00010000:02000400:29.0F:1773851502.488025:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0a76d28d-b8c9-4ae2-a94e-e228108c2897 (at 26563@kfi7) reconnecting
00010000:02000400:21.0F:1773851502.763856:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3d87da24-b427-4287-836f-67cf84d90c94 (at 8291@kfi7) reconnecting
00010000:02000400:21.0:1773851505.587888:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 03a2a88e-3158-4bde-aa9c-a45d25771d33 (at 21153@kfi7) reconnecting
00000100:02000400:16.0F:1773851508.041739:0:61342:0:(service.c:1610:ptlrpc_at_check_timed()) mdt_readpage: This server is not able to keep up with request traffic (cpu-bound).
00000100:00000400:16.0:1773851508.041741:0:61342:0:(service.c:1614:ptlrpc_at_check_timed()) earlyQ=0 reqQ=0 recA=47, svcEst=600, delay=0ms
00010000:02000400:21.0:1773851512.034311:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 666bad06-25fe-4ceb-b834-0470661e7f06 (at 192.168.128.12@o2ib60) reconnecting
00000100:02000400:1.0F:1773851540.809728:0:2494030:0:(service.c:2679:ptlrpc_watchdog_fire()) mdt00_084: service thread pid 61175 was inactive for 1224.303 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
00000100:02000400:12.0F:1773851540.809732:0:2514109:0:(service.c:2679:ptlrpc_watchdog_fire()) mdt03_069: service thread pid 60912 was inactive for 1224.304 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
00010000:02000400:2.0F:1773851550.010336:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4042a235-a60a-403f-b811-96c454acd7e5 (at 26401@kfi7) reconnecting
00010000:02000400:29.0:1773851552.672391:0:60677:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fdd24a38-47c3-4c58-b1b4-7859bf98b5b5 (at 26339@kfi7) reconnecting
00010000:02000400:9.0F:1773851555.318580:0:41171:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fd96080a-33e6-4035-b5d5-c4f2e0fc3c75 (at 26323@kfi7) reconnecting
00010000:02000400:2.0:1773851555.648691:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2e4690cb-9273-47ad-9caf-9a633dba768d (at 14816@kfi7) reconnecting
00010000:02000400:10.0F:1773851555.713489:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client d5d92dd5-7237-48c9-89c0-292bb907eb51 (at 18642@kfi7) reconnecting
00010000:02000400:4.0F:1773851564.640314:0:60976:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 97797308-f6b2-478a-a601-eb5246cb9488 (at 192.168.128.40@o2ib60) reconnecting
00010000:02000400:29.0:1773851566.280780:0:60677:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e6b486cb-e18b-48da-bd19-52418dcaa911 (at 10305@kfi7) reconnecting
00010000:02000400:4.0:1773851570.986590:0:60976:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0f151f31-d52e-46c1-a297-3c4503ee5407 (at 17584@kfi7) reconnecting
00010000:02000400:26.0F:1773851571.066857:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 16e4bc99-7b07-4eae-afe1-78fffa476cef (at 15267@kfi7) reconnecting
00000100:02000400:11.0F:1773851573.577730:0:2510946:0:(service.c:2679:ptlrpc_watchdog_fire()) mdt02_036: service thread pid 60689 was inactive for 1207.951 seconds. The thread might be hung, or it might only be slow and will resume later. Dumping the stack trace for debugging purposes:
00010000:02000400:15.0F:1773851583.045524:0:60824:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a3712ee9-fb9c-449a-927b-03a2c7dfce0c (at 17824@kfi7) reconnecting
00010000:02000400:27.0F:1773851584.962662:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 446e9609-5858-4eca-9f24-d0cc50da9fa3 (at 10961@kfi7) reconnecting
00010000:02000400:4.0:1773851588.751463:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7 (at 22579@kfi7) reconnecting
00010000:02000400:18.0F:1773851589.403299:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0aaaf0ae-3adf-4768-9796-e92833be9b18 (at 12624@kfi7) reconnecting
00010000:02000400:20.0F:1773851605.089959:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 442b5631-f9b5-4e09-aea2-9e4c3575429b (at 14433@kfi7) reconnecting
00010000:02000400:12.0:1773851605.201800:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e0617463-9db6-45c9-902a-014b15fdc2fe (at 14498@kfi7) reconnecting
00010000:02000400:18.0:1773851605.206805:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb (at 11601@kfi7) reconnecting
00010000:02000400:9.0:1773851605.216418:0:41171:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3d41f69c-c681-4606-b049-c7a92f29f23d (at 20259@kfi7) reconnecting
00010000:02000400:27.0:1773851605.234161:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2 (at 9920@kfi7) reconnecting
00010000:02000400:23.0F:1773851605.236528:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 24aa0c0d-3c4e-45d6-ae3c-badf912980be (at 14675@kfi7) reconnecting
00010000:02000400:30.0F:1773851605.316724:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 95e70f61-2824-45d5-9988-29f0ada81397 (at 21747@kfi7) reconnecting
00010000:02000400:7.0F:1773851605.389861:0:60919:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 064db4fd-29a2-4998-87eb-87410af369ba (at 10289@kfi7) reconnecting
00010000:02000400:18.0:1773851605.518252:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 935d699f-c617-4e48-96a7-4e796eb51501 (at 20592@kfi7) reconnecting
00010000:02000400:1.0:1773851605.556342:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7b563c47-b54f-4bbf-9f5d-206172800050 (at 21266@kfi7) reconnecting
00010000:02000400:28.0F:1773851605.557891:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a1f766e7-45ca-4021-baf7-2869b78b4d58 (at 15088@kfi7) reconnecting
00010000:02000400:23.0:1773851605.571093:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 112e4cf0-b379-4577-b931-b9f17463644a (at 20211@kfi7) reconnecting
00010000:02000400:26.0:1773851605.574796:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b12916bb-b658-4598-ba79-b5c5a218c697 (at 13936@kfi7) reconnecting
00010000:02000400:25.0F:1773851605.588010:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a127bbd7-a764-414e-9307-5d5c66e02d5b (at 9009@kfi7) reconnecting
00010000:02000400:1.0:1773851605.743002:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e7d87eca-5b15-4c5d-99a5-e4bddb77bf34 (at 25154@kfi7) reconnecting
00010000:02000400:9.0:1773851606.025875:0:41171:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 8f4c580e-cb98-4f09-8f03-170cdd130106 (at 17681@kfi7) reconnecting
00010000:02000400:1.0:1773851606.050111:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 81d8f0a6-5475-441f-8eb2-ba6da3482fdc (at 25233@kfi7) reconnecting
00010000:02000400:18.0:1773851606.076957:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 592c507f-ccd6-4044-839f-fd99d46495b1 (at 21585@kfi7) reconnecting
00010000:02000400:9.0:1773851606.078349:0:41171:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 34811429-c6b2-421e-b235-07cda588e89d (at 10259@kfi7) reconnecting
00010000:02000400:1.0:1773851606.085565:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a5fd2e38-596d-44a5-8fc2-20596d27a3ba (at 192.168.128.39@o2ib60) reconnecting
00010000:02000400:25.0:1773851606.109684:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fce576b6-ae1c-41f5-9897-dae5a1cd5129 (at 11906@kfi7) reconnecting
00010000:02000400:2.0:1773851606.126926:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c777fae8-84bf-407b-a2cc-2efec5d3519b (at 21682@kfi7) reconnecting
00010000:02000400:25.0:1773851606.157891:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1ba86d43-3adb-487b-b509-2e31a79a43c3 (at 22146@kfi7) reconnecting
00010000:02000400:17.0F:1773851606.247265:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 62040075-c7d4-4dd3-8c36-05637e6266e1 (at 10482@kfi7) reconnecting
00010000:02000400:25.0:1773851606.247936:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7130084e-73c0-4912-ad5f-4a092c069c65 (at 20337@kfi7) reconnecting
00010000:02000400:31.0F:1773851606.249310:0:60533:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 10c164be-21c2-4af7-bf32-80ca17bfc69c (at 20594@kfi7) reconnecting
00010000:02000400:14.0F:1773851606.251000:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7b1daea4-d38a-432f-af17-f2c91421de37 (at 12195@kfi7) reconnecting
00000100:02000400:12.0:1773851606.345732:0:2514109:0:(service.c:2686:ptlrpc_watchdog_fire()) mdt03_043: service thread pid 60712 was inactive for 1217.871 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
00000100:02000400:2.0:1773851606.345733:0:2506505:0:(service.c:2686:ptlrpc_watchdog_fire()) mdt00_012: service thread pid 60476 was inactive for 1217.870 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
00000100:02000400:15.0:1773851606.345736:0:82880:0:(service.c:1610:ptlrpc_at_check_timed()) mdt_readpage: This server is not able to keep up with request traffic (cpu-bound).
00000100:00000400:15.0:1773851606.345737:0:82880:0:(service.c:1614:ptlrpc_at_check_timed()) earlyQ=0 reqQ=0 recA=47, svcEst=600, delay=0ms
00010000:02000400:31.0:1773851606.371643:0:60533:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4aab4d56-804a-4f56-9252-987d17ee7f99 (at 11312@kfi7) reconnecting
00010000:02000400:3.0F:1773851606.395144:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ed7f393f-8111-4c3f-9ec0-8c7aba415125 (at 23153@kfi7) reconnecting
00010000:02000400:7.0:1773851606.447135:0:60976:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5c64f764-8ed7-4055-8a23-f149b09516bc (at 17907@kfi7) reconnecting
00010000:02000400:30.0:1773851606.528519:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 37374d32-bd31-4ece-8446-ba8f411b0df9 (at 21667@kfi7) reconnecting
00010000:02000400:7.0:1773851606.531090:0:60976:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 16201831-9c16-4932-a3f9-8725aef4fea9 (at 192.168.128.24@o2ib60) reconnecting
00010000:02000400:14.0:1773851606.657159:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 84194c2b-5abd-4f3b-8780-4114522f643e (at 20035@kfi7) reconnecting
00010000:02000400:9.0:1773851606.726528:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 58d48bdb-5878-492a-901c-b1eaffa8fbe6 (at 18514@kfi7) reconnecting
00010000:02000400:26.0:1773851606.784216:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 634ede5b-68a2-450e-aa69-6e0526153b59 (at 22675@kfi7) reconnecting
00010000:02000400:3.0:1773851606.810020:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2d8f9495-8f4f-4c09-b69c-2829c6c49971 (at 9122@kfi7) reconnecting
00010000:02000400:19.0F:1773851606.938512:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4fb1135c-80e8-4fba-bd27-a7d8cb531077 (at 20816@kfi7) reconnecting
00010000:02000400:25.0:1773851606.967272:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c3cf85f9-085b-4799-9c8b-160b726ef4b9 (at 20722@kfi7) reconnecting
00010000:02000400:14.0:1773851607.024756:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a8ff8b7e-ac2d-4ced-8ea1-e1c76e70ab77 (at 22928@kfi7) reconnecting
00010000:02000400:3.0:1773851607.058433:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f3103dab-b948-4502-8ded-56b82d207221 (at 11875@kfi7) reconnecting
00010000:02000400:25.0:1773851607.068764:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client bb35d9df-b897-451d-9bf0-7823e7abffd7 (at 172.16.66.134@tcp) reconnecting
00010000:02000400:28.0:1773851607.129570:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f76f91bc-d379-4db1-b5b6-36a38df7a0d1 (at 10705@kfi7) reconnecting
00010000:02000400:10.0:1773851607.239976:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fe2fec01-85c0-4406-85a9-7671e1eaf5bb (at 10576@kfi7) reconnecting
00010000:02000400:28.0:1773851607.299363:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 33595bfa-18fd-4e98-9eac-e7a741968d24 (at 9153@kfi7) reconnecting
00010000:02000400:17.0:1773851607.346625:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1d9cd995-f1e0-4691-b142-468e17c74a63 (at 17378@kfi7) reconnecting
00010000:02000400:25.0:1773851607.350627:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c35a8c5b-aa0d-4a22-9eb6-09f250de07a7 (at 17889@kfi7) reconnecting
00010000:02000400:25.0:1773851607.485231:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4a414851-4769-4450-adb9-4713c5b9a5c0 (at 9792@kfi7) reconnecting
00010000:02000400:4.0:1773851607.524160:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0a9a84d7-3b33-4079-b892-6b1b660a69ab (at 24480@kfi7) reconnecting
00010000:02000400:17.0:1773851607.839978:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 8162f468-ab4e-4359-855e-8e3883ad0f78 (at 15522@kfi7) reconnecting
00010000:02000400:31.0:1773851607.910119:0:60533:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client cb351f9e-4d35-44da-826f-555f023ed859 (at 16002@kfi7) reconnecting
00010000:02000400:3.0:1773851608.116368:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 47ac7234-bbb8-455f-b6d4-223893c86e76 (at 11536@kfi7) reconnecting
00010000:02000400:21.0:1773851608.118457:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5292b7b9-533d-4f94-92b4-7c8c783359e6 (at 12128@kfi7) reconnecting
00010000:02000400:14.0:1773851608.440787:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6eb2aa37-6a67-4af8-9d80-735dc4a16d05 (at 20754@kfi7) reconnecting
00010000:02000400:10.0:1773851608.477404:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client afc43426-7358-4285-8350-05d8e010e254 (at 23506@kfi7) reconnecting
00010000:02000400:27.0:1773851608.913687:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b843b541-a4c6-482f-a046-40b3bbbfd095 (at 9057@kfi7) reconnecting
00010000:02000400:21.0:1773851608.972172:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e821b58d-0b5a-422e-ace5-6066ed9bda6c (at 17539@kfi7) reconnecting
00010000:02000400:31.0:1773851609.019623:0:60533:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 628ab049-f83e-430f-963a-928b8c6224b2 (at 21264@kfi7) reconnecting
00010000:02000400:5.0F:1773851609.080755:0:60919:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0a4675d8-f1ca-49b3-9755-206acd16ceb9 (at 22018@kfi7) reconnecting
00010000:02000400:8.0F:1773851609.112013:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0e9dc097-bc4a-4195-abb5-413e5376081f (at 15426@kfi7) reconnecting
00010000:02000400:8.0:1773851609.119109:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client d1f64a63-eaca-46c8-b7f9-a99e22eb98f4 (at 18962@kfi7) reconnecting
00010000:02000400:27.0:1773851609.229992:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 49a8a4b7-74c4-47ed-b9ef-d4774f09047d (at 10386@kfi7) reconnecting
00010000:02000400:21.0:1773851609.741066:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client cf92737d-a747-44ac-b7f8-8f7f96aa3b76 (at 11363@kfi7) reconnecting
00010000:02000400:3.0:1773851610.095067:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 14b4eaeb-c743-40a6-933a-619c988afe22 (at 22241@kfi7) reconnecting
00010000:02000400:8.0:1773851610.528545:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client deec8167-560d-484b-8611-2c460a2db78b (at 15619@kfi7) reconnecting
00010000:02000400:6.0F:1773851611.079564:0:60963:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c04f0787-7df2-4df9-9a2b-817efb3a3a03 (at 20642@kfi7) reconnecting
00010000:02000400:31.0:1773851611.501793:0:60533:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client defbcc6c-3580-43a4-950c-b09516f54ec8 (at 21184@kfi7) reconnecting
00010000:02000400:24.0F:1773851611.648906:0:60547:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 429ba700-3a73-4a1e-94e0-f2d2c040c60e (at 20961@kfi7) reconnecting
00010000:02000400:21.0:1773851612.025324:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c5a31666-2451-4528-af13-9142bc328874 (at 21040@kfi7) reconnecting
00010000:02000400:10.0:1773851614.353534:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f0b7562b-8bd0-4d58-abfb-b60e73f92c80 (at 19617@kfi7) reconnecting
00010000:02000400:14.0:1773851614.853653:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e2a26e9b-6b8c-46e2-80ee-c334700fa96c (at 9458@kfi7) reconnecting
00010000:02000400:3.0:1773851615.493828:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 726a12db-5a5e-4487-b031-20a1f1bb333e (at 9859@kfi7) reconnecting
00010000:02000400:10.0:1773851616.916682:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ecbd1db4-b008-4e21-a987-5be2d7eeac87 (at 24899@kfi7) reconnecting
00010000:02000400:17.0:1773851617.977213:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client d68c5fbe-4986-4f1e-bcf1-75da1ece0b18 (at 192.168.128.11@o2ib60) reconnecting
00010000:02000400:10.0:1773851626.337840:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 76fb9548-052c-4505-a24b-97882ed0a9cb (at 21442@kfi7) reconnecting
00010000:02000400:25.0:1773851626.526873:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 76eaa1ef-5ee4-426c-80cc-0867211b0760 (at 13395@kfi7) reconnecting
00010000:02000400:25.0:1773851628.766703:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3c6dca2e-bb6d-4ce0-864d-e220cb5c77a9 (at 8336@kfi7) reconnecting
00010000:02000400:25.0:1773851628.774906:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 28906e78-e409-4eb1-af7f-b3f7f66f1164 (at 8673@kfi7) reconnecting
00010000:02000400:22.0F:1773851629.742196:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9024fc76-21ae-4cf4-a0c7-74cfb5e2ee99 (at 8464@kfi7) reconnecting
00010000:02000400:6.0:1773851629.792930:0:60963:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e (at 18178@kfi7) reconnecting
00010000:02000400:10.0:1773851631.058811:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 285fe4b9-e0a6-475c-9d5e-6c1748ab64c6 (at 19649@kfi7) reconnecting
00010000:02000400:30.0:1773851631.168342:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b9059a34-2344-4c58-b046-9ffd24d46dbe (at 9891@kfi7) reconnecting
00010000:02000400:22.0:1773851640.350178:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5478d6d5-3931-49e6-ba59-2f4ac28c9d8d (at 15698@kfi7) reconnecting
00010000:02000400:15.0:1773851641.657618:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 39fbe3bc-efde-4d80-a4a0-1d91e2f05a53 (at 9089@kfi7) reconnecting
00000100:00000400:0.0F:1773851647.305736:0:60951:0:(service.c:1437:ptlrpc_at_send_early_reply()) @@@ Could not add any time (1/-491), not sending early reply  req@000000005887a2c4 x1859599067307712/t0(0) o101->87b76d15-c25b-4f6f-903c-f5cfb2f3e5f2@17936@kfi7:288/0 lens 2536/5304 e 0 to 0 dl 1773851648 ref 2 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833102119426980864'
00010000:02000400:18.0:1773851648.771385:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1b454b22-87b3-43e4-af26-776c4b50e7a5 (at 8817@kfi7) reconnecting
00010000:02000400:18.0:1773851648.966616:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 474ba743-2457-4a0f-b800-0c7a07b7ce43 (at 8736@kfi7) reconnecting
00010000:02000400:0.0:1773851651.189291:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5d0355ee-385b-4027-a549-a9f96151542e (at 24130@kfi7) reconnecting
00010000:02000400:25.0:1773851651.218149:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2d96c80e-450f-42db-9d68-0d1939aa6dd1 (at 24353@kfi7) reconnecting
00010000:02000400:30.0:1773851651.741003:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 74336d25-d7db-4c25-99aa-e7e34da89239 (at 24546@kfi7) reconnecting
00010000:02000400:3.0:1773851652.467417:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0972e34a-e2b8-47bd-91d5-7bfd2b16c95e (at 24401@kfi7) reconnecting
00010000:02000400:30.0:1773851654.327437:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 58c93f4a-a669-458e-8eaa-6522874fc8ff (at 25937@kfi7) reconnecting
00010000:02000400:0.0:1773851655.814054:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f0ebef98-f473-4914-88d8-8c3cff8eea0a (at 9971@kfi7) reconnecting
00010000:02000400:22.0:1773851659.183960:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b1994ce0-73f4-44e3-8721-2aa9fd18171a (at 13248@kfi7) reconnecting
00010000:02000400:15.0:1773851665.841526:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6adfce06-1874-4549-bcd7-31756e5bb1f6 (at 22002@kfi7) reconnecting
00010000:02000400:9.0:1773851670.853556:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client bdf32223-29b0-492f-bf72-5e247d6ea511 (at 192.168.128.1@o2ib60) reconnecting
00010000:02000400:31.0:1773851671.111271:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 10e8c037-c48a-4902-bf55-717087ee6aea (at 26418@kfi7) reconnecting
00010000:02000400:31.0:1773851680.575602:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 107bb794-15dd-432e-83be-a15ea9179233 (at 192.168.128.22@o2ib60) reconnecting
00010000:02000400:25.0:1773851681.483171:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 21302aa0-e233-4eaa-ab68-cfd28a7997c5 (at 192.168.128.29@o2ib60) reconnecting
00010000:02000400:12.0:1773851685.374007:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client dcd0bcb5-7767-40f9-a2bc-ec30e5896d84 (at 192.168.128.50@o2ib60) reconnecting
00010000:02000400:12.0:1773851689.149965:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 407b5661-aeac-4193-94ec-3d90f24ca73d (at 8979@kfi7) reconnecting
00010000:02000400:17.0:1773851693.059609:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 039bd2dd-a8e9-4141-8fec-ec772eebc470 (at 9809@kfi7) reconnecting
00010000:02000400:23.0:1773851694.538838:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9a397082-c833-42f8-9bae-0377ad59b12d (at 26578@kfi7) reconnecting
00000020:00000080:17.0:1773851701.601498:0:61039:0:(genops.c:1262:class_connect()) connect: client 0af21a81-b617-44f7-9853-1bb9301810dc, cookie 0x21b6f08f07a6a83e
00000020:01000000:17.0:1773851701.601533:0:61039:0:(lprocfs_status_server.c:547:lprocfs_exp_setup()) using hash 00000000b63846cc
00000100:00020000:11.0:1773851702.436737:0:46276:0:(service.c:3665:ptlrpc_svcpt_health_check()) mdt_readpage: unhealthy - request has been waiting 8917s
00000100:00020000:11.0:1773851702.459256:0:46276:0:(service.c:3665:ptlrpc_svcpt_health_check()) mdt_io: unhealthy - request has been waiting 9387s
00010000:02000400:1.0:1773851702.761963:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 561e8f84-6e6b-423f-abef-0c029a806187 (at 8992@kfi7) reconnecting
00000100:02000400:8.0:1773851704.649745:0:2507421:0:(service.c:2686:ptlrpc_watchdog_fire()) mdt02_024: service thread pid 60604 was inactive for 1226.724 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
00000100:02000400:1.0:1773851704.649745:0:61231:0:(service.c:1610:ptlrpc_at_check_timed()) mdt_readpage: This server is not able to keep up with request traffic (cpu-bound).
00000100:00000400:1.0:1773851704.664455:0:61231:0:(service.c:1614:ptlrpc_at_check_timed()) earlyQ=0 reqQ=0 recA=47, svcEst=600, delay=0ms
00010000:02000400:17.0:1773851708.919583:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fd96080a-33e6-4035-b5d5-c4f2e0fc3c75 (at 26323@kfi7) reconnecting
00010000:02000400:23.0:1773851710.476961:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 175d5e2d-3f56-4ee8-b3c9-5168d834caab (at 24896@kfi7) reconnecting
00010000:02000400:15.0:1773851714.860032:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 87b76d15-c25b-4f6f-903c-f5cfb2f3e5f2 (at 17936@kfi7) reconnecting
00010000:02000400:15.0:1773851717.775248:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3f210437-b2af-4977-93b4-45f1c345c3ce (at 192.168.128.2@o2ib60) reconnecting
00010000:02000400:17.0:1773851719.977890:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 8430ea0a-9031-46d9-a2b3-76c3cf5661db (at 25027@kfi7) reconnecting
00010000:02000400:24.0:1773851722.555264:0:60973:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 087d6d67-1f17-4c7d-a1ce-16981fcbca19 (at 192.168.128.45@o2ib60) reconnecting
00010000:02000400:17.0:1773851722.679345:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e92405a9-77b7-4a55-89fa-dd9318c4153d (at 25329@kfi7) reconnecting
00010000:02000400:2.0:1773851725.407308:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9425ee17-c664-4410-9c77-8bb2fce56ce3 (at 19585@kfi7) reconnecting
00010000:02000400:15.0:1773851725.652842:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b5b246d9-bca1-4006-a17b-0232148da656 (at 172.19.3.154@o2ib600) reconnecting
00010000:02000400:2.0:1773851729.068215:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a6584785-3693-41d4-9d33-74287039577b (at 192.168.128.15@o2ib60) reconnecting
00010000:02000400:5.0:1773851731.954253:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 13dba3bf-2efd-4d7b-98aa-6cd66cec9e48 (at 26035@kfi7) reconnecting
00010000:02000400:23.0:1773851732.057935:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4109ff27-9e90-425c-accb-7a02287a1338 (at 13776@kfi7) reconnecting
00010000:02000400:17.0:1773851733.702786:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 827e52ce-922a-4fad-af6a-c0e3896e3e97 (at 25602@kfi7) reconnecting
00010000:02000400:31.0:1773851740.236117:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b25f32ff-1100-4bf9-a6ba-ec2e65117e7d (at 192.168.128.30@o2ib60) reconnecting
00010000:02000400:27.0:1773851741.367831:0:60973:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4d613da8-52a2-45c5-a864-e0ec635d8ba1 (at 14656@kfi7) reconnecting
00010000:02000400:20.0:1773851744.194019:0:60597:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 122166f5-6483-4cb3-a21b-391a806cb4c1 (at 15873@kfi7) reconnecting
00010000:02000400:3.0:1773851745.066702:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f61681f3-4133-41d6-92e0-a5a4ecd7e345 (at 22529@kfi7) reconnecting
00010000:02000400:25.0:1773851746.854700:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6d42f42e-b76c-4e3f-b11e-73d248fbe8f9 (at 26594@kfi7) reconnecting
00010000:02000400:5.0:1773851747.287632:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 99980d39-4618-4308-b620-5cf6e74a4e01 (at 22642@kfi7) reconnecting
00010000:02000400:31.0:1773851748.016228:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 396b608f-c2d1-4dee-979d-4441a31d5059 (at 20162@kfi7) reconnecting
00010000:02000400:23.0:1773851748.792081:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5185891a-8005-454a-996b-8a54662acd73 (at 8256@kfi7) reconnecting
00010000:02000400:23.0:1773851751.659295:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7c16d158-8ab1-4a3c-916a-c05459bcd3f4 (at 9362@kfi7) reconnecting
00010000:02000400:5.0:1773851756.268613:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0a4169e8-768e-4452-8480-75487a8f3028 (at 18145@kfi7) reconnecting
00010000:02000400:5.0:1773851758.272497:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client edddd82f-128c-4bbd-98a4-4162bc248cc0 (at 25667@kfi7) reconnecting
00010000:02000400:23.0:1773851759.018478:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1c46fc79-8484-4fc4-9a0c-97f7f862c38f (at 15393@kfi7) reconnecting
00010000:02000400:23.0:1773851759.072898:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2ab62f37-9b9a-41b1-936a-025483f1a40f (at 12272@kfi7) reconnecting
00010000:02000400:5.0:1773851759.101496:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 16c1886b-0bf5-4608-aef8-bc708d72171f (at 14915@kfi7) reconnecting
00010000:02000400:26.0:1773851759.106568:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e9935e65-4158-4feb-914b-833bc49c07bc (at 17745@kfi7) reconnecting
00010000:02000400:5.0:1773851759.107582:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ec2046a4-2a43-41b0-ab33-f81a9046ea80 (at 12611@kfi7) reconnecting
00010000:02000400:5.0:1773851759.109660:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f8433525-5654-4c28-923f-4a463922e065 (at 15937@kfi7) reconnecting
00010000:02000400:17.0:1773851759.111336:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 64912edd-4a24-4f8f-aeb1-0c974bf06e15 (at 16083@kfi7) reconnecting
00010000:02000400:23.0:1773851759.140675:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6910f24b-1325-4279-a645-3cfc980f087a (at 17360@kfi7) reconnecting
00010000:02000400:2.0:1773851759.141867:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3c1dcbfd-c698-44c4-b316-ced7b860f7c8 (at 15313@kfi7) reconnecting
00010000:02000400:2.0:1773851759.145263:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ccc7f283-ce88-4049-b0b7-c53c16010a0f (at 16963@kfi7) reconnecting
00010000:02000400:11.0:1773851759.147016:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b41e64fe-037f-4d4e-8965-c9908618df7e (at 17139@kfi7) reconnecting
00010000:02000400:17.0:1773851759.154326:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client d490388b-0f0e-413d-b949-19f6e15372d5 (at 17314@kfi7) reconnecting
00010000:02000400:2.0:1773851759.167065:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f5799e18-7327-4b0c-90aa-cca7af6e8be2 (at 15731@kfi7) reconnecting
00010000:02000400:15.0:1773851759.168485:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client dbaaf0d0-653d-4e03-8593-8ade057760cb (at 14881@kfi7) reconnecting
00010000:02000400:2.0:1773851759.289323:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client bdd7fbfb-283a-4d60-8d79-9a7c56e7f020 (at 17488@kfi7) reconnecting
00010000:02000400:5.0:1773851759.306479:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a5baac08-ada4-4e91-80c9-f3fba4c7362d (at 16482@kfi7) reconnecting
00010000:02000400:11.0:1773851759.307665:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9bc7aa7a-6966-4de1-8528-e0c2cf015742 (at 15025@kfi7) reconnecting
00010000:02000400:11.0:1773851759.327465:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2f9f3282-c8a0-4a0c-8522-056ed21bf2b3 (at 16994@kfi7) reconnecting
00010000:02000400:2.0:1773851759.332132:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9a6d27bd-980d-49de-a508-e9c3c8348818 (at 17280@kfi7) reconnecting
00010000:02000400:2.0:1773851759.332635:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5bbf59c3-3a7b-432b-ad1a-26c0212771ba (at 9744@kfi7) reconnecting
00010000:02000400:23.0:1773851759.340250:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3f0b9064-24dc-4145-8d9a-ea6d55d3c43a (at 13026@kfi7) reconnecting
00010000:02000400:5.0:1773851759.349950:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 69079148-1c62-4a2b-9d73-dd3130b7ca93 (at 16224@kfi7) reconnecting
00010000:02000400:18.0:1773851759.354269:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e9fb25d4-ba74-491d-b298-23dcdd3a56d3 (at 14963@kfi7) reconnecting
00010000:02000400:11.0:1773851759.356352:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3761013e-3503-4a7d-ad92-4b3a0f692635 (at 17729@kfi7) reconnecting
00010000:02000400:15.0:1773851759.363016:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0e5a5571-e48e-44ef-97f9-8979bd6a706c (at 17616@kfi7) reconnecting
00010000:02000400:31.0:1773851759.363226:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5c4c66a5-a226-45a5-ba3d-944cfa5bd32a (at 16322@kfi7) reconnecting
00010000:02000400:2.0:1773851759.367794:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 62217b19-f1f3-4b67-835d-5fa0b5a2b304 (at 15107@kfi7) reconnecting
00010000:02000400:15.0:1773851759.566907:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3b6ddb7f-ba7c-4fdc-8cab-d607c460281a (at 15600@kfi7) reconnecting
00010000:02000400:6.0:1773851759.582742:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4484b002-9275-45d1-b6d2-2961aa64a760 (at 17778@kfi7) reconnecting
00010000:02000400:31.0:1773851759.691596:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7f89c4e7-6b1a-440f-9a9c-ad5fc72d8263 (at 16864@kfi7) reconnecting
00010000:02000400:15.0:1773851759.710717:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client eee653b6-2872-450b-b441-d87a5a423c5a (at 17185@kfi7) reconnecting
00010000:02000400:15.0:1773851759.731198:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4456cb5b-6d36-4bbc-8af9-eba1e5a16ef3 (at 15168@kfi7) reconnecting
00010000:02000400:26.0:1773851759.754864:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7942ab61-ce00-451d-9039-e81b4360cc8c (at 13683@kfi7) reconnecting
00010000:02000400:11.0:1773851759.765864:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b3201d7d-753a-4f48-9f85-cc017c9fec47 (at 12883@kfi7) reconnecting
00010000:02000400:31.0:1773851759.794280:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client db05533a-8558-4472-97ff-ec2fc477b9b3 (at 16464@kfi7) reconnecting
00010000:02000400:2.0:1773851759.801550:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 754185ba-462f-4d90-8973-f571c611bdc5 (at 16099@kfi7) reconnecting
00010000:02000400:23.0:1773851759.801852:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b9120b51-905e-43f5-ad42-6391095c2ce2 (at 14048@kfi7) reconnecting
00010000:02000400:15.0:1773851759.802514:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e2467d76-3b16-4939-b466-9bcfd13a2b24 (at 15921@kfi7) reconnecting
00010000:02000400:15.0:1773851759.802683:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client efb7a0d9-e5bd-41be-b394-f0453992f74b (at 16369@kfi7) reconnecting
00010000:02000400:6.0:1773851759.809552:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6aea1e98-c793-44b2-819e-483a27f3a444 (at 15251@kfi7) reconnecting
00010000:02000400:31.0:1773851759.810046:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c9bd2fce-cb80-40b0-b511-2a3a04231025 (at 16993@kfi7) reconnecting
00010000:02000400:6.0:1773851759.953489:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a66bc9af-c54e-47cd-86b7-8af6542e7495 (at 14321@kfi7) reconnecting
00010000:02000400:6.0:1773851759.977225:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0473ceb1-503d-4a9a-b5a0-7154fe6e70dd (at 15635@kfi7) reconnecting
00010000:02000400:18.0:1773851759.984369:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 66457748-d5c4-4587-842a-b9f28f8c396e (at 26337@kfi7) reconnecting
00010000:02000400:18.0:1773851759.985308:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 681ab022-f57f-4e9a-9749-47d4f86a630a (at 17618@kfi7) reconnecting
00010000:02000400:31.0:1773851759.991517:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ce913412-1d1d-4164-9ba6-c1c77f66752e (at 17091@kfi7) reconnecting
00010000:02000400:18.0:1773851759.992593:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5d86713b-2b9d-42ca-a4a5-f95d329c9652 (at 11953@kfi7) reconnecting
00010000:02000400:15.0:1773851759.994064:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4edc44b4-2aeb-4b04-9fcc-a1cebb66d421 (at 14912@kfi7) reconnecting
00010000:02000400:26.0:1773851759.996330:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client bd54ef8e-2c0a-4d3f-a57c-71bd38068e17 (at 16354@kfi7) reconnecting
00010000:02000400:6.0:1773851760.008486:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 97dd8ede-9a51-437a-bfb5-4de5d731233c (at 12641@kfi7) reconnecting
00010000:02000400:18.0:1773851760.008903:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a21723b1-34e7-4d82-8dc4-233ebdaeb496 (at 9042@kfi7) reconnecting
00010000:02000400:31.0:1773851760.028729:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e1c6b307-b697-4dc3-a988-697985ba3742 (at 17283@kfi7) reconnecting
00010000:02000400:6.0:1773851760.033554:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f6d31b93-99b1-43a3-bac3-0f4c09ec1156 (at 16690@kfi7) reconnecting
00010000:02000400:23.0:1773851760.053652:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9f2168a0-e583-436c-a696-427035fe7cc1 (at 14864@kfi7) reconnecting
00010000:02000400:23.0:1773851760.060936:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0dbcfa62-9b36-4002-90c7-b9e8591c6922 (at 17107@kfi7) reconnecting
00010000:02000400:18.0:1773851760.061636:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6b0e3ba6-536b-44cc-88c9-40bbde5ca29b (at 15746@kfi7) reconnecting
00010000:02000400:11.0:1773851760.065709:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5aeca130-4025-47f5-86be-076502129638 (at 14385@kfi7) reconnecting
00010000:02000400:23.0:1773851760.072677:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4ba95859-4be6-4d15-98cb-e271c2b6a0dc (at 15729@kfi7) reconnecting
00010000:02000400:23.0:1773851760.075949:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7b6f2c30-5b3c-4bdb-ae2c-b4abcbb9b49e (at 16929@kfi7) reconnecting
00010000:02000400:6.0:1773851760.082382:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7446b5a6-5ece-4de8-b704-bd7e84cce4c6 (at 16145@kfi7) reconnecting
00010000:02000400:26.0:1773851760.103212:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a2fa94f4-ff02-46b7-a1c6-6875a7c55483 (at 13907@kfi7) reconnecting
00010000:02000400:15.0:1773851760.108699:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c50ff5a4-7248-473e-8fa2-4c9141049526 (at 16210@kfi7) reconnecting
00010000:02000400:18.0:1773851760.126462:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fecbee8c-622c-4b59-81ec-aec84c2ad1e1 (at 14176@kfi7) reconnecting
00010000:02000400:15.0:1773851760.171067:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9f03d7bb-7dac-4838-a79c-6b365f41ac8c (at 16129@kfi7) reconnecting
00010000:02000400:11.0:1773851760.177520:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9fc16aa3-2121-4855-92ae-328c5df5b3dd (at 16418@kfi7) reconnecting
00010000:02000400:23.0:1773851760.179249:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2f6dbe94-2578-485e-84cf-f4e45b43989a (at 17008@kfi7) reconnecting
00010000:02000400:2.0:1773851760.205377:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 4127317b-d94b-4c17-9ae7-b7fcb6db47f4 (at 14867@kfi7) reconnecting
00010000:02000400:31.0:1773851760.206275:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5ef68508-0e37-4a63-b8d1-91a2f1213eb1 (at 16032@kfi7) reconnecting
00010000:02000400:2.0:1773851760.240574:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9bb1d57f-ca9a-4ede-9a9f-808d7ee5dbd3 (at 15395@kfi7) reconnecting
00010000:02000400:15.0:1773851760.244639:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client d16ca4d9-fe5e-4fc4-a5c2-322d76678650 (at 13872@kfi7) reconnecting
00010000:02000400:15.0:1773851760.251345:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 23400b3a-61b1-4c12-b457-4f759058ca68 (at 14016@kfi7) reconnecting
00010000:02000400:6.0:1773851760.269981:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6bdafd76-87f0-4676-a5f9-ca6aa86286d8 (at 16594@kfi7) reconnecting
00010000:02000400:2.0:1773851760.277450:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7c56ebde-86e9-4a5b-8754-bbedb7bddb49 (at 15666@kfi7) reconnecting
00010000:02000400:26.0:1773851760.286260:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 77dcecd7-5e65-45dc-9a02-c55cb2ccee9e (at 15474@kfi7) reconnecting
00010000:02000400:2.0:1773851760.289682:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1ee42e26-cf39-4035-85e6-737f17a400c4 (at 17171@kfi7) reconnecting
00010000:02000400:11.0:1773851760.292541:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2fbea89a-36a0-4998-88a9-9911ab0be7d0 (at 13441@kfi7) reconnecting
00010000:02000400:2.0:1773851760.312433:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5f2a9d79-8f42-494c-b9e6-407fc4ec5c47 (at 14291@kfi7) reconnecting
00010000:02000400:31.0:1773851760.315481:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c4ed6125-07eb-4cb8-a1f7-1a36ae253e22 (at 15554@kfi7) reconnecting
00010000:02000400:2.0:1773851760.320259:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 43552797-cdad-44d1-ae09-5f3ead2cfc26 (at 17777@kfi7) reconnecting
00010000:02000400:11.0:1773851760.332839:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c57395c0-3fa6-419f-a38f-1741f2d104dc (at 15249@kfi7) reconnecting
00010000:02000400:2.0:1773851760.334265:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 01143989-8a17-4a30-9e1d-b6b0fa770cfc (at 16480@kfi7) reconnecting
00010000:02000400:26.0:1773851760.336896:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ee0b7bea-34a6-4a5f-900c-7e2132c7f70f (at 17010@kfi7) reconnecting
00010000:02000400:6.0:1773851760.354809:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f1b56db3-574f-48f0-a487-c7ecaab28e91 (at 15217@kfi7) reconnecting
00010000:02000400:2.0:1773851760.380413:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 09fb575b-ce24-48c9-9e85-9c4f23276d6b (at 12803@kfi7) reconnecting
00010000:02000400:0.0:1773851760.383271:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f18cc8f4-2a73-4a24-9eb4-c872250ccbf8 (at 15264@kfi7) reconnecting
00010000:02000400:19.0:1773851760.396992:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2ce99abf-a18e-4e1d-ad2c-e1528d3362b1 (at 16530@kfi7) reconnecting
00010000:02000400:21.0:1773851760.458703:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ffe94d8f-513a-40cc-9593-62eb041f5f3f (at 14256@kfi7) reconnecting
00010000:02000400:3.0:1773851760.466675:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 37aec047-b314-4020-9e03-3f6239e2ff0c (at 16352@kfi7) reconnecting
00010000:02000400:11.0:1773851760.506103:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9f4565ea-41b8-4988-9d56-b588e79f976b (at 16096@kfi7) reconnecting
00010000:02000400:21.0:1773851760.511141:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7bd3e402-efc4-4de8-b0b2-384476d7baa9 (at 10643@kfi7) reconnecting
00010000:02000400:31.0:1773851760.528869:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6ddf01e1-0880-4d34-b10a-b3847f0db02e (at 17104@kfi7) reconnecting
00010000:02000400:26.0:1773851760.530222:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ea1235ca-f554-4171-a8be-27a13e37ec9c (at 16834@kfi7) reconnecting
00010000:02000400:15.0:1773851760.531406:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client bef101e9-3dff-4771-937a-ffe70e4a12ca (at 12529@kfi7) reconnecting
00010000:02000400:19.0:1773851760.563178:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client eb430038-f778-4932-abe4-8cfca1d040fb (at 15137@kfi7) reconnecting
00010000:02000400:3.0:1773851760.563188:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 92663247-6017-41e1-b37a-a0ef78564c7e (at 14899@kfi7) reconnecting
00010000:02000400:26.0:1773851760.566911:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 854a7fb4-d024-469b-8503-9ef1129b3fcf (at 17233@kfi7) reconnecting
00010000:02000400:11.0:1773851760.567359:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 36361e6d-d0ea-4dc1-933a-ddef73e1468a (at 14945@kfi7) reconnecting
00010000:02000400:6.0:1773851760.605328:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 45481d71-4346-4520-8d8e-2ec07865c4a5 (at 9139@kfi7) reconnecting
00010000:02000400:21.0:1773851760.609252:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1dfafdc3-f3bc-47ac-99ea-8b6d9ed2d7d2 (at 16961@kfi7) reconnecting
00010000:02000400:3.0:1773851760.624420:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6f6e77b7-9f72-4e5d-9880-0a7342d2b6db (at 14946@kfi7) reconnecting
00010000:02000400:3.0:1773851760.631030:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a277e44e-6d60-4275-a420-408bc42019ed (at 16515@kfi7) reconnecting
00010000:02000400:26.0:1773851760.658505:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b12fd27e-5d7d-467c-babb-e02f175d2b7d (at 15155@kfi7) reconnecting
00010000:02000400:11.0:1773851760.681385:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 97f231cf-cca9-4b82-bf7f-d79a9b9855bc (at 11649@kfi7) reconnecting
00010000:02000400:31.0:1773851760.706675:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client eb016a4c-4761-44c0-ae51-303c1ec4ee32 (at 17392@kfi7) reconnecting
00010000:02000400:6.0:1773851760.714433:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 0f63a077-19b5-4018-85bf-1c860301b215 (at 13778@kfi7) reconnecting
00010000:02000400:19.0:1773851760.723398:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f920bebe-788d-4be2-8d05-6738b016b355 (at 15488@kfi7) reconnecting
00010000:02000400:6.0:1773851760.726696:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 27c5fcd3-dd51-486b-846e-34d091ff1ad7 (at 16931@kfi7) reconnecting
00010000:02000400:21.0:1773851760.828513:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 2b7429a1-47e0-447d-b9d9-cf6f7a57e3f0 (at 16435@kfi7) reconnecting
00010000:02000400:3.0:1773851760.859933:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 610145ec-e350-4557-aa8f-8cef08cab8b6 (at 9987@kfi7) reconnecting
00010000:02000400:3.0:1773851760.872031:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client e19f469b-d2cd-4764-9843-223086f47f25 (at 15697@kfi7) reconnecting
00010000:02000400:3.0:1773851760.882472:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5bc4ae68-43c4-43e1-a1cc-cff6914f11a5 (at 9760@kfi7) reconnecting
00010000:02000400:6.0:1773851760.903824:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client d001d61c-6820-4ab0-9e2b-f7db7ab82c4f (at 14546@kfi7) reconnecting
00010000:02000400:19.0:1773851760.920407:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c70342de-253f-4241-b778-22a0fde48108 (at 12498@kfi7) reconnecting
00010000:02000400:31.0:1773851760.928025:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 99cd9bad-32b8-494f-8119-f19960e9e1ff (at 17152@kfi7) reconnecting
00010000:02000400:15.0:1773851760.945159:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7e90dac2-9caa-4c1a-9bb9-7611eb269d24 (at 10899@kfi7) reconnecting
00010000:02000400:21.0:1773851761.064310:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a655c6da-8b04-40b4-9137-c5762235c3dd (at 17649@kfi7) reconnecting
00010000:02000400:26.0:1773851761.074371:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 99fe3856-aa45-431c-bc28-95d5f3c66008 (at 14928@kfi7) reconnecting
00010000:02000400:21.0:1773851761.241075:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 45cf2c93-56e6-4337-b4fb-8b3b2791d2bc (at 16593@kfi7) reconnecting
00010000:02000400:26.0:1773851761.299687:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7c27b615-ee7e-4601-80b8-e036e384c7c0 (at 10674@kfi7) reconnecting
00010000:02000400:21.0:1773851761.306770:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ce48d17e-1973-456c-afe2-c0e897c518a3 (at 16721@kfi7) reconnecting
00010000:02000400:6.0:1773851761.459168:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b6f312c2-b0c0-43b6-87dd-7644fb88cd55 (at 10401@kfi7) reconnecting
00010000:02000400:15.0:1773851761.507647:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 969de6db-b80f-4ff2-a7fa-86443a1728a3 (at 11715@kfi7) reconnecting
00010000:02000400:19.0:1773851761.517803:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client cd21aa94-9f33-4364-af72-18771b7316a3 (at 14848@kfi7) reconnecting
00010000:02000400:26.0:1773851761.556936:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 745a2b3e-5353-4b51-8483-b8f22fae073e (at 16978@kfi7) reconnecting
00010000:02000400:3.0:1773851761.700624:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9c3fe0ad-d92d-4a26-ab12-485047113a65 (at 13921@kfi7) reconnecting
00010000:02000400:30.0:1773851761.922759:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 5919f571-2547-417a-bee8-fa9bf29bc07c (at 15283@kfi7) reconnecting
00010000:02000400:15.0:1773851762.487831:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 180e8271-63ad-4ad5-bdd9-af4c3ccfc7e2 (at 26080@kfi7) reconnecting
00010000:02000400:30.0:1773851765.530351:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client dc66b26a-f828-4fce-ae61-fc752be8ece0 (at 26195@kfi7) reconnecting
00010000:02000400:30.0:1773851766.359924:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 57ba1c50-b58a-4faf-8125-4196896551b4 (at 17920@kfi7) reconnecting
00010000:02000400:30.0:1773851766.689657:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fd635769-9a1e-45d0-873e-30224a90594b (at 8289@kfi7) reconnecting
00010000:02000400:3.0:1773851766.700704:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client d802bead-707f-4cdb-a5ed-40dd8b083bfb (at 17395@kfi7) reconnecting
00010000:02000400:15.0:1773851766.957223:0:60487:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 6fb296c2-104d-44c6-bb96-922277c04635 (at 8417@kfi7) reconnecting
00010000:02000400:19.0:1773851767.450329:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 179dc248-1257-4dfe-bb71-f157f3daaf14 (at 20064@kfi7) reconnecting
00010000:02000400:1.0:1773851767.572676:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client c51edf73-0e96-4dd6-a341-0dcf83280983 (at 26210@kfi7) reconnecting
00000100:02000400:1.0:1773851770.185732:0:2494030:0:(service.c:2686:ptlrpc_watchdog_fire()) mdt00_033: service thread pid 60679 was inactive for 1213.198 seconds. Watchdog stack traces are limited to 3 per 300 seconds, skipping this one.
00010000:02000400:28.0:1773851773.339648:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 8d097ed6-c19b-4604-82d2-088a3de4b6c7 (at 25569@kfi7) reconnecting
00010000:02000400:26.0:1773851774.456562:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f2a5e305-02f8-4462-b17e-321aee48ad09 (at 20371@kfi7) reconnecting
00010000:02000400:31.0:1773851777.904945:0:60533:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client afaf3d47-598c-48f2-b14c-699189db912f (at 9408@kfi7) reconnecting
00010000:02000400:10.0:1773851778.711416:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1ce70c7d-3d69-42af-9ef7-6aba2ebceb36 (at 16706@kfi7) reconnecting
00010000:02000400:22.0:1773851778.929038:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 287f02d3-54ec-4ae5-a397-7889dbda0366 (at 13234@kfi7) reconnecting
00010000:02000400:31.0:1773851783.367238:0:60533:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client a871cb5b-5147-4743-a621-894b5cc44762 (at 9297@kfi7) reconnecting
00010000:02000400:22.0:1773851785.007463:0:60934:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 93368f21-5f10-4a11-aee1-c989c3028670 (at 19683@kfi7) reconnecting
00010000:02000400:0.0:1773851786.172188:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 32859ecf-de5f-4885-ad6a-a0a868764196 (at 172.16.70.108@tcp) reconnecting
00010000:02000400:18.0:1773851786.470229:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 98f52e34-938a-4df6-a93f-54c89d007e99 (at 19394@kfi7) reconnecting
00010000:02000400:7.0:1773851794.304380:0:60963:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7fc5910d-f170-4eda-bc46-60ec6a7ee835 (at 13874@kfi7) reconnecting
00010000:02000400:24.0:1773851794.389263:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ac570c85-47a9-43e5-b335-bd4576ce9c1e (at 9424@kfi7) reconnecting
00010000:02000400:10.0:1773851802.360266:0:60756:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9d12c826-b35e-43a0-8ab1-06827351a10f (at 192.168.128.41@o2ib60) reconnecting
00000100:02000400:16.0:1773851802.953758:0:61025:0:(service.c:1610:ptlrpc_at_check_timed()) mdt_io: This server is not able to keep up with request traffic (cpu-bound).
00000100:00000400:16.0:1773851802.953760:0:61025:0:(service.c:1614:ptlrpc_at_check_timed()) earlyQ=0 reqQ=0 recA=63, svcEst=438, delay=0ms
00010000:02000400:7.0:1773851806.485114:0:60963:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 9646605e-315e-40de-9602-59f79825227a (at 8418@kfi7) reconnecting
00010000:02000400:1.0:1773851817.308229:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client aecb154a-466d-4168-b3e8-2f34b9b03b0f (at 26434@kfi7) reconnecting
00010000:02000400:18.0:1773851818.733830:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 3bd4a035-19f8-423a-bfa5-462795c91e86 (at 14834@kfi7) reconnecting
00010000:02000400:2.0:1773851821.144732:0:42868:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client b1cfec29-22ea-447f-8b0c-24c7af98fa16 (at 8976@kfi7) reconnecting
00010000:02000400:7.0:1773851833.604508:0:60963:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 30dfd5f0-9936-49fc-a445-35fee1392e0a (at 10192@kfi7) reconnecting
00010000:02000400:7.0:1773851836.303442:0:60963:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 273df3b6-9fa1-4c12-8521-702eef7fcac7 (at 20851@kfi7) reconnecting
00000800:00000200:14.0:1773851846.672239:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851846.672241:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851846.672243:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851846.672247:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851846.672250:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.672252:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25106@kfi7 : PUT - for me
00000400:00000200:14.0:1773851846.672253:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.672255:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 1
00000400:00000200:14.0:1773851846.672257:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.672257:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000400:00000200:14.0:1773851846.672258:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 3
00000400:00000200:14.0:1773851846.672259:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25299@kfi7 to cpt 0
00000400:00000200:14.0:1773851846.672260:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25299@kfi7 of length 224 into portal 12 MB=0x69b1adc4075c0
00000400:00000200:14.0:1773851846.672262:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25299@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 8072
00000800:00000200:14.0:1773851846.672265:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851846.672267:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851846.672268:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25106@kfi7: PUT: OK
00000100:00000001:14.0:1773851846.672270:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851846.672271:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851846.672272:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bf1abe7c.
00000100:00000040:14.0:1773851846.672273:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000bf1abe7c x1859389526930880 msgsize 224
00000100:00100000:14.0:1773851846.672275:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-25299@kfi7 (source: 12345-25106@kfi7)
00000100:00000001:14.0:1773851846.672277:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851846.672278:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000800:00000200:14.0:1773851846.672280:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851846.672283:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851846.672284:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851846.672285:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851846.672286:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851846.672287:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851846.672288:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859389526930880
00000020:00000001:14.0:1773851846.672289:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851846.672289:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079ca4369e6
00000020:00000001:14.0:1773851846.672290:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851846.672294:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002bff92cc refcount=8
00000020:00000001:14.0:1773851846.672295:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636949100275712 : -107124609275904 : ffff9e921bb7a800)
00000020:00000001:14.0:1773851846.672296:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636949100275712 : -107124609275904 : ffff9e921bb7a800)
00000100:00000001:14.0:1773851846.672297:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851846.672298:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851846.672299:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000093d0a1a9.
00000020:00000010:14.0:1773851846.672301:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851846.672302:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851846.672303:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851846.672304:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851846.672304:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851846.672306:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851846.672306:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851846.672307:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851846.672308:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851846.672309:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851846.672309:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851846.672309:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851846.672310:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25299@kfi7, seq: 2289748
00000100:00000001:15.0:1773851846.672311:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:14.0:1773851846.672311:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002bff92cc : new rpc_count 1
00000100:00000001:15.0:1773851846.672312:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851846.672312:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851846.672312:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341811840 : -106946367739776 : ffff9ebb9bbda880)
00000100:00000040:14.0:1773851846.672313:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bf1abe7c x1859389526930880/t0(0) o400->f4e036ba-28ac-46b3-a468-1d618a71f99a@25299@kfi7:573/0 lens 224/0 e 0 to 0 dl 1773851933 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2069-0'
00000100:00000001:14.0:1773851846.672321:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851846.672322:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851846.672323:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf1abe7c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f4e036ba-28ac-46b3-a468-1d618a71f99a+8:39903:x1859389526930880:12345-25299@kfi7:400:default-tuolumne2069-0
00000100:00000200:14.0:1773851846.672324:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859389526930880
00000020:00000001:14.0:1773851846.672325:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851846.672326:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851846.672327:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.672328:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851846.672329:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851846.672330:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851846.672331:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859389526930880, found 0 last_xid 1859389526930879
00000020:00000001:14.0:1773851846.672332:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851846.672333:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851846.672333:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851846.672334:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.672334:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851846.672335:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851846.672336:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851846.672337:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001b574527.
02000000:00000001:14.0:1773851846.672338:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851846.672338:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.672339:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851846.672340:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182684228501, transno 0, xid 1859389526930880
00010000:00000001:14.0:1773851846.672341:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851846.672342:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bf1abe7c x1859389526930880/t0(0) o400->f4e036ba-28ac-46b3-a468-1d618a71f99a@25299@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2069-0'
00010000:00000001:14.0:1773851846.672345:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851846.672346:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851846.672347:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=79 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851846.672348:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851846.672349:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b2c786c refcount 3 to 25299@kfi7
00000100:00000001:14.0:1773851846.672350:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958444384 : -107146751107232 : ffff9e8cf3f61f60)
02000000:00000001:14.0:1773851846.672351:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851846.672352:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851846.672353:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851846.672354:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25106@kfi7
00000400:00000010:14.0:1773851846.672355:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003941c87b.
00000100:00000200:14.0:1773851846.672356:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859389526930880, offset 224
00000400:00000200:14.0:1773851846.672358:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25106@kfi7
00000400:00000200:14.0:1773851846.672359:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.672359:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 1
00000400:00000200:14.0:1773851846.672360:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000400:00000200:14.0:1773851846.672362:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 3
00000400:00000200:14.0:1773851846.672363:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25106@kfi7 local destination
00000400:00000200:14.0:1773851846.672365:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768316:8768316:1024:4294967295] 25106@kfi7 LPNI seq info [9309572:9309572:16:4294967295]
00000400:00000200:14.0:1773851846.672367:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000400:00000200:14.0:1773851846.672367:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.672370:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25106@kfi7(25106@kfi7:25106@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851846.672371:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 3
00000800:00000200:14.0:1773851846.672372:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851846.672374:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851846.672377:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851846.672379:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d62 Using peer 25106@kfi7(0x100000000000d62)
00000800:00000200:14.0:1773851846.672382:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000dac95d1f: Posted send of 324 bytes to peer 0x100000000000d62: rc=0
00000800:00000200:14.0:1773851846.672384:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d62 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851846.672386:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851846.672388:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b2c786c refcount 2 to 25299@kfi7
00010000:00000001:14.0:1773851846.672388:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851846.672389:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.672390:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851846.672391:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bf1abe7c x1859389526930880/t0(0) o400->f4e036ba-28ac-46b3-a468-1d618a71f99a@25299@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2069-0'
00000100:00100000:14.0:1773851846.672394:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf1abe7c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f4e036ba-28ac-46b3-a468-1d618a71f99a+8:39903:x1859389526930880:12345-25299@kfi7:400:default-tuolumne2069-0 Request processed in 72us (120us total) trans 0 rc 0/0
00000800:00000200:13.0F:1773851846.672396:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d62 TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851846.672397:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25299@kfi7, seq: 2289748
00000100:00000040:14.0:1773851846.672398:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002bff92cc : new rpc_count 0
00000100:00000001:14.0:1773851846.672399:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851846.672399:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851846.672399:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851846.672400:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851846.672401:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000400:00000200:13.0:1773851846.672401:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25106@kfi7: PUT: OK
00000020:00000010:14.0:1773851846.672402:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000093d0a1a9.
00000400:00000200:13.0:1773851846.672402:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003941c87b
00000020:00000040:14.0:1773851846.672403:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000002bff92cc : new refcount 7
00000100:00000001:14.0:1773851846.672403:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851846.672403:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003941c87b.
00000100:00000001:13.0:1773851846.672404:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851846.672404:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851846.672406:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000800:00000200:13.0:1773851846.672407:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 25106@kfi7(0000000020d9a6aa):0x0 lsk 3427 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d62 Transaction freed
00000800:00000200:21.0:1773851846.746591:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851846.746593:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851846.746595:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851846.746600:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851846.746602:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:21.0:1773851846.746604:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24049@kfi7 : PUT - for me
00000400:00000200:21.0:1773851846.746606:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:21.0:1773851846.746607:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 1
00000400:00000200:21.0:1773851846.746608:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:21.0:1773851846.746609:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000400:00000200:21.0:1773851846.746610:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 3
00000400:00000200:21.0:1773851846.746611:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24048@kfi7 to cpt 2
00000400:00000200:21.0:1773851846.746612:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24048@kfi7 of length 224 into portal 12 MB=0x699e197dad140
00000400:00000200:21.0:1773851846.746614:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24048@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 18656
00000800:00000200:21.0:1773851846.746616:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851846.746618:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851846.746619:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24049@kfi7: PUT: OK
00000100:00000001:21.0:1773851846.746621:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851846.746622:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851846.746623:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec8473ef.
00000100:00000040:21.0:1773851846.746624:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ec8473ef x1858044054655296 msgsize 224
00000100:00100000:21.0:1773851846.746626:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24048@kfi7 (source: 12345-24049@kfi7)
00000100:00000001:21.0:1773851846.746628:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851846.746629:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000100:00000001:22.0:1773851846.746630:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851846.746630:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851846.746631:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851846.746632:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851846.746633:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851846.746634:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851846.746635:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044054655296
00000020:00000001:22.0:1773851846.746636:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851846.746637:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c46
00000020:00000001:22.0:1773851846.746638:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851846.746642:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001876d267 refcount=6
00000020:00000001:22.0:1773851846.746643:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743952384 : -107128965599232 : ffff9e91180f7000)
00000020:00000001:22.0:1773851846.746644:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743952384 : -107128965599232 : ffff9e91180f7000)
00000100:00000001:22.0:1773851846.746645:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851846.746646:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851846.746647:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000247a55a4.
00000020:00000010:22.0:1773851846.746650:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851846.746651:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d08ac1b6.
00000100:00000001:22.0:1773851846.746652:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851846.746653:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851846.746654:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851846.746655:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851846.746656:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851846.746657:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.746658:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851846.746659:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851846.746660:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851846.746660:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851846.746661:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851846.746661:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24048@kfi7, seq: 1997904
00000100:00000040:22.0:1773851846.746662:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001876d267 : new rpc_count 1
00000100:00000001:23.0:1773851846.746663:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851846.746663:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.746663:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637146562804352 : -106927146747264 : ffff9ec01566ba80)
00000100:00000040:22.0:1773851846.746665:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ec8473ef x1858044054655296/t0(0) o400->33c2b67e-d2db-42c8-b115-951c593ce283@24048@kfi7:573/0 lens 224/0 e 0 to 0 dl 1773851933 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1981-0'
00000100:00000001:22.0:1773851846.746670:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851846.746670:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851846.746671:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec8473ef pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:33c2b67e-d2db-42c8-b115-951c593ce283+6:39674:x1858044054655296:12345-24048@kfi7:400:default-tuolumne1981-0
00000100:00000200:22.0:1773851846.746673:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044054655296
00000020:00000001:22.0:1773851846.746674:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851846.746675:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851846.746676:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.746677:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851846.746678:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851846.746678:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851846.746679:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044054655296, found 0 last_xid 1858044054655295
00000020:00000001:22.0:1773851846.746680:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851846.746681:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851846.746682:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851846.746682:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.746683:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851846.746684:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851846.746684:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851846.746685:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000040f3085b.
02000000:00000001:22.0:1773851846.746686:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.746687:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.746687:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851846.746688:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181475771429, transno 0, xid 1858044054655296
00010000:00000001:22.0:1773851846.746689:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851846.746690:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ec8473ef x1858044054655296/t0(0) o400->33c2b67e-d2db-42c8-b115-951c593ce283@24048@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1981-0'
00010000:00000001:22.0:1773851846.746693:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851846.746693:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851846.746694:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=79 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851846.746696:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851846.746697:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee04c026 refcount 3 to 24048@kfi7
00000100:00000001:22.0:1773851846.746698:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051135328 : -107146658416288 : ffff9e8cf97c7960)
02000000:00000001:22.0:1773851846.746699:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851846.746700:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.746701:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851846.746702:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24049@kfi7
00000400:00000010:22.0:1773851846.746703:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da48f67c.
00000100:00000200:22.0:1773851846.746704:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044054655296, offset 224
00000400:00000200:22.0:1773851846.746706:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24049@kfi7
00000400:00000200:22.0:1773851846.746707:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:22.0:1773851846.746708:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 1
00000400:00000200:22.0:1773851846.746710:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000400:00000200:22.0:1773851846.746711:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 3
00000400:00000200:22.0:1773851846.746713:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24049@kfi7 local destination
00000400:00000200:22.0:1773851846.746715:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768317:8768317:1024:4294967295] 24049@kfi7 LPNI seq info [325671:325671:16:4294967295]
00000400:00000200:22.0:1773851846.746717:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000400:00000200:22.0:1773851846.746718:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:22.0:1773851846.746720:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24049@kfi7(24049@kfi7:24049@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851846.746721:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 3
00000800:00000200:22.0:1773851846.746723:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851846.746728:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851846.746731:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851846.746734:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1af Using peer 24049@kfi7(0x1af)
00000800:00000200:22.0:1773851846.746737:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 324 bytes to peer 0x1af: rc=0
00000800:00000200:22.0:1773851846.746739:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1af TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851846.746742:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851846.746743:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee04c026 refcount 2 to 24048@kfi7
00010000:00000001:22.0:1773851846.746744:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851846.746745:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.746746:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851846.746746:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec8473ef x1858044054655296/t0(0) o400->33c2b67e-d2db-42c8-b115-951c593ce283@24048@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1981-0'
00000100:00100000:22.0:1773851846.746750:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec8473ef pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:33c2b67e-d2db-42c8-b115-951c593ce283+6:39674:x1858044054655296:12345-24048@kfi7:400:default-tuolumne1981-0 Request processed in 79us (125us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851846.746751:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1af TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851846.746753:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24048@kfi7, seq: 1997904
00000400:00000200:21.0:1773851846.746753:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:22.0:1773851846.746754:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001876d267 : new rpc_count 0
00000400:00000200:21.0:1773851846.746754:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24049@kfi7: PUT: OK
00000100:00000001:22.0:1773851846.746755:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851846.746755:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851846.746755:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da48f67c
00000020:00000010:22.0:1773851846.746756:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000010:21.0:1773851846.746756:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da48f67c.
00000020:00000010:22.0:1773851846.746757:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d08ac1b6.
00000100:00000001:21.0:1773851846.746757:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851846.746757:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851846.746758:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000247a55a4.
00000400:00000200:21.0:1773851846.746758:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000020:00000040:22.0:1773851846.746759:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000001876d267 : new refcount 5
00000100:00000001:22.0:1773851846.746760:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851846.746760:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 24049@kfi7(00000000ac86b29d):0x0 lsk 432 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1af Transaction freed
00000800:00000200:19.0:1773851846.776318:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851846.776321:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:19.0:1773851846.776324:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:19.0:1773851846.776331:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:19.0:1773851846.776336:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:19.0:1773851846.776338:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8961@kfi7 : PUT - for me
00000400:00000200:19.0:1773851846.776341:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:19.0:1773851846.776343:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 1
00000400:00000200:19.0:1773851846.776345:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:19.0:1773851846.776346:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000400:00000200:19.0:1773851846.776348:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 3
00000400:00000200:19.0:1773851846.776350:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9153@kfi7 to cpt 7
00000400:00000200:19.0:1773851846.776351:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9153@kfi7 of length 224 into portal 12 MB=0x69b4b8dc7a440
00000400:00000200:19.0:1773851846.776355:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9153@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 181432
00000800:00000200:19.0:1773851846.776359:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851846.776362:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851846.776364:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8961@kfi7: PUT: OK
00000100:00000001:19.0:1773851846.776367:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851846.776368:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851846.776370:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e97d03ee.
00000100:00000040:19.0:1773851846.776372:0:2464491:0:(events.c:358:request_in_callback()) incoming req@00000000e97d03ee x1859598663787584 msgsize 224
00000100:00100000:19.0:1773851846.776376:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-9153@kfi7 (source: 12345-8961@kfi7)
00000100:00000001:19.0:1773851846.776378:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851846.776379:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000100:00000001:18.0:1773851846.776381:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:19.0:1773851846.776382:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851846.776383:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851846.776385:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851846.776386:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851846.776388:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851846.776390:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598663787584
00000020:00000001:18.0:1773851846.776392:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851846.776393:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e75232
00000020:00000001:18.0:1773851846.776395:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851846.776398:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d87046e refcount=896
00000020:00000001:18.0:1773851846.776400:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637088971267072 : -106984738284544 : ffff9eb2acad9c00)
00000020:00000001:18.0:1773851846.776402:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637088971267072 : -106984738284544 : ffff9eb2acad9c00)
00000100:00000001:18.0:1773851846.776404:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.776406:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851846.776407:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000063aefba8.
00000020:00000010:18.0:1773851846.776410:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.776412:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d4e7664f.
00000100:00000001:18.0:1773851846.776414:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851846.776414:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851846.776416:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851846.776418:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851846.776419:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851846.776420:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.776422:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851846.776425:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851846.776425:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851846.776426:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851846.776426:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851846.776428:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9153@kfi7, seq: 2156226
00000100:00000001:19.0:1773851846.776430:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.776430:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d87046e : new rpc_count 8
00000100:00000001:18.0:1773851846.776431:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339161728 : -106987370389888 : ffff9eb20fcade80)
00000100:00000001:19.0:1773851846.776432:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.776434:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e97d03ee x1859598663787584/t0(0) o400->33595bfa-18fd-4e98-9eac-e7a741968d24@9153@kfi7:36/0 lens 224/0 e 0 to 0 dl 1773852151 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1059-0'
00000100:00000001:18.0:1773851846.776441:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.776442:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851846.776444:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e97d03ee pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:33595bfa-18fd-4e98-9eac-e7a741968d24+896:39510:x1859598663787584:12345-9153@kfi7:400:default-tuolumne1059-0
00000100:00000200:18.0:1773851846.776446:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598663787584
00000020:00000001:18.0:1773851846.776448:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851846.776449:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851846.776450:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.776452:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851846.776453:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851846.776454:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851846.776455:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598663787584, found 0 last_xid 1859598587483263
00000020:00000001:18.0:1773851846.776457:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851846.776458:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851846.776459:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851846.776460:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.776462:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851846.776463:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851846.776464:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851846.776467:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000a41fda9.
02000000:00000001:18.0:1773851846.776468:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.776469:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.776470:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851846.776472:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581127, transno 0, xid 1859598663787584
00010000:00000001:18.0:1773851846.776473:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851846.776475:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e97d03ee x1859598663787584/t0(0) o400->33595bfa-18fd-4e98-9eac-e7a741968d24@9153@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1059-0'
00010000:00000001:18.0:1773851846.776480:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851846.776480:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851846.776482:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=79 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851846.776484:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851846.776486:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e92afb3 refcount 3 to 9153@kfi7
00000100:00000001:18.0:1773851846.776487:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065664 : -107155994485952 : ffff9e8acd035b40)
02000000:00000001:18.0:1773851846.776488:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851846.776489:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.776491:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851846.776492:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8961@kfi7
00000400:00000010:18.0:1773851846.776494:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b6533870.
00000100:00000200:18.0:1773851846.776495:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598663787584, offset 224
00000400:00000200:18.0:1773851846.776498:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8961@kfi7
00000400:00000200:18.0:1773851846.776500:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.776502:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 1
00000400:00000200:18.0:1773851846.776504:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000400:00000200:18.0:1773851846.776506:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 3
00000400:00000200:18.0:1773851846.776508:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8961@kfi7 local destination
00000400:00000200:18.0:1773851846.776511:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768318:8768318:1024:4294967295] 8961@kfi7 LPNI seq info [2156335:2156335:16:4294967295]
00000400:00000200:18.0:1773851846.776514:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000400:00000200:18.0:1773851846.776515:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.776518:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8961@kfi7(8961@kfi7:8961@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851846.776521:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 3
00000800:00000200:18.0:1773851846.776524:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851846.776526:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851846.776531:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851846.776536:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e4f Using peer 8961@kfi7(0x100000000000e4f)
00000800:00000200:18.0:1773851846.776542:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000658b1b4a: Posted send of 324 bytes to peer 0x100000000000e4f: rc=0
00000800:00000200:18.0:1773851846.776544:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e4f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851846.776548:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.776550:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e92afb3 refcount 2 to 9153@kfi7
00010000:00000001:18.0:1773851846.776551:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851846.776552:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.776553:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851846.776554:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e97d03ee x1859598663787584/t0(0) o400->33595bfa-18fd-4e98-9eac-e7a741968d24@9153@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1059-0'
00000100:00100000:18.0:1773851846.776560:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e97d03ee pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:33595bfa-18fd-4e98-9eac-e7a741968d24+896:39510:x1859598663787584:12345-9153@kfi7:400:default-tuolumne1059-0 Request processed in 117us (186us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851846.776560:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e4f TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851846.776564:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9153@kfi7, seq: 2156226
00000100:00000040:18.0:1773851846.776565:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d87046e : new rpc_count 7
00000400:00000200:17.0:1773851846.776566:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851846.776567:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851846.776568:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851846.776569:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851846.776569:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8961@kfi7: PUT: OK
00000020:00000010:18.0:1773851846.776571:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d4e7664f.
00000400:00000200:17.0:1773851846.776571:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b6533870
00000020:00000010:18.0:1773851846.776572:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000063aefba8.
00000400:00000010:17.0:1773851846.776573:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b6533870.
00000020:00000040:18.0:1773851846.776574:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000002d87046e : new refcount 895
00000100:00000001:17.0:1773851846.776574:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851846.776575:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851846.776575:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851846.776577:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000800:00000200:17.0:1773851846.776580:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 8961@kfi7(0000000049e82c64):0x0 lsk 3664 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e4f Transaction freed
00000800:00000200:25.0:1773851846.793540:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851846.793541:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851846.793544:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851846.793548:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851846.793551:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:25.0:1773851846.793553:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21010@kfi7 : PUT - for me
00000400:00000200:25.0:1773851846.793554:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:25.0:1773851846.793555:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 1
00000400:00000200:25.0:1773851846.793557:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:25.0:1773851846.793557:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000400:00000200:25.0:1773851846.793558:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 3
00000400:00000200:25.0:1773851846.793560:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21202@kfi7 to cpt 1
00000400:00000200:25.0:1773851846.793561:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21202@kfi7 of length 224 into portal 12 MB=0x69b0a1d0c7540
00000400:00000200:25.0:1773851846.793563:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21202@kfi7 of length 224/224 into md 0x16159c6179 [64] + 174752
00000800:00000200:25.0:1773851846.793565:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851846.793567:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851846.793568:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21010@kfi7: PUT: OK
00000100:00000001:25.0:1773851846.793569:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851846.793570:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851846.793572:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000019f4fbde.
00000100:00000040:25.0:1773851846.793573:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000019f4fbde x1859317599597888 msgsize 224
00000100:00100000:25.0:1773851846.793575:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-21202@kfi7 (source: 12345-21010@kfi7)
00000100:00000001:25.0:1773851846.793576:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851846.793577:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000100:00000001:24.0:1773851846.793577:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851846.793579:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851846.793579:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851846.793579:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851846.793580:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851846.793582:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851846.793582:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317599597888
00000020:00000001:24.0:1773851846.793583:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851846.793584:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925f5
00000020:00000001:24.0:1773851846.793586:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851846.793588:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000032c0b98d refcount=12
00000020:00000001:24.0:1773851846.793589:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631012352 : -107123078539264 : ffff9e9276f4d800)
00000020:00000001:24.0:1773851846.793590:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631012352 : -107123078539264 : ffff9e9276f4d800)
00000100:00000001:24.0:1773851846.793591:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851846.793592:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851846.793593:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003510becf.
00000020:00000010:24.0:1773851846.793595:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851846.793597:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bc23e3f.
00000100:00000001:24.0:1773851846.793598:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851846.793598:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851846.793599:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851846.793600:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851846.793601:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851846.793602:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851846.793603:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851846.793604:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851846.793604:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851846.793605:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851846.793605:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851846.793606:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21202@kfi7, seq: 2025023
00000100:00000001:26.0:1773851846.793607:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851846.793607:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000032c0b98d : new rpc_count 1
00000100:00000001:26.0:1773851846.793608:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851846.793608:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700618368 : -106953008933248 : ffff9eba0fe51680)
00000100:00000040:24.0:1773851846.793610:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000019f4fbde x1859317599597888/t0(0) o400->753b8c0b-8653-474f-8451-b3989eeffd8b@21202@kfi7:32/0 lens 224/0 e 0 to 0 dl 1773852147 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1813-0'
00000100:00000001:24.0:1773851846.793618:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851846.793619:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851846.793620:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019f4fbde pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:753b8c0b-8653-474f-8451-b3989eeffd8b+12:39718:x1859317599597888:12345-21202@kfi7:400:default-tuolumne1813-0
00000100:00000200:24.0:1773851846.793622:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317599597888
00000020:00000001:24.0:1773851846.793623:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851846.793624:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851846.793624:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851846.793625:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851846.793626:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851846.793627:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851846.793628:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317599597888, found 0 last_xid 1859317599597887
00000020:00000001:24.0:1773851846.793629:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851846.793630:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851846.793630:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851846.793631:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851846.793632:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851846.793632:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851846.793633:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851846.793634:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d6e438f.
02000000:00000001:24.0:1773851846.793635:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851846.793636:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851846.793637:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851846.793637:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096687948, transno 0, xid 1859317599597888
00010000:00000001:24.0:1773851846.793638:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851846.793639:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000019f4fbde x1859317599597888/t0(0) o400->753b8c0b-8653-474f-8451-b3989eeffd8b@21202@kfi7:32/0 lens 224/224 e 0 to 0 dl 1773852147 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1813-0'
00010000:00000001:24.0:1773851846.793642:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851846.793643:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851846.793644:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=79 v=288 (288 212 1 1)
00000100:00000001:24.0:1773851846.793646:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851846.793647:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000086a48087 refcount 3 to 21202@kfi7
00000100:00000001:24.0:1773851846.793648:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410944 : -107145304140672 : ffff9e8d4a351480)
02000000:00000001:24.0:1773851846.793649:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851846.793650:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851846.793651:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851846.793652:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21010@kfi7
00000400:00000010:24.0:1773851846.793653:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c502b5b.
00000100:00000200:24.0:1773851846.793654:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317599597888, offset 224
00000400:00000200:24.0:1773851846.793655:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21010@kfi7
00000400:00000200:24.0:1773851846.793656:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:24.0:1773851846.793657:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 1
00000400:00000200:24.0:1773851846.793659:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000400:00000200:24.0:1773851846.793660:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 3
00000400:00000200:24.0:1773851846.793662:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21010@kfi7 local destination
00000400:00000200:24.0:1773851846.793663:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768319:8768319:1024:4294967295] 21010@kfi7 LPNI seq info [992541:992541:16:4294967295]
00000400:00000200:24.0:1773851846.793665:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000400:00000200:24.0:1773851846.793666:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:24.0:1773851846.793668:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21010@kfi7(21010@kfi7:21010@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851846.793669:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 3
00000800:00000200:24.0:1773851846.793671:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851846.793672:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851846.793675:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851846.793678:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xea2 Using peer 21010@kfi7(0xea2)
00000800:00000200:24.0:1773851846.793681:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0xea2: rc=0
00000800:00000200:24.0:1773851846.793683:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xea2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851846.793685:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851846.793686:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000086a48087 refcount 2 to 21202@kfi7
00010000:00000001:24.0:1773851846.793687:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851846.793688:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851846.793691:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851846.793691:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000019f4fbde x1859317599597888/t0(0) o400->753b8c0b-8653-474f-8451-b3989eeffd8b@21202@kfi7:32/0 lens 224/224 e 0 to 0 dl 1773852147 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1813-0'
00000100:00100000:24.0:1773851846.793695:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019f4fbde pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:753b8c0b-8653-474f-8451-b3989eeffd8b+12:39718:x1859317599597888:12345-21202@kfi7:400:default-tuolumne1813-0 Request processed in 76us (121us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851846.793698:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21202@kfi7, seq: 2025023
00000100:00000040:24.0:1773851846.793699:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000032c0b98d : new rpc_count 0
00000100:00000001:24.0:1773851846.793700:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851846.793700:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851846.793701:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851846.793702:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bc23e3f.
00000020:00000010:24.0:1773851846.793703:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003510becf.
00000020:00000040:24.0:1773851846.793704:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000032c0b98d : new refcount 11
00000100:00000001:24.0:1773851846.793704:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851846.793709:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xea2 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851846.793711:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851846.793712:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21010@kfi7: PUT: OK
00000400:00000200:25.0:1773851846.793713:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c502b5b
00000400:00000010:25.0:1773851846.793714:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c502b5b.
00000100:00000001:25.0:1773851846.793714:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851846.793715:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851846.793716:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000800:00000200:25.0:1773851846.793717:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 21010@kfi7(00000000187023bf):0x0 lsk 3747 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xea2 Transaction freed
00010000:00000001:2.0:1773851846.793731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793735:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851846.793736:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851846.793736:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793737:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851846.793738:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793739:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793739:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793740:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851846.793741:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851846.793742:0:2506505:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851846.793742:0:2506505:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851846.793743:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793743:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851846.793744:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793744:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793745:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793746:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851846.793746:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851846.793747:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793747:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851846.793747:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793748:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793748:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793749:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793750:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793750:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793751:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793751:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793751:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851846.793752:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851846.793752:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851846.793752:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793753:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851846.793753:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793754:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851846.793754:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851846.793757:0:937832:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851846.793759:0:937832:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851846.793760:0:937832:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:17.0:1773851846.819242:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851846.819243:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851846.819245:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851846.819247:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851846.819250:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.819252:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11600@kfi7 : PUT - for me
00000400:00000200:17.0:1773851846.819253:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.819254:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 1
00000400:00000200:17.0:1773851846.819255:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.819255:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000400:00000200:17.0:1773851846.819256:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 3
00000400:00000200:17.0:1773851846.819257:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11601@kfi7 to cpt 7
00000400:00000200:17.0:1773851846.819258:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11601@kfi7 of length 224 into portal 12 MB=0x69b476e351000
00000400:00000200:17.0:1773851846.819260:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11601@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 181656
00000800:00000200:17.0:1773851846.819263:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851846.819265:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851846.819266:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11600@kfi7: PUT: OK
00000100:00000001:17.0:1773851846.819267:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851846.819267:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851846.819269:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c19dbd67.
00000100:00000040:17.0:1773851846.819269:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000c19dbd67 x1859580954218496 msgsize 224
00000100:00100000:17.0:1773851846.819271:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-11601@kfi7 (source: 12345-11600@kfi7)
00000100:00000001:17.0:1773851846.819272:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851846.819273:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000100:00000001:18.0:1773851846.819274:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851846.819274:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851846.819275:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851846.819275:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851846.819275:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851846.819276:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851846.819277:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580954218496
00000020:00000001:18.0:1773851846.819277:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851846.819278:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc4589a2
00000020:00000001:18.0:1773851846.819278:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851846.819279:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b8efabcf refcount=777
00000020:00000001:18.0:1773851846.819280:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636942140959744 : -107131568591872 : ffff9e907ce8ec00)
00000020:00000001:18.0:1773851846.819281:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636942140959744 : -107131568591872 : ffff9e907ce8ec00)
00000100:00000001:18.0:1773851846.819281:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.819282:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851846.819283:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000063aefba8.
00000020:00000010:18.0:1773851846.819284:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.819284:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d4e7664f.
00000100:00000001:18.0:1773851846.819285:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851846.819285:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851846.819286:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851846.819287:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851846.819287:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851846.819287:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.819288:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851846.819289:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851846.819290:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851846.819291:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851846.819291:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851846.819291:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11601@kfi7, seq: 2156227
00000100:00000001:19.0:1773851846.819292:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.819292:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b8efabcf : new rpc_count 10
00000100:00000001:18.0:1773851846.819292:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098989193472 : -106974720358144 : ffff9eb501cb0900)
00000100:00000001:19.0:1773851846.819293:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.819293:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c19dbd67 x1859580954218496/t0(0) o400->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:36/0 lens 224/0 e 0 to 0 dl 1773852151 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1218-0'
00000100:00000001:18.0:1773851846.819296:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.819296:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851846.819297:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c19dbd67 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb+777:39635:x1859580954218496:12345-11601@kfi7:400:default-tuolumne1218-0
00000100:00000200:18.0:1773851846.819300:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580954218496
00000020:00000001:18.0:1773851846.819301:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851846.819301:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851846.819302:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.819303:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851846.819303:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851846.819304:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851846.819304:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580954218496, found 0 last_xid 1859580937482943
00000020:00000001:18.0:1773851846.819305:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851846.819306:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851846.819306:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851846.819307:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.819307:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851846.819308:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851846.819308:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851846.819309:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c5ddc52f.
02000000:00000001:18.0:1773851846.819310:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.819311:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.819311:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851846.819312:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593122, transno 0, xid 1859580954218496
00010000:00000001:18.0:1773851846.819313:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851846.819314:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c19dbd67 x1859580954218496/t0(0) o400->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1218-0'
00010000:00000001:18.0:1773851846.819317:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851846.819317:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851846.819318:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=79 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851846.819319:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851846.819320:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c7543625 refcount 3 to 11601@kfi7
00000100:00000001:18.0:1773851846.819321:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882880 : -107156296668736 : ffff9e8abb0069c0)
02000000:00000001:18.0:1773851846.819322:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851846.819322:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.819323:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851846.819324:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11600@kfi7
00000400:00000010:18.0:1773851846.819324:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d0a6e79d.
00000100:00000200:18.0:1773851846.819325:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580954218496, offset 224
00000400:00000200:18.0:1773851846.819327:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11600@kfi7
00000400:00000200:18.0:1773851846.819327:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.819328:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 1
00000400:00000200:18.0:1773851846.819329:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000400:00000200:18.0:1773851846.819331:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 3
00000400:00000200:18.0:1773851846.819332:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11600@kfi7 local destination
00000400:00000200:18.0:1773851846.819333:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768320:8768320:1024:4294967295] 11600@kfi7 LPNI seq info [6514306:6514306:16:4294967295]
00000400:00000200:18.0:1773851846.819335:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000400:00000200:18.0:1773851846.819335:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.819337:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11600@kfi7(11600@kfi7:11600@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851846.819338:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 3
00000800:00000200:18.0:1773851846.819340:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851846.819341:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851846.819343:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851846.819345:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 Using peer 11600@kfi7(0x75)
00000800:00000200:18.0:1773851846.819348:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000008e2a52ba: Posted send of 324 bytes to peer 0x75: rc=0
00000800:00000200:18.0:1773851846.819350:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851846.819352:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.819353:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c7543625 refcount 2 to 11601@kfi7
00010000:00000001:18.0:1773851846.819353:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851846.819354:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.819354:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851846.819355:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c19dbd67 x1859580954218496/t0(0) o400->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1218-0'
00000100:00100000:18.0:1773851846.819358:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c19dbd67 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb+777:39635:x1859580954218496:12345-11601@kfi7:400:default-tuolumne1218-0 Request processed in 61us (88us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851846.819361:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11601@kfi7, seq: 2156227
00000100:00000040:18.0:1773851846.819362:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b8efabcf : new rpc_count 9
00000100:00000001:18.0:1773851846.819362:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851846.819362:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851846.819363:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851846.819363:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.819364:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d4e7664f.
00000400:00000200:17.0:1773851846.819364:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851846.819365:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000063aefba8.
00000400:00000200:17.0:1773851846.819365:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11600@kfi7: PUT: OK
00000400:00000200:17.0:1773851846.819365:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d0a6e79d
00000020:00000040:18.0:1773851846.819366:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b8efabcf : new refcount 776
00000400:00000010:17.0:1773851846.819366:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d0a6e79d.
00000100:00000001:17.0:1773851846.819366:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851846.819367:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851846.819367:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851846.819368:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000800:00000200:17.0:1773851846.819369:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 Transaction freed
00000800:00000200:13.0:1773851846.836231:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851846.836232:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851846.836234:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851846.836235:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851846.836236:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851846.836236:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10144@kfi7(00000000179bcdff):0xd05 version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851846.836237:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851846.836238:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 Using peer 10144@kfi7(0x100000000000d05)
00000800:00000200:14.0:1773851846.836239:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851846.836240:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10144@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.836241:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10144@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.836243:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10144@kfi7 : PUT - for me
00000800:00000200:13.0:1773851846.836243:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 38 bytes to peer 0x100000000000d05: rc=0
00000400:00000200:14.0:1773851846.836244:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10144@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.836245:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002004d5f2 nid 10144@kfi7 refs 1
00000800:00000200:13.0:1773851846.836245:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851846.836246:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10144@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.836247:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002004d5f2 nid 10144@kfi7 refs 2
00000400:00000200:14.0:1773851846.836247:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002004d5f2 nid 10144@kfi7 refs 3
00000400:00000200:14.0:1773851846.836248:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10145@kfi7 to cpt 6
00000400:00000200:14.0:1773851846.836249:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10145@kfi7 of length 224 into portal 12 MB=0x699e71c0629c0
00000400:00000200:14.0:1773851846.836251:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10145@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 8296
00000800:00000200:14.0:1773851846.836253:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851846.836254:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851846.836255:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10144@kfi7: PUT: OK
00000100:00000001:14.0:1773851846.836256:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:13.0:1773851846.836256:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 TN_EVENT_TX_OK event status 0
00000100:00000200:14.0:1773851846.836257:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851846.836258:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c6235310.
00000100:00000040:14.0:1773851846.836258:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000c6235310 x1858067746924992 msgsize 224
00000800:00000200:13.0:1773851846.836258:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 Transaction freed
00000100:00100000:14.0:1773851846.836260:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-10145@kfi7 (source: 12345-10144@kfi7)
00000100:00000001:14.0:1773851846.836261:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851846.836262:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002004d5f2 nid 10144@kfi7 refs 2
00000800:00000200:14.0:1773851846.836264:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851846.836267:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851846.836267:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851846.836268:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851846.836269:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851846.836270:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851846.836270:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858067746924992
00000020:00000001:14.0:1773851846.836271:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851846.836271:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91586
00000020:00000001:14.0:1773851846.836272:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851846.836275:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000084d57003 refcount=6
00000020:00000001:14.0:1773851846.836276:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241010176 : -107152468541440 : ffff9e8b9f2d0000)
00000020:00000001:14.0:1773851846.836277:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241010176 : -107152468541440 : ffff9e8b9f2d0000)
00000100:00000001:14.0:1773851846.836278:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851846.836279:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851846.836280:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000093d0a1a9.
00000020:00000010:14.0:1773851846.836281:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851846.836282:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851846.836283:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851846.836283:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851846.836284:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851846.836285:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851846.836285:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851846.836286:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851846.836287:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851846.836288:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851846.836288:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851846.836288:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851846.836288:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851846.836289:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10145@kfi7, seq: 2289749
00000100:00000001:15.0:1773851846.836290:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851846.836290:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000084d57003 : new rpc_count 1
00000100:00000001:14.0:1773851846.836290:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341818752 : -106946367732864 : ffff9ebb9bbdc380)
00000100:00000001:15.0:1773851846.836291:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851846.836292:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c6235310 x1858067746924992/t0(0) o400->cf9ae637-0fcb-43fe-8c1f-124fb4279909@10145@kfi7:573/0 lens 224/0 e 0 to 0 dl 1773851933 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1120-0'
00000100:00000001:14.0:1773851846.836295:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851846.836295:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851846.836296:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6235310 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:cf9ae637-0fcb-43fe-8c1f-124fb4279909+6:39661:x1858067746924992:12345-10145@kfi7:400:default-tuolumne1120-0
00000100:00000200:14.0:1773851846.836297:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858067746924992
00000020:00000001:14.0:1773851846.836298:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851846.836298:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851846.836299:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.836300:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851846.836300:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851846.836301:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851846.836301:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858067746924992, found 0 last_xid 1858067746924991
00000020:00000001:14.0:1773851846.836302:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851846.836303:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851846.836303:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851846.836304:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.836304:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851846.836305:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851846.836305:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851846.836306:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea44ffd7.
02000000:00000001:14.0:1773851846.836307:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851846.836307:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.836308:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851846.836308:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183097237967, transno 0, xid 1858067746924992
00010000:00000001:14.0:1773851846.836310:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851846.836311:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c6235310 x1858067746924992/t0(0) o400->cf9ae637-0fcb-43fe-8c1f-124fb4279909@10145@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1120-0'
00010000:00000001:14.0:1773851846.836313:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851846.836314:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851846.836314:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=79 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851846.836315:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851846.836316:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004d9349ee refcount 3 to 10145@kfi7
00000100:00000001:14.0:1773851846.836317:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335776 : -107152617215840 : ffff9e8b965068a0)
02000000:00000001:14.0:1773851846.836317:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851846.836318:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851846.836318:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851846.836319:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10144@kfi7
00000400:00000010:14.0:1773851846.836320:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005fd47ac8.
00000100:00000200:14.0:1773851846.836321:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858067746924992, offset 224
00000400:00000200:14.0:1773851846.836322:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10144@kfi7
00000400:00000200:14.0:1773851846.836323:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10144@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.836323:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002004d5f2 nid 10144@kfi7 refs 1
00000400:00000200:14.0:1773851846.836324:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002004d5f2 nid 10144@kfi7 refs 2
00000400:00000200:14.0:1773851846.836325:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002004d5f2 nid 10144@kfi7 refs 3
00000400:00000200:14.0:1773851846.836326:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10144@kfi7 local destination
00000400:00000200:14.0:1773851846.836327:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768321:8768321:1024:4294967295] 10144@kfi7 LPNI seq info [79744754:79744754:16:4294967295]
00000400:00000200:14.0:1773851846.836329:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002004d5f2 nid 10144@kfi7 refs 2
00000400:00000200:14.0:1773851846.836330:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10144@kfi7 to cpt 3
00000400:00000200:14.0:1773851846.836331:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10144@kfi7(10144@kfi7:10144@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851846.836332:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002004d5f2 nid 10144@kfi7 refs 3
00000800:00000200:14.0:1773851846.836334:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851846.836335:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851846.836336:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851846.836340:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 Using peer 10144@kfi7(0x100000000000d05)
00000800:00000200:14.0:1773851846.836342:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000e70f539d: Posted send of 324 bytes to peer 0x100000000000d05: rc=0
00000800:00000200:14.0:1773851846.836344:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851846.836345:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851846.836346:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004d9349ee refcount 2 to 10145@kfi7
00010000:00000001:14.0:1773851846.836347:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851846.836347:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851846.836348:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851846.836349:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c6235310 x1858067746924992/t0(0) o400->cf9ae637-0fcb-43fe-8c1f-124fb4279909@10145@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1120-0'
00000100:00100000:14.0:1773851846.836351:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6235310 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:cf9ae637-0fcb-43fe-8c1f-124fb4279909+6:39661:x1858067746924992:12345-10145@kfi7:400:default-tuolumne1120-0 Request processed in 56us (92us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851846.836354:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10145@kfi7, seq: 2289749
00000100:00000040:14.0:1773851846.836354:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000084d57003 : new rpc_count 0
00000100:00000001:14.0:1773851846.836355:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851846.836355:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851846.836355:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851846.836356:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851846.836356:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000020:00000010:14.0:1773851846.836357:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000093d0a1a9.
00000400:00000200:13.0:1773851846.836357:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:14.0:1773851846.836358:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000084d57003 : new refcount 5
00000100:00000001:14.0:1773851846.836358:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851846.836358:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10144@kfi7: PUT: OK
00000400:00000200:13.0:1773851846.836359:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005fd47ac8
00000400:00000010:13.0:1773851846.836359:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005fd47ac8.
00000100:00000001:13.0:1773851846.836360:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851846.836361:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851846.836361:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002004d5f2 nid 10144@kfi7 refs 2
00000800:00000200:13.0:1773851846.836363:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 10144@kfi7(00000000179bcdff):0x0 lsk 3334 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d05 Transaction freed
00000800:00000200:21.0:1773851846.838446:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851846.838448:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851846.838450:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851846.838453:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851846.838457:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:21.0:1773851846.838459:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24947@kfi7 : PUT - for me
00000400:00000200:21.0:1773851846.838460:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:21.0:1773851846.838462:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 1
00000400:00000200:21.0:1773851846.838463:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:21.0:1773851846.838464:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000400:00000200:21.0:1773851846.838466:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 3
00000400:00000200:21.0:1773851846.838467:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25010@kfi7 to cpt 5
00000400:00000200:21.0:1773851846.838468:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25010@kfi7 of length 224 into portal 12 MB=0x699e1198717c0
00000400:00000200:21.0:1773851846.838471:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25010@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 18880
00000800:00000200:21.0:1773851846.838473:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851846.838476:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851846.838477:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24947@kfi7: PUT: OK
00000100:00000001:21.0:1773851846.838479:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851846.838479:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851846.838480:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000033e0c1e3.
00000100:00000040:21.0:1773851846.838481:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000033e0c1e3 x1858041935239104 msgsize 224
00000100:00100000:21.0:1773851846.838484:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25010@kfi7 (source: 12345-24947@kfi7)
00000100:00000001:21.0:1773851846.838485:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851846.838486:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000100:00000001:22.0:1773851846.838488:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851846.838489:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851846.838489:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851846.838489:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851846.838490:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851846.838492:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851846.838493:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041935239104
00000020:00000001:22.0:1773851846.838494:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851846.838495:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92db9
00000020:00000001:22.0:1773851846.838496:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851846.838500:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000e61e606 refcount=6
00000020:00000001:22.0:1773851846.838501:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744424448 : -107128965127168 : ffff9e911816a400)
00000020:00000001:22.0:1773851846.838503:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744424448 : -107128965127168 : ffff9e911816a400)
00000100:00000001:22.0:1773851846.838504:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851846.838506:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851846.838506:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000247a55a4.
00000020:00000010:22.0:1773851846.838508:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851846.838510:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d08ac1b6.
00000100:00000001:22.0:1773851846.838512:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851846.838513:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851846.838514:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851846.838515:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851846.838516:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851846.838517:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.838519:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851846.838521:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851846.838521:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851846.838522:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851846.838522:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851846.838523:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25010@kfi7, seq: 1997905
00000100:00000040:22.0:1773851846.838524:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000e61e606 : new rpc_count 1
00000100:00000001:23.0:1773851846.838525:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851846.838526:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.838526:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637146562793984 : -106927146757632 : ffff9ec015669200)
00000100:00000040:22.0:1773851846.838528:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000033e0c1e3 x1858041935239104/t0(0) o400->e628e1fc-6dc0-4b33-af9c-93ae40a9357a@25010@kfi7:573/0 lens 224/0 e 0 to 0 dl 1773851933 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2042-0'
00000100:00000001:22.0:1773851846.838533:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851846.838533:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851846.838535:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033e0c1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e628e1fc-6dc0-4b33-af9c-93ae40a9357a+6:39806:x1858041935239104:12345-25010@kfi7:400:default-tuolumne2042-0
00000100:00000200:22.0:1773851846.838537:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041935239104
00000020:00000001:22.0:1773851846.838538:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851846.838539:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851846.838540:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.838542:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851846.838542:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851846.838544:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851846.838545:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041935239104, found 0 last_xid 1858041935239103
00000020:00000001:22.0:1773851846.838546:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851846.838547:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851846.838548:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851846.838549:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.838550:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851846.838551:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851846.838552:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851846.838553:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000efb2b8f.
02000000:00000001:22.0:1773851846.838554:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.838555:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.838557:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851846.838557:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260753260, transno 0, xid 1858041935239104
00010000:00000001:22.0:1773851846.838559:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851846.838560:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000033e0c1e3 x1858041935239104/t0(0) o400->e628e1fc-6dc0-4b33-af9c-93ae40a9357a@25010@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2042-0'
00010000:00000001:22.0:1773851846.838564:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851846.838565:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851846.838566:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=79 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851846.838568:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851846.838569:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d44225e refcount 3 to 25010@kfi7
00000100:00000001:22.0:1773851846.838570:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024896 : -107156745526720 : ffff9e8aa03f6240)
02000000:00000001:22.0:1773851846.838571:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851846.838572:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851846.838573:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851846.838574:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24947@kfi7
00000400:00000010:22.0:1773851846.838575:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002e39ba09.
00000100:00000200:22.0:1773851846.838576:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041935239104, offset 224
00000400:00000200:22.0:1773851846.838578:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24947@kfi7
00000400:00000200:22.0:1773851846.838580:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:22.0:1773851846.838581:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 1
00000400:00000200:22.0:1773851846.838583:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000400:00000200:22.0:1773851846.838585:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 3
00000400:00000200:22.0:1773851846.838586:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24947@kfi7 local destination
00000400:00000200:22.0:1773851846.838589:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768322:8768322:1024:4294967295] 24947@kfi7 LPNI seq info [961132:961132:16:4294967295]
00000400:00000200:22.0:1773851846.838591:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000400:00000200:22.0:1773851846.838592:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:22.0:1773851846.838596:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24947@kfi7(24947@kfi7:24947@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851846.838598:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 3
00000800:00000200:22.0:1773851846.838600:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851846.838602:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2054@kfi7:5 -> 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851846.838606:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2054@kfi7:5 -> 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851846.838610:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2054@kfi7:5 -> 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001034 Using peer 24947@kfi7(0x100000000001034)
00000800:00000200:22.0:1773851846.838615:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 324 bytes to peer 0x100000000001034: rc=0
00000800:00000200:22.0:1773851846.838617:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2054@kfi7:5 -> 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001034 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851846.838620:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851846.838621:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d44225e refcount 2 to 25010@kfi7
00010000:00000001:22.0:1773851846.838623:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851846.838623:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851846.838624:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851846.838625:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000033e0c1e3 x1858041935239104/t0(0) o400->e628e1fc-6dc0-4b33-af9c-93ae40a9357a@25010@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2042-0'
00000800:00000200:21.0:1773851846.838629:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2054@kfi7:5 -> 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001034 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851846.838631:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033e0c1e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e628e1fc-6dc0-4b33-af9c-93ae40a9357a+6:39806:x1858041935239104:12345-25010@kfi7:400:default-tuolumne2042-0 Request processed in 97us (148us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851846.838632:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:22.0:1773851846.838634:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25010@kfi7, seq: 1997905
00000400:00000200:21.0:1773851846.838634:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24947@kfi7: PUT: OK
00000100:00000040:22.0:1773851846.838635:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000e61e606 : new rpc_count 0
00000400:00000200:21.0:1773851846.838635:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002e39ba09
00000400:00000010:21.0:1773851846.838635:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002e39ba09.
00000100:00000001:22.0:1773851846.838636:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851846.838636:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851846.838637:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:21.0:1773851846.838637:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851846.838638:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851846.838639:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d08ac1b6.
00000400:00000200:21.0:1773851846.838639:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000020:00000010:22.0:1773851846.838640:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000247a55a4.
00000020:00000040:22.0:1773851846.838641:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000000e61e606 : new refcount 5
00000800:00000200:21.0:1773851846.838641:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2054@kfi7:5 -> 24947@kfi7(000000003cdaa5b9):0x0 lsk 4149 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001034 Transaction freed
00000100:00000001:22.0:1773851846.838642:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851846.852604:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851846.852605:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851846.852607:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851846.852609:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851846.852611:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.852612:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9474@kfi7 : PUT - for me
00000400:00000200:17.0:1773851846.852613:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.852614:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 1
00000400:00000200:17.0:1773851846.852615:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.852616:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000400:00000200:17.0:1773851846.852617:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 3
00000400:00000200:17.0:1773851846.852618:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9666@kfi7 to cpt 6
00000400:00000200:17.0:1773851846.852619:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9666@kfi7 of length 224 into portal 12 MB=0x69aa079d4b9c0
00000400:00000200:17.0:1773851846.852620:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9666@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 181880
00000800:00000200:17.0:1773851846.852622:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851846.852623:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851846.852624:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9474@kfi7: PUT: OK
00000100:00000001:17.0:1773851846.852625:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851846.852626:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851846.852627:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a191f88.
00000100:00000040:17.0:1773851846.852628:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001a191f88 x1858863889693120 msgsize 224
00000100:00100000:17.0:1773851846.852630:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9666@kfi7 (source: 12345-9474@kfi7)
00000100:00000001:17.0:1773851846.852631:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:18.0:1773851846.852632:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851846.852632:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 2
02000000:00000001:18.0:1773851846.852633:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851846.852633:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851846.852633:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851846.852634:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851846.852635:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851846.852635:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863889693120
00000020:00000001:18.0:1773851846.852636:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851846.852636:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac919d1
00000020:00000001:18.0:1773851846.852637:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851846.852639:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008d1d1f5e refcount=6
00000020:00000001:18.0:1773851846.852639:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242248192 : -107152467303424 : ffff9e8b9f3fe400)
00000020:00000001:18.0:1773851846.852640:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242248192 : -107152467303424 : ffff9e8b9f3fe400)
00000100:00000001:18.0:1773851846.852641:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.852641:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851846.852642:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000063aefba8.
00000020:00000010:18.0:1773851846.852643:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.852644:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d4e7664f.
00000100:00000001:18.0:1773851846.852645:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851846.852645:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851846.852645:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851846.852646:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851846.852647:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851846.852647:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.852648:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851846.852649:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851846.852649:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851846.852650:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851846.852650:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851846.852651:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9666@kfi7, seq: 2156228
00000100:00000040:18.0:1773851846.852651:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008d1d1f5e : new rpc_count 1
00000100:00000001:19.0:1773851846.852652:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851846.852652:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.852652:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636967363951232 : -107106345600384 : ffff9e965c513a80)
00000100:00000040:18.0:1773851846.852653:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a191f88 x1858863889693120/t0(0) o400->680337cd-685a-4b04-a87c-a56f47e99f54@9666@kfi7:36/0 lens 224/0 e 0 to 0 dl 1773852151 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1095-0'
00000100:00000001:18.0:1773851846.852655:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.852656:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851846.852657:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a191f88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:680337cd-685a-4b04-a87c-a56f47e99f54+6:39141:x1858863889693120:12345-9666@kfi7:400:default-tuolumne1095-0
00000100:00000200:18.0:1773851846.852658:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863889693120
00000020:00000001:18.0:1773851846.852658:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851846.852659:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851846.852659:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.852660:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851846.852660:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851846.852661:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851846.852662:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863889693120, found 0 last_xid 1858863889693119
00000020:00000001:18.0:1773851846.852662:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851846.852663:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851846.852663:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851846.852664:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.852664:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851846.852665:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851846.852665:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851846.852666:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d2775dd3.
02000000:00000001:18.0:1773851846.852667:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.852667:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.852668:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851846.852668:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475273173, transno 0, xid 1858863889693120
00010000:00000001:18.0:1773851846.852669:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851846.852670:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a191f88 x1858863889693120/t0(0) o400->680337cd-685a-4b04-a87c-a56f47e99f54@9666@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1095-0'
00010000:00000001:18.0:1773851846.852674:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851846.852675:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851846.852675:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=79 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851846.852676:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851846.852677:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005c6c54a2 refcount 3 to 9666@kfi7
00000100:00000001:18.0:1773851846.852678:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330528 : -107155410221088 : ffff9e8aefd687e0)
02000000:00000001:18.0:1773851846.852678:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851846.852679:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.852679:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851846.852680:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9474@kfi7
00000400:00000010:18.0:1773851846.852681:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000170bff74.
00000100:00000200:18.0:1773851846.852681:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863889693120, offset 224
00000400:00000200:18.0:1773851846.852683:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9474@kfi7
00000400:00000200:18.0:1773851846.852683:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.852684:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 1
00000400:00000200:18.0:1773851846.852685:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000400:00000200:18.0:1773851846.852686:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 3
00000400:00000200:18.0:1773851846.852687:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9474@kfi7 local destination
00000400:00000200:18.0:1773851846.852688:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768323:8768323:1024:4294967295] 9474@kfi7 LPNI seq info [17404:17404:16:4294967295]
00000400:00000200:18.0:1773851846.852689:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000400:00000200:18.0:1773851846.852690:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.852692:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9474@kfi7(9474@kfi7:9474@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851846.852693:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 3
00000800:00000200:18.0:1773851846.852694:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851846.852695:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851846.852697:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851846.852699:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x382 Using peer 9474@kfi7(0x382)
00000800:00000200:18.0:1773851846.852701:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000582ee624: Posted send of 324 bytes to peer 0x382: rc=0
00000800:00000200:18.0:1773851846.852702:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x382 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851846.852704:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.852705:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005c6c54a2 refcount 2 to 9666@kfi7
00010000:00000001:18.0:1773851846.852705:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851846.852706:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.852706:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851846.852707:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a191f88 x1858863889693120/t0(0) o400->680337cd-685a-4b04-a87c-a56f47e99f54@9666@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1095-0'
00000100:00100000:18.0:1773851846.852710:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a191f88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:680337cd-685a-4b04-a87c-a56f47e99f54+6:39141:x1858863889693120:12345-9666@kfi7:400:default-tuolumne1095-0 Request processed in 53us (80us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851846.852712:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9666@kfi7, seq: 2156228
00000100:00000040:18.0:1773851846.852712:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008d1d1f5e : new rpc_count 0
00000100:00000001:18.0:1773851846.852713:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851846.852713:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851846.852714:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.852714:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d4e7664f.
00000800:00000200:17.0:1773851846.852714:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x382 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851846.852715:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000063aefba8.
00000020:00000040:18.0:1773851846.852716:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000008d1d1f5e : new refcount 5
00000100:00000001:18.0:1773851846.852716:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851846.852716:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851846.852717:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9474@kfi7: PUT: OK
00000400:00000200:17.0:1773851846.852717:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000170bff74
00000400:00000010:17.0:1773851846.852718:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000170bff74.
00000100:00000001:17.0:1773851846.852719:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851846.852719:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851846.852720:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000800:00000200:17.0:1773851846.852721:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 9474@kfi7(000000009d391c76):0x0 lsk 899 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x382 Transaction freed
00000800:00000200:5.0:1773851846.878945:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851846.878946:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851846.878949:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851846.878953:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851846.878956:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25760@kfi7 to cpt 1
00000400:00000200:5.0:1773851846.878958:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25760@kfi7 : PUT - for me
00000400:00000200:5.0:1773851846.878959:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25760@kfi7 to cpt 1
00000400:00000200:5.0:1773851846.878960:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000611ae861 nid 25760@kfi7 refs 1
00000400:00000200:5.0:1773851846.878962:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25760@kfi7 to cpt 1
00000400:00000200:5.0:1773851846.878963:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000611ae861 nid 25760@kfi7 refs 2
00000400:00000200:5.0:1773851846.878964:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000611ae861 nid 25760@kfi7 refs 3
00000400:00000200:5.0:1773851846.878965:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25697@kfi7 to cpt 1
00000400:00000200:5.0:1773851846.878966:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25697@kfi7 of length 224 into portal 12 MB=0x69b4c3a570080
00000400:00000200:5.0:1773851846.878968:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25697@kfi7 of length 224/224 into md 0x793926dc5 [64] + 111984
00000800:00000200:5.0:1773851846.878970:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851846.878972:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851846.878975:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25760@kfi7: PUT: OK
00000100:00000001:5.0:1773851846.878976:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851846.878977:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851846.878979:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001545c420.
00000100:00000040:5.0:1773851846.878980:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000001545c420 x1859601558864000 msgsize 224
00000100:00100000:5.0:1773851846.878982:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25697@kfi7 (source: 12345-25760@kfi7)
00000100:00000001:5.0:1773851846.878983:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851846.878984:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000611ae861 nid 25760@kfi7 refs 2
00000100:00000001:6.0:1773851846.878985:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851846.878986:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851846.878986:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851846.878987:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851846.878988:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851846.878989:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851846.878990:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601558864000
00000020:00000001:6.0:1773851846.878992:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851846.878993:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e62d22a1c
00000020:00000001:6.0:1773851846.878994:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851846.878996:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003c9faf10 refcount=9
00000020:00000001:6.0:1773851846.878997:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121281668096 : -106952427883520 : ffff9eba32873400)
00000020:00000001:6.0:1773851846.878999:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121281668096 : -106952427883520 : ffff9eba32873400)
00000100:00000001:6.0:1773851846.879000:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851846.879001:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851846.879002:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851846.879004:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851846.879005:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851846.879006:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851846.879007:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851846.879008:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851846.879010:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851846.879011:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851846.879011:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851846.879012:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851846.879014:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851846.879015:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851846.879015:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851846.879015:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851846.879017:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25697@kfi7, seq: 2001825
00000100:00000001:7.0:1773851846.879018:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851846.879018:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003c9faf10 : new rpc_count 1
00000100:00000001:7.0:1773851846.879019:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851846.879019:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095280912512 : -106978428639104 : ffff9eb424c32880)
00000100:00000040:6.0:1773851846.879020:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001545c420 x1859601558864000/t0(0) o400->190cfc70-adc6-47fc-a2a6-4405ac504a45@25697@kfi7:573/0 lens 224/0 e 0 to 0 dl 1773851933 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2096-0'
00000100:00000001:6.0:1773851846.879025:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851846.879025:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851846.879026:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001545c420 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:190cfc70-adc6-47fc-a2a6-4405ac504a45+9:39746:x1859601558864000:12345-25697@kfi7:400:default-tuolumne2096-0
00000100:00000200:6.0:1773851846.879028:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601558864000
00000020:00000001:6.0:1773851846.879029:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851846.879030:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851846.879031:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851846.879032:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851846.879032:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851846.879033:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851846.879034:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601558864000, found 0 last_xid 1859601558863999
00000020:00000001:6.0:1773851846.879035:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851846.879036:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851846.879037:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851846.879037:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851846.879038:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851846.879039:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851846.879040:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851846.879041:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005a85a977.
02000000:00000001:6.0:1773851846.879042:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851846.879043:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851846.879043:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851846.879044:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260456253, transno 0, xid 1859601558864000
00010000:00000001:6.0:1773851846.879045:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851846.879046:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001545c420 x1859601558864000/t0(0) o400->190cfc70-adc6-47fc-a2a6-4405ac504a45@25697@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2096-0'
00010000:00000001:6.0:1773851846.879049:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851846.879050:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851846.879051:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=78 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851846.879053:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851846.879054:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013885819 refcount 3 to 25697@kfi7
00000100:00000001:6.0:1773851846.879054:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231610240 : -107130477941376 : ffff9e90bdeaed80)
02000000:00000001:6.0:1773851846.879055:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851846.879056:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851846.879057:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851846.879058:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25760@kfi7
00000400:00000010:6.0:1773851846.879059:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a3caea7.
00000100:00000200:6.0:1773851846.879060:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601558864000, offset 224
00000400:00000200:6.0:1773851846.879062:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25760@kfi7
00000400:00000200:6.0:1773851846.879063:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25760@kfi7 to cpt 1
00000400:00000200:6.0:1773851846.879064:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000611ae861 nid 25760@kfi7 refs 1
00000400:00000200:6.0:1773851846.879066:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000611ae861 nid 25760@kfi7 refs 2
00000400:00000200:6.0:1773851846.879068:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000611ae861 nid 25760@kfi7 refs 3
00000400:00000200:6.0:1773851846.879069:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25760@kfi7 local destination
00000400:00000200:6.0:1773851846.879071:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768324:8768324:1024:4294967295] 25760@kfi7 LPNI seq info [222181:222181:16:4294967295]
00000400:00000200:6.0:1773851846.879073:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000611ae861 nid 25760@kfi7 refs 2
00000400:00000200:6.0:1773851846.879075:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25760@kfi7 to cpt 1
00000400:00000200:6.0:1773851846.879077:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25760@kfi7(25760@kfi7:25760@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851846.879079:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000611ae861 nid 25760@kfi7 refs 3
00000800:00000200:6.0:1773851846.879081:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851846.879082:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851846.879086:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851846.879089:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ea7 Using peer 25760@kfi7(0x100000000000ea7)
00000800:00000200:6.0:1773851846.879094:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000001aa19562: Posted send of 324 bytes to peer 0x100000000000ea7: rc=0
00000800:00000200:6.0:1773851846.879096:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ea7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851846.879099:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851846.879100:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013885819 refcount 2 to 25697@kfi7
00010000:00000001:6.0:1773851846.879102:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851846.879102:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851846.879103:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851846.879104:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001545c420 x1859601558864000/t0(0) o400->190cfc70-adc6-47fc-a2a6-4405ac504a45@25697@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2096-0'
00000100:00100000:6.0:1773851846.879108:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001545c420 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:190cfc70-adc6-47fc-a2a6-4405ac504a45+9:39746:x1859601558864000:12345-25697@kfi7:400:default-tuolumne2096-0 Request processed in 82us (127us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851846.879108:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ea7 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851846.879111:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25697@kfi7, seq: 2001825
00000400:00000200:5.0:1773851846.879111:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:6.0:1773851846.879112:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003c9faf10 : new rpc_count 0
00000400:00000200:5.0:1773851846.879112:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25760@kfi7: PUT: OK
00000400:00000200:5.0:1773851846.879113:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a3caea7
00000100:00000001:6.0:1773851846.879114:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851846.879114:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:5.0:1773851846.879114:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a3caea7.
00000020:00000010:6.0:1773851846.879115:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000100:00000001:5.0:1773851846.879115:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:6.0:1773851846.879116:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000100:00000001:5.0:1773851846.879116:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851846.879117:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000611ae861 nid 25760@kfi7 refs 2
00000020:00000010:6.0:1773851846.879118:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000020:00000040:6.0:1773851846.879119:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000003c9faf10 : new refcount 8
00000800:00000200:5.0:1773851846.879119:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 25760@kfi7(00000000287d58fa):0x0 lsk 3752 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ea7 Transaction freed
00000100:00000001:6.0:1773851846.879121:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851846.906690:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851846.906692:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851846.906694:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851846.906697:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851846.906700:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851846.906701:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9264@kfi7 : PUT - for me
00000400:00000200:9.0:1773851846.906703:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851846.906704:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 1
00000400:00000200:9.0:1773851846.906705:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851846.906706:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000400:00000200:9.0:1773851846.906707:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 3
00000400:00000200:9.0:1773851846.906708:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851846.906709:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9264@kfi7 of length 224 into portal 12 MB=0x69b823405a240
00000400:00000200:9.0:1773851846.906711:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9264@kfi7 of length 224/224 into md 0x78146ce49 [64] + 108096
00000800:00000200:9.0:1773851846.906714:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851846.906716:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851846.906717:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9264@kfi7: PUT: OK
00000100:00000001:9.0:1773851846.906718:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851846.906719:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851846.906720:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000035f73316.
00000100:00000040:9.0:1773851846.906721:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000035f73316 x1859833381102144 msgsize 224
00000100:00100000:9.0:1773851846.906723:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-9264@kfi7 (source: 12345-9264@kfi7)
00000100:00000001:8.0:1773851846.906726:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:9.0:1773851846.906728:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
02000000:00000001:8.0:1773851846.906728:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:9.0:1773851846.906729:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000100:00000001:8.0:1773851846.906729:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851846.906730:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851846.906731:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851846.906731:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851846.906732:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833381102144
00000020:00000001:8.0:1773851846.906733:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851846.906734:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c176764
00000020:00000001:8.0:1773851846.906735:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851846.906737:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004cf60823 refcount=5
00000020:00000001:8.0:1773851846.906738:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029411901440 : -107044297650176 : ffff9ea4cea9d000)
00000020:00000001:8.0:1773851846.906739:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029411901440 : -107044297650176 : ffff9ea4cea9d000)
00000100:00000001:8.0:1773851846.906740:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851846.906741:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851846.906742:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003a871c4.
00000020:00000010:8.0:1773851846.906744:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851846.906745:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851846.906746:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851846.906747:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851846.906747:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851846.906749:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851846.906750:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851846.906750:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.906751:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851846.906752:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851846.906753:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851846.906753:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851846.906754:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851846.906755:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9264@kfi7, seq: 2130695
00000100:00000001:9.0:1773851846.906756:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851846.906756:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004cf60823 : new rpc_count 1
00000100:00000001:9.0:1773851846.906757:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.906757:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569656960 : -106988139894656 : ffff9eb1e1ed2880)
00000100:00000040:8.0:1773851846.906759:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000035f73316 x1859833381102144/t0(0) o400->eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960@9264@kfi7:573/0 lens 224/0 e 0 to 0 dl 1773851933 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1069-0'
00000100:00000001:8.0:1773851846.906774:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851846.906774:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851846.906775:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035f73316 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960+5:39688:x1859833381102144:12345-9264@kfi7:400:default-tuolumne1069-0
00000100:00000200:8.0:1773851846.906777:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833381102144
00000020:00000001:8.0:1773851846.906778:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851846.906779:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851846.906780:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851846.906781:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851846.906782:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851846.906783:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851846.906783:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833381102144, found 0 last_xid 1859833381102143
00000020:00000001:8.0:1773851846.906785:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851846.906785:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851846.906786:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851846.906787:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851846.906787:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851846.906788:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851846.906789:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851846.906790:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000649b1e0a.
02000000:00000001:8.0:1773851846.906791:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.906792:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851846.906792:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851846.906793:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413770366, transno 0, xid 1859833381102144
00010000:00000001:8.0:1773851846.906794:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851846.906795:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000035f73316 x1859833381102144/t0(0) o400->eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960@9264@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1069-0'
00010000:00000001:8.0:1773851846.906798:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851846.906799:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851846.906800:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=79 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851846.906802:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851846.906803:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cbd0f9ff refcount 3 to 9264@kfi7
00000100:00000001:8.0:1773851846.906804:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611904 : -107146809939712 : ffff9e8cf0746900)
02000000:00000001:8.0:1773851846.906805:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851846.906806:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.906807:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851846.906808:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9264@kfi7
00000400:00000010:8.0:1773851846.906809:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4057092.
00000100:00000200:8.0:1773851846.906810:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833381102144, offset 224
00000400:00000200:8.0:1773851846.906811:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9264@kfi7
00000400:00000200:8.0:1773851846.906813:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:8.0:1773851846.906814:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 1
00000400:00000200:8.0:1773851846.906815:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000400:00000200:8.0:1773851846.906816:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 3
00000400:00000200:8.0:1773851846.906818:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9264@kfi7 local destination
00000400:00000200:8.0:1773851846.906820:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768325:8768325:1024:4294967295] 9264@kfi7 LPNI seq info [980448:980448:16:4294967295]
00000400:00000200:8.0:1773851846.906821:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000400:00000200:8.0:1773851846.906822:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:8.0:1773851846.906824:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9264@kfi7(9264@kfi7:9264@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851846.906826:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 3
00000800:00000200:8.0:1773851846.906828:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851846.906829:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851846.906832:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851846.906835:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000009c Using peer 9264@kfi7(0x10000000000009c)
00000800:00000200:8.0:1773851846.906838:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x10000000000009c: rc=0
00000800:00000200:8.0:1773851846.906840:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000009c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851846.906842:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851846.906843:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cbd0f9ff refcount 2 to 9264@kfi7
00010000:00000001:8.0:1773851846.906844:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851846.906845:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851846.906846:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851846.906848:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000035f73316 x1859833381102144/t0(0) o400->eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960@9264@kfi7:573/0 lens 224/224 e 0 to 0 dl 1773851933 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1069-0'
00000100:00100000:8.0:1773851846.906852:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035f73316 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960+5:39688:x1859833381102144:12345-9264@kfi7:400:default-tuolumne1069-0 Request processed in 77us (130us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851846.906855:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9264@kfi7, seq: 2130695
00000100:00000040:8.0:1773851846.906856:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004cf60823 : new rpc_count 0
00000100:00000001:8.0:1773851846.906857:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851846.906858:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851846.906859:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851846.906860:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851846.906861:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003a871c4.
00000020:00000040:8.0:1773851846.906862:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004cf60823 : new refcount 4
00000100:00000001:8.0:1773851846.906862:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851846.906868:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000009c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851846.906870:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851846.906871:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9264@kfi7: PUT: OK
00000400:00000200:9.0:1773851846.906872:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4057092
00000400:00000010:9.0:1773851846.906873:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4057092.
00000100:00000001:9.0:1773851846.906874:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851846.906875:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851846.906875:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000800:00000200:9.0:1773851846.906877:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 9264@kfi7(0000000090896841):0x0 lsk 157 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000009c Transaction freed
00000800:00000200:17.0:1773851846.910658:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851846.910659:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851846.910660:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851846.910662:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851846.910664:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.910666:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23546@kfi7 : PUT - for me
00000400:00000200:17.0:1773851846.910667:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.910667:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:17.0:1773851846.910668:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.910669:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:17.0:1773851846.910670:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:17.0:1773851846.910671:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.910672:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23546@kfi7 of length 224 into portal 12 MB=0x699de8c5a8280
00000400:00000200:17.0:1773851846.910673:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23546@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 182104
00000800:00000200:17.0:1773851846.910675:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851846.910677:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851846.910678:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23546@kfi7: PUT: OK
00000100:00000001:17.0:1773851846.910679:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851846.910680:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851846.910681:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec4866a8.
00000100:00000040:17.0:1773851846.910682:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ec4866a8 x1858030976795264 msgsize 224
00000100:00100000:17.0:1773851846.910683:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23546@kfi7 (source: 12345-23546@kfi7)
00000100:00000001:17.0:1773851846.910684:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851846.910685:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000100:00000001:18.0:1773851846.910686:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851846.910686:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851846.910686:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851846.910687:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851846.910687:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851846.910688:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851846.910689:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976795264
00000020:00000001:18.0:1773851846.910689:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851846.910689:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f90
00000020:00000001:18.0:1773851846.910690:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851846.910691:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000187f9747 refcount=6
00000020:00000001:18.0:1773851846.910692:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239866368 : -107152469685248 : ffff9e8b9f1b8c00)
00000020:00000001:18.0:1773851846.910693:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239866368 : -107152469685248 : ffff9e8b9f1b8c00)
00000100:00000001:18.0:1773851846.910694:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.910694:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851846.910695:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000063aefba8.
00000020:00000010:18.0:1773851846.910696:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.910697:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d4e7664f.
00000100:00000001:18.0:1773851846.910697:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851846.910698:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851846.910698:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851846.910699:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851846.910699:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851846.910700:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.910700:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851846.910702:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851846.910702:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851846.910702:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851846.910702:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851846.910703:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23546@kfi7, seq: 2156229
00000100:00000001:19.0:1773851846.910704:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851846.910704:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.910704:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000187f9747 : new rpc_count 1
00000100:00000001:18.0:1773851846.910704:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636967363942016 : -107106345609600 : ffff9e965c511680)
00000100:00000040:18.0:1773851846.910705:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ec4866a8 x1858030976795264/t0(0) o400->f83d0353-aeb7-4630-9f36-c327d0c5209d@23546@kfi7:36/0 lens 224/0 e 0 to 0 dl 1773852151 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne260-0'
00000100:00000001:18.0:1773851846.910708:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.910708:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851846.910709:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec4866a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f83d0353-aeb7-4630-9f36-c327d0c5209d+6:47917:x1858030976795264:12345-23546@kfi7:400:default-tuolumne260-0
00000100:00000200:18.0:1773851846.910710:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976795264
00000020:00000001:18.0:1773851846.910711:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851846.910711:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851846.910712:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.910713:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851846.910713:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851846.910714:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851846.910714:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976795264, found 0 last_xid 1858030976795263
00000020:00000001:18.0:1773851846.910715:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851846.910716:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851846.910717:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851846.910717:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.910718:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851846.910718:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851846.910719:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851846.910720:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea6a97e2.
02000000:00000001:18.0:1773851846.910720:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.910721:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.910721:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851846.910722:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030976795264
00010000:00000001:18.0:1773851846.910723:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851846.910723:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ec4866a8 x1858030976795264/t0(0) o400->f83d0353-aeb7-4630-9f36-c327d0c5209d@23546@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00010000:00000001:18.0:1773851846.910728:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851846.910729:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851846.910729:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=79 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851846.910730:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851846.910731:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000099c32eae refcount 5 to 23546@kfi7
00000100:00000001:18.0:1773851846.910731:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992800 : -107142345558816 : ffff9e8dfa8d74e0)
02000000:00000001:18.0:1773851846.910732:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851846.910733:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.910733:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851846.910734:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23546@kfi7
00000400:00000010:18.0:1773851846.910735:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fd65848e.
00000100:00000200:18.0:1773851846.910735:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976795264, offset 224
00000400:00000200:18.0:1773851846.910736:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23546@kfi7
00000400:00000200:18.0:1773851846.910737:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.910738:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:18.0:1773851846.910739:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:18.0:1773851846.910740:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:18.0:1773851846.910741:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23546@kfi7 local destination
00000400:00000200:18.0:1773851846.910742:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768326:8768326:1024:4294967295] 23546@kfi7 LPNI seq info [24415:24415:16:4294967295]
00000400:00000200:18.0:1773851846.910743:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:18.0:1773851846.910744:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.910746:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23546@kfi7(23546@kfi7:23546@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851846.910747:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000800:00000200:18.0:1773851846.910748:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851846.910749:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851846.910751:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851846.910753:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 Using peer 23546@kfi7(0x184)
00000800:00000200:18.0:1773851846.910755:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000079f17c9e: Posted send of 324 bytes to peer 0x184: rc=0
00000800:00000200:18.0:1773851846.910757:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851846.910758:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.910759:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000099c32eae refcount 4 to 23546@kfi7
00010000:00000001:18.0:1773851846.910760:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851846.910760:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.910761:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851846.910761:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec4866a8 x1858030976795264/t0(0) o400->f83d0353-aeb7-4630-9f36-c327d0c5209d@23546@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00000100:00100000:18.0:1773851846.910764:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec4866a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f83d0353-aeb7-4630-9f36-c327d0c5209d+6:47917:x1858030976795264:12345-23546@kfi7:400:default-tuolumne260-0 Request processed in 56us (82us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851846.910766:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23546@kfi7, seq: 2156229
00000100:00000040:18.0:1773851846.910767:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000187f9747 : new rpc_count 0
00000100:00000001:18.0:1773851846.910768:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851846.910768:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851846.910769:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.910769:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d4e7664f.
00000800:00000200:17.0:1773851846.910769:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851846.910770:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000063aefba8.
00000400:00000200:17.0:1773851846.910770:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:18.0:1773851846.910771:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000187f9747 : new refcount 5
00000100:00000001:18.0:1773851846.910771:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851846.910771:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23546@kfi7: PUT: OK
00000400:00000200:17.0:1773851846.910772:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fd65848e
00000400:00000010:17.0:1773851846.910773:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fd65848e.
00000100:00000001:17.0:1773851846.910773:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851846.910774:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851846.910775:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000800:00000200:17.0:1773851846.910776:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 Transaction freed
00000800:00000200:17.0:1773851846.910997:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851846.910998:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851846.910999:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851846.911001:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851846.911003:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.911004:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23546@kfi7 : PUT - for me
00000400:00000200:17.0:1773851846.911005:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.911006:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:17.0:1773851846.911007:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.911007:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:17.0:1773851846.911008:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:17.0:1773851846.911009:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851846.911009:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23546@kfi7 of length 224 into portal 12 MB=0x699de8c5a8b00
00000400:00000200:17.0:1773851846.911010:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23546@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 182328
00000800:00000200:17.0:1773851846.911012:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851846.911013:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851846.911014:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23546@kfi7: PUT: OK
00000100:00000001:17.0:1773851846.911014:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851846.911015:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851846.911015:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073176bf0.
00000100:00000040:17.0:1773851846.911016:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000073176bf0 x1858030976797440 msgsize 224
00000100:00100000:17.0:1773851846.911017:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23546@kfi7 (source: 12345-23546@kfi7)
00000100:00000001:17.0:1773851846.911018:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851846.911019:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000100:00000001:18.0:1773851846.911020:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851846.911020:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851846.911020:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851846.911020:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851846.911021:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851846.911021:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851846.911022:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976797440
00000020:00000001:18.0:1773851846.911022:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851846.911022:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911b2
00000020:00000001:18.0:1773851846.911023:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851846.911025:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000054d37d52 refcount=6
00000020:00000001:18.0:1773851846.911026:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240524800 : -107152469026816 : ffff9e8b9f259800)
00000020:00000001:18.0:1773851846.911026:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240524800 : -107152469026816 : ffff9e8b9f259800)
00000100:00000001:18.0:1773851846.911027:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.911028:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851846.911028:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000063aefba8.
00000020:00000010:18.0:1773851846.911029:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851846.911029:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d4e7664f.
00000100:00000001:18.0:1773851846.911030:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851846.911030:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851846.911030:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851846.911031:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851846.911031:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851846.911032:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.911032:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851846.911033:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851846.911034:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851846.911034:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851846.911034:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851846.911034:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23546@kfi7, seq: 2156230
00000100:00000001:19.0:1773851846.911035:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851846.911035:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.911035:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000054d37d52 : new rpc_count 1
00000100:00000001:18.0:1773851846.911035:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637122274785664 : -106951434765952 : ffff9eba6db8f980)
00000100:00000040:18.0:1773851846.911036:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000073176bf0 x1858030976797440/t0(0) o400->0e359517-5439-415d-800b-f4100739af6b@23546@kfi7:634/0 lens 224/0 e 0 to 0 dl 1773851994 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne260-0'
00000100:00000001:18.0:1773851846.911039:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851846.911039:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851846.911040:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073176bf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:0e359517-5439-415d-800b-f4100739af6b+6:47919:x1858030976797440:12345-23546@kfi7:400:default-tuolumne260-0
00000100:00000200:18.0:1773851846.911044:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976797440
00000020:00000001:18.0:1773851846.911045:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851846.911045:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851846.911045:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.911046:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851846.911046:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851846.911047:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851846.911047:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976797440, found 0 last_xid 1858030976797439
00000020:00000001:18.0:1773851846.911048:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851846.911048:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851846.911049:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851846.911049:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.911050:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851846.911050:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851846.911050:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851846.911051:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dfd51703.
02000000:00000001:18.0:1773851846.911051:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.911052:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.911052:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851846.911053:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768321, transno 0, xid 1858030976797440
00010000:00000001:18.0:1773851846.911053:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851846.911054:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000073176bf0 x1858030976797440/t0(0) o400->0e359517-5439-415d-800b-f4100739af6b@23546@kfi7:634/0 lens 224/224 e 0 to 0 dl 1773851994 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00010000:00000001:18.0:1773851846.911056:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851846.911057:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851846.911057:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=79 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851846.911058:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851846.911058:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000099c32eae refcount 5 to 23546@kfi7
00000100:00000001:18.0:1773851846.911059:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992800 : -107142345558816 : ffff9e8dfa8d74e0)
02000000:00000001:18.0:1773851846.911060:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851846.911060:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851846.911060:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851846.911061:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23546@kfi7
00000400:00000010:18.0:1773851846.911062:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f8010c39.
00000100:00000200:18.0:1773851846.911063:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976797440, offset 224
00000400:00000200:18.0:1773851846.911064:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23546@kfi7
00000400:00000200:18.0:1773851846.911065:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.911066:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:18.0:1773851846.911067:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:18.0:1773851846.911068:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:18.0:1773851846.911069:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23546@kfi7 local destination
00000400:00000200:18.0:1773851846.911070:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768327:8768327:1024:4294967295] 23546@kfi7 LPNI seq info [24416:24416:16:4294967295]
00000400:00000200:18.0:1773851846.911071:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:18.0:1773851846.911072:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851846.911074:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23546@kfi7(23546@kfi7:23546@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851846.911075:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000800:00000200:18.0:1773851846.911076:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851846.911077:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851846.911079:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851846.911081:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a Using peer 23546@kfi7(0x10000000000018a)
00000800:00000200:18.0:1773851846.911084:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000022b02854: Posted send of 324 bytes to peer 0x10000000000018a: rc=0
00000800:00000200:18.0:1773851846.911086:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851846.911088:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851846.911088:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000099c32eae refcount 4 to 23546@kfi7
00010000:00000001:18.0:1773851846.911089:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851846.911090:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851846.911090:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851846.911091:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073176bf0 x1858030976797440/t0(0) o400->0e359517-5439-415d-800b-f4100739af6b@23546@kfi7:634/0 lens 224/224 e 0 to 0 dl 1773851994 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00000100:00100000:18.0:1773851846.911094:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073176bf0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:0e359517-5439-415d-800b-f4100739af6b+6:47919:x1858030976797440:12345-23546@kfi7:400:default-tuolumne260-0 Request processed in 54us (77us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851846.911096:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23546@kfi7, seq: 2156230
00000100:00000040:18.0:1773851846.911097:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000054d37d52 : new rpc_count 0
00000800:00000200:17.0:1773851846.911097:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851846.911098:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851846.911098:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851846.911098:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851846.911098:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851846.911099:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d4e7664f.
00000400:00000200:17.0:1773851846.911099:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23546@kfi7: PUT: OK
00000400:00000200:17.0:1773851846.911099:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f8010c39
00000020:00000010:18.0:1773851846.911100:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000063aefba8.
00000020:00000040:18.0:1773851846.911100:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000054d37d52 : new refcount 5
00000400:00000010:17.0:1773851846.911100:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f8010c39.
00000100:00000001:17.0:1773851846.911100:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851846.911100:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:18.0:1773851846.911101:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851846.911101:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000800:00000200:17.0:1773851846.911102:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a Transaction freed
00000800:00000200:1.0:1773851846.938944:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851846.938945:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851846.938948:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851846.938952:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851846.938955:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:1.0:1773851846.938956:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9635@kfi7 : PUT - for me
00000400:00000200:1.0:1773851846.938958:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:1.0:1773851846.938959:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 1
00000400:00000200:1.0:1773851846.938960:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:1.0:1773851846.938961:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000400:00000200:1.0:1773851846.938961:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 3
00000400:00000200:1.0:1773851846.938963:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9634@kfi7 to cpt 4
00000400:00000200:1.0:1773851846.938964:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9634@kfi7 of length 224 into portal 12 MB=0x69b16e344a780
00000400:00000200:1.0:1773851846.938966:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9634@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 2688
00000800:00000200:1.0:1773851846.938969:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851846.938971:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851846.938973:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9635@kfi7: PUT: OK
00000100:00000001:1.0:1773851846.938974:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851846.938975:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851846.938976:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000624c19fa.
00000100:00000040:1.0:1773851846.938977:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000624c19fa x1859372464777088 msgsize 224
00000100:00100000:1.0:1773851846.938979:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9634@kfi7 (source: 12345-9635@kfi7)
00000100:00000001:1.0:1773851846.938980:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851846.938981:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000100:00000001:2.0:1773851846.938982:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851846.938983:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851846.938983:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851846.938983:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851846.938984:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851846.938986:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851846.938987:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372464777088
00000020:00000001:2.0:1773851846.938988:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851846.938988:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92cd9
00000020:00000001:2.0:1773851846.938989:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851846.938991:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055b589d0 refcount=6
00000020:00000001:2.0:1773851846.938992:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744181760 : -107128965369856 : ffff9e911812f000)
00000020:00000001:2.0:1773851846.938994:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744181760 : -107128965369856 : ffff9e911812f000)
00000100:00000001:2.0:1773851846.938995:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851846.938996:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851846.938997:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009abda479.
00000020:00000010:2.0:1773851846.938999:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851846.939000:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ebfb08ad.
00000100:00000001:2.0:1773851846.939001:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851846.939002:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851846.939003:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851846.939004:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851846.939005:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851846.939005:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851846.939006:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851846.939008:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851846.939008:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851846.939009:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851846.939009:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851846.939010:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9634@kfi7, seq: 1997464
00000100:00000040:2.0:1773851846.939012:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055b589d0 : new rpc_count 1
00000100:00000001:2.0:1773851846.939012:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114618889088 : -106959090662528 : ffff9eb8a5654380)
00000100:00000001:1.0:1773851846.939012:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851846.939012:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851846.939014:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000624c19fa x1859372464777088/t0(0) o400->b3c55872-df76-4f6b-afab-454c5fab4d74@9634@kfi7:486/0 lens 224/0 e 0 to 0 dl 1773852601 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1084-0'
00000100:00000001:2.0:1773851846.939022:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851846.939022:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851846.939023:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000624c19fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b3c55872-df76-4f6b-afab-454c5fab4d74+6:39311:x1859372464777088:12345-9634@kfi7:400:default-tuolumne1084-0
00000100:00000200:2.0:1773851846.939025:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372464777088
00000020:00000001:2.0:1773851846.939026:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851846.939027:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851846.939028:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851846.939029:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851846.939030:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851846.939030:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851846.939031:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372464777088, found 0 last_xid 1859372464777087
00000020:00000001:2.0:1773851846.939032:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851846.939033:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851846.939034:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851846.939034:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851846.939035:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851846.939036:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851846.939037:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851846.939038:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001c17cfca.
02000000:00000001:2.0:1773851846.939039:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851846.939040:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851846.939040:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851846.939041:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475272959, transno 0, xid 1859372464777088
00010000:00000001:2.0:1773851846.939042:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851846.939043:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000624c19fa x1859372464777088/t0(0) o400->b3c55872-df76-4f6b-afab-454c5fab4d74@9634@kfi7:486/0 lens 224/224 e 0 to 0 dl 1773852601 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1084-0'
00010000:00000001:2.0:1773851846.939046:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851846.939047:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851846.939048:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=79 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851846.939050:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851846.939051:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e0f5d3c refcount 3 to 9634@kfi7
00000100:00000001:2.0:1773851846.939052:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960032 : -107156125591584 : ffff9e8ac532d7e0)
02000000:00000001:2.0:1773851846.939053:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851846.939054:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851846.939055:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851846.939056:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9635@kfi7
00000400:00000010:2.0:1773851846.939057:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054da3b56.
00000100:00000200:2.0:1773851846.939059:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372464777088, offset 224
00000400:00000200:2.0:1773851846.939060:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9635@kfi7
00000400:00000200:2.0:1773851846.939062:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:2.0:1773851846.939062:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 1
00000400:00000200:2.0:1773851846.939064:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000400:00000200:2.0:1773851846.939065:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 3
00000400:00000200:2.0:1773851846.939067:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9635@kfi7 local destination
00000400:00000200:2.0:1773851846.939069:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768328:8768328:1024:4294967295] 9635@kfi7 LPNI seq info [17494:17494:16:4294967295]
00000400:00000200:2.0:1773851846.939071:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000400:00000200:2.0:1773851846.939071:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:2.0:1773851846.939073:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9635@kfi7(9635@kfi7:9635@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851846.939075:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 3
00000800:00000200:2.0:1773851846.939077:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851846.939078:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851846.939082:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851846.939085:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d83 Using peer 9635@kfi7(0x100000000000d83)
00000800:00000200:2.0:1773851846.939088:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000009005aa0b: Posted send of 324 bytes to peer 0x100000000000d83: rc=0
00000800:00000200:2.0:1773851846.939090:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d83 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851846.939093:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851846.939094:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e0f5d3c refcount 2 to 9634@kfi7
00010000:00000001:2.0:1773851846.939095:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851846.939096:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851846.939097:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851846.939098:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000624c19fa x1859372464777088/t0(0) o400->b3c55872-df76-4f6b-afab-454c5fab4d74@9634@kfi7:486/0 lens 224/224 e 0 to 0 dl 1773852601 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1084-0'
00000100:00100000:2.0:1773851846.939101:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000624c19fa pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b3c55872-df76-4f6b-afab-454c5fab4d74+6:39311:x1859372464777088:12345-9634@kfi7:400:default-tuolumne1084-0 Request processed in 78us (123us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851846.939103:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d83 TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851846.939104:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9634@kfi7, seq: 1997464
00000100:00000040:2.0:1773851846.939105:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055b589d0 : new rpc_count 0
00000400:00000200:1.0:1773851846.939105:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851846.939106:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:1.0:1773851846.939106:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9635@kfi7: PUT: OK
00000100:00000001:2.0:1773851846.939107:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:1.0:1773851846.939107:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054da3b56
00000400:00000010:1.0:1773851846.939107:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054da3b56.
00000020:00000010:2.0:1773851846.939108:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000100:00000001:1.0:1773851846.939108:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:2.0:1773851846.939109:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ebfb08ad.
00000100:00000001:1.0:1773851846.939109:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:2.0:1773851846.939110:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009abda479.
00000400:00000200:1.0:1773851846.939110:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000020:00000040:2.0:1773851846.939111:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000055b589d0 : new refcount 5
00000800:00000200:1.0:1773851846.939111:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 9635@kfi7(000000005baf22e9):0x0 lsk 3460 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d83 Transaction freed
00000100:00000001:2.0:1773851846.939112:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851846.985731:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851846.985732:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851846.985732:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:11.0:1773851846.985734:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851846.985734:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000094637c7a.
00000100:00000010:11.0:1773851846.985735:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b624700f.
00000020:00000040:10.0:1773851846.985735:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000020:00000040:11.0:1773851846.985736:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000100:00000001:10.0:1773851846.985737:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:11.0:1773851846.985738:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851846.985738:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851846.985738:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851846.985739:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851846.985739:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851846.985741:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001b3f89b7.
02000000:00000010:10.0:1773851846.985741:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006db6fddb.
00000100:00000001:11.0:1773851846.985742:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851846.985743:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851846.985744:0:2514903:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre5-MDT0000-lwp-MDT0001_UUID->lustre5-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00000001:11.0:1773851846.985744:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851846.985744:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851846.985745:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851846.985745:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851846.985747:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b624700f] to pc [ptlrpcd_02_01+1]  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851846.985747:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000094637c7a] to pc [ptlrpcd_02_00+0]  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851846.985749:0:2514903:0:(pinger.c:136:ptlrpc_ping()) Process entered
00000100:00000010:28.0:1773851846.985751:0:2514903:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006123b392.
00000020:00000040:28.0:1773851846.985755:0:2514903:0:(genops.c:1094:class_import_get()) import 000000002745b77b refcount=3 obd=lustre5-MDT0000-lwp-MDT0001
00000004:00000001:10.0:1773851846.985755:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.985756:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851846.985757:0:2514903:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:11.0:1773851846.985757:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851846.985757:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851846.985757:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851846.985757:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851846.985757:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:28.0:1773851846.985758:0:2514903:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:9.0:1773851846.985758:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:9.0:1773851846.985759:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851846.985759:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:28.0:1773851846.985760:0:2514903:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851846.985763:0:2514903:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000053e4c7dc.
00000100:00000001:8.0:1773851846.985763:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851846.985764:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851846.985764:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.985764:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851846.985765:0:2514903:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851846.985765:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851846.985765:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851846.985766:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851846.985766:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851846.985767:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051919872:42@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851846.985767:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094637c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051919936:12@kfi7:13:default-yuba2-0
00000100:00000040:28.0:1773851846.985768:0:2514903:0:(pinger.c:151:ptlrpc_ping()) @@@ pinging lustre5-MDT0000-lwp-MDT0001_UUID->lustre5-MDT0000_UUID  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00000001:9.0:1773851846.985769:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851846.985769:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851846.985770:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851846.985770:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851846.985771:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851846.985771:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851846.985771:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851846.985771:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851846.985773:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000000df5f72a.
02000000:00000010:8.0:1773851846.985773:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007267d3a2.
02000000:00000001:9.0:1773851846.985774:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851846.985774:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851846.985775:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:28.0:1773851846.985776:0:2514903:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000400:00000200:9.0:1773851846.985776:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:8.0:1773851846.985776:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000400:00000010:9.0:1773851846.985777:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000008e789f23.
00000100:00000001:28.0:1773851846.985778:0:2514903:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851846.985778:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f232fba1.
00000400:00000010:8.0:1773851846.985778:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002bb674c2.
00000100:00000040:28.0:1773851846.985779:0:2514903:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006123b392] to pc [ptlrpcd_07_03+3]  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851846.985779:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051919872, portal 4
00000100:00000200:8.0:1773851846.985779:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051919936, portal 4
00000100:00000001:9.0:1773851846.985780:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851846.985780:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851846.985781:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637164268282624 : -106909441268992 : ffff9ec434bae300)
00000100:00000001:8.0:1773851846.985781:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077423488 : -106968632128128 : ffff9eb66cae0d80)
00000100:00000040:9.0:1773851846.985783:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851846.985783:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851846.985786:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851846.985786:0:2514903:0:(pinger.c:160:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851846.985786:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851846.985786:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851846.985787:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000100:00000040:8.0:1773851846.985787:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000100:00000001:31.0:1773851846.985788:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:9.0:1773851846.985788:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000400:00000010:8.0:1773851846.985788:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006188a4b8.
00000100:00000001:31.0:1773851846.985789:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851846.985789:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:9.0:1773851846.985789:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051919872, offset 0
00000100:00000200:8.0:1773851846.985789:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051919936, offset 0
00000100:00000001:29.0:1773851846.985790:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851846.985790:0:2514903:0:(pinger.c:320:ptlrpc_pinger_main()) next wakeup in 16 (614171)
00000400:00000200:9.0:1773851846.985790:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000100:00000040:31.0:1773851846.985791:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851846.985792:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851846.985792:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:9.0:1773851846.985793:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:9.0:1773851846.985794:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851846.985795:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000100:00000001:31.0:1773851846.985797:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851846.985797:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851846.985797:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:9.0:1773851846.985798:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768326, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768328, p:4294967295, g:4294967295, h:1000]
02000000:00000001:31.0:1773851846.985799:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851846.985799:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851846.985801:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006123b392 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0000-lwp-MDT0001_UUID:41091:1859433051920000:61@kfi7:400:default-yuba2-0
00000400:00000200:9.0:1773851846.985801:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851846.985802:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851846.985803:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:9.0:1773851846.985803:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
02000000:00000001:31.0:1773851846.985804:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851846.985804:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851846.985804:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768329:8768329:1024:4294967295] 42@kfi7 LPNI seq info [5404893:5404893:16:4294967295]
02000000:00000001:31.0:1773851846.985805:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:31.0:1773851846.985806:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 000000005b012337.
00000400:00000200:9.0:1773851846.985806:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851846.985807:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
02000000:00000001:31.0:1773851846.985808:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851846.985808:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:31.0:1773851846.985809:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:8.0:1773851846.985809:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000010:31.0:1773851846.985810:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000200:9.0:1773851846.985810:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851846.985810:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000010:31.0:1773851846.985812:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f33d0462.
00000400:00000200:9.0:1773851846.985812:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:8.0:1773851846.985812:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000100:00000200:31.0:1773851846.985813:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1859433051920000, portal 10
00000400:00000200:8.0:1773851846.985813:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000800:00000200:9.0:1773851846.985814:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:31.0:1773851846.985815:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851846.985815:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324247424 : -106976385304192 : ffff9eb49e8df980)
00000800:00000200:9.0:1773851846.985815:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:8.0:1773851846.985815:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768329, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768328, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851846.985817:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000040:31.0:1773851846.985818:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851846.985818:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851846.985819:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000100:00000001:31.0:1773851846.985821:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:9.0:1773851846.985821:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:8.0:1773851846.985821:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768330:8768330:1024:4294967295] 12@kfi7 LPNI seq info [5403452:5403452:16:4294967295]
00000100:00000040:31.0:1773851846.985822:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-61@kfi7
00000400:00000200:8.0:1773851846.985822:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000010:31.0:1773851846.985823:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000535cda91.
00000100:00000200:31.0:1773851846.985824:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1859433051920000, offset 0
00000800:00000200:9.0:1773851846.985824:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000400:00000200:8.0:1773851846.985824:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:31.0:1773851846.985825:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-61@kfi7
00000400:00000200:31.0:1773851846.985826:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:8.0:1773851846.985826:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000800:00000200:9.0:1773851846.985827:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x17b: rc=0
00000400:00000200:8.0:1773851846.985827:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:31.0:1773851846.985828:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000800:00000200:9.0:1773851846.985829:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:8.0:1773851846.985829:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:31.0:1773851846.985830:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:8.0:1773851846.985830:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851846.985831:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000100:00000001:9.0:1773851846.985831:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851846.985832:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  61@kfi7 local destination
00000100:00000001:9.0:1773851846.985832:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851846.985833:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851846.985833:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851846.985833:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851846.985834:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851846.985835:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768329, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768330, p:4294967295, g:4294967295, h:1000]
00000100:00000001:9.0:1773851846.985835:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:8.0:1773851846.985835:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Using peer 12@kfi7(0x200000000000473)
00000100:00000001:9.0:1773851846.985836:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851846.985837:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851846.985837:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:31.0:1773851846.985838:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:9.0:1773851846.985838:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851846.985838:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851846.985839:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851846.985841:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851846.985842:0:41091:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[43@kfi7, 61@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[37492095, 37492094]
00000800:00000200:9.0:1773851846.985842:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000800:00000200:8.0:1773851846.985842:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x200000000000473: rc=0
00000400:00000200:31.0:1773851846.985844:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 61@kfi7
00000400:00000200:9.0:1773851846.985844:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:8.0:1773851846.985844:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851846.985845:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768331:8768331:1023:4294967295] 61@kfi7 LPNI seq info [37492096:37492096:16:4294967295]
00000400:00000200:9.0:1773851846.985845:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:31.0:1773851846.985846:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:9.0:1773851846.985846:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000100:00000001:8.0:1773851846.985846:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851846.985847:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000010:9.0:1773851846.985847:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:8.0:1773851846.985847:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851846.985848:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:8.0:1773851846.985848:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.985848:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851846.985849:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851846.985849:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851846.985850:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 61@kfi7(61@kfi7:61@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851846.985851:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000100:00000001:8.0:1773851846.985851:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851846.985852:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851846.985852:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:31.0:1773851846.985853:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000040:9.0:1773851846.985853:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851846.985853:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851846.985853:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:31.0:1773851846.985855:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851846.985856:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851846.985856:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:8.0:1773851846.985856:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851846.985857:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:8.0:1773851846.985857:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851846.985858:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851846.985858:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851846.985860:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851846.985860:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000800:00000200:31.0:1773851846.985861:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 7 tta 0x70f Using peer 61@kfi7(0x70f)
00000400:00000200:10.0:1773851846.985862:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000400:00000200:10.0:1773851846.985863:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006188a4b8
00000400:00000010:10.0:1773851846.985863:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006188a4b8.
00000800:00000200:31.0:1773851846.985864:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x70f: rc=0
00000100:00000001:10.0:1773851846.985864:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851846.985865:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851846.985866:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 7 tta 0x70f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851846.985869:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851846.985869:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851846.985870:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:10.0:1773851846.985870:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851846.985871:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851846.985871:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851846.985872:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851846.985872:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851846.985873:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851846.985873:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=240 : 240 : f0)
00000100:00000001:10.0:1773851846.985873:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851846.985874:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:25.0:1773851846.985874:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:10.0:1773851846.985874:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:31.0:1773851846.985875:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851846.985875:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851846.985875:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851846.985875:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851846.985877:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851846.985877:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Transaction freed
00000800:00000200:29.0:1773851846.985879:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 7 tta 0x70f TN_EVENT_TX_OK event status 0
00000800:00000200:25.0:1773851846.985879:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851846.985881:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:29.0:1773851846.985882:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851846.985883:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:29.0:1773851846.985884:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->61@kfi7: PUT: OK
00000400:00000200:25.0:1773851846.985884:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851846.985885:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:29.0:1773851846.985886:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000535cda91
00000400:00000200:25.0:1773851846.985886:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851846.985886:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000010:29.0:1773851846.985887:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000535cda91.
00000400:00000200:25.0:1773851846.985887:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000100:00000001:29.0:1773851846.985888:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:25.0:1773851846.985888:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000200:29.0:1773851846.985889:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851846.985889:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1600
00000400:00000200:25.0:1773851846.985889:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851846.985891:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b815b9 [1] + 224
00000100:00000001:29.0:1773851846.985893:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:25.0:1773851846.985893:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:29.0:1773851846.985894:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 2 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851846.985894:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851846.985895:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851846.985896:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851846.985897:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:25.0:1773851846.985897:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851846.985898:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851846.985899:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:29.0:1773851846.985901:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 7 tta 0x70f Transaction freed
00000100:00000040:25.0:1773851846.985901:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851846.985905:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:25.0:1773851846.985906:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:9.0:1773851846.985906:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851846.985907:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:25.0:1773851846.985908:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:9.0:1773851846.985908:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851846.985909:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00000001:10.0:1773851846.985910:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851846.985910:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851846.985910:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851846.985910:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851846.985911:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:10.0:1773851846.985912:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851846.985912:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:9.0:1773851846.985912:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:10.0:1773851846.985913:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000008e789f23.
00000800:00000200:1.0:1773851846.985913:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851846.985914:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f232fba1
00000400:00000200:9.0:1773851846.985914:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000010:10.0:1773851846.985915:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f232fba1.
00000400:00000200:9.0:1773851846.985915:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:10.0:1773851846.985916:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851846.985916:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:1.0:1773851846.985916:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000200:10.0:1773851846.985917:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851846.985917:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851846.985918:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:1.0:1773851846.985918:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 61@kfi7 : PUT - for me
00000400:00000200:1.0:1773851846.985919:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000200:10.0:1773851846.985920:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851846.985920:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:1.0:1773851846.985920:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:9.0:1773851846.985921:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:1.0:1773851846.985921:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:10.0:1773851846.985922:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851846.985922:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1640
00000400:00000200:1.0:1773851846.985922:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:1.0:1773851846.985922:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000100:00000001:10.0:1773851846.985923:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851846.985924:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851846.985924:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:9.0:1773851846.985924:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:1.0:1773851846.985924:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:10.0:1773851846.985925:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851846.985925:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781696629 [1] + 224
00000400:00000200:1.0:1773851846.985925:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 10 MB=0x69b24fe8b1680
00000100:00000001:10.0:1773851846.985926:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851846.985926:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851846.985926:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000800:00000200:9.0:1773851846.985927:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:10.0:1773851846.985928:0:41069:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=79 v=66 (66 66 66 66)
00000400:00000200:1.0:1773851846.985928:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index a from 12345-61@kfi7 of length 224/224 into md 0x7fb71c6e1 [1] + 224
00000100:00001000:10.0:1773851846.985929:0:41069:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=79 v=66 (1 1 1 1)
00000400:00000200:9.0:1773851846.985929:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851846.985930:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:9.0:1773851846.985930:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000800:00000200:1.0:1773851846.985930:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851846.985931:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851846.985931:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:9.0:1773851846.985931:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851846.985931:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:10.0:1773851846.985932:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851846.985932:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851846.985932:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->61@kfi7: PUT: OK
00000100:00000001:10.0:1773851846.985933:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:1.0:1773851846.985933:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:10.0:1773851846.985934:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000001:10.0:1773851846.985935:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:9.0:1773851846.985935:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:1.0:1773851846.985935:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851846.985936:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851846.985937:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851846.985938:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851846.985939:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000040:1.0:1773851846.985939:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851846.985940:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851846.985940:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851846.985940:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851846.985941:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851846.985941:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851846.985941:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:8.0:1773851846.985941:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851846.985941:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000001:10.0:1773851846.985942:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000010:8.0:1773851846.985942:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000400:00000200:8.0:1773851846.985942:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002bb674c2
00000004:00000040:10.0:1773851846.985943:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000400:00000010:8.0:1773851846.985943:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002bb674c2.
00000100:00000001:1.0:1773851846.985943:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:10.0:1773851846.985944:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351379049472 avail=351376133120 avail_mb=1372563020 hwm_mb=3131103 files=372019222 ffree=343143603 state=0: rc = 0
00000100:00000001:8.0:1773851846.985944:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851846.985944:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000200:8.0:1773851846.985945:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851846.985946:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851846.985946:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000020:10.0:1773851846.985946:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351379049472 free, 351376133120 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019222 files, 343143603 free files
00000800:00000200:1.0:1773851846.985946:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851846.985947:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851846.985948:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851846.985948:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000004:00000001:10.0:1773851846.985948:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851846.985948:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851846.985949:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f33d0462
00000100:00000040:10.0:1773851846.985949:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:31.0:1773851846.985950:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f33d0462.
00000100:00000001:31.0:1773851846.985950:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851846.985950:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851846.985951:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851846.985951:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:31.0:1773851846.985952:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851846.985952:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851846.985952:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00100000:10.0:1773851846.985953:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051919872:42@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851846.985953:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851846.985953:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851846.985954:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=79 v=66 (66 66 66 66)
00000100:00000200:31.0:1773851846.985955:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Rpc:RNQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851846.985955:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:8.0:1773851846.985955:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=79 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851846.985956:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851846.985957:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:10.0:1773851846.985957:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b624700f x1859433051919872/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851846.985957:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851846.985957:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851846.985958:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851846.985958:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:31.0:1773851846.985959:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851846.985959:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851846.985959:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00010000:00000001:8.0:1773851846.985959:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851846.985959:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851846.985960:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851846.985960:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851846.985960:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:8.0:1773851846.985960:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:8.0:1773851846.985960:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000001:31.0:1773851846.985961:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851846.985961:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000000df5f72a.
00000100:00000001:8.0:1773851846.985961:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851846.985962:0:41091:0:(import.c:1951:at_measured()) add 215 to 00000000bdd870d6 time=79 v=188 (188 66 66 66)
02000000:00000001:10.0:1773851846.985962:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851846.985962:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:8.0:1773851846.985962:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:31.0:1773851846.985963:0:41091:0:(import.c:2016:at_measured()) AT 00000000bdd870d6 change: old=188 new=215 delta=27 (val=215) hist 215 66 66 66
00000020:00000040:10.0:1773851846.985963:0:41069:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:10.0:1773851846.985964:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:8.0:1773851846.985964:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:31.0:1773851846.985965:0:41091:0:(client.c:379:ptlrpc_at_adj_service()) The RPC service estimate for lustre5-MDT0000-lwp-MDT0001 ptl 12 has changed from 188 to 215
02000000:00000010:10.0:1773851846.985965:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001b3f89b7.
00000100:00000001:8.0:1773851846.985965:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00001000:31.0:1773851846.985966:0:41091:0:(import.c:1951:at_measured()) add 1 to 0000000091f5e909 time=79 v=66 (1 1 1 1)
02000000:00000001:10.0:1773851846.985966:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851846.985966:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:8.0:1773851846.985966:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851846.985966:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851846.985967:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851846.985967:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:10.0:1773851846.985967:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b624700f.
00000004:00000040:8.0:1773851846.985967:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00010000:00000001:31.0:1773851846.985968:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851846.985968:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851846.985968:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000040:8.0:1773851846.985968:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541593088 avail=351539595264 avail_mb=1373201544 hwm_mb=3131101 files=372136813 ffree=343302337 state=0: rc = 0
00000100:00000001:10.0:1773851846.985969:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851846.985969:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851846.985970:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851846.985970:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0000-lwp-MDT0001: skip recheck: last_committed 0
00000004:00000020:8.0:1773851846.985970:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541593088 free, 351539595264 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136813 files, 343302337 free files
00000100:00000001:31.0:1773851846.985971:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851846.985971:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851846.985971:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851846.985971:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851846.985971:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851846.985972:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851846.985972:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851846.985973:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851846.985973:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851846.985975:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851846.985976:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00100000:8.0:1773851846.985976:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094637c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051919936:12@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851846.985977:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851846.985977:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851846.985978:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851846.985978:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851846.985979:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000094637c7a x1859433051919936/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773851999 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851846.985981:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006123b392 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0000-lwp-MDT0001_UUID:41091:1859433051920000:61@kfi7:400:default-yuba2-0
00000100:00000001:8.0:1773851846.985981:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851846.985981:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851846.985982:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007267d3a2.
00000100:00000001:31.0:1773851846.985983:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851846.985983:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:8.0:1773851846.985983:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851846.985983:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:31.0:1773851846.985984:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006123b392 x1859433051920000/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Complete:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:8.0:1773851846.985985:0:41068:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:8.0:1773851846.985985:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:31.0:1773851846.985986:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000010:8.0:1773851846.985986:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006db6fddb.
02000000:00000001:8.0:1773851846.985986:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851846.985987:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:8.0:1773851846.985987:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851846.985987:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094637c7a.
02000000:00000010:31.0:1773851846.985988:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 000000005b012337.
02000000:00000001:31.0:1773851846.985988:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:8.0:1773851846.985988:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000020:00000001:31.0:1773851846.985989:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851846.985989:0:41091:0:(genops.c:1107:class_import_put()) import 000000002745b77b refcount=2 obd=lustre5-MDT0000-lwp-MDT0001
00000100:00000001:8.0:1773851846.985989:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851846.985989:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851846.985990:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:8.0:1773851846.985990:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851846.985990:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851846.985991:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000053e4c7dc.
00000100:00000001:8.0:1773851846.985991:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851846.985991:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851846.985992:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851846.985992:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851846.985993:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006123b392.
00000100:00000001:31.0:1773851846.985994:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851846.985994:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851846.985994:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851846.985995:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851846.985996:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851846.985996:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851846.985997:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851847.048201:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.048202:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851847.048205:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851847.048209:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851847.048213:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10258@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.048215:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10258@kfi7 : PUT - for me
00000400:00000200:29.0:1773851847.048217:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10258@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.048220:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000049d58dd9 nid 10258@kfi7 refs 1
00000400:00000200:29.0:1773851847.048222:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10258@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.048224:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000049d58dd9 nid 10258@kfi7 refs 2
00000400:00000200:29.0:1773851847.048225:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000049d58dd9 nid 10258@kfi7 refs 3
00000400:00000200:29.0:1773851847.048227:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10259@kfi7 to cpt 2
00000400:00000200:29.0:1773851847.048229:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10259@kfi7 of length 224 into portal 12 MB=0x699e1a76977c0
00000400:00000200:29.0:1773851847.048232:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10259@kfi7 of length 224/224 into md 0x77fe139dd [64] + 153128
00000800:00000200:29.0:1773851847.048236:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851847.048239:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851847.048241:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10258@kfi7: PUT: OK
00000100:00000001:29.0:1773851847.048243:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851847.048244:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851847.048246:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000090045927.
00000100:00000040:29.0:1773851847.048247:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000090045927 x1858044315662272 msgsize 224
00000100:00100000:29.0:1773851847.048250:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-10259@kfi7 (source: 12345-10258@kfi7)
00000100:00000001:29.0:1773851847.048253:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851847.048255:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000049d58dd9 nid 10258@kfi7 refs 2
00000800:00000200:29.0:1773851847.048257:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851847.048262:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851847.048263:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851847.048264:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851847.048265:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851847.048266:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851847.048268:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044315662272
00000020:00000001:29.0:1773851847.048269:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851847.048270:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac915a9
00000020:00000001:29.0:1773851847.048271:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.048276:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007fc40578 refcount=363
00000020:00000001:29.0:1773851847.048277:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241014272 : -107152468537344 : ffff9e8b9f2d1000)
00000020:00000001:29.0:1773851847.048279:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241014272 : -107152468537344 : ffff9e8b9f2d1000)
00000100:00000001:29.0:1773851847.048280:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851847.048281:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851847.048283:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b92c4ee7.
00000020:00000010:29.0:1773851847.048285:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851847.048287:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000317bc9e2.
00000100:00000001:29.0:1773851847.048289:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851847.048290:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851847.048291:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851847.048294:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851847.048295:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851847.048295:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.048297:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851847.048299:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851847.048300:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851847.048300:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851847.048301:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851847.048302:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10259@kfi7, seq: 2055432
00000100:00000001:31.0:1773851847.048304:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851847.048304:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007fc40578 : new rpc_count 7
00000100:00000001:31.0:1773851847.048305:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.048305:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106004699264 : -106967704852352 : ffff9eb6a3f32880)
00000100:00000040:29.0:1773851847.048307:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000090045927 x1858044315662272/t0(0) o400->34811429-c6b2-421e-b235-07cda588e89d@10259@kfi7:635/0 lens 224/0 e 0 to 0 dl 1773851995 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1141-0'
00000100:00000001:29.0:1773851847.048314:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851847.048315:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851847.048316:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090045927 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:34811429-c6b2-421e-b235-07cda588e89d+363:39684:x1858044315662272:12345-10259@kfi7:400:default-tuolumne1141-0
00000100:00000200:29.0:1773851847.048319:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044315662272
00000020:00000001:29.0:1773851847.048320:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851847.048322:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851847.048323:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.048324:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851847.048325:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851847.048327:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851847.048329:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044315662272, found 0 last_xid 1858044266998783
00000020:00000001:29.0:1773851847.048330:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851847.048331:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851847.048332:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851847.048333:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.048335:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851847.048336:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851847.048337:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851847.048339:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ec823cb4.
02000000:00000001:29.0:1773851847.048340:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.048341:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.048342:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851847.048344:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590323, transno 0, xid 1858044315662272
00010000:00000001:29.0:1773851847.048345:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851847.048347:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000090045927 x1858044315662272/t0(0) o400->34811429-c6b2-421e-b235-07cda588e89d@10259@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1141-0'
00010000:00000001:29.0:1773851847.048351:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851847.048352:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851847.048354:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=80 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851847.048356:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851847.048358:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b01af907 refcount 3 to 10259@kfi7
00000100:00000001:29.0:1773851847.048359:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959057344 : -107146750494272 : ffff9e8cf3ff79c0)
02000000:00000001:29.0:1773851847.048361:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851847.048361:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.048363:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851847.048364:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10258@kfi7
00000400:00000010:29.0:1773851847.048365:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b9245dae.
00000100:00000200:29.0:1773851847.048366:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044315662272, offset 224
00000400:00000200:29.0:1773851847.048369:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10258@kfi7
00000400:00000200:29.0:1773851847.048370:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10258@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.048372:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000049d58dd9 nid 10258@kfi7 refs 1
00000400:00000200:29.0:1773851847.048373:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000049d58dd9 nid 10258@kfi7 refs 2
00000400:00000200:29.0:1773851847.048375:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000049d58dd9 nid 10258@kfi7 refs 3
00000400:00000200:29.0:1773851847.048378:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10258@kfi7 local destination
00000400:00000200:29.0:1773851847.048380:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768332:8768332:1024:4294967295] 10258@kfi7 LPNI seq info [12723182:12723182:16:4294967295]
00000400:00000200:29.0:1773851847.048383:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000049d58dd9 nid 10258@kfi7 refs 2
00000400:00000200:29.0:1773851847.048385:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10258@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.048388:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10258@kfi7(10258@kfi7:10258@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851847.048390:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000049d58dd9 nid 10258@kfi7 refs 3
00000800:00000200:29.0:1773851847.048393:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.048395:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851847.048399:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851847.048404:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e3f Using peer 10258@kfi7(0x100000000000e3f)
00000800:00000200:29.0:1773851847.048410:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 324 bytes to peer 0x100000000000e3f: rc=0
00000800:00000200:29.0:1773851847.048414:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e3f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851847.048418:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851847.048420:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b01af907 refcount 2 to 10259@kfi7
00010000:00000001:29.0:1773851847.048421:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851847.048422:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.048424:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851847.048425:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000090045927 x1858044315662272/t0(0) o400->34811429-c6b2-421e-b235-07cda588e89d@10259@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1141-0'
00000800:00000200:30.0:1773851847.048430:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e3f TN_EVENT_TX_OK event status 0
00000100:00100000:29.0:1773851847.048432:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090045927 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:34811429-c6b2-421e-b235-07cda588e89d+363:39684:x1858044315662272:12345-10259@kfi7:400:default-tuolumne1141-0 Request processed in 117us (183us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851847.048436:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:29.0:1773851847.048437:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10259@kfi7, seq: 2055432
00000400:00000200:30.0:1773851847.048439:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10258@kfi7: PUT: OK
00000100:00000040:29.0:1773851847.048439:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007fc40578 : new rpc_count 6
00000100:00000001:29.0:1773851847.048440:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:30.0:1773851847.048441:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b9245dae
00000400:00000010:30.0:1773851847.048442:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b9245dae.
00000100:00000001:29.0:1773851847.048442:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:30.0:1773851847.048443:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:29.0:1773851847.048443:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000100:00000001:30.0:1773851847.048444:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:29.0:1773851847.048445:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000317bc9e2.
00000400:00000200:30.0:1773851847.048446:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000049d58dd9 nid 10258@kfi7 refs 2
00000020:00000010:29.0:1773851847.048446:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b92c4ee7.
00000020:00000040:29.0:1773851847.048448:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000007fc40578 : new refcount 362
00000800:00000200:30.0:1773851847.048449:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 10258@kfi7(0000000047087129):0x0 lsk 3648 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e3f Transaction freed
00000100:00000001:29.0:1773851847.048450:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851847.091874:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851847.091875:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851847.091878:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851847.091881:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851847.091884:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:5.0:1773851847.091886:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20160@kfi7 : PUT - for me
00000400:00000200:5.0:1773851847.091888:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:5.0:1773851847.091889:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 1
00000400:00000200:5.0:1773851847.091890:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:5.0:1773851847.091891:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000400:00000200:5.0:1773851847.091894:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 3
00000400:00000200:5.0:1773851847.091896:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20161@kfi7 to cpt 4
00000400:00000200:5.0:1773851847.091897:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20161@kfi7 of length 224 into portal 12 MB=0x69b81c0326780
00000400:00000200:5.0:1773851847.091900:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20161@kfi7 of length 224/224 into md 0x793926dc5 [64] + 112208
00000800:00000200:5.0:1773851847.091903:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851847.091906:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851847.091908:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20160@kfi7: PUT: OK
00000100:00000001:5.0:1773851847.091909:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851847.091910:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851847.091912:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000020575ab3.
00000100:00000040:5.0:1773851847.091914:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000020575ab3 x1859831437879168 msgsize 224
00000100:00100000:5.0:1773851847.091916:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20161@kfi7 (source: 12345-20160@kfi7)
00000100:00000001:5.0:1773851847.091918:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851847.091919:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000100:00000001:6.0:1773851847.091921:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851847.091922:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851847.091922:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851847.091922:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851847.091923:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851847.091925:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851847.091926:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831437879168
00000020:00000001:6.0:1773851847.091927:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851847.091928:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce43c84
00000020:00000001:6.0:1773851847.091929:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851847.091931:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a11167e7 refcount=5
00000020:00000001:6.0:1773851847.091932:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637141258093568 : -106932451458048 : ffff9ebed9374400)
00000020:00000001:6.0:1773851847.091934:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637141258093568 : -106932451458048 : ffff9ebed9374400)
00000100:00000001:6.0:1773851847.091935:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851847.091937:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851847.091938:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851847.091939:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851847.091941:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851847.091942:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851847.091943:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851847.091944:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851847.091946:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851847.091947:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851847.091947:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.091949:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851847.091951:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851847.091952:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851847.091952:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851847.091953:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851847.091954:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20161@kfi7, seq: 2001826
00000100:00000001:7.0:1773851847.091956:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.091956:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a11167e7 : new rpc_count 1
00000100:00000001:7.0:1773851847.091957:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.091957:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095280926336 : -106978428625280 : ffff9eb424c35e80)
00000100:00000040:6.0:1773851847.091959:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000020575ab3 x1859831437879168/t0(0) o400->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1747-0'
00000100:00000001:6.0:1773851847.091964:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851847.091965:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851847.091968:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020575ab3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7+5:39637:x1859831437879168:12345-20161@kfi7:400:default-tuolumne1747-0
00000100:00000200:6.0:1773851847.091971:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831437879168
00000020:00000001:6.0:1773851847.091972:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851847.091973:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851847.091973:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.091975:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851847.091975:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851847.091977:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851847.091978:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831437879168, found 0 last_xid 1859831437879167
00000020:00000001:6.0:1773851847.091979:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851847.091980:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851847.091981:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851847.091982:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.091983:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851847.091984:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851847.091984:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851847.091985:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d5aaf672.
02000000:00000001:6.0:1773851847.091987:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.091988:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.091989:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851847.091990:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691390, transno 0, xid 1859831437879168
00010000:00000001:6.0:1773851847.091991:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851847.091992:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000020575ab3 x1859831437879168/t0(0) o400->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1747-0'
00010000:00000001:6.0:1773851847.091997:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851847.091998:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851847.091999:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=79 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851847.092001:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851847.092002:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f7aa4622 refcount 3 to 20161@kfi7
00000100:00000001:6.0:1773851847.092003:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583515840 : -107156126035776 : ffff9e8ac52c10c0)
02000000:00000001:6.0:1773851847.092004:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851847.092005:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.092006:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851847.092008:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20160@kfi7
00000400:00000010:6.0:1773851847.092009:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073c41ed0.
00000100:00000200:6.0:1773851847.092010:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831437879168, offset 224
00000400:00000200:6.0:1773851847.092013:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20160@kfi7
00000400:00000200:6.0:1773851847.092014:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:6.0:1773851847.092015:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 1
00000400:00000200:6.0:1773851847.092017:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000400:00000200:6.0:1773851847.092019:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 3
00000400:00000200:6.0:1773851847.092021:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20160@kfi7 local destination
00000400:00000200:6.0:1773851847.092023:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768333:8768333:1024:4294967295] 20160@kfi7 LPNI seq info [7476286:7476286:16:4294967295]
00000400:00000200:6.0:1773851847.092026:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000400:00000200:6.0:1773851847.092027:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:6.0:1773851847.092030:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20160@kfi7(20160@kfi7:20160@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851847.092032:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 3
00000800:00000200:6.0:1773851847.092034:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851847.092036:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851847.092040:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851847.092044:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000239 Using peer 20160@kfi7(0x100000000000239)
00000800:00000200:6.0:1773851847.092048:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 324 bytes to peer 0x100000000000239: rc=0
00000800:00000200:6.0:1773851847.092051:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000239 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851847.092054:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.092055:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f7aa4622 refcount 2 to 20161@kfi7
00010000:00000001:6.0:1773851847.092057:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851847.092057:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.092058:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851847.092059:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000020575ab3 x1859831437879168/t0(0) o400->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1747-0'
00000800:00000200:5.0:1773851847.092064:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000239 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851847.092067:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851847.092069:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20160@kfi7: PUT: OK
00000400:00000200:5.0:1773851847.092070:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073c41ed0
00000100:00100000:6.0:1773851847.092071:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020575ab3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7+5:39637:x1859831437879168:12345-20161@kfi7:400:default-tuolumne1747-0 Request processed in 105us (156us total) trans 0 rc 0/0
00000400:00000010:5.0:1773851847.092071:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073c41ed0.
00000100:00000001:5.0:1773851847.092072:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851847.092073:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:6.0:1773851847.092075:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20161@kfi7, seq: 2001826
00000400:00000200:5.0:1773851847.092075:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000100:00000040:6.0:1773851847.092076:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a11167e7 : new rpc_count 0
00000100:00000001:6.0:1773851847.092077:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851847.092077:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 20160@kfi7(0000000038325a2d):0x0 lsk 570 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000239 Transaction freed
00000100:00000001:6.0:1773851847.092078:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851847.092079:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851847.092080:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000020:00000010:6.0:1773851847.092082:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000020:00000040:6.0:1773851847.092083:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000a11167e7 : new refcount 4
00000100:00000001:6.0:1773851847.092084:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851847.137972:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.137973:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851847.137975:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851847.137977:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851847.137979:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.137980:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.153@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851847.137981:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.137982:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851847.137983:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851847.137984:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000400:00000200:9.0:1773851847.137985:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000400:00000200:9.0:1773851847.137986:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851847.137987:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.153@o2ib600 of length 520 into portal 12 MB=0x69a046852da00
00000400:00000200:9.0:1773851847.137989:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.153@o2ib600 of length 520/520 into md 0x78146ce49 [64] + 108320
00000800:00000200:9.0:1773851847.137991:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851847.137992:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851847.137993:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851847.137994:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851847.137995:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851847.137996:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ccc01bfa.
00000100:00000040:9.0:1773851847.137996:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ccc01bfa x1858193581070848 msgsize 520
00000100:00100000:9.0:1773851847.137998:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.153@o2ib600 (source: 12345-172.19.3.153@o2ib600)
00000100:00000001:9.0:1773851847.137999:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851847.138000:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:8.0:1773851847.138001:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851847.138001:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851847.138002:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851847.138002:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851847.138003:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851847.138003:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851847.138004:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858193581070848
00000020:00000001:8.0:1773851847.138005:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851847.138005:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91524
00000020:00000001:8.0:1773851847.138006:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851847.138007:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fff65982 refcount=908
00000020:00000001:8.0:1773851847.138008:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000020:00000001:8.0:1773851847.138009:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000100:00000001:8.0:1773851847.138010:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.138011:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851847.138011:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003a871c4.
00000020:00000010:8.0:1773851847.138012:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851847.138013:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851847.138014:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851847.138015:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851847.138016:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.138017:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:8.0:1773851847.138018:0:60829:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@00000000ccc01bfa x1858193581070848/t0(0) o38->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:0/0 lens 520/0 e 0 to 0 dl 1773852047 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic3-0'
00000100:00000001:8.0:1773851847.138024:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851847.138024:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.138026:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851847.138027:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851847.138027:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851847.138027:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851847.138028:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851847.138029:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.153@o2ib600, seq: 2130696
00000100:00000001:9.0:1773851847.138030:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.138030:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fff65982 : new rpc_count 4
00000100:00000001:9.0:1773851847.138031:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.138031:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569660416 : -106988139891200 : ffff9eb1e1ed3600)
00000100:00000040:8.0:1773851847.138032:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ccc01bfa x1858193581070848/t0(0) o38->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:0/0 lens 520/0 e 0 to 0 dl 1773852047 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic3-0'
00000100:00000001:8.0:1773851847.138035:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.138035:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851847.138037:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccc01bfa pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:14649e2c-1f67-4358-8208-20db0ccc3581+908:26489:x1858193581070848:12345-172.19.3.153@o2ib600:38:login-oslic3-0
00000100:00000200:8.0:1773851847.138038:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858193581070848
00000020:00000001:8.0:1773851847.138039:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:8.0:1773851847.138040:0:60829:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:8.0:1773851847.138042:0:60829:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:8.0:1773851847.138043:0:60829:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:8.0:1773851847.138045:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851847.138046:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851847.138046:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 000000007267d3a2.
02000000:00000001:8.0:1773851847.138047:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.138048:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851847.138049:0:60829:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:8.0:1773851847.138050:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 14649e2c-1f67-4358-8208-20db0ccc3581 (at 172.19.3.153@o2ib600) reconnecting
00010000:00000001:8.0:1773851847.138051:0:60829:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:8.0:1773851847.138052:0:60829:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:8.0:1773851847.138054:0:60829:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from 14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600 t0 exp 00000000fff65982 cur 614121 last 1773851847
00010000:00000001:8.0:1773851847.138055:0:60829:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:8.0:1773851847.138057:0:60829:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:8.0:1773851847.138058:0:60829:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:8.0:1773851847.138059:0:60829:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:8.0:1773851847.138059:0:60829:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:8.0:1773851847.138060:0:60829:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:8.0:1773851847.138062:0:60829:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:8.0:1773851847.138062:0:60829:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:8.0:1773851847.138063:0:60829:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:8.0:1773851847.138064:0:60829:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.138065:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:8.0:1773851847.138066:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:8.0:1773851847.138067:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 14649e2c-1f67-4358-8208-20db0ccc3581/00000000fff65982 free: 126633370845184 avail: 126633368748032
00000020:00000001:8.0:1773851847.138069:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:8.0:1773851847.138069:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 14649e2c-1f67-4358-8208-20db0ccc3581/00000000fff65982 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:8.0:1773851847.138071:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:8.0:1773851847.138072:0:60829:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:8.0:1773851847.138072:0:60829:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:8.0:1773851847.138073:0:60829:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli 14649e2c-1f67-4358-8208-20db0ccc3581/00000000fff65982 ocd_grant: 1879048191 want: 2097152 left: 112130449866752
00000020:00000001:8.0:1773851847.138074:0:60829:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:8.0:1773851847.138076:0:60829:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 172.19.3.153@o2ib600 supports cksum type f7, return f7
00000004:00000001:8.0:1773851847.138077:0:60829:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:8.0:1773851847.138078:0:60829:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:8.0:1773851847.138079:0:60829:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:8.0:1773851847.138081:0:60829:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851847.138081:0:60829:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851847.138082:0:60829:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.138083:0:60829:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 00000000fff65982 : new rpc_count 3
00000020:00000040:8.0:1773851847.138084:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000fff65982 : new refcount 908
00000020:00000040:8.0:1773851847.138085:0:60829:0:(genops.c:871:class_export_get()) GET export 00000000fff65982 refcount=909
00000100:00000040:8.0:1773851847.138085:0:60829:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 00000000fff65982 : new rpc_count 4
00000100:00000001:8.0:1773851847.138086:0:60829:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:8.0:1773851847.138088:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:8.0:1773851847.138089:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000400:00000200:8.0:1773851847.138090:0:60829:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000400:00000200:8.0:1773851847.138092:0:60829:0:(peer.c:1555:LNetPrimaryNID()) NID 172.19.3.153@o2ib600 primary NID 172.19.3.153@o2ib600 rc 0
00000100:00000001:8.0:1773851847.138096:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851847.138097:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d98fecdb refcount 3 to 172.19.3.153@o2ib600
00000100:00000001:8.0:1773851847.138097:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935868094912 : -107137841456704 : ffff9e8f070499c0)
00000100:00000001:8.0:1773851847.138098:0:60829:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636935868094912 : -107137841456704 : 0xffff9e8f070499c0)
00000100:00000040:8.0:1773851847.138100:0:60829:0:(connection.c:133:ptlrpc_connection_get()) conn=00000000d98fecdb refcount 3 to 172.19.3.153@o2ib600
00000100:00080000:8.0:1773851847.138101:0:60829:0:(import.c:86:import_set_state_nolock()) 00000000574c9d22 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:8.0:1773851847.138102:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d98fecdb refcount 2 to 172.19.3.153@o2ib600
00000100:00000001:8.0:1773851847.138103:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851847.138104:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d98fecdb refcount 3 to 172.19.3.153@o2ib600
00000100:00000001:8.0:1773851847.138105:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935868094912 : -107137841456704 : ffff9e8f070499c0)
02000000:00000001:8.0:1773851847.138105:0:60829:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:8.0:1773851847.138107:0:60829:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:8.0:1773851847.138108:0:60829:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.138108:0:60829:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:8.0:1773851847.138109:0:60829:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:8.0:1773851847.138110:0:60829:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:8.0:1773851847.138111:0:60829:0:(import.c:86:import_set_state_nolock()) 00000000574c9d22 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:8.0:1773851847.138112:0:60829:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:8.0:1773851847.138113:0:60829:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:8.0:1773851847.138113:0:60829:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:8.0:1773851847.138114:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000fff65982 : new refcount 908
00000020:00000040:8.0:1773851847.138115:0:60829:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:8.0:1773851847.138116:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d98fecdb refcount 2 to 172.19.3.153@o2ib600
00010000:00000001:8.0:1773851847.138117:0:60829:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.138118:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851847.138118:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:8.0:1773851847.138119:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:8.0:1773851847.138120:0:60829:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851847.138121:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851847.138121:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851847.138122:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.138123:0:60829:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:8.0:1773851847.138124:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:8.0:1773851847.138125:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:8.0:1773851847.138126:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:8.0:1773851847.138126:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.138127:0:60829:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851847.138128:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263991371, transno 0, xid 1858193581070848
00010000:00000001:8.0:1773851847.138129:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851847.138130:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ccc01bfa x1858193581070848/t0(0) o38->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:0/0 lens 520/416 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic3-0'
00010000:00000001:8.0:1773851847.138132:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851847.138133:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851847.138133:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=80 v=66 (1 1 1 1)
00000100:00001000:8.0:1773851847.138135:0:60829:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:8.0:1773851847.138136:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851847.138137:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d98fecdb refcount 3 to 172.19.3.153@o2ib600
00000100:00000001:8.0:1773851847.138137:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935868094912 : -107137841456704 : ffff9e8f070499c0)
02000000:00000001:8.0:1773851847.138138:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851847.138139:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.138139:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851847.138141:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.153@o2ib600
00000400:00000010:8.0:1773851847.138141:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002bb674c2.
00000100:00000200:8.0:1773851847.138142:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858193581070848, offset 0
00000400:00000200:8.0:1773851847.138144:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.153@o2ib600
00000400:00000200:8.0:1773851847.138145:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:8.0:1773851847.138146:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000400:00000200:8.0:1773851847.138147:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000400:00000200:8.0:1773851847.138149:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 4
00000400:00000200:8.0:1773851847.138150:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.153@o2ib600 routed destination
00000400:00000200:8.0:1773851847.138152:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:8.0:1773851847.138153:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:8.0:1773851847.138155:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.153@o2ib600: rtr pref emtpy: 1
00000400:00000200:8.0:1773851847.138156:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:8.0:1773851847.138157:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.153@o2ib600: rtr pref emtpy: 1
00000400:00000200:8.0:1773851847.138158:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:8.0:1773851847.138159:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768334:8768334:1024:4294967295] 17@kfi7 LPNI seq info [1250891876:1250891876:16:4294967295]
00000400:00000200:8.0:1773851847.138161:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:8.0:1773851847.138161:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:8.0:1773851847.138164:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.153@o2ib600(172.19.3.153@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851847.138166:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000800:00000200:8.0:1773851847.138167:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851847.138168:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:8.0:1773851847.138171:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851847.138173:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:8.0:1773851847.138176:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 516 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:8.0:1773851847.138178:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851847.138180:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.138181:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d98fecdb refcount 2 to 172.19.3.153@o2ib600
00010000:00000001:8.0:1773851847.138182:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851847.138182:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.138183:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851847.138186:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ccc01bfa x1858193581070848/t0(0) o38->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:0/0 lens 520/416 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic3-0'
00000100:00100000:8.0:1773851847.138189:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccc01bfa pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:14649e2c-1f67-4358-8208-20db0ccc3581+908:26489:x1858193581070848:12345-172.19.3.153@o2ib600:38:login-oslic3-0 Request processed in 153us (192us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851847.138195:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.153@o2ib600, seq: 2130696
00000100:00000040:8.0:1773851847.138196:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fff65982 : new rpc_count 3
00000100:00000001:8.0:1773851847.138196:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851847.138197:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851847.138198:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851847.138198:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851847.138199:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003a871c4.
00000020:00000040:8.0:1773851847.138200:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000fff65982 : new refcount 907
00000100:00000001:8.0:1773851847.138201:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851847.138206:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851847.138207:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851847.138208:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:9.0:1773851847.138209:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002bb674c2
00000400:00000010:9.0:1773851847.138209:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002bb674c2.
00000100:00000001:9.0:1773851847.138210:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851847.138210:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851847.138211:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851847.138212:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000800:00000200:9.0:1773851847.138762:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.138763:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851847.138764:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851847.138766:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851847.138767:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.138769:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.153@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851847.138769:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.138770:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851847.138771:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851847.138771:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000400:00000200:9.0:1773851847.138772:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000400:00000200:9.0:1773851847.138773:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851847.138774:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.153@o2ib600 of length 2560 into portal 12 MB=0x69a040b726440
00000400:00000200:9.0:1773851847.138775:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.153@o2ib600 of length 2560/2560 into md 0x78146ce49 [64] + 108840
00000800:00000200:17.0:1773851847.138777:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.138777:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851847.138778:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851847.138779:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851847.138780:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851847.138781:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851847.138781:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851847.138782:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851847.138782:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000400:00000200:17.0:1773851847.138783:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000100:00000010:9.0:1773851847.138783:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a3efe55.
00000400:00000200:17.0:1773851847.138784:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.153@o2ib600 : PUT - for me
00000100:00000040:9.0:1773851847.138784:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000008a3efe55 x1858192022856768 msgsize 2560
00000400:00000200:17.0:1773851847.138785:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.138786:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000100:00100000:9.0:1773851847.138786:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.153@o2ib600 (source: 12345-172.19.3.153@o2ib600)
00000100:00000001:9.0:1773851847.138786:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851847.138787:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851847.138787:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851847.138788:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851847.138788:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851847.138788:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:17.0:1773851847.138789:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000100:00000001:8.0:1773851847.138789:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851847.138789:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851847.138790:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
02000000:00000001:8.0:1773851847.138790:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851847.138790:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858192022856768
00000400:00000200:17.0:1773851847.138791:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000020:00000001:8.0:1773851847.138791:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851847.138791:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91524
00000400:00000200:17.0:1773851847.138792:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.153@o2ib600 of length 576 into portal 12 MB=0x69a045bebb940
00000020:00000001:8.0:1773851847.138792:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851847.138792:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fff65982 refcount=908
00000020:00000001:8.0:1773851847.138793:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000400:00000200:17.0:1773851847.138794:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.153@o2ib600 of length 576/576 into md 0x78146ce49 [64] + 111400
00000020:00000001:8.0:1773851847.138794:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000800:00000200:17.0:1773851847.138795:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851847.138795:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.138795:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851847.138796:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003a871c4.
00000020:00000010:8.0:1773851847.138796:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000400:00000200:17.0:1773851847.138797:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851847.138797:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:8.0:1773851847.138797:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:17.0:1773851847.138798:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:8.0:1773851847.138798:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851847.138798:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000200:17.0:1773851847.138799:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000004:00000001:8.0:1773851847.138799:0:60829:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000100:00000010:17.0:1773851847.138800:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f4d9fcda.
00000100:00000040:17.0:1773851847.138800:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f4d9fcda x1858193372985664 msgsize 576
00000100:00100000:17.0:1773851847.138802:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.153@o2ib600 (source: 12345-172.19.3.153@o2ib600)
00000004:00100000:8.0:1773851847.138802:0:60829:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000c6e02c39 cookie 0x318b40925f4d3e9d  req@000000008a3efe55 x1858192022856768/t0(0) o101->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:487/0 lens 2560/0 e 0 to 0 dl 1773852602 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-oslic3-1433465'
00000100:00000001:17.0:1773851847.138804:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851847.138805:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00010000:00000001:8.0:1773851847.138805:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000800:00000200:17.0:1773851847.138806:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851847.138806:0:41171:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00010000:00000001:8.0:1773851847.138806:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
02000000:00000001:9.0:1773851847.138807:0:41171:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851847.138807:0:41171:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000001:8.0:1773851847.138807:0:60829:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.138807:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851847.138808:0:41171:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851847.138809:0:41171:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851847.138809:0:41171:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858193372985664
00000100:00080000:8.1F:1773851847.138809:0:60829:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000008a3efe55 x1858192022856768/t0(0) o101->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:487/0 lens 2560/0 e 0 to 0 dl 1773852602 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-oslic3-1433465'
00000020:00000001:9.0:1773851847.138810:0:41171:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851847.138810:0:41171:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91524
00000020:00000001:9.0:1773851847.138811:0:41171:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851847.138812:0:41171:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fff65982 refcount=909
00000020:00000001:9.0:1773851847.138812:0:41171:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000020:00000001:9.0:1773851847.138813:0:41171:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000100:00000001:9.0:1773851847.138814:0:41171:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851847.138814:0:41171:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851847.138815:0:41171:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004830a15b.
00000020:00000010:9.0:1773851847.138815:0:41171:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000100:00080000:8.1:1773851847.138815:0:60829:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000097baafb x1858192022856768/t0(0) o101->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:576/0 lens 2560/5304 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-oslic3-1433465'
00000020:00000010:9.0:1773851847.138816:0:41171:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b4e7bb2.
00000100:00000001:9.0:1773851847.138817:0:41171:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851847.138818:0:41171:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:9.0:1773851847.138818:0:41171:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000100:00000001:8.0:1773851847.138818:0:60829:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:8.0:1773851847.138819:0:60829:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:8.0:1773851847.138820:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851847.138820:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000004:00100000:9.0:1773851847.138821:0:41171:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 0000000042e7d72f cookie 0x318b409262dc950a  req@00000000f4d9fcda x1858193372985664/t0(0) o101->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:487/0 lens 576/0 e 0 to 0 dl 1773852602 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-oslic3-6109'
00000020:00000010:8.0:1773851847.138821:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851847.138822:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851847.138822:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003a871c4.
00000020:00000040:8.0:1773851847.138823:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000fff65982 : new refcount 908
00000100:00000001:8.0:1773851847.138824:0:60829:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:9.0:1773851847.138827:0:41171:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:9.0:1773851847.138828:0:41171:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:9.0:1773851847.138828:0:41171:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851847.138828:0:41171:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:9.1F:1773851847.138830:0:41171:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000f4d9fcda x1858193372985664/t0(0) o101->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:487/0 lens 576/0 e 0 to 0 dl 1773852602 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-oslic3-6109'
00000100:00080000:9.1:1773851847.138833:0:41171:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000086e57781 x1858193372985664/t0(0) o101->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:576/0 lens 576/5344 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-oslic3-6109'
00000100:00000001:9.0:1773851847.138836:0:41171:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:9.0:1773851847.138837:0:41171:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:9.0:1773851847.138838:0:41171:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851847.138838:0:41171:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851847.138839:0:41171:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851847.138839:0:41171:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b4e7bb2.
00000020:00000010:9.0:1773851847.138840:0:41171:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004830a15b.
00000020:00000040:9.0:1773851847.138841:0:41171:0:(genops.c:882:class_export_put()) PUTting export 00000000fff65982 : new refcount 907
00000100:00000001:9.0:1773851847.138841:0:41171:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851847.149507:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.149508:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851847.149509:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851847.149511:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851847.149513:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.149514:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.153@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851847.149515:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.149516:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851847.149516:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851847.149517:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000400:00000200:9.0:1773851847.149518:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000400:00000200:9.0:1773851847.149519:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851847.149520:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.153@o2ib600 of length 520 into portal 12 MB=0x69a0403852600
00000400:00000200:9.0:1773851847.149522:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.153@o2ib600 of length 520/520 into md 0x78146ce49 [64] + 111976
00000800:00000200:9.0:1773851847.149523:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851847.149526:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851847.149526:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851847.149527:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851847.149528:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851847.149528:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000074b6355c.
00000100:00000040:9.0:1773851847.149529:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000074b6355c x1858191889868288 msgsize 520
00000100:00100000:9.0:1773851847.149531:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.153@o2ib600 (source: 12345-172.19.3.153@o2ib600)
00000100:00000001:9.0:1773851847.149532:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851847.149533:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851847.149534:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851847.149536:0:41171:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851847.149537:0:41171:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851847.149537:0:41171:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851847.149537:0:41171:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851847.149538:0:41171:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851847.149539:0:41171:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858191889868288
00000020:00000001:9.0:1773851847.149539:0:41171:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851847.149539:0:41171:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91524
00000020:00000001:9.0:1773851847.149540:0:41171:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851847.149540:0:41171:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fff65982 refcount=908
00000020:00000001:9.0:1773851847.149541:0:41171:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000020:00000001:9.0:1773851847.149541:0:41171:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000100:00000001:9.0:1773851847.149542:0:41171:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851847.149542:0:41171:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851847.149542:0:41171:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004830a15b.
00000020:00000010:9.0:1773851847.149543:0:41171:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851847.149544:0:41171:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b4e7bb2.
00000100:00000001:9.0:1773851847.149544:0:41171:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851847.149545:0:41171:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851847.149545:0:41171:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:9.1:1773851847.149546:0:41171:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000074b6355c x1858191889868288/t0(0) o36->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:332/0 lens 520/0 e 0 to 0 dl 1773852447 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-oslic3-56591'
00000100:00080000:9.1:1773851847.149549:0:41171:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000fb198b14 x1858191889868288/t0(0) o36->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:67/0 lens 520/448 e 2 to 0 dl 1773851781 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-oslic3-56591'
00000100:00000001:9.0:1773851847.149552:0:41171:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:9.0:1773851847.149552:0:41171:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:9.0:1773851847.149553:0:41171:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851847.149554:0:41171:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851847.149554:0:41171:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851847.149555:0:41171:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b4e7bb2.
00000020:00000010:9.0:1773851847.149555:0:41171:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004830a15b.
00000020:00000040:9.0:1773851847.149556:0:41171:0:(genops.c:882:class_export_put()) PUTting export 00000000fff65982 : new refcount 907
00000100:00000001:9.0:1773851847.149556:0:41171:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851847.149934:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851847.149935:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851847.149936:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851847.149938:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851847.149940:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.149941:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9555@kfi7 : PUT - for me
00000400:00000200:13.0:1773851847.149942:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.149943:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 1
00000400:00000200:13.0:1773851847.149945:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.149945:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000400:00000200:13.0:1773851847.149946:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 3
00000400:00000200:13.0:1773851847.149947:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.149948:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9555@kfi7 of length 224 into portal 12 MB=0x69aa079d9f400
00000400:00000200:13.0:1773851847.149950:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9555@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 8520
00000800:00000200:13.0:1773851847.149952:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851847.149954:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851847.149955:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9555@kfi7: PUT: OK
00000100:00000001:13.0:1773851847.149956:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851847.149956:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851847.149957:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e39a24a9.
00000100:00000040:13.0:1773851847.149958:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000e39a24a9 x1858863890035712 msgsize 224
00000100:00100000:13.0:1773851847.149960:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9555@kfi7 (source: 12345-9555@kfi7)
00000100:00000001:13.0:1773851847.149961:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851847.149962:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000100:00000001:14.0:1773851847.149963:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851847.149963:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851847.149964:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851847.149964:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851847.149964:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851847.149965:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851847.149965:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890035712
00000020:00000001:14.0:1773851847.149966:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851847.149966:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92490
00000020:00000001:14.0:1773851847.149967:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851847.149969:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000021dfdda1 refcount=6
00000020:00000001:14.0:1773851847.149970:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630500352 : -107123079051264 : ffff9e9276ed0800)
00000020:00000001:14.0:1773851847.149971:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630500352 : -107123079051264 : ffff9e9276ed0800)
00000100:00000001:14.0:1773851847.149972:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851847.149972:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851847.149973:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cad4d41a.
00000020:00000010:14.0:1773851847.149974:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851847.149975:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851847.149976:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851847.149976:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851847.149976:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851847.149977:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851847.149978:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851847.149978:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851847.149979:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851847.149980:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851847.149981:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851847.149981:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851847.149981:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851847.149982:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851847.149982:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9555@kfi7, seq: 2289750
00000100:00000040:14.0:1773851847.149982:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000021dfdda1 : new rpc_count 1
00000100:00000001:15.0:1773851847.149983:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851847.149983:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637084596662400 : -106989112889216 : ffff9eb1a7ee7080)
00000100:00000040:14.0:1773851847.149984:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e39a24a9 x1858863890035712/t0(0) o400->bd413dbe-eca9-4967-92f4-43bdc1fba79c@9555@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1094-0'
00000100:00000001:14.0:1773851847.149986:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851847.149987:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851847.149987:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e39a24a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:bd413dbe-eca9-4967-92f4-43bdc1fba79c+6:39139:x1858863890035712:12345-9555@kfi7:400:default-tuolumne1094-0
00000100:00000200:14.0:1773851847.149989:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890035712
00000020:00000001:14.0:1773851847.149989:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851847.149990:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851847.149990:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.149991:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851847.149991:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851847.149992:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851847.149993:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890035712, found 0 last_xid 1858863890035711
00000020:00000001:14.0:1773851847.149993:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851847.149994:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851847.149994:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851847.149995:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.149996:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851847.149996:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851847.149997:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851847.149997:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000009f0eb30.
02000000:00000001:14.0:1773851847.149998:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851847.149998:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.149999:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851847.149999:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510531041, transno 0, xid 1858863890035712
00010000:00000001:14.0:1773851847.150000:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851847.150001:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e39a24a9 x1858863890035712/t0(0) o400->bd413dbe-eca9-4967-92f4-43bdc1fba79c@9555@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1094-0'
00010000:00000001:14.0:1773851847.150003:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851847.150004:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851847.150004:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=80 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851847.150005:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851847.150006:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000339508b7 refcount 3 to 9555@kfi7
00000100:00000001:14.0:1773851847.150007:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152416 : -107139310399200 : ffff9e8eaf765120)
02000000:00000001:14.0:1773851847.150008:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851847.150008:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851847.150009:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851847.150010:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9555@kfi7
00000400:00000010:14.0:1773851847.150011:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000629bef0.
00000100:00000200:14.0:1773851847.150012:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890035712, offset 224
00000400:00000200:14.0:1773851847.150013:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9555@kfi7
00000400:00000200:14.0:1773851847.150014:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:14.0:1773851847.150015:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 1
00000400:00000200:14.0:1773851847.150016:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000400:00000200:14.0:1773851847.150017:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 3
00000400:00000200:14.0:1773851847.150019:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9555@kfi7 local destination
00000400:00000200:14.0:1773851847.150020:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768335:8768335:1024:4294967295] 9555@kfi7 LPNI seq info [17468:17468:16:4294967295]
00000400:00000200:14.0:1773851847.150021:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000400:00000200:14.0:1773851847.150022:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:14.0:1773851847.150024:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9555@kfi7(9555@kfi7:9555@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851847.150025:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 3
00000800:00000200:14.0:1773851847.150026:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851847.150027:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851847.150029:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851847.150031:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8e2 Using peer 9555@kfi7(0x8e2)
00000800:00000200:14.0:1773851847.150034:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004c2b9f01: Posted send of 324 bytes to peer 0x8e2: rc=0
00000800:00000200:14.0:1773851847.150035:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851847.150037:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851847.150037:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000339508b7 refcount 2 to 9555@kfi7
00010000:00000001:14.0:1773851847.150038:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851847.150038:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.150039:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851847.150039:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e39a24a9 x1858863890035712/t0(0) o400->bd413dbe-eca9-4967-92f4-43bdc1fba79c@9555@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1094-0'
00000100:00100000:14.0:1773851847.150042:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e39a24a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:bd413dbe-eca9-4967-92f4-43bdc1fba79c+6:39139:x1858863890035712:12345-9555@kfi7:400:default-tuolumne1094-0 Request processed in 55us (83us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851847.150044:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9555@kfi7, seq: 2289750
00000100:00000040:14.0:1773851847.150045:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000021dfdda1 : new rpc_count 0
00000100:00000001:14.0:1773851847.150045:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851847.150046:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851847.150047:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000800:00000200:13.0:1773851847.150047:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8e2 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851847.150048:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000020:00000010:14.0:1773851847.150048:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cad4d41a.
00000400:00000200:13.0:1773851847.150048:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:14.0:1773851847.150049:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000021dfdda1 : new refcount 5
00000100:00000001:14.0:1773851847.150049:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851847.150049:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9555@kfi7: PUT: OK
00000400:00000200:13.0:1773851847.150050:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000629bef0
00000400:00000010:13.0:1773851847.150050:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000629bef0.
00000100:00000001:13.0:1773851847.150051:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851847.150052:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851847.150052:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000800:00000200:13.0:1773851847.150054:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 9555@kfi7(00000000899667b6):0x0 lsk 2275 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8e2 Transaction freed
00000800:00000200:29.0:1773851847.158700:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.158702:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851847.158704:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851847.158706:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851847.158709:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.158710:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13745@kfi7 : PUT - for me
00000400:00000200:29.0:1773851847.158711:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.158712:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 1
00000400:00000200:29.0:1773851847.158714:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.158714:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000400:00000200:29.0:1773851847.158715:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 3
00000400:00000200:29.0:1773851847.158716:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.158718:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13745@kfi7 of length 224 into portal 12 MB=0x69b09adb1b180
00000400:00000200:29.0:1773851847.158720:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13745@kfi7 of length 224/224 into md 0x77fe139dd [64] + 153352
00000800:00000200:29.0:1773851847.158722:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851847.158724:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851847.158730:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13745@kfi7: PUT: OK
00000100:00000001:29.0:1773851847.158731:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851847.158731:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851847.158732:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000082b3f44d.
00000100:00000040:29.0:1773851847.158733:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000082b3f44d x1859315731378560 msgsize 224
00000100:00100000:29.0:1773851847.158735:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13745@kfi7 (source: 12345-13745@kfi7)
00000100:00000001:29.0:1773851847.158736:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851847.158737:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000800:00000200:29.0:1773851847.158739:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851847.158742:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851847.158742:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851847.158743:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851847.158744:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851847.158744:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851847.158745:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315731378560
00000020:00000001:29.0:1773851847.158746:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851847.158746:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ba6
00000020:00000001:29.0:1773851847.158747:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.158750:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8dc6cce refcount=6
00000020:00000001:29.0:1773851847.158751:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628036608 : -107123081515008 : ffff9e9276c77000)
00000020:00000001:29.0:1773851847.158752:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628036608 : -107123081515008 : ffff9e9276c77000)
00000100:00000001:29.0:1773851847.158753:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851847.158754:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851847.158754:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b92c4ee7.
00000020:00000010:29.0:1773851847.158756:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851847.158757:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000317bc9e2.
00000100:00000001:29.0:1773851847.158758:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851847.158758:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851847.158759:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851847.158760:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851847.158760:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851847.158761:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.158762:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851847.158763:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851847.158764:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851847.158764:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851847.158765:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851847.158765:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13745@kfi7, seq: 2055433
00000100:00000040:29.0:1773851847.158765:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8dc6cce : new rpc_count 1
00000100:00000001:31.0:1773851847.158766:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.158766:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106004708480 : -106967704843136 : ffff9eb6a3f34c80)
00000100:00000001:31.0:1773851847.158767:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851847.158768:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000082b3f44d x1859315731378560/t0(0) o400->4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601@13745@kfi7:635/0 lens 224/0 e 0 to 0 dl 1773851995 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1342-0'
00000100:00000001:29.0:1773851847.158770:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851847.158771:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851847.158772:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082b3f44d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601+6:39751:x1859315731378560:12345-13745@kfi7:400:default-tuolumne1342-0
00000100:00000200:29.0:1773851847.158773:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315731378560
00000020:00000001:29.0:1773851847.158774:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851847.158774:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851847.158775:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.158776:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851847.158776:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851847.158777:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851847.158778:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315731378560, found 0 last_xid 1859315731378559
00000020:00000001:29.0:1773851847.158778:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851847.158779:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851847.158780:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851847.158780:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.158781:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851847.158781:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851847.158782:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851847.158783:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c2eb484b.
02000000:00000001:29.0:1773851847.158784:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.158784:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.158785:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851847.158786:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104890043, transno 0, xid 1859315731378560
00010000:00000001:29.0:1773851847.158786:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851847.158787:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000082b3f44d x1859315731378560/t0(0) o400->4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601@13745@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1342-0'
00010000:00000001:29.0:1773851847.158789:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851847.158790:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851847.158791:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=80 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851847.158792:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851847.158792:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b9edfa32 refcount 3 to 13745@kfi7
00000100:00000001:29.0:1773851847.158793:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269184 : -107152618282432 : ffff9e8b96402240)
02000000:00000001:29.0:1773851847.158794:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851847.158794:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.158795:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851847.158795:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13745@kfi7
00000400:00000010:29.0:1773851847.158796:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8cfb79.
00000100:00000200:29.0:1773851847.158797:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315731378560, offset 224
00000400:00000200:29.0:1773851847.158798:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13745@kfi7
00000400:00000200:29.0:1773851847.158799:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.158799:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 1
00000400:00000200:29.0:1773851847.158800:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000400:00000200:29.0:1773851847.158801:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 3
00000400:00000200:29.0:1773851847.158802:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13745@kfi7 local destination
00000400:00000200:29.0:1773851847.158803:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768336:8768336:1024:4294967295] 13745@kfi7 LPNI seq info [13502174:13502174:16:4294967295]
00000400:00000200:29.0:1773851847.158805:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000400:00000200:29.0:1773851847.158805:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.158807:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13745@kfi7(13745@kfi7:13745@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851847.158808:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 3
00000800:00000200:29.0:1773851847.158809:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.158810:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851847.158812:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851847.158814:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x52a Using peer 13745@kfi7(0x52a)
00000800:00000200:29.0:1773851847.158817:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 324 bytes to peer 0x52a: rc=0
00000800:00000200:29.0:1773851847.158819:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x52a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851847.158820:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851847.158821:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b9edfa32 refcount 2 to 13745@kfi7
00010000:00000001:29.0:1773851847.158822:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851847.158822:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.158823:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851847.158823:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000082b3f44d x1859315731378560/t0(0) o400->4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601@13745@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1342-0'
00000100:00100000:29.0:1773851847.158826:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082b3f44d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601+6:39751:x1859315731378560:12345-13745@kfi7:400:default-tuolumne1342-0 Request processed in 55us (92us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851847.158828:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13745@kfi7, seq: 2055433
00000100:00000040:29.0:1773851847.158829:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8dc6cce : new rpc_count 0
00000100:00000001:29.0:1773851847.158830:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851847.158831:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851847.158831:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851847.158832:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000317bc9e2.
00000800:00000200:30.0:1773851847.158833:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x52a TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851847.158833:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b92c4ee7.
00000020:00000040:29.0:1773851847.158833:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000a8dc6cce : new refcount 5
00000100:00000001:29.0:1773851847.158834:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851847.158835:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851847.158836:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13745@kfi7: PUT: OK
00000400:00000200:30.0:1773851847.158837:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8cfb79
00000400:00000010:30.0:1773851847.158838:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8cfb79.
00000100:00000001:30.0:1773851847.158839:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851847.158839:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851847.158840:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000800:00000200:30.0:1773851847.158842:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 13745@kfi7(0000000053c69a5b):0x0 lsk 1323 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x52a Transaction freed
00000800:00000200:21.0:1773851847.287561:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851847.287562:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851847.287563:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851847.287565:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851847.287567:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851847.287568:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:21.0:1773851847.287569:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851847.287569:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:21.0:1773851847.287570:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851847.287571:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:21.0:1773851847.287571:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:21.0:1773851847.287572:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851847.287573:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 224 into portal 12 MB=0x699e0dd1d46c0
00000400:00000200:21.0:1773851847.287574:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2068@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 19104
00000800:00000200:21.0:1773851847.287576:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851847.287577:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851847.287578:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:21.0:1773851847.287579:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851847.287579:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851847.287580:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007b6c181c.
00000100:00000040:21.0:1773851847.287581:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000007b6c181c x1858040921671360 msgsize 224
00000100:00100000:21.0:1773851847.287582:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-2068@kfi7 (source: 12345-2068@kfi7)
00000100:00000001:21.0:1773851847.287583:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851847.287584:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:22.0:1773851847.287585:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851847.287585:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851847.287585:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851847.287586:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851847.287586:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851847.287587:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851847.287588:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040921671360
00000020:00000001:22.0:1773851847.287589:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851847.287589:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb24af
00000020:00000001:22.0:1773851847.287590:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851847.287594:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d5f9fd05 refcount=5
00000020:00000001:22.0:1773851847.287594:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636930112823296 : -107143596728320 : ffff9e8daffa2000)
00000020:00000001:22.0:1773851847.287595:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636930112823296 : -107143596728320 : ffff9e8daffa2000)
00000100:00000001:22.0:1773851847.287596:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851847.287597:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851847.287597:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000247a55a4.
00000020:00000010:22.0:1773851847.287598:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851847.287599:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d08ac1b6.
00000100:00000001:22.0:1773851847.287600:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851847.287600:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851847.287600:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851847.287601:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851847.287602:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851847.287602:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.287603:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851847.287604:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851847.287605:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851847.287605:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851847.287605:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851847.287606:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2068@kfi7, seq: 1997906
00000100:00000001:23.0:1773851847.287607:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851847.287607:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d5f9fd05 : new rpc_count 1
00000100:00000001:22.0:1773851847.287607:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637146562789376 : -106927146762240 : ffff9ec015668000)
00000100:00000040:22.0:1773851847.287608:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007b6c181c x1858040921671360/t0(0) o400->lustre5-MDT0001-lwp-OST0004_UUID@2068@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba105-0'
00000100:00000001:23.0:1773851847.287609:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.287611:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851847.287611:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851847.287612:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b6c181c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0004_UUID+5:272616:x1858040921671360:12345-2068@kfi7:400:default-yuba105-0
00000100:00000200:22.0:1773851847.287613:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040921671360
00000020:00000001:22.0:1773851847.287614:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851847.287614:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851847.287615:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.287616:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851847.287616:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851847.287617:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:22.0:1773851847.287618:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851847.287618:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851847.287619:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851847.287619:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.287620:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851847.287620:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851847.287621:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851847.287621:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003a86cebb.
02000000:00000001:22.0:1773851847.287622:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.287623:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.287623:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851847.287624:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858040921671360
00010000:00000001:22.0:1773851847.287624:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851847.287625:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007b6c181c x1858040921671360/t0(0) o400->lustre5-MDT0001-lwp-OST0004_UUID@2068@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba105-0'
00010000:00000001:22.0:1773851847.287627:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851847.287628:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851847.287628:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=80 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851847.287629:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851847.287630:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f96f322e refcount 7 to 2068@kfi7
00000100:00000001:22.0:1773851847.287631:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096128 : -107139307455488 : ffff9e8eafa33c00)
02000000:00000001:22.0:1773851847.287631:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851847.287632:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.287632:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851847.287633:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:22.0:1773851847.287634:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c97ba3c.
00000100:00000200:22.0:1773851847.287634:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040921671360, offset 224
00000400:00000200:22.0:1773851847.287635:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:22.0:1773851847.287636:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851847.287637:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:22.0:1773851847.287638:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:22.0:1773851847.287640:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:22.0:1773851847.287641:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2068@kfi7 local destination
00000400:00000200:22.0:1773851847.287642:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768337:8768337:1024:4294967295] 2068@kfi7 LPNI seq info [5403693:5403693:16:4294967295]
00000400:00000200:22.0:1773851847.287643:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:22.0:1773851847.287644:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851847.287646:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851847.287647:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:22.0:1773851847.287648:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851847.287649:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851847.287651:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851847.287653:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000800:00000200:22.0:1773851847.287655:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000007ee9d6e: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000800:00000200:22.0:1773851847.287657:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851847.287658:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851847.287659:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f96f322e refcount 6 to 2068@kfi7
00010000:00000001:22.0:1773851847.287660:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851847.287660:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.287661:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851847.287662:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007b6c181c x1858040921671360/t0(0) o400->lustre5-MDT0001-lwp-OST0004_UUID@2068@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba105-0'
00000100:00100000:22.0:1773851847.287664:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b6c181c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0004_UUID+5:272616:x1858040921671360:12345-2068@kfi7:400:default-yuba105-0 Request processed in 52us (83us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851847.287665:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851847.287666:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2068@kfi7, seq: 1997906
00000400:00000200:21.0:1773851847.287666:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:22.0:1773851847.287667:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d5f9fd05 : new rpc_count 0
00000400:00000200:21.0:1773851847.287667:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:22.0:1773851847.287668:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851847.287668:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c97ba3c
00000400:00000010:21.0:1773851847.287668:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c97ba3c.
00000100:00000001:22.0:1773851847.287669:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851847.287669:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000100:00000001:21.0:1773851847.287669:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851847.287669:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851847.287670:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d08ac1b6.
00000020:00000010:22.0:1773851847.287670:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000247a55a4.
00000400:00000200:21.0:1773851847.287670:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000020:00000040:22.0:1773851847.287671:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000d5f9fd05 : new refcount 4
00000100:00000001:22.0:1773851847.287672:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851847.287672:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 Transaction freed
00000800:00000200:25.0:1773851847.401575:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851847.401576:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851847.401577:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851847.401579:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851847.401580:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.401582:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21921@kfi7 : PUT - for me
00000400:00000200:25.0:1773851847.401583:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.401584:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 1
00000400:00000200:25.0:1773851847.401584:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.401585:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000400:00000200:25.0:1773851847.401586:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 3
00000400:00000200:25.0:1773851847.401586:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21920@kfi7 to cpt 3
00000400:00000200:25.0:1773851847.401587:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21920@kfi7 of length 224 into portal 12 MB=0x699e095f3e6c0
00000400:00000200:25.0:1773851847.401589:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21920@kfi7 of length 224/224 into md 0x16159c6179 [64] + 174976
00000800:00000200:25.0:1773851847.401590:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851847.401592:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851847.401593:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21921@kfi7: PUT: OK
00000100:00000001:25.0:1773851847.401594:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851847.401594:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851847.401595:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000effa70cf.
00000100:00000040:25.0:1773851847.401596:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000effa70cf x1858039727777472 msgsize 224
00000100:00100000:25.0:1773851847.401597:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-21920@kfi7 (source: 12345-21921@kfi7)
00000100:00000001:25.0:1773851847.401598:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851847.401599:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000800:00000200:25.0:1773851847.401600:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851847.401600:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851847.401600:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851847.401601:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851847.401601:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851847.401602:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851847.401603:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039727777472
00000020:00000001:24.0:1773851847.401604:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851847.401604:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922d0
00000020:00000001:24.0:1773851847.401605:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851847.401606:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000019271512 refcount=6
00000020:00000001:24.0:1773851847.401607:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630032384 : -107123079519232 : ffff9e9276e5e400)
00000020:00000001:24.0:1773851847.401608:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630032384 : -107123079519232 : ffff9e9276e5e400)
00000100:00000001:24.0:1773851847.401609:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851847.401609:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851847.401610:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003510becf.
00000020:00000010:24.0:1773851847.401611:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851847.401612:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bc23e3f.
00000100:00000001:24.0:1773851847.401613:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851847.401614:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851847.401615:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851847.401616:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851847.401616:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851847.401617:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.401618:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851847.401619:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851847.401619:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851847.401620:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851847.401620:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851847.401621:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21920@kfi7, seq: 2025024
00000100:00000040:24.0:1773851847.401621:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000019271512 : new rpc_count 1
00000100:00000001:26.0:1773851847.401622:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851847.401622:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.401622:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700613760 : -106953008937856 : ffff9eba0fe50480)
00000100:00000040:24.0:1773851847.401624:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000effa70cf x1858039727777472/t0(0) o400->07c68283-08a7-4e2d-9d3a-e4d07a04e682@21920@kfi7:33/0 lens 224/0 e 0 to 0 dl 1773852148 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1856-0'
00000100:00000001:24.0:1773851847.401627:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851847.401627:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851847.401628:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000effa70cf pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:07c68283-08a7-4e2d-9d3a-e4d07a04e682+6:39634:x1858039727777472:12345-21920@kfi7:400:default-tuolumne1856-0
00000100:00000200:24.0:1773851847.401630:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039727777472
00000020:00000001:24.0:1773851847.401630:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851847.401631:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851847.401631:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.401632:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851847.401633:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851847.401634:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851847.401634:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039727777472, found 0 last_xid 1858039727777471
00000020:00000001:24.0:1773851847.401635:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851847.401636:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851847.401636:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851847.401637:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.401638:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851847.401638:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851847.401639:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851847.401640:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e7a55f53.
02000000:00000001:24.0:1773851847.401641:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.401642:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.401643:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851847.401644:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698258, transno 0, xid 1858039727777472
00010000:00000001:24.0:1773851847.401645:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851847.401645:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000effa70cf x1858039727777472/t0(0) o400->07c68283-08a7-4e2d-9d3a-e4d07a04e682@21920@kfi7:33/0 lens 224/224 e 0 to 0 dl 1773852148 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1856-0'
00010000:00000001:24.0:1773851847.401648:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851847.401649:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851847.401649:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=80 v=288 (288 212 1 1)
00000100:00000001:24.0:1773851847.401650:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851847.401651:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b51b8db8 refcount 3 to 21920@kfi7
00000100:00000001:24.0:1773851847.401652:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154336 : -107139310397280 : ffff9e8eaf7658a0)
02000000:00000001:24.0:1773851847.401653:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851847.401653:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.401654:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851847.401655:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21921@kfi7
00000400:00000010:24.0:1773851847.401655:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000094777d.
00000100:00000200:24.0:1773851847.401656:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039727777472, offset 224
00000400:00000200:24.0:1773851847.401658:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21921@kfi7
00000400:00000200:24.0:1773851847.401658:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:24.0:1773851847.401659:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 1
00000400:00000200:24.0:1773851847.401660:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000400:00000200:24.0:1773851847.401661:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 3
00000400:00000200:24.0:1773851847.401662:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21921@kfi7 local destination
00000400:00000200:24.0:1773851847.401664:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768338:8768338:1024:4294967295] 21921@kfi7 LPNI seq info [691401:691401:16:4294967295]
00000400:00000200:24.0:1773851847.401665:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000400:00000200:24.0:1773851847.401666:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:24.0:1773851847.401668:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21921@kfi7(21921@kfi7:21921@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851847.401669:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 3
00000800:00000200:24.0:1773851847.401670:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851847.401671:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851847.401673:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851847.401676:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x389 Using peer 21921@kfi7(0x389)
00000800:00000200:24.0:1773851847.401679:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x389: rc=0
00000800:00000200:24.0:1773851847.401680:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x389 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851847.401682:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851847.401683:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b51b8db8 refcount 2 to 21920@kfi7
00010000:00000001:24.0:1773851847.401684:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851847.401684:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.401685:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851847.401686:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000effa70cf x1858039727777472/t0(0) o400->07c68283-08a7-4e2d-9d3a-e4d07a04e682@21920@kfi7:33/0 lens 224/224 e 0 to 0 dl 1773852148 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1856-0'
00000100:00100000:24.0:1773851847.401690:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000effa70cf pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:07c68283-08a7-4e2d-9d3a-e4d07a04e682+6:39634:x1858039727777472:12345-21920@kfi7:400:default-tuolumne1856-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851847.401693:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21920@kfi7, seq: 2025024
00000100:00000040:24.0:1773851847.401694:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000019271512 : new rpc_count 0
00000100:00000001:24.0:1773851847.401694:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851847.401695:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851847.401695:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851847.401696:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bc23e3f.
00000020:00000010:24.0:1773851847.401697:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003510becf.
00000020:00000040:24.0:1773851847.401698:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000019271512 : new refcount 5
00000100:00000001:24.0:1773851847.401699:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851847.401703:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x389 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851847.401705:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851847.401706:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21921@kfi7: PUT: OK
00000400:00000200:25.0:1773851847.401706:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000094777d
00000400:00000010:25.0:1773851847.401707:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000094777d.
00000100:00000001:25.0:1773851847.401707:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851847.401708:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851847.401708:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000800:00000200:25.0:1773851847.401710:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 21921@kfi7(00000000ba6a5148):0x0 lsk 906 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x389 Transaction freed
00000800:00000200:31.0:1773851847.421149:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851847.421150:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851847.421152:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851847.421155:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851847.421157:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851847.421159:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21746@kfi7 : PUT - for me
00000400:00000200:31.0:1773851847.421160:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851847.421161:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:31.0:1773851847.421163:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851847.421163:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:31.0:1773851847.421164:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:31.0:1773851847.421166:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21747@kfi7 to cpt 3
00000400:00000200:31.0:1773851847.421167:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21747@kfi7 of length 224 into portal 12 MB=0x69b0a32ab2200
00000400:00000200:31.0:1773851847.421168:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21747@kfi7 of length 224/224 into md 0x77fe139dd [64] + 153576
00000800:00000200:31.0:1773851847.421171:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851847.421174:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851847.421175:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21746@kfi7: PUT: OK
00000100:00000001:31.0:1773851847.421176:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851847.421177:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851847.421178:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a73ee51.
00000100:00000040:31.0:1773851847.421179:0:2465875:0:(events.c:358:request_in_callback()) incoming req@000000002a73ee51 x1859317962318336 msgsize 224
00000100:00100000:31.0:1773851847.421181:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-21747@kfi7 (source: 12345-21746@kfi7)
00000100:00000001:31.0:1773851847.421182:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851847.421184:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000100:00000001:29.0:1773851847.421185:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:31.0:1773851847.421186:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:29.0:1773851847.421186:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851847.421187:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851847.421188:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851847.421189:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851847.421190:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317962318336
00000020:00000001:29.0:1773851847.421191:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851847.421192:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9266c
00000020:00000001:29.0:1773851847.421193:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.421199:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007f505e46 refcount=6
00000020:00000001:29.0:1773851847.421200:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630999040 : -107123078552576 : ffff9e9276f4a400)
00000020:00000001:29.0:1773851847.421201:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630999040 : -107123078552576 : ffff9e9276f4a400)
00000100:00000001:29.0:1773851847.421203:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851847.421204:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851847.421205:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b92c4ee7.
00000020:00000010:29.0:1773851847.421207:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851847.421208:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000317bc9e2.
00000100:00000001:29.0:1773851847.421209:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851847.421210:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851847.421211:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851847.421213:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851847.421213:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851847.421214:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.421216:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851847.421218:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851847.421218:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851847.421218:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851847.421219:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851847.421220:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21747@kfi7, seq: 2055434
00000100:00000040:31.0:1773851847.421221:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007f505e46 : new rpc_count 1
00000100:00000001:29.0:1773851847.421221:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.421222:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636970058995072 : -107103650556544 : ffff9e96fcf45580)
00000100:00000001:29.0:1773851847.421222:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851847.421224:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002a73ee51 x1859317962318336/t0(0) o400->602458b8-9ae5-43ca-987c-12a471413e79@21747@kfi7:635/0 lens 224/0 e 0 to 0 dl 1773851995 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1833-0'
00000100:00000001:31.0:1773851847.421228:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851847.421228:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851847.421230:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a73ee51 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:602458b8-9ae5-43ca-987c-12a471413e79+6:39900:x1859317962318336:12345-21747@kfi7:400:default-tuolumne1833-0
00000100:00000200:31.0:1773851847.421231:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317962318336
00000020:00000001:31.0:1773851847.421232:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851847.421233:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851847.421234:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.421235:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851847.421236:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851847.421237:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851847.421237:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317962318336, found 0 last_xid 1859317962318335
00000020:00000001:31.0:1773851847.421238:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851847.421239:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851847.421239:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851847.421240:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.421241:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851847.421242:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851847.421242:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851847.421243:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005b012337.
02000000:00000001:31.0:1773851847.421244:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.421245:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.421245:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851847.421246:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317962318336
00010000:00000001:31.0:1773851847.421247:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851847.421248:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002a73ee51 x1859317962318336/t0(0) o400->602458b8-9ae5-43ca-987c-12a471413e79@21747@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1833-0'
00010000:00000001:31.0:1773851847.421251:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851847.421252:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851847.421252:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=80 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851847.421254:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851847.421255:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6c586e9 refcount 5 to 21747@kfi7
00000100:00000001:31.0:1773851847.421256:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154816 : -107139310396800 : ffff9e8eaf765a80)
02000000:00000001:31.0:1773851847.421257:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851847.421258:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.421259:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851847.421260:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21746@kfi7
00000400:00000010:31.0:1773851847.421260:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f33d0462.
00000100:00000200:31.0:1773851847.421261:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317962318336, offset 224
00000400:00000200:31.0:1773851847.421263:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21746@kfi7
00000400:00000200:31.0:1773851847.421264:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851847.421265:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:31.0:1773851847.421266:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:31.0:1773851847.421267:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:31.0:1773851847.421269:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21746@kfi7 local destination
00000400:00000200:31.0:1773851847.421271:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768339:8768339:1024:4294967295] 21746@kfi7 LPNI seq info [5226826:5226826:16:4294967295]
00000400:00000200:31.0:1773851847.421273:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:31.0:1773851847.421273:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851847.421276:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21746@kfi7(21746@kfi7:21746@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851847.421277:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000800:00000200:31.0:1773851847.421278:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851847.421279:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851847.421282:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851847.421285:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 Using peer 21746@kfi7(0x100000000000017)
00000800:00000200:31.0:1773851847.421289:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x100000000000017: rc=0
00000800:00000200:31.0:1773851847.421290:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851847.421293:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851847.421294:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6c586e9 refcount 4 to 21747@kfi7
00010000:00000001:31.0:1773851847.421295:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851847.421295:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.421296:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851847.421297:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a73ee51 x1859317962318336/t0(0) o400->602458b8-9ae5-43ca-987c-12a471413e79@21747@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1833-0'
00000100:00100000:31.0:1773851847.421300:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a73ee51 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:602458b8-9ae5-43ca-987c-12a471413e79+6:39900:x1859317962318336:12345-21747@kfi7:400:default-tuolumne1833-0 Request processed in 72us (120us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851847.421304:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21747@kfi7, seq: 2055434
00000100:00000040:31.0:1773851847.421305:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007f505e46 : new rpc_count 0
00000100:00000001:31.0:1773851847.421305:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851847.421306:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851847.421306:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851847.421307:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:31.0:1773851847.421308:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000317bc9e2.
00000020:00000010:31.0:1773851847.421309:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b92c4ee7.
00000020:00000040:31.0:1773851847.421310:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000007f505e46 : new refcount 5
00000400:00000200:29.0:1773851847.421310:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851847.421311:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851847.421312:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21746@kfi7: PUT: OK
00000400:00000200:29.0:1773851847.421313:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f33d0462
00000400:00000010:29.0:1773851847.421314:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f33d0462.
00000100:00000001:29.0:1773851847.421316:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851847.421316:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851847.421318:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000800:00000200:29.0:1773851847.421321:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 Transaction freed
00000800:00000200:17.0:1773851847.476850:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851847.476851:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851847.476852:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851847.476854:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851847.476855:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.476857:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19666@kfi7 : PUT - for me
00000400:00000200:17.0:1773851847.476858:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.476858:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 1
00000400:00000200:17.0:1773851847.476859:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.476860:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000400:00000200:17.0:1773851847.476861:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 3
00000400:00000200:17.0:1773851847.476861:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19667@kfi7 to cpt 7
00000400:00000200:17.0:1773851847.476862:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19667@kfi7 of length 224 into portal 12 MB=0x69b0a343c4080
00000400:00000200:17.0:1773851847.476863:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19667@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 182552
00000800:00000200:17.0:1773851847.476865:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851847.476866:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851847.476867:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19666@kfi7: PUT: OK
00000100:00000001:17.0:1773851847.476868:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851847.476869:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851847.476870:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001865f496.
00000100:00000040:17.0:1773851847.476871:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001865f496 x1859317988606080 msgsize 224
00000100:00100000:17.0:1773851847.476872:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19667@kfi7 (source: 12345-19666@kfi7)
00000100:00000001:17.0:1773851847.476873:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851847.476874:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000100:00000001:18.0:1773851847.476875:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851847.476875:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851847.476875:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851847.476876:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851847.476876:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851847.476877:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851847.476877:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317988606080
00000020:00000001:18.0:1773851847.476878:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851847.476879:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92236
00000020:00000001:18.0:1773851847.476879:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851847.476884:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000043c08bd2 refcount=6
00000020:00000001:18.0:1773851847.476884:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630006784 : -107123079544832 : ffff9e9276e58000)
00000020:00000001:18.0:1773851847.476885:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630006784 : -107123079544832 : ffff9e9276e58000)
00000100:00000001:18.0:1773851847.476886:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851847.476887:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851847.476888:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000104bdc31.
00000020:00000010:18.0:1773851847.476889:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851847.476890:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d4e7664f.
00000100:00000001:18.0:1773851847.476891:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851847.476891:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851847.476892:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851847.476892:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851847.476893:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851847.476893:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851847.476894:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851847.476896:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851847.476896:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851847.476896:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851847.476896:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851847.476897:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19667@kfi7, seq: 2156231
00000100:00000040:19.0:1773851847.476898:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000043c08bd2 : new rpc_count 1
00000100:00000001:18.0:1773851847.476898:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851847.476899:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636944025644032 : -107129683907584 : ffff9e90ed3eec00)
00000100:00000001:18.0:1773851847.476899:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851847.476900:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001865f496 x1859317988606080/t0(0) o400->e20cc4ce-fa7e-4086-864e-6c4720af89a1@19667@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1717-0'
00000100:00000001:19.0:1773851847.476904:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851847.476905:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851847.476906:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001865f496 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e20cc4ce-fa7e-4086-864e-6c4720af89a1+6:39497:x1859317988606080:12345-19667@kfi7:400:default-tuolumne1717-0
00000100:00000200:19.0:1773851847.476908:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317988606080
00000020:00000001:19.0:1773851847.476908:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851847.476909:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851847.476910:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.476910:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851847.476911:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851847.476912:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851847.476912:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317988606080, found 0 last_xid 1859317988606079
00000020:00000001:19.0:1773851847.476913:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851847.476914:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851847.476914:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851847.476915:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.476916:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851847.476916:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851847.476917:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851847.476918:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000536c7f43.
02000000:00000001:19.0:1773851847.476919:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851847.476919:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.476920:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851847.476921:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183243429769, transno 0, xid 1859317988606080
00010000:00000001:19.0:1773851847.476922:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851847.476922:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001865f496 x1859317988606080/t0(0) o400->e20cc4ce-fa7e-4086-864e-6c4720af89a1@19667@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1717-0'
00010000:00000001:19.0:1773851847.476925:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851847.476926:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851847.476926:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=80 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851847.476928:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851847.476928:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000d6494d refcount 3 to 19667@kfi7
00000100:00000001:19.0:1773851847.476929:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270048 : -107152618281568 : ffff9e8b964025a0)
02000000:00000001:19.0:1773851847.476930:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851847.476931:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851847.476931:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851847.476932:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19666@kfi7
00000400:00000010:19.0:1773851847.476933:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008f376219.
00000100:00000200:19.0:1773851847.476934:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317988606080, offset 224
00000400:00000200:19.0:1773851847.476935:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19666@kfi7
00000400:00000200:19.0:1773851847.476936:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:19.0:1773851847.476937:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 1
00000400:00000200:19.0:1773851847.476938:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000400:00000200:19.0:1773851847.476939:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 3
00000400:00000200:19.0:1773851847.476940:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19666@kfi7 local destination
00000400:00000200:19.0:1773851847.476942:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768340:8768340:1024:4294967295] 19666@kfi7 LPNI seq info [6271473:6271473:16:4294967295]
00000400:00000200:19.0:1773851847.476943:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000400:00000200:19.0:1773851847.476944:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:19.0:1773851847.476946:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19666@kfi7(19666@kfi7:19666@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851847.476947:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 3
00000800:00000200:19.0:1773851847.476948:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851847.476950:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851847.476952:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851847.476954:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001193 Using peer 19666@kfi7(0x100000000001193)
00000800:00000200:19.0:1773851847.476958:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x100000000001193: rc=0
00000800:00000200:19.0:1773851847.476959:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001193 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851847.476961:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851847.476962:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000d6494d refcount 2 to 19667@kfi7
00010000:00000001:19.0:1773851847.476963:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851847.476963:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.476964:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851847.476964:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001865f496 x1859317988606080/t0(0) o400->e20cc4ce-fa7e-4086-864e-6c4720af89a1@19667@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1717-0'
00000100:00100000:19.0:1773851847.476968:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001865f496 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e20cc4ce-fa7e-4086-864e-6c4720af89a1+6:39497:x1859317988606080:12345-19667@kfi7:400:default-tuolumne1717-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851847.476970:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19667@kfi7, seq: 2156231
00000100:00000040:19.0:1773851847.476971:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000043c08bd2 : new rpc_count 0
00000100:00000001:19.0:1773851847.476971:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851847.476971:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001193 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851847.476972:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851847.476972:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851847.476973:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:19.0:1773851847.476973:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d4e7664f.
00000400:00000200:17.0:1773851847.476973:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19666@kfi7: PUT: OK
00000020:00000010:19.0:1773851847.476974:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000104bdc31.
00000400:00000200:17.0:1773851847.476974:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008f376219
00000020:00000040:19.0:1773851847.476975:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000043c08bd2 : new refcount 5
00000400:00000010:17.0:1773851847.476975:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008f376219.
00000100:00000001:17.0:1773851847.476975:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851847.476976:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851847.476976:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851847.476976:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000800:00000200:17.0:1773851847.476978:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 19666@kfi7(00000000b69e3516):0x0 lsk 4500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001193 Transaction freed
00000004:00000001:30.0:1773851847.497731:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851847.497731:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:31.0:1773851847.497732:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851847.497732:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851847.497732:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851847.497733:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851847.497733:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:9.0:1773851847.497733:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851847.497734:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851847.497734:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f6ba6e11.
00000100:00000010:10.0:1773851847.497734:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000094637c7a.
00000004:00000020:9.0:1773851847.497734:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:7.0:1773851847.497734:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851847.497734:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:5.0:1773851847.497734:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c88ff90f.
00000020:00000040:30.0:1773851847.497735:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000010:9.0:1773851847.497735:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003a8d1543.
00000004:00000020:7.0:1773851847.497735:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:6.0:1773851847.497735:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:31.0:1773851847.497736:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000182ebf41.
00000100:00000001:30.0:1773851847.497736:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851847.497736:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:10.0:1773851847.497736:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000020:00000040:5.0:1773851847.497736:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
00000020:00000040:31.0:1773851847.497737:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
02000000:00000001:30.0:1773851847.497737:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851847.497737:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:9.0:1773851847.497737:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000100:00000010:7.0:1773851847.497737:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ffbbbda4.
00000100:00000010:6.0:1773851847.497737:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073d0c946.
02000000:00000010:30.0:1773851847.497738:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000040d06717.
02000000:00000001:10.0:1773851847.497738:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851847.497738:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851847.497738:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:31.0:1773851847.497739:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851847.497739:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851847.497739:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000060c86190.
00000100:00000001:9.0:1773851847.497739:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:7.0:1773851847.497739:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851847.497739:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
02000000:00000001:31.0:1773851847.497740:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851847.497740:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851847.497740:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851847.497740:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.497740:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851847.497740:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851847.497741:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:9.0:1773851847.497741:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:7.0:1773851847.497741:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:31.0:1773851847.497742:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851847.497742:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f6ba6e11] to pc [ptlrpcd_07_00+0]  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851847.497742:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851847.497742:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851847.497742:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851847.497742:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851847.497742:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851847.497743:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000094637c7a] to pc [ptlrpcd_02_02+2]  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851847.497743:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851847.497743:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851847.497745:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000addde0c.
02000000:00000010:9.0:1773851847.497745:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000010:7.0:1773851847.497745:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ed33a1f5.
02000000:00000010:6.0:1773851847.497745:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000f17f2b52.
02000000:00000010:5.0:1773851847.497745:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ef164abb.
00000100:00000001:31.0:1773851847.497747:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851847.497747:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.497747:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851847.497747:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851847.497748:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851847.497748:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851847.497748:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851847.497748:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.497749:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851847.497749:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:10.0:1773851847.497749:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851847.497749:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851847.497749:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851847.497749:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851847.497750:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851847.497750:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851847.497750:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851847.497750:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851847.497750:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497750:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851847.497751:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.497751:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851847.497751:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851847.497751:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:10.0:1773851847.497751:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000005b89b7c0.
00000100:00000001:8.0:1773851847.497751:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851847.497751:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.497751:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851847.497751:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851847.497752:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851847.497752:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637061890150400 : -107011819401216 : ffff9eac5e849000)
00000100:00000040:9.0:1773851847.497752:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003a8d1543] to pc [ptlrpcd_02_03+3]  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851847.497753:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000182ebf41] to pc [ptlrpcd_07_01+1]  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851847.497753:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:28.0:1773851847.497754:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851847.497754:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851847.497754:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851847.497754:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ffbbbda4] to pc [ptlrpcd_01_00+0]  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851847.497754:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000073d0c946] to pc [ptlrpcd_01_02+2]  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851847.497754:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c88ff90f] to pc [ptlrpcd_01_03+3]  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:28.0:1773851847.497755:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:11.0:1773851847.497755:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:10.0:1773851847.497755:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
02000000:00000001:28.0:1773851847.497756:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.497756:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851847.497756:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:10.0:1773851847.497756:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002c7a8f71.
00000100:00100000:28.0:1773851847.497757:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f6ba6e11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051920064:13@kfi7:41:default-yuba2-0
02000000:00000001:11.0:1773851847.497757:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:10.0:1773851847.497757:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614121951032707ns, next at 614122951031274ns, rc = 0
00000100:00000001:28.0:1773851847.497758:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00100000:11.0:1773851847.497758:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000094637c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051920128:37@kfi7:13:default-yuba2-0
00080000:00000001:10.0:1773851847.497758:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:28.0:1773851847.497759:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:9.0:1773851847.497759:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:31.0:1773851847.497760:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:28.0:1773851847.497760:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851847.497760:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:11.0:1773851847.497760:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:10.0:1773851847.497760:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851847.497760:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497760:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851847.497760:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851847.497761:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:11.0:1773851847.497761:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851847.497761:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:9.0:1773851847.497761:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000000df5f72a.
00000100:00000001:8.0:1773851847.497761:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:31.0:1773851847.497762:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003b120c65.
00000100:00000001:29.0:1773851847.497762:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000010:28.0:1773851847.497762:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000c1da22c5.
02000000:00000001:28.0:1773851847.497762:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851847.497762:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:9.0:1773851847.497762:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636951986625536 : -107121722926080 : ffff9e92c7c1dc00)
00000100:00000040:8.0:1773851847.497762:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851847.497763:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637110829928448 : -106962879623168 : ffff9eb7c38e5000)
00000100:00000001:29.0:1773851847.497763:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000010:11.0:1773851847.497763:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ad96937e.
00080000:00000001:9.0:1773851847.497763:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000001:6.0:1773851847.497763:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497763:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:29.0:1773851847.497764:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851847.497764:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:28.0:1773851847.497764:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
02000000:00000001:11.0:1773851847.497764:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497764:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:5.0:1773851847.497764:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851847.497764:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:31.0:1773851847.497765:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000400:00000010:28.0:1773851847.497765:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d3aa665.
00000400:00000200:11.0:1773851847.497765:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00080000:00000001:9.0:1773851847.497765:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497765:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851847.497765:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000001:7.0:1773851847.497765:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497765:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000200:28.0:1773851847.497766:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920064, portal 4
00000400:00000010:11.0:1773851847.497766:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000004:00001000:9.0:1773851847.497766:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
02000000:00000001:8.0:1773851847.497766:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.497766:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:5.0:1773851847.497766:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006a1874d0.
00000100:00000040:4.0:1773851847.497766:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851847.497767:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851847.497767:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851847.497767:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636973000837120 : -107100708714496 : ffff9e97ac4d4800)
00000400:00000010:11.0:1773851847.497767:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000004:00000010:9.0:1773851847.497767:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000000a0125e0.
00000100:00100000:8.0:1773851847.497767:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003a8d1543 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051920192:2060@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851847.497767:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00001000:31.0:1773851847.497768:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000200:11.0:1773851847.497768:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920128, portal 4
00000100:00000001:8.0:1773851847.497768:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:6.0:1773851847.497768:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851847.497768:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637010750997504 : -107062958554112 : ffff9ea076630400)
00000100:00000001:29.0:1773851847.497769:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:28.0:1773851847.497769:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851847.497769:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000004:00080000:9.0:1773851847.497769:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614121951044258ns, next at 614122951042685ns, rc = 0
02000000:00000001:8.0:1773851847.497769:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851847.497769:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.497769:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:31.0:1773851847.497770:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007c74af6c.
00000100:00000001:29.0:1773851847.497770:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.497770:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077423488 : -106968632128128 : ffff9eb66cae0d80)
02000000:00000001:8.0:1773851847.497770:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851847.497770:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000521610c6.
00080000:00000001:5.0:1773851847.497770:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:28.0:1773851847.497771:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00080000:00000001:9.0:1773851847.497771:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851847.497771:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851847.497771:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851847.497771:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851847.497771:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:31.0:1773851847.497772:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614121951047394ns, next at 614122951045070ns, rc = 0
02000000:00000001:29.0:1773851847.497772:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:28.0:1773851847.497772:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:28.0:1773851847.497772:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ca2a170b.
00000100:00000040:11.0:1773851847.497772:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:9.0:1773851847.497772:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851847.497772:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:7.0:1773851847.497772:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851847.497772:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851847.497772:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851847.497773:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851847.497773:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051920064, offset 0
00000004:00000001:9.0:1773851847.497773:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851847.497773:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000004:00001000:5.0:1773851847.497773:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
02000000:00000001:4.0:1773851847.497773:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851847.497774:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:11.0:1773851847.497774:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:8.0:1773851847.497774:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a36d61ab.
00000100:00000001:6.0:1773851847.497774:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00100000:29.0:1773851847.497775:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182ebf41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051920256:60@kfi7:13:default-yuba2-0
00000400:00000200:28.0:1773851847.497775:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000100:00000200:8.0:1773851847.497775:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920192, portal 4
00000100:00000001:8.0:1773851847.497775:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851847.497775:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:5.0:1773851847.497775:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000016e215d1.
00000100:00100000:4.0:1773851847.497775:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000073d0c946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051920320:36@kfi7:13:default-yuba2-0
00080000:00000001:31.0:1773851847.497776:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851847.497776:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000040:11.0:1773851847.497776:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000400:00000010:11.0:1773851847.497776:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000841fb28d.
00000100:00000001:8.0:1773851847.497776:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637085569662720 : -106988139888896 : ffff9eb1e1ed3f00)
00000100:00000001:7.0:1773851847.497776:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00080000:5.0:1773851847.497776:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614121951051843ns, next at 614122951049598ns, rc = 0
00000004:00000001:31.0:1773851847.497777:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.497777:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:28.0:1773851847.497777:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000200:11.0:1773851847.497777:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920128, offset 0
00000100:00000040:8.0:1773851847.497777:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851847.497777:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:6.0:1773851847.497777:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:4.0:1773851847.497777:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851847.497777:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851847.497778:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:28.0:1773851847.497778:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
02000000:00000001:6.0:1773851847.497778:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851847.497778:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851847.497779:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851847.497779:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000100:00000001:7.0:1773851847.497779:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00100000:6.0:1773851847.497779:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffbbbda4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051920448:2074@kfi7:41:default-yuba2-0
00080000:00000001:5.0:1773851847.497779:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851847.497779:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851847.497779:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008c84125c.
02000000:00000001:29.0:1773851847.497780:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:28.0:1773851847.497780:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:11.0:1773851847.497780:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:8.0:1773851847.497780:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851847.497780:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851847.497780:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851847.497781:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004b536c60.
00000400:00000200:28.0:1773851847.497781:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:11.0:1773851847.497781:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000040:8.0:1773851847.497781:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000004:00000001:5.0:1773851847.497781:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851847.497781:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851847.497782:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851847.497782:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768338, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768340, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851847.497782:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000010:8.0:1773851847.497782:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f71c7d5.
00000100:00000200:8.0:1773851847.497782:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920192, offset 0
00000100:00000001:6.0:1773851847.497782:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:4.0:1773851847.497782:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
02000000:00000001:6.0:1773851847.497783:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:4.0:1773851847.497783:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001dcecbd8.
00000400:00000200:28.0:1773851847.497784:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:11.0:1773851847.497784:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:8.0:1773851847.497784:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
02000000:00000001:6.0:1773851847.497784:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851847.497784:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000062ec508f.
00000400:00000200:28.0:1773851847.497785:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
02000000:00000001:6.0:1773851847.497785:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:4.0:1773851847.497785:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920320, portal 4
00000400:00000200:28.0:1773851847.497786:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851847.497786:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000100:00000001:7.0:1773851847.497786:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000010:6.0:1773851847.497786:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a2ebc3d3.
00000100:00000001:4.0:1773851847.497786:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:28.0:1773851847.497787:0:41088:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133307, 23133306]
00000100:00000001:7.0:1773851847.497787:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851847.497787:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497787:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637119644518400 : -106954065033216 : ffff9eb9d0f24800)
00000400:00000200:11.0:1773851847.497788:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768338, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768340, p:4294967295, g:4294967295, h:1000]
02000000:00000001:7.0:1773851847.497788:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:4.0:1773851847.497788:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851847.497789:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
02000000:00000001:7.0:1773851847.497789:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851847.497789:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851847.497790:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768341:8768341:1024:4294967295] 13@kfi7 LPNI seq info [23133308:23133308:16:4294967295]
00000400:00000200:11.0:1773851847.497790:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000010:6.0:1773851847.497790:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000400:00000200:28.0:1773851847.497791:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:11.0:1773851847.497791:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00100000:7.0:1773851847.497791:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c88ff90f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051920384:2061@kfi7:13:default-yuba2-0
00000400:00000010:6.0:1773851847.497791:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009150aefe.
00000100:00000001:4.0:1773851847.497791:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:28.0:1773851847.497792:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:11.0:1773851847.497792:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000100:00000040:4.0:1773851847.497792:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000200:11.0:1773851847.497793:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768342:8768342:1024:4294967295] 37@kfi7 LPNI seq info [5403389:5403389:16:4294967295]
00000100:00000200:6.0:1773851847.497793:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920448, portal 4
00000400:00000010:4.0:1773851847.497793:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6473a15.
00000100:00000200:4.0:1773851847.497793:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920320, offset 0
00000400:00000200:29.0:1773851847.497794:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:7.0:1773851847.497794:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:6.0:1773851847.497794:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851847.497794:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309129344 : -106994400422272 : ffff9eb06cc51680)
00000400:00000010:29.0:1773851847.497795:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000027eae465.
00000400:00000200:11.0:1773851847.497795:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
02000000:00000001:7.0:1773851847.497795:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:4.0:1773851847.497795:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000010:29.0:1773851847.497796:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ecffec9b.
00000400:00000200:28.0:1773851847.497796:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851847.497796:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
02000000:00000001:7.0:1773851847.497796:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.497796:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851847.497797:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:8.0:1773851847.497797:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
02000000:00000001:7.0:1773851847.497797:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:4.0:1773851847.497797:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000200:29.0:1773851847.497798:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920256, portal 4
00000400:00000200:8.0:1773851847.497798:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
02000000:00000010:7.0:1773851847.497798:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000aafb7691.
00000400:00000200:4.0:1773851847.497798:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000100:00000001:29.0:1773851847.497799:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:28.0:1773851847.497799:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:11.0:1773851847.497799:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
02000000:00000001:7.0:1773851847.497799:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.497800:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636970059004288 : -107103650547328 : ffff9e96fcf47980)
00000400:00000200:11.0:1773851847.497800:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:8.0:1773851847.497800:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:4.0:1773851847.497800:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:28.0:1773851847.497801:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:6.0:1773851847.497801:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851847.497801:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000040:29.0:1773851847.497802:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851847.497802:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:8.0:1773851847.497802:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000100:00000040:6.0:1773851847.497802:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000800:00000200:28.0:1773851847.497803:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:8.0:1773851847.497803:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000010:6.0:1773851847.497803:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009d3ba0cf.
00000400:00000200:4.0:1773851847.497803:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000800:00000200:11.0:1773851847.497804:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000200:6.0:1773851847.497804:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051920448, offset 0
00000400:00000200:8.0:1773851847.497805:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768341, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768342, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851847.497805:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768341, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768342, p:4294967295, g:4294967295, h:1000]
00000800:00000200:28.0:1773851847.497806:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Using peer 13@kfi7(0x102)
00000400:00000200:6.0:1773851847.497806:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000100:00000001:29.0:1773851847.497807:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:11.0:1773851847.497807:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:8.0:1773851847.497807:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851847.497807:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000040:29.0:1773851847.497808:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000400:00000200:8.0:1773851847.497808:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851847.497808:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000010:29.0:1773851847.497809:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089b548b8.
00000800:00000200:28.0:1773851847.497809:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x102: rc=0
00000400:00000200:8.0:1773851847.497809:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000100:00000200:29.0:1773851847.497810:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920256, offset 0
00000800:00000200:11.0:1773851847.497810:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Using peer 37@kfi7(0x2000000000001a4)
00000400:00000200:4.0:1773851847.497810:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000800:00000200:28.0:1773851847.497811:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:8.0:1773851847.497811:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768344:8768344:1023:4294967295] 2060@kfi7 LPNI seq info [5404989:5404989:16:4294967295]
00000400:00000200:4.0:1773851847.497811:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768344:8768344:1023:4294967295] 36@kfi7 LPNI seq info [5403962:5403962:16:4294967295]
00000400:00000200:29.0:1773851847.497812:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000100:00000001:28.0:1773851847.497813:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851847.497813:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x2000000000001a4: rc=0
00000400:00000200:8.0:1773851847.497813:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:4.0:1773851847.497813:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:29.0:1773851847.497814:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:28.0:1773851847.497814:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851847.497814:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851847.497814:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:4.0:1773851847.497814:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:28.0:1773851847.497815:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851847.497815:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851847.497816:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000100:00000001:28.0:1773851847.497816:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851847.497816:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.497817:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:11.0:1773851847.497817:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851847.497817:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000010:7.0:1773851847.497817:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d561f1e3.
00000100:00000001:28.0:1773851847.497818:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851847.497818:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:11.0:1773851847.497818:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851847.497818:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.497819:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000001:28.0:1773851847.497819:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851847.497819:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851847.497819:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000010:7.0:1773851847.497819:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d794ea.
00000400:00000200:6.0:1773851847.497819:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000100:00000001:28.0:1773851847.497820:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851847.497820:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851847.497820:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:29.0:1773851847.497821:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000100:00000001:11.0:1773851847.497821:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:7.0:1773851847.497821:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920384, portal 4
00000400:00000200:6.0:1773851847.497821:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:11.0:1773851847.497822:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851847.497822:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:4.0:1773851847.497822:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000100:00000001:11.0:1773851847.497823:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:8.0:1773851847.497823:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:7.0:1773851847.497823:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095280927488 : -106978428624128 : ffff9eb424c36300)
00000400:00000200:6.0:1773851847.497823:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851847.497824:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8768344, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768342, p:4294967295, g:4294967295, h:1000]
00000100:00000001:11.0:1773851847.497824:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851847.497824:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851847.497824:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851847.497824:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000400:00000200:4.0:1773851847.497824:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:28.0:1773851847.497825:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.497825:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851847.497826:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851847.497826:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851847.497826:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851847.497826:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:6.0:1773851847.497827:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8768344, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768342, p:4294967295, g:4294967295, h:1000]
00000800:00000200:4.0:1773851847.497827:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851847.497828:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851847.497828:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000200:29.0:1773851847.497828:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851847.497829:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ca2a170b
00000400:00000200:29.0:1773851847.497829:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000010:30.0:1773851847.497830:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ca2a170b.
00000100:00000001:30.0:1773851847.497830:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851847.497830:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000100:00000001:7.0:1773851847.497830:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:4.0:1773851847.497830:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:30.0:1773851847.497831:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851847.497831:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851847.497831:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851847.497832:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768345:8768345:1023:4294967295] 60@kfi7 LPNI seq info [5404304:5404304:16:4294967295]
00000800:00000200:10.0:1773851847.497832:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851847.497832:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:7.0:1773851847.497833:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c448bd40.
00000400:00000200:6.0:1773851847.497833:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:4.0:1773851847.497833:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b Using peer 36@kfi7(0x21b)
00000100:00000001:30.0:1773851847.497834:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851847.497834:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851847.497834:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:10.0:1773851847.497834:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:8.0:1773851847.497834:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Using peer 2060@kfi7(0x1c0)
00000100:00000200:7.0:1773851847.497834:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920384, offset 0
00000400:00000200:6.0:1773851847.497834:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851847.497836:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:6.0:1773851847.497836:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425156, 23425158]
00000100:00000001:30.0:1773851847.497837:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851847.497837:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851847.497837:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000400:00000200:10.0:1773851847.497837:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000841fb28d
00000800:00000200:8.0:1773851847.497837:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1c0: rc=0
00000400:00000200:7.0:1773851847.497837:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000800:00000200:4.0:1773851847.497837:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x21b: rc=0
00000400:00000010:10.0:1773851847.497838:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000841fb28d.
00000800:00000200:4.0:1773851847.497838:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851847.497839:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:6.0:1773851847.497839:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2074@kfi7
00000400:00000200:29.0:1773851847.497840:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000100:00000200:10.0:1773851847.497840:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851847.497840:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851847.497841:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768346:8768346:1022:4294967295] 2074@kfi7 LPNI seq info [23425159:23425159:16:4294967295]
00000100:00000001:4.0:1773851847.497841:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497841:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851847.497842:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851847.497842:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497842:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851847.497843:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000040:10.0:1773851847.497843:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851847.497843:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851847.497843:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:4.0:1773851847.497843:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851847.497844:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:8.0:1773851847.497844:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497844:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851847.497845:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:8.0:1773851847.497845:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851847.497845:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:4.0:1773851847.497845:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:30.0:1773851847.497846:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Transaction freed
00000100:00000001:10.0:1773851847.497846:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851847.497846:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:8.0:1773851847.497846:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851847.497846:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:29.0:1773851847.497847:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851847.497847:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851847.497847:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851847.497847:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851847.497848:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851847.497848:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:7.0:1773851847.497848:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:6.0:1773851847.497849:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851847.497850:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:4.0:1773851847.497850:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851847.497850:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851847.497851:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851847.497851:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000100:00000001:8.0:1773851847.497852:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851847.497852:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:10.0:1773851847.497853:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:8.0:1773851847.497853:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851847.497854:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_EVENT_TX_OK event status 0
00000400:00000200:7.0:1773851847.497854:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000800:00000200:6.0:1773851847.497854:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.497855:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Using peer 60@kfi7(0x2000000000001dc)
00000800:00000200:10.0:1773851847.497855:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Transaction freed
00000400:00000200:11.0:1773851847.497856:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851847.497856:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8768344, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8768346, p:4294967295, g:4294967295, h:1000]
00000800:00000200:6.0:1773851847.497856:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851847.497857:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000400:00000200:11.0:1773851847.497858:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f71c7d5
00000400:00000010:11.0:1773851847.497859:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f71c7d5.
00000800:00000200:5.0:1773851847.497859:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851847.497859:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497859:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851847.497860:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0x2000000000001dc: rc=0
00000100:00000001:11.0:1773851847.497860:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:11.0:1773851847.497860:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851847.497860:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851847.497861:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:21.0:1773851847.497862:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:7.0:1773851847.497862:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:29.0:1773851847.497863:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:21.0:1773851847.497863:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:11.0:1773851847.497863:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:6.0:1773851847.497863:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e Using peer 2074@kfi7(0x20000000000097e)
00000400:00000200:5.0:1773851847.497863:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851847.497864:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:11.0:1773851847.497864:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851847.497864:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000400:00000200:7.0:1773851847.497865:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768347:8768347:1022:4294967295] 2061@kfi7 LPNI seq info [5403455:5403455:16:4294967295]
00000400:00000200:5.0:1773851847.497865:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->36@kfi7: PUT: OK
00000100:00000001:29.0:1773851847.497866:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851847.497866:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851847.497866:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6473a15
00000100:00000001:29.0:1773851847.497867:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851847.497867:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.497867:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:5.0:1773851847.497867:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6473a15.
00000400:00000200:21.0:1773851847.497868:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:7.0:1773851847.497868:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:6.0:1773851847.497868:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 324 bytes to peer 0x20000000000097e: rc=0
00000100:00000001:5.0:1773851847.497868:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851847.497869:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851847.497869:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:11.0:1773851847.497869:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:29.0:1773851847.497870:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851847.497870:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:7.0:1773851847.497870:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000200:5.0:1773851847.497870:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851847.497871:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851847.497871:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000800:00000200:11.0:1773851847.497871:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Transaction freed
00000800:00000200:6.0:1773851847.497871:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851847.497873:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851847.497873:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:21.0:1773851847.497874:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:7.0:1773851847.497874:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000100:00000001:6.0:1773851847.497874:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851847.497875:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851847.497875:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:21.0:1773851847.497875:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:6.0:1773851847.497875:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851847.497875:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851847.497876:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851847.497876:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851847.497876:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:31.0:1773851847.497877:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:29.0:1773851847.497877:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851847.497877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:7.0:1773851847.497877:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:6.0:1773851847.497877:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851847.497877:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851847.497878:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851847.497878:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b16c0
00000100:00000001:6.0:1773851847.497878:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851847.497879:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851847.497879:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:6.0:1773851847.497879:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851847.497880:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000400:00000200:30.0:1773851847.497880:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089b548b8
00000400:00000200:21.0:1773851847.497880:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d0095 [1] + 224
00000800:00000200:7.0:1773851847.497880:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:31.0:1773851847.497881:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d80c8618: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:30.0:1773851847.497881:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089b548b8.
00000100:00000001:30.0:1773851847.497881:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:17.0:1773851847.497881:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:6.0:1773851847.497881:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851847.497881:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851847.497882:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851847.497882:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851847.497882:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:6.0:1773851847.497882:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851847.497882:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:17.0:1773851847.497883:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:7.0:1773851847.497883:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:6.0:1773851847.497883:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:21.0:1773851847.497884:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851847.497884:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851847.497884:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851847.497885:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d80c8618: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:30.0:1773851847.497885:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851847.497885:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851847.497885:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000040:30.0:1773851847.497886:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851847.497886:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000800:00000200:17.0:1773851847.497886:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:21.0:1773851847.497887:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851847.497888:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851847.497888:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:21.0:1773851847.497888:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851847.497888:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:7.0:1773851847.497888:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:31.0:1773851847.497889:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:30.0:1773851847.497889:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:17.0:1773851847.497889:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 36@kfi7 : PUT - for me
00000800:00000200:5.0:1773851847.497889:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b Transaction freed
00000400:00000200:17.0:1773851847.497890:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:31.0:1773851847.497891:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 37@kfi7 : PUT - for me
00000800:00000200:30.0:1773851847.497891:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Transaction freed
00000400:00000200:17.0:1773851847.497891:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:17.0:1773851847.497892:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:31.0:1773851847.497893:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000040:21.0:1773851847.497893:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851847.497893:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:17.0:1773851847.497894:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:7.0:1773851847.497894:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000800:00000200:5.0:1773851847.497894:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851847.497895:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:17.0:1773851847.497895:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:31.0:1773851847.497896:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:17.0:1773851847.497896:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b17c0
00000100:00000001:21.0:1773851847.497897:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851847.497897:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:5.0:1773851847.497897:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851847.497898:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:21.0:1773851847.497898:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:31.0:1773851847.497899:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:28.0:1773851847.497899:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851847.497899:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851847.497899:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851847.497899:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f01d1 [1] + 224
00000800:00000200:7.0:1773851847.497899:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x19b: rc=0
00000400:00000200:5.0:1773851847.497899:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000400:00000001:28.0:1773851847.497900:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851847.497900:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851847.497900:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009d3ba0cf
00000400:00000200:31.0:1773851847.497901:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000010:28.0:1773851847.497901:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000800:00000200:17.0:1773851847.497901:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:5.0:1773851847.497901:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009d3ba0cf.
00000400:00000200:28.0:1773851847.497902:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d3aa665
00000400:00000010:28.0:1773851847.497902:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d3aa665.
00000400:00000200:17.0:1773851847.497902:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:7.0:1773851847.497902:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851847.497902:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:31.0:1773851847.497903:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1700
00000100:00000001:28.0:1773851847.497903:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851847.497903:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->36@kfi7: PUT: OK
00000100:00000200:28.0:1773851847.497904:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851847.497904:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851847.497904:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851847.497905:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000200:17.0:1773851847.497906:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851847.497906:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851847.497907:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x78007f4bd [1] + 224
00000100:00000200:28.0:1773851847.497907:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:18.0:1773851847.497907:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:7.0:1773851847.497907:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:18.0:1773851847.497908:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:7.0:1773851847.497908:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851847.497908:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:18.0:1773851847.497909:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851847.497909:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851847.497909:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851847.497910:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851847.497910:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851847.497911:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d80c8618: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851847.497911:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851847.497912:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851847.497912:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851847.497912:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851847.497913:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:31.0:1773851847.497914:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851847.497914:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851847.497914:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851847.497914:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851847.497914:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:7.0:1773851847.497914:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:6.0:1773851847.497914:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851847.497914:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851847.497915:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851847.497915:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:18.0:1773851847.497915:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2060@kfi7 : PUT - for me
00000100:00000001:17.0:1773851847.497915:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851847.497915:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851847.497915:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:31.0:1773851847.497916:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000100:00000001:28.0:1773851847.497916:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851847.497916:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851847.497916:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851847.497916:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:7.0:1773851847.497916:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851847.497916:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:31.0:1773851847.497917:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:28.0:1773851847.497917:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851847.497917:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:18.0:1773851847.497917:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000800:00000200:17.0:1773851847.497917:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851847.497917:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497917:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851847.497917:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:28.0:1773851847.497918:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=80 v=66 (66 66 66 66)
00000400:00000200:22.0:1773851847.497918:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:6.0:1773851847.497918:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:4.0:1773851847.497918:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:31.0:1773851847.497919:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:28.0:1773851847.497919:0:41088:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=80 v=66 (1 1 1 1)
00000400:00000200:18.0:1773851847.497919:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:5.0:1773851847.497919:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e Transaction freed
00000400:00000001:4.0:1773851847.497919:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851847.497920:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851847.497920:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851847.497920:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 60@kfi7 : PUT - for me
00000400:00000200:18.0:1773851847.497920:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:6.0:1773851847.497920:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000400:00000010:4.0:1773851847.497920:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001dcecbd8.
00010000:00000001:28.0:1773851847.497921:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:28.0:1773851847.497921:0:41088:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851847.497921:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851847.497921:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:4.0:1773851847.497921:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000062ec508f
00000400:00000010:4.0:1773851847.497921:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000062ec508f.
00000100:00000001:28.0:1773851847.497922:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851847.497922:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000400:00000200:22.0:1773851847.497922:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:18.0:1773851847.497922:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:4.0:1773851847.497922:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851847.497923:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851847.497923:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851847.497923:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851847.497923:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1740
00000400:00000200:6.0:1773851847.497923:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c448bd40
00000400:00000010:6.0:1773851847.497923:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c448bd40.
00000100:00000200:4.0:1773851847.497923:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851847.497924:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:22.0:1773851847.497924:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:18.0:1773851847.497924:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:22.0:1773851847.497925:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000001:6.0:1773851847.497925:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:22.0:1773851847.497926:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851847.497926:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f01b1 [1] + 224
00000100:00000200:6.0:1773851847.497926:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851847.497927:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851847.497927:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:22.0:1773851847.497927:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1780
00000100:00000200:4.0:1773851847.497927:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851847.497928:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851847.497928:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:22.0:1773851847.497928:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:18.0:1773851847.497929:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:4.0:1773851847.497929:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851847.497929:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:28.0:1773851847.497930:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097664 blocks, 31192443712 free, 31192392896 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238816 files, 2962368311 free files
00000400:00000200:22.0:1773851847.497930:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d00b5 [1] + 224
00000400:00000200:18.0:1773851847.497930:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851847.497930:0:41066:0:(client.c:1428:after_reply()) Process entered
00000004:00000001:28.0:1773851847.497931:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.497931:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:4.0:1773851847.497931:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851847.497931:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:31.0:1773851847.497932:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851847.497932:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:18.0:1773851847.497932:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000100:00000040:6.0:1773851847.497932:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851847.497932:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851847.497933:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:18.0:1773851847.497933:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:4.0:1773851847.497933:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851847.497933:0:41066:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=80 v=66 (66 66 66 66)
00000400:00000200:22.0:1773851847.497934:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:28.0:1773851847.497935:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f6ba6e11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051920064:13@kfi7:41:default-yuba2-0
00000100:00000200:18.0:1773851847.497935:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:4.0:1773851847.497935:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=80 v=66 (1 1 1 1)
00000400:00000200:22.0:1773851847.497936:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000100:00000001:4.0:1773851847.497936:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851847.497936:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851847.497937:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851847.497937:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:22.0:1773851847.497937:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851847.497937:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.497937:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00010000:00000001:4.0:1773851847.497937:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:28.0:1773851847.497938:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f6ba6e11 x1859433051920064/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:18.0:1773851847.497938:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:4.0:1773851847.497938:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.497939:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:22.0:1773851847.497939:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851847.497939:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:4.0:1773851847.497939:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851847.497939:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:11.0:1773851847.497940:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851847.497940:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851847.497940:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851847.497941:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851847.497941:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851847.497941:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:31.0:1773851847.497942:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
02000000:00000010:28.0:1773851847.497942:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000c1da22c5.
00000100:00000040:22.0:1773851847.497942:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:18.0:1773851847.497942:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:11.0:1773851847.497942:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:6.0:1773851847.497942:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000100:00000040:4.0:1773851847.497942:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:28.0:1773851847.497943:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851847.497943:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851847.497943:0:41088:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000400:00000200:18.0:1773851847.497943:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000001:11.0:1773851847.497943:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000020:00000001:28.0:1773851847.497944:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000010:11.0:1773851847.497944:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000100:00000001:8.0:1773851847.497944:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851847.497944:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:31.0:1773851847.497945:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d80c8618: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000010:28.0:1773851847.497945:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000040d06717.
02000000:00000001:28.0:1773851847.497945:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000800:00000200:18.0:1773851847.497945:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:11.0:1773851847.497945:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000400:00000010:11.0:1773851847.497945:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000400:00000001:8.0:1773851847.497945:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:4.0:1773851847.497945:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:28.0:1773851847.497946:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851847.497946:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f6ba6e11.
00000100:00000001:11.0:1773851847.497946:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:8.0:1773851847.497946:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:4.0:1773851847.497946:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851847.497946:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851847.497947:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000200:11.0:1773851847.497947:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:8.0:1773851847.497947:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000004:00000001:4.0:1773851847.497947:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851847.497948:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851847.497948:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:8.0:1773851847.497948:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a36d61ab
00000400:00000010:8.0:1773851847.497948:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a36d61ab.
00000004:00000040:4.0:1773851847.497948:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000100:00000001:28.0:1773851847.497949:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851847.497949:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.497949:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851847.497949:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000040:4.0:1773851847.497949:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500133376 avail=351498078208 avail_mb=1373039368 hwm_mb=3131103 files=372097839 ffree=343261849 state=0: rc = 0
00000100:00000001:28.0:1773851847.497950:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851847.497950:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851847.497950:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000200:11.0:1773851847.497950:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851847.497950:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:4.0:1773851847.497951:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500133376 free, 351498078208 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097839 files, 343261849 free files
00000100:00000001:29.0:1773851847.497952:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851847.497952:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:22.0:1773851847.497952:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000004:00000001:4.0:1773851847.497952:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.497953:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851847.497953:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:8.0:1773851847.497953:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851847.497953:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:29.0:1773851847.497954:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851847.497954:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:11.0:1773851847.497954:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851847.497954:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:11.0:1773851847.497955:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:29.0:1773851847.497956:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000027eae465.
00000100:00000001:11.0:1773851847.497956:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497956:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851847.497956:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:4.0:1773851847.497956:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073d0c946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051920320:36@kfi7:13:default-yuba2-0
00000400:00000200:29.0:1773851847.497957:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ecffec9b
00000400:00000010:29.0:1773851847.497957:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ecffec9b.
02000000:00000001:11.0:1773851847.497957:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497957:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851847.497957:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:11.0:1773851847.497958:0:41070:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=80 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851847.497958:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851847.497958:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497958:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851847.497959:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:29.0:1773851847.497959:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:11.0:1773851847.497959:0:41070:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=80 v=66 (1 1 1 1)
02000000:00000001:8.0:1773851847.497959:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497959:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851847.497959:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000073d0c946 x1859433051920320/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:31.0:1773851847.497960:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851847.497960:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:29.0:1773851847.497960:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851847.497960:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00001000:8.0:1773851847.497960:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=80 v=66 (66 66 66 66)
00000800:00000200:30.0:1773851847.497961:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:11.0:1773851847.497961:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851847.497961:0:41071:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=80 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851847.497961:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000800:00000200:31.0:1773851847.497962:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00010000:00000001:11.0:1773851847.497962:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:11.0:1773851847.497962:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497962:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497962:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851847.497962:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851847.497963:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00010000:00000001:8.0:1773851847.497963:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851847.497963:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851847.497963:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008c84125c.
00000800:00000200:31.0:1773851847.497964:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851847.497964:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:11.0:1773851847.497964:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000001:11.0:1773851847.497964:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851847.497964:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:4.0:1773851847.497964:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000200:29.0:1773851847.497965:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851847.497965:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.497965:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000001:8.0:1773851847.497965:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000020:00000001:4.0:1773851847.497965:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851847.497965:0:41066:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000400:00000200:30.0:1773851847.497966:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000040:11.0:1773851847.497966:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851847.497966:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851847.497966:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851847.497966:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000f17f2b52.
00000400:00000200:30.0:1773851847.497967:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2074@kfi7 : PUT - for me
00000100:00000040:8.0:1773851847.497967:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:4.0:1773851847.497967:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000800:00000200:31.0:1773851847.497968:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851847.497968:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
02000000:00000001:4.0:1773851847.497968:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851847.497968:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000073d0c946.
00000400:00000200:30.0:1773851847.497969:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000100:00000001:29.0:1773851847.497969:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851847.497969:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851847.497969:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851847.497969:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851847.497969:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851847.497970:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851847.497970:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.497970:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851847.497970:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851847.497970:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851847.497970:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851847.497971:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:30.0:1773851847.497971:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:29.0:1773851847.497971:0:41089:0:(client.c:1428:after_reply()) Process entered
00000004:00000001:11.0:1773851847.497971:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:8.0:1773851847.497971:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851847.497971:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:30.0:1773851847.497972:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
02000000:00000001:29.0:1773851847.497972:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000040:11.0:1773851847.497972:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851847.497972:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851847.497972:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504311296 avail=351502151680 avail_mb=1373055280 hwm_mb=3131103 files=372056293 ffree=343265929 state=0: rc = 0
00000100:00000001:4.0:1773851847.497972:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851847.497972:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851847.497973:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:29.0:1773851847.497973:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000040:11.0:1773851847.497973:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690109952 avail=351687655424 avail_mb=1373779904 hwm_mb=3131103 files=372231313 ffree=343447373 state=0: rc = 0
00000100:00000001:4.0:1773851847.497973:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851847.497974:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:29.0:1773851847.497974:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:8.0:1773851847.497974:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504311296 free, 351502151680 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056293 files, 343265929 free files
00000400:00000200:31.0:1773851847.497975:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000400:00000200:30.0:1773851847.497975:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1840
02000000:00000001:29.0:1773851847.497975:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:11.0:1773851847.497975:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690109952 free, 351687655424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231313 files, 343447373 free files
00000100:00001000:29.0:1773851847.497976:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=80 v=66 (66 66 66 66)
00000004:00000001:11.0:1773851847.497976:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851847.497976:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851847.497977:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000040:11.0:1773851847.497977:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851847.497977:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:31.0:1773851847.497978:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00001000:29.0:1773851847.497978:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=80 v=66 (1 1 1 1)
00000400:00000200:30.0:1773851847.497979:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78007f4fd [1] + 224
00000400:00000200:31.0:1773851847.497980:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000100:00000001:29.0:1773851847.497980:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00100000:11.0:1773851847.497980:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000094637c7a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051920128:37@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851847.497980:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003a8d1543 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051920192:2060@kfi7:13:default-yuba2-0
00000800:00000200:30.0:1773851847.497981:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:29.0:1773851847.497981:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851847.497982:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00010000:00000001:29.0:1773851847.497982:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:11.0:1773851847.497982:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.497982:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851847.497983:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:30.0:1773851847.497983:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:29.0:1773851847.497983:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.497983:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851847.497983:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000094637c7a x1859433051920128/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851847.497983:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851847.497983:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003a8d1543 x1859433051920192/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:31.0:1773851847.497984:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:30.0:1773851847.497984:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000100:00000001:30.0:1773851847.497985:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851847.497985:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:31.0:1773851847.497986:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:29.0:1773851847.497986:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000100:00000001:11.0:1773851847.497986:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:8.0:1773851847.497986:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000200:31.0:1773851847.497987:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1800
00000100:00000200:30.0:1773851847.497987:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851847.497987:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851847.497987:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851847.497987:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:11.0:1773851847.497987:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ad96937e.
02000000:00000001:8.0:1773851847.497987:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851847.497987:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000521610c6.
02000000:00000001:11.0:1773851847.497988:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:8.0:1773851847.497988:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000400:00000200:31.0:1773851847.497989:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:29.0:1773851847.497989:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:11.0:1773851847.497989:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851847.497989:0:41070:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000020:00000001:8.0:1773851847.497989:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851847.497989:0:41071:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000100:00000040:30.0:1773851847.497990:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:11.0:1773851847.497990:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:8.0:1773851847.497990:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000200:31.0:1773851847.497991:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x78007f53d [1] + 224
02000000:00000010:11.0:1773851847.497991:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000060c86190.
02000000:00000010:8.0:1773851847.497991:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
02000000:00000001:11.0:1773851847.497992:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851847.497992:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851847.497992:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:29.0:1773851847.497993:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:11.0:1773851847.497993:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851847.497993:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094637c7a.
00000100:00000010:8.0:1773851847.497993:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003a8d1543.
00000800:00000200:31.0:1773851847.497994:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:30.0:1773851847.497994:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851847.497994:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851847.497994:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.497994:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851847.497994:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851847.497995:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:29.0:1773851847.497995:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851847.497995:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.497995:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851847.497996:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851847.497996:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851847.497996:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851847.497996:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851847.497996:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851847.497997:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000001:29.0:1773851847.497997:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:11.0:1773851847.497997:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.497997:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851847.497997:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851847.497997:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851847.497997:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:31.0:1773851847.497998:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000004:00000040:29.0:1773851847.497998:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000100:00000001:11.0:1773851847.497998:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.497998:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:29.0:1773851847.497999:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351187456 avail=351348413440 avail_mb=1372454740 hwm_mb=3131103 files=372084118 ffree=343116394 state=0: rc = 0
00000400:00000001:6.0:1773851847.497999:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851847.498000:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:6.0:1773851847.498001:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851847.498002:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009150aefe
00000004:00000020:29.0:1773851847.498003:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351187456 free, 351348413440 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372084118 files, 343116394 free files
00000400:00000010:6.0:1773851847.498003:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009150aefe.
00000100:00000001:6.0:1773851847.498004:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851847.498005:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:29.0:1773851847.498006:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851847.498006:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851847.498007:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851847.498008:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:6.0:1773851847.498011:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:29.0:1773851847.498012:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182ebf41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051920256:60@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851847.498015:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851847.498015:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:31.0:1773851847.498016:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851847.498016:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851847.498016:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:29.0:1773851847.498017:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000182ebf41 x1859433051920256/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851847.498017:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851847.498018:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851847.498019:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851847.498020:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.498021:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851847.498021:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.498022:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:29.0:1773851847.498022:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:31.0:1773851847.498023:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
02000000:00000010:29.0:1773851847.498023:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004b536c60.
00000100:00001000:6.0:1773851847.498023:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=80 v=66 (66 66 66 66)
02000000:00000001:29.0:1773851847.498025:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851847.498025:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:7.0:1773851847.498025:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:6.0:1773851847.498025:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=80 v=66 (1 1 1 1)
00000800:00000200:31.0:1773851847.498026:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000020:00000040:29.0:1773851847.498026:0:41089:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00000001:7.0:1773851847.498026:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851847.498026:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000020:00000001:29.0:1773851847.498027:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000001:7.0:1773851847.498027:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
02000000:00000010:29.0:1773851847.498028:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000addde0c.
00000400:00000001:7.0:1773851847.498028:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:6.0:1773851847.498028:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851847.498029:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:6.0:1773851847.498029:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:7.0:1773851847.498030:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d561f1e3.
00010000:00000001:6.0:1773851847.498030:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851847.498031:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851847.498031:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000182ebf41.
00000400:00000200:7.0:1773851847.498031:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d794ea
00000100:00000001:6.0:1773851847.498031:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000010:7.0:1773851847.498032:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d794ea.
00000100:00000040:6.0:1773851847.498032:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00000001:29.0:1773851847.498033:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851847.498033:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851847.498033:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851847.498033:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851847.498033:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.498034:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:7.0:1773851847.498035:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851847.498035:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851847.498036:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851847.498036:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.498037:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851847.498038:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.498039:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:7.0:1773851847.498040:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851847.498041:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851847.498042:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851847.498043:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:7.0:1773851847.498044:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000020:6.0:1773851847.498044:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223712 blocks, 31250857344 free, 31250814976 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121418 files, 2868731045 free files
00000100:00000001:7.0:1773851847.498045:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851847.498046:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851847.498047:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000001:6.0:1773851847.498047:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851847.498048:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851847.498049:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.498049:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851847.498050:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851847.498052:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=80 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851847.498054:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=80 v=66 (1 1 1 1)
00000100:00100000:6.0:1773851847.498054:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffbbbda4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051920448:2074@kfi7:41:default-yuba2-0
00000100:00000001:7.0:1773851847.498056:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851847.498056:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.498056:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851847.498057:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:6.0:1773851847.498057:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00010000:00000001:7.0:1773851847.498058:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.498058:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ffbbbda4 x1859433051920448/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851847.498060:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851847.498061:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:7.0:1773851847.498062:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851847.498062:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.498063:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851847.498063:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:7.0:1773851847.498064:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:6.0:1773851847.498064:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a2ebc3d3.
02000000:00000001:6.0:1773851847.498066:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851847.498067:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851847.498068:0:41064:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000001:7.0:1773851847.498069:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:6.0:1773851847.498069:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851847.498070:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000010:6.0:1773851847.498070:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ed33a1f5.
00000100:00000001:7.0:1773851847.498071:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:6.0:1773851847.498071:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000001:7.0:1773851847.498072:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:6.0:1773851847.498072:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000004:00000040:7.0:1773851847.498073:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000100:00000010:6.0:1773851847.498073:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ffbbbda4.
00000004:00000040:7.0:1773851847.498074:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399726592 free=351492797440 avail=351490404352 avail_mb=1373009392 hwm_mb=3131103 files=372078206 ffree=343254685 state=0: rc = 0
00000100:00000001:6.0:1773851847.498075:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851847.498075:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851847.498076:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851847.498077:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000020:7.0:1773851847.498078:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399726592 blocks, 351492797440 free, 351490404352 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372078206 files, 343254685 free files
00000100:00000001:6.0:1773851847.498078:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.498079:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851847.498080:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851847.498081:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851847.498083:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851847.498088:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c88ff90f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051920384:2061@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851847.498091:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851847.498092:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851847.498093:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c88ff90f x1859433051920384/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852000 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851847.498097:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851847.498098:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851847.498099:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000aafb7691.
02000000:00000001:7.0:1773851847.498101:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851847.498102:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851847.498102:0:41067:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000020:00000001:7.0:1773851847.498103:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851847.498104:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ef164abb.
02000000:00000001:7.0:1773851847.498106:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851847.498106:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851847.498107:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c88ff90f.
00000100:00000001:7.0:1773851847.498108:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851847.498109:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851847.498110:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851847.498111:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851847.498112:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851847.498113:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851847.498113:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851847.513816:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.513816:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851847.513817:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851847.513817:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851847.513819:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851847.513819:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851847.513821:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20273@kfi7(0000000055665df5):0x113d version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851847.513822:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851847.513823:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d Using peer 20273@kfi7(0x10000000000113d)
00000400:00000200:10.0:1773851847.513824:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:10.0:1773851847.513825:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20273@kfi7 : PUT - for me
00000400:00000200:9.0:1773851847.513825:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:10.0:1773851847.513827:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:10.0:1773851847.513827:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 1
00000800:00000200:9.0:1773851847.513827:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x10000000000113d: rc=0
00000800:00000200:9.0:1773851847.513828:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851847.513829:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:10.0:1773851847.513830:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000400:00000200:10.0:1773851847.513831:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 3
00000400:00000200:10.0:1773851847.513832:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20272@kfi7 to cpt 7
00000400:00000200:10.0:1773851847.513833:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20272@kfi7 of length 224 into portal 12 MB=0x699e0f377d880
00000400:00000200:10.0:1773851847.513835:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20272@kfi7 of length 224/224 into md 0x78146ce49 [64] + 112496
00000800:00000200:10.0:1773851847.513837:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851847.513841:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851847.513841:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851847.513843:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20273@kfi7: PUT: OK
00000800:00000200:9.0:1773851847.513843:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d Transaction freed
00000100:00000001:10.0:1773851847.513844:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851847.513844:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851847.513845:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a69063a2.
00000100:00000040:10.0:1773851847.513846:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000a69063a2 x1858041296705664 msgsize 224
00000100:00100000:10.0:1773851847.513848:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20272@kfi7 (source: 12345-20273@kfi7)
00000100:00000001:10.0:1773851847.513849:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851847.513850:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000100:00000001:9.0:1773851847.513850:0:41171:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851847.513850:0:41171:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851847.513851:0:41171:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851847.513851:0:41171:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851847.513852:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:9.0:1773851847.513852:0:41171:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851847.513853:0:41171:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041296705664
00000020:00000001:9.0:1773851847.513853:0:41171:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851847.513854:0:41171:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92657
00000020:00000001:9.0:1773851847.513854:0:41171:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851847.513859:0:41171:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028465c05 refcount=6
00000020:00000001:9.0:1773851847.513860:0:41171:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631018496 : -107123078533120 : ffff9e9276f4f000)
00000020:00000001:9.0:1773851847.513860:0:41171:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631018496 : -107123078533120 : ffff9e9276f4f000)
00000100:00000001:9.0:1773851847.513861:0:41171:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851847.513862:0:41171:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851847.513863:0:41171:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004830a15b.
00000020:00000010:9.0:1773851847.513864:0:41171:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851847.513865:0:41171:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b4e7bb2.
00000100:00000001:9.0:1773851847.513865:0:41171:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851847.513866:0:41171:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851847.513867:0:41171:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851847.513868:0:41171:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851847.513868:0:41171:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851847.513869:0:41171:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851847.513870:0:41171:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851847.513871:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851847.513871:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851847.513871:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:9.0:1773851847.513872:0:41171:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20272@kfi7, seq: 2130697
00000100:00000001:8.0:1773851847.513872:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:9.0:1773851847.513873:0:41171:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000028465c05 : new rpc_count 1
00000100:00000001:8.0:1773851847.513873:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851847.513874:0:41171:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077424640 : -106968632126976 : ffff9eb66cae1200)
00000100:00000001:8.0:1773851847.513874:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851847.513875:0:41171:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a69063a2 x1858041296705664/t0(0) o400->75768b65-6687-46ef-a350-12c4b47d1494@20272@kfi7:635/0 lens 224/0 e 0 to 0 dl 1773851995 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1757-0'
00000100:00000001:9.0:1773851847.513878:0:41171:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851847.513878:0:41171:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851847.513879:0:41171:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a69063a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_002:75768b65-6687-46ef-a350-12c4b47d1494+6:39853:x1858041296705664:12345-20272@kfi7:400:default-tuolumne1757-0
00000100:00000200:9.0:1773851847.513881:0:41171:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041296705664
00000020:00000001:9.0:1773851847.513882:0:41171:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851847.513883:0:41171:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851847.513883:0:41171:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851847.513884:0:41171:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851847.513884:0:41171:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851847.513885:0:41171:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851847.513886:0:41171:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041296705664, found 0 last_xid 1858041296705663
00000020:00000001:9.0:1773851847.513887:0:41171:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851847.513887:0:41171:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851847.513888:0:41171:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851847.513888:0:41171:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851847.513889:0:41171:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851847.513890:0:41171:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851847.513890:0:41171:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851847.513891:0:41171:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a652557e.
02000000:00000001:9.0:1773851847.513891:0:41171:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851847.513892:0:41171:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851847.513893:0:41171:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851847.513894:0:41171:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183196369378, transno 0, xid 1858041296705664
00010000:00000001:9.0:1773851847.513895:0:41171:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851847.513895:0:41171:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a69063a2 x1858041296705664/t0(0) o400->75768b65-6687-46ef-a350-12c4b47d1494@20272@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1757-0'
00010000:00000001:9.0:1773851847.513898:0:41171:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851847.513898:0:41171:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851847.513899:0:41171:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=80 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851847.513900:0:41171:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851847.513901:0:41171:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d2db579c refcount 3 to 20272@kfi7
00000100:00000001:9.0:1773851847.513902:0:41171:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805888 : -107130477745728 : ffff9e90bdede9c0)
02000000:00000001:9.0:1773851847.513902:0:41171:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851847.513903:0:41171:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851847.513904:0:41171:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851847.513905:0:41171:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20273@kfi7
00000400:00000010:9.0:1773851847.513905:0:41171:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000100:00000200:9.0:1773851847.513906:0:41171:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041296705664, offset 224
00000400:00000200:9.0:1773851847.513907:0:41171:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20273@kfi7
00000400:00000200:9.0:1773851847.513908:0:41171:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.513909:0:41171:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 1
00000400:00000200:9.0:1773851847.513910:0:41171:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000400:00000200:9.0:1773851847.513912:0:41171:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 3
00000400:00000200:9.0:1773851847.513913:0:41171:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20273@kfi7 local destination
00000400:00000200:9.0:1773851847.513914:0:41171:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768348:8768348:1024:4294967295] 20273@kfi7 LPNI seq info [310732:310732:16:4294967295]
00000400:00000200:9.0:1773851847.513916:0:41171:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000400:00000200:9.0:1773851847.513916:0:41171:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.513919:0:41171:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20273@kfi7(20273@kfi7:20273@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851847.513920:0:41171:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 3
00000800:00000200:9.0:1773851847.513921:0:41171:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.513922:0:41171:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851847.513924:0:41171:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851847.513929:0:41171:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d Using peer 20273@kfi7(0x10000000000113d)
00000800:00000200:9.0:1773851847.513931:0:41171:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x10000000000113d: rc=0
00000800:00000200:9.0:1773851847.513933:0:41171:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851847.513935:0:41171:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851847.513936:0:41171:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d2db579c refcount 2 to 20272@kfi7
00010000:00000001:9.0:1773851847.513937:0:41171:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851847.513937:0:41171:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851847.513938:0:41171:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851847.513938:0:41171:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a69063a2 x1858041296705664/t0(0) o400->75768b65-6687-46ef-a350-12c4b47d1494@20272@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1757-0'
00000100:00100000:9.0:1773851847.513941:0:41171:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a69063a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_002:75768b65-6687-46ef-a350-12c4b47d1494+6:39853:x1858041296705664:12345-20272@kfi7:400:default-tuolumne1757-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851847.513944:0:41171:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20272@kfi7, seq: 2130697
00000100:00000040:9.0:1773851847.513944:0:41171:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028465c05 : new rpc_count 0
00000800:00000200:11.0:1773851847.513945:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851847.513945:0:41171:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851847.513946:0:41171:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851847.513946:0:41171:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:11.0:1773851847.513947:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851847.513947:0:41171:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b4e7bb2.
00000020:00000010:9.0:1773851847.513948:0:41171:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004830a15b.
00000020:00000040:9.0:1773851847.513948:0:41171:0:(genops.c:882:class_export_put()) PUTting export 0000000028465c05 : new refcount 5
00000400:00000200:11.0:1773851847.513949:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20273@kfi7: PUT: OK
00000100:00000001:9.0:1773851847.513949:0:41171:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:11.0:1773851847.513950:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000400:00000010:11.0:1773851847.513950:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:11.0:1773851847.513951:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851847.513951:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851847.513952:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000800:00000200:11.0:1773851847.513954:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 20273@kfi7(0000000055665df5):0x0 lsk 4414 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000113d Transaction freed
00000800:00000200:25.0:1773851847.515759:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851847.515759:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851847.515761:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851847.515762:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851847.515764:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.515765:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25251@kfi7 : PUT - for me
00000400:00000200:25.0:1773851847.515766:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.515767:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 1
00000400:00000200:25.0:1773851847.515768:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.515768:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000400:00000200:25.0:1773851847.515769:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 3
00000400:00000200:25.0:1773851847.515769:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25250@kfi7 to cpt 3
00000400:00000200:25.0:1773851847.515770:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25250@kfi7 of length 224 into portal 12 MB=0x69b4c52f19100
00000400:00000200:25.0:1773851847.515772:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25250@kfi7 of length 224/224 into md 0x16159c6179 [64] + 175200
00000800:00000200:25.0:1773851847.515773:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851847.515775:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851847.515775:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25251@kfi7: PUT: OK
00000100:00000001:25.0:1773851847.515776:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851847.515777:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851847.515778:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000799807de.
00000100:00000040:25.0:1773851847.515778:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000799807de x1859601971646720 msgsize 224
00000100:00100000:25.0:1773851847.515780:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-25250@kfi7 (source: 12345-25251@kfi7)
00000100:00000001:25.0:1773851847.515780:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851847.515781:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000100:00000001:24.0:1773851847.515782:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851847.515782:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851847.515783:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851847.515783:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851847.515783:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851847.515784:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851847.515785:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601971646720
00000020:00000001:24.0:1773851847.515785:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851847.515786:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7c835
00000020:00000001:24.0:1773851847.515787:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851847.515788:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077df1929 refcount=5
00000020:00000001:24.0:1773851847.515788:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142647362560 : -106931062189056 : ffff9ebf2c05d400)
00000020:00000001:24.0:1773851847.515789:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142647362560 : -106931062189056 : ffff9ebf2c05d400)
00000100:00000001:24.0:1773851847.515790:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851847.515791:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851847.515792:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042031ddd.
00000020:00000010:24.0:1773851847.515793:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851847.515794:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bc23e3f.
00000100:00000001:24.0:1773851847.515795:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851847.515795:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851847.515796:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851847.515797:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851847.515797:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851847.515798:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.515798:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851847.515800:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851847.515800:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851847.515800:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851847.515800:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851847.515801:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25250@kfi7, seq: 2025025
00000100:00000001:26.0:1773851847.515802:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851847.515802:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077df1929 : new rpc_count 1
00000100:00000001:26.0:1773851847.515803:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.515803:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700642560 : -106953008909056 : ffff9eba0fe57500)
00000100:00000040:24.0:1773851847.515804:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000799807de x1859601971646720/t0(0) o400->e755ee86-706a-4dae-86e4-1329d80d4283@25250@kfi7:33/0 lens 224/0 e 0 to 0 dl 1773852148 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2060-0'
00000100:00000001:24.0:1773851847.515806:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851847.515807:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851847.515808:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000799807de pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:e755ee86-706a-4dae-86e4-1329d80d4283+5:39565:x1859601971646720:12345-25250@kfi7:400:default-tuolumne2060-0
00000100:00000200:24.0:1773851847.515809:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601971646720
00000020:00000001:24.0:1773851847.515810:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851847.515810:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851847.515811:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.515812:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851847.515812:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851847.515814:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851847.515815:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601971646720, found 0 last_xid 1859601971646719
00000020:00000001:24.0:1773851847.515816:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851847.515816:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851847.515817:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851847.515817:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.515818:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851847.515818:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851847.515819:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851847.515820:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000a162df5.
02000000:00000001:24.0:1773851847.515820:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.515821:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.515822:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851847.515822:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824564, transno 0, xid 1859601971646720
00010000:00000001:24.0:1773851847.515823:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851847.515824:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000799807de x1859601971646720/t0(0) o400->e755ee86-706a-4dae-86e4-1329d80d4283@25250@kfi7:33/0 lens 224/224 e 0 to 0 dl 1773852148 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2060-0'
00010000:00000001:24.0:1773851847.515826:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851847.515827:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851847.515828:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=80 v=288 (288 212 1 1)
00000100:00000001:24.0:1773851847.515829:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851847.515830:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000281813b7 refcount 3 to 25250@kfi7
00000100:00000001:24.0:1773851847.515830:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149920 : -107154898401696 : ffff9e8b0e584660)
02000000:00000001:24.0:1773851847.515831:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851847.515832:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.515832:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851847.515833:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25251@kfi7
00000400:00000010:24.0:1773851847.515834:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007c583f63.
00000100:00000200:24.0:1773851847.515835:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601971646720, offset 224
00000400:00000200:24.0:1773851847.515836:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25251@kfi7
00000400:00000200:24.0:1773851847.515837:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:24.0:1773851847.515838:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 1
00000400:00000200:24.0:1773851847.515839:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000400:00000200:24.0:1773851847.515840:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 3
00000400:00000200:24.0:1773851847.515841:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25251@kfi7 local destination
00000400:00000200:24.0:1773851847.515843:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768349:8768349:1024:4294967295] 25251@kfi7 LPNI seq info [1058367:1058367:16:4294967295]
00000400:00000200:24.0:1773851847.515844:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000400:00000200:24.0:1773851847.515845:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:24.0:1773851847.515847:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25251@kfi7(25251@kfi7:25251@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851847.515848:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 3
00000800:00000200:24.0:1773851847.515849:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851847.515850:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851847.515852:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851847.515855:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeb2 Using peer 25251@kfi7(0xeb2)
00000800:00000200:24.0:1773851847.515858:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0xeb2: rc=0
00000800:00000200:24.0:1773851847.515859:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeb2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851847.515862:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851847.515862:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000281813b7 refcount 2 to 25250@kfi7
00010000:00000001:24.0:1773851847.515863:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851847.515864:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.515864:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851847.515865:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000799807de x1859601971646720/t0(0) o400->e755ee86-706a-4dae-86e4-1329d80d4283@25250@kfi7:33/0 lens 224/224 e 0 to 0 dl 1773852148 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2060-0'
00000100:00100000:24.0:1773851847.515869:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000799807de pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:e755ee86-706a-4dae-86e4-1329d80d4283+5:39565:x1859601971646720:12345-25250@kfi7:400:default-tuolumne2060-0 Request processed in 62us (90us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851847.515872:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25250@kfi7, seq: 2025025
00000100:00000040:24.0:1773851847.515872:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077df1929 : new rpc_count 0
00000100:00000001:24.0:1773851847.515873:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851847.515873:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851847.515875:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851847.515875:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bc23e3f.
00000020:00000010:24.0:1773851847.515876:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042031ddd.
00000020:00000040:24.0:1773851847.515877:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000077df1929 : new refcount 4
00000100:00000001:24.0:1773851847.515878:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851847.515882:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeb2 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851847.515885:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851847.515886:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25251@kfi7: PUT: OK
00000400:00000200:25.0:1773851847.515887:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007c583f63
00000400:00000010:25.0:1773851847.515888:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007c583f63.
00000100:00000001:25.0:1773851847.515888:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851847.515889:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851847.515889:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000800:00000200:25.0:1773851847.515891:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25251@kfi7(00000000accc08b3):0x0 lsk 3763 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeb2 Transaction freed
00000400:00000200:29.0:1773851847.561734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851847.561735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:29.0:1773851847.611446:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.611447:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851847.611448:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851847.611450:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851847.611452:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21264@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.611453:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21264@kfi7 : PUT - for me
00000400:00000200:29.0:1773851847.611454:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21264@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.611455:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b535fbd6 nid 21264@kfi7 refs 1
00000400:00000200:29.0:1773851847.611457:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21264@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.611457:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b535fbd6 nid 21264@kfi7 refs 2
00000400:00000200:29.0:1773851847.611458:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b535fbd6 nid 21264@kfi7 refs 3
00000400:00000200:29.0:1773851847.611459:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21264@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.611460:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21264@kfi7 of length 224 into portal 12 MB=0x69a9e054d9200
00000400:00000200:29.0:1773851847.611461:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21264@kfi7 of length 224/224 into md 0x77fe139dd [64] + 153800
00000800:00000200:29.0:1773851847.611464:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851847.611465:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851847.611466:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21264@kfi7: PUT: OK
00000100:00000001:29.0:1773851847.611467:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851847.611468:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851847.611472:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000305b24f2.
00000100:00000040:29.0:1773851847.611472:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000305b24f2 x1858853344743936 msgsize 224
00000100:00100000:29.0:1773851847.611474:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21264@kfi7 (source: 12345-21264@kfi7)
00000100:00000001:29.0:1773851847.611474:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851847.611475:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b535fbd6 nid 21264@kfi7 refs 2
00000100:00000001:31.0:1773851847.611477:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851847.611477:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851847.611478:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851847.611479:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851847.611479:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851847.611480:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851847.611480:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858853344743936
00000020:00000001:31.0:1773851847.611481:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851847.611482:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918c7
00000020:00000001:31.0:1773851847.611482:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851847.611486:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f7a2a9f refcount=642
00000020:00000001:31.0:1773851847.611486:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241989120 : -107152467562496 : ffff9e8b9f3bf000)
00000020:00000001:31.0:1773851847.611487:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241989120 : -107152467562496 : ffff9e8b9f3bf000)
00000100:00000001:31.0:1773851847.611488:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851847.611489:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851847.611490:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851847.611491:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851847.611492:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851847.611493:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851847.611494:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851847.611494:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851847.611496:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851847.611496:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851847.611497:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.611498:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851847.611499:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851847.611500:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851847.611500:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851847.611500:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851847.611501:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21264@kfi7, seq: 2055435
00000100:00000040:31.0:1773851847.611502:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f7a2a9f : new rpc_count 8
00000100:00000001:29.0:1773851847.611502:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.611503:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121925256832 : -106951784294784 : ffff9eba58e39680)
00000100:00000001:29.0:1773851847.611503:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851847.611504:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000305b24f2 x1858853344743936/t0(0) o400->628ab049-f83e-430f-963a-928b8c6224b2@21264@kfi7:635/0 lens 224/0 e 0 to 0 dl 1773851995 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1825-0'
00000100:00000001:31.0:1773851847.611506:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851847.611506:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851847.611507:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000305b24f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:628ab049-f83e-430f-963a-928b8c6224b2+642:39852:x1858853344743936:12345-21264@kfi7:400:default-tuolumne1825-0
00000100:00000200:31.0:1773851847.611509:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858853344743936
00000020:00000001:31.0:1773851847.611510:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851847.611510:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851847.611511:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.611512:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851847.611512:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851847.611513:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851847.611514:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858853344743936, found 0 last_xid 1858853306708543
00000020:00000001:31.0:1773851847.611515:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851847.611516:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851847.611516:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851847.611517:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.611517:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851847.611518:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851847.611519:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851847.611519:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ccdcdd1e.
02000000:00000001:31.0:1773851847.611520:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.611520:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.611521:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851847.611522:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264570088, transno 0, xid 1858853344743936
00010000:00000001:31.0:1773851847.611522:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851847.611523:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000305b24f2 x1858853344743936/t0(0) o400->628ab049-f83e-430f-963a-928b8c6224b2@21264@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1825-0'
00010000:00000001:31.0:1773851847.611525:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851847.611526:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851847.611527:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=80 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851847.611528:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851847.611529:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000827f918 refcount 3 to 21264@kfi7
00000100:00000001:31.0:1773851847.611529:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271104 : -107152618280512 : ffff9e8b964029c0)
02000000:00000001:31.0:1773851847.611530:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851847.611530:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.611531:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851847.611532:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21264@kfi7
00000400:00000010:31.0:1773851847.611532:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d658250.
00000100:00000200:31.0:1773851847.611533:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858853344743936, offset 224
00000400:00000200:31.0:1773851847.611535:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21264@kfi7
00000400:00000200:31.0:1773851847.611535:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21264@kfi7 to cpt 7
00000400:00000200:31.0:1773851847.611536:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b535fbd6 nid 21264@kfi7 refs 1
00000400:00000200:31.0:1773851847.611537:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b535fbd6 nid 21264@kfi7 refs 2
00000400:00000200:31.0:1773851847.611538:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b535fbd6 nid 21264@kfi7 refs 3
00000400:00000200:31.0:1773851847.611539:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21264@kfi7 local destination
00000400:00000200:31.0:1773851847.611540:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768350:8768350:1024:4294967295] 21264@kfi7 LPNI seq info [3604954:3604954:16:4294967295]
00000400:00000200:31.0:1773851847.611542:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b535fbd6 nid 21264@kfi7 refs 2
00000400:00000200:31.0:1773851847.611542:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21264@kfi7 to cpt 7
00000400:00000200:31.0:1773851847.611544:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21264@kfi7(21264@kfi7:21264@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851847.611545:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b535fbd6 nid 21264@kfi7 refs 3
00000800:00000200:31.0:1773851847.611546:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851847.611547:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851847.611549:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851847.611551:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6da Using peer 21264@kfi7(0x6da)
00000800:00000200:31.0:1773851847.611554:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x6da: rc=0
00000800:00000200:31.0:1773851847.611556:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6da TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851847.611559:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851847.611560:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000827f918 refcount 2 to 21264@kfi7
00010000:00000001:31.0:1773851847.611561:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851847.611561:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851847.611562:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851847.611562:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000305b24f2 x1858853344743936/t0(0) o400->628ab049-f83e-430f-963a-928b8c6224b2@21264@kfi7:635/0 lens 224/224 e 0 to 0 dl 1773851995 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1825-0'
00000100:00100000:31.0:1773851847.611565:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000305b24f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:628ab049-f83e-430f-963a-928b8c6224b2+642:39852:x1858853344743936:12345-21264@kfi7:400:default-tuolumne1825-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851847.611567:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21264@kfi7, seq: 2055435
00000100:00000040:31.0:1773851847.611568:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f7a2a9f : new rpc_count 7
00000100:00000001:31.0:1773851847.611568:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851847.611568:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6da TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851847.611569:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851847.611569:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851847.611569:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851847.611570:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000400:00000200:29.0:1773851847.611570:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21264@kfi7: PUT: OK
00000020:00000010:31.0:1773851847.611571:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000020:00000040:31.0:1773851847.611571:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000004f7a2a9f : new refcount 641
00000400:00000200:29.0:1773851847.611571:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d658250
00000400:00000010:29.0:1773851847.611571:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d658250.
00000100:00000001:31.0:1773851847.611572:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851847.611572:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851847.611572:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851847.611573:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b535fbd6 nid 21264@kfi7 refs 2
00000800:00000200:29.0:1773851847.611574:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 21264@kfi7(0000000062087800):0x0 lsk 1755 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6da Transaction freed
00000800:00000200:21.0:1773851847.626561:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851847.626563:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851847.626565:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851847.626569:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851847.626572:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:21.0:1773851847.626575:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18944@kfi7 : PUT - for me
00000400:00000200:21.0:1773851847.626576:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:21.0:1773851847.626578:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 1
00000400:00000200:21.0:1773851847.626580:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:21.0:1773851847.626581:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000400:00000200:21.0:1773851847.626583:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 3
00000400:00000200:21.0:1773851847.626584:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18945@kfi7 to cpt 0
00000400:00000200:21.0:1773851847.626586:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18945@kfi7 of length 224 into portal 12 MB=0x699e17acc7e00
00000400:00000200:21.0:1773851847.626588:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18945@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 19328
00000800:00000200:21.0:1773851847.626592:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851847.626595:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851847.626597:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18944@kfi7: PUT: OK
00000100:00000001:21.0:1773851847.626599:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851847.626600:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851847.626603:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dfaf3d35.
00000100:00000040:21.0:1773851847.626604:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000dfaf3d35 x1858043567177216 msgsize 224
00000100:00100000:21.0:1773851847.626607:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18945@kfi7 (source: 12345-18944@kfi7)
00000100:00000001:21.0:1773851847.626609:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851847.626610:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000100:00000001:22.0:1773851847.626612:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851847.626613:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851847.626613:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851847.626614:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851847.626614:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851847.626616:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851847.626617:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043567177216
00000020:00000001:22.0:1773851847.626618:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851847.626619:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924ac
00000020:00000001:22.0:1773851847.626620:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851847.626623:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000270be7a1 refcount=6
00000020:00000001:22.0:1773851847.626625:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630505472 : -107123079046144 : ffff9e9276ed1c00)
00000020:00000001:22.0:1773851847.626626:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630505472 : -107123079046144 : ffff9e9276ed1c00)
00000100:00000001:22.0:1773851847.626628:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851847.626629:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851847.626630:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000247a55a4.
00000020:00000010:22.0:1773851847.626632:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851847.626633:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d08ac1b6.
00000100:00000001:22.0:1773851847.626634:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851847.626635:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851847.626636:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851847.626638:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851847.626639:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851847.626640:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.626641:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851847.626644:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851847.626644:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851847.626644:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851847.626645:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851847.626646:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18945@kfi7, seq: 1997907
00000100:00000001:23.0:1773851847.626648:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851847.626648:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000270be7a1 : new rpc_count 1
00000100:00000001:23.0:1773851847.626649:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.626649:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128597666176 : -106945111885440 : ffff9ebbe6987980)
00000100:00000040:22.0:1773851847.626652:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dfaf3d35 x1858043567177216/t0(0) o400->9b23f4d2-cc78-4d3d-973f-25e64044c0ee@18945@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1683-0'
00000100:00000001:22.0:1773851847.626657:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851847.626658:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851847.626659:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfaf3d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9b23f4d2-cc78-4d3d-973f-25e64044c0ee+6:39622:x1858043567177216:12345-18945@kfi7:400:default-tuolumne1683-0
00000100:00000200:22.0:1773851847.626661:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043567177216
00000020:00000001:22.0:1773851847.626661:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851847.626662:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851847.626663:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.626664:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851847.626664:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851847.626665:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851847.626666:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043567177216, found 0 last_xid 1858043567177215
00000020:00000001:22.0:1773851847.626667:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851847.626668:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851847.626668:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851847.626669:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.626669:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851847.626670:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851847.626671:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851847.626671:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000abf228d3.
02000000:00000001:22.0:1773851847.626672:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.626673:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.626673:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851847.626674:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254665449, transno 0, xid 1858043567177216
00010000:00000001:22.0:1773851847.626675:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851847.626676:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dfaf3d35 x1858043567177216/t0(0) o400->9b23f4d2-cc78-4d3d-973f-25e64044c0ee@18945@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1683-0'
00010000:00000001:22.0:1773851847.626679:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851847.626679:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851847.626680:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=80 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851847.626681:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851847.626682:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000090f06c9 refcount 3 to 18945@kfi7
00000100:00000001:22.0:1773851847.626683:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994449504 : -107149715102112 : ffff9e8c434b2660)
02000000:00000001:22.0:1773851847.626684:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851847.626685:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851847.626685:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851847.626686:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18944@kfi7
00000400:00000010:22.0:1773851847.626687:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088a57373.
00000100:00000200:22.0:1773851847.626688:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043567177216, offset 224
00000400:00000200:22.0:1773851847.626690:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18944@kfi7
00000400:00000200:22.0:1773851847.626691:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:22.0:1773851847.626691:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 1
00000400:00000200:22.0:1773851847.626693:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000400:00000200:22.0:1773851847.626694:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 3
00000400:00000200:22.0:1773851847.626695:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18944@kfi7 local destination
00000400:00000200:22.0:1773851847.626697:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768351:8768351:1024:4294967295] 18944@kfi7 LPNI seq info [20193644:20193644:16:4294967295]
00000400:00000200:22.0:1773851847.626698:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000400:00000200:22.0:1773851847.626699:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:22.0:1773851847.626701:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18944@kfi7(18944@kfi7:18944@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851847.626702:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 3
00000800:00000200:22.0:1773851847.626704:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851847.626705:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851847.626707:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851847.626710:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc9e Using peer 18944@kfi7(0xc9e)
00000800:00000200:22.0:1773851847.626713:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000bfc5a5ad: Posted send of 324 bytes to peer 0xc9e: rc=0
00000800:00000200:22.0:1773851847.626715:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc9e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851847.626717:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851847.626717:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000090f06c9 refcount 2 to 18945@kfi7
00010000:00000001:22.0:1773851847.626719:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851847.626719:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851847.626720:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851847.626721:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dfaf3d35 x1858043567177216/t0(0) o400->9b23f4d2-cc78-4d3d-973f-25e64044c0ee@18945@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1683-0'
00000100:00100000:22.0:1773851847.626724:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfaf3d35 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9b23f4d2-cc78-4d3d-973f-25e64044c0ee+6:39622:x1858043567177216:12345-18945@kfi7:400:default-tuolumne1683-0 Request processed in 66us (119us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851847.626728:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc9e TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851847.626729:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18945@kfi7, seq: 1997907
00000400:00000200:21.0:1773851847.626729:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:22.0:1773851847.626730:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000270be7a1 : new rpc_count 0
00000100:00000001:22.0:1773851847.626730:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851847.626730:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18944@kfi7: PUT: OK
00000400:00000200:21.0:1773851847.626730:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088a57373
00000100:00000001:22.0:1773851847.626731:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851847.626731:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000010:21.0:1773851847.626731:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088a57373.
00000020:00000010:22.0:1773851847.626732:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d08ac1b6.
00000100:00000001:21.0:1773851847.626732:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851847.626732:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851847.626733:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000247a55a4.
00000020:00000040:22.0:1773851847.626733:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000270be7a1 : new refcount 5
00000400:00000200:21.0:1773851847.626733:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000100:00000001:22.0:1773851847.626734:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851847.626734:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 18944@kfi7(000000008c226a28):0x0 lsk 3231 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc9e Transaction freed
00000800:00000200:9.0:1773851847.705187:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851847.705188:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.705188:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851847.705189:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851847.705190:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851847.705190:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851847.705192:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851847.705192:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20705@kfi7(00000000ffd3960b):0x4a8 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851847.705194:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000800:00000200:9.0:1773851847.705194:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 Using peer 20705@kfi7(0x1000000000004a8)
00000400:00000200:10.0:1773851847.705196:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20705@kfi7 : PUT - for me
00000400:00000200:9.0:1773851847.705196:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:10.0:1773851847.705197:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:10.0:1773851847.705197:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 1
00000800:00000200:9.0:1773851847.705197:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000022757302: Posted send of 38 bytes to peer 0x1000000000004a8: rc=0
00000400:00000200:10.0:1773851847.705198:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000800:00000200:9.0:1773851847.705198:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851847.705199:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000400:00000200:10.0:1773851847.705200:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 3
00000400:00000200:10.0:1773851847.705201:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20704@kfi7 to cpt 7
00000400:00000200:10.0:1773851847.705202:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20704@kfi7 of length 224 into portal 12 MB=0x69b17134d1680
00000400:00000200:10.0:1773851847.705203:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20704@kfi7 of length 224/224 into md 0x78146ce49 [64] + 112720
00000800:00000200:10.0:1773851847.705205:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851847.705206:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851847.705208:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20705@kfi7: PUT: OK
00000100:00000001:10.0:1773851847.705209:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851847.705210:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851847.705211:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e117e82f.
00000100:00000040:10.0:1773851847.705212:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000e117e82f x1859373270636160 msgsize 224
00000800:00000200:9.0:1773851847.705213:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851847.705214:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20704@kfi7 (source: 12345-20705@kfi7)
00000100:00000001:10.0:1773851847.705215:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851847.705215:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 Transaction freed
00000400:00000200:10.0:1773851847.705216:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000800:00000200:10.0:1773851847.705217:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851847.705219:0:41171:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851847.705220:0:41171:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851847.705221:0:41171:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851847.705222:0:41171:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851847.705223:0:41171:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851847.705225:0:41171:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373270636160
00000020:00000001:11.0:1773851847.705226:0:41171:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851847.705227:0:41171:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793afc81e6
00000020:00000001:11.0:1773851847.705228:0:41171:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851847.705232:0:41171:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bebf7857 refcount=5
00000020:00000001:11.0:1773851847.705233:0:41171:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934554777600 : -107139154774016 : ffff9e8eb8bcf800)
00000020:00000001:11.0:1773851847.705235:0:41171:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934554777600 : -107139154774016 : ffff9e8eb8bcf800)
00000100:00000001:11.0:1773851847.705237:0:41171:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851847.705238:0:41171:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851847.705240:0:41171:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009503e737.
00000020:00000010:11.0:1773851847.705242:0:41171:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851847.705243:0:41171:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006b5320cf.
00000100:00000001:11.0:1773851847.705245:0:41171:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851847.705246:0:41171:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851847.705247:0:41171:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851847.705249:0:41171:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851847.705250:0:41171:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851847.705251:0:41171:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.705253:0:41171:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851847.705256:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851847.705256:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851847.705257:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851847.705257:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851847.705259:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20704@kfi7, seq: 2130698
00000100:00000040:8.0:1773851847.705260:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bebf7857 : new rpc_count 1
00000100:00000001:11.0:1773851847.705261:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.705262:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.705262:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077448832 : -106968632102784 : ffff9eb66cae7080)
00000100:00000040:8.0:1773851847.705264:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e117e82f x1859373270636160/t0(0) o400->ad032a7d-253f-4f7b-b233-38716bed026d@20704@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1775-0'
00000100:00000001:8.0:1773851847.705269:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.705270:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851847.705272:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e117e82f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ad032a7d-253f-4f7b-b233-38716bed026d+5:39861:x1859373270636160:12345-20704@kfi7:400:default-tuolumne1775-0
00000100:00000200:8.0:1773851847.705275:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373270636160
00000020:00000001:8.0:1773851847.705276:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851847.705277:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851847.705278:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.705279:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851847.705280:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851847.705282:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851847.705283:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373270636160, found 0 last_xid 1859373270636159
00000020:00000001:8.0:1773851847.705285:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851847.705286:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851847.705287:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851847.705288:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.705289:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851847.705290:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851847.705291:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851847.705292:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000003a871c4.
02000000:00000001:8.0:1773851847.705294:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.705295:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.705296:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851847.705297:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692330, transno 0, xid 1859373270636160
00010000:00000001:8.0:1773851847.705299:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851847.705301:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e117e82f x1859373270636160/t0(0) o400->ad032a7d-253f-4f7b-b233-38716bed026d@20704@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1775-0'
00010000:00000001:8.0:1773851847.705305:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851847.705306:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851847.705308:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=80 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851847.705310:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851847.705311:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d876e8bb refcount 3 to 20704@kfi7
00000100:00000001:8.0:1773851847.705312:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803872 : -107130477747744 : ffff9e90bdede1e0)
02000000:00000001:8.0:1773851847.705314:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851847.705315:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.705316:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851847.705317:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20705@kfi7
00000400:00000010:8.0:1773851847.705318:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a36d61ab.
00000100:00000200:8.0:1773851847.705320:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373270636160, offset 224
00000400:00000200:8.0:1773851847.705322:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20705@kfi7
00000400:00000200:8.0:1773851847.705324:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:8.0:1773851847.705325:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 1
00000400:00000200:8.0:1773851847.705327:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000400:00000200:8.0:1773851847.705329:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 3
00000400:00000200:8.0:1773851847.705332:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20705@kfi7 local destination
00000400:00000200:8.0:1773851847.705334:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768352:8768352:1024:4294967295] 20705@kfi7 LPNI seq info [3858708:3858708:16:4294967295]
00000400:00000200:8.0:1773851847.705336:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000400:00000200:8.0:1773851847.705339:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:8.0:1773851847.705342:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20705@kfi7(20705@kfi7:20705@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851847.705345:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 3
00000800:00000200:8.0:1773851847.705347:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851847.705349:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851847.705353:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851847.705357:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 Using peer 20705@kfi7(0x1000000000004a8)
00000800:00000200:8.0:1773851847.705362:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1000000000004a8: rc=0
00000800:00000200:8.0:1773851847.705365:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851847.705368:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.705369:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d876e8bb refcount 2 to 20704@kfi7
00010000:00000001:8.0:1773851847.705373:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851847.705374:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.705375:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851847.705376:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e117e82f x1859373270636160/t0(0) o400->ad032a7d-253f-4f7b-b233-38716bed026d@20704@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1775-0'
00000100:00100000:8.0:1773851847.705382:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e117e82f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ad032a7d-253f-4f7b-b233-38716bed026d+5:39861:x1859373270636160:12345-20704@kfi7:400:default-tuolumne1775-0 Request processed in 111us (168us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851847.705386:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20704@kfi7, seq: 2130698
00000100:00000040:8.0:1773851847.705388:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bebf7857 : new rpc_count 0
00000100:00000001:8.0:1773851847.705389:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851847.705390:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851847.705391:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:8.0:1773851847.705393:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006b5320cf.
00000020:00000010:8.0:1773851847.705395:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009503e737.
00000020:00000040:8.0:1773851847.705396:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000bebf7857 : new refcount 4
00000100:00000001:8.0:1773851847.705398:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851847.705404:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851847.705405:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851847.705406:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20705@kfi7: PUT: OK
00000400:00000200:9.0:1773851847.705407:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a36d61ab
00000400:00000010:9.0:1773851847.705407:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a36d61ab.
00000100:00000001:9.0:1773851847.705408:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851847.705409:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851847.705410:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000800:00000200:9.0:1773851847.705411:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 20705@kfi7(00000000ffd3960b):0x0 lsk 1193 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004a8 Transaction freed
00000800:00000200:9.0:1773851847.720594:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.720596:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851847.720597:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851847.720600:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851847.720603:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.720605:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8832@kfi7 : PUT - for me
00000400:00000200:9.0:1773851847.720607:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.720608:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 1
00000400:00000200:9.0:1773851847.720610:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.720611:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000400:00000200:9.0:1773851847.720612:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 3
00000400:00000200:9.0:1773851847.720614:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8769@kfi7 to cpt 1
00000400:00000200:9.0:1773851847.720615:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8769@kfi7 of length 224 into portal 12 MB=0x699e0a362ea40
00000400:00000200:9.0:1773851847.720617:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8769@kfi7 of length 224/224 into md 0x78146ce49 [64] + 112944
00000800:00000200:9.0:1773851847.720620:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851847.720623:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851847.720624:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8832@kfi7: PUT: OK
00000100:00000001:9.0:1773851847.720626:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851847.720626:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851847.720627:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a9d677f5.
00000100:00000040:9.0:1773851847.720629:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000a9d677f5 x1858039953156672 msgsize 224
00000100:00100000:9.0:1773851847.720631:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8769@kfi7 (source: 12345-8832@kfi7)
00000100:00000001:9.0:1773851847.720633:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851847.720634:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000100:00000001:8.0:1773851847.720635:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851847.720636:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851847.720636:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851847.720637:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851847.720637:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851847.720638:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851847.720640:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039953156672
00000020:00000001:8.0:1773851847.720640:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851847.720641:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92386
00000020:00000001:8.0:1773851847.720642:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851847.720645:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077b90749 refcount=8
00000020:00000001:8.0:1773851847.720646:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630291456 : -107123079260160 : ffff9e9276e9d800)
00000020:00000001:8.0:1773851847.720647:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630291456 : -107123079260160 : ffff9e9276e9d800)
00000100:00000001:8.0:1773851847.720649:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.720650:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851847.720651:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851847.720652:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851847.720653:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851847.720655:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851847.720656:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851847.720657:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.720658:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851847.720659:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851847.720660:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.720661:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.720663:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851847.720664:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851847.720664:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851847.720665:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851847.720666:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8769@kfi7, seq: 2130699
00000100:00000001:11.0:1773851847.720667:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.720667:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077b90749 : new rpc_count 1
00000100:00000001:11.0:1773851847.720668:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.720668:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569676544 : -106988139875072 : ffff9eb1e1ed7500)
00000100:00000040:8.0:1773851847.720670:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a9d677f5 x1858039953156672/t0(0) o400->a042c893-3cab-4ab4-9143-0e4725873866@8769@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1044-0'
00000100:00000001:8.0:1773851847.720675:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.720676:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851847.720678:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9d677f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a042c893-3cab-4ab4-9143-0e4725873866+8:39854:x1858039953156672:12345-8769@kfi7:400:default-tuolumne1044-0
00000100:00000200:8.0:1773851847.720680:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039953156672
00000020:00000001:8.0:1773851847.720682:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851847.720683:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851847.720683:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.720685:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851847.720685:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851847.720687:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851847.720688:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039953156672, found 0 last_xid 1858039953156671
00000020:00000001:8.0:1773851847.720689:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851847.720690:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851847.720691:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851847.720692:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.720693:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851847.720694:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851847.720694:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851847.720695:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008ece2017.
02000000:00000001:8.0:1773851847.720696:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.720698:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.720699:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851847.720700:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182974960269, transno 0, xid 1858039953156672
00010000:00000001:8.0:1773851847.720701:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851847.720702:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a9d677f5 x1858039953156672/t0(0) o400->a042c893-3cab-4ab4-9143-0e4725873866@8769@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1044-0'
00010000:00000001:8.0:1773851847.720707:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851847.720708:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851847.720709:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=80 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851847.720711:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851847.720712:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007592b8f4 refcount 3 to 8769@kfi7
00000100:00000001:8.0:1773851847.720714:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412768 : -107145304138848 : ffff9e8d4a351ba0)
02000000:00000001:8.0:1773851847.720715:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851847.720716:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.720717:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851847.720719:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8832@kfi7
00000400:00000010:8.0:1773851847.720720:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ce37ba88.
00000100:00000200:8.0:1773851847.720721:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039953156672, offset 224
00000400:00000200:8.0:1773851847.720723:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8832@kfi7
00000400:00000200:8.0:1773851847.720732:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:8.0:1773851847.720733:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 1
00000400:00000200:8.0:1773851847.720735:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000400:00000200:8.0:1773851847.720737:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 3
00000400:00000200:8.0:1773851847.720739:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8832@kfi7 local destination
00000400:00000200:8.0:1773851847.720740:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768353:8768353:1024:4294967295] 8832@kfi7 LPNI seq info [1501620:1501620:16:4294967295]
00000400:00000200:8.0:1773851847.720743:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000400:00000200:8.0:1773851847.720744:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:8.0:1773851847.720747:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8832@kfi7(8832@kfi7:8832@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851847.720749:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 3
00000800:00000200:8.0:1773851847.720751:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851847.720752:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851847.720754:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851847.720757:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd8 Using peer 8832@kfi7(0x100000000000dd8)
00000800:00000200:8.0:1773851847.720760:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x100000000000dd8: rc=0
00000800:00000200:8.0:1773851847.720762:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851847.720764:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.720764:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007592b8f4 refcount 2 to 8769@kfi7
00010000:00000001:8.0:1773851847.720765:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851847.720766:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.720766:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851847.720767:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a9d677f5 x1858039953156672/t0(0) o400->a042c893-3cab-4ab4-9143-0e4725873866@8769@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1044-0'
00000100:00100000:8.0:1773851847.720777:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9d677f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a042c893-3cab-4ab4-9143-0e4725873866+8:39854:x1858039953156672:12345-8769@kfi7:400:default-tuolumne1044-0 Request processed in 101us (147us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851847.720779:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8769@kfi7, seq: 2130699
00000100:00000040:8.0:1773851847.720780:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077b90749 : new rpc_count 0
00000100:00000001:8.0:1773851847.720781:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851847.720782:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851847.720782:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851847.720783:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851847.720784:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851847.720784:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000077b90749 : new refcount 7
00000100:00000001:8.0:1773851847.720785:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851847.720791:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd8 TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851847.720793:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851847.720795:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8832@kfi7: PUT: OK
00000400:00000200:11.0:1773851847.720795:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ce37ba88
00000400:00000010:11.0:1773851847.720796:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ce37ba88.
00000100:00000001:11.0:1773851847.720796:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851847.720797:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851847.720798:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000800:00000200:11.0:1773851847.720799:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 8832@kfi7(000000002f57f775):0x0 lsk 3545 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd8 Transaction freed
00000800:00000200:17.0:1773851847.778436:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851847.778437:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851847.778438:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851847.778440:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851847.778442:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.778443:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22161@kfi7 : PUT - for me
00000400:00000200:17.0:1773851847.778444:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.778445:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 1
00000400:00000200:17.0:1773851847.778445:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.778446:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000400:00000200:17.0:1773851847.778447:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 3
00000400:00000200:17.0:1773851847.778447:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851847.778448:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22161@kfi7 of length 224 into portal 12 MB=0x699e0fc04d3c0
00000400:00000200:17.0:1773851847.778449:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22161@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 182776
00000800:00000200:17.0:1773851847.778451:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851847.778452:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851847.778453:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22161@kfi7: PUT: OK
00000100:00000001:17.0:1773851847.778454:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851847.778454:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851847.778455:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000018b7a8bf.
00000100:00000040:17.0:1773851847.778456:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000018b7a8bf x1858041440162752 msgsize 224
00000100:00100000:17.0:1773851847.778457:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22161@kfi7 (source: 12345-22161@kfi7)
00000100:00000001:17.0:1773851847.778458:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851847.778459:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851847.778459:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
02000000:00000001:19.0:1773851847.778460:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851847.778460:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851847.778460:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851847.778461:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851847.778462:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851847.778463:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041440162752
00000020:00000001:19.0:1773851847.778463:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851847.778464:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92180
00000020:00000001:19.0:1773851847.778464:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851847.778466:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b3318ef8 refcount=6
00000020:00000001:19.0:1773851847.778466:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629751808 : -107123079799808 : ffff9e9276e19c00)
00000020:00000001:19.0:1773851847.778467:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629751808 : -107123079799808 : ffff9e9276e19c00)
00000100:00000001:19.0:1773851847.778468:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851847.778469:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851847.778470:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b6c87683.
00000020:00000010:19.0:1773851847.778471:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851847.778472:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851847.778473:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851847.778473:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851847.778474:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851847.778475:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851847.778476:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851847.778476:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851847.778477:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851847.778478:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851847.778479:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851847.778479:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851847.778479:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851847.778480:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22161@kfi7, seq: 2156232
00000100:00000040:19.0:1773851847.778481:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b3318ef8 : new rpc_count 1
00000100:00000001:19.0:1773851847.778481:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636944025635968 : -107129683915648 : ffff9e90ed3ecc80)
00000100:00000001:18.0:1773851847.778481:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851847.778481:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851847.778482:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000018b7a8bf x1858041440162752/t0(0) o400->e9ba12f7-5ce9-4db2-ac30-fa369bca6177@22161@kfi7:37/0 lens 224/0 e 0 to 0 dl 1773852152 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1874-0'
00000100:00000001:19.0:1773851847.778485:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851847.778485:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851847.778486:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018b7a8bf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e9ba12f7-5ce9-4db2-ac30-fa369bca6177+6:39685:x1858041440162752:12345-22161@kfi7:400:default-tuolumne1874-0
00000100:00000200:19.0:1773851847.778488:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041440162752
00000020:00000001:19.0:1773851847.778488:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851847.778489:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851847.778490:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.778490:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851847.778491:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851847.778492:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851847.778492:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041440162752, found 0 last_xid 1858041440162751
00000020:00000001:19.0:1773851847.778493:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851847.778494:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851847.778494:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851847.778495:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.778496:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851847.778496:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851847.778497:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851847.778498:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ff8fca47.
02000000:00000001:19.0:1773851847.778499:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851847.778499:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.778500:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851847.778501:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668602316, transno 0, xid 1858041440162752
00010000:00000001:19.0:1773851847.778502:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851847.778502:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000018b7a8bf x1858041440162752/t0(0) o400->e9ba12f7-5ce9-4db2-ac30-fa369bca6177@22161@kfi7:37/0 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1874-0'
00010000:00000001:19.0:1773851847.778505:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851847.778506:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851847.778506:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=80 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851847.778508:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851847.778509:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008b56ec05 refcount 3 to 22161@kfi7
00000100:00000001:19.0:1773851847.778509:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519104 : -107156126032512 : ffff9e8ac52c1d80)
02000000:00000001:19.0:1773851847.778510:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851847.778510:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851847.778511:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851847.778512:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22161@kfi7
00000400:00000010:19.0:1773851847.778513:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c4b6298d.
00000100:00000200:19.0:1773851847.778514:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041440162752, offset 224
00000400:00000200:19.0:1773851847.778515:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22161@kfi7
00000400:00000200:19.0:1773851847.778516:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:19.0:1773851847.778517:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 1
00000400:00000200:19.0:1773851847.778518:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000400:00000200:19.0:1773851847.778520:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 3
00000400:00000200:19.0:1773851847.778521:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22161@kfi7 local destination
00000400:00000200:19.0:1773851847.778522:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768354:8768354:1024:4294967295] 22161@kfi7 LPNI seq info [1627906:1627906:16:4294967295]
00000400:00000200:19.0:1773851847.778524:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000400:00000200:19.0:1773851847.778525:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:19.0:1773851847.778526:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22161@kfi7(22161@kfi7:22161@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851847.778528:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 3
00000800:00000200:19.0:1773851847.778529:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851847.778530:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851847.778533:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851847.778537:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1b1 Using peer 22161@kfi7(0x1b1)
00000800:00000200:19.0:1773851847.778540:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x1b1: rc=0
00000800:00000200:19.0:1773851847.778541:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851847.778543:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851847.778544:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008b56ec05 refcount 2 to 22161@kfi7
00010000:00000001:19.0:1773851847.778545:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851847.778546:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851847.778546:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851847.778547:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000018b7a8bf x1858041440162752/t0(0) o400->e9ba12f7-5ce9-4db2-ac30-fa369bca6177@22161@kfi7:37/0 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1874-0'
00000100:00100000:19.0:1773851847.778550:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018b7a8bf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e9ba12f7-5ce9-4db2-ac30-fa369bca6177+6:39685:x1858041440162752:12345-22161@kfi7:400:default-tuolumne1874-0 Request processed in 64us (93us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851847.778553:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22161@kfi7, seq: 2156232
00000100:00000040:19.0:1773851847.778553:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b3318ef8 : new rpc_count 0
00000100:00000001:19.0:1773851847.778554:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851847.778554:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1b1 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851847.778555:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851847.778555:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851847.778555:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851847.778556:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000400:00000200:17.0:1773851847.778556:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22161@kfi7: PUT: OK
00000020:00000010:19.0:1773851847.778557:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b6c87683.
00000400:00000200:17.0:1773851847.778557:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c4b6298d
00000400:00000010:17.0:1773851847.778557:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c4b6298d.
00000020:00000040:19.0:1773851847.778558:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000b3318ef8 : new refcount 5
00000100:00000001:19.0:1773851847.778558:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851847.778558:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851847.778558:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851847.778559:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000800:00000200:17.0:1773851847.778561:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 22161@kfi7(00000000241a4ee9):0x0 lsk 434 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1b1 Transaction freed
00000800:00000200:29.0:1773851847.782398:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.782398:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851847.782400:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851847.782402:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851847.782403:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.782405:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9297@kfi7 : PUT - for me
00000400:00000200:29.0:1773851847.782405:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.782406:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 1
00000400:00000200:29.0:1773851847.782407:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.782408:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000400:00000200:29.0:1773851847.782409:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 3
00000400:00000200:29.0:1773851847.782409:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.782410:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9297@kfi7 of length 600 into portal 12 MB=0x699e17207f540
00000400:00000200:29.0:1773851847.782411:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9297@kfi7 of length 600/600 into md 0x77fe139dd [64] + 154024
00000800:00000200:29.0:1773851847.782413:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851847.782415:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851847.782416:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9297@kfi7: PUT: OK
00000100:00000001:29.0:1773851847.782417:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851847.782417:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851847.782418:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f3dcb147.
00000100:00000040:29.0:1773851847.782418:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f3dcb147 x1858043420079424 msgsize 600
00000100:00100000:29.0:1773851847.782420:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-9297@kfi7 (source: 12345-9297@kfi7)
00000100:00000001:29.0:1773851847.782421:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851847.782422:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000100:00000001:31.0:1773851847.782423:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851847.782423:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851847.782424:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851847.782425:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851847.782426:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851847.782427:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851847.782428:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043420079424
00000020:00000001:31.0:1773851847.782429:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851847.782430:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9164a
00000020:00000001:31.0:1773851847.782431:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851847.782432:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cd1be348 refcount=1207
00000020:00000001:31.0:1773851847.782433:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241262080 : -107152468289536 : ffff9e8b9f30d800)
00000020:00000001:31.0:1773851847.782435:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241262080 : -107152468289536 : ffff9e8b9f30d800)
00000100:00000001:31.0:1773851847.782436:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851847.782437:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851847.782438:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851847.782440:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851847.782441:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851847.782442:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851847.782443:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:31.0:1773851847.782444:0:42267:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:31.0:1773851847.782445:0:42267:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.782446:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.782448:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851847.782449:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851847.782451:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851847.782451:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851847.782451:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851847.782452:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851847.782452:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9297@kfi7, seq: 364304977
00000100:00000001:31.0:1773851847.782453:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851847.782453:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cd1be348 : new rpc_count 15
00000100:00000001:31.0:1773851847.782454:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.782454:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121925269504 : -106951784282112 : ffff9eba58e3c800)
00000100:00000040:29.0:1773851847.782455:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f3dcb147 x1858043420079424/t0(0) o101->a871cb5b-5147-4743-a621-894b5cc44762@9297@kfi7:635/0 lens 600/0 e 0 to 0 dl 1773851995 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833573739501321216'
00000100:00000001:29.0:1773851847.782458:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851847.782458:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851847.782459:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3dcb147 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:a871cb5b-5147-4743-a621-894b5cc44762+1207:4101529:x1858043420079424:12345-9297@kfi7:101:tuolumne-833573739501321216
00000100:00000200:29.0:1773851847.782460:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043420079424
00000020:00000001:29.0:1773851847.782461:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851847.782461:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851847.782462:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.782463:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851847.782463:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:29.0:1773851847.782464:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851847.782464:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043420079424, found 0 last_xid 1858043412959743
00000020:00000001:29.0:1773851847.782465:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851847.782466:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851847.782466:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851847.782467:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.782468:0:60533:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:29.0:1773851847.782468:0:60533:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:29.0:1773851847.782469:0:60533:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:29.0:1773851847.782470:0:60533:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:29.0:1773851847.782470:0:60533:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782473:0:60533:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:29.0:1773851847.782474:0:60533:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000617047cc count: 35
00010000:00000001:29.0:1773851847.782475:0:60533:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:29.0:1773851847.782477:0:60533:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:29.0:1773851847.782477:0:60533:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000f97991ce.
00000020:00000001:29.0:1773851847.782478:0:60533:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:29.0:1773851847.782479:0:60533:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000f97991ce with handle 0x21b6f08f07a6ac12 to hash
00000020:00000001:29.0:1773851847.782480:0:60533:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:29.0:1773851847.782480:0:60533:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637111637525056 : -106962072026560 : ffff9eb7f3b14240)
00010000:00000010:29.0:1773851847.782481:0:60533:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000099a5eed5.
00010000:00000001:29.0:1773851847.782482:0:60533:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637111637525056 : -106962072026560 : ffff9eb7f3b14240)
00010000:00010000:29.0:1773851847.782483:0:60533:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000f97991ce/0x21b6f08f07a6ac12 lrc: 2/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x0/0x0 rrc: 36 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd6f6229f11ef7ca expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782487:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 35
00010000:00000040:29.0:1773851847.782487:0:60533:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000cd1be348 : new locks_count 1131
00000020:00000040:29.0:1773851847.782488:0:60533:0:(genops.c:871:class_export_get()) GET export 00000000cd1be348 refcount=1208
00010000:00000001:29.0:1773851847.782490:0:60533:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:29.0:1773851847.782491:0:60533:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:29.0:1773851847.782492:0:60533:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:29.0:1773851847.782493:0:60533:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:29.0:1773851847.782493:0:60533:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:29.0:1773851847.782494:0:60533:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:29.0:1773851847.782494:0:60533:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240022ab1:0x10add:0x0]
00000020:00000001:29.0:1773851847.782495:0:60533:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:29.0:1773851847.782496:0:60533:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637060275857336 : -107013433694280 : ffff9eabfe4c67b8)
00000004:00000001:29.0:1773851847.782497:0:60533:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637060275857248 : -107013433694368 : ffff9eabfe4c6760)
00000004:00000001:29.0:1773851847.782498:0:60533:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782499:0:60533:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:29.0:1773851847.782499:0:60533:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:29.0:1773851847.782500:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851847.782500:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851847.782502:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000edefed54.
02000000:00000001:29.0:1773851847.782503:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.782504:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782504:0:60533:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782505:0:60533:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:29.0:1773851847.782506:0:60533:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:29.0:1773851847.782507:0:60533:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851847.782508:0:60533:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:29.0:1773851847.782508:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851847.782509:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:29.0:1773851847.782510:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851847.782510:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:29.0:1773851847.782510:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851847.782511:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:29.0:1773851847.782511:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851847.782511:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
02000000:00000001:29.0:1773851847.782512:0:60533:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:29.0:1773851847.782513:0:60533:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637045037292288 : -107028672259328 : ffff9ea872025b00)
00000004:00000001:29.0:1773851847.782514:0:60533:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:29.0:1773851847.782514:0:60533:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:29.0:1773851847.782515:0:60533:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851847.782515:0:60533:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782516:0:60533:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:29.0:1773851847.782517:0:60533:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782517:0:60533:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:29.0:1773851847.782518:0:60533:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x240022ab1:0x10add:0x0]/job_1741308635_647d78839385, ldlm_rep = 0000000038b76129
00000004:00000001:29.0:1773851847.782520:0:60533:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:29.0:1773851847.782521:0:60533:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:29.0:1773851847.782521:0:60533:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:29.0:1773851847.782522:0:60533:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:29.0:1773851847.782523:0:60533:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:29.0:1773851847.782523:0:60533:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:29.0:1773851847.782524:0:60533:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782524:0:60533:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:29.0:1773851847.782525:0:60533:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:29.0:1773851847.782526:0:60533:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000f8ede499.
00000020:00000001:29.0:1773851847.782526:0:60533:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:29.0:1773851847.782527:0:60533:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000f8ede499 with handle 0x21b6f08f07a6ac19 to hash
00000020:00000001:29.0:1773851847.782527:0:60533:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:29.0:1773851847.782527:0:60533:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637111637524480 : -106962072027136 : ffff9eb7f3b14000)
00010000:00000010:29.0:1773851847.782528:0:60533:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c2bbadd5.
00010000:00000001:29.0:1773851847.782529:0:60533:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637111637524480 : -106962072027136 : ffff9eb7f3b14000)
00010000:00000001:29.0:1773851847.782529:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782530:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782531:0:60533:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 3/1,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x0/0x0 rrc: 37 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782534:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782534:0:60533:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:29.0:1773851847.782535:0:60533:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:29.0:1773851847.782535:0:60533:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:29.0:1773851847.782536:0:60533:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:29.0:1773851847.782537:0:60533:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782537:0:60533:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:29.0:1773851847.782538:0:60533:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782538:0:60533:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:29.0:1773851847.782539:0:60533:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:29.0:1773851847.782540:0:60533:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:29.0:1773851847.782540:0:60533:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:29.0:1773851847.782540:0:60533:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240022ab1:0x10add:0x0].0x0 (00000000617047cc) refcount = 36
00010000:00000040:29.0:1773851847.782542:0:60533:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:29.0:1773851847.782543:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000928d62c2/0x21b6f08f07a40d31 lrc: 2/0,1 mode: CW/CW res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 60931 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782545:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782546:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c3c58638/0x21b6f08f07a6a79d lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 14656@kfi7 remote: 0xee46395ebb639eea expref: 571 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782548:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782549:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000060ce70b2/0x21b6f08f07a6a145 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 20371@kfi7 remote: 0x2051c98a273b3414 expref: 363 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782551:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782552:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031c0254b/0x21b6f08f07a6a0c7 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 15873@kfi7 remote: 0xf0e50a97590c53ef expref: 625 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782554:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782555:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004edfba06/0x21b6f08f07a67df8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d651c9b2 expref: 428 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782557:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782559:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac1665/0x21b6f08f07a67ccb lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 14834@kfi7 remote: 0xf194aee929aaa453 expref: 779 pid: 61019 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782560:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782562:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e799c17b/0x21b6f08f07a67a86 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 17395@kfi7 remote: 0x3ec3da9d2e6c4e96 expref: 798 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782563:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782565:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080b23c24/0x21b6f08f07a6763b lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19649@kfi7 remote: 0xfbed7022be6d812 expref: 764 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782567:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782569:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c7224ec/0x21b6f08f07a6760a lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 16706@kfi7 remote: 0xb9d2e15427cec0c0 expref: 688 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782571:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782572:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e29003/0x21b6f08f07a66ff8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 18145@kfi7 remote: 0x94f28eec257670ba expref: 520 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782574:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782575:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000637160eb/0x21b6f08f07a66651 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 20162@kfi7 remote: 0xd8f535f7d4066ca4 expref: 685 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782577:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782578:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9c695f/0x21b6f08f07a63383 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9362@kfi7 remote: 0xc5a97ef482d05c25 expref: 444 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782580:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782581:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099f84db4/0x21b6f08f07a5d5d5 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22529@kfi7 remote: 0xfcff1f2caad1d920 expref: 626 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782583:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782585:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab425ebe/0x21b6f08f07a5d51f lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9408@kfi7 remote: 0x370aeb12e4428f40 expref: 718 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782586:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782588:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b48c48a2/0x21b6f08f07a5d255 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9139@kfi7 remote: 0xfa7021092331e4ac expref: 436 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782589:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782591:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001047490d/0x21b6f08f07a5d1e5 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9fec7e77 expref: 523 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782593:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782594:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012ce9a88/0x21b6f08f07a5ae6e lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19394@kfi7 remote: 0x4a24d51c18b2b286 expref: 724 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782596:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782597:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f300433a/0x21b6f08f07a5a3e0 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9297@kfi7 remote: 0xd6f6229f11ea6e1 expref: 1208 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782599:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782600:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ebbd3d2/0x21b6f08f07a59180 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 26401@kfi7 remote: 0x4e2d8609cc3f28d9 expref: 736 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782602:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782603:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071b3552b/0x21b6f08f07a4e7d5 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 26563@kfi7 remote: 0x581d8fb696c27b8f expref: 5917 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782605:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782606:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000081bb9743/0x21b6f08f07a4a79a lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6642ab expref: 468 pid: 61009 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782608:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782609:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000043f411/0x21b6f08f07a49311 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22579@kfi7 remote: 0x8bf879f20ce2a6a4 expref: 406 pid: 61040 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782611:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782612:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041129efd/0x21b6f08f07a46ee4 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22352@kfi7 remote: 0x9b15b96d92895e9e expref: 311 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782614:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782615:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ad05bc3/0x21b6f08f07a449d7 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19683@kfi7 remote: 0x8c112039dd042c7d expref: 709 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782617:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782618:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000414cd34e/0x21b6f08f07a3f6da lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 13234@kfi7 remote: 0x9f53f3a6802bc5e3 expref: 601 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782620:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782621:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be11c013/0x21b6f08f07a286c0 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22579@kfi7 remote: 0x8bf879f20ce253f4 expref: 406 pid: 60986 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782622:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782623:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f544290/0x21b6f08efbf5fa86 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 14834@kfi7 remote: 0xf194aee929a94ac8 expref: 779 pid: 61061 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782625:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782626:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061e2aa35/0x21b6f08ef9b3fab8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 16706@kfi7 remote: 0xb9d2e15427ccae87 expref: 688 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782628:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782629:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000023436998/0x21b6f08eecd6afe0 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9139@kfi7 remote: 0xfa7021092330bc21 expref: 436 pid: 60731 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782631:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782632:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9bf9b9b/0x21b6f08eecab02b7 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9feb2540 expref: 523 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782633:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782634:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c6ddecc/0x21b6f08ed310b0c8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 20162@kfi7 remote: 0xd8f535f7d404bb3e expref: 685 pid: 60549 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782636:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782637:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ec6135d/0x21b6f08eaf2d9fa2 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 17395@kfi7 remote: 0x3ec3da9d2e69616c expref: 798 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782639:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782640:0:60533:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000965c2453/0x21b6f08e89765737 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 13234@kfi7 remote: 0x9f53f3a68028e4eb expref: 601 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782642:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:29.0:1773851847.782642:0:60533:0:(ldlm_resource.c:1815:ldlm_resource_dump()) Waiting locks:
00010000:00000040:29.0:1773851847.782643:0:60533:0:(ldlm_resource.c:1817:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009e05b555/0x21b6f08f07a4a0af lrc: 3/1,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x12/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60742 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782644:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00010000:29.0:1773851847.782645:0:60533:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 3/1,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782647:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782647:0:60533:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:29.0:1773851847.782648:0:60533:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:29.0:1773851847.782649:0:60533:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782650:0:60533:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:29.0:1773851847.782650:0:60533:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782651:0:60533:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782652:0:60533:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:29.0:1773851847.782653:0:60533:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:29.0:1773851847.782653:0:60533:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782654:0:60533:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 3/1,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782656:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782656:0:60533:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:29.0:1773851847.782657:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782658:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782658:0:60533:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:29.0:1773851847.782658:0:60533:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:29.0:1773851847.782659:0:60533:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000a93616cb.
00010000:00000010:29.0:1773851847.782660:0:60533:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000b56bd111.
00010000:00000001:29.0:1773851847.782661:0:60533:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:29.0:1773851847.782662:0:60533:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000040cab34e.
00000020:00000001:29.0:1773851847.782662:0:60533:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:29.0:1773851847.782663:0:60533:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000040cab34e with handle 0x21b6f08f07a6ac20 to hash
00000020:00000001:29.0:1773851847.782663:0:60533:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:29.0:1773851847.782664:0:60533:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000010:29.0:1773851847.782664:0:60533:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000008353bdd0.
00010000:00000001:29.0:1773851847.782665:0:60533:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000001:29.0:1773851847.782665:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782666:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782666:0:60533:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 3/1,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782668:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782669:0:60533:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:29.0:1773851847.782669:0:60533:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:29.0:1773851847.782669:0:60533:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:29.0:1773851847.782670:0:60533:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:29.0:1773851847.782670:0:60533:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782671:0:60533:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:29.0:1773851847.782671:0:60533:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782671:0:60533:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:29.0:1773851847.782672:0:60533:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:29.0:1773851847.782672:0:60533:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:29.0:1773851847.782672:0:60533:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:29.0:1773851847.782673:0:60533:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240022ab1:0x10add:0x0].0x53778085 (00000000a93616cb) refcount = 1
00010000:00010000:29.0:1773851847.782673:0:60533:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 3/1,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782675:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782676:0:60533:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:29.0:1773851847.782677:0:60533:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:29.0:1773851847.782677:0:60533:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782677:0:60533:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:29.0:1773851847.782678:0:60533:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782678:0:60533:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782679:0:60533:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:29.0:1773851847.782679:0:60533:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:29.0:1773851847.782680:0:60533:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782680:0:60533:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 3/1,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782682:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782682:0:60533:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:29.0:1773851847.782683:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782683:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782683:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782684:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782684:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000040cab34e refcount=3
00000020:00000001:29.0:1773851847.782685:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000001:29.0:1773851847.782686:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000001:29.0:1773851847.782686:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782686:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:29.0:1773851847.782687:0:60533:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782687:0:60533:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782689:0:60533:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:29.0:1773851847.782693:0:60533:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:29.0:1773851847.782693:0:60533:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:29.0:1773851847.782694:0:60533:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851847.782695:0:60533:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:29.0:1773851847.782702:0:60533:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:29.0:1773851847.782703:0:60533:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:29.0:1773851847.782704:0:60533:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:29.0:1773851847.782705:0:60533:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:29.0:1773851847.782705:0:60533:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:29.0:1773851847.782706:0:60533:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:29.0:1773851847.782706:0:60533:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851847.782708:0:60533:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851847.782708:0:60533:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851847.782709:0:60533:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782709:0:60533:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782710:0:60533:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:29.0:1773851847.782710:0:60533:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x200020d44:0x2cd7:0x0]
00000020:00000001:29.0:1773851847.782711:0:60533:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:29.0:1773851847.782713:0:60533:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637088869955448 : -106984839596168 : ffff9eb2a6a3b778)
00000004:00000001:29.0:1773851847.782713:0:60533:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637088869955360 : -106984839596256 : ffff9eb2a6a3b720)
00000004:00000001:29.0:1773851847.782714:0:60533:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:29.0:1773851847.782714:0:60533:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:29.0:1773851847.782714:0:60533:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:29.0:1773851847.782715:0:60533:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:29.0:1773851847.782715:0:60533:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000ef0ef386.
00010000:00000010:29.0:1773851847.782716:0:60533:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 000000001a76361c.
00010000:00000001:29.0:1773851847.782717:0:60533:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:29.0:1773851847.782717:0:60533:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000eab00ea5.
00000020:00000001:29.0:1773851847.782718:0:60533:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:29.0:1773851847.782718:0:60533:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000eab00ea5 with handle 0x21b6f08f07a6ac27 to hash
00000020:00000001:29.0:1773851847.782719:0:60533:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:29.0:1773851847.782719:0:60533:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00010000:00000010:29.0:1773851847.782720:0:60533:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000031b8b388.
00010000:00000001:29.0:1773851847.782720:0:60533:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00010000:00000001:29.0:1773851847.782721:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782721:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782722:0:60533:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000eab00ea5/0x21b6f08f07a6ac27 lrc: 3/1,0 mode: --/PR res: [0x200020d44:0x2cd7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782724:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ef0ef386 count: 1
00010000:00000001:29.0:1773851847.782724:0:60533:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:29.0:1773851847.782729:0:60533:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:29.0:1773851847.782729:0:60533:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:29.0:1773851847.782730:0:60533:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:29.0:1773851847.782730:0:60533:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782731:0:60533:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:29.0:1773851847.782731:0:60533:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782731:0:60533:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:29.0:1773851847.782732:0:60533:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:29.0:1773851847.782732:0:60533:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:29.0:1773851847.782732:0:60533:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:29.0:1773851847.782733:0:60533:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x200020d44:0x2cd7:0x0].0x0 (00000000ef0ef386) refcount = 1
00010000:00010000:29.0:1773851847.782733:0:60533:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000eab00ea5/0x21b6f08f07a6ac27 lrc: 3/1,0 mode: PR/PR res: [0x200020d44:0x2cd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782736:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ef0ef386 count: 1
00010000:00000001:29.0:1773851847.782736:0:60533:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:29.0:1773851847.782736:0:60533:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:29.0:1773851847.782737:0:60533:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782737:0:60533:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:29.0:1773851847.782737:0:60533:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782738:0:60533:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782738:0:60533:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:29.0:1773851847.782739:0:60533:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:29.0:1773851847.782739:0:60533:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782740:0:60533:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000eab00ea5/0x21b6f08f07a6ac27 lrc: 3/1,0 mode: PR/PR res: [0x200020d44:0x2cd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782741:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ef0ef386 count: 1
00010000:00000001:29.0:1773851847.782742:0:60533:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:29.0:1773851847.782742:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782743:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782743:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782744:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782744:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000eab00ea5 refcount=3
00000020:00000001:29.0:1773851847.782745:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00010000:00000001:29.0:1773851847.782745:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00010000:00000001:29.0:1773851847.782746:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782746:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:29.0:1773851847.782746:0:60533:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782749:0:60533:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:29.0:1773851847.782750:0:60533:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200020d44:0x2cd7:0x0]
00000004:00000001:29.0:1773851847.782751:0:60533:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782752:0:60533:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782752:0:60533:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:29.0:1773851847.782753:0:60533:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:29.0:1773851847.782755:0:60533:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:29.0:1773851847.782757:0:60533:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782758:0:60533:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782759:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782759:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782760:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000eab00ea5 refcount=3
00000020:00000001:29.0:1773851847.782760:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00010000:00000001:29.0:1773851847.782761:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00000004:00010000:29.0:1773851847.782762:0:60533:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000eab00ea5/0x21b6f08f07a6ac27 lrc: 3/1,0 mode: PR/PR res: [0x200020d44:0x2cd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782764:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ef0ef386 count: 1
00010000:00000001:29.0:1773851847.782765:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782765:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:29.0:1773851847.782766:0:60533:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:29.0:1773851847.782766:0:60533:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:29.0:1773851847.782767:0:60533:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:29.0:1773851847.782768:0:60533:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:29.0:1773851847.782769:0:60533:0:(lu_object.c:224:lu_object_put()) Add 0000000027d107c4/00000000dcc9c216 to site lru. bkt: 000000009a2c7aac
00000004:00000001:29.0:1773851847.782770:0:60533:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:29.0:1773851847.782770:0:60533:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:29.0:1773851847.782771:0:60533:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:29.0:1773851847.782771:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782772:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782772:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f8ede499 refcount=3
00000020:00000001:29.0:1773851847.782772:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111637524480 : -106962072027136 : ffff9eb7f3b14000)
00010000:00000001:29.0:1773851847.782773:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637111637524480 : -106962072027136 : ffff9eb7f3b14000)
00010000:00000001:29.0:1773851847.782774:0:60533:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:29.0:1773851847.782775:0:60533:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 3/1,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782777:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782778:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782778:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:29.0:1773851847.782779:0:60533:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 2/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782782:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782782:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782783:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782783:0:60533:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:29.0:1773851847.782784:0:60533:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 3/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782786:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00010000:29.0:1773851847.782787:0:60533:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000f8ede499 already unused, calling callback (000000001690cbe4)
00000004:00000001:29.0:1773851847.782788:0:60533:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:29.0:1773851847.782789:0:60533:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:29.0:1773851847.782789:0:60533:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 3/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782792:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782792:0:60533:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:29.0:1773851847.782793:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782793:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782794:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f8ede499 refcount=4
00000020:00000001:29.0:1773851847.782794:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111637524480 : -106962072027136 : ffff9eb7f3b14000)
00010000:00000001:29.0:1773851847.782795:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637111637524480 : -106962072027136 : ffff9eb7f3b14000)
00010000:00000001:29.0:1773851847.782796:0:60533:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:29.0:1773851847.782796:0:60533:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 4/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782803:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782804:0:60533:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:29.0:1773851847.782805:0:60533:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:29.0:1773851847.782805:0:60533:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782806:0:60533:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:29.0:1773851847.782807:0:60533:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:29.0:1773851847.782808:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782808:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851847.782809:0:60533:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f8ede499 with handle 0x21b6f08f07a6ac19 from hash
00010000:00000001:29.0:1773851847.782810:0:60533:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:29.0:1773851847.782811:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782811:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782811:0:60533:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:29.0:1773851847.782812:0:60533:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:29.0:1773851847.782813:0:60533:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782813:0:60533:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:29.0:1773851847.782814:0:60533:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:29.0:1773851847.782815:0:60533:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:29.0:1773851847.782815:0:60533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240022ab1:0x10add:0x0].0x0 (00000000617047cc)
00010000:00010000:29.0:1773851847.782817:0:60533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:29.0:1773851847.782818:0:60533:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre5-MDT0001_UUID lock: 000000009e05b555/0x21b6f08f07a4a0af lrc: 3/1,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x12/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60742 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782820:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782821:0:60533:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:29.0:1773851847.782822:0:60533:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:29.0:1773851847.782822:0:60533:0:(ldlm_lock.c:720:ldlm_add_ast_work_item()) Process entered
00010000:00000001:29.0:1773851847.782823:0:60533:0:(ldlm_lock.c:726:ldlm_add_ast_work_item()) Process leaving
00010000:00000001:29.0:1773851847.782823:0:60533:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782824:0:60533:0:(ldlm_inodebits.c:389:ldlm_process_inodebits_lock()) Process leaving (rc=2 : 2 : 2)
00010000:00000001:29.0:1773851847.782825:0:60533:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=2 : 2 : 2)
00010000:00000001:29.0:1773851847.782826:0:60533:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782826:0:60533:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:29.0:1773851847.782827:0:60533:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:29.0:1773851847.782828:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782829:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782829:0:60533:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782830:0:60533:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782830:0:60533:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782831:0:60533:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 2/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782834:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:29.0:1773851847.782835:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782835:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782836:0:60533:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:29.0:1773851847.782836:0:60533:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:29.0:1773851847.782837:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:29.0:1773851847.782837:0:60533:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ede499/0x21b6f08f07a6ac19 lrc: 0/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782840:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000010:29.0:1773851847.782841:0:60533:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c2bbadd5.
00010000:00000040:29.0:1773851847.782842:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 35
00010000:00000001:29.0:1773851847.782843:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:29.0:1773851847.782843:0:60533:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:29.0:1773851847.782844:0:60533:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:29.0:1773851847.782844:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782844:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782845:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000040cab34e refcount=3
00000020:00000001:29.0:1773851847.782846:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000001:29.0:1773851847.782846:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000001:29.0:1773851847.782847:0:60533:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:29.0:1773851847.782848:0:60533:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 3/1,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782850:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782851:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782852:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:29.0:1773851847.782852:0:60533:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782855:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782855:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782856:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782857:0:60533:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:29.0:1773851847.782857:0:60533:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 3/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782860:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00010000:29.0:1773851847.782861:0:60533:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000040cab34e already unused, calling callback (000000001690cbe4)
00000004:00000001:29.0:1773851847.782861:0:60533:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:29.0:1773851847.782862:0:60533:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:29.0:1773851847.782863:0:60533:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 3/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782865:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782866:0:60533:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:29.0:1773851847.782866:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782867:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782867:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000040cab34e refcount=4
00000020:00000001:29.0:1773851847.782868:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000001:29.0:1773851847.782868:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000001:29.0:1773851847.782869:0:60533:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:29.0:1773851847.782869:0:60533:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 4/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782872:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782872:0:60533:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:29.0:1773851847.782873:0:60533:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:29.0:1773851847.782873:0:60533:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782874:0:60533:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:29.0:1773851847.782874:0:60533:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:29.0:1773851847.782875:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782875:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851847.782876:0:60533:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000040cab34e with handle 0x21b6f08f07a6ac20 from hash
00010000:00000001:29.0:1773851847.782876:0:60533:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:29.0:1773851847.782877:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782877:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782878:0:60533:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:29.0:1773851847.782878:0:60533:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:29.0:1773851847.782879:0:60533:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782879:0:60533:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:29.0:1773851847.782880:0:60533:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:29.0:1773851847.782880:0:60533:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:29.0:1773851847.782881:0:60533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240022ab1:0x10add:0x0].0x53778085 (00000000a93616cb)
00010000:00010000:29.0:1773851847.782882:0:60533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:29.0:1773851847.782882:0:60533:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782883:0:60533:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782884:0:60533:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:29.0:1773851847.782884:0:60533:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:29.0:1773851847.782885:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782885:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782886:0:60533:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782886:0:60533:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782887:0:60533:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851847.782888:0:60533:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 2/0,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782890:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000001:29.0:1773851847.782891:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782891:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782892:0:60533:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:29.0:1773851847.782892:0:60533:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:29.0:1773851847.782893:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:29.0:1773851847.782893:0:60533:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6ac20 lrc: 0/0,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x53778085 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782899:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 1
00010000:00000010:29.0:1773851847.782900:0:60533:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000008353bdd0.
00010000:00000040:29.0:1773851847.782901:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a93616cb count: 0
00010000:00000010:29.0:1773851847.782902:0:60533:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000b56bd111.
00010000:00000001:29.0:1773851847.782903:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:29.0:1773851847.782904:0:60533:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:29.0:1773851847.782904:0:60533:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:29.0:1773851847.782905:0:60533:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:29.0:1773851847.782905:0:60533:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:29.0:1773851847.782906:0:60533:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851847.782906:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851847.782907:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000eab00ea5 refcount=3
00000020:00000001:29.0:1773851847.782907:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00010000:00000001:29.0:1773851847.782908:0:60533:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637136586734208 : -106937122817408 : ffff9ebdc2c7fa80)
00000004:00000040:29.0:1773851847.782909:0:60533:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000cd1be348 : new locks_count 1132
00000020:00000040:29.0:1773851847.782910:0:60533:0:(genops.c:871:class_export_get()) GET export 00000000cd1be348 refcount=1209
00010000:00000001:29.0:1773851847.782911:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782912:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:29.0:1773851847.782912:0:60533:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:29.0:1773851847.782913:0:60533:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:29.0:1773851847.782914:0:60533:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:29.0:1773851847.782915:0:60533:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:29.0:1773851847.782915:0:60533:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:29.0:1773851847.782916:0:60533:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:29.0:1773851847.782916:0:60533:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:29.0:1773851847.782917:0:60533:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:29.0:1773851847.782919:0:60533:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851847.782920:0:60533:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:29.0:1773851847.782921:0:60533:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:29.0:1773851847.782921:0:60533:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:29.0:1773851847.782922:0:60533:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:29.0:1773851847.782923:0:60533:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:29.0:1773851847.782923:0:60533:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:29.0:1773851847.782924:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782925:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782925:0:60533:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:29.0:1773851847.782926:0:60533:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851847.782926:0:60533:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f97991ce with handle 0x21b6f08f07a6ac12 from hash
00010000:00000001:29.0:1773851847.782927:0:60533:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:29.0:1773851847.782927:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782928:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782928:0:60533:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:29.0:1773851847.782929:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:29.0:1773851847.782929:0:60533:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f97991ce/0x21b6f08f07a6ac12 lrc: 0/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x1/0x0 rrc: 36 type: IBT gid 0 flags: 0x44000000000000 nid: 9297@kfi7 remote: 0xd6f6229f11ef7ca expref: 1209 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782932:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 35
00010000:00000040:29.0:1773851847.782933:0:60533:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000cd1be348 : new locks_count 1131
00000020:00000040:29.0:1773851847.782934:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000cd1be348 : new refcount 1208
00010000:00000010:29.0:1773851847.782935:0:60533:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000099a5eed5.
00010000:00000040:29.0:1773851847.782935:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 34
00010000:00000001:29.0:1773851847.782936:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:29.0:1773851847.782936:0:60533:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782937:0:60533:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:29.0:1773851847.782938:0:60533:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000eab00ea5/0x21b6f08f07a6ac27 lrc: 3/0,0 mode: PR/PR res: [0x200020d44:0x2cd7:0x0].0x0 bits 0x1/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 9297@kfi7 remote: 0xd6f6229f11ef7ca expref: 1208 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851847.782941:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ef0ef386 count: 1
00010000:00000001:29.0:1773851847.782941:0:60533:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:29.0:1773851847.782942:0:60533:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:29.0:1773851847.782942:0:60533:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200020d44:0x2cd7:0x0].0x0 (00000000ef0ef386)
00010000:00010000:29.0:1773851847.782943:0:60533:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:29.0:1773851847.782944:0:60533:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:29.0:1773851847.782944:0:60533:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851847.782945:0:60533:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:29.0:1773851847.782945:0:60533:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851847.782945:0:60533:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:29.0:1773851847.782946:0:60533:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000eab00ea5, rc 0)
00000020:00000001:29.0:1773851847.782947:0:60533:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851847.782948:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581362, transno 0, xid 1858043420079424
00010000:00000001:29.0:1773851847.782949:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851847.782950:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f3dcb147 x1858043420079424/t0(0) o101->a871cb5b-5147-4743-a621-894b5cc44762@9297@kfi7:635/0 lens 600/640 e 0 to 0 dl 1773851995 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833573739501321216'
00010000:00000001:29.0:1773851847.782952:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851847.782953:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851847.782954:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=80 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851847.782955:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851847.782956:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f587cd0e refcount 3 to 9297@kfi7
00000100:00000001:29.0:1773851847.782957:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064608 : -107155994487008 : ffff9e8acd035720)
02000000:00000001:29.0:1773851847.782958:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851847.782958:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851847.782959:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851847.782960:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9297@kfi7
00000400:00000010:29.0:1773851847.782960:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ecffec9b.
00000100:00000200:29.0:1773851847.782961:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858043420079424, offset 224
00000400:00000200:29.0:1773851847.782963:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9297@kfi7
00000400:00000200:29.0:1773851847.782964:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.782964:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 1
00000400:00000200:29.0:1773851847.782965:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000400:00000200:29.0:1773851847.782967:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 3
00000400:00000200:29.0:1773851847.782968:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9297@kfi7 local destination
00000400:00000200:29.0:1773851847.782969:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768355:8768355:1024:4294967295] 9297@kfi7 LPNI seq info [9440470:9440470:16:4294967295]
00000400:00000200:29.0:1773851847.782971:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000400:00000200:29.0:1773851847.782972:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851847.782973:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9297@kfi7(9297@kfi7:9297@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851847.782975:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 3
00000800:00000200:29.0:1773851847.782976:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851847.782977:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:29.0:1773851847.782980:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851847.782983:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000182 Using peer 9297@kfi7(0x100000000000182)
00000800:00000200:29.0:1773851847.782986:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 740 bytes to peer 0x100000000000182: rc=0
00000800:00000200:29.0:1773851847.782987:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000182 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851847.782989:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851847.782990:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f587cd0e refcount 2 to 9297@kfi7
00010000:00000001:29.0:1773851847.782991:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851847.782992:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851847.782992:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851847.782993:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f3dcb147 x1858043420079424/t0(0) o101->a871cb5b-5147-4743-a621-894b5cc44762@9297@kfi7:635/0 lens 600/640 e 0 to 0 dl 1773851995 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833573739501321216'
00000100:00100000:29.0:1773851847.782996:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3dcb147 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:a871cb5b-5147-4743-a621-894b5cc44762+1208:4101529:x1858043420079424:12345-9297@kfi7:101:tuolumne-833573739501321216 Request processed in 538us (577us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851847.782999:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9297@kfi7, seq: 364304977
00000100:00000040:29.0:1773851847.783000:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cd1be348 : new rpc_count 14
00000800:00000200:30.0:1773851847.783001:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000182 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851847.783001:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851847.783001:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:30.0:1773851847.783002:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851847.783002:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:29.0:1773851847.783002:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000400:00000200:30.0:1773851847.783003:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9297@kfi7: PUT: OK
00000020:00000010:29.0:1773851847.783003:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000400:00000200:30.0:1773851847.783004:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ecffec9b
00000400:00000010:30.0:1773851847.783004:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ecffec9b.
00000020:00000040:29.0:1773851847.783004:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000cd1be348 : new refcount 1207
00000100:00000001:30.0:1773851847.783005:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851847.783005:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:29.0:1773851847.783005:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851847.783006:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000800:00000200:30.0:1773851847.783008:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 9297@kfi7(000000001702e40b):0x0 lsk 387 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000182 Transaction freed
00010000:00000010:29.1F:1773851847.788728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f8ede499.
00010000:00000010:29.1:1773851847.788729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000a93616cb.
00010000:00000010:29.1:1773851847.788730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000040cab34e.
00010000:00000010:29.1:1773851847.788731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f97991ce.
00010000:00000001:2.0:1773851847.817732:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817732:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851847.817733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851847.817735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851847.817736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851847.817737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851847.817738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851847.817739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851847.817740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851847.817741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851847.817745:0:238018:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:11.0:1773851847.817746:0:238018:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851847.817747:0:238018:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851847.922176:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851847.922177:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851847.922180:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851847.922184:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851847.922187:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.922189:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8514@kfi7 : PUT - for me
00000400:00000200:25.0:1773851847.922191:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.922192:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 1
00000400:00000200:25.0:1773851847.922194:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.922195:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000400:00000200:25.0:1773851847.922197:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 3
00000400:00000200:25.0:1773851847.922198:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851847.922200:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8514@kfi7 of length 224 into portal 12 MB=0x69b1941641200
00000400:00000200:25.0:1773851847.922202:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8514@kfi7 of length 224/224 into md 0x16159c6179 [64] + 175424
00000800:00000200:25.0:1773851847.922206:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851847.922209:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851847.922211:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8514@kfi7: PUT: OK
00000100:00000001:25.0:1773851847.922213:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851847.922213:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851847.922216:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009de18498.
00000100:00000040:25.0:1773851847.922217:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000009de18498 x1859382633828864 msgsize 224
00000100:00100000:25.0:1773851847.922220:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8514@kfi7 (source: 12345-8514@kfi7)
00000100:00000001:25.0:1773851847.922222:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851847.922224:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000100:00000001:24.0:1773851847.922225:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851847.922226:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851847.922226:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851847.922226:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851847.922227:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851847.922229:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851847.922230:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859382633828864
00000020:00000001:24.0:1773851847.922231:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851847.922232:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079668825e2
00000020:00000001:24.0:1773851847.922233:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851847.922235:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008b9d793a refcount=8
00000020:00000001:24.0:1773851847.922236:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029441421312 : -107044268130304 : ffff9ea4d06c4000)
00000020:00000001:24.0:1773851847.922238:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029441421312 : -107044268130304 : ffff9ea4d06c4000)
00000100:00000001:24.0:1773851847.922239:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851847.922241:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851847.922242:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042031ddd.
00000020:00000010:24.0:1773851847.922243:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851847.922245:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bc23e3f.
00000100:00000001:24.0:1773851847.922246:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851847.922247:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851847.922248:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851847.922250:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851847.922251:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851847.922252:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.922254:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851847.922256:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851847.922256:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851847.922257:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851847.922257:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851847.922259:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8514@kfi7, seq: 2025026
00000100:00000001:26.0:1773851847.922260:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851847.922260:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008b9d793a : new rpc_count 1
00000100:00000001:26.0:1773851847.922261:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.922261:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700643712 : -106953008907904 : ffff9eba0fe57980)
00000100:00000040:24.0:1773851847.922263:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009de18498 x1859382633828864/t0(0) o400->4eaa24ef-b496-49ee-9889-c2bd9e5f9792@8514@kfi7:33/0 lens 224/0 e 0 to 0 dl 1773852148 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1032-0'
00000100:00000001:24.0:1773851847.922270:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851847.922271:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851847.922273:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009de18498 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4eaa24ef-b496-49ee-9889-c2bd9e5f9792+8:39771:x1859382633828864:12345-8514@kfi7:400:default-tuolumne1032-0
00000100:00000200:24.0:1773851847.922275:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859382633828864
00000020:00000001:24.0:1773851847.922276:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851847.922277:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851847.922278:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.922280:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851847.922281:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851847.922282:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851847.922283:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859382633828864, found 0 last_xid 1859382633828863
00000020:00000001:24.0:1773851847.922284:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851847.922286:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851847.922287:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851847.922287:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.922289:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851847.922289:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851847.922291:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851847.922292:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2acf0ac.
02000000:00000001:24.0:1773851847.922293:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.922294:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.922295:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851847.922297:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182926648606, transno 0, xid 1859382633828864
00010000:00000001:24.0:1773851847.922298:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851847.922299:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009de18498 x1859382633828864/t0(0) o400->4eaa24ef-b496-49ee-9889-c2bd9e5f9792@8514@kfi7:33/0 lens 224/224 e 0 to 0 dl 1773852148 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1032-0'
00010000:00000001:24.0:1773851847.922304:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851847.922305:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851847.922307:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=80 v=288 (288 212 1 1)
00000100:00000001:24.0:1773851847.922309:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851847.922310:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c1a782a refcount 3 to 8514@kfi7
00000100:00000001:24.0:1773851847.922312:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299332160 : -107155410219456 : ffff9e8aefd68e40)
02000000:00000001:24.0:1773851847.922314:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851847.922315:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851847.922316:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851847.922318:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8514@kfi7
00000400:00000010:24.0:1773851847.922319:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c206b7b6.
00000100:00000200:24.0:1773851847.922320:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859382633828864, offset 224
00000400:00000200:24.0:1773851847.922323:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8514@kfi7
00000400:00000200:24.0:1773851847.922325:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:24.0:1773851847.922326:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 1
00000400:00000200:24.0:1773851847.922328:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000400:00000200:24.0:1773851847.922331:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 3
00000400:00000200:24.0:1773851847.922333:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8514@kfi7 local destination
00000400:00000200:24.0:1773851847.922335:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768356:8768356:1024:4294967295] 8514@kfi7 LPNI seq info [6325573:6325573:16:4294967295]
00000400:00000200:24.0:1773851847.922338:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000400:00000200:24.0:1773851847.922339:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:24.0:1773851847.922343:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8514@kfi7(8514@kfi7:8514@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851847.922346:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 3
00000800:00000200:24.0:1773851847.922348:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851847.922350:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851847.922355:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851847.922359:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c4 Using peer 8514@kfi7(0x1000000000010c4)
00000800:00000200:24.0:1773851847.922364:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0x1000000000010c4: rc=0
00000800:00000200:24.0:1773851847.922367:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851847.922371:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851847.922372:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c1a782a refcount 2 to 8514@kfi7
00010000:00000001:24.0:1773851847.922375:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851847.922377:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851847.922378:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851847.922379:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009de18498 x1859382633828864/t0(0) o400->4eaa24ef-b496-49ee-9889-c2bd9e5f9792@8514@kfi7:33/0 lens 224/224 e 0 to 0 dl 1773852148 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1032-0'
00000100:00100000:24.0:1773851847.922385:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009de18498 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4eaa24ef-b496-49ee-9889-c2bd9e5f9792+8:39771:x1859382633828864:12345-8514@kfi7:400:default-tuolumne1032-0 Request processed in 114us (167us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851847.922389:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8514@kfi7, seq: 2025026
00000100:00000040:24.0:1773851847.922390:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008b9d793a : new rpc_count 0
00000100:00000001:24.0:1773851847.922392:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851847.922392:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851847.922394:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851847.922395:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bc23e3f.
00000020:00000010:24.0:1773851847.922396:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042031ddd.
00000020:00000040:24.0:1773851847.922397:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000008b9d793a : new refcount 7
00000100:00000001:24.0:1773851847.922399:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851847.922407:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c4 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851847.922411:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851847.922412:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8514@kfi7: PUT: OK
00000400:00000200:25.0:1773851847.922414:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c206b7b6
00000400:00000010:25.0:1773851847.922415:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c206b7b6.
00000100:00000001:25.0:1773851847.922416:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851847.922417:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851847.922418:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000800:00000200:25.0:1773851847.922421:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 8514@kfi7(00000000a874685b):0x0 lsk 4293 rsk 37 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c4 Transaction freed
00000800:00000200:13.0:1773851847.937868:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851847.937869:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851847.937870:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851847.937872:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851847.937874:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.937875:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10466@kfi7 : PUT - for me
00000400:00000200:13.0:1773851847.937876:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.937877:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 1
00000400:00000200:13.0:1773851847.937878:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.937878:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000400:00000200:13.0:1773851847.937879:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 3
00000400:00000200:13.0:1773851847.937880:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10275@kfi7 to cpt 3
00000400:00000200:13.0:1773851847.937881:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10275@kfi7 of length 224 into portal 12 MB=0x69b8233fa7b40
00000400:00000200:13.0:1773851847.937882:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10275@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 8744
00000800:00000200:13.0:1773851847.937884:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851847.937886:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851847.937887:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10466@kfi7: PUT: OK
00000100:00000001:13.0:1773851847.937888:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851847.937889:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851847.937891:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6167c53.
00000100:00000040:13.0:1773851847.937891:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000a6167c53 x1859833380371264 msgsize 224
00000100:00100000:13.0:1773851847.937893:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10275@kfi7 (source: 12345-10466@kfi7)
00000100:00000001:13.0:1773851847.937894:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851847.937895:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000100:00000001:14.0:1773851847.937896:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851847.937896:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851847.937896:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851847.937897:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851847.937897:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851847.937898:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851847.937899:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833380371264
00000020:00000001:14.0:1773851847.937900:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851847.937900:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c155b0c
00000020:00000001:14.0:1773851847.937901:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851847.937904:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dacefa08 refcount=5
00000020:00000001:14.0:1773851847.937905:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637060389062656 : -107013320488960 : ffff9eac050bc800)
00000020:00000001:14.0:1773851847.937905:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637060389062656 : -107013320488960 : ffff9eac050bc800)
00000100:00000001:14.0:1773851847.937906:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851847.937907:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851847.937907:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cad4d41a.
00000020:00000010:14.0:1773851847.937908:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851847.937909:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851847.937910:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851847.937910:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851847.937911:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851847.937912:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851847.937912:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851847.937912:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851847.937913:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851847.937914:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851847.937915:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851847.937915:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851847.937915:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851847.937916:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10275@kfi7, seq: 2289751
00000100:00000001:15.0:1773851847.937917:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851847.937917:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851847.937917:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dacefa08 : new rpc_count 1
00000100:00000001:14.0:1773851847.937917:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251460352 : -106960458091264 : ffff9eb853e3f500)
00000100:00000040:14.0:1773851847.937918:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6167c53 x1859833380371264/t0(0) o400->023b4f51-6e52-4395-803a-4d036fa1cf09@10275@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1131-0'
00000100:00000001:14.0:1773851847.937921:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851847.937921:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851847.937922:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6167c53 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:023b4f51-6e52-4395-803a-4d036fa1cf09+5:39723:x1859833380371264:12345-10275@kfi7:400:default-tuolumne1131-0
00000100:00000200:14.0:1773851847.937924:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833380371264
00000020:00000001:14.0:1773851847.937924:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851847.937925:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851847.937925:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.937926:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851847.937926:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851847.937927:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851847.937928:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833380371264, found 0 last_xid 1859833380371263
00000020:00000001:14.0:1773851847.937928:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851847.937929:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851847.937929:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851847.937930:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.937930:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851847.937931:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851847.937931:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851847.937932:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000093d0a1a9.
02000000:00000001:14.0:1773851847.937932:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851847.937933:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.937934:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851847.937934:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413770410, transno 0, xid 1859833380371264
00010000:00000001:14.0:1773851847.937935:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851847.937936:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6167c53 x1859833380371264/t0(0) o400->023b4f51-6e52-4395-803a-4d036fa1cf09@10275@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1131-0'
00010000:00000001:14.0:1773851847.937938:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851847.937938:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851847.937939:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=80 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851847.937940:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851847.937940:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc537c6e refcount 3 to 10275@kfi7
00000100:00000001:14.0:1773851847.937941:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148384 : -107154898403232 : ffff9e8b0e584060)
02000000:00000001:14.0:1773851847.937942:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851847.937942:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851847.937943:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851847.937944:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10466@kfi7
00000400:00000010:14.0:1773851847.937944:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000045e97c7a.
00000100:00000200:14.0:1773851847.937945:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833380371264, offset 224
00000400:00000200:14.0:1773851847.937946:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10466@kfi7
00000400:00000200:14.0:1773851847.937947:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:14.0:1773851847.937948:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 1
00000400:00000200:14.0:1773851847.937949:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000400:00000200:14.0:1773851847.937950:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 3
00000400:00000200:14.0:1773851847.937951:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10466@kfi7 local destination
00000400:00000200:14.0:1773851847.937952:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768357:8768357:1024:4294967295] 10466@kfi7 LPNI seq info [205842:205842:16:4294967295]
00000400:00000200:14.0:1773851847.937954:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000400:00000200:14.0:1773851847.937954:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:14.0:1773851847.937956:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10466@kfi7(10466@kfi7:10466@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851847.937958:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 3
00000800:00000200:14.0:1773851847.937959:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851847.937960:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851847.937962:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851847.937964:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b73 Using peer 10466@kfi7(0x100000000000b73)
00000800:00000200:14.0:1773851847.937967:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000004c2b9f01: Posted send of 324 bytes to peer 0x100000000000b73: rc=0
00000800:00000200:14.0:1773851847.937968:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b73 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851847.937970:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851847.937971:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc537c6e refcount 2 to 10275@kfi7
00010000:00000001:14.0:1773851847.937972:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851847.937972:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851847.937973:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851847.937973:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6167c53 x1859833380371264/t0(0) o400->023b4f51-6e52-4395-803a-4d036fa1cf09@10275@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1131-0'
00000100:00100000:14.0:1773851847.937976:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6167c53 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:023b4f51-6e52-4395-803a-4d036fa1cf09+5:39723:x1859833380371264:12345-10275@kfi7:400:default-tuolumne1131-0 Request processed in 54us (84us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851847.937978:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10275@kfi7, seq: 2289751
00000100:00000040:14.0:1773851847.937979:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dacefa08 : new rpc_count 0
00000100:00000001:14.0:1773851847.937979:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851847.937980:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851847.937981:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851847.937981:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000800:00000200:13.0:1773851847.937981:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b73 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851847.937982:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cad4d41a.
00000400:00000200:13.0:1773851847.937982:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:14.0:1773851847.937983:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000dacefa08 : new refcount 4
00000100:00000001:14.0:1773851847.937983:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851847.937983:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10466@kfi7: PUT: OK
00000400:00000200:13.0:1773851847.937984:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000045e97c7a
00000400:00000010:13.0:1773851847.937984:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000045e97c7a.
00000100:00000001:13.0:1773851847.937985:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851847.937985:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851847.937986:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000800:00000200:13.0:1773851847.937988:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 10466@kfi7(00000000d55d6e50):0x0 lsk 2932 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b73 Transaction freed
00000800:00000200:9.0:1773851847.955987:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851847.955988:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851847.955990:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851847.955992:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851847.955994:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.955995:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:9.0:1773851847.955996:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.955997:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:9.0:1773851847.955997:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.955998:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:9.0:1773851847.955999:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:9.0:1773851847.955999:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851847.956001:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 224 into portal 12 MB=0x699e13784a3c0
00000400:00000200:9.0:1773851847.956002:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2080@kfi7 of length 224/224 into md 0x78146ce49 [64] + 113168
00000800:00000200:9.0:1773851847.956004:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851847.956006:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851847.956007:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000100:00000001:9.0:1773851847.956008:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851847.956008:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851847.956009:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f35b1d04.
00000100:00000040:9.0:1773851847.956009:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f35b1d04 x1858042438394816 msgsize 224
00000100:00100000:9.0:1773851847.956011:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-2080@kfi7 (source: 12345-2080@kfi7)
00000100:00000001:9.0:1773851847.956012:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851847.956013:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:8.0:1773851847.956013:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851847.956014:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851847.956014:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851847.956015:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851847.956015:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851847.956016:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851847.956017:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042438394816
00000020:00000001:8.0:1773851847.956017:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851847.956018:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acdb8a7
00000020:00000001:8.0:1773851847.956018:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851847.956020:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f1c78545 refcount=5
00000020:00000001:8.0:1773851847.956021:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636949251805184 : -107124457746432 : ffff9e9224bfd000)
00000020:00000001:8.0:1773851847.956022:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636949251805184 : -107124457746432 : ffff9e9224bfd000)
00000100:00000001:8.0:1773851847.956023:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.956024:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851847.956024:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851847.956026:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851847.956026:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851847.956027:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851847.956028:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851847.956028:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.956029:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851847.956031:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851847.956031:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.956032:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851847.956033:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851847.956034:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851847.956034:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851847.956034:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851847.956035:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2080@kfi7, seq: 2130700
00000100:00000040:8.0:1773851847.956035:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f1c78545 : new rpc_count 1
00000100:00000001:11.0:1773851847.956036:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851847.956036:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.956036:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569647744 : -106988139903872 : ffff9eb1e1ed0480)
00000100:00000040:8.0:1773851847.956037:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f35b1d04 x1858042438394816/t0(0) o400->lustre5-MDT0001-lwp-OST0010_UUID@2080@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba117-0'
00000100:00000001:8.0:1773851847.956040:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851847.956041:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851847.956042:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f35b1d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:lustre5-MDT0001-lwp-OST0010_UUID+5:272593:x1858042438394816:12345-2080@kfi7:400:default-yuba117-0
00000100:00000200:8.0:1773851847.956043:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042438394816
00000020:00000001:8.0:1773851847.956044:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851847.956044:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851847.956045:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.956046:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851847.956046:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851847.956047:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:8.0:1773851847.956048:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851847.956048:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851847.956049:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851847.956049:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.956050:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851847.956050:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851847.956051:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851847.956052:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000520b67e6.
02000000:00000001:8.0:1773851847.956053:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.956053:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.956054:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851847.956055:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858042438394816
00010000:00000001:8.0:1773851847.956056:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851847.956057:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f35b1d04 x1858042438394816/t0(0) o400->lustre5-MDT0001-lwp-OST0010_UUID@2080@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba117-0'
00010000:00000001:8.0:1773851847.956060:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851847.956060:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851847.956061:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=80 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851847.956062:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851847.956063:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000737191e9 refcount 7 to 2080@kfi7
00000100:00000001:8.0:1773851847.956064:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551675072 : -107156157876544 : ffff9e8ac34636c0)
02000000:00000001:8.0:1773851847.956065:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851847.956065:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851847.956066:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851847.956067:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000010:8.0:1773851847.956068:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079e75b3d.
00000100:00000200:8.0:1773851847.956069:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042438394816, offset 224
00000400:00000200:8.0:1773851847.956070:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:8.0:1773851847.956071:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:8.0:1773851847.956072:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:8.0:1773851847.956073:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:8.0:1773851847.956074:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:8.0:1773851847.956076:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2080@kfi7 local destination
00000400:00000200:8.0:1773851847.956077:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768358:8768358:1024:4294967295] 2080@kfi7 LPNI seq info [5404386:5404386:16:4294967295]
00000400:00000200:8.0:1773851847.956079:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:8.0:1773851847.956079:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:8.0:1773851847.956082:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851847.956083:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:8.0:1773851847.956084:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851847.956086:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851847.956088:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851847.956091:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000800:00000200:8.0:1773851847.956096:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000800:00000200:8.0:1773851847.956098:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851847.956100:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851847.956101:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000737191e9 refcount 6 to 2080@kfi7
00010000:00000001:8.0:1773851847.956102:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851847.956102:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851847.956105:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851847.956106:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f35b1d04 x1858042438394816/t0(0) o400->lustre5-MDT0001-lwp-OST0010_UUID@2080@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba117-0'
00000100:00100000:8.0:1773851847.956110:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f35b1d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:lustre5-MDT0001-lwp-OST0010_UUID+5:272593:x1858042438394816:12345-2080@kfi7:400:default-yuba117-0 Request processed in 68us (99us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851847.956113:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2080@kfi7, seq: 2130700
00000100:00000040:8.0:1773851847.956114:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f1c78545 : new rpc_count 0
00000100:00000001:8.0:1773851847.956115:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851847.956115:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851847.956116:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851847.956117:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851847.956118:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851847.956119:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f1c78545 : new refcount 4
00000100:00000001:8.0:1773851847.956120:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851847.956127:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851847.956130:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851847.956131:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000400:00000200:9.0:1773851847.956133:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079e75b3d
00000400:00000010:9.0:1773851847.956133:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079e75b3d.
00000100:00000001:9.0:1773851847.956135:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851847.956136:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851847.956137:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:9.0:1773851847.956140:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000002ec Transaction freed
00000800:00000200:5.0:1773851847.996646:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851847.996647:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851847.996648:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851847.996650:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851847.996653:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:5.0:1773851847.996654:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12243@kfi7 : PUT - for me
00000400:00000200:5.0:1773851847.996655:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:5.0:1773851847.996656:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 1
00000400:00000200:5.0:1773851847.996657:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:5.0:1773851847.996657:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000400:00000200:5.0:1773851847.996658:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 3
00000400:00000200:5.0:1773851847.996660:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12050@kfi7 to cpt 3
00000400:00000200:5.0:1773851847.996661:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12050@kfi7 of length 224 into portal 12 MB=0x69b4b56969000
00000400:00000200:5.0:1773851847.996662:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12050@kfi7 of length 224/224 into md 0x793926dc5 [64] + 112432
00000800:00000200:5.0:1773851847.996664:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851847.996665:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851847.996666:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12243@kfi7: PUT: OK
00000100:00000001:5.0:1773851847.996667:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851847.996667:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851847.996668:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002e3c6712.
00000100:00000040:5.0:1773851847.996669:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000002e3c6712 x1859597737824256 msgsize 224
00000100:00100000:5.0:1773851847.996670:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12050@kfi7 (source: 12345-12243@kfi7)
00000100:00000001:5.0:1773851847.996671:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851847.996672:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000100:00000001:6.0:1773851847.996673:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851847.996673:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851847.996673:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851847.996674:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851847.996674:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851847.996675:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851847.996675:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597737824256
00000020:00000001:6.0:1773851847.996676:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851847.996676:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d811dd
00000020:00000001:6.0:1773851847.996677:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851847.996678:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000097261f1b refcount=5
00000020:00000001:6.0:1773851847.996679:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097955865600 : -106975753686016 : ffff9eb4c433b400)
00000020:00000001:6.0:1773851847.996679:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097955865600 : -106975753686016 : ffff9eb4c433b400)
00000100:00000001:6.0:1773851847.996680:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851847.996681:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851847.996682:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851847.996683:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851847.996684:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851847.996685:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851847.996685:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851847.996685:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851847.996686:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851847.996687:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851847.996687:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.996688:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851847.996689:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851847.996690:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851847.996690:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851847.996690:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851847.996691:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12050@kfi7, seq: 2001827
00000100:00000001:7.0:1773851847.996692:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851847.996692:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.996692:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000097261f1b : new rpc_count 1
00000100:00000001:6.0:1773851847.996693:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095280915968 : -106978428635648 : ffff9eb424c33600)
00000100:00000040:6.0:1773851847.996694:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002e3c6712 x1859597737824256/t0(0) o400->7968d425-dd8b-4e78-b9a0-41d777685fed@12050@kfi7:574/0 lens 224/0 e 0 to 0 dl 1773851934 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1253-0'
00000100:00000001:6.0:1773851847.996696:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851847.996697:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851847.996698:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e3c6712 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7968d425-dd8b-4e78-b9a0-41d777685fed+5:39703:x1859597737824256:12345-12050@kfi7:400:default-tuolumne1253-0
00000100:00000200:6.0:1773851847.996699:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597737824256
00000020:00000001:6.0:1773851847.996699:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851847.996700:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851847.996701:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.996701:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851847.996702:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851847.996702:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851847.996703:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597737824256, found 0 last_xid 1859597737824255
00000020:00000001:6.0:1773851847.996704:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851847.996704:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851847.996705:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851847.996705:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.996706:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851847.996706:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851847.996707:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851847.996707:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c1b77d55.
02000000:00000001:6.0:1773851847.996708:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.996708:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.996709:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851847.996710:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694836, transno 0, xid 1859597737824256
00010000:00000001:6.0:1773851847.996710:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851847.996711:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002e3c6712 x1859597737824256/t0(0) o400->7968d425-dd8b-4e78-b9a0-41d777685fed@12050@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1253-0'
00010000:00000001:6.0:1773851847.996713:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851847.996714:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851847.996715:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=79 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851847.996716:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851847.996717:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000905bc2d2 refcount 3 to 12050@kfi7
00000100:00000001:6.0:1773851847.996717:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621600 : -107151221930016 : ffff9e8be97ac7e0)
02000000:00000001:6.0:1773851847.996718:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851847.996719:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851847.996719:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851847.996720:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12243@kfi7
00000400:00000010:6.0:1773851847.996721:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009150aefe.
00000100:00000200:6.0:1773851847.996721:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597737824256, offset 224
00000400:00000200:6.0:1773851847.996723:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12243@kfi7
00000400:00000200:6.0:1773851847.996723:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:6.0:1773851847.996724:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 1
00000400:00000200:6.0:1773851847.996729:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000400:00000200:6.0:1773851847.996730:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 3
00000400:00000200:6.0:1773851847.996731:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12243@kfi7 local destination
00000400:00000200:6.0:1773851847.996732:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768359:8768359:1024:4294967295] 12243@kfi7 LPNI seq info [823177:823177:16:4294967295]
00000400:00000200:6.0:1773851847.996734:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000400:00000200:6.0:1773851847.996734:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:6.0:1773851847.996736:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12243@kfi7(12243@kfi7:12243@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851847.996738:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 3
00000800:00000200:6.0:1773851847.996739:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851847.996740:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851847.996742:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851847.996744:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000010e8 Using peer 12243@kfi7(0x1000000000010e8)
00000800:00000200:6.0:1773851847.996747:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000e8b9920: Posted send of 324 bytes to peer 0x1000000000010e8: rc=0
00000800:00000200:6.0:1773851847.996748:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000010e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851847.996750:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851847.996751:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000905bc2d2 refcount 2 to 12050@kfi7
00010000:00000001:6.0:1773851847.996752:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851847.996752:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851847.996753:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851847.996753:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002e3c6712 x1859597737824256/t0(0) o400->7968d425-dd8b-4e78-b9a0-41d777685fed@12050@kfi7:574/0 lens 224/224 e 0 to 0 dl 1773851934 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1253-0'
00000100:00100000:6.0:1773851847.996756:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e3c6712 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7968d425-dd8b-4e78-b9a0-41d777685fed+5:39703:x1859597737824256:12345-12050@kfi7:400:default-tuolumne1253-0 Request processed in 59us (86us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851847.996758:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12050@kfi7, seq: 2001827
00000100:00000040:6.0:1773851847.996759:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000097261f1b : new rpc_count 0
00000100:00000001:6.0:1773851847.996759:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851847.996760:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851847.996760:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851847.996761:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000800:00000200:5.0:1773851847.996761:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000010e8 TN_EVENT_TX_OK event status 0
00000020:00000010:6.0:1773851847.996762:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000020:00000040:6.0:1773851847.996762:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000097261f1b : new refcount 4
00000400:00000200:5.0:1773851847.996762:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851847.996763:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851847.996763:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12243@kfi7: PUT: OK
00000400:00000200:5.0:1773851847.996764:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009150aefe
00000400:00000010:5.0:1773851847.996765:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009150aefe.
00000100:00000001:5.0:1773851847.996765:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851847.996766:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851847.996766:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000800:00000200:5.0:1773851847.996768:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 12243@kfi7(0000000038973977):0x0 lsk 4329 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000010e8 Transaction freed
00000004:00000001:25.0:1773851848.009730:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:25.0:1773851848.009731:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851848.009732:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:25.0:1773851848.009732:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000de404431.
00000004:00000020:29.0:1773851848.009733:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851848.009733:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6eabe39.
00000020:00000040:25.0:1773851848.009733:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000020:00000040:29.0:1773851848.009734:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000100:00000001:25.0:1773851848.009734:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851848.009735:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:25.0:1773851848.009735:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851848.009736:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:25.0:1773851848.009736:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851848.009737:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851848.009737:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000014a6e7aa.
02000000:00000010:29.0:1773851848.009739:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
00000100:00000001:29.0:1773851848.009739:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851848.009739:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851848.009740:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851848.009740:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851848.009741:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851848.009741:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851848.009743:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a6eabe39] to pc [ptlrpcd_07_02+2]  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851848.009743:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000de404431] to pc [ptlrpcd_06_00+0]  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851848.009748:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:25.0:1773851848.009748:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851848.009749:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851848.009749:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851848.009749:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:29.0:1773851848.009749:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004b536c60.
00080000:00000001:29.0:1773851848.009749:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636957760651264 : -107115948900352 : ffff9e941fea8000)
00000100:00000001:27.0:1773851848.009749:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851848.009749:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851848.009750:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009750:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:30.0:1773851848.009750:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851848.009750:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:27.0:1773851848.009750:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.009750:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:25.0:1773851848.009750:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000289d2139.
00000100:00000001:26.0:1773851848.009751:0:41084:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:25.0:1773851848.009751:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636964481318912 : -107109228232704 : ffff9e95b07fc000)
00080000:00000001:29.0:1773851848.009752:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851848.009752:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000100:00000040:26.0:1773851848.009752:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:25.0:1773851848.009752:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851848.009753:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:29.0:1773851848.009753:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a445e829.
00080000:00000001:25.0:1773851848.009753:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009754:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:29.0:1773851848.009754:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614122463029669ns, next at 614123463028477ns, rc = 0
00000004:00001000:25.0:1773851848.009754:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
02000000:00000001:30.0:1773851848.009755:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:29.0:1773851848.009755:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00000010:25.0:1773851848.009755:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007e6b5602.
02000000:00000001:30.0:1773851848.009756:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851848.009756:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.009756:0:41084:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:25.0:1773851848.009756:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614122463031883ns, next at 614123463030571ns, rc = 0
00000100:00100000:30.0:1773851848.009757:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a6eabe39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051920576:2090@kfi7:13:default-yuba2-0
00000004:00000001:29.0:1773851848.009757:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.009757:0:41084:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009758:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:26.0:1773851848.009758:0:41084:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:25.0:1773851848.009758:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:30.0:1773851848.009759:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851848.009759:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851848.009759:0:41084:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851848.009759:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851848.009759:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851848.009760:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:26.0:1773851848.009760:0:41084:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000de404431 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051920512:2068@kfi7:13:default-yuba2-0
02000000:00000010:30.0:1773851848.009761:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d4700eda.
02000000:00000001:30.0:1773851848.009761:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851848.009762:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:26.0:1773851848.009762:0:41084:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:30.0:1773851848.009763:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
02000000:00000001:26.0:1773851848.009763:0:41084:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:26.0:1773851848.009763:0:41084:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851848.009764:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e57a604.
02000000:00000001:26.0:1773851848.009764:0:41084:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:30.0:1773851848.009765:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920576, portal 4
02000000:00000010:26.0:1773851848.009765:0:41084:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000513e7f5d.
00000100:00000001:30.0:1773851848.009766:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851848.009766:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637125762057344 : -106947947494272 : ffff9ebb3d948480)
02000000:00000001:26.0:1773851848.009766:0:41084:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851848.009767:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000040:30.0:1773851848.009768:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:26.0:1773851848.009768:0:41084:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000af3b30f4.
00000400:00000010:26.0:1773851848.009769:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004b36f071.
00000100:00000001:30.0:1773851848.009770:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:26.0:1773851848.009770:0:41084:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920512, portal 4
00000100:00000040:30.0:1773851848.009771:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:30.0:1773851848.009771:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f690b6e3.
00000100:00000001:26.0:1773851848.009771:0:41084:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:30.0:1773851848.009772:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920576, offset 0
00000100:00000001:26.0:1773851848.009772:0:41084:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637120700619520 : -106953008932096 : ffff9eba0fe51b00)
00000400:00000200:30.0:1773851848.009773:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000100:00000040:26.0:1773851848.009773:0:41084:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851848.009774:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:30.0:1773851848.009775:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:30.0:1773851848.009776:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:26.0:1773851848.009776:0:41084:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851848.009777:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000040:26.0:1773851848.009777:0:41084:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000200:30.0:1773851848.009778:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000010:26.0:1773851848.009778:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ec73ae2a.
00000100:00000200:26.0:1773851848.009778:0:41084:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920512, offset 0
00000400:00000200:30.0:1773851848.009780:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768354, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768359, p:4294967295, g:4294967295, h:1000]
00000400:00000200:26.0:1773851848.009780:0:41084:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:26.0:1773851848.009781:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:30.0:1773851848.009782:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:26.0:1773851848.009782:0:41084:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:30.0:1773851848.009783:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851848.009783:0:41084:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851848.009784:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:30.0:1773851848.009785:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768360:8768360:1024:4294967295] 2090@kfi7 LPNI seq info [5404246:5404246:16:4294967295]
00000400:00000200:26.0:1773851848.009785:0:41084:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851848.009786:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:26.0:1773851848.009786:0:41084:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:30.0:1773851848.009787:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:26.0:1773851848.009788:0:41084:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768360, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768359, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851848.009790:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851848.009790:0:41084:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851848.009791:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:26.0:1773851848.009791:0:41084:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851848.009792:0:41084:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000800:00000200:30.0:1773851848.009793:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:26.0:1773851848.009793:0:41084:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768361:8768361:1024:4294967295] 2068@kfi7 LPNI seq info [5403694:5403694:16:4294967295]
00000800:00000200:30.0:1773851848.009794:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:26.0:1773851848.009794:0:41084:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:26.0:1773851848.009795:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:30.0:1773851848.009796:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:26.0:1773851848.009798:0:41084:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000800:00000200:30.0:1773851848.009799:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000400:00000200:26.0:1773851848.009799:0:41084:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:26.0:1773851848.009800:0:41084:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:30.0:1773851848.009802:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:26.0:1773851848.009802:0:41084:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851848.009804:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:26.0:1773851848.009805:0:41084:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:30.0:1773851848.009806:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009806:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851848.009807:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851848.009807:0:41084:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000100:00000001:30.0:1773851848.009808:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009808:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851848.009810:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851848.009810:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:26.0:1773851848.009810:0:41084:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000100:00000001:30.0:1773851848.009811:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851848.009811:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851848.009812:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009812:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851848.009812:0:41084:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:29.0:1773851848.009814:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851848.009814:0:41084:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.009814:0:41084:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851848.009815:0:41084:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851848.009816:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851848.009816:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851848.009817:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000100:00000001:26.0:1773851848.009817:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851848.009818:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f690b6e3
00000100:00000001:26.0:1773851848.009818:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851848.009818:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000010:29.0:1773851848.009819:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f690b6e3.
00000100:00000001:26.0:1773851848.009819:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851848.009820:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:26.0:1773851848.009820:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851848.009820:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:29.0:1773851848.009821:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851848.009821:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851848.009822:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851848.009823:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851848.009824:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851848.009824:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851848.009825:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000400:00000200:25.0:1773851848.009826:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ec73ae2a
00000100:00000001:29.0:1773851848.009827:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:25.0:1773851848.009827:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ec73ae2a.
00000100:00000001:25.0:1773851848.009827:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851848.009828:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:25.0:1773851848.009828:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851848.009829:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000800:00000200:29.0:1773851848.009831:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000100:00000001:25.0:1773851848.009831:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:25.0:1773851848.009832:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851848.009834:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851848.009835:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851848.009836:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:25.0:1773851848.009837:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Transaction freed
00000800:00000200:1.0:1773851848.009846:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851848.009847:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851848.009849:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851848.009851:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851848.009853:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851848.009854:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851848.009854:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:1.0:1773851848.009854:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:1.0:1773851848.009855:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851848.009856:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851848.009857:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000800:00000200:21.0:1773851848.009858:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851848.009858:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851848.009859:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851848.009859:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:21.0:1773851848.009860:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851848.009861:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851848.009862:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:1.0:1773851848.009862:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b18c0
00000400:00000200:21.0:1773851848.009863:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851848.009863:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851848.009864:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:21.0:1773851848.009865:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851848.009865:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71c701 [1] + 224
00000400:00000200:21.0:1773851848.009866:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:21.0:1773851848.009867:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:1.0:1773851848.009867:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851848.009868:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851848.009869:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851848.009870:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1880
00000400:00000200:1.0:1773851848.009870:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:21.0:1773851848.009871:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000001:1.0:1773851848.009871:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851848.009872:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d00f5 [1] + 224
00000100:00000200:1.0:1773851848.009873:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851848.009874:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851848.009876:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:1.0:1773851848.009876:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851848.009877:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:21.0:1773851848.009878:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851848.009879:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851848.009880:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851848.009881:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851848.009882:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851848.009882:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:1.0:1773851848.009882:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851848.009883:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851848.009883:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:21.0:1773851848.009883:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851848.009884:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851848.009885:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e57a604
00000400:00000010:30.0:1773851848.009885:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e57a604.
00000100:00000001:30.0:1773851848.009886:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:21.0:1773851848.009886:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:30.0:1773851848.009887:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851848.009887:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:26.0:1773851848.009888:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851848.009888:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851848.009888:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:26.0:1773851848.009889:0:41084:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:30.0:1773851848.009890:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:26.0:1773851848.009890:0:41084:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:26.0:1773851848.009891:0:41084:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000af3b30f4.
00000100:00000001:30.0:1773851848.009892:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:26.0:1773851848.009892:0:41084:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004b36f071
00000400:00000010:26.0:1773851848.009892:0:41084:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004b36f071.
00000100:00000001:30.0:1773851848.009893:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.009893:0:41084:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851848.009894:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851848.009894:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:26.0:1773851848.009894:0:41084:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851848.009895:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851848.009895:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851848.009896:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851848.009897:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=81 v=66 (66 66 66 66)
00000100:00000200:26.0:1773851848.009897:0:41084:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:30.0:1773851848.009898:0:41090:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=81 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851848.009899:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851848.009899:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.009899:0:41084:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:30.0:1773851848.009900:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:26.0:1773851848.009900:0:41084:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:30.0:1773851848.009901:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009901:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:26.0:1773851848.009901:0:41084:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:26.0:1773851848.009901:0:41084:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:30.0:1773851848.009902:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:30.0:1773851848.009902:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851848.009902:0:41084:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851848.009902:0:41084:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009903:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851848.009903:0:41084:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851848.009904:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:26.0:1773851848.009904:0:41084:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=81 v=66 (66 66 66 66)
00000100:00001000:26.0:1773851848.009905:0:41084:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=81 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851848.009906:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851848.009906:0:41084:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851848.009907:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851848.009907:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.009907:0:41084:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851848.009907:0:41084:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000001:30.0:1773851848.009908:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00010000:00000001:26.0:1773851848.009908:0:41084:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:30.0:1773851848.009909:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851848.009909:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351389009920 avail=351386330112 avail_mb=1372602852 hwm_mb=3131103 files=372019234 ffree=343153330 state=0: rc = 0
00000100:00000001:26.0:1773851848.009909:0:41084:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:26.0:1773851848.009910:0:41084:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:26.0:1773851848.009910:0:41084:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000020:30.0:1773851848.009911:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351389009920 free, 351386330112 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019234 files, 343153330 free files
00000100:00000001:26.0:1773851848.009911:0:41084:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851848.009912:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:30.0:1773851848.009913:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851848.009914:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851848.009914:0:41084:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851848.009915:0:41084:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00100000:30.0:1773851848.009916:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a6eabe39 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051920576:2090@kfi7:13:default-yuba2-0
00000100:00000001:26.0:1773851848.009916:0:41084:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851848.009917:0:41084:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:26.0:1773851848.009917:0:41084:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:26.0:1773851848.009918:0:41084:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350959033344 avail=350956953600 avail_mb=1370925600 hwm_mb=3131103 files=371564135 ffree=342733431 state=0: rc = 0
00000100:00000001:30.0:1773851848.009919:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851848.009920:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851848.009920:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a6eabe39 x1859433051920576/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:26.0:1773851848.009920:0:41084:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350959033344 free, 350956953600 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371564135 files, 342733431 free files
00000004:00000001:26.0:1773851848.009922:0:41084:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851848.009923:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851848.009923:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:26.0:1773851848.009923:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:30.0:1773851848.009924:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d4700eda.
02000000:00000001:30.0:1773851848.009925:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851848.009925:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851848.009926:0:41090:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000001:30.0:1773851848.009926:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00100000:26.0:1773851848.009926:0:41084:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000de404431 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051920512:2068@kfi7:13:default-yuba2-0
02000000:00000010:30.0:1773851848.009927:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
00000100:00000001:26.0:1773851848.009927:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851848.009928:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851848.009928:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851848.009928:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6eabe39.
00000100:00000001:26.0:1773851848.009928:0:41084:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851848.009929:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:26.0:1773851848.009929:0:41084:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000de404431 x1859433051920512/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851848.009930:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851848.009930:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851848.009931:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851848.009931:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.009931:0:41084:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:26.0:1773851848.009931:0:41084:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:30.0:1773851848.009932:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851848.009932:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:26.0:1773851848.009932:0:41084:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000513e7f5d.
02000000:00000001:26.0:1773851848.009933:0:41084:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851848.009934:0:41084:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851848.009934:0:41084:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:26.0:1773851848.009935:0:41084:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:26.0:1773851848.009936:0:41084:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000014a6e7aa.
02000000:00000001:26.0:1773851848.009936:0:41084:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851848.009937:0:41084:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851848.009937:0:41084:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de404431.
00000100:00000001:26.0:1773851848.009938:0:41084:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851848.009939:0:41084:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.009939:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.009940:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851848.009940:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.009941:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851848.009941:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851848.044855:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851848.044856:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851848.044857:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851848.044859:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851848.044861:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22304@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.044862:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22304@kfi7 : PUT - for me
00000400:00000200:6.0:1773851848.044863:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22304@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.044864:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024e27cc4 nid 22304@kfi7 refs 1
00000400:00000200:6.0:1773851848.044865:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22304@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.044866:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024e27cc4 nid 22304@kfi7 refs 2
00000400:00000200:6.0:1773851848.044866:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000024e27cc4 nid 22304@kfi7 refs 3
00000400:00000200:6.0:1773851848.044867:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:6.0:1773851848.044869:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22497@kfi7 of length 224 into portal 12 MB=0x69b4bb35307c0
00000400:00000200:6.0:1773851848.044871:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22497@kfi7 of length 224/224 into md 0x793926dc5 [64] + 112656
00000800:00000200:6.0:1773851848.044873:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851848.044874:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851848.044875:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22304@kfi7: PUT: OK
00000100:00000001:6.0:1773851848.044876:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851848.044876:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851848.044877:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000591af34f.
00000100:00000040:6.0:1773851848.044878:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000591af34f x1859599293679552 msgsize 224
00000100:00100000:6.0:1773851848.044879:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-22497@kfi7 (source: 12345-22304@kfi7)
00000100:00000001:6.0:1773851848.044881:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851848.044882:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000024e27cc4 nid 22304@kfi7 refs 2
00000800:00000200:6.0:1773851848.044883:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851848.044885:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851848.044886:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851848.044886:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851848.044887:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851848.044887:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851848.044888:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599293679552
00000020:00000001:6.0:1773851848.044888:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851848.044889:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2432bef5
00000020:00000001:6.0:1773851848.044889:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851848.044893:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000911d9020 refcount=5
00000020:00000001:6.0:1773851848.044894:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132161045504 : -106941548506112 : ffff9ebcbafd5400)
00000020:00000001:6.0:1773851848.044894:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132161045504 : -106941548506112 : ffff9ebcbafd5400)
00000100:00000001:6.0:1773851848.044895:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.044896:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851848.044896:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851848.044897:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851848.044898:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851848.044898:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851848.044899:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851848.044899:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851848.044900:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851848.044900:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851848.044901:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.044901:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851848.044902:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851848.044903:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851848.044903:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851848.044903:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851848.044904:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851848.044904:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22497@kfi7, seq: 2001828
00000100:00000040:6.0:1773851848.044904:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000911d9020 : new rpc_count 1
00000100:00000001:7.0:1773851848.044905:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.044905:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637119644521856 : -106954065029760 : ffff9eb9d0f25580)
00000100:00000040:6.0:1773851848.044906:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000591af34f x1859599293679552/t0(0) o400->34728edc-093c-4cd0-a230-0ca100569825@22497@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1887-0'
00000100:00000001:6.0:1773851848.044908:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.044908:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851848.044909:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000591af34f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:34728edc-093c-4cd0-a230-0ca100569825+5:39530:x1859599293679552:12345-22497@kfi7:400:default-tuolumne1887-0
00000100:00000200:6.0:1773851848.044910:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599293679552
00000020:00000001:6.0:1773851848.044911:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851848.044911:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851848.044911:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.044912:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851848.044912:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851848.044913:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851848.044913:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599293679552, found 0 last_xid 1859599293679551
00000020:00000001:6.0:1773851848.044914:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851848.044914:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851848.044915:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851848.044915:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.044915:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851848.044916:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851848.044916:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851848.044917:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000093676479.
02000000:00000001:6.0:1773851848.044917:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.044918:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.044918:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851848.044919:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105042018, transno 0, xid 1859599293679552
00010000:00000001:6.0:1773851848.044919:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851848.044920:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000591af34f x1859599293679552/t0(0) o400->34728edc-093c-4cd0-a230-0ca100569825@22497@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1887-0'
00010000:00000001:6.0:1773851848.044922:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851848.044922:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851848.044923:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=80 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851848.044924:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851848.044925:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008baeb248 refcount 3 to 22497@kfi7
00000100:00000001:6.0:1773851848.044925:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643689600 : -107157065862016 : ffff9e8a8d277480)
02000000:00000001:6.0:1773851848.044926:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851848.044926:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.044926:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851848.044927:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22304@kfi7
00000400:00000010:6.0:1773851848.044928:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000011f34731.
00000100:00000200:6.0:1773851848.044929:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599293679552, offset 224
00000400:00000200:6.0:1773851848.044930:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22304@kfi7
00000400:00000200:6.0:1773851848.044931:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22304@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.044931:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024e27cc4 nid 22304@kfi7 refs 1
00000400:00000200:6.0:1773851848.044932:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000024e27cc4 nid 22304@kfi7 refs 2
00000400:00000200:6.0:1773851848.044933:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000024e27cc4 nid 22304@kfi7 refs 3
00000400:00000200:6.0:1773851848.044934:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22304@kfi7 local destination
00000400:00000200:6.0:1773851848.044935:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768362:8768362:1024:4294967295] 22304@kfi7 LPNI seq info [5650060:5650060:16:4294967295]
00000400:00000200:6.0:1773851848.044936:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000024e27cc4 nid 22304@kfi7 refs 2
00000400:00000200:6.0:1773851848.044937:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22304@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.044939:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22304@kfi7(22304@kfi7:22304@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851848.044940:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000024e27cc4 nid 22304@kfi7 refs 3
00000800:00000200:6.0:1773851848.044941:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851848.044942:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851848.044945:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851848.044947:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005e5 Using peer 22304@kfi7(0x1000000000005e5)
00000800:00000200:6.0:1773851848.044950:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 324 bytes to peer 0x1000000000005e5: rc=0
00000800:00000200:6.0:1773851848.044952:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005e5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851848.044954:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851848.044954:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008baeb248 refcount 2 to 22497@kfi7
00010000:00000001:6.0:1773851848.044955:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851848.044955:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.044956:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851848.044956:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000591af34f x1859599293679552/t0(0) o400->34728edc-093c-4cd0-a230-0ca100569825@22497@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1887-0'
00000100:00100000:6.0:1773851848.044959:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000591af34f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:34728edc-093c-4cd0-a230-0ca100569825+5:39530:x1859599293679552:12345-22497@kfi7:400:default-tuolumne1887-0 Request processed in 50us (80us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851848.044961:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22497@kfi7, seq: 2001828
00000100:00000040:6.0:1773851848.044961:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000911d9020 : new rpc_count 0
00000100:00000001:6.0:1773851848.044962:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851848.044962:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851848.044962:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851848.044963:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000020:00000010:6.0:1773851848.044964:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000020:00000040:6.0:1773851848.044964:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000911d9020 : new refcount 4
00000100:00000001:6.0:1773851848.044965:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851848.044965:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005e5 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851848.044966:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851848.044967:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22304@kfi7: PUT: OK
00000400:00000200:5.0:1773851848.044968:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000011f34731
00000400:00000010:5.0:1773851848.044971:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000011f34731.
00000100:00000001:5.0:1773851848.044971:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851848.044971:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851848.044972:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000024e27cc4 nid 22304@kfi7 refs 2
00000800:00000200:5.0:1773851848.044973:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 22304@kfi7(0000000036f3e9da):0x0 lsk 1510 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005e5 Transaction freed
00000800:00000200:18.0:1773851848.068010:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851848.068010:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851848.068011:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851848.068012:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851848.068013:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851848.068014:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851848.068016:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12642@kfi7(00000000c61c57ff):0xe1c version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851848.068017:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851848.068020:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c Using peer 12642@kfi7(0x100000000000e1c)
00000400:00000200:18.0:1773851848.068021:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:18.0:1773851848.068023:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12642@kfi7 : PUT - for me
00000400:00000200:17.0:1773851848.068023:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:18.0:1773851848.068024:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:18.0:1773851848.068026:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 1
00000800:00000200:17.0:1773851848.068026:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x100000000000e1c: rc=0
00000400:00000200:18.0:1773851848.068027:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:18.0:1773851848.068029:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000800:00000200:17.0:1773851848.068029:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851848.068030:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 3
00000400:00000200:18.0:1773851848.068032:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12707@kfi7 to cpt 3
00000400:00000200:18.0:1773851848.068034:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12707@kfi7 of length 224 into portal 12 MB=0x69b4b8e9d34c0
00000400:00000200:18.0:1773851848.068036:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12707@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 183000
00000800:00000200:18.0:1773851848.068040:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851848.068043:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851848.068043:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851848.068045:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12642@kfi7: PUT: OK
00000100:00000001:18.0:1773851848.068046:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851848.068047:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:17.0:1773851848.068047:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c Transaction freed
00000100:00000010:18.0:1773851848.068049:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000212eabd.
00000100:00000040:18.0:1773851848.068050:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000000212eabd x1859598677783744 msgsize 224
00000100:00100000:18.0:1773851848.068053:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-12707@kfi7 (source: 12345-12642@kfi7)
00000100:00000001:18.0:1773851848.068055:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851848.068057:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:18.0:1773851848.068057:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
02000000:00000001:19.0:1773851848.068058:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851848.068059:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851848.068059:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851848.068059:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851848.068061:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851848.068062:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598677783744
00000020:00000001:19.0:1773851848.068063:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851848.068064:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79a66
00000020:00000001:19.0:1773851848.068065:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851848.068068:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055a9eff8 refcount=5
00000020:00000001:19.0:1773851848.068070:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636941370246144 : -107132339305472 : ffff9e904ef8c400)
00000020:00000001:19.0:1773851848.068071:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636941370246144 : -107132339305472 : ffff9e904ef8c400)
00000100:00000001:19.0:1773851848.068072:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.068074:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851848.068075:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b6c87683.
00000020:00000010:19.0:1773851848.068076:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851848.068077:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851848.068079:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851848.068080:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851848.068080:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.068082:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851848.068082:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851848.068083:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.068085:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.068087:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851848.068087:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851848.068087:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851848.068088:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851848.068089:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12707@kfi7, seq: 2156233
00000100:00000040:19.0:1773851848.068090:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055a9eff8 : new rpc_count 1
00000100:00000001:18.0:1773851848.068090:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.068091:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534652672 : -106946174898944 : ffff9ebba73c2d00)
00000100:00000001:18.0:1773851848.068091:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.068093:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000212eabd x1859598677783744/t0(0) o400->54dbe7bf-5e5f-47dd-97be-1212a905e149@12707@kfi7:38/0 lens 224/0 e 0 to 0 dl 1773852153 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1276-0'
00000100:00000001:19.0:1773851848.068097:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.068098:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851848.068099:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000212eabd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:54dbe7bf-5e5f-47dd-97be-1212a905e149+5:39542:x1859598677783744:12345-12707@kfi7:400:default-tuolumne1276-0
00000100:00000200:19.0:1773851848.068101:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598677783744
00000020:00000001:19.0:1773851848.068102:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851848.068103:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851848.068104:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.068105:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851848.068106:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851848.068108:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851848.068109:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598677783744, found 0 last_xid 1859598677783743
00000020:00000001:19.0:1773851848.068110:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851848.068111:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851848.068112:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851848.068113:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.068114:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851848.068114:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851848.068115:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851848.068117:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000050c5bc22.
02000000:00000001:19.0:1773851848.068118:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.068119:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.068120:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851848.068121:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182407588634, transno 0, xid 1859598677783744
00010000:00000001:19.0:1773851848.068122:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851848.068124:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000212eabd x1859598677783744/t0(0) o400->54dbe7bf-5e5f-47dd-97be-1212a905e149@12707@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1276-0'
00010000:00000001:19.0:1773851848.068127:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851848.068128:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851848.068129:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=81 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851848.068131:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851848.068132:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036c49ceb refcount 3 to 12707@kfi7
00000100:00000001:19.0:1773851848.068134:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148864 : -107154898402752 : ffff9e8b0e584240)
02000000:00000001:19.0:1773851848.068135:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851848.068135:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.068136:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851848.068138:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12642@kfi7
00000400:00000010:19.0:1773851848.068139:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c549776.
00000100:00000200:19.0:1773851848.068140:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598677783744, offset 224
00000400:00000200:19.0:1773851848.068142:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12642@kfi7
00000400:00000200:19.0:1773851848.068143:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.068145:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 1
00000400:00000200:19.0:1773851848.068147:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000400:00000200:19.0:1773851848.068148:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 3
00000400:00000200:19.0:1773851848.068151:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12642@kfi7 local destination
00000400:00000200:19.0:1773851848.068153:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768363:8768363:1024:4294967295] 12642@kfi7 LPNI seq info [16804114:16804114:16:4294967295]
00000400:00000200:19.0:1773851848.068155:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000400:00000200:19.0:1773851848.068156:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.068159:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12642@kfi7(12642@kfi7:12642@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851848.068161:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 3
00000800:00000200:19.0:1773851848.068164:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851848.068165:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851848.068169:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851848.068172:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c Using peer 12642@kfi7(0x100000000000e1c)
00000800:00000200:19.0:1773851848.068176:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0x100000000000e1c: rc=0
00000800:00000200:19.0:1773851848.068179:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851848.068182:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.068183:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036c49ceb refcount 2 to 12707@kfi7
00010000:00000001:19.0:1773851848.068184:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851848.068185:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.068186:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851848.068187:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000212eabd x1859598677783744/t0(0) o400->54dbe7bf-5e5f-47dd-97be-1212a905e149@12707@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1276-0'
00000100:00100000:19.0:1773851848.068192:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000212eabd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:54dbe7bf-5e5f-47dd-97be-1212a905e149+5:39542:x1859598677783744:12345-12707@kfi7:400:default-tuolumne1276-0 Request processed in 93us (140us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851848.068192:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851848.068195:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12707@kfi7, seq: 2156233
00000400:00000200:17.0:1773851848.068195:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851848.068196:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12642@kfi7: PUT: OK
00000100:00000040:19.0:1773851848.068197:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055a9eff8 : new rpc_count 0
00000100:00000001:19.0:1773851848.068198:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851848.068198:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851848.068198:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c549776
00000400:00000010:17.0:1773851848.068198:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c549776.
00000020:00000010:19.0:1773851848.068200:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000100:00000001:17.0:1773851848.068200:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851848.068200:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851848.068201:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000400:00000200:17.0:1773851848.068202:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000020:00000010:19.0:1773851848.068203:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b6c87683.
00000020:00000040:19.0:1773851848.068204:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000055a9eff8 : new refcount 4
00000800:00000200:17.0:1773851848.068204:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12642@kfi7(00000000c61c57ff):0x0 lsk 3613 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e1c Transaction freed
00000100:00000001:19.0:1773851848.068205:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851848.094962:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851848.094963:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851848.094966:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851848.094969:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851848.094972:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.094976:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.118@tcp : PUT - for me
00000400:00000200:9.0:1773851848.094977:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.094979:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851848.094981:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.118@tcp to cpt 2
00000400:00000200:9.0:1773851848.094982:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 2
00000400:00000200:9.0:1773851848.094984:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 3
00000400:00000200:9.0:1773851848.094985:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.118@tcp to cpt 2
00000400:00000200:9.0:1773851848.094987:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.118@tcp of length 224 into portal 12 MB=0x69a1007e39800
00000400:00000200:9.0:1773851848.094989:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.118@tcp of length 224/224 into md 0x78146ce49 [64] + 113392
00000800:00000200:9.0:1773851848.094992:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851848.094995:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.094997:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851848.094998:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851848.094999:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851848.095000:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006d84eb89.
00000100:00000040:9.0:1773851848.095001:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006d84eb89 x1858243502774272 msgsize 224
00000100:00100000:9.0:1773851848.095004:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.118@tcp (source: 12345-172.16.70.118@tcp)
00000100:00000001:9.0:1773851848.095006:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851848.095007:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:8.0:1773851848.095008:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851848.095008:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851848.095009:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851848.095009:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851848.095010:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851848.095010:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851848.095011:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858243502774272
00000020:00000001:8.0:1773851848.095012:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851848.095012:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930c2
00000020:00000001:8.0:1773851848.095013:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851848.095015:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000f97fd0b refcount=6
00000020:00000001:8.0:1773851848.095017:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745140224 : -107128964411392 : ffff9e9118219000)
00000020:00000001:8.0:1773851848.095018:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745140224 : -107128964411392 : ffff9e9118219000)
00000100:00000001:8.0:1773851848.095019:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.095020:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851848.095020:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851848.095022:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.095023:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851848.095024:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851848.095024:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851848.095025:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.095026:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851848.095026:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851848.095027:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.095028:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.095029:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851848.095030:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851848.095030:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851848.095031:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851848.095031:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.118@tcp, seq: 2130701
00000100:00000001:11.0:1773851848.095032:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.095032:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000f97fd0b : new rpc_count 1
00000100:00000001:11.0:1773851848.095033:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.095033:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569652352 : -106988139899264 : ffff9eb1e1ed1680)
00000100:00000040:8.0:1773851848.095034:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006d84eb89 x1858243502774272/t0(0) o400->5a6e43b0-e804-4dba-a1cb-afef3e141050@172.16.70.118@tcp:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic18-0'
00000100:00000001:8.0:1773851848.095037:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.095038:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851848.095039:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d84eb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:5a6e43b0-e804-4dba-a1cb-afef3e141050+6:50016:x1858243502774272:12345-172.16.70.118@tcp:400:default-rzslic18-0
00000100:00000200:8.0:1773851848.095040:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858243502774272
00000020:00000001:8.0:1773851848.095041:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851848.095042:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851848.095043:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.095043:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851848.095044:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851848.095045:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851848.095045:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858243502774272, found 0 last_xid 1858243502774271
00000020:00000001:8.0:1773851848.095047:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851848.095048:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851848.095048:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851848.095049:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.095050:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851848.095050:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851848.095051:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851848.095053:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b488a45.
02000000:00000001:8.0:1773851848.095054:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.095055:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.095055:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851848.095056:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 172876330691, transno 0, xid 1858243502774272
00010000:00000001:8.0:1773851848.095057:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851848.095058:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006d84eb89 x1858243502774272/t0(0) o400->5a6e43b0-e804-4dba-a1cb-afef3e141050@172.16.70.118@tcp:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic18-0'
00010000:00000001:8.0:1773851848.095061:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851848.095062:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851848.095062:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=81 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851848.095063:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851848.095064:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a2d014b1 refcount 3 to 172.16.70.118@tcp
00000100:00000001:8.0:1773851848.095065:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810486368 : -107154899065248 : ffff9e8b0e4e2660)
02000000:00000001:8.0:1773851848.095066:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851848.095066:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.095067:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851848.095068:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.118@tcp
00000400:00000010:8.0:1773851848.095069:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
00000100:00000200:8.0:1773851848.095069:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858243502774272, offset 224
00000400:00000200:8.0:1773851848.095071:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.118@tcp
00000400:00000200:8.0:1773851848.095072:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.118@tcp to cpt 2
00000400:00000200:8.0:1773851848.095073:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 2
00000400:00000200:8.0:1773851848.095074:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 3
00000400:00000200:8.0:1773851848.095075:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 4
00000400:00000200:8.0:1773851848.095076:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.118@tcp routed destination
00000400:00000200:8.0:1773851848.095078:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:8.0:1773851848.095079:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:8.0:1773851848.095081:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.118@tcp: rtr pref emtpy: 1
00000400:00000200:8.0:1773851848.095082:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:8.0:1773851848.095083:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.118@tcp: rtr pref emtpy: 1
00000400:00000200:8.0:1773851848.095083:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:8.0:1773851848.095084:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768364:8768364:1024:4294967295] 2094@kfi7 LPNI seq info [1258746976:1258746976:16:4294967295]
00000400:00000200:8.0:1773851848.095086:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:8.0:1773851848.095087:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:8.0:1773851848.095089:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.118@tcp(172.16.70.118@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851848.095091:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 3
00000800:00000200:8.0:1773851848.095092:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851848.095093:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851848.095096:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851848.095098:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:8.0:1773851848.095101:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:8.0:1773851848.095102:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851848.095104:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.095105:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a2d014b1 refcount 2 to 172.16.70.118@tcp
00010000:00000001:8.0:1773851848.095106:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851848.095107:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.095107:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851848.095109:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006d84eb89 x1858243502774272/t0(0) o400->5a6e43b0-e804-4dba-a1cb-afef3e141050@172.16.70.118@tcp:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic18-0'
00000100:00100000:8.0:1773851848.095113:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d84eb89 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:5a6e43b0-e804-4dba-a1cb-afef3e141050+6:50016:x1858243502774272:12345-172.16.70.118@tcp:400:default-rzslic18-0 Request processed in 74us (110us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851848.095119:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.118@tcp, seq: 2130701
00000100:00000040:8.0:1773851848.095120:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000f97fd0b : new rpc_count 0
00000100:00000001:8.0:1773851848.095121:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851848.095122:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851848.095122:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.095123:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851848.095124:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851848.095125:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000000f97fd0b : new refcount 5
00000100:00000001:8.0:1773851848.095126:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851848.095132:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851848.095135:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.095136:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:9.0:1773851848.095138:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000400:00000010:9.0:1773851848.095138:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000100:00000001:9.0:1773851848.095140:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851848.095140:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851848.095142:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:9.0:1773851848.095144:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Transaction freed
00000800:00000200:5.0:1773851848.107421:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851848.107423:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851848.107425:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851848.107428:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851848.107431:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.107433:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16034@kfi7 : PUT - for me
00000400:00000200:5.0:1773851848.107434:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.107436:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 1
00000400:00000200:5.0:1773851848.107437:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.107438:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000400:00000200:5.0:1773851848.107440:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 3
00000400:00000200:5.0:1773851848.107441:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:5.0:1773851848.107443:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16035@kfi7 of length 224 into portal 12 MB=0x69b0a099a9e80
00000400:00000200:5.0:1773851848.107445:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16035@kfi7 of length 224/224 into md 0x793926dc5 [64] + 112880
00000800:00000200:5.0:1773851848.107447:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851848.107450:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851848.107452:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16034@kfi7: PUT: OK
00000100:00000001:5.0:1773851848.107453:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851848.107454:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851848.107455:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ba8fe4a.
00000100:00000040:5.0:1773851848.107456:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000006ba8fe4a x1859317273370240 msgsize 224
00000100:00100000:5.0:1773851848.107458:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-16035@kfi7 (source: 12345-16034@kfi7)
00000100:00000001:5.0:1773851848.107460:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851848.107461:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000100:00000001:6.0:1773851848.107462:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851848.107463:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851848.107464:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851848.107464:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851848.107465:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851848.107466:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851848.107467:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317273370240
00000020:00000001:6.0:1773851848.107468:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851848.107469:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ad4
00000020:00000001:6.0:1773851848.107470:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851848.107472:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fb4f09c0 refcount=6
00000020:00000001:6.0:1773851848.107473:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627763200 : -107123081788416 : ffff9e9276c34400)
00000020:00000001:6.0:1773851848.107474:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627763200 : -107123081788416 : ffff9e9276c34400)
00000100:00000001:6.0:1773851848.107475:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.107476:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851848.107476:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851848.107478:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851848.107478:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851848.107479:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851848.107480:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851848.107480:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851848.107481:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851848.107481:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851848.107482:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.107483:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851848.107484:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851848.107484:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851848.107484:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851848.107484:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851848.107486:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851848.107486:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16035@kfi7, seq: 2001829
00000100:00000040:6.0:1773851848.107486:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fb4f09c0 : new rpc_count 1
00000100:00000001:7.0:1773851848.107487:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.107487:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095280910208 : -106978428641408 : ffff9eb424c31f80)
00000100:00000040:6.0:1773851848.107488:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ba8fe4a x1859317273370240/t0(0) o400->ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c@16035@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1484-0'
00000100:00000001:6.0:1773851848.107492:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.107492:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851848.107494:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ba8fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c+6:39860:x1859317273370240:12345-16035@kfi7:400:default-tuolumne1484-0
00000100:00000200:6.0:1773851848.107495:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317273370240
00000020:00000001:6.0:1773851848.107496:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851848.107496:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851848.107499:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.107500:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851848.107500:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851848.107501:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851848.107502:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317273370240, found 0 last_xid 1859317273370239
00000020:00000001:6.0:1773851848.107503:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851848.107503:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851848.107504:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851848.107505:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.107505:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851848.107506:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851848.107507:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851848.107507:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000169a6455.
02000000:00000001:6.0:1773851848.107508:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.107509:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.107509:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851848.107510:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317273370240
00010000:00000001:6.0:1773851848.107511:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851848.107512:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ba8fe4a x1859317273370240/t0(0) o400->ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c@16035@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1484-0'
00010000:00000001:6.0:1773851848.107515:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851848.107516:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851848.107516:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=80 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851848.107517:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851848.107518:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3423137 refcount 5 to 16035@kfi7
00000100:00000001:6.0:1773851848.107519:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519008 : -107156126032608 : ffff9e8ac52c1d20)
02000000:00000001:6.0:1773851848.107520:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851848.107520:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.107521:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851848.107522:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16034@kfi7
00000400:00000010:6.0:1773851848.107522:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000114436b6.
00000100:00000200:6.0:1773851848.107523:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317273370240, offset 224
00000400:00000200:6.0:1773851848.107524:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16034@kfi7
00000400:00000200:6.0:1773851848.107525:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.107526:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 1
00000400:00000200:6.0:1773851848.107527:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000400:00000200:6.0:1773851848.107528:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 3
00000400:00000200:6.0:1773851848.107530:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16034@kfi7 local destination
00000400:00000200:6.0:1773851848.107531:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768365:8768365:1024:4294967295] 16034@kfi7 LPNI seq info [1163065:1163065:16:4294967295]
00000400:00000200:6.0:1773851848.107532:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000400:00000200:6.0:1773851848.107533:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.107535:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16034@kfi7(16034@kfi7:16034@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851848.107536:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 3
00000800:00000200:6.0:1773851848.107537:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851848.107538:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851848.107541:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851848.107543:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x790 Using peer 16034@kfi7(0x790)
00000800:00000200:6.0:1773851848.107546:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000235b3e16: Posted send of 324 bytes to peer 0x790: rc=0
00000800:00000200:6.0:1773851848.107547:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x790 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851848.107549:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851848.107550:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3423137 refcount 4 to 16035@kfi7
00010000:00000001:6.0:1773851848.107551:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851848.107551:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.107552:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851848.107553:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ba8fe4a x1859317273370240/t0(0) o400->ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c@16035@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1484-0'
00000100:00100000:6.0:1773851848.107555:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ba8fe4a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c+6:39860:x1859317273370240:12345-16035@kfi7:400:default-tuolumne1484-0 Request processed in 63us (98us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851848.107557:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16035@kfi7, seq: 2001829
00000100:00000040:6.0:1773851848.107558:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fb4f09c0 : new rpc_count 0
00000100:00000001:6.0:1773851848.107559:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851848.107559:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851848.107560:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000800:00000200:5.0:1773851848.107560:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x790 TN_EVENT_TX_OK event status 0
00000020:00000010:6.0:1773851848.107561:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000020:00000010:6.0:1773851848.107561:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000400:00000200:5.0:1773851848.107561:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:6.0:1773851848.107562:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000fb4f09c0 : new refcount 5
00000400:00000200:5.0:1773851848.107562:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16034@kfi7: PUT: OK
00000100:00000001:6.0:1773851848.107563:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851848.107563:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000114436b6
00000400:00000010:5.0:1773851848.107564:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000114436b6.
00000100:00000001:5.0:1773851848.107564:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851848.107564:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851848.107565:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000800:00000200:5.0:1773851848.107567:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 16034@kfi7(00000000275a7a2b):0x0 lsk 1937 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x790 Transaction freed
00000800:00000200:30.0:1773851848.223037:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851848.223038:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851848.223040:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851848.223042:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851848.223044:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:30.0:1773851848.223045:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19395@kfi7 : PUT - for me
00000400:00000200:30.0:1773851848.223046:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:30.0:1773851848.223046:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 1
00000400:00000200:30.0:1773851848.223047:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:30.0:1773851848.223048:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:30.0:1773851848.223049:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000400:00000200:30.0:1773851848.223050:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19394@kfi7 to cpt 4
00000400:00000200:30.0:1773851848.223051:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19394@kfi7 of length 224 into portal 12 MB=0x69b097c920440
00000400:00000200:30.0:1773851848.223052:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19394@kfi7 of length 224/224 into md 0x77fe139dd [64] + 154624
00000800:00000200:30.0:1773851848.223054:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851848.223056:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851848.223057:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19395@kfi7: PUT: OK
00000100:00000001:30.0:1773851848.223058:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851848.223059:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851848.223060:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006db6dd3a.
00000100:00000040:30.0:1773851848.223060:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000006db6dd3a x1859314907219008 msgsize 224
00000100:00100000:30.0:1773851848.223062:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-19394@kfi7 (source: 12345-19395@kfi7)
00000100:00000001:30.0:1773851848.223063:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851848.223064:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000100:00000001:29.0:1773851848.223064:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851848.223065:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:29.0:1773851848.223065:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851848.223066:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851848.223066:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851848.223067:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851848.223068:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314907219008
00000020:00000001:29.0:1773851848.223069:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851848.223069:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c4d
00000020:00000001:29.0:1773851848.223070:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851848.223075:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eccb7df6 refcount=6
00000020:00000001:29.0:1773851848.223075:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743945216 : -107128965606400 : ffff9e91180f5400)
00000020:00000001:29.0:1773851848.223076:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743945216 : -107128965606400 : ffff9e91180f5400)
00000100:00000001:29.0:1773851848.223077:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851848.223078:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851848.223079:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b92c4ee7.
00000020:00000010:29.0:1773851848.223080:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851848.223081:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000499d5685.
00000100:00000001:29.0:1773851848.223082:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851848.223083:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851848.223083:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851848.223084:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851848.223085:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851848.223085:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851848.223086:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.223088:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851848.223088:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851848.223088:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851848.223088:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851848.223089:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19394@kfi7, seq: 2055436
00000100:00000040:31.0:1773851848.223090:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eccb7df6 : new rpc_count 1
00000100:00000001:29.0:1773851848.223090:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.223091:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000832512 : -107100708719104 : ffff9e97ac4d3600)
00000100:00000001:29.0:1773851848.223091:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.223092:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006db6dd3a x1859314907219008/t0(0) o400->67c43a80-88b3-4f02-9cae-8e23142e67d4@19394@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1703-0'
00000100:00000001:31.0:1773851848.223094:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.223095:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851848.223096:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006db6dd3a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:67c43a80-88b3-4f02-9cae-8e23142e67d4+6:39960:x1859314907219008:12345-19394@kfi7:400:default-tuolumne1703-0
00000100:00000200:31.0:1773851848.223097:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314907219008
00000020:00000001:31.0:1773851848.223098:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851848.223098:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851848.223099:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.223100:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851848.223100:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851848.223101:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851848.223101:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314907219008, found 0 last_xid 1859314907219007
00000020:00000001:31.0:1773851848.223102:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851848.223103:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851848.223103:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851848.223104:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.223104:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851848.223105:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851848.223105:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851848.223106:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000050a6fdc2.
02000000:00000001:31.0:1773851848.223107:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.223107:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.223108:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851848.223108:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314907219008
00010000:00000001:31.0:1773851848.223109:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851848.223110:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006db6dd3a x1859314907219008/t0(0) o400->67c43a80-88b3-4f02-9cae-8e23142e67d4@19394@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1703-0'
00010000:00000001:31.0:1773851848.223112:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851848.223113:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851848.223113:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=81 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851848.223114:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851848.223115:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e162e19 refcount 5 to 19394@kfi7
00000100:00000001:31.0:1773851848.223115:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370152288 : -107145339399328 : ffff9e8d481b1360)
02000000:00000001:31.0:1773851848.223116:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851848.223117:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.223117:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851848.223118:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19395@kfi7
00000400:00000010:31.0:1773851848.223119:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d658250.
00000100:00000200:31.0:1773851848.223119:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314907219008, offset 224
00000400:00000200:31.0:1773851848.223120:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19395@kfi7
00000400:00000200:31.0:1773851848.223121:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.223122:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 1
00000400:00000200:31.0:1773851848.223123:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:31.0:1773851848.223124:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000400:00000200:31.0:1773851848.223125:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19395@kfi7 local destination
00000400:00000200:31.0:1773851848.223126:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768366:8768366:1024:4294967295] 19395@kfi7 LPNI seq info [8381838:8381838:16:4294967295]
00000400:00000200:31.0:1773851848.223128:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:31.0:1773851848.223128:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.223130:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19395@kfi7(19395@kfi7:19395@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851848.223131:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000800:00000200:31.0:1773851848.223132:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851848.223133:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851848.223135:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851848.223137:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc Using peer 19395@kfi7(0x5fc)
00000800:00000200:31.0:1773851848.223140:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x5fc: rc=0
00000800:00000200:31.0:1773851848.223141:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851848.223143:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.223143:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e162e19 refcount 4 to 19394@kfi7
00010000:00000001:31.0:1773851848.223144:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851848.223144:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.223145:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851848.223145:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006db6dd3a x1859314907219008/t0(0) o400->67c43a80-88b3-4f02-9cae-8e23142e67d4@19394@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1703-0'
00000100:00100000:31.0:1773851848.223148:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006db6dd3a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:67c43a80-88b3-4f02-9cae-8e23142e67d4+6:39960:x1859314907219008:12345-19394@kfi7:400:default-tuolumne1703-0 Request processed in 53us (87us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851848.223150:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19394@kfi7, seq: 2055436
00000100:00000040:31.0:1773851848.223151:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eccb7df6 : new rpc_count 0
00000100:00000001:31.0:1773851848.223151:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851848.223152:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851848.223153:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:31.0:1773851848.223153:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000499d5685.
00000800:00000200:29.0:1773851848.223153:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851848.223154:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b92c4ee7.
00000020:00000040:31.0:1773851848.223155:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000eccb7df6 : new refcount 5
00000100:00000001:31.0:1773851848.223155:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851848.223155:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851848.223156:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19395@kfi7: PUT: OK
00000400:00000200:29.0:1773851848.223156:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d658250
00000400:00000010:29.0:1773851848.223157:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d658250.
00000100:00000001:29.0:1773851848.223159:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851848.223159:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851848.223160:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000800:00000200:29.0:1773851848.223161:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc Transaction freed
00000800:00000200:5.0:1773851848.228848:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851848.228849:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851848.228851:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851848.228853:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851848.228855:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.228856:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22736@kfi7 : PUT - for me
00000400:00000200:5.0:1773851848.228857:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.228858:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 1
00000400:00000200:5.0:1773851848.228859:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.228859:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000400:00000200:5.0:1773851848.228860:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 3
00000400:00000200:5.0:1773851848.228861:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.228862:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22736@kfi7 of length 224 into portal 12 MB=0x699e192433200
00000400:00000200:5.0:1773851848.228863:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22736@kfi7 of length 224/224 into md 0x793926dc5 [64] + 113104
00000800:00000200:5.0:1773851848.228865:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851848.228869:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851848.228870:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22736@kfi7: PUT: OK
00000100:00000001:5.0:1773851848.228871:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851848.228871:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851848.228872:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c88ff90f.
00000100:00000040:5.0:1773851848.228873:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000c88ff90f x1858043960832512 msgsize 224
00000100:00100000:5.0:1773851848.228874:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22736@kfi7 (source: 12345-22736@kfi7)
00000100:00000001:5.0:1773851848.228875:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851848.228876:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000100:00000001:6.0:1773851848.228877:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851848.228878:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851848.228878:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851848.228878:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851848.228879:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851848.228880:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851848.228880:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043960832512
00000020:00000001:6.0:1773851848.228881:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851848.228882:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a39
00000020:00000001:6.0:1773851848.228882:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851848.228884:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fcc40cd0 refcount=6
00000020:00000001:6.0:1773851848.228885:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743448576 : -107128966103040 : ffff9e911807c000)
00000020:00000001:6.0:1773851848.228886:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743448576 : -107128966103040 : ffff9e911807c000)
00000100:00000001:6.0:1773851848.228886:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.228887:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851848.228888:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851848.228889:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851848.228890:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851848.228890:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851848.228891:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851848.228892:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851848.228892:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851848.228893:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851848.228893:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.228894:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851848.228895:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851848.228895:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851848.228896:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851848.228896:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851848.228897:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22736@kfi7, seq: 2001830
00000100:00000040:6.0:1773851848.228897:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fcc40cd0 : new rpc_count 1
00000100:00000001:7.0:1773851848.228898:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851848.228898:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.228898:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095280927488 : -106978428624128 : ffff9eb424c36300)
00000100:00000040:6.0:1773851848.228899:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c88ff90f x1858043960832512/t0(0) o400->2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58@22736@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1905-0'
00000100:00000001:6.0:1773851848.228902:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.228902:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851848.228903:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c88ff90f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58+6:39620:x1858043960832512:12345-22736@kfi7:400:default-tuolumne1905-0
00000100:00000200:6.0:1773851848.228904:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043960832512
00000020:00000001:6.0:1773851848.228905:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851848.228905:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851848.228906:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.228906:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851848.228907:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851848.228907:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851848.228908:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043960832512, found 0 last_xid 1858043960832511
00000020:00000001:6.0:1773851848.228909:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851848.228909:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851848.228910:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851848.228910:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.228911:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851848.228911:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851848.228912:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851848.228912:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009797a914.
02000000:00000001:6.0:1773851848.228913:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.228914:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.228914:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851848.228915:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098908664, transno 0, xid 1858043960832512
00010000:00000001:6.0:1773851848.228916:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851848.228916:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c88ff90f x1858043960832512/t0(0) o400->2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58@22736@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1905-0'
00010000:00000001:6.0:1773851848.228918:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851848.228919:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851848.228919:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=80 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851848.228921:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851848.228921:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000540099d9 refcount 3 to 22736@kfi7
00000100:00000001:6.0:1773851848.228922:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411040 : -107145304140576 : ffff9e8d4a3514e0)
02000000:00000001:6.0:1773851848.228922:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851848.228923:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.228923:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851848.228924:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22736@kfi7
00000400:00000010:6.0:1773851848.228925:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004a88ec3c.
00000100:00000200:6.0:1773851848.228925:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043960832512, offset 224
00000400:00000200:6.0:1773851848.228926:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22736@kfi7
00000400:00000200:6.0:1773851848.228927:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.228928:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 1
00000400:00000200:6.0:1773851848.228929:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000400:00000200:6.0:1773851848.228929:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 3
00000400:00000200:6.0:1773851848.228931:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22736@kfi7 local destination
00000400:00000200:6.0:1773851848.228932:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768367:8768367:1024:4294967295] 22736@kfi7 LPNI seq info [17841031:17841031:16:4294967295]
00000400:00000200:6.0:1773851848.228933:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000400:00000200:6.0:1773851848.228934:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.228935:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22736@kfi7(22736@kfi7:22736@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851848.228936:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 3
00000800:00000200:6.0:1773851848.228937:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851848.228938:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851848.228940:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851848.228942:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x953 Using peer 22736@kfi7(0x953)
00000800:00000200:6.0:1773851848.228945:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000618b435b: Posted send of 324 bytes to peer 0x953: rc=0
00000800:00000200:6.0:1773851848.228946:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x953 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851848.228948:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851848.228949:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000540099d9 refcount 2 to 22736@kfi7
00010000:00000001:6.0:1773851848.228949:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851848.228950:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.228950:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851848.228951:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c88ff90f x1858043960832512/t0(0) o400->2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58@22736@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1905-0'
00000100:00100000:6.0:1773851848.228953:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c88ff90f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58+6:39620:x1858043960832512:12345-22736@kfi7:400:default-tuolumne1905-0 Request processed in 51us (80us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851848.228956:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22736@kfi7, seq: 2001830
00000100:00000040:6.0:1773851848.228956:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fcc40cd0 : new rpc_count 0
00000100:00000001:6.0:1773851848.228957:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851848.228957:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851848.228958:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851848.228958:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000800:00000200:5.0:1773851848.228958:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x953 TN_EVENT_TX_OK event status 0
00000020:00000010:6.0:1773851848.228959:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000400:00000200:5.0:1773851848.228959:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:6.0:1773851848.228960:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000fcc40cd0 : new refcount 5
00000100:00000001:6.0:1773851848.228960:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851848.228960:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22736@kfi7: PUT: OK
00000400:00000200:5.0:1773851848.228961:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004a88ec3c
00000400:00000010:5.0:1773851848.228961:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004a88ec3c.
00000100:00000001:5.0:1773851848.228962:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851848.228962:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851848.228963:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000800:00000200:5.0:1773851848.228964:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 22736@kfi7(00000000c1e0f138):0x0 lsk 2388 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x953 Transaction freed
00000800:00000200:29.0:1773851848.316891:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851848.316892:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851848.316893:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851848.316896:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851848.316899:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.316902:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23793@kfi7 : PUT - for me
00000400:00000200:29.0:1773851848.316904:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.316906:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 1
00000400:00000200:29.0:1773851848.316908:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.316909:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000400:00000200:29.0:1773851848.316911:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 3
00000400:00000200:29.0:1773851848.316913:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:29.0:1773851848.316914:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23601@kfi7 of length 224 into portal 12 MB=0x69b09d7094380
00000400:00000200:29.0:1773851848.316917:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23601@kfi7 of length 224/224 into md 0x77fe139dd [64] + 154848
00000800:00000200:29.0:1773851848.316922:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851848.316925:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851848.316927:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23793@kfi7: PUT: OK
00000100:00000001:29.0:1773851848.316929:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851848.316930:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851848.316931:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000099be4fd9.
00000100:00000040:29.0:1773851848.316933:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000099be4fd9 x1859316424983424 msgsize 224
00000100:00100000:29.0:1773851848.316936:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23601@kfi7 (source: 12345-23793@kfi7)
00000100:00000001:29.0:1773851848.316938:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851848.316940:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851848.316940:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:29.0:1773851848.316940:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000100:00000001:31.0:1773851848.316941:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851848.316941:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851848.316942:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851848.316943:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316424983424
00000020:00000001:31.0:1773851848.316944:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851848.316944:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e08
00000800:00000200:29.0:1773851848.316944:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000020:00000001:31.0:1773851848.316945:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851848.316946:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000073eddc97 refcount=6
00000020:00000001:31.0:1773851848.316947:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239636992 : -107152469914624 : ffff9e8b9f180c00)
00000020:00000001:31.0:1773851848.316948:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239636992 : -107152469914624 : ffff9e8b9f180c00)
00000100:00000001:31.0:1773851848.316949:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.316951:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851848.316951:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851848.316953:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851848.316954:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851848.316954:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851848.316955:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851848.316955:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.316957:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851848.316957:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851848.316958:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.316959:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.316960:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851848.316960:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851848.316962:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23601@kfi7, seq: 2055437
00000100:00000040:31.0:1773851848.316962:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000073eddc97 : new rpc_count 1
00000100:00000001:29.0:1773851848.316962:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851848.316962:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851848.316963:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125762087296 : -106947947464320 : ffff9ebb3d94f980)
00000100:00000001:29.0:1773851848.316963:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.316964:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000099be4fd9 x1859316424983424/t0(0) o400->65dcbf64-8a8a-4216-acb5-bb5ac5392ac1@23601@kfi7:636/0 lens 224/0 e 0 to 0 dl 1773851996 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1965-0'
00000100:00000001:29.0:1773851848.316965:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.316968:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.316968:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851848.316969:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099be4fd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:65dcbf64-8a8a-4216-acb5-bb5ac5392ac1+6:39833:x1859316424983424:12345-23601@kfi7:400:default-tuolumne1965-0
00000100:00000200:31.0:1773851848.316971:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316424983424
00000020:00000001:31.0:1773851848.316972:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851848.316972:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851848.316973:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.316974:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851848.316975:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851848.316976:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851848.316976:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316424983424, found 0 last_xid 1859316424983423
00000020:00000001:31.0:1773851848.316977:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851848.316978:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851848.316979:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851848.316979:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.316980:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851848.316981:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851848.316982:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851848.316983:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000084317c76.
02000000:00000001:31.0:1773851848.316983:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.316984:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.316985:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851848.316986:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859316424983424
00010000:00000001:31.0:1773851848.316987:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851848.316988:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000099be4fd9 x1859316424983424/t0(0) o400->65dcbf64-8a8a-4216-acb5-bb5ac5392ac1@23601@kfi7:636/0 lens 224/224 e 0 to 0 dl 1773851996 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1965-0'
00010000:00000001:31.0:1773851848.316990:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851848.316991:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851848.316992:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=81 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851848.316993:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851848.316994:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ab3415d6 refcount 5 to 23601@kfi7
00000100:00000001:31.0:1773851848.316995:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583903744 : -107156125647872 : ffff9e8ac531fc00)
02000000:00000001:31.0:1773851848.316996:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851848.316997:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.316998:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851848.316999:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23793@kfi7
00000400:00000010:31.0:1773851848.317000:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f33d0462.
00000100:00000200:31.0:1773851848.317000:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316424983424, offset 224
00000400:00000200:31.0:1773851848.317002:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23793@kfi7
00000400:00000200:31.0:1773851848.317003:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.317004:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 1
00000400:00000200:31.0:1773851848.317005:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000400:00000200:31.0:1773851848.317006:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 3
00000400:00000200:31.0:1773851848.317008:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23793@kfi7 local destination
00000400:00000200:31.0:1773851848.317009:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768368:8768368:1024:4294967295] 23793@kfi7 LPNI seq info [169906:169906:16:4294967295]
00000400:00000200:31.0:1773851848.317011:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000400:00000200:31.0:1773851848.317012:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.317014:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23793@kfi7(23793@kfi7:23793@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851848.317016:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 3
00000800:00000200:31.0:1773851848.317017:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851848.317018:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851848.317021:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851848.317024:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e4d Using peer 23793@kfi7(0x100000000000e4d)
00000800:00000200:31.0:1773851848.317027:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x100000000000e4d: rc=0
00000800:00000200:31.0:1773851848.317029:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e4d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851848.317032:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.317032:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ab3415d6 refcount 4 to 23601@kfi7
00010000:00000001:31.0:1773851848.317033:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851848.317034:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.317035:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851848.317036:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000099be4fd9 x1859316424983424/t0(0) o400->65dcbf64-8a8a-4216-acb5-bb5ac5392ac1@23601@kfi7:636/0 lens 224/224 e 0 to 0 dl 1773851996 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1965-0'
00000100:00100000:31.0:1773851848.317039:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099be4fd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:65dcbf64-8a8a-4216-acb5-bb5ac5392ac1+6:39833:x1859316424983424:12345-23601@kfi7:400:default-tuolumne1965-0 Request processed in 70us (105us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851848.317042:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23601@kfi7, seq: 2055437
00000100:00000040:31.0:1773851848.317042:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000073eddc97 : new rpc_count 0
00000100:00000001:31.0:1773851848.317043:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851848.317044:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:30.0:1773851848.317044:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e4d TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851848.317045:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851848.317045:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000400:00000200:30.0:1773851848.317045:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851848.317046:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000400:00000200:30.0:1773851848.317046:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23793@kfi7: PUT: OK
00000020:00000040:31.0:1773851848.317047:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000073eddc97 : new refcount 5
00000400:00000200:30.0:1773851848.317047:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f33d0462
00000400:00000010:30.0:1773851848.317047:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f33d0462.
00000100:00000001:31.0:1773851848.317048:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851848.317048:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851848.317049:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851848.317049:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000800:00000200:30.0:1773851848.317051:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 23793@kfi7(000000004e700048):0x0 lsk 3662 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e4d Transaction freed
00000800:00000200:15.0:1773851848.324961:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851848.324962:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851848.324963:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851848.324966:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851848.324968:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:15.0:1773851848.324970:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19027@kfi7 : PUT - for me
00000400:00000200:15.0:1773851848.324971:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:15.0:1773851848.324972:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 1
00000400:00000200:15.0:1773851848.324973:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:15.0:1773851848.324974:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000400:00000200:15.0:1773851848.324975:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 3
00000400:00000200:15.0:1773851848.324976:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19091@kfi7 to cpt 7
00000400:00000200:15.0:1773851848.324977:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19091@kfi7 of length 224 into portal 12 MB=0x69b4b67b44f40
00000400:00000200:15.0:1773851848.324978:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19091@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 8968
00000800:00000200:15.0:1773851848.324981:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851848.324983:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851848.324985:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19027@kfi7: PUT: OK
00000100:00000001:15.0:1773851848.324986:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851848.324986:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851848.324987:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed8eca7b.
00000100:00000040:15.0:1773851848.324988:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000ed8eca7b x1859598024986432 msgsize 224
00000100:00100000:15.0:1773851848.324990:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-19091@kfi7 (source: 12345-19027@kfi7)
00000100:00000001:15.0:1773851848.324991:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851848.324992:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000100:00000001:14.0:1773851848.324993:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851848.324993:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:15.0:1773851848.324994:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851848.324994:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851848.324994:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851848.324995:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851848.324995:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598024986432
00000020:00000001:14.0:1773851848.324996:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851848.324996:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822e6
00000020:00000001:14.0:1773851848.324997:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851848.324999:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000003288035 refcount=5
00000020:00000001:14.0:1773851848.325000:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637099150530560 : -106974559021056 : ffff9eb50b68d800)
00000020:00000001:14.0:1773851848.325001:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637099150530560 : -106974559021056 : ffff9eb50b68d800)
00000100:00000001:14.0:1773851848.325002:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.325002:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851848.325003:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cad4d41a.
00000020:00000010:14.0:1773851848.325004:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851848.325004:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851848.325005:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851848.325006:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851848.325006:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.325007:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851848.325007:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851848.325008:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.325009:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851848.325010:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851848.325010:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851848.325010:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851848.325011:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851848.325011:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19091@kfi7, seq: 2289752
00000100:00000001:15.0:1773851848.325012:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.325012:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000003288035 : new rpc_count 1
00000100:00000001:14.0:1773851848.325012:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860226432 : -107049849325184 : ffff9ea383c1f980)
00000100:00000001:15.0:1773851848.325013:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.325014:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed8eca7b x1859598024986432/t0(0) o400->f0a87ff1-2cb8-41f1-b1a9-2291c64402d6@19091@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1686-0'
00000100:00000001:14.0:1773851848.325016:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.325016:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851848.325017:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed8eca7b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f0a87ff1-2cb8-41f1-b1a9-2291c64402d6+5:39731:x1859598024986432:12345-19091@kfi7:400:default-tuolumne1686-0
00000100:00000200:14.0:1773851848.325018:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598024986432
00000020:00000001:14.0:1773851848.325019:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851848.325019:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851848.325020:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.325020:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851848.325021:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851848.325022:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851848.325022:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598024986432, found 0 last_xid 1859598024986431
00000020:00000001:14.0:1773851848.325023:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851848.325023:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851848.325024:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851848.325024:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.325025:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851848.325025:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851848.325026:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851848.325028:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006695ef5c.
02000000:00000001:14.0:1773851848.325029:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.325031:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.325032:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851848.325032:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688634, transno 0, xid 1859598024986432
00010000:00000001:14.0:1773851848.325033:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851848.325034:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed8eca7b x1859598024986432/t0(0) o400->f0a87ff1-2cb8-41f1-b1a9-2291c64402d6@19091@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1686-0'
00010000:00000001:14.0:1773851848.325036:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851848.325036:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851848.325037:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=81 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851848.325038:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851848.325039:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b4aa1c4 refcount 3 to 19091@kfi7
00000100:00000001:14.0:1773851848.325039:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212768 : -107155106338848 : ffff9e8b01f367e0)
02000000:00000001:14.0:1773851848.325040:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851848.325040:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.325041:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851848.325042:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19027@kfi7
00000400:00000010:14.0:1773851848.325042:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000686c292d.
00000100:00000200:14.0:1773851848.325043:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598024986432, offset 224
00000400:00000200:14.0:1773851848.325044:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19027@kfi7
00000400:00000200:14.0:1773851848.325044:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.325045:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 1
00000400:00000200:14.0:1773851848.325046:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000400:00000200:14.0:1773851848.325047:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 3
00000400:00000200:14.0:1773851848.325048:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19027@kfi7 local destination
00000400:00000200:14.0:1773851848.325049:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768369:8768369:1024:4294967295] 19027@kfi7 LPNI seq info [2017411:2017411:16:4294967295]
00000400:00000200:14.0:1773851848.325050:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000400:00000200:14.0:1773851848.325051:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.325053:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19027@kfi7(19027@kfi7:19027@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851848.325054:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 3
00000800:00000200:14.0:1773851848.325055:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851848.325056:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851848.325060:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851848.325062:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010e2 Using peer 19027@kfi7(0x1000000000010e2)
00000800:00000200:14.0:1773851848.325064:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000e70f539d: Posted send of 324 bytes to peer 0x1000000000010e2: rc=0
00000800:00000200:14.0:1773851848.325066:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851848.325068:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.325068:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b4aa1c4 refcount 2 to 19091@kfi7
00010000:00000001:14.0:1773851848.325069:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851848.325069:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.325070:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851848.325070:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed8eca7b x1859598024986432/t0(0) o400->f0a87ff1-2cb8-41f1-b1a9-2291c64402d6@19091@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1686-0'
00000100:00100000:14.0:1773851848.325074:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed8eca7b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f0a87ff1-2cb8-41f1-b1a9-2291c64402d6+5:39731:x1859598024986432:12345-19091@kfi7:400:default-tuolumne1686-0 Request processed in 57us (84us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851848.325075:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19091@kfi7, seq: 2289752
00000100:00000040:14.0:1773851848.325076:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000003288035 : new rpc_count 0
00000100:00000001:14.0:1773851848.325077:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851848.325077:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851848.325078:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851848.325078:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000800:00000200:15.0:1773851848.325079:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010e2 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851848.325079:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cad4d41a.
00000020:00000040:14.0:1773851848.325080:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000003288035 : new refcount 4
00000100:00000001:14.0:1773851848.325080:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851848.325081:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851848.325082:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19027@kfi7: PUT: OK
00000400:00000200:15.0:1773851848.325083:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000686c292d
00000400:00000010:15.0:1773851848.325083:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000686c292d.
00000100:00000001:15.0:1773851848.325084:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851848.325084:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851848.325085:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000800:00000200:15.0:1773851848.325086:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2054@kfi7:3 -> 19027@kfi7(000000009d7bafbd):0x0 lsk 4323 rsk 16 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010e2 Transaction freed
00000800:00000200:25.0:1773851848.411351:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851848.411352:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851848.411353:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851848.411356:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851848.411357:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.411359:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24497@kfi7 : PUT - for me
00000400:00000200:25.0:1773851848.411360:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.411361:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 1
00000400:00000200:25.0:1773851848.411361:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.411362:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000400:00000200:25.0:1773851848.411363:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 3
00000400:00000200:25.0:1773851848.411363:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24432@kfi7 to cpt 7
00000400:00000200:25.0:1773851848.411364:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24432@kfi7 of length 224 into portal 12 MB=0x69b4b5e468980
00000400:00000200:25.0:1773851848.411366:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24432@kfi7 of length 224/224 into md 0x16159c6179 [64] + 175648
00000800:00000200:25.0:1773851848.411367:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851848.411369:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851848.411370:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24497@kfi7: PUT: OK
00000100:00000001:25.0:1773851848.411370:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851848.411371:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851848.411372:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000220e4f48.
00000100:00000040:25.0:1773851848.411372:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000220e4f48 x1859597866797440 msgsize 224
00000100:00100000:25.0:1773851848.411374:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24432@kfi7 (source: 12345-24497@kfi7)
00000100:00000001:25.0:1773851848.411375:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851848.411376:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000100:00000001:24.0:1773851848.411376:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851848.411377:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851848.411377:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851848.411377:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851848.411378:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851848.411378:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851848.411379:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597866797440
00000020:00000001:24.0:1773851848.411379:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851848.411380:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e243842e8
00000020:00000001:24.0:1773851848.411380:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851848.411381:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cce34234 refcount=5
00000020:00000001:24.0:1773851848.411382:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637156957308928 : -106916752242688 : ffff9ec280f64800)
00000020:00000001:24.0:1773851848.411383:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637156957308928 : -106916752242688 : ffff9ec280f64800)
00000100:00000001:24.0:1773851848.411384:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851848.411384:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851848.411385:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042031ddd.
00000020:00000010:24.0:1773851848.411386:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851848.411386:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bc23e3f.
00000100:00000001:24.0:1773851848.411387:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851848.411388:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851848.411389:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851848.411390:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851848.411390:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851848.411391:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.411391:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.411393:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851848.411393:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851848.411393:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851848.411394:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851848.411394:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24432@kfi7, seq: 2025027
00000100:00000001:26.0:1773851848.411395:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851848.411395:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cce34234 : new rpc_count 1
00000100:00000001:26.0:1773851848.411396:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.411396:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700631040 : -106953008920576 : ffff9eba0fe54800)
00000100:00000040:24.0:1773851848.411397:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000220e4f48 x1859597866797440/t0(0) o400->2ca23292-9077-47ca-b72f-098910436688@24432@kfi7:34/0 lens 224/0 e 0 to 0 dl 1773852149 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2014-0'
00000100:00000001:24.0:1773851848.411400:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851848.411400:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851848.411401:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000220e4f48 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:2ca23292-9077-47ca-b72f-098910436688+5:39531:x1859597866797440:12345-24432@kfi7:400:default-tuolumne2014-0
00000100:00000200:24.0:1773851848.411403:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597866797440
00000020:00000001:24.0:1773851848.411403:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851848.411404:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851848.411404:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.411405:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851848.411406:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851848.411406:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851848.411407:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597866797440, found 0 last_xid 1859597866797439
00000020:00000001:24.0:1773851848.411408:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851848.411408:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851848.411409:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851848.411409:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.411410:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851848.411411:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851848.411411:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851848.411412:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003510becf.
02000000:00000001:24.0:1773851848.411412:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.411414:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.411414:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851848.411415:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014451382, transno 0, xid 1859597866797440
00010000:00000001:24.0:1773851848.411416:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851848.411417:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000220e4f48 x1859597866797440/t0(0) o400->2ca23292-9077-47ca-b72f-098910436688@24432@kfi7:34/0 lens 224/224 e 0 to 0 dl 1773852149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2014-0'
00010000:00000001:24.0:1773851848.411419:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851848.411420:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851848.411420:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=81 v=288 (288 212 1 1)
00000100:00000001:24.0:1773851848.411421:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851848.411422:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000029d07190 refcount 3 to 24432@kfi7
00000100:00000001:24.0:1773851848.411423:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066720 : -107155994484896 : ffff9e8acd035f60)
02000000:00000001:24.0:1773851848.411423:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851848.411424:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.411425:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851848.411426:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24497@kfi7
00000400:00000010:24.0:1773851848.411426:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000460dc888.
00000100:00000200:24.0:1773851848.411427:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597866797440, offset 224
00000400:00000200:24.0:1773851848.411428:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24497@kfi7
00000400:00000200:24.0:1773851848.411429:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:24.0:1773851848.411430:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 1
00000400:00000200:24.0:1773851848.411431:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000400:00000200:24.0:1773851848.411432:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 3
00000400:00000200:24.0:1773851848.411433:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24497@kfi7 local destination
00000400:00000200:24.0:1773851848.411434:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768370:8768370:1024:4294967295] 24497@kfi7 LPNI seq info [206233:206233:16:4294967295]
00000400:00000200:24.0:1773851848.411436:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000400:00000200:24.0:1773851848.411436:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:24.0:1773851848.411438:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24497@kfi7(24497@kfi7:24497@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851848.411439:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 3
00000800:00000200:24.0:1773851848.411441:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851848.411442:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851848.411446:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851848.411448:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b0b Using peer 24497@kfi7(0x100000000000b0b)
00000800:00000200:24.0:1773851848.411452:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x100000000000b0b: rc=0
00000800:00000200:24.0:1773851848.411453:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b0b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851848.411455:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851848.411456:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000029d07190 refcount 2 to 24432@kfi7
00010000:00000001:24.0:1773851848.411457:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851848.411458:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.411458:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851848.411459:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000220e4f48 x1859597866797440/t0(0) o400->2ca23292-9077-47ca-b72f-098910436688@24432@kfi7:34/0 lens 224/224 e 0 to 0 dl 1773852149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2014-0'
00000100:00100000:24.0:1773851848.411463:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000220e4f48 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:2ca23292-9077-47ca-b72f-098910436688+5:39531:x1859597866797440:12345-24432@kfi7:400:default-tuolumne2014-0 Request processed in 62us (90us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851848.411465:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24432@kfi7, seq: 2025027
00000100:00000040:24.0:1773851848.411466:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cce34234 : new rpc_count 0
00000100:00000001:24.0:1773851848.411467:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851848.411467:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851848.411468:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851848.411469:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bc23e3f.
00000020:00000010:24.0:1773851848.411469:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042031ddd.
00000020:00000040:24.0:1773851848.411470:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000cce34234 : new refcount 4
00000100:00000001:24.0:1773851848.411471:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851848.411476:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b0b TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851848.411477:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851848.411478:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24497@kfi7: PUT: OK
00000400:00000200:25.0:1773851848.411479:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000460dc888
00000400:00000010:25.0:1773851848.411479:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000460dc888.
00000100:00000001:25.0:1773851848.411480:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851848.411480:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851848.411481:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000800:00000200:25.0:1773851848.411483:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 24497@kfi7(0000000014c8c78e):0x0 lsk 2828 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b0b Transaction freed
00000800:00000200:1.0:1773851848.412383:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851848.412384:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851848.412386:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851848.412388:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851848.412389:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:1.0:1773851848.412390:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19890@kfi7 : PUT - for me
00000400:00000200:1.0:1773851848.412391:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:1.0:1773851848.412392:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 1
00000400:00000200:1.0:1773851848.412393:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:1.0:1773851848.412394:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000400:00000200:1.0:1773851848.412394:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 3
00000400:00000200:1.0:1773851848.412395:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19826@kfi7 to cpt 4
00000400:00000200:1.0:1773851848.412396:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19826@kfi7 of length 224 into portal 12 MB=0x69b56663ce280
00000400:00000200:1.0:1773851848.412397:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19826@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 2912
00000800:00000200:1.0:1773851848.412399:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851848.412401:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851848.412402:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19890@kfi7: PUT: OK
00000100:00000001:1.0:1773851848.412403:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851848.412403:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851848.412404:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad7c7439.
00000100:00000040:1.0:1773851848.412405:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000ad7c7439 x1859645245022848 msgsize 224
00000100:00100000:1.0:1773851848.412406:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-19826@kfi7 (source: 12345-19890@kfi7)
00000100:00000001:1.0:1773851848.412407:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851848.412408:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000100:00000001:2.0:1773851848.412409:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851848.412409:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851848.412410:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851848.412410:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851848.412411:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851848.412412:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851848.412413:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859645245022848
00000020:00000001:2.0:1773851848.412413:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851848.412414:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07fcc9f14b2
00000020:00000001:2.0:1773851848.412415:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851848.412416:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000df4f2df7 refcount=5
00000020:00000001:2.0:1773851848.412416:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119431355392 : -106954278196224 : ffff9eb9c43dac00)
00000020:00000001:2.0:1773851848.412417:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119431355392 : -106954278196224 : ffff9eb9c43dac00)
00000100:00000001:2.0:1773851848.412418:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851848.412419:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851848.412420:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009abda479.
00000020:00000010:2.0:1773851848.412421:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851848.412422:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ebfb08ad.
00000100:00000001:2.0:1773851848.412423:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851848.412424:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851848.412424:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851848.412425:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851848.412426:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851848.412426:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.412427:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851848.412428:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851848.412429:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851848.412429:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851848.412429:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851848.412430:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19826@kfi7, seq: 1997465
00000100:00000040:2.0:1773851848.412431:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000df4f2df7 : new rpc_count 1
00000100:00000001:1.0:1773851848.412431:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.412432:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114618885632 : -106959090665984 : ffff9eb8a5653600)
00000100:00000001:1.0:1773851848.412432:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851848.412433:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad7c7439 x1859645245022848/t0(0) o400->4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2@19826@kfi7:488/0 lens 224/0 e 0 to 0 dl 1773852603 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1722-0'
00000100:00000001:2.0:1773851848.412436:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851848.412437:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851848.412437:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad7c7439 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2+5:39435:x1859645245022848:12345-19826@kfi7:400:default-tuolumne1722-0
00000100:00000200:2.0:1773851848.412439:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859645245022848
00000020:00000001:2.0:1773851848.412440:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851848.412440:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851848.412441:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851848.412442:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851848.412442:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851848.412443:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851848.412443:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859645245022848, found 0 last_xid 1859645245022847
00000020:00000001:2.0:1773851848.412444:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851848.412445:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851848.412445:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851848.412446:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851848.412446:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851848.412447:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851848.412447:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851848.412448:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f113e5be.
02000000:00000001:2.0:1773851848.412449:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.412449:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851848.412450:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851848.412450:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183243429325, transno 0, xid 1859645245022848
00010000:00000001:2.0:1773851848.412451:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851848.412452:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad7c7439 x1859645245022848/t0(0) o400->4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2@19826@kfi7:488/0 lens 224/224 e 0 to 0 dl 1773852603 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1722-0'
00010000:00000001:2.0:1773851848.412454:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851848.412455:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851848.412455:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=81 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851848.412457:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851848.412457:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000460c7ee0 refcount 3 to 19826@kfi7
00000100:00000001:2.0:1773851848.412458:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583950016 : -107156125601600 : ffff9e8ac532b0c0)
02000000:00000001:2.0:1773851848.412459:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851848.412459:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.412460:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851848.412461:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19890@kfi7
00000400:00000010:2.0:1773851848.412461:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b98af3b.
00000100:00000200:2.0:1773851848.412462:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859645245022848, offset 224
00000400:00000200:2.0:1773851848.412464:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19890@kfi7
00000400:00000200:2.0:1773851848.412464:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:2.0:1773851848.412465:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 1
00000400:00000200:2.0:1773851848.412466:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000400:00000200:2.0:1773851848.412467:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 3
00000400:00000200:2.0:1773851848.412469:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19890@kfi7 local destination
00000400:00000200:2.0:1773851848.412470:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768371:8768371:1024:4294967295] 19890@kfi7 LPNI seq info [7780850:7780850:16:4294967295]
00000400:00000200:2.0:1773851848.412471:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000400:00000200:2.0:1773851848.412472:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:2.0:1773851848.412474:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19890@kfi7(19890@kfi7:19890@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851848.412475:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 3
00000800:00000200:2.0:1773851848.412476:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851848.412478:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851848.412480:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851848.412482:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x38 Using peer 19890@kfi7(0x38)
00000800:00000200:2.0:1773851848.412484:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000497e951d: Posted send of 324 bytes to peer 0x38: rc=0
00000800:00000200:2.0:1773851848.412486:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x38 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851848.412488:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851848.412488:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000460c7ee0 refcount 2 to 19826@kfi7
00010000:00000001:2.0:1773851848.412489:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851848.412490:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851848.412490:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851848.412491:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad7c7439 x1859645245022848/t0(0) o400->4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2@19826@kfi7:488/0 lens 224/224 e 0 to 0 dl 1773852603 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1722-0'
00000100:00100000:2.0:1773851848.412494:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad7c7439 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2+5:39435:x1859645245022848:12345-19826@kfi7:400:default-tuolumne1722-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851848.412496:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19826@kfi7, seq: 1997465
00000100:00000040:2.0:1773851848.412497:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000df4f2df7 : new rpc_count 0
00000100:00000001:2.0:1773851848.412498:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851848.412498:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:1.0:1773851848.412498:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x38 TN_EVENT_TX_OK event status 0
00000020:00000010:2.0:1773851848.412499:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851848.412499:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ebfb08ad.
00000020:00000010:2.0:1773851848.412500:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009abda479.
00000400:00000200:1.0:1773851848.412500:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:2.0:1773851848.412501:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000df4f2df7 : new refcount 4
00000400:00000200:1.0:1773851848.412501:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19890@kfi7: PUT: OK
00000400:00000200:1.0:1773851848.412501:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b98af3b
00000100:00000001:2.0:1773851848.412502:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:1.0:1773851848.412502:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b98af3b.
00000100:00000001:1.0:1773851848.412502:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851848.412503:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851848.412504:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000800:00000200:1.0:1773851848.412505:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 19890@kfi7(000000005c53c465):0x0 lsk 57 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x38 Transaction freed
00000800:00000200:17.0:1773851848.414817:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851848.414818:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851848.414820:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851848.414823:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851848.414826:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.414828:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12786@kfi7 : PUT - for me
00000400:00000200:17.0:1773851848.414829:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.414830:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 1
00000400:00000200:17.0:1773851848.414832:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.414833:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000400:00000200:17.0:1773851848.414834:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 3
00000400:00000200:17.0:1773851848.414836:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.414837:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12786@kfi7 of length 224 into portal 12 MB=0x69b4b8106c2c0
00000400:00000200:17.0:1773851848.414840:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12786@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 183224
00000800:00000200:17.0:1773851848.414842:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851848.414845:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851848.414847:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12786@kfi7: PUT: OK
00000100:00000001:17.0:1773851848.414848:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851848.414849:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851848.414850:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000099caa41.
00000100:00000040:17.0:1773851848.414852:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000099caa41 x1859598449820352 msgsize 224
00000100:00100000:17.0:1773851848.414854:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12786@kfi7 (source: 12345-12786@kfi7)
00000100:00000001:17.0:1773851848.414856:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851848.414857:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000100:00000001:19.0:1773851848.414858:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851848.414859:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851848.414860:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851848.414860:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851848.414861:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851848.414862:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851848.414863:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598449820352
00000020:00000001:19.0:1773851848.414864:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851848.414864:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e245ddf4c
00000020:00000001:19.0:1773851848.414865:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851848.414867:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005b803923 refcount=5
00000020:00000001:19.0:1773851848.414868:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132524703744 : -106941184847872 : ffff9ebcd0aa5000)
00000020:00000001:19.0:1773851848.414869:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132524703744 : -106941184847872 : ffff9ebcd0aa5000)
00000100:00000001:19.0:1773851848.414870:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.414872:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851848.414872:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b6c87683.
00000020:00000010:19.0:1773851848.414874:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851848.414875:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851848.414876:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851848.414877:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851848.414878:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.414880:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851848.414880:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851848.414881:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.414883:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.414885:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851848.414885:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851848.414885:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851848.414886:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851848.414887:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12786@kfi7, seq: 2156234
00000100:00000040:19.0:1773851848.414888:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005b803923 : new rpc_count 1
00000100:00000001:18.0:1773851848.414888:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.414889:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109870474752 : -106963839076864 : ffff9eb78a5e3600)
00000100:00000001:18.0:1773851848.414889:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.414891:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000099caa41 x1859598449820352/t0(0) o400->ca7d03a7-fc3b-410a-94b6-a537f5113cc8@12786@kfi7:38/0 lens 224/0 e 0 to 0 dl 1773852153 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1273-0'
00000100:00000001:19.0:1773851848.414896:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.414896:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851848.414898:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000099caa41 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ca7d03a7-fc3b-410a-94b6-a537f5113cc8+5:39672:x1859598449820352:12345-12786@kfi7:400:default-tuolumne1273-0
00000100:00000200:19.0:1773851848.414900:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598449820352
00000020:00000001:19.0:1773851848.414900:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851848.414901:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851848.414902:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.414903:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851848.414904:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851848.414905:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851848.414906:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598449820352, found 0 last_xid 1859598449820351
00000020:00000001:19.0:1773851848.414907:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851848.414908:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851848.414909:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851848.414910:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.414911:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851848.414912:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851848.414912:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851848.414914:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd868df9.
02000000:00000001:19.0:1773851848.414915:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.414916:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.414917:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851848.414918:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691627, transno 0, xid 1859598449820352
00010000:00000001:19.0:1773851848.414919:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851848.414920:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000099caa41 x1859598449820352/t0(0) o400->ca7d03a7-fc3b-410a-94b6-a537f5113cc8@12786@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1273-0'
00010000:00000001:19.0:1773851848.414924:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851848.414925:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851848.414926:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=81 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851848.414928:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851848.414929:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dbe767d4 refcount 3 to 12786@kfi7
00000100:00000001:19.0:1773851848.414930:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547200 : -107156126004416 : ffff9e8ac52c8b40)
02000000:00000001:19.0:1773851848.414931:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851848.414932:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.414933:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851848.414935:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12786@kfi7
00000400:00000010:19.0:1773851848.414936:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001c1fd52d.
00000100:00000200:19.0:1773851848.414937:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598449820352, offset 224
00000400:00000200:19.0:1773851848.414939:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12786@kfi7
00000400:00000200:19.0:1773851848.414940:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.414942:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 1
00000400:00000200:19.0:1773851848.414943:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000400:00000200:19.0:1773851848.414945:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 3
00000400:00000200:19.0:1773851848.414947:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12786@kfi7 local destination
00000400:00000200:19.0:1773851848.414950:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768372:8768372:1024:4294967295] 12786@kfi7 LPNI seq info [8011870:8011870:16:4294967295]
00000400:00000200:19.0:1773851848.414952:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000400:00000200:19.0:1773851848.414954:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.414958:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12786@kfi7(12786@kfi7:12786@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851848.414960:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 3
00000800:00000200:19.0:1773851848.414962:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851848.414964:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851848.414968:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851848.414973:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000937 Using peer 12786@kfi7(0x100000000000937)
00000800:00000200:19.0:1773851848.414977:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0x100000000000937: rc=0
00000800:00000200:19.0:1773851848.414980:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000937 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851848.414984:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.414986:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dbe767d4 refcount 2 to 12786@kfi7
00010000:00000001:19.0:1773851848.414987:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851848.414989:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.414990:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851848.414991:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000099caa41 x1859598449820352/t0(0) o400->ca7d03a7-fc3b-410a-94b6-a537f5113cc8@12786@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1273-0'
00000800:00000200:17.0:1773851848.414995:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000937 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851848.414997:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000099caa41 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ca7d03a7-fc3b-410a-94b6-a537f5113cc8+5:39672:x1859598449820352:12345-12786@kfi7:400:default-tuolumne1273-0 Request processed in 100us (144us total) trans 0 rc 0/0
00000400:00000200:17.0:1773851848.415000:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851848.415001:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12786@kfi7, seq: 2156234
00000100:00000040:19.0:1773851848.415002:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005b803923 : new rpc_count 0
00000400:00000200:17.0:1773851848.415002:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12786@kfi7: PUT: OK
00000100:00000001:19.0:1773851848.415003:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851848.415003:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001c1fd52d
00000100:00000001:19.0:1773851848.415004:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:17.0:1773851848.415004:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001c1fd52d.
00000020:00000010:19.0:1773851848.415005:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000100:00000001:17.0:1773851848.415005:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:19.0:1773851848.415006:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000100:00000001:17.0:1773851848.415006:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851848.415007:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000020:00000010:19.0:1773851848.415008:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b6c87683.
00000020:00000040:19.0:1773851848.415009:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000005b803923 : new refcount 4
00000100:00000001:19.0:1773851848.415010:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851848.415010:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 12786@kfi7(000000003525d1ac):0x0 lsk 2360 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000937 Transaction freed
00000800:00000200:13.0:1773851848.429087:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851848.429088:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851848.429089:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851848.429091:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851848.429094:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.429095:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13456@kfi7 : PUT - for me
00000400:00000200:13.0:1773851848.429096:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.429097:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 1
00000400:00000200:13.0:1773851848.429098:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.429099:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000400:00000200:13.0:1773851848.429100:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 3
00000400:00000200:13.0:1773851848.429101:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13393@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.429102:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13393@kfi7 of length 224 into portal 12 MB=0x69b0986f14640
00000400:00000200:13.0:1773851848.429104:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13393@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 9192
00000800:00000200:13.0:1773851848.429106:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851848.429108:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851848.429109:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13456@kfi7: PUT: OK
00000100:00000001:13.0:1773851848.429110:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851848.429111:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851848.429112:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bcf69ad7.
00000100:00000040:13.0:1773851848.429113:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000bcf69ad7 x1859315081233984 msgsize 224
00000100:00100000:13.0:1773851848.429116:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13393@kfi7 (source: 12345-13456@kfi7)
00000100:00000001:13.0:1773851848.429117:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851848.429119:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000100:00000001:14.0:1773851848.429120:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851848.429121:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851848.429121:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851848.429121:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851848.429122:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851848.429123:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851848.429125:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315081233984
00000020:00000001:14.0:1773851848.429126:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851848.429127:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92eae
00000020:00000001:14.0:1773851848.429128:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851848.429131:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000b4833b9 refcount=6
00000020:00000001:14.0:1773851848.429133:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744666112 : -107128964885504 : ffff9e91181a5400)
00000020:00000001:14.0:1773851848.429134:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744666112 : -107128964885504 : ffff9e91181a5400)
00000100:00000001:14.0:1773851848.429136:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.429137:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851848.429138:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cad4d41a.
00000020:00000010:14.0:1773851848.429140:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851848.429141:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851848.429143:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851848.429144:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851848.429144:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.429146:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851848.429147:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851848.429148:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.429149:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.429151:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851848.429152:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851848.429152:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851848.429153:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851848.429154:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13393@kfi7, seq: 2289753
00000100:00000001:15.0:1773851848.429156:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.429156:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000b4833b9 : new rpc_count 1
00000100:00000001:15.0:1773851848.429157:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.429157:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251435008 : -106960458116608 : ffff9eb853e39200)
00000100:00000040:14.0:1773851848.429159:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bcf69ad7 x1859315081233984/t0(0) o400->ea062319-fd1d-4bbd-8620-0e1458450484@13393@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1330-0'
00000100:00000001:14.0:1773851848.429165:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.429166:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851848.429167:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bcf69ad7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ea062319-fd1d-4bbd-8620-0e1458450484+6:39593:x1859315081233984:12345-13393@kfi7:400:default-tuolumne1330-0
00000100:00000200:14.0:1773851848.429170:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315081233984
00000020:00000001:14.0:1773851848.429171:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851848.429172:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851848.429174:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.429175:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851848.429176:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851848.429177:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851848.429178:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315081233984, found 0 last_xid 1859315081233983
00000020:00000001:14.0:1773851848.429180:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851848.429181:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851848.429182:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851848.429183:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.429184:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851848.429185:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851848.429186:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851848.429187:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000090869bf1.
02000000:00000001:14.0:1773851848.429188:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.429189:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.429190:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851848.429192:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096673860, transno 0, xid 1859315081233984
00010000:00000001:14.0:1773851848.429193:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851848.429195:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bcf69ad7 x1859315081233984/t0(0) o400->ea062319-fd1d-4bbd-8620-0e1458450484@13393@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1330-0'
00010000:00000001:14.0:1773851848.429199:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851848.429200:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851848.429201:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=81 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851848.429204:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851848.429205:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000062e2e3a7 refcount 3 to 13393@kfi7
00000100:00000001:14.0:1773851848.429206:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487619680 : -107151221931936 : ffff9e8be97ac060)
02000000:00000001:14.0:1773851848.429207:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851848.429208:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.429209:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851848.429211:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13456@kfi7
00000400:00000010:14.0:1773851848.429212:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000100:00000200:14.0:1773851848.429214:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315081233984, offset 224
00000400:00000200:14.0:1773851848.429216:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13456@kfi7
00000400:00000200:14.0:1773851848.429218:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.429219:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 1
00000400:00000200:14.0:1773851848.429221:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000400:00000200:14.0:1773851848.429223:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 3
00000400:00000200:14.0:1773851848.429226:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13456@kfi7 local destination
00000400:00000200:14.0:1773851848.429228:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768373:8768373:1024:4294967295] 13456@kfi7 LPNI seq info [9761478:9761478:16:4294967295]
00000400:00000200:14.0:1773851848.429231:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000400:00000200:14.0:1773851848.429232:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.429236:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13456@kfi7(13456@kfi7:13456@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851848.429238:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 3
00000800:00000200:14.0:1773851848.429241:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851848.429243:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2069@kfi7:3 -> 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851848.429247:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2069@kfi7:3 -> 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851848.429250:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2069@kfi7:3 -> 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x665 Using peer 13456@kfi7(0x665)
00000800:00000200:14.0:1773851848.429255:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000dac95d1f: Posted send of 324 bytes to peer 0x665: rc=0
00000800:00000200:14.0:1773851848.429257:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2069@kfi7:3 -> 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x665 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851848.429260:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.429261:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000062e2e3a7 refcount 2 to 13393@kfi7
00010000:00000001:14.0:1773851848.429263:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851848.429263:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.429264:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851848.429265:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bcf69ad7 x1859315081233984/t0(0) o400->ea062319-fd1d-4bbd-8620-0e1458450484@13393@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1330-0'
00000100:00100000:14.0:1773851848.429271:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bcf69ad7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ea062319-fd1d-4bbd-8620-0e1458450484+6:39593:x1859315081233984:12345-13393@kfi7:400:default-tuolumne1330-0 Request processed in 105us (156us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851848.429272:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2069@kfi7:3 -> 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x665 TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851848.429274:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13393@kfi7, seq: 2289753
00000400:00000200:13.0:1773851848.429274:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:14.0:1773851848.429275:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000b4833b9 : new rpc_count 0
00000400:00000200:13.0:1773851848.429276:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13456@kfi7: PUT: OK
00000100:00000001:14.0:1773851848.429277:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851848.429277:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851848.429277:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
00000020:00000010:14.0:1773851848.429278:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000400:00000010:13.0:1773851848.429278:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000020:00000010:14.0:1773851848.429279:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000100:00000001:13.0:1773851848.429279:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:14.0:1773851848.429280:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cad4d41a.
00000100:00000001:13.0:1773851848.429280:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851848.429281:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000020:00000040:14.0:1773851848.429282:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000000b4833b9 : new refcount 5
00000100:00000001:14.0:1773851848.429283:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851848.429283:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2069@kfi7:3 -> 13456@kfi7(00000000cae43298):0x0 lsk 1638 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x665 Transaction freed
00000800:00000200:17.0:1773851848.456752:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851848.456754:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851848.456756:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851848.456759:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851848.456762:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.456764:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8241@kfi7 : PUT - for me
00000400:00000200:17.0:1773851848.456765:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.456767:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 1
00000400:00000200:17.0:1773851848.456768:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.456769:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000400:00000200:17.0:1773851848.456770:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 3
00000400:00000200:17.0:1773851848.456772:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8433@kfi7 to cpt 7
00000400:00000200:17.0:1773851848.456773:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8433@kfi7 of length 224 into portal 12 MB=0x69bad059142c0
00000400:00000200:17.0:1773851848.456775:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8433@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 183448
00000800:00000200:17.0:1773851848.456778:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851848.456780:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851848.456782:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8241@kfi7: PUT: OK
00000100:00000001:17.0:1773851848.456783:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851848.456784:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851848.456786:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008e98cea0.
00000100:00000040:17.0:1773851848.456787:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000008e98cea0 x1860017285317312 msgsize 224
00000100:00100000:17.0:1773851848.456789:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8433@kfi7 (source: 12345-8241@kfi7)
00000100:00000001:17.0:1773851848.456791:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851848.456792:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000100:00000001:19.0:1773851848.456793:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851848.456794:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851848.456794:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851848.456795:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851848.456796:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851848.456797:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851848.456798:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860017285317312
00000020:00000001:19.0:1773851848.456799:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851848.456799:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a66cf6
00000020:00000001:19.0:1773851848.456800:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851848.456801:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000009b2bc02 refcount=6
00000020:00000001:19.0:1773851848.456802:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148546241536 : -106925163310080 : ffff9ec08b9f9400)
00000020:00000001:19.0:1773851848.456803:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148546241536 : -106925163310080 : ffff9ec08b9f9400)
00000100:00000001:19.0:1773851848.456805:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.456806:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851848.456807:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b6c87683.
00000020:00000010:19.0:1773851848.456808:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851848.456809:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851848.456810:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851848.456812:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851848.456813:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.456814:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851848.456815:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851848.456815:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.456817:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.456819:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851848.456819:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851848.456820:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851848.456820:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851848.456822:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8433@kfi7, seq: 2156235
00000100:00000040:19.0:1773851848.456823:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000009b2bc02 : new rpc_count 1
00000100:00000001:18.0:1773851848.456823:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.456824:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109870463232 : -106963839088384 : ffff9eb78a5e0900)
00000100:00000001:18.0:1773851848.456824:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.456826:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008e98cea0 x1860017285317312/t0(0) o400->2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc@8433@kfi7:38/0 lens 224/0 e 0 to 0 dl 1773852153 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1005-0'
00000100:00000001:19.0:1773851848.456830:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.456831:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851848.456832:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e98cea0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc+6:39591:x1860017285317312:12345-8433@kfi7:400:default-tuolumne1005-0
00000100:00000200:19.0:1773851848.456834:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860017285317312
00000020:00000001:19.0:1773851848.456835:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851848.456836:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851848.456837:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.456838:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851848.456839:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851848.456840:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851848.456841:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860017285317312, found 0 last_xid 1860017285317311
00000020:00000001:19.0:1773851848.456842:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851848.456843:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851848.456844:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851848.456845:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.456845:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851848.456846:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851848.456847:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851848.456849:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004b4112ad.
02000000:00000001:19.0:1773851848.456850:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.456851:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.456852:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851848.456853:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860017285317312
00010000:00000001:19.0:1773851848.456855:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851848.456856:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008e98cea0 x1860017285317312/t0(0) o400->2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc@8433@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1005-0'
00010000:00000001:19.0:1773851848.456860:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851848.456861:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851848.456862:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=81 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851848.456864:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851848.456865:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fe40fad8 refcount 5 to 8433@kfi7
00000100:00000001:19.0:1773851848.456867:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271296 : -107152618280320 : ffff9e8b96402a80)
02000000:00000001:19.0:1773851848.456868:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851848.456869:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.456870:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851848.456871:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8241@kfi7
00000400:00000010:19.0:1773851848.456873:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a69e3aa9.
00000100:00000200:19.0:1773851848.456874:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860017285317312, offset 224
00000400:00000200:19.0:1773851848.456876:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8241@kfi7
00000400:00000200:19.0:1773851848.456877:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.456879:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 1
00000400:00000200:19.0:1773851848.456881:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000400:00000200:19.0:1773851848.456882:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 3
00000400:00000200:19.0:1773851848.456885:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8241@kfi7 local destination
00000400:00000200:19.0:1773851848.456887:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768374:8768374:1024:4294967295] 8241@kfi7 LPNI seq info [10995299:10995299:16:4294967295]
00000400:00000200:19.0:1773851848.456889:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000400:00000200:19.0:1773851848.456890:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.456894:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8241@kfi7(8241@kfi7:8241@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851848.456895:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 3
00000800:00000200:19.0:1773851848.456897:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851848.456899:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851848.456906:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851848.456910:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11e8 Using peer 8241@kfi7(0x11e8)
00000800:00000200:19.0:1773851848.456915:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x11e8: rc=0
00000800:00000200:19.0:1773851848.456918:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851848.456921:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.456922:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fe40fad8 refcount 4 to 8433@kfi7
00010000:00000001:19.0:1773851848.456923:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851848.456924:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.456925:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851848.456926:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008e98cea0 x1860017285317312/t0(0) o400->2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc@8433@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1005-0'
00000100:00100000:19.0:1773851848.456932:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e98cea0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc+6:39591:x1860017285317312:12345-8433@kfi7:400:default-tuolumne1005-0 Request processed in 101us (143us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851848.456932:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11e8 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851848.456934:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851848.456935:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8433@kfi7, seq: 2156235
00000400:00000200:17.0:1773851848.456936:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8241@kfi7: PUT: OK
00000100:00000040:19.0:1773851848.456937:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000009b2bc02 : new rpc_count 0
00000400:00000200:17.0:1773851848.456937:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a69e3aa9
00000400:00000010:17.0:1773851848.456937:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a69e3aa9.
00000100:00000001:19.0:1773851848.456938:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851848.456939:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:17.0:1773851848.456939:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851848.456939:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851848.456940:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851848.456940:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000020:00000010:19.0:1773851848.456941:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000020:00000010:19.0:1773851848.456943:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b6c87683.
00000800:00000200:17.0:1773851848.456943:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 8241@kfi7(00000000b0225f45):0x0 lsk 4585 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11e8 Transaction freed
00000020:00000040:19.0:1773851848.456944:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000009b2bc02 : new refcount 5
00000100:00000001:19.0:1773851848.456945:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851848.495157:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851848.495158:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851848.495159:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851848.495161:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851848.495163:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.495165:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14113@kfi7 : PUT - for me
00000400:00000200:13.0:1773851848.495165:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.495166:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 1
00000400:00000200:13.0:1773851848.495167:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.495168:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000400:00000200:13.0:1773851848.495169:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 3
00000400:00000200:13.0:1773851848.495169:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14304@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.495170:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14304@kfi7 of length 224 into portal 12 MB=0x69b4758fff340
00000400:00000200:13.0:1773851848.495171:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14304@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 9416
00000800:00000200:13.0:1773851848.495173:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851848.495174:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851848.495175:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14113@kfi7: PUT: OK
00000100:00000001:13.0:1773851848.495176:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851848.495176:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851848.495177:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000014e7e41f.
00000100:00000040:13.0:1773851848.495178:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000014e7e41f x1859580598416192 msgsize 224
00000100:00100000:13.0:1773851848.495179:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14304@kfi7 (source: 12345-14113@kfi7)
00000100:00000001:13.0:1773851848.495180:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851848.495181:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000100:00000001:14.0:1773851848.495182:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851848.495182:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851848.495183:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851848.495183:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851848.495183:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851848.495184:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851848.495184:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580598416192
00000020:00000001:14.0:1773851848.495185:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851848.495185:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dde0de595
00000020:00000001:14.0:1773851848.495186:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851848.495189:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000836ff402 refcount=5
00000020:00000001:14.0:1773851848.495190:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098280317952 : -106975429233664 : ffff9eb4d78a7400)
00000020:00000001:14.0:1773851848.495192:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098280317952 : -106975429233664 : ffff9eb4d78a7400)
00000100:00000001:14.0:1773851848.495193:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.495194:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851848.495195:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cad4d41a.
00000020:00000010:14.0:1773851848.495197:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851848.495198:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851848.495199:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851848.495200:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851848.495200:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.495201:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851848.495202:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851848.495203:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.495204:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851848.495206:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851848.495206:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851848.495207:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851848.495207:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851848.495208:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14304@kfi7, seq: 2289754
00000100:00000040:14.0:1773851848.495209:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000836ff402 : new rpc_count 1
00000100:00000001:15.0:1773851848.495210:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851848.495211:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.495211:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251436160 : -106960458115456 : ffff9eb853e39680)
00000100:00000040:14.0:1773851848.495212:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000014e7e41f x1859580598416192/t0(0) o400->07719914-baef-4a6a-855c-dce19c4b3255@14304@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1375-0'
00000100:00000001:14.0:1773851848.495217:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.495218:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851848.495219:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014e7e41f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:07719914-baef-4a6a-855c-dce19c4b3255+5:39829:x1859580598416192:12345-14304@kfi7:400:default-tuolumne1375-0
00000100:00000200:14.0:1773851848.495221:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580598416192
00000020:00000001:14.0:1773851848.495222:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851848.495223:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851848.495224:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.495225:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851848.495225:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851848.495227:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851848.495227:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580598416192, found 0 last_xid 1859580598416191
00000020:00000001:14.0:1773851848.495228:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851848.495229:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851848.495230:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851848.495231:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.495232:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851848.495233:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851848.495233:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851848.495235:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000080f413dd.
02000000:00000001:14.0:1773851848.495236:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.495237:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.495238:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851848.495239:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035365208, transno 0, xid 1859580598416192
00010000:00000001:14.0:1773851848.495240:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851848.495241:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000014e7e41f x1859580598416192/t0(0) o400->07719914-baef-4a6a-855c-dce19c4b3255@14304@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1375-0'
00010000:00000001:14.0:1773851848.495246:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851848.495247:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851848.495248:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=81 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851848.495250:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851848.495252:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c57ba987 refcount 3 to 14304@kfi7
00000100:00000001:14.0:1773851848.495253:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153760 : -107139310397856 : ffff9e8eaf765660)
02000000:00000001:14.0:1773851848.495254:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851848.495255:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.495256:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851848.495257:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14113@kfi7
00000400:00000010:14.0:1773851848.495258:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091834aa1.
00000100:00000200:14.0:1773851848.495259:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580598416192, offset 224
00000400:00000200:14.0:1773851848.495261:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14113@kfi7
00000400:00000200:14.0:1773851848.495263:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.495264:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 1
00000400:00000200:14.0:1773851848.495266:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000400:00000200:14.0:1773851848.495268:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 3
00000400:00000200:14.0:1773851848.495270:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14113@kfi7 local destination
00000400:00000200:14.0:1773851848.495272:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768375:8768375:1024:4294967295] 14113@kfi7 LPNI seq info [808394:808394:16:4294967295]
00000400:00000200:14.0:1773851848.495275:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000400:00000200:14.0:1773851848.495276:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.495279:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14113@kfi7(14113@kfi7:14113@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851848.495281:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 3
00000800:00000200:14.0:1773851848.495283:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851848.495285:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851848.495288:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851848.495292:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a9e Using peer 14113@kfi7(0x100000000000a9e)
00000800:00000200:14.0:1773851848.495296:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000002eb192a5: Posted send of 324 bytes to peer 0x100000000000a9e: rc=0
00000800:00000200:14.0:1773851848.495298:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a9e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851848.495301:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.495303:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c57ba987 refcount 2 to 14304@kfi7
00010000:00000001:14.0:1773851848.495304:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851848.495305:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.495306:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851848.495307:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000014e7e41f x1859580598416192/t0(0) o400->07719914-baef-4a6a-855c-dce19c4b3255@14304@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1375-0'
00000100:00100000:14.0:1773851848.495312:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014e7e41f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:07719914-baef-4a6a-855c-dce19c4b3255+5:39829:x1859580598416192:12345-14304@kfi7:400:default-tuolumne1375-0 Request processed in 94us (132us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851848.495313:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a9e TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851848.495315:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14304@kfi7, seq: 2289754
00000100:00000040:14.0:1773851848.495316:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000836ff402 : new rpc_count 0
00000400:00000200:13.0:1773851848.495316:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851848.495317:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851848.495317:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14113@kfi7: PUT: OK
00000100:00000001:14.0:1773851848.495318:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851848.495318:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091834aa1
00000020:00000010:14.0:1773851848.495319:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000400:00000010:13.0:1773851848.495319:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091834aa1.
00000020:00000010:14.0:1773851848.495320:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000100:00000001:13.0:1773851848.495320:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:14.0:1773851848.495321:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cad4d41a.
00000100:00000001:13.0:1773851848.495321:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:14.0:1773851848.495322:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000836ff402 : new refcount 4
00000400:00000200:13.0:1773851848.495322:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000100:00000001:14.0:1773851848.495323:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851848.495325:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 14113@kfi7(00000000578ee68b):0x0 lsk 2719 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a9e Transaction freed
00000800:00000200:5.0:1773851848.496163:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851848.496164:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851848.496166:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851848.496168:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851848.496170:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18898@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.496171:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18898@kfi7 : PUT - for me
00000400:00000200:5.0:1773851848.496172:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18898@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.496173:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 1
00000400:00000200:5.0:1773851848.496175:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18898@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.496175:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 2
00000400:00000200:5.0:1773851848.496176:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 3
00000400:00000200:5.0:1773851848.496177:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18707@kfi7 to cpt 1
00000400:00000200:5.0:1773851848.496178:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18707@kfi7 of length 224 into portal 12 MB=0x69b82e366e580
00000400:00000200:5.0:1773851848.496180:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18707@kfi7 of length 224/224 into md 0x793926dc5 [64] + 113328
00000800:00000200:5.0:1773851848.496182:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851848.496184:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851848.496185:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18898@kfi7: PUT: OK
00000100:00000001:5.0:1773851848.496186:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851848.496186:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851848.496188:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c8317de0.
00000100:00000040:5.0:1773851848.496189:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000c8317de0 x1859836323489152 msgsize 224
00000100:00100000:5.0:1773851848.496190:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-18707@kfi7 (source: 12345-18898@kfi7)
00000100:00000001:5.0:1773851848.496191:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851848.496192:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 2
00000100:00000001:6.0:1773851848.496193:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851848.496194:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851848.496194:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851848.496194:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851848.496195:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851848.496195:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851848.496196:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836323489152
00000020:00000001:6.0:1773851848.496197:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851848.496197:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d8938a
00000020:00000001:6.0:1773851848.496198:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851848.496200:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008a7ecbea refcount=5
00000020:00000001:6.0:1773851848.496200:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161377502208 : -106912332049408 : ffff9ec3886d1400)
00000020:00000001:6.0:1773851848.496201:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161377502208 : -106912332049408 : ffff9ec3886d1400)
00000100:00000001:6.0:1773851848.496202:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.496203:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851848.496203:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851848.496204:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851848.496206:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851848.496207:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851848.496207:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851848.496208:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851848.496209:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851848.496209:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851848.496210:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.496211:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851848.496212:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851848.496213:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851848.496213:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851848.496213:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851848.496215:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18707@kfi7, seq: 2001831
00000100:00000001:7.0:1773851848.496216:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851848.496216:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008a7ecbea : new rpc_count 1
00000100:00000001:7.0:1773851848.496217:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.496217:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120471978240 : -106953237573376 : ffff9eba02445100)
00000100:00000040:6.0:1773851848.496219:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c8317de0 x1859836323489152/t0(0) o400->671b735e-ed23-4569-8251-bdbe309d9c2b@18707@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1669-0'
00000100:00000001:6.0:1773851848.496224:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851848.496225:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851848.496227:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8317de0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:671b735e-ed23-4569-8251-bdbe309d9c2b+5:40037:x1859836323489152:12345-18707@kfi7:400:default-tuolumne1669-0
00000100:00000200:6.0:1773851848.496229:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836323489152
00000020:00000001:6.0:1773851848.496230:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851848.496231:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851848.496232:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.496233:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851848.496234:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851848.496236:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851848.496237:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836323489152, found 0 last_xid 1859836323489151
00000020:00000001:6.0:1773851848.496238:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851848.496239:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851848.496240:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851848.496241:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.496242:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851848.496243:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851848.496244:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851848.496246:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000df28b738.
02000000:00000001:6.0:1773851848.496247:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.496248:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.496249:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851848.496250:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413759611, transno 0, xid 1859836323489152
00010000:00000001:6.0:1773851848.496252:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851848.496253:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c8317de0 x1859836323489152/t0(0) o400->671b735e-ed23-4569-8251-bdbe309d9c2b@18707@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1669-0'
00010000:00000001:6.0:1773851848.496258:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851848.496259:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851848.496260:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=80 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851848.496262:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851848.496263:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b9e30e2 refcount 3 to 18707@kfi7
00000100:00000001:6.0:1773851848.496264:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411808 : -107145304139808 : ffff9e8d4a3517e0)
02000000:00000001:6.0:1773851848.496265:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851848.496266:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851848.496267:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851848.496268:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18898@kfi7
00000400:00000010:6.0:1773851848.496269:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005f69d562.
00000100:00000200:6.0:1773851848.496271:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836323489152, offset 224
00000400:00000200:6.0:1773851848.496273:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18898@kfi7
00000400:00000200:6.0:1773851848.496274:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18898@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.496276:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 1
00000400:00000200:6.0:1773851848.496277:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 2
00000400:00000200:6.0:1773851848.496279:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 3
00000400:00000200:6.0:1773851848.496281:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18898@kfi7 local destination
00000400:00000200:6.0:1773851848.496283:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768376:8768376:1024:4294967295] 18898@kfi7 LPNI seq info [374048:374048:16:4294967295]
00000400:00000200:6.0:1773851848.496286:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 2
00000400:00000200:6.0:1773851848.496287:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18898@kfi7 to cpt 1
00000400:00000200:6.0:1773851848.496290:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18898@kfi7(18898@kfi7:18898@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851848.496292:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 3
00000800:00000200:6.0:1773851848.496295:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851848.496297:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851848.496301:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851848.496304:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c9 Using peer 18898@kfi7(0x1c9)
00000800:00000200:6.0:1773851848.496309:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000618b435b: Posted send of 324 bytes to peer 0x1c9: rc=0
00000800:00000200:6.0:1773851848.496311:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851848.496314:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851848.496315:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b9e30e2 refcount 2 to 18707@kfi7
00010000:00000001:6.0:1773851848.496317:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851848.496317:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851848.496318:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851848.496319:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c8317de0 x1859836323489152/t0(0) o400->671b735e-ed23-4569-8251-bdbe309d9c2b@18707@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1669-0'
00000800:00000200:5.0:1773851848.496322:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c9 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851848.496323:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:6.0:1773851848.496324:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8317de0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:671b735e-ed23-4569-8251-bdbe309d9c2b+5:40037:x1859836323489152:12345-18707@kfi7:400:default-tuolumne1669-0 Request processed in 99us (134us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851848.496324:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18898@kfi7: PUT: OK
00000400:00000200:5.0:1773851848.496325:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005f69d562
00000400:00000010:5.0:1773851848.496325:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005f69d562.
00000100:00000001:5.0:1773851848.496326:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851848.496326:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851848.496327:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ab0f7b3 nid 18898@kfi7 refs 2
00000100:00100000:6.0:1773851848.496328:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18707@kfi7, seq: 2001831
00000800:00000200:5.0:1773851848.496328:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 18898@kfi7(00000000f1681e14):0x0 lsk 458 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c9 Transaction freed
00000100:00000040:6.0:1773851848.496329:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008a7ecbea : new rpc_count 0
00000100:00000001:6.0:1773851848.496330:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851848.496331:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851848.496332:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851848.496333:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000020:00000010:6.0:1773851848.496334:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000020:00000040:6.0:1773851848.496335:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000008a7ecbea : new refcount 4
00000100:00000001:6.0:1773851848.496336:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851848.506730:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851848.506731:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851848.506732:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851848.506734:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851848.506736:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.506737:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19345@kfi7 : PUT - for me
00000400:00000200:29.0:1773851848.506738:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.506739:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 1
00000400:00000200:29.0:1773851848.506740:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.506741:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000400:00000200:29.0:1773851848.506742:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 3
00000400:00000200:29.0:1773851848.506743:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19280@kfi7 to cpt 0
00000400:00000200:29.0:1773851848.506744:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19280@kfi7 of length 224 into portal 12 MB=0x69b4bc4942b00
00000400:00000200:29.0:1773851848.506745:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19280@kfi7 of length 224/224 into md 0x77fe139dd [64] + 155072
00000800:00000200:29.0:1773851848.506747:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851848.506748:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851848.506749:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19345@kfi7: PUT: OK
00000100:00000001:29.0:1773851848.506750:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851848.506751:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851848.506752:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000056826228.
00000100:00000040:29.0:1773851848.506752:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000056826228 x1859599583161088 msgsize 224
00000100:00100000:29.0:1773851848.506754:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19280@kfi7 (source: 12345-19345@kfi7)
00000100:00000001:29.0:1773851848.506755:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851848.506756:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000100:00000001:31.0:1773851848.506757:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851848.506757:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851848.506758:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851848.506758:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851848.506758:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851848.506759:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851848.506760:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599583161088
00000020:00000001:31.0:1773851848.506761:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851848.506761:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82586
00000020:00000001:31.0:1773851848.506762:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851848.506767:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e383da9a refcount=5
00000020:00000001:31.0:1773851848.506768:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109687002112 : -106964022549504 : ffff9eb77f6ea400)
00000020:00000001:31.0:1773851848.506768:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637109687002112 : -106964022549504 : ffff9eb77f6ea400)
00000100:00000001:31.0:1773851848.506770:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.506771:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851848.506771:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851848.506772:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851848.506773:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851848.506774:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851848.506774:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851848.506775:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.506776:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851848.506777:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851848.506777:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.506778:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.506779:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851848.506779:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851848.506780:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851848.506780:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851848.506781:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19280@kfi7, seq: 2055438
00000100:00000040:31.0:1773851848.506781:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e383da9a : new rpc_count 1
00000100:00000001:31.0:1773851848.506782:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125762086144 : -106947947465472 : ffff9ebb3d94f500)
00000100:00000001:29.0:1773851848.506782:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851848.506782:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.506783:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000056826228 x1859599583161088/t0(0) o400->cffa382e-d77b-4b5b-9a25-e6783e8fc3b8@19280@kfi7:636/0 lens 224/0 e 0 to 0 dl 1773851996 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1698-0'
00000100:00000001:31.0:1773851848.506786:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.506786:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851848.506787:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056826228 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:cffa382e-d77b-4b5b-9a25-e6783e8fc3b8+5:39550:x1859599583161088:12345-19280@kfi7:400:default-tuolumne1698-0
00000100:00000200:31.0:1773851848.506789:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599583161088
00000020:00000001:31.0:1773851848.506790:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851848.506790:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851848.506791:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.506792:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851848.506792:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851848.506793:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851848.506794:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599583161088, found 0 last_xid 1859599583161087
00000020:00000001:31.0:1773851848.506794:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851848.506795:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851848.506796:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851848.506796:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.506797:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851848.506797:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851848.506798:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851848.506799:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000054a7febb.
02000000:00000001:31.0:1773851848.506800:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.506811:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.506812:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851848.506812:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260651932, transno 0, xid 1859599583161088
00010000:00000001:31.0:1773851848.506813:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851848.506814:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000056826228 x1859599583161088/t0(0) o400->cffa382e-d77b-4b5b-9a25-e6783e8fc3b8@19280@kfi7:636/0 lens 224/224 e 0 to 0 dl 1773851996 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1698-0'
00010000:00000001:31.0:1773851848.506816:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851848.506817:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851848.506818:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=81 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851848.506819:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851848.506819:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000073580499 refcount 3 to 19280@kfi7
00000100:00000001:31.0:1773851848.506820:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050336 : -107154804501280 : ffff9e8b13f114e0)
02000000:00000001:31.0:1773851848.506821:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851848.506821:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.506822:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851848.506823:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19345@kfi7
00000400:00000010:31.0:1773851848.506823:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000535cda91.
00000100:00000200:31.0:1773851848.506824:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599583161088, offset 224
00000400:00000200:31.0:1773851848.506826:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19345@kfi7
00000400:00000200:31.0:1773851848.506826:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.506827:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 1
00000400:00000200:31.0:1773851848.506828:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000400:00000200:31.0:1773851848.506829:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 3
00000400:00000200:31.0:1773851848.506831:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19345@kfi7 local destination
00000400:00000200:31.0:1773851848.506832:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768377:8768377:1024:4294967295] 19345@kfi7 LPNI seq info [9624908:9624908:16:4294967295]
00000400:00000200:31.0:1773851848.506833:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000400:00000200:31.0:1773851848.506834:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.506836:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19345@kfi7(19345@kfi7:19345@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851848.506837:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 3
00000800:00000200:31.0:1773851848.506838:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851848.506839:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851848.506843:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851848.506845:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2ae Using peer 19345@kfi7(0x2ae)
00000800:00000200:31.0:1773851848.506848:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x2ae: rc=0
00000800:00000200:31.0:1773851848.506850:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2ae TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851848.506852:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.506853:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000073580499 refcount 2 to 19280@kfi7
00010000:00000001:31.0:1773851848.506853:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851848.506854:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.506854:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851848.506855:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000056826228 x1859599583161088/t0(0) o400->cffa382e-d77b-4b5b-9a25-e6783e8fc3b8@19280@kfi7:636/0 lens 224/224 e 0 to 0 dl 1773851996 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1698-0'
00000100:00100000:31.0:1773851848.506858:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056826228 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:cffa382e-d77b-4b5b-9a25-e6783e8fc3b8+5:39550:x1859599583161088:12345-19280@kfi7:400:default-tuolumne1698-0 Request processed in 71us (105us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851848.506860:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19280@kfi7, seq: 2055438
00000100:00000040:31.0:1773851848.506861:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e383da9a : new rpc_count 0
00000800:00000200:29.0:1773851848.506861:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2ae TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851848.506862:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851848.506862:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851848.506863:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851848.506863:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851848.506864:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851848.506864:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000400:00000200:29.0:1773851848.506864:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19345@kfi7: PUT: OK
00000020:00000040:31.0:1773851848.506865:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000e383da9a : new refcount 4
00000400:00000200:29.0:1773851848.506865:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000535cda91
00000100:00000001:31.0:1773851848.506866:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851848.506866:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000535cda91.
00000100:00000001:29.0:1773851848.506867:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851848.506867:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851848.506868:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000800:00000200:29.0:1773851848.506870:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19345@kfi7(00000000d7fcab4f):0x0 lsk 687 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2ae Transaction freed
00000004:00000001:15.0:1773851848.521733:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:15.0:1773851848.521734:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:11.0:1773851848.521734:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:3.0:1773851848.521734:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851848.521735:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:10.0:1773851848.521735:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:3.0:1773851848.521735:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:15.0:1773851848.521736:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000043120791.
00000100:00000010:11.0:1773851848.521736:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b624700f.
00000004:00000020:10.0:1773851848.521736:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851848.521737:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f2d41e54.
00000100:00000010:3.0:1773851848.521737:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aaa38a11.
00000020:00000040:15.0:1773851848.521738:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000020:00000040:11.0:1773851848.521738:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000020:00000040:10.0:1773851848.521739:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:15.0:1773851848.521740:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:11.0:1773851848.521740:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:3.0:1773851848.521740:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
02000000:00000001:15.0:1773851848.521741:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851848.521741:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851848.521741:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851848.521742:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:3.0:1773851848.521742:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:15.0:1773851848.521743:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851848.521743:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851848.521743:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851848.521743:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:15.0:1773851848.521745:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ffa7e932.
02000000:00000010:11.0:1773851848.521745:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000545d49bf.
02000000:00000010:10.0:1773851848.521745:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001e07dc98.
02000000:00000001:3.0:1773851848.521745:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851848.521747:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851848.521747:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851848.521747:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851848.521747:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000f5af9cbb.
00000100:00000001:11.0:1773851848.521748:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851848.521748:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851848.521749:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851848.521750:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851848.521750:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851848.521751:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851848.521752:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b624700f] to pc [ptlrpcd_02_01+1]  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851848.521752:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f2d41e54] to pc [ptlrpcd_02_00+0]  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851848.521752:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851848.521754:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000043120791] to pc [ptlrpcd_03_01+1]  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851848.521754:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851848.521755:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851848.521758:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000aaa38a11] to pc [ptlrpcd_00_01+1]  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851848.521759:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851848.521759:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:11.0:1773851848.521761:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ad96937e.
00080000:00000010:10.0:1773851848.521761:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000007b753448.
00000100:00000001:9.0:1773851848.521761:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851848.521761:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851848.521762:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851848.521762:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:15.0:1773851848.521763:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851848.521763:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637099810757632 : -106973898793984 : ffff9eb532c31c00)
00080000:00000001:10.0:1773851848.521763:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637011352813568 : -107062356738048 : ffff9ea09a420000)
00000100:00000001:9.0:1773851848.521763:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851848.521763:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:14.0:1773851848.521764:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851848.521764:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851848.521764:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000010:15.0:1773851848.521765:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c4869532.
00000100:00000001:12.0:1773851848.521765:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:9.0:1773851848.521765:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851848.521765:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851848.521766:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:11.0:1773851848.521766:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851848.521766:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851848.521767:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637050703005696 : -107023006545920 : ffff9ea9c3b64800)
00000100:00000001:14.0:1773851848.521767:0:41073:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:12.0:1773851848.521767:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851848.521767:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00001000:10.0:1773851848.521767:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00080000:00000001:3.0:1773851848.521767:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:15.0:1773851848.521768:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:14.0:1773851848.521768:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:11.0:1773851848.521768:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009fb04483.
00000004:00000010:10.0:1773851848.521768:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007ebb2a2f.
00080000:00000010:3.0:1773851848.521769:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000050f11f9e.
00000100:00000001:2.0:1773851848.521769:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:15.0:1773851848.521770:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:11.0:1773851848.521770:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614122975045199ns, next at 614123975043566ns, rc = 0
00000004:00080000:10.0:1773851848.521770:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614122975045129ns, next at 614123975043385ns, rc = 0
00000100:00000001:9.0:1773851848.521770:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851848.521770:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851848.521770:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851848.521770:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:15.0:1773851848.521771:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00080000:00000001:11.0:1773851848.521771:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851848.521771:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:9.0:1773851848.521771:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.521771:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851848.521771:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636987719495680 : -107085990055936 : ffff9e9b199a3000)
00000100:00000001:2.0:1773851848.521771:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851848.521771:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851848.521772:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851848.521772:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:15.0:1773851848.521773:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b78340e2.
00080000:00000001:11.0:1773851848.521773:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851848.521773:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851848.521773:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.521773:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851848.521773:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:2.0:1773851848.521773:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851848.521774:0:41073:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:11.0:1773851848.521774:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851848.521774:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851848.521774:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:15.0:1773851848.521775:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614122975050318ns, next at 614123975048074ns, rc = 0
00000100:00000001:14.0:1773851848.521775:0:41073:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851848.521775:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051920704:6@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851848.521775:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2d41e54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051920640:31@kfi7:13:default-yuba2-0
00000004:00001000:3.0:1773851848.521775:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
02000000:00000001:14.0:1773851848.521776:0:41073:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:15.0:1773851848.521777:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:9.0:1773851848.521777:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851848.521777:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000010:3.0:1773851848.521777:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000425fa3e0.
00080000:00000001:15.0:1773851848.521778:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851848.521778:0:41073:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.521778:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:15.0:1773851848.521779:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851848.521779:0:41073:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000043120791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051920768:54@kfi7:13:default-yuba2-0
02000000:00000001:9.0:1773851848.521779:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851848.521779:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.521779:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00080000:3.0:1773851848.521779:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614122975054496ns, next at 614123975052152ns, rc = 0
00000100:00000001:2.0:1773851848.521779:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.521780:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851848.521781:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851848.521781:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:3.0:1773851848.521781:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:2.0:1773851848.521781:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:14.0:1773851848.521782:0:41073:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:9.0:1773851848.521782:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ba3e4e94.
02000000:00000010:8.0:1773851848.521782:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000521610c6.
00080000:00000001:3.0:1773851848.521782:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851848.521782:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851848.521783:0:41073:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851848.521783:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.521783:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851848.521783:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851848.521783:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aaa38a11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051920832:2095@kfi7:13:default-yuba2-0
02000000:00000001:14.0:1773851848.521785:0:41073:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851848.521785:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
02000000:00000001:14.0:1773851848.521786:0:41073:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:9.0:1773851848.521786:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000010:8.0:1773851848.521786:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000100:00000001:2.0:1773851848.521786:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:14.0:1773851848.521787:0:41073:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
00000400:00000010:9.0:1773851848.521787:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000071ec9fd.
02000000:00000001:2.0:1773851848.521787:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:8.0:1773851848.521788:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7b495c.
02000000:00000001:2.0:1773851848.521788:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851848.521789:0:41073:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851848.521789:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000146cbe4e.
02000000:00000001:2.0:1773851848.521789:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:8.0:1773851848.521790:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920640, portal 4
02000000:00000010:2.0:1773851848.521790:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000595cd4c8.
00000100:00000200:9.0:1773851848.521791:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920704, portal 4
00000100:00000001:8.0:1773851848.521791:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851848.521792:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851848.521792:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077429248 : -106968632122368 : ffff9eb66cae2400)
02000000:00000001:2.0:1773851848.521792:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.521793:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637164268282624 : -106909441268992 : ffff9ec434bae300)
00000400:00000200:2.0:1773851848.521793:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000040:8.0:1773851848.521794:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:2.0:1773851848.521794:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000100:00000040:9.0:1773851848.521795:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:2.0:1773851848.521796:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b98af3b.
00000100:00000200:2.0:1773851848.521798:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920832, portal 4
00000100:00000001:9.0:1773851848.521799:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851848.521799:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:2.0:1773851848.521799:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:9.0:1773851848.521800:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000100:00000040:8.0:1773851848.521800:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000100:00000001:2.0:1773851848.521800:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288702464 : -106964420849152 : ffff9eb767b11200)
00000400:00000010:9.0:1773851848.521801:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e7ade224.
00000400:00000010:8.0:1773851848.521801:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000286a46f2.
00000400:00000200:14.0:1773851848.521802:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000200:9.0:1773851848.521802:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920704, offset 0
00000100:00000200:8.0:1773851848.521802:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920640, offset 0
00000100:00000040:2.0:1773851848.521803:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:14.0:1773851848.521804:0:41073:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000400:00000010:14.0:1773851848.521805:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f61d88ce.
00000400:00000200:9.0:1773851848.521805:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000100:00000200:14.0:1773851848.521807:0:41073:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920768, portal 4
00000400:00000200:9.0:1773851848.521807:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:8.0:1773851848.521807:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000100:00000001:2.0:1773851848.521807:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851848.521808:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000100:00000040:2.0:1773851848.521808:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000100:00000001:14.0:1773851848.521809:0:41073:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:14.0:1773851848.521810:0:41073:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860213760 : -107049849337856 : ffff9ea383c1c800)
00000400:00000200:9.0:1773851848.521810:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000010:2.0:1773851848.521810:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054da3b56.
00000100:00000200:2.0:1773851848.521811:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920832, offset 0
00000100:00000040:14.0:1773851848.521812:0:41073:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851848.521812:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:2.0:1773851848.521813:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:9.0:1773851848.521814:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000200:2.0:1773851848.521815:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:2.0:1773851848.521816:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000100:00000001:14.0:1773851848.521817:0:41073:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851848.521817:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768377, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768375, p:4294967295, g:4294967295, h:1000]
00000100:00000040:14.0:1773851848.521818:0:41073:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000200:2.0:1773851848.521818:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000010:14.0:1773851848.521819:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7a1f956.
00000400:00000200:9.0:1773851848.521820:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:2.0:1773851848.521820:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000100:00000200:14.0:1773851848.521821:0:41073:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920768, offset 0
00000400:00000200:9.0:1773851848.521822:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851848.521822:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:14.0:1773851848.521823:0:41073:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:9.0:1773851848.521823:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:14.0:1773851848.521824:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851848.521825:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768378:8768378:1024:4294967295] 6@kfi7 LPNI seq info [5405027:5405027:16:4294967295]
00000400:00000200:2.0:1773851848.521825:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768377, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768378, p:4294967295, g:4294967295, h:1000]
00000400:00000200:14.0:1773851848.521826:0:41073:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:14.0:1773851848.521828:0:41073:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851848.521828:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:14.0:1773851848.521829:0:41073:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851848.521829:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851848.521829:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:14.0:1773851848.521831:0:41073:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:8.0:1773851848.521831:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:2.0:1773851848.521831:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851848.521832:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:2.0:1773851848.521832:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:14.0:1773851848.521834:0:41073:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768379, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768378, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851848.521834:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851848.521834:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768379:8768379:1024:4294967295] 2095@kfi7 LPNI seq info [5406038:5406038:16:4294967295]
00000400:00000200:8.0:1773851848.521836:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:2.0:1773851848.521837:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:14.0:1773851848.521838:0:41073:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851848.521838:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000200:2.0:1773851848.521838:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851848.521840:0:41073:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851848.521841:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768379, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768378, p:4294967295, g:4294967295, h:1000]
00000400:00000200:14.0:1773851848.521842:0:41073:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:2.0:1773851848.521843:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851848.521844:0:41073:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768380:8768380:1023:4294967295] 54@kfi7 LPNI seq info [5403918:5403918:16:4294967295]
00000400:00000200:9.0:1773851848.521844:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851848.521845:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:2.0:1773851848.521845:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:9.0:1773851848.521846:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:14.0:1773851848.521847:0:41073:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:8.0:1773851848.521847:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:14.0:1773851848.521848:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851848.521848:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000800:00000200:2.0:1773851848.521848:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:9.0:1773851848.521849:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:8.0:1773851848.521850:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768381:8768381:1023:4294967295] 31@kfi7 LPNI seq info [5403614:5403614:16:4294967295]
00000800:00000200:9.0:1773851848.521851:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851848.521851:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:14.0:1773851848.521852:0:41073:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851848.521853:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:14.0:1773851848.521854:0:41073:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851848.521854:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:9.0:1773851848.521855:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851848.521855:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851848.521857:0:41073:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:8.0:1773851848.521858:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000800:00000200:14.0:1773851848.521859:0:41073:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851848.521860:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000400:00000200:8.0:1773851848.521860:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:2.0:1773851848.521860:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000800:00000200:14.0:1773851848.521863:0:41073:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851848.521863:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851848.521865:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000800:00000200:8.0:1773851848.521865:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851848.521865:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000497e951d: Posted send of 324 bytes to peer 0x5c0: rc=0
00000800:00000200:14.0:1773851848.521868:0:41073:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000800:00000200:9.0:1773851848.521868:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851848.521868:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:8.0:1773851848.521869:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851848.521871:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.521871:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851848.521872:0:41073:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000bbed2221: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000100:00000001:9.0:1773851848.521872:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851848.521872:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:8.0:1773851848.521873:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Using peer 31@kfi7(0x56e)
00000100:00000001:9.0:1773851848.521874:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.521874:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851848.521875:0:41073:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851848.521875:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.521876:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851848.521876:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.521877:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.521878:0:41073:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.521879:0:41073:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851848.521879:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851848.521879:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851848.521879:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851848.521880:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:1.0:1773851848.521880:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851848.521881:0:41073:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.521881:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851848.521882:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.521882:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851848.521882:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.521882:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851848.521882:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851848.521883:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851848.521883:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851848.521884:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851848.521884:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.521884:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851848.521884:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000100:00000001:14.0:1773851848.521886:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:1.0:1773851848.521886:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054da3b56
00000400:00000010:1.0:1773851848.521886:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054da3b56.
00000100:00000001:14.0:1773851848.521887:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:8.0:1773851848.521887:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x56e: rc=0
00000100:00000001:1.0:1773851848.521887:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:14.0:1773851848.521888:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:10.0:1773851848.521888:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851848.521889:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:13.0:1773851848.521889:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000100:00000200:1.0:1773851848.521889:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851848.521890:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851848.521890:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:8.0:1773851848.521890:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851848.521891:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851848.521891:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:13.0:1773851848.521892:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7a1f956
00000400:00000200:10.0:1773851848.521892:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:13.0:1773851848.521893:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7a1f956.
00000100:00000001:13.0:1773851848.521893:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:8.0:1773851848.521893:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:13.0:1773851848.521894:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851848.521894:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:1.0:1773851848.521894:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:10.0:1773851848.521895:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e7ade224
00000100:00000001:8.0:1773851848.521895:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:1.0:1773851848.521895:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:10.0:1773851848.521896:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e7ade224.
00000100:00000001:8.0:1773851848.521896:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851848.521897:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:13.0:1773851848.521898:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851848.521898:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851848.521899:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851848.521899:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851848.521899:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851848.521900:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.521901:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851848.521901:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:13.0:1773851848.521902:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.521902:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:1.0:1773851848.521902:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:13.0:1773851848.521903:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:10.0:1773851848.521903:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851848.521903:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851848.521904:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:8.0:1773851848.521904:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:10.0:1773851848.521905:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851848.521906:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000800:00000200:1.0:1773851848.521906:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000100:00000001:10.0:1773851848.521909:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.521909:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851848.521910:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:8.0:1773851848.521910:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851848.521911:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851848.521912:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:1.0:1773851848.521914:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:11.0:1773851848.521915:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:10.0:1773851848.521915:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Transaction freed
00000800:00000200:1.0:1773851848.521916:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:11.0:1773851848.521917:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000400:00000200:11.0:1773851848.521918:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000286a46f2
00000800:00000200:1.0:1773851848.521918:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:11.0:1773851848.521919:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000286a46f2.
00000100:00000001:11.0:1773851848.521920:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851848.521921:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:1.0:1773851848.521921:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851848.521922:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:11.0:1773851848.521922:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851848.521924:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851848.521925:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000001:11.0:1773851848.521926:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851848.521927:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851848.521927:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000800:00000200:29.0:1773851848.521928:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851848.521929:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:13.0:1773851848.521930:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:1.0:1773851848.521930:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:29.0:1773851848.521931:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:13.0:1773851848.521931:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:11.0:1773851848.521931:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851848.521932:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:11.0:1773851848.521932:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:1.0:1773851848.521932:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851848.521933:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:29.0:1773851848.521934:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:11.0:1773851848.521934:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:1.0:1773851848.521934:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:13.0:1773851848.521935:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851848.521935:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:29.0:1773851848.521936:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:13.0:1773851848.521936:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:17.0:1773851848.521937:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:11.0:1773851848.521937:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Transaction freed
00000400:00000200:1.0:1773851848.521937:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851848.521938:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:17.0:1773851848.521938:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851848.521938:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000200:29.0:1773851848.521939:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:13.0:1773851848.521939:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851848.521939:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1940
00000800:00000200:17.0:1773851848.521940:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851848.521940:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:29.0:1773851848.521941:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:13.0:1773851848.521941:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851848.521941:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851848.521942:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851848.521942:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:13.0:1773851848.521943:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:1.0:1773851848.521943:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71c741 [1] + 224
00000400:00000200:29.0:1773851848.521944:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b19c0
00000800:00000200:17.0:1773851848.521944:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851848.521944:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.521945:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1980
00000800:00000200:1.0:1773851848.521946:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851848.521947:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851848.521947:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:13.0:1773851848.521947:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:17.0:1773851848.521949:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:13.0:1773851848.521949:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f528d [1] + 224
00000400:00000200:1.0:1773851848.521949:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851848.521950:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78007f61d [1] + 224
00000400:00000200:17.0:1773851848.521951:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:13.0:1773851848.521951:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851848.521951:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000400:00000200:17.0:1773851848.521952:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:13.0:1773851848.521952:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851848.521952:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851848.521953:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000800:00000200:29.0:1773851848.521954:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851848.521954:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:13.0:1773851848.521954:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:1.0:1773851848.521954:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851848.521955:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000200:13.0:1773851848.521955:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851848.521956:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851848.521956:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:29.0:1773851848.521958:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:17.0:1773851848.521958:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000040:13.0:1773851848.521958:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851848.521959:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851848.521960:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851848.521960:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1900
00000100:00000001:13.0:1773851848.521961:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851848.521962:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:13.0:1773851848.521962:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000200:29.0:1773851848.521963:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851848.521963:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:13.0:1773851848.521963:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851848.521964:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f0271 [1] + 224
00000100:00000001:14.0:1773851848.521964:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:14.0:1773851848.521965:0:41073:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:1.0:1773851848.521965:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851848.521966:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:17.0:1773851848.521967:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:14.0:1773851848.521967:0:41073:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:14.0:1773851848.521967:0:41073:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000100:00000040:29.0:1773851848.521968:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851848.521968:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851848.521968:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:14.0:1773851848.521969:0:41073:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f61d88ce
00000800:00000200:1.0:1773851848.521969:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851848.521970:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:14.0:1773851848.521970:0:41073:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f61d88ce.
00000400:00000001:9.0:1773851848.521970:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:17.0:1773851848.521971:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:14.0:1773851848.521971:0:41073:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:9.0:1773851848.521971:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:14.0:1773851848.521972:0:41073:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851848.521972:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000071ec9fd.
00000100:00000001:17.0:1773851848.521973:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851848.521973:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000146cbe4e
00000100:00000001:29.0:1773851848.521974:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:9.0:1773851848.521974:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000146cbe4e.
00000100:00000200:17.0:1773851848.521975:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851848.521975:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851848.521976:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000200:9.0:1773851848.521977:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851848.521977:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851848.521978:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000200:14.0:1773851848.521978:0:41073:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851848.521978:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:2.0:1773851848.521979:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:17.0:1773851848.521980:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:2.0:1773851848.521980:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:2.0:1773851848.521981:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000100:00000001:14.0:1773851848.521982:0:41073:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:9.0:1773851848.521982:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851848.521982:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b98af3b
00000100:00000001:14.0:1773851848.521983:0:41073:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:2.0:1773851848.521983:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b98af3b.
00000100:00000001:2.0:1773851848.521984:0:41061:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:14.0:1773851848.521985:0:41073:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:17.0:1773851848.521986:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:14.0:1773851848.521986:0:41073:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851848.521986:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:2.0:1773851848.521986:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851848.521987:0:41073:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851848.521987:0:41073:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.521987:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851848.521988:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:9.0:1773851848.521988:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851848.521989:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851848.521989:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:17.0:1773851848.521990:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851848.521990:0:41073:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.521990:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851848.521990:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:14.0:1773851848.521991:0:41073:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=81 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851848.521991:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:8.0:1773851848.521991:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:2.0:1773851848.521991:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851848.521992:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:8.0:1773851848.521992:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:14.0:1773851848.521993:0:41073:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=81 v=66 (1 1 1 1)
00000400:00000010:8.0:1773851848.521993:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000100:00001000:9.0:1773851848.521994:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=81 v=66 (66 66 66 66)
00000400:00000200:8.0:1773851848.521994:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7b495c
00000100:00000001:14.0:1773851848.521995:0:41073:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000010:8.0:1773851848.521995:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7b495c.
00000100:00000001:2.0:1773851848.521995:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851848.521996:0:41073:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851848.521996:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=146 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851848.521996:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:2.0:1773851848.521996:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:14.0:1773851848.521997:0:41073:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:2.0:1773851848.521997:0:41061:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:9.0:1773851848.521998:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:8.0:1773851848.521998:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:2.0:1773851848.521998:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00010000:00000001:14.0:1773851848.521999:0:41073:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.521999:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.521999:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851848.522000:0:41073:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00010000:00000001:9.0:1773851848.522000:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:2.0:1773851848.522000:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.522001:0:41073:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00010000:00000001:9.0:1773851848.522001:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851848.522001:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.522002:0:41073:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851848.522002:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00001000:2.0:1773851848.522002:0:41061:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=81 v=66 (66 66 66 66)
00000100:00000001:14.0:1773851848.522003:0:41073:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851848.522003:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000200:8.0:1773851848.522003:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851848.522004:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:2.0:1773851848.522004:0:41061:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=81 v=66 (1 1 1 1)
00000100:00000040:14.0:1773851848.522005:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851848.522005:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851848.522006:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851848.522006:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851848.522007:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851848.522007:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.522008:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851848.522008:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851848.522009:0:41068:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:2.0:1773851848.522009:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.522010:0:41073:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:8.0:1773851848.522010:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851848.522010:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851848.522010:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851848.522011:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:2.0:1773851848.522011:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000001:14.0:1773851848.522012:0:41073:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851848.522012:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851848.522012:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.522012:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:14.0:1773851848.522013:0:41073:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851848.522013:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851848.522013:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.522013:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:14.0:1773851848.522014:0:41073:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:8.0:1773851848.522014:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=81 v=66 (66 66 66 66)
00000004:00000001:9.0:1773851848.522015:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:2.0:1773851848.522015:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:14.0:1773851848.522016:0:41073:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851848.522016:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000100:00001000:8.0:1773851848.522016:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=81 v=66 (1 1 1 1)
00000004:00000040:14.0:1773851848.522017:0:41073:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399719424 free=351524125696 avail=351521373184 avail_mb=1373130364 hwm_mb=3131103 files=372114032 ffree=343285279 state=0: rc = 0
00000004:00000040:9.0:1773851848.522018:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420277760 avail=351417801728 avail_mb=1372725788 hwm_mb=3131103 files=372009101 ffree=343183865 state=0: rc = 0
00000100:00000001:8.0:1773851848.522018:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851848.522019:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851848.522020:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:2.0:1773851848.522020:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:14.0:1773851848.522021:0:41073:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399719424 blocks, 351524125696 free, 351521373184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372114032 files, 343285279 free files
00010000:00000001:8.0:1773851848.522021:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.522021:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000020:9.0:1773851848.522022:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420277760 free, 351417801728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372009101 files, 343183865 free files
00000100:00000001:8.0:1773851848.522022:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:2.0:1773851848.522022:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:8.0:1773851848.522023:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000004:00000001:2.0:1773851848.522023:0:41061:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:8.0:1773851848.522024:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:14.0:1773851848.522025:0:41073:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851848.522025:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.522025:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:2.0:1773851848.522025:0:41061:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000004:00000040:2.0:1773851848.522026:0:41061:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449315328 avail=351446771712 avail_mb=1372838952 hwm_mb=3131103 files=372161063 ffree=343212222 state=0: rc = 0
00000100:00000040:14.0:1773851848.522027:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:9.0:1773851848.522027:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851848.522027:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:2.0:1773851848.522030:0:41061:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449315328 free, 351446771712 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372161063 files, 343212222 free files
00000100:00000001:8.0:1773851848.522031:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00100000:14.0:1773851848.522032:0:41073:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000043120791 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051920768:54@kfi7:13:default-yuba2-0
00000100:00100000:9.0:1773851848.522032:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051920704:6@kfi7:13:default-yuba2-0
00000004:00000001:2.0:1773851848.522032:0:41061:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.522033:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851848.522034:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:2.0:1773851848.522034:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:14.0:1773851848.522035:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851848.522035:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851848.522035:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:14.0:1773851848.522036:0:41073:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851848.522036:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:8.0:1773851848.522036:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851848.522037:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666708480 avail=351645507584 avail_mb=1373615264 hwm_mb=3131103 files=372238009 ffree=343424520 state=0: rc = 0
00000100:00000040:14.0:1773851848.522038:0:41073:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000043120791 x1859433051920768/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:9.0:1773851848.522038:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b624700f x1859433051920704/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:2.0:1773851848.522039:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aaa38a11 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051920832:2095@kfi7:13:default-yuba2-0
00000004:00000020:8.0:1773851848.522040:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666708480 free, 351645507584 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372238009 files, 343424520 free files
00000100:00000001:9.0:1773851848.522042:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:2.0:1773851848.522042:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.522043:0:41073:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851848.522043:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:8.0:1773851848.522043:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.522043:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:14.0:1773851848.522044:0:41073:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851848.522044:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ba3e4e94.
00000100:00000040:2.0:1773851848.522044:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000aaa38a11 x1859433051920832/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:14.0:1773851848.522045:0:41073:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
00000100:00000040:8.0:1773851848.522045:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:9.0:1773851848.522046:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:14.0:1773851848.522047:0:41073:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851848.522047:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851848.522047:0:41069:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000020:00000001:14.0:1773851848.522048:0:41073:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:14.0:1773851848.522048:0:41073:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:2.0:1773851848.522048:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:9.0:1773851848.522049:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00100000:8.0:1773851848.522049:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2d41e54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051920640:31@kfi7:13:default-yuba2-0
02000000:00000001:2.0:1773851848.522049:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:14.0:1773851848.522050:0:41073:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851848.522050:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000545d49bf.
02000000:00000010:2.0:1773851848.522050:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000595cd4c8.
02000000:00000010:14.0:1773851848.522051:0:41073:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ffa7e932.
02000000:00000001:9.0:1773851848.522051:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:14.0:1773851848.522052:0:41073:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851848.522052:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:8.0:1773851848.522052:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:2.0:1773851848.522052:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:2.0:1773851848.522052:0:41061:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:14.0:1773851848.522053:0:41073:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851848.522053:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b624700f.
00000100:00000001:8.0:1773851848.522053:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000040:2.0:1773851848.522053:0:41061:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000100:00000010:14.0:1773851848.522054:0:41073:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000043120791.
00000100:00000040:8.0:1773851848.522054:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f2d41e54 x1859433051920640/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852001 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:2.0:1773851848.522054:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:14.0:1773851848.522055:0:41073:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851848.522055:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851848.522055:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:2.0:1773851848.522055:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000f5af9cbb.
00000100:00000001:14.0:1773851848.522056:0:41073:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851848.522056:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.522057:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:2.0:1773851848.522057:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:9.0:1773851848.522058:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851848.522058:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851848.522058:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851848.522058:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aaa38a11.
00000100:00000001:14.0:1773851848.522059:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:14.0:1773851848.522059:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851848.522059:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851848.522059:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851848.522059:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:14.0:1773851848.522060:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851848.522060:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851848.522060:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:14.0:1773851848.522061:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851848.522061:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000521610c6.
00000100:00000001:2.0:1773851848.522061:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851848.522062:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851848.522063:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851848.522063:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:2.0:1773851848.522063:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000040:8.0:1773851848.522064:0:41068:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:2.0:1773851848.522064:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.522065:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:2.0:1773851848.522065:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:8.0:1773851848.522066:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001e07dc98.
00000100:00000001:2.0:1773851848.522066:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.522067:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851848.522068:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851848.522069:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f2d41e54.
00000100:00000001:8.0:1773851848.522070:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851848.522071:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.522073:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.522074:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851848.522075:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.522076:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851848.522076:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851848.585734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851848.585737:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:9.0:1773851848.646173:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851848.646174:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851848.646176:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851848.646179:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851848.646181:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.646182:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.14@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851848.646183:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.646184:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851848.646185:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.14@o2ib60 to cpt 7
00000400:00000200:9.0:1773851848.646187:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 2
00000400:00000200:9.0:1773851848.646188:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 3
00000400:00000200:9.0:1773851848.646189:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.14@o2ib60 to cpt 7
00000400:00000200:9.0:1773851848.646191:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.14@o2ib60 of length 224 into portal 12 MB=0x69b17af54bbc0
00000400:00000200:9.0:1773851848.646192:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.14@o2ib60 of length 224/224 into md 0x77fe139dd [64] + 155296
00000800:00000200:9.0:1773851848.646194:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851848.646196:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.646197:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851848.646198:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851848.646199:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851848.646200:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000599fe334.
00000100:00000040:9.0:1773851848.646200:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000599fe334 x1859375888382912 msgsize 224
00000100:00100000:9.0:1773851848.646202:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.14@o2ib60 (source: 12345-192.168.128.14@o2ib60)
00000100:00000001:9.0:1773851848.646204:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851848.646205:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851848.646206:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851848.646207:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851848.646208:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851848.646208:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851848.646209:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851848.646210:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851848.646210:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859375888382912
00000020:00000001:31.0:1773851848.646211:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851848.646212:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae3f1d2
00000020:00000001:31.0:1773851848.646212:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851848.646215:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004d43108c refcount=5
00000020:00000001:31.0:1773851848.646215:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946297476096 : -107127412075520 : ffff9e9174a85400)
00000020:00000001:31.0:1773851848.646216:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946297476096 : -107127412075520 : ffff9e9174a85400)
00000100:00000001:31.0:1773851848.646217:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.646218:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851848.646218:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851848.646219:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851848.646220:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851848.646221:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851848.646221:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851848.646222:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.646223:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851848.646223:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851848.646223:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.646224:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.646225:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851848.646226:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851848.646227:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.14@o2ib60, seq: 2055439
00000100:00000001:29.0:1773851848.646227:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851848.646227:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851848.646228:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004d43108c : new rpc_count 1
00000100:00000001:29.0:1773851848.646228:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.646229:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569661568 : -106988139890048 : ffff9eb1e1ed3a80)
00000100:00000001:29.0:1773851848.646229:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.646230:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000599fe334 x1859375888382912/t0(0) o400->a18f2895-7960-4808-acf3-aecc617f42d6@192.168.128.14@o2ib60:636/0 lens 224/0 e 0 to 0 dl 1773851996 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix14-0'
00000100:00000001:31.0:1773851848.646233:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.646233:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851848.646235:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000599fe334 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:a18f2895-7960-4808-acf3-aecc617f42d6+5:39987:x1859375888382912:12345-192.168.128.14@o2ib60:400:default-matrix14-0
00000100:00000200:31.0:1773851848.646236:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859375888382912
00000020:00000001:31.0:1773851848.646237:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851848.646237:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851848.646238:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.646240:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851848.646240:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851848.646241:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851848.646241:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859375888382912, found 0 last_xid 1859375888382911
00000020:00000001:31.0:1773851848.646242:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851848.646243:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851848.646243:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851848.646243:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.646244:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851848.646244:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851848.646245:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851848.646245:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e6269dcf.
02000000:00000001:31.0:1773851848.646246:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.646246:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.646247:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851848.646248:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182562244964, transno 0, xid 1859375888382912
00010000:00000001:31.0:1773851848.646248:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851848.646249:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000599fe334 x1859375888382912/t0(0) o400->a18f2895-7960-4808-acf3-aecc617f42d6@192.168.128.14@o2ib60:636/0 lens 224/224 e 0 to 0 dl 1773851996 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix14-0'
00010000:00000001:31.0:1773851848.646252:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851848.646252:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851848.646253:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=81 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851848.646254:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851848.646255:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f64972ed refcount 3 to 192.168.128.14@o2ib60
00000100:00000001:31.0:1773851848.646255:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934276594496 : -107139432957120 : ffff9e8ea8283b40)
02000000:00000001:31.0:1773851848.646256:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851848.646256:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.646257:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851848.646258:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.14@o2ib60
00000400:00000010:31.0:1773851848.646259:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb75a26a.
00000100:00000200:31.0:1773851848.646260:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859375888382912, offset 224
00000400:00000200:31.0:1773851848.646262:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.14@o2ib60
00000400:00000200:31.0:1773851848.646263:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.14@o2ib60 to cpt 7
00000400:00000200:31.0:1773851848.646264:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 2
00000400:00000200:31.0:1773851848.646266:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 3
00000400:00000200:31.0:1773851848.646268:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 4
00000400:00000200:31.0:1773851848.646269:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.14@o2ib60 routed destination
00000400:00000200:31.0:1773851848.646271:0:42267:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:31.0:1773851848.646272:0:42267:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:31.0:1773851848.646273:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.14@o2ib60: rtr pref emtpy: 1
00000400:00000200:31.0:1773851848.646275:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:31.0:1773851848.646276:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.14@o2ib60: rtr pref emtpy: 1
00000400:00000200:31.0:1773851848.646276:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:31.0:1773851848.646278:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768382:8768382:1024:4294967295] 17@kfi7 LPNI seq info [1250891877:1250891877:16:4294967295]
00000400:00000200:31.0:1773851848.646279:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:31.0:1773851848.646280:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:31.0:1773851848.646283:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.14@o2ib60(192.168.128.14@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851848.646284:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 3
00000800:00000200:31.0:1773851848.646286:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851848.646287:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851848.646289:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851848.646291:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:31.0:1773851848.646295:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:31.0:1773851848.646296:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851848.646298:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.646299:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f64972ed refcount 2 to 192.168.128.14@o2ib60
00010000:00000001:31.0:1773851848.646300:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851848.646300:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.646301:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851848.646302:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000599fe334 x1859375888382912/t0(0) o400->a18f2895-7960-4808-acf3-aecc617f42d6@192.168.128.14@o2ib60:636/0 lens 224/224 e 0 to 0 dl 1773851996 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix14-0'
00000100:00100000:31.0:1773851848.646305:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000599fe334 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:a18f2895-7960-4808-acf3-aecc617f42d6+5:39987:x1859375888382912:12345-192.168.128.14@o2ib60:400:default-matrix14-0 Request processed in 71us (104us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851848.646307:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.14@o2ib60, seq: 2055439
00000100:00000040:31.0:1773851848.646308:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004d43108c : new rpc_count 0
00000800:00000200:29.0:1773851848.646308:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851848.646309:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851848.646309:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851848.646309:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851848.646310:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000400:00000200:29.0:1773851848.646310:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851848.646311:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000020:00000040:31.0:1773851848.646311:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000004d43108c : new refcount 4
00000400:00000200:29.0:1773851848.646311:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:31.0:1773851848.646312:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851848.646312:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb75a26a
00000400:00000010:29.0:1773851848.646313:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb75a26a.
00000100:00000001:29.0:1773851848.646313:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851848.646314:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851848.646315:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:29.0:1773851848.646316:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Transaction freed
00000800:00000200:13.0:1773851848.671477:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851848.671478:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851848.671479:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851848.671481:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851848.671483:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.671484:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25347@kfi7 : PUT - for me
00000400:00000200:13.0:1773851848.671485:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.671486:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00000400:00000200:13.0:1773851848.671486:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.671487:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:13.0:1773851848.671488:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000400:00000200:13.0:1773851848.671488:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:13.0:1773851848.671490:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 224 into portal 12 MB=0x69a1b65e01e00
00000400:00000200:13.0:1773851848.671491:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25346@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 9640
00000800:00000200:13.0:1773851848.671492:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851848.671494:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851848.671495:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25347@kfi7: PUT: OK
00000100:00000001:13.0:1773851848.671496:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851848.671496:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851848.671497:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000debdc025.
00000100:00000040:13.0:1773851848.671497:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000debdc025 x1858292324244992 msgsize 224
00000100:00100000:13.0:1773851848.671499:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25347@kfi7)
00000100:00000001:13.0:1773851848.671500:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851848.671501:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000100:00000001:14.0:1773851848.671502:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851848.671502:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851848.671502:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851848.671503:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851848.671503:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851848.671504:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851848.671505:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324244992
00000020:00000001:14.0:1773851848.671506:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851848.671506:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000020:00000001:14.0:1773851848.671507:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851848.671508:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=10
00000020:00000001:14.0:1773851848.671509:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000020:00000001:14.0:1773851848.671510:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000100:00000001:14.0:1773851848.671511:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.671511:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851848.671512:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d8eeec17.
00000020:00000010:14.0:1773851848.671513:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851848.671514:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851848.671515:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851848.671516:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851848.671516:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.671517:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851848.671518:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851848.671518:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.671520:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.671520:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851848.671521:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851848.671521:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851848.671522:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851848.671522:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 2289755
00000100:00000001:15.0:1773851848.671523:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.671523:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 1
00000100:00000001:14.0:1773851848.671523:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251432704 : -106960458118912 : ffff9eb853e38900)
00000100:00000001:15.0:1773851848.671524:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.671525:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000debdc025 x1858292324244992/t0(0) o400->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2087-0'
00000100:00000001:14.0:1773851848.671527:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.671528:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851848.671529:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000debdc025 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4fec6715-7b94-4677-aa38-bf65c6472a0a+10:39513:x1858292324244992:12345-25346@kfi7:400:default-tuolumne2087-0
00000100:00000200:14.0:1773851848.671530:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324244992
00000020:00000001:14.0:1773851848.671531:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851848.671532:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851848.671532:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.671533:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851848.671533:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851848.671534:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851848.671535:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858292324244992, found 0 last_xid 1858292324244991
00000020:00000001:14.0:1773851848.671536:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851848.671536:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851848.671537:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851848.671538:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.671538:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851848.671539:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851848.671539:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851848.671540:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cad4d41a.
02000000:00000001:14.0:1773851848.671541:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.671541:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.671542:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851848.671543:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260458323, transno 0, xid 1858292324244992
00010000:00000001:14.0:1773851848.671544:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851848.671545:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000debdc025 x1858292324244992/t0(0) o400->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2087-0'
00010000:00000001:14.0:1773851848.671547:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851848.671547:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851848.671548:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=81 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851848.671549:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851848.671550:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00000100:00000001:14.0:1773851848.671551:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
02000000:00000001:14.0:1773851848.671551:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851848.671552:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.671553:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851848.671553:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25347@kfi7
00000400:00000010:14.0:1773851848.671554:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f61d88ce.
00000100:00000200:14.0:1773851848.671555:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858292324244992, offset 224
00000400:00000200:14.0:1773851848.671556:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25347@kfi7
00000400:00000200:14.0:1773851848.671557:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.671558:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00000400:00000200:14.0:1773851848.671559:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:14.0:1773851848.671560:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000400:00000200:14.0:1773851848.671561:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25347@kfi7 local destination
00000400:00000200:14.0:1773851848.671562:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768383:8768383:1024:4294967295] 25347@kfi7 LPNI seq info [16384151:16384151:16:4294967295]
00000400:00000200:14.0:1773851848.671564:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:14.0:1773851848.671565:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.671567:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25347@kfi7(25347@kfi7:25347@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851848.671568:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000800:00000200:14.0:1773851848.671569:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851848.671570:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851848.671572:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851848.671575:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 Using peer 25347@kfi7(0x100000000000d80)
00000800:00000200:14.0:1773851848.671578:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000c8e2b965: Posted send of 324 bytes to peer 0x100000000000d80: rc=0
00000800:00000200:14.0:1773851848.671579:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851848.671581:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.671582:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:14.0:1773851848.671583:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851848.671583:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.671584:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851848.671585:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000debdc025 x1858292324244992/t0(0) o400->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2087-0'
00000100:00100000:14.0:1773851848.671588:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000debdc025 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4fec6715-7b94-4677-aa38-bf65c6472a0a+10:39513:x1858292324244992:12345-25346@kfi7:400:default-tuolumne2087-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851848.671590:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 2289755
00000100:00000040:14.0:1773851848.671591:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 0
00000100:00000001:14.0:1773851848.671591:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851848.671591:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851848.671592:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851848.671592:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000400:00000200:13.0:1773851848.671592:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851848.671593:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000400:00000200:13.0:1773851848.671593:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25347@kfi7: PUT: OK
00000020:00000010:14.0:1773851848.671594:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d8eeec17.
00000400:00000200:13.0:1773851848.671594:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f61d88ce
00000020:00000040:14.0:1773851848.671595:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 9
00000400:00000010:13.0:1773851848.671595:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f61d88ce.
00000100:00000001:13.0:1773851848.671595:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851848.671596:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851848.671596:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851848.671596:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000800:00000200:13.0:1773851848.671598:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 Transaction freed
00000800:00000200:13.0:1773851848.685440:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851848.685440:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851848.685441:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851848.685443:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851848.685445:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.685446:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12160@kfi7 : PUT - for me
00000400:00000200:13.0:1773851848.685447:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.685448:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 1
00000400:00000200:13.0:1773851848.685449:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.685449:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000400:00000200:13.0:1773851848.685450:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 3
00000400:00000200:13.0:1773851848.685451:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12097@kfi7 to cpt 3
00000400:00000200:13.0:1773851848.685451:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12097@kfi7 of length 224 into portal 12 MB=0x69b4b64daee80
00000400:00000200:13.0:1773851848.685452:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12097@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 9864
00000800:00000200:13.0:1773851848.685454:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851848.685455:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851848.685456:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12160@kfi7: PUT: OK
00000100:00000001:13.0:1773851848.685456:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851848.685457:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851848.685457:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f70bc8a6.
00000100:00000040:13.0:1773851848.685458:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000f70bc8a6 x1859597977185920 msgsize 224
00000100:00100000:13.0:1773851848.685459:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12097@kfi7 (source: 12345-12160@kfi7)
00000100:00000001:13.0:1773851848.685460:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:14.0:1773851848.685461:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851848.685461:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
02000000:00000001:14.0:1773851848.685462:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851848.685462:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851848.685462:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851848.685463:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851848.685463:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851848.685464:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597977185920
00000020:00000001:14.0:1773851848.685464:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851848.685465:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d809be
00000020:00000001:14.0:1773851848.685466:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851848.685468:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000037094f66 refcount=5
00000020:00000001:14.0:1773851848.685469:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637153820704768 : -106919888846848 : ffff9ec1c6018000)
00000020:00000001:14.0:1773851848.685469:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637153820704768 : -106919888846848 : ffff9ec1c6018000)
00000100:00000001:14.0:1773851848.685470:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.685471:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851848.685471:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d8eeec17.
00000020:00000010:14.0:1773851848.685472:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851848.685473:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851848.685473:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851848.685474:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851848.685474:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.685475:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851848.685475:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851848.685476:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.685476:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851848.685477:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851848.685478:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851848.685478:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851848.685478:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851848.685479:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851848.685479:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12097@kfi7, seq: 2289756
00000100:00000040:14.0:1773851848.685479:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000037094f66 : new rpc_count 1
00000100:00000001:15.0:1773851848.685480:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.685480:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251431552 : -106960458120064 : ffff9eb853e38480)
00000100:00000040:14.0:1773851848.685481:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f70bc8a6 x1859597977185920/t0(0) o400->c410130f-dc41-4340-9780-23a22a0eb5e4@12097@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1252-0'
00000100:00000001:14.0:1773851848.685483:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851848.685483:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851848.685484:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f70bc8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c410130f-dc41-4340-9780-23a22a0eb5e4+5:39753:x1859597977185920:12345-12097@kfi7:400:default-tuolumne1252-0
00000100:00000200:14.0:1773851848.685485:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597977185920
00000020:00000001:14.0:1773851848.685486:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851848.685486:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851848.685487:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.685487:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851848.685488:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851848.685490:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851848.685490:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597977185920, found 0 last_xid 1859597977185919
00000020:00000001:14.0:1773851848.685491:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851848.685492:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851848.685492:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851848.685492:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.685493:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851848.685493:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851848.685494:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851848.685495:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a6b8bbcb.
02000000:00000001:14.0:1773851848.685495:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.685496:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.685496:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851848.685497:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688162, transno 0, xid 1859597977185920
00010000:00000001:14.0:1773851848.685497:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851848.685498:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f70bc8a6 x1859597977185920/t0(0) o400->c410130f-dc41-4340-9780-23a22a0eb5e4@12097@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1252-0'
00010000:00000001:14.0:1773851848.685501:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851848.685501:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851848.685502:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=81 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851848.685503:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851848.685503:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000096d83fa1 refcount 3 to 12097@kfi7
00000100:00000001:14.0:1773851848.685504:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729296384 : -107155980255232 : ffff9e8acddc8000)
02000000:00000001:14.0:1773851848.685505:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851848.685505:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851848.685506:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851848.685506:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12160@kfi7
00000400:00000010:14.0:1773851848.685507:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe17ed94.
00000100:00000200:14.0:1773851848.685508:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597977185920, offset 224
00000400:00000200:14.0:1773851848.685509:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12160@kfi7
00000400:00000200:14.0:1773851848.685510:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.685511:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 1
00000400:00000200:14.0:1773851848.685511:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000400:00000200:14.0:1773851848.685512:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 3
00000400:00000200:14.0:1773851848.685514:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12160@kfi7 local destination
00000400:00000200:14.0:1773851848.685515:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768384:8768384:1024:4294967295] 12160@kfi7 LPNI seq info [819951:819951:16:4294967295]
00000400:00000200:14.0:1773851848.685516:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000400:00000200:14.0:1773851848.685517:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:14.0:1773851848.685518:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12160@kfi7(12160@kfi7:12160@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851848.685519:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 3
00000800:00000200:14.0:1773851848.685521:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851848.685522:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851848.685524:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851848.685526:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000100b Using peer 12160@kfi7(0x10000000000100b)
00000800:00000200:14.0:1773851848.685528:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ba933e94: Posted send of 324 bytes to peer 0x10000000000100b: rc=0
00000800:00000200:14.0:1773851848.685530:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000100b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851848.685531:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851848.685532:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000096d83fa1 refcount 2 to 12097@kfi7
00010000:00000001:14.0:1773851848.685532:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851848.685533:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851848.685533:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851848.685534:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f70bc8a6 x1859597977185920/t0(0) o400->c410130f-dc41-4340-9780-23a22a0eb5e4@12097@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1252-0'
00000100:00100000:14.0:1773851848.685537:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f70bc8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c410130f-dc41-4340-9780-23a22a0eb5e4+5:39753:x1859597977185920:12345-12097@kfi7:400:default-tuolumne1252-0 Request processed in 53us (78us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851848.685539:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12097@kfi7, seq: 2289756
00000100:00000040:14.0:1773851848.685539:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000037094f66 : new rpc_count 0
00000100:00000001:14.0:1773851848.685540:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851848.685540:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851848.685541:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851848.685542:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000020:00000010:14.0:1773851848.685542:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d8eeec17.
00000800:00000200:13.0:1773851848.685542:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000100b TN_EVENT_TX_OK event status 0
00000020:00000040:14.0:1773851848.685543:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000037094f66 : new refcount 4
00000400:00000200:13.0:1773851848.685543:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851848.685544:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851848.685544:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12160@kfi7: PUT: OK
00000400:00000200:13.0:1773851848.685544:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe17ed94
00000400:00000010:13.0:1773851848.685545:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe17ed94.
00000100:00000001:13.0:1773851848.685545:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851848.685545:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851848.685546:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000800:00000200:13.0:1773851848.685547:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 12160@kfi7(000000003c0c0564):0x0 lsk 4108 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000100b Transaction freed
00000800:00000200:17.0:1773851848.688979:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851848.688980:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851848.688981:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851848.688983:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851848.688984:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.688985:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15713@kfi7 : PUT - for me
00000400:00000200:17.0:1773851848.688986:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.688987:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 1
00000400:00000200:17.0:1773851848.688988:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851848.688988:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000400:00000200:17.0:1773851848.688989:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 3
00000400:00000200:17.0:1773851848.688990:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15777@kfi7 to cpt 0
00000400:00000200:17.0:1773851848.688991:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15777@kfi7 of length 224 into portal 12 MB=0x69b4b5c4feac0
00000400:00000200:17.0:1773851848.688992:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15777@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 183672
00000800:00000200:17.0:1773851848.688994:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851848.688996:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851848.688997:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15713@kfi7: PUT: OK
00000100:00000001:17.0:1773851848.688998:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851848.688998:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851848.689000:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003b105c37.
00000100:00000040:17.0:1773851848.689001:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000003b105c37 x1859597833857728 msgsize 224
00000100:00100000:17.0:1773851848.689002:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15777@kfi7 (source: 12345-15713@kfi7)
00000100:00000001:17.0:1773851848.689003:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851848.689004:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851848.689004:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 2
02000000:00000001:19.0:1773851848.689005:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851848.689005:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851848.689005:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851848.689006:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851848.689007:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851848.689007:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597833857728
00000020:00000001:19.0:1773851848.689008:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851848.689009:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d800c6
00000020:00000001:19.0:1773851848.689009:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851848.689011:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000079f2046e refcount=5
00000020:00000001:19.0:1773851848.689012:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125217122304 : -106948492429312 : ffff9ebb1d197800)
00000020:00000001:19.0:1773851848.689012:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125217122304 : -106948492429312 : ffff9ebb1d197800)
00000100:00000001:19.0:1773851848.689014:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.689014:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851848.689015:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b6c87683.
00000020:00000010:19.0:1773851848.689016:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851848.689017:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851848.689018:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851848.689018:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851848.689019:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.689020:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851848.689020:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851848.689020:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.689021:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.689023:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851848.689023:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851848.689024:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15777@kfi7, seq: 2156236
00000100:00000001:18.0:1773851848.689024:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851848.689024:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851848.689025:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000079f2046e : new rpc_count 1
00000100:00000001:18.0:1773851848.689025:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.689026:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131864479360 : -106941845072256 : ffff9ebca9501680)
00000100:00000001:18.0:1773851848.689026:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.689027:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003b105c37 x1859597833857728/t0(0) o400->5c61fdcb-62ff-4226-a348-6d11e38945c6@15777@kfi7:38/0 lens 224/0 e 0 to 0 dl 1773852153 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1472-0'
00000100:00000001:19.0:1773851848.689029:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.689030:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851848.689031:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b105c37 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5c61fdcb-62ff-4226-a348-6d11e38945c6+5:39526:x1859597833857728:12345-15777@kfi7:400:default-tuolumne1472-0
00000100:00000200:19.0:1773851848.689032:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597833857728
00000020:00000001:19.0:1773851848.689032:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851848.689033:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851848.689033:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.689035:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851848.689036:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851848.689037:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851848.689037:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597833857728, found 0 last_xid 1859597833857727
00000020:00000001:19.0:1773851848.689038:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851848.689039:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851848.689039:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851848.689040:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.689041:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851848.689041:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851848.689041:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851848.689042:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004b9214a2.
02000000:00000001:19.0:1773851848.689043:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.689044:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.689044:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851848.689045:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183250624124, transno 0, xid 1859597833857728
00010000:00000001:19.0:1773851848.689046:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851848.689047:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003b105c37 x1859597833857728/t0(0) o400->5c61fdcb-62ff-4226-a348-6d11e38945c6@15777@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1472-0'
00010000:00000001:19.0:1773851848.689049:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851848.689050:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851848.689050:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=81 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851848.689051:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851848.689052:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000042cd4471 refcount 3 to 15777@kfi7
00000100:00000001:19.0:1773851848.689053:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051680 : -107154804499936 : ffff9e8b13f11a20)
02000000:00000001:19.0:1773851848.689054:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851848.689054:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.689055:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851848.689056:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15713@kfi7
00000400:00000010:19.0:1773851848.689057:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d89c953e.
00000100:00000200:19.0:1773851848.689058:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597833857728, offset 224
00000400:00000200:19.0:1773851848.689059:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15713@kfi7
00000400:00000200:19.0:1773851848.689060:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.689061:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 1
00000400:00000200:19.0:1773851848.689062:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000400:00000200:19.0:1773851848.689063:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 3
00000400:00000200:19.0:1773851848.689064:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15713@kfi7 local destination
00000400:00000200:19.0:1773851848.689066:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768385:8768385:1024:4294967295] 15713@kfi7 LPNI seq info [630454:630454:16:4294967295]
00000400:00000200:19.0:1773851848.689067:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000400:00000200:19.0:1773851848.689068:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.689070:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15713@kfi7(15713@kfi7:15713@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851848.689071:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 3
00000800:00000200:19.0:1773851848.689072:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851848.689073:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851848.689076:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851848.689078:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf48 Using peer 15713@kfi7(0xf48)
00000800:00000200:19.0:1773851848.689081:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0xf48: rc=0
00000800:00000200:19.0:1773851848.689083:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf48 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851848.689085:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.689086:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000042cd4471 refcount 2 to 15777@kfi7
00010000:00000001:19.0:1773851848.689086:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851848.689087:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.689088:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851848.689088:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003b105c37 x1859597833857728/t0(0) o400->5c61fdcb-62ff-4226-a348-6d11e38945c6@15777@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1472-0'
00000100:00100000:19.0:1773851848.689091:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b105c37 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5c61fdcb-62ff-4226-a348-6d11e38945c6+5:39526:x1859597833857728:12345-15777@kfi7:400:default-tuolumne1472-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851848.689093:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15777@kfi7, seq: 2156236
00000100:00000040:19.0:1773851848.689094:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000079f2046e : new rpc_count 0
00000100:00000001:19.0:1773851848.689095:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851848.689095:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851848.689095:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf48 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851848.689096:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851848.689097:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000400:00000200:17.0:1773851848.689097:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851848.689098:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b6c87683.
00000020:00000040:19.0:1773851848.689098:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000079f2046e : new refcount 4
00000400:00000200:17.0:1773851848.689098:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15713@kfi7: PUT: OK
00000100:00000001:19.0:1773851848.689099:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851848.689099:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d89c953e
00000400:00000010:17.0:1773851848.689099:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d89c953e.
00000100:00000001:17.0:1773851848.689100:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851848.689100:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851848.689101:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000800:00000200:17.0:1773851848.689102:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 15713@kfi7(00000000297fafb3):0x0 lsk 3913 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf48 Transaction freed
00000800:00000200:25.0:1773851848.691903:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851848.691904:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851848.691905:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851848.691907:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851848.691908:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.691909:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16122@kfi7 : PUT - for me
00000400:00000200:25.0:1773851848.691910:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.691911:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 1
00000400:00000200:25.0:1773851848.691911:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.691912:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000400:00000200:25.0:1773851848.691913:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 3
00000400:00000200:25.0:1773851848.691914:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.691914:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16122@kfi7 of length 224 into portal 12 MB=0x699de8bf3fe00
00000400:00000200:25.0:1773851848.691915:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16122@kfi7 of length 224/224 into md 0x16159c6179 [64] + 175872
00000800:00000200:25.0:1773851848.691917:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851848.691919:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851848.691920:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16122@kfi7: PUT: OK
00000100:00000001:25.0:1773851848.691921:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851848.691921:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851848.691922:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c0ee1094.
00000100:00000040:25.0:1773851848.691922:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c0ee1094 x1858030970076672 msgsize 224
00000100:00100000:25.0:1773851848.691924:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16122@kfi7 (source: 12345-16122@kfi7)
00000100:00000001:25.0:1773851848.691925:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851848.691926:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000100:00000001:24.0:1773851848.691926:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851848.691927:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851848.691927:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851848.691927:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851848.691928:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851848.691929:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851848.691930:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030970076672
00000020:00000001:24.0:1773851848.691930:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851848.691931:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9116c
00000020:00000001:24.0:1773851848.691931:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851848.691933:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e8353c94 refcount=6
00000020:00000001:24.0:1773851848.691933:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240323072 : -107152469228544 : ffff9e8b9f228400)
00000020:00000001:24.0:1773851848.691934:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240323072 : -107152469228544 : ffff9e8b9f228400)
00000100:00000001:24.0:1773851848.691935:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851848.691936:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851848.691937:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042031ddd.
00000020:00000010:24.0:1773851848.691938:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851848.691938:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bc23e3f.
00000100:00000001:24.0:1773851848.691939:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851848.691940:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851848.691940:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851848.691941:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851848.691941:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851848.691942:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.691943:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.691944:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851848.691944:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851848.691944:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851848.691944:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851848.691945:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16122@kfi7, seq: 2025028
00000100:00000001:26.0:1773851848.691946:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851848.691946:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e8353c94 : new rpc_count 1
00000100:00000001:26.0:1773851848.691947:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.691947:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700634496 : -106953008917120 : ffff9eba0fe55580)
00000100:00000040:24.0:1773851848.691948:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c0ee1094 x1858030970076672/t0(0) o400->058ed54d-94e8-4aa8-9e9f-c73e630431d8@16122@kfi7:34/0 lens 224/0 e 0 to 0 dl 1773852149 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne231-0'
00000100:00000001:24.0:1773851848.691951:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851848.691951:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851848.691952:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0ee1094 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:058ed54d-94e8-4aa8-9e9f-c73e630431d8+6:48631:x1858030970076672:12345-16122@kfi7:400:default-tuolumne231-0
00000100:00000200:24.0:1773851848.691953:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030970076672
00000020:00000001:24.0:1773851848.691954:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851848.691955:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851848.691956:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.691957:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851848.691957:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851848.691958:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851848.691959:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030970076672, found 0 last_xid 1858030970076671
00000020:00000001:24.0:1773851848.691960:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851848.691960:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851848.691961:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851848.691962:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.691962:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851848.691963:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851848.691963:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851848.691964:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e0eb9528.
02000000:00000001:24.0:1773851848.691965:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.691966:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.691966:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851848.691967:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768349, transno 0, xid 1858030970076672
00010000:00000001:24.0:1773851848.691968:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851848.691969:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c0ee1094 x1858030970076672/t0(0) o400->058ed54d-94e8-4aa8-9e9f-c73e630431d8@16122@kfi7:34/0 lens 224/224 e 0 to 0 dl 1773852149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne231-0'
00010000:00000001:24.0:1773851848.691971:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851848.691972:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851848.691973:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=81 v=288 (288 212 1 1)
00000100:00000001:24.0:1773851848.691974:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851848.691974:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008d96cbb9 refcount 5 to 16122@kfi7
00000100:00000001:24.0:1773851848.691975:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329184 : -107155410222432 : ffff9e8aefd682a0)
02000000:00000001:24.0:1773851848.691976:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851848.691977:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.691977:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851848.691978:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16122@kfi7
00000400:00000010:24.0:1773851848.691979:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000049ef55f5.
00000100:00000200:24.0:1773851848.691980:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030970076672, offset 224
00000400:00000200:24.0:1773851848.691981:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16122@kfi7
00000400:00000200:24.0:1773851848.691982:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:24.0:1773851848.691983:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 1
00000400:00000200:24.0:1773851848.691984:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000400:00000200:24.0:1773851848.691985:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 3
00000400:00000200:24.0:1773851848.691986:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16122@kfi7 local destination
00000400:00000200:24.0:1773851848.691987:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768386:8768386:1024:4294967295] 16122@kfi7 LPNI seq info [28017:28017:16:4294967295]
00000400:00000200:24.0:1773851848.691989:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000400:00000200:24.0:1773851848.691989:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:24.0:1773851848.691991:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16122@kfi7(16122@kfi7:16122@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851848.691992:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 3
00000800:00000200:24.0:1773851848.691994:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851848.691995:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851848.691997:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851848.691999:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x35b Using peer 16122@kfi7(0x35b)
00000800:00000200:24.0:1773851848.692002:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x35b: rc=0
00000800:00000200:24.0:1773851848.692003:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x35b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851848.692005:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851848.692006:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008d96cbb9 refcount 4 to 16122@kfi7
00010000:00000001:24.0:1773851848.692007:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851848.692007:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851848.692008:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851848.692009:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c0ee1094 x1858030970076672/t0(0) o400->058ed54d-94e8-4aa8-9e9f-c73e630431d8@16122@kfi7:34/0 lens 224/224 e 0 to 0 dl 1773852149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne231-0'
00000100:00100000:24.0:1773851848.692013:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0ee1094 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:058ed54d-94e8-4aa8-9e9f-c73e630431d8+6:48631:x1858030970076672:12345-16122@kfi7:400:default-tuolumne231-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851848.692015:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16122@kfi7, seq: 2025028
00000100:00000040:24.0:1773851848.692016:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e8353c94 : new rpc_count 0
00000100:00000001:24.0:1773851848.692018:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851848.692018:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851848.692019:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851848.692019:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bc23e3f.
00000020:00000010:24.0:1773851848.692020:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042031ddd.
00000020:00000040:24.0:1773851848.692021:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000e8353c94 : new refcount 5
00000100:00000001:24.0:1773851848.692022:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851848.692026:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x35b TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851848.692029:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851848.692030:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16122@kfi7: PUT: OK
00000400:00000200:25.0:1773851848.692031:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000049ef55f5
00000400:00000010:25.0:1773851848.692031:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000049ef55f5.
00000100:00000001:25.0:1773851848.692032:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851848.692032:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851848.692033:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000800:00000200:25.0:1773851848.692034:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16122@kfi7(0000000040a3824c):0x0 lsk 860 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x35b Transaction freed
00000800:00000200:9.0:1773851848.706189:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851848.706190:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851848.706192:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851848.706194:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851848.706196:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.706197:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22129@kfi7 : PUT - for me
00000400:00000200:9.0:1773851848.706198:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.706199:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 1
00000400:00000200:9.0:1773851848.706200:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.706200:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000400:00000200:9.0:1773851848.706201:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 3
00000400:00000200:9.0:1773851848.706202:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22193@kfi7 to cpt 5
00000400:00000200:9.0:1773851848.706203:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22193@kfi7 of length 224 into portal 12 MB=0x69b4c38b34980
00000400:00000200:9.0:1773851848.706205:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22193@kfi7 of length 224/224 into md 0x78146ce49 [64] + 113616
00000800:00000200:9.0:1773851848.706206:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851848.706208:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.706209:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22129@kfi7: PUT: OK
00000100:00000001:9.0:1773851848.706210:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851848.706210:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851848.706211:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003a8d1543.
00000100:00000040:9.0:1773851848.706212:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003a8d1543 x1859601531357568 msgsize 224
00000100:00100000:9.0:1773851848.706213:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22193@kfi7 (source: 12345-22129@kfi7)
00000100:00000001:9.0:1773851848.706214:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851848.706215:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000100:00000001:8.0:1773851848.706215:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851848.706216:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851848.706216:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851848.706216:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851848.706217:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.706218:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851848.706219:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601531357568
00000020:00000001:8.0:1773851848.706219:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851848.706220:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff81073
00000020:00000001:8.0:1773851848.706220:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851848.706222:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000023bd2e3d refcount=5
00000020:00000001:8.0:1773851848.706223:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130249601024 : -106943459950592 : ffff9ebc490f0000)
00000020:00000001:8.0:1773851848.706223:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130249601024 : -106943459950592 : ffff9ebc490f0000)
00000100:00000001:8.0:1773851848.706224:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.706225:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851848.706226:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851848.706227:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.706228:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851848.706229:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851848.706229:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851848.706230:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.706231:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851848.706231:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851848.706232:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.706233:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851848.706235:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851848.706235:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851848.706235:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851848.706235:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851848.706236:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22193@kfi7, seq: 2130702
00000100:00000001:11.0:1773851848.706237:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.706237:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000023bd2e3d : new rpc_count 1
00000100:00000001:11.0:1773851848.706238:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.706238:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569662720 : -106988139888896 : ffff9eb1e1ed3f00)
00000100:00000040:8.0:1773851848.706239:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003a8d1543 x1859601531357568/t0(0) o400->05298562-b381-4e97-806e-d1d8a4b2af67@22193@kfi7:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1870-0'
00000100:00000001:8.0:1773851848.706242:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.706242:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851848.706244:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a8d1543 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:05298562-b381-4e97-806e-d1d8a4b2af67+5:39506:x1859601531357568:12345-22193@kfi7:400:default-tuolumne1870-0
00000100:00000200:8.0:1773851848.706245:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601531357568
00000020:00000001:8.0:1773851848.706246:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851848.706246:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851848.706247:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.706248:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851848.706248:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851848.706249:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851848.706250:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601531357568, found 0 last_xid 1859601531357567
00000020:00000001:8.0:1773851848.706250:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851848.706251:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851848.706252:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851848.706252:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.706253:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851848.706253:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851848.706254:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851848.706255:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000369288ef.
02000000:00000001:8.0:1773851848.706255:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.706256:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.706256:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851848.706257:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686894, transno 0, xid 1859601531357568
00010000:00000001:8.0:1773851848.706258:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851848.706259:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003a8d1543 x1859601531357568/t0(0) o400->05298562-b381-4e97-806e-d1d8a4b2af67@22193@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1870-0'
00010000:00000001:8.0:1773851848.706261:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851848.706262:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851848.706262:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=81 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851848.706263:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851848.706264:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000023706f59 refcount 3 to 22193@kfi7
00000100:00000001:8.0:1773851848.706265:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107936 : -107156354443680 : ffff9e8ab78ed660)
02000000:00000001:8.0:1773851848.706266:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851848.706267:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.706268:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851848.706268:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22129@kfi7
00000400:00000010:8.0:1773851848.706269:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7b495c.
00000100:00000200:8.0:1773851848.706270:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601531357568, offset 224
00000400:00000200:8.0:1773851848.706271:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22129@kfi7
00000400:00000200:8.0:1773851848.706272:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:8.0:1773851848.706273:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 1
00000400:00000200:8.0:1773851848.706274:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000400:00000200:8.0:1773851848.706275:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 3
00000400:00000200:8.0:1773851848.706276:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22129@kfi7 local destination
00000400:00000200:8.0:1773851848.706278:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768387:8768387:1024:4294967295] 22129@kfi7 LPNI seq info [201219:201219:16:4294967295]
00000400:00000200:8.0:1773851848.706279:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000400:00000200:8.0:1773851848.706280:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:8.0:1773851848.706282:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22129@kfi7(22129@kfi7:22129@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851848.706283:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 3
00000800:00000200:8.0:1773851848.706284:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851848.706285:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851848.706287:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851848.706290:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000db7 Using peer 22129@kfi7(0x100000000000db7)
00000800:00000200:8.0:1773851848.706293:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x100000000000db7: rc=0
00000800:00000200:8.0:1773851848.706294:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000db7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851848.706296:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.706297:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000023706f59 refcount 2 to 22193@kfi7
00010000:00000001:8.0:1773851848.706298:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851848.706298:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.706299:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851848.706300:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003a8d1543 x1859601531357568/t0(0) o400->05298562-b381-4e97-806e-d1d8a4b2af67@22193@kfi7:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1870-0'
00000100:00100000:8.0:1773851848.706304:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a8d1543 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:05298562-b381-4e97-806e-d1d8a4b2af67+5:39506:x1859601531357568:12345-22193@kfi7:400:default-tuolumne1870-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851848.706306:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22193@kfi7, seq: 2130702
00000100:00000040:8.0:1773851848.706307:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000023bd2e3d : new rpc_count 0
00000100:00000001:8.0:1773851848.706308:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851848.706309:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851848.706309:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.706310:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851848.706311:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851848.706312:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000023bd2e3d : new refcount 4
00000100:00000001:8.0:1773851848.706313:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851848.706318:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000db7 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851848.706319:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.706320:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22129@kfi7: PUT: OK
00000400:00000200:9.0:1773851848.706321:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7b495c
00000400:00000010:9.0:1773851848.706322:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7b495c.
00000100:00000001:9.0:1773851848.706322:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851848.706323:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851848.706325:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000800:00000200:9.0:1773851848.706326:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 22129@kfi7(000000003832cd36):0x0 lsk 3512 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000db7 Transaction freed
00000800:00000200:19.0:1773851848.716828:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851848.716828:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851848.716829:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:19.0:1773851848.716830:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851848.716830:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:19.0:1773851848.716831:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005d7a1ecc: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851848.716832:0:2507147:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16768@kfi7(00000000b78cffdf):0x1282 version: 2; local version 2; negotiated version: 2
00000800:00000200:19.0:1773851848.716833:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005d7a1ecc: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:18.0:1773851848.716834:0:2507147:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 Using peer 16768@kfi7(0x1282)
00000400:00000200:19.0:1773851848.716835:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:18.0:1773851848.716836:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.716837:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16768@kfi7 : PUT - for me
00000400:00000200:19.0:1773851848.716838:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000800:00000200:18.0:1773851848.716838:0:2507147:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000006c9a9e9c: Posted send of 38 bytes to peer 0x1282: rc=0
00000400:00000200:19.0:1773851848.716839:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 1
00000400:00000200:19.0:1773851848.716840:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000800:00000200:18.0:1773851848.716840:0:2507147:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:19.0:1773851848.716841:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000400:00000200:19.0:1773851848.716842:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 3
00000400:00000200:19.0:1773851848.716843:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16704@kfi7 to cpt 0
00000400:00000200:19.0:1773851848.716844:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16704@kfi7 of length 224 into portal 12 MB=0x69bacb7925340
00000400:00000200:19.0:1773851848.716846:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16704@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 183896
00000800:00000200:19.0:1773851848.716848:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005d7a1ecc: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851848.716850:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851848.716851:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16768@kfi7: PUT: OK
00000800:00000200:18.0:1773851848.716851:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851848.716853:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851848.716853:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851848.716854:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002df47272.
00000800:00000200:18.0:1773851848.716854:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 Transaction freed
00000100:00000040:19.0:1773851848.716855:0:2464491:0:(events.c:358:request_in_callback()) incoming req@000000002df47272 x1860015976764224 msgsize 224
00000100:00100000:19.0:1773851848.716857:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-16704@kfi7 (source: 12345-16768@kfi7)
00000100:00000001:19.0:1773851848.716858:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851848.716859:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000800:00000200:19.0:1773851848.716861:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005d7a1ecc: 2069@kfi7:4 <- 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851848.716864:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851848.716864:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851848.716865:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851848.716866:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851848.716866:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851848.716867:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860015976764224
00000020:00000001:19.0:1773851848.716868:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851848.716868:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a59f80
00000020:00000001:19.0:1773851848.716869:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851848.716870:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000575ac09a refcount=9
00000020:00000001:19.0:1773851848.716870:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637093020567552 : -106980688984064 : ffff9eb39e090800)
00000020:00000001:19.0:1773851848.716871:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637093020567552 : -106980688984064 : ffff9eb39e090800)
00000100:00000001:19.0:1773851848.716872:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.716873:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851848.716873:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b6c87683.
00000020:00000010:19.0:1773851848.716874:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851848.716875:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851848.716876:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851848.716876:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851848.716877:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.716878:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851848.716878:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851848.716879:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.716879:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851848.716881:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851848.716881:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851848.716881:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851848.716881:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851848.716882:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16704@kfi7, seq: 2156237
00000100:00000040:19.0:1773851848.716883:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000575ac09a : new rpc_count 1
00000100:00000001:19.0:1773851848.716883:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339146752 : -106987370404864 : ffff9eb20fcaa400)
00000100:00000001:18.0:1773851848.716883:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851848.716884:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.716885:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002df47272 x1860015976764224/t0(0) o400->4cab7779-d619-43b7-8930-19969db2ae47@16704@kfi7:488/0 lens 224/0 e 0 to 0 dl 1773852603 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1540-0'
00000100:00000001:19.0:1773851848.716889:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851848.716890:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851848.716891:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002df47272 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4cab7779-d619-43b7-8930-19969db2ae47+9:59293:x1860015976764224:12345-16704@kfi7:400:default-tuolumne1540-0
00000100:00000200:19.0:1773851848.716892:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860015976764224
00000020:00000001:19.0:1773851848.716893:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851848.716893:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851848.716894:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.716895:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851848.716895:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851848.716896:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851848.716896:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860015976764224, found 0 last_xid 1860015976764223
00000020:00000001:19.0:1773851848.716897:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851848.716898:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851848.716899:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851848.716899:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.716900:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851848.716900:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851848.716901:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851848.716903:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009b0b01f2.
02000000:00000001:19.0:1773851848.716903:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.716904:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.716905:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851848.716905:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860015976764224
00010000:00000001:19.0:1773851848.716906:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851848.716907:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002df47272 x1860015976764224/t0(0) o400->4cab7779-d619-43b7-8930-19969db2ae47@16704@kfi7:488/0 lens 224/224 e 0 to 0 dl 1773852603 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1540-0'
00010000:00000001:19.0:1773851848.716909:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851848.716909:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851848.716910:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=81 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851848.716911:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851848.716912:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000011e22fb6 refcount 3 to 16704@kfi7
00000100:00000001:19.0:1773851848.716912:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637126492775744 : -106947216775872 : ffff9ebb69226540)
02000000:00000001:19.0:1773851848.716913:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851848.716914:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851848.716914:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851848.716915:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16768@kfi7
00000400:00000010:19.0:1773851848.716916:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c937ac03.
00000100:00000200:19.0:1773851848.716916:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860015976764224, offset 224
00000400:00000200:19.0:1773851848.716917:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16768@kfi7
00000400:00000200:19.0:1773851848.716918:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.716919:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 1
00000400:00000200:19.0:1773851848.716920:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000400:00000200:19.0:1773851848.716921:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 3
00000400:00000200:19.0:1773851848.716922:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16768@kfi7 local destination
00000400:00000200:19.0:1773851848.716923:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768388:8768388:1024:4294967295] 16768@kfi7 LPNI seq info [97762:97762:16:4294967295]
00000400:00000200:19.0:1773851848.716924:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000400:00000200:19.0:1773851848.716925:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:19.0:1773851848.716927:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16768@kfi7(16768@kfi7:16768@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851848.716927:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 3
00000800:00000200:19.0:1773851848.716928:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851848.716929:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851848.716931:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851848.716933:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 Using peer 16768@kfi7(0x1282)
00000800:00000200:19.0:1773851848.716936:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x1282: rc=0
00000800:00000200:19.0:1773851848.716937:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851848.716939:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851848.716940:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000011e22fb6 refcount 2 to 16704@kfi7
00010000:00000001:19.0:1773851848.716941:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851848.716941:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851848.716942:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851848.716943:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002df47272 x1860015976764224/t0(0) o400->4cab7779-d619-43b7-8930-19969db2ae47@16704@kfi7:488/0 lens 224/224 e 0 to 0 dl 1773852603 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1540-0'
00000100:00100000:19.0:1773851848.716945:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002df47272 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4cab7779-d619-43b7-8930-19969db2ae47+9:59293:x1860015976764224:12345-16704@kfi7:400:default-tuolumne1540-0 Request processed in 55us (89us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851848.716947:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16704@kfi7, seq: 2156237
00000100:00000040:19.0:1773851848.716948:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000575ac09a : new rpc_count 0
00000100:00000001:19.0:1773851848.716949:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851848.716949:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:18.0:1773851848.716949:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851848.716950:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851848.716950:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000020:00000010:19.0:1773851848.716951:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b6c87683.
00000020:00000040:19.0:1773851848.716951:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000575ac09a : new refcount 8
00000400:00000200:18.0:1773851848.716951:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851848.716952:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851848.716952:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16768@kfi7: PUT: OK
00000400:00000200:18.0:1773851848.716953:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c937ac03
00000400:00000010:18.0:1773851848.716954:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c937ac03.
00000100:00000001:18.0:1773851848.716955:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851848.716955:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851848.716956:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000800:00000200:18.0:1773851848.716958:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16768@kfi7(00000000b78cffdf):0x0 lsk 4739 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1282 Transaction freed
00000800:00000200:9.0:1773851848.723748:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851848.723748:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851848.723750:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851848.723752:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851848.723754:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19265@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.723755:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19265@kfi7 : PUT - for me
00000400:00000200:9.0:1773851848.723756:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19265@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.723757:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069bd7656 nid 19265@kfi7 refs 1
00000400:00000200:9.0:1773851848.723758:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19265@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.723759:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069bd7656 nid 19265@kfi7 refs 2
00000400:00000200:9.0:1773851848.723760:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000069bd7656 nid 19265@kfi7 refs 3
00000400:00000200:9.0:1773851848.723760:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19265@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.723761:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19265@kfi7 of length 456 into portal 12 MB=0x69b2e3cee2a80
00000400:00000200:9.0:1773851848.723763:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19265@kfi7 of length 456/456 into md 0x78146ce49 [64] + 113840
00000800:00000200:9.0:1773851848.723764:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851848.723766:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.723767:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19265@kfi7: PUT: OK
00000100:00000001:9.0:1773851848.723768:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851848.723768:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851848.723771:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac52ceae.
00000100:00000040:9.0:1773851848.723771:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ac52ceae x1859472753306240 msgsize 456
00000100:00100000:9.0:1773851848.723773:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-19265@kfi7 (source: 12345-19265@kfi7)
00000100:00000001:9.0:1773851848.723774:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851848.723775:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000069bd7656 nid 19265@kfi7 refs 2
00000100:00000001:8.0:1773851848.723775:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851848.723776:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851848.723776:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851848.723776:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851848.723777:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.723778:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851848.723778:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859472753306240
00000020:00000001:8.0:1773851848.723779:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851848.723780:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c9b8f12f4
00000020:00000001:8.0:1773851848.723781:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851848.723782:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000734708de refcount=5
00000020:00000001:8.0:1773851848.723783:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137657900032 : -106936051651584 : ffff9ebe02a0ac00)
00000020:00000001:8.0:1773851848.723783:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637137657900032 : -106936051651584 : ffff9ebe02a0ac00)
00000100:00000001:8.0:1773851848.723784:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.723785:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851848.723786:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851848.723787:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.723788:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851848.723788:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851848.723789:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851848.723790:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.723791:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.723792:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.723793:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851848.723794:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851848.723795:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851848.723795:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851848.723795:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19265@kfi7, seq: 406391001
00000100:00000001:11.0:1773851848.723796:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.723796:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000734708de : new rpc_count 1
00000100:00000001:8.0:1773851848.723796:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637076190064768 : -106997519486848 : ffff9eafb2dbf080)
00000100:00000001:11.0:1773851848.723797:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.723798:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ac52ceae x1859472753306240/t0(0) o17->6b87bff6-446b-47f4-a82f-4568da6ffd55@19265@kfi7:575/0 lens 456/0 e 0 to 0 dl 1773851935 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1700-0'
00000100:00000001:8.0:1773851848.723800:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.723800:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851848.723802:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac52ceae pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:6b87bff6-446b-47f4-a82f-4568da6ffd55+5:39993:x1859472753306240:12345-19265@kfi7:17:default-tuolumne1700-0
00000100:00000200:8.0:1773851848.723803:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859472753306240
00000020:00000001:8.0:1773851848.723804:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851848.723804:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851848.723805:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.723806:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851848.723806:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:8.0:1773851848.723807:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851848.723807:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859472753306240, found 0 last_xid 1859472753306239
00000020:00000001:8.0:1773851848.723808:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851848.723809:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851848.723810:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851848.723810:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851848.723811:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:8.0:1773851848.723812:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851848.723812:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851848.723813:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000521610c6.
02000000:00000001:8.0:1773851848.723814:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.723814:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.723815:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:8.0:1773851848.723816:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:8.0:1773851848.723817:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:8.0:1773851848.723819:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.723819:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:8.0:1773851848.723820:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 6b87bff6-446b-47f4-a82f-4568da6ffd55/00000000734708de free: 126633370845184 avail: 126633368748032
00000020:00000001:8.0:1773851848.723821:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:8.0:1773851848.723821:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 6b87bff6-446b-47f4-a82f-4568da6ffd55/00000000734708de avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:8.0:1773851848.723823:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:8.0:1773851848.723824:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:8.0:1773851848.723824:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 6b87bff6-446b-47f4-a82f-4568da6ffd55/00000000734708de reports grant 25952256 dropped 0, local 27000832
00000020:00000001:8.0:1773851848.723826:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:8.0:1773851848.723826:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:8.0:1773851848.723827:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851848.723827:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695342, transno 0, xid 1859472753306240
00010000:00000001:8.0:1773851848.723828:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851848.723829:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ac52ceae x1859472753306240/t0(0) o17->6b87bff6-446b-47f4-a82f-4568da6ffd55@19265@kfi7:575/0 lens 456/432 e 0 to 0 dl 1773851935 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1700-0'
00010000:00000001:8.0:1773851848.723831:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851848.723832:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851848.723832:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=81 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851848.723833:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851848.723834:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006cc4066c refcount 3 to 19265@kfi7
00000100:00000001:8.0:1773851848.723835:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551673632 : -107156157877984 : ffff9e8ac3463120)
02000000:00000001:8.0:1773851848.723836:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851848.723836:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.723837:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851848.723838:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19265@kfi7
00000400:00000010:8.0:1773851848.723839:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1f08bfb.
00000100:00000200:8.0:1773851848.723839:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859472753306240, offset 224
00000400:00000200:8.0:1773851848.723841:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19265@kfi7
00000400:00000200:8.0:1773851848.723842:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19265@kfi7 to cpt 2
00000400:00000200:8.0:1773851848.723842:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069bd7656 nid 19265@kfi7 refs 1
00000400:00000200:8.0:1773851848.723844:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000069bd7656 nid 19265@kfi7 refs 2
00000400:00000200:8.0:1773851848.723846:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000069bd7656 nid 19265@kfi7 refs 3
00000400:00000200:8.0:1773851848.723847:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19265@kfi7 local destination
00000400:00000200:8.0:1773851848.723848:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768389:8768389:1024:4294967295] 19265@kfi7 LPNI seq info [419285:419285:16:4294967295]
00000400:00000200:8.0:1773851848.723850:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000069bd7656 nid 19265@kfi7 refs 2
00000400:00000200:8.0:1773851848.723851:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19265@kfi7 to cpt 2
00000400:00000200:8.0:1773851848.723853:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19265@kfi7(19265@kfi7:19265@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851848.723854:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000069bd7656 nid 19265@kfi7 refs 3
00000800:00000200:8.0:1773851848.723855:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851848.723857:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:8.0:1773851848.723859:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851848.723861:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4eb Using peer 19265@kfi7(0x4eb)
00000800:00000200:8.0:1773851848.723864:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 532 bytes to peer 0x4eb: rc=0
00000800:00000200:8.0:1773851848.723865:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851848.723867:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.723868:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006cc4066c refcount 2 to 19265@kfi7
00010000:00000001:8.0:1773851848.723869:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851848.723869:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.723870:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851848.723871:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac52ceae x1859472753306240/t0(0) o17->6b87bff6-446b-47f4-a82f-4568da6ffd55@19265@kfi7:575/0 lens 456/432 e 0 to 0 dl 1773851935 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1700-0'
00000100:00100000:8.0:1773851848.723874:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac52ceae pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:6b87bff6-446b-47f4-a82f-4568da6ffd55+5:39993:x1859472753306240:12345-19265@kfi7:17:default-tuolumne1700-0 Request processed in 73us (102us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851848.723876:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19265@kfi7, seq: 406391001
00000100:00000040:8.0:1773851848.723877:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000734708de : new rpc_count 0
00000100:00000001:8.0:1773851848.723878:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851848.723878:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851848.723879:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.723880:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851848.723881:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851848.723881:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000734708de : new refcount 4
00000100:00000001:8.0:1773851848.723882:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851848.723886:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4eb TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851848.723888:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.723889:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19265@kfi7: PUT: OK
00000400:00000200:9.0:1773851848.723890:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1f08bfb
00000400:00000010:9.0:1773851848.723891:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1f08bfb.
00000100:00000001:9.0:1773851848.723891:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851848.723892:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851848.723892:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000069bd7656 nid 19265@kfi7 refs 2
00000800:00000200:9.0:1773851848.723894:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19265@kfi7(00000000b3b6841a):0x0 lsk 1260 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4eb Transaction freed
00000800:00000200:25.0:1773851848.833921:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851848.833921:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851848.833922:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851848.833924:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851848.833926:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.833927:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14656@kfi7 : PUT - for me
00000400:00000200:25.0:1773851848.833928:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.833929:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 1
00000400:00000200:25.0:1773851848.833929:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.833930:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000400:00000200:25.0:1773851848.833931:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 3
00000400:00000200:25.0:1773851848.833931:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.833932:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14656@kfi7 of length 224 into portal 12 MB=0x699e140c80740
00000400:00000200:25.0:1773851848.833933:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14656@kfi7 of length 224/224 into md 0x16159c6179 [64] + 176096
00000800:00000200:25.0:1773851848.833935:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851848.833936:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851848.833937:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14656@kfi7: PUT: OK
00000100:00000001:25.0:1773851848.833938:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851848.833938:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851848.833939:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000141c4f41.
00000100:00000040:25.0:1773851848.833940:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000141c4f41 x1858042593806144 msgsize 224
00000100:00100000:25.0:1773851848.833941:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-14656@kfi7 (source: 12345-14656@kfi7)
00000100:00000001:25.0:1773851848.833942:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851848.833943:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000800:00000200:25.0:1773851848.833944:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851848.833945:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851848.833946:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851848.833946:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851848.833947:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851848.833948:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851848.833950:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042593806144
00000020:00000001:24.0:1773851848.833951:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851848.833951:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b27
00000020:00000001:24.0:1773851848.833952:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851848.833954:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a0704df refcount=572
00000020:00000001:24.0:1773851848.833955:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743664640 : -107128965886976 : ffff9e91180b0c00)
00000020:00000001:24.0:1773851848.833957:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743664640 : -107128965886976 : ffff9e91180b0c00)
00000100:00000001:24.0:1773851848.833958:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851848.833959:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851848.833960:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000abee30ba.
00000020:00000010:24.0:1773851848.833962:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851848.833963:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bc23e3f.
00000100:00000001:24.0:1773851848.833965:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851848.833965:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851848.833966:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851848.833968:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851848.833968:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851848.833969:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851848.833971:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.833972:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851848.833973:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851848.833973:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:26.0:1773851848.833974:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14656@kfi7, seq: 2025029
00000100:00000001:24.0:1773851848.833974:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851848.833975:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a0704df : new rpc_count 18
00000100:00000001:24.0:1773851848.833975:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.833976:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700620672 : -106953008930944 : ffff9eba0fe51f80)
00000100:00000001:24.0:1773851848.833976:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851848.833977:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000141c4f41 x1858042593806144/t0(0) o400->4d613da8-52a2-45c5-a864-e0ec635d8ba1@14656@kfi7:65/0 lens 224/0 e 0 to 0 dl 1773852180 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1412-0'
00000100:00000001:26.0:1773851848.833980:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851848.833980:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851848.833981:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000141c4f41 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4d613da8-52a2-45c5-a864-e0ec635d8ba1+572:39653:x1858042593806144:12345-14656@kfi7:400:default-tuolumne1412-0
00000100:00000200:26.0:1773851848.833983:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042593806144
00000020:00000001:26.0:1773851848.833983:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851848.833984:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851848.833985:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.833985:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851848.833986:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851848.833987:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851848.833987:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042593806144, found 0 last_xid 1858042587434367
00000020:00000001:26.0:1773851848.833988:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851848.833989:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851848.833989:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851848.833990:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.833991:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851848.833991:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851848.833992:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851848.833992:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000018144b84.
02000000:00000001:26.0:1773851848.833993:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.833994:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.833995:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851848.833995:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578672, transno 0, xid 1858042593806144
00010000:00000001:26.0:1773851848.833996:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851848.833997:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000141c4f41 x1858042593806144/t0(0) o400->4d613da8-52a2-45c5-a864-e0ec635d8ba1@14656@kfi7:65/0 lens 224/224 e 0 to 0 dl 1773852180 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1412-0'
00010000:00000001:26.0:1773851848.833999:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851848.834000:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851848.834000:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=81 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851848.834002:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851848.834002:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000566f837e refcount 3 to 14656@kfi7
00000100:00000001:26.0:1773851848.834003:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857632 : -107149578693984 : ffff9e8c4b6c92a0)
02000000:00000001:26.0:1773851848.834004:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851848.834004:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.834005:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851848.834006:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14656@kfi7
00000400:00000010:26.0:1773851848.834007:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004b36f071.
00000100:00000200:26.0:1773851848.834007:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042593806144, offset 224
00000400:00000200:26.0:1773851848.834009:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14656@kfi7
00000400:00000200:26.0:1773851848.834010:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:26.0:1773851848.834010:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 1
00000400:00000200:26.0:1773851848.834011:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000400:00000200:26.0:1773851848.834013:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 3
00000400:00000200:26.0:1773851848.834014:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14656@kfi7 local destination
00000400:00000200:26.0:1773851848.834015:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768390:8768390:1024:4294967295] 14656@kfi7 LPNI seq info [10777233:10777233:16:4294967295]
00000400:00000200:26.0:1773851848.834017:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000400:00000200:26.0:1773851848.834017:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:26.0:1773851848.834020:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14656@kfi7(14656@kfi7:14656@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851848.834021:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 3
00000800:00000200:26.0:1773851848.834022:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851848.834023:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851848.834026:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851848.834028:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007b5 Using peer 14656@kfi7(0x1000000000007b5)
00000800:00000200:26.0:1773851848.834031:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x1000000000007b5: rc=0
00000800:00000200:26.0:1773851848.834032:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851848.834034:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851848.834035:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000566f837e refcount 2 to 14656@kfi7
00010000:00000001:26.0:1773851848.834036:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851848.834036:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.834037:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851848.834037:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000141c4f41 x1858042593806144/t0(0) o400->4d613da8-52a2-45c5-a864-e0ec635d8ba1@14656@kfi7:65/0 lens 224/224 e 0 to 0 dl 1773852180 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1412-0'
00000100:00100000:26.0:1773851848.834040:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000141c4f41 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4d613da8-52a2-45c5-a864-e0ec635d8ba1+572:39653:x1858042593806144:12345-14656@kfi7:400:default-tuolumne1412-0 Request processed in 59us (99us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851848.834043:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14656@kfi7, seq: 2025029
00000100:00000040:26.0:1773851848.834043:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a0704df : new rpc_count 17
00000100:00000001:26.0:1773851848.834044:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851848.834045:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851848.834045:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:26.0:1773851848.834046:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bc23e3f.
00000800:00000200:25.0:1773851848.834046:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007b5 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851848.834047:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000abee30ba.
00000400:00000200:25.0:1773851848.834047:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:26.0:1773851848.834048:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000009a0704df : new refcount 571
00000400:00000200:25.0:1773851848.834048:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14656@kfi7: PUT: OK
00000100:00000001:26.0:1773851848.834049:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851848.834049:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004b36f071
00000400:00000010:25.0:1773851848.834049:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004b36f071.
00000100:00000001:25.0:1773851848.834050:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851848.834050:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851848.834051:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000800:00000200:25.0:1773851848.834052:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 14656@kfi7(000000004eaddff2):0x0 lsk 1974 rsk 73 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007b5 Transaction freed
00010000:00000001:2.0:1773851848.841731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841736:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851848.841736:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851848.841737:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841737:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851848.841737:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841738:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841738:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841739:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851848.841740:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851848.841740:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841740:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851848.841741:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841741:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841742:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841742:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851848.841743:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851848.841743:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841744:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851848.841744:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841744:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841745:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851848.841746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851848.841746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851848.841751:0:937840:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851848.841752:0:937840:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851848.841754:0:937840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:29.0:1773851848.846841:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851848.846842:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851848.846844:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851848.846846:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851848.846849:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.846850:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23034@kfi7 : PUT - for me
00000400:00000200:29.0:1773851848.846851:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.846852:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 1
00000400:00000200:29.0:1773851848.846854:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.846855:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:29.0:1773851848.846856:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000400:00000200:29.0:1773851848.846857:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851848.846858:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23034@kfi7 of length 440 into portal 12 MB=0x699de8c0a72c0
00000400:00000200:29.0:1773851848.846860:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23034@kfi7 of length 440/440 into md 0x77fe139dd [64] + 155520
00000800:00000200:29.0:1773851848.846862:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851848.846864:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851848.846865:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23034@kfi7: PUT: OK
00000100:00000001:29.0:1773851848.846866:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851848.846867:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851848.846868:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003a15e32e.
00000100:00000040:29.0:1773851848.846869:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000003a15e32e x1858030971548352 msgsize 440
00000100:00100000:29.0:1773851848.846871:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23034@kfi7 (source: 12345-23034@kfi7)
00000100:00000001:29.0:1773851848.846872:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851848.846873:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000100:00000001:31.0:1773851848.846874:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851848.846875:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851848.846875:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851848.846875:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851848.846876:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851848.846877:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851848.846877:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030971548352
00000020:00000001:31.0:1773851848.846878:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851848.846879:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91245
00000020:00000001:31.0:1773851848.846879:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851848.846881:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002e6d822b refcount=6
00000020:00000001:31.0:1773851848.846882:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240525824 : -107152469025792 : ffff9e8b9f259c00)
00000020:00000001:31.0:1773851848.846883:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240525824 : -107152469025792 : ffff9e8b9f259c00)
00000100:00000001:31.0:1773851848.846884:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.846885:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851848.846885:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851848.846887:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851848.846887:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851848.846888:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851848.846889:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851848.846890:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.846891:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.846893:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851848.846894:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851848.846894:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851848.846895:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851848.846895:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851848.846896:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23034@kfi7, seq: 364304978
00000100:00000040:31.0:1773851848.846897:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002e6d822b : new rpc_count 1
00000100:00000001:29.0:1773851848.846897:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.846898:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125762064256 : -106947947487360 : ffff9ebb3d949f80)
00000100:00000001:29.0:1773851848.846898:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.846899:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003a15e32e x1858030971548352/t0(0) o41->58446cfb-775d-4bd9-821c-19e06c4d30cc@23034@kfi7:636/0 lens 440/0 e 0 to 0 dl 1773851996 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne258-0'
00000100:00000001:31.0:1773851848.846902:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851848.846903:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851848.846904:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a15e32e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:58446cfb-775d-4bd9-821c-19e06c4d30cc+6:107694:x1858030971548352:12345-23034@kfi7:41:default-tuolumne258-0
00000100:00000200:31.0:1773851848.846906:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030971548352
00000020:00000001:31.0:1773851848.846906:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851848.846907:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851848.846908:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.846909:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851848.846909:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:31.0:1773851848.846910:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851848.846911:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030971548352, found 0 last_xid 1858030971548351
00000020:00000001:31.0:1773851848.846912:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851848.846913:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851848.846913:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851848.846914:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.846915:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851848.846915:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851848.846916:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000833e2e5a.
02000000:00000001:31.0:1773851848.846917:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.846918:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846920:0:42267:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:31.0:1773851848.846920:0:42267:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:31.0:1773851848.846921:0:42267:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846924:0:42267:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:31.0:1773851848.846925:0:42267:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851848.846927:0:42267:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846929:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851848.846930:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846931:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851848.846932:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846933:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851848.846934:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846935:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851848.846935:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846936:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851848.846937:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846939:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846939:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500133376 free, 351498078208 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097839 files, 343261849 free files
00000004:00000001:31.0:1773851848.846942:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846943:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846943:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504311296 free, 351502151680 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056293 files, 343265929 free files
00000004:00000001:31.0:1773851848.846945:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846946:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846947:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690109952 free, 351687655424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231313 files, 343447373 free files
00000004:00000001:31.0:1773851848.846948:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846950:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846950:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382774784 free, 351380724736 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978851 files, 343147241 free files
00000004:00000001:31.0:1773851848.846951:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846953:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846953:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350959033344 free, 350956953600 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371564135 files, 342733431 free files
00000004:00000001:31.0:1773851848.846954:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846955:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846955:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351187456 free, 351348413440 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084118 files, 343116394 free files
00000004:00000001:31.0:1773851848.846957:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846958:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846958:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482133504 free, 351481069568 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097218 files, 343244271 free files
00000004:00000001:31.0:1773851848.846960:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846961:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846961:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449315328 free, 351446771712 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372161063 files, 343212222 free files
00000004:00000001:31.0:1773851848.846962:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846963:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846964:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353575424 free, 351351189504 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083362 files, 343118726 free files
00000004:00000001:31.0:1773851848.846965:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846965:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846966:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351389009920 free, 351386330112 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019234 files, 343153330 free files
00000004:00000001:31.0:1773851848.846967:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846968:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846968:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406575616 free, 351404227584 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127392 files, 343170484 free files
00000004:00000001:31.0:1773851848.846969:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846970:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846971:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351379049472 free, 351376133120 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019222 files, 343143603 free files
00000004:00000001:31.0:1773851848.846972:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846972:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846973:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466034176 free, 351462914048 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062983 files, 343228549 free files
00000004:00000001:31.0:1773851848.846974:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846975:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846975:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489082368 free, 351486095360 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066946 files, 343251057 free files
00000004:00000001:31.0:1773851848.846977:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846978:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846978:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399726592 blocks, 351492797440 free, 351490404352 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078206 files, 343254685 free files
00000004:00000001:31.0:1773851848.846979:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846980:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846981:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399719424 blocks, 351524125696 free, 351521373184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372114032 files, 343285279 free files
00000004:00000001:31.0:1773851848.846982:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846983:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846983:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510711296 free, 351508123648 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095956 files, 343272179 free files
00000004:00000001:31.0:1773851848.846984:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846985:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846986:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541593088 free, 351539595264 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136813 files, 343302337 free files
00000004:00000001:31.0:1773851848.846987:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846988:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846988:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470705664 free, 351461613568 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064658 files, 343233111 free files
00000004:00000001:31.0:1773851848.846989:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846991:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846991:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666708480 free, 351645507584 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372238009 files, 343424520 free files
00000004:00000001:31.0:1773851848.846992:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846993:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846993:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545849856 free, 351536211968 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116588 files, 343306494 free files
00000004:00000001:31.0:1773851848.846994:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846995:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846996:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603957760 free, 351601721344 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190567 files, 343363240 free files
00000004:00000001:31.0:1773851848.846997:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.846997:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.846998:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615885312 free, 351613308928 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043570 files, 343374888 free files
00000004:00000001:31.0:1773851848.846999:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847000:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.847000:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420277760 free, 351417801728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372009101 files, 343183865 free files
00000004:00000001:31.0:1773851848.847002:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847002:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.847004:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409079296 free, 351407109120 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011357 files, 343172929 free files
00000004:00000001:31.0:1773851848.847005:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847006:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.847006:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480007680 free, 351478743040 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073210 files, 343242195 free files
00000004:00000001:31.0:1773851848.847007:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847008:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.847008:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593663488 free, 351576843264 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190109 files, 343353187 free files
00000004:00000001:31.0:1773851848.847010:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847010:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851848.847011:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464035328 free, 351458174976 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372060785 files, 343226597 free files
00000004:00000001:31.0:1773851848.847012:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847013:0:42267:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847014:0:42267:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:31.0:1773851848.847014:0:42267:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 40309316502159360 avail 40308840083750912
00000004:00000020:31.0:1773851848.847016:0:42267:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841141724160 free, 9841025302592 avail; 10969025808 objects: 9610489965 free; state 100
00000020:00000001:31.0:1773851848.847018:0:42267:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:31.0:1773851848.847020:0:42267:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851848.847021:0:42267:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851848.847021:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767671, transno 0, xid 1858030971548352
00010000:00000001:31.0:1773851848.847022:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851848.847023:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003a15e32e x1858030971548352/t0(0) o41->58446cfb-775d-4bd9-821c-19e06c4d30cc@23034@kfi7:636/0 lens 440/368 e 0 to 0 dl 1773851996 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne258-0'
00010000:00000001:31.0:1773851848.847025:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851848.847026:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851848.847027:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=81 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851848.847028:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851848.847029:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000c0cbd96 refcount 5 to 23034@kfi7
00000100:00000001:31.0:1773851848.847030:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231807328 : -107130477744288 : ffff9e90bdedef60)
02000000:00000001:31.0:1773851848.847031:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851848.847032:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851848.847032:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851848.847033:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23034@kfi7
00000400:00000010:31.0:1773851848.847034:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000819b29f0.
00000100:00000200:31.0:1773851848.847035:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030971548352, offset 224
00000400:00000200:31.0:1773851848.847036:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23034@kfi7
00000400:00000200:31.0:1773851848.847037:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.847038:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 1
00000400:00000200:31.0:1773851848.847039:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:31.0:1773851848.847040:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000400:00000200:31.0:1773851848.847042:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23034@kfi7 local destination
00000400:00000200:31.0:1773851848.847043:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768391:8768391:1024:4294967295] 23034@kfi7 LPNI seq info [28008:28008:16:4294967295]
00000400:00000200:31.0:1773851848.847044:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:31.0:1773851848.847045:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:31.0:1773851848.847047:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23034@kfi7(23034@kfi7:23034@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851848.847048:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000800:00000200:31.0:1773851848.847050:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851848.847051:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:31.0:1773851848.847053:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851848.847056:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f Using peer 23034@kfi7(0x10000000000071f)
00000800:00000200:31.0:1773851848.847059:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 468 bytes to peer 0x10000000000071f: rc=0
00000800:00000200:31.0:1773851848.847061:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851848.847063:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851848.847063:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000c0cbd96 refcount 4 to 23034@kfi7
00010000:00000001:31.0:1773851848.847064:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851848.847065:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851848.847066:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851848.847067:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003a15e32e x1858030971548352/t0(0) o41->58446cfb-775d-4bd9-821c-19e06c4d30cc@23034@kfi7:636/0 lens 440/368 e 0 to 0 dl 1773851996 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne258-0'
00000100:00100000:31.0:1773851848.847070:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a15e32e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:58446cfb-775d-4bd9-821c-19e06c4d30cc+6:107694:x1858030971548352:12345-23034@kfi7:41:default-tuolumne258-0 Request processed in 167us (200us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851848.847073:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23034@kfi7, seq: 364304978
00000100:00000040:31.0:1773851848.847073:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002e6d822b : new rpc_count 0
00000800:00000200:29.0:1773851848.847073:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851848.847074:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851848.847075:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851848.847075:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851848.847075:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851848.847076:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000400:00000200:29.0:1773851848.847076:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23034@kfi7: PUT: OK
00000020:00000010:31.0:1773851848.847077:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000400:00000200:29.0:1773851848.847077:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000819b29f0
00000400:00000010:29.0:1773851848.847077:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000819b29f0.
00000020:00000040:31.0:1773851848.847078:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000002e6d822b : new refcount 5
00000100:00000001:29.0:1773851848.847078:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851848.847078:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851848.847079:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851848.847079:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000800:00000200:29.0:1773851848.847080:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f Transaction freed
00000800:00000200:9.0:1773851848.904105:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851848.904107:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851848.904109:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851848.904113:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851848.904116:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.904118:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.41@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851848.904120:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851848.904121:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851848.904124:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.41@o2ib60 to cpt 2
00000400:00000200:9.0:1773851848.904125:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 2
00000400:00000200:9.0:1773851848.904127:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 3
00000400:00000200:9.0:1773851848.904129:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.41@o2ib60 to cpt 2
00000400:00000200:9.0:1773851848.904131:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.41@o2ib60 of length 224 into portal 12 MB=0x69b216b98d880
00000400:00000200:9.0:1773851848.904134:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.41@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 114296
00000800:00000200:9.0:1773851848.904137:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851848.904140:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.904141:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851848.904143:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851848.904144:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851848.904146:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000010ebad53.
00000100:00000040:9.0:1773851848.904147:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000010ebad53 x1859417701668992 msgsize 224
00000100:00100000:9.0:1773851848.904150:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.41@o2ib60 (source: 12345-192.168.128.41@o2ib60)
00000100:00000001:9.0:1773851848.904152:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851848.904153:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:8.0:1773851848.904153:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851848.904154:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851848.904154:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851848.904155:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851848.904155:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851848.904155:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851848.904156:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859417701668992
00000020:00000001:8.0:1773851848.904157:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851848.904157:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ad8f
00000020:00000001:8.0:1773851848.904158:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851848.904159:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7dacd53 refcount=6
00000020:00000001:8.0:1773851848.904160:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113217495040 : -106960492056576 : ffff9eb851ddb000)
00000020:00000001:8.0:1773851848.904161:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113217495040 : -106960492056576 : ffff9eb851ddb000)
00000100:00000001:8.0:1773851848.904162:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.904163:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851848.904163:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851848.904164:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.904165:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851848.904166:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851848.904167:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851848.904167:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.904168:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851848.904169:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851848.904169:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.904170:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851848.904171:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851848.904172:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851848.904173:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851848.904173:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851848.904173:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.41@o2ib60, seq: 2130703
00000100:00000001:11.0:1773851848.904174:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.904174:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7dacd53 : new rpc_count 2
00000100:00000001:11.0:1773851848.904175:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.904175:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637118924309376 : -106954785242240 : ffff9eb9a604c380)
00000100:00000040:8.0:1773851848.904176:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000010ebad53 x1859417701668992/t0(0) o400->9d12c826-b35e-43a0-8ab1-06827351a10f@192.168.128.41@o2ib60:575/0 lens 224/0 e 0 to 0 dl 1773851935 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix41-0'
00000100:00000001:8.0:1773851848.904179:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851848.904179:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851848.904181:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010ebad53 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9d12c826-b35e-43a0-8ab1-06827351a10f+6:40072:x1859417701668992:12345-192.168.128.41@o2ib60:400:default-matrix41-0
00000100:00000200:8.0:1773851848.904182:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859417701668992
00000020:00000001:8.0:1773851848.904183:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851848.904183:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851848.904184:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.904185:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851848.904185:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851848.904186:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851848.904186:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859417701668992, found 0 last_xid 1859417701358783
00000020:00000001:8.0:1773851848.904187:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851848.904188:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851848.904188:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851848.904189:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.904189:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851848.904190:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851848.904191:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851848.904191:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fd849c6f.
02000000:00000001:8.0:1773851848.904192:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.904193:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.904193:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851848.904194:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183077434443, transno 0, xid 1859417701668992
00010000:00000001:8.0:1773851848.904195:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851848.904196:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000010ebad53 x1859417701668992/t0(0) o400->9d12c826-b35e-43a0-8ab1-06827351a10f@192.168.128.41@o2ib60:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix41-0'
00010000:00000001:8.0:1773851848.904198:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851848.904198:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851848.904199:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=81 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851848.904200:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851848.904201:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dcf405e0 refcount 3 to 192.168.128.41@o2ib60
00000100:00000001:8.0:1773851848.904202:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133120 : -107146658418496 : ffff9e8cf97c70c0)
02000000:00000001:8.0:1773851848.904203:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851848.904203:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851848.904204:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851848.904205:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.41@o2ib60
00000400:00000010:8.0:1773851848.904205:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054a4b090.
00000100:00000200:8.0:1773851848.904206:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859417701668992, offset 224
00000400:00000200:8.0:1773851848.904208:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.41@o2ib60
00000400:00000200:8.0:1773851848.904209:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.41@o2ib60 to cpt 2
00000400:00000200:8.0:1773851848.904210:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 2
00000400:00000200:8.0:1773851848.904211:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 3
00000400:00000200:8.0:1773851848.904213:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 4
00000400:00000200:8.0:1773851848.904214:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.41@o2ib60 routed destination
00000400:00000200:8.0:1773851848.904215:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:8.0:1773851848.904216:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:8.0:1773851848.904217:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.41@o2ib60: rtr pref emtpy: 1
00000400:00000200:8.0:1773851848.904218:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:8.0:1773851848.904219:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.41@o2ib60: rtr pref emtpy: 1
00000400:00000200:8.0:1773851848.904220:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:8.0:1773851848.904221:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768392:8768392:1024:4294967295] 2094@kfi7 LPNI seq info [1258746977:1258746977:16:4294967295]
00000400:00000200:8.0:1773851848.904223:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:8.0:1773851848.904224:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:8.0:1773851848.904226:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.41@o2ib60(192.168.128.41@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851848.904228:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 3
00000800:00000200:8.0:1773851848.904229:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851848.904230:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851848.904232:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851848.904234:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:8.0:1773851848.904238:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:8.0:1773851848.904239:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851848.904241:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851848.904242:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dcf405e0 refcount 2 to 192.168.128.41@o2ib60
00010000:00000001:8.0:1773851848.904243:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851848.904243:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851848.904244:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851848.904245:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000010ebad53 x1859417701668992/t0(0) o400->9d12c826-b35e-43a0-8ab1-06827351a10f@192.168.128.41@o2ib60:575/0 lens 224/224 e 0 to 0 dl 1773851935 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix41-0'
00000100:00100000:8.0:1773851848.904250:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010ebad53 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9d12c826-b35e-43a0-8ab1-06827351a10f+6:40072:x1859417701668992:12345-192.168.128.41@o2ib60:400:default-matrix41-0 Request processed in 69us (102us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851848.904252:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.41@o2ib60, seq: 2130703
00000100:00000040:8.0:1773851848.904253:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7dacd53 : new rpc_count 1
00000100:00000001:8.0:1773851848.904254:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851848.904254:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851848.904255:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851848.904256:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851848.904256:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851848.904257:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000a7dacd53 : new refcount 5
00000100:00000001:8.0:1773851848.904258:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851848.904264:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851848.904267:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851848.904269:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:9.0:1773851848.904270:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054a4b090
00000400:00000010:9.0:1773851848.904271:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054a4b090.
00000100:00000001:9.0:1773851848.904272:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851848.904273:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851848.904274:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:9.0:1773851848.904277:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Transaction freed
00000800:00000200:25.0:1773851848.923997:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851848.923998:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851848.923999:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851848.924001:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851848.924002:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.924003:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8739@kfi7 : PUT - for me
00000400:00000200:25.0:1773851848.924004:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.924005:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 1
00000400:00000200:25.0:1773851848.924006:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851848.924006:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:25.0:1773851848.924007:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000400:00000200:25.0:1773851848.924008:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:25.0:1773851848.924009:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 224 into portal 12 MB=0x69b09e5d90700
00000400:00000200:25.0:1773851848.924010:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8931@kfi7 of length 224/224 into md 0x16159c6179 [64] + 176320
00000800:00000200:25.0:1773851848.924012:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851848.924013:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851848.924014:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8739@kfi7: PUT: OK
00000100:00000001:25.0:1773851848.924015:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851848.924015:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851848.924016:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000de404431.
00000100:00000040:25.0:1773851848.924017:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000de404431 x1859316673480448 msgsize 224
00000100:00100000:25.0:1773851848.924018:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8739@kfi7)
00000100:00000001:25.0:1773851848.924019:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851848.924020:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000100:00000001:26.0:1773851848.924021:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851848.924021:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851848.924021:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851848.924022:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851848.924022:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851848.924023:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851848.924024:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673480448
00000020:00000001:26.0:1773851848.924024:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851848.924025:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000020:00000001:26.0:1773851848.924026:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851848.924027:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=9
00000020:00000001:26.0:1773851848.924028:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000020:00000001:26.0:1773851848.924028:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:26.0:1773851848.924029:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851848.924030:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851848.924031:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b7c3de4.
00000020:00000010:26.0:1773851848.924032:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851848.924033:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851848.924034:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851848.924034:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851848.924034:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.924035:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851848.924036:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851848.924036:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.924037:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851848.924039:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851848.924039:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851848.924039:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851848.924039:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851848.924040:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 2025030
00000100:00000040:26.0:1773851848.924041:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:26.0:1773851848.924041:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120700619520 : -106953008932096 : ffff9eba0fe51b00)
00000100:00000001:24.0:1773851848.924041:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851848.924042:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000de404431 x1859316673480448/t0(0) o400->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:34/0 lens 224/0 e 0 to 0 dl 1773852149 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1035-0'
00000100:00000001:24.0:1773851848.924042:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.924045:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851848.924045:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851848.924046:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de404431 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:39775:x1859316673480448:12345-8931@kfi7:400:default-tuolumne1035-0
00000100:00000200:26.0:1773851848.924047:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673480448
00000020:00000001:26.0:1773851848.924048:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851848.924049:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851848.924049:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.924050:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851848.924050:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851848.924051:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851848.924052:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316673480448, found 0 last_xid 1859316673480447
00000020:00000001:26.0:1773851848.924052:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851848.924053:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851848.924053:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851848.924054:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.924054:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851848.924055:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851848.924055:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851848.924056:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003a6d93ea.
02000000:00000001:26.0:1773851848.924057:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.924057:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.924058:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851848.924058:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200468, transno 0, xid 1859316673480448
00010000:00000001:26.0:1773851848.924059:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851848.924060:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000de404431 x1859316673480448/t0(0) o400->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:34/0 lens 224/224 e 0 to 0 dl 1773852149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1035-0'
00010000:00000001:26.0:1773851848.924062:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851848.924063:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851848.924063:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=81 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851848.924064:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851848.924065:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:26.0:1773851848.924065:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
02000000:00000001:26.0:1773851848.924066:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851848.924067:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851848.924067:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851848.924068:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8739@kfi7
00000400:00000010:26.0:1773851848.924069:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e24181d3.
00000100:00000200:26.0:1773851848.924069:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316673480448, offset 224
00000400:00000200:26.0:1773851848.924071:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8739@kfi7
00000400:00000200:26.0:1773851848.924071:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:26.0:1773851848.924072:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 1
00000400:00000200:26.0:1773851848.924074:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:26.0:1773851848.924075:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000400:00000200:26.0:1773851848.924076:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8739@kfi7 local destination
00000400:00000200:26.0:1773851848.924077:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768393:8768393:1024:4294967295] 8739@kfi7 LPNI seq info [2192100:2192100:16:4294967295]
00000400:00000200:26.0:1773851848.924078:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:26.0:1773851848.924079:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:26.0:1773851848.924081:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8739@kfi7(8739@kfi7:8739@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851848.924083:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000800:00000200:26.0:1773851848.924084:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851848.924085:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851848.924087:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851848.924089:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c Using peer 8739@kfi7(0x100000000000e5c)
00000800:00000200:26.0:1773851848.924092:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0x100000000000e5c: rc=0
00000800:00000200:26.0:1773851848.924093:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851848.924095:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851848.924096:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:26.0:1773851848.924096:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851848.924097:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851848.924097:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851848.924098:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000de404431 x1859316673480448/t0(0) o400->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:34/0 lens 224/224 e 0 to 0 dl 1773852149 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1035-0'
00000100:00100000:26.0:1773851848.924101:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de404431 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:39775:x1859316673480448:12345-8931@kfi7:400:default-tuolumne1035-0 Request processed in 55us (83us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851848.924103:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 2025030
00000100:00000040:26.0:1773851848.924103:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000100:00000001:26.0:1773851848.924105:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851848.924105:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851848.924105:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851848.924106:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851848.924106:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851848.924107:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b7c3de4.
00000400:00000200:25.0:1773851848.924107:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:26.0:1773851848.924108:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 8
00000100:00000001:26.0:1773851848.924108:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851848.924108:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8739@kfi7: PUT: OK
00000400:00000200:25.0:1773851848.924108:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e24181d3
00000400:00000010:25.0:1773851848.924109:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e24181d3.
00000100:00000001:25.0:1773851848.924109:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851848.924110:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851848.924110:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000800:00000200:25.0:1773851848.924112:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c Transaction freed
00000800:00000200:13.0:1773851849.024622:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851849.024623:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851849.024624:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851849.024626:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851849.024628:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.024629:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9699@kfi7 : PUT - for me
00000400:00000200:13.0:1773851849.024630:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.024631:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 1
00000400:00000200:13.0:1773851849.024632:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.024632:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000400:00000200:13.0:1773851849.024633:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 3
00000400:00000200:13.0:1773851849.024634:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.024635:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9699@kfi7 of length 224 into portal 12 MB=0x69b16e342c5c0
00000400:00000200:13.0:1773851849.024636:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9699@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 10088
00000800:00000200:13.0:1773851849.024638:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851849.024640:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851849.024641:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9699@kfi7: PUT: OK
00000100:00000001:13.0:1773851849.024642:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851849.024642:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851849.024643:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cffaa544.
00000100:00000040:13.0:1773851849.024644:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000cffaa544 x1859372464653760 msgsize 224
00000100:00100000:13.0:1773851849.024645:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9699@kfi7 (source: 12345-9699@kfi7)
00000100:00000001:13.0:1773851849.024646:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851849.024647:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000100:00000001:14.0:1773851849.024649:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851849.024649:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851849.024650:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851849.024651:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851849.024652:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851849.024653:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851849.024654:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372464653760
00000020:00000001:14.0:1773851849.024655:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851849.024656:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793af5fbe8
00000020:00000001:14.0:1773851849.024657:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851849.024661:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001838ccf0 refcount=5
00000020:00000001:14.0:1773851849.024662:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636927198965760 : -107146510585856 : ffff9e8d024c3000)
00000020:00000001:14.0:1773851849.024663:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636927198965760 : -107146510585856 : ffff9e8d024c3000)
00000100:00000001:14.0:1773851849.024665:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851849.024666:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851849.024667:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d8eeec17.
00000020:00000010:14.0:1773851849.024669:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851849.024670:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851849.024672:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851849.024672:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851849.024673:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851849.024675:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851849.024675:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851849.024676:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.024678:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851849.024680:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851849.024680:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851849.024680:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851849.024681:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851849.024682:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9699@kfi7, seq: 2289757
00000100:00000040:14.0:1773851849.024683:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001838ccf0 : new rpc_count 1
00000100:00000001:15.0:1773851849.024684:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.024685:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.024685:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251438464 : -106960458113152 : ffff9eb853e39f80)
00000100:00000040:14.0:1773851849.024686:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cffaa544 x1859372464653760/t0(0) o400->4e146e2c-0bd5-4604-94dd-6a0b30c3e991@9699@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1083-0'
00000100:00000001:14.0:1773851849.024692:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851849.024693:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851849.024694:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cffaa544 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4e146e2c-0bd5-4604-94dd-6a0b30c3e991+5:39502:x1859372464653760:12345-9699@kfi7:400:default-tuolumne1083-0
00000100:00000200:14.0:1773851849.024696:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372464653760
00000020:00000001:14.0:1773851849.024697:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851849.024698:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851849.024699:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.024700:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851849.024701:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851849.024702:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851849.024703:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372464653760, found 0 last_xid 1859372464653759
00000020:00000001:14.0:1773851849.024705:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851849.024706:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851849.024707:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851849.024708:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.024709:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851849.024709:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851849.024710:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851849.024712:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000041b0431b.
02000000:00000001:14.0:1773851849.024713:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.024714:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.024715:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851849.024716:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530885, transno 0, xid 1859372464653760
00010000:00000001:14.0:1773851849.024717:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851849.024718:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cffaa544 x1859372464653760/t0(0) o400->4e146e2c-0bd5-4604-94dd-6a0b30c3e991@9699@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1083-0'
00010000:00000001:14.0:1773851849.024723:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851849.024724:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851849.024728:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=82 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851849.024730:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851849.024731:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a5761387 refcount 3 to 9699@kfi7
00000100:00000001:14.0:1773851849.024732:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155968 : -107139310395648 : ffff9e8eaf765f00)
02000000:00000001:14.0:1773851849.024734:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851849.024735:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.024736:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851849.024737:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9699@kfi7
00000400:00000010:14.0:1773851849.024738:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035dcf964.
00000100:00000200:14.0:1773851849.024739:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372464653760, offset 224
00000400:00000200:14.0:1773851849.024742:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9699@kfi7
00000400:00000200:14.0:1773851849.024743:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:14.0:1773851849.024744:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 1
00000400:00000200:14.0:1773851849.024746:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000400:00000200:14.0:1773851849.024748:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 3
00000400:00000200:14.0:1773851849.024750:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9699@kfi7 local destination
00000400:00000200:14.0:1773851849.024752:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768394:8768394:1024:4294967295] 9699@kfi7 LPNI seq info [17492:17492:16:4294967295]
00000400:00000200:14.0:1773851849.024754:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000400:00000200:14.0:1773851849.024756:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:14.0:1773851849.024759:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9699@kfi7(9699@kfi7:9699@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851849.024761:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 3
00000800:00000200:14.0:1773851849.024763:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851849.024765:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851849.024769:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851849.024773:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000661 Using peer 9699@kfi7(0x100000000000661)
00000800:00000200:14.0:1773851849.024777:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ba933e94: Posted send of 324 bytes to peer 0x100000000000661: rc=0
00000800:00000200:14.0:1773851849.024780:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000661 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851849.024783:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851849.024785:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a5761387 refcount 2 to 9699@kfi7
00010000:00000001:14.0:1773851849.024786:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851849.024787:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.024788:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851849.024789:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cffaa544 x1859372464653760/t0(0) o400->4e146e2c-0bd5-4604-94dd-6a0b30c3e991@9699@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1083-0'
00000800:00000200:13.0:1773851849.024792:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000661 TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851849.024794:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cffaa544 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4e146e2c-0bd5-4604-94dd-6a0b30c3e991+5:39502:x1859372464653760:12345-9699@kfi7:400:default-tuolumne1083-0 Request processed in 102us (150us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851849.024796:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851849.024797:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9699@kfi7: PUT: OK
00000400:00000200:13.0:1773851849.024797:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035dcf964
00000100:00100000:14.0:1773851849.024798:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9699@kfi7, seq: 2289757
00000400:00000010:13.0:1773851849.024798:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035dcf964.
00000100:00000040:14.0:1773851849.024799:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001838ccf0 : new rpc_count 0
00000100:00000001:13.0:1773851849.024799:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851849.024799:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851849.024800:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000100:00000001:14.0:1773851849.024801:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851849.024801:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851849.024801:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2054@kfi7:3 -> 9699@kfi7(000000003c1791dd):0x0 lsk 1634 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000661 Transaction freed
00000020:00000010:14.0:1773851849.024802:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851849.024803:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000020:00000010:14.0:1773851849.024805:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d8eeec17.
00000020:00000040:14.0:1773851849.024806:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000001838ccf0 : new refcount 4
00000100:00000001:14.0:1773851849.024807:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851849.027744:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851849.027746:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851849.027748:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851849.027751:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851849.027754:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18833@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.027756:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18833@kfi7 : PUT - for me
00000400:00000200:9.0:1773851849.027757:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18833@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.027758:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000457babb5 nid 18833@kfi7 refs 1
00000400:00000200:9.0:1773851849.027760:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18833@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.027761:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000457babb5 nid 18833@kfi7 refs 2
00000400:00000200:9.0:1773851849.027763:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000457babb5 nid 18833@kfi7 refs 3
00000400:00000200:9.0:1773851849.027765:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18833@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.027766:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18833@kfi7 of length 224 into portal 12 MB=0x699e0e263e5c0
00000400:00000200:9.0:1773851849.027768:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18833@kfi7 of length 224/224 into md 0x78146ce49 [64] + 114520
00000800:00000200:9.0:1773851849.027771:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851849.027774:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.027776:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18833@kfi7: PUT: OK
00000100:00000001:9.0:1773851849.027777:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851849.027778:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851849.027779:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d622ae48.
00000100:00000040:9.0:1773851849.027780:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d622ae48 x1858041010185664 msgsize 224
00000100:00100000:9.0:1773851849.027782:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18833@kfi7 (source: 12345-18833@kfi7)
00000100:00000001:9.0:1773851849.027784:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851849.027785:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000457babb5 nid 18833@kfi7 refs 2
00000100:00000001:8.0:1773851849.027786:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851849.027787:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851849.027787:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851849.027788:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851849.027789:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851849.027790:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851849.027791:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041010185664
00000020:00000001:8.0:1773851849.027792:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851849.027792:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92435
00000020:00000001:8.0:1773851849.027794:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851849.027797:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09e5ef8 refcount=6
00000020:00000001:8.0:1773851849.027799:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630506496 : -107123079045120 : ffff9e9276ed2000)
00000020:00000001:8.0:1773851849.027800:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630506496 : -107123079045120 : ffff9e9276ed2000)
00000100:00000001:8.0:1773851849.027801:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.027803:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851849.027803:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851849.027805:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.027806:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851849.027807:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851849.027808:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851849.027809:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851849.027810:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851849.027811:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851849.027812:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.027813:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851849.027815:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851849.027815:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851849.027816:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851849.027816:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851849.027817:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18833@kfi7, seq: 2130704
00000100:00000001:11.0:1773851849.027819:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.027819:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e09e5ef8 : new rpc_count 1
00000100:00000001:11.0:1773851849.027820:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.027820:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637118924317440 : -106954785234176 : ffff9eb9a604e300)
00000100:00000040:8.0:1773851849.027821:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d622ae48 x1858041010185664/t0(0) o400->9be40dda-cc85-4983-97da-6755eea1eda6@18833@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1666-0'
00000100:00000001:8.0:1773851849.027826:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.027826:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851849.027828:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d622ae48 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9be40dda-cc85-4983-97da-6755eea1eda6+6:39885:x1858041010185664:12345-18833@kfi7:400:default-tuolumne1666-0
00000100:00000200:8.0:1773851849.027830:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041010185664
00000020:00000001:8.0:1773851849.027831:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851849.027832:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851849.027833:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.027834:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851849.027835:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851849.027836:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851849.027837:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041010185664, found 0 last_xid 1858041010185663
00000020:00000001:8.0:1773851849.027838:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851849.027839:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851849.027840:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851849.027841:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.027842:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851849.027843:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851849.027844:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851849.027845:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000656e182e.
02000000:00000001:8.0:1773851849.027846:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.027847:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.027848:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851849.027849:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044166223, transno 0, xid 1858041010185664
00010000:00000001:8.0:1773851849.027850:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851849.027851:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d622ae48 x1858041010185664/t0(0) o400->9be40dda-cc85-4983-97da-6755eea1eda6@18833@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1666-0'
00010000:00000001:8.0:1773851849.027855:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851849.027856:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851849.027857:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=82 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851849.027859:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851849.027860:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000093a04e95 refcount 3 to 18833@kfi7
00000100:00000001:8.0:1773851849.027861:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551676032 : -107156157875584 : ffff9e8ac3463a80)
02000000:00000001:8.0:1773851849.027862:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851849.027863:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.027864:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851849.027865:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18833@kfi7
00000400:00000010:8.0:1773851849.027866:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054a4b090.
00000100:00000200:8.0:1773851849.027868:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041010185664, offset 224
00000400:00000200:8.0:1773851849.027870:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18833@kfi7
00000400:00000200:8.0:1773851849.027871:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18833@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.027872:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000457babb5 nid 18833@kfi7 refs 1
00000400:00000200:8.0:1773851849.027874:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000457babb5 nid 18833@kfi7 refs 2
00000400:00000200:8.0:1773851849.027876:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000457babb5 nid 18833@kfi7 refs 3
00000400:00000200:8.0:1773851849.027878:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18833@kfi7 local destination
00000400:00000200:8.0:1773851849.027880:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768395:8768395:1024:4294967295] 18833@kfi7 LPNI seq info [1348237:1348237:16:4294967295]
00000400:00000200:8.0:1773851849.027884:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000457babb5 nid 18833@kfi7 refs 2
00000400:00000200:8.0:1773851849.027885:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18833@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.027888:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18833@kfi7(18833@kfi7:18833@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851849.027890:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000457babb5 nid 18833@kfi7 refs 3
00000800:00000200:8.0:1773851849.027892:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851849.027894:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851849.027897:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851849.027901:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x276 Using peer 18833@kfi7(0x276)
00000800:00000200:8.0:1773851849.027905:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x276: rc=0
00000800:00000200:8.0:1773851849.027908:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x276 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851849.027910:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.027912:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000093a04e95 refcount 2 to 18833@kfi7
00010000:00000001:8.0:1773851849.027913:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851849.027914:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.027915:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851849.027916:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d622ae48 x1858041010185664/t0(0) o400->9be40dda-cc85-4983-97da-6755eea1eda6@18833@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1666-0'
00000100:00100000:8.0:1773851849.027921:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d622ae48 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9be40dda-cc85-4983-97da-6755eea1eda6+6:39885:x1858041010185664:12345-18833@kfi7:400:default-tuolumne1666-0 Request processed in 94us (140us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851849.027925:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18833@kfi7, seq: 2130704
00000100:00000040:8.0:1773851849.027926:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e09e5ef8 : new rpc_count 0
00000100:00000001:8.0:1773851849.027927:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851849.027928:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851849.027929:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.027930:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851849.027931:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851849.027933:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e09e5ef8 : new refcount 5
00000100:00000001:8.0:1773851849.027934:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851849.027941:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x276 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851849.027943:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.027945:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18833@kfi7: PUT: OK
00000400:00000200:9.0:1773851849.027946:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054a4b090
00000400:00000010:9.0:1773851849.027947:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054a4b090.
00000100:00000001:9.0:1773851849.027948:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851849.027949:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851849.027950:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000457babb5 nid 18833@kfi7 refs 2
00000800:00000200:9.0:1773851849.027952:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 18833@kfi7(0000000023cab80b):0x0 lsk 631 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x276 Transaction freed
00000004:00000001:30.0:1773851849.033734:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851849.033735:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:5.0:1773851849.033735:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851849.033736:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851849.033736:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851849.033737:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8bb7992.
00000004:00000020:7.0:1773851849.033737:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:5.0:1773851849.033737:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad9df0c5.
00000004:00000001:4.0:1773851849.033737:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:7.0:1773851849.033738:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ffbbbda4.
00000004:00000020:4.0:1773851849.033738:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:30.0:1773851849.033739:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000020:00000040:5.0:1773851849.033739:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000100:00000010:4.0:1773851849.033739:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004dc2a5c.
00000020:00000040:7.0:1773851849.033740:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:7.0:1773851849.033741:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851849.033741:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:4.0:1773851849.033741:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:30.0:1773851849.033742:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851849.033742:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851849.033742:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851849.033742:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851849.033742:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851849.033743:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851849.033744:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851849.033744:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851849.033744:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851849.033745:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851849.033746:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000078bc3602.
02000000:00000010:7.0:1773851849.033746:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d46f64ea.
02000000:00000010:5.0:1773851849.033747:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000097fed2c.
02000000:00000010:4.0:1773851849.033747:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000030ba13a7.
00000100:00000001:30.0:1773851849.033748:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.033748:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.033748:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033748:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851849.033750:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851849.033750:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851849.033750:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851849.033750:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851849.033751:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.033751:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.033751:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033751:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851849.033753:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ffbbbda4] to pc [ptlrpcd_01_01+1]  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851849.033753:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ad9df0c5] to pc [ptlrpcd_01_02+2]  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851849.033754:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a8bb7992] to pc [ptlrpcd_07_03+3]  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851849.033754:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000004dc2a5c] to pc [ptlrpcd_01_03+3]  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851849.033761:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851849.033761:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:4.0:1773851849.033761:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851849.033762:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851849.033763:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851849.033763:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:5.0:1773851849.033763:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000007293b0c9.
00080000:00000010:30.0:1773851849.033764:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d4700eda.
00000100:00000001:29.0:1773851849.033764:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851849.033764:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851849.033764:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851849.033765:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:30.0:1773851849.033765:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637153996060672 : -106919713490944 : ffff9ec1d0753800)
00000100:00000001:7.0:1773851849.033765:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851849.033765:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851849.033765:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637100462195712 : -106973247355904 : ffff9eb559974400)
00000100:00000001:31.0:1773851849.033766:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851849.033766:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.033766:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851849.033766:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851849.033766:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:30.0:1773851849.033767:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:7.0:1773851849.033767:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851849.033767:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851849.033767:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:31.0:1773851849.033768:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851849.033768:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033768:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851849.033769:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851849.033769:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000004:00001000:30.0:1773851849.033770:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00000040:4.0:1773851849.033770:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:30.0:1773851849.033771:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008ded43be.
00000100:00000001:7.0:1773851849.033771:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:5.0:1773851849.033771:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a5af2c76.
00000100:00000001:7.0:1773851849.033772:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851849.033772:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614123487047582ns, next at 614124487045718ns, rc = 0
00000100:00000001:31.0:1773851849.033773:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851849.033773:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851849.033773:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614123487048584ns, next at 614124487046570ns, rc = 0
02000000:00000001:7.0:1773851849.033773:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851849.033774:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851849.033774:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851849.033774:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:31.0:1773851849.033775:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851849.033775:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:5.0:1773851849.033775:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033775:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851849.033776:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851849.033776:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851849.033776:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004dc2a5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051921088:2098@kfi7:41:default-yuba2-0
00000004:00000001:5.0:1773851849.033776:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851849.033776:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000001:30.0:1773851849.033777:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.033777:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:4.0:1773851849.033777:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851849.033778:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8bb7992 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051920896:2080@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851849.033778:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:6.0:1773851849.033778:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851849.033778:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad9df0c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051921024:3@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851849.033779:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851849.033779:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851849.033779:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851849.033780:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:6.0:1773851849.033780:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033780:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851849.033781:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:7.0:1773851849.033781:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000aafb7691.
02000000:00000001:4.0:1773851849.033781:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851849.033782:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851849.033782:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851849.033782:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ffbbbda4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051920960:7@kfi7:41:default-yuba2-0
02000000:00000001:4.0:1773851849.033782:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851849.033783:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851849.033783:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:31.0:1773851849.033784:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:7.0:1773851849.033784:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:6.0:1773851849.033784:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:4.0:1773851849.033784:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008c84125c.
02000000:00000001:4.0:1773851849.033784:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851849.033785:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d561f1e3.
02000000:00000001:6.0:1773851849.033785:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:7.0:1773851849.033786:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d794ea.
02000000:00000001:6.0:1773851849.033786:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851849.033786:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
02000000:00000010:31.0:1773851849.033787:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bd69d754.
02000000:00000001:6.0:1773851849.033787:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:4.0:1773851849.033787:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001dcecbd8.
02000000:00000001:31.0:1773851849.033788:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851849.033788:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921088, portal 4
02000000:00000010:6.0:1773851849.033788:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a2ebc3d3.
00000100:00000001:7.0:1773851849.033789:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:6.0:1773851849.033789:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851849.033789:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000062ec508f.
00000400:00000200:31.0:1773851849.033790:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:7.0:1773851849.033790:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528719104 : -106978180832512 : ffff9eb433886300)
00000100:00000200:4.0:1773851849.033790:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921024, portal 4
00000400:00000010:31.0:1773851849.033791:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000200:6.0:1773851849.033791:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:4.0:1773851849.033791:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:31.0:1773851849.033792:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c70e405.
00000100:00000040:7.0:1773851849.033792:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851849.033792:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:4.0:1773851849.033792:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637061663671168 : -107012045880448 : ffff9eac5104c380)
00000100:00000200:31.0:1773851849.033794:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920896, portal 4
00000400:00000010:6.0:1773851849.033794:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d995f188.
00000100:00000040:4.0:1773851849.033794:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851849.033796:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:6.0:1773851849.033796:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051920960, portal 4
00000100:00000001:31.0:1773851849.033797:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851849.033797:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636973000818688 : -107100708732928 : ffff9e97ac4d0000)
00000100:00000040:7.0:1773851849.033797:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000100:00000001:6.0:1773851849.033797:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:7.0:1773851849.033798:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
00000100:00000001:6.0:1773851849.033798:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309129344 : -106994400422272 : ffff9eb06cc51680)
00000100:00000001:4.0:1773851849.033798:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:7.0:1773851849.033799:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051921088, offset 0
00000100:00000040:31.0:1773851849.033800:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851849.033800:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000200:7.0:1773851849.033801:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000100:00000040:6.0:1773851849.033801:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851849.033801:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5f4f73.
00000100:00000200:4.0:1773851849.033802:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921024, offset 0
00000400:00000200:7.0:1773851849.033803:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:31.0:1773851849.033804:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851849.033804:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:4.0:1773851849.033804:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000100:00000040:31.0:1773851849.033806:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000200:7.0:1773851849.033806:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:6.0:1773851849.033806:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:31.0:1773851849.033807:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c73e55.
00000400:00000200:7.0:1773851849.033807:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000100:00000040:6.0:1773851849.033807:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:6.0:1773851849.033808:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025756a50.
00000100:00000200:31.0:1773851849.033809:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051920896, offset 0
00000400:00000200:7.0:1773851849.033809:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000100:00000200:6.0:1773851849.033809:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051920960, offset 0
00000400:00000200:31.0:1773851849.033811:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:7.0:1773851849.033812:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768395, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768394, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851849.033812:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:31.0:1773851849.033813:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:31.0:1773851849.033815:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:7.0:1773851849.033815:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851849.033816:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851849.033816:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851849.033818:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851849.033818:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851849.033819:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346193, 20346191]
00000400:00000200:31.0:1773851849.033820:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:7.0:1773851849.033822:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000400:00000200:31.0:1773851849.033823:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768395, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768394, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851849.033824:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768396:8768396:1024:4294967295] 2105@kfi7 LPNI seq info [20346194:20346194:16:4294967295]
00000400:00000200:7.0:1773851849.033826:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:31.0:1773851849.033827:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851849.033828:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851849.033828:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:31.0:1773851849.033830:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:4.0:1773851849.033830:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:31.0:1773851849.033832:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768397:8768397:1024:4294967295] 2080@kfi7 LPNI seq info [5404387:5404387:16:4294967295]
00000400:00000200:7.0:1773851849.033832:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851849.033832:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:4.0:1773851849.033833:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:31.0:1773851849.033834:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851849.033835:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:4.0:1773851849.033835:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:31.0:1773851849.033836:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:7.0:1773851849.033837:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851849.033837:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000800:00000200:7.0:1773851849.033839:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851849.033840:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851849.033840:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768397, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768396, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851849.033843:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:4.0:1773851849.033843:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:7.0:1773851849.033844:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851849.033844:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:31.0:1773851849.033845:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:4.0:1773851849.033846:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000800:00000200:31.0:1773851849.033847:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851849.033848:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000400:00000200:4.0:1773851849.033848:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768398:8768398:1023:4294967295] 3@kfi7 LPNI seq info [5406216:5406216:16:4294967295]
00000400:00000200:4.0:1773851849.033850:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:31.0:1773851849.033851:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851849.033851:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:7.0:1773851849.033853:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x20000000000085c: rc=0
00000400:00000200:6.0:1773851849.033853:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:6.0:1773851849.033855:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000800:00000200:31.0:1773851849.033856:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Using peer 2080@kfi7(0x64e)
00000800:00000200:7.0:1773851849.033857:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851849.033857:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:4.0:1773851849.033857:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851849.033859:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:4.0:1773851849.033859:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000001:7.0:1773851849.033860:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851849.033861:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x64e: rc=0
00000100:00000001:7.0:1773851849.033861:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851849.033861:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000100:00000001:7.0:1773851849.033862:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.033863:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851849.033863:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768397, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8768398, p:4294967295, g:4294967295, h:1000]
00000800:00000200:31.0:1773851849.033864:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851849.033864:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851849.033865:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851849.033866:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851849.033867:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.033867:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:6.0:1773851849.033867:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:31.0:1773851849.033868:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851849.033868:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851849.033868:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.033869:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.033869:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851849.033869:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851849.033870:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851849.033871:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851849.033871:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c TN_EVENT_TX_OK event status 0
00000800:00000200:4.0:1773851849.033871:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:31.0:1773851849.033872:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851849.033872:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340053, 17340052]
00000400:00000200:5.0:1773851849.033873:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851849.033874:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:6.0:1773851849.033874:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000800:00000200:4.0:1773851849.033874:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:31.0:1773851849.033875:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851849.033875:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851849.033875:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000001:31.0:1773851849.033876:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851849.033876:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851849.033876:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851849.033876:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768399:8768399:1023:4294967295] 7@kfi7 LPNI seq info [17340054:17340054:16:4294967295]
00000400:00000200:5.0:1773851849.033876:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
00000100:00000001:31.0:1773851849.033877:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851849.033877:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851849.033877:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000100:00000001:31.0:1773851849.033878:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851849.033878:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:5.0:1773851849.033878:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:4.0:1773851849.033878:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851849.033879:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:5.0:1773851849.033879:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851849.033880:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:29.0:1773851849.033881:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:29.0:1773851849.033882:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c73e55
00000800:00000200:4.0:1773851849.033882:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Using peer 3@kfi7(0x2000000000003b5)
00000400:00000010:29.0:1773851849.033883:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c73e55.
00000100:00000001:29.0:1773851849.033884:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:6.0:1773851849.033884:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000100:00000001:5.0:1773851849.033884:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851849.033885:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851849.033886:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851849.033886:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000800:00000200:4.0:1773851849.033886:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x2000000000003b5: rc=0
00000800:00000200:6.0:1773851849.033888:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851849.033889:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851849.033890:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:6.0:1773851849.033890:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:29.0:1773851849.033891:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.033893:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033893:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851849.033894:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:5.0:1773851849.033894:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851849.033894:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851849.033895:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:29.0:1773851849.033896:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.033897:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851849.033897:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851849.033898:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:6.0:1773851849.033898:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Using peer 7@kfi7(0x11b1)
00000800:00000200:5.0:1773851849.033898:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c Transaction freed
00000100:00000001:4.0:1773851849.033898:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033899:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851849.033901:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Transaction freed
00000800:00000200:25.0:1773851849.033901:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00000001:4.0:1773851849.033901:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851849.033901:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:25.0:1773851849.033902:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851849.033903:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851849.033903:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000235b3e16: Posted send of 324 bytes to peer 0x11b1: rc=0
00000100:00000001:4.0:1773851849.033903:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851849.033903:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:6.0:1773851849.033906:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:25.0:1773851849.033907:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851849.033908:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:6.0:1773851849.033909:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851849.033910:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000001:6.0:1773851849.033910:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:9.0:1773851849.033911:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:6.0:1773851849.033911:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851849.033912:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2105@kfi7 : PUT - for me
00000100:00000001:6.0:1773851849.033912:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851849.033913:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:9.0:1773851849.033913:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851849.033913:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851849.033915:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000100:00000001:6.0:1773851849.033915:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851849.033915:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:25.0:1773851849.033916:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000001:6.0:1773851849.033916:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:5.0:1773851849.033916:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851849.033917:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:9.0:1773851849.033917:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:6.0:1773851849.033917:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:7.0:1773851849.033918:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851849.033918:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.033918:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851849.033919:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000100:00000001:6.0:1773851849.033919:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851849.033919:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851849.033919:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851849.033920:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851849.033921:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851849.033921:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851849.033921:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000400:00000200:25.0:1773851849.033922:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1ac0
00000400:00000200:5.0:1773851849.033922:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5f4f73
00000400:00000200:7.0:1773851849.033923:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000400:00000010:5.0:1773851849.033923:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5f4f73.
00000400:00000200:25.0:1773851849.033924:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851849.033924:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2080@kfi7 : PUT - for me
00000100:00000001:5.0:1773851849.033924:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:7.0:1773851849.033925:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025756a50
00000100:00000200:5.0:1773851849.033925:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851849.033926:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000010:7.0:1773851849.033926:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025756a50.
00000400:00000200:9.0:1773851849.033927:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000100:00000001:7.0:1773851849.033927:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:25.0:1773851849.033928:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b2fac5 [1] + 224
00000400:00000200:9.0:1773851849.033929:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000200:7.0:1773851849.033929:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.033929:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:9.0:1773851849.033930:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:25.0:1773851849.033931:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:5.0:1773851849.033931:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851849.033932:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:9.0:1773851849.033933:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:25.0:1773851849.033934:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851849.033934:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851849.033934:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851849.033935:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1a00
00000100:00000040:7.0:1773851849.033935:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.033935:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851849.033936:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:25.0:1773851849.033936:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851849.033937:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851849.033937:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:5.0:1773851849.033937:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:29.0:1773851849.033938:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:25.0:1773851849.033939:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851849.033939:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781696849 [1] + 224
00000100:00000001:7.0:1773851849.033939:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851849.033939:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Transaction freed
00000100:00000001:7.0:1773851849.033940:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851849.033941:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851849.033942:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:9.0:1773851849.033943:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:25.0:1773851849.033944:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851849.033945:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851849.033945:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:7.0:1773851849.033945:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Transaction freed
00000400:00000200:9.0:1773851849.033947:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:29.0:1773851849.033948:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:9.0:1773851849.033949:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851849.033950:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 3@kfi7 : PUT - for me
00000100:00000001:25.0:1773851849.033951:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:9.0:1773851849.033951:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851849.033952:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851849.033952:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:29.0:1773851849.033953:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000001:4.0:1773851849.033954:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851849.033955:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:25.0:1773851849.033955:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851849.033955:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851849.033956:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000001:4.0:1773851849.033956:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:9.0:1773851849.033957:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:4.0:1773851849.033957:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851849.033958:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000010:4.0:1773851849.033958:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d561f1e3.
00000400:00000200:29.0:1773851849.033959:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:4.0:1773851849.033959:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d794ea
00000400:00000010:4.0:1773851849.033960:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d794ea.
00000400:00000200:29.0:1773851849.033961:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1a80
00000100:00000001:4.0:1773851849.033961:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851849.033963:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:9.0:1773851849.033963:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:4.0:1773851849.033963:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851849.033964:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:29.0:1773851849.033965:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78007f67d [1] + 224
00000100:00000001:31.0:1773851849.033966:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851849.033966:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851849.033967:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851849.033968:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:29.0:1773851849.033968:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:4.0:1773851849.033968:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:31.0:1773851849.033969:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851849.033970:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000200:31.0:1773851849.033971:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c70e405
00000400:00000200:29.0:1773851849.033971:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:31.0:1773851849.033972:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c70e405.
00000100:00000001:4.0:1773851849.033972:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851849.033972:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851849.033973:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000100:00000001:4.0:1773851849.033973:0:41067:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851849.033974:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851849.033974:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:4.0:1773851849.033974:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:31.0:1773851849.033975:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851849.033975:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:29.0:1773851849.033976:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851849.033976:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:4.0:1773851849.033976:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851849.033977:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851849.033978:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00001000:4.0:1773851849.033978:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=82 v=66 (66 66 66 66)
00000100:00000200:31.0:1773851849.033980:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851849.033980:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:4.0:1773851849.033980:0:41067:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=82 v=66 (1 1 1 1)
00000100:00000040:29.0:1773851849.033981:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851849.033982:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000800:00000200:13.0:1773851849.033983:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:4.0:1773851849.033983:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851849.033984:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:31.0:1773851849.033985:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:4.0:1773851849.033985:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.033986:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851849.033986:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:31.0:1773851849.033987:0:41091:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:4.0:1773851849.033987:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851849.033987:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
02000000:00000001:31.0:1773851849.033988:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:13.0:1773851849.033988:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000100:00000001:4.0:1773851849.033988:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851849.033989:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851849.033989:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851849.033989:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:4.0:1773851849.033989:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.033990:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851849.033990:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000040:4.0:1773851849.033990:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851849.033991:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851849.033991:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000100:00001000:31.0:1773851849.033992:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=82 v=66 (66 66 66 66)
00000100:00000001:5.0:1773851849.033992:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851849.033993:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851849.033993:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:5.0:1773851849.033993:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:31.0:1773851849.033994:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=82 v=66 (1 1 1 1)
00000400:00000200:13.0:1773851849.033994:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000001:5.0:1773851849.033995:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:4.0:1773851849.033995:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851849.033996:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:13.0:1773851849.033996:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000001:5.0:1773851849.033996:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:4.0:1773851849.033996:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851849.033996:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.033997:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851849.033997:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:5.0:1773851849.033997:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001dcecbd8.
00000400:00000200:13.0:1773851849.033998:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1a40
00000400:00000200:5.0:1773851849.033998:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000062ec508f
00000004:00000001:4.0:1773851849.033998:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00010000:00000001:31.0:1773851849.033999:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:5.0:1773851849.033999:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000062ec508f.
00000004:00000020:4.0:1773851849.033999:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000096 blocks, 31354646336 free, 31354615104 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064154 files, 2870603607 free files
00010000:00000001:31.0:1773851849.034000:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851849.034000:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:5.0:1773851849.034000:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851849.034001:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851849.034002:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000400:00000200:13.0:1773851849.034002:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f532d [1] + 224
00000100:00000200:5.0:1773851849.034002:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:4.0:1773851849.034002:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.034003:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:4.0:1773851849.034003:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851849.034004:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851849.034006:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:13.0:1773851849.034006:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:5.0:1773851849.034006:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851849.034008:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:4.0:1773851849.034008:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004dc2a5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051921088:2098@kfi7:41:default-yuba2-0
00000100:00000001:31.0:1773851849.034010:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:13.0:1773851849.034010:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000001:4.0:1773851849.034010:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851849.034011:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851849.034011:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851849.034012:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:13.0:1773851849.034012:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:5.0:1773851849.034012:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851849.034012:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000004dc2a5c x1859433051921088/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851849.034013:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851849.034013:0:41066:0:(client.c:1428:after_reply()) Process entered
00000004:00000001:31.0:1773851849.034014:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:13.0:1773851849.034014:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:5.0:1773851849.034014:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000040:31.0:1773851849.034015:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000100:00000001:5.0:1773851849.034015:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000040:31.0:1773851849.034016:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510728704 avail=351508101120 avail_mb=1373078520 hwm_mb=3131103 files=372095957 ffree=343272196 state=0: rc = 0
00000100:00000001:5.0:1773851849.034016:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.034016:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851849.034017:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851849.034017:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851849.034018:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000aafb7691.
00000100:00001000:5.0:1773851849.034019:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=82 v=66 (66 66 66 66)
00000004:00000020:31.0:1773851849.034020:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510728704 free, 351508101120 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095957 files, 343272196 free files
00000100:00000040:13.0:1773851849.034020:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851849.034020:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851849.034020:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000100:00001000:5.0:1773851849.034021:0:41066:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=82 v=66 (1 1 1 1)
00000020:00000040:4.0:1773851849.034021:0:41067:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:5.0:1773851849.034022:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000020:00000001:4.0:1773851849.034022:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000001:31.0:1773851849.034023:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.034023:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851849.034023:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000030ba13a7.
00000100:00000040:31.0:1773851849.034024:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:5.0:1773851849.034024:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:4.0:1773851849.034024:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:5.0:1773851849.034025:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851849.034025:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851849.034025:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004dc2a5c.
00000100:00000001:13.0:1773851849.034026:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851849.034027:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851849.034027:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:4.0:1773851849.034027:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851849.034027:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851849.034028:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:5.0:1773851849.034028:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00100000:31.0:1773851849.034029:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8bb7992 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051920896:2080@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851849.034029:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851849.034029:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.034029:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851849.034030:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851849.034030:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851849.034030:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000001:6.0:1773851849.034031:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:5.0:1773851849.034031:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851849.034031:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.034032:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:6.0:1773851849.034032:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:4.0:1773851849.034032:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851849.034032:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.034033:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851849.034035:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a8bb7992 x1859433051920896/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.034035:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851849.034037:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851849.034038:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.034039:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000001:5.0:1773851849.034039:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:31.0:1773851849.034040:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000040:5.0:1773851849.034040:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
02000000:00000010:31.0:1773851849.034041:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bd69d754.
00000004:00000040:5.0:1773851849.034041:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353593856 avail=351351204864 avail_mb=1372465644 hwm_mb=3131101 files=372083362 ffree=343118744 state=0: rc = 0
02000000:00000001:31.0:1773851849.034043:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851849.034044:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851849.034044:0:41091:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000400:00000010:6.0:1773851849.034044:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851849.034045:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d995f188
00000004:00000020:5.0:1773851849.034045:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353593856 free, 351351204864 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083362 files, 343118744 free files
00000020:00000001:31.0:1773851849.034046:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000010:6.0:1773851849.034046:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d995f188.
02000000:00000010:31.0:1773851849.034047:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000078bc3602.
00000100:00000001:6.0:1773851849.034047:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:5.0:1773851849.034048:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851849.034049:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000200:6.0:1773851849.034049:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851849.034049:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851849.034050:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851849.034050:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8bb7992.
00000100:00000001:31.0:1773851849.034052:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851849.034053:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.034054:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:6.0:1773851849.034054:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:5.0:1773851849.034054:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad9df0c5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051921024:3@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851849.034055:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851849.034056:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.034057:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851849.034058:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.034058:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851849.034059:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851849.034059:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.034060:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851849.034060:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851849.034060:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851849.034061:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:5.0:1773851849.034061:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ad9df0c5 x1859433051921024/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851849.034062:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851849.034063:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851849.034064:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=108 v=66 (66 66 66 66)
00000100:00001000:6.0:1773851849.034066:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=114 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851849.034066:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851849.034067:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851849.034067:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008c84125c.
00000100:00000001:6.0:1773851849.034068:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851849.034068:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851849.034069:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851849.034070:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851849.034070:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851849.034070:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:6.0:1773851849.034071:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000020:00000040:5.0:1773851849.034071:0:41066:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000100:00000040:6.0:1773851849.034072:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000020:00000001:5.0:1773851849.034072:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:6.0:1773851849.034073:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000010:5.0:1773851849.034073:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000097fed2c.
00000100:00000001:6.0:1773851849.034074:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851849.034074:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:6.0:1773851849.034075:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:5.0:1773851849.034075:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851849.034076:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad9df0c5.
00000100:00000001:5.0:1773851849.034077:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851849.034078:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.034079:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851849.034079:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.034081:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851849.034081:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851849.034081:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851849.034081:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851849.034082:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:5.0:1773851849.034082:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851849.034083:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:6.0:1773851849.034084:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031712 blocks, 31536853376 free, 31536810816 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425437 files, 2779493180 free files
00000004:00000001:6.0:1773851849.034086:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.034088:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:6.0:1773851849.034093:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ffbbbda4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051920960:7@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851849.034096:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.034097:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851849.034098:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ffbbbda4 x1859433051920960/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851849.034102:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851849.034102:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851849.034103:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a2ebc3d3.
02000000:00000001:6.0:1773851849.034105:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851849.034106:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851849.034106:0:41065:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000001:6.0:1773851849.034108:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851849.034109:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d46f64ea.
02000000:00000001:6.0:1773851849.034110:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851849.034111:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851849.034112:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ffbbbda4.
00000100:00000001:6.0:1773851849.034113:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851849.034114:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.034115:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.034117:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851849.034117:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.034118:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851849.034119:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851849.037104:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851849.037106:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851849.037108:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851849.037111:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851849.037114:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21715@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.037116:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21715@kfi7 : PUT - for me
00000400:00000200:5.0:1773851849.037118:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21715@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.037119:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a42b5fe nid 21715@kfi7 refs 1
00000400:00000200:5.0:1773851849.037121:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21715@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.037122:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a42b5fe nid 21715@kfi7 refs 2
00000400:00000200:5.0:1773851849.037125:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006a42b5fe nid 21715@kfi7 refs 3
00000400:00000200:5.0:1773851849.037126:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21714@kfi7 to cpt 6
00000400:00000200:5.0:1773851849.037128:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21714@kfi7 of length 224 into portal 12 MB=0x69a7212c4b080
00000400:00000200:5.0:1773851849.037130:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21714@kfi7 of length 224/224 into md 0x793926dc5 [64] + 113552
00000800:00000200:5.0:1773851849.037133:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851849.037136:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851849.037138:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21715@kfi7: PUT: OK
00000100:00000001:5.0:1773851849.037139:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851849.037140:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851849.037141:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad9df0c5.
00000100:00000040:5.0:1773851849.037142:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ad9df0c5 x1858664592093312 msgsize 224
00000100:00100000:5.0:1773851849.037144:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-21714@kfi7 (source: 12345-21715@kfi7)
00000100:00000001:5.0:1773851849.037146:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:6.0:1773851849.037148:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851849.037148:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006a42b5fe nid 21715@kfi7 refs 2
02000000:00000001:6.0:1773851849.037150:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851849.037150:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851849.037150:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851849.037151:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851849.037153:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851849.037154:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858664592093312
00000020:00000001:6.0:1773851849.037155:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851849.037156:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9206f
00000020:00000001:6.0:1773851849.037157:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851849.037159:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a37f0736 refcount=6
00000020:00000001:6.0:1773851849.037160:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629485568 : -107123080066048 : ffff9e9276dd8c00)
00000020:00000001:6.0:1773851849.037163:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629485568 : -107123080066048 : ffff9e9276dd8c00)
00000100:00000001:6.0:1773851849.037164:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851849.037166:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851849.037167:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851849.037169:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851849.037170:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851849.037172:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851849.037173:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851849.037174:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.037176:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851849.037177:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851849.037177:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.037179:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851849.037182:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851849.037182:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851849.037183:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851849.037183:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851849.037185:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21714@kfi7, seq: 2001832
00000100:00000001:7.0:1773851849.037186:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.037186:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a37f0736 : new rpc_count 1
00000100:00000001:7.0:1773851849.037187:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.037187:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637061663671168 : -107012045880448 : ffff9eac5104c380)
00000100:00000040:6.0:1773851849.037190:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad9df0c5 x1858664592093312/t0(0) o400->559d6a80-899e-4fc8-934e-404934393a89@21714@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1845-0'
00000100:00000001:6.0:1773851849.037195:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851849.037196:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851849.037198:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad9df0c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:559d6a80-899e-4fc8-934e-404934393a89+6:39481:x1858664592093312:12345-21714@kfi7:400:default-tuolumne1845-0
00000100:00000200:6.0:1773851849.037200:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858664592093312
00000020:00000001:6.0:1773851849.037201:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851849.037202:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851849.037204:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.037205:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851849.037206:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851849.037208:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851849.037209:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858664592093312, found 0 last_xid 1858664592093311
00000020:00000001:6.0:1773851849.037210:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851849.037212:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851849.037213:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851849.037214:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.037215:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851849.037216:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851849.037217:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851849.037220:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002d351829.
02000000:00000001:6.0:1773851849.037221:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.037222:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.037224:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851849.037225:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044181486, transno 0, xid 1858664592093312
00010000:00000001:6.0:1773851849.037226:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851849.037228:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad9df0c5 x1858664592093312/t0(0) o400->559d6a80-899e-4fc8-934e-404934393a89@21714@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1845-0'
00010000:00000001:6.0:1773851849.037233:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851849.037234:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851849.037235:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=81 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851849.037237:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851849.037238:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000219683ef refcount 3 to 21714@kfi7
00000100:00000001:6.0:1773851849.037239:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857056 : -107149578694560 : ffff9e8c4b6c9060)
02000000:00000001:6.0:1773851849.037241:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851849.037242:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.037243:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851849.037244:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21715@kfi7
00000400:00000010:6.0:1773851849.037246:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d995f188.
00000100:00000200:6.0:1773851849.037247:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858664592093312, offset 224
00000400:00000200:6.0:1773851849.037250:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21715@kfi7
00000400:00000200:6.0:1773851849.037251:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21715@kfi7 to cpt 1
00000400:00000200:6.0:1773851849.037253:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a42b5fe nid 21715@kfi7 refs 1
00000400:00000200:6.0:1773851849.037255:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006a42b5fe nid 21715@kfi7 refs 2
00000400:00000200:6.0:1773851849.037257:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006a42b5fe nid 21715@kfi7 refs 3
00000400:00000200:6.0:1773851849.037259:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21715@kfi7 local destination
00000400:00000200:6.0:1773851849.037262:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768400:8768400:1024:4294967295] 21715@kfi7 LPNI seq info [293503:293503:16:4294967295]
00000400:00000200:6.0:1773851849.037264:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006a42b5fe nid 21715@kfi7 refs 2
00000400:00000200:6.0:1773851849.037266:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21715@kfi7 to cpt 1
00000400:00000200:6.0:1773851849.037270:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21715@kfi7(21715@kfi7:21715@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851849.037272:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006a42b5fe nid 21715@kfi7 refs 3
00000800:00000200:6.0:1773851849.037275:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851849.037277:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851849.037281:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851849.037285:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001167 Using peer 21715@kfi7(0x100000000001167)
00000800:00000200:6.0:1773851849.037290:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 324 bytes to peer 0x100000000001167: rc=0
00000800:00000200:6.0:1773851849.037293:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001167 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851849.037296:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.037298:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000219683ef refcount 2 to 21714@kfi7
00010000:00000001:6.0:1773851849.037299:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851849.037300:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.037301:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851849.037303:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad9df0c5 x1858664592093312/t0(0) o400->559d6a80-899e-4fc8-934e-404934393a89@21714@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1845-0'
00000800:00000200:5.0:1773851849.037308:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001167 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851849.037309:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad9df0c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:559d6a80-899e-4fc8-934e-404934393a89+6:39481:x1858664592093312:12345-21714@kfi7:400:default-tuolumne1845-0 Request processed in 112us (165us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851849.037311:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851849.037312:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21715@kfi7: PUT: OK
00000100:00100000:6.0:1773851849.037313:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21714@kfi7, seq: 2001832
00000400:00000200:5.0:1773851849.037313:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d995f188
00000100:00000040:6.0:1773851849.037314:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a37f0736 : new rpc_count 0
00000400:00000010:5.0:1773851849.037314:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d995f188.
00000100:00000001:5.0:1773851849.037315:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851849.037316:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851849.037316:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851849.037316:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:6.0:1773851849.037317:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000400:00000200:5.0:1773851849.037317:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006a42b5fe nid 21715@kfi7 refs 2
00000020:00000010:6.0:1773851849.037318:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000800:00000200:5.0:1773851849.037319:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 21715@kfi7(000000009dd0f874):0x0 lsk 4456 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001167 Transaction freed
00000020:00000010:6.0:1773851849.037320:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000020:00000040:6.0:1773851849.037321:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000a37f0736 : new refcount 5
00000100:00000001:6.0:1773851849.037322:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851849.039243:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851849.039244:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851849.039245:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851849.039247:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851849.039249:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.039250:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20706@kfi7 : PUT - for me
00000400:00000200:25.0:1773851849.039251:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.039252:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 1
00000400:00000200:25.0:1773851849.039252:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.039253:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000400:00000200:25.0:1773851849.039254:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 3
00000400:00000200:25.0:1773851849.039255:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.039255:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20706@kfi7 of length 224 into portal 12 MB=0x699e0cc4db640
00000400:00000200:25.0:1773851849.039257:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20706@kfi7 of length 224/224 into md 0x16159c6179 [64] + 176544
00000800:00000200:25.0:1773851849.039258:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851849.039260:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851849.039260:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20706@kfi7: PUT: OK
00000100:00000001:25.0:1773851849.039261:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851849.039262:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851849.039264:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006fc2723e.
00000100:00000040:25.0:1773851849.039264:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000006fc2723e x1858040639632960 msgsize 224
00000100:00100000:25.0:1773851849.039266:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20706@kfi7 (source: 12345-20706@kfi7)
00000100:00000001:25.0:1773851849.039267:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851849.039267:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000100:00000001:26.0:1773851849.039269:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851849.039269:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851849.039270:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851849.039271:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851849.039272:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851849.039274:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851849.039275:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040639632960
00000020:00000001:26.0:1773851849.039276:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851849.039277:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d9e
00000020:00000001:26.0:1773851849.039278:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851849.039280:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac305a91 refcount=8
00000020:00000001:26.0:1773851849.039281:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628499456 : -107123081052160 : ffff9e9276ce8000)
00000020:00000001:26.0:1773851849.039283:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628499456 : -107123081052160 : ffff9e9276ce8000)
00000100:00000001:26.0:1773851849.039284:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.039285:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851849.039286:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b7c3de4.
00000020:00000010:26.0:1773851849.039288:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.039290:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851849.039291:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851849.039292:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851849.039293:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.039295:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851849.039295:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851849.039296:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.039298:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.039300:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851849.039301:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851849.039301:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851849.039301:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851849.039303:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20706@kfi7, seq: 2025031
00000100:00000040:26.0:1773851849.039304:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac305a91 : new rpc_count 1
00000100:00000001:24.0:1773851849.039305:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.039306:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128160059264 : -106945549492352 : ffff9ebbcc831f80)
00000100:00000001:24.0:1773851849.039306:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.039309:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006fc2723e x1858040639632960/t0(0) o400->b665ca94-5aa6-4a24-a470-507cb5a87634@20706@kfi7:35/0 lens 224/0 e 0 to 0 dl 1773852150 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1771-0'
00000100:00000001:26.0:1773851849.039314:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.039315:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851849.039316:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006fc2723e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b665ca94-5aa6-4a24-a470-507cb5a87634+8:39823:x1858040639632960:12345-20706@kfi7:400:default-tuolumne1771-0
00000100:00000200:26.0:1773851849.039319:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040639632960
00000020:00000001:26.0:1773851849.039320:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851849.039321:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851849.039322:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.039323:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851849.039324:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851849.039325:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851849.039326:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040639632960, found 0 last_xid 1858040639632959
00000020:00000001:26.0:1773851849.039328:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851849.039329:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851849.039330:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851849.039331:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.039332:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851849.039333:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851849.039334:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851849.039335:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a145e70f.
02000000:00000001:26.0:1773851849.039336:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.039337:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.039338:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851849.039340:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044173959, transno 0, xid 1858040639632960
00010000:00000001:26.0:1773851849.039341:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851849.039343:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006fc2723e x1858040639632960/t0(0) o400->b665ca94-5aa6-4a24-a470-507cb5a87634@20706@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1771-0'
00010000:00000001:26.0:1773851849.039347:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851849.039348:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851849.039349:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=82 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851849.039352:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851849.039354:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eef21c76 refcount 3 to 20706@kfi7
00000100:00000001:26.0:1773851849.039355:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691040 : -107157065860576 : ffff9e8a8d277a20)
02000000:00000001:26.0:1773851849.039356:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851849.039357:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.039358:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851849.039360:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20706@kfi7
00000400:00000010:26.0:1773851849.039361:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006957f781.
00000100:00000200:26.0:1773851849.039362:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040639632960, offset 224
00000400:00000200:26.0:1773851849.039365:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20706@kfi7
00000400:00000200:26.0:1773851849.039366:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.039367:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 1
00000400:00000200:26.0:1773851849.039369:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000400:00000200:26.0:1773851849.039371:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 3
00000400:00000200:26.0:1773851849.039373:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20706@kfi7 local destination
00000400:00000200:26.0:1773851849.039376:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768401:8768401:1024:4294967295] 20706@kfi7 LPNI seq info [630393:630393:16:4294967295]
00000400:00000200:26.0:1773851849.039379:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000400:00000200:26.0:1773851849.039380:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.039384:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20706@kfi7(20706@kfi7:20706@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851849.039386:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 3
00000800:00000200:26.0:1773851849.039389:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.039391:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851849.039395:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851849.039399:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5c8 Using peer 20706@kfi7(0x5c8)
00000800:00000200:26.0:1773851849.039404:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x5c8: rc=0
00000800:00000200:26.0:1773851849.039406:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5c8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851849.039409:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.039412:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eef21c76 refcount 2 to 20706@kfi7
00010000:00000001:26.0:1773851849.039413:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851849.039414:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.039415:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851849.039416:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006fc2723e x1858040639632960/t0(0) o400->b665ca94-5aa6-4a24-a470-507cb5a87634@20706@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1771-0'
00000800:00000200:25.0:1773851849.039418:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5c8 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851849.039420:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851849.039420:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20706@kfi7: PUT: OK
00000100:00100000:26.0:1773851849.039421:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006fc2723e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b665ca94-5aa6-4a24-a470-507cb5a87634+8:39823:x1858040639632960:12345-20706@kfi7:400:default-tuolumne1771-0 Request processed in 106us (155us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851849.039421:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006957f781
00000400:00000010:25.0:1773851849.039421:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006957f781.
00000100:00000001:25.0:1773851849.039422:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851849.039423:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851849.039423:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000100:00100000:26.0:1773851849.039424:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20706@kfi7, seq: 2025031
00000800:00000200:25.0:1773851849.039425:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20706@kfi7(000000000d5b4206):0x0 lsk 1481 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5c8 Transaction freed
00000100:00000040:26.0:1773851849.039426:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac305a91 : new rpc_count 0
00000100:00000001:26.0:1773851849.039427:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851849.039428:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851849.039429:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.039430:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851849.039431:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b7c3de4.
00000020:00000040:26.0:1773851849.039432:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000ac305a91 : new refcount 7
00000100:00000001:26.0:1773851849.039433:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851849.087909:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851849.087910:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851849.087912:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851849.087915:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851849.087921:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.087923:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26106@kfi7 : PUT - for me
00000400:00000200:9.0:1773851849.087925:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.087926:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:9.0:1773851849.087928:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.087929:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:9.0:1773851849.087930:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:9.0:1773851849.087932:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26107@kfi7 to cpt 6
00000400:00000200:9.0:1773851849.087933:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26107@kfi7 of length 224 into portal 12 MB=0x699de5e104880
00000400:00000200:9.0:1773851849.087935:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26107@kfi7 of length 224/224 into md 0x78146ce49 [64] + 114744
00000800:00000200:9.0:1773851849.087938:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851849.087940:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.087942:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26106@kfi7: PUT: OK
00000100:00000001:9.0:1773851849.087943:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851849.087944:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851849.087945:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002be62958.
00000100:00000040:9.0:1773851849.087946:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000002be62958 x1858030200178816 msgsize 224
00000100:00100000:9.0:1773851849.087949:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26107@kfi7 (source: 12345-26106@kfi7)
00000100:00000001:9.0:1773851849.087950:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851849.087951:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000100:00000001:8.0:1773851849.087952:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851849.087953:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851849.087954:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851849.087954:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851849.087955:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851849.087956:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851849.087957:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030200178816
00000020:00000001:8.0:1773851849.087958:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851849.087959:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f12
00000020:00000001:8.0:1773851849.087960:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851849.087962:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000070f86eb2 refcount=6
00000020:00000001:8.0:1773851849.087963:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239881728 : -107152469669888 : ffff9e8b9f1bc800)
00000020:00000001:8.0:1773851849.087964:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239881728 : -107152469669888 : ffff9e8b9f1bc800)
00000100:00000001:8.0:1773851849.087966:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.087967:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851849.087968:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851849.087969:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.087970:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851849.087972:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851849.087972:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851849.087973:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851849.087975:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851849.087975:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851849.087976:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.087978:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851849.087980:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851849.087980:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851849.087980:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851849.087981:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851849.087982:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26107@kfi7, seq: 2130705
00000100:00000001:11.0:1773851849.087983:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.087983:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000070f86eb2 : new rpc_count 1
00000100:00000001:8.0:1773851849.087984:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637118924302464 : -106954785249152 : ffff9eb9a604a880)
00000100:00000001:11.0:1773851849.087985:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.087986:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002be62958 x1858030200178816/t0(0) o400->27cdcc61-87a9-4eca-bd50-547a9afd6a93@26107@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne270-0'
00000100:00000001:8.0:1773851849.087990:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.087991:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851849.087993:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002be62958 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:27cdcc61-87a9-4eca-bd50-547a9afd6a93+6:47948:x1858030200178816:12345-26107@kfi7:400:default-tuolumne270-0
00000100:00000200:8.0:1773851849.087995:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030200178816
00000020:00000001:8.0:1773851849.087996:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851849.087996:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851849.087998:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.087999:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851849.087999:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851849.088001:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851849.088001:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030200178816, found 0 last_xid 1858030200178815
00000020:00000001:8.0:1773851849.088003:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851849.088004:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851849.088005:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851849.088005:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.088006:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851849.088007:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851849.088008:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851849.088009:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002f053e14.
02000000:00000001:8.0:1773851849.088010:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.088011:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.088013:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851849.088013:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030200178816
00010000:00000001:8.0:1773851849.088015:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851849.088016:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002be62958 x1858030200178816/t0(0) o400->27cdcc61-87a9-4eca-bd50-547a9afd6a93@26107@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00010000:00000001:8.0:1773851849.088020:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851849.088021:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851849.088022:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=82 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851849.088023:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851849.088025:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013e1289e refcount 5 to 26107@kfi7
00000100:00000001:8.0:1773851849.088026:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691520 : -107157065860096 : ffff9e8a8d277c00)
02000000:00000001:8.0:1773851849.088027:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851849.088028:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.088029:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851849.088030:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26106@kfi7
00000400:00000010:8.0:1773851849.088031:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1f08bfb.
00000100:00000200:8.0:1773851849.088033:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030200178816, offset 224
00000400:00000200:8.0:1773851849.088035:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26106@kfi7
00000400:00000200:8.0:1773851849.088036:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.088037:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:8.0:1773851849.088039:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:8.0:1773851849.088041:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:8.0:1773851849.088042:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26106@kfi7 local destination
00000400:00000200:8.0:1773851849.088045:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768402:8768402:1024:4294967295] 26106@kfi7 LPNI seq info [24656:24656:16:4294967295]
00000400:00000200:8.0:1773851849.088047:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:8.0:1773851849.088048:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.088051:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26106@kfi7(26106@kfi7:26106@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851849.088053:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000800:00000200:8.0:1773851849.088055:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851849.088057:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851849.088060:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851849.088064:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 Using peer 26106@kfi7(0x1000000000009e4)
00000800:00000200:8.0:1773851849.088069:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x1000000000009e4: rc=0
00000800:00000200:8.0:1773851849.088071:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851849.088074:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.088076:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013e1289e refcount 4 to 26107@kfi7
00010000:00000001:8.0:1773851849.088077:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851849.088080:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.088081:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851849.088082:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002be62958 x1858030200178816/t0(0) o400->27cdcc61-87a9-4eca-bd50-547a9afd6a93@26107@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00000100:00100000:8.0:1773851849.088093:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002be62958 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:27cdcc61-87a9-4eca-bd50-547a9afd6a93+6:47948:x1858030200178816:12345-26107@kfi7:400:default-tuolumne270-0 Request processed in 101us (145us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851849.088097:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26107@kfi7, seq: 2130705
00000100:00000040:8.0:1773851849.088098:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000070f86eb2 : new rpc_count 0
00000100:00000001:8.0:1773851849.088099:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851849.088100:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851849.088101:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.088102:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851849.088103:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851849.088105:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000070f86eb2 : new refcount 5
00000100:00000001:8.0:1773851849.088106:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851849.088113:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851849.088116:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.088118:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26106@kfi7: PUT: OK
00000400:00000200:9.0:1773851849.088119:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1f08bfb
00000400:00000010:9.0:1773851849.088120:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1f08bfb.
00000100:00000001:9.0:1773851849.088121:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851849.088122:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851849.088123:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000800:00000200:9.0:1773851849.088126:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 Transaction freed
00000800:00000200:9.0:1773851849.088346:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851849.088347:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851849.088349:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851849.088351:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851849.088353:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.088354:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26106@kfi7 : PUT - for me
00000400:00000200:9.0:1773851849.088355:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.088356:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:9.0:1773851849.088357:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.088357:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:9.0:1773851849.088358:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:9.0:1773851849.088359:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26107@kfi7 to cpt 6
00000400:00000200:9.0:1773851849.088360:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26107@kfi7 of length 224 into portal 12 MB=0x699de5e1050c0
00000400:00000200:9.0:1773851849.088361:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26107@kfi7 of length 224/224 into md 0x78146ce49 [64] + 114968
00000800:00000200:9.0:1773851849.088363:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851849.088365:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.088366:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26106@kfi7: PUT: OK
00000100:00000001:9.0:1773851849.088367:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851849.088367:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851849.088369:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009795ca9f.
00000100:00000040:9.0:1773851849.088370:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009795ca9f x1858030200180928 msgsize 224
00000100:00100000:9.0:1773851849.088371:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26107@kfi7 (source: 12345-26106@kfi7)
00000100:00000001:9.0:1773851849.088372:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851849.088373:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000100:00000001:8.0:1773851849.088374:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851849.088375:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851849.088375:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851849.088375:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851849.088375:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851849.088376:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851849.088377:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030200180928
00000020:00000001:8.0:1773851849.088377:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851849.088378:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91230
00000020:00000001:8.0:1773851849.088378:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851849.088380:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005b7bb0a6 refcount=6
00000020:00000001:8.0:1773851849.088381:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240528896 : -107152469022720 : ffff9e8b9f25a800)
00000020:00000001:8.0:1773851849.088382:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240528896 : -107152469022720 : ffff9e8b9f25a800)
00000100:00000001:8.0:1773851849.088383:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.088383:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851849.088384:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851849.088385:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.088386:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851849.088386:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851849.088387:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851849.088387:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851849.088388:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851849.088389:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851849.088389:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.088390:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851849.088392:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851849.088392:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851849.088392:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851849.088392:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851849.088393:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26107@kfi7, seq: 2130706
00000100:00000001:11.0:1773851849.088394:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851849.088394:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.088394:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005b7bb0a6 : new rpc_count 1
00000100:00000001:8.0:1773851849.088394:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636976355126528 : -107097354425088 : ffff9e98743bad00)
00000100:00000040:8.0:1773851849.088396:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009795ca9f x1858030200180928/t0(0) o400->65733714-1dfc-4efd-b392-1e01bae40ccb@26107@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne270-0'
00000100:00000001:8.0:1773851849.088399:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.088399:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851849.088400:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009795ca9f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:65733714-1dfc-4efd-b392-1e01bae40ccb+6:47950:x1858030200180928:12345-26107@kfi7:400:default-tuolumne270-0
00000100:00000200:8.0:1773851849.088402:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030200180928
00000020:00000001:8.0:1773851849.088402:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851849.088403:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851849.088404:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.088404:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851849.088405:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851849.088405:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851849.088406:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030200180928, found 0 last_xid 1858030200180927
00000020:00000001:8.0:1773851849.088407:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851849.088407:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851849.088408:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851849.088408:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.088409:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851849.088409:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851849.088410:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851849.088411:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004c51d67e.
02000000:00000001:8.0:1773851849.088412:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.088412:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.088413:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851849.088413:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030200180928
00010000:00000001:8.0:1773851849.088414:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851849.088415:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009795ca9f x1858030200180928/t0(0) o400->65733714-1dfc-4efd-b392-1e01bae40ccb@26107@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00010000:00000001:8.0:1773851849.088418:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851849.088419:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851849.088419:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=82 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851849.088421:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851849.088421:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013e1289e refcount 5 to 26107@kfi7
00000100:00000001:8.0:1773851849.088422:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691520 : -107157065860096 : ffff9e8a8d277c00)
02000000:00000001:8.0:1773851849.088423:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851849.088423:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.088424:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851849.088425:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26106@kfi7
00000400:00000010:8.0:1773851849.088425:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7b495c.
00000100:00000200:8.0:1773851849.088426:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030200180928, offset 224
00000400:00000200:8.0:1773851849.088428:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26106@kfi7
00000400:00000200:8.0:1773851849.088428:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.088429:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:8.0:1773851849.088430:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:8.0:1773851849.088431:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:8.0:1773851849.088432:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26106@kfi7 local destination
00000400:00000200:8.0:1773851849.088433:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768403:8768403:1024:4294967295] 26106@kfi7 LPNI seq info [24657:24657:16:4294967295]
00000400:00000200:8.0:1773851849.088434:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:8.0:1773851849.088435:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.088437:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26106@kfi7(26106@kfi7:26106@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851849.088438:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000800:00000200:8.0:1773851849.088439:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851849.088440:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851849.088442:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851849.088444:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 Using peer 26106@kfi7(0x948)
00000800:00000200:8.0:1773851849.088447:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x948: rc=0
00000800:00000200:8.0:1773851849.088448:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851849.088450:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.088451:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013e1289e refcount 4 to 26107@kfi7
00010000:00000001:8.0:1773851849.088452:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851849.088452:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.088453:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851849.088453:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009795ca9f x1858030200180928/t0(0) o400->65733714-1dfc-4efd-b392-1e01bae40ccb@26107@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00000100:00100000:8.0:1773851849.088456:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009795ca9f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:65733714-1dfc-4efd-b392-1e01bae40ccb+6:47950:x1858030200180928:12345-26107@kfi7:400:default-tuolumne270-0 Request processed in 57us (86us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851849.088458:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26107@kfi7, seq: 2130706
00000100:00000040:8.0:1773851849.088459:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005b7bb0a6 : new rpc_count 0
00000100:00000001:8.0:1773851849.088459:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851849.088460:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851849.088460:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.088461:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851849.088462:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851849.088462:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000005b7bb0a6 : new refcount 5
00000100:00000001:8.0:1773851849.088463:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851849.088467:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851849.088468:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.088469:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26106@kfi7: PUT: OK
00000400:00000200:9.0:1773851849.088470:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7b495c
00000400:00000010:9.0:1773851849.088470:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7b495c.
00000100:00000001:9.0:1773851849.088471:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851849.088471:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851849.088472:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000800:00000200:9.0:1773851849.088474:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 Transaction freed
00000800:00000200:13.0:1773851849.090793:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851849.090794:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851849.090795:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851849.090797:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851849.090799:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.090800:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8945@kfi7 : PUT - for me
00000400:00000200:13.0:1773851849.090801:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.090802:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 1
00000400:00000200:13.0:1773851849.090803:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.090803:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000400:00000200:13.0:1773851849.090804:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 3
00000400:00000200:13.0:1773851849.090805:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8944@kfi7 to cpt 0
00000400:00000200:13.0:1773851849.090806:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8944@kfi7 of length 224 into portal 12 MB=0x69b08bdfa2f80
00000400:00000200:13.0:1773851849.090807:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8944@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 10312
00000800:00000200:13.0:1773851849.090809:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851849.090810:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851849.090811:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8945@kfi7: PUT: OK
00000100:00000001:13.0:1773851849.090812:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851849.090812:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851849.090813:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d9e9e8f2.
00000100:00000040:13.0:1773851849.090814:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000d9e9e8f2 x1859311709597568 msgsize 224
00000100:00100000:13.0:1773851849.090816:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8944@kfi7 (source: 12345-8945@kfi7)
00000100:00000001:13.0:1773851849.090817:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851849.090818:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000800:00000200:13.0:1773851849.090819:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851849.090820:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851849.090821:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851849.090821:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851849.090822:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851849.090823:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851849.090825:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859311709597568
00000020:00000001:14.0:1773851849.090825:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851849.090826:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926dc
00000020:00000001:14.0:1773851849.090827:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851849.090830:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000473de76 refcount=11
00000020:00000001:14.0:1773851849.090831:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631260160 : -107123078291456 : ffff9e9276f8a000)
00000020:00000001:14.0:1773851849.090832:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631260160 : -107123078291456 : ffff9e9276f8a000)
00000100:00000001:14.0:1773851849.090834:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851849.090835:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851849.090836:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d8eeec17.
00000020:00000010:14.0:1773851849.090837:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851849.090838:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851849.090840:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851849.090841:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851849.090842:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851849.090843:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851849.090844:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851849.090845:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.090846:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851849.090848:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851849.090849:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851849.090849:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851849.090850:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851849.090851:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8944@kfi7, seq: 2289758
00000100:00000001:15.0:1773851849.090852:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851849.090852:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000473de76 : new rpc_count 2
00000100:00000001:15.0:1773851849.090853:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.090853:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251439616 : -106960458112000 : ffff9eb853e3a400)
00000100:00000040:14.0:1773851849.090855:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d9e9e8f2 x1859311709597568/t0(0) o400->8f07c412-a714-4a03-b908-a39c23fd64f1@8944@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1037-0'
00000100:00000001:14.0:1773851849.090860:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851849.090861:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851849.090862:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d9e9e8f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8f07c412-a714-4a03-b908-a39c23fd64f1+11:39747:x1859311709597568:12345-8944@kfi7:400:default-tuolumne1037-0
00000100:00000200:14.0:1773851849.090864:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859311709597568
00000020:00000001:14.0:1773851849.090865:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851849.090866:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851849.090867:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.090868:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851849.090869:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851849.090870:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851849.090871:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859311709597568, found 0 last_xid 1859311709508031
00000020:00000001:14.0:1773851849.090873:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851849.090874:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851849.090875:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851849.090875:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.090876:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851849.090877:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851849.090878:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851849.090880:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a77180b3.
02000000:00000001:14.0:1773851849.090881:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.090883:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.090884:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851849.090885:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183002424739, transno 0, xid 1859311709597568
00010000:00000001:14.0:1773851849.090886:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851849.090887:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d9e9e8f2 x1859311709597568/t0(0) o400->8f07c412-a714-4a03-b908-a39c23fd64f1@8944@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1037-0'
00010000:00000001:14.0:1773851849.090892:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851849.090893:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851849.090894:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=82 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851849.090895:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851849.090896:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c8280374 refcount 3 to 8944@kfi7
00000100:00000001:14.0:1773851849.090898:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002656 : -107146751548960 : ffff9e8cf3ef61e0)
02000000:00000001:14.0:1773851849.090899:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851849.090900:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.090901:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851849.090902:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8945@kfi7
00000400:00000010:14.0:1773851849.090903:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a39ae46.
00000100:00000200:14.0:1773851849.090904:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859311709597568, offset 224
00000400:00000200:14.0:1773851849.090907:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8945@kfi7
00000400:00000200:14.0:1773851849.090908:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:14.0:1773851849.090909:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 1
00000400:00000200:14.0:1773851849.090911:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000400:00000200:14.0:1773851849.090913:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 3
00000400:00000200:14.0:1773851849.090915:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8945@kfi7 local destination
00000400:00000200:14.0:1773851849.090917:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768404:8768404:1024:4294967295] 8945@kfi7 LPNI seq info [2119789:2119789:16:4294967295]
00000400:00000200:14.0:1773851849.090919:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000400:00000200:14.0:1773851849.090920:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:14.0:1773851849.090924:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8945@kfi7(8945@kfi7:8945@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851849.090926:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 3
00000800:00000200:14.0:1773851849.090928:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851849.090930:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2069@kfi7:3 -> 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851849.090937:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2069@kfi7:3 -> 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851849.090941:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2069@kfi7:3 -> 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x107b Using peer 8945@kfi7(0x107b)
00000800:00000200:14.0:1773851849.090945:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000c8e2b965: Posted send of 324 bytes to peer 0x107b: rc=0
00000800:00000200:14.0:1773851849.090948:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2069@kfi7:3 -> 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x107b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851849.090951:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851849.090952:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c8280374 refcount 2 to 8944@kfi7
00010000:00000001:14.0:1773851849.090954:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851849.090954:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.090956:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851849.090957:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d9e9e8f2 x1859311709597568/t0(0) o400->8f07c412-a714-4a03-b908-a39c23fd64f1@8944@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1037-0'
00000800:00000200:13.0:1773851849.090961:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2069@kfi7:3 -> 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x107b TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851849.090962:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d9e9e8f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8f07c412-a714-4a03-b908-a39c23fd64f1+11:39747:x1859311709597568:12345-8944@kfi7:400:default-tuolumne1037-0 Request processed in 101us (147us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851849.090963:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851849.090964:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8945@kfi7: PUT: OK
00000400:00000200:13.0:1773851849.090964:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a39ae46
00000400:00000010:13.0:1773851849.090965:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a39ae46.
00000100:00000001:13.0:1773851849.090965:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:14.0:1773851849.090966:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8944@kfi7, seq: 2289758
00000100:00000001:13.0:1773851849.090966:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:14.0:1773851849.090967:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000473de76 : new rpc_count 1
00000400:00000200:13.0:1773851849.090967:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000800:00000200:13.0:1773851849.090968:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2069@kfi7:3 -> 8945@kfi7(0000000096db22e6):0x0 lsk 4220 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x107b Transaction freed
00000100:00000001:14.0:1773851849.090969:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851849.090969:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851849.090970:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851849.090971:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000020:00000010:14.0:1773851849.090973:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d8eeec17.
00000020:00000040:14.0:1773851849.090974:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000000473de76 : new refcount 10
00000100:00000001:14.0:1773851849.090975:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851849.119441:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851849.119443:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851849.119445:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851849.119448:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851849.119451:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.119453:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8704@kfi7 : PUT - for me
00000400:00000200:13.0:1773851849.119455:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.119456:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 1
00000400:00000200:13.0:1773851849.119458:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.119459:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000400:00000200:13.0:1773851849.119461:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 3
00000400:00000200:13.0:1773851849.119462:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8897@kfi7 to cpt 0
00000400:00000200:13.0:1773851849.119464:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8897@kfi7 of length 224 into portal 12 MB=0x69b0a2a0dd800
00000400:00000200:13.0:1773851849.119466:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8897@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 10536
00000800:00000200:13.0:1773851849.119468:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851849.119471:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851849.119473:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8704@kfi7: PUT: OK
00000100:00000001:13.0:1773851849.119474:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851849.119474:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851849.119475:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bfc7118e.
00000100:00000040:13.0:1773851849.119476:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000bfc7118e x1859317817792512 msgsize 224
00000100:00100000:13.0:1773851849.119478:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8897@kfi7 (source: 12345-8704@kfi7)
00000100:00000001:13.0:1773851849.119480:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:14.0:1773851849.119481:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851849.119481:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 2
02000000:00000001:14.0:1773851849.119482:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851849.119482:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851849.119482:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851849.119483:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851849.119484:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851849.119484:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317817792512
00000020:00000001:14.0:1773851849.119485:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851849.119486:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f72
00000020:00000001:14.0:1773851849.119487:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851849.119490:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000045e6442 refcount=9
00000020:00000001:14.0:1773851849.119490:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744912896 : -107128964638720 : ffff9e91181e1800)
00000020:00000001:14.0:1773851849.119491:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744912896 : -107128964638720 : ffff9e91181e1800)
00000100:00000001:14.0:1773851849.119493:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851849.119493:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851849.119494:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d8eeec17.
00000020:00000010:14.0:1773851849.119494:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851849.119495:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851849.119496:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851849.119496:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851849.119497:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851849.119498:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851849.119498:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851849.119499:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.119500:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851849.119501:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851849.119501:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851849.119501:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851849.119502:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851849.119503:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8897@kfi7, seq: 2289759
00000100:00000040:14.0:1773851849.119503:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000045e6442 : new rpc_count 1
00000100:00000001:15.0:1773851849.119504:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.119504:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.119504:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251437312 : -106960458114304 : ffff9eb853e39b00)
00000100:00000040:14.0:1773851849.119505:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bfc7118e x1859317817792512/t0(0) o400->4117e73c-97d2-47ae-808b-056227912da3@8897@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1043-0'
00000100:00000001:14.0:1773851849.119509:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851849.119509:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851849.119510:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc7118e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4117e73c-97d2-47ae-808b-056227912da3+9:39496:x1859317817792512:12345-8897@kfi7:400:default-tuolumne1043-0
00000100:00000200:14.0:1773851849.119511:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317817792512
00000020:00000001:14.0:1773851849.119512:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851849.119513:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851849.119513:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.119514:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851849.119515:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851849.119516:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851849.119516:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317817792512, found 0 last_xid 1859317817792511
00000020:00000001:14.0:1773851849.119517:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851849.119517:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851849.119518:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851849.119518:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.119519:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851849.119520:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851849.119520:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851849.119523:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003ad02957.
02000000:00000001:14.0:1773851849.119523:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.119524:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.119524:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851849.119525:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183007402965, transno 0, xid 1859317817792512
00010000:00000001:14.0:1773851849.119526:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851849.119527:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bfc7118e x1859317817792512/t0(0) o400->4117e73c-97d2-47ae-808b-056227912da3@8897@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1043-0'
00010000:00000001:14.0:1773851849.119529:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851849.119529:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851849.119530:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=82 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851849.119531:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851849.119531:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008ea29daa refcount 3 to 8897@kfi7
00000100:00000001:14.0:1773851849.119532:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274737568 : -107155434814048 : ffff9e8aee5f45a0)
02000000:00000001:14.0:1773851849.119533:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851849.119533:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.119534:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851849.119534:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8704@kfi7
00000400:00000010:14.0:1773851849.119535:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a39ae46.
00000100:00000200:14.0:1773851849.119536:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317817792512, offset 224
00000400:00000200:14.0:1773851849.119537:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8704@kfi7
00000400:00000200:14.0:1773851849.119538:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:14.0:1773851849.119539:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 1
00000400:00000200:14.0:1773851849.119540:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000400:00000200:14.0:1773851849.119541:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 3
00000400:00000200:14.0:1773851849.119542:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8704@kfi7 local destination
00000400:00000200:14.0:1773851849.119543:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768405:8768405:1024:4294967295] 8704@kfi7 LPNI seq info [1624784:1624784:16:4294967295]
00000400:00000200:14.0:1773851849.119545:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000400:00000200:14.0:1773851849.119545:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:14.0:1773851849.119547:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8704@kfi7(8704@kfi7:8704@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851849.119548:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 3
00000800:00000200:14.0:1773851849.119549:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851849.119550:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851849.119552:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851849.119554:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000a0 Using peer 8704@kfi7(0x1000000000000a0)
00000800:00000200:14.0:1773851849.119557:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000bbed2221: Posted send of 324 bytes to peer 0x1000000000000a0: rc=0
00000800:00000200:14.0:1773851849.119558:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000a0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851849.119560:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851849.119560:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008ea29daa refcount 2 to 8897@kfi7
00010000:00000001:14.0:1773851849.119561:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851849.119561:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851849.119562:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851849.119562:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bfc7118e x1859317817792512/t0(0) o400->4117e73c-97d2-47ae-808b-056227912da3@8897@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1043-0'
00000100:00100000:14.0:1773851849.119565:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc7118e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4117e73c-97d2-47ae-808b-056227912da3+9:39496:x1859317817792512:12345-8897@kfi7:400:default-tuolumne1043-0 Request processed in 55us (88us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851849.119567:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8897@kfi7, seq: 2289759
00000100:00000040:14.0:1773851849.119567:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000045e6442 : new rpc_count 0
00000100:00000001:14.0:1773851849.119568:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851849.119569:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851849.119569:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851849.119570:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000800:00000200:13.0:1773851849.119570:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000a0 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851849.119571:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d8eeec17.
00000020:00000040:14.0:1773851849.119571:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000045e6442 : new refcount 8
00000100:00000001:14.0:1773851849.119572:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851849.119572:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851849.119573:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8704@kfi7: PUT: OK
00000400:00000200:13.0:1773851849.119573:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a39ae46
00000400:00000010:13.0:1773851849.119573:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a39ae46.
00000100:00000001:13.0:1773851849.119574:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851849.119574:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851849.119575:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000800:00000200:13.0:1773851849.119576:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8704@kfi7(0000000078674e91):0x0 lsk 161 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000a0 Transaction freed
00000800:00000200:30.0:1773851849.130767:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851849.130767:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851849.130769:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:29.0:1773851849.130769:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851849.130771:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:29.0:1773851849.130771:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851849.130775:0:2472963:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17667@kfi7(00000000e2eaba32):0x108f version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851849.130778:0:2472963:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f Using peer 17667@kfi7(0x10000000000108f)
00000800:00000200:29.0:1773851849.130778:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851849.130781:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17667@kfi7 to cpt 7
00000400:00000200:30.0:1773851849.130782:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17667@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.130783:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17667@kfi7 : PUT - for me
00000800:00000200:30.0:1773851849.130785:0:2472963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bfd826e8: Posted send of 38 bytes to peer 0x10000000000108f: rc=0
00000400:00000200:29.0:1773851849.130785:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17667@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.130787:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6b007f6 nid 17667@kfi7 refs 1
00000800:00000200:30.0:1773851849.130788:0:2472963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851849.130789:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17667@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.130790:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6b007f6 nid 17667@kfi7 refs 2
00000400:00000200:29.0:1773851849.130792:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b6b007f6 nid 17667@kfi7 refs 3
00000400:00000200:29.0:1773851849.130793:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17666@kfi7 to cpt 4
00000400:00000200:29.0:1773851849.130795:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17666@kfi7 of length 456 into portal 12 MB=0x69b4bfad774c0
00000400:00000200:29.0:1773851849.130797:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17666@kfi7 of length 456/456 into md 0x77fe139dd [64] + 155960
00000800:00000200:29.0:1773851849.130800:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851849.130802:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851849.130803:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851849.130805:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17667@kfi7: PUT: OK
00000800:00000200:30.0:1773851849.130806:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f Transaction freed
00000100:00000001:29.0:1773851849.130806:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851849.130807:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851849.130808:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c23b007.
00000100:00000040:29.0:1773851849.130810:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000001c23b007 x1859600493540544 msgsize 456
00000100:00100000:29.0:1773851849.130812:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17666@kfi7 (source: 12345-17667@kfi7)
00000100:00000001:29.0:1773851849.130814:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851849.130815:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6b007f6 nid 17667@kfi7 refs 2
00000100:00000001:31.0:1773851849.130816:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851849.130817:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851849.130818:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851849.130818:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851849.130819:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851849.130820:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851849.130822:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600493540544
00000020:00000001:31.0:1773851849.130823:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851849.130824:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82310
00000020:00000001:31.0:1773851849.130825:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851849.130830:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b4317454 refcount=5
00000020:00000001:31.0:1773851849.130831:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165079537664 : -106908630013952 : ffff9ec46515a800)
00000020:00000001:31.0:1773851849.130832:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165079537664 : -106908630013952 : ffff9ec46515a800)
00000100:00000001:31.0:1773851849.130833:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851849.130835:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851849.130835:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851849.130837:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851849.130839:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851849.130840:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851849.130841:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851849.130842:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.130843:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.130845:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.130847:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851849.130848:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851849.130848:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851849.130849:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851849.130850:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17666@kfi7, seq: 364304979
00000100:00000040:31.0:1773851849.130852:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b4317454 : new rpc_count 1
00000100:00000001:29.0:1773851849.130852:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.130853:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125762056192 : -106947947495424 : ffff9ebb3d948000)
00000100:00000001:29.0:1773851849.130853:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851849.130855:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c23b007 x1859600493540544/t0(0) o17->82dcaefd-01d7-41d8-9b57-546d38424a38@17666@kfi7:576/0 lens 456/0 e 0 to 0 dl 1773851936 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1607-0'
00000100:00000001:31.0:1773851849.130860:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851849.130861:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851849.130863:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c23b007 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:82dcaefd-01d7-41d8-9b57-546d38424a38+5:39683:x1859600493540544:12345-17666@kfi7:17:default-tuolumne1607-0
00000100:00000200:31.0:1773851849.130865:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600493540544
00000020:00000001:31.0:1773851849.130866:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851849.130867:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851849.130868:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851849.130870:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851849.130871:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:31.0:1773851849.130872:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851849.130873:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600493540544, found 0 last_xid 1859600493540543
00000020:00000001:31.0:1773851849.130875:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851849.130876:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851849.130877:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851849.130877:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851849.130879:0:42267:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:31.0:1773851849.130880:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851849.130881:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851849.130882:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000bd69d754.
02000000:00000001:31.0:1773851849.130883:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.130884:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851849.130886:0:42267:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:31.0:1773851849.130887:0:42267:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:31.0:1773851849.130888:0:42267:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851849.130889:0:42267:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851849.130891:0:42267:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:31.0:1773851849.130892:0:42267:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 82dcaefd-01d7-41d8-9b57-546d38424a38/00000000b4317454 free: 126633370845184 avail: 126633368748032
00000020:00000001:31.0:1773851849.130894:0:42267:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:31.0:1773851849.130895:0:42267:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 82dcaefd-01d7-41d8-9b57-546d38424a38/00000000b4317454 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:31.0:1773851849.130898:0:42267:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:31.0:1773851849.130900:0:42267:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:31.0:1773851849.130901:0:42267:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 82dcaefd-01d7-41d8-9b57-546d38424a38/00000000b4317454 reports grant 1808269311 dropped 0, local 1876426751
00000020:00000001:31.0:1773851849.130903:0:42267:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:31.0:1773851849.130904:0:42267:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:31.0:1773851849.130905:0:42267:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851849.130906:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183206476152, transno 0, xid 1859600493540544
00010000:00000001:31.0:1773851849.130907:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851849.130909:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c23b007 x1859600493540544/t0(0) o17->82dcaefd-01d7-41d8-9b57-546d38424a38@17666@kfi7:576/0 lens 456/432 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1607-0'
00010000:00000001:31.0:1773851849.130913:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851849.130914:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851849.130916:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=82 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851849.130917:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851849.130919:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000033f88a16 refcount 3 to 17666@kfi7
00000100:00000001:31.0:1773851849.130920:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960224 : -107156125591392 : ffff9e8ac532d8a0)
02000000:00000001:31.0:1773851849.130921:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851849.130922:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.130923:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851849.130925:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17667@kfi7
00000400:00000010:31.0:1773851849.130926:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c70e405.
00000100:00000200:31.0:1773851849.130927:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859600493540544, offset 224
00000400:00000200:31.0:1773851849.130929:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17667@kfi7
00000400:00000200:31.0:1773851849.130931:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17667@kfi7 to cpt 7
00000400:00000200:31.0:1773851849.130933:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6b007f6 nid 17667@kfi7 refs 1
00000400:00000200:31.0:1773851849.130934:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b6b007f6 nid 17667@kfi7 refs 2
00000400:00000200:31.0:1773851849.130936:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b6b007f6 nid 17667@kfi7 refs 3
00000400:00000200:31.0:1773851849.130938:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17667@kfi7 local destination
00000400:00000200:31.0:1773851849.130941:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768406:8768406:1024:4294967295] 17667@kfi7 LPNI seq info [28010458:28010458:16:4294967295]
00000400:00000200:31.0:1773851849.130943:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b6b007f6 nid 17667@kfi7 refs 2
00000400:00000200:31.0:1773851849.130945:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17667@kfi7 to cpt 7
00000400:00000200:31.0:1773851849.130948:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17667@kfi7(17667@kfi7:17667@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851849.130950:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b6b007f6 nid 17667@kfi7 refs 3
00000800:00000200:31.0:1773851849.130953:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851849.130955:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:31.0:1773851849.130959:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851849.130963:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f Using peer 17667@kfi7(0x10000000000108f)
00000800:00000200:31.0:1773851849.130968:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 532 bytes to peer 0x10000000000108f: rc=0
00000800:00000200:31.0:1773851849.130970:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851849.130973:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851849.130975:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000033f88a16 refcount 2 to 17666@kfi7
00010000:00000001:31.0:1773851849.130976:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851849.130977:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851849.130978:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851849.130979:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c23b007 x1859600493540544/t0(0) o17->82dcaefd-01d7-41d8-9b57-546d38424a38@17666@kfi7:576/0 lens 456/432 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1607-0'
00000800:00000200:29.0:1773851849.130984:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851849.130985:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c23b007 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:82dcaefd-01d7-41d8-9b57-546d38424a38+5:39683:x1859600493540544:12345-17666@kfi7:17:default-tuolumne1607-0 Request processed in 123us (174us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851849.130989:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17666@kfi7, seq: 364304979
00000100:00000040:31.0:1773851849.130990:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b4317454 : new rpc_count 0
00000400:00000200:29.0:1773851849.130990:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851849.130991:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17667@kfi7: PUT: OK
00000100:00000001:31.0:1773851849.130992:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851849.130992:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851849.130992:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c70e405
00000020:00000010:31.0:1773851849.130993:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000010:29.0:1773851849.130993:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c70e405.
00000020:00000010:31.0:1773851849.130995:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000100:00000001:29.0:1773851849.130995:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851849.130995:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851849.130996:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000020:00000040:31.0:1773851849.130997:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000b4317454 : new refcount 4
00000400:00000200:29.0:1773851849.130997:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6b007f6 nid 17667@kfi7 refs 2
00000800:00000200:29.0:1773851849.130999:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 17667@kfi7(00000000e2eaba32):0x0 lsk 4240 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000108f Transaction freed
00000100:00000001:31.0:1773851849.131000:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851849.140074:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851849.140076:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851849.140078:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851849.140085:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851849.140088:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.140090:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19105@kfi7 : PUT - for me
00000400:00000200:5.0:1773851849.140091:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.140092:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 1
00000400:00000200:5.0:1773851849.140094:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.140095:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000400:00000200:5.0:1773851849.140096:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 3
00000400:00000200:5.0:1773851849.140097:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.140099:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19105@kfi7 of length 224 into portal 12 MB=0x69b4b5bd54c40
00000400:00000200:5.0:1773851849.140101:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19105@kfi7 of length 224/224 into md 0x793926dc5 [64] + 113776
00000800:00000200:5.0:1773851849.140104:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851849.140106:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851849.140108:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19105@kfi7: PUT: OK
00000100:00000001:5.0:1773851849.140109:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851849.140110:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851849.140111:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000052c08812.
00000100:00000040:5.0:1773851849.140112:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000052c08812 x1859597825821760 msgsize 224
00000100:00100000:5.0:1773851849.140114:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19105@kfi7 (source: 12345-19105@kfi7)
00000100:00000001:5.0:1773851849.140116:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851849.140117:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000100:00000001:6.0:1773851849.140118:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851849.140119:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851849.140120:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851849.140120:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851849.140120:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:6.0:1773851849.140122:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851849.140123:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597825821760
00000020:00000001:6.0:1773851849.140124:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851849.140124:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81cb1
00000020:00000001:6.0:1773851849.140126:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851849.140127:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a2ba676 refcount=5
00000020:00000001:6.0:1773851849.140128:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107603102720 : -106966106448896 : ffff9eb70338dc00)
00000020:00000001:6.0:1773851849.140130:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107603102720 : -106966106448896 : ffff9eb70338dc00)
00000100:00000001:6.0:1773851849.140132:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851849.140133:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851849.140134:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009120c9db.
00000020:00000010:6.0:1773851849.140136:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851849.140137:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851849.140139:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851849.140139:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851849.140140:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.140142:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851849.140142:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851849.140143:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.140145:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851849.140147:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851849.140147:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851849.140148:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851849.140148:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851849.140149:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19105@kfi7, seq: 2001833
00000100:00000001:7.0:1773851849.140151:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.140151:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a2ba676 : new rpc_count 1
00000100:00000001:7.0:1773851849.140152:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.140152:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637061663653888 : -107012045897728 : ffff9eac51048000)
00000100:00000040:6.0:1773851849.140154:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000052c08812 x1859597825821760/t0(0) o400->96ce4e4b-4547-4491-808c-600093cdb9d8@19105@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1680-0'
00000100:00000001:6.0:1773851849.140158:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851849.140159:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851849.140161:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052c08812 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:96ce4e4b-4547-4491-808c-600093cdb9d8+5:39752:x1859597825821760:12345-19105@kfi7:400:default-tuolumne1680-0
00000100:00000200:6.0:1773851849.140163:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597825821760
00000020:00000001:6.0:1773851849.140164:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851849.140165:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851849.140166:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.140167:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851849.140168:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851849.140169:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851849.140170:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597825821760, found 0 last_xid 1859597825821759
00000020:00000001:6.0:1773851849.140172:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851849.140173:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851849.140173:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851849.140174:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.140175:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851849.140176:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851849.140177:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851849.140178:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000018162f74.
02000000:00000001:6.0:1773851849.140179:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.140180:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.140181:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851849.140182:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689488, transno 0, xid 1859597825821760
00010000:00000001:6.0:1773851849.140183:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851849.140185:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000052c08812 x1859597825821760/t0(0) o400->96ce4e4b-4547-4491-808c-600093cdb9d8@19105@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1680-0'
00010000:00000001:6.0:1773851849.140189:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851849.140190:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851849.140191:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=81 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851849.140192:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851849.140194:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c6edf66f refcount 3 to 19105@kfi7
00000100:00000001:6.0:1773851849.140195:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740762464 : -107153968789152 : ffff9e8b45c10960)
02000000:00000001:6.0:1773851849.140196:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851849.140197:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.140198:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851849.140202:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19105@kfi7
00000400:00000010:6.0:1773851849.140203:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c9c32447.
00000100:00000200:6.0:1773851849.140204:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597825821760, offset 224
00000400:00000200:6.0:1773851849.140206:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19105@kfi7
00000400:00000200:6.0:1773851849.140208:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:6.0:1773851849.140209:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 1
00000400:00000200:6.0:1773851849.140211:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000400:00000200:6.0:1773851849.140213:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 3
00000400:00000200:6.0:1773851849.140215:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19105@kfi7 local destination
00000400:00000200:6.0:1773851849.140217:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768407:8768407:1024:4294967295] 19105@kfi7 LPNI seq info [9166720:9166720:16:4294967295]
00000400:00000200:6.0:1773851849.140220:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000400:00000200:6.0:1773851849.140221:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:6.0:1773851849.140224:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19105@kfi7(19105@kfi7:19105@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851849.140226:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 3
00000800:00000200:6.0:1773851849.140228:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851849.140230:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851849.140234:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851849.140238:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000417 Using peer 19105@kfi7(0x100000000000417)
00000800:00000200:6.0:1773851849.140242:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000e8b9920: Posted send of 324 bytes to peer 0x100000000000417: rc=0
00000800:00000200:6.0:1773851849.140245:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000417 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851849.140248:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.140250:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c6edf66f refcount 2 to 19105@kfi7
00010000:00000001:6.0:1773851849.140251:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851849.140252:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.140253:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851849.140254:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000052c08812 x1859597825821760/t0(0) o400->96ce4e4b-4547-4491-808c-600093cdb9d8@19105@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1680-0'
00000800:00000200:5.0:1773851849.140259:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000417 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851849.140261:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851849.140263:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19105@kfi7: PUT: OK
00000100:00100000:6.0:1773851849.140264:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052c08812 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:96ce4e4b-4547-4491-808c-600093cdb9d8+5:39752:x1859597825821760:12345-19105@kfi7:400:default-tuolumne1680-0 Request processed in 104us (151us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851849.140264:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c9c32447
00000400:00000010:5.0:1773851849.140265:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c9c32447.
00000100:00000001:5.0:1773851849.140267:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851849.140267:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:6.0:1773851849.140268:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19105@kfi7, seq: 2001833
00000400:00000200:5.0:1773851849.140268:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000100:00000040:6.0:1773851849.140269:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a2ba676 : new rpc_count 0
00000100:00000001:6.0:1773851849.140270:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851849.140271:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:5.0:1773851849.140271:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19105@kfi7(00000000f12ebe67):0x0 lsk 1048 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000417 Transaction freed
00000020:00000010:6.0:1773851849.140272:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851849.140273:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000020:00000010:6.0:1773851849.140274:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009120c9db.
00000020:00000040:6.0:1773851849.140276:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009a2ba676 : new refcount 4
00000100:00000001:6.0:1773851849.140277:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:30.0:1773851849.166775:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851849.166777:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851849.166824:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851849.166825:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851849.166873:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851849.166873:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851849.166920:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851849.166921:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851849.167211:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000a8444578 (tot 253200067).
00000400:00000010:30.0:1773851849.167214:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000a8444578 (tot 253199811).
00000800:00000200:2.0:1773851849.194384:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851849.194385:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851849.194386:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851849.194389:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851849.194391:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9185@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.194392:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9185@kfi7 : PUT - for me
00000400:00000200:2.0:1773851849.194393:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9185@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.194394:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f08a68e nid 9185@kfi7 refs 1
00000400:00000200:2.0:1773851849.194395:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9185@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.194395:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f08a68e nid 9185@kfi7 refs 2
00000400:00000200:2.0:1773851849.194396:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008f08a68e nid 9185@kfi7 refs 3
00000400:00000200:2.0:1773851849.194397:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000400:00000200:2.0:1773851849.194398:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8992@kfi7 of length 224 into portal 12 MB=0x699e16d003f80
00000400:00000200:2.0:1773851849.194399:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8992@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 3136
00000800:00000200:2.0:1773851849.194401:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851849.194403:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851849.194404:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9185@kfi7: PUT: OK
00000100:00000001:2.0:1773851849.194405:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851849.194406:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851849.194407:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000da4b4d81.
00000100:00000040:2.0:1773851849.194407:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000da4b4d81 x1858043335688064 msgsize 224
00000100:00100000:2.0:1773851849.194409:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-8992@kfi7 (source: 12345-9185@kfi7)
00000100:00000001:2.0:1773851849.194410:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851849.194411:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008f08a68e nid 9185@kfi7 refs 2
00000800:00000200:2.0:1773851849.194413:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851849.194415:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851849.194416:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851849.194416:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851849.194417:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851849.194418:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851849.194419:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043335688064
00000020:00000001:2.0:1773851849.194419:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851849.194420:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c78
00000020:00000001:2.0:1773851849.194420:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.194421:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bcc24655 refcount=779
00000020:00000001:2.0:1773851849.194422:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628282368 : -107123081269248 : ffff9e9276cb3000)
00000020:00000001:2.0:1773851849.194423:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628282368 : -107123081269248 : ffff9e9276cb3000)
00000100:00000001:2.0:1773851849.194424:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851849.194424:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851849.194425:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009abda479.
00000020:00000010:2.0:1773851849.194426:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851849.194427:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ebfb08ad.
00000100:00000001:2.0:1773851849.194428:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851849.194428:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851849.194429:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.194430:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851849.194430:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851849.194430:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.194431:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.194433:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851849.194433:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851849.194433:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:2.0:1773851849.194434:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8992@kfi7, seq: 1997466
00000100:00000001:1.0:1773851849.194434:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:2.0:1773851849.194435:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bcc24655 : new rpc_count 3
00000100:00000001:1.0:1773851849.194435:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.194436:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706792576 : -106953002759040 : ffff9eba10434c80)
00000100:00000001:1.0:1773851849.194436:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.194437:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000da4b4d81 x1858043335688064/t0(0) o400->561e8f84-6e6b-423f-abef-0c029a806187@8992@kfi7:489/0 lens 224/0 e 0 to 0 dl 1773852604 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1055-0'
00000100:00000001:2.0:1773851849.194439:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851849.194440:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851849.194440:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da4b4d81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:561e8f84-6e6b-423f-abef-0c029a806187+779:39826:x1858043335688064:12345-8992@kfi7:400:default-tuolumne1055-0
00000100:00000200:2.0:1773851849.194442:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043335688064
00000020:00000001:2.0:1773851849.194443:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851849.194444:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851849.194445:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.194446:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851849.194447:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851849.194448:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851849.194449:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043335688064, found 0 last_xid 1858043246397247
00000020:00000001:2.0:1773851849.194450:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851849.194451:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851849.194452:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851849.194453:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.194454:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851849.194455:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851849.194455:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851849.194456:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007beb6845.
02000000:00000001:2.0:1773851849.194457:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.194458:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.194459:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851849.194460:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264575056, transno 0, xid 1858043335688064
00010000:00000001:2.0:1773851849.194462:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851849.194463:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000da4b4d81 x1858043335688064/t0(0) o400->561e8f84-6e6b-423f-abef-0c029a806187@8992@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1055-0'
00010000:00000001:2.0:1773851849.194467:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851849.194468:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851849.194469:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=82 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851849.194471:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851849.194472:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001079cee5 refcount 3 to 8992@kfi7
00000100:00000001:2.0:1773851849.194473:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015833920 : -107152693717696 : ffff9e8b91c11540)
02000000:00000001:2.0:1773851849.194474:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851849.194475:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.194476:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851849.194477:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9185@kfi7
00000400:00000010:2.0:1773851849.194479:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b98af3b.
00000100:00000200:2.0:1773851849.194480:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043335688064, offset 224
00000400:00000200:2.0:1773851849.194482:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9185@kfi7
00000400:00000200:2.0:1773851849.194484:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9185@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.194485:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f08a68e nid 9185@kfi7 refs 1
00000400:00000200:2.0:1773851849.194487:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008f08a68e nid 9185@kfi7 refs 2
00000400:00000200:2.0:1773851849.194488:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008f08a68e nid 9185@kfi7 refs 3
00000400:00000200:2.0:1773851849.194490:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9185@kfi7 local destination
00000400:00000200:2.0:1773851849.194492:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768408:8768408:1024:4294967295] 9185@kfi7 LPNI seq info [880524:880524:16:4294967295]
00000400:00000200:2.0:1773851849.194495:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008f08a68e nid 9185@kfi7 refs 2
00000400:00000200:2.0:1773851849.194496:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9185@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.194500:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9185@kfi7(9185@kfi7:9185@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851849.194502:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008f08a68e nid 9185@kfi7 refs 3
00000800:00000200:2.0:1773851849.194504:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851849.194506:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851849.194510:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851849.194514:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf71 Using peer 9185@kfi7(0xf71)
00000800:00000200:2.0:1773851849.194519:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000009005aa0b: Posted send of 324 bytes to peer 0xf71: rc=0
00000800:00000200:2.0:1773851849.194522:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf71 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851849.194525:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.194527:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001079cee5 refcount 2 to 8992@kfi7
00010000:00000001:2.0:1773851849.194528:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851849.194529:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.194530:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851849.194531:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000da4b4d81 x1858043335688064/t0(0) o400->561e8f84-6e6b-423f-abef-0c029a806187@8992@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1055-0'
00000100:00100000:2.0:1773851849.194536:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da4b4d81 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:561e8f84-6e6b-423f-abef-0c029a806187+779:39826:x1858043335688064:12345-8992@kfi7:400:default-tuolumne1055-0 Request processed in 96us (128us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851849.194537:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf71 TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851849.194540:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8992@kfi7, seq: 1997466
00000400:00000200:1.0:1773851849.194540:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:2.0:1773851849.194542:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bcc24655 : new rpc_count 2
00000400:00000200:1.0:1773851849.194542:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9185@kfi7: PUT: OK
00000100:00000001:2.0:1773851849.194543:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:1.0:1773851849.194543:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b98af3b
00000100:00000001:2.0:1773851849.194544:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:1.0:1773851849.194544:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b98af3b.
00000020:00000010:2.0:1773851849.194545:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000100:00000001:1.0:1773851849.194545:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851849.194545:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:2.0:1773851849.194546:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ebfb08ad.
00000020:00000010:2.0:1773851849.194547:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009abda479.
00000400:00000200:1.0:1773851849.194547:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008f08a68e nid 9185@kfi7 refs 2
00000020:00000040:2.0:1773851849.194548:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000bcc24655 : new refcount 778
00000100:00000001:2.0:1773851849.194549:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851849.194549:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 9185@kfi7(00000000f4371992):0x0 lsk 3954 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf71 Transaction freed
00000800:00000200:17.0:1773851849.273153:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.273154:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.273156:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.273158:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.273160:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13875@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.273161:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13875@kfi7 : PUT - for me
00000400:00000200:17.0:1773851849.273162:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13875@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.273164:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006220ff70 nid 13875@kfi7 refs 1
00000400:00000200:17.0:1773851849.273165:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13875@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.273165:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006220ff70 nid 13875@kfi7 refs 2
00000400:00000200:17.0:1773851849.273166:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006220ff70 nid 13875@kfi7 refs 3
00000400:00000200:17.0:1773851849.273167:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13874@kfi7 to cpt 1
00000400:00000200:17.0:1773851849.273168:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13874@kfi7 of length 440 into portal 17 MB=0x69b4ba7746500
00000400:00000200:17.0:1773851849.273170:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-13874@kfi7 of length 440/440 into md 0x6ab0f7c31 [2] + 0
00000800:00000200:17.0:1773851849.273172:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.273174:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.273175:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13875@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.273176:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.273176:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:17.0:1773851849.273177:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009285d8c1.
00000100:00000040:17.0:1773851849.273178:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009285d8c1 x1859599094539520 msgsize 440
00000100:00100000:17.0:1773851849.273180:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13874@kfi7 (source: 12345-13875@kfi7)
00000100:00000001:17.0:1773851849.273182:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.273183:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006220ff70 nid 13875@kfi7 refs 2
00000100:00000001:18.0:1773851849.273185:0:154717:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851849.273185:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851849.273186:0:154717:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851849.273186:0:154717:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851849.273187:0:154717:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851849.273188:0:154717:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851849.273188:0:154717:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599094539520
00000020:00000001:18.0:1773851849.273189:0:154717:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851849.273190:0:154717:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38944ea2
00000020:00000001:18.0:1773851849.273190:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273191:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f920d659 refcount=775
00000020:00000001:18.0:1773851849.273192:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114263451648 : -106959446099968 : ffff9eb89035b800)
00000020:00000001:18.0:1773851849.273193:0:154717:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637114263451648 : -106959446099968 : ffff9eb89035b800)
00000100:00000001:18.0:1773851849.273194:0:154717:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851849.273195:0:154717:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851849.273196:0:154717:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000104bdc31.
00000020:00000010:18.0:1773851849.273197:0:154717:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851849.273198:0:154717:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f73ed6a1.
00000100:00000040:18.0:1773851849.273199:0:154717:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:18.0:1773851849.273200:0:154717:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851849.273200:0:154717:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:18.0:1773851849.273201:0:154717:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:18.0:1773851849.273202:0:154717:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273203:0:154717:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:18.0:1773851849.273204:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273205:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273205:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000881e7e6b refcount=3
00000020:00000001:18.0:1773851849.273206:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146614726656 : -106927094824960 : ffff9ec0187f0000)
00010000:00000001:18.0:1773851849.273207:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637146614726656 : -106927094824960 : ffff9ec0187f0000)
00010000:00000001:18.0:1773851849.273208:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273208:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273209:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273209:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273210:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028ee2aa1 refcount=3
00000020:00000001:18.0:1773851849.273210:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636984071084224 : -107089638467392 : ffff9e9a4023d8c0)
00010000:00000001:18.0:1773851849.273211:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636984071084224 : -107089638467392 : ffff9e9a4023d8c0)
00010000:00000001:18.0:1773851849.273212:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273212:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273213:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273213:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273214:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000a42befff refcount=3
00000020:00000001:18.0:1773851849.273214:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636984071085376 : -107089638466240 : ffff9e9a4023dd40)
00010000:00000001:18.0:1773851849.273215:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636984071085376 : -107089638466240 : ffff9e9a4023dd40)
00010000:00000001:18.0:1773851849.273215:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273216:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273216:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273216:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273217:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000088ed58a9 refcount=3
00000020:00000001:18.0:1773851849.273218:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636980442980800 : -107093266570816 : ffff9e9967e361c0)
00010000:00000001:18.0:1773851849.273218:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636980442980800 : -107093266570816 : ffff9e9967e361c0)
00010000:00000001:18.0:1773851849.273219:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273220:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273220:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273220:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273221:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000075e39480 refcount=3
00000020:00000001:18.0:1773851849.273222:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146614735296 : -106927094816320 : ffff9ec0187f21c0)
00010000:00000001:18.0:1773851849.273223:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637146614735296 : -106927094816320 : ffff9ec0187f21c0)
00010000:00000001:18.0:1773851849.273223:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273224:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273224:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273224:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273225:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c54a356c refcount=3
00000020:00000001:18.0:1773851849.273226:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637155649516480 : -106918060035136 : ffff9ec23302f3c0)
00010000:00000001:18.0:1773851849.273226:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637155649516480 : -106918060035136 : ffff9ec23302f3c0)
00010000:00000001:18.0:1773851849.273227:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273227:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273228:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273228:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273229:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000606bbf2c refcount=3
00000020:00000001:18.0:1773851849.273229:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956339237248 : -107117370314368 : ffff9e93cb317180)
00010000:00000001:18.0:1773851849.273230:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636956339237248 : -107117370314368 : ffff9e93cb317180)
00010000:00000001:18.0:1773851849.273231:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273231:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273231:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273232:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273232:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000543103b3 refcount=3
00000020:00000001:18.0:1773851849.273233:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164207670976 : -106909501880640 : ffff9ec4311e06c0)
00010000:00000001:18.0:1773851849.273234:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164207670976 : -106909501880640 : ffff9ec4311e06c0)
00010000:00000001:18.0:1773851849.273234:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273235:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273235:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273235:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273236:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006da0e849 refcount=3
00000020:00000001:18.0:1773851849.273236:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105594414016 : -106968115137600 : ffff9eb68b7eb3c0)
00010000:00000001:18.0:1773851849.273237:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105594414016 : -106968115137600 : ffff9eb68b7eb3c0)
00010000:00000001:18.0:1773851849.273238:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273238:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273238:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273239:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273240:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d3d8bfab refcount=3
00000020:00000001:18.0:1773851849.273240:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063303002176 : -107010406549440 : ffff9eacb2baf840)
00010000:00000001:18.0:1773851849.273241:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063303002176 : -107010406549440 : ffff9eacb2baf840)
00010000:00000001:18.0:1773851849.273242:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273242:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273242:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273243:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273243:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005a0a3a92 refcount=3
00000020:00000001:18.0:1773851849.273244:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138172207552 : -106935537344064 : ffff9ebe214861c0)
00010000:00000001:18.0:1773851849.273245:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637138172207552 : -106935537344064 : ffff9ebe214861c0)
00010000:00000001:18.0:1773851849.273245:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273246:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273246:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273246:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273249:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f990be19 refcount=3
00000020:00000001:18.0:1773851849.273250:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636988327481856 : -107085382069760 : ffff9e9b3dd75200)
00010000:00000001:18.0:1773851849.273250:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636988327481856 : -107085382069760 : ffff9e9b3dd75200)
00010000:00000001:18.0:1773851849.273251:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273252:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273252:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273252:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273253:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000004a42b50d refcount=3
00000020:00000001:18.0:1773851849.273253:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942684736 : -106911766866880 : ffff9ec3aa1d1440)
00010000:00000001:18.0:1773851849.273254:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942684736 : -106911766866880 : ffff9ec3aa1d1440)
00010000:00000001:18.0:1773851849.273255:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273255:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273255:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273256:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273257:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000666b16a refcount=3
00000020:00000001:18.0:1773851849.273257:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117498497216 : -106956211054400 : ffff9eb9510898c0)
00010000:00000001:18.0:1773851849.273258:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637117498497216 : -106956211054400 : ffff9eb9510898c0)
00010000:00000001:18.0:1773851849.273259:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273259:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273259:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273260:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273261:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000001a3c7d0b refcount=3
00000020:00000001:18.0:1773851849.273261:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166298044032 : -106907411507584 : ffff9ec4adb69680)
00010000:00000001:18.0:1773851849.273262:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166298044032 : -106907411507584 : ffff9ec4adb69680)
00010000:00000001:18.0:1773851849.273263:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273263:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273263:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273264:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273265:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000377d1226 refcount=3
00000020:00000001:18.0:1773851849.273266:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637071917549824 : -107001792001792 : ffff9eaeb4328900)
00010000:00000001:18.0:1773851849.273266:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637071917549824 : -107001792001792 : ffff9eaeb4328900)
00010000:00000001:18.0:1773851849.273267:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273267:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273268:0:154717:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.273268:0:154717:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.273270:0:154717:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.273272:0:154717:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851849.273274:0:154717:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851849.273274:0:154717:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851849.273275:0:154220:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851849.273275:0:154220:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851849.273275:0:154717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13874@kfi7, seq: 38350201
00000100:00000001:19.0:1773851849.273276:0:154220:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851849.273276:0:154717:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f920d659 : new rpc_count 15
00000100:00000001:19.0:1773851849.273277:0:154220:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.273277:0:154717:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131864489728 : -106941845061888 : ffff9ebca9503f00)
00000100:00000040:18.0:1773851849.273278:0:154717:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009285d8c1 x1859599094539520/t0(0) o103->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:576/0 lens 440/0 e 0 to 0 dl 1773851936 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:18.0:1773851849.273281:0:154717:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851849.273282:0:154717:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851849.273283:0:154717:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009285d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_011:7fc5910d-f170-4eda-bc46-60ec6a7ee835+775:39459:x1859599094539520:12345-13874@kfi7:103:
00000100:00000200:18.0:1773851849.273284:0:154717:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599094539520
00010000:00000001:18.0:1773851849.273285:0:154717:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:18.0:1773851849.273286:0:154717:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:18.0:1773851849.273287:0:154717:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:18.0:1773851849.273288:0:154717:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851849.273289:0:154717:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851849.273290:0:154717:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000063aefba8.
02000000:00000001:18.0:1773851849.273290:0:154717:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.273291:0:154717:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273292:0:154717:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:18.0:1773851849.273293:0:154717:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0
00010000:00000001:18.0:1773851849.273293:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273294:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273294:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000881e7e6b refcount=3
00000020:00000001:18.0:1773851849.273295:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146614726656 : -106927094824960 : ffff9ec0187f0000)
00010000:00000001:18.0:1773851849.273295:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637146614726656 : -106927094824960 : ffff9ec0187f0000)
00010000:00000040:18.0:1773851849.273297:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000f1b3f465 count: 2
00000004:00000001:18.0:1773851849.273299:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273299:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273300:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273301:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273302:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273303:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273304:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273304:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273306:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273306:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273306:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273307:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273308:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000881e7e6b with handle 0x21b6f08f07a5a036 from hash
00010000:00000001:18.0:1773851849.273309:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273309:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273310:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273310:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273311:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273312:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273312:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273313:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273314:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000881e7e6b/0x21b6f08f07a5a036 lrc: 0/0,0 mode: --/CR res: [0x240023415:0x1245a:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf5f44 expref: 775 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273317:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f1b3f465 count: 2
00010000:00000040:18.0:1773851849.273318:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 697
00000020:00000040:18.0:1773851849.273319:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 774
00010000:00000010:18.0:1773851849.273320:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000cccfb9f8.
00010000:00000040:18.0:1773851849.273321:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f1b3f465 count: 1
00010000:00000001:18.0:1773851849.273321:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273322:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273322:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273322:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028ee2aa1 refcount=3
00000020:00000001:18.0:1773851849.273323:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636984071084224 : -107089638467392 : ffff9e9a4023d8c0)
00010000:00000001:18.0:1773851849.273323:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636984071084224 : -107089638467392 : ffff9e9a4023d8c0)
00010000:00000001:18.0:1773851849.273324:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273325:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273326:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240023415:0x1245a:0x0].0x0 (00000000f1b3f465)
00010000:00000001:18.0:1773851849.273327:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273328:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273329:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273329:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f1b3f465 count: 0
00010000:00000010:18.0:1773851849.273330:0:154717:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000107bcf38.
00010000:00000040:18.0:1773851849.273331:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000eeff851b count: 2
00000004:00000001:18.0:1773851849.273332:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273332:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273333:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273333:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273334:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273334:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273335:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273336:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273337:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273337:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273337:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273338:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273338:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000028ee2aa1 with handle 0x21b6f08f07a59fb8 from hash
00010000:00000001:18.0:1773851849.273339:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273339:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273340:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273341:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273341:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273341:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273342:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273342:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273343:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000028ee2aa1/0x21b6f08f07a59fb8 lrc: 0/0,0 mode: --/CR res: [0x240024baa:0x4174:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf5ee2 expref: 774 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273346:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000eeff851b count: 2
00010000:00000040:18.0:1773851849.273346:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 696
00000020:00000040:18.0:1773851849.273347:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 773
00010000:00000010:18.0:1773851849.273347:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000007d39708e.
00010000:00000040:18.0:1773851849.273348:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000eeff851b count: 1
00010000:00000001:18.0:1773851849.273349:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273349:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273349:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273350:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000a42befff refcount=3
00000020:00000001:18.0:1773851849.273350:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636984071085376 : -107089638466240 : ffff9e9a4023dd40)
00010000:00000001:18.0:1773851849.273351:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636984071085376 : -107089638466240 : ffff9e9a4023dd40)
00010000:00000001:18.0:1773851849.273352:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273353:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273353:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024baa:0x4174:0x0].0x0 (00000000eeff851b)
00010000:00000001:18.0:1773851849.273354:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273355:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273355:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273356:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000eeff851b count: 0
00010000:00000010:18.0:1773851849.273357:0:154717:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 000000001247ba8b.
00010000:00000040:18.0:1773851849.273358:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008ebd8b7b count: 2
00000004:00000001:18.0:1773851849.273358:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273359:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273359:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273360:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273360:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273361:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273362:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273363:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273363:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273364:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273364:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273364:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273365:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000a42befff with handle 0x21b6f08f07a59fb1 from hash
00010000:00000001:18.0:1773851849.273366:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273366:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273367:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273367:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273367:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273368:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273368:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273369:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273369:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000a42befff/0x21b6f08f07a59fb1 lrc: 0/0,0 mode: --/CR res: [0x240024e40:0x1d092:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf5ecd expref: 773 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273372:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008ebd8b7b count: 2
00010000:00000040:18.0:1773851849.273372:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 695
00000020:00000040:18.0:1773851849.273373:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 772
00010000:00000010:18.0:1773851849.273374:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000005ce0488e.
00010000:00000040:18.0:1773851849.273374:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008ebd8b7b count: 1
00010000:00000001:18.0:1773851849.273375:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273375:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273376:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273376:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000088ed58a9 refcount=3
00000020:00000001:18.0:1773851849.273377:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636980442980800 : -107093266570816 : ffff9e9967e361c0)
00010000:00000001:18.0:1773851849.273377:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636980442980800 : -107093266570816 : ffff9e9967e361c0)
00010000:00000001:18.0:1773851849.273378:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273378:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273379:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024e40:0x1d092:0x0].0x0 (000000008ebd8b7b)
00010000:00000001:18.0:1773851849.273380:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273380:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273381:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273381:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008ebd8b7b count: 0
00010000:00000010:18.0:1773851849.273382:0:154717:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 000000006fcce8e3.
00010000:00000040:18.0:1773851849.273383:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000007787162c count: 5
00000004:00000001:18.0:1773851849.273384:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273384:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273385:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273385:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273386:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273386:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273388:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273388:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273389:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273389:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273390:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273390:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273391:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000088ed58a9 with handle 0x21b6f08f07a59ec3 from hash
00010000:00000001:18.0:1773851849.273391:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273392:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273392:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273392:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273393:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273393:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273394:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273394:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273395:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000088ed58a9/0x21b6f08f07a59ec3 lrc: 0/0,0 mode: --/CR res: [0x240028ddf:0x1b9c0:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf5c6c expref: 772 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273397:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000007787162c count: 5
00010000:00000040:18.0:1773851849.273398:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 694
00000020:00000040:18.0:1773851849.273398:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 771
00010000:00000010:18.0:1773851849.273399:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000007551a98d.
00010000:00000040:18.0:1773851849.273399:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000007787162c count: 4
00010000:00000001:18.0:1773851849.273400:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273400:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273401:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273401:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000075e39480 refcount=3
00000020:00000001:18.0:1773851849.273402:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146614735296 : -106927094816320 : ffff9ec0187f21c0)
00010000:00000001:18.0:1773851849.273402:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637146614735296 : -106927094816320 : ffff9ec0187f21c0)
00010000:00000001:18.0:1773851849.273403:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273403:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273404:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028ddf:0x1b9c0:0x0].0x0 (000000007787162c)
00010000:00000001:18.0:1773851849.273405:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273406:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273406:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273407:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000007787162c count: 3
00010000:00000040:18.0:1773851849.273407:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000003327997f count: 3
00000004:00000001:18.0:1773851849.273408:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273408:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273409:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273409:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273410:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273410:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273411:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273411:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273412:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273412:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273413:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273413:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273414:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000075e39480 with handle 0x21b6f08f07a59053 from hash
00010000:00000001:18.0:1773851849.273415:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273415:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273415:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273415:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273416:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273416:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273417:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273417:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273418:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000075e39480/0x21b6f08f07a59053 lrc: 0/0,0 mode: --/CR res: [0x240024c23:0x622d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf4e96 expref: 771 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273420:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003327997f count: 3
00010000:00000040:18.0:1773851849.273421:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 693
00000020:00000040:18.0:1773851849.273422:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 770
00010000:00000010:18.0:1773851849.273422:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a1b87050.
00010000:00000040:18.0:1773851849.273423:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003327997f count: 2
00010000:00000001:18.0:1773851849.273423:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273424:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273424:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273424:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c54a356c refcount=3
00000020:00000001:18.0:1773851849.273425:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637155649516480 : -106918060035136 : ffff9ec23302f3c0)
00010000:00000001:18.0:1773851849.273425:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637155649516480 : -106918060035136 : ffff9ec23302f3c0)
00010000:00000001:18.0:1773851849.273426:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273426:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273427:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024c23:0x622d:0x0].0x0 (000000003327997f)
00010000:00000001:18.0:1773851849.273428:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273428:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273429:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273429:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003327997f count: 1
00010000:00000040:18.0:1773851849.273430:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000001cfc2025 count: 3
00000004:00000001:18.0:1773851849.273431:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273431:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273432:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273432:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273432:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273433:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273434:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273435:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273435:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273435:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273436:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273436:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273437:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c54a356c with handle 0x21b6f08f07a58b13 from hash
00010000:00000001:18.0:1773851849.273438:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273438:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273438:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273439:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273440:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273440:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273440:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273441:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273442:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c54a356c/0x21b6f08f07a58b13 lrc: 0/0,0 mode: --/CR res: [0x240024e3a:0xc4fa:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf4b47 expref: 770 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273444:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000001cfc2025 count: 3
00010000:00000040:18.0:1773851849.273445:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 692
00000020:00000040:18.0:1773851849.273445:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 769
00010000:00000010:18.0:1773851849.273446:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000e2773ffa.
00010000:00000040:18.0:1773851849.273447:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000001cfc2025 count: 2
00010000:00000001:18.0:1773851849.273447:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273448:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273448:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273448:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000606bbf2c refcount=3
00000020:00000001:18.0:1773851849.273449:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956339237248 : -107117370314368 : ffff9e93cb317180)
00010000:00000001:18.0:1773851849.273449:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636956339237248 : -107117370314368 : ffff9e93cb317180)
00010000:00000001:18.0:1773851849.273450:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273450:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273451:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024e3a:0xc4fa:0x0].0x0 (000000001cfc2025)
00010000:00000001:18.0:1773851849.273452:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273452:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273453:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273453:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000001cfc2025 count: 1
00010000:00000040:18.0:1773851849.273454:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000c8421d8c count: 4
00000004:00000001:18.0:1773851849.273455:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273455:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273456:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273456:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273457:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273457:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273458:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273459:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273460:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273460:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273460:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273461:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273461:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000606bbf2c with handle 0x21b6f08f07a58abf from hash
00010000:00000001:18.0:1773851849.273462:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273462:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273463:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273463:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273463:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273464:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273464:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273465:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273465:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000606bbf2c/0x21b6f08f07a58abf lrc: 0/0,0 mode: --/CR res: [0x240024a6d:0xa6b4:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf4ac9 expref: 769 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273468:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c8421d8c count: 4
00010000:00000040:18.0:1773851849.273468:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 691
00000020:00000040:18.0:1773851849.273469:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 768
00010000:00000010:18.0:1773851849.273469:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000cf4f963a.
00010000:00000040:18.0:1773851849.273470:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c8421d8c count: 3
00010000:00000001:18.0:1773851849.273470:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273471:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273471:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273471:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000543103b3 refcount=3
00000020:00000001:18.0:1773851849.273472:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164207670976 : -106909501880640 : ffff9ec4311e06c0)
00010000:00000001:18.0:1773851849.273473:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164207670976 : -106909501880640 : ffff9ec4311e06c0)
00010000:00000001:18.0:1773851849.273473:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273474:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273474:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024a6d:0xa6b4:0x0].0x0 (00000000c8421d8c)
00010000:00000001:18.0:1773851849.273475:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273476:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273476:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273476:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c8421d8c count: 2
00010000:00000040:18.0:1773851849.273477:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000002a5b957b count: 5
00000004:00000001:18.0:1773851849.273478:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273478:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273479:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273479:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273480:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273480:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273481:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273481:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273482:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273482:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273483:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273483:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273484:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000543103b3 with handle 0x21b6f08f07a52260 from hash
00010000:00000001:18.0:1773851849.273484:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273485:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273485:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273485:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273486:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273486:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273486:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273487:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273487:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000543103b3/0x21b6f08f07a52260 lrc: 0/0,0 mode: --/PR res: [0x30001e07b:0x5ab3:0x0].0x0 bits 0x1/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf4440 expref: 768 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273489:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002a5b957b count: 5
00010000:00000040:18.0:1773851849.273490:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 690
00000020:00000040:18.0:1773851849.273491:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 767
00010000:00000010:18.0:1773851849.273491:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000bc25299d.
00010000:00000040:18.0:1773851849.273492:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002a5b957b count: 4
00010000:00000001:18.0:1773851849.273493:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273493:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273494:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273494:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006da0e849 refcount=3
00000020:00000001:18.0:1773851849.273494:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105594414016 : -106968115137600 : ffff9eb68b7eb3c0)
00010000:00000001:18.0:1773851849.273495:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105594414016 : -106968115137600 : ffff9eb68b7eb3c0)
00010000:00000001:18.0:1773851849.273496:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273496:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273497:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x30001e07b:0x5ab3:0x0].0x0 (000000002a5b957b)
00010000:00000001:18.0:1773851849.273498:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273499:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273499:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273499:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002a5b957b count: 3
00010000:00000040:18.0:1773851849.273500:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000635cf3d8 count: 3
00000004:00000001:18.0:1773851849.273501:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273501:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273502:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273502:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273502:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273503:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273504:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273505:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273505:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273506:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273506:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273506:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273507:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006da0e849 with handle 0x21b6f08f07a5220c from hash
00010000:00000001:18.0:1773851849.273508:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273508:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273508:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273509:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273509:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273509:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273510:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273510:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273511:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006da0e849/0x21b6f08f07a5220c lrc: 0/0,0 mode: --/PR res: [0x30001e1ab:0x53c4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf430c expref: 767 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273513:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000635cf3d8 count: 3
00010000:00000040:18.0:1773851849.273514:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 689
00000020:00000040:18.0:1773851849.273514:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 766
00010000:00000010:18.0:1773851849.273515:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000bf32f38c.
00010000:00000040:18.0:1773851849.273516:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000635cf3d8 count: 2
00010000:00000001:18.0:1773851849.273516:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273517:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273517:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273517:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d3d8bfab refcount=3
00000020:00000001:18.0:1773851849.273518:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063303002176 : -107010406549440 : ffff9eacb2baf840)
00010000:00000001:18.0:1773851849.273519:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063303002176 : -107010406549440 : ffff9eacb2baf840)
00010000:00000001:18.0:1773851849.273519:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273520:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273520:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x30001e1ab:0x53c4:0x0].0x0 (00000000635cf3d8)
00010000:00000001:18.0:1773851849.273521:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273521:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273522:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273522:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000635cf3d8 count: 1
00010000:00000040:18.0:1773851849.273523:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000006b0984f4 count: 4
00000004:00000001:18.0:1773851849.273524:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273524:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273525:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273525:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273525:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273526:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273527:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273527:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273528:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273529:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273529:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273529:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273530:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d3d8bfab with handle 0x21b6f08f07a50d2f from hash
00010000:00000001:18.0:1773851849.273531:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273531:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273531:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273532:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273532:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273532:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273533:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273533:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273535:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3d8bfab/0x21b6f08f07a50d2f lrc: 0/0,0 mode: --/CR res: [0x2400278ec:0x747d:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf4129 expref: 766 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273537:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000006b0984f4 count: 4
00010000:00000040:18.0:1773851849.273537:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 688
00000020:00000040:18.0:1773851849.273538:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 765
00010000:00000010:18.0:1773851849.273538:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000001fd1689a.
00010000:00000040:18.0:1773851849.273539:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000006b0984f4 count: 3
00010000:00000001:18.0:1773851849.273540:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273540:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273540:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273541:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005a0a3a92 refcount=3
00000020:00000001:18.0:1773851849.273541:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138172207552 : -106935537344064 : ffff9ebe214861c0)
00010000:00000001:18.0:1773851849.273542:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637138172207552 : -106935537344064 : ffff9ebe214861c0)
00010000:00000001:18.0:1773851849.273542:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273543:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273543:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400278ec:0x747d:0x0].0x0 (000000006b0984f4)
00010000:00000001:18.0:1773851849.273544:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273545:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273545:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273546:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000006b0984f4 count: 2
00010000:00000040:18.0:1773851849.273547:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000df6f860b count: 3
00000004:00000001:18.0:1773851849.273547:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273548:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273548:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273549:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273549:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273549:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273551:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273551:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273552:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273552:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273552:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273553:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273553:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000005a0a3a92 with handle 0x21b6f08f07a4e6fc from hash
00010000:00000001:18.0:1773851849.273554:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273555:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273555:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273555:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273556:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273556:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273557:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273557:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273558:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000005a0a3a92/0x21b6f08f07a4e6fc lrc: 0/0,0 mode: --/CR res: [0x240028a78:0x49d2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf4065 expref: 765 pid: 41173 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273560:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000df6f860b count: 3
00010000:00000040:18.0:1773851849.273561:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 687
00000020:00000040:18.0:1773851849.273561:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 764
00010000:00000010:18.0:1773851849.273562:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000054324c2b.
00010000:00000040:18.0:1773851849.273563:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000df6f860b count: 2
00010000:00000001:18.0:1773851849.273563:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273563:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273564:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273564:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f990be19 refcount=3
00000020:00000001:18.0:1773851849.273565:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636988327481856 : -107085382069760 : ffff9e9b3dd75200)
00010000:00000001:18.0:1773851849.273565:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636988327481856 : -107085382069760 : ffff9e9b3dd75200)
00010000:00000001:18.0:1773851849.273566:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273566:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273567:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028a78:0x49d2:0x0].0x0 (00000000df6f860b)
00010000:00000001:18.0:1773851849.273568:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273568:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273569:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273569:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000df6f860b count: 1
00010000:00000040:18.0:1773851849.273570:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000613d6e97 count: 2
00000004:00000001:18.0:1773851849.273571:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000004:00000001:18.0:1773851849.273572:0:154717:0:(mdt_lvb.c:155:mdt_dom_lvbo_update()) Process entered
00000004:00000001:18.0:1773851849.273573:0:154717:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:18.0:1773851849.273574:0:154717:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400261c8:0x15844:0x0]
00000020:00000001:18.0:1773851849.273575:0:154717:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:18.0:1773851849.273577:0:154717:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637015920959784 : -107057788591832 : ffff9ea1aa8a6128)
00000004:00000001:18.0:1773851849.273578:0:154717:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637015920959696 : -107057788591920 : ffff9ea1aa8a60d0)
00000004:00000001:18.0:1773851849.273579:0:154717:0:(mdt_lvb.c:91:mdt_dom_disk_lvbo_update()) Process entered
00000004:00000001:18.0:1773851849.273580:0:154717:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:18.0:1773851849.273583:0:154717:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:18.0:1773851849.273584:0:154717:0:(mdt_lvb.c:140:mdt_dom_disk_lvbo_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:18.0:1773851849.273585:0:154717:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:18.0:1773851849.273586:0:154717:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00010000:00000001:18.0:1773851849.273586:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273587:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273587:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273588:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273588:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273589:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273589:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273590:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273590:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273591:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273591:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273592:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f990be19 with handle 0x21b6f08f037ee92f from hash
00010000:00000001:18.0:1773851849.273593:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273593:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273593:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273594:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273594:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273595:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273595:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273596:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273596:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f990be19/0x21b6f08f037ee92f lrc: 0/0,0 mode: --/PR res: [0x2400261c8:0x15844:0x0].0x0 bits 0x49/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87ce9c4e expref: 764 pid: 61095 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273599:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000613d6e97 count: 2
00010000:00000040:18.0:1773851849.273600:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 686
00000020:00000040:18.0:1773851849.273600:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 763
00010000:00000010:18.0:1773851849.273601:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002264f284.
00010000:00000040:18.0:1773851849.273602:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000613d6e97 count: 1
00010000:00000001:18.0:1773851849.273602:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273603:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273603:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273603:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000004a42b50d refcount=3
00000020:00000001:18.0:1773851849.273604:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942684736 : -106911766866880 : ffff9ec3aa1d1440)
00010000:00000001:18.0:1773851849.273604:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942684736 : -106911766866880 : ffff9ec3aa1d1440)
00010000:00000001:18.0:1773851849.273605:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273606:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273606:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400261c8:0x15844:0x0].0x0 (00000000613d6e97)
00010000:00000001:18.0:1773851849.273607:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273608:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273608:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273609:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000613d6e97 count: 0
00000004:00000010:18.0:1773851849.273610:0:154717:0:(mdt_lvb.c:460:mdt_lvbo_free()) kfreed 'res->lr_lvb_data': 56 at 0000000082f63ffa.
00010000:00000010:18.0:1773851849.273611:0:154717:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000b67d7c83.
00010000:00000040:18.0:1773851849.273612:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000f1ee3779 count: 6
00000004:00000001:18.0:1773851849.273612:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273613:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273613:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273614:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273614:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273615:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273616:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273616:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273617:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273617:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273618:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273618:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273619:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000004a42b50d with handle 0x21b6f08f07a4deba from hash
00010000:00000001:18.0:1773851849.273620:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273620:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273620:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273621:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273621:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273622:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273622:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273623:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273623:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000004a42b50d/0x21b6f08f07a4deba lrc: 0/0,0 mode: --/CR res: [0x240028a99:0xdd5b:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf3c91 expref: 763 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273625:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f1ee3779 count: 6
00010000:00000040:18.0:1773851849.273626:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 685
00000020:00000040:18.0:1773851849.273627:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 762
00010000:00000010:18.0:1773851849.273627:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000025e05eac.
00010000:00000040:18.0:1773851849.273628:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f1ee3779 count: 5
00010000:00000001:18.0:1773851849.273628:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273629:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273629:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273629:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000666b16a refcount=3
00000020:00000001:18.0:1773851849.273630:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117498497216 : -106956211054400 : ffff9eb9510898c0)
00010000:00000001:18.0:1773851849.273631:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637117498497216 : -106956211054400 : ffff9eb9510898c0)
00010000:00000001:18.0:1773851849.273631:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273632:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273632:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028a99:0xdd5b:0x0].0x0 (00000000f1ee3779)
00010000:00000001:18.0:1773851849.273633:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273633:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273634:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273634:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f1ee3779 count: 4
00010000:00000040:18.0:1773851849.273635:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000018b269ad count: 4
00000004:00000001:18.0:1773851849.273635:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273636:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273636:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273637:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273637:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273637:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273639:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273639:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273640:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273641:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273642:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273642:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273643:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000000666b16a with handle 0x21b6f08f07a4dcad from hash
00010000:00000001:18.0:1773851849.273643:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273644:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273644:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273644:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273645:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273645:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273646:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273646:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273647:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000000666b16a/0x21b6f08f07a4dcad lrc: 0/0,0 mode: --/CR res: [0x240028959:0x227a:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf3abc expref: 762 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273649:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000018b269ad count: 4
00010000:00000040:18.0:1773851849.273650:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 684
00000020:00000040:18.0:1773851849.273650:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 761
00010000:00000010:18.0:1773851849.273651:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000933a20a3.
00010000:00000040:18.0:1773851849.273651:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000018b269ad count: 3
00010000:00000001:18.0:1773851849.273652:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273652:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273652:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273653:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000001a3c7d0b refcount=3
00000020:00000001:18.0:1773851849.273653:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166298044032 : -106907411507584 : ffff9ec4adb69680)
00010000:00000001:18.0:1773851849.273654:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166298044032 : -106907411507584 : ffff9ec4adb69680)
00010000:00000001:18.0:1773851849.273655:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273655:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273655:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028959:0x227a:0x0].0x0 (0000000018b269ad)
00010000:00000001:18.0:1773851849.273656:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273657:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273658:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273658:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000018b269ad count: 2
00010000:00000040:18.0:1773851849.273659:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000005e650e9c count: 3
00000004:00000001:18.0:1773851849.273659:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273660:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273661:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273661:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273661:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273662:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273663:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273664:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273664:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273665:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273665:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273666:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273666:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000001a3c7d0b with handle 0x21b6f08f07a4dc8a from hash
00010000:00000001:18.0:1773851849.273667:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273667:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273668:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273668:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273668:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273669:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273669:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273670:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273670:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000001a3c7d0b/0x21b6f08f07a4dc8a lrc: 0/0,0 mode: --/CR res: [0x240028c7f:0x14f7d:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf3a8b expref: 761 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273673:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000005e650e9c count: 3
00010000:00000040:18.0:1773851849.273673:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 683
00000020:00000040:18.0:1773851849.273674:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 760
00010000:00000010:18.0:1773851849.273674:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003b026fc9.
00010000:00000040:18.0:1773851849.273675:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000005e650e9c count: 2
00010000:00000001:18.0:1773851849.273676:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273676:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851849.273676:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851849.273677:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000377d1226 refcount=3
00000020:00000001:18.0:1773851849.273677:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637071917549824 : -107001792001792 : ffff9eaeb4328900)
00010000:00000001:18.0:1773851849.273678:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637071917549824 : -107001792001792 : ffff9eaeb4328900)
00010000:00000001:18.0:1773851849.273679:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273679:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273679:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028c7f:0x14f7d:0x0].0x0 (000000005e650e9c)
00010000:00000001:18.0:1773851849.273680:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273681:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273681:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273682:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000005e650e9c count: 1
00010000:00000040:18.0:1773851849.273683:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000026e6f55b count: 5
00000004:00000001:18.0:1773851849.273683:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851849.273684:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851849.273684:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273684:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851849.273685:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.273686:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273687:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851849.273687:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851849.273688:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273688:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273689:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851849.273689:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851849.273690:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000377d1226 with handle 0x21b6f08f07a4d70b from hash
00010000:00000001:18.0:1773851849.273691:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851849.273691:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851849.273691:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273692:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851849.273692:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851849.273692:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273693:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851849.273693:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851849.273694:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000377d1226/0x21b6f08f07a4d70b lrc: 0/0,0 mode: --/CR res: [0x240024a38:0x10daa:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cf3957 expref: 760 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851849.273696:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000026e6f55b count: 5
00010000:00000040:18.0:1773851849.273697:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f920d659 : new locks_count 682
00000020:00000040:18.0:1773851849.273697:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 759
00010000:00000010:18.0:1773851849.273698:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000051e923a1.
00010000:00000040:18.0:1773851849.273699:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000026e6f55b count: 4
00010000:00000001:18.0:1773851849.273700:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851849.273700:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851849.273700:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851849.273701:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024a38:0x10daa:0x0].0x0 (0000000026e6f55b)
00010000:00000001:18.0:1773851849.273702:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851849.273702:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273703:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851849.273703:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000026e6f55b count: 3
00010000:00010000:18.0:1773851849.273704:0:154717:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:18.0:1773851849.273704:0:154717:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=16 : 16 : 10)
00010000:00000001:18.0:1773851849.273705:0:154717:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851849.273706:0:154717:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851849.273707:0:154717:0:(import.c:1951:at_measured()) add 1 to 000000001a540702 time=553 v=66 (1 1 0 1)
00000100:00000001:18.0:1773851849.273708:0:154717:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851849.273709:0:154717:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000312e3384 refcount 3 to 13874@kfi7
00000100:00000001:18.0:1773851849.273709:0:154717:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232982784 : -107130476568832 : ffff9e90bdffdf00)
02000000:00000001:18.0:1773851849.273710:0:154717:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851849.273711:0:154717:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.273711:0:154717:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851849.273712:0:154717:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13875@kfi7
00000400:00000010:18.0:1773851849.273713:0:154717:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000096a160b6.
00000100:00000200:18.0:1773851849.273714:0:154717:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859599094539520, offset 224
00000400:00000200:18.0:1773851849.273715:0:154717:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13875@kfi7
00000400:00000200:18.0:1773851849.273716:0:154717:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13875@kfi7 to cpt 4
00000400:00000200:18.0:1773851849.273717:0:154717:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006220ff70 nid 13875@kfi7 refs 1
00000400:00000200:18.0:1773851849.273719:0:154717:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006220ff70 nid 13875@kfi7 refs 2
00000400:00000200:18.0:1773851849.273720:0:154717:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006220ff70 nid 13875@kfi7 refs 3
00000400:00000200:18.0:1773851849.273721:0:154717:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13875@kfi7 local destination
00000400:00000200:18.0:1773851849.273723:0:154717:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768409:8768409:1024:4294967295] 13875@kfi7 LPNI seq info [729481:729481:16:4294967295]
00000400:00000200:18.0:1773851849.273724:0:154717:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006220ff70 nid 13875@kfi7 refs 2
00000400:00000200:18.0:1773851849.273731:0:154717:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13875@kfi7 to cpt 4
00000400:00000200:18.0:1773851849.273733:0:154717:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13875@kfi7(13875@kfi7:13875@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851849.273734:0:154717:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006220ff70 nid 13875@kfi7 refs 3
00000800:00000200:18.0:1773851849.273736:0:154717:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851849.273737:0:154717:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851849.273740:0:154717:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851849.273743:0:154717:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c71 Using peer 13875@kfi7(0x100000000000c71)
00000800:00000200:18.0:1773851849.273745:0:154717:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006c9a9e9c: Posted send of 324 bytes to peer 0x100000000000c71: rc=0
00000800:00000200:18.0:1773851849.273747:0:154717:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c71 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851849.273749:0:154717:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851849.273750:0:154717:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000312e3384 refcount 2 to 13874@kfi7
00010000:00000001:18.0:1773851849.273751:0:154717:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851849.273751:0:154717:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851849.273752:0:154717:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009285d8c1 x1859599094539520/t0(0) o103->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:576/0 lens 440/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:18.0:1773851849.273755:0:154717:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009285d8c1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_011:7fc5910d-f170-4eda-bc46-60ec6a7ee835+759:39459:x1859599094539520:12345-13874@kfi7:103: Request processed in 473us (576us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851849.273758:0:154717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13874@kfi7, seq: 38350201
00000100:00000040:18.0:1773851849.273759:0:154717:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f920d659 : new rpc_count 14
00000800:00000200:17.0:1773851849.273759:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c71 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851849.273760:0:154717:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851849.273760:0:154717:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851849.273761:0:154717:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851849.273761:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851849.273762:0:154717:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f73ed6a1.
00000400:00000200:17.0:1773851849.273762:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13875@kfi7: PUT: OK
00000020:00000010:18.0:1773851849.273763:0:154717:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000104bdc31.
00000020:00000040:18.0:1773851849.273763:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 758
00000400:00000200:17.0:1773851849.273763:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000096a160b6
00000400:00000010:17.0:1773851849.273763:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000096a160b6.
00000100:00000001:18.0:1773851849.273764:0:154717:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851849.273764:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851849.273764:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851849.273765:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006220ff70 nid 13875@kfi7 refs 2
00000800:00000200:17.0:1773851849.273767:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13875@kfi7(000000004a231452):0x0 lsk 3186 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c71 Transaction freed
00010000:00000010:18.1F:1773851849.278727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000881e7e6b.
00010000:00000010:18.1:1773851849.278729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000f1b3f465.
00010000:00000010:18.1:1773851849.278730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000028ee2aa1.
00010000:00000010:18.1:1773851849.278731:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000eeff851b.
00010000:00000010:18.1:1773851849.278732:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000a42befff.
00010000:00000010:18.1:1773851849.278733:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000008ebd8b7b.
00010000:00000010:18.1:1773851849.278733:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000088ed58a9.
00010000:00000010:18.1:1773851849.278734:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000075e39480.
00010000:00000010:18.1:1773851849.278734:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c54a356c.
00010000:00000010:18.1:1773851849.278735:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000606bbf2c.
00010000:00000010:18.1:1773851849.278736:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000543103b3.
00010000:00000010:18.1:1773851849.278737:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006da0e849.
00010000:00000010:18.1:1773851849.278737:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d3d8bfab.
00010000:00000010:18.1:1773851849.278738:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000005a0a3a92.
00010000:00000010:18.1:1773851849.278739:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f990be19.
00010000:00000010:18.1:1773851849.278740:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000613d6e97.
00010000:00000010:18.1:1773851849.278740:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000004a42b50d.
00010000:00000010:18.1:1773851849.278741:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000000666b16a.
00010000:00000010:18.1:1773851849.278742:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000001a3c7d0b.
00010000:00000010:18.1:1773851849.278742:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000377d1226.
00000800:00000200:29.0:1773851849.293889:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851849.293889:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851849.293891:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851849.293893:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851849.293895:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.293896:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9585@kfi7 : PUT - for me
00000400:00000200:29.0:1773851849.293897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.293898:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 1
00000400:00000200:29.0:1773851849.293899:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.293900:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000400:00000200:29.0:1773851849.293901:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 3
00000400:00000200:29.0:1773851849.293902:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.293902:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9585@kfi7 of length 224 into portal 12 MB=0x69aa079dc1c80
00000400:00000200:29.0:1773851849.293904:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9585@kfi7 of length 224/224 into md 0x77fe139dd [64] + 156416
00000800:00000200:29.0:1773851849.293905:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851849.293907:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851849.293908:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9585@kfi7: PUT: OK
00000100:00000001:29.0:1773851849.293909:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851849.293910:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851849.293911:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f37fb891.
00000100:00000040:29.0:1773851849.293912:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f37fb891 x1858863890177152 msgsize 224
00000100:00100000:29.0:1773851849.293913:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-9585@kfi7 (source: 12345-9585@kfi7)
00000100:00000001:29.0:1773851849.293914:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851849.293915:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000100:00000001:31.0:1773851849.293916:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851849.293916:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851849.293917:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851849.293917:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851849.293917:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851849.293918:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851849.293919:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890177152
00000020:00000001:31.0:1773851849.293920:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851849.293920:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cf7
00000020:00000001:31.0:1773851849.293921:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851849.293924:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b12b325 refcount=6
00000020:00000001:31.0:1773851849.293924:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395721216 : -107136313830400 : ffff9e8f62125400)
00000020:00000001:31.0:1773851849.293925:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395721216 : -107136313830400 : ffff9e8f62125400)
00000100:00000001:31.0:1773851849.293926:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851849.293927:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851849.293928:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008af9e3b3.
00000020:00000010:31.0:1773851849.293929:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851849.293930:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851849.293930:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851849.293931:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851849.293932:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.293933:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851849.293933:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851849.293934:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.293935:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.293936:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851849.293936:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851849.293937:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851849.293937:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851849.293938:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9585@kfi7, seq: 2055440
00000100:00000040:29.0:1773851849.293938:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b12b325 : new rpc_count 1
00000100:00000001:31.0:1773851849.293939:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.293939:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.293939:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125762082688 : -106947947468928 : ffff9ebb3d94e780)
00000100:00000040:29.0:1773851849.293940:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f37fb891 x1858863890177152/t0(0) o400->af2b1efd-c372-4639-aa69-7d778f8db008@9585@kfi7:637/0 lens 224/0 e 0 to 0 dl 1773851997 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1086-0'
00000100:00000001:29.0:1773851849.293943:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851849.293944:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851849.293945:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f37fb891 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:af2b1efd-c372-4639-aa69-7d778f8db008+6:39118:x1858863890177152:12345-9585@kfi7:400:default-tuolumne1086-0
00000100:00000200:29.0:1773851849.293946:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890177152
00000020:00000001:29.0:1773851849.293947:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851849.293948:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851849.293949:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.293949:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851849.293950:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851849.293951:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851849.293951:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890177152, found 0 last_xid 1858863890177151
00000020:00000001:29.0:1773851849.293952:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851849.293953:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851849.293953:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851849.293954:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.293955:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851849.293955:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851849.293956:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851849.293958:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b92c4ee7.
02000000:00000001:29.0:1773851849.293958:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.293959:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.293960:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851849.293961:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475272608, transno 0, xid 1858863890177152
00010000:00000001:29.0:1773851849.293962:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851849.293963:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f37fb891 x1858863890177152/t0(0) o400->af2b1efd-c372-4639-aa69-7d778f8db008@9585@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1086-0'
00010000:00000001:29.0:1773851849.293965:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851849.293966:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851849.293967:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=82 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851849.293968:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851849.293969:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a8e7c881 refcount 3 to 9585@kfi7
00000100:00000001:29.0:1773851849.293969:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063840 : -107155994487776 : ffff9e8acd035420)
02000000:00000001:29.0:1773851849.293970:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851849.293971:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.293971:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851849.293972:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9585@kfi7
00000400:00000010:29.0:1773851849.293973:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052b8dd85.
00000100:00000200:29.0:1773851849.293974:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890177152, offset 224
00000400:00000200:29.0:1773851849.293976:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9585@kfi7
00000400:00000200:29.0:1773851849.293976:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.293977:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 1
00000400:00000200:29.0:1773851849.293978:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000400:00000200:29.0:1773851849.293979:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 3
00000400:00000200:29.0:1773851849.293981:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9585@kfi7 local destination
00000400:00000200:29.0:1773851849.293982:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768410:8768410:1024:4294967295] 9585@kfi7 LPNI seq info [17388:17388:16:4294967295]
00000400:00000200:29.0:1773851849.293983:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000400:00000200:29.0:1773851849.293984:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.293986:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9585@kfi7(9585@kfi7:9585@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851849.293987:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 3
00000800:00000200:29.0:1773851849.293989:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851849.293990:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851849.293992:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851849.293995:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000745 Using peer 9585@kfi7(0x100000000000745)
00000800:00000200:29.0:1773851849.293998:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x100000000000745: rc=0
00000800:00000200:29.0:1773851849.293999:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000745 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851849.294001:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851849.294002:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a8e7c881 refcount 2 to 9585@kfi7
00010000:00000001:29.0:1773851849.294003:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851849.294003:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.294004:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851849.294005:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f37fb891 x1858863890177152/t0(0) o400->af2b1efd-c372-4639-aa69-7d778f8db008@9585@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1086-0'
00000100:00100000:29.0:1773851849.294008:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f37fb891 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:af2b1efd-c372-4639-aa69-7d778f8db008+6:39118:x1858863890177152:12345-9585@kfi7:400:default-tuolumne1086-0 Request processed in 64us (95us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851849.294010:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9585@kfi7, seq: 2055440
00000100:00000040:29.0:1773851849.294011:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b12b325 : new rpc_count 0
00000100:00000001:29.0:1773851849.294012:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:30.0:1773851849.294013:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000745 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851849.294013:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851849.294013:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:29.0:1773851849.294014:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000400:00000200:30.0:1773851849.294015:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851849.294015:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008af9e3b3.
00000400:00000200:30.0:1773851849.294016:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9585@kfi7: PUT: OK
00000020:00000040:29.0:1773851849.294016:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000004b12b325 : new refcount 5
00000400:00000200:30.0:1773851849.294017:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052b8dd85
00000400:00000010:30.0:1773851849.294017:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052b8dd85.
00000100:00000001:29.0:1773851849.294017:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851849.294018:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851849.294018:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851849.294019:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000800:00000200:30.0:1773851849.294021:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 9585@kfi7(000000005af2f46b):0x0 lsk 1862 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000745 Transaction freed
00000800:00000200:25.0:1773851849.299986:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851849.299987:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851849.299988:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851849.299990:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851849.299992:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.299993:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9200@kfi7 : PUT - for me
00000400:00000200:25.0:1773851849.299993:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.299994:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 1
00000400:00000200:25.0:1773851849.299995:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.299995:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000400:00000200:25.0:1773851849.299996:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 3
00000400:00000200:25.0:1773851849.299997:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9009@kfi7 to cpt 7
00000400:00000200:25.0:1773851849.299998:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9009@kfi7 of length 224 into portal 12 MB=0x69b4b853b3f80
00000400:00000200:25.0:1773851849.299999:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9009@kfi7 of length 224/224 into md 0x16159c6179 [64] + 176768
00000800:00000200:25.0:1773851849.300000:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851849.300001:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851849.300002:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9200@kfi7: PUT: OK
00000100:00000001:25.0:1773851849.300003:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851849.300003:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851849.300005:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bbc4c3a8.
00000100:00000040:25.0:1773851849.300005:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bbc4c3a8 x1859598520369024 msgsize 224
00000100:00100000:25.0:1773851849.300007:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9009@kfi7 (source: 12345-9200@kfi7)
00000100:00000001:25.0:1773851849.300007:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851849.300008:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000100:00000001:26.0:1773851849.300009:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851849.300010:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851849.300010:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851849.300010:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851849.300010:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851849.300011:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851849.300012:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598520369024
00000020:00000001:26.0:1773851849.300012:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851849.300013:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e7513d
00000020:00000001:26.0:1773851849.300013:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851849.300014:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c9e6effb refcount=827
00000020:00000001:26.0:1773851849.300015:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637094908804096 : -106978800747520 : ffff9eb40e953c00)
00000020:00000001:26.0:1773851849.300015:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637094908804096 : -106978800747520 : ffff9eb40e953c00)
00000100:00000001:26.0:1773851849.300016:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.300017:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851849.300017:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b7c3de4.
00000020:00000010:26.0:1773851849.300018:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.300020:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851849.300020:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851849.300020:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851849.300021:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.300022:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851849.300022:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851849.300023:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.300023:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.300024:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851849.300025:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851849.300025:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851849.300025:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851849.300026:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9009@kfi7, seq: 2025032
00000100:00000040:26.0:1773851849.300026:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c9e6effb : new rpc_count 9
00000100:00000001:26.0:1773851849.300027:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128409131136 : -106945300420480 : ffff9ebbdb5ba880)
00000100:00000001:24.0:1773851849.300027:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851849.300027:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.300028:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bbc4c3a8 x1859598520369024/t0(0) o400->a127bbd7-a764-414e-9307-5d5c66e02d5b@9009@kfi7:35/0 lens 224/0 e 0 to 0 dl 1773852150 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1053-0'
00000100:00000001:26.0:1773851849.300030:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.300031:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851849.300032:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbc4c3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a127bbd7-a764-414e-9307-5d5c66e02d5b+827:39490:x1859598520369024:12345-9009@kfi7:400:default-tuolumne1053-0
00000100:00000200:26.0:1773851849.300033:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598520369024
00000020:00000001:26.0:1773851849.300033:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851849.300034:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851849.300034:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.300035:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851849.300035:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851849.300036:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851849.300036:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598520369024, found 0 last_xid 1859598443219199
00000020:00000001:26.0:1773851849.300037:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851849.300038:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851849.300038:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851849.300039:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.300039:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851849.300040:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851849.300040:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851849.300041:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001febf1e2.
02000000:00000001:26.0:1773851849.300042:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.300043:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.300043:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851849.300044:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592093, transno 0, xid 1859598520369024
00010000:00000001:26.0:1773851849.300045:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851849.300046:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bbc4c3a8 x1859598520369024/t0(0) o400->a127bbd7-a764-414e-9307-5d5c66e02d5b@9009@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1053-0'
00010000:00000001:26.0:1773851849.300048:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851849.300049:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851849.300049:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=82 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851849.300050:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851849.300051:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a56392fb refcount 3 to 9009@kfi7
00000100:00000001:26.0:1773851849.300052:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869935072 : -107137839616544 : ffff9e8f0720ade0)
02000000:00000001:26.0:1773851849.300053:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851849.300053:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.300054:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851849.300055:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9200@kfi7
00000400:00000010:26.0:1773851849.300055:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027bbb058.
00000100:00000200:26.0:1773851849.300056:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598520369024, offset 224
00000400:00000200:26.0:1773851849.300057:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9200@kfi7
00000400:00000200:26.0:1773851849.300058:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.300059:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 1
00000400:00000200:26.0:1773851849.300060:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000400:00000200:26.0:1773851849.300061:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 3
00000400:00000200:26.0:1773851849.300062:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9200@kfi7 local destination
00000400:00000200:26.0:1773851849.300064:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768411:8768411:1024:4294967295] 9200@kfi7 LPNI seq info [1853261:1853261:16:4294967295]
00000400:00000200:26.0:1773851849.300065:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000400:00000200:26.0:1773851849.300066:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.300068:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9200@kfi7(9200@kfi7:9200@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851849.300069:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 3
00000800:00000200:26.0:1773851849.300070:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.300072:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851849.300074:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851849.300076:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10f8 Using peer 9200@kfi7(0x10f8)
00000800:00000200:26.0:1773851849.300079:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0x10f8: rc=0
00000800:00000200:26.0:1773851849.300081:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10f8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851849.300083:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.300084:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a56392fb refcount 2 to 9009@kfi7
00010000:00000001:26.0:1773851849.300084:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851849.300085:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.300086:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851849.300086:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bbc4c3a8 x1859598520369024/t0(0) o400->a127bbd7-a764-414e-9307-5d5c66e02d5b@9009@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1053-0'
00000100:00100000:26.0:1773851849.300089:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbc4c3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a127bbd7-a764-414e-9307-5d5c66e02d5b+827:39490:x1859598520369024:12345-9009@kfi7:400:default-tuolumne1053-0 Request processed in 58us (83us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851849.300091:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9009@kfi7, seq: 2025032
00000100:00000040:26.0:1773851849.300092:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c9e6effb : new rpc_count 8
00000100:00000001:26.0:1773851849.300093:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851849.300093:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851849.300093:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10f8 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851849.300094:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851849.300094:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851849.300095:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851849.300095:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b7c3de4.
00000400:00000200:25.0:1773851849.300095:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9200@kfi7: PUT: OK
00000020:00000040:26.0:1773851849.300096:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c9e6effb : new refcount 826
00000400:00000200:25.0:1773851849.300096:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027bbb058
00000100:00000001:26.0:1773851849.300097:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851849.300097:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027bbb058.
00000100:00000001:25.0:1773851849.300097:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851849.300098:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851849.300099:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000800:00000200:25.0:1773851849.300100:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 9200@kfi7(00000000e0e005db):0x0 lsk 4345 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10f8 Transaction freed
00000800:00000200:25.0:1773851849.306808:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851849.306809:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851849.306810:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851849.306812:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851849.306814:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.306815:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24353@kfi7 : PUT - for me
00000400:00000200:25.0:1773851849.306816:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.306816:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 1
00000400:00000200:25.0:1773851849.306817:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.306818:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000400:00000200:25.0:1773851849.306818:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 3
00000400:00000200:25.0:1773851849.306819:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851849.306820:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24353@kfi7 of length 224 into portal 12 MB=0x69b4628545780
00000400:00000200:25.0:1773851849.306821:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24353@kfi7 of length 224/224 into md 0x16159c6179 [64] + 176992
00000800:00000200:25.0:1773851849.306823:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851849.306824:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851849.306825:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24353@kfi7: PUT: OK
00000100:00000001:25.0:1773851849.306826:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851849.306826:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851849.306827:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b9614c8c.
00000100:00000040:25.0:1773851849.306827:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b9614c8c x1859575486896000 msgsize 224
00000100:00100000:25.0:1773851849.306828:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24353@kfi7 (source: 12345-24353@kfi7)
00000100:00000001:25.0:1773851849.306830:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851849.306830:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000100:00000001:26.0:1773851849.306831:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851849.306832:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851849.306832:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851849.306832:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851849.306832:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851849.306833:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851849.306834:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575486896000
00000020:00000001:26.0:1773851849.306834:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851849.306834:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc3bf901b
00000020:00000001:26.0:1773851849.306835:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851849.306836:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d6f534bb refcount=10
00000020:00000001:26.0:1773851849.306836:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637093615878144 : -106980093673472 : ffff9eb3c184c000)
00000020:00000001:26.0:1773851849.306837:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637093615878144 : -106980093673472 : ffff9eb3c184c000)
00000100:00000001:26.0:1773851849.306838:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.306839:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851849.306839:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b7c3de4.
00000020:00000010:26.0:1773851849.306840:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.306841:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851849.306841:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851849.306841:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851849.306842:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.306842:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851849.306843:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851849.306843:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.306844:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.306845:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851849.306845:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851849.306846:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24353@kfi7, seq: 2025033
00000100:00000001:24.0:1773851849.306846:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851849.306846:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851849.306847:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d6f534bb : new rpc_count 3
00000100:00000001:24.0:1773851849.306847:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.306848:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128409127680 : -106945300423936 : ffff9ebbdb5b9b00)
00000100:00000040:26.0:1773851849.306848:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b9614c8c x1859575486896000/t0(0) o400->2d96c80e-450f-42db-9d68-0d1939aa6dd1@24353@kfi7:35/0 lens 224/0 e 0 to 0 dl 1773852150 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2015-0'
00000100:00000001:24.0:1773851849.306848:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.306851:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.306851:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851849.306852:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9614c8c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2d96c80e-450f-42db-9d68-0d1939aa6dd1+10:39684:x1859575486896000:12345-24353@kfi7:400:default-tuolumne2015-0
00000100:00000200:26.0:1773851849.306853:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575486896000
00000020:00000001:26.0:1773851849.306853:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851849.306854:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851849.306855:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.306855:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851849.306855:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851849.306856:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851849.306857:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575486896000, found 0 last_xid 1859575486329151
00000020:00000001:26.0:1773851849.306857:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851849.306858:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851849.306858:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851849.306859:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.306859:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851849.306860:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851849.306860:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851849.306861:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000005e9bf30.
02000000:00000001:26.0:1773851849.306861:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.306862:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.306862:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851849.306863:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264505322, transno 0, xid 1859575486896000
00010000:00000001:26.0:1773851849.306864:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851849.306864:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b9614c8c x1859575486896000/t0(0) o400->2d96c80e-450f-42db-9d68-0d1939aa6dd1@24353@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2015-0'
00010000:00000001:26.0:1773851849.306867:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851849.306867:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851849.306868:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=82 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851849.306869:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851849.306869:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c59b57ea refcount 3 to 24353@kfi7
00000100:00000001:26.0:1773851849.306870:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419840 : -107156724131776 : ffff9e8aa185d840)
02000000:00000001:26.0:1773851849.306871:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851849.306871:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.306872:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851849.306872:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24353@kfi7
00000400:00000010:26.0:1773851849.306873:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a08fe443.
00000100:00000200:26.0:1773851849.306874:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575486896000, offset 224
00000400:00000200:26.0:1773851849.306875:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24353@kfi7
00000400:00000200:26.0:1773851849.306876:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.306876:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 1
00000400:00000200:26.0:1773851849.306877:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000400:00000200:26.0:1773851849.306878:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 3
00000400:00000200:26.0:1773851849.306879:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24353@kfi7 local destination
00000400:00000200:26.0:1773851849.306881:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768412:8768412:1024:4294967295] 24353@kfi7 LPNI seq info [518090:518090:16:4294967295]
00000400:00000200:26.0:1773851849.306882:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000400:00000200:26.0:1773851849.306882:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.306884:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24353@kfi7(24353@kfi7:24353@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851849.306885:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 3
00000800:00000200:26.0:1773851849.306886:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.306887:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851849.306889:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851849.306891:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000966 Using peer 24353@kfi7(0x100000000000966)
00000800:00000200:26.0:1773851849.306893:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 324 bytes to peer 0x100000000000966: rc=0
00000800:00000200:26.0:1773851849.306894:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000966 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851849.306896:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.306897:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c59b57ea refcount 2 to 24353@kfi7
00010000:00000001:26.0:1773851849.306897:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851849.306897:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.306898:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851849.306898:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b9614c8c x1859575486896000/t0(0) o400->2d96c80e-450f-42db-9d68-0d1939aa6dd1@24353@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2015-0'
00000100:00100000:26.0:1773851849.306901:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9614c8c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2d96c80e-450f-42db-9d68-0d1939aa6dd1+10:39684:x1859575486896000:12345-24353@kfi7:400:default-tuolumne2015-0 Request processed in 49us (73us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851849.306903:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24353@kfi7, seq: 2025033
00000100:00000040:26.0:1773851849.306903:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d6f534bb : new rpc_count 2
00000100:00000001:26.0:1773851849.306904:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851849.306905:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851849.306905:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.306905:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851849.306906:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b7c3de4.
00000020:00000040:26.0:1773851849.306906:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000d6f534bb : new refcount 9
00000800:00000200:25.0:1773851849.306906:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000966 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851849.306907:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851849.306908:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851849.306909:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24353@kfi7: PUT: OK
00000400:00000200:25.0:1773851849.306909:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a08fe443
00000400:00000010:25.0:1773851849.306910:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a08fe443.
00000100:00000001:25.0:1773851849.306910:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851849.306911:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851849.306911:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000800:00000200:25.0:1773851849.306913:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 24353@kfi7(00000000a5526302):0x0 lsk 2407 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000966 Transaction freed
00000800:00000200:21.0:1773851849.312419:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851849.312421:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851849.312423:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851849.312427:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851849.312430:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10930@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.312432:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10930@kfi7 : PUT - for me
00000400:00000200:21.0:1773851849.312434:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10930@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.312435:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007fd3722 nid 10930@kfi7 refs 1
00000400:00000200:21.0:1773851849.312437:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10930@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.312438:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007fd3722 nid 10930@kfi7 refs 2
00000400:00000200:21.0:1773851849.312439:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007fd3722 nid 10930@kfi7 refs 3
00000400:00000200:21.0:1773851849.312441:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10867@kfi7 to cpt 4
00000400:00000200:21.0:1773851849.312442:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10867@kfi7 of length 224 into portal 12 MB=0x69b563ef2b180
00000400:00000200:21.0:1773851849.312445:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10867@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 19552
00000800:00000200:21.0:1773851849.312448:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851849.312450:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851849.312452:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10930@kfi7: PUT: OK
00000100:00000001:21.0:1773851849.312454:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851849.312454:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851849.312456:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009a1bc855.
00000100:00000040:21.0:1773851849.312457:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009a1bc855 x1859644585849216 msgsize 224
00000100:00100000:21.0:1773851849.312459:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-10867@kfi7 (source: 12345-10930@kfi7)
00000100:00000001:21.0:1773851849.312460:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851849.312462:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007fd3722 nid 10930@kfi7 refs 2
00000100:00000001:22.0:1773851849.312463:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851849.312464:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851849.312464:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851849.312465:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851849.312466:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851849.312467:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851849.312468:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859644585849216
00000020:00000001:22.0:1773851849.312469:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851849.312470:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07fcc9e2228
00000020:00000001:22.0:1773851849.312470:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851849.312474:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000042a48808 refcount=5
00000020:00000001:22.0:1773851849.312475:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148937019392 : -106924772532224 : ffff9ec0a2ea6000)
00000020:00000001:22.0:1773851849.312477:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148937019392 : -106924772532224 : ffff9ec0a2ea6000)
00000100:00000001:22.0:1773851849.312478:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851849.312479:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851849.312480:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000247a55a4.
00000020:00000010:22.0:1773851849.312482:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851849.312483:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d08ac1b6.
00000100:00000001:22.0:1773851849.312485:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851849.312486:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851849.312487:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851849.312488:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851849.312489:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851849.312489:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.312491:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851849.312493:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851849.312494:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851849.312494:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851849.312495:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851849.312495:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10867@kfi7, seq: 1997908
00000100:00000001:23.0:1773851849.312497:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851849.312497:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000042a48808 : new rpc_count 1
00000100:00000001:23.0:1773851849.312498:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.312498:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117335936 : -106995592215680 : ffff9eb025bbc380)
00000100:00000040:22.0:1773851849.312500:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009a1bc855 x1859644585849216/t0(0) o400->6310648f-13f0-4c64-b7ff-37db3addf14e@10867@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1162-0'
00000100:00000001:22.0:1773851849.312504:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851849.312505:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851849.312507:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a1bc855 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:6310648f-13f0-4c64-b7ff-37db3addf14e+5:39556:x1859644585849216:12345-10867@kfi7:400:default-tuolumne1162-0
00000100:00000200:22.0:1773851849.312508:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859644585849216
00000020:00000001:22.0:1773851849.312509:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851849.312510:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851849.312511:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.312512:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851849.312513:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851849.312514:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851849.312515:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859644585849216, found 0 last_xid 1859644585849215
00000020:00000001:22.0:1773851849.312516:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851849.312517:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851849.312518:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851849.312519:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.312520:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851849.312521:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851849.312522:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851849.312522:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007f911b50.
02000000:00000001:22.0:1773851849.312524:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.312525:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.312526:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851849.312527:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096683842, transno 0, xid 1859644585849216
00010000:00000001:22.0:1773851849.312528:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851849.312529:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009a1bc855 x1859644585849216/t0(0) o400->6310648f-13f0-4c64-b7ff-37db3addf14e@10867@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1162-0'
00010000:00000001:22.0:1773851849.312533:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851849.312534:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851849.312535:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=82 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851849.312537:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851849.312538:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000074a2eafb refcount 3 to 10867@kfi7
00000100:00000001:22.0:1773851849.312539:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992032 : -107142345559584 : ffff9e8dfa8d71e0)
02000000:00000001:22.0:1773851849.312540:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851849.312541:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.312542:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851849.312543:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10930@kfi7
00000400:00000010:22.0:1773851849.312544:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d078057.
00000100:00000200:22.0:1773851849.312545:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859644585849216, offset 224
00000400:00000200:22.0:1773851849.312548:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10930@kfi7
00000400:00000200:22.0:1773851849.312549:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10930@kfi7 to cpt 5
00000400:00000200:22.0:1773851849.312550:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007fd3722 nid 10930@kfi7 refs 1
00000400:00000200:22.0:1773851849.312552:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007fd3722 nid 10930@kfi7 refs 2
00000400:00000200:22.0:1773851849.312554:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007fd3722 nid 10930@kfi7 refs 3
00000400:00000200:22.0:1773851849.312556:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10930@kfi7 local destination
00000400:00000200:22.0:1773851849.312558:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768413:8768413:1024:4294967295] 10930@kfi7 LPNI seq info [280091:280091:16:4294967295]
00000400:00000200:22.0:1773851849.312560:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007fd3722 nid 10930@kfi7 refs 2
00000400:00000200:22.0:1773851849.312561:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10930@kfi7 to cpt 5
00000400:00000200:22.0:1773851849.312564:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10930@kfi7(10930@kfi7:10930@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851849.312566:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007fd3722 nid 10930@kfi7 refs 3
00000800:00000200:22.0:1773851849.312569:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851849.312570:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851849.312574:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851849.312578:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc10 Using peer 10930@kfi7(0xc10)
00000800:00000200:22.0:1773851849.312582:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000008ad6e841: Posted send of 324 bytes to peer 0xc10: rc=0
00000800:00000200:22.0:1773851849.312585:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc10 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851849.312588:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851849.312589:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000074a2eafb refcount 2 to 10867@kfi7
00010000:00000001:22.0:1773851849.312590:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851849.312591:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.312592:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851849.312593:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009a1bc855 x1859644585849216/t0(0) o400->6310648f-13f0-4c64-b7ff-37db3addf14e@10867@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1162-0'
00000100:00100000:22.0:1773851849.312598:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a1bc855 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:6310648f-13f0-4c64-b7ff-37db3addf14e+5:39556:x1859644585849216:12345-10867@kfi7:400:default-tuolumne1162-0 Request processed in 92us (140us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851849.312599:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc10 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851849.312601:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10867@kfi7, seq: 1997908
00000100:00000040:22.0:1773851849.312602:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000042a48808 : new rpc_count 0
00000400:00000200:21.0:1773851849.312602:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851849.312603:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851849.312604:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851849.312604:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10930@kfi7: PUT: OK
00000020:00000010:22.0:1773851849.312605:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851849.312605:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d078057
00000400:00000010:21.0:1773851849.312605:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d078057.
00000020:00000010:22.0:1773851849.312606:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d08ac1b6.
00000100:00000001:21.0:1773851849.312606:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:22.0:1773851849.312607:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000247a55a4.
00000100:00000001:21.0:1773851849.312607:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851849.312608:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007fd3722 nid 10930@kfi7 refs 2
00000020:00000040:22.0:1773851849.312609:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000042a48808 : new refcount 4
00000100:00000001:22.0:1773851849.312610:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851849.312611:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 10930@kfi7(00000000a95269cc):0x0 lsk 3089 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc10 Transaction freed
00000800:00000200:25.0:1773851849.315679:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.315680:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.315681:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851849.315681:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851849.315682:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851849.315683:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851849.315685:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851849.315685:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8658@kfi7(00000000cc7e802d):0x125c version: 2; local version 2; negotiated version: 2
00000400:00000200:26.0:1773851849.315687:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000800:00000200:25.0:1773851849.315688:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c Using peer 8658@kfi7(0x125c)
00000400:00000200:26.0:1773851849.315690:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8658@kfi7 : PUT - for me
00000400:00000200:25.0:1773851849.315691:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.315693:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.315694:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000400:00000200:26.0:1773851849.315695:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000800:00000200:25.0:1773851849.315695:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x125c: rc=0
00000400:00000200:26.0:1773851849.315696:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000800:00000200:25.0:1773851849.315697:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851849.315698:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:26.0:1773851849.315700:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.315701:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8658@kfi7 of length 224 into portal 12 MB=0x69b2fd4bf4dc0
00000400:00000200:26.0:1773851849.315704:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8658@kfi7 of length 224/224 into md 0x16159c6179 [64] + 177216
00000800:00000200:26.0:1773851849.315709:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851849.315711:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851849.315712:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851849.315714:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8658@kfi7: PUT: OK
00000100:00000001:26.0:1773851849.315716:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:25.0:1773851849.315716:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c Transaction freed
00000100:00000200:26.0:1773851849.315717:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851849.315719:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ee8342d1.
00000100:00000040:26.0:1773851849.315721:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000ee8342d1 x1859479595339200 msgsize 224
00000100:00100000:26.0:1773851849.315724:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-8658@kfi7 (source: 12345-8658@kfi7)
00000100:00000001:26.0:1773851849.315731:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851849.315733:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000800:00000200:26.0:1773851849.315736:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851849.315742:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851849.315743:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851849.315744:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851849.315745:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851849.315746:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851849.315748:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479595339200
00000020:00000001:26.0:1773851849.315749:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851849.315749:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2fc9a
00000020:00000001:26.0:1773851849.315750:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851849.315752:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef161c6c refcount=8
00000020:00000001:26.0:1773851849.315753:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000020:00000001:26.0:1773851849.315754:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000100:00000001:26.0:1773851849.315756:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.315757:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851849.315758:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851849.315760:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.315761:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851849.315763:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851849.315763:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851849.315764:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.315766:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851849.315767:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851849.315767:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.315769:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.315771:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851849.315772:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851849.315772:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851849.315773:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851849.315774:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8658@kfi7, seq: 2025034
00000100:00000040:26.0:1773851849.315775:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef161c6c : new rpc_count 1
00000100:00000001:24.0:1773851849.315775:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.315776:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538627072 : -106958170924544 : ffff9eb8dc375a00)
00000100:00000001:24.0:1773851849.315777:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.315778:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ee8342d1 x1859479595339200/t0(0) o400->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:35/0 lens 224/0 e 0 to 0 dl 1773852150 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1029-0'
00000100:00000001:26.0:1773851849.315784:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.315785:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851849.315787:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee8342d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:39973:x1859479595339200:12345-8658@kfi7:400:default-tuolumne1029-0
00000100:00000200:26.0:1773851849.315789:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479595339200
00000020:00000001:26.0:1773851849.315790:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851849.315791:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851849.315792:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.315793:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851849.315794:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851849.315795:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851849.315796:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479595339200, found 0 last_xid 1859479595339199
00000020:00000001:26.0:1773851849.315798:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851849.315799:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851849.315800:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851849.315801:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.315802:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851849.315803:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851849.315803:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851849.315805:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eb31c54c.
02000000:00000001:26.0:1773851849.315806:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.315807:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.315808:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851849.315809:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106902121, transno 0, xid 1859479595339200
00010000:00000001:26.0:1773851849.315811:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851849.315812:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ee8342d1 x1859479595339200/t0(0) o400->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1029-0'
00010000:00000001:26.0:1773851849.315816:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851849.315817:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851849.315819:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=82 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851849.315821:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851849.315822:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d208fb4 refcount 3 to 8658@kfi7
00000100:00000001:26.0:1773851849.315823:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637098420265536 : -106975289286080 : ffff9eb4dfe1e240)
02000000:00000001:26.0:1773851849.315825:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851849.315825:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.315827:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851849.315828:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8658@kfi7
00000400:00000010:26.0:1773851849.315829:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1589030.
00000100:00000200:26.0:1773851849.315830:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859479595339200, offset 224
00000400:00000200:26.0:1773851849.315833:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8658@kfi7
00000400:00000200:26.0:1773851849.315834:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.315836:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000400:00000200:26.0:1773851849.315837:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:26.0:1773851849.315839:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:26.0:1773851849.315841:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8658@kfi7 local destination
00000400:00000200:26.0:1773851849.315843:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768414:8768414:1024:4294967295] 8658@kfi7 LPNI seq info [4888388:4888388:16:4294967295]
00000400:00000200:26.0:1773851849.315846:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:26.0:1773851849.315847:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.315851:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8658@kfi7(8658@kfi7:8658@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851849.315853:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000800:00000200:26.0:1773851849.315855:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.315857:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851849.315861:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851849.315865:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c Using peer 8658@kfi7(0x125c)
00000800:00000200:26.0:1773851849.315870:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001c682e34: Posted send of 324 bytes to peer 0x125c: rc=0
00000800:00000200:26.0:1773851849.315872:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851849.315876:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.315877:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d208fb4 refcount 2 to 8658@kfi7
00010000:00000001:26.0:1773851849.315879:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851849.315879:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.315881:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851849.315882:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ee8342d1 x1859479595339200/t0(0) o400->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1029-0'
00000800:00000200:25.0:1773851849.315887:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851849.315888:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee8342d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:39973:x1859479595339200:12345-8658@kfi7:400:default-tuolumne1029-0 Request processed in 102us (166us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851849.315892:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8658@kfi7, seq: 2025034
00000100:00000040:26.0:1773851849.315893:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef161c6c : new rpc_count 0
00000100:00000001:26.0:1773851849.315895:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851849.315895:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851849.315895:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851849.315896:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851849.315897:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8658@kfi7: PUT: OK
00000020:00000010:26.0:1773851849.315898:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000400:00000200:25.0:1773851849.315898:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1589030
00000020:00000010:26.0:1773851849.315899:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000400:00000010:25.0:1773851849.315899:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1589030.
00000020:00000040:26.0:1773851849.315900:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 7
00000100:00000001:25.0:1773851849.315900:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851849.315901:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:26.0:1773851849.315902:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851849.315903:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000800:00000200:25.0:1773851849.315905:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8658@kfi7(00000000cc7e802d):0x0 lsk 4701 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x125c Transaction freed
00000800:00000200:17.0:1773851849.392974:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.392975:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.392977:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.392979:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.392981:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9728@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.392982:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9728@kfi7 : PUT - for me
00000400:00000200:17.0:1773851849.392983:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9728@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.392984:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b303ec54 nid 9728@kfi7 refs 1
00000400:00000200:17.0:1773851849.392985:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9728@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.392985:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b303ec54 nid 9728@kfi7 refs 2
00000400:00000200:17.0:1773851849.392987:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b303ec54 nid 9728@kfi7 refs 3
00000400:00000200:17.0:1773851849.392987:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9920@kfi7 to cpt 6
00000400:00000200:17.0:1773851849.392988:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9920@kfi7 of length 224 into portal 12 MB=0x69b4bdb7fb640
00000400:00000200:17.0:1773851849.392989:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9920@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 184120
00000800:00000200:17.0:1773851849.392991:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.392993:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.392994:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9728@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.392995:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.392995:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.392996:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076b20839.
00000100:00000040:17.0:1773851849.392997:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000076b20839 x1859599967696448 msgsize 224
00000100:00100000:17.0:1773851849.392998:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9920@kfi7 (source: 12345-9728@kfi7)
00000100:00000001:17.0:1773851849.392999:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.393000:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b303ec54 nid 9728@kfi7 refs 2
00000100:00000001:19.0:1773851849.393001:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851849.393001:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851849.393001:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851849.393002:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851849.393002:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851849.393003:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851849.393003:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599967696448
00000020:00000001:19.0:1773851849.393004:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851849.393004:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79cf8
00000020:00000001:19.0:1773851849.393005:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851849.393009:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000020d557c5 refcount=280
00000020:00000001:19.0:1773851849.393009:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637040582517760 : -107033127033856 : ffff9ea7687be400)
00000020:00000001:19.0:1773851849.393010:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637040582517760 : -107033127033856 : ffff9ea7687be400)
00000100:00000001:19.0:1773851849.393011:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.393012:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851849.393012:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b6c87683.
00000020:00000010:19.0:1773851849.393013:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.393014:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851849.393015:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851849.393015:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851849.393016:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.393017:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851849.393017:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851849.393017:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.393018:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.393019:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851849.393020:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851849.393020:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851849.393020:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851849.393021:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9920@kfi7, seq: 2156238
00000100:00000040:19.0:1773851849.393021:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000020d557c5 : new rpc_count 3
00000100:00000001:18.0:1773851849.393021:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.393022:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131864481664 : -106941845069952 : ffff9ebca9501f80)
00000100:00000001:18.0:1773851849.393022:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.393023:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000076b20839 x1859599967696448/t0(0) o400->384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2@9920@kfi7:637/0 lens 224/0 e 0 to 0 dl 1773851997 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1107-0'
00000100:00000001:19.0:1773851849.393025:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.393025:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851849.393026:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076b20839 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2+280:39671:x1859599967696448:12345-9920@kfi7:400:default-tuolumne1107-0
00000100:00000200:19.0:1773851849.393028:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599967696448
00000020:00000001:19.0:1773851849.393028:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851849.393029:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851849.393029:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.393030:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851849.393030:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851849.393031:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851849.393032:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599967696448, found 0 last_xid 1859599824447103
00000020:00000001:19.0:1773851849.393032:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851849.393033:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851849.393033:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851849.393034:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.393034:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851849.393035:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851849.393035:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851849.393036:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fdcbf452.
02000000:00000001:19.0:1773851849.393037:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.393037:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.393038:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851849.393038:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592423, transno 0, xid 1859599967696448
00010000:00000001:19.0:1773851849.393039:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851849.393040:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000076b20839 x1859599967696448/t0(0) o400->384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2@9920@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1107-0'
00010000:00000001:19.0:1773851849.393042:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851849.393042:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851849.393043:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=82 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851849.393044:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851849.393045:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000014734729 refcount 3 to 9920@kfi7
00000100:00000001:19.0:1773851849.393045:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420608 : -107156724131008 : ffff9e8aa185db40)
02000000:00000001:19.0:1773851849.393046:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851849.393047:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.393047:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851849.393048:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9728@kfi7
00000400:00000010:19.0:1773851849.393049:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000067d0f432.
00000100:00000200:19.0:1773851849.393049:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599967696448, offset 224
00000400:00000200:19.0:1773851849.393051:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9728@kfi7
00000400:00000200:19.0:1773851849.393052:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9728@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.393052:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b303ec54 nid 9728@kfi7 refs 1
00000400:00000200:19.0:1773851849.393053:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b303ec54 nid 9728@kfi7 refs 2
00000400:00000200:19.0:1773851849.393054:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b303ec54 nid 9728@kfi7 refs 3
00000400:00000200:19.0:1773851849.393056:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9728@kfi7 local destination
00000400:00000200:19.0:1773851849.393057:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768415:8768415:1024:4294967295] 9728@kfi7 LPNI seq info [11094978:11094978:16:4294967295]
00000400:00000200:19.0:1773851849.393058:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b303ec54 nid 9728@kfi7 refs 2
00000400:00000200:19.0:1773851849.393059:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9728@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.393061:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9728@kfi7(9728@kfi7:9728@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851849.393062:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b303ec54 nid 9728@kfi7 refs 3
00000800:00000200:19.0:1773851849.393063:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851849.393064:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851849.393066:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851849.393068:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf9a Using peer 9728@kfi7(0xf9a)
00000800:00000200:19.0:1773851849.393071:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0xf9a: rc=0
00000800:00000200:19.0:1773851849.393072:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf9a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851849.393074:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.393075:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000014734729 refcount 2 to 9920@kfi7
00010000:00000001:19.0:1773851849.393075:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851849.393076:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.393076:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851849.393077:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000076b20839 x1859599967696448/t0(0) o400->384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2@9920@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1107-0'
00000100:00100000:19.0:1773851849.393080:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076b20839 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2+280:39671:x1859599967696448:12345-9920@kfi7:400:default-tuolumne1107-0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851849.393082:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9920@kfi7, seq: 2156238
00000100:00000040:19.0:1773851849.393083:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000020d557c5 : new rpc_count 2
00000100:00000001:19.0:1773851849.393083:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851849.393084:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851849.393084:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.393085:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000020:00000010:19.0:1773851849.393085:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b6c87683.
00000020:00000040:19.0:1773851849.393086:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000020d557c5 : new refcount 279
00000800:00000200:17.0:1773851849.393086:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf9a TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851849.393087:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851849.393087:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.393088:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9728@kfi7: PUT: OK
00000400:00000200:17.0:1773851849.393089:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000067d0f432
00000400:00000010:17.0:1773851849.393089:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000067d0f432.
00000100:00000001:17.0:1773851849.393090:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851849.393090:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851849.393091:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b303ec54 nid 9728@kfi7 refs 2
00000800:00000200:17.0:1773851849.393092:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 9728@kfi7(00000000bed647a3):0x0 lsk 3995 rsk 21 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf9a Transaction freed
00000800:00000200:17.0:1773851849.454787:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.454788:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.454789:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.454790:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.454792:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.454793:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22787@kfi7 : PUT - for me
00000400:00000200:17.0:1773851849.454794:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.454794:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 1
00000400:00000200:17.0:1773851849.454795:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.454796:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000400:00000200:17.0:1773851849.454796:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 3
00000400:00000200:17.0:1773851849.454797:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22979@kfi7 to cpt 7
00000400:00000200:17.0:1773851849.454798:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22979@kfi7 of length 224 into portal 12 MB=0x699e0a31be340
00000400:00000200:17.0:1773851849.454798:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22979@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 184344
00000800:00000200:17.0:1773851849.454800:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.454801:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.454802:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22787@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.454802:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.454803:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.454803:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000915cf614.
00000100:00000040:17.0:1773851849.454804:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000915cf614 x1858039948501824 msgsize 224
00000100:00100000:17.0:1773851849.454805:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22979@kfi7 (source: 12345-22787@kfi7)
00000100:00000001:17.0:1773851849.454806:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.454806:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000100:00000001:19.0:1773851849.454807:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851849.454807:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851849.454808:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851849.454808:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851849.454808:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851849.454809:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851849.454809:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039948501824
00000020:00000001:19.0:1773851849.454810:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851849.454810:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ada
00000020:00000001:19.0:1773851849.454810:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851849.454812:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007dd85248 refcount=6
00000020:00000001:19.0:1773851849.454813:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743681024 : -107128965870592 : ffff9e91180b4c00)
00000020:00000001:19.0:1773851849.454813:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743681024 : -107128965870592 : ffff9e91180b4c00)
00000100:00000001:19.0:1773851849.454814:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.454815:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851849.454815:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5d5268b.
00000020:00000010:19.0:1773851849.454816:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.454816:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851849.454817:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851849.454817:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851849.454817:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.454818:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851849.454818:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851849.454819:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.454819:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.454820:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851849.454820:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851849.454821:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22979@kfi7, seq: 2156239
00000100:00000001:18.0:1773851849.454821:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851849.454821:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851849.454822:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007dd85248 : new rpc_count 1
00000100:00000001:19.0:1773851849.454822:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131864474752 : -106941845076864 : ffff9ebca9500480)
00000100:00000001:18.0:1773851849.454822:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.454822:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.454823:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000915cf614 x1858039948501824/t0(0) o400->7d8ce497-db29-470b-93e2-7eb1ef517947@22979@kfi7:39/0 lens 224/0 e 0 to 0 dl 1773852154 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1927-0'
00000100:00000001:19.0:1773851849.454826:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.454826:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851849.454827:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000915cf614 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7d8ce497-db29-470b-93e2-7eb1ef517947+6:39690:x1858039948501824:12345-22979@kfi7:400:default-tuolumne1927-0
00000100:00000200:19.0:1773851849.454828:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039948501824
00000020:00000001:19.0:1773851849.454829:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851849.454829:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851849.454829:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.454830:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851849.454831:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851849.454831:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851849.454832:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039948501824, found 0 last_xid 1858039948501823
00000020:00000001:19.0:1773851849.454832:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851849.454833:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851849.454833:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851849.454834:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.454834:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851849.454835:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851849.454835:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851849.454836:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ade6baf1.
02000000:00000001:19.0:1773851849.454836:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.454837:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.454837:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851849.454838:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668605953, transno 0, xid 1858039948501824
00010000:00000001:19.0:1773851849.454838:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851849.454839:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000915cf614 x1858039948501824/t0(0) o400->7d8ce497-db29-470b-93e2-7eb1ef517947@22979@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1927-0'
00010000:00000001:19.0:1773851849.454841:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851849.454842:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851849.454842:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=82 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851849.454843:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851849.454844:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c20b8d6d refcount 3 to 22979@kfi7
00000100:00000001:19.0:1773851849.454844:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064896 : -107155994486720 : ffff9e8acd035840)
02000000:00000001:19.0:1773851849.454845:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851849.454846:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.454846:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851849.454847:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22787@kfi7
00000400:00000010:19.0:1773851849.454847:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7998b6f.
00000100:00000200:19.0:1773851849.454848:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039948501824, offset 224
00000400:00000200:19.0:1773851849.454849:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22787@kfi7
00000400:00000200:19.0:1773851849.454850:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.454851:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 1
00000400:00000200:19.0:1773851849.454851:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000400:00000200:19.0:1773851849.454852:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 3
00000400:00000200:19.0:1773851849.454853:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22787@kfi7 local destination
00000400:00000200:19.0:1773851849.454855:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768416:8768416:1024:4294967295] 22787@kfi7 LPNI seq info [82428:82428:16:4294967295]
00000400:00000200:19.0:1773851849.454856:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000400:00000200:19.0:1773851849.454857:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.454858:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22787@kfi7(22787@kfi7:22787@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851849.454860:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 3
00000800:00000200:19.0:1773851849.454861:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851849.454862:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851849.454864:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851849.454866:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xafa Using peer 22787@kfi7(0xafa)
00000800:00000200:19.0:1773851849.454869:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0xafa: rc=0
00000800:00000200:19.0:1773851849.454870:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xafa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851849.454872:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.454872:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c20b8d6d refcount 2 to 22979@kfi7
00010000:00000001:19.0:1773851849.454873:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851849.454873:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.454874:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851849.454875:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000915cf614 x1858039948501824/t0(0) o400->7d8ce497-db29-470b-93e2-7eb1ef517947@22979@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1927-0'
00000100:00100000:19.0:1773851849.454878:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000915cf614 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7d8ce497-db29-470b-93e2-7eb1ef517947+6:39690:x1858039948501824:12345-22979@kfi7:400:default-tuolumne1927-0 Request processed in 51us (73us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851849.454880:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22979@kfi7, seq: 2156239
00000100:00000040:19.0:1773851849.454880:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007dd85248 : new rpc_count 0
00000100:00000001:19.0:1773851849.454881:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851849.454881:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851849.454881:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xafa TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851849.454882:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.454882:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000020:00000010:19.0:1773851849.454883:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5d5268b.
00000400:00000200:17.0:1773851849.454883:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:19.0:1773851849.454884:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007dd85248 : new refcount 5
00000100:00000001:19.0:1773851849.454884:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851849.454884:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22787@kfi7: PUT: OK
00000400:00000200:17.0:1773851849.454884:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7998b6f
00000400:00000010:17.0:1773851849.454885:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7998b6f.
00000100:00000001:17.0:1773851849.454885:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851849.454885:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851849.454886:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000800:00000200:17.0:1773851849.454887:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 22787@kfi7(00000000b1c9d4f1):0x0 lsk 2811 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xafa Transaction freed
00000800:00000200:17.0:1773851849.489791:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.489791:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.489792:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.489794:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.489795:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14587@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.489796:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14587@kfi7 : PUT - for me
00000400:00000200:17.0:1773851849.489797:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14587@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.489798:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c61bdd2 nid 14587@kfi7 refs 1
00000400:00000200:17.0:1773851849.489799:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14587@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.489800:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c61bdd2 nid 14587@kfi7 refs 2
00000400:00000200:17.0:1773851849.489800:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001c61bdd2 nid 14587@kfi7 refs 3
00000400:00000200:17.0:1773851849.489801:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:17.0:1773851849.489802:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14586@kfi7 of length 224 into portal 12 MB=0x699de8d2b1d80
00000400:00000200:17.0:1773851849.489802:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14586@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 184568
00000800:00000200:17.0:1773851849.489804:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.489805:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.489806:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14587@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.489807:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.489808:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.489808:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000778e9f55.
00000100:00000040:17.0:1773851849.489809:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000778e9f55 x1858030990466432 msgsize 224
00000100:00100000:17.0:1773851849.489810:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14586@kfi7 (source: 12345-14587@kfi7)
00000100:00000001:17.0:1773851849.489811:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.489811:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001c61bdd2 nid 14587@kfi7 refs 2
00000100:00000001:19.0:1773851849.489812:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851849.489812:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851849.489812:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851849.489813:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851849.489813:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851849.489814:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851849.489814:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030990466432
00000020:00000001:19.0:1773851849.489815:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851849.489815:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9102a
00000020:00000001:19.0:1773851849.489816:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851849.489821:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f2844070 refcount=6
00000020:00000001:19.0:1773851849.489821:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240099840 : -107152469451776 : ffff9e8b9f1f1c00)
00000020:00000001:19.0:1773851849.489822:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240099840 : -107152469451776 : ffff9e8b9f1f1c00)
00000100:00000001:19.0:1773851849.489823:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.489824:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851849.489825:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5d5268b.
00000020:00000010:19.0:1773851849.489825:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.489826:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851849.489826:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851849.489827:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851849.489827:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.489828:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851849.489828:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851849.489828:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.489829:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.489830:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851849.489830:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851849.489830:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851849.489831:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14586@kfi7, seq: 2156240
00000100:00000001:18.0:1773851849.489831:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851849.489832:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f2844070 : new rpc_count 1
00000100:00000001:19.0:1773851849.489832:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131864493184 : -106941845058432 : ffff9ebca9504c80)
00000100:00000001:18.0:1773851849.489832:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.489832:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.489833:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000778e9f55 x1858030990466432/t0(0) o400->31f05efb-19ec-4279-9939-59a9e638739c@14586@kfi7:489/0 lens 224/0 e 0 to 0 dl 1773852604 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne225-0'
00000100:00000001:19.0:1773851849.489836:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.489836:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851849.489837:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000778e9f55 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:31f05efb-19ec-4279-9939-59a9e638739c+6:47860:x1858030990466432:12345-14586@kfi7:400:default-tuolumne225-0
00000100:00000200:19.0:1773851849.489838:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030990466432
00000020:00000001:19.0:1773851849.489839:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851849.489839:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851849.489840:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.489840:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851849.489841:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851849.489841:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851849.489842:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030990466432, found 0 last_xid 1858030990466431
00000020:00000001:19.0:1773851849.489843:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851849.489843:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851849.489844:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851849.489844:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.489844:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851849.489845:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851849.489845:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851849.489846:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aaef15b5.
02000000:00000001:19.0:1773851849.489846:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.489847:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.489847:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851849.489848:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030990466432
00010000:00000001:19.0:1773851849.489849:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851849.489849:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000778e9f55 x1858030990466432/t0(0) o400->31f05efb-19ec-4279-9939-59a9e638739c@14586@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne225-0'
00010000:00000001:19.0:1773851849.489852:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851849.489852:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851849.489854:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=82 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851849.489854:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851849.489855:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce33b24b refcount 5 to 14586@kfi7
00000100:00000001:19.0:1773851849.489856:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545859072 : -107154163692544 : ffff9e8b3a230c00)
02000000:00000001:19.0:1773851849.489856:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851849.489857:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.489857:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851849.489858:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14587@kfi7
00000400:00000010:19.0:1773851849.489859:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e88f2542.
00000100:00000200:19.0:1773851849.489859:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030990466432, offset 224
00000400:00000200:19.0:1773851849.489860:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14587@kfi7
00000400:00000200:19.0:1773851849.489861:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14587@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.489862:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c61bdd2 nid 14587@kfi7 refs 1
00000400:00000200:19.0:1773851849.489863:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001c61bdd2 nid 14587@kfi7 refs 2
00000400:00000200:19.0:1773851849.489864:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001c61bdd2 nid 14587@kfi7 refs 3
00000400:00000200:19.0:1773851849.489865:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14587@kfi7 local destination
00000400:00000200:19.0:1773851849.489866:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768417:8768417:1024:4294967295] 14587@kfi7 LPNI seq info [28004:28004:16:4294967295]
00000400:00000200:19.0:1773851849.489867:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001c61bdd2 nid 14587@kfi7 refs 2
00000400:00000200:19.0:1773851849.489867:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14587@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.489869:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14587@kfi7(14587@kfi7:14587@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851849.489870:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001c61bdd2 nid 14587@kfi7 refs 3
00000800:00000200:19.0:1773851849.489872:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851849.489872:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851849.489874:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851849.489876:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfe9 Using peer 14587@kfi7(0xfe9)
00000800:00000200:19.0:1773851849.489879:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0xfe9: rc=0
00000800:00000200:19.0:1773851849.489880:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfe9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851849.489884:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.489885:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce33b24b refcount 4 to 14586@kfi7
00010000:00000001:19.0:1773851849.489886:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851849.489886:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.489886:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851849.489887:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000778e9f55 x1858030990466432/t0(0) o400->31f05efb-19ec-4279-9939-59a9e638739c@14586@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne225-0'
00000100:00100000:19.0:1773851849.489890:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000778e9f55 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:31f05efb-19ec-4279-9939-59a9e638739c+6:47860:x1858030990466432:12345-14586@kfi7:400:default-tuolumne225-0 Request processed in 53us (81us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851849.489892:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14586@kfi7, seq: 2156240
00000100:00000040:19.0:1773851849.489893:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f2844070 : new rpc_count 0
00000800:00000200:17.0:1773851849.489893:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfe9 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851849.489894:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851849.489894:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851849.489894:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851849.489895:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.489895:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000400:00000200:17.0:1773851849.489895:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14587@kfi7: PUT: OK
00000400:00000200:17.0:1773851849.489895:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e88f2542
00000020:00000010:19.0:1773851849.489896:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5d5268b.
00000020:00000040:19.0:1773851849.489896:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000f2844070 : new refcount 5
00000400:00000010:17.0:1773851849.489896:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e88f2542.
00000100:00000001:17.0:1773851849.489896:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851849.489897:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851849.489897:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851849.489897:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001c61bdd2 nid 14587@kfi7 refs 2
00000800:00000200:17.0:1773851849.489898:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 14587@kfi7(00000000f3cb39f2):0x0 lsk 4074 rsk 84 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfe9 Transaction freed
00000800:00000200:1.0:1773851849.513588:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.513589:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851849.513591:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851849.513593:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851849.513595:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.513597:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25346@kfi7 : PUT - for me
00000400:00000200:1.0:1773851849.513597:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.513599:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:1.0:1773851849.513600:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.513601:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:1.0:1773851849.513602:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:1.0:1773851849.513603:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.513604:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 576 into portal 12 MB=0x69a1b65e01e80
00000400:00000200:1.0:1773851849.513605:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25346@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 3360
00000800:00000200:1.0:1773851849.513607:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851849.513609:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851849.513610:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25346@kfi7: PUT: OK
00000100:00000001:1.0:1773851849.513611:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851849.513611:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851849.513612:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c086d1f.
00000100:00000040:1.0:1773851849.513613:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000001c086d1f x1858292324245120 msgsize 576
00000100:00100000:1.0:1773851849.513614:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25346@kfi7)
00000100:00000001:1.0:1773851849.513615:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:2.0:1773851849.513616:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:1.0:1773851849.513616:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
02000000:00000001:2.0:1773851849.513617:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851849.513617:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851849.513618:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851849.513618:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:2.0:1773851849.513619:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851849.513619:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324245120
00000020:00000001:2.0:1773851849.513620:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851849.513620:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000020:00000001:2.0:1773851849.513621:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.513623:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=10
00000020:00000001:2.0:1773851849.513624:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000020:00000001:2.0:1773851849.513624:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000100:00000001:2.0:1773851849.513625:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851849.513626:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851849.513626:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009abda479.
00000020:00000010:2.0:1773851849.513627:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851849.513628:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ebfb08ad.
00000100:00000001:2.0:1773851849.513629:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851849.513629:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:2.0:1773851849.513630:0:42868:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:2.0:1773851849.513630:0:42868:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.513631:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.513632:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.513633:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.513634:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851849.513634:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851849.513634:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851849.513635:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851849.513636:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 408701469
00000100:00000040:2.0:1773851849.513637:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 1
00000100:00000001:2.0:1773851849.513637:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114618894848 : -106959090656768 : ffff9eb8a5655a00)
00000100:00000001:1.0:1773851849.513637:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.513637:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.513638:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c086d1f x1858292324245120/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 576/0 e 0 to 0 dl 1773851936 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833448332813667328'
00000100:00000001:2.0:1773851849.513641:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851849.513641:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851849.513642:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c086d1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4fec6715-7b94-4677-aa38-bf65c6472a0a+10:1591361:x1858292324245120:12345-25346@kfi7:101:tuolumne-833448332813667328
00000100:00000200:2.0:1773851849.513643:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324245120
00000020:00000001:2.0:1773851849.513644:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851849.513644:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851849.513645:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.513646:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851849.513646:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:2.0:1773851849.513647:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851849.513647:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858292324245120, found 0 last_xid 1858292324245119
00000020:00000001:2.0:1773851849.513648:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851849.513648:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851849.513649:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851849.513649:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.513650:0:42868:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:2.0:1773851849.513651:0:42868:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:2.0:1773851849.513651:0:42868:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:2.0:1773851849.513652:0:42868:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:2.0:1773851849.513652:0:42868:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.513655:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851849.513657:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008c3bb33b count: 21
00010000:00000001:2.0:1773851849.513658:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.513659:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.513660:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000d651f136.
00000020:00000001:2.0:1773851849.513661:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.513661:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000d651f136 with handle 0x21b6f08f07a6ac2e to hash
00000020:00000001:2.0:1773851849.513662:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.513663:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637096459085952 : -106977250465664 : ffff9eb46afca880)
00010000:00000010:2.0:1773851849.513664:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000795a147f.
00010000:00000001:2.0:1773851849.513665:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637096459085952 : -106977250465664 : ffff9eb46afca880)
00010000:00010000:2.0:1773851849.513666:0:42868:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000d651f136/0x21b6f08f07a6ac2e lrc: 2/0,0 mode: --/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd114cfd214afd5f expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513669:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 21
00010000:00000040:2.0:1773851849.513670:0:42868:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ffc3dfaf : new locks_count 5
00000020:00000040:2.0:1773851849.513671:0:42868:0:(genops.c:871:class_export_get()) GET export 00000000ffc3dfaf refcount=11
00010000:00000001:2.0:1773851849.513673:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:2.0:1773851849.513674:0:42868:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:2.0:1773851849.513675:0:42868:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:2.0:1773851849.513675:0:42868:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:2.0:1773851849.513676:0:42868:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:2.0:1773851849.513677:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851849.513677:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240013d14:0xb:0x0]
00000020:00000001:2.0:1773851849.513678:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:2.0:1773851849.513680:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637113210907896 : -106960498643720 : ffff9eb851792cf8)
00000004:00000001:2.0:1773851849.513681:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637113210907808 : -106960498643808 : ffff9eb851792ca0)
00000004:00000001:2.0:1773851849.513682:0:42868:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513682:0:42868:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:2.0:1773851849.513683:0:42868:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:2.0:1773851849.513683:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851849.513684:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851849.513685:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000b92f369c.
02000000:00000001:2.0:1773851849.513686:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.513686:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513687:0:42868:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513687:0:42868:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:2.0:1773851849.513688:0:42868:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:2.0:1773851849.513689:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.513690:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.513691:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.513691:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.513692:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.513692:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.513693:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.513693:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.513694:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.513694:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
02000000:00000001:2.0:1773851849.513695:0:42868:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:2.0:1773851849.513696:0:42868:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637111293937920 : -106962415613696 : ffff9eb7df368900)
00000004:00000001:2.0:1773851849.513697:0:42868:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:2.0:1773851849.513697:0:42868:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.513698:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.513698:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513698:0:42868:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:2.0:1773851849.513699:0:42868:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513700:0:42868:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:2.0:1773851849.513701:0:42868:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x240013d14:0xb:0x0]/na, ldlm_rep = 0000000001266f04
00000004:00000001:2.0:1773851849.513702:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:2.0:1773851849.513703:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:2.0:1773851849.513703:0:42868:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:2.0:1773851849.513704:0:42868:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:2.0:1773851849.513705:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.513705:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851849.513705:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.513706:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.513707:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.513707:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000fd1025e2.
00000020:00000001:2.0:1773851849.513707:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.513708:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000fd1025e2 with handle 0x21b6f08f07a6ac35 to hash
00000020:00000001:2.0:1773851849.513709:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.513709:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637096459083072 : -106977250468544 : ffff9eb46afc9d40)
00010000:00000010:2.0:1773851849.513709:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a1f16a1c.
00010000:00000001:2.0:1773851849.513710:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637096459083072 : -106977250468544 : ffff9eb46afc9d40)
00010000:00000001:2.0:1773851849.513711:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.513711:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.513712:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 3/1,0 mode: --/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x0/0x0 rrc: 23 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513718:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.513718:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.513719:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.513720:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.513721:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.513722:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513722:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.513723:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513724:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.513724:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.513730:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.513731:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.513731:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240013d14:0xb:0x0].0x0 (000000008c3bb33b) refcount = 22
00010000:00000040:2.0:1773851849.513732:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851849.513734:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bb42e53/0x21b6f08f07a6a6fc lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25344@kfi7 remote: 0xc2f4b565992771c8 expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513736:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513737:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099d0e3d2/0x21b6f08f07a6a69a lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25857@kfi7 remote: 0x67ad6c07d46ccba1 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513739:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513741:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6000cf7/0x21b6f08f07a6a638 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25811@kfi7 remote: 0x852786f6c6fb3129 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513742:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513744:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c2a8da2/0x21b6f08f07a6a5d6 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 26003@kfi7 remote: 0xd2845bd3ebcaa799 expref: 8 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513746:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513747:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095301483/0x21b6f08f07a6a574 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25234@kfi7 remote: 0x15722d0a1e061f41 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513752:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513753:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e44ff38/0x21b6f08f07a6a4e8 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25955@kfi7 remote: 0x1eaea03265ab6c2b expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513755:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513756:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb9a7b3/0x21b6f08f07a6a486 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25651@kfi7 remote: 0xf59cb3f75528840e expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513759:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513760:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a0238eb/0x21b6f08f07a6a401 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25523@kfi7 remote: 0x55d9da689ceec0d5 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513762:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513763:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e81d5d0/0x21b6f08f07a6a313 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afcda expref: 11 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513765:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513766:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b98e03c0/0x21b6f08f07a6a295 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25697@kfi7 remote: 0x8a2d120cd21bdfb0 expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513768:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513769:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071921dde/0x21b6f08f07a6a1ed lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25776@kfi7 remote: 0x979753abbfa0d893 expref: 8 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513771:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513772:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080a4f76d/0x21b6f08f07a6a16f lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x10/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 25457@kfi7 remote: 0x72480a5c17042aa0 expref: 8 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513774:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513776:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000011a69c4/0x21b6f08f07a663cd lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x20/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262dc85d6 expref: 907 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513781:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513782:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e66573c6/0x21b6f08f07a582bc lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x20/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba48fa65 expref: 904 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513784:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513785:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f1225f8d/0x21b6f08f07a57866 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x20/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6c7b65 expref: 904 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513787:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513788:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a39a77b4/0x21b6f08f07a663bf lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x12/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262dc85cf expref: 907 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513790:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513791:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044bb8b69/0x21b6f08f07a5b686 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x12/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787b528 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513793:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513794:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036068ed7/0x21b6f08e329f6eb2 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x12/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e494476 expref: 904 pid: 61089 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513796:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513797:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc4e445c/0x21b6f08d219c6be7 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x12/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.159@o2ib600 remote: 0x989cacccf625f937 expref: 566 pid: 60791 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513799:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000040:2.0:1773851849.513800:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ebb86e3d/0x21b6f08b916a02f1 lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0x0 bits 0x12/0x0 rrc: 23 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb365cc5e expref: 904 pid: 41173 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513802:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00010000:2.0:1773851849.513803:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 3/1,0 mode: CR/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513805:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.513805:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.513806:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.513807:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.513807:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.513808:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513808:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.513809:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.513810:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.513811:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.513811:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 3/1,0 mode: CR/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513813:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.513814:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851849.513814:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.513815:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.513815:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.513815:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:2.0:1773851849.513816:0:42868:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000000017e741.
00010000:00000010:2.0:1773851849.513817:0:42868:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000c1bdad60.
00010000:00000001:2.0:1773851849.513818:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.513819:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000327b941a.
00000020:00000001:2.0:1773851849.513819:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.513820:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000327b941a with handle 0x21b6f08f07a6ac3c to hash
00000020:00000001:2.0:1773851849.513820:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.513820:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000010:2.0:1773851849.513821:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000026012d57.
00010000:00000001:2.0:1773851849.513822:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000001:2.0:1773851849.513822:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.513823:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.513823:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 3/1,0 mode: --/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513826:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.513826:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.513827:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.513827:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.513827:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.513828:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513828:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.513828:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513829:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.513829:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.513830:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.513830:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.513830:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240013d14:0xb:0x0].0xc465951e (000000000017e741) refcount = 1
00010000:00010000:2.0:1773851849.513831:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 3/1,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513833:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.513833:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.513834:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.513834:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.513835:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.513835:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513835:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.513836:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.513836:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.513837:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.513837:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 3/1,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513839:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.513840:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851849.513840:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.513840:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.513843:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.513843:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.513844:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000327b941a refcount=3
00000020:00000001:2.0:1773851849.513844:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000001:2.0:1773851849.513845:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000001:2.0:1773851849.513846:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.513846:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.513846:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513847:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513848:0:42868:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:2.0:1773851849.513858:0:42868:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:2.0:1773851849.513859:0:42868:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:2.0:1773851849.513860:0:42868:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.513861:0:42868:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:2.0:1773851849.513866:0:42868:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:2.0:1773851849.513867:0:42868:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:2.0:1773851849.513868:0:42868:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:2.0:1773851849.513868:0:42868:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:2.0:1773851849.513869:0:42868:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:2.0:1773851849.513870:0:42868:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:2.0:1773851849.513870:0:42868:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.513871:0:42868:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:2.0:1773851849.513872:0:42868:0:(osd_index.c:979:osd_remote_fid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.513872:0:42868:0:(osd_index.c:554:osd_zfs_consistency_check()) Process entered
00080000:00000001:2.0:1773851849.513873:0:42868:0:(osd_oi.c:669:osd_fid_lookup()) Process entered
00080000:00000001:2.0:1773851849.513874:0:42868:0:(osd_oi.c:360:fid_is_on_ost()) Process entered
80000000:00000001:2.0:1773851849.513874:0:42868:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:2.0:1773851849.513874:0:42868:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:2.0:1773851849.513875:0:42868:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:2.0:1773851849.513875:0:42868:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.513876:0:42868:0:(osd_oi.c:389:fid_is_on_ost()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.513887:0:42868:0:(osd_oi.c:706:osd_fid_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.513888:0:42868:0:(osd_index.c:582:osd_zfs_consistency_check()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:2.0:1773851849.513889:0:42868:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513890:0:42868:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513890:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851849.513891:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002615b:0x12392:0x0]
00000020:00000001:2.0:1773851849.513891:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:2.0:1773851849.513892:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637097005971992 : -106976703579624 : ffff9eb48b957a18)
00000004:00000001:2.0:1773851849.513893:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637097005971904 : -106976703579712 : ffff9eb48b9579c0)
00000004:00000001:2.0:1773851849.513894:0:42868:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:2.0:1773851849.513895:0:42868:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:2.0:1773851849.513901:0:42868:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:2.0:1773851849.513902:0:42868:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:2.0:1773851849.513903:0:42868:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513904:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:2.0:1773851849.513904:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:2.0:1773851849.513904:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.513905:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851849.513906:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000021f43f2a count: 13
00010000:00000001:2.0:1773851849.513906:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.513907:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.513907:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000028397a70.
00000020:00000001:2.0:1773851849.513908:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.513908:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000028397a70 with handle 0x21b6f08f07a6ac43 to hash
00000020:00000001:2.0:1773851849.513909:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.513909:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000010:2.0:1773851849.513910:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000001c5f17f1.
00010000:00000001:2.0:1773851849.513910:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000001:2.0:1773851849.513911:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.513911:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.513912:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000028397a70/0x21b6f08f07a6ac43 lrc: 3/1,0 mode: --/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513914:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000001:2.0:1773851849.513914:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.513915:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.513915:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.513915:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.513916:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513916:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.513917:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513918:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.513918:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.513918:0:42868:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.513919:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.513919:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002615b:0x12392:0x0].0x0 (0000000021f43f2a) refcount = 13
00010000:00000040:2.0:1773851849.513920:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851849.513921:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b0b4f41/0x21b6f08f07a6a718 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25344@kfi7 remote: 0xc2f4b565992771cf expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513923:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513924:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cf9f54a3/0x21b6f08f07a6a6b6 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25857@kfi7 remote: 0x67ad6c07d46ccba8 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513926:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513926:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010d70c79/0x21b6f08f07a6a654 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25811@kfi7 remote: 0x852786f6c6fb3130 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513928:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513929:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bae939c2/0x21b6f08f07a6a5f2 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 26003@kfi7 remote: 0xd2845bd3ebcaa7a0 expref: 8 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513931:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513932:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ade770aa/0x21b6f08f07a6a590 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25234@kfi7 remote: 0x15722d0a1e061f48 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513934:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513935:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030cd5d51/0x21b6f08f07a6a504 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25955@kfi7 remote: 0x1eaea03265ab6c32 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513937:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513938:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd251db4/0x21b6f08f07a6a4a2 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25651@kfi7 remote: 0xf59cb3f755288415 expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513942:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513943:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d2265b/0x21b6f08f07a6a41d lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25523@kfi7 remote: 0x55d9da689ceec0dc expref: 10 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513945:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513946:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8a2ebb5/0x21b6f08f07a6a32f lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afce1 expref: 11 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513947:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513949:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000053251a31/0x21b6f08f07a6a2b1 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25697@kfi7 remote: 0x8a2d120cd21bdfb7 expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513950:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513952:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc5f27b3/0x21b6f08f07a6a209 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25776@kfi7 remote: 0x979753abbfa0d89a expref: 8 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513953:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.513954:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097ca6def/0x21b6f08f07a6a18b lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25457@kfi7 remote: 0x72480a5c17042aa7 expref: 8 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513956:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00010000:2.0:1773851849.513956:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000028397a70/0x21b6f08f07a6ac43 lrc: 3/1,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513958:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000001:2.0:1773851849.513959:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.513959:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.513960:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.513960:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.513960:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.513961:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.513962:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.513962:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.513963:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.513964:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000028397a70/0x21b6f08f07a6ac43 lrc: 3/1,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.513966:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000001:2.0:1773851849.513966:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851849.513967:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.513967:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.513967:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.513968:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.513968:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028397a70 refcount=3
00000020:00000001:2.0:1773851849.513969:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000001:2.0:1773851849.513970:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000001:2.0:1773851849.513970:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.513971:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.513971:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513972:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513972:0:42868:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:2.0:1773851849.513974:0:42868:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:2.0:1773851849.513974:0:42868:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:2.0:1773851849.513975:0:42868:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513976:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851849.513978:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.513979:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.513981:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.513982:0:42868:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.513982:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.513983:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851849.513983:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.513984:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.513984:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=48 : 48 : 30)
00000004:00000001:2.0:1773851849.513985:0:42868:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=48 : 48 : 30)
00000004:00000001:2.0:1773851849.513986:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=48 : 48 : 30)
00000004:00000002:2.0:1773851849.513986:0:42868:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x101 ma_lmm=0000000000000000
00000004:00000001:2.0:1773851849.513988:0:42868:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.513989:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.513989:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.513990:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.513990:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.513991:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.513991:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.513992:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.513992:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:2.0:1773851849.513993:0:42868:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002615b:0x12392:0x0]: nlink=10, mode=40700, valid=0x1100000000002f8f
00000004:00200000:2.0:1773851849.513995:0:42868:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002615b:0x12392:0x0]: returning size 29184
00000004:00200000:2.0:1773851849.513996:0:42868:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 6
00000004:00000002:2.0:1773851849.513996:0:42868:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:2.0:1773851849.513997:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.513997:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.513998:0:42868:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:2.0:1773851849.513999:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851849.513999:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514000:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514000:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514001:0:42868:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514002:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514003:0:42868:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.514004:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000010:2.0:1773851849.514007:0:42868:0:(lprocfs_status.c:1166:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 960 at 00000000595cd4c8 (tot 253200771).
00000020:00000001:2.0:1773851849.514008:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514009:0:42868:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514011:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514011:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514011:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028397a70 refcount=3
00000020:00000001:2.0:1773851849.514012:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000001:2.0:1773851849.514013:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00000004:00010000:2.0:1773851849.514014:0:42868:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 0000000028397a70/0x21b6f08f07a6ac43 lrc: 3/1,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514016:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000001:2.0:1773851849.514017:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514017:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514018:0:42868:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:2.0:1773851849.514019:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:2.0:1773851849.514019:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000abcbc5d2/00000000fed94e34 to site lru. bkt: 000000001a4bd291
00000004:00000001:2.0:1773851849.514020:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851849.514021:0:42868:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:2.0:1773851849.514021:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:2.0:1773851849.514022:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514022:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514023:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fd1025e2 refcount=3
00000020:00000001:2.0:1773851849.514023:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459083072 : -106977250468544 : ffff9eb46afc9d40)
00010000:00000001:2.0:1773851849.514024:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459083072 : -106977250468544 : ffff9eb46afc9d40)
00010000:00000001:2.0:1773851849.514025:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:2.0:1773851849.514025:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 3/1,0 mode: CR/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514028:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.514029:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514029:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.514029:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 2/0,0 mode: CR/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514032:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.514032:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514033:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514033:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:2.0:1773851849.514034:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 3/0,0 mode: CR/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514036:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00010000:2.0:1773851849.514037:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000fd1025e2 already unused, calling callback (000000001690cbe4)
00000004:00000001:2.0:1773851849.514038:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:2.0:1773851849.514039:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:2.0:1773851849.514040:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 3/0,0 mode: CR/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514042:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.514043:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:2.0:1773851849.514043:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514044:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514044:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fd1025e2 refcount=4
00000020:00000001:2.0:1773851849.514045:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459083072 : -106977250468544 : ffff9eb46afc9d40)
00010000:00000001:2.0:1773851849.514045:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459083072 : -106977250468544 : ffff9eb46afc9d40)
00010000:00000001:2.0:1773851849.514046:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:2.0:1773851849.514047:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 4/0,0 mode: CR/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514049:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.514050:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:2.0:1773851849.514051:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:2.0:1773851849.514051:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514052:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:2.0:1773851849.514053:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.514053:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514053:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.514054:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000fd1025e2 with handle 0x21b6f08f07a6ac35 from hash
00010000:00000001:2.0:1773851849.514055:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.514055:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514056:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514056:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:2.0:1773851849.514057:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.514057:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514058:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:2.0:1773851849.514059:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.514059:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.514060:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240013d14:0xb:0x0].0x0 (000000008c3bb33b)
00010000:00010000:2.0:1773851849.514061:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:2.0:1773851849.514062:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514063:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514064:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.514064:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:2.0:1773851849.514065:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514066:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514066:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514067:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514068:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514068:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 2/0,0 mode: --/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514070:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000001:2.0:1773851849.514071:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514071:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514072:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:2.0:1773851849.514072:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:2.0:1773851849.514073:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.514073:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd1025e2/0x21b6f08f07a6ac35 lrc: 0/0,0 mode: --/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x2/0x0 rrc: 23 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514076:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 22
00010000:00000010:2.0:1773851849.514076:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a1f16a1c.
00010000:00000040:2.0:1773851849.514077:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 21
00010000:00000001:2.0:1773851849.514078:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514078:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:2.0:1773851849.514079:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:2.0:1773851849.514079:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514079:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514080:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000327b941a refcount=3
00000020:00000001:2.0:1773851849.514080:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000001:2.0:1773851849.514081:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000001:2.0:1773851849.514081:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:2.0:1773851849.514082:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 3/1,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514084:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.514085:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514085:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.514085:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 2/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514087:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.514088:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514089:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514089:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:2.0:1773851849.514090:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 3/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514092:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00010000:2.0:1773851849.514092:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000327b941a already unused, calling callback (000000001690cbe4)
00000004:00000001:2.0:1773851849.514093:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:2.0:1773851849.514093:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:2.0:1773851849.514094:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 3/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514096:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.514096:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:2.0:1773851849.514097:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514097:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514097:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000327b941a refcount=4
00000020:00000001:2.0:1773851849.514098:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000001:2.0:1773851849.514098:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459087104 : -106977250464512 : ffff9eb46afcad00)
00010000:00000001:2.0:1773851849.514099:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:2.0:1773851849.514099:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 4/0,0 mode: PR/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514103:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.514104:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:2.0:1773851849.514104:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:2.0:1773851849.514105:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514105:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:2.0:1773851849.514106:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.514106:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514106:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.514107:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000327b941a with handle 0x21b6f08f07a6ac3c from hash
00010000:00000001:2.0:1773851849.514108:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.514108:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514108:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514109:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:2.0:1773851849.514109:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.514110:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514110:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:2.0:1773851849.514111:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.514111:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.514111:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240013d14:0xb:0x0].0xc465951e (000000000017e741)
00010000:00010000:2.0:1773851849.514112:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:2.0:1773851849.514113:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514113:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514114:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.514114:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:2.0:1773851849.514115:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514115:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514115:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514116:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514116:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514117:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 2/0,0 mode: --/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514118:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000001:2.0:1773851849.514119:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514120:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514120:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:2.0:1773851849.514120:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:2.0:1773851849.514121:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.514121:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000327b941a/0x21b6f08f07a6ac3c lrc: 0/0,0 mode: --/PR res: [0x240013d14:0xb:0x0].0xc465951e bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514123:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 1
00010000:00000010:2.0:1773851849.514124:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000026012d57.
00010000:00000040:2.0:1773851849.514124:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000017e741 count: 0
00010000:00000010:2.0:1773851849.514125:0:42868:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000c1bdad60.
00010000:00000001:2.0:1773851849.514126:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514126:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:2.0:1773851849.514127:0:42868:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:2.0:1773851849.514128:0:42868:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:2.0:1773851849.514128:0:42868:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:2.0:1773851849.514128:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514129:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514129:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028397a70 refcount=3
00000020:00000001:2.0:1773851849.514130:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000001:2.0:1773851849.514130:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00000004:00000040:2.0:1773851849.514131:0:42868:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000ffc3dfaf : new locks_count 6
00000020:00000040:2.0:1773851849.514132:0:42868:0:(genops.c:871:class_export_get()) GET export 00000000ffc3dfaf refcount=12
00010000:00000001:2.0:1773851849.514133:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514133:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514133:0:42868:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851849.514134:0:42868:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:2.0:1773851849.514135:0:42868:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:2.0:1773851849.514135:0:42868:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:2.0:1773851849.514136:0:42868:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:2.0:1773851849.514136:0:42868:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:2.0:1773851849.514137:0:42868:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:2.0:1773851849.514138:0:42868:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 48 cookie/acl_size = 0
00000004:00000001:2.0:1773851849.514139:0:42868:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514139:0:42868:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851849.514141:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:2.0:1773851849.514141:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000cb3f8649/000000007fba6756 to site lru. bkt: 0000000013a49733
00000004:00000001:2.0:1773851849.514141:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851849.514142:0:42868:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:2.0:1773851849.514143:0:42868:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:2.0:1773851849.514143:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.514144:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514144:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514144:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514145:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.514145:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d651f136 with handle 0x21b6f08f07a6ac2e from hash
00010000:00000001:2.0:1773851849.514146:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.514146:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514146:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514146:0:42868:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:2.0:1773851849.514147:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.514147:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d651f136/0x21b6f08f07a6ac2e lrc: 0/0,0 mode: --/CR res: [0x240013d14:0xb:0x0].0x0 bits 0x1/0x0 rrc: 22 type: IBT gid 0 flags: 0x44000000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd5f expref: 12 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514149:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 21
00010000:00000040:2.0:1773851849.514150:0:42868:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ffc3dfaf : new locks_count 5
00000020:00000040:2.0:1773851849.514151:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 11
00010000:00000010:2.0:1773851849.514151:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000795a147f.
00010000:00000040:2.0:1773851849.514152:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008c3bb33b count: 20
00010000:00000001:2.0:1773851849.514152:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514152:0:42868:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514153:0:42868:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:2.0:1773851849.514154:0:42868:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 0000000028397a70/0x21b6f08f07a6ac43 lrc: 3/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd5f expref: 11 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514156:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000001:2.0:1773851849.514157:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.514157:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.514157:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002615b:0x12392:0x0].0x0 (0000000021f43f2a)
00010000:00010000:2.0:1773851849.514158:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00000001:2.0:1773851849.514159:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514160:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514160:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.514160:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514161:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.514161:0:42868:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000028397a70, rc 0)
00000020:00000001:2.0:1773851849.514162:0:42868:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851849.514163:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260458323, transno 0, xid 1858292324245120
00010000:00000001:2.0:1773851849.514164:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851849.514165:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c086d1f x1858292324245120/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 576/688 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833448332813667328'
00010000:00000001:2.0:1773851849.514167:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851849.514168:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851849.514169:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=82 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851849.514170:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851849.514170:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00000100:00000001:2.0:1773851849.514171:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
02000000:00000001:2.0:1773851849.514172:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851849.514172:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.514173:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851849.514174:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25346@kfi7
00000400:00000010:2.0:1773851849.514175:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000093900eac.
00000100:00000200:2.0:1773851849.514175:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 688 bytes to portal 10, xid 1858292324245120, offset 224
00000400:00000200:2.0:1773851849.514177:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25346@kfi7
00000400:00000200:2.0:1773851849.514178:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.514179:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:2.0:1773851849.514180:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:2.0:1773851849.514181:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:2.0:1773851849.514182:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25346@kfi7 local destination
00000400:00000200:2.0:1773851849.514183:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768418:8768418:1024:4294967295] 25346@kfi7 LPNI seq info [16384152:16384152:16:4294967295]
00000400:00000200:2.0:1773851849.514185:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:2.0:1773851849.514185:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.514187:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25346@kfi7(25346@kfi7:25346@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851849.514189:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000800:00000200:2.0:1773851849.514190:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851849.514191:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 688 bytes in 1 frags
00000800:00000200:2.0:1773851849.514194:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851849.514196:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 Using peer 25346@kfi7(0x863)
00000800:00000200:2.0:1773851849.514199:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000014e57432: Posted send of 788 bytes to peer 0x863: rc=0
00000800:00000200:2.0:1773851849.514200:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851849.514202:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.514203:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:2.0:1773851849.514204:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851849.514204:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.514205:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851849.514205:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c086d1f x1858292324245120/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 576/688 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833448332813667328'
00000100:00100000:2.0:1773851849.514209:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c086d1f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4fec6715-7b94-4677-aa38-bf65c6472a0a+11:1591361:x1858292324245120:12345-25346@kfi7:101:tuolumne-833448332813667328 Request processed in 567us (595us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851849.514211:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 408701469
00000100:00000040:2.0:1773851849.514212:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 0
00000100:00000001:2.0:1773851849.514213:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851849.514213:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:1.0:1773851849.514213:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 TN_EVENT_TX_OK event status 0
00000020:00000010:2.0:1773851849.514214:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851849.514214:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ebfb08ad.
00000400:00000200:1.0:1773851849.514214:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:2.0:1773851849.514215:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009abda479.
00000020:00000040:2.0:1773851849.514216:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 10
00000100:00000001:2.0:1773851849.514216:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851849.514216:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25346@kfi7: PUT: OK
00000400:00000200:1.0:1773851849.514216:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000093900eac
00000400:00000010:1.0:1773851849.514217:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000093900eac.
00000100:00000001:1.0:1773851849.514218:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851849.514218:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851849.514219:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000800:00000200:1.0:1773851849.514221:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 Transaction freed
00000800:00000200:13.0:1773851849.514379:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851849.514380:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851849.514381:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851849.514383:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851849.514384:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.514386:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25347@kfi7 : PUT - for me
00000400:00000200:13.0:1773851849.514386:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.514387:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00000400:00000200:13.0:1773851849.514389:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.514389:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:13.0:1773851849.514390:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000400:00000200:13.0:1773851849.514391:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:13.0:1773851849.514392:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 328 into portal 17 MB=0x69a1b65e01ec0
00000400:00000200:13.0:1773851849.514393:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-25346@kfi7 of length 328/328 into md 0x82a562e4d [2] + 1000
00000800:00000200:13.0:1773851849.514396:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851849.514397:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851849.514398:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25347@kfi7: PUT: OK
00000100:00000001:13.0:1773851849.514399:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851849.514400:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:13.0:1773851849.514401:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000090e501.
00000100:00000040:13.0:1773851849.514401:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000000090e501 x1858292324245184 msgsize 328
00000100:00100000:13.0:1773851849.514403:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25347@kfi7)
00000100:00000001:13.0:1773851849.514405:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851849.514406:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000100:00000001:15.0:1773851849.514407:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851849.514407:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851849.514408:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851849.514408:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851849.514409:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851849.514410:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851849.514410:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00100000:15.0:1773851849.514411:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324245184
00000020:00000001:15.0:1773851849.514411:0:609420:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:1.0:1773851849.514411:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000040:15.0:1773851849.514412:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000020:00000001:15.0:1773851849.514413:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:1.0:1773851849.514413:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000040:15.0:1773851849.514414:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=11
00000020:00000001:15.0:1773851849.514414:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000020:00000001:15.0:1773851849.514415:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000800:00000200:1.0:1773851849.514415:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:15.0:1773851849.514416:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851849.514417:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:1.0:1773851849.514417:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000020:00000010:15.0:1773851849.514418:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000944b52d0.
00000400:00000200:1.0:1773851849.514418:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25346@kfi7 : PUT - for me
00000020:00000010:15.0:1773851849.514419:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000400:00000200:1.0:1773851849.514419:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000020:00000010:15.0:1773851849.514420:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000400:00000200:1.0:1773851849.514420:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:1.0:1773851849.514421:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.514421:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000100:00000040:15.0:1773851849.514422:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:15.0:1773851849.514422:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851849.514423:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:1.0:1773851849.514423:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:1.0:1773851849.514423:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00010000:00000001:15.0:1773851849.514424:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00000400:00000200:1.0:1773851849.514424:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 584 into portal 12 MB=0x69a1b65e01f00
00010000:00000001:15.0:1773851849.514425:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851849.514425:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25346@kfi7 of length 584/584 into md 0x7fb56e801 [64] + 3936
00010000:00000001:15.0:1773851849.514426:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:15.0:1773851849.514427:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000800:00000200:1.0:1773851849.514427:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:15.0:1773851849.514428:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851849.514429:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028397a70 refcount=3
00000020:00000001:15.0:1773851849.514429:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00000400:00000200:1.0:1773851849.514429:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851849.514430:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25346@kfi7: PUT: OK
00000100:00000001:1.0:1773851849.514430:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:15.0:1773851849.514431:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00000100:00000200:1.0:1773851849.514431:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00010000:00000001:15.0:1773851849.514432:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000010:1.0:1773851849.514432:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a78b7893.
00010000:00000001:15.0:1773851849.514433:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851849.514433:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851849.514433:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a78b7893 x1858292324245248 msgsize 584
00000100:00000001:15.0:1773851849.514434:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851849.514434:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25346@kfi7)
00000100:00000001:15.0:1773851849.514435:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.514435:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851849.514436:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.514436:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:1.0:1773851849.514436:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
02000000:00000001:2.0:1773851849.514437:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851849.514437:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851849.514437:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851849.514438:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.514439:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851849.514439:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
02000000:00000001:2.0:1773851849.514439:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851849.514439:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324245248
00000020:00000001:2.0:1773851849.514440:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851849.514440:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000100:00100000:15.0:1773851849.514441:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 50273002
00000100:00000040:15.0:1773851849.514441:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 1
00000100:00000001:12.0:1773851849.514441:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851849.514441:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000020:00000001:2.0:1773851849.514441:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514441:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=12
00000100:00000001:15.0:1773851849.514442:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251452288 : -106960458099328 : ffff9eb853e3d580)
00000020:00000001:2.0:1773851849.514442:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000100:00000040:15.0:1773851849.514443:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000090e501 x1858292324245184/t0(0) o103->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 328/0 e 0 to 0 dl 1773851936 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:12.0:1773851849.514443:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.514443:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000100:00000001:2.0:1773851849.514443:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851849.514444:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.514444:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851849.514444:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000de1a9407.
00000020:00000010:2.0:1773851849.514445:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851849.514446:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ebfb08ad.
00000100:00000001:15.0:1773851849.514447:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851849.514447:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:2.0:1773851849.514447:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00100000:15.0:1773851849.514448:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000090e501 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:4fec6715-7b94-4677-aa38-bf65c6472a0a+12:39515:x1858292324245184:12345-25346@kfi7:103:
00000100:00000001:2.0:1773851849.514448:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:2.0:1773851849.514448:0:42868:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:2.0:1773851849.514448:0:42868:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.514449:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:15.0:1773851849.514450:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324245184
00000100:00000001:2.0:1773851849.514450:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514451:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00000100:00000001:2.0:1773851849.514451:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000002:15.0:1773851849.514452:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:15.0:1773851849.514452:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:2.0:1773851849.514452:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851849.514452:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851849.514453:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000100:00000001:2.0:1773851849.514453:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851849.514453:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 408701470
00000100:00000001:1.0:1773851849.514453:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
02000000:00000001:15.0:1773851849.514454:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000040:2.0:1773851849.514454:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 2
00000100:00000001:1.0:1773851849.514454:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:15.0:1773851849.514455:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7d5d081.
00000100:00000001:2.0:1773851849.514455:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114618876416 : -106959090675200 : ffff9eb8a5651200)
00000100:00000001:1.0:1773851849.514455:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851849.514456:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.514456:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.514456:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a78b7893 x1858292324245248/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:489/0 lens 584/0 e 0 to 0 dl 1773852604 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833448332813667328'
00010000:00000001:15.0:1773851849.514457:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:15.0:1773851849.514458:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:15.0:1773851849.514458:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:2.0:1773851849.514458:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:15.0:1773851849.514459:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:2.0:1773851849.514459:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851849.514459:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a78b7893 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4fec6715-7b94-4677-aa38-bf65c6472a0a+12:1591361:x1858292324245248:12345-25346@kfi7:101:tuolumne-833448332813667328
00000020:00000040:15.0:1773851849.514460:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028397a70 refcount=3
00000020:00000001:15.0:1773851849.514460:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000001:15.0:1773851849.514461:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459089408 : -106977250462208 : ffff9eb46afcb600)
00010000:00000040:15.0:1773851849.514462:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000021f43f2a count: 14
00000004:00000001:15.0:1773851849.514464:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000100:00000200:2.0:1773851849.514464:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324245248
00000020:00000001:2.0:1773851849.514464:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:15.0:1773851849.514465:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:2.0:1773851849.514465:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851849.514465:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851849.514466:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00000020:00000001:2.0:1773851849.514466:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851849.514466:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00010000:00000001:15.0:1773851849.514467:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:15.0:1773851849.514467:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.514467:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851849.514467:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858292324245248, found 0 last_xid 1858292324245183
00000020:00000001:15.0:1773851849.514468:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.514468:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851849.514468:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851849.514469:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851849.514469:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514470:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00000020:00000001:2.0:1773851849.514470:0:42868:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:2.0:1773851849.514470:0:42868:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:2.0:1773851849.514470:0:42868:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:15.0:1773851849.514471:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.514471:0:42868:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:2.0:1773851849.514471:0:42868:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514472:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851849.514473:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514473:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851849.514473:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000021f43f2a count: 15
00010000:00000001:15.0:1773851849.514474:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:15.0:1773851849.514474:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514474:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.514474:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00000020:00000040:15.0:1773851849.514475:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000028397a70 with handle 0x21b6f08f07a6ac43 from hash
00010000:00000010:2.0:1773851849.514475:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000007e4075d0.
00010000:00000001:15.0:1773851849.514476:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:15.0:1773851849.514476:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851849.514476:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:2.0:1773851849.514476:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.514476:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 000000007e4075d0 with handle 0x21b6f08f07a6ac4a to hash
00010000:00000001:15.0:1773851849.514477:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00000020:00000001:2.0:1773851849.514477:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.514477:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637096459076160 : -106977250475456 : ffff9eb46afc8240)
00010000:00000001:15.0:1773851849.514478:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000010:2.0:1773851849.514478:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000795a147f.
00010000:00000001:2.0:1773851849.514478:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637096459076160 : -106977250475456 : ffff9eb46afc8240)
00010000:00000001:15.0:1773851849.514479:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514479:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00010000:2.0:1773851849.514479:0:42868:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000007e4075d0/0x21b6f08f07a6ac4a lrc: 2/0,0 mode: --/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x0/0x0 rrc: 16 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd114cfd214afd66 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000001:15.0:1773851849.514480:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:15.0:1773851849.514480:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000028397a70/0x21b6f08f07a6ac43 lrc: 0/0,0 mode: --/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 17 type: IBT gid 0 flags: 0x44a01000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd5f expref: 12 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514481:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 16
00010000:00000040:2.0:1773851849.514482:0:42868:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ffc3dfaf : new locks_count 6
00000020:00000040:2.0:1773851849.514483:0:42868:0:(genops.c:871:class_export_get()) GET export 00000000ffc3dfaf refcount=13
00010000:00000040:15.0:1773851849.514484:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 15
00010000:00000001:2.0:1773851849.514484:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:2.0:1773851849.514484:0:42868:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:2.0:1773851849.514485:0:42868:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:2.0:1773851849.514485:0:42868:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00010000:00000040:15.0:1773851849.514486:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ffc3dfaf : new locks_count 5
00000004:00000001:2.0:1773851849.514486:0:42868:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:2.0:1773851849.514486:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851849.514486:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002615b:0x12392:0x0]
00000020:00000040:15.0:1773851849.514487:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 12
00010000:00000010:15.0:1773851849.514487:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000001c5f17f1.
00000020:00000001:2.0:1773851849.514487:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:2.0:1773851849.514487:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637097005971992 : -106976703579624 : ffff9eb48b957a18)
00010000:00000040:15.0:1773851849.514488:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00000004:00000001:2.0:1773851849.514488:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637097005971904 : -106976703579712 : ffff9eb48b9579c0)
00000004:00000001:2.0:1773851849.514488:0:42868:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514489:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851849.514489:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00000004:00000001:2.0:1773851849.514489:0:42868:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:2.0:1773851849.514489:0:42868:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:2.0:1773851849.514490:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851849.514490:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00010000:00000001:15.0:1773851849.514491:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
02000000:00000010:2.0:1773851849.514491:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000ee3688b0.
00010000:00010000:15.0:1773851849.514492:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002615b:0x12392:0x0].0x0 (0000000021f43f2a)
02000000:00000001:2.0:1773851849.514492:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.514492:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514493:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851849.514493:0:42868:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514493:0:42868:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00010000:00000001:15.0:1773851849.514494:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514494:0:42868:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:2.0:1773851849.514494:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.514494:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514495:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:15.0:1773851849.514495:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00000001:00000001:2.0:1773851849.514495:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.514495:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00010000:00010000:15.0:1773851849.514496:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00000001:00000001:2.0:1773851849.514496:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.514496:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.514496:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:15.0:1773851849.514497:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000001:00000001:2.0:1773851849.514497:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.514497:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.514497:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00010000:00000001:15.0:1773851849.514498:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851849.514498:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851849.514498:0:42868:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:2.0:1773851849.514498:0:42868:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637111293937920 : -106962415613696 : ffff9eb7df368900)
00000100:00001000:15.0:1773851849.514499:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=103 v=66 (1 1 1 1)
00000004:00000001:2.0:1773851849.514499:0:42868:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000100:00000001:15.0:1773851849.514500:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000004:00000001:2.0:1773851849.514500:0:42868:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.514500:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00000040:15.0:1773851849.514501:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00000001:00000001:2.0:1773851849.514501:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514501:0:42868:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:2.0:1773851849.514501:0:42868:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.514502:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
00000004:00000001:2.0:1773851849.514502:0:42868:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
02000000:00000001:15.0:1773851849.514503:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000004:00000002:2.0:1773851849.514503:0:42868:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24002615b:0x12392:0x0]/second_af3vhhna, ldlm_rep = 00000000378faddd
02000000:00000001:15.0:1773851849.514504:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.514504:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000004:00000001:2.0:1773851849.514504:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:2.0:1773851849.514504:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:2.0:1773851849.514504:0:42868:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000100:00000040:15.0:1773851849.514505:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25347@kfi7
00000004:00000001:2.0:1773851849.514505:0:42868:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:2.0:1773851849.514505:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.514505:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00000400:00000010:15.0:1773851849.514506:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000085014459.
00010000:00000040:2.0:1773851849.514506:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514506:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00000100:00000200:15.0:1773851849.514507:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1858292324245184, offset 224
00010000:00000001:2.0:1773851849.514507:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.514507:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000a83c471f.
00000400:00000200:15.0:1773851849.514508:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25347@kfi7
00000020:00000001:2.0:1773851849.514508:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.514509:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000a83c471f with handle 0x21b6f08f07a6ac51 to hash
00000020:00000001:2.0:1773851849.514509:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00000400:00000200:15.0:1773851849.514510:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00010000:00000001:2.0:1773851849.514510:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637096459084224 : -106977250467392 : ffff9eb46afca1c0)
00010000:00000010:2.0:1773851849.514510:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000026012d57.
00000400:00000200:15.0:1773851849.514511:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00010000:00000001:2.0:1773851849.514511:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637096459084224 : -106977250467392 : ffff9eb46afca1c0)
00010000:00000001:2.0:1773851849.514511:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00000400:00000200:15.0:1773851849.514512:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00010000:00000001:2.0:1773851849.514512:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514512:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 3/1,0 mode: --/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00000400:00000200:15.0:1773851849.514513:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000400:00000200:15.0:1773851849.514514:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25347@kfi7 local destination
00010000:00000040:2.0:1773851849.514515:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514515:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000400:00000200:15.0:1773851849.514516:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768419:8768419:1024:4294967295] 25347@kfi7 LPNI seq info [16384153:16384153:16:4294967295]
00010000:00000001:2.0:1773851849.514516:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.514516:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.514516:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.514517:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514517:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00000400:00000200:15.0:1773851849.514518:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:15.0:1773851849.514518:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00010000:00000001:2.0:1773851849.514518:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514519:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.514519:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.514519:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.514520:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.514520:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002615b:0x12392:0x0].0x0 (0000000021f43f2a) refcount = 14
00000400:00000200:15.0:1773851849.514521:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25347@kfi7(25347@kfi7:25347@kfi7) <?> : PUT try# 0
00010000:00000040:2.0:1773851849.514521:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851849.514521:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b0b4f41/0x21b6f08f07a6a718 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25344@kfi7 remote: 0xc2f4b565992771cf expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00000400:00000200:15.0:1773851849.514522:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00010000:00000040:2.0:1773851849.514523:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00000800:00000200:15.0:1773851849.514524:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00010000:00000040:2.0:1773851849.514524:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cf9f54a3/0x21b6f08f07a6a6b6 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25857@kfi7 remote: 0x67ad6c07d46ccba8 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00000800:00000200:15.0:1773851849.514525:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00010000:00000040:2.0:1773851849.514526:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514527:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010d70c79/0x21b6f08f07a6a654 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25811@kfi7 remote: 0x852786f6c6fb3130 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00000800:00000200:15.0:1773851849.514528:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00010000:00000040:2.0:1773851849.514529:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514529:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bae939c2/0x21b6f08f07a6a5f2 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 26003@kfi7 remote: 0xd2845bd3ebcaa7a0 expref: 8 pid: 60951 timeout: 0 lvb_type: 0
00000800:00000200:15.0:1773851849.514530:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 Using peer 25347@kfi7(0x100000000000d80)
00010000:00000040:2.0:1773851849.514531:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514532:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ade770aa/0x21b6f08f07a6a590 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25234@kfi7 remote: 0x15722d0a1e061f48 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00000800:00000200:15.0:1773851849.514534:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x100000000000d80: rc=0
00010000:00000040:2.0:1773851849.514534:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514535:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030cd5d51/0x21b6f08f07a6a504 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25955@kfi7 remote: 0x1eaea03265ab6c32 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00000800:00000200:15.0:1773851849.514536:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00010000:00000040:2.0:1773851849.514536:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514537:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd251db4/0x21b6f08f07a6a4a2 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25651@kfi7 remote: 0xf59cb3f755288415 expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00000100:00000001:15.0:1773851849.514538:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851849.514539:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:15.0:1773851849.514540:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.514540:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851849.514541:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000090e501 x1858292324245184/t0(0) o103->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 328/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00010000:00000040:2.0:1773851849.514541:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514542:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d2265b/0x21b6f08f07a6a41d lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25523@kfi7 remote: 0x55d9da689ceec0dc expref: 10 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514544:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514544:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8a2ebb5/0x21b6f08f07a6a32f lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afce1 expref: 12 pid: 60487 timeout: 0 lvb_type: 0
00000100:00100000:15.0:1773851849.514545:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000090e501 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:4fec6715-7b94-4677-aa38-bf65c6472a0a+12:39515:x1858292324245184:12345-25346@kfi7:103: Request processed in 98us (143us total) trans 0 rc 0/0
00010000:00000040:2.0:1773851849.514546:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514547:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000053251a31/0x21b6f08f07a6a2b1 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25697@kfi7 remote: 0x8a2d120cd21bdfb7 expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00000100:00100000:15.0:1773851849.514548:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 50273002
00000100:00000040:15.0:1773851849.514549:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 1
00010000:00000040:2.0:1773851849.514549:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000040:2.0:1773851849.514549:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc5f27b3/0x21b6f08f07a6a209 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25776@kfi7 remote: 0x979753abbfa0d89a expref: 8 pid: 60829 timeout: 0 lvb_type: 0
00000100:00000001:15.0:1773851849.514550:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851849.514550:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851849.514550:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851849.514551:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851849.514551:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000040:2.0:1773851849.514551:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00000020:00000010:15.0:1773851849.514552:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000400:00000200:13.0:1773851849.514552:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25347@kfi7: PUT: OK
00010000:00000040:2.0:1773851849.514552:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097ca6def/0x21b6f08f07a6a18b lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x0 bits 0x13/0x0 rrc: 15 type: IBT gid 0 flags: 0x40200000000000 nid: 25457@kfi7 remote: 0x72480a5c17042aa7 expref: 8 pid: 42267 timeout: 0 lvb_type: 0
00000020:00000010:15.0:1773851849.514553:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000944b52d0.
00000020:00000040:15.0:1773851849.514553:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 11
00000400:00000200:13.0:1773851849.514553:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000085014459
00000100:00000001:15.0:1773851849.514554:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851849.514554:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000085014459.
00000100:00000001:13.0:1773851849.514554:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00010000:00000040:2.0:1773851849.514554:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00010000:2.0:1773851849.514554:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 3/1,0 mode: CR/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00000100:00000001:13.0:1773851849.514555:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851849.514556:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00010000:00000040:2.0:1773851849.514556:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514556:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00000800:00000200:13.0:1773851849.514557:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25347@kfi7(000000003e7dde0f):0x0 lsk 3457 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000d80 Transaction freed
00010000:00000001:2.0:1773851849.514557:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.514557:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514558:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.514558:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514559:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514559:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.514560:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.514560:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514561:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 3/1,0 mode: CR/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514563:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514563:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851849.514564:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514564:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514564:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.514565:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:2.0:1773851849.514565:0:42868:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000003cc3ba26.
00010000:00000010:2.0:1773851849.514566:0:42868:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000c1bdad60.
00010000:00000001:2.0:1773851849.514567:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.514567:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000005cc1f30b.
00000020:00000001:2.0:1773851849.514568:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.514568:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 000000005cc1f30b with handle 0x21b6f08f07a6ac58 to hash
00000020:00000001:2.0:1773851849.514569:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.514569:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000010:2.0:1773851849.514570:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a1f16a1c.
00010000:00000001:2.0:1773851849.514570:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000001:2.0:1773851849.514571:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514571:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514571:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 3/1,0 mode: --/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514573:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514574:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.514574:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.514575:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.514575:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.514575:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514576:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.514577:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514577:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.514578:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.514578:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.514578:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.514579:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002615b:0x12392:0x0].0x773ea3a1 (000000003cc3ba26) refcount = 1
00010000:00010000:2.0:1773851849.514579:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 3/1,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514581:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514582:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.514582:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.514582:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514583:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.514583:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514584:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514584:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.514585:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.514585:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514585:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 3/1,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514587:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514588:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851849.514588:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514588:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514589:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514589:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514590:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005cc1f30b refcount=3
00000020:00000001:2.0:1773851849.514590:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000001:2.0:1773851849.514591:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000001:2.0:1773851849.514591:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514592:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514592:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514592:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514594:0:42868:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:2.0:1773851849.514595:0:42868:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:2.0:1773851849.514596:0:42868:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:2.0:1773851849.514596:0:42868:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.514597:0:42868:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:2.0:1773851849.514602:0:42868:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:2.0:1773851849.514602:0:42868:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:2.0:1773851849.514603:0:42868:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:2.0:1773851849.514603:0:42868:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:2.0:1773851849.514603:0:42868:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:2.0:1773851849.514603:0:42868:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:2.0:1773851849.514604:0:42868:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.514604:0:42868:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:2.0:1773851849.514605:0:42868:0:(osd_index.c:979:osd_remote_fid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.514605:0:42868:0:(osd_index.c:554:osd_zfs_consistency_check()) Process entered
00080000:00000001:2.0:1773851849.514606:0:42868:0:(osd_oi.c:669:osd_fid_lookup()) Process entered
00080000:00000001:2.0:1773851849.514606:0:42868:0:(osd_oi.c:360:fid_is_on_ost()) Process entered
80000000:00000001:2.0:1773851849.514606:0:42868:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:2.0:1773851849.514606:0:42868:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:2.0:1773851849.514607:0:42868:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:2.0:1773851849.514607:0:42868:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.514608:0:42868:0:(osd_oi.c:389:fid_is_on_ost()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.514620:0:42868:0:(osd_oi.c:706:osd_fid_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.514620:0:42868:0:(osd_index.c:582:osd_zfs_consistency_check()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:2.0:1773851849.514621:0:42868:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514621:0:42868:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514622:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851849.514622:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240026139:0x16820:0x0]
00000020:00000001:2.0:1773851849.514622:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:2.0:1773851849.514624:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637127652643512 : -106946056908104 : ffff9ebbae4492b8)
00000004:00000001:2.0:1773851849.514624:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637127652643424 : -106946056908192 : ffff9ebbae449260)
00000004:00000001:2.0:1773851849.514625:0:42868:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:2.0:1773851849.514625:0:42868:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:2.0:1773851849.514630:0:42868:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:2.0:1773851849.514631:0:42868:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:2.0:1773851849.514631:0:42868:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514632:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:2.0:1773851849.514633:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:2.0:1773851849.514633:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.514633:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851849.514634:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e5f2fc73 count: 13
00010000:00000001:2.0:1773851849.514635:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.514635:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.514636:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000ac32bed5.
00000020:00000001:2.0:1773851849.514637:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.514638:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000ac32bed5 with handle 0x21b6f08f07a6ac5f to hash
00000020:00000001:2.0:1773851849.514638:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.514638:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000010:2.0:1773851849.514639:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000bb4e0cac.
00010000:00000001:2.0:1773851849.514639:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000001:2.0:1773851849.514640:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514640:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514641:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ac32bed5/0x21b6f08f07a6ac5f lrc: 3/1,0 mode: --/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514643:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000001:2.0:1773851849.514643:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.514644:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.514644:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.514644:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.514645:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514646:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.514646:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514647:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.514647:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.514647:0:42868:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.514648:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.514648:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240026139:0x16820:0x0].0x0 (00000000e5f2fc73) refcount = 13
00010000:00000040:2.0:1773851849.514649:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851849.514650:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083abdf2b/0x21b6f08f07a6a734 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25344@kfi7 remote: 0xc2f4b565992771d6 expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514653:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514654:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000151b6737/0x21b6f08f07a6a6d2 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25857@kfi7 remote: 0x67ad6c07d46ccbaf expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514656:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514657:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000afa688a1/0x21b6f08f07a6a670 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25811@kfi7 remote: 0x852786f6c6fb3137 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514659:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514660:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000079e508bc/0x21b6f08f07a6a60e lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 26003@kfi7 remote: 0xd2845bd3ebcaa7a7 expref: 8 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514662:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514663:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1852e6b/0x21b6f08f07a6a5ac lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25234@kfi7 remote: 0x15722d0a1e061f4f expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514665:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514666:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9ef01dd/0x21b6f08f07a6a520 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25955@kfi7 remote: 0x1eaea03265ab6c39 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514667:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514668:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007719fd1a/0x21b6f08f07a6a4be lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25651@kfi7 remote: 0xf59cb3f75528841c expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514670:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514671:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dc869009/0x21b6f08f07a6a439 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25523@kfi7 remote: 0x55d9da689ceec0e3 expref: 10 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514673:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514674:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8bf78f8/0x21b6f08f07a6a34b lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afce8 expref: 11 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514677:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514678:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ff89dfb8/0x21b6f08f07a6a2cd lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25697@kfi7 remote: 0x8a2d120cd21bdfbe expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514680:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514682:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ae013a48/0x21b6f08f07a6a225 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25776@kfi7 remote: 0x979753abbfa0d8a1 expref: 8 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514684:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.514685:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050dcfb9c/0x21b6f08f07a6a1a7 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25457@kfi7 remote: 0x72480a5c17042aae expref: 8 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514687:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00010000:2.0:1773851849.514688:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000ac32bed5/0x21b6f08f07a6ac5f lrc: 3/1,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514689:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000001:2.0:1773851849.514690:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.514690:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.514691:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514691:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.514691:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514692:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514692:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.514693:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.514693:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514694:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000ac32bed5/0x21b6f08f07a6ac5f lrc: 3/1,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514695:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000001:2.0:1773851849.514696:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851849.514697:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514697:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514697:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514697:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514698:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ac32bed5 refcount=3
00000020:00000001:2.0:1773851849.514698:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000001:2.0:1773851849.514699:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000001:2.0:1773851849.514699:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514699:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514700:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514700:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514701:0:42868:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:2.0:1773851849.514701:0:42868:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:2.0:1773851849.514702:0:42868:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:2.0:1773851849.514703:0:42868:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514703:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851849.514704:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514704:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514706:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514706:0:42868:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514707:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514707:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851849.514708:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514708:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514708:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514709:0:42868:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514709:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:2.0:1773851849.514710:0:42868:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:2.0:1773851849.514710:0:42868:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.514711:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.514711:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.514712:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.514712:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.514712:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.514713:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.514713:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.514714:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:2.0:1773851849.514714:0:42868:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x240026139:0x16820:0x0]: nlink=7, mode=40700, valid=0x1100000000002f8f
00000004:00200000:2.0:1773851849.514715:0:42868:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240026139:0x16820:0x0]: returning size 37888
00000004:00200000:2.0:1773851849.514716:0:42868:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 7 stripe count 1 MDT count 6
00000004:00000002:2.0:1773851849.514717:0:42868:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:2.0:1773851849.514717:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.514717:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514718:0:42868:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:2.0:1773851849.514718:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851849.514719:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514719:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851849.514719:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514720:0:42868:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514720:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851849.514721:0:42868:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.514721:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:2.0:1773851849.514722:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514723:0:42868:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514729:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514729:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514730:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ac32bed5 refcount=3
00000020:00000001:2.0:1773851849.514730:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000001:2.0:1773851849.514731:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00000004:00010000:2.0:1773851849.514731:0:42868:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000ac32bed5/0x21b6f08f07a6ac5f lrc: 3/1,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514733:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000001:2.0:1773851849.514734:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514734:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514734:0:42868:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:2.0:1773851849.514735:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:2.0:1773851849.514735:0:42868:0:(lu_object.c:224:lu_object_put()) Add 000000005c33f9a2/00000000c2fc8738 to site lru. bkt: 00000000262bba3e
00000004:00000001:2.0:1773851849.514736:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851849.514736:0:42868:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:2.0:1773851849.514737:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:2.0:1773851849.514737:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514737:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514738:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000a83c471f refcount=3
00000020:00000001:2.0:1773851849.514738:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459084224 : -106977250467392 : ffff9eb46afca1c0)
00010000:00000001:2.0:1773851849.514739:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459084224 : -106977250467392 : ffff9eb46afca1c0)
00010000:00000001:2.0:1773851849.514740:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:2.0:1773851849.514740:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 3/1,0 mode: CR/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514742:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514743:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514744:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.514744:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 2/0,0 mode: CR/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514746:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514747:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514747:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514748:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:2.0:1773851849.514748:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 3/0,0 mode: CR/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514751:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00010000:2.0:1773851849.514751:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000a83c471f already unused, calling callback (000000001690cbe4)
00000004:00000001:2.0:1773851849.514752:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:2.0:1773851849.514753:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:2.0:1773851849.514753:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 3/0,0 mode: CR/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514755:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514755:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:2.0:1773851849.514756:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514756:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514757:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000a83c471f refcount=4
00000020:00000001:2.0:1773851849.514757:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096459084224 : -106977250467392 : ffff9eb46afca1c0)
00010000:00000001:2.0:1773851849.514758:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637096459084224 : -106977250467392 : ffff9eb46afca1c0)
00010000:00000001:2.0:1773851849.514759:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:2.0:1773851849.514759:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 4/0,0 mode: CR/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514761:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514762:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:2.0:1773851849.514762:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:2.0:1773851849.514763:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514764:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:2.0:1773851849.514764:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.514764:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514765:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.514766:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000a83c471f with handle 0x21b6f08f07a6ac51 from hash
00010000:00000001:2.0:1773851849.514766:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.514767:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514767:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514768:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:2.0:1773851849.514768:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.514768:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514769:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:2.0:1773851849.514770:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.514770:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.514771:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002615b:0x12392:0x0].0x0 (0000000021f43f2a)
00010000:00010000:2.0:1773851849.514772:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:2.0:1773851849.514773:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514773:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514774:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.514774:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:2.0:1773851849.514775:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514775:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514776:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514777:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514777:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514778:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 2/0,0 mode: --/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514780:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000001:2.0:1773851849.514781:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514781:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514781:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:2.0:1773851849.514782:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:2.0:1773851849.514782:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.514783:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000a83c471f/0x21b6f08f07a6ac51 lrc: 0/0,0 mode: --/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514785:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 14
00010000:00000010:2.0:1773851849.514786:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000026012d57.
00010000:00000040:2.0:1773851849.514786:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000001:2.0:1773851849.514787:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514787:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:2.0:1773851849.514788:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:2.0:1773851849.514788:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514788:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514789:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005cc1f30b refcount=3
00000020:00000001:2.0:1773851849.514789:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000001:2.0:1773851849.514790:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000001:2.0:1773851849.514791:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:2.0:1773851849.514791:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 3/1,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514793:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514793:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514794:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.514794:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 2/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514800:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514800:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514801:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514802:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:2.0:1773851849.514802:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 3/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514804:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00010000:2.0:1773851849.514805:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005cc1f30b already unused, calling callback (000000001690cbe4)
00000004:00000001:2.0:1773851849.514805:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:2.0:1773851849.514806:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:2.0:1773851849.514806:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 3/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514809:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514810:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:2.0:1773851849.514810:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514810:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514811:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005cc1f30b refcount=4
00000020:00000001:2.0:1773851849.514811:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000001:2.0:1773851849.514812:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637064291226112 : -107009418325504 : ffff9eaceda21200)
00010000:00000001:2.0:1773851849.514813:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:2.0:1773851849.514813:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 4/0,0 mode: PR/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514816:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514816:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:2.0:1773851849.514817:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:2.0:1773851849.514817:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514818:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:2.0:1773851849.514818:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.514819:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514819:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.514820:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000005cc1f30b with handle 0x21b6f08f07a6ac58 from hash
00010000:00000001:2.0:1773851849.514821:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.514821:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514821:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514822:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:2.0:1773851849.514822:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.514822:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514823:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:2.0:1773851849.514823:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.514824:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.514824:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002615b:0x12392:0x0].0x773ea3a1 (000000003cc3ba26)
00010000:00010000:2.0:1773851849.514825:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:2.0:1773851849.514825:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514826:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514827:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.514827:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:2.0:1773851849.514828:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514828:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514828:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514829:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514830:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.514830:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 2/0,0 mode: --/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514832:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000001:2.0:1773851849.514833:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514833:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514834:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:2.0:1773851849.514834:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:2.0:1773851849.514834:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.514835:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc1f30b/0x21b6f08f07a6ac58 lrc: 0/0,0 mode: --/PR res: [0x24002615b:0x12392:0x0].0x773ea3a1 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514837:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 1
00010000:00000010:2.0:1773851849.514838:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a1f16a1c.
00010000:00000040:2.0:1773851849.514839:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003cc3ba26 count: 0
00010000:00000010:2.0:1773851849.514840:0:42868:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000c1bdad60.
00010000:00000001:2.0:1773851849.514841:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514841:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:2.0:1773851849.514841:0:42868:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:2.0:1773851849.514842:0:42868:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:2.0:1773851849.514842:0:42868:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:2.0:1773851849.514842:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.514843:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.514843:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ac32bed5 refcount=3
00000020:00000001:2.0:1773851849.514844:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000001:2.0:1773851849.514844:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00000004:00000040:2.0:1773851849.514845:0:42868:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000ffc3dfaf : new locks_count 6
00000020:00000040:2.0:1773851849.514846:0:42868:0:(genops.c:871:class_export_get()) GET export 00000000ffc3dfaf refcount=12
00010000:00000001:2.0:1773851849.514847:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514847:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.514847:0:42868:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851849.514848:0:42868:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:2.0:1773851849.514848:0:42868:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:2.0:1773851849.514849:0:42868:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:2.0:1773851849.514849:0:42868:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:2.0:1773851849.514849:0:42868:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:2.0:1773851849.514850:0:42868:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:2.0:1773851849.514850:0:42868:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:2.0:1773851849.514851:0:42868:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.514852:0:42868:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851849.514852:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:2.0:1773851849.514853:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000abcbc5d2/00000000fed94e34 to site lru. bkt: 000000001a4bd291
00000004:00000001:2.0:1773851849.514854:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851849.514854:0:42868:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:2.0:1773851849.514855:0:42868:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:2.0:1773851849.514855:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.514855:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514856:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514856:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.514857:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.514857:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000007e4075d0 with handle 0x21b6f08f07a6ac4a from hash
00010000:00000001:2.0:1773851849.514858:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.514858:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514859:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514859:0:42868:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:2.0:1773851849.514859:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.514860:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000007e4075d0/0x21b6f08f07a6ac4a lrc: 0/0,0 mode: --/CR res: [0x24002615b:0x12392:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd66 expref: 12 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514862:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 13
00010000:00000040:2.0:1773851849.514863:0:42868:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ffc3dfaf : new locks_count 5
00000020:00000040:2.0:1773851849.514863:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 11
00010000:00000010:2.0:1773851849.514864:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000795a147f.
00010000:00000040:2.0:1773851849.514864:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000021f43f2a count: 12
00010000:00000001:2.0:1773851849.514865:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.514865:0:42868:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514866:0:42868:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:2.0:1773851849.514867:0:42868:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ac32bed5/0x21b6f08f07a6ac5f lrc: 3/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd66 expref: 11 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.514869:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000001:2.0:1773851849.514869:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.514870:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.514870:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240026139:0x16820:0x0].0x0 (00000000e5f2fc73)
00010000:00010000:2.0:1773851849.514871:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00000001:2.0:1773851849.514872:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.514872:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.514873:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.514873:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.514873:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.514874:0:42868:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ac32bed5, rc 0)
00000020:00000001:2.0:1773851849.514874:0:42868:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851849.514875:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260458323, transno 0, xid 1858292324245248
00010000:00000001:2.0:1773851849.514877:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851849.514878:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a78b7893 x1858292324245248/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:489/0 lens 584/640 e 0 to 0 dl 1773852604 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833448332813667328'
00010000:00000001:2.0:1773851849.514881:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851849.514882:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851849.514882:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=82 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851849.514883:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851849.514884:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00000100:00000001:2.0:1773851849.514885:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
02000000:00000001:2.0:1773851849.514886:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851849.514886:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.514887:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851849.514888:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25346@kfi7
00000400:00000010:2.0:1773851849.514888:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f7a496d1.
00000100:00000200:2.0:1773851849.514889:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858292324245248, offset 224
00000400:00000200:2.0:1773851849.514891:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25346@kfi7
00000400:00000200:2.0:1773851849.514892:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.514893:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:2.0:1773851849.514894:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:2.0:1773851849.514895:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:2.0:1773851849.514896:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25346@kfi7 local destination
00000400:00000200:2.0:1773851849.514897:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768420:8768420:1024:4294967295] 25346@kfi7 LPNI seq info [16384154:16384154:16:4294967295]
00000400:00000200:2.0:1773851849.514899:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:2.0:1773851849.514900:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.514902:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25346@kfi7(25346@kfi7:25346@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851849.514903:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000800:00000200:2.0:1773851849.514904:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851849.514905:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:2.0:1773851849.514908:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851849.514912:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 Using peer 25346@kfi7(0x863)
00000800:00000200:2.0:1773851849.514915:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000004991649e: Posted send of 740 bytes to peer 0x863: rc=0
00000800:00000200:2.0:1773851849.514916:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851849.514918:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.514919:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:2.0:1773851849.514919:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851849.514920:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.514920:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851849.514921:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a78b7893 x1858292324245248/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:489/0 lens 584/640 e 0 to 0 dl 1773852604 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833448332813667328'
00000100:00100000:2.0:1773851849.514924:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a78b7893 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4fec6715-7b94-4677-aa38-bf65c6472a0a+11:1591361:x1858292324245248:12345-25346@kfi7:101:tuolumne-833448332813667328 Request processed in 465us (490us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851849.514926:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 408701470
00000100:00000040:2.0:1773851849.514927:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 0
00000100:00000001:2.0:1773851849.514928:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851849.514929:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:1.0:1773851849.514929:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 TN_EVENT_TX_OK event status 0
00000020:00000010:2.0:1773851849.514930:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851849.514930:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ebfb08ad.
00000020:00000010:2.0:1773851849.514931:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000de1a9407.
00000400:00000200:1.0:1773851849.514931:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:2.0:1773851849.514932:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 10
00000100:00000001:2.0:1773851849.514932:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851849.514932:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25346@kfi7: PUT: OK
00000400:00000200:1.0:1773851849.514933:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f7a496d1
00000400:00000010:1.0:1773851849.514934:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f7a496d1.
00000100:00000001:1.0:1773851849.514934:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851849.514935:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851849.514936:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000800:00000200:1.0:1773851849.514937:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 25346@kfi7(000000002fbcaeaa):0x0 lsk 2148 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x863 Transaction freed
00000800:00000200:1.0:1773851849.515021:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.515022:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851849.515023:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851849.515025:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851849.515026:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515027:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25346@kfi7 : PUT - for me
00000400:00000200:1.0:1773851849.515028:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515029:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:1.0:1773851849.515030:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515031:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:1.0:1773851849.515031:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:1.0:1773851849.515033:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515034:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 576 into portal 12 MB=0x69a1b65e01f40
00000400:00000200:1.0:1773851849.515035:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25346@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 4520
00000800:00000200:1.0:1773851849.515036:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851849.515038:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851849.515039:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25346@kfi7: PUT: OK
00000100:00000001:1.0:1773851849.515040:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851849.515040:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851849.515041:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a2e8cc2e.
00000100:00000040:1.0:1773851849.515041:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a2e8cc2e x1858292324245312 msgsize 576
00000100:00100000:1.0:1773851849.515042:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25346@kfi7)
00000100:00000001:1.0:1773851849.515043:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851849.515044:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000800:00000200:13.0:1773851849.515045:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:2.0:1773851849.515045:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851849.515045:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851849.515045:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851849.515046:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:2.0:1773851849.515046:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851849.515046:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:2.0:1773851849.515047:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851849.515047:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324245312
00000800:00000200:13.0:1773851849.515048:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:2.0:1773851849.515048:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851849.515048:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000020:00000001:2.0:1773851849.515049:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:13.0:1773851849.515050:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:2.0:1773851849.515050:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=11
00000400:00000200:13.0:1773851849.515051:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000020:00000001:2.0:1773851849.515051:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000020:00000001:2.0:1773851849.515051:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000400:00000200:13.0:1773851849.515052:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25347@kfi7 : PUT - for me
00000100:00000001:2.0:1773851849.515052:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:13.0:1773851849.515053:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000100:00000001:2.0:1773851849.515053:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851849.515053:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009abda479.
00000400:00000200:13.0:1773851849.515054:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00000020:00000010:2.0:1773851849.515054:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851849.515054:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ebfb08ad.
00000400:00000200:13.0:1773851849.515055:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851849.515055:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000100:00000001:2.0:1773851849.515055:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851849.515055:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:13.0:1773851849.515056:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000004:00000001:2.0:1773851849.515056:0:42868:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:2.0:1773851849.515056:0:42868:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851849.515057:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:13.0:1773851849.515057:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 328 into portal 17 MB=0x69a1b65e01f80
00000100:00000001:2.0:1773851849.515057:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851849.515058:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-25346@kfi7 of length 328/328 into md 0x82a562e4d [2] + 1328
00000100:00000001:2.0:1773851849.515058:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.515058:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.515059:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000800:00000200:13.0:1773851849.515060:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:2.0:1773851849.515060:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851849.515060:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851849.515060:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000400:00000200:13.0:1773851849.515061:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:2.0:1773851849.515061:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 408701471
00000100:00000040:2.0:1773851849.515061:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 1
00000100:00000001:1.0:1773851849.515061:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851849.515062:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25347@kfi7: PUT: OK
00000100:00000001:2.0:1773851849.515062:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114618890240 : -106959090661376 : ffff9eb8a5654800)
00000100:00000001:1.0:1773851849.515062:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851849.515063:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851849.515063:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000040:2.0:1773851849.515063:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a2e8cc2e x1858292324245312/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:489/0 lens 576/0 e 0 to 0 dl 1773852604 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833448332813667328'
00000100:00000010:13.0:1773851849.515065:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009e144d9b.
00000100:00000040:13.0:1773851849.515065:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009e144d9b x1858292324245376 msgsize 328
00000100:00000001:2.0:1773851849.515066:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851849.515066:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851849.515067:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25347@kfi7)
00000100:00100000:2.0:1773851849.515067:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2e8cc2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4fec6715-7b94-4677-aa38-bf65c6472a0a+11:1591361:x1858292324245312:12345-25346@kfi7:101:tuolumne-833448332813667328
00000100:00000001:13.0:1773851849.515068:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000200:2.0:1773851849.515068:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324245312
00000100:00000001:15.0:1773851849.515069:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851849.515069:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000020:00000001:2.0:1773851849.515069:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851849.515069:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
02000000:00000001:15.0:1773851849.515070:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851849.515070:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851849.515070:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000020:00000001:2.0:1773851849.515070:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.515070:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:15.0:1773851849.515071:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.515071:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
02000000:00000001:15.0:1773851849.515072:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.515072:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851849.515072:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858292324245312, found 0 last_xid 1858292324245311
00000100:00100000:15.0:1773851849.515073:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324245376
00000020:00000001:2.0:1773851849.515073:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851849.515074:0:609420:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851849.515074:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000020:00000001:2.0:1773851849.515074:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851849.515074:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851849.515075:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:2.0:1773851849.515075:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.515075:0:42868:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00000020:00000040:15.0:1773851849.515076:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=12
00000020:00000001:15.0:1773851849.515076:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00010000:00000001:2.0:1773851849.515076:0:42868:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:2.0:1773851849.515076:0:42868:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:2.0:1773851849.515076:0:42868:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00000020:00000001:15.0:1773851849.515077:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00010000:00000001:2.0:1773851849.515077:0:42868:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.515078:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851849.515078:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00010000:00000001:2.0:1773851849.515078:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00000020:00000010:15.0:1773851849.515079:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000944b52d0.
00010000:00000040:2.0:1773851849.515079:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e5f2fc73 count: 14
00010000:00000001:2.0:1773851849.515079:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00000020:00000010:15.0:1773851849.515080:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00010000:00000001:2.0:1773851849.515080:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00000020:00000010:15.0:1773851849.515081:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00010000:00000010:2.0:1773851849.515081:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000003ef0068.
00000020:00000001:2.0:1773851849.515081:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000100:00000040:15.0:1773851849.515082:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000020:00000040:2.0:1773851849.515082:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000003ef0068 with handle 0x21b6f08f07a6ac66 to hash
00000100:00000001:15.0:1773851849.515083:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851849.515083:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:15.0:1773851849.515083:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00000020:00000001:2.0:1773851849.515083:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.515083:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637074271375872 : -106999438175744 : ffff9eaf407f1200)
00010000:00000001:15.0:1773851849.515084:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.515084:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000010:2.0:1773851849.515084:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000795a147f.
00010000:00000001:2.0:1773851849.515084:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637074271375872 : -106999438175744 : ffff9eaf407f1200)
00010000:00000001:15.0:1773851849.515085:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:15.0:1773851849.515085:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00010000:00010000:2.0:1773851849.515085:0:42868:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000003ef0068/0x21b6f08f07a6ac66 lrc: 2/0,0 mode: --/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x0/0x0 rrc: 15 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xdd114cfd214afd6d expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00000020:00000040:15.0:1773851849.515086:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ac32bed5 refcount=3
00000020:00000001:15.0:1773851849.515087:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000040:2.0:1773851849.515087:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00000001:15.0:1773851849.515088:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000001:15.0:1773851849.515088:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000040:2.0:1773851849.515088:0:42868:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ffc3dfaf : new locks_count 6
00010000:00000001:15.0:1773851849.515089:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851849.515089:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.515089:0:42868:0:(genops.c:871:class_export_get()) GET export 00000000ffc3dfaf refcount=13
00000100:00000001:15.0:1773851849.515090:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515090:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:2.0:1773851849.515090:0:42868:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000100:00000001:15.0:1773851849.515091:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515091:0:42868:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:2.0:1773851849.515091:0:42868:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000100:00000001:15.0:1773851849.515092:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851849.515092:0:42868:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:2.0:1773851849.515092:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851849.515093:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240026139:0x16820:0x0]
00000100:00000001:15.0:1773851849.515094:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851849.515094:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000020:00000001:2.0:1773851849.515094:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:2.0:1773851849.515094:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637127652643512 : -106946056908104 : ffff9ebbae4492b8)
00000100:00100000:15.0:1773851849.515095:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 50273003
00000100:00000001:12.0:1773851849.515095:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851849.515095:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000004:00000001:2.0:1773851849.515095:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637127652643424 : -106946056908192 : ffff9ebbae449260)
00000004:00000001:2.0:1773851849.515095:0:42868:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851849.515096:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 2
00000100:00000001:12.0:1773851849.515096:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515096:0:42868:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000100:00000001:15.0:1773851849.515097:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197387264 : -106942512164352 : ffff9ebc818d1200)
00000100:00000001:12.0:1773851849.515097:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515097:0:42868:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:2.0:1773851849.515097:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851849.515097:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851849.515098:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000e43594c2.
00000100:00000040:15.0:1773851849.515099:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009e144d9b x1858292324245376/t0(0) o103->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 328/0 e 0 to 0 dl 1773851936 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
02000000:00000001:2.0:1773851849.515099:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.515100:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515100:0:42868:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.515101:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000004:00000001:2.0:1773851849.515101:0:42868:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:2.0:1773851849.515101:0:42868:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000100:00000001:15.0:1773851849.515102:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:2.0:1773851849.515102:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851849.515102:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851849.515103:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e144d9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:4fec6715-7b94-4677-aa38-bf65c6472a0a+13:39516:x1858292324245376:12345-25346@kfi7:103:
00000001:00000001:2.0:1773851849.515103:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000200:15.0:1773851849.515104:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324245376
00010000:00000001:15.0:1773851849.515104:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00000001:00000001:2.0:1773851849.515104:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.515104:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.515104:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00010000:00000002:15.0:1773851849.515105:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:15.0:1773851849.515105:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000001:00000001:2.0:1773851849.515105:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:15.0:1773851849.515106:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851849.515106:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000001:00000001:2.0:1773851849.515106:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
00000001:00000001:2.0:1773851849.515106:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851849.515106:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1424447 : 1424447 : 15bc3f)
02000000:00000010:15.0:1773851849.515107:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad15dc46.
02000000:00000001:15.0:1773851849.515107:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851849.515107:0:42868:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
00000100:00000001:15.0:1773851849.515108:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851849.515108:0:42868:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637111293937920 : -106962415613696 : ffff9eb7df368900)
00000004:00000001:2.0:1773851849.515108:0:42868:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00010000:00000001:15.0:1773851849.515109:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:15.0:1773851849.515109:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000004:00000001:2.0:1773851849.515109:0:42868:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851849.515109:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00010000:00000001:15.0:1773851849.515110:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:15.0:1773851849.515110:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851849.515110:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ac32bed5 refcount=3
00000001:00000001:2.0:1773851849.515110:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515110:0:42868:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000020:00000001:15.0:1773851849.515111:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00010000:00000001:15.0:1773851849.515111:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074271386816 : -106999438164800 : ffff9eaf407f3cc0)
00000004:00000001:2.0:1773851849.515111:0:42868:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515111:0:42868:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00010000:00000040:15.0:1773851849.515112:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e5f2fc73 count: 15
00000004:00000002:2.0:1773851849.515112:0:42868:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x240026139:0x16820:0x0]/output, ldlm_rep = 0000000065175ac7
00000004:00000001:15.0:1773851849.515113:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:15.0:1773851849.515113:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:2.0:1773851849.515113:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000020:00000001:15.0:1773851849.515114:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:15.0:1773851849.515114:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00000004:00000001:2.0:1773851849.515114:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:2.0:1773851849.515114:0:42868:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00010000:00000001:15.0:1773851849.515115:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851849.515115:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515115:0:42868:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:2.0:1773851849.515115:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.515116:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851849.515116:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e5f2fc73 count: 16
00010000:00000001:15.0:1773851849.515117:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:15.0:1773851849.515117:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.515117:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.515117:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000001:15.0:1773851849.515118:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851849.515119:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851849.515119:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000010:2.0:1773851849.515119:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000b2fd8ebc.
00000020:00000001:2.0:1773851849.515119:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00010000:00000001:15.0:1773851849.515120:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.515120:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000b2fd8ebc with handle 0x21b6f08f07a6ac6d to hash
00000020:00000001:2.0:1773851849.515120:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00000020:00000040:15.0:1773851849.515121:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000ac32bed5 with handle 0x21b6f08f07a6ac5f from hash
00010000:00000001:2.0:1773851849.515121:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000010:2.0:1773851849.515121:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a1f16a1c.
00010000:00000001:15.0:1773851849.515122:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.515122:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:15.0:1773851849.515123:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851849.515123:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515123:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515123:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.515124:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:15.0:1773851849.515124:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00010000:2.0:1773851849.515124:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 3/1,0 mode: --/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x0/0x0 rrc: 17 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000001:15.0:1773851849.515125:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.515126:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:15.0:1773851849.515126:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000040:2.0:1773851849.515126:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 17
00010000:00010000:15.0:1773851849.515127:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000ac32bed5/0x21b6f08f07a6ac5f lrc: 0/0,0 mode: --/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 18 type: IBT gid 0 flags: 0x44a01000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd66 expref: 13 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000001:2.0:1773851849.515127:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.515128:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.515128:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.515128:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.515129:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000040:15.0:1773851849.515130:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 16
00010000:00000001:2.0:1773851849.515130:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.515130:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000040:15.0:1773851849.515131:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ffc3dfaf : new locks_count 5
00000020:00000040:15.0:1773851849.515131:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 12
00010000:00000001:2.0:1773851849.515131:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.515131:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000010:15.0:1773851849.515132:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000bb4e0cac.
00010000:00000001:2.0:1773851849.515132:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.515132:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.515132:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240026139:0x16820:0x0].0x0 (00000000e5f2fc73) refcount = 16
00010000:00000040:15.0:1773851849.515133:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000001:15.0:1773851849.515133:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851849.515134:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000040:2.0:1773851849.515134:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851849.515134:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083abdf2b/0x21b6f08f07a6a734 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25344@kfi7 remote: 0xc2f4b565992771d6 expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515138:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515139:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000151b6737/0x21b6f08f07a6a6d2 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25857@kfi7 remote: 0x67ad6c07d46ccbaf expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515141:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515142:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000afa688a1/0x21b6f08f07a6a670 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25811@kfi7 remote: 0x852786f6c6fb3137 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515144:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515145:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000079e508bc/0x21b6f08f07a6a60e lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 26003@kfi7 remote: 0xd2845bd3ebcaa7a7 expref: 8 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515147:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515148:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1852e6b/0x21b6f08f07a6a5ac lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25234@kfi7 remote: 0x15722d0a1e061f4f expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515150:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515151:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9ef01dd/0x21b6f08f07a6a520 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25955@kfi7 remote: 0x1eaea03265ab6c39 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515153:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515154:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007719fd1a/0x21b6f08f07a6a4be lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25651@kfi7 remote: 0xf59cb3f75528841c expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515156:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515157:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dc869009/0x21b6f08f07a6a439 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25523@kfi7 remote: 0x55d9da689ceec0e3 expref: 10 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515159:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515161:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8bf78f8/0x21b6f08f07a6a34b lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afce8 expref: 12 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515163:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515164:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ff89dfb8/0x21b6f08f07a6a2cd lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25697@kfi7 remote: 0x8a2d120cd21bdfbe expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515166:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515167:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ae013a48/0x21b6f08f07a6a225 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25776@kfi7 remote: 0x979753abbfa0d8a1 expref: 8 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515169:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515170:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050dcfb9c/0x21b6f08f07a6a1a7 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0x0 bits 0x13/0x0 rrc: 16 type: IBT gid 0 flags: 0x40200000000000 nid: 25457@kfi7 remote: 0x72480a5c17042aae expref: 8 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515172:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00010000:2.0:1773851849.515173:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 3/1,0 mode: CR/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515175:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000001:2.0:1773851849.515176:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.515176:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.515177:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515177:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.515178:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515178:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515179:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:15.0:1773851849.515180:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:15.0:1773851849.515180:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240026139:0x16820:0x0].0x0 (00000000e5f2fc73)
00010000:00000001:2.0:1773851849.515180:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.515180:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.515181:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00010000:2.0:1773851849.515181:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 3/1,0 mode: CR/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 16 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000001:15.0:1773851849.515182:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.515183:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:15.0:1773851849.515183:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000040:2.0:1773851849.515183:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 15
00010000:00000001:2.0:1773851849.515183:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00010000:15.0:1773851849.515184:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:15.0:1773851849.515184:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515184:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851849.515185:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851849.515185:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515185:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515185:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00000100:00001000:15.0:1773851849.515186:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=103 v=66 (1 1 1 1)
00010000:00000001:2.0:1773851849.515186:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:2.0:1773851849.515186:0:42868:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000008d6b0941.
00000100:00000001:15.0:1773851849.515187:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851849.515187:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00010000:00000010:2.0:1773851849.515187:0:42868:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000c1bdad60.
00000100:00000001:15.0:1773851849.515188:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
00010000:00000001:2.0:1773851849.515188:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.515188:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000009d396318.
02000000:00000001:15.0:1773851849.515189:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000020:00000001:2.0:1773851849.515189:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
02000000:00000001:15.0:1773851849.515190:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.515190:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000020:00000040:2.0:1773851849.515190:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 000000009d396318 with handle 0x21b6f08f07a6ac74 to hash
00000020:00000001:2.0:1773851849.515190:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00000100:00000040:15.0:1773851849.515191:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25347@kfi7
00010000:00000001:2.0:1773851849.515191:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000010:2.0:1773851849.515191:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000026012d57.
00000400:00000010:15.0:1773851849.515192:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9765a66.
00010000:00000001:2.0:1773851849.515192:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00000100:00000200:15.0:1773851849.515193:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1858292324245376, offset 224
00010000:00000001:2.0:1773851849.515193:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515193:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851849.515194:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25347@kfi7
00010000:00010000:2.0:1773851849.515194:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 3/1,0 mode: --/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00000400:00000200:15.0:1773851849.515195:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:15.0:1773851849.515196:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00010000:00000040:2.0:1773851849.515196:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00000400:00000200:15.0:1773851849.515197:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00010000:00000001:2.0:1773851849.515197:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.515197:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.515197:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00000400:00000200:15.0:1773851849.515198:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00010000:00000001:2.0:1773851849.515198:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.515198:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851849.515199:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25347@kfi7 local destination
00010000:00000001:2.0:1773851849.515199:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.515199:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515200:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.515200:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.515200:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00000400:00000200:15.0:1773851849.515201:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768421:8768421:1024:4294967295] 25347@kfi7 LPNI seq info [16384155:16384155:16:4294967295]
00010000:00000001:2.0:1773851849.515201:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.515201:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240026139:0x16820:0x0].0xb4ee6ff5 (000000008d6b0941) refcount = 1
00000400:00000200:15.0:1773851849.515202:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00010000:00010000:2.0:1773851849.515202:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 3/1,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00000400:00000200:15.0:1773851849.515203:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:15.0:1773851849.515204:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25347@kfi7(25347@kfi7:25347@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851849.515206:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00010000:00000040:2.0:1773851849.515206:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00000800:00000200:15.0:1773851849.515207:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00010000:00000001:2.0:1773851849.515207:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.515207:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00000800:00000200:15.0:1773851849.515208:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00010000:00000001:2.0:1773851849.515208:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515208:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.515209:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515209:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851849.515210:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00010000:00000001:2.0:1773851849.515210:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.515210:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.515211:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.515211:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 3/1,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00000800:00000200:15.0:1773851849.515212:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df Using peer 25347@kfi7(0x4df)
00010000:00000040:2.0:1773851849.515214:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00000001:2.0:1773851849.515214:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00000800:00000200:15.0:1773851849.515215:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x4df: rc=0
00010000:00000001:2.0:1773851849.515215:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515215:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515215:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515216:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515216:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009d396318 refcount=3
00000800:00000200:15.0:1773851849.515217:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000020:00000001:2.0:1773851849.515217:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000001:2.0:1773851849.515218:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00000100:00000001:15.0:1773851849.515219:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851849.515219:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:2.0:1773851849.515219:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515219:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.515219:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.515220:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851849.515220:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515220:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851849.515221:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009e144d9b x1858292324245376/t0(0) o103->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 328/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000004:00000001:2.0:1773851849.515221:0:42868:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:2.0:1773851849.515222:0:42868:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:2.0:1773851849.515223:0:42868:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:2.0:1773851849.515223:0:42868:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.515224:0:42868:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00000100:00100000:15.0:1773851849.515225:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e144d9b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:4fec6715-7b94-4677-aa38-bf65c6472a0a+12:39516:x1858292324245376:12345-25346@kfi7:103: Request processed in 123us (159us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851849.515227:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 50273003
00000100:00000040:15.0:1773851849.515228:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 1
00080000:00000001:2.0:1773851849.515228:0:42868:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00000100:00000001:15.0:1773851849.515229:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851849.515229:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851849.515229:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df TN_EVENT_TX_OK event status 0
00080000:00000001:2.0:1773851849.515229:0:42868:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:2.0:1773851849.515229:0:42868:0:(osd_index.c:945:osd_seq_exists()) Process entered
00000020:00000010:15.0:1773851849.515230:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851849.515230:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
80000000:00000001:2.0:1773851849.515230:0:42868:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:2.0:1773851849.515230:0:42868:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:2.0:1773851849.515230:0:42868:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:15.0:1773851849.515231:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000944b52d0.
00000400:00000200:13.0:1773851849.515231:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
80000000:00000001:2.0:1773851849.515231:0:42868:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:2.0:1773851849.515231:0:42868:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:15.0:1773851849.515232:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 11
00000100:00000001:15.0:1773851849.515232:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851849.515232:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25347@kfi7: PUT: OK
00000400:00000200:13.0:1773851849.515232:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9765a66
00080000:00000001:2.0:1773851849.515232:0:42868:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851849.515233:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9765a66.
00000004:00000001:2.0:1773851849.515233:0:42868:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515233:0:42868:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851849.515234:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851849.515234:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000004:00000001:2.0:1773851849.515234:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851849.515234:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x200024c5d:0x11b95:0x0]
00000020:00000001:2.0:1773851849.515234:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000400:00000200:13.0:1773851849.515235:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000800:00000200:13.0:1773851849.515236:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df Transaction freed
00000020:00000001:2.0:1773851849.515236:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637157048966456 : -106916660585160 : ffff9ec2866cdd38)
00000004:00000001:2.0:1773851849.515236:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637157048966368 : -106916660585248 : ffff9ec2866cdce0)
00000004:00000001:2.0:1773851849.515237:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:2.0:1773851849.515238:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:2.0:1773851849.515238:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851849.515238:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851849.515239:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000084605880 count: 13
00010000:00000001:2.0:1773851849.515240:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.515240:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851849.515241:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000502a26af.
00000020:00000001:2.0:1773851849.515242:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851849.515242:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000502a26af with handle 0x21b6f08f07a6ac7b to hash
00000020:00000001:2.0:1773851849.515243:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851849.515244:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000010:2.0:1773851849.515244:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000d70befba.
00010000:00000001:2.0:1773851849.515245:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:2.0:1773851849.515246:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515246:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.515247:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000502a26af/0x21b6f08f07a6ac7b lrc: 3/1,0 mode: --/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x0/0x0 rrc: 14 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515249:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000001:2.0:1773851849.515249:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851849.515250:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851849.515251:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851849.515251:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.515252:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515253:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851849.515253:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515254:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851849.515254:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851849.515255:0:42868:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851849.515255:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851849.515255:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x200024c5d:0x11b95:0x0].0x0 (0000000084605880) refcount = 13
00010000:00000040:2.0:1773851849.515256:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851849.515257:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004fad3bd6/0x21b6f08f07a6a750 lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25344@kfi7 remote: 0xc2f4b565992771dd expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515259:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515261:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000517777e3/0x21b6f08f07a6a6ee lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25857@kfi7 remote: 0x67ad6c07d46ccbb6 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515263:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515264:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000def1ea9f/0x21b6f08f07a6a68c lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25811@kfi7 remote: 0x852786f6c6fb313e expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515266:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515267:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001d1ecacb/0x21b6f08f07a6a62a lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 26003@kfi7 remote: 0xd2845bd3ebcaa7ae expref: 8 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515269:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515270:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000500f6572/0x21b6f08f07a6a5c8 lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25234@kfi7 remote: 0x15722d0a1e061f56 expref: 9 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515272:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515273:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000372ef867/0x21b6f08f07a6a53c lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25955@kfi7 remote: 0x1eaea03265ab6c40 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515277:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515278:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a3a232da/0x21b6f08f07a6a4da lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25651@kfi7 remote: 0xf59cb3f755288423 expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515280:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515281:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041c31031/0x21b6f08f07a6a455 lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25523@kfi7 remote: 0x55d9da689ceec0ea expref: 10 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515283:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515285:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef8ab781/0x21b6f08f07a6a367 lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afcef expref: 11 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515286:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515287:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7eefc7b/0x21b6f08f07a6a2e9 lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25697@kfi7 remote: 0x8a2d120cd21bdfc5 expref: 8 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515289:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515290:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263e601e/0x21b6f08f07a6a241 lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25776@kfi7 remote: 0x979753abbfa0d8a8 expref: 8 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515292:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000040:2.0:1773851849.515293:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008667b7ff/0x21b6f08f07a6a1c3 lrc: 2/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25457@kfi7 remote: 0x72480a5c17042ab5 expref: 8 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515295:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00010000:2.0:1773851849.515296:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000502a26af/0x21b6f08f07a6ac7b lrc: 3/1,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515298:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000001:2.0:1773851849.515298:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851849.515300:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.515300:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515301:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851849.515301:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515302:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515303:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851849.515303:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851849.515304:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.515304:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000502a26af/0x21b6f08f07a6ac7b lrc: 3/1,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515306:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000001:2.0:1773851849.515307:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851849.515307:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515307:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515308:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515308:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515308:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000502a26af refcount=3
00000020:00000001:2.0:1773851849.515309:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:2.0:1773851849.515310:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:2.0:1773851849.515310:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515311:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.515311:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515313:0:42868:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:2.0:1773851849.515314:0:42868:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x200024c5d:0x11b95:0x0]
00000004:00000001:2.0:1773851849.515315:0:42868:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515316:0:42868:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515316:0:42868:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:2.0:1773851849.515317:0:42868:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:2.0:1773851849.515318:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:2.0:1773851849.515319:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515319:0:42868:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515320:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515320:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515321:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000502a26af refcount=3
00000020:00000001:2.0:1773851849.515321:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:2.0:1773851849.515322:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00000004:00010000:2.0:1773851849.515323:0:42868:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000502a26af/0x21b6f08f07a6ac7b lrc: 3/1,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515325:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000001:2.0:1773851849.515326:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515326:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.515326:0:42868:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:2.0:1773851849.515327:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:2.0:1773851849.515327:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851849.515328:0:42868:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:2.0:1773851849.515328:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:2.0:1773851849.515329:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515329:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515329:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2fd8ebc refcount=3
00000020:00000001:2.0:1773851849.515330:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851849.515330:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851849.515331:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:2.0:1773851849.515332:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 3/1,0 mode: CR/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515334:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00000001:2.0:1773851849.515334:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515335:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.515335:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 2/0,0 mode: CR/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515337:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00000001:2.0:1773851849.515338:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515338:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515339:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:2.0:1773851849.515339:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 3/0,0 mode: CR/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515344:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00010000:2.0:1773851849.515345:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000b2fd8ebc already unused, calling callback (000000001690cbe4)
00000004:00000001:2.0:1773851849.515346:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:2.0:1773851849.515346:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:2.0:1773851849.515346:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 3/0,0 mode: CR/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515349:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00000001:2.0:1773851849.515349:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:2.0:1773851849.515349:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515350:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515350:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2fd8ebc refcount=4
00000020:00000001:2.0:1773851849.515351:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851849.515351:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851849.515352:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:2.0:1773851849.515352:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 4/0,0 mode: CR/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515355:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00000001:2.0:1773851849.515356:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:2.0:1773851849.515356:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:2.0:1773851849.515356:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515357:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:2.0:1773851849.515358:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.515358:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515358:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.515359:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000b2fd8ebc with handle 0x21b6f08f07a6ac6d from hash
00010000:00000001:2.0:1773851849.515360:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.515360:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515361:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515361:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:2.0:1773851849.515361:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.515362:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515363:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:2.0:1773851849.515363:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.515364:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.515364:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240026139:0x16820:0x0].0x0 (00000000e5f2fc73)
00010000:00010000:2.0:1773851849.515365:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:2.0:1773851849.515366:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515367:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515367:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.515368:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:2.0:1773851849.515368:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515369:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515369:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515370:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515370:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.515371:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 2/0,0 mode: --/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515373:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00000001:2.0:1773851849.515373:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515374:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515374:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:2.0:1773851849.515374:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:2.0:1773851849.515375:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.515375:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6ac6d lrc: 0/0,0 mode: --/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515377:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 14
00010000:00000010:2.0:1773851849.515378:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a1f16a1c.
00010000:00000040:2.0:1773851849.515379:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000001:2.0:1773851849.515379:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.515380:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:2.0:1773851849.515380:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:2.0:1773851849.515380:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515381:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515381:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009d396318 refcount=3
00000020:00000001:2.0:1773851849.515392:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000001:2.0:1773851849.515392:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000001:2.0:1773851849.515393:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:2.0:1773851849.515393:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 3/1,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515396:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00000001:2.0:1773851849.515396:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515396:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.515397:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 2/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515399:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00000001:2.0:1773851849.515399:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515400:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515400:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:2.0:1773851849.515401:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 3/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515403:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00010000:2.0:1773851849.515404:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000009d396318 already unused, calling callback (000000001690cbe4)
00000004:00000001:2.0:1773851849.515404:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:2.0:1773851849.515405:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:2.0:1773851849.515405:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 3/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515407:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00000001:2.0:1773851849.515408:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:2.0:1773851849.515408:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515408:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515409:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009d396318 refcount=4
00000020:00000001:2.0:1773851849.515409:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000001:2.0:1773851849.515410:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000001:2.0:1773851849.515411:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:2.0:1773851849.515411:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 4/0,0 mode: PR/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515414:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00000001:2.0:1773851849.515414:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:2.0:1773851849.515415:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:2.0:1773851849.515415:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515416:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:2.0:1773851849.515416:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.515416:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515417:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.515417:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000009d396318 with handle 0x21b6f08f07a6ac74 from hash
00010000:00000001:2.0:1773851849.515418:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.515418:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515418:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515419:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:2.0:1773851849.515419:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.515420:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515420:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:2.0:1773851849.515420:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.515421:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.515421:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240026139:0x16820:0x0].0xb4ee6ff5 (000000008d6b0941)
00010000:00010000:2.0:1773851849.515422:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:2.0:1773851849.515423:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515423:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515424:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.515424:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:2.0:1773851849.515425:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515425:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515425:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515426:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515426:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851849.515427:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 2/0,0 mode: --/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515432:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00000001:2.0:1773851849.515432:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515433:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515433:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:2.0:1773851849.515433:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:2.0:1773851849.515434:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.515434:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6ac74 lrc: 0/0,0 mode: --/PR res: [0x240026139:0x16820:0x0].0xb4ee6ff5 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515436:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 1
00010000:00000010:2.0:1773851849.515437:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000026012d57.
00010000:00000040:2.0:1773851849.515437:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008d6b0941 count: 0
00010000:00000010:2.0:1773851849.515438:0:42868:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000c1bdad60.
00010000:00000001:2.0:1773851849.515439:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.515439:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:2.0:1773851849.515439:0:42868:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:2.0:1773851849.515440:0:42868:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:2.0:1773851849.515440:0:42868:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:2.0:1773851849.515440:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851849.515441:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.515441:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000502a26af refcount=3
00000020:00000001:2.0:1773851849.515442:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:2.0:1773851849.515442:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00000004:00000040:2.0:1773851849.515443:0:42868:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000ffc3dfaf : new locks_count 6
00000020:00000040:2.0:1773851849.515444:0:42868:0:(genops.c:871:class_export_get()) GET export 00000000ffc3dfaf refcount=12
00010000:00000001:2.0:1773851849.515445:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515445:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851849.515446:0:42868:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851849.515446:0:42868:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:2.0:1773851849.515447:0:42868:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:2.0:1773851849.515447:0:42868:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:2.0:1773851849.515447:0:42868:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:2.0:1773851849.515448:0:42868:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:2.0:1773851849.515449:0:42868:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:2.0:1773851849.515449:0:42868:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:2.0:1773851849.515450:0:42868:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851849.515450:0:42868:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851849.515451:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:2.0:1773851849.515452:0:42868:0:(lu_object.c:224:lu_object_put()) Add 000000005c33f9a2/00000000c2fc8738 to site lru. bkt: 00000000262bba3e
00000004:00000001:2.0:1773851849.515452:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851849.515453:0:42868:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:2.0:1773851849.515453:0:42868:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:2.0:1773851849.515454:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851849.515454:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515454:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515455:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851849.515455:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851849.515456:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000003ef0068 with handle 0x21b6f08f07a6ac66 from hash
00010000:00000001:2.0:1773851849.515456:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851849.515457:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515457:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515457:0:42868:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:2.0:1773851849.515458:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851849.515458:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000003ef0068/0x21b6f08f07a6ac66 lrc: 0/0,0 mode: --/CR res: [0x240026139:0x16820:0x0].0x0 bits 0x2/0x0 rrc: 14 type: IBT gid 0 flags: 0x44000000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd6d expref: 12 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515461:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 13
00010000:00000040:2.0:1773851849.515461:0:42868:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ffc3dfaf : new locks_count 5
00000020:00000040:2.0:1773851849.515462:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 11
00010000:00000010:2.0:1773851849.515463:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000795a147f.
00010000:00000040:2.0:1773851849.515463:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e5f2fc73 count: 12
00010000:00000001:2.0:1773851849.515464:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851849.515464:0:42868:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515465:0:42868:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:2.0:1773851849.515465:0:42868:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000502a26af/0x21b6f08f07a6ac7b lrc: 3/0,0 mode: PR/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 14 type: IBT gid 0 flags: 0x40200000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd6d expref: 11 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851849.515468:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000001:2.0:1773851849.515469:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851849.515469:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851849.515470:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200024c5d:0x11b95:0x0].0x0 (0000000084605880)
00010000:00010000:2.0:1773851849.515471:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:2.0:1773851849.515471:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851849.515472:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.515472:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851849.515473:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851849.515473:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851849.515473:0:42868:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000502a26af, rc 0)
00000020:00000001:2.0:1773851849.515474:0:42868:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851849.515475:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260458323, transno 0, xid 1858292324245312
00010000:00000001:2.0:1773851849.515476:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851849.515476:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a2e8cc2e x1858292324245312/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:489/0 lens 576/640 e 0 to 0 dl 1773852604 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833448332813667328'
00010000:00000001:2.0:1773851849.515479:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851849.515479:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851849.515480:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=82 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851849.515481:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851849.515482:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00000100:00000001:2.0:1773851849.515483:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
02000000:00000001:2.0:1773851849.515483:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851849.515484:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.515485:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851849.515486:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25346@kfi7
00000400:00000010:2.0:1773851849.515486:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000099c0224b.
00000100:00000200:2.0:1773851849.515487:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858292324245312, offset 224
00000400:00000200:2.0:1773851849.515489:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25346@kfi7
00000400:00000200:2.0:1773851849.515490:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.515490:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:2.0:1773851849.515491:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:2.0:1773851849.515493:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:2.0:1773851849.515494:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25346@kfi7 local destination
00000400:00000200:2.0:1773851849.515496:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768422:8768422:1024:4294967295] 25346@kfi7 LPNI seq info [16384156:16384156:16:4294967295]
00000400:00000200:2.0:1773851849.515498:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:2.0:1773851849.515499:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:2.0:1773851849.515501:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25346@kfi7(25346@kfi7:25346@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851849.515502:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000800:00000200:2.0:1773851849.515504:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851849.515505:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:2.0:1773851849.515507:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851849.515509:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 Using peer 25346@kfi7(0x1000000000004d5)
00000800:00000200:2.0:1773851849.515512:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000e8d7e86a: Posted send of 740 bytes to peer 0x1000000000004d5: rc=0
00000800:00000200:2.0:1773851849.515514:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851849.515516:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.515517:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:2.0:1773851849.515517:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851849.515518:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851849.515518:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851849.515519:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a2e8cc2e x1858292324245312/t0(0) o101->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:489/0 lens 576/640 e 0 to 0 dl 1773852604 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833448332813667328'
00000100:00100000:2.0:1773851849.515522:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2e8cc2e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4fec6715-7b94-4677-aa38-bf65c6472a0a+11:1591361:x1858292324245312:12345-25346@kfi7:101:tuolumne-833448332813667328 Request processed in 456us (480us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851849.515524:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 408701471
00000100:00000040:2.0:1773851849.515525:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 0
00000100:00000001:2.0:1773851849.515526:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851849.515526:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851849.515527:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000800:00000200:1.0:1773851849.515527:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 TN_EVENT_TX_OK event status 0
00000020:00000010:2.0:1773851849.515528:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ebfb08ad.
00000020:00000010:2.0:1773851849.515529:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009abda479.
00000400:00000200:1.0:1773851849.515529:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:2.0:1773851849.515530:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 10
00000100:00000001:2.0:1773851849.515530:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851849.515530:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25346@kfi7: PUT: OK
00000400:00000200:1.0:1773851849.515531:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000099c0224b
00000400:00000010:1.0:1773851849.515532:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000099c0224b.
00000100:00000001:1.0:1773851849.515532:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851849.515533:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851849.515534:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000800:00000200:1.0:1773851849.515535:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 Transaction freed
00000800:00000200:1.0:1773851849.515761:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.515761:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851849.515763:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851849.515765:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851849.515767:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515768:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25346@kfi7 : PUT - for me
00000400:00000200:1.0:1773851849.515769:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515770:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:1.0:1773851849.515771:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515771:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:1.0:1773851849.515772:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:1.0:1773851849.515773:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.515774:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 328 into portal 17 MB=0x69a1b65e02000
00000400:00000200:1.0:1773851849.515776:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-25346@kfi7 of length 328/328 into md 0x7fb60e481 [2] + 0
00000800:00000200:1.0:1773851849.515778:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851849.515780:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851849.515781:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25346@kfi7: PUT: OK
00000100:00000001:1.0:1773851849.515782:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851849.515783:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:1.0:1773851849.515784:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000e5f6861.
00000100:00000040:1.0:1773851849.515784:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000000e5f6861 x1858292324245504 msgsize 328
00000100:00100000:1.0:1773851849.515786:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25346@kfi7)
00000100:00000001:1.0:1773851849.515787:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851849.515788:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000800:00000200:1.0:1773851849.515789:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851849.515789:0:61144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851849.515790:0:61144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851849.515790:0:61144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851849.515791:0:61144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851849.515792:0:61144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851849.515793:0:61144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324245504
00000020:00000001:0.0:1773851849.515793:0:61144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851849.515794:0:61144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000020:00000001:0.0:1773851849.515795:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851849.515795:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=11
00000020:00000001:0.0:1773851849.515796:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000020:00000001:0.0:1773851849.515797:0:61144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000100:00000001:0.0:1773851849.515799:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851849.515799:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851849.515800:0:61144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2dc323e.
00000020:00000010:0.0:1773851849.515801:0:61144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851849.515802:0:61144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000040:0.0:1773851849.515804:0:61144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:0.0:1773851849.515805:0:61144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851849.515805:0:61144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:0.0:1773851849.515806:0:61144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:0.0:1773851849.515806:0:61144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851849.515807:0:61144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:0.0:1773851849.515808:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851849.515809:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851849.515809:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000502a26af refcount=3
00000020:00000001:0.0:1773851849.515810:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:0.0:1773851849.515810:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:0.0:1773851849.515811:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851849.515811:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851849.515812:0:61144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851849.515812:0:61144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851849.515813:0:61144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851849.515814:0:61144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851849.515816:0:61144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851849.515817:0:82951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851849.515817:0:82951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851849.515817:0:61144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851849.515818:0:61144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 45419463
00000100:00000001:3.0:1773851849.515819:0:82951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851849.515819:0:61144:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 1
00000100:00000001:0.0:1773851849.515819:0:61144:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114618887936 : -106959090663680 : ffff9eb8a5653f00)
00000100:00000001:3.0:1773851849.515820:0:82951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851849.515820:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000e5f6861 x1858292324245504/t0(0) o103->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 328/0 e 0 to 0 dl 1773851936 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:0.0:1773851849.515824:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851849.515824:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851849.515825:0:61144:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e5f6861 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4fec6715-7b94-4677-aa38-bf65c6472a0a+11:39509:x1858292324245504:12345-25346@kfi7:103:
00000100:00000200:0.0:1773851849.515827:0:61144:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324245504
00010000:00000001:0.0:1773851849.515827:0:61144:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:0.0:1773851849.515828:0:61144:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:0.0:1773851849.515829:0:61144:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:0.0:1773851849.515829:0:61144:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851849.515830:0:61144:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851849.515830:0:61144:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000043c0a6a8.
02000000:00000001:0.0:1773851849.515831:0:61144:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851849.515832:0:61144:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851849.515832:0:61144:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:0.0:1773851849.515833:0:61144:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:0.0:1773851849.515834:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851849.515834:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851849.515834:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000502a26af refcount=3
00000020:00000001:0.0:1773851849.515835:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000001:0.0:1773851849.515835:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951957056 : -106906757594560 : ffff9ec4d4b08240)
00010000:00000040:0.0:1773851849.515836:0:61144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000084605880 count: 14
00000004:00000001:0.0:1773851849.515837:0:61144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:0.0:1773851849.515838:0:61144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:0.0:1773851849.515838:0:61144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851849.515839:0:61144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:0.0:1773851849.515840:0:61144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851849.515840:0:61144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851849.515841:0:61144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851849.515841:0:61144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851849.515842:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851849.515842:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851849.515843:0:61144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851849.515843:0:61144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851849.515844:0:61144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000502a26af with handle 0x21b6f08f07a6ac7b from hash
00010000:00000001:0.0:1773851849.515844:0:61144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851849.515845:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851849.515845:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851849.515845:0:61144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851849.515846:0:61144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851849.515846:0:61144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851849.515847:0:61144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851849.515847:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851849.515847:0:61144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000502a26af/0x21b6f08f07a6ac7b lrc: 0/0,0 mode: --/PR res: [0x200024c5d:0x11b95:0x0].0x0 bits 0x1/0x0 rrc: 15 type: IBT gid 0 flags: 0x44a01000000000 nid: 25346@kfi7 remote: 0xdd114cfd214afd6d expref: 11 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851849.515850:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 14
00010000:00000040:0.0:1773851849.515851:0:61144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ffc3dfaf : new locks_count 4
00000020:00000040:0.0:1773851849.515851:0:61144:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 10
00010000:00000010:0.0:1773851849.515852:0:61144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000d70befba.
00010000:00000040:0.0:1773851849.515853:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 13
00010000:00000001:0.0:1773851849.515853:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851849.515853:0:61144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851849.515854:0:61144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851849.515854:0:61144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200024c5d:0x11b95:0x0].0x0 (0000000084605880)
00010000:00000001:0.0:1773851849.515855:0:61144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851849.515856:0:61144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851849.515856:0:61144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:0.0:1773851849.515857:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000084605880 count: 12
00010000:00010000:0.0:1773851849.515857:0:61144:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:0.0:1773851849.515858:0:61144:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851849.515859:0:61144:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851849.515859:0:61144:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851849.515860:0:61144:0:(import.c:1951:at_measured()) add 1 to 00000000fe6e7196 time=103 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851849.515861:0:61144:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851849.515861:0:61144:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00000100:00000001:0.0:1773851849.515862:0:61144:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
02000000:00000001:0.0:1773851849.515863:0:61144:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851849.515863:0:61144:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851849.515864:0:61144:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851849.515865:0:61144:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25346@kfi7
00000400:00000010:0.0:1773851849.515865:0:61144:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007a35718f.
00000100:00000200:0.0:1773851849.515866:0:61144:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1858292324245504, offset 224
00000400:00000200:0.0:1773851849.515867:0:61144:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25346@kfi7
00000400:00000200:0.0:1773851849.515869:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:0.0:1773851849.515870:0:61144:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 1
00000400:00000200:0.0:1773851849.515871:0:61144:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:0.0:1773851849.515872:0:61144:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000400:00000200:0.0:1773851849.515873:0:61144:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25346@kfi7 local destination
00000400:00000200:0.0:1773851849.515874:0:61144:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768423:8768423:1024:4294967295] 25346@kfi7 LPNI seq info [16384157:16384157:16:4294967295]
00000400:00000200:0.0:1773851849.515876:0:61144:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000400:00000200:0.0:1773851849.515877:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:0.0:1773851849.515879:0:61144:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25346@kfi7(25346@kfi7:25346@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851849.515880:0:61144:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 3
00000800:00000200:0.0:1773851849.515881:0:61144:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851849.515883:0:61144:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851849.515885:0:61144:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851849.515887:0:61144:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 Using peer 25346@kfi7(0x1000000000004d5)
00000800:00000200:0.0:1773851849.515890:0:61144:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x1000000000004d5: rc=0
00000800:00000200:0.0:1773851849.515892:0:61144:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851849.515893:0:61144:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851849.515894:0:61144:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:0.0:1773851849.515895:0:61144:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851849.515895:0:61144:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851849.515896:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000e5f6861 x1858292324245504/t0(0) o103->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:576/0 lens 328/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:0.0:1773851849.515901:0:61144:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e5f6861 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:4fec6715-7b94-4677-aa38-bf65c6472a0a+10:39509:x1858292324245504:12345-25346@kfi7:103: Request processed in 75us (114us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851849.515903:0:61144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 45419463
00000100:00000040:0.0:1773851849.515904:0:61144:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 0
00000100:00000001:0.0:1773851849.515904:0:61144:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851849.515905:0:61144:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851849.515905:0:61144:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851849.515906:0:61144:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851849.515907:0:61144:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2dc323e.
00000020:00000040:0.0:1773851849.515907:0:61144:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 9
00000100:00000001:0.0:1773851849.515908:0:61144:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851849.515913:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851849.515915:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851849.515916:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25346@kfi7: PUT: OK
00000400:00000200:2.0:1773851849.515917:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007a35718f
00000400:00000010:2.0:1773851849.515917:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007a35718f.
00000100:00000001:2.0:1773851849.515918:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851849.515918:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851849.515919:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000089df9b9 nid 25346@kfi7 refs 2
00000800:00000200:2.0:1773851849.515921:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25346@kfi7(000000009b828932):0x0 lsk 1238 rsk 57 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004d5 Transaction freed
00010000:00000010:15.1F:1773851849.520727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000028397a70.
00010000:00000010:2.1F:1773851849.520727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000fd1025e2.
00010000:00000010:2.1:1773851849.520729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000000017e741.
00010000:00000010:2.1:1773851849.520730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000327b941a.
00010000:00000010:2.1:1773851849.520731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d651f136.
00010000:00000010:15.1:1773851849.524727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000ac32bed5.
00010000:00000010:2.1:1773851849.524727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000a83c471f.
00010000:00000010:2.1:1773851849.524728:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000003cc3ba26.
00010000:00000010:0.1F:1773851849.524728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000502a26af.
00010000:00000010:2.1:1773851849.524729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000005cc1f30b.
00010000:00000010:2.1:1773851849.524730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000007e4075d0.
00010000:00000010:2.1:1773851849.524730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000b2fd8ebc.
00010000:00000010:2.1:1773851849.524731:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000008d6b0941.
00010000:00000010:2.1:1773851849.524732:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000009d396318.
00010000:00000010:2.1:1773851849.524732:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000003ef0068.
00000800:00000200:31.0:1773851849.535959:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851849.535959:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851849.535960:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:29.0:1773851849.535960:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851849.535961:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:29.0:1773851849.535961:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851849.535963:0:2465875:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17248@kfi7(000000000c2ea980):0x944 version: 2; local version 2; negotiated version: 2
00000800:00000200:31.0:1773851849.535965:0:2465875:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 Using peer 17248@kfi7(0x944)
00000400:00000200:31.0:1773851849.535968:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17248@kfi7 to cpt 7
00000800:00000200:29.0:1773851849.535968:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:31.0:1773851849.535970:0:2465875:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002809a79a: Posted send of 38 bytes to peer 0x944: rc=0
00000400:00000200:29.0:1773851849.535970:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17248@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.535971:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17248@kfi7 : PUT - for me
00000800:00000200:31.0:1773851849.535972:0:2465875:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851849.535972:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17248@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.535974:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1a1c811 nid 17248@kfi7 refs 1
00000400:00000200:29.0:1773851849.535976:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17248@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.535976:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1a1c811 nid 17248@kfi7 refs 2
00000400:00000200:29.0:1773851849.535978:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f1a1c811 nid 17248@kfi7 refs 3
00000400:00000200:29.0:1773851849.535978:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17249@kfi7 to cpt 2
00000400:00000200:29.0:1773851849.535980:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17249@kfi7 of length 224 into portal 12 MB=0x69b4b594e0280
00000400:00000200:29.0:1773851849.535981:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17249@kfi7 of length 224/224 into md 0x77fe139dd [64] + 156640
00000800:00000200:29.0:1773851849.535983:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851849.535984:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851849.535984:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851849.535985:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17248@kfi7: PUT: OK
00000800:00000200:31.0:1773851849.535986:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 Transaction freed
00000100:00000001:29.0:1773851849.535986:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851849.535987:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851849.535988:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6eabe39.
00000100:00000040:29.0:1773851849.535989:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a6eabe39 x1859597783401088 msgsize 224
00000100:00100000:29.0:1773851849.535991:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17249@kfi7 (source: 12345-17248@kfi7)
00000100:00000001:29.0:1773851849.535992:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851849.535993:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f1a1c811 nid 17248@kfi7 refs 2
00000800:00000200:29.0:1773851849.535995:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851849.535998:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851849.535998:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851849.535999:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851849.535999:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851849.536000:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851849.536001:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597783401088
00000020:00000001:29.0:1773851849.536002:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851849.536002:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81373
00000020:00000001:29.0:1773851849.536003:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851849.536007:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f63cf0b7 refcount=5
00000020:00000001:29.0:1773851849.536008:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136006989824 : -106937702561792 : ffff9ebda039c800)
00000020:00000001:29.0:1773851849.536009:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136006989824 : -106937702561792 : ffff9ebda039c800)
00000100:00000001:29.0:1773851849.536010:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851849.536011:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851849.536013:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009b78eae0.
00000020:00000010:29.0:1773851849.536014:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851849.536015:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851849.536016:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851849.536017:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851849.536017:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851849.536019:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851849.536019:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851849.536020:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.536021:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.536022:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851849.536022:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851849.536022:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851849.536023:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851849.536024:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17249@kfi7, seq: 2055441
00000100:00000040:29.0:1773851849.536024:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f63cf0b7 : new rpc_count 1
00000100:00000001:31.0:1773851849.536025:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.536025:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.536025:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125762057344 : -106947947494272 : ffff9ebb3d948480)
00000100:00000040:29.0:1773851849.536026:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6eabe39 x1859597783401088/t0(0) o400->e64416a0-133f-4034-a9b2-278a75eebdd0@17249@kfi7:637/0 lens 224/0 e 0 to 0 dl 1773851997 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1568-0'
00000100:00000001:29.0:1773851849.536029:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851849.536030:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851849.536031:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6eabe39 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e64416a0-133f-4034-a9b2-278a75eebdd0+5:39686:x1859597783401088:12345-17249@kfi7:400:default-tuolumne1568-0
00000100:00000200:29.0:1773851849.536032:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597783401088
00000020:00000001:29.0:1773851849.536033:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851849.536034:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851849.536034:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.536036:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851849.536036:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851849.536037:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851849.536038:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597783401088, found 0 last_xid 1859597783401087
00000020:00000001:29.0:1773851849.536038:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851849.536039:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851849.536040:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851849.536040:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.536041:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851849.536042:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851849.536042:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851849.536043:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b022f54.
02000000:00000001:29.0:1773851849.536044:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.536044:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.536045:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851849.536046:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413766264, transno 0, xid 1859597783401088
00010000:00000001:29.0:1773851849.536047:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851849.536048:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6eabe39 x1859597783401088/t0(0) o400->e64416a0-133f-4034-a9b2-278a75eebdd0@17249@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1568-0'
00010000:00000001:29.0:1773851849.536050:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851849.536051:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851849.536052:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=82 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851849.536053:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851849.536053:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eafe9e83 refcount 3 to 17249@kfi7
00000100:00000001:29.0:1773851849.536054:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526776256 : -107156182775360 : ffff9e8ac1ca49c0)
02000000:00000001:29.0:1773851849.536055:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851849.536056:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.536056:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851849.536057:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17248@kfi7
00000400:00000010:29.0:1773851849.536058:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000254c983a.
00000100:00000200:29.0:1773851849.536059:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597783401088, offset 224
00000400:00000200:29.0:1773851849.536060:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17248@kfi7
00000400:00000200:29.0:1773851849.536061:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17248@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.536062:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1a1c811 nid 17248@kfi7 refs 1
00000400:00000200:29.0:1773851849.536063:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f1a1c811 nid 17248@kfi7 refs 2
00000400:00000200:29.0:1773851849.536064:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f1a1c811 nid 17248@kfi7 refs 3
00000400:00000200:29.0:1773851849.536065:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17248@kfi7 local destination
00000400:00000200:29.0:1773851849.536067:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768424:8768424:1024:4294967295] 17248@kfi7 LPNI seq info [6323011:6323011:16:4294967295]
00000400:00000200:29.0:1773851849.536069:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f1a1c811 nid 17248@kfi7 refs 2
00000400:00000200:29.0:1773851849.536069:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17248@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.536071:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17248@kfi7(17248@kfi7:17248@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851849.536073:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f1a1c811 nid 17248@kfi7 refs 3
00000800:00000200:29.0:1773851849.536074:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851849.536075:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851849.536077:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851849.536079:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 Using peer 17248@kfi7(0x944)
00000800:00000200:29.0:1773851849.536082:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x944: rc=0
00000800:00000200:29.0:1773851849.536084:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851849.536086:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851849.536087:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eafe9e83 refcount 2 to 17249@kfi7
00010000:00000001:29.0:1773851849.536087:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851849.536088:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.536088:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851849.536089:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6eabe39 x1859597783401088/t0(0) o400->e64416a0-133f-4034-a9b2-278a75eebdd0@17249@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1568-0'
00000100:00100000:29.0:1773851849.536092:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6eabe39 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e64416a0-133f-4034-a9b2-278a75eebdd0+5:39686:x1859597783401088:12345-17249@kfi7:400:default-tuolumne1568-0 Request processed in 62us (103us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851849.536094:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17249@kfi7, seq: 2055441
00000100:00000040:29.0:1773851849.536095:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f63cf0b7 : new rpc_count 0
00000800:00000200:31.0:1773851849.536096:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851849.536096:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851849.536097:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:31.0:1773851849.536098:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851849.536098:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851849.536098:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000400:00000200:31.0:1773851849.536099:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17248@kfi7: PUT: OK
00000020:00000010:29.0:1773851849.536099:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009b78eae0.
00000400:00000200:31.0:1773851849.536100:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000254c983a
00000400:00000010:31.0:1773851849.536100:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000254c983a.
00000020:00000040:29.0:1773851849.536100:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000f63cf0b7 : new refcount 4
00000100:00000001:31.0:1773851849.536101:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851849.536101:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.536102:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851849.536103:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f1a1c811 nid 17248@kfi7 refs 2
00000800:00000200:31.0:1773851849.536104:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 17248@kfi7(000000000c2ea980):0x0 lsk 2373 rsk 26 tsk 0 trmk 0 tmk 0 trr 7 tta 0x944 Transaction freed
00000004:00000001:4.0:1773851849.545730:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:4.0:1773851849.545731:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851849.545732:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851849.545732:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:8.0:1773851849.545732:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851849.545732:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:4.0:1773851849.545732:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004dc2a5c.
00000004:00000020:29.0:1773851849.545733:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:6.0:1773851849.545733:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:4.0:1773851849.545733:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000004:00000001:0.0:1773851849.545733:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851849.545734:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:8.0:1773851849.545734:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851849.545734:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073d0c946.
00000100:00000001:4.0:1773851849.545734:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851849.545734:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:0.0:1773851849.545734:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851849.545735:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fb2f43fd.
00000100:00000010:28.0:1773851849.545735:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061748571.
00000100:00000010:8.0:1773851849.545735:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b54598de.
00000020:00000040:6.0:1773851849.545735:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
02000000:00000001:4.0:1773851849.545735:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:0.0:1773851849.545735:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000045f4f36e.
00000100:00000001:6.0:1773851849.545736:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851849.545736:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:4.0:1773851849.545736:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000030ba13a7.
00000020:00000040:0.0:1773851849.545736:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000020:00000040:29.0:1773851849.545737:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000020:00000040:28.0:1773851849.545737:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000020:00000040:8.0:1773851849.545737:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
02000000:00000001:6.0:1773851849.545737:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851849.545737:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000f17f2b52.
00000100:00000001:4.0:1773851849.545737:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.545738:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851849.545738:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851849.545738:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851849.545738:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851849.545738:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851849.545739:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:28.0:1773851849.545739:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:8.0:1773851849.545739:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851849.545739:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:0.0:1773851849.545739:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851849.545740:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851849.545740:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:8.0:1773851849.545740:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851849.545740:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851849.545740:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000004dc2a5c] to pc [ptlrpcd_01_00+0]  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:0.0:1773851849.545740:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851849.545741:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.545741:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000073d0c946] to pc [ptlrpcd_01_01+1]  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:0.0:1773851849.545741:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000d3c5e98.
02000000:00000010:29.0:1773851849.545742:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
02000000:00000001:8.0:1773851849.545742:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851849.545742:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.545743:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851849.545743:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000086abf230.
00000100:00000001:0.0:1773851849.545743:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:8.0:1773851849.545744:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:0.0:1773851849.545744:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.545745:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851849.545745:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.545745:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851849.545745:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:6.0:1773851849.545745:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:4.0:1773851849.545745:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:0.0:1773851849.545745:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000045f4f36e] to pc [ptlrpcd_00_02+2]  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851849.545746:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851849.545746:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:8.0:1773851849.545746:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.545746:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:6.0:1773851849.545746:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a2ebc3d3.
00080000:00000001:6.0:1773851849.545746:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637084377880576 : -106989331671040 : ffff9eb19ae41800)
00080000:00000010:4.0:1773851849.545746:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ac861a5d.
00000100:00000001:28.0:1773851849.545747:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.545747:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:7.0:1773851849.545747:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851849.545747:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851849.545747:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:4.0:1773851849.545747:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637133301525504 : -106940408026112 : ffff9ebcfef7ac00)
00080000:00000001:4.0:1773851849.545747:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:29.0:1773851849.545748:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fb2f43fd] to pc [ptlrpcd_07_00+0]  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.545748:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851849.545748:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:28.0:1773851849.545749:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000061748571] to pc [ptlrpcd_07_01+1]  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851849.545749:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.545749:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851849.545749:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851849.545749:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851849.545749:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00080000:00000001:4.0:1773851849.545749:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:4.0:1773851849.545749:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
02000000:00000001:7.0:1773851849.545750:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851849.545750:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:6.0:1773851849.545750:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007c70c918.
00000100:00000040:5.0:1773851849.545750:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:4.0:1773851849.545750:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000addbb551.
00000100:00000040:8.0:1773851849.545751:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b54598de] to pc [ptlrpcd_02_02+2]  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:7.0:1773851849.545751:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004dc2a5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051921152:2085@kfi7:13:default-yuba2-0
00000004:00080000:4.0:1773851849.545751:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614123999026912ns, next at 614124999025700ns, rc = 0
00000100:00000001:1.0:1773851849.545751:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:0.0:1773851849.545751:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851849.545752:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614123999027123ns, next at 614124999025580ns, rc = 0
00080000:00000001:6.0:1773851849.545752:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:4.0:1773851849.545752:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:1.0:1773851849.545752:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851849.545753:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851849.545753:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851849.545753:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851849.545753:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851849.545753:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.545753:0:41062:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:7.0:1773851849.545754:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851849.545754:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000aafb7691.
00000004:00000001:6.0:1773851849.545754:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851849.545754:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.545754:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:1.0:1773851849.545754:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851849.545755:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.545755:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851849.545755:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851849.545756:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:5.0:1773851849.545756:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851849.545757:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851849.545757:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000400:00000010:7.0:1773851849.545757:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
02000000:00000001:5.0:1773851849.545757:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:1.0:1773851849.545757:0:41062:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:1.0:1773851849.545757:0:41062:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.545758:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:28.0:1773851849.545758:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:5.0:1773851849.545758:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851849.545758:0:41062:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:31.0:1773851849.545759:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851849.545759:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:28.0:1773851849.545759:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c1da22c5.
00080000:00000001:8.0:1773851849.545759:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000200:7.0:1773851849.545759:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921152, portal 4
00000100:00000001:7.0:1773851849.545759:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00100000:5.0:1773851849.545759:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000073d0c946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051921216:46@kfi7:13:default-yuba2-0
02000000:00000001:1.0:1773851849.545759:0:41062:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.545760:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:30.0:1773851849.545760:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851849.545760:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528719104 : -106978180832512 : ffff9eb433886300)
00000100:00100000:1.0:1773851849.545760:0:41062:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000045f4f36e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051921280:2057@kfi7:13:default-yuba2-0
00000100:00000040:31.0:1773851849.545761:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851849.545761:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851849.545761:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637098085793792 : -106975623757824 : ffff9eb4cbf24000)
00000100:00000001:11.0:1773851849.545761:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851849.545761:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:7.0:1773851849.545761:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851849.545762:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:11.0:1773851849.545762:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851849.545762:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:8.0:1773851849.545762:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000fc16eaf5.
00000100:00000001:5.0:1773851849.545762:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:1.0:1773851849.545762:0:41062:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:30.0:1773851849.545763:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851849.545763:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:7.0:1773851849.545763:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:5.0:1773851849.545763:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:1.0:1773851849.545763:0:41062:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:28.0:1773851849.545764:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851849.545764:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851849.545764:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637054800203776 : -107018909347840 : ffff9eaab7ec9000)
00000100:00000040:7.0:1773851849.545764:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000010:7.0:1773851849.545764:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
02000000:00000001:5.0:1773851849.545764:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851849.545764:0:41062:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851849.545764:0:41062:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00001000:28.0:1773851849.545765:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000100:00000200:7.0:1773851849.545765:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921152, offset 0
02000000:00000001:5.0:1773851849.545765:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851849.545766:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:8.0:1773851849.545766:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000010:1.0:1773851849.545766:0:41062:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003ef8b576.
02000000:00000001:1.0:1773851849.545766:0:41062:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.545767:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:28.0:1773851849.545767:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000874ecaf8.
00080000:00000001:8.0:1773851849.545767:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851849.545767:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000400:00000200:1.0:1773851849.545767:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
02000000:00000001:31.0:1773851849.545768:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:30.0:1773851849.545768:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:28.0:1773851849.545768:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614123999043554ns, next at 614124999042011ns, rc = 0
00000004:00001000:8.0:1773851849.545768:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000400:00000200:7.0:1773851849.545768:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
02000000:00000010:5.0:1773851849.545768:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000069fb2a64.
00000400:00000010:1.0:1773851849.545768:0:41062:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001d866e0e.
00000100:00000001:30.0:1773851849.545769:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851849.545769:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
02000000:00000001:5.0:1773851849.545769:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:1.0:1773851849.545769:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe46cc14.
02000000:00000001:31.0:1773851849.545770:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851849.545770:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:28.0:1773851849.545770:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:11.0:1773851849.545770:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851849.545770:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851849.545770:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000509201cc.
00000400:00000200:7.0:1773851849.545770:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00100000:31.0:1773851849.545771:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb2f43fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051921344:2056@kfi7:13:default-yuba2-0
02000000:00000001:30.0:1773851849.545771:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851849.545771:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:8.0:1773851849.545771:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614123999046649ns, next at 614124999044886ns, rc = 0
00000400:00000200:7.0:1773851849.545771:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000200:1.0:1773851849.545771:0:41062:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921280, portal 4
00000100:00000001:1.0:1773851849.545771:0:41062:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00100000:30.0:1773851849.545772:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061748571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051921408:2065@kfi7:13:default-yuba2-0
00000004:00000001:28.0:1773851849.545772:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851849.545772:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:7.0:1773851849.545772:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000100:00000001:1.0:1773851849.545772:0:41062:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203097856 : -107102506453760 : ffff9e974125f500)
02000000:00000001:11.0:1773851849.545773:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851849.545773:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:31.0:1773851849.545774:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00100000:11.0:1773851849.545774:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b54598de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051921472:2055@kfi7:13:default-yuba2-0
00000400:00000200:7.0:1773851849.545774:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768424, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768423, p:4294967295, g:4294967295, h:1000]
00000100:00000040:1.0:1773851849.545774:0:41062:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851849.545775:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:30.0:1773851849.545775:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:8.0:1773851849.545775:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851849.545776:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851849.545776:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851849.545776:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:1.0:1773851849.545776:0:41062:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:31.0:1773851849.545777:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:30.0:1773851849.545777:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:11.0:1773851849.545777:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:7.0:1773851849.545777:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:1.0:1773851849.545777:0:41062:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
02000000:00000001:30.0:1773851849.545778:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851849.545778:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:7.0:1773851849.545778:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000010:1.0:1773851849.545778:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005510933f.
00000100:00000200:1.0:1773851849.545778:0:41062:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921280, offset 0
02000000:00000010:31.0:1773851849.545779:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000db073834.
02000000:00000001:31.0:1773851849.545779:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851849.545779:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:11.0:1773851849.545779:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851849.545779:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768425:8768425:1024:4294967295] 2085@kfi7 LPNI seq info [5403236:5403236:16:4294967295]
02000000:00000010:30.0:1773851849.545780:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000516842de.
02000000:00000001:11.0:1773851849.545780:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:7.0:1773851849.545780:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:1.0:1773851849.545780:0:41062:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:31.0:1773851849.545781:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
02000000:00000001:30.0:1773851849.545781:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851849.545781:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003e871f44.
00000400:00000200:1.0:1773851849.545781:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000010:31.0:1773851849.545782:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000200:7.0:1773851849.545782:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:30.0:1773851849.545783:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
02000000:00000001:11.0:1773851849.545783:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851849.545783:0:41062:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000010:31.0:1773851849.545784:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000400:00000010:30.0:1773851849.545784:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000200:11.0:1773851849.545784:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851849.545784:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851849.545784:0:41062:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000200:31.0:1773851849.545785:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921344, portal 4
00000400:00000010:30.0:1773851849.545785:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e57a604.
00000400:00000200:1.0:1773851849.545785:0:41062:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000010:11.0:1773851849.545786:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000400:00000200:7.0:1773851849.545786:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851849.545786:0:41062:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000100:00000001:31.0:1773851849.545787:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851849.545787:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637111224849792 : -106962484701824 : ffff9eb7db185580)
00000100:00000200:30.0:1773851849.545787:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921408, portal 4
00000400:00000010:11.0:1773851849.545787:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000800:00000200:7.0:1773851849.545787:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851849.545787:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:30.0:1773851849.545788:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:7.0:1773851849.545788:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:5.0:1773851849.545788:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f228ac8a.
00000400:00000200:1.0:1773851849.545788:0:41062:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768424, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768425, p:4294967295, g:4294967295, h:1000]
00000100:00000040:31.0:1773851849.545789:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851849.545789:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324230144 : -106976385321472 : ffff9eb49e8db600)
00000100:00000200:11.0:1773851849.545789:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921472, portal 4
00000400:00000010:5.0:1773851849.545790:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000040:30.0:1773851849.545791:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851849.545791:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851849.545791:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491275904 : -107117218275712 : ffff9e93d4415e80)
00000400:00000200:1.0:1773851849.545791:0:41062:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000200:5.0:1773851849.545792:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921216, portal 4
00000400:00000200:1.0:1773851849.545792:0:41062:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851849.545793:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:5.0:1773851849.545793:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:1.0:1773851849.545793:0:41062:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000100:00000001:31.0:1773851849.545794:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851849.545794:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.545794:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637119644518400 : -106954065033216 : ffff9eb9d0f24800)
00000400:00000200:1.0:1773851849.545794:0:41062:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768426:8768426:1024:4294967295] 2057@kfi7 LPNI seq info [5404102:5404102:16:4294967295]
00000100:00000040:31.0:1773851849.545796:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000010:31.0:1773851849.545796:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
00000100:00000001:30.0:1773851849.545796:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:7.0:1773851849.545796:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Using peer 2085@kfi7(0x200000000000110)
00000100:00000040:5.0:1773851849.545796:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851849.545796:0:41062:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000040:30.0:1773851849.545797:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000200:1.0:1773851849.545797:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000200:31.0:1773851849.545798:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921344, offset 0
00000400:00000010:30.0:1773851849.545798:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004459b6e1.
00000100:00000001:11.0:1773851849.545798:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:30.0:1773851849.545799:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921408, offset 0
00000800:00000200:7.0:1773851849.545799:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x200000000000110: rc=0
00000400:00000200:31.0:1773851849.545800:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000100:00000040:11.0:1773851849.545800:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000100:00000001:5.0:1773851849.545800:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:1.0:1773851849.545800:0:41062:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000010:11.0:1773851849.545801:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1f8095d.
00000800:00000200:7.0:1773851849.545801:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851849.545802:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:30.0:1773851849.545802:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000100:00000200:11.0:1773851849.545802:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921472, offset 0
00000100:00000040:5.0:1773851849.545802:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000200:1.0:1773851849.545802:0:41062:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000100:00000001:7.0:1773851849.545803:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.545803:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000010:5.0:1773851849.545803:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036e7f712.
00000800:00000200:1.0:1773851849.545803:0:41062:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:31.0:1773851849.545804:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000100:00000001:7.0:1773851849.545804:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.545804:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851849.545804:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921216, offset 0
00000400:00000200:31.0:1773851849.545805:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:11.0:1773851849.545805:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000100:00000001:7.0:1773851849.545805:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851849.545805:0:41062:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:7.0:1773851849.545806:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851849.545806:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:5.0:1773851849.545806:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000200:31.0:1773851849.545807:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000001:7.0:1773851849.545807:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851849.545807:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:1.0:1773851849.545807:0:41062:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851849.545808:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:7.0:1773851849.545808:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.545808:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851849.545809:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000400:00000200:5.0:1773851849.545809:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:11.0:1773851849.545810:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000800:00000200:1.0:1773851849.545810:0:41062:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000400:00000200:5.0:1773851849.545811:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:31.0:1773851849.545812:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768426, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768425, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851849.545812:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:7.0:1773851849.545812:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851849.545813:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:1.0:1773851849.545813:0:41062:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x295: rc=0
00000400:00000200:7.0:1773851849.545814:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851849.545815:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:11.0:1773851849.545815:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:5.0:1773851849.545815:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:1.0:1773851849.545815:0:41062:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851849.545816:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:7.0:1773851849.545816:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000400:00000200:31.0:1773851849.545817:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851849.545817:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000400:00000010:7.0:1773851849.545817:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000400:00000200:5.0:1773851849.545817:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000100:00000001:1.0:1773851849.545817:0:41062:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851849.545818:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000100:00000001:7.0:1773851849.545818:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:1.0:1773851849.545818:0:41062:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:7.0:1773851849.545819:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851849.545819:0:41062:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851849.545820:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768427:8768427:1023:4294967295] 2056@kfi7 LPNI seq info [5402396:5402396:16:4294967295]
00000400:00000200:5.0:1773851849.545820:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768426, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768425, p:4294967295, g:4294967295, h:1000]
00000100:00000001:1.0:1773851849.545820:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.545820:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851849.545821:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:31.0:1773851849.545822:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:7.0:1773851849.545822:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:1.0:1773851849.545822:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000040:7.0:1773851849.545823:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851849.545823:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851849.545823:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:31.0:1773851849.545824:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:5.0:1773851849.545824:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:1.0:1773851849.545824:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.545824:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851849.545825:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768426, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768427, p:4294967295, g:4294967295, h:1000]
00000100:00000001:7.0:1773851849.545825:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851849.545826:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:7.0:1773851849.545826:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851849.545826:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851849.545827:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000800:00000200:1.0:1773851849.545827:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851849.545828:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851849.545828:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000400:00000200:30.0:1773851849.545829:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:11.0:1773851849.545829:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:1.0:1773851849.545829:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851849.545830:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851849.545830:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768428:8768428:1023:4294967295] 46@kfi7 LPNI seq info [5403854:5403854:16:4294967295]
00000400:00000200:1.0:1773851849.545830:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000400:00000200:31.0:1773851849.545831:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:30.0:1773851849.545831:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:11.0:1773851849.545831:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000200:1.0:1773851849.545831:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005510933f
00000400:00000200:5.0:1773851849.545832:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000010:1.0:1773851849.545832:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005510933f.
00000100:00000001:1.0:1773851849.545832:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:31.0:1773851849.545833:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:30.0:1773851849.545833:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000100:00000200:1.0:1773851849.545833:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851849.545834:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768429:8768429:1023:4294967295] 2055@kfi7 LPNI seq info [5404665:5404665:16:4294967295]
00000400:00000200:5.0:1773851849.545834:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:31.0:1773851849.545835:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851849.545836:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768429, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8768427, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851849.545836:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:7.0:1773851849.545836:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:1.0:1773851849.545836:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:7.0:1773851849.545837:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Transaction freed
00000100:00000040:1.0:1773851849.545837:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851849.545838:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:31.0:1773851849.545839:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851849.545839:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:1.0:1773851849.545839:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.545840:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851849.545841:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:1.0:1773851849.545841:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:30.0:1773851849.545842:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000800:00000200:31.0:1773851849.545843:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000800:00000200:1.0:1773851849.545843:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000400:00000200:11.0:1773851849.545844:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851849.545844:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851849.545845:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768430:8768430:1022:4294967295] 2065@kfi7 LPNI seq info [5402824:5402824:16:4294967295]
00000400:00000200:30.0:1773851849.545847:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:11.0:1773851849.545847:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:6.0:1773851849.545847:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851849.545847:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:31.0:1773851849.545848:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000400:00000200:30.0:1773851849.545848:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:6.0:1773851849.545848:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851849.545849:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851849.545849:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:11.0:1773851849.545850:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:31.0:1773851849.545851:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:11.0:1773851849.545852:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851849.545852:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851849.545852:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851849.545853:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000100:00000001:31.0:1773851849.545854:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851849.545854:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851849.545855:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851849.545855:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:6.0:1773851849.545856:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2085@kfi7 : PUT - for me
00000100:00000001:31.0:1773851849.545857:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851849.545857:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851849.545857:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:5.0:1773851849.545857:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:31.0:1773851849.545858:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851849.545858:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:6.0:1773851849.545858:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000001:31.0:1773851849.545859:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851849.545859:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:6.0:1773851849.545859:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:31.0:1773851849.545861:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:30.0:1773851849.545861:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851849.545861:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000001:31.0:1773851849.545862:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:6.0:1773851849.545862:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:5.0:1773851849.545862:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000100:00000001:31.0:1773851849.545863:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851849.545863:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851849.545863:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1b00
00000100:00000001:31.0:1773851849.545864:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:11.0:1773851849.545864:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Using peer 2055@kfi7(0x2f3)
00000400:00000200:6.0:1773851849.545864:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851849.545865:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851849.545865:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:31.0:1773851849.545866:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851849.545866:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851849.545866:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b2fb85 [1] + 224
00000800:00000200:5.0:1773851849.545867:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x3df: rc=0
00000400:00000200:29.0:1773851849.545868:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000800:00000200:6.0:1773851849.545868:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851849.545869:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Using peer 2065@kfi7(0x5e8)
00000800:00000200:11.0:1773851849.545869:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x2f3: rc=0
00000400:00000200:29.0:1773851849.545870:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000400:00000010:29.0:1773851849.545870:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000800:00000200:14.0:1773851849.545870:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:6.0:1773851849.545870:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851849.545870:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851849.545872:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:14.0:1773851849.545872:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851849.545872:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851849.545872:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000200:29.0:1773851849.545873:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:14.0:1773851849.545873:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851849.545873:0:2499722:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:6.0:1773851849.545873:0:2499722:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851849.545874:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000bfd826e8: Posted send of 324 bytes to peer 0x5e8: rc=0
00000100:00000001:5.0:1773851849.545874:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.545875:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:14.0:1773851849.545876:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:5.0:1773851849.545876:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851849.545877:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:6.0:1773851849.545877:0:2499722:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.545877:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.545878:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:14.0:1773851849.545878:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:11.0:1773851849.545878:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.545878:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:29.0:1773851849.545879:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:14.0:1773851849.545879:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000100:00000001:11.0:1773851849.545879:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851849.545880:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851849.545880:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.545880:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851849.545881:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:14.0:1773851849.545881:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:6.0:1773851849.545881:0:2499722:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851849.545881:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:14.0:1773851849.545882:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000100:00000001:11.0:1773851849.545882:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851849.545882:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851849.545883:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.545883:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851849.545883:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:11.0:1773851849.545883:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851849.545883:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:7.0:1773851849.545883:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851849.545883:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:5.0:1773851849.545883:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851849.545883:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851849.545884:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.545884:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:14.0:1773851849.545884:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:11.0:1773851849.545884:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851849.545884:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851849.545885:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851849.545885:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:9.0:1773851849.545885:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000400:00000200:7.0:1773851849.545885:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851849.545885:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851849.545885:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851849.545886:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:14.0:1773851849.545886:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:11.0:1773851849.545886:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:9.0:1773851849.545886:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1f8095d
00000400:00000010:9.0:1773851849.545886:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1f8095d.
00000400:00000200:7.0:1773851849.545886:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000001:30.0:1773851849.545887:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:14.0:1773851849.545887:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1b80
00000100:00000001:11.0:1773851849.545887:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851849.545887:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:7.0:1773851849.545887:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036e7f712
00000100:00000001:30.0:1773851849.545888:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:14.0:1773851849.545888:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:11.0:1773851849.545888:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:9.0:1773851849.545888:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:7.0:1773851849.545888:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036e7f712.
00000100:00000001:7.0:1773851849.545888:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851849.545889:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851849.545889:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Transaction freed
00000100:00000001:11.0:1773851849.545889:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851849.545889:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851849.545890:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:14.0:1773851849.545890:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f53cd [1] + 224
00000100:00000001:11.0:1773851849.545890:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851849.545891:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851849.545891:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851849.545891:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851849.545892:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851849.545892:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:9.0:1773851849.545892:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851849.545892:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851849.545893:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851849.545894:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851849.545894:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851849.545894:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851849.545895:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:31.0:1773851849.545896:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000400:00000200:14.0:1773851849.545896:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000400:00000200:9.0:1773851849.545896:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:7.0:1773851849.545896:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851849.545896:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:14.0:1773851849.545897:0:2514739:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:7.0:1773851849.545897:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:31.0:1773851849.545898:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004459b6e1
00000400:00000010:31.0:1773851849.545898:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004459b6e1.
00000100:00000200:14.0:1773851849.545898:0:2514739:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851849.545898:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Transaction freed
00000800:00000200:7.0:1773851849.545899:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000100:00000001:31.0:1773851849.545900:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:31.0:1773851849.545901:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:14.0:1773851849.545902:0:2514739:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851849.545903:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851849.545903:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851849.545904:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851849.545904:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851849.545905:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000100:00000001:31.0:1773851849.545906:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:7.0:1773851849.545906:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:7.0:1773851849.545906:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:7.0:1773851849.545907:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:31.0:1773851849.545908:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851849.545908:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851849.545909:0:2514739:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:14.0:1773851849.545910:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000200:7.0:1773851849.545911:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851849.545912:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851849.545912:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851849.545912:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851849.545913:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:7.0:1773851849.545913:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:1.0:1773851849.545913:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:1.0:1773851849.545913:0:41062:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:7.0:1773851849.545914:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851849.545914:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000001:1.0:1773851849.545914:0:41062:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:31.0:1773851849.545915:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:7.0:1773851849.545915:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851849.545915:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:1.0:1773851849.545915:0:41062:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001d866e0e.
00000400:00000200:1.0:1773851849.545915:0:41062:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe46cc14
00000800:00000200:9.0:1773851849.545916:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:7.0:1773851849.545916:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851849.545916:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851849.545916:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000010:1.0:1773851849.545916:0:41062:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe46cc14.
00000800:00000200:9.0:1773851849.545917:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
02000000:00000001:7.0:1773851849.545917:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.545917:0:41062:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:31.0:1773851849.545918:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Transaction freed
00000800:00000200:9.0:1773851849.545918:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:7.0:1773851849.545918:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=82 v=66 (66 66 66 66)
00000800:00000200:2.0:1773851849.545918:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:1.0:1773851849.545918:0:41062:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:7.0:1773851849.545919:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=82 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851849.545920:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851849.545920:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851849.545920:0:41062:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:7.0:1773851849.545921:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851849.545921:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851849.545922:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:7.0:1773851849.545922:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851849.545922:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000800:00000200:18.0:1773851849.545923:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851849.545923:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851849.545923:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851849.545923:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851849.545923:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:1.0:1773851849.545923:0:41062:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:1.0:1773851849.545923:0:41062:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851849.545924:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:1.0:1773851849.545924:0:41062:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:1.0:1773851849.545924:0:41062:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000800:00000200:18.0:1773851849.545925:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:1.0:1773851849.545925:0:41062:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851849.545926:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:2.0:1773851849.545926:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:1.0:1773851849.545926:0:41062:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851849.545926:0:41062:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851849.545927:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851849.545927:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:1.0:1773851849.545927:0:41062:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=82 v=66 (66 66 66 66)
00000400:00000200:9.0:1773851849.545928:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000100:00000001:7.0:1773851849.545928:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851849.545928:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851849.545928:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:9.0:1773851849.545929:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000004:00000001:7.0:1773851849.545929:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851849.545929:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000100:00001000:1.0:1773851849.545929:0:41062:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=82 v=66 (1 1 1 1)
00000400:00000200:18.0:1773851849.545930:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:9.0:1773851849.545930:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000004:00000040:7.0:1773851849.545930:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351466038272 avail=351462929408 avail_mb=1372902068 hwm_mb=3131103 files=372062971 ffree=343228553 state=0: rc = 0
00000400:00000200:2.0:1773851849.545930:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:1.0:1773851849.545930:0:41062:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:18.0:1773851849.545931:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:9.0:1773851849.545931:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:1.0:1773851849.545931:0:41062:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851849.545931:0:41062:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:9.0:1773851849.545932:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000004:00000020:7.0:1773851849.545932:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351466038272 free, 351462929408 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062971 files, 343228553 free files
00000400:00000200:2.0:1773851849.545932:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00010000:00000001:1.0:1773851849.545932:0:41062:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851849.545933:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:9.0:1773851849.545933:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000004:00000001:7.0:1773851849.545933:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.545933:0:41062:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:1.0:1773851849.545933:0:41062:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000400:00000200:18.0:1773851849.545934:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:2.0:1773851849.545934:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:1.0:1773851849.545934:0:41062:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:1.0:1773851849.545934:0:41062:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851849.545935:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:7.0:1773851849.545935:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:1.0:1773851849.545935:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:18.0:1773851849.545936:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:18.0:1773851849.545936:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:9.0:1773851849.545936:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1b40
00000400:00000200:2.0:1773851849.545936:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:9.0:1773851849.545937:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:18.0:1773851849.545938:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:9.0:1773851849.545938:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x7816968a9 [1] + 224
00000100:00100000:7.0:1773851849.545938:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004dc2a5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051921152:2085@kfi7:13:default-yuba2-0
00000400:00000200:2.0:1773851849.545938:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000001:1.0:1773851849.545938:0:41062:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:18.0:1773851849.545939:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:7.0:1773851849.545939:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851849.545939:0:41062:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:18.0:1773851849.545940:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1c00
00000100:00000001:7.0:1773851849.545940:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:2.0:1773851849.545940:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:1.0:1773851849.545940:0:41062:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:1.0:1773851849.545940:0:41062:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000800:00000200:9.0:1773851849.545941:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:7.0:1773851849.545941:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000004dc2a5c x1859433051921152/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:1.0:1773851849.545941:0:41062:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000400:00000200:18.0:1773851849.545942:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:2.0:1773851849.545942:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1bc0
00000004:00000040:1.0:1773851849.545942:0:41062:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406587904 avail=351404209152 avail_mb=1372672692 hwm_mb=3131103 files=372127385 ffree=343170496 state=0: rc = 0
00000400:00000200:18.0:1773851849.545943:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f0351 [1] + 224
00000400:00000200:9.0:1773851849.545943:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851849.545943:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851849.545943:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:9.0:1773851849.545944:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
02000000:00000010:7.0:1773851849.545944:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000aafb7691.
00000400:00000200:2.0:1773851849.545944:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000004:00000020:1.0:1773851849.545944:0:41062:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406587904 free, 351404209152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127385 files, 343170496 free files
00000100:00000001:9.0:1773851849.545945:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:7.0:1773851849.545945:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000800:00000200:18.0:1773851849.545946:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:7.0:1773851849.545946:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851849.545946:0:41064:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000400:00000200:2.0:1773851849.545946:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71c841 [1] + 224
00000004:00000001:1.0:1773851849.545946:0:41062:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851849.545947:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:9.0:1773851849.545947:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:7.0:1773851849.545947:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851849.545947:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000030ba13a7.
00000100:00000040:1.0:1773851849.545947:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851849.545948:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000200:18.0:1773851849.545949:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
02000000:00000001:7.0:1773851849.545949:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851849.545949:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004dc2a5c.
00000100:00000001:18.0:1773851849.545950:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:9.0:1773851849.545950:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851849.545950:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851849.545950:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:1.0:1773851849.545950:0:41062:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000045f4f36e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051921280:2057@kfi7:13:default-yuba2-0
00000100:00000200:18.0:1773851849.545951:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851849.545951:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851849.545951:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:1.0:1773851849.545951:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851849.545952:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851849.545952:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.545952:0:41062:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851849.545953:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851849.545953:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:2.0:1773851849.545953:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:1.0:1773851849.545953:0:41062:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000045f4f36e x1859433051921280/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:9.0:1773851849.545954:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:7.0:1773851849.545954:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851849.545955:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851849.545955:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000800:00000200:9.0:1773851849.545956:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851849.545956:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851849.545956:0:41062:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:1.0:1773851849.545956:0:41062:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:5.0:1773851849.545957:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851849.545957:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000010:1.0:1773851849.545957:0:41062:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003ef8b576.
00000400:00000001:5.0:1773851849.545958:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
02000000:00000001:1.0:1773851849.545958:0:41062:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:18.0:1773851849.545959:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:5.0:1773851849.545959:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:2.0:1773851849.545959:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:1.0:1773851849.545959:0:41062:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:1.0:1773851849.545959:0:41062:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000400:00000010:5.0:1773851849.545960:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f228ac8a.
00000020:00000001:1.0:1773851849.545960:0:41062:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:1.0:1773851849.545960:0:41062:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000d3c5e98.
00000400:00000200:18.0:1773851849.545961:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:5.0:1773851849.545961:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
02000000:00000001:1.0:1773851849.545961:0:41062:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:30.0:1773851849.545962:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:5.0:1773851849.545962:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
02000000:00000001:1.0:1773851849.545962:0:41062:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:1.0:1773851849.545962:0:41062:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000045f4f36e.
00000100:00000001:30.0:1773851849.545963:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:18.0:1773851849.545963:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851849.545963:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:1.0:1773851849.545963:0:41062:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000200:5.0:1773851849.545964:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851849.545964:0:41062:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851849.545964:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:30.0:1773851849.545965:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851849.545965:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:1.0:1773851849.545965:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851849.545965:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851849.545966:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851849.545966:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851849.545966:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851849.545967:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851849.545967:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e57a604
00000400:00000010:30.0:1773851849.545968:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e57a604.
00000100:00000001:30.0:1773851849.545970:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851849.545970:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851849.545971:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851849.545972:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851849.545974:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851849.545974:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851849.545974:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:31.0:1773851849.545975:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851849.545975:0:41065:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851849.545976:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:30.0:1773851849.545976:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:5.0:1773851849.545976:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000001:31.0:1773851849.545977:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:5.0:1773851849.545977:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:2.0:1773851849.545977:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851849.545978:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:5.0:1773851849.545978:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851849.545979:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
02000000:00000001:5.0:1773851849.545979:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851849.545980:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000100:00000001:30.0:1773851849.545980:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:5.0:1773851849.545980:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=82 v=66 (66 66 66 66)
00000400:00000010:31.0:1773851849.545981:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000100:00000001:31.0:1773851849.545982:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:5.0:1773851849.545982:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=82 v=66 (1 1 1 1)
00000100:00000200:31.0:1773851849.545983:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851849.545983:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851849.545984:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:5.0:1773851849.545984:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:30.0:1773851849.545985:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851849.545985:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851849.545985:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851849.545986:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851849.545986:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851849.545987:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851849.545988:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851849.545988:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.545988:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851849.545988:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00001000:30.0:1773851849.545989:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=82 v=66 (66 66 66 66)
00000100:00000001:5.0:1773851849.545989:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851849.545990:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851849.545991:0:41089:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=82 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851849.545992:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:5.0:1773851849.545992:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851849.545993:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851849.545993:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851849.545994:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851849.545994:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851849.545994:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.545995:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:30.0:1773851849.545995:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:31.0:1773851849.545996:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851849.545996:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.545996:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:31.0:1773851849.545997:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851849.545997:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:5.0:1773851849.545997:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:30.0:1773851849.545998:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00001000:31.0:1773851849.545999:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=82 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851849.545999:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851849.545999:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.545999:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:31.0:1773851849.546000:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=82 v=66 (1 1 1 1)
00000004:00000001:5.0:1773851849.546000:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:30.0:1773851849.546001:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:5.0:1773851849.546001:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000100:00000001:31.0:1773851849.546002:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000040:5.0:1773851849.546002:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489086464 avail=351486007296 avail_mb=1372992216 hwm_mb=3131103 files=372066932 ffree=343251061 state=0: rc = 0
00000100:00000001:31.0:1773851849.546003:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851849.546004:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851849.546004:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851849.546005:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:5.0:1773851849.546005:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489086464 free, 351486007296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066932 files, 343251061 free files
00000100:00000001:31.0:1773851849.546006:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851849.546007:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:30.0:1773851849.546007:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851849.546007:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.546008:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851849.546008:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851849.546008:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:5.0:1773851849.546008:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:30.0:1773851849.546010:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000100:00000040:5.0:1773851849.546010:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851849.546011:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:30.0:1773851849.546011:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464045568 avail=351458209792 avail_mb=1372883632 hwm_mb=3131101 files=372060775 ffree=343226607 state=0: rc = 0
00000004:00000020:30.0:1773851849.546014:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464045568 free, 351458209792 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372060775 files, 343226607 free files
00000100:00000001:31.0:1773851849.546015:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00100000:5.0:1773851849.546015:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073d0c946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051921216:46@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851849.546016:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851849.546017:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851849.546017:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851849.546017:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851849.546018:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:30.0:1773851849.546018:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851849.546018:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:31.0:1773851849.546019:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000100:00000040:5.0:1773851849.546019:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000073d0c946 x1859433051921216/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:31.0:1773851849.546020:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545834496 avail=351536206848 avail_mb=1373188308 hwm_mb=3131103 files=372116555 ffree=343306479 state=0: rc = 0
00000004:00000020:31.0:1773851849.546023:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545834496 free, 351536206848 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116555 files, 343306479 free files
00000100:00100000:30.0:1773851849.546023:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061748571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051921408:2065@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851849.546023:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851849.546024:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:31.0:1773851849.546025:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851849.546025:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:5.0:1773851849.546025:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000069fb2a64.
00000100:00000040:31.0:1773851849.546027:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851849.546027:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:5.0:1773851849.546027:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851849.546027:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:30.0:1773851849.546028:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000061748571 x1859433051921408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:5.0:1773851849.546028:0:41065:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000020:00000001:5.0:1773851849.546029:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851849.546030:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000f17f2b52.
02000000:00000001:5.0:1773851849.546031:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00100000:31.0:1773851849.546032:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb2f43fd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051921344:2056@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851849.546032:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851849.546032:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:30.0:1773851849.546033:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000010:5.0:1773851849.546033:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000073d0c946.
00000100:00000001:31.0:1773851849.546034:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:30.0:1773851849.546034:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000516842de.
00000100:00000001:5.0:1773851849.546034:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851849.546035:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:30.0:1773851849.546035:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:5.0:1773851849.546035:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851849.546036:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fb2f43fd x1859433051921344/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:30.0:1773851849.546036:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:5.0:1773851849.546036:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:30.0:1773851849.546037:0:41089:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000100:00000001:5.0:1773851849.546037:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:30.0:1773851849.546038:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:5.0:1773851849.546038:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851849.546039:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000086abf230.
00000100:00000001:5.0:1773851849.546039:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:30.0:1773851849.546040:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:5.0:1773851849.546040:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.546041:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851849.546041:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:30.0:1773851849.546041:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:31.0:1773851849.546042:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000db073834.
00000100:00000010:30.0:1773851849.546042:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061748571.
00000100:00000001:30.0:1773851849.546043:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851849.546043:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851849.546044:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851849.546044:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:30.0:1773851849.546044:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:31.0:1773851849.546045:0:41088:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000020:00000001:31.0:1773851849.546046:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:30.0:1773851849.546046:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:31.0:1773851849.546047:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000100:00000001:30.0:1773851849.546047:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851849.546048:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:30.0:1773851849.546048:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851849.546048:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851849.546049:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851849.546050:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb2f43fd.
00000100:00000001:31.0:1773851849.546051:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851849.546051:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.546052:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.546054:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851849.546055:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.546056:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851849.546056:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851849.546595:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851849.546596:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851849.546597:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851849.546599:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851849.546601:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.546602:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:21.0:1773851849.546603:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.546604:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:21.0:1773851849.546605:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.546605:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:21.0:1773851849.546606:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:21.0:1773851849.546607:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.546608:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1c40
00000400:00000200:21.0:1773851849.546608:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.546610:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d0135 [1] + 224
00000800:00000200:21.0:1773851849.546611:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851849.546613:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851849.546614:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:21.0:1773851849.546615:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851849.546616:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851849.546619:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851849.546623:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851849.546624:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:21.0:1773851849.546625:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851849.546625:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851849.546625:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:11.0:1773851849.546626:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851849.546627:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:11.0:1773851849.546628:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000200:11.0:1773851849.546629:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000400:00000010:11.0:1773851849.546629:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000100:00000001:11.0:1773851849.546630:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:11.0:1773851849.546631:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:11.0:1773851849.546634:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851849.546637:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851849.546637:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851849.546638:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851849.546638:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:11.0:1773851849.546639:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851849.546640:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851849.546641:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851849.546641:0:41070:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=82 v=66 (66 66 66 66)
00000100:00001000:11.0:1773851849.546643:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=82 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851849.546644:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851849.546644:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851849.546645:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:11.0:1773851849.546645:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851849.546646:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851849.546647:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:11.0:1773851849.546648:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851849.546648:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851849.546649:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851849.546652:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851849.546653:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851849.546654:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851849.546654:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:11.0:1773851849.546655:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000004:00000040:11.0:1773851849.546656:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382772736 avail=351380675584 avail_mb=1372580764 hwm_mb=3131101 files=371978826 ffree=343147239 state=0: rc = 0
00000004:00000020:11.0:1773851849.546658:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382772736 free, 351380675584 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978826 files, 343147239 free files
00000004:00000001:11.0:1773851849.546659:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851849.546660:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:11.0:1773851849.546663:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b54598de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051921472:2055@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851849.546665:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851849.546665:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851849.546666:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b54598de x1859433051921472/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852002 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851849.546669:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851849.546669:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:11.0:1773851849.546670:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003e871f44.
02000000:00000001:11.0:1773851849.546671:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851849.546671:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851849.546672:0:41070:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000020:00000001:11.0:1773851849.546673:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851849.546673:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:11.0:1773851849.546674:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851849.546675:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851849.546675:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b54598de.
00000100:00000001:11.0:1773851849.546676:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851849.546677:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851849.546677:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851849.546678:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851849.546678:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851849.546679:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851849.546682:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851849.560445:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851849.560446:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851849.560448:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851849.560450:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851849.560452:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.560453:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23937@kfi7 : PUT - for me
00000400:00000200:29.0:1773851849.560454:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.560455:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 1
00000400:00000200:29.0:1773851849.560457:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.560457:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000400:00000200:29.0:1773851849.560458:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 3
00000400:00000200:29.0:1773851849.560459:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23873@kfi7 to cpt 3
00000400:00000200:29.0:1773851849.560460:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23873@kfi7 of length 224 into portal 12 MB=0x69b4cb11d4300
00000400:00000200:29.0:1773851849.560462:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23873@kfi7 of length 224/224 into md 0x77fe139dd [64] + 156864
00000800:00000200:29.0:1773851849.560463:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851849.560465:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851849.560466:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23937@kfi7: PUT: OK
00000100:00000001:29.0:1773851849.560467:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851849.560467:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851849.560468:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000da69eff3.
00000100:00000040:29.0:1773851849.560469:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000da69eff3 x1859603551568640 msgsize 224
00000100:00100000:29.0:1773851849.560471:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23873@kfi7 (source: 12345-23937@kfi7)
00000100:00000001:29.0:1773851849.560472:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851849.560473:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000800:00000200:29.0:1773851849.560475:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851849.560478:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851849.560479:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851849.560479:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851849.560480:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851849.560481:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851849.560482:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603551568640
00000020:00000001:29.0:1773851849.560482:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851849.560482:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78bb2
00000020:00000001:29.0:1773851849.560483:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851849.560486:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006ca4359d refcount=5
00000020:00000001:29.0:1773851849.560487:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109617785856 : -106964091765760 : ffff9eb77b4e7c00)
00000020:00000001:29.0:1773851849.560487:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637109617785856 : -106964091765760 : ffff9eb77b4e7c00)
00000100:00000001:29.0:1773851849.560488:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851849.560489:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851849.560489:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009b78eae0.
00000020:00000010:29.0:1773851849.560490:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851849.560491:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851849.560492:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851849.560492:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851849.560492:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851849.560493:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851849.560494:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851849.560494:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.560495:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851849.560496:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851849.560496:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851849.560496:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851849.560497:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851849.560497:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23873@kfi7, seq: 2055442
00000100:00000040:29.0:1773851849.560497:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006ca4359d : new rpc_count 1
00000100:00000001:31.0:1773851849.560498:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851849.560498:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.560498:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224845184 : -106962484706432 : ffff9eb7db184380)
00000100:00000040:29.0:1773851849.560499:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000da69eff3 x1859603551568640/t0(0) o400->ddfa68f8-12ed-49a6-ba4e-621be0d539a7@23873@kfi7:637/0 lens 224/0 e 0 to 0 dl 1773851997 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1988-0'
00000100:00000001:29.0:1773851849.560502:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851849.560502:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851849.560504:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da69eff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ddfa68f8-12ed-49a6-ba4e-621be0d539a7+5:39726:x1859603551568640:12345-23873@kfi7:400:default-tuolumne1988-0
00000100:00000200:29.0:1773851849.560505:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603551568640
00000020:00000001:29.0:1773851849.560505:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851849.560506:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851849.560506:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.560507:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851849.560507:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851849.560508:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851849.560509:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603551568640, found 0 last_xid 1859603551568639
00000020:00000001:29.0:1773851849.560509:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851849.560510:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851849.560510:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851849.560511:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.560511:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851849.560512:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851849.560512:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851849.560513:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006e8a160c.
02000000:00000001:29.0:1773851849.560514:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.560514:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.560515:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851849.560516:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915826680, transno 0, xid 1859603551568640
00010000:00000001:29.0:1773851849.560516:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851849.560517:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000da69eff3 x1859603551568640/t0(0) o400->ddfa68f8-12ed-49a6-ba4e-621be0d539a7@23873@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1988-0'
00010000:00000001:29.0:1773851849.560519:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851849.560520:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851849.560521:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=82 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851849.560521:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851849.560522:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000044bd0e40 refcount 3 to 23873@kfi7
00000100:00000001:29.0:1773851849.560523:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487622368 : -107151221929248 : ffff9e8be97acae0)
02000000:00000001:29.0:1773851849.560523:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851849.560524:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851849.560525:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851849.560527:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23937@kfi7
00000400:00000010:29.0:1773851849.560527:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000acbff741.
00000100:00000200:29.0:1773851849.560528:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859603551568640, offset 224
00000400:00000200:29.0:1773851849.560530:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23937@kfi7
00000400:00000200:29.0:1773851849.560530:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.560531:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 1
00000400:00000200:29.0:1773851849.560532:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000400:00000200:29.0:1773851849.560533:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 3
00000400:00000200:29.0:1773851849.560534:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23937@kfi7 local destination
00000400:00000200:29.0:1773851849.560535:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768431:8768431:1024:4294967295] 23937@kfi7 LPNI seq info [427172:427172:16:4294967295]
00000400:00000200:29.0:1773851849.560537:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000400:00000200:29.0:1773851849.560537:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851849.560539:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23937@kfi7(23937@kfi7:23937@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851849.560540:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 3
00000800:00000200:29.0:1773851849.560542:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851849.560543:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851849.560545:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851849.560547:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xccb Using peer 23937@kfi7(0xccb)
00000800:00000200:29.0:1773851849.560550:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 324 bytes to peer 0xccb: rc=0
00000800:00000200:29.0:1773851849.560551:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xccb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851849.560553:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851849.560554:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000044bd0e40 refcount 2 to 23873@kfi7
00010000:00000001:29.0:1773851849.560555:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851849.560555:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851849.560556:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851849.560556:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000da69eff3 x1859603551568640/t0(0) o400->ddfa68f8-12ed-49a6-ba4e-621be0d539a7@23873@kfi7:637/0 lens 224/224 e 0 to 0 dl 1773851997 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1988-0'
00000100:00100000:29.0:1773851849.560562:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da69eff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ddfa68f8-12ed-49a6-ba4e-621be0d539a7+5:39726:x1859603551568640:12345-23873@kfi7:400:default-tuolumne1988-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000800:00000200:30.0:1773851849.560564:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xccb TN_EVENT_TX_OK event status 0
00000100:00100000:29.0:1773851849.560565:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23873@kfi7, seq: 2055442
00000100:00000040:29.0:1773851849.560565:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006ca4359d : new rpc_count 0
00000400:00000200:30.0:1773851849.560566:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851849.560566:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:30.0:1773851849.560567:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23937@kfi7: PUT: OK
00000100:00000001:29.0:1773851849.560567:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851849.560567:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851849.560567:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000400:00000200:30.0:1773851849.560568:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000acbff741
00000400:00000010:30.0:1773851849.560568:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000acbff741.
00000020:00000010:29.0:1773851849.560568:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009b78eae0.
00000100:00000001:30.0:1773851849.560569:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851849.560569:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:29.0:1773851849.560569:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000006ca4359d : new refcount 4
00000100:00000001:29.0:1773851849.560569:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851849.560570:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000800:00000200:30.0:1773851849.560571:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 23937@kfi7(00000000b9cdfbc2):0x0 lsk 3276 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xccb Transaction freed
00000800:00000200:1.0:1773851849.568870:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.568870:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851849.568872:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851849.568874:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851849.568876:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.568877:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25202@kfi7 : PUT - for me
00000400:00000200:1.0:1773851849.568878:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.568878:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 1
00000400:00000200:1.0:1773851849.568879:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.568880:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000400:00000200:1.0:1773851849.568881:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 3
00000400:00000200:1.0:1773851849.568882:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.568883:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25202@kfi7 of length 224 into portal 12 MB=0x699e126f01500
00000400:00000200:1.0:1773851849.568884:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25202@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 5096
00000800:00000200:1.0:1773851849.568886:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851849.568887:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851849.568888:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25202@kfi7: PUT: OK
00000100:00000001:1.0:1773851849.568889:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851849.568890:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851849.568892:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002aa98957.
00000100:00000040:1.0:1773851849.568893:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000002aa98957 x1858042160223488 msgsize 224
00000100:00100000:1.0:1773851849.568894:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25202@kfi7 (source: 12345-25202@kfi7)
00000100:00000001:1.0:1773851849.568895:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851849.568896:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000100:00000001:2.0:1773851849.568897:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851849.568897:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851849.568897:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851849.568898:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851849.568899:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851849.568899:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851849.568900:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042160223488
00000020:00000001:2.0:1773851849.568901:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851849.568901:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e1b
00000020:00000001:2.0:1773851849.568902:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851849.568903:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000054f30bb5 refcount=6
00000020:00000001:2.0:1773851849.568903:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744420352 : -107128965131264 : ffff9e9118169400)
00000020:00000001:2.0:1773851849.568904:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744420352 : -107128965131264 : ffff9e9118169400)
00000100:00000001:2.0:1773851849.568905:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851849.568906:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851849.568907:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000de1a9407.
00000020:00000010:2.0:1773851849.568908:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851849.568909:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ebfb08ad.
00000100:00000001:2.0:1773851849.568910:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851849.568910:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851849.568911:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.568912:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851849.568912:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851849.568913:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851849.568914:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.568915:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851849.568915:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851849.568916:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851849.568916:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851849.568917:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25202@kfi7, seq: 1997467
00000100:00000001:2.0:1773851849.568918:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851849.568918:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000054f30bb5 : new rpc_count 1
00000100:00000001:2.0:1773851849.568919:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.568919:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637142266968448 : -106931442583168 : ffff9ebf15597980)
00000100:00000040:1.0:1773851849.568920:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002aa98957 x1858042160223488/t0(0) o400->8c82da73-812f-448a-885d-a8fc9804b49c@25202@kfi7:489/0 lens 224/0 e 0 to 0 dl 1773852604 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2058-0'
00000100:00000001:1.0:1773851849.568923:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851849.568923:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851849.568924:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002aa98957 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8c82da73-812f-448a-885d-a8fc9804b49c+6:39694:x1858042160223488:12345-25202@kfi7:400:default-tuolumne2058-0
00000100:00000200:1.0:1773851849.568926:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042160223488
00000020:00000001:1.0:1773851849.568927:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851849.568927:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851849.568928:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.568929:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851849.568929:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851849.568930:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851849.568931:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042160223488, found 0 last_xid 1858042160223487
00000020:00000001:1.0:1773851849.568932:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851849.568933:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851849.568933:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851849.568934:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.568935:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851849.568935:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851849.568937:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851849.568937:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000838d6e68.
02000000:00000001:1.0:1773851849.568938:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.568939:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.568940:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851849.568940:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183047692922, transno 0, xid 1858042160223488
00010000:00000001:1.0:1773851849.568941:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851849.568942:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002aa98957 x1858042160223488/t0(0) o400->8c82da73-812f-448a-885d-a8fc9804b49c@25202@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2058-0'
00010000:00000001:1.0:1773851849.568944:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851849.568945:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851849.568946:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=82 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851849.568947:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851849.568948:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c283804b refcount 3 to 25202@kfi7
00000100:00000001:1.0:1773851849.568949:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850078336 : -107143859473280 : ffff9e8da050f480)
02000000:00000001:1.0:1773851849.568950:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851849.568950:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.568951:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851849.568952:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25202@kfi7
00000400:00000010:1.0:1773851849.568953:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe46cc14.
00000100:00000200:1.0:1773851849.568954:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042160223488, offset 224
00000400:00000200:1.0:1773851849.568955:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25202@kfi7
00000400:00000200:1.0:1773851849.568956:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.568957:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 1
00000400:00000200:1.0:1773851849.568958:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000400:00000200:1.0:1773851849.568959:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 3
00000400:00000200:1.0:1773851849.568960:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25202@kfi7 local destination
00000400:00000200:1.0:1773851849.568962:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768432:8768432:1024:4294967295] 25202@kfi7 LPNI seq info [294934:294934:16:4294967295]
00000400:00000200:1.0:1773851849.568963:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000400:00000200:1.0:1773851849.568964:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.568966:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25202@kfi7(25202@kfi7:25202@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851849.568967:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 3
00000800:00000200:1.0:1773851849.568968:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.568970:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851849.568972:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851849.568974:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x43f Using peer 25202@kfi7(0x43f)
00000800:00000200:1.0:1773851849.568977:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x43f: rc=0
00000800:00000200:1.0:1773851849.568978:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x43f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851849.568980:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851849.568981:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c283804b refcount 2 to 25202@kfi7
00010000:00000001:1.0:1773851849.568982:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851849.568982:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.568983:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851849.568984:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002aa98957 x1858042160223488/t0(0) o400->8c82da73-812f-448a-885d-a8fc9804b49c@25202@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2058-0'
00000100:00100000:1.0:1773851849.568987:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002aa98957 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8c82da73-812f-448a-885d-a8fc9804b49c+6:39694:x1858042160223488:12345-25202@kfi7:400:default-tuolumne2058-0 Request processed in 63us (93us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851849.568989:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25202@kfi7, seq: 1997467
00000100:00000040:1.0:1773851849.568990:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000054f30bb5 : new rpc_count 0
00000800:00000200:2.0:1773851849.568991:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x43f TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851849.568991:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851849.568991:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851849.568992:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000400:00000200:2.0:1773851849.568993:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851849.568993:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ebfb08ad.
00000400:00000200:2.0:1773851849.568994:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25202@kfi7: PUT: OK
00000020:00000010:1.0:1773851849.568994:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000de1a9407.
00000020:00000040:1.0:1773851849.568994:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000054f30bb5 : new refcount 5
00000400:00000200:2.0:1773851849.568995:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe46cc14
00000400:00000010:2.0:1773851849.568995:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe46cc14.
00000100:00000001:1.0:1773851849.568995:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.568996:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851849.568997:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851849.568998:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000800:00000200:2.0:1773851849.568999:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 25202@kfi7(00000000dc03c110):0x0 lsk 1088 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x43f Transaction freed
00000400:00000200:29.0:1773851849.609731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851849.609732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:15.0:1773851849.688361:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851849.688362:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851849.688364:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851849.688366:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851849.688369:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:15.0:1773851849.688370:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26224@kfi7 : PUT - for me
00000400:00000200:15.0:1773851849.688371:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:15.0:1773851849.688372:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 1
00000400:00000200:15.0:1773851849.688373:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:15.0:1773851849.688374:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000400:00000200:15.0:1773851849.688375:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 3
00000400:00000200:15.0:1773851849.688376:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26289@kfi7 to cpt 2
00000400:00000200:15.0:1773851849.688377:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26289@kfi7 of length 224 into portal 12 MB=0x699e0d4fff1c0
00000400:00000200:15.0:1773851849.688379:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26289@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 10760
00000800:00000200:15.0:1773851849.688381:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851849.688383:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851849.688385:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26224@kfi7: PUT: OK
00000100:00000001:15.0:1773851849.688386:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851849.688387:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851849.688388:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a3087c47.
00000100:00000040:15.0:1773851849.688389:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000a3087c47 x1858040785531328 msgsize 224
00000100:00100000:15.0:1773851849.688391:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-26289@kfi7 (source: 12345-26224@kfi7)
00000100:00000001:15.0:1773851849.688392:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851849.688393:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000800:00000200:15.0:1773851849.688395:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851849.688395:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851849.688396:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851849.688397:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851849.688398:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851849.688399:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851849.688401:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040785531328
00000020:00000001:14.0:1773851849.688402:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851849.688402:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92fc6
00000020:00000001:14.0:1773851849.688403:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851849.688407:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffe8db66 refcount=6
00000020:00000001:14.0:1773851849.688408:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744937472 : -107128964614144 : ffff9e91181e7800)
00000020:00000001:14.0:1773851849.688410:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744937472 : -107128964614144 : ffff9e91181e7800)
00000100:00000001:14.0:1773851849.688411:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851849.688413:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851849.688414:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d8eeec17.
00000020:00000010:14.0:1773851849.688416:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851849.688418:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851849.688419:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851849.688420:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851849.688421:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851849.688422:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851849.688423:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851849.688424:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.688426:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851849.688428:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851849.688428:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851849.688428:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851849.688429:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851849.688430:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26289@kfi7, seq: 2289760
00000100:00000040:15.0:1773851849.688431:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffe8db66 : new rpc_count 1
00000100:00000001:15.0:1773851849.688431:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860218368 : -107049849333248 : ffff9ea383c1da00)
00000100:00000001:14.0:1773851849.688431:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851849.688432:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851849.688433:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a3087c47 x1858040785531328/t0(0) o400->568d622e-1620-4ec0-bab0-846211b031a3@26289@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2126-0'
00000100:00000001:15.0:1773851849.688437:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851849.688437:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851849.688438:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3087c47 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:568d622e-1620-4ec0-bab0-846211b031a3+6:39764:x1858040785531328:12345-26289@kfi7:400:default-tuolumne2126-0
00000100:00000200:15.0:1773851849.688440:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040785531328
00000020:00000001:15.0:1773851849.688441:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851849.688441:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851849.688442:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851849.688443:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851849.688444:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851849.688445:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851849.688445:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040785531328, found 0 last_xid 1858040785531327
00000020:00000001:15.0:1773851849.688446:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851849.688447:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851849.688448:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851849.688448:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851849.688449:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851849.688450:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851849.688451:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851849.688452:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008df19f11.
02000000:00000001:15.0:1773851849.688453:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.688453:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851849.688454:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851849.688455:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013969455, transno 0, xid 1858040785531328
00010000:00000001:15.0:1773851849.688456:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851849.688457:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a3087c47 x1858040785531328/t0(0) o400->568d622e-1620-4ec0-bab0-846211b031a3@26289@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2126-0'
00010000:00000001:15.0:1773851849.688461:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851849.688461:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851849.688462:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=82 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851849.688463:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851849.688464:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000200b5744 refcount 3 to 26289@kfi7
00000100:00000001:15.0:1773851849.688465:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899612768 : -107146809938848 : ffff9e8cf0746c60)
02000000:00000001:15.0:1773851849.688466:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851849.688467:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851849.688468:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851849.688469:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26224@kfi7
00000400:00000010:15.0:1773851849.688470:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c2b163d5.
00000100:00000200:15.0:1773851849.688472:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040785531328, offset 224
00000400:00000200:15.0:1773851849.688474:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26224@kfi7
00000400:00000200:15.0:1773851849.688476:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:15.0:1773851849.688477:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 1
00000400:00000200:15.0:1773851849.688479:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000400:00000200:15.0:1773851849.688481:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 3
00000400:00000200:15.0:1773851849.688483:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26224@kfi7 local destination
00000400:00000200:15.0:1773851849.688486:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768433:8768433:1024:4294967295] 26224@kfi7 LPNI seq info [878871:878871:16:4294967295]
00000400:00000200:15.0:1773851849.688489:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000400:00000200:15.0:1773851849.688490:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:15.0:1773851849.688494:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26224@kfi7(26224@kfi7:26224@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851849.688498:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 3
00000800:00000200:15.0:1773851849.688500:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851849.688502:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851849.688506:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851849.688511:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000112f Using peer 26224@kfi7(0x10000000000112f)
00000800:00000200:15.0:1773851849.688516:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x10000000000112f: rc=0
00000800:00000200:15.0:1773851849.688519:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000112f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851849.688522:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851849.688524:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000200b5744 refcount 2 to 26289@kfi7
00010000:00000001:15.0:1773851849.688525:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851849.688526:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851849.688527:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851849.688529:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a3087c47 x1858040785531328/t0(0) o400->568d622e-1620-4ec0-bab0-846211b031a3@26289@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2126-0'
00000800:00000200:13.0:1773851849.688531:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000112f TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851849.688533:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851849.688534:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3087c47 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:568d622e-1620-4ec0-bab0-846211b031a3+6:39764:x1858040785531328:12345-26289@kfi7:400:default-tuolumne2126-0 Request processed in 97us (144us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851849.688534:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26224@kfi7: PUT: OK
00000400:00000200:13.0:1773851849.688535:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c2b163d5
00000400:00000010:13.0:1773851849.688536:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c2b163d5.
00000100:00000001:13.0:1773851849.688537:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851849.688537:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851849.688538:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000100:00100000:15.0:1773851849.688539:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26289@kfi7, seq: 2289760
00000800:00000200:13.0:1773851849.688539:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 26224@kfi7(0000000082152b76):0x0 lsk 4400 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000112f Transaction freed
00000100:00000040:15.0:1773851849.688540:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffe8db66 : new rpc_count 0
00000100:00000001:15.0:1773851849.688542:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851849.688543:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851849.688544:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:15.0:1773851849.688545:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000020:00000010:15.0:1773851849.688547:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d8eeec17.
00000020:00000040:15.0:1773851849.688548:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000ffe8db66 : new refcount 5
00000100:00000001:15.0:1773851849.688549:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851849.704297:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.704298:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.704299:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.704301:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.704302:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.704303:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8720@kfi7 : PUT - for me
00000400:00000200:17.0:1773851849.704304:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.704305:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 1
00000400:00000200:17.0:1773851849.704306:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.704307:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000400:00000200:17.0:1773851849.704307:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 3
00000400:00000200:17.0:1773851849.704308:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8721@kfi7 to cpt 7
00000400:00000200:17.0:1773851849.704309:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8721@kfi7 of length 224 into portal 12 MB=0x69b473fc31780
00000400:00000200:17.0:1773851849.704310:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8721@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 184792
00000800:00000200:17.0:1773851849.704312:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.704313:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.704314:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8720@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.704315:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.704316:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.704316:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001e66cc3e.
00000100:00000040:17.0:1773851849.704317:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001e66cc3e x1859580174997376 msgsize 224
00000100:00100000:17.0:1773851849.704319:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8721@kfi7 (source: 12345-8720@kfi7)
00000100:00000001:17.0:1773851849.704320:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.704320:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000100:00000001:19.0:1773851849.704321:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851849.704322:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851849.704322:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851849.704322:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851849.704323:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851849.704323:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851849.704324:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580174997376
00000020:00000001:19.0:1773851849.704325:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851849.704325:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3fd343
00000020:00000001:19.0:1773851849.704326:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851849.704327:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eb040dea refcount=6
00000020:00000001:19.0:1773851849.704328:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637116516518912 : -106957193032704 : ffff9eb91680cc00)
00000020:00000001:19.0:1773851849.704329:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637116516518912 : -106957193032704 : ffff9eb91680cc00)
00000100:00000001:19.0:1773851849.704330:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.704331:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851849.704332:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5d5268b.
00000020:00000010:19.0:1773851849.704333:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.704334:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851849.704335:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851849.704335:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851849.704336:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.704337:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851849.704337:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851849.704338:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.704339:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.704340:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851849.704341:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851849.704341:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851849.704341:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851849.704342:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8721@kfi7, seq: 2156241
00000100:00000040:19.0:1773851849.704342:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eb040dea : new rpc_count 2
00000100:00000001:18.0:1773851849.704342:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.704343:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131864487424 : -106941845064192 : ffff9ebca9503600)
00000100:00000001:18.0:1773851849.704343:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.704344:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001e66cc3e x1859580174997376/t0(0) o400->8728b896-e97f-43f3-b7ed-6bf03b7dc567@8721@kfi7:39/0 lens 224/0 e 0 to 0 dl 1773852154 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1041-0'
00000100:00000001:19.0:1773851849.704347:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.704347:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851849.704348:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e66cc3e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8728b896-e97f-43f3-b7ed-6bf03b7dc567+6:39718:x1859580174997376:12345-8721@kfi7:400:default-tuolumne1041-0
00000100:00000200:19.0:1773851849.704349:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580174997376
00000020:00000001:19.0:1773851849.704350:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851849.704350:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851849.704351:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.704352:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851849.704352:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851849.704353:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851849.704354:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580174997376, found 0 last_xid 1859580174866431
00000020:00000001:19.0:1773851849.704355:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851849.704355:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851849.704356:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851849.704356:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.704360:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851849.704360:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851849.704361:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851849.704361:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000083b72841.
02000000:00000001:19.0:1773851849.704362:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.704363:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.704363:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851849.704364:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183003856728, transno 0, xid 1859580174997376
00010000:00000001:19.0:1773851849.704365:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851849.704366:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001e66cc3e x1859580174997376/t0(0) o400->8728b896-e97f-43f3-b7ed-6bf03b7dc567@8721@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1041-0'
00010000:00000001:19.0:1773851849.704368:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851849.704369:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851849.704369:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=82 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851849.704370:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851849.704371:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a5150dad refcount 3 to 8721@kfi7
00000100:00000001:19.0:1773851849.704372:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803776 : -107130477747840 : ffff9e90bdede180)
02000000:00000001:19.0:1773851849.704373:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851849.704373:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.704374:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851849.704375:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8720@kfi7
00000400:00000010:19.0:1773851849.704376:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073b38b00.
00000100:00000200:19.0:1773851849.704377:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580174997376, offset 224
00000400:00000200:19.0:1773851849.704378:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8720@kfi7
00000400:00000200:19.0:1773851849.704379:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.704380:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 1
00000400:00000200:19.0:1773851849.704381:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000400:00000200:19.0:1773851849.704382:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 3
00000400:00000200:19.0:1773851849.704383:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8720@kfi7 local destination
00000400:00000200:19.0:1773851849.704384:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768434:8768434:1024:4294967295] 8720@kfi7 LPNI seq info [1851732:1851732:16:4294967295]
00000400:00000200:19.0:1773851849.704386:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000400:00000200:19.0:1773851849.704386:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.704388:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8720@kfi7(8720@kfi7:8720@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851849.704390:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 3
00000800:00000200:19.0:1773851849.704391:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851849.704392:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851849.704394:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851849.704396:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe85 Using peer 8720@kfi7(0xe85)
00000800:00000200:19.0:1773851849.704399:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0xe85: rc=0
00000800:00000200:19.0:1773851849.704401:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe85 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851849.704403:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.704404:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a5150dad refcount 2 to 8721@kfi7
00010000:00000001:19.0:1773851849.704404:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851849.704405:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.704405:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851849.704406:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001e66cc3e x1859580174997376/t0(0) o400->8728b896-e97f-43f3-b7ed-6bf03b7dc567@8721@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1041-0'
00000100:00100000:19.0:1773851849.704409:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e66cc3e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8728b896-e97f-43f3-b7ed-6bf03b7dc567+6:39718:x1859580174997376:12345-8721@kfi7:400:default-tuolumne1041-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851849.704411:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8721@kfi7, seq: 2156241
00000100:00000040:19.0:1773851849.704412:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eb040dea : new rpc_count 1
00000100:00000001:19.0:1773851849.704413:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851849.704413:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851849.704414:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851849.704414:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe85 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851849.704415:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000400:00000200:17.0:1773851849.704415:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851849.704416:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5d5268b.
00000020:00000040:19.0:1773851849.704416:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000eb040dea : new refcount 5
00000400:00000200:17.0:1773851849.704416:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8720@kfi7: PUT: OK
00000100:00000001:19.0:1773851849.704417:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851849.704417:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073b38b00
00000400:00000010:17.0:1773851849.704417:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073b38b00.
00000100:00000001:17.0:1773851849.704418:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851849.704418:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851849.704419:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000800:00000200:17.0:1773851849.704420:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 8720@kfi7(0000000004debda7):0x0 lsk 3718 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe85 Transaction freed
00000800:00000200:17.0:1773851849.712434:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.712435:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.712437:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.712439:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.712441:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.712442:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13985@kfi7 : PUT - for me
00000400:00000200:17.0:1773851849.712443:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.712444:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 1
00000400:00000200:17.0:1773851849.712445:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.712445:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:17.0:1773851849.712446:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000400:00000200:17.0:1773851849.712447:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13921@kfi7 to cpt 0
00000400:00000200:17.0:1773851849.712448:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13921@kfi7 of length 224 into portal 12 MB=0x69b0a274ee200
00000400:00000200:17.0:1773851849.712449:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13921@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 185016
00000800:00000200:17.0:1773851849.712451:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.712452:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.712453:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13985@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.712454:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.712454:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.712456:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b12be0b0.
00000100:00000040:17.0:1773851849.712456:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b12be0b0 x1859317771723264 msgsize 224
00000100:00100000:17.0:1773851849.712458:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13921@kfi7 (source: 12345-13985@kfi7)
00000100:00000001:17.0:1773851849.712458:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.712459:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000100:00000001:19.0:1773851849.712460:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851849.712460:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851849.712461:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851849.712462:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851849.712462:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851849.712463:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851849.712463:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317771723264
00000020:00000001:19.0:1773851849.712464:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851849.712464:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918f1
00000020:00000001:19.0:1773851849.712464:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851849.712467:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e3700aad refcount=6
00000020:00000001:19.0:1773851849.712468:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241970688 : -107152467580928 : ffff9e8b9f3ba800)
00000020:00000001:19.0:1773851849.712469:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241970688 : -107152467580928 : ffff9e8b9f3ba800)
00000100:00000001:19.0:1773851849.712469:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.712470:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851849.712471:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5d5268b.
00000020:00000010:19.0:1773851849.712471:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.712472:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851849.712473:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851849.712473:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851849.712474:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.712474:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851849.712475:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851849.712475:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.712476:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.712477:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851849.712477:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851849.712478:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13921@kfi7, seq: 2156242
00000100:00000001:18.0:1773851849.712478:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851849.712478:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851849.712479:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e3700aad : new rpc_count 1
00000100:00000001:19.0:1773851849.712479:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637028583793408 : -107045125758208 : ffff9ea49d4de300)
00000100:00000001:18.0:1773851849.712479:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.712480:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b12be0b0 x1859317771723264/t0(0) o400->3575a08f-106b-4cba-9fa2-52babd369fcd@13921@kfi7:39/0 lens 224/0 e 0 to 0 dl 1773852154 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1360-0'
00000100:00000001:18.0:1773851849.712480:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.712483:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.712483:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851849.712484:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b12be0b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:3575a08f-106b-4cba-9fa2-52babd369fcd+6:39829:x1859317771723264:12345-13921@kfi7:400:default-tuolumne1360-0
00000100:00000200:19.0:1773851849.712485:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317771723264
00000020:00000001:19.0:1773851849.712486:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851849.712487:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851849.712487:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.712488:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851849.712488:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851849.712489:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851849.712489:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317771723264, found 0 last_xid 1859317771723263
00000020:00000001:19.0:1773851849.712490:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851849.712490:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851849.712490:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851849.712491:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.712491:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851849.712492:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851849.712492:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851849.712493:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dec2f936.
02000000:00000001:19.0:1773851849.712493:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.712494:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.712494:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851849.712495:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317771723264
00010000:00000001:19.0:1773851849.712495:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851849.712496:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b12be0b0 x1859317771723264/t0(0) o400->3575a08f-106b-4cba-9fa2-52babd369fcd@13921@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1360-0'
00010000:00000001:19.0:1773851849.712499:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851849.712499:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851849.712500:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=82 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851849.712500:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851849.712501:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e5915c6 refcount 5 to 13921@kfi7
00000100:00000001:19.0:1773851849.712501:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545858112 : -107154163693504 : ffff9e8b3a230840)
02000000:00000001:19.0:1773851849.712502:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851849.712502:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.712503:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851849.712504:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13985@kfi7
00000400:00000010:19.0:1773851849.712504:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df1656e9.
00000100:00000200:19.0:1773851849.712505:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317771723264, offset 224
00000400:00000200:19.0:1773851849.712506:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13985@kfi7
00000400:00000200:19.0:1773851849.712508:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.712509:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 1
00000400:00000200:19.0:1773851849.712510:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:19.0:1773851849.712511:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000400:00000200:19.0:1773851849.712512:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13985@kfi7 local destination
00000400:00000200:19.0:1773851849.712513:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768435:8768435:1024:4294967295] 13985@kfi7 LPNI seq info [7474935:7474935:16:4294967295]
00000400:00000200:19.0:1773851849.712514:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:19.0:1773851849.712515:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:19.0:1773851849.712517:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13985@kfi7(13985@kfi7:13985@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851849.712518:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000800:00000200:19.0:1773851849.712519:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851849.712520:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851849.712522:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851849.712524:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 Using peer 13985@kfi7(0x801)
00000800:00000200:19.0:1773851849.712527:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x801: rc=0
00000800:00000200:19.0:1773851849.712528:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851849.712530:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851849.712530:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e5915c6 refcount 4 to 13921@kfi7
00010000:00000001:19.0:1773851849.712531:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851849.712531:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851849.712532:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851849.712533:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b12be0b0 x1859317771723264/t0(0) o400->3575a08f-106b-4cba-9fa2-52babd369fcd@13921@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1360-0'
00000100:00100000:19.0:1773851849.712535:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b12be0b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:3575a08f-106b-4cba-9fa2-52babd369fcd+6:39829:x1859317771723264:12345-13921@kfi7:400:default-tuolumne1360-0 Request processed in 52us (78us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851849.712537:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13921@kfi7, seq: 2156242
00000100:00000040:19.0:1773851849.712538:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e3700aad : new rpc_count 0
00000100:00000001:19.0:1773851849.712539:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851849.712539:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851849.712540:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.712540:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000800:00000200:17.0:1773851849.712540:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851849.712541:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5d5268b.
00000400:00000200:17.0:1773851849.712541:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:19.0:1773851849.712542:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000e3700aad : new refcount 5
00000100:00000001:19.0:1773851849.712542:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851849.712543:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13985@kfi7: PUT: OK
00000400:00000200:17.0:1773851849.712543:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df1656e9
00000400:00000010:17.0:1773851849.712544:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df1656e9.
00000100:00000001:17.0:1773851849.712544:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851849.712545:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851849.712545:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000800:00000200:17.0:1773851849.712546:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 Transaction freed
00000800:00000200:1.0:1773851849.717511:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.717512:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851849.717513:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851849.717516:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851849.717518:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.717519:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18162@kfi7 : PUT - for me
00000400:00000200:1.0:1773851849.717520:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.717521:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 1
00000400:00000200:1.0:1773851849.717522:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.717522:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000400:00000200:1.0:1773851849.717523:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 3
00000400:00000200:1.0:1773851849.717524:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17971@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.717525:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17971@kfi7 of length 224 into portal 12 MB=0x699e14cc40040
00000400:00000200:1.0:1773851849.717526:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17971@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 5320
00000800:00000200:1.0:1773851849.717528:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851849.717530:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851849.717531:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18162@kfi7: PUT: OK
00000100:00000001:1.0:1773851849.717532:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851849.717532:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851849.717533:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000034a30387.
00000100:00000040:1.0:1773851849.717534:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000034a30387 x1858042794868800 msgsize 224
00000100:00100000:1.0:1773851849.717535:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-17971@kfi7 (source: 12345-18162@kfi7)
00000100:00000001:1.0:1773851849.717537:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851849.717538:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000800:00000200:1.0:1773851849.717539:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851849.717541:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851849.717542:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851849.717543:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851849.717543:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851849.717544:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851849.717545:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042794868800
00000020:00000001:1.0:1773851849.717545:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851849.717546:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922ad
00000020:00000001:1.0:1773851849.717547:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851849.717549:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005ff7e049 refcount=41
00000020:00000001:1.0:1773851849.717550:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630017024 : -107123079534592 : ffff9e9276e5a800)
00000020:00000001:1.0:1773851849.717550:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630017024 : -107123079534592 : ffff9e9276e5a800)
00000100:00000001:1.0:1773851849.717551:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851849.717552:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851849.717553:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851849.717554:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851849.717555:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851849.717555:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851849.717556:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851849.717557:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851849.717558:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851849.717558:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851849.717559:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.717560:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851849.717561:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851849.717561:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851849.717561:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851849.717561:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851849.717562:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17971@kfi7, seq: 1997468
00000100:00000001:2.0:1773851849.717563:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851849.717563:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005ff7e049 : new rpc_count 3
00000100:00000001:2.0:1773851849.717564:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.717564:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085911363968 : -106987798187648 : ffff9eb1f64b3180)
00000100:00000040:1.0:1773851849.717565:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000034a30387 x1858042794868800/t0(0) o400->390a348e-44b3-4f57-ab2c-48cc379b92c3@17971@kfi7:489/0 lens 224/0 e 0 to 0 dl 1773852604 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1609-0'
00000100:00000001:1.0:1773851849.717567:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851849.717568:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851849.717569:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034a30387 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:390a348e-44b3-4f57-ab2c-48cc379b92c3+41:39811:x1858042794868800:12345-17971@kfi7:400:default-tuolumne1609-0
00000100:00000200:1.0:1773851849.717570:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042794868800
00000020:00000001:1.0:1773851849.717570:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851849.717571:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851849.717572:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.717572:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851849.717573:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851849.717574:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851849.717575:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042794868800, found 0 last_xid 1858042790836159
00000020:00000001:1.0:1773851849.717575:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851849.717576:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851849.717577:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851849.717577:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.717578:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851849.717579:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851849.717579:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851849.717580:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000e473bb4.
02000000:00000001:1.0:1773851849.717580:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.717581:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.717582:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851849.717582:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183248106944, transno 0, xid 1858042794868800
00010000:00000001:1.0:1773851849.717583:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851849.717584:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000034a30387 x1858042794868800/t0(0) o400->390a348e-44b3-4f57-ab2c-48cc379b92c3@17971@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1609-0'
00010000:00000001:1.0:1773851849.717586:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851849.717587:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851849.717587:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=82 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851849.717588:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851849.717589:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001a2db78e refcount 3 to 17971@kfi7
00000100:00000001:1.0:1773851849.717590:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003232 : -107146751548384 : ffff9e8cf3ef6420)
02000000:00000001:1.0:1773851849.717590:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851849.717591:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.717591:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851849.717592:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18162@kfi7
00000400:00000010:1.0:1773851849.717593:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005510933f.
00000100:00000200:1.0:1773851849.717594:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042794868800, offset 224
00000400:00000200:1.0:1773851849.717595:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18162@kfi7
00000400:00000200:1.0:1773851849.717595:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.717596:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 1
00000400:00000200:1.0:1773851849.717597:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000400:00000200:1.0:1773851849.717598:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 3
00000400:00000200:1.0:1773851849.717599:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18162@kfi7 local destination
00000400:00000200:1.0:1773851849.717601:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768436:8768436:1024:4294967295] 18162@kfi7 LPNI seq info [364686:364686:16:4294967295]
00000400:00000200:1.0:1773851849.717602:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000400:00000200:1.0:1773851849.717603:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851849.717605:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18162@kfi7(18162@kfi7:18162@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851849.717606:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 3
00000800:00000200:1.0:1773851849.717607:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.717608:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851849.717610:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851849.717612:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ba6 Using peer 18162@kfi7(0x100000000000ba6)
00000800:00000200:1.0:1773851849.717615:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0x100000000000ba6: rc=0
00000800:00000200:1.0:1773851849.717616:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ba6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851849.717618:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851849.717619:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001a2db78e refcount 2 to 17971@kfi7
00010000:00000001:1.0:1773851849.717620:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851849.717620:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.717621:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851849.717621:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000034a30387 x1858042794868800/t0(0) o400->390a348e-44b3-4f57-ab2c-48cc379b92c3@17971@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1609-0'
00000100:00100000:1.0:1773851849.717624:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034a30387 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:390a348e-44b3-4f57-ab2c-48cc379b92c3+41:39811:x1858042794868800:12345-17971@kfi7:400:default-tuolumne1609-0 Request processed in 56us (90us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851849.717627:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17971@kfi7, seq: 1997468
00000100:00000040:1.0:1773851849.717627:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005ff7e049 : new rpc_count 2
00000100:00000001:1.0:1773851849.717629:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851849.717629:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:3.0:1773851849.717630:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ba6 TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851849.717630:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851849.717630:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000020:00000010:1.0:1773851849.717631:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000020:00000040:1.0:1773851849.717632:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005ff7e049 : new refcount 40
00000400:00000200:3.0:1773851849.717633:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851849.717633:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851849.717635:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18162@kfi7: PUT: OK
00000400:00000200:3.0:1773851849.717636:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005510933f
00000400:00000010:3.0:1773851849.717637:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005510933f.
00000100:00000001:3.0:1773851849.717637:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851849.717638:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851849.717639:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000800:00000200:3.0:1773851849.717641:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 18162@kfi7(00000000caa9b688):0x0 lsk 2983 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ba6 Transaction freed
00000800:00000200:26.0:1773851849.801035:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.801036:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851849.801037:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851849.801039:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851849.801041:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.801042:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9603@kfi7 : PUT - for me
00000400:00000200:26.0:1773851849.801043:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.801044:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 1
00000400:00000200:26.0:1773851849.801045:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.801046:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000400:00000200:26.0:1773851849.801046:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 3
00000400:00000200:26.0:1773851849.801047:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9602@kfi7 to cpt 3
00000400:00000200:26.0:1773851849.801048:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9602@kfi7 of length 224 into portal 12 MB=0x69aa079d6c840
00000400:00000200:26.0:1773851849.801049:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9602@kfi7 of length 224/224 into md 0x16159c6179 [64] + 177440
00000800:00000200:26.0:1773851849.801052:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851849.801054:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851849.801056:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9603@kfi7: PUT: OK
00000100:00000001:26.0:1773851849.801057:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851849.801057:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851849.801058:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004b40f7a7.
00000100:00000040:26.0:1773851849.801059:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000004b40f7a7 x1858863889827904 msgsize 224
00000100:00100000:26.0:1773851849.801060:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9602@kfi7 (source: 12345-9603@kfi7)
00000100:00000001:26.0:1773851849.801062:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851849.801063:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000800:00000200:26.0:1773851849.801064:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851849.801067:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851849.801067:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851849.801068:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851849.801068:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851849.801069:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851849.801070:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863889827904
00000020:00000001:26.0:1773851849.801071:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851849.801071:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92975
00000020:00000001:26.0:1773851849.801072:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851849.801073:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ea320856 refcount=6
00000020:00000001:26.0:1773851849.801074:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743172096 : -107128966379520 : ffff9e9118038800)
00000020:00000001:26.0:1773851849.801074:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743172096 : -107128966379520 : ffff9e9118038800)
00000100:00000001:26.0:1773851849.801075:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.801077:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851849.801077:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851849.801079:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.801080:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851849.801080:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851849.801081:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851849.801081:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.801082:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851849.801083:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851849.801083:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.801084:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851849.801086:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851849.801086:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851849.801086:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851849.801086:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851849.801087:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9602@kfi7, seq: 2025035
00000100:00000040:26.0:1773851849.801088:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ea320856 : new rpc_count 1
00000100:00000001:24.0:1773851849.801088:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.801089:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538604032 : -106958170947584 : ffff9eb8dc370000)
00000100:00000001:24.0:1773851849.801089:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.801090:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004b40f7a7 x1858863889827904/t0(0) o400->de176814-41b9-488d-aaa3-7c60066e77ac@9602@kfi7:35/0 lens 224/0 e 0 to 0 dl 1773852150 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1096-0'
00000100:00000001:26.0:1773851849.801093:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851849.801093:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851849.801094:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b40f7a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:de176814-41b9-488d-aaa3-7c60066e77ac+6:39022:x1858863889827904:12345-9602@kfi7:400:default-tuolumne1096-0
00000100:00000200:26.0:1773851849.801095:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863889827904
00000020:00000001:26.0:1773851849.801096:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851849.801097:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851849.801097:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.801098:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851849.801099:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851849.801099:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851849.801100:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863889827904, found 0 last_xid 1858863889827903
00000020:00000001:26.0:1773851849.801101:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851849.801102:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851849.801102:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851849.801103:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.801103:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851849.801104:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851849.801104:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851849.801105:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008385752c.
02000000:00000001:26.0:1773851849.801106:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.801107:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.801107:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851849.801108:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475272696, transno 0, xid 1858863889827904
00010000:00000001:26.0:1773851849.801108:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851849.801110:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004b40f7a7 x1858863889827904/t0(0) o400->de176814-41b9-488d-aaa3-7c60066e77ac@9602@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1096-0'
00010000:00000001:26.0:1773851849.801112:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851849.801113:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851849.801114:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=82 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851849.801115:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851849.801115:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8ca4473 refcount 3 to 9602@kfi7
00000100:00000001:26.0:1773851849.801116:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298304 : -107155980253312 : ffff9e8acddc8780)
02000000:00000001:26.0:1773851849.801117:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851849.801118:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851849.801118:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851849.801119:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9603@kfi7
00000400:00000010:26.0:1773851849.801120:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002a370da0.
00000100:00000200:26.0:1773851849.801120:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863889827904, offset 224
00000400:00000200:26.0:1773851849.801122:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9603@kfi7
00000400:00000200:26.0:1773851849.801123:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.801123:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 1
00000400:00000200:26.0:1773851849.801125:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000400:00000200:26.0:1773851849.801126:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 3
00000400:00000200:26.0:1773851849.801127:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9603@kfi7 local destination
00000400:00000200:26.0:1773851849.801128:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768437:8768437:1024:4294967295] 9603@kfi7 LPNI seq info [17360:17360:16:4294967295]
00000400:00000200:26.0:1773851849.801129:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000400:00000200:26.0:1773851849.801130:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:26.0:1773851849.801132:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9603@kfi7(9603@kfi7:9603@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851849.801133:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 3
00000800:00000200:26.0:1773851849.801134:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851849.801135:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851849.801136:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851849.801138:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x164 Using peer 9603@kfi7(0x164)
00000800:00000200:26.0:1773851849.801141:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001c682e34: Posted send of 324 bytes to peer 0x164: rc=0
00000800:00000200:26.0:1773851849.801143:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x164 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851849.801145:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851849.801146:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8ca4473 refcount 2 to 9602@kfi7
00010000:00000001:26.0:1773851849.801146:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851849.801147:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851849.801147:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851849.801148:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004b40f7a7 x1858863889827904/t0(0) o400->de176814-41b9-488d-aaa3-7c60066e77ac@9602@kfi7:35/0 lens 224/224 e 0 to 0 dl 1773852150 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1096-0'
00000100:00100000:26.0:1773851849.801151:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b40f7a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:de176814-41b9-488d-aaa3-7c60066e77ac+6:39022:x1858863889827904:12345-9602@kfi7:400:default-tuolumne1096-0 Request processed in 57us (91us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851849.801153:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9602@kfi7, seq: 2025035
00000100:00000040:26.0:1773851849.801154:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ea320856 : new rpc_count 0
00000100:00000001:26.0:1773851849.801154:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851849.801155:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851849.801155:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851849.801156:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000800:00000200:27.0:1773851849.801157:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x164 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851849.801157:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000020:00000040:26.0:1773851849.801158:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000ea320856 : new refcount 5
00000100:00000001:26.0:1773851849.801158:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851849.801160:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851849.801162:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9603@kfi7: PUT: OK
00000400:00000200:27.0:1773851849.801163:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002a370da0
00000400:00000010:27.0:1773851849.801164:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002a370da0.
00000100:00000001:27.0:1773851849.801165:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851849.801165:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851849.801166:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000800:00000200:27.0:1773851849.801168:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9603@kfi7(00000000375f7975):0x0 lsk 357 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x164 Transaction freed
00000800:00000200:17.0:1773851849.838038:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.838040:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.838042:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.838046:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.838049:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.838052:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.171@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851849.838054:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.838056:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851849.838059:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.171@o2ib600 to cpt 4
00000400:00000200:17.0:1773851849.838061:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 2
00000400:00000200:17.0:1773851849.838063:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 3
00000400:00000200:17.0:1773851849.838065:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.171@o2ib600 to cpt 4
00000400:00000200:17.0:1773851849.838067:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.171@o2ib600 of length 224 into portal 12 MB=0x69aeefc1fd280
00000400:00000200:17.0:1773851849.838070:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.171@o2ib600 of length 224/224 into md 0x6ab0181b1 [64] + 185240
00000800:00000200:17.0:1773851849.838073:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.838076:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.838078:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.838080:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.838081:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.838082:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a3f6c2c.
00000100:00000040:17.0:1773851849.838083:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001a3f6c2c x1859201083101824 msgsize 224
00000100:00100000:17.0:1773851849.838087:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.171@o2ib600 (source: 12345-172.19.3.171@o2ib600)
00000100:00000001:17.0:1773851849.838088:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851849.838091:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851849.838091:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
02000000:00000001:19.0:1773851849.838092:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851849.838092:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851849.838093:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851849.838093:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851849.838094:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851849.838095:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859201083101824
00000020:00000001:19.0:1773851849.838096:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851849.838097:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dfa
00000020:00000001:19.0:1773851849.838098:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851849.838100:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b1bdc74e refcount=6
00000020:00000001:19.0:1773851849.838100:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239480320 : -107152470071296 : ffff9e8b9f15a800)
00000020:00000001:19.0:1773851849.838101:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239480320 : -107152470071296 : ffff9e8b9f15a800)
00000100:00000001:19.0:1773851849.838102:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851849.838103:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851849.838104:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5d5268b.
00000020:00000010:19.0:1773851849.838105:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851849.838106:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851849.838107:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851849.838107:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851849.838108:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.838109:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851849.838110:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851849.838110:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851849.838111:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851849.838112:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851849.838113:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851849.838113:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851849.838113:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851849.838115:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.171@o2ib600, seq: 2156243
00000100:00000001:19.0:1773851849.838116:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851849.838116:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b1bdc74e : new rpc_count 1
00000100:00000001:19.0:1773851849.838117:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.838117:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637028583777280 : -107045125774336 : ffff9ea49d4da400)
00000100:00000040:18.0:1773851849.838119:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a3f6c2c x1859201083101824/t0(0) o400->c12e22a0-0329-4c15-a86e-2b2df3dfddd5@172.19.3.171@o2ib600:39/0 lens 224/0 e 0 to 0 dl 1773852154 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic21-0'
00000100:00000001:18.0:1773851849.838122:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851849.838123:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851849.838124:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a3f6c2c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:c12e22a0-0329-4c15-a86e-2b2df3dfddd5+6:24877:x1859201083101824:12345-172.19.3.171@o2ib600:400:default-oslic21-0
00000100:00000200:18.0:1773851849.838126:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859201083101824
00000020:00000001:18.0:1773851849.838126:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851849.838127:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851849.838128:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.838129:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851849.838129:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851849.838130:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851849.838131:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859201083101824, found 0 last_xid 1859201083101823
00000020:00000001:18.0:1773851849.838132:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851849.838133:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851849.838134:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851849.838134:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.838135:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851849.838135:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851849.838136:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851849.838137:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e96e8f6f.
02000000:00000001:18.0:1773851849.838138:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.838138:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.838139:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851849.838140:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859201083101824
00010000:00000001:18.0:1773851849.838140:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851849.838141:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a3f6c2c x1859201083101824/t0(0) o400->c12e22a0-0329-4c15-a86e-2b2df3dfddd5@172.19.3.171@o2ib600:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic21-0'
00010000:00000001:18.0:1773851849.838144:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851849.838144:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851849.838145:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=82 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851849.838146:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851849.838147:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3f73eef refcount 3 to 172.19.3.171@o2ib600
00000100:00000001:18.0:1773851849.838148:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935868517088 : -107137841034528 : ffff9e8f070b0ae0)
02000000:00000001:18.0:1773851849.838148:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851849.838149:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851849.838150:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851849.838150:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.171@o2ib600
00000400:00000010:18.0:1773851849.838151:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2ef0da5.
00000100:00000200:18.0:1773851849.838152:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859201083101824, offset 224
00000400:00000200:18.0:1773851849.838154:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.171@o2ib600
00000400:00000200:18.0:1773851849.838155:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.171@o2ib600 to cpt 4
00000400:00000200:18.0:1773851849.838156:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 2
00000400:00000200:18.0:1773851849.838158:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 3
00000400:00000200:18.0:1773851849.838159:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 4
00000400:00000200:18.0:1773851849.838160:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.171@o2ib600 routed destination
00000400:00000200:18.0:1773851849.838161:0:61039:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:18.0:1773851849.838163:0:61039:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:18.0:1773851849.838164:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.171@o2ib600: rtr pref emtpy: 1
00000400:00000200:18.0:1773851849.838165:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:18.0:1773851849.838166:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.171@o2ib600: rtr pref emtpy: 1
00000400:00000200:18.0:1773851849.838167:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:18.0:1773851849.838168:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768438:8768438:1024:4294967295] 2094@kfi7 LPNI seq info [1258746978:1258746978:16:4294967295]
00000400:00000200:18.0:1773851849.838170:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:18.0:1773851849.838171:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:18.0:1773851849.838173:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.171@o2ib600(172.19.3.171@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851849.838175:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 3
00000800:00000200:18.0:1773851849.838176:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851849.838177:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851849.838180:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851849.838182:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:18.0:1773851849.838185:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006c9a9e9c: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:18.0:1773851849.838187:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851849.838189:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851849.838190:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3f73eef refcount 2 to 172.19.3.171@o2ib600
00010000:00000001:18.0:1773851849.838190:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851849.838191:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851849.838191:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851849.838192:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a3f6c2c x1859201083101824/t0(0) o400->c12e22a0-0329-4c15-a86e-2b2df3dfddd5@172.19.3.171@o2ib600:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic21-0'
00000100:00100000:18.0:1773851849.838195:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a3f6c2c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:c12e22a0-0329-4c15-a86e-2b2df3dfddd5+6:24877:x1859201083101824:12345-172.19.3.171@o2ib600:400:default-oslic21-0 Request processed in 72us (111us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851849.838197:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851849.838198:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.171@o2ib600, seq: 2156243
00000100:00000040:18.0:1773851849.838199:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b1bdc74e : new rpc_count 0
00000400:00000200:17.0:1773851849.838199:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851849.838200:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851849.838200:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851849.838201:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851849.838201:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:17.0:1773851849.838201:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2ef0da5
00000020:00000010:18.0:1773851849.838202:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000400:00000010:17.0:1773851849.838202:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2ef0da5.
00000020:00000010:18.0:1773851849.838203:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5d5268b.
00000020:00000040:18.0:1773851849.838203:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b1bdc74e : new refcount 5
00000100:00000001:17.0:1773851849.838203:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851849.838204:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851849.838204:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851849.838205:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851849.838206:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000800:00000200:17.0:1773851849.847261:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.847262:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.847263:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.847267:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.847269:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.847271:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.156@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851849.847273:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.847274:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851849.847276:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.156@o2ib600 to cpt 5
00000400:00000200:17.0:1773851849.847277:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 2
00000400:00000200:17.0:1773851849.847279:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 3
00000400:00000200:17.0:1773851849.847281:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.156@o2ib600 to cpt 5
00000400:00000200:17.0:1773851849.847282:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.156@o2ib600 of length 224 into portal 12 MB=0x699fe0ddfa780
00000400:00000200:17.0:1773851849.847284:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.156@o2ib600 of length 224/224 into md 0x6a32cacf5 [64] + 19776
00000800:00000200:17.0:1773851849.847287:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.847290:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.847292:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.847293:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.847294:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.847295:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009777524b.
00000100:00000040:17.0:1773851849.847296:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009777524b x1858166293768064 msgsize 224
00000100:00100000:17.0:1773851849.847299:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.156@o2ib600 (source: 12345-172.19.3.156@o2ib600)
00000100:00000001:17.0:1773851849.847301:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.847302:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851849.847304:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851849.847307:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851849.847308:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851849.847309:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851849.847310:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851849.847312:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851849.847314:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858166293768064
00000020:00000001:22.0:1773851849.847316:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851849.847317:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91309
00000020:00000001:22.0:1773851849.847318:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851849.847322:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e6d77679 refcount=6
00000020:00000001:22.0:1773851849.847324:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716191232 : -107155993360384 : ffff9e8acd148800)
00000020:00000001:22.0:1773851849.847326:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716191232 : -107155993360384 : ffff9e8acd148800)
00000100:00000001:22.0:1773851849.847327:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851849.847329:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851849.847330:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000537f43cb.
00000020:00000010:22.0:1773851849.847332:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851849.847334:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d08ac1b6.
00000100:00000001:22.0:1773851849.847336:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851849.847336:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851849.847337:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851849.847340:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851849.847341:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851849.847341:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.847344:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851849.847346:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851849.847347:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851849.847347:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851849.847347:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851849.847348:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.156@o2ib600, seq: 1997909
00000100:00000040:23.0:1773851849.847349:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e6d77679 : new rpc_count 1
00000100:00000001:23.0:1773851849.847350:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637028583789952 : -107045125761664 : ffff9ea49d4dd580)
00000100:00000001:22.0:1773851849.847350:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.847351:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851849.847353:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009777524b x1858166293768064/t0(0) o400->feed51c4-681e-4ef0-8d73-8fce5959d31f@172.19.3.156@o2ib600:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic6-0'
00000100:00000001:23.0:1773851849.847357:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851849.847357:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851849.847359:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009777524b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:feed51c4-681e-4ef0-8d73-8fce5959d31f+6:26472:x1858166293768064:12345-172.19.3.156@o2ib600:400:login-oslic6-0
00000100:00000200:23.0:1773851849.847360:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858166293768064
00000020:00000001:23.0:1773851849.847361:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851849.847362:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851849.847363:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851849.847364:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851849.847364:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851849.847365:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851849.847366:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858166293768064, found 0 last_xid 1858166293768063
00000020:00000001:23.0:1773851849.847367:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851849.847368:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851849.847368:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851849.847369:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851849.847369:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851849.847371:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851849.847372:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851849.847373:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bb61c326.
02000000:00000001:23.0:1773851849.847374:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851849.847374:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851849.847375:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851849.847376:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182988317141, transno 0, xid 1858166293768064
00010000:00000001:23.0:1773851849.847377:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851849.847378:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009777524b x1858166293768064/t0(0) o400->feed51c4-681e-4ef0-8d73-8fce5959d31f@172.19.3.156@o2ib600:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic6-0'
00010000:00000001:23.0:1773851849.847381:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851849.847381:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851849.847382:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=82 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851849.847384:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851849.847384:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000021d38f47 refcount 3 to 172.19.3.156@o2ib600
00000100:00000001:23.0:1773851849.847385:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999946336 : -107156709605280 : ffff9e8aa2638060)
02000000:00000001:23.0:1773851849.847386:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851849.847387:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851849.847387:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851849.847389:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.156@o2ib600
00000400:00000010:23.0:1773851849.847389:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037bf7dea.
00000100:00000200:23.0:1773851849.847390:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858166293768064, offset 224
00000400:00000200:23.0:1773851849.847392:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.156@o2ib600
00000400:00000200:23.0:1773851849.847394:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.156@o2ib600 to cpt 5
00000400:00000200:23.0:1773851849.847396:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 2
00000400:00000200:23.0:1773851849.847397:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 3
00000400:00000200:23.0:1773851849.847399:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 4
00000400:00000200:23.0:1773851849.847400:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.156@o2ib600 routed destination
00000400:00000200:23.0:1773851849.847401:0:61145:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851849.847403:0:61145:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:23.0:1773851849.847405:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.156@o2ib600: rtr pref emtpy: 1
00000400:00000200:23.0:1773851849.847406:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851849.847407:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.156@o2ib600: rtr pref emtpy: 1
00000400:00000200:23.0:1773851849.847410:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851849.847411:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768439:8768439:1024:4294967295] 17@kfi7 LPNI seq info [1250891878:1250891878:16:4294967295]
00000400:00000200:23.0:1773851849.847413:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:23.0:1773851849.847413:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:23.0:1773851849.847416:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.156@o2ib600(172.19.3.156@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851849.847418:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 3
00000800:00000200:23.0:1773851849.847420:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851849.847421:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851849.847424:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851849.847427:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:23.0:1773851849.847431:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:23.0:1773851849.847432:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851849.847435:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851849.847436:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000021d38f47 refcount 2 to 172.19.3.156@o2ib600
00010000:00000001:23.0:1773851849.847437:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851849.847437:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851849.847438:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851849.847439:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009777524b x1858166293768064/t0(0) o400->feed51c4-681e-4ef0-8d73-8fce5959d31f@172.19.3.156@o2ib600:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic6-0'
00000100:00100000:23.0:1773851849.847443:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009777524b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:feed51c4-681e-4ef0-8d73-8fce5959d31f+6:26472:x1858166293768064:12345-172.19.3.156@o2ib600:400:login-oslic6-0 Request processed in 85us (146us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851849.847445:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.156@o2ib600, seq: 1997909
00000800:00000200:21.0:1773851849.847445:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851849.847446:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e6d77679 : new rpc_count 0
00000100:00000001:23.0:1773851849.847447:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851849.847447:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851849.847448:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851849.847449:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851849.847449:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000010:23.0:1773851849.847450:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d08ac1b6.
00000400:00000200:21.0:1773851849.847450:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037bf7dea
00000400:00000010:21.0:1773851849.847450:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037bf7dea.
00000020:00000010:23.0:1773851849.847451:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000537f43cb.
00000100:00000001:21.0:1773851849.847451:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851849.847451:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851849.847452:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000040:23.0:1773851849.847453:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000e6d77679 : new refcount 5
00000100:00000001:23.0:1773851849.847453:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851849.847455:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Transaction freed
00000800:00000200:17.0:1773851849.854388:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851849.854390:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851849.854391:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851849.854394:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851849.854397:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.854399:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.31@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851849.854401:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851849.854402:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851849.854404:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.31@o2ib60 to cpt 0
00000400:00000200:17.0:1773851849.854407:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 2
00000400:00000200:17.0:1773851849.854410:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 3
00000400:00000200:17.0:1773851849.854411:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.31@o2ib60 to cpt 0
00000400:00000200:17.0:1773851849.854413:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.31@o2ib60 of length 224 into portal 12 MB=0x69b877c8ec9c0
00000400:00000200:17.0:1773851849.854416:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.31@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 5544
00000800:00000200:17.0:1773851849.854419:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851849.854422:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851849.854424:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851849.854426:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851849.854426:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851849.854428:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000af8e927b.
00000100:00000040:17.0:1773851849.854429:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000af8e927b x1859856072886720 msgsize 224
00000100:00100000:17.0:1773851849.854432:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.31@o2ib60 (source: 12345-192.168.128.31@o2ib60)
00000100:00000001:17.0:1773851849.854435:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851849.854436:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851849.854438:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851849.854439:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851849.854440:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851849.854441:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851849.854442:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851849.854443:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851849.854444:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859856072886720
00000020:00000001:1.0:1773851849.854445:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851849.854446:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f088c6a10317
00000020:00000001:1.0:1773851849.854447:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851849.854449:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004ff8a158 refcount=5
00000020:00000001:1.0:1773851849.854450:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142213413888 : -106931496137728 : ffff9ebf12284c00)
00000020:00000001:1.0:1773851849.854452:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142213413888 : -106931496137728 : ffff9ebf12284c00)
00000100:00000001:1.0:1773851849.854453:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851849.854455:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851849.854456:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851849.854457:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851849.854459:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851849.854461:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851849.854461:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851849.854462:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851849.854464:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851849.854465:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851849.854465:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.854467:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851849.854469:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851849.854470:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851849.854471:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851849.854472:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851849.854472:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.31@o2ib60, seq: 1997469
00000100:00000001:2.0:1773851849.854474:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851849.854474:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004ff8a158 : new rpc_count 1
00000100:00000001:2.0:1773851849.854475:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.854475:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637077795945088 : -106995913606528 : ffff9eb01293ba80)
00000100:00000040:1.0:1773851849.854478:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000af8e927b x1859856072886720/t0(0) o400->33817210-3a80-455d-8b39-e62572be47a5@192.168.128.31@o2ib60:489/0 lens 224/0 e 0 to 0 dl 1773852604 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix31-0'
00000100:00000001:1.0:1773851849.854483:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851849.854483:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851849.854485:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af8e927b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:33817210-3a80-455d-8b39-e62572be47a5+5:39845:x1859856072886720:12345-192.168.128.31@o2ib60:400:default-matrix31-0
00000100:00000200:1.0:1773851849.854488:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859856072886720
00000020:00000001:1.0:1773851849.854489:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851849.854490:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851849.854491:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.854492:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851849.854493:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851849.854494:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851849.854495:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859856072886720, found 0 last_xid 1859856072886719
00000020:00000001:1.0:1773851849.854496:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851849.854498:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851849.854498:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851849.854499:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.854500:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851849.854501:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851849.854502:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851849.854503:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d19fa361.
02000000:00000001:1.0:1773851849.854504:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.854505:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.854506:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851849.854507:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425071597, transno 0, xid 1859856072886720
00010000:00000001:1.0:1773851849.854509:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851849.854510:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000af8e927b x1859856072886720/t0(0) o400->33817210-3a80-455d-8b39-e62572be47a5@192.168.128.31@o2ib60:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix31-0'
00010000:00000001:1.0:1773851849.854514:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851849.854515:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851849.854516:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=82 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851849.854519:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851849.854520:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e03b5cee refcount 3 to 192.168.128.31@o2ib60
00000100:00000001:1.0:1773851849.854522:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050816 : -107154804500800 : ffff9e8b13f116c0)
02000000:00000001:1.0:1773851849.854523:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851849.854524:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851849.854525:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851849.854527:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.31@o2ib60
00000400:00000010:1.0:1773851849.854528:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000586dc892.
00000100:00000200:1.0:1773851849.854529:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859856072886720, offset 224
00000400:00000200:1.0:1773851849.854531:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.31@o2ib60
00000400:00000200:1.0:1773851849.854533:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.31@o2ib60 to cpt 0
00000400:00000200:1.0:1773851849.854535:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 2
00000400:00000200:1.0:1773851849.854537:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 3
00000400:00000200:1.0:1773851849.854540:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 4
00000400:00000200:1.0:1773851849.854542:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.31@o2ib60 routed destination
00000400:00000200:1.0:1773851849.854544:0:60951:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:1.0:1773851849.854546:0:60951:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:1.0:1773851849.854548:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.31@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851849.854551:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:1.0:1773851849.854552:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.31@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851849.854554:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:1.0:1773851849.854555:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768440:8768440:1024:4294967295] 17@kfi7 LPNI seq info [1250891879:1250891879:16:4294967295]
00000400:00000200:1.0:1773851849.854558:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:1.0:1773851849.854559:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:1.0:1773851849.854563:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.31@o2ib60(192.168.128.31@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851849.854566:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 3
00000800:00000200:1.0:1773851849.854568:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851849.854570:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851849.854574:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851849.854581:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:1.0:1773851849.854586:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:1.0:1773851849.854588:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851849.854592:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851849.854594:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e03b5cee refcount 2 to 192.168.128.31@o2ib60
00010000:00000001:1.0:1773851849.854595:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851849.854596:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851849.854597:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851849.854598:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000af8e927b x1859856072886720/t0(0) o400->33817210-3a80-455d-8b39-e62572be47a5@192.168.128.31@o2ib60:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix31-0'
00000100:00100000:1.0:1773851849.854604:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af8e927b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:33817210-3a80-455d-8b39-e62572be47a5+5:39845:x1859856072886720:12345-192.168.128.31@o2ib60:400:default-matrix31-0 Request processed in 120us (174us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851849.854606:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851849.854609:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851849.854609:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.31@o2ib60, seq: 1997469
00000100:00000040:1.0:1773851849.854610:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004ff8a158 : new rpc_count 0
00000400:00000200:2.0:1773851849.854611:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:1.0:1773851849.854612:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851849.854612:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851849.854613:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000586dc892
00000020:00000010:1.0:1773851849.854613:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000010:2.0:1773851849.854614:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000586dc892.
00000020:00000010:1.0:1773851849.854614:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000100:00000001:2.0:1773851849.854615:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851849.854616:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851849.854616:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000020:00000040:1.0:1773851849.854617:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004ff8a158 : new refcount 4
00000400:00000200:2.0:1773851849.854618:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:1.0:1773851849.854618:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851849.854621:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Transaction freed
00010000:00000001:2.0:1773851849.865734:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865735:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.865737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.865739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.865741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.865743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.865745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.865747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851849.865749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851849.865750:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851849.865757:0:937828:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:30.0:1773851849.865758:0:937828:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:30.0:1773851849.865759:0:937828:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:21.0:1773851849.898058:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851849.898059:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851849.898060:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851849.898062:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851849.898064:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21520@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.898065:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21520@kfi7 : PUT - for me
00000400:00000200:21.0:1773851849.898066:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21520@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.898067:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004d759111 nid 21520@kfi7 refs 1
00000400:00000200:21.0:1773851849.898068:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21520@kfi7 to cpt 5
00000400:00000200:21.0:1773851849.898069:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004d759111 nid 21520@kfi7 refs 2
00000400:00000200:21.0:1773851849.898069:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004d759111 nid 21520@kfi7 refs 3
00000400:00000200:21.0:1773851849.898070:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:21.0:1773851849.898071:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21712@kfi7 of length 224 into portal 12 MB=0x699e0a70292c0
00000400:00000200:21.0:1773851849.898072:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21712@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 20000
00000800:00000200:21.0:1773851849.898074:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851849.898076:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851849.898077:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21520@kfi7: PUT: OK
00000100:00000001:21.0:1773851849.898078:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851849.898078:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851849.898079:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070a68975.
00000100:00000040:21.0:1773851849.898080:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000070a68975 x1858040013951680 msgsize 224
00000100:00100000:21.0:1773851849.898081:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21712@kfi7 (source: 12345-21520@kfi7)
00000100:00000001:21.0:1773851849.898082:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851849.898083:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851849.898083:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004d759111 nid 21520@kfi7 refs 2
02000000:00000001:23.0:1773851849.898084:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851849.898084:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851849.898084:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851849.898085:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851849.898086:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851849.898087:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040013951680
00000020:00000001:23.0:1773851849.898087:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851849.898088:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9289c
00000020:00000001:23.0:1773851849.898089:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851849.898093:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000075bb3aec refcount=6
00000020:00000001:23.0:1773851849.898093:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742966272 : -107128966585344 : ffff9e9118006400)
00000020:00000001:23.0:1773851849.898094:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742966272 : -107128966585344 : ffff9e9118006400)
00000100:00000001:23.0:1773851849.898095:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851849.898096:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851849.898097:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000030b104a1.
00000020:00000010:23.0:1773851849.898098:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851849.898099:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851849.898100:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851849.898100:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851849.898101:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851849.898102:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851849.898102:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851849.898103:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851849.898104:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851849.898105:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851849.898106:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851849.898106:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851849.898106:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851849.898107:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21712@kfi7, seq: 1997910
00000100:00000001:23.0:1773851849.898108:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851849.898108:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000075bb3aec : new rpc_count 1
00000100:00000001:23.0:1773851849.898109:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.898109:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117331328 : -106995592220288 : ffff9eb025bbb180)
00000100:00000040:22.0:1773851849.898110:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000070a68975 x1858040013951680/t0(0) o400->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:489/0 lens 224/0 e 0 to 0 dl 1773852604 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1841-0'
00000100:00000001:22.0:1773851849.898113:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851849.898114:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851849.898115:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070a68975 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:45cc513a-aa46-4716-a011-ea6a00158659+6:39694:x1858040013951680:12345-21712@kfi7:400:default-tuolumne1841-0
00000100:00000200:22.0:1773851849.898116:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040013951680
00000020:00000001:22.0:1773851849.898117:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851849.898118:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851849.898119:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.898120:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851849.898120:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851849.898121:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851849.898122:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040013951680, found 0 last_xid 1858040013951679
00000020:00000001:22.0:1773851849.898123:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851849.898124:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851849.898124:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851849.898125:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.898125:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851849.898126:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851849.898127:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851849.898128:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a1ed158d.
02000000:00000001:22.0:1773851849.898128:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.898129:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.898130:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851849.898131:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595829, transno 0, xid 1858040013951680
00010000:00000001:22.0:1773851849.898132:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851849.898133:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000070a68975 x1858040013951680/t0(0) o400->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1841-0'
00010000:00000001:22.0:1773851849.898135:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851849.898136:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851849.898137:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=82 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851849.898138:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851849.898139:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006edcb5ed refcount 3 to 21712@kfi7
00000100:00000001:22.0:1773851849.898140:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451232 : -107149715100384 : ffff9e8c434b2d20)
02000000:00000001:22.0:1773851849.898141:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851849.898142:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851849.898142:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851849.898143:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21520@kfi7
00000400:00000010:22.0:1773851849.898144:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b975f2ee.
00000100:00000200:22.0:1773851849.898145:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040013951680, offset 224
00000400:00000200:22.0:1773851849.898146:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21520@kfi7
00000400:00000200:22.0:1773851849.898148:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21520@kfi7 to cpt 5
00000400:00000200:22.0:1773851849.898149:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004d759111 nid 21520@kfi7 refs 1
00000400:00000200:22.0:1773851849.898151:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004d759111 nid 21520@kfi7 refs 2
00000400:00000200:22.0:1773851849.898152:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004d759111 nid 21520@kfi7 refs 3
00000400:00000200:22.0:1773851849.898153:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21520@kfi7 local destination
00000400:00000200:22.0:1773851849.898155:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768441:8768441:1024:4294967295] 21520@kfi7 LPNI seq info [3936247:3936247:16:4294967295]
00000400:00000200:22.0:1773851849.898157:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004d759111 nid 21520@kfi7 refs 2
00000400:00000200:22.0:1773851849.898157:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21520@kfi7 to cpt 5
00000400:00000200:22.0:1773851849.898160:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21520@kfi7(21520@kfi7:21520@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851849.898161:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004d759111 nid 21520@kfi7 refs 3
00000800:00000200:22.0:1773851849.898163:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851849.898164:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851849.898167:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851849.898170:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000378 Using peer 21520@kfi7(0x100000000000378)
00000800:00000200:22.0:1773851849.898173:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000389ce1b3: Posted send of 324 bytes to peer 0x100000000000378: rc=0
00000800:00000200:22.0:1773851849.898175:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000378 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851849.898177:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851849.898178:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006edcb5ed refcount 2 to 21712@kfi7
00010000:00000001:22.0:1773851849.898179:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851849.898180:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851849.898180:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851849.898181:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000070a68975 x1858040013951680/t0(0) o400->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:489/0 lens 224/224 e 0 to 0 dl 1773852604 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1841-0'
00000100:00100000:22.0:1773851849.898185:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070a68975 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:45cc513a-aa46-4716-a011-ea6a00158659+6:39694:x1858040013951680:12345-21712@kfi7:400:default-tuolumne1841-0 Request processed in 70us (104us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851849.898185:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000378 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851849.898186:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851849.898187:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21520@kfi7: PUT: OK
00000400:00000200:21.0:1773851849.898188:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b975f2ee
00000100:00100000:22.0:1773851849.898189:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21712@kfi7, seq: 1997910
00000400:00000010:21.0:1773851849.898189:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b975f2ee.
00000100:00000001:21.0:1773851849.898189:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851849.898189:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:22.0:1773851849.898190:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000075bb3aec : new rpc_count 0
00000400:00000200:21.0:1773851849.898190:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004d759111 nid 21520@kfi7 refs 2
00000100:00000001:22.0:1773851849.898191:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851849.898192:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851849.898192:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851849.898192:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 21520@kfi7(0000000001514be7):0x0 lsk 889 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000378 Transaction freed
00000020:00000010:22.0:1773851849.898193:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:22.0:1773851849.898194:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000030b104a1.
00000020:00000040:22.0:1773851849.898195:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000075bb3aec : new refcount 5
00000100:00000001:22.0:1773851849.898196:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851849.972254:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851849.972256:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851849.972258:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851849.972262:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851849.972267:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.972269:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20320@kfi7 : PUT - for me
00000400:00000200:9.0:1773851849.972271:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.972272:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 1
00000400:00000200:9.0:1773851849.972274:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:9.0:1773851849.972275:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000400:00000200:9.0:1773851849.972276:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 3
00000400:00000200:9.0:1773851849.972278:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000400:00000200:9.0:1773851849.972279:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 224 into portal 12 MB=0x699e2eb464b80
00000400:00000200:9.0:1773851849.972282:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20321@kfi7 of length 224/224 into md 0x78146ce49 [64] + 115192
00000800:00000200:9.0:1773851849.972285:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851849.972288:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.972289:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20320@kfi7: PUT: OK
00000100:00000001:9.0:1773851849.972291:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851849.972292:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851849.972294:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b4eafdef.
00000100:00000040:9.0:1773851849.972295:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000b4eafdef x1858049749175168 msgsize 224
00000100:00100000:9.0:1773851849.972298:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20320@kfi7)
00000100:00000001:9.0:1773851849.972299:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851849.972301:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000100:00000001:8.0:1773851849.972302:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851849.972303:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851849.972303:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851849.972304:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851849.972305:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851849.972306:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851849.972307:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049749175168
00000020:00000001:8.0:1773851849.972308:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851849.972309:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000020:00000001:8.0:1773851849.972310:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851849.972312:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=312
00000020:00000001:8.0:1773851849.972313:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000001:8.0:1773851849.972315:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00000001:8.0:1773851849.972316:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.972318:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851849.972319:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851849.972320:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.972322:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851849.972323:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851849.972324:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851849.972325:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851849.972327:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851849.972327:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851849.972328:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.972330:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851849.972332:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851849.972333:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851849.972333:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851849.972334:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851849.972334:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20321@kfi7, seq: 2130707
00000100:00000040:8.0:1773851849.972335:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001c891228 : new rpc_count 3
00000100:00000001:11.0:1773851849.972336:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851849.972337:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.972337:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792139776 : -106938917411840 : ffff9ebd57d0a400)
00000100:00000040:8.0:1773851849.972338:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b4eafdef x1858049749175168/t0(0) o400->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1760-0'
00000100:00000001:8.0:1773851849.972343:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851849.972344:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851849.972345:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4eafdef pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:22d610ea-bd49-4aa8-a9ca-314c404a25ba+312:39776:x1858049749175168:12345-20321@kfi7:400:default-tuolumne1760-0
00000100:00000200:8.0:1773851849.972348:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858049749175168
00000020:00000001:8.0:1773851849.972349:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851849.972350:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851849.972351:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.972352:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851849.972352:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851849.972354:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851849.972355:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858049749175168, found 0 last_xid 1858049711087935
00000020:00000001:8.0:1773851849.972356:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851849.972357:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851849.972358:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851849.972359:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.972360:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851849.972361:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851849.972362:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851849.972363:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005c46322a.
02000000:00000001:8.0:1773851849.972364:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.972365:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.972366:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851849.972368:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578129, transno 0, xid 1858049749175168
00010000:00000001:8.0:1773851849.972369:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851849.972370:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b4eafdef x1858049749175168/t0(0) o400->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1760-0'
00010000:00000001:8.0:1773851849.972375:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851849.972376:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851849.972377:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=82 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851849.972379:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851849.972380:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fbb9e656 refcount 3 to 20321@kfi7
00000100:00000001:8.0:1773851849.972381:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094496 : -107139307457120 : ffff9e8eafa335a0)
02000000:00000001:8.0:1773851849.972382:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851849.972383:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851849.972384:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851849.972385:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20320@kfi7
00000400:00000010:8.0:1773851849.972387:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000286a46f2.
00000100:00000200:8.0:1773851849.972388:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858049749175168, offset 224
00000400:00000200:8.0:1773851849.972390:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20320@kfi7
00000400:00000200:8.0:1773851849.972392:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.972393:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 1
00000400:00000200:8.0:1773851849.972395:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000400:00000200:8.0:1773851849.972397:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 3
00000400:00000200:8.0:1773851849.972399:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20320@kfi7 local destination
00000400:00000200:8.0:1773851849.972401:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768442:8768442:1024:4294967295] 20320@kfi7 LPNI seq info [18599944:18599944:16:4294967295]
00000400:00000200:8.0:1773851849.972403:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000400:00000200:8.0:1773851849.972404:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:8.0:1773851849.972408:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20320@kfi7(20320@kfi7:20320@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851849.972410:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 3
00000800:00000200:8.0:1773851849.972412:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851849.972414:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851849.972417:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851849.972422:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a8a Using peer 20320@kfi7(0x100000000000a8a)
00000800:00000200:8.0:1773851849.972426:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x100000000000a8a: rc=0
00000800:00000200:8.0:1773851849.972429:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a8a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851849.972432:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851849.972433:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fbb9e656 refcount 2 to 20321@kfi7
00010000:00000001:8.0:1773851849.972434:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851849.972435:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851849.972439:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851849.972440:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b4eafdef x1858049749175168/t0(0) o400->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1760-0'
00000100:00100000:8.0:1773851849.972445:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4eafdef pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:22d610ea-bd49-4aa8-a9ca-314c404a25ba+312:39776:x1858049749175168:12345-20321@kfi7:400:default-tuolumne1760-0 Request processed in 100us (149us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851849.972449:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20321@kfi7, seq: 2130707
00000100:00000040:8.0:1773851849.972450:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001c891228 : new rpc_count 2
00000100:00000001:8.0:1773851849.972451:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851849.972452:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851849.972453:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851849.972454:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851849.972455:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851849.972457:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 311
00000100:00000001:8.0:1773851849.972458:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851849.972465:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a8a TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851849.972468:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851849.972470:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20320@kfi7: PUT: OK
00000400:00000200:9.0:1773851849.972471:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000286a46f2
00000400:00000010:9.0:1773851849.972472:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000286a46f2.
00000100:00000001:9.0:1773851849.972473:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851849.972474:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851849.972476:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000800:00000200:9.0:1773851849.972478:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a8a Transaction freed
00000800:00000200:5.0:1773851849.975387:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851849.975390:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851849.975393:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851849.975398:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851849.975402:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11984@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.975404:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11984@kfi7 : PUT - for me
00000400:00000200:5.0:1773851849.975407:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11984@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.975408:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e41be5f3 nid 11984@kfi7 refs 1
00000400:00000200:5.0:1773851849.975410:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11984@kfi7 to cpt 1
00000400:00000200:5.0:1773851849.975411:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e41be5f3 nid 11984@kfi7 refs 2
00000400:00000200:5.0:1773851849.975413:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e41be5f3 nid 11984@kfi7 refs 3
00000400:00000200:5.0:1773851849.975415:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11792@kfi7 to cpt 7
00000400:00000200:5.0:1773851849.975416:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11792@kfi7 of length 224 into portal 12 MB=0x69b4c3ade5900
00000400:00000200:5.0:1773851849.975419:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11792@kfi7 of length 224/224 into md 0x793926dc5 [64] + 114000
00000800:00000200:5.0:1773851849.975424:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851849.975427:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851849.975429:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11984@kfi7: PUT: OK
00000100:00000001:5.0:1773851849.975431:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851849.975432:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851849.975433:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d985513a.
00000100:00000040:5.0:1773851849.975435:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d985513a x1859601567734016 msgsize 224
00000100:00100000:5.0:1773851849.975437:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-11792@kfi7 (source: 12345-11984@kfi7)
00000100:00000001:5.0:1773851849.975439:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851849.975441:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e41be5f3 nid 11984@kfi7 refs 2
00000100:00000001:6.0:1773851849.975442:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851849.975444:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851849.975444:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851849.975445:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851849.975445:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851849.975447:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851849.975449:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601567734016
00000020:00000001:6.0:1773851849.975450:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851849.975450:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7ed57
00000020:00000001:6.0:1773851849.975452:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851849.975454:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000367174e4 refcount=5
00000020:00000001:6.0:1773851849.975455:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098251043840 : -106975458507776 : ffff9eb4d5cbc400)
00000020:00000001:6.0:1773851849.975457:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098251043840 : -106975458507776 : ffff9eb4d5cbc400)
00000100:00000001:6.0:1773851849.975459:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851849.975460:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851849.975461:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000086f510d0.
00000020:00000010:6.0:1773851849.975463:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000ca491f03.
00000020:00000010:6.0:1773851849.975465:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851849.975467:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851849.975467:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851849.975468:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.975470:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:6.0:1773851849.975471:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:6.0:1773851849.975472:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.975474:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851849.975476:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851849.975477:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851849.975477:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851849.975477:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851849.975479:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11792@kfi7, seq: 2001834
00000100:00000001:7.0:1773851849.975481:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.975481:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000367174e4 : new rpc_count 1
00000100:00000001:7.0:1773851849.975482:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.975482:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637061663675776 : -107012045875840 : ffff9eac5104d580)
00000100:00000040:6.0:1773851849.975484:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d985513a x1859601567734016/t0(0) o400->d1947575-a800-4ee0-8cf0-50468cd8fe58@11792@kfi7:576/0 lens 224/0 e 0 to 0 dl 1773851936 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1233-0'
00000100:00000001:6.0:1773851849.975495:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851849.975496:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851849.975497:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d985513a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d1947575-a800-4ee0-8cf0-50468cd8fe58+5:39463:x1859601567734016:12345-11792@kfi7:400:default-tuolumne1233-0
00000100:00000200:6.0:1773851849.975500:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601567734016
00000020:00000001:6.0:1773851849.975501:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851849.975502:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851849.975503:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.975504:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851849.975505:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851849.975507:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851849.975508:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601567734016, found 0 last_xid 1859601567734015
00000020:00000001:6.0:1773851849.975509:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851849.975510:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851849.975511:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851849.975512:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.975513:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851849.975514:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851849.975515:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851849.975516:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009120c9db.
02000000:00000001:6.0:1773851849.975518:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.975519:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.975520:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851849.975521:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690944142, transno 0, xid 1859601567734016
00010000:00000001:6.0:1773851849.975522:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851849.975524:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d985513a x1859601567734016/t0(0) o400->d1947575-a800-4ee0-8cf0-50468cd8fe58@11792@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1233-0'
00010000:00000001:6.0:1773851849.975528:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851849.975529:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851849.975530:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=81 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851849.975532:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851849.975533:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000001cd29e7 refcount 3 to 11792@kfi7
00000100:00000001:6.0:1773851849.975535:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064416 : -107155994487200 : ffff9e8acd035660)
02000000:00000001:6.0:1773851849.975537:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851849.975538:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851849.975539:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851849.975540:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11984@kfi7
00000400:00000010:6.0:1773851849.975541:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f75391c.
00000100:00000200:6.0:1773851849.975543:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601567734016, offset 224
00000400:00000200:6.0:1773851849.975545:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11984@kfi7
00000400:00000200:6.0:1773851849.975547:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11984@kfi7 to cpt 1
00000400:00000200:6.0:1773851849.975548:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e41be5f3 nid 11984@kfi7 refs 1
00000400:00000200:6.0:1773851849.975550:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e41be5f3 nid 11984@kfi7 refs 2
00000400:00000200:6.0:1773851849.975552:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e41be5f3 nid 11984@kfi7 refs 3
00000400:00000200:6.0:1773851849.975554:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11984@kfi7 local destination
00000400:00000200:6.0:1773851849.975557:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768443:8768443:1024:4294967295] 11984@kfi7 LPNI seq info [206039:206039:16:4294967295]
00000400:00000200:6.0:1773851849.975559:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e41be5f3 nid 11984@kfi7 refs 2
00000400:00000200:6.0:1773851849.975561:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11984@kfi7 to cpt 1
00000400:00000200:6.0:1773851849.975565:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11984@kfi7(11984@kfi7:11984@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851849.975567:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e41be5f3 nid 11984@kfi7 refs 3
00000800:00000200:6.0:1773851849.975570:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851849.975572:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851849.975576:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851849.975580:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bc7 Using peer 11984@kfi7(0x100000000000bc7)
00000800:00000200:6.0:1773851849.975585:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 324 bytes to peer 0x100000000000bc7: rc=0
00000800:00000200:6.0:1773851849.975588:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bc7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851849.975591:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851849.975593:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000001cd29e7 refcount 2 to 11792@kfi7
00010000:00000001:6.0:1773851849.975594:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851849.975595:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851849.975596:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851849.975597:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d985513a x1859601567734016/t0(0) o400->d1947575-a800-4ee0-8cf0-50468cd8fe58@11792@kfi7:576/0 lens 224/224 e 0 to 0 dl 1773851936 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1233-0'
00000800:00000200:5.0:1773851849.975601:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bc7 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851849.975603:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d985513a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d1947575-a800-4ee0-8cf0-50468cd8fe58+5:39463:x1859601567734016:12345-11792@kfi7:400:default-tuolumne1233-0 Request processed in 107us (167us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851849.975604:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851849.975606:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11984@kfi7: PUT: OK
00000100:00100000:6.0:1773851849.975607:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11792@kfi7, seq: 2001834
00000100:00000040:6.0:1773851849.975608:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000367174e4 : new rpc_count 0
00000400:00000200:5.0:1773851849.975608:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f75391c
00000400:00000010:5.0:1773851849.975608:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f75391c.
00000100:00000001:6.0:1773851849.975610:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851849.975610:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851849.975611:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851849.975611:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:6.0:1773851849.975612:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000ca491f03.
00000400:00000200:5.0:1773851849.975612:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e41be5f3 nid 11984@kfi7 refs 2
00000020:00000010:6.0:1773851849.975613:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000020:00000010:6.0:1773851849.975615:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000086f510d0.
00000800:00000200:5.0:1773851849.975615:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 11984@kfi7(00000000ee0d7b60):0x0 lsk 3016 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bc7 Transaction freed
00000020:00000040:6.0:1773851849.975616:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000367174e4 : new refcount 4
00000100:00000001:6.0:1773851849.975617:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851850.036987:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851850.036987:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851850.036989:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851850.036990:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851850.036992:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.036993:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16496@kfi7 : PUT - for me
00000400:00000200:21.0:1773851850.036994:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.036996:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 1
00000400:00000200:21.0:1773851850.036997:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.036998:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000400:00000200:21.0:1773851850.036999:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 3
00000400:00000200:21.0:1773851850.036999:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16561@kfi7 to cpt 4
00000400:00000200:21.0:1773851850.037000:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16561@kfi7 of length 224 into portal 12 MB=0x69b44eb715000
00000400:00000200:21.0:1773851850.037002:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16561@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 20224
00000800:00000200:21.0:1773851850.037004:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851850.037005:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851850.037006:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16496@kfi7: PUT: OK
00000100:00000001:21.0:1773851850.037007:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851850.037008:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851850.037009:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000b32f299.
00000100:00000040:21.0:1773851850.037010:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000b32f299 x1859570170417152 msgsize 224
00000100:00100000:21.0:1773851850.037011:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16561@kfi7 (source: 12345-16496@kfi7)
00000100:00000001:21.0:1773851850.037012:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851850.037013:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000100:00000001:22.0:1773851850.037014:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851850.037015:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851850.037015:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851850.037016:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851850.037016:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851850.037017:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851850.037018:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859570170417152
00000020:00000001:22.0:1773851850.037019:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851850.037019:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07d95ea24e6
00000020:00000001:22.0:1773851850.037020:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851850.037024:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000034923f78 refcount=5
00000020:00000001:22.0:1773851850.037025:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139374468096 : -106934335083520 : ffff9ebe68f16c00)
00000020:00000001:22.0:1773851850.037026:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139374468096 : -106934335083520 : ffff9ebe68f16c00)
00000100:00000001:22.0:1773851850.037027:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851850.037028:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851850.037029:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2b41301.
00000020:00000010:22.0:1773851850.037030:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851850.037031:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000140f5233.
00000100:00000001:22.0:1773851850.037032:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851850.037032:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851850.037033:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851850.037034:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851850.037034:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851850.037035:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.037036:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851850.037038:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851850.037038:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851850.037039:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851850.037040:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16561@kfi7, seq: 1997911
00000100:00000001:22.0:1773851850.037040:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851850.037041:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000034923f78 : new rpc_count 1
00000100:00000001:22.0:1773851850.037041:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.037042:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117324416 : -106995592227200 : ffff9eb025bb9680)
00000100:00000001:22.0:1773851850.037042:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.037044:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000b32f299 x1859570170417152/t0(0) o400->d3aa33fc-9573-49b1-a536-a003b591b72e@16561@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1518-0'
00000100:00000001:23.0:1773851850.037047:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851850.037048:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851850.037049:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b32f299 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d3aa33fc-9573-49b1-a536-a003b591b72e+5:39827:x1859570170417152:12345-16561@kfi7:400:default-tuolumne1518-0
00000100:00000200:23.0:1773851850.037051:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859570170417152
00000020:00000001:23.0:1773851850.037051:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851850.037052:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851850.037053:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.037054:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851850.037054:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851850.037055:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851850.037056:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859570170417152, found 0 last_xid 1859570170417151
00000020:00000001:23.0:1773851850.037057:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851850.037058:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851850.037058:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851850.037059:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.037060:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851850.037061:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851850.037061:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851850.037062:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000030b104a1.
02000000:00000001:23.0:1773851850.037063:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.037063:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.037064:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851850.037065:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044165082, transno 0, xid 1859570170417152
00010000:00000001:23.0:1773851850.037066:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851850.037067:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000b32f299 x1859570170417152/t0(0) o400->d3aa33fc-9573-49b1-a536-a003b591b72e@16561@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1518-0'
00010000:00000001:23.0:1773851850.037071:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851850.037073:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851850.037074:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=83 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851850.037076:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851850.037077:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e065949f refcount 3 to 16561@kfi7
00000100:00000001:23.0:1773851850.037079:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958016 : -107156125593600 : ffff9e8ac532d000)
02000000:00000001:23.0:1773851850.037080:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851850.037081:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.037082:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851850.037083:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16496@kfi7
00000400:00000010:23.0:1773851850.037084:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001f94b366.
00000100:00000200:23.0:1773851850.037086:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859570170417152, offset 224
00000400:00000200:23.0:1773851850.037089:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16496@kfi7
00000400:00000200:23.0:1773851850.037091:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.037093:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 1
00000400:00000200:23.0:1773851850.037095:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000400:00000200:23.0:1773851850.037097:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 3
00000400:00000200:23.0:1773851850.037100:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16496@kfi7 local destination
00000400:00000200:23.0:1773851850.037102:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768444:8768444:1024:4294967295] 16496@kfi7 LPNI seq info [8007779:8007779:16:4294967295]
00000400:00000200:23.0:1773851850.037105:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000400:00000200:23.0:1773851850.037107:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.037111:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16496@kfi7(16496@kfi7:16496@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851850.037113:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 3
00000800:00000200:23.0:1773851850.037116:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851850.037118:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851850.037123:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851850.037127:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x461 Using peer 16496@kfi7(0x461)
00000800:00000200:23.0:1773851850.037133:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x461: rc=0
00000800:00000200:23.0:1773851850.037136:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x461 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851850.037142:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.037143:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e065949f refcount 2 to 16561@kfi7
00010000:00000001:23.0:1773851850.037144:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851850.037145:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.037147:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851850.037148:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000b32f299 x1859570170417152/t0(0) o400->d3aa33fc-9573-49b1-a536-a003b591b72e@16561@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1518-0'
00000800:00000200:21.0:1773851850.037152:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x461 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851850.037154:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b32f299 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d3aa33fc-9573-49b1-a536-a003b591b72e+5:39827:x1859570170417152:12345-16561@kfi7:400:default-tuolumne1518-0 Request processed in 106us (143us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851850.037155:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851850.037157:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16496@kfi7: PUT: OK
00000400:00000200:21.0:1773851850.037158:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001f94b366
00000100:00100000:23.0:1773851850.037159:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16561@kfi7, seq: 1997911
00000400:00000010:21.0:1773851850.037159:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001f94b366.
00000100:00000040:23.0:1773851850.037160:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000034923f78 : new rpc_count 0
00000100:00000001:21.0:1773851850.037160:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851850.037161:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851850.037161:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851850.037162:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851850.037162:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000020:00000010:23.0:1773851850.037163:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:23.0:1773851850.037165:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000140f5233.
00000800:00000200:21.0:1773851850.037165:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 16496@kfi7(00000000de6d17c0):0x0 lsk 1122 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x461 Transaction freed
00000020:00000010:23.0:1773851850.037167:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2b41301.
00000020:00000040:23.0:1773851850.037168:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000034923f78 : new refcount 4
00000100:00000001:23.0:1773851850.037170:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851850.057732:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851850.057733:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851850.057734:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073d0c946.
00000020:00000040:6.0:1773851850.057735:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851850.057737:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851850.057738:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851850.057739:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851850.057741:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000035adc4a4.
00000100:00000001:6.0:1773851850.057742:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851850.057744:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851850.057745:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851850.057747:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000073d0c946] to pc [ptlrpcd_01_02+2]  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851850.057754:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:5.0:1773851850.057755:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:6.0:1773851850.057756:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ed850049.
00000100:00000001:5.0:1773851850.057756:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851850.057756:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:4.0:1773851850.057756:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851850.057756:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.057757:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851850.057758:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637124839402496 : -106948870149120 : ffff9ebb0695ec00)
00080000:00000001:6.0:1773851850.057759:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851850.057760:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851850.057761:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851850.057762:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851850.057762:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:6.0:1773851850.057763:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
02000000:00000001:5.0:1773851850.057763:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851850.057763:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000073d0c946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051921536:16@kfi7:13:default-yuba2-0
00000004:00000010:6.0:1773851850.057764:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000afa24891.
00000100:00000001:5.0:1773851850.057765:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00080000:6.0:1773851850.057766:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614124511041179ns, next at 614125511039466ns, rc = 0
02000000:00000001:5.0:1773851850.057766:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851850.057766:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851850.057767:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851850.057767:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:5.0:1773851850.057768:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000069fb2a64.
02000000:00000001:5.0:1773851850.057768:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851850.057769:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851850.057769:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000004:00000001:6.0:1773851850.057770:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851850.057770:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f228ac8a.
00000400:00000010:5.0:1773851850.057771:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000200:5.0:1773851850.057772:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921536, portal 4
00000100:00000001:5.0:1773851850.057773:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851850.057773:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637119644518400 : -106954065033216 : ffff9eb9d0f24800)
00000100:00000040:5.0:1773851850.057775:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851850.057778:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851850.057778:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:5.0:1773851850.057779:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
00000100:00000200:5.0:1773851850.057780:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921536, offset 0
00000400:00000200:5.0:1773851850.057782:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:5.0:1773851850.057783:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:5.0:1773851850.057784:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:5.0:1773851850.057785:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:5.0:1773851850.057787:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:5.0:1773851850.057788:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:5.0:1773851850.057790:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768444, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768443, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851850.057792:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:5.0:1773851850.057793:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851850.057793:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:5.0:1773851850.057795:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768445:8768445:1024:4294967295] 16@kfi7 LPNI seq info [5403811:5403811:16:4294967295]
00000400:00000200:5.0:1773851850.057796:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:5.0:1773851850.057797:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:5.0:1773851850.057799:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851850.057801:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:5.0:1773851850.057802:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.057804:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851850.057806:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851850.057809:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Using peer 16@kfi7(0x200000000000169)
00000800:00000200:5.0:1773851850.057812:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x200000000000169: rc=0
00000800:00000200:5.0:1773851850.057814:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851850.057816:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.057817:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851850.057818:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.057818:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.057819:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.057821:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851850.057821:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851850.057822:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851850.057822:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851850.057822:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.057823:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851850.057826:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851850.057827:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851850.057829:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000400:00000200:5.0:1773851850.057829:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00000400:00000010:5.0:1773851850.057830:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
00000100:00000001:5.0:1773851850.057831:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851850.057832:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851850.057835:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851850.057835:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851850.057838:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.057838:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851850.057839:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:5.0:1773851850.057841:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Transaction freed
00000800:00000200:29.0:1773851850.059888:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851850.059889:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851850.059890:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851850.059893:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851850.059896:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.059898:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851850.059899:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.059900:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851850.059901:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.059901:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851850.059902:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851850.059903:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.059904:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1c80
00000400:00000200:29.0:1773851850.059906:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.059908:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x78007f77d [1] + 224
00000800:00000200:29.0:1773851850.059910:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851850.059912:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851850.059913:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851850.059915:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851850.059916:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851850.059920:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851850.059924:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851850.059925:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:5.0:1773851850.059926:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851850.059927:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851850.059927:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:5.0:1773851850.059928:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851850.059929:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:5.0:1773851850.059930:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f228ac8a.
00000400:00000200:5.0:1773851850.059930:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:5.0:1773851850.059931:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00000001:5.0:1773851850.059932:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851850.059933:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851850.059935:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851850.059940:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851850.059941:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.059941:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851850.059942:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851850.059943:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851850.059944:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851850.059944:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851850.059946:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=83 v=66 (66 66 66 66)
00000100:00001000:5.0:1773851850.059947:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=83 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851850.059948:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851850.059948:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851850.059949:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851850.059950:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.059951:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851850.059951:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:5.0:1773851850.059952:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851850.059952:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.059953:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851850.059956:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851850.059957:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851850.059957:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851850.059958:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851850.059959:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:5.0:1773851850.059960:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482149888 avail=351481123840 avail_mb=1372973140 hwm_mb=3131103 files=372097214 ffree=343244287 state=0: rc = 0
00000004:00000020:5.0:1773851850.059962:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482149888 free, 351481123840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097214 files, 343244287 free files
00000004:00000001:5.0:1773851850.059964:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.059964:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:5.0:1773851850.059967:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000073d0c946 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051921536:16@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851850.059970:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.059970:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851850.059971:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000073d0c946 x1859433051921536/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851850.059973:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851850.059974:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851850.059974:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000069fb2a64.
02000000:00000001:5.0:1773851850.059975:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851850.059976:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851850.059976:0:41066:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:5.0:1773851850.059977:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851850.059978:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000035adc4a4.
02000000:00000001:5.0:1773851850.059978:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851850.059979:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851850.059980:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000073d0c946.
00000100:00000001:5.0:1773851850.059981:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851850.059981:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.059981:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.059982:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851850.059983:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.059983:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851850.059984:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851850.082666:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851850.082667:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851850.082668:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851850.082670:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851850.082672:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.082673:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9697@kfi7 : PUT - for me
00000400:00000200:21.0:1773851850.082674:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.082674:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 1
00000400:00000200:21.0:1773851850.082675:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.082676:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000400:00000200:21.0:1773851850.082677:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 3
00000400:00000200:21.0:1773851850.082677:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9505@kfi7 to cpt 2
00000400:00000200:21.0:1773851850.082678:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9505@kfi7 of length 224 into portal 12 MB=0x69aa079dbffc0
00000400:00000200:21.0:1773851850.082680:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9505@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 20448
00000800:00000200:21.0:1773851850.082681:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851850.082683:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851850.082684:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9697@kfi7: PUT: OK
00000100:00000001:21.0:1773851850.082684:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851850.082685:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851850.082686:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000892119ae.
00000100:00000040:21.0:1773851850.082686:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000892119ae x1858863890169792 msgsize 224
00000100:00100000:21.0:1773851850.082687:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9505@kfi7 (source: 12345-9697@kfi7)
00000100:00000001:21.0:1773851850.082688:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851850.082689:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000100:00000001:23.0:1773851850.082690:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851850.082690:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851850.082690:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851850.082691:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851850.082691:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851850.082692:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851850.082693:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890169792
00000020:00000001:23.0:1773851850.082693:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851850.082694:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a4e
00000020:00000001:23.0:1773851850.082694:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851850.082697:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b97b2bf8 refcount=6
00000020:00000001:23.0:1773851850.082698:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743459840 : -107128966091776 : ffff9e911807ec00)
00000020:00000001:23.0:1773851850.082698:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743459840 : -107128966091776 : ffff9e911807ec00)
00000100:00000001:23.0:1773851850.082699:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851850.082701:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851850.082702:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000054a79f9a.
00000020:00000010:23.0:1773851850.082703:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851850.082704:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851850.082704:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851850.082705:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851850.082705:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851850.082706:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851850.082706:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851850.082707:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.082708:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851850.082709:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851850.082709:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851850.082709:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851850.082710:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9505@kfi7, seq: 1997912
00000100:00000040:23.0:1773851850.082710:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b97b2bf8 : new rpc_count 1
00000100:00000001:22.0:1773851850.082710:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851850.082711:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117349760 : -106995592201856 : ffff9eb025bbf980)
00000100:00000001:22.0:1773851850.082711:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.082711:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.082712:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000892119ae x1858863890169792/t0(0) o400->f1242886-a7cd-42fb-a71e-e33abc31f00a@9505@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1087-0'
00000100:00000001:23.0:1773851850.082715:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851850.082715:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851850.082716:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000892119ae pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f1242886-a7cd-42fb-a71e-e33abc31f00a+6:39032:x1858863890169792:12345-9505@kfi7:400:default-tuolumne1087-0
00000100:00000200:23.0:1773851850.082717:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890169792
00000020:00000001:23.0:1773851850.082718:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851850.082718:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851850.082719:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.082719:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851850.082720:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851850.082721:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851850.082721:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890169792, found 0 last_xid 1858863890169791
00000020:00000001:23.0:1773851850.082722:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851850.082722:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851850.082723:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851850.082723:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.082724:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851850.082727:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851850.082728:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851850.082730:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e09081fb.
02000000:00000001:23.0:1773851850.082731:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.082731:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.082732:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851850.082732:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475273052, transno 0, xid 1858863890169792
00010000:00000001:23.0:1773851850.082733:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851850.082734:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000892119ae x1858863890169792/t0(0) o400->f1242886-a7cd-42fb-a71e-e33abc31f00a@9505@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1087-0'
00010000:00000001:23.0:1773851850.082736:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851850.082736:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851850.082737:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=83 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851850.082738:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851850.082739:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000a7843a0 refcount 3 to 9505@kfi7
00000100:00000001:23.0:1773851850.082740:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051135424 : -107146658416192 : ffff9e8cf97c79c0)
02000000:00000001:23.0:1773851850.082740:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851850.082741:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.082741:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851850.082742:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9697@kfi7
00000400:00000010:23.0:1773851850.082743:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007062c552.
00000100:00000200:23.0:1773851850.082744:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890169792, offset 224
00000400:00000200:23.0:1773851850.082745:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9697@kfi7
00000400:00000200:23.0:1773851850.082746:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.082747:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 1
00000400:00000200:23.0:1773851850.082748:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000400:00000200:23.0:1773851850.082749:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 3
00000400:00000200:23.0:1773851850.082750:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9697@kfi7 local destination
00000400:00000200:23.0:1773851850.082752:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768446:8768446:1024:4294967295] 9697@kfi7 LPNI seq info [17481:17481:16:4294967295]
00000400:00000200:23.0:1773851850.082753:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000400:00000200:23.0:1773851850.082754:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.082756:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9697@kfi7(9697@kfi7:9697@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851850.082758:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 3
00000800:00000200:23.0:1773851850.082759:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851850.082760:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851850.082763:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851850.082765:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001ce Using peer 9697@kfi7(0x1000000000001ce)
00000800:00000200:23.0:1773851850.082769:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x1000000000001ce: rc=0
00000800:00000200:23.0:1773851850.082770:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851850.082772:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.082773:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000a7843a0 refcount 2 to 9505@kfi7
00010000:00000001:23.0:1773851850.082773:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851850.082774:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.082774:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851850.082775:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000892119ae x1858863890169792/t0(0) o400->f1242886-a7cd-42fb-a71e-e33abc31f00a@9505@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1087-0'
00000100:00100000:23.0:1773851850.082778:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000892119ae pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f1242886-a7cd-42fb-a71e-e33abc31f00a+6:39032:x1858863890169792:12345-9505@kfi7:400:default-tuolumne1087-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851850.082780:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9505@kfi7, seq: 1997912
00000100:00000040:23.0:1773851850.082781:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b97b2bf8 : new rpc_count 0
00000100:00000001:23.0:1773851850.082781:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851850.082781:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851850.082781:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001ce TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851850.082782:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851850.082782:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851850.082783:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851850.082783:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000054a79f9a.
00000400:00000200:21.0:1773851850.082783:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9697@kfi7: PUT: OK
00000020:00000040:23.0:1773851850.082784:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b97b2bf8 : new refcount 5
00000400:00000200:21.0:1773851850.082784:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007062c552
00000400:00000010:21.0:1773851850.082784:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007062c552.
00000100:00000001:23.0:1773851850.082785:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851850.082785:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851850.082785:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851850.082786:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000800:00000200:21.0:1773851850.082787:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 9697@kfi7(000000002bf813f8):0x0 lsk 463 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001ce Transaction freed
00000800:00000200:17.0:1773851850.084616:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851850.084617:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851850.084618:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851850.084620:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851850.084622:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.084623:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:17.0:1773851850.084624:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.084625:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851850.084626:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.084626:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851850.084627:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851850.084628:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:17.0:1773851850.084629:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e35080
00000400:00000200:17.0:1773851850.084630:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 185464
00000800:00000200:17.0:1773851850.084632:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851850.084634:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851850.084635:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000100:00000001:17.0:1773851850.084635:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851850.084636:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851850.084637:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f7101259.
00000100:00000040:17.0:1773851850.084638:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f7101259 x1859316187615360 msgsize 224
00000100:00100000:17.0:1773851850.084639:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:17.0:1773851850.084640:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:18.0:1773851850.084641:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851850.084641:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
02000000:00000001:18.0:1773851850.084642:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851850.084642:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851850.084642:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851850.084643:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851850.084644:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851850.084644:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187615360
00000020:00000001:18.0:1773851850.084645:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851850.084645:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:18.0:1773851850.084646:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851850.084647:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:18.0:1773851850.084648:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:18.0:1773851850.084648:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:18.0:1773851850.084649:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851850.084650:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851850.084651:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000104bdc31.
00000020:00000010:18.0:1773851850.084652:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851850.084652:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f73ed6a1.
00000100:00000001:18.0:1773851850.084653:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851850.084654:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851850.084654:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851850.084655:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851850.084656:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851850.084656:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.084657:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851850.084658:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851850.084659:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851850.084659:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851850.084659:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851850.084660:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156244
00000100:00000001:19.0:1773851850.084661:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851850.084661:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851850.084661:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:18.0:1773851850.084661:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637077795933568 : -106995913618048 : ffff9eb012938d80)
00000100:00000040:18.0:1773851850.084662:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f7101259 x1859316187615360/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:102/0 lens 224/0 e 0 to 0 dl 1773852217 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:18.0:1773851850.084665:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851850.084666:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851850.084666:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7101259 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39683:x1859316187615360:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:18.0:1773851850.084668:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187615360
00000020:00000001:18.0:1773851850.084668:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851850.084669:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851850.084670:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.084670:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851850.084671:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851850.084672:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851850.084672:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187615360, found 0 last_xid 1859316186815935
00000020:00000001:18.0:1773851850.084673:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851850.084674:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851850.084675:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851850.084675:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.084676:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851850.084676:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851850.084677:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851850.084679:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef791807.
02000000:00000001:18.0:1773851850.084679:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.084680:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.084680:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851850.084681:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187615360
00010000:00000001:18.0:1773851850.084682:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851850.084682:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f7101259 x1859316187615360/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:18.0:1773851850.084685:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851850.084685:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851850.084686:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=83 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851850.084687:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851850.084688:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:18.0:1773851850.084688:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:18.0:1773851850.084689:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851850.084690:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.084690:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851850.084691:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:18.0:1773851850.084691:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035c154b5.
00000100:00000200:18.0:1773851850.084692:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187615360, offset 224
00000400:00000200:18.0:1773851850.084693:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:18.0:1773851850.084694:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:18.0:1773851850.084695:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:18.0:1773851850.084696:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:18.0:1773851850.084697:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:18.0:1773851850.084698:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:18.0:1773851850.084699:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768447:8768447:1024:4294967295] 20881@kfi7 LPNI seq info [16890550:16890550:16:4294967295]
00000400:00000200:18.0:1773851850.084701:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:18.0:1773851850.084702:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:18.0:1773851850.084703:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851850.084705:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:18.0:1773851850.084706:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851850.084707:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851850.084710:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851850.084712:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Using peer 20881@kfi7(0x10000000000027f)
00000800:00000200:18.0:1773851850.084715:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000022b02854: Posted send of 324 bytes to peer 0x10000000000027f: rc=0
00000800:00000200:18.0:1773851850.084716:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851850.084721:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851850.084722:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:18.0:1773851850.084723:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851850.084723:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.084724:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851850.084724:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f7101259 x1859316187615360/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000800:00000200:17.0:1773851850.084729:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851850.084731:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:18.0:1773851850.084732:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7101259 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39683:x1859316187615360:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 65us (93us total) trans 0 rc 0/0
00000400:00000200:17.0:1773851850.084732:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000400:00000200:17.0:1773851850.084733:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035c154b5
00000400:00000010:17.0:1773851850.084733:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035c154b5.
00000100:00100000:18.0:1773851850.084734:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156244
00000100:00000040:18.0:1773851850.084734:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000100:00000001:17.0:1773851850.084734:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851850.084734:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:18.0:1773851850.084735:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851850.084735:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000100:00000001:18.0:1773851850.084736:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851850.084736:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851850.084737:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f73ed6a1.
00000800:00000200:17.0:1773851850.084737:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Transaction freed
00000020:00000010:18.0:1773851850.084738:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000104bdc31.
00000020:00000040:18.0:1773851850.084738:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:18.0:1773851850.084739:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851850.138368:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851850.138368:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851850.138369:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851850.138371:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851850.138373:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.138375:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20609@kfi7 : PUT - for me
00000400:00000200:21.0:1773851850.138376:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.138376:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 1
00000400:00000200:21.0:1773851850.138377:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.138378:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000400:00000200:21.0:1773851850.138379:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 3
00000400:00000200:21.0:1773851850.138379:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:21.0:1773851850.138380:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20544@kfi7 of length 224 into portal 12 MB=0x69b095c15d940
00000400:00000200:21.0:1773851850.138381:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20544@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 20672
00000800:00000200:21.0:1773851850.138383:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851850.138384:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851850.138385:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20609@kfi7: PUT: OK
00000100:00000001:21.0:1773851850.138386:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851850.138386:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851850.138387:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa2ee19d.
00000100:00000040:21.0:1773851850.138387:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000fa2ee19d x1859314362210624 msgsize 224
00000100:00100000:21.0:1773851850.138389:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20544@kfi7 (source: 12345-20609@kfi7)
00000100:00000001:21.0:1773851850.138390:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851850.138390:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000100:00000001:23.0:1773851850.138391:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851850.138392:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851850.138393:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851850.138393:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851850.138394:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851850.138394:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851850.138395:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314362210624
00000020:00000001:23.0:1773851850.138396:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851850.138396:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913bf
00000020:00000001:23.0:1773851850.138397:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851850.138400:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028b73cab refcount=6
00000020:00000001:23.0:1773851850.138400:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169308160 : -107127540243456 : ffff9e916d04a400)
00000020:00000001:23.0:1773851850.138401:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169308160 : -107127540243456 : ffff9e916d04a400)
00000100:00000001:23.0:1773851850.138402:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851850.138403:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851850.138404:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000054a79f9a.
00000020:00000010:23.0:1773851850.138405:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851850.138405:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851850.138406:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851850.138407:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851850.138407:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851850.138408:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851850.138408:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851850.138409:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.138410:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851850.138411:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851850.138411:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851850.138411:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851850.138412:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851850.138413:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20544@kfi7, seq: 1997913
00000100:00000040:23.0:1773851850.138413:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000028b73cab : new rpc_count 1
00000100:00000001:22.0:1773851850.138413:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.138414:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117334784 : -106995592216832 : ffff9eb025bbbf00)
00000100:00000001:22.0:1773851850.138414:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.138415:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fa2ee19d x1859314362210624/t0(0) o400->e3016a31-a365-4044-b2f6-16bab5868c30@20544@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1780-0'
00000100:00000001:23.0:1773851850.138418:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851850.138418:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851850.138420:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa2ee19d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e3016a31-a365-4044-b2f6-16bab5868c30+6:39885:x1859314362210624:12345-20544@kfi7:400:default-tuolumne1780-0
00000100:00000200:23.0:1773851850.138423:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314362210624
00000020:00000001:23.0:1773851850.138424:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851850.138424:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851850.138425:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.138426:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851850.138426:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851850.138427:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851850.138428:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314362210624, found 0 last_xid 1859314362210623
00000020:00000001:23.0:1773851850.138428:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851850.138429:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851850.138430:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851850.138430:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.138431:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851850.138431:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851850.138432:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851850.138432:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000edb5bd18.
02000000:00000001:23.0:1773851850.138433:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.138434:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.138434:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851850.138435:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044156668, transno 0, xid 1859314362210624
00010000:00000001:23.0:1773851850.138436:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851850.138437:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fa2ee19d x1859314362210624/t0(0) o400->e3016a31-a365-4044-b2f6-16bab5868c30@20544@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1780-0'
00010000:00000001:23.0:1773851850.138439:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851850.138440:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851850.138440:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=83 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851850.138442:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851850.138442:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d02b961 refcount 5 to 20544@kfi7
00000100:00000001:23.0:1773851850.138443:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923993437888 : -107149716113728 : ffff9e8c433bb6c0)
02000000:00000001:23.0:1773851850.138444:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851850.138444:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.138445:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851850.138446:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20609@kfi7
00000400:00000010:23.0:1773851850.138446:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a34f2baa.
00000100:00000200:23.0:1773851850.138448:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314362210624, offset 224
00000400:00000200:23.0:1773851850.138449:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20609@kfi7
00000400:00000200:23.0:1773851850.138450:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.138450:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 1
00000400:00000200:23.0:1773851850.138451:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000400:00000200:23.0:1773851850.138452:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 3
00000400:00000200:23.0:1773851850.138454:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20609@kfi7 local destination
00000400:00000200:23.0:1773851850.138455:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768448:8768448:1024:4294967295] 20609@kfi7 LPNI seq info [1323079:1323079:16:4294967295]
00000400:00000200:23.0:1773851850.138456:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000400:00000200:23.0:1773851850.138457:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.138459:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20609@kfi7(20609@kfi7:20609@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851850.138460:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 3
00000800:00000200:23.0:1773851850.138461:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851850.138462:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851850.138465:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851850.138467:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f Using peer 20609@kfi7(0x10000000000048f)
00000800:00000200:23.0:1773851850.138470:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x10000000000048f: rc=0
00000800:00000200:23.0:1773851850.138471:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851850.138473:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.138473:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d02b961 refcount 4 to 20544@kfi7
00010000:00000001:23.0:1773851850.138474:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851850.138475:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.138475:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851850.138476:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa2ee19d x1859314362210624/t0(0) o400->e3016a31-a365-4044-b2f6-16bab5868c30@20544@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1780-0'
00000100:00100000:23.0:1773851850.138479:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa2ee19d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e3016a31-a365-4044-b2f6-16bab5868c30+6:39885:x1859314362210624:12345-20544@kfi7:400:default-tuolumne1780-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851850.138481:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851850.138482:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20544@kfi7, seq: 1997913
00000400:00000200:21.0:1773851850.138482:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:23.0:1773851850.138483:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028b73cab : new rpc_count 0
00000100:00000001:23.0:1773851850.138483:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851850.138483:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20609@kfi7: PUT: OK
00000100:00000001:23.0:1773851850.138484:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851850.138484:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851850.138484:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a34f2baa
00000400:00000010:21.0:1773851850.138484:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a34f2baa.
00000020:00000010:23.0:1773851850.138485:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000100:00000001:21.0:1773851850.138485:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851850.138485:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851850.138486:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000054a79f9a.
00000400:00000200:21.0:1773851850.138486:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000020:00000040:23.0:1773851850.138487:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000028b73cab : new refcount 5
00000100:00000001:23.0:1773851850.138487:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851850.138487:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f Transaction freed
00000800:00000200:21.0:1773851850.157060:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851850.157061:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851850.157063:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851850.157066:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851850.157069:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.157070:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:21.0:1773851850.157072:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.157073:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:21.0:1773851850.157074:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.157075:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:21.0:1773851850.157076:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:21.0:1773851850.157078:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.157079:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 224 into portal 12 MB=0x699e12d522a00
00000400:00000200:21.0:1773851850.157080:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2055@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 20896
00000800:00000200:21.0:1773851850.157083:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851850.157085:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851850.157087:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:21.0:1773851850.157088:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851850.157088:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851850.157089:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002331d564.
00000100:00000040:21.0:1773851850.157090:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002331d564 x1858042267314688 msgsize 224
00000100:00100000:21.0:1773851850.157092:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-2055@kfi7 (source: 12345-2055@kfi7)
00000100:00000001:21.0:1773851850.157094:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851850.157095:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:23.0:1773851850.157096:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851850.157097:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851850.157097:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851850.157098:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851850.157098:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851850.157099:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851850.157100:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042267314688
00000020:00000001:23.0:1773851850.157101:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851850.157102:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acdf562
00000020:00000001:23.0:1773851850.157102:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851850.157107:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bc769ae0 refcount=5
00000020:00000001:23.0:1773851850.157108:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636958049081344 : -107115660470272 : ffff9e94311b9800)
00000020:00000001:23.0:1773851850.157109:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636958049081344 : -107115660470272 : ffff9e94311b9800)
00000100:00000001:23.0:1773851850.157111:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851850.157112:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851850.157113:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b547314f.
00000020:00000010:23.0:1773851850.157114:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851850.157115:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851850.157116:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851850.157117:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851850.157117:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851850.157118:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851850.157119:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851850.157120:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.157121:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851850.157123:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851850.157124:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851850.157125:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851850.157126:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851850.157126:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2055@kfi7, seq: 1997914
00000100:00000001:23.0:1773851850.157127:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851850.157127:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bc769ae0 : new rpc_count 1
00000100:00000001:23.0:1773851850.157128:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.157128:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117318656 : -106995592232960 : ffff9eb025bb8000)
00000100:00000040:22.0:1773851850.157130:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002331d564 x1858042267314688/t0(0) o400->lustre5-MDT0001-lwp-OST0003_UUID@2055@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba104-0'
00000100:00000001:22.0:1773851850.157135:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851850.157136:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851850.157137:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002331d564 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0003_UUID+5:272653:x1858042267314688:12345-2055@kfi7:400:default-yuba104-0
00000100:00000200:22.0:1773851850.157140:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042267314688
00000020:00000001:22.0:1773851850.157141:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851850.157142:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851850.157143:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.157144:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851850.157145:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851850.157146:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:22.0:1773851850.157147:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851850.157148:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851850.157149:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851850.157150:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.157151:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851850.157152:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851850.157153:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851850.157154:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006de32f1f.
02000000:00000001:22.0:1773851850.157156:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.157156:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.157157:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851850.157158:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858042267314688
00010000:00000001:22.0:1773851850.157160:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851850.157161:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002331d564 x1858042267314688/t0(0) o400->lustre5-MDT0001-lwp-OST0003_UUID@2055@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba104-0'
00010000:00000001:22.0:1773851850.157165:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851850.157166:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851850.157167:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=83 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851850.157169:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851850.157170:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000078e2608b refcount 7 to 2055@kfi7
00000100:00000001:22.0:1773851850.157171:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999949312 : -107156709602304 : ffff9e8aa2638c00)
02000000:00000001:22.0:1773851850.157173:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851850.157173:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.157174:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851850.157176:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000010:22.0:1773851850.157177:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b1c91353.
00000100:00000200:22.0:1773851850.157178:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042267314688, offset 224
00000400:00000200:22.0:1773851850.157180:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:22.0:1773851850.157182:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851850.157183:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:22.0:1773851850.157185:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:22.0:1773851850.157187:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:22.0:1773851850.157189:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2055@kfi7 local destination
00000400:00000200:22.0:1773851850.157191:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768449:8768449:1024:4294967295] 2055@kfi7 LPNI seq info [5404666:5404666:16:4294967295]
00000400:00000200:22.0:1773851850.157193:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:22.0:1773851850.157194:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851850.157197:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851850.157200:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:22.0:1773851850.157203:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851850.157205:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851850.157208:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851850.157212:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000800:00000200:22.0:1773851850.157217:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000068d775d8: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000800:00000200:22.0:1773851850.157219:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851850.157223:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851850.157224:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000078e2608b refcount 6 to 2055@kfi7
00010000:00000001:22.0:1773851850.157226:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851850.157226:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.157228:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851850.157229:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002331d564 x1858042267314688/t0(0) o400->lustre5-MDT0001-lwp-OST0003_UUID@2055@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba104-0'
00000800:00000200:21.0:1773851850.157230:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851850.157235:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002331d564 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0003_UUID+5:272653:x1858042267314688:12345-2055@kfi7:400:default-yuba104-0 Request processed in 98us (143us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851850.157237:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:22.0:1773851850.157239:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2055@kfi7, seq: 1997914
00000400:00000200:21.0:1773851850.157239:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000040:22.0:1773851850.157240:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bc769ae0 : new rpc_count 0
00000400:00000200:21.0:1773851850.157240:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b1c91353
00000400:00000010:21.0:1773851850.157241:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b1c91353.
00000100:00000001:22.0:1773851850.157242:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851850.157242:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851850.157243:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851850.157243:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851850.157243:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851850.157244:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000020:00000010:22.0:1773851850.157245:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:22.0:1773851850.157246:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b547314f.
00000800:00000200:21.0:1773851850.157246:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 Transaction freed
00000020:00000040:22.0:1773851850.157248:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000bc769ae0 : new refcount 4
00000100:00000001:22.0:1773851850.157249:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851850.159776:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851850.159777:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851850.159779:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851850.159783:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851850.159786:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.159789:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8800@kfi7 : PUT - for me
00000400:00000200:1.0:1773851850.159791:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.159792:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 1
00000400:00000200:1.0:1773851850.159794:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.159795:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000400:00000200:1.0:1773851850.159797:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 3
00000400:00000200:1.0:1773851850.159798:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8865@kfi7 to cpt 7
00000400:00000200:1.0:1773851850.159800:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8865@kfi7 of length 224 into portal 12 MB=0x69b1907162140
00000400:00000200:1.0:1773851850.159802:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8865@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 5768
00000800:00000200:1.0:1773851850.159805:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851850.159808:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851850.159810:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8800@kfi7: PUT: OK
00000100:00000001:1.0:1773851850.159812:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851850.159812:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851850.159814:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000153e4c8f.
00000100:00000040:1.0:1773851850.159815:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000153e4c8f x1859381655642432 msgsize 224
00000100:00100000:1.0:1773851850.159817:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8865@kfi7 (source: 12345-8800@kfi7)
00000100:00000001:1.0:1773851850.159820:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851850.159821:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000800:00000200:1.0:1773851850.159824:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851850.159828:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851850.159829:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851850.159830:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851850.159831:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851850.159832:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851850.159833:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381655642432
00000020:00000001:1.0:1773851850.159834:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851850.159835:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07966881ad6
00000020:00000001:1.0:1773851850.159836:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851850.159839:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002e697baa refcount=10
00000020:00000001:1.0:1773851850.159840:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000020:00000001:1.0:1773851850.159842:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000100:00000001:1.0:1773851850.159844:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851850.159845:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851850.159846:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851850.159847:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851850.159849:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851850.159850:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851850.159850:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851850.159851:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851850.159853:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851850.159854:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851850.159854:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.159856:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851850.159858:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851850.159858:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851850.159859:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851850.159859:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851850.159860:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8865@kfi7, seq: 1997470
00000100:00000040:1.0:1773851850.159861:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002e697baa : new rpc_count 2
00000100:00000001:2.0:1773851850.159862:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851850.159863:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.159863:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085911382400 : -106987798169216 : ffff9eb1f64b7980)
00000100:00000040:1.0:1773851850.159865:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000153e4c8f x1859381655642432/t0(0) o400->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:490/0 lens 224/0 e 0 to 0 dl 1773852605 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1040-0'
00000100:00000001:1.0:1773851850.159869:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851850.159870:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851850.159871:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000153e4c8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f4813154-7699-4896-9522-14f850a6fb2e+10:40023:x1859381655642432:12345-8865@kfi7:400:default-tuolumne1040-0
00000100:00000200:1.0:1773851850.159874:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381655642432
00000020:00000001:1.0:1773851850.159875:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851850.159876:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851850.159877:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.159878:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851850.159878:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851850.159880:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851850.159881:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381655642432, found 0 last_xid 1859381655553663
00000020:00000001:1.0:1773851850.159882:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851850.159884:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851850.159884:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851850.159885:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.159886:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851850.159887:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851850.159888:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851850.159889:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000028c8ad4e.
02000000:00000001:1.0:1773851850.159890:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.159891:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.159892:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851850.159893:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183034610706, transno 0, xid 1859381655642432
00010000:00000001:1.0:1773851850.159895:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851850.159896:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000153e4c8f x1859381655642432/t0(0) o400->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:490/0 lens 224/224 e 0 to 0 dl 1773852605 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1040-0'
00010000:00000001:1.0:1773851850.159900:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851850.159901:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851850.159902:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=83 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851850.159904:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851850.159905:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053217cde refcount 3 to 8865@kfi7
00000100:00000001:1.0:1773851850.159906:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212384 : -107155106339232 : ffff9e8b01f36660)
02000000:00000001:1.0:1773851850.159908:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851850.159908:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.159909:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851850.159911:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8800@kfi7
00000400:00000010:1.0:1773851850.159912:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a124e9e1.
00000100:00000200:1.0:1773851850.159913:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859381655642432, offset 224
00000400:00000200:1.0:1773851850.159915:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8800@kfi7
00000400:00000200:1.0:1773851850.159916:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.159917:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 1
00000400:00000200:1.0:1773851850.159919:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000400:00000200:1.0:1773851850.159921:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 3
00000400:00000200:1.0:1773851850.159923:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8800@kfi7 local destination
00000400:00000200:1.0:1773851850.159925:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768450:8768450:1024:4294967295] 8800@kfi7 LPNI seq info [1300262:1300262:16:4294967295]
00000400:00000200:1.0:1773851850.159928:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000400:00000200:1.0:1773851850.159929:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.159933:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8800@kfi7(8800@kfi7:8800@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851850.159934:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 3
00000800:00000200:1.0:1773851850.159936:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851850.159938:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851850.159942:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851850.159945:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000028b Using peer 8800@kfi7(0x10000000000028b)
00000800:00000200:1.0:1773851850.159950:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x10000000000028b: rc=0
00000800:00000200:1.0:1773851850.159952:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000028b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851850.159955:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851850.159956:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053217cde refcount 2 to 8865@kfi7
00010000:00000001:1.0:1773851850.159958:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851850.159958:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.159959:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851850.159961:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000153e4c8f x1859381655642432/t0(0) o400->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:490/0 lens 224/224 e 0 to 0 dl 1773852605 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1040-0'
00000100:00100000:1.0:1773851850.159966:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000153e4c8f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f4813154-7699-4896-9522-14f850a6fb2e+10:40023:x1859381655642432:12345-8865@kfi7:400:default-tuolumne1040-0 Request processed in 95us (149us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851850.159969:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000028b TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851850.159970:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8865@kfi7, seq: 1997470
00000400:00000200:2.0:1773851850.159971:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:1.0:1773851850.159971:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002e697baa : new rpc_count 1
00000100:00000001:1.0:1773851850.159972:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851850.159973:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8800@kfi7: PUT: OK
00000100:00000001:1.0:1773851850.159973:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851850.159974:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a124e9e1
00000020:00000010:1.0:1773851850.159974:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000010:2.0:1773851850.159975:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a124e9e1.
00000020:00000010:1.0:1773851850.159975:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000100:00000001:2.0:1773851850.159976:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851850.159976:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000100:00000001:2.0:1773851850.159977:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851850.159978:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000020:00000040:1.0:1773851850.159978:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000002e697baa : new refcount 9
00000100:00000001:1.0:1773851850.159979:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851850.159981:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000028b Transaction freed
00000800:00000200:25.0:1773851850.175927:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851850.175928:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851850.175929:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851850.175931:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851850.175933:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8849@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.175935:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8849@kfi7 : PUT - for me
00000400:00000200:25.0:1773851850.175936:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8849@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.175937:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c06b7acc nid 8849@kfi7 refs 1
00000400:00000200:25.0:1773851850.175938:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8849@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.175938:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c06b7acc nid 8849@kfi7 refs 2
00000400:00000200:25.0:1773851850.175939:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c06b7acc nid 8849@kfi7 refs 3
00000400:00000200:25.0:1773851850.175940:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8784@kfi7 to cpt 7
00000400:00000200:25.0:1773851850.175941:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8784@kfi7 of length 224 into portal 12 MB=0x69b09daddd580
00000400:00000200:25.0:1773851850.175942:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8784@kfi7 of length 224/224 into md 0x16159c6179 [64] + 177664
00000800:00000200:25.0:1773851850.175944:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851850.175945:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851850.175947:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8849@kfi7: PUT: OK
00000100:00000001:25.0:1773851850.175948:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851850.175948:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851850.175949:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c856867b.
00000100:00000040:25.0:1773851850.175950:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c856867b x1859316489246080 msgsize 224
00000100:00100000:25.0:1773851850.175952:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8784@kfi7 (source: 12345-8849@kfi7)
00000100:00000001:25.0:1773851850.175953:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851850.175954:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c06b7acc nid 8849@kfi7 refs 2
00000800:00000200:25.0:1773851850.175956:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851850.175957:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851850.175958:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851850.175959:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851850.175960:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851850.175961:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851850.175962:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316489246080
00000020:00000001:26.0:1773851850.175963:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851850.175964:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913a3
00000020:00000001:26.0:1773851850.175965:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851850.175966:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a4f19c69 refcount=9
00000020:00000001:26.0:1773851850.175967:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169306112 : -107127540245504 : ffff9e916d049c00)
00000020:00000001:26.0:1773851850.175970:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169306112 : -107127540245504 : ffff9e916d049c00)
00000100:00000001:26.0:1773851850.175971:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851850.175973:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851850.175974:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851850.175975:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851850.175977:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851850.175978:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851850.175978:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851850.175979:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851850.175981:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851850.175982:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851850.175982:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851850.175984:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851850.175986:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851850.175987:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851850.175987:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851850.175987:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851850.175989:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8784@kfi7, seq: 2025036
00000100:00000040:26.0:1773851850.175990:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a4f19c69 : new rpc_count 1
00000100:00000001:24.0:1773851850.175990:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851850.175991:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128409133440 : -106945300418176 : ffff9ebbdb5bb180)
00000100:00000001:24.0:1773851850.175991:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851850.175993:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c856867b x1859316489246080/t0(0) o400->1a7a255e-4016-4cc8-81f9-d7275f92b41c@8784@kfi7:36/0 lens 224/0 e 0 to 0 dl 1773852151 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1042-0'
00000100:00000001:26.0:1773851850.175998:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851850.175998:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851850.176000:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c856867b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1a7a255e-4016-4cc8-81f9-d7275f92b41c+9:39892:x1859316489246080:12345-8784@kfi7:400:default-tuolumne1042-0
00000100:00000200:26.0:1773851850.176002:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316489246080
00000020:00000001:26.0:1773851850.176003:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851850.176004:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851850.176005:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851850.176006:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851850.176007:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851850.176008:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851850.176009:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316489246080, found 0 last_xid 1859316489246079
00000020:00000001:26.0:1773851850.176010:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851850.176013:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851850.176014:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851850.176014:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851850.176016:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851850.176017:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851850.176017:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851850.176018:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000034faa970.
02000000:00000001:26.0:1773851850.176019:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851850.176020:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851850.176022:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851850.176023:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182991537005, transno 0, xid 1859316489246080
00010000:00000001:26.0:1773851850.176024:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851850.176025:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c856867b x1859316489246080/t0(0) o400->1a7a255e-4016-4cc8-81f9-d7275f92b41c@8784@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1042-0'
00010000:00000001:26.0:1773851850.176029:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851850.176030:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851850.176031:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=83 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851850.176033:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851850.176034:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b36472f refcount 5 to 8784@kfi7
00000100:00000001:26.0:1773851850.176036:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271392 : -107152618280224 : ffff9e8b96402ae0)
02000000:00000001:26.0:1773851850.176037:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851850.176038:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851850.176039:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851850.176040:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8849@kfi7
00000400:00000010:26.0:1773851850.176041:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b92c768b.
00000100:00000200:26.0:1773851850.176043:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316489246080, offset 224
00000400:00000200:26.0:1773851850.176045:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8849@kfi7
00000400:00000200:26.0:1773851850.176046:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8849@kfi7 to cpt 6
00000400:00000200:26.0:1773851850.176048:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c06b7acc nid 8849@kfi7 refs 1
00000400:00000200:26.0:1773851850.176049:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c06b7acc nid 8849@kfi7 refs 2
00000400:00000200:26.0:1773851850.176051:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c06b7acc nid 8849@kfi7 refs 3
00000400:00000200:26.0:1773851850.176053:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8849@kfi7 local destination
00000400:00000200:26.0:1773851850.176055:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768451:8768451:1024:4294967295] 8849@kfi7 LPNI seq info [721292:721292:16:4294967295]
00000400:00000200:26.0:1773851850.176057:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c06b7acc nid 8849@kfi7 refs 2
00000400:00000200:26.0:1773851850.176060:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8849@kfi7 to cpt 6
00000400:00000200:26.0:1773851850.176063:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8849@kfi7(8849@kfi7:8849@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851850.176065:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c06b7acc nid 8849@kfi7 refs 3
00000800:00000200:26.0:1773851850.176067:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851850.176069:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851850.176073:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851850.176077:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd9e Using peer 8849@kfi7(0xd9e)
00000800:00000200:26.0:1773851850.176081:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 324 bytes to peer 0xd9e: rc=0
00000800:00000200:26.0:1773851850.176084:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd9e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851850.176087:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851850.176089:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b36472f refcount 4 to 8784@kfi7
00010000:00000001:26.0:1773851850.176090:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851850.176091:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851850.176092:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851850.176093:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c856867b x1859316489246080/t0(0) o400->1a7a255e-4016-4cc8-81f9-d7275f92b41c@8784@kfi7:36/0 lens 224/224 e 0 to 0 dl 1773852151 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1042-0'
00000800:00000200:25.0:1773851850.176097:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd9e TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851850.176098:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c856867b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1a7a255e-4016-4cc8-81f9-d7275f92b41c+9:39892:x1859316489246080:12345-8784@kfi7:400:default-tuolumne1042-0 Request processed in 99us (147us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851850.176098:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851850.176099:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8849@kfi7: PUT: OK
00000400:00000200:25.0:1773851850.176100:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b92c768b
00000400:00000010:25.0:1773851850.176101:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b92c768b.
00000100:00000001:25.0:1773851850.176101:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:26.0:1773851850.176102:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8784@kfi7, seq: 2025036
00000100:00000001:25.0:1773851850.176102:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:26.0:1773851850.176103:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a4f19c69 : new rpc_count 0
00000400:00000200:25.0:1773851850.176103:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c06b7acc nid 8849@kfi7 refs 2
00000800:00000200:25.0:1773851850.176104:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8849@kfi7(00000000023aa6cf):0x0 lsk 3487 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd9e Transaction freed
00000100:00000001:26.0:1773851850.176105:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851850.176105:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851850.176106:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851850.176108:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851850.176109:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000020:00000040:26.0:1773851850.176111:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000a4f19c69 : new refcount 8
00000100:00000001:26.0:1773851850.176112:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851850.319700:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851850.319702:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851850.319704:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851850.319707:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851850.319710:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:3.0:1773851850.319711:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9779@kfi7 : PUT - for me
00000400:00000200:3.0:1773851850.319713:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:3.0:1773851850.319714:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 1
00000400:00000200:3.0:1773851850.319715:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:3.0:1773851850.319715:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000400:00000200:3.0:1773851850.319716:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 3
00000400:00000200:3.0:1773851850.319717:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9971@kfi7 to cpt 2
00000400:00000200:3.0:1773851850.319718:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9971@kfi7 of length 224 into portal 12 MB=0x699e14b1eb140
00000400:00000200:3.0:1773851850.319720:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9971@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 5992
00000800:00000200:3.0:1773851850.319723:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851850.319729:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851850.319730:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9779@kfi7: PUT: OK
00000100:00000001:3.0:1773851850.319731:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851850.319732:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851850.319733:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000534534ff.
00000100:00000040:3.0:1773851850.319734:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000534534ff x1858042767257920 msgsize 224
00000100:00100000:3.0:1773851850.319736:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-9971@kfi7 (source: 12345-9779@kfi7)
00000100:00000001:3.0:1773851850.319737:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851850.319738:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000100:00000001:1.0:1773851850.319739:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851850.319739:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851850.319740:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851850.319740:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851850.319741:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851850.319741:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851850.319742:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042767257920
00000020:00000001:1.0:1773851850.319743:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851850.319744:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac915b0
00000020:00000001:1.0:1773851850.319744:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851850.319746:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005830d2c8 refcount=8
00000020:00000001:1.0:1773851850.319746:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241012224 : -107152468539392 : ffff9e8b9f2d0800)
00000020:00000001:1.0:1773851850.319747:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241012224 : -107152468539392 : ffff9e8b9f2d0800)
00000100:00000001:1.0:1773851850.319749:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851850.319749:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851850.319750:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851850.319751:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851850.319752:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851850.319753:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851850.319754:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851850.319754:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851850.319755:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851850.319756:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851850.319756:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.319757:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851850.319759:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851850.319759:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851850.319759:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851850.319760:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851850.319761:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9971@kfi7, seq: 1997471
00000100:00000001:2.0:1773851850.319762:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851850.319762:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005830d2c8 : new rpc_count 3
00000100:00000001:2.0:1773851850.319763:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.319763:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288709376 : -106964420842240 : ffff9eb767b12d00)
00000100:00000040:1.0:1773851850.319764:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000534534ff x1858042767257920/t0(0) o400->f0ebef98-f473-4914-88d8-8c3cff8eea0a@9971@kfi7:490/0 lens 224/0 e 0 to 0 dl 1773852605 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1097-0'
00000100:00000001:1.0:1773851850.319767:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851850.319768:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851850.319769:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000534534ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f0ebef98-f473-4914-88d8-8c3cff8eea0a+8:39838:x1858042767257920:12345-9971@kfi7:400:default-tuolumne1097-0
00000100:00000200:1.0:1773851850.319771:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042767257920
00000020:00000001:1.0:1773851850.319771:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851850.319772:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851850.319773:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.319774:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851850.319774:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851850.319775:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851850.319776:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042767257920, found 0 last_xid 1858042764542143
00000020:00000001:1.0:1773851850.319777:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851850.319778:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851850.319778:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851850.319779:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.319779:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851850.319780:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851850.319781:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851850.319781:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000245bd798.
02000000:00000001:1.0:1773851850.319782:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.319783:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.319784:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851850.319784:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183235806336, transno 0, xid 1858042767257920
00010000:00000001:1.0:1773851850.319785:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851850.319786:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000534534ff x1858042767257920/t0(0) o400->f0ebef98-f473-4914-88d8-8c3cff8eea0a@9971@kfi7:490/0 lens 224/224 e 0 to 0 dl 1773852605 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1097-0'
00010000:00000001:1.0:1773851850.319789:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851850.319790:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851850.319791:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=83 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851850.319792:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851850.319792:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005a910016 refcount 3 to 9971@kfi7
00000100:00000001:1.0:1773851850.319793:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051136384 : -107146658415232 : ffff9e8cf97c7d80)
02000000:00000001:1.0:1773851850.319794:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851850.319795:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.319795:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851850.319797:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9779@kfi7
00000400:00000010:1.0:1773851850.319797:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a124e9e1.
00000100:00000200:1.0:1773851850.319798:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042767257920, offset 224
00000400:00000200:1.0:1773851850.319799:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9779@kfi7
00000400:00000200:1.0:1773851850.319800:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.319801:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 1
00000400:00000200:1.0:1773851850.319801:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000400:00000200:1.0:1773851850.319803:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 3
00000400:00000200:1.0:1773851850.319804:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9779@kfi7 local destination
00000400:00000200:1.0:1773851850.319805:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768452:8768452:1024:4294967295] 9779@kfi7 LPNI seq info [27091916:27091916:16:4294967295]
00000400:00000200:1.0:1773851850.319807:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000400:00000200:1.0:1773851850.319807:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.319809:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9779@kfi7(9779@kfi7:9779@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851850.319810:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 3
00000800:00000200:1.0:1773851850.319812:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851850.319813:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851850.319815:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851850.319817:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16a Using peer 9779@kfi7(0x16a)
00000800:00000200:1.0:1773851850.319819:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x16a: rc=0
00000800:00000200:1.0:1773851850.319821:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851850.319823:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851850.319823:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005a910016 refcount 2 to 9971@kfi7
00010000:00000001:1.0:1773851850.319824:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851850.319825:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.319825:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851850.319826:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000534534ff x1858042767257920/t0(0) o400->f0ebef98-f473-4914-88d8-8c3cff8eea0a@9971@kfi7:490/0 lens 224/224 e 0 to 0 dl 1773852605 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1097-0'
00000100:00100000:1.0:1773851850.319832:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000534534ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f0ebef98-f473-4914-88d8-8c3cff8eea0a+8:39838:x1858042767257920:12345-9971@kfi7:400:default-tuolumne1097-0 Request processed in 63us (97us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851850.319834:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16a TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851850.319834:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9971@kfi7, seq: 1997471
00000100:00000040:1.0:1773851850.319835:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005830d2c8 : new rpc_count 2
00000100:00000001:1.0:1773851850.319835:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851850.319836:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851850.319836:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9779@kfi7: PUT: OK
00000100:00000001:1.0:1773851850.319836:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851850.319836:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000200:2.0:1773851850.319837:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a124e9e1
00000020:00000010:1.0:1773851850.319837:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000010:2.0:1773851850.319838:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a124e9e1.
00000100:00000001:2.0:1773851850.319838:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851850.319838:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000020:00000040:1.0:1773851850.319838:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005830d2c8 : new refcount 7
00000100:00000001:2.0:1773851850.319839:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:1.0:1773851850.319839:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851850.319840:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000800:00000200:2.0:1773851850.319841:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9779@kfi7(000000009c075bd0):0x0 lsk 363 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16a Transaction freed
00000800:00000200:17.0:1773851850.326351:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851850.326352:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851850.326353:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851850.326355:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851850.326357:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.326359:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26528@kfi7 : PUT - for me
00000400:00000200:17.0:1773851850.326360:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.326361:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 1
00000400:00000200:17.0:1773851850.326362:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.326362:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000400:00000200:17.0:1773851850.326363:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 3
00000400:00000200:17.0:1773851850.326364:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.326365:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26528@kfi7 of length 224 into portal 12 MB=0x69a9d49db8900
00000400:00000200:17.0:1773851850.326367:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26528@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 185688
00000800:00000200:17.0:1773851850.326368:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851850.326370:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851850.326371:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26528@kfi7: PUT: OK
00000100:00000001:17.0:1773851850.326372:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851850.326372:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851850.326373:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001ecc7e94.
00000100:00000040:17.0:1773851850.326373:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001ecc7e94 x1858850199931136 msgsize 224
00000100:00100000:17.0:1773851850.326375:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26528@kfi7 (source: 12345-26528@kfi7)
00000100:00000001:17.0:1773851850.326376:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851850.326376:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000100:00000001:18.0:1773851850.326377:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851850.326378:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851850.326378:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851850.326378:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851850.326379:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851850.326380:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851850.326380:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858850199931136
00000020:00000001:18.0:1773851850.326381:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851850.326382:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914b4
00000020:00000001:18.0:1773851850.326382:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851850.326384:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005ea1098b refcount=6
00000020:00000001:18.0:1773851850.326385:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240806400 : -107152468745216 : ffff9e8b9f29e400)
00000020:00000001:18.0:1773851850.326386:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240806400 : -107152468745216 : ffff9e8b9f29e400)
00000100:00000001:18.0:1773851850.326387:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851850.326388:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851850.326389:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000104bdc31.
00000020:00000010:18.0:1773851850.326390:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851850.326391:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f73ed6a1.
00000100:00000001:18.0:1773851850.326392:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851850.326392:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851850.326393:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851850.326394:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851850.326394:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851850.326394:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.326396:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851850.326397:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851850.326397:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851850.326397:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851850.326397:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851850.326399:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26528@kfi7, seq: 2156245
00000100:00000040:19.0:1773851850.326399:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005ea1098b : new rpc_count 1
00000100:00000001:18.0:1773851850.326399:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851850.326400:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637077795946240 : -106995913605376 : ffff9eb01293bf00)
00000100:00000001:18.0:1773851850.326400:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851850.326401:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001ecc7e94 x1858850199931136/t0(0) o400->1f277aad-a14c-4077-b83c-4ff3ae6d561e@26528@kfi7:40/0 lens 224/0 e 0 to 0 dl 1773852155 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2144-0'
00000100:00000001:19.0:1773851850.326404:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851850.326404:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851850.326405:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ecc7e94 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1f277aad-a14c-4077-b83c-4ff3ae6d561e+6:39688:x1858850199931136:12345-26528@kfi7:400:default-tuolumne2144-0
00000100:00000200:19.0:1773851850.326407:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858850199931136
00000020:00000001:19.0:1773851850.326407:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851850.326408:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851850.326408:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851850.326409:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851850.326410:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851850.326410:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851850.326411:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858850199931136, found 0 last_xid 1858850199931135
00000020:00000001:19.0:1773851850.326412:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851850.326412:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851850.326413:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851850.326413:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851850.326414:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851850.326415:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851850.326415:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851850.326416:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4b1e044.
02000000:00000001:19.0:1773851850.326417:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851850.326417:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851850.326419:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851850.326419:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182427040445, transno 0, xid 1858850199931136
00010000:00000001:19.0:1773851850.326420:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851850.326421:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001ecc7e94 x1858850199931136/t0(0) o400->1f277aad-a14c-4077-b83c-4ff3ae6d561e@26528@kfi7:40/0 lens 224/224 e 0 to 0 dl 1773852155 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2144-0'
00010000:00000001:19.0:1773851850.326423:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851850.326424:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851850.326424:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=83 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851850.326425:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851850.326426:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005dc5ade0 refcount 3 to 26528@kfi7
00000100:00000001:19.0:1773851850.326427:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363991648 : -107142345559968 : ffff9e8dfa8d7060)
02000000:00000001:19.0:1773851850.326427:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851850.326428:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851850.326428:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851850.326429:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26528@kfi7
00000400:00000010:19.0:1773851850.326430:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000638810d2.
00000100:00000200:19.0:1773851850.326431:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858850199931136, offset 224
00000400:00000200:19.0:1773851850.326432:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26528@kfi7
00000400:00000200:19.0:1773851850.326433:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:19.0:1773851850.326434:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 1
00000400:00000200:19.0:1773851850.326434:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000400:00000200:19.0:1773851850.326436:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 3
00000400:00000200:19.0:1773851850.326437:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26528@kfi7 local destination
00000400:00000200:19.0:1773851850.326438:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768453:8768453:1024:4294967295] 26528@kfi7 LPNI seq info [34336:34336:16:4294967295]
00000400:00000200:19.0:1773851850.326440:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000400:00000200:19.0:1773851850.326440:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:19.0:1773851850.326442:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26528@kfi7(26528@kfi7:26528@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851850.326443:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 3
00000800:00000200:19.0:1773851850.326444:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851850.326445:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851850.326448:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851850.326451:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1020 Using peer 26528@kfi7(0x1020)
00000800:00000200:19.0:1773851850.326455:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x1020: rc=0
00000800:00000200:19.0:1773851850.326456:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1020 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851850.326458:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851850.326459:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005dc5ade0 refcount 2 to 26528@kfi7
00010000:00000001:19.0:1773851850.326460:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851850.326460:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851850.326461:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851850.326462:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001ecc7e94 x1858850199931136/t0(0) o400->1f277aad-a14c-4077-b83c-4ff3ae6d561e@26528@kfi7:40/0 lens 224/224 e 0 to 0 dl 1773852155 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2144-0'
00000100:00100000:19.0:1773851850.326465:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ecc7e94 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1f277aad-a14c-4077-b83c-4ff3ae6d561e+6:39688:x1858850199931136:12345-26528@kfi7:400:default-tuolumne2144-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851850.326467:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26528@kfi7, seq: 2156245
00000100:00000040:19.0:1773851850.326468:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005ea1098b : new rpc_count 0
00000100:00000001:19.0:1773851850.326468:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851850.326468:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1020 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851850.326469:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851850.326469:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:19.0:1773851850.326470:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f73ed6a1.
00000400:00000200:17.0:1773851850.326470:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851850.326470:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26528@kfi7: PUT: OK
00000020:00000010:19.0:1773851850.326471:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000104bdc31.
00000400:00000200:17.0:1773851850.326471:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000638810d2
00000400:00000010:17.0:1773851850.326471:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000638810d2.
00000020:00000040:19.0:1773851850.326472:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000005ea1098b : new refcount 5
00000100:00000001:19.0:1773851850.326472:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851850.326472:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851850.326472:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851850.326473:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000800:00000200:17.0:1773851850.326475:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 26528@kfi7(00000000ebcd43bd):0x0 lsk 4129 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1020 Transaction freed
00000800:00000200:6.0:1773851850.396224:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.396224:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851850.396225:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851850.396225:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851850.396226:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851850.396227:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851850.396229:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851850.396229:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22833@kfi7(0000000011e627c7):0xa4b version: 2; local version 2; negotiated version: 2
00000400:00000200:6.0:1773851850.396231:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000800:00000200:5.0:1773851850.396232:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b Using peer 22833@kfi7(0x100000000000a4b)
00000400:00000200:6.0:1773851850.396233:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22833@kfi7 : PUT - for me
00000400:00000200:6.0:1773851850.396234:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.396234:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 1
00000400:00000200:6.0:1773851850.396235:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.396236:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000400:00000200:6.0:1773851850.396237:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 3
00000400:00000200:5.0:1773851850.396238:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.396239:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23024@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.396240:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23024@kfi7 of length 224 into portal 12 MB=0x69b4665285400
00000800:00000200:5.0:1773851850.396240:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046518b99: Posted send of 38 bytes to peer 0x100000000000a4b: rc=0
00000800:00000200:5.0:1773851850.396241:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851850.396242:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23024@kfi7 of length 224/224 into md 0x793926dc5 [64] + 114224
00000800:00000200:6.0:1773851850.396244:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851850.396246:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851850.396247:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22833@kfi7: PUT: OK
00000100:00000001:6.0:1773851850.396248:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851850.396248:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851850.396249:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073d0c946.
00000100:00000040:6.0:1773851850.396250:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000073d0c946 x1859576507421696 msgsize 224
00000100:00100000:6.0:1773851850.396251:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-23024@kfi7 (source: 12345-22833@kfi7)
00000100:00000001:6.0:1773851850.396253:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:5.0:1773851850.396253:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851850.396254:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000800:00000200:5.0:1773851850.396255:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b Transaction freed
00000800:00000200:6.0:1773851850.396256:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851850.396260:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851850.396260:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851850.396261:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851850.396261:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851850.396262:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851850.396263:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576507421696
00000020:00000001:5.0:1773851850.396264:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851850.396264:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc30bd679
00000020:00000001:5.0:1773851850.396265:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851850.396266:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000014ddb816 refcount=5
00000020:00000001:5.0:1773851850.396267:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072996454400 : -107000713097216 : ffff9eaef4815000)
00000020:00000001:5.0:1773851850.396268:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072996454400 : -107000713097216 : ffff9eaef4815000)
00000100:00000001:5.0:1773851850.396269:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.396269:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851850.396270:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6b8036f.
00000020:00000010:5.0:1773851850.396271:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851850.396272:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008d4880d3.
00000100:00000001:5.0:1773851850.396273:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851850.396273:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851850.396274:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.396275:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851850.396276:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851850.396276:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.396277:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851850.396279:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851850.396279:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851850.396279:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851850.396279:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851850.396280:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23024@kfi7, seq: 2001835
00000100:00000001:7.0:1773851850.396281:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.396281:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000014ddb816 : new rpc_count 1
00000100:00000001:7.0:1773851850.396282:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.396282:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637119644518400 : -106954065033216 : ffff9eb9d0f24800)
00000100:00000040:5.0:1773851850.396283:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000073d0c946 x1859576507421696/t0(0) o400->34309051-ae01-4994-9f23-d7dfc668d6f2@23024@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1917-0'
00000100:00000001:5.0:1773851850.396286:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.396286:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851850.396287:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073d0c946 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:34309051-ae01-4994-9f23-d7dfc668d6f2+5:39862:x1859576507421696:12345-23024@kfi7:400:default-tuolumne1917-0
00000100:00000200:5.0:1773851850.396288:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576507421696
00000020:00000001:5.0:1773851850.396289:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851850.396290:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851850.396290:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.396291:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851850.396291:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851850.396292:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851850.396293:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576507421696, found 0 last_xid 1859576507421695
00000020:00000001:5.0:1773851850.396294:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851850.396294:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851850.396295:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851850.396295:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.396296:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851850.396297:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851850.396297:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851850.396298:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008b310163.
02000000:00000001:5.0:1773851850.396298:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.396299:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.396300:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851850.396300:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098907222, transno 0, xid 1859576507421696
00010000:00000001:5.0:1773851850.396301:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851850.396302:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000073d0c946 x1859576507421696/t0(0) o400->34309051-ae01-4994-9f23-d7dfc668d6f2@23024@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1917-0'
00010000:00000001:5.0:1773851850.396304:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851850.396305:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851850.396305:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=82 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851850.396307:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851850.396308:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006bc7a0cd refcount 3 to 23024@kfi7
00000100:00000001:5.0:1773851850.396308:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232980480 : -107130476571136 : ffff9e90bdffd600)
02000000:00000001:5.0:1773851850.396309:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851850.396310:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.396310:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851850.396311:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22833@kfi7
00000400:00000010:5.0:1773851850.396312:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000200:5.0:1773851850.396312:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576507421696, offset 224
00000400:00000200:5.0:1773851850.396314:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22833@kfi7
00000400:00000200:5.0:1773851850.396315:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.396315:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 1
00000400:00000200:5.0:1773851850.396316:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000400:00000200:5.0:1773851850.396317:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 3
00000400:00000200:5.0:1773851850.396319:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22833@kfi7 local destination
00000400:00000200:5.0:1773851850.396320:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768454:8768454:1024:4294967295] 22833@kfi7 LPNI seq info [3861659:3861659:16:4294967295]
00000400:00000200:5.0:1773851850.396322:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000400:00000200:5.0:1773851850.396322:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.396324:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22833@kfi7(22833@kfi7:22833@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851850.396325:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 3
00000800:00000200:5.0:1773851850.396326:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.396327:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851850.396329:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851850.396331:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b Using peer 22833@kfi7(0x100000000000a4b)
00000800:00000200:5.0:1773851850.396334:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x100000000000a4b: rc=0
00000800:00000200:5.0:1773851850.396335:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851850.396337:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.396338:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006bc7a0cd refcount 2 to 23024@kfi7
00010000:00000001:5.0:1773851850.396339:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851850.396339:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.396340:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851850.396340:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073d0c946 x1859576507421696/t0(0) o400->34309051-ae01-4994-9f23-d7dfc668d6f2@23024@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1917-0'
00000100:00100000:5.0:1773851850.396343:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073d0c946 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:34309051-ae01-4994-9f23-d7dfc668d6f2+5:39862:x1859576507421696:12345-23024@kfi7:400:default-tuolumne1917-0 Request processed in 57us (92us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851850.396346:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23024@kfi7, seq: 2001835
00000100:00000040:5.0:1773851850.396346:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000014ddb816 : new rpc_count 0
00000800:00000200:6.0:1773851850.396347:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851850.396347:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851850.396348:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851850.396348:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851850.396349:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851850.396349:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008d4880d3.
00000400:00000200:6.0:1773851850.396350:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22833@kfi7: PUT: OK
00000020:00000010:5.0:1773851850.396350:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6b8036f.
00000020:00000040:5.0:1773851850.396350:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000014ddb816 : new refcount 4
00000400:00000200:6.0:1773851850.396351:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:6.0:1773851850.396351:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00000001:5.0:1773851850.396351:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851850.396352:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851850.396353:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851850.396353:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000800:00000200:6.0:1773851850.396355:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 22833@kfi7(0000000011e627c7):0x0 lsk 2636 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000a4b Transaction freed
00000800:00000200:26.0:1773851850.474829:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851850.474830:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851850.474831:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851850.474833:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851850.474835:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:26.0:1773851850.474836:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:26.0:1773851850.474837:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:26.0:1773851850.474838:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:26.0:1773851850.474839:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:26.0:1773851850.474840:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:26.0:1773851850.474841:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:26.0:1773851850.474842:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:26.0:1773851850.474843:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed3fe940
00000400:00000200:26.0:1773851850.474844:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x160dfce379 [256] + 12168
00000800:00000200:26.0:1773851850.474846:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851850.474848:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851850.474849:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00000001:26.0:1773851850.474851:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851850.474851:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:26.0:1773851850.474852:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d020b226.
00000100:00000040:26.0:1773851850.474853:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000d020b226 x1858062667213120 msgsize 224
00000100:00100000:26.0:1773851850.474855:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000100:00000001:26.0:1773851850.474856:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851850.474857:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:24.0:1773851850.474858:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851850.474858:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851850.474859:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851850.474859:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851850.474860:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851850.474861:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851850.474862:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667213120
00000020:00000001:24.0:1773851850.474862:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851850.474863:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:24.0:1773851850.474864:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851850.474868:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:24.0:1773851850.474869:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:24.0:1773851850.474870:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:24.0:1773851850.474871:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851850.474872:0:1537164:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851850.474873:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000098c1846a.
00000020:00000010:24.0:1773851850.474874:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851850.474876:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003edb2b79.
00000100:00000040:24.0:1773851850.474877:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851850.474878:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851850.474878:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851850.474879:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.474880:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.474881:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851850.474882:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851850.474883:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851850.474884:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799977
00000100:00000001:25.0:1773851850.474885:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:24.0:1773851850.474885:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:25.0:1773851850.474886:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851850.474886:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538614400 : -106958170937216 : ffff9eb8dc372880)
00000100:00000001:25.0:1773851850.474887:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851850.474888:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d020b226 x1858062667213120/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:25.0:1773851850.474889:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.474891:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851850.474892:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851850.474893:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d020b226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667213120:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:24.0:1773851850.474894:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667213120
00000020:00000001:24.0:1773851850.474895:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851850.474896:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851850.474897:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851850.474898:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851850.474898:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851850.474899:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851850.474900:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851850.474901:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851850.474901:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851850.474902:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.474903:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851850.474904:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851850.474905:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000f57a73f4.
02000000:00000001:24.0:1773851850.474906:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.474907:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851850.474908:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851850.474909:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851850.474910:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851850.474911:0:1537164:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851850.474913:0:1537164:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851850.474914:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851850.474915:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851850.474917:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851850.474918:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667213120
00010000:00000001:24.0:1773851850.474919:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851850.474920:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d020b226 x1858062667213120/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:577/0 lens 224/368 e 0 to 0 dl 1773851937 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:24.0:1773851850.474923:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851850.474924:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851850.474925:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=127 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851850.474926:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851850.474927:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:24.0:1773851850.474928:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:24.0:1773851850.474929:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851850.474930:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.474931:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851850.474932:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:24.0:1773851850.474933:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000040aa4957.
00000100:00000200:24.0:1773851850.474934:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667213120, offset 224
00000400:00000200:24.0:1773851850.474935:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:24.0:1773851850.474936:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851850.474937:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:24.0:1773851850.474939:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851850.474940:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:24.0:1773851850.474941:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2105@kfi7 local destination
00000400:00000200:24.0:1773851850.474943:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768455:8768455:1024:4294967295] 2105@kfi7 LPNI seq info [20346195:20346195:16:4294967295]
00000400:00000200:24.0:1773851850.474945:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851850.474946:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851850.474949:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851850.474950:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:24.0:1773851850.474952:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851850.474953:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851850.474956:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851850.474958:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000800:00000200:24.0:1773851850.474962:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 468 bytes to peer 0x4c6: rc=0
00000800:00000200:24.0:1773851850.474964:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851850.474966:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851850.474967:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:24.0:1773851850.474968:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851850.474970:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851850.474971:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851850.474972:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d020b226 x1858062667213120/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:577/0 lens 224/368 e 0 to 0 dl 1773851937 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:24.0:1773851850.474975:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d020b226 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667213120:12345-2098@kfi7:41:default-yuba6-0 Request processed in 83us (121us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851850.474978:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799977
00000100:00000040:24.0:1773851850.474979:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:24.0:1773851850.474980:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851850.474981:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851850.474982:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851850.474982:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003edb2b79.
00000020:00000010:24.0:1773851850.474983:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000098c1846a.
00000020:00000040:24.0:1773851850.474984:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:24.0:1773851850.474985:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851850.474990:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851850.474991:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851850.474992:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:25.0:1773851850.474993:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000040aa4957
00000400:00000010:25.0:1773851850.474994:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000040aa4957.
00000100:00000001:25.0:1773851850.474994:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851850.474995:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851850.474996:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851850.474997:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Transaction freed
00000800:00000200:9.0:1773851850.520225:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851850.520227:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851850.520229:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851850.520232:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851850.520235:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.520237:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16304@kfi7 : PUT - for me
00000400:00000200:9.0:1773851850.520239:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.520240:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 1
00000400:00000200:9.0:1773851850.520241:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.520243:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000400:00000200:9.0:1773851850.520244:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 3
00000400:00000200:9.0:1773851850.520246:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.520247:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16304@kfi7 of length 224 into portal 12 MB=0x69b4b57015900
00000400:00000200:9.0:1773851850.520250:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16304@kfi7 of length 224/224 into md 0x78146ce49 [64] + 115416
00000800:00000200:9.0:1773851850.520252:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851850.520255:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.520257:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16304@kfi7: PUT: OK
00000100:00000001:9.0:1773851850.520258:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851850.520259:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851850.520261:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004bda138c.
00000100:00000040:9.0:1773851850.520262:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004bda138c x1859597744822528 msgsize 224
00000100:00100000:9.0:1773851850.520265:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-16304@kfi7 (source: 12345-16304@kfi7)
00000100:00000001:9.0:1773851850.520266:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851850.520268:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000800:00000200:9.0:1773851850.520270:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851850.520270:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851850.520271:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851850.520271:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851850.520272:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851850.520274:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851850.520275:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597744822528
00000020:00000001:8.0:1773851850.520276:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851850.520277:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80947
00000020:00000001:8.0:1773851850.520278:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851850.520281:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004de9afed refcount=5
00000020:00000001:8.0:1773851850.520283:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637101826956288 : -106971882595328 : ffff9eb5aaefdc00)
00000020:00000001:8.0:1773851850.520284:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637101826956288 : -106971882595328 : ffff9eb5aaefdc00)
00000100:00000001:8.0:1773851850.520286:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.520287:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851850.520288:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000690b86c3.
00000020:00000010:8.0:1773851850.520290:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.520291:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851850.520293:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851850.520294:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851850.520295:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851850.520296:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851850.520297:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851850.520298:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.520299:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851850.520301:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851850.520302:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851850.520302:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851850.520303:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851850.520304:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16304@kfi7, seq: 2130708
00000100:00000001:11.0:1773851850.520305:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.520305:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004de9afed : new rpc_count 1
00000100:00000001:11.0:1773851850.520306:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.520306:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792160512 : -106938917391104 : ffff9ebd57d0f500)
00000100:00000040:8.0:1773851850.520308:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004bda138c x1859597744822528/t0(0) o400->a04d15c8-374e-40b4-959e-12c9074d5bf5@16304@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1502-0'
00000100:00000001:8.0:1773851850.520313:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.520313:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851850.520315:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bda138c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a04d15c8-374e-40b4-959e-12c9074d5bf5+5:39559:x1859597744822528:12345-16304@kfi7:400:default-tuolumne1502-0
00000100:00000200:8.0:1773851850.520317:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597744822528
00000020:00000001:8.0:1773851850.520318:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851850.520319:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851850.520320:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.520321:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851850.520322:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851850.520324:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851850.520325:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597744822528, found 0 last_xid 1859597744822527
00000020:00000001:8.0:1773851850.520326:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851850.520328:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851850.520328:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851850.520329:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.520330:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851850.520331:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851850.520332:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851850.520335:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000097eb0323.
02000000:00000001:8.0:1773851850.520336:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.520337:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.520338:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851850.520339:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044150690, transno 0, xid 1859597744822528
00010000:00000001:8.0:1773851850.520341:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851850.520342:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004bda138c x1859597744822528/t0(0) o400->a04d15c8-374e-40b4-959e-12c9074d5bf5@16304@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1502-0'
00010000:00000001:8.0:1773851850.520346:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851850.520347:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851850.520349:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=83 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851850.520350:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851850.520352:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f2114774 refcount 3 to 16304@kfi7
00000100:00000001:8.0:1773851850.520353:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134272 : -107146658417344 : ffff9e8cf97c7540)
02000000:00000001:8.0:1773851850.520354:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851850.520355:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.520356:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851850.520358:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16304@kfi7
00000400:00000010:8.0:1773851850.520359:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
00000100:00000200:8.0:1773851850.520360:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597744822528, offset 224
00000400:00000200:8.0:1773851850.520362:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16304@kfi7
00000400:00000200:8.0:1773851850.520364:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.520366:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 1
00000400:00000200:8.0:1773851850.520367:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000400:00000200:8.0:1773851850.520369:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 3
00000400:00000200:8.0:1773851850.520372:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16304@kfi7 local destination
00000400:00000200:8.0:1773851850.520374:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768456:8768456:1024:4294967295] 16304@kfi7 LPNI seq info [263362:263362:16:4294967295]
00000400:00000200:8.0:1773851850.520376:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000400:00000200:8.0:1773851850.520378:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.520381:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16304@kfi7(16304@kfi7:16304@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851850.520383:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 3
00000800:00000200:8.0:1773851850.520385:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851850.520387:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851850.520391:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851850.520394:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000075c Using peer 16304@kfi7(0x10000000000075c)
00000800:00000200:8.0:1773851850.520399:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x10000000000075c: rc=0
00000800:00000200:8.0:1773851850.520402:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000075c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851850.520405:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.520406:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f2114774 refcount 2 to 16304@kfi7
00010000:00000001:8.0:1773851850.520407:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851850.520408:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.520412:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851850.520413:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004bda138c x1859597744822528/t0(0) o400->a04d15c8-374e-40b4-959e-12c9074d5bf5@16304@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1502-0'
00000100:00100000:8.0:1773851850.520418:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bda138c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a04d15c8-374e-40b4-959e-12c9074d5bf5+5:39559:x1859597744822528:12345-16304@kfi7:400:default-tuolumne1502-0 Request processed in 104us (154us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851850.520422:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16304@kfi7, seq: 2130708
00000100:00000040:8.0:1773851850.520423:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004de9afed : new rpc_count 0
00000100:00000001:8.0:1773851850.520424:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851850.520425:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851850.520440:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.520441:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851850.520443:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000690b86c3.
00000020:00000040:8.0:1773851850.520444:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004de9afed : new refcount 4
00000100:00000001:8.0:1773851850.520445:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851850.520455:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000075c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851850.520458:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.520459:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16304@kfi7: PUT: OK
00000400:00000200:9.0:1773851850.520461:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000400:00000010:9.0:1773851850.520461:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000100:00000001:9.0:1773851850.520463:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851850.520463:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851850.520465:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000800:00000200:9.0:1773851850.520467:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 16304@kfi7(00000000408dc402):0x0 lsk 1885 rsk 21 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000075c Transaction freed
00000800:00000200:5.0:1773851850.542484:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.542486:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851850.542488:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851850.542491:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851850.542494:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.542495:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12353@kfi7 : PUT - for me
00000400:00000200:5.0:1773851850.542497:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.542498:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 1
00000400:00000200:5.0:1773851850.542498:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.542499:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000400:00000200:5.0:1773851850.542500:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 3
00000400:00000200:5.0:1773851850.542501:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.542503:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12353@kfi7 of length 224 into portal 12 MB=0x69b4b8bcef780
00000400:00000200:5.0:1773851850.542504:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12353@kfi7 of length 224/224 into md 0x793926dc5 [64] + 114448
00000800:00000200:5.0:1773851850.542507:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851850.542508:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851850.542510:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12353@kfi7: PUT: OK
00000100:00000001:5.0:1773851850.542511:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851850.542511:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851850.542514:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b1095e2.
00000100:00000040:5.0:1773851850.542514:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000005b1095e2 x1859598630713216 msgsize 224
00000100:00100000:5.0:1773851850.542516:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12353@kfi7 (source: 12345-12353@kfi7)
00000100:00000001:5.0:1773851850.542518:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851850.542518:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000800:00000200:5.0:1773851850.542520:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851850.542523:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851850.542523:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851850.542524:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851850.542525:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851850.542525:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851850.542526:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598630713216
00000020:00000001:5.0:1773851850.542527:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851850.542527:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fc3c
00000020:00000001:5.0:1773851850.542528:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851850.542530:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bb4b928d refcount=7
00000020:00000001:5.0:1773851850.542530:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136154940416 : -106937554611200 : ffff9ebda90b5400)
00000020:00000001:5.0:1773851850.542531:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136154940416 : -106937554611200 : ffff9ebda90b5400)
00000100:00000001:5.0:1773851850.542532:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.542533:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851850.542534:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6b8036f.
00000020:00000010:5.0:1773851850.542535:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851850.542536:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008d4880d3.
00000100:00000001:5.0:1773851850.542537:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851850.542537:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851850.542538:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.542539:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851850.542539:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851850.542540:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.542541:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851850.542542:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851850.542542:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851850.542542:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851850.542543:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851850.542543:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12353@kfi7, seq: 2001836
00000100:00000001:7.0:1773851850.542544:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.542544:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bb4b928d : new rpc_count 3
00000100:00000001:5.0:1773851850.542544:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637007785716736 : -107065923834880 : ffff9e9fc5a46c00)
00000100:00000001:7.0:1773851850.542545:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.542545:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005b1095e2 x1859598630713216/t0(0) o400->fcbee1ec-186f-4f69-a3f9-2978df3c252a@12353@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1268-0'
00000100:00000001:5.0:1773851850.542548:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.542548:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851850.542549:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b1095e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fcbee1ec-186f-4f69-a3f9-2978df3c252a+7:39739:x1859598630713216:12345-12353@kfi7:400:default-tuolumne1268-0
00000100:00000200:5.0:1773851850.542550:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598630713216
00000020:00000001:5.0:1773851850.542550:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851850.542551:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851850.542551:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.542552:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851850.542552:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851850.542553:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851850.542554:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598630713216, found 0 last_xid 1859598629660095
00000020:00000001:5.0:1773851850.542554:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851850.542555:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851850.542555:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851850.542556:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.542556:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851850.542557:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851850.542557:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851850.542558:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b2f6945d.
02000000:00000001:5.0:1773851850.542559:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.542560:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.542560:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851850.542561:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183237937276, transno 0, xid 1859598630713216
00010000:00000001:5.0:1773851850.542562:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851850.542562:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005b1095e2 x1859598630713216/t0(0) o400->fcbee1ec-186f-4f69-a3f9-2978df3c252a@12353@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1268-0'
00010000:00000001:5.0:1773851850.542564:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851850.542565:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851850.542566:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=82 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851850.542566:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851850.542567:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000010ad3832 refcount 3 to 12353@kfi7
00000100:00000001:5.0:1773851850.542568:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981632 : -107130476569984 : ffff9e90bdffda80)
02000000:00000001:5.0:1773851850.542568:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851850.542569:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.542569:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851850.542570:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12353@kfi7
00000400:00000010:5.0:1773851850.542571:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
00000100:00000200:5.0:1773851850.542572:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598630713216, offset 224
00000400:00000200:5.0:1773851850.542573:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12353@kfi7
00000400:00000200:5.0:1773851850.542573:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.542574:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 1
00000400:00000200:5.0:1773851850.542575:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000400:00000200:5.0:1773851850.542575:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 3
00000400:00000200:5.0:1773851850.542576:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12353@kfi7 local destination
00000400:00000200:5.0:1773851850.542577:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768457:8768457:1024:4294967295] 12353@kfi7 LPNI seq info [7741079:7741079:16:4294967295]
00000400:00000200:5.0:1773851850.542579:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000400:00000200:5.0:1773851850.542579:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.542581:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12353@kfi7(12353@kfi7:12353@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851850.542582:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 3
00000800:00000200:5.0:1773851850.542583:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.542584:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851850.542587:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851850.542589:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x91f Using peer 12353@kfi7(0x91f)
00000800:00000200:5.0:1773851850.542592:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x91f: rc=0
00000800:00000200:5.0:1773851850.542594:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x91f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851850.542595:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.542596:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000010ad3832 refcount 2 to 12353@kfi7
00010000:00000001:5.0:1773851850.542597:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851850.542597:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.542598:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851850.542598:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b1095e2 x1859598630713216/t0(0) o400->fcbee1ec-186f-4f69-a3f9-2978df3c252a@12353@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1268-0'
00000100:00100000:5.0:1773851850.542601:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b1095e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fcbee1ec-186f-4f69-a3f9-2978df3c252a+7:39739:x1859598630713216:12345-12353@kfi7:400:default-tuolumne1268-0 Request processed in 52us (86us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851850.542603:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12353@kfi7, seq: 2001836
00000100:00000040:5.0:1773851850.542603:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bb4b928d : new rpc_count 2
00000100:00000001:5.0:1773851850.542604:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851850.542605:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851850.542605:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851850.542606:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x91f TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851850.542606:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008d4880d3.
00000020:00000010:5.0:1773851850.542606:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6b8036f.
00000400:00000200:6.0:1773851850.542607:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:5.0:1773851850.542607:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000bb4b928d : new refcount 6
00000400:00000200:6.0:1773851850.542608:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12353@kfi7: PUT: OK
00000100:00000001:5.0:1773851850.542608:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851850.542609:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00000400:00000010:6.0:1773851850.542610:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
00000100:00000001:6.0:1773851850.542610:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851850.542611:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851850.542612:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000800:00000200:6.0:1773851850.542613:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 12353@kfi7(00000000a6b3a080):0x0 lsk 2336 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x91f Transaction freed
00000800:00000200:9.0:1773851850.568956:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851850.568956:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851850.568958:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851850.568960:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851850.568961:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.568963:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23027@kfi7 : PUT - for me
00000400:00000200:9.0:1773851850.568963:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.568964:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 1
00000400:00000200:9.0:1773851850.568965:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.568965:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000400:00000200:9.0:1773851850.568966:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 3
00000400:00000200:9.0:1773851850.568967:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23026@kfi7 to cpt 7
00000400:00000200:9.0:1773851850.568968:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23026@kfi7 of length 224 into portal 12 MB=0x69b0a1b5903c0
00000400:00000200:9.0:1773851850.568969:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23026@kfi7 of length 224/224 into md 0x78146ce49 [64] + 115640
00000800:00000200:9.0:1773851850.568971:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851850.568972:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.568974:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23027@kfi7: PUT: OK
00000100:00000001:9.0:1773851850.568975:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851850.568975:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851850.568977:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000017d64c10.
00000100:00000040:9.0:1773851850.568977:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000017d64c10 x1859317571060672 msgsize 224
00000100:00100000:9.0:1773851850.568979:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-23026@kfi7 (source: 12345-23027@kfi7)
00000100:00000001:9.0:1773851850.568980:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851850.568981:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000100:00000001:8.0:1773851850.568981:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851850.568982:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851850.568982:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851850.568982:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851850.568983:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851850.568983:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851850.568984:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317571060672
00000020:00000001:8.0:1773851850.568985:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851850.568985:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92faa
00000020:00000001:8.0:1773851850.568986:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851850.568988:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006a3b15fb refcount=6
00000020:00000001:8.0:1773851850.568989:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744906752 : -107128964644864 : ffff9e91181e0000)
00000020:00000001:8.0:1773851850.568989:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744906752 : -107128964644864 : ffff9e91181e0000)
00000100:00000001:8.0:1773851850.568990:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.568991:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851850.568992:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003ec85fa.
00000020:00000010:8.0:1773851850.568993:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.568994:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851850.568995:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851850.568995:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851850.568996:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851850.568996:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851850.568997:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851850.568997:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.568998:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851850.569000:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851850.569000:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851850.569000:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851850.569000:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851850.569001:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23026@kfi7, seq: 2130709
00000100:00000001:11.0:1773851850.569002:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.569002:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006a3b15fb : new rpc_count 1
00000100:00000001:11.0:1773851850.569003:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.569003:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792130560 : -106938917421056 : ffff9ebd57d08000)
00000100:00000040:8.0:1773851850.569004:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000017d64c10 x1859317571060672/t0(0) o400->846b8381-9333-48d8-8e13-eed170471ae2@23026@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1913-0'
00000100:00000001:8.0:1773851850.569009:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.569010:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851850.569011:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017d64c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:846b8381-9333-48d8-8e13-eed170471ae2+6:39625:x1859317571060672:12345-23026@kfi7:400:default-tuolumne1913-0
00000100:00000200:8.0:1773851850.569012:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317571060672
00000020:00000001:8.0:1773851850.569013:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851850.569013:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851850.569014:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.569015:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851850.569015:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851850.569016:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851850.569016:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317571060672, found 0 last_xid 1859317571060671
00000020:00000001:8.0:1773851850.569017:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851850.569018:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851850.569019:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851850.569019:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.569020:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851850.569020:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851850.569021:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851850.569022:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006239b615.
02000000:00000001:8.0:1773851850.569022:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.569023:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.569024:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851850.569024:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915840701, transno 0, xid 1859317571060672
00010000:00000001:8.0:1773851850.569025:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851850.569026:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000017d64c10 x1859317571060672/t0(0) o400->846b8381-9333-48d8-8e13-eed170471ae2@23026@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1913-0'
00010000:00000001:8.0:1773851850.569028:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851850.569029:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851850.569030:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=83 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851850.569031:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851850.569032:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003850777f refcount 3 to 23026@kfi7
00000100:00000001:8.0:1773851850.569032:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805600 : -107130477746016 : ffff9e90bdede8a0)
02000000:00000001:8.0:1773851850.569034:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851850.569034:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.569035:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851850.569036:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23027@kfi7
00000400:00000010:8.0:1773851850.569036:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079e75b3d.
00000100:00000200:8.0:1773851850.569037:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317571060672, offset 224
00000400:00000200:8.0:1773851850.569038:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23027@kfi7
00000400:00000200:8.0:1773851850.569039:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.569040:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 1
00000400:00000200:8.0:1773851850.569041:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000400:00000200:8.0:1773851850.569042:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 3
00000400:00000200:8.0:1773851850.569043:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23027@kfi7 local destination
00000400:00000200:8.0:1773851850.569045:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768458:8768458:1024:4294967295] 23027@kfi7 LPNI seq info [747490:747490:16:4294967295]
00000400:00000200:8.0:1773851850.569046:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000400:00000200:8.0:1773851850.569047:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.569049:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23027@kfi7(23027@kfi7:23027@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851850.569050:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 3
00000800:00000200:8.0:1773851850.569051:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851850.569052:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851850.569055:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851850.569057:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003d7 Using peer 23027@kfi7(0x1000000000003d7)
00000800:00000200:8.0:1773851850.569060:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1000000000003d7: rc=0
00000800:00000200:8.0:1773851850.569062:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851850.569063:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.569064:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003850777f refcount 2 to 23026@kfi7
00010000:00000001:8.0:1773851850.569065:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851850.569066:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.569066:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851850.569067:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000017d64c10 x1859317571060672/t0(0) o400->846b8381-9333-48d8-8e13-eed170471ae2@23026@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1913-0'
00000100:00100000:8.0:1773851850.569071:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017d64c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:846b8381-9333-48d8-8e13-eed170471ae2+6:39625:x1859317571060672:12345-23026@kfi7:400:default-tuolumne1913-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851850.569073:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23026@kfi7, seq: 2130709
00000100:00000040:8.0:1773851850.569074:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006a3b15fb : new rpc_count 0
00000100:00000001:8.0:1773851850.569075:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851850.569076:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851850.569076:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.569077:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851850.569078:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003ec85fa.
00000020:00000040:8.0:1773851850.569079:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000006a3b15fb : new refcount 5
00000100:00000001:8.0:1773851850.569079:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851850.569084:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003d7 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851850.569085:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.569086:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23027@kfi7: PUT: OK
00000400:00000200:9.0:1773851850.569087:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079e75b3d
00000400:00000010:9.0:1773851850.569088:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079e75b3d.
00000100:00000001:9.0:1773851850.569088:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851850.569089:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851850.569089:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000800:00000200:9.0:1773851850.569091:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 23027@kfi7(0000000056349bd2):0x0 lsk 984 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003d7 Transaction freed
00000004:00000001:11.0:1773851850.569729:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851850.569730:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851850.569731:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b624700f.
00000020:00000040:11.0:1773851850.569732:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851850.569733:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851850.569734:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851850.569734:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851850.569735:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004ecafcc4.
00000100:00000001:11.0:1773851850.569736:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851850.569737:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851850.569738:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851850.569740:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b624700f] to pc [ptlrpcd_02_03+3]  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851850.569744:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851850.569745:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:11.0:1773851850.569746:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003e871f44.
00000100:00000001:10.0:1773851850.569746:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851850.569746:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851850.569746:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:11.0:1773851850.569747:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637095039367168 : -106978670184448 : ffff9eb4165d7800)
00000100:00000001:10.0:1773851850.569747:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851850.569747:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851850.569748:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:11.0:1773851850.569749:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851850.569750:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000100:00000001:9.0:1773851850.569750:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851850.569750:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:11.0:1773851850.569751:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f4ca7edb.
02000000:00000001:9.0:1773851850.569751:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:11.0:1773851850.569752:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614125023027252ns, next at 614126023026050ns, rc = 0
02000000:00000001:9.0:1773851850.569752:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851850.569753:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:9.0:1773851850.569753:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051921600:2075@kfi7:13:default-yuba2-0
00080000:00000001:11.0:1773851850.569754:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851850.569754:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:11.0:1773851850.569755:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851850.569755:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851850.569755:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851850.569756:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851850.569757:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ba3e4e94.
02000000:00000001:9.0:1773851850.569757:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851850.569758:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:9.0:1773851850.569759:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000071ec9fd.
00000400:00000010:9.0:1773851850.569760:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000146cbe4e.
00000100:00000200:9.0:1773851850.569761:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921600, portal 4
00000100:00000001:9.0:1773851850.569762:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851850.569762:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637164268282624 : -106909441268992 : ffff9ec434bae300)
00000100:00000040:9.0:1773851850.569763:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851850.569766:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851850.569767:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:9.0:1773851850.569767:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e30a1d2d.
00000100:00000200:9.0:1773851850.569768:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921600, offset 0
00000400:00000200:9.0:1773851850.569769:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:9.0:1773851850.569770:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.569771:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851850.569772:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851850.569773:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851850.569774:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:9.0:1773851850.569775:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768457, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768458, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851850.569777:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851850.569778:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851850.569779:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:9.0:1773851850.569780:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768459:8768459:1024:4294967295] 2075@kfi7 LPNI seq info [5403907:5403907:16:4294967295]
00000400:00000200:9.0:1773851850.569781:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851850.569782:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.569784:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851850.569785:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:9.0:1773851850.569786:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851850.569787:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851850.569790:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851850.569792:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Using peer 2075@kfi7(0x4e8)
00000800:00000200:9.0:1773851850.569795:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000438708cd: Posted send of 324 bytes to peer 0x4e8: rc=0
00000800:00000200:9.0:1773851850.569796:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851850.569798:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851850.569799:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851850.569800:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851850.569801:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851850.569801:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851850.569802:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851850.569803:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851850.569804:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851850.569804:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851850.569804:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851850.569805:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851850.569806:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851850.569809:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851850.569811:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000400:00000200:10.0:1773851850.569812:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e30a1d2d
00000400:00000010:10.0:1773851850.569812:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e30a1d2d.
00000100:00000001:10.0:1773851850.569813:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851850.569814:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851850.569818:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851850.569819:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851850.569821:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851850.569822:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851850.569823:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:10.0:1773851850.569826:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Transaction freed
00000800:00000200:9.0:1773851850.569850:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851850.569851:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851850.569852:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851850.569854:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851850.569856:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.569857:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851850.569858:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.569859:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851850.569859:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.569860:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851850.569861:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851850.569861:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.569863:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1cc0
00000400:00000200:9.0:1773851850.569864:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.569865:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781696949 [1] + 224
00000800:00000200:9.0:1773851850.569866:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851850.569868:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.569869:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851850.569870:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851850.569871:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851850.569874:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851850.569877:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851850.569878:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851850.569879:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851850.569881:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851850.569881:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:9.0:1773851850.569882:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851850.569883:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851850.569883:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000071ec9fd.
00000400:00000200:9.0:1773851850.569884:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000146cbe4e
00000400:00000010:9.0:1773851850.569884:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000146cbe4e.
00000100:00000001:9.0:1773851850.569885:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851850.569885:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851850.569888:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851850.569890:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851850.569891:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851850.569891:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851850.569892:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851850.569892:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851850.569893:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851850.569894:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851850.569895:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=83 v=66 (66 66 66 66)
00000100:00001000:9.0:1773851850.569896:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=83 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851850.569897:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851850.569898:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851850.569898:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851850.569899:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851850.569900:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851850.569900:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:9.0:1773851850.569901:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851850.569901:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851850.569902:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851850.569904:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851850.569905:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851850.569906:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851850.569906:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851850.569907:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851850.569908:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470754816 avail=351461655552 avail_mb=1372897092 hwm_mb=3131103 files=372064680 ffree=343233159 state=0: rc = 0
00000004:00000020:9.0:1773851850.569910:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470754816 free, 351461655552 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064680 files, 343233159 free files
00000004:00000001:9.0:1773851850.569911:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851850.569912:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851850.569915:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051921600:2075@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851850.569916:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851850.569917:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851850.569917:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b624700f x1859433051921600/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852003 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851850.569920:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851850.569920:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851850.569922:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ba3e4e94.
02000000:00000001:9.0:1773851850.569923:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851850.569923:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851850.569924:0:41071:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:9.0:1773851850.569925:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851850.569925:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004ecafcc4.
02000000:00000001:9.0:1773851850.569926:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851850.569926:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851850.569927:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b624700f.
00000100:00000001:9.0:1773851850.569928:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851850.569928:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851850.569928:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851850.569929:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851850.569930:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851850.569930:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851850.569930:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851850.633733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851850.633734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:29.0:1773851850.658167:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851850.658168:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851850.658169:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851850.658171:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851850.658173:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.658174:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12931@kfi7 : PUT - for me
00000400:00000200:29.0:1773851850.658175:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.658176:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 1
00000400:00000200:29.0:1773851850.658176:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.658177:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000400:00000200:29.0:1773851850.658178:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 3
00000400:00000200:29.0:1773851850.658178:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.658179:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12931@kfi7 of length 456 into portal 12 MB=0x69b4b5e8fda40
00000400:00000200:29.0:1773851850.658181:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12931@kfi7 of length 456/456 into md 0x77fe139dd [64] + 157088
00000800:00000200:29.0:1773851850.658183:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851850.658185:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851850.658186:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12931@kfi7: PUT: OK
00000100:00000001:29.0:1773851850.658187:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851850.658188:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851850.658189:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007205c70f.
00000100:00000040:29.0:1773851850.658190:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000007205c70f x1859597871602240 msgsize 456
00000100:00100000:29.0:1773851850.658191:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12931@kfi7 (source: 12345-12931@kfi7)
00000100:00000001:29.0:1773851850.658193:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851850.658194:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000800:00000200:29.0:1773851850.658195:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851850.658198:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851850.658199:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851850.658200:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851850.658200:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851850.658201:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851850.658202:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597871602240
00000020:00000001:29.0:1773851850.658203:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851850.658203:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79f4b
00000020:00000001:29.0:1773851850.658204:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851850.658205:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004fde6f08 refcount=5
00000020:00000001:29.0:1773851850.658206:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108662001664 : -106965047549952 : ffff9eb742566000)
00000020:00000001:29.0:1773851850.658207:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108662001664 : -106965047549952 : ffff9eb742566000)
00000100:00000001:29.0:1773851850.658208:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851850.658209:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851850.658209:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001d1a7a8a.
00000020:00000010:29.0:1773851850.658211:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851850.658211:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851850.658212:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851850.658213:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851850.658214:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.658215:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.658216:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851850.658218:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851850.658218:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851850.658219:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851850.658219:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851850.658220:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12931@kfi7, seq: 364304980
00000100:00000001:31.0:1773851850.658221:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851850.658221:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851850.658221:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004fde6f08 : new rpc_count 1
00000100:00000001:29.0:1773851850.658221:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224856704 : -106962484694912 : ffff9eb7db187080)
00000100:00000040:29.0:1773851850.658223:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007205c70f x1859597871602240/t0(0) o17->51df9d36-3edf-4909-a0db-9339591aea20@12931@kfi7:638/0 lens 456/0 e 0 to 0 dl 1773851998 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1304-0'
00000100:00000001:29.0:1773851850.658226:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851850.658226:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851850.658227:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007205c70f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:51df9d36-3edf-4909-a0db-9339591aea20+5:39546:x1859597871602240:12345-12931@kfi7:17:default-tuolumne1304-0
00000100:00000200:29.0:1773851850.658229:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597871602240
00000020:00000001:29.0:1773851850.658229:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851850.658230:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851850.658231:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.658232:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851850.658232:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:29.0:1773851850.658233:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851850.658234:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597871602240, found 0 last_xid 1859597871602239
00000020:00000001:29.0:1773851850.658235:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851850.658236:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851850.658236:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851850.658237:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851850.658238:0:60533:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:29.0:1773851850.658239:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851850.658239:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851850.658240:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000003eda824d.
02000000:00000001:29.0:1773851850.658241:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.658242:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.658242:0:60533:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:29.0:1773851850.658243:0:60533:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:29.0:1773851850.658244:0:60533:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:29.0:1773851850.658246:0:60533:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.658246:0:60533:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:29.0:1773851850.658247:0:60533:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 51df9d36-3edf-4909-a0db-9339591aea20/000000004fde6f08 free: 126633370845184 avail: 126633368748032
00000020:00000001:29.0:1773851850.658248:0:60533:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:29.0:1773851850.658249:0:60533:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 51df9d36-3edf-4909-a0db-9339591aea20/000000004fde6f08 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:29.0:1773851850.658250:0:60533:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:29.0:1773851850.658251:0:60533:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:29.0:1773851850.658251:0:60533:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 51df9d36-3edf-4909-a0db-9339591aea20/000000004fde6f08 reports grant 1811152895 dropped 0, local 1879310335
00000020:00000001:29.0:1773851850.658252:0:60533:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:29.0:1773851850.658253:0:60533:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:29.0:1773851850.658253:0:60533:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851850.658254:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183245103018, transno 0, xid 1859597871602240
00010000:00000001:29.0:1773851850.658255:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851850.658256:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007205c70f x1859597871602240/t0(0) o17->51df9d36-3edf-4909-a0db-9339591aea20@12931@kfi7:638/0 lens 456/432 e 0 to 0 dl 1773851998 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1304-0'
00010000:00000001:29.0:1773851850.658259:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851850.658259:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851850.658260:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=83 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851850.658261:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851850.658262:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b12a23f5 refcount 3 to 12931@kfi7
00000100:00000001:29.0:1773851850.658263:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214208 : -107155106337408 : ffff9e8b01f36d80)
02000000:00000001:29.0:1773851850.658264:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851850.658265:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.658265:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851850.658266:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12931@kfi7
00000400:00000010:29.0:1773851850.658267:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf20a357.
00000100:00000200:29.0:1773851850.658268:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859597871602240, offset 224
00000400:00000200:29.0:1773851850.658269:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12931@kfi7
00000400:00000200:29.0:1773851850.658270:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.658271:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 1
00000400:00000200:29.0:1773851850.658272:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000400:00000200:29.0:1773851850.658274:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 3
00000400:00000200:29.0:1773851850.658275:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12931@kfi7 local destination
00000400:00000200:29.0:1773851850.658277:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768460:8768460:1024:4294967295] 12931@kfi7 LPNI seq info [1083490:1083490:16:4294967295]
00000400:00000200:29.0:1773851850.658278:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000400:00000200:29.0:1773851850.658279:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.658281:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12931@kfi7(12931@kfi7:12931@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851850.658283:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 3
00000800:00000200:29.0:1773851850.658284:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851850.658285:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:29.0:1773851850.658287:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851850.658289:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001d3 Using peer 12931@kfi7(0x1000000000001d3)
00000800:00000200:29.0:1773851850.658293:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 532 bytes to peer 0x1000000000001d3: rc=0
00000800:00000200:29.0:1773851850.658294:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001d3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851850.658297:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851850.658297:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b12a23f5 refcount 2 to 12931@kfi7
00010000:00000001:29.0:1773851850.658298:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851850.658298:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.658299:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851850.658300:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007205c70f x1859597871602240/t0(0) o17->51df9d36-3edf-4909-a0db-9339591aea20@12931@kfi7:638/0 lens 456/432 e 0 to 0 dl 1773851998 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1304-0'
00000100:00100000:29.0:1773851850.658303:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007205c70f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:51df9d36-3edf-4909-a0db-9339591aea20+5:39546:x1859597871602240:12345-12931@kfi7:17:default-tuolumne1304-0 Request processed in 76us (112us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851850.658305:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12931@kfi7, seq: 364304980
00000100:00000040:29.0:1773851850.658306:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004fde6f08 : new rpc_count 0
00000100:00000001:29.0:1773851850.658307:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:30.0:1773851850.658308:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001d3 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851850.658308:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851850.658308:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851850.658309:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000020:00000010:29.0:1773851850.658310:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001d1a7a8a.
00000020:00000040:29.0:1773851850.658311:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000004fde6f08 : new refcount 4
00000400:00000200:30.0:1773851850.658312:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851850.658312:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851850.658314:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12931@kfi7: PUT: OK
00000400:00000200:30.0:1773851850.658315:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf20a357
00000400:00000010:30.0:1773851850.658315:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf20a357.
00000100:00000001:30.0:1773851850.658316:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851850.658316:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851850.658318:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000800:00000200:30.0:1773851850.658319:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 12931@kfi7(000000000cb91b25):0x0 lsk 468 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001d3 Transaction freed
00000800:00000200:5.0:1773851850.668941:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.668942:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851850.668944:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851850.668946:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851850.668949:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24417@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.668950:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24417@kfi7 : PUT - for me
00000400:00000200:5.0:1773851850.668951:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24417@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.668952:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 1
00000400:00000200:5.0:1773851850.668952:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24417@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.668953:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 2
00000400:00000200:5.0:1773851850.668954:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 3
00000400:00000200:5.0:1773851850.668955:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000400:00000200:5.0:1773851850.668955:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24480@kfi7 of length 224 into portal 12 MB=0x69b8271434740
00000400:00000200:5.0:1773851850.668957:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24480@kfi7 of length 224/224 into md 0x793926dc5 [64] + 114672
00000800:00000200:5.0:1773851850.668959:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851850.668960:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851850.668961:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24417@kfi7: PUT: OK
00000100:00000001:5.0:1773851850.668962:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851850.668963:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851850.668964:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a1ee805d.
00000100:00000040:5.0:1773851850.668964:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a1ee805d x1859834408552256 msgsize 224
00000100:00100000:5.0:1773851850.668966:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-24480@kfi7 (source: 12345-24417@kfi7)
00000100:00000001:5.0:1773851850.668967:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851850.668968:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 2
00000800:00000200:5.0:1773851850.668970:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851850.668972:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851850.668973:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851850.668973:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851850.668974:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851850.668975:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851850.668976:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859834408552256
00000020:00000001:5.0:1773851850.668976:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851850.668977:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875ee00af3
00000020:00000001:5.0:1773851850.668977:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851850.668979:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009cd0a936 refcount=210
00000020:00000001:5.0:1773851850.668979:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133105587200 : -106940603964416 : ffff9ebcf349e400)
00000020:00000001:5.0:1773851850.668980:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133105587200 : -106940603964416 : ffff9ebcf349e400)
00000100:00000001:5.0:1773851850.668981:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.668982:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851850.668983:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6b8036f.
00000020:00000010:5.0:1773851850.668984:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851850.668985:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008d4880d3.
00000100:00000001:5.0:1773851850.668985:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851850.668986:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851850.668986:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.668987:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851850.668988:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851850.668988:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.668989:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851850.668990:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851850.668990:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851850.668991:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851850.668991:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851850.668992:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24480@kfi7, seq: 2001837
00000100:00000001:7.0:1773851850.668993:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851850.668993:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.668993:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009cd0a936 : new rpc_count 8
00000100:00000001:5.0:1773851850.668993:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046240640 : -106940663310976 : ffff9ebcefc05580)
00000100:00000040:5.0:1773851850.668994:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a1ee805d x1859834408552256/t0(0) o400->0a9a84d7-3b33-4079-b892-6b1b660a69ab@24480@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2016-0'
00000100:00000001:5.0:1773851850.668997:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.668997:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851850.668998:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1ee805d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:0a9a84d7-3b33-4079-b892-6b1b660a69ab+210:39697:x1859834408552256:12345-24480@kfi7:400:default-tuolumne2016-0
00000100:00000200:5.0:1773851850.668999:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859834408552256
00000020:00000001:5.0:1773851850.669000:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851850.669000:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851850.669001:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.669002:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851850.669002:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851850.669003:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851850.669004:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859834408552256, found 0 last_xid 1859834350631359
00000020:00000001:5.0:1773851850.669005:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851850.669005:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851850.669006:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851850.669006:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.669007:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851850.669007:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851850.669008:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851850.669009:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002425f636.
02000000:00000001:5.0:1773851850.669009:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.669010:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.669010:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851850.669011:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578128, transno 0, xid 1859834408552256
00010000:00000001:5.0:1773851850.669012:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851850.669013:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a1ee805d x1859834408552256/t0(0) o400->0a9a84d7-3b33-4079-b892-6b1b660a69ab@24480@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2016-0'
00010000:00000001:5.0:1773851850.669015:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851850.669015:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851850.669016:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=82 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851850.669017:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851850.669018:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032330ec1 refcount 3 to 24480@kfi7
00000100:00000001:5.0:1773851850.669018:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994448160 : -107149715103456 : ffff9e8c434b2120)
02000000:00000001:5.0:1773851850.669019:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851850.669020:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.669020:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851850.669021:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24417@kfi7
00000400:00000010:5.0:1773851850.669022:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c5557a40.
00000100:00000200:5.0:1773851850.669022:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859834408552256, offset 224
00000400:00000200:5.0:1773851850.669024:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24417@kfi7
00000400:00000200:5.0:1773851850.669024:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24417@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.669025:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 1
00000400:00000200:5.0:1773851850.669026:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 2
00000400:00000200:5.0:1773851850.669027:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 3
00000400:00000200:5.0:1773851850.669028:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24417@kfi7 local destination
00000400:00000200:5.0:1773851850.669029:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768461:8768461:1024:4294967295] 24417@kfi7 LPNI seq info [2995987:2995987:16:4294967295]
00000400:00000200:5.0:1773851850.669031:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 2
00000400:00000200:5.0:1773851850.669031:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24417@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.669033:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24417@kfi7(24417@kfi7:24417@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851850.669035:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 3
00000800:00000200:5.0:1773851850.669036:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.669037:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851850.669039:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851850.669041:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000009e9 Using peer 24417@kfi7(0x1000000000009e9)
00000800:00000200:5.0:1773851850.669043:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x1000000000009e9: rc=0
00000800:00000200:5.0:1773851850.669045:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000009e9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851850.669047:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.669047:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032330ec1 refcount 2 to 24480@kfi7
00010000:00000001:5.0:1773851850.669048:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851850.669048:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.669049:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851850.669050:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a1ee805d x1859834408552256/t0(0) o400->0a9a84d7-3b33-4079-b892-6b1b660a69ab@24480@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2016-0'
00000100:00100000:5.0:1773851850.669052:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1ee805d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:0a9a84d7-3b33-4079-b892-6b1b660a69ab+210:39697:x1859834408552256:12345-24480@kfi7:400:default-tuolumne2016-0 Request processed in 55us (87us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851850.669055:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24480@kfi7, seq: 2001837
00000100:00000040:5.0:1773851850.669055:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009cd0a936 : new rpc_count 7
00000100:00000001:5.0:1773851850.669056:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:6.0:1773851850.669057:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000009e9 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851850.669057:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851850.669057:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851850.669058:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851850.669058:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008d4880d3.
00000400:00000200:6.0:1773851850.669059:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24417@kfi7: PUT: OK
00000020:00000010:5.0:1773851850.669059:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6b8036f.
00000400:00000200:6.0:1773851850.669060:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c5557a40
00000400:00000010:6.0:1773851850.669060:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c5557a40.
00000020:00000040:5.0:1773851850.669060:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009cd0a936 : new refcount 209
00000100:00000001:5.0:1773851850.669060:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851850.669061:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851850.669062:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851850.669063:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ffe86ab0 nid 24417@kfi7 refs 2
00000800:00000200:6.0:1773851850.669065:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 24417@kfi7(00000000c6c48005):0x0 lsk 2538 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000009e9 Transaction freed
00000800:00000200:25.0:1773851850.696185:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851850.696186:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851850.696187:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851850.696189:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851850.696191:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.696192:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851850.696193:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.696194:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851850.696195:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.696196:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851850.696196:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851850.696197:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851850.696198:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a8607f200
00000400:00000200:25.0:1773851850.696199:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 12392
00000800:00000200:25.0:1773851850.696201:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851850.696202:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851850.696203:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851850.696204:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851850.696204:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851850.696206:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d73048d7.
00000100:00000040:25.0:1773851850.696206:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000d73048d7 x1859388080386560 msgsize 224
00000100:00100000:25.0:1773851850.696208:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851850.696209:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851850.696210:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851850.696211:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851850.696212:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851850.696212:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851850.696213:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851850.696214:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851850.696215:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851850.696216:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080386560
00000020:00000001:24.0:1773851850.696217:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851850.696218:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:24.0:1773851850.696219:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851850.696220:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:24.0:1773851850.696221:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:24.0:1773851850.696223:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:24.0:1773851850.696224:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851850.696225:0:1537164:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851850.696226:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000098c1846a.
00000020:00000010:24.0:1773851850.696227:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851850.696229:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003edb2b79.
00000100:00000040:24.0:1773851850.696230:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851850.696231:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851850.696232:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851850.696233:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.696234:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851850.696236:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851850.696237:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851850.696238:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851850.696238:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851850.696238:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851850.696239:0:1691804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799978
00000100:00000040:25.0:1773851850.696240:0:1691804:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:24.0:1773851850.696240:0:1537164:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851850.696241:0:1691804:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150698752 : -106980558852864 : ffff9eb3a5caad00)
00000100:00000001:24.0:1773851850.696241:0:1537164:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851850.696243:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d73048d7 x1859388080386560/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:25.0:1773851850.696246:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851850.696246:0:1691804:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851850.696247:0:1691804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d73048d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080386560:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:25.0:1773851850.696249:0:1691804:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080386560
00000020:00000001:25.0:1773851850.696249:0:1691804:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851850.696250:0:1691804:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851850.696251:0:1691804:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851850.696252:0:1691804:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851850.696252:0:1691804:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:25.0:1773851850.696253:0:1691804:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:25.0:1773851850.696254:0:1691804:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851850.696254:0:1691804:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851850.696255:0:1691804:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851850.696255:0:1691804:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851850.696256:0:1691804:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851850.696256:0:1691804:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851850.696258:0:1691804:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000f0464aa2.
02000000:00000001:25.0:1773851850.696258:0:1691804:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851850.696259:0:1691804:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851850.696260:0:1691804:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:25.0:1773851850.696261:0:1691804:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:25.0:1773851850.696261:0:1691804:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851850.696262:0:1691804:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:25.0:1773851850.696264:0:1691804:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:25.0:1773851850.696264:0:1691804:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:25.0:1773851850.696265:0:1691804:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:25.0:1773851850.696267:0:1691804:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851850.696267:0:1691804:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080386560
00010000:00000001:25.0:1773851850.696268:0:1691804:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851850.696269:0:1691804:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d73048d7 x1859388080386560/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:577/0 lens 224/368 e 0 to 0 dl 1773851937 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:25.0:1773851850.696272:0:1691804:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851850.696272:0:1691804:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851850.696273:0:1691804:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=127 v=66 (1 1 1 1)
00000100:00000001:25.0:1773851850.696275:0:1691804:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851850.696275:0:1691804:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:25.0:1773851850.696276:0:1691804:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:25.0:1773851850.696277:0:1691804:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851850.696278:0:1691804:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851850.696278:0:1691804:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851850.696280:0:1691804:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:25.0:1773851850.696280:0:1691804:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000609f3c28.
00000100:00000200:25.0:1773851850.696281:0:1691804:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080386560, offset 224
00000400:00000200:25.0:1773851850.696282:0:1691804:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:25.0:1773851850.696283:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.696284:0:1691804:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851850.696285:0:1691804:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851850.696286:0:1691804:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851850.696287:0:1691804:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:25.0:1773851850.696289:0:1691804:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768462:8768462:1024:4294967295] 8@kfi7 LPNI seq info [17340055:17340055:16:4294967295]
00000400:00000200:25.0:1773851850.696290:0:1691804:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851850.696292:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851850.696295:0:1691804:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851850.696298:0:1691804:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:25.0:1773851850.696300:0:1691804:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851850.696302:0:1691804:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:25.0:1773851850.696306:0:1691804:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851850.696310:0:1691804:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000800:00000200:25.0:1773851850.696316:0:1691804:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 468 bytes to peer 0x200000000001191: rc=0
00000800:00000200:25.0:1773851850.696320:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851850.696324:0:1691804:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851850.696326:0:1691804:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:25.0:1773851850.696327:0:1691804:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851850.696328:0:1691804:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851850.696329:0:1691804:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851850.696330:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d73048d7 x1859388080386560/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:577/0 lens 224/368 e 0 to 0 dl 1773851937 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000800:00000200:26.0:1773851850.696332:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851850.696334:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:25.0:1773851850.696337:0:1691804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d73048d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080386560:12345-7@kfi7:41:default-yuba5-0 Request processed in 89us (129us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851850.696341:0:1691804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799978
00000100:00000040:25.0:1773851850.696343:0:1691804:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:25.0:1773851850.696345:0:1691804:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851850.696345:0:1691804:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:26.0:1773851850.696346:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000020:00000010:25.0:1773851850.696346:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:26.0:1773851850.696347:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000609f3c28
00000400:00000010:26.0:1773851850.696347:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000609f3c28.
00000100:00000001:26.0:1773851850.696348:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:25.0:1773851850.696348:0:1691804:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003edb2b79.
00000100:00000001:26.0:1773851850.696349:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851850.696349:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000020:00000010:25.0:1773851850.696350:0:1691804:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000098c1846a.
00000800:00000200:26.0:1773851850.696351:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Transaction freed
00000020:00000040:25.0:1773851850.696351:0:1691804:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:25.0:1773851850.696352:0:1691804:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851850.749123:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851850.749125:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851850.749127:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851850.749131:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851850.749134:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:3.0:1773851850.749136:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11473@kfi7 : PUT - for me
00000400:00000200:3.0:1773851850.749138:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:3.0:1773851850.749139:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 1
00000400:00000200:3.0:1773851850.749141:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:3.0:1773851850.749142:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000400:00000200:3.0:1773851850.749143:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 3
00000400:00000200:3.0:1773851850.749144:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:3.0:1773851850.749146:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11473@kfi7 of length 224 into portal 12 MB=0x69b472e7d8380
00000400:00000200:3.0:1773851850.749148:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11473@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 6216
00000800:00000200:3.0:1773851850.749151:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851850.749154:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851850.749156:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11473@kfi7: PUT: OK
00000100:00000001:3.0:1773851850.749157:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851850.749158:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851850.749159:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000165cbb0b.
00000100:00000040:3.0:1773851850.749160:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000165cbb0b x1859579885224832 msgsize 224
00000100:00100000:3.0:1773851850.749163:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-11473@kfi7 (source: 12345-11473@kfi7)
00000100:00000001:3.0:1773851850.749165:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851850.749166:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000100:00000001:1.0:1773851850.749167:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:3.0:1773851850.749168:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:1.0:1773851850.749168:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851850.749169:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851850.749170:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851850.749171:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851850.749172:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859579885224832
00000020:00000001:1.0:1773851850.749173:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851850.749174:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f5217
00000020:00000001:1.0:1773851850.749175:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851850.749177:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009272c87b refcount=5
00000020:00000001:1.0:1773851850.749179:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636964372225024 : -107109337326592 : ffff9e95a9ff1c00)
00000020:00000001:1.0:1773851850.749180:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636964372225024 : -107109337326592 : ffff9e95a9ff1c00)
00000100:00000001:1.0:1773851850.749181:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851850.749182:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851850.749183:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851850.749185:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851850.749186:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851850.749187:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851850.749188:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851850.749189:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851850.749190:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851850.749191:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851850.749192:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.749194:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851850.749196:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851850.749196:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851850.749197:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851850.749197:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851850.749198:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11473@kfi7, seq: 1997472
00000100:00000001:2.0:1773851850.749200:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851850.749200:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009272c87b : new rpc_count 1
00000100:00000001:2.0:1773851850.749201:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.749201:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288708224 : -106964420843392 : ffff9eb767b12880)
00000100:00000040:1.0:1773851850.749203:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000165cbb0b x1859579885224832/t0(0) o400->12e8f0ce-8486-4b90-a323-2801d5f5b55c@11473@kfi7:490/0 lens 224/0 e 0 to 0 dl 1773852605 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1201-0'
00000100:00000001:1.0:1773851850.749207:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851850.749208:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851850.749210:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000165cbb0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:12e8f0ce-8486-4b90-a323-2801d5f5b55c+5:39826:x1859579885224832:12345-11473@kfi7:400:default-tuolumne1201-0
00000100:00000200:1.0:1773851850.749212:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859579885224832
00000020:00000001:1.0:1773851850.749213:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851850.749214:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851850.749215:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.749216:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851850.749216:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851850.749218:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851850.749219:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859579885224832, found 0 last_xid 1859579885224831
00000020:00000001:1.0:1773851850.749220:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851850.749221:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851850.749221:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851850.749222:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.749223:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851850.749224:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851850.749225:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851850.749226:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004f5735e0.
02000000:00000001:1.0:1773851850.749227:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.749228:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.749229:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851850.749230:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254359119, transno 0, xid 1859579885224832
00010000:00000001:1.0:1773851850.749232:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851850.749233:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000165cbb0b x1859579885224832/t0(0) o400->12e8f0ce-8486-4b90-a323-2801d5f5b55c@11473@kfi7:490/0 lens 224/224 e 0 to 0 dl 1773852605 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1201-0'
00010000:00000001:1.0:1773851850.749237:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851850.749238:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851850.749239:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=83 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851850.749241:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851850.749242:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3115979 refcount 3 to 11473@kfi7
00000100:00000001:1.0:1773851850.749244:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005536 : -107146751546080 : ffff9e8cf3ef6d20)
02000000:00000001:1.0:1773851850.749245:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851850.749246:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851850.749247:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851850.749248:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11473@kfi7
00000400:00000010:1.0:1773851850.749249:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000586dc892.
00000100:00000200:1.0:1773851850.749250:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859579885224832, offset 224
00000400:00000200:1.0:1773851850.749253:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11473@kfi7
00000400:00000200:1.0:1773851850.749254:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.749255:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 1
00000400:00000200:1.0:1773851850.749257:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000400:00000200:1.0:1773851850.749259:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 3
00000400:00000200:1.0:1773851850.749261:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11473@kfi7 local destination
00000400:00000200:1.0:1773851850.749263:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768463:8768463:1024:4294967295] 11473@kfi7 LPNI seq info [8828670:8828670:16:4294967295]
00000400:00000200:1.0:1773851850.749265:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000400:00000200:1.0:1773851850.749266:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:1.0:1773851850.749270:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11473@kfi7(11473@kfi7:11473@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851850.749272:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 3
00000800:00000200:1.0:1773851850.749274:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851850.749276:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851850.749280:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851850.749286:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x761 Using peer 11473@kfi7(0x761)
00000800:00000200:1.0:1773851850.749291:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 324 bytes to peer 0x761: rc=0
00000800:00000200:1.0:1773851850.749293:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x761 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851850.749297:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851850.749298:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3115979 refcount 2 to 11473@kfi7
00010000:00000001:1.0:1773851850.749299:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851850.749300:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851850.749301:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851850.749302:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000165cbb0b x1859579885224832/t0(0) o400->12e8f0ce-8486-4b90-a323-2801d5f5b55c@11473@kfi7:490/0 lens 224/224 e 0 to 0 dl 1773852605 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1201-0'
00000100:00100000:1.0:1773851850.749307:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000165cbb0b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:12e8f0ce-8486-4b90-a323-2801d5f5b55c+5:39826:x1859579885224832:12345-11473@kfi7:400:default-tuolumne1201-0 Request processed in 98us (145us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851850.749310:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x761 TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851850.749310:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11473@kfi7, seq: 1997472
00000100:00000040:1.0:1773851850.749311:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009272c87b : new rpc_count 0
00000400:00000200:2.0:1773851850.749313:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851850.749313:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851850.749313:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851850.749314:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11473@kfi7: PUT: OK
00000020:00000010:1.0:1773851850.749314:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851850.749315:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:2.0:1773851850.749316:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000586dc892
00000400:00000010:2.0:1773851850.749317:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000586dc892.
00000020:00000010:1.0:1773851850.749317:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000100:00000001:2.0:1773851850.749318:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851850.749318:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:1.0:1773851850.749318:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000009272c87b : new refcount 4
00000100:00000001:1.0:1773851850.749319:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851850.749320:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000800:00000200:2.0:1773851850.749322:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11473@kfi7(000000009dcfb4ba):0x0 lsk 1890 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x761 Transaction freed
00000800:00000200:5.0:1773851850.769647:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.769648:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851850.769651:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851850.769654:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851850.769657:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.769659:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851850.769661:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.769662:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851850.769664:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.769665:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851850.769666:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851850.769668:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851850.769669:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c925940
00000400:00000200:5.0:1773851850.769671:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x793844545 [256] + 4496
00000800:00000200:5.0:1773851850.769675:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851850.769678:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851850.769679:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851850.769681:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851850.769682:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851850.769683:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d7a5a501.
00000100:00000040:5.0:1773851850.769684:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d7a5a501 x1858065608628544 msgsize 224
00000100:00100000:5.0:1773851850.769687:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00000100:00000001:5.0:1773851850.769689:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851850.769691:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851850.769693:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851850.769698:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851850.769699:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851850.769700:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851850.769701:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851850.769702:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851850.769703:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608628544
00000020:00000001:5.0:1773851850.769704:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851850.769705:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:5.0:1773851850.769706:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851850.769707:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:5.0:1773851850.769708:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:5.0:1773851850.769709:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:5.0:1773851850.769710:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.769711:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851850.769712:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6b8036f.
00000020:00000010:5.0:1773851850.769714:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851850.769715:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008d4880d3.
00000100:00000040:5.0:1773851850.769717:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851850.769718:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851850.769719:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851850.769720:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.769721:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.769723:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.769731:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851850.769732:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851850.769732:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851850.769733:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851850.769734:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314071
00000100:00000001:6.0:1773851850.769735:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.769735:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:5.0:1773851850.769736:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046222208 : -106940663329408 : ffff9ebcefc00d80)
00000100:00000001:6.0:1773851850.769737:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.769738:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d7a5a501 x1858065608628544/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:5.0:1773851850.769743:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.769743:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851850.769745:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7a5a501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0002-mdtlov_UUID+5:52335:x1858065608628544:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:5.0:1773851850.769749:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608628544
00000020:00000001:5.0:1773851850.769750:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851850.769751:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851850.769752:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.769753:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851850.769754:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851850.769755:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851850.769756:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851850.769757:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851850.769758:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851850.769759:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.769760:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851850.769761:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851850.769762:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000069fb2a64.
02000000:00000001:5.0:1773851850.769763:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.769764:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851850.769766:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851850.769767:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851850.769768:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851850.769770:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851850.769772:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851850.769774:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851850.769776:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608628544
00010000:00000001:5.0:1773851850.769777:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851850.769778:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d7a5a501 x1858065608628544/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:577/0 lens 224/368 e 0 to 0 dl 1773851937 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:5.0:1773851850.769782:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851850.769783:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851850.769784:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=79 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851850.769786:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851850.769787:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:5.0:1773851850.769789:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:5.0:1773851850.769790:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851850.769791:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.769792:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851850.769794:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000400:00000010:5.0:1773851850.769795:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070e61bd6.
00000100:00000200:5.0:1773851850.769796:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608628544, offset 224
00000400:00000200:5.0:1773851850.769798:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000400:00000200:5.0:1773851850.769800:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.769801:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851850.769802:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851850.769804:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851850.769806:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  30@kfi7 local destination
00000400:00000200:5.0:1773851850.769808:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768464:8768464:1024:4294967295] 30@kfi7 LPNI seq info [23133309:23133309:16:4294967295]
00000400:00000200:5.0:1773851850.769811:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851850.769812:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.769815:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851850.769817:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000800:00000200:5.0:1773851850.769819:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.769821:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851850.769824:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851850.769828:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000800:00000200:5.0:1773851850.769832:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046518b99: Posted send of 468 bytes to peer 0x2000000000000fe: rc=0
00000800:00000200:5.0:1773851850.769835:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851850.769838:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.769839:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:5.0:1773851850.769841:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851850.769841:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.769842:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851850.769844:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d7a5a501 x1858065608628544/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:577/0 lens 224/368 e 0 to 0 dl 1773851937 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000800:00000200:6.0:1773851850.769849:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851850.769849:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7a5a501 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0002-mdtlov_UUID+5:52335:x1858065608628544:12345-13@kfi7:41:default-yuba3-0 Request processed in 105us (163us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851850.769852:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:5.0:1773851850.769853:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314071
00000400:00000200:6.0:1773851850.769854:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000100:00000040:5.0:1773851850.769854:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000400:00000200:6.0:1773851850.769855:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070e61bd6
00000100:00000001:5.0:1773851850.769855:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:6.0:1773851850.769856:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070e61bd6.
00000100:00000001:5.0:1773851850.769856:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851850.769857:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00000001:6.0:1773851850.769858:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851850.769858:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:5.0:1773851850.769858:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008d4880d3.
00000020:00000010:5.0:1773851850.769859:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6b8036f.
00000400:00000200:6.0:1773851850.769860:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000020:00000040:5.0:1773851850.769861:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000800:00000200:6.0:1773851850.769862:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe Transaction freed
00000100:00000001:5.0:1773851850.769862:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851850.771020:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851850.771021:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851850.771022:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851850.771023:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851850.771025:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.771027:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9440@kfi7 : PUT - for me
00000400:00000200:17.0:1773851850.771027:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.771028:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 1
00000400:00000200:17.0:1773851850.771029:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.771029:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000400:00000200:17.0:1773851850.771030:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 3
00000400:00000200:17.0:1773851850.771031:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9248@kfi7 to cpt 1
00000400:00000200:17.0:1773851850.771032:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9248@kfi7 of length 520 into portal 12 MB=0x699e1ece81540
00000400:00000200:17.0:1773851850.771033:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9248@kfi7 of length 520/520 into md 0x6ab0181b1 [64] + 185912
00000800:00000200:17.0:1773851850.771034:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851850.771036:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851850.771037:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9440@kfi7: PUT: OK
00000100:00000001:17.0:1773851850.771037:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851850.771038:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851850.771039:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ab6ff233.
00000100:00000040:17.0:1773851850.771039:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ab6ff233 x1858045481588032 msgsize 520
00000100:00100000:17.0:1773851850.771041:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9248@kfi7 (source: 12345-9440@kfi7)
00000100:00000001:17.0:1773851850.771041:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851850.771042:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000800:00000200:17.0:1773851850.771043:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851850.771044:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851850.771045:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851850.771046:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851850.771046:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851850.771048:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851850.771049:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858045481588032
00000020:00000001:19.0:1773851850.771050:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851850.771050:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b98
00000020:00000001:19.0:1773851850.771053:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851850.771054:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029538b25 refcount=7
00000020:00000001:19.0:1773851850.771055:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628027392 : -107123081524224 : ffff9e9276c74c00)
00000020:00000001:19.0:1773851850.771056:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628027392 : -107123081524224 : ffff9e9276c74c00)
00000100:00000001:19.0:1773851850.771058:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851850.771059:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851850.771060:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072ba4afe.
00000020:00000010:19.0:1773851850.771061:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851850.771063:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050d3142f.
00000100:00000001:19.0:1773851850.771064:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851850.771065:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851850.771066:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851850.771067:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:19.0:1773851850.771069:0:60961:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@00000000ab6ff233 x1858045481588032/t0(0) o38->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1071-0'
00000100:00000001:19.0:1773851850.771073:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851850.771074:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851850.771075:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851850.771077:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851850.771077:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851850.771077:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851850.771078:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851850.771078:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9248@kfi7, seq: 2156246
00000100:00000001:19.0:1773851850.771079:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851850.771079:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000029538b25 : new rpc_count 2
00000100:00000001:19.0:1773851850.771080:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.771080:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637077795943936 : -106995913607680 : ffff9eb01293b600)
00000100:00000040:18.0:1773851850.771081:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ab6ff233 x1858045481588032/t0(0) o38->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1071-0'
00000100:00000001:18.0:1773851850.771084:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851850.771084:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851850.771085:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab6ff233 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1babdaf0-18e0-4dce-a52d-1dbe90afd35c+7:39630:x1858045481588032:12345-9248@kfi7:38:default-tuolumne1071-0
00000100:00000200:18.0:1773851850.771087:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858045481588032
00000020:00000001:18.0:1773851850.771087:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:18.0:1773851850.771088:0:61039:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:18.0:1773851850.771090:0:61039:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:18.0:1773851850.771091:0:61039:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:18.0:1773851850.771093:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851850.771093:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851850.771095:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 0000000011098c85.
02000000:00000001:18.0:1773851850.771096:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.771097:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851850.771098:0:61039:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:18.0:1773851850.771098:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 1babdaf0-18e0-4dce-a52d-1dbe90afd35c (at 9248@kfi7) reconnecting
00010000:00000001:18.0:1773851850.771099:0:61039:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:18.0:1773851850.771101:0:61039:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:18.0:1773851850.771102:0:61039:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from 1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7 t0 exp 0000000029538b25 cur 614125 last 1773851850
00010000:00000001:18.0:1773851850.771103:0:61039:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:18.0:1773851850.771104:0:61039:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:18.0:1773851850.771105:0:61039:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:18.0:1773851850.771106:0:61039:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:18.0:1773851850.771106:0:61039:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:18.0:1773851850.771108:0:61039:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:18.0:1773851850.771109:0:61039:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:18.0:1773851850.771109:0:61039:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:18.0:1773851850.771110:0:61039:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:18.0:1773851850.771111:0:61039:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.771112:0:61039:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:18.0:1773851850.771113:0:61039:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:18.0:1773851850.771114:0:61039:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 1babdaf0-18e0-4dce-a52d-1dbe90afd35c/0000000029538b25 free: 126633370845184 avail: 126633368748032
00000020:00000001:18.0:1773851850.771115:0:61039:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:18.0:1773851850.771116:0:61039:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 1babdaf0-18e0-4dce-a52d-1dbe90afd35c/0000000029538b25 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:18.0:1773851850.771117:0:61039:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:18.0:1773851850.771118:0:61039:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:18.0:1773851850.771119:0:61039:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:18.0:1773851850.771120:0:61039:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli 1babdaf0-18e0-4dce-a52d-1dbe90afd35c/0000000029538b25 ocd_grant: 1880621055 want: 2097152 left: 112130449866752
00000020:00000001:18.0:1773851850.771121:0:61039:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:18.0:1773851850.771121:0:61039:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 9248@kfi7 supports cksum type f7, return f7
00000004:00000001:18.0:1773851850.771123:0:61039:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:18.0:1773851850.771124:0:61039:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:18.0:1773851850.771125:0:61039:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:18.0:1773851850.771126:0:61039:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:18.0:1773851850.771127:0:61039:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851850.771127:0:61039:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851850.771128:0:61039:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 0000000029538b25 : new rpc_count 1
00000020:00000040:18.0:1773851850.771129:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000029538b25 : new refcount 7
00000020:00000040:18.0:1773851850.771130:0:61039:0:(genops.c:871:class_export_get()) GET export 0000000029538b25 refcount=8
00000100:00000040:18.0:1773851850.771131:0:61039:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 0000000029538b25 : new rpc_count 2
00000100:00000001:18.0:1773851850.771132:0:61039:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:18.0:1773851850.771132:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9248@kfi7 to cpt 1
00000400:00000200:18.0:1773851850.771133:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb1c5a9e nid 9248@kfi7 refs 1
00000400:00000200:18.0:1773851850.771135:0:61039:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 00000000bb1c5a9e nid 9248@kfi7 refs 2
00000400:00000200:18.0:1773851850.771136:0:61039:0:(peer.c:1555:LNetPrimaryNID()) NID 9248@kfi7 primary NID 9248@kfi7 rc 0
00000100:00000001:18.0:1773851850.771157:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851850.771157:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000243285 refcount 3 to 9248@kfi7
00000100:00000001:18.0:1773851850.771158:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704800 : -107156155846816 : ffff9e8ac3652f60)
00000100:00000001:18.0:1773851850.771159:0:61039:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636917553704800 : -107156155846816 : 0xffff9e8ac3652f60)
00000100:00000040:18.0:1773851850.771160:0:61039:0:(connection.c:133:ptlrpc_connection_get()) conn=0000000000243285 refcount 3 to 9248@kfi7
00000100:00080000:18.0:1773851850.771162:0:61039:0:(import.c:86:import_set_state_nolock()) 00000000265bdfb9 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:18.0:1773851850.771163:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000243285 refcount 2 to 9248@kfi7
00000100:00000001:18.0:1773851850.771164:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851850.771164:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000243285 refcount 3 to 9248@kfi7
00000100:00000001:18.0:1773851850.771165:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704800 : -107156155846816 : ffff9e8ac3652f60)
02000000:00000001:18.0:1773851850.771166:0:61039:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:18.0:1773851850.771167:0:61039:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:18.0:1773851850.771168:0:61039:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.771169:0:61039:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:18.0:1773851850.771170:0:61039:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:18.0:1773851850.771170:0:61039:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:18.0:1773851850.771171:0:61039:0:(import.c:86:import_set_state_nolock()) 00000000265bdfb9 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:18.0:1773851850.771172:0:61039:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:18.0:1773851850.771173:0:61039:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:18.0:1773851850.771173:0:61039:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851850.771174:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000029538b25 : new refcount 7
00000020:00000040:18.0:1773851850.771175:0:61039:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:18.0:1773851850.771176:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000243285 refcount 2 to 9248@kfi7
00010000:00000001:18.0:1773851850.771176:0:61039:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.771177:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851850.771178:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:18.0:1773851850.771178:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:18.0:1773851850.771179:0:61039:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851850.771180:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851850.771180:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851850.771180:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.771181:0:61039:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:18.0:1773851850.771182:0:61039:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:18.0:1773851850.771182:0:61039:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:18.0:1773851850.771183:0:61039:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:18.0:1773851850.771183:0:61039:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.771184:0:61039:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851850.771184:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256634619, transno 0, xid 1858045481588032
00010000:00000001:18.0:1773851850.771185:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851850.771186:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ab6ff233 x1858045481588032/t0(0) o38->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1071-0'
00010000:00000001:18.0:1773851850.771188:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851850.771189:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851850.771189:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=83 v=290 (290 214 1 1)
00000100:00001000:18.0:1773851850.771190:0:61039:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:18.0:1773851850.771192:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851850.771192:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000243285 refcount 3 to 9248@kfi7
00000100:00000001:18.0:1773851850.771193:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704800 : -107156155846816 : ffff9e8ac3652f60)
02000000:00000001:18.0:1773851850.771193:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851850.771194:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.771195:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851850.771195:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9440@kfi7
00000400:00000010:18.0:1773851850.771196:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6f9e0c1.
00000100:00000200:18.0:1773851850.771197:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858045481588032, offset 0
00000400:00000200:18.0:1773851850.771198:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9440@kfi7
00000400:00000200:18.0:1773851850.771199:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:18.0:1773851850.771200:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 1
00000400:00000200:18.0:1773851850.771200:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000400:00000200:18.0:1773851850.771201:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 3
00000400:00000200:18.0:1773851850.771202:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9440@kfi7 local destination
00000400:00000200:18.0:1773851850.771204:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768465:8768465:1024:4294967295] 9440@kfi7 LPNI seq info [9763630:9763630:16:4294967295]
00000400:00000200:18.0:1773851850.771205:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000400:00000200:18.0:1773851850.771206:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:18.0:1773851850.771207:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9440@kfi7(9440@kfi7:9440@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851850.771208:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 3
00000800:00000200:18.0:1773851850.771210:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851850.771211:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:18.0:1773851850.771213:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851850.771215:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf Using peer 9440@kfi7(0xeaf)
00000800:00000200:18.0:1773851850.771218:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000079f17c9e: Posted send of 516 bytes to peer 0xeaf: rc=0
00000800:00000200:18.0:1773851850.771219:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851850.771221:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851850.771222:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000243285 refcount 2 to 9248@kfi7
00010000:00000001:18.0:1773851850.771222:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851850.771223:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.771223:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851850.771224:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ab6ff233 x1858045481588032/t0(0) o38->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1071-0'
00000100:00100000:18.0:1773851850.771227:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab6ff233 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1babdaf0-18e0-4dce-a52d-1dbe90afd35c+7:39630:x1858045481588032:12345-9248@kfi7:38:default-tuolumne1071-0 Request processed in 142us (186us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851850.771232:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9248@kfi7, seq: 2156246
00000800:00000200:17.0:1773851850.771232:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851850.771233:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000029538b25 : new rpc_count 1
00000400:00000200:17.0:1773851850.771233:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851850.771234:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851850.771234:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851850.771234:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9440@kfi7: PUT: OK
00000020:00000010:18.0:1773851850.771235:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851850.771235:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6f9e0c1
00000400:00000010:17.0:1773851850.771235:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6f9e0c1.
00000020:00000010:18.0:1773851850.771236:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050d3142f.
00000020:00000010:18.0:1773851850.771236:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072ba4afe.
00000100:00000001:17.0:1773851850.771236:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851850.771236:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:18.0:1773851850.771237:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000029538b25 : new refcount 6
00000100:00000001:18.0:1773851850.771237:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851850.771237:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000800:00000200:17.0:1773851850.771238:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf Transaction freed
00000800:00000200:17.0:1773851850.782314:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851850.782315:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851850.782316:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 9440@kfi7(00000000851eb7fb):0x0 lsk 539 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851850.782317:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 9440@kfi7(00000000851eb7fb):0x0 lsk 539 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851850.782319:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.782320:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9440@kfi7 : PUT - for me
00000400:00000200:17.0:1773851850.782321:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.782321:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 1
00000400:00000200:17.0:1773851850.782322:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.782323:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000400:00000200:17.0:1773851850.782323:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 3
00000400:00000200:17.0:1773851850.782324:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9248@kfi7 to cpt 1
00000400:00000200:17.0:1773851850.782325:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9248@kfi7 of length 512 into portal 12 MB=0x699e1ecca8b40
00000400:00000200:17.0:1773851850.782325:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9248@kfi7 of length 512/512 into md 0x6ab0181b1 [64] + 186432
00000800:00000200:17.0:1773851850.782327:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 9440@kfi7(00000000851eb7fb):0x0 lsk 539 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851850.782328:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851850.782329:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9440@kfi7: PUT: OK
00000100:00000001:17.0:1773851850.782330:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851850.782330:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851850.782332:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc4ed428.
00000100:00000040:17.0:1773851850.782332:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000dc4ed428 x1858045479652160 msgsize 512
00000100:00100000:17.0:1773851850.782334:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9248@kfi7 (source: 12345-9440@kfi7)
00000100:00000001:17.0:1773851850.782334:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851850.782335:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000100:00000001:18.0:1773851850.782336:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851850.782336:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851850.782337:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851850.782337:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851850.782337:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 9440@kfi7(00000000851eb7fb):0x0 lsk 539 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851850.782338:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851850.782338:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858045479652160
00000020:00000001:18.0:1773851850.782339:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851850.782339:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b98
00000020:00000001:18.0:1773851850.782339:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851850.782340:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029538b25 refcount=7
00000020:00000001:18.0:1773851850.782341:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628027392 : -107123081524224 : ffff9e9276c74c00)
00000020:00000001:18.0:1773851850.782341:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628027392 : -107123081524224 : ffff9e9276c74c00)
00000100:00000001:18.0:1773851850.782342:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851850.782342:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851850.782343:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000104bdc31.
00000020:00000010:18.0:1773851850.782343:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851850.782344:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066264e32.
00000100:00000001:18.0:1773851850.782345:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851850.782345:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851850.782345:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:18.1:1773851850.782347:0:61039:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000dc4ed428 x1858045479652160/t0(0) o36->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:490/0 lens 512/0 e 0 to 0 dl 1773852605 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833021994396154880'
00000100:00080000:18.1:1773851850.782350:0:61039:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000b4cb27db x1858045479652160/t0(0) o36->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:583/0 lens 512/448 e 0 to 0 dl 1773851784 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833021994396154880'
00000100:00000001:18.0:1773851850.782353:0:61039:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:18.0:1773851850.782354:0:61039:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:18.0:1773851850.782355:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851850.782355:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851850.782356:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851850.782356:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066264e32.
00000020:00000010:18.0:1773851850.782357:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000104bdc31.
00000020:00000040:18.0:1773851850.782357:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000029538b25 : new refcount 6
00000100:00000001:18.0:1773851850.782358:0:61039:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851850.784286:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851850.784287:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851850.784288:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851850.784291:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851850.784293:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:30.0:1773851850.784294:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13219@kfi7 : PUT - for me
00000400:00000200:30.0:1773851850.784295:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:30.0:1773851850.784296:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 1
00000400:00000200:30.0:1773851850.784297:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:30.0:1773851850.784298:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000400:00000200:30.0:1773851850.784299:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 3
00000400:00000200:30.0:1773851850.784300:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13218@kfi7 to cpt 4
00000400:00000200:30.0:1773851850.784301:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13218@kfi7 of length 224 into portal 12 MB=0x699e0fdb3c640
00000400:00000200:30.0:1773851850.784303:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13218@kfi7 of length 224/224 into md 0x77fe139dd [64] + 157544
00000800:00000200:30.0:1773851850.784305:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851850.784307:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851850.784307:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13219@kfi7: PUT: OK
00000100:00000001:30.0:1773851850.784309:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851850.784309:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851850.784310:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cca2a948.
00000100:00000040:30.0:1773851850.784311:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000cca2a948 x1858041468405312 msgsize 224
00000100:00100000:30.0:1773851850.784313:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-13218@kfi7 (source: 12345-13219@kfi7)
00000100:00000001:30.0:1773851850.784314:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851850.784315:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000100:00000001:29.0:1773851850.784315:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851850.784316:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:29.0:1773851850.784316:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851850.784316:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851850.784317:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851850.784317:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851850.784318:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041468405312
00000020:00000001:29.0:1773851850.784319:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851850.784319:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b28
00000020:00000001:29.0:1773851850.784320:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851850.784323:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009ebe3c23 refcount=6
00000020:00000001:29.0:1773851850.784324:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628016128 : -107123081535488 : ffff9e9276c72000)
00000020:00000001:29.0:1773851850.784325:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628016128 : -107123081535488 : ffff9e9276c72000)
00000100:00000001:29.0:1773851850.784326:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851850.784327:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851850.784327:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001d1a7a8a.
00000020:00000010:29.0:1773851850.784328:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851850.784329:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851850.784330:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851850.784330:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851850.784331:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851850.784332:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851850.784333:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851850.784333:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.784334:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851850.784335:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851850.784336:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851850.784337:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851850.784337:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851850.784337:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13218@kfi7, seq: 2055443
00000100:00000001:31.0:1773851850.784338:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851850.784338:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009ebe3c23 : new rpc_count 1
00000100:00000001:31.0:1773851850.784339:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.784339:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000824448 : -107100708727168 : ffff9e97ac4d1680)
00000100:00000040:29.0:1773851850.784340:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cca2a948 x1858041468405312/t0(0) o400->01e626c5-180f-4eb8-9637-473270a7b169@13218@kfi7:638/0 lens 224/0 e 0 to 0 dl 1773851998 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1308-0'
00000100:00000001:29.0:1773851850.784343:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851850.784343:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851850.784344:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cca2a948 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:01e626c5-180f-4eb8-9637-473270a7b169+6:39674:x1858041468405312:12345-13218@kfi7:400:default-tuolumne1308-0
00000100:00000200:29.0:1773851850.784345:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041468405312
00000020:00000001:29.0:1773851850.784346:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851850.784347:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851850.784347:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.784348:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851850.784348:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851850.784349:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851850.784350:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041468405312, found 0 last_xid 1858041468405311
00000020:00000001:29.0:1773851850.784351:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851850.784351:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851850.784352:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851850.784353:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.784353:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851850.784354:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851850.784354:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851850.784355:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000088bd73c8.
02000000:00000001:29.0:1773851850.784356:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.784356:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.784357:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851850.784358:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693316, transno 0, xid 1858041468405312
00010000:00000001:29.0:1773851850.784359:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851850.784359:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cca2a948 x1858041468405312/t0(0) o400->01e626c5-180f-4eb8-9637-473270a7b169@13218@kfi7:638/0 lens 224/224 e 0 to 0 dl 1773851998 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1308-0'
00010000:00000001:29.0:1773851850.784362:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851850.784363:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851850.784363:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=83 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851850.784364:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851850.784365:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ead4c652 refcount 3 to 13218@kfi7
00000100:00000001:29.0:1773851850.784366:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518048 : -107156126033568 : ffff9e8ac52c1960)
02000000:00000001:29.0:1773851850.784367:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851850.784367:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851850.784368:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851850.784369:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13219@kfi7
00000400:00000010:29.0:1773851850.784369:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050b15012.
00000100:00000200:29.0:1773851850.784370:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041468405312, offset 224
00000400:00000200:29.0:1773851850.784372:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13219@kfi7
00000400:00000200:29.0:1773851850.784373:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.784373:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 1
00000400:00000200:29.0:1773851850.784374:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000400:00000200:29.0:1773851850.784376:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 3
00000400:00000200:29.0:1773851850.784377:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13219@kfi7 local destination
00000400:00000200:29.0:1773851850.784378:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768466:8768466:1024:4294967295] 13219@kfi7 LPNI seq info [5760224:5760224:16:4294967295]
00000400:00000200:29.0:1773851850.784379:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000400:00000200:29.0:1773851850.784380:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:29.0:1773851850.784382:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13219@kfi7(13219@kfi7:13219@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851850.784383:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 3
00000800:00000200:29.0:1773851850.784384:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851850.784386:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851850.784388:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851850.784390:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b14 Using peer 13219@kfi7(0x100000000000b14)
00000800:00000200:29.0:1773851850.784393:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 324 bytes to peer 0x100000000000b14: rc=0
00000800:00000200:29.0:1773851850.784394:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b14 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851850.784396:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851850.784397:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ead4c652 refcount 2 to 13218@kfi7
00010000:00000001:29.0:1773851850.784398:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851850.784398:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851850.784399:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851850.784399:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cca2a948 x1858041468405312/t0(0) o400->01e626c5-180f-4eb8-9637-473270a7b169@13218@kfi7:638/0 lens 224/224 e 0 to 0 dl 1773851998 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1308-0'
00000100:00100000:29.0:1773851850.784402:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cca2a948 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:01e626c5-180f-4eb8-9637-473270a7b169+6:39674:x1858041468405312:12345-13218@kfi7:400:default-tuolumne1308-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851850.784404:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13218@kfi7, seq: 2055443
00000100:00000040:29.0:1773851850.784405:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009ebe3c23 : new rpc_count 0
00000100:00000001:29.0:1773851850.784405:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851850.784406:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851850.784406:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000800:00000200:30.0:1773851850.784407:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b14 TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851850.784407:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000020:00000010:29.0:1773851850.784407:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001d1a7a8a.
00000020:00000040:29.0:1773851850.784408:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000009ebe3c23 : new refcount 5
00000400:00000200:30.0:1773851850.784409:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851850.784409:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851850.784410:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13219@kfi7: PUT: OK
00000400:00000200:30.0:1773851850.784411:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050b15012
00000400:00000010:30.0:1773851850.784411:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050b15012.
00000100:00000001:30.0:1773851850.784412:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851850.784412:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851850.784413:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000800:00000200:30.0:1773851850.784415:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 13219@kfi7(000000005ab4e27c):0x0 lsk 2837 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b14 Transaction freed
00000800:00000200:13.0:1773851850.800970:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851850.800971:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851850.800973:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851850.800975:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851850.800977:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9712@kfi7 to cpt 3
00000400:00000200:13.0:1773851850.800978:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9712@kfi7 : PUT - for me
00000400:00000200:13.0:1773851850.800979:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9712@kfi7 to cpt 3
00000400:00000200:13.0:1773851850.800980:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000479f4ebe nid 9712@kfi7 refs 1
00000400:00000200:13.0:1773851850.800981:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9712@kfi7 to cpt 3
00000400:00000200:13.0:1773851850.800982:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000479f4ebe nid 9712@kfi7 refs 2
00000400:00000200:13.0:1773851850.800983:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000479f4ebe nid 9712@kfi7 refs 3
00000400:00000200:13.0:1773851850.800983:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9712@kfi7 to cpt 3
00000400:00000200:13.0:1773851850.800984:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9712@kfi7 of length 224 into portal 12 MB=0x69aa079e029c0
00000400:00000200:13.0:1773851850.800986:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9712@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 10984
00000800:00000200:13.0:1773851850.800988:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851850.800990:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851850.800991:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9712@kfi7: PUT: OK
00000100:00000001:13.0:1773851850.800992:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851850.800992:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851850.800993:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000018aee3f9.
00000100:00000040:13.0:1773851850.800994:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000018aee3f9 x1858863890442688 msgsize 224
00000100:00100000:13.0:1773851850.800995:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9712@kfi7 (source: 12345-9712@kfi7)
00000100:00000001:13.0:1773851850.800996:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851850.800997:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000479f4ebe nid 9712@kfi7 refs 2
00000100:00000001:15.0:1773851850.800998:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851850.800998:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851850.800999:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851850.801000:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851850.801001:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851850.801002:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851850.801002:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890442688
00000020:00000001:15.0:1773851850.801003:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851850.801004:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a5c
00000020:00000001:15.0:1773851850.801004:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851850.801008:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000102562a3 refcount=6
00000020:00000001:15.0:1773851850.801009:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743437312 : -107128966114304 : ffff9e9118079400)
00000020:00000001:15.0:1773851850.801010:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743437312 : -107128966114304 : ffff9e9118079400)
00000100:00000001:15.0:1773851850.801011:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851850.801011:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851850.801012:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f2922694.
00000020:00000010:15.0:1773851850.801013:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851850.801014:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851850.801015:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851850.801015:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851850.801016:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851850.801017:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851850.801018:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851850.801018:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851850.801019:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851850.801021:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851850.801021:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851850.801021:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851850.801022:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9712@kfi7, seq: 2289761
00000100:00000001:14.0:1773851850.801022:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851850.801023:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000102562a3 : new rpc_count 1
00000100:00000001:14.0:1773851850.801023:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851850.801024:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197397632 : -106942512153984 : ffff9ebc818d3a80)
00000100:00000001:14.0:1773851850.801024:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851850.801025:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000018aee3f9 x1858863890442688/t0(0) o400->533fe074-1855-4dcb-8168-79a229472317@9712@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1085-0'
00000100:00000001:15.0:1773851850.801028:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851850.801029:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851850.801030:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018aee3f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:533fe074-1855-4dcb-8168-79a229472317+6:39147:x1858863890442688:12345-9712@kfi7:400:default-tuolumne1085-0
00000100:00000200:15.0:1773851850.801032:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890442688
00000020:00000001:15.0:1773851850.801033:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851850.801034:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851850.801035:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.801035:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851850.801036:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851850.801037:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851850.801037:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890442688, found 0 last_xid 1858863890442687
00000020:00000001:15.0:1773851850.801038:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851850.801039:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851850.801039:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851850.801040:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.801040:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851850.801041:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851850.801041:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851850.801042:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000592113e2.
02000000:00000001:15.0:1773851850.801043:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851850.801043:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.801044:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851850.801045:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530908, transno 0, xid 1858863890442688
00010000:00000001:15.0:1773851850.801045:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851850.801046:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000018aee3f9 x1858863890442688/t0(0) o400->533fe074-1855-4dcb-8168-79a229472317@9712@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1085-0'
00010000:00000001:15.0:1773851850.801049:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851850.801050:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851850.801050:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=83 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851850.801051:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851850.801052:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002673c990 refcount 3 to 9712@kfi7
00000100:00000001:15.0:1773851850.801053:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642470048 : -107157067081568 : ffff9e8a8d14d8a0)
02000000:00000001:15.0:1773851850.801054:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851850.801054:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851850.801055:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851850.801056:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9712@kfi7
00000400:00000010:15.0:1773851850.801056:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050bc9375.
00000100:00000200:15.0:1773851850.801058:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890442688, offset 224
00000400:00000200:15.0:1773851850.801059:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9712@kfi7
00000400:00000200:15.0:1773851850.801060:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9712@kfi7 to cpt 3
00000400:00000200:15.0:1773851850.801061:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000479f4ebe nid 9712@kfi7 refs 1
00000400:00000200:15.0:1773851850.801062:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000479f4ebe nid 9712@kfi7 refs 2
00000400:00000200:15.0:1773851850.801063:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000479f4ebe nid 9712@kfi7 refs 3
00000400:00000200:15.0:1773851850.801065:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9712@kfi7 local destination
00000400:00000200:15.0:1773851850.801066:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768467:8768467:1024:4294967295] 9712@kfi7 LPNI seq info [17521:17521:16:4294967295]
00000400:00000200:15.0:1773851850.801068:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000479f4ebe nid 9712@kfi7 refs 2
00000400:00000200:15.0:1773851850.801068:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9712@kfi7 to cpt 3
00000400:00000200:15.0:1773851850.801070:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9712@kfi7(9712@kfi7:9712@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851850.801071:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000479f4ebe nid 9712@kfi7 refs 3
00000800:00000200:15.0:1773851850.801073:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851850.801075:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851850.801077:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851850.801079:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x867 Using peer 9712@kfi7(0x867)
00000800:00000200:15.0:1773851850.801083:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x867: rc=0
00000800:00000200:15.0:1773851850.801084:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x867 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851850.801086:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851850.801087:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002673c990 refcount 2 to 9712@kfi7
00010000:00000001:15.0:1773851850.801088:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851850.801088:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.801089:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851850.801089:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000018aee3f9 x1858863890442688/t0(0) o400->533fe074-1855-4dcb-8168-79a229472317@9712@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1085-0'
00000100:00100000:15.0:1773851850.801092:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018aee3f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:533fe074-1855-4dcb-8168-79a229472317+6:39147:x1858863890442688:12345-9712@kfi7:400:default-tuolumne1085-0 Request processed in 63us (98us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851850.801095:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9712@kfi7, seq: 2289761
00000100:00000040:15.0:1773851850.801096:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000102562a3 : new rpc_count 0
00000100:00000001:15.0:1773851850.801096:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851850.801096:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x867 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851850.801097:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851850.801097:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851850.801098:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000400:00000200:13.0:1773851850.801098:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851850.801099:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f2922694.
00000400:00000200:13.0:1773851850.801099:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9712@kfi7: PUT: OK
00000020:00000040:15.0:1773851850.801100:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000102562a3 : new refcount 5
00000100:00000001:15.0:1773851850.801100:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851850.801100:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050bc9375
00000400:00000010:13.0:1773851850.801100:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050bc9375.
00000100:00000001:13.0:1773851850.801101:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851850.801101:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851850.801102:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000479f4ebe nid 9712@kfi7 refs 2
00000800:00000200:13.0:1773851850.801103:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 9712@kfi7(00000000c2e2bb05):0x0 lsk 2152 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x867 Transaction freed
00000800:00000200:17.0:1773851850.816927:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851850.816928:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851850.816930:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851850.816932:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851850.816933:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24130@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.816934:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24130@kfi7 : PUT - for me
00000400:00000200:17.0:1773851850.816935:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24130@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.816936:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366aa7f5 nid 24130@kfi7 refs 1
00000400:00000200:17.0:1773851850.816937:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24130@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.816938:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366aa7f5 nid 24130@kfi7 refs 2
00000400:00000200:17.0:1773851850.816939:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000366aa7f5 nid 24130@kfi7 refs 3
00000400:00000200:17.0:1773851850.816939:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24130@kfi7 to cpt 4
00000400:00000200:17.0:1773851850.816940:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24130@kfi7 of length 224 into portal 12 MB=0x69b466195a000
00000400:00000200:17.0:1773851850.816941:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24130@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 186944
00000800:00000200:17.0:1773851850.816943:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851850.816944:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851850.816945:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24130@kfi7: PUT: OK
00000100:00000001:17.0:1773851850.816946:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851850.816946:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851850.816947:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cb6fe2e.
00000100:00000040:17.0:1773851850.816948:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000007cb6fe2e x1859576447475712 msgsize 224
00000100:00100000:17.0:1773851850.816949:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-24130@kfi7 (source: 12345-24130@kfi7)
00000100:00000001:17.0:1773851850.816950:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:18.0:1773851850.816951:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851850.816951:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000366aa7f5 nid 24130@kfi7 refs 2
02000000:00000001:18.0:1773851850.816952:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851850.816952:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851850.816952:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851850.816953:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851850.816953:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851850.816954:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576447475712
00000020:00000001:18.0:1773851850.816955:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851850.816955:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc5571241
00000020:00000001:18.0:1773851850.816956:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851850.816957:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000034444e98 refcount=27
00000020:00000001:18.0:1773851850.816958:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105833324544 : -106967876227072 : ffff9eb699bc3000)
00000020:00000001:18.0:1773851850.816959:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105833324544 : -106967876227072 : ffff9eb699bc3000)
00000100:00000001:18.0:1773851850.816960:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851850.816961:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851850.816961:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000104bdc31.
00000020:00000010:18.0:1773851850.816962:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851850.816963:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066264e32.
00000100:00000001:18.0:1773851850.816964:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851850.816964:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851850.816965:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851850.816966:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851850.816966:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851850.816967:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.816968:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851850.816969:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851850.816969:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851850.816969:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851850.816969:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851850.816970:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24130@kfi7, seq: 2156247
00000100:00000001:19.0:1773851850.816971:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851850.816971:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000034444e98 : new rpc_count 3
00000100:00000001:19.0:1773851850.816972:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.816972:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157367936 : -106936552183680 : ffff9ebde4cb2880)
00000100:00000040:18.0:1773851850.816973:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007cb6fe2e x1859576447475712/t0(0) o400->5d0355ee-385b-4027-a549-a9f96151542e@24130@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2008-0'
00000100:00000001:18.0:1773851850.816976:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851850.816976:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851850.816977:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cb6fe2e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:5d0355ee-385b-4027-a549-a9f96151542e+27:39726:x1859576447475712:12345-24130@kfi7:400:default-tuolumne2008-0
00000100:00000200:18.0:1773851850.816978:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576447475712
00000020:00000001:18.0:1773851850.816979:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851850.816980:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851850.816980:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.816981:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851850.816981:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851850.816982:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851850.816983:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576447475712, found 0 last_xid 1859576446907263
00000020:00000001:18.0:1773851850.816984:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851850.816984:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851850.816985:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851850.816985:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.816986:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851850.816987:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851850.816987:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851850.816988:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0f8282b.
02000000:00000001:18.0:1773851850.816989:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.816990:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.816990:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851850.816991:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264505453, transno 0, xid 1859576447475712
00010000:00000001:18.0:1773851850.816992:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851850.816992:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007cb6fe2e x1859576447475712/t0(0) o400->5d0355ee-385b-4027-a549-a9f96151542e@24130@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2008-0'
00010000:00000001:18.0:1773851850.816994:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851850.816995:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851850.816996:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=83 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851850.816997:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851850.816998:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091ff2221 refcount 3 to 24130@kfi7
00000100:00000001:18.0:1773851850.816998:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518240 : -107156126033376 : ffff9e8ac52c1a20)
02000000:00000001:18.0:1773851850.816999:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851850.817000:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851850.817001:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851850.817001:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24130@kfi7
00000400:00000010:18.0:1773851850.817002:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f4a6e6ff.
00000100:00000200:18.0:1773851850.817003:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576447475712, offset 224
00000400:00000200:18.0:1773851850.817004:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24130@kfi7
00000400:00000200:18.0:1773851850.817005:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24130@kfi7 to cpt 4
00000400:00000200:18.0:1773851850.817006:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366aa7f5 nid 24130@kfi7 refs 1
00000400:00000200:18.0:1773851850.817007:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000366aa7f5 nid 24130@kfi7 refs 2
00000400:00000200:18.0:1773851850.817008:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000366aa7f5 nid 24130@kfi7 refs 3
00000400:00000200:18.0:1773851850.817009:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24130@kfi7 local destination
00000400:00000200:18.0:1773851850.817010:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768468:8768468:1024:4294967295] 24130@kfi7 LPNI seq info [1909018:1909018:16:4294967295]
00000400:00000200:18.0:1773851850.817011:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000366aa7f5 nid 24130@kfi7 refs 2
00000400:00000200:18.0:1773851850.817012:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24130@kfi7 to cpt 4
00000400:00000200:18.0:1773851850.817014:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24130@kfi7(24130@kfi7:24130@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851850.817015:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000366aa7f5 nid 24130@kfi7 refs 3
00000800:00000200:18.0:1773851850.817016:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851850.817017:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851850.817019:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851850.817022:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008fb Using peer 24130@kfi7(0x1000000000008fb)
00000800:00000200:18.0:1773851850.817025:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000582ee624: Posted send of 324 bytes to peer 0x1000000000008fb: rc=0
00000800:00000200:18.0:1773851850.817026:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008fb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851850.817028:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851850.817029:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091ff2221 refcount 2 to 24130@kfi7
00010000:00000001:18.0:1773851850.817030:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851850.817031:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851850.817032:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851850.817032:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cb6fe2e x1859576447475712/t0(0) o400->5d0355ee-385b-4027-a549-a9f96151542e@24130@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2008-0'
00000100:00100000:18.0:1773851850.817035:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cb6fe2e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:5d0355ee-385b-4027-a549-a9f96151542e+27:39726:x1859576447475712:12345-24130@kfi7:400:default-tuolumne2008-0 Request processed in 59us (87us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851850.817038:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24130@kfi7, seq: 2156247
00000100:00000040:18.0:1773851850.817038:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000034444e98 : new rpc_count 2
00000800:00000200:17.0:1773851850.817038:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008fb TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851850.817039:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851850.817039:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851850.817040:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851850.817040:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851850.817040:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24130@kfi7: PUT: OK
00000020:00000010:18.0:1773851850.817041:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066264e32.
00000020:00000010:18.0:1773851850.817041:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000104bdc31.
00000400:00000200:17.0:1773851850.817041:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f4a6e6ff
00000400:00000010:17.0:1773851850.817041:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f4a6e6ff.
00000020:00000040:18.0:1773851850.817042:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000034444e98 : new refcount 26
00000100:00000001:17.0:1773851850.817042:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851850.817042:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:18.0:1773851850.817043:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851850.817043:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000366aa7f5 nid 24130@kfi7 refs 2
00000800:00000200:17.0:1773851850.817044:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 24130@kfi7(00000000be262bd5):0x0 lsk 2300 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008fb Transaction freed
00000800:00000200:9.0:1773851850.817832:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851850.817833:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851850.817834:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851850.817837:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851850.817839:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.817841:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21409@kfi7 : PUT - for me
00000400:00000200:9.0:1773851850.817842:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.817843:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 1
00000400:00000200:9.0:1773851850.817844:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.817845:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000400:00000200:9.0:1773851850.817845:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 3
00000400:00000200:9.0:1773851850.817846:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.817847:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21409@kfi7 of length 224 into portal 12 MB=0x699e0a2a82a40
00000400:00000200:9.0:1773851850.817849:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21409@kfi7 of length 224/224 into md 0x78146ce49 [64] + 115864
00000800:00000200:9.0:1773851850.817851:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851850.817856:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.817857:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21409@kfi7: PUT: OK
00000100:00000001:9.0:1773851850.817858:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851850.817858:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851850.817859:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000006d67088.
00000100:00000040:9.0:1773851850.817860:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000006d67088 x1858039940917824 msgsize 224
00000100:00100000:9.0:1773851850.817862:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21409@kfi7 (source: 12345-21409@kfi7)
00000100:00000001:9.0:1773851850.817863:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851850.817864:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000100:00000001:8.0:1773851850.817865:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851850.817865:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851850.817866:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851850.817866:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851850.817866:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851850.817867:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851850.817868:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039940917824
00000020:00000001:8.0:1773851850.817869:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851850.817869:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92810
00000020:00000001:8.0:1773851850.817870:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851850.817872:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005c7bee10 refcount=6
00000020:00000001:8.0:1773851850.817873:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631512064 : -107123078039552 : ffff9e9276fc7800)
00000020:00000001:8.0:1773851850.817874:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631512064 : -107123078039552 : ffff9e9276fc7800)
00000100:00000001:8.0:1773851850.817875:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.817876:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851850.817876:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003ec85fa.
00000020:00000010:8.0:1773851850.817877:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.817878:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851850.817879:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851850.817880:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851850.817881:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851850.817882:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851850.817882:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851850.817883:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.817884:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851850.817885:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851850.817886:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851850.817886:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851850.817887:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851850.817887:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21409@kfi7, seq: 2130710
00000100:00000001:11.0:1773851850.817888:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.817888:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005c7bee10 : new rpc_count 1
00000100:00000001:11.0:1773851850.817889:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.817889:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792132864 : -106938917418752 : ffff9ebd57d08900)
00000100:00000040:8.0:1773851850.817890:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000006d67088 x1858039940917824/t0(0) o400->b6a4ec85-993a-4370-a7a3-3dcb162f5254@21409@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1824-0'
00000100:00000001:8.0:1773851850.817892:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.817893:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851850.817894:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006d67088 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:b6a4ec85-993a-4370-a7a3-3dcb162f5254+6:39637:x1858039940917824:12345-21409@kfi7:400:default-tuolumne1824-0
00000100:00000200:8.0:1773851850.817895:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039940917824
00000020:00000001:8.0:1773851850.817896:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851850.817897:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851850.817897:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.817898:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851850.817899:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851850.817900:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851850.817900:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039940917824, found 0 last_xid 1858039940917823
00000020:00000001:8.0:1773851850.817901:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851850.817902:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851850.817902:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851850.817903:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.817904:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851850.817904:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851850.817905:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851850.817906:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009d68b7fe.
02000000:00000001:8.0:1773851850.817906:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.817907:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.817908:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851850.817908:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183052313194, transno 0, xid 1858039940917824
00010000:00000001:8.0:1773851850.817909:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851850.817910:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000006d67088 x1858039940917824/t0(0) o400->b6a4ec85-993a-4370-a7a3-3dcb162f5254@21409@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1824-0'
00010000:00000001:8.0:1773851850.817913:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851850.817914:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851850.817914:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=83 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851850.817915:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851850.817916:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000099fd890 refcount 3 to 21409@kfi7
00000100:00000001:8.0:1773851850.817917:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134752 : -107146658416864 : ffff9e8cf97c7720)
02000000:00000001:8.0:1773851850.817918:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851850.817918:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.817919:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851850.817920:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21409@kfi7
00000400:00000010:8.0:1773851850.817920:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ce37ba88.
00000100:00000200:8.0:1773851850.817921:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039940917824, offset 224
00000400:00000200:8.0:1773851850.817923:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21409@kfi7
00000400:00000200:8.0:1773851850.817924:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.817925:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 1
00000400:00000200:8.0:1773851850.817926:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000400:00000200:8.0:1773851850.817927:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 3
00000400:00000200:8.0:1773851850.817928:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21409@kfi7 local destination
00000400:00000200:8.0:1773851850.817930:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768469:8768469:1024:4294967295] 21409@kfi7 LPNI seq info [561757:561757:16:4294967295]
00000400:00000200:8.0:1773851850.817931:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000400:00000200:8.0:1773851850.817932:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.817934:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21409@kfi7(21409@kfi7:21409@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851850.817935:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 3
00000800:00000200:8.0:1773851850.817936:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851850.817938:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851850.817942:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851850.817944:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x163 Using peer 21409@kfi7(0x163)
00000800:00000200:8.0:1773851850.817947:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x163: rc=0
00000800:00000200:8.0:1773851850.817949:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x163 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851850.817951:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.817952:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000099fd890 refcount 2 to 21409@kfi7
00010000:00000001:8.0:1773851850.817953:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851850.817953:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.817954:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851850.817955:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000006d67088 x1858039940917824/t0(0) o400->b6a4ec85-993a-4370-a7a3-3dcb162f5254@21409@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1824-0'
00000100:00100000:8.0:1773851850.817958:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006d67088 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:b6a4ec85-993a-4370-a7a3-3dcb162f5254+6:39637:x1858039940917824:12345-21409@kfi7:400:default-tuolumne1824-0 Request processed in 65us (97us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851850.817961:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21409@kfi7, seq: 2130710
00000100:00000040:8.0:1773851850.817962:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005c7bee10 : new rpc_count 0
00000100:00000001:8.0:1773851850.817963:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851850.817963:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851850.817964:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.817964:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851850.817965:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003ec85fa.
00000020:00000040:8.0:1773851850.817966:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000005c7bee10 : new refcount 5
00000100:00000001:8.0:1773851850.817967:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851850.817971:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x163 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851850.817973:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.817974:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21409@kfi7: PUT: OK
00000400:00000200:9.0:1773851850.817975:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ce37ba88
00000400:00000010:9.0:1773851850.817975:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ce37ba88.
00000100:00000001:9.0:1773851850.817976:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851850.817977:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851850.817978:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000800:00000200:9.0:1773851850.817979:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21409@kfi7(00000000e6eee237):0x0 lsk 356 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x163 Transaction freed
00000800:00000200:13.0:1773851850.850304:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851850.850305:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851850.850307:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851850.850310:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851850.850313:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:13.0:1773851850.850315:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13859@kfi7 : PUT - for me
00000400:00000200:13.0:1773851850.850317:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:13.0:1773851850.850319:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 1
00000400:00000200:13.0:1773851850.850320:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:13.0:1773851850.850321:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000400:00000200:13.0:1773851850.850323:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 3
00000400:00000200:13.0:1773851850.850324:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14051@kfi7 to cpt 6
00000400:00000200:13.0:1773851850.850325:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14051@kfi7 of length 224 into portal 12 MB=0x69b4b86704580
00000400:00000200:13.0:1773851850.850327:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14051@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 11208
00000800:00000200:13.0:1773851850.850330:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851850.850333:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851850.850334:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13859@kfi7: PUT: OK
00000100:00000001:13.0:1773851850.850336:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851850.850336:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851850.850338:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e75e0366.
00000100:00000040:13.0:1773851850.850339:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000e75e0366 x1859598540621184 msgsize 224
00000100:00100000:13.0:1773851850.850341:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14051@kfi7 (source: 12345-13859@kfi7)
00000100:00000001:13.0:1773851850.850342:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851850.850344:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000100:00000001:15.0:1773851850.850345:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851850.850346:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851850.850346:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851850.850347:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851850.850347:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851850.850348:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851850.850350:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598540621184
00000020:00000001:15.0:1773851850.850351:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851850.850351:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eb10
00000020:00000001:15.0:1773851850.850352:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851850.850357:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e334522a refcount=5
00000020:00000001:15.0:1773851850.850358:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636965671813120 : -107108037738496 : ffff9e95f7754000)
00000020:00000001:15.0:1773851850.850359:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636965671813120 : -107108037738496 : ffff9e95f7754000)
00000100:00000001:15.0:1773851850.850361:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851850.850361:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851850.850362:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f2922694.
00000020:00000010:15.0:1773851850.850364:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851850.850365:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851850.850367:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851850.850367:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851850.850368:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851850.850370:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851850.850370:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851850.850371:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851850.850372:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851850.850375:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851850.850375:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851850.850376:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851850.850376:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851850.850377:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14051@kfi7, seq: 2289762
00000100:00000040:15.0:1773851850.850378:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e334522a : new rpc_count 1
00000100:00000001:15.0:1773851850.850379:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197402240 : -106942512149376 : ffff9ebc818d4c80)
00000100:00000001:14.0:1773851850.850379:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851850.850380:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851850.850381:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e75e0366 x1859598540621184/t0(0) o400->0bdc96a4-3516-4624-9207-97e6d1e438fd@14051@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1355-0'
00000100:00000001:15.0:1773851850.850386:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851850.850387:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851850.850388:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e75e0366 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:0bdc96a4-3516-4624-9207-97e6d1e438fd+5:39532:x1859598540621184:12345-14051@kfi7:400:default-tuolumne1355-0
00000100:00000200:15.0:1773851850.850390:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598540621184
00000020:00000001:15.0:1773851850.850391:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851850.850392:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851850.850393:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.850394:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851850.850395:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851850.850396:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851850.850397:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598540621184, found 0 last_xid 1859598540621183
00000020:00000001:15.0:1773851850.850398:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851850.850399:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851850.850400:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851850.850401:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.850402:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851850.850403:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851850.850403:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851850.850404:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004498212b.
02000000:00000001:15.0:1773851850.850405:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851850.850406:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.850407:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851850.850408:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691983, transno 0, xid 1859598540621184
00010000:00000001:15.0:1773851850.850410:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851850.850411:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e75e0366 x1859598540621184/t0(0) o400->0bdc96a4-3516-4624-9207-97e6d1e438fd@14051@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1355-0'
00010000:00000001:15.0:1773851850.850420:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851850.850420:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851850.850421:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=83 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851850.850423:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851850.850424:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d98afaf0 refcount 3 to 14051@kfi7
00000100:00000001:15.0:1773851850.850425:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985418304 : -107156724133312 : ffff9e8aa185d240)
02000000:00000001:15.0:1773851850.850427:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851850.850427:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851850.850428:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851850.850430:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13859@kfi7
00000400:00000010:15.0:1773851850.850431:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000d55f9f0.
00000100:00000200:15.0:1773851850.850432:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598540621184, offset 224
00000400:00000200:15.0:1773851850.850434:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13859@kfi7
00000400:00000200:15.0:1773851850.850436:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:15.0:1773851850.850437:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 1
00000400:00000200:15.0:1773851850.850439:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000400:00000200:15.0:1773851850.850441:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 3
00000400:00000200:15.0:1773851850.850442:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13859@kfi7 local destination
00000400:00000200:15.0:1773851850.850445:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768470:8768470:1024:4294967295] 13859@kfi7 LPNI seq info [8608399:8608399:16:4294967295]
00000400:00000200:15.0:1773851850.850447:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000400:00000200:15.0:1773851850.850448:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:15.0:1773851850.850452:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13859@kfi7(13859@kfi7:13859@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851850.850454:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 3
00000800:00000200:15.0:1773851850.850456:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851850.850458:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851850.850461:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851850.850465:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000006c Using peer 13859@kfi7(0x10000000000006c)
00000800:00000200:15.0:1773851850.850473:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x10000000000006c: rc=0
00000800:00000200:15.0:1773851850.850475:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000006c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851850.850478:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851850.850480:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d98afaf0 refcount 2 to 14051@kfi7
00010000:00000001:15.0:1773851850.850481:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851850.850481:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851850.850482:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851850.850483:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e75e0366 x1859598540621184/t0(0) o400->0bdc96a4-3516-4624-9207-97e6d1e438fd@14051@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1355-0'
00000100:00100000:15.0:1773851850.850488:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e75e0366 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:0bdc96a4-3516-4624-9207-97e6d1e438fd+5:39532:x1859598540621184:12345-14051@kfi7:400:default-tuolumne1355-0 Request processed in 101us (149us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851850.850491:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000006c TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851850.850492:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14051@kfi7, seq: 2289762
00000100:00000040:15.0:1773851850.850493:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e334522a : new rpc_count 0
00000400:00000200:13.0:1773851850.850493:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851850.850494:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851850.850495:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851850.850495:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13859@kfi7: PUT: OK
00000020:00000010:15.0:1773851850.850496:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851850.850496:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000d55f9f0
00000020:00000010:15.0:1773851850.850497:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000400:00000010:13.0:1773851850.850497:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000d55f9f0.
00000020:00000010:15.0:1773851850.850498:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f2922694.
00000100:00000001:13.0:1773851850.850498:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851850.850498:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:15.0:1773851850.850499:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000e334522a : new refcount 4
00000100:00000001:15.0:1773851850.850500:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851850.850500:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000800:00000200:13.0:1773851850.850502:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 13859@kfi7(000000002bdb2107):0x0 lsk 109 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000006c Transaction freed
00010000:00000001:2.0:1773851850.889730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889730:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851850.889731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851850.889732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851850.889735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851850.889736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851850.889737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851850.889738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851850.889739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851850.889739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851850.889742:0:849257:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851850.889743:0:849257:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851850.889744:0:849257:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:21.0:1773851850.895837:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851850.895837:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851850.895839:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851850.895841:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851850.895842:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.895844:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23329@kfi7 : PUT - for me
00000400:00000200:21.0:1773851850.895844:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.895845:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 1
00000400:00000200:21.0:1773851850.895846:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.895847:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000400:00000200:21.0:1773851850.895848:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 3
00000400:00000200:21.0:1773851850.895848:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23521@kfi7 to cpt 7
00000400:00000200:21.0:1773851850.895849:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23521@kfi7 of length 224 into portal 12 MB=0x69b171abbfcc0
00000400:00000200:21.0:1773851850.895850:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23521@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 21120
00000800:00000200:21.0:1773851850.895852:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851850.895853:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851850.895854:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23329@kfi7: PUT: OK
00000100:00000001:21.0:1773851850.895855:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851850.895856:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851850.895857:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a898f0c7.
00000100:00000040:21.0:1773851850.895858:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000a898f0c7 x1859373395344576 msgsize 224
00000100:00100000:21.0:1773851850.895859:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23521@kfi7 (source: 12345-23329@kfi7)
00000100:00000001:21.0:1773851850.895860:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:22.0:1773851850.895861:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851850.895861:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
02000000:00000001:22.0:1773851850.895862:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851850.895862:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851850.895863:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851850.895864:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851850.895864:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851850.895865:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373395344576
00000020:00000001:22.0:1773851850.895866:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851850.895866:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793b05f36a
00000020:00000001:22.0:1773851850.895867:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851850.895871:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000a68feff refcount=5
00000020:00000001:22.0:1773851850.895872:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636919893070848 : -107153816480768 : ffff9e8b4ed51400)
00000020:00000001:22.0:1773851850.895873:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636919893070848 : -107153816480768 : ffff9e8b4ed51400)
00000100:00000001:22.0:1773851850.895874:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851850.895875:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851850.895876:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2b41301.
00000020:00000010:22.0:1773851850.895877:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851850.895877:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000a2aa08a.
00000100:00000001:22.0:1773851850.895878:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851850.895879:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851850.895879:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851850.895880:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851850.895881:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851850.895881:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.895882:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851850.895883:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851850.895884:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851850.895884:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851850.895884:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851850.895885:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23521@kfi7, seq: 1997915
00000100:00000001:23.0:1773851850.895886:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851850.895886:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000a68feff : new rpc_count 1
00000100:00000001:23.0:1773851850.895887:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.895887:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117326720 : -106995592224896 : ffff9eb025bb9f80)
00000100:00000040:22.0:1773851850.895888:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a898f0c7 x1859373395344576/t0(0) o400->e45b2f0a-cd0b-453c-bf17-c38836be7af6@23521@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1951-0'
00000100:00000001:22.0:1773851850.895890:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851850.895891:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851850.895891:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a898f0c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e45b2f0a-cd0b-453c-bf17-c38836be7af6+5:39687:x1859373395344576:12345-23521@kfi7:400:default-tuolumne1951-0
00000100:00000200:22.0:1773851850.895894:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373395344576
00000020:00000001:22.0:1773851850.895895:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851850.895896:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851850.895897:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.895897:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851850.895898:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851850.895899:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851850.895899:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373395344576, found 0 last_xid 1859373395344575
00000020:00000001:22.0:1773851850.895900:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851850.895901:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851850.895902:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851850.895902:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.895903:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851850.895904:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851850.895904:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851850.895905:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000537f43cb.
02000000:00000001:22.0:1773851850.895905:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.895906:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.895907:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851850.895907:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260816345, transno 0, xid 1859373395344576
00010000:00000001:22.0:1773851850.895908:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851850.895909:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a898f0c7 x1859373395344576/t0(0) o400->e45b2f0a-cd0b-453c-bf17-c38836be7af6@23521@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1951-0'
00010000:00000001:22.0:1773851850.895911:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851850.895912:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851850.895913:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=83 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851850.895914:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851850.895915:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c123457b refcount 3 to 23521@kfi7
00000100:00000001:22.0:1773851850.895915:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063552 : -107155994488064 : ffff9e8acd035300)
02000000:00000001:22.0:1773851850.895916:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851850.895917:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.895918:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851850.895918:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23329@kfi7
00000400:00000010:22.0:1773851850.895919:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005155ebc6.
00000100:00000200:22.0:1773851850.895920:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373395344576, offset 224
00000400:00000200:22.0:1773851850.895921:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23329@kfi7
00000400:00000200:22.0:1773851850.895922:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:22.0:1773851850.895923:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 1
00000400:00000200:22.0:1773851850.895924:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000400:00000200:22.0:1773851850.895925:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 3
00000400:00000200:22.0:1773851850.895926:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23329@kfi7 local destination
00000400:00000200:22.0:1773851850.895928:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768471:8768471:1024:4294967295] 23329@kfi7 LPNI seq info [7213983:7213983:16:4294967295]
00000400:00000200:22.0:1773851850.895929:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000400:00000200:22.0:1773851850.895930:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:22.0:1773851850.895932:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23329@kfi7(23329@kfi7:23329@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851850.895933:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 3
00000800:00000200:22.0:1773851850.895934:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851850.895935:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851850.895938:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851850.895940:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000104d Using peer 23329@kfi7(0x10000000000104d)
00000800:00000200:22.0:1773851850.895942:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000003e4ddf4f: Posted send of 324 bytes to peer 0x10000000000104d: rc=0
00000800:00000200:22.0:1773851850.895944:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000104d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851850.895946:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851850.895947:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c123457b refcount 2 to 23521@kfi7
00010000:00000001:22.0:1773851850.895947:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851850.895948:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851850.895948:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851850.895949:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a898f0c7 x1859373395344576/t0(0) o400->e45b2f0a-cd0b-453c-bf17-c38836be7af6@23521@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1951-0'
00000100:00100000:22.0:1773851850.895952:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a898f0c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e45b2f0a-cd0b-453c-bf17-c38836be7af6+5:39687:x1859373395344576:12345-23521@kfi7:400:default-tuolumne1951-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851850.895954:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000104d TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851850.895955:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23521@kfi7, seq: 1997915
00000100:00000040:22.0:1773851850.895955:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000a68feff : new rpc_count 0
00000400:00000200:21.0:1773851850.895955:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851850.895956:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851850.895956:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23329@kfi7: PUT: OK
00000100:00000001:22.0:1773851850.895957:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851850.895957:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851850.895957:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005155ebc6
00000400:00000010:21.0:1773851850.895957:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005155ebc6.
00000020:00000010:22.0:1773851850.895958:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000a2aa08a.
00000100:00000001:21.0:1773851850.895958:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851850.895958:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851850.895959:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2b41301.
00000400:00000200:21.0:1773851850.895959:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000020:00000040:22.0:1773851850.895960:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000000a68feff : new refcount 4
00000800:00000200:21.0:1773851850.895960:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 23329@kfi7(00000000f7cca119):0x0 lsk 4174 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000104d Transaction freed
00000100:00000001:22.0:1773851850.895961:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851850.897297:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851850.897298:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851850.897300:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851850.897302:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851850.897304:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.897305:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10641@kfi7 : PUT - for me
00000400:00000200:9.0:1773851850.897306:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.897307:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 1
00000400:00000200:9.0:1773851850.897308:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:9.0:1773851850.897309:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000400:00000200:9.0:1773851850.897310:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 3
00000400:00000200:9.0:1773851850.897311:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10576@kfi7 to cpt 3
00000400:00000200:9.0:1773851850.897312:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10576@kfi7 of length 224 into portal 12 MB=0x69aeff1336180
00000400:00000200:9.0:1773851850.897313:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10576@kfi7 of length 224/224 into md 0x78146ce49 [64] + 116088
00000800:00000200:9.0:1773851850.897315:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851850.897316:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.897317:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10641@kfi7: PUT: OK
00000100:00000001:9.0:1773851850.897318:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851850.897319:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851850.897320:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f440eb9a.
00000100:00000040:9.0:1773851850.897320:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f440eb9a x1859205194801536 msgsize 224
00000100:00100000:9.0:1773851850.897322:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10576@kfi7 (source: 12345-10641@kfi7)
00000100:00000001:9.0:1773851850.897323:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851850.897324:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000100:00000001:8.0:1773851850.897324:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851850.897325:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851850.897325:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851850.897326:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851850.897326:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851850.897327:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851850.897328:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859205194801536
00000020:00000001:8.0:1773851850.897329:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851850.897329:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92593
00000020:00000001:8.0:1773851850.897330:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851850.897332:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000033237b95 refcount=333
00000020:00000001:8.0:1773851850.897333:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630764544 : -107123078787072 : ffff9e9276f11000)
00000020:00000001:8.0:1773851850.897334:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630764544 : -107123078787072 : ffff9e9276f11000)
00000100:00000001:8.0:1773851850.897335:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.897336:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851850.897337:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003ec85fa.
00000020:00000010:8.0:1773851850.897338:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.897339:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851850.897340:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851850.897340:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851850.897341:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851850.897342:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851850.897342:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851850.897343:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.897344:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851850.897345:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851850.897345:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851850.897346:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851850.897346:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851850.897347:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10576@kfi7, seq: 2130711
00000100:00000001:11.0:1773851850.897348:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851850.897348:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.897348:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000033237b95 : new rpc_count 8
00000100:00000001:8.0:1773851850.897348:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792145536 : -106938917406080 : ffff9ebd57d0ba80)
00000100:00000040:8.0:1773851850.897350:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f440eb9a x1859205194801536/t0(0) o400->fe2fec01-85c0-4406-85a9-7671e1eaf5bb@10576@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1154-0'
00000100:00000001:8.0:1773851850.897353:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851850.897353:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851850.897354:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f440eb9a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fe2fec01-85c0-4406-85a9-7671e1eaf5bb+333:39660:x1859205194801536:12345-10576@kfi7:400:default-tuolumne1154-0
00000100:00000200:8.0:1773851850.897356:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859205194801536
00000020:00000001:8.0:1773851850.897356:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851850.897357:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851850.897358:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.897360:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851850.897360:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851850.897361:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851850.897362:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859205194801536, found 0 last_xid 1859205092801151
00000020:00000001:8.0:1773851850.897363:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851850.897363:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851850.897364:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851850.897365:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.897365:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851850.897366:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851850.897366:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851850.897367:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000690b86c3.
02000000:00000001:8.0:1773851850.897368:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.897369:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.897369:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851850.897370:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593887, transno 0, xid 1859205194801536
00010000:00000001:8.0:1773851850.897371:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851850.897372:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f440eb9a x1859205194801536/t0(0) o400->fe2fec01-85c0-4406-85a9-7671e1eaf5bb@10576@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1154-0'
00010000:00000001:8.0:1773851850.897375:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851850.897375:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851850.897376:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=83 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851850.897377:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851850.897378:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fd84902e refcount 3 to 10576@kfi7
00000100:00000001:8.0:1773851850.897379:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153280 : -107139310398336 : ffff9e8eaf765480)
02000000:00000001:8.0:1773851850.897380:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851850.897380:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851850.897381:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851850.897382:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10641@kfi7
00000400:00000010:8.0:1773851850.897383:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a36d61ab.
00000100:00000200:8.0:1773851850.897383:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859205194801536, offset 224
00000400:00000200:8.0:1773851850.897385:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10641@kfi7
00000400:00000200:8.0:1773851850.897386:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.897387:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 1
00000400:00000200:8.0:1773851850.897388:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000400:00000200:8.0:1773851850.897389:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 3
00000400:00000200:8.0:1773851850.897390:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10641@kfi7 local destination
00000400:00000200:8.0:1773851850.897392:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768472:8768472:1024:4294967295] 10641@kfi7 LPNI seq info [4421990:4421990:16:4294967295]
00000400:00000200:8.0:1773851850.897393:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000400:00000200:8.0:1773851850.897394:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:8.0:1773851850.897396:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10641@kfi7(10641@kfi7:10641@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851850.897398:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 3
00000800:00000200:8.0:1773851850.897399:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851850.897400:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851850.897402:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851850.897405:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000010ec Using peer 10641@kfi7(0x1000000000010ec)
00000800:00000200:8.0:1773851850.897408:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x1000000000010ec: rc=0
00000800:00000200:8.0:1773851850.897409:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000010ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851850.897411:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851850.897412:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fd84902e refcount 2 to 10576@kfi7
00010000:00000001:8.0:1773851850.897413:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851850.897414:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851850.897414:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851850.897415:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f440eb9a x1859205194801536/t0(0) o400->fe2fec01-85c0-4406-85a9-7671e1eaf5bb@10576@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1154-0'
00000100:00100000:8.0:1773851850.897420:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f440eb9a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fe2fec01-85c0-4406-85a9-7671e1eaf5bb+333:39660:x1859205194801536:12345-10576@kfi7:400:default-tuolumne1154-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851850.897423:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10576@kfi7, seq: 2130711
00000100:00000040:8.0:1773851850.897423:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000033237b95 : new rpc_count 7
00000100:00000001:8.0:1773851850.897425:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851850.897425:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851850.897426:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851850.897426:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851850.897427:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003ec85fa.
00000020:00000040:8.0:1773851850.897428:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000033237b95 : new refcount 332
00000100:00000001:8.0:1773851850.897429:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851850.897434:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000010ec TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851850.897435:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851850.897436:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10641@kfi7: PUT: OK
00000400:00000200:9.0:1773851850.897437:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a36d61ab
00000400:00000010:9.0:1773851850.897438:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a36d61ab.
00000100:00000001:9.0:1773851850.897438:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851850.897439:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851850.897440:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000800:00000200:9.0:1773851850.897441:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 10641@kfi7(000000006dd4b594):0x0 lsk 4333 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000010ec Transaction freed
00000800:00000200:21.0:1773851850.910600:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851850.910601:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851850.910602:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851850.910604:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851850.910605:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.910606:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9011@kfi7 : PUT - for me
00000400:00000200:21.0:1773851850.910607:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.910609:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 1
00000400:00000200:21.0:1773851850.910610:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:21.0:1773851850.910610:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000400:00000200:21.0:1773851850.910611:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 3
00000400:00000200:21.0:1773851850.910612:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9202@kfi7 to cpt 4
00000400:00000200:21.0:1773851850.910613:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9202@kfi7 of length 224 into portal 12 MB=0x69b4be4ec5340
00000400:00000200:21.0:1773851850.910614:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9202@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 21344
00000800:00000200:21.0:1773851850.910616:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851850.910617:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851850.910618:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9011@kfi7: PUT: OK
00000100:00000001:21.0:1773851850.910619:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851850.910619:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851850.910620:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a18c3dff.
00000100:00000040:21.0:1773851850.910620:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000a18c3dff x1859600125809472 msgsize 224
00000100:00100000:21.0:1773851850.910622:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9202@kfi7 (source: 12345-9011@kfi7)
00000100:00000001:21.0:1773851850.910623:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851850.910623:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000100:00000001:22.0:1773851850.910624:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851850.910625:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851850.910625:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851850.910625:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851850.910626:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851850.910626:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851850.910627:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600125809472
00000020:00000001:22.0:1773851850.910628:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851850.910628:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e71d49
00000020:00000001:22.0:1773851850.910629:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851850.910632:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000964232c4 refcount=5
00000020:00000001:22.0:1773851850.910633:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814436864 : -106911895114752 : ffff9ec3a2782c00)
00000020:00000001:22.0:1773851850.910633:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814436864 : -106911895114752 : ffff9ec3a2782c00)
00000100:00000001:22.0:1773851850.910634:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851850.910635:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851850.910636:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2b41301.
00000020:00000010:22.0:1773851850.910637:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851850.910638:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000a2aa08a.
00000100:00000001:22.0:1773851850.910639:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851850.910639:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851850.910639:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851850.910640:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851850.910641:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851850.910641:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851850.910642:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851850.910644:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851850.910644:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851850.910644:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851850.910644:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851850.910645:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9202@kfi7, seq: 1997916
00000100:00000040:23.0:1773851850.910646:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000964232c4 : new rpc_count 1
00000100:00000001:22.0:1773851850.910646:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.910647:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117338240 : -106995592213376 : ffff9eb025bbcc80)
00000100:00000001:22.0:1773851850.910647:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.910648:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a18c3dff x1859600125809472/t0(0) o400->095df23b-cfee-4b15-a8d0-940ff444150e@9202@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1049-0'
00000100:00000001:23.0:1773851850.910651:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851850.910651:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851850.910652:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a18c3dff pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:095df23b-cfee-4b15-a8d0-940ff444150e+5:39467:x1859600125809472:12345-9202@kfi7:400:default-tuolumne1049-0
00000100:00000200:23.0:1773851850.910654:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600125809472
00000020:00000001:23.0:1773851850.910654:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851850.910655:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851850.910656:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.910656:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851850.910657:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851850.910658:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851850.910658:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600125809472, found 0 last_xid 1859600125809471
00000020:00000001:23.0:1773851850.910659:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851850.910660:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851850.910660:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851850.910661:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.910662:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851850.910662:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851850.910663:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851850.910664:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d2319a97.
02000000:00000001:23.0:1773851850.910664:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.910665:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.910666:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851850.910666:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260765186, transno 0, xid 1859600125809472
00010000:00000001:23.0:1773851850.910667:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851850.910668:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a18c3dff x1859600125809472/t0(0) o400->095df23b-cfee-4b15-a8d0-940ff444150e@9202@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1049-0'
00010000:00000001:23.0:1773851850.910670:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851850.910671:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851850.910672:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=83 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851850.910673:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851850.910674:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000030f111c5 refcount 3 to 9202@kfi7
00000100:00000001:23.0:1773851850.910674:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332032 : -107155408219584 : ffff9e8aeff51240)
02000000:00000001:23.0:1773851850.910675:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851850.910676:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851850.910676:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851850.910677:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9011@kfi7
00000400:00000010:23.0:1773851850.910678:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000451cdaad.
00000100:00000200:23.0:1773851850.910679:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600125809472, offset 224
00000400:00000200:23.0:1773851850.910680:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9011@kfi7
00000400:00000200:23.0:1773851850.910681:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.910682:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 1
00000400:00000200:23.0:1773851850.910683:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000400:00000200:23.0:1773851850.910684:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 3
00000400:00000200:23.0:1773851850.910685:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9011@kfi7 local destination
00000400:00000200:23.0:1773851850.910687:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768473:8768473:1024:4294967295] 9011@kfi7 LPNI seq info [14728029:14728029:16:4294967295]
00000400:00000200:23.0:1773851850.910688:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000400:00000200:23.0:1773851850.910689:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:23.0:1773851850.910691:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9011@kfi7(9011@kfi7:9011@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851850.910692:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 3
00000800:00000200:23.0:1773851850.910693:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851850.910695:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851850.910697:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851850.910699:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c6e Using peer 9011@kfi7(0x100000000000c6e)
00000800:00000200:23.0:1773851850.910702:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x100000000000c6e: rc=0
00000800:00000200:23.0:1773851850.910704:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c6e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851850.910706:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851850.910707:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000030f111c5 refcount 2 to 9202@kfi7
00010000:00000001:23.0:1773851850.910707:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851850.910708:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851850.910708:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851850.910709:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a18c3dff x1859600125809472/t0(0) o400->095df23b-cfee-4b15-a8d0-940ff444150e@9202@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1049-0'
00000100:00100000:23.0:1773851850.910712:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a18c3dff pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:095df23b-cfee-4b15-a8d0-940ff444150e+5:39467:x1859600125809472:12345-9202@kfi7:400:default-tuolumne1049-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851850.910714:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9202@kfi7, seq: 1997916
00000800:00000200:21.0:1773851850.910714:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c6e TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851850.910715:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000964232c4 : new rpc_count 0
00000100:00000001:23.0:1773851850.910716:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851850.910716:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851850.910716:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851850.910717:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851850.910717:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9011@kfi7: PUT: OK
00000400:00000200:21.0:1773851850.910717:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000451cdaad
00000020:00000010:23.0:1773851850.910718:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000a2aa08a.
00000400:00000010:21.0:1773851850.910718:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000451cdaad.
00000100:00000001:21.0:1773851850.910718:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851850.910719:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2b41301.
00000100:00000001:21.0:1773851850.910719:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851850.910719:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000020:00000040:23.0:1773851850.910720:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000964232c4 : new refcount 4
00000100:00000001:23.0:1773851850.910720:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851850.910721:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 9011@kfi7(0000000057415bc9):0x0 lsk 3183 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c6e Transaction freed
00000800:00000200:6.0:1773851850.974782:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.974783:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851850.974784:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851850.974784:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851850.974785:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851850.974785:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851850.974787:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19762@kfi7(00000000cca9a90c):0xecf version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851850.974788:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851850.974789:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf Using peer 19762@kfi7(0x100000000000ecf)
00000400:00000200:6.0:1773851850.974790:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.974791:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19762@kfi7 : PUT - for me
00000400:00000200:5.0:1773851850.974791:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.974792:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.974793:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 1
00000800:00000200:5.0:1773851850.974793:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 38 bytes to peer 0x100000000000ecf: rc=0
00000400:00000200:6.0:1773851850.974794:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:6.0:1773851850.974795:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000800:00000200:5.0:1773851850.974795:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851850.974796:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 3
00000400:00000200:6.0:1773851850.974797:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19955@kfi7 to cpt 7
00000400:00000200:6.0:1773851850.974799:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19955@kfi7 of length 224 into portal 12 MB=0x69b4c5676d780
00000400:00000200:6.0:1773851850.974801:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19955@kfi7 of length 224/224 into md 0x793926dc5 [64] + 114896
00000800:00000200:6.0:1773851850.974803:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851850.974805:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851850.974806:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19762@kfi7: PUT: OK
00000100:00000001:6.0:1773851850.974807:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:5.0:1773851850.974807:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf TN_EVENT_TX_OK event status 0
00000100:00000200:6.0:1773851850.974808:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851850.974809:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000e612f11.
00000100:00000040:6.0:1773851850.974810:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000000e612f11 x1859602030712704 msgsize 224
00000800:00000200:5.0:1773851850.974810:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf Transaction freed
00000100:00100000:6.0:1773851850.974812:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-19955@kfi7 (source: 12345-19762@kfi7)
00000100:00000001:6.0:1773851850.974813:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851850.974814:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000100:00000001:5.0:1773851850.974814:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851850.974815:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851850.974816:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851850.974816:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851850.974816:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851850.974817:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851850.974818:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602030712704
00000020:00000001:5.0:1773851850.974819:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851850.974819:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78e59
00000020:00000001:5.0:1773851850.974820:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851850.974821:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000039a8b877 refcount=5
00000020:00000001:5.0:1773851850.974822:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126829084672 : -106946880466944 : ffff9ebb7d2e1000)
00000020:00000001:5.0:1773851850.974823:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126829084672 : -106946880466944 : ffff9ebb7d2e1000)
00000100:00000001:5.0:1773851850.974824:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.974825:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851850.974825:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6b8036f.
00000020:00000010:5.0:1773851850.974826:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851850.974827:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008d4880d3.
00000100:00000001:5.0:1773851850.974828:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851850.974829:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851850.974829:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851850.974830:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851850.974831:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851850.974831:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.974832:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851850.974834:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851850.974834:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851850.974834:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851850.974835:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851850.974836:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851850.974836:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19955@kfi7, seq: 2001838
00000100:00000040:5.0:1773851850.974836:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000039a8b877 : new rpc_count 1
00000100:00000001:7.0:1773851850.974837:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.974837:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064886921344 : -107008822630272 : ffff9ead1123a880)
00000100:00000040:5.0:1773851850.974838:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000e612f11 x1859602030712704/t0(0) o400->d7cb7640-1a0d-41eb-90cb-d58ce9a92857@19955@kfi7:577/0 lens 224/0 e 0 to 0 dl 1773851937 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1721-0'
00000100:00000001:5.0:1773851850.974841:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851850.974842:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851850.974843:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e612f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d7cb7640-1a0d-41eb-90cb-d58ce9a92857+5:39661:x1859602030712704:12345-19955@kfi7:400:default-tuolumne1721-0
00000100:00000200:5.0:1773851850.974844:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602030712704
00000020:00000001:5.0:1773851850.974845:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851850.974846:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851850.974846:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.974847:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851850.974848:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851850.974848:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851850.974849:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602030712704, found 0 last_xid 1859602030712703
00000020:00000001:5.0:1773851850.974850:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851850.974851:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851850.974851:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851850.974852:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.974852:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851850.974853:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851850.974854:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851850.974854:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c8df5e7d.
02000000:00000001:5.0:1773851850.974855:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.974856:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.974856:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851850.974857:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106926206, transno 0, xid 1859602030712704
00010000:00000001:5.0:1773851850.974858:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851850.974859:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000e612f11 x1859602030712704/t0(0) o400->d7cb7640-1a0d-41eb-90cb-d58ce9a92857@19955@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1721-0'
00010000:00000001:5.0:1773851850.974862:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851850.974862:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851850.974863:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=82 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851850.974864:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851850.974865:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008a67f331 refcount 3 to 19955@kfi7
00000100:00000001:5.0:1773851850.974865:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805120 : -107130477746496 : ffff9e90bdede6c0)
02000000:00000001:5.0:1773851850.974866:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851850.974867:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851850.974868:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851850.974869:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19762@kfi7
00000400:00000010:5.0:1773851850.974869:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d4e64133.
00000100:00000200:5.0:1773851850.974870:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602030712704, offset 224
00000400:00000200:5.0:1773851850.974872:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19762@kfi7
00000400:00000200:5.0:1773851850.974874:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.974875:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 1
00000400:00000200:5.0:1773851850.974876:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000400:00000200:5.0:1773851850.974877:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 3
00000400:00000200:5.0:1773851850.974879:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19762@kfi7 local destination
00000400:00000200:5.0:1773851850.974880:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768474:8768474:1024:4294967295] 19762@kfi7 LPNI seq info [5373237:5373237:16:4294967295]
00000400:00000200:5.0:1773851850.974882:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000400:00000200:5.0:1773851850.974883:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:5.0:1773851850.974885:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19762@kfi7(19762@kfi7:19762@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851850.974887:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 3
00000800:00000200:5.0:1773851850.974888:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851850.974889:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851850.974892:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851850.974894:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf Using peer 19762@kfi7(0x100000000000ecf)
00000800:00000200:5.0:1773851850.974897:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x100000000000ecf: rc=0
00000800:00000200:5.0:1773851850.974899:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851850.974901:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851850.974902:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008a67f331 refcount 2 to 19955@kfi7
00010000:00000001:5.0:1773851850.974903:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851850.974904:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851850.974905:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851850.974906:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000e612f11 x1859602030712704/t0(0) o400->d7cb7640-1a0d-41eb-90cb-d58ce9a92857@19955@kfi7:577/0 lens 224/224 e 0 to 0 dl 1773851937 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1721-0'
00000100:00100000:5.0:1773851850.974912:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e612f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d7cb7640-1a0d-41eb-90cb-d58ce9a92857+5:39661:x1859602030712704:12345-19955@kfi7:400:default-tuolumne1721-0 Request processed in 69us (101us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851850.974914:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851850.974917:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851850.974919:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19762@kfi7: PUT: OK
00000400:00000200:6.0:1773851850.974920:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d4e64133
00000100:00100000:5.0:1773851850.974920:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19955@kfi7, seq: 2001838
00000400:00000010:6.0:1773851850.974921:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d4e64133.
00000100:00000001:6.0:1773851850.974922:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000040:5.0:1773851850.974922:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000039a8b877 : new rpc_count 0
00000100:00000001:6.0:1773851850.974923:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851850.974923:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851850.974924:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000100:00000001:5.0:1773851850.974924:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851850.974925:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851850.974927:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 19762@kfi7(00000000cca9a90c):0x0 lsk 3792 rsk 18 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ecf Transaction freed
00000020:00000010:5.0:1773851850.974927:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008d4880d3.
00000020:00000010:5.0:1773851850.974928:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6b8036f.
00000020:00000040:5.0:1773851850.974930:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000039a8b877 : new refcount 4
00000100:00000001:5.0:1773851850.974931:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851851.016025:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851851.016026:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851851.016027:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851851.016030:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851851.016032:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.016034:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20432@kfi7 : PUT - for me
00000400:00000200:1.0:1773851851.016035:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.016036:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 1
00000400:00000200:1.0:1773851851.016037:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.016038:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000400:00000200:1.0:1773851851.016039:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 3
00000400:00000200:1.0:1773851851.016040:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20241@kfi7 to cpt 1
00000400:00000200:1.0:1773851851.016041:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20241@kfi7 of length 224 into portal 12 MB=0x69b4c2d16a6c0
00000400:00000200:1.0:1773851851.016043:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20241@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 6440
00000800:00000200:1.0:1773851851.016045:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851851.016047:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851851.016049:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20432@kfi7: PUT: OK
00000100:00000001:1.0:1773851851.016050:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851851.016050:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851851.016052:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000018508df6.
00000100:00000040:1.0:1773851851.016052:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000018508df6 x1859601336542912 msgsize 224
00000100:00100000:1.0:1773851851.016054:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-20241@kfi7 (source: 12345-20432@kfi7)
00000100:00000001:1.0:1773851851.016056:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851851.016057:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000800:00000200:1.0:1773851851.016059:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851851.016062:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851851.016063:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851851.016063:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851851.016064:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851851.016065:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851851.016066:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601336542912
00000020:00000001:1.0:1773851851.016066:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851851.016067:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7d849
00000020:00000001:1.0:1773851851.016068:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851851.016070:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029d36c25 refcount=5
00000020:00000001:1.0:1773851851.016070:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142389326848 : -106931320224768 : ffff9ebf1ca48400)
00000020:00000001:1.0:1773851851.016072:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142389326848 : -106931320224768 : ffff9ebf1ca48400)
00000100:00000001:1.0:1773851851.016073:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.016074:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851851.016075:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851851.016076:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851851.016076:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851851.016077:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851851.016078:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851851.016078:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851851.016080:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851851.016080:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851851.016080:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.016081:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851851.016083:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851851.016083:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851851.016083:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851851.016083:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851851.016084:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20241@kfi7, seq: 1997473
00000100:00000001:2.0:1773851851.016085:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851851.016085:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851851.016085:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000029d36c25 : new rpc_count 1
00000100:00000001:1.0:1773851851.016085:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085911367424 : -106987798184192 : ffff9eb1f64b3f00)
00000100:00000040:1.0:1773851851.016086:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000018508df6 x1859601336542912/t0(0) o400->c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb@20241@kfi7:491/0 lens 224/0 e 0 to 0 dl 1773852606 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1761-0'
00000100:00000001:1.0:1773851851.016089:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.016089:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851851.016090:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018508df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb+5:39438:x1859601336542912:12345-20241@kfi7:400:default-tuolumne1761-0
00000100:00000200:1.0:1773851851.016091:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601336542912
00000020:00000001:1.0:1773851851.016092:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851851.016093:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851851.016093:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.016094:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851851.016095:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851851.016095:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851851.016096:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601336542912, found 0 last_xid 1859601336542911
00000020:00000001:1.0:1773851851.016097:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851851.016098:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851851.016098:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851851.016099:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.016100:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851851.016100:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851851.016101:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851851.016101:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c2705501.
02000000:00000001:1.0:1773851851.016102:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.016103:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.016103:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851851.016104:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105131216, transno 0, xid 1859601336542912
00010000:00000001:1.0:1773851851.016105:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851851.016106:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000018508df6 x1859601336542912/t0(0) o400->c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb@20241@kfi7:491/0 lens 224/224 e 0 to 0 dl 1773852606 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1761-0'
00010000:00000001:1.0:1773851851.016108:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851851.016109:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851851.016110:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=84 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851851.016111:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851851.016111:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007fb1e49a refcount 3 to 20241@kfi7
00000100:00000001:1.0:1773851851.016112:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411232 : -107145304140384 : ffff9e8d4a3515a0)
02000000:00000001:1.0:1773851851.016113:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851851.016113:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.016114:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851851.016115:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20432@kfi7
00000400:00000010:1.0:1773851851.016115:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005510933f.
00000100:00000200:1.0:1773851851.016116:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601336542912, offset 224
00000400:00000200:1.0:1773851851.016117:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20432@kfi7
00000400:00000200:1.0:1773851851.016118:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.016119:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 1
00000400:00000200:1.0:1773851851.016120:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000400:00000200:1.0:1773851851.016121:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 3
00000400:00000200:1.0:1773851851.016122:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20432@kfi7 local destination
00000400:00000200:1.0:1773851851.016123:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768475:8768475:1024:4294967295] 20432@kfi7 LPNI seq info [10496294:10496294:16:4294967295]
00000400:00000200:1.0:1773851851.016124:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000400:00000200:1.0:1773851851.016125:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.016127:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20432@kfi7(20432@kfi7:20432@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851851.016128:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 3
00000800:00000200:1.0:1773851851.016129:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851851.016130:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851851.016132:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851851.016134:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x101d Using peer 20432@kfi7(0x101d)
00000800:00000200:1.0:1773851851.016137:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0x101d: rc=0
00000800:00000200:1.0:1773851851.016139:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x101d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851851.016141:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851851.016142:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007fb1e49a refcount 2 to 20241@kfi7
00010000:00000001:1.0:1773851851.016142:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851851.016143:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.016144:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851851.016144:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000018508df6 x1859601336542912/t0(0) o400->c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb@20241@kfi7:491/0 lens 224/224 e 0 to 0 dl 1773852606 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1761-0'
00000100:00100000:1.0:1773851851.016147:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018508df6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb+5:39438:x1859601336542912:12345-20241@kfi7:400:default-tuolumne1761-0 Request processed in 57us (94us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851851.016149:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20241@kfi7, seq: 1997473
00000100:00000040:1.0:1773851851.016150:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000029d36c25 : new rpc_count 0
00000100:00000001:1.0:1773851851.016150:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:2.0:1773851851.016151:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x101d TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851851.016151:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851851.016151:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851851.016152:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:2.0:1773851851.016153:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851851.016153:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000400:00000200:2.0:1773851851.016154:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20432@kfi7: PUT: OK
00000020:00000040:1.0:1773851851.016154:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000029d36c25 : new refcount 4
00000100:00000001:1.0:1773851851.016154:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851851.016155:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005510933f
00000400:00000010:2.0:1773851851.016155:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005510933f.
00000100:00000001:2.0:1773851851.016156:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851851.016157:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851851.016158:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000800:00000200:2.0:1773851851.016159:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 20432@kfi7(0000000093067b86):0x0 lsk 4126 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x101d Transaction freed
00000800:00000200:21.0:1773851851.022878:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851851.022879:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851851.022880:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851851.022882:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851851.022884:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.022885:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:21.0:1773851851.022886:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.022887:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:21.0:1773851851.022888:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.022888:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:21.0:1773851851.022889:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:21.0:1773851851.022890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851851.022890:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee00f80
00000400:00000200:21.0:1773851851.022892:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 6536
00000800:00000200:21.0:1773851851.022893:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851851.022895:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851851.022896:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000001:21.0:1773851851.022897:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851851.022897:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851851.022898:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c37f60e2.
00000100:00000040:21.0:1773851851.022898:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c37f60e2 x1858059204824960 msgsize 224
00000100:00100000:21.0:1773851851.022900:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2081@kfi7)
00000100:00000001:21.0:1773851851.022901:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851851.022902:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:22.0:1773851851.022903:0:1537183:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851851.022903:0:1537183:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851851.022903:0:1537183:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851851.022903:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851851.022904:0:1537183:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851851.022905:0:1537183:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851851.022906:0:1537183:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204824960
00000020:00000001:22.0:1773851851.022906:0:1537183:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851851.022907:0:1537183:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:22.0:1773851851.022907:0:1537183:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851851.022908:0:1537183:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:22.0:1773851851.022909:0:1537183:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:22.0:1773851851.022910:0:1537183:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:22.0:1773851851.022911:0:1537183:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851851.022912:0:1537183:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851851.022912:0:1537183:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000247a55a4.
00000020:00000010:22.0:1773851851.022913:0:1537183:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851851.022914:0:1537183:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030b42b18.
00000100:00000040:22.0:1773851851.022915:0:1537183:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:22.0:1773851851.022916:0:1537183:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851851.022917:0:1537183:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851851.022917:0:1537183:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851851.022918:0:1537183:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851851.022919:0:1537183:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851851.022920:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851851.022921:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851851.022921:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:22.0:1773851851.022922:0:1537183:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 3084757
00000100:00000040:22.0:1773851851.022922:0:1537183:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:22.0:1773851851.022923:0:1537183:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117322112 : -106995592229504 : ffff9eb025bb8d80)
00000100:00000001:20.0:1773851851.022923:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851851.022923:0:1537152:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851851.022924:0:1537183:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c37f60e2 x1858059204824960/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:20.0:1773851851.022924:0:1537152:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851851.022930:0:1537183:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851851.022931:0:1537183:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851851.022931:0:1537183:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c37f60e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_028:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204824960:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:22.0:1773851851.022933:0:1537183:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204824960
00000020:00000001:22.0:1773851851.022934:0:1537183:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851851.022934:0:1537183:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851851.022935:0:1537183:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851851.022936:0:1537183:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851851.022936:0:1537183:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:22.0:1773851851.022937:0:1537183:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:22.0:1773851851.022938:0:1537183:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851851.022938:0:1537183:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851851.022939:0:1537183:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851851.022940:0:1537183:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851851.022940:0:1537183:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851851.022941:0:1537183:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851851.022941:0:1537183:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000c7d51791.
02000000:00000001:22.0:1773851851.022942:0:1537183:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851851.022943:0:1537183:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:22.0:1773851851.022944:0:1537183:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:22.0:1773851851.022945:0:1537183:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:22.0:1773851851.022946:0:1537183:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:22.0:1773851851.022947:0:1537183:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:22.0:1773851851.022948:0:1537183:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:22.0:1773851851.022950:0:1537183:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851851.022950:0:1537183:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204824960
00010000:00000001:22.0:1773851851.022951:0:1537183:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851851.022952:0:1537183:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c37f60e2 x1858059204824960/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:578/0 lens 224/368 e 0 to 0 dl 1773851938 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:22.0:1773851851.022955:0:1537183:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851851.022955:0:1537183:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851851.022956:0:1537183:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=75 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851851.022957:0:1537183:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851851.022958:0:1537183:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:22.0:1773851851.022959:0:1537183:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:22.0:1773851851.022960:0:1537183:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851851.022961:0:1537183:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851851.022961:0:1537183:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851851.022962:0:1537183:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2081@kfi7
00000400:00000010:22.0:1773851851.022963:0:1537183:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ba66170e.
00000100:00000200:22.0:1773851851.022964:0:1537183:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204824960, offset 224
00000400:00000200:22.0:1773851851.022965:0:1537183:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2081@kfi7
00000400:00000200:22.0:1773851851.022966:0:1537183:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851851.022967:0:1537183:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:22.0:1773851851.022968:0:1537183:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:22.0:1773851851.022969:0:1537183:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:22.0:1773851851.022970:0:1537183:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2081@kfi7 local destination
00000400:00000200:22.0:1773851851.022971:0:1537183:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768476:8768476:1024:4294967295] 2081@kfi7 LPNI seq info [23425160:23425160:16:4294967295]
00000400:00000200:22.0:1773851851.022973:0:1537183:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:22.0:1773851851.022974:0:1537183:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851851.022976:0:1537183:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2081@kfi7(2081@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851851.022977:0:1537183:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000800:00000200:22.0:1773851851.022978:0:1537183:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851851.022980:0:1537183:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:22.0:1773851851.022982:0:1537183:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851851.022984:0:1537183:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 Using peer 2081@kfi7(0x270)
00000800:00000200:22.0:1773851851.022987:0:1537183:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003e4ddf4f: Posted send of 468 bytes to peer 0x270: rc=0
00000800:00000200:22.0:1773851851.022989:0:1537183:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851851.022991:0:1537183:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851851.022992:0:1537183:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:22.0:1773851851.022992:0:1537183:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851851.022993:0:1537183:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851851.022993:0:1537183:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851851.022994:0:1537183:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c37f60e2 x1858059204824960/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:578/0 lens 224/368 e 0 to 0 dl 1773851938 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:22.0:1773851851.022997:0:1537183:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c37f60e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_028:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204824960:12345-2074@kfi7:41:default-yuba4-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851851.022999:0:1537183:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 3084757
00000800:00000200:21.0:1773851851.022999:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 TN_EVENT_TX_OK event status 0
00000100:00000040:22.0:1773851851.023000:0:1537183:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000400:00000200:21.0:1773851851.023000:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851851.023001:0:1537183:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851851.023001:0:1537183:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851851.023001:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000020:00000010:22.0:1773851851.023002:0:1537183:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851851.023002:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ba66170e
00000400:00000010:21.0:1773851851.023002:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ba66170e.
00000020:00000010:22.0:1773851851.023003:0:1537183:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030b42b18.
00000100:00000001:21.0:1773851851.023003:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851851.023003:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851851.023004:0:1537183:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000247a55a4.
00000020:00000040:22.0:1773851851.023004:0:1537183:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000400:00000200:21.0:1773851851.023004:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:22.0:1773851851.023005:0:1537183:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851851.023005:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 Transaction freed
00000004:00000001:7.0:1773851851.081730:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851851.081731:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851851.081732:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000139092c2.
00000020:00000040:7.0:1773851851.081733:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851851.081734:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851851.081734:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851851.081735:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851851.081736:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006f706ecc.
00000100:00000001:7.0:1773851851.081737:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.081738:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851851.081739:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851851.081740:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000139092c2] to pc [ptlrpcd_01_03+3]  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851851.081744:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851851.081744:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:7.0:1773851851.081745:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000aafb7691.
00080000:00000001:7.0:1773851851.081745:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637112209348608 : -106961500203008 : ffff9eb815c69800)
00000100:00000001:5.0:1773851851.081745:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851851.081745:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851851.081745:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:7.0:1773851851.081746:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851851.081746:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851851.081746:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851851.081748:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:7.0:1773851851.081748:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000004:00000010:7.0:1773851851.081749:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000042a806c8.
00000004:00080000:7.0:1773851851.081750:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614125535025268ns, next at 614126535024226ns, rc = 0
00080000:00000001:7.0:1773851851.081751:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:7.0:1773851851.081752:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851851.081752:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851851.081753:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851851.081753:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851851.081754:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851851.081754:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851851.081755:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000139092c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051921664:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851851.081757:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851851.081757:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851851.081758:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851851.081759:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851851.081759:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008c84125c.
02000000:00000001:4.0:1773851851.081760:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851851.081761:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:4.0:1773851851.081762:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000400:00000010:4.0:1773851851.081763:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:4.0:1773851851.081764:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921664, portal 4
00000100:00000001:4.0:1773851851.081765:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851851.081765:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309128192 : -106994400423424 : ffff9eb06cc51200)
00000100:00000040:4.0:1773851851.081766:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851851.081769:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851851.081770:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851851.081770:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000645e16b0.
00000100:00000200:4.0:1773851851.081771:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921664, offset 0
00000400:00000200:4.0:1773851851.081772:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851851.081773:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851851.081775:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851851.081776:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851851.081777:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851851.081778:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851851.081780:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768476, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768474, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851851.081782:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851851.081783:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851851.081783:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851851.081784:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768477:8768477:1024:4294967295] 2099@kfi7 LPNI seq info [5403427:5403427:16:4294967295]
00000400:00000200:4.0:1773851851.081786:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851851.081786:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851851.081789:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851851.081790:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851851.081792:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851851.081793:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851851.081795:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851851.081798:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Using peer 2099@kfi7(0x2000000000002c4)
00000800:00000200:4.0:1773851851.081801:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x2000000000002c4: rc=0
00000800:00000200:4.0:1773851851.081802:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851851.081804:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851851.081805:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851851.081805:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851851.081806:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851851.081806:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851851.081809:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851851.081809:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851851.081810:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851851.081810:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851851.081814:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851851.081814:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851851.081815:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851851.081816:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851851.081818:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851851.081819:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000645e16b0
00000400:00000010:5.0:1773851851.081819:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000645e16b0.
00000100:00000001:5.0:1773851851.081820:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851851.081821:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851851.081824:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851851.081825:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851851.081827:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.081828:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851851.081829:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851851.081830:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Transaction freed
00000800:00000200:17.0:1773851851.081846:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851851.081847:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851851.081848:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851851.081849:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851851.081851:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.081852:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851851.081853:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.081854:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851851.081855:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.081855:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851851.081856:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851851.081857:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.081858:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1d00
00000400:00000200:17.0:1773851851.081859:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.081860:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f0451 [1] + 224
00000800:00000200:17.0:1773851851.081862:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851851.081863:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851851.081864:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851851.081865:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851851.081866:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851851.081870:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851851.081876:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851851.081877:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851851.081878:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851851.081878:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851851.081879:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851851.081879:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851851.081880:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851851.081881:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851851.081881:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851851.081882:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:4.0:1773851851.081883:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851851.081884:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851851.081887:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851851.081890:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851851.081890:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851851.081891:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851851.081891:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851851.081892:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851851.081892:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851851.081893:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851851.081894:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=84 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851851.081895:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=84 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851851.081897:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851851.081897:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851851.081898:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851851.081899:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851851.081899:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851851.081900:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851851.081901:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851851.081901:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851851.081902:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851851.081905:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851851.081905:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851851.081906:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851851.081907:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851851.081907:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851851.081908:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409079296 avail=351406989312 avail_mb=1372683552 hwm_mb=3131101 files=372011357 ffree=343172929 state=0: rc = 0
00000004:00000020:4.0:1773851851.081910:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409079296 free, 351406989312 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011357 files, 343172929 free files
00000004:00000001:4.0:1773851851.081912:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851851.081914:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851851.081917:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000139092c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051921664:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851851.081918:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851851.081919:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851851.081919:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000139092c2 x1859433051921664/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851851.081922:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851851.081922:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851851.081923:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008c84125c.
02000000:00000001:4.0:1773851851.081924:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851851.081924:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851851.081925:0:41067:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851851.081925:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851851.081926:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006f706ecc.
02000000:00000001:4.0:1773851851.081927:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851851.081927:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851851.081927:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000139092c2.
00000100:00000001:4.0:1773851851.081928:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851851.081929:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851851.081929:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851851.081930:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851851.081930:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851851.081931:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851851.081931:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851851.122600:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851851.122601:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851851.122602:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851851.122603:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851851.122605:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.122607:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.103@tcp : PUT - for me
00000400:00000200:17.0:1773851851.122608:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.122608:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851851.122609:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.103@tcp to cpt 3
00000400:00000200:17.0:1773851851.122611:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002abde94d nid 172.16.70.103@tcp refs 2
00000400:00000200:17.0:1773851851.122612:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002abde94d nid 172.16.70.103@tcp refs 3
00000400:00000200:17.0:1773851851.122613:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.103@tcp to cpt 3
00000400:00000200:17.0:1773851851.122613:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.103@tcp of length 224 into portal 12 MB=0x69a13d8518b80
00000400:00000200:17.0:1773851851.122615:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.103@tcp of length 224/224 into md 0x82a36e8ed [64] + 11432
00000800:00000200:17.0:1773851851.122617:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851851.122618:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851851.122619:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851851.122620:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851851.122620:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851851.122622:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000078529167.
00000100:00000040:17.0:1773851851.122622:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000078529167 x1858259884542848 msgsize 224
00000100:00100000:17.0:1773851851.122624:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.103@tcp (source: 12345-172.16.70.103@tcp)
00000100:00000001:17.0:1773851851.122626:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851851.122627:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851851.122628:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851851.122628:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851851.122629:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851851.122630:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851851.122630:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851851.122631:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851851.122632:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858259884542848
00000020:00000001:15.0:1773851851.122632:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851851.122633:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9304b
00000020:00000001:15.0:1773851851.122633:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851851.122635:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071f0a341 refcount=6
00000020:00000001:15.0:1773851851.122636:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745139200 : -107128964412416 : ffff9e9118218c00)
00000020:00000001:15.0:1773851851.122637:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745139200 : -107128964412416 : ffff9e9118218c00)
00000100:00000001:15.0:1773851851.122638:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851851.122639:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851851.122640:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f2922694.
00000020:00000010:15.0:1773851851.122641:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851851.122642:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851851.122643:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851851.122643:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851851.122644:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851851.122644:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851851.122645:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851851.122645:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.122646:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851851.122648:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851851.122648:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851851.122648:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851851.122649:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851851.122650:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.103@tcp, seq: 2289763
00000100:00000040:15.0:1773851851.122650:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071f0a341 : new rpc_count 1
00000100:00000001:14.0:1773851851.122650:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.122651:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636951520135168 : -107122189416448 : ffff9e92abf3c800)
00000100:00000001:14.0:1773851851.122651:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851851.122653:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000078529167 x1858259884542848/t0(0) o400->9597e36b-de2b-415a-a471-4504ee58a17f@172.16.70.103@tcp:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic3-0'
00000100:00000001:15.0:1773851851.122656:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851851.122656:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851851.122657:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078529167 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9597e36b-de2b-415a-a471-4504ee58a17f+6:53029:x1858259884542848:12345-172.16.70.103@tcp:400:login-rzslic3-0
00000100:00000200:15.0:1773851851.122658:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858259884542848
00000020:00000001:15.0:1773851851.122659:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851851.122660:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851851.122660:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.122661:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851851.122661:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851851.122662:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851851.122663:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858259884542848, found 0 last_xid 1858259884542847
00000020:00000001:15.0:1773851851.122664:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851851.122664:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851851.122665:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851851.122665:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.122666:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851851.122666:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851851.122667:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851851.122667:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ca7088d2.
02000000:00000001:15.0:1773851851.122668:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.122669:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.122669:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851851.122670:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 172876228056, transno 0, xid 1858259884542848
00010000:00000001:15.0:1773851851.122671:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851851.122671:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000078529167 x1858259884542848/t0(0) o400->9597e36b-de2b-415a-a471-4504ee58a17f@172.16.70.103@tcp:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic3-0'
00010000:00000001:15.0:1773851851.122673:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851851.122674:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851851.122675:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=84 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851851.122676:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851851.122676:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e5463af2 refcount 3 to 172.16.70.103@tcp
00000100:00000001:15.0:1773851851.122677:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150112 : -107154898401504 : ffff9e8b0e584720)
02000000:00000001:15.0:1773851851.122678:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851851.122678:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.122679:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851851.122680:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.103@tcp
00000400:00000010:15.0:1773851851.122681:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edce5c74.
00000100:00000200:15.0:1773851851.122681:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858259884542848, offset 224
00000400:00000200:15.0:1773851851.122683:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.103@tcp
00000400:00000200:15.0:1773851851.122684:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.103@tcp to cpt 3
00000400:00000200:15.0:1773851851.122686:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002abde94d nid 172.16.70.103@tcp refs 2
00000400:00000200:15.0:1773851851.122687:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002abde94d nid 172.16.70.103@tcp refs 3
00000400:00000200:15.0:1773851851.122688:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002abde94d nid 172.16.70.103@tcp refs 4
00000400:00000200:15.0:1773851851.122689:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.103@tcp routed destination
00000400:00000200:15.0:1773851851.122691:0:60487:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851851.122692:0:60487:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:15.0:1773851851.122693:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.103@tcp: rtr pref emtpy: 1
00000400:00000200:15.0:1773851851.122695:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851851.122696:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.103@tcp: rtr pref emtpy: 1
00000400:00000200:15.0:1773851851.122696:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851851.122697:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768478:8768478:1024:4294967295] 17@kfi7 LPNI seq info [1250891880:1250891880:16:4294967295]
00000400:00000200:15.0:1773851851.122699:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:15.0:1773851851.122700:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:15.0:1773851851.122702:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.103@tcp(172.16.70.103@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851851.122703:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002abde94d nid 172.16.70.103@tcp refs 3
00000800:00000200:15.0:1773851851.122705:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851851.122706:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851851.122709:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851851.122711:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:15.0:1773851851.122714:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:15.0:1773851851.122715:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851851.122717:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851851.122718:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e5463af2 refcount 2 to 172.16.70.103@tcp
00010000:00000001:15.0:1773851851.122719:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851851.122719:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.122720:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851851.122720:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000078529167 x1858259884542848/t0(0) o400->9597e36b-de2b-415a-a471-4504ee58a17f@172.16.70.103@tcp:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic3-0'
00000100:00100000:15.0:1773851851.122723:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078529167 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9597e36b-de2b-415a-a471-4504ee58a17f+6:53029:x1858259884542848:12345-172.16.70.103@tcp:400:login-rzslic3-0 Request processed in 67us (100us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851851.122732:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.103@tcp, seq: 2289763
00000100:00000040:15.0:1773851851.122732:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071f0a341 : new rpc_count 0
00000800:00000200:14.0:1773851851.122732:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851851.122733:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851851.122734:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851851.122734:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:14.0:1773851851.122734:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851851.122735:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000020:00000010:15.0:1773851851.122735:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f2922694.
00000400:00000200:14.0:1773851851.122735:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000040:15.0:1773851851.122736:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000071f0a341 : new refcount 5
00000400:00000200:14.0:1773851851.122736:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edce5c74
00000100:00000001:15.0:1773851851.122737:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:14.0:1773851851.122737:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edce5c74.
00000100:00000001:14.0:1773851851.122738:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851851.122738:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851851.122739:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:14.0:1773851851.122741:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000800:00000200:3.0:1773851851.153267:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851851.153268:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851851.153269:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851851.153271:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851851.153273:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:3.0:1773851851.153274:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18683@kfi7 : PUT - for me
00000400:00000200:3.0:1773851851.153275:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:3.0:1773851851.153276:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 1
00000400:00000200:3.0:1773851851.153277:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:3.0:1773851851.153277:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:3.0:1773851851.153278:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000400:00000200:3.0:1773851851.153279:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:3.0:1773851851.153280:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18682@kfi7 of length 224 into portal 12 MB=0x699dedbdb5cc0
00000400:00000200:3.0:1773851851.153281:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18682@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 6664
00000800:00000200:3.0:1773851851.153282:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851851.153284:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851851.153285:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18683@kfi7: PUT: OK
00000100:00000001:3.0:1773851851.153286:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851851.153286:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851851.153287:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aaa38a11.
00000100:00000040:3.0:1773851851.153288:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000aaa38a11 x1858032310639808 msgsize 224
00000100:00100000:3.0:1773851851.153289:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-18682@kfi7 (source: 12345-18683@kfi7)
00000100:00000001:3.0:1773851851.153290:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851851.153290:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000100:00000001:1.0:1773851851.153291:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:3.0:1773851851.153292:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:1.0:1773851851.153292:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851851.153292:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851851.153293:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851851.153293:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851851.153294:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858032310639808
00000020:00000001:1.0:1773851851.153295:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851851.153295:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912df
00000020:00000001:1.0:1773851851.153296:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851851.153297:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bf31ffe refcount=6
00000020:00000001:1.0:1773851851.153298:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716189184 : -107155993362432 : ffff9e8acd148000)
00000020:00000001:1.0:1773851851.153299:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716189184 : -107155993362432 : ffff9e8acd148000)
00000100:00000001:1.0:1773851851.153300:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.153300:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851851.153301:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092010b2a.
00000020:00000010:1.0:1773851851.153302:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851851.153303:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851851.153304:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851851.153304:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851851.153305:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851851.153305:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851851.153306:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851851.153306:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.153307:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851851.153308:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851851.153309:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851851.153309:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851851.153309:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851851.153310:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18682@kfi7, seq: 1997474
00000100:00000001:2.0:1773851851.153311:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851851.153311:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851851.153311:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bf31ffe : new rpc_count 1
00000100:00000001:1.0:1773851851.153311:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288702464 : -106964420849152 : ffff9eb767b11200)
00000100:00000040:1.0:1773851851.153312:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aaa38a11 x1858032310639808/t0(0) o400->ab453a19-f80c-4fd4-8fd5-40b713ca1db7@18682@kfi7:491/0 lens 224/0 e 0 to 0 dl 1773852606 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne241-0'
00000100:00000001:1.0:1773851851.153315:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.153315:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851851.153316:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aaa38a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ab453a19-f80c-4fd4-8fd5-40b713ca1db7+6:47638:x1858032310639808:12345-18682@kfi7:400:default-tuolumne241-0
00000100:00000200:1.0:1773851851.153318:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858032310639808
00000020:00000001:1.0:1773851851.153319:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851851.153319:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851851.153320:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.153321:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851851.153321:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851851.153322:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851851.153323:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858032310639808, found 0 last_xid 1858032310639807
00000020:00000001:1.0:1773851851.153323:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851851.153324:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851851.153324:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851851.153325:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.153326:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851851.153326:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851851.153327:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851851.153327:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001adf5560.
02000000:00000001:1.0:1773851851.153328:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.153328:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.153329:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851851.153330:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858032310639808
00010000:00000001:1.0:1773851851.153330:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851851.153331:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aaa38a11 x1858032310639808/t0(0) o400->ab453a19-f80c-4fd4-8fd5-40b713ca1db7@18682@kfi7:491/0 lens 224/224 e 0 to 0 dl 1773852606 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne241-0'
00010000:00000001:1.0:1773851851.153333:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851851.153334:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851851.153335:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=84 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851851.153336:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851851.153337:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b964497e refcount 5 to 18682@kfi7
00000100:00000001:1.0:1773851851.153337:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109952 : -107156354441664 : ffff9e8ab78ede40)
02000000:00000001:1.0:1773851851.153338:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851851.153339:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.153339:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851851.153340:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18683@kfi7
00000400:00000010:1.0:1773851851.153341:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe46cc14.
00000100:00000200:1.0:1773851851.153342:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858032310639808, offset 224
00000400:00000200:1.0:1773851851.153343:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18683@kfi7
00000400:00000200:1.0:1773851851.153344:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.153344:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 1
00000400:00000200:1.0:1773851851.153345:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:1.0:1773851851.153347:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000400:00000200:1.0:1773851851.153348:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18683@kfi7 local destination
00000400:00000200:1.0:1773851851.153349:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768479:8768479:1024:4294967295] 18683@kfi7 LPNI seq info [28004:28004:16:4294967295]
00000400:00000200:1.0:1773851851.153350:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:1.0:1773851851.153351:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.153353:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18683@kfi7(18683@kfi7:18683@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851851.153354:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000800:00000200:1.0:1773851851.153356:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851851.153357:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851851.153359:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851851.153361:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4d8 Using peer 18683@kfi7(0x4d8)
00000800:00000200:1.0:1773851851.153364:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x4d8: rc=0
00000800:00000200:1.0:1773851851.153365:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4d8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851851.153367:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851851.153368:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b964497e refcount 4 to 18682@kfi7
00010000:00000001:1.0:1773851851.153368:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851851.153369:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.153370:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851851.153370:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aaa38a11 x1858032310639808/t0(0) o400->ab453a19-f80c-4fd4-8fd5-40b713ca1db7@18682@kfi7:491/0 lens 224/224 e 0 to 0 dl 1773852606 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne241-0'
00000100:00100000:1.0:1773851851.153373:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aaa38a11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ab453a19-f80c-4fd4-8fd5-40b713ca1db7+6:47638:x1858032310639808:12345-18682@kfi7:400:default-tuolumne241-0 Request processed in 57us (85us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851851.153376:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18682@kfi7, seq: 1997474
00000800:00000200:2.0:1773851851.153377:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4d8 TN_EVENT_TX_OK event status 0
00000100:00000040:1.0:1773851851.153377:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bf31ffe : new rpc_count 0
00000100:00000001:1.0:1773851851.153377:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851851.153378:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851851.153378:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000200:2.0:1773851851.153379:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851851.153379:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:2.0:1773851851.153380:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18683@kfi7: PUT: OK
00000020:00000010:1.0:1773851851.153380:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092010b2a.
00000400:00000200:2.0:1773851851.153381:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe46cc14
00000400:00000010:2.0:1773851851.153381:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe46cc14.
00000020:00000040:1.0:1773851851.153381:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005bf31ffe : new refcount 5
00000100:00000001:1.0:1773851851.153381:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851851.153382:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851851.153383:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851851.153384:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000800:00000200:2.0:1773851851.153385:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 18683@kfi7(000000003ec32d1a):0x0 lsk 1241 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4d8 Transaction freed
00000800:00000200:1.0:1773851851.154023:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851851.154023:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851851.154025:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851851.154027:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851851.154029:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.154030:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18683@kfi7 : PUT - for me
00000400:00000200:1.0:1773851851.154031:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.154032:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 1
00000400:00000200:1.0:1773851851.154032:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.154033:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:1.0:1773851851.154034:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000400:00000200:1.0:1773851851.154035:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:1.0:1773851851.154036:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18682@kfi7 of length 224 into portal 12 MB=0x699dedbdb6540
00000400:00000200:1.0:1773851851.154037:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18682@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 6888
00000800:00000200:1.0:1773851851.154038:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851851.154040:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851851.154041:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18683@kfi7: PUT: OK
00000100:00000001:1.0:1773851851.154042:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851851.154043:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851851.154043:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a98a27a.
00000100:00000040:1.0:1773851851.154044:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000001a98a27a x1858032310641984 msgsize 224
00000100:00100000:1.0:1773851851.154045:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-18682@kfi7 (source: 12345-18683@kfi7)
00000100:00000001:1.0:1773851851.154046:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851851.154047:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000800:00000200:1.0:1773851851.154048:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851851.154051:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851851.154051:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851851.154051:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851851.154052:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851851.154052:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851851.154053:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858032310641984
00000020:00000001:1.0:1773851851.154053:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851851.154054:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9135d
00000020:00000001:1.0:1773851851.154054:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851851.154056:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008431f1f5 refcount=6
00000020:00000001:1.0:1773851851.154056:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169298944 : -107127540252672 : ffff9e916d048000)
00000020:00000001:1.0:1773851851.154057:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169298944 : -107127540252672 : ffff9e916d048000)
00000100:00000001:1.0:1773851851.154058:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.154058:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851851.154059:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092010b2a.
00000020:00000010:1.0:1773851851.154059:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851851.154060:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851851.154061:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851851.154061:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851851.154061:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851851.154062:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851851.154063:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851851.154063:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.154064:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851851.154065:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851851.154065:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851851.154065:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851851.154066:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851851.154066:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18682@kfi7, seq: 1997475
00000100:00000001:2.0:1773851851.154067:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851851.154067:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008431f1f5 : new rpc_count 1
00000100:00000001:2.0:1773851851.154068:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.154068:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085911351296 : -106987798200320 : ffff9eb1f64b0000)
00000100:00000040:1.0:1773851851.154069:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a98a27a x1858032310641984/t0(0) o400->1317ece7-4cca-46d1-b6d7-d640d587a0c4@18682@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne241-0'
00000100:00000001:1.0:1773851851.154071:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.154072:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851851.154073:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a98a27a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:1317ece7-4cca-46d1-b6d7-d640d587a0c4+6:47639:x1858032310641984:12345-18682@kfi7:400:default-tuolumne241-0
00000100:00000200:1.0:1773851851.154074:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858032310641984
00000020:00000001:1.0:1773851851.154075:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851851.154075:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851851.154076:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.154076:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851851.154077:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851851.154077:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851851.154078:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858032310641984, found 0 last_xid 1858032310641983
00000020:00000001:1.0:1773851851.154078:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851851.154079:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851851.154079:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851851.154079:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.154080:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851851.154080:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851851.154081:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851851.154081:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000070cf2c2c.
02000000:00000001:1.0:1773851851.154082:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.154082:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.154083:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851851.154083:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768011, transno 0, xid 1858032310641984
00010000:00000001:1.0:1773851851.154084:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851851.154085:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a98a27a x1858032310641984/t0(0) o400->1317ece7-4cca-46d1-b6d7-d640d587a0c4@18682@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne241-0'
00010000:00000001:1.0:1773851851.154087:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851851.154087:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851851.154088:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=84 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851851.154089:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851851.154090:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b964497e refcount 5 to 18682@kfi7
00000100:00000001:1.0:1773851851.154090:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109952 : -107156354441664 : ffff9e8ab78ede40)
02000000:00000001:1.0:1773851851.154091:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851851.154091:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.154092:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851851.154093:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18683@kfi7
00000400:00000010:1.0:1773851851.154093:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001634e401.
00000100:00000200:1.0:1773851851.154094:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858032310641984, offset 224
00000400:00000200:1.0:1773851851.154095:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18683@kfi7
00000400:00000200:1.0:1773851851.154096:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.154097:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 1
00000400:00000200:1.0:1773851851.154098:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:1.0:1773851851.154098:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000400:00000200:1.0:1773851851.154099:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18683@kfi7 local destination
00000400:00000200:1.0:1773851851.154100:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768480:8768480:1024:4294967295] 18683@kfi7 LPNI seq info [28005:28005:16:4294967295]
00000400:00000200:1.0:1773851851.154102:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:1.0:1773851851.154102:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851851.154104:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18683@kfi7(18683@kfi7:18683@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851851.154105:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000800:00000200:1.0:1773851851.154106:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851851.154107:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851851.154109:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851851.154111:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce Using peer 18683@kfi7(0x1000000000004ce)
00000800:00000200:1.0:1773851851.154114:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 324 bytes to peer 0x1000000000004ce: rc=0
00000800:00000200:1.0:1773851851.154115:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851851.154119:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851851.154120:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b964497e refcount 4 to 18682@kfi7
00010000:00000001:1.0:1773851851.154120:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851851.154121:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.154121:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851851.154122:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a98a27a x1858032310641984/t0(0) o400->1317ece7-4cca-46d1-b6d7-d640d587a0c4@18682@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne241-0'
00000100:00100000:1.0:1773851851.154125:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a98a27a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:1317ece7-4cca-46d1-b6d7-d640d587a0c4+6:47639:x1858032310641984:12345-18682@kfi7:400:default-tuolumne241-0 Request processed in 53us (80us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851851.154127:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18682@kfi7, seq: 1997475
00000800:00000200:2.0:1773851851.154128:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce TN_EVENT_TX_OK event status 0
00000100:00000040:1.0:1773851851.154128:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008431f1f5 : new rpc_count 0
00000100:00000001:1.0:1773851851.154128:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851851.154129:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851851.154129:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851851.154129:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000200:2.0:1773851851.154130:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18683@kfi7: PUT: OK
00000020:00000010:1.0:1773851851.154130:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000020:00000010:1.0:1773851851.154130:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092010b2a.
00000400:00000200:2.0:1773851851.154131:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001634e401
00000400:00000010:2.0:1773851851.154131:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001634e401.
00000020:00000040:1.0:1773851851.154131:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000008431f1f5 : new refcount 5
00000100:00000001:2.0:1773851851.154132:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851851.154132:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:1.0:1773851851.154132:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851851.154133:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000800:00000200:2.0:1773851851.154134:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce Transaction freed
00000800:00000200:17.0:1773851851.164077:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851851.164078:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851851.164079:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851851.164081:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851851.164083:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20962@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.164084:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20962@kfi7 : PUT - for me
00000400:00000200:17.0:1773851851.164085:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20962@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.164085:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000303d26ff nid 20962@kfi7 refs 1
00000400:00000200:17.0:1773851851.164086:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20962@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.164087:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000303d26ff nid 20962@kfi7 refs 2
00000400:00000200:17.0:1773851851.164088:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000303d26ff nid 20962@kfi7 refs 3
00000400:00000200:17.0:1773851851.164088:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20771@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.164089:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20771@kfi7 of length 224 into portal 12 MB=0x69b4b95e2cc40
00000400:00000200:17.0:1773851851.164090:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20771@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 187168
00000800:00000200:17.0:1773851851.164092:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851851.164093:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851851.164094:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20962@kfi7: PUT: OK
00000100:00000001:17.0:1773851851.164095:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851851.164095:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851851.164096:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000144e137a.
00000100:00000040:17.0:1773851851.164097:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000144e137a x1859598799785024 msgsize 224
00000100:00100000:17.0:1773851851.164098:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20771@kfi7 (source: 12345-20962@kfi7)
00000100:00000001:17.0:1773851851.164099:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:18.0:1773851851.164100:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851851.164100:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000303d26ff nid 20962@kfi7 refs 2
02000000:00000001:18.0:1773851851.164101:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851851.164101:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851851.164101:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851851.164102:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851851.164102:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851851.164103:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598799785024
00000020:00000001:18.0:1773851851.164103:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851851.164104:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38956bb8
00000020:00000001:18.0:1773851851.164104:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851851.164106:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000188afc38 refcount=5
00000020:00000001:18.0:1773851851.164107:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637065547358208 : -107008162193408 : ffff9ead38812000)
00000020:00000001:18.0:1773851851.164108:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637065547358208 : -107008162193408 : ffff9ead38812000)
00000100:00000001:18.0:1773851851.164109:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851851.164109:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851851.164110:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a408a807.
00000020:00000010:18.0:1773851851.164111:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851851.164112:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066264e32.
00000100:00000001:18.0:1773851851.164113:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851851.164113:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851851.164114:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851851.164115:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851851.164115:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851851.164116:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.164116:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851851.164118:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851851.164118:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851851.164118:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851851.164118:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851851.164119:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20771@kfi7, seq: 2156248
00000100:00000001:19.0:1773851851.164120:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851851.164120:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000188afc38 : new rpc_count 1
00000100:00000001:19.0:1773851851.164121:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.164121:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636951520131712 : -107122189419904 : ffff9e92abf3ba80)
00000100:00000040:18.0:1773851851.164122:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000144e137a x1859598799785024/t0(0) o400->23a1b59d-c44e-4770-9609-f75151108cda@20771@kfi7:41/0 lens 224/0 e 0 to 0 dl 1773852156 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1787-0'
00000100:00000001:18.0:1773851851.164124:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851851.164125:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851851.164126:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000144e137a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:23a1b59d-c44e-4770-9609-f75151108cda+5:39586:x1859598799785024:12345-20771@kfi7:400:default-tuolumne1787-0
00000100:00000200:18.0:1773851851.164127:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598799785024
00000020:00000001:18.0:1773851851.164128:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851851.164128:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851851.164129:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.164129:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851851.164130:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851851.164131:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851851.164131:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598799785024, found 0 last_xid 1859598799785023
00000020:00000001:18.0:1773851851.164132:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851851.164133:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851851.164134:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851851.164134:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.164135:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851851.164135:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851851.164136:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851851.164137:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000020e4017.
02000000:00000001:18.0:1773851851.164138:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.164138:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.164139:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851851.164140:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693369, transno 0, xid 1859598799785024
00010000:00000001:18.0:1773851851.164140:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851851.164141:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000144e137a x1859598799785024/t0(0) o400->23a1b59d-c44e-4770-9609-f75151108cda@20771@kfi7:41/0 lens 224/224 e 0 to 0 dl 1773852156 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1787-0'
00010000:00000001:18.0:1773851851.164144:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851851.164144:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851851.164145:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=84 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851851.164146:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851851.164147:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000090646e32 refcount 3 to 20771@kfi7
00000100:00000001:18.0:1773851851.164148:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547488 : -107156126004128 : ffff9e8ac52c8c60)
02000000:00000001:18.0:1773851851.164148:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851851.164149:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.164150:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851851.164150:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20962@kfi7
00000400:00000010:18.0:1773851851.164151:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000185e3b02.
00000100:00000200:18.0:1773851851.164152:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598799785024, offset 224
00000400:00000200:18.0:1773851851.164154:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20962@kfi7
00000400:00000200:18.0:1773851851.164154:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20962@kfi7 to cpt 4
00000400:00000200:18.0:1773851851.164155:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000303d26ff nid 20962@kfi7 refs 1
00000400:00000200:18.0:1773851851.164157:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000303d26ff nid 20962@kfi7 refs 2
00000400:00000200:18.0:1773851851.164158:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000303d26ff nid 20962@kfi7 refs 3
00000400:00000200:18.0:1773851851.164159:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20962@kfi7 local destination
00000400:00000200:18.0:1773851851.164160:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768481:8768481:1024:4294967295] 20962@kfi7 LPNI seq info [259720:259720:16:4294967295]
00000400:00000200:18.0:1773851851.164162:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000303d26ff nid 20962@kfi7 refs 2
00000400:00000200:18.0:1773851851.164162:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20962@kfi7 to cpt 4
00000400:00000200:18.0:1773851851.164164:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20962@kfi7(20962@kfi7:20962@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851851.164165:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000303d26ff nid 20962@kfi7 refs 3
00000800:00000200:18.0:1773851851.164166:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851851.164168:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851851.164170:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851851.164172:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x503 Using peer 20962@kfi7(0x503)
00000800:00000200:18.0:1773851851.164175:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000008e2a52ba: Posted send of 324 bytes to peer 0x503: rc=0
00000800:00000200:18.0:1773851851.164176:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x503 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851851.164178:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851851.164179:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000090646e32 refcount 2 to 20771@kfi7
00010000:00000001:18.0:1773851851.164180:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851851.164180:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.164181:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851851.164182:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000144e137a x1859598799785024/t0(0) o400->23a1b59d-c44e-4770-9609-f75151108cda@20771@kfi7:41/0 lens 224/224 e 0 to 0 dl 1773852156 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1787-0'
00000100:00100000:18.0:1773851851.164185:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000144e137a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:23a1b59d-c44e-4770-9609-f75151108cda+5:39586:x1859598799785024:12345-20771@kfi7:400:default-tuolumne1787-0 Request processed in 59us (87us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851851.164187:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20771@kfi7, seq: 2156248
00000100:00000040:18.0:1773851851.164188:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000188afc38 : new rpc_count 0
00000800:00000200:17.0:1773851851.164188:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x503 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851851.164189:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851851.164189:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851851.164189:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851851.164190:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851851.164190:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066264e32.
00000400:00000200:17.0:1773851851.164190:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20962@kfi7: PUT: OK
00000020:00000010:18.0:1773851851.164191:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a408a807.
00000400:00000200:17.0:1773851851.164191:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000185e3b02
00000400:00000010:17.0:1773851851.164191:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000185e3b02.
00000020:00000040:18.0:1773851851.164192:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000188afc38 : new refcount 4
00000100:00000001:17.0:1773851851.164192:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851851.164192:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:18.0:1773851851.164193:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851851.164193:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000303d26ff nid 20962@kfi7 refs 2
00000800:00000200:17.0:1773851851.164194:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 20962@kfi7(00000000a4461fdf):0x0 lsk 1284 rsk 34 tsk 0 trmk 0 tmk 0 trr 4 tta 0x503 Transaction freed
00000800:00000200:5.0:1773851851.221170:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851851.221171:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851851.221173:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851851.221175:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851851.221177:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.221178:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851851.221179:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.221180:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851851.221181:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.221182:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851851.221183:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851851.221184:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851851.221185:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a879cd7c0
00000400:00000200:5.0:1773851851.221186:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 4720
00000800:00000200:5.0:1773851851.221188:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851851.221190:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851851.221191:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851851.221192:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851851.221192:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851851.221193:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce38cf4e.
00000100:00000040:5.0:1773851851.221194:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ce38cf4e x1859388106921920 msgsize 224
00000100:00100000:5.0:1773851851.221195:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851851.221197:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851851.221197:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851851.221199:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851851.221201:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851851.221202:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851851.221202:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851851.221203:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851851.221203:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851851.221204:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388106921920
00000020:00000001:5.0:1773851851.221205:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851851.221205:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:5.0:1773851851.221206:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851851.221207:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:5.0:1773851851.221207:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:5.0:1773851851.221208:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:5.0:1773851851.221209:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851851.221210:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851851.221210:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6b8036f.
00000020:00000010:5.0:1773851851.221211:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851851.221212:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008d4880d3.
00000100:00000040:5.0:1773851851.221213:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851851.221214:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851851.221214:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851851.221215:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.221215:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.221217:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851851.221218:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851851.221218:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851851.221218:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851851.221218:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851851.221219:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314072
00000100:00000001:6.0:1773851851.221220:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851851.221220:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:6.0:1773851851.221221:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.221221:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046225664 : -106940663325952 : ffff9ebcefc01b00)
00000100:00000040:5.0:1773851851.221222:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ce38cf4e x1859388106921920/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:5.0:1773851851.221224:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851851.221225:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851851.221226:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce38cf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388106921920:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:5.0:1773851851.221227:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388106921920
00000020:00000001:5.0:1773851851.221227:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851851.221228:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851851.221229:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851851.221229:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851851.221230:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851851.221230:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851851.221231:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851851.221232:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851851.221232:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851851.221233:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.221234:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851851.221234:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851851.221235:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000f6e1e153.
02000000:00000001:5.0:1773851851.221236:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.221237:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851851.221238:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851851.221238:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851851.221239:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851851.221240:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851851.221241:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851851.221242:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851851.221243:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388106921920
00010000:00000001:5.0:1773851851.221244:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851851.221244:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ce38cf4e x1859388106921920/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:578/0 lens 224/368 e 0 to 0 dl 1773851938 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:5.0:1773851851.221247:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851851.221248:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851851.221248:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=80 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851851.221250:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851851.221250:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:5.0:1773851851.221251:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:5.0:1773851851.221252:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851851.221252:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.221253:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851851.221254:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:5.0:1773851851.221254:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005a691dda.
00000100:00000200:5.0:1773851851.221255:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388106921920, offset 224
00000400:00000200:5.0:1773851851.221257:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:5.0:1773851851.221258:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.221258:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851851.221259:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851851.221260:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851851.221261:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:5.0:1773851851.221263:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768482:8768482:1024:4294967295] 43@kfi7 LPNI seq info [37492097:37492097:16:4294967295]
00000400:00000200:5.0:1773851851.221264:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851851.221265:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.221267:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851851.221268:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:5.0:1773851851.221269:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851851.221270:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851851.221272:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851851.221275:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Using peer 43@kfi7(0x20000000000070b)
00000800:00000200:5.0:1773851851.221278:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 468 bytes to peer 0x20000000000070b: rc=0
00000800:00000200:5.0:1773851851.221279:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851851.221281:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851851.221282:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:5.0:1773851851.221283:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851851.221283:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851851.221284:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851851.221284:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce38cf4e x1859388106921920/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:578/0 lens 224/368 e 0 to 0 dl 1773851938 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:5.0:1773851851.221287:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce38cf4e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388106921920:12345-61@kfi7:41:default-yuba1-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851851.221290:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314072
00000100:00000040:5.0:1773851851.221290:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000800:00000200:6.0:1773851851.221291:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851851.221291:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851851.221292:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851851.221292:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851851.221293:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851851.221293:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008d4880d3.
00000400:00000200:6.0:1773851851.221294:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000020:00000010:5.0:1773851851.221294:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6b8036f.
00000020:00000040:5.0:1773851851.221294:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000400:00000200:6.0:1773851851.221295:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005a691dda
00000100:00000001:5.0:1773851851.221295:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851851.221296:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005a691dda.
00000100:00000001:6.0:1773851851.221296:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851851.221297:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851851.221298:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:6.0:1773851851.221299:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Transaction freed
00000800:00000200:18.0:1773851851.324894:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851851.324895:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851851.324897:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851851.324901:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851851.324903:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:18.0:1773851851.324904:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9330@kfi7 : PUT - for me
00000400:00000200:18.0:1773851851.324905:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:18.0:1773851851.324906:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 1
00000400:00000200:18.0:1773851851.324907:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:18.0:1773851851.324908:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000400:00000200:18.0:1773851851.324909:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 3
00000400:00000200:18.0:1773851851.324910:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9331@kfi7 to cpt 7
00000400:00000200:18.0:1773851851.324911:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9331@kfi7 of length 224 into portal 12 MB=0x69b8265c92940
00000400:00000200:18.0:1773851851.324913:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9331@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 187392
00000800:00000200:18.0:1773851851.324915:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851851.324917:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851851.324919:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9330@kfi7: PUT: OK
00000100:00000001:18.0:1773851851.324920:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851851.324921:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851851.324922:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f638512.
00000100:00000040:18.0:1773851851.324923:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001f638512 x1859834215999808 msgsize 224
00000100:00100000:18.0:1773851851.324924:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-9331@kfi7 (source: 12345-9330@kfi7)
00000100:00000001:18.0:1773851851.324926:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851851.324927:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000800:00000200:18.0:1773851851.324929:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851851.324931:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851851.324932:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851851.324932:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851851.324933:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851851.324934:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851851.324934:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859834215999808
00000020:00000001:18.0:1773851851.324935:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851851.324936:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c177d7c
00000020:00000001:18.0:1773851851.324936:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851851.324938:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b135b089 refcount=5
00000020:00000001:18.0:1773851851.324938:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029411892224 : -107044297659392 : ffff9ea4cea9ac00)
00000020:00000001:18.0:1773851851.324939:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029411892224 : -107044297659392 : ffff9ea4cea9ac00)
00000100:00000001:18.0:1773851851.324940:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851851.324941:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851851.324942:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a408a807.
00000020:00000010:18.0:1773851851.324943:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851851.324943:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066264e32.
00000100:00000001:18.0:1773851851.324944:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851851.324945:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851851.324945:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851851.324946:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851851.324946:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851851.324947:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.324948:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851851.324949:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851851.324949:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851851.324950:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:18.0:1773851851.324950:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9331@kfi7, seq: 2156249
00000100:00000001:19.0:1773851851.324951:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:18.0:1773851851.324951:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b135b089 : new rpc_count 1
00000100:00000001:19.0:1773851851.324952:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.324952:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534651520 : -106946174900096 : ffff9ebba73c2880)
00000100:00000001:19.0:1773851851.324953:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851851.324953:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001f638512 x1859834215999808/t0(0) o400->1698a260-6167-4170-80ac-0ec0b5956089@9331@kfi7:41/0 lens 224/0 e 0 to 0 dl 1773852156 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1066-0'
00000100:00000001:18.0:1773851851.324956:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851851.324956:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851851.324957:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f638512 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1698a260-6167-4170-80ac-0ec0b5956089+5:39727:x1859834215999808:12345-9331@kfi7:400:default-tuolumne1066-0
00000100:00000200:18.0:1773851851.324958:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859834215999808
00000020:00000001:18.0:1773851851.324959:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851851.324960:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851851.324960:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.324961:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851851.324971:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851851.324972:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851851.324973:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859834215999808, found 0 last_xid 1859834215999807
00000020:00000001:18.0:1773851851.324974:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851851.324974:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851851.324975:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851851.324975:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.324976:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851851.324976:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851851.324977:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851851.324977:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000104bdc31.
02000000:00000001:18.0:1773851851.324978:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.324979:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.324979:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851851.324980:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183206694979, transno 0, xid 1859834215999808
00010000:00000001:18.0:1773851851.324981:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851851.324981:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001f638512 x1859834215999808/t0(0) o400->1698a260-6167-4170-80ac-0ec0b5956089@9331@kfi7:41/0 lens 224/224 e 0 to 0 dl 1773852156 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1066-0'
00010000:00000001:18.0:1773851851.324984:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851851.324984:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851851.324985:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=84 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851851.324986:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851851.324987:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c130e67c refcount 3 to 9331@kfi7
00000100:00000001:18.0:1773851851.324987:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932096 : -107137839619520 : ffff9e8f0720a240)
02000000:00000001:18.0:1773851851.324988:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851851.324989:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.324989:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851851.324990:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9330@kfi7
00000400:00000010:18.0:1773851851.324991:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000185e3b02.
00000100:00000200:18.0:1773851851.324992:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859834215999808, offset 224
00000400:00000200:18.0:1773851851.324993:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9330@kfi7
00000400:00000200:18.0:1773851851.324994:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:18.0:1773851851.324994:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 1
00000400:00000200:18.0:1773851851.324995:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000400:00000200:18.0:1773851851.324997:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 3
00000400:00000200:18.0:1773851851.324998:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9330@kfi7 local destination
00000400:00000200:18.0:1773851851.324999:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768483:8768483:1024:4294967295] 9330@kfi7 LPNI seq info [1621601:1621601:16:4294967295]
00000400:00000200:18.0:1773851851.325001:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000400:00000200:18.0:1773851851.325001:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:18.0:1773851851.325003:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9330@kfi7(9330@kfi7:9330@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851851.325004:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 3
00000800:00000200:18.0:1773851851.325005:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851851.325006:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851851.325008:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851851.325010:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001246 Using peer 9330@kfi7(0x100000000001246)
00000800:00000200:18.0:1773851851.325013:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000658b1b4a: Posted send of 324 bytes to peer 0x100000000001246: rc=0
00000800:00000200:18.0:1773851851.325015:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001246 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851851.325017:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851851.325017:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c130e67c refcount 2 to 9331@kfi7
00010000:00000001:18.0:1773851851.325018:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851851.325019:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851851.325019:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851851.325020:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f638512 x1859834215999808/t0(0) o400->1698a260-6167-4170-80ac-0ec0b5956089@9331@kfi7:41/0 lens 224/224 e 0 to 0 dl 1773852156 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1066-0'
00000100:00100000:18.0:1773851851.325023:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f638512 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1698a260-6167-4170-80ac-0ec0b5956089+5:39727:x1859834215999808:12345-9331@kfi7:400:default-tuolumne1066-0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851851.325025:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9331@kfi7, seq: 2156249
00000100:00000040:18.0:1773851851.325026:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b135b089 : new rpc_count 0
00000100:00000001:18.0:1773851851.325027:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851851.325028:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851851.325028:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851851.325029:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066264e32.
00000800:00000200:17.0:1773851851.325029:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001246 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851851.325030:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a408a807.
00000020:00000040:18.0:1773851851.325030:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b135b089 : new refcount 4
00000100:00000001:18.0:1773851851.325031:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851851.325032:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851851.325034:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9330@kfi7: PUT: OK
00000400:00000200:17.0:1773851851.325035:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000185e3b02
00000400:00000010:17.0:1773851851.325036:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000185e3b02.
00000100:00000001:17.0:1773851851.325037:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851851.325037:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851851.325039:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000800:00000200:17.0:1773851851.325041:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 9330@kfi7(00000000e396c3dd):0x0 lsk 4679 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001246 Transaction freed
00000800:00000200:9.0:1773851851.333204:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851851.333205:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851851.333207:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851851.333209:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851851.333211:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851851.333213:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.39@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851851.333214:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851851.333214:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851851.333216:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:9.0:1773851851.333217:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:9.0:1773851851.333218:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:9.0:1773851851.333219:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:9.0:1773851851.333220:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.39@o2ib60 of length 224 into portal 12 MB=0x69b220e966580
00000400:00000200:9.0:1773851851.333222:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.39@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 7112
00000800:00000200:9.0:1773851851.333224:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851851.333225:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851851.333226:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851851.333227:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851851.333228:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851851.333229:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003680c21c.
00000100:00000040:9.0:1773851851.333229:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003680c21c x1859420436194688 msgsize 224
00000100:00100000:9.0:1773851851.333231:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.39@o2ib60 (source: 12345-192.168.128.39@o2ib60)
00000100:00000001:9.0:1773851851.333233:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851851.333234:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851851.333235:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851851.333236:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851851.333236:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851851.333237:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851851.333237:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851851.333238:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851851.333239:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859420436194688
00000020:00000001:1.0:1773851851.333239:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851851.333240:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ab51
00000020:00000001:1.0:1773851851.333241:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851851.333242:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000187322e6 refcount=125617
00000020:00000001:1.0:1773851851.333242:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000020:00000001:1.0:1773851851.333243:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000100:00000001:1.0:1773851851.333244:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.333246:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851851.333246:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092010b2a.
00000020:00000010:1.0:1773851851.333247:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851851.333248:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851851.333249:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851851.333249:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851851.333250:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851851.333251:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851851.333251:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851851.333252:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.333253:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851851.333254:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851851.333254:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851851.333255:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851851.333255:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851851.333256:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.39@o2ib60, seq: 1997476
00000100:00000040:1.0:1773851851.333256:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000187322e6 : new rpc_count 9
00000100:00000001:2.0:1773851851.333257:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851851.333257:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.333257:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792157056 : -106938917394560 : ffff9ebd57d0e780)
00000100:00000040:1.0:1773851851.333259:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003680c21c x1859420436194688/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:491/0 lens 224/0 e 0 to 0 dl 1773852606 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix39-0'
00000100:00000001:1.0:1773851851.333262:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851851.333262:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851851.333263:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003680c21c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40565:x1859420436194688:12345-192.168.128.39@o2ib60:400:default-matrix39-0
00000100:00000200:1.0:1773851851.333265:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859420436194688
00000020:00000001:1.0:1773851851.333265:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851851.333266:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851851.333269:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.333270:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851851.333270:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851851.333271:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851851.333272:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859420436194688, found 0 last_xid 1859420408095423
00000020:00000001:1.0:1773851851.333272:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851851.333273:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851851.333274:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851851.333275:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.333275:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851851.333276:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851851.333276:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851851.333277:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000491a05ae.
02000000:00000001:1.0:1773851851.333278:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.333278:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.333279:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851851.333280:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593807, transno 0, xid 1859420436194688
00010000:00000001:1.0:1773851851.333280:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851851.333281:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003680c21c x1859420436194688/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:491/0 lens 224/224 e 0 to 0 dl 1773852606 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00010000:00000001:1.0:1773851851.333284:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851851.333284:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851851.333285:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=84 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851851.333286:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851851.333287:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b587bdf refcount 3 to 192.168.128.39@o2ib60
00000100:00000001:1.0:1773851851.333288:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441792 : -107146751109824 : ffff9e8cf3f61540)
02000000:00000001:1.0:1773851851.333288:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851851.333289:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851851.333290:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851851.333291:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.39@o2ib60
00000400:00000010:1.0:1773851851.333292:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d5fbcac.
00000100:00000200:1.0:1773851851.333292:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859420436194688, offset 224
00000400:00000200:1.0:1773851851.333294:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.39@o2ib60
00000400:00000200:1.0:1773851851.333295:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:1.0:1773851851.333296:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:1.0:1773851851.333297:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:1.0:1773851851.333299:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 4
00000400:00000200:1.0:1773851851.333300:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.39@o2ib60 routed destination
00000400:00000200:1.0:1773851851.333301:0:60951:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:1.0:1773851851.333302:0:60951:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:1.0:1773851851.333304:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851851.333305:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:1.0:1773851851.333306:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851851.333307:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:1.0:1773851851.333308:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768484:8768484:1024:4294967295] 2094@kfi7 LPNI seq info [1258746979:1258746979:16:4294967295]
00000400:00000200:1.0:1773851851.333310:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:1.0:1773851851.333310:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:1.0:1773851851.333313:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.39@o2ib60(192.168.128.39@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851851.333315:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000800:00000200:1.0:1773851851.333316:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851851.333317:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851851.333319:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851851.333321:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:1.0:1773851851.333324:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:1.0:1773851851.333326:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851851.333328:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851851.333329:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b587bdf refcount 2 to 192.168.128.39@o2ib60
00010000:00000001:1.0:1773851851.333330:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851851.333330:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851851.333331:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851851.333332:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003680c21c x1859420436194688/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:491/0 lens 224/224 e 0 to 0 dl 1773852606 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00000100:00100000:1.0:1773851851.333335:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003680c21c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40565:x1859420436194688:12345-192.168.128.39@o2ib60:400:default-matrix39-0 Request processed in 72us (104us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851851.333337:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851851.333337:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.39@o2ib60, seq: 1997476
00000100:00000040:1.0:1773851851.333338:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000187322e6 : new rpc_count 8
00000400:00000200:2.0:1773851851.333339:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851851.333339:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851851.333340:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:1.0:1773851851.333340:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851851.333340:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000200:2.0:1773851851.333341:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d5fbcac
00000020:00000010:1.0:1773851851.333341:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000010:2.0:1773851851.333342:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d5fbcac.
00000100:00000001:2.0:1773851851.333342:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851851.333342:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092010b2a.
00000100:00000001:2.0:1773851851.333343:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:1.0:1773851851.333343:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000187322e6 : new refcount 125616
00000400:00000200:2.0:1773851851.333344:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:1.0:1773851851.333344:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851851.333345:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Transaction freed
00000800:00000200:6.0:1773851851.511645:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851851.511646:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851851.511647:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851851.511649:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851851.511651:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:6.0:1773851851.511652:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23202@kfi7 : PUT - for me
00000400:00000200:6.0:1773851851.511653:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:6.0:1773851851.511654:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 1
00000400:00000200:6.0:1773851851.511655:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:6.0:1773851851.511655:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000400:00000200:6.0:1773851851.511656:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 3
00000400:00000200:6.0:1773851851.511657:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23139@kfi7 to cpt 0
00000400:00000200:6.0:1773851851.511658:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23139@kfi7 of length 224 into portal 12 MB=0x699e09d3c4e00
00000400:00000200:6.0:1773851851.511659:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23139@kfi7 of length 224/224 into md 0x793926dc5 [64] + 115120
00000800:00000200:6.0:1773851851.511661:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851851.511663:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851851.511664:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23202@kfi7: PUT: OK
00000100:00000001:6.0:1773851851.511664:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851851.511665:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851851.511666:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bca7b3ad.
00000100:00000040:6.0:1773851851.511667:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000bca7b3ad x1858039849963008 msgsize 224
00000100:00100000:6.0:1773851851.511668:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-23139@kfi7 (source: 12345-23202@kfi7)
00000100:00000001:6.0:1773851851.511670:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851851.511671:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000800:00000200:6.0:1773851851.511672:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851851.511673:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851851.511673:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851851.511674:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851851.511675:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851851.511676:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851851.511677:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039849963008
00000020:00000001:5.0:1773851851.511678:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851851.511679:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92afd
00000020:00000001:5.0:1773851851.511680:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851851.511681:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004e18a56b refcount=6
00000020:00000001:5.0:1773851851.511682:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743670784 : -107128965880832 : ffff9e91180b2400)
00000020:00000001:5.0:1773851851.511684:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743670784 : -107128965880832 : ffff9e91180b2400)
00000100:00000001:5.0:1773851851.511685:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851851.511686:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851851.511687:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6b8036f.
00000020:00000010:5.0:1773851851.511689:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851851.511690:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008d4880d3.
00000100:00000001:5.0:1773851851.511691:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851851.511692:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851851.511693:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851851.511695:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851851.511695:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851851.511696:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.511697:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851851.511699:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851851.511699:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851851.511700:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851851.511700:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851851.511701:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23139@kfi7, seq: 2001839
00000100:00000040:7.0:1773851851.511702:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004e18a56b : new rpc_count 1
00000100:00000001:7.0:1773851851.511702:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637052503314688 : -107021206236928 : ffff9eaa2f04d100)
00000100:00000001:5.0:1773851851.511702:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.511703:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851851.511704:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bca7b3ad x1858039849963008/t0(0) o400->60cc34a0-911a-4365-8e9a-94876c00bdbb@23139@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1932-0'
00000100:00000001:7.0:1773851851.511709:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851851.511710:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851851.511711:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bca7b3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:60cc34a0-911a-4365-8e9a-94876c00bdbb+6:39651:x1858039849963008:12345-23139@kfi7:400:default-tuolumne1932-0
00000100:00000200:7.0:1773851851.511712:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039849963008
00000020:00000001:7.0:1773851851.511713:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851851.511714:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851851.511714:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.511715:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851851.511715:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851851.511716:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851851.511717:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039849963008, found 0 last_xid 1858039849963007
00000020:00000001:7.0:1773851851.511718:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851851.511718:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851851.511719:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851851.511719:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.511720:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851851.511720:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851851.511721:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851851.511722:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000585fbe5d.
02000000:00000001:7.0:1773851851.511722:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.511723:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.511724:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851851.511724:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044164973, transno 0, xid 1858039849963008
00010000:00000001:7.0:1773851851.511729:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851851.511730:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bca7b3ad x1858039849963008/t0(0) o400->60cc34a0-911a-4365-8e9a-94876c00bdbb@23139@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1932-0'
00010000:00000001:7.0:1773851851.511732:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851851.511733:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851851.511733:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=83 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851851.511735:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851851.511735:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dfea3861 refcount 3 to 23139@kfi7
00000100:00000001:7.0:1773851851.511736:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052544 : -107154804499072 : ffff9e8b13f11d80)
02000000:00000001:7.0:1773851851.511737:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851851.511738:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.511738:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851851.511739:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23202@kfi7
00000400:00000010:7.0:1773851851.511740:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000100:00000200:7.0:1773851851.511741:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039849963008, offset 224
00000400:00000200:7.0:1773851851.511742:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23202@kfi7
00000400:00000200:7.0:1773851851.511743:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:7.0:1773851851.511744:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 1
00000400:00000200:7.0:1773851851.511745:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000400:00000200:7.0:1773851851.511746:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 3
00000400:00000200:7.0:1773851851.511747:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23202@kfi7 local destination
00000400:00000200:7.0:1773851851.511749:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768485:8768485:1024:4294967295] 23202@kfi7 LPNI seq info [88741:88741:16:4294967295]
00000400:00000200:7.0:1773851851.511750:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000400:00000200:7.0:1773851851.511751:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:7.0:1773851851.511753:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23202@kfi7(23202@kfi7:23202@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851851.511754:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 3
00000800:00000200:7.0:1773851851.511755:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851851.511756:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851851.511759:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851851.511761:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000def Using peer 23202@kfi7(0x100000000000def)
00000800:00000200:7.0:1773851851.511764:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x100000000000def: rc=0
00000800:00000200:7.0:1773851851.511765:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000def TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851851.511767:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851851.511768:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dfea3861 refcount 2 to 23139@kfi7
00010000:00000001:7.0:1773851851.511768:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851851.511769:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.511769:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851851.511770:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bca7b3ad x1858039849963008/t0(0) o400->60cc34a0-911a-4365-8e9a-94876c00bdbb@23139@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1932-0'
00000100:00100000:7.0:1773851851.511773:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bca7b3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:60cc34a0-911a-4365-8e9a-94876c00bdbb+6:39651:x1858039849963008:12345-23139@kfi7:400:default-tuolumne1932-0 Request processed in 63us (105us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851851.511775:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23139@kfi7, seq: 2001839
00000100:00000040:7.0:1773851851.511776:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004e18a56b : new rpc_count 0
00000100:00000001:7.0:1773851851.511777:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851851.511778:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851851.511778:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851851.511778:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000def TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851851.511779:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008d4880d3.
00000020:00000010:7.0:1773851851.511780:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6b8036f.
00000400:00000200:6.0:1773851851.511780:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851851.511781:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004e18a56b : new refcount 5
00000400:00000200:6.0:1773851851.511781:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23202@kfi7: PUT: OK
00000100:00000001:7.0:1773851851.511782:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851851.511782:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:6.0:1773851851.511782:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:6.0:1773851851.511783:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851851.511783:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851851.511784:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000800:00000200:6.0:1773851851.511785:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 23202@kfi7(00000000eefd0472):0x0 lsk 3568 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000def Transaction freed
00000800:00000200:13.0:1773851851.528640:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851851.528643:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851851.528644:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851851.528647:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851851.528648:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851851.528649:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18946@kfi7 : PUT - for me
00000400:00000200:13.0:1773851851.528650:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851851.528651:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 1
00000400:00000200:13.0:1773851851.528652:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851851.528652:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000400:00000200:13.0:1773851851.528653:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 3
00000400:00000200:13.0:1773851851.528654:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851851.528654:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18946@kfi7 of length 224 into portal 12 MB=0x69b4b92905100
00000400:00000200:13.0:1773851851.528656:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18946@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 11656
00000800:00000200:13.0:1773851851.528658:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851851.528659:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851851.528660:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18946@kfi7: PUT: OK
00000100:00000001:13.0:1773851851.528661:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851851.528661:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851851.528662:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6d5033e.
00000100:00000040:13.0:1773851851.528663:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000a6d5033e x1859598744047872 msgsize 224
00000100:00100000:13.0:1773851851.528664:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18946@kfi7 (source: 12345-18946@kfi7)
00000100:00000001:13.0:1773851851.528665:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851851.528666:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000100:00000001:15.0:1773851851.528667:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851851.528667:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851851.528667:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851851.528668:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851851.528668:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851851.528669:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851851.528669:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598744047872
00000020:00000001:15.0:1773851851.528670:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851851.528670:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d802b0
00000020:00000001:15.0:1773851851.528671:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851851.528674:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000740d8c3e refcount=5
00000020:00000001:15.0:1773851851.528675:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132046950400 : -106941662601216 : ffff9ebcb4306000)
00000020:00000001:15.0:1773851851.528675:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132046950400 : -106941662601216 : ffff9ebcb4306000)
00000100:00000001:15.0:1773851851.528676:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851851.528677:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851851.528677:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f2922694.
00000020:00000010:15.0:1773851851.528678:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851851.528679:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851851.528680:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851851.528681:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851851.528681:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851851.528682:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851851.528682:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851851.528683:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.528683:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851851.528685:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851851.528685:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851851.528685:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851851.528685:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851851.528687:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18946@kfi7, seq: 2289764
00000100:00000040:15.0:1773851851.528687:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000740d8c3e : new rpc_count 1
00000100:00000001:14.0:1773851851.528687:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.528688:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197396480 : -106942512155136 : ffff9ebc818d3600)
00000100:00000001:14.0:1773851851.528688:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851851.528689:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6d5033e x1859598744047872/t0(0) o400->48e2200b-a543-4d57-b813-456caa265e22@18946@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1687-0'
00000100:00000001:15.0:1773851851.528691:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851851.528692:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851851.528693:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d5033e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:48e2200b-a543-4d57-b813-456caa265e22+5:39689:x1859598744047872:12345-18946@kfi7:400:default-tuolumne1687-0
00000100:00000200:15.0:1773851851.528694:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598744047872
00000020:00000001:15.0:1773851851.528694:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851851.528695:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851851.528696:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.528696:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851851.528697:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851851.528697:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851851.528698:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598744047872, found 0 last_xid 1859598744047871
00000020:00000001:15.0:1773851851.528699:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851851.528699:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851851.528700:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851851.528700:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.528701:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851851.528701:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851851.528702:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851851.528702:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000944b52d0.
02000000:00000001:15.0:1773851851.528703:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.528703:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.528704:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851851.528705:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693879, transno 0, xid 1859598744047872
00010000:00000001:15.0:1773851851.528705:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851851.528706:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6d5033e x1859598744047872/t0(0) o400->48e2200b-a543-4d57-b813-456caa265e22@18946@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1687-0'
00010000:00000001:15.0:1773851851.528711:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851851.528711:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851851.528712:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=84 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851851.528713:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851851.528713:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fc97fbf7 refcount 3 to 18946@kfi7
00000100:00000001:15.0:1773851851.528714:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902779456 : -107154806772160 : ffff9e8b13ce6e40)
02000000:00000001:15.0:1773851851.528715:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851851.528715:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851851.528716:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851851.528717:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18946@kfi7
00000400:00000010:15.0:1773851851.528717:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c8b6bf6d.
00000100:00000200:15.0:1773851851.528718:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598744047872, offset 224
00000400:00000200:15.0:1773851851.528720:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18946@kfi7
00000400:00000200:15.0:1773851851.528720:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:15.0:1773851851.528721:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 1
00000400:00000200:15.0:1773851851.528722:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000400:00000200:15.0:1773851851.528723:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 3
00000400:00000200:15.0:1773851851.528727:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18946@kfi7 local destination
00000400:00000200:15.0:1773851851.528728:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768486:8768486:1024:4294967295] 18946@kfi7 LPNI seq info [10584766:10584766:16:4294967295]
00000400:00000200:15.0:1773851851.528729:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000400:00000200:15.0:1773851851.528730:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:15.0:1773851851.528732:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18946@kfi7(18946@kfi7:18946@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851851.528733:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 3
00000800:00000200:15.0:1773851851.528734:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851851.528735:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851851.528737:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851851.528739:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ad Using peer 18946@kfi7(0x1000000000005ad)
00000800:00000200:15.0:1773851851.528743:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x1000000000005ad: rc=0
00000800:00000200:15.0:1773851851.528745:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851851.528746:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851851.528747:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fc97fbf7 refcount 2 to 18946@kfi7
00010000:00000001:15.0:1773851851.528748:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851851.528748:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851851.528749:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851851.528749:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6d5033e x1859598744047872/t0(0) o400->48e2200b-a543-4d57-b813-456caa265e22@18946@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1687-0'
00000100:00100000:15.0:1773851851.528752:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d5033e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:48e2200b-a543-4d57-b813-456caa265e22+5:39689:x1859598744047872:12345-18946@kfi7:400:default-tuolumne1687-0 Request processed in 60us (88us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851851.528754:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18946@kfi7, seq: 2289764
00000100:00000040:15.0:1773851851.528755:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000740d8c3e : new rpc_count 0
00000100:00000001:15.0:1773851851.528756:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851851.528756:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851851.528756:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851851.528757:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000020:00000010:15.0:1773851851.528758:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f2922694.
00000800:00000200:13.0:1773851851.528758:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ad TN_EVENT_TX_OK event status 0
00000020:00000040:15.0:1773851851.528759:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000740d8c3e : new refcount 4
00000100:00000001:15.0:1773851851.528759:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851851.528759:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851851.528760:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18946@kfi7: PUT: OK
00000400:00000200:13.0:1773851851.528761:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c8b6bf6d
00000400:00000010:13.0:1773851851.528762:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c8b6bf6d.
00000100:00000001:13.0:1773851851.528762:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851851.528763:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851851.528764:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000800:00000200:13.0:1773851851.528765:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18946@kfi7(0000000047dbe861):0x0 lsk 1454 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ad Transaction freed
00000004:00000001:28.0:1773851851.593731:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:8.0:1773851851.593731:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851851.593732:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851851.593732:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:8.0:1773851851.593732:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851851.593733:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851851.593733:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851851.593733:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:28.0:1773851851.593733:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8e8c6f3.
00000100:00000010:8.0:1773851851.593733:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001eed8194.
00000100:00000010:30.0:1773851851.593734:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8bb7992.
00000100:00000010:29.0:1773851851.593734:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f0c0660c.
00000020:00000040:28.0:1773851851.593734:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000020:00000040:30.0:1773851851.593735:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000020:00000040:29.0:1773851851.593735:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
00000020:00000040:8.0:1773851851.593735:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000100:00000001:30.0:1773851851.593736:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851851.593736:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851851.593736:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:28.0:1773851851.593736:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851851.593736:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851851.593736:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851851.593737:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851851.593737:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851851.593737:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851851.593737:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851851.593738:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851851.593738:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851851.593739:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
02000000:00000010:28.0:1773851851.593739:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000009f509882.
02000000:00000010:8.0:1773851851.593739:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
02000000:00000010:30.0:1773851851.593740:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a8444578.
00000100:00000001:29.0:1773851851.593740:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593740:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851851.593741:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593741:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851851.593741:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593741:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851851.593741:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.593741:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851851.593742:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:8.0:1773851851.593742:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851851.593743:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851851.593743:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f0c0660c] to pc [ptlrpcd_07_02+2]  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851851.593743:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b8e8c6f3] to pc [ptlrpcd_07_03+3]  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851851.593743:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851851.593745:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a8bb7992] to pc [ptlrpcd_07_00+0]  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851851.593745:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001eed8194] to pc [ptlrpcd_02_00+0]  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851851.593747:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851851.593747:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851851.593748:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:28.0:1773851851.593748:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000becc0787.
00000100:00000001:31.0:1773851851.593749:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851851.593749:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:29.0:1773851851.593749:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000df435905.
00080000:00000001:29.0:1773851851.593749:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637109634357248 : -106964075194368 : ffff9eb77c4b5800)
00080000:00000001:28.0:1773851851.593749:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637084775502848 : -106988934048768 : ffff9eb1b2975400)
00080000:00000001:8.0:1773851851.593749:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:31.0:1773851851.593750:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851851.593750:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851851.593750:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:30.0:1773851851.593751:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:29.0:1773851851.593751:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851851.593751:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851851.593751:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851851.593751:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851851.593751:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ca146e38.
00000004:00001000:29.0:1773851851.593752:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00000004:00001000:28.0:1773851851.593752:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000004:00000010:28.0:1773851851.593752:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003913b07c.
00000100:00000001:10.0:1773851851.593752:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851851.593752:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851851.593752:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851851.593752:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636979027065856 : -107094682485760 : ffff9e99137e3c00)
00080000:00000010:30.0:1773851851.593753:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000516842de.
00000004:00000010:29.0:1773851851.593753:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000dc1d2239.
00000004:00080000:29.0:1773851851.593753:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614126047028735ns, next at 614127047027954ns, rc = 0
00000004:00080000:28.0:1773851851.593753:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614126047028655ns, next at 614127047027743ns, rc = 0
00000100:00000040:10.0:1773851851.593753:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851851.593753:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851851.593754:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851851.593754:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851851.593754:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636968877862912 : -107104831688704 : ffff9e96b68db000)
00080000:00000001:29.0:1773851851.593754:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851851.593754:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:8.0:1773851851.593754:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851851.593755:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851851.593755:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851851.593755:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851851.593755:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851851.593755:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851851.593755:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:8.0:1773851851.593755:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
02000000:00000001:31.0:1773851851.593756:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851851.593756:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851851.593756:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:8.0:1773851851.593756:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006a833e4d.
00000100:00100000:31.0:1773851851.593757:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f0c0660c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051921728:47@kfi7:13:default-yuba2-0
00000004:00001000:30.0:1773851851.593757:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000100:00000001:10.0:1773851851.593757:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:8.0:1773851851.593757:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614126047032172ns, next at 614127047030779ns, rc = 0
00000004:00000010:30.0:1773851851.593758:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007acdf483.
02000000:00000001:10.0:1773851851.593758:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:8.0:1773851851.593758:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:31.0:1773851851.593759:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851851.593759:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00080000:30.0:1773851851.593759:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614126047034576ns, next at 614127047033474ns, rc = 0
02000000:00000001:10.0:1773851851.593759:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851851.593759:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851851.593759:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851851.593760:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851851.593760:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:30.0:1773851851.593760:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:28.0:1773851851.593760:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:10.0:1773851851.593760:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eed8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051921856:2084@kfi7:13:default-yuba2-0
02000000:00000010:31.0:1773851851.593761:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000db073834.
00080000:00000001:30.0:1773851851.593761:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593761:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851851.593761:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851851.593761:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851851.593761:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:10.0:1773851851.593761:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851851.593762:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851851.593762:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593762:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:10.0:1773851851.593762:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:31.0:1773851851.593763:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000040:29.0:1773851851.593763:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851851.593763:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:10.0:1773851851.593763:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851851.593763:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:31.0:1773851851.593764:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000100:00000001:30.0:1773851851.593764:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851851.593764:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851851.593764:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d92ace2a.
00000400:00000010:31.0:1773851851.593765:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000100:00000001:29.0:1773851851.593765:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851851.593765:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:10.0:1773851851.593765:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851851.593766:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921728, portal 4
00000100:00000001:29.0:1773851851.593766:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593766:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851851.593766:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:31.0:1773851851.593767:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:29.0:1773851851.593767:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851851.593767:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851851.593767:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851851.593767:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851851.593767:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000784143ff.
00000100:00000001:31.0:1773851851.593768:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637111224827904 : -106962484723712 : ffff9eb7db180000)
00000100:00100000:29.0:1773851851.593768:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8e8c6f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051921792:9@kfi7:13:default-yuba2-0
00000100:00100000:28.0:1773851851.593768:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a8bb7992 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051921920:2104@kfi7:13:default-yuba2-0
00000400:00000010:10.0:1773851851.593768:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000053a50d5b.
00000100:00000040:31.0:1773851851.593769:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851851.593770:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:29.0:1773851851.593770:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:28.0:1773851851.593770:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851851.593770:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:10.0:1773851851.593770:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921856, portal 4
00000100:00000001:10.0:1773851851.593770:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:29.0:1773851851.593771:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851851.593771:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:28.0:1773851851.593771:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851851.593771:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:10.0:1773851851.593771:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491259776 : -107117218291840 : ffff9e93d4411f80)
00000100:00000001:31.0:1773851851.593772:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000010:28.0:1773851851.593772:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ec11d2f7.
00000100:00000040:31.0:1773851851.593773:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
02000000:00000010:29.0:1773851851.593773:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002cae99cb.
02000000:00000001:28.0:1773851851.593773:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851851.593773:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851851.593774:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d81a04c.
00000100:00000200:31.0:1773851851.593774:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921728, offset 0
02000000:00000001:29.0:1773851851.593774:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851851.593774:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:29.0:1773851851.593775:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:29.0:1773851851.593775:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000027eae465.
00000400:00000010:28.0:1773851851.593775:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000010:28.0:1773851851.593775:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d3aa665.
00000100:00000001:10.0:1773851851.593775:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851851.593776:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000010:29.0:1773851851.593776:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3501a9c.
00000100:00000040:10.0:1773851851.593776:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000200:31.0:1773851851.593777:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000200:29.0:1773851851.593777:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921792, portal 4
00000100:00000200:28.0:1773851851.593777:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921920, portal 4
00000100:00000001:28.0:1773851851.593777:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:10.0:1773851851.593777:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008746fc24.
00000400:00000200:31.0:1773851851.593778:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000001:29.0:1773851851.593778:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851851.593778:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324220928 : -106976385330688 : ffff9eb49e8d9200)
00000100:00000001:28.0:1773851851.593778:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636973000818688 : -107100708732928 : ffff9e97ac4d0000)
00000100:00000200:10.0:1773851851.593778:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921856, offset 0
00000400:00000200:31.0:1773851851.593779:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000040:29.0:1773851851.593779:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851851.593779:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851851.593779:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:31.0:1773851851.593780:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:10.0:1773851851.593781:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851851.593782:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000100:00000001:29.0:1773851851.593782:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851851.593782:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851851.593782:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000100:00000040:29.0:1773851851.593783:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:29.0:1773851851.593783:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ff351f68.
00000100:00000040:28.0:1773851851.593783:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:28.0:1773851851.593783:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091f735e9.
00000400:00000200:10.0:1773851851.593783:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851851.593784:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768481, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768486, p:4294967295, g:4294967295, h:1000]
00000100:00000200:29.0:1773851851.593784:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921792, offset 0
00000100:00000200:28.0:1773851851.593784:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921920, offset 0
00000400:00000200:29.0:1773851851.593785:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000400:00000200:10.0:1773851851.593785:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:31.0:1773851851.593786:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851851.593786:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:10.0:1773851851.593786:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000200:31.0:1773851851.593787:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851851.593787:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768481, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768486, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851851.593788:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000400:00000200:31.0:1773851851.593789:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768487:8768487:1024:4294967295] 47@kfi7 LPNI seq info [5403016:5403016:16:4294967295]
00000400:00000200:10.0:1773851851.593789:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851851.593790:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:10.0:1773851851.593790:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851851.593791:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:10.0:1773851851.593791:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:29.0:1773851851.593792:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:29.0:1773851851.593793:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000200:10.0:1773851851.593793:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768488:8768488:1024:4294967295] 2084@kfi7 LPNI seq info [5402741:5402741:16:4294967295]
00000400:00000200:31.0:1773851851.593794:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851851.593794:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:10.0:1773851851.593794:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851851.593795:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:10.0:1773851851.593795:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:29.0:1773851851.593796:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000800:00000200:31.0:1773851851.593797:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:29.0:1773851851.593797:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000400:00000200:10.0:1773851851.593798:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000800:00000200:31.0:1773851851.593799:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851851.593799:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768487, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768488, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851851.593800:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:31.0:1773851851.593801:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851851.593801:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851851.593801:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851851.593802:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000800:00000200:10.0:1773851851.593802:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:29.0:1773851851.593803:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768489:8768489:1023:4294967295] 9@kfi7 LPNI seq info [5403005:5403005:16:4294967295]
00000800:00000200:31.0:1773851851.593804:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 Using peer 47@kfi7(0x274)
00000800:00000200:10.0:1773851851.593804:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851851.593805:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:29.0:1773851851.593805:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:28.0:1773851851.593806:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:10.0:1773851851.593806:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851851.593807:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x274: rc=0
00000400:00000200:28.0:1773851851.593807:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:29.0:1773851851.593808:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851851.593808:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:29.0:1773851851.593809:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000800:00000200:10.0:1773851851.593809:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Using peer 2084@kfi7(0x2000000000000ff)
00000800:00000200:31.0:1773851851.593810:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851851.593810:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000800:00000200:29.0:1773851851.593811:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851851.593811:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000100:00000001:31.0:1773851851.593812:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851851.593812:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851851.593812:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851851.593812:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8768489, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768488, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851851.593813:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851851.593813:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000019dc57a6: Posted send of 324 bytes to peer 0x2000000000000ff: rc=0
00000100:00000001:31.0:1773851851.593814:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851851.593814:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851851.593814:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851851.593815:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851851.593816:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851851.593816:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:29.0:1773851851.593816:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000400:00000200:28.0:1773851851.593816:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:31.0:1773851851.593817:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851851.593817:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851851.593817:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851851.593818:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851851.593818:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851851.593818:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851851.593818:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000100:00000001:10.0:1773851851.593818:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851851.593819:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 324 bytes to peer 0x31e: rc=0
00000400:00000200:28.0:1773851851.593819:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768490:8768490:1023:4294967295] 2104@kfi7 LPNI seq info [5403373:5403373:16:4294967295]
00000100:00000001:10.0:1773851851.593819:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851851.593820:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851851.593820:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851851.593820:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851851.593821:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:28.0:1773851851.593821:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:29.0:1773851851.593822:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593822:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851851.593822:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851851.593822:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851851.593823:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851851.593823:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851851.593824:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851851.593824:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000100:00000001:10.0:1773851851.593824:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851851.593824:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593825:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851851.593825:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:10.0:1773851851.593825:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593826:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851851.593826:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851851.593827:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851851.593827:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851851.593827:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851851.593828:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593828:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851851.593828:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851851.593830:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000800:00000200:29.0:1773851851.593831:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851851.593831:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008746fc24
00000800:00000200:28.0:1773851851.593832:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000010:9.0:1773851851.593832:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008746fc24.
00000800:00000200:30.0:1773851851.593833:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851851.593833:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851851.593833:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:30.0:1773851851.593834:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851851.593834:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->47@kfi7: PUT: OK
00000800:00000200:28.0:1773851851.593834:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000200:9.0:1773851851.593834:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851851.593835:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d81a04c
00000400:00000200:30.0:1773851851.593836:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000400:00000010:29.0:1773851851.593836:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d81a04c.
00000100:00000001:29.0:1773851851.593836:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:28.0:1773851851.593836:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851851.593837:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ff351f68
00000400:00000010:30.0:1773851851.593837:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ff351f68.
00000100:00000200:29.0:1773851851.593837:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851851.593837:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851851.593838:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000040:9.0:1773851851.593838:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851851.593839:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851851.593839:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000100:00000001:29.0:1773851851.593840:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851851.593841:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851851.593841:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851851.593841:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851851.593841:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:30.0:1773851851.593842:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851851.593842:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
00000400:00000200:9.0:1773851851.593842:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:29.0:1773851851.593843:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593843:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:30.0:1773851851.593844:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851851.593844:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000800:00000200:28.0:1773851851.593844:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851851.593844:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Transaction freed
00000100:00000001:30.0:1773851851.593845:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851851.593846:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:29.0:1773851851.593846:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 Transaction freed
00000100:00000001:28.0:1773851851.593846:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593846:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:30.0:1773851851.593847:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000100:00000001:28.0:1773851851.593847:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593847:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593848:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851851.593850:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851851.593851:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:28.0:1773851851.593851:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851851.593852:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851851.593855:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593855:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851851.593856:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851851.593857:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851851.593858:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000400:00000200:29.0:1773851851.593859:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091f735e9
00000400:00000010:29.0:1773851851.593860:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091f735e9.
00000100:00000001:29.0:1773851851.593860:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851851.593861:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851851.593863:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851851.593864:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851851.593866:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593867:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851851.593867:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:21.0:1773851851.593867:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851851.593868:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851851.593869:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Transaction freed
00000800:00000200:25.0:1773851851.593869:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:21.0:1773851851.593869:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851851.593870:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851851.593871:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851851.593871:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851851.593873:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:25.0:1773851851.593874:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851851.593874:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 47@kfi7 : PUT - for me
00000400:00000200:21.0:1773851851.593875:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851851.593876:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851851.593876:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:21.0:1773851851.593877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851851.593878:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2084@kfi7 : PUT - for me
00000400:00000200:21.0:1773851851.593878:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:21.0:1773851851.593878:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:25.0:1773851851.593879:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851851.593880:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:21.0:1773851851.593880:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851851.593881:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851851.593881:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1d40
00000400:00000200:21.0:1773851851.593882:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851851.593883:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:21.0:1773851851.593883:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d0275 [1] + 224
00000400:00000200:25.0:1773851851.593884:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:5.0:1773851851.593884:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:25.0:1773851851.593885:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:21.0:1773851851.593885:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851851.593886:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1dc0
00000800:00000200:5.0:1773851851.593886:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851851.593887:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851851.593887:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851851.593888:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851851.593888:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->47@kfi7: PUT: OK
00000400:00000200:25.0:1773851851.593889:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b817d9 [1] + 224
00000100:00000001:21.0:1773851851.593889:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:5.0:1773851851.593889:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:21.0:1773851851.593890:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851851.593891:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851851.593892:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:25.0:1773851851.593893:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851851.593893:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000400:00000200:25.0:1773851851.593894:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000100:00000040:21.0:1773851851.593894:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851851.593894:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:25.0:1773851851.593895:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851851.593895:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000200:25.0:1773851851.593896:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851851.593897:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851851.593897:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.593897:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:21.0:1773851851.593898:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:31.0:1773851851.593899:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851851.593899:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:31.0:1773851851.593900:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:25.0:1773851851.593900:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851851.593900:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:5.0:1773851851.593900:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000001:31.0:1773851851.593901:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851851.593901:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851851.593901:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1d80
00000400:00000010:31.0:1773851851.593902:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000200:5.0:1773851851.593902:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:31.0:1773851851.593903:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000400:00000010:31.0:1773851851.593903:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000100:00000001:31.0:1773851851.593904:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:25.0:1773851851.593904:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:13.0:1773851851.593904:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:5.0:1773851851.593904:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b2fd25 [1] + 224
00000100:00000200:31.0:1773851851.593905:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851851.593905:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:13.0:1773851851.593905:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851851.593906:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:13.0:1773851851.593906:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851851.593906:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851851.593906:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851851.593906:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:10.0:1773851851.593907:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851851.593907:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:31.0:1773851851.593908:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851851.593908:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000010:10.0:1773851851.593908:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000784143ff.
00000400:00000200:5.0:1773851851.593908:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851851.593909:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000053a50d5b
00000400:00000010:10.0:1773851851.593909:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000053a50d5b.
00000400:00000200:5.0:1773851851.593909:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000400:00000200:13.0:1773851851.593910:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:10.0:1773851851.593910:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:5.0:1773851851.593910:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851851.593911:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851851.593911:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851851.593911:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000100:00000200:10.0:1773851851.593911:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851851.593912:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851851.593912:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:13.0:1773851851.593912:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000200:5.0:1773851851.593912:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851851.593913:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851851.593913:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851851.593913:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
02000000:00000001:31.0:1773851851.593914:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851851.593914:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851851.593914:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000200:10.0:1773851851.593914:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851851.593915:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=84 v=66 (66 66 66 66)
00000400:00000200:13.0:1773851851.593915:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000040:5.0:1773851851.593915:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851851.593916:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=84 v=66 (1 1 1 1)
00000400:00000200:13.0:1773851851.593916:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:31.0:1773851851.593917:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:13.0:1773851851.593917:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1e00
00000100:00000001:10.0:1773851851.593917:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851851.593917:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851851.593918:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851851.593918:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:13.0:1773851851.593918:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:10.0:1773851851.593918:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851851.593918:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00010000:00000001:31.0:1773851851.593919:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851851.593919:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f548d [1] + 224
00000100:00000001:10.0:1773851851.593919:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851851.593919:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.593919:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851851.593920:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:10.0:1773851851.593920:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851851.593920:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000040:31.0:1773851851.593921:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00000001:31.0:1773851851.593921:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851851.593921:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851851.593921:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:13.0:1773851851.593921:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:10.0:1773851851.593921:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=84 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851851.593922:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:29.0:1773851851.593922:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00001000:10.0:1773851851.593922:0:41068:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=84 v=66 (1 1 1 1)
00000800:00000200:5.0:1773851851.593922:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000040:31.0:1773851851.593923:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:29.0:1773851851.593923:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:13.0:1773851851.593923:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851851.593923:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851851.593923:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851851.593924:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000027eae465.
00000400:00000200:29.0:1773851851.593924:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3501a9c
00000400:00000200:13.0:1773851851.593924:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00010000:00000001:10.0:1773851851.593924:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:29.0:1773851851.593925:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3501a9c.
00000100:00000001:13.0:1773851851.593925:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:10.0:1773851851.593925:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851851.593925:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851851.593926:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851851.593926:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851851.593926:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:13.0:1773851851.593926:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851851.593926:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000100:00000001:10.0:1773851851.593926:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851851.593927:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:29.0:1773851851.593927:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851851.593927:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851851.593928:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851851.593928:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000100:00000040:10.0:1773851851.593928:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:31.0:1773851851.593929:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603975168 avail=351601704960 avail_mb=1373444160 hwm_mb=3131103 files=372190563 ffree=343363257 state=0: rc = 0
00000100:00000200:29.0:1773851851.593929:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:13.0:1773851851.593929:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851851.593930:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:31.0:1773851851.593931:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603975168 free, 351601704960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190563 files, 343363257 free files
00000100:00000001:10.0:1773851851.593931:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851851.593931:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851851.593932:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851851.593932:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851851.593932:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:31.0:1773851851.593933:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593933:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851851.593933:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:13.0:1773851851.593933:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:10.0:1773851851.593933:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000100:00000040:31.0:1773851851.593934:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851851.593934:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851851.593934:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851851.593934:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000004:00000040:10.0:1773851851.593934:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593664512 avail=351576846336 avail_mb=1373347056 hwm_mb=3131103 files=372190086 ffree=343353188 state=0: rc = 0
02000000:00000001:29.0:1773851851.593935:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851851.593935:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000004:00000020:10.0:1773851851.593935:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593664512 free, 351576846336 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190086 files, 343353188 free files
00000100:00001000:29.0:1773851851.593936:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=84 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851851.593936:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851851.593936:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:31.0:1773851851.593937:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f0c0660c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051921728:47@kfi7:13:default-yuba2-0
00000100:00001000:29.0:1773851851.593937:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=5 v=66 (1 1 1 1)
00000400:00000001:28.0:1773851851.593937:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851851.593937:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000001:10.0:1773851851.593937:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851851.593938:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851851.593938:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851851.593938:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:28.0:1773851851.593938:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000040:10.0:1773851851.593938:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851851.593939:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00010000:00000001:29.0:1773851851.593939:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:29.0:1773851851.593939:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851851.593939:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d3aa665
00000400:00000010:28.0:1773851851.593939:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d3aa665.
00000100:00000040:31.0:1773851851.593940:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f0c0660c x1859433051921728/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851851.593940:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:28.0:1773851851.593940:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00100000:10.0:1773851851.593940:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eed8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051921856:2084@kfi7:13:default-yuba2-0
00000100:00000040:29.0:1773851851.593941:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000100:00000001:29.0:1773851851.593941:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851851.593941:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851851.593941:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851851.593942:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851851.593942:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851851.593943:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851851.593943:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:29.0:1773851851.593943:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:10.0:1773851851.593943:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001eed8194 x1859433051921856/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:31.0:1773851851.593944:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000db073834.
00000100:00000200:28.0:1773851851.593944:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851851.593945:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:29.0:1773851851.593945:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:31.0:1773851851.593946:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851851.593946:0:41090:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000100:00000001:29.0:1773851851.593946:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851851.593946:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851851.593946:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851851.593946:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851851.593946:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:31.0:1773851851.593947:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851851.593947:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
00000004:00000001:29.0:1773851851.593947:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851851.593947:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000100:00000001:28.0:1773851851.593947:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851851.593947:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000010:10.0:1773851851.593947:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d92ace2a.
02000000:00000001:31.0:1773851851.593948:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000040:29.0:1773851851.593948:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351479990272 avail=351478736896 avail_mb=1372963816 hwm_mb=3131101 files=372073173 ffree=343242178 state=0: rc = 0
02000000:00000001:28.0:1773851851.593948:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851851.593948:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851851.593948:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851851.593948:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851851.593948:0:41068:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:31.0:1773851851.593949:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851851.593949:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f0c0660c.
02000000:00000001:28.0:1773851851.593949:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851851.593949:0:41068:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000020:00000001:10.0:1773851851.593949:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:31.0:1773851851.593950:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851851.593950:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:29.0:1773851851.593950:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351479990272 free, 351478736896 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073173 files, 343242178 free files
00000100:00001000:28.0:1773851851.593950:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=84 v=66 (66 66 66 66)
02000000:00000010:10.0:1773851851.593950:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:31.0:1773851851.593951:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851851.593951:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851851.593951:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=84 v=66 (1 1 1 1)
02000000:00000001:10.0:1773851851.593951:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851851.593951:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:31.0:1773851851.593952:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851851.593952:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851851.593952:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:29.0:1773851851.593952:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851851.593952:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851851.593952:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:10.0:1773851851.593952:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001eed8194.
00000100:00000001:31.0:1773851851.593953:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851851.593953:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:28.0:1773851851.593953:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851851.593953:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851851.593953:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851851.593954:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851851.593954:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000001:10.0:1773851851.593954:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:29.0:1773851851.593955:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8e8c6f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051921792:9@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851851.593955:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851851.593955:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851851.593955:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851851.593955:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593956:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:28.0:1773851851.593956:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851851.593956:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851851.593956:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593957:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851851.593958:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b8e8c6f3 x1859433051921792/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851851.593958:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851851.593959:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851851.593959:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851851.593959:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:29.0:1773851851.593960:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851851.593960:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000040:28.0:1773851851.593960:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
02000000:00000010:29.0:1773851851.593961:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002cae99cb.
00000004:00000040:28.0:1773851851.593961:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615885312 avail=351613266944 avail_mb=1373489324 hwm_mb=3131103 files=372043550 ffree=343374888 state=0: rc = 0
02000000:00000001:29.0:1773851851.593962:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851851.593962:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851851.593963:0:41091:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000020:00000001:29.0:1773851851.593963:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000020:28.0:1773851851.593963:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615885312 free, 351613266944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043550 files, 343374888 free files
02000000:00000010:29.0:1773851851.593964:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000009f509882.
00000004:00000001:28.0:1773851851.593964:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851851.593965:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851851.593965:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:28.0:1773851851.593965:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:29.0:1773851851.593966:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8e8c6f3.
00000100:00000001:29.0:1773851851.593967:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851851.593967:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851851.593967:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851851.593968:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00100000:28.0:1773851851.593968:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a8bb7992 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051921920:2104@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851851.593969:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.593969:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851851.593970:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593970:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851851.593970:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851851.593971:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a8bb7992 x1859433051921920/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852004 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851851.593974:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851851.593974:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851851.593974:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ec11d2f7.
02000000:00000001:28.0:1773851851.593976:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851851.593976:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851851.593976:0:41088:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000020:00000001:28.0:1773851851.593977:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851851.593977:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a8444578.
02000000:00000001:28.0:1773851851.593978:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851851.593979:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851851.593979:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8bb7992.
00000100:00000001:28.0:1773851851.593980:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851851.593980:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851851.593981:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851851.593981:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851851.593982:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851851.593982:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851851.593983:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851851.646553:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851851.646555:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851851.646556:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851851.646561:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851851.646564:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.646566:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14018@kfi7 : PUT - for me
00000400:00000200:5.0:1773851851.646567:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.646569:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 1
00000400:00000200:5.0:1773851851.646570:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.646571:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000400:00000200:5.0:1773851851.646572:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 3
00000400:00000200:5.0:1773851851.646574:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14019@kfi7 to cpt 4
00000400:00000200:5.0:1773851851.646575:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14019@kfi7 of length 224 into portal 12 MB=0x699e0e7d75200
00000400:00000200:5.0:1773851851.646577:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14019@kfi7 of length 224/224 into md 0x793926dc5 [64] + 115344
00000800:00000200:5.0:1773851851.646580:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851851.646583:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851851.646585:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14018@kfi7: PUT: OK
00000100:00000001:5.0:1773851851.646586:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851851.646587:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851851.646589:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000610be6a2.
00000100:00000040:5.0:1773851851.646590:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000610be6a2 x1858041101636096 msgsize 224
00000100:00100000:5.0:1773851851.646592:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14019@kfi7 (source: 12345-14018@kfi7)
00000100:00000001:5.0:1773851851.646594:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851851.646595:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000100:00000001:7.0:1773851851.646596:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851851.646597:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851851.646597:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851851.646598:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851851.646599:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851851.646600:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851851.646602:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041101636096
00000020:00000001:7.0:1773851851.646603:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851851.646603:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925e0
00000020:00000001:7.0:1773851851.646604:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851851.646606:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f4bc5786 refcount=6
00000020:00000001:7.0:1773851851.646607:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631017472 : -107123078534144 : ffff9e9276f4ec00)
00000020:00000001:7.0:1773851851.646609:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631017472 : -107123078534144 : ffff9e9276f4ec00)
00000100:00000001:7.0:1773851851.646610:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851851.646611:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851851.646612:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000090a6c2c5.
00000020:00000010:7.0:1773851851.646614:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851851.646615:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003876d754.
00000100:00000001:7.0:1773851851.646617:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851851.646618:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851851.646619:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851851.646621:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851851.646622:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851851.646622:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.646624:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851851.646626:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851851.646627:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851851.646627:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851851.646627:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851851.646629:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14019@kfi7, seq: 2001840
00000100:00000040:7.0:1773851851.646630:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f4bc5786 : new rpc_count 1
00000100:00000001:5.0:1773851851.646630:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.646631:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046229120 : -106940663322496 : ffff9ebcefc02880)
00000100:00000001:5.0:1773851851.646631:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851851.646632:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000610be6a2 x1858041101636096/t0(0) o400->6b6ac767-84f5-4bcd-8873-5b9eb6f722cb@14019@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1367-0'
00000100:00000001:7.0:1773851851.646637:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851851.646638:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851851.646639:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000610be6a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6b6ac767-84f5-4bcd-8873-5b9eb6f722cb+6:39707:x1858041101636096:12345-14019@kfi7:400:default-tuolumne1367-0
00000100:00000200:7.0:1773851851.646641:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041101636096
00000020:00000001:7.0:1773851851.646642:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851851.646643:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851851.646644:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.646645:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851851.646646:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851851.646647:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851851.646648:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041101636096, found 0 last_xid 1858041101636095
00000020:00000001:7.0:1773851851.646649:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851851.646650:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851851.646651:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851851.646652:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.646653:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851851.646653:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851851.646654:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851851.646655:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000068054816.
02000000:00000001:7.0:1773851851.646656:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.646658:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.646659:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851851.646660:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693986, transno 0, xid 1858041101636096
00010000:00000001:7.0:1773851851.646661:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851851.646662:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000610be6a2 x1858041101636096/t0(0) o400->6b6ac767-84f5-4bcd-8873-5b9eb6f722cb@14019@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1367-0'
00010000:00000001:7.0:1773851851.646666:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851851.646667:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851851.646668:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=83 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851851.646670:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851851.646671:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007186c27d refcount 3 to 14019@kfi7
00000100:00000001:7.0:1773851851.646672:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095774976 : -107152613776640 : ffff9e8b9684e300)
02000000:00000001:7.0:1773851851.646673:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851851.646674:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.646675:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851851.646676:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14018@kfi7
00000400:00000010:7.0:1773851851.646677:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
00000100:00000200:7.0:1773851851.646679:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041101636096, offset 224
00000400:00000200:7.0:1773851851.646681:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14018@kfi7
00000400:00000200:7.0:1773851851.646682:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:7.0:1773851851.646684:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 1
00000400:00000200:7.0:1773851851.646685:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000400:00000200:7.0:1773851851.646687:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 3
00000400:00000200:7.0:1773851851.646688:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14018@kfi7 local destination
00000400:00000200:7.0:1773851851.646690:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768491:8768491:1024:4294967295] 14018@kfi7 LPNI seq info [7488133:7488133:16:4294967295]
00000400:00000200:7.0:1773851851.646693:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000400:00000200:7.0:1773851851.646694:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:7.0:1773851851.646697:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14018@kfi7(14018@kfi7:14018@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851851.646699:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 3
00000800:00000200:7.0:1773851851.646702:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851851.646703:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851851.646710:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851851.646713:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x498 Using peer 14018@kfi7(0x498)
00000800:00000200:7.0:1773851851.646717:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x498: rc=0
00000800:00000200:7.0:1773851851.646720:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x498 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851851.646723:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851851.646724:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007186c27d refcount 2 to 14019@kfi7
00010000:00000001:7.0:1773851851.646730:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851851.646731:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.646732:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851851.646733:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000610be6a2 x1858041101636096/t0(0) o400->6b6ac767-84f5-4bcd-8873-5b9eb6f722cb@14019@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1367-0'
00000800:00000200:5.0:1773851851.646736:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x498 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851851.646738:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000610be6a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6b6ac767-84f5-4bcd-8873-5b9eb6f722cb+6:39707:x1858041101636096:12345-14019@kfi7:400:default-tuolumne1367-0 Request processed in 100us (147us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851851.646739:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851851.646741:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14018@kfi7: PUT: OK
00000100:00100000:7.0:1773851851.646742:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14019@kfi7, seq: 2001840
00000400:00000200:5.0:1773851851.646742:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000100:00000040:7.0:1773851851.646743:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f4bc5786 : new rpc_count 0
00000400:00000010:5.0:1773851851.646743:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000100:00000001:7.0:1773851851.646744:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851851.646745:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851851.646745:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851851.646745:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851851.646746:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851851.646747:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003876d754.
00000400:00000200:5.0:1773851851.646747:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000020:00000010:7.0:1773851851.646748:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000090a6c2c5.
00000020:00000040:7.0:1773851851.646749:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000f4bc5786 : new refcount 5
00000800:00000200:5.0:1773851851.646749:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 14018@kfi7(00000000305c137d):0x0 lsk 1177 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x498 Transaction freed
00000100:00000001:7.0:1773851851.646750:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851851.657732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851851.657733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:15.0:1773851851.736599:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851851.736599:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851851.736600:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851851.736600:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851851.736601:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:15.0:1773851851.736602:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851851.736603:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19857@kfi7(0000000004911821):0x36d version: 2; local version 2; negotiated version: 2
00000800:00000200:15.0:1773851851.736604:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851851.736605:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d Using peer 19857@kfi7(0x10000000000036d)
00000400:00000200:15.0:1773851851.736606:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:15.0:1773851851.736607:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19857@kfi7 : PUT - for me
00000400:00000200:13.0:1773851851.736607:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:15.0:1773851851.736608:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:15.0:1773851851.736609:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 1
00000800:00000200:13.0:1773851851.736609:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 38 bytes to peer 0x10000000000036d: rc=0
00000400:00000200:15.0:1773851851.736610:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:15.0:1773851851.736611:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000800:00000200:13.0:1773851851.736611:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:15.0:1773851851.736612:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 3
00000400:00000200:15.0:1773851851.736613:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19856@kfi7 to cpt 0
00000400:00000200:15.0:1773851851.736614:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19856@kfi7 of length 224 into portal 12 MB=0x69b81a0ecd540
00000400:00000200:15.0:1773851851.736615:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19856@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 11880
00000800:00000200:15.0:1773851851.736618:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851851.736619:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851851.736621:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19857@kfi7: PUT: OK
00000100:00000001:15.0:1773851851.736622:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851851.736622:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851851.736623:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a762cfd.
00000800:00000200:13.0:1773851851.736623:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851851.736624:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000002a762cfd x1859830913226048 msgsize 224
00000100:00100000:15.0:1773851851.736625:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-19856@kfi7 (source: 12345-19857@kfi7)
00000800:00000200:13.0:1773851851.736625:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d Transaction freed
00000100:00000001:15.0:1773851851.736627:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851851.736628:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000800:00000200:15.0:1773851851.736629:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851851.736630:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851851.736631:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851851.736631:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851851.736632:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851851.736633:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851851.736634:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830913226048
00000020:00000001:13.0:1773851851.736634:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851851.736635:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce54255
00000020:00000001:13.0:1773851851.736635:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851851.736637:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006b180d1b refcount=5
00000020:00000001:13.0:1773851851.736638:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143576656896 : -106930132894720 : ffff9ebf6369bc00)
00000020:00000001:13.0:1773851851.736639:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143576656896 : -106930132894720 : ffff9ebf6369bc00)
00000100:00000001:13.0:1773851851.736641:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851851.736641:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851851.736642:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006643e087.
00000020:00000010:13.0:1773851851.736643:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851851.736644:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000239bdc0.
00000100:00000001:13.0:1773851851.736645:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851851.736645:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851851.736646:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851851.736647:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851851.736648:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851851.736648:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851851.736649:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851851.736651:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851851.736651:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851851.736651:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851851.736651:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851851.736652:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19856@kfi7, seq: 2289765
00000100:00000040:14.0:1773851851.736653:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006b180d1b : new rpc_count 1
00000100:00000001:13.0:1773851851.736653:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851851.736654:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860208000 : -107049849343616 : ffff9ea383c1b180)
00000100:00000001:13.0:1773851851.736654:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851851.736655:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002a762cfd x1859830913226048/t0(0) o400->79fdafa2-6645-4cea-a794-10701a3109b4@19856@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1730-0'
00000100:00000001:14.0:1773851851.736658:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851851.736659:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851851.736660:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a762cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:79fdafa2-6645-4cea-a794-10701a3109b4+5:39510:x1859830913226048:12345-19856@kfi7:400:default-tuolumne1730-0
00000100:00000200:14.0:1773851851.736661:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830913226048
00000020:00000001:14.0:1773851851.736662:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851851.736662:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851851.736663:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851851.736664:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851851.736664:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851851.736665:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851851.736666:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830913226048, found 0 last_xid 1859830913226047
00000020:00000001:14.0:1773851851.736666:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851851.736667:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851851.736668:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851851.736668:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851851.736669:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851851.736670:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851851.736670:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851851.736671:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d8eeec17.
02000000:00000001:14.0:1773851851.736671:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851851.736672:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851851.736673:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851851.736673:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096683572, transno 0, xid 1859830913226048
00010000:00000001:14.0:1773851851.736674:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851851.736675:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002a762cfd x1859830913226048/t0(0) o400->79fdafa2-6645-4cea-a794-10701a3109b4@19856@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1730-0'
00010000:00000001:14.0:1773851851.736677:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851851.736678:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851851.736678:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=84 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851851.736679:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851851.736680:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000999e0b93 refcount 3 to 19856@kfi7
00000100:00000001:14.0:1773851851.736681:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451616 : -107149715100000 : ffff9e8c434b2ea0)
02000000:00000001:14.0:1773851851.736682:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851851.736682:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851851.736684:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851851.736685:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19857@kfi7
00000400:00000010:14.0:1773851851.736686:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035dcf964.
00000100:00000200:14.0:1773851851.736687:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830913226048, offset 224
00000400:00000200:14.0:1773851851.736688:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19857@kfi7
00000400:00000200:14.0:1773851851.736689:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:14.0:1773851851.736690:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 1
00000400:00000200:14.0:1773851851.736691:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000400:00000200:14.0:1773851851.736692:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 3
00000400:00000200:14.0:1773851851.736693:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19857@kfi7 local destination
00000400:00000200:14.0:1773851851.736695:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768492:8768492:1024:4294967295] 19857@kfi7 LPNI seq info [138972:138972:16:4294967295]
00000400:00000200:14.0:1773851851.736696:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000400:00000200:14.0:1773851851.736697:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:14.0:1773851851.736699:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19857@kfi7(19857@kfi7:19857@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851851.736700:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 3
00000800:00000200:14.0:1773851851.736701:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851851.736702:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851851.736704:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851851.736706:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d Using peer 19857@kfi7(0x10000000000036d)
00000800:00000200:14.0:1773851851.736709:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000002eb192a5: Posted send of 324 bytes to peer 0x10000000000036d: rc=0
00000800:00000200:14.0:1773851851.736711:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851851.736713:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851851.736714:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000999e0b93 refcount 2 to 19856@kfi7
00010000:00000001:14.0:1773851851.736714:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851851.736715:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851851.736715:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851851.736716:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a762cfd x1859830913226048/t0(0) o400->79fdafa2-6645-4cea-a794-10701a3109b4@19856@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1730-0'
00000100:00100000:14.0:1773851851.736720:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a762cfd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:79fdafa2-6645-4cea-a794-10701a3109b4+5:39510:x1859830913226048:12345-19856@kfi7:400:default-tuolumne1730-0 Request processed in 61us (95us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851851.736722:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851851.736723:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19856@kfi7, seq: 2289765
00000100:00000040:14.0:1773851851.736723:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006b180d1b : new rpc_count 0
00000100:00000001:14.0:1773851851.736724:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851851.736724:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851851.736727:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851851.736727:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19857@kfi7: PUT: OK
00000020:00000010:14.0:1773851851.736728:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:14.0:1773851851.736728:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000239bdc0.
00000400:00000200:13.0:1773851851.736728:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035dcf964
00000400:00000010:13.0:1773851851.736728:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035dcf964.
00000020:00000010:14.0:1773851851.736729:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006643e087.
00000100:00000001:13.0:1773851851.736729:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:14.0:1773851851.736730:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000006b180d1b : new refcount 4
00000100:00000001:13.0:1773851851.736730:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:14.0:1773851851.736731:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851851.736731:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000800:00000200:13.0:1773851851.736732:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2054@kfi7:3 -> 19857@kfi7(0000000004911821):0x0 lsk 878 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000036d Transaction freed
00000800:00000200:27.0:1773851851.776112:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851851.776114:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851851.776116:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:27.0:1773851851.776121:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851851.776125:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:27.0:1773851851.776127:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13153@kfi7 : PUT - for me
00000400:00000200:27.0:1773851851.776130:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:27.0:1773851851.776131:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 1
00000400:00000200:27.0:1773851851.776133:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:27.0:1773851851.776134:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000400:00000200:27.0:1773851851.776135:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 3
00000400:00000200:27.0:1773851851.776137:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:27.0:1773851851.776140:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13153@kfi7 of length 224 into portal 12 MB=0x69b1761f681c0
00000400:00000200:27.0:1773851851.776143:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13153@kfi7 of length 224/224 into md 0x16159c6179 [64] + 177888
00000800:00000200:27.0:1773851851.776147:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851851.776150:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851851.776152:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13153@kfi7: PUT: OK
00000100:00000001:27.0:1773851851.776154:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851851.776154:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851851.776156:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc7c2ddc.
00000100:00000040:27.0:1773851851.776158:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000dc7c2ddc x1859374590362048 msgsize 224
00000100:00100000:27.0:1773851851.776160:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-13153@kfi7 (source: 12345-13153@kfi7)
00000100:00000001:27.0:1773851851.776162:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851851.776164:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000100:00000001:26.0:1773851851.776165:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851851.776166:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:27.0:1773851851.776167:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851851.776167:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851851.776168:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851851.776169:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851851.776171:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374590362048
00000020:00000001:26.0:1773851851.776172:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851851.776172:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793afc65fb
00000020:00000001:26.0:1773851851.776173:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851851.776176:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009f1d1626 refcount=5
00000020:00000001:26.0:1773851851.776177:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636955093846016 : -107118615705600 : ffff9e9380f64800)
00000020:00000001:26.0:1773851851.776178:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636955093846016 : -107118615705600 : ffff9e9380f64800)
00000100:00000001:26.0:1773851851.776180:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851851.776181:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851851.776182:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851851.776184:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851851.776185:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851851.776186:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851851.776187:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851851.776188:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851851.776190:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851851.776191:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851851.776191:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851851.776193:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851851.776195:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851851.776196:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851851.776196:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:26.0:1773851851.776198:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13153@kfi7, seq: 2025037
00000100:00000001:24.0:1773851851.776198:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851851.776201:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009f1d1626 : new rpc_count 1
00000100:00000001:24.0:1773851851.776201:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851851.776202:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998389376 : -107053711162240 : ffff9ea29d930480)
00000100:00000001:24.0:1773851851.776202:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851851.776204:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dc7c2ddc x1859374590362048/t0(0) o400->58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3@13153@kfi7:37/0 lens 224/0 e 0 to 0 dl 1773852152 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1312-0'
00000100:00000001:26.0:1773851851.776208:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851851.776209:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851851.776211:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7c2ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3+5:39888:x1859374590362048:12345-13153@kfi7:400:default-tuolumne1312-0
00000100:00000200:26.0:1773851851.776213:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374590362048
00000020:00000001:26.0:1773851851.776214:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851851.776215:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851851.776216:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851851.776217:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851851.776218:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851851.776220:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851851.776220:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374590362048, found 0 last_xid 1859374590362047
00000020:00000001:26.0:1773851851.776222:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851851.776223:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851851.776223:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851851.776224:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851851.776225:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851851.776226:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851851.776227:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851851.776228:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008455af9f.
02000000:00000001:26.0:1773851851.776229:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851851.776230:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851851.776231:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851851.776232:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182888316797, transno 0, xid 1859374590362048
00010000:00000001:26.0:1773851851.776234:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851851.776235:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dc7c2ddc x1859374590362048/t0(0) o400->58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3@13153@kfi7:37/0 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1312-0'
00010000:00000001:26.0:1773851851.776239:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851851.776240:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851851.776242:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=84 v=288 (288 212 1 1)
00000100:00000001:26.0:1773851851.776244:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851851.776245:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000eab27ea refcount 3 to 13153@kfi7
00000100:00000001:26.0:1773851851.776246:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860416 : -107149578691200 : ffff9e8c4b6c9d80)
02000000:00000001:26.0:1773851851.776247:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851851.776248:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851851.776249:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851851.776251:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13153@kfi7
00000400:00000010:26.0:1773851851.776252:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000909b9a2b.
00000100:00000200:26.0:1773851851.776253:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374590362048, offset 224
00000400:00000200:26.0:1773851851.776255:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13153@kfi7
00000400:00000200:26.0:1773851851.776257:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:26.0:1773851851.776258:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 1
00000400:00000200:26.0:1773851851.776260:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000400:00000200:26.0:1773851851.776262:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 3
00000400:00000200:26.0:1773851851.776263:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13153@kfi7 local destination
00000400:00000200:26.0:1773851851.776266:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768493:8768493:1024:4294967295] 13153@kfi7 LPNI seq info [27813202:27813202:16:4294967295]
00000400:00000200:26.0:1773851851.776268:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000400:00000200:26.0:1773851851.776269:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:26.0:1773851851.776272:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13153@kfi7(13153@kfi7:13153@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851851.776274:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 3
00000800:00000200:26.0:1773851851.776277:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851851.776279:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851851.776282:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851851.776287:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1ef Using peer 13153@kfi7(0x1ef)
00000800:00000200:26.0:1773851851.776292:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0x1ef: rc=0
00000800:00000200:26.0:1773851851.776294:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1ef TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851851.776302:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851851.776304:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000eab27ea refcount 2 to 13153@kfi7
00010000:00000001:26.0:1773851851.776305:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851851.776306:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851851.776307:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851851.776309:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dc7c2ddc x1859374590362048/t0(0) o400->58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3@13153@kfi7:37/0 lens 224/224 e 0 to 0 dl 1773852152 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1312-0'
00000800:00000200:25.0:1773851851.776310:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1ef TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851851.776313:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:26.0:1773851851.776315:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7c2ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3+5:39888:x1859374590362048:12345-13153@kfi7:400:default-tuolumne1312-0 Request processed in 105us (156us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851851.776316:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13153@kfi7: PUT: OK
00000400:00000200:25.0:1773851851.776317:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000909b9a2b
00000400:00000010:25.0:1773851851.776318:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000909b9a2b.
00000100:00000001:25.0:1773851851.776319:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:26.0:1773851851.776320:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13153@kfi7, seq: 2025037
00000100:00000001:25.0:1773851851.776320:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:26.0:1773851851.776321:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009f1d1626 : new rpc_count 0
00000100:00000001:26.0:1773851851.776322:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851851.776322:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000100:00000001:26.0:1773851851.776323:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851851.776324:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000800:00000200:25.0:1773851851.776325:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13153@kfi7(000000005ce3668d):0x0 lsk 496 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1ef Transaction freed
00000020:00000010:26.0:1773851851.776326:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851851.776327:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000020:00000040:26.0:1773851851.776329:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000009f1d1626 : new refcount 4
00000100:00000001:26.0:1773851851.776330:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851851.835577:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851851.835579:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851851.835580:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851851.835582:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851851.835584:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.835586:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9587@kfi7 : PUT - for me
00000400:00000200:21.0:1773851851.835587:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.835588:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 1
00000400:00000200:21.0:1773851851.835589:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.835590:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000400:00000200:21.0:1773851851.835591:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 3
00000400:00000200:21.0:1773851851.835591:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.835592:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9587@kfi7 of length 224 into portal 12 MB=0x69b16e344bac0
00000400:00000200:21.0:1773851851.835594:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9587@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 21568
00000800:00000200:21.0:1773851851.835595:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851851.835597:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851851.835598:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9587@kfi7: PUT: OK
00000100:00000001:21.0:1773851851.835599:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851851.835599:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851851.835600:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b774020.
00000100:00000040:21.0:1773851851.835600:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002b774020 x1859372464782016 msgsize 224
00000100:00100000:21.0:1773851851.835602:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9587@kfi7 (source: 12345-9587@kfi7)
00000100:00000001:21.0:1773851851.835603:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851851.835603:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000100:00000001:23.0:1773851851.835604:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851851.835605:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851851.835605:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851851.835605:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851851.835606:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851851.835617:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851851.835617:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372464782016
00000020:00000001:23.0:1773851851.835618:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851851.835619:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92570
00000020:00000001:23.0:1773851851.835619:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851851.835623:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001be2f3fc refcount=6
00000020:00000001:23.0:1773851851.835624:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630760448 : -107123078791168 : ffff9e9276f10000)
00000020:00000001:23.0:1773851851.835625:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630760448 : -107123078791168 : ffff9e9276f10000)
00000100:00000001:23.0:1773851851.835625:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851851.835626:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851851.835627:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e556a1b5.
00000020:00000010:23.0:1773851851.835628:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851851.835629:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851851.835630:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851851.835630:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851851.835631:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851851.835632:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851851.835632:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851851.835633:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851851.835633:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851851.835635:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851851.835635:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851851.835635:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851851.835636:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9587@kfi7, seq: 1997917
00000100:00000001:22.0:1773851851.835636:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851851.835637:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001be2f3fc : new rpc_count 1
00000100:00000001:23.0:1773851851.835637:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117332480 : -106995592219136 : ffff9eb025bbb600)
00000100:00000001:22.0:1773851851.835637:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851851.835637:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851851.835639:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002b774020 x1859372464782016/t0(0) o400->b9c8c5dc-d238-4795-82ef-ae3aafe74c61@9587@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1082-0'
00000100:00000001:23.0:1773851851.835641:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851851.835642:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851851.835643:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b774020 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b9c8c5dc-d238-4795-82ef-ae3aafe74c61+6:39481:x1859372464782016:12345-9587@kfi7:400:default-tuolumne1082-0
00000100:00000200:23.0:1773851851.835644:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372464782016
00000020:00000001:23.0:1773851851.835645:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851851.835646:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851851.835647:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.835647:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851851.835648:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851851.835649:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851851.835649:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372464782016, found 0 last_xid 1859372464782015
00000020:00000001:23.0:1773851851.835650:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851851.835651:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851851.835651:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851851.835652:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.835652:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851851.835653:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851851.835654:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851851.835654:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000038d4928f.
02000000:00000001:23.0:1773851851.835655:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851851.835655:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.835656:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851851.835657:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510527984, transno 0, xid 1859372464782016
00010000:00000001:23.0:1773851851.835658:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851851.835658:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002b774020 x1859372464782016/t0(0) o400->b9c8c5dc-d238-4795-82ef-ae3aafe74c61@9587@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1082-0'
00010000:00000001:23.0:1773851851.835661:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851851.835661:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851851.835662:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=84 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851851.835663:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851851.835664:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000704def3b refcount 3 to 9587@kfi7
00000100:00000001:23.0:1773851851.835664:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107744 : -107156354443872 : ffff9e8ab78ed5a0)
02000000:00000001:23.0:1773851851.835665:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851851.835666:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851851.835666:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851851.835667:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9587@kfi7
00000400:00000010:23.0:1773851851.835668:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c56f69f.
00000100:00000200:23.0:1773851851.835669:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372464782016, offset 224
00000400:00000200:23.0:1773851851.835670:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9587@kfi7
00000400:00000200:23.0:1773851851.835671:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:23.0:1773851851.835672:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 1
00000400:00000200:23.0:1773851851.835673:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000400:00000200:23.0:1773851851.835674:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 3
00000400:00000200:23.0:1773851851.835675:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9587@kfi7 local destination
00000400:00000200:23.0:1773851851.835676:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768494:8768494:1024:4294967295] 9587@kfi7 LPNI seq info [17485:17485:16:4294967295]
00000400:00000200:23.0:1773851851.835678:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000400:00000200:23.0:1773851851.835678:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:23.0:1773851851.835681:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9587@kfi7(9587@kfi7:9587@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851851.835682:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 3
00000800:00000200:23.0:1773851851.835683:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851851.835684:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851851.835686:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851851.835689:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x594 Using peer 9587@kfi7(0x594)
00000800:00000200:23.0:1773851851.835692:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x594: rc=0
00000800:00000200:23.0:1773851851.835693:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x594 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851851.835695:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851851.835696:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000704def3b refcount 2 to 9587@kfi7
00010000:00000001:23.0:1773851851.835697:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851851.835697:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.835698:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851851.835699:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002b774020 x1859372464782016/t0(0) o400->b9c8c5dc-d238-4795-82ef-ae3aafe74c61@9587@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1082-0'
00000100:00100000:23.0:1773851851.835701:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b774020 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b9c8c5dc-d238-4795-82ef-ae3aafe74c61+6:39481:x1859372464782016:12345-9587@kfi7:400:default-tuolumne1082-0 Request processed in 59us (100us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851851.835703:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9587@kfi7, seq: 1997917
00000100:00000040:23.0:1773851851.835704:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001be2f3fc : new rpc_count 0
00000100:00000001:23.0:1773851851.835705:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851851.835706:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851851.835706:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851851.835706:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x594 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851851.835707:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851851.835707:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851851.835708:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e556a1b5.
00000020:00000040:23.0:1773851851.835708:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000001be2f3fc : new refcount 5
00000400:00000200:21.0:1773851851.835708:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9587@kfi7: PUT: OK
00000100:00000001:23.0:1773851851.835709:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851851.835709:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c56f69f
00000400:00000010:21.0:1773851851.835709:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c56f69f.
00000100:00000001:21.0:1773851851.835710:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851851.835710:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851851.835711:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000800:00000200:21.0:1773851851.835713:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 9587@kfi7(00000000bfc2d26c):0x0 lsk 1429 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x594 Transaction freed
00000800:00000200:17.0:1773851851.842260:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851851.842260:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851851.842261:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851851.842263:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851851.842265:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.842266:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12291@kfi7 : PUT - for me
00000400:00000200:17.0:1773851851.842266:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.842267:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 1
00000400:00000200:17.0:1773851851.842268:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:17.0:1773851851.842269:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000400:00000200:17.0:1773851851.842270:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 3
00000400:00000200:17.0:1773851851.842271:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12483@kfi7 to cpt 6
00000400:00000200:17.0:1773851851.842272:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12483@kfi7 of length 224 into portal 12 MB=0x699e0a6c2dec0
00000400:00000200:17.0:1773851851.842273:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12483@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 187616
00000800:00000200:17.0:1773851851.842274:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851851.842276:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851851.842277:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12291@kfi7: PUT: OK
00000100:00000001:17.0:1773851851.842277:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851851.842278:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851851.842279:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d6e38e6d.
00000100:00000040:17.0:1773851851.842279:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000d6e38e6d x1858040009776832 msgsize 224
00000100:00100000:17.0:1773851851.842280:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12483@kfi7 (source: 12345-12291@kfi7)
00000100:00000001:17.0:1773851851.842281:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851851.842282:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000800:00000200:17.0:1773851851.842283:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851851.842284:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851851.842285:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851851.842285:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851851.842286:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851851.842287:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851851.842288:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040009776832
00000020:00000001:18.0:1773851851.842289:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851851.842290:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a10
00000020:00000001:18.0:1773851851.842291:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851851.842293:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8e20867 refcount=6
00000020:00000001:18.0:1773851851.842294:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242254336 : -107152467297280 : ffff9e8b9f3ffc00)
00000020:00000001:18.0:1773851851.842295:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242254336 : -107152467297280 : ffff9e8b9f3ffc00)
00000100:00000001:18.0:1773851851.842296:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851851.842297:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851851.842298:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a408a807.
00000020:00000010:18.0:1773851851.842300:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851851.842301:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066264e32.
00000100:00000001:18.0:1773851851.842302:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851851.842303:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851851.842304:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851851.842305:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851851.842306:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851851.842307:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851851.842308:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851851.842310:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851851.842310:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851851.842310:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851851.842311:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851851.842312:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12483@kfi7, seq: 2156250
00000100:00000040:19.0:1773851851.842312:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8e20867 : new rpc_count 1
00000100:00000001:19.0:1773851851.842313:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127300485632 : -106946409065984 : ffff9ebb99471200)
00000100:00000001:18.0:1773851851.842313:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851851.842314:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d6e38e6d x1858040009776832/t0(0) o400->eaccd46a-924c-467e-a4e3-8b698464c35c@12483@kfi7:41/0 lens 224/0 e 0 to 0 dl 1773852156 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1271-0'
00000100:00000001:18.0:1773851851.842314:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851851.842317:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851851.842317:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851851.842318:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6e38e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:eaccd46a-924c-467e-a4e3-8b698464c35c+6:39705:x1858040009776832:12345-12483@kfi7:400:default-tuolumne1271-0
00000100:00000200:19.0:1773851851.842320:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040009776832
00000020:00000001:19.0:1773851851.842320:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851851.842321:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851851.842322:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851851.842322:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851851.842323:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851851.842323:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851851.842324:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040009776832, found 0 last_xid 1858040009776831
00000020:00000001:19.0:1773851851.842325:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851851.842326:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851851.842326:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851851.842327:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851851.842327:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851851.842328:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851851.842328:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851851.842329:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000072ba4afe.
02000000:00000001:19.0:1773851851.842330:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851851.842330:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851851.842331:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851851.842332:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096705810, transno 0, xid 1858040009776832
00010000:00000001:19.0:1773851851.842332:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851851.842333:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d6e38e6d x1858040009776832/t0(0) o400->eaccd46a-924c-467e-a4e3-8b698464c35c@12483@kfi7:41/0 lens 224/224 e 0 to 0 dl 1773852156 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1271-0'
00010000:00000001:19.0:1773851851.842336:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851851.842337:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851851.842337:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=84 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851851.842338:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851851.842339:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000066079c3b refcount 3 to 12483@kfi7
00000100:00000001:19.0:1773851851.842340:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331776 : -107155410219840 : ffff9e8aefd68cc0)
02000000:00000001:19.0:1773851851.842340:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851851.842341:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851851.842342:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851851.842342:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12291@kfi7
00000400:00000010:19.0:1773851851.842343:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000638810d2.
00000100:00000200:19.0:1773851851.842343:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040009776832, offset 224
00000400:00000200:19.0:1773851851.842345:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12291@kfi7
00000400:00000200:19.0:1773851851.842346:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:19.0:1773851851.842346:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 1
00000400:00000200:19.0:1773851851.842347:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000400:00000200:19.0:1773851851.842348:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 3
00000400:00000200:19.0:1773851851.842349:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12291@kfi7 local destination
00000400:00000200:19.0:1773851851.842351:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768495:8768495:1024:4294967295] 12291@kfi7 LPNI seq info [255608:255608:16:4294967295]
00000400:00000200:19.0:1773851851.842352:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000400:00000200:19.0:1773851851.842353:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:19.0:1773851851.842354:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12291@kfi7(12291@kfi7:12291@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851851.842356:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 3
00000800:00000200:19.0:1773851851.842357:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851851.842358:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851851.842360:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851851.842362:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae6 Using peer 12291@kfi7(0x100000000000ae6)
00000800:00000200:19.0:1773851851.842365:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x100000000000ae6: rc=0
00000800:00000200:19.0:1773851851.842367:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851851.842369:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851851.842371:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000066079c3b refcount 2 to 12483@kfi7
00010000:00000001:19.0:1773851851.842371:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851851.842372:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851851.842373:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851851.842373:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d6e38e6d x1858040009776832/t0(0) o400->eaccd46a-924c-467e-a4e3-8b698464c35c@12483@kfi7:41/0 lens 224/224 e 0 to 0 dl 1773852156 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1271-0'
00000100:00100000:19.0:1773851851.842376:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6e38e6d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:eaccd46a-924c-467e-a4e3-8b698464c35c+6:39705:x1858040009776832:12345-12483@kfi7:400:default-tuolumne1271-0 Request processed in 58us (96us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851851.842379:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12483@kfi7, seq: 2156250
00000800:00000200:17.0:1773851851.842379:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae6 TN_EVENT_TX_OK event status 0
00000100:00000040:19.0:1773851851.842380:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8e20867 : new rpc_count 0
00000100:00000001:19.0:1773851851.842380:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851851.842380:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851851.842381:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851851.842381:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12291@kfi7: PUT: OK
00000020:00000010:19.0:1773851851.842382:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:19.0:1773851851.842382:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066264e32.
00000400:00000200:17.0:1773851851.842382:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000638810d2
00000400:00000010:17.0:1773851851.842382:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000638810d2.
00000020:00000010:19.0:1773851851.842383:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a408a807.
00000100:00000001:17.0:1773851851.842383:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851851.842383:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:19.0:1773851851.842384:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000a8e20867 : new refcount 5
00000400:00000200:17.0:1773851851.842384:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000100:00000001:19.0:1773851851.842385:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851851.842385:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 12291@kfi7(0000000006eb43f2):0x0 lsk 2791 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae6 Transaction freed
00000800:00000200:5.0:1773851851.855120:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851851.855121:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851851.855122:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851851.855125:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851851.855127:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23731@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.855128:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23731@kfi7 : PUT - for me
00000400:00000200:5.0:1773851851.855129:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23731@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.855130:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab684aee nid 23731@kfi7 refs 1
00000400:00000200:5.0:1773851851.855131:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23731@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.855131:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab684aee nid 23731@kfi7 refs 2
00000400:00000200:5.0:1773851851.855132:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ab684aee nid 23731@kfi7 refs 3
00000400:00000200:5.0:1773851851.855133:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23667@kfi7 to cpt 6
00000400:00000200:5.0:1773851851.855134:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23667@kfi7 of length 224 into portal 12 MB=0x699e0d39721c0
00000400:00000200:5.0:1773851851.855136:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23667@kfi7 of length 224/224 into md 0x793926dc5 [64] + 115568
00000800:00000200:5.0:1773851851.855137:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851851.855139:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851851.855140:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23731@kfi7: PUT: OK
00000100:00000001:5.0:1773851851.855141:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851851.855142:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851851.855143:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000011a532e8.
00000100:00000040:5.0:1773851851.855143:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000011a532e8 x1858040761885120 msgsize 224
00000100:00100000:5.0:1773851851.855145:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23667@kfi7 (source: 12345-23731@kfi7)
00000100:00000001:5.0:1773851851.855146:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851851.855147:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab684aee nid 23731@kfi7 refs 2
00000100:00000001:7.0:1773851851.855148:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851851.855148:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851851.855149:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851851.855149:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851851.855149:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851851.855150:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851851.855151:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040761885120
00000020:00000001:7.0:1773851851.855153:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851851.855153:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92068
00000020:00000001:7.0:1773851851.855153:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851851.855155:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000020e4e4b4 refcount=6
00000020:00000001:7.0:1773851851.855155:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629507072 : -107123080044544 : ffff9e9276dde000)
00000020:00000001:7.0:1773851851.855156:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629507072 : -107123080044544 : ffff9e9276dde000)
00000100:00000001:7.0:1773851851.855157:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851851.855158:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851851.855158:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000090a6c2c5.
00000020:00000010:7.0:1773851851.855159:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851851.855160:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003876d754.
00000100:00000001:7.0:1773851851.855161:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851851.855161:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851851.855162:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851851.855163:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851851.855163:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851851.855163:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.855164:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851851.855165:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851851.855166:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851851.855166:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851851.855166:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851851.855167:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23667@kfi7, seq: 2001841
00000100:00000040:7.0:1773851851.855168:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000020e4e4b4 : new rpc_count 1
00000100:00000001:7.0:1773851851.855168:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046227968 : -106940663323648 : ffff9ebcefc02400)
00000100:00000001:5.0:1773851851.855168:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.855169:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851851.855170:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000011a532e8 x1858040761885120/t0(0) o400->28adea76-dedb-4857-8cc9-30f2a67bcaa5@23667@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1962-0'
00000100:00000001:7.0:1773851851.855173:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851851.855173:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851851.855174:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011a532e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:28adea76-dedb-4857-8cc9-30f2a67bcaa5+6:39651:x1858040761885120:12345-23667@kfi7:400:default-tuolumne1962-0
00000100:00000200:7.0:1773851851.855175:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040761885120
00000020:00000001:7.0:1773851851.855176:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851851.855176:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851851.855177:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.855177:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851851.855178:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851851.855179:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851851.855179:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040761885120, found 0 last_xid 1858040761885119
00000020:00000001:7.0:1773851851.855180:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851851.855181:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851851.855181:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851851.855182:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.855183:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851851.855183:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851851.855184:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851851.855184:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c0753dba.
02000000:00000001:7.0:1773851851.855185:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.855186:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.855186:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851851.855187:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181817315201, transno 0, xid 1858040761885120
00010000:00000001:7.0:1773851851.855188:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851851.855189:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000011a532e8 x1858040761885120/t0(0) o400->28adea76-dedb-4857-8cc9-30f2a67bcaa5@23667@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1962-0'
00010000:00000001:7.0:1773851851.855191:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851851.855191:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851851.855192:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=83 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851851.855193:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851851.855194:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000831189aa refcount 3 to 23667@kfi7
00000100:00000001:7.0:1773851851.855195:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130859360 : -107149578692256 : ffff9e8c4b6c9960)
02000000:00000001:7.0:1773851851.855196:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851851.855196:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.855197:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851851.855198:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23731@kfi7
00000400:00000010:7.0:1773851851.855198:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
00000100:00000200:7.0:1773851851.855199:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040761885120, offset 224
00000400:00000200:7.0:1773851851.855200:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23731@kfi7
00000400:00000200:7.0:1773851851.855201:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23731@kfi7 to cpt 1
00000400:00000200:7.0:1773851851.855202:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab684aee nid 23731@kfi7 refs 1
00000400:00000200:7.0:1773851851.855203:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ab684aee nid 23731@kfi7 refs 2
00000400:00000200:7.0:1773851851.855204:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ab684aee nid 23731@kfi7 refs 3
00000400:00000200:7.0:1773851851.855205:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23731@kfi7 local destination
00000400:00000200:7.0:1773851851.855206:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768496:8768496:1024:4294967295] 23731@kfi7 LPNI seq info [178992:178992:16:4294967295]
00000400:00000200:7.0:1773851851.855208:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ab684aee nid 23731@kfi7 refs 2
00000400:00000200:7.0:1773851851.855209:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23731@kfi7 to cpt 1
00000400:00000200:7.0:1773851851.855211:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23731@kfi7(23731@kfi7:23731@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851851.855212:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ab684aee nid 23731@kfi7 refs 3
00000800:00000200:7.0:1773851851.855213:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851851.855214:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851851.855217:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851851.855219:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001ee Using peer 23731@kfi7(0x1000000000001ee)
00000800:00000200:7.0:1773851851.855222:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x1000000000001ee: rc=0
00000800:00000200:7.0:1773851851.855223:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001ee TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851851.855225:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851851.855226:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000831189aa refcount 2 to 23667@kfi7
00010000:00000001:7.0:1773851851.855227:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851851.855228:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851851.855228:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851851.855229:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000011a532e8 x1858040761885120/t0(0) o400->28adea76-dedb-4857-8cc9-30f2a67bcaa5@23667@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1962-0'
00000100:00100000:7.0:1773851851.855232:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011a532e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:28adea76-dedb-4857-8cc9-30f2a67bcaa5+6:39651:x1858040761885120:12345-23667@kfi7:400:default-tuolumne1962-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851851.855234:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23667@kfi7, seq: 2001841
00000100:00000040:7.0:1773851851.855235:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000020e4e4b4 : new rpc_count 0
00000800:00000200:5.0:1773851851.855235:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001ee TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851851.855236:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851851.855237:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851851.855237:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000200:5.0:1773851851.855237:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851851.855238:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003876d754.
00000400:00000200:5.0:1773851851.855238:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23731@kfi7: PUT: OK
00000020:00000010:7.0:1773851851.855239:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000090a6c2c5.
00000400:00000200:5.0:1773851851.855239:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000400:00000010:5.0:1773851851.855239:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000020:00000040:7.0:1773851851.855240:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000020e4e4b4 : new refcount 5
00000100:00000001:7.0:1773851851.855240:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851851.855240:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851851.855240:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851851.855241:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab684aee nid 23731@kfi7 refs 2
00000800:00000200:5.0:1773851851.855242:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 23731@kfi7(00000000325ca8f9):0x0 lsk 495 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001ee Transaction freed
00000800:00000200:30.0:1773851851.890138:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851851.890139:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851851.890140:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851851.890142:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851851.890146:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:30.0:1773851851.890147:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24610@kfi7 : PUT - for me
00000400:00000200:30.0:1773851851.890148:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:30.0:1773851851.890149:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 1
00000400:00000200:30.0:1773851851.890151:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:30.0:1773851851.890151:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000400:00000200:30.0:1773851851.890152:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 3
00000400:00000200:30.0:1773851851.890153:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24802@kfi7 to cpt 2
00000400:00000200:30.0:1773851851.890154:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24802@kfi7 of length 224 into portal 12 MB=0x69a9dbfb44400
00000400:00000200:30.0:1773851851.890156:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24802@kfi7 of length 224/224 into md 0x77fe139dd [64] + 157768
00000800:00000200:30.0:1773851851.890158:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851851.890159:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851851.890160:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24610@kfi7: PUT: OK
00000100:00000001:30.0:1773851851.890161:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851851.890162:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851851.890162:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f6ba6e11.
00000100:00000040:30.0:1773851851.890163:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000f6ba6e11 x1858852177069056 msgsize 224
00000100:00100000:30.0:1773851851.890164:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-24802@kfi7 (source: 12345-24610@kfi7)
00000100:00000001:30.0:1773851851.890166:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851851.890166:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000800:00000200:30.0:1773851851.890168:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851851.890169:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851851.890170:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851851.890171:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851851.890171:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851851.890173:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851851.890174:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858852177069056
00000020:00000001:29.0:1773851851.890175:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851851.890176:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917d2
00000020:00000001:29.0:1773851851.890177:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851851.890181:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e408d3e7 refcount=6
00000020:00000001:29.0:1773851851.890182:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241738240 : -107152467813376 : ffff9e8b9f381c00)
00000020:00000001:29.0:1773851851.890183:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241738240 : -107152467813376 : ffff9e8b9f381c00)
00000100:00000001:29.0:1773851851.890185:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851851.890186:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851851.890187:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001d1a7a8a.
00000020:00000010:29.0:1773851851.890188:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851851.890190:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851851.890191:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851851.890192:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851851.890193:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851851.890195:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851851.890195:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851851.890196:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.890198:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851851.890200:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851851.890201:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851851.890201:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851851.890202:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851851.890202:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24802@kfi7, seq: 2055444
00000100:00000001:31.0:1773851851.890204:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851851.890204:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e408d3e7 : new rpc_count 1
00000100:00000001:31.0:1773851851.890205:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.890205:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000837120 : -107100708714496 : ffff9e97ac4d4800)
00000100:00000040:29.0:1773851851.890207:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f6ba6e11 x1858852177069056/t0(0) o400->ff2c26b8-dedd-4a7b-b20c-24247e1a648d@24802@kfi7:639/0 lens 224/0 e 0 to 0 dl 1773851999 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2027-0'
00000100:00000001:29.0:1773851851.890212:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851851.890213:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851851.890214:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6ba6e11 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ff2c26b8-dedd-4a7b-b20c-24247e1a648d+6:39655:x1858852177069056:12345-24802@kfi7:400:default-tuolumne2027-0
00000100:00000200:29.0:1773851851.890216:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858852177069056
00000020:00000001:29.0:1773851851.890217:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851851.890218:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851851.890220:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851851.890221:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851851.890222:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851851.890223:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851851.890224:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858852177069056, found 0 last_xid 1858852177069055
00000020:00000001:29.0:1773851851.890225:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851851.890226:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851851.890227:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851851.890228:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851851.890229:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851851.890230:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851851.890230:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851851.890232:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000069907261.
02000000:00000001:29.0:1773851851.890233:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.890234:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851851.890235:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851851.890236:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824191, transno 0, xid 1858852177069056
00010000:00000001:29.0:1773851851.890237:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851851.890239:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f6ba6e11 x1858852177069056/t0(0) o400->ff2c26b8-dedd-4a7b-b20c-24247e1a648d@24802@kfi7:639/0 lens 224/224 e 0 to 0 dl 1773851999 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2027-0'
00010000:00000001:29.0:1773851851.890243:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851851.890244:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851851.890245:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=84 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851851.890247:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851851.890248:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000070fdc554 refcount 3 to 24802@kfi7
00000100:00000001:29.0:1773851851.890249:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133024 : -107146658418592 : ffff9e8cf97c7060)
02000000:00000001:29.0:1773851851.890250:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851851.890251:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851851.890252:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851851.890254:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24610@kfi7
00000400:00000010:29.0:1773851851.890255:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3501a9c.
00000100:00000200:29.0:1773851851.890256:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858852177069056, offset 224
00000400:00000200:29.0:1773851851.890258:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24610@kfi7
00000400:00000200:29.0:1773851851.890260:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:29.0:1773851851.890261:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 1
00000400:00000200:29.0:1773851851.890263:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000400:00000200:29.0:1773851851.890264:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 3
00000400:00000200:29.0:1773851851.890266:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24610@kfi7 local destination
00000400:00000200:29.0:1773851851.890268:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768497:8768497:1024:4294967295] 24610@kfi7 LPNI seq info [773233:773233:16:4294967295]
00000400:00000200:29.0:1773851851.890271:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000400:00000200:29.0:1773851851.890272:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:29.0:1773851851.890275:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24610@kfi7(24610@kfi7:24610@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851851.890277:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 3
00000800:00000200:29.0:1773851851.890280:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851851.890281:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851851.890285:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851851.890289:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd9 Using peer 24610@kfi7(0x100000000000fd9)
00000800:00000200:29.0:1773851851.890294:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x100000000000fd9: rc=0
00000800:00000200:29.0:1773851851.890296:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851851.890299:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851851.890301:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000070fdc554 refcount 2 to 24802@kfi7
00010000:00000001:29.0:1773851851.890302:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851851.890303:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851851.890304:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851851.890305:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f6ba6e11 x1858852177069056/t0(0) o400->ff2c26b8-dedd-4a7b-b20c-24247e1a648d@24802@kfi7:639/0 lens 224/224 e 0 to 0 dl 1773851999 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2027-0'
00000800:00000200:30.0:1773851851.890308:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd9 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851851.890309:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851851.890310:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24610@kfi7: PUT: OK
00000100:00100000:29.0:1773851851.890310:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6ba6e11 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ff2c26b8-dedd-4a7b-b20c-24247e1a648d+6:39655:x1858852177069056:12345-24802@kfi7:400:default-tuolumne2027-0 Request processed in 97us (145us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851851.890311:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3501a9c
00000400:00000010:30.0:1773851851.890312:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3501a9c.
00000100:00000001:30.0:1773851851.890312:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851851.890313:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851851.890314:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000100:00100000:29.0:1773851851.890314:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24802@kfi7, seq: 2055444
00000800:00000200:30.0:1773851851.890315:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 24610@kfi7(000000002593c9e0):0x0 lsk 4058 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd9 Transaction freed
00000100:00000040:29.0:1773851851.890315:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e408d3e7 : new rpc_count 0
00000100:00000001:29.0:1773851851.890316:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851851.890317:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851851.890318:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851851.890319:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000020:00000010:29.0:1773851851.890321:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001d1a7a8a.
00000020:00000040:29.0:1773851851.890322:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000e408d3e7 : new refcount 5
00000100:00000001:29.0:1773851851.890323:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851851.892090:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851851.892091:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851851.892093:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851851.892095:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851851.892097:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:10.0:1773851851.892098:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20354@kfi7 : PUT - for me
00000400:00000200:10.0:1773851851.892099:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:10.0:1773851851.892100:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 1
00000400:00000200:10.0:1773851851.892101:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:10.0:1773851851.892101:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000400:00000200:10.0:1773851851.892102:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 3
00000400:00000200:10.0:1773851851.892103:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20291@kfi7 to cpt 1
00000400:00000200:10.0:1773851851.892104:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20291@kfi7 of length 224 into portal 12 MB=0x69b0a3f2ce380
00000400:00000200:10.0:1773851851.892106:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20291@kfi7 of length 224/224 into md 0x78146ce49 [64] + 116312
00000800:00000200:10.0:1773851851.892108:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851851.892109:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851851.892111:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20354@kfi7: PUT: OK
00000100:00000001:10.0:1773851851.892112:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851851.892112:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851851.892113:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000025cdc6ba.
00000100:00000040:10.0:1773851851.892114:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000025cdc6ba x1859318172148608 msgsize 224
00000100:00100000:10.0:1773851851.892115:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20291@kfi7 (source: 12345-20354@kfi7)
00000100:00000001:10.0:1773851851.892116:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851851.892117:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000100:00000001:8.0:1773851851.892118:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851851.892118:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851851.892119:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851851.892119:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851851.892120:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851851.892121:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851851.892122:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318172148608
00000020:00000001:8.0:1773851851.892122:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851851.892123:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9243c
00000020:00000001:8.0:1773851851.892124:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851851.892126:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dde6cf3b refcount=6
00000020:00000001:8.0:1773851851.892126:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630525952 : -107123079025664 : ffff9e9276ed6c00)
00000020:00000001:8.0:1773851851.892127:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630525952 : -107123079025664 : ffff9e9276ed6c00)
00000100:00000001:8.0:1773851851.892129:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851851.892129:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851851.892130:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003ec85fa.
00000020:00000010:8.0:1773851851.892131:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851851.892132:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851851.892133:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851851.892133:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851851.892134:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851851.892135:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851851.892136:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851851.892136:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.892137:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851851.892138:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851851.892139:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851851.892140:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:8.0:1773851851.892140:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20291@kfi7, seq: 2130712
00000100:00000001:11.0:1773851851.892141:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:8.0:1773851851.892141:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dde6cf3b : new rpc_count 1
00000100:00000001:11.0:1773851851.892142:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.892142:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077433856 : -106968632117760 : ffff9eb66cae3600)
00000100:00000001:11.0:1773851851.892143:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851851.892143:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000025cdc6ba x1859318172148608/t0(0) o400->d5639816-d81a-4bc3-b4d8-29a95f8c3635@20291@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1768-0'
00000100:00000001:8.0:1773851851.892146:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851851.892146:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851851.892147:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025cdc6ba pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d5639816-d81a-4bc3-b4d8-29a95f8c3635+6:39544:x1859318172148608:12345-20291@kfi7:400:default-tuolumne1768-0
00000100:00000200:8.0:1773851851.892149:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318172148608
00000020:00000001:8.0:1773851851.892150:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851851.892151:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851851.892151:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.892152:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851851.892153:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851851.892154:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851851.892154:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318172148608, found 0 last_xid 1859318172148607
00000020:00000001:8.0:1773851851.892155:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851851.892156:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851851.892157:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851851.892157:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.892158:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851851.892158:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851851.892159:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851851.892160:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000015faf49d.
02000000:00000001:8.0:1773851851.892161:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.892161:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.892162:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851851.892163:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183208761549, transno 0, xid 1859318172148608
00010000:00000001:8.0:1773851851.892164:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851851.892165:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000025cdc6ba x1859318172148608/t0(0) o400->d5639816-d81a-4bc3-b4d8-29a95f8c3635@20291@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1768-0'
00010000:00000001:8.0:1773851851.892167:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851851.892168:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851851.892168:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=84 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851851.892170:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851851.892170:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aff866f1 refcount 3 to 20291@kfi7
00000100:00000001:8.0:1773851851.892171:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704608 : -107156155847008 : ffff9e8ac3652ea0)
02000000:00000001:8.0:1773851851.892172:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851851.892173:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.892173:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851851.892174:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20354@kfi7
00000400:00000010:8.0:1773851851.892175:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f71c7d5.
00000100:00000200:8.0:1773851851.892176:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318172148608, offset 224
00000400:00000200:8.0:1773851851.892177:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20354@kfi7
00000400:00000200:8.0:1773851851.892179:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:8.0:1773851851.892179:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 1
00000400:00000200:8.0:1773851851.892181:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000400:00000200:8.0:1773851851.892182:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 3
00000400:00000200:8.0:1773851851.892183:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20354@kfi7 local destination
00000400:00000200:8.0:1773851851.892184:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768498:8768498:1024:4294967295] 20354@kfi7 LPNI seq info [8766888:8766888:16:4294967295]
00000400:00000200:8.0:1773851851.892186:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000400:00000200:8.0:1773851851.892186:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:8.0:1773851851.892188:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20354@kfi7(20354@kfi7:20354@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851851.892190:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 3
00000800:00000200:8.0:1773851851.892191:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851851.892192:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851851.892194:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851851.892196:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf79 Using peer 20354@kfi7(0xf79)
00000800:00000200:8.0:1773851851.892199:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0xf79: rc=0
00000800:00000200:8.0:1773851851.892201:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851851.892203:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851851.892204:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aff866f1 refcount 2 to 20291@kfi7
00010000:00000001:8.0:1773851851.892204:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851851.892205:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.892206:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851851.892206:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000025cdc6ba x1859318172148608/t0(0) o400->d5639816-d81a-4bc3-b4d8-29a95f8c3635@20291@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1768-0'
00000100:00100000:8.0:1773851851.892210:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025cdc6ba pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d5639816-d81a-4bc3-b4d8-29a95f8c3635+6:39544:x1859318172148608:12345-20291@kfi7:400:default-tuolumne1768-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851851.892212:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20291@kfi7, seq: 2130712
00000100:00000040:8.0:1773851851.892213:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dde6cf3b : new rpc_count 0
00000100:00000001:8.0:1773851851.892214:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851851.892215:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851851.892215:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851851.892216:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851851.892217:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003ec85fa.
00000020:00000040:8.0:1773851851.892218:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000dde6cf3b : new refcount 5
00000100:00000001:8.0:1773851851.892219:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851851.892224:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf79 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851851.892226:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851851.892227:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20354@kfi7: PUT: OK
00000400:00000200:10.0:1773851851.892227:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f71c7d5
00000400:00000010:10.0:1773851851.892228:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f71c7d5.
00000100:00000001:10.0:1773851851.892229:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851851.892229:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851851.892230:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000800:00000200:10.0:1773851851.892232:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 20354@kfi7(00000000f090775b):0x0 lsk 3962 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf79 Transaction freed
00000800:00000200:5.0:1773851851.909229:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851851.909230:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851851.909232:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851851.909234:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851851.909236:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.909237:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11696@kfi7 : PUT - for me
00000400:00000200:5.0:1773851851.909238:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.909238:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 1
00000400:00000200:5.0:1773851851.909239:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.909240:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000400:00000200:5.0:1773851851.909241:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 3
00000400:00000200:5.0:1773851851.909242:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11632@kfi7 to cpt 6
00000400:00000200:5.0:1773851851.909243:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11632@kfi7 of length 224 into portal 12 MB=0x69b4c004487c0
00000400:00000200:5.0:1773851851.909245:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11632@kfi7 of length 224/224 into md 0x793926dc5 [64] + 115792
00000800:00000200:5.0:1773851851.909247:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851851.909248:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851851.909249:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11696@kfi7: PUT: OK
00000100:00000001:5.0:1773851851.909250:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851851.909251:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851851.909252:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b00193a8.
00000100:00000040:5.0:1773851851.909252:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000b00193a8 x1859600584574912 msgsize 224
00000100:00100000:5.0:1773851851.909254:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-11632@kfi7 (source: 12345-11696@kfi7)
00000100:00000001:5.0:1773851851.909255:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851851.909256:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000800:00000200:5.0:1773851851.909257:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851851.909258:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851851.909259:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851851.909259:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851851.909260:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851851.909261:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851851.909262:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600584574912
00000020:00000001:7.0:1773851851.909263:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851851.909264:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7f56f
00000020:00000001:7.0:1773851851.909265:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851851.909267:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000096bfa274 refcount=5
00000020:00000001:7.0:1773851851.909269:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636938641305600 : -107135068246016 : ffff9e8fac507000)
00000020:00000001:7.0:1773851851.909270:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636938641305600 : -107135068246016 : ffff9e8fac507000)
00000100:00000001:7.0:1773851851.909271:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851851.909272:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851851.909273:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000090a6c2c5.
00000020:00000010:7.0:1773851851.909275:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851851.909276:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003876d754.
00000100:00000001:7.0:1773851851.909278:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851851.909278:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851851.909279:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851851.909280:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851851.909281:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851851.909281:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851851.909283:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851851.909285:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851851.909285:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851851.909285:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851851.909286:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851851.909286:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11632@kfi7, seq: 2001842
00000100:00000001:7.0:1773851851.909287:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851851.909287:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000096bfa274 : new rpc_count 1
00000100:00000001:7.0:1773851851.909288:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.909288:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046246400 : -106940663305216 : ffff9ebcefc06c00)
00000100:00000040:5.0:1773851851.909289:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b00193a8 x1859600584574912/t0(0) o400->d3292450-52af-4bad-93b2-3895aa25a10b@11632@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1214-0'
00000100:00000001:5.0:1773851851.909291:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851851.909292:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851851.909293:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b00193a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d3292450-52af-4bad-93b2-3895aa25a10b+5:39707:x1859600584574912:12345-11632@kfi7:400:default-tuolumne1214-0
00000100:00000200:5.0:1773851851.909294:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600584574912
00000020:00000001:5.0:1773851851.909295:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851851.909295:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851851.909296:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851851.909297:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851851.909298:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851851.909299:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851851.909300:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600584574912, found 0 last_xid 1859600584574911
00000020:00000001:5.0:1773851851.909300:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851851.909301:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851851.909301:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851851.909302:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851851.909303:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851851.909303:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851851.909304:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851851.909305:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000029a4901c.
02000000:00000001:5.0:1773851851.909306:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.909306:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851851.909307:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851851.909307:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035363001, transno 0, xid 1859600584574912
00010000:00000001:5.0:1773851851.909308:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851851.909309:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b00193a8 x1859600584574912/t0(0) o400->d3292450-52af-4bad-93b2-3895aa25a10b@11632@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1214-0'
00010000:00000001:5.0:1773851851.909312:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851851.909312:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851851.909313:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=83 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851851.909314:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851851.909315:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009f542743 refcount 3 to 11632@kfi7
00000100:00000001:5.0:1773851851.909315:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313738240 : -107139395813376 : ffff9e8eaa5f0000)
02000000:00000001:5.0:1773851851.909316:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851851.909317:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851851.909317:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851851.909318:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11696@kfi7
00000400:00000010:5.0:1773851851.909319:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081188a2f.
00000100:00000200:5.0:1773851851.909319:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600584574912, offset 224
00000400:00000200:5.0:1773851851.909321:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11696@kfi7
00000400:00000200:5.0:1773851851.909322:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.909322:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 1
00000400:00000200:5.0:1773851851.909324:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000400:00000200:5.0:1773851851.909327:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 3
00000400:00000200:5.0:1773851851.909328:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11696@kfi7 local destination
00000400:00000200:5.0:1773851851.909329:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768499:8768499:1024:4294967295] 11696@kfi7 LPNI seq info [633603:633603:16:4294967295]
00000400:00000200:5.0:1773851851.909331:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000400:00000200:5.0:1773851851.909331:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851851.909333:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11696@kfi7(11696@kfi7:11696@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851851.909335:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 3
00000800:00000200:5.0:1773851851.909336:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851851.909337:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851851.909339:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851851.909341:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d0d Using peer 11696@kfi7(0x100000000000d0d)
00000800:00000200:5.0:1773851851.909344:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 324 bytes to peer 0x100000000000d0d: rc=0
00000800:00000200:5.0:1773851851.909345:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d0d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851851.909347:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851851.909348:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009f542743 refcount 2 to 11632@kfi7
00010000:00000001:5.0:1773851851.909349:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851851.909349:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851851.909350:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851851.909351:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b00193a8 x1859600584574912/t0(0) o400->d3292450-52af-4bad-93b2-3895aa25a10b@11632@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1214-0'
00000100:00100000:5.0:1773851851.909354:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b00193a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d3292450-52af-4bad-93b2-3895aa25a10b+5:39707:x1859600584574912:12345-11632@kfi7:400:default-tuolumne1214-0 Request processed in 61us (101us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851851.909356:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11632@kfi7, seq: 2001842
00000100:00000040:5.0:1773851851.909357:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000096bfa274 : new rpc_count 0
00000100:00000001:5.0:1773851851.909358:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851851.909359:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851851.909359:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000800:00000200:6.0:1773851851.909360:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d0d TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851851.909360:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003876d754.
00000020:00000010:5.0:1773851851.909361:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000090a6c2c5.
00000400:00000200:6.0:1773851851.909362:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:5.0:1773851851.909362:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000096bfa274 : new refcount 4
00000100:00000001:5.0:1773851851.909363:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851851.909364:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11696@kfi7: PUT: OK
00000400:00000200:6.0:1773851851.909365:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081188a2f
00000400:00000010:6.0:1773851851.909366:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081188a2f.
00000100:00000001:6.0:1773851851.909367:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851851.909368:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851851.909369:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000800:00000200:6.0:1773851851.909371:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 11696@kfi7(00000000bdd6963f):0x0 lsk 3342 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d0d Transaction freed
00010000:00000001:2.0:1773851851.913730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851851.913732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851851.913733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851851.913734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851851.913735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851851.913736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851851.913737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851851.913738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851851.913739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851851.913741:0:937831:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851851.913742:0:937831:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851851.913743:0:937831:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:9.0:1773851851.925709:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851851.925710:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851851.925712:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851851.925715:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851851.925717:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851851.925718:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.25@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851851.925719:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851851.925720:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851851.925722:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.25@o2ib60 to cpt 2
00000400:00000200:9.0:1773851851.925723:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 2
00000400:00000200:9.0:1773851851.925724:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 3
00000400:00000200:9.0:1773851851.925730:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.25@o2ib60 to cpt 2
00000400:00000200:9.0:1773851851.925732:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.25@o2ib60 of length 224 into portal 12 MB=0x69a0ced30a0c0
00000400:00000200:9.0:1773851851.925734:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.25@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 116536
00000800:00000200:9.0:1773851851.925736:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851851.925739:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851851.925740:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851851.925741:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851851.925742:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851851.925743:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008ac7558c.
00000100:00000040:9.0:1773851851.925743:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000008ac7558c x1858230169936064 msgsize 224
00000100:00100000:9.0:1773851851.925746:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.25@o2ib60 (source: 12345-192.168.128.25@o2ib60)
00000100:00000001:9.0:1773851851.925747:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851851.925748:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:8.0:1773851851.925749:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851851.925750:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851851.925750:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851851.925750:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851851.925751:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851851.925752:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851851.925753:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858230169936064
00000020:00000001:8.0:1773851851.925754:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851851.925754:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93028
00000020:00000001:8.0:1773851851.925755:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851851.925756:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bcf147e8 refcount=6
00000020:00000001:8.0:1773851851.925757:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745165824 : -107128964385792 : ffff9e911821f400)
00000020:00000001:8.0:1773851851.925758:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745165824 : -107128964385792 : ffff9e911821f400)
00000100:00000001:8.0:1773851851.925759:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851851.925760:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851851.925761:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089926a18.
00000020:00000010:8.0:1773851851.925762:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851851.925763:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851851.925764:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851851.925765:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851851.925766:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851851.925767:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851851.925767:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851851.925768:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.925770:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851851.925771:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851851.925771:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851851.925772:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851851.925772:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851851.925773:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.25@o2ib60, seq: 2130713
00000100:00000040:8.0:1773851851.925774:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bcf147e8 : new rpc_count 1
00000100:00000001:11.0:1773851851.925775:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851851.925775:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.925775:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792131712 : -106938917419904 : ffff9ebd57d08480)
00000100:00000040:8.0:1773851851.925777:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008ac7558c x1858230169936064/t0(0) o400->69314898-c1f0-4dd0-9825-7592e9b9a02e@192.168.128.25@o2ib60:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix25-0'
00000100:00000001:8.0:1773851851.925780:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851851.925780:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851851.925782:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ac7558c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:69314898-c1f0-4dd0-9825-7592e9b9a02e+6:41321:x1858230169936064:12345-192.168.128.25@o2ib60:400:default-matrix25-0
00000100:00000200:8.0:1773851851.925783:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858230169936064
00000020:00000001:8.0:1773851851.925784:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851851.925785:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851851.925786:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.925787:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851851.925787:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851851.925788:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851851.925789:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858230169936064, found 0 last_xid 1858230169936063
00000020:00000001:8.0:1773851851.925790:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851851.925791:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851851.925792:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851851.925792:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.925793:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851851.925794:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851851.925795:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851851.925795:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000003ec85fa.
02000000:00000001:8.0:1773851851.925796:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.925797:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.925798:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851851.925799:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858230169936064
00010000:00000001:8.0:1773851851.925799:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851851.925801:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008ac7558c x1858230169936064/t0(0) o400->69314898-c1f0-4dd0-9825-7592e9b9a02e@192.168.128.25@o2ib60:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix25-0'
00010000:00000001:8.0:1773851851.925804:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851851.925804:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851851.925806:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=84 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851851.925807:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851851.925808:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a54d2907 refcount 3 to 192.168.128.25@o2ib60
00000100:00000001:8.0:1773851851.925809:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051136576 : -107146658415040 : ffff9e8cf97c7e40)
02000000:00000001:8.0:1773851851.925810:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851851.925811:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.925811:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851851.925813:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.25@o2ib60
00000400:00000010:8.0:1773851851.925814:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002bb674c2.
00000100:00000200:8.0:1773851851.925814:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858230169936064, offset 224
00000400:00000200:8.0:1773851851.925816:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.25@o2ib60
00000400:00000200:8.0:1773851851.925817:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.25@o2ib60 to cpt 2
00000400:00000200:8.0:1773851851.925818:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 2
00000400:00000200:8.0:1773851851.925820:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 3
00000400:00000200:8.0:1773851851.925822:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 4
00000400:00000200:8.0:1773851851.925824:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.25@o2ib60 routed destination
00000400:00000200:8.0:1773851851.925825:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:8.0:1773851851.925826:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:8.0:1773851851.925828:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.25@o2ib60: rtr pref emtpy: 1
00000400:00000200:8.0:1773851851.925829:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:8.0:1773851851.925830:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.25@o2ib60: rtr pref emtpy: 1
00000400:00000200:8.0:1773851851.925831:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:8.0:1773851851.925832:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768500:8768500:1024:4294967295] 17@kfi7 LPNI seq info [1250891881:1250891881:16:4294967295]
00000400:00000200:8.0:1773851851.925834:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:8.0:1773851851.925835:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:8.0:1773851851.925838:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.25@o2ib60(192.168.128.25@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851851.925840:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 3
00000800:00000200:8.0:1773851851.925841:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851851.925842:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851851.925845:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851851.925849:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:8.0:1773851851.925853:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:8.0:1773851851.925854:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851851.925856:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851851.925858:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a54d2907 refcount 2 to 192.168.128.25@o2ib60
00010000:00000001:8.0:1773851851.925858:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851851.925859:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.925859:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851851.925860:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008ac7558c x1858230169936064/t0(0) o400->69314898-c1f0-4dd0-9825-7592e9b9a02e@192.168.128.25@o2ib60:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix25-0'
00000100:00100000:8.0:1773851851.925865:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ac7558c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:69314898-c1f0-4dd0-9825-7592e9b9a02e+6:41321:x1858230169936064:12345-192.168.128.25@o2ib60:400:default-matrix25-0 Request processed in 84us (120us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851851.925868:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.25@o2ib60, seq: 2130713
00000100:00000040:8.0:1773851851.925868:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bcf147e8 : new rpc_count 0
00000100:00000001:8.0:1773851851.925869:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851851.925870:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851851.925870:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851851.925871:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851851.925872:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089926a18.
00000020:00000040:8.0:1773851851.925872:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000bcf147e8 : new refcount 5
00000100:00000001:8.0:1773851851.925873:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851851.925878:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851851.925879:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851851.925880:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:9.0:1773851851.925881:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002bb674c2
00000400:00000010:9.0:1773851851.925882:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002bb674c2.
00000100:00000001:9.0:1773851851.925882:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851851.925883:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851851.925884:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851851.925885:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000800:00000200:9.0:1773851851.945082:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851851.945082:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851851.945084:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851851.945086:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851851.945088:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20451@kfi7 to cpt 2
00000400:00000200:9.0:1773851851.945089:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20451@kfi7 : PUT - for me
00000400:00000200:9.0:1773851851.945090:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20451@kfi7 to cpt 2
00000400:00000200:9.0:1773851851.945091:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1285467 nid 20451@kfi7 refs 1
00000400:00000200:9.0:1773851851.945093:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20451@kfi7 to cpt 2
00000400:00000200:9.0:1773851851.945093:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1285467 nid 20451@kfi7 refs 2
00000400:00000200:9.0:1773851851.945094:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c1285467 nid 20451@kfi7 refs 3
00000400:00000200:9.0:1773851851.945095:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20259@kfi7 to cpt 0
00000400:00000200:9.0:1773851851.945096:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20259@kfi7 of length 224 into portal 12 MB=0x699e144e52540
00000400:00000200:9.0:1773851851.945097:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20259@kfi7 of length 224/224 into md 0x78146ce49 [64] + 116760
00000800:00000200:9.0:1773851851.945099:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851851.945101:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851851.945102:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20451@kfi7: PUT: OK
00000100:00000001:9.0:1773851851.945103:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851851.945103:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851851.945104:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d174ec8f.
00000100:00000040:9.0:1773851851.945105:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d174ec8f x1858042662823232 msgsize 224
00000100:00100000:9.0:1773851851.945107:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20259@kfi7 (source: 12345-20451@kfi7)
00000100:00000001:9.0:1773851851.945107:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851851.945108:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1285467 nid 20451@kfi7 refs 2
00000100:00000001:8.0:1773851851.945109:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851851.945109:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851851.945110:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851851.945110:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851851.945110:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851851.945111:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851851.945111:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042662823232
00000020:00000001:8.0:1773851851.945112:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851851.945113:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac921b8
00000020:00000001:8.0:1773851851.945113:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851851.945115:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007958b3ca refcount=481
00000020:00000001:8.0:1773851851.945115:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629771264 : -107123079780352 : ffff9e9276e1e800)
00000020:00000001:8.0:1773851851.945116:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629771264 : -107123079780352 : ffff9e9276e1e800)
00000100:00000001:8.0:1773851851.945116:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851851.945117:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851851.945118:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089926a18.
00000020:00000010:8.0:1773851851.945118:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851851.945119:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851851.945120:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851851.945120:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851851.945120:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851851.945121:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851851.945121:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851851.945122:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.945123:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851851.945124:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851851.945124:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851851.945124:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851851.945125:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851851.945125:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20259@kfi7, seq: 2130714
00000100:00000001:11.0:1773851851.945126:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851851.945126:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851851.945126:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007958b3ca : new rpc_count 8
00000100:00000001:8.0:1773851851.945126:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792150144 : -106938917401472 : ffff9ebd57d0cc80)
00000100:00000040:8.0:1773851851.945127:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d174ec8f x1858042662823232/t0(0) o400->3d41f69c-c681-4606-b049-c7a92f29f23d@20259@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1755-0'
00000100:00000001:8.0:1773851851.945130:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851851.945130:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851851.945131:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d174ec8f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:3d41f69c-c681-4606-b049-c7a92f29f23d+481:39655:x1858042662823232:12345-20259@kfi7:400:default-tuolumne1755-0
00000100:00000200:8.0:1773851851.945133:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042662823232
00000020:00000001:8.0:1773851851.945133:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851851.945133:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851851.945134:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.945134:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851851.945136:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851851.945136:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851851.945137:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042662823232, found 0 last_xid 1858042623667775
00000020:00000001:8.0:1773851851.945137:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851851.945138:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851851.945138:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851851.945139:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.945139:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851851.945140:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851851.945140:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851851.945141:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000836421ef.
02000000:00000001:8.0:1773851851.945142:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.945142:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.945143:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851851.945143:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592967, transno 0, xid 1858042662823232
00010000:00000001:8.0:1773851851.945144:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851851.945145:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d174ec8f x1858042662823232/t0(0) o400->3d41f69c-c681-4606-b049-c7a92f29f23d@20259@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1755-0'
00010000:00000001:8.0:1773851851.945147:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851851.945147:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851851.945148:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=84 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851851.945149:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851851.945149:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000567c149 refcount 3 to 20259@kfi7
00000100:00000001:8.0:1773851851.945150:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850077856 : -107143859473760 : ffff9e8da050f2a0)
02000000:00000001:8.0:1773851851.945151:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851851.945151:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851851.945152:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851851.945153:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20451@kfi7
00000400:00000010:8.0:1773851851.945153:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006188a4b8.
00000100:00000200:8.0:1773851851.945154:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042662823232, offset 224
00000400:00000200:8.0:1773851851.945155:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20451@kfi7
00000400:00000200:8.0:1773851851.945156:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20451@kfi7 to cpt 2
00000400:00000200:8.0:1773851851.945157:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1285467 nid 20451@kfi7 refs 1
00000400:00000200:8.0:1773851851.945158:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c1285467 nid 20451@kfi7 refs 2
00000400:00000200:8.0:1773851851.945159:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c1285467 nid 20451@kfi7 refs 3
00000400:00000200:8.0:1773851851.945160:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20451@kfi7 local destination
00000400:00000200:8.0:1773851851.945162:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768501:8768501:1024:4294967295] 20451@kfi7 LPNI seq info [10326436:10326436:16:4294967295]
00000400:00000200:8.0:1773851851.945163:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c1285467 nid 20451@kfi7 refs 2
00000400:00000200:8.0:1773851851.945164:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20451@kfi7 to cpt 2
00000400:00000200:8.0:1773851851.945166:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20451@kfi7(20451@kfi7:20451@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851851.945167:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c1285467 nid 20451@kfi7 refs 3
00000800:00000200:8.0:1773851851.945168:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851851.945169:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851851.945171:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851851.945173:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ff Using peer 20451@kfi7(0x4ff)
00000800:00000200:8.0:1773851851.945176:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x4ff: rc=0
00000800:00000200:8.0:1773851851.945177:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851851.945179:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851851.945179:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000567c149 refcount 2 to 20259@kfi7
00010000:00000001:8.0:1773851851.945180:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851851.945180:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851851.945181:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851851.945181:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d174ec8f x1858042662823232/t0(0) o400->3d41f69c-c681-4606-b049-c7a92f29f23d@20259@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1755-0'
00000100:00100000:8.0:1773851851.945185:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d174ec8f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:3d41f69c-c681-4606-b049-c7a92f29f23d+481:39655:x1858042662823232:12345-20259@kfi7:400:default-tuolumne1755-0 Request processed in 54us (79us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851851.945187:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20259@kfi7, seq: 2130714
00000100:00000040:8.0:1773851851.945187:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007958b3ca : new rpc_count 7
00000100:00000001:8.0:1773851851.945188:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851851.945189:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851851.945189:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851851.945190:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851851.945191:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089926a18.
00000020:00000040:8.0:1773851851.945192:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000007958b3ca : new refcount 480
00000100:00000001:8.0:1773851851.945192:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851851.945196:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ff TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851851.945198:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851851.945199:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20451@kfi7: PUT: OK
00000400:00000200:9.0:1773851851.945199:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006188a4b8
00000400:00000010:9.0:1773851851.945200:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006188a4b8.
00000100:00000001:9.0:1773851851.945200:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851851.945201:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851851.945201:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1285467 nid 20451@kfi7 refs 2
00000800:00000200:9.0:1773851851.945203:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20451@kfi7(00000000ef193035):0x0 lsk 1280 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ff Transaction freed
00000800:00000200:21.0:1773851851.979844:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851851.979845:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851851.979846:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851851.979848:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851851.979849:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.979850:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17491@kfi7 : PUT - for me
00000400:00000200:21.0:1773851851.979851:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.979852:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 1
00000400:00000200:21.0:1773851851.979853:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.979854:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000400:00000200:21.0:1773851851.979854:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 3
00000400:00000200:21.0:1773851851.979855:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851851.979856:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17491@kfi7 of length 224 into portal 12 MB=0x699e11ad72e40
00000400:00000200:21.0:1773851851.979857:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17491@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 21792
00000800:00000200:21.0:1773851851.979859:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851851.979860:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851851.979861:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17491@kfi7: PUT: OK
00000100:00000001:21.0:1773851851.979862:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851851.979862:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851851.979863:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000955df05.
00000100:00000040:21.0:1773851851.979864:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000955df05 x1858041957264960 msgsize 224
00000100:00100000:21.0:1773851851.979865:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17491@kfi7 (source: 12345-17491@kfi7)
00000100:00000001:21.0:1773851851.979866:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851851.979867:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000100:00000001:23.0:1773851851.979868:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851851.979868:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851851.979869:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851851.979869:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851851.979870:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851851.979870:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851851.979871:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041957264960
00000020:00000001:23.0:1773851851.979872:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851851.979872:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92259
00000020:00000001:23.0:1773851851.979873:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851851.979876:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f5875560 refcount=7
00000020:00000001:23.0:1773851851.979876:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630010880 : -107123079540736 : ffff9e9276e59000)
00000020:00000001:23.0:1773851851.979877:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630010880 : -107123079540736 : ffff9e9276e59000)
00000100:00000001:23.0:1773851851.979878:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851851.979879:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851851.979879:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e556a1b5.
00000020:00000010:23.0:1773851851.979880:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851851.979881:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851851.979882:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851851.979882:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851851.979883:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851851.979884:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851851.979884:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851851.979885:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851851.979886:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851851.979887:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851851.979888:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851851.979889:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17491@kfi7, seq: 1997918
00000100:00000001:22.0:1773851851.979889:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851851.979889:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851851.979890:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f5875560 : new rpc_count 1
00000100:00000001:23.0:1773851851.979890:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117337088 : -106995592214528 : ffff9eb025bbc800)
00000100:00000001:22.0:1773851851.979890:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851851.979891:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000955df05 x1858041957264960/t0(0) o400->ffa2222d-56e5-4372-aae4-de164838bb86@17491@kfi7:578/0 lens 224/0 e 0 to 0 dl 1773851938 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1590-0'
00000100:00000001:22.0:1773851851.979891:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851851.979894:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851851.979895:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851851.979896:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000955df05 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ffa2222d-56e5-4372-aae4-de164838bb86+7:39619:x1858041957264960:12345-17491@kfi7:400:default-tuolumne1590-0
00000100:00000200:23.0:1773851851.979897:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041957264960
00000020:00000001:23.0:1773851851.979898:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851851.979898:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851851.979899:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.979899:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851851.979900:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851851.979901:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851851.979901:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041957264960, found 0 last_xid 1858041957264959
00000020:00000001:23.0:1773851851.979902:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851851.979903:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851851.979903:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851851.979904:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.979904:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851851.979905:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851851.979905:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851851.979906:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000066cb8064.
02000000:00000001:23.0:1773851851.979907:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851851.979907:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.979908:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851851.979909:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183245961964, transno 0, xid 1858041957264960
00010000:00000001:23.0:1773851851.979910:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851851.979910:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000955df05 x1858041957264960/t0(0) o400->ffa2222d-56e5-4372-aae4-de164838bb86@17491@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1590-0'
00010000:00000001:23.0:1773851851.979913:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851851.979913:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851851.979915:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=84 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851851.979915:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851851.979916:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000098b2b123 refcount 3 to 17491@kfi7
00000100:00000001:23.0:1773851851.979917:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452096 : -107146752099520 : ffff9e8cf3e6fb40)
02000000:00000001:23.0:1773851851.979918:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851851.979918:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851851.979919:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851851.979920:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17491@kfi7
00000400:00000010:23.0:1773851851.979920:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000571e5f64.
00000100:00000200:23.0:1773851851.979921:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041957264960, offset 224
00000400:00000200:23.0:1773851851.979922:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17491@kfi7
00000400:00000200:23.0:1773851851.979923:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:23.0:1773851851.979924:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 1
00000400:00000200:23.0:1773851851.979925:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000400:00000200:23.0:1773851851.979926:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 3
00000400:00000200:23.0:1773851851.979927:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17491@kfi7 local destination
00000400:00000200:23.0:1773851851.979928:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768502:8768502:1024:4294967295] 17491@kfi7 LPNI seq info [384899:384899:16:4294967295]
00000400:00000200:23.0:1773851851.979930:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000400:00000200:23.0:1773851851.979930:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:23.0:1773851851.979932:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17491@kfi7(17491@kfi7:17491@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851851.979933:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 3
00000800:00000200:23.0:1773851851.979935:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851851.979936:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851851.979938:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851851.979940:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x126 Using peer 17491@kfi7(0x126)
00000800:00000200:23.0:1773851851.979943:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0x126: rc=0
00000800:00000200:23.0:1773851851.979945:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x126 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851851.979948:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851851.979949:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000098b2b123 refcount 2 to 17491@kfi7
00010000:00000001:23.0:1773851851.979950:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851851.979951:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851851.979951:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851851.979952:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000955df05 x1858041957264960/t0(0) o400->ffa2222d-56e5-4372-aae4-de164838bb86@17491@kfi7:578/0 lens 224/224 e 0 to 0 dl 1773851938 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1590-0'
00000100:00100000:23.0:1773851851.979955:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000955df05 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ffa2222d-56e5-4372-aae4-de164838bb86+7:39619:x1858041957264960:12345-17491@kfi7:400:default-tuolumne1590-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851851.979956:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x126 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851851.979958:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17491@kfi7, seq: 1997918
00000100:00000040:23.0:1773851851.979958:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f5875560 : new rpc_count 0
00000400:00000200:21.0:1773851851.979958:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851851.979959:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851851.979959:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17491@kfi7: PUT: OK
00000400:00000200:21.0:1773851851.979959:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000571e5f64
00000100:00000001:23.0:1773851851.979960:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851851.979960:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000010:21.0:1773851851.979960:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000571e5f64.
00000100:00000001:21.0:1773851851.979960:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851851.979961:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000100:00000001:21.0:1773851851.979961:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851851.979962:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e556a1b5.
00000400:00000200:21.0:1773851851.979962:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000020:00000040:23.0:1773851851.979963:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000f5875560 : new refcount 6
00000800:00000200:21.0:1773851851.979963:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17491@kfi7(0000000013f0dea2):0x0 lsk 295 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x126 Transaction freed
00000100:00000001:23.0:1773851851.979964:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851852.026082:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.026083:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.026084:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851852.026086:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851852.026088:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.026089:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19840@kfi7 : PUT - for me
00000400:00000200:29.0:1773851852.026090:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.026092:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f74301d6 nid 19840@kfi7 refs 1
00000400:00000200:29.0:1773851852.026093:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.026093:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f74301d6 nid 19840@kfi7 refs 2
00000400:00000200:29.0:1773851852.026094:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f74301d6 nid 19840@kfi7 refs 3
00000400:00000200:29.0:1773851852.026095:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000400:00000200:29.0:1773851852.026096:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19841@kfi7 of length 224 into portal 12 MB=0x69b0978f329c0
00000400:00000200:29.0:1773851852.026098:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19841@kfi7 of length 224/224 into md 0x77fe139dd [64] + 157992
00000800:00000200:29.0:1773851852.026099:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851852.026101:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851852.026102:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19840@kfi7: PUT: OK
00000100:00000001:29.0:1773851852.026103:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851852.026103:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851852.026104:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000593d5b1.
00000100:00000040:29.0:1773851852.026105:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000000593d5b1 x1859314846476736 msgsize 224
00000100:00100000:29.0:1773851852.026106:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19841@kfi7 (source: 12345-19840@kfi7)
00000100:00000001:29.0:1773851852.026107:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851852.026108:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f74301d6 nid 19840@kfi7 refs 2
00000800:00000200:29.0:1773851852.026110:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851852.026112:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851852.026113:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851852.026113:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851852.026114:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.026114:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.026115:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314846476736
00000020:00000001:29.0:1773851852.026115:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851852.026116:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91539
00000020:00000001:29.0:1773851852.026116:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851852.026119:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001fe18b5e refcount=9
00000020:00000001:29.0:1773851852.026120:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241021440 : -107152468530176 : ffff9e8b9f2d2c00)
00000020:00000001:29.0:1773851852.026121:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241021440 : -107152468530176 : ffff9e8b9f2d2c00)
00000100:00000001:29.0:1773851852.026121:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.026122:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851852.026123:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001d1a7a8a.
00000020:00000010:29.0:1773851852.026124:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.026124:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851852.026125:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851852.026126:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851852.026126:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.026127:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851852.026127:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851852.026128:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.026128:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851852.026130:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851852.026130:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851852.026130:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851852.026130:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851852.026131:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19841@kfi7, seq: 2055445
00000100:00000001:31.0:1773851852.026132:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851852.026132:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.026132:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001fe18b5e : new rpc_count 1
00000100:00000001:29.0:1773851852.026132:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224859008 : -106962484692608 : ffff9eb7db187980)
00000100:00000040:29.0:1773851852.026133:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000593d5b1 x1859314846476736/t0(0) o400->8df2c079-cdec-416a-bce6-a24dae3c2ec8@19841@kfi7:640/0 lens 224/0 e 0 to 0 dl 1773852000 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1732-0'
00000100:00000001:29.0:1773851852.026136:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.026136:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851852.026137:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000593d5b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:8df2c079-cdec-416a-bce6-a24dae3c2ec8+9:39781:x1859314846476736:12345-19841@kfi7:400:default-tuolumne1732-0
00000100:00000200:29.0:1773851852.026138:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314846476736
00000020:00000001:29.0:1773851852.026138:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851852.026139:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851852.026140:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.026140:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851852.026141:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851852.026141:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851852.026142:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314846476736, found 0 last_xid 1859314846476735
00000020:00000001:29.0:1773851852.026142:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851852.026143:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851852.026144:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851852.026144:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.026145:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851852.026145:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851852.026145:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851852.026146:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009b78eae0.
02000000:00000001:29.0:1773851852.026147:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.026147:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.026148:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851852.026148:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182847780279, transno 0, xid 1859314846476736
00010000:00000001:29.0:1773851852.026149:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851852.026150:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000593d5b1 x1859314846476736/t0(0) o400->8df2c079-cdec-416a-bce6-a24dae3c2ec8@19841@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1732-0'
00010000:00000001:29.0:1773851852.026152:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851852.026152:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851852.026153:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=85 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851852.026154:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851852.026155:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ec52ff21 refcount 3 to 19841@kfi7
00000100:00000001:29.0:1773851852.026155:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959055904 : -107146750495712 : ffff9e8cf3ff7420)
02000000:00000001:29.0:1773851852.026156:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851852.026156:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.026157:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851852.026158:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19840@kfi7
00000400:00000010:29.0:1773851852.026158:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b0ca5bfc.
00000100:00000200:29.0:1773851852.026159:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314846476736, offset 224
00000400:00000200:29.0:1773851852.026160:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19840@kfi7
00000400:00000200:29.0:1773851852.026161:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.026161:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f74301d6 nid 19840@kfi7 refs 1
00000400:00000200:29.0:1773851852.026162:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f74301d6 nid 19840@kfi7 refs 2
00000400:00000200:29.0:1773851852.026163:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f74301d6 nid 19840@kfi7 refs 3
00000400:00000200:29.0:1773851852.026164:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19840@kfi7 local destination
00000400:00000200:29.0:1773851852.026165:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768503:8768503:1024:4294967295] 19840@kfi7 LPNI seq info [2032246:2032246:16:4294967295]
00000400:00000200:29.0:1773851852.026166:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f74301d6 nid 19840@kfi7 refs 2
00000400:00000200:29.0:1773851852.026167:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.026169:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19840@kfi7(19840@kfi7:19840@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851852.026170:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f74301d6 nid 19840@kfi7 refs 3
00000800:00000200:29.0:1773851852.026171:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.026172:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851852.026175:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851852.026177:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e82 Using peer 19840@kfi7(0x100000000000e82)
00000800:00000200:29.0:1773851852.026180:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0x100000000000e82: rc=0
00000800:00000200:29.0:1773851852.026181:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851852.026183:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.026184:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ec52ff21 refcount 2 to 19841@kfi7
00010000:00000001:29.0:1773851852.026184:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851852.026185:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.026185:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851852.026186:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000593d5b1 x1859314846476736/t0(0) o400->8df2c079-cdec-416a-bce6-a24dae3c2ec8@19841@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1732-0'
00000100:00100000:29.0:1773851852.026189:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000593d5b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:8df2c079-cdec-416a-bce6-a24dae3c2ec8+9:39781:x1859314846476736:12345-19841@kfi7:400:default-tuolumne1732-0 Request processed in 52us (83us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851852.026190:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19841@kfi7, seq: 2055445
00000100:00000040:29.0:1773851852.026191:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001fe18b5e : new rpc_count 0
00000100:00000001:29.0:1773851852.026192:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851852.026192:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851852.026193:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.026193:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000020:00000010:29.0:1773851852.026194:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001d1a7a8a.
00000800:00000200:31.0:1773851852.026195:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e82 TN_EVENT_TX_OK event status 0
00000020:00000040:29.0:1773851852.026195:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000001fe18b5e : new refcount 8
00000100:00000001:29.0:1773851852.026195:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851852.026196:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851852.026198:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19840@kfi7: PUT: OK
00000400:00000200:31.0:1773851852.026199:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b0ca5bfc
00000400:00000010:31.0:1773851852.026199:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b0ca5bfc.
00000100:00000001:31.0:1773851852.026200:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851852.026200:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851852.026201:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f74301d6 nid 19840@kfi7 refs 2
00000800:00000200:31.0:1773851852.026203:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 19840@kfi7(00000000c774ca57):0x0 lsk 3715 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e82 Transaction freed
00000100:00000001:8.0:1773851852.105732:0:60519:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000100:00000001:26.0:1773851852.105733:0:41182:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000001:11.0:1773851852.105733:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851852.105734:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851852.105735:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b624700f.
00000020:00000040:11.0:1773851852.105737:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000004:00000001:10.0:1773851852.105737:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851852.105738:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000040:8.0:1773851852.105738:0:60519:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +58s
00000100:00000001:11.0:1773851852.105739:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851852.105739:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:10.0:1773851852.105739:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009d0add5.
00000100:00001000:8.0:1773851852.105739:0:60519:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +3s, asking for 30 secs on 1 early replies
00000020:00000040:10.0:1773851852.105740:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000001:8.0:1773851852.105740:0:60519:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000040:26.0:1773851852.105741:0:41182:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +469s
02000000:00000001:11.0:1773851852.105741:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105741:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00001000:26.0:1773851852.105742:0:41182:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
02000000:00000010:11.0:1773851852.105742:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000073bbffc.
02000000:00000001:10.0:1773851852.105742:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00001000:8.0:1773851852.105742:0:60519:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +3s, margin -597s) for 600+30  req@000000000e26b193 x1859597924930816/t0(0) o49->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:495/0 lens 480/0 e 0 to 0 dl 1773851855 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111525036260352'
02000000:00000001:10.0:1773851852.105743:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851852.105744:0:41182:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000001:11.0:1773851852.105744:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851852.105745:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000068b7b641.
00000100:00001000:26.0:1773851852.105746:0:41182:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -283s) for 288+30  req@00000000778639ec x1858059147462400/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:497/0 lens 2528/5304 e 8 to 0 dl 1773851857 ref 2 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne1002-1427325'
00000100:00000001:11.0:1773851852.105746:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851852.105746:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851852.105746:0:60519:0:(import.c:1951:at_measured()) add 114 to 00000000119ab4c7 time=1606 v=600 (824 0 0 0)
00000100:00000001:11.0:1773851852.105747:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851852.105747:0:60519:0:(import.c:2016:at_measured()) AT 00000000119ab4c7 change: old=600 new=114 delta=-486 (val=114) hist 114 0 0 0
00000100:00000001:10.0:1773851852.105748:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:11.0:1773851852.105749:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b624700f] to pc [ptlrpcd_02_01+1]  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851852.105749:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:8.0:1773851852.105749:0:60519:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000821d3b26.
00000100:00000010:8.0:1773851852.105749:0:60519:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 480 at 0000000089926a18.
00000100:00000040:10.0:1773851852.105751:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000009d0add5] to pc [ptlrpcd_02_02+2]  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:8.0:1773851852.105751:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851852.105751:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74122
00000020:00000001:8.0:1773851852.105752:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00001000:26.0:1773851852.105753:0:41182:0:(import.c:1951:at_measured()) add 313 to 00000000eab3bd15 time=85 v=288 (288 212 1 1)
00000100:00001000:26.0:1773851852.105754:0:41182:0:(import.c:2016:at_measured()) AT 00000000eab3bd15 change: old=288 new=313 delta=25 (val=313) hist 313 212 1 1
00000020:00000040:8.0:1773851852.105754:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d60686f refcount=469
00000020:00000001:8.0:1773851852.105754:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000020:00000001:8.0:1773851852.105755:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000100:00000040:8.0:1773851852.105756:0:60519:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 000000009d60686f : new rpc_count 11
00000100:00000010:26.0:1773851852.105757:0:41182:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000026004054.
00000100:00000001:8.0:1773851852.105757:0:60519:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851852.105757:0:60519:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000010:26.0:1773851852.105758:0:41182:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 2528 at 00000000582505ce.
00000100:00000001:9.0:1773851852.105758:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:8.0:1773851852.105758:0:60519:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000025ad5da9.
00000004:00000001:11.0:1773851852.105759:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.105759:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:8.0:1773851852.105759:0:60519:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.105759:0:60519:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851852.105760:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:9.0:1773851852.105760:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000020:00000040:26.0:1773851852.105761:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91888
00000004:00000001:10.0:1773851852.105761:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851852.105761:0:60519:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851852.105761:0:60519:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851852.105762:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:8.0:1773851852.105762:0:60519:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851852.105762:0:60519:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc978f5f refcount 3 to 25667@kfi7
00000100:00000040:9.0:1773851852.105763:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851852.105763:0:60519:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106880 : -107156354444736 : ffff9e8ab78ed240)
00000020:00000040:26.0:1773851852.105764:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076ee99f4 refcount=21
02000000:00000001:8.0:1773851852.105764:0:60519:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000020:00000001:26.0:1773851852.105766:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000020:00000001:26.0:1773851852.105767:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000100:00000001:11.0:1773851852.105767:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851852.105767:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851852.105767:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:26.0:1773851852.105768:0:41182:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 0000000076ee99f4 : new rpc_count 4
00000100:00000001:11.0:1773851852.105768:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105768:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851852.105768:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851852.105768:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851852.105768:0:60519:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.105768:0:60519:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851852.105769:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851852.105769:0:60519:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25666@kfi7
00000100:00000001:26.0:1773851852.105770:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851852.105770:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000001:9.0:1773851852.105770:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:8.0:1773851852.105770:0:60519:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4057092.
00000100:00000200:8.0:1773851852.105770:0:60519:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597924930816, offset 0
02000000:00000001:9.0:1773851852.105771:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:26.0:1773851852.105772:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000282fbfa2.
00000100:00100000:9.0:1773851852.105772:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051921984:42@kfi7:13:default-yuba2-0
00000400:00000200:8.0:1773851852.105772:0:60519:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25666@kfi7
02000000:00000001:26.0:1773851852.105773:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105773:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000200:8.0:1773851852.105773:0:60519:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000100:00000001:26.0:1773851852.105774:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105774:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851852.105774:0:60519:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 1
00000400:00000200:8.0:1773851852.105774:0:60519:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00010000:00000001:26.0:1773851852.105775:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:11.0:1773851852.105775:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:10.0:1773851852.105775:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:9.0:1773851852.105775:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00010000:00000001:26.0:1773851852.105776:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.105776:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851852.105776:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851852.105776:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:8.0:1773851852.105776:0:60519:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000100:00000001:26.0:1773851852.105777:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00100000:10.0:1773851852.105777:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051922048:12@kfi7:13:default-yuba2-0
02000000:00000001:9.0:1773851852.105777:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851852.105777:0:60519:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25666@kfi7 local destination
00000100:00000040:26.0:1773851852.105778:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000049078092 refcount 3 to 8370@kfi7
02000000:00000001:9.0:1773851852.105778:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:8.0:1773851852.105778:0:60519:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768504:8768504:1024:4294967295] 25666@kfi7 LPNI seq info [611804:611804:16:4294967295]
00000100:00000001:26.0:1773851852.105779:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336256 : -107152617215360 : ffff9e8b96506a80)
00000100:00000001:10.0:1773851852.105779:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:9.0:1773851852.105779:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ba3e4e94.
02000000:00000001:10.0:1773851852.105780:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851852.105780:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851852.105780:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851852.105780:0:60519:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:8.0:1773851852.105780:0:60519:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
02000000:00000001:26.0:1773851852.105781:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851852.105781:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:10.0:1773851852.105782:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d92ace2a.
00000400:00000200:8.0:1773851852.105782:0:60519:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25666@kfi7(25666@kfi7:25666@kfi7) <?> : PUT try# 0
02000000:00000001:26.0:1773851852.105783:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851852.105783:0:60519:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000100:00000001:26.0:1773851852.105784:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:10.0:1773851852.105784:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851852.105784:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000040:26.0:1773851852.105785:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8370@kfi7
00000400:00000010:9.0:1773851852.105785:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000071ec9fd.
00000800:00000200:8.0:1773851852.105785:0:60519:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000010:26.0:1773851852.105786:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000a1253fa.
00000400:00000200:10.0:1773851852.105786:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:8.0:1773851852.105786:0:60519:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:10.0:1773851852.105787:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000784143ff.
00000400:00000010:9.0:1773851852.105787:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000146cbe4e.
00000100:00000200:26.0:1773851852.105788:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858059147462400, offset 0
00000400:00000010:10.0:1773851852.105788:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000053a50d5b.
00000800:00000200:8.0:1773851852.105788:0:60519:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:10.0:1773851852.105789:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922048, portal 4
00000100:00000200:9.0:1773851852.105789:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051921984, portal 4
00000400:00000200:26.0:1773851852.105790:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8370@kfi7
00000100:00000001:10.0:1773851852.105790:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851852.105790:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851852.105791:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077439616 : -106968632112000 : ffff9eb66cae4c80)
00000100:00000001:9.0:1773851852.105791:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637164268282624 : -106909441268992 : ffff9ec434bae300)
00000800:00000200:8.0:1773851852.105791:0:60519:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb Using peer 25666@kfi7(0x100000000000dcb)
00000400:00000200:26.0:1773851852.105792:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:26.0:1773851852.105793:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000caae4472 nid 8370@kfi7 refs 1
00000100:00000040:10.0:1773851852.105793:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851852.105794:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851852.105794:0:60519:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x100000000000dcb: rc=0
00000400:00000200:26.0:1773851852.105795:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000caae4472 nid 8370@kfi7 refs 2
00000800:00000200:8.0:1773851852.105795:0:60519:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851852.105797:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000caae4472 nid 8370@kfi7 refs 3
00000100:00000001:10.0:1773851852.105797:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851852.105797:0:60519:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.105798:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851852.105798:0:60519:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc978f5f refcount 2 to 25667@kfi7
00000400:00000200:26.0:1773851852.105799:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8370@kfi7 local destination
00000100:00000040:10.0:1773851852.105799:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:10.0:1773851852.105799:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dea1ff36.
00000100:00000040:9.0:1773851852.105799:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000100:00000040:8.0:1773851852.105799:0:60519:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 000000009d60686f : new rpc_count 10
00000100:00000200:10.0:1773851852.105800:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922048, offset 0
00000400:00000010:9.0:1773851852.105800:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001328b840.
00000020:00000040:8.0:1773851852.105800:0:60519:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 468
00000400:00000200:26.0:1773851852.105801:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768505:8768505:1023:4294967295] 8370@kfi7 LPNI seq info [34722291:34722291:16:4294967295]
00000100:00000200:9.0:1773851852.105801:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051921984, offset 0
00000100:00000010:8.0:1773851852.105801:0:60519:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 480 at 0000000089926a18.
00000100:00000010:8.0:1773851852.105802:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000821d3b26.
00000400:00000200:10.0:1773851852.105803:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000100:00000001:8.0:1773851852.105803:0:60519:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851852.105804:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000caae4472 nid 8370@kfi7 refs 2
00000400:00000200:10.0:1773851852.105804:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:26.0:1773851852.105805:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:9.0:1773851852.105805:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:10.0:1773851852.105806:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000100:00000040:8.0:1773851852.105806:0:60519:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +25s
00000100:00000001:8.0:1773851852.105806:0:60519:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851852.105807:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:26.0:1773851852.105809:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8370@kfi7(8370@kfi7:8370@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851852.105809:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:26.0:1773851852.105811:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000caae4472 nid 8370@kfi7 refs 3
00000400:00000200:10.0:1773851852.105811:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000400:00000200:10.0:1773851852.105813:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768502, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8768505, p:4294967295, g:4294967295, h:1000]
00000800:00000200:26.0:1773851852.105815:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:11.0:1773851852.105815:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb TN_EVENT_TX_OK event status 0
00000800:00000200:26.0:1773851852.105817:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851852.105817:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:11.0:1773851852.105818:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851852.105818:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851852.105820:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000800:00000200:26.0:1773851852.105821:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851852.105821:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25666@kfi7: PUT: OK
00000400:00000200:10.0:1773851852.105821:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768506:8768506:1024:4294967295] 12@kfi7 LPNI seq info [5403453:5403453:16:4294967295]
00000400:00000200:11.0:1773851852.105822:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4057092
00000400:00000010:11.0:1773851852.105823:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4057092.
00000400:00000200:10.0:1773851852.105824:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:26.0:1773851852.105825:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x14000000000004d0 Using peer 8370@kfi7(0x14000000000004d0)
00000100:00000001:11.0:1773851852.105825:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000400:00000200:10.0:1773851852.105825:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
02000000:00000001:11.0:1773851852.105826:0:2510946:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:11.0:1773851852.105827:0:2510946:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000025ad5da9.
02000000:00000001:11.0:1773851852.105828:0:2510946:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000800:00000200:26.0:1773851852.105829:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x14000000000004d0: rc=0
00000100:00000001:11.0:1773851852.105829:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851852.105829:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851852.105831:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:26.0:1773851852.105832:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x14000000000004d0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851852.105833:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000800:00000200:10.0:1773851852.105834:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:26.0:1773851852.105835:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851852.105835:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851852.105835:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000100:00000040:26.0:1773851852.105836:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000049078092 refcount 2 to 8370@kfi7
00000400:00000200:9.0:1773851852.105836:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000040:26.0:1773851852.105838:0:41182:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 0000000076ee99f4 : new rpc_count 3
00000400:00000200:9.0:1773851852.105838:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000020:00000040:26.0:1773851852.105839:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 20
00000100:00000010:26.0:1773851852.105840:0:41182:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 2528 at 00000000582505ce.
00000400:00000200:9.0:1773851852.105840:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000100:00000010:26.0:1773851852.105842:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000026004054.
00000800:00000200:10.0:1773851852.105842:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851852.105842:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768506, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8768505, p:4294967295, g:4294967295, h:1000]
00000100:00000001:26.0:1773851852.105843:0:41182:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851852.105845:0:41182:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +25s
00000100:00000001:26.0:1773851852.105846:0:41182:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851852.105846:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x14000000000004d0 TN_EVENT_TX_OK event status 0
00000800:00000200:10.0:1773851852.105846:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Using peer 12@kfi7(0x47e)
00000400:00000200:9.0:1773851852.105849:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:25.0:1773851852.105850:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851852.105851:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8370@kfi7: PUT: OK
00000400:00000200:9.0:1773851852.105851:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:25.0:1773851852.105852:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000a1253fa
00000400:00000010:25.0:1773851852.105852:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000a1253fa.
00000800:00000200:10.0:1773851852.105852:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000005269f40f: Posted send of 324 bytes to peer 0x47e: rc=0
00000100:00000001:25.0:1773851852.105853:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:25.0:1773851852.105853:0:2494371:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000400:00000200:9.0:1773851852.105853:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
02000000:00000010:25.0:1773851852.105854:0:2494371:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000282fbfa2.
00000800:00000200:10.0:1773851852.105854:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851852.105854:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768507:8768507:1023:4294967295] 42@kfi7 LPNI seq info [5404894:5404894:16:4294967295]
02000000:00000001:25.0:1773851852.105855:0:2494371:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:25.0:1773851852.105855:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851852.105856:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000caae4472 nid 8370@kfi7 refs 2
00000400:00000200:9.0:1773851852.105857:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:25.0:1773851852.105858:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x14000000000004d0 Transaction freed
00000100:00000001:10.0:1773851852.105858:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105858:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851852.105859:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000001:10.0:1773851852.105860:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851852.105861:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000100:00000001:10.0:1773851852.105861:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105862:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851852.105863:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000800:00000200:11.0:1773851852.105864:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb Transaction freed
00000100:00000001:10.0:1773851852.105864:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851852.105865:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:9.0:1773851852.105865:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000100:00000001:10.0:1773851852.105866:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851852.105866:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851852.105867:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105868:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851852.105868:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851852.105869:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851852.105870:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851852.105872:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851852.105874:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000800:00000200:9.0:1773851852.105874:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851852.105876:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dea1ff36
00000400:00000010:11.0:1773851852.105877:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dea1ff36.
00000100:00000001:11.0:1773851852.105878:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:11.0:1773851852.105879:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851852.105879:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000100:00000001:11.0:1773851852.105885:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:9.0:1773851852.105885:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x17b: rc=0
00000100:00000040:11.0:1773851852.105886:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851852.105888:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851852.105891:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.105892:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.105892:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851852.105893:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851852.105893:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851852.105894:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:9.0:1773851852.105894:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.105895:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851852.105897:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Transaction freed
00000100:00000001:9.0:1773851852.105897:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:10.0:1773851852.105898:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851852.105898:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851852.105900:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851852.105900:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:10.0:1773851852.105901:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851852.105901:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.105902:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851852.105903:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:10.0:1773851852.105904:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001328b840
00000400:00000010:10.0:1773851852.105905:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001328b840.
00000100:00000001:10.0:1773851852.105906:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851852.105908:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851852.105909:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851852.105910:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851852.105913:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851852.105913:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851852.105914:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851852.105917:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:10.0:1773851852.105918:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.105919:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851852.105921:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:10.0:1773851852.105921:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:11.0:1773851852.105923:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12@kfi7 : PUT - for me
00000800:00000200:10.0:1773851852.105924:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000400:00000200:11.0:1773851852.105925:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:11.0:1773851852.105927:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:11.0:1773851852.105928:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:11.0:1773851852.105930:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:11.0:1773851852.105931:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:25.0:1773851852.105933:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:11.0:1773851852.105933:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:25.0:1773851852.105934:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:11.0:1773851852.105935:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1e80
00000800:00000200:25.0:1773851852.105936:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851852.105938:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:25.0:1773851852.105939:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:11.0:1773851852.105940:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781696a69 [1] + 224
00000400:00000200:25.0:1773851852.105941:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.105942:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851852.105944:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000800:00000200:11.0:1773851852.105944:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851852.105945:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851852.105946:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.105947:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:11.0:1773851852.105947:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851852.105948:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:11.0:1773851852.105949:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000400:00000200:25.0:1773851852.105950:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.105951:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1e40
00000100:00000001:11.0:1773851852.105951:0:2510946:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851852.105952:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000200:11.0:1773851852.105952:0:2510946:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851852.105954:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b81839 [1] + 224
00000800:00000200:25.0:1773851852.105956:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851852.105958:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851852.105958:0:2510946:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851852.105960:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851852.105962:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851852.105963:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851852.105964:0:2510946:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:11.0:1773851852.105966:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:10.0:1773851852.105966:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:25.0:1773851852.105967:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851852.105967:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:10.0:1773851852.105968:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:11.0:1773851852.105969:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:10.0:1773851852.105969:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851852.105970:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000784143ff.
00000100:00000001:25.0:1773851852.105971:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851852.105971:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000053a50d5b
00000400:00000200:25.0:1773851852.105972:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000010:10.0:1773851852.105972:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000053a50d5b.
00000100:00000001:10.0:1773851852.105973:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:25.0:1773851852.105974:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000200:10.0:1773851852.105974:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851852.105974:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851852.105975:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:9.0:1773851852.105977:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851852.105978:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:10.0:1773851852.105980:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851852.105980:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000071ec9fd.
00000400:00000200:9.0:1773851852.105981:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000146cbe4e
00000400:00000010:9.0:1773851852.105982:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000146cbe4e.
00000100:00000001:9.0:1773851852.105983:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:10.0:1773851852.105984:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851852.105985:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:9.0:1773851852.105985:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851852.105986:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851852.105987:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851852.105988:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851852.105989:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851852.105990:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851852.105990:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:10.0:1773851852.105992:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=85 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851852.105994:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=85 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851852.105995:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851852.105996:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851852.105996:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.105996:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851852.105997:0:41069:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:10.0:1773851852.105998:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:9.0:1773851852.105998:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00010000:00000001:10.0:1773851852.105999:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.105999:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851852.106000:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851852.106000:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851852.106001:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
02000000:00000001:9.0:1773851852.106001:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.106002:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:9.0:1773851852.106002:0:41069:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=85 v=66 (66 66 66 66)
00000100:00000001:10.0:1773851852.106003:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851852.106004:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:9.0:1773851852.106004:0:41069:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=85 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851852.106005:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851852.106005:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.106006:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:9.0:1773851852.106006:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851852.106006:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.106007:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851852.106007:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:10.0:1773851852.106008:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:9.0:1773851852.106008:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000001:9.0:1773851852.106008:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:10.0:1773851852.106009:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851852.106009:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:10.0:1773851852.106010:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851852.106010:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541593088 avail=351539441664 avail_mb=1373200944 hwm_mb=3131101 files=372136813 ffree=343302337 state=0: rc = 0
00000100:00000040:9.0:1773851852.106010:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:10.0:1773851852.106012:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541593088 free, 351539441664 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136813 files, 343302337 free files
00000100:00000001:9.0:1773851852.106013:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:10.0:1773851852.106014:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.106014:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851852.106014:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:10.0:1773851852.106015:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851852.106015:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851852.106016:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851852.106017:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351379065856 avail=351376106496 avail_mb=1372562916 hwm_mb=3131103 files=372019208 ffree=343143619 state=0: rc = 0
00000100:00100000:10.0:1773851852.106018:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051922048:12@kfi7:13:default-yuba2-0
00000004:00000020:9.0:1773851852.106019:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351379065856 free, 351376106496 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019208 files, 343143619 free files
00000100:00000001:10.0:1773851852.106020:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851852.106020:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851852.106021:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000009d0add5 x1859433051922048/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851852.106021:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851852.106023:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851852.106024:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851852.106024:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851852.106025:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d92ace2a.
02000000:00000001:10.0:1773851852.106026:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851852.106026:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000100:00100000:9.0:1773851852.106026:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051921984:42@kfi7:13:default-yuba2-0
00000020:00000040:10.0:1773851852.106027:0:41070:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:10.0:1773851852.106027:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851852.106028:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000068b7b641.
00000100:00000001:9.0:1773851852.106028:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851852.106029:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851852.106029:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:9.0:1773851852.106029:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000010:10.0:1773851852.106030:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009d0add5.
00000100:00000001:10.0:1773851852.106030:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:9.0:1773851852.106030:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b624700f x1859433051921984/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851852.106031:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851852.106031:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851852.106032:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851852.106032:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.106032:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:10.0:1773851852.106033:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851852.106033:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851852.106033:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851852.106033:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ba3e4e94.
02000000:00000001:9.0:1773851852.106035:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851852.106035:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851852.106036:0:41069:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:9.0:1773851852.106036:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851852.106037:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000073bbffc.
02000000:00000001:9.0:1773851852.106038:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851852.106038:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851852.106039:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b624700f.
00000100:00000001:9.0:1773851852.106040:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851852.106040:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851852.106041:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851852.106042:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851852.106042:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.106043:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851852.106043:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851852.128341:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851852.128342:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851852.128343:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851852.128345:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851852.128348:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.128349:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13107@kfi7 : PUT - for me
00000400:00000200:5.0:1773851852.128350:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.128351:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 1
00000400:00000200:5.0:1773851852.128352:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.128352:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000400:00000200:5.0:1773851852.128353:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 3
00000400:00000200:5.0:1773851852.128354:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13299@kfi7 to cpt 4
00000400:00000200:5.0:1773851852.128355:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13299@kfi7 of length 224 into portal 12 MB=0x699e169d109c0
00000400:00000200:5.0:1773851852.128357:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13299@kfi7 of length 224/224 into md 0x793926dc5 [64] + 116016
00000800:00000200:5.0:1773851852.128359:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851852.128360:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851852.128361:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13107@kfi7: PUT: OK
00000100:00000001:5.0:1773851852.128362:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851852.128363:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851852.128364:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000079c9f38d.
00000100:00000040:5.0:1773851852.128365:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000079c9f38d x1858043282262464 msgsize 224
00000100:00100000:5.0:1773851852.128366:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13299@kfi7 (source: 12345-13107@kfi7)
00000100:00000001:5.0:1773851852.128369:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851852.128369:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000800:00000200:5.0:1773851852.128371:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851852.128373:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851852.128374:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851852.128375:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851852.128375:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851852.128376:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851852.128377:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043282262464
00000020:00000001:5.0:1773851852.128377:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851852.128378:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f65
00000020:00000001:5.0:1773851852.128378:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851852.128380:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005f1251dd refcount=6
00000020:00000001:5.0:1773851852.128380:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629016576 : -107123080535040 : ffff9e9276d66400)
00000020:00000001:5.0:1773851852.128381:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629016576 : -107123080535040 : ffff9e9276d66400)
00000100:00000001:5.0:1773851852.128382:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851852.128383:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851852.128383:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000093a22904.
00000020:00000010:5.0:1773851852.128385:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851852.128386:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000018730203.
00000100:00000001:5.0:1773851852.128387:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851852.128387:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851852.128388:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851852.128389:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851852.128389:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851852.128390:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.128391:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.128392:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851852.128392:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851852.128392:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851852.128393:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851852.128394:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13299@kfi7, seq: 2001843
00000100:00000040:5.0:1773851852.128394:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005f1251dd : new rpc_count 1
00000100:00000001:7.0:1773851852.128395:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.128395:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.128395:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046244096 : -106940663307520 : ffff9ebcefc06300)
00000100:00000040:5.0:1773851852.128396:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000079c9f38d x1858043282262464/t0(0) o400->161cd7e3-04ea-4f69-a294-914022728b49@13299@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1305-0'
00000100:00000001:5.0:1773851852.128399:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851852.128400:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851852.128401:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079c9f38d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:161cd7e3-04ea-4f69-a294-914022728b49+6:39704:x1858043282262464:12345-13299@kfi7:400:default-tuolumne1305-0
00000100:00000200:5.0:1773851852.128402:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043282262464
00000020:00000001:5.0:1773851852.128403:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851852.128403:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851852.128404:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.128404:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851852.128405:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851852.128406:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851852.128406:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043282262464, found 0 last_xid 1858043282262463
00000020:00000001:5.0:1773851852.128407:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851852.128408:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851852.128408:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851852.128409:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.128410:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851852.128410:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851852.128411:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851852.128412:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4b8619a.
02000000:00000001:5.0:1773851852.128412:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.128413:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.128414:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851852.128414:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690261, transno 0, xid 1858043282262464
00010000:00000001:5.0:1773851852.128415:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851852.128416:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000079c9f38d x1858043282262464/t0(0) o400->161cd7e3-04ea-4f69-a294-914022728b49@13299@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1305-0'
00010000:00000001:5.0:1773851852.128418:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851852.128419:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851852.128420:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=84 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851852.128421:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851852.128422:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000527b2cb8 refcount 3 to 13299@kfi7
00000100:00000001:5.0:1773851852.128423:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332512 : -107155408219104 : ffff9e8aeff51420)
02000000:00000001:5.0:1773851852.128424:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851852.128425:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.128425:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851852.128426:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13107@kfi7
00000400:00000010:5.0:1773851852.128427:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002d33c725.
00000100:00000200:5.0:1773851852.128427:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043282262464, offset 224
00000400:00000200:5.0:1773851852.128429:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13107@kfi7
00000400:00000200:5.0:1773851852.128429:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.128430:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 1
00000400:00000200:5.0:1773851852.128431:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000400:00000200:5.0:1773851852.128432:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 3
00000400:00000200:5.0:1773851852.128433:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13107@kfi7 local destination
00000400:00000200:5.0:1773851852.128435:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768508:8768508:1024:4294967295] 13107@kfi7 LPNI seq info [239638:239638:16:4294967295]
00000400:00000200:5.0:1773851852.128436:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000400:00000200:5.0:1773851852.128437:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.128439:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13107@kfi7(13107@kfi7:13107@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851852.128440:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 3
00000800:00000200:5.0:1773851852.128441:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851852.128442:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851852.128444:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851852.128446:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005bf Using peer 13107@kfi7(0x1000000000005bf)
00000800:00000200:5.0:1773851852.128449:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x1000000000005bf: rc=0
00000800:00000200:5.0:1773851852.128451:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005bf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851852.128453:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851852.128453:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000527b2cb8 refcount 2 to 13299@kfi7
00010000:00000001:5.0:1773851852.128454:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851852.128455:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.128456:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851852.128456:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000079c9f38d x1858043282262464/t0(0) o400->161cd7e3-04ea-4f69-a294-914022728b49@13299@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1305-0'
00000100:00100000:5.0:1773851852.128459:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079c9f38d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:161cd7e3-04ea-4f69-a294-914022728b49+6:39704:x1858043282262464:12345-13299@kfi7:400:default-tuolumne1305-0 Request processed in 59us (94us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851852.128462:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13299@kfi7, seq: 2001843
00000100:00000040:5.0:1773851852.128463:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005f1251dd : new rpc_count 0
00000800:00000200:6.0:1773851852.128464:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005bf TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851852.128464:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851852.128464:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851852.128465:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851852.128465:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851852.128465:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000018730203.
00000400:00000200:6.0:1773851852.128466:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13107@kfi7: PUT: OK
00000020:00000010:5.0:1773851852.128466:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000093a22904.
00000400:00000200:6.0:1773851852.128467:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002d33c725
00000020:00000040:5.0:1773851852.128467:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000005f1251dd : new refcount 5
00000400:00000010:6.0:1773851852.128468:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002d33c725.
00000100:00000001:5.0:1773851852.128468:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851852.128469:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851852.128469:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851852.128470:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000800:00000200:6.0:1773851852.128471:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13107@kfi7(00000000b7d290ed):0x0 lsk 1472 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005bf Transaction freed
00000800:00000200:9.0:1773851852.132180:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851852.132181:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851852.132182:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851852.132184:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851852.132186:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851852.132187:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19778@kfi7 : PUT - for me
00000400:00000200:9.0:1773851852.132188:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851852.132189:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 1
00000400:00000200:9.0:1773851852.132190:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851852.132191:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000400:00000200:9.0:1773851852.132191:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 3
00000400:00000200:9.0:1773851852.132192:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19842@kfi7 to cpt 5
00000400:00000200:9.0:1773851852.132193:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19842@kfi7 of length 224 into portal 12 MB=0x69b81a0564bc0
00000400:00000200:9.0:1773851852.132195:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19842@kfi7 of length 224/224 into md 0x78146ce49 [64] + 116984
00000800:00000200:9.0:1773851852.132197:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851852.132198:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851852.132200:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19778@kfi7: PUT: OK
00000100:00000001:9.0:1773851852.132201:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851852.132201:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851852.132202:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000f12ca84.
00000100:00000040:9.0:1773851852.132203:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000000f12ca84 x1859830903360448 msgsize 224
00000100:00100000:9.0:1773851852.132205:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-19842@kfi7 (source: 12345-19778@kfi7)
00000100:00000001:9.0:1773851852.132206:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851852.132207:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000100:00000001:8.0:1773851852.132207:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851852.132208:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851852.132208:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851852.132208:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851852.132209:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851852.132210:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851852.132210:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830903360448
00000020:00000001:8.0:1773851852.132211:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851852.132211:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087408a2e46
00000020:00000001:8.0:1773851852.132212:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851852.132214:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dab6d205 refcount=5
00000020:00000001:8.0:1773851852.132215:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637016918589440 : -107056790962176 : ffff9ea1e6010000)
00000020:00000001:8.0:1773851852.132216:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637016918589440 : -107056790962176 : ffff9ea1e6010000)
00000100:00000001:8.0:1773851852.132217:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851852.132217:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851852.132218:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025ad5da9.
00000020:00000010:8.0:1773851852.132219:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851852.132220:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851852.132221:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851852.132222:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851852.132222:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851852.132223:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851852.132223:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851852.132224:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.132225:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851852.132226:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851852.132226:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851852.132227:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851852.132228:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19842@kfi7, seq: 2130715
00000100:00000040:8.0:1773851852.132228:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dab6d205 : new rpc_count 1
00000100:00000001:8.0:1773851852.132229:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792152448 : -106938917399168 : ffff9ebd57d0d580)
00000100:00000040:8.0:1773851852.132231:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000f12ca84 x1859830903360448/t0(0) o400->be04a832-fc51-4c4e-9082-83badf1682f6@19842@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1736-0'
00000100:00000001:8.0:1773851852.132233:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851852.132234:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851852.132234:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f12ca84 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:be04a832-fc51-4c4e-9082-83badf1682f6+5:39677:x1859830903360448:12345-19842@kfi7:400:default-tuolumne1736-0
00000100:00000001:11.0:1773851852.132236:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000200:8.0:1773851852.132236:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830903360448
00000020:00000001:8.0:1773851852.132236:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000100:00000001:11.0:1773851852.132237:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851852.132237:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00000001:11.0:1773851852.132238:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851852.132238:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851852.132238:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851852.132239:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851852.132239:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851852.132240:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830903360448, found 0 last_xid 1859830903360447
00000020:00000001:8.0:1773851852.132241:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851852.132241:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851852.132242:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851852.132242:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851852.132243:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851852.132243:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851852.132244:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851852.132244:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000089926a18.
02000000:00000001:8.0:1773851852.132245:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.132246:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851852.132246:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851852.132247:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690294, transno 0, xid 1859830903360448
00010000:00000001:8.0:1773851852.132248:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851852.132248:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000f12ca84 x1859830903360448/t0(0) o400->be04a832-fc51-4c4e-9082-83badf1682f6@19842@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1736-0'
00010000:00000001:8.0:1773851852.132251:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851852.132251:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851852.132252:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=85 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851852.132253:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851852.132254:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0d50067 refcount 3 to 19842@kfi7
00000100:00000001:8.0:1773851852.132255:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096224 : -107139307455392 : ffff9e8eafa33c60)
02000000:00000001:8.0:1773851852.132255:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851852.132256:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.132256:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851852.132257:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19778@kfi7
00000400:00000010:8.0:1773851852.132258:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000017f9c5c1.
00000100:00000200:8.0:1773851852.132259:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830903360448, offset 224
00000400:00000200:8.0:1773851852.132260:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19778@kfi7
00000400:00000200:8.0:1773851852.132261:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:8.0:1773851852.132261:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 1
00000400:00000200:8.0:1773851852.132262:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000400:00000200:8.0:1773851852.132263:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 3
00000400:00000200:8.0:1773851852.132264:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19778@kfi7 local destination
00000400:00000200:8.0:1773851852.132266:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768509:8768509:1024:4294967295] 19778@kfi7 LPNI seq info [165891:165891:16:4294967295]
00000400:00000200:8.0:1773851852.132267:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000400:00000200:8.0:1773851852.132268:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:8.0:1773851852.132270:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19778@kfi7(19778@kfi7:19778@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851852.132271:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 3
00000800:00000200:8.0:1773851852.132272:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851852.132273:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851852.132275:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851852.132277:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc08 Using peer 19778@kfi7(0xc08)
00000800:00000200:8.0:1773851852.132280:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0xc08: rc=0
00000800:00000200:8.0:1773851852.132281:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc08 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851852.132283:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851852.132284:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0d50067 refcount 2 to 19842@kfi7
00010000:00000001:8.0:1773851852.132285:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851852.132285:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851852.132286:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851852.132287:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000f12ca84 x1859830903360448/t0(0) o400->be04a832-fc51-4c4e-9082-83badf1682f6@19842@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1736-0'
00000100:00100000:8.0:1773851852.132290:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f12ca84 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:be04a832-fc51-4c4e-9082-83badf1682f6+5:39677:x1859830903360448:12345-19842@kfi7:400:default-tuolumne1736-0 Request processed in 56us (86us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851852.132293:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19842@kfi7, seq: 2130715
00000100:00000040:8.0:1773851852.132293:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dab6d205 : new rpc_count 0
00000100:00000001:8.0:1773851852.132294:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851852.132295:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851852.132295:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851852.132296:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851852.132297:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025ad5da9.
00000020:00000040:8.0:1773851852.132297:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000dab6d205 : new refcount 4
00000100:00000001:8.0:1773851852.132298:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851852.132302:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc08 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851852.132304:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851852.132305:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19778@kfi7: PUT: OK
00000400:00000200:9.0:1773851852.132306:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000017f9c5c1
00000400:00000010:9.0:1773851852.132306:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000017f9c5c1.
00000100:00000001:9.0:1773851852.132307:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851852.132307:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851852.132308:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000800:00000200:9.0:1773851852.132310:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 19778@kfi7(0000000004b7de76):0x0 lsk 3081 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc08 Transaction freed
00000800:00000200:29.0:1773851852.190192:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.190193:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.190194:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851852.190198:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851852.190202:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.190204:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18387@kfi7 : PUT - for me
00000400:00000200:29.0:1773851852.190206:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.190208:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 1
00000400:00000200:29.0:1773851852.190210:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.190211:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000400:00000200:29.0:1773851852.190212:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 3
00000400:00000200:29.0:1773851852.190214:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.190216:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18387@kfi7 of length 224 into portal 12 MB=0x69b16ef203040
00000400:00000200:29.0:1773851852.190218:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18387@kfi7 of length 224/224 into md 0x77fe139dd [64] + 158216
00000800:00000200:29.0:1773851852.190222:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851852.190225:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851852.190227:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18387@kfi7: PUT: OK
00000100:00000001:29.0:1773851852.190228:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851852.190229:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851852.190231:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000328d89c9.
00000100:00000040:29.0:1773851852.190232:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000328d89c9 x1859372663713856 msgsize 224
00000100:00100000:29.0:1773851852.190235:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-18387@kfi7 (source: 12345-18387@kfi7)
00000100:00000001:29.0:1773851852.190238:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851852.190239:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000800:00000200:29.0:1773851852.190242:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851852.190246:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851852.190247:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851852.190248:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851852.190249:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.190250:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.190251:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372663713856
00000020:00000001:29.0:1773851852.190253:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851852.190253:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae82968
00000020:00000001:29.0:1773851852.190254:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851852.190260:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c82f7925 refcount=5
00000020:00000001:29.0:1773851852.190262:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636922792924160 : -107150916627456 : ffff9e8bfbad5400)
00000020:00000001:29.0:1773851852.190263:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636922792924160 : -107150916627456 : ffff9e8bfbad5400)
00000100:00000001:29.0:1773851852.190265:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.190267:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851852.190268:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001d1a7a8a.
00000020:00000010:29.0:1773851852.190270:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.190272:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851852.190273:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851852.190274:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851852.190275:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.190276:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851852.190277:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851852.190278:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.190279:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.190281:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851852.190282:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851852.190282:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851852.190283:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851852.190284:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18387@kfi7, seq: 2055446
00000100:00000001:31.0:1773851852.190285:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.190285:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c82f7925 : new rpc_count 1
00000100:00000001:31.0:1773851852.190286:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.190286:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224840576 : -106962484711040 : ffff9eb7db183180)
00000100:00000040:29.0:1773851852.190288:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000328d89c9 x1859372663713856/t0(0) o400->369b8a33-a99c-4e5d-92eb-872818783069@18387@kfi7:640/0 lens 224/0 e 0 to 0 dl 1773852000 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1637-0'
00000100:00000001:29.0:1773851852.190293:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.190294:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851852.190295:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000328d89c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:369b8a33-a99c-4e5d-92eb-872818783069+5:39840:x1859372663713856:12345-18387@kfi7:400:default-tuolumne1637-0
00000100:00000200:29.0:1773851852.190298:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372663713856
00000020:00000001:29.0:1773851852.190298:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851852.190299:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851852.190300:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.190302:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851852.190302:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851852.190304:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851852.190305:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372663713856, found 0 last_xid 1859372663713855
00000020:00000001:29.0:1773851852.190306:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851852.190308:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851852.190308:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851852.190309:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.190310:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851852.190311:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851852.190312:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851852.190314:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000761cf767.
02000000:00000001:29.0:1773851852.190315:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.190316:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.190317:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851852.190318:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044175218, transno 0, xid 1859372663713856
00010000:00000001:29.0:1773851852.190319:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851852.190321:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000328d89c9 x1859372663713856/t0(0) o400->369b8a33-a99c-4e5d-92eb-872818783069@18387@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1637-0'
00010000:00000001:29.0:1773851852.190325:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851852.190326:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851852.190327:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=85 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851852.190329:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851852.190330:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003641a136 refcount 3 to 18387@kfi7
00000100:00000001:29.0:1773851852.190331:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231804544 : -107130477747072 : ffff9e90bdede480)
02000000:00000001:29.0:1773851852.190333:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851852.190333:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.190334:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851852.190336:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18387@kfi7
00000400:00000010:29.0:1773851852.190337:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d566f385.
00000100:00000200:29.0:1773851852.190338:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372663713856, offset 224
00000400:00000200:29.0:1773851852.190340:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18387@kfi7
00000400:00000200:29.0:1773851852.190341:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.190342:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 1
00000400:00000200:29.0:1773851852.190344:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000400:00000200:29.0:1773851852.190346:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 3
00000400:00000200:29.0:1773851852.190347:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18387@kfi7 local destination
00000400:00000200:29.0:1773851852.190350:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768510:8768510:1024:4294967295] 18387@kfi7 LPNI seq info [260908:260908:16:4294967295]
00000400:00000200:29.0:1773851852.190353:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000400:00000200:29.0:1773851852.190354:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.190358:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18387@kfi7(18387@kfi7:18387@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851852.190360:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 3
00000800:00000200:29.0:1773851852.190362:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.190363:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851852.190367:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851852.190371:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000519 Using peer 18387@kfi7(0x100000000000519)
00000800:00000200:29.0:1773851852.190375:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0x100000000000519: rc=0
00000800:00000200:29.0:1773851852.190377:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000519 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851852.190381:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.190382:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003641a136 refcount 2 to 18387@kfi7
00010000:00000001:29.0:1773851852.190383:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851852.190384:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.190385:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851852.190386:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000328d89c9 x1859372663713856/t0(0) o400->369b8a33-a99c-4e5d-92eb-872818783069@18387@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1637-0'
00000800:00000200:30.0:1773851852.190389:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000519 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851852.190390:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851852.190391:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18387@kfi7: PUT: OK
00000100:00100000:29.0:1773851852.190391:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000328d89c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:369b8a33-a99c-4e5d-92eb-872818783069+5:39840:x1859372663713856:12345-18387@kfi7:400:default-tuolumne1637-0 Request processed in 97us (158us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851852.190392:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d566f385
00000400:00000010:30.0:1773851852.190393:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d566f385.
00000100:00000001:30.0:1773851852.190393:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851852.190394:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851852.190394:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000100:00100000:29.0:1773851852.190395:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18387@kfi7, seq: 2055446
00000800:00000200:30.0:1773851852.190396:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 18387@kfi7(0000000025676a95):0x0 lsk 1306 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000519 Transaction freed
00000100:00000040:29.0:1773851852.190396:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c82f7925 : new rpc_count 0
00000100:00000001:29.0:1773851852.190397:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851852.190398:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851852.190399:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.190402:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000020:00000010:29.0:1773851852.190404:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001d1a7a8a.
00000020:00000040:29.0:1773851852.190405:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000c82f7925 : new refcount 4
00000100:00000001:29.0:1773851852.190406:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851852.265112:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851852.265112:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851852.265114:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851852.265116:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851852.265118:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.265119:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25650@kfi7 : PUT - for me
00000400:00000200:5.0:1773851852.265120:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.265120:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 1
00000400:00000200:5.0:1773851852.265121:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.265122:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000400:00000200:5.0:1773851852.265123:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 3
00000400:00000200:5.0:1773851852.265124:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25651@kfi7 to cpt 4
00000400:00000200:5.0:1773851852.265125:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25651@kfi7 of length 224 into portal 12 MB=0x69b4c3e290800
00000400:00000200:5.0:1773851852.265126:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25651@kfi7 of length 224/224 into md 0x793926dc5 [64] + 116240
00000800:00000200:5.0:1773851852.265128:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851852.265129:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851852.265130:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25650@kfi7: PUT: OK
00000100:00000001:5.0:1773851852.265131:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851852.265132:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851852.265132:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000179a991c.
00000100:00000040:5.0:1773851852.265133:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000179a991c x1859601622960128 msgsize 224
00000100:00100000:5.0:1773851852.265134:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25651@kfi7 (source: 12345-25650@kfi7)
00000100:00000001:5.0:1773851852.265135:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851852.265136:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000800:00000200:5.0:1773851852.265138:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851852.265140:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851852.265141:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851852.265141:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851852.265142:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851852.265142:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851852.265143:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601622960128
00000020:00000001:5.0:1773851852.265144:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851852.265144:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff82485
00000020:00000001:5.0:1773851852.265145:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851852.265147:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000046ccb84b refcount=9
00000020:00000001:5.0:1773851852.265147:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108589139968 : -106965120411648 : ffff9eb73dfe9800)
00000020:00000001:5.0:1773851852.265148:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108589139968 : -106965120411648 : ffff9eb73dfe9800)
00000100:00000001:5.0:1773851852.265149:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851852.265150:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851852.265150:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000093a22904.
00000020:00000010:5.0:1773851852.265151:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851852.265152:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000018730203.
00000100:00000001:5.0:1773851852.265153:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851852.265154:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851852.265154:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851852.265155:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851852.265156:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851852.265156:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.265157:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.265158:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851852.265158:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851852.265159:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851852.265159:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851852.265160:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25651@kfi7, seq: 2001844
00000100:00000040:5.0:1773851852.265160:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000046ccb84b : new rpc_count 1
00000100:00000001:7.0:1773851852.265161:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.265161:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.265161:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046241792 : -106940663309824 : ffff9ebcefc05a00)
00000100:00000040:5.0:1773851852.265162:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000179a991c x1859601622960128/t0(0) o400->32324cb1-964d-4b36-8769-0612de2afa4d@25651@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2089-0'
00000100:00000001:5.0:1773851852.265165:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851852.265165:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851852.265166:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000179a991c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:32324cb1-964d-4b36-8769-0612de2afa4d+9:39517:x1859601622960128:12345-25651@kfi7:400:default-tuolumne2089-0
00000100:00000200:5.0:1773851852.265168:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601622960128
00000020:00000001:5.0:1773851852.265168:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851852.265169:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851852.265170:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.265170:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851852.265171:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851852.265172:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851852.265172:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601622960128, found 0 last_xid 1859601622960127
00000020:00000001:5.0:1773851852.265173:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851852.265174:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851852.265174:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851852.265175:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.265175:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851852.265176:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851852.265176:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851852.265177:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000081653d34.
02000000:00000001:5.0:1773851852.265178:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.265179:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.265179:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851852.265180:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182684279075, transno 0, xid 1859601622960128
00010000:00000001:5.0:1773851852.265181:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851852.265182:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000179a991c x1859601622960128/t0(0) o400->32324cb1-964d-4b36-8769-0612de2afa4d@25651@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2089-0'
00010000:00000001:5.0:1773851852.265184:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851852.265185:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851852.265186:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=84 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851852.265187:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851852.265187:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ea17a7e0 refcount 3 to 25651@kfi7
00000100:00000001:5.0:1773851852.265188:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518432 : -107156126033184 : ffff9e8ac52c1ae0)
02000000:00000001:5.0:1773851852.265189:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851852.265189:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.265190:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851852.265191:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25650@kfi7
00000400:00000010:5.0:1773851852.265191:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000007a84371.
00000100:00000200:5.0:1773851852.265192:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601622960128, offset 224
00000400:00000200:5.0:1773851852.265193:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25650@kfi7
00000400:00000200:5.0:1773851852.265194:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.265195:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 1
00000400:00000200:5.0:1773851852.265196:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000400:00000200:5.0:1773851852.265197:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 3
00000400:00000200:5.0:1773851852.265198:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25650@kfi7 local destination
00000400:00000200:5.0:1773851852.265199:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768511:8768511:1024:4294967295] 25650@kfi7 LPNI seq info [261073:261073:16:4294967295]
00000400:00000200:5.0:1773851852.265201:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000400:00000200:5.0:1773851852.265201:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.265203:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25650@kfi7(25650@kfi7:25650@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851852.265204:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 3
00000800:00000200:5.0:1773851852.265205:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851852.265206:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851852.265208:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851852.265212:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e78 Using peer 25650@kfi7(0x100000000000e78)
00000800:00000200:5.0:1773851852.265215:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 324 bytes to peer 0x100000000000e78: rc=0
00000800:00000200:5.0:1773851852.265217:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e78 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851852.265219:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851852.265219:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ea17a7e0 refcount 2 to 25651@kfi7
00010000:00000001:5.0:1773851852.265220:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851852.265221:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851852.265221:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851852.265222:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000179a991c x1859601622960128/t0(0) o400->32324cb1-964d-4b36-8769-0612de2afa4d@25651@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2089-0'
00000100:00100000:5.0:1773851852.265225:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000179a991c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:32324cb1-964d-4b36-8769-0612de2afa4d+9:39517:x1859601622960128:12345-25651@kfi7:400:default-tuolumne2089-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851852.265227:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25651@kfi7, seq: 2001844
00000100:00000040:5.0:1773851852.265228:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000046ccb84b : new rpc_count 0
00000100:00000001:5.0:1773851852.265229:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851852.265229:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851852.265229:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851852.265230:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e78 TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851852.265230:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000018730203.
00000400:00000200:6.0:1773851852.265231:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851852.265231:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000093a22904.
00000020:00000040:5.0:1773851852.265232:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000046ccb84b : new refcount 8
00000100:00000001:5.0:1773851852.265232:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851852.265233:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25650@kfi7: PUT: OK
00000400:00000200:6.0:1773851852.265234:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000007a84371
00000400:00000010:6.0:1773851852.265234:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000007a84371.
00000100:00000001:6.0:1773851852.265235:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851852.265235:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851852.265236:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000800:00000200:6.0:1773851852.265238:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 25650@kfi7(0000000046d908d5):0x0 lsk 3705 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e78 Transaction freed
00000800:00000200:2.0:1773851852.296075:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851852.296076:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851852.296079:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851852.296083:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851852.296086:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:2.0:1773851852.296088:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26032@kfi7 : PUT - for me
00000400:00000200:2.0:1773851852.296090:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:2.0:1773851852.296091:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 1
00000400:00000200:2.0:1773851852.296093:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:2.0:1773851852.296094:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000400:00000200:2.0:1773851852.296096:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 3
00000400:00000200:2.0:1773851852.296097:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25968@kfi7 to cpt 5
00000400:00000200:2.0:1773851852.296099:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25968@kfi7 of length 224 into portal 12 MB=0x699e16c067340
00000400:00000200:2.0:1773851852.296102:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25968@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 7336
00000800:00000200:2.0:1773851852.296106:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851852.296109:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851852.296111:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26032@kfi7: PUT: OK
00000100:00000001:2.0:1773851852.296113:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851852.296114:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851852.296115:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000094fbd466.
00000100:00000040:2.0:1773851852.296117:0:2506505:0:(events.c:358:request_in_callback()) incoming req@0000000094fbd466 x1858043319317312 msgsize 224
00000100:00100000:2.0:1773851852.296120:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-25968@kfi7 (source: 12345-26032@kfi7)
00000100:00000001:2.0:1773851852.296121:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851852.296123:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000100:00000001:1.0:1773851852.296124:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851852.296125:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:1.0:1773851852.296125:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.296126:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.296127:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.296128:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.296130:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043319317312
00000020:00000001:1.0:1773851852.296131:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.296132:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f56
00000020:00000001:1.0:1773851852.296133:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.296135:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009823d5b4 refcount=6
00000020:00000001:1.0:1773851852.296136:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744909824 : -107128964641792 : ffff9e91181e0c00)
00000020:00000001:1.0:1773851852.296138:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744909824 : -107128964641792 : ffff9e91181e0c00)
00000100:00000001:1.0:1773851852.296140:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.296141:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.296142:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092010b2a.
00000020:00000010:1.0:1773851852.296144:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851852.296145:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.296147:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.296147:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851852.296148:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.296150:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851852.296151:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851852.296152:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.296154:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851852.296156:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851852.296156:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.296157:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851852.296157:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851852.296159:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25968@kfi7, seq: 1997477
00000100:00000001:2.0:1773851852.296160:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.296160:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009823d5b4 : new rpc_count 1
00000100:00000001:2.0:1773851852.296161:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.296162:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706776448 : -106953002775168 : ffff9eba10430d80)
00000100:00000040:1.0:1773851852.296164:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000094fbd466 x1858043319317312/t0(0) o400->0f3115da-fe03-4cb5-9f51-142871ab6186@25968@kfi7:492/0 lens 224/0 e 0 to 0 dl 1773852607 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2110-0'
00000100:00000001:1.0:1773851852.296169:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.296170:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.296172:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094fbd466 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0f3115da-fe03-4cb5-9f51-142871ab6186+6:39711:x1858043319317312:12345-25968@kfi7:400:default-tuolumne2110-0
00000100:00000200:1.0:1773851852.296174:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043319317312
00000020:00000001:1.0:1773851852.296175:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.296176:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.296177:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.296178:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.296179:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851852.296181:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.296181:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043319317312, found 0 last_xid 1858043319317311
00000020:00000001:1.0:1773851852.296183:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.296184:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.296185:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.296186:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.296187:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851852.296188:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.296188:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.296189:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f99f5ddc.
02000000:00000001:1.0:1773851852.296190:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.296191:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.296192:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.296194:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183028139431, transno 0, xid 1858043319317312
00010000:00000001:1.0:1773851852.296195:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.296196:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000094fbd466 x1858043319317312/t0(0) o400->0f3115da-fe03-4cb5-9f51-142871ab6186@25968@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2110-0'
00010000:00000001:1.0:1773851852.296201:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.296202:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.296203:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.296205:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.296206:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b7872b40 refcount 3 to 25968@kfi7
00000100:00000001:1.0:1773851852.296208:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108032 : -107156354443584 : ffff9e8ab78ed6c0)
02000000:00000001:1.0:1773851852.296209:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.296210:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.296211:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.296212:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26032@kfi7
00000400:00000010:1.0:1773851852.296213:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003083b24b.
00000100:00000200:1.0:1773851852.296214:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043319317312, offset 224
00000400:00000200:1.0:1773851852.296217:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26032@kfi7
00000400:00000200:1.0:1773851852.296218:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.296219:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 1
00000400:00000200:1.0:1773851852.296221:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000400:00000200:1.0:1773851852.296223:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 3
00000400:00000200:1.0:1773851852.296225:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26032@kfi7 local destination
00000400:00000200:1.0:1773851852.296227:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768512:8768512:1024:4294967295] 26032@kfi7 LPNI seq info [3537995:3537995:16:4294967295]
00000400:00000200:1.0:1773851852.296230:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000400:00000200:1.0:1773851852.296231:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.296235:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26032@kfi7(26032@kfi7:26032@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.296237:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 3
00000800:00000200:1.0:1773851852.296239:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.296241:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851852.296245:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.296249:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a87 Using peer 26032@kfi7(0x100000000000a87)
00000800:00000200:1.0:1773851852.296254:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 324 bytes to peer 0x100000000000a87: rc=0
00000800:00000200:1.0:1773851852.296256:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a87 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.296260:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.296262:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b7872b40 refcount 2 to 25968@kfi7
00010000:00000001:1.0:1773851852.296264:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.296264:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.296266:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.296267:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000094fbd466 x1858043319317312/t0(0) o400->0f3115da-fe03-4cb5-9f51-142871ab6186@25968@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2110-0'
00000800:00000200:2.0:1773851852.296271:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a87 TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851852.296273:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094fbd466 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0f3115da-fe03-4cb5-9f51-142871ab6186+6:39711:x1858043319317312:12345-25968@kfi7:400:default-tuolumne2110-0 Request processed in 102us (155us total) trans 0 rc 0/0
00000400:00000200:2.0:1773851852.296274:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851852.296276:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26032@kfi7: PUT: OK
00000400:00000200:2.0:1773851852.296277:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003083b24b
00000100:00100000:1.0:1773851852.296277:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25968@kfi7, seq: 1997477
00000400:00000010:2.0:1773851852.296278:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003083b24b.
00000100:00000040:1.0:1773851852.296278:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009823d5b4 : new rpc_count 0
00000100:00000001:2.0:1773851852.296279:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851852.296280:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:1.0:1773851852.296280:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851852.296281:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851852.296282:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000020:00000010:1.0:1773851852.296282:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851852.296283:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000800:00000200:2.0:1773851852.296284:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 26032@kfi7(00000000d945adc1):0x0 lsk 2696 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a87 Transaction freed
00000020:00000010:1.0:1773851852.296285:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092010b2a.
00000020:00000040:1.0:1773851852.296286:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000009823d5b4 : new refcount 5
00000100:00000001:1.0:1773851852.296287:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851852.374173:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851852.374173:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851852.374175:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851852.374177:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851852.374179:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:6.0:1773851852.374180:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22147@kfi7 : PUT - for me
00000400:00000200:6.0:1773851852.374181:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:6.0:1773851852.374181:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 1
00000400:00000200:6.0:1773851852.374182:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:6.0:1773851852.374183:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000400:00000200:6.0:1773851852.374184:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 3
00000400:00000200:6.0:1773851852.374185:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22146@kfi7 to cpt 6
00000400:00000200:6.0:1773851852.374186:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22146@kfi7 of length 224 into portal 12 MB=0x699e2c3650440
00000400:00000200:6.0:1773851852.374187:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22146@kfi7 of length 224/224 into md 0x793926dc5 [64] + 116464
00000800:00000200:6.0:1773851852.374188:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851852.374191:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851852.374192:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22147@kfi7: PUT: OK
00000100:00000001:6.0:1773851852.374193:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851852.374193:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851852.374194:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000032b7ae9d.
00000100:00000040:6.0:1773851852.374195:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000032b7ae9d x1858049080099904 msgsize 224
00000100:00100000:6.0:1773851852.374196:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-22146@kfi7 (source: 12345-22147@kfi7)
00000100:00000001:6.0:1773851852.374197:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851852.374198:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000800:00000200:6.0:1773851852.374199:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851852.374200:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851852.374201:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851852.374201:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851852.374202:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851852.374203:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851852.374204:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049080099904
00000020:00000001:5.0:1773851852.374205:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851852.374206:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929b4
00000020:00000001:5.0:1773851852.374208:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851852.374210:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000827577a3 refcount=3453
00000020:00000001:5.0:1773851852.374211:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743199744 : -107128966351872 : ffff9e911803f400)
00000020:00000001:5.0:1773851852.374213:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743199744 : -107128966351872 : ffff9e911803f400)
00000100:00000001:5.0:1773851852.374214:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851852.374215:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851852.374216:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000093a22904.
00000020:00000010:5.0:1773851852.374218:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851852.374219:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000018730203.
00000100:00000001:5.0:1773851852.374221:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851852.374221:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851852.374222:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851852.374223:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851852.374224:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851852.374225:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.374226:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.374228:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851852.374228:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851852.374229:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851852.374229:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851852.374230:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22146@kfi7, seq: 2001845
00000100:00000040:7.0:1773851852.374231:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000827577a3 : new rpc_count 10
00000100:00000001:5.0:1773851852.374231:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.374232:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637052503298560 : -107021206253056 : ffff9eaa2f049200)
00000100:00000001:5.0:1773851852.374232:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.374233:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000032b7ae9d x1858049080099904/t0(0) o400->1ba86d43-3adb-487b-b509-2e31a79a43c3@22146@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1880-0'
00000100:00000001:7.0:1773851852.374236:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851852.374236:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851852.374237:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032b7ae9d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1ba86d43-3adb-487b-b509-2e31a79a43c3+3453:39643:x1858049080099904:12345-22146@kfi7:400:default-tuolumne1880-0
00000100:00000200:7.0:1773851852.374239:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858049080099904
00000020:00000001:7.0:1773851852.374239:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851852.374240:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851852.374241:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.374241:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851852.374242:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851852.374243:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851852.374243:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858049080099904, found 0 last_xid 1858049079317567
00000020:00000001:7.0:1773851852.374244:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851852.374245:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851852.374245:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851852.374246:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.374246:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851852.374247:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851852.374247:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851852.374248:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006931cd83.
02000000:00000001:7.0:1773851852.374259:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.374259:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.374260:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851852.374261:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593460, transno 0, xid 1858049080099904
00010000:00000001:7.0:1773851852.374261:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851852.374262:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000032b7ae9d x1858049080099904/t0(0) o400->1ba86d43-3adb-487b-b509-2e31a79a43c3@22146@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1880-0'
00010000:00000001:7.0:1773851852.374264:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851852.374265:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851852.374266:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=84 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851852.374267:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851852.374267:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004f1b770b refcount 3 to 22146@kfi7
00000100:00000001:7.0:1773851852.374268:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329472 : -107155410222144 : ffff9e8aefd683c0)
02000000:00000001:7.0:1773851852.374269:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851852.374269:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.374270:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851852.374271:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22147@kfi7
00000400:00000010:7.0:1773851852.374271:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000100:00000200:7.0:1773851852.374272:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858049080099904, offset 224
00000400:00000200:7.0:1773851852.374273:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22147@kfi7
00000400:00000200:7.0:1773851852.374274:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:7.0:1773851852.374275:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 1
00000400:00000200:7.0:1773851852.374276:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000400:00000200:7.0:1773851852.374277:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 3
00000400:00000200:7.0:1773851852.374278:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22147@kfi7 local destination
00000400:00000200:7.0:1773851852.374279:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768513:8768513:1024:4294967295] 22147@kfi7 LPNI seq info [12849564:12849564:16:4294967295]
00000400:00000200:7.0:1773851852.374281:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000400:00000200:7.0:1773851852.374282:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:7.0:1773851852.374284:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22147@kfi7(22147@kfi7:22147@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851852.374285:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 3
00000800:00000200:7.0:1773851852.374286:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851852.374288:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851852.374291:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851852.374293:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c5c Using peer 22147@kfi7(0x100000000000c5c)
00000800:00000200:7.0:1773851852.374296:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x100000000000c5c: rc=0
00000800:00000200:7.0:1773851852.374298:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c5c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851852.374300:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.374301:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004f1b770b refcount 2 to 22146@kfi7
00010000:00000001:7.0:1773851852.374301:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851852.374302:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.374302:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851852.374303:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000032b7ae9d x1858049080099904/t0(0) o400->1ba86d43-3adb-487b-b509-2e31a79a43c3@22146@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1880-0'
00000100:00100000:7.0:1773851852.374306:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032b7ae9d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1ba86d43-3adb-487b-b509-2e31a79a43c3+3453:39643:x1858049080099904:12345-22146@kfi7:400:default-tuolumne1880-0 Request processed in 70us (111us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851852.374308:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22146@kfi7, seq: 2001845
00000100:00000040:7.0:1773851852.374309:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000827577a3 : new rpc_count 9
00000100:00000001:7.0:1773851852.374310:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851852.374310:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:6.0:1773851852.374310:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c5c TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851852.374311:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851852.374311:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851852.374312:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000018730203.
00000400:00000200:6.0:1773851852.374312:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22147@kfi7: PUT: OK
00000020:00000010:7.0:1773851852.374313:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000093a22904.
00000020:00000040:7.0:1773851852.374313:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000827577a3 : new refcount 3452
00000400:00000200:6.0:1773851852.374313:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000100:00000001:7.0:1773851852.374314:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851852.374314:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:6.0:1773851852.374315:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851852.374315:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851852.374316:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000800:00000200:6.0:1773851852.374317:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 22147@kfi7(0000000000d48152):0x0 lsk 3165 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c5c Transaction freed
00000800:00000200:25.0:1773851852.394646:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851852.394647:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851852.394648:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851852.394651:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851852.394652:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.394654:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12915@kfi7 : PUT - for me
00000400:00000200:25.0:1773851852.394655:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.394655:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 1
00000400:00000200:25.0:1773851852.394656:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.394657:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000400:00000200:25.0:1773851852.394658:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 3
00000400:00000200:25.0:1773851852.394659:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12978@kfi7 to cpt 7
00000400:00000200:25.0:1773851852.394660:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12978@kfi7 of length 224 into portal 12 MB=0x69b31167f7d80
00000400:00000200:25.0:1773851852.394661:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12978@kfi7 of length 224/224 into md 0x16159c6179 [64] + 178112
00000800:00000200:25.0:1773851852.394663:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851852.394665:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851852.394666:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12915@kfi7: PUT: OK
00000100:00000001:25.0:1773851852.394667:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851852.394668:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851852.394669:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1d60491.
00000100:00000040:25.0:1773851852.394669:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000e1d60491 x1859484993420672 msgsize 224
00000100:00100000:25.0:1773851852.394671:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12978@kfi7 (source: 12345-12915@kfi7)
00000100:00000001:25.0:1773851852.394672:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851852.394673:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000100:00000001:26.0:1773851852.394675:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851852.394675:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851852.394676:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851852.394677:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851852.394677:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851852.394679:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851852.394680:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859484993420672
00000020:00000001:26.0:1773851852.394681:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851852.394682:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cdbf9b67c
00000020:00000001:26.0:1773851852.394683:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851852.394684:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000052438900 refcount=5
00000020:00000001:26.0:1773851852.394685:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636979123768320 : -107094585783296 : ffff9e991941cc00)
00000020:00000001:26.0:1773851852.394686:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636979123768320 : -107094585783296 : ffff9e991941cc00)
00000100:00000001:26.0:1773851852.394688:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851852.394690:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851852.394691:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851852.394693:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851852.394694:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851852.394696:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851852.394697:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851852.394698:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851852.394699:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851852.394700:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851852.394701:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851852.394703:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851852.394705:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851852.394706:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851852.394706:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851852.394706:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851852.394708:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12978@kfi7, seq: 2025038
00000100:00000040:26.0:1773851852.394709:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000052438900 : new rpc_count 1
00000100:00000001:24.0:1773851852.394709:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851852.394710:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150697600 : -106980558854016 : ffff9eb3a5caa880)
00000100:00000001:24.0:1773851852.394710:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851852.394712:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e1d60491 x1859484993420672/t0(0) o400->ff3af850-8622-47de-8418-85a9c6c111f1@12978@kfi7:38/0 lens 224/0 e 0 to 0 dl 1773852153 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1290-0'
00000100:00000001:26.0:1773851852.394717:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851852.394717:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851852.394719:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1d60491 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ff3af850-8622-47de-8418-85a9c6c111f1+5:39894:x1859484993420672:12345-12978@kfi7:400:default-tuolumne1290-0
00000100:00000200:26.0:1773851852.394721:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859484993420672
00000020:00000001:26.0:1773851852.394722:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851852.394723:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851852.394724:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851852.394729:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851852.394730:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851852.394732:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851852.394732:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859484993420672, found 0 last_xid 1859484993420671
00000020:00000001:26.0:1773851852.394734:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851852.394735:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851852.394736:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851852.394737:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851852.394738:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851852.394739:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851852.394740:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851852.394741:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b7c3de4.
02000000:00000001:26.0:1773851852.394742:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851852.394743:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851852.394745:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851852.394746:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686839, transno 0, xid 1859484993420672
00010000:00000001:26.0:1773851852.394747:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851852.394749:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e1d60491 x1859484993420672/t0(0) o400->ff3af850-8622-47de-8418-85a9c6c111f1@12978@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1290-0'
00010000:00000001:26.0:1773851852.394753:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851852.394754:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851852.394755:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=85 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851852.394757:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851852.394758:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000181ed72f refcount 3 to 12978@kfi7
00000100:00000001:26.0:1773851852.394759:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272160 : -107152618279456 : ffff9e8b96402de0)
02000000:00000001:26.0:1773851852.394760:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851852.394761:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851852.394762:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851852.394764:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12915@kfi7
00000400:00000010:26.0:1773851852.394765:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e163307.
00000100:00000200:26.0:1773851852.394766:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859484993420672, offset 224
00000400:00000200:26.0:1773851852.394768:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12915@kfi7
00000400:00000200:26.0:1773851852.394770:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:26.0:1773851852.394771:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 1
00000400:00000200:26.0:1773851852.394773:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000400:00000200:26.0:1773851852.394775:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 3
00000400:00000200:26.0:1773851852.394777:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12915@kfi7 local destination
00000400:00000200:26.0:1773851852.394779:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768514:8768514:1024:4294967295] 12915@kfi7 LPNI seq info [10811825:10811825:16:4294967295]
00000400:00000200:26.0:1773851852.394782:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000400:00000200:26.0:1773851852.394783:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:26.0:1773851852.394787:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12915@kfi7(12915@kfi7:12915@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851852.394789:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 3
00000800:00000200:26.0:1773851852.394792:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851852.394794:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851852.394797:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851852.394801:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xce9 Using peer 12915@kfi7(0xce9)
00000800:00000200:26.0:1773851852.394806:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0xce9: rc=0
00000800:00000200:26.0:1773851852.394808:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xce9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851852.394812:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851852.394813:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000181ed72f refcount 2 to 12978@kfi7
00010000:00000001:26.0:1773851852.394815:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851852.394815:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851852.394816:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851852.394817:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1d60491 x1859484993420672/t0(0) o400->ff3af850-8622-47de-8418-85a9c6c111f1@12978@kfi7:38/0 lens 224/224 e 0 to 0 dl 1773852153 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1290-0'
00000800:00000200:25.0:1773851852.394822:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xce9 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851852.394823:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1d60491 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ff3af850-8622-47de-8418-85a9c6c111f1+5:39894:x1859484993420672:12345-12978@kfi7:400:default-tuolumne1290-0 Request processed in 105us (152us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851852.394823:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851852.394824:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12915@kfi7: PUT: OK
00000400:00000200:25.0:1773851852.394825:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e163307
00000400:00000010:25.0:1773851852.394826:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e163307.
00000100:00000001:25.0:1773851852.394826:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:26.0:1773851852.394827:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12978@kfi7, seq: 2025038
00000100:00000001:25.0:1773851852.394827:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:26.0:1773851852.394828:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000052438900 : new rpc_count 0
00000400:00000200:25.0:1773851852.394828:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000100:00000001:26.0:1773851852.394829:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851852.394829:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 12915@kfi7(000000006f036898):0x0 lsk 3306 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xce9 Transaction freed
00000100:00000001:26.0:1773851852.394830:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851852.394831:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851852.394832:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851852.394834:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000020:00000040:26.0:1773851852.394835:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000052438900 : new refcount 4
00000100:00000001:26.0:1773851852.394836:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851852.437560:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851852.437560:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851852.437561:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851852.437561:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:3.0:1773851852.437563:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851852.437564:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:3.0:1773851852.437567:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:2.0:1773851852.437567:0:2506505:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8931@kfi7(000000004f110280):0x7e2 version: 2; local version 2; negotiated version: 2
00000400:00000200:3.0:1773851852.437571:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000800:00000200:2.0:1773851852.437571:0:2506505:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Using peer 8931@kfi7(0x7e2)
00000400:00000200:3.0:1773851852.437573:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8931@kfi7 : PUT - for me
00000400:00000200:2.0:1773851852.437574:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:3.0:1773851852.437575:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:3.0:1773851852.437577:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 1
00000800:00000200:2.0:1773851852.437577:0:2506505:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000dae7d744: Posted send of 38 bytes to peer 0x7e2: rc=0
00000400:00000200:3.0:1773851852.437579:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:3.0:1773851852.437580:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000800:00000200:2.0:1773851852.437580:0:2506505:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:3.0:1773851852.437581:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000400:00000200:3.0:1773851852.437583:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:3.0:1773851852.437585:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 576 into portal 12 MB=0x69b09e5d90900
00000400:00000200:3.0:1773851852.437587:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8931@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 7560
00000800:00000200:3.0:1773851852.437590:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851852.437593:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:1.0:1773851852.437593:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_EVENT_TX_OK event status 0
00000400:00000200:3.0:1773851852.437595:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8931@kfi7: PUT: OK
00000100:00000001:3.0:1773851852.437596:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:1.0:1773851852.437596:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Transaction freed
00000100:00000200:3.0:1773851852.437597:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851852.437598:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008b6a4b28.
00000100:00000040:3.0:1773851852.437599:0:2506738:0:(events.c:358:request_in_callback()) incoming req@000000008b6a4b28 x1859316673480960 msgsize 576
00000100:00100000:3.0:1773851852.437602:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8931@kfi7)
00000100:00000001:3.0:1773851852.437604:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851852.437605:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000100:00000001:1.0:1773851852.437606:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851852.437606:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.437607:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.437607:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:3.0:1773851852.437608:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:1.0:1773851852.437608:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.437609:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673480960
00000020:00000001:1.0:1773851852.437610:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.437611:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000020:00000001:1.0:1773851852.437611:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.437614:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=9
00000020:00000001:1.0:1773851852.437615:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000020:00000001:1.0:1773851852.437616:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:1.0:1773851852.437617:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.437618:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.437619:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092010b2a.
00000020:00000010:1.0:1773851852.437620:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851852.437621:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.437622:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.437622:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:1.0:1773851852.437623:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:1.0:1773851852.437623:0:60951:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.437624:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.437625:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.437626:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.437627:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851852.437627:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851852.437629:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.437629:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851852.437629:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 408701472
00000100:00000001:2.0:1773851852.437630:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.437630:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:1.0:1773851852.437630:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288720896 : -106964420830720 : ffff9eb767b15a00)
00000100:00000001:2.0:1773851852.437631:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.437632:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008b6a4b28 x1859316673480960/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:102/0 lens 576/0 e 0 to 0 dl 1773852217 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1035-0'
00000100:00000001:1.0:1773851852.437634:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.437635:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.437636:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b6a4b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:1429396:x1859316673480960:12345-8931@kfi7:101:default-tuolumne1035-0
00000100:00000200:1.0:1773851852.437637:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673480960
00000020:00000001:1.0:1773851852.437638:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.437638:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.437639:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.437640:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.437641:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:1.0:1773851852.437641:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.437642:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316673480960, found 0 last_xid 1859316673480959
00000020:00000001:1.0:1773851852.437643:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.437644:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.437644:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.437645:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.437646:0:60951:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:1.0:1773851852.437646:0:60951:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:1.0:1773851852.437647:0:60951:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:1.0:1773851852.437647:0:60951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:1.0:1773851852.437647:0:60951:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.437650:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:1.0:1773851852.437652:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 200
00010000:00000001:1.0:1773851852.437652:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.437653:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.437654:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000f47951c7.
00000020:00000001:1.0:1773851852.437655:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.437656:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000f47951c7 with handle 0x21b6f08f07a6ac82 to hash
00000020:00000001:1.0:1773851852.437657:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.437657:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636928174528704 : -107145535022912 : ffff9e8d3c7218c0)
00010000:00000010:1.0:1773851852.437658:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000b22c364f.
00010000:00000001:1.0:1773851852.437659:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636928174528704 : -107145535022912 : ffff9e8d3c7218c0)
00010000:00010000:1.0:1773851852.437660:0:60951:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000f47951c7/0x21b6f08f07a6ac82 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 201 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde0abe468d1e3cb6 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437663:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:1.0:1773851852.437664:0:60951:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000006b8dd11 : new locks_count 4
00000020:00000040:1.0:1773851852.437664:0:60951:0:(genops.c:871:class_export_get()) GET export 0000000006b8dd11 refcount=10
00010000:00000001:1.0:1773851852.437666:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:1.0:1773851852.437667:0:60951:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:1.0:1773851852.437668:0:60951:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:1.0:1773851852.437668:0:60951:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:1.0:1773851852.437669:0:60951:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:1.0:1773851852.437669:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:1.0:1773851852.437669:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:1.0:1773851852.437670:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:1.0:1773851852.437671:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:1.0:1773851852.437672:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:1.0:1773851852.437673:0:60951:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.437683:0:60951:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:1.0:1773851852.437683:0:60951:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:1.0:1773851852.437684:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.437684:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.437686:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000737bfd9e.
02000000:00000001:1.0:1773851852.437687:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.437688:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.437688:0:60951:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.437689:0:60951:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:1.0:1773851852.437689:0:60951:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:1.0:1773851852.437690:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.437690:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.437691:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.437692:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.437692:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.437692:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.437693:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.437693:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.437694:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.437694:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.437695:0:60951:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:1.0:1773851852.437696:0:60951:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:1.0:1773851852.437696:0:60951:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:1.0:1773851852.437697:0:60951:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.437697:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.437698:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.437698:0:60951:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:1.0:1773851852.437699:0:60951:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.437700:0:60951:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:1.0:1773851852.437700:0:60951:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 00000000c1bee0f6
00000004:00000001:1.0:1773851852.437701:0:60951:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:1.0:1773851852.437702:0:60951:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:1.0:1773851852.437702:0:60951:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:1.0:1773851852.437702:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:1.0:1773851852.437703:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.437703:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.437704:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.437705:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000d0bc046c.
00000020:00000001:1.0:1773851852.437706:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.437706:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000d0bc046c with handle 0x21b6f08f07a6ac89 to hash
00000020:00000001:1.0:1773851852.437707:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.437707:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00010000:00000010:1.0:1773851852.437708:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000078bd25d4.
00010000:00000001:1.0:1773851852.437709:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00010000:00000001:1.0:1773851852.437710:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.437710:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.437711:0:60951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0bc046c/0x21b6f08f07a6ac89 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 202 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437714:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.437714:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:1.0:1773851852.437715:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:1.0:1773851852.437716:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:1.0:1773851852.437716:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.437717:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.437718:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.437718:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.437719:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:1.0:1773851852.437719:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:1.0:1773851852.437720:0:60951:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:1.0:1773851852.437720:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:1.0:1773851852.437720:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 201
00010000:00000040:1.0:1773851852.437722:0:60951:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:1.0:1773851852.437723:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437728:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437730:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437732:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437734:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437736:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437738:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437740:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437742:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437744:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437745:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437747:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437749:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437751:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437752:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437754:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437756:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437758:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437760:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437762:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437764:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437766:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437767:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437769:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437770:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437772:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437774:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437776:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437778:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437780:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437781:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437783:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437785:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437787:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437788:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437790:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437792:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437794:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437795:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437797:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437799:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437801:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437803:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437805:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437806:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437808:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437809:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437811:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437813:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437815:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437817:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437819:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437820:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437822:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437824:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdf7f3a8/0x21b6f08f07a5a537 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6a8 expref: 8 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437826:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437827:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437830:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437831:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437833:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437834:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 10 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437836:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437837:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437839:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437841:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437843:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437845:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437847:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437848:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437850:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437853:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437855:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437856:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437858:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437860:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437862:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437863:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437866:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437867:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437869:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437870:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437873:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437874:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437876:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437878:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437880:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437881:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437883:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437885:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437887:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437889:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437891:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437892:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437894:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437895:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437897:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437899:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a4d807 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25b3 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437901:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437903:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062815ce5/0x21b6f08f07a4d7cf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b924a expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437905:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437906:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d2098ccc/0x21b6f08f07a4d797 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0f4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437909:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437910:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f2deef/0x21b6f08f07a4d75f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84ed expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437912:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437913:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a4d720 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18304@kfi7 remote: 0xa8da567d9ebd26ed expref: 8 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437916:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437916:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437919:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437920:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437922:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437923:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437926:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437927:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437929:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437931:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437933:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437934:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437936:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437938:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437940:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437941:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437943:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437945:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437947:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437948:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437950:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437952:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437954:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437955:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437957:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437958:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437960:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437962:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437964:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437966:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437967:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437969:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437971:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437972:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437974:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437975:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437977:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437978:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437980:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437981:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437984:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437985:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437987:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437989:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437991:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437992:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437994:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437995:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.437998:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.437999:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438002:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438003:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438005:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438006:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438008:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438009:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438012:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438013:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438015:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438017:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438019:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438020:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438022:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438024:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438026:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438027:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438029:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438031:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438033:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438034:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438036:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438038:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438040:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438041:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438043:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438044:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438047:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438049:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438051:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438052:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438054:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438055:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438058:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438059:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438062:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438063:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438065:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438066:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438069:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438070:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438073:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438074:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438076:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438077:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438079:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438080:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438083:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438084:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438086:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438088:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438090:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438091:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438093:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438094:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438096:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438098:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438100:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438101:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438104:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438105:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438107:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438108:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438110:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438112:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438114:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438115:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438117:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438119:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438121:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438123:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438125:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438126:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438128:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438130:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438132:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438133:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438135:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438136:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438138:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438140:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438142:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438144:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438146:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438147:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438149:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438150:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438152:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438153:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438155:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438157:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438159:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438160:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438162:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438163:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438166:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438167:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438169:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438170:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438172:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438174:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438175:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438177:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438179:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438181:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438183:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438184:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438186:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438187:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438189:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438190:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438193:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438194:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438196:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438197:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438199:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438201:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438203:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438204:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438206:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438208:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438210:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438212:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438214:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438215:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438217:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438218:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438221:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438222:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438224:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438226:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438228:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438229:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438231:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438233:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438234:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438235:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438237:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438239:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438241:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438243:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438245:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438246:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438248:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438250:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438252:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438253:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438255:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438256:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438259:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438260:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438262:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438264:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438266:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438268:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438270:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438271:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438273:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438275:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438277:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438278:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438280:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438282:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438284:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438285:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438287:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438288:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438291:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438292:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438294:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438295:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438298:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438299:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438301:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438302:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438304:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438306:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438308:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438310:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438312:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438313:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438315:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438316:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438319:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438320:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438322:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438324:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438326:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438327:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438329:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438330:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438333:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438334:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438336:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438338:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438340:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438341:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438343:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438344:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438346:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438348:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438350:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438351:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438353:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438354:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438357:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438358:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438360:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438361:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438363:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438365:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438367:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438368:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438370:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438371:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438374:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438375:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438377:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438378:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438381:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438382:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438384:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438385:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438387:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438389:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438391:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438393:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438395:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438396:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438398:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438399:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438401:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438402:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438404:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438406:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438408:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438409:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438411:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438413:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438415:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438416:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438418:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438419:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438422:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00010000:1.0:1773851852.438422:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0bc046c/0x21b6f08f07a6ac89 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438424:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.438425:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:1.0:1773851852.438427:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:1.0:1773851852.438427:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.438428:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:1.0:1773851852.438428:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.438429:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.438429:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.438430:0:60951:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:1.0:1773851852.438431:0:60951:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.438431:0:60951:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0bc046c/0x21b6f08f07a6ac89 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438434:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.438434:0:60951:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:1.0:1773851852.438435:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.438435:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.438436:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.438436:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.438437:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d0bc046c refcount=3
00000020:00000001:1.0:1773851852.438437:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00010000:00000001:1.0:1773851852.438438:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00010000:00000001:1.0:1773851852.438438:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.438439:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.438439:0:60951:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.438440:0:60951:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.438441:0:60951:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:1.0:1773851852.438441:0:60951:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:1.0:1773851852.438442:0:60951:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:1.0:1773851852.438449:0:60951:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.438450:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:1.0:1773851852.438450:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.438451:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.438452:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438453:0:60951:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438453:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438454:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:1.0:1773851852.438454:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.438455:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.438455:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438456:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438457:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:1.0:1773851852.438457:0:60951:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:1.0:1773851852.438458:0:60951:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.438459:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.438459:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.438460:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.438460:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.438461:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.438461:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:1.0:1773851852.438462:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.438462:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:1.0:1773851852.438462:0:60951:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:1.0:1773851852.438463:0:60951:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:1.0:1773851852.438464:0:60951:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:1.0:1773851852.438465:0:60951:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:1.0:1773851852.438466:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.438466:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.438466:0:60951:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:1.0:1773851852.438467:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:1.0:1773851852.438467:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.438468:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.438468:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438469:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438469:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.438470:0:60951:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.438471:0:60951:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:1.0:1773851852.438473:0:60951:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.438473:0:60951:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.438476:0:60951:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.438476:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.438476:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.438477:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d0bc046c refcount=3
00000020:00000001:1.0:1773851852.438478:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00010000:00000001:1.0:1773851852.438478:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00000004:00000040:1.0:1773851852.438479:0:60951:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 0000000006b8dd11 : new locks_count 5
00000020:00000040:1.0:1773851852.438479:0:60951:0:(genops.c:871:class_export_get()) GET export 0000000006b8dd11 refcount=11
00010000:00000001:1.0:1773851852.438480:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.438480:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.438481:0:60951:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:1.0:1773851852.438482:0:60951:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:1.0:1773851852.438482:0:60951:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:1.0:1773851852.438482:0:60951:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:1.0:1773851852.438483:0:60951:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:1.0:1773851852.438483:0:60951:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:1.0:1773851852.438483:0:60951:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:1.0:1773851852.438484:0:60951:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:1.0:1773851852.438485:0:60951:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.438485:0:60951:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:1.0:1773851852.438486:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:1.0:1773851852.438487:0:60951:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:1.0:1773851852.438488:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:1.0:1773851852.438488:0:60951:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:1.0:1773851852.438489:0:60951:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:1.0:1773851852.438489:0:60951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:1.0:1773851852.438490:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.438490:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.438490:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.438491:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:1.0:1773851852.438492:0:60951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f47951c7 with handle 0x21b6f08f07a6ac82 from hash
00010000:00000001:1.0:1773851852.438492:0:60951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:1.0:1773851852.438493:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.438493:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.438493:0:60951:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:1.0:1773851852.438494:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:1.0:1773851852.438494:0:60951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f47951c7/0x21b6f08f07a6ac82 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x44000000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3cb6 expref: 11 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438497:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.438497:0:60951:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000006b8dd11 : new locks_count 4
00000020:00000040:1.0:1773851852.438498:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 10
00010000:00000010:1.0:1773851852.438499:0:60951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000b22c364f.
00010000:00000040:1.0:1773851852.438499:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000001:1.0:1773851852.438500:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.438500:0:60951:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.438501:0:60951:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:1.0:1773851852.438502:0:60951:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0bc046c/0x21b6f08f07a6ac89 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3cb6 expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.438504:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000001:1.0:1773851852.438505:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:1.0:1773851852.438506:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:1.0:1773851852.438506:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:1.0:1773851852.438507:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:1.0:1773851852.438508:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.438508:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.438509:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:1.0:1773851852.438509:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.438509:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:1.0:1773851852.438510:0:60951:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d0bc046c, rc 0)
00000020:00000001:1.0:1773851852.438510:0:60951:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.438511:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200468, transno 0, xid 1859316673480960
00010000:00000001:1.0:1773851852.438512:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.438513:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008b6a4b28 x1859316673480960/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:102/0 lens 576/640 e 0 to 0 dl 1773852217 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1035-0'
00010000:00000001:1.0:1773851852.438515:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.438516:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.438517:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.438518:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.438518:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:1.0:1773851852.438519:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
02000000:00000001:1.0:1773851852.438520:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.438521:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.438521:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.438522:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8931@kfi7
00000400:00000010:1.0:1773851852.438523:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009da9b420.
00000100:00000200:1.0:1773851852.438524:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859316673480960, offset 224
00000400:00000200:1.0:1773851852.438525:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8931@kfi7
00000400:00000200:1.0:1773851852.438526:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.438528:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 1
00000400:00000200:1.0:1773851852.438529:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.438531:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000400:00000200:1.0:1773851852.438532:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8931@kfi7 local destination
00000400:00000200:1.0:1773851852.438534:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768515:8768515:1024:4294967295] 8931@kfi7 LPNI seq info [2192101:2192101:16:4294967295]
00000400:00000200:1.0:1773851852.438535:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.438536:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.438539:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8931@kfi7(8931@kfi7:8931@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.438540:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000800:00000200:1.0:1773851852.438542:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.438543:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:1.0:1773851852.438546:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.438549:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Using peer 8931@kfi7(0x7e2)
00000800:00000200:1.0:1773851852.438552:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 740 bytes to peer 0x7e2: rc=0
00000800:00000200:1.0:1773851852.438554:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.438557:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.438558:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:1.0:1773851852.438558:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.438559:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.438560:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.438561:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008b6a4b28 x1859316673480960/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:102/0 lens 576/640 e 0 to 0 dl 1773852217 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1035-0'
00000100:00100000:1.0:1773851852.438564:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b6a4b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:060c0146-d4d1-4a42-8c8d-241eaa2f523c+10:1429396:x1859316673480960:12345-8931@kfi7:101:default-tuolumne1035-0 Request processed in 929us (964us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851852.438567:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 408701472
00000800:00000200:3.0:1773851852.438569:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_EVENT_TX_OK event status 0
00000100:00000040:1.0:1773851852.438569:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000100:00000001:1.0:1773851852.438570:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851852.438570:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851852.438571:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000200:3.0:1773851852.438572:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851852.438572:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000020:00000010:1.0:1773851852.438573:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092010b2a.
00000020:00000040:1.0:1773851852.438573:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 9
00000400:00000200:3.0:1773851852.438574:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8931@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.438574:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851852.438575:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009da9b420
00000400:00000010:3.0:1773851852.438576:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009da9b420.
00000100:00000001:3.0:1773851852.438577:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851852.438578:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851852.438580:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000800:00000200:3.0:1773851852.438583:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Transaction freed
00000800:00000200:25.0:1773851852.438731:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851852.438732:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851852.438734:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851852.438735:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851852.438737:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.438739:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8739@kfi7 : PUT - for me
00000400:00000200:25.0:1773851852.438739:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.438740:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 1
00000800:00000200:26.0:1773851852.438741:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:25.0:1773851852.438741:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000800:00000200:26.0:1773851852.438742:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851852.438742:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:25.0:1773851852.438743:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000800:00000200:26.0:1773851852.438744:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851852.438744:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:25.0:1773851852.438745:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 328 into portal 17 MB=0x69b09e5d90a40
00000800:00000200:26.0:1773851852.438746:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851852.438747:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8931@kfi7 of length 328/328 into md 0x1615af7ff9 [2] + 1312
00000400:00000200:26.0:1773851852.438748:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:25.0:1773851852.438749:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851852.438750:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:25.0:1773851852.438750:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851852.438751:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:26.0:1773851852.438751:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:25.0:1773851852.438751:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8739@kfi7: PUT: OK
00000400:00000200:26.0:1773851852.438752:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000001:25.0:1773851852.438752:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:26.0:1773851852.438753:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000200:25.0:1773851852.438753:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000400:00000200:26.0:1773851852.438754:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000100:00000010:25.0:1773851852.438754:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031afaa57.
00000100:00000040:25.0:1773851852.438754:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000031afaa57 x1859316673481280 msgsize 328
00000400:00000200:26.0:1773851852.438755:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:26.0:1773851852.438756:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 328 into portal 24 MB=0x699e5ed407580
00000100:00100000:25.0:1773851852.438756:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8739@kfi7)
00000400:00000200:26.0:1773851852.438757:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 328/328 into md 0x160dfce379 [256] + 12616
00000100:00000001:25.0:1773851852.438757:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851852.438759:0:184027:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851852.438759:0:184027:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851852.438759:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851852.438759:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000100:00000001:27.0:1773851852.438760:0:184027:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851852.438760:0:184027:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851852.438760:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851852.438761:0:184027:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851852.438761:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851852.438762:0:184027:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673481280
00000400:00000200:26.0:1773851852.438762:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000020:00000001:27.0:1773851852.438763:0:184027:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851852.438763:0:184027:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000100:00000001:26.0:1773851852.438763:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851852.438763:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000020:00000001:27.0:1773851852.438764:0:184027:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000010:26.0:1773851852.438764:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000026004054.
00000020:00000040:27.0:1773851852.438765:0:184027:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=10
00000100:00000040:26.0:1773851852.438765:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000026004054 x1858062667249024 msgsize 328
00000020:00000001:27.0:1773851852.438766:0:184027:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00100000:26.0:1773851852.438766:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000020:00000001:27.0:1773851852.438767:0:184027:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:26.0:1773851852.438767:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851852.438768:0:184027:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:26.0:1773851852.438768:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:27.0:1773851852.438769:0:184027:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:26.0:1773851852.438769:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851852.438769:0:1691804:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851852.438769:0:1691804:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:27.0:1773851852.438770:0:184027:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009edd1273.
00000100:00000001:25.0:1773851852.438770:0:1691804:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851852.438770:0:1691804:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:27.0:1773851852.438771:0:184027:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000022b22b54.
02000000:00000001:25.0:1773851852.438771:0:1691804:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851852.438771:0:1691804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667249024
00000020:00000010:27.0:1773851852.438772:0:184027:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000767c635b.
00000020:00000001:25.0:1773851852.438772:0:1691804:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851852.438772:0:1691804:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:25.0:1773851852.438773:0:1691804:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000040:27.0:1773851852.438774:0:184027:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000020:00000040:25.0:1773851852.438774:0:1691804:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000100:00000001:27.0:1773851852.438775:0:184027:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851852.438775:0:184027:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:25.0:1773851852.438775:0:1691804:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00010000:00000001:27.0:1773851852.438776:0:184027:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00000020:00000001:25.0:1773851852.438776:0:1691804:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:25.0:1773851852.438776:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00010000:00000001:27.0:1773851852.438777:0:184027:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851852.438777:0:1691804:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00010000:00000001:27.0:1773851852.438778:0:184027:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00000020:00000010:25.0:1773851852.438778:0:1691804:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00010000:00000001:27.0:1773851852.438779:0:184027:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851852.438779:0:184027:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000010:25.0:1773851852.438779:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000040:27.0:1773851852.438780:0:184027:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d0bc046c refcount=3
00000020:00000010:25.0:1773851852.438780:0:1691804:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006daec5af.
00000020:00000001:27.0:1773851852.438781:0:184027:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00000100:00000040:25.0:1773851852.438781:0:1691804:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00010000:00000001:27.0:1773851852.438782:0:184027:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00010000:00000001:27.0:1773851852.438782:0:184027:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:25.0:1773851852.438782:0:1691804:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00010000:00000001:27.0:1773851852.438783:0:184027:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851852.438783:0:184027:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851852.438783:0:1691804:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851852.438783:0:1691804:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851852.438784:0:184027:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851852.438784:0:1691804:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851852.438785:0:184027:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851852.438785:0:1691804:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851852.438786:0:184027:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851852.438786:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851852.438786:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851852.438787:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851852.438787:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851852.438788:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851852.438788:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851852.438788:0:1691804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799979
00000100:00100000:27.0:1773851852.438789:0:184027:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 105589640
00000100:00000001:26.0:1773851852.438789:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851852.438789:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:25.0:1773851852.438789:0:1691804:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:25.0:1773851852.438789:0:1691804:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538619008 : -106958170932608 : ffff9eb8dc373a80)
00000100:00000001:24.0:1773851852.438789:0:1537164:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851852.438789:0:1537164:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851852.438790:0:184027:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:26.0:1773851852.438790:0:533719:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851852.438790:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000026004054 x1858062667249024/t0(0) o1000->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:579/0 lens 328/0 e 0 to 0 dl 1773851939 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:27.0:1773851852.438791:0:184027:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150704512 : -106980558847104 : ffff9eb3a5cac380)
00000100:00000001:26.0:1773851852.438791:0:533719:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851852.438792:0:184027:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000031afaa57 x1859316673481280/t0(0) o103->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:579/0 lens 328/0 e 0 to 0 dl 1773851939 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:25.0:1773851852.438793:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851852.438793:0:1691804:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:27.0:1773851852.438795:0:184027:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00100000:25.0:1773851852.438795:0:1691804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026004054 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0005-mdtlov_UUID+5:2142690:x1858062667249024:12345-2098@kfi7:1000:default-yuba6-0
00000100:00000001:27.0:1773851852.438796:0:184027:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851852.438796:0:184027:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031afaa57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_012:060c0146-d4d1-4a42-8c8d-241eaa2f523c+10:39766:x1859316673481280:12345-8931@kfi7:103:
00000100:00000200:25.0:1773851852.438796:0:1691804:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667249024
00000020:00000001:25.0:1773851852.438797:0:1691804:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851852.438797:0:1691804:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00000200:27.0:1773851852.438798:0:184027:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673481280
00010000:00000001:27.0:1773851852.438798:0:184027:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00000020:00000001:25.0:1773851852.438798:0:1691804:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851852.438798:0:1691804:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00010000:00000002:27.0:1773851852.438799:0:184027:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00000020:00000001:25.0:1773851852.438799:0:1691804:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667521856 : -1042029760 : ffffffffc1e3e340)
00010000:00000001:27.0:1773851852.438800:0:184027:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000020:00000001:25.0:1773851852.438800:0:1691804:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:25.0:1773851852.438800:0:1691804:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851852.438801:0:184027:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851852.438801:0:184027:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000001:25.0:1773851852.438801:0:1691804:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
02000000:00000010:27.0:1773851852.438802:0:184027:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005a01a116.
00000020:00000001:25.0:1773851852.438802:0:1691804:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851852.438802:0:1691804:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851852.438803:0:184027:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851852.438803:0:1691804:0:(out_handler.c:970:out_handle()) Process entered
00000100:00000001:27.0:1773851852.438804:0:184027:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:25.0:1773851852.438804:0:1691804:0:(out_handler.c:993:out_handle()) kmalloced '(update_bufs)': 8 at 000000002d7248d2.
00010000:00000001:27.0:1773851852.438805:0:184027:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:27.0:1773851852.438805:0:184027:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000100:00000001:25.0:1773851852.438805:0:1691804:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851852.438805:0:1691804:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00010000:00000001:27.0:1773851852.438806:0:184027:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851852.438806:0:184027:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851852.438806:0:184027:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d0bc046c refcount=3
00000020:00000001:27.0:1773851852.438807:0:184027:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
00010000:00000001:27.0:1773851852.438807:0:184027:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637139711809728 : -106933997741888 : ffff9ebe7d0cd8c0)
02000000:00000010:25.0:1773851852.438807:0:1691804:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 4576 at 00000000e36c8b8d.
02000000:00000001:25.0:1773851852.438807:0:1691804:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851852.438808:0:184027:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 201
00000100:00000001:25.0:1773851852.438808:0:1691804:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851852.438808:0:1691804:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000004:00000001:27.0:1773851852.438810:0:184027:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:27.0:1773851852.438810:0:184027:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:25.0:1773851852.438810:0:1691804:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000020:00000001:27.0:1773851852.438811:0:184027:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:27.0:1773851852.438812:0:184027:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00000020:00000001:25.0:1773851852.438812:0:1691804:0:(out_handler.c:356:out_index_lookup()) Process entered
00010000:00000001:27.0:1773851852.438813:0:184027:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851852.438813:0:184027:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851852.438813:0:1691804:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00010000:00000001:27.0:1773851852.438815:0:184027:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:27.0:1773851852.438816:0:184027:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:27.0:1773851852.438817:0:184027:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851852.438817:0:184027:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851852.438818:0:184027:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851852.438818:0:184027:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:27.0:1773851852.438819:0:184027:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d0bc046c with handle 0x21b6f08f07a6ac89 from hash
00010000:00000001:27.0:1773851852.438820:0:184027:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:27.0:1773851852.438820:0:184027:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851852.438820:0:184027:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851852.438821:0:184027:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:27.0:1773851852.438822:0:184027:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00080000:00000001:25.0:1773851852.438822:0:1691804:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851852.438823:0:184027:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851852.438823:0:184027:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00080000:00000001:25.0:1773851852.438823:0:1691804:0:(osd_index.c:965:osd_remote_fid()) Process entered
00010000:00000001:27.0:1773851852.438824:0:184027:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:27.0:1773851852.438824:0:184027:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0bc046c/0x21b6f08f07a6ac89 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x44a01000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3cb6 expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00080000:00000001:25.0:1773851852.438824:0:1691804:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:25.0:1773851852.438824:0:1691804:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:25.0:1773851852.438825:0:1691804:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:25.0:1773851852.438826:0:1691804:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:25.0:1773851852.438827:0:1691804:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851852.438828:0:184027:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00080000:00000001:25.0:1773851852.438828:0:1691804:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851852.438828:0:1691804:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:25.0:1773851852.438829:0:1691804:0:(out_handler.c:389:out_index_lookup()) lookup [0x24001b599:0x10e2:0x0] slingshotmon get [0x2800256ea:0x3d:0x0] rc 1
00010000:00000040:27.0:1773851852.438830:0:184027:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000006b8dd11 : new locks_count 3
00000020:00000040:27.0:1773851852.438830:0:184027:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 9
00000020:00000040:25.0:1773851852.438830:0:1691804:0:(out_handler.c:393:out_index_lookup()) lustre5-MDT0001: insert lookup reply 000000008f05c0a4 index 0: rc = 1
00010000:00000010:27.0:1773851852.438831:0:184027:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000078bd25d4.
00000020:00000001:25.0:1773851852.438831:0:1691804:0:(out_handler.c:398:out_index_lookup()) Process leaving (rc=1 : 1 : 1)
00010000:00000040:27.0:1773851852.438832:0:184027:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00000020:00000002:25.0:1773851852.438832:0:1691804:0:(lu_object.c:224:lu_object_put()) Add 000000003fbfefe6/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00010000:00000001:27.0:1773851852.438833:0:184027:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851852.438833:0:184027:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:27.0:1773851852.438834:0:184027:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00000020:00000010:25.0:1773851852.438834:0:1691804:0:(out_handler.c:1241:out_handle()) kfreed 'update_bufs': 8 at 000000002d7248d2.
00010000:00010000:27.0:1773851852.438835:0:184027:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00000020:00000001:25.0:1773851852.438835:0:1691804:0:(out_handler.c:1247:out_handle()) Process leaving (rc=1 : 1 : 1)
00010000:00000040:25.0:1773851852.438835:0:1691804:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667249024
00010000:00000001:27.0:1773851852.438836:0:184027:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:25.0:1773851852.438836:0:1691804:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000001:27.0:1773851852.438837:0:184027:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000200:25.0:1773851852.438837:0:1691804:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000026004054 x1858062667249024/t0(0) o1000->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:579/0 lens 328/4320 e 0 to 0 dl 1773851939 ref 1 fl Interpret:/0/0 rc 1/0 job:'default-yuba6-0'
00010000:00000001:27.0:1773851852.438838:0:184027:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:27.0:1773851852.438838:0:184027:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00010000:27.0:1773851852.438838:0:184027:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:27.0:1773851852.438839:0:184027:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:25.0:1773851852.438839:0:1691804:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851852.438840:0:184027:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851852.438840:0:184027:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:25.0:1773851852.438840:0:1691804:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851852.438841:0:184027:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=106 v=66 (1 1 0 1)
00000100:00001000:25.0:1773851852.438841:0:1691804:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=129 v=66 (1 1 1 1)
00000100:00000001:27.0:1773851852.438842:0:184027:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000001:25.0:1773851852.438842:0:1691804:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851852.438843:0:184027:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:27.0:1773851852.438843:0:184027:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
00000100:00000040:25.0:1773851852.438843:0:1691804:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:25.0:1773851852.438843:0:1691804:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:27.0:1773851852.438844:0:184027:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851852.438844:0:1691804:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851852.438845:0:184027:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851852.438845:0:184027:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:25.0:1773851852.438845:0:1691804:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851852.438845:0:1691804:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851852.438846:0:184027:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8739@kfi7
00000100:00000040:25.0:1773851852.438846:0:1691804:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:27.0:1773851852.438847:0:184027:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aa68e447.
00000400:00000010:25.0:1773851852.438847:0:1691804:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000d9fa5928 (tot 253200923).
00000100:00000200:27.0:1773851852.438848:0:184027:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859316673481280, offset 224
00000100:00000200:25.0:1773851852.438848:0:1691804:0:(niobuf.c:86:ptl_send_buf()) Sending 4320 bytes to portal 4, xid 1858062667249024, offset 224
00000400:00000200:27.0:1773851852.438849:0:184027:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8739@kfi7
00000400:00000200:27.0:1773851852.438850:0:184027:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.438850:0:1691804:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:27.0:1773851852.438851:0:184027:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 1
00000400:00000200:27.0:1773851852.438852:0:184027:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:27.0:1773851852.438853:0:184027:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000400:00000200:27.0:1773851852.438854:0:184027:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8739@kfi7 local destination
00000400:00000200:27.0:1773851852.438856:0:184027:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768516:8768516:1024:4294967295] 8739@kfi7 LPNI seq info [2192102:2192102:16:4294967295]
00000400:00000200:27.0:1773851852.438857:0:184027:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:27.0:1773851852.438858:0:184027:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:27.0:1773851852.438860:0:184027:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8739@kfi7(8739@kfi7:8739@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851852.438862:0:184027:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000800:00000200:27.0:1773851852.438863:0:184027:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:25.0:1773851852.438863:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.438863:0:1691804:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000800:00000200:27.0:1773851852.438864:0:184027:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:25.0:1773851852.438864:0:1691804:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851852.438865:0:1691804:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:25.0:1773851852.438866:0:1691804:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2105@kfi7 local destination
00000800:00000200:27.0:1773851852.438867:0:184027:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:25.0:1773851852.438867:0:1691804:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768517:8768517:1023:4294967295] 2105@kfi7 LPNI seq info [20346196:20346196:16:4294967295]
00000800:00000200:27.0:1773851852.438869:0:184027:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c Using peer 8739@kfi7(0x100000000000e5c)
00000400:00000200:25.0:1773851852.438869:0:1691804:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851852.438870:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851852.438871:0:1691804:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000800:00000200:27.0:1773851852.438873:0:184027:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x100000000000e5c: rc=0
00000400:00000200:25.0:1773851852.438873:0:1691804:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:25.0:1773851852.438874:0:1691804:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 1 allocated
00000800:00000200:27.0:1773851852.438875:0:184027:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:25.0:1773851852.438876:0:1691804:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000100:00000001:27.0:1773851852.438877:0:184027:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851852.438877:0:184027:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:27.0:1773851852.438878:0:184027:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851852.438878:0:1691804:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 TN_EVENT_INIT_BULK event status 0
00010000:00000001:27.0:1773851852.438879:0:184027:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851852.438879:0:184027:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031afaa57 x1859316673481280/t0(0) o103->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:579/0 lens 328/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000800:00000200:25.0:1773851852.438882:0:1691804:0:(kfilnd_ep.c:374:kfilnd_ep_post_tagged_recv()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted tagged recv of 4320 bytes (2 frags) with tag 0x85d0001: rc=0
00000100:00100000:27.0:1773851852.438883:0:184027:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031afaa57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_012:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:39766:x1859316673481280:12345-8931@kfi7:103: Request processed in 87us (127us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851852.438884:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_TAGGED_RECV_POSTED state change
00000100:00100000:27.0:1773851852.438885:0:184027:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 105589640
00000100:00000040:27.0:1773851852.438886:0:184027:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000800:00000200:25.0:1773851852.438886:0:1691804:0:(kfilnd_tn.c:603:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000100:00000001:27.0:1773851852.438887:0:184027:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851852.438887:0:184027:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851852.438888:0:184027:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000022b22b54.
00000800:00000200:26.0:1773851852.438888:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851852.438889:0:184027:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000767c635b.
00000020:00000010:27.0:1773851852.438889:0:184027:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009edd1273.
00000800:00000200:25.0:1773851852.438889:0:1691804:0:(kfilnd_tn.c:610:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000020:00000040:27.0:1773851852.438890:0:184027:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 8
00000400:00000200:26.0:1773851852.438890:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851852.438891:0:184027:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851852.438891:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8739@kfi7: PUT: OK
00000400:00000200:26.0:1773851852.438891:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aa68e447
00000400:00000010:26.0:1773851852.438892:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aa68e447.
00000100:00000001:26.0:1773851852.438893:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851852.438893:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000800:00000200:25.0:1773851852.438893:0:1691804:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 110 bytes to peer 0x20000000000085c: rc=0
00000400:00000200:26.0:1773851852.438894:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000800:00000200:25.0:1773851852.438894:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x20000000000085c TN_STATE_TAGGED_RECV_POSTED -> TN_STATE_WAIT_COMP state change
00000800:00000200:26.0:1773851852.438896:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 8739@kfi7(000000003f56059e):0x0 lsk 3677 rsk 75 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e5c Transaction freed
00000100:00000001:25.0:1773851852.438896:0:1691804:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851852.438897:0:1691804:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:25.0:1773851852.438898:0:1691804:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851852.438899:0:1691804:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851852.438899:0:1691804:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851852.438900:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000026004054 x1858062667249024/t0(0) o1000->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:579/0 lens 328/4320 e 0 to 0 dl 1773851939 ref 1 fl Interpret:/0/0 rc 1/1 job:'default-yuba6-0'
00000800:00000200:26.0:1773851852.438903:0:2507427:0:(kfilnd_tn.c:1127:kfilnd_tn_state_wait_comp()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x20000000000085c TN_EVENT_TX_OK event status 0
00000100:00100000:25.0:1773851852.438903:0:1691804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026004054 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0005-mdtlov_UUID+5:2142690:x1858062667249024:12345-2098@kfi7:1000:default-yuba6-0 Request processed in 109us (138us total) trans 0 rc 1/1
00000800:00000200:26.0:1773851852.438905:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x20000000000085c TN_STATE_WAIT_COMP -> TN_STATE_WAIT_TAG_COMP state change
00000100:00100000:25.0:1773851852.438906:0:1691804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799979
00000100:00000040:25.0:1773851852.438906:0:1691804:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:25.0:1773851852.438907:0:1691804:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851852.438907:0:1691804:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851852.438908:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851852.438909:0:1691804:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006daec5af.
00000020:00000010:25.0:1773851852.438909:0:1691804:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:25.0:1773851852.438910:0:1691804:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:25.0:1773851852.438910:0:1691804:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851852.438930:0:2494371:0:(kfilnd_tn.c:1307:kfilnd_tn_state_wait_tag_comp()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x20000000000085c TN_EVENT_TAG_RX_OK event status 0
00000400:00000200:25.0:1773851852.438932:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851852.438933:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000400:00000200:25.0:1773851852.438934:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d9fa5928
00000400:00000010:25.0:1773851852.438934:0:2494371:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000d9fa5928 (tot 253200771).
00000100:00000001:25.0:1773851852.438935:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851852.438935:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851852.438936:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851852.438938:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_BULK_PUT_REQ TN 000000007d5570ed: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 1 trr 6 tta 0x20000000000085c Transaction freed
00000800:00000200:1.0:1773851852.439046:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.439047:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851852.439048:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851852.439051:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851852.439053:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.439054:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8931@kfi7 : PUT - for me
00000400:00000200:1.0:1773851852.439055:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.439056:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 1
00000400:00000200:1.0:1773851852.439057:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.439057:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.439058:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000400:00000200:1.0:1773851852.439059:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.439060:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 584 into portal 12 MB=0x69b09e5d90a80
00000400:00000200:1.0:1773851852.439061:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8931@kfi7 of length 584/584 into md 0x7fb56e801 [64] + 8136
00000800:00000200:1.0:1773851852.439064:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851852.439065:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851852.439066:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8931@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.439068:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851852.439068:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851852.439069:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000000c3002b.
00000100:00000040:1.0:1773851852.439070:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000000c3002b x1859316673481344 msgsize 584
00000100:00100000:1.0:1773851852.439072:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8931@kfi7)
00000100:00000001:1.0:1773851852.439073:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851852.439074:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000800:00000200:1.0:1773851852.439076:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851852.439078:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851852.439079:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.439079:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.439080:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.439081:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.439082:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673481344
00000020:00000001:1.0:1773851852.439082:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.439083:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000020:00000001:1.0:1773851852.439084:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.439084:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=9
00000020:00000001:1.0:1773851852.439085:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000020:00000001:1.0:1773851852.439086:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:1.0:1773851852.439087:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.439087:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.439088:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092010b2a.
00000020:00000010:1.0:1773851852.439089:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000797e8388.
00000020:00000010:1.0:1773851852.439090:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.439091:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.439091:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:1.0:1773851852.439092:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:1.0:1773851852.439092:0:60951:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.439093:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.439094:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.439095:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851852.439096:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.439096:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851852.439096:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851852.439096:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851852.439097:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 408701473
00000100:00000001:2.0:1773851852.439098:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.439098:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:2.0:1773851852.439099:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.439099:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085911357056 : -106987798194560 : ffff9eb1f64b1680)
00000100:00000040:1.0:1773851852.439100:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000000c3002b x1859316673481344/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:492/0 lens 584/0 e 0 to 0 dl 1773852607 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1035-0'
00000100:00000001:1.0:1773851852.439103:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.439103:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.439104:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000c3002b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:1429396:x1859316673481344:12345-8931@kfi7:101:default-tuolumne1035-0
00000100:00000200:1.0:1773851852.439106:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673481344
00000020:00000001:1.0:1773851852.439106:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.439107:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.439107:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.439108:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.439109:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:1.0:1773851852.439110:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.439110:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316673481344, found 0 last_xid 1859316673481343
00000020:00000001:1.0:1773851852.439111:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.439112:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.439112:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.439113:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.439114:0:60951:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:1.0:1773851852.439114:0:60951:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:1.0:1773851852.439115:0:60951:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:1.0:1773851852.439115:0:60951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:1.0:1773851852.439116:0:60951:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.439117:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:1.0:1773851852.439118:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 200
00010000:00000001:1.0:1773851852.439118:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.439119:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.439120:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000006c541e9e.
00000020:00000001:1.0:1773851852.439121:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.439122:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 000000006c541e9e with handle 0x21b6f08f07a6ac90 to hash
00000020:00000001:1.0:1773851852.439122:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.439123:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637063873506560 : -107009836045056 : ffff9eacd4bc2d00)
00010000:00000010:1.0:1773851852.439124:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000b22c364f.
00010000:00000001:1.0:1773851852.439124:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637063873506560 : -107009836045056 : ffff9eacd4bc2d00)
00010000:00010000:1.0:1773851852.439125:0:60951:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000006c541e9e/0x21b6f08f07a6ac90 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 201 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde0abe468d1e3cbd expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439128:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:1.0:1773851852.439128:0:60951:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000006b8dd11 : new locks_count 4
00000020:00000040:1.0:1773851852.439129:0:60951:0:(genops.c:871:class_export_get()) GET export 0000000006b8dd11 refcount=10
00010000:00000001:1.0:1773851852.439130:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:1.0:1773851852.439131:0:60951:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:1.0:1773851852.439131:0:60951:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:1.0:1773851852.439132:0:60951:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:1.0:1773851852.439132:0:60951:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:1.0:1773851852.439133:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:1.0:1773851852.439133:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:1.0:1773851852.439134:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:1.0:1773851852.439135:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:1.0:1773851852.439135:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:1.0:1773851852.439136:0:60951:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439136:0:60951:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:1.0:1773851852.439137:0:60951:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:1.0:1773851852.439137:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.439138:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.439140:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 0000000022f96960.
02000000:00000001:1.0:1773851852.439141:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.439142:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439142:0:60951:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439143:0:60951:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:1.0:1773851852.439143:0:60951:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:1.0:1773851852.439144:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.439144:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.439145:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.439145:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.439146:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.439146:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.439146:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.439147:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.439147:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.439148:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.439148:0:60951:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:1.0:1773851852.439149:0:60951:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:1.0:1773851852.439150:0:60951:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:1.0:1773851852.439150:0:60951:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.439150:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.439151:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439151:0:60951:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:1.0:1773851852.439152:0:60951:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439152:0:60951:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:1.0:1773851852.439153:0:60951:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 000000001379d938
00000004:00000001:1.0:1773851852.439154:0:60951:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:1.0:1773851852.439155:0:60951:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:1.0:1773851852.439155:0:60951:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:1.0:1773851852.439156:0:60951:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:1.0:1773851852.439156:0:60951:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:1.0:1773851852.439157:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:1.0:1773851852.439157:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.439157:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.439158:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.439159:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000bf74ee88.
00000020:00000001:1.0:1773851852.439160:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.439160:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000bf74ee88 with handle 0x21b6f08f07a6ac97 to hash
00000020:00000001:1.0:1773851852.439161:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.439161:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637074825686272 : -106998883865344 : ffff9eaf61892d00)
00010000:00000010:1.0:1773851852.439162:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000029304d64.
00010000:00000001:1.0:1773851852.439163:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637074825686272 : -106998883865344 : ffff9eaf61892d00)
00010000:00000001:1.0:1773851852.439164:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.439164:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.439165:0:60951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 202 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439168:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.439168:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:1.0:1773851852.439169:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:1.0:1773851852.439169:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:1.0:1773851852.439170:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.439170:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439171:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.439171:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439172:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:1.0:1773851852.439172:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:1.0:1773851852.439173:0:60951:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:1.0:1773851852.439173:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:1.0:1773851852.439173:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 201
00010000:00000040:1.0:1773851852.439174:0:60951:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:1.0:1773851852.439175:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439177:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439178:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439180:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439181:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439183:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439184:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439186:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439187:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439189:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439190:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439193:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439194:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439196:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439196:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439198:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439199:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439201:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439202:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439204:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439205:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439207:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439208:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439210:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439211:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439213:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439214:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439216:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439217:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439219:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439220:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439222:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439223:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439225:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439226:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439228:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439229:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439231:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439231:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439234:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439234:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439237:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439237:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439241:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439242:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439244:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439244:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439246:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439247:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439249:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439250:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439252:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439253:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439255:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439256:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdf7f3a8/0x21b6f08f07a5a537 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6a8 expref: 8 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439258:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439259:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439261:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439261:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439264:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439265:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 10 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439267:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439268:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439270:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439271:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439273:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439274:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439276:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439276:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439279:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439279:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439281:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439282:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439284:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439285:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439288:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439289:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439291:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439292:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439294:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439295:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439297:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439298:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439300:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439301:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439303:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439304:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439306:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439307:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439309:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439310:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439312:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439313:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439315:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439316:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439318:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439319:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a4d807 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25b3 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439321:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439321:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062815ce5/0x21b6f08f07a4d7cf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b924a expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439324:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439324:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d2098ccc/0x21b6f08f07a4d797 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0f4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439327:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439327:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f2deef/0x21b6f08f07a4d75f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84ed expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439329:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439330:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a4d720 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18304@kfi7 remote: 0xa8da567d9ebd26ed expref: 8 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439332:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439333:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439336:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439337:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439339:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439340:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439342:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439343:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439345:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439346:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439348:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439348:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439350:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439351:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439354:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439354:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439357:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439357:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439360:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439362:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439363:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439364:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439367:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439367:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439369:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439370:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439372:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439373:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439375:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439376:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439378:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439378:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439381:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439382:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439385:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439386:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439388:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439389:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439391:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439392:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439394:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439394:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439396:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439397:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439399:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439400:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439402:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439403:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439405:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439406:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439408:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439409:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439411:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439412:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439414:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439415:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439417:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439418:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439420:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439421:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439423:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439423:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439426:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439426:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439428:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439429:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439432:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439432:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439434:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439435:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439437:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439438:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439440:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439441:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439443:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439443:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439445:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439446:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439448:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439449:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439451:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439452:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439455:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439456:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439457:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439458:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439460:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439461:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439463:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439464:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439466:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439466:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439468:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439469:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439471:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439472:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439474:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439475:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439478:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439479:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439481:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439481:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439484:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439485:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439487:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439487:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439489:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439490:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439492:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439493:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439495:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439496:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439498:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439499:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439501:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439502:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439504:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439505:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439507:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439508:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439510:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439511:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439513:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439514:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439516:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439516:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439519:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439519:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439522:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439522:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439525:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439526:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439528:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439529:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439531:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439532:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439534:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439534:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439536:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439537:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439539:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439540:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439542:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439543:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439545:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439546:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439549:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439550:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439552:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439553:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439555:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439556:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439558:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439559:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439561:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439562:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439564:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439565:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439567:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439568:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439570:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439571:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439573:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439574:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439576:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439576:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439579:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439579:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439581:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439582:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439584:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439585:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439587:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439588:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439590:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439591:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439593:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439594:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439596:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439597:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439599:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439600:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439602:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439603:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439605:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439606:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439608:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439609:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439611:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439611:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439614:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439614:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439616:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439617:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439621:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439622:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439624:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439625:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439627:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439628:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439630:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439630:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439632:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439633:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439635:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439636:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439638:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439639:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439641:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439642:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439645:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439646:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439647:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439648:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439650:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439651:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439653:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439654:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439656:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439657:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439658:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439659:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439661:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439662:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439664:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439665:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439668:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439669:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439671:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439672:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439674:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439675:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439677:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439677:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439680:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439680:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439682:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439683:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439685:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439686:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439688:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439689:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439693:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439694:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439696:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439697:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439699:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439700:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439702:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439702:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439705:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439706:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439708:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439708:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439711:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439711:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439714:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439714:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439718:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439719:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439721:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439722:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439724:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439727:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439729:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439730:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439732:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439733:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439735:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439735:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439737:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439738:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439740:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439741:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439744:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439745:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439747:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439747:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439750:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439751:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439752:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439753:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439755:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439756:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439758:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439759:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439761:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439762:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439764:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439765:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439767:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:1.0:1773851852.439768:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439770:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00010000:1.0:1773851852.439771:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439773:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.439773:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:1.0:1773851852.439774:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:1.0:1773851852.439774:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.439775:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:1.0:1773851852.439775:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439776:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.439777:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.439777:0:60951:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:1.0:1773851852.439778:0:60951:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.439778:0:60951:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439780:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.439781:0:60951:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:1.0:1773851852.439781:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.439782:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.439782:0:60951:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:1.0:1773851852.439783:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:1.0:1773851852.439784:0:60951:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000743f6774.
00010000:00000010:1.0:1773851852.439785:0:60951:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000e394f866.
00010000:00000001:1.0:1773851852.439786:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.439787:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000789a22e3.
00000020:00000001:1.0:1773851852.439787:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.439798:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000789a22e3 with handle 0x21b6f08f07a6ac9e to hash
00000020:00000001:1.0:1773851852.439799:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.439799:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000010:1.0:1773851852.439800:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000078bd25d4.
00010000:00000001:1.0:1773851852.439801:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000001:1.0:1773851852.439802:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.439802:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.439803:0:60951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439805:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.439806:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:1.0:1773851852.439806:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:1.0:1773851852.439807:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:1.0:1773851852.439807:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.439807:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439808:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.439808:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439809:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:1.0:1773851852.439809:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:1.0:1773851852.439810:0:60951:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:1.0:1773851852.439810:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:1.0:1773851852.439810:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (00000000743f6774) refcount = 1
00010000:00010000:1.0:1773851852.439811:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439813:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.439814:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:1.0:1773851852.439814:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:1.0:1773851852.439815:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.439815:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:1.0:1773851852.439815:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439816:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.439816:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.439818:0:60951:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:1.0:1773851852.439818:0:60951:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.439819:0:60951:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439821:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.439821:0:60951:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:1.0:1773851852.439822:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.439822:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.439823:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.439823:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.439823:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000789a22e3 refcount=3
00000020:00000001:1.0:1773851852.439824:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000001:1.0:1773851852.439825:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000001:1.0:1773851852.439826:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.439826:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.439826:0:60951:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439827:0:60951:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439828:0:60951:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:1.0:1773851852.439831:0:60951:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:1.0:1773851852.439832:0:60951:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:1.0:1773851852.439832:0:60951:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:1.0:1773851852.439833:0:60951:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:1.0:1773851852.439837:0:60951:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:1.0:1773851852.439838:0:60951:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:1.0:1773851852.439838:0:60951:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:1.0:1773851852.439838:0:60951:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:1.0:1773851852.439839:0:60951:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:1.0:1773851852.439840:0:60951:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:1.0:1773851852.439840:0:60951:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:1.0:1773851852.439841:0:60951:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:1.0:1773851852.439842:0:60951:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:1.0:1773851852.439842:0:60951:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439843:0:60951:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.439843:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:1.0:1773851852.439844:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:1.0:1773851852.439844:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:1.0:1773851852.439846:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:1.0:1773851852.439846:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:1.0:1773851852.439847:0:60951:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:1.0:1773851852.439848:0:60951:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:1.0:1773851852.439848:0:60951:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:1.0:1773851852.439848:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:1.0:1773851852.439849:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 234
00010000:00000001:1.0:1773851852.439850:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.439850:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.439851:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000af8f1b7b.
00000020:00000001:1.0:1773851852.439852:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.439853:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000af8f1b7b with handle 0x21b6f08f07a6aca5 to hash
00000020:00000001:1.0:1773851852.439853:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.439854:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000010:1.0:1773851852.439854:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000f2bd3033.
00010000:00000001:1.0:1773851852.439855:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:1.0:1773851852.439856:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.439856:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.439857:0:60951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000af8f1b7b/0x21b6f08f07a6aca5 lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 235 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439859:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000001:1.0:1773851852.439859:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:1.0:1773851852.439860:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:1.0:1773851852.439860:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:1.0:1773851852.439861:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.439861:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439862:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.439862:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.439863:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:1.0:1773851852.439863:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:1.0:1773851852.439864:0:60951:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:1.0:1773851852.439864:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:1.0:1773851852.439865:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 234
00010000:00000040:1.0:1773851852.439867:0:60951:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:1.0:1773851852.439867:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439870:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439871:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439873:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439874:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439876:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439877:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439879:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439881:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439883:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439884:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439886:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439887:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439889:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439890:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439892:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439894:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439896:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439898:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439900:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439901:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439903:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439904:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439907:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439908:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439910:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439911:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439913:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439914:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439916:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439917:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439920:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439921:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439923:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439925:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439927:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439928:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439930:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439932:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439934:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439935:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439937:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439938:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439940:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439941:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439943:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439944:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 8 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439946:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439947:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439952:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439954:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439956:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439957:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439959:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439961:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439963:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439964:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439966:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439967:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439969:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439970:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439972:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439973:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439975:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439976:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439982:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439983:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439985:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439986:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439989:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439990:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439992:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439993:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439995:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.439996:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.439999:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440000:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440002:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440003:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440005:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440006:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440009:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440010:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440012:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440013:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440016:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440017:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440019:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440020:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440022:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440024:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f504d49/0x21b6f08f07a4d823 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25ba expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440026:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440027:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d71abe2/0x21b6f08f07a4d7eb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b9251 expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440029:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440030:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000057d4c5f/0x21b6f08f07a4d7b3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0fb expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440032:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440032:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc5e9c7/0x21b6f08f07a4d77b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84f4 expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440037:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440038:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f315dcef/0x21b6f08f07a4d73c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 18304@kfi7 remote: 0xa8da567d9ebd26f4 expref: 8 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440040:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440041:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440044:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440045:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440047:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440048:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440050:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440051:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440053:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440054:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440056:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440057:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440059:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440060:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440063:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440064:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440066:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440067:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440069:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440070:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440072:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440073:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440075:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440076:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440078:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440080:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440081:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440082:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440084:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440086:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440088:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440089:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440091:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440093:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440095:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440096:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440098:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440099:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440101:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440102:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440104:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440105:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440107:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440108:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440110:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440111:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440113:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440114:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440116:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440117:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440120:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440121:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440123:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440124:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440126:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440127:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440129:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440130:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440132:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440133:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440135:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440137:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440140:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440141:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440143:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440143:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440146:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440147:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440149:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440150:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440152:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440153:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440155:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440156:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440158:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440159:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440161:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440162:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440165:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440166:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440168:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440169:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440171:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440172:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440174:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440175:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440177:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440178:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440180:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440181:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440183:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440184:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440186:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440187:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440190:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440191:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440192:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440194:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440196:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440197:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440199:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440200:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440202:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440203:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440205:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440206:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440208:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440209:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440211:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440212:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440215:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440216:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440218:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440219:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440221:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440222:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440224:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440225:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440227:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440228:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440230:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440231:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440233:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440234:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440236:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440237:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440240:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440241:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440243:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440244:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440247:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440248:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440250:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440251:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440253:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440254:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440256:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440257:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440259:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440260:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 10 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440262:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440263:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440266:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440267:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440270:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440270:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440272:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440274:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440276:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440277:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440279:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440281:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440282:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440284:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440286:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440287:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440289:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440290:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440293:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440294:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440296:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440297:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440300:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440301:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440303:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440304:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440306:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440308:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440310:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440311:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440313:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440314:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440316:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440317:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440320:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440321:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440323:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440324:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440326:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440328:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440330:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440330:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440332:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440334:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440336:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440337:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440339:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440341:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440343:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440344:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440347:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440348:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440350:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440351:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440354:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440355:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440357:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440358:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440360:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440362:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440364:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440365:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440367:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440368:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440371:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440371:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440375:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440376:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440378:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440379:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440381:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440382:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440385:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440386:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440388:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440389:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440391:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440393:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440395:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440396:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440397:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440399:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440402:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440403:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440405:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440406:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440409:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440410:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440412:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440413:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440415:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440416:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440419:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440420:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440422:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440423:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440425:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440426:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440428:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440430:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440432:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440433:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440435:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440436:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440438:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440439:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440441:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440442:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440444:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440446:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440448:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440449:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440451:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440452:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440455:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440456:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440458:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440459:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440462:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440463:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440465:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440466:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440468:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440469:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440471:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440472:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440474:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440475:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440477:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440478:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440481:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440482:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440484:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440485:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440487:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440488:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440490:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440492:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440494:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440495:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440497:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440499:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440501:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440502:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440504:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440505:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440508:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440509:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440511:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440512:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440514:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440516:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440518:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440519:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440521:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440522:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440524:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440525:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440527:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440528:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440530:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440531:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440535:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440536:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440538:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440539:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440541:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440543:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440544:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440546:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440548:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440549:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440551:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440552:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440554:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440555:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440558:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440559:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440562:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440563:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440565:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440566:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440568:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440569:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440571:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440572:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440574:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440575:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440577:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440578:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440580:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440582:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440584:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440585:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440588:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440589:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440591:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440593:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440595:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440597:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440599:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440600:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440602:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440604:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440606:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440607:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440609:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440610:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440612:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440613:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440616:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440617:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440619:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440621:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440623:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440624:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440626:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440627:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440629:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440630:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440632:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440633:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440635:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440636:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440638:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:1.0:1773851852.440639:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440642:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00010000:1.0:1773851852.440642:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000af8f1b7b/0x21b6f08f07a6aca5 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440644:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000001:1.0:1773851852.440645:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:1.0:1773851852.440645:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:1.0:1773851852.440646:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440646:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:1.0:1773851852.440647:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.440647:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440648:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.440648:0:60951:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:1.0:1773851852.440649:0:60951:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.440649:0:60951:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000af8f1b7b/0x21b6f08f07a6aca5 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440651:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000001:1.0:1773851852.440652:0:60951:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:1.0:1773851852.440652:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440653:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440653:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.440653:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.440654:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000af8f1b7b refcount=3
00000020:00000001:1.0:1773851852.440654:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:1.0:1773851852.440655:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:1.0:1773851852.440656:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440656:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.440656:0:60951:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.440658:0:60951:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:1.0:1773851852.440658:0:60951:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:1.0:1773851852.440659:0:60951:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.440659:0:60951:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.440661:0:60951:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:1.0:1773851852.440661:0:60951:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:1.0:1773851852.440662:0:60951:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:1.0:1773851852.440663:0:60951:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.440664:0:60951:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440665:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.440665:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.440665:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000af8f1b7b refcount=3
00000020:00000001:1.0:1773851852.440666:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:1.0:1773851852.440666:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00000004:00010000:1.0:1773851852.440667:0:60951:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000af8f1b7b/0x21b6f08f07a6aca5 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440669:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000001:1.0:1773851852.440670:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440670:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.440671:0:60951:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:1.0:1773851852.440671:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:1.0:1773851852.440672:0:60951:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:1.0:1773851852.440672:0:60951:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:1.0:1773851852.440673:0:60951:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:1.0:1773851852.440674:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:1.0:1773851852.440674:0:60951:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:1.0:1773851852.440675:0:60951:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:1.0:1773851852.440675:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.440675:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.440676:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000bf74ee88 refcount=3
00000020:00000001:1.0:1773851852.440676:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074825686272 : -106998883865344 : ffff9eaf61892d00)
00010000:00000001:1.0:1773851852.440677:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074825686272 : -106998883865344 : ffff9eaf61892d00)
00010000:00000001:1.0:1773851852.440677:0:60951:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:1.0:1773851852.440678:0:60951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440680:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.440681:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440681:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:1.0:1773851852.440682:0:60951:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440684:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.440684:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.440685:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440685:0:60951:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:1.0:1773851852.440686:0:60951:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440688:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00010000:1.0:1773851852.440689:0:60951:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000bf74ee88 already unused, calling callback (000000001690cbe4)
00000004:00000001:1.0:1773851852.440690:0:60951:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:1.0:1773851852.440690:0:60951:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:1.0:1773851852.440691:0:60951:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440693:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.440693:0:60951:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:1.0:1773851852.440694:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.440694:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.440695:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000bf74ee88 refcount=4
00000020:00000001:1.0:1773851852.440695:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074825686272 : -106998883865344 : ffff9eaf61892d00)
00010000:00000001:1.0:1773851852.440696:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074825686272 : -106998883865344 : ffff9eaf61892d00)
00010000:00000001:1.0:1773851852.440697:0:60951:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:1.0:1773851852.440697:0:60951:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440699:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.440700:0:60951:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:1.0:1773851852.440700:0:60951:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:1.0:1773851852.440701:0:60951:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440702:0:60951:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:1.0:1773851852.440702:0:60951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:1.0:1773851852.440703:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.440703:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:1.0:1773851852.440704:0:60951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000bf74ee88 with handle 0x21b6f08f07a6ac97 from hash
00010000:00000001:1.0:1773851852.440705:0:60951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:1.0:1773851852.440705:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440705:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440706:0:60951:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:1.0:1773851852.440706:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:1.0:1773851852.440707:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440707:0:60951:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:1.0:1773851852.440708:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:1.0:1773851852.440708:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:1.0:1773851852.440709:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:1.0:1773851852.440710:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:1.0:1773851852.440711:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.440711:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440712:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:1.0:1773851852.440713:0:60951:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:1.0:1773851852.440713:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440714:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440714:0:60951:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440715:0:60951:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.440715:0:60951:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.440716:0:60951:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440718:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000001:1.0:1773851852.440718:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440719:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440719:0:60951:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:1.0:1773851852.440720:0:60951:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:1.0:1773851852.440720:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:1.0:1773851852.440720:0:60951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf74ee88/0x21b6f08f07a6ac97 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 202 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440723:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000010:1.0:1773851852.440724:0:60951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000029304d64.
00010000:00000040:1.0:1773851852.440724:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000001:1.0:1773851852.440728:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.440728:0:60951:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:1.0:1773851852.440728:0:60951:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:1.0:1773851852.440729:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.440729:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.440729:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000789a22e3 refcount=3
00000020:00000001:1.0:1773851852.440730:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000001:1.0:1773851852.440730:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000001:1.0:1773851852.440731:0:60951:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:1.0:1773851852.440732:0:60951:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440734:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.440734:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440735:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:1.0:1773851852.440735:0:60951:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440737:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.440738:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.440738:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440739:0:60951:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:1.0:1773851852.440739:0:60951:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440741:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00010000:1.0:1773851852.440741:0:60951:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000789a22e3 already unused, calling callback (000000001690cbe4)
00000004:00000001:1.0:1773851852.440742:0:60951:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:1.0:1773851852.440743:0:60951:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:1.0:1773851852.440743:0:60951:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440746:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.440746:0:60951:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:1.0:1773851852.440746:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.440747:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.440747:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000789a22e3 refcount=4
00000020:00000001:1.0:1773851852.440748:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000001:1.0:1773851852.440748:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637114646517952 : -106959063033664 : ffff9eb8a70ad8c0)
00010000:00000001:1.0:1773851852.440749:0:60951:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:1.0:1773851852.440749:0:60951:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440751:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.440752:0:60951:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:1.0:1773851852.440752:0:60951:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:1.0:1773851852.440753:0:60951:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440753:0:60951:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:1.0:1773851852.440754:0:60951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:1.0:1773851852.440754:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.440754:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:1.0:1773851852.440755:0:60951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000789a22e3 with handle 0x21b6f08f07a6ac9e from hash
00010000:00000001:1.0:1773851852.440755:0:60951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:1.0:1773851852.440756:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440756:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440756:0:60951:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:1.0:1773851852.440757:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:1.0:1773851852.440757:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440758:0:60951:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:1.0:1773851852.440758:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:1.0:1773851852.440759:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:1.0:1773851852.440759:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (00000000743f6774)
00010000:00010000:1.0:1773851852.440760:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:1.0:1773851852.440761:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.440762:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440762:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:1.0:1773851852.440763:0:60951:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:1.0:1773851852.440764:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440764:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440764:0:60951:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440765:0:60951:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.440765:0:60951:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.440766:0:60951:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440768:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000001:1.0:1773851852.440768:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440769:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440769:0:60951:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:1.0:1773851852.440770:0:60951:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:1.0:1773851852.440770:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:1.0:1773851852.440770:0:60951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000789a22e3/0x21b6f08f07a6ac9e lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440772:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 1
00010000:00000010:1.0:1773851852.440773:0:60951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000078bd25d4.
00010000:00000040:1.0:1773851852.440773:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000743f6774 count: 0
00010000:00000010:1.0:1773851852.440774:0:60951:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000e394f866.
00010000:00000001:1.0:1773851852.440775:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.440775:0:60951:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:1.0:1773851852.440775:0:60951:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:1.0:1773851852.440776:0:60951:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:1.0:1773851852.440776:0:60951:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:1.0:1773851852.440777:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.440777:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.440777:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000af8f1b7b refcount=3
00000020:00000001:1.0:1773851852.440778:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:1.0:1773851852.440778:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00000004:00000040:1.0:1773851852.440780:0:60951:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 0000000006b8dd11 : new locks_count 5
00000020:00000040:1.0:1773851852.440780:0:60951:0:(genops.c:871:class_export_get()) GET export 0000000006b8dd11 refcount=11
00010000:00000001:1.0:1773851852.440781:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440782:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.440782:0:60951:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:1.0:1773851852.440783:0:60951:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:1.0:1773851852.440783:0:60951:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:1.0:1773851852.440783:0:60951:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:1.0:1773851852.440784:0:60951:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:1.0:1773851852.440784:0:60951:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:1.0:1773851852.440785:0:60951:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:1.0:1773851852.440785:0:60951:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:1.0:1773851852.440786:0:60951:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.440787:0:60951:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:1.0:1773851852.440787:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:1.0:1773851852.440788:0:60951:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:1.0:1773851852.440788:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:1.0:1773851852.440789:0:60951:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:1.0:1773851852.440789:0:60951:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:1.0:1773851852.440790:0:60951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:1.0:1773851852.440790:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440791:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440791:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.440791:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:1.0:1773851852.440792:0:60951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006c541e9e with handle 0x21b6f08f07a6ac90 from hash
00010000:00000001:1.0:1773851852.440793:0:60951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:1.0:1773851852.440793:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440793:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440794:0:60951:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:1.0:1773851852.440794:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:1.0:1773851852.440795:0:60951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006c541e9e/0x21b6f08f07a6ac90 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 201 type: IBT gid 0 flags: 0x44000000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3cbd expref: 11 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440797:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:1.0:1773851852.440797:0:60951:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000006b8dd11 : new locks_count 4
00000020:00000040:1.0:1773851852.440798:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 10
00010000:00000010:1.0:1773851852.440800:0:60951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000b22c364f.
00010000:00000040:1.0:1773851852.440800:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:1.0:1773851852.440801:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.440801:0:60951:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440802:0:60951:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:1.0:1773851852.440802:0:60951:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000af8f1b7b/0x21b6f08f07a6aca5 lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3cbd expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.440805:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000001:1.0:1773851852.440805:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:1.0:1773851852.440806:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:1.0:1773851852.440806:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:1.0:1773851852.440807:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:1.0:1773851852.440808:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.440808:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.440809:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:1.0:1773851852.440809:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.440809:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:1.0:1773851852.440810:0:60951:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000af8f1b7b, rc 0)
00000020:00000001:1.0:1773851852.440810:0:60951:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.440811:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200468, transno 0, xid 1859316673481344
00010000:00000001:1.0:1773851852.440812:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.440813:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000000c3002b x1859316673481344/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:492/0 lens 584/640 e 0 to 0 dl 1773852607 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1035-0'
00010000:00000001:1.0:1773851852.440816:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.440816:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.440817:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.440818:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.440819:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:1.0:1773851852.440820:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
02000000:00000001:1.0:1773851852.440821:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.440821:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.440822:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.440823:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8931@kfi7
00000400:00000010:1.0:1773851852.440824:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090cc6d90.
00000100:00000200:1.0:1773851852.440825:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859316673481344, offset 224
00000400:00000200:1.0:1773851852.440826:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8931@kfi7
00000400:00000200:1.0:1773851852.440827:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.440828:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 1
00000400:00000200:1.0:1773851852.440829:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.440830:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000400:00000200:1.0:1773851852.440831:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8931@kfi7 local destination
00000400:00000200:1.0:1773851852.440832:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768518:8768518:1024:4294967295] 8931@kfi7 LPNI seq info [2192103:2192103:16:4294967295]
00000400:00000200:1.0:1773851852.440834:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.440834:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.440836:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8931@kfi7(8931@kfi7:8931@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.440837:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000800:00000200:1.0:1773851852.440839:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.440840:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:1.0:1773851852.440842:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.440844:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Using peer 8931@kfi7(0x7e2)
00000800:00000200:1.0:1773851852.440847:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 740 bytes to peer 0x7e2: rc=0
00000800:00000200:1.0:1773851852.440849:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.440851:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.440851:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:1.0:1773851852.440852:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.440853:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.440853:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.440854:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000000c3002b x1859316673481344/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:492/0 lens 584/640 e 0 to 0 dl 1773852607 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1035-0'
00000100:00100000:1.0:1773851852.440857:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000c3002b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:060c0146-d4d1-4a42-8c8d-241eaa2f523c+10:1429396:x1859316673481344:12345-8931@kfi7:101:default-tuolumne1035-0 Request processed in 1753us (1786us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851852.440860:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 408701473
00000100:00000040:1.0:1773851852.440861:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000800:00000200:3.0:1773851852.440862:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851852.440862:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851852.440862:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:3.0:1773851852.440863:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851852.440863:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000797e8388.
00000400:00000200:3.0:1773851852.440864:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8931@kfi7: PUT: OK
00000020:00000010:1.0:1773851852.440864:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:3.0:1773851852.440865:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090cc6d90
00000400:00000010:3.0:1773851852.440865:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090cc6d90.
00000020:00000010:1.0:1773851852.440865:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092010b2a.
00000100:00000001:3.0:1773851852.440866:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851852.440866:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:1.0:1773851852.440866:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 9
00000100:00000001:1.0:1773851852.440866:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851852.440867:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000800:00000200:3.0:1773851852.440868:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Transaction freed
00000800:00000200:14.0:1773851852.441105:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851852.441105:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851852.441106:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851852.441106:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851852.441107:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851852.441107:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851852.441109:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851852.441109:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8738@kfi7(00000000c8b65ef0):0x2aa version: 2; local version 2; negotiated version: 2
00000400:00000200:14.0:1773851852.441111:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000800:00000200:13.0:1773851852.441111:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa Using peer 8738@kfi7(0x1000000000002aa)
00000400:00000200:14.0:1773851852.441112:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8738@kfi7 : PUT - for me
00000400:00000200:14.0:1773851852.441113:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:14.0:1773851852.441114:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 1
00000400:00000200:14.0:1773851852.441116:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:14.0:1773851852.441116:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000400:00000200:14.0:1773851852.441117:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 3
00000400:00000200:13.0:1773851852.441118:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:14.0:1773851852.441119:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:14.0:1773851852.441120:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 328 into portal 17 MB=0x69b09e5d90b00
00000800:00000200:13.0:1773851852.441120:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 38 bytes to peer 0x1000000000002aa: rc=0
00000400:00000200:14.0:1773851852.441121:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8931@kfi7 of length 328/328 into md 0x82a562e4d [2] + 1656
00000800:00000200:13.0:1773851852.441122:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:14.0:1773851852.441123:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851852.441125:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851852.441126:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8738@kfi7: PUT: OK
00000100:00000001:14.0:1773851852.441128:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851852.441128:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:14.0:1773851852.441129:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e693730a.
00000100:00000040:14.0:1773851852.441130:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000e693730a x1859316673481472 msgsize 328
00000100:00100000:14.0:1773851852.441131:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8738@kfi7)
00000100:00000001:14.0:1773851852.441132:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851852.441133:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000800:00000200:13.0:1773851852.441135:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851852.441137:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851852.441137:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000800:00000200:13.0:1773851852.441137:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa Transaction freed
02000000:00000001:15.0:1773851852.441138:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851852.441139:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851852.441140:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851852.441141:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851852.441143:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673481472
00000020:00000001:15.0:1773851852.441144:0:609420:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851852.441145:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000020:00000001:15.0:1773851852.441145:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851852.441149:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=10
00000020:00000001:15.0:1773851852.441151:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000020:00000001:15.0:1773851852.441152:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:15.0:1773851852.441154:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851852.441155:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851852.441156:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f2922694.
00000020:00000010:15.0:1773851852.441158:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851852.441159:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000040:15.0:1773851852.441161:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:15.0:1773851852.441162:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851852.441163:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:15.0:1773851852.441163:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:15.0:1773851852.441164:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851852.441165:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:15.0:1773851852.441167:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:15.0:1773851852.441167:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851852.441169:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000af8f1b7b refcount=3
00000020:00000001:15.0:1773851852.441170:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:15.0:1773851852.441171:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:15.0:1773851852.441172:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851852.441173:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851852.441174:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851852.441175:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851852.441177:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851852.441178:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851852.441180:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851852.441181:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851852.441181:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851852.441181:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851852.441183:0:536982:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 50273004
00000100:00000001:15.0:1773851852.441184:0:609420:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851852.441184:0:536982:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:15.0:1773851852.441185:0:609420:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851852.441185:0:536982:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341807232 : -106946367744384 : ffff9ebb9bbd9680)
00000100:00000040:12.0:1773851852.441187:0:536982:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e693730a x1859316673481472/t0(0) o103->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:579/0 lens 328/0 e 0 to 0 dl 1773851939 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:12.0:1773851852.441191:0:536982:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851852.441191:0:536982:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851852.441192:0:536982:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e693730a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_017:060c0146-d4d1-4a42-8c8d-241eaa2f523c+10:39785:x1859316673481472:12345-8931@kfi7:103:
00000100:00000200:12.0:1773851852.441194:0:536982:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673481472
00010000:00000001:12.0:1773851852.441195:0:536982:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:12.0:1773851852.441195:0:536982:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:12.0:1773851852.441196:0:536982:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:12.0:1773851852.441197:0:536982:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851852.441198:0:536982:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851852.441200:0:536982:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000290d0842.
02000000:00000001:12.0:1773851852.441200:0:536982:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851852.441201:0:536982:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851852.441202:0:536982:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:12.0:1773851852.441202:0:536982:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:12.0:1773851852.441203:0:536982:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851852.441203:0:536982:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851852.441204:0:536982:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000af8f1b7b refcount=3
00000020:00000001:12.0:1773851852.441204:0:536982:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000001:12.0:1773851852.441205:0:536982:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946452032 : -106939763099584 : ffff9ebd25687840)
00010000:00000040:12.0:1773851852.441206:0:536982:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 235
00000004:00000001:12.0:1773851852.441207:0:536982:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851852.441208:0:536982:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851852.441209:0:536982:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851852.441209:0:536982:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851852.441210:0:536982:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851852.441210:0:536982:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851852.441212:0:536982:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851852.441212:0:536982:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851852.441214:0:536982:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851852.441214:0:536982:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851852.441215:0:536982:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851852.441215:0:536982:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851852.441216:0:536982:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000af8f1b7b with handle 0x21b6f08f07a6aca5 from hash
00010000:00000001:12.0:1773851852.441217:0:536982:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851852.441217:0:536982:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851852.441217:0:536982:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851852.441218:0:536982:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851852.441219:0:536982:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851852.441219:0:536982:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851852.441220:0:536982:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851852.441220:0:536982:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851852.441221:0:536982:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000af8f1b7b/0x21b6f08f07a6aca5 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 236 type: IBT gid 0 flags: 0x44a01000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3cbd expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851852.441224:0:536982:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 235
00010000:00000040:12.0:1773851852.441226:0:536982:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000006b8dd11 : new locks_count 3
00000020:00000040:12.0:1773851852.441227:0:536982:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 9
00010000:00000010:12.0:1773851852.441227:0:536982:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000f2bd3033.
00010000:00000040:12.0:1773851852.441228:0:536982:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000001:12.0:1773851852.441229:0:536982:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851852.441229:0:536982:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851852.441230:0:536982:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851852.441230:0:536982:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:12.0:1773851852.441232:0:536982:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851852.441233:0:536982:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851852.441233:0:536982:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851852.441234:0:536982:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00010000:12.0:1773851852.441234:0:536982:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:12.0:1773851852.441235:0:536982:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851852.441236:0:536982:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851852.441236:0:536982:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851852.441237:0:536982:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=106 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851852.441238:0:536982:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851852.441239:0:536982:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:12.0:1773851852.441239:0:536982:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
02000000:00000001:12.0:1773851852.441240:0:536982:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851852.441241:0:536982:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851852.441241:0:536982:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851852.441242:0:536982:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8738@kfi7
00000400:00000010:12.0:1773851852.441243:0:536982:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e652fce.
00000100:00000200:12.0:1773851852.441244:0:536982:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859316673481472, offset 224
00000400:00000200:12.0:1773851852.441245:0:536982:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8738@kfi7
00000400:00000200:12.0:1773851852.441246:0:536982:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:12.0:1773851852.441247:0:536982:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 1
00000400:00000200:12.0:1773851852.441249:0:536982:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000400:00000200:12.0:1773851852.441250:0:536982:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 3
00000400:00000200:12.0:1773851852.441251:0:536982:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8738@kfi7 local destination
00000400:00000200:12.0:1773851852.441253:0:536982:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768519:8768519:1024:4294967295] 8738@kfi7 LPNI seq info [2192104:2192104:16:4294967295]
00000400:00000200:12.0:1773851852.441255:0:536982:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000400:00000200:12.0:1773851852.441255:0:536982:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:12.0:1773851852.441257:0:536982:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8738@kfi7(8738@kfi7:8738@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851852.441258:0:536982:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 3
00000800:00000200:12.0:1773851852.441260:0:536982:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851852.441261:0:536982:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851852.441264:0:536982:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851852.441266:0:536982:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa Using peer 8738@kfi7(0x1000000000002aa)
00000800:00000200:12.0:1773851852.441269:0:536982:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0x1000000000002aa: rc=0
00000800:00000200:12.0:1773851852.441270:0:536982:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851852.441272:0:536982:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851852.441273:0:536982:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:12.0:1773851852.441274:0:536982:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851852.441275:0:536982:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851852.441275:0:536982:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e693730a x1859316673481472/t0(0) o103->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:579/0 lens 328/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:12.0:1773851852.441280:0:536982:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e693730a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_017:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:39785:x1859316673481472:12345-8931@kfi7:103: Request processed in 89us (149us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851852.441282:0:536982:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 50273004
00000100:00000040:12.0:1773851852.441283:0:536982:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000100:00000001:12.0:1773851852.441284:0:536982:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851852.441284:0:536982:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851852.441285:0:536982:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851852.441286:0:536982:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000020:00000010:12.0:1773851852.441287:0:536982:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f2922694.
00000020:00000040:12.0:1773851852.441287:0:536982:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 8
00000100:00000001:12.0:1773851852.441288:0:536982:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851852.441293:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851852.441295:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851852.441296:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8738@kfi7: PUT: OK
00000400:00000200:13.0:1773851852.441297:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e652fce
00000400:00000010:13.0:1773851852.441297:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e652fce.
00000100:00000001:13.0:1773851852.441298:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851852.441298:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851852.441299:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000800:00000200:13.0:1773851852.441301:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa Transaction freed
00000800:00000200:1.0:1773851852.442136:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.442137:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851852.442138:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851852.442140:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851852.442142:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.442143:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8931@kfi7 : PUT - for me
00000400:00000200:1.0:1773851852.442144:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.442145:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 1
00000400:00000200:1.0:1773851852.442146:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.442146:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.442147:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000400:00000200:1.0:1773851852.442148:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.442149:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 576 into portal 12 MB=0x69b09e5d90ec0
00000400:00000200:1.0:1773851852.442150:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8931@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 8720
00000800:00000200:1.0:1773851852.442152:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851852.442154:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851852.442155:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8931@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.442156:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851852.442157:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851852.442158:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066bff78c.
00000100:00000040:1.0:1773851852.442159:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000066bff78c x1859316673482432 msgsize 576
00000100:00100000:1.0:1773851852.442160:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8931@kfi7)
00000100:00000001:1.0:1773851852.442162:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851852.442163:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000800:00000200:1.0:1773851852.442164:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851852.442167:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851852.442167:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.442168:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.442168:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.442169:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.442170:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673482432
00000020:00000001:1.0:1773851852.442170:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.442171:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000020:00000001:1.0:1773851852.442172:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.442172:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=9
00000020:00000001:1.0:1773851852.442173:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000020:00000001:1.0:1773851852.442174:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:1.0:1773851852.442175:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.442175:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.442176:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851852.442177:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851852.442178:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.442179:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.442179:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:1.0:1773851852.442180:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:1.0:1773851852.442180:0:60951:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.442181:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.442182:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.442183:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851852.442184:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851852.442184:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.442185:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851852.442185:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851852.442186:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 408701474
00000100:00000001:2.0:1773851852.442188:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.442188:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:2.0:1773851852.442189:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.442189:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085911358208 : -106987798193408 : ffff9eb1f64b1b00)
00000100:00000040:1.0:1773851852.442190:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066bff78c x1859316673482432/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:492/0 lens 576/0 e 0 to 0 dl 1773852607 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1035-0'
00000100:00000001:1.0:1773851852.442193:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.442193:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.442194:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066bff78c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:1429396:x1859316673482432:12345-8931@kfi7:101:default-tuolumne1035-0
00000100:00000200:1.0:1773851852.442195:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673482432
00000020:00000001:1.0:1773851852.442196:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.442197:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.442197:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.442198:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.442198:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:1.0:1773851852.442199:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.442199:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316673482432, found 0 last_xid 1859316673482431
00000020:00000001:1.0:1773851852.442200:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.442200:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.442201:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.442201:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.442202:0:60951:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:1.0:1773851852.442202:0:60951:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:1.0:1773851852.442203:0:60951:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:1.0:1773851852.442203:0:60951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:1.0:1773851852.442204:0:60951:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.442205:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:1.0:1773851852.442206:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 199
00010000:00000001:1.0:1773851852.442207:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.442208:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.442208:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000dc455f59.
00000020:00000001:1.0:1773851852.442209:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.442209:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000dc455f59 with handle 0x21b6f08f07a6acac to hash
00000020:00000001:1.0:1773851852.442210:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.442211:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637133946445120 : -106939763106496 : ffff9ebd25685d40)
00010000:00000010:1.0:1773851852.442211:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000b22c364f.
00010000:00000001:1.0:1773851852.442212:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637133946445120 : -106939763106496 : ffff9ebd25685d40)
00010000:00010000:1.0:1773851852.442213:0:60951:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000dc455f59/0x21b6f08f07a6acac lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 200 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xde0abe468d1e3ce7 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442215:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:1.0:1773851852.442216:0:60951:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000006b8dd11 : new locks_count 4
00000020:00000040:1.0:1773851852.442216:0:60951:0:(genops.c:871:class_export_get()) GET export 0000000006b8dd11 refcount=10
00010000:00000001:1.0:1773851852.442218:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:1.0:1773851852.442218:0:60951:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:1.0:1773851852.442219:0:60951:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:1.0:1773851852.442220:0:60951:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:1.0:1773851852.442220:0:60951:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:1.0:1773851852.442220:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:1.0:1773851852.442221:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:1.0:1773851852.442221:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:1.0:1773851852.442223:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:1.0:1773851852.442223:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:1.0:1773851852.442224:0:60951:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442225:0:60951:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:1.0:1773851852.442225:0:60951:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:1.0:1773851852.442226:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.442226:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.442228:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 0000000070feac5c.
02000000:00000001:1.0:1773851852.442229:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.442230:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442230:0:60951:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442231:0:60951:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:1.0:1773851852.442231:0:60951:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:1.0:1773851852.442232:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.442232:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442233:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.442233:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442234:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.442234:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442235:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.442235:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442236:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.442236:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.442237:0:60951:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:1.0:1773851852.442237:0:60951:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:1.0:1773851852.442238:0:60951:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:1.0:1773851852.442238:0:60951:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442239:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.442239:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442240:0:60951:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:1.0:1773851852.442240:0:60951:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442241:0:60951:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:1.0:1773851852.442241:0:60951:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 00000000ac363dad
00000004:00000001:1.0:1773851852.442242:0:60951:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:1.0:1773851852.442242:0:60951:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:1.0:1773851852.442243:0:60951:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:1.0:1773851852.442243:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:1.0:1773851852.442244:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 200
00010000:00000001:1.0:1773851852.442244:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.442245:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:1.0:1773851852.442246:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000cae86653.
00000020:00000001:1.0:1773851852.442246:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:1.0:1773851852.442247:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000cae86653 with handle 0x21b6f08f07a6acb3 to hash
00000020:00000001:1.0:1773851852.442247:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:1.0:1773851852.442248:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000010:1.0:1773851852.442248:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000078bd25d4.
00010000:00000001:1.0:1773851852.442249:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000001:1.0:1773851852.442250:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.442250:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.442251:0:60951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000cae86653/0x21b6f08f07a6acb3 lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 201 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442253:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000001:1.0:1773851852.442254:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:1.0:1773851852.442255:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:1.0:1773851852.442255:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:1.0:1773851852.442256:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.442256:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.442257:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:1.0:1773851852.442257:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.442258:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:1.0:1773851852.442258:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:1.0:1773851852.442259:0:60951:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:1.0:1773851852.442259:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:1.0:1773851852.442260:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 200
00010000:00000040:1.0:1773851852.442261:0:60951:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:1.0:1773851852.442261:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442264:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442265:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442267:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442268:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442270:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442271:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442273:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442275:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442277:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442278:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442281:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442282:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442284:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442285:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442287:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442289:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442291:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442292:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442294:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442296:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442298:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442299:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442301:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442302:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442305:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442306:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442308:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442309:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442311:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442312:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442314:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442315:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442317:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442318:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442320:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442322:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442324:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442325:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442327:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442328:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442330:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442331:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442334:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442335:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442337:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442338:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 8 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442340:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442342:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442344:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442345:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442347:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442348:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442350:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442351:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442353:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442354:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442356:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442357:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442359:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442360:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442362:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442364:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442366:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442367:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442369:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442370:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442372:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442373:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442375:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442376:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442378:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442379:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442381:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442383:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442386:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442387:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442389:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442390:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442392:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442393:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442395:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442397:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442399:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442400:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442402:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442403:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442405:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442406:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442408:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442409:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008294d81b/0x21b6f08f07a4d831 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25e4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442412:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442414:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6fd604e/0x21b6f08f07a4d7f9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b927b expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442416:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442417:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a4d7c1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc125 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442419:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442420:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000006bb1a52/0x21b6f08f07a4d789 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c851e expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442422:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442423:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcaf5765/0x21b6f08f07a4d74a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 18304@kfi7 remote: 0xa8da567d9ebd271e expref: 8 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442425:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442426:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442428:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442429:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442431:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442432:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442434:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442435:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442437:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442439:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442440:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442442:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442444:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442445:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442447:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442448:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442450:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442451:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442453:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442454:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442456:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442457:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442459:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442460:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442462:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442464:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442466:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442467:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442469:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442470:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442472:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442473:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442475:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442476:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442478:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442479:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442482:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442483:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442485:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442486:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442489:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442490:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442492:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442493:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442495:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442496:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442498:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442499:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442501:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442502:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442504:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442505:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442507:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442508:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442510:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442511:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442515:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442516:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442518:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442519:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442521:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442522:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442525:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442526:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442528:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442529:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442531:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442532:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442534:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442535:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442537:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442539:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442542:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442543:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442545:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442545:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442548:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442549:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442551:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442552:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442554:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442555:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442557:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442558:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442560:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442561:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442563:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442564:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442567:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442568:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442570:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442572:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442574:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442575:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442577:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442578:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442580:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442581:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442583:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442584:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442586:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442587:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442589:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442591:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442594:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442595:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442597:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442598:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442600:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442601:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442603:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442604:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442606:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442607:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442609:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442610:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442612:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442613:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442615:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442616:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 10 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442619:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442620:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442622:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442623:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442625:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442626:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442628:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442629:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442631:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442632:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442634:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442635:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442637:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442638:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442640:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442641:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442644:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442645:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442647:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442648:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442650:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442651:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442653:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442654:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442656:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442657:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442659:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442661:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442663:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442664:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442666:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442667:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442679:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442680:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442682:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442683:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442685:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442686:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442688:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442690:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442692:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442693:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442695:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442696:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442698:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442699:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442702:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442703:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442706:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442707:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442709:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442710:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442712:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442713:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442715:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442716:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442718:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442719:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442721:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442722:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442724:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442728:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442730:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442732:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442734:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442735:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442737:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442739:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442741:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442742:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442744:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442745:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442748:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442749:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442751:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442752:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442754:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442755:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442757:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442758:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442761:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442763:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442765:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442765:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442768:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442769:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442771:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442772:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442774:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442775:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442777:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442778:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442780:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442782:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442784:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442785:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442788:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442789:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442791:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442792:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442794:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442795:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442797:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442798:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442801:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442802:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442804:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442805:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442807:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442808:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442810:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442811:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442814:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442815:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442817:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442818:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442820:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442821:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442823:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442824:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442826:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442827:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442829:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442830:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442833:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442834:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442836:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442837:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442840:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442841:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442843:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442844:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442846:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442848:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442850:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442850:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442853:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442854:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442856:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442857:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442859:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442860:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442862:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442864:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442866:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442868:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442869:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442871:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442873:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442874:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442876:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442877:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442880:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442881:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442883:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442884:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442886:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442887:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442889:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442890:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442893:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442894:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442896:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442897:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442899:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442900:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442902:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442903:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442905:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442906:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442908:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442909:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442912:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442913:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442915:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442916:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442919:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00010000:1.0:1773851852.442919:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000cae86653/0x21b6f08f07a6acb3 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442921:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000001:1.0:1773851852.442922:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:1.0:1773851852.442923:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:1.0:1773851852.442923:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.442924:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:1.0:1773851852.442924:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.442925:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.442925:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:1.0:1773851852.442926:0:60951:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:1.0:1773851852.442926:0:60951:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851852.442927:0:60951:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000cae86653/0x21b6f08f07a6acb3 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442929:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000001:1.0:1773851852.442929:0:60951:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:1.0:1773851852.442930:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.442930:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.442931:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.442931:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.442932:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cae86653 refcount=3
00000020:00000001:1.0:1773851852.442932:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000001:1.0:1773851852.442933:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000001:1.0:1773851852.442934:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.442934:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.442934:0:60951:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442935:0:60951:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442936:0:60951:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:1.0:1773851852.442937:0:60951:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:1.0:1773851852.442937:0:60951:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:1.0:1773851852.442945:0:60951:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442945:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:1.0:1773851852.442946:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.442946:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.442947:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442948:0:60951:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442949:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442949:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:1.0:1773851852.442950:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.442950:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.442950:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442951:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442952:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:1.0:1773851852.442952:0:60951:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:1.0:1773851852.442953:0:60951:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442954:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.442954:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442955:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.442955:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:1.0:1773851852.442956:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:1.0:1773851852.442956:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:1.0:1773851852.442957:0:60951:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:1.0:1773851852.442958:0:60951:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:1.0:1773851852.442958:0:60951:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:1.0:1773851852.442959:0:60951:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:1.0:1773851852.442959:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:1.0:1773851852.442960:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442960:0:60951:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:1.0:1773851852.442961:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:1.0:1773851852.442961:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.442962:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:1.0:1773851852.442962:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442962:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442963:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:1.0:1773851852.442964:0:60951:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.442965:0:60951:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:1.0:1773851852.442965:0:60951:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442966:0:60951:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442968:0:60951:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.442968:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:1.0:1773851852.442969:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.442969:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cae86653 refcount=3
00000020:00000001:1.0:1773851852.442970:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000001:1.0:1773851852.442970:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00000004:00000040:1.0:1773851852.442971:0:60951:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 0000000006b8dd11 : new locks_count 5
00000020:00000040:1.0:1773851852.442972:0:60951:0:(genops.c:871:class_export_get()) GET export 0000000006b8dd11 refcount=11
00010000:00000001:1.0:1773851852.442972:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.442973:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:1.0:1773851852.442973:0:60951:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:1.0:1773851852.442973:0:60951:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:1.0:1773851852.442974:0:60951:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:1.0:1773851852.442974:0:60951:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:1.0:1773851852.442975:0:60951:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:1.0:1773851852.442975:0:60951:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:1.0:1773851852.442975:0:60951:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:1.0:1773851852.442976:0:60951:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:1.0:1773851852.442977:0:60951:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851852.442977:0:60951:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:1.0:1773851852.442978:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:1.0:1773851852.442978:0:60951:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:1.0:1773851852.442979:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:1.0:1773851852.442979:0:60951:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:1.0:1773851852.442980:0:60951:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:1.0:1773851852.442981:0:60951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:1.0:1773851852.442981:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.442981:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.442982:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:1.0:1773851852.442982:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:1.0:1773851852.442983:0:60951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000dc455f59 with handle 0x21b6f08f07a6acac from hash
00010000:00000001:1.0:1773851852.442984:0:60951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:1.0:1773851852.442984:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.442985:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.442985:0:60951:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:1.0:1773851852.442985:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:1.0:1773851852.442986:0:60951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000dc455f59/0x21b6f08f07a6acac lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 201 type: IBT gid 0 flags: 0x44000000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3ce7 expref: 11 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442989:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:1.0:1773851852.442989:0:60951:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000006b8dd11 : new locks_count 4
00000020:00000040:1.0:1773851852.442990:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 10
00010000:00000010:1.0:1773851852.442991:0:60951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000b22c364f.
00010000:00000040:1.0:1773851852.442991:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:1.0:1773851852.442992:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:1.0:1773851852.442992:0:60951:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.442993:0:60951:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:1.0:1773851852.442994:0:60951:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000cae86653/0x21b6f08f07a6acb3 lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3ce7 expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:1.0:1773851852.442996:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:1.0:1773851852.442997:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:1.0:1773851852.442998:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:1.0:1773851852.442998:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:1.0:1773851852.442999:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:1.0:1773851852.443000:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:1.0:1773851852.443001:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851852.443001:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:1.0:1773851852.443002:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:1.0:1773851852.443002:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:1.0:1773851852.443003:0:60951:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000cae86653, rc 0)
00000020:00000001:1.0:1773851852.443003:0:60951:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.443004:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200468, transno 0, xid 1859316673482432
00010000:00000001:1.0:1773851852.443005:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.443005:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066bff78c x1859316673482432/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:492/0 lens 576/640 e 0 to 0 dl 1773852607 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1035-0'
00010000:00000001:1.0:1773851852.443012:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.443012:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.443013:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.443014:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.443015:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:1.0:1773851852.443015:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
02000000:00000001:1.0:1773851852.443016:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.443017:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.443017:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.443018:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8931@kfi7
00000400:00000010:1.0:1773851852.443019:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001ad7c3a1.
00000100:00000200:1.0:1773851852.443019:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859316673482432, offset 224
00000400:00000200:1.0:1773851852.443021:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8931@kfi7
00000400:00000200:1.0:1773851852.443022:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.443022:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 1
00000400:00000200:1.0:1773851852.443023:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.443024:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000400:00000200:1.0:1773851852.443026:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8931@kfi7 local destination
00000400:00000200:1.0:1773851852.443027:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768520:8768520:1024:4294967295] 8931@kfi7 LPNI seq info [2192105:2192105:16:4294967295]
00000400:00000200:1.0:1773851852.443028:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000400:00000200:1.0:1773851852.443029:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.443031:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8931@kfi7(8931@kfi7:8931@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.443032:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 3
00000800:00000200:1.0:1773851852.443034:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.443035:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:1.0:1773851852.443037:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.443039:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Using peer 8931@kfi7(0x7e2)
00000800:00000200:1.0:1773851852.443044:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 740 bytes to peer 0x7e2: rc=0
00000800:00000200:1.0:1773851852.443045:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.443047:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.443048:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:1.0:1773851852.443049:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.443049:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.443050:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.443050:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066bff78c x1859316673482432/t0(0) o101->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:492/0 lens 576/640 e 0 to 0 dl 1773852607 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1035-0'
00000100:00100000:1.0:1773851852.443053:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066bff78c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:060c0146-d4d1-4a42-8c8d-241eaa2f523c+10:1429396:x1859316673482432:12345-8931@kfi7:101:default-tuolumne1035-0 Request processed in 859us (893us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851852.443056:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 408701474
00000100:00000040:1.0:1773851852.443057:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000800:00000200:3.0:1773851852.443058:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851852.443058:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851852.443058:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:3.0:1773851852.443059:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851852.443059:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:3.0:1773851852.443060:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8931@kfi7: PUT: OK
00000020:00000010:1.0:1773851852.443060:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:3.0:1773851852.443061:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001ad7c3a1
00000400:00000010:3.0:1773851852.443061:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001ad7c3a1.
00000020:00000010:1.0:1773851852.443061:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000020:00000040:1.0:1773851852.443061:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 9
00000100:00000001:3.0:1773851852.443062:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851852.443062:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:1.0:1773851852.443062:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851852.443063:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000040743c94 nid 8931@kfi7 refs 2
00000800:00000200:3.0:1773851852.443064:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 8931@kfi7(000000004f110280):0x0 lsk 2019 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e2 Transaction freed
00000800:00000200:13.0:1773851852.443137:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851852.443137:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851852.443138:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851852.443140:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851852.443142:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.443143:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8738@kfi7 : PUT - for me
00000400:00000200:13.0:1773851852.443144:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.443144:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 1
00000400:00000200:13.0:1773851852.443145:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.443146:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000400:00000200:13.0:1773851852.443147:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 3
00000400:00000200:13.0:1773851852.443148:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:13.0:1773851852.443149:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 328 into portal 17 MB=0x69b09e5d90f40
00000400:00000200:13.0:1773851852.443150:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8931@kfi7 of length 328/328 into md 0x82a562e4d [2] + 1984
00000400:00000010:13.0:1773851852.443151:0:2514888:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000400bc581.
00000400:00000200:13.0:1773851852.443152:0:2514888:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 000000008c9c57fe
00000800:00000200:13.0:1773851852.443153:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851852.443155:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851852.443156:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8738@kfi7: PUT: OK
00000400:00000200:13.0:1773851852.443156:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c9c57fe
00000400:00000010:13.0:1773851852.443157:0:2514888:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 000000008c9c57fe (tot 253200619).
00000100:00000001:13.0:1773851852.443158:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851852.443158:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000040:13.0:1773851852.443159:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000fc6dae68 x1859316673482560 msgsize 328
00000100:00100000:13.0:1773851852.443160:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8738@kfi7)
00000100:00000040:13.0:1773851852.443161:0:2514888:0:(events.c:370:request_in_callback()) Buffer complete: 63 buffers still posted
00000100:00000001:13.0:1773851852.443162:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851852.443163:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000100:00000001:12.0:1773851852.443163:0:536982:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851852.443164:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851852.443164:0:536982:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851852.443164:0:536982:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851852.443165:0:536982:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851852.443166:0:536982:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851852.443166:0:536982:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673482560
00000020:00000001:12.0:1773851852.443167:0:536982:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851852.443167:0:536982:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000020:00000001:12.0:1773851852.443168:0:536982:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851852.443169:0:536982:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=10
00000020:00000001:12.0:1773851852.443170:0:536982:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000020:00000001:12.0:1773851852.443170:0:536982:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:12.0:1773851852.443171:0:536982:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851852.443172:0:536982:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851852.443172:0:536982:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008ee0eb28.
00000020:00000010:12.0:1773851852.443173:0:536982:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851852.443174:0:536982:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002667cede.
00000100:00000040:12.0:1773851852.443175:0:536982:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:12.0:1773851852.443176:0:536982:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851852.443176:0:536982:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:12.0:1773851852.443177:0:536982:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:12.0:1773851852.443177:0:536982:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851852.443178:0:536982:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:12.0:1773851852.443178:0:536982:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851852.443178:0:536982:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851852.443179:0:536982:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cae86653 refcount=3
00000020:00000001:12.0:1773851852.443180:0:536982:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000001:12.0:1773851852.443180:0:536982:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000001:12.0:1773851852.443181:0:536982:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851852.443182:0:536982:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851852.443182:0:536982:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851852.443182:0:536982:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851852.443183:0:536982:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851852.443184:0:536982:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851852.443186:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851852.443186:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851852.443186:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851852.443187:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 50273005
00000100:00000001:12.0:1773851852.443187:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851852.443188:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:12.0:1773851852.443188:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851852.443189:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121800439888 : -106951909111728 : ffff9eba51730850)
00000100:00000001:12.0:1773851852.443189:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851852.443190:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fc6dae68 x1859316673482560/t0(0) o103->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:579/0 lens 328/0 e 0 to 0 dl 1773851939 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:15.0:1773851852.443192:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851852.443193:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851852.443194:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc6dae68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:060c0146-d4d1-4a42-8c8d-241eaa2f523c+10:39765:x1859316673482560:12345-8931@kfi7:103:
00000100:00000200:15.0:1773851852.443195:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673482560
00010000:00000001:15.0:1773851852.443196:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:15.0:1773851852.443196:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:15.0:1773851852.443197:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:15.0:1773851852.443197:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851852.443198:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851852.443198:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2922694.
02000000:00000001:15.0:1773851852.443199:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851852.443200:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851852.443200:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:15.0:1773851852.443201:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:15.0:1773851852.443201:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:15.0:1773851852.443201:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851852.443202:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cae86653 refcount=3
00000020:00000001:15.0:1773851852.443202:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000001:15.0:1773851852.443203:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133946440512 : -106939763111104 : ffff9ebd25684b40)
00010000:00000040:15.0:1773851852.443204:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 200
00000004:00000001:15.0:1773851852.443204:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:15.0:1773851852.443205:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:15.0:1773851852.443205:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:15.0:1773851852.443206:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:15.0:1773851852.443206:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851852.443206:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851852.443208:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:15.0:1773851852.443208:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:15.0:1773851852.443210:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851852.443210:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851852.443211:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:15.0:1773851852.443211:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:15.0:1773851852.443212:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000cae86653 with handle 0x21b6f08f07a6acb3 from hash
00010000:00000001:15.0:1773851852.443212:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:15.0:1773851852.443213:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851852.443213:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851852.443213:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:15.0:1773851852.443214:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:15.0:1773851852.443215:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851852.443215:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:15.0:1773851852.443215:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:15.0:1773851852.443216:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000cae86653/0x21b6f08f07a6acb3 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x44a01000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3ce7 expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851852.443219:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 200
00010000:00000040:15.0:1773851852.443220:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000006b8dd11 : new locks_count 3
00000020:00000040:15.0:1773851852.443220:0:609420:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 9
00010000:00000010:15.0:1773851852.443221:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000078bd25d4.
00010000:00000040:15.0:1773851852.443222:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:15.0:1773851852.443222:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851852.443223:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:15.0:1773851852.443223:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:15.0:1773851852.443224:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:15.0:1773851852.443225:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:15.0:1773851852.443226:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851852.443226:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:15.0:1773851852.443227:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00010000:15.0:1773851852.443227:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:15.0:1773851852.443228:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:15.0:1773851852.443228:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851852.443229:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851852.443229:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=106 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851852.443230:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851852.443231:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:15.0:1773851852.443232:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
02000000:00000001:15.0:1773851852.443233:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851852.443233:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851852.443234:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851852.443234:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8738@kfi7
00000400:00000010:15.0:1773851852.443235:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006efdb9c7.
00000100:00000200:15.0:1773851852.443236:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859316673482560, offset 224
00000400:00000200:15.0:1773851852.443237:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8738@kfi7
00000400:00000200:15.0:1773851852.443238:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:15.0:1773851852.443239:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 1
00000400:00000200:15.0:1773851852.443240:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000400:00000200:15.0:1773851852.443241:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 3
00000400:00000200:15.0:1773851852.443242:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8738@kfi7 local destination
00000400:00000200:15.0:1773851852.443244:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768521:8768521:1024:4294967295] 8738@kfi7 LPNI seq info [2192106:2192106:16:4294967295]
00000400:00000200:15.0:1773851852.443245:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
00000400:00000200:15.0:1773851852.443246:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8738@kfi7 to cpt 3
00000400:00000200:15.0:1773851852.443247:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8738@kfi7(8738@kfi7:8738@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851852.443249:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 3
00000800:00000200:15.0:1773851852.443250:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851852.443251:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851852.443253:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851852.443255:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa Using peer 8738@kfi7(0x1000000000002aa)
00000800:00000200:15.0:1773851852.443258:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x1000000000002aa: rc=0
00000800:00000200:15.0:1773851852.443259:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851852.443261:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851852.443262:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:15.0:1773851852.443262:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851852.443263:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851852.443263:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fc6dae68 x1859316673482560/t0(0) o103->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:579/0 lens 328/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:15.0:1773851852.443266:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc6dae68 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:39765:x1859316673482560:12345-8931@kfi7:103: Request processed in 73us (106us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851852.443268:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 50273005
00000100:00000040:15.0:1773851852.443271:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000100:00000001:15.0:1773851852.443271:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851852.443271:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851852.443272:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851852.443272:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851852.443273:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:15.0:1773851852.443273:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002667cede.
00000400:00000200:13.0:1773851852.443273:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8738@kfi7: PUT: OK
00000020:00000010:15.0:1773851852.443274:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008ee0eb28.
00000400:00000200:13.0:1773851852.443274:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006efdb9c7
00000400:00000010:13.0:1773851852.443274:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006efdb9c7.
00000020:00000040:15.0:1773851852.443275:0:609420:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 8
00000100:00000001:13.0:1773851852.443275:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851852.443275:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
02000000:00000001:15.0:1773851852.443276:0:609420:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:15.0:1773851852.443276:0:609420:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2922694.
00000400:00000200:13.0:1773851852.443276:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003fbe77b4 nid 8738@kfi7 refs 2
02000000:00000001:15.0:1773851852.443277:0:609420:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000800:00000200:13.0:1773851852.443277:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 8738@kfi7(00000000c8b65ef0):0x0 lsk 683 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002aa Transaction freed
02000000:00000001:15.0:1773851852.443278:0:609420:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:15.0:1773851852.443278:0:609420:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000290d0842.
02000000:00000001:15.0:1773851852.443278:0:609420:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:15.0:1773851852.443279:0:609420:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e693730a.
02000000:00000001:15.0:1773851852.443279:0:609420:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:15.0:1773851852.443280:0:609420:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad15dc46.
02000000:00000001:15.0:1773851852.443280:0:609420:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:15.0:1773851852.443280:0:609420:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009e144d9b.
02000000:00000001:15.0:1773851852.443281:0:609420:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:15.0:1773851852.443281:0:609420:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b7d5d081.
02000000:00000001:15.0:1773851852.443282:0:609420:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:15.0:1773851852.443282:0:609420:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000090e501.
02000000:00000001:15.0:1773851852.443283:0:609420:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:15.0:1773851852.443283:0:609420:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002c8efac2.
02000000:00000001:15.0:1773851852.443284:0:609420:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:15.0:1773851852.443284:0:609420:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e4fb9b89.
02000000:00000001:15.0:1773851852.443285:0:609420:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:15.0:1773851852.443286:0:609420:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008ee171b0.
02000000:00000001:15.0:1773851852.443286:0:609420:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:15.0:1773851852.443286:0:609420:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cc2fb00.
02000000:00000001:15.0:1773851852.443287:0:609420:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:15.0:1773851852.443287:0:609420:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e442e125.
02000000:00000001:15.0:1773851852.443288:0:609420:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:15.0:1773851852.443288:0:609420:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000451054f7.
00000100:00000001:15.0:1773851852.443290:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:15.0:1773851852.443291:0:609420:0:(niobuf.c:993:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17
00000400:00000010:15.0:1773851852.443292:0:609420:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bdff5822.
00000400:00000010:15.0:1773851852.443293:0:609420:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 000000003cb7bae6 (tot 253200771).
00010000:00000010:1.1F:1773851852.445728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f47951c7.
00010000:00000010:15.1:1773851852.454726:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000cae86653.
00010000:00000010:27.1F:1773851852.454727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d0bc046c.
00010000:00000010:12.1F:1773851852.454727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000af8f1b7b.
00010000:00000010:1.1:1773851852.454728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000bf74ee88.
00010000:00000010:1.1:1773851852.454729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000743f6774.
00010000:00000010:1.1:1773851852.454730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000789a22e3.
00010000:00000010:1.1:1773851852.454731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006c541e9e.
00000800:00000200:21.0:1773851852.456160:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851852.456161:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851852.456163:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851852.456166:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851852.456168:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.456170:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14323@kfi7 : PUT - for me
00000400:00000200:21.0:1773851852.456172:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.456173:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 1
00000400:00000200:21.0:1773851852.456175:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.456175:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000400:00000200:21.0:1773851852.456177:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 3
00000400:00000200:21.0:1773851852.456178:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14130@kfi7 to cpt 7
00000400:00000200:21.0:1773851852.456179:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14130@kfi7 of length 224 into portal 12 MB=0x699e0be19f540
00000400:00000200:21.0:1773851852.456181:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14130@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 22016
00000800:00000200:21.0:1773851852.456184:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851852.456187:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851852.456189:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14323@kfi7: PUT: OK
00000100:00000001:21.0:1773851852.456190:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851852.456191:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851852.456192:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1c8a557.
00000100:00000040:21.0:1773851852.456193:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000f1c8a557 x1858040401360192 msgsize 224
00000100:00100000:21.0:1773851852.456196:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14130@kfi7 (source: 12345-14323@kfi7)
00000100:00000001:21.0:1773851852.456197:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851852.456199:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000100:00000001:23.0:1773851852.456200:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851852.456201:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851852.456201:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851852.456202:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851852.456202:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851852.456204:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851852.456205:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040401360192
00000020:00000001:23.0:1773851852.456206:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851852.456207:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91674
00000020:00000001:23.0:1773851852.456208:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851852.456213:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002183a2bb refcount=6
00000020:00000001:23.0:1773851852.456214:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241240576 : -107152468311040 : ffff9e8b9f308400)
00000020:00000001:23.0:1773851852.456215:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241240576 : -107152468311040 : ffff9e8b9f308400)
00000100:00000001:23.0:1773851852.456217:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851852.456219:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851852.456220:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e556a1b5.
00000020:00000010:23.0:1773851852.456221:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851852.456223:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851852.456224:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851852.456224:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851852.456225:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.456227:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851852.456227:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851852.456228:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.456230:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.456231:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851852.456232:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851852.456232:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.456233:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851852.456234:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14130@kfi7, seq: 1997919
00000100:00000040:23.0:1773851852.456235:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002183a2bb : new rpc_count 1
00000100:00000001:22.0:1773851852.456235:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.456236:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117346304 : -106995592205312 : ffff9eb025bbec00)
00000100:00000001:22.0:1773851852.456236:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851852.456238:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f1c8a557 x1858040401360192/t0(0) o400->79bfc268-2c23-489c-b61e-95950ba6e74c@14130@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1369-0'
00000100:00000001:23.0:1773851852.456243:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851852.456244:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851852.456245:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1c8a557 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:79bfc268-2c23-489c-b61e-95950ba6e74c+6:39824:x1858040401360192:12345-14130@kfi7:400:default-tuolumne1369-0
00000100:00000200:23.0:1773851852.456247:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040401360192
00000020:00000001:23.0:1773851852.456248:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851852.456249:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851852.456250:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.456251:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851852.456252:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851852.456253:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851852.456254:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040401360192, found 0 last_xid 1858040401360191
00000020:00000001:23.0:1773851852.456255:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851852.456256:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851852.456257:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851852.456257:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.456259:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851852.456260:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851852.456261:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851852.456262:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001adae866.
02000000:00000001:23.0:1773851852.456263:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.456264:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.456265:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851852.456266:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693973, transno 0, xid 1858040401360192
00010000:00000001:23.0:1773851852.456268:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851852.456269:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f1c8a557 x1858040401360192/t0(0) o400->79bfc268-2c23-489c-b61e-95950ba6e74c@14130@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1369-0'
00010000:00000001:23.0:1773851852.456273:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851852.456274:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851852.456275:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=85 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851852.456276:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851852.456278:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce3ef0a7 refcount 3 to 14130@kfi7
00000100:00000001:23.0:1773851852.456279:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214304 : -107155106337312 : ffff9e8b01f36de0)
02000000:00000001:23.0:1773851852.456280:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851852.456281:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.456282:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851852.456283:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14323@kfi7
00000400:00000010:23.0:1773851852.456284:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a342ba58.
00000100:00000200:23.0:1773851852.456285:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040401360192, offset 224
00000400:00000200:23.0:1773851852.456288:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14323@kfi7
00000400:00000200:23.0:1773851852.456289:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.456290:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 1
00000400:00000200:23.0:1773851852.456292:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000400:00000200:23.0:1773851852.456294:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 3
00000400:00000200:23.0:1773851852.456295:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14323@kfi7 local destination
00000400:00000200:23.0:1773851852.456297:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768522:8768522:1024:4294967295] 14323@kfi7 LPNI seq info [8496373:8496373:16:4294967295]
00000400:00000200:23.0:1773851852.456300:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000400:00000200:23.0:1773851852.456301:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.456304:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14323@kfi7(14323@kfi7:14323@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851852.456307:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 3
00000800:00000200:23.0:1773851852.456309:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851852.456311:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851852.456314:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851852.456318:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000026b Using peer 14323@kfi7(0x10000000000026b)
00000800:00000200:23.0:1773851852.456323:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0x10000000000026b: rc=0
00000800:00000200:23.0:1773851852.456325:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000026b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851852.456328:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851852.456329:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce3ef0a7 refcount 2 to 14130@kfi7
00010000:00000001:23.0:1773851852.456330:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851852.456331:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.456332:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851852.456333:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1c8a557 x1858040401360192/t0(0) o400->79bfc268-2c23-489c-b61e-95950ba6e74c@14130@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1369-0'
00000800:00000200:21.0:1773851852.456338:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000026b TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851852.456339:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1c8a557 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:79bfc268-2c23-489c-b61e-95950ba6e74c+6:39824:x1858040401360192:12345-14130@kfi7:400:default-tuolumne1369-0 Request processed in 95us (144us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851852.456341:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851852.456343:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14130@kfi7, seq: 1997919
00000400:00000200:21.0:1773851852.456343:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14323@kfi7: PUT: OK
00000100:00000040:23.0:1773851852.456344:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002183a2bb : new rpc_count 0
00000400:00000200:21.0:1773851852.456344:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a342ba58
00000100:00000001:23.0:1773851852.456345:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:21.0:1773851852.456345:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a342ba58.
00000100:00000001:23.0:1773851852.456346:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:21.0:1773851852.456346:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851852.456347:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851852.456347:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851852.456348:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851852.456348:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000020:00000010:23.0:1773851852.456349:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e556a1b5.
00000020:00000040:23.0:1773851852.456350:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000002183a2bb : new refcount 5
00000800:00000200:21.0:1773851852.456350:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14323@kfi7(00000000963ea343):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000026b Transaction freed
00000100:00000001:23.0:1773851852.456351:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000010:1.1:1773851852.459727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000dc455f59.
00000800:00000200:9.0:1773851852.474985:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851852.474986:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851852.474987:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851852.474989:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851852.474991:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851852.474993:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.160@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851852.474994:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851852.474994:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851852.474995:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.160@o2ib600 to cpt 1
00000400:00000200:9.0:1773851852.474997:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 2
00000400:00000200:9.0:1773851852.474998:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 3
00000400:00000200:9.0:1773851852.474999:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.160@o2ib600 to cpt 1
00000400:00000200:9.0:1773851852.475001:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.160@o2ib600 of length 224 into portal 12 MB=0x699f27899f8c0
00000400:00000200:9.0:1773851852.475002:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.160@o2ib600 of length 224/224 into md 0x793926dc5 [64] + 116688
00000800:00000200:9.0:1773851852.475004:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851852.475006:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851852.475007:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851852.475008:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851852.475008:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851852.475009:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c33d7c3d.
00000100:00000040:9.0:1773851852.475010:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c33d7c3d x1858116544755904 msgsize 224
00000100:00100000:9.0:1773851852.475013:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.160@o2ib600 (source: 12345-172.19.3.160@o2ib600)
00000100:00000001:9.0:1773851852.475015:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851852.475016:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851852.475017:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851852.475018:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851852.475018:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851852.475019:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851852.475019:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.475020:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851852.475021:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858116544755904
00000020:00000001:7.0:1773851852.475022:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851852.475022:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dc9
00000020:00000001:7.0:1773851852.475023:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851852.475024:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000568dff62 refcount=6
00000020:00000001:7.0:1773851852.475024:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239491584 : -107152470060032 : ffff9e8b9f15d400)
00000020:00000001:7.0:1773851852.475025:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239491584 : -107152470060032 : ffff9e8b9f15d400)
00000100:00000001:7.0:1773851852.475026:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851852.475027:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851852.475028:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ac9a4ff4.
00000020:00000010:7.0:1773851852.475029:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851852.475030:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ee82f04.
00000100:00000001:7.0:1773851852.475031:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851852.475031:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851852.475032:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.475033:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851852.475033:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851852.475033:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.475035:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.475036:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851852.475037:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851852.475038:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.160@o2ib600, seq: 2001846
00000100:00000001:5.0:1773851852.475038:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:7.0:1773851852.475039:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000568dff62 : new rpc_count 1
00000100:00000001:7.0:1773851852.475039:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792159360 : -106938917392256 : ffff9ebd57d0f080)
00000100:00000001:5.0:1773851852.475039:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851852.475040:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.475041:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c33d7c3d x1858116544755904/t0(0) o400->f325ba5a-1c96-4e56-b14b-2dc6339836bd@172.19.3.160@o2ib600:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic10-0'
00000100:00000001:5.0:1773851852.475041:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.475044:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851852.475044:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851852.475045:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c33d7c3d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:f325ba5a-1c96-4e56-b14b-2dc6339836bd+6:24918:x1858116544755904:12345-172.19.3.160@o2ib600:400:default-oslic10-0
00000100:00000200:7.0:1773851852.475047:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858116544755904
00000020:00000001:7.0:1773851852.475047:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851852.475048:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851852.475049:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.475049:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851852.475050:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851852.475051:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851852.475051:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858116544755904, found 0 last_xid 1858116544755903
00000020:00000001:7.0:1773851852.475052:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851852.475053:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851852.475053:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851852.475054:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.475055:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851852.475055:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851852.475056:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851852.475056:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000090a6c2c5.
02000000:00000001:7.0:1773851852.475057:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.475058:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.475058:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851852.475059:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183211359502, transno 0, xid 1858116544755904
00010000:00000001:7.0:1773851852.475060:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851852.475061:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c33d7c3d x1858116544755904/t0(0) o400->f325ba5a-1c96-4e56-b14b-2dc6339836bd@172.19.3.160@o2ib600:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic10-0'
00010000:00000001:7.0:1773851852.475063:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851852.475064:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851852.475065:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=84 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851852.475066:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851852.475067:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f41b0213 refcount 3 to 172.19.3.160@o2ib600
00000100:00000001:7.0:1773851852.475067:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074951456 : -107155634600160 : ffff9e8ae276c720)
02000000:00000001:7.0:1773851852.475068:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851852.475069:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.475069:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851852.475070:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.160@o2ib600
00000400:00000010:7.0:1773851852.475071:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d794ea.
00000100:00000200:7.0:1773851852.475072:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858116544755904, offset 224
00000400:00000200:7.0:1773851852.475073:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.160@o2ib600
00000400:00000200:7.0:1773851852.475074:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.160@o2ib600 to cpt 1
00000400:00000200:7.0:1773851852.475075:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 2
00000400:00000200:7.0:1773851852.475077:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 3
00000400:00000200:7.0:1773851852.475078:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 4
00000400:00000200:7.0:1773851852.475079:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.160@o2ib600 routed destination
00000400:00000200:7.0:1773851852.475081:0:61015:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851852.475082:0:61015:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:7.0:1773851852.475083:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.160@o2ib600: rtr pref emtpy: 1
00000400:00000200:7.0:1773851852.475085:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851852.475086:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.160@o2ib600: rtr pref emtpy: 1
00000400:00000200:7.0:1773851852.475086:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851852.475087:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768523:8768523:1024:4294967295] 2094@kfi7 LPNI seq info [1258746980:1258746980:16:4294967295]
00000400:00000200:7.0:1773851852.475089:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:7.0:1773851852.475089:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:7.0:1773851852.475092:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.160@o2ib600(172.19.3.160@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851852.475094:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 3
00000800:00000200:7.0:1773851852.475095:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851852.475096:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851852.475099:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851852.475101:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:7.0:1773851852.475104:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:7.0:1773851852.475105:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851852.475107:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.475108:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f41b0213 refcount 2 to 172.19.3.160@o2ib600
00010000:00000001:7.0:1773851852.475109:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851852.475109:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.475110:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851852.475111:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c33d7c3d x1858116544755904/t0(0) o400->f325ba5a-1c96-4e56-b14b-2dc6339836bd@172.19.3.160@o2ib600:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic10-0'
00000100:00100000:7.0:1773851852.475114:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c33d7c3d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:f325ba5a-1c96-4e56-b14b-2dc6339836bd+6:24918:x1858116544755904:12345-172.19.3.160@o2ib600:400:default-oslic10-0 Request processed in 69us (103us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851852.475116:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.160@o2ib600, seq: 2001846
00000100:00000040:7.0:1773851852.475117:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000568dff62 : new rpc_count 0
00000800:00000200:5.0:1773851852.475117:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851852.475118:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851852.475118:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851852.475118:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851852.475119:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ee82f04.
00000020:00000010:7.0:1773851852.475120:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ac9a4ff4.
00000400:00000200:5.0:1773851852.475120:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851852.475121:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000568dff62 : new refcount 5
00000100:00000001:7.0:1773851852.475121:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851852.475122:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:5.0:1773851852.475123:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d794ea
00000400:00000010:5.0:1773851852.475124:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d794ea.
00000100:00000001:5.0:1773851852.475125:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851852.475126:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851852.475128:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:5.0:1773851852.475130:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Transaction freed
00000800:00000200:21.0:1773851852.478888:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851852.478889:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851852.478890:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851852.478892:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851852.478894:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.478895:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23761@kfi7 : PUT - for me
00000400:00000200:21.0:1773851852.478896:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.478896:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 1
00000400:00000200:21.0:1773851852.478898:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.478898:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000400:00000200:21.0:1773851852.478899:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 3
00000400:00000200:21.0:1773851852.478900:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23568@kfi7 to cpt 7
00000400:00000200:21.0:1773851852.478901:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23568@kfi7 of length 224 into portal 12 MB=0x699e175ec7c80
00000400:00000200:21.0:1773851852.478902:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23568@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 22240
00000800:00000200:21.0:1773851852.478904:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851852.478906:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851852.478907:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23761@kfi7: PUT: OK
00000100:00000001:21.0:1773851852.478908:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851852.478909:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851852.478909:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cee1b1a0.
00000100:00000040:21.0:1773851852.478910:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000cee1b1a0 x1858043485387904 msgsize 224
00000100:00100000:21.0:1773851852.478912:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23568@kfi7 (source: 12345-23761@kfi7)
00000100:00000001:21.0:1773851852.478913:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851852.478914:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851852.478914:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
02000000:00000001:23.0:1773851852.478915:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851852.478915:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851852.478916:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851852.478916:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851852.478917:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851852.478918:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043485387904
00000020:00000001:23.0:1773851852.478918:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851852.478919:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916ac
00000020:00000001:23.0:1773851852.478919:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851852.478922:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002da1a89e refcount=6
00000020:00000001:23.0:1773851852.478923:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241268224 : -107152468283392 : ffff9e8b9f30f000)
00000020:00000001:23.0:1773851852.478924:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241268224 : -107152468283392 : ffff9e8b9f30f000)
00000100:00000001:23.0:1773851852.478925:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851852.478926:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851852.478926:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e556a1b5.
00000020:00000010:23.0:1773851852.478927:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851852.478928:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851852.478929:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851852.478929:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851852.478930:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.478931:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851852.478931:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851852.478931:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.478932:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.478933:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851852.478934:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851852.478934:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.478934:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851852.478935:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23568@kfi7, seq: 1997920
00000100:00000040:23.0:1773851852.478935:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002da1a89e : new rpc_count 1
00000100:00000001:22.0:1773851852.478935:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.478936:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117339392 : -106995592212224 : ffff9eb025bbd100)
00000100:00000001:22.0:1773851852.478936:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851852.478937:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cee1b1a0 x1858043485387904/t0(0) o400->aade71c6-4c41-45b6-86ac-ee2aaaf30341@23568@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1969-0'
00000100:00000001:23.0:1773851852.478940:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851852.478940:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851852.478941:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cee1b1a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:aade71c6-4c41-45b6-86ac-ee2aaaf30341+6:39789:x1858043485387904:12345-23568@kfi7:400:default-tuolumne1969-0
00000100:00000200:23.0:1773851852.478944:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043485387904
00000020:00000001:23.0:1773851852.478944:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851852.478945:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851852.478946:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.478946:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851852.478947:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851852.478948:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851852.478948:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043485387904, found 0 last_xid 1858043485387903
00000020:00000001:23.0:1773851852.478949:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851852.478949:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851852.478950:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851852.478950:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.478951:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851852.478952:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851852.478952:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851852.478953:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b547314f.
02000000:00000001:23.0:1773851852.478953:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.478954:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.478955:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851852.478955:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044150185, transno 0, xid 1858043485387904
00010000:00000001:23.0:1773851852.478956:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851852.478957:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cee1b1a0 x1858043485387904/t0(0) o400->aade71c6-4c41-45b6-86ac-ee2aaaf30341@23568@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1969-0'
00010000:00000001:23.0:1773851852.478959:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851852.478960:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851852.478960:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=85 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851852.478961:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851852.478962:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd4ac1c6 refcount 3 to 23568@kfi7
00000100:00000001:23.0:1773851852.478963:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063456 : -107155994488160 : ffff9e8acd0352a0)
02000000:00000001:23.0:1773851852.478963:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851852.478964:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.478965:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851852.478965:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23761@kfi7
00000400:00000010:23.0:1773851852.478966:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000598e4ceb.
00000100:00000200:23.0:1773851852.478967:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043485387904, offset 224
00000400:00000200:23.0:1773851852.478968:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23761@kfi7
00000400:00000200:23.0:1773851852.478969:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.478970:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 1
00000400:00000200:23.0:1773851852.478971:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000400:00000200:23.0:1773851852.478972:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 3
00000400:00000200:23.0:1773851852.478974:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23761@kfi7 local destination
00000400:00000200:23.0:1773851852.478975:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768524:8768524:1024:4294967295] 23761@kfi7 LPNI seq info [1164133:1164133:16:4294967295]
00000400:00000200:23.0:1773851852.478976:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000400:00000200:23.0:1773851852.478977:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.478979:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23761@kfi7(23761@kfi7:23761@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851852.478980:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 3
00000800:00000200:23.0:1773851852.478981:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851852.478982:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851852.478984:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851852.478986:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x231 Using peer 23761@kfi7(0x231)
00000800:00000200:23.0:1773851852.478989:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x231: rc=0
00000800:00000200:23.0:1773851852.478990:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x231 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851852.478992:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851852.478993:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd4ac1c6 refcount 2 to 23568@kfi7
00010000:00000001:23.0:1773851852.478994:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851852.478994:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.478995:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851852.478996:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cee1b1a0 x1858043485387904/t0(0) o400->aade71c6-4c41-45b6-86ac-ee2aaaf30341@23568@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1969-0'
00000100:00100000:23.0:1773851852.478998:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cee1b1a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:aade71c6-4c41-45b6-86ac-ee2aaaf30341+6:39789:x1858043485387904:12345-23568@kfi7:400:default-tuolumne1969-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851852.479001:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23568@kfi7, seq: 1997920
00000100:00000040:23.0:1773851852.479002:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002da1a89e : new rpc_count 0
00000100:00000001:23.0:1773851852.479002:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851852.479002:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x231 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851852.479003:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851852.479003:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851852.479004:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851852.479004:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851852.479005:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e556a1b5.
00000400:00000200:21.0:1773851852.479005:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23761@kfi7: PUT: OK
00000020:00000040:23.0:1773851852.479006:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000002da1a89e : new refcount 5
00000400:00000200:21.0:1773851852.479006:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000598e4ceb
00000400:00000010:21.0:1773851852.479006:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000598e4ceb.
00000100:00000001:23.0:1773851852.479007:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851852.479007:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851852.479007:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851852.479008:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000800:00000200:21.0:1773851852.479010:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 23761@kfi7(00000000290185c0):0x0 lsk 562 rsk 60 tsk 0 trmk 0 tmk 0 trr 5 tta 0x231 Transaction freed
00000004:00000001:31.0:1773851852.617730:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851852.617730:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851852.617731:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:31.0:1773851852.617731:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000182ebf41.
00000004:00000020:30.0:1773851852.617731:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851852.617731:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031392470.
00000020:00000040:31.0:1773851852.617732:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000020:00000040:30.0:1773851852.617732:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000004:00000001:10.0:1773851852.617732:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:9.0:1773851852.617732:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851852.617732:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851852.617732:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:31.0:1773851852.617733:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851852.617733:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851852.617733:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:10.0:1773851852.617733:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:9.0:1773851852.617733:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:7.0:1773851852.617733:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:5.0:1773851852.617733:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002710aeb3.
02000000:00000001:31.0:1773851852.617734:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:31.0:1773851852.617734:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851852.617734:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:10.0:1773851852.617734:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009d0add5.
00000020:00000040:10.0:1773851852.617734:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000100:00000010:9.0:1773851852.617734:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006d139e4f.
00000004:00000020:7.0:1773851852.617734:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851852.617734:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc290a1f.
00000004:00000001:6.0:1773851852.617734:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851852.617734:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:5.0:1773851852.617734:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
02000000:00000010:31.0:1773851852.617735:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000012eaad24.
02000000:00000010:30.0:1773851852.617735:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a709584c.
00000100:00000001:10.0:1773851852.617735:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:9.0:1773851852.617735:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000020:00000040:7.0:1773851852.617735:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000010:6.0:1773851852.617735:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000876bb723.
00000020:00000040:6.0:1773851852.617735:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000100:00000001:5.0:1773851852.617735:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851852.617735:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:31.0:1773851852.617736:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851852.617736:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851852.617736:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851852.617736:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.617736:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:9.0:1773851852.617736:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:7.0:1773851852.617736:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851852.617736:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851852.617737:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851852.617737:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851852.617737:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851852.617737:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.617737:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851852.617737:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851852.617737:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:31.0:1773851852.617738:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851852.617738:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000031392470] to pc [ptlrpcd_07_01+1]  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:10.0:1773851852.617738:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000068b7b641.
02000000:00000001:7.0:1773851852.617738:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851852.617738:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851852.617738:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000097fed2c.
00000100:00000040:31.0:1773851852.617739:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000182ebf41] to pc [ptlrpcd_07_02+2]  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851852.617739:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851852.617739:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000010:7.0:1773851852.617739:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000607a30e5.
02000000:00000010:6.0:1773851852.617739:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004acfe469.
00000100:00000001:5.0:1773851852.617739:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.617740:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851852.617740:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617740:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617740:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.617740:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851852.617741:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.617741:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851852.617741:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851852.617741:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851852.617741:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851852.617742:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000009d0add5] to pc [ptlrpcd_02_03+3]  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851852.617742:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617742:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617742:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851852.617742:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002710aeb3] to pc [ptlrpcd_01_00+0]  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851852.617743:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:30.0:1773851852.617743:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.617743:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000cc290a1f] to pc [ptlrpcd_01_01+1]  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851852.617744:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006d139e4f] to pc [ptlrpcd_02_00+0]  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851852.617744:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000876bb723] to pc [ptlrpcd_01_02+2]  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:31.0:1773851852.617745:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000db073834.
00080000:00000001:31.0:1773851852.617745:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636967454022656 : -107106255528960 : ffff9e9661af9c00)
00000100:00000001:29.0:1773851852.617745:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851852.617745:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851852.617745:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851852.617745:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:31.0:1773851852.617746:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:29.0:1773851852.617746:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:28.0:1773851852.617746:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:10.0:1773851852.617746:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:31.0:1773851852.617747:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.617747:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851852.617747:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851852.617747:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:10.0:1773851852.617747:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d92ace2a.
00000004:00001000:31.0:1773851852.617748:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000004:00000010:31.0:1773851852.617748:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001b15b694.
00000100:00000001:30.0:1773851852.617748:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851852.617748:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.617748:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851852.617748:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:10.0:1773851852.617748:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637140472667136 : -106933236884480 : ffff9ebeaa669c00)
00000100:00000001:8.0:1773851852.617748:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:7.0:1773851852.617748:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851852.617748:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851852.617748:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00080000:31.0:1773851852.617749:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614127071024541ns, next at 614128071023659ns, rc = 0
00000100:00000040:11.0:1773851852.617749:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851852.617749:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:9.0:1773851852.617749:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851852.617749:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851852.617749:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851852.617749:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851852.617749:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:31.0:1773851852.617750:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:29.0:1773851852.617750:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851852.617750:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617750:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851852.617750:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851852.617750:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:9.0:1773851852.617750:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ba3e4e94.
00080000:00000010:5.0:1773851852.617750:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000061b05f5a.
00080000:00000001:5.0:1773851852.617750:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637134827266048 : -106938882285568 : ffff9ebd59e8a000)
00000100:00000040:4.0:1773851852.617750:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851852.617751:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851852.617751:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851852.617751:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:29.0:1773851852.617751:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:10.0:1773851852.617751:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00080000:00000001:9.0:1773851852.617751:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637046893382656 : -107026816168960 : ffff9ea8e0a40c00)
00000100:00000001:30.0:1773851852.617752:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.617752:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851852.617752:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851852.617752:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.617752:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851852.617752:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:10.0:1773851852.617752:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009f74560e.
00000004:00080000:10.0:1773851852.617752:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614127071027737ns, next at 614128071026835ns, rc = 0
00080000:00000001:9.0:1773851852.617752:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:8.0:1773851852.617752:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:8.0:1773851852.617752:0:41069:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:7.0:1773851852.617752:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851852.617752:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:29.0:1773851852.617753:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000182ebf41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051922176:60@kfi7:13:default-yuba2-0
02000000:00000001:11.0:1773851852.617753:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:10.0:1773851852.617753:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:9.0:1773851852.617753:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.617753:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.617753:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851852.617753:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851852.617753:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851852.617753:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.617754:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00100000:28.0:1773851852.617754:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031392470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051922112:13@kfi7:41:default-yuba2-0
02000000:00000001:11.0:1773851852.617754:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851852.617754:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:9.0:1773851852.617754:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:8.0:1773851852.617754:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851852.617754:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851852.617754:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:6.0:1773851852.617754:0:41067:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:6.0:1773851852.617754:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00001000:5.0:1773851852.617754:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000100:00000001:4.0:1773851852.617754:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851852.617754:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.617755:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851852.617755:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617755:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00100000:11.0:1773851852.617755:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051922304:37@kfi7:13:default-yuba2-0
00000004:00000001:10.0:1773851852.617755:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:9.0:1773851852.617755:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b6e55836.
00000100:00000001:8.0:1773851852.617755:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851852.617755:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000010:5.0:1773851852.617755:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ea635e07.
02000000:00000001:4.0:1773851852.617755:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851852.617756:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:28.0:1773851852.617756:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851852.617756:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:9.0:1773851852.617756:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614127071031534ns, next at 614128071030262ns, rc = 0
00000100:00000001:8.0:1773851852.617756:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851852.617756:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851852.617756:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000004:00080000:5.0:1773851852.617756:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614127071031123ns, next at 614128071029921ns, rc = 0
02000000:00000001:4.0:1773851852.617756:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851852.617757:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002cae99cb.
02000000:00000001:29.0:1773851852.617757:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851852.617757:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:28.0:1773851852.617757:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ec11d2f7.
00000100:00000001:11.0:1773851852.617757:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:9.0:1773851852.617757:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:8.0:1773851852.617757:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851852.617757:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851852.617757:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617757:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851852.617757:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851852.617757:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:4.0:1773851852.617757:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002710aeb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051922240:2061@kfi7:13:default-yuba2-0
02000000:00000001:28.0:1773851852.617758:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851852.617758:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851852.617758:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851852.617758:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.617758:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:6.0:1773851852.617758:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851852.617758:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851852.617759:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000010:29.0:1773851852.617759:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000027eae465.
02000000:00000001:11.0:1773851852.617759:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:10.0:1773851852.617759:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:9.0:1773851852.617759:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.617759:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851852.617759:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:5.0:1773851852.617759:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851852.617759:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851852.617759:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:29.0:1773851852.617760:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f6d59d8b.
00000400:00000200:28.0:1773851852.617760:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:28.0:1773851852.617760:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
02000000:00000010:11.0:1773851852.617760:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a276050b.
00000100:00000001:10.0:1773851852.617760:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.617760:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851852.617760:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851852.617760:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc290a1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051922432:2074@kfi7:41:default-yuba2-0
02000000:00000001:4.0:1773851852.617760:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851852.617761:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851852.617761:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851852.617761:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851852.617761:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851852.617761:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851852.617761:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008c84125c.
00000100:00000200:29.0:1773851852.617762:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922176, portal 4
00000400:00000010:28.0:1773851852.617762:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d3aa665.
00000400:00000200:11.0:1773851852.617762:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
02000000:00000001:8.0:1773851852.617762:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.617762:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.617762:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:6.0:1773851852.617762:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851852.617762:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.617762:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:4.0:1773851852.617762:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.617763:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851852.617763:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636970059004288 : -107103650547328 : ffff9e96fcf47980)
00000100:00000200:28.0:1773851852.617763:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922112, portal 4
00000100:00000001:28.0:1773851852.617763:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:11.0:1773851852.617763:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000400:00000010:11.0:1773851852.617763:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000100:00100000:8.0:1773851852.617763:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d139e4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051922368:2060@kfi7:13:default-yuba2-0
02000000:00000001:6.0:1773851852.617763:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:5.0:1773851852.617763:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851852.617763:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000010:4.0:1773851852.617763:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000100:00000001:28.0:1773851852.617764:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636973000839424 : -107100708712192 : ffff9e97ac4d5100)
02000000:00000010:7.0:1773851852.617764:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000556caab8.
02000000:00000001:6.0:1773851852.617764:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851852.617764:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000040:29.0:1773851852.617765:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851852.617765:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:11.0:1773851852.617765:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922304, portal 4
00000100:00000001:8.0:1773851852.617765:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851852.617765:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851852.617765:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000876bb723 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051922496:36@kfi7:13:default-yuba2-0
00000100:00000200:4.0:1773851852.617765:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922240, portal 4
00000100:00000001:11.0:1773851852.617766:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851852.617766:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077439616 : -106968632112000 : ffff9eb66cae4c80)
02000000:00000001:8.0:1773851852.617766:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851852.617766:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851852.617766:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000010:7.0:1773851852.617766:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000100:00000001:6.0:1773851852.617766:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:4.0:1773851852.617766:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851852.617767:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:8.0:1773851852.617767:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:7.0:1773851852.617767:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
02000000:00000001:6.0:1773851852.617767:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851852.617767:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851852.617767:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637133046226816 : -106940663324800 : ffff9ebcefc01f80)
00000100:00000040:29.0:1773851852.617768:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000100:00000001:28.0:1773851852.617768:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851852.617768:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:8.0:1773851852.617768:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000db30ef3a.
00000100:00000200:7.0:1773851852.617768:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922432, portal 4
02000000:00000001:6.0:1773851852.617768:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:29.0:1773851852.617769:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dee493e9.
00000100:00000040:28.0:1773851852.617769:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:28.0:1773851852.617769:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fbb7163e.
02000000:00000001:8.0:1773851852.617769:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617769:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851852.617769:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309143168 : -106994400408448 : ffff9eb06cc54c80)
02000000:00000010:6.0:1773851852.617769:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005041e9c5.
00000100:00000040:4.0:1773851852.617769:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851852.617770:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922176, offset 0
00000100:00000200:28.0:1773851852.617770:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051922112, offset 0
00000400:00000200:8.0:1773851852.617770:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000010:8.0:1773851852.617770:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000100:00000040:7.0:1773851852.617770:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851852.617770:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851852.617771:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000100:00000001:11.0:1773851852.617771:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:8.0:1773851852.617771:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000b6b4cce.
00000400:00000200:6.0:1773851852.617771:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:6.0:1773851852.617771:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:4.0:1773851852.617771:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:29.0:1773851852.617772:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000040:11.0:1773851852.617772:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000100:00000200:8.0:1773851852.617772:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922368, portal 4
00000100:00000040:4.0:1773851852.617772:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000200:28.0:1773851852.617773:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000010:11.0:1773851852.617773:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008f5867f4.
00000100:00000001:8.0:1773851852.617773:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851852.617773:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851852.617773:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:6.0:1773851852.617773:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4270b1f.
00000400:00000010:4.0:1773851852.617773:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009ae139dd.
00000100:00000200:4.0:1773851852.617773:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922240, offset 0
00000400:00000200:29.0:1773851852.617774:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:29.0:1773851852.617774:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000200:11.0:1773851852.617774:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922304, offset 0
00000100:00000001:8.0:1773851852.617774:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637134792135168 : -106938917416448 : ffff9ebd57d09200)
00000400:00000010:7.0:1773851852.617774:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c448bd40.
00000100:00000200:6.0:1773851852.617774:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922496, portal 4
00000400:00000200:11.0:1773851852.617775:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000100:00000040:8.0:1773851852.617775:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851852.617775:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851852.617775:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637127092536448 : -106946617015168 : ffff9ebb8ce20480)
00000400:00000200:4.0:1773851852.617775:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:29.0:1773851852.617776:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000200:7.0:1773851852.617776:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051922432, offset 0
00000400:00000200:4.0:1773851852.617776:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.617777:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:11.0:1773851852.617777:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851852.617777:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000100:00000040:6.0:1773851852.617777:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851852.617777:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:11.0:1773851852.617778:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000001:8.0:1773851852.617778:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851852.617778:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:29.0:1773851852.617779:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768524, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768523, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851852.617779:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000040:8.0:1773851852.617779:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:8.0:1773851852.617779:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc2dfd46.
00000400:00000200:29.0:1773851852.617780:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000200:8.0:1773851852.617780:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922368, offset 0
00000100:00000001:6.0:1773851852.617780:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851852.617780:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:29.0:1773851852.617781:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851852.617781:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000040:6.0:1773851852.617781:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000200:4.0:1773851852.617781:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000400:00000200:29.0:1773851852.617782:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:11.0:1773851852.617782:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000400:00000200:8.0:1773851852.617782:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000010:6.0:1773851852.617782:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c906ec4e.
00000400:00000200:4.0:1773851852.617782:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768524, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768523, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851852.617783:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768525:8768525:1024:4294967295] 60@kfi7 LPNI seq info [5404305:5404305:16:4294967295]
00000100:00000200:6.0:1773851852.617783:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922496, offset 0
00000400:00000200:11.0:1773851852.617784:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768524, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768525, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851852.617784:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:29.0:1773851852.617785:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:4.0:1773851852.617785:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851852.617786:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:11.0:1773851852.617786:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851852.617786:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851852.617787:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:11.0:1773851852.617787:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851852.617787:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000400:00000200:28.0:1773851852.617788:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:11.0:1773851852.617788:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000200:4.0:1773851852.617788:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768526:8768526:1024:4294967295] 2061@kfi7 LPNI seq info [5403456:5403456:16:4294967295]
00000400:00000200:29.0:1773851852.617789:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851852.617789:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:11.0:1773851852.617789:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768527:8768527:1024:4294967295] 37@kfi7 LPNI seq info [5403390:5403390:16:4294967295]
00000400:00000200:29.0:1773851852.617790:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:28.0:1773851852.617790:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:4.0:1773851852.617790:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:28.0:1773851852.617791:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:11.0:1773851852.617791:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:4.0:1773851852.617791:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:29.0:1773851852.617792:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:11.0:1773851852.617792:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851852.617792:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:29.0:1773851852.617793:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851852.617793:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768527, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768525, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851852.617793:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:7.0:1773851852.617793:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:8.0:1773851852.617794:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:7.0:1773851852.617794:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851852.617795:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851852.617795:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851852.617795:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:7.0:1773851852.617795:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851852.617796:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851852.617797:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851852.617797:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:7.0:1773851852.617797:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000800:00000200:29.0:1773851852.617798:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Using peer 60@kfi7(0x2000000000001dc)
00000400:00000200:28.0:1773851852.617798:0:41089:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133309, 23133308]
00000400:00000200:8.0:1773851852.617798:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000200:7.0:1773851852.617798:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768527, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768525, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851852.617800:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768527, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768525, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851852.617800:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:29.0:1773851852.617801:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x2000000000001dc: rc=0
00000400:00000200:28.0:1773851852.617801:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000400:00000200:7.0:1773851852.617801:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000400:00000200:28.0:1773851852.617802:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768528:8768528:1024:4294967295] 13@kfi7 LPNI seq info [23133310:23133310:16:4294967295]
00000400:00000200:8.0:1773851852.617802:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851852.617802:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:29.0:1773851852.617803:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851852.617803:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:8.0:1773851852.617803:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:29.0:1773851852.617804:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851852.617804:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:8.0:1773851852.617804:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000400:00000200:7.0:1773851852.617804:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425159, 23425160]
00000100:00000001:29.0:1773851852.617805:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:8.0:1773851852.617805:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768529:8768529:1024:4294967295] 2060@kfi7 LPNI seq info [5404990:5404990:16:4294967295]
00000100:00000001:29.0:1773851852.617806:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.617806:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851852.617806:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000100:00000001:29.0:1773851852.617807:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:8.0:1773851852.617807:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:7.0:1773851852.617807:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768530:8768530:1022:4294967295] 2081@kfi7 LPNI seq info [23425161:23425161:16:4294967295]
00000100:00000001:29.0:1773851852.617808:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851852.617808:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:28.0:1773851852.617808:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851852.617808:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:29.0:1773851852.617809:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:7.0:1773851852.617809:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:4.0:1773851852.617809:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000100:00000001:29.0:1773851852.617810:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851852.617810:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851852.617810:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:4.0:1773851852.617810:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:29.0:1773851852.617811:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851852.617811:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:8.0:1773851852.617811:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851852.617811:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:8.0:1773851852.617812:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:6.0:1773851852.617812:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000800:00000200:4.0:1773851852.617812:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:6.0:1773851852.617813:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:4.0:1773851852.617813:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851852.617814:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851852.617814:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:6.0:1773851852.617814:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:11.0:1773851852.617815:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:7.0:1773851852.617815:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851852.617815:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000800:00000200:8.0:1773851852.617816:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851852.617816:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851852.617817:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:7.0:1773851852.617817:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851852.617818:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_EVENT_TX_OK event status 0
00000800:00000200:28.0:1773851852.617818:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:8.0:1773851852.617818:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851852.617818:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1019, d:10, s:8768530, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768525, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851852.617819:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:28.0:1773851852.617819:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851852.617819:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851852.617819:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851852.617819:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000400:00000200:29.0:1773851852.617820:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000800:00000200:7.0:1773851852.617820:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851852.617820:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851852.617821:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dee493e9
00000800:00000200:11.0:1773851852.617821:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851852.617821:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Using peer 2060@kfi7(0x1c0)
00000400:00000200:6.0:1773851852.617821:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000010:29.0:1773851852.617822:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dee493e9.
00000100:00000001:29.0:1773851852.617822:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:28.0:1773851852.617822:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851852.617822:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000800:00000200:4.0:1773851852.617822:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x19b: rc=0
00000100:00000200:29.0:1773851852.617823:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:7.0:1773851852.617823:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851852.617823:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768531:8768531:1023:4294967295] 36@kfi7 LPNI seq info [5403963:5403963:16:4294967295]
00000800:00000200:8.0:1773851852.617824:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x1c0: rc=0
00000800:00000200:4.0:1773851852.617824:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:28.0:1773851852.617825:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:11.0:1773851852.617825:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000400:00000200:6.0:1773851852.617825:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:29.0:1773851852.617826:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851852.617826:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851852.617826:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851852.617826:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Using peer 2081@kfi7(0x270)
00000400:00000200:6.0:1773851852.617826:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:4.0:1773851852.617826:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851852.617827:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851852.617828:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.617828:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851852.617828:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000100:00000001:4.0:1773851852.617828:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.617829:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.617829:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:28.0:1773851852.617829:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x102: rc=0
00000100:00000001:8.0:1773851852.617829:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851852.617829:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x270: rc=0
00000400:00000200:29.0:1773851852.617830:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:11.0:1773851852.617830:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x1a3: rc=0
00000400:00000200:6.0:1773851852.617830:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:4.0:1773851852.617830:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851852.617831:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851852.617831:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.617831:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851852.617831:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851852.617831:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:4.0:1773851852.617831:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851852.617832:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Transaction freed
00000100:00000001:4.0:1773851852.617832:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851852.617832:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:11.0:1773851852.617833:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851852.617833:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851852.617833:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:4.0:1773851852.617833:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851852.617833:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851852.617834:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617834:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851852.617834:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617835:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851852.617835:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.617835:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617835:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851852.617835:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:28.0:1773851852.617836:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.617836:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:9.0:1773851852.617836:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851852.617836:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851852.617837:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851852.617837:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851852.617837:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851852.617837:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:28.0:1773851852.617838:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851852.617838:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851852.617838:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851852.617838:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851852.617838:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851852.617838:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:6.0:1773851852.617838:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000100:00000001:11.0:1773851852.617839:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851852.617839:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:9.0:1773851852.617839:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000100:00000001:7.0:1773851852.617839:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617839:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851852.617839:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851852.617840:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851852.617840:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:11.0:1773851852.617840:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851852.617840:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:10.0:1773851852.617840:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008f5867f4
00000400:00000010:10.0:1773851852.617840:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008f5867f4.
00000400:00000200:5.0:1773851852.617840:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851852.617840:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617841:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851852.617841:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851852.617841:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851852.617841:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:9.0:1773851852.617841:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc2dfd46
00000400:00000010:9.0:1773851852.617841:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc2dfd46.
00000800:00000200:6.0:1773851852.617841:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000100:00000001:4.0:1773851852.617841:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.617842:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851852.617842:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851852.617842:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851852.617842:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:5.0:1773851852.617842:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000400:00000200:5.0:1773851852.617842:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009ae139dd
00000100:00000001:11.0:1773851852.617843:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851852.617843:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:7.0:1773851852.617843:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851852.617843:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000010:5.0:1773851852.617843:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009ae139dd.
00000100:00000001:5.0:1773851852.617844:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851852.617845:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:7.0:1773851852.617845:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851852.617845:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617845:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:5.0:1773851852.617845:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851852.617846:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851852.617846:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851852.617846:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851852.617846:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000001:6.0:1773851852.617846:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851852.617847:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851852.617847:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851852.617847:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851852.617847:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c448bd40
00000400:00000010:7.0:1773851852.617847:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c448bd40.
00000100:00000001:7.0:1773851852.617848:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:5.0:1773851852.617848:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851852.617849:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851852.617849:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851852.617849:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851852.617849:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851852.617849:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617849:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851852.617849:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851852.617850:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000100:00000001:10.0:1773851852.617850:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851852.617850:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851852.617851:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fbb7163e
00000400:00000010:29.0:1773851852.617851:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fbb7163e.
00000400:00000200:10.0:1773851852.617851:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:9.0:1773851852.617851:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:5.0:1773851852.617851:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.617852:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:10.0:1773851852.617852:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000800:00000200:9.0:1773851852.617852:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Transaction freed
00000100:00000001:7.0:1773851852.617852:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851852.617852:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851852.617852:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:29.0:1773851852.617853:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851852.617853:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:5.0:1773851852.617854:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000100:00000001:29.0:1773851852.617855:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:21.0:1773851852.617855:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000001:7.0:1773851852.617855:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617855:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:29.0:1773851852.617856:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851852.617856:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:7.0:1773851852.617856:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:6.0:1773851852.617857:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851852.617858:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851852.617858:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:7.0:1773851852.617858:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Transaction freed
00000400:00000200:6.0:1773851852.617858:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851852.617859:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851852.617860:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:21.0:1773851852.617860:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851852.617860:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:6.0:1773851852.617860:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c906ec4e
00000800:00000200:29.0:1773851852.617861:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Transaction freed
00000400:00000010:6.0:1773851852.617861:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c906ec4e.
00000400:00000200:21.0:1773851852.617862:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:6.0:1773851852.617862:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851852.617862:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851852.617863:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 60@kfi7 : PUT - for me
00000400:00000200:21.0:1773851852.617864:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.617865:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000100:00000001:6.0:1773851852.617865:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851852.617866:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851852.617867:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.617867:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:21.0:1773851852.617868:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:21.0:1773851852.617869:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:6.0:1773851852.617869:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851852.617870:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1f00
00000100:00000001:6.0:1773851852.617870:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851852.617871:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:6.0:1773851852.617871:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:29.0:1773851852.617873:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:21.0:1773851852.617873:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d0315 [1] + 224
00000800:00000200:6.0:1773851852.617873:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:30.0:1773851852.617874:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:17.0:1773851852.617874:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:30.0:1773851852.617875:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.617875:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851852.617875:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851852.617875:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.617876:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851852.617876:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851852.617877:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851852.617877:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:30.0:1773851852.617879:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851852.617879:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:23.0:1773851852.617879:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851852.617879:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:21.0:1773851852.617879:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000800:00000200:17.0:1773851852.617879:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:23.0:1773851852.617880:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:21.0:1773851852.617880:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851852.617881:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:22.0:1773851852.617881:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:21.0:1773851852.617881:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851852.617881:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:23.0:1773851852.617882:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851852.617882:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000068d775d8: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851852.617883:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.617883:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000400:00000200:17.0:1773851852.617883:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2060@kfi7 : PUT - for me
00000400:00000200:30.0:1773851852.617884:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000800:00000200:23.0:1773851852.617884:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851852.617884:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:29.0:1773851852.617885:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:22.0:1773851852.617885:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000068d775d8: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:21.0:1773851852.617885:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851852.617885:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:29.0:1773851852.617886:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:17.0:1773851852.617886:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:29.0:1773851852.617887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:23.0:1773851852.617887:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:29.0:1773851852.617888:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:23.0:1773851852.617888:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:22.0:1773851852.617888:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:17.0:1773851852.617888:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:21.0:1773851852.617889:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851852.617889:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:29.0:1773851852.617890:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:23.0:1773851852.617890:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851852.617890:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000800:00000200:18.0:1773851852.617890:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:17.0:1773851852.617890:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:31.0:1773851852.617891:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851852.617891:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:23.0:1773851852.617891:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000800:00000200:18.0:1773851852.617891:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851852.617891:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1fc0
00000100:00000001:31.0:1773851852.617892:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851852.617892:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:23.0:1773851852.617892:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:17.0:1773851852.617892:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000001:31.0:1773851852.617893:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851852.617893:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:23.0:1773851852.617893:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:18.0:1773851852.617893:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:31.0:1773851852.617894:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000027eae465.
00000400:00000200:30.0:1773851852.617894:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:30.0:1773851852.617894:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:23.0:1773851852.617894:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:17.0:1773851852.617894:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f04d1 [1] + 224
00000400:00000200:31.0:1773851852.617895:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f6d59d8b
00000400:00000010:31.0:1773851852.617895:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f6d59d8b.
00000100:00000001:31.0:1773851852.617896:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851852.617896:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:21.0:1773851852.617896:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:18.0:1773851852.617896:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851852.617896:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:31.0:1773851852.617897:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851852.617897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851852.617897:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:17.0:1773851852.617897:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851852.617898:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.617898:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1f40
00000400:00000200:22.0:1773851852.617898:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000800:00000200:21.0:1773851852.617898:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851852.617898:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000400:00000200:30.0:1773851852.617899:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1f80
00000400:00000200:18.0:1773851852.617899:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000200:31.0:1773851852.617900:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851852.617900:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851852.617900:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:18.0:1773851852.617900:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000100:00000001:17.0:1773851852.617900:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851852.617901:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851852.617901:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000200:17.0:1773851852.617901:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851852.617902:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x78007f8bd [1] + 224
00000400:00000200:22.0:1773851852.617902:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:18.0:1773851852.617902:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:31.0:1773851852.617903:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:23.0:1773851852.617903:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:18.0:1773851852.617903:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000100:00000001:31.0:1773851852.617904:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:17.0:1773851852.617904:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851852.617905:0:41090:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:30.0:1773851852.617905:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x78007f89d [1] + 224
00000400:00000200:18.0:1773851852.617905:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
02000000:00000001:31.0:1773851852.617906:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851852.617906:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851852.617906:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851852.617906:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2000
00000400:00000200:22.0:1773851852.617906:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:18.0:1773851852.617906:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:31.0:1773851852.617907:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851852.617907:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851852.617907:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851852.617907:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b1ec0
00000400:00000200:18.0:1773851852.617907:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:17.0:1773851852.617907:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:31.0:1773851852.617908:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851852.617908:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:23.0:1773851852.617908:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00001000:31.0:1773851852.617909:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=85 v=66 (66 66 66 66)
00000400:00000200:29.0:1773851852.617909:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000400:00000200:22.0:1773851852.617909:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:17.0:1773851852.617909:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00001000:31.0:1773851852.617910:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=85 v=66 (1 1 1 1)
00000400:00000200:30.0:1773851852.617910:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:23.0:1773851852.617910:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78007f8dd [1] + 224
00000400:00000200:18.0:1773851852.617910:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:8.0:1773851852.617910:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851852.617910:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851852.617911:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:22.0:1773851852.617911:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d0335 [1] + 224
00000400:00000200:18.0:1773851852.617911:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2040
00000800:00000200:17.0:1773851852.617911:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851852.617912:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851852.617912:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851852.617912:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:8.0:1773851852.617912:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851852.617912:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:31.0:1773851852.617913:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851852.617913:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851852.617913:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851852.617913:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:23.0:1773851852.617913:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851852.617913:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000068d775d8: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851852.617913:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:8.0:1773851852.617913:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000100:00000001:31.0:1773851852.617914:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:8.0:1773851852.617914:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000b6b4cce
00000100:00000040:31.0:1773851852.617915:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000400:00000200:23.0:1773851852.617915:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851852.617915:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:8.0:1773851852.617915:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000b6b4cce.
00000100:00000001:31.0:1773851852.617916:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851852.617916:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851852.617916:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851852.617916:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:29.0:1773851852.617917:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851852.617917:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000400:00000200:22.0:1773851852.617917:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000200:18.0:1773851852.617917:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f04f1 [1] + 224
00000100:00000200:8.0:1773851852.617917:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851852.617918:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:22.0:1773851852.617918:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:23.0:1773851852.617919:0:2495434:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:22.0:1773851852.617919:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851852.617920:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851852.617920:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:18.0:1773851852.617920:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851852.617921:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:30.0:1773851852.617921:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:29.0:1773851852.617921:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:23.0:1773851852.617921:0:2495434:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851852.617921:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851852.617922:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851852.617922:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000001:31.0:1773851852.617923:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851852.617923:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000800:00000200:30.0:1773851852.617923:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:29.0:1773851852.617923:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000040:22.0:1773851852.617923:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851852.617923:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000040:31.0:1773851852.617924:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351238656 avail=351348434944 avail_mb=1372454824 hwm_mb=3131103 files=372084149 ffree=343116444 state=0: rc = 0
00000800:00000200:29.0:1773851852.617924:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:18.0:1773851852.617924:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000100:00000001:11.0:1773851852.617924:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851852.617924:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851852.617924:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851852.617924:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:23.0:1773851852.617925:0:2495434:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851852.617925:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851852.617925:0:41069:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:18.0:1773851852.617926:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:8.0:1773851852.617926:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000001:4.0:1773851852.617926:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851852.617926:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000020:31.0:1773851852.617927:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351238656 free, 351348434944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372084149 files, 343116444 free files
00000100:00000001:22.0:1773851852.617927:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851852.617927:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851852.617927:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851852.617927:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:22.0:1773851852.617928:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000200:18.0:1773851852.617928:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851852.617928:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851852.617928:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000004:00000001:31.0:1773851852.617929:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617929:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:23.0:1773851852.617929:0:2495434:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:8.0:1773851852.617929:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=85 v=66 (66 66 66 66)
00000400:00000010:4.0:1773851852.617929:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000040:31.0:1773851852.617930:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851852.617930:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:22.0:1773851852.617930:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000068d775d8: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:11.0:1773851852.617930:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:4.0:1773851852.617930:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:28.0:1773851852.617931:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851852.617931:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:8.0:1773851852.617931:0:41069:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=85 v=66 (1 1 1 1)
00000100:00000200:4.0:1773851852.617931:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:28.0:1773851852.617932:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851852.617932:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851852.617932:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851852.617932:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:31.0:1773851852.617933:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000182ebf41 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051922176:60@kfi7:13:default-yuba2-0
00000400:00000010:28.0:1773851852.617933:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000010:11.0:1773851852.617933:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000100:00000001:8.0:1773851852.617933:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851852.617934:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d3aa665
00000100:00000040:18.0:1773851852.617934:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851852.617934:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00010000:00000001:8.0:1773851852.617934:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851852.617934:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851852.617934:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851852.617935:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:28.0:1773851852.617935:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d3aa665.
00000100:00000001:8.0:1773851852.617935:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851852.617936:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:11.0:1773851852.617936:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000100:00000040:8.0:1773851852.617936:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000040:31.0:1773851852.617937:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000182ebf41 x1859433051922176/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851852.617937:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851852.617937:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851852.617937:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851852.617937:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851852.617938:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851852.617938:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000040:8.0:1773851852.617938:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:7.0:1773851852.617938:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851852.617938:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:11.0:1773851852.617939:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851852.617940:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000800:00000200:23.0:1773851852.617940:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851852.617940:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:7.0:1773851852.617940:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000400:00000200:7.0:1773851852.617940:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
02000000:00000001:31.0:1773851852.617941:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851852.617941:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002cae99cb.
00000100:00000200:28.0:1773851852.617941:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851852.617941:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:7.0:1773851852.617941:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000100:00000001:4.0:1773851852.617941:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851852.617941:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851852.617942:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:8.0:1773851852.617942:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851852.617942:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851852.617942:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851852.617942:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851852.617943:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851852.617943:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:8.0:1773851852.617943:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:7.0:1773851852.617943:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851852.617943:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:4.0:1773851852.617943:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851852.617943:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000040:31.0:1773851852.617944:0:41090:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00000001:28.0:1773851852.617944:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:8.0:1773851852.617944:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000001:6.0:1773851852.617944:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851852.617944:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:4.0:1773851852.617944:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851852.617945:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851852.617945:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000012eaad24.
00000100:00000001:28.0:1773851852.617945:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851852.617945:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000200:11.0:1773851852.617945:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:8.0:1773851852.617945:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
02000000:00000001:4.0:1773851852.617945:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851852.617946:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:28.0:1773851852.617946:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851852.617946:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000040:8.0:1773851852.617946:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504365568 avail=351502193664 avail_mb=1373055444 hwm_mb=3131103 files=372056321 ffree=343265982 state=0: rc = 0
00000400:00000010:6.0:1773851852.617946:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851852.617946:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4270b1f
00000100:00001000:4.0:1773851852.617946:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=85 v=66 (66 66 66 66)
02000000:00000001:31.0:1773851852.617947:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851852.617947:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000182ebf41.
00000100:00000001:28.0:1773851852.617947:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851852.617947:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851852.617947:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851852.617947:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4270b1f.
00000100:00000001:6.0:1773851852.617947:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:4.0:1773851852.617947:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=85 v=66 (1 1 1 1)
02000000:00000001:28.0:1773851852.617948:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:8.0:1773851852.617948:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504365568 free, 351502193664 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056321 files, 343265982 free files
00000100:00000001:4.0:1773851852.617948:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851852.617949:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851852.617949:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:28.0:1773851852.617949:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=85 v=66 (66 66 66 66)
00000100:00000200:6.0:1773851852.617949:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851852.617949:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851852.617950:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851852.617950:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:8.0:1773851852.617950:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617950:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:4.0:1773851852.617950:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851852.617950:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851852.617951:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00001000:28.0:1773851852.617951:0:41089:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=85 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851852.617951:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:8.0:1773851852.617951:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851852.617951:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851852.617951:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851852.617952:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617952:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851852.617952:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.617952:0:41071:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:7.0:1773851852.617952:0:41065:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:6.0:1773851852.617952:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851852.617952:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:31.0:1773851852.617953:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851852.617953:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851852.617953:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:11.0:1773851852.617953:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:7.0:1773851852.617953:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851852.617953:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851852.617953:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851852.617953:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851852.617954:0:41089:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.617954:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851852.617954:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617954:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851852.617954:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851852.617954:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851852.617955:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851852.617955:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000100:00100000:8.0:1773851852.617955:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d139e4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051922368:2060@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851852.617955:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617955:0:41067:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:28.0:1773851852.617956:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851852.617956:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851852.617956:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=85 v=66 (66 66 66 66)
02000000:00000001:6.0:1773851852.617956:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851852.617957:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851852.617957:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851852.617957:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:7.0:1773851852.617957:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=85 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851852.617957:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851852.617957:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851852.617958:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851852.617958:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851852.617958:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:6.0:1773851852.617958:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851852.617958:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:11.0:1773851852.617959:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=85 v=66 (66 66 66 66)
00000100:00000040:8.0:1773851852.617959:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006d139e4f x1859433051922368/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851852.617959:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851852.617959:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=85 v=66 (66 66 66 66)
00000100:00000001:4.0:1773851852.617959:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851852.617959:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851852.617960:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851852.617960:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851852.617960:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851852.617961:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851852.617961:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00001000:6.0:1773851852.617961:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=85 v=66 (1 1 1 1)
00000004:00000040:4.0:1773851852.617961:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000100:00000001:28.0:1773851852.617962:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851852.617962:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:11.0:1773851852.617962:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=85 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851852.617962:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851852.617962:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:7.0:1773851852.617962:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00000001:7.0:1773851852.617962:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851852.617962:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851852.617962:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851852.617962:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399726592 free=351492805632 avail=351490399232 avail_mb=1373009372 hwm_mb=3131103 files=372078194 ffree=343254693 state=0: rc = 0
02000000:00000010:8.0:1773851852.617963:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000db30ef3a.
00000100:00000001:7.0:1773851852.617963:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851852.617963:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851852.617963:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851852.617964:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:11.0:1773851852.617964:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:7.0:1773851852.617964:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851852.617964:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851852.617964:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000004:00000020:4.0:1773851852.617964:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399726592 blocks, 351492805632 free, 351490399232 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372078194 files, 343254693 free files
00000004:00000020:28.0:1773851852.617965:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097504 blocks, 31192442912 free, 31192401312 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238730 files, 2962368235 free files
00000100:00000001:11.0:1773851852.617965:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851852.617965:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:6.0:1773851852.617965:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851852.617965:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851852.617966:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000020:00000001:8.0:1773851852.617966:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851852.617966:0:41069:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000100:00000040:6.0:1773851852.617966:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:4.0:1773851852.617966:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851852.617967:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851852.617967:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851852.617967:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851852.617967:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:4.0:1773851852.617967:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851852.617968:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:8.0:1773851852.617968:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000100:00000001:7.0:1773851852.617968:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851852.617969:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851852.617969:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
02000000:00000001:8.0:1773851852.617969:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:7.0:1773851852.617969:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851852.617969:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851852.617969:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:8.0:1773851852.617970:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851852.617970:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006d139e4f.
00000004:00000001:7.0:1773851852.617970:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:6.0:1773851852.617970:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851852.617970:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00100000:4.0:1773851852.617970:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002710aeb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051922240:2061@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851852.617971:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851852.617971:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:7.0:1773851852.617971:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223712 blocks, 31250857408 free, 31250821184 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121423 files, 2868731051 free files
00000004:00000040:6.0:1773851852.617971:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000100:00100000:28.0:1773851852.617972:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031392470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051922112:13@kfi7:41:default-yuba2-0
00000100:00000001:8.0:1773851852.617972:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851852.617972:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:6.0:1773851852.617972:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500140544 avail=351498047488 avail_mb=1373039248 hwm_mb=3131103 files=372097820 ffree=343261856 state=0: rc = 0
00000100:00000040:11.0:1773851852.617973:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851852.617973:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851852.617973:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617974:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851852.617974:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851852.617974:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.617974:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:6.0:1773851852.617974:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500140544 free, 351498047488 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097820 files, 343261856 free files
00000100:00000001:4.0:1773851852.617974:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851852.617975:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851852.617975:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:6.0:1773851852.617975:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851852.617975:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851852.617976:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000031392470 x1859433051922112/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851852.617976:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851852.617976:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:4.0:1773851852.617976:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002710aeb3 x1859433051922240/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851852.617977:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc290a1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051922432:2074@kfi7:41:default-yuba2-0
00000100:00000001:28.0:1773851852.617979:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:11.0:1773851852.617979:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851852.617979:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:6.0:1773851852.617979:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000876bb723 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051922496:36@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851852.617979:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851852.617979:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:28.0:1773851852.617980:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851852.617980:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851852.617980:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:4.0:1773851852.617980:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008c84125c.
02000000:00000010:28.0:1773851852.617981:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ec11d2f7.
00000100:00000001:11.0:1773851852.617981:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851852.617981:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000cc290a1f x1859433051922432/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851852.617981:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851852.617981:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:28.0:1773851852.617982:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000001:11.0:1773851852.617982:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:6.0:1773851852.617982:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000876bb723 x1859433051922496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:4.0:1773851852.617982:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851852.617982:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000001:28.0:1773851852.617983:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851852.617983:0:41089:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000040:4.0:1773851852.617983:0:41064:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000004:00000040:11.0:1773851852.617984:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000100:00000001:7.0:1773851852.617984:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851852.617984:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:6.0:1773851852.617984:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:4.0:1773851852.617984:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851852.617984:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000097fed2c.
00000020:00000001:28.0:1773851852.617985:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851852.617985:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a709584c.
00000004:00000040:11.0:1773851852.617985:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690117120 avail=351687688192 avail_mb=1373780032 hwm_mb=3131103 files=372231289 ffree=343447380 state=0: rc = 0
02000000:00000010:7.0:1773851852.617985:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000556caab8.
02000000:00000001:6.0:1773851852.617985:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:4.0:1773851852.617985:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851852.617986:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851852.617986:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000010:6.0:1773851852.617986:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005041e9c5.
02000000:00000001:4.0:1773851852.617986:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851852.617986:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002710aeb3.
02000000:00000001:28.0:1773851852.617987:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851852.617987:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031392470.
00000020:00000001:7.0:1773851852.617987:0:41065:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:6.0:1773851852.617987:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851852.617987:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:4.0:1773851852.617987:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851852.617988:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000020:00000040:7.0:1773851852.617988:0:41065:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851852.617988:0:41067:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000020:00000001:6.0:1773851852.617988:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:4.0:1773851852.617988:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851852.617988:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851852.617989:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:11.0:1773851852.617989:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690117120 free, 351687688192 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231289 files, 343447380 free files
00000020:00000001:7.0:1773851852.617989:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851852.617989:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000607a30e5.
02000000:00000010:6.0:1773851852.617989:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004acfe469.
00000100:00000001:4.0:1773851852.617989:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851852.617990:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851852.617990:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851852.617990:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:4.0:1773851852.617990:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617991:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851852.617991:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.617991:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:6.0:1773851852.617991:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851852.617991:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000876bb723.
00000100:00000001:4.0:1773851852.617991:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851852.617991:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851852.617992:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:11.0:1773851852.617992:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:7.0:1773851852.617992:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc290a1f.
00000100:00000001:6.0:1773851852.617992:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851852.617993:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617993:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851852.617993:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851852.617993:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:11.0:1773851852.617994:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851852.617994:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.617994:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851852.617994:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851852.617994:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851852.617995:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617995:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.617996:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851852.617996:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851852.617996:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851852.617996:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851852.617999:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051922304:37@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851852.618002:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851852.618003:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851852.618005:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000009d0add5 x1859433051922304/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852005 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851852.618009:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851852.618010:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:11.0:1773851852.618011:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a276050b.
02000000:00000001:11.0:1773851852.618013:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851852.618014:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851852.618015:0:41071:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000020:00000001:11.0:1773851852.618016:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851852.618017:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000068b7b641.
02000000:00000001:11.0:1773851852.618019:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851852.618020:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851852.618021:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009d0add5.
00000100:00000001:11.0:1773851852.618022:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851852.618023:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851852.618024:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851852.618026:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851852.618027:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851852.618028:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851852.618029:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851852.640508:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851852.640509:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851852.640510:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851852.640512:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851852.640514:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19450@kfi7 to cpt 0
00000400:00000200:2.0:1773851852.640515:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19450@kfi7 : PUT - for me
00000400:00000200:2.0:1773851852.640516:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19450@kfi7 to cpt 0
00000400:00000200:2.0:1773851852.640517:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000787c5b6e nid 19450@kfi7 refs 1
00000400:00000200:2.0:1773851852.640518:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19450@kfi7 to cpt 0
00000400:00000200:2.0:1773851852.640518:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000787c5b6e nid 19450@kfi7 refs 2
00000400:00000200:2.0:1773851852.640519:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000787c5b6e nid 19450@kfi7 refs 3
00000400:00000200:2.0:1773851852.640520:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:2.0:1773851852.640521:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19451@kfi7 of length 224 into portal 12 MB=0x699de86f2e400
00000400:00000200:2.0:1773851852.640523:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19451@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 9296
00000800:00000200:2.0:1773851852.640524:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851852.640526:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851852.640528:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19450@kfi7: PUT: OK
00000100:00000001:2.0:1773851852.640529:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851852.640529:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851852.640530:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005f488f33.
00000100:00000040:2.0:1773851852.640531:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000005f488f33 x1858030886118400 msgsize 224
00000100:00100000:2.0:1773851852.640532:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-19451@kfi7 (source: 12345-19450@kfi7)
00000100:00000001:2.0:1773851852.640533:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851852.640534:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000787c5b6e nid 19450@kfi7 refs 2
00000800:00000200:2.0:1773851852.640535:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851852.640535:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851852.640535:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.640536:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.640537:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.640537:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.640538:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030886118400
00000020:00000001:1.0:1773851852.640539:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.640539:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f3c
00000020:00000001:1.0:1773851852.640540:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.640544:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000039eaf5bd refcount=6
00000020:00000001:1.0:1773851852.640544:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239867392 : -107152469684224 : ffff9e8b9f1b9000)
00000020:00000001:1.0:1773851852.640545:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239867392 : -107152469684224 : ffff9e8b9f1b9000)
00000100:00000001:1.0:1773851852.640546:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.640547:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.640548:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851852.640549:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851852.640550:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.640551:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.640551:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851852.640552:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.640553:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851852.640553:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851852.640554:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.640555:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851852.640556:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851852.640556:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851852.640556:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851852.640557:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851852.640557:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19451@kfi7, seq: 1997478
00000100:00000001:2.0:1773851852.640558:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.640558:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000039eaf5bd : new rpc_count 1
00000100:00000001:2.0:1773851852.640559:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.640559:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706786816 : -106953002764800 : ffff9eba10433600)
00000100:00000040:1.0:1773851852.640560:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005f488f33 x1858030886118400/t0(0) o400->3a919ed7-97fb-4238-96eb-f184c1cb3ad1@19451@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne244-0'
00000100:00000001:1.0:1773851852.640563:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.640563:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.640564:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f488f33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3a919ed7-97fb-4238-96eb-f184c1cb3ad1+6:47670:x1858030886118400:12345-19451@kfi7:400:default-tuolumne244-0
00000100:00000200:1.0:1773851852.640566:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030886118400
00000020:00000001:1.0:1773851852.640566:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.640567:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.640568:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.640568:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.640569:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851852.640570:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.640570:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030886118400, found 0 last_xid 1858030886118399
00000020:00000001:1.0:1773851852.640571:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.640572:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.640573:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.640573:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.640574:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851852.640575:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.640575:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.640576:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000092010b2a.
02000000:00000001:1.0:1773851852.640577:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.640577:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.640578:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.640579:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030886118400
00010000:00000001:1.0:1773851852.640580:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.640580:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005f488f33 x1858030886118400/t0(0) o400->3a919ed7-97fb-4238-96eb-f184c1cb3ad1@19451@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne244-0'
00010000:00000001:1.0:1773851852.640583:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.640583:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.640584:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.640585:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.640586:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000020c12e0 refcount 5 to 19451@kfi7
00000100:00000001:1.0:1773851852.640587:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151072 : -107154898400544 : ffff9e8b0e584ae0)
02000000:00000001:1.0:1773851852.640587:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.640588:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.640589:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.640589:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19450@kfi7
00000400:00000010:1.0:1773851852.640590:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000077f3bf52.
00000100:00000200:1.0:1773851852.640591:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030886118400, offset 224
00000400:00000200:1.0:1773851852.640592:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19450@kfi7
00000400:00000200:1.0:1773851852.640593:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19450@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.640594:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000787c5b6e nid 19450@kfi7 refs 1
00000400:00000200:1.0:1773851852.640595:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000787c5b6e nid 19450@kfi7 refs 2
00000400:00000200:1.0:1773851852.640596:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000787c5b6e nid 19450@kfi7 refs 3
00000400:00000200:1.0:1773851852.640597:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19450@kfi7 local destination
00000400:00000200:1.0:1773851852.640598:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768532:8768532:1024:4294967295] 19450@kfi7 LPNI seq info [28185:28185:16:4294967295]
00000400:00000200:1.0:1773851852.640600:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000787c5b6e nid 19450@kfi7 refs 2
00000400:00000200:1.0:1773851852.640601:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19450@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.640603:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19450@kfi7(19450@kfi7:19450@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.640604:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000787c5b6e nid 19450@kfi7 refs 3
00000800:00000200:1.0:1773851852.640606:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.640607:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851852.640609:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.640611:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0xccf Using peer 19450@kfi7(0xccf)
00000800:00000200:1.0:1773851852.640614:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0xccf: rc=0
00000800:00000200:1.0:1773851852.640616:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0xccf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.640618:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.640618:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000020c12e0 refcount 4 to 19451@kfi7
00010000:00000001:1.0:1773851852.640619:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.640620:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.640620:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.640621:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005f488f33 x1858030886118400/t0(0) o400->3a919ed7-97fb-4238-96eb-f184c1cb3ad1@19451@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne244-0'
00000100:00100000:1.0:1773851852.640624:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f488f33 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3a919ed7-97fb-4238-96eb-f184c1cb3ad1+6:47670:x1858030886118400:12345-19451@kfi7:400:default-tuolumne244-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851852.640626:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19451@kfi7, seq: 1997478
00000100:00000040:1.0:1773851852.640627:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000039eaf5bd : new rpc_count 0
00000800:00000200:2.0:1773851852.640628:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0xccf TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851852.640628:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851852.640628:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851852.640629:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851852.640629:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851852.640629:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:2.0:1773851852.640630:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19450@kfi7: PUT: OK
00000020:00000010:1.0:1773851852.640630:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000400:00000200:2.0:1773851852.640631:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000077f3bf52
00000020:00000040:1.0:1773851852.640631:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000039eaf5bd : new refcount 5
00000400:00000010:2.0:1773851852.640632:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000077f3bf52.
00000100:00000001:2.0:1773851852.640632:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851852.640632:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851852.640633:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851852.640634:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000787c5b6e nid 19450@kfi7 refs 2
00000800:00000200:2.0:1773851852.640635:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 19450@kfi7(00000000eb890830):0x0 lsk 3280 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0xccf Transaction freed
00000800:00000200:21.0:1773851852.648316:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851852.648317:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851852.648318:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851852.648320:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851852.648322:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.648324:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13056@kfi7 : PUT - for me
00000400:00000200:21.0:1773851852.648325:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.648326:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 1
00000400:00000200:21.0:1773851852.648327:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.648328:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000400:00000200:21.0:1773851852.648329:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 3
00000400:00000200:21.0:1773851852.648330:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13248@kfi7 to cpt 0
00000400:00000200:21.0:1773851852.648331:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13248@kfi7 of length 224 into portal 12 MB=0x699e12ce5c180
00000400:00000200:21.0:1773851852.648332:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13248@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 22464
00000800:00000200:21.0:1773851852.648333:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851852.648335:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851852.648336:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13056@kfi7: PUT: OK
00000100:00000001:21.0:1773851852.648337:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851852.648337:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851852.648338:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004e68e3a0.
00000100:00000040:21.0:1773851852.648339:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000004e68e3a0 x1858042260210048 msgsize 224
00000100:00100000:21.0:1773851852.648340:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13248@kfi7 (source: 12345-13056@kfi7)
00000100:00000001:21.0:1773851852.648341:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851852.648342:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851852.648342:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
02000000:00000001:23.0:1773851852.648343:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851852.648343:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851852.648344:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851852.648344:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851852.648345:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851852.648346:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042260210048
00000020:00000001:23.0:1773851852.648346:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851852.648347:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b1a
00000020:00000001:23.0:1773851852.648347:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851852.648350:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a3946b85 refcount=767
00000020:00000001:23.0:1773851852.648350:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628024320 : -107123081527296 : ffff9e9276c74000)
00000020:00000001:23.0:1773851852.648351:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628024320 : -107123081527296 : ffff9e9276c74000)
00000100:00000001:23.0:1773851852.648352:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851852.648353:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851852.648354:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e556a1b5.
00000020:00000010:23.0:1773851852.648355:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851852.648355:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851852.648356:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851852.648357:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851852.648357:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.648358:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851852.648359:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851852.648359:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.648360:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.648361:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.648361:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.648362:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851852.648363:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13248@kfi7, seq: 1997921
00000100:00000001:23.0:1773851852.648364:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851852.648365:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.648365:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851852.648365:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a3946b85 : new rpc_count 8
00000100:00000001:22.0:1773851852.648365:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117325568 : -106995592226048 : ffff9eb025bb9b00)
00000100:00000040:22.0:1773851852.648367:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004e68e3a0 x1858042260210048/t0(0) o400->b1994ce0-73f4-44e3-8721-2aa9fd18171a@13248@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1315-0'
00000100:00000001:22.0:1773851852.648369:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851852.648370:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851852.648371:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e68e3a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b1994ce0-73f4-44e3-8721-2aa9fd18171a+767:39651:x1858042260210048:12345-13248@kfi7:400:default-tuolumne1315-0
00000100:00000200:22.0:1773851852.648372:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042260210048
00000020:00000001:22.0:1773851852.648373:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851852.648374:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851852.648374:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.648375:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851852.648376:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851852.648376:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851852.648377:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042260210048, found 0 last_xid 1858042214607295
00000020:00000001:22.0:1773851852.648378:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851852.648379:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851852.648379:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851852.648380:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.648380:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851852.648381:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851852.648382:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851852.648382:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000247a55a4.
02000000:00000001:22.0:1773851852.648383:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.648384:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.648384:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851852.648385:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593675, transno 0, xid 1858042260210048
00010000:00000001:22.0:1773851852.648386:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851852.648386:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004e68e3a0 x1858042260210048/t0(0) o400->b1994ce0-73f4-44e3-8721-2aa9fd18171a@13248@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1315-0'
00010000:00000001:22.0:1773851852.648389:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851852.648389:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851852.648390:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=85 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851852.648391:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851852.648392:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d3c4198 refcount 3 to 13248@kfi7
00000100:00000001:22.0:1773851852.648393:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052736 : -107154804498880 : ffff9e8b13f11e40)
02000000:00000001:22.0:1773851852.648394:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851852.648395:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.648395:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851852.648396:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13056@kfi7
00000400:00000010:22.0:1773851852.648397:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000255a4f76.
00000100:00000200:22.0:1773851852.648398:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042260210048, offset 224
00000400:00000200:22.0:1773851852.648400:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13056@kfi7
00000400:00000200:22.0:1773851852.648400:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:22.0:1773851852.648401:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 1
00000400:00000200:22.0:1773851852.648403:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000400:00000200:22.0:1773851852.648404:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 3
00000400:00000200:22.0:1773851852.648405:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13056@kfi7 local destination
00000400:00000200:22.0:1773851852.648406:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768533:8768533:1024:4294967295] 13056@kfi7 LPNI seq info [11763768:11763768:16:4294967295]
00000400:00000200:22.0:1773851852.648408:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000400:00000200:22.0:1773851852.648408:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:22.0:1773851852.648410:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13056@kfi7(13056@kfi7:13056@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851852.648412:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 3
00000800:00000200:22.0:1773851852.648413:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851852.648414:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851852.648416:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851852.648419:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f2f Using peer 13056@kfi7(0x100000000000f2f)
00000800:00000200:22.0:1773851852.648422:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000068d775d8: Posted send of 324 bytes to peer 0x100000000000f2f: rc=0
00000800:00000200:22.0:1773851852.648423:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f2f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851852.648428:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851852.648428:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d3c4198 refcount 2 to 13248@kfi7
00010000:00000001:22.0:1773851852.648429:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851852.648430:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.648431:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851852.648431:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004e68e3a0 x1858042260210048/t0(0) o400->b1994ce0-73f4-44e3-8721-2aa9fd18171a@13248@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1315-0'
00000100:00100000:22.0:1773851852.648434:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e68e3a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b1994ce0-73f4-44e3-8721-2aa9fd18171a+767:39651:x1858042260210048:12345-13248@kfi7:400:default-tuolumne1315-0 Request processed in 64us (95us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851852.648434:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f2f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851852.648435:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851852.648436:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13056@kfi7: PUT: OK
00000100:00100000:22.0:1773851852.648437:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13248@kfi7, seq: 1997921
00000100:00000040:22.0:1773851852.648437:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a3946b85 : new rpc_count 7
00000400:00000200:21.0:1773851852.648437:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000255a4f76
00000100:00000001:22.0:1773851852.648438:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:21.0:1773851852.648438:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000255a4f76.
00000100:00000001:22.0:1773851852.648439:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851852.648439:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851852.648439:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851852.648439:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851852.648440:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851852.648440:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000020:00000010:22.0:1773851852.648441:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e556a1b5.
00000800:00000200:21.0:1773851852.648441:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 13056@kfi7(000000008e3bdabe):0x0 lsk 3888 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f2f Transaction freed
00000020:00000040:22.0:1773851852.648442:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000a3946b85 : new refcount 766
00000100:00000001:22.0:1773851852.648442:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851852.664039:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851852.664040:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851852.664041:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851852.664044:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851852.664046:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:6.0:1773851852.664047:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17906@kfi7 : PUT - for me
00000400:00000200:6.0:1773851852.664048:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:6.0:1773851852.664049:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 1
00000400:00000200:6.0:1773851852.664050:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:6.0:1773851852.664051:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000400:00000200:6.0:1773851852.664051:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 3
00000400:00000200:6.0:1773851852.664052:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17907@kfi7 to cpt 5
00000400:00000200:6.0:1773851852.664053:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17907@kfi7 of length 224 into portal 12 MB=0x69b4baa6899c0
00000400:00000200:6.0:1773851852.664055:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17907@kfi7 of length 224/224 into md 0x793926dc5 [64] + 116912
00000800:00000200:6.0:1773851852.664057:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851852.664059:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851852.664060:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17906@kfi7: PUT: OK
00000100:00000001:6.0:1773851852.664061:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851852.664061:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851852.664062:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000876bb723.
00000100:00000040:6.0:1773851852.664063:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000876bb723 x1859599144098240 msgsize 224
00000100:00100000:6.0:1773851852.664064:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-17907@kfi7 (source: 12345-17906@kfi7)
00000100:00000001:6.0:1773851852.664065:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851852.664066:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000800:00000200:6.0:1773851852.664067:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851852.664068:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851852.664069:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851852.664070:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851852.664070:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.664072:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851852.664073:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599144098240
00000020:00000001:7.0:1773851852.664074:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851852.664075:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81b45
00000020:00000001:7.0:1773851852.664076:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851852.664077:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ed265264 refcount=912
00000020:00000001:7.0:1773851852.664078:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146516842496 : -106927192709120 : ffff9ec012a96800)
00000020:00000001:7.0:1773851852.664079:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637146516842496 : -106927192709120 : ffff9ec012a96800)
00000100:00000001:7.0:1773851852.664081:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851852.664082:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851852.664083:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ac9a4ff4.
00000020:00000010:7.0:1773851852.664084:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851852.664086:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ee82f04.
00000100:00000001:7.0:1773851852.664087:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851852.664088:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851852.664089:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.664091:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851852.664091:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851852.664092:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.664094:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.664096:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851852.664096:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851852.664097:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851852.664097:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851852.664098:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17907@kfi7, seq: 2001847
00000100:00000040:7.0:1773851852.664100:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ed265264 : new rpc_count 7
00000100:00000001:5.0:1773851852.664100:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.664101:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.664103:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092536448 : -106946617015168 : ffff9ebb8ce20480)
00000100:00000040:7.0:1773851852.664105:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000876bb723 x1859599144098240/t0(0) o400->5c64f764-8ed7-4055-8a23-f149b09516bc@17907@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1593-0'
00000100:00000001:7.0:1773851852.664110:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851852.664111:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851852.664112:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000876bb723 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5c64f764-8ed7-4055-8a23-f149b09516bc+912:39593:x1859599144098240:12345-17907@kfi7:400:default-tuolumne1593-0
00000100:00000200:7.0:1773851852.664115:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599144098240
00000020:00000001:7.0:1773851852.664116:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851852.664117:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851852.664118:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.664119:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851852.664120:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851852.664121:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851852.664122:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599144098240, found 0 last_xid 1859599143432383
00000020:00000001:7.0:1773851852.664124:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851852.664125:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851852.664125:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851852.664126:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.664127:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851852.664128:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851852.664129:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851852.664130:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e2f530f.
02000000:00000001:7.0:1773851852.664131:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.664132:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.664134:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851852.664135:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593320, transno 0, xid 1859599144098240
00010000:00000001:7.0:1773851852.664136:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851852.664137:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000876bb723 x1859599144098240/t0(0) o400->5c64f764-8ed7-4055-8a23-f149b09516bc@17907@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1593-0'
00010000:00000001:7.0:1773851852.664142:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851852.664143:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851852.664144:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=84 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851852.664146:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851852.664148:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e348bef4 refcount 3 to 17907@kfi7
00000100:00000001:7.0:1773851852.664149:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024992 : -107156745526624 : ffff9e8aa03f62a0)
02000000:00000001:7.0:1773851852.664150:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851852.664151:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.664152:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851852.664154:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17906@kfi7
00000400:00000010:7.0:1773851852.664155:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
00000100:00000200:7.0:1773851852.664156:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599144098240, offset 224
00000400:00000200:7.0:1773851852.664158:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17906@kfi7
00000400:00000200:7.0:1773851852.664159:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:7.0:1773851852.664161:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 1
00000400:00000200:7.0:1773851852.664162:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000400:00000200:7.0:1773851852.664164:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 3
00000400:00000200:7.0:1773851852.664166:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17906@kfi7 local destination
00000400:00000200:7.0:1773851852.664168:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768534:8768534:1024:4294967295] 17906@kfi7 LPNI seq info [15152055:15152055:16:4294967295]
00000400:00000200:7.0:1773851852.664170:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000400:00000200:7.0:1773851852.664172:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:7.0:1773851852.664175:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17906@kfi7(17906@kfi7:17906@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851852.664177:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 3
00000800:00000200:7.0:1773851852.664179:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851852.664181:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851852.664185:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851852.664189:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000447 Using peer 17906@kfi7(0x100000000000447)
00000800:00000200:7.0:1773851852.664194:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x100000000000447: rc=0
00000800:00000200:7.0:1773851852.664196:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000447 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851852.664199:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.664202:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e348bef4 refcount 2 to 17907@kfi7
00010000:00000001:7.0:1773851852.664203:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851852.664204:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.664205:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851852.664206:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000876bb723 x1859599144098240/t0(0) o400->5c64f764-8ed7-4055-8a23-f149b09516bc@17907@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1593-0'
00000800:00000200:6.0:1773851852.664207:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000447 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851852.664209:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851852.664210:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17906@kfi7: PUT: OK
00000100:00100000:7.0:1773851852.664211:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000876bb723 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5c64f764-8ed7-4055-8a23-f149b09516bc+912:39593:x1859599144098240:12345-17907@kfi7:400:default-tuolumne1593-0 Request processed in 100us (147us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851852.664211:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
00000400:00000010:6.0:1773851852.664211:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000100:00000001:6.0:1773851852.664212:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851852.664213:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851852.664214:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000100:00100000:7.0:1773851852.664215:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17907@kfi7, seq: 2001847
00000800:00000200:6.0:1773851852.664215:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 17906@kfi7(000000007f210bb1):0x0 lsk 1096 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000447 Transaction freed
00000100:00000040:7.0:1773851852.664216:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ed265264 : new rpc_count 6
00000100:00000001:7.0:1773851852.664218:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851852.664219:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851852.664219:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851852.664221:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ee82f04.
00000020:00000010:7.0:1773851852.664222:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ac9a4ff4.
00000020:00000040:7.0:1773851852.664224:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000ed265264 : new refcount 911
00000100:00000001:7.0:1773851852.664225:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851852.681733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851852.681734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:29.0:1773851852.681833:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.681833:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.681835:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851852.681837:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851852.681838:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.681840:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21840@kfi7 : PUT - for me
00000400:00000200:29.0:1773851852.681840:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.681841:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027778483 nid 21840@kfi7 refs 1
00000400:00000200:29.0:1773851852.681842:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.681843:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027778483 nid 21840@kfi7 refs 2
00000400:00000200:29.0:1773851852.681843:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000027778483 nid 21840@kfi7 refs 3
00000400:00000200:29.0:1773851852.681844:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21904@kfi7 to cpt 2
00000400:00000200:29.0:1773851852.681845:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21904@kfi7 of length 224 into portal 12 MB=0x699e0bef12f80
00000400:00000200:29.0:1773851852.681846:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21904@kfi7 of length 224/224 into md 0x77fe139dd [64] + 158440
00000800:00000200:29.0:1773851852.681848:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851852.681850:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851852.681851:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21840@kfi7: PUT: OK
00000100:00000001:29.0:1773851852.681852:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851852.681852:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851852.681853:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005eed34e7.
00000100:00000040:29.0:1773851852.681854:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000005eed34e7 x1858040415465344 msgsize 224
00000100:00100000:29.0:1773851852.681855:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21904@kfi7 (source: 12345-21840@kfi7)
00000100:00000001:29.0:1773851852.681856:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851852.681858:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000027778483 nid 21840@kfi7 refs 2
00000800:00000200:29.0:1773851852.681859:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851852.681861:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851852.681862:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851852.681862:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851852.681863:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.681863:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.681864:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040415465344
00000020:00000001:29.0:1773851852.681865:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851852.681865:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b60
00000020:00000001:29.0:1773851852.681866:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851852.681869:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008fe5c163 refcount=6
00000020:00000001:29.0:1773851852.681870:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628022272 : -107123081529344 : ffff9e9276c73800)
00000020:00000001:29.0:1773851852.681870:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628022272 : -107123081529344 : ffff9e9276c73800)
00000100:00000001:29.0:1773851852.681871:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.681873:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851852.681873:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001d1a7a8a.
00000020:00000010:29.0:1773851852.681874:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.681875:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851852.681876:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851852.681876:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851852.681877:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.681878:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851852.681878:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851852.681879:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.681880:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.681880:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851852.681881:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851852.681881:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851852.681882:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851852.681882:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21904@kfi7, seq: 2055447
00000100:00000001:31.0:1773851852.681883:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851852.681883:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.681883:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008fe5c163 : new rpc_count 1
00000100:00000001:29.0:1773851852.681883:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224855552 : -106962484696064 : ffff9eb7db186c00)
00000100:00000040:29.0:1773851852.681884:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005eed34e7 x1858040415465344/t0(0) o400->c067ddfe-3c69-408f-b9c3-30be380d1b9b@21904@kfi7:640/0 lens 224/0 e 0 to 0 dl 1773852000 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1858-0'
00000100:00000001:29.0:1773851852.681889:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.681890:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851852.681891:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eed34e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c067ddfe-3c69-408f-b9c3-30be380d1b9b+6:39652:x1858040415465344:12345-21904@kfi7:400:default-tuolumne1858-0
00000100:00000200:29.0:1773851852.681892:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040415465344
00000020:00000001:29.0:1773851852.681893:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851852.681893:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851852.681894:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.681894:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851852.681895:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851852.681896:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851852.681896:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040415465344, found 0 last_xid 1858040415465343
00000020:00000001:29.0:1773851852.681897:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851852.681898:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851852.681898:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851852.681899:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.681899:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851852.681900:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851852.681900:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851852.681902:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000694036ea.
02000000:00000001:29.0:1773851852.681903:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.681903:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.681904:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851852.681904:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183052319744, transno 0, xid 1858040415465344
00010000:00000001:29.0:1773851852.681905:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851852.681906:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005eed34e7 x1858040415465344/t0(0) o400->c067ddfe-3c69-408f-b9c3-30be380d1b9b@21904@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1858-0'
00010000:00000001:29.0:1773851852.681908:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851852.681909:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851852.681909:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=85 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851852.681910:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851852.681911:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b58cf250 refcount 3 to 21904@kfi7
00000100:00000001:29.0:1773851852.681912:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581600 : -107154806970016 : ffff9e8b13cb6960)
02000000:00000001:29.0:1773851852.681913:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851852.681913:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.681914:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851852.681915:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21840@kfi7
00000400:00000010:29.0:1773851852.681916:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dee493e9.
00000100:00000200:29.0:1773851852.681917:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040415465344, offset 224
00000400:00000200:29.0:1773851852.681918:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21840@kfi7
00000400:00000200:29.0:1773851852.681919:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.681920:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027778483 nid 21840@kfi7 refs 1
00000400:00000200:29.0:1773851852.681921:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000027778483 nid 21840@kfi7 refs 2
00000400:00000200:29.0:1773851852.681922:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000027778483 nid 21840@kfi7 refs 3
00000400:00000200:29.0:1773851852.681923:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21840@kfi7 local destination
00000400:00000200:29.0:1773851852.681925:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768535:8768535:1024:4294967295] 21840@kfi7 LPNI seq info [1353653:1353653:16:4294967295]
00000400:00000200:29.0:1773851852.681926:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000027778483 nid 21840@kfi7 refs 2
00000400:00000200:29.0:1773851852.681927:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21840@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.681929:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21840@kfi7(21840@kfi7:21840@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851852.681930:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000027778483 nid 21840@kfi7 refs 3
00000800:00000200:29.0:1773851852.681931:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.681932:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851852.681934:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851852.681937:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xeb4 Using peer 21840@kfi7(0xeb4)
00000800:00000200:29.0:1773851852.681940:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0xeb4: rc=0
00000800:00000200:29.0:1773851852.681942:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xeb4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851852.681944:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.681944:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b58cf250 refcount 2 to 21904@kfi7
00010000:00000001:29.0:1773851852.681945:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851852.681946:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.681947:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851852.681947:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005eed34e7 x1858040415465344/t0(0) o400->c067ddfe-3c69-408f-b9c3-30be380d1b9b@21904@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1858-0'
00000100:00100000:29.0:1773851852.681951:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eed34e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c067ddfe-3c69-408f-b9c3-30be380d1b9b+6:39652:x1858040415465344:12345-21904@kfi7:400:default-tuolumne1858-0 Request processed in 60us (96us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851852.681953:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21904@kfi7, seq: 2055447
00000800:00000200:30.0:1773851852.681954:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xeb4 TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851852.681954:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008fe5c163 : new rpc_count 0
00000100:00000001:29.0:1773851852.681955:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851852.681955:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:30.0:1773851852.681956:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851852.681956:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851852.681957:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21840@kfi7: PUT: OK
00000020:00000010:29.0:1773851852.681957:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000020:00000010:29.0:1773851852.681957:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001d1a7a8a.
00000400:00000200:30.0:1773851852.681958:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dee493e9
00000400:00000010:30.0:1773851852.681958:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dee493e9.
00000020:00000040:29.0:1773851852.681958:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000008fe5c163 : new refcount 5
00000100:00000001:30.0:1773851852.681959:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851852.681959:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:29.0:1773851852.681959:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851852.681960:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000027778483 nid 21840@kfi7 refs 2
00000800:00000200:30.0:1773851852.681962:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 21840@kfi7(00000000149e99b0):0x0 lsk 3765 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xeb4 Transaction freed
00000800:00000200:5.0:1773851852.747244:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851852.747245:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851852.747246:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851852.747248:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851852.747250:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.747252:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21859@kfi7 : PUT - for me
00000400:00000200:5.0:1773851852.747253:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.747253:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 1
00000400:00000200:5.0:1773851852.747254:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:5.0:1773851852.747255:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000400:00000200:5.0:1773851852.747256:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 3
00000400:00000200:5.0:1773851852.747257:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21858@kfi7 to cpt 6
00000400:00000200:5.0:1773851852.747258:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21858@kfi7 of length 224 into portal 12 MB=0x69b0a33cd1b80
00000400:00000200:5.0:1773851852.747259:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21858@kfi7 of length 224/224 into md 0x793926dc5 [64] + 117136
00000800:00000200:5.0:1773851852.747261:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851852.747265:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851852.747266:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21859@kfi7: PUT: OK
00000100:00000001:5.0:1773851852.747267:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851852.747268:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851852.747269:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000052ad6f4c.
00000100:00000040:5.0:1773851852.747269:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000052ad6f4c x1859317981322112 msgsize 224
00000100:00100000:5.0:1773851852.747271:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-21858@kfi7 (source: 12345-21859@kfi7)
00000100:00000001:5.0:1773851852.747272:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851852.747273:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851852.747273:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 2
02000000:00000001:7.0:1773851852.747274:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851852.747274:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851852.747274:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851852.747275:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851852.747276:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851852.747276:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317981322112
00000020:00000001:7.0:1773851852.747277:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851852.747277:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9275a
00000020:00000001:7.0:1773851852.747278:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851852.747280:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000637b8908 refcount=6
00000020:00000001:7.0:1773851852.747280:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631488512 : -107123078063104 : ffff9e9276fc1c00)
00000020:00000001:7.0:1773851852.747281:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631488512 : -107123078063104 : ffff9e9276fc1c00)
00000100:00000001:7.0:1773851852.747282:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851852.747283:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851852.747283:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ac9a4ff4.
00000020:00000010:7.0:1773851852.747284:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851852.747286:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ee82f04.
00000100:00000001:7.0:1773851852.747286:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851852.747287:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851852.747287:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.747288:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851852.747289:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851852.747289:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.747290:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851852.747291:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851852.747292:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851852.747292:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851852.747292:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851852.747293:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21858@kfi7, seq: 2001848
00000100:00000040:7.0:1773851852.747293:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000637b8908 : new rpc_count 1
00000100:00000001:7.0:1773851852.747294:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046219904 : -106940663331712 : ffff9ebcefc00480)
00000100:00000001:5.0:1773851852.747294:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851852.747294:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.747295:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000052ad6f4c x1859317981322112/t0(0) o400->87bc2668-48aa-41e5-aad3-cd00e0aa0d18@21858@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1852-0'
00000100:00000001:7.0:1773851852.747298:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851852.747298:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851852.747299:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052ad6f4c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:87bc2668-48aa-41e5-aad3-cd00e0aa0d18+6:39485:x1859317981322112:12345-21858@kfi7:400:default-tuolumne1852-0
00000100:00000200:7.0:1773851852.747301:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317981322112
00000020:00000001:7.0:1773851852.747301:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851852.747302:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851852.747303:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.747303:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851852.747304:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851852.747305:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851852.747305:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317981322112, found 0 last_xid 1859317981322111
00000020:00000001:7.0:1773851852.747306:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851852.747307:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851852.747307:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851852.747308:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.747308:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851852.747309:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851852.747310:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851852.747311:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002c4e0b06.
02000000:00000001:7.0:1773851852.747312:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.747312:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.747313:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851852.747314:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096705949, transno 0, xid 1859317981322112
00010000:00000001:7.0:1773851852.747314:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851852.747315:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000052ad6f4c x1859317981322112/t0(0) o400->87bc2668-48aa-41e5-aad3-cd00e0aa0d18@21858@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1852-0'
00010000:00000001:7.0:1773851852.747317:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851852.747318:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851852.747319:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=84 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851852.747320:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851852.747321:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000034e2684 refcount 3 to 21858@kfi7
00000100:00000001:7.0:1773851852.747321:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419168 : -107156724132448 : ffff9e8aa185d5a0)
02000000:00000001:7.0:1773851852.747322:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851852.747323:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851852.747323:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851852.747324:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21859@kfi7
00000400:00000010:7.0:1773851852.747325:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c448bd40.
00000100:00000200:7.0:1773851852.747326:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317981322112, offset 224
00000400:00000200:7.0:1773851852.747327:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21859@kfi7
00000400:00000200:7.0:1773851852.747328:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:7.0:1773851852.747328:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 1
00000400:00000200:7.0:1773851852.747329:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000400:00000200:7.0:1773851852.747330:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 3
00000400:00000200:7.0:1773851852.747332:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21859@kfi7 local destination
00000400:00000200:7.0:1773851852.747333:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768536:8768536:1024:4294967295] 21859@kfi7 LPNI seq info [1218958:1218958:16:4294967295]
00000400:00000200:7.0:1773851852.747334:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000400:00000200:7.0:1773851852.747335:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:7.0:1773851852.747337:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21859@kfi7(21859@kfi7:21859@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851852.747339:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 3
00000800:00000200:7.0:1773851852.747340:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851852.747341:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851852.747343:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851852.747345:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d38 Using peer 21859@kfi7(0x100000000000d38)
00000800:00000200:7.0:1773851852.747348:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x100000000000d38: rc=0
00000800:00000200:7.0:1773851852.747349:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d38 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851852.747351:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851852.747352:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000034e2684 refcount 2 to 21858@kfi7
00010000:00000001:7.0:1773851852.747353:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851852.747353:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851852.747354:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851852.747355:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000052ad6f4c x1859317981322112/t0(0) o400->87bc2668-48aa-41e5-aad3-cd00e0aa0d18@21858@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1852-0'
00000100:00100000:7.0:1773851852.747358:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052ad6f4c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:87bc2668-48aa-41e5-aad3-cd00e0aa0d18+6:39485:x1859317981322112:12345-21858@kfi7:400:default-tuolumne1852-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851852.747360:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21858@kfi7, seq: 2001848
00000100:00000040:7.0:1773851852.747361:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000637b8908 : new rpc_count 0
00000100:00000001:7.0:1773851852.747361:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851852.747361:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d38 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851852.747362:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851852.747362:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851852.747363:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ee82f04.
00000400:00000200:5.0:1773851852.747363:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851852.747364:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ac9a4ff4.
00000400:00000200:5.0:1773851852.747364:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21859@kfi7: PUT: OK
00000400:00000200:5.0:1773851852.747364:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c448bd40
00000020:00000040:7.0:1773851852.747365:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000637b8908 : new refcount 5
00000100:00000001:7.0:1773851852.747365:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:5.0:1773851852.747365:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c448bd40.
00000100:00000001:5.0:1773851852.747366:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851852.747366:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851852.747367:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000800:00000200:5.0:1773851852.747369:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 21859@kfi7(00000000e9552697):0x0 lsk 3385 rsk 66 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d38 Transaction freed
00000800:00000200:29.0:1773851852.750695:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.750695:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.750697:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851852.750699:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851852.750701:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.750703:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20387@kfi7 : PUT - for me
00000400:00000200:29.0:1773851852.750704:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.750705:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 1
00000400:00000200:29.0:1773851852.750706:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.750707:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000400:00000200:29.0:1773851852.750708:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 3
00000400:00000200:29.0:1773851852.750708:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20323@kfi7 to cpt 3
00000400:00000200:29.0:1773851852.750710:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20323@kfi7 of length 224 into portal 12 MB=0x699e1181ae7c0
00000400:00000200:29.0:1773851852.750711:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20323@kfi7 of length 224/224 into md 0x77fe139dd [64] + 158664
00000800:00000200:29.0:1773851852.750712:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851852.750714:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851852.750715:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20387@kfi7: PUT: OK
00000100:00000001:29.0:1773851852.750716:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851852.750717:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851852.750718:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000056e05a01.
00000100:00000040:29.0:1773851852.750719:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000056e05a01 x1858041911371712 msgsize 224
00000100:00100000:29.0:1773851852.750720:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-20323@kfi7 (source: 12345-20387@kfi7)
00000100:00000001:29.0:1773851852.750722:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851852.750722:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000800:00000200:29.0:1773851852.750724:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851852.750729:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851852.750730:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851852.750730:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851852.750731:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.750732:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.750732:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041911371712
00000020:00000001:29.0:1773851852.750733:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851852.750734:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91769
00000020:00000001:29.0:1773851852.750734:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851852.750738:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e448dc86 refcount=6
00000020:00000001:29.0:1773851852.750738:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241499648 : -107152468051968 : ffff9e8b9f347800)
00000020:00000001:29.0:1773851852.750739:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241499648 : -107152468051968 : ffff9e8b9f347800)
00000100:00000001:29.0:1773851852.750740:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.750741:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851852.750741:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a5f84808.
00000020:00000010:29.0:1773851852.750742:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.750743:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851852.750744:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851852.750744:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851852.750745:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.750746:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851852.750746:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851852.750747:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.750748:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.750749:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851852.750750:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851852.750750:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851852.750750:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851852.750751:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.750751:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20323@kfi7, seq: 2055448
00000100:00000040:29.0:1773851852.750751:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e448dc86 : new rpc_count 1
00000100:00000001:31.0:1773851852.750752:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.750752:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224838272 : -106962484713344 : ffff9eb7db182880)
00000100:00000040:29.0:1773851852.750753:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000056e05a01 x1858041911371712/t0(0) o400->9f30d803-c78b-4aff-a0c2-53c7b4656346@20323@kfi7:640/0 lens 224/0 e 0 to 0 dl 1773852000 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1756-0'
00000100:00000001:29.0:1773851852.750756:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.750757:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851852.750758:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056e05a01 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:9f30d803-c78b-4aff-a0c2-53c7b4656346+6:39656:x1858041911371712:12345-20323@kfi7:400:default-tuolumne1756-0
00000100:00000200:29.0:1773851852.750759:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041911371712
00000020:00000001:29.0:1773851852.750760:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851852.750760:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851852.750761:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.750762:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851852.750762:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851852.750763:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851852.750763:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041911371712, found 0 last_xid 1858041911371711
00000020:00000001:29.0:1773851852.750764:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851852.750765:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851852.750766:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851852.750766:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.750767:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851852.750767:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851852.750768:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851852.750769:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000061049fe5.
02000000:00000001:29.0:1773851852.750769:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.750770:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.750771:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851852.750771:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694172, transno 0, xid 1858041911371712
00010000:00000001:29.0:1773851852.750772:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851852.750774:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000056e05a01 x1858041911371712/t0(0) o400->9f30d803-c78b-4aff-a0c2-53c7b4656346@20323@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1756-0'
00010000:00000001:29.0:1773851852.750776:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851852.750777:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851852.750777:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=85 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851852.750778:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851852.750779:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007faa644f refcount 3 to 20323@kfi7
00000100:00000001:29.0:1773851852.750780:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153088 : -107139310398528 : ffff9e8eaf7653c0)
02000000:00000001:29.0:1773851852.750781:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851852.750781:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.750782:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851852.750783:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20387@kfi7
00000400:00000010:29.0:1773851852.750783:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ff40b36.
00000100:00000200:29.0:1773851852.750784:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041911371712, offset 224
00000400:00000200:29.0:1773851852.750786:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20387@kfi7
00000400:00000200:29.0:1773851852.750787:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.750787:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 1
00000400:00000200:29.0:1773851852.750789:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000400:00000200:29.0:1773851852.750790:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 3
00000400:00000200:29.0:1773851852.750791:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20387@kfi7 local destination
00000400:00000200:29.0:1773851852.750792:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768537:8768537:1024:4294967295] 20387@kfi7 LPNI seq info [17703300:17703300:16:4294967295]
00000400:00000200:29.0:1773851852.750794:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000400:00000200:29.0:1773851852.750794:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.750796:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20387@kfi7(20387@kfi7:20387@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851852.750797:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 3
00000800:00000200:29.0:1773851852.750798:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.750799:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851852.750801:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851852.750804:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3eb Using peer 20387@kfi7(0x3eb)
00000800:00000200:29.0:1773851852.750807:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 324 bytes to peer 0x3eb: rc=0
00000800:00000200:29.0:1773851852.750809:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851852.750811:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.750812:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007faa644f refcount 2 to 20323@kfi7
00010000:00000001:29.0:1773851852.750812:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851852.750813:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.750813:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851852.750814:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000056e05a01 x1858041911371712/t0(0) o400->9f30d803-c78b-4aff-a0c2-53c7b4656346@20323@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1756-0'
00000100:00100000:29.0:1773851852.750817:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056e05a01 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:9f30d803-c78b-4aff-a0c2-53c7b4656346+6:39656:x1858041911371712:12345-20323@kfi7:400:default-tuolumne1756-0 Request processed in 60us (97us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851852.750819:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20323@kfi7, seq: 2055448
00000100:00000040:29.0:1773851852.750819:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e448dc86 : new rpc_count 0
00000100:00000001:29.0:1773851852.750820:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851852.750821:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851852.750821:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000800:00000200:30.0:1773851852.750822:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3eb TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851852.750822:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000400:00000200:30.0:1773851852.750823:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851852.750823:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a5f84808.
00000400:00000200:30.0:1773851852.750824:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20387@kfi7: PUT: OK
00000020:00000040:29.0:1773851852.750824:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000e448dc86 : new refcount 5
00000100:00000001:29.0:1773851852.750824:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851852.750825:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ff40b36
00000400:00000010:30.0:1773851852.750826:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ff40b36.
00000100:00000001:30.0:1773851852.750826:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851852.750827:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851852.750827:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000800:00000200:30.0:1773851852.750828:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20387@kfi7(000000001f8077a2):0x0 lsk 1004 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3eb Transaction freed
00000800:00000200:29.0:1773851852.751865:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.751866:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.751867:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851852.751869:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851852.751870:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.751871:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22513@kfi7 : PUT - for me
00000400:00000200:29.0:1773851852.751872:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.751873:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 1
00000400:00000200:29.0:1773851852.751875:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.751875:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000400:00000200:29.0:1773851852.751876:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 3
00000400:00000200:29.0:1773851852.751877:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22320@kfi7 to cpt 1
00000400:00000200:29.0:1773851852.751878:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22320@kfi7 of length 224 into portal 12 MB=0x699e105308fc0
00000400:00000200:29.0:1773851852.751879:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22320@kfi7 of length 224/224 into md 0x77fe139dd [64] + 158888
00000800:00000200:29.0:1773851852.751880:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851852.751882:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851852.751883:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22513@kfi7: PUT: OK
00000100:00000001:29.0:1773851852.751884:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851852.751884:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851852.751885:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c0c62afe.
00000100:00000040:29.0:1773851852.751885:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000c0c62afe x1858041594023872 msgsize 224
00000100:00100000:29.0:1773851852.751886:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22320@kfi7 (source: 12345-22513@kfi7)
00000100:00000001:29.0:1773851852.751887:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851852.751888:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000800:00000200:29.0:1773851852.751889:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851852.751892:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851852.751892:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851852.751892:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851852.751893:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.751893:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.751894:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041594023872
00000020:00000001:29.0:1773851852.751894:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851852.751895:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e3f
00000020:00000001:29.0:1773851852.751895:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851852.751899:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000467bea46 refcount=6
00000020:00000001:29.0:1773851852.751899:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628792320 : -107123080759296 : ffff9e9276d2f800)
00000020:00000001:29.0:1773851852.751900:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628792320 : -107123080759296 : ffff9e9276d2f800)
00000100:00000001:29.0:1773851852.751901:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.751902:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851852.751903:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a5f84808.
00000020:00000010:29.0:1773851852.751903:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.751904:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851852.751905:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851852.751905:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851852.751906:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.751907:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851852.751907:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851852.751907:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.751908:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851852.751909:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851852.751909:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851852.751909:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851852.751910:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851852.751910:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22320@kfi7, seq: 2055449
00000100:00000001:31.0:1773851852.751911:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851852.751911:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.751911:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000467bea46 : new rpc_count 1
00000100:00000001:29.0:1773851852.751911:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224847488 : -106962484704128 : ffff9eb7db184c80)
00000100:00000040:29.0:1773851852.751912:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c0c62afe x1858041594023872/t0(0) o400->f81d0730-d54a-4e10-abd8-eaddbac1f6b8@22320@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1885-0'
00000100:00000001:29.0:1773851852.751915:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.751915:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851852.751916:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0c62afe pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f81d0730-d54a-4e10-abd8-eaddbac1f6b8+6:39628:x1858041594023872:12345-22320@kfi7:400:default-tuolumne1885-0
00000100:00000200:29.0:1773851852.751917:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041594023872
00000020:00000001:29.0:1773851852.751918:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851852.751918:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851852.751919:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.751919:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851852.751920:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851852.751920:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851852.751921:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041594023872, found 0 last_xid 1858041594023871
00000020:00000001:29.0:1773851852.751921:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851852.751922:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851852.751922:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851852.751922:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.751923:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851852.751924:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851852.751924:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851852.751925:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7ab105f.
02000000:00000001:29.0:1773851852.751925:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.751926:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.751926:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851852.751927:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183241701982, transno 0, xid 1858041594023872
00010000:00000001:29.0:1773851852.751927:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851852.751928:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c0c62afe x1858041594023872/t0(0) o400->f81d0730-d54a-4e10-abd8-eaddbac1f6b8@22320@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1885-0'
00010000:00000001:29.0:1773851852.751930:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851852.751931:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851852.751931:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=85 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851852.751932:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851852.751932:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000096d24127 refcount 3 to 22320@kfi7
00000100:00000001:29.0:1773851852.751933:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553700864 : -107156155850752 : ffff9e8ac3652000)
02000000:00000001:29.0:1773851852.751934:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851852.751935:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.751935:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851852.751936:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22513@kfi7
00000400:00000010:29.0:1773851852.751936:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000844552bf.
00000100:00000200:29.0:1773851852.751937:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041594023872, offset 224
00000400:00000200:29.0:1773851852.751938:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22513@kfi7
00000400:00000200:29.0:1773851852.751939:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.751939:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 1
00000400:00000200:29.0:1773851852.751940:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000400:00000200:29.0:1773851852.751941:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 3
00000400:00000200:29.0:1773851852.751942:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22513@kfi7 local destination
00000400:00000200:29.0:1773851852.751943:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768538:8768538:1024:4294967295] 22513@kfi7 LPNI seq info [305402:305402:16:4294967295]
00000400:00000200:29.0:1773851852.751945:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000400:00000200:29.0:1773851852.751945:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.751947:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22513@kfi7(22513@kfi7:22513@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851852.751949:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 3
00000800:00000200:29.0:1773851852.751950:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.751951:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851852.751953:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851852.751955:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe92 Using peer 22513@kfi7(0xe92)
00000800:00000200:29.0:1773851852.751958:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 324 bytes to peer 0xe92: rc=0
00000800:00000200:29.0:1773851852.751959:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe92 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851852.751961:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.751961:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000096d24127 refcount 2 to 22320@kfi7
00010000:00000001:29.0:1773851852.751962:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851852.751962:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.751963:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851852.751963:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c0c62afe x1858041594023872/t0(0) o400->f81d0730-d54a-4e10-abd8-eaddbac1f6b8@22320@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1885-0'
00000100:00100000:29.0:1773851852.751966:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0c62afe pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f81d0730-d54a-4e10-abd8-eaddbac1f6b8+6:39628:x1858041594023872:12345-22320@kfi7:400:default-tuolumne1885-0 Request processed in 51us (80us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851852.751968:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22320@kfi7, seq: 2055449
00000100:00000040:29.0:1773851852.751969:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000467bea46 : new rpc_count 0
00000100:00000001:29.0:1773851852.751970:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851852.751970:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851852.751970:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000800:00000200:30.0:1773851852.751971:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe92 TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851852.751971:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000400:00000200:30.0:1773851852.751972:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851852.751972:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a5f84808.
00000020:00000040:29.0:1773851852.751972:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000467bea46 : new refcount 5
00000400:00000200:30.0:1773851852.751973:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22513@kfi7: PUT: OK
00000100:00000001:29.0:1773851852.751973:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851852.751974:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000844552bf
00000400:00000010:30.0:1773851852.751974:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000844552bf.
00000100:00000001:30.0:1773851852.751975:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851852.751975:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851852.751975:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000800:00000200:30.0:1773851852.751976:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 22513@kfi7(00000000f1263d9c):0x0 lsk 3731 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe92 Transaction freed
00000800:00000200:1.0:1773851852.755645:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.755647:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851852.755649:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851852.755652:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851852.755656:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.755658:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9410@kfi7 : PUT - for me
00000400:00000200:1.0:1773851852.755659:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.755661:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 1
00000400:00000200:1.0:1773851852.755662:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.755664:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000400:00000200:1.0:1773851852.755665:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 3
00000400:00000200:1.0:1773851852.755667:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.755668:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9410@kfi7 of length 224 into portal 12 MB=0x69b4bc5aaa240
00000400:00000200:1.0:1773851852.755671:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9410@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 9520
00000800:00000200:1.0:1773851852.755675:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851852.755678:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851852.755680:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9410@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.755681:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851852.755682:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851852.755684:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000112256d2.
00000100:00000040:1.0:1773851852.755685:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000112256d2 x1859599601410624 msgsize 224
00000100:00100000:1.0:1773851852.755687:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9410@kfi7 (source: 12345-9410@kfi7)
00000100:00000001:1.0:1773851852.755690:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851852.755692:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000800:00000200:1.0:1773851852.755694:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851852.755699:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851852.755700:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.755700:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.755702:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.755703:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.755705:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599601410624
00000020:00000001:1.0:1773851852.755705:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.755706:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d777ba
00000020:00000001:1.0:1773851852.755707:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.755710:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f039ce3 refcount=6
00000020:00000001:1.0:1773851852.755711:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637156959353856 : -106916750197760 : ffff9ec281157c00)
00000020:00000001:1.0:1773851852.755712:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637156959353856 : -106916750197760 : ffff9ec281157c00)
00000100:00000001:1.0:1773851852.755713:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.755714:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.755715:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f091a3c3.
00000020:00000010:1.0:1773851852.755717:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851852.755718:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.755719:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.755720:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851852.755721:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.755722:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851852.755723:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851852.755724:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.755729:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851852.755731:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851852.755731:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.755732:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851852.755732:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851852.755733:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9410@kfi7, seq: 1997479
00000100:00000001:2.0:1773851852.755735:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.755735:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f039ce3 : new rpc_count 2
00000100:00000001:2.0:1773851852.755736:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.755736:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085911368576 : -106987798183040 : ffff9eb1f64b4380)
00000100:00000040:1.0:1773851852.755738:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000112256d2 x1859599601410624/t0(0) o400->6d79422a-f50e-45ec-938e-37aceb27293c@9410@kfi7:492/0 lens 224/0 e 0 to 0 dl 1773852607 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1079-0'
00000100:00000001:1.0:1773851852.755742:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.755743:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.755744:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000112256d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6d79422a-f50e-45ec-938e-37aceb27293c+6:39541:x1859599601410624:12345-9410@kfi7:400:default-tuolumne1079-0
00000100:00000200:1.0:1773851852.755747:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599601410624
00000020:00000001:1.0:1773851852.755748:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.755749:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.755750:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.755751:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.755752:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851852.755753:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.755754:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599601410624, found 0 last_xid 1859599600996351
00000020:00000001:1.0:1773851852.755755:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.755756:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.755757:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.755758:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.755759:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851852.755760:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.755761:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.755763:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003797eb4b.
02000000:00000001:1.0:1773851852.755764:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.755765:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.755766:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.755767:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183167140555, transno 0, xid 1859599601410624
00010000:00000001:1.0:1773851852.755768:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.755770:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000112256d2 x1859599601410624/t0(0) o400->6d79422a-f50e-45ec-938e-37aceb27293c@9410@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1079-0'
00010000:00000001:1.0:1773851852.755774:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.755775:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.755776:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.755778:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.755779:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000abf8fc8a refcount 3 to 9410@kfi7
00000100:00000001:1.0:1773851852.755780:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994449216 : -107149715102400 : ffff9e8c434b2540)
02000000:00000001:1.0:1773851852.755781:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.755782:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.755783:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.755784:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9410@kfi7
00000400:00000010:1.0:1773851852.755785:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000adbde9c1.
00000100:00000200:1.0:1773851852.755786:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599601410624, offset 224
00000400:00000200:1.0:1773851852.755788:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9410@kfi7
00000400:00000200:1.0:1773851852.755790:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.755791:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 1
00000400:00000200:1.0:1773851852.755793:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000400:00000200:1.0:1773851852.755795:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 3
00000400:00000200:1.0:1773851852.755797:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9410@kfi7 local destination
00000400:00000200:1.0:1773851852.755799:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768539:8768539:1024:4294967295] 9410@kfi7 LPNI seq info [20856470:20856470:16:4294967295]
00000400:00000200:1.0:1773851852.755801:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000400:00000200:1.0:1773851852.755802:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.755805:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9410@kfi7(9410@kfi7:9410@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.755807:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 3
00000800:00000200:1.0:1773851852.755809:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.755811:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851852.755814:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.755818:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7fe Using peer 9410@kfi7(0x7fe)
00000800:00000200:1.0:1773851852.755823:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0x7fe: rc=0
00000800:00000200:1.0:1773851852.755825:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.755828:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.755829:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000abf8fc8a refcount 2 to 9410@kfi7
00010000:00000001:1.0:1773851852.755830:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.755831:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.755832:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.755833:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000112256d2 x1859599601410624/t0(0) o400->6d79422a-f50e-45ec-938e-37aceb27293c@9410@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1079-0'
00000100:00100000:1.0:1773851852.755838:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000112256d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6d79422a-f50e-45ec-938e-37aceb27293c+6:39541:x1859599601410624:12345-9410@kfi7:400:default-tuolumne1079-0 Request processed in 95us (152us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851852.755841:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7fe TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851852.755842:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9410@kfi7, seq: 1997479
00000400:00000200:2.0:1773851852.755843:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:1.0:1773851852.755844:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f039ce3 : new rpc_count 1
00000100:00000001:1.0:1773851852.755845:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851852.755846:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9410@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.755846:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851852.755847:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000adbde9c1
00000020:00000010:1.0:1773851852.755847:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000010:2.0:1773851852.755848:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000adbde9c1.
00000020:00000010:1.0:1773851852.755848:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000100:00000001:2.0:1773851852.755849:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851852.755849:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f091a3c3.
00000100:00000001:2.0:1773851852.755850:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851852.755851:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000020:00000040:1.0:1773851852.755851:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004f039ce3 : new refcount 5
00000100:00000001:1.0:1773851852.755852:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851852.755853:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 9410@kfi7(0000000066cf3ccd):0x0 lsk 2047 rsk 9 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7fe Transaction freed
00000800:00000200:23.0:1773851852.776018:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851852.776018:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851852.776019:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851852.776019:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:23.0:1773851852.776021:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851852.776021:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:23.0:1773851852.776023:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851852.776023:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18080@kfi7(00000000d2b65664):0x6be version: 2; local version 2; negotiated version: 2
00000400:00000200:23.0:1773851852.776025:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18080@kfi7 to cpt 5
00000800:00000200:21.0:1773851852.776025:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be Using peer 18080@kfi7(0x1000000000006be)
00000400:00000200:23.0:1773851852.776026:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18080@kfi7 : PUT - for me
00000400:00000200:21.0:1773851852.776027:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18080@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.776028:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18080@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.776029:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053c00a5c nid 18080@kfi7 refs 1
00000800:00000200:21.0:1773851852.776029:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000008c4261a5: Posted send of 38 bytes to peer 0x1000000000006be: rc=0
00000400:00000200:23.0:1773851852.776030:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18080@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.776031:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053c00a5c nid 18080@kfi7 refs 2
00000800:00000200:21.0:1773851852.776031:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:23.0:1773851852.776032:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000053c00a5c nid 18080@kfi7 refs 3
00000400:00000200:23.0:1773851852.776033:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18017@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.776034:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18017@kfi7 of length 224 into portal 12 MB=0x69b82ee04dd00
00000400:00000200:23.0:1773851852.776036:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18017@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 22688
00000800:00000200:23.0:1773851852.776038:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851852.776039:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851852.776040:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be TN_EVENT_TX_OK event status 0
00000400:00000200:23.0:1773851852.776041:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18080@kfi7: PUT: OK
00000100:00000001:23.0:1773851852.776042:0:2495434:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:23.0:1773851852.776042:0:2495434:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:21.0:1773851852.776043:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be Transaction freed
00000100:00000010:23.0:1773851852.776044:0:2495434:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000089d43385.
00000100:00000040:23.0:1773851852.776044:0:2495434:0:(events.c:358:request_in_callback()) incoming req@0000000089d43385 x1859836501613824 msgsize 224
00000100:00100000:23.0:1773851852.776046:0:2495434:0:(events.c:361:request_in_callback()) peer: 12345-18017@kfi7 (source: 12345-18080@kfi7)
00000100:00000001:23.0:1773851852.776047:0:2495434:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:23.0:1773851852.776048:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000053c00a5c nid 18080@kfi7 refs 2
00000100:00000001:22.0:1773851852.776048:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:23.0:1773851852.776049:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851852.776049:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851852.776049:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851852.776050:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851852.776051:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851852.776051:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836501613824
00000020:00000001:22.0:1773851852.776052:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851852.776052:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d6e6a7
00000020:00000001:22.0:1773851852.776053:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851852.776058:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005602a7a2 refcount=5
00000020:00000001:22.0:1773851852.776058:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095721517056 : -106977988034560 : ffff9eb43f064000)
00000020:00000001:22.0:1773851852.776059:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637095721517056 : -106977988034560 : ffff9eb43f064000)
00000100:00000001:22.0:1773851852.776060:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851852.776062:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851852.776063:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2b41301.
00000020:00000010:22.0:1773851852.776064:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851852.776065:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030b42b18.
00000100:00000001:22.0:1773851852.776066:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851852.776066:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851852.776067:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851852.776068:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851852.776068:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851852.776069:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.776070:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.776071:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.776071:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.776071:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851852.776072:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851852.776073:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18017@kfi7, seq: 1997922
00000100:00000001:23.0:1773851852.776074:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.776074:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851852.776074:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005602a7a2 : new rpc_count 1
00000100:00000001:22.0:1773851852.776074:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133285628672 : -106940423922944 : ffff9ebcfe051b00)
00000100:00000040:22.0:1773851852.776076:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000089d43385 x1859836501613824/t0(0) o400->799294c7-b7c7-4892-8b83-c4ee8be75c49@18017@kfi7:492/0 lens 224/0 e 0 to 0 dl 1773852607 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1616-0'
00000100:00000001:22.0:1773851852.776078:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851852.776079:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851852.776080:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089d43385 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:799294c7-b7c7-4892-8b83-c4ee8be75c49+5:40443:x1859836501613824:12345-18017@kfi7:400:default-tuolumne1616-0
00000100:00000200:22.0:1773851852.776081:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836501613824
00000020:00000001:22.0:1773851852.776082:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851852.776082:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851852.776083:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.776084:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851852.776084:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851852.776085:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851852.776086:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836501613824, found 0 last_xid 1859836501613823
00000020:00000001:22.0:1773851852.776087:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851852.776087:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851852.776088:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851852.776088:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.776090:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851852.776090:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851852.776091:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851852.776091:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e095521.
02000000:00000001:22.0:1773851852.776092:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.776093:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.776093:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851852.776094:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183001219526, transno 0, xid 1859836501613824
00010000:00000001:22.0:1773851852.776095:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851852.776096:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000089d43385 x1859836501613824/t0(0) o400->799294c7-b7c7-4892-8b83-c4ee8be75c49@18017@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1616-0'
00010000:00000001:22.0:1773851852.776098:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851852.776099:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851852.776100:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=85 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851852.776101:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851852.776102:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004f582f4e refcount 3 to 18017@kfi7
00000100:00000001:22.0:1773851852.776102:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026240 : -107156745525376 : ffff9e8aa03f6780)
02000000:00000001:22.0:1773851852.776103:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851852.776103:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.776104:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851852.776105:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18080@kfi7
00000400:00000010:22.0:1773851852.776106:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b3a5ce20.
00000100:00000200:22.0:1773851852.776107:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836501613824, offset 224
00000400:00000200:22.0:1773851852.776108:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18080@kfi7
00000400:00000200:22.0:1773851852.776109:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18080@kfi7 to cpt 5
00000400:00000200:22.0:1773851852.776110:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053c00a5c nid 18080@kfi7 refs 1
00000400:00000200:22.0:1773851852.776111:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000053c00a5c nid 18080@kfi7 refs 2
00000400:00000200:22.0:1773851852.776112:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000053c00a5c nid 18080@kfi7 refs 3
00000400:00000200:22.0:1773851852.776113:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18080@kfi7 local destination
00000400:00000200:22.0:1773851852.776114:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768540:8768540:1024:4294967295] 18080@kfi7 LPNI seq info [170572:170572:16:4294967295]
00000400:00000200:22.0:1773851852.776116:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000053c00a5c nid 18080@kfi7 refs 2
00000400:00000200:22.0:1773851852.776117:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18080@kfi7 to cpt 5
00000400:00000200:22.0:1773851852.776118:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18080@kfi7(18080@kfi7:18080@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851852.776120:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000053c00a5c nid 18080@kfi7 refs 3
00000800:00000200:22.0:1773851852.776122:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851852.776123:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851852.776125:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851852.776127:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be Using peer 18080@kfi7(0x1000000000006be)
00000800:00000200:22.0:1773851852.776130:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000389ce1b3: Posted send of 324 bytes to peer 0x1000000000006be: rc=0
00000800:00000200:22.0:1773851852.776131:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851852.776134:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851852.776134:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004f582f4e refcount 2 to 18017@kfi7
00010000:00000001:22.0:1773851852.776135:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851852.776136:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.776136:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851852.776137:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000089d43385 x1859836501613824/t0(0) o400->799294c7-b7c7-4892-8b83-c4ee8be75c49@18017@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1616-0'
00000100:00100000:22.0:1773851852.776140:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089d43385 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:799294c7-b7c7-4892-8b83-c4ee8be75c49+5:40443:x1859836501613824:12345-18017@kfi7:400:default-tuolumne1616-0 Request processed in 61us (95us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851852.776141:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851852.776142:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:22.0:1773851852.776143:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18017@kfi7, seq: 1997922
00000400:00000200:21.0:1773851852.776143:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18080@kfi7: PUT: OK
00000100:00000040:22.0:1773851852.776144:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005602a7a2 : new rpc_count 0
00000400:00000200:21.0:1773851852.776144:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b3a5ce20
00000400:00000010:21.0:1773851852.776144:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b3a5ce20.
00000100:00000001:22.0:1773851852.776145:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851852.776145:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:21.0:1773851852.776145:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851852.776145:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851852.776146:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851852.776146:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030b42b18.
00000400:00000200:21.0:1773851852.776146:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000053c00a5c nid 18080@kfi7 refs 2
00000020:00000010:22.0:1773851852.776147:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2b41301.
00000800:00000200:21.0:1773851852.776147:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 18080@kfi7(00000000d2b65664):0x0 lsk 1727 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000006be Transaction freed
00000020:00000040:22.0:1773851852.776148:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000005602a7a2 : new refcount 4
00000100:00000001:22.0:1773851852.776149:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851852.843050:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851852.843051:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851852.843052:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851852.843054:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851852.843056:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.843057:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13522@kfi7 : PUT - for me
00000400:00000200:21.0:1773851852.843057:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.843058:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 1
00000400:00000200:21.0:1773851852.843059:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.843060:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000400:00000200:21.0:1773851852.843061:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 3
00000400:00000200:21.0:1773851852.843061:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.843062:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13522@kfi7 of length 224 into portal 12 MB=0x699e0d8dd64c0
00000400:00000200:21.0:1773851852.843063:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13522@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 22912
00000800:00000200:21.0:1773851852.843065:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851852.843066:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851852.843067:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13522@kfi7: PUT: OK
00000100:00000001:21.0:1773851852.843068:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851852.843068:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851852.843069:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003452dcce.
00000100:00000040:21.0:1773851852.843069:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000003452dcce x1858040850375872 msgsize 224
00000100:00100000:21.0:1773851852.843071:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13522@kfi7 (source: 12345-13522@kfi7)
00000100:00000001:21.0:1773851852.843071:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851852.843072:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000100:00000001:22.0:1773851852.843073:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851852.843074:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851852.843074:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851852.843074:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851852.843074:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851852.843075:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851852.843076:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040850375872
00000020:00000001:22.0:1773851852.843076:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851852.843077:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91bbb
00000020:00000001:22.0:1773851852.843077:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851852.843081:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000da179c1d refcount=6
00000020:00000001:22.0:1773851852.843082:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628017152 : -107123081534464 : ffff9e9276c72400)
00000020:00000001:22.0:1773851852.843083:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628017152 : -107123081534464 : ffff9e9276c72400)
00000100:00000001:22.0:1773851852.843083:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851852.843084:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851852.843085:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2b41301.
00000020:00000010:22.0:1773851852.843085:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851852.843086:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030b42b18.
00000100:00000001:22.0:1773851852.843087:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851852.843087:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851852.843087:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851852.843088:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851852.843089:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851852.843089:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.843090:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.843091:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.843091:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.843091:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851852.843092:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851852.843092:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13522@kfi7, seq: 1997923
00000100:00000001:23.0:1773851852.843093:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.843093:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851852.843093:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000da179c1d : new rpc_count 1
00000100:00000001:22.0:1773851852.843093:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117340544 : -106995592211072 : ffff9eb025bbd580)
00000100:00000040:22.0:1773851852.843094:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003452dcce x1858040850375872/t0(0) o400->b0a8b929-be92-42d5-8320-c2004ce3aa74@13522@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1333-0'
00000100:00000001:22.0:1773851852.843097:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851852.843097:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851852.843098:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003452dcce pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b0a8b929-be92-42d5-8320-c2004ce3aa74+6:39809:x1858040850375872:12345-13522@kfi7:400:default-tuolumne1333-0
00000100:00000200:22.0:1773851852.843101:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040850375872
00000020:00000001:22.0:1773851852.843102:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851852.843102:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851852.843103:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.843103:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851852.843104:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851852.843104:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851852.843105:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040850375872, found 0 last_xid 1858040850375871
00000020:00000001:22.0:1773851852.843105:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851852.843106:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851852.843106:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851852.843107:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.843107:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851852.843108:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851852.843108:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851852.843110:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000071a512d9.
02000000:00000001:22.0:1773851852.843110:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.843111:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.843111:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851852.843112:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 173177117327, transno 0, xid 1858040850375872
00010000:00000001:22.0:1773851852.843112:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851852.843113:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003452dcce x1858040850375872/t0(0) o400->b0a8b929-be92-42d5-8320-c2004ce3aa74@13522@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1333-0'
00010000:00000001:22.0:1773851852.843115:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851852.843116:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851852.843116:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=85 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851852.843117:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851852.843118:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000066d61f3d refcount 3 to 13522@kfi7
00000100:00000001:22.0:1773851852.843118:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027680 : -107156745523936 : ffff9e8aa03f6d20)
02000000:00000001:22.0:1773851852.843119:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851852.843119:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.843120:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851852.843121:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13522@kfi7
00000400:00000010:22.0:1773851852.843121:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a596cda7.
00000100:00000200:22.0:1773851852.843123:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040850375872, offset 224
00000400:00000200:22.0:1773851852.843124:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13522@kfi7
00000400:00000200:22.0:1773851852.843124:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:22.0:1773851852.843125:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 1
00000400:00000200:22.0:1773851852.843126:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000400:00000200:22.0:1773851852.843127:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 3
00000400:00000200:22.0:1773851852.843128:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13522@kfi7 local destination
00000400:00000200:22.0:1773851852.843129:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768541:8768541:1024:4294967295] 13522@kfi7 LPNI seq info [15735:15735:16:4294967295]
00000400:00000200:22.0:1773851852.843130:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000400:00000200:22.0:1773851852.843131:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:22.0:1773851852.843133:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13522@kfi7(13522@kfi7:13522@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851852.843134:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 3
00000800:00000200:22.0:1773851852.843135:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851852.843136:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851852.843138:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851852.843140:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x824 Using peer 13522@kfi7(0x824)
00000800:00000200:22.0:1773851852.843143:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000008ad6e841: Posted send of 324 bytes to peer 0x824: rc=0
00000800:00000200:22.0:1773851852.843144:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x824 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851852.843146:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851852.843146:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000066d61f3d refcount 2 to 13522@kfi7
00010000:00000001:22.0:1773851852.843147:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851852.843147:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851852.843148:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851852.843148:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003452dcce x1858040850375872/t0(0) o400->b0a8b929-be92-42d5-8320-c2004ce3aa74@13522@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1333-0'
00000100:00100000:22.0:1773851852.843151:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003452dcce pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b0a8b929-be92-42d5-8320-c2004ce3aa74+6:39809:x1858040850375872:12345-13522@kfi7:400:default-tuolumne1333-0 Request processed in 53us (81us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851852.843156:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13522@kfi7, seq: 1997923
00000800:00000200:21.0:1773851852.843156:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x824 TN_EVENT_TX_OK event status 0
00000100:00000040:22.0:1773851852.843157:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000da179c1d : new rpc_count 0
00000100:00000001:22.0:1773851852.843157:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851852.843157:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851852.843158:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851852.843158:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851852.843158:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13522@kfi7: PUT: OK
00000020:00000010:22.0:1773851852.843159:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030b42b18.
00000400:00000200:21.0:1773851852.843159:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a596cda7
00000400:00000010:21.0:1773851852.843159:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a596cda7.
00000020:00000010:22.0:1773851852.843160:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2b41301.
00000020:00000040:22.0:1773851852.843160:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000da179c1d : new refcount 5
00000100:00000001:21.0:1773851852.843160:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851852.843160:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:22.0:1773851852.843161:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851852.843161:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000800:00000200:21.0:1773851852.843163:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 13522@kfi7(00000000c03e9eda):0x0 lsk 2085 rsk 59 tsk 0 trmk 0 tmk 0 trr 5 tta 0x824 Transaction freed
00000800:00000200:29.0:1773851852.852255:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.852256:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851852.852259:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851852.852261:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851852.852263:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.852264:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19201@kfi7 : PUT - for me
00000400:00000200:29.0:1773851852.852265:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.852266:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 1
00000400:00000200:29.0:1773851852.852267:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.852268:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000400:00000200:29.0:1773851852.852269:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 3
00000400:00000200:29.0:1773851852.852270:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19200@kfi7 to cpt 4
00000400:00000200:29.0:1773851852.852271:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19200@kfi7 of length 224 into portal 12 MB=0x69b4b849c9fc0
00000400:00000200:29.0:1773851852.852272:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19200@kfi7 of length 224/224 into md 0x77fe139dd [64] + 159112
00000800:00000200:29.0:1773851852.852274:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851852.852275:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851852.852276:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19201@kfi7: PUT: OK
00000100:00000001:29.0:1773851852.852277:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851852.852278:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851852.852279:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042094d87.
00000100:00000040:29.0:1773851852.852279:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000042094d87 x1859598509973440 msgsize 224
00000100:00100000:29.0:1773851852.852281:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19200@kfi7 (source: 12345-19201@kfi7)
00000100:00000001:29.0:1773851852.852282:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851852.852283:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000800:00000200:29.0:1773851852.852284:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851852.852287:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851852.852287:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851852.852287:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851852.852288:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851852.852289:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.852290:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598509973440
00000020:00000001:29.0:1773851852.852290:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851852.852291:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81caa
00000020:00000001:29.0:1773851852.852291:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851852.852294:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000efb06e4b refcount=5
00000020:00000001:29.0:1773851852.852294:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139323327488 : -106934386224128 : ffff9ebe65e51400)
00000020:00000001:29.0:1773851852.852295:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139323327488 : -106934386224128 : ffff9ebe65e51400)
00000100:00000001:29.0:1773851852.852296:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.852298:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851852.852298:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a5f84808.
00000020:00000010:29.0:1773851852.852299:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851852.852300:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851852.852301:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851852.852301:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851852.852302:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.852303:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851852.852303:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851852.852303:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.852304:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851852.852305:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851852.852306:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851852.852306:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851852.852306:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851852.852307:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851852.852307:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19200@kfi7, seq: 2055450
00000100:00000040:29.0:1773851852.852307:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000efb06e4b : new rpc_count 1
00000100:00000001:31.0:1773851852.852308:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.852308:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224848640 : -106962484702976 : ffff9eb7db185100)
00000100:00000040:29.0:1773851852.852309:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042094d87 x1859598509973440/t0(0) o400->f1a14405-9455-40ba-a816-ab7b23799e06@19200@kfi7:640/0 lens 224/0 e 0 to 0 dl 1773852000 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1699-0'
00000100:00000001:29.0:1773851852.852312:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851852.852312:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851852.852313:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042094d87 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f1a14405-9455-40ba-a816-ab7b23799e06+5:39526:x1859598509973440:12345-19200@kfi7:400:default-tuolumne1699-0
00000100:00000200:29.0:1773851852.852315:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598509973440
00000020:00000001:29.0:1773851852.852316:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851852.852316:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851852.852317:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.852318:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851852.852319:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851852.852320:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851852.852320:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598509973440, found 0 last_xid 1859598509973439
00000020:00000001:29.0:1773851852.852321:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851852.852322:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851852.852322:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851852.852323:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.852324:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851852.852324:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851852.852325:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851852.852326:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001d1a7a8a.
02000000:00000001:29.0:1773851852.852326:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.852327:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.852328:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851852.852328:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262830027, transno 0, xid 1859598509973440
00010000:00000001:29.0:1773851852.852329:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851852.852330:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042094d87 x1859598509973440/t0(0) o400->f1a14405-9455-40ba-a816-ab7b23799e06@19200@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1699-0'
00010000:00000001:29.0:1773851852.852333:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851852.852333:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851852.852334:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=85 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851852.852335:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851852.852336:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ab0141db refcount 3 to 19200@kfi7
00000100:00000001:29.0:1773851852.852337:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333376 : -107155408218240 : ffff9e8aeff51780)
02000000:00000001:29.0:1773851852.852338:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851852.852338:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851852.852339:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851852.852340:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19201@kfi7
00000400:00000010:29.0:1773851852.852341:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e59cee39.
00000100:00000200:29.0:1773851852.852341:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598509973440, offset 224
00000400:00000200:29.0:1773851852.852343:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19201@kfi7
00000400:00000200:29.0:1773851852.852344:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.852344:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 1
00000400:00000200:29.0:1773851852.852346:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000400:00000200:29.0:1773851852.852347:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 3
00000400:00000200:29.0:1773851852.852349:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19201@kfi7 local destination
00000400:00000200:29.0:1773851852.852351:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768542:8768542:1024:4294967295] 19201@kfi7 LPNI seq info [9070806:9070806:16:4294967295]
00000400:00000200:29.0:1773851852.852352:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000400:00000200:29.0:1773851852.852353:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851852.852355:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19201@kfi7(19201@kfi7:19201@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851852.852356:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 3
00000800:00000200:29.0:1773851852.852358:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851852.852359:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851852.852361:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851852.852364:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdd5 Using peer 19201@kfi7(0xdd5)
00000800:00000200:29.0:1773851852.852367:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0xdd5: rc=0
00000800:00000200:29.0:1773851852.852369:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdd5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851852.852371:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851852.852372:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ab0141db refcount 2 to 19200@kfi7
00010000:00000001:29.0:1773851852.852373:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851852.852373:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851852.852374:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851852.852375:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042094d87 x1859598509973440/t0(0) o400->f1a14405-9455-40ba-a816-ab7b23799e06@19200@kfi7:640/0 lens 224/224 e 0 to 0 dl 1773852000 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1699-0'
00000100:00100000:29.0:1773851852.852378:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042094d87 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f1a14405-9455-40ba-a816-ab7b23799e06+5:39526:x1859598509973440:12345-19200@kfi7:400:default-tuolumne1699-0 Request processed in 65us (98us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851852.852381:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19200@kfi7, seq: 2055450
00000800:00000200:30.0:1773851852.852382:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdd5 TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851852.852382:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000efb06e4b : new rpc_count 0
00000100:00000001:29.0:1773851852.852383:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:30.0:1773851852.852384:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851852.852384:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851852.852384:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851852.852385:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19201@kfi7: PUT: OK
00000020:00000010:29.0:1773851852.852385:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000400:00000200:30.0:1773851852.852386:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e59cee39
00000020:00000010:29.0:1773851852.852386:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a5f84808.
00000400:00000010:30.0:1773851852.852387:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e59cee39.
00000100:00000001:30.0:1773851852.852387:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:29.0:1773851852.852387:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000efb06e4b : new refcount 4
00000100:00000001:30.0:1773851852.852388:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:29.0:1773851852.852388:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851852.852389:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000800:00000200:30.0:1773851852.852390:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 19201@kfi7(00000000e5844947):0x0 lsk 3542 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdd5 Transaction freed
00000800:00000200:13.0:1773851852.871553:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851852.871555:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851852.871556:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851852.871559:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851852.871561:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.871562:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13058@kfi7 : PUT - for me
00000400:00000200:13.0:1773851852.871563:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.871564:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 1
00000400:00000200:13.0:1773851852.871565:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.871566:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000400:00000200:13.0:1773851852.871566:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 3
00000400:00000200:13.0:1773851852.871567:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.871568:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13058@kfi7 of length 224 into portal 12 MB=0x69b4b6b5a3a80
00000400:00000200:13.0:1773851852.871570:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13058@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 12104
00000800:00000200:13.0:1773851852.871571:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851852.871573:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851852.871574:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13058@kfi7: PUT: OK
00000100:00000001:13.0:1773851852.871575:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851852.871575:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851852.871576:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c282ffe5.
00000100:00000040:13.0:1773851852.871577:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c282ffe5 x1859598086191744 msgsize 224
00000100:00100000:13.0:1773851852.871578:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13058@kfi7 (source: 12345-13058@kfi7)
00000100:00000001:13.0:1773851852.871579:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851852.871580:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000100:00000001:14.0:1773851852.871581:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851852.871582:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851852.871582:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851852.871583:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851852.871583:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851852.871584:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851852.871585:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598086191744
00000020:00000001:14.0:1773851852.871586:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851852.871587:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e06d
00000020:00000001:14.0:1773851852.871587:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851852.871591:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c346a78b refcount=5
00000020:00000001:14.0:1773851852.871592:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636920812368896 : -107152897182720 : ffff9e8b85a07400)
00000020:00000001:14.0:1773851852.871593:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636920812368896 : -107152897182720 : ffff9e8b85a07400)
00000100:00000001:14.0:1773851852.871594:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851852.871595:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851852.871596:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a7b6048b.
00000020:00000010:14.0:1773851852.871598:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851852.871599:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000001:14.0:1773851852.871600:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851852.871600:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851852.871601:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851852.871602:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851852.871603:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851852.871603:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851852.871604:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851852.871606:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851852.871606:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851852.871607:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851852.871607:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851852.871608:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13058@kfi7, seq: 2289766
00000100:00000001:14.0:1773851852.871609:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851852.871609:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c346a78b : new rpc_count 1
00000100:00000001:14.0:1773851852.871610:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851852.871610:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197408000 : -106942512143616 : ffff9ebc818d6300)
00000100:00000040:13.0:1773851852.871612:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c282ffe5 x1859598086191744/t0(0) o400->aa4c535c-afaa-414b-a725-478a416db45e@13058@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1319-0'
00000100:00000001:13.0:1773851852.871615:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851852.871615:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851852.871616:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c282ffe5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:aa4c535c-afaa-414b-a725-478a416db45e+5:39708:x1859598086191744:12345-13058@kfi7:400:default-tuolumne1319-0
00000100:00000200:13.0:1773851852.871618:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598086191744
00000020:00000001:13.0:1773851852.871619:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851852.871619:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851852.871620:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851852.871621:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851852.871621:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851852.871622:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851852.871623:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598086191744, found 0 last_xid 1859598086191743
00000020:00000001:13.0:1773851852.871624:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851852.871624:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851852.871625:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851852.871625:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851852.871626:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851852.871627:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851852.871627:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851852.871628:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009e773d58.
02000000:00000001:13.0:1773851852.871629:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851852.871629:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851852.871630:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851852.871631:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183210479690, transno 0, xid 1859598086191744
00010000:00000001:13.0:1773851852.871632:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851852.871633:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c282ffe5 x1859598086191744/t0(0) o400->aa4c535c-afaa-414b-a725-478a416db45e@13058@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1319-0'
00010000:00000001:13.0:1773851852.871635:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851852.871636:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851852.871636:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=85 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851852.871638:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851852.871639:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004e14d67a refcount 3 to 13058@kfi7
00000100:00000001:13.0:1773851852.871640:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620352 : -107151221931264 : ffff9e8be97ac300)
02000000:00000001:13.0:1773851852.871641:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851852.871641:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851852.871642:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851852.871643:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13058@kfi7
00000400:00000010:13.0:1773851852.871644:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000beb6bb34.
00000100:00000200:13.0:1773851852.871644:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598086191744, offset 224
00000400:00000200:13.0:1773851852.871646:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13058@kfi7
00000400:00000200:13.0:1773851852.871647:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.871647:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 1
00000400:00000200:13.0:1773851852.871649:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000400:00000200:13.0:1773851852.871650:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 3
00000400:00000200:13.0:1773851852.871651:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13058@kfi7 local destination
00000400:00000200:13.0:1773851852.871652:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768543:8768543:1024:4294967295] 13058@kfi7 LPNI seq info [7000135:7000135:16:4294967295]
00000400:00000200:13.0:1773851852.871654:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000400:00000200:13.0:1773851852.871655:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851852.871656:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13058@kfi7(13058@kfi7:13058@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851852.871658:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 3
00000800:00000200:13.0:1773851852.871659:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851852.871660:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851852.871662:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851852.871664:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x7e6 Using peer 13058@kfi7(0x7e6)
00000800:00000200:13.0:1773851852.871668:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 324 bytes to peer 0x7e6: rc=0
00000800:00000200:13.0:1773851852.871669:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x7e6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851852.871671:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851852.871672:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004e14d67a refcount 2 to 13058@kfi7
00010000:00000001:13.0:1773851852.871673:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851852.871673:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851852.871674:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851852.871675:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c282ffe5 x1859598086191744/t0(0) o400->aa4c535c-afaa-414b-a725-478a416db45e@13058@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1319-0'
00000100:00100000:13.0:1773851852.871677:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c282ffe5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:aa4c535c-afaa-414b-a725-478a416db45e+5:39708:x1859598086191744:12345-13058@kfi7:400:default-tuolumne1319-0 Request processed in 62us (99us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851852.871680:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13058@kfi7, seq: 2289766
00000100:00000040:13.0:1773851852.871681:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c346a78b : new rpc_count 0
00000800:00000200:15.0:1773851852.871682:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x7e6 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851852.871682:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851852.871682:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851852.871683:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000400:00000200:15.0:1773851852.871684:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851852.871684:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000020:00000010:13.0:1773851852.871684:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a7b6048b.
00000020:00000040:13.0:1773851852.871685:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c346a78b : new refcount 4
00000400:00000200:15.0:1773851852.871686:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13058@kfi7: PUT: OK
00000100:00000001:13.0:1773851852.871686:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851852.871687:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000beb6bb34
00000400:00000010:15.0:1773851852.871687:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000beb6bb34.
00000100:00000001:15.0:1773851852.871688:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851852.871688:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851852.871689:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000800:00000200:15.0:1773851852.871691:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 13058@kfi7(00000000a294c1ae):0x0 lsk 2023 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x7e6 Transaction freed
00000800:00000200:19.0:1773851852.879713:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851852.879713:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851852.879714:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851852.879715:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:19.0:1773851852.879716:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851852.879716:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:19.0:1773851852.879718:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:19.0:1773851852.879720:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000800:00000200:17.0:1773851852.879720:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25473@kfi7(00000000b9eb3de5):0xbac version: 2; local version 2; negotiated version: 2
00000400:00000200:19.0:1773851852.879721:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25473@kfi7 : PUT - for me
00000400:00000200:19.0:1773851852.879722:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:19.0:1773851852.879723:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 1
00000800:00000200:17.0:1773851852.879723:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac Using peer 25473@kfi7(0x100000000000bac)
00000400:00000200:19.0:1773851852.879730:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:19.0:1773851852.879731:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000400:00000200:19.0:1773851852.879732:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 3
00000400:00000200:19.0:1773851852.879733:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25472@kfi7 to cpt 1
00000400:00000200:19.0:1773851852.879734:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25472@kfi7 of length 224 into portal 12 MB=0x699e0d0d4b2c0
00000400:00000200:17.0:1773851852.879735:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:19.0:1773851852.879736:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25472@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 187840
00000800:00000200:19.0:1773851852.879738:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851852.879738:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x100000000000bac: rc=0
00000400:00000200:19.0:1773851852.879740:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851852.879741:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25473@kfi7: PUT: OK
00000800:00000200:17.0:1773851852.879741:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851852.879742:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851852.879743:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851852.879744:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006fcc29bf.
00000100:00000040:19.0:1773851852.879745:0:2464491:0:(events.c:358:request_in_callback()) incoming req@000000006fcc29bf x1858040715588288 msgsize 224
00000100:00100000:19.0:1773851852.879746:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-25472@kfi7 (source: 12345-25473@kfi7)
00000100:00000001:19.0:1773851852.879748:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851852.879749:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000800:00000200:19.0:1773851852.879751:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000281c67ea: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851852.879753:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851852.879754:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851852.879754:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851852.879755:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851852.879755:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851852.879756:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040715588288
00000800:00000200:18.0:1773851852.879756:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac TN_EVENT_TX_OK event status 0
00000020:00000001:19.0:1773851852.879757:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851852.879757:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ea0
00000020:00000001:19.0:1773851852.879758:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:18.0:1773851852.879761:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac Transaction freed
00000020:00000040:19.0:1773851852.879762:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d154656 refcount=6
00000020:00000001:19.0:1773851852.879762:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744651776 : -107128964899840 : ffff9e91181a1c00)
00000020:00000001:19.0:1773851852.879763:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744651776 : -107128964899840 : ffff9e91181a1c00)
00000100:00000001:19.0:1773851852.879764:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851852.879764:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851852.879765:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5d5268b.
00000020:00000010:19.0:1773851852.879766:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851852.879767:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050d3142f.
00000100:00000001:19.0:1773851852.879769:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851852.879769:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851852.879770:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851852.879771:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851852.879771:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851852.879772:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851852.879773:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851852.879774:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851852.879774:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851852.879775:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851852.879776:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25472@kfi7, seq: 2156251
00000100:00000040:19.0:1773851852.879776:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009d154656 : new rpc_count 1
00000100:00000001:18.0:1773851852.879776:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851852.879777:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339152512 : -106987370399104 : ffff9eb20fcaba80)
00000100:00000001:18.0:1773851852.879777:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851852.879778:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006fcc29bf x1858040715588288/t0(0) o400->ea17e9ac-929c-40d5-9605-398b01644c5e@25472@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2084-0'
00000100:00000001:18.0:1773851852.879778:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851852.879780:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851852.879781:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851852.879782:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006fcc29bf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ea17e9ac-929c-40d5-9605-398b01644c5e+6:39804:x1858040715588288:12345-25472@kfi7:400:default-tuolumne2084-0
00000100:00000200:19.0:1773851852.879783:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040715588288
00000020:00000001:19.0:1773851852.879783:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851852.879784:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851852.879785:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851852.879785:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851852.879786:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851852.879787:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851852.879787:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040715588288, found 0 last_xid 1858040715588287
00000020:00000001:19.0:1773851852.879788:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851852.879789:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851852.879789:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851852.879790:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851852.879790:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851852.879791:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851852.879791:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851852.879792:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b6c87683.
02000000:00000001:19.0:1773851852.879793:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851852.879794:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851852.879794:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851852.879795:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182998107156, transno 0, xid 1858040715588288
00010000:00000001:19.0:1773851852.879796:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851852.879796:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006fcc29bf x1858040715588288/t0(0) o400->ea17e9ac-929c-40d5-9605-398b01644c5e@25472@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2084-0'
00010000:00000001:19.0:1773851852.879799:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851852.879799:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851852.879800:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=85 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851852.879801:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851852.879802:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001c97e1aa refcount 3 to 25472@kfi7
00000100:00000001:19.0:1773851852.879802:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412480 : -107145304139136 : ffff9e8d4a351a80)
02000000:00000001:19.0:1773851852.879803:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851852.879804:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851852.879804:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851852.879805:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25473@kfi7
00000400:00000010:19.0:1773851852.879806:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df1656e9.
00000100:00000200:19.0:1773851852.879807:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040715588288, offset 224
00000400:00000200:19.0:1773851852.879808:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25473@kfi7
00000400:00000200:19.0:1773851852.879809:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:19.0:1773851852.879809:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 1
00000400:00000200:19.0:1773851852.879811:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000400:00000200:19.0:1773851852.879812:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 3
00000400:00000200:19.0:1773851852.879813:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25473@kfi7 local destination
00000400:00000200:19.0:1773851852.879814:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768544:8768544:1024:4294967295] 25473@kfi7 LPNI seq info [8126579:8126579:16:4294967295]
00000400:00000200:19.0:1773851852.879815:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000400:00000200:19.0:1773851852.879816:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:19.0:1773851852.879818:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25473@kfi7(25473@kfi7:25473@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851852.879820:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 3
00000800:00000200:19.0:1773851852.879821:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851852.879822:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851852.879826:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851852.879829:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac Using peer 25473@kfi7(0x100000000000bac)
00000800:00000200:19.0:1773851852.879832:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x100000000000bac: rc=0
00000800:00000200:19.0:1773851852.879833:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851852.879835:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851852.879836:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001c97e1aa refcount 2 to 25472@kfi7
00010000:00000001:19.0:1773851852.879837:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851852.879837:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851852.879838:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851852.879839:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006fcc29bf x1858040715588288/t0(0) o400->ea17e9ac-929c-40d5-9605-398b01644c5e@25472@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2084-0'
00000100:00100000:19.0:1773851852.879841:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006fcc29bf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ea17e9ac-929c-40d5-9605-398b01644c5e+6:39804:x1858040715588288:12345-25472@kfi7:400:default-tuolumne2084-0 Request processed in 60us (96us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851852.879843:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25472@kfi7, seq: 2156251
00000100:00000040:19.0:1773851852.879844:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009d154656 : new rpc_count 0
00000100:00000001:19.0:1773851852.879845:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851852.879845:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851852.879846:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851852.879847:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050d3142f.
00000020:00000010:19.0:1773851852.879847:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5d5268b.
00000020:00000040:19.0:1773851852.879848:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000009d154656 : new refcount 5
00000800:00000200:17.0:1773851852.879848:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851852.879849:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851852.879850:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851852.879852:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25473@kfi7: PUT: OK
00000400:00000200:17.0:1773851852.879853:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df1656e9
00000400:00000010:17.0:1773851852.879854:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df1656e9.
00000100:00000001:17.0:1773851852.879855:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851852.879856:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851852.879857:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000800:00000200:17.0:1773851852.879860:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 25473@kfi7(00000000b9eb3de5):0x0 lsk 2989 rsk 54 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bac Transaction freed
00000800:00000200:1.0:1773851852.890148:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.890149:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851852.890151:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851852.890155:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851852.890158:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21330@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.890160:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21330@kfi7 : PUT - for me
00000400:00000200:1.0:1773851852.890162:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21330@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.890163:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb831fc3 nid 21330@kfi7 refs 1
00000400:00000200:1.0:1773851852.890165:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21330@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.890166:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb831fc3 nid 21330@kfi7 refs 2
00000400:00000200:1.0:1773851852.890167:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eb831fc3 nid 21330@kfi7 refs 3
00000400:00000200:1.0:1773851852.890169:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:1.0:1773851852.890170:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21395@kfi7 of length 224 into portal 12 MB=0x699e172ba1900
00000400:00000200:1.0:1773851852.890173:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21395@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 9744
00000800:00000200:1.0:1773851852.890176:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851852.890178:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851852.890180:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21330@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.890182:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851852.890183:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851852.890185:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000089963df.
00000100:00000040:1.0:1773851852.890186:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000089963df x1858043431753984 msgsize 224
00000100:00100000:1.0:1773851852.890189:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-21395@kfi7 (source: 12345-21330@kfi7)
00000100:00000001:1.0:1773851852.890191:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851852.890193:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb831fc3 nid 21330@kfi7 refs 2
00000800:00000200:1.0:1773851852.890195:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851852.890199:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851852.890200:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.890201:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.890202:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.890203:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.890204:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043431753984
00000020:00000001:1.0:1773851852.890205:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.890206:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a72
00000020:00000001:1.0:1773851852.890207:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.890208:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000365e249d refcount=377
00000020:00000001:1.0:1773851852.890210:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627753984 : -107123081797632 : ffff9e9276c32000)
00000020:00000001:1.0:1773851852.890211:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627753984 : -107123081797632 : ffff9e9276c32000)
00000100:00000001:1.0:1773851852.890212:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.890213:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.890214:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5405d62.
00000020:00000010:1.0:1773851852.890216:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851852.890217:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.890218:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.890219:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851852.890220:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.890221:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851852.890222:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851852.890223:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.890224:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.890226:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.890227:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.890227:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851852.890227:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851852.890229:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21395@kfi7, seq: 1997480
00000100:00000001:2.0:1773851852.890230:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.890230:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000365e249d : new rpc_count 9
00000100:00000001:2.0:1773851852.890231:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.890231:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637155385767168 : -106918323784448 : ffff9ec2234a7500)
00000100:00000040:1.0:1773851852.890233:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000089963df x1858043431753984/t0(0) o400->99ccfe45-9361-4db1-8454-203e5e6f3a21@21395@kfi7:492/0 lens 224/0 e 0 to 0 dl 1773852607 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1830-0'
00000100:00000001:1.0:1773851852.890238:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.890239:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.890240:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000089963df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:99ccfe45-9361-4db1-8454-203e5e6f3a21+377:39826:x1858043431753984:12345-21395@kfi7:400:default-tuolumne1830-0
00000100:00000200:1.0:1773851852.890242:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043431753984
00000020:00000001:1.0:1773851852.890243:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.890244:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.890245:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.890246:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.890247:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851852.890248:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.890249:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043431753984, found 0 last_xid 1858043431070143
00000020:00000001:1.0:1773851852.890251:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.890252:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.890252:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.890253:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.890254:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851852.890255:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.890256:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.890257:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f091a3c3.
02000000:00000001:1.0:1773851852.890258:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.890259:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.890260:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.890261:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578717, transno 0, xid 1858043431753984
00010000:00000001:1.0:1773851852.890262:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.890264:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000089963df x1858043431753984/t0(0) o400->99ccfe45-9361-4db1-8454-203e5e6f3a21@21395@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1830-0'
00010000:00000001:1.0:1773851852.890268:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.890268:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.890270:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.890271:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.890273:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006f4ad592 refcount 3 to 21395@kfi7
00000100:00000001:1.0:1773851852.890274:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603211136 : -107155106340480 : ffff9e8b01f36180)
02000000:00000001:1.0:1773851852.890275:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.890276:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.890277:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.890278:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21330@kfi7
00000400:00000010:1.0:1773851852.890279:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004677a1ce.
00000100:00000200:1.0:1773851852.890280:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043431753984, offset 224
00000400:00000200:1.0:1773851852.890282:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21330@kfi7
00000400:00000200:1.0:1773851852.890284:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21330@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.890285:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb831fc3 nid 21330@kfi7 refs 1
00000400:00000200:1.0:1773851852.890286:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eb831fc3 nid 21330@kfi7 refs 2
00000400:00000200:1.0:1773851852.890288:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eb831fc3 nid 21330@kfi7 refs 3
00000400:00000200:1.0:1773851852.890290:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21330@kfi7 local destination
00000400:00000200:1.0:1773851852.890292:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768545:8768545:1024:4294967295] 21330@kfi7 LPNI seq info [2139297:2139297:16:4294967295]
00000400:00000200:1.0:1773851852.890294:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eb831fc3 nid 21330@kfi7 refs 2
00000400:00000200:1.0:1773851852.890296:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21330@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.890299:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21330@kfi7(21330@kfi7:21330@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.890301:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eb831fc3 nid 21330@kfi7 refs 3
00000800:00000200:1.0:1773851852.890303:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.890304:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851852.890308:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.890311:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd18 Using peer 21330@kfi7(0xd18)
00000800:00000200:1.0:1773851852.890316:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 324 bytes to peer 0xd18: rc=0
00000800:00000200:1.0:1773851852.890318:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd18 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.890321:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.890322:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006f4ad592 refcount 2 to 21395@kfi7
00010000:00000001:1.0:1773851852.890324:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.890324:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.890325:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.890326:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000089963df x1858043431753984/t0(0) o400->99ccfe45-9361-4db1-8454-203e5e6f3a21@21395@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1830-0'
00000100:00100000:1.0:1773851852.890331:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000089963df pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:99ccfe45-9361-4db1-8454-203e5e6f3a21+377:39826:x1858043431753984:12345-21395@kfi7:400:default-tuolumne1830-0 Request processed in 92us (144us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851852.890333:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd18 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851852.890335:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851852.890335:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21395@kfi7, seq: 1997480
00000100:00000040:1.0:1773851852.890336:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000365e249d : new rpc_count 8
00000400:00000200:2.0:1773851852.890337:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21330@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.890337:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851852.890338:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004677a1ce
00000100:00000001:1.0:1773851852.890338:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:2.0:1773851852.890339:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004677a1ce.
00000020:00000010:1.0:1773851852.890339:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000100:00000001:2.0:1773851852.890340:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851852.890340:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000100:00000001:2.0:1773851852.890341:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851852.890341:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5405d62.
00000400:00000200:2.0:1773851852.890342:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb831fc3 nid 21330@kfi7 refs 2
00000020:00000040:1.0:1773851852.890343:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000365e249d : new refcount 376
00000100:00000001:1.0:1773851852.890344:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851852.890345:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 21330@kfi7(00000000ac87dd3b):0x0 lsk 3353 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd18 Transaction freed
00000800:00000200:1.0:1773851852.896859:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.896860:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851852.896862:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851852.896864:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851852.896866:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.896867:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14337@kfi7 : PUT - for me
00000400:00000200:1.0:1773851852.896868:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.896868:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 1
00000400:00000200:1.0:1773851852.896869:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.896870:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000400:00000200:1.0:1773851852.896871:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 3
00000400:00000200:1.0:1773851852.896872:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14528@kfi7 to cpt 7
00000400:00000200:1.0:1773851852.896873:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14528@kfi7 of length 224 into portal 12 MB=0x69b4b905b4bc0
00000400:00000200:1.0:1773851852.896874:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14528@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 9968
00000800:00000200:1.0:1773851852.896876:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851852.896878:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851852.896879:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14337@kfi7: PUT: OK
00000100:00000001:1.0:1773851852.896880:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851852.896880:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851852.896881:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000021b9e21f.
00000100:00000040:1.0:1773851852.896882:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000021b9e21f x1859598707018688 msgsize 224
00000100:00100000:1.0:1773851852.896884:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14528@kfi7 (source: 12345-14337@kfi7)
00000100:00000001:1.0:1773851852.896885:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851852.896886:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000800:00000200:1.0:1773851852.896887:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851852.896889:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851852.896890:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851852.896890:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851852.896891:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851852.896891:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.896892:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598707018688
00000020:00000001:1.0:1773851852.896892:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851852.896893:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80056
00000020:00000001:1.0:1773851852.896893:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851852.896895:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001fc955ce refcount=5
00000020:00000001:1.0:1773851852.896896:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637059659974656 : -107014049576960 : ffff9eabd996c800)
00000020:00000001:1.0:1773851852.896896:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637059659974656 : -107014049576960 : ffff9eabd996c800)
00000100:00000001:1.0:1773851852.896897:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.896898:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851852.896898:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5405d62.
00000020:00000010:1.0:1773851852.896899:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851852.896899:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851852.896900:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851852.896900:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851852.896901:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.896902:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851852.896902:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851852.896903:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.896903:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851852.896904:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.896905:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851852.896905:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851852.896905:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851852.896906:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851852.896906:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14528@kfi7, seq: 1997481
00000100:00000040:1.0:1773851852.896906:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001fc955ce : new rpc_count 1
00000100:00000001:2.0:1773851852.896907:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.896907:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605663872 : -106923103887744 : ffff9ec1065fde80)
00000100:00000040:1.0:1773851852.896908:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000021b9e21f x1859598707018688/t0(0) o400->5572fbc8-1545-4f89-a541-491a75017e2f@14528@kfi7:492/0 lens 224/0 e 0 to 0 dl 1773852607 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1395-0'
00000100:00000001:1.0:1773851852.896910:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851852.896911:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851852.896912:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021b9e21f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5572fbc8-1545-4f89-a541-491a75017e2f+5:39619:x1859598707018688:12345-14528@kfi7:400:default-tuolumne1395-0
00000100:00000200:1.0:1773851852.896913:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598707018688
00000020:00000001:1.0:1773851852.896913:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851852.896914:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851852.896914:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.896915:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851852.896915:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851852.896916:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851852.896916:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598707018688, found 0 last_xid 1859598707018687
00000020:00000001:1.0:1773851852.896917:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851852.896917:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851852.896918:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851852.896918:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.896919:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851852.896919:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851852.896919:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851852.896921:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000c34c595.
02000000:00000001:1.0:1773851852.896921:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.896922:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.896923:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851852.896923:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096703605, transno 0, xid 1859598707018688
00010000:00000001:1.0:1773851852.896924:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851852.896925:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000021b9e21f x1859598707018688/t0(0) o400->5572fbc8-1545-4f89-a541-491a75017e2f@14528@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1395-0'
00010000:00000001:1.0:1773851852.896927:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851852.896927:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851852.896928:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=85 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851852.896929:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851852.896929:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000028dc5e87 refcount 3 to 14528@kfi7
00000100:00000001:1.0:1773851852.896930:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957478944 : -107146752072672 : ffff9e8cf3e76420)
02000000:00000001:1.0:1773851852.896931:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851852.896931:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851852.896931:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851852.896932:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14337@kfi7
00000400:00000010:1.0:1773851852.896933:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a9b6731.
00000100:00000200:1.0:1773851852.896933:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598707018688, offset 224
00000400:00000200:1.0:1773851852.896935:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14337@kfi7
00000400:00000200:1.0:1773851852.896935:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.896936:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 1
00000400:00000200:1.0:1773851852.896937:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000400:00000200:1.0:1773851852.896938:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 3
00000400:00000200:1.0:1773851852.896939:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14337@kfi7 local destination
00000400:00000200:1.0:1773851852.896940:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768546:8768546:1024:4294967295] 14337@kfi7 LPNI seq info [11120091:11120091:16:4294967295]
00000400:00000200:1.0:1773851852.896941:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000400:00000200:1.0:1773851852.896942:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:1.0:1773851852.896944:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14337@kfi7(14337@kfi7:14337@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851852.896945:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 3
00000800:00000200:1.0:1773851852.896946:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851852.896947:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851852.896949:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851852.896954:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000895 Using peer 14337@kfi7(0x100000000000895)
00000800:00000200:1.0:1773851852.896956:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x100000000000895: rc=0
00000800:00000200:1.0:1773851852.896958:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000895 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851852.896960:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851852.896960:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000028dc5e87 refcount 2 to 14528@kfi7
00010000:00000001:1.0:1773851852.896961:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851852.896961:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851852.896962:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851852.896962:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000021b9e21f x1859598707018688/t0(0) o400->5572fbc8-1545-4f89-a541-491a75017e2f@14528@kfi7:492/0 lens 224/224 e 0 to 0 dl 1773852607 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1395-0'
00000100:00100000:1.0:1773851852.896965:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021b9e21f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5572fbc8-1545-4f89-a541-491a75017e2f+5:39619:x1859598707018688:12345-14528@kfi7:400:default-tuolumne1395-0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851852.896967:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14528@kfi7, seq: 1997481
00000100:00000040:1.0:1773851852.896968:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001fc955ce : new rpc_count 0
00000100:00000001:1.0:1773851852.896968:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851852.896969:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851852.896969:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851852.896970:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000020:00000010:1.0:1773851852.896970:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5405d62.
00000020:00000040:1.0:1773851852.896971:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000001fc955ce : new refcount 4
00000800:00000200:3.0:1773851852.896972:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000895 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851852.896972:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851852.896973:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851852.896974:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14337@kfi7: PUT: OK
00000400:00000200:3.0:1773851852.896975:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a9b6731
00000400:00000010:3.0:1773851852.896975:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a9b6731.
00000100:00000001:3.0:1773851852.896976:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851852.896976:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851852.896977:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000800:00000200:3.0:1773851852.896978:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 14337@kfi7(000000009ce9d14c):0x0 lsk 2198 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000895 Transaction freed
00000800:00000200:21.0:1773851852.916526:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851852.916527:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851852.916528:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851852.916530:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851852.916532:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.916533:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13569@kfi7 : PUT - for me
00000400:00000200:21.0:1773851852.916534:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.916535:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 1
00000400:00000200:21.0:1773851852.916536:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:21.0:1773851852.916536:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000400:00000200:21.0:1773851852.916537:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 3
00000400:00000200:21.0:1773851852.916538:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13760@kfi7 to cpt 4
00000400:00000200:21.0:1773851852.916539:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13760@kfi7 of length 224 into portal 12 MB=0x69b8239a6a280
00000400:00000200:21.0:1773851852.916540:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13760@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 23136
00000800:00000200:21.0:1773851852.916542:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851852.916543:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851852.916544:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13569@kfi7: PUT: OK
00000100:00000001:21.0:1773851852.916545:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851852.916546:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851852.916546:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000093234f6c.
00000100:00000040:21.0:1773851852.916547:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000093234f6c x1859833475539584 msgsize 224
00000100:00100000:21.0:1773851852.916548:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13760@kfi7 (source: 12345-13569@kfi7)
00000100:00000001:21.0:1773851852.916551:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851852.916551:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000100:00000001:22.0:1773851852.916552:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851852.916553:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851852.916553:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851852.916553:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851852.916554:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851852.916555:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851852.916555:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833475539584
00000020:00000001:22.0:1773851852.916556:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851852.916556:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875d32bfbe
00000020:00000001:22.0:1773851852.916557:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851852.916560:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de8a2683 refcount=5
00000020:00000001:22.0:1773851852.916561:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144875876352 : -106928833675264 : ffff9ebfb0da4000)
00000020:00000001:22.0:1773851852.916562:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144875876352 : -106928833675264 : ffff9ebfb0da4000)
00000100:00000001:22.0:1773851852.916563:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851852.916564:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851852.916565:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2b41301.
00000020:00000010:22.0:1773851852.916565:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851852.916566:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030b42b18.
00000100:00000001:22.0:1773851852.916567:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851852.916567:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851852.916568:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851852.916569:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851852.916569:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851852.916570:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851852.916571:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851852.916572:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851852.916573:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851852.916573:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851852.916573:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851852.916574:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13760@kfi7, seq: 1997924
00000100:00000040:23.0:1773851852.916575:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de8a2683 : new rpc_count 1
00000100:00000001:22.0:1773851852.916575:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.916576:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117347456 : -106995592204160 : ffff9eb025bbf080)
00000100:00000001:22.0:1773851852.916576:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851852.916577:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000093234f6c x1859833475539584/t0(0) o400->b554442c-f36c-48c6-8f35-ced70d428437@13760@kfi7:579/0 lens 224/0 e 0 to 0 dl 1773851939 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1347-0'
00000100:00000001:23.0:1773851852.916580:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851852.916580:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851852.916581:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093234f6c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b554442c-f36c-48c6-8f35-ced70d428437+5:39866:x1859833475539584:12345-13760@kfi7:400:default-tuolumne1347-0
00000100:00000200:23.0:1773851852.916583:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833475539584
00000020:00000001:23.0:1773851852.916584:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851852.916584:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851852.916585:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.916586:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851852.916586:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851852.916587:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851852.916588:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833475539584, found 0 last_xid 1859833475539583
00000020:00000001:23.0:1773851852.916588:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851852.916589:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851852.916590:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851852.916590:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.916591:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851852.916592:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851852.916592:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851852.916593:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e556a1b5.
02000000:00000001:23.0:1773851852.916594:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.916595:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.916595:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851852.916596:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413757282, transno 0, xid 1859833475539584
00010000:00000001:23.0:1773851852.916597:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851852.916597:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000093234f6c x1859833475539584/t0(0) o400->b554442c-f36c-48c6-8f35-ced70d428437@13760@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1347-0'
00010000:00000001:23.0:1773851852.916600:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851852.916600:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851852.916601:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=85 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851852.916602:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851852.916603:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000021553fb9 refcount 3 to 13760@kfi7
00000100:00000001:23.0:1773851852.916604:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516512 : -107156126035104 : ffff9e8ac52c1360)
02000000:00000001:23.0:1773851852.916604:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851852.916605:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851852.916605:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851852.916606:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13569@kfi7
00000400:00000010:23.0:1773851852.916607:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003279a6c9.
00000100:00000200:23.0:1773851852.916608:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833475539584, offset 224
00000400:00000200:23.0:1773851852.916609:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13569@kfi7
00000400:00000200:23.0:1773851852.916610:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.916610:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 1
00000400:00000200:23.0:1773851852.916611:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000400:00000200:23.0:1773851852.916613:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 3
00000400:00000200:23.0:1773851852.916614:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13569@kfi7 local destination
00000400:00000200:23.0:1773851852.916615:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768547:8768547:1024:4294967295] 13569@kfi7 LPNI seq info [4793180:4793180:16:4294967295]
00000400:00000200:23.0:1773851852.916617:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000400:00000200:23.0:1773851852.916617:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:23.0:1773851852.916619:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13569@kfi7(13569@kfi7:13569@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851852.916620:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 3
00000800:00000200:23.0:1773851852.916622:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851852.916623:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851852.916626:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851852.916628:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f79 Using peer 13569@kfi7(0x100000000000f79)
00000800:00000200:23.0:1773851852.916631:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x100000000000f79: rc=0
00000800:00000200:23.0:1773851852.916632:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851852.916634:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851852.916635:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000021553fb9 refcount 2 to 13760@kfi7
00010000:00000001:23.0:1773851852.916636:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851852.916636:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851852.916637:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851852.916638:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000093234f6c x1859833475539584/t0(0) o400->b554442c-f36c-48c6-8f35-ced70d428437@13760@kfi7:579/0 lens 224/224 e 0 to 0 dl 1773851939 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1347-0'
00000100:00100000:23.0:1773851852.916641:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093234f6c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b554442c-f36c-48c6-8f35-ced70d428437+5:39866:x1859833475539584:12345-13760@kfi7:400:default-tuolumne1347-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851852.916643:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13760@kfi7, seq: 1997924
00000800:00000200:22.0:1773851852.916643:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f79 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851852.916644:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de8a2683 : new rpc_count 0
00000100:00000001:23.0:1773851852.916645:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851852.916645:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:22.0:1773851852.916645:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851852.916646:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:22.0:1773851852.916646:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13569@kfi7: PUT: OK
00000020:00000010:23.0:1773851852.916647:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030b42b18.
00000400:00000200:22.0:1773851852.916647:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003279a6c9
00000020:00000010:23.0:1773851852.916648:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2b41301.
00000400:00000010:22.0:1773851852.916648:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003279a6c9.
00000100:00000001:22.0:1773851852.916648:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:23.0:1773851852.916649:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000de8a2683 : new refcount 4
00000100:00000001:23.0:1773851852.916649:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851852.916649:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851852.916650:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000800:00000200:22.0:1773851852.916652:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 13569@kfi7(00000000add972f9):0x0 lsk 3962 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f79 Transaction freed
00000800:00000200:18.0:1773851852.937184:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851852.937185:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851852.937186:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2069@kfi7:4 <- 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851852.937189:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2069@kfi7:4 <- 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851852.937190:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851852.937192:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16433@kfi7 : PUT - for me
00000400:00000200:18.0:1773851852.937193:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851852.937194:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 1
00000400:00000200:18.0:1773851852.937195:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851852.937195:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000400:00000200:18.0:1773851852.937196:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 3
00000400:00000200:18.0:1773851852.937197:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851852.937198:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16433@kfi7 of length 224 into portal 12 MB=0x69b4b9555cdc0
00000400:00000200:18.0:1773851852.937200:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16433@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 188064
00000800:00000200:18.0:1773851852.937202:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2069@kfi7:4 <- 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851852.937203:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851852.937204:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16433@kfi7: PUT: OK
00000100:00000001:18.0:1773851852.937205:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851852.937206:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851852.937207:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000c7ef22a.
00000100:00000040:18.0:1773851852.937208:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000000c7ef22a x1859598790544832 msgsize 224
00000100:00100000:18.0:1773851852.937209:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-16433@kfi7 (source: 12345-16433@kfi7)
00000100:00000001:18.0:1773851852.937211:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851852.937212:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000100:00000001:19.0:1773851852.937213:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851852.937214:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851852.937214:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2069@kfi7:4 <- 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851852.937215:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851852.937216:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851852.937217:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851852.937218:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598790544832
00000020:00000001:19.0:1773851852.937219:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851852.937220:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3894fd9b
00000020:00000001:19.0:1773851852.937221:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851852.937224:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b7c861d7 refcount=5
00000020:00000001:19.0:1773851852.937225:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130631108608 : -106943078443008 : ffff9ebc5fcc5800)
00000020:00000001:19.0:1773851852.937226:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130631108608 : -106943078443008 : ffff9ebc5fcc5800)
00000100:00000001:19.0:1773851852.937228:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851852.937229:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851852.937230:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5d5268b.
00000020:00000010:19.0:1773851852.937232:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851852.937233:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050d3142f.
00000100:00000001:19.0:1773851852.937234:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851852.937235:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851852.937236:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851852.937238:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851852.937238:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851852.937239:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851852.937241:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851852.937242:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851852.937242:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851852.937243:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851852.937243:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851852.937244:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16433@kfi7, seq: 2156252
00000100:00000001:19.0:1773851852.937245:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851852.937245:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b7c861d7 : new rpc_count 1
00000100:00000001:18.0:1773851852.937245:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534658432 : -106946174893184 : ffff9ebba73c4380)
00000100:00000001:19.0:1773851852.937246:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851852.937247:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000c7ef22a x1859598790544832/t0(0) o400->e54702dc-7b2d-4df9-9c3f-fd083857bb92@16433@kfi7:42/0 lens 224/0 e 0 to 0 dl 1773852157 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1517-0'
00000100:00000001:18.0:1773851852.937250:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851852.937250:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851852.937251:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c7ef22a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e54702dc-7b2d-4df9-9c3f-fd083857bb92+5:39546:x1859598790544832:12345-16433@kfi7:400:default-tuolumne1517-0
00000100:00000200:18.0:1773851852.937253:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598790544832
00000020:00000001:18.0:1773851852.937253:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851852.937254:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851852.937255:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851852.937255:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851852.937256:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851852.937257:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851852.937257:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598790544832, found 0 last_xid 1859598790544831
00000020:00000001:18.0:1773851852.937258:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851852.937259:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851852.937260:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851852.937260:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851852.937261:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851852.937261:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851852.937262:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851852.937263:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a408a807.
02000000:00000001:18.0:1773851852.937264:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851852.937264:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851852.937265:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851852.937266:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044139343, transno 0, xid 1859598790544832
00010000:00000001:18.0:1773851852.937268:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851852.937269:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000c7ef22a x1859598790544832/t0(0) o400->e54702dc-7b2d-4df9-9c3f-fd083857bb92@16433@kfi7:42/0 lens 224/224 e 0 to 0 dl 1773852157 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1517-0'
00010000:00000001:18.0:1773851852.937271:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851852.937272:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851852.937272:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=85 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851852.937273:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851852.937274:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000962f1278 refcount 3 to 16433@kfi7
00000100:00000001:18.0:1773851852.937275:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095775072 : -107152613776544 : ffff9e8b9684e360)
02000000:00000001:18.0:1773851852.937276:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851852.937277:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851852.937277:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851852.937278:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16433@kfi7
00000400:00000010:18.0:1773851852.937279:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f4a6e6ff.
00000100:00000200:18.0:1773851852.937280:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598790544832, offset 224
00000400:00000200:18.0:1773851852.937281:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16433@kfi7
00000400:00000200:18.0:1773851852.937282:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851852.937282:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 1
00000400:00000200:18.0:1773851852.937284:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000400:00000200:18.0:1773851852.937284:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 3
00000400:00000200:18.0:1773851852.937286:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16433@kfi7 local destination
00000400:00000200:18.0:1773851852.937287:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768548:8768548:1024:4294967295] 16433@kfi7 LPNI seq info [384796:384796:16:4294967295]
00000400:00000200:18.0:1773851852.937288:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000400:00000200:18.0:1773851852.937289:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851852.937291:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16433@kfi7(16433@kfi7:16433@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851852.937292:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 3
00000800:00000200:18.0:1773851852.937293:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851852.937294:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2069@kfi7:4 -> 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851852.937297:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2069@kfi7:4 -> 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851852.937300:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2069@kfi7:4 -> 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x994 Using peer 16433@kfi7(0x994)
00000800:00000200:18.0:1773851852.937304:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b4a37ded: Posted send of 324 bytes to peer 0x994: rc=0
00000800:00000200:18.0:1773851852.937305:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2069@kfi7:4 -> 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x994 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851852.937307:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851852.937308:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000962f1278 refcount 2 to 16433@kfi7
00010000:00000001:18.0:1773851852.937309:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851852.937309:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851852.937310:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851852.937311:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000c7ef22a x1859598790544832/t0(0) o400->e54702dc-7b2d-4df9-9c3f-fd083857bb92@16433@kfi7:42/0 lens 224/224 e 0 to 0 dl 1773852157 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1517-0'
00000100:00100000:18.0:1773851852.937314:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c7ef22a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e54702dc-7b2d-4df9-9c3f-fd083857bb92+5:39546:x1859598790544832:12345-16433@kfi7:400:default-tuolumne1517-0 Request processed in 63us (105us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851852.937316:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16433@kfi7, seq: 2156252
00000100:00000040:18.0:1773851852.937317:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b7c861d7 : new rpc_count 0
00000100:00000001:18.0:1773851852.937318:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851852.937318:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851852.937319:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:18.0:1773851852.937320:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050d3142f.
00000800:00000200:17.0:1773851852.937320:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2069@kfi7:4 -> 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x994 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851852.937321:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5d5268b.
00000020:00000040:18.0:1773851852.937321:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b7c861d7 : new refcount 4
00000100:00000001:18.0:1773851852.937322:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851852.937323:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851852.937325:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16433@kfi7: PUT: OK
00000400:00000200:17.0:1773851852.937326:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f4a6e6ff
00000400:00000010:17.0:1773851852.937326:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f4a6e6ff.
00000100:00000001:17.0:1773851852.937327:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851852.937328:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851852.937329:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000800:00000200:17.0:1773851852.937332:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2069@kfi7:4 -> 16433@kfi7(000000002882a53c):0x0 lsk 2453 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x994 Transaction freed
00010000:00000001:2.0:1773851852.937733:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937733:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851852.937734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851852.937735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851852.937736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851852.937737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851852.937739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851852.937740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851852.937741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851852.937741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851852.937745:0:937839:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851852.937745:0:937839:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851852.937746:0:937839:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:30.0:1773851853.031182:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851853.031182:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851853.031183:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851853.031185:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851853.031187:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10483@kfi7 to cpt 7
00000400:00000200:30.0:1773851853.031188:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10483@kfi7 : PUT - for me
00000400:00000200:30.0:1773851853.031189:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10483@kfi7 to cpt 7
00000400:00000200:30.0:1773851853.031190:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004fce63d1 nid 10483@kfi7 refs 1
00000400:00000200:30.0:1773851853.031191:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10483@kfi7 to cpt 7
00000400:00000200:30.0:1773851853.031192:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004fce63d1 nid 10483@kfi7 refs 2
00000400:00000200:30.0:1773851853.031193:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004fce63d1 nid 10483@kfi7 refs 3
00000400:00000200:30.0:1773851853.031193:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10482@kfi7 to cpt 4
00000400:00000200:30.0:1773851853.031194:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10482@kfi7 of length 224 into portal 12 MB=0x69b4c7a0d3cc0
00000400:00000200:30.0:1773851853.031196:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10482@kfi7 of length 224/224 into md 0x77fe139dd [64] + 159336
00000800:00000200:30.0:1773851853.031197:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851853.031199:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851853.031200:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10483@kfi7: PUT: OK
00000100:00000001:30.0:1773851853.031200:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851853.031201:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851853.031202:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000333fbfa4.
00000100:00000040:30.0:1773851853.031202:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000333fbfa4 x1859602627771584 msgsize 224
00000100:00100000:30.0:1773851853.031203:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-10482@kfi7 (source: 12345-10483@kfi7)
00000100:00000001:30.0:1773851853.031205:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851853.031206:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004fce63d1 nid 10483@kfi7 refs 2
00000800:00000200:30.0:1773851853.031208:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851853.031208:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851853.031208:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851853.031209:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851853.031210:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851853.031211:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851853.031212:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602627771584
00000020:00000001:29.0:1773851853.031213:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851853.031214:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d8ba2c
00000020:00000001:29.0:1773851853.031215:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851853.031219:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bd7c80f refcount=3570
00000020:00000001:29.0:1773851853.031220:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112454205440 : -106961255346176 : ffff9eb8245ed000)
00000020:00000001:29.0:1773851853.031221:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637112454205440 : -106961255346176 : ffff9eb8245ed000)
00000100:00000001:29.0:1773851853.031223:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851853.031224:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851853.031225:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a5f84808.
00000020:00000010:29.0:1773851853.031227:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851853.031228:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e489412.
00000100:00000001:29.0:1773851853.031229:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851853.031230:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851853.031231:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851853.031232:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851853.031233:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851853.031234:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851853.031235:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.031237:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851853.031237:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.031238:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851853.031238:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851853.031239:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10482@kfi7, seq: 2055451
00000100:00000040:31.0:1773851853.031240:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bd7c80f : new rpc_count 40
00000100:00000001:29.0:1773851853.031240:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.031241:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000833664 : -107100708717952 : ffff9e97ac4d3a80)
00000100:00000001:29.0:1773851853.031241:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.031242:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000333fbfa4 x1859602627771584/t0(0) o400->62040075-c7d4-4dd3-8c36-05637e6266e1@10482@kfi7:43/0 lens 224/0 e 0 to 0 dl 1773852158 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1129-0'
00000100:00000001:31.0:1773851853.031245:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.031245:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851853.031246:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000333fbfa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:62040075-c7d4-4dd3-8c36-05637e6266e1+3570:39501:x1859602627771584:12345-10482@kfi7:400:default-tuolumne1129-0
00000100:00000200:31.0:1773851853.031248:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602627771584
00000020:00000001:31.0:1773851853.031249:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851853.031249:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851853.031250:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.031251:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851853.031252:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851853.031253:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851853.031254:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602627771584, found 0 last_xid 1859602627001279
00000020:00000001:31.0:1773851853.031255:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851853.031256:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851853.031256:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851853.031257:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.031258:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851853.031258:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851853.031259:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851853.031260:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008af9e3b3.
02000000:00000001:31.0:1773851853.031260:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.031261:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.031262:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851853.031263:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264591865, transno 0, xid 1859602627771584
00010000:00000001:31.0:1773851853.031264:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851853.031265:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000333fbfa4 x1859602627771584/t0(0) o400->62040075-c7d4-4dd3-8c36-05637e6266e1@10482@kfi7:43/0 lens 224/224 e 0 to 0 dl 1773852158 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1129-0'
00010000:00000001:31.0:1773851853.031267:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851853.031270:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851853.031270:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=86 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851853.031272:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851853.031272:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d17f0bb3 refcount 3 to 10482@kfi7
00000100:00000001:31.0:1773851853.031273:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958592 : -107156125593024 : ffff9e8ac532d240)
02000000:00000001:31.0:1773851853.031274:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851853.031274:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.031275:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851853.031276:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10483@kfi7
00000400:00000010:31.0:1773851853.031277:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000100:00000200:31.0:1773851853.031278:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602627771584, offset 224
00000400:00000200:31.0:1773851853.031279:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10483@kfi7
00000400:00000200:31.0:1773851853.031280:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10483@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.031281:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004fce63d1 nid 10483@kfi7 refs 1
00000400:00000200:31.0:1773851853.031282:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004fce63d1 nid 10483@kfi7 refs 2
00000400:00000200:31.0:1773851853.031283:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004fce63d1 nid 10483@kfi7 refs 3
00000400:00000200:31.0:1773851853.031284:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10483@kfi7 local destination
00000400:00000200:31.0:1773851853.031286:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768549:8768549:1024:4294967295] 10483@kfi7 LPNI seq info [12191065:12191065:16:4294967295]
00000400:00000200:31.0:1773851853.031287:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004fce63d1 nid 10483@kfi7 refs 2
00000400:00000200:31.0:1773851853.031288:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10483@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.031290:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10483@kfi7(10483@kfi7:10483@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851853.031291:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004fce63d1 nid 10483@kfi7 refs 3
00000800:00000200:31.0:1773851853.031293:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851853.031294:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851853.031296:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851853.031298:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009ed Using peer 10483@kfi7(0x1000000000009ed)
00000800:00000200:31.0:1773851853.031302:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x1000000000009ed: rc=0
00000800:00000200:31.0:1773851853.031303:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009ed TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851853.031306:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.031307:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d17f0bb3 refcount 2 to 10482@kfi7
00010000:00000001:31.0:1773851853.031307:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851853.031308:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.031309:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851853.031309:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000333fbfa4 x1859602627771584/t0(0) o400->62040075-c7d4-4dd3-8c36-05637e6266e1@10482@kfi7:43/0 lens 224/224 e 0 to 0 dl 1773852158 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1129-0'
00000100:00100000:31.0:1773851853.031312:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000333fbfa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:62040075-c7d4-4dd3-8c36-05637e6266e1+3570:39501:x1859602627771584:12345-10482@kfi7:400:default-tuolumne1129-0 Request processed in 66us (109us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851853.031315:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10482@kfi7, seq: 2055451
00000100:00000040:31.0:1773851853.031315:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bd7c80f : new rpc_count 39
00000100:00000001:31.0:1773851853.031316:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851853.031317:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851853.031317:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:31.0:1773851853.031318:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e489412.
00000800:00000200:30.0:1773851853.031318:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009ed TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851853.031319:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a5f84808.
00000400:00000200:30.0:1773851853.031319:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851853.031320:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000005bd7c80f : new refcount 3569
00000400:00000200:30.0:1773851853.031320:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10483@kfi7: PUT: OK
00000400:00000200:30.0:1773851853.031320:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000100:00000001:31.0:1773851853.031321:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:30.0:1773851853.031321:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000100:00000001:30.0:1773851853.031321:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851853.031322:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851853.031323:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004fce63d1 nid 10483@kfi7 refs 2
00000800:00000200:30.0:1773851853.031324:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 10483@kfi7(000000002b6928ab):0x0 lsk 2542 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009ed Transaction freed
00000800:00000200:1.0:1773851853.077389:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.077391:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851853.077393:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851853.077396:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851853.077400:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.077403:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11515@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.077404:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.077406:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:1.0:1773851853.077407:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.077408:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851853.077410:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:1.0:1773851853.077411:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11514@kfi7 to cpt 5
00000400:00000200:1.0:1773851853.077413:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11514@kfi7 of length 224 into portal 12 MB=0x699de8c6d6840
00000400:00000200:1.0:1773851853.077415:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11514@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 10192
00000800:00000200:1.0:1773851853.077418:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851853.077421:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.077423:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11515@kfi7: PUT: OK
00000100:00000001:1.0:1773851853.077424:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851853.077425:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851853.077426:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009996f0e8.
00000100:00000040:1.0:1773851853.077427:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000009996f0e8 x1858030978033728 msgsize 224
00000100:00100000:1.0:1773851853.077430:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11514@kfi7 (source: 12345-11515@kfi7)
00000100:00000001:1.0:1773851853.077432:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851853.077433:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000800:00000200:1.0:1773851853.077436:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851853.077440:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851853.077441:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851853.077442:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851853.077442:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851853.077444:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851853.077445:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978033728
00000020:00000001:1.0:1773851853.077446:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851853.077446:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90efd
00000020:00000001:1.0:1773851853.077447:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851853.077449:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009f551fac refcount=6
00000020:00000001:1.0:1773851853.077450:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239890944 : -107152469660672 : ffff9e8b9f1bec00)
00000020:00000001:1.0:1773851853.077452:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239890944 : -107152469660672 : ffff9e8b9f1bec00)
00000100:00000001:1.0:1773851853.077454:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851853.077455:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851853.077456:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000bd14c1b.
00000020:00000010:1.0:1773851853.077457:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851853.077459:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851853.077460:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851853.077460:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851853.077461:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851853.077463:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851853.077463:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851853.077464:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.077466:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.077468:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851853.077468:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851853.077469:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851853.077469:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851853.077470:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11514@kfi7, seq: 1997482
00000100:00000001:2.0:1773851853.077471:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851853.077471:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009f551fac : new rpc_count 1
00000100:00000001:2.0:1773851853.077472:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.077472:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605659264 : -106923103892352 : ffff9ec1065fcc80)
00000100:00000040:1.0:1773851853.077474:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009996f0e8 x1858030978033728/t0(0) o400->007dbd5a-bbfd-4f1d-b41d-342980af677a@11514@kfi7:493/0 lens 224/0 e 0 to 0 dl 1773852608 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne213-0'
00000100:00000001:1.0:1773851853.077478:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851853.077479:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851853.077480:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009996f0e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:007dbd5a-bbfd-4f1d-b41d-342980af677a+6:47839:x1858030978033728:12345-11514@kfi7:400:default-tuolumne213-0
00000100:00000200:1.0:1773851853.077482:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978033728
00000020:00000001:1.0:1773851853.077483:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851853.077484:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851853.077485:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.077486:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851853.077487:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851853.077488:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851853.077489:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978033728, found 0 last_xid 1858030978033727
00000020:00000001:1.0:1773851853.077490:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851853.077492:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851853.077493:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851853.077493:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.077495:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851853.077495:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851853.077496:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851853.077497:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003f7efaff.
02000000:00000001:1.0:1773851853.077498:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.077499:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.077500:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851853.077502:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030978033728
00010000:00000001:1.0:1773851853.077503:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851853.077504:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009996f0e8 x1858030978033728/t0(0) o400->007dbd5a-bbfd-4f1d-b41d-342980af677a@11514@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00010000:00000001:1.0:1773851853.077508:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851853.077509:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851853.077510:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851853.077512:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851853.077513:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e9f490fd refcount 5 to 11514@kfi7
00000100:00000001:1.0:1773851853.077514:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450464 : -107146752101152 : ffff9e8cf3e6f4e0)
02000000:00000001:1.0:1773851853.077515:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851853.077516:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.077517:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851853.077519:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11515@kfi7
00000400:00000010:1.0:1773851853.077520:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089f888d1.
00000100:00000200:1.0:1773851853.077521:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978033728, offset 224
00000400:00000200:1.0:1773851853.077523:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11515@kfi7
00000400:00000200:1.0:1773851853.077524:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.077525:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:1.0:1773851853.077527:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851853.077529:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:1.0:1773851853.077531:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11515@kfi7 local destination
00000400:00000200:1.0:1773851853.077533:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768550:8768550:1024:4294967295] 11515@kfi7 LPNI seq info [24505:24505:16:4294967295]
00000400:00000200:1.0:1773851853.077535:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851853.077537:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.077540:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11515@kfi7(11515@kfi7:11515@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851853.077542:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000800:00000200:1.0:1773851853.077544:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.077546:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851853.077549:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851853.077553:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a Using peer 11515@kfi7(0x10000000000008a)
00000800:00000200:1.0:1773851853.077558:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x10000000000008a: rc=0
00000800:00000200:1.0:1773851853.077560:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851853.077563:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851853.077565:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e9f490fd refcount 4 to 11514@kfi7
00010000:00000001:1.0:1773851853.077566:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851853.077567:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.077568:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851853.077569:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009996f0e8 x1858030978033728/t0(0) o400->007dbd5a-bbfd-4f1d-b41d-342980af677a@11514@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00000100:00100000:1.0:1773851853.077574:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009996f0e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:007dbd5a-bbfd-4f1d-b41d-342980af677a+6:47839:x1858030978033728:12345-11514@kfi7:400:default-tuolumne213-0 Request processed in 94us (145us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851853.077576:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851853.077577:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11514@kfi7, seq: 1997482
00000100:00000040:1.0:1773851853.077578:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009f551fac : new rpc_count 0
00000400:00000200:2.0:1773851853.077579:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851853.077579:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851853.077580:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11515@kfi7: PUT: OK
00000100:00000001:1.0:1773851853.077580:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851853.077581:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:2.0:1773851853.077582:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089f888d1
00000020:00000010:1.0:1773851853.077582:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000010:2.0:1773851853.077583:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089f888d1.
00000100:00000001:2.0:1773851853.077584:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851853.077584:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851853.077584:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000bd14c1b.
00000020:00000040:1.0:1773851853.077585:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000009f551fac : new refcount 5
00000400:00000200:2.0:1773851853.077586:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000100:00000001:1.0:1773851853.077586:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851853.077588:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a Transaction freed
00000800:00000200:1.0:1773851853.078053:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.078055:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851853.078057:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851853.078060:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851853.078064:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.078066:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11515@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.078068:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.078069:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:1.0:1773851853.078071:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.078072:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851853.078074:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:1.0:1773851853.078075:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11514@kfi7 to cpt 5
00000400:00000200:1.0:1773851853.078077:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11514@kfi7 of length 224 into portal 12 MB=0x699de8c6d70c0
00000400:00000200:1.0:1773851853.078079:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11514@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 10416
00000800:00000200:1.0:1773851853.078082:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851853.078085:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.078087:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11515@kfi7: PUT: OK
00000100:00000001:1.0:1773851853.078089:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851853.078089:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851853.078090:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c8e52062.
00000100:00000040:1.0:1773851853.078092:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000c8e52062 x1858030978035904 msgsize 224
00000100:00100000:1.0:1773851853.078094:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11514@kfi7 (source: 12345-11515@kfi7)
00000100:00000001:1.0:1773851853.078096:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851853.078097:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000800:00000200:1.0:1773851853.078100:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851853.078105:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851853.078106:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851853.078107:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851853.078107:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851853.078109:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851853.078110:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978035904
00000020:00000001:1.0:1773851853.078111:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851853.078111:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912e6
00000020:00000001:1.0:1773851853.078112:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851853.078115:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a671848 refcount=6
00000020:00000001:1.0:1773851853.078116:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716203520 : -107155993348096 : ffff9e8acd14b800)
00000020:00000001:1.0:1773851853.078117:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716203520 : -107155993348096 : ffff9e8acd14b800)
00000100:00000001:1.0:1773851853.078118:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851853.078120:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851853.078121:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000bd14c1b.
00000020:00000010:1.0:1773851853.078122:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851853.078123:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851853.078124:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851853.078125:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851853.078126:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851853.078128:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851853.078128:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851853.078129:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.078130:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851853.078132:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851853.078133:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851853.078133:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851853.078134:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851853.078135:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11514@kfi7, seq: 1997483
00000100:00000001:2.0:1773851853.078136:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851853.078136:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a671848 : new rpc_count 1
00000100:00000001:2.0:1773851853.078137:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.078137:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605645440 : -106923103906176 : ffff9ec1065f9680)
00000100:00000040:1.0:1773851853.078139:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c8e52062 x1858030978035904/t0(0) o400->2edac9c7-455d-446a-93b6-0d0a73e9f47f@11514@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne213-0'
00000100:00000001:1.0:1773851853.078144:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851853.078145:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851853.078146:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8e52062 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2edac9c7-455d-446a-93b6-0d0a73e9f47f+6:47841:x1858030978035904:12345-11514@kfi7:400:default-tuolumne213-0
00000100:00000200:1.0:1773851853.078148:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978035904
00000020:00000001:1.0:1773851853.078150:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851853.078151:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851853.078152:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.078153:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851853.078154:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851853.078155:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851853.078156:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978035904, found 0 last_xid 1858030978035903
00000020:00000001:1.0:1773851853.078157:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851853.078158:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851853.078159:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851853.078160:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.078161:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851853.078162:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851853.078162:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851853.078163:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006bde09a9.
02000000:00000001:1.0:1773851853.078164:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.078165:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.078167:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851853.078167:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768320, transno 0, xid 1858030978035904
00010000:00000001:1.0:1773851853.078169:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851853.078170:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c8e52062 x1858030978035904/t0(0) o400->2edac9c7-455d-446a-93b6-0d0a73e9f47f@11514@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00010000:00000001:1.0:1773851853.078175:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851853.078175:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851853.078176:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851853.078178:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851853.078179:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e9f490fd refcount 5 to 11514@kfi7
00000100:00000001:1.0:1773851853.078180:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450464 : -107146752101152 : ffff9e8cf3e6f4e0)
02000000:00000001:1.0:1773851853.078182:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851853.078182:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.078183:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851853.078185:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11515@kfi7
00000400:00000010:1.0:1773851853.078186:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000605f25c.
00000100:00000200:1.0:1773851853.078187:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978035904, offset 224
00000400:00000200:1.0:1773851853.078189:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11515@kfi7
00000400:00000200:1.0:1773851853.078191:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.078193:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:1.0:1773851853.078194:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851853.078196:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:1.0:1773851853.078198:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11515@kfi7 local destination
00000400:00000200:1.0:1773851853.078200:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768551:8768551:1024:4294967295] 11515@kfi7 LPNI seq info [24506:24506:16:4294967295]
00000400:00000200:1.0:1773851853.078203:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851853.078204:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.078207:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11515@kfi7(11515@kfi7:11515@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851853.078209:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000800:00000200:1.0:1773851853.078210:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.078212:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851853.078215:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851853.078217:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 Using peer 11515@kfi7(0x83)
00000800:00000200:1.0:1773851853.078220:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 324 bytes to peer 0x83: rc=0
00000800:00000200:1.0:1773851853.078222:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851853.078224:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851853.078225:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e9f490fd refcount 4 to 11514@kfi7
00010000:00000001:1.0:1773851853.078226:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851853.078226:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851853.078227:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851853.078227:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c8e52062 x1858030978035904/t0(0) o400->2edac9c7-455d-446a-93b6-0d0a73e9f47f@11514@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00000100:00100000:1.0:1773851853.078231:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8e52062 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2edac9c7-455d-446a-93b6-0d0a73e9f47f+6:47841:x1858030978035904:12345-11514@kfi7:400:default-tuolumne213-0 Request processed in 86us (138us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851853.078233:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11514@kfi7, seq: 1997483
00000800:00000200:2.0:1773851853.078234:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 TN_EVENT_TX_OK event status 0
00000100:00000040:1.0:1773851853.078234:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a671848 : new rpc_count 0
00000100:00000001:1.0:1773851853.078235:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851853.078235:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851853.078236:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851853.078236:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851853.078236:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:2.0:1773851853.078237:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11515@kfi7: PUT: OK
00000020:00000010:1.0:1773851853.078237:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000bd14c1b.
00000400:00000200:2.0:1773851853.078238:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000605f25c
00000020:00000040:1.0:1773851853.078238:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000009a671848 : new refcount 5
00000400:00000010:2.0:1773851853.078239:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000605f25c.
00000100:00000001:2.0:1773851853.078239:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851853.078239:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.078240:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851853.078241:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000800:00000200:2.0:1773851853.078242:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 Transaction freed
00000004:00000001:29.0:1773851853.129730:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851853.129731:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:25.0:1773851853.129731:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:25.0:1773851853.129731:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851853.129732:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1c723ea.
00000020:00000040:29.0:1773851853.129732:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000100:00000010:25.0:1773851853.129732:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004c01fc4.
00000100:00000001:29.0:1773851853.129733:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:25.0:1773851853.129733:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
02000000:00000001:29.0:1773851853.129734:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:25.0:1773851853.129734:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851853.129735:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851853.129735:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:29.0:1773851853.129736:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
02000000:00000001:25.0:1773851853.129736:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851853.129737:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851853.129737:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000294dbfa2.
00000100:00000001:29.0:1773851853.129738:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851853.129738:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851853.129738:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851853.129739:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:29.0:1773851853.129740:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e1c723ea] to pc [ptlrpcd_07_03+3]  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851853.129740:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851853.129741:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000004c01fc4] to pc [ptlrpcd_06_01+1]  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851853.129744:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:29.0:1773851853.129744:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851853.129745:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851853.129745:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129745:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851853.129745:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:29.0:1773851853.129745:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000002cae99cb.
00080000:00000001:29.0:1773851853.129745:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637120961831936 : -106952747719680 : ffff9eba1f76e400)
00080000:00000001:25.0:1773851853.129745:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:30.0:1773851853.129746:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851853.129746:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000010:25.0:1773851853.129746:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ce248f5e.
00080000:00000001:29.0:1773851853.129747:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851853.129747:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851853.129747:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:26.0:1773851853.129747:0:41084:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00080000:00000001:25.0:1773851853.129747:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637110622734336 : -106963086817280 : ffff9eb7b734c800)
00000004:00001000:29.0:1773851853.129748:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000100:00000001:27.0:1773851853.129748:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.129748:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:25.0:1773851853.129748:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851853.129749:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851853.129749:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:29.0:1773851853.129749:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000e424a3ed.
00000100:00000001:26.0:1773851853.129749:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:30.0:1773851853.129750:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:29.0:1773851853.129750:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614127583025386ns, next at 614128583024274ns, rc = 0
00000100:00000001:26.0:1773851853.129750:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.129750:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:25.0:1773851853.129750:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:25.0:1773851853.129750:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
02000000:00000001:30.0:1773851853.129751:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851853.129751:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e1c723ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051922560:2090@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851853.129751:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:26.0:1773851853.129751:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851853.129751:0:41084:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:25.0:1773851853.129751:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000032fb49d1.
00080000:00000001:29.0:1773851853.129752:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851853.129752:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.129752:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:25.0:1773851853.129752:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614127583027470ns, next at 614128583026298ns, rc = 0
00000100:00000001:30.0:1773851853.129753:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851853.129753:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:25.0:1773851853.129753:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:30.0:1773851853.129754:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851853.129754:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:25.0:1773851853.129754:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.129755:0:41084:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:25.0:1773851853.129755:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851853.129756:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003c8399ec.
00000100:00000001:26.0:1773851853.129756:0:41084:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851853.129757:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851853.129757:0:41084:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:26.0:1773851853.129757:0:41084:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851853.129758:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:30.0:1773851853.129759:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00100000:26.0:1773851853.129759:0:41084:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004c01fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051922624:2068@kfi7:13:default-yuba2-0
00000400:00000010:30.0:1773851853.129760:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e57a604.
00000100:00000001:26.0:1773851853.129760:0:41084:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000200:30.0:1773851853.129761:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922560, portal 4
02000000:00000001:26.0:1773851853.129761:0:41084:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:26.0:1773851853.129761:0:41084:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851853.129762:0:41084:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:26.0:1773851853.129762:0:41084:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000513e7f5d.
02000000:00000001:26.0:1773851853.129764:0:41084:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851853.129765:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000010:26.0:1773851853.129766:0:41084:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000af3b30f4.
00000400:00000010:26.0:1773851853.129766:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000001d16f21.
00000100:00000200:26.0:1773851853.129768:0:41084:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922624, portal 4
00000100:00000001:26.0:1773851853.129769:0:41084:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:26.0:1773851853.129769:0:41084:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637093150699904 : -106980558851712 : ffff9eb3a5cab180)
00000100:00000040:26.0:1773851853.129770:0:41084:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851853.129771:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851853.129772:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637111224853248 : -106962484698368 : ffff9eb7db186300)
00000100:00000040:30.0:1773851853.129773:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851853.129773:0:41084:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851853.129774:0:41084:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:26.0:1773851853.129774:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000445da448.
00000100:00000200:26.0:1773851853.129775:0:41084:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922624, offset 0
00000100:00000001:30.0:1773851853.129776:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851853.129777:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:30.0:1773851853.129777:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bddd7f6b.
00000400:00000200:26.0:1773851853.129777:0:41084:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000100:00000200:30.0:1773851853.129778:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922560, offset 0
00000400:00000200:26.0:1773851853.129778:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:26.0:1773851853.129778:0:41084:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:30.0:1773851853.129780:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000400:00000200:26.0:1773851853.129780:0:41084:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851853.129781:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:26.0:1773851853.129781:0:41084:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851853.129782:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:30.0:1773851853.129783:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:26.0:1773851853.129783:0:41084:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:30.0:1773851853.129784:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:26.0:1773851853.129785:0:41084:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768551, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768550, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851853.129786:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000200:30.0:1773851853.129787:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768551, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768550, p:4294967295, g:4294967295, h:1000]
00000400:00000200:26.0:1773851853.129787:0:41084:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:26.0:1773851853.129788:0:41084:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851853.129789:0:41084:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:30.0:1773851853.129790:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851853.129790:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851853.129790:0:41084:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768552:8768552:1024:4294967295] 2068@kfi7 LPNI seq info [5403695:5403695:16:4294967295]
00000400:00000200:30.0:1773851853.129791:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:26.0:1773851853.129792:0:41084:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:26.0:1773851853.129792:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:30.0:1773851853.129793:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768553:8768553:1024:4294967295] 2090@kfi7 LPNI seq info [5404247:5404247:16:4294967295]
00000400:00000200:30.0:1773851853.129794:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:30.0:1773851853.129795:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:26.0:1773851853.129795:0:41084:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851853.129796:0:41084:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851853.129798:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000800:00000200:26.0:1773851853.129798:0:41084:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:30.0:1773851853.129799:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:26.0:1773851853.129800:0:41084:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851853.129801:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851853.129802:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851853.129804:0:41084:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851853.129805:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851853.129807:0:41084:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000800:00000200:30.0:1773851853.129808:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f Using peer 2090@kfi7(0x20000000000002f)
00000800:00000200:26.0:1773851853.129810:0:41084:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000800:00000200:30.0:1773851853.129811:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000fd057322: Posted send of 324 bytes to peer 0x20000000000002f: rc=0
00000800:00000200:26.0:1773851853.129812:0:41084:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851853.129813:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851853.129814:0:41084:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129816:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129816:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851853.129817:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.129817:0:41084:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851853.129818:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.129818:0:41084:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.129818:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129819:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.129819:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129821:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851853.129821:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851853.129822:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851853.129822:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851853.129822:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851853.129823:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129823:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851853.129823:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851853.129824:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851853.129824:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851853.129825:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2090@kfi7: PUT: OK
00000400:00000200:29.0:1773851853.129826:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bddd7f6b
00000400:00000200:25.0:1773851853.129826:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000400:00000010:29.0:1773851853.129827:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bddd7f6b.
00000400:00000200:25.0:1773851853.129827:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000445da448
00000400:00000010:25.0:1773851853.129827:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000445da448.
00000100:00000001:29.0:1773851853.129828:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:25.0:1773851853.129828:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851853.129829:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:25.0:1773851853.129829:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851853.129831:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:25.0:1773851853.129832:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851853.129833:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851853.129833:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851853.129835:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851853.129835:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851853.129836:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:25.0:1773851853.129836:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851853.129837:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:29.0:1773851853.129838:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000800:00000200:29.0:1773851853.129839:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f Transaction freed
00000800:00000200:25.0:1773851853.129839:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Transaction freed
00000800:00000200:21.0:1773851853.129865:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851853.129865:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851853.129867:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851853.129869:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851853.129871:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.129872:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:21.0:1773851853.129873:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.129874:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000800:00000200:1.0:1773851853.129874:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:21.0:1773851853.129875:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:1.0:1773851853.129875:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851853.129876:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:21.0:1773851853.129876:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:1.0:1773851853.129876:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851853.129877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.129878:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b20c0
00000800:00000200:1.0:1773851853.129878:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851853.129879:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851853.129880:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851853.129881:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d03d5 [1] + 224
00000800:00000200:21.0:1773851853.129882:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851853.129882:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.129883:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.129883:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:21.0:1773851853.129884:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851853.129885:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000400:00000200:1.0:1773851853.129885:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.129885:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851853.129886:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000001:21.0:1773851853.129888:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851853.129888:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000200:21.0:1773851853.129889:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851853.129889:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2080
00000400:00000200:1.0:1773851853.129890:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000040:21.0:1773851853.129892:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851853.129892:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71cae1 [1] + 224
00000800:00000200:1.0:1773851853.129894:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:21.0:1773851853.129896:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851853.129896:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851853.129897:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:1.0:1773851853.129897:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2090@kfi7: PUT: OK
00000100:00000001:26.0:1773851853.129898:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851853.129898:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851853.129898:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851853.129898:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:26.0:1773851853.129899:0:41084:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:1.0:1773851853.129899:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:26.0:1773851853.129900:0:41084:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:26.0:1773851853.129901:0:41084:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000af3b30f4.
00000400:00000200:26.0:1773851853.129901:0:41084:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000001d16f21
00000400:00000010:26.0:1773851853.129902:0:41084:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000001d16f21.
00000100:00000001:26.0:1773851853.129903:0:41084:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:26.0:1773851853.129904:0:41084:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851853.129906:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:26.0:1773851853.129907:0:41084:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851853.129910:0:41084:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851853.129910:0:41084:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851853.129910:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851853.129911:0:41084:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:1.0:1773851853.129911:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851853.129912:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851853.129912:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:26.0:1773851853.129912:0:41084:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:26.0:1773851853.129912:0:41084:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851853.129912:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851853.129913:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:26.0:1773851853.129913:0:41084:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:30.0:1773851853.129914:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:26.0:1773851853.129914:0:41084:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851853.129914:0:41084:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=86 v=66 (66 66 66 66)
00000400:00000010:30.0:1773851853.129915:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851853.129915:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e57a604
00000400:00000010:30.0:1773851853.129916:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e57a604.
00000100:00001000:26.0:1773851853.129916:0:41084:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=86 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851853.129917:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:26.0:1773851853.129917:0:41084:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:30.0:1773851853.129918:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851853.129918:0:41084:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851853.129919:0:41084:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:26.0:1773851853.129919:0:41084:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851853.129920:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851853.129920:0:41084:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:26.0:1773851853.129920:0:41084:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:26.0:1773851853.129921:0:41084:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851853.129922:0:41084:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.129922:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851853.129923:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851853.129923:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851853.129924:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851853.129925:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851853.129925:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851853.129925:0:41084:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851853.129926:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.129926:0:41084:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:26.0:1773851853.129926:0:41084:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851853.129927:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851853.129927:0:41084:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:30.0:1773851853.129928:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=86 v=66 (66 66 66 66)
00000004:00000040:26.0:1773851853.129928:0:41084:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:26.0:1773851853.129928:0:41084:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350959053824 avail=350956949504 avail_mb=1370925584 hwm_mb=3131103 files=371564137 ffree=342733451 state=0: rc = 0
00000100:00001000:30.0:1773851853.129929:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=86 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851853.129930:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851853.129930:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:26.0:1773851853.129930:0:41084:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350959053824 free, 350956949504 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371564137 files, 342733451 free files
00010000:00000001:30.0:1773851853.129931:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851853.129932:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851853.129932:0:41084:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129933:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851853.129933:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000040:26.0:1773851853.129933:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851853.129934:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851853.129934:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851853.129935:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:26.0:1773851853.129936:0:41084:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004c01fc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051922624:2068@kfi7:13:default-yuba2-0
00000100:00000001:26.0:1773851853.129937:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851853.129938:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851853.129938:0:41084:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851853.129939:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851853.129939:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:26.0:1773851853.129939:0:41084:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000004c01fc4 x1859433051922624/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:30.0:1773851853.129940:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851853.129941:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000100:00000001:26.0:1773851853.129941:0:41084:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000040:30.0:1773851853.129942:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351389022208 avail=351386321920 avail_mb=1372602820 hwm_mb=3131103 files=372019222 ffree=343153342 state=0: rc = 0
02000000:00000001:26.0:1773851853.129942:0:41084:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:26.0:1773851853.129942:0:41084:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000513e7f5d.
00000004:00000020:30.0:1773851853.129944:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351389022208 free, 351386321920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019222 files, 343153342 free files
02000000:00000001:26.0:1773851853.129944:0:41084:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851853.129944:0:41084:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851853.129944:0:41084:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:26.0:1773851853.129945:0:41084:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000001:30.0:1773851853.129946:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:26.0:1773851853.129946:0:41084:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000294dbfa2.
00000100:00000040:30.0:1773851853.129947:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:26.0:1773851853.129947:0:41084:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851853.129947:0:41084:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851853.129948:0:41084:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004c01fc4.
00000100:00100000:30.0:1773851853.129949:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e1c723ea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051922560:2090@kfi7:13:default-yuba2-0
00000100:00000001:26.0:1773851853.129949:0:41084:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851853.129949:0:41084:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.129950:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851853.129951:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.129951:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851853.129951:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129952:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851853.129952:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e1c723ea x1859433051922560/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851853.129952:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851853.129952:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129955:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851853.129955:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851853.129956:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003c8399ec.
02000000:00000001:30.0:1773851853.129957:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851853.129958:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851853.129958:0:41091:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000001:30.0:1773851853.129959:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851853.129960:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
02000000:00000001:30.0:1773851853.129961:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851853.129962:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851853.129962:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e1c723ea.
00000100:00000001:30.0:1773851853.129963:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851853.129963:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851853.129964:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851853.129965:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851853.129965:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851853.129966:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851853.129966:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851853.174689:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851853.174691:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851853.174692:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851853.174694:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851853.174696:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.174698:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11920@kfi7 : PUT - for me
00000400:00000200:25.0:1773851853.174699:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.174699:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 1
00000400:00000200:25.0:1773851853.174700:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.174701:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000400:00000200:25.0:1773851853.174702:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 3
00000400:00000200:25.0:1773851853.174703:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11921@kfi7 to cpt 1
00000400:00000200:25.0:1773851853.174704:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11921@kfi7 of length 224 into portal 12 MB=0x69b4b575b4bc0
00000400:00000200:25.0:1773851853.174706:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11921@kfi7 of length 224/224 into md 0x16159c6179 [64] + 178336
00000800:00000200:25.0:1773851853.174707:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851853.174709:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851853.174710:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11920@kfi7: PUT: OK
00000100:00000001:25.0:1773851853.174711:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851853.174712:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851853.174713:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009a2f06a.
00000100:00000040:25.0:1773851853.174714:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000009a2f06a x1859597750717376 msgsize 224
00000100:00100000:25.0:1773851853.174715:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-11921@kfi7 (source: 12345-11920@kfi7)
00000100:00000001:25.0:1773851853.174716:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851853.174718:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851853.174718:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
02000000:00000001:26.0:1773851853.174719:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851853.174719:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851853.174719:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851853.174720:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851853.174721:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851853.174721:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597750717376
00000020:00000001:26.0:1773851853.174722:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851853.174722:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ed63
00000020:00000001:26.0:1773851853.174723:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851853.174724:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b661e706 refcount=5
00000020:00000001:26.0:1773851853.174727:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161058305024 : -106912651246592 : ffff9ec375668400)
00000020:00000001:26.0:1773851853.174728:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161058305024 : -106912651246592 : ffff9ec375668400)
00000100:00000001:26.0:1773851853.174729:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851853.174730:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851853.174730:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851853.174731:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851853.174732:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851853.174733:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851853.174734:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851853.174734:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.174735:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851853.174736:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851853.174736:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.174737:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.174738:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851853.174739:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851853.174739:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851853.174739:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851853.174740:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11921@kfi7, seq: 2025039
00000100:00000040:26.0:1773851853.174741:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b661e706 : new rpc_count 1
00000100:00000001:24.0:1773851853.174741:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.174742:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150692992 : -106980558858624 : ffff9eb3a5ca9680)
00000100:00000001:24.0:1773851853.174742:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.174743:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009a2f06a x1859597750717376/t0(0) o400->0eebdac8-7b88-4014-b570-98df74744c30@11921@kfi7:70/0 lens 224/0 e 0 to 0 dl 1773852185 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1234-0'
00000100:00000001:26.0:1773851853.174746:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851853.174746:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851853.174747:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009a2f06a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:0eebdac8-7b88-4014-b570-98df74744c30+5:39574:x1859597750717376:12345-11921@kfi7:400:default-tuolumne1234-0
00000100:00000200:26.0:1773851853.174749:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597750717376
00000020:00000001:26.0:1773851853.174750:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851853.174750:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851853.174751:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.174752:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851853.174753:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851853.174753:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851853.174754:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597750717376, found 0 last_xid 1859597750717375
00000020:00000001:26.0:1773851853.174755:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851853.174756:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851853.174756:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851853.174757:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.174758:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851853.174759:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851853.174759:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851853.174760:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000551f1b10.
02000000:00000001:26.0:1773851853.174761:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.174762:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.174762:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851853.174763:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690944576, transno 0, xid 1859597750717376
00010000:00000001:26.0:1773851853.174764:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851853.174765:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009a2f06a x1859597750717376/t0(0) o400->0eebdac8-7b88-4014-b570-98df74744c30@11921@kfi7:70/0 lens 224/224 e 0 to 0 dl 1773852185 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1234-0'
00010000:00000001:26.0:1773851853.174767:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851853.174768:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851853.174769:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=86 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851853.174770:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851853.174771:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002d0245cf refcount 3 to 11921@kfi7
00000100:00000001:26.0:1773851853.174772:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981344 : -107130476570272 : ffff9e90bdffd960)
02000000:00000001:26.0:1773851853.174773:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851853.174773:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.174774:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851853.174775:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11920@kfi7
00000400:00000010:26.0:1773851853.174776:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000001d16f21.
00000100:00000200:26.0:1773851853.174776:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597750717376, offset 224
00000400:00000200:26.0:1773851853.174778:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11920@kfi7
00000400:00000200:26.0:1773851853.174779:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:26.0:1773851853.174780:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 1
00000400:00000200:26.0:1773851853.174781:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000400:00000200:26.0:1773851853.174782:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 3
00000400:00000200:26.0:1773851853.174783:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11920@kfi7 local destination
00000400:00000200:26.0:1773851853.174785:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768554:8768554:1024:4294967295] 11920@kfi7 LPNI seq info [1132878:1132878:16:4294967295]
00000400:00000200:26.0:1773851853.174786:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000400:00000200:26.0:1773851853.174786:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:26.0:1773851853.174788:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11920@kfi7(11920@kfi7:11920@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851853.174789:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 3
00000800:00000200:26.0:1773851853.174791:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851853.174792:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851853.174794:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851853.174796:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xfbe Using peer 11920@kfi7(0xfbe)
00000800:00000200:26.0:1773851853.174799:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0xfbe: rc=0
00000800:00000200:26.0:1773851853.174800:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xfbe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851853.174803:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.174804:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002d0245cf refcount 2 to 11921@kfi7
00010000:00000001:26.0:1773851853.174804:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851853.174805:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.174805:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851853.174806:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009a2f06a x1859597750717376/t0(0) o400->0eebdac8-7b88-4014-b570-98df74744c30@11921@kfi7:70/0 lens 224/224 e 0 to 0 dl 1773852185 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1234-0'
00000100:00100000:26.0:1773851853.174809:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009a2f06a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:0eebdac8-7b88-4014-b570-98df74744c30+5:39574:x1859597750717376:12345-11921@kfi7:400:default-tuolumne1234-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851853.174811:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11921@kfi7, seq: 2025039
00000100:00000040:26.0:1773851853.174812:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b661e706 : new rpc_count 0
00000800:00000200:25.0:1773851853.174812:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xfbe TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851853.174813:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851853.174814:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851853.174814:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851853.174815:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851853.174816:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000400:00000200:25.0:1773851853.174816:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:26.0:1773851853.174817:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000b661e706 : new refcount 4
00000400:00000200:25.0:1773851853.174817:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11920@kfi7: PUT: OK
00000100:00000001:26.0:1773851853.174818:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851853.174818:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000001d16f21
00000400:00000010:25.0:1773851853.174818:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000001d16f21.
00000100:00000001:25.0:1773851853.174819:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851853.174819:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851853.174820:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000800:00000200:25.0:1773851853.174822:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 11920@kfi7(00000000a21bcb4b):0x0 lsk 4031 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0xfbe Transaction freed
00000800:00000200:2.0:1773851853.203736:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.203736:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851853.203737:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851853.203737:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851853.203739:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851853.203739:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:2.0:1773851853.203741:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851853.203741:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 23618@kfi7(00000000d61ad799):0xbf9 version: 2; local version 2; negotiated version: 2
00000400:00000200:2.0:1773851853.203743:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23618@kfi7 to cpt 0
00000800:00000200:1.0:1773851853.203743:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 Using peer 23618@kfi7(0x100000000000bf9)
00000400:00000200:2.0:1773851853.203744:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23618@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.203744:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23618@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.203745:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23618@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.203746:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e631762 nid 23618@kfi7 refs 1
00000800:00000200:1.0:1773851853.203746:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 38 bytes to peer 0x100000000000bf9: rc=0
00000400:00000200:2.0:1773851853.203747:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23618@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.203748:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e631762 nid 23618@kfi7 refs 2
00000400:00000200:2.0:1773851853.203748:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000e631762 nid 23618@kfi7 refs 3
00000800:00000200:1.0:1773851853.203748:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851853.203749:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23619@kfi7 to cpt 3
00000400:00000200:2.0:1773851853.203750:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23619@kfi7 of length 224 into portal 12 MB=0x69b83c611a4c0
00000400:00000200:2.0:1773851853.203751:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23619@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 10640
00000800:00000200:2.0:1773851853.203754:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000894f0236: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851853.203755:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851853.203756:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23618@kfi7: PUT: OK
00000100:00000001:2.0:1773851853.203757:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851853.203757:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851853.203758:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ccac766.
00000100:00000040:2.0:1773851853.203759:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000006ccac766 x1859840126330048 msgsize 224
00000100:00100000:2.0:1773851853.203760:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-23619@kfi7 (source: 12345-23618@kfi7)
00000800:00000200:1.0:1773851853.203760:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851853.203762:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:1.0:1773851853.203762:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 Transaction freed
00000400:00000200:2.0:1773851853.203763:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000e631762 nid 23618@kfi7 refs 2
00000800:00000200:2.0:1773851853.203764:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000894f0236: 2054@kfi7:0 <- 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851853.203764:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851853.203765:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851853.203765:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851853.203766:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851853.203767:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.203768:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859840126330048
00000020:00000001:0.0:1773851853.203769:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851853.203769:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087ab3448f1
00000020:00000001:0.0:1773851853.203770:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851853.203773:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d3bc059d refcount=5
00000020:00000001:0.0:1773851853.203774:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121059023872 : -106952650527744 : ffff9eba2541ec00)
00000020:00000001:0.0:1773851853.203775:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121059023872 : -106952650527744 : ffff9eba2541ec00)
00000100:00000001:0.0:1773851853.203776:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.203777:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851853.203778:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851853.203779:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.203780:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851853.203781:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851853.203781:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851853.203782:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.203783:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851853.203784:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851853.203785:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.203786:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.203788:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851853.203788:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851853.203788:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.203788:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851853.203790:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23619@kfi7, seq: 1997484
00000100:00000001:2.0:1773851853.203791:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.203791:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.203791:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d3bc059d : new rpc_count 1
00000100:00000001:0.0:1773851853.203792:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706791424 : -106953002760192 : ffff9eba10434800)
00000100:00000040:0.0:1773851853.203793:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ccac766 x1859840126330048/t0(0) o400->9ae7937b-da08-4c7b-9875-fe6a081eb4df@23619@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1976-0'
00000100:00000001:0.0:1773851853.203796:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.203796:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851853.203798:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ccac766 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9ae7937b-da08-4c7b-9875-fe6a081eb4df+5:39722:x1859840126330048:12345-23619@kfi7:400:default-tuolumne1976-0
00000100:00000200:0.0:1773851853.203799:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859840126330048
00000020:00000001:0.0:1773851853.203800:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851853.203801:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851853.203802:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.203803:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851853.203803:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851853.203804:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851853.203805:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859840126330048, found 0 last_xid 1859840126330047
00000020:00000001:0.0:1773851853.203806:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851853.203807:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.203807:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851853.203808:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.203809:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851853.203809:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851853.203810:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851853.203811:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2dc323e.
02000000:00000001:0.0:1773851853.203812:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.203812:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.203813:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851853.203814:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260828409, transno 0, xid 1859840126330048
00010000:00000001:0.0:1773851853.203815:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851853.203815:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ccac766 x1859840126330048/t0(0) o400->9ae7937b-da08-4c7b-9875-fe6a081eb4df@23619@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1976-0'
00010000:00000001:0.0:1773851853.203819:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851853.203819:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851853.203820:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851853.203822:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851853.203822:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006fce085a refcount 3 to 23619@kfi7
00000100:00000001:0.0:1773851853.203823:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149056 : -107154898402560 : ffff9e8b0e584300)
02000000:00000001:0.0:1773851853.203824:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851853.203825:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.203826:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851853.203826:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23618@kfi7
00000400:00000010:0.0:1773851853.203827:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ccec3e81.
00000100:00000200:0.0:1773851853.203828:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859840126330048, offset 224
00000400:00000200:0.0:1773851853.203830:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23618@kfi7
00000400:00000200:0.0:1773851853.203831:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23618@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.203832:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e631762 nid 23618@kfi7 refs 1
00000400:00000200:0.0:1773851853.203834:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000e631762 nid 23618@kfi7 refs 2
00000400:00000200:0.0:1773851853.203835:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000e631762 nid 23618@kfi7 refs 3
00000400:00000200:0.0:1773851853.203836:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23618@kfi7 local destination
00000400:00000200:0.0:1773851853.203838:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768555:8768555:1024:4294967295] 23618@kfi7 LPNI seq info [51460:51460:16:4294967295]
00000400:00000200:0.0:1773851853.203840:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000e631762 nid 23618@kfi7 refs 2
00000400:00000200:0.0:1773851853.203840:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23618@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.203843:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23618@kfi7(23618@kfi7:23618@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851853.203844:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000e631762 nid 23618@kfi7 refs 3
00000800:00000200:0.0:1773851853.203846:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851853.203847:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851853.203849:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851853.203852:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 Using peer 23618@kfi7(0x100000000000bf9)
00000800:00000200:0.0:1773851853.203857:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x100000000000bf9: rc=0
00000800:00000200:0.0:1773851853.203859:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851853.203861:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.203862:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006fce085a refcount 2 to 23619@kfi7
00010000:00000001:0.0:1773851853.203863:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851853.203864:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.203864:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851853.203867:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ccac766 x1859840126330048/t0(0) o400->9ae7937b-da08-4c7b-9875-fe6a081eb4df@23619@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1976-0'
00000100:00100000:0.0:1773851853.203870:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ccac766 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9ae7937b-da08-4c7b-9875-fe6a081eb4df+5:39722:x1859840126330048:12345-23619@kfi7:400:default-tuolumne1976-0 Request processed in 73us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851853.203873:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23619@kfi7, seq: 1997484
00000100:00000040:0.0:1773851853.203874:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d3bc059d : new rpc_count 0
00000100:00000001:0.0:1773851853.203875:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851853.203876:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851853.203876:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.203877:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851853.203878:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851853.203879:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000d3bc059d : new refcount 4
00000100:00000001:0.0:1773851853.203879:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851853.203885:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851853.203887:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.203888:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23618@kfi7: PUT: OK
00000400:00000200:1.0:1773851853.203889:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ccec3e81
00000400:00000010:1.0:1773851853.203889:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ccec3e81.
00000100:00000001:1.0:1773851853.203890:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851853.203890:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851853.203891:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000e631762 nid 23618@kfi7 refs 2
00000800:00000200:1.0:1773851853.203894:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 23618@kfi7(00000000d61ad799):0x0 lsk 3066 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bf9 Transaction freed
00000800:00000200:25.0:1773851853.204322:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851853.204323:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851853.204324:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851853.204326:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851853.204328:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.204329:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851853.204330:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.204331:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:25.0:1773851853.204331:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.204332:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:25.0:1773851853.204333:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:25.0:1773851853.204334:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851853.204335:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 224 into portal 12 MB=0x69a77b727de40
00000400:00000200:25.0:1773851853.204336:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9811@kfi7 of length 224/224 into md 0x16159c6179 [64] + 178560
00000800:00000200:25.0:1773851853.204338:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851853.204340:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851853.204341:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000100:00000001:25.0:1773851853.204342:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851853.204342:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851853.204344:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000028637c2.
00000100:00000040:25.0:1773851853.204344:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000028637c2 x1858688824892992 msgsize 224
00000100:00100000:25.0:1773851853.204346:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:25.0:1773851853.204347:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851853.204348:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851853.204348:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
02000000:00000001:26.0:1773851853.204349:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851853.204349:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851853.204350:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851853.204350:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851853.204351:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851853.204352:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688824892992
00000020:00000001:26.0:1773851853.204352:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851853.204353:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:26.0:1773851853.204354:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851853.204355:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:26.0:1773851853.204355:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:26.0:1773851853.204356:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:26.0:1773851853.204357:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851853.204358:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851853.204359:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851853.204360:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851853.204361:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851853.204362:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851853.204362:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851853.204362:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.204363:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851853.204364:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851853.204364:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.204365:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.204366:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851853.204366:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851853.204367:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851853.204367:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851853.204368:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9811@kfi7, seq: 2025040
00000100:00000040:26.0:1773851853.204368:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c3e651d4 : new rpc_count 6
00000100:00000001:26.0:1773851853.204369:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150706816 : -106980558844800 : ffff9eb3a5cacc80)
00000100:00000001:24.0:1773851853.204369:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851853.204369:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.204370:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000028637c2 x1858688824892992/t0(0) o400->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:70/0 lens 224/0 e 0 to 0 dl 1773852185 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1110-0'
00000100:00000001:26.0:1773851853.204373:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851853.204373:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851853.204375:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000028637c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb+674:39542:x1858688824892992:12345-9811@kfi7:400:default-tuolumne1110-0
00000100:00000200:26.0:1773851853.204376:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858688824892992
00000020:00000001:26.0:1773851853.204377:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851853.204377:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851853.204378:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.204378:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851853.204379:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851853.204380:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851853.204380:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858688824892992, found 0 last_xid 1858688799811199
00000020:00000001:26.0:1773851853.204381:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851853.204382:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851853.204382:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851853.204383:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.204384:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851853.204385:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851853.204385:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851853.204387:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000da174bc7.
02000000:00000001:26.0:1773851853.204388:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.204388:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.204389:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851853.204390:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589670, transno 0, xid 1858688824892992
00010000:00000001:26.0:1773851853.204391:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851853.204391:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000028637c2 x1858688824892992/t0(0) o400->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:70/0 lens 224/224 e 0 to 0 dl 1773852185 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1110-0'
00010000:00000001:26.0:1773851853.204394:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851853.204395:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851853.204395:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=86 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851853.204396:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851853.204397:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005543abc2 refcount 3 to 9811@kfi7
00000100:00000001:26.0:1773851853.204398:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612320 : -107130477939296 : ffff9e90bdeaf5a0)
02000000:00000001:26.0:1773851853.204399:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851853.204399:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.204400:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851853.204401:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9810@kfi7
00000400:00000010:26.0:1773851853.204402:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007ea02df2.
00000100:00000200:26.0:1773851853.204402:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858688824892992, offset 224
00000400:00000200:26.0:1773851853.204404:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9810@kfi7
00000400:00000200:26.0:1773851853.204405:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851853.204405:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:26.0:1773851853.204406:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:26.0:1773851853.204408:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:26.0:1773851853.204409:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9810@kfi7 local destination
00000400:00000200:26.0:1773851853.204410:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768556:8768556:1024:4294967295] 9810@kfi7 LPNI seq info [3397418:3397418:16:4294967295]
00000400:00000200:26.0:1773851853.204411:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:26.0:1773851853.204412:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851853.204414:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9810@kfi7(9810@kfi7:9810@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851853.204415:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000800:00000200:26.0:1773851853.204417:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851853.204418:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851853.204420:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851853.204422:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000249 Using peer 9810@kfi7(0x100000000000249)
00000800:00000200:26.0:1773851853.204425:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x100000000000249: rc=0
00000800:00000200:26.0:1773851853.204427:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000249 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851853.204429:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.204430:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005543abc2 refcount 2 to 9811@kfi7
00010000:00000001:26.0:1773851853.204430:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851853.204431:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.204432:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851853.204432:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000028637c2 x1858688824892992/t0(0) o400->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:70/0 lens 224/224 e 0 to 0 dl 1773852185 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1110-0'
00000100:00100000:26.0:1773851853.204436:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000028637c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb+674:39542:x1858688824892992:12345-9811@kfi7:400:default-tuolumne1110-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851853.204438:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9811@kfi7, seq: 2025040
00000100:00000040:26.0:1773851853.204438:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c3e651d4 : new rpc_count 5
00000800:00000200:25.0:1773851853.204438:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000249 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851853.204439:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851853.204440:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851853.204440:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851853.204440:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851853.204441:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000400:00000200:25.0:1773851853.204441:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000020:00000010:26.0:1773851853.204442:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000400:00000200:25.0:1773851853.204442:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007ea02df2
00000400:00000010:25.0:1773851853.204442:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007ea02df2.
00000020:00000040:26.0:1773851853.204443:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:26.0:1773851853.204443:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851853.204443:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851853.204444:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851853.204444:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000800:00000200:25.0:1773851853.204446:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000249 Transaction freed
00000800:00000200:9.0:1773851853.266813:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851853.266814:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851853.266816:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851853.266818:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851853.266820:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17872@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.266821:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17872@kfi7 : PUT - for me
00000400:00000200:9.0:1773851853.266822:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17872@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.266823:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f7ebd4b nid 17872@kfi7 refs 1
00000400:00000200:9.0:1773851853.266824:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17872@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.266825:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f7ebd4b nid 17872@kfi7 refs 2
00000400:00000200:9.0:1773851853.266826:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005f7ebd4b nid 17872@kfi7 refs 3
00000400:00000200:9.0:1773851853.266827:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.266828:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17681@kfi7 of length 224 into portal 12 MB=0x699e1357a2180
00000400:00000200:9.0:1773851853.266829:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17681@kfi7 of length 224/224 into md 0x78146ce49 [64] + 117208
00000800:00000200:9.0:1773851853.266830:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851853.266832:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.266833:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17872@kfi7: PUT: OK
00000100:00000001:9.0:1773851853.266834:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851853.266835:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851853.266836:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004ff51ca0.
00000100:00000040:9.0:1773851853.266837:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004ff51ca0 x1858042404151680 msgsize 224
00000100:00100000:9.0:1773851853.266838:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17681@kfi7 (source: 12345-17872@kfi7)
00000100:00000001:9.0:1773851853.266839:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851853.266841:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005f7ebd4b nid 17872@kfi7 refs 2
00000100:00000001:8.0:1773851853.266841:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851853.266842:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851853.266842:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851853.266842:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851853.266843:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.266843:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851853.266844:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042404151680
00000020:00000001:8.0:1773851853.266845:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851853.266845:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92611
00000020:00000001:8.0:1773851853.266846:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851853.266850:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000013630f62 refcount=3502
00000020:00000001:8.0:1773851853.266850:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631004160 : -107123078547456 : ffff9e9276f4b800)
00000020:00000001:8.0:1773851853.266851:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631004160 : -107123078547456 : ffff9e9276f4b800)
00000100:00000001:8.0:1773851853.266852:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.266853:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851853.266854:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025ad5da9.
00000020:00000010:8.0:1773851853.266855:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.266856:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851853.266857:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851853.266857:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851853.266858:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851853.266859:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851853.266860:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851853.266860:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.266861:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851853.266863:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851853.266863:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851853.266863:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851853.266863:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851853.266864:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17681@kfi7, seq: 2130716
00000100:00000001:11.0:1773851853.266865:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.266865:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000013630f62 : new rpc_count 12
00000100:00000001:8.0:1773851853.266866:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792155904 : -106938917395712 : ffff9ebd57d0e300)
00000100:00000001:11.0:1773851853.266867:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.266867:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004ff51ca0 x1858042404151680/t0(0) o400->8f4c580e-cb98-4f09-8f03-170cdd130106@17681@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1601-0'
00000100:00000001:8.0:1773851853.266870:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.266870:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851853.266871:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ff51ca0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8f4c580e-cb98-4f09-8f03-170cdd130106+3502:39689:x1858042404151680:12345-17681@kfi7:400:default-tuolumne1601-0
00000100:00000200:8.0:1773851853.266873:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042404151680
00000020:00000001:8.0:1773851853.266874:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851853.266874:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851853.266875:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.266876:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851853.266876:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851853.266877:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851853.266878:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042404151680, found 0 last_xid 1858042403418431
00000020:00000001:8.0:1773851853.266879:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851853.266879:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851853.266880:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851853.266881:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.266881:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851853.266882:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851853.266882:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851853.266884:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000783bd1d5.
02000000:00000001:8.0:1773851853.266885:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.266885:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.266886:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851853.266887:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264585740, transno 0, xid 1858042404151680
00010000:00000001:8.0:1773851853.266887:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851853.266889:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004ff51ca0 x1858042404151680/t0(0) o400->8f4c580e-cb98-4f09-8f03-170cdd130106@17681@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1601-0'
00010000:00000001:8.0:1773851853.266891:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851853.266892:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851853.266893:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=86 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851853.266894:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851853.266895:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3132021 refcount 3 to 17681@kfi7
00000100:00000001:8.0:1773851853.266895:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959056768 : -107146750494848 : ffff9e8cf3ff7780)
02000000:00000001:8.0:1773851853.266896:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851853.266897:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.266898:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851853.266899:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17872@kfi7
00000400:00000010:8.0:1773851853.266899:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000b6b4cce.
00000100:00000200:8.0:1773851853.266900:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042404151680, offset 224
00000400:00000200:8.0:1773851853.266901:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17872@kfi7
00000400:00000200:8.0:1773851853.266902:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17872@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.266903:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f7ebd4b nid 17872@kfi7 refs 1
00000400:00000200:8.0:1773851853.266904:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005f7ebd4b nid 17872@kfi7 refs 2
00000400:00000200:8.0:1773851853.266906:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005f7ebd4b nid 17872@kfi7 refs 3
00000400:00000200:8.0:1773851853.266907:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17872@kfi7 local destination
00000400:00000200:8.0:1773851853.266908:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768557:8768557:1024:4294967295] 17872@kfi7 LPNI seq info [8343728:8343728:16:4294967295]
00000400:00000200:8.0:1773851853.266909:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005f7ebd4b nid 17872@kfi7 refs 2
00000400:00000200:8.0:1773851853.266910:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17872@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.266912:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17872@kfi7(17872@kfi7:17872@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851853.266913:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005f7ebd4b nid 17872@kfi7 refs 3
00000800:00000200:8.0:1773851853.266914:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851853.266915:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851853.266918:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851853.266920:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa0d Using peer 17872@kfi7(0xa0d)
00000800:00000200:8.0:1773851853.266923:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0xa0d: rc=0
00000800:00000200:8.0:1773851853.266924:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa0d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851853.266926:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.266927:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3132021 refcount 2 to 17681@kfi7
00010000:00000001:8.0:1773851853.266928:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851853.266928:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.266929:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851853.266929:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004ff51ca0 x1858042404151680/t0(0) o400->8f4c580e-cb98-4f09-8f03-170cdd130106@17681@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1601-0'
00000100:00100000:8.0:1773851853.266933:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ff51ca0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8f4c580e-cb98-4f09-8f03-170cdd130106+3502:39689:x1858042404151680:12345-17681@kfi7:400:default-tuolumne1601-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851853.266935:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17681@kfi7, seq: 2130716
00000100:00000040:8.0:1773851853.266936:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000013630f62 : new rpc_count 11
00000100:00000001:8.0:1773851853.266937:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851853.266937:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851853.266938:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.266939:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851853.266939:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025ad5da9.
00000020:00000040:8.0:1773851853.266940:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000013630f62 : new refcount 3501
00000100:00000001:8.0:1773851853.266941:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851853.266945:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa0d TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851853.266947:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.266948:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17872@kfi7: PUT: OK
00000400:00000200:9.0:1773851853.266949:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000b6b4cce
00000400:00000010:9.0:1773851853.266949:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000b6b4cce.
00000100:00000001:9.0:1773851853.266950:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851853.266950:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851853.266951:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005f7ebd4b nid 17872@kfi7 refs 2
00000800:00000200:9.0:1773851853.266953:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 17872@kfi7(00000000a7cde9f7):0x0 lsk 2574 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa0d Transaction freed
00000800:00000200:18.0:1773851853.270815:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851853.270816:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851853.270817:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851853.270820:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851853.270822:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20593@kfi7 to cpt 4
00000400:00000200:18.0:1773851853.270823:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20593@kfi7 : PUT - for me
00000400:00000200:18.0:1773851853.270824:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20593@kfi7 to cpt 4
00000400:00000200:18.0:1773851853.270825:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 1
00000400:00000200:18.0:1773851853.270826:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20593@kfi7 to cpt 4
00000400:00000200:18.0:1773851853.270827:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 2
00000400:00000200:18.0:1773851853.270828:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 3
00000400:00000200:18.0:1773851853.270828:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20592@kfi7 to cpt 1
00000400:00000200:18.0:1773851853.270829:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20592@kfi7 of length 224 into portal 12 MB=0x69a88c45fc000
00000400:00000200:18.0:1773851853.270831:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20592@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 188288
00000800:00000200:18.0:1773851853.270833:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851853.270834:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851853.270836:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20593@kfi7: PUT: OK
00000100:00000001:18.0:1773851853.270837:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851853.270837:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851853.270838:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000340e4ee5.
00000100:00000040:18.0:1773851853.270839:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000340e4ee5 x1858762061103104 msgsize 224
00000100:00100000:18.0:1773851853.270841:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-20592@kfi7 (source: 12345-20593@kfi7)
00000100:00000001:18.0:1773851853.270842:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851853.270843:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 2
00000800:00000200:18.0:1773851853.270844:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851853.270847:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851853.270847:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851853.270848:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851853.270848:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851853.270849:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851853.270850:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858762061103104
00000020:00000001:18.0:1773851853.270850:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851853.270851:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92156
00000020:00000001:18.0:1773851853.270851:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851853.270853:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c114cfce refcount=4238
00000020:00000001:18.0:1773851853.270854:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629775360 : -107123079776256 : ffff9e9276e1f800)
00000020:00000001:18.0:1773851853.270855:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629775360 : -107123079776256 : ffff9e9276e1f800)
00000100:00000001:18.0:1773851853.270856:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851853.270857:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851853.270858:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002a3a26dd.
00000020:00000010:18.0:1773851853.270859:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851853.270860:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004b65e428.
00000100:00000001:18.0:1773851853.270860:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851853.270861:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851853.270861:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851853.270863:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851853.270863:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851853.270863:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851853.270864:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851853.270865:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851853.270866:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851853.270867:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:18.0:1773851853.270867:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20592@kfi7, seq: 2156253
00000100:00000001:19.0:1773851853.270868:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:18.0:1773851853.270868:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c114cfce : new rpc_count 17
00000100:00000001:19.0:1773851853.270869:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851853.270869:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534653824 : -106946174897792 : ffff9ebba73c3180)
00000100:00000001:19.0:1773851853.270870:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851853.270870:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000340e4ee5 x1858762061103104/t0(0) o400->935d699f-c617-4e48-96a7-4e796eb51501@20592@kfi7:43/0 lens 224/0 e 0 to 0 dl 1773852158 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1774-0'
00000100:00000001:18.0:1773851853.270872:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851853.270873:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851853.270874:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000340e4ee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:935d699f-c617-4e48-96a7-4e796eb51501+4238:39597:x1858762061103104:12345-20592@kfi7:400:default-tuolumne1774-0
00000100:00000200:18.0:1773851853.270875:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858762061103104
00000020:00000001:18.0:1773851853.270876:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851853.270876:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851853.270877:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851853.270877:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851853.270878:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851853.270879:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851853.270879:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858762061103104, found 0 last_xid 1858762060390015
00000020:00000001:18.0:1773851853.270880:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851853.270881:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851853.270882:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851853.270882:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851853.270883:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851853.270884:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851853.270884:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851853.270885:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f8fc0f95.
02000000:00000001:18.0:1773851853.270886:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851853.270886:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851853.270887:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851853.270888:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593035, transno 0, xid 1858762061103104
00010000:00000001:18.0:1773851853.270889:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851853.270889:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000340e4ee5 x1858762061103104/t0(0) o400->935d699f-c617-4e48-96a7-4e796eb51501@20592@kfi7:43/0 lens 224/224 e 0 to 0 dl 1773852158 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1774-0'
00010000:00000001:18.0:1773851853.270892:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851853.270893:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851853.270893:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=86 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851853.270894:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851853.270895:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000469bd9a2 refcount 3 to 20592@kfi7
00000100:00000001:18.0:1773851853.270896:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410368 : -107145304141248 : ffff9e8d4a351240)
02000000:00000001:18.0:1773851853.270896:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851853.270897:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851853.270898:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851853.270899:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20593@kfi7
00000400:00000010:18.0:1773851853.270899:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6f9e0c1.
00000100:00000200:18.0:1773851853.270900:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858762061103104, offset 224
00000400:00000200:18.0:1773851853.270901:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20593@kfi7
00000400:00000200:18.0:1773851853.270902:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20593@kfi7 to cpt 4
00000400:00000200:18.0:1773851853.270903:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 1
00000400:00000200:18.0:1773851853.270904:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 2
00000400:00000200:18.0:1773851853.270905:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 3
00000400:00000200:18.0:1773851853.270906:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20593@kfi7 local destination
00000400:00000200:18.0:1773851853.270907:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768558:8768558:1024:4294967295] 20593@kfi7 LPNI seq info [7348993:7348993:16:4294967295]
00000400:00000200:18.0:1773851853.270908:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 2
00000400:00000200:18.0:1773851853.270909:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20593@kfi7 to cpt 4
00000400:00000200:18.0:1773851853.270911:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20593@kfi7(20593@kfi7:20593@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851853.270912:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 3
00000800:00000200:18.0:1773851853.270913:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851853.270914:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851853.270916:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851853.270919:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000112a Using peer 20593@kfi7(0x10000000000112a)
00000800:00000200:18.0:1773851853.270922:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000b4a37ded: Posted send of 324 bytes to peer 0x10000000000112a: rc=0
00000800:00000200:18.0:1773851853.270923:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000112a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851853.270925:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851853.270926:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000469bd9a2 refcount 2 to 20592@kfi7
00010000:00000001:18.0:1773851853.270927:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851853.270927:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851853.270928:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851853.270928:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000340e4ee5 x1858762061103104/t0(0) o400->935d699f-c617-4e48-96a7-4e796eb51501@20592@kfi7:43/0 lens 224/224 e 0 to 0 dl 1773852158 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1774-0'
00000100:00100000:18.0:1773851853.270932:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000340e4ee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:935d699f-c617-4e48-96a7-4e796eb51501+4238:39597:x1858762061103104:12345-20592@kfi7:400:default-tuolumne1774-0 Request processed in 58us (91us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851853.270934:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20592@kfi7, seq: 2156253
00000100:00000040:18.0:1773851853.270935:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c114cfce : new rpc_count 16
00000100:00000001:18.0:1773851853.270935:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851853.270936:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851853.270936:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000800:00000200:17.0:1773851853.270936:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000112a TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851853.270937:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004b65e428.
00000020:00000010:18.0:1773851853.270938:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002a3a26dd.
00000020:00000040:18.0:1773851853.270939:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000c114cfce : new refcount 4237
00000400:00000200:17.0:1773851853.270939:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851853.270941:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851853.270941:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20593@kfi7: PUT: OK
00000400:00000200:17.0:1773851853.270942:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6f9e0c1
00000400:00000010:17.0:1773851853.270943:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6f9e0c1.
00000100:00000001:17.0:1773851853.270944:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851853.270945:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851853.270946:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000039d7f3a8 nid 20593@kfi7 refs 2
00000800:00000200:17.0:1773851853.270949:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 20593@kfi7(00000000e2c20f23):0x0 lsk 4395 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000112a Transaction freed
00000800:00000200:1.0:1773851853.278167:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.278168:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851853.278169:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851853.278171:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851853.278174:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.278175:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11939@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.278176:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.278177:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 1
00000400:00000200:1.0:1773851853.278178:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.278179:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000400:00000200:1.0:1773851853.278180:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 3
00000400:00000200:1.0:1773851853.278181:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11875@kfi7 to cpt 4
00000400:00000200:1.0:1773851853.278182:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11875@kfi7 of length 224 into portal 12 MB=0x69b09f34d1ec0
00000400:00000200:1.0:1773851853.278184:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11875@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 10864
00000800:00000200:1.0:1773851853.278186:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851853.278187:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.278188:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11939@kfi7: PUT: OK
00000100:00000001:1.0:1773851853.278189:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851853.278190:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851853.278191:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003797818e.
00000100:00000040:1.0:1773851853.278191:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000003797818e x1859316899192512 msgsize 224
00000100:00100000:1.0:1773851853.278193:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11875@kfi7 (source: 12345-11939@kfi7)
00000100:00000001:1.0:1773851853.278194:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851853.278195:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000100:00000001:0.0:1773851853.278195:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851853.278196:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851853.278196:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851853.278196:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851853.278197:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851853.278198:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.278199:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316899192512
00000020:00000001:0.0:1773851853.278199:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851853.278200:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916c1
00000020:00000001:0.0:1773851853.278200:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851853.278202:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000016f43646 refcount=66
00000020:00000001:0.0:1773851853.278203:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241490432 : -107152468061184 : ffff9e8b9f345400)
00000020:00000001:0.0:1773851853.278204:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241490432 : -107152468061184 : ffff9e8b9f345400)
00000100:00000001:0.0:1773851853.278204:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.278206:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851853.278206:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851853.278207:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.278208:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851853.278209:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851853.278209:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851853.278210:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.278210:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851853.278211:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851853.278211:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.278212:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.278213:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.278213:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851853.278214:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851853.278214:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851853.278215:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.278215:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11875@kfi7, seq: 1997485
00000100:00000040:0.0:1773851853.278215:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000016f43646 : new rpc_count 2
00000100:00000001:2.0:1773851853.278216:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.278216:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605669632 : -106923103881984 : ffff9ec1065ff500)
00000100:00000040:0.0:1773851853.278217:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003797818e x1859316899192512/t0(0) o400->f3103dab-b948-4502-8ded-56b82d207221@11875@kfi7:493/0 lens 224/0 e 0 to 0 dl 1773852608 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1228-0'
00000100:00000001:0.0:1773851853.278220:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.278220:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851853.278221:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003797818e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f3103dab-b948-4502-8ded-56b82d207221+66:39644:x1859316899192512:12345-11875@kfi7:400:default-tuolumne1228-0
00000100:00000200:0.0:1773851853.278222:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316899192512
00000020:00000001:0.0:1773851853.278223:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851853.278223:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851853.278224:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.278225:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851853.278225:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851853.278226:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851853.278226:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316899192512, found 0 last_xid 1859316898628223
00000020:00000001:0.0:1773851853.278227:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851853.278228:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.278228:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851853.278229:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.278229:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851853.278230:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851853.278230:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851853.278231:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000971481d5.
02000000:00000001:0.0:1773851853.278231:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.278232:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.278233:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851853.278233:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586628, transno 0, xid 1859316899192512
00010000:00000001:0.0:1773851853.278234:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851853.278235:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003797818e x1859316899192512/t0(0) o400->f3103dab-b948-4502-8ded-56b82d207221@11875@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1228-0'
00010000:00000001:0.0:1773851853.278237:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851853.278237:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851853.278238:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851853.278239:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851853.278240:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000711ef0da refcount 3 to 11875@kfi7
00000100:00000001:0.0:1773851853.278240:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301331936 : -107155408219680 : ffff9e8aeff511e0)
02000000:00000001:0.0:1773851853.278241:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851853.278241:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.278242:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851853.278243:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11939@kfi7
00000400:00000010:0.0:1773851853.278243:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c05e23f.
00000100:00000200:0.0:1773851853.278244:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316899192512, offset 224
00000400:00000200:0.0:1773851853.278245:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11939@kfi7
00000400:00000200:0.0:1773851853.278246:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.278247:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 1
00000400:00000200:0.0:1773851853.278248:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000400:00000200:0.0:1773851853.278249:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 3
00000400:00000200:0.0:1773851853.278250:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11939@kfi7 local destination
00000400:00000200:0.0:1773851853.278251:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768559:8768559:1024:4294967295] 11939@kfi7 LPNI seq info [832169:832169:16:4294967295]
00000400:00000200:0.0:1773851853.278252:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000400:00000200:0.0:1773851853.278253:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.278255:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11939@kfi7(11939@kfi7:11939@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851853.278256:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 3
00000800:00000200:0.0:1773851853.278257:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851853.278258:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851853.278260:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851853.278262:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005d9 Using peer 11939@kfi7(0x1000000000005d9)
00000800:00000200:0.0:1773851853.278265:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x1000000000005d9: rc=0
00000800:00000200:0.0:1773851853.278266:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005d9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851853.278268:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.278269:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000711ef0da refcount 2 to 11875@kfi7
00010000:00000001:0.0:1773851853.278269:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851853.278270:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.278270:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851853.278271:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003797818e x1859316899192512/t0(0) o400->f3103dab-b948-4502-8ded-56b82d207221@11875@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1228-0'
00000100:00100000:0.0:1773851853.278275:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003797818e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f3103dab-b948-4502-8ded-56b82d207221+66:39644:x1859316899192512:12345-11875@kfi7:400:default-tuolumne1228-0 Request processed in 53us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851853.278277:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11875@kfi7, seq: 1997485
00000100:00000040:0.0:1773851853.278278:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000016f43646 : new rpc_count 1
00000100:00000001:0.0:1773851853.278278:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851853.278279:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851853.278279:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.278280:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851853.278281:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851853.278282:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000016f43646 : new refcount 65
00000100:00000001:0.0:1773851853.278282:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851853.278287:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005d9 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851853.278289:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.278291:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11939@kfi7: PUT: OK
00000400:00000200:1.0:1773851853.278291:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c05e23f
00000400:00000010:1.0:1773851853.278292:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c05e23f.
00000100:00000001:1.0:1773851853.278293:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851853.278293:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851853.278294:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000800:00000200:1.0:1773851853.278295:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11939@kfi7(00000000a6218cb0):0x0 lsk 1498 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005d9 Transaction freed
00000800:00000200:9.0:1773851853.324526:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851853.324527:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851853.324528:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851853.324530:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851853.324532:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.324534:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.44@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851853.324535:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.324535:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851853.324537:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.44@o2ib60 to cpt 5
00000400:00000200:9.0:1773851853.324538:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 2
00000400:00000200:9.0:1773851853.324540:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 3
00000400:00000200:9.0:1773851853.324540:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.44@o2ib60 to cpt 5
00000400:00000200:9.0:1773851853.324542:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.44@o2ib60 of length 224 into portal 12 MB=0x69b2b0598a240
00000400:00000200:9.0:1773851853.324543:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.44@o2ib60 of length 224/224 into md 0x6a32cacf5 [64] + 23360
00000800:00000200:9.0:1773851853.324545:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851853.324549:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.324549:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851853.324551:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851853.324551:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851853.324552:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000582bfbf9.
00000100:00000040:9.0:1773851853.324552:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000582bfbf9 x1859458940052032 msgsize 224
00000100:00100000:9.0:1773851853.324554:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.44@o2ib60 (source: 12345-192.168.128.44@o2ib60)
00000100:00000001:9.0:1773851853.324557:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851853.324558:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851853.324559:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851853.324560:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851853.324560:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851853.324561:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851853.324561:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851853.324562:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851853.324563:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859458940052032
00000020:00000001:23.0:1773851853.324564:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851853.324564:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c5f4c88e1
00000020:00000001:23.0:1773851853.324565:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851853.324567:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d45491cf refcount=5
00000020:00000001:23.0:1773851853.324568:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636992240006144 : -107081469545472 : ffff9e9c270bb400)
00000020:00000001:23.0:1773851853.324569:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636992240006144 : -107081469545472 : ffff9e9c270bb400)
00000100:00000001:23.0:1773851853.324570:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851853.324570:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851853.324571:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000054a79f9a.
00000020:00000010:23.0:1773851853.324572:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851853.324573:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851853.324574:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851853.324574:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851853.324575:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851853.324576:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851853.324576:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851853.324577:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.324578:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851853.324579:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851853.324580:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851853.324580:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851853.324580:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851853.324581:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.44@o2ib60, seq: 1997925
00000100:00000040:23.0:1773851853.324582:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d45491cf : new rpc_count 1
00000100:00000001:22.0:1773851853.324582:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.324583:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792142080 : -106938917409536 : ffff9ebd57d0ad00)
00000100:00000001:22.0:1773851853.324583:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851853.324584:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000582bfbf9 x1859458940052032/t0(0) o400->d7135126-0e2a-45af-ba93-31b92fb030ef@192.168.128.44@o2ib60:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix44-0'
00000100:00000001:23.0:1773851853.324587:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851853.324587:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851853.324588:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000582bfbf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d7135126-0e2a-45af-ba93-31b92fb030ef+5:39987:x1859458940052032:12345-192.168.128.44@o2ib60:400:default-matrix44-0
00000100:00000200:23.0:1773851853.324589:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859458940052032
00000020:00000001:23.0:1773851853.324590:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851853.324591:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851853.324592:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.324592:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851853.324593:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851853.324594:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851853.324594:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859458940052032, found 0 last_xid 1859458940052031
00000020:00000001:23.0:1773851853.324595:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851853.324596:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851853.324596:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851853.324597:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.324597:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851853.324598:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851853.324598:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851853.324599:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001147eaac.
02000000:00000001:23.0:1773851853.324600:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.324601:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.324602:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851853.324602:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183077510627, transno 0, xid 1859458940052032
00010000:00000001:23.0:1773851853.324603:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851853.324604:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000582bfbf9 x1859458940052032/t0(0) o400->d7135126-0e2a-45af-ba93-31b92fb030ef@192.168.128.44@o2ib60:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix44-0'
00010000:00000001:23.0:1773851853.324606:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851853.324607:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851853.324608:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=86 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851853.324609:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851853.324610:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000045e72181 refcount 3 to 192.168.128.44@o2ib60
00000100:00000001:23.0:1773851853.324610:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452384 : -107146752099232 : ffff9e8cf3e6fc60)
02000000:00000001:23.0:1773851853.324611:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851853.324612:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.324612:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851853.324613:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.44@o2ib60
00000400:00000010:23.0:1773851853.324614:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000403003e5.
00000100:00000200:23.0:1773851853.324615:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859458940052032, offset 224
00000400:00000200:23.0:1773851853.324617:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.44@o2ib60
00000400:00000200:23.0:1773851853.324618:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.44@o2ib60 to cpt 5
00000400:00000200:23.0:1773851853.324619:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 2
00000400:00000200:23.0:1773851853.324620:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 3
00000400:00000200:23.0:1773851853.324622:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 4
00000400:00000200:23.0:1773851853.324624:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.44@o2ib60 routed destination
00000400:00000200:23.0:1773851853.324625:0:61145:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851853.324626:0:61145:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:23.0:1773851853.324628:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.44@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851853.324629:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851853.324630:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.44@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851853.324631:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851853.324632:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768560:8768560:1024:4294967295] 2094@kfi7 LPNI seq info [1258746981:1258746981:16:4294967295]
00000400:00000200:23.0:1773851853.324633:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:23.0:1773851853.324634:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:23.0:1773851853.324637:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.44@o2ib60(192.168.128.44@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851853.324638:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 3
00000800:00000200:23.0:1773851853.324639:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851853.324641:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851853.324643:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851853.324645:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:23.0:1773851853.324648:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:23.0:1773851853.324649:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851853.324651:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851853.324652:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000045e72181 refcount 2 to 192.168.128.44@o2ib60
00010000:00000001:23.0:1773851853.324653:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851853.324653:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.324654:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851853.324655:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000582bfbf9 x1859458940052032/t0(0) o400->d7135126-0e2a-45af-ba93-31b92fb030ef@192.168.128.44@o2ib60:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix44-0'
00000100:00100000:23.0:1773851853.324659:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000582bfbf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d7135126-0e2a-45af-ba93-31b92fb030ef+5:39987:x1859458940052032:12345-192.168.128.44@o2ib60:400:default-matrix44-0 Request processed in 71us (105us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851853.324659:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851853.324660:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851853.324661:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.44@o2ib60, seq: 1997925
00000100:00000040:23.0:1773851853.324662:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d45491cf : new rpc_count 0
00000400:00000200:21.0:1773851853.324662:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:21.0:1773851853.324662:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000403003e5
00000100:00000001:23.0:1773851853.324663:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851853.324663:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:21.0:1773851853.324663:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000403003e5.
00000020:00000010:23.0:1773851853.324664:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851853.324664:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851853.324664:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851853.324665:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:23.0:1773851853.324665:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000054a79f9a.
00000400:00000200:21.0:1773851853.324665:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000040:23.0:1773851853.324666:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000d45491cf : new refcount 4
00000100:00000001:23.0:1773851853.324667:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851853.324667:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Transaction freed
00000800:00000200:31.0:1773851853.428291:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851853.428292:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851853.428293:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a3f98e4d: 2069@kfi7:7 <- 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851853.428295:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a3f98e4d: 2069@kfi7:7 <- 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851853.428297:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.428298:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15075@kfi7 : PUT - for me
00000400:00000200:31.0:1773851853.428299:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.428300:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 1
00000400:00000200:31.0:1773851853.428302:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.428303:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000400:00000200:31.0:1773851853.428304:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 3
00000400:00000200:31.0:1773851853.428305:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.428306:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15075@kfi7 of length 224 into portal 12 MB=0x69b4b57487140
00000400:00000200:31.0:1773851853.428307:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15075@kfi7 of length 224/224 into md 0x77fe139dd [64] + 159560
00000800:00000200:31.0:1773851853.428310:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a3f98e4d: 2069@kfi7:7 <- 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851853.428311:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851853.428312:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15075@kfi7: PUT: OK
00000100:00000001:31.0:1773851853.428314:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851853.428314:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851853.428315:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000182ebf41.
00000100:00000040:31.0:1773851853.428316:0:2465875:0:(events.c:358:request_in_callback()) incoming req@00000000182ebf41 x1859597749481792 msgsize 224
00000100:00100000:31.0:1773851853.428317:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-15075@kfi7 (source: 12345-15075@kfi7)
00000100:00000001:31.0:1773851853.428319:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851853.428320:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000800:00000200:31.0:1773851853.428322:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a3f98e4d: 2069@kfi7:7 <- 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851853.428325:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851853.428325:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851853.428326:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851853.428326:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851853.428327:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851853.428328:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597749481792
00000020:00000001:31.0:1773851853.428329:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851853.428329:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e862
00000020:00000001:31.0:1773851853.428330:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851853.428333:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000962fe2ad refcount=5
00000020:00000001:31.0:1773851853.428334:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157024034816 : -106916685516800 : ffff9ec284f07000)
00000020:00000001:31.0:1773851853.428335:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157024034816 : -106916685516800 : ffff9ec284f07000)
00000100:00000001:31.0:1773851853.428336:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.428337:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851853.428338:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000238b2613.
00000020:00000010:31.0:1773851853.428339:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.428340:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851853.428341:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851853.428341:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851853.428342:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.428343:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851853.428344:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851853.428344:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.428345:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.428346:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.428347:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851853.428348:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15075@kfi7, seq: 2055452
00000100:00000040:31.0:1773851853.428348:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000962fe2ad : new rpc_count 1
00000100:00000001:29.0:1773851853.428348:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.428349:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636970059004288 : -107103650547328 : ffff9e96fcf47980)
00000100:00000001:29.0:1773851853.428349:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851853.428350:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000182ebf41 x1859597749481792/t0(0) o400->898c8171-d161-4e53-b143-d9fcdd253bcf@15075@kfi7:641/0 lens 224/0 e 0 to 0 dl 1773852001 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1419-0'
00000100:00000001:29.0:1773851853.428350:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851853.428351:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.428353:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.428353:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851853.428354:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000182ebf41 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:898c8171-d161-4e53-b143-d9fcdd253bcf+5:39760:x1859597749481792:12345-15075@kfi7:400:default-tuolumne1419-0
00000100:00000200:31.0:1773851853.428355:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597749481792
00000020:00000001:31.0:1773851853.428356:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851853.428357:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851853.428357:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.428358:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851853.428358:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851853.428359:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851853.428360:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597749481792, found 0 last_xid 1859597749481791
00000020:00000001:31.0:1773851853.428361:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851853.428361:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851853.428362:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851853.428362:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.428363:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851853.428363:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851853.428365:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851853.428366:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000adf8f91b.
02000000:00000001:31.0:1773851853.428367:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.428368:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.428368:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851853.428369:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689997, transno 0, xid 1859597749481792
00010000:00000001:31.0:1773851853.428370:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851853.428370:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000182ebf41 x1859597749481792/t0(0) o400->898c8171-d161-4e53-b143-d9fcdd253bcf@15075@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1419-0'
00010000:00000001:31.0:1773851853.428373:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851853.428373:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851853.428374:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=86 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851853.428375:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851853.428376:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002b5a77c4 refcount 3 to 15075@kfi7
00000100:00000001:31.0:1773851853.428377:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932480 : -107137839619136 : ffff9e8f0720a3c0)
02000000:00000001:31.0:1773851853.428377:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851853.428378:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.428379:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851853.428379:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15075@kfi7
00000400:00000010:31.0:1773851853.428380:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000761d5a45.
00000100:00000200:31.0:1773851853.428381:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597749481792, offset 224
00000400:00000200:31.0:1773851853.428382:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15075@kfi7
00000400:00000200:31.0:1773851853.428383:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.428383:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 1
00000400:00000200:31.0:1773851853.428384:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000400:00000200:31.0:1773851853.428385:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 3
00000400:00000200:31.0:1773851853.428386:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15075@kfi7 local destination
00000400:00000200:31.0:1773851853.428387:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768561:8768561:1024:4294967295] 15075@kfi7 LPNI seq info [217611:217611:16:4294967295]
00000400:00000200:31.0:1773851853.428389:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000400:00000200:31.0:1773851853.428389:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.428391:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15075@kfi7(15075@kfi7:15075@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851853.428392:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 3
00000800:00000200:31.0:1773851853.428394:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851853.428395:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851853.428397:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851853.428400:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8cb Using peer 15075@kfi7(0x8cb)
00000800:00000200:31.0:1773851853.428403:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x8cb: rc=0
00000800:00000200:31.0:1773851853.428405:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851853.428407:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.428408:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002b5a77c4 refcount 2 to 15075@kfi7
00010000:00000001:31.0:1773851853.428409:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851853.428410:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.428410:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851853.428411:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000182ebf41 x1859597749481792/t0(0) o400->898c8171-d161-4e53-b143-d9fcdd253bcf@15075@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1419-0'
00000100:00100000:31.0:1773851853.428415:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000182ebf41 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:898c8171-d161-4e53-b143-d9fcdd253bcf+5:39760:x1859597749481792:12345-15075@kfi7:400:default-tuolumne1419-0 Request processed in 61us (98us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851853.428418:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15075@kfi7, seq: 2055452
00000100:00000040:31.0:1773851853.428418:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000962fe2ad : new rpc_count 0
00000100:00000001:31.0:1773851853.428419:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851853.428419:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8cb TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851853.428420:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851853.428421:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.428421:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851853.428422:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000238b2613.
00000020:00000040:31.0:1773851853.428423:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000962fe2ad : new refcount 4
00000400:00000200:29.0:1773851853.428423:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851853.428424:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851853.428424:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15075@kfi7: PUT: OK
00000400:00000200:29.0:1773851853.428426:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000761d5a45
00000400:00000010:29.0:1773851853.428427:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000761d5a45.
00000100:00000001:29.0:1773851853.428428:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851853.428429:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851853.428431:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000800:00000200:29.0:1773851853.428433:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15075@kfi7(0000000065bf81e7):0x0 lsk 2252 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8cb Transaction freed
00000800:00000200:25.0:1773851853.495775:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851853.495776:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851853.495778:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851853.495780:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851853.495782:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.495784:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22675@kfi7 : PUT - for me
00000400:00000200:25.0:1773851853.495785:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.495786:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 1
00000400:00000200:25.0:1773851853.495787:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.495788:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000400:00000200:25.0:1773851853.495789:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 3
00000400:00000200:25.0:1773851853.495790:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.495791:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22675@kfi7 of length 224 into portal 12 MB=0x699e18d2cd9c0
00000400:00000200:25.0:1773851853.495793:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22675@kfi7 of length 224/224 into md 0x16159c6179 [64] + 178784
00000800:00000200:25.0:1773851853.495795:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851853.495797:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851853.495798:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22675@kfi7: PUT: OK
00000100:00000001:25.0:1773851853.495799:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851853.495800:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851853.495800:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000183c91d2.
00000100:00000040:25.0:1773851853.495801:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000183c91d2 x1858043875482048 msgsize 224
00000100:00100000:25.0:1773851853.495803:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22675@kfi7 (source: 12345-22675@kfi7)
00000100:00000001:25.0:1773851853.495804:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851853.495805:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000100:00000001:26.0:1773851853.495807:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851853.495807:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851853.495808:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851853.495809:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851853.495810:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851853.495811:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851853.495812:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043875482048
00000020:00000001:26.0:1773851853.495813:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851853.495814:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9271b
00000020:00000001:26.0:1773851853.495815:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851853.495817:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000096f2e818 refcount=3490
00000020:00000001:26.0:1773851853.495818:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631267328 : -107123078284288 : ffff9e9276f8bc00)
00000020:00000001:26.0:1773851853.495819:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631267328 : -107123078284288 : ffff9e9276f8bc00)
00000100:00000001:26.0:1773851853.495821:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851853.495822:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851853.495823:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851853.495825:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851853.495826:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851853.495827:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851853.495828:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851853.495829:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.495830:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851853.495831:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851853.495831:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.495833:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.495835:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851853.495835:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851853.495836:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851853.495836:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851853.495837:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22675@kfi7, seq: 2025041
00000100:00000040:26.0:1773851853.495839:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000096f2e818 : new rpc_count 56
00000100:00000001:24.0:1773851853.495839:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.495840:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150701056 : -106980558850560 : ffff9eb3a5cab600)
00000100:00000001:24.0:1773851853.495840:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.495842:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000183c91d2 x1858043875482048/t0(0) o400->634ede5b-68a2-450e-aa69-6e0526153b59@22675@kfi7:70/0 lens 224/0 e 0 to 0 dl 1773852185 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1910-0'
00000100:00000001:26.0:1773851853.495846:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851853.495847:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851853.495849:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000183c91d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:634ede5b-68a2-450e-aa69-6e0526153b59+3490:39672:x1858043875482048:12345-22675@kfi7:400:default-tuolumne1910-0
00000100:00000200:26.0:1773851853.495855:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043875482048
00000020:00000001:26.0:1773851853.495856:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851853.495857:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851853.495858:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.495859:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851853.495860:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851853.495861:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851853.495862:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043875482048, found 0 last_xid 1858043874695167
00000020:00000001:26.0:1773851853.495864:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851853.495865:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851853.495865:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851853.495866:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.495867:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851853.495868:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851853.495869:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851853.495870:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab401516.
02000000:00000001:26.0:1773851853.495871:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.495872:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.495873:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851853.495874:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593323, transno 0, xid 1858043875482048
00010000:00000001:26.0:1773851853.495875:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851853.495877:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000183c91d2 x1858043875482048/t0(0) o400->634ede5b-68a2-450e-aa69-6e0526153b59@22675@kfi7:70/0 lens 224/224 e 0 to 0 dl 1773852185 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1910-0'
00010000:00000001:26.0:1773851853.495881:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851853.495882:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851853.495883:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=86 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851853.495885:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851853.495886:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bfc8a764 refcount 3 to 22675@kfi7
00000100:00000001:26.0:1773851853.495887:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092334720 : -107152617216896 : ffff9e8b96506480)
02000000:00000001:26.0:1773851853.495889:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851853.495889:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.495891:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851853.495892:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22675@kfi7
00000400:00000010:26.0:1773851853.495893:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079b55fe1.
00000100:00000200:26.0:1773851853.495895:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043875482048, offset 224
00000400:00000200:26.0:1773851853.495897:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22675@kfi7
00000400:00000200:26.0:1773851853.495898:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:26.0:1773851853.495900:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 1
00000400:00000200:26.0:1773851853.495901:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000400:00000200:26.0:1773851853.495903:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 3
00000400:00000200:26.0:1773851853.495905:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22675@kfi7 local destination
00000400:00000200:26.0:1773851853.495907:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768562:8768562:1024:4294967295] 22675@kfi7 LPNI seq info [23384541:23384541:16:4294967295]
00000400:00000200:26.0:1773851853.495910:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000400:00000200:26.0:1773851853.495911:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:26.0:1773851853.495914:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22675@kfi7(22675@kfi7:22675@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851853.495917:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 3
00000800:00000200:26.0:1773851853.495919:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851853.495921:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851853.495924:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851853.495928:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x934 Using peer 22675@kfi7(0x934)
00000800:00000200:26.0:1773851853.495933:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x934: rc=0
00000800:00000200:26.0:1773851853.495935:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x934 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851853.495938:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851853.495940:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bfc8a764 refcount 2 to 22675@kfi7
00010000:00000001:26.0:1773851853.495941:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851853.495942:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851853.495943:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851853.495944:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000183c91d2 x1858043875482048/t0(0) o400->634ede5b-68a2-450e-aa69-6e0526153b59@22675@kfi7:70/0 lens 224/224 e 0 to 0 dl 1773852185 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1910-0'
00000800:00000200:25.0:1773851853.495948:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x934 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851853.495949:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000183c91d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:634ede5b-68a2-450e-aa69-6e0526153b59+3490:39672:x1858043875482048:12345-22675@kfi7:400:default-tuolumne1910-0 Request processed in 102us (147us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851853.495949:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851853.495950:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22675@kfi7: PUT: OK
00000400:00000200:25.0:1773851853.495951:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079b55fe1
00000400:00000010:25.0:1773851853.495952:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079b55fe1.
00000100:00000001:25.0:1773851853.495953:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851853.495953:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:26.0:1773851853.495954:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22675@kfi7, seq: 2025041
00000400:00000200:25.0:1773851853.495954:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000100:00000040:26.0:1773851853.495955:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000096f2e818 : new rpc_count 55
00000800:00000200:25.0:1773851853.495955:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 22675@kfi7(00000000255db2f8):0x0 lsk 2357 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x934 Transaction freed
00000100:00000001:26.0:1773851853.495956:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851853.495957:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851853.495958:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851853.495959:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:26.0:1773851853.495960:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000020:00000040:26.0:1773851853.495961:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000096f2e818 : new refcount 3489
00000100:00000001:26.0:1773851853.495963:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851853.558287:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851853.558288:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851853.558289:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851853.558291:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851853.558293:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13890@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.558295:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13890@kfi7 : PUT - for me
00000400:00000200:9.0:1773851853.558295:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13890@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.558296:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001154d5c4 nid 13890@kfi7 refs 1
00000400:00000200:9.0:1773851853.558298:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13890@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.558298:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001154d5c4 nid 13890@kfi7 refs 2
00000400:00000200:9.0:1773851853.558299:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001154d5c4 nid 13890@kfi7 refs 3
00000400:00000200:9.0:1773851853.558300:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13891@kfi7 to cpt 5
00000400:00000200:9.0:1773851853.558301:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13891@kfi7 of length 224 into portal 12 MB=0x699e0c69e0200
00000400:00000200:9.0:1773851853.558302:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13891@kfi7 of length 224/224 into md 0x78146ce49 [64] + 117432
00000800:00000200:9.0:1773851853.558304:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851853.558305:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.558306:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13890@kfi7: PUT: OK
00000100:00000001:9.0:1773851853.558308:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851853.558308:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851853.558309:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d18c5a37.
00000100:00000040:9.0:1773851853.558310:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d18c5a37 x1858040544231936 msgsize 224
00000100:00100000:9.0:1773851853.558311:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13891@kfi7 (source: 12345-13890@kfi7)
00000100:00000001:9.0:1773851853.558312:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851853.558313:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001154d5c4 nid 13890@kfi7 refs 2
00000100:00000001:8.0:1773851853.558313:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851853.558314:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851853.558314:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851853.558315:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851853.558315:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.558316:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851853.558317:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040544231936
00000020:00000001:8.0:1773851853.558317:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851853.558318:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f2d
00000020:00000001:8.0:1773851853.558318:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851853.558321:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000084890e37 refcount=6
00000020:00000001:8.0:1773851853.558322:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629000192 : -107123080551424 : ffff9e9276d62400)
00000020:00000001:8.0:1773851853.558322:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629000192 : -107123080551424 : ffff9e9276d62400)
00000100:00000001:8.0:1773851853.558324:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.558324:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851853.558325:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025ad5da9.
00000020:00000010:8.0:1773851853.558326:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.558327:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851853.558328:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851853.558328:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851853.558329:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851853.558329:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851853.558330:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851853.558330:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.558331:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851853.558332:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851853.558332:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851853.558333:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851853.558333:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851853.558334:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851853.558334:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13891@kfi7, seq: 2130717
00000100:00000040:8.0:1773851853.558334:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000084890e37 : new rpc_count 1
00000100:00000001:11.0:1773851853.558335:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.558335:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792137472 : -106938917414144 : ffff9ebd57d09b00)
00000100:00000040:8.0:1773851853.558336:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d18c5a37 x1858040544231936/t0(0) o400->e0931aa2-9dea-49de-b149-33ebde4e47fa@13891@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1368-0'
00000100:00000001:8.0:1773851853.558339:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.558339:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851853.558340:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d18c5a37 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:e0931aa2-9dea-49de-b149-33ebde4e47fa+6:39558:x1858040544231936:12345-13891@kfi7:400:default-tuolumne1368-0
00000100:00000200:8.0:1773851853.558342:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040544231936
00000020:00000001:8.0:1773851853.558342:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851853.558343:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851853.558343:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.558344:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851853.558345:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851853.558345:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851853.558346:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040544231936, found 0 last_xid 1858040544231935
00000020:00000001:8.0:1773851853.558348:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851853.558349:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851853.558349:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851853.558350:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.558350:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851853.558351:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851853.558351:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851853.558352:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000146785dc.
02000000:00000001:8.0:1773851853.558353:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.558353:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.558354:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851853.558355:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096699747, transno 0, xid 1858040544231936
00010000:00000001:8.0:1773851853.558355:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851853.558356:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d18c5a37 x1858040544231936/t0(0) o400->e0931aa2-9dea-49de-b149-33ebde4e47fa@13891@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1368-0'
00010000:00000001:8.0:1773851853.558358:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851853.558359:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851853.558359:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=86 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851853.558361:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851853.558361:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b0415e63 refcount 3 to 13891@kfi7
00000100:00000001:8.0:1773851853.558362:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024512 : -107156745527104 : ffff9e8aa03f60c0)
02000000:00000001:8.0:1773851853.558362:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851853.558363:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.558364:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851853.558364:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13890@kfi7
00000400:00000010:8.0:1773851853.558365:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000516de938.
00000100:00000200:8.0:1773851853.558366:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040544231936, offset 224
00000400:00000200:8.0:1773851853.558367:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13890@kfi7
00000400:00000200:8.0:1773851853.558368:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13890@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.558368:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001154d5c4 nid 13890@kfi7 refs 1
00000400:00000200:8.0:1773851853.558369:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001154d5c4 nid 13890@kfi7 refs 2
00000400:00000200:8.0:1773851853.558371:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001154d5c4 nid 13890@kfi7 refs 3
00000400:00000200:8.0:1773851853.558372:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13890@kfi7 local destination
00000400:00000200:8.0:1773851853.558373:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768563:8768563:1024:4294967295] 13890@kfi7 LPNI seq info [6990484:6990484:16:4294967295]
00000400:00000200:8.0:1773851853.558375:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001154d5c4 nid 13890@kfi7 refs 2
00000400:00000200:8.0:1773851853.558375:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13890@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.558377:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13890@kfi7(13890@kfi7:13890@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851853.558378:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001154d5c4 nid 13890@kfi7 refs 3
00000800:00000200:8.0:1773851853.558379:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851853.558380:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851853.558382:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851853.558385:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x420 Using peer 13890@kfi7(0x420)
00000800:00000200:8.0:1773851853.558387:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x420: rc=0
00000800:00000200:8.0:1773851853.558389:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x420 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851853.558391:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.558392:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b0415e63 refcount 2 to 13891@kfi7
00010000:00000001:8.0:1773851853.558392:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851853.558393:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.558393:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851853.558394:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d18c5a37 x1858040544231936/t0(0) o400->e0931aa2-9dea-49de-b149-33ebde4e47fa@13891@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1368-0'
00000100:00100000:8.0:1773851853.558398:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d18c5a37 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:e0931aa2-9dea-49de-b149-33ebde4e47fa+6:39558:x1858040544231936:12345-13891@kfi7:400:default-tuolumne1368-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851853.558400:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13891@kfi7, seq: 2130717
00000100:00000040:8.0:1773851853.558401:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000084890e37 : new rpc_count 0
00000100:00000001:8.0:1773851853.558402:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851853.558402:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851853.558403:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.558403:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851853.558404:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025ad5da9.
00000020:00000040:8.0:1773851853.558405:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000084890e37 : new refcount 5
00000100:00000001:8.0:1773851853.558406:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851853.558410:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x420 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851853.558411:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.558413:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13890@kfi7: PUT: OK
00000400:00000200:9.0:1773851853.558414:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000516de938
00000400:00000010:9.0:1773851853.558414:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000516de938.
00000100:00000001:9.0:1773851853.558415:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851853.558415:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851853.558416:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001154d5c4 nid 13890@kfi7 refs 2
00000800:00000200:9.0:1773851853.558417:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 13890@kfi7(00000000a2156686):0x0 lsk 1057 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x420 Transaction freed
00000800:00000200:29.0:1773851853.564701:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851853.564703:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851853.564705:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851853.564709:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851853.564713:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.564715:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21746@kfi7 : PUT - for me
00000400:00000200:29.0:1773851853.564717:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.564719:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:29.0:1773851853.564720:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.564722:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:29.0:1773851853.564724:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:29.0:1773851853.564732:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21747@kfi7 to cpt 3
00000400:00000200:29.0:1773851853.564734:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21747@kfi7 of length 224 into portal 12 MB=0x69b0a32ab2f00
00000400:00000200:29.0:1773851853.564736:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21747@kfi7 of length 224/224 into md 0x77fe139dd [64] + 159784
00000800:00000200:29.0:1773851853.564740:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851853.564743:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851853.564745:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21746@kfi7: PUT: OK
00000100:00000001:29.0:1773851853.564747:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851853.564748:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851853.564749:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1b17a23.
00000100:00000040:29.0:1773851853.564751:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f1b17a23 x1859317962321664 msgsize 224
00000100:00100000:29.0:1773851853.564754:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21747@kfi7 (source: 12345-21746@kfi7)
00000100:00000001:29.0:1773851853.564756:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851853.564757:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000100:00000001:31.0:1773851853.564759:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851853.564760:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851853.564760:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851853.564761:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851853.564762:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851853.564763:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851853.564765:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317962321664
00000020:00000001:31.0:1773851853.564766:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851853.564767:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92673
00000020:00000001:31.0:1773851853.564768:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851853.564771:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000060c5b0bb refcount=3988
00000020:00000001:31.0:1773851853.564772:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631019520 : -107123078532096 : ffff9e9276f4f400)
00000020:00000001:31.0:1773851853.564774:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631019520 : -107123078532096 : ffff9e9276f4f400)
00000100:00000001:31.0:1773851853.564775:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.564776:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851853.564778:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c0d1fe47.
00000020:00000010:31.0:1773851853.564780:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.564781:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851853.564783:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851853.564784:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851853.564784:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.564786:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851853.564787:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851853.564788:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.564790:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.564792:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.564793:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851853.564793:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851853.564793:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851853.564794:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21747@kfi7, seq: 2055453
00000100:00000040:31.0:1773851853.564796:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000060c5b0bb : new rpc_count 15
00000100:00000001:29.0:1773851853.564796:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.564797:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224844032 : -106962484707584 : ffff9eb7db183f00)
00000100:00000001:29.0:1773851853.564797:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.564799:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f1b17a23 x1859317962321664/t0(0) o400->95e70f61-2824-45d5-9988-29f0ada81397@21747@kfi7:641/0 lens 224/0 e 0 to 0 dl 1773852001 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1833-0'
00000100:00000001:31.0:1773851853.564804:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.564805:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851853.564807:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1b17a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:95e70f61-2824-45d5-9988-29f0ada81397+3988:39898:x1859317962321664:12345-21747@kfi7:400:default-tuolumne1833-0
00000100:00000200:31.0:1773851853.564809:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317962321664
00000020:00000001:31.0:1773851853.564810:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851853.564812:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851853.564813:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.564814:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851853.564815:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851853.564816:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851853.564817:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317962321664, found 0 last_xid 1859317960987775
00000020:00000001:31.0:1773851853.564819:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851853.564820:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851853.564821:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851853.564822:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.564823:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851853.564824:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851853.564825:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851853.564826:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000238b2613.
02000000:00000001:31.0:1773851853.564827:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.564828:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.564830:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851853.564831:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593573, transno 0, xid 1859317962321664
00010000:00000001:31.0:1773851853.564832:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851853.564834:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f1b17a23 x1859317962321664/t0(0) o400->95e70f61-2824-45d5-9988-29f0ada81397@21747@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1833-0'
00010000:00000001:31.0:1773851853.564838:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851853.564838:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851853.564840:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=86 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851853.564841:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851853.564842:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6c586e9 refcount 5 to 21747@kfi7
00000100:00000001:31.0:1773851853.564844:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154816 : -107139310396800 : ffff9e8eaf765a80)
02000000:00000001:31.0:1773851853.564845:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851853.564845:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.564846:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851853.564847:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21746@kfi7
00000400:00000010:31.0:1773851853.564848:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defe7a25.
00000100:00000200:31.0:1773851853.564849:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317962321664, offset 224
00000400:00000200:31.0:1773851853.564850:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21746@kfi7
00000400:00000200:31.0:1773851853.564852:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.564853:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:31.0:1773851853.564854:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:31.0:1773851853.564855:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:31.0:1773851853.564856:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21746@kfi7 local destination
00000400:00000200:31.0:1773851853.564858:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768564:8768564:1024:4294967295] 21746@kfi7 LPNI seq info [5226827:5226827:16:4294967295]
00000400:00000200:31.0:1773851853.564859:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:31.0:1773851853.564860:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.564862:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21746@kfi7(21746@kfi7:21746@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851853.564864:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000800:00000200:31.0:1773851853.564865:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851853.564867:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851853.564869:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851853.564871:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Using peer 21746@kfi7(0x0)
00000800:00000200:31.0:1773851853.564875:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x0: rc=0
00000800:00000200:31.0:1773851853.564876:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851853.564879:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.564879:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6c586e9 refcount 4 to 21747@kfi7
00010000:00000001:31.0:1773851853.564880:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851853.564881:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.564882:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851853.564882:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1b17a23 x1859317962321664/t0(0) o400->95e70f61-2824-45d5-9988-29f0ada81397@21747@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1833-0'
00000100:00100000:31.0:1773851853.564886:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1b17a23 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:95e70f61-2824-45d5-9988-29f0ada81397+3988:39898:x1859317962321664:12345-21747@kfi7:400:default-tuolumne1833-0 Request processed in 81us (134us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851853.564889:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21747@kfi7, seq: 2055453
00000800:00000200:29.0:1773851853.564889:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851853.564890:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000060c5b0bb : new rpc_count 14
00000100:00000001:31.0:1773851853.564891:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851853.564891:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851853.564891:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851853.564892:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.564892:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851853.564892:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21746@kfi7: PUT: OK
00000020:00000010:31.0:1773851853.564893:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c0d1fe47.
00000400:00000200:29.0:1773851853.564893:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defe7a25
00000400:00000010:29.0:1773851853.564893:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defe7a25.
00000020:00000040:31.0:1773851853.564894:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000060c5b0bb : new refcount 3987
00000100:00000001:29.0:1773851853.564894:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851853.564894:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851853.564895:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851853.564895:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000800:00000200:29.0:1773851853.564896:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:25.0:1773851853.575473:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851853.575474:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851853.575475:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851853.575478:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851853.575479:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14449@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.575481:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14449@kfi7 : PUT - for me
00000400:00000200:25.0:1773851853.575482:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14449@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.575483:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000092990513 nid 14449@kfi7 refs 1
00000400:00000200:25.0:1773851853.575484:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14449@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.575485:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000092990513 nid 14449@kfi7 refs 2
00000400:00000200:25.0:1773851853.575485:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000092990513 nid 14449@kfi7 refs 3
00000400:00000200:25.0:1773851853.575486:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14512@kfi7 to cpt 6
00000400:00000200:25.0:1773851853.575487:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14512@kfi7 of length 224 into portal 12 MB=0x69b4b564bde80
00000400:00000200:25.0:1773851853.575488:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14512@kfi7 of length 224/224 into md 0x16159c6179 [64] + 179008
00000800:00000200:25.0:1773851853.575490:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851853.575491:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851853.575493:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14449@kfi7: PUT: OK
00000100:00000001:25.0:1773851853.575494:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851853.575494:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851853.575495:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059547c5c.
00000100:00000040:25.0:1773851853.575495:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000059547c5c x1859597732929152 msgsize 224
00000100:00100000:25.0:1773851853.575497:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-14512@kfi7 (source: 12345-14449@kfi7)
00000100:00000001:25.0:1773851853.575498:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851853.575499:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851853.575499:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000092990513 nid 14449@kfi7 refs 2
02000000:00000001:26.0:1773851853.575500:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851853.575500:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851853.575500:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851853.575501:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851853.575502:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851853.575502:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597732929152
00000020:00000001:26.0:1773851853.575503:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851853.575503:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f1f4
00000020:00000001:26.0:1773851853.575504:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851853.575505:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c7655b12 refcount=5
00000020:00000001:26.0:1773851853.575506:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161058318336 : -106912651233280 : ffff9ec37566b800)
00000020:00000001:26.0:1773851853.575507:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161058318336 : -106912651233280 : ffff9ec37566b800)
00000100:00000001:26.0:1773851853.575508:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851853.575509:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851853.575510:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f28122c3.
00000020:00000010:26.0:1773851853.575511:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851853.575512:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000423b288d.
00000100:00000001:26.0:1773851853.575513:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851853.575513:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851853.575514:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.575514:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851853.575515:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851853.575515:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851853.575516:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851853.575518:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851853.575518:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851853.575518:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851853.575518:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851853.575519:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14512@kfi7, seq: 2025042
00000100:00000001:26.0:1773851853.575520:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851853.575520:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c7655b12 : new rpc_count 1
00000100:00000001:26.0:1773851853.575521:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851853.575521:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150705664 : -106980558845952 : ffff9eb3a5cac800)
00000100:00000040:24.0:1773851853.575522:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000059547c5c x1859597732929152/t0(0) o400->f1ced77b-da76-4d22-ae9d-27aca9742376@14512@kfi7:39/0 lens 224/0 e 0 to 0 dl 1773852154 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1390-0'
00000100:00000001:24.0:1773851853.575525:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851853.575526:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851853.575527:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059547c5c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:f1ced77b-da76-4d22-ae9d-27aca9742376+5:39607:x1859597732929152:12345-14512@kfi7:400:default-tuolumne1390-0
00000100:00000200:24.0:1773851853.575528:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597732929152
00000020:00000001:24.0:1773851853.575530:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851853.575530:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851853.575531:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851853.575532:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851853.575533:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851853.575533:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851853.575534:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597732929152, found 0 last_xid 1859597732929151
00000020:00000001:24.0:1773851853.575535:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851853.575535:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851853.575536:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851853.575536:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851853.575537:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851853.575538:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851853.575538:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851853.575539:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000098c1846a.
02000000:00000001:24.0:1773851853.575539:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851853.575540:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851853.575541:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851853.575541:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181457954436, transno 0, xid 1859597732929152
00010000:00000001:24.0:1773851853.575542:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851853.575543:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000059547c5c x1859597732929152/t0(0) o400->f1ced77b-da76-4d22-ae9d-27aca9742376@14512@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1390-0'
00010000:00000001:24.0:1773851853.575545:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851853.575546:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851853.575547:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=86 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851853.575548:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851853.575549:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e9617cf4 refcount 3 to 14512@kfi7
00000100:00000001:24.0:1773851853.575550:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335584 : -107152617216032 : ffff9e8b965067e0)
02000000:00000001:24.0:1773851853.575551:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851853.575551:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851853.575552:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851853.575553:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14449@kfi7
00000400:00000010:24.0:1773851853.575553:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002fb795f8.
00000100:00000200:24.0:1773851853.575554:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597732929152, offset 224
00000400:00000200:24.0:1773851853.575556:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14449@kfi7
00000400:00000200:24.0:1773851853.575558:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14449@kfi7 to cpt 6
00000400:00000200:24.0:1773851853.575558:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000092990513 nid 14449@kfi7 refs 1
00000400:00000200:24.0:1773851853.575560:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000092990513 nid 14449@kfi7 refs 2
00000400:00000200:24.0:1773851853.575561:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000092990513 nid 14449@kfi7 refs 3
00000400:00000200:24.0:1773851853.575562:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14449@kfi7 local destination
00000400:00000200:24.0:1773851853.575563:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768565:8768565:1024:4294967295] 14449@kfi7 LPNI seq info [152665:152665:16:4294967295]
00000400:00000200:24.0:1773851853.575565:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000092990513 nid 14449@kfi7 refs 2
00000400:00000200:24.0:1773851853.575566:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14449@kfi7 to cpt 6
00000400:00000200:24.0:1773851853.575568:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14449@kfi7(14449@kfi7:14449@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851853.575569:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000092990513 nid 14449@kfi7 refs 3
00000800:00000200:24.0:1773851853.575570:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851853.575572:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851853.575574:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851853.575577:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdb2 Using peer 14449@kfi7(0xdb2)
00000800:00000200:24.0:1773851853.575579:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0xdb2: rc=0
00000800:00000200:24.0:1773851853.575581:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdb2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851853.575583:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851853.575584:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e9617cf4 refcount 2 to 14512@kfi7
00010000:00000001:24.0:1773851853.575584:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851853.575585:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851853.575585:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851853.575586:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059547c5c x1859597732929152/t0(0) o400->f1ced77b-da76-4d22-ae9d-27aca9742376@14512@kfi7:39/0 lens 224/224 e 0 to 0 dl 1773852154 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1390-0'
00000100:00100000:24.0:1773851853.575590:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059547c5c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:f1ced77b-da76-4d22-ae9d-27aca9742376+5:39607:x1859597732929152:12345-14512@kfi7:400:default-tuolumne1390-0 Request processed in 64us (94us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851853.575593:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14512@kfi7, seq: 2025042
00000100:00000040:24.0:1773851853.575594:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c7655b12 : new rpc_count 0
00000100:00000001:24.0:1773851853.575595:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851853.575595:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851853.575596:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:24.0:1773851853.575597:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000423b288d.
00000020:00000010:24.0:1773851853.575598:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f28122c3.
00000020:00000040:24.0:1773851853.575598:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000c7655b12 : new refcount 4
00000100:00000001:24.0:1773851853.575599:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851853.575604:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdb2 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851853.575605:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851853.575606:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14449@kfi7: PUT: OK
00000400:00000200:25.0:1773851853.575607:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002fb795f8
00000400:00000010:25.0:1773851853.575608:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002fb795f8.
00000100:00000001:25.0:1773851853.575608:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851853.575609:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851853.575609:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000092990513 nid 14449@kfi7 refs 2
00000800:00000200:25.0:1773851853.575611:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 14449@kfi7(000000001167dfff):0x0 lsk 3507 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdb2 Transaction freed
00000800:00000200:5.0:1773851853.591047:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851853.591048:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851853.591049:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851853.591051:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851853.591053:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15568@kfi7 to cpt 1
00000400:00000200:5.0:1773851853.591055:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15568@kfi7 : PUT - for me
00000400:00000200:5.0:1773851853.591056:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15568@kfi7 to cpt 1
00000400:00000200:5.0:1773851853.591057:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e77f3c7 nid 15568@kfi7 refs 1
00000400:00000200:5.0:1773851853.591057:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15568@kfi7 to cpt 1
00000400:00000200:5.0:1773851853.591058:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e77f3c7 nid 15568@kfi7 refs 2
00000400:00000200:5.0:1773851853.591059:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000e77f3c7 nid 15568@kfi7 refs 3
00000400:00000200:5.0:1773851853.591060:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15568@kfi7 to cpt 1
00000400:00000200:5.0:1773851853.591061:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15568@kfi7 of length 224 into portal 12 MB=0x69b4b69d4c680
00000400:00000200:5.0:1773851853.591062:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15568@kfi7 of length 224/224 into md 0x793926dc5 [64] + 117360
00000800:00000200:5.0:1773851853.591064:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851853.591065:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851853.591066:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15568@kfi7: PUT: OK
00000100:00000001:5.0:1773851853.591067:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851853.591068:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851853.591069:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073f82553.
00000100:00000040:5.0:1773851853.591069:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000073f82553 x1859598060668544 msgsize 224
00000100:00100000:5.0:1773851853.591071:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-15568@kfi7 (source: 12345-15568@kfi7)
00000100:00000001:5.0:1773851853.591072:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851853.591073:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000e77f3c7 nid 15568@kfi7 refs 2
00000800:00000200:5.0:1773851853.591074:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851853.591075:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851853.591076:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851853.591076:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851853.591077:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851853.591079:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851853.591080:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598060668544
00000020:00000001:7.0:1773851853.591081:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851853.591082:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79d53
00000020:00000001:7.0:1773851853.591083:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851853.591085:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007060177f refcount=5
00000020:00000001:7.0:1773851853.591086:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104478803968 : -106969230747648 : ffff9eb648ffd800)
00000020:00000001:7.0:1773851853.591088:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637104478803968 : -106969230747648 : ffff9eb648ffd800)
00000100:00000001:7.0:1773851853.591089:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851853.591090:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851853.591091:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ac9a4ff4.
00000020:00000010:7.0:1773851853.591093:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851853.591094:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ee82f04.
00000100:00000001:7.0:1773851853.591095:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851853.591096:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851853.591097:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851853.591099:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851853.591099:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851853.591100:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851853.591102:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851853.591103:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851853.591104:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851853.591104:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851853.591104:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851853.591105:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15568@kfi7, seq: 2001849
00000100:00000001:7.0:1773851853.591106:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851853.591106:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007060177f : new rpc_count 1
00000100:00000001:5.0:1773851853.591106:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046218752 : -106940663332864 : ffff9ebcefc00000)
00000100:00000001:7.0:1773851853.591107:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851853.591108:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000073f82553 x1859598060668544/t0(0) o400->dc01034b-4b3c-46e9-b4b7-5094f3d1a849@15568@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1457-0'
00000100:00000001:5.0:1773851853.591110:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851853.591111:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851853.591113:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073f82553 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:dc01034b-4b3c-46e9-b4b7-5094f3d1a849+5:39489:x1859598060668544:12345-15568@kfi7:400:default-tuolumne1457-0
00000100:00000200:5.0:1773851853.591114:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598060668544
00000020:00000001:5.0:1773851853.591115:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851853.591116:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851853.591116:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851853.591117:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851853.591118:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851853.591119:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851853.591119:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598060668544, found 0 last_xid 1859598060668543
00000020:00000001:5.0:1773851853.591120:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851853.591121:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851853.591121:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851853.591122:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851853.591123:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851853.591123:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851853.591124:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851853.591125:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002abb348c.
02000000:00000001:5.0:1773851853.591125:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851853.591126:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851853.591127:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851853.591127:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597124, transno 0, xid 1859598060668544
00010000:00000001:5.0:1773851853.591128:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851853.591129:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000073f82553 x1859598060668544/t0(0) o400->dc01034b-4b3c-46e9-b4b7-5094f3d1a849@15568@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1457-0'
00010000:00000001:5.0:1773851853.591132:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851853.591132:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851853.591133:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=85 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851853.591134:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851853.591135:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c83f61b9 refcount 3 to 15568@kfi7
00000100:00000001:5.0:1773851853.591135:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232982304 : -107130476569312 : ffff9e90bdffdd20)
02000000:00000001:5.0:1773851853.591136:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851853.591137:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851853.591138:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851853.591139:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15568@kfi7
00000400:00000010:5.0:1773851853.591140:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000011aff20.
00000100:00000200:5.0:1773851853.591141:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598060668544, offset 224
00000400:00000200:5.0:1773851853.591142:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15568@kfi7
00000400:00000200:5.0:1773851853.591143:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15568@kfi7 to cpt 1
00000400:00000200:5.0:1773851853.591143:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e77f3c7 nid 15568@kfi7 refs 1
00000400:00000200:5.0:1773851853.591144:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000e77f3c7 nid 15568@kfi7 refs 2
00000400:00000200:5.0:1773851853.591145:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000e77f3c7 nid 15568@kfi7 refs 3
00000400:00000200:5.0:1773851853.591147:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15568@kfi7 local destination
00000400:00000200:5.0:1773851853.591148:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768566:8768566:1024:4294967295] 15568@kfi7 LPNI seq info [3860970:3860970:16:4294967295]
00000400:00000200:5.0:1773851853.591149:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000e77f3c7 nid 15568@kfi7 refs 2
00000400:00000200:5.0:1773851853.591150:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15568@kfi7 to cpt 1
00000400:00000200:5.0:1773851853.591152:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15568@kfi7(15568@kfi7:15568@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851853.591153:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000e77f3c7 nid 15568@kfi7 refs 3
00000800:00000200:5.0:1773851853.591154:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851853.591155:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851853.591157:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851853.591159:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d3 Using peer 15568@kfi7(0x7d3)
00000800:00000200:5.0:1773851853.591162:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 324 bytes to peer 0x7d3: rc=0
00000800:00000200:5.0:1773851853.591164:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851853.591166:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851853.591166:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c83f61b9 refcount 2 to 15568@kfi7
00010000:00000001:5.0:1773851853.591167:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851853.591168:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851853.591168:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851853.591169:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073f82553 x1859598060668544/t0(0) o400->dc01034b-4b3c-46e9-b4b7-5094f3d1a849@15568@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1457-0'
00000100:00100000:5.0:1773851853.591175:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073f82553 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:dc01034b-4b3c-46e9-b4b7-5094f3d1a849+5:39489:x1859598060668544:12345-15568@kfi7:400:default-tuolumne1457-0 Request processed in 64us (105us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851853.591178:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d3 TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851853.591178:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15568@kfi7, seq: 2001849
00000100:00000040:5.0:1773851853.591178:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007060177f : new rpc_count 0
00000100:00000001:5.0:1773851853.591179:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851853.591179:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851853.591180:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:6.0:1773851853.591181:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851853.591181:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ee82f04.
00000400:00000200:6.0:1773851853.591182:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15568@kfi7: PUT: OK
00000020:00000010:5.0:1773851853.591182:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ac9a4ff4.
00000020:00000040:5.0:1773851853.591183:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000007060177f : new refcount 4
00000100:00000001:5.0:1773851853.591183:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851853.591184:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000011aff20
00000400:00000010:6.0:1773851853.591185:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000011aff20.
00000100:00000001:6.0:1773851853.591186:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851853.591186:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851853.591188:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000e77f3c7 nid 15568@kfi7 refs 2
00000800:00000200:6.0:1773851853.591190:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 15568@kfi7(00000000ba35e8e0):0x0 lsk 2004 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d3 Transaction freed
00000800:00000200:29.0:1773851853.596852:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851853.596853:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851853.596855:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851853.596857:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851853.596859:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.596861:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16379@kfi7 : PUT - for me
00000400:00000200:29.0:1773851853.596862:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.596863:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 1
00000400:00000200:29.0:1773851853.596864:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.596865:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000400:00000200:29.0:1773851853.596866:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 3
00000400:00000200:29.0:1773851853.596867:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.596868:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16379@kfi7 of length 224 into portal 12 MB=0x699de8bdc0c40
00000400:00000200:29.0:1773851853.596869:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16379@kfi7 of length 224/224 into md 0x77fe139dd [64] + 160008
00000800:00000200:29.0:1773851853.596871:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851853.596873:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851853.596875:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16379@kfi7: PUT: OK
00000100:00000001:29.0:1773851853.596876:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851853.596877:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851853.596878:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1c723ea.
00000100:00000040:29.0:1773851853.596878:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000e1c723ea x1858030968507456 msgsize 224
00000100:00100000:29.0:1773851853.596880:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16379@kfi7 (source: 12345-16379@kfi7)
00000100:00000001:29.0:1773851853.596881:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851853.596883:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000100:00000001:31.0:1773851853.596884:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851853.596884:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851853.596885:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851853.596886:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851853.596887:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851853.596889:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851853.596890:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968507456
00000020:00000001:31.0:1773851853.596891:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851853.596892:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91069
00000020:00000001:31.0:1773851853.596893:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851853.596897:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000009c236c0 refcount=6
00000020:00000001:31.0:1773851853.596898:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240103936 : -107152469447680 : ffff9e8b9f1f2c00)
00000020:00000001:31.0:1773851853.596900:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240103936 : -107152469447680 : ffff9e8b9f1f2c00)
00000100:00000001:31.0:1773851853.596901:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.596903:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851853.596904:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c0d1fe47.
00000020:00000010:31.0:1773851853.596906:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.596908:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851853.596909:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851853.596910:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851853.596911:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.596913:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851853.596913:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851853.596914:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.596916:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.596918:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851853.596918:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.596919:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851853.596919:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851853.596921:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16379@kfi7, seq: 2055454
00000100:00000040:31.0:1773851853.596923:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000009c236c0 : new rpc_count 1
00000100:00000001:29.0:1773851853.596923:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.596924:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224853248 : -106962484698368 : ffff9eb7db186300)
00000100:00000001:29.0:1773851853.596924:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.596926:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e1c723ea x1858030968507456/t0(0) o400->62cca3f4-8fd1-4c26-a5b3-5e10ec9de534@16379@kfi7:641/0 lens 224/0 e 0 to 0 dl 1773852001 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne232-0'
00000100:00000001:31.0:1773851853.596931:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.596931:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851853.596933:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1c723ea pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:62cca3f4-8fd1-4c26-a5b3-5e10ec9de534+6:47883:x1858030968507456:12345-16379@kfi7:400:default-tuolumne232-0
00000100:00000200:31.0:1773851853.596935:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968507456
00000020:00000001:31.0:1773851853.596936:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851853.596937:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851853.596938:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.596939:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851853.596940:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851853.596941:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851853.596942:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968507456, found 0 last_xid 1858030968507455
00000020:00000001:31.0:1773851853.596943:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851853.596944:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851853.596945:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851853.596946:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.596947:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851853.596948:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851853.596948:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851853.596950:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fe19af99.
02000000:00000001:31.0:1773851853.596951:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.596952:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.596953:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851853.596954:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030968507456
00010000:00000001:31.0:1773851853.596956:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851853.596957:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e1c723ea x1858030968507456/t0(0) o400->62cca3f4-8fd1-4c26-a5b3-5e10ec9de534@16379@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00010000:00000001:31.0:1773851853.596961:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851853.596962:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851853.596964:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=86 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851853.596965:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851853.596966:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b253f1f refcount 5 to 16379@kfi7
00000100:00000001:31.0:1773851853.596968:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715062880 : -107155994488736 : ffff9e8acd035060)
02000000:00000001:31.0:1773851853.596969:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851853.596970:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.596971:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851853.596973:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16379@kfi7
00000400:00000010:31.0:1773851853.596974:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000030edd6e9.
00000100:00000200:31.0:1773851853.596975:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968507456, offset 224
00000400:00000200:31.0:1773851853.596977:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16379@kfi7
00000400:00000200:31.0:1773851853.596978:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.596980:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 1
00000400:00000200:31.0:1773851853.596981:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000400:00000200:31.0:1773851853.596983:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 3
00000400:00000200:31.0:1773851853.596985:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16379@kfi7 local destination
00000400:00000200:31.0:1773851853.596987:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768567:8768567:1024:4294967295] 16379@kfi7 LPNI seq info [24404:24404:16:4294967295]
00000400:00000200:31.0:1773851853.596989:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000400:00000200:31.0:1773851853.596991:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.596994:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16379@kfi7(16379@kfi7:16379@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851853.596996:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 3
00000800:00000200:31.0:1773851853.596998:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851853.597000:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851853.597004:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851853.597008:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x139 Using peer 16379@kfi7(0x139)
00000800:00000200:31.0:1773851853.597012:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x139: rc=0
00000800:00000200:31.0:1773851853.597015:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x139 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851853.597021:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.597022:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b253f1f refcount 4 to 16379@kfi7
00010000:00000001:31.0:1773851853.597024:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851853.597024:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.597025:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000800:00000200:29.0:1773851853.597026:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x139 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851853.597027:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1c723ea x1858030968507456/t0(0) o400->62cca3f4-8fd1-4c26-a5b3-5e10ec9de534@16379@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00000400:00000200:29.0:1773851853.597028:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851853.597029:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16379@kfi7: PUT: OK
00000400:00000200:29.0:1773851853.597030:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000030edd6e9
00000400:00000010:29.0:1773851853.597030:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000030edd6e9.
00000100:00000001:29.0:1773851853.597031:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:31.0:1773851853.597032:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1c723ea pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:62cca3f4-8fd1-4c26-a5b3-5e10ec9de534+6:47883:x1858030968507456:12345-16379@kfi7:400:default-tuolumne232-0 Request processed in 100us (153us total) trans 0 rc 0/0
00000100:00000001:29.0:1773851853.597032:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851853.597033:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000800:00000200:29.0:1773851853.597034:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 16379@kfi7(00000000bf660726):0x0 lsk 314 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x139 Transaction freed
00000100:00100000:31.0:1773851853.597037:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16379@kfi7, seq: 2055454
00000100:00000040:31.0:1773851853.597038:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000009c236c0 : new rpc_count 0
00000100:00000001:31.0:1773851853.597039:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851853.597040:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851853.597041:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.597042:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851853.597043:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c0d1fe47.
00000020:00000040:31.0:1773851853.597044:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000009c236c0 : new refcount 5
00000100:00000001:31.0:1773851853.597046:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851853.597384:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851853.597385:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851853.597386:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851853.597388:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851853.597390:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:17.0:1773851853.597391:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16378@kfi7 : PUT - for me
00000400:00000200:17.0:1773851853.597391:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:17.0:1773851853.597392:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 1
00000400:00000200:17.0:1773851853.597393:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:17.0:1773851853.597394:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000400:00000200:17.0:1773851853.597394:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 3
00000400:00000200:17.0:1773851853.597395:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:17.0:1773851853.597396:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16379@kfi7 of length 224 into portal 12 MB=0x699de8bdc1480
00000400:00000200:17.0:1773851853.597397:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16379@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 188512
00000800:00000200:17.0:1773851853.597399:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851853.597400:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851853.597401:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16378@kfi7: PUT: OK
00000100:00000001:17.0:1773851853.597402:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851853.597403:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851853.597405:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000060cdda82.
00000100:00000040:17.0:1773851853.597405:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000060cdda82 x1858030968509568 msgsize 224
00000100:00100000:17.0:1773851853.597406:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16379@kfi7 (source: 12345-16378@kfi7)
00000100:00000001:17.0:1773851853.597408:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851853.597409:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000100:00000001:18.0:1773851853.597410:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851853.597410:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851853.597411:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851853.597412:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851853.597413:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851853.597414:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851853.597415:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968509568
00000020:00000001:18.0:1773851853.597416:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851853.597417:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91261
00000020:00000001:18.0:1773851853.597417:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851853.597421:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef038100 refcount=6
00000020:00000001:18.0:1773851853.597422:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716198400 : -107155993353216 : ffff9e8acd14a400)
00000020:00000001:18.0:1773851853.597423:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716198400 : -107155993353216 : ffff9e8acd14a400)
00000100:00000001:18.0:1773851853.597425:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851853.597426:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851853.597427:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002a3a26dd.
00000020:00000010:18.0:1773851853.597429:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851853.597430:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004b65e428.
00000100:00000001:18.0:1773851853.597431:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851853.597432:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851853.597433:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851853.597434:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851853.597435:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851853.597436:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851853.597437:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851853.597438:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851853.597439:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851853.597439:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851853.597439:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851853.597440:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16379@kfi7, seq: 2156254
00000100:00000040:19.0:1773851853.597441:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef038100 : new rpc_count 1
00000100:00000001:19.0:1773851853.597441:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637145007334400 : -106928702217216 : ffff9ebfb8b02400)
00000100:00000001:18.0:1773851853.597441:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851853.597442:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851853.597443:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000060cdda82 x1858030968509568/t0(0) o400->7edca6f3-ed65-447f-a152-66b9ba44fa80@16379@kfi7:43/0 lens 224/0 e 0 to 0 dl 1773852158 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne232-0'
00000100:00000001:19.0:1773851853.597448:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851853.597449:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851853.597450:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060cdda82 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7edca6f3-ed65-447f-a152-66b9ba44fa80+6:47884:x1858030968509568:12345-16379@kfi7:400:default-tuolumne232-0
00000100:00000200:19.0:1773851853.597451:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968509568
00000020:00000001:19.0:1773851853.597452:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851853.597452:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851853.597453:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.597453:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851853.597454:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851853.597455:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851853.597455:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968509568, found 0 last_xid 1858030968509567
00000020:00000001:19.0:1773851853.597456:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851853.597457:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851853.597457:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851853.597458:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.597458:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851853.597459:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851853.597460:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851853.597460:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b5d5268b.
02000000:00000001:19.0:1773851853.597461:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851853.597462:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.597462:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851853.597463:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768283, transno 0, xid 1858030968509568
00010000:00000001:19.0:1773851853.597463:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851853.597464:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000060cdda82 x1858030968509568/t0(0) o400->7edca6f3-ed65-447f-a152-66b9ba44fa80@16379@kfi7:43/0 lens 224/224 e 0 to 0 dl 1773852158 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00010000:00000001:19.0:1773851853.597466:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851853.597467:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851853.597468:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=86 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851853.597469:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851853.597469:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b253f1f refcount 5 to 16379@kfi7
00000100:00000001:19.0:1773851853.597470:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715062880 : -107155994488736 : ffff9e8acd035060)
02000000:00000001:19.0:1773851853.597472:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851853.597472:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851853.597473:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851853.597474:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16378@kfi7
00000400:00000010:19.0:1773851853.597474:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073b38b00.
00000100:00000200:19.0:1773851853.597475:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968509568, offset 224
00000400:00000200:19.0:1773851853.597476:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16378@kfi7
00000400:00000200:19.0:1773851853.597477:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:19.0:1773851853.597478:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 1
00000400:00000200:19.0:1773851853.597479:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000400:00000200:19.0:1773851853.597480:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 3
00000400:00000200:19.0:1773851853.597481:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16378@kfi7 local destination
00000400:00000200:19.0:1773851853.597482:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768568:8768568:1024:4294967295] 16378@kfi7 LPNI seq info [24405:24405:16:4294967295]
00000400:00000200:19.0:1773851853.597484:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000400:00000200:19.0:1773851853.597484:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:19.0:1773851853.597487:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16378@kfi7(16378@kfi7:16378@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851853.597487:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 3
00000800:00000200:19.0:1773851853.597489:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851853.597490:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851853.597492:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851853.597494:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000764 Using peer 16378@kfi7(0x100000000000764)
00000800:00000200:19.0:1773851853.597497:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x100000000000764: rc=0
00000800:00000200:19.0:1773851853.597499:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000764 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851853.597501:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851853.597502:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b253f1f refcount 4 to 16379@kfi7
00010000:00000001:19.0:1773851853.597503:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851853.597504:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.597505:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851853.597505:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000060cdda82 x1858030968509568/t0(0) o400->7edca6f3-ed65-447f-a152-66b9ba44fa80@16379@kfi7:43/0 lens 224/224 e 0 to 0 dl 1773852158 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00000100:00100000:19.0:1773851853.597508:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060cdda82 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7edca6f3-ed65-447f-a152-66b9ba44fa80+6:47884:x1858030968509568:12345-16379@kfi7:400:default-tuolumne232-0 Request processed in 59us (102us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851853.597511:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16379@kfi7, seq: 2156254
00000100:00000040:19.0:1773851853.597511:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef038100 : new rpc_count 0
00000100:00000001:19.0:1773851853.597512:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851853.597512:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000764 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851853.597513:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851853.597513:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851853.597513:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851853.597514:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004b65e428.
00000400:00000200:17.0:1773851853.597514:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16378@kfi7: PUT: OK
00000020:00000010:19.0:1773851853.597515:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002a3a26dd.
00000400:00000200:17.0:1773851853.597515:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073b38b00
00000400:00000010:17.0:1773851853.597515:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073b38b00.
00000020:00000040:19.0:1773851853.597516:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000ef038100 : new refcount 5
00000100:00000001:19.0:1773851853.597516:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851853.597516:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851853.597516:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851853.597517:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000800:00000200:17.0:1773851853.597518:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 16378@kfi7(00000000896976ab):0x0 lsk 1893 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000764 Transaction freed
00000800:00000200:9.0:1773851853.604885:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851853.604886:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851853.604887:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851853.604889:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851853.604891:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.604892:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21985@kfi7 : PUT - for me
00000400:00000200:9.0:1773851853.604893:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.604894:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 1
00000400:00000200:9.0:1773851853.604895:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.604896:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000400:00000200:9.0:1773851853.604897:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 3
00000400:00000200:9.0:1773851853.604898:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21792@kfi7 to cpt 4
00000400:00000200:9.0:1773851853.604899:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21792@kfi7 of length 224 into portal 12 MB=0x699e0dbf00080
00000400:00000200:9.0:1773851853.604900:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21792@kfi7 of length 224/224 into md 0x78146ce49 [64] + 117656
00000800:00000200:9.0:1773851853.604902:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851853.604904:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.604904:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21985@kfi7: PUT: OK
00000100:00000001:9.0:1773851853.604905:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851853.604906:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851853.604907:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000acf2010d.
00000100:00000040:9.0:1773851853.604907:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000acf2010d x1858040901927040 msgsize 224
00000100:00100000:9.0:1773851853.604909:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21792@kfi7 (source: 12345-21985@kfi7)
00000100:00000001:9.0:1773851853.604910:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851853.604910:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000100:00000001:8.0:1773851853.604911:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851853.604912:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851853.604912:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851853.604912:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851853.604913:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.604914:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851853.604914:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040901927040
00000020:00000001:8.0:1773851853.604915:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851853.604915:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92905
00000020:00000001:8.0:1773851853.604916:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851853.604919:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e78e8aba refcount=6
00000020:00000001:8.0:1773851853.604919:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742944768 : -107128966606848 : ffff9e9118001000)
00000020:00000001:8.0:1773851853.604920:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742944768 : -107128966606848 : ffff9e9118001000)
00000100:00000001:8.0:1773851853.604921:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.604922:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851853.604923:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000073849ec.
00000020:00000010:8.0:1773851853.604924:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.604925:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851853.604926:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851853.604926:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851853.604927:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851853.604928:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851853.604928:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851853.604929:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.604930:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851853.604931:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851853.604931:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851853.604931:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851853.604931:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851853.604932:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21792@kfi7, seq: 2130718
00000100:00000001:11.0:1773851853.604933:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.604933:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e78e8aba : new rpc_count 1
00000100:00000001:11.0:1773851853.604934:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.604934:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792134016 : -106938917417600 : ffff9ebd57d08d80)
00000100:00000040:8.0:1773851853.604935:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000acf2010d x1858040901927040/t0(0) o400->eea97ee4-0975-4e57-9e34-713079f029eb@21792@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1855-0'
00000100:00000001:8.0:1773851853.604937:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.604938:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851853.604939:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000acf2010d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:eea97ee4-0975-4e57-9e34-713079f029eb+6:39906:x1858040901927040:12345-21792@kfi7:400:default-tuolumne1855-0
00000100:00000200:8.0:1773851853.604940:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040901927040
00000020:00000001:8.0:1773851853.604941:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851853.604942:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851853.604942:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.604943:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851853.604944:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851853.604944:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851853.604945:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040901927040, found 0 last_xid 1858040901927039
00000020:00000001:8.0:1773851853.604946:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851853.604947:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851853.604947:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851853.604948:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.604948:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851853.604949:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851853.604949:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851853.604950:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000025ad5da9.
02000000:00000001:8.0:1773851853.604951:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.604951:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.604952:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851853.604952:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044152544, transno 0, xid 1858040901927040
00010000:00000001:8.0:1773851853.604953:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851853.604954:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000acf2010d x1858040901927040/t0(0) o400->eea97ee4-0975-4e57-9e34-713079f029eb@21792@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1855-0'
00010000:00000001:8.0:1773851853.604956:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851853.604957:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851853.604957:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=86 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851853.604958:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851853.604959:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009bdbad0c refcount 3 to 21792@kfi7
00000100:00000001:8.0:1773851853.604960:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583911552 : -107156125640064 : ffff9e8ac5321a80)
02000000:00000001:8.0:1773851853.604960:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851853.604961:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.604962:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851853.604962:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21985@kfi7
00000400:00000010:8.0:1773851853.604963:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2abdf16.
00000100:00000200:8.0:1773851853.604964:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040901927040, offset 224
00000400:00000200:8.0:1773851853.604965:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21985@kfi7
00000400:00000200:8.0:1773851853.604966:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.604966:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 1
00000400:00000200:8.0:1773851853.604967:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000400:00000200:8.0:1773851853.604968:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 3
00000400:00000200:8.0:1773851853.604969:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21985@kfi7 local destination
00000400:00000200:8.0:1773851853.604971:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768569:8768569:1024:4294967295] 21985@kfi7 LPNI seq info [531822:531822:16:4294967295]
00000400:00000200:8.0:1773851853.604972:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000400:00000200:8.0:1773851853.604973:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.604975:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21985@kfi7(21985@kfi7:21985@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851853.604976:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 3
00000800:00000200:8.0:1773851853.604977:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851853.604978:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851853.604980:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851853.604982:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xaa2 Using peer 21985@kfi7(0xaa2)
00000800:00000200:8.0:1773851853.604985:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0xaa2: rc=0
00000800:00000200:8.0:1773851853.604986:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xaa2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851853.604988:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.604989:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009bdbad0c refcount 2 to 21792@kfi7
00010000:00000001:8.0:1773851853.604990:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851853.604991:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.604991:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851853.604992:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000acf2010d x1858040901927040/t0(0) o400->eea97ee4-0975-4e57-9e34-713079f029eb@21792@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1855-0'
00000100:00100000:8.0:1773851853.604996:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000acf2010d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:eea97ee4-0975-4e57-9e34-713079f029eb+6:39906:x1858040901927040:12345-21792@kfi7:400:default-tuolumne1855-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851853.604998:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21792@kfi7, seq: 2130718
00000100:00000040:8.0:1773851853.604998:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e78e8aba : new rpc_count 0
00000100:00000001:8.0:1773851853.604999:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851853.605000:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851853.605000:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.605001:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851853.605002:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000073849ec.
00000020:00000040:8.0:1773851853.605003:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e78e8aba : new refcount 5
00000100:00000001:8.0:1773851853.605003:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851853.605007:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xaa2 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851853.605009:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.605010:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21985@kfi7: PUT: OK
00000400:00000200:9.0:1773851853.605010:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2abdf16
00000400:00000010:9.0:1773851853.605011:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2abdf16.
00000100:00000001:9.0:1773851853.605012:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851853.605012:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851853.605013:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000800:00000200:9.0:1773851853.605014:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 21985@kfi7(00000000e981bf3b):0x0 lsk 2723 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xaa2 Transaction freed
00000800:00000200:29.0:1773851853.605688:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851853.605690:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851853.605691:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851853.605693:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851853.605695:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.605696:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26466@kfi7 : PUT - for me
00000400:00000200:29.0:1773851853.605697:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.605698:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 1
00000400:00000200:29.0:1773851853.605700:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.605700:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000400:00000200:29.0:1773851853.605701:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 3
00000400:00000200:29.0:1773851853.605702:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26467@kfi7 to cpt 2
00000400:00000200:29.0:1773851853.605703:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26467@kfi7 of length 224 into portal 12 MB=0x699e15f08de00
00000400:00000200:29.0:1773851853.605704:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26467@kfi7 of length 224/224 into md 0x77fe139dd [64] + 160232
00000800:00000200:29.0:1773851853.605705:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851853.605707:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851853.605709:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26466@kfi7: PUT: OK
00000100:00000001:29.0:1773851853.605709:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851853.605710:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851853.605711:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f0c0660c.
00000100:00000040:29.0:1773851853.605711:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f0c0660c x1858043101371904 msgsize 224
00000100:00100000:29.0:1773851853.605713:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26467@kfi7 (source: 12345-26466@kfi7)
00000100:00000001:29.0:1773851853.605714:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851853.605715:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851853.605715:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
02000000:00000001:31.0:1773851853.605716:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851853.605716:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851853.605717:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851853.605717:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851853.605718:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851853.605719:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043101371904
00000020:00000001:31.0:1773851853.605719:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851853.605720:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920bc
00000020:00000001:31.0:1773851853.605721:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851853.605724:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d96466f6 refcount=6
00000020:00000001:31.0:1773851853.605728:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629514240 : -107123080037376 : ffff9e9276ddfc00)
00000020:00000001:31.0:1773851853.605729:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629514240 : -107123080037376 : ffff9e9276ddfc00)
00000100:00000001:31.0:1773851853.605730:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.605731:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851853.605732:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f353d06.
00000020:00000010:31.0:1773851853.605733:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.605734:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851853.605735:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851853.605735:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851853.605736:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.605736:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851853.605737:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851853.605737:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.605738:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.605739:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.605740:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851853.605740:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851853.605740:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851853.605741:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26467@kfi7, seq: 2055455
00000100:00000040:31.0:1773851853.605742:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d96466f6 : new rpc_count 1
00000100:00000001:31.0:1773851853.605742:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224827904 : -106962484723712 : ffff9eb7db180000)
00000100:00000001:29.0:1773851853.605742:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851853.605742:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.605744:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f0c0660c x1858043101371904/t0(0) o400->058f1734-10ab-4bd0-870f-9300526f4f24@26467@kfi7:641/0 lens 224/0 e 0 to 0 dl 1773852001 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2140-0'
00000100:00000001:31.0:1773851853.605746:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.605747:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851853.605748:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0c0660c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:058f1734-10ab-4bd0-870f-9300526f4f24+6:39793:x1858043101371904:12345-26467@kfi7:400:default-tuolumne2140-0
00000100:00000200:31.0:1773851853.605749:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043101371904
00000020:00000001:31.0:1773851853.605750:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851853.605750:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851853.605751:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.605752:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851853.605752:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851853.605753:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851853.605754:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043101371904, found 0 last_xid 1858043101371903
00000020:00000001:31.0:1773851853.605754:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851853.605755:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851853.605756:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851853.605756:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.605757:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851853.605757:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851853.605758:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851853.605759:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c0d1fe47.
02000000:00000001:31.0:1773851853.605759:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.605760:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.605760:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851853.605761:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182422364440, transno 0, xid 1858043101371904
00010000:00000001:31.0:1773851853.605762:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851853.605763:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f0c0660c x1858043101371904/t0(0) o400->058f1734-10ab-4bd0-870f-9300526f4f24@26467@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2140-0'
00010000:00000001:31.0:1773851853.605765:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851853.605766:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851853.605767:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=86 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851853.605768:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851853.605768:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000005fb9a55 refcount 3 to 26467@kfi7
00000100:00000001:31.0:1773851853.605769:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526777696 : -107156182773920 : ffff9e8ac1ca4f60)
02000000:00000001:31.0:1773851853.605770:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851853.605771:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.605771:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851853.605772:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26466@kfi7
00000400:00000010:31.0:1773851853.605773:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e37bb3ee.
00000100:00000200:31.0:1773851853.605773:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043101371904, offset 224
00000400:00000200:31.0:1773851853.605775:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26466@kfi7
00000400:00000200:31.0:1773851853.605775:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.605776:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 1
00000400:00000200:31.0:1773851853.605777:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000400:00000200:31.0:1773851853.605779:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 3
00000400:00000200:31.0:1773851853.605780:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26466@kfi7 local destination
00000400:00000200:31.0:1773851853.605781:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768570:8768570:1024:4294967295] 26466@kfi7 LPNI seq info [14483599:14483599:16:4294967295]
00000400:00000200:31.0:1773851853.605783:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000400:00000200:31.0:1773851853.605784:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.605786:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26466@kfi7(26466@kfi7:26466@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851853.605787:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 3
00000800:00000200:31.0:1773851853.605788:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851853.605790:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851853.605792:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851853.605794:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd13 Using peer 26466@kfi7(0xd13)
00000800:00000200:31.0:1773851853.605797:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0xd13: rc=0
00000800:00000200:31.0:1773851853.605799:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd13 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851853.605801:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.605801:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000005fb9a55 refcount 2 to 26467@kfi7
00010000:00000001:31.0:1773851853.605802:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851853.605803:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.605803:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851853.605804:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f0c0660c x1858043101371904/t0(0) o400->058f1734-10ab-4bd0-870f-9300526f4f24@26467@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2140-0'
00000100:00100000:31.0:1773851853.605807:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0c0660c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:058f1734-10ab-4bd0-870f-9300526f4f24+6:39793:x1858043101371904:12345-26467@kfi7:400:default-tuolumne2140-0 Request processed in 60us (95us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851853.605809:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26467@kfi7, seq: 2055455
00000100:00000040:31.0:1773851853.605810:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d96466f6 : new rpc_count 0
00000100:00000001:31.0:1773851853.605810:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851853.605811:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851853.605811:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000800:00000200:29.0:1773851853.605811:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd13 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851853.605812:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851853.605812:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851853.605813:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f353d06.
00000400:00000200:29.0:1773851853.605813:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26466@kfi7: PUT: OK
00000020:00000040:31.0:1773851853.605814:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000d96466f6 : new refcount 5
00000400:00000200:29.0:1773851853.605814:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e37bb3ee
00000100:00000001:31.0:1773851853.605815:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851853.605815:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e37bb3ee.
00000100:00000001:29.0:1773851853.605815:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851853.605816:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851853.605817:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000800:00000200:29.0:1773851853.605818:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26466@kfi7(00000000f4641aab):0x0 lsk 3348 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd13 Transaction freed
00000800:00000200:1.0:1773851853.619729:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.619730:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851853.619732:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851853.619734:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851853.619736:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.619737:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18801@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.619738:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.619739:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 1
00000400:00000200:1.0:1773851853.619740:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.619740:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000400:00000200:1.0:1773851853.619741:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 3
00000400:00000200:1.0:1773851853.619742:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18800@kfi7 to cpt 5
00000400:00000200:1.0:1773851853.619743:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18800@kfi7 of length 224 into portal 12 MB=0x69b4ba6ddc000
00000400:00000200:1.0:1773851853.619745:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18800@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 11088
00000800:00000200:1.0:1773851853.619746:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851853.619748:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.619749:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18801@kfi7: PUT: OK
00000100:00000001:1.0:1773851853.619750:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851853.619751:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851853.619752:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000445f3ba1.
00000100:00000040:1.0:1773851853.619753:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000445f3ba1 x1859599084666880 msgsize 224
00000100:00100000:1.0:1773851853.619754:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-18800@kfi7 (source: 12345-18801@kfi7)
00000100:00000001:1.0:1773851853.619755:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851853.619756:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000800:00000200:1.0:1773851853.619757:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851853.619758:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851853.619759:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851853.619760:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851853.619760:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851853.619762:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.619763:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599084666880
00000020:00000001:0.0:1773851853.619764:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851853.619764:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3893c415
00000020:00000001:0.0:1773851853.619765:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851853.619767:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003e4a3866 refcount=5
00000020:00000001:0.0:1773851853.619768:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130178664448 : -106943530887168 : ffff9ebc44d49800)
00000020:00000001:0.0:1773851853.619769:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130178664448 : -106943530887168 : ffff9ebc44d49800)
00000100:00000001:0.0:1773851853.619770:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.619771:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851853.619772:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851853.619774:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.619775:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851853.619776:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851853.619777:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851853.619778:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.619779:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851853.619780:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851853.619781:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.619783:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.619784:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.619785:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851853.619787:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851853.619787:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18800@kfi7, seq: 1997486
00000100:00000001:2.0:1773851853.619788:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851853.619788:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003e4a3866 : new rpc_count 1
00000100:00000001:2.0:1773851853.619789:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.619789:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605640832 : -106923103910784 : ffff9ec1065f8480)
00000100:00000001:2.0:1773851853.619790:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.619790:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000445f3ba1 x1859599084666880/t0(0) o400->8237baa5-dfce-4505-ba05-5fb328dae416@18800@kfi7:493/0 lens 224/0 e 0 to 0 dl 1773852608 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1662-0'
00000100:00000001:0.0:1773851853.619795:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.619796:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851853.619798:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000445f3ba1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8237baa5-dfce-4505-ba05-5fb328dae416+5:39522:x1859599084666880:12345-18800@kfi7:400:default-tuolumne1662-0
00000100:00000200:0.0:1773851853.619800:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599084666880
00000020:00000001:0.0:1773851853.619801:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851853.619802:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851853.619803:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.619804:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851853.619805:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851853.619807:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851853.619807:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599084666880, found 0 last_xid 1859599084666879
00000020:00000001:0.0:1773851853.619809:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851853.619810:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.619810:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851853.619811:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.619812:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851853.619812:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851853.619813:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851853.619814:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000023dfd9b.
02000000:00000001:0.0:1773851853.619814:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.619815:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.619816:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851853.619816:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260594509, transno 0, xid 1859599084666880
00010000:00000001:0.0:1773851853.619817:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851853.619818:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000445f3ba1 x1859599084666880/t0(0) o400->8237baa5-dfce-4505-ba05-5fb328dae416@18800@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1662-0'
00010000:00000001:0.0:1773851853.619820:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851853.619821:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851853.619821:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851853.619822:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851853.619823:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009a6c3a6f refcount 3 to 18800@kfi7
00000100:00000001:0.0:1773851853.619823:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051069312 : -107146658482304 : ffff9e8cf97b7780)
02000000:00000001:0.0:1773851853.619824:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851853.619825:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.619825:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851853.619826:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18801@kfi7
00000400:00000010:0.0:1773851853.619827:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008edf1d49.
00000100:00000200:0.0:1773851853.619827:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599084666880, offset 224
00000400:00000200:0.0:1773851853.619828:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18801@kfi7
00000400:00000200:0.0:1773851853.619829:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.619830:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 1
00000400:00000200:0.0:1773851853.619831:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000400:00000200:0.0:1773851853.619832:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 3
00000400:00000200:0.0:1773851853.619833:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18801@kfi7 local destination
00000400:00000200:0.0:1773851853.619835:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768571:8768571:1024:4294967295] 18801@kfi7 LPNI seq info [1543243:1543243:16:4294967295]
00000400:00000200:0.0:1773851853.619836:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000400:00000200:0.0:1773851853.619837:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.619839:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18801@kfi7(18801@kfi7:18801@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851853.619841:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 3
00000800:00000200:0.0:1773851853.619842:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851853.619843:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851853.619845:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851853.619847:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000122c Using peer 18801@kfi7(0x10000000000122c)
00000800:00000200:0.0:1773851853.619850:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x10000000000122c: rc=0
00000800:00000200:0.0:1773851853.619852:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000122c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851853.619854:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.619855:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009a6c3a6f refcount 2 to 18800@kfi7
00010000:00000001:0.0:1773851853.619856:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851853.619856:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.619857:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851853.619857:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000445f3ba1 x1859599084666880/t0(0) o400->8237baa5-dfce-4505-ba05-5fb328dae416@18800@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1662-0'
00000100:00100000:0.0:1773851853.619863:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000445f3ba1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8237baa5-dfce-4505-ba05-5fb328dae416+5:39522:x1859599084666880:12345-18800@kfi7:400:default-tuolumne1662-0 Request processed in 67us (109us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851853.619865:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18800@kfi7, seq: 1997486
00000100:00000040:0.0:1773851853.619866:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003e4a3866 : new rpc_count 0
00000100:00000001:0.0:1773851853.619867:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851853.619867:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851853.619868:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.619869:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851853.619869:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851853.619870:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003e4a3866 : new refcount 4
00000100:00000001:0.0:1773851853.619871:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851853.619877:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000122c TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851853.619879:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851853.619880:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18801@kfi7: PUT: OK
00000400:00000200:2.0:1773851853.619881:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008edf1d49
00000400:00000010:2.0:1773851853.619882:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008edf1d49.
00000100:00000001:2.0:1773851853.619883:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851853.619883:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851853.619884:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000800:00000200:2.0:1773851853.619885:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 18801@kfi7(000000002aa6fae0):0x0 lsk 4653 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000122c Transaction freed
00000004:00000001:10.0:1773851853.641730:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:3.0:1773851853.641730:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:15.0:1773851853.641731:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851853.641731:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:3.0:1773851853.641731:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:15.0:1773851853.641732:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851853.641732:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e177912e.
00000020:00000040:10.0:1773851853.641732:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000100:00000010:3.0:1773851853.641732:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f14d14e1.
00000100:00000010:15.0:1773851853.641733:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002cc2fb00.
00000020:00000040:15.0:1773851853.641733:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:10.0:1773851853.641733:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:3.0:1773851853.641733:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
02000000:00000001:10.0:1773851853.641734:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851853.641734:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851853.641734:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:15.0:1773851853.641735:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:15.0:1773851853.641735:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000001:11.0:1773851853.641735:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851853.641735:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000010:10.0:1773851853.641735:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b4289b24.
02000000:00000001:3.0:1773851853.641735:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:15.0:1773851853.641736:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:11.0:1773851853.641736:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b624700f.
00000100:00000001:10.0:1773851853.641736:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851853.641736:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851853.641737:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000100:00000001:10.0:1773851853.641737:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851853.641737:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851853.641737:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000082d59ac0.
02000000:00000010:15.0:1773851853.641738:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000174d8ecc.
00000100:00000001:11.0:1773851853.641738:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851853.641738:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:10.0:1773851853.641738:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e177912e] to pc [ptlrpcd_02_01+1]  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:15.0:1773851853.641739:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851853.641739:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851853.641739:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851853.641740:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:11.0:1773851853.641740:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000171bdcdb.
00000100:00000001:3.0:1773851853.641740:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:15.0:1773851853.641741:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851853.641741:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851853.641741:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851853.641742:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002cc2fb00] to pc [ptlrpcd_03_02+2]  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851853.641742:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:10.0:1773851853.641742:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:3.0:1773851853.641742:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f14d14e1] to pc [ptlrpcd_00_03+3]  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851853.641743:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641743:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851853.641743:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851853.641743:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:11.0:1773851853.641744:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b624700f] to pc [ptlrpcd_02_02+2]  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:10.0:1773851853.641744:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000005e7f2fa5.
00000100:00000001:9.0:1773851853.641744:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641744:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:10.0:1773851853.641745:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637127928424448 : -106945781127168 : ffff9ebbbeb4a800)
00000100:00000040:8.0:1773851853.641745:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:15.0:1773851853.641746:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851853.641746:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851853.641746:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851853.641747:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00080000:00000001:3.0:1773851853.641747:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:15.0:1773851853.641748:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000dc0de693.
00000100:00000001:14.0:1773851853.641748:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851853.641748:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851853.641748:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851853.641748:0:41074:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000010:10.0:1773851853.641748:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004a7f86f9.
00000004:00080000:10.0:1773851853.641748:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614128095023771ns, next at 614129095023019ns, rc = 0
00000100:00000001:8.0:1773851853.641748:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851853.641748:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:3.0:1773851853.641748:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b1d0135a.
00000100:00000001:2.0:1773851853.641748:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851853.641748:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:15.0:1773851853.641749:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637058753570816 : -107014955980800 : ffff9eaba3902800)
00000100:00000001:12.0:1773851853.641749:0:41074:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:11.0:1773851853.641749:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851853.641749:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851853.641749:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641749:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:8.0:1773851853.641749:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851853.641749:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851853.641749:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637166625124352 : -106907084427264 : ffff9ec4c1357000)
00000100:00000001:2.0:1773851853.641749:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851853.641749:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:15.0:1773851853.641750:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:12.0:1773851853.641750:0:41074:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:11.0:1773851853.641750:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a276050b.
00000004:00000001:10.0:1773851853.641750:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641750:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851853.641750:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00100000:8.0:1773851853.641750:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e177912e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051922688:31@kfi7:13:default-yuba2-0
00080000:00000001:3.0:1773851853.641750:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:15.0:1773851853.641751:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851853.641751:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637070368358400 : -107003341193216 : ffff9eae57dbc000)
00000100:00000040:9.0:1773851853.641751:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:3.0:1773851853.641751:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851853.641751:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851853.641751:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:15.0:1773851853.641752:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00080000:00000001:11.0:1773851853.641752:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:8.0:1773851853.641752:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851853.641752:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00001000:3.0:1773851853.641752:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000004:00000010:15.0:1773851853.641753:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d8c6468d.
00000100:00000001:12.0:1773851853.641753:0:41074:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:11.0:1773851853.641753:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851853.641753:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
02000000:00000001:8.0:1773851853.641753:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.641753:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000010:3.0:1773851853.641753:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001394896b.
00000004:00080000:15.0:1773851853.641754:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614128095029231ns, next at 614129095027918ns, rc = 0
00000100:00000001:12.0:1773851853.641754:0:41074:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:11.0:1773851853.641754:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000cc2b5873.
02000000:00000010:8.0:1773851853.641754:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000db30ef3a.
00000004:00080000:3.0:1773851853.641754:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614128095029912ns, next at 614129095028479ns, rc = 0
00000100:00000001:2.0:1773851853.641754:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851853.641754:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851853.641755:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:12.0:1773851853.641755:0:41074:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:10.0:1773851853.641755:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851853.641755:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.641755:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851853.641755:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:12.0:1773851853.641756:0:41074:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:11.0:1773851853.641756:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614128095031325ns, next at 614129095029531ns, rc = 0
00000400:00000200:8.0:1773851853.641756:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:8.0:1773851853.641756:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00080000:00000001:3.0:1773851853.641756:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:3.0:1773851853.641756:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851853.641756:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851853.641757:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851853.641757:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851853.641757:0:41074:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cc2fb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_02:lustre5-MDT0001-mdtlov_UUID:41074:1859433051922816:54@kfi7:13:default-yuba2-0
00080000:00000001:11.0:1773851853.641757:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:9.0:1773851853.641757:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851853.641757:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851853.641757:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851853.641758:0:41074:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:12.0:1773851853.641758:0:41074:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:11.0:1773851853.641758:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851853.641758:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851853.641758:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:8.0:1773851853.641758:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3e9aeb1.
00000100:00100000:2.0:1773851853.641758:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f14d14e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051922752:2095@kfi7:13:default-yuba2-0
02000000:00000001:12.0:1773851853.641759:0:41074:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851853.641759:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851853.641759:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922688, portal 4
00000100:00000001:2.0:1773851853.641759:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:12.0:1773851853.641760:0:41074:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:12.0:1773851853.641760:0:41074:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001061b4d8.
00000100:00100000:9.0:1773851853.641760:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051922880:6@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851853.641760:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851853.641760:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077420032 : -106968632131584 : ffff9eb66cae0000)
02000000:00000001:2.0:1773851853.641760:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:2.0:1773851853.641760:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851853.641761:0:41074:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641761:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:8.0:1773851853.641761:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:2.0:1773851853.641761:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:12.0:1773851853.641762:0:41074:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
02000000:00000001:9.0:1773851853.641762:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851853.641762:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:2.0:1773851853.641762:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d3421c59.
00000400:00000010:12.0:1773851853.641763:0:41074:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000001259ac8.
00000400:00000010:12.0:1773851853.641763:0:41074:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df1f761c.
02000000:00000001:9.0:1773851853.641763:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:2.0:1773851853.641763:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:12.0:1773851853.641764:0:41074:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922816, portal 4
02000000:00000010:9.0:1773851853.641764:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e50c3955.
00000100:00000001:8.0:1773851853.641764:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:2.0:1773851853.641764:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:12.0:1773851853.641765:0:41074:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:12.0:1773851853.641765:0:41074:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860222976 : -107049849328640 : ffff9ea383c1ec00)
02000000:00000001:9.0:1773851853.641765:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.641765:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:8.0:1773851853.641765:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6b06622.
00000400:00000010:2.0:1773851853.641765:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000400:00000200:9.0:1773851853.641766:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000200:8.0:1773851853.641766:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922688, offset 0
00000400:00000010:2.0:1773851853.641766:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee30c2c.
00000100:00000040:12.0:1773851853.641767:0:41074:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851853.641767:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000071ec9fd.
00000400:00000200:8.0:1773851853.641767:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000100:00000200:2.0:1773851853.641767:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922752, portal 4
00000400:00000010:9.0:1773851853.641768:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000146cbe4e.
00000400:00000200:8.0:1773851853.641768:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:2.0:1773851853.641768:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851853.641768:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288715136 : -106964420836480 : ffff9eb767b14380)
00000100:00000001:12.0:1773851853.641769:0:41074:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:9.0:1773851853.641769:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922880, portal 4
00000400:00000200:8.0:1773851853.641769:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000100:00000040:12.0:1773851853.641770:0:41074:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000010:12.0:1773851853.641770:0:41074:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f7dab02.
00000100:00000001:9.0:1773851853.641770:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851853.641770:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637164268282624 : -106909441268992 : ffff9ec434bae300)
00000400:00000200:8.0:1773851853.641770:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000040:2.0:1773851853.641770:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:12.0:1773851853.641771:0:41074:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922816, offset 0
00000400:00000200:12.0:1773851853.641772:0:41074:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000100:00000040:9.0:1773851853.641772:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851853.641772:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000100:00000001:2.0:1773851853.641772:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851853.641773:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000100:00000040:2.0:1773851853.641773:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000200:12.0:1773851853.641774:0:41074:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:12.0:1773851853.641774:0:41074:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000100:00000001:9.0:1773851853.641774:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:2.0:1773851853.641774:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c97ce9eb.
00000100:00000040:9.0:1773851853.641775:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000200:8.0:1773851853.641775:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768570, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768571, p:4294967295, g:4294967295, h:1000]
00000100:00000200:2.0:1773851853.641775:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922752, offset 0
00000400:00000200:12.0:1773851853.641776:0:41074:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000010:9.0:1773851853.641776:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000200:9.0:1773851853.641776:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051922880, offset 0
00000400:00000200:2.0:1773851853.641776:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:12.0:1773851853.641777:0:41074:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851853.641777:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:12.0:1773851853.641778:0:41074:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:9.0:1773851853.641778:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000400:00000200:8.0:1773851853.641778:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851853.641778:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000200:2.0:1773851853.641778:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:2.0:1773851853.641779:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:12.0:1773851853.641780:0:41074:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768572, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768571, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851853.641780:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768572:8768572:1024:4294967295] 31@kfi7 LPNI seq info [5403615:5403615:16:4294967295]
00000400:00000200:2.0:1773851853.641780:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:2.0:1773851853.641781:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:8.0:1773851853.641782:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:12.0:1773851853.641783:0:41074:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851853.641783:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:2.0:1773851853.641783:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:12.0:1773851853.641784:0:41074:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851853.641784:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.641784:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768572, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768571, p:4294967295, g:4294967295, h:1000]
00000400:00000200:12.0:1773851853.641785:0:41074:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:9.0:1773851853.641785:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:12.0:1773851853.641786:0:41074:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768573:8768573:1024:4294967295] 54@kfi7 LPNI seq info [5403919:5403919:16:4294967295]
00000400:00000200:9.0:1773851853.641786:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:8.0:1773851853.641786:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851853.641787:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:2.0:1773851853.641787:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:12.0:1773851853.641788:0:41074:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851853.641788:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000200:8.0:1773851853.641788:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:2.0:1773851853.641788:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:12.0:1773851853.641789:0:41074:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:2.0:1773851853.641789:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:9.0:1773851853.641790:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768574, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768573, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851853.641790:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:2.0:1773851853.641790:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768574:8768574:1023:4294967295] 2095@kfi7 LPNI seq info [5406039:5406039:16:4294967295]
00000800:00000200:8.0:1773851853.641791:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:12.0:1773851853.641792:0:41074:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851853.641792:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:2.0:1773851853.641792:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:12.0:1773851853.641793:0:41074:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851853.641793:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851853.641793:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:2.0:1773851853.641793:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:9.0:1773851853.641794:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000800:00000200:12.0:1773851853.641795:0:41074:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851853.641795:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768575:8768575:1023:4294967295] 6@kfi7 LPNI seq info [5405028:5405028:16:4294967295]
00000400:00000200:2.0:1773851853.641796:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000800:00000200:12.0:1773851853.641797:0:41074:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851853.641797:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:8.0:1773851853.641797:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Using peer 31@kfi7(0x56e)
00000400:00000200:9.0:1773851853.641798:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.641798:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000800:00000200:12.0:1773851853.641799:0:41074:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851853.641799:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:8.0:1773851853.641800:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x56e: rc=0
00000400:00000200:9.0:1773851853.641801:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851853.641801:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851853.641801:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851853.641802:0:41074:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000400:00000200:9.0:1773851853.641802:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000800:00000200:9.0:1773851853.641803:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851853.641804:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641804:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:2.0:1773851853.641804:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851853.641805:0:41074:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000800:00000200:9.0:1773851853.641805:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851853.641805:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641806:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641806:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:12.0:1773851853.641807:0:41074:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851853.641807:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851853.641807:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000100:00000001:8.0:1773851853.641808:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851853.641808:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:12.0:1773851853.641809:0:41074:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641809:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851853.641810:0:41074:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:12.0:1773851853.641810:0:41074:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851853.641810:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000100:00000001:8.0:1773851853.641810:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851853.641811:0:41074:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851853.641811:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000894f0236: Posted send of 324 bytes to peer 0x5c0: rc=0
00000100:00000001:12.0:1773851853.641812:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851853.641812:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851853.641813:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000100:00000001:8.0:1773851853.641814:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641814:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641814:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851853.641815:0:41074:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:12.0:1773851853.641815:0:41074:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:9.0:1773851853.641815:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851853.641815:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:12.0:1773851853.641816:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851853.641816:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641816:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851853.641817:0:41074:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:11.0:1773851853.641817:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851853.641817:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641817:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851853.641817:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851853.641818:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641818:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851853.641819:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641819:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.641819:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:11.0:1773851853.641820:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851853.641820:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851853.641820:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851853.641820:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851853.641821:0:41074:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851853.641821:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:9.0:1773851853.641821:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851853.641821:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851853.641821:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641821:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851853.641822:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000100:00000001:12.0:1773851853.641822:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851853.641822:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6b06622
00000400:00000010:11.0:1773851853.641822:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6b06622.
00000100:00000001:9.0:1773851853.641822:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851853.641822:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851853.641823:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851853.641823:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851853.641824:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:11.0:1773851853.641824:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851853.641824:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851853.641826:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:13.0:1773851853.641826:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f7dab02
00000800:00000200:9.0:1773851853.641826:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000400:00000010:13.0:1773851853.641827:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f7dab02.
00000100:00000001:11.0:1773851853.641827:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:13.0:1773851853.641828:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000100:00000040:11.0:1773851853.641828:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851853.641828:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.641828:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:13.0:1773851853.641829:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851853.641829:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:11.0:1773851853.641830:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851853.641830:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000400:00000200:1.0:1773851853.641830:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000100:00000001:13.0:1773851853.641831:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851853.641831:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:9.0:1773851853.641831:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000400:00000200:1.0:1773851853.641831:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c97ce9eb
00000100:00000040:13.0:1773851853.641832:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851853.641832:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:9.0:1773851853.641832:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851853.641832:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:1.0:1773851853.641832:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c97ce9eb.
00000800:00000200:11.0:1773851853.641834:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Transaction freed
00000100:00000001:1.0:1773851853.641834:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:13.0:1773851853.641835:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.641835:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851853.641835:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:1.0:1773851853.641835:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851853.641836:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000040:9.0:1773851853.641836:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851853.641838:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000100:00000001:9.0:1773851853.641838:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641839:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851853.641840:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:9.0:1773851853.641841:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Transaction freed
00000100:00000001:1.0:1773851853.641841:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:1.0:1773851853.641842:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851853.641846:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:1.0:1773851853.641846:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851853.641847:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851853.641848:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:1.0:1773851853.641848:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:1.0:1773851853.641849:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000800:00000200:17.0:1773851853.641850:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851853.641852:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:1.0:1773851853.641852:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000400:00000200:17.0:1773851853.641853:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 31@kfi7 : PUT - for me
00000800:00000200:13.0:1773851853.641853:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:17.0:1773851853.641854:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:13.0:1773851853.641854:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851853.641855:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000800:00000200:13.0:1773851853.641855:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851853.641856:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851853.641857:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:13.0:1773851853.641857:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851853.641858:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:17.0:1773851853.641859:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:13.0:1773851853.641859:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:17.0:1773851853.641860:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2100
00000400:00000200:13.0:1773851853.641860:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000200:17.0:1773851853.641861:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851853.641862:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f0591 [1] + 224
00000400:00000200:13.0:1773851853.641862:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.641862:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:13.0:1773851853.641863:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:17.0:1773851853.641864:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851853.641864:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:13.0:1773851853.641865:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000800:00000200:30.0:1773851853.641866:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:17.0:1773851853.641866:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851853.641866:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:30.0:1773851853.641867:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851853.641867:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000400:00000200:13.0:1773851853.641867:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2180
00000800:00000200:30.0:1773851853.641868:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:17.0:1773851853.641868:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851853.641868:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:1.0:1773851853.641868:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:13.0:1773851853.641869:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f554d [1] + 224
00000800:00000200:1.0:1773851853.641869:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:17.0:1773851853.641870:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851853.641870:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851853.641871:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851853.641871:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851853.641873:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000040:17.0:1773851853.641873:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851853.641873:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:1.0:1773851853.641873:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851853.641874:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:30.0:1773851853.641875:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.641875:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:30.0:1773851853.641876:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:17.0:1773851853.641876:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:30.0:1773851853.641877:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000100:00000001:13.0:1773851853.641877:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851853.641877:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:30.0:1773851853.641878:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851853.641878:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000200:13.0:1773851853.641878:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851853.641878:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851853.641879:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000800:00000200:17.0:1773851853.641879:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851853.641879:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851853.641879:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:30.0:1773851853.641880:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000100:00000040:13.0:1773851853.641880:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:8.0:1773851853.641880:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851853.641880:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:1.0:1773851853.641880:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000010:8.0:1773851853.641881:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000400:00000200:1.0:1773851853.641881:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:30.0:1773851853.641882:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:8.0:1773851853.641882:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3e9aeb1
00000400:00000010:8.0:1773851853.641882:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3e9aeb1.
00000400:00000200:1.0:1773851853.641882:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:30.0:1773851853.641883:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2140
00000100:00000001:13.0:1773851853.641883:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851853.641883:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851853.641883:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:30.0:1773851853.641884:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851853.641884:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:12.0:1773851853.641884:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:8.0:1773851853.641884:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851853.641884:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000001:12.0:1773851853.641885:0:41074:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851853.641886:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78007fa7d [1] + 224
00000800:00000200:13.0:1773851853.641886:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000001:12.0:1773851853.641886:0:41074:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:12.0:1773851853.641886:0:41074:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:1.0:1773851853.641886:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b21c0
00000400:00000010:12.0:1773851853.641887:0:41074:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000001259ac8.
00000400:00000200:12.0:1773851853.641887:0:41074:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df1f761c
00000100:00000200:8.0:1773851853.641887:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851853.641887:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000010:12.0:1773851853.641888:0:41074:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df1f761c.
00000100:00000001:12.0:1773851853.641888:0:41074:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851853.641888:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71cb61 [1] + 224
00000800:00000200:30.0:1773851853.641889:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:12.0:1773851853.641889:0:41074:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851853.641889:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:30.0:1773851853.641890:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851853.641890:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851853.641890:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851853.641891:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851853.641891:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851853.641891:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851853.641892:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000100:00000200:12.0:1773851853.641892:0:41074:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851853.641892:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851853.641892:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851853.641893:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:8.0:1773851853.641893:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851853.641893:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=86 v=66 (66 66 66 66)
00000100:00000200:30.0:1773851853.641894:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851853.641894:0:41074:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:8.0:1773851853.641894:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=86 v=66 (1 1 1 1)
00000400:00000200:1.0:1773851853.641894:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:12.0:1773851853.641895:0:41074:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851853.641895:0:41074:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:8.0:1773851853.641895:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:1.0:1773851853.641895:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:12.0:1773851853.641896:0:41074:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:12.0:1773851853.641896:0:41074:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851853.641896:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851853.641896:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851853.641897:0:41074:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851853.641897:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851853.641897:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851853.641898:0:41074:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851853.641898:0:41074:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=86 v=66 (66 66 66 66)
00000100:00000040:30.0:1773851853.641899:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:12.0:1773851853.641899:0:41074:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=86 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851853.641899:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851853.641899:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000040:1.0:1773851853.641899:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851853.641900:0:41074:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851853.641900:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851853.641900:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851853.641901:0:41074:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851853.641901:0:41074:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:8.0:1773851853.641901:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:12.0:1773851853.641902:0:41074:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851853.641902:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851853.641903:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:12.0:1773851853.641903:0:41074:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:12.0:1773851853.641903:0:41074:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:8.0:1773851853.641903:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851853.641904:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:12.0:1773851853.641904:0:41074:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:12.0:1773851853.641904:0:41074:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641904:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851853.641904:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:1.0:1773851853.641904:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000040:12.0:1773851853.641905:0:41074:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851853.641905:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851853.641905:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.641905:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851853.641905:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:30.0:1773851853.641906:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000001:9.0:1773851853.641906:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000004:00000001:8.0:1773851853.641906:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851853.641906:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000400:00000001:2.0:1773851853.641906:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:1.0:1773851853.641906:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851853.641907:0:41074:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000001:9.0:1773851853.641907:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851853.641907:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000071ec9fd.
00000004:00000040:8.0:1773851853.641907:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666736128 avail=351645489152 avail_mb=1373615192 hwm_mb=3131103 files=372238013 ffree=343424547 state=0: rc = 0
00000400:00000001:2.0:1773851853.641907:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:12.0:1773851853.641908:0:41074:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:9.0:1773851853.641908:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000146cbe4e
00000400:00000010:2.0:1773851853.641908:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000100:00000001:12.0:1773851853.641909:0:41074:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851853.641909:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000146cbe4e.
00000004:00000020:8.0:1773851853.641909:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666736128 free, 351645489152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372238013 files, 343424547 free files
00000400:00000200:2.0:1773851853.641909:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee30c2c
00000004:00000001:12.0:1773851853.641910:0:41074:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851853.641910:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:8.0:1773851853.641910:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:2.0:1773851853.641910:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee30c2c.
00000004:00000040:12.0:1773851853.641911:0:41074:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000004:00000040:12.0:1773851853.641911:0:41074:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399719424 free=351524128768 avail=351521378304 avail_mb=1373130384 hwm_mb=3131103 files=372114012 ffree=343285282 state=0: rc = 0
00000100:00000200:9.0:1773851853.641911:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851853.641911:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851853.641911:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:2.0:1773851853.641912:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:12.0:1773851853.641913:0:41074:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399719424 blocks, 351524128768 free, 351521378304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372114012 files, 343285282 free files
00000004:00000001:12.0:1773851853.641914:0:41074:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851853.641914:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:8.0:1773851853.641914:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e177912e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051922688:31@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851853.641915:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:2.0:1773851853.641915:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:12.0:1773851853.641916:0:41074:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851853.641916:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851853.641916:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851853.641917:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:8.0:1773851853.641917:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e177912e x1859433051922688/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851853.641917:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00100000:12.0:1773851853.641918:0:41074:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cc2fb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_02:lustre5-MDT0001-mdtlov_UUID:41074:1859433051922816:54@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851853.641918:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851853.641918:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:2.0:1773851853.641918:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.641918:0:41063:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:9.0:1773851853.641919:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851853.641919:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641919:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:2.0:1773851853.641919:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:12.0:1773851853.641920:0:41074:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851853.641920:0:41074:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:9.0:1773851853.641920:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.641920:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851853.641920:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000db30ef3a.
00000100:00000001:2.0:1773851853.641920:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:12.0:1773851853.641921:0:41074:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002cc2fb00 x1859433051922816/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:9.0:1773851853.641921:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=86 v=66 (66 66 66 66)
02000000:00000001:8.0:1773851853.641921:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:2.0:1773851853.641921:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851853.641921:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851853.641922:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=151 v=66 (1 1 1 1)
00000020:00000001:8.0:1773851853.641922:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851853.641922:0:41069:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00001000:2.0:1773851853.641922:0:41063:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=86 v=66 (66 66 66 66)
00000100:00000001:12.0:1773851853.641923:0:41074:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:12.0:1773851853.641923:0:41074:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:9.0:1773851853.641923:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851853.641923:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.641923:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851853.641923:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b4289b24.
02000000:00000010:12.0:1773851853.641924:0:41074:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001061b4d8.
00010000:00000001:9.0:1773851853.641924:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:8.0:1773851853.641924:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:2.0:1773851853.641924:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=86 v=66 (1 1 1 1)
02000000:00000001:12.0:1773851853.641925:0:41074:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:12.0:1773851853.641925:0:41074:0:(genops.c:1101:class_import_put()) Process entered
00010000:00000001:9.0:1773851853.641925:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.641925:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851853.641925:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e177912e.
00000100:00000001:2.0:1773851853.641925:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851853.641925:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851853.641926:0:41074:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000020:00000001:12.0:1773851853.641926:0:41074:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:9.0:1773851853.641926:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851853.641926:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000001:8.0:1773851853.641926:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00010000:00000001:2.0:1773851853.641926:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000010:12.0:1773851853.641927:0:41074:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000174d8ecc.
00000100:00000001:8.0:1773851853.641927:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851853.641927:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851853.641927:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851853.641928:0:41074:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:12.0:1773851853.641928:0:41074:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:12.0:1773851853.641928:0:41074:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cc2fb00.
00000100:00000001:9.0:1773851853.641928:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851853.641928:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.641928:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851853.641928:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641928:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:2.0:1773851853.641928:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000001:12.0:1773851853.641929:0:41074:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:9.0:1773851853.641929:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851853.641929:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851853.641929:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641929:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:2.0:1773851853.641929:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851853.641930:0:41074:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851853.641930:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:2.0:1773851853.641930:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:12.0:1773851853.641931:0:41074:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:12.0:1773851853.641931:0:41074:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851853.641932:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851853.641932:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851853.641932:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851853.641933:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851853.641933:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.641933:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:9.0:1773851853.641934:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:2.0:1773851853.641934:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851853.641934:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:9.0:1773851853.641935:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851853.641935:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420286976 avail=351417833472 avail_mb=1372725912 hwm_mb=3131103 files=372009086 ffree=343183874 state=0: rc = 0
00000004:00000001:2.0:1773851853.641935:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:2.0:1773851853.641936:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000004:00000040:2.0:1773851853.641936:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449354240 avail=351446762496 avail_mb=1372838916 hwm_mb=3131103 files=372161080 ffree=343212260 state=0: rc = 0
00000004:00000020:9.0:1773851853.641938:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420286976 free, 351417833472 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372009086 files, 343183874 free files
00000004:00000020:2.0:1773851853.641938:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449354240 free, 351446762496 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372161080 files, 343212260 free files
00000004:00000001:9.0:1773851853.641939:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851853.641940:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:2.0:1773851853.641940:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851853.641941:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851853.641943:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051922880:6@kfi7:13:default-yuba2-0
00000100:00100000:2.0:1773851853.641944:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f14d14e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051922752:2095@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851853.641945:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851853.641946:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851853.641946:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b624700f x1859433051922880/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851853.641946:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.641947:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:2.0:1773851853.641947:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f14d14e1 x1859433051922752/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852006 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851853.641949:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851853.641949:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851853.641950:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e50c3955.
00000100:00000001:2.0:1773851853.641950:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851853.641951:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:2.0:1773851853.641951:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:2.0:1773851853.641951:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d3421c59.
00000020:00000001:9.0:1773851853.641952:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851853.641952:0:41070:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
02000000:00000001:2.0:1773851853.641952:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851853.641953:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:2.0:1773851853.641953:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851853.641953:0:41063:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
02000000:00000010:9.0:1773851853.641954:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000171bdcdb.
00000020:00000001:2.0:1773851853.641954:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:9.0:1773851853.641955:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851853.641955:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:2.0:1773851853.641955:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000082d59ac0.
00000100:00000010:9.0:1773851853.641956:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b624700f.
02000000:00000001:2.0:1773851853.641956:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:2.0:1773851853.641956:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:9.0:1773851853.641957:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851853.641957:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:2.0:1773851853.641957:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f14d14e1.
00000100:00000001:9.0:1773851853.641958:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.641958:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851853.641958:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851853.641959:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851853.641959:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641959:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851853.641960:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851853.641960:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641960:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851853.641960:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.641961:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851853.641962:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851853.668937:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851853.668938:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851853.668940:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851853.668942:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851853.668945:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.668946:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17409@kfi7 : PUT - for me
00000400:00000200:13.0:1773851853.668947:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.668948:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 1
00000400:00000200:13.0:1773851853.668950:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.668950:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000400:00000200:13.0:1773851853.668951:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 3
00000400:00000200:13.0:1773851853.668952:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.668953:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17409@kfi7 of length 224 into portal 12 MB=0x69b4b9fa3b380
00000400:00000200:13.0:1773851853.668955:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17409@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 12328
00000800:00000200:13.0:1773851853.668957:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851853.668959:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851853.668960:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17409@kfi7: PUT: OK
00000100:00000001:13.0:1773851853.668961:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851853.668961:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851853.668962:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db78db23.
00000100:00000040:13.0:1773851853.668963:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000db78db23 x1859598963422080 msgsize 224
00000100:00100000:13.0:1773851853.668965:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-17409@kfi7 (source: 12345-17409@kfi7)
00000100:00000001:13.0:1773851853.668967:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851853.668968:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000800:00000200:13.0:1773851853.668970:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851853.668973:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851853.668974:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851853.668975:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851853.668976:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851853.668977:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851853.668977:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598963422080
00000020:00000001:13.0:1773851853.668978:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851853.668979:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d820d9
00000020:00000001:13.0:1773851853.668979:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851853.668982:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a1f78026 refcount=5
00000020:00000001:13.0:1773851853.668983:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113785078784 : -106959924472832 : ffff9eb873b25400)
00000020:00000001:13.0:1773851853.668984:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113785078784 : -106959924472832 : ffff9eb873b25400)
00000100:00000001:13.0:1773851853.668985:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851853.668986:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851853.668987:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851853.668988:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851853.668989:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851853.668991:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851853.668991:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851853.668992:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851853.668993:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851853.668994:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851853.668994:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.668995:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851853.668997:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851853.668997:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851853.668998:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851853.668998:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851853.668999:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17409@kfi7, seq: 2289767
00000100:00000001:14.0:1773851853.669000:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851853.669000:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a1f78026 : new rpc_count 1
00000100:00000001:14.0:1773851853.669001:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.669001:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197394176 : -106942512157440 : ffff9ebc818d2d00)
00000100:00000040:13.0:1773851853.669002:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000db78db23 x1859598963422080/t0(0) o400->08eaedb1-39c4-4c0e-8c8f-1e772e114f26@17409@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1587-0'
00000100:00000001:13.0:1773851853.669006:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851853.669007:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851853.669008:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db78db23 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:08eaedb1-39c4-4c0e-8c8f-1e772e114f26+5:39585:x1859598963422080:12345-17409@kfi7:400:default-tuolumne1587-0
00000100:00000200:13.0:1773851853.669010:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598963422080
00000020:00000001:13.0:1773851853.669012:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851853.669013:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851853.669014:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.669015:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851853.669016:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851853.669018:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851853.669019:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598963422080, found 0 last_xid 1859598963422079
00000020:00000001:13.0:1773851853.669020:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851853.669022:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851853.669023:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851853.669024:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.669025:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851853.669026:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851853.669027:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851853.669028:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006643e087.
02000000:00000001:13.0:1773851853.669029:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.669030:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.669032:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851853.669033:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104889088, transno 0, xid 1859598963422080
00010000:00000001:13.0:1773851853.669035:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851853.669036:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000db78db23 x1859598963422080/t0(0) o400->08eaedb1-39c4-4c0e-8c8f-1e772e114f26@17409@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1587-0'
00010000:00000001:13.0:1773851853.669041:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851853.669042:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851853.669043:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=86 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851853.669046:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851853.669047:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000e21193e refcount 3 to 17409@kfi7
00000100:00000001:13.0:1773851853.669048:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642468512 : -107157067083104 : ffff9e8a8d14d2a0)
02000000:00000001:13.0:1773851853.669050:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851853.669051:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.669052:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851853.669053:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17409@kfi7
00000400:00000010:13.0:1773851853.669055:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000734400bf.
00000100:00000200:13.0:1773851853.669056:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598963422080, offset 224
00000400:00000200:13.0:1773851853.669059:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17409@kfi7
00000400:00000200:13.0:1773851853.669061:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.669062:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 1
00000400:00000200:13.0:1773851853.669064:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000400:00000200:13.0:1773851853.669066:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 3
00000400:00000200:13.0:1773851853.669069:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17409@kfi7 local destination
00000400:00000200:13.0:1773851853.669071:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768576:8768576:1024:4294967295] 17409@kfi7 LPNI seq info [13528357:13528357:16:4294967295]
00000400:00000200:13.0:1773851853.669074:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000400:00000200:13.0:1773851853.669076:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.669080:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17409@kfi7(17409@kfi7:17409@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851853.669082:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 3
00000800:00000200:13.0:1773851853.669084:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851853.669086:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851853.669090:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851853.669095:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000009a5 Using peer 17409@kfi7(0x1000000000009a5)
00000800:00000200:13.0:1773851853.669101:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 324 bytes to peer 0x1000000000009a5: rc=0
00000800:00000200:13.0:1773851853.669104:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000009a5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851853.669107:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851853.669109:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000e21193e refcount 2 to 17409@kfi7
00010000:00000001:13.0:1773851853.669110:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851853.669111:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.669112:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851853.669114:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db78db23 x1859598963422080/t0(0) o400->08eaedb1-39c4-4c0e-8c8f-1e772e114f26@17409@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1587-0'
00000800:00000200:14.0:1773851853.669120:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000009a5 TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851853.669120:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db78db23 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:08eaedb1-39c4-4c0e-8c8f-1e772e114f26+5:39585:x1859598963422080:12345-17409@kfi7:400:default-tuolumne1587-0 Request processed in 112us (155us total) trans 0 rc 0/0
00000400:00000200:14.0:1773851853.669124:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851853.669126:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17409@kfi7: PUT: OK
00000400:00000200:14.0:1773851853.669128:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000734400bf
00000100:00100000:13.0:1773851853.669128:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17409@kfi7, seq: 2289767
00000400:00000010:14.0:1773851853.669129:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000734400bf.
00000100:00000040:13.0:1773851853.669129:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a1f78026 : new rpc_count 0
00000100:00000001:14.0:1773851853.669131:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851853.669131:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851853.669132:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:13.0:1773851853.669132:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851853.669133:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851853.669134:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000020:00000010:13.0:1773851853.669134:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000020:00000010:13.0:1773851853.669136:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000800:00000200:14.0:1773851853.669137:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17409@kfi7(00000000638f19f9):0x0 lsk 2470 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000009a5 Transaction freed
00000020:00000040:13.0:1773851853.669137:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000a1f78026 : new refcount 4
00000100:00000001:13.0:1773851853.669138:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851853.705732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851853.705733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:22.0:1773851853.737316:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851853.737316:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851853.737318:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851853.737318:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851853.737320:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851853.737320:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851853.737323:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10608@kfi7(00000000a605ffec):0xe5d version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851853.737324:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851853.737326:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d Using peer 10608@kfi7(0xe5d)
00000400:00000200:22.0:1773851853.737327:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10608@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.737329:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10608@kfi7 to cpt 5
00000400:00000200:22.0:1773851853.737330:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10608@kfi7 : PUT - for me
00000400:00000200:22.0:1773851853.737332:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10608@kfi7 to cpt 5
00000800:00000200:21.0:1773851853.737332:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000008c4261a5: Posted send of 38 bytes to peer 0xe5d: rc=0
00000400:00000200:22.0:1773851853.737333:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053a3dd74 nid 10608@kfi7 refs 1
00000400:00000200:22.0:1773851853.737335:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10608@kfi7 to cpt 5
00000800:00000200:21.0:1773851853.737335:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851853.737336:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053a3dd74 nid 10608@kfi7 refs 2
00000400:00000200:22.0:1773851853.737338:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000053a3dd74 nid 10608@kfi7 refs 3
00000400:00000200:22.0:1773851853.737339:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10672@kfi7 to cpt 0
00000400:00000200:22.0:1773851853.737342:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10672@kfi7 of length 456 into portal 12 MB=0x69b4b600b1080
00000400:00000200:22.0:1773851853.737345:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10672@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 23584
00000800:00000200:22.0:1773851853.737348:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851853.737348:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851853.737351:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851853.737352:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d Transaction freed
00000400:00000200:22.0:1773851853.737353:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10608@kfi7: PUT: OK
00000100:00000001:22.0:1773851853.737355:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851853.737356:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851853.737358:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d37858e2.
00000100:00000040:22.0:1773851853.737359:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000d37858e2 x1859597896454272 msgsize 456
00000100:00100000:22.0:1773851853.737362:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-10672@kfi7 (source: 12345-10608@kfi7)
00000100:00000001:22.0:1773851853.737364:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851853.737366:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000053a3dd74 nid 10608@kfi7 refs 2
00000100:00000001:23.0:1773851853.737367:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851853.737368:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851853.737368:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851853.737369:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851853.737369:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851853.737370:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851853.737372:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597896454272
00000020:00000001:23.0:1773851853.737373:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851853.737373:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7822c
00000020:00000001:23.0:1773851853.737374:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851853.737379:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000058608a40 refcount=5
00000020:00000001:23.0:1773851853.737380:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107444595712 : -106966264955904 : ffff9eb6f9c63c00)
00000020:00000001:23.0:1773851853.737381:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107444595712 : -106966264955904 : ffff9eb6f9c63c00)
00000100:00000001:23.0:1773851853.737383:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851853.737385:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851853.737386:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000054a79f9a.
00000020:00000010:23.0:1773851853.737387:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851853.737389:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851853.737390:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851853.737391:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851853.737393:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.737394:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.737396:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851853.737398:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851853.737398:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851853.737399:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851853.737399:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851853.737401:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10672@kfi7, seq: 335333142
00000100:00000040:23.0:1773851853.737402:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000058608a40 : new rpc_count 1
00000100:00000001:22.0:1773851853.737402:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.737403:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619624320 : -107003089927296 : ffff9eae66d5c380)
00000100:00000001:22.0:1773851853.737403:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851853.737405:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d37858e2 x1859597896454272/t0(0) o17->319b87fd-c5ae-43fe-8b0e-22a41df1b80d@10672@kfi7:493/0 lens 456/0 e 0 to 0 dl 1773852608 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1150-0'
00000100:00000001:23.0:1773851853.737410:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851853.737411:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851853.737413:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d37858e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:319b87fd-c5ae-43fe-8b0e-22a41df1b80d+5:39507:x1859597896454272:12345-10672@kfi7:17:default-tuolumne1150-0
00000100:00000200:23.0:1773851853.737415:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597896454272
00000020:00000001:23.0:1773851853.737416:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851853.737417:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851853.737418:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.737420:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851853.737420:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:23.0:1773851853.737422:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851853.737423:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597896454272, found 0 last_xid 1859597896454271
00000020:00000001:23.0:1773851853.737424:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851853.737425:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851853.737426:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851853.737427:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851853.737428:0:61145:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:23.0:1773851853.737430:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851853.737431:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851853.737433:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000071edad8.
02000000:00000001:23.0:1773851853.737434:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.737435:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.737437:0:61145:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:23.0:1773851853.737438:0:61145:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:23.0:1773851853.737440:0:61145:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:23.0:1773851853.737443:0:61145:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.737444:0:61145:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:23.0:1773851853.737446:0:61145:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 319b87fd-c5ae-43fe-8b0e-22a41df1b80d/0000000058608a40 free: 126633370845184 avail: 126633368748032
00000020:00000001:23.0:1773851853.737448:0:61145:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:23.0:1773851853.737449:0:61145:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 319b87fd-c5ae-43fe-8b0e-22a41df1b80d/0000000058608a40 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:23.0:1773851853.737451:0:61145:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:23.0:1773851853.737453:0:61145:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:23.0:1773851853.737454:0:61145:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 319b87fd-c5ae-43fe-8b0e-22a41df1b80d/0000000058608a40 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:23.0:1773851853.737456:0:61145:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:23.0:1773851853.737457:0:61145:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:23.0:1773851853.737458:0:61145:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851853.737459:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182904623213, transno 0, xid 1859597896454272
00010000:00000001:23.0:1773851853.737460:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851853.737461:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d37858e2 x1859597896454272/t0(0) o17->319b87fd-c5ae-43fe-8b0e-22a41df1b80d@10672@kfi7:493/0 lens 456/432 e 0 to 0 dl 1773852608 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1150-0'
00010000:00000001:23.0:1773851853.737466:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851853.737467:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851853.737468:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=86 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851853.737470:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851853.737471:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d1551e6 refcount 3 to 10672@kfi7
00000100:00000001:23.0:1773851853.737472:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049952 : -107154804501664 : ffff9e8b13f11360)
02000000:00000001:23.0:1773851853.737473:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851853.737474:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.737475:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851853.737476:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10608@kfi7
00000400:00000010:23.0:1773851853.737477:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc3746cb.
00000100:00000200:23.0:1773851853.737478:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859597896454272, offset 224
00000400:00000200:23.0:1773851853.737481:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10608@kfi7
00000400:00000200:23.0:1773851853.737482:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10608@kfi7 to cpt 5
00000400:00000200:23.0:1773851853.737483:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053a3dd74 nid 10608@kfi7 refs 1
00000400:00000200:23.0:1773851853.737485:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000053a3dd74 nid 10608@kfi7 refs 2
00000400:00000200:23.0:1773851853.737488:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000053a3dd74 nid 10608@kfi7 refs 3
00000400:00000200:23.0:1773851853.737490:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10608@kfi7 local destination
00000400:00000200:23.0:1773851853.737493:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768577:8768577:1024:4294967295] 10608@kfi7 LPNI seq info [176911:176911:16:4294967295]
00000400:00000200:23.0:1773851853.737495:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000053a3dd74 nid 10608@kfi7 refs 2
00000400:00000200:23.0:1773851853.737497:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10608@kfi7 to cpt 5
00000400:00000200:23.0:1773851853.737500:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10608@kfi7(10608@kfi7:10608@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851853.737502:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000053a3dd74 nid 10608@kfi7 refs 3
00000800:00000200:23.0:1773851853.737504:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851853.737506:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:23.0:1773851853.737510:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851853.737514:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d Using peer 10608@kfi7(0xe5d)
00000800:00000200:23.0:1773851853.737518:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 532 bytes to peer 0xe5d: rc=0
00000800:00000200:23.0:1773851853.737520:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851853.737524:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851853.737525:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d1551e6 refcount 2 to 10672@kfi7
00010000:00000001:23.0:1773851853.737526:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851853.737527:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.737528:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851853.737529:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d37858e2 x1859597896454272/t0(0) o17->319b87fd-c5ae-43fe-8b0e-22a41df1b80d@10672@kfi7:493/0 lens 456/432 e 0 to 0 dl 1773852608 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1150-0'
00000800:00000200:21.0:1773851853.737533:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851853.737535:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d37858e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:319b87fd-c5ae-43fe-8b0e-22a41df1b80d+5:39507:x1859597896454272:12345-10672@kfi7:17:default-tuolumne1150-0 Request processed in 123us (174us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851853.737536:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851853.737538:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10608@kfi7: PUT: OK
00000100:00100000:23.0:1773851853.737539:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10672@kfi7, seq: 335333142
00000400:00000200:21.0:1773851853.737539:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc3746cb
00000100:00000040:23.0:1773851853.737540:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000058608a40 : new rpc_count 0
00000400:00000010:21.0:1773851853.737540:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc3746cb.
00000100:00000001:23.0:1773851853.737541:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851853.737542:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:21.0:1773851853.737542:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851853.737542:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851853.737543:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851853.737544:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000053a3dd74 nid 10608@kfi7 refs 2
00000020:00000010:23.0:1773851853.737545:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:23.0:1773851853.737546:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000054a79f9a.
00000800:00000200:21.0:1773851853.737546:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10608@kfi7(00000000a605ffec):0x0 lsk 3678 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe5d Transaction freed
00000020:00000040:23.0:1773851853.737547:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000058608a40 : new refcount 4
00000100:00000001:23.0:1773851853.737548:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851853.791605:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851853.791607:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851853.791608:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851853.791610:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851853.791624:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.791625:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25089@kfi7 : PUT - for me
00000400:00000200:29.0:1773851853.791626:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000800:00000200:1.0:1773851853.791626:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851853.791627:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.791627:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:29.0:1773851853.791628:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 1
00000800:00000200:1.0:1773851853.791628:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:3.0:1773851853.791629:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851853.791630:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000400:00000200:29.0:1773851853.791630:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000400:00000200:29.0:1773851853.791631:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 3
00000800:00000200:3.0:1773851853.791631:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851853.791631:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 24579@kfi7(000000001a4ee67b):0xdcd version: 2; local version 2; negotiated version: 2
00000800:00000200:1.0:1773851853.791632:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd Using peer 24579@kfi7(0x100000000000dcd)
00000400:00000200:29.0:1773851853.791633:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25281@kfi7 to cpt 1
00000400:00000200:29.0:1773851853.791634:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25281@kfi7 of length 224 into portal 12 MB=0x69b4b94ba6780
00000800:00000200:3.0:1773851853.791634:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851853.791635:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25281@kfi7 of length 224/224 into md 0x77fe139dd [64] + 160456
00000400:00000200:1.0:1773851853.791635:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24579@kfi7 to cpt 0
00000800:00000200:29.0:1773851853.791637:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851853.791637:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24579@kfi7 to cpt 0
00000800:00000200:1.0:1773851853.791637:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 38 bytes to peer 0x100000000000dcd: rc=0
00000400:00000200:29.0:1773851853.791639:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851853.791639:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24579@kfi7 : PUT - for me
00000800:00000200:1.0:1773851853.791639:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851853.791640:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25089@kfi7: PUT: OK
00000100:00000001:29.0:1773851853.791641:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851853.791641:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851853.791642:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fb2f43fd.
00000400:00000200:3.0:1773851853.791642:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24579@kfi7 to cpt 0
00000100:00000040:29.0:1773851853.791643:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000fb2f43fd x1859598780360576 msgsize 224
00000400:00000200:3.0:1773851853.791643:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007d04346 nid 24579@kfi7 refs 1
00000100:00100000:29.0:1773851853.791646:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25281@kfi7 (source: 12345-25089@kfi7)
00000400:00000200:3.0:1773851853.791646:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24579@kfi7 to cpt 0
00000100:00000001:29.0:1773851853.791647:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851853.791647:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007d04346 nid 24579@kfi7 refs 2
00000400:00000200:29.0:1773851853.791648:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000400:00000200:3.0:1773851853.791648:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007d04346 nid 24579@kfi7 refs 3
00000100:00000001:31.0:1773851853.791649:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851853.791649:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851853.791650:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:3.0:1773851853.791650:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24578@kfi7 to cpt 5
00000800:00000200:1.0:1773851853.791650:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851853.791651:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851853.791651:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851853.791652:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:3.0:1773851853.791652:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24578@kfi7 of length 456 into portal 12 MB=0x69b4c3aecd700
00000100:00100000:31.0:1773851853.791653:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598780360576
00000020:00000001:31.0:1773851853.791653:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:1.0:1773851853.791653:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd Transaction freed
00000020:00000040:31.0:1773851853.791654:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389340d5
00000020:00000001:31.0:1773851853.791654:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:3.0:1773851853.791654:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24578@kfi7 of length 456/456 into md 0x7fb56e801 [64] + 11312
00000020:00000040:31.0:1773851853.791656:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000052a470cc refcount=5
00000020:00000001:31.0:1773851853.791657:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165090483200 : -106908619068416 : ffff9ec465bcac00)
00000800:00000200:3.0:1773851853.791657:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:31.0:1773851853.791658:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165090483200 : -106908619068416 : ffff9ec465bcac00)
00000100:00000001:31.0:1773851853.791659:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.791660:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851853.791660:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f353d06.
00000400:00000200:3.0:1773851853.791660:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851853.791661:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000400:00000200:3.0:1773851853.791661:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24579@kfi7: PUT: OK
00000020:00000010:31.0:1773851853.791662:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851853.791663:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851853.791663:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:3.0:1773851853.791663:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:31.0:1773851853.791664:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:3.0:1773851853.791664:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000001:31.0:1773851853.791665:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851853.791665:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851853.791665:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:3.0:1773851853.791665:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a3f97c1.
00000100:00000001:31.0:1773851853.791666:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:3.0:1773851853.791666:0:2506738:0:(events.c:358:request_in_callback()) incoming req@000000008a3f97c1 x1859601568683776 msgsize 456
00000100:00000001:31.0:1773851853.791667:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.791668:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851853.791668:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851853.791668:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:3.0:1773851853.791668:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-24578@kfi7 (source: 12345-24579@kfi7)
00000100:00100000:31.0:1773851853.791669:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25281@kfi7, seq: 2055456
00000100:00000040:31.0:1773851853.791669:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000052a470cc : new rpc_count 1
00000100:00000001:31.0:1773851853.791670:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111224849792 : -106962484701824 : ffff9eb7db185580)
00000100:00000001:29.0:1773851853.791670:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851853.791670:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851853.791670:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000040:31.0:1773851853.791671:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fb2f43fd x1859598780360576/t0(0) o400->e4557c0a-c316-4306-b114-a8521041acdb@25281@kfi7:641/0 lens 224/0 e 0 to 0 dl 1773852001 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2067-0'
00000400:00000200:3.0:1773851853.791671:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007d04346 nid 24579@kfi7 refs 2
00000100:00000001:0.0:1773851853.791671:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851853.791672:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851853.791672:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851853.791673:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.791674:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.791674:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:3.0:1773851853.791674:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851853.791674:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.791674:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601568683776
00000100:00100000:31.0:1773851853.791675:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb2f43fd pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e4557c0a-c316-4306-b114-a8521041acdb+5:39567:x1859598780360576:12345-25281@kfi7:400:default-tuolumne2067-0
00000020:00000001:0.0:1773851853.791675:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851853.791675:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff81c19
00000100:00000200:31.0:1773851853.791676:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598780360576
00000020:00000001:0.0:1773851853.791676:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:31.0:1773851853.791677:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851853.791678:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851853.791679:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.791680:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851853.791680:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851853.791681:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851853.791682:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598780360576, found 0 last_xid 1859598780360575
00000020:00000001:31.0:1773851853.791682:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:0.0:1773851853.791682:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b07469aa refcount=5
00000020:00000001:0.0:1773851853.791682:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111503885312 : -106962205666304 : ffff9eb7ebba1400)
00000020:00000001:31.0:1773851853.791683:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.791683:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111503885312 : -106962205666304 : ffff9eb7ebba1400)
00000020:00000001:31.0:1773851853.791684:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851853.791684:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.791684:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.791684:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:31.0:1773851853.791685:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851853.791685:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000020:00000010:0.0:1773851853.791685:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
02000000:00000001:31.0:1773851853.791686:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000010:0.0:1773851853.791686:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
02000000:00000010:31.0:1773851853.791687:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004c041e40.
02000000:00000001:31.0:1773851853.791687:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:0.0:1773851853.791687:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:31.0:1773851853.791688:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.791688:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851853.791688:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:31.0:1773851853.791689:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851853.791689:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181761069426, transno 0, xid 1859598780360576
00000100:00000001:0.0:1773851853.791689:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851853.791690:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000100:00000001:0.0:1773851853.791690:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00010000:00000200:31.0:1773851853.791691:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fb2f43fd x1859598780360576/t0(0) o400->e4557c0a-c316-4306-b114-a8521041acdb@25281@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2067-0'
00000100:00000001:0.0:1773851853.791691:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.791692:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00010000:00000001:31.0:1773851853.791693:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851853.791693:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.791693:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00001000:31.0:1773851853.791694:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=86 v=115 (1 1 1 115)
00000100:00100000:0.0:1773851853.791694:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24578@kfi7, seq: 408701475
00000100:00000001:31.0:1773851853.791695:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000001:2.0:1773851853.791695:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851853.791695:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851853.791695:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b07469aa : new rpc_count 1
00000100:00000001:0.0:1773851853.791695:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288710528 : -106964420841088 : ffff9eb767b13180)
00000100:00000040:31.0:1773851853.791696:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a0d6227 refcount 3 to 25281@kfi7
00000100:00000001:2.0:1773851853.791696:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.791697:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232979424 : -107130476572192 : ffff9e90bdffd1e0)
02000000:00000001:31.0:1773851853.791697:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000040:0.0:1773851853.791697:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a3f97c1 x1859601568683776/t0(0) o17->f740de4c-b891-45a8-9fc0-104b4b0bae76@24578@kfi7:580/0 lens 456/0 e 0 to 0 dl 1773851940 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2039-0'
02000000:00000001:31.0:1773851853.791698:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.791698:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.791699:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:0.0:1773851853.791699:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.791699:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000040:31.0:1773851853.791700:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25089@kfi7
00000400:00000010:31.0:1773851853.791700:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa0db5be.
00000100:00100000:0.0:1773851853.791700:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a3f97c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f740de4c-b891-45a8-9fc0-104b4b0bae76+5:39491:x1859601568683776:12345-24578@kfi7:17:default-tuolumne2039-0
00000100:00000200:31.0:1773851853.791701:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598780360576, offset 224
00000100:00000200:0.0:1773851853.791701:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601568683776
00000400:00000200:31.0:1773851853.791702:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25089@kfi7
00000020:00000001:0.0:1773851853.791702:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851853.791702:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:31.0:1773851853.791703:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000020:00000001:0.0:1773851853.791703:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851853.791704:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 1
00000020:00000001:0.0:1773851853.791704:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851853.791704:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000400:00000200:31.0:1773851853.791705:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000020:00000001:0.0:1773851853.791705:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851853.791705:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601568683776, found 0 last_xid 1859601568683775
00000400:00000200:31.0:1773851853.791706:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 3
00000020:00000001:0.0:1773851853.791706:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851853.791707:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25089@kfi7 local destination
00000020:00000001:0.0:1773851853.791707:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.791707:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851853.791708:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851853.791708:0:60951:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000400:00000200:31.0:1773851853.791709:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768578:8768578:1024:4294967295] 25089@kfi7 LPNI seq info [4081019:4081019:16:4294967295]
00000100:00000001:0.0:1773851853.791709:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:31.0:1773851853.791710:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
02000000:00000001:0.0:1773851853.791710:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:31.0:1773851853.791711:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
02000000:00000010:0.0:1773851853.791711:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000205e9d32.
02000000:00000001:0.0:1773851853.791711:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851853.791712:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25089@kfi7(25089@kfi7:25089@kfi7) <?> : PUT try# 0
00000100:00000001:0.0:1773851853.791712:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.791713:0:60951:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000400:00000200:31.0:1773851853.791714:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 3
00000020:00000001:0.0:1773851853.791714:0:60951:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000800:00000200:31.0:1773851853.791715:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00080000:00000001:0.0:1773851853.791715:0:60951:0:(osd_handler.c:559:osd_statfs()) Process entered
00000800:00000200:31.0:1773851853.791716:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00080000:00000001:0.0:1773851853.791717:0:60951:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851853.791718:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000020:00000001:0.0:1773851853.791718:0:60951:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:0.0:1773851853.791719:0:60951:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli f740de4c-b891-45a8-9fc0-104b4b0bae76/00000000b07469aa free: 126633370845184 avail: 126633368748032
00000800:00000200:31.0:1773851853.791720:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006d1 Using peer 25089@kfi7(0x1000000000006d1)
00000020:00000001:0.0:1773851853.791720:0:60951:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:0.0:1773851853.791720:0:60951:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli f740de4c-b891-45a8-9fc0-104b4b0bae76/00000000b07469aa avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:0.0:1773851853.791722:0:60951:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000800:00000200:31.0:1773851853.791723:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x1000000000006d1: rc=0
00000020:00000001:0.0:1773851853.791723:0:60951:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:0.0:1773851853.791723:0:60951:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli f740de4c-b891-45a8-9fc0-104b4b0bae76/00000000b07469aa reports grant 328466432 dropped 0, local 396623872
00000020:00000001:0.0:1773851853.791728:0:60951:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000800:00000200:31.0:1773851853.791729:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000020:00000001:0.0:1773851853.791729:0:60951:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:0.0:1773851853.791729:0:60951:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851853.791730:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046795510, transno 0, xid 1859601568683776
00000100:00000001:31.0:1773851853.791731:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.791731:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a0d6227 refcount 2 to 25281@kfi7
00010000:00000001:0.0:1773851853.791731:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000001:31.0:1773851853.791732:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00010000:00000200:0.0:1773851853.791732:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008a3f97c1 x1859601568683776/t0(0) o17->f740de4c-b891-45a8-9fc0-104b4b0bae76@24578@kfi7:580/0 lens 456/432 e 0 to 0 dl 1773851940 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2039-0'
00000020:00000001:31.0:1773851853.791733:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.791733:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851853.791734:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fb2f43fd x1859598780360576/t0(0) o400->e4557c0a-c316-4306-b114-a8521041acdb@25281@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2067-0'
00010000:00000001:0.0:1773851853.791734:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851853.791734:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851853.791735:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851853.791736:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00100000:31.0:1773851853.791737:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb2f43fd pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e4557c0a-c316-4306-b114-a8521041acdb+5:39567:x1859598780360576:12345-25281@kfi7:400:default-tuolumne2067-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00000040:0.0:1773851853.791737:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003f09ac3a refcount 3 to 24578@kfi7
00000100:00000001:0.0:1773851853.791737:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402093440 : -107139307458176 : ffff9e8eafa33180)
00000800:00000200:30.0:1773851853.791738:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006d1 TN_EVENT_TX_OK event status 0
02000000:00000001:0.0:1773851853.791738:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851853.791738:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.791739:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851853.791740:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:0.0:1773851853.791740:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24579@kfi7
00000400:00000010:0.0:1773851853.791740:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071d311d2.
00000400:00000200:30.0:1773851853.791741:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25089@kfi7: PUT: OK
00000400:00000200:30.0:1773851853.791741:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa0db5be
00000100:00000200:0.0:1773851853.791741:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859601568683776, offset 224
00000100:00100000:31.0:1773851853.791742:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25281@kfi7, seq: 2055456
00000100:00000040:31.0:1773851853.791742:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000052a470cc : new rpc_count 0
00000400:00000010:30.0:1773851853.791742:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa0db5be.
00000100:00000001:31.0:1773851853.791743:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851853.791743:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851853.791743:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:0.0:1773851853.791743:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24579@kfi7
00000100:00000001:31.0:1773851853.791744:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:30.0:1773851853.791744:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000400:00000200:0.0:1773851853.791744:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24579@kfi7 to cpt 0
00000020:00000010:31.0:1773851853.791745:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.791745:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:0.0:1773851853.791745:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007d04346 nid 24579@kfi7 refs 1
00000800:00000200:30.0:1773851853.791746:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25089@kfi7(00000000f506326d):0x0 lsk 1746 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006d1 Transaction freed
00000400:00000200:0.0:1773851853.791746:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007d04346 nid 24579@kfi7 refs 2
00000020:00000010:31.0:1773851853.791747:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f353d06.
00000020:00000040:31.0:1773851853.791747:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000052a470cc : new refcount 4
00000400:00000200:0.0:1773851853.791747:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007d04346 nid 24579@kfi7 refs 3
00000100:00000001:31.0:1773851853.791748:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:0.0:1773851853.791748:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24579@kfi7 local destination
00000400:00000200:0.0:1773851853.791749:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768579:8768579:1024:4294967295] 24579@kfi7 LPNI seq info [446123:446123:16:4294967295]
00000400:00000200:0.0:1773851853.791751:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007d04346 nid 24579@kfi7 refs 2
00000400:00000200:0.0:1773851853.791751:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24579@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.791754:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24579@kfi7(24579@kfi7:24579@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851853.791755:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007d04346 nid 24579@kfi7 refs 3
00000800:00000200:0.0:1773851853.791756:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851853.791757:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:0.0:1773851853.791759:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851853.791761:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd Using peer 24579@kfi7(0x100000000000dcd)
00000800:00000200:0.0:1773851853.791764:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 532 bytes to peer 0x100000000000dcd: rc=0
00000800:00000200:0.0:1773851853.791766:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851853.791768:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.791768:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003f09ac3a refcount 2 to 24578@kfi7
00010000:00000001:0.0:1773851853.791769:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851853.791769:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.791770:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851853.791771:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a3f97c1 x1859601568683776/t0(0) o17->f740de4c-b891-45a8-9fc0-104b4b0bae76@24578@kfi7:580/0 lens 456/432 e 0 to 0 dl 1773851940 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2039-0'
00000100:00100000:0.0:1773851853.791775:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a3f97c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f740de4c-b891-45a8-9fc0-104b4b0bae76+5:39491:x1859601568683776:12345-24578@kfi7:17:default-tuolumne2039-0 Request processed in 75us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851853.791777:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24578@kfi7, seq: 408701475
00000100:00000040:0.0:1773851853.791778:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b07469aa : new rpc_count 0
00000100:00000001:0.0:1773851853.791779:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851853.791779:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851853.791780:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.791781:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851853.791782:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851853.791782:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000b07469aa : new refcount 4
00000100:00000001:0.0:1773851853.791783:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851853.791789:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851853.791790:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.791791:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24579@kfi7: PUT: OK
00000400:00000200:1.0:1773851853.791792:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071d311d2
00000400:00000010:1.0:1773851853.791793:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071d311d2.
00000100:00000001:1.0:1773851853.791794:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851853.791794:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851853.791795:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007d04346 nid 24579@kfi7 refs 2
00000800:00000200:1.0:1773851853.791797:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 24579@kfi7(000000001a4ee67b):0x0 lsk 3534 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000dcd Transaction freed
00000800:00000200:13.0:1773851853.806919:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851853.806920:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851853.806920:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:15.0:1773851853.806922:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851853.806922:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851853.806923:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17155@kfi7(00000000335d14aa):0x846 version: 2; local version 2; negotiated version: 2
00000800:00000200:15.0:1773851853.806924:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851853.806925:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 Using peer 17155@kfi7(0x846)
00000400:00000200:13.0:1773851853.806927:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17155@kfi7 to cpt 3
00000800:00000200:15.0:1773851853.806928:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851853.806929:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 38 bytes to peer 0x846: rc=0
00000400:00000200:15.0:1773851853.806931:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17155@kfi7 to cpt 3
00000800:00000200:13.0:1773851853.806931:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:15.0:1773851853.806934:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17155@kfi7 : PUT - for me
00000400:00000200:15.0:1773851853.806936:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17155@kfi7 to cpt 3
00000400:00000200:15.0:1773851853.806938:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000219b77d1 nid 17155@kfi7 refs 1
00000400:00000200:15.0:1773851853.806940:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17155@kfi7 to cpt 3
00000400:00000200:15.0:1773851853.806941:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000219b77d1 nid 17155@kfi7 refs 2
00000400:00000200:15.0:1773851853.806942:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000219b77d1 nid 17155@kfi7 refs 3
00000800:00000200:13.0:1773851853.806943:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 TN_EVENT_TX_OK event status 0
00000400:00000200:15.0:1773851853.806944:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17155@kfi7 to cpt 3
00000400:00000200:15.0:1773851853.806945:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17155@kfi7 of length 456 into portal 12 MB=0x69b4b6d408480
00000800:00000200:13.0:1773851853.806945:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 Transaction freed
00000400:00000200:15.0:1773851853.806948:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17155@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 12552
00000800:00000200:15.0:1773851853.806952:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851853.806955:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851853.806957:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17155@kfi7: PUT: OK
00000100:00000001:15.0:1773851853.806959:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851853.806960:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851853.806961:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f0f080b.
00000100:00000040:15.0:1773851853.806962:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000002f0f080b x1859598118061184 msgsize 456
00000100:00100000:15.0:1773851853.806965:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-17155@kfi7 (source: 12345-17155@kfi7)
00000100:00000001:15.0:1773851853.806967:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851853.806968:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000219b77d1 nid 17155@kfi7 refs 2
00000100:00000001:13.0:1773851853.806968:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851853.806969:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851853.806969:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851853.806969:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851853.806970:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851853.806971:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00100000:13.0:1773851853.806971:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598118061184
00000020:00000001:13.0:1773851853.806971:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851853.806973:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8297d
00000020:00000001:13.0:1773851853.806974:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851853.806978:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002023aa85 refcount=5
00000020:00000001:13.0:1773851853.806978:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157028236288 : -106916681315328 : ffff9ec285308c00)
00000020:00000001:13.0:1773851853.806979:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157028236288 : -106916681315328 : ffff9ec285308c00)
00000100:00000001:13.0:1773851853.806980:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851853.806980:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851853.806981:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851853.806982:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851853.806983:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851853.806984:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851853.806984:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851853.806984:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.806986:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.806986:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851853.806988:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851853.806988:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851853.806989:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:13.0:1773851853.806989:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17155@kfi7, seq: 411190544
00000100:00000001:14.0:1773851853.806990:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:13.0:1773851853.806990:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002023aa85 : new rpc_count 1
00000100:00000001:14.0:1773851853.806991:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.806991:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860212608 : -107049849339008 : ffff9ea383c1c380)
00000100:00000001:14.0:1773851853.806992:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851853.806992:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f0f080b x1859598118061184/t0(0) o17->171d5198-106a-48b5-ab47-286a2d6b38d1@17155@kfi7:493/0 lens 456/0 e 0 to 0 dl 1773852608 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1575-0'
00000100:00000001:13.0:1773851853.806994:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851853.806994:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851853.806995:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f0f080b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:171d5198-106a-48b5-ab47-286a2d6b38d1+5:39784:x1859598118061184:12345-17155@kfi7:17:default-tuolumne1575-0
00000100:00000200:13.0:1773851853.806997:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598118061184
00000020:00000001:13.0:1773851853.806997:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851853.806998:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851853.806998:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.806999:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851853.806999:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:13.0:1773851853.807000:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851853.807001:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598118061184, found 0 last_xid 1859598118061183
00000020:00000001:13.0:1773851853.807002:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851853.807002:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851853.807003:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851853.807003:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:13.0:1773851853.807004:0:60487:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:13.0:1773851853.807005:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851853.807006:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851853.807007:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000005b655ae1.
02000000:00000001:13.0:1773851853.807007:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.807008:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.807009:0:60487:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:13.0:1773851853.807009:0:60487:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:13.0:1773851853.807010:0:60487:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:13.0:1773851853.807012:0:60487:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.807012:0:60487:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:13.0:1773851853.807013:0:60487:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 171d5198-106a-48b5-ab47-286a2d6b38d1/000000002023aa85 free: 126633370845184 avail: 126633368748032
00000020:00000001:13.0:1773851853.807015:0:60487:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:13.0:1773851853.807015:0:60487:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 171d5198-106a-48b5-ab47-286a2d6b38d1/000000002023aa85 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:13.0:1773851853.807017:0:60487:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:13.0:1773851853.807018:0:60487:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:13.0:1773851853.807018:0:60487:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 171d5198-106a-48b5-ab47-286a2d6b38d1/000000002023aa85 reports grant 1811152895 dropped 0, local 1879310335
00000020:00000001:13.0:1773851853.807019:0:60487:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:13.0:1773851853.807020:0:60487:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:13.0:1773851853.807020:0:60487:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851853.807021:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915823814, transno 0, xid 1859598118061184
00010000:00000001:13.0:1773851853.807022:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851853.807023:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f0f080b x1859598118061184/t0(0) o17->171d5198-106a-48b5-ab47-286a2d6b38d1@17155@kfi7:493/0 lens 456/432 e 0 to 0 dl 1773852608 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1575-0'
00010000:00000001:13.0:1773851853.807025:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851853.807025:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851853.807026:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=86 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851853.807027:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851853.807028:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3c25f8e refcount 3 to 17155@kfi7
00000100:00000001:13.0:1773851853.807028:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642470144 : -107157067081472 : ffff9e8a8d14d900)
02000000:00000001:13.0:1773851853.807029:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851853.807030:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.807030:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851853.807031:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17155@kfi7
00000400:00000010:13.0:1773851853.807032:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f58b105f.
00000100:00000200:13.0:1773851853.807032:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598118061184, offset 224
00000400:00000200:13.0:1773851853.807034:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17155@kfi7
00000400:00000200:13.0:1773851853.807034:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17155@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.807035:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000219b77d1 nid 17155@kfi7 refs 1
00000400:00000200:13.0:1773851853.807036:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000219b77d1 nid 17155@kfi7 refs 2
00000400:00000200:13.0:1773851853.807037:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000219b77d1 nid 17155@kfi7 refs 3
00000400:00000200:13.0:1773851853.807038:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17155@kfi7 local destination
00000400:00000200:13.0:1773851853.807040:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768580:8768580:1024:4294967295] 17155@kfi7 LPNI seq info [1065718:1065718:16:4294967295]
00000400:00000200:13.0:1773851853.807041:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000219b77d1 nid 17155@kfi7 refs 2
00000400:00000200:13.0:1773851853.807042:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17155@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.807044:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17155@kfi7(17155@kfi7:17155@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851853.807045:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000219b77d1 nid 17155@kfi7 refs 3
00000800:00000200:13.0:1773851853.807046:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851853.807047:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:13.0:1773851853.807049:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851853.807051:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 Using peer 17155@kfi7(0x846)
00000800:00000200:13.0:1773851853.807053:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 532 bytes to peer 0x846: rc=0
00000800:00000200:13.0:1773851853.807055:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851853.807056:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851853.807057:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3c25f8e refcount 2 to 17155@kfi7
00010000:00000001:13.0:1773851853.807058:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851853.807058:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.807059:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851853.807060:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f0f080b x1859598118061184/t0(0) o17->171d5198-106a-48b5-ab47-286a2d6b38d1@17155@kfi7:493/0 lens 456/432 e 0 to 0 dl 1773852608 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1575-0'
00000100:00100000:13.0:1773851853.807063:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f0f080b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:171d5198-106a-48b5-ab47-286a2d6b38d1+5:39784:x1859598118061184:12345-17155@kfi7:17:default-tuolumne1575-0 Request processed in 68us (100us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851853.807065:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17155@kfi7, seq: 411190544
00000100:00000040:13.0:1773851853.807066:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002023aa85 : new rpc_count 0
00000100:00000001:13.0:1773851853.807067:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:14.0:1773851853.807068:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851853.807068:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851853.807068:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851853.807069:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000020:00000010:13.0:1773851853.807070:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000400:00000200:14.0:1773851853.807071:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:13.0:1773851853.807071:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000002023aa85 : new refcount 4
00000100:00000001:13.0:1773851853.807071:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851853.807073:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17155@kfi7: PUT: OK
00000400:00000200:14.0:1773851853.807074:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f58b105f
00000400:00000010:14.0:1773851853.807075:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f58b105f.
00000100:00000001:14.0:1773851853.807077:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851853.807077:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851853.807079:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000219b77d1 nid 17155@kfi7 refs 2
00000800:00000200:14.0:1773851853.807081:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 17155@kfi7(00000000335d14aa):0x0 lsk 2119 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x846 Transaction freed
00000800:00000200:30.0:1773851853.854137:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851853.854138:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851853.854140:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851853.854142:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851853.854143:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14211@kfi7 to cpt 7
00000400:00000200:30.0:1773851853.854145:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14211@kfi7 : PUT - for me
00000400:00000200:30.0:1773851853.854145:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14211@kfi7 to cpt 7
00000400:00000200:30.0:1773851853.854146:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006823a97c nid 14211@kfi7 refs 1
00000400:00000200:30.0:1773851853.854148:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14211@kfi7 to cpt 7
00000400:00000200:30.0:1773851853.854148:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006823a97c nid 14211@kfi7 refs 2
00000400:00000200:30.0:1773851853.854149:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006823a97c nid 14211@kfi7 refs 3
00000400:00000200:30.0:1773851853.854150:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14147@kfi7 to cpt 3
00000400:00000200:30.0:1773851853.854152:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14147@kfi7 of length 224 into portal 12 MB=0x69b4babcb0740
00000400:00000200:30.0:1773851853.854153:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14147@kfi7 of length 224/224 into md 0x77fe139dd [64] + 160680
00000800:00000200:30.0:1773851853.854155:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851853.854156:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851853.854157:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14211@kfi7: PUT: OK
00000100:00000001:30.0:1773851853.854158:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851853.854159:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851853.854159:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000062c0ca66.
00000100:00000040:30.0:1773851853.854160:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000062c0ca66 x1859599167326016 msgsize 224
00000100:00100000:30.0:1773851853.854161:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-14147@kfi7 (source: 12345-14211@kfi7)
00000100:00000001:30.0:1773851853.854163:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851853.854163:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006823a97c nid 14211@kfi7 refs 2
00000100:00000001:31.0:1773851853.854164:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851853.854165:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851853.854165:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851853.854165:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851853.854166:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851853.854166:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851853.854167:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599167326016
00000020:00000001:31.0:1773851853.854168:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851853.854168:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f75e
00000020:00000001:31.0:1773851853.854169:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851853.854172:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007b2e53f0 refcount=5
00000020:00000001:31.0:1773851853.854173:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637043724886016 : -107029984665600 : ffff9ea823c8a000)
00000020:00000001:31.0:1773851853.854173:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637043724886016 : -107029984665600 : ffff9ea823c8a000)
00000100:00000001:31.0:1773851853.854174:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.854175:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851853.854176:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f353d06.
00000020:00000010:31.0:1773851853.854177:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.854178:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851853.854179:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851853.854179:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851853.854179:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851853.854180:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851853.854181:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851853.854181:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.854182:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851853.854184:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.854185:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851853.854185:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851853.854185:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851853.854186:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14147@kfi7, seq: 2055457
00000100:00000040:31.0:1773851853.854187:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007b2e53f0 : new rpc_count 1
00000100:00000001:29.0:1773851853.854187:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.854188:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000827904 : -107100708723712 : ffff9e97ac4d2400)
00000100:00000001:29.0:1773851853.854188:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.854189:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000062c0ca66 x1859599167326016/t0(0) o400->5813b2a1-2556-4d13-bf21-6edeac79c473@14147@kfi7:641/0 lens 224/0 e 0 to 0 dl 1773852001 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1384-0'
00000100:00000001:31.0:1773851853.854191:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851853.854192:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851853.854193:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062c0ca66 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5813b2a1-2556-4d13-bf21-6edeac79c473+5:39581:x1859599167326016:12345-14147@kfi7:400:default-tuolumne1384-0
00000100:00000200:31.0:1773851853.854194:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599167326016
00000020:00000001:31.0:1773851853.854194:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851853.854195:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851853.854196:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.854197:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851853.854197:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851853.854198:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851853.854198:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599167326016, found 0 last_xid 1859599167326015
00000020:00000001:31.0:1773851853.854199:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851853.854200:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851853.854200:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851853.854201:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.854201:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851853.854202:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851853.854202:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851853.854204:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e1288339.
02000000:00000001:31.0:1773851853.854204:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.854205:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.854205:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851853.854206:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096700065, transno 0, xid 1859599167326016
00010000:00000001:31.0:1773851853.854207:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851853.854208:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000062c0ca66 x1859599167326016/t0(0) o400->5813b2a1-2556-4d13-bf21-6edeac79c473@14147@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1384-0'
00010000:00000001:31.0:1773851853.854212:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851853.854213:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851853.854214:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=86 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851853.854215:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851853.854215:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000045ec067e refcount 3 to 14147@kfi7
00000100:00000001:31.0:1773851853.854216:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152800 : -107139310398816 : ffff9e8eaf7652a0)
02000000:00000001:31.0:1773851853.854217:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851853.854217:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851853.854218:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851853.854219:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14211@kfi7
00000400:00000010:31.0:1773851853.854219:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f9abbdbd.
00000100:00000200:31.0:1773851853.854220:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599167326016, offset 224
00000400:00000200:31.0:1773851853.854221:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14211@kfi7
00000400:00000200:31.0:1773851853.854222:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14211@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.854223:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006823a97c nid 14211@kfi7 refs 1
00000400:00000200:31.0:1773851853.854224:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006823a97c nid 14211@kfi7 refs 2
00000400:00000200:31.0:1773851853.854225:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006823a97c nid 14211@kfi7 refs 3
00000400:00000200:31.0:1773851853.854226:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14211@kfi7 local destination
00000400:00000200:31.0:1773851853.854227:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768581:8768581:1024:4294967295] 14211@kfi7 LPNI seq info [11367938:11367938:16:4294967295]
00000400:00000200:31.0:1773851853.854228:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006823a97c nid 14211@kfi7 refs 2
00000400:00000200:31.0:1773851853.854229:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14211@kfi7 to cpt 7
00000400:00000200:31.0:1773851853.854231:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14211@kfi7(14211@kfi7:14211@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851853.854232:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006823a97c nid 14211@kfi7 refs 3
00000800:00000200:31.0:1773851853.854233:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851853.854234:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851853.854236:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851853.854238:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdff Using peer 14211@kfi7(0xdff)
00000800:00000200:31.0:1773851853.854243:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0xdff: rc=0
00000800:00000200:31.0:1773851853.854245:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851853.854247:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851853.854247:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000045ec067e refcount 2 to 14147@kfi7
00010000:00000001:31.0:1773851853.854248:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851853.854248:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851853.854249:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851853.854250:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000062c0ca66 x1859599167326016/t0(0) o400->5813b2a1-2556-4d13-bf21-6edeac79c473@14147@kfi7:641/0 lens 224/224 e 0 to 0 dl 1773852001 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1384-0'
00000100:00100000:31.0:1773851853.854252:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062c0ca66 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5813b2a1-2556-4d13-bf21-6edeac79c473+5:39581:x1859599167326016:12345-14147@kfi7:400:default-tuolumne1384-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851853.854254:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14147@kfi7, seq: 2055457
00000100:00000040:31.0:1773851853.854255:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007b2e53f0 : new rpc_count 0
00000100:00000001:31.0:1773851853.854256:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851853.854256:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851853.854257:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851853.854257:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851853.854258:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f353d06.
00000800:00000200:29.0:1773851853.854258:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdff TN_EVENT_TX_OK event status 0
00000020:00000040:31.0:1773851853.854259:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000007b2e53f0 : new refcount 4
00000100:00000001:31.0:1773851853.854259:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851853.854260:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851853.854260:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14211@kfi7: PUT: OK
00000400:00000200:29.0:1773851853.854261:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f9abbdbd
00000400:00000010:29.0:1773851853.854262:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f9abbdbd.
00000100:00000001:29.0:1773851853.854262:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851853.854263:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851853.854264:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006823a97c nid 14211@kfi7 refs 2
00000800:00000200:29.0:1773851853.854265:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 14211@kfi7(000000000ce52b6e):0x0 lsk 3584 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xdff Transaction freed
00000800:00000200:17.0:1773851853.868316:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851853.868317:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851853.868317:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:19.0:1773851853.868318:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851853.868318:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:19.0:1773851853.868319:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851853.868320:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9186@kfi7(00000000bd92ee5e):0x27a version: 2; local version 2; negotiated version: 2
00000800:00000200:19.0:1773851853.868322:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851853.868323:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a Using peer 9186@kfi7(0x27a)
00000400:00000200:19.0:1773851853.868324:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:17.0:1773851853.868325:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:19.0:1773851853.868326:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9186@kfi7 : PUT - for me
00000400:00000200:19.0:1773851853.868327:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000800:00000200:17.0:1773851853.868327:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x27a: rc=0
00000400:00000200:19.0:1773851853.868328:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 1
00000400:00000200:19.0:1773851853.868329:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000800:00000200:17.0:1773851853.868329:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:19.0:1773851853.868330:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000400:00000200:19.0:1773851853.868331:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 3
00000400:00000200:19.0:1773851853.868332:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:19.0:1773851853.868334:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9186@kfi7 of length 224 into portal 12 MB=0x69b8236926740
00000400:00000200:19.0:1773851853.868335:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9186@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 188736
00000800:00000200:19.0:1773851853.868338:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851853.868340:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851853.868342:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9186@kfi7: PUT: OK
00000100:00000001:19.0:1773851853.868343:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851853.868343:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:17.0:1773851853.868343:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a TN_EVENT_TX_OK event status 0
00000100:00000010:19.0:1773851853.868345:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fd3822b2.
00000100:00000040:19.0:1773851853.868345:0:2464491:0:(events.c:358:request_in_callback()) incoming req@00000000fd3822b2 x1859833423882048 msgsize 224
00000800:00000200:17.0:1773851853.868346:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a Transaction freed
00000100:00100000:19.0:1773851853.868347:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-9186@kfi7 (source: 12345-9186@kfi7)
00000100:00000001:19.0:1773851853.868349:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851853.868350:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000800:00000200:19.0:1773851853.868352:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851853.868356:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851853.868356:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851853.868357:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851853.868357:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851853.868358:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851853.868359:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833423882048
00000020:00000001:19.0:1773851853.868360:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851853.868361:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c16f105
00000020:00000001:19.0:1773851853.868361:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851853.868365:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ec27bebc refcount=5
00000020:00000001:19.0:1773851853.868366:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148287554560 : -106925421997056 : ffff9ec07c345400)
00000020:00000001:19.0:1773851853.868367:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148287554560 : -106925421997056 : ffff9ec07c345400)
00000100:00000001:19.0:1773851853.868368:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851853.868369:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851853.868371:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000799785d1.
00000020:00000010:19.0:1773851853.868372:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851853.868373:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851853.868374:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851853.868374:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851853.868375:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851853.868376:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851853.868377:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851853.868377:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851853.868378:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851853.868380:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851853.868381:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851853.868381:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851853.868382:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9186@kfi7, seq: 2156255
00000100:00000001:18.0:1773851853.868382:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851853.868383:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ec27bebc : new rpc_count 1
00000100:00000001:18.0:1773851853.868383:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851853.868384:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339140992 : -106987370410624 : ffff9eb20fca8d80)
00000100:00000001:18.0:1773851853.868384:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851853.868385:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fd3822b2 x1859833423882048/t0(0) o400->c372f125-707b-440e-ac9b-182540fa9ffb@9186@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1051-0'
00000100:00000001:19.0:1773851853.868388:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851853.868388:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851853.868389:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3822b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c372f125-707b-440e-ac9b-182540fa9ffb+5:39707:x1859833423882048:12345-9186@kfi7:400:default-tuolumne1051-0
00000100:00000200:19.0:1773851853.868391:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833423882048
00000020:00000001:19.0:1773851853.868392:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851853.868392:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851853.868393:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.868394:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851853.868395:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851853.868395:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851853.868396:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833423882048, found 0 last_xid 1859833423882047
00000020:00000001:19.0:1773851853.868397:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851853.868398:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851853.868399:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851853.868399:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.868400:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851853.868401:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851853.868401:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851853.868402:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000013afd4e8.
02000000:00000001:19.0:1773851853.868403:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851853.868404:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.868404:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851853.868405:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182984232520, transno 0, xid 1859833423882048
00010000:00000001:19.0:1773851853.868417:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851853.868418:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fd3822b2 x1859833423882048/t0(0) o400->c372f125-707b-440e-ac9b-182540fa9ffb@9186@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1051-0'
00010000:00000001:19.0:1773851853.868420:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851853.868421:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851853.868422:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=86 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851853.868423:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851853.868424:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002927be28 refcount 3 to 9186@kfi7
00000100:00000001:19.0:1773851853.868424:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095777472 : -107152613774144 : ffff9e8b9684ecc0)
02000000:00000001:19.0:1773851853.868425:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851853.868426:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851853.868426:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851853.868427:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9186@kfi7
00000400:00000010:19.0:1773851853.868428:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e88f2542.
00000100:00000200:19.0:1773851853.868429:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833423882048, offset 224
00000400:00000200:19.0:1773851853.868430:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9186@kfi7
00000400:00000200:19.0:1773851853.868431:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:19.0:1773851853.868432:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 1
00000400:00000200:19.0:1773851853.868433:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000400:00000200:19.0:1773851853.868434:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 3
00000400:00000200:19.0:1773851853.868435:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9186@kfi7 local destination
00000400:00000200:19.0:1773851853.868436:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768582:8768582:1024:4294967295] 9186@kfi7 LPNI seq info [2053839:2053839:16:4294967295]
00000400:00000200:19.0:1773851853.868437:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000400:00000200:19.0:1773851853.868438:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:19.0:1773851853.868440:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9186@kfi7(9186@kfi7:9186@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851853.868441:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 3
00000800:00000200:19.0:1773851853.868442:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851853.868443:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851853.868445:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851853.868448:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a Using peer 9186@kfi7(0x27a)
00000800:00000200:19.0:1773851853.868451:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0x27a: rc=0
00000800:00000200:19.0:1773851853.868453:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851853.868455:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851853.868455:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002927be28 refcount 2 to 9186@kfi7
00010000:00000001:19.0:1773851853.868456:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851853.868456:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851853.868457:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851853.868458:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fd3822b2 x1859833423882048/t0(0) o400->c372f125-707b-440e-ac9b-182540fa9ffb@9186@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1051-0'
00000100:00100000:19.0:1773851853.868461:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3822b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c372f125-707b-440e-ac9b-182540fa9ffb+5:39707:x1859833423882048:12345-9186@kfi7:400:default-tuolumne1051-0 Request processed in 72us (114us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851853.868463:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9186@kfi7, seq: 2156255
00000100:00000040:19.0:1773851853.868464:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ec27bebc : new rpc_count 0
00000100:00000001:19.0:1773851853.868464:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851853.868465:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851853.868465:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851853.868466:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000800:00000200:17.0:1773851853.868466:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851853.868467:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000799785d1.
00000400:00000200:17.0:1773851853.868467:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:19.0:1773851853.868468:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000ec27bebc : new refcount 4
00000100:00000001:19.0:1773851853.868468:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851853.868468:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9186@kfi7: PUT: OK
00000400:00000200:17.0:1773851853.868469:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e88f2542
00000400:00000010:17.0:1773851853.868470:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e88f2542.
00000100:00000001:17.0:1773851853.868471:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851853.868471:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851853.868472:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000800:00000200:17.0:1773851853.868473:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9186@kfi7(00000000bd92ee5e):0x0 lsk 635 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x27a Transaction freed
00000800:00000200:13.0:1773851853.884978:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851853.884979:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851853.884980:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851853.884982:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851853.884985:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14689@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.884986:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14689@kfi7 : PUT - for me
00000400:00000200:13.0:1773851853.884987:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14689@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.884988:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e86f6ff nid 14689@kfi7 refs 1
00000400:00000200:13.0:1773851853.884989:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14689@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.884989:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e86f6ff nid 14689@kfi7 refs 2
00000400:00000200:13.0:1773851853.884990:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000e86f6ff nid 14689@kfi7 refs 3
00000400:00000200:13.0:1773851853.884991:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14688@kfi7 to cpt 0
00000400:00000200:13.0:1773851853.884992:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14688@kfi7 of length 224 into portal 12 MB=0x69b4b58617cc0
00000400:00000200:13.0:1773851853.884994:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14688@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 13008
00000800:00000200:13.0:1773851853.884996:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851853.884998:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851853.884999:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14689@kfi7: PUT: OK
00000100:00000001:13.0:1773851853.885000:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851853.885000:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851853.885001:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000d35980b.
00000100:00000040:13.0:1773851853.885002:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000000d35980b x1859597767900352 msgsize 224
00000100:00100000:13.0:1773851853.885004:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14688@kfi7 (source: 12345-14689@kfi7)
00000100:00000001:13.0:1773851853.885005:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851853.885006:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000e86f6ff nid 14689@kfi7 refs 2
00000800:00000200:13.0:1773851853.885008:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851853.885010:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851853.885011:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851853.885012:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851853.885012:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851853.885013:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851853.885014:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597767900352
00000020:00000001:13.0:1773851853.885014:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851853.885015:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ddf7
00000020:00000001:13.0:1773851853.885015:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851853.885017:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008ab1c8f1 refcount=5
00000020:00000001:13.0:1773851853.885018:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142452529152 : -106931257022464 : ffff9ebf2068e800)
00000020:00000001:13.0:1773851853.885019:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142452529152 : -106931257022464 : ffff9ebf2068e800)
00000100:00000001:13.0:1773851853.885020:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851853.885021:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851853.885021:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851853.885022:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851853.885023:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851853.885024:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851853.885024:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851853.885025:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851853.885026:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851853.885026:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851853.885027:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.885028:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851853.885029:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851853.885029:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851853.885030:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851853.885031:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851853.885031:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14688@kfi7, seq: 2289768
00000100:00000001:14.0:1773851853.885032:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851853.885032:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851853.885032:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008ab1c8f1 : new rpc_count 1
00000100:00000001:13.0:1773851853.885032:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197404544 : -106942512147072 : ffff9ebc818d5580)
00000100:00000040:13.0:1773851853.885034:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000d35980b x1859597767900352/t0(0) o400->47b934e2-9e1c-455f-94e2-2a25d7953537@14688@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1408-0'
00000100:00000001:13.0:1773851853.885036:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851853.885037:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851853.885038:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d35980b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:47b934e2-9e1c-455f-94e2-2a25d7953537+5:39583:x1859597767900352:12345-14688@kfi7:400:default-tuolumne1408-0
00000100:00000200:13.0:1773851853.885039:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597767900352
00000020:00000001:13.0:1773851853.885040:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851853.885040:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851853.885041:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.885042:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851853.885042:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851853.885043:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851853.885044:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597767900352, found 0 last_xid 1859597767900351
00000020:00000001:13.0:1773851853.885045:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851853.885045:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851853.885046:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851853.885046:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.885047:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851853.885047:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851853.885048:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851853.885048:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c46bc715.
02000000:00000001:13.0:1773851853.885049:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.885050:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.885051:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851853.885051:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686549, transno 0, xid 1859597767900352
00010000:00000001:13.0:1773851853.885052:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851853.885053:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000d35980b x1859597767900352/t0(0) o400->47b934e2-9e1c-455f-94e2-2a25d7953537@14688@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1408-0'
00010000:00000001:13.0:1773851853.885055:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851853.885056:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851853.885056:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=86 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851853.885057:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851853.885058:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000039adaf86 refcount 3 to 14688@kfi7
00000100:00000001:13.0:1773851853.885059:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729381472 : -107155980170144 : ffff9e8acdddcc60)
02000000:00000001:13.0:1773851853.885060:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851853.885060:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851853.885061:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851853.885061:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14689@kfi7
00000400:00000010:13.0:1773851853.885062:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008b5248b5.
00000100:00000200:13.0:1773851853.885063:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597767900352, offset 224
00000400:00000200:13.0:1773851853.885064:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14689@kfi7
00000400:00000200:13.0:1773851853.885065:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14689@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.885066:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e86f6ff nid 14689@kfi7 refs 1
00000400:00000200:13.0:1773851853.885067:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000e86f6ff nid 14689@kfi7 refs 2
00000400:00000200:13.0:1773851853.885068:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000e86f6ff nid 14689@kfi7 refs 3
00000400:00000200:13.0:1773851853.885069:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14689@kfi7 local destination
00000400:00000200:13.0:1773851853.885070:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768583:8768583:1024:4294967295] 14689@kfi7 LPNI seq info [180058:180058:16:4294967295]
00000400:00000200:13.0:1773851853.885071:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000e86f6ff nid 14689@kfi7 refs 2
00000400:00000200:13.0:1773851853.885072:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14689@kfi7 to cpt 3
00000400:00000200:13.0:1773851853.885074:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14689@kfi7(14689@kfi7:14689@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851853.885075:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000e86f6ff nid 14689@kfi7 refs 3
00000800:00000200:13.0:1773851853.885076:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851853.885077:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851853.885079:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851853.885081:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc66 Using peer 14689@kfi7(0xc66)
00000800:00000200:13.0:1773851853.885084:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000006c12e940: Posted send of 324 bytes to peer 0xc66: rc=0
00000800:00000200:13.0:1773851853.885085:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc66 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851853.885087:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851853.885088:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000039adaf86 refcount 2 to 14688@kfi7
00010000:00000001:13.0:1773851853.885088:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851853.885089:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851853.885089:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851853.885090:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000d35980b x1859597767900352/t0(0) o400->47b934e2-9e1c-455f-94e2-2a25d7953537@14688@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1408-0'
00000100:00100000:13.0:1773851853.885093:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d35980b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:47b934e2-9e1c-455f-94e2-2a25d7953537+5:39583:x1859597767900352:12345-14688@kfi7:400:default-tuolumne1408-0 Request processed in 55us (89us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851853.885095:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14688@kfi7, seq: 2289768
00000100:00000040:13.0:1773851853.885095:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008ab1c8f1 : new rpc_count 0
00000100:00000001:13.0:1773851853.885096:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851853.885096:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851853.885097:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:14.0:1773851853.885098:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc66 TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851853.885098:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000020:00000010:13.0:1773851853.885098:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000020:00000040:13.0:1773851853.885099:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000008ab1c8f1 : new refcount 4
00000400:00000200:14.0:1773851853.885100:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851853.885100:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851853.885101:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14689@kfi7: PUT: OK
00000400:00000200:14.0:1773851853.885101:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008b5248b5
00000400:00000010:14.0:1773851853.885102:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008b5248b5.
00000100:00000001:14.0:1773851853.885102:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851853.885103:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851853.885104:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000e86f6ff nid 14689@kfi7 refs 2
00000800:00000200:14.0:1773851853.885105:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 14689@kfi7(000000001b646263):0x0 lsk 3175 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc66 Transaction freed
00000800:00000200:1.0:1773851853.926575:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851853.926576:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851853.926578:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851853.926582:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851853.926585:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10033@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.926587:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10033@kfi7 : PUT - for me
00000400:00000200:1.0:1773851853.926588:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10033@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.926590:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc2d117d nid 10033@kfi7 refs 1
00000400:00000200:1.0:1773851853.926591:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10033@kfi7 to cpt 0
00000400:00000200:1.0:1773851853.926592:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc2d117d nid 10033@kfi7 refs 2
00000400:00000200:1.0:1773851853.926593:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dc2d117d nid 10033@kfi7 refs 3
00000400:00000200:1.0:1773851853.926595:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10225@kfi7 to cpt 2
00000400:00000200:1.0:1773851853.926598:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10225@kfi7 of length 224 into portal 12 MB=0x699e0f8b85700
00000400:00000200:1.0:1773851853.926600:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10225@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 11768
00000800:00000200:1.0:1773851853.926603:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851853.926606:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.926608:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10033@kfi7: PUT: OK
00000100:00000001:1.0:1773851853.926609:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851853.926610:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851853.926612:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003ddc6022.
00000100:00000040:1.0:1773851853.926613:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000003ddc6022 x1858041384818432 msgsize 224
00000100:00100000:1.0:1773851853.926615:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-10225@kfi7 (source: 12345-10033@kfi7)
00000100:00000001:1.0:1773851853.926617:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851853.926618:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc2d117d nid 10033@kfi7 refs 2
00000100:00000001:0.0:1773851853.926620:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851853.926621:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851853.926621:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851853.926621:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851853.926622:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851853.926623:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.926624:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041384818432
00000020:00000001:0.0:1773851853.926625:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851853.926626:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ee7
00000020:00000001:0.0:1773851853.926627:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851853.926629:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c48c23f9 refcount=6
00000020:00000001:0.0:1773851853.926630:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629021696 : -107123080529920 : ffff9e9276d67800)
00000020:00000001:0.0:1773851853.926631:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629021696 : -107123080529920 : ffff9e9276d67800)
00000100:00000001:0.0:1773851853.926632:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.926633:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851853.926634:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851853.926636:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.926637:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851853.926638:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851853.926639:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851853.926640:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.926641:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851853.926642:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851853.926642:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.926644:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.926646:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.926646:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.926646:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851853.926647:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851853.926648:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10225@kfi7, seq: 1997487
00000100:00000001:2.0:1773851853.926649:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.926649:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c48c23f9 : new rpc_count 1
00000100:00000001:2.0:1773851853.926650:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.926650:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605643136 : -106923103908480 : ffff9ec1065f8d80)
00000100:00000040:0.0:1773851853.926652:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003ddc6022 x1858041384818432/t0(0) o400->cec62672-dcdd-40ec-9441-81ac2cb653df@10225@kfi7:493/0 lens 224/0 e 0 to 0 dl 1773852608 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1117-0'
00000100:00000001:0.0:1773851853.926657:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.926657:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851853.926659:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ddc6022 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:cec62672-dcdd-40ec-9441-81ac2cb653df+6:39712:x1858041384818432:12345-10225@kfi7:400:default-tuolumne1117-0
00000100:00000200:0.0:1773851853.926661:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041384818432
00000020:00000001:0.0:1773851853.926662:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851853.926663:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851853.926664:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.926665:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851853.926666:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851853.926667:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851853.926668:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041384818432, found 0 last_xid 1858041384818431
00000020:00000001:0.0:1773851853.926669:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851853.926671:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.926671:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851853.926672:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.926673:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851853.926674:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851853.926675:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851853.926676:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000028ff6d2a.
02000000:00000001:0.0:1773851853.926677:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.926678:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.926679:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851853.926680:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183097238839, transno 0, xid 1858041384818432
00010000:00000001:0.0:1773851853.926681:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851853.926683:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003ddc6022 x1858041384818432/t0(0) o400->cec62672-dcdd-40ec-9441-81ac2cb653df@10225@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1117-0'
00010000:00000001:0.0:1773851853.926687:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851853.926688:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851853.926689:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851853.926690:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851853.926691:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ef01ae2a refcount 3 to 10225@kfi7
00000100:00000001:0.0:1773851853.926692:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810485408 : -107154899066208 : ffff9e8b0e4e22a0)
02000000:00000001:0.0:1773851853.926694:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851853.926695:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.926696:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851853.926697:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10033@kfi7
00000400:00000010:0.0:1773851853.926698:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073d1c143.
00000100:00000200:0.0:1773851853.926699:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041384818432, offset 224
00000400:00000200:0.0:1773851853.926701:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10033@kfi7
00000400:00000200:0.0:1773851853.926703:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10033@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.926704:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc2d117d nid 10033@kfi7 refs 1
00000400:00000200:0.0:1773851853.926706:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dc2d117d nid 10033@kfi7 refs 2
00000400:00000200:0.0:1773851853.926708:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dc2d117d nid 10033@kfi7 refs 3
00000400:00000200:0.0:1773851853.926709:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10033@kfi7 local destination
00000400:00000200:0.0:1773851853.926712:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768584:8768584:1024:4294967295] 10033@kfi7 LPNI seq info [839010:839010:16:4294967295]
00000400:00000200:0.0:1773851853.926714:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dc2d117d nid 10033@kfi7 refs 2
00000400:00000200:0.0:1773851853.926715:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10033@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.926719:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10033@kfi7(10033@kfi7:10033@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851853.926721:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dc2d117d nid 10033@kfi7 refs 3
00000800:00000200:0.0:1773851853.926723:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851853.926729:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851853.926733:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851853.926736:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000226 Using peer 10033@kfi7(0x100000000000226)
00000800:00000200:0.0:1773851853.926741:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x100000000000226: rc=0
00000800:00000200:0.0:1773851853.926743:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000226 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851853.926746:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.926748:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ef01ae2a refcount 2 to 10225@kfi7
00010000:00000001:0.0:1773851853.926749:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851853.926752:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.926753:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851853.926754:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003ddc6022 x1858041384818432/t0(0) o400->cec62672-dcdd-40ec-9441-81ac2cb653df@10225@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1117-0'
00000100:00100000:0.0:1773851853.926759:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ddc6022 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:cec62672-dcdd-40ec-9441-81ac2cb653df+6:39712:x1858041384818432:12345-10225@kfi7:400:default-tuolumne1117-0 Request processed in 102us (146us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851853.926763:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10225@kfi7, seq: 1997487
00000100:00000040:0.0:1773851853.926764:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c48c23f9 : new rpc_count 0
00000100:00000001:0.0:1773851853.926766:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851853.926766:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851853.926767:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.926769:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851853.926770:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851853.926771:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000c48c23f9 : new refcount 5
00000100:00000001:0.0:1773851853.926772:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851853.926780:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000226 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851853.926783:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.926785:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10033@kfi7: PUT: OK
00000400:00000200:1.0:1773851853.926786:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073d1c143
00000400:00000010:1.0:1773851853.926787:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073d1c143.
00000100:00000001:1.0:1773851853.926788:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851853.926789:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851853.926790:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc2d117d nid 10033@kfi7 refs 2
00000800:00000200:1.0:1773851853.926792:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 10033@kfi7(0000000011cd276c):0x0 lsk 551 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000226 Transaction freed
00000800:00000200:21.0:1773851853.941055:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851853.941056:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851853.941057:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851853.941059:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851853.941060:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.941062:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8291@kfi7 : PUT - for me
00000400:00000200:21.0:1773851853.941062:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.941063:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 1
00000400:00000200:21.0:1773851853.941064:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.941065:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000400:00000200:21.0:1773851853.941066:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 3
00000400:00000200:21.0:1773851853.941066:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851853.941067:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8291@kfi7 of length 224 into portal 12 MB=0x699e42c2fc000
00000400:00000200:21.0:1773851853.941069:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8291@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 24040
00000800:00000200:21.0:1773851853.941070:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851853.941072:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851853.941073:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8291@kfi7: PUT: OK
00000100:00000001:21.0:1773851853.941074:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851853.941074:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851853.941075:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b41e7d09.
00000100:00000040:21.0:1773851853.941076:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000b41e7d09 x1858055133184000 msgsize 224
00000100:00100000:21.0:1773851853.941078:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-8291@kfi7 (source: 12345-8291@kfi7)
00000100:00000001:21.0:1773851853.941080:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851853.941081:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851853.941081:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
02000000:00000001:23.0:1773851853.941082:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851853.941082:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851853.941082:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851853.941083:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851853.941083:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851853.941084:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858055133184000
00000020:00000001:23.0:1773851853.941085:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851853.941085:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91bd7
00000020:00000001:23.0:1773851853.941086:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851853.941091:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b315c015 refcount=5967
00000020:00000001:23.0:1773851853.941092:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628034560 : -107123081517056 : ffff9e9276c76800)
00000020:00000001:23.0:1773851853.941093:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628034560 : -107123081517056 : ffff9e9276c76800)
00000100:00000001:23.0:1773851853.941094:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851853.941095:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851853.941096:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000054a79f9a.
00000020:00000010:23.0:1773851853.941097:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851853.941098:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851853.941099:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851853.941099:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851853.941100:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851853.941101:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851853.941101:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851853.941102:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.941103:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851853.941104:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851853.941104:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851853.941105:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8291@kfi7, seq: 1997926
00000100:00000001:22.0:1773851853.941105:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:23.0:1773851853.941106:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b315c015 : new rpc_count 8
00000100:00000001:22.0:1773851853.941106:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851853.941107:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117344000 : -106995592207616 : ffff9eb025bbe300)
00000100:00000001:22.0:1773851853.941107:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851853.941108:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851853.941109:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b41e7d09 x1858055133184000/t0(0) o400->3d87da24-b427-4287-836f-67cf84d90c94@8291@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne1004-0'
00000100:00000001:23.0:1773851853.941112:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851853.941112:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851853.941113:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b41e7d09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3d87da24-b427-4287-836f-67cf84d90c94+5967:40622:x1858055133184000:12345-8291@kfi7:400:login-tuolumne1004-0
00000100:00000200:23.0:1773851853.941115:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858055133184000
00000020:00000001:23.0:1773851853.941115:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851853.941116:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851853.941117:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.941117:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851853.941118:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851853.941119:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851853.941119:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858055133184000, found 0 last_xid 1858055132577599
00000020:00000001:23.0:1773851853.941120:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851853.941121:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851853.941121:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851853.941122:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.941122:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851853.941123:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851853.941124:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851853.941124:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000183777ff.
02000000:00000001:23.0:1773851853.941125:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.941126:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.941127:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851853.941127:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593871, transno 0, xid 1858055133184000
00010000:00000001:23.0:1773851853.941128:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851853.941129:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b41e7d09 x1858055133184000/t0(0) o400->3d87da24-b427-4287-836f-67cf84d90c94@8291@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1004-0'
00010000:00000001:23.0:1773851853.941131:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851853.941132:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851853.941132:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=86 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851853.941133:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851853.941135:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ed825b52 refcount 3 to 8291@kfi7
00000100:00000001:23.0:1773851853.941136:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094304 : -107139307457312 : ffff9e8eafa334e0)
02000000:00000001:23.0:1773851853.941136:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851853.941137:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851853.941138:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851853.941139:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8291@kfi7
00000400:00000010:23.0:1773851853.941139:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008506b019.
00000100:00000200:23.0:1773851853.941140:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858055133184000, offset 224
00000400:00000200:23.0:1773851853.941141:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8291@kfi7
00000400:00000200:23.0:1773851853.941142:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:23.0:1773851853.941143:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 1
00000400:00000200:23.0:1773851853.941144:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000400:00000200:23.0:1773851853.941145:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 3
00000400:00000200:23.0:1773851853.941146:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8291@kfi7 local destination
00000400:00000200:23.0:1773851853.941148:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768585:8768585:1024:4294967295] 8291@kfi7 LPNI seq info [41191084:41191084:16:4294967295]
00000400:00000200:23.0:1773851853.941149:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000400:00000200:23.0:1773851853.941150:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:23.0:1773851853.941152:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8291@kfi7(8291@kfi7:8291@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851853.941153:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 3
00000800:00000200:23.0:1773851853.941155:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851853.941156:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851853.941158:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851853.941160:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3000000000001b4 Using peer 8291@kfi7(0x3000000000001b4)
00000800:00000200:23.0:1773851853.941163:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x3000000000001b4: rc=0
00000800:00000200:23.0:1773851853.941165:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3000000000001b4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851853.941167:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851853.941168:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ed825b52 refcount 2 to 8291@kfi7
00010000:00000001:23.0:1773851853.941169:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851853.941169:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851853.941170:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851853.941171:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b41e7d09 x1858055133184000/t0(0) o400->3d87da24-b427-4287-836f-67cf84d90c94@8291@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1004-0'
00000100:00100000:23.0:1773851853.941174:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b41e7d09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3d87da24-b427-4287-836f-67cf84d90c94+5967:40622:x1858055133184000:12345-8291@kfi7:400:login-tuolumne1004-0 Request processed in 61us (97us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851853.941176:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8291@kfi7, seq: 1997926
00000100:00000040:23.0:1773851853.941177:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b315c015 : new rpc_count 7
00000100:00000001:23.0:1773851853.941177:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851853.941178:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851853.941178:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3000000000001b4 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851853.941179:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851853.941179:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000400:00000200:21.0:1773851853.941179:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851853.941180:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000054a79f9a.
00000400:00000200:21.0:1773851853.941180:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8291@kfi7: PUT: OK
00000020:00000040:23.0:1773851853.941181:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b315c015 : new refcount 5966
00000400:00000200:21.0:1773851853.941181:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008506b019
00000100:00000001:23.0:1773851853.941182:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:21.0:1773851853.941182:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008506b019.
00000100:00000001:21.0:1773851853.941182:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851853.941183:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851853.941184:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000800:00000200:21.0:1773851853.941185:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 8291@kfi7(0000000049d0a7d7):0x0 lsk 437 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3000000000001b4 Transaction freed
00000800:00000200:9.0:1773851853.945279:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851853.945281:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851853.945282:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851853.945285:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851853.945287:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.945288:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14466@kfi7 : PUT - for me
00000400:00000200:9.0:1773851853.945290:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.945290:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 1
00000400:00000200:9.0:1773851853.945292:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:9.0:1773851853.945293:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000400:00000200:9.0:1773851853.945294:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 3
00000400:00000200:9.0:1773851853.945295:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14467@kfi7 to cpt 5
00000400:00000200:9.0:1773851853.945296:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14467@kfi7 of length 224 into portal 12 MB=0x69b1913e94580
00000400:00000200:9.0:1773851853.945297:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14467@kfi7 of length 224/224 into md 0x78146ce49 [64] + 117880
00000800:00000200:9.0:1773851853.945299:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851853.945301:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.945302:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14466@kfi7: PUT: OK
00000100:00000001:9.0:1773851853.945303:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851853.945304:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851853.945305:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000460b3aab.
00000100:00000040:9.0:1773851853.945305:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000460b3aab x1859381870806400 msgsize 224
00000100:00100000:9.0:1773851853.945308:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14467@kfi7 (source: 12345-14466@kfi7)
00000100:00000001:9.0:1773851853.945309:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851853.945310:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000100:00000001:8.0:1773851853.945311:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851853.945311:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851853.945312:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851853.945312:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851853.945312:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851853.945313:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851853.945314:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381870806400
00000020:00000001:8.0:1773851853.945315:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851853.945315:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0796852dd1e
00000020:00000001:8.0:1773851853.945316:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851853.945318:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b80a48ea refcount=5
00000020:00000001:8.0:1773851853.945319:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637013007810560 : -107060701741056 : ffff9ea0fce74000)
00000020:00000001:8.0:1773851853.945319:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637013007810560 : -107060701741056 : ffff9ea0fce74000)
00000100:00000001:8.0:1773851853.945320:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.945322:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851853.945322:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000073849ec.
00000020:00000010:8.0:1773851853.945323:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.945324:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851853.945325:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851853.945326:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851853.945326:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851853.945327:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851853.945328:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851853.945328:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.945329:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851853.945331:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851853.945331:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851853.945331:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851853.945332:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851853.945332:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14467@kfi7, seq: 2130719
00000100:00000001:11.0:1773851853.945333:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.945333:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b80a48ea : new rpc_count 1
00000100:00000001:11.0:1773851853.945334:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.945334:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792154752 : -106938917396864 : ffff9ebd57d0de80)
00000100:00000040:8.0:1773851853.945336:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000460b3aab x1859381870806400/t0(0) o400->ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c@14467@kfi7:580/0 lens 224/0 e 0 to 0 dl 1773851940 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1400-0'
00000100:00000001:8.0:1773851853.945338:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851853.945338:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851853.945339:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000460b3aab pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c+5:39828:x1859381870806400:12345-14467@kfi7:400:default-tuolumne1400-0
00000100:00000200:8.0:1773851853.945341:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381870806400
00000020:00000001:8.0:1773851853.945341:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851853.945342:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851853.945343:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.945343:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851853.945344:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851853.945344:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851853.945345:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381870806400, found 0 last_xid 1859381870806399
00000020:00000001:8.0:1773851853.945346:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851853.945347:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851853.945347:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851853.945348:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.945348:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851853.945349:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851853.945349:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851853.945350:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab90608d.
02000000:00000001:8.0:1773851853.945351:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.945351:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.945352:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851853.945353:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676018384, transno 0, xid 1859381870806400
00010000:00000001:8.0:1773851853.945353:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851853.945354:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000460b3aab x1859381870806400/t0(0) o400->ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c@14467@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1400-0'
00010000:00000001:8.0:1773851853.945357:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851853.945357:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851853.945358:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=86 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851853.945359:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851853.945360:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002ccbb477 refcount 3 to 14467@kfi7
00000100:00000001:8.0:1773851853.945361:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026816 : -107156745524800 : ffff9e8aa03f69c0)
02000000:00000001:8.0:1773851853.945362:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851853.945362:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851853.945363:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851853.945364:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14466@kfi7
00000400:00000010:8.0:1773851853.945364:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3e9aeb1.
00000100:00000200:8.0:1773851853.945365:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859381870806400, offset 224
00000400:00000200:8.0:1773851853.945366:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14466@kfi7
00000400:00000200:8.0:1773851853.945367:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.945368:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 1
00000400:00000200:8.0:1773851853.945369:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000400:00000200:8.0:1773851853.945370:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 3
00000400:00000200:8.0:1773851853.945372:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14466@kfi7 local destination
00000400:00000200:8.0:1773851853.945373:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768586:8768586:1024:4294967295] 14466@kfi7 LPNI seq info [638822:638822:16:4294967295]
00000400:00000200:8.0:1773851853.945374:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000400:00000200:8.0:1773851853.945375:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:8.0:1773851853.945377:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14466@kfi7(14466@kfi7:14466@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851853.945378:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 3
00000800:00000200:8.0:1773851853.945380:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851853.945381:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851853.945383:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851853.945385:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000108a Using peer 14466@kfi7(0x10000000000108a)
00000800:00000200:8.0:1773851853.945388:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x10000000000108a: rc=0
00000800:00000200:8.0:1773851853.945389:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000108a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851853.945391:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851853.945392:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002ccbb477 refcount 2 to 14467@kfi7
00010000:00000001:8.0:1773851853.945393:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851853.945393:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851853.945394:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851853.945395:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000460b3aab x1859381870806400/t0(0) o400->ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c@14467@kfi7:580/0 lens 224/224 e 0 to 0 dl 1773851940 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1400-0'
00000100:00100000:8.0:1773851853.945399:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000460b3aab pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c+5:39828:x1859381870806400:12345-14467@kfi7:400:default-tuolumne1400-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851853.945401:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14467@kfi7, seq: 2130719
00000100:00000040:8.0:1773851853.945402:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b80a48ea : new rpc_count 0
00000100:00000001:8.0:1773851853.945403:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851853.945403:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851853.945404:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851853.945405:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851853.945406:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000073849ec.
00000020:00000040:8.0:1773851853.945406:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b80a48ea : new refcount 4
00000100:00000001:8.0:1773851853.945407:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851853.945412:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000108a TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851853.945414:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851853.945415:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14466@kfi7: PUT: OK
00000400:00000200:9.0:1773851853.945415:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3e9aeb1
00000400:00000010:9.0:1773851853.945416:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3e9aeb1.
00000100:00000001:9.0:1773851853.945417:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851853.945417:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851853.945418:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000800:00000200:9.0:1773851853.945420:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 14466@kfi7(000000004dad4bbc):0x0 lsk 4235 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000108a Transaction freed
00010000:00000001:2.0:1773851853.961730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961730:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851853.961731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851853.961732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851853.961733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851853.961734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851853.961735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851853.961736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851853.961737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851853.961738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851853.961741:0:849254:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851853.961741:0:849254:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851853.961742:0:849254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:2.0:1773851853.965980:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851853.965981:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851853.965982:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851853.965984:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851853.965986:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26291@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.965988:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26291@kfi7 : PUT - for me
00000400:00000200:2.0:1773851853.965989:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26291@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.965989:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 1
00000400:00000200:2.0:1773851853.965990:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26291@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.965991:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 2
00000400:00000200:2.0:1773851853.965992:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 3
00000400:00000200:2.0:1773851853.965993:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26291@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.965994:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26291@kfi7 of length 224 into portal 12 MB=0x69b4c55f0b200
00000400:00000200:2.0:1773851853.965995:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26291@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 11992
00000800:00000200:2.0:1773851853.965997:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851853.965999:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851853.966000:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26291@kfi7: PUT: OK
00000100:00000001:2.0:1773851853.966001:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851853.966002:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851853.966003:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1ca5990.
00000100:00000040:2.0:1773851853.966004:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000f1ca5990 x1859602021921280 msgsize 224
00000100:00100000:2.0:1773851853.966005:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-26291@kfi7 (source: 12345-26291@kfi7)
00000100:00000001:2.0:1773851853.966006:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851853.966007:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 2
00000100:00000001:0.0:1773851853.966008:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851853.966008:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:2.0:1773851853.966009:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851853.966009:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851853.966009:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851853.966010:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.966011:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602021921280
00000020:00000001:0.0:1773851853.966011:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851853.966012:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff80de8
00000020:00000001:0.0:1773851853.966012:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851853.966013:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005f632031 refcount=5
00000020:00000001:0.0:1773851853.966014:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157001836544 : -106916707715072 : ffff9ec2839db800)
00000020:00000001:0.0:1773851853.966014:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157001836544 : -106916707715072 : ffff9ec2839db800)
00000100:00000001:0.0:1773851853.966015:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.966016:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851853.966016:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851853.966017:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.966018:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851853.966019:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851853.966020:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851853.966020:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.966021:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851853.966022:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851853.966022:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.966023:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851853.966024:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851853.966025:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.966025:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851853.966026:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851853.966026:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26291@kfi7, seq: 1997488
00000100:00000001:2.0:1773851853.966027:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.966027:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.966027:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005f632031 : new rpc_count 1
00000100:00000001:0.0:1773851853.966027:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706800640 : -106953002750976 : ffff9eba10436c00)
00000100:00000040:0.0:1773851853.966028:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f1ca5990 x1859602021921280/t0(0) o400->95e3a325-1b3f-4363-bb12-359b94adb2c2@26291@kfi7:493/0 lens 224/0 e 0 to 0 dl 1773852608 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2122-0'
00000100:00000001:0.0:1773851853.966031:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.966031:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851853.966032:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1ca5990 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:95e3a325-1b3f-4363-bb12-359b94adb2c2+5:39467:x1859602021921280:12345-26291@kfi7:400:default-tuolumne2122-0
00000100:00000200:0.0:1773851853.966033:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602021921280
00000020:00000001:0.0:1773851853.966034:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851853.966035:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851853.966035:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.966036:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851853.966037:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851853.966037:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851853.966038:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602021921280, found 0 last_xid 1859602021921279
00000020:00000001:0.0:1773851853.966039:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851853.966039:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.966040:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851853.966041:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.966041:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851853.966042:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851853.966042:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851853.966043:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002a0e2225.
02000000:00000001:0.0:1773851853.966043:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.966044:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.966045:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851853.966045:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013982658, transno 0, xid 1859602021921280
00010000:00000001:0.0:1773851853.966046:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851853.966047:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f1ca5990 x1859602021921280/t0(0) o400->95e3a325-1b3f-4363-bb12-359b94adb2c2@26291@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2122-0'
00010000:00000001:0.0:1773851853.966049:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851853.966049:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851853.966050:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851853.966051:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851853.966051:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee878a14 refcount 3 to 26291@kfi7
00000100:00000001:0.0:1773851853.966052:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451136 : -107149715100480 : ffff9e8c434b2cc0)
02000000:00000001:0.0:1773851853.966053:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851853.966053:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.966054:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851853.966054:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26291@kfi7
00000400:00000010:0.0:1773851853.966055:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b505966b.
00000100:00000200:0.0:1773851853.966056:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602021921280, offset 224
00000400:00000200:0.0:1773851853.966057:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26291@kfi7
00000400:00000200:0.0:1773851853.966058:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26291@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.966058:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 1
00000400:00000200:0.0:1773851853.966059:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 2
00000400:00000200:0.0:1773851853.966060:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 3
00000400:00000200:0.0:1773851853.966061:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26291@kfi7 local destination
00000400:00000200:0.0:1773851853.966062:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768587:8768587:1024:4294967295] 26291@kfi7 LPNI seq info [84144:84144:16:4294967295]
00000400:00000200:0.0:1773851853.966064:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 2
00000400:00000200:0.0:1773851853.966064:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26291@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.966066:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26291@kfi7(26291@kfi7:26291@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851853.966067:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 3
00000800:00000200:0.0:1773851853.966068:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851853.966069:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851853.966073:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851853.966075:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9a4 Using peer 26291@kfi7(0x9a4)
00000800:00000200:0.0:1773851853.966078:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x9a4: rc=0
00000800:00000200:0.0:1773851853.966080:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851853.966081:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.966082:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee878a14 refcount 2 to 26291@kfi7
00010000:00000001:0.0:1773851853.966083:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851853.966083:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.966084:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851853.966084:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1ca5990 x1859602021921280/t0(0) o400->95e3a325-1b3f-4363-bb12-359b94adb2c2@26291@kfi7:493/0 lens 224/224 e 0 to 0 dl 1773852608 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2122-0'
00000100:00100000:0.0:1773851853.966089:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1ca5990 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:95e3a325-1b3f-4363-bb12-359b94adb2c2+5:39467:x1859602021921280:12345-26291@kfi7:400:default-tuolumne2122-0 Request processed in 55us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851853.966091:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26291@kfi7, seq: 1997488
00000100:00000040:0.0:1773851853.966091:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005f632031 : new rpc_count 0
00000100:00000001:0.0:1773851853.966092:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851853.966092:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851853.966093:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.966093:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851853.966094:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851853.966095:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005f632031 : new refcount 4
00000100:00000001:0.0:1773851853.966095:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851853.966100:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9a4 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851853.966102:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851853.966103:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26291@kfi7: PUT: OK
00000400:00000200:1.0:1773851853.966103:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b505966b
00000400:00000010:1.0:1773851853.966104:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b505966b.
00000100:00000001:1.0:1773851853.966105:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851853.966108:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851853.966109:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1fc1ac7 nid 26291@kfi7 refs 2
00000800:00000200:1.0:1773851853.966110:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 26291@kfi7(0000000085348059):0x0 lsk 2469 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9a4 Transaction freed
00000800:00000200:2.0:1773851853.993964:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851853.993965:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851853.993966:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851853.993968:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851853.993969:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.993970:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21712@kfi7 : PUT - for me
00000400:00000200:2.0:1773851853.993971:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.993972:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 1
00000400:00000200:2.0:1773851853.993973:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.993974:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000400:00000200:2.0:1773851853.993974:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 3
00000400:00000200:2.0:1773851853.993975:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:2.0:1773851853.993976:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21712@kfi7 of length 456 into portal 12 MB=0x699e0a7029b40
00000400:00000200:2.0:1773851853.993977:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21712@kfi7 of length 456/456 into md 0x7fb56e801 [64] + 12216
00000800:00000200:2.0:1773851853.993979:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851853.993981:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851853.993982:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21712@kfi7: PUT: OK
00000100:00000001:2.0:1773851853.993983:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851853.993983:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851853.993984:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c4bca51.
00000100:00000040:2.0:1773851853.993984:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000004c4bca51 x1858040013953856 msgsize 456
00000100:00100000:2.0:1773851853.993986:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-21712@kfi7 (source: 12345-21712@kfi7)
00000100:00000001:2.0:1773851853.993987:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851853.993987:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000100:00000001:0.0:1773851853.993988:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851853.993988:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:2.0:1773851853.993989:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851853.993989:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851853.993989:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851853.993989:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851853.993990:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040013953856
00000020:00000001:0.0:1773851853.993991:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851853.993991:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9289c
00000020:00000001:0.0:1773851853.993992:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851853.993993:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000075bb3aec refcount=6
00000020:00000001:0.0:1773851853.993994:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742966272 : -107128966585344 : ffff9e9118006400)
00000020:00000001:0.0:1773851853.993995:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742966272 : -107128966585344 : ffff9e9118006400)
00000100:00000001:0.0:1773851853.993995:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.993996:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851853.993996:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851853.993997:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.993998:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851853.993998:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851853.993999:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851853.993999:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.994000:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.994001:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851853.994002:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.994002:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851853.994002:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851853.994003:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851853.994003:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21712@kfi7, seq: 408701476
00000100:00000001:2.0:1773851853.994004:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851853.994004:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.994004:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000075bb3aec : new rpc_count 1
00000100:00000001:0.0:1773851853.994004:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706793728 : -106953002757888 : ffff9eba10435100)
00000100:00000040:0.0:1773851853.994005:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004c4bca51 x1858040013953856/t0(0) o17->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:580/0 lens 456/0 e 0 to 0 dl 1773851940 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1841-0'
00000100:00000001:0.0:1773851853.994008:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851853.994008:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851853.994009:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c4bca51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:45cc513a-aa46-4716-a011-ea6a00158659+6:39708:x1858040013953856:12345-21712@kfi7:17:default-tuolumne1841-0
00000100:00000200:0.0:1773851853.994010:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040013953856
00000020:00000001:0.0:1773851853.994011:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851853.994011:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851853.994012:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.994012:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851853.994013:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:0.0:1773851853.994014:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851853.994014:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040013953856, found 0 last_xid 1858040013953855
00000020:00000001:0.0:1773851853.994015:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851853.994015:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851853.994015:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851853.994016:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851853.994016:0:60951:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:0.0:1773851853.994017:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851853.994017:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851853.994019:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000056aebb4b.
02000000:00000001:0.0:1773851853.994019:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.994020:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.994020:0:60951:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:0.0:1773851853.994021:0:60951:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:0.0:1773851853.994021:0:60951:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:0.0:1773851853.994022:0:60951:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.994023:0:60951:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:0.0:1773851853.994024:0:60951:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 45cc513a-aa46-4716-a011-ea6a00158659/0000000075bb3aec free: 126633370845184 avail: 126633368748032
00000020:00000001:0.0:1773851853.994025:0:60951:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:0.0:1773851853.994025:0:60951:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 45cc513a-aa46-4716-a011-ea6a00158659/0000000075bb3aec avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:0.0:1773851853.994026:0:60951:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:0.0:1773851853.994027:0:60951:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:0.0:1773851853.994027:0:60951:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 45cc513a-aa46-4716-a011-ea6a00158659/0000000075bb3aec reports grant 1810890751 dropped 0, local 1878786047
00000020:00000001:0.0:1773851853.994028:0:60951:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:0.0:1773851853.994029:0:60951:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:0.0:1773851853.994029:0:60951:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851853.994030:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595829, transno 0, xid 1858040013953856
00010000:00000001:0.0:1773851853.994030:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851853.994031:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004c4bca51 x1858040013953856/t0(0) o17->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:580/0 lens 456/432 e 0 to 0 dl 1773851940 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1841-0'
00010000:00000001:0.0:1773851853.994033:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851853.994033:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851853.994034:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=86 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851853.994035:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851853.994035:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006edcb5ed refcount 3 to 21712@kfi7
00000100:00000001:0.0:1773851853.994036:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451232 : -107149715100384 : ffff9e8c434b2d20)
02000000:00000001:0.0:1773851853.994036:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851853.994037:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851853.994037:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851853.994038:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21712@kfi7
00000400:00000010:0.0:1773851853.994038:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b505966b.
00000100:00000200:0.0:1773851853.994039:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858040013953856, offset 224
00000400:00000200:0.0:1773851853.994040:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21712@kfi7
00000400:00000200:0.0:1773851853.994041:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.994042:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 1
00000400:00000200:0.0:1773851853.994042:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000400:00000200:0.0:1773851853.994043:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 3
00000400:00000200:0.0:1773851853.994044:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21712@kfi7 local destination
00000400:00000200:0.0:1773851853.994045:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768588:8768588:1024:4294967295] 21712@kfi7 LPNI seq info [3936248:3936248:16:4294967295]
00000400:00000200:0.0:1773851853.994046:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000400:00000200:0.0:1773851853.994047:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:0.0:1773851853.994049:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21712@kfi7(21712@kfi7:21712@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851853.994050:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 3
00000800:00000200:0.0:1773851853.994051:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851853.994052:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:0.0:1773851853.994054:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851853.994056:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x812 Using peer 21712@kfi7(0x812)
00000800:00000200:0.0:1773851853.994058:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 532 bytes to peer 0x812: rc=0
00000800:00000200:0.0:1773851853.994059:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x812 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851853.994063:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851853.994063:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006edcb5ed refcount 2 to 21712@kfi7
00010000:00000001:0.0:1773851853.994064:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851853.994064:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851853.994065:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851853.994065:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c4bca51 x1858040013953856/t0(0) o17->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:580/0 lens 456/432 e 0 to 0 dl 1773851940 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1841-0'
00000100:00100000:0.0:1773851853.994070:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c4bca51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:45cc513a-aa46-4716-a011-ea6a00158659+6:39708:x1858040013953856:12345-21712@kfi7:17:default-tuolumne1841-0 Request processed in 61us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851853.994072:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21712@kfi7, seq: 408701476
00000100:00000040:0.0:1773851853.994072:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000075bb3aec : new rpc_count 0
00000100:00000001:0.0:1773851853.994073:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851853.994073:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851853.994074:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851853.994074:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851853.994075:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851853.994076:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000075bb3aec : new refcount 5
00000100:00000001:0.0:1773851853.994076:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851853.994081:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x812 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851853.994082:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851853.994084:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21712@kfi7: PUT: OK
00000400:00000200:2.0:1773851853.994084:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b505966b
00000400:00000010:2.0:1773851853.994085:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b505966b.
00000100:00000001:2.0:1773851853.994085:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851853.994086:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851853.994087:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000800:00000200:2.0:1773851853.994088:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 21712@kfi7(000000007e934d1f):0x0 lsk 2067 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x812 Transaction freed
00000800:00000200:5.0:1773851854.032127:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851854.032128:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851854.032130:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851854.032132:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851854.032134:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:5.0:1773851854.032136:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19537@kfi7 : PUT - for me
00000400:00000200:5.0:1773851854.032137:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:5.0:1773851854.032137:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 1
00000400:00000200:5.0:1773851854.032138:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:5.0:1773851854.032139:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000400:00000200:5.0:1773851854.032140:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 3
00000400:00000200:5.0:1773851854.032140:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19536@kfi7 to cpt 6
00000400:00000200:5.0:1773851854.032141:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19536@kfi7 of length 224 into portal 12 MB=0x69b174cd13200
00000400:00000200:5.0:1773851854.032143:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19536@kfi7 of length 224/224 into md 0x793926dc5 [64] + 117584
00000800:00000200:5.0:1773851854.032144:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851854.032146:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851854.032148:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19537@kfi7: PUT: OK
00000100:00000001:5.0:1773851854.032149:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851854.032149:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851854.032150:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a62b8fe.
00000100:00000040:5.0:1773851854.032151:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008a62b8fe x1859374235595264 msgsize 224
00000100:00100000:5.0:1773851854.032152:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19536@kfi7 (source: 12345-19537@kfi7)
00000100:00000001:5.0:1773851854.032154:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851854.032155:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000800:00000200:5.0:1773851854.032156:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851854.032159:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851854.032160:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851854.032160:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851854.032161:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851854.032162:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851854.032162:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374235595264
00000020:00000001:5.0:1773851854.032163:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851854.032163:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793b0a0da9
00000020:00000001:5.0:1773851854.032164:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851854.032165:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000046053e5c refcount=5
00000020:00000001:5.0:1773851854.032166:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636939132352512 : -107134577199104 : ffff9e8fc9953800)
00000020:00000001:5.0:1773851854.032167:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636939132352512 : -107134577199104 : ffff9e8fc9953800)
00000100:00000001:5.0:1773851854.032168:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851854.032169:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851854.032169:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004dc22896.
00000020:00000010:5.0:1773851854.032171:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851854.032171:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000001c8675.
00000100:00000001:5.0:1773851854.032172:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851854.032173:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851854.032174:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851854.032175:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851854.032175:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851854.032175:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.032177:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.032178:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851854.032178:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851854.032179:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851854.032179:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851854.032180:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19536@kfi7, seq: 2001850
00000100:00000040:7.0:1773851854.032180:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000046053e5c : new rpc_count 1
00000100:00000001:5.0:1773851854.032180:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.032181:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046242944 : -106940663308672 : ffff9ebcefc05e80)
00000100:00000001:5.0:1773851854.032181:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.032182:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a62b8fe x1859374235595264/t0(0) o400->a6e73be6-36ee-481a-8cf7-3e6235c0cd00@19536@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1714-0'
00000100:00000001:7.0:1773851854.032184:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851854.032185:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851854.032186:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a62b8fe pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:a6e73be6-36ee-481a-8cf7-3e6235c0cd00+5:39909:x1859374235595264:12345-19536@kfi7:400:default-tuolumne1714-0
00000100:00000200:7.0:1773851854.032188:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374235595264
00000020:00000001:7.0:1773851854.032188:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851854.032189:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851854.032189:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.032190:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851854.032191:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851854.032191:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851854.032192:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374235595264, found 0 last_xid 1859374235595263
00000020:00000001:7.0:1773851854.032193:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851854.032193:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851854.032194:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851854.032194:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.032195:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851854.032195:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851854.032196:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851854.032197:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ac9a4ff4.
02000000:00000001:7.0:1773851854.032197:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.032198:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.032198:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851854.032200:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596474, transno 0, xid 1859374235595264
00010000:00000001:7.0:1773851854.032200:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851854.032201:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008a62b8fe x1859374235595264/t0(0) o400->a6e73be6-36ee-481a-8cf7-3e6235c0cd00@19536@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1714-0'
00010000:00000001:7.0:1773851854.032203:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851854.032204:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851854.032205:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=86 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851854.032206:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851854.032206:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cf68c30f refcount 3 to 19536@kfi7
00000100:00000001:7.0:1773851854.032207:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331296 : -107155410220320 : ffff9e8aefd68ae0)
02000000:00000001:7.0:1773851854.032208:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851854.032208:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.032209:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851854.032210:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19537@kfi7
00000400:00000010:7.0:1773851854.032210:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df522108.
00000100:00000200:7.0:1773851854.032211:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374235595264, offset 224
00000400:00000200:7.0:1773851854.032212:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19537@kfi7
00000400:00000200:7.0:1773851854.032213:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.032214:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 1
00000400:00000200:7.0:1773851854.032215:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000400:00000200:7.0:1773851854.032216:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 3
00000400:00000200:7.0:1773851854.032217:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19537@kfi7 local destination
00000400:00000200:7.0:1773851854.032219:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768589:8768589:1024:4294967295] 19537@kfi7 LPNI seq info [18778077:18778077:16:4294967295]
00000400:00000200:7.0:1773851854.032220:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000400:00000200:7.0:1773851854.032221:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.032223:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19537@kfi7(19537@kfi7:19537@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851854.032224:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 3
00000800:00000200:7.0:1773851854.032225:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851854.032226:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851854.032228:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851854.032230:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd61 Using peer 19537@kfi7(0xd61)
00000800:00000200:7.0:1773851854.032233:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0xd61: rc=0
00000800:00000200:7.0:1773851854.032235:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd61 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851854.032237:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.032237:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cf68c30f refcount 2 to 19536@kfi7
00010000:00000001:7.0:1773851854.032238:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851854.032239:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.032239:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851854.032240:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a62b8fe x1859374235595264/t0(0) o400->a6e73be6-36ee-481a-8cf7-3e6235c0cd00@19536@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1714-0'
00000100:00100000:7.0:1773851854.032243:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a62b8fe pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:a6e73be6-36ee-481a-8cf7-3e6235c0cd00+5:39909:x1859374235595264:12345-19536@kfi7:400:default-tuolumne1714-0 Request processed in 57us (91us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851854.032245:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19536@kfi7, seq: 2001850
00000100:00000040:7.0:1773851854.032246:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000046053e5c : new rpc_count 0
00000800:00000200:5.0:1773851854.032246:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd61 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851854.032247:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851854.032248:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851854.032248:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:5.0:1773851854.032248:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851854.032249:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000001c8675.
00000400:00000200:5.0:1773851854.032249:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19537@kfi7: PUT: OK
00000020:00000010:7.0:1773851854.032250:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004dc22896.
00000020:00000040:7.0:1773851854.032250:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000046053e5c : new refcount 4
00000400:00000200:5.0:1773851854.032250:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df522108
00000100:00000001:7.0:1773851854.032251:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:5.0:1773851854.032251:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df522108.
00000100:00000001:5.0:1773851854.032251:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851854.032252:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851854.032253:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000800:00000200:5.0:1773851854.032254:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 19537@kfi7(00000000a85ca4a6):0x0 lsk 3426 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd61 Transaction freed
00000800:00000200:30.0:1773851854.091182:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851854.091183:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851854.091184:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851854.091186:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851854.091188:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:30.0:1773851854.091189:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12512@kfi7 : PUT - for me
00000400:00000200:30.0:1773851854.091190:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:30.0:1773851854.091192:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 1
00000400:00000200:30.0:1773851854.091193:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:30.0:1773851854.091194:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000400:00000200:30.0:1773851854.091195:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 3
00000400:00000200:30.0:1773851854.091195:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12321@kfi7 to cpt 7
00000400:00000200:30.0:1773851854.091196:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12321@kfi7 of length 224 into portal 12 MB=0x69b4b5667b740
00000400:00000200:30.0:1773851854.091198:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12321@kfi7 of length 224/224 into md 0x77fe139dd [64] + 160904
00000800:00000200:30.0:1773851854.091199:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851854.091201:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851854.091202:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12512@kfi7: PUT: OK
00000100:00000001:30.0:1773851854.091203:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851854.091204:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851854.091204:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000088cead73.
00000100:00000040:30.0:1773851854.091205:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000088cead73 x1859597734754112 msgsize 224
00000100:00100000:30.0:1773851854.091207:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-12321@kfi7 (source: 12345-12512@kfi7)
00000100:00000001:30.0:1773851854.091208:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851854.091208:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000100:00000001:31.0:1773851854.091209:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851854.091210:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851854.091210:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851854.091210:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851854.091211:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.091211:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851854.091212:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597734754112
00000020:00000001:31.0:1773851854.091213:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851854.091213:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7d3d9
00000020:00000001:31.0:1773851854.091214:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851854.091217:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ba76814c refcount=5
00000020:00000001:31.0:1773851854.091217:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092408504320 : -106981301047296 : ffff9eb3798db000)
00000020:00000001:31.0:1773851854.091218:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637092408504320 : -106981301047296 : ffff9eb3798db000)
00000100:00000001:31.0:1773851854.091219:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.091221:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851854.091221:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f353d06.
00000020:00000010:31.0:1773851854.091222:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851854.091223:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851854.091224:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851854.091224:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851854.091225:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.091226:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851854.091226:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851854.091226:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.091227:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.091228:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851854.091229:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851854.091229:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851854.091229:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851854.091230:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12321@kfi7, seq: 2055458
00000100:00000040:31.0:1773851854.091231:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ba76814c : new rpc_count 1
00000100:00000001:29.0:1773851854.091231:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.091231:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.091232:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000829056 : -107100708722560 : ffff9e97ac4d2880)
00000100:00000040:31.0:1773851854.091233:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000088cead73 x1859597734754112/t0(0) o400->94b4f77a-d744-4fde-b718-8ac986464a78@12321@kfi7:642/0 lens 224/0 e 0 to 0 dl 1773852002 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1263-0'
00000100:00000001:31.0:1773851854.091235:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.091236:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851854.091237:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088cead73 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:94b4f77a-d744-4fde-b718-8ac986464a78+5:39597:x1859597734754112:12345-12321@kfi7:400:default-tuolumne1263-0
00000100:00000200:31.0:1773851854.091238:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597734754112
00000020:00000001:31.0:1773851854.091239:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851854.091239:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851854.091240:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.091240:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851854.091241:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851854.091242:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851854.091242:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597734754112, found 0 last_xid 1859597734754111
00000020:00000001:31.0:1773851854.091243:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851854.091244:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851854.091245:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851854.091245:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.091246:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851854.091246:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851854.091247:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851854.091248:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b4252b4e.
02000000:00000001:31.0:1773851854.091249:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.091249:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.091250:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851854.091250:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096677557, transno 0, xid 1859597734754112
00010000:00000001:31.0:1773851854.091251:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851854.091252:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000088cead73 x1859597734754112/t0(0) o400->94b4f77a-d744-4fde-b718-8ac986464a78@12321@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1263-0'
00010000:00000001:31.0:1773851854.091254:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851854.091255:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851854.091256:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=87 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851854.091256:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851854.091257:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000314956ff refcount 3 to 12321@kfi7
00000100:00000001:31.0:1773851854.091258:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869934400 : -107137839617216 : ffff9e8f0720ab40)
02000000:00000001:31.0:1773851854.091259:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851854.091259:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.091260:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851854.091261:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12512@kfi7
00000400:00000010:31.0:1773851854.091261:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fab8ac69.
00000100:00000200:31.0:1773851854.091262:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597734754112, offset 224
00000400:00000200:31.0:1773851854.091263:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12512@kfi7
00000400:00000200:31.0:1773851854.091264:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.091265:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 1
00000400:00000200:31.0:1773851854.091266:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000400:00000200:31.0:1773851854.091267:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 3
00000400:00000200:31.0:1773851854.091268:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12512@kfi7 local destination
00000400:00000200:31.0:1773851854.091269:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768590:8768590:1024:4294967295] 12512@kfi7 LPNI seq info [410713:410713:16:4294967295]
00000400:00000200:31.0:1773851854.091271:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000400:00000200:31.0:1773851854.091272:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.091274:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12512@kfi7(12512@kfi7:12512@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851854.091275:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 3
00000800:00000200:31.0:1773851854.091276:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851854.091277:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851854.091279:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851854.091281:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5ce Using peer 12512@kfi7(0x5ce)
00000800:00000200:31.0:1773851854.091284:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x5ce: rc=0
00000800:00000200:31.0:1773851854.091285:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851854.091287:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.091288:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000314956ff refcount 2 to 12321@kfi7
00010000:00000001:31.0:1773851854.091289:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851854.091289:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.091290:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851854.091290:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000088cead73 x1859597734754112/t0(0) o400->94b4f77a-d744-4fde-b718-8ac986464a78@12321@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1263-0'
00000100:00100000:31.0:1773851854.091293:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088cead73 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:94b4f77a-d744-4fde-b718-8ac986464a78+5:39597:x1859597734754112:12345-12321@kfi7:400:default-tuolumne1263-0 Request processed in 57us (87us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851854.091295:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12321@kfi7, seq: 2055458
00000100:00000040:31.0:1773851854.091296:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ba76814c : new rpc_count 0
00000100:00000001:31.0:1773851854.091297:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851854.091297:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851854.091298:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851854.091298:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000800:00000200:29.0:1773851854.091298:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5ce TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851854.091299:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f353d06.
00000400:00000200:29.0:1773851854.091299:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851854.091300:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000ba76814c : new refcount 4
00000400:00000200:29.0:1773851854.091300:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12512@kfi7: PUT: OK
00000100:00000001:31.0:1773851854.091301:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851854.091301:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fab8ac69
00000400:00000010:29.0:1773851854.091302:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fab8ac69.
00000100:00000001:29.0:1773851854.091302:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851854.091303:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851854.091304:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000800:00000200:29.0:1773851854.091305:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12512@kfi7(0000000038544585):0x0 lsk 1487 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5ce Transaction freed
00000800:00000200:9.0:1773851854.104942:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851854.104943:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851854.104944:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851854.104944:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851854.104945:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851854.104947:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8722@kfi7(00000000c7e8dc80):0x11e2 version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851854.104948:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851854.104948:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 Using peer 8722@kfi7(0x1000000000011e2)
00000400:00000200:9.0:1773851854.104950:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8722@kfi7 to cpt 2
00000800:00000200:10.0:1773851854.104951:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851854.104953:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 38 bytes to peer 0x1000000000011e2: rc=0
00000800:00000200:9.0:1773851854.104954:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851854.104955:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8722@kfi7 to cpt 2
00000400:00000200:10.0:1773851854.104957:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8722@kfi7 : PUT - for me
00000400:00000200:10.0:1773851854.104959:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8722@kfi7 to cpt 2
00000400:00000200:10.0:1773851854.104960:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000535e76e0 nid 8722@kfi7 refs 1
00000400:00000200:10.0:1773851854.104962:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8722@kfi7 to cpt 2
00000400:00000200:10.0:1773851854.104963:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000535e76e0 nid 8722@kfi7 refs 2
00000400:00000200:10.0:1773851854.104965:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000535e76e0 nid 8722@kfi7 refs 3
00000400:00000200:10.0:1773851854.104966:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8915@kfi7 to cpt 7
00000800:00000200:9.0:1773851854.104967:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851854.104968:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8915@kfi7 of length 224 into portal 12 MB=0x69b4bfa4404c0
00000800:00000200:9.0:1773851854.104969:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 Transaction freed
00000400:00000200:10.0:1773851854.104970:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8915@kfi7 of length 224/224 into md 0x78146ce49 [64] + 118104
00000800:00000200:10.0:1773851854.104974:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851854.104977:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851854.104979:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8722@kfi7: PUT: OK
00000100:00000001:10.0:1773851854.104980:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851854.104981:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851854.104982:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005af4f4c9.
00000100:00000040:10.0:1773851854.104983:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000005af4f4c9 x1859600483878080 msgsize 224
00000100:00100000:10.0:1773851854.104986:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-8915@kfi7 (source: 12345-8722@kfi7)
00000100:00000001:10.0:1773851854.104988:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851854.104989:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000535e76e0 nid 8722@kfi7 refs 2
00000100:00000001:8.0:1773851854.104990:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851854.104991:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851854.104992:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851854.104992:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851854.104993:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.104994:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851854.104996:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600483878080
00000020:00000001:8.0:1773851854.104997:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851854.104997:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7a0d5
00000020:00000001:8.0:1773851854.104998:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851854.105002:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b60f90a5 refcount=8
00000020:00000001:8.0:1773851854.105004:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934456947712 : -107139252603904 : ffff9e8eb2e83400)
00000020:00000001:8.0:1773851854.105005:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934456947712 : -107139252603904 : ffff9e8eb2e83400)
00000100:00000001:8.0:1773851854.105006:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851854.105008:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851854.105009:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005de312e6.
00000020:00000010:8.0:1773851854.105010:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851854.105012:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851854.105013:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851854.105014:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851854.105015:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.105016:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851854.105017:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851854.105018:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.105019:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851854.105022:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851854.105022:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851854.105022:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851854.105023:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851854.105024:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8915@kfi7, seq: 2130720
00000100:00000001:11.0:1773851854.105025:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.105025:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b60f90a5 : new rpc_count 1
00000100:00000001:8.0:1773851854.105026:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077443072 : -106968632108544 : ffff9eb66cae5a00)
00000100:00000001:11.0:1773851854.105027:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.105028:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005af4f4c9 x1859600483878080/t0(0) o400->546589f1-5243-4d08-8810-91f5d7737d00@8915@kfi7:642/0 lens 224/0 e 0 to 0 dl 1773852002 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1045-0'
00000100:00000001:8.0:1773851854.105033:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851854.105034:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851854.105035:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005af4f4c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:546589f1-5243-4d08-8810-91f5d7737d00+8:39601:x1859600483878080:12345-8915@kfi7:400:default-tuolumne1045-0
00000100:00000200:8.0:1773851854.105038:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600483878080
00000020:00000001:8.0:1773851854.105039:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851854.105040:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851854.105041:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.105042:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851854.105042:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851854.105044:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851854.105045:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600483878080, found 0 last_xid 1859600483878079
00000020:00000001:8.0:1773851854.105046:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851854.105047:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851854.105048:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851854.105049:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.105050:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851854.105051:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851854.105051:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851854.105053:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000073849ec.
02000000:00000001:8.0:1773851854.105054:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.105055:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.105056:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851854.105057:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859600483878080
00010000:00000001:8.0:1773851854.105058:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851854.105060:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005af4f4c9 x1859600483878080/t0(0) o400->546589f1-5243-4d08-8810-91f5d7737d00@8915@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1045-0'
00010000:00000001:8.0:1773851854.105064:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851854.105065:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851854.105066:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=87 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851854.105068:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851854.105069:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee3ab4df refcount 3 to 8915@kfi7
00000100:00000001:8.0:1773851854.105070:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270144 : -107152618281472 : ffff9e8b96402600)
02000000:00000001:8.0:1773851854.105071:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851854.105072:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.105073:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851854.105075:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8722@kfi7
00000400:00000010:8.0:1773851854.105076:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042ed2e1b.
00000100:00000200:8.0:1773851854.105077:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600483878080, offset 224
00000400:00000200:8.0:1773851854.105079:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8722@kfi7
00000400:00000200:8.0:1773851854.105081:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8722@kfi7 to cpt 2
00000400:00000200:8.0:1773851854.105082:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000535e76e0 nid 8722@kfi7 refs 1
00000400:00000200:8.0:1773851854.105084:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000535e76e0 nid 8722@kfi7 refs 2
00000400:00000200:8.0:1773851854.105086:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000535e76e0 nid 8722@kfi7 refs 3
00000400:00000200:8.0:1773851854.105088:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8722@kfi7 local destination
00000400:00000200:8.0:1773851854.105090:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768591:8768591:1024:4294967295] 8722@kfi7 LPNI seq info [33671:33671:16:4294967295]
00000400:00000200:8.0:1773851854.105092:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000535e76e0 nid 8722@kfi7 refs 2
00000400:00000200:8.0:1773851854.105094:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8722@kfi7 to cpt 2
00000400:00000200:8.0:1773851854.105097:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8722@kfi7(8722@kfi7:8722@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851854.105099:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000535e76e0 nid 8722@kfi7 refs 3
00000800:00000200:8.0:1773851854.105102:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851854.105104:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851854.105108:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851854.105111:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 Using peer 8722@kfi7(0x1000000000011e2)
00000800:00000200:8.0:1773851854.105116:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1000000000011e2: rc=0
00000800:00000200:8.0:1773851854.105118:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851854.105121:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.105122:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee3ab4df refcount 2 to 8915@kfi7
00010000:00000001:8.0:1773851854.105124:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851854.105126:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.105127:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851854.105129:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005af4f4c9 x1859600483878080/t0(0) o400->546589f1-5243-4d08-8810-91f5d7737d00@8915@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1045-0'
00000100:00100000:8.0:1773851854.105134:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005af4f4c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:546589f1-5243-4d08-8810-91f5d7737d00+8:39601:x1859600483878080:12345-8915@kfi7:400:default-tuolumne1045-0 Request processed in 100us (149us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851854.105137:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8915@kfi7, seq: 2130720
00000100:00000040:8.0:1773851854.105139:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b60f90a5 : new rpc_count 0
00000100:00000001:8.0:1773851854.105140:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851854.105141:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851854.105142:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851854.105143:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851854.105144:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005de312e6.
00000020:00000040:8.0:1773851854.105145:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b60f90a5 : new refcount 7
00000100:00000001:8.0:1773851854.105146:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851854.105152:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851854.105154:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.105155:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8722@kfi7: PUT: OK
00000400:00000200:9.0:1773851854.105156:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042ed2e1b
00000400:00000010:9.0:1773851854.105157:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042ed2e1b.
00000100:00000001:9.0:1773851854.105157:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851854.105158:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851854.105159:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000535e76e0 nid 8722@kfi7 refs 2
00000800:00000200:9.0:1773851854.105160:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 8722@kfi7(00000000c7e8dc80):0x0 lsk 4579 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e2 Transaction freed
00000004:00000001:30.0:1773851854.153731:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851854.153731:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:4.0:1773851854.153731:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851854.153732:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:7.0:1773851854.153732:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:5.0:1773851854.153732:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851854.153732:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:4.0:1773851854.153732:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851854.153733:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031392470.
00000100:00000010:7.0:1773851854.153733:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc290a1f.
00000100:00000010:5.0:1773851854.153733:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b974fa3.
00000100:00000010:4.0:1773851854.153733:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000083f226b7.
00000020:00000040:30.0:1773851854.153734:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000020:00000040:7.0:1773851854.153734:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000040:5.0:1773851854.153734:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000020:00000040:4.0:1773851854.153734:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:30.0:1773851854.153735:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:7.0:1773851854.153735:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851854.153735:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:5.0:1773851854.153735:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851854.153735:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851854.153735:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851854.153736:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851854.153736:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851854.153737:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851854.153737:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851854.153737:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851854.153737:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851854.153738:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006dbfd28d.
02000000:00000010:7.0:1773851854.153738:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000607a30e5.
02000000:00000010:5.0:1773851854.153738:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000100f702c.
02000000:00000010:4.0:1773851854.153738:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000022c33118.
00000100:00000001:7.0:1773851854.153739:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.153739:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153739:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851854.153740:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153740:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851854.153740:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851854.153740:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851854.153741:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851854.153741:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153741:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.153741:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153741:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.153742:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000cc290a1f] to pc [ptlrpcd_01_03+3]  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851854.153742:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002b974fa3] to pc [ptlrpcd_01_01+1]  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851854.153742:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000083f226b7] to pc [ptlrpcd_01_00+0]  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851854.153743:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000031392470] to pc [ptlrpcd_07_00+0]  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851854.153746:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851854.153747:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:30.0:1773851854.153748:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003c8399ec.
00000100:00000001:7.0:1773851854.153748:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851854.153748:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851854.153748:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851854.153748:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851854.153749:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:31.0:1773851854.153749:0:41089:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00080000:00000001:30.0:1773851854.153749:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637112132965376 : -106961576586240 : ffff9eb811391400)
00000100:00000001:28.0:1773851854.153749:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851854.153749:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153749:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851854.153749:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851854.153749:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:5.0:1773851854.153749:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000096dccd8c.
00000004:00000001:4.0:1773851854.153749:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.153750:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:30.0:1773851854.153750:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:7.0:1773851854.153750:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851854.153750:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637050943760384 : -107022765791232 : ffff9ea9d20fe800)
00000100:00000001:31.0:1773851854.153751:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851854.153751:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:30.0:1773851854.153751:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851854.153751:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851854.153751:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851854.153752:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:30.0:1773851854.153752:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00080000:00000001:5.0:1773851854.153752:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153752:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851854.153752:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.153753:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851854.153753:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:30.0:1773851854.153753:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000089219e7e.
00000100:00000001:7.0:1773851854.153753:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851854.153753:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851854.153753:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000004:00000010:5.0:1773851854.153753:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000083be369b.
00000100:00000040:31.0:1773851854.153754:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:30.0:1773851854.153754:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614128607029381ns, next at 614129607028189ns, rc = 0
02000000:00000001:7.0:1773851854.153754:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851854.153755:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851854.153755:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:30.0:1773851854.153756:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:7.0:1773851854.153756:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b974fa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051923072:3@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851854.153756:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851854.153756:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614128607031835ns, next at 614129607028800ns, rc = 0
00000100:00000001:4.0:1773851854.153756:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851854.153757:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:30.0:1773851854.153757:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851854.153757:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153757:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851854.153757:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:5.0:1773851854.153757:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851854.153757:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851854.153757:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:31.0:1773851854.153758:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.153758:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851854.153758:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851854.153758:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851854.153758:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851854.153758:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851854.153758:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851854.153759:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851854.153759:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:6.0:1773851854.153759:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc290a1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051922944:7@kfi7:41:default-yuba2-0
00000004:00000001:5.0:1773851854.153759:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851854.153760:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031392470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051923136:2080@kfi7:13:default-yuba2-0
02000000:00000010:7.0:1773851854.153760:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000556caab8.
02000000:00000001:7.0:1773851854.153760:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.153761:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:7.0:1773851854.153761:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:4.0:1773851854.153761:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851854.153761:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.153762:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:7.0:1773851854.153762:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000100:00000001:6.0:1773851854.153762:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851854.153762:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851854.153763:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.153763:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:7.0:1773851854.153763:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
02000000:00000001:6.0:1773851854.153763:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851854.153763:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851854.153764:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923072, portal 4
02000000:00000001:6.0:1773851854.153764:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851854.153764:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083f226b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051923008:2098@kfi7:41:default-yuba2-0
02000000:00000010:31.0:1773851854.153765:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e9f67bb0.
02000000:00000001:31.0:1773851854.153765:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153765:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:6.0:1773851854.153765:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:4.0:1773851854.153765:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:31.0:1773851854.153766:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:7.0:1773851854.153766:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637133046245248 : -106940663306368 : ffff9ebcefc06780)
02000000:00000010:6.0:1773851854.153766:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005041e9c5.
02000000:00000001:4.0:1773851854.153766:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851854.153766:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851854.153767:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000100:00000040:7.0:1773851854.153767:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851854.153767:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851854.153767:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851854.153767:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008c84125c.
00000400:00000010:31.0:1773851854.153768:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000811703b3.
02000000:00000001:4.0:1773851854.153768:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851854.153769:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923136, portal 4
00000100:00000001:7.0:1773851854.153769:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851854.153769:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:4.0:1773851854.153769:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000100:00000001:31.0:1773851854.153770:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851854.153770:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636973000839424 : -107100708712192 : ffff9e97ac4d5100)
00000100:00000040:7.0:1773851854.153770:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000200:6.0:1773851854.153770:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:4.0:1773851854.153770:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000400:00000010:7.0:1773851854.153771:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034f580d9.
00000400:00000010:6.0:1773851854.153771:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000200:4.0:1773851854.153771:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923008, portal 4
00000100:00000040:31.0:1773851854.153772:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851854.153772:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923072, offset 0
00000100:00000001:4.0:1773851854.153772:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851854.153772:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528722560 : -106978180829056 : ffff9eb433887080)
00000400:00000200:7.0:1773851854.153773:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000010:6.0:1773851854.153773:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4270b1f.
00000100:00000001:31.0:1773851854.153774:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851854.153774:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:7.0:1773851854.153774:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000200:6.0:1773851854.153774:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051922944, portal 4
00000100:00000040:4.0:1773851854.153774:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851854.153775:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000200:7.0:1773851854.153775:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000010:31.0:1773851854.153776:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007bba7902.
00000100:00000001:6.0:1773851854.153776:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851854.153776:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309143168 : -106994400408448 : ffff9eb06cc54c80)
00000100:00000001:4.0:1773851854.153776:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:31.0:1773851854.153777:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923136, offset 0
00000400:00000200:7.0:1773851854.153777:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000040:4.0:1773851854.153777:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000200:31.0:1773851854.153778:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:7.0:1773851854.153778:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000400:00000010:4.0:1773851854.153778:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a0b1f78.
00000100:00000200:4.0:1773851854.153778:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051923008, offset 0
00000400:00000200:31.0:1773851854.153779:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000040:6.0:1773851854.153779:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851854.153780:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768590, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768591, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851854.153780:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:31.0:1773851854.153781:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:31.0:1773851854.153782:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851854.153782:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851854.153783:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:6.0:1773851854.153783:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851854.153784:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851854.153784:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000400:00000200:31.0:1773851854.153785:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:7.0:1773851854.153785:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768592:8768592:1024:4294967295] 3@kfi7 LPNI seq info [5406217:5406217:16:4294967295]
00000100:00000040:6.0:1773851854.153785:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000200:7.0:1773851854.153786:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000010:6.0:1773851854.153786:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c906ec4e.
00000400:00000200:31.0:1773851854.153787:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768592, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768591, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851854.153787:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000200:6.0:1773851854.153787:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051922944, offset 0
00000400:00000200:4.0:1773851854.153788:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:31.0:1773851854.153789:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851854.153789:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:4.0:1773851854.153789:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:31.0:1773851854.153790:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851854.153790:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:31.0:1773851854.153791:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:31.0:1773851854.153792:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768593:8768593:1024:4294967295] 2080@kfi7 LPNI seq info [5404388:5404388:16:4294967295]
00000400:00000200:4.0:1773851854.153792:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:31.0:1773851854.153793:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:4.0:1773851854.153793:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000400:00000200:31.0:1773851854.153794:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:4.0:1773851854.153795:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768592, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768593, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851854.153797:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851854.153797:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851854.153798:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851854.153798:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851854.153798:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000400:00000200:4.0:1773851854.153799:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:31.0:1773851854.153800:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:7.0:1773851854.153800:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:4.0:1773851854.153800:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346193, 20346196]
00000800:00000200:31.0:1773851854.153801:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851854.153802:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851854.153802:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000800:00000200:31.0:1773851854.153803:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851854.153803:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768594:8768594:1023:4294967295] 2105@kfi7 LPNI seq info [20346197:20346197:16:4294967295]
00000800:00000200:7.0:1773851854.153804:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851854.153805:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000400:00000200:4.0:1773851854.153805:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000800:00000200:7.0:1773851854.153806:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851854.153806:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:6.0:1773851854.153807:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:31.0:1773851854.153809:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000800:00000200:7.0:1773851854.153809:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Using peer 3@kfi7(0x3b9)
00000400:00000200:6.0:1773851854.153809:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000800:00000200:31.0:1773851854.153810:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851854.153810:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851854.153811:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:4.0:1773851854.153811:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:31.0:1773851854.153812:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.153813:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851854.153813:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851854.153813:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x3b9: rc=0
00000400:00000200:6.0:1773851854.153813:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000800:00000200:4.0:1773851854.153813:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:31.0:1773851854.153814:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851854.153814:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:31.0:1773851854.153815:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851854.153815:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851854.153815:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000100:00000001:7.0:1773851854.153817:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851854.153817:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:7.0:1773851854.153818:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851854.153818:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8768594, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768593, p:4294967295, g:4294967295, h:1000]
00000100:00000001:7.0:1773851854.153819:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153819:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153820:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:4.0:1773851854.153820:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000100:00000001:7.0:1773851854.153821:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851854.153822:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851854.153822:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:6.0:1773851854.153822:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:7.0:1773851854.153823:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851854.153823:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851854.153823:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851854.153823:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851854.153824:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851854.153824:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851854.153825:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000400:00000200:6.0:1773851854.153825:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851854.153826:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007bba7902
00000400:00000200:6.0:1773851854.153826:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340055, 17340054]
00000400:00000010:29.0:1773851854.153827:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007bba7902.
00000100:00000001:29.0:1773851854.153828:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851854.153829:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851854.153829:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851854.153830:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000800:00000200:4.0:1773851854.153830:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x4c6: rc=0
00000400:00000200:5.0:1773851854.153831:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851854.153832:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:6.0:1773851854.153832:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768595:8768595:1023:4294967295] 7@kfi7 LPNI seq info [17340056:17340056:16:4294967295]
00000400:00000200:5.0:1773851854.153832:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000800:00000200:4.0:1773851854.153832:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851854.153833:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034f580d9
00000400:00000010:5.0:1773851854.153833:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034f580d9.
00000100:00000040:29.0:1773851854.153834:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851854.153834:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:5.0:1773851854.153834:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:4.0:1773851854.153834:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153834:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:5.0:1773851854.153835:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851854.153835:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851854.153836:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:4.0:1773851854.153836:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.153837:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.153837:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851854.153838:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851854.153839:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:5.0:1773851854.153839:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:29.0:1773851854.153840:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Transaction freed
00000100:00000040:5.0:1773851854.153840:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851854.153840:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851854.153840:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:6.0:1773851854.153841:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000100:00000001:4.0:1773851854.153841:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851854.153841:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:6.0:1773851854.153843:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:5.0:1773851854.153843:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.153843:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851854.153844:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:4.0:1773851854.153845:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153845:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851854.153846:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851854.153846:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851854.153846:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Transaction freed
00000800:00000200:6.0:1773851854.153848:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851854.153849:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851854.153850:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:7.0:1773851854.153851:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a0b1f78
00000400:00000010:7.0:1773851854.153851:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a0b1f78.
00000100:00000001:7.0:1773851854.153852:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:6.0:1773851854.153852:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:7.0:1773851854.153853:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851854.153856:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851854.153857:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851854.153857:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a Using peer 7@kfi7(0x20000000000119a)
00000800:00000200:29.0:1773851854.153862:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:6.0:1773851854.153862:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 324 bytes to peer 0x20000000000119a: rc=0
00000100:00000001:7.0:1773851854.153863:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851854.153864:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:7.0:1773851854.153864:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851854.153865:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851854.153865:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:6.0:1773851854.153865:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851854.153867:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Transaction freed
00000800:00000200:29.0:1773851854.153868:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:6.0:1773851854.153869:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851854.153870:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851854.153871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:6.0:1773851854.153871:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851854.153872:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:29.0:1773851854.153873:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:6.0:1773851854.153873:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851854.153874:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000001:6.0:1773851854.153874:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851854.153875:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:6.0:1773851854.153875:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:29.0:1773851854.153876:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:6.0:1773851854.153876:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851854.153877:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:5.0:1773851854.153877:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851854.153878:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:6.0:1773851854.153878:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851854.153878:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851854.153879:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2280
00000800:00000200:9.0:1773851854.153879:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:6.0:1773851854.153879:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851854.153879:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851854.153880:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851854.153880:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000400:00000200:29.0:1773851854.153881:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:9.0:1773851854.153881:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851854.153881:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c906ec4e
00000400:00000010:5.0:1773851854.153881:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c906ec4e.
00000100:00000001:5.0:1773851854.153882:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851854.153883:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78007fafd [1] + 224
00000800:00000200:25.0:1773851854.153883:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:9.0:1773851854.153883:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:5.0:1773851854.153883:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851854.153885:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851854.153886:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851854.153886:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851854.153887:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851854.153887:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851854.153887:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:5.0:1773851854.153887:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851854.153889:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000100:00000001:29.0:1773851854.153890:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:25.0:1773851854.153891:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851854.153891:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000200:29.0:1773851854.153892:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851854.153893:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000100:00000001:5.0:1773851854.153893:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.153894:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:29.0:1773851854.153895:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851854.153895:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:5.0:1773851854.153895:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:9.0:1773851854.153896:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.153897:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000800:00000200:5.0:1773851854.153897:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a Transaction freed
00000400:00000200:25.0:1773851854.153898:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:9.0:1773851854.153899:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:29.0:1773851854.153900:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:25.0:1773851854.153900:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:9.0:1773851854.153901:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:29.0:1773851854.153902:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:25.0:1773851854.153902:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000100:00000001:7.0:1773851854.153902:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851854.153903:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000100:00000001:7.0:1773851854.153903:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851854.153904:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851854.153904:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000001:7.0:1773851854.153904:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:25.0:1773851854.153905:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:9.0:1773851854.153905:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000001:7.0:1773851854.153905:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851854.153906:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000400:00000200:7.0:1773851854.153906:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000200:25.0:1773851854.153907:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000010:7.0:1773851854.153907:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000100:00000001:7.0:1773851854.153908:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851854.153909:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851854.153909:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b22c0
00000100:00000200:7.0:1773851854.153909:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851854.153911:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2240
00000400:00000200:9.0:1773851854.153911:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000200:7.0:1773851854.153912:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851854.153913:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851854.153913:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781696c09 [1] + 224
00000800:00000200:13.0:1773851854.153915:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:25.0:1773851854.153916:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b2ff05 [1] + 224
00000800:00000200:13.0:1773851854.153916:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:7.0:1773851854.153916:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:9.0:1773851854.153917:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851854.153917:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851854.153918:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851854.153918:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851854.153919:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000800:00000200:25.0:1773851854.153920:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851854.153920:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851854.153920:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851854.153921:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851854.153922:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851854.153922:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
02000000:00000001:7.0:1773851854.153922:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851854.153923:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851854.153923:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:7.0:1773851854.153924:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=87 v=66 (66 66 66 66)
00000400:00000200:25.0:1773851854.153925:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:13.0:1773851854.153925:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:25.0:1773851854.153926:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851854.153926:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:7.0:1773851854.153926:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=87 v=66 (1 1 1 1)
00000400:00000200:13.0:1773851854.153927:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 7@kfi7 : PUT - for me
00000100:00000200:25.0:1773851854.153928:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851854.153928:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:13.0:1773851854.153929:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:7.0:1773851854.153929:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851854.153930:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:13.0:1773851854.153931:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00010000:00000001:7.0:1773851854.153931:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851854.153932:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851854.153933:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:7.0:1773851854.153933:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:13.0:1773851854.153934:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000040:7.0:1773851854.153934:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000040:25.0:1773851854.153935:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851854.153935:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:13.0:1773851854.153936:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:7.0:1773851854.153936:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.153937:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:13.0:1773851854.153938:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:9.0:1773851854.153938:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851854.153939:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2200
00000400:00000200:9.0:1773851854.153940:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:13.0:1773851854.153941:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:31.0:1773851854.153942:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851854.153942:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:25.0:1773851854.153942:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:9.0:1773851854.153942:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851854.153943:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:7.0:1773851854.153943:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:13.0:1773851854.153944:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f55ed [1] + 224
00000100:00000001:7.0:1773851854.153944:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851854.153944:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851854.153945:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851854.153945:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:25.0:1773851854.153946:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000004:00000001:7.0:1773851854.153946:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000001:4.0:1773851854.153946:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851854.153946:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:13.0:1773851854.153947:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:4.0:1773851854.153947:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000004:00000040:7.0:1773851854.153948:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000400:00000200:4.0:1773851854.153948:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851854.153948:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000004:00000040:7.0:1773851854.153949:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353649152 avail=351351227392 avail_mb=1372465732 hwm_mb=3131101 files=372083391 ffree=343118798 state=0: rc = 0
00000100:00000001:4.0:1773851854.153950:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851854.153951:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:4.0:1773851854.153951:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851854.153953:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000004:00000020:7.0:1773851854.153953:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353649152 free, 351351227392 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083391 files, 343118798 free files
00000100:00000200:4.0:1773851854.153954:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851854.153955:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:31.0:1773851854.153956:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851854.153957:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:13.0:1773851854.153957:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851854.153957:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153957:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:31.0:1773851854.153958:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000100:00000040:7.0:1773851854.153958:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851854.153958:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851854.153958:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851854.153959:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851854.153959:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:31.0:1773851854.153960:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000811703b3
00000100:00000001:4.0:1773851854.153960:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851854.153961:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000811703b3.
02000000:00000001:4.0:1773851854.153961:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.153962:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:4.0:1773851854.153962:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=87 v=66 (66 66 66 66)
00000100:00000040:13.0:1773851854.153963:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:4.0:1773851854.153963:0:41064:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=87 v=66 (1 1 1 1)
00000100:00000200:31.0:1773851854.153964:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:7.0:1773851854.153964:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b974fa3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051923072:3@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851854.153964:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851854.153964:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851854.153965:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851854.153966:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153967:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851854.153967:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851854.153967:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:7.0:1773851854.153968:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851854.153968:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851854.153968:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.153969:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:4.0:1773851854.153969:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:31.0:1773851854.153970:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851854.153970:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002b974fa3 x1859433051923072/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:13.0:1773851854.153971:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:6.0:1773851854.153971:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851854.153972:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:6.0:1773851854.153973:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851854.153973:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:13.0:1773851854.153974:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851854.153974:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000010:6.0:1773851854.153974:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000100:00000001:31.0:1773851854.153975:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851854.153975:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851854.153975:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:6.0:1773851854.153975:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4270b1f
02000000:00000010:7.0:1773851854.153976:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000556caab8.
00000400:00000010:6.0:1773851854.153976:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4270b1f.
00000100:00000001:4.0:1773851854.153976:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851854.153976:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851854.153977:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:6.0:1773851854.153977:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:4.0:1773851854.153977:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851854.153977:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:31.0:1773851854.153978:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851854.153978:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000001:7.0:1773851854.153978:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000200:6.0:1773851854.153978:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:4.0:1773851854.153978:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000096 blocks, 31354646688 free, 31354616992 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064187 files, 2870603639 free files
00000100:00000001:31.0:1773851854.153979:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.153979:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851854.153980:0:41065:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000004:00000001:4.0:1773851854.153980:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.153981:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.153981:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000200:6.0:1773851854.153981:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851854.153981:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:31.0:1773851854.153982:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=87 v=66 (66 66 66 66)
02000000:00000010:7.0:1773851854.153982:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000100f702c.
00000100:00001000:31.0:1773851854.153984:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=87 v=66 (1 1 1 1)
02000000:00000001:7.0:1773851854.153984:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:6.0:1773851854.153984:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:7.0:1773851854.153985:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851854.153985:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002b974fa3.
00000100:00000001:6.0:1773851854.153985:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:4.0:1773851854.153985:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083f226b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051923008:2098@kfi7:41:default-yuba2-0
00000100:00000001:31.0:1773851854.153986:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851854.153986:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851854.153986:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851854.153986:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.153987:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153987:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851854.153987:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851854.153987:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851854.153987:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153987:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00010000:00000001:31.0:1773851854.153988:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:6.0:1773851854.153988:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851854.153988:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000083f226b7 x1859433051923008/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:31.0:1773851854.153989:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153989:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:6.0:1773851854.153989:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=113 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851854.153990:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851854.153990:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00001000:6.0:1773851854.153990:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=119 v=66 (1 1 1 1)
00000100:00000040:31.0:1773851854.153991:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00000001:7.0:1773851854.153991:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.153991:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851854.153991:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:31.0:1773851854.153992:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851854.153992:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851854.153992:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851854.153992:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851854.153992:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008c84125c.
00000100:00000001:31.0:1773851854.153993:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.153993:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851854.153993:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851854.153993:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851854.153993:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851854.153993:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:31.0:1773851854.153994:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851854.153994:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000020:00000040:4.0:1773851854.153994:0:41064:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000040:6.0:1773851854.153995:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000020:00000001:4.0:1773851854.153995:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851854.153995:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000022c33118.
00000100:00000001:6.0:1773851854.153996:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851854.153996:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851854.153996:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:6.0:1773851854.153997:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:4.0:1773851854.153997:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851854.153997:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000083f226b7.
00000100:00000001:4.0:1773851854.153998:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851854.153999:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851854.153999:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851854.154000:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851854.154000:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851854.154001:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851854.154001:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851854.154001:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.154001:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851854.154002:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851854.154002:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851854.154002:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851854.154002:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.154003:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:6.0:1773851854.154003:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851854.154004:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000004:00000020:6.0:1773851854.154005:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031808 blocks, 31536853440 free, 31536799936 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425463 files, 2779493186 free files
00000004:00000040:31.0:1773851854.154006:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510718464 avail=351508084736 avail_mb=1373078456 hwm_mb=3131103 files=372095927 ffree=343272186 state=0: rc = 0
00000004:00000001:6.0:1773851854.154006:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851854.154008:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:6.0:1773851854.154011:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc290a1f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051922944:7@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851854.154012:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:31.0:1773851854.154013:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510718464 free, 351508084736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095927 files, 343272186 free files
00000100:00000001:6.0:1773851854.154013:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851854.154014:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000cc290a1f x1859433051922944/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:31.0:1773851854.154016:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.154017:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851854.154017:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851854.154017:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851854.154018:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005041e9c5.
02000000:00000001:6.0:1773851854.154019:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851854.154019:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851854.154020:0:41067:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000001:6.0:1773851854.154021:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851854.154021:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000607a30e5.
02000000:00000001:6.0:1773851854.154022:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00100000:31.0:1773851854.154023:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031392470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051923136:2080@kfi7:13:default-yuba2-0
02000000:00000001:6.0:1773851854.154023:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851854.154023:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc290a1f.
00000100:00000001:6.0:1773851854.154024:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851854.154024:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851854.154025:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.154026:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851854.154026:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851854.154026:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.154027:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851854.154027:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851854.154027:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.154029:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000031392470 x1859433051923136/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851854.154033:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851854.154034:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851854.154035:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e9f67bb0.
02000000:00000001:31.0:1773851854.154037:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851854.154038:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851854.154038:0:41089:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000020:00000001:31.0:1773851854.154040:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851854.154040:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006dbfd28d.
02000000:00000001:31.0:1773851854.154042:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851854.154043:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851854.154043:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031392470.
00000100:00000001:31.0:1773851854.154045:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851854.154046:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.154047:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.154048:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851854.154049:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.154050:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851854.154051:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851854.167695:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851854.167696:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851854.167722:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851854.167723:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851854.167754:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851854.167754:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851854.167780:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851854.167780:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851854.167938:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000ce3b9347 (tot 253201027).
00000400:00000010:30.0:1773851854.167940:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000ce3b9347 (tot 253200771).
00000800:00000200:6.0:1773851854.213315:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851854.213316:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851854.213318:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851854.213322:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851854.213326:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.213328:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11002@kfi7 : PUT - for me
00000400:00000200:6.0:1773851854.213329:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.213330:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 1
00000400:00000200:6.0:1773851854.213332:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.213333:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000400:00000200:6.0:1773851854.213335:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 3
00000400:00000200:6.0:1773851854.213336:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.213338:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11002@kfi7 of length 440 into portal 12 MB=0x699de8cc2ef00
00000400:00000200:6.0:1773851854.213340:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11002@kfi7 of length 440/440 into md 0x793926dc5 [64] + 117808
00000800:00000200:6.0:1773851854.213343:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851854.213346:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851854.213348:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11002@kfi7: PUT: OK
00000100:00000001:6.0:1773851854.213349:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851854.213350:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851854.213351:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ab24bd3.
00000100:00000040:6.0:1773851854.213353:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000005ab24bd3 x1858030983638784 msgsize 440
00000100:00100000:6.0:1773851854.213355:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-11002@kfi7 (source: 12345-11002@kfi7)
00000100:00000001:6.0:1773851854.213356:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851854.213358:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000100:00000001:7.0:1773851854.213359:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851854.213360:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851854.213360:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851854.213361:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851854.213361:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851854.213363:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851854.213364:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030983638784
00000020:00000001:7.0:1773851854.213365:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851854.213366:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911d5
00000020:00000001:7.0:1773851854.213367:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851854.213371:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000102b8067 refcount=6
00000020:00000001:7.0:1773851854.213371:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240545280 : -107152469006336 : ffff9e8b9f25e800)
00000020:00000001:7.0:1773851854.213373:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240545280 : -107152469006336 : ffff9e8b9f25e800)
00000100:00000001:7.0:1773851854.213375:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851854.213376:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851854.213378:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000c1e289c.
00000020:00000010:7.0:1773851854.213380:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851854.213381:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851854.213383:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851854.213384:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851854.213385:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.213387:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.213388:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.213390:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851854.213391:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851854.213391:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851854.213392:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851854.213393:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11002@kfi7, seq: 371100837
00000100:00000040:7.0:1773851854.213394:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000102b8067 : new rpc_count 1
00000100:00000001:5.0:1773851854.213394:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.213395:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092556032 : -106946616995584 : ffff9ebb8ce25100)
00000100:00000001:5.0:1773851854.213395:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.213398:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005ab24bd3 x1858030983638784/t0(0) o41->8b9ddf22-0076-4a43-bae0-8966102e80ab@11002@kfi7:75/0 lens 440/0 e 0 to 0 dl 1773852190 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne211-0'
00000100:00000001:7.0:1773851854.213402:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851854.213403:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851854.213404:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ab24bd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:8b9ddf22-0076-4a43-bae0-8966102e80ab+6:108306:x1858030983638784:12345-11002@kfi7:41:default-tuolumne211-0
00000100:00000200:7.0:1773851854.213407:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030983638784
00000020:00000001:7.0:1773851854.213408:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851854.213409:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851854.213410:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.213411:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851854.213412:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:7.0:1773851854.213414:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851854.213415:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030983638784, found 0 last_xid 1858030983638783
00000020:00000001:7.0:1773851854.213416:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851854.213417:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851854.213418:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851854.213418:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.213420:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851854.213421:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851854.213422:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000556caab8.
02000000:00000001:7.0:1773851854.213423:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.213424:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213426:0:61015:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:7.0:1773851854.213426:0:61015:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:7.0:1773851854.213427:0:61015:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213429:0:61015:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:7.0:1773851854.213431:0:61015:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851854.213433:0:61015:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213435:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851854.213436:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213438:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851854.213438:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213439:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851854.213440:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213441:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851854.213441:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213442:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851854.213443:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213445:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213445:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500140544 free, 351498047488 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097820 files, 343261856 free files
00000004:00000001:7.0:1773851854.213452:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213454:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213454:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504365568 free, 351502193664 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056321 files, 343265982 free files
00000004:00000001:7.0:1773851854.213456:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213457:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213458:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690117120 free, 351687688192 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231289 files, 343447380 free files
00000004:00000001:7.0:1773851854.213460:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213461:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213462:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382772736 free, 351380675584 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978826 files, 343147239 free files
00000004:00000001:7.0:1773851854.213464:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213465:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213465:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350959053824 free, 350956949504 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371564137 files, 342733451 free files
00000004:00000001:7.0:1773851854.213467:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213468:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213469:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351238656 free, 351348434944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084149 files, 343116444 free files
00000004:00000001:7.0:1773851854.213471:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213472:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213472:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482149888 free, 351481123840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097214 files, 343244287 free files
00000004:00000001:7.0:1773851854.213474:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213475:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213475:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449354240 free, 351446762496 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372161080 files, 343212260 free files
00000004:00000001:7.0:1773851854.213477:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213478:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213479:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353649152 free, 351351227392 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083391 files, 343118798 free files
00000004:00000001:7.0:1773851854.213480:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213482:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213482:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351389022208 free, 351386321920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019222 files, 343153342 free files
00000004:00000001:7.0:1773851854.213485:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213486:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213486:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406587904 free, 351404209152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127385 files, 343170496 free files
00000004:00000001:7.0:1773851854.213488:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213489:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213490:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351379065856 free, 351376106496 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019208 files, 343143619 free files
00000004:00000001:7.0:1773851854.213492:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213493:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213493:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466038272 free, 351462929408 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062971 files, 343228553 free files
00000004:00000001:7.0:1773851854.213495:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213496:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213496:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489086464 free, 351486007296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066932 files, 343251061 free files
00000004:00000001:7.0:1773851854.213498:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213499:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213500:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399726592 blocks, 351492805632 free, 351490399232 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078194 files, 343254693 free files
00000004:00000001:7.0:1773851854.213501:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213502:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213503:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399719424 blocks, 351524128768 free, 351521378304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372114012 files, 343285282 free files
00000004:00000001:7.0:1773851854.213505:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213506:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213507:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510718464 free, 351508084736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095927 files, 343272186 free files
00000004:00000001:7.0:1773851854.213509:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213509:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213510:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541593088 free, 351539441664 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136813 files, 343302337 free files
00000004:00000001:7.0:1773851854.213512:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213513:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213514:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470754816 free, 351461655552 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064680 files, 343233159 free files
00000004:00000001:7.0:1773851854.213516:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213517:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213518:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666736128 free, 351645489152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372238013 files, 343424547 free files
00000004:00000001:7.0:1773851854.213520:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213521:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213522:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545834496 free, 351536206848 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116555 files, 343306479 free files
00000004:00000001:7.0:1773851854.213524:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213525:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213525:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603975168 free, 351601704960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190563 files, 343363257 free files
00000004:00000001:7.0:1773851854.213527:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213528:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213529:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615885312 free, 351613266944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043550 files, 343374888 free files
00000004:00000001:7.0:1773851854.213531:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213532:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213533:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420286976 free, 351417833472 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372009086 files, 343183874 free files
00000004:00000001:7.0:1773851854.213535:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213536:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213536:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409079296 free, 351406989312 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011357 files, 343172929 free files
00000004:00000001:7.0:1773851854.213538:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213539:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213540:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351479990272 free, 351478736896 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073173 files, 343242178 free files
00000004:00000001:7.0:1773851854.213542:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213543:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213543:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593664512 free, 351576846336 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190086 files, 343353188 free files
00000004:00000001:7.0:1773851854.213545:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213546:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851854.213547:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464045568 free, 351458209792 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372060775 files, 343226607 free files
00000004:00000001:7.0:1773851854.213549:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213550:0:61015:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213551:0:61015:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:7.0:1773851854.213553:0:61015:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 40309318209241088 avail 40308838775128064
00000004:00000020:7.0:1773851854.213554:0:61015:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841142140928 free, 9841024983104 avail; 10969026243 objects: 9610490372 free; state 100
00000020:00000001:7.0:1773851854.213557:0:61015:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:7.0:1773851854.213561:0:61015:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851854.213562:0:61015:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851854.213564:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030983638784
00010000:00000001:7.0:1773851854.213565:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851854.213566:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005ab24bd3 x1858030983638784/t0(0) o41->8b9ddf22-0076-4a43-bae0-8966102e80ab@11002@kfi7:75/0 lens 440/368 e 0 to 0 dl 1773852190 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne211-0'
00010000:00000001:7.0:1773851854.213571:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851854.213571:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851854.213572:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=86 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851854.213574:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851854.213575:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003ea4911a refcount 3 to 11002@kfi7
00000100:00000001:7.0:1773851854.213577:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921094244896 : -107152615306720 : ffff9e8b966d8a20)
02000000:00000001:7.0:1773851854.213578:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851854.213579:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.213580:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851854.213581:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11002@kfi7
00000400:00000010:7.0:1773851854.213583:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000100:00000200:7.0:1773851854.213584:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030983638784, offset 224
00000400:00000200:7.0:1773851854.213586:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11002@kfi7
00000400:00000200:7.0:1773851854.213587:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.213588:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 1
00000400:00000200:7.0:1773851854.213590:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000400:00000200:7.0:1773851854.213592:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 3
00000400:00000200:7.0:1773851854.213593:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11002@kfi7 local destination
00000400:00000200:7.0:1773851854.213596:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768596:8768596:1024:4294967295] 11002@kfi7 LPNI seq info [28071:28071:16:4294967295]
00000400:00000200:7.0:1773851854.213599:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000400:00000200:7.0:1773851854.213600:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.213604:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11002@kfi7(11002@kfi7:11002@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851854.213605:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 3
00000800:00000200:7.0:1773851854.213608:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851854.213609:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:7.0:1773851854.213613:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851854.213617:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 Using peer 11002@kfi7(0x5a4)
00000800:00000200:7.0:1773851854.213621:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 468 bytes to peer 0x5a4: rc=0
00000800:00000200:7.0:1773851854.213624:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851854.213627:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.213628:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003ea4911a refcount 2 to 11002@kfi7
00010000:00000001:7.0:1773851854.213630:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851854.213630:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.213631:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851854.213633:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ab24bd3 x1858030983638784/t0(0) o41->8b9ddf22-0076-4a43-bae0-8966102e80ab@11002@kfi7:75/0 lens 440/368 e 0 to 0 dl 1773852190 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne211-0'
00000100:00100000:7.0:1773851854.213638:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ab24bd3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:8b9ddf22-0076-4a43-bae0-8966102e80ab+6:108306:x1858030983638784:12345-11002@kfi7:41:default-tuolumne211-0 Request processed in 234us (284us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851854.213638:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851854.213641:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851854.213642:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11002@kfi7, seq: 371100837
00000400:00000200:5.0:1773851854.213642:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11002@kfi7: PUT: OK
00000100:00000040:7.0:1773851854.213643:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000102b8067 : new rpc_count 0
00000400:00000200:5.0:1773851854.213643:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000100:00000001:7.0:1773851854.213644:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:5.0:1773851854.213644:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000100:00000001:7.0:1773851854.213645:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851854.213645:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851854.213646:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000100:00000001:5.0:1773851854.213646:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851854.213647:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000400:00000200:5.0:1773851854.213647:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000020:00000010:7.0:1773851854.213649:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000c1e289c.
00000800:00000200:5.0:1773851854.213649:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 Transaction freed
00000020:00000040:7.0:1773851854.213651:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000102b8067 : new refcount 5
00000100:00000001:7.0:1773851854.213652:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851854.214898:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851854.214899:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851854.214900:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851854.214900:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851854.214901:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851854.214901:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851854.214903:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12721@kfi7(000000007fdf4b09):0xec3 version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851854.214904:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851854.214905:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12721@kfi7 to cpt 6
00000800:00000200:25.0:1773851854.214905:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 Using peer 12721@kfi7(0x100000000000ec3)
00000400:00000200:26.0:1773851854.214907:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12721@kfi7 : PUT - for me
00000400:00000200:25.0:1773851854.214907:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12721@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.214908:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12721@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.214909:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003202478c nid 12721@kfi7 refs 1
00000800:00000200:25.0:1773851854.214910:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x100000000000ec3: rc=0
00000400:00000200:26.0:1773851854.214911:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12721@kfi7 to cpt 6
00000800:00000200:25.0:1773851854.214911:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851854.214912:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003202478c nid 12721@kfi7 refs 2
00000400:00000200:26.0:1773851854.214913:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003202478c nid 12721@kfi7 refs 3
00000400:00000200:26.0:1773851854.214914:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12657@kfi7 to cpt 2
00000400:00000200:26.0:1773851854.214915:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12657@kfi7 of length 456 into portal 12 MB=0x699e0c9513580
00000400:00000200:26.0:1773851854.214917:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12657@kfi7 of length 456/456 into md 0x16159c6179 [64] + 179232
00000800:00000200:26.0:1773851854.214919:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851854.214921:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851854.214923:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12721@kfi7: PUT: OK
00000800:00000200:25.0:1773851854.214923:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851854.214924:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851854.214924:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851854.214926:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000084986d7.
00000800:00000200:25.0:1773851854.214926:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 Transaction freed
00000100:00000040:26.0:1773851854.214927:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000084986d7 x1858040589530496 msgsize 456
00000100:00100000:26.0:1773851854.214928:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-12657@kfi7 (source: 12345-12721@kfi7)
00000100:00000001:26.0:1773851854.214929:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851854.214930:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003202478c nid 12721@kfi7 refs 2
00000800:00000200:26.0:1773851854.214932:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851854.214932:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851854.214933:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851854.214934:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851854.214935:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851854.214936:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851854.214937:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040589530496
00000020:00000001:24.0:1773851854.214938:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851854.214939:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a41
00000020:00000001:24.0:1773851854.214940:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851854.214945:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006033be94 refcount=6
00000020:00000001:24.0:1773851854.214946:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627772416 : -107123081779200 : ffff9e9276c36800)
00000020:00000001:24.0:1773851854.214947:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627772416 : -107123081779200 : ffff9e9276c36800)
00000100:00000001:24.0:1773851854.214949:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851854.214950:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851854.214951:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000abee30ba.
00000020:00000010:24.0:1773851854.214952:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851854.214954:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001363a829.
00000100:00000001:24.0:1773851854.214955:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851854.214956:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851854.214957:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851854.214958:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851854.214960:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.214962:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851854.214962:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851854.214962:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851854.214963:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851854.214964:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12657@kfi7, seq: 1451911028
00000100:00000040:26.0:1773851854.214965:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006033be94 : new rpc_count 1
00000100:00000001:24.0:1773851854.214965:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.214966:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538623616 : -106958170928000 : ffff9eb8dc374c80)
00000100:00000001:24.0:1773851854.214966:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.214967:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000084986d7 x1858040589530496/t0(0) o17->a1a4e503-6434-4e15-8e35-62d2aa4fae88@12657@kfi7:581/0 lens 456/0 e 0 to 0 dl 1773851941 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1278-0'
00000100:00000001:26.0:1773851854.214969:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.214970:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851854.214971:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000084986d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a1a4e503-6434-4e15-8e35-62d2aa4fae88+6:39812:x1858040589530496:12345-12657@kfi7:17:default-tuolumne1278-0
00000100:00000200:26.0:1773851854.214972:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040589530496
00000020:00000001:26.0:1773851854.214973:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851854.214974:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851854.214975:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.214975:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851854.214976:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:26.0:1773851854.214977:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851854.214977:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040589530496, found 0 last_xid 1858040589530495
00000020:00000001:26.0:1773851854.214978:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851854.214979:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851854.214979:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851854.214980:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851854.214981:0:41182:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:26.0:1773851854.214982:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851854.214982:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851854.214983:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000513e7f5d.
02000000:00000001:26.0:1773851854.214984:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.214984:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.214985:0:41182:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:26.0:1773851854.214986:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:26.0:1773851854.214987:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:26.0:1773851854.214989:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.214990:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:26.0:1773851854.214991:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli a1a4e503-6434-4e15-8e35-62d2aa4fae88/000000006033be94 free: 126633370845184 avail: 126633368748032
00000020:00000001:26.0:1773851854.214992:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:26.0:1773851854.214993:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli a1a4e503-6434-4e15-8e35-62d2aa4fae88/000000006033be94 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:26.0:1773851854.214994:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:26.0:1773851854.214996:0:41182:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:26.0:1773851854.214996:0:41182:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli a1a4e503-6434-4e15-8e35-62d2aa4fae88/000000006033be94 reports grant 1810890751 dropped 0, local 1874591743
00000020:00000001:26.0:1773851854.214998:0:41182:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:26.0:1773851854.214998:0:41182:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:26.0:1773851854.214999:0:41182:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851854.215000:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596480, transno 0, xid 1858040589530496
00010000:00000001:26.0:1773851854.215000:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851854.215001:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000084986d7 x1858040589530496/t0(0) o17->a1a4e503-6434-4e15-8e35-62d2aa4fae88@12657@kfi7:581/0 lens 456/432 e 0 to 0 dl 1773851941 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1278-0'
00010000:00000001:26.0:1773851854.215004:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851854.215004:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851854.215005:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=87 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851854.215006:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851854.215007:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a819fb75 refcount 3 to 12657@kfi7
00000100:00000001:26.0:1773851854.215008:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526774720 : -107156182776896 : ffff9e8ac1ca43c0)
02000000:00000001:26.0:1773851854.215008:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851854.215009:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.215010:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851854.215010:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12721@kfi7
00000400:00000010:26.0:1773851854.215011:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d13b1817.
00000100:00000200:26.0:1773851854.215012:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858040589530496, offset 224
00000400:00000200:26.0:1773851854.215013:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12721@kfi7
00000400:00000200:26.0:1773851854.215014:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12721@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.215015:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003202478c nid 12721@kfi7 refs 1
00000400:00000200:26.0:1773851854.215016:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003202478c nid 12721@kfi7 refs 2
00000400:00000200:26.0:1773851854.215017:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003202478c nid 12721@kfi7 refs 3
00000400:00000200:26.0:1773851854.215018:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12721@kfi7 local destination
00000400:00000200:26.0:1773851854.215020:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768597:8768597:1024:4294967295] 12721@kfi7 LPNI seq info [10400489:10400489:16:4294967295]
00000400:00000200:26.0:1773851854.215021:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003202478c nid 12721@kfi7 refs 2
00000400:00000200:26.0:1773851854.215022:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12721@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.215024:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12721@kfi7(12721@kfi7:12721@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851854.215026:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003202478c nid 12721@kfi7 refs 3
00000800:00000200:26.0:1773851854.215027:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851854.215028:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:26.0:1773851854.215030:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851854.215032:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 Using peer 12721@kfi7(0x100000000000ec3)
00000800:00000200:26.0:1773851854.215035:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 532 bytes to peer 0x100000000000ec3: rc=0
00000800:00000200:26.0:1773851854.215036:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851854.215038:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.215039:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a819fb75 refcount 2 to 12657@kfi7
00010000:00000001:26.0:1773851854.215040:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851854.215040:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.215041:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851854.215041:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000084986d7 x1858040589530496/t0(0) o17->a1a4e503-6434-4e15-8e35-62d2aa4fae88@12657@kfi7:581/0 lens 456/432 e 0 to 0 dl 1773851941 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1278-0'
00000100:00100000:26.0:1773851854.215045:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000084986d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a1a4e503-6434-4e15-8e35-62d2aa4fae88+6:39812:x1858040589530496:12345-12657@kfi7:17:default-tuolumne1278-0 Request processed in 74us (117us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851854.215047:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12657@kfi7, seq: 1451911028
00000100:00000040:26.0:1773851854.215047:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006033be94 : new rpc_count 0
00000100:00000001:26.0:1773851854.215048:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851854.215049:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851854.215049:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851854.215050:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:25.0:1773851854.215050:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851854.215051:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001363a829.
00000020:00000010:26.0:1773851854.215051:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000abee30ba.
00000400:00000200:25.0:1773851854.215051:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12721@kfi7: PUT: OK
00000020:00000040:26.0:1773851854.215052:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000006033be94 : new refcount 5
00000400:00000200:25.0:1773851854.215052:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d13b1817
00000100:00000001:26.0:1773851854.215053:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851854.215053:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d13b1817.
00000100:00000001:25.0:1773851854.215053:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851854.215054:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851854.215055:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003202478c nid 12721@kfi7 refs 2
00000800:00000200:25.0:1773851854.215056:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12721@kfi7(000000007fdf4b09):0x0 lsk 3780 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ec3 Transaction freed
00000800:00000200:25.0:1773851854.216526:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851854.216526:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851854.216528:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851854.216530:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851854.216533:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.216534:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9857@kfi7 : PUT - for me
00000400:00000200:25.0:1773851854.216535:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.216536:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 1
00000400:00000200:25.0:1773851854.216537:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.216537:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000400:00000200:25.0:1773851854.216538:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 3
00000400:00000200:25.0:1773851854.216539:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9792@kfi7 to cpt 7
00000400:00000200:25.0:1773851854.216540:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9792@kfi7 of length 224 into portal 12 MB=0x699e1bdff2800
00000400:00000200:25.0:1773851854.216541:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9792@kfi7 of length 224/224 into md 0x16159c6179 [64] + 179688
00000800:00000200:25.0:1773851854.216542:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851854.216543:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851854.216544:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9857@kfi7: PUT: OK
00000100:00000001:25.0:1773851854.216545:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851854.216545:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851854.216546:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a66fb627.
00000100:00000040:25.0:1773851854.216547:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000a66fb627 x1858044694571008 msgsize 224
00000100:00100000:25.0:1773851854.216548:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9792@kfi7 (source: 12345-9857@kfi7)
00000100:00000001:25.0:1773851854.216548:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851854.216549:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000100:00000001:26.0:1773851854.216550:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851854.216550:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851854.216551:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851854.216551:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851854.216551:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851854.216552:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851854.216553:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044694571008
00000020:00000001:26.0:1773851854.216553:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851854.216553:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913f7
00000020:00000001:26.0:1773851854.216554:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851854.216555:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000090286c59 refcount=60
00000020:00000001:26.0:1773851854.216556:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169324544 : -107127540227072 : ffff9e916d04e400)
00000020:00000001:26.0:1773851854.216557:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169324544 : -107127540227072 : ffff9e916d04e400)
00000100:00000001:26.0:1773851854.216557:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.216558:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851854.216559:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000608ed6cb.
00000020:00000010:26.0:1773851854.216560:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851854.216560:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6ffcbe8.
00000100:00000001:26.0:1773851854.216561:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851854.216561:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851854.216562:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.216563:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851854.216563:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851854.216563:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.216564:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.216565:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851854.216566:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851854.216566:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9792@kfi7, seq: 2025043
00000100:00000001:24.0:1773851854.216566:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:26.0:1773851854.216567:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000090286c59 : new rpc_count 5
00000100:00000001:24.0:1773851854.216567:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851854.216567:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.216568:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150714880 : -106980558836736 : ffff9eb3a5caec00)
00000100:00000001:24.0:1773851854.216568:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.216569:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a66fb627 x1858044694571008/t0(0) o400->4a414851-4769-4450-adb9-4713c5b9a5c0@9792@kfi7:71/0 lens 224/0 e 0 to 0 dl 1773852186 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1108-0'
00000100:00000001:26.0:1773851854.216572:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.216572:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851854.216573:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a66fb627 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4a414851-4769-4450-adb9-4713c5b9a5c0+60:39797:x1858044694571008:12345-9792@kfi7:400:default-tuolumne1108-0
00000100:00000200:26.0:1773851854.216574:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044694571008
00000020:00000001:26.0:1773851854.216574:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851854.216575:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851854.216575:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.216576:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851854.216576:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851854.216577:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851854.216577:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044694571008, found 0 last_xid 1858044693998975
00000020:00000001:26.0:1773851854.216578:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851854.216579:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851854.216579:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851854.216579:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.216580:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851854.216581:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851854.216581:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851854.216582:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001eed40ae.
02000000:00000001:26.0:1773851854.216582:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.216583:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.216583:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851854.216584:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581691, transno 0, xid 1858044694571008
00010000:00000001:26.0:1773851854.216584:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851854.216585:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a66fb627 x1858044694571008/t0(0) o400->4a414851-4769-4450-adb9-4713c5b9a5c0@9792@kfi7:71/0 lens 224/224 e 0 to 0 dl 1773852186 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1108-0'
00010000:00000001:26.0:1773851854.216587:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851854.216588:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851854.216588:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=87 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851854.216589:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851854.216590:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6edfea0 refcount 3 to 9792@kfi7
00000100:00000001:26.0:1773851854.216591:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063648 : -107155994487968 : ffff9e8acd035360)
02000000:00000001:26.0:1773851854.216592:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851854.216592:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.216593:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851854.216594:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9857@kfi7
00000400:00000010:26.0:1773851854.216594:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f9444cf1.
00000100:00000200:26.0:1773851854.216595:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044694571008, offset 224
00000400:00000200:26.0:1773851854.216597:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9857@kfi7
00000400:00000200:26.0:1773851854.216598:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.216599:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 1
00000400:00000200:26.0:1773851854.216599:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000400:00000200:26.0:1773851854.216601:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 3
00000400:00000200:26.0:1773851854.216601:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9857@kfi7 local destination
00000400:00000200:26.0:1773851854.216603:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768598:8768598:1024:4294967295] 9857@kfi7 LPNI seq info [556665:556665:16:4294967295]
00000400:00000200:26.0:1773851854.216604:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000400:00000200:26.0:1773851854.216604:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.216606:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9857@kfi7(9857@kfi7:9857@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851854.216607:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 3
00000800:00000200:26.0:1773851854.216608:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851854.216609:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851854.216611:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851854.216613:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000795 Using peer 9857@kfi7(0x100000000000795)
00000800:00000200:26.0:1773851854.216616:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x100000000000795: rc=0
00000800:00000200:26.0:1773851854.216617:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000795 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851854.216619:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.216619:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6edfea0 refcount 2 to 9792@kfi7
00010000:00000001:26.0:1773851854.216620:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851854.216621:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.216621:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851854.216622:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a66fb627 x1858044694571008/t0(0) o400->4a414851-4769-4450-adb9-4713c5b9a5c0@9792@kfi7:71/0 lens 224/224 e 0 to 0 dl 1773852186 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1108-0'
00000100:00100000:26.0:1773851854.216625:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a66fb627 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4a414851-4769-4450-adb9-4713c5b9a5c0+60:39797:x1858044694571008:12345-9792@kfi7:400:default-tuolumne1108-0 Request processed in 52us (77us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851854.216627:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9792@kfi7, seq: 2025043
00000100:00000040:26.0:1773851854.216628:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000090286c59 : new rpc_count 4
00000800:00000200:25.0:1773851854.216628:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000795 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851854.216629:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851854.216629:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851854.216630:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851854.216630:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6ffcbe8.
00000400:00000200:25.0:1773851854.216630:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851854.216631:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000608ed6cb.
00000400:00000200:25.0:1773851854.216631:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9857@kfi7: PUT: OK
00000020:00000040:26.0:1773851854.216632:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000090286c59 : new refcount 59
00000100:00000001:26.0:1773851854.216632:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851854.216632:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f9444cf1
00000400:00000010:25.0:1773851854.216632:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f9444cf1.
00000100:00000001:25.0:1773851854.216632:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851854.216633:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851854.216634:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000800:00000200:25.0:1773851854.216635:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 9857@kfi7(000000002249a481):0x0 lsk 1942 rsk 54 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000795 Transaction freed
00000800:00000200:9.0:1773851854.327471:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851854.327472:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851854.327474:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851854.327478:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851854.327481:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.327483:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26323@kfi7 : PUT - for me
00000400:00000200:9.0:1773851854.327485:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.327486:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 1
00000400:00000200:9.0:1773851854.327488:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.327489:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000400:00000200:9.0:1773851854.327490:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 3
00000400:00000200:9.0:1773851854.327492:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.327493:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 224 into portal 12 MB=0x69b4c65a32600
00000400:00000200:9.0:1773851854.327495:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26323@kfi7 of length 224/224 into md 0x78146ce49 [64] + 118328
00000800:00000200:9.0:1773851854.327498:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851854.327500:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.327502:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26323@kfi7: PUT: OK
00000100:00000001:9.0:1773851854.327504:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851854.327504:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851854.327506:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ad6a131.
00000100:00000040:9.0:1773851854.327508:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000005ad6a131 x1859602285274624 msgsize 224
00000100:00100000:9.0:1773851854.327511:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26323@kfi7)
00000100:00000001:9.0:1773851854.327512:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851854.327514:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000100:00000001:8.0:1773851854.327515:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851854.327516:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851854.327516:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851854.327516:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851854.327517:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.327519:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851854.327520:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602285274624
00000020:00000001:8.0:1773851854.327521:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851854.327522:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000020:00000001:8.0:1773851854.327523:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851854.327528:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=164
00000020:00000001:8.0:1773851854.327529:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000020:00000001:8.0:1773851854.327530:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:8.0:1773851854.327532:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851854.327533:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851854.327534:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005de312e6.
00000020:00000010:8.0:1773851854.327535:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851854.327536:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851854.327538:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851854.327539:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851854.327539:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.327541:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851854.327542:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851854.327542:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.327544:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.327546:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851854.327547:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851854.327547:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851854.327547:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851854.327548:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26323@kfi7, seq: 2130721
00000100:00000040:8.0:1773851854.327549:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e09d60f5 : new rpc_count 3
00000100:00000001:11.0:1773851854.327550:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851854.327551:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.327551:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792151296 : -106938917400320 : ffff9ebd57d0d100)
00000100:00000040:8.0:1773851854.327552:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005ad6a131 x1859602285274624/t0(0) o400->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:44/0 lens 224/0 e 0 to 0 dl 1773852159 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2133-0'
00000100:00000001:8.0:1773851854.327557:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851854.327557:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851854.327559:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ad6a131 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fd96080a-33e6-4035-b5d5-c4f2e0fc3c75+164:39513:x1859602285274624:12345-26323@kfi7:400:default-tuolumne2133-0
00000100:00000200:8.0:1773851854.327561:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602285274624
00000020:00000001:8.0:1773851854.327562:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851854.327563:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851854.327564:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.327566:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851854.327566:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851854.327568:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851854.327568:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602285274624, found 0 last_xid 1859602246540351
00000020:00000001:8.0:1773851854.327570:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851854.327571:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851854.327572:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851854.327572:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.327573:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851854.327574:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851854.327575:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851854.327576:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005fc35e74.
02000000:00000001:8.0:1773851854.327577:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.327578:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.327579:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851854.327580:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263881838, transno 0, xid 1859602285274624
00010000:00000001:8.0:1773851854.327581:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851854.327583:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005ad6a131 x1859602285274624/t0(0) o400->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2133-0'
00010000:00000001:8.0:1773851854.327587:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851854.327588:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851854.327589:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=87 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851854.327590:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851854.327591:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009e9c4a62 refcount 3 to 26323@kfi7
00000100:00000001:8.0:1773851854.327593:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058112 : -107146750493504 : ffff9e8cf3ff7cc0)
02000000:00000001:8.0:1773851854.327594:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851854.327595:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.327596:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851854.327597:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26323@kfi7
00000400:00000010:8.0:1773851854.327598:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a9fe4d78.
00000100:00000200:8.0:1773851854.327599:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602285274624, offset 224
00000400:00000200:8.0:1773851854.327602:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26323@kfi7
00000400:00000200:8.0:1773851854.327603:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:8.0:1773851854.327606:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 1
00000400:00000200:8.0:1773851854.327608:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000400:00000200:8.0:1773851854.327610:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 3
00000400:00000200:8.0:1773851854.327611:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26323@kfi7 local destination
00000400:00000200:8.0:1773851854.327614:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768599:8768599:1024:4294967295] 26323@kfi7 LPNI seq info [1552830:1552830:16:4294967295]
00000400:00000200:8.0:1773851854.327616:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000400:00000200:8.0:1773851854.327617:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:8.0:1773851854.327620:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26323@kfi7(26323@kfi7:26323@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851854.327622:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 3
00000800:00000200:8.0:1773851854.327625:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851854.327626:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851854.327630:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851854.327634:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5cc Using peer 26323@kfi7(0x5cc)
00000800:00000200:8.0:1773851854.327638:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x5cc: rc=0
00000800:00000200:8.0:1773851854.327640:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5cc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851854.327644:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.327645:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009e9c4a62 refcount 2 to 26323@kfi7
00010000:00000001:8.0:1773851854.327646:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851854.327647:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.327649:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851854.327650:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ad6a131 x1859602285274624/t0(0) o400->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2133-0'
00000100:00100000:8.0:1773851854.327655:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ad6a131 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fd96080a-33e6-4035-b5d5-c4f2e0fc3c75+164:39513:x1859602285274624:12345-26323@kfi7:400:default-tuolumne2133-0 Request processed in 97us (145us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851854.327658:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26323@kfi7, seq: 2130721
00000100:00000040:8.0:1773851854.327660:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e09d60f5 : new rpc_count 2
00000100:00000001:8.0:1773851854.327661:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851854.327662:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851854.327663:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851854.327664:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851854.327665:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005de312e6.
00000020:00000040:8.0:1773851854.327667:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 163
00000100:00000001:8.0:1773851854.327668:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851854.327674:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5cc TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851854.327677:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.327679:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26323@kfi7: PUT: OK
00000400:00000200:9.0:1773851854.327680:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a9fe4d78
00000400:00000010:9.0:1773851854.327681:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a9fe4d78.
00000100:00000001:9.0:1773851854.327682:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851854.327683:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851854.327684:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000800:00000200:9.0:1773851854.327687:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 26323@kfi7(000000009208990b):0x0 lsk 1485 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5cc Transaction freed
00000800:00000200:29.0:1773851854.337383:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851854.337385:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851854.337386:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851854.337388:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851854.337390:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.337391:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13266@kfi7 : PUT - for me
00000400:00000200:29.0:1773851854.337392:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.337393:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 1
00000400:00000200:29.0:1773851854.337394:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.337395:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000400:00000200:29.0:1773851854.337396:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 3
00000400:00000200:29.0:1773851854.337397:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.337398:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13266@kfi7 of length 224 into portal 12 MB=0x69a9ddfcbec80
00000400:00000200:29.0:1773851854.337399:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13266@kfi7 of length 224/224 into md 0x77fe139dd [64] + 161128
00000800:00000200:29.0:1773851854.337400:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851854.337402:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851854.337403:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13266@kfi7: PUT: OK
00000100:00000001:29.0:1773851854.337404:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851854.337404:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851854.337406:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c52fac07.
00000100:00000040:29.0:1773851854.337407:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000c52fac07 x1858852715490432 msgsize 224
00000100:00100000:29.0:1773851854.337408:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13266@kfi7 (source: 12345-13266@kfi7)
00000100:00000001:29.0:1773851854.337409:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851854.337411:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851854.337411:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851854.337412:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851854.337412:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.337413:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851854.337413:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000100:00100000:31.0:1773851854.337414:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858852715490432
00000020:00000001:31.0:1773851854.337415:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851854.337415:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91532
00000800:00000200:29.0:1773851854.337415:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000020:00000001:31.0:1773851854.337416:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851854.337421:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e0e0e802 refcount=6
00000020:00000001:31.0:1773851854.337421:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241013248 : -107152468538368 : ffff9e8b9f2d0c00)
00000020:00000001:31.0:1773851854.337422:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241013248 : -107152468538368 : ffff9e8b9f2d0c00)
00000100:00000001:31.0:1773851854.337423:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.337424:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851854.337424:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f353d06.
00000020:00000010:31.0:1773851854.337426:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851854.337426:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851854.337427:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851854.337428:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851854.337428:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.337429:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851854.337430:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851854.337430:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.337431:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.337433:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851854.337433:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851854.337433:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851854.337433:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851854.337434:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13266@kfi7, seq: 2055459
00000100:00000040:31.0:1773851854.337435:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e0e0e802 : new rpc_count 1
00000100:00000001:29.0:1773851854.337435:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.337436:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165180412672 : -106908529138944 : ffff9ec46b18e300)
00000100:00000001:29.0:1773851854.337436:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.337437:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c52fac07 x1858852715490432/t0(0) o400->e62f082e-4418-4fb8-9e8e-82115f4489d7@13266@kfi7:642/0 lens 224/0 e 0 to 0 dl 1773852002 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1317-0'
00000100:00000001:31.0:1773851854.337440:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.337440:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851854.337441:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c52fac07 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e62f082e-4418-4fb8-9e8e-82115f4489d7+6:39559:x1858852715490432:12345-13266@kfi7:400:default-tuolumne1317-0
00000100:00000200:31.0:1773851854.337443:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858852715490432
00000020:00000001:31.0:1773851854.337443:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851854.337444:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851854.337445:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.337446:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851854.337446:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851854.337447:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851854.337448:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858852715490432, found 0 last_xid 1858852715490431
00000020:00000001:31.0:1773851854.337449:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851854.337449:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851854.337450:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851854.337450:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.337451:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851854.337452:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851854.337452:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851854.337454:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cb79a0c5.
02000000:00000001:31.0:1773851854.337454:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.337455:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.337456:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851854.337456:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692378, transno 0, xid 1858852715490432
00010000:00000001:31.0:1773851854.337457:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851854.337458:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c52fac07 x1858852715490432/t0(0) o400->e62f082e-4418-4fb8-9e8e-82115f4489d7@13266@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1317-0'
00010000:00000001:31.0:1773851854.337460:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851854.337461:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851854.337461:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=87 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851854.337462:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851854.337463:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002d9174f8 refcount 3 to 13266@kfi7
00000100:00000001:31.0:1773851854.337464:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412884128 : -107156296667488 : ffff9e8abb006ea0)
02000000:00000001:31.0:1773851854.337465:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851854.337465:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.337466:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851854.337467:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13266@kfi7
00000400:00000010:31.0:1773851854.337467:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000811703b3.
00000100:00000200:31.0:1773851854.337468:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858852715490432, offset 224
00000400:00000200:31.0:1773851854.337470:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13266@kfi7
00000400:00000200:31.0:1773851854.337471:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.337472:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 1
00000400:00000200:31.0:1773851854.337473:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000400:00000200:31.0:1773851854.337474:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 3
00000400:00000200:31.0:1773851854.337475:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13266@kfi7 local destination
00000400:00000200:31.0:1773851854.337477:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768600:8768600:1024:4294967295] 13266@kfi7 LPNI seq info [8560214:8560214:16:4294967295]
00000400:00000200:31.0:1773851854.337478:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000400:00000200:31.0:1773851854.337479:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.337480:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13266@kfi7(13266@kfi7:13266@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851854.337482:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 3
00000800:00000200:31.0:1773851854.337483:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851854.337484:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851854.337487:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851854.337489:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x682 Using peer 13266@kfi7(0x682)
00000800:00000200:31.0:1773851854.337492:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x682: rc=0
00000800:00000200:31.0:1773851854.337493:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x682 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851854.337495:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.337496:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002d9174f8 refcount 2 to 13266@kfi7
00010000:00000001:31.0:1773851854.337497:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851854.337497:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.337498:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851854.337498:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c52fac07 x1858852715490432/t0(0) o400->e62f082e-4418-4fb8-9e8e-82115f4489d7@13266@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1317-0'
00000100:00100000:31.0:1773851854.337501:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c52fac07 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e62f082e-4418-4fb8-9e8e-82115f4489d7+6:39559:x1858852715490432:12345-13266@kfi7:400:default-tuolumne1317-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851854.337504:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13266@kfi7, seq: 2055459
00000100:00000040:31.0:1773851854.337504:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e0e0e802 : new rpc_count 0
00000100:00000001:31.0:1773851854.337505:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851854.337505:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x682 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851854.337506:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851854.337506:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851854.337507:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851854.337507:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851854.337508:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f353d06.
00000020:00000040:31.0:1773851854.337508:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000e0e0e802 : new refcount 5
00000400:00000200:29.0:1773851854.337508:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13266@kfi7: PUT: OK
00000100:00000001:31.0:1773851854.337509:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851854.337509:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000811703b3
00000400:00000010:29.0:1773851854.337509:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000811703b3.
00000100:00000001:29.0:1773851854.337510:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851854.337510:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851854.337511:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000800:00000200:29.0:1773851854.337513:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 13266@kfi7(00000000e5e7d657):0x0 lsk 1667 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x682 Transaction freed
00000800:00000200:25.0:1773851854.352203:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851854.352205:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851854.352207:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851854.352211:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851854.352214:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.352216:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19248@kfi7 : PUT - for me
00000400:00000200:25.0:1773851854.352218:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.352219:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 1
00000400:00000200:25.0:1773851854.352220:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.352222:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000400:00000200:25.0:1773851854.352223:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 3
00000400:00000200:25.0:1773851854.352225:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.352226:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19248@kfi7 of length 224 into portal 12 MB=0x699e0940fd480
00000400:00000200:25.0:1773851854.352228:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19248@kfi7 of length 224/224 into md 0x16159c6179 [64] + 179912
00000800:00000200:25.0:1773851854.352231:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851854.352234:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851854.352236:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19248@kfi7: PUT: OK
00000100:00000001:25.0:1773851854.352237:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851854.352238:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851854.352239:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bb16047f.
00000100:00000040:25.0:1773851854.352240:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bb16047f x1858039696053376 msgsize 224
00000100:00100000:25.0:1773851854.352243:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19248@kfi7 (source: 12345-19248@kfi7)
00000100:00000001:25.0:1773851854.352244:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851854.352246:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000100:00000001:26.0:1773851854.352248:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851854.352248:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851854.352249:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851854.352250:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851854.352250:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851854.352252:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851854.352253:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039696053376
00000020:00000001:26.0:1773851854.352254:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851854.352255:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924e4
00000020:00000001:26.0:1773851854.352256:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851854.352259:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009b6536bf refcount=6
00000020:00000001:26.0:1773851854.352260:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630781952 : -107123078769664 : ffff9e9276f15400)
00000020:00000001:26.0:1773851854.352261:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630781952 : -107123078769664 : ffff9e9276f15400)
00000100:00000001:26.0:1773851854.352263:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.352264:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851854.352265:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000608ed6cb.
00000020:00000010:26.0:1773851854.352266:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851854.352267:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6ffcbe8.
00000100:00000001:26.0:1773851854.352269:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851854.352270:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851854.352270:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.352271:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851854.352272:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851854.352273:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.352274:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.352275:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851854.352276:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851854.352276:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851854.352276:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851854.352277:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19248@kfi7, seq: 2025044
00000100:00000040:26.0:1773851854.352278:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009b6536bf : new rpc_count 1
00000100:00000001:24.0:1773851854.352278:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.352279:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150707968 : -106980558843648 : ffff9eb3a5cad100)
00000100:00000001:24.0:1773851854.352279:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.352280:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bb16047f x1858039696053376/t0(0) o400->583ca5b8-884e-4568-977b-61053f27c332@19248@kfi7:71/0 lens 224/0 e 0 to 0 dl 1773852186 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1693-0'
00000100:00000001:26.0:1773851854.352283:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.352284:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851854.352285:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb16047f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:583ca5b8-884e-4568-977b-61053f27c332+6:39683:x1858039696053376:12345-19248@kfi7:400:default-tuolumne1693-0
00000100:00000200:26.0:1773851854.352286:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039696053376
00000020:00000001:26.0:1773851854.352287:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851854.352288:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851854.352288:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.352289:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851854.352290:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851854.352291:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851854.352291:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039696053376, found 0 last_xid 1858039696053375
00000020:00000001:26.0:1773851854.352292:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851854.352293:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851854.352294:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851854.352294:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.352295:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851854.352296:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851854.352296:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851854.352297:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007ef92a63.
02000000:00000001:26.0:1773851854.352298:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.352299:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.352300:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851854.352301:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692164, transno 0, xid 1858039696053376
00010000:00000001:26.0:1773851854.352302:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851854.352303:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bb16047f x1858039696053376/t0(0) o400->583ca5b8-884e-4568-977b-61053f27c332@19248@kfi7:71/0 lens 224/224 e 0 to 0 dl 1773852186 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1693-0'
00010000:00000001:26.0:1773851854.352306:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851854.352306:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851854.352307:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=87 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851854.352308:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851854.352309:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000031950d16 refcount 3 to 19248@kfi7
00000100:00000001:26.0:1773851854.352310:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092334144 : -107152617217472 : ffff9e8b96506240)
02000000:00000001:26.0:1773851854.352311:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851854.352311:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.352312:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851854.352313:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19248@kfi7
00000400:00000010:26.0:1773851854.352314:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057e36a8a.
00000100:00000200:26.0:1773851854.352315:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039696053376, offset 224
00000400:00000200:26.0:1773851854.352316:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19248@kfi7
00000400:00000200:26.0:1773851854.352317:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.352318:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 1
00000400:00000200:26.0:1773851854.352319:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000400:00000200:26.0:1773851854.352320:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 3
00000400:00000200:26.0:1773851854.352322:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19248@kfi7 local destination
00000400:00000200:26.0:1773851854.352323:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768601:8768601:1024:4294967295] 19248@kfi7 LPNI seq info [538873:538873:16:4294967295]
00000400:00000200:26.0:1773851854.352325:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000400:00000200:26.0:1773851854.352326:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.352328:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19248@kfi7(19248@kfi7:19248@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851854.352329:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 3
00000800:00000200:26.0:1773851854.352331:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851854.352332:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851854.352337:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851854.352340:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x673 Using peer 19248@kfi7(0x673)
00000800:00000200:26.0:1773851854.352343:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0x673: rc=0
00000800:00000200:26.0:1773851854.352345:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x673 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851854.352347:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.352348:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000031950d16 refcount 2 to 19248@kfi7
00010000:00000001:26.0:1773851854.352349:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851854.352349:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.352350:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851854.352351:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bb16047f x1858039696053376/t0(0) o400->583ca5b8-884e-4568-977b-61053f27c332@19248@kfi7:71/0 lens 224/224 e 0 to 0 dl 1773852186 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1693-0'
00000100:00100000:26.0:1773851854.352354:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb16047f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:583ca5b8-884e-4568-977b-61053f27c332+6:39683:x1858039696053376:12345-19248@kfi7:400:default-tuolumne1693-0 Request processed in 70us (113us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851854.352356:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x673 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851854.352357:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19248@kfi7, seq: 2025044
00000100:00000040:26.0:1773851854.352358:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009b6536bf : new rpc_count 0
00000400:00000200:25.0:1773851854.352358:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851854.352359:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851854.352359:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851854.352359:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19248@kfi7: PUT: OK
00000400:00000200:25.0:1773851854.352359:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057e36a8a
00000020:00000010:26.0:1773851854.352360:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851854.352360:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6ffcbe8.
00000400:00000010:25.0:1773851854.352360:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057e36a8a.
00000100:00000001:25.0:1773851854.352360:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:26.0:1773851854.352361:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000608ed6cb.
00000100:00000001:25.0:1773851854.352361:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:26.0:1773851854.352362:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000009b6536bf : new refcount 5
00000400:00000200:25.0:1773851854.352362:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000100:00000001:26.0:1773851854.352363:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851854.352363:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 19248@kfi7(00000000e62d1aa8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x673 Transaction freed
00000800:00000200:13.0:1773851854.370104:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851854.370105:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851854.370107:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851854.370111:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851854.370114:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.370116:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14066@kfi7 : PUT - for me
00000400:00000200:13.0:1773851854.370117:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.370119:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 1
00000400:00000200:13.0:1773851854.370120:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.370121:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000400:00000200:13.0:1773851854.370123:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 3
00000400:00000200:13.0:1773851854.370124:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13874@kfi7 to cpt 1
00000400:00000200:13.0:1773851854.370126:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13874@kfi7 of length 376 into portal 12 MB=0x69b4ba7747300
00000400:00000200:13.0:1773851854.370128:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13874@kfi7 of length 376/376 into md 0x82a36e8ed [64] + 13232
00000800:00000200:13.0:1773851854.370131:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851854.370134:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851854.370136:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14066@kfi7: PUT: OK
00000100:00000001:13.0:1773851854.370137:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851854.370138:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851854.370140:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001e5e9fb6.
00000100:00000040:13.0:1773851854.370141:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000001e5e9fb6 x1859599094543104 msgsize 376
00000100:00100000:13.0:1773851854.370143:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13874@kfi7 (source: 12345-14066@kfi7)
00000100:00000001:13.0:1773851854.370145:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851854.370147:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000800:00000200:13.0:1773851854.370149:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851854.370154:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851854.370154:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851854.370155:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851854.370156:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851854.370157:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851854.370158:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599094543104
00000020:00000001:13.0:1773851854.370159:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851854.370160:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38944ea2
00000020:00000001:13.0:1773851854.370161:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851854.370165:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f920d659 refcount=759
00000020:00000001:13.0:1773851854.370166:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114263451648 : -106959446099968 : ffff9eb89035b800)
00000020:00000001:13.0:1773851854.370167:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637114263451648 : -106959446099968 : ffff9eb89035b800)
00000100:00000001:13.0:1773851854.370168:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851854.370170:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851854.370171:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851854.370173:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851854.370174:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851854.370176:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851854.370177:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:13.0:1773851854.370178:0:60487:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:13.0:1773851854.370179:0:60487:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.370180:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.370182:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.370184:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851854.370187:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851854.370187:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851854.370187:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851854.370188:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851854.370189:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13874@kfi7, seq: 411190545
00000100:00000040:13.0:1773851854.370190:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f920d659 : new rpc_count 15
00000100:00000001:14.0:1773851854.370191:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.370191:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197399936 : -106942512151680 : ffff9ebc818d4380)
00000100:00000001:14.0:1773851854.370192:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851854.370193:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001e5e9fb6 x1859599094543104/t0(0) o101->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:642/0 lens 376/0 e 0 to 0 dl 1773852002 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111549111565312'
00000100:00000001:13.0:1773851854.370198:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851854.370199:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851854.370200:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e5e9fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7fc5910d-f170-4eda-bc46-60ec6a7ee835+759:476344:x1859599094543104:12345-13874@kfi7:101:tuolumne-833111549111565312
00000100:00000200:13.0:1773851854.370202:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599094543104
00000020:00000001:13.0:1773851854.370203:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851854.370204:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851854.370205:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.370206:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851854.370207:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:13.0:1773851854.370208:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851854.370209:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599094543104, found 0 last_xid 1859599087266815
00000020:00000001:13.0:1773851854.370211:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851854.370212:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851854.370212:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851854.370214:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.370215:0:60487:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:13.0:1773851854.370217:0:60487:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:13.0:1773851854.370218:0:60487:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:13.0:1773851854.370219:0:60487:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:13.0:1773851854.370219:0:60487:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851854.370225:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:13.0:1773851854.370228:0:60487:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000ec35219b.
00010000:00000010:13.0:1773851854.370230:0:60487:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 000000009595442b.
00010000:00000001:13.0:1773851854.370231:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:13.0:1773851854.370233:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000291a826d.
00000020:00000001:13.0:1773851854.370234:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:13.0:1773851854.370235:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000291a826d with handle 0x21b6f08f07a6acba to hash
00000020:00000001:13.0:1773851854.370237:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:13.0:1773851854.370238:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637089045418496 : -106984664133120 : ffff9eb2b1191200)
00010000:00000010:13.0:1773851854.370240:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c0c679b6.
00010000:00000001:13.0:1773851854.370241:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637089045418496 : -106984664133120 : ffff9eb2b1191200)
00010000:00010000:13.0:1773851854.370243:0:60487:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000291a826d/0x21b6f08f07a6acba lrc: 2/0,0 mode: --/CR res: [0x240024e40:0x1d092:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd20d8d4f87cfdb14 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:13.0:1773851854.370249:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ec35219b count: 1
00010000:00000040:13.0:1773851854.370251:0:60487:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000f920d659 : new locks_count 683
00000020:00000040:13.0:1773851854.370252:0:60487:0:(genops.c:871:class_export_get()) GET export 00000000f920d659 refcount=760
00010000:00000001:13.0:1773851854.370256:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:13.0:1773851854.370257:0:60487:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:13.0:1773851854.370260:0:60487:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:13.0:1773851854.370261:0:60487:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:13.0:1773851854.370262:0:60487:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:13.0:1773851854.370264:0:60487:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:13.0:1773851854.370265:0:60487:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x240024e40:0x1d092:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:13.0:1773851854.370268:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:13.0:1773851854.370268:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240024e40:0x1d092:0x0]
00000020:00000001:13.0:1773851854.370271:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:13.0:1773851854.370273:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637113309823400 : -106960399728216 : ffff9eb8575e81a8)
00000004:00000001:13.0:1773851854.370275:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637113309823312 : -106960399728304 : ffff9eb8575e8150)
00000004:00000001:13.0:1773851854.370279:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:13.0:1773851854.370282:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:13.0:1773851854.370284:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:13.0:1773851854.370288:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370290:0:60487:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370292:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:13.0:1773851854.370293:0:60487:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:13.0:1773851854.370295:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851854.370296:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851854.370298:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 00000000cb0563eb.
02000000:00000001:13.0:1773851854.370299:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.370301:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:13.0:1773851854.370303:0:60487:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:13.0:1773851854.370305:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:13.0:1773851854.370306:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:13.0:1773851854.370307:0:60487:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:13.0:1773851854.370308:0:60487:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851854.370310:0:60487:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:13.0:1773851854.370311:0:60487:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:13.0:1773851854.370312:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:13.0:1773851854.370313:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851854.370314:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:13.0:1773851854.370315:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851854.370317:0:60487:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:13.0:1773851854.370318:0:60487:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:13.0:1773851854.370319:0:60487:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:13.0:1773851854.370320:0:60487:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:13.0:1773851854.370321:0:60487:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240024e40:0x1d092:0x0].0x0 (00000000ec35219b) refcount = 1
00010000:00010000:13.0:1773851854.370324:0:60487:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000291a826d/0x21b6f08f07a6acba lrc: 3/0,0 mode: CR/CR res: [0x240024e40:0x1d092:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cfdb14 expref: 760 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:13.0:1773851854.370329:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ec35219b count: 1
00010000:00000001:13.0:1773851854.370330:0:60487:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:13.0:1773851854.370332:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:13.0:1773851854.370333:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851854.370335:0:60487:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:13.0:1773851854.370335:0:60487:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851854.370337:0:60487:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851854.370338:0:60487:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:13.0:1773851854.370340:0:60487:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:13.0:1773851854.370341:0:60487:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000291a826d/0x21b6f08f07a6acba lrc: 3/0,0 mode: CR/CR res: [0x240024e40:0x1d092:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 13874@kfi7 remote: 0xd20d8d4f87cfdb14 expref: 760 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:13.0:1773851854.370346:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ec35219b count: 1
00000004:00000001:13.0:1773851854.370348:0:60487:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:13.0:1773851854.370350:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:13.0:1773851854.370351:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240024e40:0x1d092:0x0]
00000020:00000001:13.0:1773851854.370352:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:13.0:1773851854.370353:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637113309823400 : -106960399728216 : ffff9eb8575e81a8)
00000004:00000001:13.0:1773851854.370354:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637113309823312 : -106960399728304 : ffff9eb8575e8150)
00000004:00000001:13.0:1773851854.370356:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:13.0:1773851854.370357:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:13.0:1773851854.370358:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:13.0:1773851854.370359:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370360:0:60487:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370360:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370361:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:13.0:1773851854.370362:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:13.0:1773851854.370362:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:13.0:1773851854.370363:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370364:0:60487:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370365:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:13.0:1773851854.370366:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:13.0:1773851854.370367:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:13.0:1773851854.370367:0:60487:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:13.0:1773851854.370369:0:60487:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:13.0:1773851854.370370:0:60487:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:13.0:1773851854.370370:0:60487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024e40:0x1d092:0x0].0x0 (00000000ec35219b)
00010000:00010000:13.0:1773851854.370371:0:60487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:13.0:1773851854.370372:0:60487:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851854.370373:0:60487:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851854.370374:0:60487:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:13.0:1773851854.370374:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851854.370375:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:13.0:1773851854.370375:0:60487:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000291a826d, rc 0)
00000020:00000001:13.0:1773851854.370376:0:60487:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851854.370377:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264585739, transno 0, xid 1859599094543104
00010000:00000001:13.0:1773851854.370378:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851854.370379:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001e5e9fb6 x1859599094543104/t0(0) o101->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:642/0 lens 376/1080 e 0 to 0 dl 1773852002 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111549111565312'
00010000:00000001:13.0:1773851854.370382:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851854.370382:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851854.370383:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=87 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851854.370384:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851854.370385:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000312e3384 refcount 3 to 13874@kfi7
00000100:00000001:13.0:1773851854.370386:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232982784 : -107130476568832 : ffff9e90bdffdf00)
02000000:00000001:13.0:1773851854.370387:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851854.370387:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.370388:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851854.370389:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14066@kfi7
00000400:00000010:13.0:1773851854.370389:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000449f1b53.
00000100:00000200:13.0:1773851854.370390:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1859599094543104, offset 224
00000400:00000200:13.0:1773851854.370392:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14066@kfi7
00000400:00000200:13.0:1773851854.370393:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.370394:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 1
00000400:00000200:13.0:1773851854.370395:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000400:00000200:13.0:1773851854.370396:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 3
00000400:00000200:13.0:1773851854.370397:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14066@kfi7 local destination
00000400:00000200:13.0:1773851854.370399:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768602:8768602:1024:4294967295] 14066@kfi7 LPNI seq info [729482:729482:16:4294967295]
00000400:00000200:13.0:1773851854.370400:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000400:00000200:13.0:1773851854.370401:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.370403:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14066@kfi7(14066@kfi7:14066@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851854.370405:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 3
00000800:00000200:13.0:1773851854.370406:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851854.370407:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000800:00000200:13.0:1773851854.370410:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851854.370412:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11fb Using peer 14066@kfi7(0x11fb)
00000800:00000200:13.0:1773851854.370415:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 1180 bytes to peer 0x11fb: rc=0
00000800:00000200:13.0:1773851854.370417:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11fb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851854.370419:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851854.370419:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000312e3384 refcount 2 to 13874@kfi7
00010000:00000001:13.0:1773851854.370420:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851854.370420:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.370421:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851854.370422:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001e5e9fb6 x1859599094543104/t0(0) o101->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:642/0 lens 376/1080 e 0 to 0 dl 1773852002 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111549111565312'
00000100:00100000:13.0:1773851854.370425:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e5e9fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7fc5910d-f170-4eda-bc46-60ec6a7ee835+760:476344:x1859599094543104:12345-13874@kfi7:101:tuolumne-833111549111565312 Request processed in 226us (283us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851854.370427:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13874@kfi7, seq: 411190545
00000100:00000040:13.0:1773851854.370427:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f920d659 : new rpc_count 14
00000100:00000001:13.0:1773851854.370428:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851854.370428:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851854.370429:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:14.0:1773851854.370430:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11fb TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851854.370430:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000400:00000200:14.0:1773851854.370431:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851854.370431:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000020:00000040:13.0:1773851854.370431:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 759
00000400:00000200:14.0:1773851854.370432:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14066@kfi7: PUT: OK
00000100:00000001:13.0:1773851854.370432:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851854.370433:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000449f1b53
00000400:00000010:14.0:1773851854.370434:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000449f1b53.
00000100:00000001:14.0:1773851854.370434:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851854.370435:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851854.370436:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000800:00000200:14.0:1773851854.370437:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 14066@kfi7(0000000053527b14):0x0 lsk 4604 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11fb Transaction freed
00000800:00000200:25.0:1773851854.370996:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851854.370996:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851854.370998:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851854.371000:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851854.371001:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24992@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.371003:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24992@kfi7 : PUT - for me
00000400:00000200:25.0:1773851854.371003:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24992@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.371004:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000549067d3 nid 24992@kfi7 refs 1
00000400:00000200:25.0:1773851854.371005:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24992@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.371006:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000549067d3 nid 24992@kfi7 refs 2
00000400:00000200:25.0:1773851854.371006:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000549067d3 nid 24992@kfi7 refs 3
00000400:00000200:25.0:1773851854.371007:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24993@kfi7 to cpt 1
00000400:00000200:25.0:1773851854.371008:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24993@kfi7 of length 224 into portal 12 MB=0x69a9d5eb18f80
00000400:00000200:25.0:1773851854.371009:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24993@kfi7 of length 224/224 into md 0x16159c6179 [64] + 180136
00000800:00000200:25.0:1773851854.371011:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851854.371013:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851854.371013:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24992@kfi7: PUT: OK
00000100:00000001:25.0:1773851854.371015:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851854.371015:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851854.371016:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8e67710.
00000100:00000040:25.0:1773851854.371017:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b8e67710 x1858850549501824 msgsize 224
00000100:00100000:25.0:1773851854.371018:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24993@kfi7 (source: 12345-24992@kfi7)
00000100:00000001:25.0:1773851854.371019:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851854.371020:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851854.371020:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000549067d3 nid 24992@kfi7 refs 2
02000000:00000001:26.0:1773851854.371021:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851854.371021:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851854.371021:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851854.371022:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851854.371023:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851854.371023:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858850549501824
00000020:00000001:26.0:1773851854.371025:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851854.371025:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ad3
00000020:00000001:26.0:1773851854.371026:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851854.371027:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000952e469f refcount=6
00000020:00000001:26.0:1773851854.371028:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743452672 : -107128966098944 : ffff9e911807d000)
00000020:00000001:26.0:1773851854.371029:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743452672 : -107128966098944 : ffff9e911807d000)
00000100:00000001:26.0:1773851854.371030:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.371031:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851854.371031:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000608ed6cb.
00000020:00000010:26.0:1773851854.371032:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851854.371033:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6ffcbe8.
00000100:00000001:26.0:1773851854.371034:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851854.371034:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851854.371035:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.371036:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851854.371036:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851854.371036:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.371037:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.371038:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851854.371039:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851854.371039:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851854.371039:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851854.371040:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24993@kfi7, seq: 2025045
00000100:00000040:26.0:1773851854.371041:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000952e469f : new rpc_count 1
00000100:00000001:24.0:1773851854.371041:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.371042:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150694144 : -106980558857472 : ffff9eb3a5ca9b00)
00000100:00000001:24.0:1773851854.371042:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.371043:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b8e67710 x1858850549501824/t0(0) o400->3a4d8fc7-2869-4090-9851-63d97e212155@24993@kfi7:40/0 lens 224/0 e 0 to 0 dl 1773852155 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2048-0'
00000100:00000001:26.0:1773851854.371045:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.371046:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851854.371047:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8e67710 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:3a4d8fc7-2869-4090-9851-63d97e212155+6:39696:x1858850549501824:12345-24993@kfi7:400:default-tuolumne2048-0
00000100:00000200:26.0:1773851854.371048:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858850549501824
00000020:00000001:26.0:1773851854.371049:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851854.371049:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851854.371050:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.371051:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851854.371052:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851854.371053:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851854.371053:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858850549501824, found 0 last_xid 1858850549501823
00000020:00000001:26.0:1773851854.371054:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851854.371055:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851854.371055:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851854.371056:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.371056:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851854.371057:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851854.371057:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851854.371058:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005928d584.
02000000:00000001:26.0:1773851854.371059:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.371059:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.371060:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851854.371061:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183045378138, transno 0, xid 1858850549501824
00010000:00000001:26.0:1773851854.371061:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851854.371062:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b8e67710 x1858850549501824/t0(0) o400->3a4d8fc7-2869-4090-9851-63d97e212155@24993@kfi7:40/0 lens 224/224 e 0 to 0 dl 1773852155 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2048-0'
00010000:00000001:26.0:1773851854.371065:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851854.371065:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851854.371066:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=87 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851854.371067:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851854.371067:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006d9f473 refcount 3 to 24993@kfi7
00000100:00000001:26.0:1773851854.371068:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863571584 : -107154845980032 : ffff9e8b11782a80)
02000000:00000001:26.0:1773851854.371069:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851854.371070:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.371070:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851854.371071:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24992@kfi7
00000400:00000010:26.0:1773851854.371072:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000520e24c5.
00000100:00000200:26.0:1773851854.371073:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858850549501824, offset 224
00000400:00000200:26.0:1773851854.371074:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24992@kfi7
00000400:00000200:26.0:1773851854.371075:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24992@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.371075:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000549067d3 nid 24992@kfi7 refs 1
00000400:00000200:26.0:1773851854.371076:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000549067d3 nid 24992@kfi7 refs 2
00000400:00000200:26.0:1773851854.371078:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000549067d3 nid 24992@kfi7 refs 3
00000400:00000200:26.0:1773851854.371079:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24992@kfi7 local destination
00000400:00000200:26.0:1773851854.371080:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768603:8768603:1024:4294967295] 24992@kfi7 LPNI seq info [14927096:14927096:16:4294967295]
00000400:00000200:26.0:1773851854.371082:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000549067d3 nid 24992@kfi7 refs 2
00000400:00000200:26.0:1773851854.371082:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24992@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.371085:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24992@kfi7(24992@kfi7:24992@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851854.371086:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000549067d3 nid 24992@kfi7 refs 3
00000800:00000200:26.0:1773851854.371087:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851854.371088:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851854.371090:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851854.371092:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe30 Using peer 24992@kfi7(0xe30)
00000800:00000200:26.0:1773851854.371095:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 324 bytes to peer 0xe30: rc=0
00000800:00000200:26.0:1773851854.371096:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe30 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851854.371098:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.371099:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006d9f473 refcount 2 to 24993@kfi7
00010000:00000001:26.0:1773851854.371099:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851854.371100:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.371101:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851854.371101:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8e67710 x1858850549501824/t0(0) o400->3a4d8fc7-2869-4090-9851-63d97e212155@24993@kfi7:40/0 lens 224/224 e 0 to 0 dl 1773852155 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2048-0'
00000100:00100000:26.0:1773851854.371104:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8e67710 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:3a4d8fc7-2869-4090-9851-63d97e212155+6:39696:x1858850549501824:12345-24993@kfi7:400:default-tuolumne2048-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851854.371106:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24993@kfi7, seq: 2025045
00000100:00000040:26.0:1773851854.371107:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000952e469f : new rpc_count 0
00000100:00000001:26.0:1773851854.371108:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851854.371108:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe30 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851854.371109:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851854.371110:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851854.371110:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6ffcbe8.
00000400:00000200:25.0:1773851854.371110:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851854.371111:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000608ed6cb.
00000400:00000200:25.0:1773851854.371111:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24992@kfi7: PUT: OK
00000020:00000040:26.0:1773851854.371112:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000952e469f : new refcount 5
00000100:00000001:26.0:1773851854.371112:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851854.371112:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000520e24c5
00000400:00000010:25.0:1773851854.371112:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000520e24c5.
00000100:00000001:25.0:1773851854.371113:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851854.371113:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851854.371114:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000549067d3 nid 24992@kfi7 refs 2
00000800:00000200:25.0:1773851854.371115:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 24992@kfi7(00000000c3132da5):0x0 lsk 3633 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe30 Transaction freed
00000800:00000200:17.0:1773851854.389913:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851854.389914:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851854.389915:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851854.389917:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851854.389919:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.389920:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16577@kfi7 : PUT - for me
00000400:00000200:17.0:1773851854.389921:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.389922:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 1
00000400:00000200:17.0:1773851854.389923:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.389924:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000400:00000200:17.0:1773851854.389925:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 3
00000400:00000200:17.0:1773851854.389925:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16576@kfi7 to cpt 1
00000400:00000200:17.0:1773851854.389927:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16576@kfi7 of length 224 into portal 12 MB=0x69b4b5ac90c40
00000400:00000200:17.0:1773851854.389928:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16576@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 188960
00000800:00000200:17.0:1773851854.389930:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851854.389931:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851854.389932:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16577@kfi7: PUT: OK
00000100:00000001:17.0:1773851854.389933:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851854.389934:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851854.389935:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b656cafc.
00000100:00000040:17.0:1773851854.389935:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b656cafc x1859597808241728 msgsize 224
00000100:00100000:17.0:1773851854.389937:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16576@kfi7 (source: 12345-16577@kfi7)
00000100:00000001:17.0:1773851854.389938:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851854.389939:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000100:00000001:19.0:1773851854.389940:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851854.389940:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851854.389940:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851854.389941:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851854.389941:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851854.389942:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851854.389943:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597808241728
00000020:00000001:19.0:1773851854.389943:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851854.389944:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d85c6e
00000020:00000001:19.0:1773851854.389944:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851854.389949:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000004ac5241 refcount=5
00000020:00000001:19.0:1773851854.389949:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123907279872 : -106949802271744 : ffff9ebacf06dc00)
00000020:00000001:19.0:1773851854.389950:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123907279872 : -106949802271744 : ffff9ebacf06dc00)
00000100:00000001:19.0:1773851854.389951:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851854.389952:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851854.389953:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000799785d1.
00000020:00000010:19.0:1773851854.389954:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851854.389955:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851854.389956:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851854.389956:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851854.389956:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851854.389957:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851854.389958:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851854.389958:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.389959:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851854.389960:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851854.389960:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851854.389961:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851854.389961:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851854.389962:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16576@kfi7, seq: 2156256
00000100:00000040:19.0:1773851854.389962:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000004ac5241 : new rpc_count 1
00000100:00000001:18.0:1773851854.389962:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.389963:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121088358656 : -106952621192960 : ffff9eba27018900)
00000100:00000040:19.0:1773851854.389964:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b656cafc x1859597808241728/t0(0) o400->1202a898-6271-4faf-b8a5-29782a51113a@16576@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1523-0'
00000100:00000001:18.0:1773851854.389964:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.389967:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851854.389967:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851854.389968:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b656cafc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1202a898-6271-4faf-b8a5-29782a51113a+5:39697:x1859597808241728:12345-16576@kfi7:400:default-tuolumne1523-0
00000100:00000200:19.0:1773851854.389969:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597808241728
00000020:00000001:19.0:1773851854.389970:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851854.389970:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851854.389971:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.389972:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851854.389972:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851854.389973:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851854.389973:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597808241728, found 0 last_xid 1859597808241727
00000020:00000001:19.0:1773851854.389974:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851854.389975:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851854.389976:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851854.389976:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.389977:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851854.389977:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851854.389978:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851854.389978:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000007331ce8.
02000000:00000001:19.0:1773851854.389979:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.389980:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.389981:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851854.389981:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035392088, transno 0, xid 1859597808241728
00010000:00000001:19.0:1773851854.389982:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851854.389983:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b656cafc x1859597808241728/t0(0) o400->1202a898-6271-4faf-b8a5-29782a51113a@16576@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1523-0'
00010000:00000001:19.0:1773851854.389986:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851854.389986:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851854.389987:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=87 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851854.389988:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851854.389988:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d9368660 refcount 3 to 16576@kfi7
00000100:00000001:19.0:1773851854.389989:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232979808 : -107130476571808 : ffff9e90bdffd360)
02000000:00000001:19.0:1773851854.389990:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851854.389990:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.389991:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851854.389992:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16577@kfi7
00000400:00000010:19.0:1773851854.389993:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7998b6f.
00000100:00000200:19.0:1773851854.389993:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597808241728, offset 224
00000400:00000200:19.0:1773851854.389995:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16577@kfi7
00000400:00000200:19.0:1773851854.389996:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:19.0:1773851854.389996:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 1
00000400:00000200:19.0:1773851854.389997:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000400:00000200:19.0:1773851854.389999:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 3
00000400:00000200:19.0:1773851854.390000:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16577@kfi7 local destination
00000400:00000200:19.0:1773851854.390001:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768604:8768604:1024:4294967295] 16577@kfi7 LPNI seq info [1116736:1116736:16:4294967295]
00000400:00000200:19.0:1773851854.390002:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000400:00000200:19.0:1773851854.390003:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:19.0:1773851854.390005:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16577@kfi7(16577@kfi7:16577@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851854.390006:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 3
00000800:00000200:19.0:1773851854.390008:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851854.390009:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851854.390011:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851854.390014:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc55 Using peer 16577@kfi7(0xc55)
00000800:00000200:19.0:1773851854.390016:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0xc55: rc=0
00000800:00000200:19.0:1773851854.390018:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc55 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851854.390020:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851854.390021:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d9368660 refcount 2 to 16576@kfi7
00010000:00000001:19.0:1773851854.390022:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851854.390022:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.390023:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851854.390023:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b656cafc x1859597808241728/t0(0) o400->1202a898-6271-4faf-b8a5-29782a51113a@16576@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1523-0'
00000100:00100000:19.0:1773851854.390026:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b656cafc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1202a898-6271-4faf-b8a5-29782a51113a+5:39697:x1859597808241728:12345-16576@kfi7:400:default-tuolumne1523-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851854.390028:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16576@kfi7, seq: 2156256
00000100:00000040:19.0:1773851854.390029:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000004ac5241 : new rpc_count 0
00000100:00000001:19.0:1773851854.390030:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851854.390030:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851854.390030:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc55 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851854.390031:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851854.390031:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000020:00000010:19.0:1773851854.390032:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000799785d1.
00000400:00000200:17.0:1773851854.390032:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:19.0:1773851854.390033:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000004ac5241 : new refcount 4
00000100:00000001:19.0:1773851854.390033:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851854.390033:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16577@kfi7: PUT: OK
00000400:00000200:17.0:1773851854.390034:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7998b6f
00000400:00000010:17.0:1773851854.390034:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7998b6f.
00000100:00000001:17.0:1773851854.390035:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851854.390035:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851854.390036:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000800:00000200:17.0:1773851854.390037:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16577@kfi7(00000000e09a3e2c):0x0 lsk 3158 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc55 Transaction freed
00000800:00000200:9.0:1773851854.404400:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851854.404402:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851854.404404:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851854.404408:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851854.404412:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20019@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.404414:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20019@kfi7 : PUT - for me
00000400:00000200:9.0:1773851854.404416:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20019@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.404417:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006acf41e5 nid 20019@kfi7 refs 1
00000400:00000200:9.0:1773851854.404419:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20019@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.404421:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006acf41e5 nid 20019@kfi7 refs 2
00000400:00000200:9.0:1773851854.404422:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006acf41e5 nid 20019@kfi7 refs 3
00000400:00000200:9.0:1773851854.404424:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000400:00000200:9.0:1773851854.404426:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20211@kfi7 of length 224 into portal 12 MB=0x69b80ed4829c0
00000400:00000200:9.0:1773851854.404428:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20211@kfi7 of length 224/224 into md 0x78146ce49 [64] + 118552
00000800:00000200:9.0:1773851854.404434:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851854.404437:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.404439:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20019@kfi7: PUT: OK
00000100:00000001:9.0:1773851854.404440:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851854.404441:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851854.404442:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000060645ff3.
00000100:00000040:9.0:1773851854.404444:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000060645ff3 x1859827899312576 msgsize 224
00000100:00100000:9.0:1773851854.404447:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20211@kfi7 (source: 12345-20019@kfi7)
00000100:00000001:9.0:1773851854.404448:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851854.404450:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006acf41e5 nid 20019@kfi7 refs 2
00000100:00000001:8.0:1773851854.404451:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851854.404452:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851854.404453:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851854.404453:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851854.404454:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.404455:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851854.404457:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859827899312576
00000020:00000001:8.0:1773851854.404458:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851854.404459:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f086fcb858a5
00000020:00000001:8.0:1773851854.404460:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851854.404464:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000757894f0 refcount=1043
00000020:00000001:8.0:1773851854.404465:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637071986072576 : -107001723479040 : ffff9eaeb8481c00)
00000020:00000001:8.0:1773851854.404466:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637071986072576 : -107001723479040 : ffff9eaeb8481c00)
00000100:00000001:8.0:1773851854.404468:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851854.404469:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851854.404471:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005de312e6.
00000020:00000010:8.0:1773851854.404472:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851854.404474:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851854.404475:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851854.404476:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851854.404477:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.404479:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851854.404480:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851854.404480:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.404482:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.404484:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851854.404485:0:41171:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851854.404485:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851854.404486:0:41171:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851854.404487:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20211@kfi7, seq: 2130722
00000100:00000001:11.0:1773851854.404489:0:41171:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.404489:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000757894f0 : new rpc_count 13
00000100:00000001:11.0:1773851854.404490:0:41171:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.404490:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792143232 : -106938917408384 : ffff9ebd57d0b180)
00000100:00000040:8.0:1773851854.404492:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000060645ff3 x1859827899312576/t0(0) o400->112e4cf0-b379-4577-b931-b9f17463644a@20211@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1737-0'
00000100:00000001:8.0:1773851854.404497:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851854.404498:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851854.404500:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060645ff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:112e4cf0-b379-4577-b931-b9f17463644a+1043:39594:x1859827899312576:12345-20211@kfi7:400:default-tuolumne1737-0
00000100:00000200:8.0:1773851854.404502:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859827899312576
00000020:00000001:8.0:1773851854.404503:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851854.404504:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851854.404505:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.404506:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851854.404507:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851854.404509:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851854.404510:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859827899312576, found 0 last_xid 1859827850244607
00000020:00000001:8.0:1773851854.404511:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851854.404513:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851854.404513:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851854.404514:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.404515:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851854.404516:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851854.404517:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851854.404519:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006c3c979b.
02000000:00000001:8.0:1773851854.404520:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.404521:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.404522:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851854.404523:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592458, transno 0, xid 1859827899312576
00010000:00000001:8.0:1773851854.404525:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851854.404526:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000060645ff3 x1859827899312576/t0(0) o400->112e4cf0-b379-4577-b931-b9f17463644a@20211@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1737-0'
00010000:00000001:8.0:1773851854.404530:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851854.404531:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851854.404532:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=87 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851854.404534:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851854.404535:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e3318e8 refcount 3 to 20211@kfi7
00000100:00000001:8.0:1773851854.404536:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027968 : -107156745523648 : ffff9e8aa03f6e40)
02000000:00000001:8.0:1773851854.404538:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851854.404539:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.404540:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851854.404541:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20019@kfi7
00000400:00000010:8.0:1773851854.404542:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c20ed36.
00000100:00000200:8.0:1773851854.404543:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859827899312576, offset 224
00000400:00000200:8.0:1773851854.404545:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20019@kfi7
00000400:00000200:8.0:1773851854.404547:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20019@kfi7 to cpt 2
00000400:00000200:8.0:1773851854.404548:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006acf41e5 nid 20019@kfi7 refs 1
00000400:00000200:8.0:1773851854.404550:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006acf41e5 nid 20019@kfi7 refs 2
00000400:00000200:8.0:1773851854.404552:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006acf41e5 nid 20019@kfi7 refs 3
00000400:00000200:8.0:1773851854.404554:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20019@kfi7 local destination
00000400:00000200:8.0:1773851854.404556:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768605:8768605:1024:4294967295] 20019@kfi7 LPNI seq info [13673114:13673114:16:4294967295]
00000400:00000200:8.0:1773851854.404558:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006acf41e5 nid 20019@kfi7 refs 2
00000400:00000200:8.0:1773851854.404559:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20019@kfi7 to cpt 2
00000400:00000200:8.0:1773851854.404563:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20019@kfi7(20019@kfi7:20019@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851854.404565:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006acf41e5 nid 20019@kfi7 refs 3
00000800:00000200:8.0:1773851854.404567:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851854.404569:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851854.404572:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851854.404576:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000494 Using peer 20019@kfi7(0x100000000000494)
00000800:00000200:8.0:1773851854.404581:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x100000000000494: rc=0
00000800:00000200:8.0:1773851854.404583:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000494 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851854.404590:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.404594:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e3318e8 refcount 2 to 20211@kfi7
00010000:00000001:8.0:1773851854.404595:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851854.404596:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.404597:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851854.404598:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000060645ff3 x1859827899312576/t0(0) o400->112e4cf0-b379-4577-b931-b9f17463644a@20211@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1737-0'
00000100:00100000:8.0:1773851854.404603:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060645ff3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:112e4cf0-b379-4577-b931-b9f17463644a+1043:39594:x1859827899312576:12345-20211@kfi7:400:default-tuolumne1737-0 Request processed in 105us (158us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851854.404607:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20211@kfi7, seq: 2130722
00000100:00000040:8.0:1773851854.404609:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000757894f0 : new rpc_count 12
00000100:00000001:8.0:1773851854.404610:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851854.404611:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851854.404612:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851854.404613:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851854.404614:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005de312e6.
00000020:00000040:8.0:1773851854.404615:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000757894f0 : new refcount 1042
00000100:00000001:8.0:1773851854.404616:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851854.404624:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000494 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851854.404626:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.404628:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20019@kfi7: PUT: OK
00000400:00000200:9.0:1773851854.404630:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c20ed36
00000400:00000010:9.0:1773851854.404630:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c20ed36.
00000100:00000001:9.0:1773851854.404632:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851854.404632:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851854.404634:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006acf41e5 nid 20019@kfi7 refs 2
00000800:00000200:9.0:1773851854.404636:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 20019@kfi7(000000001d2c3c36):0x0 lsk 1173 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000494 Transaction freed
00000800:00000200:13.0:1773851854.411039:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851854.411040:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851854.411041:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851854.411044:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851854.411046:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20035@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.411047:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20035@kfi7 : PUT - for me
00000400:00000200:13.0:1773851854.411048:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20035@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.411049:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040dbfb73 nid 20035@kfi7 refs 1
00000400:00000200:13.0:1773851854.411050:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20035@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.411051:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040dbfb73 nid 20035@kfi7 refs 2
00000400:00000200:13.0:1773851854.411052:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000040dbfb73 nid 20035@kfi7 refs 3
00000400:00000200:13.0:1773851854.411053:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20035@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.411054:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20035@kfi7 of length 224 into portal 12 MB=0x69b4b9f0fe5c0
00000400:00000200:13.0:1773851854.411055:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20035@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 13608
00000800:00000200:13.0:1773851854.411057:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851854.411059:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851854.411060:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20035@kfi7: PUT: OK
00000100:00000001:13.0:1773851854.411061:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851854.411061:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851854.411062:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001281eee0.
00000100:00000040:13.0:1773851854.411063:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000001281eee0 x1859598953735616 msgsize 224
00000100:00100000:13.0:1773851854.411064:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20035@kfi7 (source: 12345-20035@kfi7)
00000100:00000001:13.0:1773851854.411066:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851854.411067:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000040dbfb73 nid 20035@kfi7 refs 2
00000800:00000200:13.0:1773851854.411068:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851854.411071:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851854.411072:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851854.411072:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851854.411072:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851854.411073:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851854.411074:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598953735616
00000020:00000001:13.0:1773851854.411075:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851854.411075:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2438c318
00000020:00000001:13.0:1773851854.411076:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851854.411078:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bc0c213 refcount=3083
00000020:00000001:13.0:1773851854.411079:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098492729344 : -106975216822272 : ffff9eb4e4339800)
00000020:00000001:13.0:1773851854.411080:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098492729344 : -106975216822272 : ffff9eb4e4339800)
00000100:00000001:13.0:1773851854.411081:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851854.411082:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851854.411083:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851854.411084:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851854.411085:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851854.411086:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851854.411086:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851854.411087:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851854.411088:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851854.411088:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851854.411089:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.411090:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851854.411091:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851854.411091:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851854.411091:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851854.411091:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851854.411092:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20035@kfi7, seq: 2289769
00000100:00000001:14.0:1773851854.411093:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851854.411093:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bc0c213 : new rpc_count 8
00000100:00000001:14.0:1773851854.411094:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.411094:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197409152 : -106942512142464 : ffff9ebc818d6780)
00000100:00000040:13.0:1773851854.411095:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001281eee0 x1859598953735616/t0(0) o400->84194c2b-5abd-4f3b-8780-4114522f643e@20035@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1752-0'
00000100:00000001:13.0:1773851854.411098:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851854.411098:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851854.411099:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001281eee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:84194c2b-5abd-4f3b-8780-4114522f643e+3083:39712:x1859598953735616:12345-20035@kfi7:400:default-tuolumne1752-0
00000100:00000200:13.0:1773851854.411101:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598953735616
00000020:00000001:13.0:1773851854.411101:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851854.411102:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851854.411102:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.411105:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851854.411105:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851854.411106:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851854.411106:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598953735616, found 0 last_xid 1859598953024191
00000020:00000001:13.0:1773851854.411107:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851854.411108:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851854.411109:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851854.411109:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.411110:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851854.411111:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851854.411111:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851854.411112:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c457327c.
02000000:00000001:13.0:1773851854.411113:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.411113:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.411114:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851854.411115:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588994, transno 0, xid 1859598953735616
00010000:00000001:13.0:1773851854.411116:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851854.411117:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001281eee0 x1859598953735616/t0(0) o400->84194c2b-5abd-4f3b-8780-4114522f643e@20035@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1752-0'
00010000:00000001:13.0:1773851854.411119:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851854.411120:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851854.411120:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=87 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851854.411121:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851854.411122:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e0a70026 refcount 3 to 20035@kfi7
00000100:00000001:13.0:1773851854.411122:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155392 : -107139310396224 : ffff9e8eaf765cc0)
02000000:00000001:13.0:1773851854.411123:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851854.411123:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.411124:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851854.411125:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20035@kfi7
00000400:00000010:13.0:1773851854.411125:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022d7296e.
00000100:00000200:13.0:1773851854.411126:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598953735616, offset 224
00000400:00000200:13.0:1773851854.411127:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20035@kfi7
00000400:00000200:13.0:1773851854.411128:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20035@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.411129:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040dbfb73 nid 20035@kfi7 refs 1
00000400:00000200:13.0:1773851854.411129:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000040dbfb73 nid 20035@kfi7 refs 2
00000400:00000200:13.0:1773851854.411131:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000040dbfb73 nid 20035@kfi7 refs 3
00000400:00000200:13.0:1773851854.411132:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20035@kfi7 local destination
00000400:00000200:13.0:1773851854.411133:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768606:8768606:1024:4294967295] 20035@kfi7 LPNI seq info [13001238:13001238:16:4294967295]
00000400:00000200:13.0:1773851854.411135:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000040dbfb73 nid 20035@kfi7 refs 2
00000400:00000200:13.0:1773851854.411135:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20035@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.411138:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20035@kfi7(20035@kfi7:20035@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851854.411139:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000040dbfb73 nid 20035@kfi7 refs 3
00000800:00000200:13.0:1773851854.411140:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851854.411141:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851854.411143:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851854.411145:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000074a Using peer 20035@kfi7(0x10000000000074a)
00000800:00000200:13.0:1773851854.411149:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000af8ff251: Posted send of 324 bytes to peer 0x10000000000074a: rc=0
00000800:00000200:13.0:1773851854.411150:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000074a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851854.411152:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851854.411153:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e0a70026 refcount 2 to 20035@kfi7
00010000:00000001:13.0:1773851854.411154:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851854.411154:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.411155:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851854.411156:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001281eee0 x1859598953735616/t0(0) o400->84194c2b-5abd-4f3b-8780-4114522f643e@20035@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1752-0'
00000100:00100000:13.0:1773851854.411159:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001281eee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:84194c2b-5abd-4f3b-8780-4114522f643e+3083:39712:x1859598953735616:12345-20035@kfi7:400:default-tuolumne1752-0 Request processed in 60us (95us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851854.411161:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20035@kfi7, seq: 2289769
00000100:00000040:13.0:1773851854.411162:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bc0c213 : new rpc_count 7
00000800:00000200:14.0:1773851854.411163:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000074a TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851854.411163:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851854.411164:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851854.411164:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851854.411165:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000020:00000010:13.0:1773851854.411166:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000020:00000040:13.0:1773851854.411166:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000005bc0c213 : new refcount 3082
00000400:00000200:14.0:1773851854.411167:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851854.411167:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851854.411168:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20035@kfi7: PUT: OK
00000400:00000200:14.0:1773851854.411169:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022d7296e
00000400:00000010:14.0:1773851854.411170:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022d7296e.
00000100:00000001:14.0:1773851854.411170:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851854.411171:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851854.411171:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000040dbfb73 nid 20035@kfi7 refs 2
00000800:00000200:14.0:1773851854.411173:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 20035@kfi7(00000000c84954aa):0x0 lsk 1867 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000074a Transaction freed
00000800:00000200:1.0:1773851854.461447:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851854.461448:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851854.461449:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851854.461452:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851854.461454:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.461455:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24529@kfi7 : PUT - for me
00000400:00000200:1.0:1773851854.461456:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.461457:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 1
00000400:00000200:1.0:1773851854.461458:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.461459:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000400:00000200:1.0:1773851854.461460:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 3
00000400:00000200:1.0:1773851854.461461:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.461462:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24529@kfi7 of length 224 into portal 12 MB=0x699e132bd7400
00000400:00000200:1.0:1773851854.461463:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24529@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 12672
00000800:00000200:1.0:1773851854.461465:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851854.461467:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851854.461468:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24529@kfi7: PUT: OK
00000100:00000001:1.0:1773851854.461469:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851854.461470:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851854.461471:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa90580f.
00000100:00000040:1.0:1773851854.461471:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000aa90580f x1858042358232064 msgsize 224
00000100:00100000:1.0:1773851854.461473:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24529@kfi7 (source: 12345-24529@kfi7)
00000100:00000001:1.0:1773851854.461474:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851854.461475:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000100:00000001:0.0:1773851854.461476:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851854.461476:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851854.461477:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851854.461477:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851854.461477:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851854.461478:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851854.461479:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042358232064
00000020:00000001:0.0:1773851854.461479:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851854.461480:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d42
00000020:00000001:0.0:1773851854.461480:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851854.461483:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b2f0deb3 refcount=6
00000020:00000001:0.0:1773851854.461483:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744180736 : -107128965370880 : ffff9e911812ec00)
00000020:00000001:0.0:1773851854.461484:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744180736 : -107128965370880 : ffff9e911812ec00)
00000100:00000001:0.0:1773851854.461485:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851854.461486:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851854.461487:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851854.461488:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851854.461488:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851854.461489:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851854.461489:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851854.461490:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851854.461491:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851854.461491:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851854.461492:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.461492:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851854.461494:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851854.461494:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851854.461494:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851854.461494:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851854.461495:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24529@kfi7, seq: 1997489
00000100:00000001:2.0:1773851854.461496:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.461496:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851854.461496:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b2f0deb3 : new rpc_count 1
00000100:00000001:0.0:1773851854.461496:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605658112 : -106923103893504 : ffff9ec1065fc800)
00000100:00000040:0.0:1773851854.461497:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa90580f x1858042358232064/t0(0) o400->8905909c-1928-46a1-87ab-4d3a4effb77d@24529@kfi7:494/0 lens 224/0 e 0 to 0 dl 1773852609 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2017-0'
00000100:00000001:0.0:1773851854.461500:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851854.461500:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851854.461501:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa90580f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8905909c-1928-46a1-87ab-4d3a4effb77d+6:39792:x1858042358232064:12345-24529@kfi7:400:default-tuolumne2017-0
00000100:00000200:0.0:1773851854.461502:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042358232064
00000020:00000001:0.0:1773851854.461503:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851854.461503:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851854.461504:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.461504:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851854.461505:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851854.461506:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851854.461506:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042358232064, found 0 last_xid 1858042358232063
00000020:00000001:0.0:1773851854.461507:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851854.461507:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851854.461508:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851854.461508:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.461509:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851854.461510:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851854.461510:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851854.461511:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000734d152a.
02000000:00000001:0.0:1773851854.461511:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.461512:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.461513:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851854.461513:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104961841, transno 0, xid 1858042358232064
00010000:00000001:0.0:1773851854.461514:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851854.461514:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa90580f x1858042358232064/t0(0) o400->8905909c-1928-46a1-87ab-4d3a4effb77d@24529@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2017-0'
00010000:00000001:0.0:1773851854.461517:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851854.461517:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851854.461518:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=87 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851854.461519:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851854.461519:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d81eff1 refcount 3 to 24529@kfi7
00000100:00000001:0.0:1773851854.461520:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928670973120 : -107145038578496 : ffff9e8d5a093cc0)
02000000:00000001:0.0:1773851854.461521:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851854.461521:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.461522:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851854.461522:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24529@kfi7
00000400:00000010:0.0:1773851854.461523:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073d1c143.
00000100:00000200:0.0:1773851854.461524:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042358232064, offset 224
00000400:00000200:0.0:1773851854.461525:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24529@kfi7
00000400:00000200:0.0:1773851854.461525:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:0.0:1773851854.461526:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 1
00000400:00000200:0.0:1773851854.461527:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000400:00000200:0.0:1773851854.461528:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 3
00000400:00000200:0.0:1773851854.461529:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24529@kfi7 local destination
00000400:00000200:0.0:1773851854.461530:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768607:8768607:1024:4294967295] 24529@kfi7 LPNI seq info [6478802:6478802:16:4294967295]
00000400:00000200:0.0:1773851854.461532:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000400:00000200:0.0:1773851854.461532:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:0.0:1773851854.461534:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24529@kfi7(24529@kfi7:24529@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851854.461536:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 3
00000800:00000200:0.0:1773851854.461537:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851854.461538:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851854.461540:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851854.461542:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a7 Using peer 24529@kfi7(0x5a7)
00000800:00000200:0.0:1773851854.461544:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x5a7: rc=0
00000800:00000200:0.0:1773851854.461546:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851854.461547:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851854.461548:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d81eff1 refcount 2 to 24529@kfi7
00010000:00000001:0.0:1773851854.461549:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851854.461549:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.461550:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851854.461550:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa90580f x1858042358232064/t0(0) o400->8905909c-1928-46a1-87ab-4d3a4effb77d@24529@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2017-0'
00000100:00100000:0.0:1773851854.461554:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa90580f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8905909c-1928-46a1-87ab-4d3a4effb77d+6:39792:x1858042358232064:12345-24529@kfi7:400:default-tuolumne2017-0 Request processed in 52us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851854.461556:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24529@kfi7, seq: 1997489
00000100:00000040:0.0:1773851854.461557:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b2f0deb3 : new rpc_count 0
00000100:00000001:0.0:1773851854.461558:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851854.461558:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851854.461558:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851854.461559:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851854.461560:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851854.461560:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000b2f0deb3 : new refcount 5
00000100:00000001:0.0:1773851854.461561:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851854.461566:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a7 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851854.461567:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851854.461568:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24529@kfi7: PUT: OK
00000400:00000200:1.0:1773851854.461569:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073d1c143
00000400:00000010:1.0:1773851854.461570:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073d1c143.
00000100:00000001:1.0:1773851854.461570:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851854.461571:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851854.461572:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000800:00000200:1.0:1773851854.461573:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 24529@kfi7(000000008a3142b1):0x0 lsk 1448 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a7 Transaction freed
00000800:00000200:29.0:1773851854.592587:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851854.592588:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851854.592589:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851854.592591:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851854.592593:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13923@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.592594:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13923@kfi7 : PUT - for me
00000400:00000200:29.0:1773851854.592595:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13923@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.592596:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010237ff5 nid 13923@kfi7 refs 1
00000400:00000200:29.0:1773851854.592597:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13923@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.592598:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010237ff5 nid 13923@kfi7 refs 2
00000400:00000200:29.0:1773851854.592599:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010237ff5 nid 13923@kfi7 refs 3
00000400:00000200:29.0:1773851854.592600:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13986@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.592601:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13986@kfi7 of length 224 into portal 12 MB=0x69b0965022c40
00000400:00000200:29.0:1773851854.592602:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13986@kfi7 of length 224/224 into md 0x77fe139dd [64] + 161352
00000800:00000200:29.0:1773851854.592604:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851854.592606:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851854.592606:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13923@kfi7: PUT: OK
00000100:00000001:29.0:1773851854.592607:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851854.592608:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851854.592609:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fd2b39c4.
00000100:00000040:29.0:1773851854.592609:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000fd2b39c4 x1859314511916096 msgsize 224
00000100:00100000:29.0:1773851854.592611:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13986@kfi7 (source: 12345-13923@kfi7)
00000100:00000001:29.0:1773851854.592612:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851854.592613:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010237ff5 nid 13923@kfi7 refs 2
00000800:00000200:29.0:1773851854.592614:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851854.592615:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851854.592615:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851854.592616:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851854.592617:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.592618:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851854.592619:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314511916096
00000020:00000001:31.0:1773851854.592620:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851854.592621:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f6b
00000020:00000001:31.0:1773851854.592622:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851854.592626:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001f26d538 refcount=6
00000020:00000001:31.0:1773851854.592627:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744923136 : -107128964628480 : ffff9e91181e4000)
00000020:00000001:31.0:1773851854.592628:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744923136 : -107128964628480 : ffff9e91181e4000)
00000100:00000001:31.0:1773851854.592630:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.592631:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851854.592632:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f353d06.
00000020:00000010:31.0:1773851854.592633:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851854.592634:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851854.592635:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851854.592635:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851854.592636:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.592637:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851854.592637:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851854.592637:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.592638:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.592640:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851854.592640:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851854.592640:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851854.592640:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851854.592641:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13986@kfi7, seq: 2055460
00000100:00000040:31.0:1773851854.592642:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001f26d538 : new rpc_count 1
00000100:00000001:29.0:1773851854.592642:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.592643:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165180393088 : -106908529158528 : ffff9ec46b189680)
00000100:00000001:29.0:1773851854.592643:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.592644:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fd2b39c4 x1859314511916096/t0(0) o400->9d7824db-4dd8-46f5-99d3-9a00e18181f5@13986@kfi7:642/0 lens 224/0 e 0 to 0 dl 1773852002 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1356-0'
00000100:00000001:31.0:1773851854.592647:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.592648:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851854.592649:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd2b39c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:9d7824db-4dd8-46f5-99d3-9a00e18181f5+6:39656:x1859314511916096:12345-13986@kfi7:400:default-tuolumne1356-0
00000100:00000200:31.0:1773851854.592650:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314511916096
00000020:00000001:31.0:1773851854.592651:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851854.592652:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851854.592653:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.592653:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851854.592654:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851854.592655:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851854.592655:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314511916096, found 0 last_xid 1859314511916095
00000020:00000001:31.0:1773851854.592656:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851854.592657:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851854.592658:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851854.592658:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.592659:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851854.592660:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851854.592660:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851854.592661:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002fdd8d54.
02000000:00000001:31.0:1773851854.592662:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.592662:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.592663:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851854.592664:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182675796729, transno 0, xid 1859314511916096
00010000:00000001:31.0:1773851854.592665:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851854.592665:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fd2b39c4 x1859314511916096/t0(0) o400->9d7824db-4dd8-46f5-99d3-9a00e18181f5@13986@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1356-0'
00010000:00000001:31.0:1773851854.592668:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851854.592669:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851854.592669:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=87 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851854.592671:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851854.592672:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000004b6cada refcount 3 to 13986@kfi7
00000100:00000001:31.0:1773851854.592673:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412883840 : -107156296667776 : ffff9e8abb006d80)
02000000:00000001:31.0:1773851854.592674:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851854.592674:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.592675:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851854.592676:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13923@kfi7
00000400:00000010:31.0:1773851854.592677:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defdea60.
00000100:00000200:31.0:1773851854.592678:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314511916096, offset 224
00000400:00000200:31.0:1773851854.592679:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13923@kfi7
00000400:00000200:31.0:1773851854.592680:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13923@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.592681:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010237ff5 nid 13923@kfi7 refs 1
00000400:00000200:31.0:1773851854.592682:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000010237ff5 nid 13923@kfi7 refs 2
00000400:00000200:31.0:1773851854.592683:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000010237ff5 nid 13923@kfi7 refs 3
00000400:00000200:31.0:1773851854.592684:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13923@kfi7 local destination
00000400:00000200:31.0:1773851854.592685:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768608:8768608:1024:4294967295] 13923@kfi7 LPNI seq info [4578677:4578677:16:4294967295]
00000400:00000200:31.0:1773851854.592687:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000010237ff5 nid 13923@kfi7 refs 2
00000400:00000200:31.0:1773851854.592687:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13923@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.592689:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13923@kfi7(13923@kfi7:13923@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851854.592690:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000010237ff5 nid 13923@kfi7 refs 3
00000800:00000200:31.0:1773851854.592691:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851854.592692:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851854.592695:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851854.592697:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x622 Using peer 13923@kfi7(0x622)
00000800:00000200:31.0:1773851854.592700:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x622: rc=0
00000800:00000200:31.0:1773851854.592701:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x622 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851854.592703:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.592706:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000004b6cada refcount 2 to 13986@kfi7
00010000:00000001:31.0:1773851854.592706:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851854.592707:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.592708:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851854.592708:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fd2b39c4 x1859314511916096/t0(0) o400->9d7824db-4dd8-46f5-99d3-9a00e18181f5@13986@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1356-0'
00000100:00100000:31.0:1773851854.592711:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd2b39c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:9d7824db-4dd8-46f5-99d3-9a00e18181f5+6:39656:x1859314511916096:12345-13986@kfi7:400:default-tuolumne1356-0 Request processed in 63us (101us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851854.592713:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13986@kfi7, seq: 2055460
00000800:00000200:29.0:1773851854.592713:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x622 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851854.592714:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001f26d538 : new rpc_count 0
00000100:00000001:31.0:1773851854.592714:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851854.592714:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851854.592715:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851854.592715:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851854.592715:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13923@kfi7: PUT: OK
00000020:00000010:31.0:1773851854.592716:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851854.592716:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defdea60
00000020:00000010:31.0:1773851854.592717:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f353d06.
00000400:00000010:29.0:1773851854.592717:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defdea60.
00000020:00000040:31.0:1773851854.592718:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000001f26d538 : new refcount 5
00000100:00000001:31.0:1773851854.592718:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851854.592718:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851854.592718:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851854.592719:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000010237ff5 nid 13923@kfi7 refs 2
00000800:00000200:29.0:1773851854.592720:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13923@kfi7(0000000080411add):0x0 lsk 1571 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x622 Transaction freed
00000800:00000200:13.0:1773851854.612909:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851854.612911:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851854.612913:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851854.612917:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851854.612920:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18849@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.612922:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18849@kfi7 : PUT - for me
00000400:00000200:13.0:1773851854.612924:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18849@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.612925:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000448f988c nid 18849@kfi7 refs 1
00000400:00000200:13.0:1773851854.612927:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18849@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.612928:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000448f988c nid 18849@kfi7 refs 2
00000400:00000200:13.0:1773851854.612929:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000448f988c nid 18849@kfi7 refs 3
00000400:00000200:13.0:1773851854.612930:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18785@kfi7 to cpt 7
00000400:00000200:13.0:1773851854.612932:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18785@kfi7 of length 224 into portal 12 MB=0x69b4c3eaf2ac0
00000400:00000200:13.0:1773851854.612934:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18785@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 13832
00000800:00000200:13.0:1773851854.612937:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851854.612939:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851854.612941:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18849@kfi7: PUT: OK
00000100:00000001:13.0:1773851854.612943:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851854.612943:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851854.612945:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002c642c27.
00000100:00000040:13.0:1773851854.612946:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000002c642c27 x1859601631750848 msgsize 224
00000100:00100000:13.0:1773851854.612948:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18785@kfi7 (source: 12345-18849@kfi7)
00000100:00000001:13.0:1773851854.612951:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851854.612953:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000448f988c nid 18849@kfi7 refs 2
00000800:00000200:13.0:1773851854.612955:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851854.612959:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851854.612960:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851854.612961:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851854.612962:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851854.612963:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851854.612964:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601631750848
00000020:00000001:13.0:1773851854.612965:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851854.612966:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8a55d
00000020:00000001:13.0:1773851854.612966:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851854.612970:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dd653a65 refcount=5
00000020:00000001:13.0:1773851854.612971:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142750771200 : -106930958780416 : ffff9ebf322fb800)
00000020:00000001:13.0:1773851854.612972:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142750771200 : -106930958780416 : ffff9ebf322fb800)
00000100:00000001:13.0:1773851854.612973:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851854.612975:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851854.612976:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851854.612977:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851854.612978:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851854.612979:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851854.612980:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851854.612981:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851854.612982:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851854.612983:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851854.612984:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.612985:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851854.612987:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851854.612988:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851854.612988:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851854.612988:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851854.612990:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18785@kfi7, seq: 2289770
00000100:00000001:14.0:1773851854.612991:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851854.612991:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dd653a65 : new rpc_count 1
00000100:00000001:14.0:1773851854.612992:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.612992:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197382656 : -106942512168960 : ffff9ebc818d0000)
00000100:00000040:13.0:1773851854.612993:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002c642c27 x1859601631750848/t0(0) o400->78df1694-f7db-445a-b96b-ff0167416419@18785@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1664-0'
00000100:00000001:13.0:1773851854.612998:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851854.612999:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851854.613001:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c642c27 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:78df1694-f7db-445a-b96b-ff0167416419+5:39518:x1859601631750848:12345-18785@kfi7:400:default-tuolumne1664-0
00000100:00000200:13.0:1773851854.613003:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601631750848
00000020:00000001:13.0:1773851854.613003:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851854.613004:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851854.613005:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.613006:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851854.613007:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851854.613008:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851854.613009:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601631750848, found 0 last_xid 1859601631750847
00000020:00000001:13.0:1773851854.613010:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851854.613011:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851854.613012:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851854.613013:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.613014:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851854.613015:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851854.613015:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851854.613016:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000305932b9.
02000000:00000001:13.0:1773851854.613017:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.613018:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.613019:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851854.613020:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044165043, transno 0, xid 1859601631750848
00010000:00000001:13.0:1773851854.613021:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851854.613023:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002c642c27 x1859601631750848/t0(0) o400->78df1694-f7db-445a-b96b-ff0167416419@18785@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1664-0'
00010000:00000001:13.0:1773851854.613027:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851854.613028:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851854.613029:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=87 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851854.613030:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851854.613031:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004129efb7 refcount 3 to 18785@kfi7
00000100:00000001:13.0:1773851854.613032:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806944 : -107130477744672 : ffff9e90bdedede0)
02000000:00000001:13.0:1773851854.613034:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851854.613034:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851854.613035:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851854.613037:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18849@kfi7
00000400:00000010:13.0:1773851854.613037:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000de6ab09e.
00000100:00000200:13.0:1773851854.613039:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601631750848, offset 224
00000400:00000200:13.0:1773851854.613041:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18849@kfi7
00000400:00000200:13.0:1773851854.613042:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18849@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.613043:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000448f988c nid 18849@kfi7 refs 1
00000400:00000200:13.0:1773851854.613044:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000448f988c nid 18849@kfi7 refs 2
00000400:00000200:13.0:1773851854.613046:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000448f988c nid 18849@kfi7 refs 3
00000400:00000200:13.0:1773851854.613048:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18849@kfi7 local destination
00000400:00000200:13.0:1773851854.613050:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768609:8768609:1024:4294967295] 18849@kfi7 LPNI seq info [763087:763087:16:4294967295]
00000400:00000200:13.0:1773851854.613052:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000448f988c nid 18849@kfi7 refs 2
00000400:00000200:13.0:1773851854.613053:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18849@kfi7 to cpt 3
00000400:00000200:13.0:1773851854.613056:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18849@kfi7(18849@kfi7:18849@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851854.613058:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000448f988c nid 18849@kfi7 refs 3
00000800:00000200:13.0:1773851854.613060:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851854.613061:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851854.613065:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851854.613068:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001077 Using peer 18849@kfi7(0x100000000001077)
00000800:00000200:13.0:1773851854.613073:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000af8ff251: Posted send of 324 bytes to peer 0x100000000001077: rc=0
00000800:00000200:13.0:1773851854.613075:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001077 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851854.613078:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851854.613079:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004129efb7 refcount 2 to 18785@kfi7
00010000:00000001:13.0:1773851854.613081:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851854.613081:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851854.613082:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851854.613083:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002c642c27 x1859601631750848/t0(0) o400->78df1694-f7db-445a-b96b-ff0167416419@18785@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1664-0'
00000100:00100000:13.0:1773851854.613088:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c642c27 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:78df1694-f7db-445a-b96b-ff0167416419+5:39518:x1859601631750848:12345-18785@kfi7:400:default-tuolumne1664-0 Request processed in 89us (141us total) trans 0 rc 0/0
00000800:00000200:14.0:1773851854.613090:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001077 TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851854.613092:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18785@kfi7, seq: 2289770
00000400:00000200:14.0:1773851854.613093:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:13.0:1773851854.613093:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dd653a65 : new rpc_count 0
00000100:00000001:13.0:1773851854.613094:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851854.613095:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18849@kfi7: PUT: OK
00000100:00000001:13.0:1773851854.613095:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851854.613096:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000de6ab09e
00000020:00000010:13.0:1773851854.613096:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000010:14.0:1773851854.613097:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000de6ab09e.
00000020:00000010:13.0:1773851854.613097:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000100:00000001:14.0:1773851854.613098:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:13.0:1773851854.613098:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000100:00000001:14.0:1773851854.613099:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:13.0:1773851854.613099:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000dd653a65 : new refcount 4
00000400:00000200:14.0:1773851854.613100:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000448f988c nid 18849@kfi7 refs 2
00000100:00000001:13.0:1773851854.613100:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851854.613102:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18849@kfi7(00000000fb98a026):0x0 lsk 4216 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001077 Transaction freed
00000800:00000200:29.0:1773851854.637043:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851854.637044:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851854.637046:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851854.637052:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851854.637055:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11504@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.637057:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11504@kfi7 : PUT - for me
00000400:00000200:29.0:1773851854.637059:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11504@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.637060:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 1
00000400:00000200:29.0:1773851854.637063:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11504@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.637064:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 2
00000400:00000200:29.0:1773851854.637065:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 3
00000400:00000200:29.0:1773851854.637067:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000400:00000200:29.0:1773851854.637068:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11312@kfi7 of length 224 into portal 12 MB=0x69b09f8b4bfc0
00000400:00000200:29.0:1773851854.637070:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11312@kfi7 of length 224/224 into md 0x77fe139dd [64] + 161576
00000800:00000200:29.0:1773851854.637073:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851854.637076:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851854.637078:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11504@kfi7: PUT: OK
00000100:00000001:29.0:1773851854.637079:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851854.637080:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851854.637081:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000093a4bdc.
00000100:00000040:29.0:1773851854.637082:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000093a4bdc x1859316989870016 msgsize 224
00000100:00100000:29.0:1773851854.637085:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11312@kfi7 (source: 12345-11504@kfi7)
00000100:00000001:29.0:1773851854.637087:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851854.637088:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 2
00000100:00000001:31.0:1773851854.637089:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851854.637090:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851854.637090:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851854.637091:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851854.637091:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.637093:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851854.637094:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316989870016
00000020:00000001:31.0:1773851854.637095:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851854.637095:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f25
00000020:00000001:31.0:1773851854.637096:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851854.637100:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fb49f329 refcount=2189
00000020:00000001:31.0:1773851854.637101:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744667136 : -107128964884480 : ffff9e91181a5800)
00000020:00000001:31.0:1773851854.637102:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744667136 : -107128964884480 : ffff9e91181a5800)
00000100:00000001:31.0:1773851854.637104:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.637105:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851854.637106:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025d2a996.
00000020:00000010:31.0:1773851854.637108:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851854.637110:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851854.637111:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851854.637111:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851854.637112:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.637114:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851854.637115:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851854.637115:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.637117:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.637119:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851854.637119:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851854.637120:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851854.637120:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851854.637121:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11312@kfi7, seq: 2055461
00000100:00000040:31.0:1773851854.637123:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fb49f329 : new rpc_count 8
00000100:00000001:29.0:1773851854.637123:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.637124:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165180395392 : -106908529156224 : ffff9ec46b189f80)
00000100:00000001:29.0:1773851854.637124:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.637126:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000093a4bdc x1859316989870016/t0(0) o400->4aab4d56-804a-4f56-9252-987d17ee7f99@11312@kfi7:642/0 lens 224/0 e 0 to 0 dl 1773852002 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1197-0'
00000100:00000001:31.0:1773851854.637130:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.637131:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851854.637133:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000093a4bdc pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:4aab4d56-804a-4f56-9252-987d17ee7f99+2189:39803:x1859316989870016:12345-11312@kfi7:400:default-tuolumne1197-0
00000100:00000200:31.0:1773851854.637135:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316989870016
00000020:00000001:31.0:1773851854.637136:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851854.637137:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851854.637138:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.637139:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851854.637140:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851854.637141:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851854.637142:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316989870016, found 0 last_xid 1859316989179903
00000020:00000001:31.0:1773851854.637143:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851854.637144:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851854.637145:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851854.637146:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.637147:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851854.637148:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851854.637149:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851854.637150:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad1c0d73.
02000000:00000001:31.0:1773851854.637151:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.637152:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.637153:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851854.637154:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593489, transno 0, xid 1859316989870016
00010000:00000001:31.0:1773851854.637155:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851854.637157:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000093a4bdc x1859316989870016/t0(0) o400->4aab4d56-804a-4f56-9252-987d17ee7f99@11312@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1197-0'
00010000:00000001:31.0:1773851854.637161:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851854.637162:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851854.637163:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=87 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851854.637164:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851854.637166:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000071f74d6b refcount 3 to 11312@kfi7
00000100:00000001:31.0:1773851854.637167:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333472 : -107155408218144 : ffff9e8aeff517e0)
02000000:00000001:31.0:1773851854.637168:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851854.637169:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.637170:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851854.637171:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11504@kfi7
00000400:00000010:31.0:1773851854.637172:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025a37126.
00000100:00000200:31.0:1773851854.637173:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316989870016, offset 224
00000400:00000200:31.0:1773851854.637175:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11504@kfi7
00000400:00000200:31.0:1773851854.637177:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11504@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.637178:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 1
00000400:00000200:31.0:1773851854.637180:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 2
00000400:00000200:31.0:1773851854.637181:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 3
00000400:00000200:31.0:1773851854.637183:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11504@kfi7 local destination
00000400:00000200:31.0:1773851854.637185:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768610:8768610:1024:4294967295] 11504@kfi7 LPNI seq info [22618630:22618630:16:4294967295]
00000400:00000200:31.0:1773851854.637188:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 2
00000400:00000200:31.0:1773851854.637189:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11504@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.637193:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11504@kfi7(11504@kfi7:11504@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851854.637195:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 3
00000800:00000200:31.0:1773851854.637197:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851854.637199:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851854.637203:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851854.637207:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000020b Using peer 11504@kfi7(0x10000000000020b)
00000800:00000200:31.0:1773851854.637212:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x10000000000020b: rc=0
00000800:00000200:31.0:1773851854.637214:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000020b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851854.637217:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.637219:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000071f74d6b refcount 2 to 11312@kfi7
00010000:00000001:31.0:1773851854.637220:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851854.637221:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.637222:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851854.637223:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000093a4bdc x1859316989870016/t0(0) o400->4aab4d56-804a-4f56-9252-987d17ee7f99@11312@kfi7:642/0 lens 224/224 e 0 to 0 dl 1773852002 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1197-0'
00000800:00000200:29.0:1773851854.637227:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000020b TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851854.637228:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000093a4bdc pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:4aab4d56-804a-4f56-9252-987d17ee7f99+2189:39803:x1859316989870016:12345-11312@kfi7:400:default-tuolumne1197-0 Request processed in 97us (144us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851854.637232:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11312@kfi7, seq: 2055461
00000100:00000040:31.0:1773851854.637233:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fb49f329 : new rpc_count 7
00000400:00000200:29.0:1773851854.637233:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851854.637234:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851854.637234:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11504@kfi7: PUT: OK
00000100:00000001:31.0:1773851854.637235:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851854.637236:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851854.637236:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025a37126
00000400:00000010:29.0:1773851854.637236:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025a37126.
00000020:00000010:31.0:1773851854.637237:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851854.637238:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025d2a996.
00000100:00000001:29.0:1773851854.637238:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851854.637238:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:31.0:1773851854.637239:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000fb49f329 : new refcount 2188
00000100:00000001:31.0:1773851854.637240:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851854.637240:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a3c1fbe1 nid 11504@kfi7 refs 2
00000800:00000200:29.0:1773851854.637242:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 11504@kfi7(0000000021e6e3b9):0x0 lsk 524 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000020b Transaction freed
00000800:00000200:5.0:1773851854.645990:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851854.645991:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851854.645993:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851854.645995:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851854.645996:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851854.645997:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11586@kfi7(00000000bc1da9ef):0xdac version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851854.645998:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851854.646000:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac Using peer 11586@kfi7(0xdac)
00000800:00000200:6.0:1773851854.646002:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851854.646004:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11586@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.646005:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11586@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.646007:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11586@kfi7 : PUT - for me
00000800:00000200:5.0:1773851854.646007:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 38 bytes to peer 0xdac: rc=0
00000800:00000200:5.0:1773851854.646009:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851854.646010:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11586@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.646011:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000913c3d66 nid 11586@kfi7 refs 1
00000400:00000200:6.0:1773851854.646013:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11586@kfi7 to cpt 1
00000400:00000200:6.0:1773851854.646014:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000913c3d66 nid 11586@kfi7 refs 2
00000400:00000200:6.0:1773851854.646016:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000913c3d66 nid 11586@kfi7 refs 3
00000400:00000200:6.0:1773851854.646017:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11587@kfi7 to cpt 4
00000400:00000200:6.0:1773851854.646019:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11587@kfi7 of length 224 into portal 12 MB=0x69b4b57e64200
00000400:00000200:6.0:1773851854.646021:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11587@kfi7 of length 224/224 into md 0x793926dc5 [64] + 118248
00000800:00000200:5.0:1773851854.646022:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851854.646024:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851854.646026:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac Transaction freed
00000400:00000200:6.0:1773851854.646027:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851854.646029:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11586@kfi7: PUT: OK
00000100:00000001:6.0:1773851854.646030:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851854.646031:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851854.646033:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000020a011a4.
00000100:00000040:6.0:1773851854.646034:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000020a011a4 x1859597759824384 msgsize 224
00000100:00100000:6.0:1773851854.646037:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-11587@kfi7 (source: 12345-11586@kfi7)
00000100:00000001:6.0:1773851854.646038:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851854.646039:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000913c3d66 nid 11586@kfi7 refs 2
00000100:00000001:7.0:1773851854.646041:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851854.646042:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851854.646042:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851854.646042:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851854.646043:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851854.646045:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851854.646046:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597759824384
00000020:00000001:7.0:1773851854.646047:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851854.646047:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7a819
00000020:00000001:7.0:1773851854.646048:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851854.646053:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b62f6cfd refcount=5
00000020:00000001:7.0:1773851854.646054:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636953160450048 : -107120549101568 : ffff9e930db90000)
00000020:00000001:7.0:1773851854.646056:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636953160450048 : -107120549101568 : ffff9e930db90000)
00000100:00000001:7.0:1773851854.646057:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851854.646059:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851854.646060:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000c1e289c.
00000020:00000010:7.0:1773851854.646061:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851854.646062:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851854.646064:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851854.646065:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851854.646066:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.646067:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851854.646068:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851854.646069:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.646070:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.646072:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851854.646073:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851854.646073:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851854.646074:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851854.646075:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11587@kfi7, seq: 2001851
00000100:00000040:7.0:1773851854.646076:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b62f6cfd : new rpc_count 1
00000100:00000001:5.0:1773851854.646076:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.646077:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637142942787712 : -106930766763904 : ffff9ebf3da1a880)
00000100:00000001:5.0:1773851854.646077:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.646079:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000020a011a4 x1859597759824384/t0(0) o400->f767ffcc-932b-45f0-9f77-64c7190ea705@11587@kfi7:44/0 lens 224/0 e 0 to 0 dl 1773852159 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1224-0'
00000100:00000001:7.0:1773851854.646084:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851854.646085:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851854.646087:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020a011a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:f767ffcc-932b-45f0-9f77-64c7190ea705+5:39505:x1859597759824384:12345-11587@kfi7:400:default-tuolumne1224-0
00000100:00000200:7.0:1773851854.646089:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597759824384
00000020:00000001:7.0:1773851854.646090:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851854.646091:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851854.646092:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.646093:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851854.646094:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851854.646096:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851854.646097:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597759824384, found 0 last_xid 1859597759824383
00000020:00000001:7.0:1773851854.646098:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851854.646099:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851854.646100:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851854.646101:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.646102:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851854.646103:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851854.646103:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851854.646104:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fd596955.
02000000:00000001:7.0:1773851854.646105:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.646106:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.646108:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851854.646109:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096685492, transno 0, xid 1859597759824384
00010000:00000001:7.0:1773851854.646110:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851854.646111:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000020a011a4 x1859597759824384/t0(0) o400->f767ffcc-932b-45f0-9f77-64c7190ea705@11587@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1224-0'
00010000:00000001:7.0:1773851854.646115:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851854.646116:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851854.646117:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=86 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851854.646119:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851854.646121:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009f701d7e refcount 3 to 11587@kfi7
00000100:00000001:7.0:1773851854.646122:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519296 : -107156126032320 : ffff9e8ac52c1e40)
02000000:00000001:7.0:1773851854.646123:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851854.646124:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.646126:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851854.646127:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11586@kfi7
00000400:00000010:7.0:1773851854.646128:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000068cc9555.
00000100:00000200:7.0:1773851854.646129:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597759824384, offset 224
00000400:00000200:7.0:1773851854.646131:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11586@kfi7
00000400:00000200:7.0:1773851854.646133:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11586@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.646134:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000913c3d66 nid 11586@kfi7 refs 1
00000400:00000200:7.0:1773851854.646136:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000913c3d66 nid 11586@kfi7 refs 2
00000400:00000200:7.0:1773851854.646138:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000913c3d66 nid 11586@kfi7 refs 3
00000400:00000200:7.0:1773851854.646139:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11586@kfi7 local destination
00000400:00000200:7.0:1773851854.646142:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768611:8768611:1024:4294967295] 11586@kfi7 LPNI seq info [812429:812429:16:4294967295]
00000400:00000200:7.0:1773851854.646144:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000913c3d66 nid 11586@kfi7 refs 2
00000400:00000200:7.0:1773851854.646145:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11586@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.646149:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11586@kfi7(11586@kfi7:11586@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851854.646151:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000913c3d66 nid 11586@kfi7 refs 3
00000800:00000200:7.0:1773851854.646153:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851854.646155:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851854.646158:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851854.646162:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac Using peer 11586@kfi7(0xdac)
00000800:00000200:7.0:1773851854.646166:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0xdac: rc=0
00000800:00000200:7.0:1773851854.646169:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851854.646172:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.646174:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009f701d7e refcount 2 to 11587@kfi7
00010000:00000001:7.0:1773851854.646175:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851854.646176:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.646177:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851854.646178:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000020a011a4 x1859597759824384/t0(0) o400->f767ffcc-932b-45f0-9f77-64c7190ea705@11587@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1224-0'
00000800:00000200:5.0:1773851854.646182:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851854.646184:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020a011a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:f767ffcc-932b-45f0-9f77-64c7190ea705+5:39505:x1859597759824384:12345-11587@kfi7:400:default-tuolumne1224-0 Request processed in 99us (149us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851854.646184:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851854.646186:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11586@kfi7: PUT: OK
00000400:00000200:5.0:1773851854.646187:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000068cc9555
00000100:00100000:7.0:1773851854.646188:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11587@kfi7, seq: 2001851
00000400:00000010:5.0:1773851854.646188:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000068cc9555.
00000100:00000040:7.0:1773851854.646189:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b62f6cfd : new rpc_count 0
00000100:00000001:5.0:1773851854.646189:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851854.646190:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851854.646190:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851854.646191:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851854.646192:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851854.646192:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000913c3d66 nid 11586@kfi7 refs 2
00000020:00000010:7.0:1773851854.646193:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000800:00000200:5.0:1773851854.646194:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 11586@kfi7(00000000bc1da9ef):0x0 lsk 3501 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdac Transaction freed
00000020:00000010:7.0:1773851854.646195:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000c1e289c.
00000020:00000040:7.0:1773851854.646196:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000b62f6cfd : new refcount 4
00000100:00000001:7.0:1773851854.646197:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851854.665730:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851854.665730:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:4.0:1773851854.665730:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:6.0:1773851854.665731:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a97ad12.
00000004:00000001:0.0:1773851854.665731:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:29.0:1773851854.665732:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851854.665732:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:8.0:1773851854.665732:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:6.0:1773851854.665732:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000004:00000020:0.0:1773851854.665732:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:29.0:1773851854.665733:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:8.0:1773851854.665733:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:6.0:1773851854.665733:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851854.665733:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:4.0:1773851854.665733:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851854.665734:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000543749aa.
00000004:00000020:28.0:1773851854.665734:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:28.0:1773851854.665734:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000014ee1213.
02000000:00000001:6.0:1773851854.665734:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:4.0:1773851854.665734:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000083f226b7.
00000100:00000010:0.0:1773851854.665734:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002beed3bf.
00000020:00000040:29.0:1773851854.665735:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000020:00000040:28.0:1773851854.665735:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000100:00000010:8.0:1773851854.665735:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000821d3b26.
02000000:00000010:6.0:1773851854.665735:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004acfe469.
00000020:00000040:4.0:1773851854.665735:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000020:00000040:0.0:1773851854.665735:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000100:00000001:29.0:1773851854.665736:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:8.0:1773851854.665736:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
00000100:00000001:6.0:1773851854.665736:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851854.665736:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:0.0:1773851854.665736:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851854.665737:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:28.0:1773851854.665737:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851854.665737:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.665737:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851854.665737:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:0.0:1773851854.665737:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:0.0:1773851854.665737:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851854.665738:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851854.665738:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000040:6.0:1773851854.665738:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007a97ad12] to pc [ptlrpcd_01_02+2]  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851854.665739:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851854.665739:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.665739:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851854.665739:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851854.665739:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000709e948f.
00000100:00000001:0.0:1773851854.665739:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.665740:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851854.665740:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000022c33118.
00000100:00000001:0.0:1773851854.665740:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:29.0:1773851854.665741:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
02000000:00000010:28.0:1773851854.665741:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e26a8126.
00000100:00000001:4.0:1773851854.665741:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851854.665741:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:0.0:1773851854.665741:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.665742:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851854.665742:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851854.665742:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:4.0:1773851854.665742:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851854.665742:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002beed3bf] to pc [ptlrpcd_00_00+0]  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851854.665743:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851854.665743:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851854.665743:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:6.0:1773851854.665743:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:4.0:1773851854.665743:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000083f226b7] to pc [ptlrpcd_01_03+3]  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851854.665744:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000543749aa] to pc [ptlrpcd_07_01+1]  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851854.665744:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.665744:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:6.0:1773851854.665744:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000005041e9c5.
00000100:00000001:5.0:1773851854.665744:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:28.0:1773851854.665745:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000014ee1213] to pc [ptlrpcd_07_02+2]  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851854.665745:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851854.665745:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:6.0:1773851854.665745:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637156660741120 : -106917048810496 : ffff9ec26f490400)
00000100:00000001:5.0:1773851854.665745:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851854.665746:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.665746:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:6.0:1773851854.665746:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851854.665746:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:4.0:1773851854.665746:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:0.0:1773851854.665746:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.665747:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.665747:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851854.665747:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851854.665747:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851854.665747:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00000100:00000040:5.0:1773851854.665747:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:4.0:1773851854.665747:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008c84125c.
00000100:00000040:7.0:1773851854.665748:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:6.0:1773851854.665748:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000000723e7e5.
00080000:00000001:4.0:1773851854.665748:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637133301526528 : -106940408025088 : ffff9ebcfef7b000)
00080000:00000001:4.0:1773851854.665748:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:2.0:1773851854.665748:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851854.665748:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851854.665749:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:29.0:1773851854.665749:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.665749:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000821d3b26] to pc [ptlrpcd_02_03+3]  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:6.0:1773851854.665749:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614129119024140ns, next at 614130119023318ns, rc = 0
00080000:00000001:6.0:1773851854.665749:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:5.0:1773851854.665749:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:4.0:1773851854.665749:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.665749:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665749:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851854.665749:0:41060:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:31.0:1773851854.665750:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851854.665750:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:30.0:1773851854.665750:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:6.0:1773851854.665750:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665750:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:4.0:1773851854.665750:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000100:00000040:1.0:1773851854.665750:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851854.665751:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851854.665751:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851854.665751:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851854.665751:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851854.665751:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851854.665751:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851854.665751:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:5.0:1773851854.665751:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:4.0:1773851854.665751:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d42eddde.
00000004:00080000:4.0:1773851854.665751:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614129119026985ns, next at 614130119026074ns, rc = 0
00000100:00000001:29.0:1773851854.665752:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:28.0:1773851854.665752:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ec11d2f7.
00080000:00000001:28.0:1773851854.665752:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637148139914240 : -106925569637376 : ffff9ec073678400)
02000000:00000001:7.0:1773851854.665752:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851854.665752:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851854.665752:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a97ad12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051923200:46@kfi7:13:default-yuba2-0
00080000:00000001:4.0:1773851854.665752:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:29.0:1773851854.665753:0:41091:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:29.0:1773851854.665753:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:28.0:1773851854.665753:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:7.0:1773851854.665753:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000083f226b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051923328:2085@kfi7:13:default-yuba2-0
00080000:00000001:4.0:1773851854.665753:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851854.665753:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665753:0:41060:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851854.665754:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851854.665754:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.665754:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851854.665754:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:5.0:1773851854.665754:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:5.0:1773851854.665754:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:1.0:1773851854.665754:0:41060:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.665755:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851854.665755:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851854.665755:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851854.665755:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.665755:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:7.0:1773851854.665755:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851854.665755:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:5.0:1773851854.665755:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851854.665755:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:1.0:1773851854.665755:0:41060:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:1.0:1773851854.665755:0:41060:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.665756:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:29.0:1773851854.665756:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851854.665756:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851854.665756:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851854.665756:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00080000:00000001:8.0:1773851854.665756:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000010:7.0:1773851854.665756:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b29eb503.
02000000:00000010:5.0:1773851854.665756:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002264044c.
02000000:00000001:31.0:1773851854.665757:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851854.665757:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000543749aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051923456:2056@kfi7:13:default-yuba2-0
00000100:00000040:29.0:1773851854.665757:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:28.0:1773851854.665757:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008286d68a.
00000100:00000001:10.0:1773851854.665757:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851854.665757:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:7.0:1773851854.665757:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851854.665757:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851854.665757:0:41060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002beed3bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051923264:2057@kfi7:13:default-yuba2-0
00000004:00080000:28.0:1773851854.665758:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614129119033678ns, next at 614130119032536ns, rc = 0
00000100:00000001:10.0:1773851854.665758:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851854.665758:0:41070:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00000001:9.0:1773851854.665758:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000010:8.0:1773851854.665758:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000db30ef3a.
00000400:00000200:7.0:1773851854.665758:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:1.0:1773851854.665758:0:41060:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851854.665759:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:28.0:1773851854.665759:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:8.0:1773851854.665759:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636979027079168 : -107094682472448 : ffff9e99137e7000)
00000400:00000010:7.0:1773851854.665759:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000400:00000010:7.0:1773851854.665759:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000232fbe3.
00000400:00000200:5.0:1773851854.665759:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000010:5.0:1773851854.665759:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f228ac8a.
02000000:00000001:1.0:1773851854.665759:0:41060:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851854.665760:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851854.665760:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.665760:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:28.0:1773851854.665760:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851854.665760:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851854.665760:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:8.0:1773851854.665760:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000200:7.0:1773851854.665760:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923328, portal 4
00000400:00000010:5.0:1773851854.665760:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032855b1f.
02000000:00000001:1.0:1773851854.665760:0:41060:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851854.665760:0:41060:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:31.0:1773851854.665761:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:29.0:1773851854.665761:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851854.665761:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000001:28.0:1773851854.665761:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851854.665761:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851854.665761:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851854.665761:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851854.665761:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528722560 : -106978180829056 : ffff9eb433887080)
00000100:00000200:5.0:1773851854.665761:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923200, portal 4
02000000:00000010:1.0:1773851854.665761:0:41060:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003ef8b576.
02000000:00000010:31.0:1773851854.665762:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e9f67bb0.
02000000:00000001:31.0:1773851854.665762:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851854.665762:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851854.665762:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851854.665762:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.665762:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851854.665762:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851854.665762:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637142942786560 : -106930766765056 : ffff9ebf3da1a400)
02000000:00000001:1.0:1773851854.665762:0:41060:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851854.665763:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014ee1213 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051923392:2065@kfi7:13:default-yuba2-0
00000100:00000040:9.0:1773851854.665763:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:8.0:1773851854.665763:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000400:00000200:1.0:1773851854.665763:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:31.0:1773851854.665764:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:29.0:1773851854.665764:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:7.0:1773851854.665764:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851854.665764:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:1.0:1773851854.665764:0:41060:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001d866e0e.
00000400:00000010:31.0:1773851854.665765:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
02000000:00000001:29.0:1773851854.665765:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851854.665765:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851854.665765:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000000a05c615.
00000100:00000040:7.0:1773851854.665765:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000010:1.0:1773851854.665765:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000226d8b0f.
00000400:00000010:31.0:1773851854.665766:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002000cf5e.
02000000:00000001:29.0:1773851854.665766:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00080000:8.0:1773851854.665766:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614129119041773ns, next at 614130119039569ns, rc = 0
00000400:00000010:7.0:1773851854.665766:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036a990bc.
00000100:00000001:5.0:1773851854.665766:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:1.0:1773851854.665766:0:41060:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923264, portal 4
02000000:00000010:29.0:1773851854.665767:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000079640adb.
00080000:00000001:8.0:1773851854.665767:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000200:7.0:1773851854.665767:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923328, offset 0
00000100:00000040:5.0:1773851854.665767:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000010:5.0:1773851854.665767:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e34c40c.
00000100:00000001:1.0:1773851854.665767:0:41060:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:31.0:1773851854.665768:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923456, portal 4
02000000:00000001:29.0:1773851854.665768:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851854.665768:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:8.0:1773851854.665768:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851854.665768:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000100:00000200:5.0:1773851854.665768:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923200, offset 0
00000100:00000001:1.0:1773851854.665768:0:41060:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203067904 : -107102506483712 : ffff9e9741258000)
00000400:00000200:29.0:1773851854.665769:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:9.0:1773851854.665769:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851854.665769:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851854.665769:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000040:1.0:1773851854.665769:0:41060:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851854.665770:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851854.665770:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637165180401152 : -106908529150464 : ffff9ec46b18b600)
00000400:00000010:29.0:1773851854.665770:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000060a59eec.
02000000:00000001:9.0:1773851854.665770:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851854.665770:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851854.665770:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:7.0:1773851854.665770:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:5.0:1773851854.665770:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000010:29.0:1773851854.665771:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1fc7045.
00000100:00100000:9.0:1773851854.665771:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000821d3b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051923520:2055@kfi7:13:default-yuba2-0
00000100:00000040:31.0:1773851854.665772:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851854.665772:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923392, portal 4
00000400:00000200:7.0:1773851854.665772:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000001:1.0:1773851854.665772:0:41060:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:29.0:1773851854.665773:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851854.665773:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324228992 : -106976385322624 : ffff9eb49e8db180)
00000100:00000001:9.0:1773851854.665773:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:7.0:1773851854.665773:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000100:00000040:1.0:1773851854.665773:0:41060:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000100:00000040:29.0:1773851854.665774:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851854.665774:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851854.665774:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:1.0:1773851854.665774:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003054ad65.
02000000:00000001:9.0:1773851854.665775:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:7.0:1773851854.665775:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768611, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768610, p:4294967295, g:4294967295, h:1000]
00000100:00000200:1.0:1773851854.665775:0:41060:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923264, offset 0
02000000:00000010:9.0:1773851854.665776:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e50c3955.
02000000:00000001:9.0:1773851854.665776:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851854.665776:0:41060:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000100:00000001:31.0:1773851854.665777:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:29.0:1773851854.665777:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851854.665777:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000040:31.0:1773851854.665778:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000100:00000040:29.0:1773851854.665778:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000010:29.0:1773851854.665778:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bfe97a25.
00000400:00000200:9.0:1773851854.665778:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000010:9.0:1773851854.665778:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000071ec9fd.
00000400:00000200:7.0:1773851854.665778:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:1.0:1773851854.665778:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:1.0:1773851854.665778:0:41060:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000010:31.0:1773851854.665779:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000eb85f77.
00000100:00000200:29.0:1773851854.665779:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923392, offset 0
00000400:00000200:7.0:1773851854.665779:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:29.0:1773851854.665780:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000400:00000010:9.0:1773851854.665780:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000146cbe4e.
00000400:00000200:1.0:1773851854.665780:0:41060:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000200:31.0:1773851854.665781:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923456, offset 0
00000100:00000200:9.0:1773851854.665781:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923520, portal 4
00000400:00000200:7.0:1773851854.665781:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768612:8768612:1024:4294967295] 2085@kfi7 LPNI seq info [5403237:5403237:16:4294967295]
00000400:00000200:1.0:1773851854.665781:0:41060:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:29.0:1773851854.665782:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:29.0:1773851854.665782:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000100:00000001:9.0:1773851854.665782:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851854.665782:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491251712 : -107117218299904 : ffff9e93d4410000)
00000400:00000200:7.0:1773851854.665782:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:1.0:1773851854.665782:0:41060:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:31.0:1773851854.665783:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000200:29.0:1773851854.665784:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000040:9.0:1773851854.665784:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851854.665784:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851854.665784:0:41060:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768611, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768612, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851854.665785:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000001:9.0:1773851854.665786:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851854.665786:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851854.665787:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000100:00000040:9.0:1773851854.665787:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000200:7.0:1773851854.665787:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851854.665787:0:41060:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:1.0:1773851854.665787:0:41060:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000010:9.0:1773851854.665788:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000400:00000200:1.0:1773851854.665788:0:41060:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:29.0:1773851854.665789:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768611, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768612, p:4294967295, g:4294967295, h:1000]
00000100:00000200:9.0:1773851854.665789:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923520, offset 0
00000800:00000200:7.0:1773851854.665789:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851854.665789:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.665790:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:5.0:1773851854.665790:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:1.0:1773851854.665790:0:41060:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768613:8768613:1024:4294967295] 2057@kfi7 LPNI seq info [5404103:5404103:16:4294967295]
00000400:00000200:9.0:1773851854.665791:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:7.0:1773851854.665791:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851854.665791:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:1.0:1773851854.665791:0:41060:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:29.0:1773851854.665792:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:5.0:1773851854.665792:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:1.0:1773851854.665792:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:29.0:1773851854.665793:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851854.665793:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:29.0:1773851854.665794:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000400:00000200:9.0:1773851854.665794:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:7.0:1773851854.665794:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:5.0:1773851854.665794:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000400:00000200:9.0:1773851854.665795:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:29.0:1773851854.665796:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768614:8768614:1023:4294967295] 2065@kfi7 LPNI seq info [5402825:5402825:16:4294967295]
00000400:00000200:9.0:1773851854.665796:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:5.0:1773851854.665796:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768614, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768612, p:4294967295, g:4294967295, h:1000]
00000400:00000200:1.0:1773851854.665796:0:41060:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851854.665797:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:7.0:1773851854.665797:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Using peer 2085@kfi7(0x200000000000110)
00000400:00000200:29.0:1773851854.665798:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:9.0:1773851854.665798:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768614, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768612, p:4294967295, g:4294967295, h:1000]
00000400:00000200:1.0:1773851854.665798:0:41060:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:5.0:1773851854.665799:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:1.0:1773851854.665799:0:41060:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:31.0:1773851854.665800:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:9.0:1773851854.665800:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:5.0:1773851854.665800:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851854.665801:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000800:00000200:7.0:1773851854.665801:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x200000000000110: rc=0
00000400:00000200:5.0:1773851854.665801:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000800:00000200:1.0:1773851854.665801:0:41060:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851854.665802:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851854.665802:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851854.665803:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:29.0:1773851854.665803:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:9.0:1773851854.665803:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000800:00000200:7.0:1773851854.665803:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851854.665803:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768615:8768615:1023:4294967295] 46@kfi7 LPNI seq info [5403855:5403855:16:4294967295]
00000400:00000200:9.0:1773851854.665804:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768616:8768616:1023:4294967295] 2055@kfi7 LPNI seq info [5404667:5404667:16:4294967295]
00000800:00000200:1.0:1773851854.665804:0:41060:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:31.0:1773851854.665805:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000800:00000200:29.0:1773851854.665805:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:7.0:1773851854.665805:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851854.665805:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:9.0:1773851854.665806:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:7.0:1773851854.665806:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851854.665806:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:1.0:1773851854.665806:0:41060:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000800:00000200:29.0:1773851854.665807:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851854.665807:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:7.0:1773851854.665807:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.665807:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851854.665808:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000100:00000001:7.0:1773851854.665808:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.665809:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851854.665810:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:7.0:1773851854.665810:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851854.665810:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:1.0:1773851854.665810:0:41060:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0x295: rc=0
00000400:00000200:31.0:1773851854.665811:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8768614, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8768616, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851854.665811:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851854.665811:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851854.665811:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851854.665811:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000800:00000200:1.0:1773851854.665811:0:41060:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851854.665812:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000100:00000001:7.0:1773851854.665812:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851854.665812:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:29.0:1773851854.665813:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Using peer 2065@kfi7(0x5e8)
00000800:00000200:6.0:1773851854.665813:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851854.665814:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:9.0:1773851854.665814:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:6.0:1773851854.665815:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851854.665815:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:1.0:1773851854.665815:0:41060:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665815:0:41060:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:31.0:1773851854.665816:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:9.0:1773851854.665816:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851854.665816:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:1.0:1773851854.665816:0:41060:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851854.665817:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 324 bytes to peer 0x5e8: rc=0
00000400:00000200:6.0:1773851854.665817:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000400:00000200:6.0:1773851854.665817:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036a990bc
00000100:00000001:1.0:1773851854.665817:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851854.665818:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000800:00000200:29.0:1773851854.665818:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000010:6.0:1773851854.665818:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036a990bc.
00000100:00000001:6.0:1773851854.665818:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:1.0:1773851854.665818:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851854.665819:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:6.0:1773851854.665819:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851854.665819:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:1.0:1773851854.665819:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851854.665819:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:31.0:1773851854.665820:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768617:8768617:1022:4294967295] 2056@kfi7 LPNI seq info [5402397:5402397:16:4294967295]
00000100:00000001:29.0:1773851854.665820:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665820:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851854.665820:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851854.665821:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:1.0:1773851854.665821:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665821:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851854.665822:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:29.0:1773851854.665822:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.665822:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851854.665822:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:5.0:1773851854.665822:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de Using peer 46@kfi7(0x2000000000003de)
00000100:00000001:29.0:1773851854.665823:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851854.665823:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000100:00000040:6.0:1773851854.665823:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:2.0:1773851854.665823:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851854.665824:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:6.0:1773851854.665825:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851854.665825:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:2.0:1773851854.665825:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851854.665826:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000400:00000200:6.0:1773851854.665826:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:5.0:1773851854.665826:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x2000000000003de: rc=0
00000400:00000200:2.0:1773851854.665826:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000400:00000200:2.0:1773851854.665827:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003054ad65
00000400:00000010:2.0:1773851854.665827:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003054ad65.
00000400:00000200:31.0:1773851854.665828:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000800:00000200:9.0:1773851854.665828:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851854.665828:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Transaction freed
00000800:00000200:5.0:1773851854.665828:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851854.665828:0:2506505:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:30.0:1773851854.665829:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_EVENT_TX_OK event status 0
00000100:00000200:2.0:1773851854.665829:0:2506505:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851854.665830:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665830:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851854.665831:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:30.0:1773851854.665831:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851854.665831:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851854.665831:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851854.665832:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665832:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.665832:0:2506505:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:31.0:1773851854.665833:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:30.0:1773851854.665833:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000100:00000001:9.0:1773851854.665833:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665833:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665833:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:2.0:1773851854.665833:0:2506505:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851854.665834:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bfe97a25
00000400:00000010:30.0:1773851854.665834:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bfe97a25.
00000100:00000001:9.0:1773851854.665834:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665834:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:31.0:1773851854.665835:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:30.0:1773851854.665835:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:5.0:1773851854.665835:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851854.665835:0:2506505:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851854.665836:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851854.665836:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851854.665836:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851854.665836:0:2506505:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851854.665837:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665837:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851854.665837:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:9.0:1773851854.665838:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851854.665838:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de TN_EVENT_TX_OK event status 0
00000800:00000200:31.0:1773851854.665839:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:30.0:1773851854.665839:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:2.0:1773851854.665839:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000100:00000040:30.0:1773851854.665840:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851854.665840:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851854.665840:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.665841:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000400:00000200:9.0:1773851854.665842:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000400:00000200:6.0:1773851854.665842:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000800:00000200:31.0:1773851854.665843:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Using peer 2056@kfi7(0x204)
00000100:00000001:30.0:1773851854.665843:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851854.665843:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:9.0:1773851854.665843:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000400:00000200:6.0:1773851854.665843:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e34c40c
00000100:00000001:9.0:1773851854.665844:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000010:6.0:1773851854.665844:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e34c40c.
00000400:00000200:30.0:1773851854.665845:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000200:9.0:1773851854.665845:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851854.665845:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:30.0:1773851854.665846:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Transaction freed
00000100:00000200:6.0:1773851854.665846:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851854.665847:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x204: rc=0
00000100:00000001:9.0:1773851854.665848:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851854.665848:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851854.665849:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851854.665850:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:9.0:1773851854.665850:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851854.665850:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851854.665851:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:9.0:1773851854.665852:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851854.665852:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851854.665852:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851854.665853:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851854.665853:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851854.665853:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:5.0:1773851854.665853:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851854.665854:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851854.665854:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:31.0:1773851854.665855:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851854.665855:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de Transaction freed
00000800:00000200:5.0:1773851854.665855:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851854.665856:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851854.665856:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Transaction freed
00000100:00000001:31.0:1773851854.665857:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851854.665857:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851854.665859:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851854.665859:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:29.0:1773851854.665859:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851854.665859:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2085@kfi7 : PUT - for me
00000400:00000200:29.0:1773851854.665860:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851854.665860:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:5.0:1773851854.665860:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851854.665861:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:17.0:1773851854.665861:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:13.0:1773851854.665861:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851854.665861:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000001:31.0:1773851854.665862:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851854.665862:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851854.665862:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000800:00000200:17.0:1773851854.665862:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851854.665862:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851854.665862:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851854.665863:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851854.665863:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000eb85f77
00000400:00000010:29.0:1773851854.665863:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000eb85f77.
00000400:00000200:5.0:1773851854.665863:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:29.0:1773851854.665864:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:17.0:1773851854.665864:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851854.665864:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851854.665864:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000200:29.0:1773851854.665865:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851854.665865:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:17.0:1773851854.665866:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851854.665866:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:5.0:1773851854.665866:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2380
00000100:00000001:29.0:1773851854.665867:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851854.665867:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000040:29.0:1773851854.665868:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851854.665868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851854.665868:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000200:13.0:1773851854.665869:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:5.0:1773851854.665869:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b2ffc5 [1] + 224
00000400:00000200:17.0:1773851854.665870:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:17.0:1773851854.665870:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851854.665870:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:17.0:1773851854.665871:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:13.0:1773851854.665871:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:5.0:1773851854.665871:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851854.665872:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851854.665872:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:17.0:1773851854.665873:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:13.0:1773851854.665873:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:5.0:1773851854.665873:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851854.665874:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851854.665874:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:13.0:1773851854.665874:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:5.0:1773851854.665874:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000001:29.0:1773851854.665875:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:17.0:1773851854.665875:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851854.665875:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2340
00000100:00000001:5.0:1773851854.665875:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851854.665876:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:17.0:1773851854.665876:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b23c0
00000400:00000200:13.0:1773851854.665876:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:9.0:1773851854.665876:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000200:5.0:1773851854.665876:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851854.665877:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Transaction freed
00000400:00000200:17.0:1773851854.665877:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:9.0:1773851854.665877:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851854.665879:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f05f1 [1] + 224
00000400:00000200:13.0:1773851854.665879:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f566d [1] + 224
00000800:00000200:9.0:1773851854.665879:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:5.0:1773851854.665879:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851854.665881:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851854.665881:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851854.665882:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:5.0:1773851854.665882:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851854.665883:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851854.665883:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851854.665883:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851854.665883:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:21.0:1773851854.665884:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:17.0:1773851854.665884:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000400:00000200:9.0:1773851854.665884:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:7.0:1773851854.665884:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851854.665884:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:21.0:1773851854.665885:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:17.0:1773851854.665885:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851854.665885:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000400:00000200:9.0:1773851854.665885:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 46@kfi7 : PUT - for me
00000400:00000001:7.0:1773851854.665885:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851854.665885:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000800:00000200:5.0:1773851854.665885:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000800:00000200:21.0:1773851854.665886:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:13.0:1773851854.665886:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:7.0:1773851854.665886:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000232fbe3
00000100:00000200:17.0:1773851854.665887:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:13.0:1773851854.665887:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851854.665887:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.665887:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000010:7.0:1773851854.665887:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000232fbe3.
00000100:00000001:7.0:1773851854.665887:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851854.665888:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:17.0:1773851854.665889:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851854.665889:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.665889:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000200:7.0:1773851854.665889:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:13.0:1773851854.665890:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851854.665891:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:9.0:1773851854.665891:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:21.0:1773851854.665892:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:9.0:1773851854.665892:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000200:7.0:1773851854.665892:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851854.665893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:17.0:1773851854.665893:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851854.665893:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2300
00000400:00000200:21.0:1773851854.665894:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000100:00000001:13.0:1773851854.665894:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851854.665894:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:7.0:1773851854.665894:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851854.665895:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:17.0:1773851854.665895:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:13.0:1773851854.665895:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:9.0:1773851854.665895:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781696c69 [1] + 224
00000100:00000001:7.0:1773851854.665895:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.665895:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851854.665895:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851854.665896:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851854.665896:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851854.665896:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:7.0:1773851854.665896:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851854.665896:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665896:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851854.665896:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:29.0:1773851854.665897:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851854.665897:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:21.0:1773851854.665897:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:17.0:1773851854.665897:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000800:00000200:13.0:1773851854.665897:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851854.665897:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851854.665897:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=87 v=66 (66 66 66 66)
00000400:00000001:1.0:1773851854.665897:0:41060:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000010:29.0:1773851854.665898:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000060a59eec.
00000800:00000200:9.0:1773851854.665898:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:7.0:1773851854.665898:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=87 v=66 (1 1 1 1)
00000400:00000001:1.0:1773851854.665898:0:41060:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851854.665899:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1fc7045
00000400:00000010:29.0:1773851854.665899:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1fc7045.
00000400:00000200:21.0:1773851854.665899:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:9.0:1773851854.665899:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:1.0:1773851854.665899:0:41060:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001d866e0e.
00000100:00000001:29.0:1773851854.665900:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851854.665900:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2440
00000400:00000200:9.0:1773851854.665900:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000100:00000001:7.0:1773851854.665900:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851854.665900:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851854.665900:0:41060:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000226d8b0f
00000400:00000010:1.0:1773851854.665900:0:41060:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000226d8b0f.
00000100:00000200:29.0:1773851854.665901:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851854.665901:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:9.0:1773851854.665901:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:7.0:1773851854.665901:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851854.665901:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665901:0:41060:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851854.665902:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851854.665902:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000200:1.0:1773851854.665902:0:41060:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851854.665903:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d0455 [1] + 224
00000100:00000200:9.0:1773851854.665903:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851854.665903:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851854.665903:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:29.0:1773851854.665904:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851854.665905:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:9.0:1773851854.665905:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851854.665905:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:1.0:1773851854.665905:0:41060:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:2.0:1773851854.665906:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00000001:29.0:1773851854.665907:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851854.665907:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851854.665907:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851854.665907:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:2.0:1773851854.665907:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:29.0:1773851854.665908:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851854.665908:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:21.0:1773851854.665908:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:7.0:1773851854.665908:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:1.0:1773851854.665908:0:41060:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:1.0:1773851854.665908:0:41060:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851854.665909:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851854.665909:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851854.665909:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000800:00000200:2.0:1773851854.665909:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:1.0:1773851854.665909:0:41060:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:29.0:1773851854.665910:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851854.665910:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851854.665910:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851854.665910:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851854.665910:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000004:00000040:7.0:1773851854.665910:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
02000000:00000001:1.0:1773851854.665910:0:41060:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:1.0:1773851854.665910:0:41060:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:29.0:1773851854.665911:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=87 v=66 (66 66 66 66)
00000100:00000200:21.0:1773851854.665911:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:7.0:1773851854.665911:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351466059776 avail=351462900736 avail_mb=1372901956 hwm_mb=3131103 files=372062973 ffree=343228574 state=0: rc = 0
00000800:00000200:2.0:1773851854.665911:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:1.0:1773851854.665911:0:41060:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851854.665911:0:41060:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851854.665912:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851854.665912:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851854.665912:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:29.0:1773851854.665913:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=87 v=66 (1 1 1 1)
00000004:00000020:7.0:1773851854.665913:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351466059776 free, 351462900736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062973 files, 343228574 free files
00000400:00000001:5.0:1773851854.665913:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:2.0:1773851854.665913:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00001000:1.0:1773851854.665913:0:41060:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=87 v=66 (66 66 66 66)
00000100:00000001:29.0:1773851854.665914:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851854.665914:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851854.665914:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851854.665914:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:5.0:1773851854.665914:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:2.0:1773851854.665914:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2056@kfi7 : PUT - for me
00000100:00001000:1.0:1773851854.665914:0:41060:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=87 v=66 (1 1 1 1)
00010000:00000001:29.0:1773851854.665915:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:7.0:1773851854.665915:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:5.0:1773851854.665915:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f228ac8a.
00000400:00000200:5.0:1773851854.665915:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032855b1f
00000400:00000200:2.0:1773851854.665915:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:1.0:1773851854.665915:0:41060:0:(client.c:1349:ptlrpc_check_status()) Process entered
00010000:00000001:29.0:1773851854.665916:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851854.665916:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032855b1f.
00000100:00000001:5.0:1773851854.665916:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:2.0:1773851854.665916:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000100:00000001:1.0:1773851854.665916:0:41060:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:1.0:1773851854.665916:0:41060:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:29.0:1773851854.665917:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851854.665917:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000200:5.0:1773851854.665917:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851854.665917:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00010000:00000001:1.0:1773851854.665917:0:41060:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.665918:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851854.665918:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851854.665918:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00100000:7.0:1773851854.665918:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000083f226b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051923328:2085@kfi7:13:default-yuba2-0
00000400:00000200:2.0:1773851854.665918:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:1.0:1773851854.665918:0:41060:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851854.665919:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:21.0:1773851854.665919:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:7.0:1773851854.665919:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851854.665919:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000040:1.0:1773851854.665919:0:41060:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00000001:7.0:1773851854.665920:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:5.0:1773851854.665920:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851854.665920:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:1.0:1773851854.665920:0:41060:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:1.0:1773851854.665920:0:41060:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851854.665921:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851854.665921:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851854.665921:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:7.0:1773851854.665921:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000083f226b7 x1859433051923328/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:2.0:1773851854.665921:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2400
00000100:00000040:1.0:1773851854.665921:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:8.0:1773851854.665922:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:5.0:1773851854.665922:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851854.665923:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851854.665923:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000001:8.0:1773851854.665923:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:7.0:1773851854.665923:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:5.0:1773851854.665923:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851854.665923:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:29.0:1773851854.665924:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:8.0:1773851854.665924:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000071ec9fd.
02000000:00000001:7.0:1773851854.665924:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851854.665924:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b29eb503.
00000100:00000001:5.0:1773851854.665924:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851854.665924:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:2.0:1773851854.665924:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71cc41 [1] + 224
00000100:00000001:1.0:1773851854.665924:0:41060:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:29.0:1773851854.665925:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851854.665925:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000400:00000200:8.0:1773851854.665925:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000146cbe4e
00000400:00000010:8.0:1773851854.665925:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000146cbe4e.
02000000:00000001:7.0:1773851854.665925:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:5.0:1773851854.665925:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851854.665925:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851854.665925:0:41060:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:1.0:1773851854.665925:0:41060:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:29.0:1773851854.665926:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464037376 avail=351458166784 avail_mb=1372883464 hwm_mb=3131101 files=372060746 ffree=343226599 state=0: rc = 0
00000100:00000001:8.0:1773851854.665926:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000020:00000001:7.0:1773851854.665926:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851854.665926:0:41067:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
02000000:00000001:5.0:1773851854.665926:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851854.665926:0:41060:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:8.0:1773851854.665927:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:7.0:1773851854.665927:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:5.0:1773851854.665927:0:41066:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=87 v=66 (66 66 66 66)
00000800:00000200:2.0:1773851854.665927:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000040:1.0:1773851854.665927:0:41060:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000004:00000020:29.0:1773851854.665928:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464037376 free, 351458166784 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372060746 files, 343226599 free files
02000000:00000010:7.0:1773851854.665928:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000022c33118.
02000000:00000001:7.0:1773851854.665928:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:5.0:1773851854.665928:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=87 v=66 (1 1 1 1)
00000400:00000200:2.0:1773851854.665928:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000040:1.0:1773851854.665928:0:41060:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406602240 avail=351404174336 avail_mb=1372672556 hwm_mb=3131103 files=372127373 ffree=343170510 state=0: rc = 0
02000000:00000001:7.0:1773851854.665929:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851854.665929:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000083f226b7.
00000100:00000001:5.0:1773851854.665929:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:2.0:1773851854.665929:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000004:00000001:29.0:1773851854.665930:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851854.665930:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851854.665930:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851854.665930:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851854.665930:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.665930:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000020:1.0:1773851854.665930:0:41060:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406602240 free, 351404174336 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127373 files, 343170510 free files
00000100:00000040:29.0:1773851854.665931:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851854.665931:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:5.0:1773851854.665931:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851854.665931:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.665932:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851854.665932:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851854.665932:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665932:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851854.665932:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000200:2.0:1773851854.665932:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:1.0:1773851854.665932:0:41060:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.665933:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.665933:0:41070:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:7.0:1773851854.665933:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851854.665933:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665933:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851854.665933:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851854.665933:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:29.0:1773851854.665934:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014ee1213 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051923392:2065@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851854.665934:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851854.665934:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:5.0:1773851854.665934:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:2.0:1773851854.665934:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851854.665935:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.665935:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.665936:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851854.665936:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00001000:8.0:1773851854.665936:0:41070:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=87 v=66 (66 66 66 66)
00000100:00100000:1.0:1773851854.665936:0:41060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002beed3bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051923264:2057@kfi7:13:default-yuba2-0
00000100:00000040:29.0:1773851854.665937:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000014ee1213 x1859433051923392/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:8.0:1773851854.665937:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=87 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851854.665937:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:1.0:1773851854.665937:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.665938:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851854.665938:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851854.665938:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851854.665938:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:1.0:1773851854.665938:0:41060:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851854.665939:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851854.665939:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:1.0:1773851854.665939:0:41060:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002beed3bf x1859433051923264/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851854.665940:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00010000:00000001:8.0:1773851854.665940:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851854.665940:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:5.0:1773851854.665940:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000004:00000040:5.0:1773851854.665940:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489103872 avail=351486099456 avail_mb=1372992576 hwm_mb=3131103 files=372066925 ffree=343251078 state=0: rc = 0
00000400:00000200:2.0:1773851854.665940:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:31.0:1773851854.665941:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:29.0:1773851854.665941:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851854.665941:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000079640adb.
00000100:00000001:8.0:1773851854.665941:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000800:00000200:2.0:1773851854.665941:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000894f0236: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851854.665942:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:8.0:1773851854.665942:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000004:00000020:5.0:1773851854.665942:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489103872 free, 351486099456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066925 files, 343251078 free files
00000100:00000001:1.0:1773851854.665942:0:41060:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:1.0:1773851854.665942:0:41060:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:29.0:1773851854.665943:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851854.665943:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851854.665943:0:41091:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000100:00000001:8.0:1773851854.665943:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851854.665943:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:1.0:1773851854.665943:0:41060:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003ef8b576.
00000400:00000001:31.0:1773851854.665944:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000020:00000001:29.0:1773851854.665944:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:8.0:1773851854.665944:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:5.0:1773851854.665944:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851854.665944:0:41060:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000400:00000001:31.0:1773851854.665945:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000010:29.0:1773851854.665945:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e26a8126.
00000100:00000040:5.0:1773851854.665945:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:1.0:1773851854.665945:0:41060:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:1.0:1773851854.665945:0:41060:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000400:00000010:31.0:1773851854.665946:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
02000000:00000001:29.0:1773851854.665946:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851854.665946:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:1.0:1773851854.665946:0:41060:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000200:31.0:1773851854.665947:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002000cf5e
00000100:00000010:29.0:1773851854.665947:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000014ee1213.
00000100:00000001:8.0:1773851854.665947:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851854.665947:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000010:1.0:1773851854.665947:0:41060:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000709e948f.
00000100:00000001:29.0:1773851854.665948:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851854.665948:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.665948:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:5.0:1773851854.665948:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a97ad12 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051923200:46@kfi7:13:default-yuba2-0
02000000:00000001:1.0:1773851854.665948:0:41060:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000010:31.0:1773851854.665949:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002000cf5e.
00000100:00000001:29.0:1773851854.665949:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851854.665949:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851854.665949:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00000001:5.0:1773851854.665949:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:1.0:1773851854.665949:0:41060:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:31.0:1773851854.665950:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851854.665950:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000040:8.0:1773851854.665950:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382748160 avail=351380697088 avail_mb=1372580848 hwm_mb=3131101 files=371978785 ffree=343147215 state=0: rc = 0
00000100:00000001:5.0:1773851854.665950:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000010:1.0:1773851854.665950:0:41060:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002beed3bf.
00000100:00000200:31.0:1773851854.665951:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851854.665951:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851854.665951:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851854.665951:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851854.665951:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007a97ad12 x1859433051923200/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:1.0:1773851854.665951:0:41060:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:1.0:1773851854.665951:0:41060:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:8.0:1773851854.665952:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382748160 free, 351380697088 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978785 files, 343147215 free files
00000100:00000001:1.0:1773851854.665952:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851854.665953:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.665953:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:1.0:1773851854.665953:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851854.665953:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851854.665954:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:1.0:1773851854.665954:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851854.665954:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851854.665955:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:5.0:1773851854.665955:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002264044c.
02000000:00000001:5.0:1773851854.665956:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000200:31.0:1773851854.665957:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:8.0:1773851854.665957:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000821d3b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051923520:2055@kfi7:13:default-yuba2-0
00000020:00000001:5.0:1773851854.665957:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851854.665957:0:41066:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000020:00000001:5.0:1773851854.665958:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851854.665958:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004acfe469.
00000100:00000001:8.0:1773851854.665959:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:5.0:1773851854.665959:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851854.665960:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851854.665960:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000821d3b26 x1859433051923520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:5.0:1773851854.665960:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851854.665960:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a97ad12.
00000100:00000001:31.0:1773851854.665961:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851854.665961:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851854.665961:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851854.665961:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851854.665962:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.665963:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851854.665963:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851854.665963:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851854.665963:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:5.0:1773851854.665963:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851854.665963:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.665964:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000010:8.0:1773851854.665964:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e50c3955.
00000100:00000001:5.0:1773851854.665964:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851854.665964:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.665965:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.665965:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:31.0:1773851854.665966:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.665966:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851854.665966:0:41070:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000020:00000001:8.0:1773851854.665967:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:31.0:1773851854.665968:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=87 v=66 (66 66 66 66)
02000000:00000010:8.0:1773851854.665968:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:8.0:1773851854.665968:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:31.0:1773851854.665969:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=87 v=66 (1 1 1 1)
02000000:00000001:8.0:1773851854.665969:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851854.665970:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000821d3b26.
00000100:00000001:31.0:1773851854.665971:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851854.665971:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851854.665972:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.665972:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851854.665972:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:31.0:1773851854.665973:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851854.665973:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00010000:00000001:31.0:1773851854.665974:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.665974:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.665974:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851854.665975:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:8.0:1773851854.665975:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.665976:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:31.0:1773851854.665977:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851854.665978:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.665980:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851854.665984:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851854.665985:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851854.665986:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851854.665987:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851854.665988:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851854.665990:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545837568 avail=351536185344 avail_mb=1373188224 hwm_mb=3131103 files=372116532 ffree=343306482 state=0: rc = 0
00000004:00000020:31.0:1773851854.665992:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545837568 free, 351536185344 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116532 files, 343306482 free files
00000004:00000001:31.0:1773851854.665995:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.665997:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851854.666002:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000543749aa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051923456:2056@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851854.666004:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.666006:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851854.666007:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000543749aa x1859433051923456/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852007 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851854.666011:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851854.666012:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851854.666013:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e9f67bb0.
02000000:00000001:31.0:1773851854.666015:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851854.666016:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851854.666016:0:41089:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000020:00000001:31.0:1773851854.666018:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851854.666018:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
02000000:00000001:31.0:1773851854.666020:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851854.666021:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851854.666021:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000543749aa.
00000100:00000001:31.0:1773851854.666023:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851854.666023:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.666024:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.666026:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851854.666026:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.666028:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851854.666028:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851854.678189:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851854.678191:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851854.678193:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851854.678196:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851854.678199:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.678201:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26176@kfi7 : PUT - for me
00000400:00000200:1.0:1773851854.678203:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.678204:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 1
00000400:00000200:1.0:1773851854.678206:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.678207:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000400:00000200:1.0:1773851854.678209:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 3
00000400:00000200:1.0:1773851854.678210:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.678212:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26176@kfi7 of length 224 into portal 12 MB=0x69b4b96e6ac80
00000400:00000200:1.0:1773851854.678214:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26176@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 12896
00000800:00000200:1.0:1773851854.678217:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851854.678220:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851854.678222:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26176@kfi7: PUT: OK
00000100:00000001:1.0:1773851854.678224:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851854.678225:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851854.678226:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000707cac9e.
00000100:00000040:1.0:1773851854.678227:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000707cac9e x1859598816816256 msgsize 224
00000100:00100000:1.0:1773851854.678230:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-26176@kfi7 (source: 12345-26176@kfi7)
00000100:00000001:1.0:1773851854.678232:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851854.678234:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000100:00000001:0.0:1773851854.678234:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851854.678234:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851854.678235:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851854.678235:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851854.678236:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851854.678236:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851854.678237:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598816816256
00000020:00000001:0.0:1773851854.678237:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851854.678238:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389470d7
00000020:00000001:0.0:1773851854.678238:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851854.678241:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000009fb796b refcount=5
00000020:00000001:0.0:1773851854.678241:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143382586368 : -106930326965248 : ffff9ebf57d87400)
00000020:00000001:0.0:1773851854.678242:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143382586368 : -106930326965248 : ffff9ebf57d87400)
00000100:00000001:0.0:1773851854.678243:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851854.678244:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851854.678245:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851854.678246:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851854.678246:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851854.678247:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851854.678248:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851854.678248:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851854.678249:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851854.678249:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851854.678250:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.678251:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851854.678252:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851854.678253:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851854.678253:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851854.678253:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26176@kfi7, seq: 1997490
00000100:00000001:2.0:1773851854.678254:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851854.678254:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000009fb796b : new rpc_count 1
00000100:00000001:2.0:1773851854.678255:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.678255:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605660416 : -106923103891200 : ffff9ec1065fd100)
00000100:00000001:2.0:1773851854.678256:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851854.678256:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000707cac9e x1859598816816256/t0(0) o400->d694a97a-c615-4ad0-9894-0a08ce0bc5b4@26176@kfi7:494/0 lens 224/0 e 0 to 0 dl 1773852609 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2132-0'
00000100:00000001:0.0:1773851854.678258:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851854.678259:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851854.678260:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000707cac9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:d694a97a-c615-4ad0-9894-0a08ce0bc5b4+5:39735:x1859598816816256:12345-26176@kfi7:400:default-tuolumne2132-0
00000100:00000200:0.0:1773851854.678261:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598816816256
00000020:00000001:0.0:1773851854.678261:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851854.678262:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851854.678263:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.678263:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851854.678264:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851854.678264:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851854.678265:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598816816256, found 0 last_xid 1859598816816255
00000020:00000001:0.0:1773851854.678266:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851854.678266:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851854.678267:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851854.678267:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.678268:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851854.678268:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851854.678269:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851854.678270:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000037c10965.
02000000:00000001:0.0:1773851854.678270:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.678271:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.678272:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851854.678272:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183152133795, transno 0, xid 1859598816816256
00010000:00000001:0.0:1773851854.678273:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851854.678273:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000707cac9e x1859598816816256/t0(0) o400->d694a97a-c615-4ad0-9894-0a08ce0bc5b4@26176@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2132-0'
00010000:00000001:0.0:1773851854.678277:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851854.678277:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851854.678278:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=87 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851854.678279:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851854.678280:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000095266bfa refcount 3 to 26176@kfi7
00000100:00000001:0.0:1773851854.678281:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003808 : -107146751547808 : ffff9e8cf3ef6660)
02000000:00000001:0.0:1773851854.678282:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851854.678282:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.678283:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851854.678284:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26176@kfi7
00000400:00000010:0.0:1773851854.678284:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071d311d2.
00000100:00000200:0.0:1773851854.678285:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598816816256, offset 224
00000400:00000200:0.0:1773851854.678287:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26176@kfi7
00000400:00000200:0.0:1773851854.678288:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:0.0:1773851854.678289:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 1
00000400:00000200:0.0:1773851854.678290:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000400:00000200:0.0:1773851854.678291:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 3
00000400:00000200:0.0:1773851854.678292:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26176@kfi7 local destination
00000400:00000200:0.0:1773851854.678293:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768618:8768618:1024:4294967295] 26176@kfi7 LPNI seq info [150617:150617:16:4294967295]
00000400:00000200:0.0:1773851854.678295:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000400:00000200:0.0:1773851854.678296:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:0.0:1773851854.678298:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26176@kfi7(26176@kfi7:26176@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851854.678299:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 3
00000800:00000200:0.0:1773851854.678301:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851854.678302:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851854.678304:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851854.678306:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x72d Using peer 26176@kfi7(0x72d)
00000800:00000200:0.0:1773851854.678311:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x72d: rc=0
00000800:00000200:0.0:1773851854.678312:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x72d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851854.678314:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851854.678315:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000095266bfa refcount 2 to 26176@kfi7
00010000:00000001:0.0:1773851854.678316:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851854.678317:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851854.678317:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851854.678318:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000707cac9e x1859598816816256/t0(0) o400->d694a97a-c615-4ad0-9894-0a08ce0bc5b4@26176@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2132-0'
00000100:00100000:0.0:1773851854.678323:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000707cac9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:d694a97a-c615-4ad0-9894-0a08ce0bc5b4+5:39735:x1859598816816256:12345-26176@kfi7:400:default-tuolumne2132-0 Request processed in 64us (95us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851854.678325:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26176@kfi7, seq: 1997490
00000100:00000040:0.0:1773851854.678326:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000009fb796b : new rpc_count 0
00000100:00000001:0.0:1773851854.678327:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851854.678327:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851854.678328:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851854.678329:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000020:00000010:0.0:1773851854.678330:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000020:00000040:0.0:1773851854.678330:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000009fb796b : new refcount 4
00000100:00000001:0.0:1773851854.678331:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851854.678338:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x72d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851854.678340:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851854.678342:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26176@kfi7: PUT: OK
00000400:00000200:1.0:1773851854.678343:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071d311d2
00000400:00000010:1.0:1773851854.678344:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071d311d2.
00000100:00000001:1.0:1773851854.678345:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851854.678346:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851854.678347:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000800:00000200:1.0:1773851854.678350:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 26176@kfi7(00000000b23295a9):0x0 lsk 1838 rsk 35 tsk 0 trmk 0 tmk 0 trr 0 tta 0x72d Transaction freed
00000800:00000200:17.0:1773851854.689754:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851854.689755:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851854.689756:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851854.689758:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851854.689760:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26371@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.689761:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26371@kfi7 : PUT - for me
00000400:00000200:17.0:1773851854.689762:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26371@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.689763:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051552e7b nid 26371@kfi7 refs 1
00000400:00000200:17.0:1773851854.689764:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26371@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.689765:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051552e7b nid 26371@kfi7 refs 2
00000400:00000200:17.0:1773851854.689766:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000051552e7b nid 26371@kfi7 refs 3
00000400:00000200:17.0:1773851854.689766:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26563@kfi7 to cpt 7
00000400:00000200:17.0:1773851854.689767:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26563@kfi7 of length 224 into portal 12 MB=0x69b51cc6d98c0
00000400:00000200:17.0:1773851854.689769:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26563@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 189184
00000800:00000200:17.0:1773851854.689770:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851854.689772:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851854.689773:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26371@kfi7: PUT: OK
00000100:00000001:17.0:1773851854.689774:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851854.689775:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851854.689776:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed35718a.
00000100:00000040:17.0:1773851854.689777:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ed35718a x1859625484654784 msgsize 224
00000100:00100000:17.0:1773851854.689778:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26563@kfi7 (source: 12345-26371@kfi7)
00000100:00000001:17.0:1773851854.689779:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851854.689780:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000051552e7b nid 26371@kfi7 refs 2
00000100:00000001:19.0:1773851854.689781:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851854.689781:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851854.689781:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851854.689781:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851854.689782:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851854.689783:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851854.689783:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859625484654784
00000020:00000001:19.0:1773851854.689784:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851854.689784:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e1b1009dc
00000020:00000001:19.0:1773851854.689785:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851854.689786:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000015f32c02 refcount=5918
00000020:00000001:19.0:1773851854.689787:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136975640576 : -106936733911040 : ffff9ebdd9f63800)
00000020:00000001:19.0:1773851854.689788:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136975640576 : -106936733911040 : ffff9ebdd9f63800)
00000100:00000001:19.0:1773851854.689789:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851854.689790:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851854.689791:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000799785d1.
00000020:00000010:19.0:1773851854.689792:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851854.689793:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851854.689794:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851854.689794:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851854.689795:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851854.689796:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851854.689796:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851854.689797:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.689798:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851854.689799:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851854.689800:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851854.689800:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851854.689800:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851854.689801:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26563@kfi7, seq: 2156257
00000100:00000040:19.0:1773851854.689802:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000015f32c02 : new rpc_count 10
00000100:00000001:18.0:1773851854.689802:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.689803:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113837098624 : -106959872452992 : ffff9eb876cc1680)
00000100:00000001:18.0:1773851854.689803:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851854.689804:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed35718a x1859625484654784/t0(0) o400->0a76d28d-b8c9-4ae2-a94e-e228108c2897@26563@kfi7:44/0 lens 224/0 e 0 to 0 dl 1773852159 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne2151-0'
00000100:00000001:19.0:1773851854.689807:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851854.689808:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851854.689809:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed35718a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0a76d28d-b8c9-4ae2-a94e-e228108c2897+5918:39194:x1859625484654784:12345-26563@kfi7:400:login-tuolumne2151-0
00000100:00000200:19.0:1773851854.689811:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859625484654784
00000020:00000001:19.0:1773851854.689812:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851854.689813:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851854.689813:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.689814:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851854.689815:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851854.689816:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851854.689816:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859625484654784, found 0 last_xid 1859625452689151
00000020:00000001:19.0:1773851854.689817:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851854.689818:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851854.689819:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851854.689819:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.689820:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851854.689821:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851854.689821:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851854.689822:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e7f7db99.
02000000:00000001:19.0:1773851854.689823:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.689823:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.689824:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851854.689825:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593469, transno 0, xid 1859625484654784
00010000:00000001:19.0:1773851854.689826:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851854.689827:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed35718a x1859625484654784/t0(0) o400->0a76d28d-b8c9-4ae2-a94e-e228108c2897@26563@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2151-0'
00010000:00000001:19.0:1773851854.689830:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851854.689831:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851854.689832:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=87 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851854.689834:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851854.689835:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013997a60 refcount 3 to 26563@kfi7
00000100:00000001:19.0:1773851854.689836:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803680 : -107130477747936 : ffff9e90bdede120)
02000000:00000001:19.0:1773851854.689837:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851854.689838:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.689839:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851854.689840:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26371@kfi7
00000400:00000010:19.0:1773851854.689841:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000067d0f432.
00000100:00000200:19.0:1773851854.689844:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859625484654784, offset 224
00000400:00000200:19.0:1773851854.689846:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26371@kfi7
00000400:00000200:19.0:1773851854.689848:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26371@kfi7 to cpt 4
00000400:00000200:19.0:1773851854.689849:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051552e7b nid 26371@kfi7 refs 1
00000400:00000200:19.0:1773851854.689851:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000051552e7b nid 26371@kfi7 refs 2
00000400:00000200:19.0:1773851854.689853:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000051552e7b nid 26371@kfi7 refs 3
00000400:00000200:19.0:1773851854.689855:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26371@kfi7 local destination
00000400:00000200:19.0:1773851854.689857:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768619:8768619:1024:4294967295] 26371@kfi7 LPNI seq info [60171835:60171835:16:4294967295]
00000400:00000200:19.0:1773851854.689860:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000051552e7b nid 26371@kfi7 refs 2
00000400:00000200:19.0:1773851854.689862:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26371@kfi7 to cpt 4
00000400:00000200:19.0:1773851854.689865:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26371@kfi7(26371@kfi7:26371@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851854.689868:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000051552e7b nid 26371@kfi7 refs 3
00000800:00000200:19.0:1773851854.689870:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851854.689872:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851854.689876:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851854.689880:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1400000000000583 Using peer 26371@kfi7(0x1400000000000583)
00000800:00000200:19.0:1773851854.689885:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x1400000000000583: rc=0
00000800:00000200:19.0:1773851854.689888:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1400000000000583 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851854.689892:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851854.689894:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013997a60 refcount 2 to 26563@kfi7
00010000:00000001:19.0:1773851854.689895:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851854.689896:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851854.689897:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851854.689899:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed35718a x1859625484654784/t0(0) o400->0a76d28d-b8c9-4ae2-a94e-e228108c2897@26563@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2151-0'
00000800:00000200:17.0:1773851854.689902:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1400000000000583 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851854.689904:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed35718a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0a76d28d-b8c9-4ae2-a94e-e228108c2897+5918:39194:x1859625484654784:12345-26563@kfi7:400:login-tuolumne2151-0 Request processed in 96us (126us total) trans 0 rc 0/0
00000400:00000200:17.0:1773851854.689905:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851854.689907:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26371@kfi7: PUT: OK
00000100:00100000:19.0:1773851854.689909:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26563@kfi7, seq: 2156257
00000400:00000200:17.0:1773851854.689909:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000067d0f432
00000400:00000010:17.0:1773851854.689909:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000067d0f432.
00000100:00000040:19.0:1773851854.689911:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000015f32c02 : new rpc_count 9
00000100:00000001:17.0:1773851854.689911:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851854.689911:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:19.0:1773851854.689912:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851854.689913:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851854.689913:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000051552e7b nid 26371@kfi7 refs 2
00000020:00000010:19.0:1773851854.689914:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851854.689915:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000800:00000200:17.0:1773851854.689915:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 26371@kfi7(00000000b141c10e):0x0 lsk 1412 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1400000000000583 Transaction freed
00000020:00000010:19.0:1773851854.689917:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000799785d1.
00000020:00000040:19.0:1773851854.689918:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000015f32c02 : new refcount 5917
00000100:00000001:19.0:1773851854.689919:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851854.720591:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851854.720593:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851854.720595:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851854.720598:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851854.720601:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13648@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.720603:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13648@kfi7 : PUT - for me
00000400:00000200:25.0:1773851854.720604:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13648@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.720606:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db9ceaaa nid 13648@kfi7 refs 1
00000400:00000200:25.0:1773851854.720607:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13648@kfi7 to cpt 6
00000400:00000200:25.0:1773851854.720608:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db9ceaaa nid 13648@kfi7 refs 2
00000400:00000200:25.0:1773851854.720609:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db9ceaaa nid 13648@kfi7 refs 3
00000400:00000200:25.0:1773851854.720612:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13649@kfi7 to cpt 1
00000400:00000200:25.0:1773851854.720613:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13649@kfi7 of length 224 into portal 12 MB=0x699e134a4e800
00000400:00000200:25.0:1773851854.720615:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13649@kfi7 of length 224/224 into md 0x16159c6179 [64] + 180360
00000800:00000200:25.0:1773851854.720618:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851854.720621:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851854.720623:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13648@kfi7: PUT: OK
00000100:00000001:25.0:1773851854.720624:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851854.720625:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851854.720626:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006d31b448.
00000100:00000040:25.0:1773851854.720627:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000006d31b448 x1858042390177792 msgsize 224
00000100:00100000:25.0:1773851854.720629:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-13649@kfi7 (source: 12345-13648@kfi7)
00000100:00000001:25.0:1773851854.720631:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851854.720632:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db9ceaaa nid 13648@kfi7 refs 2
00000100:00000001:26.0:1773851854.720633:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851854.720634:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851854.720634:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851854.720635:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851854.720636:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851854.720637:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851854.720638:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042390177792
00000020:00000001:26.0:1773851854.720639:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851854.720640:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c24
00000020:00000001:26.0:1773851854.720641:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851854.720643:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005e4d3594 refcount=6
00000020:00000001:26.0:1773851854.720644:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628300800 : -107123081250816 : ffff9e9276cb7800)
00000020:00000001:26.0:1773851854.720646:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628300800 : -107123081250816 : ffff9e9276cb7800)
00000100:00000001:26.0:1773851854.720647:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.720649:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851854.720650:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000608ed6cb.
00000020:00000010:26.0:1773851854.720651:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851854.720653:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6ffcbe8.
00000100:00000001:26.0:1773851854.720654:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851854.720655:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851854.720655:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.720657:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851854.720658:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851854.720659:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.720660:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851854.720662:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851854.720662:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851854.720663:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851854.720663:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851854.720664:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13649@kfi7, seq: 2025046
00000100:00000040:26.0:1773851854.720666:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005e4d3594 : new rpc_count 1
00000100:00000001:24.0:1773851854.720666:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.720667:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150713728 : -106980558837888 : ffff9eb3a5cae780)
00000100:00000001:24.0:1773851854.720667:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.720673:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006d31b448 x1858042390177792/t0(0) o400->861e153f-66c1-4b12-adb7-d89ed611d2ec@13649@kfi7:40/0 lens 224/0 e 0 to 0 dl 1773852155 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1346-0'
00000100:00000001:26.0:1773851854.720677:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851854.720678:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851854.720680:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d31b448 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:861e153f-66c1-4b12-adb7-d89ed611d2ec+6:39626:x1858042390177792:12345-13649@kfi7:400:default-tuolumne1346-0
00000100:00000200:26.0:1773851854.720682:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042390177792
00000020:00000001:26.0:1773851854.720683:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851854.720684:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851854.720685:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.720686:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851854.720686:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851854.720688:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851854.720689:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042390177792, found 0 last_xid 1858042390177791
00000020:00000001:26.0:1773851854.720690:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851854.720691:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851854.720692:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851854.720693:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.720694:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851854.720695:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851854.720696:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851854.720697:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000051edfd8a.
02000000:00000001:26.0:1773851854.720698:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.720699:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.720700:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851854.720701:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182681920762, transno 0, xid 1858042390177792
00010000:00000001:26.0:1773851854.720702:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851854.720703:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006d31b448 x1858042390177792/t0(0) o400->861e153f-66c1-4b12-adb7-d89ed611d2ec@13649@kfi7:40/0 lens 224/224 e 0 to 0 dl 1773852155 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1346-0'
00010000:00000001:26.0:1773851854.720707:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851854.720708:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851854.720709:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=87 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851854.720711:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851854.720713:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000def402ee refcount 3 to 13649@kfi7
00000100:00000001:26.0:1773851854.720714:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410848 : -107145304140768 : ffff9e8d4a351420)
02000000:00000001:26.0:1773851854.720715:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851854.720716:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851854.720717:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851854.720718:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13648@kfi7
00000400:00000010:26.0:1773851854.720719:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000453a77c2.
00000100:00000200:26.0:1773851854.720720:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042390177792, offset 224
00000400:00000200:26.0:1773851854.720723:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13648@kfi7
00000400:00000200:26.0:1773851854.720724:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13648@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.720728:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db9ceaaa nid 13648@kfi7 refs 1
00000400:00000200:26.0:1773851854.720730:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db9ceaaa nid 13648@kfi7 refs 2
00000400:00000200:26.0:1773851854.720732:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db9ceaaa nid 13648@kfi7 refs 3
00000400:00000200:26.0:1773851854.720734:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13648@kfi7 local destination
00000400:00000200:26.0:1773851854.720736:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768620:8768620:1024:4294967295] 13648@kfi7 LPNI seq info [6686885:6686885:16:4294967295]
00000400:00000200:26.0:1773851854.720738:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db9ceaaa nid 13648@kfi7 refs 2
00000400:00000200:26.0:1773851854.720740:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13648@kfi7 to cpt 6
00000400:00000200:26.0:1773851854.720743:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13648@kfi7(13648@kfi7:13648@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851854.720745:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db9ceaaa nid 13648@kfi7 refs 3
00000800:00000200:26.0:1773851854.720748:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851854.720749:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851854.720753:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851854.720757:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001145 Using peer 13648@kfi7(0x100000000001145)
00000800:00000200:26.0:1773851854.720762:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001c682e34: Posted send of 324 bytes to peer 0x100000000001145: rc=0
00000800:00000200:26.0:1773851854.720764:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001145 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851854.720767:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851854.720770:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000def402ee refcount 2 to 13649@kfi7
00010000:00000001:26.0:1773851854.720771:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851854.720772:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851854.720773:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851854.720774:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006d31b448 x1858042390177792/t0(0) o400->861e153f-66c1-4b12-adb7-d89ed611d2ec@13649@kfi7:40/0 lens 224/224 e 0 to 0 dl 1773852155 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1346-0'
00000100:00100000:26.0:1773851854.720779:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d31b448 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:861e153f-66c1-4b12-adb7-d89ed611d2ec+6:39626:x1858042390177792:12345-13649@kfi7:400:default-tuolumne1346-0 Request processed in 100us (151us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851854.720779:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001145 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851854.720782:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13649@kfi7, seq: 2025046
00000400:00000200:25.0:1773851854.720782:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:26.0:1773851854.720783:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005e4d3594 : new rpc_count 0
00000400:00000200:25.0:1773851854.720783:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13648@kfi7: PUT: OK
00000100:00000001:26.0:1773851854.720785:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851854.720785:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851854.720785:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000453a77c2
00000400:00000010:25.0:1773851854.720785:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000453a77c2.
00000020:00000010:26.0:1773851854.720786:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000100:00000001:25.0:1773851854.720786:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:26.0:1773851854.720787:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6ffcbe8.
00000100:00000001:25.0:1773851854.720787:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851854.720788:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db9ceaaa nid 13648@kfi7 refs 2
00000020:00000010:26.0:1773851854.720789:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000608ed6cb.
00000020:00000040:26.0:1773851854.720790:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000005e4d3594 : new refcount 5
00000100:00000001:26.0:1773851854.720791:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851854.720791:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 13648@kfi7(00000000ed497ae5):0x0 lsk 4422 rsk 69 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001145 Transaction freed
00000400:00000200:29.0:1773851854.729734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851854.729736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:29.0:1773851854.738930:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851854.738931:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851854.738932:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851854.738934:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851854.738934:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851854.738937:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851854.738938:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20730@kfi7(0000000045e01ee8):0x50c version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851854.738941:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851854.738942:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c Using peer 20730@kfi7(0x50c)
00000400:00000200:30.0:1773851854.738945:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:29.0:1773851854.738946:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:30.0:1773851854.738947:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20730@kfi7 : PUT - for me
00000400:00000200:30.0:1773851854.738949:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000800:00000200:29.0:1773851854.738949:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 38 bytes to peer 0x50c: rc=0
00000400:00000200:30.0:1773851854.738952:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 1
00000800:00000200:29.0:1773851854.738952:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851854.738954:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:30.0:1773851854.738955:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000400:00000200:30.0:1773851854.738957:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 3
00000400:00000200:30.0:1773851854.738959:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:30.0:1773851854.738960:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20731@kfi7 of length 440 into portal 12 MB=0x699de8bc30300
00000400:00000200:30.0:1773851854.738963:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20731@kfi7 of length 440/440 into md 0x77fe139dd [64] + 161800
00000800:00000200:29.0:1773851854.738966:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851854.738968:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851854.738970:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c Transaction freed
00000400:00000200:30.0:1773851854.738971:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851854.738973:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20730@kfi7: PUT: OK
00000100:00000001:30.0:1773851854.738975:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851854.738976:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851854.738978:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8bb7992.
00000100:00000040:30.0:1773851854.738979:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000a8bb7992 x1858030966866688 msgsize 440
00000100:00100000:30.0:1773851854.738982:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-20731@kfi7 (source: 12345-20730@kfi7)
00000100:00000001:30.0:1773851854.738984:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851854.738986:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000100:00000001:31.0:1773851854.738987:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851854.738988:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851854.738989:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851854.738989:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851854.738990:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851854.738992:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851854.738993:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966866688
00000020:00000001:31.0:1773851854.738994:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851854.738995:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912ed
00000020:00000001:31.0:1773851854.738996:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851854.739000:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a9d5ad2c refcount=6
00000020:00000001:31.0:1773851854.739002:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716204544 : -107155993347072 : ffff9e8acd14bc00)
00000020:00000001:31.0:1773851854.739004:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716204544 : -107155993347072 : ffff9e8acd14bc00)
00000100:00000001:31.0:1773851854.739005:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.739006:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851854.739007:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025d2a996.
00000020:00000010:31.0:1773851854.739009:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851854.739010:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851854.739012:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851854.739013:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851854.739014:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.739016:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.739018:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851854.739020:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851854.739021:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851854.739021:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851854.739021:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851854.739023:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20731@kfi7, seq: 364304981
00000100:00000040:31.0:1773851854.739024:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a9d5ad2c : new rpc_count 1
00000100:00000001:29.0:1773851854.739024:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.739025:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000818688 : -107100708732928 : ffff9e97ac4d0000)
00000100:00000001:29.0:1773851854.739025:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.739027:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a8bb7992 x1858030966866688/t0(0) o41->09bbfb8c-d3e1-4120-87ce-4227c255fc36@20731@kfi7:581/0 lens 440/0 e 0 to 0 dl 1773851941 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne249-0'
00000100:00000001:31.0:1773851854.739033:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851854.739033:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851854.739035:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8bb7992 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:09bbfb8c-d3e1-4120-87ce-4227c255fc36+6:107745:x1858030966866688:12345-20731@kfi7:41:default-tuolumne249-0
00000100:00000200:31.0:1773851854.739038:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966866688
00000020:00000001:31.0:1773851854.739039:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851854.739040:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851854.739041:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.739042:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851854.739043:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:31.0:1773851854.739045:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851854.739046:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966866688, found 0 last_xid 1858030966866687
00000020:00000001:31.0:1773851854.739047:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851854.739049:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851854.739050:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851854.739051:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.739052:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851854.739053:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851854.739054:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000e9f67bb0.
02000000:00000001:31.0:1773851854.739055:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.739056:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739058:0:42267:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:31.0:1773851854.739059:0:42267:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:31.0:1773851854.739060:0:42267:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739062:0:42267:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:31.0:1773851854.739063:0:42267:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851854.739066:0:42267:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739068:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851854.739069:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739070:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851854.739071:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739072:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851854.739072:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739073:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851854.739074:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739075:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:31.0:1773851854.739076:0:42267:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739077:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739078:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500140544 free, 351498047488 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097820 files, 343261856 free files
00000004:00000001:31.0:1773851854.739081:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739082:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739083:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504365568 free, 351502193664 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056321 files, 343265982 free files
00000004:00000001:31.0:1773851854.739085:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739086:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739086:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690117120 free, 351687688192 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231289 files, 343447380 free files
00000004:00000001:31.0:1773851854.739088:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739089:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739090:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382748160 free, 351380697088 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978785 files, 343147215 free files
00000004:00000001:31.0:1773851854.739094:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739095:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739095:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350959053824 free, 350956949504 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371564137 files, 342733451 free files
00000004:00000001:31.0:1773851854.739097:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739097:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739098:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351238656 free, 351348434944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084149 files, 343116444 free files
00000004:00000001:31.0:1773851854.739099:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739100:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739101:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482149888 free, 351481123840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097214 files, 343244287 free files
00000004:00000001:31.0:1773851854.739102:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739103:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739103:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449354240 free, 351446762496 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372161080 files, 343212260 free files
00000004:00000001:31.0:1773851854.739104:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739105:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739106:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353649152 free, 351351227392 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083391 files, 343118798 free files
00000004:00000001:31.0:1773851854.739107:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739108:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739108:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351389022208 free, 351386321920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019222 files, 343153342 free files
00000004:00000001:31.0:1773851854.739110:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739110:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739111:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406602240 free, 351404174336 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127373 files, 343170510 free files
00000004:00000001:31.0:1773851854.739112:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739113:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739114:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351379065856 free, 351376106496 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019208 files, 343143619 free files
00000004:00000001:31.0:1773851854.739115:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739115:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739116:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466059776 free, 351462900736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062973 files, 343228574 free files
00000004:00000001:31.0:1773851854.739118:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739119:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739119:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489103872 free, 351486099456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066925 files, 343251078 free files
00000004:00000001:31.0:1773851854.739121:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739121:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739122:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399726592 blocks, 351492805632 free, 351490399232 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078194 files, 343254693 free files
00000004:00000001:31.0:1773851854.739123:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739124:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739124:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399719424 blocks, 351524128768 free, 351521378304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372114012 files, 343285282 free files
00000004:00000001:31.0:1773851854.739126:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739126:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739127:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510718464 free, 351508084736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095927 files, 343272186 free files
00000004:00000001:31.0:1773851854.739128:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739129:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739130:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541593088 free, 351539441664 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136813 files, 343302337 free files
00000004:00000001:31.0:1773851854.739131:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739132:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739132:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470754816 free, 351461655552 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064680 files, 343233159 free files
00000004:00000001:31.0:1773851854.739134:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739134:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739135:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666736128 free, 351645489152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372238013 files, 343424547 free files
00000004:00000001:31.0:1773851854.739136:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739137:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739137:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545837568 free, 351536185344 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116532 files, 343306482 free files
00000004:00000001:31.0:1773851854.739138:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739138:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739139:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603975168 free, 351601704960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190563 files, 343363257 free files
00000004:00000001:31.0:1773851854.739141:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739141:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739142:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615885312 free, 351613266944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043550 files, 343374888 free files
00000004:00000001:31.0:1773851854.739143:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739144:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739144:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420286976 free, 351417833472 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372009086 files, 343183874 free files
00000004:00000001:31.0:1773851854.739145:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739146:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739146:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409079296 free, 351406989312 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011357 files, 343172929 free files
00000004:00000001:31.0:1773851854.739147:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739148:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739149:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351479990272 free, 351478736896 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073173 files, 343242178 free files
00000004:00000001:31.0:1773851854.739150:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739150:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739151:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593664512 free, 351576846336 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190086 files, 343353188 free files
00000004:00000001:31.0:1773851854.739152:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739153:0:42267:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:31.0:1773851854.739153:0:42267:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464037376 free, 351458166784 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372060746 files, 343226599 free files
00000004:00000001:31.0:1773851854.739154:0:42267:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739155:0:42267:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739155:0:42267:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:31.0:1773851854.739156:0:42267:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 40309318305710080 avail 40308838716407808
00000004:00000020:31.0:1773851854.739157:0:42267:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841142164480 free, 9841024968768 avail; 10969026266 objects: 9610490395 free; state 100
00000020:00000001:31.0:1773851854.739159:0:42267:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:31.0:1773851854.739161:0:42267:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851854.739162:0:42267:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851854.739162:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768262, transno 0, xid 1858030966866688
00010000:00000001:31.0:1773851854.739163:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851854.739165:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a8bb7992 x1858030966866688/t0(0) o41->09bbfb8c-d3e1-4120-87ce-4227c255fc36@20731@kfi7:581/0 lens 440/368 e 0 to 0 dl 1773851941 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne249-0'
00010000:00000001:31.0:1773851854.739167:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851854.739168:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851854.739168:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=87 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851854.739169:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851854.739170:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000a2cc74 refcount 5 to 20731@kfi7
00000100:00000001:31.0:1773851854.739171:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526777120 : -107156182774496 : ffff9e8ac1ca4d20)
02000000:00000001:31.0:1773851854.739172:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851854.739172:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851854.739173:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851854.739174:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20730@kfi7
00000400:00000010:31.0:1773851854.739175:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002000cf5e.
00000100:00000200:31.0:1773851854.739175:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030966866688, offset 224
00000400:00000200:31.0:1773851854.739177:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20730@kfi7
00000400:00000200:31.0:1773851854.739178:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.739179:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 1
00000400:00000200:31.0:1773851854.739180:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000400:00000200:31.0:1773851854.739181:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 3
00000400:00000200:31.0:1773851854.739182:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20730@kfi7 local destination
00000400:00000200:31.0:1773851854.739183:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768621:8768621:1024:4294967295] 20730@kfi7 LPNI seq info [28142:28142:16:4294967295]
00000400:00000200:31.0:1773851854.739185:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000400:00000200:31.0:1773851854.739185:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:31.0:1773851854.739187:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20730@kfi7(20730@kfi7:20730@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851854.739188:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 3
00000800:00000200:31.0:1773851854.739190:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851854.739191:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:31.0:1773851854.739193:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851854.739195:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c Using peer 20730@kfi7(0x50c)
00000800:00000200:31.0:1773851854.739198:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002809a79a: Posted send of 468 bytes to peer 0x50c: rc=0
00000800:00000200:31.0:1773851854.739200:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851854.739202:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851854.739203:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000a2cc74 refcount 4 to 20731@kfi7
00010000:00000001:31.0:1773851854.739203:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851854.739204:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851854.739205:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851854.739205:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a8bb7992 x1858030966866688/t0(0) o41->09bbfb8c-d3e1-4120-87ce-4227c255fc36@20731@kfi7:581/0 lens 440/368 e 0 to 0 dl 1773851941 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne249-0'
00000100:00100000:31.0:1773851854.739208:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8bb7992 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:09bbfb8c-d3e1-4120-87ce-4227c255fc36+6:107745:x1858030966866688:12345-20731@kfi7:41:default-tuolumne249-0 Request processed in 175us (228us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851854.739210:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20731@kfi7, seq: 364304981
00000100:00000040:31.0:1773851854.739211:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a9d5ad2c : new rpc_count 0
00000800:00000200:29.0:1773851854.739211:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851854.739212:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851854.739212:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851854.739213:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851854.739213:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851854.739214:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851854.739214:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025d2a996.
00000400:00000200:29.0:1773851854.739214:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20730@kfi7: PUT: OK
00000020:00000040:31.0:1773851854.739215:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000a9d5ad2c : new refcount 5
00000400:00000200:29.0:1773851854.739215:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002000cf5e
00000400:00000010:29.0:1773851854.739215:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002000cf5e.
00000100:00000001:31.0:1773851854.739216:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851854.739216:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851854.739216:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851854.739217:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000800:00000200:29.0:1773851854.739220:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 20730@kfi7(0000000045e01ee8):0x0 lsk 1293 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x50c Transaction freed
00000800:00000200:9.0:1773851854.757413:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851854.757415:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851854.757417:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851854.757420:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:10.0:1773851854.757423:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851854.757423:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000800:00000200:10.0:1773851854.757424:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851854.757425:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22993@kfi7 : PUT - for me
00000800:00000200:10.0:1773851854.757426:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851854.757427:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.757428:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 1
00000800:00000200:10.0:1773851854.757430:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851854.757430:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.757431:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 2
00000400:00000200:9.0:1773851854.757432:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000400:00000200:10.0:1773851854.757434:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.757435:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:10.0:1773851854.757436:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22993@kfi7 : PUT - for me
00000400:00000200:10.0:1773851854.757437:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.757437:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22993@kfi7 of length 224 into portal 12 MB=0x69b0a12eb0b80
00000400:00000200:10.0:1773851854.757439:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 2
00000400:00000200:9.0:1773851854.757439:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22993@kfi7 of length 224/224 into md 0x78146ce49 [64] + 118776
00000400:00000200:10.0:1773851854.757440:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:10.0:1773851854.757441:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000800:00000200:9.0:1773851854.757442:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851854.757443:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 4
00000400:00000200:10.0:1773851854.757444:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:9.0:1773851854.757444:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851854.757446:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22993@kfi7 of length 224 into portal 12 MB=0x69b0a12eb0cc0
00000400:00000200:9.0:1773851854.757446:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22993@kfi7: PUT: OK
00000400:00000200:10.0:1773851854.757448:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22993@kfi7 of length 224/224 into md 0x78146ce49 [64] + 119000
00000100:00000001:9.0:1773851854.757450:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:10.0:1773851854.757451:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:9.0:1773851854.757451:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851854.757452:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000942a36a9.
00000400:00000200:10.0:1773851854.757453:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:9.0:1773851854.757453:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000942a36a9 x1859317429635968 msgsize 224
00000400:00000200:10.0:1773851854.757455:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22993@kfi7: PUT: OK
00000100:00100000:9.0:1773851854.757456:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22993@kfi7 (source: 12345-22993@kfi7)
00000100:00000001:9.0:1773851854.757457:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851854.757460:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000100:00000001:8.0:1773851854.757460:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:10.0:1773851854.757461:0:2464469:0:(events.c:307:request_in_callback()) Process entered
02000000:00000001:8.0:1773851854.757461:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000200:10.0:1773851854.757462:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851854.757462:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851854.757462:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851854.757462:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:10.0:1773851854.757463:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006c5c5ec1.
00000100:00000040:10.0:1773851854.757464:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000006c5c5ec1 x1859317429636288 msgsize 224
02000000:00000001:8.0:1773851854.757464:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851854.757465:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317429635968
00000100:00100000:10.0:1773851854.757466:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-22993@kfi7 (source: 12345-22993@kfi7)
00000020:00000001:8.0:1773851854.757466:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851854.757466:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac928db
00000020:00000001:8.0:1773851854.757467:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851854.757468:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851854.757469:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 2
00000100:00000001:11.0:1773851854.757470:0:41171:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000040:8.0:1773851854.757470:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c2aa3a62 refcount=6
02000000:00000001:11.0:1773851854.757471:0:41171:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851854.757471:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000001:8.0:1773851854.757471:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742972416 : -107128966579200 : ffff9e9118007c00)
00000100:00000001:11.0:1773851854.757472:0:41171:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:8.0:1773851854.757472:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742972416 : -107128966579200 : ffff9e9118007c00)
00000100:00000001:11.0:1773851854.757473:0:41171:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.757474:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
02000000:00000001:11.0:1773851854.757475:0:41171:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.757475:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851854.757476:0:41171:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317429636288
00000020:00000010:8.0:1773851854.757476:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005de312e6.
00000020:00000001:11.0:1773851854.757477:0:41171:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851854.757478:0:41171:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9290c
00000020:00000010:8.0:1773851854.757478:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000001:11.0:1773851854.757479:0:41171:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000010:8.0:1773851854.757479:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851854.757481:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851854.757481:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000040:11.0:1773851854.757482:0:41171:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d066086c refcount=6
00000100:00000001:8.0:1773851854.757482:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851854.757484:0:41171:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742942720 : -107128966608896 : ffff9e9118000800)
00000100:00000001:8.0:1773851854.757484:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000020:00000001:11.0:1773851854.757485:0:41171:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742942720 : -107128966608896 : ffff9e9118000800)
00000100:00000001:8.0:1773851854.757485:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851854.757485:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851854.757486:0:41171:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851854.757487:0:41171:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:8.0:1773851854.757488:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:11.0:1773851854.757489:0:41171:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009503e737.
00000020:00000010:11.0:1773851854.757490:0:41171:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000100:00000001:8.0:1773851854.757490:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851854.757491:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000020:00000010:11.0:1773851854.757492:0:41171:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ecfd6d70.
00000100:00000001:10.0:1773851854.757492:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:8.0:1773851854.757492:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22993@kfi7, seq: 2130723
00000100:00000001:11.0:1773851854.757493:0:41171:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851854.757493:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:8.0:1773851854.757493:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c2aa3a62 : new rpc_count 1
00000100:00000001:11.0:1773851854.757494:0:41171:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851854.757494:0:41171:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851854.757495:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851854.757495:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792148992 : -106938917402624 : ffff9ebd57d0c800)
00000100:00000001:11.0:1773851854.757496:0:41171:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851854.757496:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851854.757497:0:41171:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000040:8.0:1773851854.757497:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000942a36a9 x1859317429635968/t0(0) o400->f8750a55-f7e0-44c7-88a2-39bc95772800@22993@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1921-0'
00000100:00000001:11.0:1773851854.757498:0:41171:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851854.757499:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851854.757499:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851854.757501:0:41171:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:10.0:1773851854.757501:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22993@kfi7, seq: 2130724
00000100:00000040:10.0:1773851854.757502:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d066086c : new rpc_count 1
00000100:00000001:8.0:1773851854.757502:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851854.757502:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:10.0:1773851854.757503:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077444224 : -106968632107392 : ffff9eb66cae5e80)
00000100:00100000:8.0:1773851854.757504:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000942a36a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:f8750a55-f7e0-44c7-88a2-39bc95772800+6:39848:x1859317429635968:12345-22993@kfi7:400:default-tuolumne1921-0
00000100:00000040:10.0:1773851854.757505:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006c5c5ec1 x1859317429636288/t0(0) o400->8a7d5e14-88a2-4b93-83dc-00df740f2df2@22993@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1921-0'
00000100:00000200:8.0:1773851854.757506:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317429635968
00000020:00000001:8.0:1773851854.757507:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851854.757508:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851854.757509:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.757510:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:10.0:1773851854.757511:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851854.757511:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:8.0:1773851854.757511:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851854.757512:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000100:00100000:10.0:1773851854.757513:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c5c5ec1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8a7d5e14-88a2-4b93-83dc-00df740f2df2+6:39847:x1859317429636288:12345-22993@kfi7:400:default-tuolumne1921-0
00000001:00000001:8.0:1773851854.757513:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317429635968, found 0 last_xid 1859317429635967
00000100:00000200:10.0:1773851854.757515:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317429636288
00000020:00000001:8.0:1773851854.757515:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851854.757516:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851854.757516:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851854.757516:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851854.757517:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851854.757517:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851854.757518:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.757518:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000020:00000001:10.0:1773851854.757519:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:8.0:1773851854.757519:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000020:00000001:10.0:1773851854.757520:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
02000000:00000001:8.0:1773851854.757520:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000001:10.0:1773851854.757521:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851854.757522:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317429636288, found 0 last_xid 1859317429636287
00000020:00000001:10.0:1773851854.757523:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:8.0:1773851854.757523:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004d1ed55c.
02000000:00000001:8.0:1773851854.757523:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851854.757524:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000100:00000001:8.0:1773851854.757524:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851854.757525:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851854.757526:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.757526:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851854.757527:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00010000:00000040:8.0:1773851854.757527:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317429635968
00000100:00000001:10.0:1773851854.757528:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851854.757528:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00010000:00000001:8.0:1773851854.757528:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851854.757529:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000942a36a9 x1859317429635968/t0(0) o400->f8750a55-f7e0-44c7-88a2-39bc95772800@22993@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1921-0'
02000000:00000010:10.0:1773851854.757530:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b903b69.
02000000:00000001:10.0:1773851854.757531:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851854.757532:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851854.757533:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851854.757533:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000040:10.0:1773851854.757534:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668607367, transno 0, xid 1859317429636288
00010000:00000001:8.0:1773851854.757534:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851854.757535:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000100:00001000:8.0:1773851854.757535:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=87 v=66 (1 1 1 1)
00010000:00000200:10.0:1773851854.757537:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006c5c5ec1 x1859317429636288/t0(0) o400->8a7d5e14-88a2-4b93-83dc-00df740f2df2@22993@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1921-0'
00000100:00000001:8.0:1773851854.757538:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851854.757539:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bef3aedf refcount 5 to 22993@kfi7
00000100:00000001:8.0:1773851854.757540:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581408 : -107154806970208 : ffff9e8b13cb68a0)
00010000:00000001:10.0:1773851854.757542:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851854.757542:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851854.757542:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851854.757542:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851854.757543:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=87 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851854.757543:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:10.0:1773851854.757545:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851854.757545:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22993@kfi7
00000100:00000040:10.0:1773851854.757546:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bef3aedf refcount 6 to 22993@kfi7
00000400:00000010:8.0:1773851854.757546:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
00000100:00000001:10.0:1773851854.757547:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581408 : -107154806970208 : ffff9e8b13cb68a0)
00000100:00000200:8.0:1773851854.757547:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317429635968, offset 224
02000000:00000001:10.0:1773851854.757548:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851854.757549:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851854.757550:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851854.757550:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22993@kfi7
00000400:00000200:8.0:1773851854.757551:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000100:00000040:10.0:1773851854.757552:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22993@kfi7
00000400:00000010:10.0:1773851854.757552:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000053a50d5b.
00000400:00000200:8.0:1773851854.757552:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 1
00000100:00000200:10.0:1773851854.757554:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317429636288, offset 224
00000400:00000200:8.0:1773851854.757554:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 2
00000400:00000200:10.0:1773851854.757556:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22993@kfi7
00000400:00000200:8.0:1773851854.757556:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000400:00000200:8.0:1773851854.757558:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22993@kfi7 local destination
00000400:00000200:8.0:1773851854.757560:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768622:8768622:1024:4294967295] 22993@kfi7 LPNI seq info [93649:93649:16:4294967295]
00000400:00000200:8.0:1773851854.757563:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 2
00000400:00000200:8.0:1773851854.757564:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:8.0:1773851854.757567:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22993@kfi7(22993@kfi7:22993@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851854.757569:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000400:00000200:10.0:1773851854.757571:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:10.0:1773851854.757572:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 2
00000800:00000200:8.0:1773851854.757572:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:10.0:1773851854.757574:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000800:00000200:8.0:1773851854.757574:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851854.757575:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 4
00000400:00000200:10.0:1773851854.757577:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22993@kfi7 local destination
00000800:00000200:8.0:1773851854.757578:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851854.757579:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768623:8768623:1024:4294967295] 22993@kfi7 LPNI seq info [93650:93650:15:4294967295]
00000800:00000200:8.0:1773851854.757581:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000090e Using peer 22993@kfi7(0x10000000000090e)
00000400:00000200:10.0:1773851854.757582:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000400:00000200:10.0:1773851854.757583:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22993@kfi7 to cpt 2
00000400:00000200:10.0:1773851854.757586:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22993@kfi7(22993@kfi7:22993@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851854.757586:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x10000000000090e: rc=0
00000400:00000200:10.0:1773851854.757588:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 4
00000800:00000200:8.0:1773851854.757589:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000090e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:10.0:1773851854.757590:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851854.757592:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851854.757592:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851854.757595:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851854.757599:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x920 Using peer 22993@kfi7(0x920)
00000800:00000200:10.0:1773851854.757606:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000348da31e: Posted send of 324 bytes to peer 0x920: rc=0
00000100:00000040:8.0:1773851854.757607:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bef3aedf refcount 5 to 22993@kfi7
00010000:00000001:8.0:1773851854.757608:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000800:00000200:10.0:1773851854.757609:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x920 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000020:00000001:8.0:1773851854.757609:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851854.757610:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851854.757611:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000942a36a9 x1859317429635968/t0(0) o400->f8750a55-f7e0-44c7-88a2-39bc95772800@22993@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1921-0'
00000100:00000001:10.0:1773851854.757612:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851854.757613:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bef3aedf refcount 4 to 22993@kfi7
00010000:00000001:10.0:1773851854.757614:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851854.757615:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851854.757615:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00100000:8.0:1773851854.757616:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000942a36a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:f8750a55-f7e0-44c7-88a2-39bc95772800+6:39848:x1859317429635968:12345-22993@kfi7:400:default-tuolumne1921-0 Request processed in 114us (162us total) trans 0 rc 0/0
00000100:00000040:10.0:1773851854.757617:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006c5c5ec1 x1859317429636288/t0(0) o400->8a7d5e14-88a2-4b93-83dc-00df740f2df2@22993@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1921-0'
00000100:00100000:8.0:1773851854.757620:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22993@kfi7, seq: 2130723
00000100:00100000:10.0:1773851854.757622:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c5c5ec1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8a7d5e14-88a2-4b93-83dc-00df740f2df2+6:39847:x1859317429636288:12345-22993@kfi7:400:default-tuolumne1921-0 Request processed in 110us (157us total) trans 0 rc 0/0
00000100:00000040:8.0:1773851854.757622:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c2aa3a62 : new rpc_count 0
00000100:00000001:8.0:1773851854.757623:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851854.757624:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851854.757625:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000100:00100000:10.0:1773851854.757626:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22993@kfi7, seq: 2130724
00000020:00000010:8.0:1773851854.757626:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000100:00000040:10.0:1773851854.757627:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d066086c : new rpc_count 0
00000020:00000010:8.0:1773851854.757627:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005de312e6.
00000100:00000001:10.0:1773851854.757628:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851854.757629:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000040:8.0:1773851854.757629:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c2aa3a62 : new refcount 5
00000020:00000010:10.0:1773851854.757630:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000100:00000001:8.0:1773851854.757630:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:10.0:1773851854.757631:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ecfd6d70.
00000020:00000010:10.0:1773851854.757633:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009503e737.
00000020:00000040:10.0:1773851854.757634:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000d066086c : new refcount 5
00000100:00000001:10.0:1773851854.757635:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851854.757637:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000090e TN_EVENT_TX_OK event status 0
00000800:00000200:11.0:1773851854.757639:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x920 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851854.757640:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.757641:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22993@kfi7: PUT: OK
00000400:00000200:11.0:1773851854.757642:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851854.757643:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000400:00000200:11.0:1773851854.757644:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22993@kfi7: PUT: OK
00000400:00000010:9.0:1773851854.757644:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000100:00000001:9.0:1773851854.757645:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000400:00000200:11.0:1773851854.757646:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000053a50d5b
00000400:00000010:11.0:1773851854.757646:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000053a50d5b.
00000100:00000001:9.0:1773851854.757646:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:11.0:1773851854.757647:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000400:00000200:9.0:1773851854.757647:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 3
00000100:00000001:11.0:1773851854.757648:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851854.757649:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f518b8f0 nid 22993@kfi7 refs 2
00000800:00000200:9.0:1773851854.757650:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 22993@kfi7(00000000a3a62a41):0x0 lsk 2319 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000090e Transaction freed
00000800:00000200:11.0:1773851854.757652:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 22993@kfi7(000000000fc46268):0x0 lsk 2337 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x920 Transaction freed
00000800:00000200:17.0:1773851854.758653:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851854.758653:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851854.758655:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851854.758656:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851854.758658:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.758659:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:17.0:1773851854.758660:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.758661:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:17.0:1773851854.758661:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.758662:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:17.0:1773851854.758663:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:17.0:1773851854.758664:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:17.0:1773851854.758665:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 224 into portal 12 MB=0x699e0f324f700
00000400:00000200:17.0:1773851854.758666:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2065@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 189408
00000800:00000200:17.0:1773851854.758667:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851854.758669:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851854.758670:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000001:17.0:1773851854.758671:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851854.758671:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851854.758672:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000ed293b4.
00000100:00000040:17.0:1773851854.758673:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000000ed293b4 x1858041291273984 msgsize 224
00000100:00100000:17.0:1773851854.758674:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-2065@kfi7 (source: 12345-2065@kfi7)
00000100:00000001:17.0:1773851854.758675:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851854.758676:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:19.0:1773851854.758677:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851854.758677:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851854.758677:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851854.758678:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851854.758678:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851854.758679:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851854.758679:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041291273984
00000020:00000001:19.0:1773851854.758680:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851854.758680:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acbaa49
00000020:00000001:19.0:1773851854.758681:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851854.758683:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d06926ae refcount=5
00000020:00000001:19.0:1773851854.758683:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934536679424 : -107139172872192 : ffff9e8eb7a8d000)
00000020:00000001:19.0:1773851854.758684:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934536679424 : -107139172872192 : ffff9e8eb7a8d000)
00000100:00000001:19.0:1773851854.758685:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851854.758686:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851854.758686:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000799785d1.
00000020:00000010:19.0:1773851854.758687:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851854.758688:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005bd5535d.
00000100:00000001:19.0:1773851854.758689:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851854.758690:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851854.758690:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851854.758691:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851854.758691:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851854.758692:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.758692:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851854.758694:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851854.758694:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851854.758695:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2065@kfi7, seq: 2156258
00000100:00000001:19.0:1773851854.758696:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851854.758696:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:18.0:1773851854.758696:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d06926ae : new rpc_count 1
00000100:00000001:19.0:1773851854.758697:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851854.758697:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851854.758697:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113837100928 : -106959872450688 : ffff9eb876cc1f80)
00000100:00000040:18.0:1773851854.758698:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000ed293b4 x1858041291273984/t0(0) o400->lustre5-MDT0001-lwp-OST001b_UUID@2065@kfi7:44/0 lens 224/0 e 0 to 0 dl 1773852159 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba128-0'
00000100:00000001:18.0:1773851854.758701:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851854.758701:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851854.758702:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ed293b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:lustre5-MDT0001-lwp-OST001b_UUID+5:273063:x1858041291273984:12345-2065@kfi7:400:default-yuba128-0
00000100:00000200:18.0:1773851854.758704:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041291273984
00000020:00000001:18.0:1773851854.758704:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851854.758705:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851854.758706:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851854.758706:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851854.758707:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851854.758707:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:18.0:1773851854.758708:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851854.758709:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851854.758709:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851854.758710:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851854.758710:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851854.758711:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851854.758712:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851854.758712:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002a3a26dd.
02000000:00000001:18.0:1773851854.758713:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851854.758714:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851854.758714:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851854.758715:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041291273984
00010000:00000001:18.0:1773851854.758716:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851854.758717:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000ed293b4 x1858041291273984/t0(0) o400->lustre5-MDT0001-lwp-OST001b_UUID@2065@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba128-0'
00010000:00000001:18.0:1773851854.758719:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851854.758720:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851854.758721:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=87 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851854.758722:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851854.758723:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d418b0cd refcount 7 to 2065@kfi7
00000100:00000001:18.0:1773851854.758724:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301334048 : -107155408217568 : ffff9e8aeff51a20)
02000000:00000001:18.0:1773851854.758724:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851854.758730:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851854.758731:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851854.758732:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000010:18.0:1773851854.758732:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035c154b5.
00000100:00000200:18.0:1773851854.758733:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041291273984, offset 224
00000400:00000200:18.0:1773851854.758735:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000400:00000200:18.0:1773851854.758736:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:18.0:1773851854.758736:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:18.0:1773851854.758738:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:18.0:1773851854.758738:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:18.0:1773851854.758740:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2065@kfi7 local destination
00000400:00000200:18.0:1773851854.758741:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768624:8768624:1024:4294967295] 2065@kfi7 LPNI seq info [5402826:5402826:16:4294967295]
00000400:00000200:18.0:1773851854.758742:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:18.0:1773851854.758743:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:18.0:1773851854.758745:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851854.758746:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000800:00000200:18.0:1773851854.758747:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851854.758748:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851854.758750:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851854.758753:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000800:00000200:18.0:1773851854.758756:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000658b1b4a: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000800:00000200:18.0:1773851854.758757:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851854.758760:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851854.758761:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d418b0cd refcount 6 to 2065@kfi7
00010000:00000001:18.0:1773851854.758761:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851854.758762:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851854.758763:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851854.758763:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000ed293b4 x1858041291273984/t0(0) o400->lustre5-MDT0001-lwp-OST001b_UUID@2065@kfi7:44/0 lens 224/224 e 0 to 0 dl 1773852159 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba128-0'
00000100:00100000:18.0:1773851854.758767:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ed293b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:lustre5-MDT0001-lwp-OST001b_UUID+5:273063:x1858041291273984:12345-2065@kfi7:400:default-yuba128-0 Request processed in 64us (93us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851854.758767:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851854.758768:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:18.0:1773851854.758769:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2065@kfi7, seq: 2156258
00000100:00000040:18.0:1773851854.758769:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d06926ae : new rpc_count 0
00000400:00000200:17.0:1773851854.758769:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000001:18.0:1773851854.758770:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851854.758770:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035c154b5
00000400:00000010:17.0:1773851854.758770:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035c154b5.
00000100:00000001:18.0:1773851854.758771:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851854.758771:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000100:00000001:17.0:1773851854.758771:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851854.758771:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:18.0:1773851854.758772:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005bd5535d.
00000400:00000200:17.0:1773851854.758772:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000020:00000010:18.0:1773851854.758773:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000799785d1.
00000800:00000200:17.0:1773851854.758773:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2054@kfi7:4 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000005d1 Transaction freed
00000020:00000040:18.0:1773851854.758774:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000d06926ae : new refcount 4
00000100:00000001:18.0:1773851854.758775:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851854.810563:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851854.810564:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851854.810565:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851854.810567:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851854.810569:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10913@kfi7 to cpt 1
00000400:00000200:5.0:1773851854.810570:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10913@kfi7 : PUT - for me
00000400:00000200:5.0:1773851854.810571:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10913@kfi7 to cpt 1
00000400:00000200:5.0:1773851854.810572:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edbb109c nid 10913@kfi7 refs 1
00000400:00000200:5.0:1773851854.810572:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10913@kfi7 to cpt 1
00000400:00000200:5.0:1773851854.810573:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edbb109c nid 10913@kfi7 refs 2
00000400:00000200:5.0:1773851854.810574:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000edbb109c nid 10913@kfi7 refs 3
00000400:00000200:5.0:1773851854.810575:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000400:00000200:5.0:1773851854.810576:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10848@kfi7 of length 224 into portal 12 MB=0x69b09ed07b180
00000400:00000200:5.0:1773851854.810577:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10848@kfi7 of length 224/224 into md 0x793926dc5 [64] + 118472
00000800:00000200:5.0:1773851854.810579:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851854.810580:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851854.810582:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10913@kfi7: PUT: OK
00000100:00000001:5.0:1773851854.810583:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851854.810584:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851854.810584:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e431b18a.
00000100:00000040:5.0:1773851854.810585:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e431b18a x1859316793979264 msgsize 224
00000100:00100000:5.0:1773851854.810586:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10848@kfi7 (source: 12345-10913@kfi7)
00000100:00000001:5.0:1773851854.810587:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851854.810588:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000edbb109c nid 10913@kfi7 refs 2
00000100:00000001:7.0:1773851854.810589:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851854.810590:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851854.810590:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851854.810590:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851854.810591:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851854.810591:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851854.810592:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316793979264
00000020:00000001:7.0:1773851854.810593:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851854.810593:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913b8
00000020:00000001:7.0:1773851854.810594:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851854.810595:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047242df6 refcount=6
00000020:00000001:7.0:1773851854.810596:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169319424 : -107127540232192 : ffff9e916d04d000)
00000020:00000001:7.0:1773851854.810597:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169319424 : -107127540232192 : ffff9e916d04d000)
00000100:00000001:7.0:1773851854.810598:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851854.810598:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851854.810599:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000c1e289c.
00000020:00000010:7.0:1773851854.810600:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851854.810601:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851854.810602:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851854.810602:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851854.810603:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.810604:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851854.810604:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851854.810604:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.810606:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851854.810607:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851854.810608:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851854.810608:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851854.810608:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851854.810609:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10848@kfi7, seq: 2001852
00000100:00000040:7.0:1773851854.810610:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047242df6 : new rpc_count 1
00000100:00000001:7.0:1773851854.810610:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046224512 : -106940663327104 : ffff9ebcefc01680)
00000100:00000001:5.0:1773851854.810610:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851854.810611:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.810612:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e431b18a x1859316793979264/t0(0) o400->af813657-f44d-4bfd-ae7a-51d0a6621d79@10848@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1168-0'
00000100:00000001:7.0:1773851854.810614:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851854.810615:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851854.810616:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e431b18a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:af813657-f44d-4bfd-ae7a-51d0a6621d79+6:39735:x1859316793979264:12345-10848@kfi7:400:default-tuolumne1168-0
00000100:00000200:7.0:1773851854.810617:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316793979264
00000020:00000001:7.0:1773851854.810618:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851854.810618:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851854.810619:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.810619:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851854.810620:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851854.810621:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851854.810622:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316793979264, found 0 last_xid 1859316793979263
00000020:00000001:7.0:1773851854.810622:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851854.810623:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851854.810624:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851854.810624:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.810625:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851854.810625:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851854.810626:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851854.810627:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b071ae19.
02000000:00000001:7.0:1773851854.810627:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.810628:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.810629:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851854.810629:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684744, transno 0, xid 1859316793979264
00010000:00000001:7.0:1773851854.810630:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851854.810631:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e431b18a x1859316793979264/t0(0) o400->af813657-f44d-4bfd-ae7a-51d0a6621d79@10848@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1168-0'
00010000:00000001:7.0:1773851854.810634:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851854.810635:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851854.810635:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=86 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851854.810636:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851854.810637:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c8896b9c refcount 3 to 10848@kfi7
00000100:00000001:7.0:1773851854.810638:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274739008 : -107155434812608 : ffff9e8aee5f4b40)
02000000:00000001:7.0:1773851854.810639:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851854.810639:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851854.810640:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851854.810641:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10913@kfi7
00000400:00000010:7.0:1773851854.810642:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000232fbe3.
00000100:00000200:7.0:1773851854.810642:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316793979264, offset 224
00000400:00000200:7.0:1773851854.810644:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10913@kfi7
00000400:00000200:7.0:1773851854.810645:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10913@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.810645:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edbb109c nid 10913@kfi7 refs 1
00000400:00000200:7.0:1773851854.810646:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000edbb109c nid 10913@kfi7 refs 2
00000400:00000200:7.0:1773851854.810648:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000edbb109c nid 10913@kfi7 refs 3
00000400:00000200:7.0:1773851854.810649:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10913@kfi7 local destination
00000400:00000200:7.0:1773851854.810650:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768625:8768625:1024:4294967295] 10913@kfi7 LPNI seq info [352670:352670:16:4294967295]
00000400:00000200:7.0:1773851854.810651:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000edbb109c nid 10913@kfi7 refs 2
00000400:00000200:7.0:1773851854.810652:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10913@kfi7 to cpt 1
00000400:00000200:7.0:1773851854.810654:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10913@kfi7(10913@kfi7:10913@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851854.810655:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000edbb109c nid 10913@kfi7 refs 3
00000800:00000200:7.0:1773851854.810656:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851854.810657:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851854.810659:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851854.810662:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000cd4 Using peer 10913@kfi7(0x100000000000cd4)
00000800:00000200:7.0:1773851854.810667:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x100000000000cd4: rc=0
00000800:00000200:7.0:1773851854.810669:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000cd4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851854.810671:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851854.810671:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c8896b9c refcount 2 to 10848@kfi7
00010000:00000001:7.0:1773851854.810672:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851854.810673:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851854.810673:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851854.810674:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e431b18a x1859316793979264/t0(0) o400->af813657-f44d-4bfd-ae7a-51d0a6621d79@10848@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1168-0'
00000100:00100000:7.0:1773851854.810677:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e431b18a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:af813657-f44d-4bfd-ae7a-51d0a6621d79+6:39735:x1859316793979264:12345-10848@kfi7:400:default-tuolumne1168-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851854.810679:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10848@kfi7, seq: 2001852
00000100:00000040:7.0:1773851854.810680:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047242df6 : new rpc_count 0
00000100:00000001:7.0:1773851854.810681:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851854.810681:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:5.0:1773851854.810681:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000cd4 TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851854.810682:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851854.810683:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000400:00000200:5.0:1773851854.810683:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851854.810684:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000c1e289c.
00000020:00000040:7.0:1773851854.810684:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000047242df6 : new refcount 5
00000400:00000200:5.0:1773851854.810684:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10913@kfi7: PUT: OK
00000100:00000001:7.0:1773851854.810685:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851854.810685:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000232fbe3
00000400:00000010:5.0:1773851854.810685:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000232fbe3.
00000100:00000001:5.0:1773851854.810686:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851854.810687:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851854.810687:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000edbb109c nid 10913@kfi7 refs 2
00000800:00000200:5.0:1773851854.810689:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 10913@kfi7(00000000883eb266):0x0 lsk 3285 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000cd4 Transaction freed
00000800:00000200:1.0:1773851854.850057:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851854.850057:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851854.850059:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851854.850061:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851854.850063:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.850064:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23537@kfi7 : PUT - for me
00000400:00000200:1.0:1773851854.850065:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.850065:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 1
00000400:00000200:1.0:1773851854.850067:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.850067:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000400:00000200:1.0:1773851854.850068:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 3
00000400:00000200:1.0:1773851854.850069:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:1.0:1773851854.850070:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23537@kfi7 of length 224 into portal 12 MB=0x69b095cd52f00
00000400:00000200:1.0:1773851854.850071:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23537@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 13120
00000800:00000200:1.0:1773851854.850073:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851854.850075:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851854.850076:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23537@kfi7: PUT: OK
00000100:00000001:1.0:1773851854.850077:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851854.850078:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851854.850078:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f7f0b202.
00000100:00000040:1.0:1773851854.850079:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000f7f0b202 x1859314374749952 msgsize 224
00000100:00100000:1.0:1773851854.850081:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-23537@kfi7 (source: 12345-23537@kfi7)
00000100:00000001:1.0:1773851854.850082:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851854.850082:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000100:00000001:0.0:1773851854.850083:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851854.850084:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851854.850084:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851854.850084:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851854.850085:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851854.850086:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851854.850086:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314374749952
00000020:00000001:0.0:1773851854.850087:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851854.850087:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e30
00000020:00000001:0.0:1773851854.850088:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851854.850089:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e85c0383 refcount=6
00000020:00000001:0.0:1773851854.850089:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744446976 : -107128965104640 : ffff9e911816fc00)
00000020:00000001:0.0:1773851854.850091:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744446976 : -107128965104640 : ffff9e911816fc00)
00000100:00000001:0.0:1773851854.850092:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851854.850093:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851854.850094:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec7129f9.
00000020:00000010:0.0:1773851854.850095:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851854.850096:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009dbae27c.
00000100:00000001:0.0:1773851854.850096:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851854.850097:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851854.850097:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851854.850098:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851854.850099:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851854.850099:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851854.850100:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851854.850101:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851854.850101:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851854.850102:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851854.850102:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851854.850103:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23537@kfi7, seq: 1997491
00000100:00000040:2.0:1773851854.850104:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e85c0383 : new rpc_count 1
00000100:00000001:0.0:1773851854.850104:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.850105:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605670784 : -106923103880832 : ffff9ec1065ff980)
00000100:00000001:0.0:1773851854.850105:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851854.850106:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f7f0b202 x1859314374749952/t0(0) o400->a754eefe-5a2b-4baf-8357-6a85c2d886f8@23537@kfi7:494/0 lens 224/0 e 0 to 0 dl 1773852609 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1949-0'
00000100:00000001:2.0:1773851854.850109:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851854.850109:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851854.850110:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f7f0b202 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a754eefe-5a2b-4baf-8357-6a85c2d886f8+6:39769:x1859314374749952:12345-23537@kfi7:400:default-tuolumne1949-0
00000100:00000200:2.0:1773851854.850112:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314374749952
00000020:00000001:2.0:1773851854.850113:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851854.850113:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851854.850114:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850115:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851854.850115:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851854.850116:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851854.850117:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314374749952, found 0 last_xid 1859314374749951
00000020:00000001:2.0:1773851854.850118:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851854.850119:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851854.850119:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851854.850120:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850120:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851854.850121:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851854.850122:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851854.850122:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000de1a9407.
02000000:00000001:2.0:1773851854.850124:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.850124:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850125:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851854.850126:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314374749952
00010000:00000001:2.0:1773851854.850127:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851854.850127:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f7f0b202 x1859314374749952/t0(0) o400->a754eefe-5a2b-4baf-8357-6a85c2d886f8@23537@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1949-0'
00010000:00000001:2.0:1773851854.850130:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851854.850130:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851854.850131:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=87 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851854.850132:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851854.850133:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6aa224c refcount 5 to 23537@kfi7
00000100:00000001:2.0:1773851854.850134:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850079392 : -107143859472224 : ffff9e8da050f8a0)
02000000:00000001:2.0:1773851854.850135:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851854.850136:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.850136:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851854.850137:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23537@kfi7
00000400:00000010:2.0:1773851854.850138:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee30c2c.
00000100:00000200:2.0:1773851854.850139:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314374749952, offset 224
00000400:00000200:2.0:1773851854.850140:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23537@kfi7
00000400:00000200:2.0:1773851854.850141:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:2.0:1773851854.850142:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 1
00000400:00000200:2.0:1773851854.850143:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000400:00000200:2.0:1773851854.850144:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 3
00000400:00000200:2.0:1773851854.850145:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23537@kfi7 local destination
00000400:00000200:2.0:1773851854.850147:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768626:8768626:1024:4294967295] 23537@kfi7 LPNI seq info [390092:390092:16:4294967295]
00000400:00000200:2.0:1773851854.850148:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000400:00000200:2.0:1773851854.850149:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:2.0:1773851854.850151:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23537@kfi7(23537@kfi7:23537@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851854.850153:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 3
00000800:00000200:2.0:1773851854.850154:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851854.850155:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2054@kfi7:0 -> 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851854.850157:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2054@kfi7:0 -> 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851854.850160:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2054@kfi7:0 -> 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003f2 Using peer 23537@kfi7(0x1000000000003f2)
00000800:00000200:2.0:1773851854.850163:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000894f0236: Posted send of 324 bytes to peer 0x1000000000003f2: rc=0
00000800:00000200:2.0:1773851854.850164:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2054@kfi7:0 -> 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003f2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851854.850167:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851854.850167:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6aa224c refcount 4 to 23537@kfi7
00010000:00000001:2.0:1773851854.850168:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851854.850169:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850169:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851854.850170:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f7f0b202 x1859314374749952/t0(0) o400->a754eefe-5a2b-4baf-8357-6a85c2d886f8@23537@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1949-0'
00000100:00100000:2.0:1773851854.850173:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f7f0b202 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a754eefe-5a2b-4baf-8357-6a85c2d886f8+6:39769:x1859314374749952:12345-23537@kfi7:400:default-tuolumne1949-0 Request processed in 63us (93us total) trans 0 rc 0/0
00000800:00000200:3.0:1773851854.850176:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00100000:2.0:1773851854.850176:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23537@kfi7, seq: 1997491
00000800:00000200:3.0:1773851854.850177:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:2.0:1773851854.850177:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e85c0383 : new rpc_count 0
00000800:00000200:1.0:1773851854.850177:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2054@kfi7:0 -> 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003f2 TN_EVENT_TX_OK event status 0
00000800:00000200:3.0:1773851854.850178:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:2.0:1773851854.850178:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851854.850178:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851854.850179:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000800:00000200:3.0:1773851854.850180:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:2.0:1773851854.850180:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009dbae27c.
00000400:00000200:1.0:1773851854.850180:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851854.850181:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000020:00000010:2.0:1773851854.850181:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec7129f9.
00000400:00000200:1.0:1773851854.850181:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23537@kfi7: PUT: OK
00000400:00000200:3.0:1773851854.850182:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23537@kfi7 : PUT - for me
00000020:00000040:2.0:1773851854.850182:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000e85c0383 : new refcount 5
00000100:00000001:2.0:1773851854.850183:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851854.850183:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee30c2c
00000400:00000010:1.0:1773851854.850183:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee30c2c.
00000400:00000200:3.0:1773851854.850184:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:3.0:1773851854.850184:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000400:00000200:3.0:1773851854.850185:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000100:00000001:1.0:1773851854.850185:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851854.850185:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851854.850186:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 3
00000400:00000200:3.0:1773851854.850186:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 4
00000400:00000200:1.0:1773851854.850188:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 3
00000400:00000200:3.0:1773851854.850189:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:3.0:1773851854.850190:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23537@kfi7 of length 224 into portal 12 MB=0x69b095cd53040
00000800:00000200:1.0:1773851854.850190:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2054@kfi7:0 -> 23537@kfi7(00000000a128b83b):0x0 lsk 1011 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003f2 Transaction freed
00000400:00000200:3.0:1773851854.850191:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23537@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 13344
00000800:00000200:3.0:1773851854.850193:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851854.850194:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851854.850195:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23537@kfi7: PUT: OK
00000100:00000001:3.0:1773851854.850195:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851854.850196:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851854.850196:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000041b4cbef.
00000100:00000040:3.0:1773851854.850197:0:2506738:0:(events.c:358:request_in_callback()) incoming req@0000000041b4cbef x1859314374750272 msgsize 224
00000100:00100000:3.0:1773851854.850198:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-23537@kfi7 (source: 12345-23537@kfi7)
00000100:00000001:3.0:1773851854.850199:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851854.850200:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000800:00000200:3.0:1773851854.850201:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851854.850201:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851854.850201:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851854.850201:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851854.850202:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851854.850203:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851854.850204:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314374750272
00000020:00000001:2.0:1773851854.850204:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851854.850204:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e4c
00000020:00000001:2.0:1773851854.850205:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851854.850206:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bf78949f refcount=6
00000020:00000001:2.0:1773851854.850207:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744416256 : -107128965135360 : ffff9e9118168400)
00000020:00000001:2.0:1773851854.850207:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744416256 : -107128965135360 : ffff9e9118168400)
00000100:00000001:2.0:1773851854.850208:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851854.850209:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851854.850209:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009abda479.
00000020:00000010:2.0:1773851854.850210:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851854.850211:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a912de76.
00000100:00000001:2.0:1773851854.850212:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851854.850212:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851854.850213:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851854.850214:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851854.850214:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851854.850214:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.850215:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851854.850216:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851854.850217:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851854.850217:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23537@kfi7, seq: 1997492
00000100:00000001:0.0:1773851854.850217:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851854.850217:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:2.0:1773851854.850218:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bf78949f : new rpc_count 1
00000100:00000001:0.0:1773851854.850218:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.850219:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288703616 : -106964420848000 : ffff9eb767b11680)
00000100:00000001:0.0:1773851854.850219:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851854.850220:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000041b4cbef x1859314374750272/t0(0) o400->4c827321-6ae7-4984-8462-d07e1903dcd7@23537@kfi7:494/0 lens 224/0 e 0 to 0 dl 1773852609 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1949-0'
00000100:00000001:2.0:1773851854.850222:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851854.850222:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851854.850223:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000041b4cbef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4c827321-6ae7-4984-8462-d07e1903dcd7+6:39768:x1859314374750272:12345-23537@kfi7:400:default-tuolumne1949-0
00000100:00000200:2.0:1773851854.850224:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314374750272
00000020:00000001:2.0:1773851854.850225:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851854.850225:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851854.850226:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850227:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851854.850227:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851854.850228:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851854.850228:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314374750272, found 0 last_xid 1859314374750271
00000020:00000001:2.0:1773851854.850229:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851854.850229:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851854.850230:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851854.850230:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850231:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851854.850231:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851854.850231:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851854.850232:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c5d22bd1.
02000000:00000001:2.0:1773851854.850233:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.850233:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850234:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851854.850234:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044147599, transno 0, xid 1859314374750272
00010000:00000001:2.0:1773851854.850235:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851854.850236:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000041b4cbef x1859314374750272/t0(0) o400->4c827321-6ae7-4984-8462-d07e1903dcd7@23537@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1949-0'
00010000:00000001:2.0:1773851854.850238:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851854.850239:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851854.850239:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=87 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851854.850240:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851854.850241:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6aa224c refcount 5 to 23537@kfi7
00000100:00000001:2.0:1773851854.850241:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850079392 : -107143859472224 : ffff9e8da050f8a0)
02000000:00000001:2.0:1773851854.850242:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851854.850242:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851854.850243:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851854.850244:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23537@kfi7
00000400:00000010:2.0:1773851854.850244:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002d057656.
00000100:00000200:2.0:1773851854.850245:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314374750272, offset 224
00000400:00000200:2.0:1773851854.850247:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23537@kfi7
00000400:00000200:2.0:1773851854.850247:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:2.0:1773851854.850248:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 1
00000400:00000200:2.0:1773851854.850249:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000400:00000200:2.0:1773851854.850250:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 3
00000400:00000200:2.0:1773851854.850252:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23537@kfi7 local destination
00000400:00000200:2.0:1773851854.850253:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768627:8768627:1024:4294967295] 23537@kfi7 LPNI seq info [390093:390093:16:4294967295]
00000400:00000200:2.0:1773851854.850255:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000400:00000200:2.0:1773851854.850255:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23537@kfi7 to cpt 0
00000400:00000200:2.0:1773851854.850257:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23537@kfi7(23537@kfi7:23537@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851854.850258:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 3
00000800:00000200:2.0:1773851854.850260:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851854.850261:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851854.850263:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851854.850265:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3f7 Using peer 23537@kfi7(0x3f7)
00000800:00000200:2.0:1773851854.850267:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000dae7d744: Posted send of 324 bytes to peer 0x3f7: rc=0
00000800:00000200:2.0:1773851854.850269:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3f7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851854.850271:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851854.850271:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6aa224c refcount 4 to 23537@kfi7
00010000:00000001:2.0:1773851854.850272:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851854.850272:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851854.850273:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851854.850273:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000041b4cbef x1859314374750272/t0(0) o400->4c827321-6ae7-4984-8462-d07e1903dcd7@23537@kfi7:494/0 lens 224/224 e 0 to 0 dl 1773852609 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1949-0'
00000100:00100000:2.0:1773851854.850276:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000041b4cbef pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4c827321-6ae7-4984-8462-d07e1903dcd7+6:39768:x1859314374750272:12345-23537@kfi7:400:default-tuolumne1949-0 Request processed in 54us (79us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851854.850278:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23537@kfi7, seq: 1997492
00000100:00000040:2.0:1773851854.850279:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bf78949f : new rpc_count 0
00000100:00000001:2.0:1773851854.850280:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851854.850280:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:3.0:1773851854.850281:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3f7 TN_EVENT_TX_OK event status 0
00000020:00000010:2.0:1773851854.850281:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851854.850281:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a912de76.
00000020:00000010:2.0:1773851854.850282:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009abda479.
00000400:00000200:3.0:1773851854.850283:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:2.0:1773851854.850283:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000bf78949f : new refcount 5
00000100:00000001:2.0:1773851854.850283:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851854.850284:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23537@kfi7: PUT: OK
00000400:00000200:3.0:1773851854.850284:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002d057656
00000400:00000010:3.0:1773851854.850284:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002d057656.
00000100:00000001:3.0:1773851854.850285:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851854.850285:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851854.850286:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004b556215 nid 23537@kfi7 refs 2
00000800:00000200:3.0:1773851854.850287:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 23537@kfi7(00000000599384ec):0x0 lsk 1016 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3f7 Transaction freed
00000800:00000200:21.0:1773851854.924221:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851854.924222:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851854.924224:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851854.924228:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851854.924231:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24290@kfi7 to cpt 5
00000400:00000200:21.0:1773851854.924233:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24290@kfi7 : PUT - for me
00000400:00000200:21.0:1773851854.924235:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24290@kfi7 to cpt 5
00000400:00000200:21.0:1773851854.924237:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074566a62 nid 24290@kfi7 refs 1
00000400:00000200:21.0:1773851854.924239:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24290@kfi7 to cpt 5
00000400:00000200:21.0:1773851854.924240:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074566a62 nid 24290@kfi7 refs 2
00000400:00000200:21.0:1773851854.924242:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000074566a62 nid 24290@kfi7 refs 3
00000400:00000200:21.0:1773851854.924244:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24291@kfi7 to cpt 0
00000400:00000200:21.0:1773851854.924246:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24291@kfi7 of length 224 into portal 12 MB=0x69b464510dd80
00000400:00000200:21.0:1773851854.924248:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24291@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 24264
00000800:00000200:21.0:1773851854.924251:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851854.924254:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851854.924257:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24290@kfi7: PUT: OK
00000100:00000001:21.0:1773851854.924259:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851854.924260:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851854.924261:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cdb9ae83.
00000100:00000040:21.0:1773851854.924263:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000cdb9ae83 x1859575969013120 msgsize 224
00000100:00100000:21.0:1773851854.924266:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24291@kfi7 (source: 12345-24290@kfi7)
00000100:00000001:21.0:1773851854.924268:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851854.924269:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000074566a62 nid 24290@kfi7 refs 2
00000100:00000001:23.0:1773851854.924272:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851854.924272:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2069@kfi7:5 <- 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851854.924273:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851854.924274:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851854.924275:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851854.924277:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851854.924279:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575969013120
00000020:00000001:23.0:1773851854.924281:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851854.924281:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc31b1bba
00000020:00000001:23.0:1773851854.924283:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851854.924288:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ecb0ec75 refcount=5
00000020:00000001:23.0:1773851854.924289:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637147319162880 : -106926390388736 : ffff9ec0427bd800)
00000020:00000001:23.0:1773851854.924291:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637147319162880 : -106926390388736 : ffff9ec0427bd800)
00000100:00000001:23.0:1773851854.924293:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851854.924294:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851854.924296:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a6e6ffee.
00000020:00000010:23.0:1773851854.924298:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851854.924301:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851854.924303:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851854.924304:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851854.924305:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851854.924308:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851854.924309:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851854.924309:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851854.924312:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851854.924315:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851854.924315:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851854.924316:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851854.924316:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851854.924319:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24291@kfi7, seq: 1997927
00000100:00000040:23.0:1773851854.924320:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ecb0ec75 : new rpc_count 1
00000100:00000001:22.0:1773851854.924320:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851854.924322:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117342848 : -106995592208768 : ffff9eb025bbde80)
00000100:00000001:22.0:1773851854.924322:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851854.924324:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cdb9ae83 x1859575969013120/t0(0) o400->8bc4958c-1897-4285-9fb7-ad97c90b3f0b@24291@kfi7:581/0 lens 224/0 e 0 to 0 dl 1773851941 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1995-0'
00000100:00000001:23.0:1773851854.924331:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851854.924332:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851854.924333:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdb9ae83 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:8bc4958c-1897-4285-9fb7-ad97c90b3f0b+5:39924:x1859575969013120:12345-24291@kfi7:400:default-tuolumne1995-0
00000100:00000200:23.0:1773851854.924336:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575969013120
00000020:00000001:23.0:1773851854.924337:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851854.924339:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851854.924340:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851854.924342:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851854.924343:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851854.924344:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851854.924345:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575969013120, found 0 last_xid 1859575969013119
00000020:00000001:23.0:1773851854.924347:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851854.924348:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851854.924349:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851854.924351:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851854.924352:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851854.924353:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851854.924354:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851854.924359:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000054a79f9a.
02000000:00000001:23.0:1773851854.924360:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851854.924361:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851854.924363:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851854.924364:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182422167210, transno 0, xid 1859575969013120
00010000:00000001:23.0:1773851854.924366:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851854.924367:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cdb9ae83 x1859575969013120/t0(0) o400->8bc4958c-1897-4285-9fb7-ad97c90b3f0b@24291@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1995-0'
00010000:00000001:23.0:1773851854.924373:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851854.924374:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851854.924375:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=87 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851854.924377:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851854.924379:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005cc6927f refcount 3 to 24291@kfi7
00000100:00000001:23.0:1773851854.924380:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850080544 : -107143859471072 : ffff9e8da050fd20)
02000000:00000001:23.0:1773851854.924382:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851854.924383:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851854.924384:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851854.924386:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24290@kfi7
00000400:00000010:23.0:1773851854.924387:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d767c6.
00000100:00000200:23.0:1773851854.924389:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575969013120, offset 224
00000400:00000200:23.0:1773851854.924392:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24290@kfi7
00000400:00000200:23.0:1773851854.924394:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24290@kfi7 to cpt 5
00000400:00000200:23.0:1773851854.924396:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074566a62 nid 24290@kfi7 refs 1
00000400:00000200:23.0:1773851854.924398:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000074566a62 nid 24290@kfi7 refs 2
00000400:00000200:23.0:1773851854.924400:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000074566a62 nid 24290@kfi7 refs 3
00000400:00000200:23.0:1773851854.924402:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24290@kfi7 local destination
00000400:00000200:23.0:1773851854.924404:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768628:8768628:1024:4294967295] 24290@kfi7 LPNI seq info [7134093:7134093:16:4294967295]
00000400:00000200:23.0:1773851854.924406:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000074566a62 nid 24290@kfi7 refs 2
00000400:00000200:23.0:1773851854.924407:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24290@kfi7 to cpt 5
00000400:00000200:23.0:1773851854.924410:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24290@kfi7(24290@kfi7:24290@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851854.924411:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000074566a62 nid 24290@kfi7 refs 3
00000800:00000200:23.0:1773851854.924413:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851854.924415:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851854.924418:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851854.924421:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6d4 Using peer 24290@kfi7(0x6d4)
00000800:00000200:23.0:1773851854.924425:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x6d4: rc=0
00000800:00000200:23.0:1773851854.924427:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6d4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851854.924429:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851854.924430:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005cc6927f refcount 2 to 24291@kfi7
00010000:00000001:23.0:1773851854.924431:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851854.924431:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851854.924432:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851854.924433:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cdb9ae83 x1859575969013120/t0(0) o400->8bc4958c-1897-4285-9fb7-ad97c90b3f0b@24291@kfi7:581/0 lens 224/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1995-0'
00000100:00100000:23.0:1773851854.924436:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdb9ae83 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:8bc4958c-1897-4285-9fb7-ad97c90b3f0b+5:39924:x1859575969013120:12345-24291@kfi7:400:default-tuolumne1995-0 Request processed in 105us (173us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851854.924439:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24291@kfi7, seq: 1997927
00000800:00000200:21.0:1773851854.924439:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6d4 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851854.924440:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ecb0ec75 : new rpc_count 0
00000100:00000001:23.0:1773851854.924441:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851854.924442:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851854.924442:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851854.924443:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851854.924443:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24290@kfi7: PUT: OK
00000400:00000200:21.0:1773851854.924443:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d767c6
00000020:00000010:23.0:1773851854.924444:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:23.0:1773851854.924444:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a6e6ffee.
00000400:00000010:21.0:1773851854.924444:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d767c6.
00000020:00000040:23.0:1773851854.924445:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000ecb0ec75 : new refcount 4
00000100:00000001:21.0:1773851854.924445:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851854.924445:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851854.924446:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851854.924446:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000074566a62 nid 24290@kfi7 refs 2
00000800:00000200:21.0:1773851854.924448:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24290@kfi7(0000000054327445):0x0 lsk 1749 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6d4 Transaction freed
00000800:00000200:22.0:1773851854.950108:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851854.950108:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851854.950109:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851854.950109:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851854.950110:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851854.950110:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851854.950112:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851854.950112:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18305@kfi7(00000000d5ca31ef):0xbfc version: 2; local version 2; negotiated version: 2
00000400:00000200:22.0:1773851854.950114:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18305@kfi7 to cpt 5
00000800:00000200:21.0:1773851854.950114:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc Using peer 18305@kfi7(0x100000000000bfc)
00000400:00000200:22.0:1773851854.950116:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18305@kfi7 : PUT - for me
00000400:00000200:21.0:1773851854.950116:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18305@kfi7 to cpt 5
00000400:00000200:22.0:1773851854.950117:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18305@kfi7 to cpt 5
00000800:00000200:21.0:1773851854.950117:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000008c4261a5: Posted send of 38 bytes to peer 0x100000000000bfc: rc=0
00000400:00000200:22.0:1773851854.950118:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 1
00000400:00000200:22.0:1773851854.950119:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18305@kfi7 to cpt 5
00000800:00000200:21.0:1773851854.950119:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851854.950120:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 2
00000400:00000200:22.0:1773851854.950121:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 3
00000400:00000200:22.0:1773851854.950122:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18304@kfi7 to cpt 2
00000400:00000200:22.0:1773851854.950123:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18304@kfi7 of length 336 into portal 17 MB=0x69b0a05ac4540
00000400:00000200:22.0:1773851854.950125:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-18304@kfi7 of length 336/336 into md 0x6a33b3795 [2] + 1888
00000400:00000010:22.0:1773851854.950126:0:2456945:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000025064de4.
00000400:00000200:22.0:1773851854.950127:0:2456945:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 000000002ddb5e1c
00000800:00000200:22.0:1773851854.950128:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851854.950129:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851854.950130:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851854.950131:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18305@kfi7: PUT: OK
00000800:00000200:21.0:1773851854.950131:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008c4261a5: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc Transaction freed
00000400:00000200:22.0:1773851854.950132:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002ddb5e1c
00000400:00000010:22.0:1773851854.950132:0:2456945:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 000000002ddb5e1c (tot 253200619).
00000100:00000001:22.0:1773851854.950133:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851854.950134:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000040:22.0:1773851854.950135:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000003b37a6a1 x1859317207418176 msgsize 336
00000100:00100000:22.0:1773851854.950136:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-18304@kfi7 (source: 12345-18305@kfi7)
00000100:00000040:22.0:1773851854.950137:0:2456945:0:(events.c:370:request_in_callback()) Buffer complete: 63 buffers still posted
00000100:00000001:22.0:1773851854.950138:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851854.950139:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 2
00000800:00000200:22.0:1773851854.950140:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:21.0:1773851854.950140:0:41144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:21.0:1773851854.950141:0:41144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:21.0:1773851854.950141:0:41144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:21.0:1773851854.950142:0:41144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:21.0:1773851854.950143:0:41144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:21.0:1773851854.950143:0:41144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317207418176
00000020:00000001:21.0:1773851854.950144:0:41144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:21.0:1773851854.950144:0:41144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91fd5
00000020:00000001:21.0:1773851854.950145:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851854.950149:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e953d29d refcount=9
00000020:00000001:21.0:1773851854.950150:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629267456 : -107123080284160 : ffff9e9276da3800)
00000020:00000001:21.0:1773851854.950150:0:41144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629267456 : -107123080284160 : ffff9e9276da3800)
00000100:00000001:21.0:1773851854.950152:0:41144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:21.0:1773851854.950152:0:41144:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:21.0:1773851854.950153:0:41144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004cfa686b.
00000020:00000010:21.0:1773851854.950154:0:41144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a03aa828.
00000020:00000010:21.0:1773851854.950155:0:41144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000104460d.
00000100:00000040:21.0:1773851854.950156:0:41144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:21.0:1773851854.950157:0:41144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:21.0:1773851854.950157:0:41144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:21.0:1773851854.950158:0:41144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:21.0:1773851854.950159:0:41144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950160:0:41144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:21.0:1773851854.950161:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851854.950161:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851854.950162:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fcaf5765 refcount=3
00000020:00000001:21.0:1773851854.950163:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962503739072 : -107111205812544 : ffff9e953aa046c0)
00010000:00000001:21.0:1773851854.950164:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962503739072 : -107111205812544 : ffff9e953aa046c0)
00010000:00000001:21.0:1773851854.950165:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950166:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950166:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851854.950166:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851854.950167:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f315dcef refcount=3
00000020:00000001:21.0:1773851854.950168:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962503748288 : -107111205803328 : ffff9e953aa06ac0)
00010000:00000001:21.0:1773851854.950168:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962503748288 : -107111205803328 : ffff9e953aa06ac0)
00010000:00000001:21.0:1773851854.950169:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950169:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950170:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851854.950170:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851854.950171:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000017380f27 refcount=3
00000020:00000001:21.0:1773851854.950171:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:21.0:1773851854.950172:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:21.0:1773851854.950173:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950173:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950174:0:41144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851854.950174:0:41144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851854.950175:0:41144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851854.950176:0:41144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851854.950178:0:41144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:21.0:1773851854.950178:0:41144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851854.950179:0:170562:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851854.950179:0:170562:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:21.0:1773851854.950179:0:41144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18304@kfi7, seq: 37871501
00000100:00000001:23.0:1773851854.950180:0:170562:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851854.950180:0:170562:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851854.950180:0:41144:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e953d29d : new rpc_count 1
00000100:00000001:21.0:1773851854.950180:0:41144:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637076397807696 : -106997311743920 : ffff9eafbf3dd850)
00000100:00000040:21.0:1773851854.950181:0:41144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003b37a6a1 x1859317207418176/t0(0) o103->7ab41b3c-ab7c-4fb9-8f74-dc6193954110@18304@kfi7:581/0 lens 336/0 e 0 to 0 dl 1773851941 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:21.0:1773851854.950184:0:41144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:21.0:1773851854.950185:0:41144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:21.0:1773851854.950186:0:41144:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b37a6a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn05_000:7ab41b3c-ab7c-4fb9-8f74-dc6193954110+9:39738:x1859317207418176:12345-18304@kfi7:103:
00000100:00000200:21.0:1773851854.950187:0:41144:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317207418176
00010000:00000001:21.0:1773851854.950188:0:41144:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:21.0:1773851854.950188:0:41144:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:21.0:1773851854.950189:0:41144:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:21.0:1773851854.950191:0:41144:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:21.0:1773851854.950191:0:41144:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:21.0:1773851854.950192:0:41144:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f06186fb.
02000000:00000001:21.0:1773851854.950193:0:41144:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851854.950193:0:41144:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950195:0:41144:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:21.0:1773851854.950195:0:41144:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00000001:21.0:1773851854.950196:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851854.950196:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851854.950197:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fcaf5765 refcount=3
00000020:00000001:21.0:1773851854.950197:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962503739072 : -107111205812544 : ffff9e953aa046c0)
00010000:00000001:21.0:1773851854.950198:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962503739072 : -107111205812544 : ffff9e953aa046c0)
00010000:00000040:21.0:1773851854.950199:0:41144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 199
00000004:00000001:21.0:1773851854.950200:0:41144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:21.0:1773851854.950201:0:41144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:21.0:1773851854.950202:0:41144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:21.0:1773851854.950203:0:41144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:21.0:1773851854.950203:0:41144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:21.0:1773851854.950204:0:41144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950206:0:41144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:21.0:1773851854.950206:0:41144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:21.0:1773851854.950207:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950208:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950208:0:41144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:21.0:1773851854.950209:0:41144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:21.0:1773851854.950210:0:41144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000fcaf5765 with handle 0x21b6f08f07a4d74a from hash
00010000:00000001:21.0:1773851854.950211:0:41144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:21.0:1773851854.950211:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950211:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950212:0:41144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:21.0:1773851854.950213:0:41144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:21.0:1773851854.950214:0:41144:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950215:0:41144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:21.0:1773851854.950215:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:21.0:1773851854.950216:0:41144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcaf5765/0x21b6f08f07a4d74a lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a01000000000 nid: 18304@kfi7 remote: 0xa8da567d9ebd271e expref: 9 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:21.0:1773851854.950223:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:21.0:1773851854.950224:0:41144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e953d29d : new locks_count 2
00000020:00000040:21.0:1773851854.950225:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000e953d29d : new refcount 8
00010000:00000010:21.0:1773851854.950226:0:41144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000000c323125.
00010000:00000040:21.0:1773851854.950227:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000001:21.0:1773851854.950227:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950227:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851854.950228:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851854.950228:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f315dcef refcount=3
00000020:00000001:21.0:1773851854.950229:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962503748288 : -107111205803328 : ffff9e953aa06ac0)
00010000:00000001:21.0:1773851854.950230:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962503748288 : -107111205803328 : ffff9e953aa06ac0)
00010000:00000001:21.0:1773851854.950231:0:41144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:21.0:1773851854.950231:0:41144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:21.0:1773851854.950232:0:41144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:21.0:1773851854.950234:0:41144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:21.0:1773851854.950234:0:41144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950235:0:41144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:21.0:1773851854.950236:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 197
00010000:00000040:21.0:1773851854.950237:0:41144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 234
00000004:00000001:21.0:1773851854.950237:0:41144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:21.0:1773851854.950238:0:41144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:21.0:1773851854.950238:0:41144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:21.0:1773851854.950239:0:41144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:21.0:1773851854.950239:0:41144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:21.0:1773851854.950240:0:41144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950241:0:41144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:21.0:1773851854.950241:0:41144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:21.0:1773851854.950242:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950243:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950243:0:41144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:21.0:1773851854.950243:0:41144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:21.0:1773851854.950244:0:41144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f315dcef with handle 0x21b6f08f07a4d73c from hash
00010000:00000001:21.0:1773851854.950245:0:41144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:21.0:1773851854.950246:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950246:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950246:0:41144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:21.0:1773851854.950247:0:41144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:21.0:1773851854.950247:0:41144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950248:0:41144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:21.0:1773851854.950248:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:21.0:1773851854.950249:0:41144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f315dcef/0x21b6f08f07a4d73c lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x44a01000000000 nid: 18304@kfi7 remote: 0xa8da567d9ebd26f4 expref: 8 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:21.0:1773851854.950251:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:21.0:1773851854.950252:0:41144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e953d29d : new locks_count 1
00000020:00000040:21.0:1773851854.950253:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000e953d29d : new refcount 7
00010000:00000010:21.0:1773851854.950253:0:41144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000050028e8c.
00010000:00000040:21.0:1773851854.950254:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:21.0:1773851854.950254:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950255:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851854.950255:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851854.950255:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000017380f27 refcount=3
00000020:00000001:21.0:1773851854.950256:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:21.0:1773851854.950257:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:21.0:1773851854.950258:0:41144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:21.0:1773851854.950258:0:41144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:21.0:1773851854.950259:0:41144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:21.0:1773851854.950260:0:41144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:21.0:1773851854.950260:0:41144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950261:0:41144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:21.0:1773851854.950261:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 232
00010000:00000040:21.0:1773851854.950262:0:41144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 200
00000004:00000001:21.0:1773851854.950263:0:41144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:21.0:1773851854.950263:0:41144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:21.0:1773851854.950264:0:41144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:21.0:1773851854.950264:0:41144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:21.0:1773851854.950265:0:41144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:21.0:1773851854.950266:0:41144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950267:0:41144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:21.0:1773851854.950268:0:41144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:21.0:1773851854.950268:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950269:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950269:0:41144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:21.0:1773851854.950269:0:41144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:21.0:1773851854.950270:0:41144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000017380f27 with handle 0x21b6f08f07a4d720 from hash
00010000:00000001:21.0:1773851854.950271:0:41144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:21.0:1773851854.950271:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851854.950272:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950272:0:41144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:21.0:1773851854.950272:0:41144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:21.0:1773851854.950273:0:41144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950273:0:41144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:21.0:1773851854.950274:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:21.0:1773851854.950275:0:41144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a4d720 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x44a01000000000 nid: 18304@kfi7 remote: 0xa8da567d9ebd26ed expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:21.0:1773851854.950277:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:21.0:1773851854.950278:0:41144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e953d29d : new locks_count 0
00000020:00000040:21.0:1773851854.950279:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000e953d29d : new refcount 6
00010000:00000010:21.0:1773851854.950279:0:41144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000007d562905.
00010000:00000040:21.0:1773851854.950280:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:21.0:1773851854.950281:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851854.950281:0:41144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:21.0:1773851854.950281:0:41144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:21.0:1773851854.950282:0:41144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:21.0:1773851854.950283:0:41144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:21.0:1773851854.950284:0:41144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950284:0:41144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:21.0:1773851854.950285:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00010000:21.0:1773851854.950286:0:41144:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:21.0:1773851854.950286:0:41144:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=3 : 3 : 3)
00010000:00000001:21.0:1773851854.950288:0:41144:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:21.0:1773851854.950288:0:41144:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:21.0:1773851854.950289:0:41144:0:(import.c:1951:at_measured()) add 1 to 0000000007eb48e0 time=108 v=66 (1 1 1 1)
00000100:00000001:21.0:1773851854.950291:0:41144:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:21.0:1773851854.950292:0:41144:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009fdc3e62 refcount 3 to 18304@kfi7
00000100:00000001:21.0:1773851854.950292:0:41144:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899610080 : -107146809941536 : ffff9e8cf07461e0)
02000000:00000001:21.0:1773851854.950293:0:41144:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:21.0:1773851854.950294:0:41144:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851854.950295:0:41144:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:21.0:1773851854.950296:0:41144:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18305@kfi7
00000400:00000010:21.0:1773851854.950296:0:41144:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098c60bd6.
00000100:00000200:21.0:1773851854.950298:0:41144:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859317207418176, offset 224
00000400:00000200:21.0:1773851854.950299:0:41144:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18305@kfi7
00000400:00000200:21.0:1773851854.950301:0:41144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18305@kfi7 to cpt 5
00000400:00000200:21.0:1773851854.950302:0:41144:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 1
00000400:00000200:21.0:1773851854.950303:0:41144:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 2
00000400:00000200:21.0:1773851854.950304:0:41144:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 3
00000400:00000200:21.0:1773851854.950306:0:41144:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18305@kfi7 local destination
00000400:00000200:21.0:1773851854.950308:0:41144:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768629:8768629:1024:4294967295] 18305@kfi7 LPNI seq info [211339:211339:16:4294967295]
00000400:00000200:21.0:1773851854.950310:0:41144:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 2
00000400:00000200:21.0:1773851854.950311:0:41144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18305@kfi7 to cpt 5
00000400:00000200:21.0:1773851854.950313:0:41144:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18305@kfi7(18305@kfi7:18305@kfi7) <?> : PUT try# 0
00000400:00000200:21.0:1773851854.950315:0:41144:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 3
00000800:00000200:21.0:1773851854.950316:0:41144:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851854.950318:0:41144:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008c4261a5: 2054@kfi7:5 -> 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:21.0:1773851854.950321:0:41144:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008c4261a5: 2054@kfi7:5 -> 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:21.0:1773851854.950323:0:41144:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008c4261a5: 2054@kfi7:5 -> 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc Using peer 18305@kfi7(0x100000000000bfc)
00000800:00000200:21.0:1773851854.950327:0:41144:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000008c4261a5: Posted send of 324 bytes to peer 0x100000000000bfc: rc=0
00000800:00000200:21.0:1773851854.950329:0:41144:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008c4261a5: 2054@kfi7:5 -> 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:21.0:1773851854.950332:0:41144:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851854.950334:0:41144:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009fdc3e62 refcount 2 to 18304@kfi7
00010000:00000001:21.0:1773851854.950335:0:41144:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851854.950336:0:41144:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851854.950337:0:41144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003b37a6a1 x1859317207418176/t0(0) o103->7ab41b3c-ab7c-4fb9-8f74-dc6193954110@18304@kfi7:581/0 lens 336/224 e 0 to 0 dl 1773851941 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000800:00000200:22.0:1773851854.950339:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008c4261a5: 2054@kfi7:5 -> 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851854.950341:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:21.0:1773851854.950341:0:41144:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b37a6a1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn05_000:7ab41b3c-ab7c-4fb9-8f74-dc6193954110+6:39738:x1859317207418176:12345-18304@kfi7:103: Request processed in 156us (205us total) trans 0 rc 0/0
00000400:00000200:22.0:1773851854.950342:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18305@kfi7: PUT: OK
00000400:00000200:22.0:1773851854.950343:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098c60bd6
00000400:00000010:22.0:1773851854.950343:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098c60bd6.
00000100:00100000:21.0:1773851854.950344:0:41144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18304@kfi7, seq: 37871501
00000100:00000001:22.0:1773851854.950345:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851854.950345:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:21.0:1773851854.950345:0:41144:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e953d29d : new rpc_count 0
00000400:00000200:22.0:1773851854.950346:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c45c1aa2 nid 18305@kfi7 refs 2
00000100:00000001:21.0:1773851854.950346:0:41144:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851854.950347:0:41144:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:21.0:1773851854.950347:0:41144:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a03aa828.
00000800:00000200:22.0:1773851854.950348:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008c4261a5: 2054@kfi7:5 -> 18305@kfi7(00000000d5ca31ef):0x0 lsk 3069 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000bfc Transaction freed
00000020:00000010:21.0:1773851854.950348:0:41144:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000104460d.
00000020:00000010:21.0:1773851854.950349:0:41144:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004cfa686b.
00000020:00000040:21.0:1773851854.950350:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000e953d29d : new refcount 5
02000000:00000001:21.0:1773851854.950352:0:41144:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:21.0:1773851854.950353:0:41144:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f06186fb.
02000000:00000001:21.0:1773851854.950353:0:41144:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
02000000:00000001:21.0:1773851854.950354:0:41144:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:21.0:1773851854.950354:0:41144:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b48ef36e.
02000000:00000001:21.0:1773851854.950355:0:41144:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:21.0:1773851854.950356:0:41144:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005954abd8.
02000000:00000001:21.0:1773851854.950357:0:41144:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:21.0:1773851854.950357:0:41144:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000845eb89.
02000000:00000001:21.0:1773851854.950358:0:41144:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:21.0:1773851854.950358:0:41144:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e508b29.
02000000:00000001:21.0:1773851854.950360:0:41144:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:21.0:1773851854.950360:0:41144:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000088deefd1.
02000000:00000001:21.0:1773851854.950361:0:41144:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:21.0:1773851854.950361:0:41144:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e56070dc.
02000000:00000001:21.0:1773851854.950363:0:41144:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:21.0:1773851854.950364:0:41144:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007a2bd4f1.
02000000:00000001:21.0:1773851854.950365:0:41144:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:21.0:1773851854.950365:0:41144:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006eb3f4ce.
02000000:00000001:21.0:1773851854.950367:0:41144:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:21.0:1773851854.950367:0:41144:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d7b4be7.
02000000:00000001:21.0:1773851854.950368:0:41144:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:21.0:1773851854.950368:0:41144:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000033a05165.
00000100:00000001:21.0:1773851854.950370:0:41144:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:21.0:1773851854.950371:0:41144:0:(niobuf.c:993:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17
00000400:00000010:21.0:1773851854.950372:0:41144:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000625bce57.
00000400:00000010:21.0:1773851854.950374:0:41144:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 000000000c93fd07 (tot 253200771).
00010000:00000010:21.1F:1773851854.955727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000fcaf5765.
00010000:00000010:21.1:1773851854.955729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f315dcef.
00010000:00000010:21.1:1773851854.955730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000017380f27.
00010000:00000001:2.0:1773851854.985736:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985737:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851854.985739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851854.985740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851854.985742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851854.985743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851854.985745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851854.985747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851854.985749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851854.985749:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851854.985755:0:937835:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:29.0:1773851854.985756:0:937835:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851854.985756:0:937835:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851855.025009:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851855.025010:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851855.025011:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851855.025013:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851855.025015:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20337@kfi7 to cpt 6
00000400:00000200:25.0:1773851855.025017:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20337@kfi7 : PUT - for me
00000400:00000200:25.0:1773851855.025017:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20337@kfi7 to cpt 6
00000400:00000200:25.0:1773851855.025018:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9257b4b nid 20337@kfi7 refs 1
00000400:00000200:25.0:1773851855.025019:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20337@kfi7 to cpt 6
00000400:00000200:25.0:1773851855.025020:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9257b4b nid 20337@kfi7 refs 2
00000400:00000200:25.0:1773851855.025021:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a9257b4b nid 20337@kfi7 refs 3
00000400:00000200:25.0:1773851855.025021:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20337@kfi7 to cpt 6
00000400:00000200:25.0:1773851855.025022:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20337@kfi7 of length 224 into portal 12 MB=0x69b81bfd30680
00000400:00000200:25.0:1773851855.025023:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20337@kfi7 of length 224/224 into md 0x16159c6179 [64] + 180584
00000800:00000200:25.0:1773851855.025025:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851855.025027:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851855.025027:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20337@kfi7: PUT: OK
00000100:00000001:25.0:1773851855.025028:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851855.025029:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851855.025029:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004c01fc4.
00000100:00000040:25.0:1773851855.025030:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000004c01fc4 x1859831431628416 msgsize 224
00000100:00100000:25.0:1773851855.025031:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20337@kfi7 (source: 12345-20337@kfi7)
00000100:00000001:25.0:1773851855.025032:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851855.025033:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851855.025033:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9257b4b nid 20337@kfi7 refs 2
02000000:00000001:26.0:1773851855.025034:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851855.025034:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851855.025035:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851855.025035:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851855.025036:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851855.025037:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831431628416
00000020:00000001:26.0:1773851855.025037:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851855.025038:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce631c1
00000020:00000001:26.0:1773851855.025038:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851855.025043:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b70ec961 refcount=3936
00000020:00000001:26.0:1773851855.025044:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123795911680 : -106949913639936 : ffff9ebac8638400)
00000020:00000001:26.0:1773851855.025045:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123795911680 : -106949913639936 : ffff9ebac8638400)
00000100:00000001:26.0:1773851855.025046:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851855.025047:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851855.025047:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000608ed6cb.
00000020:00000010:26.0:1773851855.025048:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851855.025049:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6ffcbe8.
00000100:00000001:26.0:1773851855.025050:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851855.025050:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851855.025051:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851855.025052:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851855.025053:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851855.025053:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.025054:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851855.025055:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851855.025055:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851855.025056:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851855.025056:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851855.025057:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20337@kfi7, seq: 2025047
00000100:00000040:26.0:1773851855.025057:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b70ec961 : new rpc_count 18
00000100:00000001:24.0:1773851855.025057:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.025058:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150699904 : -106980558851712 : ffff9eb3a5cab180)
00000100:00000001:24.0:1773851855.025058:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851855.025059:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000004c01fc4 x1859831431628416/t0(0) o400->7130084e-73c0-4912-ad5f-4a092c069c65@20337@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1758-0'
00000100:00000001:26.0:1773851855.025062:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851855.025062:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851855.025063:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004c01fc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7130084e-73c0-4912-ad5f-4a092c069c65+3936:39470:x1859831431628416:12345-20337@kfi7:400:default-tuolumne1758-0
00000100:00000200:26.0:1773851855.025064:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831431628416
00000020:00000001:26.0:1773851855.025065:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851855.025066:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851855.025066:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.025067:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851855.025067:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851855.025068:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851855.025069:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831431628416, found 0 last_xid 1859831430869055
00000020:00000001:26.0:1773851855.025070:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851855.025070:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851855.025071:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851855.025071:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.025072:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851855.025072:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851855.025073:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851855.025074:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f28122c3.
02000000:00000001:26.0:1773851855.025075:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.025075:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.025076:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851855.025077:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593304, transno 0, xid 1859831431628416
00010000:00000001:26.0:1773851855.025077:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851855.025078:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000004c01fc4 x1859831431628416/t0(0) o400->7130084e-73c0-4912-ad5f-4a092c069c65@20337@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1758-0'
00010000:00000001:26.0:1773851855.025080:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851855.025081:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851855.025082:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=88 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851855.025083:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851855.025083:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a24d21d5 refcount 3 to 20337@kfi7
00000100:00000001:26.0:1773851855.025084:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329376 : -107155410222240 : ffff9e8aefd68360)
02000000:00000001:26.0:1773851855.025085:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851855.025085:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.025086:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851855.025087:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20337@kfi7
00000400:00000010:26.0:1773851855.025088:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000394249d0.
00000100:00000200:26.0:1773851855.025088:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831431628416, offset 224
00000400:00000200:26.0:1773851855.025089:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20337@kfi7
00000400:00000200:26.0:1773851855.025090:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20337@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.025091:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9257b4b nid 20337@kfi7 refs 1
00000400:00000200:26.0:1773851855.025092:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a9257b4b nid 20337@kfi7 refs 2
00000400:00000200:26.0:1773851855.025093:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a9257b4b nid 20337@kfi7 refs 3
00000400:00000200:26.0:1773851855.025094:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20337@kfi7 local destination
00000400:00000200:26.0:1773851855.025095:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768630:8768630:1024:4294967295] 20337@kfi7 LPNI seq info [8058906:8058906:16:4294967295]
00000400:00000200:26.0:1773851855.025096:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a9257b4b nid 20337@kfi7 refs 2
00000400:00000200:26.0:1773851855.025097:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20337@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.025100:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20337@kfi7(20337@kfi7:20337@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851855.025101:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a9257b4b nid 20337@kfi7 refs 3
00000800:00000200:26.0:1773851855.025102:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851855.025103:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851855.025106:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851855.025108:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003e4 Using peer 20337@kfi7(0x1000000000003e4)
00000800:00000200:26.0:1773851855.025111:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001c682e34: Posted send of 324 bytes to peer 0x1000000000003e4: rc=0
00000800:00000200:26.0:1773851855.025112:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003e4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851855.025114:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851855.025115:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a24d21d5 refcount 2 to 20337@kfi7
00010000:00000001:26.0:1773851855.025116:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851855.025116:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.025117:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851855.025118:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000004c01fc4 x1859831431628416/t0(0) o400->7130084e-73c0-4912-ad5f-4a092c069c65@20337@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1758-0'
00000100:00100000:26.0:1773851855.025121:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004c01fc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7130084e-73c0-4912-ad5f-4a092c069c65+3936:39470:x1859831431628416:12345-20337@kfi7:400:default-tuolumne1758-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851855.025123:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20337@kfi7, seq: 2025047
00000100:00000040:26.0:1773851855.025124:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b70ec961 : new rpc_count 17
00000100:00000001:26.0:1773851855.025124:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851855.025124:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003e4 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851855.025125:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851855.025125:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851855.025125:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851855.025126:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6ffcbe8.
00000020:00000010:26.0:1773851855.025127:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000608ed6cb.
00000400:00000200:25.0:1773851855.025127:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20337@kfi7: PUT: OK
00000400:00000200:25.0:1773851855.025127:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000394249d0
00000020:00000040:26.0:1773851855.025128:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000b70ec961 : new refcount 3935
00000100:00000001:26.0:1773851855.025128:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851855.025128:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000394249d0.
00000100:00000001:25.0:1773851855.025128:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851855.025129:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851855.025130:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9257b4b nid 20337@kfi7 refs 2
00000800:00000200:25.0:1773851855.025131:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 20337@kfi7(000000009be15e3c):0x0 lsk 997 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003e4 Transaction freed
00000800:00000200:29.0:1773851855.028755:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.028755:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.028757:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.028759:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851855.028761:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.028763:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12944@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.028763:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.028765:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 1
00000400:00000200:29.0:1773851855.028767:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.028767:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000400:00000200:29.0:1773851855.028768:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 3
00000400:00000200:29.0:1773851855.028769:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.028770:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12944@kfi7 of length 224 into portal 12 MB=0x69b4b57c18200
00000400:00000200:29.0:1773851855.028771:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12944@kfi7 of length 224/224 into md 0x77fe139dd [64] + 162240
00000800:00000200:29.0:1773851855.028773:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851855.028775:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.028776:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12944@kfi7: PUT: OK
00000100:00000001:29.0:1773851855.028777:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851855.028777:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851855.028778:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ceec6c49.
00000100:00000040:29.0:1773851855.028779:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ceec6c49 x1859597757415936 msgsize 224
00000100:00100000:29.0:1773851855.028780:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12944@kfi7 (source: 12345-12944@kfi7)
00000100:00000001:29.0:1773851855.028781:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851855.028782:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000100:00000001:31.0:1773851855.028783:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851855.028783:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851855.028784:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851855.028784:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851855.028785:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851855.028785:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00100000:31.0:1773851855.028786:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597757415936
00000020:00000001:31.0:1773851855.028786:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851855.028787:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ed39
00000020:00000001:31.0:1773851855.028787:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851855.028790:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071c91787 refcount=5
00000020:00000001:31.0:1773851855.028791:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959017488384 : -107114692063232 : ffff9e946ad45000)
00000020:00000001:31.0:1773851855.028792:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959017488384 : -107114692063232 : ffff9e946ad45000)
00000100:00000001:31.0:1773851855.028793:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851855.028794:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851855.028794:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025d2a996.
00000020:00000010:31.0:1773851855.028795:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851855.028796:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851855.028797:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851855.028797:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851855.028798:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.028798:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851855.028799:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851855.028799:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.028800:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.028801:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.028802:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851855.028802:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851855.028802:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851855.028803:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12944@kfi7, seq: 2055462
00000100:00000040:31.0:1773851855.028803:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071c91787 : new rpc_count 1
00000100:00000001:31.0:1773851855.028804:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165180404608 : -106908529147008 : ffff9ec46b18c380)
00000100:00000001:29.0:1773851855.028804:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851855.028804:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851855.028805:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ceec6c49 x1859597757415936/t0(0) o400->6b7746ca-91e9-4383-8baa-701498855e5a@12944@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1298-0'
00000100:00000001:31.0:1773851855.028808:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851855.028809:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851855.028810:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ceec6c49 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6b7746ca-91e9-4383-8baa-701498855e5a+5:39542:x1859597757415936:12345-12944@kfi7:400:default-tuolumne1298-0
00000100:00000200:31.0:1773851855.028811:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597757415936
00000020:00000001:31.0:1773851855.028812:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851855.028812:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851855.028813:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.028813:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851855.028814:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851855.028815:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851855.028815:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597757415936, found 0 last_xid 1859597757415935
00000020:00000001:31.0:1773851855.028816:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851855.028819:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851855.028820:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851855.028820:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.028821:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851855.028822:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851855.028822:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851855.028823:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000032ef3259.
02000000:00000001:31.0:1773851855.028823:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.028824:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.028825:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851855.028825:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096685241, transno 0, xid 1859597757415936
00010000:00000001:31.0:1773851855.028826:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851855.028827:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ceec6c49 x1859597757415936/t0(0) o400->6b7746ca-91e9-4383-8baa-701498855e5a@12944@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1298-0'
00010000:00000001:31.0:1773851855.028829:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851855.028830:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851855.028830:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851855.028831:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851855.028832:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b450b4a refcount 3 to 12944@kfi7
00000100:00000001:31.0:1773851855.028833:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636956444310240 : -107117265241376 : ffff9e93d174bae0)
02000000:00000001:31.0:1773851855.028833:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851855.028834:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.028835:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851855.028836:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12944@kfi7
00000400:00000010:31.0:1773851855.028836:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001af55591.
00000100:00000200:31.0:1773851855.028837:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597757415936, offset 224
00000400:00000200:31.0:1773851855.028838:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12944@kfi7
00000400:00000200:31.0:1773851855.028839:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:31.0:1773851855.028840:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 1
00000400:00000200:31.0:1773851855.028841:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000400:00000200:31.0:1773851855.028842:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 3
00000400:00000200:31.0:1773851855.028843:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12944@kfi7 local destination
00000400:00000200:31.0:1773851855.028844:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768631:8768631:1024:4294967295] 12944@kfi7 LPNI seq info [376601:376601:16:4294967295]
00000400:00000200:31.0:1773851855.028845:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000400:00000200:31.0:1773851855.028847:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:31.0:1773851855.028849:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12944@kfi7(12944@kfi7:12944@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851855.028850:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 3
00000800:00000200:31.0:1773851855.028851:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851855.028852:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851855.028855:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851855.028857:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x9d7 Using peer 12944@kfi7(0x9d7)
00000800:00000200:31.0:1773851855.028860:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x9d7: rc=0
00000800:00000200:31.0:1773851855.028861:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x9d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851855.028863:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851855.028864:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b450b4a refcount 2 to 12944@kfi7
00010000:00000001:31.0:1773851855.028864:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851855.028865:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.028866:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851855.028866:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ceec6c49 x1859597757415936/t0(0) o400->6b7746ca-91e9-4383-8baa-701498855e5a@12944@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1298-0'
00000100:00100000:31.0:1773851855.028869:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ceec6c49 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6b7746ca-91e9-4383-8baa-701498855e5a+5:39542:x1859597757415936:12345-12944@kfi7:400:default-tuolumne1298-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851855.028872:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12944@kfi7, seq: 2055462
00000100:00000040:31.0:1773851855.028872:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071c91787 : new rpc_count 0
00000100:00000001:31.0:1773851855.028873:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851855.028873:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851855.028873:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x9d7 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851855.028874:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851855.028875:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851855.028875:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025d2a996.
00000400:00000200:29.0:1773851855.028875:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851855.028876:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000071c91787 : new refcount 4
00000400:00000200:29.0:1773851855.028876:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12944@kfi7: PUT: OK
00000100:00000001:31.0:1773851855.028877:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851855.028877:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001af55591
00000400:00000010:29.0:1773851855.028877:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001af55591.
00000100:00000001:29.0:1773851855.028878:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851855.028878:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851855.028879:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000800:00000200:29.0:1773851855.028881:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12944@kfi7(0000000052578c80):0x0 lsk 2520 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x9d7 Transaction freed
00000800:00000200:26.0:1773851855.126243:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851855.126243:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851855.126244:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851855.126244:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851855.126245:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851855.126246:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851855.126247:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21392@kfi7(0000000019a5d949):0x2a9 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851855.126249:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 Using peer 21392@kfi7(0x1000000000002a9)
00000800:00000200:26.0:1773851855.126250:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851855.126251:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.126252:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000800:00000200:25.0:1773851855.126252:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x1000000000002a9: rc=0
00000400:00000200:26.0:1773851855.126253:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21392@kfi7 : PUT - for me
00000400:00000200:26.0:1773851855.126254:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000800:00000200:25.0:1773851855.126254:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851855.126255:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 1
00000400:00000200:26.0:1773851855.126256:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.126256:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000400:00000200:26.0:1773851855.126258:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 3
00000400:00000200:26.0:1773851855.126259:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21393@kfi7 to cpt 1
00000400:00000200:26.0:1773851855.126259:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21393@kfi7 of length 576 into portal 12 MB=0x699e0e1307700
00000400:00000200:26.0:1773851855.126261:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21393@kfi7 of length 576/576 into md 0x16159c6179 [64] + 180808
00000800:00000200:26.0:1773851855.126263:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851855.126265:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851855.126265:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851855.126266:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21392@kfi7: PUT: OK
00000100:00000001:26.0:1773851855.126267:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851855.126267:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851855.126268:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a7622945.
00000800:00000200:25.0:1773851855.126268:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 Transaction freed
00000100:00000040:26.0:1773851855.126269:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000a7622945 x1858040990037760 msgsize 576
00000100:00100000:26.0:1773851855.126270:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-21393@kfi7 (source: 12345-21392@kfi7)
00000100:00000001:26.0:1773851855.126272:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851855.126273:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000800:00000200:26.0:1773851855.126274:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851855.126277:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851855.126278:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851855.126278:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851855.126279:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851855.126279:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851855.126280:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040990037760
00000020:00000001:26.0:1773851855.126281:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851855.126282:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914ad
00000020:00000001:26.0:1773851855.126282:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851855.126286:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000840913ea refcount=6
00000020:00000001:26.0:1773851855.126287:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240792064 : -107152468759552 : ffff9e8b9f29ac00)
00000020:00000001:26.0:1773851855.126288:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240792064 : -107152468759552 : ffff9e8b9f29ac00)
00000100:00000001:26.0:1773851855.126289:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851855.126290:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851855.126290:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000608ed6cb.
00000020:00000010:26.0:1773851855.126291:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851855.126292:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6ffcbe8.
00000100:00000001:26.0:1773851855.126293:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851855.126293:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:26.0:1773851855.126294:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:26.0:1773851855.126294:0:41182:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.126295:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.126296:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.126297:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851855.126298:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851855.126298:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851855.126299:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851855.126299:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851855.126300:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21393@kfi7, seq: 1451911029
00000100:00000040:26.0:1773851855.126300:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000840913ea : new rpc_count 1
00000100:00000001:26.0:1773851855.126301:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538617856 : -106958170933760 : ffff9eb8dc373600)
00000100:00000001:24.0:1773851855.126301:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.126301:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851855.126302:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a7622945 x1858040990037760/t0(0) o101->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:582/0 lens 576/0 e 0 to 0 dl 1773851942 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-832052957968075776'
00000100:00000001:26.0:1773851855.126305:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851855.126305:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851855.126306:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7622945 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:0be85a48-c251-410d-838d-23bdfd7e98c7+6:2297909:x1858040990037760:12345-21393@kfi7:101:tuolumne-832052957968075776
00000100:00000200:26.0:1773851855.126308:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040990037760
00000020:00000001:26.0:1773851855.126308:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851855.126309:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851855.126310:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.126311:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851855.126312:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:26.0:1773851855.126313:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851855.126313:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040990037760, found 0 last_xid 1858040990037759
00000020:00000001:26.0:1773851855.126314:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851855.126315:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851855.126315:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851855.126316:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.126316:0:41182:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:26.0:1773851855.126317:0:41182:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:26.0:1773851855.126318:0:41182:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:26.0:1773851855.126318:0:41182:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:26.0:1773851855.126319:0:41182:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851855.126322:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851855.126325:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 18
00010000:00000001:26.0:1773851855.126326:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851855.126327:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851855.126327:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000056845fce.
00000020:00000001:26.0:1773851855.126328:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851855.126330:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000056845fce with handle 0x21b6f08f07a6acc1 to hash
00000020:00000001:26.0:1773851855.126330:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851855.126331:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637028277643968 : -107045431907648 : ffff9ea48b0e6ac0)
00010000:00000010:26.0:1773851855.126332:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000002e11f02b.
00010000:00000001:26.0:1773851855.126333:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637028277643968 : -107045431907648 : ffff9ea48b0e6ac0)
00010000:00010000:26.0:1773851855.126334:0:41182:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000056845fce/0x21b6f08f07a6acc1 lrc: 2/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x21b9c71b2096562b expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126337:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 18
00010000:00000040:26.0:1773851855.126338:0:41182:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000840913ea : new locks_count 1
00000020:00000040:26.0:1773851855.126339:0:41182:0:(genops.c:871:class_export_get()) GET export 00000000840913ea refcount=7
00010000:00000001:26.0:1773851855.126341:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:26.0:1773851855.126341:0:41182:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:26.0:1773851855.126343:0:41182:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:26.0:1773851855.126343:0:41182:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:26.0:1773851855.126344:0:41182:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:26.0:1773851855.126345:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:26.0:1773851855.126346:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400276f1:0x9609:0x0]
00000020:00000001:26.0:1773851855.126347:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:26.0:1773851855.126348:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637105610757464 : -106968098794152 : ffff9eb68c781558)
00000004:00000001:26.0:1773851855.126349:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637105610757376 : -106968098794240 : ffff9eb68c781500)
00000004:00000001:26.0:1773851855.126350:0:41182:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126351:0:41182:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:26.0:1773851855.126351:0:41182:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:26.0:1773851855.126352:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851855.126353:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851855.126355:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000a514a942.
02000000:00000001:26.0:1773851855.126355:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.126356:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126356:0:41182:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126357:0:41182:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:26.0:1773851855.126358:0:41182:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:26.0:1773851855.126359:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851855.126360:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851855.126361:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851855.126361:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:26.0:1773851855.126362:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851855.126362:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:26.0:1773851855.126363:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851855.126363:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:26.0:1773851855.126364:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851855.126364:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
02000000:00000001:26.0:1773851855.126365:0:41182:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:26.0:1773851855.126366:0:41182:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637071493641344 : -107002215910272 : ffff9eae9aee3480)
00000004:00000001:26.0:1773851855.126367:0:41182:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:26.0:1773851855.126367:0:41182:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851855.126368:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851855.126369:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126369:0:41182:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:26.0:1773851855.126370:0:41182:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126371:0:41182:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:26.0:1773851855.126372:0:41182:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x2400276f1:0x9609:0x0], ldlm_rep = 00000000f9bf82b1
00000004:00000001:26.0:1773851855.126373:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:26.0:1773851855.126374:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:26.0:1773851855.126375:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:26.0:1773851855.126375:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851855.126376:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 19
00010000:00000001:26.0:1773851855.126376:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851855.126377:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851855.126377:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000142763aa.
00000020:00000001:26.0:1773851855.126378:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851855.126379:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000142763aa with handle 0x21b6f08f07a6acc8 to hash
00000020:00000001:26.0:1773851855.126379:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851855.126380:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637028277648576 : -107045431903040 : ffff9ea48b0e7cc0)
00010000:00000010:26.0:1773851855.126380:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000096a5fedd.
00010000:00000001:26.0:1773851855.126381:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637028277648576 : -107045431903040 : ffff9ea48b0e7cc0)
00010000:00000001:26.0:1773851855.126382:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851855.126383:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851855.126383:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000142763aa/0x21b6f08f07a6acc8 lrc: 3/1,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126386:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000001:26.0:1773851855.126387:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:26.0:1773851855.126388:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:26.0:1773851855.126388:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:26.0:1773851855.126389:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851855.126390:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851855.126391:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851855.126391:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851855.126392:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:26.0:1773851855.126393:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:26.0:1773851855.126393:0:41182:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:26.0:1773851855.126394:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:26.0:1773851855.126394:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb) refcount = 19
00010000:00000040:26.0:1773851855.126396:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:26.0:1773851855.126397:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd6a9637/0x21b6f08f07a6ab0f lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 15297@kfi7 remote: 0x2a385bf44de18475 expref: 7 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126400:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126402:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c415d6e/0x21b6f08f07a6a54a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 20785@kfi7 remote: 0x99860d9ed9853cd4 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126404:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126405:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000832de5a3/0x21b6f08f07a6a26b lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 23601@kfi7 remote: 0xce07d8f4f3aa40e1 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126407:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126408:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000059acec9a/0x21b6f08f07a67ffe lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21826@kfi7 remote: 0x177c482190197e35 expref: 7 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126410:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126411:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf485bd3/0x21b6f08f07a67dce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 16017@kfi7 remote: 0x6f0957fcc2016c01 expref: 6 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126414:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126415:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5320073/0x21b6f08f07a67998 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21298@kfi7 remote: 0x5a56a05cb8a8b31d expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126417:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126419:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016423bf5/0x21b6f08f07a6782c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21936@kfi7 remote: 0xb4fb780a561291c3 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126421:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126422:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b934f1e/0x21b6f08f07a66f6c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 23634@kfi7 remote: 0x7c0da7673655e6bb expref: 7 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126424:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126426:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fecbf600/0x21b6f08f07a66f26 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 16257@kfi7 remote: 0x757acea6a351db8a expref: 6 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126428:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126430:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7dcf18c/0x21b6f08f07a66ed9 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 13714@kfi7 remote: 0xe6fc6ed572595da9 expref: 6 pid: 61083 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126432:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126433:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010fa0ac0/0x21b6f08f07a6315a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 22450@kfi7 remote: 0x5c0bf53c716f4467 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126435:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126436:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008f335fab/0x21b6f08f07a5d4bd lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 20706@kfi7 remote: 0xee4f431a41d43936 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126438:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126439:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e2ad57/0x21b6f08f07a5d477 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 18867@kfi7 remote: 0x6f0fd12f6ddf8254 expref: 6 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126441:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126443:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a82f52ea/0x21b6f08f07a58b7c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21216@kfi7 remote: 0xce2ef96babfa3e25 expref: 7 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126445:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126446:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bbc818af/0x21b6f08ef3d9b2ce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 23153@kfi7 remote: 0xc70354b40450ada2 expref: 56 pid: 61192 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126448:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126449:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c3684a3/0x21b6f08ef35f0f50 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 18962@kfi7 remote: 0xc8dab5ae9bddf110 expref: 60 pid: 60739 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126451:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126452:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9d1f20f/0x21b6f08eeeedea42 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 9792@kfi7 remote: 0x7f4e1c592d72496c expref: 59 pid: 61066 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126455:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00010000:26.0:1773851855.126456:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000142763aa/0x21b6f08f07a6acc8 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126458:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000001:26.0:1773851855.126459:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:26.0:1773851855.126459:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851855.126460:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851855.126461:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:26.0:1773851855.126461:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851855.126462:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851855.126463:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851855.126464:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:26.0:1773851855.126464:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851855.126465:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000142763aa/0x21b6f08f07a6acc8 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126467:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000001:26.0:1773851855.126468:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:26.0:1773851855.126468:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851855.126469:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851855.126469:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851855.126470:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851855.126470:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000142763aa refcount=3
00000020:00000001:26.0:1773851855.126471:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277648576 : -107045431903040 : ffff9ea48b0e7cc0)
00010000:00000001:26.0:1773851855.126471:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277648576 : -107045431903040 : ffff9ea48b0e7cc0)
00010000:00000001:26.0:1773851855.126472:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851855.126472:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851855.126473:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126473:0:41182:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126475:0:41182:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:26.0:1773851855.126476:0:41182:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:26.0:1773851855.126477:0:41182:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:26.0:1773851855.126486:0:41182:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126487:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851855.126489:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851855.126489:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851855.126491:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126492:0:41182:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126493:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126493:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851855.126494:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851855.126494:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851855.126495:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126495:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126496:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:26.0:1773851855.126497:0:41182:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:26.0:1773851855.126498:0:41182:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851855.126498:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851855.126499:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851855.126499:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851855.126500:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:26.0:1773851855.126500:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851855.126501:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:26.0:1773851855.126501:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851855.126502:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:26.0:1773851855.126502:0:41182:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x2400276f1:0x9609:0x0]: nlink=4, mode=40755, valid=0x1100000000002f8f
00000004:00200000:26.0:1773851855.126504:0:41182:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400276f1:0x9609:0x0]: returning size 37888
00000004:00200000:26.0:1773851855.126505:0:41182:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 6
00000004:00000002:26.0:1773851855.126505:0:41182:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:26.0:1773851855.126506:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851855.126506:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126507:0:41182:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:26.0:1773851855.126507:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851855.126508:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851855.126508:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851855.126509:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126509:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126511:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851855.126511:0:41182:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.126512:0:41182:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:26.0:1773851855.126515:0:41182:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126516:0:41182:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126518:0:41182:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851855.126519:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851855.126519:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851855.126520:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000142763aa refcount=3
00000020:00000001:26.0:1773851855.126520:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277648576 : -107045431903040 : ffff9ea48b0e7cc0)
00010000:00000001:26.0:1773851855.126521:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277648576 : -107045431903040 : ffff9ea48b0e7cc0)
00000004:00000040:26.0:1773851855.126522:0:41182:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000840913ea : new locks_count 2
00000020:00000040:26.0:1773851855.126523:0:41182:0:(genops.c:871:class_export_get()) GET export 00000000840913ea refcount=8
00010000:00000001:26.0:1773851855.126523:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851855.126524:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851855.126524:0:41182:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851855.126525:0:41182:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:26.0:1773851855.126526:0:41182:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:26.0:1773851855.126526:0:41182:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:26.0:1773851855.126527:0:41182:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:26.0:1773851855.126527:0:41182:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:26.0:1773851855.126528:0:41182:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:26.0:1773851855.126529:0:41182:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:26.0:1773851855.126530:0:41182:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851855.126531:0:41182:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851855.126531:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:26.0:1773851855.126532:0:41182:0:(lu_object.c:224:lu_object_put()) Add 000000007e72d379/000000009c9aae14 to site lru. bkt: 000000005a7eb874
00000004:00000001:26.0:1773851855.126533:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:26.0:1773851855.126534:0:41182:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:26.0:1773851855.126534:0:41182:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:26.0:1773851855.126535:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851855.126536:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851855.126536:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851855.126536:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851855.126537:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851855.126538:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000056845fce with handle 0x21b6f08f07a6acc1 from hash
00010000:00000001:26.0:1773851855.126541:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851855.126541:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851855.126542:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851855.126542:0:41182:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:26.0:1773851855.126543:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851855.126543:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000056845fce/0x21b6f08f07a6acc1 lrc: 0/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x1/0x0 rrc: 20 type: IBT gid 0 flags: 0x44000000000000 nid: 21393@kfi7 remote: 0x21b9c71b2096562b expref: 8 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126545:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:26.0:1773851855.126546:0:41182:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000840913ea : new locks_count 1
00000020:00000040:26.0:1773851855.126547:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000840913ea : new refcount 7
00010000:00000010:26.0:1773851855.126548:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002e11f02b.
00010000:00000040:26.0:1773851855.126549:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 18
00010000:00000001:26.0:1773851855.126549:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851855.126550:0:41182:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851855.126551:0:41182:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:26.0:1773851855.126551:0:41182:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000142763aa/0x21b6f08f07a6acc8 lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 21393@kfi7 remote: 0x21b9c71b2096562b expref: 7 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851855.126554:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 18
00010000:00000001:26.0:1773851855.126555:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851855.126555:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851855.126556:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb)
00010000:00010000:26.0:1773851855.126557:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10
00010000:00000001:26.0:1773851855.126558:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851855.126559:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851855.126559:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:26.0:1773851855.126560:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851855.126560:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:26.0:1773851855.126561:0:41182:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000142763aa, rc 0)
00000020:00000001:26.0:1773851855.126562:0:41182:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851855.126563:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044109179, transno 0, xid 1858040990037760
00010000:00000001:26.0:1773851855.126563:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851855.126564:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a7622945 x1858040990037760/t0(0) o101->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:582/0 lens 576/640 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832052957968075776'
00010000:00000001:26.0:1773851855.126567:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851855.126568:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851855.126569:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=88 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851855.126570:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851855.126570:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000969e3622 refcount 3 to 21393@kfi7
00000100:00000001:26.0:1773851855.126571:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612512 : -107130477939104 : ffff9e90bdeaf660)
02000000:00000001:26.0:1773851855.126572:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851855.126572:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.126573:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851855.126574:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21392@kfi7
00000400:00000010:26.0:1773851855.126575:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000007a61ab6.
00000100:00000200:26.0:1773851855.126575:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858040990037760, offset 224
00000400:00000200:26.0:1773851855.126577:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21392@kfi7
00000400:00000200:26.0:1773851855.126578:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.126578:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 1
00000400:00000200:26.0:1773851855.126579:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000400:00000200:26.0:1773851855.126580:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 3
00000400:00000200:26.0:1773851855.126581:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21392@kfi7 local destination
00000400:00000200:26.0:1773851855.126583:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768632:8768632:1024:4294967295] 21392@kfi7 LPNI seq info [1131114:1131114:16:4294967295]
00000400:00000200:26.0:1773851855.126584:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000400:00000200:26.0:1773851855.126585:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.126587:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21392@kfi7(21392@kfi7:21392@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851855.126588:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 3
00000800:00000200:26.0:1773851855.126589:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851855.126591:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:26.0:1773851855.126593:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851855.126595:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 Using peer 21392@kfi7(0x1000000000002a9)
00000800:00000200:26.0:1773851855.126600:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 740 bytes to peer 0x1000000000002a9: rc=0
00000800:00000200:26.0:1773851855.126601:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851855.126603:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851855.126604:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000969e3622 refcount 2 to 21393@kfi7
00010000:00000001:26.0:1773851855.126605:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851855.126605:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.126606:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851855.126607:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a7622945 x1858040990037760/t0(0) o101->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:582/0 lens 576/640 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832052957968075776'
00000100:00100000:26.0:1773851855.126610:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7622945 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:0be85a48-c251-410d-838d-23bdfd7e98c7+7:2297909:x1858040990037760:12345-21393@kfi7:101:tuolumne-832052957968075776 Request processed in 304us (340us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851855.126612:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851855.126613:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21393@kfi7, seq: 1451911029
00000100:00000040:26.0:1773851855.126614:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000840913ea : new rpc_count 0
00000100:00000001:26.0:1773851855.126614:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851855.126614:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851855.126614:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21392@kfi7: PUT: OK
00000100:00000001:26.0:1773851855.126615:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851855.126615:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851855.126615:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000007a61ab6
00000020:00000010:26.0:1773851855.126616:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6ffcbe8.
00000400:00000010:25.0:1773851855.126616:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000007a61ab6.
00000100:00000001:25.0:1773851855.126616:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:26.0:1773851855.126617:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000608ed6cb.
00000100:00000001:25.0:1773851855.126617:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851855.126617:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000020:00000040:26.0:1773851855.126618:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000840913ea : new refcount 6
00000100:00000001:26.0:1773851855.126618:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851855.126619:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 21392@kfi7(0000000019a5d949):0x0 lsk 682 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002a9 Transaction freed
00000800:00000200:25.0:1773851855.126681:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851855.126682:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851855.126682:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851855.126683:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851855.126684:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851855.126684:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851855.126686:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21392@kfi7(00000000f84f3c5f):0xc67 version: 2; local version 2; negotiated version: 2
00000800:00000200:27.0:1773851855.126687:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851855.126687:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 Using peer 21392@kfi7(0xc67)
00000400:00000200:25.0:1773851855.126689:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:27.0:1773851855.126690:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:27.0:1773851855.126691:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21392@kfi7 : PUT - for me
00000800:00000200:25.0:1773851855.126691:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0xc67: rc=0
00000400:00000200:27.0:1773851855.126692:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000800:00000200:25.0:1773851855.126692:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851855.126693:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 1
00000400:00000200:27.0:1773851855.126694:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:27.0:1773851855.126695:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000400:00000200:27.0:1773851855.126696:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 3
00000400:00000200:27.0:1773851855.126697:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21393@kfi7 to cpt 1
00000400:00000200:27.0:1773851855.126698:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21393@kfi7 of length 584 into portal 12 MB=0x699e0e1307740
00000400:00000200:27.0:1773851855.126699:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21393@kfi7 of length 584/584 into md 0x16159c6179 [64] + 181384
00000800:00000200:27.0:1773851855.126701:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006faf1aef: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851855.126703:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851855.126703:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851855.126704:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21392@kfi7: PUT: OK
00000100:00000001:27.0:1773851855.126705:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851855.126705:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851855.126705:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 Transaction freed
00000100:00000010:27.0:1773851855.126706:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000944814f9.
00000100:00000040:27.0:1773851855.126707:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000944814f9 x1858040990037824 msgsize 584
00000100:00100000:27.0:1773851855.126709:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-21393@kfi7 (source: 12345-21392@kfi7)
00000100:00000001:27.0:1773851855.126710:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851855.126711:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000100:00000001:26.0:1773851855.126711:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851855.126711:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851855.126711:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851855.126712:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851855.126713:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006faf1aef: 2069@kfi7:6 <- 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851855.126713:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851855.126713:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040990037824
00000020:00000001:26.0:1773851855.126714:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851855.126714:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914ad
00000020:00000001:26.0:1773851855.126715:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851855.126715:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000840913ea refcount=7
00000020:00000001:26.0:1773851855.126716:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240792064 : -107152468759552 : ffff9e8b9f29ac00)
00000020:00000001:26.0:1773851855.126717:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240792064 : -107152468759552 : ffff9e8b9f29ac00)
00000100:00000001:26.0:1773851855.126718:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851855.126718:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851855.126719:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000608ed6cb.
00000020:00000010:26.0:1773851855.126720:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851855.126720:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6ffcbe8.
00000100:00000001:26.0:1773851855.126721:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851855.126721:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:26.0:1773851855.126722:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:26.0:1773851855.126722:0:41182:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.126723:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.126724:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.126726:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851855.126727:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851855.126728:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:24.0:1773851855.126728:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21393@kfi7, seq: 1451911030
00000100:00000040:24.0:1773851855.126729:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000840913ea : new rpc_count 1
00000100:00000001:24.0:1773851855.126729:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998407808 : -107053711143808 : ffff9ea29d934c80)
00000100:00000040:24.0:1773851855.126730:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000944814f9 x1858040990037824/t0(0) o101->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:136/0 lens 584/0 e 0 to 0 dl 1773852251 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-832052957968075776'
00000100:00000001:24.0:1773851855.126733:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851855.126734:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851855.126734:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000944814f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:0be85a48-c251-410d-838d-23bdfd7e98c7+7:2297909:x1858040990037824:12345-21393@kfi7:101:tuolumne-832052957968075776
00000100:00000200:24.0:1773851855.126736:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040990037824
00000020:00000001:24.0:1773851855.126738:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851855.126738:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851855.126739:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.126739:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851855.126740:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:24.0:1773851855.126740:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851855.126741:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040990037824, found 0 last_xid 1858040990037823
00000020:00000001:24.0:1773851855.126742:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851855.126742:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851855.126742:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851855.126743:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.126744:0:60973:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:24.0:1773851855.126744:0:60973:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:24.0:1773851855.126745:0:60973:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:24.0:1773851855.126745:0:60973:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:24.0:1773851855.126745:0:60973:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.126747:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851855.126748:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 19
00010000:00000001:24.0:1773851855.126749:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851855.126749:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851855.126750:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000002127fc97.
00000020:00000001:24.0:1773851855.126751:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851855.126751:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000002127fc97 with handle 0x21b6f08f07a6accf to hash
00000020:00000001:24.0:1773851855.126752:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851855.126753:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637115981074368 : -106957728477248 : ffff9eb8f6968fc0)
00010000:00000010:24.0:1773851855.126753:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000003a8b4b11.
00010000:00000001:24.0:1773851855.126754:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637115981074368 : -106957728477248 : ffff9eb8f6968fc0)
00010000:00010000:24.0:1773851855.126755:0:60973:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000002127fc97/0x21b6f08f07a6accf lrc: 2/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x21b9c71b20965632 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126758:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:24.0:1773851855.126759:0:60973:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000840913ea : new locks_count 2
00000020:00000040:24.0:1773851855.126759:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000840913ea refcount=8
00010000:00000001:24.0:1773851855.126761:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:24.0:1773851855.126761:0:60973:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:24.0:1773851855.126762:0:60973:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:24.0:1773851855.126763:0:60973:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:24.0:1773851855.126763:0:60973:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:24.0:1773851855.126764:0:60973:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:24.0:1773851855.126764:0:60973:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400276f1:0x9609:0x0]
00000020:00000001:24.0:1773851855.126765:0:60973:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:24.0:1773851855.126765:0:60973:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637105610757464 : -106968098794152 : ffff9eb68c781558)
00000004:00000001:24.0:1773851855.126766:0:60973:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637105610757376 : -106968098794240 : ffff9eb68c781500)
00000004:00000001:24.0:1773851855.126767:0:60973:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126767:0:60973:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:24.0:1773851855.126768:0:60973:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:24.0:1773851855.126768:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851855.126769:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851855.126771:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 000000007aa6ae5c.
02000000:00000001:24.0:1773851855.126771:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.126772:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126772:0:60973:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126773:0:60973:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:24.0:1773851855.126774:0:60973:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:24.0:1773851855.126774:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851855.126775:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851855.126775:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851855.126776:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:24.0:1773851855.126776:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851855.126777:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:24.0:1773851855.126777:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851855.126778:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:24.0:1773851855.126778:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851855.126778:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
02000000:00000001:24.0:1773851855.126779:0:60973:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:24.0:1773851855.126780:0:60973:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637071493641344 : -107002215910272 : ffff9eae9aee3480)
00000004:00000001:24.0:1773851855.126781:0:60973:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:24.0:1773851855.126781:0:60973:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851855.126782:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851855.126782:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126783:0:60973:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:24.0:1773851855.126784:0:60973:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126785:0:60973:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:24.0:1773851855.126786:0:60973:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x2400276f1:0x9609:0x0]/template_files, ldlm_rep = 000000000d7a2df8
00000004:00000001:24.0:1773851855.126787:0:60973:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:24.0:1773851855.126788:0:60973:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:24.0:1773851855.126788:0:60973:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:24.0:1773851855.126789:0:60973:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:24.0:1773851855.126789:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851855.126790:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851855.126790:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.126791:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851855.126792:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851855.126792:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000001e96caf9.
00000020:00000001:24.0:1773851855.126793:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851855.126794:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000001e96caf9 with handle 0x21b6f08f07a6acd6 to hash
00000020:00000001:24.0:1773851855.126794:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851855.126794:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00000010:24.0:1773851855.126795:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000644b2a52.
00010000:00000001:24.0:1773851855.126796:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00000001:24.0:1773851855.126797:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.126797:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.126798:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 3/1,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126801:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.126802:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851855.126802:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851855.126803:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851855.126803:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851855.126804:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126804:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851855.126805:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126805:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851855.126806:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851855.126806:0:60973:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851855.126807:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851855.126807:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb) refcount = 20
00010000:00000040:24.0:1773851855.126809:0:60973:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:24.0:1773851855.126810:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000142763aa/0x21b6f08f07a6acc8 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21393@kfi7 remote: 0x21b9c71b2096562b expref: 8 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126812:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126813:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd6a9637/0x21b6f08f07a6ab0f lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 15297@kfi7 remote: 0x2a385bf44de18475 expref: 7 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126815:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126816:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c415d6e/0x21b6f08f07a6a54a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 20785@kfi7 remote: 0x99860d9ed9853cd4 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126818:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126819:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000832de5a3/0x21b6f08f07a6a26b lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 23601@kfi7 remote: 0xce07d8f4f3aa40e1 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126821:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126822:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000059acec9a/0x21b6f08f07a67ffe lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21826@kfi7 remote: 0x177c482190197e35 expref: 7 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126824:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126825:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf485bd3/0x21b6f08f07a67dce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 16017@kfi7 remote: 0x6f0957fcc2016c01 expref: 6 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126828:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126829:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5320073/0x21b6f08f07a67998 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21298@kfi7 remote: 0x5a56a05cb8a8b31d expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126831:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126832:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016423bf5/0x21b6f08f07a6782c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21936@kfi7 remote: 0xb4fb780a561291c3 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126837:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126838:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b934f1e/0x21b6f08f07a66f6c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 23634@kfi7 remote: 0x7c0da7673655e6bb expref: 7 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126840:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126841:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fecbf600/0x21b6f08f07a66f26 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 16257@kfi7 remote: 0x757acea6a351db8a expref: 6 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126844:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126845:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7dcf18c/0x21b6f08f07a66ed9 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 13714@kfi7 remote: 0xe6fc6ed572595da9 expref: 6 pid: 61083 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126846:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126847:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010fa0ac0/0x21b6f08f07a6315a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 22450@kfi7 remote: 0x5c0bf53c716f4467 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126850:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126850:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008f335fab/0x21b6f08f07a5d4bd lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 20706@kfi7 remote: 0xee4f431a41d43936 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126852:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126853:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e2ad57/0x21b6f08f07a5d477 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 18867@kfi7 remote: 0x6f0fd12f6ddf8254 expref: 6 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126855:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126856:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a82f52ea/0x21b6f08f07a58b7c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21216@kfi7 remote: 0xce2ef96babfa3e25 expref: 7 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126858:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126859:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bbc818af/0x21b6f08ef3d9b2ce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 23153@kfi7 remote: 0xc70354b40450ada2 expref: 56 pid: 61192 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126862:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126862:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c3684a3/0x21b6f08ef35f0f50 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 18962@kfi7 remote: 0xc8dab5ae9bddf110 expref: 60 pid: 60739 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126864:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:24.0:1773851855.126865:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9d1f20f/0x21b6f08eeeedea42 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 9792@kfi7 remote: 0x7f4e1c592d72496c expref: 59 pid: 61066 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126867:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00010000:24.0:1773851855.126868:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 3/1,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126870:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.126871:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851855.126871:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851855.126872:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.126872:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851855.126873:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126873:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.126874:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851855.126874:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851855.126875:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.126875:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 3/1,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126878:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.126878:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851855.126879:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.126879:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.126879:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851855.126880:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:24.0:1773851855.126881:0:60973:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000dc0dc02c.
00010000:00000010:24.0:1773851855.126882:0:60973:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 000000001f8916c2.
00010000:00000001:24.0:1773851855.126883:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851855.126884:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000005ba4d8aa.
00000020:00000001:24.0:1773851855.126884:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851855.126885:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000005ba4d8aa with handle 0x21b6f08f07a6acdd to hash
00000020:00000001:24.0:1773851855.126886:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851855.126886:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000010:24.0:1773851855.126887:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000034f8f89b.
00010000:00000001:24.0:1773851855.126888:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851855.126888:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.126889:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.126889:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 3/1,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126892:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.126892:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851855.126893:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851855.126893:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851855.126894:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851855.126894:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126895:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851855.126895:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126896:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851855.126896:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851855.126897:0:60973:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851855.126897:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851855.126897:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x9609:0x0].0x537abb93 (00000000dc0dc02c) refcount = 1
00010000:00010000:24.0:1773851855.126898:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126901:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.126901:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851855.126901:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851855.126902:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.126903:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851855.126903:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126904:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.126904:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851855.126905:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851855.126905:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.126906:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126908:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.126909:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851855.126909:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.126909:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.126910:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.126910:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.126911:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005ba4d8aa refcount=3
00000020:00000001:24.0:1773851855.126911:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851855.126912:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851855.126913:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.126913:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851855.126914:0:60973:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126914:0:60973:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126916:0:60973:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:24.0:1773851855.126919:0:60973:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:24.0:1773851855.126920:0:60973:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:24.0:1773851855.126921:0:60973:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851855.126922:0:60973:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:24.0:1773851855.126927:0:60973:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:24.0:1773851855.126928:0:60973:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:24.0:1773851855.126928:0:60973:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:24.0:1773851855.126929:0:60973:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:24.0:1773851855.126929:0:60973:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:24.0:1773851855.126930:0:60973:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:24.0:1773851855.126930:0:60973:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851855.126931:0:60973:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:24.0:1773851855.126934:0:60973:0:(osd_index.c:979:osd_remote_fid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851855.126935:0:60973:0:(osd_index.c:554:osd_zfs_consistency_check()) Process entered
00080000:00000001:24.0:1773851855.126935:0:60973:0:(osd_oi.c:669:osd_fid_lookup()) Process entered
00080000:00000001:24.0:1773851855.126936:0:60973:0:(osd_oi.c:360:fid_is_on_ost()) Process entered
80000000:00000001:24.0:1773851855.126937:0:60973:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:24.0:1773851855.126937:0:60973:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:24.0:1773851855.126938:0:60973:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:24.0:1773851855.126938:0:60973:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851855.126939:0:60973:0:(osd_oi.c:389:fid_is_on_ost()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851855.126950:0:60973:0:(osd_oi.c:706:osd_fid_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851855.126951:0:60973:0:(osd_index.c:582:osd_zfs_consistency_check()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:24.0:1773851855.126952:0:60973:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126953:0:60973:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.126953:0:60973:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:24.0:1773851855.126954:0:60973:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400276f1:0x961f:0x0]
00000020:00000001:24.0:1773851855.126954:0:60973:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:24.0:1773851855.126956:0:60973:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637137110913048 : -106936598638568 : ffff9ebde2065018)
00000004:00000001:24.0:1773851855.126956:0:60973:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637137110912960 : -106936598638656 : ffff9ebde2064fc0)
00000004:00000001:24.0:1773851855.126957:0:60973:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:24.0:1773851855.126958:0:60973:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:24.0:1773851855.126958:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851855.126958:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851855.126960:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000009d5e76b5 count: 18
00010000:00000001:24.0:1773851855.126961:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851855.126962:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851855.126963:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000ee31cffb.
00000020:00000001:24.0:1773851855.126963:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851855.126964:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000ee31cffb with handle 0x21b6f08f07a6ace4 to hash
00000020:00000001:24.0:1773851855.126965:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851855.126965:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00010000:00000010:24.0:1773851855.126966:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000056cdb677.
00010000:00000001:24.0:1773851855.126967:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00010000:00000001:24.0:1773851855.126967:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.126968:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.126968:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ee31cffb/0x21b6f08f07a6ace4 lrc: 3/1,0 mode: --/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x0/0x0 rrc: 19 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126971:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000001:24.0:1773851855.126972:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851855.126972:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851855.126973:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851855.126973:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851855.126974:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126974:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851855.126975:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.126975:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851855.126976:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851855.126976:0:60973:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851855.126977:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851855.126977:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x961f:0x0].0x0 (000000009d5e76b5) refcount = 18
00010000:00000040:24.0:1773851855.126978:0:60973:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:24.0:1773851855.126979:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c015d2b/0x21b6f08f07a6ab2b lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 15297@kfi7 remote: 0x2a385bf44de1847c expref: 7 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126981:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.126983:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000021cb55fc/0x21b6f08f07a6a566 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 20785@kfi7 remote: 0x99860d9ed9853cdb expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126985:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.126986:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b3509970/0x21b6f08f07a6a287 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 23601@kfi7 remote: 0xce07d8f4f3aa40e8 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126988:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.126989:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec6b566/0x21b6f08f07a6801a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 21826@kfi7 remote: 0x177c482190197e3c expref: 7 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126992:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.126993:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1257b77/0x21b6f08f07a67dea lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 16017@kfi7 remote: 0x6f0957fcc2016c08 expref: 6 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.126997:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.126999:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002263aa90/0x21b6f08f07a679b4 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 21298@kfi7 remote: 0x5a56a05cb8a8b324 expref: 7 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127001:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127002:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ad0a3f8/0x21b6f08f07a67848 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 21936@kfi7 remote: 0xb4fb780a561291ca expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127004:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127005:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f8f827e/0x21b6f08f07a66f88 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 23634@kfi7 remote: 0x7c0da7673655e6c2 expref: 7 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127007:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127008:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056ddf98a/0x21b6f08f07a66f42 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 16257@kfi7 remote: 0x757acea6a351db91 expref: 6 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127010:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127011:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001b236374/0x21b6f08f07a66ef5 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 13714@kfi7 remote: 0xe6fc6ed572595db0 expref: 6 pid: 61083 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127013:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127015:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e231235/0x21b6f08f07a63176 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 22450@kfi7 remote: 0x5c0bf53c716f446e expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127017:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127018:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ae20e37/0x21b6f08f07a5d4f5 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 20706@kfi7 remote: 0xee4f431a41d4393d expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127020:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127021:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000935c16cd/0x21b6f08f07a5d4a1 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 18867@kfi7 remote: 0x6f0fd12f6ddf825b expref: 6 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127023:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127024:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa7a21f7/0x21b6f08f07a58b98 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 21216@kfi7 remote: 0xce2ef96babfa3e2c expref: 7 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127027:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127028:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000930e9ef/0x21b6f08ef3d9b2ea lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 23153@kfi7 remote: 0xc70354b40450ada9 expref: 56 pid: 61192 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127030:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127031:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003daf75b9/0x21b6f08ef35f0fb2 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 18962@kfi7 remote: 0xc8dab5ae9bddf117 expref: 60 pid: 60739 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127033:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000040:24.0:1773851855.127034:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000967bf993/0x21b6f08eeeedeaf1 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 9792@kfi7 remote: 0x7f4e1c592d724973 expref: 59 pid: 61066 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127036:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00010000:24.0:1773851855.127036:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000ee31cffb/0x21b6f08f07a6ace4 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127038:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000001:24.0:1773851855.127039:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851855.127040:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851855.127040:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127041:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851855.127041:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.127042:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127042:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851855.127043:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851855.127043:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.127044:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000ee31cffb/0x21b6f08f07a6ace4 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127047:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000001:24.0:1773851855.127047:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851855.127048:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127048:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127049:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.127049:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.127049:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ee31cffb refcount=3
00000020:00000001:24.0:1773851855.127050:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00010000:00000001:24.0:1773851855.127050:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00010000:00000001:24.0:1773851855.127051:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127051:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851855.127052:0:60973:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127052:0:60973:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127053:0:60973:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:24.0:1773851855.127054:0:60973:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:24.0:1773851855.127055:0:60973:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:24.0:1773851855.127061:0:60973:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127062:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851855.127062:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851855.127063:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851855.127064:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127065:0:60973:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127066:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127066:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851855.127067:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851855.127067:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851855.127067:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127068:0:60973:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127069:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:24.0:1773851855.127069:0:60973:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:24.0:1773851855.127070:0:60973:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851855.127071:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851855.127071:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851855.127073:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851855.127073:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:24.0:1773851855.127074:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851855.127074:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:24.0:1773851855.127075:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851855.127075:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:24.0:1773851855.127076:0:60973:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x2400276f1:0x961f:0x0]: nlink=2, mode=40755, valid=0x1100000000002f8f
00000004:00200000:24.0:1773851855.127077:0:60973:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400276f1:0x961f:0x0]: returning size 37888
00000004:00200000:24.0:1773851855.127078:0:60973:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:24.0:1773851855.127078:0:60973:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:24.0:1773851855.127079:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851855.127079:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127080:0:60973:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:24.0:1773851855.127080:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851855.127081:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851855.127081:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851855.127082:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127082:0:60973:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127083:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851855.127083:0:60973:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.127084:0:60973:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:24.0:1773851855.127086:0:60973:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127086:0:60973:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127088:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.127089:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.127089:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ee31cffb refcount=3
00000020:00000001:24.0:1773851855.127090:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00010000:00000001:24.0:1773851855.127090:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00000004:00010000:24.0:1773851855.127091:0:60973:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000ee31cffb/0x21b6f08f07a6ace4 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127093:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000001:24.0:1773851855.127094:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127094:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851855.127095:0:60973:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:24.0:1773851855.127096:0:60973:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:24.0:1773851855.127096:0:60973:0:(lu_object.c:224:lu_object_put()) Add 00000000d578ae85/0000000056fac4eb to site lru. bkt: 000000001c01ab3e
00000004:00000001:24.0:1773851855.127097:0:60973:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:24.0:1773851855.127097:0:60973:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:24.0:1773851855.127098:0:60973:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:24.0:1773851855.127098:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.127099:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.127099:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000001e96caf9 refcount=3
00000020:00000001:24.0:1773851855.127100:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00000001:24.0:1773851855.127100:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00000001:24.0:1773851855.127101:0:60973:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:24.0:1773851855.127102:0:60973:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 3/1,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127104:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.127105:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127105:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851855.127106:0:60973:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 2/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127108:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.127109:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.127109:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127110:0:60973:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:24.0:1773851855.127110:0:60973:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 3/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127113:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00010000:24.0:1773851855.127114:0:60973:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000001e96caf9 already unused, calling callback (000000001690cbe4)
00000004:00000001:24.0:1773851855.127115:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:24.0:1773851855.127115:0:60973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:24.0:1773851855.127116:0:60973:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 3/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127121:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.127121:0:60973:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:24.0:1773851855.127122:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.127122:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.127123:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000001e96caf9 refcount=4
00000020:00000001:24.0:1773851855.127123:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00000001:24.0:1773851855.127124:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00000001:24.0:1773851855.127124:0:60973:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:24.0:1773851855.127125:0:60973:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 4/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127127:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.127128:0:60973:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:24.0:1773851855.127129:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:24.0:1773851855.127129:0:60973:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127130:0:60973:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:24.0:1773851855.127130:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851855.127130:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.127131:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851855.127131:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000001e96caf9 with handle 0x21b6f08f07a6acd6 from hash
00010000:00000001:24.0:1773851855.127132:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851855.127133:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127133:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127133:0:60973:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:24.0:1773851855.127134:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851855.127134:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127135:0:60973:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:24.0:1773851855.127135:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851855.127136:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851855.127136:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb)
00010000:00010000:24.0:1773851855.127137:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:24.0:1773851855.127138:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.127139:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127140:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851855.127140:0:60973:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:24.0:1773851855.127141:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127141:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127142:0:60973:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127142:0:60973:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127143:0:60973:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.127144:0:60973:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 2/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127146:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:24.0:1773851855.127146:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127147:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127147:0:60973:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:24.0:1773851855.127148:0:60973:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:24.0:1773851855.127148:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851855.127149:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6acd6 lrc: 0/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127150:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000010:24.0:1773851855.127151:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000644b2a52.
00010000:00000040:24.0:1773851855.127152:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000001:24.0:1773851855.127152:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851855.127153:0:60973:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:24.0:1773851855.127153:0:60973:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:24.0:1773851855.127153:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.127154:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.127154:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005ba4d8aa refcount=3
00000020:00000001:24.0:1773851855.127155:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851855.127155:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851855.127156:0:60973:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:24.0:1773851855.127156:0:60973:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127158:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.127160:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127160:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851855.127160:0:60973:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127163:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.127164:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.127164:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127165:0:60973:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:24.0:1773851855.127165:0:60973:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127167:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00010000:24.0:1773851855.127168:0:60973:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000005ba4d8aa already unused, calling callback (000000001690cbe4)
00000004:00000001:24.0:1773851855.127169:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:24.0:1773851855.127169:0:60973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:24.0:1773851855.127169:0:60973:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127172:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.127172:0:60973:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:24.0:1773851855.127173:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.127173:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.127173:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005ba4d8aa refcount=4
00000020:00000001:24.0:1773851855.127174:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851855.127175:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851855.127175:0:60973:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:24.0:1773851855.127176:0:60973:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 4/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127178:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.127178:0:60973:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:24.0:1773851855.127179:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:24.0:1773851855.127179:0:60973:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127180:0:60973:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:24.0:1773851855.127180:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851855.127181:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.127181:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851855.127181:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000005ba4d8aa with handle 0x21b6f08f07a6acdd from hash
00010000:00000001:24.0:1773851855.127182:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851855.127182:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127183:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127183:0:60973:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:24.0:1773851855.127184:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851855.127184:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127184:0:60973:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:24.0:1773851855.127185:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851855.127185:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851855.127185:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x9609:0x0].0x537abb93 (00000000dc0dc02c)
00010000:00010000:24.0:1773851855.127186:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:24.0:1773851855.127187:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.127187:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127188:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851855.127189:0:60973:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:24.0:1773851855.127189:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127190:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127190:0:60973:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127190:0:60973:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127191:0:60973:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851855.127192:0:60973:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 2/0,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127194:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851855.127194:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127195:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127195:0:60973:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:24.0:1773851855.127195:0:60973:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:24.0:1773851855.127196:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851855.127196:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6acdd lrc: 0/0,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127198:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000010:24.0:1773851855.127199:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000034f8f89b.
00010000:00000040:24.0:1773851855.127200:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 0
00010000:00000010:24.0:1773851855.127200:0:60973:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 000000001f8916c2.
00010000:00000001:24.0:1773851855.127201:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851855.127202:0:60973:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:24.0:1773851855.127202:0:60973:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:24.0:1773851855.127203:0:60973:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:24.0:1773851855.127203:0:60973:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:24.0:1773851855.127204:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851855.127204:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.127204:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ee31cffb refcount=3
00000020:00000001:24.0:1773851855.127205:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00010000:00000001:24.0:1773851855.127206:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637152227166464 : -106921482385152 : ffff9ec167060900)
00000004:00000040:24.0:1773851855.127206:0:60973:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000840913ea : new locks_count 3
00000020:00000040:24.0:1773851855.127207:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000840913ea refcount=9
00010000:00000001:24.0:1773851855.127208:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127208:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851855.127208:0:60973:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851855.127209:0:60973:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:24.0:1773851855.127209:0:60973:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:24.0:1773851855.127210:0:60973:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:24.0:1773851855.127210:0:60973:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:24.0:1773851855.127211:0:60973:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:24.0:1773851855.127211:0:60973:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:24.0:1773851855.127211:0:60973:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:24.0:1773851855.127213:0:60973:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851855.127213:0:60973:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851855.127214:0:60973:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:24.0:1773851855.127214:0:60973:0:(lu_object.c:224:lu_object_put()) Add 000000007e72d379/000000009c9aae14 to site lru. bkt: 000000005a7eb874
00000004:00000001:24.0:1773851855.127215:0:60973:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:24.0:1773851855.127215:0:60973:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:24.0:1773851855.127216:0:60973:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:24.0:1773851855.127217:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851855.127217:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127218:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127218:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851855.127218:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851855.127219:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000002127fc97 with handle 0x21b6f08f07a6accf from hash
00010000:00000001:24.0:1773851855.127220:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851855.127220:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127220:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127221:0:60973:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:24.0:1773851855.127221:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851855.127222:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000002127fc97/0x21b6f08f07a6accf lrc: 0/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 20 type: IBT gid 0 flags: 0x44000000000000 nid: 21393@kfi7 remote: 0x21b9c71b20965632 expref: 9 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127224:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:24.0:1773851855.127224:0:60973:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000840913ea : new locks_count 2
00000020:00000040:24.0:1773851855.127225:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000840913ea : new refcount 8
00010000:00000010:24.0:1773851855.127225:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003a8b4b11.
00010000:00000040:24.0:1773851855.127226:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 18
00010000:00000001:24.0:1773851855.127226:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851855.127227:0:60973:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127227:0:60973:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:24.0:1773851855.127228:0:60973:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ee31cffb/0x21b6f08f07a6ace4 lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 19 type: IBT gid 0 flags: 0x40200000000000 nid: 21393@kfi7 remote: 0x21b9c71b20965632 expref: 8 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851855.127231:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 18
00010000:00000001:24.0:1773851855.127231:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851855.127232:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851855.127232:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x961f:0x0].0x0 (000000009d5e76b5)
00010000:00010000:24.0:1773851855.127233:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00000001:24.0:1773851855.127233:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851855.127234:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851855.127234:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851855.127235:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851855.127235:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851855.127246:0:60973:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ee31cffb, rc 0)
00000020:00000001:24.0:1773851855.127247:0:60973:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851855.127247:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044109179, transno 0, xid 1858040990037824
00010000:00000001:24.0:1773851855.127248:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851855.127249:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000944814f9 x1858040990037824/t0(0) o101->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:136/0 lens 584/640 e 0 to 0 dl 1773852251 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832052957968075776'
00010000:00000001:24.0:1773851855.127252:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851855.127252:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851855.127253:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=88 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851855.127254:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851855.127254:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000969e3622 refcount 3 to 21393@kfi7
00000100:00000001:24.0:1773851855.127255:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612512 : -107130477939104 : ffff9e90bdeaf660)
02000000:00000001:24.0:1773851855.127256:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851855.127256:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.127257:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851855.127257:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21392@kfi7
00000400:00000010:24.0:1773851855.127258:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000473d3742.
00000100:00000200:24.0:1773851855.127259:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858040990037824, offset 224
00000400:00000200:24.0:1773851855.127260:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21392@kfi7
00000400:00000200:24.0:1773851855.127261:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:24.0:1773851855.127262:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 1
00000400:00000200:24.0:1773851855.127263:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000400:00000200:24.0:1773851855.127264:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 3
00000400:00000200:24.0:1773851855.127265:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21392@kfi7 local destination
00000400:00000200:24.0:1773851855.127267:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768633:8768633:1024:4294967295] 21392@kfi7 LPNI seq info [1131115:1131115:16:4294967295]
00000400:00000200:24.0:1773851855.127268:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000400:00000200:24.0:1773851855.127269:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21392@kfi7 to cpt 6
00000400:00000200:24.0:1773851855.127271:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21392@kfi7(21392@kfi7:21392@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851855.127272:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 3
00000800:00000200:24.0:1773851855.127274:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851855.127275:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:24.0:1773851855.127279:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851855.127281:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 Using peer 21392@kfi7(0xc67)
00000800:00000200:24.0:1773851855.127285:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000358ab717: Posted send of 740 bytes to peer 0xc67: rc=0
00000800:00000200:24.0:1773851855.127286:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851855.127288:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851855.127289:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000969e3622 refcount 2 to 21393@kfi7
00010000:00000001:24.0:1773851855.127289:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851855.127290:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.127291:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851855.127291:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000944814f9 x1858040990037824/t0(0) o101->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:136/0 lens 584/640 e 0 to 0 dl 1773852251 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832052957968075776'
00000100:00100000:24.0:1773851855.127296:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000944814f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:0be85a48-c251-410d-838d-23bdfd7e98c7+8:2297909:x1858040990037824:12345-21393@kfi7:101:tuolumne-832052957968075776 Request processed in 562us (588us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851855.127299:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21393@kfi7, seq: 1451911030
00000100:00000040:24.0:1773851855.127300:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000840913ea : new rpc_count 0
00000100:00000001:24.0:1773851855.127300:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851855.127301:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851855.127301:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:24.0:1773851855.127302:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6ffcbe8.
00000020:00000010:24.0:1773851855.127303:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000608ed6cb.
00000020:00000040:24.0:1773851855.127304:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000840913ea : new refcount 7
00000100:00000001:24.0:1773851855.127304:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851855.127310:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851855.127312:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851855.127313:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21392@kfi7: PUT: OK
00000400:00000200:26.0:1773851855.127314:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000473d3742
00000400:00000010:26.0:1773851855.127315:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000473d3742.
00000100:00000001:26.0:1773851855.127315:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851855.127316:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851855.127317:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f520f6e2 nid 21392@kfi7 refs 2
00000800:00000200:26.0:1773851855.127318:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 21392@kfi7(00000000f84f3c5f):0x0 lsk 3176 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc67 Transaction freed
00010000:00000010:26.1F:1773851855.131727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000056845fce.
00010000:00000010:24.1F:1773851855.135729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000001e96caf9.
00010000:00000010:24.1:1773851855.135730:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000dc0dc02c.
00010000:00000010:24.1:1773851855.135731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000005ba4d8aa.
00010000:00000010:24.1:1773851855.135732:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000002127fc97.
00000800:00000200:13.0:1773851855.141659:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851855.141660:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851855.141661:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851855.141663:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851855.141665:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22208@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.141666:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22208@kfi7 : PUT - for me
00000400:00000200:13.0:1773851855.141667:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22208@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.141668:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124e0875 nid 22208@kfi7 refs 1
00000400:00000200:13.0:1773851855.141669:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22208@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.141670:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124e0875 nid 22208@kfi7 refs 2
00000400:00000200:13.0:1773851855.141671:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124e0875 nid 22208@kfi7 refs 3
00000400:00000200:13.0:1773851855.141671:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22017@kfi7 to cpt 4
00000400:00000200:13.0:1773851855.141672:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22017@kfi7 of length 224 into portal 12 MB=0x699e0f024f180
00000400:00000200:13.0:1773851855.141674:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22017@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 14056
00000800:00000200:13.0:1773851855.141675:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851855.141678:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851855.141679:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22208@kfi7: PUT: OK
00000100:00000001:13.0:1773851855.141680:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851855.141680:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851855.141681:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000008d8e42c.
00000100:00000040:13.0:1773851855.141682:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000008d8e42c x1858041240940928 msgsize 224
00000100:00100000:13.0:1773851855.141684:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22017@kfi7 (source: 12345-22208@kfi7)
00000100:00000001:13.0:1773851855.141685:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851855.141686:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124e0875 nid 22208@kfi7 refs 2
00000800:00000200:13.0:1773851855.141688:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851855.141691:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851855.141691:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851855.141692:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851855.141692:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851855.141693:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851855.141694:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041240940928
00000020:00000001:13.0:1773851855.141695:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851855.141695:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac928e2
00000020:00000001:13.0:1773851855.141696:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851855.141701:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e28a86c3 refcount=6
00000020:00000001:13.0:1773851855.141702:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742940672 : -107128966610944 : ffff9e9118000000)
00000020:00000001:13.0:1773851855.141703:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742940672 : -107128966610944 : ffff9e9118000000)
00000100:00000001:13.0:1773851855.141704:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851855.141705:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851855.141705:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851855.141706:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851855.141707:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851855.141708:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851855.141709:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851855.141709:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851855.141710:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851855.141711:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851855.141711:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851855.141712:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851855.141714:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851855.141714:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851855.141714:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851855.141715:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851855.141715:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22017@kfi7, seq: 2289771
00000100:00000001:14.0:1773851855.141716:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851855.141716:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e28a86c3 : new rpc_count 1
00000100:00000001:14.0:1773851855.141717:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851855.141717:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197389568 : -106942512162048 : ffff9ebc818d1b00)
00000100:00000040:13.0:1773851855.141718:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000008d8e42c x1858041240940928/t0(0) o400->bd55f3e8-962d-45b1-81d6-eff89bd2797b@22017@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1875-0'
00000100:00000001:13.0:1773851855.141721:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851855.141721:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851855.141722:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008d8e42c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bd55f3e8-962d-45b1-81d6-eff89bd2797b+6:39791:x1858041240940928:12345-22017@kfi7:400:default-tuolumne1875-0
00000100:00000200:13.0:1773851855.141723:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041240940928
00000020:00000001:13.0:1773851855.141724:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851855.141727:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851855.141728:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851855.141729:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851855.141729:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851855.141730:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851855.141731:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041240940928, found 0 last_xid 1858041240940927
00000020:00000001:13.0:1773851855.141732:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851855.141732:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851855.141733:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851855.141733:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851855.141734:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851855.141735:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851855.141735:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851855.141736:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000140784c7.
02000000:00000001:13.0:1773851855.141737:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851855.141738:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851855.141738:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851855.141739:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044124144, transno 0, xid 1858041240940928
00010000:00000001:13.0:1773851855.141740:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851855.141741:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000008d8e42c x1858041240940928/t0(0) o400->bd55f3e8-962d-45b1-81d6-eff89bd2797b@22017@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1875-0'
00010000:00000001:13.0:1773851855.141743:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851855.141744:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851855.141745:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=88 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851855.141746:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851855.141747:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a6063b16 refcount 3 to 22017@kfi7
00000100:00000001:13.0:1773851855.141747:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993088 : -107142345558528 : ffff9e8dfa8d7600)
02000000:00000001:13.0:1773851855.141748:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851855.141749:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851855.141750:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851855.141751:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22208@kfi7
00000400:00000010:13.0:1773851855.141751:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f7a58502.
00000100:00000200:13.0:1773851855.141752:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041240940928, offset 224
00000400:00000200:13.0:1773851855.141754:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22208@kfi7
00000400:00000200:13.0:1773851855.141755:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22208@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.141756:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124e0875 nid 22208@kfi7 refs 1
00000400:00000200:13.0:1773851855.141757:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124e0875 nid 22208@kfi7 refs 2
00000400:00000200:13.0:1773851855.141758:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124e0875 nid 22208@kfi7 refs 3
00000400:00000200:13.0:1773851855.141760:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22208@kfi7 local destination
00000400:00000200:13.0:1773851855.141761:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768634:8768634:1024:4294967295] 22208@kfi7 LPNI seq info [434808:434808:16:4294967295]
00000400:00000200:13.0:1773851855.141762:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124e0875 nid 22208@kfi7 refs 2
00000400:00000200:13.0:1773851855.141763:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22208@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.141765:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22208@kfi7(22208@kfi7:22208@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851855.141766:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124e0875 nid 22208@kfi7 refs 3
00000800:00000200:13.0:1773851855.141767:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851855.141768:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851855.141770:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851855.141772:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e5f Using peer 22208@kfi7(0x100000000000e5f)
00000800:00000200:13.0:1773851855.141777:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 324 bytes to peer 0x100000000000e5f: rc=0
00000800:00000200:13.0:1773851855.141779:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e5f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851855.141783:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851855.141785:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a6063b16 refcount 2 to 22017@kfi7
00010000:00000001:13.0:1773851855.141786:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851855.141787:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851855.141788:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851855.141789:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000008d8e42c x1858041240940928/t0(0) o400->bd55f3e8-962d-45b1-81d6-eff89bd2797b@22017@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1875-0'
00000100:00100000:13.0:1773851855.141795:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008d8e42c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bd55f3e8-962d-45b1-81d6-eff89bd2797b+6:39791:x1858041240940928:12345-22017@kfi7:400:default-tuolumne1875-0 Request processed in 73us (111us total) trans 0 rc 0/0
00000800:00000200:15.0:1773851855.141796:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e5f TN_EVENT_TX_OK event status 0
00000400:00000200:15.0:1773851855.141799:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:13.0:1773851855.141799:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22017@kfi7, seq: 2289771
00000400:00000200:15.0:1773851855.141800:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22208@kfi7: PUT: OK
00000400:00000200:15.0:1773851855.141801:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f7a58502
00000100:00000040:13.0:1773851855.141801:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e28a86c3 : new rpc_count 0
00000400:00000010:15.0:1773851855.141802:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f7a58502.
00000100:00000001:13.0:1773851855.141802:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851855.141803:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851855.141803:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:15.0:1773851855.141804:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:13.0:1773851855.141804:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:15.0:1773851855.141805:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124e0875 nid 22208@kfi7 refs 2
00000800:00000200:15.0:1773851855.141806:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 22208@kfi7(0000000037c5d6f3):0x0 lsk 3680 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e5f Transaction freed
00000020:00000010:13.0:1773851855.141806:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000020:00000010:13.0:1773851855.141807:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000020:00000040:13.0:1773851855.141809:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000e28a86c3 : new refcount 5
00000100:00000001:13.0:1773851855.141810:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851855.177731:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851855.177731:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851855.177732:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f814d8f1.
00000020:00000040:6.0:1773851855.177733:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851855.177734:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851855.177734:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851855.177735:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851855.177736:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a8eda3b1.
00000100:00000001:6.0:1773851855.177737:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851855.177738:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851855.177738:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851855.177739:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f814d8f1] to pc [ptlrpcd_01_00+0]  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851855.177745:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:6.0:1773851855.177746:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c66fb52b.
00000100:00000001:4.0:1773851855.177746:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851855.177747:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851855.177747:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:7.0:1773851855.177748:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851855.177748:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851855.177748:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637108560081920 : -106965149469696 : ffff9eb73c433400)
00000100:00000040:4.0:1773851855.177748:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851855.177749:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:6.0:1773851855.177750:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851855.177751:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000100:00000001:4.0:1773851855.177751:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851855.177751:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:6.0:1773851855.177752:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a186ac79.
02000000:00000001:4.0:1773851855.177752:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851855.177753:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851855.177754:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f814d8f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051923584:16@kfi7:13:default-yuba2-0
00000004:00080000:6.0:1773851855.177755:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614129631030040ns, next at 614130631027626ns, rc = 0
00000100:00000001:4.0:1773851855.177755:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:6.0:1773851855.177756:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851855.177756:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851855.177756:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851855.177757:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851855.177757:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000001:6.0:1773851855.177758:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851855.177758:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007e3989c4.
02000000:00000001:4.0:1773851855.177759:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851855.177760:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:4.0:1773851855.177761:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000400:00000010:4.0:1773851855.177762:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:4.0:1773851855.177763:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923584, portal 4
00000100:00000001:4.0:1773851855.177764:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851855.177765:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637142942796928 : -106930766754688 : ffff9ebf3da1cc80)
00000100:00000040:4.0:1773851855.177766:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851855.177769:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851855.177770:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:4.0:1773851855.177770:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000058aef11.
00000100:00000200:4.0:1773851855.177771:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923584, offset 0
00000400:00000200:4.0:1773851855.177773:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:4.0:1773851855.177773:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851855.177774:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:4.0:1773851855.177775:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851855.177777:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:4.0:1773851855.177778:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:4.0:1773851855.177780:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768633, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768634, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851855.177781:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851855.177782:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851855.177783:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:4.0:1773851855.177784:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768635:8768635:1024:4294967295] 16@kfi7 LPNI seq info [5403812:5403812:16:4294967295]
00000400:00000200:4.0:1773851855.177785:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851855.177786:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851855.177788:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851855.177790:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:4.0:1773851855.177791:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851855.177792:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851855.177794:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851855.177797:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Using peer 16@kfi7(0x15d)
00000800:00000200:4.0:1773851855.177799:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x15d: rc=0
00000800:00000200:4.0:1773851855.177801:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851855.177803:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851855.177803:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851855.177804:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851855.177805:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851855.177805:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851855.177807:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851855.177807:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851855.177807:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851855.177808:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851855.177808:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851855.177810:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851855.177816:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851855.177818:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851855.177819:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000400:00000200:5.0:1773851855.177820:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000058aef11
00000400:00000010:5.0:1773851855.177820:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000058aef11.
00000100:00000001:5.0:1773851855.177821:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851855.177822:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851855.177825:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851855.177826:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851855.177828:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.177829:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851855.177830:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:5.0:1773851855.177832:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Transaction freed
00000800:00000200:29.0:1773851855.177856:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.177857:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.177858:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.177860:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851855.177862:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.177863:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.177865:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.177865:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851855.177866:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.177867:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851855.177868:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851855.177869:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.177870:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2480
00000400:00000200:29.0:1773851855.177871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.177874:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x78007fc1d [1] + 224
00000800:00000200:29.0:1773851855.177876:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851855.177878:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.177879:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851855.177880:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851855.177881:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851855.177884:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851855.177888:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851855.177888:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:29.0:1773851855.177890:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851855.177890:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851855.177890:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851855.177891:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851855.177891:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851855.177892:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851855.177892:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851855.177893:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:4.0:1773851855.177894:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851855.177895:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851855.177898:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851855.177900:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851855.177901:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851855.177902:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851855.177902:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851855.177903:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851855.177904:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851855.177904:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851855.177905:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=88 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851855.177906:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=88 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851855.177907:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851855.177908:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851855.177909:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851855.177909:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851855.177910:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851855.177911:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:4.0:1773851855.177911:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851855.177912:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851855.177912:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851855.177915:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851855.177916:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851855.177916:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851855.177917:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851855.177918:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851855.177918:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482181632 avail=351481137152 avail_mb=1372973192 hwm_mb=3131103 files=372097221 ffree=343244318 state=0: rc = 0
00000004:00000020:4.0:1773851855.177920:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482181632 free, 351481137152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097221 files, 343244318 free files
00000004:00000001:4.0:1773851855.177922:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851855.177923:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851855.177925:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f814d8f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051923584:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851855.177927:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851855.177927:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851855.177928:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f814d8f1 x1859433051923584/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851855.177931:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851855.177932:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851855.177932:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007e3989c4.
02000000:00000001:4.0:1773851855.177934:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851855.177934:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851855.177935:0:41064:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:4.0:1773851855.177936:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851855.177936:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a8eda3b1.
02000000:00000001:4.0:1773851855.177937:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851855.177938:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851855.177938:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f814d8f1.
00000100:00000001:4.0:1773851855.177939:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851855.177939:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851855.177940:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851855.177940:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851855.177941:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851855.177941:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851855.177942:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851855.198061:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851855.198061:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851855.198063:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851855.198065:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851855.198066:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.198068:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23506@kfi7 : PUT - for me
00000400:00000200:9.0:1773851855.198069:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.198070:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 1
00000400:00000200:9.0:1773851855.198070:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.198071:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000400:00000200:9.0:1773851855.198072:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 3
00000400:00000200:9.0:1773851855.198073:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.198074:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23506@kfi7 of length 224 into portal 12 MB=0x69b4b61450a00
00000400:00000200:9.0:1773851855.198075:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23506@kfi7 of length 224/224 into md 0x78146ce49 [64] + 119224
00000800:00000200:9.0:1773851855.198077:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851855.198081:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851855.198082:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23506@kfi7: PUT: OK
00000100:00000001:9.0:1773851855.198083:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851855.198083:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851855.198084:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000080acc760.
00000100:00000040:9.0:1773851855.198085:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000080acc760 x1859597917030912 msgsize 224
00000100:00100000:9.0:1773851855.198087:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-23506@kfi7 (source: 12345-23506@kfi7)
00000100:00000001:9.0:1773851855.198088:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851855.198089:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000800:00000200:9.0:1773851855.198090:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851855.198090:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851855.198090:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851855.198091:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851855.198091:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851855.198092:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851855.198093:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597917030912
00000020:00000001:8.0:1773851855.198093:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851855.198094:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24376d14
00000020:00000001:8.0:1773851855.198094:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851855.198096:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b73932b refcount=40
00000020:00000001:8.0:1773851855.198097:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637152147262464 : -106921562289152 : ffff9ec16242cc00)
00000020:00000001:8.0:1773851855.198098:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637152147262464 : -106921562289152 : ffff9ec16242cc00)
00000100:00000001:8.0:1773851855.198099:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851855.198100:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851855.198101:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005de312e6.
00000020:00000010:8.0:1773851855.198102:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851855.198103:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851855.198104:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851855.198105:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851855.198105:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851855.198106:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851855.198107:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851855.198107:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851855.198108:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851855.198109:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851855.198109:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851855.198110:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851855.198110:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851855.198111:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23506@kfi7, seq: 2130725
00000100:00000001:10.0:1773851855.198112:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851855.198112:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851855.198112:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b73932b : new rpc_count 2
00000100:00000001:8.0:1773851855.198112:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792158208 : -106938917393408 : ffff9ebd57d0ec00)
00000100:00000040:8.0:1773851855.198114:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000080acc760 x1859597917030912/t0(0) o400->afc43426-7358-4285-8350-05d8e010e254@23506@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1957-0'
00000100:00000001:8.0:1773851855.198116:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851855.198117:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851855.198118:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080acc760 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:afc43426-7358-4285-8350-05d8e010e254+40:39729:x1859597917030912:12345-23506@kfi7:400:default-tuolumne1957-0
00000100:00000200:8.0:1773851855.198119:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597917030912
00000020:00000001:8.0:1773851855.198120:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851855.198120:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851855.198121:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.198122:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851855.198122:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851855.198123:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851855.198124:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597917030912, found 0 last_xid 1859597916462655
00000020:00000001:8.0:1773851855.198124:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851855.198125:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851855.198126:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851855.198126:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.198127:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851855.198127:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851855.198128:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851855.198129:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea992775.
02000000:00000001:8.0:1773851855.198130:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851855.198130:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.198131:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851855.198132:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593494, transno 0, xid 1859597917030912
00010000:00000001:8.0:1773851855.198133:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851855.198134:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000080acc760 x1859597917030912/t0(0) o400->afc43426-7358-4285-8350-05d8e010e254@23506@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1957-0'
00010000:00000001:8.0:1773851855.198136:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851855.198137:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851855.198137:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=88 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851855.198139:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851855.198140:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000988e1f20 refcount 3 to 23506@kfi7
00000100:00000001:8.0:1773851855.198140:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899609984 : -107146809941632 : ffff9e8cf0746180)
02000000:00000001:8.0:1773851855.198141:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851855.198142:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851855.198142:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851855.198143:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23506@kfi7
00000400:00000010:8.0:1773851855.198144:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc809cf6.
00000100:00000200:8.0:1773851855.198145:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597917030912, offset 224
00000400:00000200:8.0:1773851855.198146:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23506@kfi7
00000400:00000200:8.0:1773851855.198147:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:8.0:1773851855.198148:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 1
00000400:00000200:8.0:1773851855.198149:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000400:00000200:8.0:1773851855.198150:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 3
00000400:00000200:8.0:1773851855.198151:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23506@kfi7 local destination
00000400:00000200:8.0:1773851855.198153:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768636:8768636:1024:4294967295] 23506@kfi7 LPNI seq info [598678:598678:16:4294967295]
00000400:00000200:8.0:1773851855.198154:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000400:00000200:8.0:1773851855.198155:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:8.0:1773851855.198157:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23506@kfi7(23506@kfi7:23506@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851855.198158:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 3
00000800:00000200:8.0:1773851855.198160:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851855.198162:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851855.198164:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851855.198166:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000103 Using peer 23506@kfi7(0x100000000000103)
00000800:00000200:8.0:1773851855.198169:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x100000000000103: rc=0
00000800:00000200:8.0:1773851855.198170:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851855.198172:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851855.198173:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000988e1f20 refcount 2 to 23506@kfi7
00010000:00000001:8.0:1773851855.198174:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851855.198175:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.198175:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851855.198176:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000080acc760 x1859597917030912/t0(0) o400->afc43426-7358-4285-8350-05d8e010e254@23506@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1957-0'
00000100:00100000:8.0:1773851855.198181:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080acc760 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:afc43426-7358-4285-8350-05d8e010e254+40:39729:x1859597917030912:12345-23506@kfi7:400:default-tuolumne1957-0 Request processed in 64us (95us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851855.198184:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23506@kfi7, seq: 2130725
00000100:00000040:8.0:1773851855.198184:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b73932b : new rpc_count 1
00000100:00000001:8.0:1773851855.198185:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851855.198186:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851855.198186:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851855.198187:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851855.198188:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005de312e6.
00000020:00000040:8.0:1773851855.198189:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004b73932b : new refcount 39
00000100:00000001:8.0:1773851855.198189:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851855.198194:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000103 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851855.198196:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851855.198197:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23506@kfi7: PUT: OK
00000400:00000200:9.0:1773851855.198198:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc809cf6
00000400:00000010:9.0:1773851855.198198:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc809cf6.
00000100:00000001:9.0:1773851855.198199:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851855.198199:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851855.198200:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000800:00000200:9.0:1773851855.198202:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 23506@kfi7(00000000d230f60a):0x0 lsk 260 rsk 25 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000103 Transaction freed
00000800:00000200:18.0:1773851855.232067:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851855.232068:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851855.232069:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2069@kfi7:4 <- 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851855.232072:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2069@kfi7:4 <- 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851855.232074:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.232075:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21936@kfi7 : PUT - for me
00000400:00000200:18.0:1773851855.232076:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.232078:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 1
00000400:00000200:18.0:1773851855.232079:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.232080:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000400:00000200:18.0:1773851855.232080:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 3
00000400:00000200:18.0:1773851855.232081:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.232082:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21936@kfi7 of length 224 into portal 12 MB=0x69b4c401cc5c0
00000400:00000200:18.0:1773851855.232084:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21936@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 189632
00000800:00000200:18.0:1773851855.232086:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2069@kfi7:4 <- 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851855.232087:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851855.232088:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21936@kfi7: PUT: OK
00000100:00000001:18.0:1773851855.232090:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851855.232090:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851855.232091:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001fe91f27.
00000100:00000040:18.0:1773851855.232092:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001fe91f27 x1859601655711168 msgsize 224
00000100:00100000:18.0:1773851855.232093:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-21936@kfi7 (source: 12345-21936@kfi7)
00000100:00000001:18.0:1773851855.232095:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851855.232096:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000800:00000200:18.0:1773851855.232097:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2069@kfi7:4 <- 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851855.232100:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851855.232100:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851855.232101:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851855.232101:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851855.232102:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851855.232103:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601655711168
00000020:00000001:18.0:1773851855.232103:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851855.232104:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff85864
00000020:00000001:18.0:1773851855.232104:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851855.232106:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006e40c48f refcount=7
00000020:00000001:18.0:1773851855.232107:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636942363377664 : -107131346173952 : ffff9e908a2ac000)
00000020:00000001:18.0:1773851855.232107:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636942363377664 : -107131346173952 : ffff9e908a2ac000)
00000100:00000001:18.0:1773851855.232108:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851855.232110:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851855.232111:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009c31097.
00000020:00000010:18.0:1773851855.232112:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851855.232113:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851855.232114:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851855.232114:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851855.232115:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851855.232116:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851855.232116:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851855.232117:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.232118:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851855.232119:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851855.232119:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851855.232120:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:18.0:1773851855.232120:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21936@kfi7, seq: 2156259
00000100:00000001:19.0:1773851855.232121:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:18.0:1773851855.232121:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006e40c48f : new rpc_count 1
00000100:00000001:19.0:1773851855.232122:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.232122:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534646912 : -106946174904704 : ffff9ebba73c1680)
00000100:00000001:19.0:1773851855.232123:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851855.232123:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001fe91f27 x1859601655711168/t0(0) o400->422cd82f-f001-4d23-a8f6-51fae3e05432@21936@kfi7:45/0 lens 224/0 e 0 to 0 dl 1773852160 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1854-0'
00000100:00000001:18.0:1773851855.232125:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851855.232126:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851855.232127:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fe91f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:422cd82f-f001-4d23-a8f6-51fae3e05432+7:39770:x1859601655711168:12345-21936@kfi7:400:default-tuolumne1854-0
00000100:00000200:18.0:1773851855.232128:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601655711168
00000020:00000001:18.0:1773851855.232129:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851855.232129:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851855.232130:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.232131:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851855.232131:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851855.232132:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851855.232133:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601655711168, found 0 last_xid 1859601655711167
00000020:00000001:18.0:1773851855.232134:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851855.232134:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851855.232135:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851855.232136:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.232137:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851855.232137:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851855.232138:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851855.232139:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000025fb9ec7.
02000000:00000001:18.0:1773851855.232139:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.232140:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.232141:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851855.232141:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044163794, transno 0, xid 1859601655711168
00010000:00000001:18.0:1773851855.232142:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851855.232143:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001fe91f27 x1859601655711168/t0(0) o400->422cd82f-f001-4d23-a8f6-51fae3e05432@21936@kfi7:45/0 lens 224/224 e 0 to 0 dl 1773852160 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1854-0'
00010000:00000001:18.0:1773851855.232146:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851855.232146:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851855.232147:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=88 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851855.232148:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851855.232149:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000045e3ff1 refcount 3 to 21936@kfi7
00000100:00000001:18.0:1773851855.232149:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958304 : -107156125593312 : ffff9e8ac532d120)
02000000:00000001:18.0:1773851855.232150:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851855.232151:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.232151:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851855.232152:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21936@kfi7
00000400:00000010:18.0:1773851855.232153:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2ef0da5.
00000100:00000200:18.0:1773851855.232154:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601655711168, offset 224
00000400:00000200:18.0:1773851855.232155:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21936@kfi7
00000400:00000200:18.0:1773851855.232156:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.232157:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 1
00000400:00000200:18.0:1773851855.232158:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000400:00000200:18.0:1773851855.232159:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 3
00000400:00000200:18.0:1773851855.232160:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21936@kfi7 local destination
00000400:00000200:18.0:1773851855.232161:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768637:8768637:1024:4294967295] 21936@kfi7 LPNI seq info [1100427:1100427:16:4294967295]
00000400:00000200:18.0:1773851855.232162:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000400:00000200:18.0:1773851855.232163:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.232165:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21936@kfi7(21936@kfi7:21936@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851855.232166:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 3
00000800:00000200:18.0:1773851855.232168:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851855.232169:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851855.232171:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851855.232173:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x66c Using peer 21936@kfi7(0x66c)
00000800:00000200:18.0:1773851855.232176:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000008e2a52ba: Posted send of 324 bytes to peer 0x66c: rc=0
00000800:00000200:18.0:1773851855.232177:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x66c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851855.232179:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851855.232180:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000045e3ff1 refcount 2 to 21936@kfi7
00010000:00000001:18.0:1773851855.232181:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851855.232182:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.232182:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851855.232183:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001fe91f27 x1859601655711168/t0(0) o400->422cd82f-f001-4d23-a8f6-51fae3e05432@21936@kfi7:45/0 lens 224/224 e 0 to 0 dl 1773852160 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1854-0'
00000100:00100000:18.0:1773851855.232186:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fe91f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:422cd82f-f001-4d23-a8f6-51fae3e05432+7:39770:x1859601655711168:12345-21936@kfi7:400:default-tuolumne1854-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851855.232188:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21936@kfi7, seq: 2156259
00000100:00000040:18.0:1773851855.232189:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006e40c48f : new rpc_count 0
00000100:00000001:18.0:1773851855.232190:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851855.232190:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851855.232191:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851855.232191:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000020:00000010:18.0:1773851855.232192:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009c31097.
00000800:00000200:17.0:1773851855.232192:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x66c TN_EVENT_TX_OK event status 0
00000020:00000040:18.0:1773851855.232193:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000006e40c48f : new refcount 6
00000100:00000001:18.0:1773851855.232194:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851855.232195:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851855.232197:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21936@kfi7: PUT: OK
00000400:00000200:17.0:1773851855.232199:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2ef0da5
00000400:00000010:17.0:1773851855.232200:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2ef0da5.
00000100:00000001:17.0:1773851855.232201:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851855.232202:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851855.232203:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000800:00000200:17.0:1773851855.232205:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 21936@kfi7(000000001901822c):0x0 lsk 1645 rsk 7 tsk 0 trmk 0 tmk 0 trr 4 tta 0x66c Transaction freed
00000800:00000200:9.0:1773851855.250162:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851855.250163:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851855.250164:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851855.250166:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851855.250168:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11314@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.250169:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11314@kfi7 : PUT - for me
00000400:00000200:9.0:1773851855.250170:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11314@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.250170:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2586dee nid 11314@kfi7 refs 1
00000400:00000200:9.0:1773851855.250172:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11314@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.250172:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2586dee nid 11314@kfi7 refs 2
00000400:00000200:9.0:1773851855.250173:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2586dee nid 11314@kfi7 refs 3
00000400:00000200:9.0:1773851855.250174:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11314@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.250175:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11314@kfi7 of length 224 into portal 12 MB=0x69b4615c94f80
00000400:00000200:9.0:1773851855.250177:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11314@kfi7 of length 224/224 into md 0x78146ce49 [64] + 119448
00000800:00000200:9.0:1773851855.250179:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851855.250180:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851855.250181:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11314@kfi7: PUT: OK
00000100:00000001:9.0:1773851855.250182:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851855.250182:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851855.250183:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006d139e4f.
00000100:00000040:9.0:1773851855.250184:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006d139e4f x1859575175794560 msgsize 224
00000100:00100000:9.0:1773851855.250186:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-11314@kfi7 (source: 12345-11314@kfi7)
00000100:00000001:9.0:1773851855.250187:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851855.250188:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2586dee nid 11314@kfi7 refs 2
00000100:00000001:8.0:1773851855.250188:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851855.250189:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851855.250189:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851855.250189:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851855.250190:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851855.250192:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851855.250192:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575175794560
00000020:00000001:8.0:1773851855.250193:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851855.250193:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc1625bd2
00000020:00000001:8.0:1773851855.250194:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851855.250196:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c9d51102 refcount=5
00000020:00000001:8.0:1773851855.250197:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636951682809856 : -107122026741760 : ffff9e92b5a60000)
00000020:00000001:8.0:1773851855.250198:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636951682809856 : -107122026741760 : ffff9e92b5a60000)
00000100:00000001:8.0:1773851855.250199:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851855.250200:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851855.250200:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025dffd82.
00000020:00000010:8.0:1773851855.250201:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851855.250202:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851855.250203:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851855.250204:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851855.250204:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851855.250205:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851855.250206:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851855.250206:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851855.250207:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851855.250208:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851855.250209:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851855.250210:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851855.250210:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851855.250210:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11314@kfi7, seq: 2130726
00000100:00000001:10.0:1773851855.250211:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851855.250211:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c9d51102 : new rpc_count 1
00000100:00000001:8.0:1773851855.250211:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134792135168 : -106938917416448 : ffff9ebd57d09200)
00000100:00000001:10.0:1773851855.250212:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851855.250213:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006d139e4f x1859575175794560/t0(0) o400->a4116574-99d7-4066-84ca-5c1f0babb33d@11314@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1193-0'
00000100:00000001:8.0:1773851855.250215:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851855.250216:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851855.250217:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d139e4f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a4116574-99d7-4066-84ca-5c1f0babb33d+5:39751:x1859575175794560:12345-11314@kfi7:400:default-tuolumne1193-0
00000100:00000200:8.0:1773851855.250218:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575175794560
00000020:00000001:8.0:1773851855.250219:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851855.250221:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851855.250222:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.250223:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851855.250223:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851855.250224:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851855.250225:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575175794560, found 0 last_xid 1859575175794559
00000020:00000001:8.0:1773851855.250226:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851855.250226:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851855.250227:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851855.250227:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.250228:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851855.250228:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851855.250229:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851855.250230:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008329506d.
02000000:00000001:8.0:1773851855.250230:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851855.250231:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.250231:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851855.250232:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096699884, transno 0, xid 1859575175794560
00010000:00000001:8.0:1773851855.250233:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851855.250234:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006d139e4f x1859575175794560/t0(0) o400->a4116574-99d7-4066-84ca-5c1f0babb33d@11314@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1193-0'
00010000:00000001:8.0:1773851855.250236:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851855.250237:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851855.250238:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=88 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851855.250239:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851855.250239:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cb93b61e refcount 3 to 11314@kfi7
00000100:00000001:8.0:1773851855.250240:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810486464 : -107154899065152 : ffff9e8b0e4e26c0)
02000000:00000001:8.0:1773851855.250241:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851855.250241:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851855.250242:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851855.250243:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11314@kfi7
00000400:00000010:8.0:1773851855.250244:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000369ff48e.
00000100:00000200:8.0:1773851855.250244:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575175794560, offset 224
00000400:00000200:8.0:1773851855.250246:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11314@kfi7
00000400:00000200:8.0:1773851855.250246:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11314@kfi7 to cpt 2
00000400:00000200:8.0:1773851855.250248:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2586dee nid 11314@kfi7 refs 1
00000400:00000200:8.0:1773851855.250249:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2586dee nid 11314@kfi7 refs 2
00000400:00000200:8.0:1773851855.250250:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2586dee nid 11314@kfi7 refs 3
00000400:00000200:8.0:1773851855.250251:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11314@kfi7 local destination
00000400:00000200:8.0:1773851855.250252:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768638:8768638:1024:4294967295] 11314@kfi7 LPNI seq info [417021:417021:16:4294967295]
00000400:00000200:8.0:1773851855.250253:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b2586dee nid 11314@kfi7 refs 2
00000400:00000200:8.0:1773851855.250254:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11314@kfi7 to cpt 2
00000400:00000200:8.0:1773851855.250256:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11314@kfi7(11314@kfi7:11314@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851855.250257:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2586dee nid 11314@kfi7 refs 3
00000800:00000200:8.0:1773851855.250258:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851855.250259:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851855.250261:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851855.250264:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x904 Using peer 11314@kfi7(0x904)
00000800:00000200:8.0:1773851855.250267:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x904: rc=0
00000800:00000200:8.0:1773851855.250268:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x904 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851855.250271:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851855.250271:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cb93b61e refcount 2 to 11314@kfi7
00010000:00000001:8.0:1773851855.250272:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851855.250273:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851855.250273:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851855.250274:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006d139e4f x1859575175794560/t0(0) o400->a4116574-99d7-4066-84ca-5c1f0babb33d@11314@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1193-0'
00000100:00100000:8.0:1773851855.250278:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d139e4f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a4116574-99d7-4066-84ca-5c1f0babb33d+5:39751:x1859575175794560:12345-11314@kfi7:400:default-tuolumne1193-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851855.250280:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11314@kfi7, seq: 2130726
00000100:00000040:8.0:1773851855.250282:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c9d51102 : new rpc_count 0
00000100:00000001:8.0:1773851855.250282:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851855.250283:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851855.250283:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851855.250284:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851855.250285:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025dffd82.
00000020:00000040:8.0:1773851855.250286:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c9d51102 : new refcount 4
00000100:00000001:8.0:1773851855.250287:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851855.250294:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x904 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851855.250295:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851855.250296:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11314@kfi7: PUT: OK
00000400:00000200:9.0:1773851855.250297:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000369ff48e
00000400:00000010:9.0:1773851855.250297:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000369ff48e.
00000100:00000001:9.0:1773851855.250298:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851855.250298:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851855.250299:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2586dee nid 11314@kfi7 refs 2
00000800:00000200:9.0:1773851855.250301:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 11314@kfi7(000000004a5acda1):0x0 lsk 2309 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x904 Transaction freed
00000800:00000200:10.0:1773851855.268488:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851855.268488:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851855.268488:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851855.268488:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851855.268490:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851855.268490:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851855.268492:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851855.268492:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8306@kfi7(00000000ff0bc860):0x10df version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851855.268493:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:10.0:1773851855.268494:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8306@kfi7 : PUT - for me
00000800:00000200:9.0:1773851855.268494:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df Using peer 8306@kfi7(0x14000000000010df)
00000400:00000200:10.0:1773851855.268495:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:10.0:1773851855.268496:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e09805 nid 8306@kfi7 refs 1
00000400:00000200:10.0:1773851855.268497:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:10.0:1773851855.268498:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e09805 nid 8306@kfi7 refs 2
00000400:00000200:10.0:1773851855.268499:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000055e09805 nid 8306@kfi7 refs 3
00000400:00000200:10.0:1773851855.268500:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:9.0:1773851855.268500:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:10.0:1773851855.268501:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8370@kfi7 of length 456 into portal 12 MB=0x699e51b750140
00000800:00000200:9.0:1773851855.268501:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 38 bytes to peer 0x14000000000010df: rc=0
00000400:00000200:10.0:1773851855.268502:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8370@kfi7 of length 456/456 into md 0x78146ce49 [64] + 119672
00000800:00000200:9.0:1773851855.268503:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:10.0:1773851855.268504:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851855.268505:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851855.268506:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8306@kfi7: PUT: OK
00000100:00000001:10.0:1773851855.268507:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851855.268507:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851855.268508:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d974bf9f.
00000100:00000040:10.0:1773851855.268508:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000d974bf9f x1858059147477312 msgsize 456
00000100:00100000:10.0:1773851855.268510:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-8370@kfi7 (source: 12345-8306@kfi7)
00000100:00000001:10.0:1773851855.268511:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851855.268512:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000055e09805 nid 8306@kfi7 refs 2
00000100:00000001:11.0:1773851855.268513:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851855.268513:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851855.268513:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851855.268514:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851855.268515:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851855.268515:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df TN_EVENT_TX_OK event status 0
02000000:00000001:11.0:1773851855.268516:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851855.268516:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059147477312
00000020:00000001:11.0:1773851855.268517:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851855.268517:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91888
00000020:00000001:11.0:1773851855.268518:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:9.0:1773851855.268518:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df Transaction freed
00000020:00000040:11.0:1773851855.268524:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076ee99f4 refcount=21
00000020:00000001:11.0:1773851855.268525:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000020:00000001:11.0:1773851855.268525:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000100:00000001:11.0:1773851855.268526:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851855.268527:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851855.268527:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009503e737.
00000020:00000010:11.0:1773851855.268528:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851855.268529:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b8cf8b34.
00000100:00000001:11.0:1773851855.268530:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851855.268530:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851855.268530:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.268531:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.268532:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851855.268533:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851855.268534:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851855.268534:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851855.268534:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851855.268535:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8370@kfi7, seq: 406391002
00000100:00000040:11.0:1773851855.268536:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000076ee99f4 : new rpc_count 4
00000100:00000001:11.0:1773851855.268536:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077431552 : -106968632120064 : ffff9eb66cae2d00)
00000100:00000001:10.0:1773851855.268536:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851855.268536:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851855.268537:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d974bf9f x1858059147477312/t0(0) o17->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:72/0 lens 456/0 e 0 to 0 dl 1773852187 ref 1 fl New:/0/ffffffff rc 0/-1 job:'login-tuolumne1002-0'
00000100:00000001:11.0:1773851855.268540:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851855.268541:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851855.268542:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d974bf9f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8f68da36-21fb-4bf8-b064-ed0ff3e25ba4+21:40661:x1858059147477312:12345-8370@kfi7:17:login-tuolumne1002-0
00000100:00000200:11.0:1773851855.268543:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059147477312
00000020:00000001:11.0:1773851855.268544:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851855.268544:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851855.268546:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.268546:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851855.268547:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:11.0:1773851855.268548:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851855.268548:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858059147477312, found 0 last_xid 1858059146981631
00000020:00000001:11.0:1773851855.268549:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851855.268550:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851855.268550:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851855.268551:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851855.268552:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:11.0:1773851855.268552:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851855.268553:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851855.268554:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000709d11da.
02000000:00000001:11.0:1773851855.268554:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.268555:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.268556:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:11.0:1773851855.268557:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:11.0:1773851855.268558:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851855.268559:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.268560:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851855.268561:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4/0000000076ee99f4 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851855.268562:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851855.268562:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4/0000000076ee99f4 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851855.268564:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851855.268564:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:11.0:1773851855.268565:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4/0000000076ee99f4 reports grant 1807613951 dropped 0, local 1875771391
00000020:00000001:11.0:1773851855.268566:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:11.0:1773851855.268566:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:11.0:1773851855.268567:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851855.268568:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183226748786, transno 0, xid 1858059147477312
00010000:00000001:11.0:1773851855.268568:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851855.268569:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d974bf9f x1858059147477312/t0(0) o17->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:72/0 lens 456/432 e 0 to 0 dl 1773852187 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne1002-0'
00010000:00000001:11.0:1773851855.268575:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851855.268575:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851855.268576:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=88 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851855.268577:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851855.268577:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000049078092 refcount 3 to 8370@kfi7
00000100:00000001:11.0:1773851855.268578:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336256 : -107152617215360 : ffff9e8b96506a80)
02000000:00000001:11.0:1773851855.268579:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851855.268580:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.268580:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851855.268581:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8306@kfi7
00000400:00000010:11.0:1773851855.268582:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000100:00000200:11.0:1773851855.268583:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858059147477312, offset 224
00000400:00000200:11.0:1773851855.268584:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8306@kfi7
00000400:00000200:11.0:1773851855.268585:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:11.0:1773851855.268586:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e09805 nid 8306@kfi7 refs 1
00000400:00000200:11.0:1773851855.268587:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000055e09805 nid 8306@kfi7 refs 2
00000400:00000200:11.0:1773851855.268588:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000055e09805 nid 8306@kfi7 refs 3
00000400:00000200:11.0:1773851855.268589:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8306@kfi7 local destination
00000400:00000200:11.0:1773851855.268590:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768639:8768639:1024:4294967295] 8306@kfi7 LPNI seq info [34722292:34722292:16:4294967295]
00000400:00000200:11.0:1773851855.268592:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000055e09805 nid 8306@kfi7 refs 2
00000400:00000200:11.0:1773851855.268593:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:11.0:1773851855.268595:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8306@kfi7(8306@kfi7:8306@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851855.268596:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000055e09805 nid 8306@kfi7 refs 3
00000800:00000200:11.0:1773851855.268597:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851855.268598:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:11.0:1773851855.268601:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851855.268603:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df Using peer 8306@kfi7(0x14000000000010df)
00000800:00000200:11.0:1773851855.268610:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 532 bytes to peer 0x14000000000010df: rc=0
00000800:00000200:11.0:1773851855.268612:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851855.268613:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851855.268614:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000049078092 refcount 2 to 8370@kfi7
00010000:00000001:11.0:1773851855.268615:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851855.268615:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.268616:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851855.268617:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d974bf9f x1858059147477312/t0(0) o17->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:72/0 lens 456/432 e 0 to 0 dl 1773852187 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne1002-0'
00000100:00100000:11.0:1773851855.268620:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d974bf9f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8f68da36-21fb-4bf8-b064-ed0ff3e25ba4+21:40661:x1858059147477312:12345-8370@kfi7:17:login-tuolumne1002-0 Request processed in 79us (110us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851855.268622:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8370@kfi7, seq: 406391002
00000100:00000040:11.0:1773851855.268623:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000076ee99f4 : new rpc_count 3
00000800:00000200:9.0:1773851855.268623:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851855.268624:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851855.268624:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851855.268625:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851855.268625:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851855.268626:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b8cf8b34.
00000020:00000010:11.0:1773851855.268626:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009503e737.
00000400:00000200:9.0:1773851855.268626:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8306@kfi7: PUT: OK
00000020:00000040:11.0:1773851855.268627:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 20
00000400:00000200:9.0:1773851855.268627:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000400:00000010:9.0:1773851855.268627:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000100:00000001:11.0:1773851855.268628:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851855.268628:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851855.268628:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851855.268629:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000055e09805 nid 8306@kfi7 refs 2
00000800:00000200:9.0:1773851855.268630:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 8306@kfi7(00000000ff0bc860):0x0 lsk 4320 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14000000000010df Transaction freed
00000800:00000200:29.0:1773851855.357669:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.357670:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.357671:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.357673:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851855.357675:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21458@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.357676:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21458@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.357677:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21458@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.357678:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9e16c60 nid 21458@kfi7 refs 1
00000400:00000200:29.0:1773851855.357680:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21458@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.357680:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9e16c60 nid 21458@kfi7 refs 2
00000400:00000200:29.0:1773851855.357682:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c9e16c60 nid 21458@kfi7 refs 3
00000400:00000200:29.0:1773851855.357682:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21266@kfi7 to cpt 5
00000400:00000200:29.0:1773851855.357683:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21266@kfi7 of length 224 into portal 12 MB=0x69b0470d24040
00000400:00000200:29.0:1773851855.357685:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21266@kfi7 of length 224/224 into md 0x77fe139dd [64] + 162464
00000800:00000200:29.0:1773851855.357687:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851855.357689:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.357690:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21458@kfi7: PUT: OK
00000100:00000001:29.0:1773851855.357691:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851855.357692:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851855.357693:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000217c2e7.
00000100:00000040:29.0:1773851855.357693:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000000217c2e7 x1859293235265600 msgsize 224
00000100:00100000:29.0:1773851855.357695:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21266@kfi7 (source: 12345-21458@kfi7)
00000100:00000001:29.0:1773851855.357696:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851855.357697:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9e16c60 nid 21458@kfi7 refs 2
00000100:00000001:31.0:1773851855.357698:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851855.357698:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851855.357699:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851855.357699:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851855.357699:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851855.357700:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851855.357701:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859293235265600
00000020:00000001:31.0:1773851855.357702:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851855.357702:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e07
00000020:00000001:31.0:1773851855.357703:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851855.357706:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077696ad0 refcount=154
00000020:00000001:31.0:1773851855.357707:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628766720 : -107123080784896 : ffff9e9276d29400)
00000020:00000001:31.0:1773851855.357708:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628766720 : -107123080784896 : ffff9e9276d29400)
00000100:00000001:31.0:1773851855.357709:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851855.357709:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851855.357710:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025d2a996.
00000020:00000010:31.0:1773851855.357711:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851855.357712:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851855.357713:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851855.357713:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851855.357714:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.357715:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851855.357715:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851855.357716:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.357716:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.357718:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.357718:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851855.357718:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851855.357718:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851855.357719:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21266@kfi7, seq: 2055463
00000100:00000040:31.0:1773851855.357720:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077696ad0 : new rpc_count 4
00000100:00000001:29.0:1773851855.357720:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.357721:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165180389632 : -106908529161984 : ffff9ec46b188900)
00000100:00000001:29.0:1773851855.357721:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851855.357722:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000217c2e7 x1859293235265600/t0(0) o400->7b563c47-b54f-4bbf-9f5d-206172800050@21266@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1829-0'
00000100:00000001:31.0:1773851855.357728:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851855.357729:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851855.357730:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000217c2e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:7b563c47-b54f-4bbf-9f5d-206172800050+154:39877:x1859293235265600:12345-21266@kfi7:400:default-tuolumne1829-0
00000100:00000200:31.0:1773851855.357732:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859293235265600
00000020:00000001:31.0:1773851855.357732:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851855.357733:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851855.357734:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.357734:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851855.357735:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851855.357736:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851855.357736:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859293235265600, found 0 last_xid 1859293200979327
00000020:00000001:31.0:1773851855.357737:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851855.357738:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851855.357739:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851855.357739:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.357740:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851855.357740:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851855.357741:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851855.357741:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009f353d06.
02000000:00000001:31.0:1773851855.357742:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.357743:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.357743:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851855.357744:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593816, transno 0, xid 1859293235265600
00010000:00000001:31.0:1773851855.357745:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851855.357745:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000217c2e7 x1859293235265600/t0(0) o400->7b563c47-b54f-4bbf-9f5d-206172800050@21266@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1829-0'
00010000:00000001:31.0:1773851855.357748:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851855.357748:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851855.357749:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851855.357750:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851855.357751:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3d85de1 refcount 3 to 21266@kfi7
00000100:00000001:31.0:1773851855.357751:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025472 : -107156745526144 : ffff9e8aa03f6480)
02000000:00000001:31.0:1773851855.357752:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851855.357753:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.357754:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851855.357754:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21458@kfi7
00000400:00000010:31.0:1773851855.357755:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004e2b8359.
00000100:00000200:31.0:1773851855.357757:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859293235265600, offset 224
00000400:00000200:31.0:1773851855.357758:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21458@kfi7
00000400:00000200:31.0:1773851855.357759:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21458@kfi7 to cpt 7
00000400:00000200:31.0:1773851855.357760:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9e16c60 nid 21458@kfi7 refs 1
00000400:00000200:31.0:1773851855.357761:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c9e16c60 nid 21458@kfi7 refs 2
00000400:00000200:31.0:1773851855.357762:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c9e16c60 nid 21458@kfi7 refs 3
00000400:00000200:31.0:1773851855.357763:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21458@kfi7 local destination
00000400:00000200:31.0:1773851855.357764:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768640:8768640:1024:4294967295] 21458@kfi7 LPNI seq info [1247030:1247030:16:4294967295]
00000400:00000200:31.0:1773851855.357766:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c9e16c60 nid 21458@kfi7 refs 2
00000400:00000200:31.0:1773851855.357766:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21458@kfi7 to cpt 7
00000400:00000200:31.0:1773851855.357768:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21458@kfi7(21458@kfi7:21458@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851855.357769:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c9e16c60 nid 21458@kfi7 refs 3
00000800:00000200:31.0:1773851855.357771:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851855.357772:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851855.357774:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851855.357776:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xca0 Using peer 21458@kfi7(0xca0)
00000800:00000200:31.0:1773851855.357779:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0xca0: rc=0
00000800:00000200:31.0:1773851855.357780:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xca0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851855.357782:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851855.357783:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3d85de1 refcount 2 to 21266@kfi7
00010000:00000001:31.0:1773851855.357784:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851855.357784:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.357785:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851855.357786:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000217c2e7 x1859293235265600/t0(0) o400->7b563c47-b54f-4bbf-9f5d-206172800050@21266@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1829-0'
00000100:00100000:31.0:1773851855.357788:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000217c2e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:7b563c47-b54f-4bbf-9f5d-206172800050+154:39877:x1859293235265600:12345-21266@kfi7:400:default-tuolumne1829-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851855.357791:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21266@kfi7, seq: 2055463
00000100:00000040:31.0:1773851855.357792:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077696ad0 : new rpc_count 3
00000100:00000001:31.0:1773851855.357793:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851855.357793:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851855.357793:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xca0 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851855.357794:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851855.357795:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851855.357795:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025d2a996.
00000400:00000200:29.0:1773851855.357795:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851855.357796:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000077696ad0 : new refcount 153
00000400:00000200:29.0:1773851855.357796:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21458@kfi7: PUT: OK
00000100:00000001:31.0:1773851855.357797:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851855.357797:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004e2b8359
00000400:00000010:29.0:1773851855.357798:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004e2b8359.
00000100:00000001:29.0:1773851855.357798:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851855.357799:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851855.357800:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9e16c60 nid 21458@kfi7 refs 2
00000800:00000200:29.0:1773851855.357801:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 21458@kfi7(000000000de5b455):0x0 lsk 3233 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xca0 Transaction freed
00000800:00000200:17.0:1773851855.358795:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851855.358796:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851855.358797:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851855.358799:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851855.358800:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:17.0:1773851855.358801:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17009@kfi7 : PUT - for me
00000400:00000200:17.0:1773851855.358802:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:17.0:1773851855.358803:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 1
00000400:00000200:17.0:1773851855.358804:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:17.0:1773851855.358805:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000400:00000200:17.0:1773851855.358806:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 3
00000400:00000200:17.0:1773851855.358806:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17008@kfi7 to cpt 1
00000400:00000200:17.0:1773851855.358807:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17008@kfi7 of length 224 into portal 12 MB=0x69b4b5abb6cc0
00000400:00000200:17.0:1773851855.358808:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17008@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 189856
00000800:00000200:17.0:1773851855.358810:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851855.358811:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851855.358812:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17009@kfi7: PUT: OK
00000100:00000001:17.0:1773851855.358813:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851855.358813:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851855.358815:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000025e3f153.
00000100:00000040:17.0:1773851855.358815:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000025e3f153 x1859597807348928 msgsize 224
00000100:00100000:17.0:1773851855.358816:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-17008@kfi7 (source: 12345-17009@kfi7)
00000100:00000001:17.0:1773851855.358817:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851855.358818:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000100:00000001:18.0:1773851855.358819:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851855.358819:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851855.358819:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851855.358820:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851855.358821:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851855.358821:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851855.358822:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597807348928
00000020:00000001:18.0:1773851855.358823:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851855.358823:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822fb
00000020:00000001:18.0:1773851855.358823:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851855.358829:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d4a35379 refcount=167
00000020:00000001:18.0:1773851855.358830:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131280826368 : -106942428725248 : ffff9ebc86864000)
00000020:00000001:18.0:1773851855.358830:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131280826368 : -106942428725248 : ffff9ebc86864000)
00000100:00000001:18.0:1773851855.358831:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851855.358832:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851855.358833:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009c31097.
00000020:00000010:18.0:1773851855.358834:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851855.358835:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851855.358835:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851855.358836:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851855.358836:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851855.358837:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851855.358838:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851855.358838:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.358839:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851855.358840:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851855.358840:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851855.358841:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851855.358841:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851855.358842:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851855.358842:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17008@kfi7, seq: 2156260
00000100:00000040:18.0:1773851855.358842:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d4a35379 : new rpc_count 1
00000100:00000001:19.0:1773851855.358843:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.358843:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405311488 : -106994304240128 : ffff9eb07280b600)
00000100:00000040:18.0:1773851855.358844:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000025e3f153 x1859597807348928/t0(0) o400->2f6dbe94-2578-485e-84cf-f4e45b43989a@17008@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1550-0'
00000100:00000001:18.0:1773851855.358847:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851855.358847:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851855.358848:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025e3f153 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:2f6dbe94-2578-485e-84cf-f4e45b43989a+167:39568:x1859597807348928:12345-17008@kfi7:400:default-tuolumne1550-0
00000100:00000200:18.0:1773851855.358849:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597807348928
00000020:00000001:18.0:1773851855.358850:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851855.358851:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851855.358851:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.358852:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851855.358852:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851855.358853:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851855.358854:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597807348928, found 0 last_xid 1859597806928447
00000020:00000001:18.0:1773851855.358854:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851855.358855:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851855.358856:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851855.358856:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.358857:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851855.358857:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851855.358858:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851855.358859:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008308567b.
02000000:00000001:18.0:1773851855.358860:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.358860:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.358861:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851855.358862:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062262, transno 0, xid 1859597807348928
00010000:00000001:18.0:1773851855.358862:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851855.358863:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000025e3f153 x1859597807348928/t0(0) o400->2f6dbe94-2578-485e-84cf-f4e45b43989a@17008@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1550-0'
00010000:00000001:18.0:1773851855.358865:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851855.358866:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851855.358867:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=88 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851855.358868:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851855.358868:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cea9c403 refcount 3 to 17008@kfi7
00000100:00000001:18.0:1773851855.358869:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740764000 : -107153968787616 : ffff9e8b45c10f60)
02000000:00000001:18.0:1773851855.358870:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851855.358870:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851855.358871:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851855.358872:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17009@kfi7
00000400:00000010:18.0:1773851855.358873:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000096a160b6.
00000100:00000200:18.0:1773851855.358873:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597807348928, offset 224
00000400:00000200:18.0:1773851855.358874:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17009@kfi7
00000400:00000200:18.0:1773851855.358878:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.358878:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 1
00000400:00000200:18.0:1773851855.358880:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000400:00000200:18.0:1773851855.358881:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 3
00000400:00000200:18.0:1773851855.358882:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17009@kfi7 local destination
00000400:00000200:18.0:1773851855.358883:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768641:8768641:1024:4294967295] 17009@kfi7 LPNI seq info [279487:279487:16:4294967295]
00000400:00000200:18.0:1773851855.358884:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000400:00000200:18.0:1773851855.358885:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:18.0:1773851855.358887:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17009@kfi7(17009@kfi7:17009@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851855.358888:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 3
00000800:00000200:18.0:1773851855.358889:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851855.358890:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851855.358892:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851855.358894:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bc4 Using peer 17009@kfi7(0x100000000000bc4)
00000800:00000200:18.0:1773851855.358897:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000582ee624: Posted send of 324 bytes to peer 0x100000000000bc4: rc=0
00000800:00000200:18.0:1773851855.358898:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bc4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851855.358900:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851855.358901:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cea9c403 refcount 2 to 17008@kfi7
00010000:00000001:18.0:1773851855.358902:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851855.358902:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851855.358903:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851855.358904:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000025e3f153 x1859597807348928/t0(0) o400->2f6dbe94-2578-485e-84cf-f4e45b43989a@17008@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1550-0'
00000100:00100000:18.0:1773851855.358906:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025e3f153 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:2f6dbe94-2578-485e-84cf-f4e45b43989a+167:39568:x1859597807348928:12345-17008@kfi7:400:default-tuolumne1550-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851855.358910:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bc4 TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851855.358911:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17008@kfi7, seq: 2156260
00000100:00000040:18.0:1773851855.358911:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d4a35379 : new rpc_count 0
00000100:00000001:18.0:1773851855.358912:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851855.358912:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851855.358912:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17009@kfi7: PUT: OK
00000100:00000001:18.0:1773851855.358913:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851855.358913:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851855.358913:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000096a160b6
00000400:00000010:17.0:1773851855.358913:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000096a160b6.
00000020:00000010:18.0:1773851855.358914:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000100:00000001:17.0:1773851855.358914:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851855.358914:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:18.0:1773851855.358915:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009c31097.
00000020:00000040:18.0:1773851855.358915:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000d4a35379 : new refcount 166
00000400:00000200:17.0:1773851855.358915:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000100:00000001:18.0:1773851855.358916:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851855.358916:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 17009@kfi7(00000000ddba255d):0x0 lsk 3013 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bc4 Transaction freed
00000800:00000200:22.0:1773851855.390144:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851855.390145:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851855.390146:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851855.390149:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851855.390151:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:22.0:1773851855.390152:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25248@kfi7 : PUT - for me
00000400:00000200:22.0:1773851855.390153:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:22.0:1773851855.390154:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 1
00000400:00000200:22.0:1773851855.390155:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:22.0:1773851855.390156:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 2
00000400:00000200:22.0:1773851855.390157:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 3
00000400:00000200:22.0:1773851855.390158:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:22.0:1773851855.390160:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25248@kfi7 of length 224 into portal 12 MB=0x69b4b9e4846c0
00000400:00000200:22.0:1773851855.390162:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25248@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 24488
00000800:00000200:22.0:1773851855.390166:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851855.390168:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851855.390170:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25248@kfi7: PUT: OK
00000100:00000001:22.0:1773851855.390172:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851855.390172:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851855.390174:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000045379983.
00000100:00000040:22.0:1773851855.390175:0:2456945:0:(events.c:358:request_in_callback()) incoming req@0000000045379983 x1859598940653248 msgsize 224
00000100:00100000:22.0:1773851855.390178:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-25248@kfi7 (source: 12345-25248@kfi7)
00000100:00000001:22.0:1773851855.390179:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851855.390181:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 2
00000100:00000001:23.0:1773851855.390182:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851855.390183:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851855.390184:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851855.390184:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851855.390184:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2069@kfi7:5 <- 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851855.390186:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851855.390187:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598940653248
00000020:00000001:23.0:1773851855.390188:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851855.390189:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3895db56
00000020:00000001:23.0:1773851855.390190:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851855.390194:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000060dded7a refcount=5
00000020:00000001:23.0:1773851855.390195:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137288117248 : -106936421434368 : ffff9ebdec963c00)
00000020:00000001:23.0:1773851855.390196:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637137288117248 : -106936421434368 : ffff9ebdec963c00)
00000100:00000001:23.0:1773851855.390198:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.390199:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851855.390200:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a6e6ffee.
00000020:00000010:23.0:1773851855.390202:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851855.390203:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851855.390204:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851855.390205:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851855.390206:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.390208:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851855.390208:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851855.390209:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.390211:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.390213:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851855.390214:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851855.390214:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851855.390214:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851855.390216:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25248@kfi7, seq: 1997928
00000100:00000040:23.0:1773851855.390217:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000060dded7a : new rpc_count 1
00000100:00000001:22.0:1773851855.390217:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.390218:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619619712 : -107003089931904 : ffff9eae66d5b180)
00000100:00000001:22.0:1773851855.390218:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.390220:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000045379983 x1859598940653248/t0(0) o400->274c2e67-cfbb-4b8c-a5eb-f77cc706a134@25248@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2064-0'
00000100:00000001:23.0:1773851855.390225:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.390226:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851855.390227:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045379983 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:274c2e67-cfbb-4b8c-a5eb-f77cc706a134+5:39586:x1859598940653248:12345-25248@kfi7:400:default-tuolumne2064-0
00000100:00000200:23.0:1773851855.390230:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598940653248
00000020:00000001:23.0:1773851855.390231:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851855.390232:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851855.390233:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.390234:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851855.390235:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851855.390236:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851855.390237:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598940653248, found 0 last_xid 1859598940653247
00000020:00000001:23.0:1773851855.390238:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851855.390239:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851855.390240:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851855.390241:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.390242:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851855.390243:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851855.390244:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851855.390246:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000040f6c533.
02000000:00000001:23.0:1773851855.390246:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.390248:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.390249:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851855.390250:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182608876305, transno 0, xid 1859598940653248
00010000:00000001:23.0:1773851855.390251:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851855.390252:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000045379983 x1859598940653248/t0(0) o400->274c2e67-cfbb-4b8c-a5eb-f77cc706a134@25248@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2064-0'
00010000:00000001:23.0:1773851855.390257:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851855.390258:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851855.390259:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=88 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851855.390261:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851855.390262:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000279c6fb refcount 3 to 25248@kfi7
00000100:00000001:23.0:1773851855.390263:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964028160 : -107156745523456 : ffff9e8aa03f6f00)
02000000:00000001:23.0:1773851855.390264:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851855.390265:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.390266:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851855.390268:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25248@kfi7
00000400:00000010:23.0:1773851855.390268:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042659cea.
00000100:00000200:23.0:1773851855.390271:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598940653248, offset 224
00000400:00000200:23.0:1773851855.390273:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25248@kfi7
00000400:00000200:23.0:1773851855.390274:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.390276:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 1
00000400:00000200:23.0:1773851855.390278:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 2
00000400:00000200:23.0:1773851855.390280:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 3
00000400:00000200:23.0:1773851855.390282:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25248@kfi7 local destination
00000400:00000200:23.0:1773851855.390284:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768642:8768642:1024:4294967295] 25248@kfi7 LPNI seq info [211828:211828:16:4294967295]
00000400:00000200:23.0:1773851855.390287:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 2
00000400:00000200:23.0:1773851855.390288:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.390291:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25248@kfi7(25248@kfi7:25248@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851855.390293:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 3
00000800:00000200:23.0:1773851855.390296:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851855.390298:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851855.390301:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851855.390305:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40b Using peer 25248@kfi7(0x40b)
00000800:00000200:23.0:1773851855.390310:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x40b: rc=0
00000800:00000200:23.0:1773851855.390312:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851855.390316:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.390317:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000279c6fb refcount 2 to 25248@kfi7
00010000:00000001:23.0:1773851855.390318:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851855.390319:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.390320:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851855.390321:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000045379983 x1859598940653248/t0(0) o400->274c2e67-cfbb-4b8c-a5eb-f77cc706a134@25248@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2064-0'
00000800:00000200:21.0:1773851855.390326:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40b TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851855.390327:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045379983 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:274c2e67-cfbb-4b8c-a5eb-f77cc706a134+5:39586:x1859598940653248:12345-25248@kfi7:400:default-tuolumne2064-0 Request processed in 100us (150us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851855.390328:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851855.390330:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25248@kfi7: PUT: OK
00000400:00000200:21.0:1773851855.390330:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042659cea
00000100:00100000:23.0:1773851855.390331:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25248@kfi7, seq: 1997928
00000400:00000010:21.0:1773851855.390331:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042659cea.
00000100:00000040:23.0:1773851855.390332:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000060dded7a : new rpc_count 0
00000100:00000001:21.0:1773851855.390332:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851855.390332:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851855.390333:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851855.390333:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 2
00000100:00000001:23.0:1773851855.390334:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851855.390335:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851855.390335:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 25248@kfi7(00000000b46ea38f):0x0 lsk 1036 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40b Transaction freed
00000020:00000010:23.0:1773851855.390336:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:23.0:1773851855.390338:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a6e6ffee.
00000020:00000040:23.0:1773851855.390339:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000060dded7a : new refcount 4
00000100:00000001:23.0:1773851855.390340:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851855.403875:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851855.403875:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851855.403877:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851855.403879:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851855.403880:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24570@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.403882:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24570@kfi7 : PUT - for me
00000400:00000200:21.0:1773851855.403883:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24570@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.403884:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009aff1588 nid 24570@kfi7 refs 1
00000400:00000200:21.0:1773851855.403885:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24570@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.403888:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009aff1588 nid 24570@kfi7 refs 2
00000400:00000200:21.0:1773851855.403889:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009aff1588 nid 24570@kfi7 refs 3
00000400:00000200:21.0:1773851855.403890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:21.0:1773851855.403891:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24571@kfi7 of length 224 into portal 12 MB=0x699de8c698e80
00000400:00000200:21.0:1773851855.403892:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24571@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 24712
00000800:00000200:21.0:1773851855.403894:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851855.403895:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851855.403896:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24570@kfi7: PUT: OK
00000100:00000001:21.0:1773851855.403897:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851855.403897:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851855.403898:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c6e938cb.
00000100:00000040:21.0:1773851855.403899:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c6e938cb x1858030977781376 msgsize 224
00000100:00100000:21.0:1773851855.403900:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24571@kfi7 (source: 12345-24570@kfi7)
00000100:00000001:21.0:1773851855.403901:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851855.403902:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009aff1588 nid 24570@kfi7 refs 2
00000100:00000001:23.0:1773851855.403903:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851855.403903:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851855.403904:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851855.403904:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851855.403904:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851855.403905:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851855.403905:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030977781376
00000020:00000001:23.0:1773851855.403906:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851855.403906:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91214
00000020:00000001:23.0:1773851855.403906:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851855.403911:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a263e624 refcount=6
00000020:00000001:23.0:1773851855.403911:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240549376 : -107152469002240 : ffff9e8b9f25f800)
00000020:00000001:23.0:1773851855.403912:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240549376 : -107152469002240 : ffff9e8b9f25f800)
00000100:00000001:23.0:1773851855.403913:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.403913:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851855.403914:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a6e6ffee.
00000020:00000010:23.0:1773851855.403914:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851855.403915:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851855.403916:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851855.403916:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851855.403917:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.403917:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851855.403918:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851855.403918:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.403919:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.403920:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851855.403921:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851855.403921:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851855.403921:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851855.403922:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24571@kfi7, seq: 1997929
00000100:00000040:23.0:1773851855.403923:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a263e624 : new rpc_count 1
00000100:00000001:23.0:1773851855.403923:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117320960 : -106995592230656 : ffff9eb025bb8900)
00000100:00000001:22.0:1773851855.403923:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851855.403923:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.403924:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c6e938cb x1858030977781376/t0(0) o400->a73f91a0-2f91-485b-93f6-c195aabf5153@24571@kfi7:495/0 lens 224/0 e 0 to 0 dl 1773852610 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne264-0'
00000100:00000001:23.0:1773851855.403927:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.403927:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851855.403928:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6e938cb pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:a73f91a0-2f91-485b-93f6-c195aabf5153+6:47880:x1858030977781376:12345-24571@kfi7:400:default-tuolumne264-0
00000100:00000200:23.0:1773851855.403929:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030977781376
00000020:00000001:23.0:1773851855.403930:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851855.403930:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851855.403931:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.403931:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851855.403932:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851855.403932:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851855.403933:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030977781376, found 0 last_xid 1858030977781375
00000020:00000001:23.0:1773851855.403933:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851855.403934:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851855.403934:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851855.403935:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.403935:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851855.403936:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851855.403936:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851855.403938:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009c315059.
02000000:00000001:23.0:1773851855.403938:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.403939:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.403939:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851855.403940:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768273, transno 0, xid 1858030977781376
00010000:00000001:23.0:1773851855.403941:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851855.403941:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c6e938cb x1858030977781376/t0(0) o400->a73f91a0-2f91-485b-93f6-c195aabf5153@24571@kfi7:495/0 lens 224/224 e 0 to 0 dl 1773852610 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne264-0'
00010000:00000001:23.0:1773851855.403947:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851855.403947:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851855.403948:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=88 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851855.403949:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851855.403949:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000792a543a refcount 5 to 24571@kfi7
00000100:00000001:23.0:1773851855.403950:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729380416 : -107155980171200 : ffff9e8acdddc840)
02000000:00000001:23.0:1773851855.403951:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851855.403951:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.403952:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851855.403953:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24570@kfi7
00000400:00000010:23.0:1773851855.403953:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042659cea.
00000100:00000200:23.0:1773851855.403954:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030977781376, offset 224
00000400:00000200:23.0:1773851855.403955:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24570@kfi7
00000400:00000200:23.0:1773851855.403956:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24570@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.403957:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009aff1588 nid 24570@kfi7 refs 1
00000400:00000200:23.0:1773851855.403958:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009aff1588 nid 24570@kfi7 refs 2
00000400:00000200:23.0:1773851855.403959:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009aff1588 nid 24570@kfi7 refs 3
00000400:00000200:23.0:1773851855.403960:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24570@kfi7 local destination
00000400:00000200:23.0:1773851855.403961:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768643:8768643:1024:4294967295] 24570@kfi7 LPNI seq info [28029:28029:16:4294967295]
00000400:00000200:23.0:1773851855.403963:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009aff1588 nid 24570@kfi7 refs 2
00000400:00000200:23.0:1773851855.403964:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24570@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.403965:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24570@kfi7(24570@kfi7:24570@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851855.403966:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009aff1588 nid 24570@kfi7 refs 3
00000800:00000200:23.0:1773851855.403967:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851855.403968:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851855.403970:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851855.403972:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x591 Using peer 24570@kfi7(0x591)
00000800:00000200:23.0:1773851855.403977:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x591: rc=0
00000800:00000200:23.0:1773851855.403979:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x591 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851855.403980:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.403981:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000792a543a refcount 4 to 24571@kfi7
00010000:00000001:23.0:1773851855.403982:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851855.403982:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.403983:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851855.403983:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c6e938cb x1858030977781376/t0(0) o400->a73f91a0-2f91-485b-93f6-c195aabf5153@24571@kfi7:495/0 lens 224/224 e 0 to 0 dl 1773852610 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne264-0'
00000100:00100000:23.0:1773851855.403986:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6e938cb pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:a73f91a0-2f91-485b-93f6-c195aabf5153+6:47880:x1858030977781376:12345-24571@kfi7:400:default-tuolumne264-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851855.403988:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24571@kfi7, seq: 1997929
00000100:00000040:23.0:1773851855.403989:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a263e624 : new rpc_count 0
00000100:00000001:23.0:1773851855.403989:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851855.403990:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851855.403990:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851855.403990:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x591 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851855.403991:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:23.0:1773851855.403991:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a6e6ffee.
00000400:00000200:21.0:1773851855.403991:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:23.0:1773851855.403992:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000a263e624 : new refcount 5
00000100:00000001:23.0:1773851855.403992:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851855.403993:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24570@kfi7: PUT: OK
00000400:00000200:21.0:1773851855.403993:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042659cea
00000400:00000010:21.0:1773851855.403994:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042659cea.
00000100:00000001:21.0:1773851855.403994:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851855.403995:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851855.403996:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009aff1588 nid 24570@kfi7 refs 2
00000800:00000200:21.0:1773851855.403997:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24570@kfi7(00000000ff472529):0x0 lsk 1426 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x591 Transaction freed
00000800:00000200:21.0:1773851855.433066:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851855.433066:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851855.433068:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851855.433070:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851855.433072:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22465@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.433073:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22465@kfi7 : PUT - for me
00000400:00000200:21.0:1773851855.433074:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22465@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.433074:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f3b5929 nid 22465@kfi7 refs 1
00000400:00000200:21.0:1773851855.433076:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22465@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.433076:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f3b5929 nid 22465@kfi7 refs 2
00000400:00000200:21.0:1773851855.433077:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009f3b5929 nid 22465@kfi7 refs 3
00000400:00000200:21.0:1773851855.433078:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22464@kfi7 to cpt 1
00000400:00000200:21.0:1773851855.433079:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22464@kfi7 of length 224 into portal 12 MB=0x69b4c477c5900
00000400:00000200:21.0:1773851855.433080:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22464@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 24936
00000800:00000200:21.0:1773851855.433081:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851855.433083:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851855.433084:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22465@kfi7: PUT: OK
00000100:00000001:21.0:1773851855.433084:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851855.433085:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851855.433085:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006b30b6fc.
00000100:00000040:21.0:1773851855.433086:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006b30b6fc x1859601779415296 msgsize 224
00000100:00100000:21.0:1773851855.433087:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-22464@kfi7 (source: 12345-22465@kfi7)
00000100:00000001:21.0:1773851855.433088:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851855.433089:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851855.433089:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009f3b5929 nid 22465@kfi7 refs 2
02000000:00000001:23.0:1773851855.433090:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851855.433090:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851855.433090:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851855.433090:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851855.433091:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851855.433092:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601779415296
00000020:00000001:23.0:1773851855.433092:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851855.433092:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e62882347
00000020:00000001:23.0:1773851855.433093:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851855.433097:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cbf427a1 refcount=5
00000020:00000001:23.0:1773851855.433098:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110290920448 : -106963418631168 : ffff9eb7a36db400)
00000020:00000001:23.0:1773851855.433099:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110290920448 : -106963418631168 : ffff9eb7a36db400)
00000100:00000001:23.0:1773851855.433100:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.433101:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851855.433102:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab1b10d5.
00000020:00000010:23.0:1773851855.433102:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851855.433103:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851855.433103:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851855.433104:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851855.433104:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.433105:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851855.433105:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851855.433106:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.433107:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.433108:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851855.433108:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851855.433108:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851855.433109:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22464@kfi7, seq: 1997930
00000100:00000040:23.0:1773851855.433109:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cbf427a1 : new rpc_count 1
00000100:00000001:22.0:1773851855.433109:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851855.433109:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.433110:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117333632 : -106995592217984 : ffff9eb025bbba80)
00000100:00000001:22.0:1773851855.433110:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.433111:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006b30b6fc x1859601779415296/t0(0) o400->620832b7-4aaf-46cb-8399-fe134b52e63f@22464@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1891-0'
00000100:00000001:23.0:1773851855.433114:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.433114:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851855.433115:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b30b6fc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:620832b7-4aaf-46cb-8399-fe134b52e63f+5:39733:x1859601779415296:12345-22464@kfi7:400:default-tuolumne1891-0
00000100:00000200:23.0:1773851855.433116:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601779415296
00000020:00000001:23.0:1773851855.433117:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851855.433117:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851855.433118:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.433118:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851855.433118:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851855.433119:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851855.433120:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601779415296, found 0 last_xid 1859601779415295
00000020:00000001:23.0:1773851855.433120:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851855.433122:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851855.433122:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851855.433123:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.433123:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851855.433124:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851855.433124:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851855.433125:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003587a943.
02000000:00000001:23.0:1773851855.433125:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.433126:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.433126:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851855.433127:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252857853, transno 0, xid 1859601779415296
00010000:00000001:23.0:1773851855.433127:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851855.433128:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006b30b6fc x1859601779415296/t0(0) o400->620832b7-4aaf-46cb-8399-fe134b52e63f@22464@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1891-0'
00010000:00000001:23.0:1773851855.433131:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851855.433131:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851855.433132:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=88 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851855.433132:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851855.433133:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004fab7af5 refcount 3 to 22464@kfi7
00000100:00000001:23.0:1773851855.433134:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740762752 : -107153968788864 : ffff9e8b45c10a80)
02000000:00000001:23.0:1773851855.433135:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851855.433135:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.433135:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851855.433136:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22465@kfi7
00000400:00000010:23.0:1773851855.433137:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d767c6.
00000100:00000200:23.0:1773851855.433137:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601779415296, offset 224
00000400:00000200:23.0:1773851855.433139:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22465@kfi7
00000400:00000200:23.0:1773851855.433140:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22465@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.433140:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f3b5929 nid 22465@kfi7 refs 1
00000400:00000200:23.0:1773851855.433141:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009f3b5929 nid 22465@kfi7 refs 2
00000400:00000200:23.0:1773851855.433143:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009f3b5929 nid 22465@kfi7 refs 3
00000400:00000200:23.0:1773851855.433144:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22465@kfi7 local destination
00000400:00000200:23.0:1773851855.433145:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768644:8768644:1024:4294967295] 22465@kfi7 LPNI seq info [890867:890867:16:4294967295]
00000400:00000200:23.0:1773851855.433146:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009f3b5929 nid 22465@kfi7 refs 2
00000400:00000200:23.0:1773851855.433147:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22465@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.433149:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22465@kfi7(22465@kfi7:22465@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851855.433150:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009f3b5929 nid 22465@kfi7 refs 3
00000800:00000200:23.0:1773851855.433152:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851855.433152:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851855.433155:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851855.433157:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e65 Using peer 22465@kfi7(0x100000000000e65)
00000800:00000200:23.0:1773851855.433160:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x100000000000e65: rc=0
00000800:00000200:23.0:1773851855.433161:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e65 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851855.433163:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.433164:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004fab7af5 refcount 2 to 22464@kfi7
00010000:00000001:23.0:1773851855.433164:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851855.433165:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.433166:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851855.433166:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006b30b6fc x1859601779415296/t0(0) o400->620832b7-4aaf-46cb-8399-fe134b52e63f@22464@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1891-0'
00000100:00100000:23.0:1773851855.433169:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b30b6fc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:620832b7-4aaf-46cb-8399-fe134b52e63f+5:39733:x1859601779415296:12345-22464@kfi7:400:default-tuolumne1891-0 Request processed in 55us (82us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851855.433171:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22464@kfi7, seq: 1997930
00000100:00000040:23.0:1773851855.433172:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cbf427a1 : new rpc_count 0
00000800:00000200:21.0:1773851855.433172:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e65 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851855.433173:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851855.433173:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851855.433173:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851855.433174:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851855.433174:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000400:00000200:21.0:1773851855.433174:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22465@kfi7: PUT: OK
00000020:00000010:23.0:1773851855.433175:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab1b10d5.
00000400:00000200:21.0:1773851855.433175:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d767c6
00000400:00000010:21.0:1773851855.433175:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d767c6.
00000020:00000040:23.0:1773851855.433176:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000cbf427a1 : new refcount 4
00000100:00000001:21.0:1773851855.433176:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851855.433177:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851855.433177:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851855.433177:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009f3b5929 nid 22465@kfi7 refs 2
00000800:00000200:21.0:1773851855.433179:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 22465@kfi7(0000000004c22e37):0x0 lsk 3686 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e65 Transaction freed
00000800:00000200:6.0:1773851855.540973:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851855.540973:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851855.540975:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851855.540975:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851855.540977:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851855.540977:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851855.540980:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14738@kfi7(00000000de077eaa):0xb7a version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851855.540981:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851855.540983:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a Using peer 14738@kfi7(0x100000000000b7a)
00000400:00000200:6.0:1773851855.540984:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14738@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.540986:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14738@kfi7 : PUT - for me
00000400:00000200:5.0:1773851855.540986:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14738@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.540988:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14738@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.540989:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f582c604 nid 14738@kfi7 refs 1
00000800:00000200:5.0:1773851855.540989:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 38 bytes to peer 0x100000000000b7a: rc=0
00000400:00000200:6.0:1773851855.540991:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14738@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.540992:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f582c604 nid 14738@kfi7 refs 2
00000800:00000200:5.0:1773851855.540992:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851855.540993:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f582c604 nid 14738@kfi7 refs 3
00000400:00000200:6.0:1773851855.540995:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14675@kfi7 to cpt 0
00000400:00000200:6.0:1773851855.540996:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14675@kfi7 of length 224 into portal 12 MB=0x69b4b5c411840
00000400:00000200:6.0:1773851855.540998:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14675@kfi7 of length 224/224 into md 0x793926dc5 [64] + 118696
00000800:00000200:6.0:1773851855.541001:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851855.541004:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851855.541005:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851855.541006:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14738@kfi7: PUT: OK
00000100:00000001:6.0:1773851855.541007:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851855.541008:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:5.0:1773851855.541008:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a Transaction freed
00000100:00000010:6.0:1773851855.541009:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f814d8f1.
00000100:00000040:6.0:1773851855.541011:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000f814d8f1 x1859597832886336 msgsize 224
00000100:00100000:6.0:1773851855.541013:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-14675@kfi7 (source: 12345-14738@kfi7)
00000100:00000001:6.0:1773851855.541015:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851855.541016:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f582c604 nid 14738@kfi7 refs 2
00000100:00000001:7.0:1773851855.541017:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851855.541018:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851855.541019:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851855.541019:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851855.541020:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851855.541021:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851855.541022:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597832886336
00000020:00000001:7.0:1773851855.541023:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851855.541024:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fac9
00000020:00000001:7.0:1773851855.541026:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851855.541028:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009bb1bc3c refcount=58
00000020:00000001:7.0:1773851855.541030:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105660605440 : -106968048946176 : ffff9eb68f70b400)
00000020:00000001:7.0:1773851855.541031:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105660605440 : -106968048946176 : ffff9eb68f70b400)
00000100:00000001:7.0:1773851855.541033:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851855.541034:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851855.541035:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000020:00000010:7.0:1773851855.541037:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851855.541038:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851855.541040:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851855.541040:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851855.541041:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851855.541043:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851855.541043:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851855.541044:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.541046:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851855.541048:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851855.541048:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851855.541049:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851855.541049:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851855.541050:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14675@kfi7, seq: 2001853
00000100:00000040:7.0:1773851855.541052:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009bb1bc3c : new rpc_count 2
00000100:00000001:5.0:1773851855.541052:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.541053:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637142942796928 : -106930766754688 : ffff9ebf3da1cc80)
00000100:00000001:5.0:1773851855.541053:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851855.541055:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f814d8f1 x1859597832886336/t0(0) o400->24aa0c0d-3c4e-45d6-ae3c-badf912980be@14675@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1414-0'
00000100:00000001:7.0:1773851855.541060:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851855.541061:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851855.541062:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f814d8f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:24aa0c0d-3c4e-45d6-ae3c-badf912980be+58:39609:x1859597832886336:12345-14675@kfi7:400:default-tuolumne1414-0
00000100:00000200:7.0:1773851855.541065:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597832886336
00000020:00000001:7.0:1773851855.541066:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851855.541067:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851855.541068:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.541069:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851855.541070:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851855.541072:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851855.541073:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597832886336, found 0 last_xid 1859597832322175
00000020:00000001:7.0:1773851855.541074:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851855.541075:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851855.541076:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851855.541077:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.541078:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851855.541079:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851855.541080:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851855.541081:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007324f527.
02000000:00000001:7.0:1773851855.541082:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.541083:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.541084:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851855.541085:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581322, transno 0, xid 1859597832886336
00010000:00000001:7.0:1773851855.541086:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851855.541088:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f814d8f1 x1859597832886336/t0(0) o400->24aa0c0d-3c4e-45d6-ae3c-badf912980be@14675@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1414-0'
00010000:00000001:7.0:1773851855.541092:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851855.541093:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851855.541094:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=87 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851855.541096:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851855.541097:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c50bff73 refcount 3 to 14675@kfi7
00000100:00000001:7.0:1773851855.541099:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451328 : -107149715100288 : ffff9e8c434b2d80)
02000000:00000001:7.0:1773851855.541100:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851855.541101:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.541102:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851855.541103:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14738@kfi7
00000400:00000010:7.0:1773851855.541104:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000100:00000200:7.0:1773851855.541106:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597832886336, offset 224
00000400:00000200:7.0:1773851855.541108:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14738@kfi7
00000400:00000200:7.0:1773851855.541109:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14738@kfi7 to cpt 1
00000400:00000200:7.0:1773851855.541111:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f582c604 nid 14738@kfi7 refs 1
00000400:00000200:7.0:1773851855.541112:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f582c604 nid 14738@kfi7 refs 2
00000400:00000200:7.0:1773851855.541115:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f582c604 nid 14738@kfi7 refs 3
00000400:00000200:7.0:1773851855.541120:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14738@kfi7 local destination
00000400:00000200:7.0:1773851855.541122:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768645:8768645:1024:4294967295] 14738@kfi7 LPNI seq info [1031492:1031492:16:4294967295]
00000400:00000200:7.0:1773851855.541125:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f582c604 nid 14738@kfi7 refs 2
00000400:00000200:7.0:1773851855.541126:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14738@kfi7 to cpt 1
00000400:00000200:7.0:1773851855.541129:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14738@kfi7(14738@kfi7:14738@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851855.541131:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f582c604 nid 14738@kfi7 refs 3
00000800:00000200:7.0:1773851855.541134:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851855.541135:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851855.541139:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851855.541143:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a Using peer 14738@kfi7(0x100000000000b7a)
00000800:00000200:7.0:1773851855.541147:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x100000000000b7a: rc=0
00000800:00000200:7.0:1773851855.541150:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851855.541153:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851855.541154:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c50bff73 refcount 2 to 14675@kfi7
00010000:00000001:7.0:1773851855.541156:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851855.541157:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.541158:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851855.541159:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f814d8f1 x1859597832886336/t0(0) o400->24aa0c0d-3c4e-45d6-ae3c-badf912980be@14675@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1414-0'
00000800:00000200:5.0:1773851855.541163:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851855.541164:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f814d8f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:24aa0c0d-3c4e-45d6-ae3c-badf912980be+58:39609:x1859597832886336:12345-14675@kfi7:400:default-tuolumne1414-0 Request processed in 103us (152us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851855.541166:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851855.541167:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14738@kfi7: PUT: OK
00000100:00100000:7.0:1773851855.541168:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14675@kfi7, seq: 2001853
00000100:00000040:7.0:1773851855.541169:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009bb1bc3c : new rpc_count 1
00000400:00000200:5.0:1773851855.541169:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000100:00000001:7.0:1773851855.541170:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:5.0:1773851855.541170:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000100:00000001:7.0:1773851855.541171:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851855.541171:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851855.541172:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851855.541173:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851855.541173:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f582c604 nid 14738@kfi7 refs 2
00000020:00000010:7.0:1773851855.541174:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000020:00000010:7.0:1773851855.541176:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000800:00000200:5.0:1773851855.541176:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14738@kfi7(00000000de077eaa):0x0 lsk 2939 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b7a Transaction freed
00000020:00000040:7.0:1773851855.541177:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000009bb1bc3c : new refcount 57
00000100:00000001:7.0:1773851855.541179:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851855.547821:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851855.547823:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851855.547824:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851855.547828:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851855.547831:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.547834:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26619@kfi7 : PUT - for me
00000400:00000200:9.0:1773851855.547835:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.547837:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 1
00000400:00000200:9.0:1773851855.547838:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.547839:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000400:00000200:9.0:1773851855.547841:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 3
00000400:00000200:9.0:1773851855.547842:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:9.0:1773851855.547843:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26618@kfi7 of length 224 into portal 12 MB=0x699de5b7cbdc0
00000400:00000200:9.0:1773851855.547845:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26618@kfi7 of length 224/224 into md 0x78146ce49 [64] + 120128
00000800:00000200:9.0:1773851855.547848:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851855.547851:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851855.547853:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26619@kfi7: PUT: OK
00000100:00000001:9.0:1773851855.547854:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851855.547855:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851855.547857:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007584939d.
00000100:00000040:9.0:1773851855.547858:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000007584939d x1858030156955072 msgsize 224
00000100:00100000:9.0:1773851855.547861:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26618@kfi7 (source: 12345-26619@kfi7)
00000100:00000001:9.0:1773851855.547863:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851855.547864:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000100:00000001:11.0:1773851855.547865:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851855.547866:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851855.547866:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851855.547867:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851855.547867:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851855.547869:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851855.547870:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030156955072
00000020:00000001:11.0:1773851855.547871:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851855.547871:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910ee
00000020:00000001:11.0:1773851855.547872:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851855.547876:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c84116a7 refcount=6
00000020:00000001:11.0:1773851855.547877:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240353792 : -107152469197824 : ffff9e8b9f22fc00)
00000020:00000001:11.0:1773851855.547879:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240353792 : -107152469197824 : ffff9e8b9f22fc00)
00000100:00000001:11.0:1773851855.547880:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851855.547882:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851855.547882:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009503e737.
00000020:00000010:11.0:1773851855.547884:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851855.547885:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b8cf8b34.
00000100:00000001:11.0:1773851855.547887:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851855.547888:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851855.547888:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851855.547890:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851855.547891:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851855.547891:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.547893:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851855.547895:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851855.547895:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851855.547896:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851855.547896:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851855.547897:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26618@kfi7, seq: 2130727
00000100:00000040:11.0:1773851855.547898:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c84116a7 : new rpc_count 1
00000100:00000001:10.0:1773851855.547899:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851855.547899:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.547900:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058724014208 : -107014985537408 : ffff9eaba1cd2880)
00000100:00000040:11.0:1773851855.547902:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007584939d x1858030156955072/t0(0) o400->41f6ac82-eec0-4588-84f8-b4f44a59b133@26618@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne272-0'
00000100:00000001:11.0:1773851855.547907:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851855.547907:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851855.547909:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007584939d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:41f6ac82-eec0-4588-84f8-b4f44a59b133+6:47815:x1858030156955072:12345-26618@kfi7:400:default-tuolumne272-0
00000100:00000200:11.0:1773851855.547911:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030156955072
00000020:00000001:11.0:1773851855.547912:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851855.547913:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851855.547914:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.547915:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851855.547916:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851855.547917:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851855.547918:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030156955072, found 0 last_xid 1858030156955071
00000020:00000001:11.0:1773851855.547920:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851855.547921:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851855.547922:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851855.547923:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.547924:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851855.547925:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851855.547926:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851855.547927:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eb9cea25.
02000000:00000001:11.0:1773851855.547928:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.547929:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.547930:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851855.547931:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030156955072
00010000:00000001:11.0:1773851855.547932:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851855.547934:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007584939d x1858030156955072/t0(0) o400->41f6ac82-eec0-4588-84f8-b4f44a59b133@26618@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00010000:00000001:11.0:1773851855.547938:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851855.547939:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851855.547940:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=88 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851855.547942:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851855.547943:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000743cfeb9 refcount 5 to 26618@kfi7
00000100:00000001:11.0:1773851855.547944:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064032 : -107155994487584 : ffff9e8acd0354e0)
02000000:00000001:11.0:1773851855.547946:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851855.547946:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.547947:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851855.547949:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26619@kfi7
00000400:00000010:11.0:1773851855.547950:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2b33615.
00000100:00000200:11.0:1773851855.547951:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030156955072, offset 224
00000400:00000200:11.0:1773851855.547953:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26619@kfi7
00000400:00000200:11.0:1773851855.547955:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:11.0:1773851855.547956:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 1
00000400:00000200:11.0:1773851855.547958:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000400:00000200:11.0:1773851855.547960:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 3
00000400:00000200:11.0:1773851855.547962:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26619@kfi7 local destination
00000400:00000200:11.0:1773851855.547964:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768646:8768646:1024:4294967295] 26619@kfi7 LPNI seq info [24449:24449:16:4294967295]
00000400:00000200:11.0:1773851855.547967:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000400:00000200:11.0:1773851855.547968:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:11.0:1773851855.547972:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26619@kfi7(26619@kfi7:26619@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851855.547974:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 3
00000800:00000200:11.0:1773851855.547976:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851855.547978:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851855.547982:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851855.547986:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 Using peer 26619@kfi7(0x230)
00000800:00000200:11.0:1773851855.547991:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x230: rc=0
00000800:00000200:11.0:1773851855.547994:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851855.547997:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851855.548001:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000743cfeb9 refcount 4 to 26618@kfi7
00010000:00000001:11.0:1773851855.548002:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851855.548003:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851855.548004:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851855.548005:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007584939d x1858030156955072/t0(0) o400->41f6ac82-eec0-4588-84f8-b4f44a59b133@26618@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00000800:00000200:9.0:1773851855.548006:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851855.548009:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851855.548010:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007584939d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:41f6ac82-eec0-4588-84f8-b4f44a59b133+6:47815:x1858030156955072:12345-26618@kfi7:400:default-tuolumne272-0 Request processed in 103us (151us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851855.548011:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26619@kfi7: PUT: OK
00000400:00000200:9.0:1773851855.548012:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2b33615
00000400:00000010:9.0:1773851855.548013:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2b33615.
00000100:00100000:11.0:1773851855.548014:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26618@kfi7, seq: 2130727
00000100:00000001:9.0:1773851855.548014:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851855.548015:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:11.0:1773851855.548016:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c84116a7 : new rpc_count 0
00000400:00000200:9.0:1773851855.548016:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000100:00000001:11.0:1773851855.548017:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851855.548018:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851855.548018:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 Transaction freed
00000020:00000010:11.0:1773851855.548019:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851855.548020:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b8cf8b34.
00000020:00000010:11.0:1773851855.548021:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009503e737.
00000020:00000040:11.0:1773851855.548023:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c84116a7 : new refcount 5
00000100:00000001:11.0:1773851855.548024:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851855.548142:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.548144:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.548146:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.548149:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851855.548152:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.548155:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26618@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.548157:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.548159:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 1
00000400:00000200:29.0:1773851855.548161:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.548162:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000400:00000200:29.0:1773851855.548163:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 3
00000400:00000200:29.0:1773851855.548165:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.548166:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26618@kfi7 of length 224 into portal 12 MB=0x699de5b7cc540
00000400:00000200:29.0:1773851855.548168:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26618@kfi7 of length 224/224 into md 0x77fe139dd [64] + 162688
00000800:00000200:29.0:1773851855.548171:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851855.548174:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.548176:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26618@kfi7: PUT: OK
00000100:00000001:29.0:1773851855.548177:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851855.548178:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851855.548179:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004ef04081.
00000100:00000040:29.0:1773851855.548180:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000004ef04081 x1858030156956992 msgsize 224
00000100:00100000:29.0:1773851855.548183:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26618@kfi7 (source: 12345-26618@kfi7)
00000100:00000001:29.0:1773851855.548184:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851855.548185:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000100:00000001:31.0:1773851855.548187:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851855.548188:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851855.548188:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851855.548188:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851855.548189:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851855.548190:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851855.548191:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030156956992
00000020:00000001:31.0:1773851855.548192:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851855.548193:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91292
00000020:00000001:31.0:1773851855.548194:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851855.548198:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006910799b refcount=6
00000020:00000001:31.0:1773851855.548199:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716200448 : -107155993351168 : ffff9e8acd14ac00)
00000020:00000001:31.0:1773851855.548200:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716200448 : -107155993351168 : ffff9e8acd14ac00)
00000100:00000001:31.0:1773851855.548202:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851855.548203:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851855.548204:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025d2a996.
00000020:00000010:31.0:1773851855.548206:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851855.548207:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851855.548208:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851855.548209:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851855.548210:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.548211:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851855.548212:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851855.548213:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.548214:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.548217:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851855.548217:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.548218:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851855.548218:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851855.548219:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26618@kfi7, seq: 2055464
00000100:00000001:31.0:1773851855.548221:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851855.548221:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006910799b : new rpc_count 1
00000100:00000001:31.0:1773851855.548222:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851855.548222:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165180400000 : -106908529151616 : ffff9ec46b18b180)
00000100:00000040:29.0:1773851855.548224:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004ef04081 x1858030156956992/t0(0) o400->2e369438-c3c2-47e1-bcd5-12dc00068d91@26618@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne272-0'
00000100:00000001:29.0:1773851855.548229:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851855.548230:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851855.548232:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ef04081 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:2e369438-c3c2-47e1-bcd5-12dc00068d91+6:47814:x1858030156956992:12345-26618@kfi7:400:default-tuolumne272-0
00000100:00000200:29.0:1773851855.548234:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030156956992
00000020:00000001:29.0:1773851855.548235:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851855.548237:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851855.548238:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851855.548239:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851855.548240:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851855.548242:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851855.548243:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030156956992, found 0 last_xid 1858030156956991
00000020:00000001:29.0:1773851855.548244:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851855.548245:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851855.548246:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851855.548247:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851855.548248:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851855.548249:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851855.548250:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851855.548252:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a5f84808.
02000000:00000001:29.0:1773851855.548253:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851855.548254:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851855.548255:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851855.548256:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030156956992
00010000:00000001:29.0:1773851855.548258:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851855.548259:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004ef04081 x1858030156956992/t0(0) o400->2e369438-c3c2-47e1-bcd5-12dc00068d91@26618@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00010000:00000001:29.0:1773851855.548263:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851855.548264:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851855.548265:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851855.548267:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851855.548268:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000743cfeb9 refcount 5 to 26618@kfi7
00000100:00000001:29.0:1773851855.548270:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064032 : -107155994487584 : ffff9e8acd0354e0)
02000000:00000001:29.0:1773851855.548271:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851855.548272:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851855.548273:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851855.548274:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26618@kfi7
00000400:00000010:29.0:1773851855.548276:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1fc7045.
00000100:00000200:29.0:1773851855.548278:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030156956992, offset 224
00000400:00000200:29.0:1773851855.548280:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26618@kfi7
00000400:00000200:29.0:1773851855.548281:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.548282:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 1
00000400:00000200:29.0:1773851855.548284:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000400:00000200:29.0:1773851855.548285:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 3
00000400:00000200:29.0:1773851855.548287:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26618@kfi7 local destination
00000400:00000200:29.0:1773851855.548290:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768647:8768647:1024:4294967295] 26618@kfi7 LPNI seq info [24450:24450:16:4294967295]
00000400:00000200:29.0:1773851855.548292:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000400:00000200:29.0:1773851855.548293:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.548297:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26618@kfi7(26618@kfi7:26618@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851855.548299:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 3
00000800:00000200:29.0:1773851855.548301:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.548303:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851855.548306:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851855.548310:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 Using peer 26618@kfi7(0x100000000000230)
00000800:00000200:29.0:1773851855.548315:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x100000000000230: rc=0
00000800:00000200:29.0:1773851855.548317:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851855.548321:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851855.548322:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000743cfeb9 refcount 4 to 26618@kfi7
00010000:00000001:29.0:1773851855.548323:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851855.548324:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851855.548325:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851855.548326:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004ef04081 x1858030156956992/t0(0) o400->2e369438-c3c2-47e1-bcd5-12dc00068d91@26618@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00000800:00000200:30.0:1773851855.548334:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 TN_EVENT_TX_OK event status 0
00000100:00100000:29.0:1773851855.548336:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ef04081 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:2e369438-c3c2-47e1-bcd5-12dc00068d91+6:47814:x1858030156956992:12345-26618@kfi7:400:default-tuolumne272-0 Request processed in 106us (155us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851855.548337:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851855.548339:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26618@kfi7: PUT: OK
00000400:00000200:30.0:1773851855.548341:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1fc7045
00000100:00100000:29.0:1773851855.548341:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26618@kfi7, seq: 2055464
00000400:00000010:30.0:1773851855.548342:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1fc7045.
00000100:00000040:29.0:1773851855.548342:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006910799b : new rpc_count 0
00000100:00000001:29.0:1773851855.548343:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851855.548344:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851855.548344:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:29.0:1773851855.548344:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851855.548345:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:30.0:1773851855.548346:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000020:00000010:29.0:1773851855.548346:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:29.0:1773851855.548348:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025d2a996.
00000800:00000200:30.0:1773851855.548349:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 Transaction freed
00000020:00000040:29.0:1773851855.548349:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000006910799b : new refcount 5
00000100:00000001:29.0:1773851855.548350:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851855.567812:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.567812:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851855.567813:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.567813:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851855.567814:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.567814:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851855.567816:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851855.567816:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16130@kfi7(0000000026ed2daf):0xef9 version: 2; local version 2; negotiated version: 2
00000400:00000200:30.0:1773851855.567818:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16130@kfi7 to cpt 7
00000800:00000200:29.0:1773851855.567818:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 Using peer 16130@kfi7(0xef9)
00000400:00000200:30.0:1773851855.567820:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16130@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.567820:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16130@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.567821:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16130@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.567822:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f8e8844 nid 16130@kfi7 refs 1
00000800:00000200:29.0:1773851855.567822:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 38 bytes to peer 0xef9: rc=0
00000400:00000200:30.0:1773851855.567823:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16130@kfi7 to cpt 7
00000800:00000200:29.0:1773851855.567823:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851855.567824:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f8e8844 nid 16130@kfi7 refs 2
00000400:00000200:30.0:1773851855.567825:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008f8e8844 nid 16130@kfi7 refs 3
00000400:00000200:30.0:1773851855.567826:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16322@kfi7 to cpt 1
00000400:00000200:30.0:1773851855.567827:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16322@kfi7 of length 224 into portal 12 MB=0x69b84a5c95240
00000400:00000200:30.0:1773851855.567828:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16322@kfi7 of length 224/224 into md 0x77fe139dd [64] + 162912
00000800:00000200:30.0:1773851855.567830:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851855.567832:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851855.567833:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16130@kfi7: PUT: OK
00000100:00000001:30.0:1773851855.567834:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851855.567834:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851855.567835:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031392470.
00000100:00000040:30.0:1773851855.567836:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000031392470 x1859843879686720 msgsize 224
00000800:00000200:29.0:1773851855.567836:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 TN_EVENT_TX_OK event status 0
00000100:00100000:30.0:1773851855.567837:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-16322@kfi7 (source: 12345-16130@kfi7)
00000800:00000200:29.0:1773851855.567838:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 Transaction freed
00000100:00000001:30.0:1773851855.567839:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851855.567840:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008f8e8844 nid 16130@kfi7 refs 2
00000800:00000200:30.0:1773851855.567842:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851855.567842:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851855.567842:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851855.567843:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851855.567843:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851855.567844:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851855.567845:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859843879686720
00000020:00000001:28.0:1773851855.567846:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851855.567846:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087f2036965
00000020:00000001:28.0:1773851855.567847:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851855.567851:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f3ed1bd5 refcount=169
00000020:00000001:28.0:1773851855.567852:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117669292032 : -106956040259584 : ffff9eb95b36b800)
00000020:00000001:28.0:1773851855.567853:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117669292032 : -106956040259584 : ffff9eb95b36b800)
00000100:00000001:28.0:1773851855.567854:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.567855:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851855.567855:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bef19b5b.
00000020:00000010:28.0:1773851855.567856:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.567857:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8a95503.
00000100:00000001:28.0:1773851855.567858:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851855.567858:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851855.567859:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.567860:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851855.567861:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851855.567862:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.567863:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.567865:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.567865:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851855.567865:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851855.567865:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851855.567866:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16322@kfi7, seq: 2055465
00000100:00000040:31.0:1773851855.567866:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f3ed1bd5 : new rpc_count 1
00000100:00000001:31.0:1773851855.567867:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636973000839424 : -107100708712192 : ffff9e97ac4d5100)
00000100:00000001:28.0:1773851855.567867:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.567867:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851855.567868:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000031392470 x1859843879686720/t0(0) o400->5c4c66a5-a226-45a5-ba3d-944cfa5bd32a@16322@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1511-0'
00000100:00000001:31.0:1773851855.567871:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851855.567871:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851855.567872:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031392470 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5c4c66a5-a226-45a5-ba3d-944cfa5bd32a+169:40212:x1859843879686720:12345-16322@kfi7:400:default-tuolumne1511-0
00000100:00000200:31.0:1773851855.567873:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859843879686720
00000020:00000001:31.0:1773851855.567874:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851855.567874:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851855.567875:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.567876:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851855.567876:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851855.567877:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851855.567877:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859843879686720, found 0 last_xid 1859843879265791
00000020:00000001:31.0:1773851855.567878:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851855.567878:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851855.567879:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851855.567879:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.567879:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851855.567880:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851855.567880:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851855.567881:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000025d2a996.
02000000:00000001:31.0:1773851855.567881:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.567882:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.567882:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851855.567883:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062544, transno 0, xid 1859843879686720
00010000:00000001:31.0:1773851855.567884:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851855.567885:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000031392470 x1859843879686720/t0(0) o400->5c4c66a5-a226-45a5-ba3d-944cfa5bd32a@16322@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1511-0'
00010000:00000001:31.0:1773851855.567887:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851855.567887:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851855.567888:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851855.567889:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851855.567890:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bdfa9aeb refcount 3 to 16322@kfi7
00000100:00000001:31.0:1773851855.567890:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074950496 : -107155634601120 : ffff9e8ae276c360)
02000000:00000001:31.0:1773851855.567891:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851855.567892:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.567892:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851855.567893:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16130@kfi7
00000400:00000010:31.0:1773851855.567893:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088e46351.
00000100:00000200:31.0:1773851855.567894:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859843879686720, offset 224
00000400:00000200:31.0:1773851855.567895:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16130@kfi7
00000400:00000200:31.0:1773851855.567896:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16130@kfi7 to cpt 7
00000400:00000200:31.0:1773851855.567897:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f8e8844 nid 16130@kfi7 refs 1
00000400:00000200:31.0:1773851855.567898:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008f8e8844 nid 16130@kfi7 refs 2
00000400:00000200:31.0:1773851855.567899:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008f8e8844 nid 16130@kfi7 refs 3
00000400:00000200:31.0:1773851855.567900:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16130@kfi7 local destination
00000400:00000200:31.0:1773851855.567901:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768648:8768648:1024:4294967295] 16130@kfi7 LPNI seq info [78807:78807:16:4294967295]
00000400:00000200:31.0:1773851855.567902:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008f8e8844 nid 16130@kfi7 refs 2
00000400:00000200:31.0:1773851855.567903:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16130@kfi7 to cpt 7
00000400:00000200:31.0:1773851855.567905:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16130@kfi7(16130@kfi7:16130@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851855.567906:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008f8e8844 nid 16130@kfi7 refs 3
00000800:00000200:31.0:1773851855.567907:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851855.567908:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851855.567910:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851855.567913:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 Using peer 16130@kfi7(0xef9)
00000800:00000200:31.0:1773851855.567916:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0xef9: rc=0
00000800:00000200:31.0:1773851855.567917:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851855.567919:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851855.567920:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bdfa9aeb refcount 2 to 16322@kfi7
00010000:00000001:31.0:1773851855.567920:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851855.567921:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851855.567921:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851855.567922:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031392470 x1859843879686720/t0(0) o400->5c4c66a5-a226-45a5-ba3d-944cfa5bd32a@16322@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1511-0'
00000100:00100000:31.0:1773851855.567925:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031392470 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5c4c66a5-a226-45a5-ba3d-944cfa5bd32a+169:40212:x1859843879686720:12345-16322@kfi7:400:default-tuolumne1511-0 Request processed in 53us (88us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851855.567927:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16322@kfi7, seq: 2055465
00000100:00000040:31.0:1773851855.567927:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f3ed1bd5 : new rpc_count 0
00000100:00000001:31.0:1773851855.567928:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851855.567928:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851855.567929:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851855.567929:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8a95503.
00000800:00000200:29.0:1773851855.567929:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851855.567930:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bef19b5b.
00000400:00000200:29.0:1773851855.567930:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851855.567931:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000f3ed1bd5 : new refcount 168
00000100:00000001:31.0:1773851855.567931:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851855.567934:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16130@kfi7: PUT: OK
00000400:00000200:29.0:1773851855.567934:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088e46351
00000400:00000010:29.0:1773851855.567935:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088e46351.
00000100:00000001:29.0:1773851855.567935:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851855.567935:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851855.567936:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008f8e8844 nid 16130@kfi7 refs 2
00000800:00000200:29.0:1773851855.567938:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 16130@kfi7(0000000026ed2daf):0x0 lsk 3834 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0xef9 Transaction freed
00000800:00000200:5.0:1773851855.594833:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851855.594834:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851855.594836:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851855.594840:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851855.594844:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.594846:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:5.0:1773851855.594848:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.594850:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:5.0:1773851855.594851:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.594853:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851855.594854:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:5.0:1773851855.594856:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.594858:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed408fc0
00000400:00000200:5.0:1773851855.594860:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x793844545 [256] + 4944
00000800:00000200:5.0:1773851855.594864:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851855.594867:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851855.594869:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000100:00000001:5.0:1773851855.594870:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851855.594871:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851855.594873:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e5925b45.
00000100:00000040:5.0:1773851855.594874:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e5925b45 x1858062667255744 msgsize 224
00000100:00100000:5.0:1773851855.594877:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2098@kfi7)
00000100:00000001:5.0:1773851855.594880:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851855.594882:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:5.0:1773851855.594885:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851855.594890:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851855.594891:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851855.594892:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851855.594893:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851855.594894:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851855.594896:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667255744
00000020:00000001:5.0:1773851855.594897:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851855.594898:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:5.0:1773851855.594899:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851855.594901:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:5.0:1773851855.594902:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:5.0:1773851855.594904:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:5.0:1773851855.594906:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851855.594907:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851855.594909:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000829447ec.
00000020:00000010:5.0:1773851855.594911:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851855.594913:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000040:5.0:1773851855.594915:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851855.594916:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851855.594917:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851855.594918:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.594920:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.594922:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851855.594925:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851855.594926:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851855.594926:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851855.594927:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851855.594928:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 18314073
00000100:00000001:6.0:1773851855.594930:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851855.594930:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:6.0:1773851855.594931:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.594931:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046221056 : -106940663330560 : ffff9ebcefc00900)
00000100:00000040:5.0:1773851855.594933:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e5925b45 x1858062667255744/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:5.0:1773851855.594938:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851855.594940:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851855.594941:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5925b45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667255744:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:5.0:1773851855.594944:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667255744
00000020:00000001:5.0:1773851855.594945:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851855.594947:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851855.594948:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851855.594949:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851855.594950:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851855.594952:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851855.594953:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851855.594954:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851855.594955:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851855.594956:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.594958:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851855.594959:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851855.594960:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000002264044c.
02000000:00000001:5.0:1773851855.594962:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.594963:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851855.594965:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851855.594966:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851855.594967:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851855.594968:0:1203214:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:5.0:1773851855.594971:0:1203214:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851855.594972:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851855.594975:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851855.594977:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851855.594979:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667255744
00010000:00000001:5.0:1773851855.594980:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851855.594982:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e5925b45 x1858062667255744/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:582/0 lens 224/368 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:5.0:1773851855.594987:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851855.594988:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851855.594990:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=84 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851855.594992:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851855.594994:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:5.0:1773851855.594995:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:5.0:1773851855.594997:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851855.594998:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.594999:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851855.595001:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:5.0:1773851855.595002:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032855b1f.
00000100:00000200:5.0:1773851855.595003:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667255744, offset 224
00000400:00000200:5.0:1773851855.595006:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:5.0:1773851855.595008:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.595009:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:5.0:1773851855.595011:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851855.595014:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:5.0:1773851855.595016:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2098@kfi7 local destination
00000400:00000200:5.0:1773851855.595019:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768649:8768649:1024:4294967295] 2098@kfi7 LPNI seq info [20346198:20346198:16:4294967295]
00000400:00000200:5.0:1773851855.595021:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851855.595023:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.595026:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851855.595028:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:5.0:1773851855.595030:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851855.595031:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851855.595034:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851855.595037:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Using peer 2098@kfi7(0x2000000000004bc)
00000800:00000200:5.0:1773851855.595040:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 468 bytes to peer 0x2000000000004bc: rc=0
00000800:00000200:5.0:1773851855.595042:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851855.595044:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851855.595047:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:5.0:1773851855.595048:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851855.595048:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851855.595049:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851855.595050:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e5925b45 x1858062667255744/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:582/0 lens 224/368 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000800:00000200:6.0:1773851855.595053:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851855.595053:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5925b45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667255744:12345-2098@kfi7:41:default-yuba6-0 Request processed in 114us (178us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851855.595055:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851855.595056:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000100:00100000:5.0:1773851855.595056:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 18314073
00000400:00000200:6.0:1773851855.595057:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032855b1f
00000400:00000010:6.0:1773851855.595057:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032855b1f.
00000100:00000040:5.0:1773851855.595057:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:6.0:1773851855.595058:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851855.595058:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851855.595059:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851855.595059:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851855.595059:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851855.595060:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000020:00000010:5.0:1773851855.595060:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000800:00000200:6.0:1773851855.595061:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Transaction freed
00000020:00000010:5.0:1773851855.595061:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000829447ec.
00000020:00000040:5.0:1773851855.595062:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:5.0:1773851855.595063:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851855.633223:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851855.633223:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851855.633224:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851855.633224:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851855.633225:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851855.633225:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851855.633227:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16635@kfi7(00000000410d9b00):0x3cd version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851855.633228:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851855.633229:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd Using peer 16635@kfi7(0x3cd)
00000400:00000200:26.0:1773851855.633230:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.633231:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16635@kfi7 : PUT - for me
00000400:00000200:25.0:1773851855.633231:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.633232:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000800:00000200:25.0:1773851855.633232:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x3cd: rc=0
00000800:00000200:25.0:1773851855.633234:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851855.633235:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000400:00000200:26.0:1773851855.633236:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.633236:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:26.0:1773851855.633237:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:26.0:1773851855.633238:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16634@kfi7 to cpt 3
00000400:00000200:26.0:1773851855.633239:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16634@kfi7 of length 224 into portal 12 MB=0x699de8c700bc0
00000400:00000200:26.0:1773851855.633240:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16634@kfi7 of length 224/224 into md 0x16159c6179 [64] + 181968
00000800:00000200:26.0:1773851855.633243:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851855.633244:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851855.633245:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851855.633246:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16635@kfi7: PUT: OK
00000100:00000001:26.0:1773851855.633247:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851855.633247:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851855.633247:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd Transaction freed
00000100:00000010:26.0:1773851855.633248:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d89d810c.
00000100:00000040:26.0:1773851855.633249:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000d89d810c x1858030978206656 msgsize 224
00000100:00100000:26.0:1773851855.633251:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-16634@kfi7 (source: 12345-16635@kfi7)
00000100:00000001:26.0:1773851855.633252:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851855.633253:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000100:00000001:24.0:1773851855.633253:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:26.0:1773851855.633254:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851855.633254:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851855.633255:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851855.633255:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851855.633256:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851855.633257:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978206656
00000020:00000001:24.0:1773851855.633260:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851855.633260:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fc8
00000020:00000001:24.0:1773851855.633261:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.633265:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006dec92c0 refcount=6
00000020:00000001:24.0:1773851855.633266:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240098816 : -107152469452800 : ffff9e8b9f1f1800)
00000020:00000001:24.0:1773851855.633267:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240098816 : -107152469452800 : ffff9e8b9f1f1800)
00000100:00000001:24.0:1773851855.633268:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851855.633269:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851855.633270:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000abee30ba.
00000020:00000010:24.0:1773851855.633271:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851855.633271:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006cfd8c16.
00000100:00000001:24.0:1773851855.633272:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851855.633273:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851855.633273:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851855.633275:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851855.633275:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851855.633276:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.633277:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851855.633278:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851855.633278:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851855.633279:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851855.633279:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851855.633280:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16634@kfi7, seq: 2025048
00000100:00000001:26.0:1773851855.633281:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.633281:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851855.633281:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006dec92c0 : new rpc_count 1
00000100:00000001:24.0:1773851855.633281:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538622464 : -106958170929152 : ffff9eb8dc374800)
00000100:00000040:24.0:1773851855.633283:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d89d810c x1858030978206656/t0(0) o400->7fb29351-fdec-447b-894b-55817dcd5426@16634@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne233-0'
00000100:00000001:24.0:1773851855.633286:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851855.633286:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851855.633287:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d89d810c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:7fb29351-fdec-447b-894b-55817dcd5426+6:48041:x1858030978206656:12345-16634@kfi7:400:default-tuolumne233-0
00000100:00000200:24.0:1773851855.633289:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978206656
00000020:00000001:24.0:1773851855.633289:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851855.633290:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851855.633291:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633292:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851855.633293:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851855.633294:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851855.633294:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978206656, found 0 last_xid 1858030978206655
00000020:00000001:24.0:1773851855.633295:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851855.633296:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851855.633297:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851855.633297:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633298:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851855.633299:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851855.633299:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851855.633300:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000042031ddd.
02000000:00000001:24.0:1773851855.633300:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.633301:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633302:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851855.633303:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030978206656
00010000:00000001:24.0:1773851855.633304:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851855.633305:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d89d810c x1858030978206656/t0(0) o400->7fb29351-fdec-447b-894b-55817dcd5426@16634@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00010000:00000001:24.0:1773851855.633307:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851855.633308:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851855.633308:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=88 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851855.633309:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851855.633310:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000757a55d7 refcount 5 to 16634@kfi7
00000100:00000001:24.0:1773851855.633311:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153568 : -107139310398048 : ffff9e8eaf7655a0)
02000000:00000001:24.0:1773851855.633312:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851855.633312:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.633313:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851855.633314:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16635@kfi7
00000400:00000010:24.0:1773851855.633315:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6088efc.
00000100:00000200:24.0:1773851855.633315:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978206656, offset 224
00000400:00000200:24.0:1773851855.633317:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16635@kfi7
00000400:00000200:24.0:1773851855.633318:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851855.633319:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000400:00000200:24.0:1773851855.633320:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851855.633322:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:24.0:1773851855.633323:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16635@kfi7 local destination
00000400:00000200:24.0:1773851855.633324:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768650:8768650:1024:4294967295] 16635@kfi7 LPNI seq info [24389:24389:16:4294967295]
00000400:00000200:24.0:1773851855.633326:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851855.633326:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851855.633328:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16635@kfi7(16635@kfi7:16635@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851855.633329:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000800:00000200:24.0:1773851855.633331:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851855.633332:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851855.633334:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851855.633336:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd Using peer 16635@kfi7(0x3cd)
00000800:00000200:24.0:1773851855.633339:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x3cd: rc=0
00000800:00000200:24.0:1773851855.633340:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851855.633343:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851855.633344:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000757a55d7 refcount 4 to 16634@kfi7
00010000:00000001:24.0:1773851855.633345:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851855.633345:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633346:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851855.633347:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d89d810c x1858030978206656/t0(0) o400->7fb29351-fdec-447b-894b-55817dcd5426@16634@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00000100:00100000:24.0:1773851855.633351:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d89d810c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:7fb29351-fdec-447b-894b-55817dcd5426+6:48041:x1858030978206656:12345-16634@kfi7:400:default-tuolumne233-0 Request processed in 64us (101us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851855.633354:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16634@kfi7, seq: 2025048
00000100:00000040:24.0:1773851855.633355:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006dec92c0 : new rpc_count 0
00000100:00000001:24.0:1773851855.633355:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851855.633356:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851855.633357:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851855.633358:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006cfd8c16.
00000020:00000010:24.0:1773851855.633359:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000abee30ba.
00000020:00000040:24.0:1773851855.633359:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000006dec92c0 : new refcount 5
00000100:00000001:24.0:1773851855.633360:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851855.633365:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851855.633366:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851855.633368:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16635@kfi7: PUT: OK
00000400:00000200:25.0:1773851855.633369:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6088efc
00000400:00000010:25.0:1773851855.633369:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6088efc.
00000100:00000001:25.0:1773851855.633370:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851855.633371:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851855.633372:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000800:00000200:25.0:1773851855.633373:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd Transaction freed
00000800:00000200:26.0:1773851855.633483:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851855.633483:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851855.633483:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851855.633484:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851855.633484:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851855.633485:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851855.633486:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16635@kfi7(0000000050065eff):0x3cb version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851855.633487:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851855.633488:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000800:00000200:25.0:1773851855.633488:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb Using peer 16635@kfi7(0x1000000000003cb)
00000400:00000200:26.0:1773851855.633489:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16635@kfi7 : PUT - for me
00000400:00000200:25.0:1773851855.633489:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.633491:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.633491:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000800:00000200:25.0:1773851855.633491:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x1000000000003cb: rc=0
00000400:00000200:26.0:1773851855.633492:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000800:00000200:25.0:1773851855.633492:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851855.633493:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:26.0:1773851855.633494:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:26.0:1773851855.633494:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16634@kfi7 to cpt 3
00000400:00000200:26.0:1773851855.633495:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16634@kfi7 of length 224 into portal 12 MB=0x699de8c701340
00000400:00000200:26.0:1773851855.633496:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16634@kfi7 of length 224/224 into md 0x16159c6179 [64] + 182192
00000800:00000200:26.0:1773851855.633498:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851855.633499:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851855.633500:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16635@kfi7: PUT: OK
00000100:00000001:26.0:1773851855.633501:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851855.633501:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851855.633502:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fcf8e826.
00000100:00000040:26.0:1773851855.633503:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000fcf8e826 x1858030978208576 msgsize 224
00000800:00000200:25.0:1773851855.633503:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851855.633504:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-16634@kfi7 (source: 12345-16635@kfi7)
00000100:00000001:26.0:1773851855.633505:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851855.633505:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000800:00000200:25.0:1773851855.633505:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb Transaction freed
00000100:00000001:24.0:1773851855.633506:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:26.0:1773851855.633507:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851855.633507:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851855.633507:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851855.633507:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851855.633508:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851855.633509:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978208576
00000020:00000001:24.0:1773851855.633509:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851855.633509:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911e3
00000020:00000001:24.0:1773851855.633510:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.633514:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009509b713 refcount=6
00000020:00000001:24.0:1773851855.633515:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240521728 : -107152469029888 : ffff9e8b9f258c00)
00000020:00000001:24.0:1773851855.633515:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240521728 : -107152469029888 : ffff9e8b9f258c00)
00000100:00000001:24.0:1773851855.633516:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851855.633517:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851855.633517:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000abee30ba.
00000020:00000010:24.0:1773851855.633518:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851855.633519:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006cfd8c16.
00000100:00000001:24.0:1773851855.633520:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851855.633520:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851855.633520:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851855.633521:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851855.633522:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851855.633522:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.633523:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851855.633524:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851855.633524:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851855.633524:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851855.633525:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851855.633525:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16634@kfi7, seq: 2025049
00000100:00000001:26.0:1773851855.633526:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.633526:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851855.633526:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009509b713 : new rpc_count 1
00000100:00000001:24.0:1773851855.633526:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538612096 : -106958170939520 : ffff9eb8dc371f80)
00000100:00000040:24.0:1773851855.633528:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fcf8e826 x1858030978208576/t0(0) o400->3081707c-5141-4dbe-9894-cd5202e99e27@16634@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne233-0'
00000100:00000001:24.0:1773851855.633531:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851855.633531:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851855.633532:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf8e826 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3081707c-5141-4dbe-9894-cd5202e99e27+6:48039:x1858030978208576:12345-16634@kfi7:400:default-tuolumne233-0
00000100:00000200:24.0:1773851855.633533:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978208576
00000020:00000001:24.0:1773851855.633533:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851855.633534:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851855.633535:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633535:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851855.633536:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851855.633536:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851855.633537:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978208576, found 0 last_xid 1858030978208575
00000020:00000001:24.0:1773851855.633537:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851855.633538:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851855.633538:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851855.633538:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633539:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851855.633540:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851855.633540:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851855.633541:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009a093184.
02000000:00000001:24.0:1773851855.633541:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.633542:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633542:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851855.633543:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030978208576
00010000:00000001:24.0:1773851855.633543:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851855.633544:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fcf8e826 x1858030978208576/t0(0) o400->3081707c-5141-4dbe-9894-cd5202e99e27@16634@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00010000:00000001:24.0:1773851855.633546:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851855.633547:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851855.633547:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=88 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851855.633548:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851855.633549:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000757a55d7 refcount 5 to 16634@kfi7
00000100:00000001:24.0:1773851855.633550:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153568 : -107139310398048 : ffff9e8eaf7655a0)
02000000:00000001:24.0:1773851855.633551:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851855.633551:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.633552:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851855.633553:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16635@kfi7
00000400:00000010:24.0:1773851855.633553:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a14eb2ca.
00000100:00000200:24.0:1773851855.633554:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978208576, offset 224
00000400:00000200:24.0:1773851855.633555:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16635@kfi7
00000400:00000200:24.0:1773851855.633556:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851855.633556:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000400:00000200:24.0:1773851855.633557:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851855.633558:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:24.0:1773851855.633559:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16635@kfi7 local destination
00000400:00000200:24.0:1773851855.633561:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768651:8768651:1024:4294967295] 16635@kfi7 LPNI seq info [24390:24390:16:4294967295]
00000400:00000200:24.0:1773851855.633562:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851855.633563:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851855.633565:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16635@kfi7(16635@kfi7:16635@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851855.633566:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000800:00000200:24.0:1773851855.633567:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851855.633568:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851855.633570:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851855.633572:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb Using peer 16635@kfi7(0x1000000000003cb)
00000800:00000200:24.0:1773851855.633575:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x1000000000003cb: rc=0
00000800:00000200:24.0:1773851855.633576:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851855.633578:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851855.633580:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000757a55d7 refcount 4 to 16634@kfi7
00010000:00000001:24.0:1773851855.633580:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851855.633580:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851855.633581:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851855.633582:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fcf8e826 x1858030978208576/t0(0) o400->3081707c-5141-4dbe-9894-cd5202e99e27@16634@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00000100:00100000:24.0:1773851855.633586:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf8e826 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3081707c-5141-4dbe-9894-cd5202e99e27+6:48039:x1858030978208576:12345-16634@kfi7:400:default-tuolumne233-0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851855.633588:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16634@kfi7, seq: 2025049
00000100:00000040:24.0:1773851855.633588:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009509b713 : new rpc_count 0
00000100:00000001:24.0:1773851855.633589:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851855.633589:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851855.633590:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851855.633590:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006cfd8c16.
00000020:00000010:24.0:1773851855.633591:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000abee30ba.
00000020:00000040:24.0:1773851855.633592:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000009509b713 : new refcount 5
00000100:00000001:24.0:1773851855.633592:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851855.633597:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851855.633598:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851855.633600:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16635@kfi7: PUT: OK
00000400:00000200:25.0:1773851855.633600:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a14eb2ca
00000400:00000010:25.0:1773851855.633601:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a14eb2ca.
00000100:00000001:25.0:1773851855.633601:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851855.633601:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851855.633602:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000800:00000200:25.0:1773851855.633606:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb Transaction freed
00000800:00000200:6.0:1773851855.642325:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851855.642326:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851855.642328:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851855.642331:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851855.642334:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9057@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.642336:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9057@kfi7 : PUT - for me
00000400:00000200:6.0:1773851855.642337:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9057@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.642339:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002cabf054 nid 9057@kfi7 refs 1
00000400:00000200:6.0:1773851855.642340:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9057@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.642341:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002cabf054 nid 9057@kfi7 refs 2
00000400:00000200:6.0:1773851855.642342:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002cabf054 nid 9057@kfi7 refs 3
00000400:00000200:6.0:1773851855.642344:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9057@kfi7 to cpt 1
00000400:00000200:6.0:1773851855.642345:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9057@kfi7 of length 224 into portal 12 MB=0x699e1909503c0
00000400:00000200:6.0:1773851855.642347:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9057@kfi7 of length 224/224 into md 0x793926dc5 [64] + 118920
00000800:00000200:6.0:1773851855.642350:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851855.642354:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851855.642356:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9057@kfi7: PUT: OK
00000100:00000001:6.0:1773851855.642357:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851855.642358:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851855.642359:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a97ad12.
00000100:00000040:6.0:1773851855.642360:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000007a97ad12 x1858043932640192 msgsize 224
00000100:00100000:6.0:1773851855.642363:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-9057@kfi7 (source: 12345-9057@kfi7)
00000100:00000001:6.0:1773851855.642364:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851855.642366:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002cabf054 nid 9057@kfi7 refs 2
00000100:00000001:7.0:1773851855.642367:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851855.642368:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851855.642368:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851855.642369:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851855.642369:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851855.642371:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851855.642372:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043932640192
00000020:00000001:7.0:1773851855.642373:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851855.642374:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91428
00000020:00000001:7.0:1773851855.642375:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851855.642377:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000953a2ea6 refcount=113
00000020:00000001:7.0:1773851855.642378:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240796160 : -107152468755456 : ffff9e8b9f29bc00)
00000020:00000001:7.0:1773851855.642379:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240796160 : -107152468755456 : ffff9e8b9f29bc00)
00000100:00000001:7.0:1773851855.642381:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851855.642382:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851855.642383:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000020:00000010:7.0:1773851855.642384:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851855.642385:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851855.642387:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851855.642387:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851855.642388:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851855.642389:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851855.642390:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851855.642391:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.642392:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851855.642394:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851855.642395:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851855.642395:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851855.642396:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9057@kfi7, seq: 2001854
00000100:00000001:5.0:1773851855.642396:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851855.642398:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000953a2ea6 : new rpc_count 8
00000100:00000001:5.0:1773851855.642398:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.642399:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637142942786560 : -106930766765056 : ffff9ebf3da1a400)
00000100:00000001:5.0:1773851855.642399:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851855.642401:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007a97ad12 x1858043932640192/t0(0) o400->b843b541-a4c6-482f-a046-40b3bbbfd095@9057@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1056-0'
00000100:00000001:7.0:1773851855.642406:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851855.642407:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851855.642408:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a97ad12 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b843b541-a4c6-482f-a046-40b3bbbfd095+113:39681:x1858043932640192:12345-9057@kfi7:400:default-tuolumne1056-0
00000100:00000200:7.0:1773851855.642410:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043932640192
00000020:00000001:7.0:1773851855.642411:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851855.642412:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851855.642413:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.642414:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851855.642415:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851855.642416:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851855.642417:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043932640192, found 0 last_xid 1858043922262911
00000020:00000001:7.0:1773851855.642419:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851855.642420:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851855.642420:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851855.642421:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.642422:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851855.642423:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851855.642424:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851855.642425:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000056b6ab05.
02000000:00000001:7.0:1773851855.642426:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.642427:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.642428:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851855.642429:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264587337, transno 0, xid 1858043932640192
00010000:00000001:7.0:1773851855.642430:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851855.642432:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007a97ad12 x1858043932640192/t0(0) o400->b843b541-a4c6-482f-a046-40b3bbbfd095@9057@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1056-0'
00010000:00000001:7.0:1773851855.642436:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851855.642437:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851855.642438:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=87 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851855.642440:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851855.642441:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e51d10db refcount 3 to 9057@kfi7
00000100:00000001:7.0:1773851855.642442:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702304 : -107156155849312 : ffff9e8ac36525a0)
02000000:00000001:7.0:1773851855.642444:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851855.642445:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.642446:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851855.642447:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9057@kfi7
00000400:00000010:7.0:1773851855.642448:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012526ad9.
00000100:00000200:7.0:1773851855.642449:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043932640192, offset 224
00000400:00000200:7.0:1773851855.642451:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9057@kfi7
00000400:00000200:7.0:1773851855.642453:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9057@kfi7 to cpt 1
00000400:00000200:7.0:1773851855.642454:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002cabf054 nid 9057@kfi7 refs 1
00000400:00000200:7.0:1773851855.642456:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002cabf054 nid 9057@kfi7 refs 2
00000400:00000200:7.0:1773851855.642458:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002cabf054 nid 9057@kfi7 refs 3
00000400:00000200:7.0:1773851855.642460:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9057@kfi7 local destination
00000400:00000200:7.0:1773851855.642462:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768652:8768652:1024:4294967295] 9057@kfi7 LPNI seq info [16740649:16740649:16:4294967295]
00000400:00000200:7.0:1773851855.642464:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002cabf054 nid 9057@kfi7 refs 2
00000400:00000200:7.0:1773851855.642465:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9057@kfi7 to cpt 1
00000400:00000200:7.0:1773851855.642468:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9057@kfi7(9057@kfi7:9057@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851855.642470:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002cabf054 nid 9057@kfi7 refs 3
00000800:00000200:7.0:1773851855.642472:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851855.642474:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851855.642477:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851855.642481:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000893 Using peer 9057@kfi7(0x100000000000893)
00000800:00000200:7.0:1773851855.642485:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x100000000000893: rc=0
00000800:00000200:7.0:1773851855.642488:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000893 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851855.642491:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851855.642492:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e51d10db refcount 2 to 9057@kfi7
00010000:00000001:7.0:1773851855.642493:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851855.642495:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.642496:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851855.642497:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a97ad12 x1858043932640192/t0(0) o400->b843b541-a4c6-482f-a046-40b3bbbfd095@9057@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1056-0'
00000100:00100000:7.0:1773851855.642502:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a97ad12 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b843b541-a4c6-482f-a046-40b3bbbfd095+113:39681:x1858043932640192:12345-9057@kfi7:400:default-tuolumne1056-0 Request processed in 95us (141us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851855.642502:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000893 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851855.642505:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851855.642506:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9057@kfi7, seq: 2001854
00000100:00000040:7.0:1773851855.642507:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000953a2ea6 : new rpc_count 7
00000400:00000200:5.0:1773851855.642507:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9057@kfi7: PUT: OK
00000400:00000200:5.0:1773851855.642508:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012526ad9
00000100:00000001:7.0:1773851855.642509:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851855.642509:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:5.0:1773851855.642509:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012526ad9.
00000020:00000010:7.0:1773851855.642510:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000100:00000001:5.0:1773851855.642510:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851855.642511:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000100:00000001:5.0:1773851855.642511:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851855.642513:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000400:00000200:5.0:1773851855.642513:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002cabf054 nid 9057@kfi7 refs 2
00000020:00000040:7.0:1773851855.642514:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000953a2ea6 : new refcount 112
00000100:00000001:7.0:1773851855.642515:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851855.642515:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 9057@kfi7(00000000dcde148b):0x0 lsk 2196 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000893 Transaction freed
00000800:00000200:5.0:1773851855.647197:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851855.647199:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851855.647200:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851855.647202:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851855.647204:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23058@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.647205:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23058@kfi7 : PUT - for me
00000400:00000200:5.0:1773851855.647206:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23058@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.647207:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033f3f861 nid 23058@kfi7 refs 1
00000400:00000200:5.0:1773851855.647208:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23058@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.647208:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033f3f861 nid 23058@kfi7 refs 2
00000400:00000200:5.0:1773851855.647209:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000033f3f861 nid 23058@kfi7 refs 3
00000400:00000200:5.0:1773851855.647210:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23059@kfi7 to cpt 4
00000400:00000200:5.0:1773851855.647211:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23059@kfi7 of length 224 into portal 12 MB=0x699e0ba77f3c0
00000400:00000200:5.0:1773851855.647212:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23059@kfi7 of length 224/224 into md 0x793926dc5 [64] + 119144
00000800:00000200:5.0:1773851855.647214:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851855.647215:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851855.647216:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23058@kfi7: PUT: OK
00000100:00000001:5.0:1773851855.647217:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851855.647218:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851855.647218:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b974fa3.
00000100:00000040:5.0:1773851855.647219:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000002b974fa3 x1858040340411328 msgsize 224
00000100:00100000:5.0:1773851855.647220:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23059@kfi7 (source: 12345-23058@kfi7)
00000100:00000001:5.0:1773851855.647221:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851855.647222:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000033f3f861 nid 23058@kfi7 refs 2
00000100:00000001:7.0:1773851855.647223:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851855.647223:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851855.647223:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851855.647224:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851855.647224:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851855.647224:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00100000:7.0:1773851855.647225:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040340411328
00000020:00000001:7.0:1773851855.647225:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851855.647226:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9181f
00000020:00000001:7.0:1773851855.647226:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851855.647227:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a6c0931a refcount=6
00000020:00000001:7.0:1773851855.647228:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241742336 : -107152467809280 : ffff9e8b9f382c00)
00000020:00000001:7.0:1773851855.647228:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241742336 : -107152467809280 : ffff9e8b9f382c00)
00000100:00000001:7.0:1773851855.647229:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851855.647230:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851855.647231:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000020:00000010:7.0:1773851855.647231:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851855.647232:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851855.647232:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851855.647233:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851855.647234:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851855.647234:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851855.647235:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851855.647235:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.647236:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851855.647237:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851855.647237:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851855.647237:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851855.647238:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23059@kfi7, seq: 2001855
00000100:00000001:5.0:1773851855.647238:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851855.647239:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a6c0931a : new rpc_count 1
00000100:00000001:7.0:1773851855.647239:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046245248 : -106940663306368 : ffff9ebcefc06780)
00000100:00000001:5.0:1773851855.647239:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.647239:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851855.647240:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002b974fa3 x1858040340411328/t0(0) o400->29fc4d7a-3582-47d2-b255-8a60c77de61b@23059@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1941-0'
00000100:00000001:7.0:1773851855.647243:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851855.647243:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851855.647244:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b974fa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:29fc4d7a-3582-47d2-b255-8a60c77de61b+6:39822:x1858040340411328:12345-23059@kfi7:400:default-tuolumne1941-0
00000100:00000200:7.0:1773851855.647245:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040340411328
00000020:00000001:7.0:1773851855.647246:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851855.647246:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851855.647247:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.647247:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851855.647248:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851855.647248:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851855.647249:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040340411328, found 0 last_xid 1858040340411327
00000020:00000001:7.0:1773851855.647249:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851855.647250:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851855.647250:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851855.647251:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.647251:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851855.647252:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851855.647252:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851855.647252:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e1f2b104.
02000000:00000001:7.0:1773851855.647253:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.647254:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.647254:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851855.647255:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425801321, transno 0, xid 1858040340411328
00010000:00000001:7.0:1773851855.647255:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851855.647256:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002b974fa3 x1858040340411328/t0(0) o400->29fc4d7a-3582-47d2-b255-8a60c77de61b@23059@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1941-0'
00010000:00000001:7.0:1773851855.647259:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851855.647259:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851855.647259:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=87 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851855.647260:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851855.647261:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009af5c628 refcount 3 to 23059@kfi7
00000100:00000001:7.0:1773851855.647261:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583912224 : -107156125639392 : ffff9e8ac5321d20)
02000000:00000001:7.0:1773851855.647262:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851855.647262:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851855.647263:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851855.647264:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23058@kfi7
00000400:00000010:7.0:1773851855.647264:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
00000100:00000200:7.0:1773851855.647265:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040340411328, offset 224
00000400:00000200:7.0:1773851855.647266:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23058@kfi7
00000400:00000200:7.0:1773851855.647267:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23058@kfi7 to cpt 1
00000400:00000200:7.0:1773851855.647267:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033f3f861 nid 23058@kfi7 refs 1
00000400:00000200:7.0:1773851855.647268:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000033f3f861 nid 23058@kfi7 refs 2
00000400:00000200:7.0:1773851855.647269:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000033f3f861 nid 23058@kfi7 refs 3
00000400:00000200:7.0:1773851855.647270:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23058@kfi7 local destination
00000400:00000200:7.0:1773851855.647271:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768653:8768653:1024:4294967295] 23058@kfi7 LPNI seq info [7946258:7946258:16:4294967295]
00000400:00000200:7.0:1773851855.647272:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000033f3f861 nid 23058@kfi7 refs 2
00000400:00000200:7.0:1773851855.647273:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23058@kfi7 to cpt 1
00000400:00000200:7.0:1773851855.647275:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23058@kfi7(23058@kfi7:23058@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851855.647276:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000033f3f861 nid 23058@kfi7 refs 3
00000800:00000200:7.0:1773851855.647277:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851855.647278:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851855.647282:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851855.647285:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x121b Using peer 23058@kfi7(0x121b)
00000800:00000200:7.0:1773851855.647288:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x121b: rc=0
00000800:00000200:7.0:1773851855.647289:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x121b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851855.647291:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851855.647291:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009af5c628 refcount 2 to 23059@kfi7
00010000:00000001:7.0:1773851855.647292:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851855.647292:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851855.647293:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851855.647293:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002b974fa3 x1858040340411328/t0(0) o400->29fc4d7a-3582-47d2-b255-8a60c77de61b@23059@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1941-0'
00000100:00100000:7.0:1773851855.647296:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b974fa3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:29fc4d7a-3582-47d2-b255-8a60c77de61b+6:39822:x1858040340411328:12345-23059@kfi7:400:default-tuolumne1941-0 Request processed in 53us (76us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851855.647298:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23059@kfi7, seq: 2001855
00000100:00000040:7.0:1773851855.647299:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a6c0931a : new rpc_count 0
00000100:00000001:7.0:1773851855.647300:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851855.647300:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851855.647301:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851855.647301:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000800:00000200:5.0:1773851855.647301:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x121b TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851855.647302:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000400:00000200:5.0:1773851855.647302:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851855.647303:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000a6c0931a : new refcount 5
00000100:00000001:7.0:1773851855.647303:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851855.647303:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23058@kfi7: PUT: OK
00000400:00000200:5.0:1773851855.647304:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000400:00000010:5.0:1773851855.647304:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000100:00000001:5.0:1773851855.647305:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851855.647305:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851855.647306:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000033f3f861 nid 23058@kfi7 refs 2
00000800:00000200:5.0:1773851855.647308:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 23058@kfi7(0000000086d85ec2):0x0 lsk 4636 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x121b Transaction freed
00000004:00000001:11.0:1773851855.689735:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851855.689737:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851855.689738:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b624700f.
00000020:00000040:11.0:1773851855.689740:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851855.689742:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851855.689743:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851855.689745:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851855.689747:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003b54e2de.
00000100:00000001:11.0:1773851855.689749:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.689751:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851855.689752:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851855.689755:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b624700f] to pc [ptlrpcd_02_00+0]  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851855.689762:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851855.689764:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:11.0:1773851855.689765:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000fda3ca71.
00000100:00000001:9.0:1773851855.689765:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851855.689765:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851855.689766:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637150005225472 : -106923704326144 : ffff9ec0e295e800)
00000100:00000001:9.0:1773851855.689766:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851855.689766:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851855.689767:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851855.689768:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:11.0:1773851855.689770:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851855.689771:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000004:00000010:11.0:1773851855.689773:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007644d37d.
00000100:00000001:9.0:1773851855.689773:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:11.0:1773851855.689774:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614130143049696ns, next at 614131143047823ns, rc = 0
00000100:00000001:9.0:1773851855.689774:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851855.689775:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:11.0:1773851855.689776:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:9.0:1773851855.689776:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851855.689778:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851855.689778:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051923648:2075@kfi7:13:default-yuba2-0
00000004:00000001:11.0:1773851855.689779:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851855.689781:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851855.689782:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851855.689782:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851855.689784:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851855.689785:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e50c3955.
02000000:00000001:9.0:1773851855.689786:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851855.689788:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:9.0:1773851855.689789:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000010:9.0:1773851855.689791:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000200:9.0:1773851855.689792:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923648, portal 4
00000100:00000001:9.0:1773851855.689794:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851855.689794:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637164268282624 : -106909441268992 : ffff9ec434bae300)
00000100:00000040:9.0:1773851855.689797:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851855.689802:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851855.689804:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:9.0:1773851855.689804:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003d28ebe7.
00000100:00000200:9.0:1773851855.689806:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923648, offset 0
00000400:00000200:9.0:1773851855.689808:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:9.0:1773851855.689810:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.689811:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851855.689813:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851855.689815:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851855.689818:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:9.0:1773851855.689821:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768653, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768652, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851855.689825:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851855.689826:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851855.689828:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:9.0:1773851855.689830:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768654:8768654:1024:4294967295] 2075@kfi7 LPNI seq info [5403908:5403908:16:4294967295]
00000400:00000200:9.0:1773851855.689832:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851855.689834:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.689838:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851855.689840:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:9.0:1773851855.689843:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851855.689845:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851855.689849:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851855.689854:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Using peer 2075@kfi7(0x2000000000004de)
00000800:00000200:9.0:1773851855.689859:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x2000000000004de: rc=0
00000800:00000200:9.0:1773851855.689862:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851855.689865:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851855.689867:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851855.689868:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851855.689869:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851855.689870:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851855.689872:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851855.689873:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851855.689874:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:10.0:1773851855.689875:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851855.689875:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851855.689876:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851855.689877:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851855.689879:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851855.689880:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000400:00000200:10.0:1773851855.689882:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003d28ebe7
00000400:00000010:10.0:1773851855.689883:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003d28ebe7.
00000100:00000001:10.0:1773851855.689884:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851855.689886:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851855.689891:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851855.689892:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851855.689897:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851855.689898:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851855.689900:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:10.0:1773851855.689903:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Transaction freed
00000800:00000200:9.0:1773851855.689945:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851855.689946:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851855.689948:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851855.689952:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851855.689955:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.689957:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851855.689958:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.689959:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851855.689961:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.689962:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851855.689963:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851855.689965:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.689967:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b24c0
00000400:00000200:9.0:1773851855.689969:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.689970:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781696d69 [1] + 224
00000800:00000200:9.0:1773851855.689974:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851855.689976:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851855.689978:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851855.689980:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851855.689981:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851855.689986:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851855.689992:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851855.689993:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851855.689996:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851855.690000:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851855.690001:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:9.0:1773851855.690002:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851855.690003:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851855.690004:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000400:00000200:9.0:1773851855.690005:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000400:00000010:9.0:1773851855.690006:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000100:00000001:9.0:1773851855.690007:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851855.690008:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851855.690013:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851855.690017:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851855.690018:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851855.690019:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851855.690020:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851855.690021:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851855.690022:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851855.690023:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851855.690025:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=88 v=66 (66 66 66 66)
00000100:00001000:9.0:1773851855.690027:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=88 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851855.690028:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851855.690029:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851855.690030:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851855.690031:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851855.690033:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851855.690034:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:9.0:1773851855.690035:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851855.690035:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851855.690037:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851855.690041:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851855.690043:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851855.690043:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851855.690045:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851855.690046:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851855.690047:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470755840 avail=351461613568 avail_mb=1372896928 hwm_mb=3131103 files=372064663 ffree=343233160 state=0: rc = 0
00000004:00000020:9.0:1773851855.690051:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470755840 free, 351461613568 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064663 files, 343233160 free files
00000004:00000001:9.0:1773851855.690054:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851855.690055:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851855.690060:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b624700f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051923648:2075@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851855.690063:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851855.690064:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851855.690065:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b624700f x1859433051923648/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852008 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851855.690069:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851855.690070:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851855.690071:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e50c3955.
02000000:00000001:9.0:1773851855.690072:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851855.690073:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851855.690073:0:41068:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:9.0:1773851855.690075:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851855.690075:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003b54e2de.
02000000:00000001:9.0:1773851855.690077:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851855.690078:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851855.690079:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b624700f.
00000100:00000001:9.0:1773851855.690080:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851855.690080:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851855.690081:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851855.690083:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851855.690083:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851855.690084:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851855.690085:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851855.721044:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851855.721045:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851855.721046:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851855.721048:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851855.721050:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721051:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11258@kfi7 : PUT - for me
00000400:00000200:30.0:1773851855.721052:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721053:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:30.0:1773851855.721054:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721055:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:30.0:1773851855.721056:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:30.0:1773851855.721057:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721058:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11258@kfi7 of length 224 into portal 12 MB=0x69b867d089ac0
00000400:00000200:30.0:1773851855.721059:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11258@kfi7 of length 224/224 into md 0x77fe139dd [64] + 163136
00000800:00000200:30.0:1773851855.721061:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851855.721062:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851855.721063:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11258@kfi7: PUT: OK
00000100:00000001:30.0:1773851855.721064:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851855.721065:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851855.721067:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003e308ff7.
00000100:00000040:30.0:1773851855.721068:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000003e308ff7 x1859851785902784 msgsize 224
00000100:00100000:30.0:1773851855.721069:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-11258@kfi7 (source: 12345-11258@kfi7)
00000100:00000001:30.0:1773851855.721070:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851855.721071:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000800:00000200:30.0:1773851855.721072:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851855.721073:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851855.721074:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851855.721074:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851855.721075:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851855.721076:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851855.721078:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859851785902784
00000020:00000001:31.0:1773851855.721079:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851855.721079:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08873a6770a
00000020:00000001:31.0:1773851855.721081:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851855.721086:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000048f0e615 refcount=5
00000020:00000001:31.0:1773851855.721087:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150717597696 : -106922991953920 : ffff9ec10d0bd800)
00000020:00000001:31.0:1773851855.721088:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637150717597696 : -106922991953920 : ffff9ec10d0bd800)
00000100:00000001:31.0:1773851855.721090:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851855.721091:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851855.721092:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000015155d29.
00000020:00000010:31.0:1773851855.721094:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851855.721095:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851855.721097:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851855.721097:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851855.721098:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.721100:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851855.721101:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851855.721101:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851855.721103:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.721105:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.721105:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851855.721105:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851855.721105:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851855.721107:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11258@kfi7, seq: 2055466
00000100:00000001:31.0:1773851855.721108:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.721108:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000048f0e615 : new rpc_count 1
00000100:00000001:31.0:1773851855.721109:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.721109:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637002779070976 : -107070930480640 : ffff9e9e9b391200)
00000100:00000040:28.0:1773851855.721110:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003e308ff7 x1859851785902784/t0(0) o400->d7981da2-55de-42b6-b17a-9d58902c456d@11258@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne212-0'
00000100:00000001:28.0:1773851855.721114:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.721114:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851855.721115:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e308ff7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d7981da2-55de-42b6-b17a-9d58902c456d+5:42002:x1859851785902784:12345-11258@kfi7:400:default-tuolumne212-0
00000100:00000200:28.0:1773851855.721117:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859851785902784
00000020:00000001:28.0:1773851855.721118:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851855.721118:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851855.721119:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721120:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851855.721121:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851855.721122:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851855.721122:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859851785902784, found 0 last_xid 1859851785902783
00000020:00000001:28.0:1773851855.721123:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851855.721124:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851855.721124:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851855.721125:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721126:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851855.721127:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851855.721127:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851855.721128:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bef19b5b.
02000000:00000001:28.0:1773851855.721129:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.721130:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721131:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851855.721132:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859851785902784
00010000:00000001:28.0:1773851855.721133:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851855.721134:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003e308ff7 x1859851785902784/t0(0) o400->d7981da2-55de-42b6-b17a-9d58902c456d@11258@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00010000:00000001:28.0:1773851855.721136:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851855.721137:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851855.721138:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851855.721139:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851855.721140:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b5b44ef refcount 5 to 11258@kfi7
00000100:00000001:28.0:1773851855.721141:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806080 : -107130477745536 : ffff9e90bdedea80)
02000000:00000001:28.0:1773851855.721142:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851855.721143:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.721143:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851855.721144:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11258@kfi7
00000400:00000010:28.0:1773851855.721145:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d3aa665.
00000100:00000200:28.0:1773851855.721146:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859851785902784, offset 224
00000400:00000200:28.0:1773851855.721148:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11258@kfi7
00000400:00000200:28.0:1773851855.721149:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.721150:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:28.0:1773851855.721151:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:28.0:1773851855.721152:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:28.0:1773851855.721154:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11258@kfi7 local destination
00000400:00000200:28.0:1773851855.721155:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768655:8768655:1024:4294967295] 11258@kfi7 LPNI seq info [14062:14062:16:4294967295]
00000400:00000200:28.0:1773851855.721157:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:28.0:1773851855.721158:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.721160:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11258@kfi7(11258@kfi7:11258@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851855.721162:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000800:00000200:28.0:1773851855.721163:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851855.721164:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851855.721169:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851855.721172:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 Using peer 11258@kfi7(0x423)
00000800:00000200:28.0:1773851855.721175:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x423: rc=0
00000800:00000200:28.0:1773851855.721177:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851855.721179:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.721181:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b5b44ef refcount 4 to 11258@kfi7
00010000:00000001:28.0:1773851855.721181:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851855.721182:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721183:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851855.721184:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003e308ff7 x1859851785902784/t0(0) o400->d7981da2-55de-42b6-b17a-9d58902c456d@11258@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00000100:00100000:28.0:1773851855.721189:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e308ff7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d7981da2-55de-42b6-b17a-9d58902c456d+5:42002:x1859851785902784:12345-11258@kfi7:400:default-tuolumne212-0 Request processed in 74us (120us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851855.721192:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11258@kfi7, seq: 2055466
00000100:00000040:28.0:1773851855.721193:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000048f0e615 : new rpc_count 0
00000100:00000001:28.0:1773851855.721193:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851855.721194:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851855.721195:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:28.0:1773851855.721196:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:28.0:1773851855.721197:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000015155d29.
00000020:00000040:28.0:1773851855.721198:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000048f0e615 : new refcount 4
00000100:00000001:28.0:1773851855.721199:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851855.721204:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851855.721206:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851855.721207:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11258@kfi7: PUT: OK
00000400:00000200:30.0:1773851855.721208:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d3aa665
00000400:00000010:30.0:1773851855.721208:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d3aa665.
00000100:00000001:30.0:1773851855.721209:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851855.721209:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851855.721210:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000800:00000200:30.0:1773851855.721212:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 Transaction freed
00000800:00000200:30.0:1773851855.721466:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851855.721466:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851855.721467:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851855.721469:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851855.721471:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721472:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11258@kfi7 : PUT - for me
00000400:00000200:30.0:1773851855.721473:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721473:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:30.0:1773851855.721474:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721475:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:30.0:1773851855.721476:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:30.0:1773851855.721476:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:30.0:1773851855.721477:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11258@kfi7 of length 224 into portal 12 MB=0x69b867d08a340
00000400:00000200:30.0:1773851855.721478:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11258@kfi7 of length 224/224 into md 0x77fe139dd [64] + 163360
00000800:00000200:30.0:1773851855.721480:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851855.721481:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851855.721482:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11258@kfi7: PUT: OK
00000100:00000001:30.0:1773851855.721483:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851855.721483:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851855.721484:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b2ab906b.
00000100:00000040:30.0:1773851855.721485:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000b2ab906b x1859851785904960 msgsize 224
00000100:00100000:30.0:1773851855.721486:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-11258@kfi7 (source: 12345-11258@kfi7)
00000100:00000001:30.0:1773851855.721487:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851855.721488:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000100:00000001:28.0:1773851855.721488:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851855.721489:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851855.721489:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851855.721489:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851855.721490:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851855.721491:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851855.721491:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859851785904960
00000020:00000001:28.0:1773851855.721492:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851855.721493:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f088caa601dc
00000020:00000001:28.0:1773851855.721493:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851855.721497:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000407f4e4e refcount=5
00000020:00000001:28.0:1773851855.721498:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120382072832 : -106953327478784 : ffff9eb9fce87800)
00000020:00000001:28.0:1773851855.721499:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637120382072832 : -106953327478784 : ffff9eb9fce87800)
00000100:00000001:28.0:1773851855.721500:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.721500:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851855.721501:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008c112e85.
00000020:00000010:28.0:1773851855.721502:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.721502:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8a95503.
00000100:00000001:28.0:1773851855.721503:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851855.721504:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851855.721504:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.721505:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851855.721505:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851855.721506:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.721507:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.721508:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851855.721508:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851855.721509:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:28.0:1773851855.721509:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11258@kfi7, seq: 2055467
00000100:00000001:31.0:1773851855.721510:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:28.0:1773851855.721510:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000407f4e4e : new rpc_count 1
00000100:00000001:28.0:1773851855.721510:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832825728 : -106933876725888 : ffff9ebe84436780)
00000100:00000001:31.0:1773851855.721511:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.721511:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b2ab906b x1859851785904960/t0(0) o400->1deafb17-958a-41fb-a8ff-c35b2029a49d@11258@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne212-0'
00000100:00000001:31.0:1773851855.721512:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.721514:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.721514:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851855.721515:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2ab906b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:1deafb17-958a-41fb-a8ff-c35b2029a49d+5:42004:x1859851785904960:12345-11258@kfi7:400:default-tuolumne212-0
00000100:00000200:28.0:1773851855.721517:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859851785904960
00000020:00000001:28.0:1773851855.721517:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851855.721518:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851855.721518:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721520:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851855.721520:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851855.721521:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851855.721522:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859851785904960, found 0 last_xid 1859851785904959
00000020:00000001:28.0:1773851855.721522:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851855.721523:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851855.721523:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851855.721524:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721524:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851855.721525:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851855.721525:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851855.721526:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000064d31181.
02000000:00000001:28.0:1773851855.721527:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.721527:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721528:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851855.721528:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859851785904960
00010000:00000001:28.0:1773851855.721529:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851855.721530:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b2ab906b x1859851785904960/t0(0) o400->1deafb17-958a-41fb-a8ff-c35b2029a49d@11258@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00010000:00000001:28.0:1773851855.721533:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851855.721533:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851855.721534:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851855.721535:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851855.721535:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b5b44ef refcount 5 to 11258@kfi7
00000100:00000001:28.0:1773851855.721536:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806080 : -107130477745536 : ffff9e90bdedea80)
02000000:00000001:28.0:1773851855.721537:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851855.721537:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.721538:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851855.721539:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11258@kfi7
00000400:00000010:28.0:1773851855.721539:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f52a267c.
00000100:00000200:28.0:1773851855.721540:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859851785904960, offset 224
00000400:00000200:28.0:1773851855.721541:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11258@kfi7
00000400:00000200:28.0:1773851855.721542:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.721543:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:28.0:1773851855.721544:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:28.0:1773851855.721546:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:28.0:1773851855.721547:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11258@kfi7 local destination
00000400:00000200:28.0:1773851855.721549:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768656:8768656:1024:4294967295] 11258@kfi7 LPNI seq info [14063:14063:16:4294967295]
00000400:00000200:28.0:1773851855.721550:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:28.0:1773851855.721551:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.721553:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11258@kfi7(11258@kfi7:11258@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851855.721554:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000800:00000200:28.0:1773851855.721555:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851855.721556:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851855.721558:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851855.721560:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 Using peer 11258@kfi7(0x100000000000828)
00000800:00000200:28.0:1773851855.721564:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x100000000000828: rc=0
00000800:00000200:28.0:1773851855.721565:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851855.721567:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.721568:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b5b44ef refcount 4 to 11258@kfi7
00010000:00000001:28.0:1773851855.721568:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851855.721569:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.721569:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851855.721570:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b2ab906b x1859851785904960/t0(0) o400->1deafb17-958a-41fb-a8ff-c35b2029a49d@11258@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00000100:00100000:28.0:1773851855.721575:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2ab906b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:1deafb17-958a-41fb-a8ff-c35b2029a49d+5:42004:x1859851785904960:12345-11258@kfi7:400:default-tuolumne212-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851855.721577:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11258@kfi7, seq: 2055467
00000100:00000040:28.0:1773851855.721578:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000407f4e4e : new rpc_count 0
00000100:00000001:28.0:1773851855.721579:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851855.721580:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851855.721581:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.721582:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8a95503.
00000020:00000010:28.0:1773851855.721582:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008c112e85.
00000020:00000040:28.0:1773851855.721583:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000407f4e4e : new refcount 4
00000100:00000001:28.0:1773851855.721583:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851855.721589:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851855.721590:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851855.721591:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11258@kfi7: PUT: OK
00000400:00000200:30.0:1773851855.721592:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f52a267c
00000400:00000010:30.0:1773851855.721592:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f52a267c.
00000100:00000001:30.0:1773851855.721593:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851855.721593:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851855.721594:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000800:00000200:30.0:1773851855.721596:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 Transaction freed
00000400:00000200:29.0:1773851855.753732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851855.753733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:26.0:1773851855.763702:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851855.763703:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851855.763704:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851855.763707:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851855.763708:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.763720:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23840@kfi7 : PUT - for me
00000400:00000200:26.0:1773851855.763720:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.763721:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 1
00000400:00000200:26.0:1773851855.763722:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.763723:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000400:00000200:26.0:1773851855.763724:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 3
00000400:00000200:26.0:1773851855.763727:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24032@kfi7 to cpt 1
00000400:00000200:26.0:1773851855.763728:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24032@kfi7 of length 224 into portal 12 MB=0x69b4756450e80
00000400:00000200:26.0:1773851855.763729:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24032@kfi7 of length 224/224 into md 0x16159c6179 [64] + 182416
00000800:00000200:26.0:1773851855.763731:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851855.763733:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851855.763734:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23840@kfi7: PUT: OK
00000100:00000001:26.0:1773851855.763735:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851855.763736:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851855.763736:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000208dfb3.
00000100:00000040:26.0:1773851855.763737:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000000208dfb3 x1859580552613504 msgsize 224
00000100:00100000:26.0:1773851855.763739:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-24032@kfi7 (source: 12345-23840@kfi7)
00000100:00000001:26.0:1773851855.763739:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851855.763740:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000800:00000200:26.0:1773851855.763742:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851855.763742:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851855.763743:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851855.763744:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851855.763744:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851855.763746:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851855.763747:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580552613504
00000020:00000001:24.0:1773851855.763748:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851855.763748:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddd0109eb
00000020:00000001:24.0:1773851855.763749:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851855.763751:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000044bea927 refcount=5
00000020:00000001:24.0:1773851855.763752:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077288256512 : -106996421295104 : ffff9eaff4510400)
00000020:00000001:24.0:1773851855.763754:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637077288256512 : -106996421295104 : ffff9eaff4510400)
00000100:00000001:24.0:1773851855.763755:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851855.763757:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851855.763758:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000abee30ba.
00000020:00000010:24.0:1773851855.763759:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851855.763761:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006cfd8c16.
00000100:00000001:24.0:1773851855.763762:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851855.763763:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851855.763764:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851855.763765:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851855.763766:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851855.763766:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851855.763768:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851855.763770:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851855.763770:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851855.763770:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851855.763770:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851855.763771:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24032@kfi7, seq: 2025050
00000100:00000040:26.0:1773851855.763772:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000044bea927 : new rpc_count 1
00000100:00000001:24.0:1773851855.763772:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.763773:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538621312 : -106958170930304 : ffff9eb8dc374380)
00000100:00000001:24.0:1773851855.763773:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851855.763774:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000208dfb3 x1859580552613504/t0(0) o400->28c7b5db-3e42-4937-9833-2cefd799bdeb@24032@kfi7:72/0 lens 224/0 e 0 to 0 dl 1773852187 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1983-0'
00000100:00000001:26.0:1773851855.763777:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851855.763778:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851855.763779:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000208dfb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:28c7b5db-3e42-4937-9833-2cefd799bdeb+5:39824:x1859580552613504:12345-24032@kfi7:400:default-tuolumne1983-0
00000100:00000200:26.0:1773851855.763780:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580552613504
00000020:00000001:26.0:1773851855.763781:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851855.763782:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851855.763782:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.763783:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851855.763784:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851855.763785:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851855.763785:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580552613504, found 0 last_xid 1859580552613503
00000020:00000001:26.0:1773851855.763786:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851855.763787:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851855.763787:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851855.763788:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.763789:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851855.763789:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851855.763790:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851855.763791:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000608ed6cb.
02000000:00000001:26.0:1773851855.763791:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.763792:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.763793:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851855.763793:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824229, transno 0, xid 1859580552613504
00010000:00000001:26.0:1773851855.763794:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851855.763795:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000208dfb3 x1859580552613504/t0(0) o400->28c7b5db-3e42-4937-9833-2cefd799bdeb@24032@kfi7:72/0 lens 224/224 e 0 to 0 dl 1773852187 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1983-0'
00010000:00000001:26.0:1773851855.763797:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851855.763798:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851855.763799:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=88 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851855.763800:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851855.763801:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b3bf362 refcount 3 to 24032@kfi7
00000100:00000001:26.0:1773851855.763802:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981536 : -107130476570080 : ffff9e90bdffda20)
02000000:00000001:26.0:1773851855.763803:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851855.763803:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851855.763804:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851855.763805:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23840@kfi7
00000400:00000010:26.0:1773851855.763806:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007ba097d8.
00000100:00000200:26.0:1773851855.763807:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580552613504, offset 224
00000400:00000200:26.0:1773851855.763809:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23840@kfi7
00000400:00000200:26.0:1773851855.763809:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.763810:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 1
00000400:00000200:26.0:1773851855.763812:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000400:00000200:26.0:1773851855.763813:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 3
00000400:00000200:26.0:1773851855.763814:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23840@kfi7 local destination
00000400:00000200:26.0:1773851855.763816:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768657:8768657:1024:4294967295] 23840@kfi7 LPNI seq info [12932517:12932517:16:4294967295]
00000400:00000200:26.0:1773851855.763817:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000400:00000200:26.0:1773851855.763818:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:26.0:1773851855.763820:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23840@kfi7(23840@kfi7:23840@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851855.763822:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 3
00000800:00000200:26.0:1773851855.763823:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851855.763825:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851855.763827:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851855.763830:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010d0 Using peer 23840@kfi7(0x1000000000010d0)
00000800:00000200:26.0:1773851855.763834:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0x1000000000010d0: rc=0
00000800:00000200:26.0:1773851855.763836:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010d0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851855.763838:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851855.763839:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b3bf362 refcount 2 to 24032@kfi7
00010000:00000001:26.0:1773851855.763840:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851855.763840:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851855.763841:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851855.763842:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000208dfb3 x1859580552613504/t0(0) o400->28c7b5db-3e42-4937-9833-2cefd799bdeb@24032@kfi7:72/0 lens 224/224 e 0 to 0 dl 1773852187 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1983-0'
00000100:00100000:26.0:1773851855.763850:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000208dfb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:28c7b5db-3e42-4937-9833-2cefd799bdeb+5:39824:x1859580552613504:12345-24032@kfi7:400:default-tuolumne1983-0 Request processed in 72us (112us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851855.763852:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010d0 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851855.763853:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24032@kfi7, seq: 2025050
00000100:00000040:26.0:1773851855.763853:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000044bea927 : new rpc_count 0
00000100:00000001:26.0:1773851855.763854:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851855.763855:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851855.763855:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851855.763856:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:26.0:1773851855.763857:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006cfd8c16.
00000400:00000200:25.0:1773851855.763857:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23840@kfi7: PUT: OK
00000020:00000010:26.0:1773851855.763858:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000abee30ba.
00000400:00000200:25.0:1773851855.763858:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007ba097d8
00000020:00000040:26.0:1773851855.763859:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000044bea927 : new refcount 4
00000100:00000001:26.0:1773851855.763859:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851855.763859:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007ba097d8.
00000100:00000001:25.0:1773851855.763860:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851855.763861:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851855.763862:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000800:00000200:25.0:1773851855.763865:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 23840@kfi7(00000000c5e93e54):0x0 lsk 4305 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010d0 Transaction freed
00000800:00000200:21.0:1773851855.776491:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851855.776492:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851855.776493:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851855.776495:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851855.776497:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.776498:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23803@kfi7 : PUT - for me
00000400:00000200:21.0:1773851855.776499:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.776500:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 1
00000400:00000200:21.0:1773851855.776501:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.776501:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000400:00000200:21.0:1773851855.776502:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 3
00000400:00000200:21.0:1773851855.776503:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:21.0:1773851855.776504:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23803@kfi7 of length 224 into portal 12 MB=0x699de8d4e5740
00000400:00000200:21.0:1773851855.776505:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23803@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 25160
00000800:00000200:21.0:1773851855.776507:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851855.776509:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851855.776510:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23803@kfi7: PUT: OK
00000100:00000001:21.0:1773851855.776511:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851855.776511:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851855.776512:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e9688a9b.
00000100:00000040:21.0:1773851855.776513:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e9688a9b x1858030992774976 msgsize 224
00000100:00100000:21.0:1773851855.776514:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23803@kfi7 (source: 12345-23803@kfi7)
00000100:00000001:21.0:1773851855.776515:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851855.776516:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000100:00000001:23.0:1773851855.776517:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851855.776517:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851855.776518:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851855.776518:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851855.776519:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851855.776519:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00100000:23.0:1773851855.776520:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030992774976
00000020:00000001:23.0:1773851855.776520:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851855.776521:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910cb
00000020:00000001:23.0:1773851855.776521:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851855.776525:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071a6e1d9 refcount=6
00000020:00000001:23.0:1773851855.776526:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240328192 : -107152469223424 : ffff9e8b9f229800)
00000020:00000001:23.0:1773851855.776526:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240328192 : -107152469223424 : ffff9e8b9f229800)
00000100:00000001:23.0:1773851855.776527:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.776528:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851855.776529:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab1b10d5.
00000020:00000010:23.0:1773851855.776530:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851855.776531:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851855.776531:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851855.776532:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851855.776532:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.776533:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851855.776534:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851855.776534:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.776535:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851855.776536:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851855.776536:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851855.776537:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851855.776537:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851855.776538:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23803@kfi7, seq: 1997931
00000100:00000040:23.0:1773851855.776538:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071a6e1d9 : new rpc_count 1
00000100:00000001:22.0:1773851855.776538:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.776539:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117345152 : -106995592206464 : ffff9eb025bbe780)
00000100:00000001:22.0:1773851855.776539:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.776540:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e9688a9b x1858030992774976/t0(0) o400->918a8a56-13a2-4a91-9ded-d83af214a091@23803@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne261-0'
00000100:00000001:23.0:1773851855.776543:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851855.776543:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851855.776545:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9688a9b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:918a8a56-13a2-4a91-9ded-d83af214a091+6:47912:x1858030992774976:12345-23803@kfi7:400:default-tuolumne261-0
00000100:00000200:23.0:1773851855.776546:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030992774976
00000020:00000001:23.0:1773851855.776547:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851855.776548:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851855.776548:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.776549:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851855.776550:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851855.776550:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851855.776551:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030992774976, found 0 last_xid 1858030992774975
00000020:00000001:23.0:1773851855.776552:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851855.776552:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851855.776553:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851855.776553:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.776554:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851855.776554:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851855.776555:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851855.776556:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005aa369b5.
02000000:00000001:23.0:1773851855.776556:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.776557:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.776558:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851855.776558:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030992774976
00010000:00000001:23.0:1773851855.776559:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851855.776560:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e9688a9b x1858030992774976/t0(0) o400->918a8a56-13a2-4a91-9ded-d83af214a091@23803@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne261-0'
00010000:00000001:23.0:1773851855.776562:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851855.776563:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851855.776564:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=88 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851855.776565:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851855.776565:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a39a93a refcount 5 to 23803@kfi7
00000100:00000001:23.0:1773851855.776566:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424334176 : -107145285217440 : ffff9e8d4b55d360)
02000000:00000001:23.0:1773851855.776567:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851855.776567:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851855.776568:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851855.776569:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23803@kfi7
00000400:00000010:23.0:1773851855.776570:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008506b019.
00000100:00000200:23.0:1773851855.776571:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030992774976, offset 224
00000400:00000200:23.0:1773851855.776572:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23803@kfi7
00000400:00000200:23.0:1773851855.776573:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.776574:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 1
00000400:00000200:23.0:1773851855.776574:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000400:00000200:23.0:1773851855.776576:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 3
00000400:00000200:23.0:1773851855.776577:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23803@kfi7 local destination
00000400:00000200:23.0:1773851855.776578:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768658:8768658:1024:4294967295] 23803@kfi7 LPNI seq info [28034:28034:16:4294967295]
00000400:00000200:23.0:1773851855.776580:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000400:00000200:23.0:1773851855.776580:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:23.0:1773851855.776582:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23803@kfi7(23803@kfi7:23803@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851855.776583:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 3
00000800:00000200:23.0:1773851855.776585:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851855.776586:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851855.776588:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851855.776590:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f Using peer 23803@kfi7(0x39f)
00000800:00000200:23.0:1773851855.776593:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x39f: rc=0
00000800:00000200:23.0:1773851855.776594:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851855.776596:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851855.776597:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a39a93a refcount 4 to 23803@kfi7
00010000:00000001:23.0:1773851855.776598:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851855.776598:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851855.776599:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851855.776600:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e9688a9b x1858030992774976/t0(0) o400->918a8a56-13a2-4a91-9ded-d83af214a091@23803@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne261-0'
00000100:00100000:23.0:1773851855.776605:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9688a9b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:918a8a56-13a2-4a91-9ded-d83af214a091+6:47912:x1858030992774976:12345-23803@kfi7:400:default-tuolumne261-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851855.776607:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23803@kfi7, seq: 1997931
00000800:00000200:21.0:1773851855.776607:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851855.776608:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071a6e1d9 : new rpc_count 0
00000400:00000200:21.0:1773851855.776608:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851855.776609:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851855.776609:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851855.776609:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23803@kfi7: PUT: OK
00000020:00000010:23.0:1773851855.776610:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851855.776610:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000400:00000200:21.0:1773851855.776610:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008506b019
00000020:00000010:23.0:1773851855.776611:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab1b10d5.
00000400:00000010:21.0:1773851855.776611:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008506b019.
00000100:00000001:21.0:1773851855.776611:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:23.0:1773851855.776612:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000071a6e1d9 : new refcount 5
00000100:00000001:21.0:1773851855.776612:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851855.776613:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851855.776613:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000800:00000200:21.0:1773851855.776614:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f Transaction freed
00000800:00000200:13.0:1773851855.816183:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851855.816184:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851855.816186:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851855.816188:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851855.816191:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.816192:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:13.0:1773851855.816193:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.816195:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:13.0:1773851855.816196:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.816196:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:13.0:1773851855.816197:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:13.0:1773851855.816198:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851855.816199:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a86084e00
00000400:00000200:13.0:1773851855.816201:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x8242bd2ed [256] + 2464
00000800:00000200:13.0:1773851855.816203:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851855.816204:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851855.816206:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000001:13.0:1773851855.816207:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851855.816207:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:13.0:1773851855.816208:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008bfea84d.
00000100:00000040:13.0:1773851855.816209:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000008bfea84d x1859388080410112 msgsize 224
00000100:00100000:13.0:1773851855.816210:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-7@kfi7)
00000100:00000001:13.0:1773851855.816211:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851855.816212:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:13.0:1773851855.816214:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851855.816215:0:1537104:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851855.816217:0:1537104:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851855.816218:0:1537104:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851855.816218:0:1537104:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851855.816220:0:1537104:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851855.816221:0:1537104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080410112
00000020:00000001:12.0:1773851855.816223:0:1537104:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851855.816223:0:1537104:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:12.0:1773851855.816224:0:1537104:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851855.816226:0:1537104:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:12.0:1773851855.816227:0:1537104:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:12.0:1773851855.816229:0:1537104:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:12.0:1773851855.816230:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851855.816231:0:1537104:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851855.816233:0:1537104:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000290d0842.
00000020:00000010:12.0:1773851855.816235:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851855.816236:0:1537104:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000422619af.
00000100:00000040:12.0:1773851855.816238:0:1537104:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:12.0:1773851855.816239:0:1537104:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851855.816240:0:1537104:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851855.816241:0:1537104:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851855.816243:0:1537104:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851855.816244:0:1537104:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851855.816247:0:1537104:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851855.816248:0:1537109:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851855.816248:0:1537104:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851855.816249:0:1537109:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851855.816250:0:1537104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 1164649
00000100:00000001:14.0:1773851855.816251:0:1537109:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851855.816251:0:1537104:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:14.0:1773851855.816252:0:1537109:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851855.816252:0:1537104:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197395328 : -106942512156288 : ffff9ebc818d3180)
00000100:00000040:12.0:1773851855.816254:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008bfea84d x1859388080410112/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:12.0:1773851855.816259:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851855.816260:0:1537104:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851855.816262:0:1537104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bfea84d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080410112:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:12.0:1773851855.816264:0:1537104:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080410112
00000020:00000001:12.0:1773851855.816266:0:1537104:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851855.816267:0:1537104:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851855.816268:0:1537104:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851855.816269:0:1537104:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851855.816270:0:1537104:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:12.0:1773851855.816271:0:1537104:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:12.0:1773851855.816272:0:1537104:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851855.816273:0:1537104:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851855.816274:0:1537104:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851855.816275:0:1537104:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851855.816276:0:1537104:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851855.816277:0:1537104:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851855.816279:0:1537104:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000001061b4d8.
02000000:00000001:12.0:1773851855.816280:0:1537104:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851855.816281:0:1537104:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851855.816283:0:1537104:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:12.0:1773851855.816284:0:1537104:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:12.0:1773851855.816285:0:1537104:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:12.0:1773851855.816286:0:1537104:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:12.0:1773851855.816288:0:1537104:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:12.0:1773851855.816291:0:1537104:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851855.816292:0:1537104:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080410112
00010000:00000001:12.0:1773851855.816293:0:1537104:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851855.816295:0:1537104:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008bfea84d x1859388080410112/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:582/0 lens 224/368 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:12.0:1773851855.816299:0:1537104:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851855.816300:0:1537104:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851855.816302:0:1537104:0:(import.c:1951:at_measured()) add 1 to 00000000a8c7027b time=165 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851855.816304:0:1537104:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851855.816305:0:1537104:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:12.0:1773851855.816306:0:1537104:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:12.0:1773851855.816307:0:1537104:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851855.816308:0:1537104:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851855.816309:0:1537104:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851855.816311:0:1537104:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:12.0:1773851855.816313:0:1537104:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df1f761c.
00000100:00000200:12.0:1773851855.816314:0:1537104:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080410112, offset 224
00000400:00000200:12.0:1773851855.816317:0:1537104:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:12.0:1773851855.816319:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:12.0:1773851855.816320:0:1537104:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:12.0:1773851855.816322:0:1537104:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:12.0:1773851855.816324:0:1537104:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:12.0:1773851855.816326:0:1537104:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  7@kfi7 local destination
00000400:00000200:12.0:1773851855.816329:0:1537104:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768659:8768659:1024:4294967295] 7@kfi7 LPNI seq info [17340057:17340057:16:4294967295]
00000400:00000200:12.0:1773851855.816331:0:1537104:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:12.0:1773851855.816332:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:12.0:1773851855.816336:0:1537104:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851855.816338:0:1537104:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000800:00000200:12.0:1773851855.816341:0:1537104:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851855.816343:0:1537104:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:12.0:1773851855.816347:0:1537104:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851855.816351:0:1537104:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11b1 Using peer 7@kfi7(0x11b1)
00000800:00000200:12.0:1773851855.816356:0:1537104:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 468 bytes to peer 0x11b1: rc=0
00000800:00000200:12.0:1773851855.816358:0:1537104:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851855.816362:0:1537104:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851855.816363:0:1537104:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:12.0:1773851855.816366:0:1537104:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851855.816367:0:1537104:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851855.816368:0:1537104:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851855.816370:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008bfea84d x1859388080410112/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:582/0 lens 224/368 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:12.0:1773851855.816375:0:1537104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bfea84d pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080410112:12345-7@kfi7:41:default-yuba5-0 Request processed in 114us (165us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851855.816380:0:1537104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 1164649
00000100:00000040:12.0:1773851855.816381:0:1537104:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:12.0:1773851855.816383:0:1537104:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851855.816383:0:1537104:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851855.816384:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851855.816386:0:1537104:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000422619af.
00000020:00000010:12.0:1773851855.816387:0:1537104:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000290d0842.
00000020:00000040:12.0:1773851855.816388:0:1537104:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:12.0:1773851855.816389:0:1537104:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851855.816396:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851855.816398:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851855.816399:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000400:00000200:13.0:1773851855.816400:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df1f761c
00000400:00000010:13.0:1773851855.816401:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df1f761c.
00000100:00000001:13.0:1773851855.816401:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851855.816402:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851855.816403:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:13.0:1773851855.816404:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11b1 Transaction freed
00000800:00000200:29.0:1773851855.828472:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.828473:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.828475:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.828478:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851855.828481:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.828483:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19586@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.828484:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.828487:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 1
00000400:00000200:29.0:1773851855.828489:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.828490:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000400:00000200:29.0:1773851855.828491:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 3
00000400:00000200:29.0:1773851855.828493:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19522@kfi7 to cpt 4
00000400:00000200:29.0:1773851855.828494:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19522@kfi7 of length 224 into portal 12 MB=0x699e184a496c0
00000400:00000200:29.0:1773851855.828496:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19522@kfi7 of length 224/224 into md 0x77fe139dd [64] + 163584
00000800:00000200:29.0:1773851855.828499:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851855.828502:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.828503:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19586@kfi7: PUT: OK
00000100:00000001:29.0:1773851855.828505:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851855.828505:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851855.828508:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000543749aa.
00000100:00000040:29.0:1773851855.828509:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000543749aa x1858043732334272 msgsize 224
00000100:00100000:29.0:1773851855.828511:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19522@kfi7 (source: 12345-19586@kfi7)
00000100:00000001:29.0:1773851855.828513:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851855.828514:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000100:00000001:28.0:1773851855.828515:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851855.828516:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851855.828516:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851855.828517:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851855.828518:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851855.828519:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851855.828520:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043732334272
00000020:00000001:28.0:1773851855.828521:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851855.828522:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92482
00000020:00000001:28.0:1773851855.828523:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851855.828527:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002cf1246b refcount=6
00000020:00000001:28.0:1773851855.828528:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630529024 : -107123079022592 : ffff9e9276ed7800)
00000020:00000001:28.0:1773851855.828529:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630529024 : -107123079022592 : ffff9e9276ed7800)
00000100:00000001:28.0:1773851855.828531:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.828532:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851855.828533:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008c112e85.
00000020:00000010:28.0:1773851855.828535:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.828536:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8a95503.
00000100:00000001:28.0:1773851855.828538:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851855.828538:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851855.828539:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.828541:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851855.828542:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851855.828543:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.828544:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.828546:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.828547:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.828547:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851855.828547:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851855.828549:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19522@kfi7, seq: 2055468
00000100:00000001:31.0:1773851855.828550:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.828550:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002cf1246b : new rpc_count 1
00000100:00000001:31.0:1773851855.828551:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.828551:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165180401152 : -106908529150464 : ffff9ec46b18b600)
00000100:00000040:28.0:1773851855.828554:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000543749aa x1858043732334272/t0(0) o400->203b0707-8946-4ab9-bf3b-e60dd2992146@19522@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1720-0'
00000100:00000001:28.0:1773851855.828558:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.828559:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851855.828560:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000543749aa pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:203b0707-8946-4ab9-bf3b-e60dd2992146+6:39749:x1858043732334272:12345-19522@kfi7:400:default-tuolumne1720-0
00000100:00000200:28.0:1773851855.828563:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043732334272
00000020:00000001:28.0:1773851855.828564:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851855.828565:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851855.828566:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.828567:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851855.828568:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851855.828569:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851855.828570:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043732334272, found 0 last_xid 1858043732334271
00000020:00000001:28.0:1773851855.828571:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851855.828572:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851855.828573:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851855.828574:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.828575:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851855.828576:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851855.828577:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851855.828578:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d7aa1437.
02000000:00000001:28.0:1773851855.828579:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.828580:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.828581:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851855.828582:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183243430305, transno 0, xid 1858043732334272
00010000:00000001:28.0:1773851855.828584:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851855.828585:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000543749aa x1858043732334272/t0(0) o400->203b0707-8946-4ab9-bf3b-e60dd2992146@19522@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1720-0'
00010000:00000001:28.0:1773851855.828589:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851855.828590:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851855.828591:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851855.828593:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851855.828595:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000097ed30be refcount 3 to 19522@kfi7
00000100:00000001:28.0:1773851855.828596:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583546048 : -107156126005568 : ffff9e8ac52c86c0)
02000000:00000001:28.0:1773851855.828597:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851855.828598:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.828599:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851855.828600:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19586@kfi7
00000400:00000010:28.0:1773851855.828601:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000048f1f202.
00000100:00000200:28.0:1773851855.828602:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043732334272, offset 224
00000400:00000200:28.0:1773851855.828605:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19586@kfi7
00000400:00000200:28.0:1773851855.828606:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.828608:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 1
00000400:00000200:28.0:1773851855.828609:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000400:00000200:28.0:1773851855.828611:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 3
00000400:00000200:28.0:1773851855.828613:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19586@kfi7 local destination
00000400:00000200:28.0:1773851855.828615:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768660:8768660:1024:4294967295] 19586@kfi7 LPNI seq info [4566817:4566817:16:4294967295]
00000400:00000200:28.0:1773851855.828618:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000400:00000200:28.0:1773851855.828619:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.828622:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19586@kfi7(19586@kfi7:19586@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851855.828624:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 3
00000800:00000200:28.0:1773851855.828627:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851855.828628:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851855.828632:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851855.828636:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008aa Using peer 19586@kfi7(0x1000000000008aa)
00000800:00000200:28.0:1773851855.828640:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x1000000000008aa: rc=0
00000800:00000200:28.0:1773851855.828642:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851855.828646:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.828648:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000097ed30be refcount 2 to 19522@kfi7
00010000:00000001:28.0:1773851855.828651:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851855.828652:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.828653:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851855.828654:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000543749aa x1858043732334272/t0(0) o400->203b0707-8946-4ab9-bf3b-e60dd2992146@19522@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1720-0'
00000100:00100000:28.0:1773851855.828659:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000543749aa pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:203b0707-8946-4ab9-bf3b-e60dd2992146+6:39749:x1858043732334272:12345-19522@kfi7:400:default-tuolumne1720-0 Request processed in 99us (149us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851855.828663:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19522@kfi7, seq: 2055468
00000100:00000040:28.0:1773851855.828664:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002cf1246b : new rpc_count 0
00000100:00000001:28.0:1773851855.828665:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851855.828666:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851855.828667:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.828668:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8a95503.
00000020:00000010:28.0:1773851855.828669:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008c112e85.
00000020:00000040:28.0:1773851855.828670:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000002cf1246b : new refcount 5
00000100:00000001:28.0:1773851855.828671:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851855.828679:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008aa TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851855.828681:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.828683:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19586@kfi7: PUT: OK
00000400:00000200:29.0:1773851855.828684:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000048f1f202
00000400:00000010:29.0:1773851855.828685:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000048f1f202.
00000100:00000001:29.0:1773851855.828686:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851855.828687:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851855.828688:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000800:00000200:29.0:1773851855.828691:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 19586@kfi7(00000000fb32f79a):0x0 lsk 2219 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008aa Transaction freed
00000800:00000200:29.0:1773851855.854803:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.854803:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.854805:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.854806:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851855.854808:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.854809:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10449@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.854810:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.854811:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 1
00000400:00000200:29.0:1773851855.854812:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.854813:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000400:00000200:29.0:1773851855.854814:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 3
00000400:00000200:29.0:1773851855.854814:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10448@kfi7 to cpt 4
00000400:00000200:29.0:1773851855.854816:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10448@kfi7 of length 224 into portal 12 MB=0x699e115819140
00000400:00000200:29.0:1773851855.854817:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10448@kfi7 of length 224/224 into md 0x77fe139dd [64] + 163808
00000800:00000200:29.0:1773851855.854818:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851855.854820:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.854821:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10449@kfi7: PUT: OK
00000100:00000001:29.0:1773851855.854822:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851855.854822:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851855.854824:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d00e119c.
00000100:00000040:29.0:1773851855.854824:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000d00e119c x1858041867768128 msgsize 224
00000100:00100000:29.0:1773851855.854825:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-10448@kfi7 (source: 12345-10449@kfi7)
00000100:00000001:29.0:1773851855.854826:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851855.854827:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000800:00000200:29.0:1773851855.854828:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851855.854828:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851855.854828:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851855.854829:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851855.854829:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851855.854830:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851855.854830:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041867768128
00000020:00000001:28.0:1773851855.854831:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851855.854831:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91689
00000020:00000001:28.0:1773851855.854831:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851855.854835:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f7208bc refcount=6
00000020:00000001:28.0:1773851855.854836:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241241600 : -107152468310016 : ffff9e8b9f308800)
00000020:00000001:28.0:1773851855.854837:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241241600 : -107152468310016 : ffff9e8b9f308800)
00000100:00000001:28.0:1773851855.854837:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.854838:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851855.854839:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008c112e85.
00000020:00000010:28.0:1773851855.854839:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.854841:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8a95503.
00000100:00000001:28.0:1773851855.854841:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851855.854842:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851855.854842:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.854843:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851855.854843:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851855.854844:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.854844:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.854845:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.854846:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.854846:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851855.854846:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851855.854847:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851855.854847:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10448@kfi7, seq: 2055469
00000100:00000040:28.0:1773851855.854847:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f7208bc : new rpc_count 1
00000100:00000001:31.0:1773851855.854848:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.854848:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124442196224 : -106949267355392 : ffff9ebaeee90900)
00000100:00000040:28.0:1773851855.854849:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d00e119c x1858041867768128/t0(0) o400->9aba6351-b3b7-49dd-bb1e-db0185a8585c@10448@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1137-0'
00000100:00000001:28.0:1773851855.854852:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.854852:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851855.854853:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d00e119c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:9aba6351-b3b7-49dd-bb1e-db0185a8585c+6:39710:x1858041867768128:12345-10448@kfi7:400:default-tuolumne1137-0
00000100:00000200:28.0:1773851855.854854:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041867768128
00000020:00000001:28.0:1773851855.854855:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851855.854855:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851855.854856:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.854856:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851855.854857:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851855.854857:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851855.854858:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041867768128, found 0 last_xid 1858041867768127
00000020:00000001:28.0:1773851855.854858:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851855.854859:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851855.854859:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851855.854860:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.854860:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851855.854861:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851855.854861:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851855.854863:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b4aa73e4.
02000000:00000001:28.0:1773851855.854863:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.854864:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.854864:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851855.854865:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183201002852, transno 0, xid 1858041867768128
00010000:00000001:28.0:1773851855.854866:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851855.854867:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d00e119c x1858041867768128/t0(0) o400->9aba6351-b3b7-49dd-bb1e-db0185a8585c@10448@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1137-0'
00010000:00000001:28.0:1773851855.854869:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851855.854869:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851855.854870:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851855.854871:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851855.854871:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007553f5da refcount 3 to 10448@kfi7
00000100:00000001:28.0:1773851855.854872:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301335200 : -107155408216416 : ffff9e8aeff51ea0)
02000000:00000001:28.0:1773851855.854873:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851855.854873:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.854874:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851855.854875:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10449@kfi7
00000400:00000010:28.0:1773851855.854875:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc38e5ee.
00000100:00000200:28.0:1773851855.854876:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041867768128, offset 224
00000400:00000200:28.0:1773851855.854877:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10449@kfi7
00000400:00000200:28.0:1773851855.854878:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.854879:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 1
00000400:00000200:28.0:1773851855.854879:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000400:00000200:28.0:1773851855.854881:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 3
00000400:00000200:28.0:1773851855.854882:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10449@kfi7 local destination
00000400:00000200:28.0:1773851855.854883:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768661:8768661:1024:4294967295] 10449@kfi7 LPNI seq info [8660002:8660002:16:4294967295]
00000400:00000200:28.0:1773851855.854884:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000400:00000200:28.0:1773851855.854885:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.854887:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10449@kfi7(10449@kfi7:10449@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851855.854888:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 3
00000800:00000200:28.0:1773851855.854889:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851855.854891:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851855.854893:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851855.854895:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f01 Using peer 10449@kfi7(0x100000000000f01)
00000800:00000200:28.0:1773851855.854898:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x100000000000f01: rc=0
00000800:00000200:28.0:1773851855.854899:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f01 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851855.854900:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.854901:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007553f5da refcount 2 to 10448@kfi7
00010000:00000001:28.0:1773851855.854902:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851855.854902:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.854903:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851855.854903:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d00e119c x1858041867768128/t0(0) o400->9aba6351-b3b7-49dd-bb1e-db0185a8585c@10448@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1137-0'
00000100:00100000:28.0:1773851855.854907:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d00e119c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:9aba6351-b3b7-49dd-bb1e-db0185a8585c+6:39710:x1858041867768128:12345-10448@kfi7:400:default-tuolumne1137-0 Request processed in 55us (82us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851855.854909:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10448@kfi7, seq: 2055469
00000100:00000040:28.0:1773851855.854910:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f7208bc : new rpc_count 0
00000100:00000001:28.0:1773851855.854911:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851855.854911:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851855.854911:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.854912:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8a95503.
00000020:00000010:28.0:1773851855.854913:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008c112e85.
00000020:00000040:28.0:1773851855.854913:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000003f7208bc : new refcount 5
00000100:00000001:28.0:1773851855.854914:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851855.854919:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f01 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851855.854920:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.854921:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10449@kfi7: PUT: OK
00000400:00000200:29.0:1773851855.854922:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc38e5ee
00000400:00000010:29.0:1773851855.854922:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc38e5ee.
00000100:00000001:29.0:1773851855.854923:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851855.854923:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851855.854924:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000800:00000200:29.0:1773851855.854925:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10449@kfi7(00000000ad4c1b02):0x0 lsk 3842 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f01 Transaction freed
00000800:00000200:5.0:1773851855.889633:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851855.889634:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851855.889635:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851855.889637:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851855.889639:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.889640:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851855.889641:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.889642:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851855.889643:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.889643:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851855.889645:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851855.889645:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851855.889646:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c932940
00000400:00000200:5.0:1773851855.889647:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x793844545 [256] + 5168
00000800:00000200:5.0:1773851855.889649:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851855.889651:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851855.889652:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851855.889653:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851855.889654:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851855.889655:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002710aeb3.
00000100:00000040:5.0:1773851855.889656:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000002710aeb3 x1858065608681792 msgsize 224
00000100:00100000:5.0:1773851855.889658:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00000100:00000001:5.0:1773851855.889659:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851855.889660:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851855.889661:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851855.889664:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851855.889665:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851855.889665:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851855.889666:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851855.889666:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851855.889667:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608681792
00000020:00000001:5.0:1773851855.889668:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851855.889668:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:5.0:1773851855.889669:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851855.889670:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:5.0:1773851855.889670:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:5.0:1773851855.889671:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:5.0:1773851855.889672:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851855.889673:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851855.889674:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000829447ec.
00000020:00000010:5.0:1773851855.889675:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851855.889676:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000040:5.0:1773851855.889677:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851855.889678:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851855.889678:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851855.889679:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.889680:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.889681:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851855.889682:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851855.889682:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851855.889683:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851855.889683:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851855.889684:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851855.889684:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314074
00000100:00000040:5.0:1773851855.889684:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:6.0:1773851855.889685:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.889686:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133046226816 : -106940663324800 : ffff9ebcefc01f80)
00000100:00000040:5.0:1773851855.889687:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002710aeb3 x1858065608681792/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:5.0:1773851855.889690:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851855.889690:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851855.889691:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002710aeb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065608681792:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:5.0:1773851855.889692:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608681792
00000020:00000001:5.0:1773851855.889693:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851855.889694:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851855.889695:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851855.889695:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851855.889696:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851855.889697:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851855.889697:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851855.889698:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851855.889699:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851855.889699:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.889700:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851855.889701:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851855.889702:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000033dca560.
02000000:00000001:5.0:1773851855.889703:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.889703:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851855.889704:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851855.889705:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851855.889705:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851855.889706:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851855.889707:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851855.889709:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851855.889709:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608681792
00010000:00000001:5.0:1773851855.889710:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851855.889711:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002710aeb3 x1858065608681792/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:582/0 lens 224/368 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:5.0:1773851855.889714:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851855.889715:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851855.889715:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=84 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851855.889716:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851855.889717:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:5.0:1773851855.889718:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:5.0:1773851855.889719:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851855.889719:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851855.889720:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851855.889721:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000400:00000010:5.0:1773851855.889721:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000014972f8a.
00000100:00000200:5.0:1773851855.889722:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608681792, offset 224
00000400:00000200:5.0:1773851855.889724:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000400:00000200:5.0:1773851855.889729:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.889729:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851855.889730:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851855.889731:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851855.889733:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  30@kfi7 local destination
00000400:00000200:5.0:1773851855.889734:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768662:8768662:1024:4294967295] 30@kfi7 LPNI seq info [23133311:23133311:16:4294967295]
00000400:00000200:5.0:1773851855.889735:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851855.889736:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851855.889738:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851855.889740:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000800:00000200:5.0:1773851855.889741:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851855.889742:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851855.889744:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851855.889747:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000800:00000200:5.0:1773851855.889750:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 468 bytes to peer 0x2000000000000fe: rc=0
00000800:00000200:5.0:1773851855.889751:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851855.889757:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851855.889758:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:5.0:1773851855.889758:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851855.889759:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851855.889759:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851855.889760:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002710aeb3 x1858065608681792/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:582/0 lens 224/368 e 0 to 0 dl 1773851942 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:5.0:1773851855.889763:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002710aeb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065608681792:12345-13@kfi7:41:default-yuba3-0 Request processed in 73us (106us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851855.889765:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851855.889765:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314074
00000100:00000040:5.0:1773851855.889766:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000400:00000200:6.0:1773851855.889767:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851855.889767:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851855.889768:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851855.889768:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851855.889768:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851855.889769:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000014972f8a
00000020:00000010:5.0:1773851855.889769:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000400:00000010:6.0:1773851855.889770:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000014972f8a.
00000100:00000001:6.0:1773851855.889770:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:5.0:1773851855.889770:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000829447ec.
00000020:00000040:5.0:1773851855.889770:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:6.0:1773851855.889771:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851855.889771:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851855.889772:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:6.0:1773851855.889773:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe Transaction freed
00000800:00000200:29.0:1773851855.909350:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851855.909351:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851855.909352:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851855.909354:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851855.909356:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.909358:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10512@kfi7 : PUT - for me
00000400:00000200:29.0:1773851855.909358:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.909359:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 1
00000400:00000200:29.0:1773851855.909360:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:29.0:1773851855.909361:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000400:00000200:29.0:1773851855.909362:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 3
00000400:00000200:29.0:1773851855.909363:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10705@kfi7 to cpt 5
00000400:00000200:29.0:1773851855.909364:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10705@kfi7 of length 224 into portal 12 MB=0x69b4732324600
00000400:00000200:29.0:1773851855.909365:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10705@kfi7 of length 224/224 into md 0x77fe139dd [64] + 164032
00000800:00000200:29.0:1773851855.909366:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851855.909368:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.909369:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10512@kfi7: PUT: OK
00000100:00000001:29.0:1773851855.909370:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851855.909370:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851855.909371:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000097803a98.
00000100:00000040:29.0:1773851855.909372:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000097803a98 x1859579947402752 msgsize 224
00000100:00100000:29.0:1773851855.909373:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-10705@kfi7 (source: 12345-10512@kfi7)
00000100:00000001:29.0:1773851855.909374:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851855.909375:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000800:00000200:29.0:1773851855.909376:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851855.909376:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851855.909376:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851855.909377:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851855.909377:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851855.909379:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851855.909379:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859579947402752
00000020:00000001:28.0:1773851855.909380:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851855.909381:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3e948b
00000020:00000001:28.0:1773851855.909381:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851855.909385:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c5da03e1 refcount=49
00000020:00000001:28.0:1773851855.909386:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944013828096 : -107129695723520 : ffff9e90ec8aa000)
00000020:00000001:28.0:1773851855.909386:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944013828096 : -107129695723520 : ffff9e90ec8aa000)
00000100:00000001:28.0:1773851855.909388:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.909389:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851855.909389:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008c112e85.
00000020:00000010:28.0:1773851855.909390:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.909391:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8a95503.
00000100:00000001:28.0:1773851855.909392:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851855.909392:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851855.909393:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851855.909394:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851855.909395:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851855.909395:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.909396:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851855.909397:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851855.909397:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851855.909398:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851855.909398:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851855.909399:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851855.909399:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10705@kfi7, seq: 2055470
00000100:00000040:28.0:1773851855.909399:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c5da03e1 : new rpc_count 4
00000100:00000001:31.0:1773851855.909400:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.909400:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124442225024 : -106949267326592 : ffff9ebaeee97980)
00000100:00000040:28.0:1773851855.909401:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000097803a98 x1859579947402752/t0(0) o400->f76f91bc-d379-4db1-b5b6-36a38df7a0d1@10705@kfi7:643/0 lens 224/0 e 0 to 0 dl 1773852003 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1153-0'
00000100:00000001:28.0:1773851855.909404:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851855.909404:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851855.909405:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097803a98 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f76f91bc-d379-4db1-b5b6-36a38df7a0d1+49:39831:x1859579947402752:12345-10705@kfi7:400:default-tuolumne1153-0
00000100:00000200:28.0:1773851855.909407:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859579947402752
00000020:00000001:28.0:1773851855.909407:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851855.909409:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851855.909409:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.909410:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851855.909411:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851855.909411:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851855.909412:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859579947402752, found 0 last_xid 1859579946833023
00000020:00000001:28.0:1773851855.909413:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851855.909413:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851855.909414:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851855.909414:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.909415:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851855.909415:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851855.909416:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851855.909417:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c8e5216d.
02000000:00000001:28.0:1773851855.909418:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.909418:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.909419:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851855.909420:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264582484, transno 0, xid 1859579947402752
00010000:00000001:28.0:1773851855.909421:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851855.909421:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000097803a98 x1859579947402752/t0(0) o400->f76f91bc-d379-4db1-b5b6-36a38df7a0d1@10705@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1153-0'
00010000:00000001:28.0:1773851855.909424:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851855.909424:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851855.909425:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=88 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851855.909426:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851855.909427:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a9caf37f refcount 3 to 10705@kfi7
00000100:00000001:28.0:1773851855.909428:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106400 : -107156354445216 : ffff9e8ab78ed060)
02000000:00000001:28.0:1773851855.909428:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851855.909429:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851855.909429:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851855.909430:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10512@kfi7
00000400:00000010:28.0:1773851855.909431:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f11aa4e7.
00000100:00000200:28.0:1773851855.909431:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859579947402752, offset 224
00000400:00000200:28.0:1773851855.909433:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10512@kfi7
00000400:00000200:28.0:1773851855.909434:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.909435:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 1
00000400:00000200:28.0:1773851855.909436:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000400:00000200:28.0:1773851855.909438:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 3
00000400:00000200:28.0:1773851855.909439:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10512@kfi7 local destination
00000400:00000200:28.0:1773851855.909440:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768663:8768663:1024:4294967295] 10512@kfi7 LPNI seq info [535626:535626:16:4294967295]
00000400:00000200:28.0:1773851855.909441:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000400:00000200:28.0:1773851855.909442:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:28.0:1773851855.909444:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10512@kfi7(10512@kfi7:10512@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851855.909445:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 3
00000800:00000200:28.0:1773851855.909446:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851855.909447:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851855.909449:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851855.909451:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd1 Using peer 10512@kfi7(0x100000000000fd1)
00000800:00000200:28.0:1773851855.909454:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x100000000000fd1: rc=0
00000800:00000200:28.0:1773851855.909455:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851855.909457:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851855.909458:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a9caf37f refcount 2 to 10705@kfi7
00010000:00000001:28.0:1773851855.909459:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851855.909459:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851855.909460:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851855.909460:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000097803a98 x1859579947402752/t0(0) o400->f76f91bc-d379-4db1-b5b6-36a38df7a0d1@10705@kfi7:643/0 lens 224/224 e 0 to 0 dl 1773852003 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1153-0'
00000100:00100000:28.0:1773851855.909465:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097803a98 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f76f91bc-d379-4db1-b5b6-36a38df7a0d1+49:39831:x1859579947402752:12345-10705@kfi7:400:default-tuolumne1153-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851855.909467:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10705@kfi7, seq: 2055470
00000100:00000040:28.0:1773851855.909470:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c5da03e1 : new rpc_count 3
00000100:00000001:28.0:1773851855.909471:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851855.909472:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851855.909472:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851855.909473:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8a95503.
00000020:00000010:28.0:1773851855.909474:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008c112e85.
00000020:00000040:28.0:1773851855.909475:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000c5da03e1 : new refcount 48
00000100:00000001:28.0:1773851855.909475:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851855.909480:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd1 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851855.909481:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851855.909482:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10512@kfi7: PUT: OK
00000400:00000200:29.0:1773851855.909483:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f11aa4e7
00000400:00000010:29.0:1773851855.909484:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f11aa4e7.
00000100:00000001:29.0:1773851855.909484:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851855.909485:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851855.909486:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000800:00000200:29.0:1773851855.909487:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 10512@kfi7(000000002e9fbc8e):0x0 lsk 4050 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fd1 Transaction freed
00000800:00000200:9.0:1773851855.915691:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851855.915691:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851855.915693:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851855.915695:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851855.915698:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14432@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.915699:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14432@kfi7 : PUT - for me
00000400:00000200:9.0:1773851855.915700:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14432@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.915701:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000546fdaea nid 14432@kfi7 refs 1
00000400:00000200:9.0:1773851855.915702:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14432@kfi7 to cpt 2
00000400:00000200:9.0:1773851855.915703:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000546fdaea nid 14432@kfi7 refs 2
00000400:00000200:9.0:1773851855.915704:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000546fdaea nid 14432@kfi7 refs 3
00000400:00000200:9.0:1773851855.915705:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14433@kfi7 to cpt 5
00000400:00000200:9.0:1773851855.915706:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14433@kfi7 of length 224 into portal 12 MB=0x69b4bbc3cc080
00000400:00000200:9.0:1773851855.915707:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14433@kfi7 of length 224/224 into md 0x78146ce49 [64] + 120352
00000800:00000200:9.0:1773851855.915709:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851855.915711:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851855.915712:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14432@kfi7: PUT: OK
00000100:00000001:9.0:1773851855.915713:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851855.915713:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851855.915714:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002d4a6467.
00000100:00000040:9.0:1773851855.915715:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000002d4a6467 x1859599443214464 msgsize 224
00000100:00100000:9.0:1773851855.915716:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14433@kfi7 (source: 12345-14432@kfi7)
00000100:00000001:9.0:1773851855.915717:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851855.915718:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000546fdaea nid 14432@kfi7 refs 2
00000100:00000001:11.0:1773851855.915719:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851855.915720:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851855.915720:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851855.915720:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851855.915721:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851855.915722:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851855.915723:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599443214464
00000020:00000001:11.0:1773851855.915723:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851855.915724:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f0b2
00000020:00000001:11.0:1773851855.915728:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851855.915732:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bca3293 refcount=1789
00000020:00000001:11.0:1773851855.915732:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106844115968 : -106966865435648 : ffff9eb6d5fba400)
00000020:00000001:11.0:1773851855.915733:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106844115968 : -106966865435648 : ffff9eb6d5fba400)
00000100:00000001:11.0:1773851855.915735:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851855.915735:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851855.915736:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009503e737.
00000020:00000010:11.0:1773851855.915737:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851855.915738:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b8cf8b34.
00000100:00000001:11.0:1773851855.915739:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851855.915740:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851855.915740:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851855.915741:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851855.915742:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851855.915742:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851855.915743:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851855.915745:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851855.915745:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851855.915745:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851855.915745:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851855.915746:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14433@kfi7, seq: 2130728
00000100:00000001:11.0:1773851855.915747:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851855.915747:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bca3293 : new rpc_count 8
00000100:00000001:11.0:1773851855.915748:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851855.915748:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058724008448 : -107014985543168 : ffff9eaba1cd1200)
00000100:00000040:10.0:1773851855.915749:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002d4a6467 x1859599443214464/t0(0) o400->442b5631-f9b5-4e09-aea2-9e4c3575429b@14433@kfi7:582/0 lens 224/0 e 0 to 0 dl 1773851942 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1392-0'
00000100:00000001:10.0:1773851855.915751:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851855.915752:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851855.915753:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d4a6467 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:442b5631-f9b5-4e09-aea2-9e4c3575429b+1789:39722:x1859599443214464:12345-14433@kfi7:400:default-tuolumne1392-0
00000100:00000200:10.0:1773851855.915754:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599443214464
00000020:00000001:10.0:1773851855.915755:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851855.915755:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851855.915756:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851855.915757:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851855.915757:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851855.915758:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851855.915758:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599443214464, found 0 last_xid 1859599442511039
00000020:00000001:10.0:1773851855.915759:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851855.915760:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851855.915760:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851855.915761:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851855.915761:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851855.915762:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851855.915762:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851855.915763:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000042ab7600.
02000000:00000001:10.0:1773851855.915764:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851855.915764:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851855.915765:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851855.915765:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264587071, transno 0, xid 1859599443214464
00010000:00000001:10.0:1773851855.915766:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851855.915767:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002d4a6467 x1859599443214464/t0(0) o400->442b5631-f9b5-4e09-aea2-9e4c3575429b@14433@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1392-0'
00010000:00000001:10.0:1773851855.915769:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851855.915770:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851855.915770:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=88 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851855.915771:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851855.915772:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000173b00a3 refcount 3 to 14433@kfi7
00000100:00000001:10.0:1773851855.915773:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108128 : -107156354443488 : ffff9e8ab78ed720)
02000000:00000001:10.0:1773851855.915774:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851855.915774:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851855.915775:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851855.915775:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14432@kfi7
00000400:00000010:10.0:1773851855.915776:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009fd35021.
00000100:00000200:10.0:1773851855.915777:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599443214464, offset 224
00000400:00000200:10.0:1773851855.915778:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14432@kfi7
00000400:00000200:10.0:1773851855.915780:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14432@kfi7 to cpt 2
00000400:00000200:10.0:1773851855.915781:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000546fdaea nid 14432@kfi7 refs 1
00000400:00000200:10.0:1773851855.915782:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000546fdaea nid 14432@kfi7 refs 2
00000400:00000200:10.0:1773851855.915783:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000546fdaea nid 14432@kfi7 refs 3
00000400:00000200:10.0:1773851855.915784:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14432@kfi7 local destination
00000400:00000200:10.0:1773851855.915785:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768664:8768664:1024:4294967295] 14432@kfi7 LPNI seq info [28229322:28229322:16:4294967295]
00000400:00000200:10.0:1773851855.915786:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000546fdaea nid 14432@kfi7 refs 2
00000400:00000200:10.0:1773851855.915787:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14432@kfi7 to cpt 2
00000400:00000200:10.0:1773851855.915789:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14432@kfi7(14432@kfi7:14432@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851855.915790:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000546fdaea nid 14432@kfi7 refs 3
00000800:00000200:10.0:1773851855.915792:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851855.915793:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851855.915795:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851855.915797:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0xfde Using peer 14432@kfi7(0xfde)
00000800:00000200:10.0:1773851855.915800:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d35a17e8: Posted send of 324 bytes to peer 0xfde: rc=0
00000800:00000200:10.0:1773851855.915802:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0xfde TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851855.915804:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851855.915805:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000173b00a3 refcount 2 to 14433@kfi7
00010000:00000001:10.0:1773851855.915805:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851855.915806:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851855.915807:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851855.915807:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002d4a6467 x1859599443214464/t0(0) o400->442b5631-f9b5-4e09-aea2-9e4c3575429b@14433@kfi7:582/0 lens 224/224 e 0 to 0 dl 1773851942 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1392-0'
00000100:00100000:10.0:1773851855.915810:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d4a6467 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:442b5631-f9b5-4e09-aea2-9e4c3575429b+1789:39722:x1859599443214464:12345-14433@kfi7:400:default-tuolumne1392-0 Request processed in 58us (94us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851855.915813:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14433@kfi7, seq: 2130728
00000800:00000200:9.0:1773851855.915813:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0xfde TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851855.915814:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bca3293 : new rpc_count 7
00000100:00000001:10.0:1773851855.915815:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851855.915815:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851855.915816:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851855.915816:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851855.915816:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14432@kfi7: PUT: OK
00000020:00000010:10.0:1773851855.915817:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b8cf8b34.
00000400:00000200:9.0:1773851855.915817:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009fd35021
00000020:00000010:10.0:1773851855.915818:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009503e737.
00000400:00000010:9.0:1773851855.915818:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009fd35021.
00000020:00000040:10.0:1773851855.915819:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000005bca3293 : new refcount 1788
00000100:00000001:10.0:1773851855.915819:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851855.915819:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851855.915819:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851855.915820:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000546fdaea nid 14432@kfi7 refs 2
00000800:00000200:9.0:1773851855.915822:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 14432@kfi7(00000000b622f6df):0x0 lsk 4063 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0xfde Transaction freed
00010000:00000001:2.0:1773851856.009736:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009737:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851856.009738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851856.009740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851856.009742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851856.009743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851856.009745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851856.009747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851856.009749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851856.009750:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.009756:0:205377:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:15.0:1773851856.009758:0:205377:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:15.0:1773851856.009759:0:205377:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:2.0:1773851856.011749:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.011749:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851856.011750:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851856.011750:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851856.011751:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851856.011752:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:2.0:1773851856.011753:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851856.011754:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16544@kfi7(00000000ca685c6c):0xe7f version: 2; local version 2; negotiated version: 2
00000400:00000200:2.0:1773851856.011756:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000800:00000200:1.0:1773851856.011756:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f Using peer 16544@kfi7(0x100000000000e7f)
00000400:00000200:2.0:1773851856.011757:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16544@kfi7 : PUT - for me
00000400:00000200:1.0:1773851856.011758:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:2.0:1773851856.011759:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:2.0:1773851856.011760:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 1
00000800:00000200:1.0:1773851856.011760:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 38 bytes to peer 0x100000000000e7f: rc=0
00000400:00000200:2.0:1773851856.011761:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:2.0:1773851856.011761:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000400:00000200:2.0:1773851856.011763:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 3
00000400:00000200:2.0:1773851856.011763:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16480@kfi7 to cpt 4
00000800:00000200:1.0:1773851856.011763:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851856.011765:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16480@kfi7 of length 224 into portal 12 MB=0x69b9db1b97600
00000400:00000200:2.0:1773851856.011766:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16480@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 13568
00000800:00000200:2.0:1773851856.011768:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851856.011770:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851856.011771:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16544@kfi7: PUT: OK
00000100:00000001:2.0:1773851856.011772:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851856.011772:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851856.011773:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ba87db0.
00000100:00000040:2.0:1773851856.011774:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000005ba87db0 x1859951454156288 msgsize 224
00000800:00000200:1.0:1773851856.011775:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851856.011776:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-16480@kfi7 (source: 12345-16544@kfi7)
00000100:00000001:2.0:1773851856.011777:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851856.011778:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000800:00000200:1.0:1773851856.011778:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f Transaction freed
00000800:00000200:2.0:1773851856.011780:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851856.011783:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851856.011784:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851856.011784:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851856.011785:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851856.011785:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851856.011786:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859951454156288
00000020:00000001:1.0:1773851856.011787:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851856.011787:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08c833289fa
00000020:00000001:1.0:1773851856.011788:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851856.011790:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002454b9e4 refcount=167
00000020:00000001:1.0:1773851856.011791:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100752097280 : -106972957454336 : ffff9eb56aded000)
00000020:00000001:1.0:1773851856.011792:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637100752097280 : -106972957454336 : ffff9eb56aded000)
00000100:00000001:1.0:1773851856.011793:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.011794:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851856.011794:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000bd14c1b.
00000020:00000010:1.0:1773851856.011796:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851856.011796:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851856.011797:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851856.011798:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851856.011799:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.011800:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851856.011800:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851856.011801:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.011802:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.011803:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.011804:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851856.011804:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:1.0:1773851856.011805:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16480@kfi7, seq: 1997493
00000100:00000001:0.0:1773851856.011805:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:1.0:1773851856.011806:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002454b9e4 : new rpc_count 1
00000100:00000001:0.0:1773851856.011806:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.011807:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706779904 : -106953002771712 : ffff9eba10431b00)
00000100:00000001:0.0:1773851856.011807:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.011808:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005ba87db0 x1859951454156288/t0(0) o400->01143989-8a17-4a30-9e1d-b6b0fa770cfc@16480@kfi7:496/0 lens 224/0 e 0 to 0 dl 1773852611 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1520-0'
00000100:00000001:1.0:1773851856.011811:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.011812:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851856.011813:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ba87db0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:01143989-8a17-4a30-9e1d-b6b0fa770cfc+167:39735:x1859951454156288:12345-16480@kfi7:400:default-tuolumne1520-0
00000100:00000200:1.0:1773851856.011814:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859951454156288
00000020:00000001:1.0:1773851856.011815:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851856.011816:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851856.011816:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.011817:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851856.011817:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851856.011818:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851856.011819:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859951454156288, found 0 last_xid 1859951453733311
00000020:00000001:1.0:1773851856.011820:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851856.011821:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851856.011821:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851856.011822:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.011822:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851856.011823:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851856.011824:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851856.011824:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002d0aac7b.
02000000:00000001:1.0:1773851856.011825:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.011826:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.011827:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851856.011827:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062852, transno 0, xid 1859951454156288
00010000:00000001:1.0:1773851856.011828:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851856.011829:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005ba87db0 x1859951454156288/t0(0) o400->01143989-8a17-4a30-9e1d-b6b0fa770cfc@16480@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1520-0'
00010000:00000001:1.0:1773851856.011832:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851856.011832:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851856.011833:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=89 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851856.011835:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851856.011836:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000098baeed7 refcount 3 to 16480@kfi7
00000100:00000001:1.0:1773851856.011836:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959360 : -107156125592256 : ffff9e8ac532d540)
02000000:00000001:1.0:1773851856.011837:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851856.011838:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.011838:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851856.011839:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16544@kfi7
00000400:00000010:1.0:1773851856.011840:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000226d8b0f.
00000100:00000200:1.0:1773851856.011841:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859951454156288, offset 224
00000400:00000200:1.0:1773851856.011842:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16544@kfi7
00000400:00000200:1.0:1773851856.011843:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.011844:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 1
00000400:00000200:1.0:1773851856.011845:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000400:00000200:1.0:1773851856.011846:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 3
00000400:00000200:1.0:1773851856.011848:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16544@kfi7 local destination
00000400:00000200:1.0:1773851856.011849:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768665:8768665:1024:4294967295] 16544@kfi7 LPNI seq info [438915:438915:16:4294967295]
00000400:00000200:1.0:1773851856.011850:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000400:00000200:1.0:1773851856.011851:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.011853:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16544@kfi7(16544@kfi7:16544@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851856.011854:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 3
00000800:00000200:1.0:1773851856.011856:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.011857:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851856.011859:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851856.011861:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f Using peer 16544@kfi7(0x100000000000e7f)
00000800:00000200:1.0:1773851856.011864:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x100000000000e7f: rc=0
00000800:00000200:1.0:1773851856.011865:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851856.011867:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.011868:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000098baeed7 refcount 2 to 16480@kfi7
00010000:00000001:1.0:1773851856.011869:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851856.011869:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.011870:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851856.011871:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ba87db0 x1859951454156288/t0(0) o400->01143989-8a17-4a30-9e1d-b6b0fa770cfc@16480@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1520-0'
00000100:00100000:1.0:1773851856.011874:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ba87db0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:01143989-8a17-4a30-9e1d-b6b0fa770cfc+167:39735:x1859951454156288:12345-16480@kfi7:400:default-tuolumne1520-0 Request processed in 61us (99us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851856.011876:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16480@kfi7, seq: 1997493
00000100:00000040:1.0:1773851856.011877:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002454b9e4 : new rpc_count 0
00000100:00000001:1.0:1773851856.011878:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851856.011878:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:3.0:1773851856.011879:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851856.011879:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851856.011880:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000400:00000200:3.0:1773851856.011881:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851856.011881:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000bd14c1b.
00000020:00000040:1.0:1773851856.011881:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000002454b9e4 : new refcount 166
00000400:00000200:3.0:1773851856.011882:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16544@kfi7: PUT: OK
00000100:00000001:1.0:1773851856.011882:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851856.011883:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000226d8b0f
00000400:00000010:3.0:1773851856.011883:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000226d8b0f.
00000100:00000001:3.0:1773851856.011884:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851856.011884:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851856.011885:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000800:00000200:3.0:1773851856.011886:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 16544@kfi7(00000000ca685c6c):0x0 lsk 3712 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000e7f Transaction freed
00000800:00000200:13.0:1773851856.024905:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.024906:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851856.024908:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851856.024910:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851856.024912:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.024914:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22818@kfi7 : PUT - for me
00000400:00000200:13.0:1773851856.024915:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.024915:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044297de9 nid 22818@kfi7 refs 1
00000400:00000200:13.0:1773851856.024917:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.024917:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044297de9 nid 22818@kfi7 refs 2
00000400:00000200:13.0:1773851856.024918:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000044297de9 nid 22818@kfi7 refs 3
00000400:00000200:13.0:1773851856.024919:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.024920:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22818@kfi7 of length 224 into portal 12 MB=0x69b4caf62e7c0
00000400:00000200:13.0:1773851856.024922:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22818@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 14280
00000800:00000200:13.0:1773851856.024923:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.024925:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.024926:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22818@kfi7: PUT: OK
00000100:00000001:13.0:1773851856.024927:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851856.024927:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851856.024928:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000222ce5f2.
00000100:00000040:13.0:1773851856.024929:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000222ce5f2 x1859603522578368 msgsize 224
00000100:00100000:13.0:1773851856.024930:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22818@kfi7 (source: 12345-22818@kfi7)
00000100:00000001:13.0:1773851856.024931:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851856.024932:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000044297de9 nid 22818@kfi7 refs 2
00000800:00000200:13.0:1773851856.024934:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851856.024937:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851856.024938:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851856.024938:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851856.024939:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851856.024940:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851856.024941:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603522578368
00000020:00000001:13.0:1773851856.024942:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851856.024942:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff80cc2
00000020:00000001:13.0:1773851856.024943:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851856.024945:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d49eaeb refcount=5
00000020:00000001:13.0:1773851856.024946:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142647366656 : -106931062184960 : ffff9ebf2c05e400)
00000020:00000001:13.0:1773851856.024947:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142647366656 : -106931062184960 : ffff9ebf2c05e400)
00000100:00000001:13.0:1773851856.024948:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851856.024948:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851856.024949:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851856.024950:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851856.024951:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851856.024952:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851856.024953:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851856.024953:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851856.024954:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851856.024955:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851856.024955:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.024956:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.024958:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851856.024958:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.024958:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851856.024958:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851856.024959:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22818@kfi7, seq: 2289772
00000100:00000001:14.0:1773851856.024960:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851856.024960:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d49eaeb : new rpc_count 1
00000100:00000001:14.0:1773851856.024961:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.024961:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197393024 : -106942512158592 : ffff9ebc818d2880)
00000100:00000040:13.0:1773851856.024962:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000222ce5f2 x1859603522578368/t0(0) o400->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1915-0'
00000100:00000001:13.0:1773851856.024964:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851856.024965:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851856.024965:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000222ce5f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:1e88b751-b4e7-4eda-b881-bf76c8d02e53+5:39564:x1859603522578368:12345-22818@kfi7:400:default-tuolumne1915-0
00000100:00000200:13.0:1773851856.024967:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603522578368
00000020:00000001:13.0:1773851856.024967:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851856.024968:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851856.024969:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.024969:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851856.024970:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851856.024971:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851856.024972:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603522578368, found 0 last_xid 1859603522578367
00000020:00000001:13.0:1773851856.024973:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851856.024973:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851856.024974:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851856.024975:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.024975:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851856.024976:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851856.024977:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851856.024978:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d1b1046.
02000000:00000001:13.0:1773851856.024978:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.024979:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.024980:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851856.024981:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044159471, transno 0, xid 1859603522578368
00010000:00000001:13.0:1773851856.024982:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851856.024983:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000222ce5f2 x1859603522578368/t0(0) o400->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1915-0'
00010000:00000001:13.0:1773851856.024985:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851856.024986:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851856.024987:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851856.024988:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851856.024989:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000033d23b05 refcount 3 to 22818@kfi7
00000100:00000001:13.0:1773851856.024989:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154720 : -107139310396896 : ffff9e8eaf765a20)
02000000:00000001:13.0:1773851856.024990:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851856.024990:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.024991:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851856.024992:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22818@kfi7
00000400:00000010:13.0:1773851856.024993:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d85ae778.
00000100:00000200:13.0:1773851856.024994:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859603522578368, offset 224
00000400:00000200:13.0:1773851856.024995:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22818@kfi7
00000400:00000200:13.0:1773851856.024996:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.024996:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044297de9 nid 22818@kfi7 refs 1
00000400:00000200:13.0:1773851856.025000:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000044297de9 nid 22818@kfi7 refs 2
00000400:00000200:13.0:1773851856.025001:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000044297de9 nid 22818@kfi7 refs 3
00000400:00000200:13.0:1773851856.025003:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22818@kfi7 local destination
00000400:00000200:13.0:1773851856.025004:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768666:8768666:1024:4294967295] 22818@kfi7 LPNI seq info [368540:368540:16:4294967295]
00000400:00000200:13.0:1773851856.025005:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000044297de9 nid 22818@kfi7 refs 2
00000400:00000200:13.0:1773851856.025006:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.025008:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22818@kfi7(22818@kfi7:22818@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851856.025009:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000044297de9 nid 22818@kfi7 refs 3
00000800:00000200:13.0:1773851856.025010:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.025011:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851856.025013:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851856.025015:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x455 Using peer 22818@kfi7(0x455)
00000800:00000200:13.0:1773851856.025019:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000006c12e940: Posted send of 324 bytes to peer 0x455: rc=0
00000800:00000200:13.0:1773851856.025020:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x455 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851856.025022:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851856.025023:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000033d23b05 refcount 2 to 22818@kfi7
00010000:00000001:13.0:1773851856.025024:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851856.025024:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.025025:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851856.025025:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000222ce5f2 x1859603522578368/t0(0) o400->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1915-0'
00000100:00100000:13.0:1773851856.025028:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000222ce5f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:1e88b751-b4e7-4eda-b881-bf76c8d02e53+5:39564:x1859603522578368:12345-22818@kfi7:400:default-tuolumne1915-0 Request processed in 63us (98us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851856.025030:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22818@kfi7, seq: 2289772
00000100:00000040:13.0:1773851856.025031:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d49eaeb : new rpc_count 0
00000100:00000001:13.0:1773851856.025032:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:14.0:1773851856.025033:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x455 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851856.025033:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851856.025033:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851856.025034:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000400:00000200:14.0:1773851856.025035:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851856.025035:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000020:00000040:13.0:1773851856.025035:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000002d49eaeb : new refcount 4
00000100:00000001:13.0:1773851856.025036:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851856.025037:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22818@kfi7: PUT: OK
00000400:00000200:14.0:1773851856.025037:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d85ae778
00000400:00000010:14.0:1773851856.025038:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d85ae778.
00000100:00000001:14.0:1773851856.025039:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851856.025039:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851856.025040:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000044297de9 nid 22818@kfi7 refs 2
00000800:00000200:14.0:1773851856.025041:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 22818@kfi7(0000000067b2f805):0x0 lsk 1110 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x455 Transaction freed
00000800:00000200:13.0:1773851856.070651:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.070651:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851856.070653:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851856.070655:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851856.070657:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.070659:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8754@kfi7 : PUT - for me
00000400:00000200:13.0:1773851856.070660:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.070661:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000400:00000200:13.0:1773851856.070662:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.070663:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:13.0:1773851856.070664:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000400:00000200:13.0:1773851856.070665:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.070666:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 224 into portal 12 MB=0x69b0936b1a480
00000400:00000200:13.0:1773851856.070667:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8754@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 14504
00000800:00000200:13.0:1773851856.070669:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.070671:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.070672:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000100:00000001:13.0:1773851856.070673:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851856.070673:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851856.070674:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f43ae99a.
00000100:00000040:13.0:1773851856.070675:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000f43ae99a x1859313734886528 msgsize 224
00000100:00100000:13.0:1773851856.070676:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8754@kfi7)
00000100:00000001:13.0:1773851856.070678:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851856.070679:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000800:00000200:13.0:1773851856.070680:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851856.070682:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851856.070683:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851856.070683:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851856.070683:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851856.070684:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851856.070684:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734886528
00000020:00000001:13.0:1773851856.070685:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851856.070685:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:13.0:1773851856.070686:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851856.070688:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=9
00000020:00000001:13.0:1773851856.070688:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000001:13.0:1773851856.070689:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000100:00000001:13.0:1773851856.070690:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851856.070690:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851856.070691:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851856.070691:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851856.070692:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851856.070692:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851856.070693:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851856.070693:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851856.070694:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851856.070694:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851856.070694:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.070695:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851856.070696:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851856.070696:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851856.070697:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 2289773
00000100:00000001:14.0:1773851856.070698:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:13.0:1773851856.070698:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 1
00000100:00000001:13.0:1773851856.070698:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197384960 : -106942512166656 : ffff9ebc818d0900)
00000100:00000001:14.0:1773851856.070699:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851856.070699:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851856.070699:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f43ae99a x1859313734886528/t0(0) o400->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1033-0'
00000100:00000001:14.0:1773851856.070700:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.070702:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851856.070702:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851856.070703:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f43ae99a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:39865:x1859313734886528:12345-8754@kfi7:400:default-tuolumne1033-0
00000100:00000200:13.0:1773851856.070704:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734886528
00000020:00000001:13.0:1773851856.070704:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851856.070704:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851856.070705:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.070705:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851856.070706:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851856.070706:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851856.070707:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313734886528, found 0 last_xid 1859313734886527
00000020:00000001:13.0:1773851856.070707:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851856.070708:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851856.070708:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851856.070708:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.070709:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851856.070709:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851856.070710:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851856.070710:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005c47b6e6.
02000000:00000001:13.0:1773851856.070711:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.070711:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.070711:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851856.070712:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183110002015, transno 0, xid 1859313734886528
00010000:00000001:13.0:1773851856.070712:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851856.070713:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f43ae99a x1859313734886528/t0(0) o400->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1033-0'
00010000:00000001:13.0:1773851856.070715:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851856.070715:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851856.070716:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851856.070717:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851856.070717:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:13.0:1773851856.070718:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:13.0:1773851856.070719:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851856.070720:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.070720:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851856.070721:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8754@kfi7
00000400:00000010:13.0:1773851856.070722:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b434206b.
00000100:00000200:13.0:1773851856.070722:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859313734886528, offset 224
00000400:00000200:13.0:1773851856.070723:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8754@kfi7
00000400:00000200:13.0:1773851856.070724:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.070728:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000400:00000200:13.0:1773851856.070729:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:13.0:1773851856.070729:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000400:00000200:13.0:1773851856.070730:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8754@kfi7 local destination
00000400:00000200:13.0:1773851856.070732:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768667:8768667:1024:4294967295] 8754@kfi7 LPNI seq info [5400471:5400471:16:4294967295]
00000400:00000200:13.0:1773851856.070733:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:13.0:1773851856.070733:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.070735:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8754@kfi7(8754@kfi7:8754@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851856.070736:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000800:00000200:13.0:1773851856.070737:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.070738:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851856.070740:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851856.070742:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Using peer 8754@kfi7(0x10000000000000a)
00000800:00000200:13.0:1773851856.070745:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 324 bytes to peer 0x10000000000000a: rc=0
00000800:00000200:13.0:1773851856.070746:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851856.070748:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851856.070748:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:13.0:1773851856.070749:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851856.070750:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.070751:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851856.070751:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f43ae99a x1859313734886528/t0(0) o400->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1033-0'
00000100:00100000:13.0:1773851856.070754:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f43ae99a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:39865:x1859313734886528:12345-8754@kfi7:400:default-tuolumne1033-0 Request processed in 52us (79us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851856.070757:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 2289773
00000100:00000040:13.0:1773851856.070757:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 0
00000100:00000001:13.0:1773851856.070758:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851856.070758:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851856.070759:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851856.070759:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000020:00000010:13.0:1773851856.070760:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000020:00000040:13.0:1773851856.070760:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 8
00000100:00000001:13.0:1773851856.070761:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851856.070763:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851856.070766:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851856.070768:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000400:00000200:14.0:1773851856.070769:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b434206b
00000400:00000010:14.0:1773851856.070770:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b434206b.
00000100:00000001:14.0:1773851856.070770:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851856.070771:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851856.070772:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000800:00000200:14.0:1773851856.070775:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Transaction freed
00000800:00000200:14.0:1773851856.104116:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851856.104117:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851856.104119:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851856.104121:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851856.104125:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104126:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21755@kfi7 : PUT - for me
00000400:00000200:14.0:1773851856.104127:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104127:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:14.0:1773851856.104128:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104129:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851856.104130:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:14.0:1773851856.104131:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104132:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21755@kfi7 of length 224 into portal 12 MB=0x699de8c230140
00000400:00000200:14.0:1773851856.104133:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21755@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 14728
00000800:00000200:14.0:1773851856.104135:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851856.104137:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851856.104137:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21755@kfi7: PUT: OK
00000100:00000001:14.0:1773851856.104138:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851856.104139:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851856.104139:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e9a2ff58.
00000100:00000040:14.0:1773851856.104140:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000e9a2ff58 x1858030973157696 msgsize 224
00000100:00100000:14.0:1773851856.104142:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-21755@kfi7 (source: 12345-21755@kfi7)
00000100:00000001:14.0:1773851856.104143:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851856.104143:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000800:00000200:14.0:1773851856.104144:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851856.104145:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851856.104146:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851856.104147:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851856.104147:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851856.104149:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851856.104150:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030973157696
00000020:00000001:13.0:1773851856.104150:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851856.104151:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f58
00000020:00000001:13.0:1773851856.104152:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851856.104155:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000049547fde refcount=6
00000020:00000001:13.0:1773851856.104156:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239870464 : -107152469681152 : ffff9e8b9f1b9c00)
00000020:00000001:13.0:1773851856.104157:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239870464 : -107152469681152 : ffff9e8b9f1b9c00)
00000100:00000001:13.0:1773851856.104159:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851856.104159:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851856.104160:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000074aaa0ab.
00000020:00000010:13.0:1773851856.104161:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851856.104162:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a13d1b.
00000100:00000001:13.0:1773851856.104164:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851856.104165:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851856.104166:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851856.104167:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851856.104168:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851856.104168:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.104170:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.104171:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851856.104171:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.104171:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851856.104172:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851856.104173:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21755@kfi7, seq: 2289774
00000100:00000040:14.0:1773851856.104173:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000049547fde : new rpc_count 1
00000100:00000001:14.0:1773851856.104174:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341832576 : -106946367719040 : ffff9ebb9bbdf980)
00000100:00000001:13.0:1773851856.104174:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851856.104175:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e9a2ff58 x1858030973157696/t0(0) o400->617da55e-691b-4798-ae52-d332b6296a7f@21755@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne253-0'
00000100:00000001:13.0:1773851856.104175:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.104181:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851856.104181:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851856.104182:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9a2ff58 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:617da55e-691b-4798-ae52-d332b6296a7f+6:47700:x1858030973157696:12345-21755@kfi7:400:default-tuolumne253-0
00000100:00000200:14.0:1773851856.104183:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030973157696
00000020:00000001:14.0:1773851856.104184:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851856.104184:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851856.104185:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104186:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851856.104187:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851856.104187:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851856.104188:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030973157696, found 0 last_xid 1858030973157695
00000020:00000001:14.0:1773851856.104188:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851856.104189:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851856.104190:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851856.104190:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104191:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851856.104191:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851856.104192:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851856.104192:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a7b6048b.
02000000:00000001:14.0:1773851856.104193:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.104194:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104194:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851856.104195:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030973157696
00010000:00000001:14.0:1773851856.104195:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851856.104196:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e9a2ff58 x1858030973157696/t0(0) o400->617da55e-691b-4798-ae52-d332b6296a7f@21755@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00010000:00000001:14.0:1773851856.104198:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851856.104199:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851856.104200:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851856.104201:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851856.104201:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002affc16a refcount 5 to 21755@kfi7
00000100:00000001:14.0:1773851856.104202:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015836032 : -107152693715584 : ffff9e8b91c11d80)
02000000:00000001:14.0:1773851856.104203:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851856.104204:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.104204:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851856.104205:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21755@kfi7
00000400:00000010:14.0:1773851856.104205:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe17ed94.
00000100:00000200:14.0:1773851856.104206:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030973157696, offset 224
00000400:00000200:14.0:1773851856.104207:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21755@kfi7
00000400:00000200:14.0:1773851856.104208:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104209:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:14.0:1773851856.104210:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851856.104211:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:14.0:1773851856.104212:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21755@kfi7 local destination
00000400:00000200:14.0:1773851856.104213:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768668:8768668:1024:4294967295] 21755@kfi7 LPNI seq info [24444:24444:16:4294967295]
00000400:00000200:14.0:1773851856.104215:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851856.104215:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104217:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21755@kfi7(21755@kfi7:21755@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851856.104218:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000800:00000200:14.0:1773851856.104219:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851856.104220:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851856.104222:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851856.104225:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 Using peer 21755@kfi7(0x100000000000781)
00000800:00000200:14.0:1773851856.104228:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000dac95d1f: Posted send of 324 bytes to peer 0x100000000000781: rc=0
00000800:00000200:14.0:1773851856.104229:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851856.104231:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851856.104231:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002affc16a refcount 4 to 21755@kfi7
00010000:00000001:14.0:1773851856.104232:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851856.104233:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104234:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851856.104234:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e9a2ff58 x1858030973157696/t0(0) o400->617da55e-691b-4798-ae52-d332b6296a7f@21755@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00000100:00100000:14.0:1773851856.104237:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9a2ff58 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:617da55e-691b-4798-ae52-d332b6296a7f+6:47700:x1858030973157696:12345-21755@kfi7:400:default-tuolumne253-0 Request processed in 56us (96us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851856.104240:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21755@kfi7, seq: 2289774
00000100:00000040:14.0:1773851856.104241:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000049547fde : new rpc_count 0
00000100:00000001:14.0:1773851856.104241:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851856.104242:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851856.104242:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:15.0:1773851856.104243:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851856.104243:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a13d1b.
00000400:00000200:15.0:1773851856.104244:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851856.104244:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000074aaa0ab.
00000020:00000040:14.0:1773851856.104244:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000049547fde : new refcount 5
00000100:00000001:14.0:1773851856.104245:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851856.104246:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21755@kfi7: PUT: OK
00000400:00000200:15.0:1773851856.104246:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe17ed94
00000400:00000010:15.0:1773851856.104247:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe17ed94.
00000100:00000001:15.0:1773851856.104247:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851856.104248:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851856.104249:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000800:00000200:15.0:1773851856.104250:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 Transaction freed
00000800:00000200:14.0:1773851856.104439:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851856.104440:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851856.104441:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851856.104444:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851856.104446:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104447:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21755@kfi7 : PUT - for me
00000400:00000200:14.0:1773851856.104448:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104449:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:14.0:1773851856.104450:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104450:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851856.104451:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:14.0:1773851856.104452:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104452:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21755@kfi7 of length 224 into portal 12 MB=0x699de8c2308c0
00000400:00000200:14.0:1773851856.104454:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21755@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 14952
00000800:00000200:14.0:1773851856.104456:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851856.104458:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851856.104459:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21755@kfi7: PUT: OK
00000100:00000001:14.0:1773851856.104459:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851856.104460:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851856.104460:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006f0fffe2.
00000100:00000040:14.0:1773851856.104461:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000006f0fffe2 x1858030973159616 msgsize 224
00000100:00100000:14.0:1773851856.104462:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-21755@kfi7 (source: 12345-21755@kfi7)
00000100:00000001:14.0:1773851856.104463:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851856.104464:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000800:00000200:14.0:1773851856.104465:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851856.104468:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851856.104468:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851856.104468:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851856.104469:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851856.104469:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851856.104470:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030973159616
00000020:00000001:14.0:1773851856.104471:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851856.104471:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911b9
00000020:00000001:14.0:1773851856.104471:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851856.104475:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ea37d21d refcount=6
00000020:00000001:14.0:1773851856.104475:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240541184 : -107152469010432 : ffff9e8b9f25d800)
00000020:00000001:14.0:1773851856.104476:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240541184 : -107152469010432 : ffff9e8b9f25d800)
00000100:00000001:14.0:1773851856.104477:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851856.104477:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851856.104478:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047b64737.
00000020:00000010:14.0:1773851856.104479:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851856.104480:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000001:14.0:1773851856.104480:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851856.104481:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851856.104481:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.104482:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851856.104483:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851856.104483:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.104484:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.104485:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851856.104485:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851856.104486:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21755@kfi7, seq: 2289775
00000100:00000040:14.0:1773851856.104487:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ea37d21d : new rpc_count 1
00000100:00000001:13.0:1773851856.104487:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851856.104488:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341817600 : -106946367734016 : ffff9ebb9bbdbf00)
00000100:00000040:14.0:1773851856.104488:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006f0fffe2 x1858030973159616/t0(0) o400->8a787133-e548-4933-b9b5-1a87a61de2a4@21755@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne253-0'
00000100:00000001:13.0:1773851856.104488:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.104488:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.104489:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.104491:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851856.104492:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851856.104492:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f0fffe2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8a787133-e548-4933-b9b5-1a87a61de2a4+6:47699:x1858030973159616:12345-21755@kfi7:400:default-tuolumne253-0
00000100:00000200:14.0:1773851856.104494:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030973159616
00000020:00000001:14.0:1773851856.104494:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851856.104494:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851856.104495:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104496:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851856.104496:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851856.104497:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851856.104497:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030973159616, found 0 last_xid 1858030973159615
00000020:00000001:14.0:1773851856.104498:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851856.104498:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851856.104499:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851856.104499:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104500:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851856.104500:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851856.104500:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851856.104501:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000003c75fb2.
02000000:00000001:14.0:1773851856.104502:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.104502:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104503:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851856.104503:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768118, transno 0, xid 1858030973159616
00010000:00000001:14.0:1773851856.104505:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851856.104505:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006f0fffe2 x1858030973159616/t0(0) o400->8a787133-e548-4933-b9b5-1a87a61de2a4@21755@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00010000:00000001:14.0:1773851856.104508:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851856.104508:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851856.104509:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851856.104510:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851856.104510:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002affc16a refcount 5 to 21755@kfi7
00000100:00000001:14.0:1773851856.104511:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015836032 : -107152693715584 : ffff9e8b91c11d80)
02000000:00000001:14.0:1773851856.104512:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851856.104512:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.104513:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851856.104513:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21755@kfi7
00000400:00000010:14.0:1773851856.104514:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f61d88ce.
00000100:00000200:14.0:1773851856.104514:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030973159616, offset 224
00000400:00000200:14.0:1773851856.104516:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21755@kfi7
00000400:00000200:14.0:1773851856.104517:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104517:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:14.0:1773851856.104518:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851856.104519:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:14.0:1773851856.104520:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21755@kfi7 local destination
00000400:00000200:14.0:1773851856.104521:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768669:8768669:1024:4294967295] 21755@kfi7 LPNI seq info [24445:24445:16:4294967295]
00000400:00000200:14.0:1773851856.104523:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851856.104523:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.104525:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21755@kfi7(21755@kfi7:21755@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851856.104526:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000800:00000200:14.0:1773851856.104528:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851856.104528:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851856.104530:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851856.104532:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 Using peer 21755@kfi7(0x205)
00000800:00000200:14.0:1773851856.104536:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000e70f539d: Posted send of 324 bytes to peer 0x205: rc=0
00000800:00000200:14.0:1773851856.104537:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851856.104539:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851856.104539:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002affc16a refcount 4 to 21755@kfi7
00010000:00000001:14.0:1773851856.104540:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851856.104540:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.104541:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851856.104542:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006f0fffe2 x1858030973159616/t0(0) o400->8a787133-e548-4933-b9b5-1a87a61de2a4@21755@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00000100:00100000:14.0:1773851856.104544:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f0fffe2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8a787133-e548-4933-b9b5-1a87a61de2a4+6:47699:x1858030973159616:12345-21755@kfi7:400:default-tuolumne253-0 Request processed in 52us (82us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851856.104546:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21755@kfi7, seq: 2289775
00000100:00000040:14.0:1773851856.104547:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ea37d21d : new rpc_count 0
00000100:00000001:14.0:1773851856.104548:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851856.104548:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851856.104548:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851856.104549:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000020:00000010:14.0:1773851856.104550:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047b64737.
00000020:00000040:14.0:1773851856.104550:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000ea37d21d : new refcount 5
00000800:00000200:15.0:1773851856.104551:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851856.104551:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851856.104552:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851856.104554:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21755@kfi7: PUT: OK
00000400:00000200:15.0:1773851856.104554:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f61d88ce
00000400:00000010:15.0:1773851856.104555:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f61d88ce.
00000100:00000001:15.0:1773851856.104555:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851856.104556:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851856.104556:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000800:00000200:15.0:1773851856.104558:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 Transaction freed
00000800:00000200:9.0:1773851856.128112:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.128112:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851856.128114:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851856.128116:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851856.128118:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.128120:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24082@kfi7 : PUT - for me
00000400:00000200:9.0:1773851856.128120:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.128121:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 1
00000400:00000200:9.0:1773851856.128123:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.128123:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000400:00000200:9.0:1773851856.128124:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 3
00000400:00000200:9.0:1773851856.128125:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24274@kfi7 to cpt 4
00000400:00000200:9.0:1773851856.128126:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24274@kfi7 of length 224 into portal 12 MB=0x69b4c629ff8c0
00000400:00000200:9.0:1773851856.128128:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24274@kfi7 of length 224/224 into md 0x78146ce49 [64] + 120576
00000800:00000200:9.0:1773851856.128130:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851856.128132:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851856.128133:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24082@kfi7: PUT: OK
00000100:00000001:9.0:1773851856.128134:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851856.128135:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851856.128136:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001d83627f.
00000100:00000040:9.0:1773851856.128137:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000001d83627f x1859602234734784 msgsize 224
00000100:00100000:9.0:1773851856.128139:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24274@kfi7 (source: 12345-24082@kfi7)
00000100:00000001:9.0:1773851856.128140:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:10.0:1773851856.128141:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851856.128141:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 2
02000000:00000001:10.0:1773851856.128142:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851856.128142:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851856.128142:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851856.128143:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851856.128143:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851856.128144:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602234734784
00000020:00000001:10.0:1773851856.128145:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851856.128145:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8db1f
00000020:00000001:10.0:1773851856.128146:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851856.128149:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000281f20d refcount=5
00000020:00000001:10.0:1773851856.128150:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117511712768 : -106956197838848 : ffff9eb951d24000)
00000020:00000001:10.0:1773851856.128151:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117511712768 : -106956197838848 : ffff9eb951d24000)
00000100:00000001:10.0:1773851856.128152:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.128153:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851856.128154:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000014daa50c.
00000020:00000010:10.0:1773851856.128155:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000065d1028a.
00000020:00000010:10.0:1773851856.128156:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007aba1bf5.
00000100:00000001:10.0:1773851856.128156:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851856.128157:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851856.128158:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851856.128159:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851856.128159:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851856.128160:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.128161:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851856.128162:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.128162:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851856.128162:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851856.128162:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851856.128163:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24274@kfi7, seq: 2130729
00000100:00000001:11.0:1773851856.128164:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.128164:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000281f20d : new rpc_count 1
00000100:00000001:11.0:1773851856.128165:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.128165:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637155881296896 : -106917828254720 : ffff9ec240d3a400)
00000100:00000040:10.0:1773851856.128166:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001d83627f x1859602234734784/t0(0) o400->c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca@24274@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2005-0'
00000100:00000001:10.0:1773851856.128168:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.128169:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851856.128170:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d83627f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca+5:39648:x1859602234734784:12345-24274@kfi7:400:default-tuolumne2005-0
00000100:00000200:10.0:1773851856.128171:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602234734784
00000020:00000001:10.0:1773851856.128172:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851856.128172:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851856.128173:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.128173:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851856.128174:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851856.128175:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851856.128175:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602234734784, found 0 last_xid 1859602234734783
00000020:00000001:10.0:1773851856.128176:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851856.128177:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851856.128177:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851856.128177:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.128178:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851856.128179:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851856.128179:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851856.128181:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cb892b8d.
02000000:00000001:10.0:1773851856.128181:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.128182:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.128182:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851856.128183:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046923900, transno 0, xid 1859602234734784
00010000:00000001:10.0:1773851856.128184:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851856.128185:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001d83627f x1859602234734784/t0(0) o400->c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca@24274@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2005-0'
00010000:00000001:10.0:1773851856.128187:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851856.128188:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851856.128189:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=89 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851856.128190:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851856.128191:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000f9c17ad refcount 3 to 24274@kfi7
00000100:00000001:10.0:1773851856.128191:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583961184 : -107156125590432 : ffff9e8ac532dc60)
02000000:00000001:10.0:1773851856.128192:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851856.128193:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.128193:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851856.128194:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24082@kfi7
00000400:00000010:10.0:1773851856.128195:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000092ac144e.
00000100:00000200:10.0:1773851856.128195:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602234734784, offset 224
00000400:00000200:10.0:1773851856.128197:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24082@kfi7
00000400:00000200:10.0:1773851856.128197:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.128198:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 1
00000400:00000200:10.0:1773851856.128200:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000400:00000200:10.0:1773851856.128201:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 3
00000400:00000200:10.0:1773851856.128202:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24082@kfi7 local destination
00000400:00000200:10.0:1773851856.128203:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768670:8768670:1024:4294967295] 24082@kfi7 LPNI seq info [8357037:8357037:16:4294967295]
00000400:00000200:10.0:1773851856.128205:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000400:00000200:10.0:1773851856.128205:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.128207:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24082@kfi7(24082@kfi7:24082@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851856.128209:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 3
00000800:00000200:10.0:1773851856.128210:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851856.128211:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851856.128213:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851856.128215:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1145 Using peer 24082@kfi7(0x1145)
00000800:00000200:10.0:1773851856.128218:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d35a17e8: Posted send of 324 bytes to peer 0x1145: rc=0
00000800:00000200:10.0:1773851856.128219:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1145 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851856.128223:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.128224:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000f9c17ad refcount 2 to 24274@kfi7
00010000:00000001:10.0:1773851856.128225:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851856.128225:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.128226:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851856.128227:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001d83627f x1859602234734784/t0(0) o400->c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca@24274@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2005-0'
00000800:00000200:9.0:1773851856.128229:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1145 TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851856.128230:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d83627f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca+5:39648:x1859602234734784:12345-24274@kfi7:400:default-tuolumne2005-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851856.128231:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:10.0:1773851856.128232:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24274@kfi7, seq: 2130729
00000400:00000200:9.0:1773851856.128232:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24082@kfi7: PUT: OK
00000100:00000040:10.0:1773851856.128233:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000281f20d : new rpc_count 0
00000400:00000200:9.0:1773851856.128233:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000092ac144e
00000100:00000001:10.0:1773851856.128234:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:9.0:1773851856.128234:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000092ac144e.
00000100:00000001:10.0:1773851856.128235:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851856.128235:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000065d1028a.
00000100:00000001:9.0:1773851856.128235:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851856.128235:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:10.0:1773851856.128236:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007aba1bf5.
00000400:00000200:9.0:1773851856.128236:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000020:00000010:10.0:1773851856.128237:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000014daa50c.
00000800:00000200:9.0:1773851856.128237:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 24082@kfi7(00000000482ebf93):0x0 lsk 4422 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1145 Transaction freed
00000020:00000040:10.0:1773851856.128238:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000000281f20d : new refcount 4
00000100:00000001:10.0:1773851856.128238:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851856.139409:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851856.139409:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851856.139410:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851856.139412:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851856.139414:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23889@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.139415:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23889@kfi7 : PUT - for me
00000400:00000200:17.0:1773851856.139416:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23889@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.139416:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e58eedcc nid 23889@kfi7 refs 1
00000400:00000200:17.0:1773851856.139418:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23889@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.139418:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e58eedcc nid 23889@kfi7 refs 2
00000400:00000200:17.0:1773851856.139419:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e58eedcc nid 23889@kfi7 refs 3
00000400:00000200:17.0:1773851856.139420:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23952@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.139421:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23952@kfi7 of length 224 into portal 12 MB=0x699e1b59803c0
00000400:00000200:17.0:1773851856.139422:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23952@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 190080
00000800:00000200:17.0:1773851856.139423:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851856.139425:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.139426:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23889@kfi7: PUT: OK
00000100:00000001:17.0:1773851856.139427:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851856.139428:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851856.139428:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000002c6d032.
00000100:00000040:17.0:1773851856.139429:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000002c6d032 x1858044553593792 msgsize 224
00000100:00100000:17.0:1773851856.139431:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23952@kfi7 (source: 12345-23889@kfi7)
00000100:00000001:17.0:1773851856.139432:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851856.139432:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e58eedcc nid 23889@kfi7 refs 2
00000100:00000001:18.0:1773851856.139433:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851856.139433:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851856.139434:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851856.139434:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851856.139435:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851856.139435:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851856.139436:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044553593792
00000020:00000001:18.0:1773851856.139437:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851856.139437:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c62
00000020:00000001:18.0:1773851856.139438:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851856.139439:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f8f9f7ec refcount=6
00000020:00000001:18.0:1773851856.139440:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743953408 : -107128965598208 : ffff9e91180f7400)
00000020:00000001:18.0:1773851856.139441:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743953408 : -107128965598208 : ffff9e91180f7400)
00000100:00000001:18.0:1773851856.139442:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.139443:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851856.139444:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009c31097.
00000020:00000010:18.0:1773851856.139445:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851856.139445:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851856.139446:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851856.139447:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851856.139447:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851856.139448:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851856.139448:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851856.139449:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.139450:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851856.139451:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851856.139451:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851856.139452:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851856.139452:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851856.139453:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23952@kfi7, seq: 2156261
00000100:00000040:18.0:1773851856.139453:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f8f9f7ec : new rpc_count 1
00000100:00000001:19.0:1773851856.139454:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.139454:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.139454:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405305728 : -106994304245888 : ffff9eb072809f80)
00000100:00000040:18.0:1773851856.139456:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000002c6d032 x1858044553593792/t0(0) o400->047996a6-2068-4c26-9df4-b264cf1e77c8@23952@kfi7:46/0 lens 224/0 e 0 to 0 dl 1773852161 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1986-0'
00000100:00000001:18.0:1773851856.139458:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.139459:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851856.139460:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002c6d032 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:047996a6-2068-4c26-9df4-b264cf1e77c8+6:39678:x1858044553593792:12345-23952@kfi7:400:default-tuolumne1986-0
00000100:00000200:18.0:1773851856.139461:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044553593792
00000020:00000001:18.0:1773851856.139462:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851856.139462:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851856.139463:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.139464:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851856.139464:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851856.139465:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851856.139466:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044553593792, found 0 last_xid 1858044553593791
00000020:00000001:18.0:1773851856.139467:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851856.139467:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851856.139468:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851856.139468:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.139469:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851856.139469:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851856.139470:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851856.139472:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000029245368.
02000000:00000001:18.0:1773851856.139472:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.139473:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.139474:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851856.139474:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044152699, transno 0, xid 1858044553593792
00010000:00000001:18.0:1773851856.139475:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851856.139476:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000002c6d032 x1858044553593792/t0(0) o400->047996a6-2068-4c26-9df4-b264cf1e77c8@23952@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1986-0'
00010000:00000001:18.0:1773851856.139481:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851856.139482:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851856.139483:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=89 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851856.139484:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851856.139485:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000075a6eb53 refcount 3 to 23952@kfi7
00000100:00000001:18.0:1773851856.139485:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095776704 : -107152613774912 : ffff9e8b9684e9c0)
02000000:00000001:18.0:1773851856.139486:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851856.139487:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.139487:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851856.139488:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23889@kfi7
00000400:00000010:18.0:1773851856.139489:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f8010c39.
00000100:00000200:18.0:1773851856.139490:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044553593792, offset 224
00000400:00000200:18.0:1773851856.139491:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23889@kfi7
00000400:00000200:18.0:1773851856.139492:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23889@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.139493:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e58eedcc nid 23889@kfi7 refs 1
00000400:00000200:18.0:1773851856.139494:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e58eedcc nid 23889@kfi7 refs 2
00000400:00000200:18.0:1773851856.139495:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e58eedcc nid 23889@kfi7 refs 3
00000400:00000200:18.0:1773851856.139496:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23889@kfi7 local destination
00000400:00000200:18.0:1773851856.139497:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768671:8768671:1024:4294967295] 23889@kfi7 LPNI seq info [1584498:1584498:16:4294967295]
00000400:00000200:18.0:1773851856.139499:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e58eedcc nid 23889@kfi7 refs 2
00000400:00000200:18.0:1773851856.139499:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23889@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.139501:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23889@kfi7(23889@kfi7:23889@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851856.139503:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e58eedcc nid 23889@kfi7 refs 3
00000800:00000200:18.0:1773851856.139504:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851856.139505:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851856.139507:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851856.139509:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaa1 Using peer 23889@kfi7(0xaa1)
00000800:00000200:18.0:1773851856.139514:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000079f17c9e: Posted send of 324 bytes to peer 0xaa1: rc=0
00000800:00000200:18.0:1773851856.139516:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaa1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851856.139518:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851856.139519:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000075a6eb53 refcount 2 to 23952@kfi7
00010000:00000001:18.0:1773851856.139520:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851856.139520:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.139521:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851856.139522:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000002c6d032 x1858044553593792/t0(0) o400->047996a6-2068-4c26-9df4-b264cf1e77c8@23952@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1986-0'
00000100:00100000:18.0:1773851856.139526:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002c6d032 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:047996a6-2068-4c26-9df4-b264cf1e77c8+6:39678:x1858044553593792:12345-23952@kfi7:400:default-tuolumne1986-0 Request processed in 66us (96us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851856.139528:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23952@kfi7, seq: 2156261
00000800:00000200:17.0:1773851856.139528:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaa1 TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851856.139529:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f8f9f7ec : new rpc_count 0
00000100:00000001:18.0:1773851856.139530:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851856.139530:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851856.139530:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.139530:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23889@kfi7: PUT: OK
00000020:00000010:18.0:1773851856.139531:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851856.139531:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f8010c39
00000020:00000010:18.0:1773851856.139532:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000400:00000010:17.0:1773851856.139532:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f8010c39.
00000100:00000001:17.0:1773851856.139532:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:18.0:1773851856.139533:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009c31097.
00000100:00000001:17.0:1773851856.139533:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851856.139533:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e58eedcc nid 23889@kfi7 refs 2
00000020:00000040:18.0:1773851856.139534:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000f8f9f7ec : new refcount 5
00000100:00000001:18.0:1773851856.139534:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851856.139535:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2069@kfi7:4 -> 23889@kfi7(00000000b7011036):0x0 lsk 2722 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaa1 Transaction freed
00000800:00000200:29.0:1773851856.142887:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851856.142888:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851856.142889:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851856.142892:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851856.142894:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851856.142895:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2074@kfi7 : PUT - for me
00000400:00000200:29.0:1773851856.142895:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851856.142896:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851856.142898:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851856.142899:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851856.142899:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851856.142900:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851856.142901:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee05f40
00000400:00000200:29.0:1773851856.142902:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x77ec58b3d [256] + 20552
00000800:00000200:29.0:1773851856.142904:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851856.142906:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851856.142907:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000100:00000001:29.0:1773851856.142907:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851856.142908:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:29.0:1773851856.142909:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009fad7fef.
00000100:00000040:29.0:1773851856.142909:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000009fad7fef x1858059204845376 msgsize 224
00000100:00100000:29.0:1773851856.142911:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2074@kfi7)
00000100:00000001:29.0:1773851856.142912:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851856.142913:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851856.142914:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851856.142915:0:41218:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851856.142916:0:41218:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851856.142916:0:41218:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851856.142917:0:41218:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851856.142918:0:41218:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851856.142920:0:41218:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204845376
00000020:00000001:28.0:1773851856.142921:0:41218:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851856.142922:0:41218:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:28.0:1773851856.142922:0:41218:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851856.142924:0:41218:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:28.0:1773851856.142925:0:41218:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:28.0:1773851856.142927:0:41218:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:28.0:1773851856.142928:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851856.142929:0:41218:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851856.142930:0:41218:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cd411c23.
00000020:00000010:28.0:1773851856.142932:0:41218:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851856.142933:0:41218:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8a95503.
00000100:00000040:28.0:1773851856.142935:0:41218:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:28.0:1773851856.142936:0:41218:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851856.142937:0:41218:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851856.142938:0:41218:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.142939:0:41218:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.142941:0:41218:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851856.142943:0:157090:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851856.142943:0:41218:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851856.142944:0:157090:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851856.142944:0:41218:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851856.142945:0:157090:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 6571509
00000100:00000040:30.0:1773851856.142946:0:157090:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:28.0:1773851856.142946:0:41218:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.142947:0:157090:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221540608 : -106948488011008 : ffff9ebb1d5ce300)
00000100:00000001:28.0:1773851856.142947:0:41218:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851856.142949:0:157090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009fad7fef x1858059204845376/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:30.0:1773851856.142952:0:157090:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851856.142952:0:157090:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851856.142953:0:157090:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009fad7fef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_003:lustre5-MDT0003-mdtlov_UUID+5:52354:x1858059204845376:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:30.0:1773851856.142955:0:157090:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204845376
00000020:00000001:30.0:1773851856.142955:0:157090:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851856.142957:0:157090:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851856.142957:0:157090:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851856.142958:0:157090:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851856.142958:0:157090:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:30.0:1773851856.142959:0:157090:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:30.0:1773851856.142960:0:157090:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851856.142961:0:157090:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851856.142961:0:157090:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851856.142962:0:157090:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.142963:0:157090:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851856.142963:0:157090:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851856.142964:0:157090:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000dc5073cb.
02000000:00000001:30.0:1773851856.142965:0:157090:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.142966:0:157090:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851856.142967:0:157090:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:30.0:1773851856.142968:0:157090:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:30.0:1773851856.142969:0:157090:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:30.0:1773851856.142970:0:157090:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:30.0:1773851856.142971:0:157090:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:30.0:1773851856.142972:0:157090:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851856.142973:0:157090:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204845376
00010000:00000001:30.0:1773851856.142974:0:157090:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851856.142975:0:157090:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009fad7fef x1858059204845376/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:583/0 lens 224/368 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:30.0:1773851856.142978:0:157090:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851856.142979:0:157090:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851856.142980:0:157090:0:(import.c:1951:at_measured()) add 1 to 00000000f04ba3b2 time=110 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851856.142981:0:157090:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851856.142982:0:157090:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:30.0:1773851856.142982:0:157090:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:30.0:1773851856.142983:0:157090:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851856.142984:0:157090:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.142985:0:157090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851856.142985:0:157090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:30.0:1773851856.142986:0:157090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e57a604.
00000100:00000200:30.0:1773851856.142987:0:157090:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204845376, offset 224
00000400:00000200:30.0:1773851856.142989:0:157090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:30.0:1773851856.142990:0:157090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:30.0:1773851856.142990:0:157090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:30.0:1773851856.142991:0:157090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:30.0:1773851856.142993:0:157090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:30.0:1773851856.142994:0:157090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2074@kfi7 local destination
00000400:00000200:30.0:1773851856.142995:0:157090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768672:8768672:1024:4294967295] 2074@kfi7 LPNI seq info [23425162:23425162:16:4294967295]
00000400:00000200:30.0:1773851856.142997:0:157090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:30.0:1773851856.142997:0:157090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:30.0:1773851856.142999:0:157090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851856.143001:0:157090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:30.0:1773851856.143002:0:157090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851856.143003:0:157090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:30.0:1773851856.143006:0:157090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851856.143008:0:157090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Using peer 2074@kfi7(0x20000000000097e)
00000800:00000200:30.0:1773851856.143012:0:157090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bc942d61: Posted send of 468 bytes to peer 0x20000000000097e: rc=0
00000800:00000200:30.0:1773851856.143013:0:157090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851856.143015:0:157090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851856.143016:0:157090:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:30.0:1773851856.143017:0:157090:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851856.143017:0:157090:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851856.143018:0:157090:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851856.143019:0:157090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009fad7fef x1858059204845376/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:583/0 lens 224/368 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:30.0:1773851856.143022:0:157090:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009fad7fef pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_003:lustre5-MDT0003-mdtlov_UUID+5:52354:x1858059204845376:12345-2074@kfi7:41:default-yuba4-0 Request processed in 69us (111us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851856.143024:0:157090:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 6571509
00000100:00000040:30.0:1773851856.143025:0:157090:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000800:00000200:29.0:1773851856.143025:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851856.143026:0:157090:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851856.143027:0:157090:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851856.143027:0:157090:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:30.0:1773851856.143028:0:157090:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8a95503.
00000020:00000010:30.0:1773851856.143029:0:157090:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cd411c23.
00000400:00000200:29.0:1773851856.143029:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:30.0:1773851856.143030:0:157090:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000400:00000200:29.0:1773851856.143030:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000400:00000200:29.0:1773851856.143030:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e57a604
00000100:00000001:30.0:1773851856.143031:0:157090:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851856.143031:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e57a604.
00000100:00000001:29.0:1773851856.143031:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851856.143032:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851856.143033:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851856.143034:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Transaction freed
00000800:00000200:13.0:1773851856.152944:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.152944:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851856.152946:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851856.152947:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851856.152949:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.152951:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13490@kfi7 : PUT - for me
00000400:00000200:13.0:1773851856.152951:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.152952:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 1
00000400:00000200:13.0:1773851856.152953:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.152954:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000400:00000200:13.0:1773851856.152954:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 3
00000400:00000200:13.0:1773851856.152955:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13491@kfi7 to cpt 6
00000400:00000200:13.0:1773851856.152956:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13491@kfi7 of length 224 into portal 12 MB=0x699e13ebd2500
00000400:00000200:13.0:1773851856.152957:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13491@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 15176
00000800:00000200:13.0:1773851856.152959:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.152960:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.152962:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13490@kfi7: PUT: OK
00000100:00000001:13.0:1773851856.152963:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851856.152964:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851856.152964:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b7cefe0c.
00000100:00000040:13.0:1773851856.152965:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000b7cefe0c x1858042559538432 msgsize 224
00000100:00100000:13.0:1773851856.152966:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13491@kfi7 (source: 12345-13490@kfi7)
00000100:00000001:13.0:1773851856.152967:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851856.152968:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000100:00000001:14.0:1773851856.152969:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851856.152969:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851856.152969:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851856.152970:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851856.152970:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851856.152971:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851856.152972:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042559538432
00000020:00000001:14.0:1773851856.152972:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851856.152973:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b52
00000020:00000001:14.0:1773851856.152973:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851856.152976:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005961a270 refcount=6
00000020:00000001:14.0:1773851856.152977:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628039680 : -107123081511936 : ffff9e9276c77c00)
00000020:00000001:14.0:1773851856.152978:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628039680 : -107123081511936 : ffff9e9276c77c00)
00000100:00000001:14.0:1773851856.152979:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851856.152980:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851856.152981:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047b64737.
00000020:00000010:14.0:1773851856.152982:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851856.152983:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000001:14.0:1773851856.152983:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851856.152984:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851856.152984:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.152985:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851856.152986:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851856.152986:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.152987:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.152988:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851856.152989:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.152989:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851856.152989:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851856.152990:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13491@kfi7, seq: 2289776
00000100:00000040:14.0:1773851856.152990:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005961a270 : new rpc_count 1
00000100:00000001:13.0:1773851856.152990:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.152991:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197410304 : -106942512141312 : ffff9ebc818d6c00)
00000100:00000001:13.0:1773851856.152991:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851856.152992:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b7cefe0c x1858042559538432/t0(0) o400->7d6510c0-1e31-448e-a25c-8cd71c721d01@13491@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1322-0'
00000100:00000001:14.0:1773851856.152995:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851856.152995:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851856.152996:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7cefe0c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7d6510c0-1e31-448e-a25c-8cd71c721d01+6:39667:x1858042559538432:12345-13491@kfi7:400:default-tuolumne1322-0
00000100:00000200:14.0:1773851856.152997:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042559538432
00000020:00000001:14.0:1773851856.152998:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851856.152998:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851856.152999:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.153000:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851856.153000:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851856.153001:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851856.153002:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042559538432, found 0 last_xid 1858042559538431
00000020:00000001:14.0:1773851856.153002:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851856.153006:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851856.153006:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851856.153007:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.153007:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851856.153008:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851856.153009:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851856.153009:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000088e07f0e.
02000000:00000001:14.0:1773851856.153010:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.153011:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.153011:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851856.153012:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183230551873, transno 0, xid 1858042559538432
00010000:00000001:14.0:1773851856.153013:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851856.153014:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b7cefe0c x1858042559538432/t0(0) o400->7d6510c0-1e31-448e-a25c-8cd71c721d01@13491@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1322-0'
00010000:00000001:14.0:1773851856.153016:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851856.153017:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851856.153017:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851856.153018:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851856.153019:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000da50139c refcount 3 to 13491@kfi7
00000100:00000001:14.0:1773851856.153020:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366321344 : -107142343230272 : ffff9e8dfab0fcc0)
02000000:00000001:14.0:1773851856.153020:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851856.153021:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.153022:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851856.153023:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13490@kfi7
00000400:00000010:14.0:1773851856.153023:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7a1f956.
00000100:00000200:14.0:1773851856.153024:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042559538432, offset 224
00000400:00000200:14.0:1773851856.153025:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13490@kfi7
00000400:00000200:14.0:1773851856.153026:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.153027:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 1
00000400:00000200:14.0:1773851856.153028:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000400:00000200:14.0:1773851856.153029:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 3
00000400:00000200:14.0:1773851856.153030:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13490@kfi7 local destination
00000400:00000200:14.0:1773851856.153031:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768673:8768673:1024:4294967295] 13490@kfi7 LPNI seq info [9271791:9271791:16:4294967295]
00000400:00000200:14.0:1773851856.153033:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000400:00000200:14.0:1773851856.153034:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.153036:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13490@kfi7(13490@kfi7:13490@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851856.153037:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 3
00000800:00000200:14.0:1773851856.153038:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851856.153039:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851856.153041:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851856.153043:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb7d Using peer 13490@kfi7(0xb7d)
00000800:00000200:14.0:1773851856.153046:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004c2b9f01: Posted send of 324 bytes to peer 0xb7d: rc=0
00000800:00000200:14.0:1773851856.153048:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb7d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851856.153050:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851856.153051:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000da50139c refcount 2 to 13491@kfi7
00010000:00000001:14.0:1773851856.153052:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851856.153052:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.153053:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851856.153054:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b7cefe0c x1858042559538432/t0(0) o400->7d6510c0-1e31-448e-a25c-8cd71c721d01@13491@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1322-0'
00000100:00100000:14.0:1773851856.153057:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7cefe0c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7d6510c0-1e31-448e-a25c-8cd71c721d01+6:39667:x1858042559538432:12345-13491@kfi7:400:default-tuolumne1322-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851856.153059:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13491@kfi7, seq: 2289776
00000100:00000040:14.0:1773851856.153060:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005961a270 : new rpc_count 0
00000100:00000001:14.0:1773851856.153060:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851856.153061:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851856.153061:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000800:00000200:13.0:1773851856.153061:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb7d TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851856.153062:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000400:00000200:13.0:1773851856.153062:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851856.153063:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047b64737.
00000400:00000200:13.0:1773851856.153063:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13490@kfi7: PUT: OK
00000020:00000040:14.0:1773851856.153064:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000005961a270 : new refcount 5
00000100:00000001:14.0:1773851856.153064:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851856.153064:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7a1f956
00000400:00000010:13.0:1773851856.153065:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7a1f956.
00000100:00000001:13.0:1773851856.153065:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851856.153066:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851856.153067:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000800:00000200:13.0:1773851856.153068:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 13490@kfi7(000000003d76c273):0x0 lsk 2942 rsk 54 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb7d Transaction freed
00000800:00000200:9.0:1773851856.161924:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.161925:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851856.161926:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851856.161928:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851856.161930:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.161932:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.106@tcp : PUT - for me
00000400:00000200:9.0:1773851856.161932:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.161933:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851856.161935:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.106@tcp to cpt 6
00000400:00000200:9.0:1773851856.161936:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 2
00000400:00000200:9.0:1773851856.161937:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 3
00000400:00000200:9.0:1773851856.161938:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.106@tcp to cpt 6
00000400:00000200:9.0:1773851856.161939:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.106@tcp of length 224 into portal 12 MB=0x69a10a6a71f00
00000400:00000200:9.0:1773851856.161941:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.106@tcp of length 224/224 into md 0x16159c6179 [64] + 182640
00000800:00000200:9.0:1773851856.161943:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851856.161945:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851856.161946:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851856.161948:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851856.161948:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851856.161949:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cdaa9e3f.
00000100:00000040:9.0:1773851856.161950:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000cdaa9e3f x1858246166388480 msgsize 224
00000100:00100000:9.0:1773851856.161952:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.106@tcp (source: 12345-172.16.70.106@tcp)
00000100:00000001:9.0:1773851856.161954:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851856.161955:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851856.161956:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851856.161957:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851856.161958:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851856.161958:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851856.161959:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851856.161960:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851856.161961:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858246166388480
00000020:00000001:26.0:1773851856.161961:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851856.161962:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930d0
00000020:00000001:26.0:1773851856.161962:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851856.161963:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000001f34815 refcount=6
00000020:00000001:26.0:1773851856.161964:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745153536 : -107128964398080 : ffff9e911821c400)
00000020:00000001:26.0:1773851856.161965:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745153536 : -107128964398080 : ffff9e911821c400)
00000100:00000001:26.0:1773851856.161966:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.161967:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851856.161967:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000282fbfa2.
00000020:00000010:26.0:1773851856.161969:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851856.161969:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000760eec19.
00000100:00000001:26.0:1773851856.161970:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851856.161971:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851856.161971:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851856.161972:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851856.161973:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851856.161974:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.161975:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851856.161976:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851856.161977:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851856.161977:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:26.0:1773851856.161978:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.106@tcp, seq: 2025051
00000100:00000001:24.0:1773851856.161978:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851856.161979:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000001f34815 : new rpc_count 1
00000100:00000001:24.0:1773851856.161979:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.161980:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637155881307264 : -106917828244352 : ffff9ec240d3cc80)
00000100:00000001:24.0:1773851856.161980:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.161982:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cdaa9e3f x1858246166388480/t0(0) o400->34ef1146-173a-4ba8-943d-d0fda67cb162@172.16.70.106@tcp:73/0 lens 224/0 e 0 to 0 dl 1773852188 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic6-0'
00000100:00000001:26.0:1773851856.161985:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.161985:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851856.161987:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdaa9e3f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:34ef1146-173a-4ba8-943d-d0fda67cb162+6:34158:x1858246166388480:12345-172.16.70.106@tcp:400:login-rzslic6-0
00000100:00000200:26.0:1773851856.161988:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858246166388480
00000020:00000001:26.0:1773851856.161989:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851856.161989:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851856.161990:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.161991:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851856.161991:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851856.161992:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851856.161993:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858246166388480, found 0 last_xid 1858246166388479
00000020:00000001:26.0:1773851856.161994:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851856.161994:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851856.161995:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851856.161995:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.161996:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851856.161997:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851856.161997:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851856.161999:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f009aeee.
02000000:00000001:26.0:1773851856.162000:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.162000:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.162001:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851856.162002:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180968704544, transno 0, xid 1858246166388480
00010000:00000001:26.0:1773851856.162003:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851856.162004:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cdaa9e3f x1858246166388480/t0(0) o400->34ef1146-173a-4ba8-943d-d0fda67cb162@172.16.70.106@tcp:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic6-0'
00010000:00000001:26.0:1773851856.162006:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851856.162007:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851856.162008:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=89 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851856.162009:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851856.162010:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e4507a9 refcount 3 to 172.16.70.106@tcp
00000100:00000001:26.0:1773851856.162010:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419744 : -107156724131872 : ffff9e8aa185d7e0)
02000000:00000001:26.0:1773851856.162011:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851856.162012:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.162012:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851856.162013:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.106@tcp
00000400:00000010:26.0:1773851856.162014:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007ba097d8.
00000100:00000200:26.0:1773851856.162015:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858246166388480, offset 224
00000400:00000200:26.0:1773851856.162016:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.106@tcp
00000400:00000200:26.0:1773851856.162017:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.106@tcp to cpt 6
00000400:00000200:26.0:1773851856.162018:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 2
00000400:00000200:26.0:1773851856.162019:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 3
00000400:00000200:26.0:1773851856.162020:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 4
00000400:00000200:26.0:1773851856.162022:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.106@tcp routed destination
00000400:00000200:26.0:1773851856.162023:0:41182:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:26.0:1773851856.162024:0:41182:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:26.0:1773851856.162026:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.106@tcp: rtr pref emtpy: 1
00000400:00000200:26.0:1773851856.162027:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:26.0:1773851856.162028:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.106@tcp: rtr pref emtpy: 1
00000400:00000200:26.0:1773851856.162029:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:26.0:1773851856.162030:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768674:8768674:1024:4294967295] 2094@kfi7 LPNI seq info [1258746982:1258746982:16:4294967295]
00000400:00000200:26.0:1773851856.162032:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:26.0:1773851856.162033:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:26.0:1773851856.162036:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.106@tcp(172.16.70.106@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851856.162039:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 3
00000800:00000200:26.0:1773851856.162040:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851856.162042:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851856.162044:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851856.162046:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:26.0:1773851856.162049:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:26.0:1773851856.162051:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851856.162053:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.162054:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e4507a9 refcount 2 to 172.16.70.106@tcp
00010000:00000001:26.0:1773851856.162055:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851856.162056:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.162056:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851856.162057:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cdaa9e3f x1858246166388480/t0(0) o400->34ef1146-173a-4ba8-943d-d0fda67cb162@172.16.70.106@tcp:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic6-0'
00000100:00100000:26.0:1773851856.162060:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdaa9e3f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:34ef1146-173a-4ba8-943d-d0fda67cb162+6:34158:x1858246166388480:12345-172.16.70.106@tcp:400:login-rzslic6-0 Request processed in 74us (109us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851856.162063:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.106@tcp, seq: 2025051
00000800:00000200:25.0:1773851856.162063:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851856.162064:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000001f34815 : new rpc_count 0
00000100:00000001:26.0:1773851856.162064:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851856.162065:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851856.162065:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851856.162066:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000760eec19.
00000400:00000200:25.0:1773851856.162066:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851856.162067:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000282fbfa2.
00000020:00000040:26.0:1773851856.162068:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000001f34815 : new refcount 5
00000100:00000001:26.0:1773851856.162068:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851856.162068:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:25.0:1773851856.162069:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007ba097d8
00000400:00000010:25.0:1773851856.162070:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007ba097d8.
00000100:00000001:25.0:1773851856.162071:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851856.162071:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851856.162073:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:25.0:1773851856.162075:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Transaction freed
00000800:00000200:25.0:1773851856.200094:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851856.200095:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851856.200097:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851856.200100:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851856.200103:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16355@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.200105:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16355@kfi7 : PUT - for me
00000400:00000200:25.0:1773851856.200107:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16355@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.200109:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006bed3a24 nid 16355@kfi7 refs 1
00000400:00000200:25.0:1773851856.200110:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16355@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.200111:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006bed3a24 nid 16355@kfi7 refs 2
00000400:00000200:25.0:1773851856.200113:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006bed3a24 nid 16355@kfi7 refs 3
00000400:00000200:25.0:1773851856.200114:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16354@kfi7 to cpt 3
00000400:00000200:25.0:1773851856.200116:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16354@kfi7 of length 224 into portal 12 MB=0x69b4b8ebc9a80
00000400:00000200:25.0:1773851856.200118:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16354@kfi7 of length 224/224 into md 0x16159c6179 [64] + 182864
00000800:00000200:25.0:1773851856.200121:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851856.200123:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851856.200125:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16355@kfi7: PUT: OK
00000100:00000001:25.0:1773851856.200126:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851856.200127:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851856.200129:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000085e48411.
00000100:00000040:25.0:1773851856.200130:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000085e48411 x1859598679841408 msgsize 224
00000100:00100000:25.0:1773851856.200132:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16354@kfi7 (source: 12345-16355@kfi7)
00000100:00000001:25.0:1773851856.200134:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851856.200136:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006bed3a24 nid 16355@kfi7 refs 2
00000100:00000001:26.0:1773851856.200137:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851856.200138:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851856.200138:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851856.200139:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851856.200140:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851856.200141:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851856.200142:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598679841408
00000020:00000001:26.0:1773851856.200142:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851856.200143:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d823cd
00000020:00000001:26.0:1773851856.200144:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851856.200146:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c6d548ff refcount=169
00000020:00000001:26.0:1773851856.200147:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637099150517248 : -106974559034368 : ffff9eb50b68a400)
00000020:00000001:26.0:1773851856.200148:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637099150517248 : -106974559034368 : ffff9eb50b68a400)
00000100:00000001:26.0:1773851856.200149:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.200150:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851856.200151:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000305b1095.
00000020:00000010:26.0:1773851856.200152:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851856.200153:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000760eec19.
00000100:00000001:26.0:1773851856.200155:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851856.200155:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851856.200156:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851856.200157:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851856.200158:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851856.200158:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.200160:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851856.200161:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851856.200162:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851856.200162:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851856.200163:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851856.200164:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16354@kfi7, seq: 2025052
00000100:00000040:26.0:1773851856.200165:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c6d548ff : new rpc_count 1
00000100:00000001:24.0:1773851856.200165:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.200166:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637122116285696 : -106951593265920 : ffff9eba64467500)
00000100:00000001:24.0:1773851856.200166:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.200167:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000085e48411 x1859598679841408/t0(0) o400->bd54ef8e-2c0a-4d3f-a57c-71bd38068e17@16354@kfi7:73/0 lens 224/0 e 0 to 0 dl 1773852188 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1499-0'
00000100:00000001:26.0:1773851856.200172:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.200173:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851856.200174:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085e48411 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:bd54ef8e-2c0a-4d3f-a57c-71bd38068e17+169:39516:x1859598679841408:12345-16354@kfi7:400:default-tuolumne1499-0
00000100:00000200:26.0:1773851856.200178:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598679841408
00000020:00000001:26.0:1773851856.200179:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851856.200180:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851856.200181:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.200182:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851856.200183:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851856.200184:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851856.200185:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598679841408, found 0 last_xid 1859598679422079
00000020:00000001:26.0:1773851856.200186:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851856.200187:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851856.200187:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851856.200188:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.200189:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851856.200190:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851856.200190:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851856.200191:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d5f0d58.
02000000:00000001:26.0:1773851856.200192:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.200193:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.200194:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851856.200195:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062320, transno 0, xid 1859598679841408
00010000:00000001:26.0:1773851856.200196:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851856.200197:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000085e48411 x1859598679841408/t0(0) o400->bd54ef8e-2c0a-4d3f-a57c-71bd38068e17@16354@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1499-0'
00010000:00000001:26.0:1773851856.200201:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851856.200202:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851856.200203:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=89 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851856.200205:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851856.200206:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006d17df54 refcount 3 to 16354@kfi7
00000100:00000001:26.0:1773851856.200207:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154048 : -107139310397568 : ffff9e8eaf765780)
02000000:00000001:26.0:1773851856.200208:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851856.200208:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.200209:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851856.200211:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16355@kfi7
00000400:00000010:26.0:1773851856.200212:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000007a61ab6.
00000100:00000200:26.0:1773851856.200214:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598679841408, offset 224
00000400:00000200:26.0:1773851856.200216:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16355@kfi7
00000400:00000200:26.0:1773851856.200218:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16355@kfi7 to cpt 6
00000400:00000200:26.0:1773851856.200219:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006bed3a24 nid 16355@kfi7 refs 1
00000400:00000200:26.0:1773851856.200220:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006bed3a24 nid 16355@kfi7 refs 2
00000400:00000200:26.0:1773851856.200222:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006bed3a24 nid 16355@kfi7 refs 3
00000400:00000200:26.0:1773851856.200224:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16355@kfi7 local destination
00000400:00000200:26.0:1773851856.200226:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768675:8768675:1024:4294967295] 16355@kfi7 LPNI seq info [887353:887353:16:4294967295]
00000400:00000200:26.0:1773851856.200228:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006bed3a24 nid 16355@kfi7 refs 2
00000400:00000200:26.0:1773851856.200230:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16355@kfi7 to cpt 6
00000400:00000200:26.0:1773851856.200233:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16355@kfi7(16355@kfi7:16355@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851856.200235:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006bed3a24 nid 16355@kfi7 refs 3
00000800:00000200:26.0:1773851856.200237:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851856.200239:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851856.200243:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851856.200246:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0xa72 Using peer 16355@kfi7(0xa72)
00000800:00000200:26.0:1773851856.200251:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0xa72: rc=0
00000800:00000200:26.0:1773851856.200253:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0xa72 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851856.200256:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.200257:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006d17df54 refcount 2 to 16354@kfi7
00010000:00000001:26.0:1773851856.200258:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851856.200259:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.200260:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851856.200261:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000085e48411 x1859598679841408/t0(0) o400->bd54ef8e-2c0a-4d3f-a57c-71bd38068e17@16354@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1499-0'
00000100:00100000:26.0:1773851856.200265:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085e48411 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:bd54ef8e-2c0a-4d3f-a57c-71bd38068e17+169:39516:x1859598679841408:12345-16354@kfi7:400:default-tuolumne1499-0 Request processed in 92us (134us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851856.200267:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0xa72 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851856.200269:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:26.0:1773851856.200270:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16354@kfi7, seq: 2025052
00000100:00000040:26.0:1773851856.200271:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c6d548ff : new rpc_count 0
00000400:00000200:25.0:1773851856.200271:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16355@kfi7: PUT: OK
00000100:00000001:26.0:1773851856.200272:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851856.200272:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851856.200272:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000007a61ab6
00000020:00000010:26.0:1773851856.200273:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000010:25.0:1773851856.200273:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000007a61ab6.
00000020:00000010:26.0:1773851856.200274:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000760eec19.
00000100:00000001:25.0:1773851856.200274:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851856.200274:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:26.0:1773851856.200275:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000305b1095.
00000020:00000040:26.0:1773851856.200276:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c6d548ff : new refcount 168
00000400:00000200:25.0:1773851856.200276:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006bed3a24 nid 16355@kfi7 refs 2
00000100:00000001:26.0:1773851856.200278:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851856.200278:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 16355@kfi7(00000000702db2a8):0x0 lsk 2675 rsk 35 tsk 0 trmk 0 tmk 0 trr 6 tta 0xa72 Transaction freed
00000004:00000001:7.0:1773851856.201731:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851856.201731:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:14.0:1773851856.201732:0:60824:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000100:00000010:7.0:1773851856.201732:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bf12c261.
00000020:00000040:7.0:1773851856.201732:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851856.201733:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851856.201734:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851856.201735:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851856.201736:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000607a30e5.
00000100:00000040:14.0:1773851856.201737:0:60824:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +513s
00000100:00000001:7.0:1773851856.201737:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851856.201738:0:60824:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +1s, asking for 30 secs on 0 early replies
00000100:00000001:7.0:1773851856.201738:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:14.0:1773851856.201739:0:60824:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.201739:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851856.201740:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000bf12c261] to pc [ptlrpcd_01_01+1]  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851856.201745:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:7.0:1773851856.201746:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b29eb503.
00000100:00000001:4.0:1773851856.201746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851856.201746:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:7.0:1773851856.201747:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637129396032512 : -106944313519104 : ffff9ebc162e9400)
00000100:00000001:5.0:1773851856.201747:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851856.201747:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:7.0:1773851856.201748:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851856.201748:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851856.201748:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851856.201749:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:7.0:1773851856.201750:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000004:00000010:7.0:1773851856.201750:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004500c9cd.
00000004:00080000:7.0:1773851856.201751:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614130655026762ns, next at 614131655025640ns, rc = 0
00000100:00000001:4.0:1773851856.201751:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851856.201751:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851856.201752:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851856.201752:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:7.0:1773851856.201753:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851856.201753:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851856.201753:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bf12c261 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051923712:2099@kfi7:13:default-yuba2-0
00000004:00000001:7.0:1773851856.201754:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851856.201755:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851856.201755:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851856.201756:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851856.201757:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851856.201757:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007e3989c4.
02000000:00000001:4.0:1773851856.201758:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851856.201759:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:4.0:1773851856.201760:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000400:00000010:4.0:1773851856.201761:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:4.0:1773851856.201762:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923712, portal 4
00000100:00000001:4.0:1773851856.201763:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851856.201763:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309146624 : -106994400404992 : ffff9eb06cc55a00)
00000100:00000040:4.0:1773851856.201765:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851856.201767:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851856.201768:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851856.201768:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da924145.
00000100:00000200:4.0:1773851856.201769:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923712, offset 0
00000400:00000200:4.0:1773851856.201771:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851856.201771:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851856.201772:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851856.201773:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851856.201775:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851856.201776:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851856.201777:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768675, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768674, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851856.201779:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851856.201779:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851856.201780:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851856.201781:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768676:8768676:1024:4294967295] 2099@kfi7 LPNI seq info [5403428:5403428:16:4294967295]
00000400:00000200:4.0:1773851856.201783:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851856.201783:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851856.201786:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851856.201787:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851856.201789:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851856.201790:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851856.201792:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851856.201797:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Using peer 2099@kfi7(0x2000000000002c4)
00000800:00000200:4.0:1773851856.201800:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x2000000000002c4: rc=0
00000800:00000200:4.0:1773851856.201801:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851856.201804:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851856.201804:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851856.201805:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851856.201806:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851856.201808:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851856.201809:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851856.201809:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851856.201810:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851856.201811:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851856.201815:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851856.201815:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851856.201815:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851856.201817:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851856.201818:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851856.201819:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da924145
00000400:00000010:5.0:1773851856.201820:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da924145.
00000100:00000001:5.0:1773851856.201821:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851856.201821:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851856.201824:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851856.201825:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851856.201831:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.201831:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851856.201832:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851856.201834:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Transaction freed
00000800:00000200:17.0:1773851856.201853:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851856.201854:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851856.201855:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851856.201856:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851856.201858:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.201859:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851856.201860:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.201861:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851856.201863:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.201863:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851856.201864:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851856.201865:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.201866:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2500
00000400:00000200:17.0:1773851856.201867:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.201868:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f06b1 [1] + 224
00000800:00000200:17.0:1773851856.201870:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851856.201872:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.201873:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851856.201874:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851856.201875:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851856.201877:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851856.201880:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851856.201881:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851856.201883:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851856.201883:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851856.201883:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851856.201884:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851856.201884:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851856.201885:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851856.201886:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851856.201886:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:4.0:1773851856.201887:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851856.201888:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851856.201891:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851856.201893:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851856.201894:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851856.201894:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851856.201895:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851856.201895:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851856.201896:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851856.201898:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851856.201898:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=89 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851856.201899:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=89 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851856.201901:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851856.201901:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851856.201902:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851856.201902:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851856.201903:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851856.201903:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851856.201904:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851856.201904:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851856.201905:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851856.201908:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851856.201908:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851856.201909:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851856.201910:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851856.201910:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851856.201911:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409117184 avail=351407117312 avail_mb=1372684052 hwm_mb=3131101 files=372011349 ffree=343172966 state=0: rc = 0
00000004:00000020:4.0:1773851856.201913:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409117184 free, 351407117312 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011349 files, 343172966 free files
00000004:00000001:4.0:1773851856.201914:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851856.201915:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851856.201918:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bf12c261 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051923712:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851856.201919:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851856.201920:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851856.201921:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000bf12c261 x1859433051923712/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851856.201923:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851856.201923:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851856.201924:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007e3989c4.
02000000:00000001:4.0:1773851856.201926:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851856.201926:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851856.201926:0:41065:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851856.201927:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851856.201928:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000607a30e5.
02000000:00000001:4.0:1773851856.201929:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851856.201929:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851856.201930:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bf12c261.
00000100:00000001:4.0:1773851856.201930:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851856.201931:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851856.201931:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851856.201932:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851856.201932:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851856.201932:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851856.201933:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851856.202155:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851856.202157:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851856.202158:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851856.202160:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851856.202162:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21568@kfi7 to cpt 0
00000400:00000200:2.0:1773851856.202163:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21568@kfi7 : PUT - for me
00000400:00000200:2.0:1773851856.202164:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21568@kfi7 to cpt 0
00000400:00000200:2.0:1773851856.202164:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b4058f9 nid 21568@kfi7 refs 1
00000400:00000200:2.0:1773851856.202165:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21568@kfi7 to cpt 0
00000400:00000200:2.0:1773851856.202166:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b4058f9 nid 21568@kfi7 refs 2
00000400:00000200:2.0:1773851856.202167:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b4058f9 nid 21568@kfi7 refs 3
00000400:00000200:2.0:1773851856.202168:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21568@kfi7 to cpt 0
00000400:00000200:2.0:1773851856.202169:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21568@kfi7 of length 224 into portal 12 MB=0x699e221db2e40
00000400:00000200:2.0:1773851856.202170:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21568@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 13792
00000800:00000200:2.0:1773851856.202172:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851856.202174:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851856.202175:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21568@kfi7: PUT: OK
00000100:00000001:2.0:1773851856.202176:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851856.202176:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851856.202177:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009b8bcf3a.
00000100:00000040:2.0:1773851856.202178:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000009b8bcf3a x1858046369934912 msgsize 224
00000100:00100000:2.0:1773851856.202179:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-21568@kfi7 (source: 12345-21568@kfi7)
00000100:00000001:2.0:1773851856.202180:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851856.202181:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009b4058f9 nid 21568@kfi7 refs 2
00000800:00000200:2.0:1773851856.202182:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851856.202183:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851856.202184:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851856.202185:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851856.202185:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851856.202187:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851856.202188:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858046369934912
00000020:00000001:1.0:1773851856.202189:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851856.202190:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac928b1
00000020:00000001:1.0:1773851856.202191:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851856.202193:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c13d790 refcount=6
00000020:00000001:1.0:1773851856.202194:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742948864 : -107128966602752 : ffff9e9118002000)
00000020:00000001:1.0:1773851856.202195:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742948864 : -107128966602752 : ffff9e9118002000)
00000100:00000001:1.0:1773851856.202196:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.202198:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851856.202199:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000bd14c1b.
00000020:00000010:1.0:1773851856.202200:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851856.202202:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000070317339.
00000100:00000001:1.0:1773851856.202204:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851856.202204:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851856.202205:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.202207:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851856.202207:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851856.202208:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.202210:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.202211:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851856.202211:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.202212:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851856.202212:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851856.202213:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21568@kfi7, seq: 1997494
00000100:00000040:0.0:1773851856.202213:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004c13d790 : new rpc_count 1
00000100:00000001:1.0:1773851856.202214:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.202214:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706794880 : -106953002756736 : ffff9eba10435580)
00000100:00000001:1.0:1773851856.202215:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851856.202215:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009b8bcf3a x1858046369934912/t0(0) o400->4f66509b-0236-4c5a-a5d1-c35b0b19dd3f@21568@kfi7:73/0 lens 224/0 e 0 to 0 dl 1773852188 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1844-0'
00000100:00000001:0.0:1773851856.202218:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851856.202218:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851856.202219:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b8bcf3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4f66509b-0236-4c5a-a5d1-c35b0b19dd3f+6:39832:x1858046369934912:12345-21568@kfi7:400:default-tuolumne1844-0
00000100:00000200:0.0:1773851856.202221:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858046369934912
00000020:00000001:0.0:1773851856.202222:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851856.202222:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851856.202223:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.202224:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851856.202224:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851856.202225:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851856.202226:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858046369934912, found 0 last_xid 1858046369934911
00000020:00000001:0.0:1773851856.202227:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851856.202227:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851856.202228:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851856.202228:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.202229:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851856.202230:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851856.202230:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851856.202231:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000c6911c9.
02000000:00000001:0.0:1773851856.202232:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.202232:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.202233:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851856.202234:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597344, transno 0, xid 1858046369934912
00010000:00000001:0.0:1773851856.202234:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851856.202235:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009b8bcf3a x1858046369934912/t0(0) o400->4f66509b-0236-4c5a-a5d1-c35b0b19dd3f@21568@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1844-0'
00010000:00000001:0.0:1773851856.202238:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851856.202238:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851856.202239:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=89 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851856.202240:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851856.202241:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000031984553 refcount 3 to 21568@kfi7
00000100:00000001:0.0:1773851856.202241:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994449696 : -107149715101920 : ffff9e8c434b2720)
02000000:00000001:0.0:1773851856.202242:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851856.202243:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.202243:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851856.202245:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21568@kfi7
00000400:00000010:0.0:1773851856.202245:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008edf1d49.
00000100:00000200:0.0:1773851856.202246:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858046369934912, offset 224
00000400:00000200:0.0:1773851856.202248:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21568@kfi7
00000400:00000200:0.0:1773851856.202248:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21568@kfi7 to cpt 0
00000400:00000200:0.0:1773851856.202249:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b4058f9 nid 21568@kfi7 refs 1
00000400:00000200:0.0:1773851856.202250:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b4058f9 nid 21568@kfi7 refs 2
00000400:00000200:0.0:1773851856.202251:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b4058f9 nid 21568@kfi7 refs 3
00000400:00000200:0.0:1773851856.202252:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21568@kfi7 local destination
00000400:00000200:0.0:1773851856.202253:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768677:8768677:1024:4294967295] 21568@kfi7 LPNI seq info [8536801:8536801:16:4294967295]
00000400:00000200:0.0:1773851856.202255:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009b4058f9 nid 21568@kfi7 refs 2
00000400:00000200:0.0:1773851856.202255:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21568@kfi7 to cpt 0
00000400:00000200:0.0:1773851856.202257:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21568@kfi7(21568@kfi7:21568@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851856.202259:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b4058f9 nid 21568@kfi7 refs 3
00000800:00000200:0.0:1773851856.202260:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851856.202261:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851856.202263:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851856.202265:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x818 Using peer 21568@kfi7(0x818)
00000800:00000200:0.0:1773851856.202268:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x818: rc=0
00000800:00000200:0.0:1773851856.202270:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x818 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851856.202272:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851856.202273:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000031984553 refcount 2 to 21568@kfi7
00010000:00000001:0.0:1773851856.202273:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851856.202274:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.202275:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851856.202275:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009b8bcf3a x1858046369934912/t0(0) o400->4f66509b-0236-4c5a-a5d1-c35b0b19dd3f@21568@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1844-0'
00000100:00100000:0.0:1773851856.202283:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b8bcf3a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4f66509b-0236-4c5a-a5d1-c35b0b19dd3f+6:39832:x1858046369934912:12345-21568@kfi7:400:default-tuolumne1844-0 Request processed in 64us (104us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851856.202285:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21568@kfi7, seq: 1997494
00000100:00000040:0.0:1773851856.202286:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004c13d790 : new rpc_count 0
00000100:00000001:0.0:1773851856.202287:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851856.202287:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851856.202288:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:0.0:1773851856.202288:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000070317339.
00000020:00000010:0.0:1773851856.202289:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000bd14c1b.
00000020:00000040:0.0:1773851856.202290:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004c13d790 : new refcount 5
00000100:00000001:0.0:1773851856.202291:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851856.202296:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x818 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851856.202297:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851856.202298:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21568@kfi7: PUT: OK
00000400:00000200:2.0:1773851856.202300:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008edf1d49
00000400:00000010:2.0:1773851856.202300:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008edf1d49.
00000100:00000001:2.0:1773851856.202301:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851856.202301:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851856.202302:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009b4058f9 nid 21568@kfi7 refs 2
00000800:00000200:2.0:1773851856.202304:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 21568@kfi7(00000000845c300a):0x0 lsk 2073 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x818 Transaction freed
00000800:00000200:17.0:1773851856.228599:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851856.228600:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851856.228601:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851856.228603:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851856.228605:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.228606:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:17.0:1773851856.228606:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.228607:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851856.228608:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.228609:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851856.228610:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851856.228610:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:17.0:1773851856.228611:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e351c0
00000400:00000200:17.0:1773851856.228612:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 190304
00000800:00000200:17.0:1773851856.228614:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851856.228616:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.228616:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000100:00000001:17.0:1773851856.228617:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851856.228618:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851856.228619:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f4ae4484.
00000100:00000040:17.0:1773851856.228619:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f4ae4484 x1859316187615680 msgsize 224
00000100:00100000:17.0:1773851856.228621:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:17.0:1773851856.228621:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851856.228622:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000100:00000001:18.0:1773851856.228623:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851856.228623:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851856.228623:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851856.228624:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851856.228624:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851856.228625:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851856.228626:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187615680
00000020:00000001:18.0:1773851856.228626:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851856.228627:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:18.0:1773851856.228627:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851856.228628:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:18.0:1773851856.228629:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:18.0:1773851856.228630:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:18.0:1773851856.228631:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.228632:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851856.228633:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003da7790a.
00000020:00000010:18.0:1773851856.228634:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851856.228635:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851856.228636:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851856.228636:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851856.228637:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851856.228637:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851856.228638:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851856.228638:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.228639:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851856.228640:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851856.228640:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851856.228641:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851856.228641:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851856.228642:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851856.228642:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156262
00000100:00000040:18.0:1773851856.228642:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:19.0:1773851856.228643:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.228643:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405318400 : -106994304233216 : ffff9eb07280d100)
00000100:00000040:18.0:1773851856.228644:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f4ae4484 x1859316187615680/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:108/0 lens 224/0 e 0 to 0 dl 1773852223 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:18.0:1773851856.228647:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.228647:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851856.228648:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4ae4484 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39682:x1859316187615680:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:18.0:1773851856.228649:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187615680
00000020:00000001:18.0:1773851856.228650:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851856.228651:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851856.228651:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.228652:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851856.228652:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851856.228653:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851856.228654:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187615680, found 0 last_xid 1859316186815935
00000020:00000001:18.0:1773851856.228655:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851856.228656:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851856.228657:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851856.228657:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.228658:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851856.228658:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851856.228659:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851856.228659:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005445676a.
02000000:00000001:18.0:1773851856.228660:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.228661:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.228661:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851856.228662:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187615680
00010000:00000001:18.0:1773851856.228663:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851856.228664:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f4ae4484 x1859316187615680/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:108/0 lens 224/224 e 0 to 0 dl 1773852223 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:18.0:1773851856.228666:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851856.228666:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851856.228667:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=89 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851856.228668:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851856.228669:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:18.0:1773851856.228669:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:18.0:1773851856.228670:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851856.228671:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.228672:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851856.228672:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:18.0:1773851856.228673:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fd65848e.
00000100:00000200:18.0:1773851856.228674:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187615680, offset 224
00000400:00000200:18.0:1773851856.228675:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:18.0:1773851856.228676:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.228677:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:18.0:1773851856.228678:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:18.0:1773851856.228679:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:18.0:1773851856.228680:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:18.0:1773851856.228682:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768678:8768678:1024:4294967295] 20881@kfi7 LPNI seq info [16890551:16890551:16:4294967295]
00000400:00000200:18.0:1773851856.228683:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:18.0:1773851856.228684:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.228686:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851856.228687:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:18.0:1773851856.228688:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851856.228689:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851856.228691:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851856.228694:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Using peer 20881@kfi7(0x6b5)
00000800:00000200:18.0:1773851856.228698:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000022b02854: Posted send of 324 bytes to peer 0x6b5: rc=0
00000800:00000200:18.0:1773851856.228699:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851856.228702:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851856.228703:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:18.0:1773851856.228704:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851856.228704:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.228705:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851856.228706:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f4ae4484 x1859316187615680/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:108/0 lens 224/224 e 0 to 0 dl 1773852223 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000100:00100000:18.0:1773851856.228709:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4ae4484 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39682:x1859316187615680:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 62us (89us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851856.228712:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156262
00000800:00000200:17.0:1773851856.228712:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851856.228713:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000400:00000200:17.0:1773851856.228713:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851856.228714:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851856.228714:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851856.228714:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000020:00000010:18.0:1773851856.228715:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851856.228715:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fd65848e
00000020:00000010:18.0:1773851856.228716:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000020:00000010:18.0:1773851856.228716:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003da7790a.
00000400:00000010:17.0:1773851856.228716:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fd65848e.
00000100:00000001:17.0:1773851856.228716:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:18.0:1773851856.228717:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:17.0:1773851856.228717:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:18.0:1773851856.228718:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851856.228718:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:17.0:1773851856.228719:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Transaction freed
00000800:00000200:25.0:1773851856.238119:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851856.238121:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851856.238123:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851856.238126:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851856.238130:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.238131:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10234@kfi7 : PUT - for me
00000400:00000200:25.0:1773851856.238133:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.238134:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 1
00000400:00000200:25.0:1773851856.238135:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.238136:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000400:00000200:25.0:1773851856.238138:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 3
00000400:00000200:25.0:1773851856.238139:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.238141:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10234@kfi7 of length 224 into portal 12 MB=0x699de8e79fe80
00000400:00000200:25.0:1773851856.238143:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10234@kfi7 of length 224/224 into md 0x16159c6179 [64] + 183088
00000800:00000200:25.0:1773851856.238145:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851856.238148:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851856.238150:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10234@kfi7: PUT: OK
00000100:00000001:25.0:1773851856.238151:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851856.238152:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851856.238153:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000555f5694.
00000100:00000040:25.0:1773851856.238154:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000555f5694 x1858031012413056 msgsize 224
00000100:00100000:25.0:1773851856.238156:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10234@kfi7 (source: 12345-10234@kfi7)
00000100:00000001:25.0:1773851856.238158:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851856.238159:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000100:00000001:26.0:1773851856.238160:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851856.238161:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851856.238161:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851856.238162:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851856.238162:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851856.238164:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851856.238165:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031012413056
00000020:00000001:26.0:1773851856.238166:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851856.238166:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912a7
00000020:00000001:26.0:1773851856.238167:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851856.238170:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000edce776b refcount=6
00000020:00000001:26.0:1773851856.238171:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716195328 : -107155993356288 : ffff9e8acd149800)
00000020:00000001:26.0:1773851856.238172:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716195328 : -107155993356288 : ffff9e8acd149800)
00000100:00000001:26.0:1773851856.238174:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.238175:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851856.238175:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000305b1095.
00000020:00000010:26.0:1773851856.238177:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851856.238178:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000760eec19.
00000100:00000001:26.0:1773851856.238179:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851856.238180:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851856.238181:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851856.238182:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851856.238183:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851856.238184:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.238185:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851856.238188:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851856.238188:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851856.238189:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851856.238190:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851856.238190:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10234@kfi7, seq: 2025053
00000100:00000040:24.0:1773851856.238191:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000edce776b : new rpc_count 1
00000100:00000001:26.0:1773851856.238192:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851856.238192:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637122116286848 : -106951593264768 : ffff9eba64467980)
00000100:00000001:26.0:1773851856.238193:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851856.238194:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000555f5694 x1858031012413056/t0(0) o400->3a5e7a11-36d0-4a81-b6fc-92e6c4739016@10234@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne208-0'
00000100:00000001:24.0:1773851856.238199:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851856.238200:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851856.238201:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000555f5694 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3a5e7a11-36d0-4a81-b6fc-92e6c4739016+6:47893:x1858031012413056:12345-10234@kfi7:400:default-tuolumne208-0
00000100:00000200:24.0:1773851856.238203:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031012413056
00000020:00000001:24.0:1773851856.238204:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851856.238205:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851856.238207:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.238208:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851856.238209:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851856.238210:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851856.238211:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031012413056, found 0 last_xid 1858031012413055
00000020:00000001:24.0:1773851856.238212:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851856.238213:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851856.238214:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851856.238215:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.238216:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851856.238216:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851856.238217:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851856.238218:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000abee30ba.
02000000:00000001:24.0:1773851856.238219:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851856.238220:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.238221:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851856.238222:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768353, transno 0, xid 1858031012413056
00010000:00000001:24.0:1773851856.238224:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851856.238225:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000555f5694 x1858031012413056/t0(0) o400->3a5e7a11-36d0-4a81-b6fc-92e6c4739016@10234@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne208-0'
00010000:00000001:24.0:1773851856.238229:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851856.238230:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851856.238231:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=89 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851856.238233:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851856.238234:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aa3fe92f refcount 5 to 10234@kfi7
00000100:00000001:24.0:1773851856.238235:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336352 : -107152617215264 : ffff9e8b96506ae0)
02000000:00000001:24.0:1773851856.238237:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851856.238237:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851856.238238:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851856.238240:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10234@kfi7
00000400:00000010:24.0:1773851856.238240:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cd21ec1b.
00000100:00000200:24.0:1773851856.238242:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031012413056, offset 224
00000400:00000200:24.0:1773851856.238244:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10234@kfi7
00000400:00000200:24.0:1773851856.238245:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:24.0:1773851856.238246:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 1
00000400:00000200:24.0:1773851856.238248:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000400:00000200:24.0:1773851856.238250:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 3
00000400:00000200:24.0:1773851856.238252:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10234@kfi7 local destination
00000400:00000200:24.0:1773851856.238254:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768679:8768679:1024:4294967295] 10234@kfi7 LPNI seq info [28011:28011:16:4294967295]
00000400:00000200:24.0:1773851856.238257:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000400:00000200:24.0:1773851856.238258:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:24.0:1773851856.238261:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10234@kfi7(10234@kfi7:10234@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851856.238263:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 3
00000800:00000200:24.0:1773851856.238265:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851856.238267:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851856.238271:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851856.238275:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000431 Using peer 10234@kfi7(0x100000000000431)
00000800:00000200:24.0:1773851856.238280:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000358ab717: Posted send of 324 bytes to peer 0x100000000000431: rc=0
00000800:00000200:24.0:1773851856.238282:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000431 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851856.238285:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851856.238287:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aa3fe92f refcount 4 to 10234@kfi7
00010000:00000001:24.0:1773851856.238288:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851856.238289:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.238292:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851856.238293:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000555f5694 x1858031012413056/t0(0) o400->3a5e7a11-36d0-4a81-b6fc-92e6c4739016@10234@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne208-0'
00000100:00100000:24.0:1773851856.238298:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000555f5694 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3a5e7a11-36d0-4a81-b6fc-92e6c4739016+6:47893:x1858031012413056:12345-10234@kfi7:400:default-tuolumne208-0 Request processed in 97us (142us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851856.238301:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10234@kfi7, seq: 2025053
00000100:00000040:24.0:1773851856.238303:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000edce776b : new rpc_count 0
00000100:00000001:24.0:1773851856.238304:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851856.238305:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851856.238306:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:24.0:1773851856.238307:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000760eec19.
00000020:00000010:24.0:1773851856.238309:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000305b1095.
00000020:00000040:24.0:1773851856.238310:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000edce776b : new refcount 5
00000100:00000001:24.0:1773851856.238311:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851856.238318:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000431 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851856.238321:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851856.238323:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10234@kfi7: PUT: OK
00000400:00000200:25.0:1773851856.238324:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cd21ec1b
00000400:00000010:25.0:1773851856.238325:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cd21ec1b.
00000100:00000001:25.0:1773851856.238326:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851856.238327:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851856.238328:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000800:00000200:25.0:1773851856.238331:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 10234@kfi7(000000004906c377):0x0 lsk 1074 rsk 136 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000431 Transaction freed
00000800:00000200:1.0:1773851856.250152:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.250153:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851856.250155:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851856.250157:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851856.250159:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21233@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.250160:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21233@kfi7 : PUT - for me
00000400:00000200:1.0:1773851856.250161:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21233@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.250162:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e985ab6e nid 21233@kfi7 refs 1
00000400:00000200:1.0:1773851856.250163:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21233@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.250164:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e985ab6e nid 21233@kfi7 refs 2
00000400:00000200:1.0:1773851856.250165:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e985ab6e nid 21233@kfi7 refs 3
00000400:00000200:1.0:1773851856.250166:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21040@kfi7 to cpt 2
00000400:00000200:1.0:1773851856.250167:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21040@kfi7 of length 224 into portal 12 MB=0x69b1946747940
00000400:00000200:1.0:1773851856.250168:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21040@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 14016
00000800:00000200:1.0:1773851856.250170:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851856.250172:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851856.250173:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21233@kfi7: PUT: OK
00000100:00000001:1.0:1773851856.250174:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851856.250175:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851856.250176:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005975df12.
00000100:00000040:1.0:1773851856.250177:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000005975df12 x1859382718789952 msgsize 224
00000100:00100000:1.0:1773851856.250178:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-21040@kfi7 (source: 12345-21233@kfi7)
00000100:00000001:1.0:1773851856.250179:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851856.250181:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e985ab6e nid 21233@kfi7 refs 2
00000800:00000200:1.0:1773851856.250182:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851856.250182:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851856.250183:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851856.250184:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851856.250185:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851856.250186:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851856.250187:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859382718789952
00000020:00000001:0.0:1773851856.250188:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851856.250189:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0796788641d
00000020:00000001:0.0:1773851856.250190:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851856.250191:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ab06bf45 refcount=329
00000020:00000001:0.0:1773851856.250192:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636967266106368 : -107106443445248 : ffff9e96567c3c00)
00000020:00000001:0.0:1773851856.250194:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636967266106368 : -107106443445248 : ffff9e96567c3c00)
00000100:00000001:0.0:1773851856.250195:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851856.250196:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851856.250197:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006856a5c.
00000020:00000010:0.0:1773851856.250199:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851856.250201:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851856.250203:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851856.250203:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851856.250204:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851856.250206:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851856.250207:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851856.250208:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.250210:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.250211:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851856.250211:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.250212:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851856.250212:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851856.250213:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21040@kfi7, seq: 1997495
00000100:00000040:1.0:1773851856.250214:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ab06bf45 : new rpc_count 8
00000100:00000001:0.0:1773851856.250214:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.250215:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605651200 : -106923103900416 : ffff9ec1065fad00)
00000100:00000001:0.0:1773851856.250215:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.250216:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005975df12 x1859382718789952/t0(0) o400->c5a31666-2451-4528-af13-9142bc328874@21040@kfi7:496/0 lens 224/0 e 0 to 0 dl 1773852611 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1805-0'
00000100:00000001:1.0:1773851856.250219:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.250219:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851856.250221:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005975df12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c5a31666-2451-4528-af13-9142bc328874+329:39931:x1859382718789952:12345-21040@kfi7:400:default-tuolumne1805-0
00000100:00000200:1.0:1773851856.250222:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859382718789952
00000020:00000001:1.0:1773851856.250223:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851856.250223:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851856.250224:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.250225:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851856.250225:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851856.250226:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851856.250227:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859382718789952, found 0 last_xid 1859382665986175
00000020:00000001:1.0:1773851856.250228:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851856.250229:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851856.250229:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851856.250230:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.250231:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851856.250231:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851856.250232:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851856.250233:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007c96b23f.
02000000:00000001:1.0:1773851856.250234:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.250235:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.250235:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851856.250236:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264574578, transno 0, xid 1859382718789952
00010000:00000001:1.0:1773851856.250237:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851856.250238:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005975df12 x1859382718789952/t0(0) o400->c5a31666-2451-4528-af13-9142bc328874@21040@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1805-0'
00010000:00000001:1.0:1773851856.250240:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851856.250241:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851856.250241:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=89 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851856.250243:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851856.250243:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d4dc43b2 refcount 3 to 21040@kfi7
00000100:00000001:1.0:1773851856.250244:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994448544 : -107149715103072 : ffff9e8c434b22a0)
02000000:00000001:1.0:1773851856.250245:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851856.250246:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.250246:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851856.250247:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21233@kfi7
00000400:00000010:1.0:1773851856.250248:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000de236318.
00000100:00000200:1.0:1773851856.250249:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859382718789952, offset 224
00000400:00000200:1.0:1773851856.250250:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21233@kfi7
00000400:00000200:1.0:1773851856.250251:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21233@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.250252:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e985ab6e nid 21233@kfi7 refs 1
00000400:00000200:1.0:1773851856.250253:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e985ab6e nid 21233@kfi7 refs 2
00000400:00000200:1.0:1773851856.250254:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e985ab6e nid 21233@kfi7 refs 3
00000400:00000200:1.0:1773851856.250255:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21233@kfi7 local destination
00000400:00000200:1.0:1773851856.250257:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768680:8768680:1024:4294967295] 21233@kfi7 LPNI seq info [2553809:2553809:16:4294967295]
00000400:00000200:1.0:1773851856.250258:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e985ab6e nid 21233@kfi7 refs 2
00000400:00000200:1.0:1773851856.250259:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21233@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.250261:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21233@kfi7(21233@kfi7:21233@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851856.250262:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e985ab6e nid 21233@kfi7 refs 3
00000800:00000200:1.0:1773851856.250274:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.250275:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851856.250277:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851856.250279:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004df Using peer 21233@kfi7(0x1000000000004df)
00000800:00000200:1.0:1773851856.250282:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 324 bytes to peer 0x1000000000004df: rc=0
00000800:00000200:1.0:1773851856.250284:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851856.250286:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.250287:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d4dc43b2 refcount 2 to 21040@kfi7
00010000:00000001:1.0:1773851856.250288:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851856.250288:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.250289:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851856.250290:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005975df12 x1859382718789952/t0(0) o400->c5a31666-2451-4528-af13-9142bc328874@21040@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1805-0'
00000100:00100000:1.0:1773851856.250293:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005975df12 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c5a31666-2451-4528-af13-9142bc328874+329:39931:x1859382718789952:12345-21040@kfi7:400:default-tuolumne1805-0 Request processed in 73us (115us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851856.250295:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21040@kfi7, seq: 1997495
00000100:00000040:1.0:1773851856.250296:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ab06bf45 : new rpc_count 7
00000100:00000001:1.0:1773851856.250297:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851856.250297:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851856.250298:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:1.0:1773851856.250299:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000800:00000200:2.0:1773851856.250300:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004df TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851856.250300:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006856a5c.
00000020:00000040:1.0:1773851856.250300:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ab06bf45 : new refcount 328
00000100:00000001:1.0:1773851856.250301:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851856.250303:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851856.250305:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21233@kfi7: PUT: OK
00000400:00000200:2.0:1773851856.250306:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000de236318
00000400:00000010:2.0:1773851856.250307:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000de236318.
00000100:00000001:2.0:1773851856.250308:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851856.250309:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851856.250310:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e985ab6e nid 21233@kfi7 refs 2
00000800:00000200:2.0:1773851856.250313:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 21233@kfi7(0000000016a6363f):0x0 lsk 1248 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004df Transaction freed
00000800:00000200:25.0:1773851856.256699:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851856.256700:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851856.256702:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851856.256705:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851856.256708:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20803@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.256710:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20803@kfi7 : PUT - for me
00000400:00000200:25.0:1773851856.256712:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20803@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.256713:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067a76bac nid 20803@kfi7 refs 1
00000400:00000200:25.0:1773851856.256714:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20803@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.256715:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067a76bac nid 20803@kfi7 refs 2
00000400:00000200:25.0:1773851856.256717:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000067a76bac nid 20803@kfi7 refs 3
00000400:00000200:25.0:1773851856.256718:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.256719:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20866@kfi7 of length 224 into portal 12 MB=0x69b0a43fc4e40
00000400:00000200:25.0:1773851856.256721:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20866@kfi7 of length 224/224 into md 0x16159c6179 [64] + 183312
00000800:00000200:25.0:1773851856.256724:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851856.256734:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851856.256736:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20803@kfi7: PUT: OK
00000100:00000001:25.0:1773851856.256737:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851856.256738:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851856.256739:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b64ba1d.
00000100:00000040:25.0:1773851856.256740:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000005b64ba1d x1859318252850752 msgsize 224
00000100:00100000:25.0:1773851856.256744:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20866@kfi7 (source: 12345-20803@kfi7)
00000100:00000001:25.0:1773851856.256745:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851856.256747:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000067a76bac nid 20803@kfi7 refs 2
00000100:00000001:24.0:1773851856.256748:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851856.256749:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851856.256749:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851856.256750:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851856.256751:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851856.256752:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851856.256753:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318252850752
00000020:00000001:24.0:1773851856.256755:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851856.256755:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f9c
00000020:00000001:24.0:1773851856.256757:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851856.256758:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000068a4f811 refcount=6
00000020:00000001:24.0:1773851856.256760:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744925184 : -107128964626432 : ffff9e91181e4800)
00000020:00000001:24.0:1773851856.256761:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744925184 : -107128964626432 : ffff9e91181e4800)
00000100:00000001:24.0:1773851856.256763:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851856.256764:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851856.256767:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000705a3f71.
00000020:00000010:24.0:1773851856.256769:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851856.256771:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002065a558.
00000100:00000001:24.0:1773851856.256772:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851856.256773:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851856.256774:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851856.256775:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851856.256776:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851856.256777:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851856.256779:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851856.256781:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851856.256782:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851856.256782:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851856.256783:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851856.256784:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20866@kfi7, seq: 2025054
00000100:00000001:26.0:1773851856.256785:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851856.256785:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000068a4f811 : new rpc_count 1
00000100:00000001:26.0:1773851856.256787:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851856.256787:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637122116264960 : -106951593286656 : ffff9eba64462400)
00000100:00000040:24.0:1773851856.256790:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005b64ba1d x1859318252850752/t0(0) o400->4f80de69-1eb8-4dc2-be2a-b739d23a0281@20866@kfi7:73/0 lens 224/0 e 0 to 0 dl 1773852188 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1800-0'
00000100:00000001:24.0:1773851856.256795:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851856.256796:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851856.256797:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b64ba1d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4f80de69-1eb8-4dc2-be2a-b739d23a0281+6:39631:x1859318252850752:12345-20866@kfi7:400:default-tuolumne1800-0
00000100:00000200:24.0:1773851856.256800:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318252850752
00000020:00000001:24.0:1773851856.256801:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851856.256802:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851856.256803:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.256804:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851856.256805:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851856.256806:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851856.256807:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318252850752, found 0 last_xid 1859318252850751
00000020:00000001:24.0:1773851856.256809:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851856.256810:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851856.256811:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851856.256812:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.256813:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851856.256814:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851856.256815:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851856.256816:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000c38d331.
02000000:00000001:24.0:1773851856.256817:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851856.256818:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.256819:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851856.256820:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859318252850752
00010000:00000001:24.0:1773851856.256822:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851856.256823:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005b64ba1d x1859318252850752/t0(0) o400->4f80de69-1eb8-4dc2-be2a-b739d23a0281@20866@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1800-0'
00010000:00000001:24.0:1773851856.256828:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851856.256829:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851856.256830:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=89 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851856.256833:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851856.256834:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d36ced6 refcount 5 to 20866@kfi7
00000100:00000001:24.0:1773851856.256835:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739104 : -107139395812512 : ffff9e8eaa5f0360)
02000000:00000001:24.0:1773851856.256836:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851856.256837:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851856.256838:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851856.256840:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20803@kfi7
00000400:00000010:24.0:1773851856.256841:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000043f7937d.
00000100:00000200:24.0:1773851856.256842:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318252850752, offset 224
00000400:00000200:24.0:1773851856.256845:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20803@kfi7
00000400:00000200:24.0:1773851856.256847:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20803@kfi7 to cpt 6
00000400:00000200:24.0:1773851856.256848:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067a76bac nid 20803@kfi7 refs 1
00000400:00000200:24.0:1773851856.256850:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000067a76bac nid 20803@kfi7 refs 2
00000400:00000200:24.0:1773851856.256852:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000067a76bac nid 20803@kfi7 refs 3
00000400:00000200:24.0:1773851856.256854:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20803@kfi7 local destination
00000400:00000200:24.0:1773851856.256856:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768681:8768681:1024:4294967295] 20803@kfi7 LPNI seq info [6979595:6979595:16:4294967295]
00000400:00000200:24.0:1773851856.256858:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000067a76bac nid 20803@kfi7 refs 2
00000400:00000200:24.0:1773851856.256859:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20803@kfi7 to cpt 6
00000400:00000200:24.0:1773851856.256862:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20803@kfi7(20803@kfi7:20803@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851856.256864:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000067a76bac nid 20803@kfi7 refs 3
00000800:00000200:24.0:1773851856.256865:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851856.256866:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851856.256869:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851856.256871:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002c3 Using peer 20803@kfi7(0x1000000000002c3)
00000800:00000200:24.0:1773851856.256874:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0x1000000000002c3: rc=0
00000800:00000200:24.0:1773851856.256876:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002c3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851856.256878:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851856.256880:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d36ced6 refcount 4 to 20866@kfi7
00010000:00000001:24.0:1773851856.256881:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851856.256882:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851856.256884:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851856.256885:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b64ba1d x1859318252850752/t0(0) o400->4f80de69-1eb8-4dc2-be2a-b739d23a0281@20866@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1800-0'
00000100:00100000:24.0:1773851856.256888:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b64ba1d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4f80de69-1eb8-4dc2-be2a-b739d23a0281+6:39631:x1859318252850752:12345-20866@kfi7:400:default-tuolumne1800-0 Request processed in 92us (147us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851856.256891:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20866@kfi7, seq: 2025054
00000100:00000040:24.0:1773851856.256892:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000068a4f811 : new rpc_count 0
00000100:00000001:24.0:1773851856.256893:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851856.256893:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851856.256894:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851856.256895:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002065a558.
00000020:00000010:24.0:1773851856.256896:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000705a3f71.
00000020:00000040:24.0:1773851856.256896:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000068a4f811 : new refcount 5
00000100:00000001:24.0:1773851856.256897:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851856.256903:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002c3 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851856.256905:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851856.256906:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20803@kfi7: PUT: OK
00000400:00000200:25.0:1773851856.256907:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000043f7937d
00000400:00000010:25.0:1773851856.256908:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000043f7937d.
00000100:00000001:25.0:1773851856.256908:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851856.256909:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851856.256910:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000067a76bac nid 20803@kfi7 refs 2
00000800:00000200:25.0:1773851856.256912:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20803@kfi7(00000000a84923f8):0x0 lsk 708 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002c3 Transaction freed
00000800:00000200:5.0:1773851856.341176:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851856.341177:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851856.341179:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851856.341183:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851856.341186:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.341188:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851856.341189:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.341190:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851856.341192:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.341193:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851856.341194:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851856.341196:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851856.341197:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a879d3840
00000400:00000200:5.0:1773851856.341200:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 5392
00000800:00000200:5.0:1773851856.341203:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851856.341205:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851856.341207:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851856.341209:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851856.341209:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851856.341211:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dcae8bd0.
00000100:00000040:5.0:1773851856.341212:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000dcae8bd0 x1859388106946624 msgsize 224
00000100:00100000:5.0:1773851856.341215:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851856.341217:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851856.341219:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851856.341221:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851856.341226:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851856.341227:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851856.341227:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851856.341228:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851856.341230:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851856.341231:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388106946624
00000020:00000001:5.0:1773851856.341232:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851856.341232:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:5.0:1773851856.341233:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851856.341235:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:5.0:1773851856.341236:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:5.0:1773851856.341237:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:5.0:1773851856.341239:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851856.341240:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851856.341241:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000829447ec.
00000020:00000010:5.0:1773851856.341242:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851856.341244:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000040:5.0:1773851856.341245:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851856.341246:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851856.341247:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851856.341248:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.341249:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.341251:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851856.341253:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851856.341253:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851856.341254:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851856.341254:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851856.341255:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314075
00000100:00000001:6.0:1773851856.341257:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851856.341257:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:6.0:1773851856.341258:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.341258:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637147603215360 : -106926106336256 : ffff9ec0536a2400)
00000100:00000040:5.0:1773851856.341260:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dcae8bd0 x1859388106946624/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:5.0:1773851856.341264:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851856.341265:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851856.341267:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcae8bd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388106946624:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:5.0:1773851856.341269:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388106946624
00000020:00000001:5.0:1773851856.341270:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851856.341271:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851856.341272:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851856.341273:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851856.341274:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851856.341275:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851856.341276:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851856.341277:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851856.341278:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851856.341278:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.341279:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851856.341280:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851856.341282:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000b33268d5.
02000000:00000001:5.0:1773851856.341283:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.341284:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851856.341285:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851856.341286:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851856.341287:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851856.341288:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851856.341290:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851856.341292:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851856.341293:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388106946624
00010000:00000001:5.0:1773851856.341294:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851856.341295:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dcae8bd0 x1859388106946624/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:583/0 lens 224/368 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:5.0:1773851856.341299:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851856.341300:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851856.341301:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=85 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851856.341303:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851856.341304:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:5.0:1773851856.341305:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:5.0:1773851856.341308:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851856.341308:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.341310:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851856.341311:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:5.0:1773851856.341312:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e688c1e.
00000100:00000200:5.0:1773851856.341313:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388106946624, offset 224
00000400:00000200:5.0:1773851856.341315:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:5.0:1773851856.341317:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.341318:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851856.341319:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851856.341321:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851856.341323:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:5.0:1773851856.341325:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768682:8768682:1024:4294967295] 43@kfi7 LPNI seq info [37492098:37492098:16:4294967295]
00000400:00000200:5.0:1773851856.341328:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851856.341329:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.341332:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851856.341334:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:5.0:1773851856.341336:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851856.341338:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851856.341342:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851856.341345:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Using peer 43@kfi7(0xa02)
00000800:00000200:5.0:1773851856.341350:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 468 bytes to peer 0xa02: rc=0
00000800:00000200:5.0:1773851856.341352:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851856.341355:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851856.341357:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:5.0:1773851856.341358:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851856.341359:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851856.341360:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851856.341361:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dcae8bd0 x1859388106946624/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:583/0 lens 224/368 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000800:00000200:6.0:1773851856.341366:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851856.341366:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcae8bd0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388106946624:12345-61@kfi7:41:default-yuba1-0 Request processed in 101us (153us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851856.341369:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:5.0:1773851856.341370:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314075
00000400:00000200:6.0:1773851856.341372:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000100:00000040:5.0:1773851856.341372:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000400:00000200:6.0:1773851856.341373:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e688c1e
00000400:00000010:6.0:1773851856.341373:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e688c1e.
00000100:00000001:5.0:1773851856.341373:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851856.341374:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851856.341374:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00000001:6.0:1773851856.341375:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851856.341376:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:5.0:1773851856.341376:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000400:00000200:6.0:1773851856.341377:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000020:00000010:5.0:1773851856.341377:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000829447ec.
00000020:00000040:5.0:1773851856.341378:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000800:00000200:6.0:1773851856.341379:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Transaction freed
00000100:00000001:5.0:1773851856.341379:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851856.382067:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851856.382068:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851856.382069:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851856.382071:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851856.382073:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.382074:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17315@kfi7 : PUT - for me
00000400:00000200:17.0:1773851856.382075:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.382076:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 1
00000400:00000200:17.0:1773851856.382077:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.382077:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000400:00000200:17.0:1773851856.382078:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 3
00000400:00000200:17.0:1773851856.382079:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17314@kfi7 to cpt 0
00000400:00000200:17.0:1773851856.382080:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17314@kfi7 of length 224 into portal 12 MB=0x69b4b5f414640
00000400:00000200:17.0:1773851856.382081:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17314@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 190528
00000800:00000200:17.0:1773851856.382083:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851856.382085:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.382086:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17315@kfi7: PUT: OK
00000100:00000001:17.0:1773851856.382087:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851856.382087:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851856.382088:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a060c2e3.
00000100:00000040:17.0:1773851856.382089:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a060c2e3 x1859597883229760 msgsize 224
00000100:00100000:17.0:1773851856.382090:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-17314@kfi7 (source: 12345-17315@kfi7)
00000100:00000001:17.0:1773851856.382091:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:18.0:1773851856.382092:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851856.382092:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
02000000:00000001:18.0:1773851856.382093:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851856.382093:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851856.382093:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851856.382094:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851856.382094:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851856.382095:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597883229760
00000020:00000001:18.0:1773851856.382096:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851856.382096:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8207e
00000020:00000001:18.0:1773851856.382097:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851856.382099:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006315effd refcount=167
00000020:00000001:18.0:1773851856.382099:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636994755049472 : -107078954502144 : ffff9e9cbcf43800)
00000020:00000001:18.0:1773851856.382100:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636994755049472 : -107078954502144 : ffff9e9cbcf43800)
00000100:00000001:18.0:1773851856.382101:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.382102:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851856.382103:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003da7790a.
00000020:00000010:18.0:1773851856.382104:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851856.382105:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851856.382105:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851856.382106:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851856.382106:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851856.382107:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851856.382108:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851856.382108:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.382109:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851856.382110:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851856.382110:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851856.382111:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851856.382111:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851856.382111:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17314@kfi7, seq: 2156263
00000100:00000001:19.0:1773851856.382112:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851856.382112:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006315effd : new rpc_count 1
00000100:00000001:19.0:1773851856.382113:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.382113:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405314944 : -106994304236672 : ffff9eb07280c380)
00000100:00000040:18.0:1773851856.382114:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a060c2e3 x1859597883229760/t0(0) o400->d490388b-0f0e-413d-b949-19f6e15372d5@17314@kfi7:46/0 lens 224/0 e 0 to 0 dl 1773852161 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1564-0'
00000100:00000001:18.0:1773851856.382116:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.382117:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851856.382118:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a060c2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d490388b-0f0e-413d-b949-19f6e15372d5+167:39670:x1859597883229760:12345-17314@kfi7:400:default-tuolumne1564-0
00000100:00000200:18.0:1773851856.382120:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597883229760
00000020:00000001:18.0:1773851856.382120:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851856.382121:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851856.382122:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.382122:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851856.382123:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851856.382124:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851856.382124:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597883229760, found 0 last_xid 1859597882808255
00000020:00000001:18.0:1773851856.382125:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851856.382126:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851856.382126:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851856.382127:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.382127:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851856.382128:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851856.382128:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851856.382129:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000043b40cc9.
02000000:00000001:18.0:1773851856.382130:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.382130:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.382131:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851856.382132:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062649, transno 0, xid 1859597883229760
00010000:00000001:18.0:1773851856.382132:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851856.382133:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a060c2e3 x1859597883229760/t0(0) o400->d490388b-0f0e-413d-b949-19f6e15372d5@17314@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1564-0'
00010000:00000001:18.0:1773851856.382135:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851856.382136:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851856.382137:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=89 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851856.382138:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851856.382138:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e95ced3 refcount 3 to 17314@kfi7
00000100:00000001:18.0:1773851856.382139:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850079488 : -107143859472128 : ffff9e8da050f900)
02000000:00000001:18.0:1773851856.382140:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851856.382140:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.382141:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851856.382141:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17315@kfi7
00000400:00000010:18.0:1773851856.382142:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000170bff74.
00000100:00000200:18.0:1773851856.382144:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597883229760, offset 224
00000400:00000200:18.0:1773851856.382145:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17315@kfi7
00000400:00000200:18.0:1773851856.382145:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.382146:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 1
00000400:00000200:18.0:1773851856.382147:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000400:00000200:18.0:1773851856.382148:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 3
00000400:00000200:18.0:1773851856.382149:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17315@kfi7 local destination
00000400:00000200:18.0:1773851856.382150:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768683:8768683:1024:4294967295] 17315@kfi7 LPNI seq info [136500:136500:16:4294967295]
00000400:00000200:18.0:1773851856.382152:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000400:00000200:18.0:1773851856.382152:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.382154:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17315@kfi7(17315@kfi7:17315@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851856.382156:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 3
00000800:00000200:18.0:1773851856.382157:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851856.382158:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851856.382160:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851856.382162:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004f6 Using peer 17315@kfi7(0x1000000000004f6)
00000800:00000200:18.0:1773851856.382165:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006c9a9e9c: Posted send of 324 bytes to peer 0x1000000000004f6: rc=0
00000800:00000200:18.0:1773851856.382166:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004f6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851856.382169:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851856.382170:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e95ced3 refcount 2 to 17314@kfi7
00010000:00000001:18.0:1773851856.382170:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851856.382171:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.382171:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851856.382172:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a060c2e3 x1859597883229760/t0(0) o400->d490388b-0f0e-413d-b949-19f6e15372d5@17314@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1564-0'
00000100:00100000:18.0:1773851856.382175:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a060c2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d490388b-0f0e-413d-b949-19f6e15372d5+167:39670:x1859597883229760:12345-17314@kfi7:400:default-tuolumne1564-0 Request processed in 58us (85us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851856.382178:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17314@kfi7, seq: 2156263
00000100:00000040:18.0:1773851856.382178:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006315effd : new rpc_count 0
00000800:00000200:17.0:1773851856.382178:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004f6 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851856.382179:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851856.382179:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851856.382180:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851856.382180:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851856.382180:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17315@kfi7: PUT: OK
00000020:00000010:18.0:1773851856.382181:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000400:00000200:17.0:1773851856.382181:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000170bff74
00000400:00000010:17.0:1773851856.382181:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000170bff74.
00000020:00000010:18.0:1773851856.382182:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003da7790a.
00000020:00000040:18.0:1773851856.382182:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000006315effd : new refcount 166
00000100:00000001:17.0:1773851856.382182:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851856.382183:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851856.382183:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851856.382184:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000800:00000200:17.0:1773851856.382185:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 17315@kfi7(000000009628ecb8):0x0 lsk 1271 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004f6 Transaction freed
00000800:00000200:1.0:1773851856.481517:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.481519:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851856.481522:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851856.481524:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851856.481527:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.481528:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15667@kfi7 : PUT - for me
00000400:00000200:1.0:1773851856.481529:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.481530:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 1
00000400:00000200:1.0:1773851856.481531:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.481532:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000400:00000200:1.0:1773851856.481533:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 3
00000400:00000200:1.0:1773851856.481534:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15666@kfi7 to cpt 5
00000400:00000200:1.0:1773851856.481535:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15666@kfi7 of length 224 into portal 12 MB=0x69b4b93c11700
00000400:00000200:1.0:1773851856.481536:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15666@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 14240
00000800:00000200:1.0:1773851856.481538:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851856.481540:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851856.481541:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15667@kfi7: PUT: OK
00000100:00000001:1.0:1773851856.481542:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851856.481542:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851856.481543:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf24403a.
00000100:00000040:1.0:1773851856.481544:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000cf24403a x1859598764021504 msgsize 224
00000100:00100000:1.0:1773851856.481545:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-15666@kfi7 (source: 12345-15667@kfi7)
00000100:00000001:1.0:1773851856.481546:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851856.481547:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000800:00000200:1.0:1773851856.481549:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851856.481552:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851856.481552:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851856.481553:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851856.481553:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851856.481554:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851856.481556:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598764021504
00000020:00000001:1.0:1773851856.481556:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851856.481557:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80d30
00000020:00000001:1.0:1773851856.481557:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851856.481558:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000132a9f0c refcount=167
00000020:00000001:1.0:1773851856.481559:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126449935360 : -106947259616256 : ffff9ebb6694b400)
00000020:00000001:1.0:1773851856.481560:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126449935360 : -106947259616256 : ffff9ebb6694b400)
00000100:00000001:1.0:1773851856.481561:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.481562:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851856.481562:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab5a0507.
00000020:00000010:1.0:1773851856.481564:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851856.481564:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c1799ca9.
00000100:00000001:1.0:1773851856.481565:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851856.481566:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851856.481566:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.481567:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851856.481568:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851856.481568:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.481569:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.481571:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.481571:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851856.481571:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:1.0:1773851856.481572:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15666@kfi7, seq: 1997496
00000100:00000001:0.0:1773851856.481572:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:1.0:1773851856.481573:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000132a9f0c : new rpc_count 1
00000100:00000001:0.0:1773851856.481573:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.481574:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605641984 : -106923103909632 : ffff9ec1065f8900)
00000100:00000001:0.0:1773851856.481574:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.481575:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cf24403a x1859598764021504/t0(0) o400->7c56ebde-86e9-4a5b-8754-bbedb7bddb49@15666@kfi7:496/0 lens 224/0 e 0 to 0 dl 1773852611 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1465-0'
00000100:00000001:1.0:1773851856.481578:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.481578:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851856.481579:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf24403a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7c56ebde-86e9-4a5b-8754-bbedb7bddb49+167:39757:x1859598764021504:12345-15666@kfi7:400:default-tuolumne1465-0
00000100:00000200:1.0:1773851856.481580:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598764021504
00000020:00000001:1.0:1773851856.481581:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851856.481582:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851856.481582:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.481583:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851856.481584:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851856.481585:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851856.481585:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598764021504, found 0 last_xid 1859598763597823
00000020:00000001:1.0:1773851856.481586:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851856.481587:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851856.481587:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851856.481588:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.481588:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851856.481589:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851856.481589:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851856.481590:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001d291252.
02000000:00000001:1.0:1773851856.481591:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.481591:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.481592:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851856.481593:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062787, transno 0, xid 1859598764021504
00010000:00000001:1.0:1773851856.481594:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851856.481594:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cf24403a x1859598764021504/t0(0) o400->7c56ebde-86e9-4a5b-8754-bbedb7bddb49@15666@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1465-0'
00010000:00000001:1.0:1773851856.481597:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851856.481597:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851856.481598:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=89 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851856.481599:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851856.481600:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a504c1f7 refcount 3 to 15666@kfi7
00000100:00000001:1.0:1773851856.481600:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402093728 : -107139307457888 : ffff9e8eafa332a0)
02000000:00000001:1.0:1773851856.481601:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851856.481602:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.481602:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851856.481603:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15667@kfi7
00000400:00000010:1.0:1773851856.481604:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004af764b3.
00000100:00000200:1.0:1773851856.481605:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598764021504, offset 224
00000400:00000200:1.0:1773851856.481606:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15667@kfi7
00000400:00000200:1.0:1773851856.481607:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.481608:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 1
00000400:00000200:1.0:1773851856.481609:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000400:00000200:1.0:1773851856.481610:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 3
00000400:00000200:1.0:1773851856.481611:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15667@kfi7 local destination
00000400:00000200:1.0:1773851856.481612:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768684:8768684:1024:4294967295] 15667@kfi7 LPNI seq info [4389011:4389011:16:4294967295]
00000400:00000200:1.0:1773851856.481614:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000400:00000200:1.0:1773851856.481614:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.481616:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15667@kfi7(15667@kfi7:15667@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851856.481617:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 3
00000800:00000200:1.0:1773851856.481619:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.481620:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851856.481622:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851856.481624:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xffb Using peer 15667@kfi7(0xffb)
00000800:00000200:1.0:1773851856.481627:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 324 bytes to peer 0xffb: rc=0
00000800:00000200:1.0:1773851856.481628:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xffb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851856.481630:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.481631:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a504c1f7 refcount 2 to 15666@kfi7
00010000:00000001:1.0:1773851856.481632:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851856.481632:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.481633:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851856.481633:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cf24403a x1859598764021504/t0(0) o400->7c56ebde-86e9-4a5b-8754-bbedb7bddb49@15666@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1465-0'
00000100:00100000:1.0:1773851856.481636:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf24403a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7c56ebde-86e9-4a5b-8754-bbedb7bddb49+167:39757:x1859598764021504:12345-15666@kfi7:400:default-tuolumne1465-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851856.481638:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15666@kfi7, seq: 1997496
00000100:00000040:1.0:1773851856.481639:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000132a9f0c : new rpc_count 0
00000100:00000001:1.0:1773851856.481640:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:2.0:1773851856.481641:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xffb TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851856.481641:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851856.481642:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851856.481642:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851856.481642:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c1799ca9.
00000400:00000200:2.0:1773851856.481643:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15667@kfi7: PUT: OK
00000020:00000010:1.0:1773851856.481643:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab5a0507.
00000400:00000200:2.0:1773851856.481644:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004af764b3
00000400:00000010:2.0:1773851856.481644:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004af764b3.
00000020:00000040:1.0:1773851856.481644:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000132a9f0c : new refcount 166
00000100:00000001:1.0:1773851856.481644:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851856.481645:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851856.481646:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851856.481646:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000800:00000200:2.0:1773851856.481648:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 15667@kfi7(000000001a7637da):0x0 lsk 4092 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xffb Transaction freed
00000800:00000200:13.0:1773851856.485809:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.485810:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851856.485812:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851856.485815:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851856.485817:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14435@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.485819:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14435@kfi7 : PUT - for me
00000400:00000200:13.0:1773851856.485820:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14435@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.485821:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000062fe339 nid 14435@kfi7 refs 1
00000400:00000200:13.0:1773851856.485822:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14435@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.485822:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000062fe339 nid 14435@kfi7 refs 2
00000400:00000200:13.0:1773851856.485823:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000062fe339 nid 14435@kfi7 refs 3
00000400:00000200:13.0:1773851856.485824:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000400:00000200:13.0:1773851856.485825:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14498@kfi7 of length 224 into portal 12 MB=0x69b4be0cba640
00000400:00000200:13.0:1773851856.485827:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14498@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 15400
00000800:00000200:13.0:1773851856.485829:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.485831:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.485832:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14435@kfi7: PUT: OK
00000100:00000001:13.0:1773851856.485833:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851856.485833:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851856.485834:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c3453f1c.
00000100:00000040:13.0:1773851856.485835:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c3453f1c x1859600056559168 msgsize 224
00000100:00100000:13.0:1773851856.485836:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14498@kfi7 (source: 12345-14435@kfi7)
00000100:00000001:13.0:1773851856.485837:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851856.485838:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000062fe339 nid 14435@kfi7 refs 2
00000100:00000001:14.0:1773851856.485839:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851856.485839:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851856.485840:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851856.485840:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851856.485840:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851856.485841:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851856.485842:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600056559168
00000020:00000001:14.0:1773851856.485842:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851856.485843:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f868
00000020:00000001:14.0:1773851856.485843:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851856.485846:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cd3dbdb1 refcount=3832
00000020:00000001:14.0:1773851856.485847:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125217116160 : -106948492435456 : ffff9ebb1d196000)
00000020:00000001:14.0:1773851856.485848:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125217116160 : -106948492435456 : ffff9ebb1d196000)
00000100:00000001:14.0:1773851856.485849:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851856.485850:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851856.485850:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047b64737.
00000020:00000010:14.0:1773851856.485851:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851856.485852:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000040:14.0:1773851856.485853:0:60824:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +82s
00000100:00000001:14.0:1773851856.485854:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851856.485854:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851856.485855:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.485856:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851856.485856:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851856.485857:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.485858:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851856.485859:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851856.485859:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.485859:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:14.0:1773851856.485860:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14498@kfi7, seq: 2289777
00000100:00000001:13.0:1773851856.485860:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:14.0:1773851856.485861:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cd3dbdb1 : new rpc_count 25
00000100:00000001:13.0:1773851856.485861:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.485862:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197383808 : -106942512167808 : ffff9ebc818d0480)
00000100:00000001:13.0:1773851856.485862:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851856.485863:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c3453f1c x1859600056559168/t0(0) o400->e0617463-9db6-45c9-902a-014b15fdc2fe@14498@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1388-0'
00000100:00000001:14.0:1773851856.485867:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851856.485867:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851856.485868:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3453f1c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e0617463-9db6-45c9-902a-014b15fdc2fe+3832:39594:x1859600056559168:12345-14498@kfi7:400:default-tuolumne1388-0
00000100:00000200:14.0:1773851856.485870:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600056559168
00000020:00000001:14.0:1773851856.485870:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851856.485871:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851856.485871:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.485872:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851856.485873:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851856.485874:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851856.485874:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600056559168, found 0 last_xid 1859600055848447
00000020:00000001:14.0:1773851856.485875:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851856.485875:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851856.485876:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851856.485877:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.485877:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851856.485878:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851856.485878:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851856.485879:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ca80d828.
02000000:00000001:14.0:1773851856.485880:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.485881:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.485881:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851856.485882:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593890, transno 0, xid 1859600056559168
00010000:00000001:14.0:1773851856.485883:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851856.485884:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c3453f1c x1859600056559168/t0(0) o400->e0617463-9db6-45c9-902a-014b15fdc2fe@14498@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1388-0'
00010000:00000001:14.0:1773851856.485886:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851856.485886:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851856.485887:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851856.485888:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851856.485889:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000861b221c refcount 3 to 14498@kfi7
00000100:00000001:14.0:1773851856.485890:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333664 : -107155408217952 : ffff9e8aeff518a0)
02000000:00000001:14.0:1773851856.485891:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851856.485891:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851856.485892:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851856.485893:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14435@kfi7
00000400:00000010:14.0:1773851856.485893:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091834aa1.
00000100:00000200:14.0:1773851856.485894:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600056559168, offset 224
00000400:00000200:14.0:1773851856.485895:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14435@kfi7
00000400:00000200:14.0:1773851856.485896:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14435@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.485897:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000062fe339 nid 14435@kfi7 refs 1
00000400:00000200:14.0:1773851856.485898:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000062fe339 nid 14435@kfi7 refs 2
00000400:00000200:14.0:1773851856.485899:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000062fe339 nid 14435@kfi7 refs 3
00000400:00000200:14.0:1773851856.485900:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14435@kfi7 local destination
00000400:00000200:14.0:1773851856.485901:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768685:8768685:1024:4294967295] 14435@kfi7 LPNI seq info [14359369:14359369:16:4294967295]
00000400:00000200:14.0:1773851856.485903:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000062fe339 nid 14435@kfi7 refs 2
00000400:00000200:14.0:1773851856.485904:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14435@kfi7 to cpt 3
00000400:00000200:14.0:1773851856.485906:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14435@kfi7(14435@kfi7:14435@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851856.485907:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000062fe339 nid 14435@kfi7 refs 3
00000800:00000200:14.0:1773851856.485908:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851856.485909:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851856.485911:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851856.485914:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5e5 Using peer 14435@kfi7(0x5e5)
00000800:00000200:14.0:1773851856.485917:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004c2b9f01: Posted send of 324 bytes to peer 0x5e5: rc=0
00000800:00000200:14.0:1773851856.485918:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5e5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851856.485920:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851856.485921:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000861b221c refcount 2 to 14498@kfi7
00010000:00000001:14.0:1773851856.485922:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851856.485922:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851856.485923:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851856.485924:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c3453f1c x1859600056559168/t0(0) o400->e0617463-9db6-45c9-902a-014b15fdc2fe@14498@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1388-0'
00000100:00100000:14.0:1773851856.485927:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3453f1c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e0617463-9db6-45c9-902a-014b15fdc2fe+3832:39594:x1859600056559168:12345-14498@kfi7:400:default-tuolumne1388-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851856.485929:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14498@kfi7, seq: 2289777
00000100:00000040:14.0:1773851856.485930:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cd3dbdb1 : new rpc_count 24
00000100:00000001:14.0:1773851856.485931:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851856.485931:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851856.485931:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5e5 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851856.485932:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000400:00000200:13.0:1773851856.485932:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851856.485933:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000020:00000010:14.0:1773851856.485933:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047b64737.
00000400:00000200:13.0:1773851856.485933:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14435@kfi7: PUT: OK
00000020:00000040:14.0:1773851856.485934:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000cd3dbdb1 : new refcount 3831
00000400:00000200:13.0:1773851856.485934:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091834aa1
00000400:00000010:13.0:1773851856.485934:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091834aa1.
00000100:00000001:14.0:1773851856.485935:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851856.485935:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851856.485936:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851856.485936:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000062fe339 nid 14435@kfi7 refs 2
00000800:00000200:13.0:1773851856.485938:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 14435@kfi7(0000000059c1ef9b):0x0 lsk 1510 rsk 32 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5e5 Transaction freed
00000800:00000200:1.0:1773851856.493393:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.493394:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851856.493395:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851856.493397:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851856.493399:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19458@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.493400:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19458@kfi7 : PUT - for me
00000400:00000200:1.0:1773851856.493401:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19458@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.493402:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ffbe488a nid 19458@kfi7 refs 1
00000400:00000200:1.0:1773851856.493403:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19458@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.493404:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ffbe488a nid 19458@kfi7 refs 2
00000400:00000200:1.0:1773851856.493404:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ffbe488a nid 19458@kfi7 refs 3
00000400:00000200:1.0:1773851856.493405:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19458@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.493406:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19458@kfi7 of length 224 into portal 12 MB=0x69b4b614631c0
00000400:00000200:1.0:1773851856.493408:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19458@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 14464
00000800:00000200:1.0:1773851856.493409:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851856.493411:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851856.493412:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19458@kfi7: PUT: OK
00000100:00000001:1.0:1773851856.493413:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851856.493414:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851856.493414:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000916d40f9.
00000100:00000040:1.0:1773851856.493415:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000916d40f9 x1859597917106624 msgsize 224
00000100:00100000:1.0:1773851856.493417:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-19458@kfi7 (source: 12345-19458@kfi7)
00000100:00000001:1.0:1773851856.493419:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851856.493420:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ffbe488a nid 19458@kfi7 refs 2
00000800:00000200:1.0:1773851856.493421:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851856.493423:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851856.493424:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851856.493424:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851856.493425:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851856.493426:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851856.493426:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597917106624
00000020:00000001:1.0:1773851856.493427:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851856.493427:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e243870ca
00000020:00000001:1.0:1773851856.493428:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851856.493430:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b342c59a refcount=5
00000020:00000001:1.0:1773851856.493431:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100510966784 : -106973198584832 : ffff9eb55c7f7400)
00000020:00000001:1.0:1773851856.493432:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637100510966784 : -106973198584832 : ffff9eb55c7f7400)
00000100:00000001:1.0:1773851856.493432:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.493433:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851856.493434:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab5a0507.
00000020:00000010:1.0:1773851856.493435:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851856.493436:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c1799ca9.
00000100:00000001:1.0:1773851856.493437:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851856.493437:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851856.493438:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.493438:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851856.493439:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851856.493439:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.493440:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.493441:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.493442:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851856.493442:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851856.493442:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851856.493443:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19458@kfi7, seq: 1997497
00000100:00000040:1.0:1773851856.493444:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b342c59a : new rpc_count 1
00000100:00000001:1.0:1773851856.493444:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605662720 : -106923103888896 : ffff9ec1065fda00)
00000100:00000001:0.0:1773851856.493444:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.493444:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.493445:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000916d40f9 x1859597917106624/t0(0) o400->3dc89a60-67f3-4fc9-9177-b0f4e1897757@19458@kfi7:496/0 lens 224/0 e 0 to 0 dl 1773852611 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1719-0'
00000100:00000001:1.0:1773851856.493448:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.493449:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851856.493450:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000916d40f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3dc89a60-67f3-4fc9-9177-b0f4e1897757+5:39548:x1859597917106624:12345-19458@kfi7:400:default-tuolumne1719-0
00000100:00000200:1.0:1773851856.493451:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597917106624
00000020:00000001:1.0:1773851856.493452:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851856.493452:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851856.493453:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.493453:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851856.493454:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851856.493455:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851856.493455:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597917106624, found 0 last_xid 1859597917106623
00000020:00000001:1.0:1773851856.493456:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851856.493457:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851856.493457:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851856.493458:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.493458:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851856.493459:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851856.493459:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851856.493460:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000bd14c1b.
02000000:00000001:1.0:1773851856.493461:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.493462:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.493462:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851856.493463:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260393514, transno 0, xid 1859597917106624
00010000:00000001:1.0:1773851856.493464:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851856.493464:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000916d40f9 x1859597917106624/t0(0) o400->3dc89a60-67f3-4fc9-9177-b0f4e1897757@19458@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1719-0'
00010000:00000001:1.0:1773851856.493466:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851856.493467:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851856.493468:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=89 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851856.493469:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851856.493470:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f60382ed refcount 3 to 19458@kfi7
00000100:00000001:1.0:1773851856.493470:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050528 : -107154804501088 : ffff9e8b13f115a0)
02000000:00000001:1.0:1773851856.493472:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851856.493472:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.493473:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851856.493474:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19458@kfi7
00000400:00000010:1.0:1773851856.493474:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000409960d4.
00000100:00000200:1.0:1773851856.493475:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597917106624, offset 224
00000400:00000200:1.0:1773851856.493476:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19458@kfi7
00000400:00000200:1.0:1773851856.493477:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19458@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.493478:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ffbe488a nid 19458@kfi7 refs 1
00000400:00000200:1.0:1773851856.493479:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ffbe488a nid 19458@kfi7 refs 2
00000400:00000200:1.0:1773851856.493480:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ffbe488a nid 19458@kfi7 refs 3
00000400:00000200:1.0:1773851856.493481:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19458@kfi7 local destination
00000400:00000200:1.0:1773851856.493483:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768686:8768686:1024:4294967295] 19458@kfi7 LPNI seq info [516132:516132:16:4294967295]
00000400:00000200:1.0:1773851856.493484:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ffbe488a nid 19458@kfi7 refs 2
00000400:00000200:1.0:1773851856.493485:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19458@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.493487:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19458@kfi7(19458@kfi7:19458@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851856.493488:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ffbe488a nid 19458@kfi7 refs 3
00000800:00000200:1.0:1773851856.493489:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.493490:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851856.493492:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851856.493494:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x993 Using peer 19458@kfi7(0x993)
00000800:00000200:1.0:1773851856.493497:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 324 bytes to peer 0x993: rc=0
00000800:00000200:1.0:1773851856.493499:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x993 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851856.493501:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851856.493502:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f60382ed refcount 2 to 19458@kfi7
00010000:00000001:1.0:1773851856.493502:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851856.493503:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851856.493504:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851856.493505:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000916d40f9 x1859597917106624/t0(0) o400->3dc89a60-67f3-4fc9-9177-b0f4e1897757@19458@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1719-0'
00000100:00100000:1.0:1773851856.493508:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000916d40f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3dc89a60-67f3-4fc9-9177-b0f4e1897757+5:39548:x1859597917106624:12345-19458@kfi7:400:default-tuolumne1719-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851856.493510:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19458@kfi7, seq: 1997497
00000100:00000040:1.0:1773851856.493511:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b342c59a : new rpc_count 0
00000800:00000200:3.0:1773851856.493512:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x993 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851856.493512:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851856.493512:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851856.493513:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:3.0:1773851856.493514:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851856.493514:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c1799ca9.
00000020:00000010:1.0:1773851856.493514:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab5a0507.
00000400:00000200:3.0:1773851856.493515:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19458@kfi7: PUT: OK
00000400:00000200:3.0:1773851856.493515:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000409960d4
00000020:00000040:1.0:1773851856.493515:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000b342c59a : new refcount 4
00000400:00000010:3.0:1773851856.493516:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000409960d4.
00000100:00000001:1.0:1773851856.493516:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851856.493517:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851856.493517:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851856.493518:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ffbe488a nid 19458@kfi7 refs 2
00000800:00000200:3.0:1773851856.493519:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19458@kfi7(00000000846d9c10):0x0 lsk 2452 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x993 Transaction freed
00000800:00000200:23.0:1773851856.526992:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851856.526993:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851856.526994:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851856.526995:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:23.0:1773851856.526996:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851856.526997:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:23.0:1773851856.527000:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851856.527002:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16737@kfi7(00000000cb47692e):0x53f version: 2; local version 2; negotiated version: 2
00000400:00000200:23.0:1773851856.527003:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000800:00000200:21.0:1773851856.527005:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f Using peer 16737@kfi7(0x53f)
00000400:00000200:23.0:1773851856.527006:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16737@kfi7 : PUT - for me
00000400:00000200:23.0:1773851856.527008:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:23.0:1773851856.527009:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 1
00000400:00000200:23.0:1773851856.527011:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:23.0:1773851856.527012:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000400:00000200:23.0:1773851856.527014:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 3
00000400:00000200:21.0:1773851856.527016:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:23.0:1773851856.527017:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:23.0:1773851856.527019:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16737@kfi7 of length 224 into portal 12 MB=0x699e0c3853ac0
00000800:00000200:21.0:1773851856.527019:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000184df75a: Posted send of 38 bytes to peer 0x53f: rc=0
00000400:00000200:23.0:1773851856.527021:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16737@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 25384
00000800:00000200:21.0:1773851856.527022:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:23.0:1773851856.527025:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851856.527028:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:23.0:1773851856.527034:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16737@kfi7: PUT: OK
00000800:00000200:21.0:1773851856.527034:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851856.527036:0:2495434:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:23.0:1773851856.527037:0:2495434:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:23.0:1773851856.527038:0:2495434:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3f588c9.
00000800:00000200:21.0:1773851856.527039:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f Transaction freed
00000100:00000040:23.0:1773851856.527040:0:2495434:0:(events.c:358:request_in_callback()) incoming req@00000000e3f588c9 x1858040492276416 msgsize 224
00000100:00100000:23.0:1773851856.527042:0:2495434:0:(events.c:361:request_in_callback()) peer: 12345-16737@kfi7 (source: 12345-16737@kfi7)
00000100:00000001:23.0:1773851856.527045:0:2495434:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:23.0:1773851856.527047:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000800:00000200:23.0:1773851856.527050:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cf211825: 2069@kfi7:5 <- 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851856.527055:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851856.527056:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851856.527057:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851856.527058:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851856.527059:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851856.527061:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040492276416
00000020:00000001:23.0:1773851856.527062:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851856.527062:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920f4
00000020:00000001:23.0:1773851856.527063:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851856.527067:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009e5dbd74 refcount=6
00000020:00000001:23.0:1773851856.527068:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629499904 : -107123080051712 : ffff9e9276ddc400)
00000020:00000001:23.0:1773851856.527069:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629499904 : -107123080051712 : ffff9e9276ddc400)
00000100:00000001:23.0:1773851856.527071:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851856.527072:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851856.527073:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab1b10d5.
00000020:00000010:23.0:1773851856.527074:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851856.527076:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851856.527077:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851856.527078:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851856.527079:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851856.527081:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851856.527081:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851856.527082:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851856.527084:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851856.527086:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851856.527087:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851856.527088:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851856.527089:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16737@kfi7, seq: 1997932
00000100:00000001:22.0:1773851856.527089:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851856.527090:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009e5dbd74 : new rpc_count 1
00000100:00000001:23.0:1773851856.527091:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133285643648 : -106940423907968 : ffff9ebcfe055580)
00000100:00000001:22.0:1773851856.527091:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851856.527092:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851856.527093:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3f588c9 x1858040492276416/t0(0) o400->0c8abac1-08b2-4ebd-94ea-b4eb21c770f0@16737@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1536-0'
00000100:00000001:23.0:1773851856.527098:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851856.527099:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851856.527100:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f588c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0c8abac1-08b2-4ebd-94ea-b4eb21c770f0+6:39635:x1858040492276416:12345-16737@kfi7:400:default-tuolumne1536-0
00000100:00000200:23.0:1773851856.527102:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040492276416
00000020:00000001:23.0:1773851856.527103:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851856.527104:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851856.527105:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851856.527107:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851856.527107:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851856.527109:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851856.527109:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040492276416, found 0 last_xid 1858040492276415
00000020:00000001:23.0:1773851856.527111:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851856.527112:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851856.527113:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851856.527113:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851856.527115:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851856.527115:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851856.527116:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851856.527118:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a6e6ffee.
02000000:00000001:23.0:1773851856.527119:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851856.527120:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851856.527121:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851856.527122:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044158747, transno 0, xid 1858040492276416
00010000:00000001:23.0:1773851856.527123:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851856.527125:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3f588c9 x1858040492276416/t0(0) o400->0c8abac1-08b2-4ebd-94ea-b4eb21c770f0@16737@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1536-0'
00010000:00000001:23.0:1773851856.527129:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851856.527130:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851856.527131:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=89 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851856.527133:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851856.527134:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032cab2e4 refcount 3 to 16737@kfi7
00000100:00000001:23.0:1773851856.527136:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106304 : -107156354445312 : ffff9e8ab78ed000)
02000000:00000001:23.0:1773851856.527137:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851856.527138:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851856.527139:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851856.527140:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16737@kfi7
00000400:00000010:23.0:1773851856.527141:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc3746cb.
00000100:00000200:23.0:1773851856.527142:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040492276416, offset 224
00000400:00000200:23.0:1773851856.527144:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16737@kfi7
00000400:00000200:23.0:1773851856.527146:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:23.0:1773851856.527147:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 1
00000400:00000200:23.0:1773851856.527149:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000400:00000200:23.0:1773851856.527151:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 3
00000400:00000200:23.0:1773851856.527152:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16737@kfi7 local destination
00000400:00000200:23.0:1773851856.527155:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768687:8768687:1024:4294967295] 16737@kfi7 LPNI seq info [87254:87254:16:4294967295]
00000400:00000200:23.0:1773851856.527157:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000400:00000200:23.0:1773851856.527158:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:23.0:1773851856.527162:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16737@kfi7(16737@kfi7:16737@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851856.527164:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 3
00000800:00000200:23.0:1773851856.527166:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851856.527167:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851856.527171:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851856.527175:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f Using peer 16737@kfi7(0x53f)
00000800:00000200:23.0:1773851856.527179:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x53f: rc=0
00000800:00000200:23.0:1773851856.527182:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851856.527186:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851856.527187:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032cab2e4 refcount 2 to 16737@kfi7
00010000:00000001:23.0:1773851856.527189:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851856.527189:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851856.527191:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851856.527192:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3f588c9 x1858040492276416/t0(0) o400->0c8abac1-08b2-4ebd-94ea-b4eb21c770f0@16737@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1536-0'
00000800:00000200:21.0:1773851856.527194:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851856.527197:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f588c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0c8abac1-08b2-4ebd-94ea-b4eb21c770f0+6:39635:x1858040492276416:12345-16737@kfi7:400:default-tuolumne1536-0 Request processed in 98us (156us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851856.527197:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851856.527199:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16737@kfi7: PUT: OK
00000100:00100000:23.0:1773851856.527201:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16737@kfi7, seq: 1997932
00000400:00000200:21.0:1773851856.527201:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc3746cb
00000100:00000040:23.0:1773851856.527202:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009e5dbd74 : new rpc_count 0
00000400:00000010:21.0:1773851856.527202:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc3746cb.
00000100:00000001:23.0:1773851856.527203:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851856.527203:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851856.527204:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:21.0:1773851856.527204:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851856.527205:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851856.527205:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000020:00000010:23.0:1773851856.527206:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:23.0:1773851856.527208:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab1b10d5.
00000800:00000200:21.0:1773851856.527208:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 16737@kfi7(00000000cb47692e):0x0 lsk 1344 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x53f Transaction freed
00000020:00000040:23.0:1773851856.527209:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000009e5dbd74 : new refcount 5
00000100:00000001:23.0:1773851856.527210:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851856.555820:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.555820:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851856.555821:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851856.555823:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851856.555825:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10547@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.555826:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10547@kfi7 : PUT - for me
00000400:00000200:9.0:1773851856.555827:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10547@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.555828:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8374a9f nid 10547@kfi7 refs 1
00000400:00000200:9.0:1773851856.555829:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10547@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.555830:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8374a9f nid 10547@kfi7 refs 2
00000400:00000200:9.0:1773851856.555831:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a8374a9f nid 10547@kfi7 refs 3
00000400:00000200:9.0:1773851856.555831:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10546@kfi7 to cpt 7
00000400:00000200:9.0:1773851856.555832:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10546@kfi7 of length 224 into portal 12 MB=0x699e112f48c00
00000400:00000200:9.0:1773851856.555834:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10546@kfi7 of length 224/224 into md 0x78146ce49 [64] + 120800
00000800:00000200:9.0:1773851856.555836:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851856.555837:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851856.555839:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10547@kfi7: PUT: OK
00000100:00000001:9.0:1773851856.555840:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851856.555840:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851856.555841:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8a71053.
00000100:00000040:9.0:1773851856.555845:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000a8a71053 x1858041824971776 msgsize 224
00000100:00100000:9.0:1773851856.555846:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10546@kfi7 (source: 12345-10547@kfi7)
00000100:00000001:9.0:1773851856.555847:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851856.555848:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8374a9f nid 10547@kfi7 refs 2
00000100:00000001:10.0:1773851856.555849:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851856.555850:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851856.555850:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851856.555851:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851856.555851:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851856.555852:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851856.555853:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041824971776
00000020:00000001:10.0:1773851856.555854:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851856.555855:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916cf
00000020:00000001:10.0:1773851856.555855:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851856.555858:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000004c0bfa0 refcount=6
00000020:00000001:10.0:1773851856.555859:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241478144 : -107152468073472 : ffff9e8b9f342400)
00000020:00000001:10.0:1773851856.555860:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241478144 : -107152468073472 : ffff9e8b9f342400)
00000100:00000001:10.0:1773851856.555861:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.555862:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851856.555863:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000014daa50c.
00000020:00000010:10.0:1773851856.555865:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000065d1028a.
00000020:00000010:10.0:1773851856.555865:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007aba1bf5.
00000100:00000001:10.0:1773851856.555866:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851856.555867:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851856.555867:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851856.555869:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851856.555869:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851856.555870:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.555871:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851856.555872:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.555873:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.555873:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851856.555873:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851856.555874:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10546@kfi7, seq: 2130730
00000100:00000001:11.0:1773851856.555875:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.555875:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000004c0bfa0 : new rpc_count 1
00000100:00000001:11.0:1773851856.555876:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.555876:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064885632 : -106983644665984 : ffff9eb2eddce780)
00000100:00000040:10.0:1773851856.555877:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a8a71053 x1858041824971776/t0(0) o400->5a3d8716-2af6-49b9-a719-c3558db80ed1@10546@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1145-0'
00000100:00000001:10.0:1773851856.555880:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.555880:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851856.555881:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8a71053 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5a3d8716-2af6-49b9-a719-c3558db80ed1+6:39830:x1858041824971776:12345-10546@kfi7:400:default-tuolumne1145-0
00000100:00000200:10.0:1773851856.555883:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041824971776
00000020:00000001:10.0:1773851856.555883:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851856.555884:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851856.555885:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.555886:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851856.555886:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851856.555887:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851856.555888:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041824971776, found 0 last_xid 1858041824971775
00000020:00000001:10.0:1773851856.555889:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851856.555889:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851856.555890:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851856.555891:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.555892:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851856.555892:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851856.555893:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851856.555894:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000042c552e4.
02000000:00000001:10.0:1773851856.555895:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.555895:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.555896:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851856.555897:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689446, transno 0, xid 1858041824971776
00010000:00000001:10.0:1773851856.555898:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851856.555899:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a8a71053 x1858041824971776/t0(0) o400->5a3d8716-2af6-49b9-a719-c3558db80ed1@10546@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1145-0'
00010000:00000001:10.0:1773851856.555901:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851856.555902:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851856.555902:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=89 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851856.555904:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851856.555904:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000af9277f8 refcount 3 to 10546@kfi7
00000100:00000001:10.0:1773851856.555905:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603211040 : -107155106340576 : ffff9e8b01f36120)
02000000:00000001:10.0:1773851856.555906:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851856.555906:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.555907:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851856.555908:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10547@kfi7
00000400:00000010:10.0:1773851856.555909:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004a7d4940.
00000100:00000200:10.0:1773851856.555910:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041824971776, offset 224
00000400:00000200:10.0:1773851856.555911:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10547@kfi7
00000400:00000200:10.0:1773851856.555912:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10547@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.555913:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8374a9f nid 10547@kfi7 refs 1
00000400:00000200:10.0:1773851856.555914:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a8374a9f nid 10547@kfi7 refs 2
00000400:00000200:10.0:1773851856.555915:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a8374a9f nid 10547@kfi7 refs 3
00000400:00000200:10.0:1773851856.555916:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10547@kfi7 local destination
00000400:00000200:10.0:1773851856.555918:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768688:8768688:1024:4294967295] 10547@kfi7 LPNI seq info [6616265:6616265:16:4294967295]
00000400:00000200:10.0:1773851856.555919:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a8374a9f nid 10547@kfi7 refs 2
00000400:00000200:10.0:1773851856.555920:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10547@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.555922:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10547@kfi7(10547@kfi7:10547@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851856.555923:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a8374a9f nid 10547@kfi7 refs 3
00000800:00000200:10.0:1773851856.555925:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851856.555926:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851856.555929:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851856.555931:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000cd5 Using peer 10547@kfi7(0x100000000000cd5)
00000800:00000200:10.0:1773851856.555935:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000348da31e: Posted send of 324 bytes to peer 0x100000000000cd5: rc=0
00000800:00000200:10.0:1773851856.555936:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000cd5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851856.555938:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.555939:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000af9277f8 refcount 2 to 10546@kfi7
00010000:00000001:10.0:1773851856.555940:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851856.555941:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.555942:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851856.555943:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a8a71053 x1858041824971776/t0(0) o400->5a3d8716-2af6-49b9-a719-c3558db80ed1@10546@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1145-0'
00000100:00100000:10.0:1773851856.555946:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8a71053 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5a3d8716-2af6-49b9-a719-c3558db80ed1+6:39830:x1858041824971776:12345-10546@kfi7:400:default-tuolumne1145-0 Request processed in 65us (100us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851856.555948:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10546@kfi7, seq: 2130730
00000800:00000200:9.0:1773851856.555948:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000cd5 TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851856.555949:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000004c0bfa0 : new rpc_count 0
00000100:00000001:10.0:1773851856.555950:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851856.555950:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851856.555951:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851856.555951:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000065d1028a.
00000400:00000200:9.0:1773851856.555951:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10547@kfi7: PUT: OK
00000020:00000010:10.0:1773851856.555952:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007aba1bf5.
00000400:00000200:9.0:1773851856.555952:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004a7d4940
00000020:00000010:10.0:1773851856.555953:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000014daa50c.
00000400:00000010:9.0:1773851856.555953:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004a7d4940.
00000100:00000001:9.0:1773851856.555953:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:10.0:1773851856.555954:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000004c0bfa0 : new refcount 5
00000100:00000001:10.0:1773851856.555954:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851856.555954:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851856.555955:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8374a9f nid 10547@kfi7 refs 2
00000800:00000200:9.0:1773851856.555956:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 10547@kfi7(00000000c58324e9):0x0 lsk 3286 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000cd5 Transaction freed
00000800:00000200:9.0:1773851856.584084:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.584084:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851856.584086:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851856.584087:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851856.584089:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.584090:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17728@kfi7 : PUT - for me
00000400:00000200:9.0:1773851856.584091:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.584092:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 1
00000400:00000200:9.0:1773851856.584092:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.584093:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000400:00000200:9.0:1773851856.584094:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 3
00000400:00000200:9.0:1773851856.584095:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17729@kfi7 to cpt 5
00000400:00000200:9.0:1773851856.584095:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17729@kfi7 of length 224 into portal 12 MB=0x69b4b5baef840
00000400:00000200:9.0:1773851856.584097:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17729@kfi7 of length 224/224 into md 0x78146ce49 [64] + 121024
00000800:00000200:9.0:1773851856.584099:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851856.584101:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851856.584102:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17728@kfi7: PUT: OK
00000100:00000001:9.0:1773851856.584103:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851856.584103:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851856.584104:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006b201c7c.
00000100:00000040:9.0:1773851856.584104:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006b201c7c x1859597823309888 msgsize 224
00000100:00100000:9.0:1773851856.584106:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17729@kfi7 (source: 12345-17728@kfi7)
00000100:00000001:9.0:1773851856.584107:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851856.584107:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000100:00000001:10.0:1773851856.584108:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851856.584109:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851856.584109:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851856.584110:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851856.584110:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851856.584111:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851856.584111:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597823309888
00000020:00000001:10.0:1773851856.584112:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851856.584112:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81e5c
00000020:00000001:10.0:1773851856.584113:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851856.584115:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b0be8314 refcount=165
00000020:00000001:10.0:1773851856.584115:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131280812032 : -106942428739584 : ffff9ebc86860800)
00000020:00000001:10.0:1773851856.584116:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131280812032 : -106942428739584 : ffff9ebc86860800)
00000100:00000001:10.0:1773851856.584117:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.584117:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851856.584118:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000014daa50c.
00000020:00000010:10.0:1773851856.584118:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000065d1028a.
00000020:00000010:10.0:1773851856.584119:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007aba1bf5.
00000100:00000001:10.0:1773851856.584120:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851856.584120:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851856.584121:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851856.584121:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851856.584122:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851856.584122:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.584123:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851856.584124:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851856.584124:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851856.584125:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.584125:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851856.584125:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17729@kfi7, seq: 2130731
00000100:00000001:11.0:1773851856.584126:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.584126:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b0be8314 : new rpc_count 1
00000100:00000001:11.0:1773851856.584127:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.584127:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064877568 : -106983644674048 : ffff9eb2eddcc800)
00000100:00000040:10.0:1773851856.584128:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006b201c7c x1859597823309888/t0(0) o400->3761013e-3503-4a7d-ad92-4b3a0f692635@17729@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1604-0'
00000100:00000001:10.0:1773851856.584130:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.584131:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851856.584131:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b201c7c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3761013e-3503-4a7d-ad92-4b3a0f692635+165:39690:x1859597823309888:12345-17729@kfi7:400:default-tuolumne1604-0
00000100:00000200:10.0:1773851856.584134:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597823309888
00000020:00000001:10.0:1773851856.584135:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851856.584136:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851856.584136:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.584137:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851856.584137:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851856.584138:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851856.584139:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597823309888, found 0 last_xid 1859597822889663
00000020:00000001:10.0:1773851856.584140:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851856.584140:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851856.584141:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851856.584141:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.584141:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851856.584142:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851856.584142:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851856.584143:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005eec6f95.
02000000:00000001:10.0:1773851856.584144:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.584144:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.584145:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851856.584145:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062127, transno 0, xid 1859597823309888
00010000:00000001:10.0:1773851856.584146:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851856.584147:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006b201c7c x1859597823309888/t0(0) o400->3761013e-3503-4a7d-ad92-4b3a0f692635@17729@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1604-0'
00010000:00000001:10.0:1773851856.584149:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851856.584150:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851856.584150:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=89 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851856.584151:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851856.584152:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007776ad29 refcount 3 to 17729@kfi7
00000100:00000001:10.0:1773851856.584152:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424336768 : -107145285214848 : ffff9e8d4b55dd80)
02000000:00000001:10.0:1773851856.584153:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851856.584154:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.584154:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851856.584155:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17728@kfi7
00000400:00000010:10.0:1773851856.584155:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004a7d4940.
00000100:00000200:10.0:1773851856.584156:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597823309888, offset 224
00000400:00000200:10.0:1773851856.584158:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17728@kfi7
00000400:00000200:10.0:1773851856.584158:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.584159:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 1
00000400:00000200:10.0:1773851856.584160:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000400:00000200:10.0:1773851856.584161:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 3
00000400:00000200:10.0:1773851856.584162:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17728@kfi7 local destination
00000400:00000200:10.0:1773851856.584164:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768689:8768689:1024:4294967295] 17728@kfi7 LPNI seq info [353910:353910:16:4294967295]
00000400:00000200:10.0:1773851856.584165:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000400:00000200:10.0:1773851856.584166:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.584167:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17728@kfi7(17728@kfi7:17728@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851856.584168:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 3
00000800:00000200:10.0:1773851856.584170:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851856.584171:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851856.584173:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851856.584175:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x34d Using peer 17728@kfi7(0x34d)
00000800:00000200:10.0:1773851856.584178:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000005269f40f: Posted send of 324 bytes to peer 0x34d: rc=0
00000800:00000200:10.0:1773851856.584179:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x34d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851856.584181:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.584182:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007776ad29 refcount 2 to 17729@kfi7
00010000:00000001:10.0:1773851856.584182:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851856.584183:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.584183:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851856.584184:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006b201c7c x1859597823309888/t0(0) o400->3761013e-3503-4a7d-ad92-4b3a0f692635@17729@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1604-0'
00000100:00100000:10.0:1773851856.584187:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b201c7c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3761013e-3503-4a7d-ad92-4b3a0f692635+165:39690:x1859597823309888:12345-17729@kfi7:400:default-tuolumne1604-0 Request processed in 56us (82us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851856.584189:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17729@kfi7, seq: 2130731
00000100:00000040:10.0:1773851856.584190:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b0be8314 : new rpc_count 0
00000800:00000200:9.0:1773851856.584190:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x34d TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851856.584191:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851856.584191:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851856.584191:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851856.584192:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000065d1028a.
00000020:00000010:10.0:1773851856.584192:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007aba1bf5.
00000400:00000200:9.0:1773851856.584192:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17728@kfi7: PUT: OK
00000020:00000010:10.0:1773851856.584193:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000014daa50c.
00000400:00000200:9.0:1773851856.584193:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004a7d4940
00000400:00000010:9.0:1773851856.584193:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004a7d4940.
00000020:00000040:10.0:1773851856.584194:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000b0be8314 : new refcount 164
00000100:00000001:10.0:1773851856.584194:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851856.584194:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851856.584194:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851856.584195:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000800:00000200:9.0:1773851856.584196:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 17728@kfi7(00000000cda6e81b):0x0 lsk 846 rsk 40 tsk 0 trmk 0 tmk 0 trr 2 tta 0x34d Transaction freed
00000800:00000200:3.0:1773851856.622905:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851856.622906:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851856.622907:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851856.622909:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851856.622911:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25155@kfi7 to cpt 0
00000400:00000200:3.0:1773851856.622912:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25155@kfi7 : PUT - for me
00000400:00000200:3.0:1773851856.622913:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25155@kfi7 to cpt 0
00000400:00000200:3.0:1773851856.622913:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c129b87 nid 25155@kfi7 refs 1
00000400:00000200:3.0:1773851856.622914:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25155@kfi7 to cpt 0
00000400:00000200:3.0:1773851856.622915:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c129b87 nid 25155@kfi7 refs 2
00000400:00000200:3.0:1773851856.622917:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000c129b87 nid 25155@kfi7 refs 3
00000400:00000200:3.0:1773851856.622917:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25154@kfi7 to cpt 5
00000400:00000200:3.0:1773851856.622918:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25154@kfi7 of length 224 into portal 12 MB=0x69b8a7ae12cc0
00000400:00000200:3.0:1773851856.622919:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25154@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 14688
00000800:00000200:3.0:1773851856.622921:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851856.622922:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851856.622924:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25155@kfi7: PUT: OK
00000100:00000001:3.0:1773851856.622925:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851856.622925:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851856.622926:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f7e93dd.
00000100:00000040:3.0:1773851856.622926:0:2506738:0:(events.c:358:request_in_callback()) incoming req@000000008f7e93dd x1859868929633472 msgsize 224
00000100:00100000:3.0:1773851856.622927:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-25154@kfi7 (source: 12345-25155@kfi7)
00000100:00000001:3.0:1773851856.622928:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851856.622929:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000c129b87 nid 25155@kfi7 refs 2
00000800:00000200:3.0:1773851856.622930:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851856.622930:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851856.622930:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851856.622931:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851856.622931:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851856.622932:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851856.622933:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859868929633472
00000020:00000001:1.0:1773851856.622933:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851856.622934:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0896ed09fd0
00000020:00000001:1.0:1773851856.622934:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851856.622936:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8c53dd7 refcount=1567
00000020:00000001:1.0:1773851856.622937:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636984868131840 : -107088841419776 : ffff9e9a6fa5d400)
00000020:00000001:1.0:1773851856.622937:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636984868131840 : -107088841419776 : ffff9e9a6fa5d400)
00000100:00000001:1.0:1773851856.622938:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851856.622939:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851856.622940:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab5a0507.
00000020:00000010:1.0:1773851856.622941:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851856.622941:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c1799ca9.
00000100:00000001:1.0:1773851856.622942:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851856.622943:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851856.622943:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.622944:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851856.622944:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851856.622945:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.622946:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851856.622947:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851856.622947:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.622948:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851856.622948:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851856.622949:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25154@kfi7, seq: 1997498
00000100:00000001:1.0:1773851856.622950:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851856.622950:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851856.622950:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8c53dd7 : new rpc_count 7
00000100:00000001:0.0:1773851856.622950:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288713984 : -106964420837632 : ffff9eb767b13f00)
00000100:00000040:0.0:1773851856.622952:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008f7e93dd x1859868929633472/t0(0) o400->e7d87eca-5b15-4c5d-99a5-e4bddb77bf34@25154@kfi7:496/0 lens 224/0 e 0 to 0 dl 1773852611 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2072-0'
00000100:00000001:0.0:1773851856.622955:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851856.622955:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851856.622956:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f7e93dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:e7d87eca-5b15-4c5d-99a5-e4bddb77bf34+1567:39922:x1859868929633472:12345-25154@kfi7:400:default-tuolumne2072-0
00000100:00000200:0.0:1773851856.622957:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859868929633472
00000020:00000001:0.0:1773851856.622958:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851856.622959:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851856.622959:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.622960:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851856.622960:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851856.622961:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851856.622962:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859868929633472, found 0 last_xid 1859868928909439
00000020:00000001:0.0:1773851856.622963:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851856.622963:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851856.622964:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851856.622964:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.622965:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851856.622965:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851856.622966:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851856.622967:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000911a4077.
02000000:00000001:0.0:1773851856.622967:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.622968:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.622969:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851856.622969:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593183, transno 0, xid 1859868929633472
00010000:00000001:0.0:1773851856.622970:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851856.622971:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008f7e93dd x1859868929633472/t0(0) o400->e7d87eca-5b15-4c5d-99a5-e4bddb77bf34@25154@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2072-0'
00010000:00000001:0.0:1773851856.622973:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851856.622974:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851856.622974:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=89 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851856.622975:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851856.622976:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000914ad73e refcount 3 to 25154@kfi7
00000100:00000001:0.0:1773851856.622977:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027296 : -107156745524320 : ffff9e8aa03f6ba0)
02000000:00000001:0.0:1773851856.622977:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851856.622978:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.622979:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851856.622980:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25155@kfi7
00000400:00000010:0.0:1773851856.622981:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c05e23f.
00000100:00000200:0.0:1773851856.622981:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859868929633472, offset 224
00000400:00000200:0.0:1773851856.622983:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25155@kfi7
00000400:00000200:0.0:1773851856.622984:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25155@kfi7 to cpt 0
00000400:00000200:0.0:1773851856.622985:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c129b87 nid 25155@kfi7 refs 1
00000400:00000200:0.0:1773851856.622986:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000c129b87 nid 25155@kfi7 refs 2
00000400:00000200:0.0:1773851856.622987:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000c129b87 nid 25155@kfi7 refs 3
00000400:00000200:0.0:1773851856.622989:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25155@kfi7 local destination
00000400:00000200:0.0:1773851856.622990:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768690:8768690:1024:4294967295] 25155@kfi7 LPNI seq info [11055740:11055740:16:4294967295]
00000400:00000200:0.0:1773851856.622992:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000c129b87 nid 25155@kfi7 refs 2
00000400:00000200:0.0:1773851856.622992:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25155@kfi7 to cpt 0
00000400:00000200:0.0:1773851856.622994:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25155@kfi7(25155@kfi7:25155@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851856.622995:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000c129b87 nid 25155@kfi7 refs 3
00000800:00000200:0.0:1773851856.622997:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851856.622998:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851856.623000:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851856.623002:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a81 Using peer 25155@kfi7(0x100000000000a81)
00000800:00000200:0.0:1773851856.623005:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x100000000000a81: rc=0
00000800:00000200:0.0:1773851856.623006:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a81 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851856.623008:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851856.623009:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000914ad73e refcount 2 to 25154@kfi7
00010000:00000001:0.0:1773851856.623009:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851856.623010:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.623010:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851856.623011:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f7e93dd x1859868929633472/t0(0) o400->e7d87eca-5b15-4c5d-99a5-e4bddb77bf34@25154@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2072-0'
00000100:00100000:0.0:1773851856.623016:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f7e93dd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:e7d87eca-5b15-4c5d-99a5-e4bddb77bf34+1567:39922:x1859868929633472:12345-25154@kfi7:400:default-tuolumne2072-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851856.623018:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25154@kfi7, seq: 1997498
00000100:00000040:0.0:1773851856.623019:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8c53dd7 : new rpc_count 6
00000100:00000001:0.0:1773851856.623019:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851856.623020:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851856.623020:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:0.0:1773851856.623021:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c1799ca9.
00000020:00000010:0.0:1773851856.623022:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab5a0507.
00000020:00000040:0.0:1773851856.623023:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000c8c53dd7 : new refcount 1566
00000100:00000001:0.0:1773851856.623024:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851856.623029:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a81 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851856.623030:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851856.623032:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25155@kfi7: PUT: OK
00000400:00000200:1.0:1773851856.623032:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c05e23f
00000400:00000010:1.0:1773851856.623033:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c05e23f.
00000100:00000001:1.0:1773851856.623034:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851856.623034:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851856.623035:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000c129b87 nid 25155@kfi7 refs 2
00000800:00000200:1.0:1773851856.623037:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 25155@kfi7(00000000c07683d6):0x0 lsk 2690 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a81 Transaction freed
00000800:00000200:17.0:1773851856.628586:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851856.628587:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851856.628588:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851856.628591:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851856.628593:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21059@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.628594:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21059@kfi7 : PUT - for me
00000400:00000200:17.0:1773851856.628596:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21059@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.628597:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000097dfbb7 nid 21059@kfi7 refs 1
00000400:00000200:17.0:1773851856.628598:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21059@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.628599:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000097dfbb7 nid 21059@kfi7 refs 2
00000400:00000200:17.0:1773851856.628600:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000097dfbb7 nid 21059@kfi7 refs 3
00000400:00000200:17.0:1773851856.628601:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21058@kfi7 to cpt 1
00000400:00000200:17.0:1773851856.628602:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21058@kfi7 of length 224 into portal 12 MB=0x69b0958077000
00000400:00000200:17.0:1773851856.628604:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21058@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 190752
00000800:00000200:17.0:1773851856.628606:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851856.628608:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.628609:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21059@kfi7: PUT: OK
00000100:00000001:17.0:1773851856.628610:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851856.628611:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851856.628612:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000094e0f615.
00000100:00000040:17.0:1773851856.628613:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000094e0f615 x1859314294157312 msgsize 224
00000100:00100000:17.0:1773851856.628615:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21058@kfi7 (source: 12345-21059@kfi7)
00000100:00000001:17.0:1773851856.628616:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851856.628617:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000097dfbb7 nid 21059@kfi7 refs 2
00000100:00000001:18.0:1773851856.628618:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851856.628619:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851856.628619:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851856.628619:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851856.628620:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851856.628621:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851856.628622:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314294157312
00000020:00000001:18.0:1773851856.628623:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851856.628623:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bcf
00000020:00000001:18.0:1773851856.628624:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851856.628627:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f1d14e2e refcount=6
00000020:00000001:18.0:1773851856.628628:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743951360 : -107128965600256 : ffff9e91180f6c00)
00000020:00000001:18.0:1773851856.628629:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743951360 : -107128965600256 : ffff9e91180f6c00)
00000100:00000001:18.0:1773851856.628630:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.628631:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851856.628632:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003da7790a.
00000020:00000010:18.0:1773851856.628633:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851856.628634:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851856.628635:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851856.628636:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851856.628637:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851856.628638:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851856.628639:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851856.628639:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.628640:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851856.628642:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851856.628643:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851856.628643:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851856.628643:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851856.628644:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21058@kfi7, seq: 2156264
00000100:00000040:19.0:1773851856.628645:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f1d14e2e : new rpc_count 1
00000100:00000001:18.0:1773851856.628645:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.628646:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405310336 : -106994304241280 : ffff9eb07280b180)
00000100:00000001:18.0:1773851856.628646:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851856.628647:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000094e0f615 x1859314294157312/t0(0) o400->1e5af699-d828-4042-a479-a06f75f07da8@21058@kfi7:46/0 lens 224/0 e 0 to 0 dl 1773852161 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1816-0'
00000100:00000001:19.0:1773851856.628651:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851856.628651:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851856.628652:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094e0f615 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1e5af699-d828-4042-a479-a06f75f07da8+6:39593:x1859314294157312:12345-21058@kfi7:400:default-tuolumne1816-0
00000100:00000200:19.0:1773851856.628656:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314294157312
00000020:00000001:19.0:1773851856.628657:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851856.628657:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851856.628658:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.628659:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851856.628660:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851856.628661:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851856.628661:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314294157312, found 0 last_xid 1859314294157311
00000020:00000001:19.0:1773851856.628662:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851856.628663:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851856.628664:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851856.628664:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.628665:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851856.628666:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851856.628666:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851856.628667:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000380b86f9.
02000000:00000001:19.0:1773851856.628668:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.628668:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.628669:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851856.628670:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044137280, transno 0, xid 1859314294157312
00010000:00000001:19.0:1773851856.628671:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851856.628672:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000094e0f615 x1859314294157312/t0(0) o400->1e5af699-d828-4042-a479-a06f75f07da8@21058@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1816-0'
00010000:00000001:19.0:1773851856.628674:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851856.628675:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851856.628676:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=89 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851856.628677:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851856.628677:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b2688a08 refcount 3 to 21058@kfi7
00000100:00000001:19.0:1773851856.628678:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917806311488 : -107155903240128 : ffff9e8ad273a840)
02000000:00000001:19.0:1773851856.628679:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851856.628679:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.628680:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851856.628681:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21059@kfi7
00000400:00000010:19.0:1773851856.628681:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c937ac03.
00000100:00000200:19.0:1773851856.628682:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314294157312, offset 224
00000400:00000200:19.0:1773851856.628684:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21059@kfi7
00000400:00000200:19.0:1773851856.628685:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21059@kfi7 to cpt 4
00000400:00000200:19.0:1773851856.628685:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000097dfbb7 nid 21059@kfi7 refs 1
00000400:00000200:19.0:1773851856.628686:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000097dfbb7 nid 21059@kfi7 refs 2
00000400:00000200:19.0:1773851856.628687:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000097dfbb7 nid 21059@kfi7 refs 3
00000400:00000200:19.0:1773851856.628688:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21059@kfi7 local destination
00000400:00000200:19.0:1773851856.628690:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768691:8768691:1024:4294967295] 21059@kfi7 LPNI seq info [370838:370838:16:4294967295]
00000400:00000200:19.0:1773851856.628691:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000097dfbb7 nid 21059@kfi7 refs 2
00000400:00000200:19.0:1773851856.628692:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21059@kfi7 to cpt 4
00000400:00000200:19.0:1773851856.628694:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21059@kfi7(21059@kfi7:21059@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851856.628695:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000097dfbb7 nid 21059@kfi7 refs 3
00000800:00000200:19.0:1773851856.628696:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851856.628697:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851856.628699:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851856.628701:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf41 Using peer 21059@kfi7(0xf41)
00000800:00000200:19.0:1773851856.628704:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0xf41: rc=0
00000800:00000200:19.0:1773851856.628705:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf41 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851856.628707:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851856.628708:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b2688a08 refcount 2 to 21058@kfi7
00010000:00000001:19.0:1773851856.628709:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851856.628709:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.628710:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851856.628711:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000094e0f615 x1859314294157312/t0(0) o400->1e5af699-d828-4042-a479-a06f75f07da8@21058@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1816-0'
00000100:00100000:19.0:1773851856.628713:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094e0f615 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1e5af699-d828-4042-a479-a06f75f07da8+6:39593:x1859314294157312:12345-21058@kfi7:400:default-tuolumne1816-0 Request processed in 62us (100us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851856.628716:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21058@kfi7, seq: 2156264
00000100:00000040:19.0:1773851856.628717:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f1d14e2e : new rpc_count 0
00000100:00000001:19.0:1773851856.628717:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851856.628718:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851856.628718:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000800:00000200:17.0:1773851856.628718:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf41 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851856.628719:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000400:00000200:17.0:1773851856.628719:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851856.628720:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003da7790a.
00000400:00000200:17.0:1773851856.628720:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21059@kfi7: PUT: OK
00000020:00000040:19.0:1773851856.628721:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000f1d14e2e : new refcount 5
00000100:00000001:19.0:1773851856.628721:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851856.628721:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c937ac03
00000400:00000010:17.0:1773851856.628722:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c937ac03.
00000100:00000001:17.0:1773851856.628722:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851856.628723:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851856.628724:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000097dfbb7 nid 21059@kfi7 refs 2
00000800:00000200:17.0:1773851856.628730:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 21059@kfi7(00000000968b8df7):0x0 lsk 3906 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf41 Transaction freed
00000800:00000200:7.0:1773851856.660971:0:2507579:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851856.660972:0:2507579:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:7.0:1773851856.660974:0:2507579:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000071e56989: 2054@kfi7:1 <- 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:7.0:1773851856.660978:0:2507579:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000071e56989: 2054@kfi7:1 <- 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:7.0:1773851856.660982:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8227@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.660984:0:2507579:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8227@kfi7 : PUT - for me
00000400:00000200:7.0:1773851856.660985:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8227@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.660987:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158d5966 nid 8227@kfi7 refs 1
00000400:00000200:7.0:1773851856.660988:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8227@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.660989:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158d5966 nid 8227@kfi7 refs 2
00000400:00000200:7.0:1773851856.660991:0:2507579:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000158d5966 nid 8227@kfi7 refs 3
00000400:00000200:7.0:1773851856.660992:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8418@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.660995:0:2507579:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8418@kfi7 of length 224 into portal 12 MB=0x699e546916300
00000400:00000200:7.0:1773851856.660998:0:2507579:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8418@kfi7 of length 224/224 into md 0x793926dc5 [64] + 119368
00000800:00000200:7.0:1773851856.661002:0:2507579:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000071e56989: 2054@kfi7:1 <- 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851856.661005:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851856.661007:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8227@kfi7: PUT: OK
00000100:00000001:7.0:1773851856.661009:0:2507579:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:7.0:1773851856.661010:0:2507579:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:7.0:1773851856.661011:0:2507579:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d41f22fc.
00000100:00000040:7.0:1773851856.661012:0:2507579:0:(events.c:358:request_in_callback()) incoming req@00000000d41f22fc x1858059870757632 msgsize 224
00000100:00100000:7.0:1773851856.661014:0:2507579:0:(events.c:361:request_in_callback()) peer: 12345-8418@kfi7 (source: 12345-8227@kfi7)
00000100:00000001:7.0:1773851856.661017:0:2507579:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:7.0:1773851856.661018:0:2507579:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000158d5966 nid 8227@kfi7 refs 2
00000800:00000200:7.0:1773851856.661021:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000071e56989: 2054@kfi7:1 <- 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851856.661026:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851856.661026:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851856.661027:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851856.661028:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851856.661029:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851856.661030:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059870757632
00000020:00000001:7.0:1773851856.661031:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851856.661032:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b59
00000020:00000001:7.0:1773851856.661033:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851856.661035:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000053620f9b refcount=71
00000020:00000001:7.0:1773851856.661036:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628007936 : -107123081543680 : ffff9e9276c70000)
00000020:00000001:7.0:1773851856.661038:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628007936 : -107123081543680 : ffff9e9276c70000)
00000100:00000001:7.0:1773851856.661039:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851856.661040:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851856.661041:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000020:00000010:7.0:1773851856.661043:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851856.661044:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851856.661046:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851856.661047:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851856.661048:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.661049:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851856.661050:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851856.661051:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.661052:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.661054:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851856.661055:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851856.661056:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851856.661057:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8418@kfi7, seq: 2001856
00000100:00000001:5.0:1773851856.661057:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851856.661058:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000053620f9b : new rpc_count 5
00000100:00000001:5.0:1773851856.661058:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.661059:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079309130496 : -106994400421120 : ffff9eb06cc51b00)
00000100:00000001:5.0:1773851856.661060:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851856.661061:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d41f22fc x1858059870757632/t0(0) o400->9646605e-315e-40de-9602-59f79825227a@8418@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne1003-0'
00000100:00000001:7.0:1773851856.661065:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851856.661066:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851856.661067:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d41f22fc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:9646605e-315e-40de-9602-59f79825227a+71:40656:x1858059870757632:12345-8418@kfi7:400:login-tuolumne1003-0
00000100:00000200:7.0:1773851856.661070:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059870757632
00000020:00000001:7.0:1773851856.661070:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851856.661072:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851856.661073:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.661074:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851856.661074:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851856.661076:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851856.661077:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858059870757632, found 0 last_xid 1858059854489791
00000020:00000001:7.0:1773851856.661078:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851856.661079:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851856.661080:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851856.661081:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.661082:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851856.661082:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851856.661083:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851856.661084:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007144015e.
02000000:00000001:7.0:1773851856.661085:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.661087:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.661088:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851856.661089:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261790685, transno 0, xid 1858059870757632
00010000:00000001:7.0:1773851856.661090:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851856.661091:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d41f22fc x1858059870757632/t0(0) o400->9646605e-315e-40de-9602-59f79825227a@8418@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1003-0'
00010000:00000001:7.0:1773851856.661096:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851856.661097:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851856.661098:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=88 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851856.661099:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851856.661100:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e81bfd0 refcount 3 to 8418@kfi7
00000100:00000001:7.0:1773851856.661102:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612128 : -107130477939488 : ffff9e90bdeaf4e0)
02000000:00000001:7.0:1773851856.661103:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851856.661104:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.661105:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851856.661106:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8227@kfi7
00000400:00000010:7.0:1773851856.661107:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c74d75.
00000100:00000200:7.0:1773851856.661108:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858059870757632, offset 224
00000400:00000200:7.0:1773851856.661110:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8227@kfi7
00000400:00000200:7.0:1773851856.661111:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8227@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.661112:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158d5966 nid 8227@kfi7 refs 1
00000400:00000200:7.0:1773851856.661114:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000158d5966 nid 8227@kfi7 refs 2
00000400:00000200:7.0:1773851856.661116:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000158d5966 nid 8227@kfi7 refs 3
00000400:00000200:7.0:1773851856.661117:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8227@kfi7 local destination
00000400:00000200:7.0:1773851856.661120:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768692:8768692:1024:4294967295] 8227@kfi7 LPNI seq info [28126777:28126777:16:4294967295]
00000400:00000200:7.0:1773851856.661122:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000158d5966 nid 8227@kfi7 refs 2
00000400:00000200:7.0:1773851856.661123:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8227@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.661126:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8227@kfi7(8227@kfi7:8227@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851856.661128:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000158d5966 nid 8227@kfi7 refs 3
00000800:00000200:7.0:1773851856.661130:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851856.661132:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851856.661138:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851856.661142:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1400000000000b20 Using peer 8227@kfi7(0x1400000000000b20)
00000800:00000200:7.0:1773851856.661146:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x1400000000000b20: rc=0
00000800:00000200:7.0:1773851856.661149:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1400000000000b20 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851856.661152:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851856.661153:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e81bfd0 refcount 2 to 8418@kfi7
00010000:00000001:7.0:1773851856.661154:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851856.661155:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.661156:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851856.661157:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d41f22fc x1858059870757632/t0(0) o400->9646605e-315e-40de-9602-59f79825227a@8418@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1003-0'
00000100:00100000:7.0:1773851856.661162:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d41f22fc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:9646605e-315e-40de-9602-59f79825227a+71:40656:x1858059870757632:12345-8418@kfi7:400:login-tuolumne1003-0 Request processed in 96us (149us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851856.661164:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1400000000000b20 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851856.661166:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8418@kfi7, seq: 2001856
00000100:00000040:7.0:1773851856.661167:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000053620f9b : new rpc_count 4
00000100:00000001:7.0:1773851856.661168:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851856.661168:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851856.661169:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851856.661170:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851856.661170:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8227@kfi7: PUT: OK
00000020:00000010:7.0:1773851856.661171:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000020:00000010:7.0:1773851856.661172:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000400:00000200:5.0:1773851856.661172:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c74d75
00000020:00000040:7.0:1773851856.661173:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000053620f9b : new refcount 70
00000400:00000010:5.0:1773851856.661173:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c74d75.
00000100:00000001:7.0:1773851856.661174:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851856.661175:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851856.661175:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851856.661177:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000158d5966 nid 8227@kfi7 refs 2
00000800:00000200:5.0:1773851856.661180:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8227@kfi7(000000004d9cf7ee):0x0 lsk 2849 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1400000000000b20 Transaction freed
00000800:00000200:21.0:1773851856.670255:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851856.670256:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851856.670256:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851856.670257:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851856.670257:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851856.670258:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851856.670259:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16352@kfi7(000000008acbdbfe):0x5cb version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851856.670261:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851856.670261:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb Using peer 16352@kfi7(0x1000000000005cb)
00000400:00000200:21.0:1773851856.670263:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16352@kfi7 to cpt 5
00000400:00000200:22.0:1773851856.670264:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16352@kfi7 to cpt 5
00000400:00000200:22.0:1773851856.670265:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16352@kfi7 : PUT - for me
00000800:00000200:21.0:1773851856.670265:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000184df75a: Posted send of 38 bytes to peer 0x1000000000005cb: rc=0
00000400:00000200:22.0:1773851856.670267:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16352@kfi7 to cpt 5
00000800:00000200:21.0:1773851856.670267:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851856.670268:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000702b0181 nid 16352@kfi7 refs 1
00000400:00000200:22.0:1773851856.670269:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16352@kfi7 to cpt 5
00000400:00000200:22.0:1773851856.670270:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000702b0181 nid 16352@kfi7 refs 2
00000400:00000200:22.0:1773851856.670271:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000702b0181 nid 16352@kfi7 refs 3
00000400:00000200:22.0:1773851856.670272:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16352@kfi7 to cpt 5
00000400:00000200:22.0:1773851856.670274:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16352@kfi7 of length 224 into portal 12 MB=0x69b4b586b9180
00000400:00000200:22.0:1773851856.670275:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16352@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 25608
00000800:00000200:22.0:1773851856.670278:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851856.670278:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851856.670280:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851856.670280:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb Transaction freed
00000400:00000200:22.0:1773851856.670281:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16352@kfi7: PUT: OK
00000100:00000001:22.0:1773851856.670282:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851856.670283:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851856.670284:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a24325cd.
00000100:00000040:22.0:1773851856.670285:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000a24325cd x1859597768561024 msgsize 224
00000100:00100000:22.0:1773851856.670287:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-16352@kfi7 (source: 12345-16352@kfi7)
00000100:00000001:22.0:1773851856.670288:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851856.670289:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000702b0181 nid 16352@kfi7 refs 2
00000100:00000001:23.0:1773851856.670291:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:22.0:1773851856.670291:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfc5a5ad: 2054@kfi7:5 <- 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851856.670292:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851856.670292:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851856.670293:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851856.670295:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851856.670296:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597768561024
00000020:00000001:23.0:1773851856.670297:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851856.670297:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a3a
00000020:00000001:23.0:1773851856.670298:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851856.670303:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ff82485 refcount=166
00000020:00000001:23.0:1773851856.670304:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165079547904 : -106908630003712 : ffff9ec46515d000)
00000020:00000001:23.0:1773851856.670305:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165079547904 : -106908630003712 : ffff9ec46515d000)
00000100:00000001:23.0:1773851856.670307:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851856.670308:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851856.670309:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab1b10d5.
00000020:00000010:23.0:1773851856.670311:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851856.670312:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851856.670313:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851856.670314:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851856.670315:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851856.670317:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851856.670317:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851856.670318:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851856.670319:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851856.670321:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851856.670321:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851856.670322:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851856.670322:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851856.670323:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16352@kfi7, seq: 1997933
00000100:00000001:23.0:1773851856.670324:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851856.670324:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ff82485 : new rpc_count 1
00000100:00000001:23.0:1773851856.670325:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851856.670325:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619612800 : -107003089938816 : ffff9eae66d59680)
00000100:00000040:22.0:1773851856.670326:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a24325cd x1859597768561024/t0(0) o400->37aec047-b314-4020-9e03-3f6239e2ff0c@16352@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1503-0'
00000100:00000001:22.0:1773851856.670330:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851856.670330:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851856.670331:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a24325cd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:37aec047-b314-4020-9e03-3f6239e2ff0c+166:39713:x1859597768561024:12345-16352@kfi7:400:default-tuolumne1503-0
00000100:00000200:22.0:1773851856.670333:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597768561024
00000020:00000001:22.0:1773851856.670334:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851856.670335:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851856.670335:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851856.670336:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851856.670337:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851856.670338:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851856.670339:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597768561024, found 0 last_xid 1859597768140927
00000020:00000001:22.0:1773851856.670340:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851856.670340:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851856.670341:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851856.670342:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851856.670342:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851856.670343:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851856.670344:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851856.670345:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2b41301.
02000000:00000001:22.0:1773851856.670346:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851856.670347:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851856.670347:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851856.670348:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061902, transno 0, xid 1859597768561024
00010000:00000001:22.0:1773851856.670349:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851856.670350:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a24325cd x1859597768561024/t0(0) o400->37aec047-b314-4020-9e03-3f6239e2ff0c@16352@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1503-0'
00010000:00000001:22.0:1773851856.670352:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851856.670353:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851856.670354:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=89 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851856.670355:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851856.670355:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b4de2e53 refcount 3 to 16352@kfi7
00000100:00000001:22.0:1773851856.670357:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956271296 : -107146753280320 : ffff9e8cf3d4f6c0)
02000000:00000001:22.0:1773851856.670358:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851856.670358:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851856.670359:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851856.670360:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16352@kfi7
00000400:00000010:22.0:1773851856.670361:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004529803e.
00000100:00000200:22.0:1773851856.670362:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597768561024, offset 224
00000400:00000200:22.0:1773851856.670363:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16352@kfi7
00000400:00000200:22.0:1773851856.670364:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16352@kfi7 to cpt 5
00000400:00000200:22.0:1773851856.670365:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000702b0181 nid 16352@kfi7 refs 1
00000400:00000200:22.0:1773851856.670366:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000702b0181 nid 16352@kfi7 refs 2
00000400:00000200:22.0:1773851856.670368:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000702b0181 nid 16352@kfi7 refs 3
00000400:00000200:22.0:1773851856.670369:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16352@kfi7 local destination
00000400:00000200:22.0:1773851856.670371:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768693:8768693:1024:4294967295] 16352@kfi7 LPNI seq info [264311:264311:16:4294967295]
00000400:00000200:22.0:1773851856.670372:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000702b0181 nid 16352@kfi7 refs 2
00000400:00000200:22.0:1773851856.670373:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16352@kfi7 to cpt 5
00000400:00000200:22.0:1773851856.670375:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16352@kfi7(16352@kfi7:16352@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851856.670377:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000702b0181 nid 16352@kfi7 refs 3
00000800:00000200:22.0:1773851856.670378:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851856.670379:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851856.670381:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851856.670384:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb Using peer 16352@kfi7(0x1000000000005cb)
00000800:00000200:22.0:1773851856.670387:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000bfc5a5ad: Posted send of 324 bytes to peer 0x1000000000005cb: rc=0
00000800:00000200:22.0:1773851856.670389:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851856.670391:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851856.670392:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b4de2e53 refcount 2 to 16352@kfi7
00010000:00000001:22.0:1773851856.670392:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851856.670393:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851856.670394:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851856.670394:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a24325cd x1859597768561024/t0(0) o400->37aec047-b314-4020-9e03-3f6239e2ff0c@16352@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1503-0'
00000100:00100000:22.0:1773851856.670398:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a24325cd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:37aec047-b314-4020-9e03-3f6239e2ff0c+166:39713:x1859597768561024:12345-16352@kfi7:400:default-tuolumne1503-0 Request processed in 67us (112us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851856.670400:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16352@kfi7, seq: 1997933
00000800:00000200:21.0:1773851856.670400:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb TN_EVENT_TX_OK event status 0
00000100:00000040:22.0:1773851856.670401:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ff82485 : new rpc_count 0
00000400:00000200:21.0:1773851856.670401:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851856.670402:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16352@kfi7: PUT: OK
00000100:00000001:22.0:1773851856.670403:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851856.670403:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851856.670403:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004529803e
00000400:00000010:21.0:1773851856.670403:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004529803e.
00000020:00000010:22.0:1773851856.670404:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851856.670404:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851856.670404:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851856.670405:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000400:00000200:21.0:1773851856.670405:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000702b0181 nid 16352@kfi7 refs 2
00000020:00000010:22.0:1773851856.670406:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab1b10d5.
00000800:00000200:21.0:1773851856.670406:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 16352@kfi7(000000008acbdbfe):0x0 lsk 1484 rsk 36 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005cb Transaction freed
00000020:00000040:22.0:1773851856.670407:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000003ff82485 : new refcount 165
00000100:00000001:22.0:1773851856.670407:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851856.713730:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851856.713731:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851856.713732:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061cdc96b.
00000004:00000001:28.0:1773851856.713732:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851856.713732:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:28.0:1773851856.713733:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000014ee1213.
00000004:00000001:8.0:1773851856.713733:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:30.0:1773851856.713734:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000004:00000001:29.0:1773851856.713734:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:28.0:1773851856.713734:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000004:00000020:8.0:1773851856.713734:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851856.713734:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000821d3b26.
00000100:00000001:30.0:1773851856.713735:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:29.0:1773851856.713735:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:28.0:1773851856.713735:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851856.713736:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:29.0:1773851856.713736:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036759c4c.
02000000:00000001:28.0:1773851856.713736:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:8.0:1773851856.713736:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
02000000:00000001:30.0:1773851856.713737:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851856.713737:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
02000000:00000001:28.0:1773851856.713737:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851856.713737:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851856.713737:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:30.0:1773851856.713738:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ce3b9347.
00000100:00000001:29.0:1773851856.713738:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851856.713738:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:28.0:1773851856.713738:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003d9460a0.
02000000:00000001:8.0:1773851856.713738:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.713739:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.713739:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.713740:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:29.0:1773851856.713740:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.713740:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:8.0:1773851856.713740:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:30.0:1773851856.713741:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851856.713741:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
00000100:00000001:28.0:1773851856.713741:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851856.713741:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851856.713742:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851856.713742:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:30.0:1773851856.713743:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000061cdc96b] to pc [ptlrpcd_07_00+0]  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851856.713743:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:28.0:1773851856.713743:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000014ee1213] to pc [ptlrpcd_07_03+3]  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851856.713743:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851856.713744:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851856.713744:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000821d3b26] to pc [ptlrpcd_02_01+1]  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851856.713745:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000036759c4c] to pc [ptlrpcd_07_01+1]  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851856.713750:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:28.0:1773851856.713750:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:8.0:1773851856.713750:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851856.713751:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:30.0:1773851856.713751:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:29.0:1773851856.713751:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851856.713752:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851856.713752:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851856.713752:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c530f7bd.
00080000:00000010:30.0:1773851856.713753:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000009e71bc36.
00080000:00000010:29.0:1773851856.713753:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000079640adb.
00080000:00000010:28.0:1773851856.713753:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000fc661392.
00000100:00000001:10.0:1773851856.713753:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851856.713753:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:8.0:1773851856.713753:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637129649577984 : -106944059973632 : ffff9ebc254b6000)
00000100:00000040:31.0:1773851856.713754:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851856.713754:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637103493999616 : -106970215552000 : ffff9eb60e4cec00)
00080000:00000001:29.0:1773851856.713754:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637126152792064 : -106947556759552 : ffff9ebb54dea800)
00080000:00000001:28.0:1773851856.713754:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121538416640 : -106952171134976 : ffff9eba41d4e000)
00000100:00000001:10.0:1773851856.713754:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851856.713754:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851856.713754:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:8.0:1773851856.713755:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851856.713756:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851856.713756:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851856.713756:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:9.0:1773851856.713756:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:8.0:1773851856.713756:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00000004:00000010:8.0:1773851856.713757:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000606038cb.
00080000:00000001:30.0:1773851856.713758:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851856.713758:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851856.713758:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:8.0:1773851856.713758:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614131167033864ns, next at 614132167032322ns, rc = 0
00000100:00000001:31.0:1773851856.713759:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:30.0:1773851856.713759:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000004:00001000:29.0:1773851856.713759:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00000004:00001000:28.0:1773851856.713759:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000100:00000001:31.0:1773851856.713760:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:30.0:1773851856.713760:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002e5340fd.
00000004:00000010:29.0:1773851856.713760:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000015492ffe.
00000004:00000010:28.0:1773851856.713760:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d33ea2b1.
00080000:00000001:8.0:1773851856.713760:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:8.0:1773851856.713761:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851856.713761:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851856.713762:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:30.0:1773851856.713762:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614131167037251ns, next at 614132167035568ns, rc = 0
00000004:00080000:29.0:1773851856.713762:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614131167037121ns, next at 614132167035327ns, rc = 0
00000004:00080000:28.0:1773851856.713762:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614131167037101ns, next at 614132167035277ns, rc = 0
00000100:00000001:9.0:1773851856.713762:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:31.0:1773851856.713763:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851856.713763:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851856.713764:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:29.0:1773851856.713764:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851856.713764:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:9.0:1773851856.713764:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:31.0:1773851856.713765:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000014ee1213 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051923776:9@kfi7:13:default-yuba2-0
00080000:00000001:28.0:1773851856.713765:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851856.713766:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851856.713766:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.713767:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:29.0:1773851856.713767:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851856.713767:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851856.713767:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851856.713768:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851856.713768:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000821d3b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051923904:2084@kfi7:13:default-yuba2-0
02000000:00000001:31.0:1773851856.713769:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851856.713770:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851856.713771:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:9.0:1773851856.713771:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851856.713772:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:9.0:1773851856.713772:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:31.0:1773851856.713773:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000022fc6104.
00000100:00000001:30.0:1773851856.713773:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:9.0:1773851856.713773:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.713774:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:9.0:1773851856.713774:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:31.0:1773851856.713775:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851856.713776:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851856.713776:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:9.0:1773851856.713776:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e50c3955.
00000400:00000200:31.0:1773851856.713777:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:28.0:1773851856.713777:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851856.713777:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851856.713779:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000200:9.0:1773851856.713779:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000010:9.0:1773851856.713780:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000010:31.0:1773851856.713781:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000001:30.0:1773851856.713782:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851856.713782:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:9.0:1773851856.713782:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000200:31.0:1773851856.713783:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923776, portal 4
00000100:00000001:30.0:1773851856.713783:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.713783:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851856.713784:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851856.713784:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000200:9.0:1773851856.713784:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923904, portal 4
00000100:00000001:31.0:1773851856.713785:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324228992 : -106976385322624 : ffff9eb49e8db180)
02000000:00000001:30.0:1773851856.713785:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:28.0:1773851856.713785:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851856.713785:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:30.0:1773851856.713786:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851856.713786:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491251712 : -107117218299904 : ffff9e93d4410000)
00000100:00000040:31.0:1773851856.713788:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:30.0:1773851856.713788:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051923840:2104@kfi7:13:default-yuba2-0
00000100:00000040:9.0:1773851856.713789:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851856.713790:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:28.0:1773851856.713790:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851856.713791:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851856.713792:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:31.0:1773851856.713793:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:30.0:1773851856.713793:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851856.713793:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:30.0:1773851856.713794:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:28.0:1773851856.713794:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851856.713794:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851856.713795:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:31.0:1773851856.713796:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018a1fff7.
02000000:00000010:30.0:1773851856.713796:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e7dccfaa.
00000100:00100000:28.0:1773851856.713796:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000036759c4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051923968:47@kfi7:13:default-yuba2-0
00000100:00000040:9.0:1773851856.713796:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
02000000:00000001:30.0:1773851856.713797:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851856.713797:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa4a0339.
00000100:00000200:31.0:1773851856.713798:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923776, offset 0
00000100:00000200:9.0:1773851856.713798:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923904, offset 0
00000100:00000001:28.0:1773851856.713799:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:30.0:1773851856.713800:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
02000000:00000001:28.0:1773851856.713800:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:31.0:1773851856.713801:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000400:00000010:30.0:1773851856.713801:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
02000000:00000001:28.0:1773851856.713801:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851856.713801:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
02000000:00000001:28.0:1773851856.713802:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:31.0:1773851856.713803:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:30.0:1773851856.713803:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000400:00000200:9.0:1773851856.713803:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
02000000:00000010:28.0:1773851856.713804:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001529c0f6.
00000400:00000200:31.0:1773851856.713805:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000200:30.0:1773851856.713805:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923840, portal 4
02000000:00000001:28.0:1773851856.713805:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851856.713805:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:31.0:1773851856.713807:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:30.0:1773851856.713807:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:9.0:1773851856.713807:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:30.0:1773851856.713808:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832828032 : -106933876723584 : ffff9ebe84437080)
00000400:00000200:31.0:1773851856.713810:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000040:30.0:1773851856.713810:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851856.713810:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:9.0:1773851856.713812:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000200:31.0:1773851856.713813:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000100:00000001:30.0:1773851856.713815:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851856.713815:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768691, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768693, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851856.713817:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768691, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768693, p:4294967295, g:4294967295, h:1000]
00000100:00000040:30.0:1773851856.713817:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:30.0:1773851856.713818:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007d5ec24f.
00000100:00000200:30.0:1773851856.713819:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923840, offset 0
00000400:00000200:9.0:1773851856.713819:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851856.713821:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851856.713821:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851856.713822:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:9.0:1773851856.713822:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:31.0:1773851856.713823:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851856.713824:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000400:00000200:9.0:1773851856.713825:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768694:8768694:1024:4294967295] 2084@kfi7 LPNI seq info [5402742:5402742:16:4294967295]
00000400:00000200:31.0:1773851856.713826:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768695:8768695:1024:4294967295] 9@kfi7 LPNI seq info [5403006:5403006:16:4294967295]
00000400:00000200:9.0:1773851856.713828:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851856.713829:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:31.0:1773851856.713831:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:9.0:1773851856.713831:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:28.0:1773851856.713833:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000010:28.0:1773851856.713834:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000200:30.0:1773851856.713835:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:31.0:1773851856.713836:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000400:00000010:28.0:1773851856.713836:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df8dec7a.
00000400:00000200:9.0:1773851856.713836:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851856.713837:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000100:00000200:28.0:1773851856.713838:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051923968, portal 4
00000400:00000200:31.0:1773851856.713839:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:30.0:1773851856.713839:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:9.0:1773851856.713839:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000001:28.0:1773851856.713840:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851856.713841:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637125221518720 : -106948488032896 : ffff9ebb1d5c8d80)
00000400:00000200:30.0:1773851856.713842:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000800:00000200:9.0:1773851856.713842:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:31.0:1773851856.713843:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000040:28.0:1773851856.713843:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851856.713844:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000800:00000200:31.0:1773851856.713845:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851856.713845:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851856.713848:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8768695, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768693, p:4294967295, g:4294967295, h:1000]
00000100:00000001:28.0:1773851856.713848:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851856.713849:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000800:00000200:31.0:1773851856.713850:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000010:28.0:1773851856.713850:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032756c42.
00000800:00000200:9.0:1773851856.713850:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851856.713852:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000200:28.0:1773851856.713852:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051923968, offset 0
00000400:00000200:30.0:1773851856.713853:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851856.713854:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000800:00000200:31.0:1773851856.713855:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000400:00000200:30.0:1773851856.713855:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000800:00000200:9.0:1773851856.713855:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Using peer 2084@kfi7(0x103)
00000400:00000200:30.0:1773851856.713857:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768696:8768696:1024:4294967295] 2104@kfi7 LPNI seq info [5403374:5403374:16:4294967295]
00000400:00000200:30.0:1773851856.713860:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:30.0:1773851856.713861:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:31.0:1773851856.713862:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x31e: rc=0
00000800:00000200:9.0:1773851856.713862:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x103: rc=0
00000400:00000200:28.0:1773851856.713863:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:31.0:1773851856.713865:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851856.713865:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000800:00000200:9.0:1773851856.713865:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851856.713866:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851856.713867:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:31.0:1773851856.713869:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851856.713869:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:28.0:1773851856.713869:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000001:9.0:1773851856.713869:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.713870:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851856.713870:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851856.713872:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851856.713872:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:9.0:1773851856.713872:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.713873:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851856.713873:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000100:00000001:9.0:1773851856.713874:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.713875:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851856.713875:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851856.713875:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851856.713876:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8768695, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768696, p:4294967295, g:4294967295, h:1000]
00000800:00000200:10.0:1773851856.713876:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851856.713878:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851856.713878:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851856.713879:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851856.713879:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851856.713880:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:30.0:1773851856.713880:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851856.713880:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:10.0:1773851856.713880:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851856.713880:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851856.713881:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851856.713881:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851856.713882:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851856.713882:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851856.713882:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000001:9.0:1773851856.713882:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.713883:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851856.713883:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000400:00000200:10.0:1773851856.713884:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa4a0339
00000100:00000001:9.0:1773851856.713884:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851856.713885:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000400:00000200:28.0:1773851856.713885:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768697:8768697:1023:4294967295] 47@kfi7 LPNI seq info [5403017:5403017:16:4294967295]
00000400:00000010:10.0:1773851856.713885:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa4a0339.
00000100:00000001:10.0:1773851856.713886:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:28.0:1773851856.713887:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000200:10.0:1773851856.713887:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851856.713889:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:30.0:1773851856.713891:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bc942d61: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
00000800:00000200:30.0:1773851856.713893:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851856.713893:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000100:00000001:10.0:1773851856.713893:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851856.713894:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851856.713896:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000001:30.0:1773851856.713897:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.713898:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851856.713898:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.713899:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.713899:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:30.0:1773851856.713901:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851856.713901:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:30.0:1773851856.713902:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851856.713904:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:10.0:1773851856.713904:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Transaction freed
00000100:00000001:30.0:1773851856.713905:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:29.0:1773851856.713905:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851856.713906:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851856.713907:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851856.713907:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851856.713908:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851856.713908:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851856.713908:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:28.0:1773851856.713908:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:29.0:1773851856.713910:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000800:00000200:28.0:1773851856.713910:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851856.713911:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018a1fff7
00000400:00000200:31.0:1773851856.713912:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:29.0:1773851856.713912:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018a1fff7.
00000100:00000001:29.0:1773851856.713913:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:31.0:1773851856.713914:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000800:00000200:28.0:1773851856.713914:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:29.0:1773851856.713915:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851856.713916:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007d5ec24f
00000400:00000010:31.0:1773851856.713917:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007d5ec24f.
00000100:00000001:31.0:1773851856.713918:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:28.0:1773851856.713918:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000800:00000200:5.0:1773851856.713918:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000200:31.0:1773851856.713919:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851856.713920:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:5.0:1773851856.713920:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:29.0:1773851856.713921:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:26.0:1773851856.713921:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851856.713922:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851856.713922:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:28.0:1773851856.713923:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000100:00000001:31.0:1773851856.713924:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:26.0:1773851856.713924:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:31.0:1773851856.713925:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851856.713925:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851856.713925:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851856.713926:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851856.713928:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:28.0:1773851856.713928:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.713929:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.713929:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851856.713930:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851856.713931:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000800:00000200:26.0:1773851856.713931:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851856.713931:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851856.713932:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:28.0:1773851856.713933:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.713934:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851856.713935:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Transaction freed
00000100:00000001:28.0:1773851856.713935:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851856.713935:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:5.0:1773851856.713935:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:28.0:1773851856.713936:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851856.713937:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:28.0:1773851856.713938:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:26.0:1773851856.713938:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2084@kfi7 : PUT - for me
00000400:00000200:5.0:1773851856.713938:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000100:00000001:28.0:1773851856.713939:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:26.0:1773851856.713940:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:26.0:1773851856.713941:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:5.0:1773851856.713941:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.713942:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000001:28.0:1773851856.713944:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851856.713944:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:28.0:1773851856.713945:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851856.713945:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:5.0:1773851856.713945:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000800:00000200:29.0:1773851856.713946:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851856.713946:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:26.0:1773851856.713947:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:13.0:1773851856.713947:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:29.0:1773851856.713948:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851856.713948:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:26.0:1773851856.713949:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:13.0:1773851856.713949:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851856.713950:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000400:00000200:5.0:1773851856.713950:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:26.0:1773851856.713951:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b25c0
00000800:00000200:13.0:1773851856.713951:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851856.713952:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032756c42
00000400:00000010:29.0:1773851856.713952:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032756c42.
00000400:00000200:5.0:1773851856.713952:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2540
00000100:00000001:29.0:1773851856.713953:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:26.0:1773851856.713953:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:5.0:1773851856.713954:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000200:29.0:1773851856.713955:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851856.713955:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851856.713956:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b81b39 [1] + 224
00000400:00000200:5.0:1773851856.713957:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b30165 [1] + 224
00000400:00000200:13.0:1773851856.713958:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:29.0:1773851856.713959:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851856.713960:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:26.0:1773851856.713960:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.713960:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000800:00000200:5.0:1773851856.713961:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.713962:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:26.0:1773851856.713963:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.713963:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000100:00000001:29.0:1773851856.713964:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851856.713965:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:26.0:1773851856.713965:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000400:00000200:13.0:1773851856.713965:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:5.0:1773851856.713965:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.713966:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:29.0:1773851856.713967:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:13.0:1773851856.713967:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:5.0:1773851856.713967:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000100:00000001:26.0:1773851856.713968:0:2507427:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:29.0:1773851856.713969:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000400:00000200:13.0:1773851856.713969:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:5.0:1773851856.713969:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:26.0:1773851856.713970:0:2507427:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851856.713970:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2580
00000100:00000200:5.0:1773851856.713971:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851856.713972:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.713974:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f578d [1] + 224
00000100:00000040:26.0:1773851856.713975:0:2507427:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851856.713977:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851856.713978:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851856.713981:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:13.0:1773851856.713981:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851856.713982:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851856.713982:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00000001:26.0:1773851856.713983:0:2507427:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:21.0:1773851856.713984:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:13.0:1773851856.713984:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:5.0:1773851856.713984:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:26.0:1773851856.713985:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000200:13.0:1773851856.713986:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851856.713986:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851856.713986:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:31.0:1773851856.713987:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851856.713987:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851856.713988:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:26.0:1773851856.713988:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:21.0:1773851856.713988:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000001:9.0:1773851856.713988:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851856.713989:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851856.713989:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:5.0:1773851856.713989:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851856.713990:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851856.713990:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000400:00000010:31.0:1773851856.713991:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000200:21.0:1773851856.713991:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:9.0:1773851856.713991:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000400:00000200:31.0:1773851856.713992:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000100:00000040:13.0:1773851856.713992:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851856.713992:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000400:00000010:31.0:1773851856.713993:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000400:00000200:21.0:1773851856.713993:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000100:00000001:9.0:1773851856.713994:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851856.713995:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851856.713995:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000200:9.0:1773851856.713996:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851856.713997:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851856.713997:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:21.0:1773851856.713999:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:13.0:1773851856.713999:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851856.714000:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:13.0:1773851856.714000:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000200:31.0:1773851856.714002:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851856.714002:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851856.714002:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851856.714002:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000200:9.0:1773851856.714002:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851856.714003:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851856.714004:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851856.714004:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:21.0:1773851856.714004:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:31.0:1773851856.714006:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:30.0:1773851856.714006:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:21.0:1773851856.714006:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2600
00000100:00000001:9.0:1773851856.714006:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851856.714007:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851856.714007:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000200:21.0:1773851856.714007:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:9.0:1773851856.714007:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851856.714008:0:41091:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:30.0:1773851856.714008:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
02000000:00000001:31.0:1773851856.714009:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851856.714009:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851856.714009:0:41069:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851856.714010:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:30.0:1773851856.714010:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851856.714010:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d0595 [1] + 224
02000000:00000001:9.0:1773851856.714010:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851856.714010:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851856.714011:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851856.714012:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851856.714012:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851856.714013:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851856.714014:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:31.0:1773851856.714015:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=89 v=66 (66 66 66 66)
00000100:00001000:9.0:1773851856.714015:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=89 v=66 (66 66 66 66)
00000100:00000200:30.0:1773851856.714016:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851856.714017:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=10 v=66 (1 1 1 1)
00000400:00000200:21.0:1773851856.714017:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00001000:9.0:1773851856.714017:0:41069:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=89 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851856.714019:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851856.714019:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851856.714019:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000100:00000001:9.0:1773851856.714019:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851856.714020:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.714020:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851856.714020:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851856.714021:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851856.714021:0:41088:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:21.0:1773851856.714021:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:31.0:1773851856.714022:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851856.714022:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00010000:00000001:9.0:1773851856.714022:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851856.714023:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:21.0:1773851856.714023:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:9.0:1773851856.714023:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.714024:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851856.714024:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851856.714024:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851856.714025:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
02000000:00000001:30.0:1773851856.714025:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.714026:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:9.0:1773851856.714026:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000100:00000001:31.0:1773851856.714027:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851856.714027:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=89 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851856.714027:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:31.0:1773851856.714028:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:30.0:1773851856.714028:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=89 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851856.714028:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851856.714029:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851856.714030:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:9.0:1773851856.714030:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851856.714031:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851856.714031:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00010000:00000001:30.0:1773851856.714032:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000800:00000200:5.0:1773851856.714032:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851856.714033:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:30.0:1773851856.714033:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851856.714034:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851856.714034:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000800:00000200:5.0:1773851856.714034:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851856.714035:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851856.714035:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000001:21.0:1773851856.714035:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851856.714035:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:31.0:1773851856.714036:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:30.0:1773851856.714036:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851856.714036:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000040:31.0:1773851856.714037:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000100:00000001:30.0:1773851856.714037:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851856.714037:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:9.0:1773851856.714037:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851856.714038:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851856.714038:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:9.0:1773851856.714038:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000800:00000200:5.0:1773851856.714038:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000004:00000040:31.0:1773851856.714039:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480043520 avail=351478760448 avail_mb=1372963908 hwm_mb=3131101 files=372073201 ffree=343242230 state=0: rc = 0
00000100:00000001:28.0:1773851856.714039:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000040:9.0:1773851856.714039:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000400:00000001:28.0:1773851856.714040:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:21.0:1773851856.714040:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:28.0:1773851856.714041:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000040:9.0:1773851856.714041:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593722880 avail=351576876032 avail_mb=1373347172 hwm_mb=3131103 files=372190120 ffree=343353245 state=0: rc = 0
00000004:00000020:31.0:1773851856.714042:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480043520 free, 351478760448 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073201 files, 343242230 free files
00000400:00000200:5.0:1773851856.714042:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000100:00000001:30.0:1773851856.714043:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:28.0:1773851856.714043:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000001:30.0:1773851856.714044:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:28.0:1773851856.714044:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df8dec7a
00000400:00000010:28.0:1773851856.714044:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df8dec7a.
00000004:00000020:9.0:1773851856.714044:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593722880 free, 351576876032 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190120 files, 343353245 free files
00000400:00000200:5.0:1773851856.714044:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13819@kfi7 : PUT - for me
00000004:00000001:31.0:1773851856.714045:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.714045:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851856.714046:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851856.714046:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851856.714046:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000100:00000040:31.0:1773851856.714047:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:30.0:1773851856.714047:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000100:00000200:28.0:1773851856.714047:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:9.0:1773851856.714047:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851856.714047:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 1
00000004:00000040:30.0:1773851856.714049:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615877120 avail=351613220864 avail_mb=1373489144 hwm_mb=3131103 files=372043518 ffree=343374880 state=0: rc = 0
00000100:00000040:9.0:1773851856.714049:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851856.714049:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.714050:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000100:00100000:31.0:1773851856.714051:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000014ee1213 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051923776:9@kfi7:13:default-yuba2-0
00000400:00000200:5.0:1773851856.714051:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 3
00000004:00000020:30.0:1773851856.714052:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615877120 free, 351613220864 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043518 files, 343374880 free files
00000100:00000200:28.0:1773851856.714052:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851856.714053:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000100:00000001:31.0:1773851856.714054:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:9.0:1773851856.714054:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000821d3b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051923904:2084@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851856.714055:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:30.0:1773851856.714055:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851856.714055:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13819@kfi7 of length 224 into portal 12 MB=0x699de8c317c00
00000100:00000040:31.0:1773851856.714056:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000014ee1213 x1859433051923776/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851856.714056:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851856.714057:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13819@kfi7 of length 224/224 into md 0x793926dc5 [64] + 119592
00000100:00000001:28.0:1773851856.714058:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851856.714058:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851856.714059:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851856.714060:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851856.714060:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851856.714060:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851856.714061:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:30.0:1773851856.714061:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051923840:2104@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851856.714061:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851856.714061:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:5.0:1773851856.714061:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000010:31.0:1773851856.714062:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000022fc6104.
00000100:00000001:28.0:1773851856.714062:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851856.714062:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000821d3b26 x1859433051923904/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851856.714063:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:28.0:1773851856.714063:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851856.714064:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00001000:28.0:1773851856.714064:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=89 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851856.714064:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:31.0:1773851856.714065:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:30.0:1773851856.714065:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000040:31.0:1773851856.714066:0:41091:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000100:00000040:30.0:1773851856.714066:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000061cdc96b x1859433051923840/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:28.0:1773851856.714066:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=89 v=66 (1 1 1 1)
00000400:00000200:5.0:1773851856.714066:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13819@kfi7: PUT: OK
00000020:00000001:31.0:1773851856.714067:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:9.0:1773851856.714067:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000010:31.0:1773851856.714068:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003d9460a0.
00000100:00000001:28.0:1773851856.714068:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851856.714068:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851856.714068:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:5.0:1773851856.714068:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851856.714068:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
02000000:00000001:31.0:1773851856.714069:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:28.0:1773851856.714069:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000010:9.0:1773851856.714069:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e50c3955.
02000000:00000001:31.0:1773851856.714070:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:30.0:1773851856.714070:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00010000:00000001:28.0:1773851856.714070:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851856.714070:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066080e99.
00000100:00000010:31.0:1773851856.714071:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000014ee1213.
02000000:00000001:30.0:1773851856.714071:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851856.714071:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e7dccfaa.
00000100:00000001:28.0:1773851856.714071:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:9.0:1773851856.714071:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:31.0:1773851856.714072:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:28.0:1773851856.714072:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000020:00000001:9.0:1773851856.714072:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:5.0:1773851856.714072:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000066080e99 x1858030974106624 msgsize 224
00000100:00000001:31.0:1773851856.714073:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851856.714073:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851856.714073:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:28.0:1773851856.714073:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000020:00000040:9.0:1773851856.714073:0:41069:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000020:00000001:30.0:1773851856.714074:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851856.714074:0:41088:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000100:00000001:28.0:1773851856.714074:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851856.714074:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:31.0:1773851856.714075:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851856.714075:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851856.714075:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:9.0:1773851856.714075:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00100000:5.0:1773851856.714075:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13819@kfi7 (source: 12345-13819@kfi7)
00000100:00000001:31.0:1773851856.714076:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000001:30.0:1773851856.714076:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851856.714076:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ce3b9347.
00000100:00000001:31.0:1773851856.714077:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851856.714077:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851856.714077:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:5.0:1773851856.714077:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
02000000:00000001:30.0:1773851856.714078:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000010:9.0:1773851856.714078:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000821d3b26.
00000400:00000200:5.0:1773851856.714078:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
02000000:00000001:30.0:1773851856.714079:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851856.714079:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061cdc96b.
00000100:00000001:28.0:1773851856.714079:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851856.714079:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:9.0:1773851856.714080:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:7.0:1773851856.714080:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851856.714080:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851856.714081:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851856.714081:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851856.714081:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851856.714081:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.714081:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851856.714082:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851856.714082:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851856.714082:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.714082:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.714083:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:28.0:1773851856.714083:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851856.714083:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:7.0:1773851856.714083:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.714084:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851856.714084:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851856.714085:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:28.0:1773851856.714085:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603945472 avail=351601683456 avail_mb=1373444076 hwm_mb=3131103 files=372190512 ffree=343363228 state=0: rc = 0
00000100:00000001:9.0:1773851856.714085:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:7.0:1773851856.714085:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974106624
00000100:00000001:30.0:1773851856.714086:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851856.714086:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.714086:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851856.714086:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9118f
00000100:00000001:30.0:1773851856.714087:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.714087:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000004:00000020:28.0:1773851856.714088:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603945472 free, 351601683456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190512 files, 343363228 free files
00000004:00000001:28.0:1773851856.714090:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851856.714090:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003bb8e38d refcount=6
00000020:00000001:7.0:1773851856.714091:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240531968 : -107152469019648 : ffff9e8b9f25b400)
00000100:00000040:28.0:1773851856.714092:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:7.0:1773851856.714092:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240531968 : -107152469019648 : ffff9e8b9f25b400)
00000100:00000001:7.0:1773851856.714094:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851856.714095:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851856.714096:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000100:00100000:28.0:1773851856.714097:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000036759c4c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051923968:47@kfi7:13:default-yuba2-0
00000020:00000010:7.0:1773851856.714098:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851856.714099:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851856.714101:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851856.714102:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851856.714103:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.714103:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851856.714104:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851856.714104:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000040:28.0:1773851856.714105:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000036759c4c x1859433051923968/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852009 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851856.714105:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851856.714106:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.714107:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.714109:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851856.714110:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851856.714110:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851856.714110:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
02000000:00000001:28.0:1773851856.714111:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851856.714111:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001529c0f6.
00000100:00000001:5.0:1773851856.714111:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851856.714112:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13819@kfi7, seq: 2001857
02000000:00000001:28.0:1773851856.714113:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:7.0:1773851856.714113:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003bb8e38d : new rpc_count 1
00000100:00000001:5.0:1773851856.714113:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851856.714114:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851856.714114:0:41089:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000100:00000001:7.0:1773851856.714114:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636975247302528 : -107098462249088 : ffff9e9832339f80)
00000020:00000001:28.0:1773851856.714115:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:5.0:1773851856.714115:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851856.714116:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
00000100:00000040:7.0:1773851856.714116:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066080e99 x1858030974106624/t0(0) o400->9e3a8776-cba2-4e17-86e4-afe9f824ed79@13819@kfi7:73/0 lens 224/0 e 0 to 0 dl 1773852188 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne222-0'
02000000:00000001:28.0:1773851856.714117:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851856.714118:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851856.714119:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036759c4c.
00000100:00000001:28.0:1773851856.714120:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851856.714121:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.714121:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851856.714121:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:28.0:1773851856.714122:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:7.0:1773851856.714123:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066080e99 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:9e3a8776-cba2-4e17-86e4-afe9f824ed79+6:50161:x1858030974106624:12345-13819@kfi7:400:default-tuolumne222-0
00000100:00000001:28.0:1773851856.714124:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851856.714125:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851856.714125:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974106624
00000100:00000001:28.0:1773851856.714126:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851856.714126:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.714126:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851856.714127:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851856.714129:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.714130:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851856.714131:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851856.714132:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851856.714133:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974106624, found 0 last_xid 1858030974106623
00000020:00000001:7.0:1773851856.714135:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851856.714136:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851856.714137:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851856.714137:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.714139:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851856.714139:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851856.714140:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851856.714141:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000327106b3.
02000000:00000001:7.0:1773851856.714142:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.714144:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.714145:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851856.714146:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768292, transno 0, xid 1858030974106624
00010000:00000001:7.0:1773851856.714147:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851856.714149:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066080e99 x1858030974106624/t0(0) o400->9e3a8776-cba2-4e17-86e4-afe9f824ed79@13819@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne222-0'
00010000:00000001:7.0:1773851856.714153:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851856.714154:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851856.714155:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=88 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851856.714157:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851856.714158:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000112f6e4e refcount 5 to 13819@kfi7
00000100:00000001:7.0:1773851856.714159:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931325663872 : -107142383887744 : ffff9e8df8449a80)
02000000:00000001:7.0:1773851856.714161:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851856.714162:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.714163:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851856.714164:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13819@kfi7
00000400:00000010:7.0:1773851856.714165:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000100:00000200:7.0:1773851856.714167:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974106624, offset 224
00000400:00000200:7.0:1773851856.714169:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13819@kfi7
00000400:00000200:7.0:1773851856.714170:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.714172:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 1
00000400:00000200:7.0:1773851856.714174:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000400:00000200:7.0:1773851856.714175:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 3
00000400:00000200:7.0:1773851856.714178:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13819@kfi7 local destination
00000400:00000200:7.0:1773851856.714180:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768698:8768698:1024:4294967295] 13819@kfi7 LPNI seq info [28025:28025:16:4294967295]
00000400:00000200:7.0:1773851856.714182:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000400:00000200:7.0:1773851856.714184:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.714187:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13819@kfi7(13819@kfi7:13819@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851856.714189:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 3
00000800:00000200:7.0:1773851856.714191:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851856.714193:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851856.714197:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851856.714201:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003d6 Using peer 13819@kfi7(0x1000000000003d6)
00000800:00000200:7.0:1773851856.714206:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x1000000000003d6: rc=0
00000800:00000200:7.0:1773851856.714208:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851856.714212:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851856.714213:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000112f6e4e refcount 4 to 13819@kfi7
00010000:00000001:7.0:1773851856.714214:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851856.714215:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.714216:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851856.714217:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066080e99 x1858030974106624/t0(0) o400->9e3a8776-cba2-4e17-86e4-afe9f824ed79@13819@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne222-0'
00000800:00000200:5.0:1773851856.714221:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003d6 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851856.714222:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066080e99 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:9e3a8776-cba2-4e17-86e4-afe9f824ed79+6:50161:x1858030974106624:12345-13819@kfi7:400:default-tuolumne222-0 Request processed in 100us (149us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851856.714224:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851856.714226:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13819@kfi7, seq: 2001857
00000400:00000200:5.0:1773851856.714226:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13819@kfi7: PUT: OK
00000100:00000040:7.0:1773851856.714227:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003bb8e38d : new rpc_count 0
00000400:00000200:5.0:1773851856.714228:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000400:00000010:5.0:1773851856.714229:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000100:00000001:5.0:1773851856.714230:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851856.714231:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851856.714232:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851856.714232:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000100:00000001:7.0:1773851856.714233:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851856.714233:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851856.714235:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000800:00000200:5.0:1773851856.714235:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 13819@kfi7(000000009fa82890):0x0 lsk 983 rsk 85 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003d6 Transaction freed
00000020:00000010:7.0:1773851856.714236:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000020:00000040:7.0:1773851856.714237:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000003bb8e38d : new refcount 5
00000100:00000001:7.0:1773851856.714238:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851856.737350:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851856.737350:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851856.737350:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.737351:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851856.737352:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851856.737352:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851856.737354:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26483@kfi7(00000000f7b15ac9):0xe7 version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851856.737356:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851856.737356:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Using peer 26483@kfi7(0x1000000000000e7)
00000400:00000200:9.0:1773851856.737358:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.737359:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.737360:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26483@kfi7 : PUT - for me
00000800:00000200:9.0:1773851856.737360:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000743dc611: Posted send of 38 bytes to peer 0x1000000000000e7: rc=0
00000400:00000200:10.0:1773851856.737362:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.737362:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00000800:00000200:9.0:1773851856.737362:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851856.737364:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.737365:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:10.0:1773851856.737366:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000400:00000200:10.0:1773851856.737367:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.737368:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 576 into portal 12 MB=0x699e10f5c9780
00000400:00000200:10.0:1773851856.737369:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26483@kfi7 of length 576/576 into md 0x78146ce49 [64] + 121248
00000800:00000200:10.0:1773851856.737372:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851856.737373:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851856.737374:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851856.737375:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26483@kfi7: PUT: OK
00000100:00000001:10.0:1773851856.737376:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851856.737376:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851856.737376:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Transaction freed
00000100:00000010:10.0:1773851856.737377:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f249d714.
00000100:00000040:10.0:1773851856.737378:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000f249d714 x1858041764681600 msgsize 576
00000100:00100000:10.0:1773851856.737380:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26483@kfi7)
00000100:00000001:10.0:1773851856.737381:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851856.737382:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000800:00000200:10.0:1773851856.737384:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851856.737387:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851856.737387:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851856.737388:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851856.737388:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851856.737389:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851856.737390:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764681600
00000020:00000001:10.0:1773851856.737390:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851856.737393:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000020:00000001:10.0:1773851856.737394:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851856.737396:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=9
00000020:00000001:10.0:1773851856.737397:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000020:00000001:10.0:1773851856.737398:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:10.0:1773851856.737398:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.737399:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851856.737400:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000014daa50c.
00000020:00000010:10.0:1773851856.737401:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000065d1028a.
00000020:00000010:10.0:1773851856.737402:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007aba1bf5.
00000100:00000001:10.0:1773851856.737403:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851856.737403:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:10.0:1773851856.737404:0:60898:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:10.0:1773851856.737404:0:60898:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.737405:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.737406:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.737407:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851856.737408:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.737409:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.737409:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851856.737409:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851856.737410:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 406391003
00000100:00000001:11.0:1773851856.737411:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.737411:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 1
00000100:00000001:11.0:1773851856.737412:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.737412:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077438464 : -106968632113152 : ffff9eb66cae4800)
00000100:00000040:10.0:1773851856.737413:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f249d714 x1858041764681600/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 576/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2138-0'
00000100:00000001:10.0:1773851856.737416:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851856.737416:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851856.737417:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f249d714 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a937d024-898f-4830-9525-051e39c8017b+9:509647:x1858041764681600:12345-26483@kfi7:101:default-tuolumne2138-0
00000100:00000200:10.0:1773851856.737419:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764681600
00000020:00000001:10.0:1773851856.737419:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851856.737420:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851856.737421:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.737421:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851856.737422:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:10.0:1773851856.737423:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851856.737424:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041764681600, found 0 last_xid 1858041764681599
00000020:00000001:10.0:1773851856.737425:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851856.737425:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851856.737426:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851856.737426:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.737427:0:60898:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:10.0:1773851856.737428:0:60898:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:10.0:1773851856.737428:0:60898:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:10.0:1773851856.737429:0:60898:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:10.0:1773851856.737430:0:60898:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851856.737433:0:60898:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:10.0:1773851856.737435:0:60898:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 199
00010000:00000001:10.0:1773851856.737436:0:60898:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:10.0:1773851856.737437:0:60898:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:10.0:1773851856.737438:0:60898:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000010c8de4a.
00000020:00000001:10.0:1773851856.737439:0:60898:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:10.0:1773851856.737439:0:60898:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000010c8de4a with handle 0x21b6f08f07a6aceb to hash
00000020:00000001:10.0:1773851856.737440:0:60898:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:10.0:1773851856.737441:0:60898:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162844124096 : -106910865427520 : ffff9ec3dfd7f3c0)
00010000:00000010:10.0:1773851856.737442:0:60898:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000007136837c.
00010000:00000001:10.0:1773851856.737443:0:60898:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162844124096 : -106910865427520 : ffff9ec3dfd7f3c0)
00010000:00010000:10.0:1773851856.737444:0:60898:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000010c8de4a/0x21b6f08f07a6aceb lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 200 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f31783b4587f76c expref: -99 pid: 60898 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737448:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:10.0:1773851856.737449:0:60898:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000f20dc80d : new locks_count 4
00000020:00000040:10.0:1773851856.737450:0:60898:0:(genops.c:871:class_export_get()) GET export 00000000f20dc80d refcount=10
00010000:00000001:10.0:1773851856.737451:0:60898:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:10.0:1773851856.737452:0:60898:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:10.0:1773851856.737454:0:60898:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:10.0:1773851856.737454:0:60898:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:10.0:1773851856.737455:0:60898:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:10.0:1773851856.737456:0:60898:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:10.0:1773851856.737457:0:60898:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:10.0:1773851856.737458:0:60898:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:10.0:1773851856.737459:0:60898:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:10.0:1773851856.737460:0:60898:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:10.0:1773851856.737461:0:60898:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.737462:0:60898:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:10.0:1773851856.737462:0:60898:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:10.0:1773851856.737463:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851856.737464:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851856.737466:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000bc1d069a.
02000000:00000001:10.0:1773851856.737467:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.737467:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.737468:0:60898:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.737469:0:60898:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:10.0:1773851856.737470:0:60898:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:10.0:1773851856.737470:0:60898:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851856.737471:0:60898:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.737472:0:60898:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851856.737472:0:60898:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.737473:0:60898:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851856.737473:0:60898:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.737474:0:60898:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851856.737474:0:60898:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.737475:0:60898:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851856.737475:0:60898:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851856.737476:0:60898:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:10.0:1773851856.737477:0:60898:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:10.0:1773851856.737478:0:60898:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:10.0:1773851856.737478:0:60898:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.737479:0:60898:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851856.737479:0:60898:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.737480:0:60898:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:10.0:1773851856.737481:0:60898:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.737481:0:60898:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:10.0:1773851856.737482:0:60898:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 0000000037d47b9c
00000004:00000001:10.0:1773851856.737483:0:60898:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:10.0:1773851856.737484:0:60898:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:10.0:1773851856.737485:0:60898:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:10.0:1773851856.737485:0:60898:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:10.0:1773851856.737486:0:60898:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 200
00010000:00000001:10.0:1773851856.737487:0:60898:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:10.0:1773851856.737487:0:60898:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:10.0:1773851856.737488:0:60898:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000ea70075e.
00000020:00000001:10.0:1773851856.737488:0:60898:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:10.0:1773851856.737489:0:60898:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000ea70075e with handle 0x21b6f08f07a6acf2 to hash
00000020:00000001:10.0:1773851856.737490:0:60898:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:10.0:1773851856.737490:0:60898:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00010000:00000010:10.0:1773851856.737491:0:60898:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000002526197d.
00010000:00000001:10.0:1773851856.737491:0:60898:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00010000:00000001:10.0:1773851856.737492:0:60898:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851856.737493:0:60898:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:10.0:1773851856.737494:0:60898:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea70075e/0x21b6f08f07a6acf2 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 201 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60898 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737496:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000001:10.0:1773851856.737497:0:60898:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:10.0:1773851856.737498:0:60898:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:10.0:1773851856.737498:0:60898:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:10.0:1773851856.737499:0:60898:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:10.0:1773851856.737500:0:60898:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851856.737501:0:60898:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:10.0:1773851856.737501:0:60898:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851856.737502:0:60898:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:10.0:1773851856.737503:0:60898:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:10.0:1773851856.737503:0:60898:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:10.0:1773851856.737504:0:60898:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:10.0:1773851856.737504:0:60898:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 200
00010000:00000040:10.0:1773851856.737506:0:60898:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:10.0:1773851856.737507:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737513:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737515:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737516:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737518:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737520:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737522:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737524:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737526:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737528:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737529:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737532:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737533:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737535:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737536:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737539:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737540:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737543:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737545:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737547:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737548:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737551:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737552:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737554:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737556:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737558:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737560:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737562:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737564:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737566:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737567:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737569:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737571:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737573:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737575:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737577:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737578:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737580:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737582:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737584:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737585:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737587:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737589:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737591:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737592:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737594:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737595:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737597:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737599:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737601:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737603:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737605:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737606:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737608:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737610:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdf7f3a8/0x21b6f08f07a5a537 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6a8 expref: 10 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737612:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737613:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737615:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737616:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737618:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737620:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737622:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737623:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737625:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737626:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737629:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737630:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737632:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737634:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737636:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737637:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737639:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737640:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737643:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737644:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737646:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737647:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737650:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737651:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737653:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737655:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737658:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737659:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737661:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737662:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737664:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737666:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737668:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737669:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737671:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737673:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737675:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737676:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737679:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737680:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737683:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737685:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a4d807 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25b3 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737689:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737691:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062815ce5/0x21b6f08f07a4d7cf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b924a expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737695:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737697:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d2098ccc/0x21b6f08f07a4d797 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0f4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737701:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737703:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f2deef/0x21b6f08f07a4d75f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84ed expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737707:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737709:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737713:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737716:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737720:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737722:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737732:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737734:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737738:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737740:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737745:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737747:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737751:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737753:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737757:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737759:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737763:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737765:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737769:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737771:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737775:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737777:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737781:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737783:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737787:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737789:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737793:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737795:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737799:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737801:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737805:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737807:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737811:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737813:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737817:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737819:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737823:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737825:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737829:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737831:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737835:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737837:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737842:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737844:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737848:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737850:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737854:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737855:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737859:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737861:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737865:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737867:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737871:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737873:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737877:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737879:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737883:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737885:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737890:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737892:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737895:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737897:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737901:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737903:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737907:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737908:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737912:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737914:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737917:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737919:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737923:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737925:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737929:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737931:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737935:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737937:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737940:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737942:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737946:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737948:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737951:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737953:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737957:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737959:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737962:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737964:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737968:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737970:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737973:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737975:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737982:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737984:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737987:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737990:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737993:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.737995:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.737999:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738001:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738005:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738006:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738010:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738012:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738016:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738018:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738021:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738024:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738028:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738030:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738033:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738035:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738039:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738040:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738044:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738046:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738050:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738051:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738055:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738057:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738060:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738062:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738066:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738068:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738072:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738074:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738078:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738080:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738083:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738085:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738089:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738091:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738095:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738097:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738100:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738102:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738106:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738107:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738111:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738113:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738117:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738119:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738122:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738124:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738128:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738130:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738133:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738135:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738139:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738141:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738144:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738146:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738150:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738152:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738156:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738158:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738162:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738164:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738168:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738170:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738173:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738175:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738179:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738181:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738184:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738186:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738190:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738192:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738196:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738198:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738201:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738203:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738207:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738209:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738213:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738215:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738219:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738221:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738224:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738226:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738230:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738233:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738236:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738238:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738242:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738244:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738248:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738249:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738254:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738256:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738259:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738262:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738266:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738268:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738271:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738273:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738277:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738279:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738282:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738285:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738289:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738290:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738294:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738296:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738300:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738302:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738306:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738308:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738312:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738314:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738318:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738320:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738324:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738326:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738329:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738331:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738335:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738337:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738340:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738342:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738358:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738360:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738363:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738365:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738369:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738370:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738374:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738376:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738380:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738382:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738385:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738387:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738391:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738392:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738396:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738398:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738402:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738404:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738407:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738409:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738413:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738415:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738419:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738421:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738425:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738427:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738430:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738432:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738436:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738438:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738442:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738443:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738447:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738450:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738453:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738455:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738459:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738461:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738465:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738467:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738470:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738472:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738476:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738478:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738482:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738484:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738487:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738490:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738493:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738495:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738499:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738501:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738504:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738506:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738510:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738512:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738516:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738517:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738521:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738523:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738527:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738529:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738533:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738534:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738539:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738541:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738544:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738546:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738550:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738552:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738555:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738558:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738562:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738564:0:60898:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738567:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00010000:10.0:1773851856.738568:0:60898:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea70075e/0x21b6f08f07a6acf2 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60898 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738572:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000001:10.0:1773851856.738574:0:60898:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:10.0:1773851856.738576:0:60898:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851856.738577:0:60898:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851856.738578:0:60898:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:10.0:1773851856.738579:0:60898:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851856.738580:0:60898:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851856.738582:0:60898:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:10.0:1773851856.738583:0:60898:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:10.0:1773851856.738584:0:60898:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:10.0:1773851856.738586:0:60898:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea70075e/0x21b6f08f07a6acf2 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60898 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738590:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000001:10.0:1773851856.738591:0:60898:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:10.0:1773851856.738592:0:60898:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851856.738592:0:60898:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851856.738593:0:60898:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851856.738594:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851856.738595:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ea70075e refcount=3
00000020:00000001:10.0:1773851856.738596:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00010000:00000001:10.0:1773851856.738598:0:60898:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00010000:00000001:10.0:1773851856.738599:0:60898:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851856.738600:0:60898:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:10.0:1773851856.738600:0:60898:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.738601:0:60898:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.738604:0:60898:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:10.0:1773851856.738605:0:60898:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:10.0:1773851856.738607:0:60898:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:10.0:1773851856.738618:0:60898:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.738619:0:60898:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:10.0:1773851856.738621:0:60898:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:10.0:1773851856.738622:0:60898:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:10.0:1773851856.738624:0:60898:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738626:0:60898:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738627:0:60898:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738629:0:60898:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:10.0:1773851856.738629:0:60898:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:10.0:1773851856.738630:0:60898:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:10.0:1773851856.738631:0:60898:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738632:0:60898:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738633:0:60898:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:10.0:1773851856.738635:0:60898:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:10.0:1773851856.738636:0:60898:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.738637:0:60898:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851856.738638:0:60898:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.738639:0:60898:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851856.738640:0:60898:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851856.738641:0:60898:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851856.738641:0:60898:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:10.0:1773851856.738643:0:60898:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851856.738643:0:60898:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:10.0:1773851856.738644:0:60898:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:10.0:1773851856.738647:0:60898:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:10.0:1773851856.738648:0:60898:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:10.0:1773851856.738650:0:60898:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:10.0:1773851856.738651:0:60898:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851856.738651:0:60898:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.738652:0:60898:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:10.0:1773851856.738653:0:60898:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:10.0:1773851856.738654:0:60898:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:10.0:1773851856.738655:0:60898:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:10.0:1773851856.738655:0:60898:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738657:0:60898:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738658:0:60898:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:10.0:1773851856.738659:0:60898:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.738661:0:60898:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:10.0:1773851856.738666:0:60898:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.738667:0:60898:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.738671:0:60898:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851856.738673:0:60898:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851856.738674:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851856.738674:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ea70075e refcount=3
00000020:00000001:10.0:1773851856.738676:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00010000:00000001:10.0:1773851856.738677:0:60898:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00000004:00000040:10.0:1773851856.738679:0:60898:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000f20dc80d : new locks_count 5
00000020:00000040:10.0:1773851856.738681:0:60898:0:(genops.c:871:class_export_get()) GET export 00000000f20dc80d refcount=11
00010000:00000001:10.0:1773851856.738683:0:60898:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851856.738684:0:60898:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:10.0:1773851856.738684:0:60898:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:10.0:1773851856.738686:0:60898:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:10.0:1773851856.738687:0:60898:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:10.0:1773851856.738688:0:60898:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:10.0:1773851856.738689:0:60898:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:10.0:1773851856.738690:0:60898:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:10.0:1773851856.738691:0:60898:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:10.0:1773851856.738691:0:60898:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:10.0:1773851856.738694:0:60898:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851856.738695:0:60898:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:10.0:1773851856.738697:0:60898:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:10.0:1773851856.738698:0:60898:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:10.0:1773851856.738700:0:60898:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:10.0:1773851856.738701:0:60898:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:10.0:1773851856.738702:0:60898:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:10.0:1773851856.738703:0:60898:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851856.738705:0:60898:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851856.738705:0:60898:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851856.738706:0:60898:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851856.738707:0:60898:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851856.738708:0:60898:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000010c8de4a with handle 0x21b6f08f07a6aceb from hash
00010000:00000001:10.0:1773851856.738710:0:60898:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851856.738711:0:60898:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851856.738712:0:60898:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851856.738712:0:60898:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:10.0:1773851856.738713:0:60898:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851856.738714:0:60898:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000010c8de4a/0x21b6f08f07a6aceb lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 201 type: IBT gid 0 flags: 0x44000000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f76c expref: 11 pid: 60898 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738719:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000040:10.0:1773851856.738721:0:60898:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f20dc80d : new locks_count 4
00000020:00000040:10.0:1773851856.738722:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 10
00010000:00000010:10.0:1773851856.738723:0:60898:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000007136837c.
00010000:00000040:10.0:1773851856.738728:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:10.0:1773851856.738729:0:60898:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851856.738729:0:60898:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851856.738731:0:60898:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:10.0:1773851856.738731:0:60898:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea70075e/0x21b6f08f07a6acf2 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f76c expref: 10 pid: 60898 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851856.738734:0:60898:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:10.0:1773851856.738735:0:60898:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851856.738736:0:60898:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851856.738737:0:60898:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:10.0:1773851856.738738:0:60898:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:10.0:1773851856.738739:0:60898:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851856.738740:0:60898:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851856.738741:0:60898:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:10.0:1773851856.738741:0:60898:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851856.738742:0:60898:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:10.0:1773851856.738742:0:60898:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000ea70075e, rc 0)
00000020:00000001:10.0:1773851856.738744:0:60898:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851856.738744:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260805375, transno 0, xid 1858041764681600
00010000:00000001:10.0:1773851856.738745:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851856.738746:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f249d714 x1858041764681600/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 576/640 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00010000:00000001:10.0:1773851856.738750:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851856.738750:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851856.738751:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=89 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851856.738753:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851856.738753:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00000100:00000001:10.0:1773851856.738754:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
02000000:00000001:10.0:1773851856.738755:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851856.738756:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.738757:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851856.738758:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26483@kfi7
00000400:00000010:10.0:1773851856.738759:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000092ac144e.
00000100:00000200:10.0:1773851856.738762:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858041764681600, offset 224
00000400:00000200:10.0:1773851856.738763:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26483@kfi7
00000400:00000200:10.0:1773851856.738764:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.738765:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00000400:00000200:10.0:1773851856.738767:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:10.0:1773851856.738768:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000400:00000200:10.0:1773851856.738769:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26483@kfi7 local destination
00000400:00000200:10.0:1773851856.738771:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768699:8768699:1024:4294967295] 26483@kfi7 LPNI seq info [184798:184798:16:4294967295]
00000400:00000200:10.0:1773851856.738773:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:10.0:1773851856.738773:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.738776:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26483@kfi7(26483@kfi7:26483@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851856.738777:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000800:00000200:10.0:1773851856.738779:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851856.738780:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:10.0:1773851856.738783:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851856.738786:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Using peer 26483@kfi7(0x1000000000000e7)
00000800:00000200:10.0:1773851856.738789:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000019dc57a6: Posted send of 740 bytes to peer 0x1000000000000e7: rc=0
00000800:00000200:10.0:1773851856.738791:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851856.738793:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851856.738795:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 2 to 26483@kfi7
00010000:00000001:10.0:1773851856.738795:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851856.738796:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851856.738797:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851856.738798:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f249d714 x1858041764681600/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 576/640 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00000100:00100000:10.0:1773851856.738801:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f249d714 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a937d024-898f-4830-9525-051e39c8017b+10:509647:x1858041764681600:12345-26483@kfi7:101:default-tuolumne2138-0 Request processed in 1384us (1422us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851856.738804:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851856.738805:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 406391003
00000400:00000200:9.0:1773851856.738805:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:10.0:1773851856.738806:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 0
00000100:00000001:10.0:1773851856.738807:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851856.738807:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26483@kfi7: PUT: OK
00000100:00000001:10.0:1773851856.738808:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851856.738808:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000065d1028a.
00000400:00000200:9.0:1773851856.738808:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000092ac144e
00000400:00000010:9.0:1773851856.738808:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000092ac144e.
00000020:00000010:10.0:1773851856.738809:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007aba1bf5.
00000100:00000001:9.0:1773851856.738809:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:10.0:1773851856.738810:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000014daa50c.
00000100:00000001:9.0:1773851856.738810:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:10.0:1773851856.738811:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 9
00000400:00000200:9.0:1773851856.738811:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000100:00000001:10.0:1773851856.738812:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851856.738813:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Transaction freed
00000800:00000200:9.0:1773851856.739035:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.739035:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851856.739036:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:11.0:1773851856.739036:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.739036:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851856.739037:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851856.739037:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851856.739038:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851856.739038:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26483@kfi7(000000005ec70586):0x961 version: 2; local version 2; negotiated version: 2
00000800:00000200:11.0:1773851856.739039:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851856.739040:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851856.739040:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 Using peer 26483@kfi7(0x961)
00000800:00000200:11.0:1773851856.739041:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851856.739042:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000400:00000200:9.0:1773851856.739042:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:11.0:1773851856.739043:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:13.0:1773851856.739044:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26546@kfi7 : PUT - for me
00000800:00000200:9.0:1773851856.739044:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 38 bytes to peer 0x961: rc=0
00000400:00000200:13.0:1773851856.739045:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.739045:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 1
00000400:00000200:11.0:1773851856.739045:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26483@kfi7 : PUT - for me
00000800:00000200:9.0:1773851856.739045:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851856.739046:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:13.0:1773851856.739047:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000400:00000200:11.0:1773851856.739047:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00000400:00000200:13.0:1773851856.739048:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000400:00000200:13.0:1773851856.739048:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 3
00000400:00000200:13.0:1773851856.739049:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:11.0:1773851856.739049:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:13.0:1773851856.739050:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 512 into portal 12 MB=0x699e10f5c98c0
00000400:00000200:11.0:1773851856.739050:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:13.0:1773851856.739052:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26483@kfi7 of length 512/512 into md 0x82a36e8ed [64] + 15624
00000400:00000200:11.0:1773851856.739053:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000800:00000200:13.0:1773851856.739054:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851856.739054:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:13.0:1773851856.739055:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851856.739055:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 224 into portal 12 MB=0x699e10f5c9800
00000800:00000200:9.0:1773851856.739055:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851856.739056:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26546@kfi7: PUT: OK
00000100:00000001:13.0:1773851856.739057:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851856.739057:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000400:00000200:11.0:1773851856.739057:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26483@kfi7 of length 224/224 into md 0x78146ce49 [64] + 121824
00000800:00000200:14.0:1773851856.739058:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000010:13.0:1773851856.739058:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a91b4606.
00000800:00000200:9.0:1773851856.739058:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 Transaction freed
00000800:00000200:14.0:1773851856.739059:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:13.0:1773851856.739059:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000a91b4606 x1858041764681920 msgsize 512
00000800:00000200:14.0:1773851856.739061:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:13.0:1773851856.739061:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26546@kfi7)
00000800:00000200:11.0:1773851856.739061:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851856.739062:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:14.0:1773851856.739063:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:13.0:1773851856.739063:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851856.739064:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000400:00000200:11.0:1773851856.739064:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26483@kfi7: PUT: OK
00000100:00000001:15.0:1773851856.739065:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851856.739065:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:14.0:1773851856.739065:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000800:00000200:13.0:1773851856.739065:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851856.739065:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:15.0:1773851856.739066:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851856.739066:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851856.739066:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26546@kfi7 : PUT - for me
00000100:00000200:11.0:1773851856.739066:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:11.0:1773851856.739066:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b624700f.
02000000:00000001:15.0:1773851856.739067:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851856.739067:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000b624700f x1858041764681728 msgsize 224
00000100:00100000:15.0:1773851856.739068:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764681920
00000400:00000200:14.0:1773851856.739068:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000020:00000001:15.0:1773851856.739069:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851856.739069:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000400:00000200:14.0:1773851856.739069:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 1
00000100:00100000:11.0:1773851856.739069:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26483@kfi7)
00000020:00000001:15.0:1773851856.739070:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:14.0:1773851856.739070:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000100:00000001:11.0:1773851856.739070:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000040:15.0:1773851856.739071:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=10
00000400:00000200:14.0:1773851856.739071:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000400:00000200:14.0:1773851856.739071:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 3
00000400:00000200:11.0:1773851856.739071:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000100:00000001:10.0:1773851856.739071:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:15.0:1773851856.739072:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000020:00000001:15.0:1773851856.739072:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000400:00000200:14.0:1773851856.739072:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
02000000:00000001:10.0:1773851856.739072:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851856.739072:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851856.739073:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:14.0:1773851856.739073:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 328 into portal 17 MB=0x699e10f5c9840
00000800:00000200:11.0:1773851856.739073:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851856.739073:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851856.739073:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.739074:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851856.739074:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ad15dc46.
00000100:00100000:10.0:1773851856.739074:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764681728
00000020:00000010:15.0:1773851856.739075:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000400:00000200:14.0:1773851856.739075:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-26483@kfi7 of length 328/328 into md 0x82a56312d [2] + 0
00000020:00000001:10.0:1773851856.739075:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851856.739075:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000020:00000010:15.0:1773851856.739076:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000020:00000001:10.0:1773851856.739076:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:15.0:1773851856.739077:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851856.739077:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000040:10.0:1773851856.739077:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=11
00000020:00000001:10.0:1773851856.739077:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:15.0:1773851856.739078:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851856.739078:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:10.0:1773851856.739078:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:15.0:1773851856.739079:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.739079:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851856.739080:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851856.739080:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851856.739080:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851856.739080:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000014daa50c.
00000100:00000001:15.0:1773851856.739081:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000400:00000200:14.0:1773851856.739081:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26546@kfi7: PUT: OK
00000020:00000010:10.0:1773851856.739081:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000065d1028a.
00000100:00000001:15.0:1773851856.739082:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.739082:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851856.739082:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000020:00000010:10.0:1773851856.739082:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007aba1bf5.
00000100:00100000:15.0:1773851856.739083:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 411190546
00000100:00000040:15.0:1773851856.739083:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 1
00000100:00000001:14.0:1773851856.739083:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851856.739083:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000001:13.0:1773851856.739083:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.739083:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851856.739083:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851856.739084:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197391872 : -106942512159744 : ffff9ebc818d2400)
00000100:00000010:14.0:1773851856.739084:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007fde1e78.
00000100:00000040:14.0:1773851856.739084:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000007fde1e78 x1858041764681792 msgsize 328
00000100:00000001:13.0:1773851856.739084:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.739084:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851856.739085:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a91b4606 x1858041764681920/t0(0) o36->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 512/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2138-0'
00000100:00000001:10.0:1773851856.739085:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851856.739086:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26546@kfi7)
00000100:00000001:10.0:1773851856.739086:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851856.739087:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851856.739087:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851856.739088:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851856.739088:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:14.0:1773851856.739088:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851856.739088:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851856.739088:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851856.739089:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a91b4606 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:a937d024-898f-4830-9525-051e39c8017b+11:509647:x1858041764681920:12345-26483@kfi7:36:default-tuolumne2138-0
00000400:00000200:14.0:1773851856.739089:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000100:00000001:12.0:1773851856.739089:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00100000:11.0:1773851856.739089:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 406391004
00000800:00000200:14.0:1773851856.739090:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851856.739090:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851856.739091:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851856.739091:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851856.739091:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 2
00000100:00000001:11.0:1773851856.739091:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637164268282624 : -106909441268992 : ffff9ec434bae300)
00000100:00000001:10.0:1773851856.739091:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:15.0:1773851856.739092:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764681920
02000000:00000001:12.0:1773851856.739092:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851856.739092:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.739093:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851856.739093:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00100000:12.0:1773851856.739093:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764681792
00000020:00000001:12.0:1773851856.739093:0:609420:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000040:11.0:1773851856.739093:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b624700f x1858041764681728/t0(0) o41->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2138-0'
00000020:00000001:15.0:1773851856.739094:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851856.739094:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000020:00000001:12.0:1773851856.739094:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:15.0:1773851856.739095:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851856.739095:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658704 : -1035892912 : ffffffffc2418750)
00000020:00000040:12.0:1773851856.739095:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=12
00000020:00000001:15.0:1773851856.739096:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851856.739096:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041764681920, found 0 last_xid 1858041764681727
00000020:00000001:12.0:1773851856.739096:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:11.0:1773851856.739096:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851856.739096:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:15.0:1773851856.739097:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851856.739097:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00100000:11.0:1773851856.739097:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b624700f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a937d024-898f-4830-9525-051e39c8017b+12:39808:x1858041764681728:12345-26483@kfi7:41:default-tuolumne2138-0
00000020:00000001:15.0:1773851856.739098:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851856.739098:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:12.0:1773851856.739098:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851856.739098:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:15.0:1773851856.739099:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:12.0:1773851856.739099:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000290d0842.
00000100:00000200:11.0:1773851856.739099:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764681728
00000004:00000001:15.0:1773851856.739100:0:60824:0:(mdt_handler.c:3040:mdt_reint()) Process entered
00000020:00000010:12.0:1773851856.739100:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000001:11.0:1773851856.739100:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000004:00000002:15.0:1773851856.739101:0:60824:0:(mdt_handler.c:3007:mdt_reint_opcode()) @@@ reint opt = 2  req@00000000a91b4606 x1858041764681920/t0(0) o36->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 512/0 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/ffffffff rc 0/-1 job:'default-tuolumne2138-0'
00000020:00000010:12.0:1773851856.739101:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000422619af.
00000020:00000001:11.0:1773851856.739101:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851856.739101:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851856.739102:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:12.0:1773851856.739102:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:11.0:1773851856.739102:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:12.0:1773851856.739103:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:12.0:1773851856.739103:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00000020:00000001:11.0:1773851856.739103:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:11.0:1773851856.739103:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00010000:00000001:12.0:1773851856.739104:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.739104:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041764681728, found 0 last_xid 1858041764681727
00000004:00000001:15.0:1773851856.739105:0:60824:0:(mdt_handler.c:2906:mdt_reint_internal()) Process entered
00010000:00000001:12.0:1773851856.739105:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:12.0:1773851856.739105:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.739105:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:15.0:1773851856.739106:0:60824:0:(mdt_lib.c:1846:mdt_reint_unpack()) Process entered
00000004:00000001:15.0:1773851856.739106:0:60824:0:(mdt_lib.c:1303:mdt_create_unpack()) Process entered
00000020:00000001:12.0:1773851856.739106:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:11.0:1773851856.739106:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851856.739106:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000040:12.0:1773851856.739107:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ea70075e refcount=3
00000020:00000001:11.0:1773851856.739107:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851856.739108:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00000100:00000001:11.0:1773851856.739108:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851856.739108:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000001:00000001:15.0:1773851856.739109:0:60824:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:15.0:1773851856.739109:0:60824:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739109:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00010000:00000001:12.0:1773851856.739109:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000004:00000001:15.0:1773851856.739110:0:60824:0:(mdt_lib.c:1213:mdt_dlmreq_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739110:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851856.739110:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851856.739110:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000024c9e5ad.
00000004:00000001:15.0:1773851856.739111:0:60824:0:(mdt_lib.c:1379:mdt_create_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851856.739111:0:60824:0:(mdt_lib.c:1856:mdt_reint_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851856.739111:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851856.739111:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.739111:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851856.739112:0:60824:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:15.0:1773851856.739112:0:60824:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:12.0:1773851856.739112:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.739112:0:60829:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000100:00000001:15.0:1773851856.739113:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851856.739113:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000001:12.0:1773851856.739113:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851856.739113:0:60829:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
02000000:00000010:15.0:1773851856.739114:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 704 at 00000000d3fd4655.
00000004:00000001:11.0:1773851856.739114:0:60829:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851856.739115:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.739115:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.739115:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851856.739115:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851856.739115:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00080000:00000001:11.0:1773851856.739115:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00000100:00000001:13.0:1773851856.739116:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851856.739116:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 50273006
00080000:00000001:11.0:1773851856.739116:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851856.739117:0:60824:0:(mdt_lib.c:578:old_init_ucred_reint()) Process entered
00000001:00000001:15.0:1773851856.739117:0:60824:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:15.0:1773851856.739117:0:60824:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.739117:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851856.739117:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 3
00000004:00000024:11.0:1773851856.739117:0:60829:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000001:00000001:15.0:1773851856.739118:0:60824:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:15.0:1773851856.739118:0:60824:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.739118:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851856.739118:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341801472 : -106946367750144 : ffff9ebb9bbd8000)
00000004:00000020:11.0:1773851856.739118:0:60829:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000001:00000001:15.0:1773851856.739119:0:60824:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000040:12.0:1773851856.739119:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007fde1e78 x1858041764681792/t0(0) o103->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 328/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000020:00000001:11.0:1773851856.739119:0:60829:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000001:00000001:15.0:1773851856.739120:0:60824:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851856.739121:0:60824:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
00000100:00000001:12.0:1773851856.739121:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
02000000:00000001:15.0:1773851856.739122:0:60824:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000100:00000001:12.0:1773851856.739122:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:11.0:1773851856.739122:0:60829:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.739122:0:60829:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851856.739123:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007fde1e78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:a937d024-898f-4830-9525-051e39c8017b+12:39825:x1858041764681792:12345-26483@kfi7:103:
00010000:00000040:11.0:1773851856.739123:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260805375, transno 0, xid 1858041764681728
00000004:00000001:15.0:1773851856.739124:0:60824:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:15.0:1773851856.739124:0:60824:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:12.0:1773851856.739124:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764681792
00010000:00000001:11.0:1773851856.739124:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000001:00000001:15.0:1773851856.739125:0:60824:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:15.0:1773851856.739125:0:60824:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739125:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:12.0:1773851856.739125:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000200:11.0:1773851856.739125:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b624700f x1858041764681728/t0(0) o41->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 224/368 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00000004:00000001:15.0:1773851856.739126:0:60824:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:15.0:1773851856.739126:0:60824:0:(mdt_lib.c:599:old_init_ucred_reint()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739126:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000004:00000001:15.0:1773851856.739127:0:60824:0:(mdt_internal.h:1182:mdt_check_resent()) Process entered
00000100:00000001:12.0:1773851856.739127:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851856.739127:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000004:00000001:15.0:1773851856.739128:0:60824:0:(mdt_internal.h:1200:mdt_check_resent()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:12.0:1773851856.739128:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008ee0eb28.
02000000:00000001:12.0:1773851856.739128:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.739128:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851856.739128:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851856.739129:0:60824:0:(mdt_reint.c:3241:mdt_reint_rec()) Process entered
00000100:00000001:12.0:1773851856.739129:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739129:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00000100:00001000:11.0:1773851856.739129:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=89 v=66 (1 1 1 1)
00000004:00000001:15.0:1773851856.739130:0:60824:0:(mdt_reint.c:1049:mdt_reint_create()) Process entered
00010000:00000001:15.0:1773851856.739130:0:60824:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:12.0:1773851856.739130:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:12.0:1773851856.739130:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:11.0:1773851856.739130:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851856.739130:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00010000:00010000:15.0:1773851856.739131:0:60824:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:15.0:1773851856.739131:0:60824:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851856.739131:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851856.739131:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ea70075e refcount=3
00000100:00000001:11.0:1773851856.739131:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
00000020:00000001:15.0:1773851856.739132:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:12.0:1773851856.739132:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
00010000:00000001:12.0:1773851856.739132:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162844115456 : -106910865436160 : ffff9ec3dfd7d200)
02000000:00000001:11.0:1773851856.739132:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851856.739132:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:15.0:1773851856.739133:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000bdf7f3a8 refcount=3
00000020:00000001:15.0:1773851856.739133:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637070539934528 : -107003169617088 : ffff9eae6215cb40)
00010000:00000040:12.0:1773851856.739133:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 200
00000100:00000001:11.0:1773851856.739133:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000004:00000001:12.0:1773851856.739134:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000100:00000040:11.0:1773851856.739134:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26483@kfi7
00010000:00000001:15.0:1773851856.739135:0:60824:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637070539934528 : -107003169617088 : ffff9eae6215cb40)
00010000:00000040:15.0:1773851856.739135:0:60824:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 201
00010000:00000001:12.0:1773851856.739135:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851856.739135:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00000400:00000010:11.0:1773851856.739135:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1dd5303.
00000100:00000200:11.0:1773851856.739135:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858041764681728, offset 224
00000004:00000001:15.0:1773851856.739136:0:60824:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851856.739136:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851856.739136:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851856.739137:0:60824:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:15.0:1773851856.739137:0:60824:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:15.0:1773851856.739137:0:60824:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00000020:00000001:12.0:1773851856.739137:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851856.739137:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26483@kfi7
00010000:00000001:15.0:1773851856.739138:0:60824:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.739138:0:60824:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739138:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851856.739138:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00000400:00000200:11.0:1773851856.739138:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00010000:00000001:12.0:1773851856.739139:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:11.0:1773851856.739139:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00010000:00000001:12.0:1773851856.739140:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851856.739140:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00000400:00000200:11.0:1773851856.739140:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00010000:00000001:12.0:1773851856.739141:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851856.739141:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000ea70075e with handle 0x21b6f08f07a6acf2 from hash
00000400:00000200:11.0:1773851856.739141:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00010000:00000001:12.0:1773851856.739142:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851856.739142:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:11.0:1773851856.739142:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26483@kfi7 local destination
00010000:00000001:12.0:1773851856.739143:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851856.739143:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851856.739144:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851856.739144:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851856.739144:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768700:8768700:1024:4294967295] 26483@kfi7 LPNI seq info [184799:184799:16:4294967295]
00010000:00000001:12.0:1773851856.739145:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851856.739145:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:11.0:1773851856.739145:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00010000:00000001:15.0:1773851856.739146:0:60824:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:15.0:1773851856.739146:0:60824:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00010000:12.0:1773851856.739146:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea70075e/0x21b6f08f07a6acf2 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 202 type: IBT gid 0 flags: 0x44a01000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f76c expref: 12 pid: 60898 timeout: 0 lvb_type: 0
00000400:00000200:11.0:1773851856.739146:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00010000:00000001:15.0:1773851856.739147:0:60824:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851856.739148:0:60824:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851856.739148:0:60824:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:15.0:1773851856.739148:0:60824:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851856.739148:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26483@kfi7(26483@kfi7:26483@kfi7) <?> : PUT try# 0
00000020:00000040:15.0:1773851856.739149:0:60824:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000bdf7f3a8 with handle 0x21b6f08f07a5a537 from hash
00010000:00000040:12.0:1773851856.739149:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 201
00010000:00000040:12.0:1773851856.739149:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f20dc80d : new locks_count 3
00000400:00000200:11.0:1773851856.739149:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00010000:00000001:15.0:1773851856.739150:0:60824:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00000020:00000040:12.0:1773851856.739150:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 11
00000800:00000200:11.0:1773851856.739150:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00010000:00000001:15.0:1773851856.739151:0:60824:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851856.739151:0:60824:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851856.739151:0:60824:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000010:12.0:1773851856.739151:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002526197d.
00010000:00000040:12.0:1773851856.739151:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00000800:00000200:11.0:1773851856.739151:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00010000:00000001:15.0:1773851856.739152:0:60824:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:15.0:1773851856.739152:0:60824:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739152:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851856.739153:0:60824:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:15.0:1773851856.739153:0:60824:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851856.739153:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00010000:15.0:1773851856.739154:0:60824:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdf7f3a8/0x21b6f08f07a5a537 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 201 type: IBT gid 0 flags: 0x44a01000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6a8 expref: 11 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000001:12.0:1773851856.739154:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851856.739155:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:12.0:1773851856.739156:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851856.739156:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00010000:00000040:15.0:1773851856.739157:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 200
00010000:00000001:12.0:1773851856.739157:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851856.739157:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:15.0:1773851856.739158:0:60824:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f20dc80d : new locks_count 2
00000020:00000040:15.0:1773851856.739158:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 10
00010000:00000040:12.0:1773851856.739158:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000010:15.0:1773851856.739159:0:60824:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000ae9033dc.
00010000:00010000:12.0:1773851856.739159:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:12.0:1773851856.739159:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851856.739159:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 Using peer 26483@kfi7(0x961)
00010000:00000040:15.0:1773851856.739160:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000001:12.0:1773851856.739160:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851856.739161:0:60824:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:15.0:1773851856.739161:0:60824:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:15.0:1773851856.739161:0:60824:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00000001:12.0:1773851856.739161:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851856.739161:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=110 v=66 (1 1 1 1)
00010000:00010000:15.0:1773851856.739162:0:60824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00000100:00000001:12.0:1773851856.739162:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000800:00000200:11.0:1773851856.739162:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 468 bytes to peer 0x961: rc=0
00010000:00000001:15.0:1773851856.739163:0:60824:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:12.0:1773851856.739163:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 4 to 26483@kfi7
00010000:00000001:15.0:1773851856.739164:0:60824:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851856.739164:0:60824:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00000100:00000001:12.0:1773851856.739164:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
00000800:00000200:11.0:1773851856.739164:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00010000:00000040:15.0:1773851856.739165:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 197
00010000:00010000:15.0:1773851856.739165:0:60824:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
02000000:00000001:12.0:1773851856.739165:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851856.739165:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.739165:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851856.739166:0:60824:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:15.0:1773851856.739166:0:60824:0:(mdt_reint.c:511:mdt_create()) Process entered
00000100:00000001:12.0:1773851856.739166:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851856.739166:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00000004:00000002:15.0:1773851856.739167:0:60824:0:(mdt_reint.c:514:mdt_create()) @@@ Create (slingshotmon->[0x2400276d5:0xa57f:0x0]) in [0x24001b599:0x10e2:0x0]  req@00000000a91b4606 x1858041764681920/t0(0) o36->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 512/448 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00000100:00000040:12.0:1773851856.739167:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26546@kfi7
00010000:00000001:11.0:1773851856.739167:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851856.739167:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:12.0:1773851856.739168:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000dde699a.
00000020:00000001:11.0:1773851856.739168:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000200:12.0:1773851856.739169:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1858041764681792, offset 224
00000100:00000040:11.0:1773851856.739170:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b624700f x1858041764681728/t0(0) o41->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 224/368 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00000004:00000001:15.0:1773851856.739171:0:60824:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000400:00000200:12.0:1773851856.739171:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26546@kfi7
00000004:00000040:15.0:1773851856.739172:0:60824:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000400:00000200:12.0:1773851856.739172:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000020:00000001:15.0:1773851856.739173:0:60824:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000400:00000200:12.0:1773851856.739173:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 1
00000020:00000001:15.0:1773851856.739174:0:60824:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000400:00000200:12.0:1773851856.739174:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000100:00100000:11.0:1773851856.739174:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b624700f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a937d024-898f-4830-9525-051e39c8017b+10:39808:x1858041764681728:12345-26483@kfi7:41:default-tuolumne2138-0 Request processed in 77us (105us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851856.739174:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 TN_EVENT_TX_OK event status 0
00000004:00000001:15.0:1773851856.739175:0:60824:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000400:00000200:12.0:1773851856.739175:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 3
00000400:00000200:10.0:1773851856.739175:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851856.739176:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 406391004
00000004:00000001:15.0:1773851856.739177:0:60824:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000400:00000200:12.0:1773851856.739177:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26546@kfi7 local destination
00000100:00000040:11.0:1773851856.739177:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 2
00000400:00000200:10.0:1773851856.739177:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26483@kfi7: PUT: OK
00000400:00000200:12.0:1773851856.739178:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768701:8768701:1023:4294967295] 26546@kfi7 LPNI seq info [184800:184800:16:4294967295]
00000100:00000001:11.0:1773851856.739178:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851856.739178:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1dd5303
00000400:00000010:10.0:1773851856.739178:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1dd5303.
00000100:00000001:11.0:1773851856.739179:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851856.739179:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000065d1028a.
00000100:00000001:10.0:1773851856.739179:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851856.739179:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:12.0:1773851856.739180:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000020:00000010:11.0:1773851856.739180:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007aba1bf5.
00000400:00000200:10.0:1773851856.739180:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:12.0:1773851856.739181:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000020:00000010:11.0:1773851856.739181:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000014daa50c.
00000020:00000040:11.0:1773851856.739182:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 9
00000800:00000200:10.0:1773851856.739182:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26483@kfi7(000000005ec70586):0x0 lsk 2402 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x961 Transaction freed
00000100:00000001:11.0:1773851856.739183:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:12.0:1773851856.739184:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26546@kfi7(26546@kfi7:26546@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851856.739185:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 3
00000800:00000200:12.0:1773851856.739186:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000004:00000001:15.0:1773851856.739188:0:60824:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000800:00000200:12.0:1773851856.739188:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000004:00000001:15.0:1773851856.739189:0:60824:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:15.0:1773851856.739190:0:60824:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:12.0:1773851856.739190:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00080000:00000001:15.0:1773851856.739192:0:60824:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00000800:00000200:12.0:1773851856.739193:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xec Using peer 26546@kfi7(0xec)
00000800:00000200:12.0:1773851856.739196:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0xec: rc=0
00000800:00000200:12.0:1773851856.739198:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00080000:00000001:15.0:1773851856.739199:0:60824:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:15.0:1773851856.739200:0:60824:0:(osd_index.c:965:osd_remote_fid()) Process entered
00000100:00000001:12.0:1773851856.739200:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851856.739201:0:60824:0:(osd_index.c:945:osd_seq_exists()) Process entered
00000100:00000040:12.0:1773851856.739201:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 2 to 26483@kfi7
80000000:00000001:15.0:1773851856.739202:0:60824:0:(fld_handler.c:211:fld_local_lookup()) Process entered
00010000:00000001:12.0:1773851856.739202:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:15.0:1773851856.739203:0:60824:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
00010000:00000001:12.0:1773851856.739203:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851856.739204:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007fde1e78 x1858041764681792/t0(0) o103->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 328/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:''
80000000:00000001:15.0:1773851856.739205:0:60824:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:15.0:1773851856.739205:0:60824:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851856.739206:0:60824:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851856.739207:0:60824:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:15.0:1773851856.739208:0:60824:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851856.739208:0:60824:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851856.739209:0:60824:0:(mdt_reint.c:581:mdt_create()) Process leaving via put_parent (rc=18446744073709551599 : -17 : 0xffffffffffffffef)
00000100:00100000:12.0:1773851856.739209:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007fde1e78 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:a937d024-898f-4830-9525-051e39c8017b+9:39825:x1858041764681792:12345-26483@kfi7:103: Request processed in 86us (123us total) trans 0 rc 0/0
00000004:00000001:15.0:1773851856.739211:0:60824:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:15.0:1773851856.739212:0:60824:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000100:00100000:12.0:1773851856.739212:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 50273006
00000004:00000001:15.0:1773851856.739213:0:60824:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:15.0:1773851856.739213:0:60824:0:(mdt_reint.c:1087:mdt_reint_create()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000100:00000040:12.0:1773851856.739213:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 1
00000100:00000001:12.0:1773851856.739213:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000004:00000001:15.0:1773851856.739214:0:60824:0:(mdt_reint.c:3254:mdt_reint_rec()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000100:00000001:12.0:1773851856.739214:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000004:00000001:15.0:1773851856.739215:0:60824:0:(mdt_handler.c:2976:mdt_reint_internal()) Process leaving
00000020:00000010:12.0:1773851856.739215:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851856.739215:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000422619af.
02000000:00000001:15.0:1773851856.739216:0:60824:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:15.0:1773851856.739216:0:60824:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000020:00000010:12.0:1773851856.739216:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000290d0842.
00000004:00000001:15.0:1773851856.739217:0:60824:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000020:00000040:12.0:1773851856.739217:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 8
00000004:00000001:15.0:1773851856.739218:0:60824:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:15.0:1773851856.739218:0:60824:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000100:00000001:12.0:1773851856.739218:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:15.0:1773851856.739219:0:60824:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:15.0:1773851856.739220:0:60824:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851856.739220:0:60824:0:(mdt_handler.c:3056:mdt_reint()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00010000:00000040:15.0:1773851856.739221:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260805375, transno 0, xid 1858041764681920
00010000:00000001:15.0:1773851856.739222:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851856.739223:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a91b4606 x1858041764681920/t0(0) o36->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 512/448 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc -17/0 job:'default-tuolumne2138-0'
00000800:00000200:13.0:1773851856.739224:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xec TN_EVENT_TX_OK event status 0
00010000:00000001:15.0:1773851856.739225:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000400:00000200:13.0:1773851856.739225:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:15.0:1773851856.739226:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851856.739226:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26546@kfi7: PUT: OK
00000100:00001000:15.0:1773851856.739227:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000400:00000200:13.0:1773851856.739227:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000dde699a
00000400:00000010:13.0:1773851856.739227:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000dde699a.
00000100:00000001:15.0:1773851856.739228:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851856.739228:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00000100:00000001:13.0:1773851856.739228:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851856.739228:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851856.739229:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
00000400:00000200:13.0:1773851856.739229:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
02000000:00000001:15.0:1773851856.739230:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851856.739230:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.739231:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:13.0:1773851856.739231:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 26546@kfi7(00000000ce6b9ae5):0x0 lsk 237 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xec Transaction freed
00000100:00000040:15.0:1773851856.739232:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26546@kfi7
00000400:00000010:15.0:1773851856.739232:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a10312a3.
00000100:00000200:15.0:1773851856.739233:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 448 bytes to portal 10, xid 1858041764681920, offset 224
00000400:00000200:15.0:1773851856.739235:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26546@kfi7
00000400:00000200:15.0:1773851856.739236:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000400:00000200:15.0:1773851856.739237:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 1
00000400:00000200:15.0:1773851856.739238:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000400:00000200:15.0:1773851856.739239:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 3
00000400:00000200:15.0:1773851856.739240:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26546@kfi7 local destination
00000400:00000200:15.0:1773851856.739242:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768702:8768702:1024:4294967295] 26546@kfi7 LPNI seq info [184801:184801:16:4294967295]
00000400:00000200:15.0:1773851856.739243:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000400:00000200:15.0:1773851856.739244:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26546@kfi7 to cpt 3
00000400:00000200:15.0:1773851856.739246:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26546@kfi7(26546@kfi7:26546@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851856.739247:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 3
00000800:00000200:15.0:1773851856.739249:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851856.739250:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 448 bytes in 1 frags
00000800:00000200:15.0:1773851856.739253:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851856.739255:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b82 Using peer 26546@kfi7(0x100000000000b82)
00000800:00000200:15.0:1773851856.739259:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 548 bytes to peer 0x100000000000b82: rc=0
00000800:00000200:15.0:1773851856.739261:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851856.739265:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851856.739266:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 2 to 26483@kfi7
00010000:00000001:15.0:1773851856.739266:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851856.739267:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.739268:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851856.739268:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a91b4606 x1858041764681920/t0(0) o36->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 512/448 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc -17/-17 job:'default-tuolumne2138-0'
00000100:00100000:15.0:1773851856.739271:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a91b4606 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:a937d024-898f-4830-9525-051e39c8017b+8:509647:x1858041764681920:12345-26483@kfi7:36:default-tuolumne2138-0 Request processed in 183us (212us total) trans 0 rc -17/-17
00000800:00000200:13.0:1773851856.739273:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b82 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851856.739274:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 411190546
00000400:00000200:13.0:1773851856.739274:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:15.0:1773851856.739275:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 0
00000100:00000001:15.0:1773851856.739275:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851856.739275:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26546@kfi7: PUT: OK
00000100:00000001:15.0:1773851856.739276:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851856.739276:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851856.739276:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a10312a3
00000400:00000010:13.0:1773851856.739276:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a10312a3.
00000020:00000010:15.0:1773851856.739277:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000020:00000010:15.0:1773851856.739277:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ad15dc46.
00000100:00000001:13.0:1773851856.739277:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851856.739277:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:15.0:1773851856.739278:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 7
00000400:00000200:13.0:1773851856.739278:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004f00e4fc nid 26546@kfi7 refs 2
00000100:00000001:15.0:1773851856.739279:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851856.739279:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 26546@kfi7(00000000ecf4cbcb):0x0 lsk 2947 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000b82 Transaction freed
00000800:00000200:9.0:1773851856.739402:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851856.739404:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851856.739405:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851856.739407:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851856.739409:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.739410:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26483@kfi7 : PUT - for me
00000400:00000200:9.0:1773851856.739411:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.739412:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00000400:00000200:9.0:1773851856.739413:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.739414:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:9.0:1773851856.739415:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000400:00000200:9.0:1773851856.739415:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:9.0:1773851856.739417:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 584 into portal 12 MB=0x699e10f5c9900
00000400:00000200:9.0:1773851856.739418:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26483@kfi7 of length 584/584 into md 0x78146ce49 [64] + 122048
00000800:00000200:9.0:1773851856.739420:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851856.739421:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851856.739422:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26483@kfi7: PUT: OK
00000100:00000001:9.0:1773851856.739424:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851856.739424:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851856.739425:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006164d830.
00000100:00000040:9.0:1773851856.739426:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006164d830 x1858041764681984 msgsize 584
00000100:00100000:9.0:1773851856.739427:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26483@kfi7)
00000100:00000001:9.0:1773851856.739428:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851856.739429:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851856.739429:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
02000000:00000001:11.0:1773851856.739430:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851856.739430:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851856.739430:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851856.739431:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851856.739432:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851856.739433:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764681984
00000020:00000001:11.0:1773851856.739434:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851856.739434:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000020:00000001:11.0:1773851856.739435:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.739436:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=8
00000020:00000001:11.0:1773851856.739437:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000020:00000001:11.0:1773851856.739438:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:11.0:1773851856.739439:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851856.739439:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851856.739440:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009503e737.
00000020:00000010:11.0:1773851856.739441:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851856.739442:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851856.739443:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851856.739443:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:11.0:1773851856.739444:0:60829:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:11.0:1773851856.739444:0:60829:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.739445:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.739445:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.739446:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851856.739448:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.739448:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851856.739448:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851856.739448:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851856.739449:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 406391005
00000100:00000040:11.0:1773851856.739450:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 1
00000100:00000001:10.0:1773851856.739450:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.739451:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064863744 : -106983644687872 : ffff9eb2eddc9200)
00000100:00000001:10.0:1773851856.739451:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851856.739452:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006164d830 x1858041764681984/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 584/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2138-0'
00000100:00000001:11.0:1773851856.739455:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851856.739455:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851856.739456:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006164d830 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a937d024-898f-4830-9525-051e39c8017b+8:509647:x1858041764681984:12345-26483@kfi7:101:default-tuolumne2138-0
00000100:00000200:11.0:1773851856.739457:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764681984
00000020:00000001:11.0:1773851856.739458:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851856.739458:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851856.739459:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851856.739460:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851856.739461:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:11.0:1773851856.739461:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851856.739462:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041764681984, found 0 last_xid 1858041764681983
00000020:00000001:11.0:1773851856.739462:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851856.739463:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851856.739463:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851856.739464:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851856.739465:0:60829:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:11.0:1773851856.739465:0:60829:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:11.0:1773851856.739465:0:60829:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:11.0:1773851856.739466:0:60829:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:11.0:1773851856.739467:0:60829:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.739468:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:11.0:1773851856.739469:0:60829:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 198
00010000:00000001:11.0:1773851856.739470:0:60829:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.739471:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:11.0:1773851856.739472:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000dfbc811c.
00000020:00000001:11.0:1773851856.739472:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:11.0:1773851856.739473:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000dfbc811c with handle 0x21b6f08f07a6acf9 to hash
00000020:00000001:11.0:1773851856.739474:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:11.0:1773851856.739474:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637107859682240 : -106965849869376 : ffff9eb71283f3c0)
00010000:00000010:11.0:1773851856.739476:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000004491bac8.
00010000:00000001:11.0:1773851856.739476:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637107859682240 : -106965849869376 : ffff9eb71283f3c0)
00010000:00010000:11.0:1773851856.739477:0:60829:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfbc811c/0x21b6f08f07a6acf9 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 199 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f31783b4587f773 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739480:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000040:11.0:1773851856.739481:0:60829:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000f20dc80d : new locks_count 3
00000020:00000040:11.0:1773851856.739482:0:60829:0:(genops.c:871:class_export_get()) GET export 00000000f20dc80d refcount=9
00010000:00000001:11.0:1773851856.739483:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:11.0:1773851856.739484:0:60829:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:11.0:1773851856.739485:0:60829:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:11.0:1773851856.739485:0:60829:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:11.0:1773851856.739486:0:60829:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:11.0:1773851856.739487:0:60829:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:11.0:1773851856.739487:0:60829:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:11.0:1773851856.739488:0:60829:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:11.0:1773851856.739489:0:60829:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:11.0:1773851856.739490:0:60829:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:11.0:1773851856.739490:0:60829:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.739491:0:60829:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:11.0:1773851856.739492:0:60829:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:11.0:1773851856.739492:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851856.739493:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851856.739494:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 000000000caa8b1e.
02000000:00000001:11.0:1773851856.739495:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.739496:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.739496:0:60829:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.739497:0:60829:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:11.0:1773851856.739498:0:60829:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:11.0:1773851856.739498:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851856.739499:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.739499:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.739500:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.739500:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.739501:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.739501:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.739502:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.739502:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.739502:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851856.739503:0:60829:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:11.0:1773851856.739504:0:60829:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:11.0:1773851856.739505:0:60829:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:11.0:1773851856.739505:0:60829:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.739506:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851856.739506:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.739507:0:60829:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:11.0:1773851856.739507:0:60829:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.739508:0:60829:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:11.0:1773851856.739509:0:60829:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 00000000cc8012dd
00000004:00000001:11.0:1773851856.739512:0:60829:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:11.0:1773851856.739512:0:60829:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:11.0:1773851856.739513:0:60829:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:11.0:1773851856.739513:0:60829:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:11.0:1773851856.739514:0:60829:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:11.0:1773851856.739514:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:11.0:1773851856.739515:0:60829:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.739515:0:60829:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.739516:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:11.0:1773851856.739517:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000c148efd2.
00000020:00000001:11.0:1773851856.739517:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:11.0:1773851856.739518:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000c148efd2 with handle 0x21b6f08f07a6ad00 to hash
00000020:00000001:11.0:1773851856.739518:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:11.0:1773851856.739519:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637107859677632 : -106965849873984 : ffff9eb71283e1c0)
00010000:00000010:11.0:1773851856.739520:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a8feb16a.
00010000:00000001:11.0:1773851856.739521:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637107859677632 : -106965849873984 : ffff9eb71283e1c0)
00010000:00000001:11.0:1773851856.739522:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.739522:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.739523:0:60829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 200 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739525:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.739526:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:11.0:1773851856.739527:0:60829:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:11.0:1773851856.739527:0:60829:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:11.0:1773851856.739528:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.739528:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.739529:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.739529:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.739530:0:60829:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:11.0:1773851856.739530:0:60829:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:11.0:1773851856.739531:0:60829:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:11.0:1773851856.739531:0:60829:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:11.0:1773851856.739531:0:60829:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 199
00010000:00000040:11.0:1773851856.739532:0:60829:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:11.0:1773851856.739534:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739537:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739538:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739540:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739541:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739543:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739544:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739546:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739548:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739550:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739551:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739553:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739554:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739557:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739558:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739560:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739561:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739563:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739564:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739566:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739567:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739570:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739571:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739573:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739574:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739576:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739576:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739578:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739579:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739581:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739582:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739584:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739588:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739590:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739591:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739593:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739594:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739596:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739597:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739599:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739600:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739602:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739603:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739604:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739605:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739608:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739609:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739611:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739612:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739614:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739615:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739617:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739618:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739620:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739620:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739622:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739623:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739625:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739625:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739627:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739628:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739630:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739631:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739633:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739634:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739636:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739637:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739639:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739640:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739642:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739643:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739645:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739646:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739648:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739648:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739651:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739652:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739654:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739655:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739657:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739658:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739660:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739661:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739663:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739664:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739666:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739667:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739668:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739669:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739672:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739673:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739675:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739675:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739678:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739679:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a4d807 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25b3 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739680:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739682:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062815ce5/0x21b6f08f07a4d7cf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b924a expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739684:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739685:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d2098ccc/0x21b6f08f07a4d797 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0f4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739687:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739688:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f2deef/0x21b6f08f07a4d75f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84ed expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739690:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739690:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739692:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739693:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739695:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739696:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739698:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739699:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739701:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739702:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739704:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739705:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739707:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739708:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739710:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739711:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739713:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739713:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739716:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739716:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739718:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739719:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739721:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739722:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739729:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739730:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739732:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739733:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739735:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739736:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739738:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739738:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739741:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739741:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739744:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739744:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739746:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739747:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739749:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739750:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739752:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739753:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739755:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739756:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739758:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739759:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739761:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739762:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739764:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739766:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739768:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739769:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739771:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739771:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739774:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739774:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739776:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739777:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739779:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739781:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739783:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739784:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739786:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739787:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739789:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739790:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739792:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739793:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739795:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739796:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739798:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739799:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739801:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739802:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739804:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739805:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739807:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739808:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739810:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739811:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739813:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739814:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739816:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739817:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739819:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739820:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739822:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739823:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739825:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739826:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739828:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739829:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739831:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739832:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739834:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739835:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739837:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739838:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739840:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739841:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739843:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739844:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739846:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739847:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739849:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739849:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739851:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739852:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739855:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739856:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739858:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739858:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739860:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739861:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739864:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739864:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739866:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739867:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739869:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739870:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739872:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739873:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739875:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739876:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739879:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739879:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739882:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739882:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739884:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739885:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739887:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739888:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739890:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739891:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739893:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739894:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739896:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739897:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739899:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739900:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739903:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739904:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739906:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739906:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739908:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739910:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739912:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739912:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739914:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739915:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739917:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739918:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739920:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739921:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739923:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739924:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739927:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739927:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739929:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739930:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739932:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739933:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739935:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739936:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739938:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739939:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739941:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739942:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739944:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739945:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739947:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739949:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739951:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739952:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739954:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739954:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739956:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739957:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739960:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739961:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739963:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739963:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739966:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739967:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739969:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739970:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739972:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739975:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739977:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739978:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739980:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739981:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739983:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739984:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739986:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739986:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739988:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739989:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739991:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739992:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739994:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739995:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.739997:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.739998:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740000:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740001:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740003:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740004:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740006:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740007:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740009:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740010:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740012:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740012:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740014:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740015:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740017:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740018:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740020:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740022:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740024:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740025:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740027:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740027:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740030:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740031:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740033:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740034:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740036:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740036:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740038:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740039:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740041:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740042:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740044:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740046:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740048:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740049:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740051:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740052:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740054:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740055:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740057:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740058:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740060:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740060:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740062:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740063:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740065:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740066:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740068:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740069:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740071:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740072:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740074:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740075:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740077:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740078:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740080:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740081:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740083:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740084:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740086:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740087:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740089:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740090:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740092:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740093:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740096:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740097:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740099:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740100:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740102:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740103:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740105:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740106:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740108:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740109:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740111:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740112:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740114:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740115:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740117:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740119:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740121:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740122:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740124:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740124:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740126:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740127:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740129:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851856.740130:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740132:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00010000:11.0:1773851856.740133:0:60829:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740135:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.740136:0:60829:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:11.0:1773851856.740136:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:11.0:1773851856.740137:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.740137:0:60829:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:11.0:1773851856.740138:0:60829:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.740138:0:60829:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.740139:0:60829:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.740140:0:60829:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:11.0:1773851856.740140:0:60829:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.740141:0:60829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740144:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.740144:0:60829:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:11.0:1773851856.740145:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.740145:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.740146:0:60829:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:11.0:1773851856.740146:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:11.0:1773851856.740148:0:60829:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000002d59cc31.
00010000:00000010:11.0:1773851856.740148:0:60829:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 0000000028079cd4.
00010000:00000001:11.0:1773851856.740149:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:11.0:1773851856.740150:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000031ad8e5c.
00000020:00000001:11.0:1773851856.740151:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:11.0:1773851856.740151:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000031ad8e5c with handle 0x21b6f08f07a6ad07 to hash
00000020:00000001:11.0:1773851856.740152:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:11.0:1773851856.740152:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000010:11.0:1773851856.740153:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000082b7e6f.
00010000:00000001:11.0:1773851856.740154:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000001:11.0:1773851856.740155:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.740156:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.740156:0:60829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740158:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.740159:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:11.0:1773851856.740160:0:60829:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:11.0:1773851856.740160:0:60829:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:11.0:1773851856.740160:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.740161:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.740161:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.740162:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.740162:0:60829:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:11.0:1773851856.740163:0:60829:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:11.0:1773851856.740164:0:60829:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:11.0:1773851856.740164:0:60829:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:11.0:1773851856.740164:0:60829:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (000000002d59cc31) refcount = 1
00010000:00010000:11.0:1773851856.740165:0:60829:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740168:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.740168:0:60829:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:11.0:1773851856.740169:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:11.0:1773851856.740169:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.740170:0:60829:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:11.0:1773851856.740170:0:60829:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.740170:0:60829:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.740171:0:60829:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.740172:0:60829:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:11.0:1773851856.740172:0:60829:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.740173:0:60829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740175:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.740176:0:60829:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:11.0:1773851856.740176:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.740176:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.740177:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.740177:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.740178:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000031ad8e5c refcount=3
00000020:00000001:11.0:1773851856.740178:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000001:11.0:1773851856.740179:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000001:11.0:1773851856.740180:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.740180:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.740181:0:60829:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.740181:0:60829:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.740183:0:60829:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:11.0:1773851856.740188:0:60829:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:11.0:1773851856.740189:0:60829:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:11.0:1773851856.740190:0:60829:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851856.740192:0:60829:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:11.0:1773851856.740198:0:60829:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:11.0:1773851856.740199:0:60829:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:11.0:1773851856.740199:0:60829:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:11.0:1773851856.740200:0:60829:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:11.0:1773851856.740201:0:60829:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:11.0:1773851856.740201:0:60829:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:11.0:1773851856.740202:0:60829:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851856.740203:0:60829:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851856.740204:0:60829:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851856.740204:0:60829:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.740205:0:60829:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.740206:0:60829:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:11.0:1773851856.740206:0:60829:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:11.0:1773851856.740207:0:60829:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:11.0:1773851856.740208:0:60829:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:11.0:1773851856.740208:0:60829:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:11.0:1773851856.740209:0:60829:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:11.0:1773851856.740210:0:60829:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:11.0:1773851856.740210:0:60829:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:11.0:1773851856.740210:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:11.0:1773851856.740211:0:60829:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 233
00010000:00000001:11.0:1773851856.740212:0:60829:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.740213:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:11.0:1773851856.740213:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000f6a91b8a.
00000020:00000001:11.0:1773851856.740214:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:11.0:1773851856.740214:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000f6a91b8a with handle 0x21b6f08f07a6ad0e to hash
00000020:00000001:11.0:1773851856.740215:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:11.0:1773851856.740215:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000010:11.0:1773851856.740216:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000013566a77.
00010000:00000001:11.0:1773851856.740217:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:11.0:1773851856.740218:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.740218:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.740218:0:60829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6a91b8a/0x21b6f08f07a6ad0e lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 234 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740221:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:11.0:1773851856.740222:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:11.0:1773851856.740222:0:60829:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:11.0:1773851856.740223:0:60829:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:11.0:1773851856.740223:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.740224:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.740224:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.740225:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.740225:0:60829:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:11.0:1773851856.740226:0:60829:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:11.0:1773851856.740226:0:60829:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:11.0:1773851856.740226:0:60829:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:11.0:1773851856.740227:0:60829:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 233
00010000:00000040:11.0:1773851856.740228:0:60829:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:11.0:1773851856.740229:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740231:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740232:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740234:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740235:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740237:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740238:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740240:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740241:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740246:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740247:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740249:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740250:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740252:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740253:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740255:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740257:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740259:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740260:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740262:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740264:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740266:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740267:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740269:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740270:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740275:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740276:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740278:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740279:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740281:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740282:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740285:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740286:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740288:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740289:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740291:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740292:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740294:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740295:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740297:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740298:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740302:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740304:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740306:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740307:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740309:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740310:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 9 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740312:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740313:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740315:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740316:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740318:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740319:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740321:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740323:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740325:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740326:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740330:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740331:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740334:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740335:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740337:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740339:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740340:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740342:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740344:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740345:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740347:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740348:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740350:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740351:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740353:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740354:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740357:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740358:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740360:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740362:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740364:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740365:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740367:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740368:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740370:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740371:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740373:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740375:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740377:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740378:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740380:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740381:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740388:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740389:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f504d49/0x21b6f08f07a4d823 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25ba expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740391:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740392:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d71abe2/0x21b6f08f07a4d7eb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b9251 expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740394:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740395:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000057d4c5f/0x21b6f08f07a4d7b3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0fb expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740398:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740399:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc5e9c7/0x21b6f08f07a4d77b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84f4 expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740401:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740402:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740404:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740405:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740407:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740408:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740410:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740411:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740415:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740416:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740418:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740420:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740422:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740423:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740425:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740426:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740428:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740429:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740431:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740432:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740434:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740435:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740437:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740438:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740441:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740442:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740444:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740445:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740448:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740450:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740452:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740453:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740455:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740456:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740458:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740460:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740462:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740463:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740465:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740466:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740468:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740469:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740471:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740473:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740475:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740476:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740478:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740479:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740481:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740482:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740484:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740485:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740487:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740488:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740490:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740491:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740493:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740495:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740497:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740498:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740500:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740501:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740503:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740504:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740506:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740507:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740509:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740510:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740512:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740513:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740515:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740516:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740528:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740529:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740531:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740532:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740534:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740535:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740537:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740538:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740540:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740541:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740543:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740544:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740546:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740547:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740549:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740550:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740553:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740554:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740556:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740557:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740559:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740560:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740562:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740563:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740565:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740566:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740568:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740569:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740571:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740573:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740575:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740575:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740578:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740579:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740581:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740582:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740584:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740587:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740589:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740589:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740591:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740592:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740595:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740596:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740598:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740599:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740601:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740602:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740605:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740607:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740608:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740609:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740612:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740613:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740615:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740616:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740618:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740619:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740621:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740622:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740624:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740625:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740627:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740628:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740631:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740632:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740634:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740635:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740637:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740638:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740641:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740642:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740644:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740645:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740647:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740648:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740651:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740652:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740654:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740655:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740659:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740661:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740663:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740664:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740667:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740668:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740670:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740671:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740673:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740674:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740676:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740677:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740679:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740680:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740682:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740684:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740687:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740688:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740690:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740692:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740694:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740696:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740698:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740699:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740701:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740702:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740705:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740706:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740708:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740709:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740711:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740712:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740715:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740716:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740718:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740720:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740722:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740723:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740729:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740730:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740732:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740733:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740735:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740736:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740738:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740739:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740741:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740743:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740746:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740747:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740750:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740751:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740753:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740754:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740756:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740758:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740759:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740761:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740763:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740764:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740766:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740767:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740769:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740770:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740773:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740774:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740776:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740777:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740779:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740781:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740782:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740783:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740785:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740787:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740789:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740790:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740792:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740793:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740795:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740796:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740799:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740800:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740802:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740803:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740805:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740807:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740808:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740809:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740811:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740813:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740815:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740816:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740818:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740819:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740821:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740823:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740825:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740827:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740828:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740830:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740832:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740833:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740835:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740836:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740838:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740839:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740841:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740842:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740844:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740845:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740847:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740848:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740851:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740852:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740854:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740855:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740857:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740858:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740860:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740861:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740863:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740864:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740866:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740867:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740869:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740870:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740872:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740873:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740878:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740879:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740881:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740882:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740885:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740886:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740888:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740889:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740891:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740892:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740894:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740896:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740898:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740899:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740901:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740902:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740905:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740907:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740909:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740910:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740912:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740913:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740915:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740916:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740919:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740920:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740922:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740923:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740926:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740927:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740929:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740930:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740933:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740934:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740936:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740937:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740939:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740940:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740942:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740943:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740945:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740946:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740948:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740950:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740952:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740953:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740955:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740956:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740959:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740960:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740962:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740963:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740965:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740967:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740969:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740970:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740972:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740973:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740975:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740977:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740979:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740980:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740982:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740983:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740986:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740987:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740989:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740990:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740992:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740993:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740995:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740996:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.740998:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.740999:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741001:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.741003:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741004:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.741005:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741008:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.741009:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741012:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.741012:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741014:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.741016:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741018:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:11.0:1773851856.741019:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741020:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00010000:11.0:1773851856.741021:0:60829:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6a91b8a/0x21b6f08f07a6ad0e lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741023:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:11.0:1773851856.741024:0:60829:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:11.0:1773851856.741024:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:11.0:1773851856.741025:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741025:0:60829:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:11.0:1773851856.741026:0:60829:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.741026:0:60829:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741027:0:60829:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.741027:0:60829:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:11.0:1773851856.741028:0:60829:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.741028:0:60829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6a91b8a/0x21b6f08f07a6ad0e lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741030:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:11.0:1773851856.741031:0:60829:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:11.0:1773851856.741032:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741032:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741032:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.741033:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.741033:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f6a91b8a refcount=3
00000020:00000001:11.0:1773851856.741034:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:11.0:1773851856.741034:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:11.0:1773851856.741035:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741036:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.741036:0:60829:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.741038:0:60829:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:11.0:1773851856.741039:0:60829:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:11.0:1773851856.741040:0:60829:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.741041:0:60829:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.741042:0:60829:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:11.0:1773851856.741042:0:60829:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:11.0:1773851856.741043:0:60829:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:11.0:1773851856.741045:0:60829:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.741045:0:60829:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741046:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.741047:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.741047:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f6a91b8a refcount=3
00000020:00000001:11.0:1773851856.741047:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:11.0:1773851856.741048:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00000004:00010000:11.0:1773851856.741049:0:60829:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6a91b8a/0x21b6f08f07a6ad0e lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741051:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:11.0:1773851856.741051:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741052:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.741052:0:60829:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:11.0:1773851856.741053:0:60829:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:11.0:1773851856.741053:0:60829:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:11.0:1773851856.741054:0:60829:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:11.0:1773851856.741055:0:60829:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:11.0:1773851856.741055:0:60829:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:11.0:1773851856.741057:0:60829:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:11.0:1773851856.741057:0:60829:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:11.0:1773851856.741058:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.741058:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.741058:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c148efd2 refcount=3
00000020:00000001:11.0:1773851856.741059:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859677632 : -106965849873984 : ffff9eb71283e1c0)
00010000:00000001:11.0:1773851856.741060:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859677632 : -106965849873984 : ffff9eb71283e1c0)
00010000:00000001:11.0:1773851856.741061:0:60829:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:11.0:1773851856.741061:0:60829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741064:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.741065:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741065:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:11.0:1773851856.741065:0:60829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741067:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.741068:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.741068:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741069:0:60829:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:11.0:1773851856.741070:0:60829:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741072:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00010000:11.0:1773851856.741073:0:60829:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000c148efd2 already unused, calling callback (000000001690cbe4)
00000004:00000001:11.0:1773851856.741074:0:60829:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:11.0:1773851856.741075:0:60829:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:11.0:1773851856.741075:0:60829:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741078:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.741078:0:60829:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:11.0:1773851856.741079:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.741080:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.741080:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c148efd2 refcount=4
00000020:00000001:11.0:1773851856.741081:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859677632 : -106965849873984 : ffff9eb71283e1c0)
00010000:00000001:11.0:1773851856.741081:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859677632 : -106965849873984 : ffff9eb71283e1c0)
00010000:00000001:11.0:1773851856.741082:0:60829:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:11.0:1773851856.741082:0:60829:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741084:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.741085:0:60829:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:11.0:1773851856.741086:0:60829:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:11.0:1773851856.741086:0:60829:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741087:0:60829:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:11.0:1773851856.741087:0:60829:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:11.0:1773851856.741088:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.741088:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851856.741089:0:60829:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c148efd2 with handle 0x21b6f08f07a6ad00 from hash
00010000:00000001:11.0:1773851856.741090:0:60829:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:11.0:1773851856.741090:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741090:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741091:0:60829:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:11.0:1773851856.741091:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:11.0:1773851856.741092:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741092:0:60829:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:11.0:1773851856.741093:0:60829:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:11.0:1773851856.741093:0:60829:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:11.0:1773851856.741094:0:60829:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:11.0:1773851856.741095:0:60829:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:11.0:1773851856.741095:0:60829:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.741096:0:60829:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741097:0:60829:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:11.0:1773851856.741097:0:60829:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:11.0:1773851856.741098:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741098:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741100:0:60829:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741100:0:60829:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.741101:0:60829:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.741102:0:60829:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741104:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:11.0:1773851856.741104:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741105:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741105:0:60829:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:11.0:1773851856.741105:0:60829:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:11.0:1773851856.741106:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:11.0:1773851856.741106:0:60829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c148efd2/0x21b6f08f07a6ad00 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741108:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000010:11.0:1773851856.741109:0:60829:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a8feb16a.
00010000:00000040:11.0:1773851856.741110:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000001:11.0:1773851856.741110:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.741111:0:60829:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:11.0:1773851856.741111:0:60829:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:11.0:1773851856.741112:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.741112:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.741112:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000031ad8e5c refcount=3
00000020:00000001:11.0:1773851856.741113:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000001:11.0:1773851856.741113:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000001:11.0:1773851856.741114:0:60829:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:11.0:1773851856.741114:0:60829:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741116:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.741117:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741117:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:11.0:1773851856.741118:0:60829:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741122:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.741123:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.741123:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741124:0:60829:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:11.0:1773851856.741124:0:60829:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741126:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00010000:11.0:1773851856.741127:0:60829:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000031ad8e5c already unused, calling callback (000000001690cbe4)
00000004:00000001:11.0:1773851856.741128:0:60829:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:11.0:1773851856.741128:0:60829:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:11.0:1773851856.741128:0:60829:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741131:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.741131:0:60829:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:11.0:1773851856.741131:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.741132:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.741132:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000031ad8e5c refcount=4
00000020:00000001:11.0:1773851856.741133:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000001:11.0:1773851856.741134:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859674176 : -106965849877440 : ffff9eb71283d440)
00010000:00000001:11.0:1773851856.741134:0:60829:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:11.0:1773851856.741134:0:60829:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741136:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.741137:0:60829:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:11.0:1773851856.741137:0:60829:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:11.0:1773851856.741138:0:60829:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741138:0:60829:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:11.0:1773851856.741139:0:60829:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:11.0:1773851856.741140:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.741140:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851856.741140:0:60829:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000031ad8e5c with handle 0x21b6f08f07a6ad07 from hash
00010000:00000001:11.0:1773851856.741141:0:60829:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:11.0:1773851856.741142:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741142:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741142:0:60829:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:11.0:1773851856.741142:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:11.0:1773851856.741143:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741143:0:60829:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:11.0:1773851856.741144:0:60829:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:11.0:1773851856.741144:0:60829:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:11.0:1773851856.741145:0:60829:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (000000002d59cc31)
00010000:00010000:11.0:1773851856.741145:0:60829:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:11.0:1773851856.741146:0:60829:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.741147:0:60829:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741147:0:60829:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:11.0:1773851856.741147:0:60829:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:11.0:1773851856.741148:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741148:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741149:0:60829:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741149:0:60829:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.741150:0:60829:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.741150:0:60829:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741152:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000001:11.0:1773851856.741153:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741153:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741154:0:60829:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:11.0:1773851856.741154:0:60829:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:11.0:1773851856.741154:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:11.0:1773851856.741155:0:60829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000031ad8e5c/0x21b6f08f07a6ad07 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741157:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 1
00010000:00000010:11.0:1773851856.741158:0:60829:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000082b7e6f.
00010000:00000040:11.0:1773851856.741159:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002d59cc31 count: 0
00010000:00000010:11.0:1773851856.741160:0:60829:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 0000000028079cd4.
00010000:00000001:11.0:1773851856.741161:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.741161:0:60829:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:11.0:1773851856.741161:0:60829:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:11.0:1773851856.741162:0:60829:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:11.0:1773851856.741162:0:60829:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:11.0:1773851856.741163:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.741163:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.741163:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f6a91b8a refcount=3
00000020:00000001:11.0:1773851856.741164:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:11.0:1773851856.741165:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00000004:00000040:11.0:1773851856.741165:0:60829:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000f20dc80d : new locks_count 4
00000020:00000040:11.0:1773851856.741166:0:60829:0:(genops.c:871:class_export_get()) GET export 00000000f20dc80d refcount=10
00010000:00000001:11.0:1773851856.741167:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741167:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.741167:0:60829:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:11.0:1773851856.741168:0:60829:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:11.0:1773851856.741169:0:60829:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:11.0:1773851856.741169:0:60829:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:11.0:1773851856.741170:0:60829:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:11.0:1773851856.741170:0:60829:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:11.0:1773851856.741171:0:60829:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:11.0:1773851856.741171:0:60829:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:11.0:1773851856.741172:0:60829:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.741173:0:60829:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:11.0:1773851856.741174:0:60829:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:11.0:1773851856.741174:0:60829:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:11.0:1773851856.741175:0:60829:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:11.0:1773851856.741175:0:60829:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:11.0:1773851856.741176:0:60829:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:11.0:1773851856.741176:0:60829:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:11.0:1773851856.741177:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741177:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741177:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.741178:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851856.741179:0:60829:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000dfbc811c with handle 0x21b6f08f07a6acf9 from hash
00010000:00000001:11.0:1773851856.741179:0:60829:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:11.0:1773851856.741180:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741180:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741180:0:60829:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:11.0:1773851856.741181:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:11.0:1773851856.741181:0:60829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfbc811c/0x21b6f08f07a6acf9 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 199 type: IBT gid 0 flags: 0x44000000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f773 expref: 10 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741183:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000040:11.0:1773851856.741184:0:60829:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f20dc80d : new locks_count 3
00000020:00000040:11.0:1773851856.741185:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 9
00010000:00000010:11.0:1773851856.741185:0:60829:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000004491bac8.
00010000:00000040:11.0:1773851856.741186:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 197
00010000:00000001:11.0:1773851856.741187:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.741187:0:60829:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741188:0:60829:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:11.0:1773851856.741188:0:60829:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6a91b8a/0x21b6f08f07a6ad0e lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f773 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.741191:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:11.0:1773851856.741191:0:60829:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:11.0:1773851856.741192:0:60829:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:11.0:1773851856.741192:0:60829:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:11.0:1773851856.741193:0:60829:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:11.0:1773851856.741193:0:60829:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.741194:0:60829:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.741195:0:60829:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:11.0:1773851856.741195:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.741195:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:11.0:1773851856.741196:0:60829:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000f6a91b8a, rc 0)
00000020:00000001:11.0:1773851856.741196:0:60829:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851856.741197:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260805375, transno 0, xid 1858041764681984
00010000:00000001:11.0:1773851856.741199:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851856.741200:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006164d830 x1858041764681984/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 584/640 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00010000:00000001:11.0:1773851856.741202:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851856.741203:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851856.741204:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=89 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851856.741205:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851856.741205:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00000100:00000001:11.0:1773851856.741206:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
02000000:00000001:11.0:1773851856.741207:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851856.741207:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.741208:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851856.741209:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26483@kfi7
00000400:00000010:11.0:1773851856.741209:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ed9687dd.
00000100:00000200:11.0:1773851856.741211:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858041764681984, offset 224
00000400:00000200:11.0:1773851856.741212:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26483@kfi7
00000400:00000200:11.0:1773851856.741213:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:11.0:1773851856.741214:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00000400:00000200:11.0:1773851856.741215:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:11.0:1773851856.741216:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000400:00000200:11.0:1773851856.741217:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26483@kfi7 local destination
00000400:00000200:11.0:1773851856.741218:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768703:8768703:1024:4294967295] 26483@kfi7 LPNI seq info [184802:184802:16:4294967295]
00000400:00000200:11.0:1773851856.741220:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:11.0:1773851856.741221:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:11.0:1773851856.741223:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26483@kfi7(26483@kfi7:26483@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851856.741224:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000800:00000200:11.0:1773851856.741225:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851856.741227:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:11.0:1773851856.741229:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851856.741231:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Using peer 26483@kfi7(0x1000000000000e7)
00000800:00000200:11.0:1773851856.741235:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 740 bytes to peer 0x1000000000000e7: rc=0
00000800:00000200:11.0:1773851856.741236:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851856.741238:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851856.741239:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 2 to 26483@kfi7
00010000:00000001:11.0:1773851856.741239:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851856.741240:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851856.741241:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851856.741241:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006164d830 x1858041764681984/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 584/640 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00000100:00100000:11.0:1773851856.741244:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006164d830 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a937d024-898f-4830-9525-051e39c8017b+9:509647:x1858041764681984:12345-26483@kfi7:101:default-tuolumne2138-0 Request processed in 1789us (1818us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851856.741247:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 406391005
00000100:00000040:11.0:1773851856.741248:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 0
00000100:00000001:11.0:1773851856.741249:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:10.0:1773851856.741249:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851856.741250:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851856.741250:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851856.741251:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000400:00000200:10.0:1773851856.741251:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851856.741252:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009503e737.
00000020:00000040:11.0:1773851856.741252:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 8
00000400:00000200:10.0:1773851856.741252:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26483@kfi7: PUT: OK
00000100:00000001:11.0:1773851856.741253:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851856.741253:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ed9687dd
00000400:00000010:10.0:1773851856.741253:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ed9687dd.
00000100:00000001:10.0:1773851856.741254:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851856.741254:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851856.741255:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000800:00000200:10.0:1773851856.741257:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Transaction freed
00000800:00000200:25.0:1773851856.741498:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851856.741499:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851856.741501:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851856.741503:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851856.741506:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.741507:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26547@kfi7 : PUT - for me
00000400:00000200:25.0:1773851856.741508:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.741509:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 1
00000400:00000200:25.0:1773851856.741510:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.741510:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000400:00000200:25.0:1773851856.741511:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 3
00000400:00000200:25.0:1773851856.741512:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:25.0:1773851856.741513:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 328 into portal 17 MB=0x699e10f5c9980
00000400:00000200:25.0:1773851856.741515:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-26483@kfi7 of length 328/328 into md 0x1615af7ff9 [2] + 1640
00000800:00000200:25.0:1773851856.741518:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851856.741519:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851856.741520:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26547@kfi7: PUT: OK
00000100:00000001:25.0:1773851856.741521:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851856.741522:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:25.0:1773851856.741523:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000627f12de.
00000100:00000040:25.0:1773851856.741524:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000627f12de x1858041764682112 msgsize 328
00000100:00100000:25.0:1773851856.741525:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26547@kfi7)
00000100:00000001:25.0:1773851856.741526:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851856.741527:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000100:00000001:27.0:1773851856.741529:0:184027:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851856.741529:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851856.741530:0:184027:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851856.741532:0:184027:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851856.741533:0:184027:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851856.741534:0:184027:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851856.741536:0:184027:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764682112
00000020:00000001:27.0:1773851856.741537:0:184027:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851856.741538:0:184027:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000020:00000001:27.0:1773851856.741539:0:184027:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851856.741541:0:184027:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=9
00000020:00000001:27.0:1773851856.741542:0:184027:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000020:00000001:27.0:1773851856.741543:0:184027:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:27.0:1773851856.741544:0:184027:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851856.741545:0:184027:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851856.741546:0:184027:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009edd1273.
00000020:00000010:27.0:1773851856.741548:0:184027:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000022b22b54.
00000020:00000010:27.0:1773851856.741549:0:184027:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000767c635b.
00000100:00000040:27.0:1773851856.741551:0:184027:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:27.0:1773851856.741552:0:184027:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851856.741553:0:184027:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:27.0:1773851856.741554:0:184027:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:27.0:1773851856.741555:0:184027:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851856.741556:0:184027:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:27.0:1773851856.741557:0:184027:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851856.741558:0:184027:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851856.741559:0:184027:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f6a91b8a refcount=3
00000020:00000001:27.0:1773851856.741560:0:184027:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:27.0:1773851856.741561:0:184027:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:27.0:1773851856.741562:0:184027:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851856.741563:0:184027:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851856.741564:0:184027:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851856.741565:0:184027:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851856.741567:0:184027:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851856.741568:0:184027:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851856.741570:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851856.741571:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851856.741571:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851856.741572:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851856.741572:0:533719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 105589641
00000100:00000001:27.0:1773851856.741573:0:184027:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.741573:0:533719:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 1
00000100:00000001:26.0:1773851856.741574:0:533719:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636968615761280 : -107105093790336 : ffff9e96a6ee5580)
00000100:00000001:27.0:1773851856.741575:0:184027:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.741575:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000627f12de x1858041764682112/t0(0) o103->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 328/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:26.0:1773851856.741578:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.741579:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851856.741580:0:533719:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000627f12de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:a937d024-898f-4830-9525-051e39c8017b+9:39820:x1858041764682112:12345-26483@kfi7:103:
00000100:00000200:26.0:1773851856.741581:0:533719:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764682112
00010000:00000001:26.0:1773851856.741582:0:533719:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:26.0:1773851856.741583:0:533719:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:26.0:1773851856.741583:0:533719:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:26.0:1773851856.741584:0:533719:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851856.741585:0:533719:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851856.741586:0:533719:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd49e8f6.
02000000:00000001:26.0:1773851856.741586:0:533719:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.741587:0:533719:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.741588:0:533719:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:26.0:1773851856.741588:0:533719:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:26.0:1773851856.741589:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851856.741589:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851856.741590:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f6a91b8a refcount=3
00000020:00000001:26.0:1773851856.741590:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000001:26.0:1773851856.741591:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859683392 : -106965849868224 : ffff9eb71283f840)
00010000:00000040:26.0:1773851856.741592:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 234
00000004:00000001:26.0:1773851856.741594:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851856.741594:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851856.741595:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851856.741595:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851856.741596:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.741597:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.741598:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851856.741599:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851856.741600:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851856.741600:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851856.741601:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851856.741601:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851856.741602:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f6a91b8a with handle 0x21b6f08f07a6ad0e from hash
00010000:00000001:26.0:1773851856.741603:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851856.741603:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851856.741604:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851856.741604:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851856.741605:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851856.741606:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.741606:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851856.741606:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851856.741607:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6a91b8a/0x21b6f08f07a6ad0e lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x44a01000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f773 expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851856.741610:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:26.0:1773851856.741611:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f20dc80d : new locks_count 2
00000020:00000040:26.0:1773851856.741612:0:533719:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 8
00010000:00000010:26.0:1773851856.741612:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000013566a77.
00010000:00000040:26.0:1773851856.741613:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:26.0:1773851856.741614:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851856.741615:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851856.741615:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851856.741616:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:26.0:1773851856.741617:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851856.741617:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.741618:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851856.741619:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 232
00010000:00010000:26.0:1773851856.741619:0:533719:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:26.0:1773851856.741620:0:533719:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851856.741621:0:533719:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851856.741622:0:533719:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851856.741622:0:533719:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=110 v=66 (1 1 0 1)
00000100:00000001:26.0:1773851856.741623:0:533719:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851856.741624:0:533719:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00000100:00000001:26.0:1773851856.741625:0:533719:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
02000000:00000001:26.0:1773851856.741626:0:533719:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851856.741626:0:533719:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.741627:0:533719:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851856.741628:0:533719:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26547@kfi7
00000400:00000010:26.0:1773851856.741628:0:533719:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000394249d0.
00000100:00000200:26.0:1773851856.741630:0:533719:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1858041764682112, offset 224
00000400:00000200:26.0:1773851856.741631:0:533719:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26547@kfi7
00000400:00000200:26.0:1773851856.741632:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:26.0:1773851856.741633:0:533719:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 1
00000400:00000200:26.0:1773851856.741634:0:533719:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000400:00000200:26.0:1773851856.741635:0:533719:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 3
00000400:00000200:26.0:1773851856.741636:0:533719:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26547@kfi7 local destination
00000400:00000200:26.0:1773851856.741637:0:533719:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768704:8768704:1024:4294967295] 26547@kfi7 LPNI seq info [184803:184803:16:4294967295]
00000400:00000200:26.0:1773851856.741639:0:533719:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000400:00000200:26.0:1773851856.741640:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:26.0:1773851856.741642:0:533719:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26547@kfi7(26547@kfi7:26547@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851856.741643:0:533719:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 3
00000800:00000200:26.0:1773851856.741644:0:533719:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851856.741645:0:533719:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851856.741647:0:533719:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851856.741650:0:533719:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c Using peer 26547@kfi7(0x124c)
00000800:00000200:26.0:1773851856.741653:0:533719:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x124c: rc=0
00000800:00000200:26.0:1773851856.741655:0:533719:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851856.741657:0:533719:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.741658:0:533719:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 2 to 26483@kfi7
00010000:00000001:26.0:1773851856.741658:0:533719:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.741659:0:533719:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.741660:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000627f12de x1858041764682112/t0(0) o103->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 328/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:26.0:1773851856.741663:0:533719:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000627f12de pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:a937d024-898f-4830-9525-051e39c8017b+8:39820:x1858041764682112:12345-26483@kfi7:103: Request processed in 84us (138us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851856.741665:0:533719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 105589641
00000100:00000040:26.0:1773851856.741666:0:533719:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 0
00000100:00000001:26.0:1773851856.741667:0:533719:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851856.741667:0:533719:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851856.741668:0:533719:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000022b22b54.
00000800:00000200:25.0:1773851856.741668:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851856.741669:0:533719:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000767c635b.
00000400:00000200:25.0:1773851856.741669:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851856.741670:0:533719:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009edd1273.
00000400:00000200:25.0:1773851856.741670:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26547@kfi7: PUT: OK
00000020:00000040:26.0:1773851856.741671:0:533719:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 7
00000100:00000001:26.0:1773851856.741671:0:533719:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851856.741671:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000394249d0
00000400:00000010:25.0:1773851856.741671:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000394249d0.
00000100:00000001:25.0:1773851856.741672:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851856.741673:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851856.741673:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000800:00000200:25.0:1773851856.741675:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c Transaction freed
00000800:00000200:10.0:1773851856.742953:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851856.742954:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851856.742955:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851856.742958:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851856.742960:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.742961:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26483@kfi7 : PUT - for me
00000400:00000200:10.0:1773851856.742962:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.742963:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00000400:00000200:10.0:1773851856.742964:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.742965:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:10.0:1773851856.742966:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000400:00000200:10.0:1773851856.742967:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:10.0:1773851856.742967:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 576 into portal 12 MB=0x699e10f5c9dc0
00000400:00000200:10.0:1773851856.742969:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26483@kfi7 of length 576/576 into md 0x78146ce49 [64] + 122632
00000800:00000200:10.0:1773851856.742971:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851856.742973:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851856.742974:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26483@kfi7: PUT: OK
00000100:00000001:10.0:1773851856.742975:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851856.742975:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851856.742976:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e177912e.
00000100:00000040:10.0:1773851856.742977:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000e177912e x1858041764683200 msgsize 576
00000100:00100000:10.0:1773851856.742978:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26483@kfi7)
00000100:00000001:10.0:1773851856.742979:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851856.742980:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:10.0:1773851856.742980:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
02000000:00000001:11.0:1773851856.742981:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851856.742981:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851856.742981:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851856.742982:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851856.742983:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851856.742984:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764683200
00000020:00000001:11.0:1773851856.742984:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851856.742985:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000020:00000001:11.0:1773851856.742986:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.742986:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=8
00000020:00000001:11.0:1773851856.742989:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000020:00000001:11.0:1773851856.742990:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:11.0:1773851856.742991:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851856.742992:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851856.742992:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000faab3b2c.
00000020:00000010:11.0:1773851856.742993:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851856.742994:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851856.742995:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851856.742995:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:11.0:1773851856.742996:0:60829:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:11.0:1773851856.742996:0:60829:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.742997:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.742998:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.742999:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851856.743000:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851856.743000:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851856.743000:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851856.743001:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 406391006
00000100:00000001:10.0:1773851856.743001:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851856.743002:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 1
00000100:00000001:10.0:1773851856.743002:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.743003:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077420032 : -106968632131584 : ffff9eb66cae0000)
00000100:00000001:10.0:1773851856.743003:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851856.743004:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e177912e x1858041764683200/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 576/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2138-0'
00000100:00000001:11.0:1773851856.743006:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851856.743007:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851856.743007:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e177912e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a937d024-898f-4830-9525-051e39c8017b+8:509647:x1858041764683200:12345-26483@kfi7:101:default-tuolumne2138-0
00000100:00000200:11.0:1773851856.743009:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764683200
00000020:00000001:11.0:1773851856.743009:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851856.743010:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851856.743010:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851856.743011:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851856.743011:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:11.0:1773851856.743012:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851856.743012:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041764683200, found 0 last_xid 1858041764683199
00000020:00000001:11.0:1773851856.743013:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851856.743014:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851856.743014:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851856.743015:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851856.743016:0:60829:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:11.0:1773851856.743016:0:60829:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:11.0:1773851856.743017:0:60829:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:11.0:1773851856.743018:0:60829:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:11.0:1773851856.743018:0:60829:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.743019:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:11.0:1773851856.743020:0:60829:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 198
00010000:00000001:11.0:1773851856.743021:0:60829:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.743022:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:11.0:1773851856.743022:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000d6844d18.
00000020:00000001:11.0:1773851856.743023:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:11.0:1773851856.743024:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000d6844d18 with handle 0x21b6f08f07a6ad15 to hash
00000020:00000001:11.0:1773851856.743024:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:11.0:1773851856.743025:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637107859684544 : -106965849867072 : ffff9eb71283fcc0)
00010000:00000010:11.0:1773851856.743026:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000007d3d878b.
00010000:00000001:11.0:1773851856.743026:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637107859684544 : -106965849867072 : ffff9eb71283fcc0)
00010000:00010000:11.0:1773851856.743027:0:60829:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6844d18/0x21b6f08f07a6ad15 lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 199 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f31783b4587f79d expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743029:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000040:11.0:1773851856.743030:0:60829:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000f20dc80d : new locks_count 3
00000020:00000040:11.0:1773851856.743030:0:60829:0:(genops.c:871:class_export_get()) GET export 00000000f20dc80d refcount=9
00010000:00000001:11.0:1773851856.743032:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:11.0:1773851856.743032:0:60829:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:11.0:1773851856.743033:0:60829:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:11.0:1773851856.743033:0:60829:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:11.0:1773851856.743033:0:60829:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:11.0:1773851856.743034:0:60829:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:11.0:1773851856.743034:0:60829:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:11.0:1773851856.743035:0:60829:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:11.0:1773851856.743037:0:60829:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:11.0:1773851856.743037:0:60829:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:11.0:1773851856.743038:0:60829:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743038:0:60829:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:11.0:1773851856.743039:0:60829:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:11.0:1773851856.743039:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851856.743040:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851856.743041:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000bf1da5ba.
02000000:00000001:11.0:1773851856.743042:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.743043:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743043:0:60829:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743044:0:60829:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:11.0:1773851856.743045:0:60829:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:11.0:1773851856.743045:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851856.743045:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743046:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.743046:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743047:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.743047:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743048:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.743048:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743049:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.743049:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851856.743049:0:60829:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:11.0:1773851856.743050:0:60829:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:11.0:1773851856.743051:0:60829:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:11.0:1773851856.743051:0:60829:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743051:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851856.743052:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743052:0:60829:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:11.0:1773851856.743053:0:60829:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743053:0:60829:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:11.0:1773851856.743054:0:60829:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 00000000e7cad939
00000004:00000001:11.0:1773851856.743055:0:60829:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:11.0:1773851856.743055:0:60829:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:11.0:1773851856.743056:0:60829:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:11.0:1773851856.743057:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:11.0:1773851856.743057:0:60829:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 199
00010000:00000001:11.0:1773851856.743058:0:60829:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.743058:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:11.0:1773851856.743059:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000006227810.
00000020:00000001:11.0:1773851856.743060:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:11.0:1773851856.743060:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000006227810 with handle 0x21b6f08f07a6ad1c to hash
00000020:00000001:11.0:1773851856.743061:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:11.0:1773851856.743061:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000010:11.0:1773851856.743062:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000f4e37007.
00010000:00000001:11.0:1773851856.743062:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000001:11.0:1773851856.743063:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.743064:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.743064:0:60829:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000006227810/0x21b6f08f07a6ad1c lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 200 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743067:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:11.0:1773851856.743067:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:11.0:1773851856.743068:0:60829:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:11.0:1773851856.743068:0:60829:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:11.0:1773851856.743069:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.743069:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.743070:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:11.0:1773851856.743070:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.743071:0:60829:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:11.0:1773851856.743071:0:60829:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:11.0:1773851856.743072:0:60829:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:11.0:1773851856.743072:0:60829:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:11.0:1773851856.743073:0:60829:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 199
00010000:00000040:11.0:1773851856.743073:0:60829:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:11.0:1773851856.743074:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743076:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743077:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743079:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743080:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743082:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743083:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743086:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743086:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743089:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743090:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743092:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743092:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743095:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743096:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743098:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743099:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743101:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743103:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743105:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743106:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743108:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743109:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743111:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743112:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743114:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743115:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743117:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743117:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743119:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743120:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743122:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743123:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743126:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743127:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743129:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743130:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743132:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743133:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743136:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743137:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743138:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743139:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743141:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743142:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743144:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743145:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 9 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743147:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743148:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743150:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743152:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743154:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743155:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743157:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743157:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743160:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743161:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743163:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743164:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743166:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743167:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743169:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743170:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743172:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743173:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743175:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743176:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743178:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743179:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743181:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743182:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743185:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743185:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743188:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743189:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743191:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743191:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743193:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743195:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743196:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743198:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743200:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743201:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743203:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743204:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743206:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743207:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743209:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743210:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743212:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743213:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008294d81b/0x21b6f08f07a4d831 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25e4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743215:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743216:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6fd604e/0x21b6f08f07a4d7f9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b927b expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743218:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743219:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a4d7c1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc125 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743221:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743221:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000006bb1a52/0x21b6f08f07a4d789 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c851e expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743223:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743225:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743227:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743228:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743230:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743231:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743233:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743234:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743235:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743236:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743238:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743239:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743241:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743242:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743244:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743245:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743247:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743248:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743250:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743251:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743253:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743254:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743257:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743257:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743260:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743260:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743262:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743263:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743265:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743266:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743268:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743269:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743271:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743273:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743275:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743276:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743278:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743279:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743281:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743282:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743284:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743285:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743287:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743288:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743290:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743291:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743293:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743294:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743296:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743297:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743299:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743300:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743302:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743303:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743305:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743306:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743308:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743309:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743311:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743312:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743314:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743315:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743317:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743318:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743320:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743321:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743323:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743324:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743326:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743327:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743330:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743330:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743333:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743334:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743336:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743336:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743339:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743340:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743342:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743342:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743344:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743346:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743348:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743349:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743351:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743352:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743354:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743355:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743357:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743358:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743360:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743361:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743363:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743364:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743366:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743367:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743369:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743372:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743374:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743375:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743377:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743378:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743380:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743381:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743383:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743384:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743386:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743388:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743390:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743391:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743393:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743394:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743396:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743397:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743399:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743400:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743402:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743403:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743405:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743406:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743408:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743409:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743411:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743412:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743414:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743415:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743417:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743418:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743420:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743421:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743423:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743424:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743426:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743427:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743429:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743430:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743432:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743433:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743435:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743436:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743438:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743439:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743441:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743442:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743444:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743446:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743448:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743449:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743451:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743452:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743454:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743455:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743457:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743458:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743460:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743461:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743463:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743464:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743466:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743467:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743469:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743471:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743473:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743474:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743476:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743477:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743479:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743480:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743482:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743483:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743485:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743486:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743488:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743489:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743491:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743492:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743494:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743496:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743498:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743499:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743501:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743502:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743504:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743505:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743507:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743508:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743510:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743511:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743513:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743514:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743516:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743517:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743519:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743521:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743523:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743524:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743526:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743527:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743529:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743530:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743532:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743533:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743535:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743536:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743538:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743539:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743541:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743542:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743544:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743546:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743548:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743549:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743551:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743552:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743554:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743555:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743557:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743558:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743560:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743561:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743563:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743564:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743566:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743567:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743569:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743570:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743572:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743573:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743575:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743576:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743578:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743579:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743581:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743583:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743585:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743585:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743587:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743588:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743590:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743591:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743593:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743595:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743597:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743597:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743599:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743600:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743603:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743604:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743606:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743607:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743609:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743610:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743612:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743613:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743615:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743616:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743618:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743619:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743621:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743622:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743624:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743626:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743628:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743629:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743631:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743632:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743634:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743635:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743637:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743638:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743640:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743642:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743644:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743646:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743647:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743649:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743650:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743652:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743654:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743655:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743657:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743658:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743660:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743661:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743663:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743664:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743666:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743667:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743669:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743670:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743672:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743673:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743675:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743676:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743678:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743679:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743681:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00010000:11.0:1773851856.743682:0:60829:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000006227810/0x21b6f08f07a6ad1c lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743684:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:11.0:1773851856.743684:0:60829:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:11.0:1773851856.743685:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:11.0:1773851856.743685:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.743686:0:60829:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:11.0:1773851856.743686:0:60829:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.743687:0:60829:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.743687:0:60829:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851856.743688:0:60829:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:11.0:1773851856.743688:0:60829:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851856.743689:0:60829:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000006227810/0x21b6f08f07a6ad1c lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743691:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:11.0:1773851856.743692:0:60829:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:11.0:1773851856.743692:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.743693:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.743693:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.743694:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.743694:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006227810 refcount=3
00000020:00000001:11.0:1773851856.743695:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000001:11.0:1773851856.743695:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000001:11.0:1773851856.743696:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.743696:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.743697:0:60829:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743697:0:60829:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743698:0:60829:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:11.0:1773851856.743699:0:60829:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:11.0:1773851856.743700:0:60829:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:11.0:1773851856.743707:0:60829:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743708:0:60829:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:11.0:1773851856.743708:0:60829:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:11.0:1773851856.743709:0:60829:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:11.0:1773851856.743710:0:60829:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743711:0:60829:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743711:0:60829:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743712:0:60829:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:11.0:1773851856.743712:0:60829:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:11.0:1773851856.743713:0:60829:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:11.0:1773851856.743713:0:60829:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743714:0:60829:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743714:0:60829:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:11.0:1773851856.743715:0:60829:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:11.0:1773851856.743716:0:60829:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743716:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851856.743717:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743717:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.743717:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851856.743718:0:60829:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:11.0:1773851856.743718:0:60829:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:11.0:1773851856.743719:0:60829:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:11.0:1773851856.743720:0:60829:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:11.0:1773851856.743721:0:60829:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:11.0:1773851856.743722:0:60829:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:11.0:1773851856.743722:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851856.743723:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743723:0:60829:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:11.0:1773851856.743724:0:60829:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:11.0:1773851856.743724:0:60829:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:11.0:1773851856.743726:0:60829:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:11.0:1773851856.743727:0:60829:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743727:0:60829:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743728:0:60829:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:11.0:1773851856.743729:0:60829:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851856.743729:0:60829:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:11.0:1773851856.743730:0:60829:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743731:0:60829:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743733:0:60829:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.743733:0:60829:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851856.743733:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851856.743734:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006227810 refcount=3
00000020:00000001:11.0:1773851856.743734:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000001:11.0:1773851856.743735:0:60829:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00000004:00000040:11.0:1773851856.743736:0:60829:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000f20dc80d : new locks_count 4
00000020:00000040:11.0:1773851856.743736:0:60829:0:(genops.c:871:class_export_get()) GET export 00000000f20dc80d refcount=10
00010000:00000001:11.0:1773851856.743737:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.743737:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851856.743738:0:60829:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:11.0:1773851856.743738:0:60829:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:11.0:1773851856.743739:0:60829:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:11.0:1773851856.743739:0:60829:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:11.0:1773851856.743739:0:60829:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:11.0:1773851856.743740:0:60829:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:11.0:1773851856.743740:0:60829:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:11.0:1773851856.743741:0:60829:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:11.0:1773851856.743742:0:60829:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851856.743742:0:60829:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:11.0:1773851856.743743:0:60829:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:11.0:1773851856.743743:0:60829:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:11.0:1773851856.743744:0:60829:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:11.0:1773851856.743744:0:60829:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:11.0:1773851856.743745:0:60829:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:11.0:1773851856.743745:0:60829:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:11.0:1773851856.743746:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.743746:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.743746:0:60829:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851856.743747:0:60829:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851856.743747:0:60829:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d6844d18 with handle 0x21b6f08f07a6ad15 from hash
00010000:00000001:11.0:1773851856.743748:0:60829:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:11.0:1773851856.743748:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.743749:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.743749:0:60829:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:11.0:1773851856.743749:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:11.0:1773851856.743750:0:60829:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6844d18/0x21b6f08f07a6ad15 lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x44000000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f79d expref: 10 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743752:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:11.0:1773851856.743753:0:60829:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f20dc80d : new locks_count 3
00000020:00000040:11.0:1773851856.743754:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 9
00010000:00000010:11.0:1773851856.743754:0:60829:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000007d3d878b.
00010000:00000040:11.0:1773851856.743755:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000001:11.0:1773851856.743756:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851856.743756:0:60829:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.743757:0:60829:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:11.0:1773851856.743757:0:60829:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 0000000006227810/0x21b6f08f07a6ad1c lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 199 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f79d expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:11.0:1773851856.743759:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000001:11.0:1773851856.743760:0:60829:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:11.0:1773851856.743761:0:60829:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:11.0:1773851856.743762:0:60829:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:11.0:1773851856.743763:0:60829:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:11.0:1773851856.743763:0:60829:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851856.743764:0:60829:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851856.743765:0:60829:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:11.0:1773851856.743765:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851856.743765:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:11.0:1773851856.743766:0:60829:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000006227810, rc 0)
00000020:00000001:11.0:1773851856.743766:0:60829:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851856.743767:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260805375, transno 0, xid 1858041764683200
00010000:00000001:11.0:1773851856.743768:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851856.743769:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e177912e x1858041764683200/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 576/640 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00010000:00000001:11.0:1773851856.743771:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851856.743772:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851856.743772:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=89 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851856.743773:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851856.743774:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00000100:00000001:11.0:1773851856.743775:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
02000000:00000001:11.0:1773851856.743776:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851856.743776:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851856.743777:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851856.743777:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26483@kfi7
00000400:00000010:11.0:1773851856.743778:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000110e0a3f.
00000100:00000200:11.0:1773851856.743779:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1858041764683200, offset 224
00000400:00000200:11.0:1773851856.743780:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26483@kfi7
00000400:00000200:11.0:1773851856.743781:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:11.0:1773851856.743782:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 1
00000400:00000200:11.0:1773851856.743783:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:11.0:1773851856.743784:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000400:00000200:11.0:1773851856.743785:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26483@kfi7 local destination
00000400:00000200:11.0:1773851856.743786:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768705:8768705:1024:4294967295] 26483@kfi7 LPNI seq info [184804:184804:16:4294967295]
00000400:00000200:11.0:1773851856.743789:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000400:00000200:11.0:1773851856.743790:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:11.0:1773851856.743792:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26483@kfi7(26483@kfi7:26483@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851856.743793:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 3
00000800:00000200:11.0:1773851856.743795:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851856.743796:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:11.0:1773851856.743798:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851856.743800:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Using peer 26483@kfi7(0x1000000000000e7)
00000800:00000200:11.0:1773851856.743803:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 740 bytes to peer 0x1000000000000e7: rc=0
00000800:00000200:11.0:1773851856.743804:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851856.743806:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851856.743807:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 2 to 26483@kfi7
00010000:00000001:11.0:1773851856.743807:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851856.743807:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851856.743808:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851856.743809:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e177912e x1858041764683200/t0(0) o101->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 576/640 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2138-0'
00000100:00100000:11.0:1773851856.743811:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e177912e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a937d024-898f-4830-9525-051e39c8017b+9:509647:x1858041764683200:12345-26483@kfi7:101:default-tuolumne2138-0 Request processed in 804us (834us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851856.743814:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 406391006
00000100:00000040:11.0:1773851856.743815:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 0
00000100:00000001:11.0:1773851856.743816:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851856.743817:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851856.743817:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000800:00000200:10.0:1773851856.743817:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851856.743818:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000400:00000200:10.0:1773851856.743818:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851856.743819:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000faab3b2c.
00000400:00000200:10.0:1773851856.743819:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26483@kfi7: PUT: OK
00000400:00000200:10.0:1773851856.743821:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000110e0a3f
00000400:00000010:10.0:1773851856.743821:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000110e0a3f.
00000100:00000001:10.0:1773851856.743822:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851856.743822:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851856.743823:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006a5397b9 nid 26483@kfi7 refs 2
00000800:00000200:10.0:1773851856.743824:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26483@kfi7(00000000f7b15ac9):0x0 lsk 232 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e7 Transaction freed
00000020:00000040:11.0:1773851856.743828:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 8
00000100:00000001:11.0:1773851856.743829:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851856.744002:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851856.744003:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851856.744005:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851856.744007:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851856.744009:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.744010:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26547@kfi7 : PUT - for me
00000400:00000200:25.0:1773851856.744011:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.744012:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 1
00000400:00000200:25.0:1773851856.744013:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:25.0:1773851856.744013:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000400:00000200:25.0:1773851856.744014:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 3
00000400:00000200:25.0:1773851856.744015:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26483@kfi7 to cpt 2
00000400:00000200:25.0:1773851856.744016:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26483@kfi7 of length 328 into portal 17 MB=0x699e10f5c9e40
00000400:00000200:25.0:1773851856.744017:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-26483@kfi7 of length 328/328 into md 0x1615af7ff9 [2] + 1968
00000400:00000010:25.0:1773851856.744018:0:2494371:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000585b0768.
00000400:00000200:25.0:1773851856.744019:0:2494371:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 0000000099404bfe
00000800:00000200:25.0:1773851856.744020:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851856.744021:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851856.744022:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26547@kfi7: PUT: OK
00000400:00000200:25.0:1773851856.744023:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000099404bfe
00000400:00000010:25.0:1773851856.744024:0:2494371:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 0000000099404bfe (tot 253200619).
00000100:00000001:25.0:1773851856.744025:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851856.744025:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000040:25.0:1773851856.744026:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000218fde82 x1858041764683328 msgsize 328
00000100:00100000:25.0:1773851856.744027:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26483@kfi7 (source: 12345-26547@kfi7)
00000100:00000040:25.0:1773851856.744028:0:2494371:0:(events.c:370:request_in_callback()) Buffer complete: 63 buffers still posted
00000100:00000001:25.0:1773851856.744029:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851856.744030:0:533719:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851856.744030:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 2
02000000:00000001:26.0:1773851856.744031:0:533719:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851856.744031:0:533719:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851856.744031:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851856.744032:0:533719:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851856.744033:0:533719:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851856.744034:0:533719:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041764683328
00000020:00000001:26.0:1773851856.744034:0:533719:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851856.744035:0:533719:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91849
00000020:00000001:26.0:1773851856.744035:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851856.744036:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f20dc80d refcount=9
00000020:00000001:26.0:1773851856.744037:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000020:00000001:26.0:1773851856.744038:0:533719:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241744384 : -107152467807232 : ffff9e8b9f383400)
00000100:00000001:26.0:1773851856.744039:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.744040:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851856.744040:0:533719:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007e903d1e.
00000020:00000010:26.0:1773851856.744042:0:533719:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851856.744042:0:533719:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000040:26.0:1773851856.744044:0:533719:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:26.0:1773851856.744044:0:533719:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851856.744044:0:533719:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:26.0:1773851856.744045:0:533719:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:26.0:1773851856.744045:0:533719:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.744046:0:533719:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:26.0:1773851856.744047:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851856.744047:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851856.744048:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006227810 refcount=3
00000020:00000001:26.0:1773851856.744048:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000001:26.0:1773851856.744049:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000001:26.0:1773851856.744050:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851856.744051:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851856.744051:0:533719:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.744052:0:533719:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.744053:0:533719:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.744054:0:533719:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851856.744055:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851856.744055:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851856.744056:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851856.744056:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851856.744057:0:533719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26483@kfi7, seq: 105589642
00000100:00000040:26.0:1773851856.744057:0:533719:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f20dc80d : new rpc_count 1
00000100:00000001:27.0:1773851856.744058:0:184027:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851856.744058:0:184027:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.744058:0:533719:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637164448059472 : -106909261492144 : ffff9ec43f721050)
00000100:00000040:26.0:1773851856.744059:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000218fde82 x1858041764683328/t0(0) o103->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 328/0 e 0 to 0 dl 1773851943 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:26.0:1773851856.744062:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851856.744062:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851856.744063:0:533719:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000218fde82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:a937d024-898f-4830-9525-051e39c8017b+9:39819:x1858041764683328:12345-26483@kfi7:103:
00000100:00000200:26.0:1773851856.744065:0:533719:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041764683328
00010000:00000001:26.0:1773851856.744065:0:533719:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:26.0:1773851856.744066:0:533719:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:26.0:1773851856.744066:0:533719:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:26.0:1773851856.744067:0:533719:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851856.744068:0:533719:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851856.744068:0:533719:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cf433d41.
02000000:00000001:26.0:1773851856.744069:0:533719:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.744070:0:533719:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.744070:0:533719:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:26.0:1773851856.744071:0:533719:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:26.0:1773851856.744072:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851856.744072:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851856.744072:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006227810 refcount=3
00000020:00000001:26.0:1773851856.744073:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000001:26.0:1773851856.744074:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107859673600 : -106965849878016 : ffff9eb71283d200)
00010000:00000040:26.0:1773851856.744074:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 199
00000004:00000001:26.0:1773851856.744075:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851856.744076:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851856.744076:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851856.744077:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851856.744077:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851856.744077:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.744079:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851856.744079:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851856.744081:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851856.744081:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851856.744081:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851856.744082:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851856.744083:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000006227810 with handle 0x21b6f08f07a6ad1c from hash
00010000:00000001:26.0:1773851856.744083:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851856.744084:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851856.744084:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851856.744085:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851856.744085:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851856.744086:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.744087:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851856.744087:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851856.744088:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000006227810/0x21b6f08f07a6ad1c lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a01000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f79d expref: 9 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851856.744090:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:26.0:1773851856.744091:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000f20dc80d : new locks_count 2
00000020:00000040:26.0:1773851856.744092:0:533719:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 8
00010000:00000010:26.0:1773851856.744093:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000f4e37007.
00010000:00000040:26.0:1773851856.744093:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000001:26.0:1773851856.744094:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851856.744095:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851856.744095:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851856.744096:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:26.0:1773851856.744097:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851856.744098:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.744099:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851856.744099:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 197
00010000:00010000:26.0:1773851856.744100:0:533719:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:26.0:1773851856.744100:0:533719:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851856.744101:0:533719:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851856.744101:0:533719:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851856.744102:0:533719:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=110 v=66 (1 1 0 1)
00000100:00000001:26.0:1773851856.744103:0:533719:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851856.744104:0:533719:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c5e4a39 refcount 3 to 26483@kfi7
00000100:00000001:26.0:1773851856.744105:0:533719:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611136 : -107146809940480 : ffff9e8cf0746600)
02000000:00000001:26.0:1773851856.744106:0:533719:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851856.744106:0:533719:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851856.744107:0:533719:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851856.744107:0:533719:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26547@kfi7
00000400:00000010:26.0:1773851856.744108:0:533719:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000453a77c2.
00000100:00000200:26.0:1773851856.744109:0:533719:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1858041764683328, offset 224
00000400:00000200:26.0:1773851856.744110:0:533719:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26547@kfi7
00000400:00000200:26.0:1773851856.744111:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:26.0:1773851856.744112:0:533719:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 1
00000400:00000200:26.0:1773851856.744113:0:533719:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000400:00000200:26.0:1773851856.744114:0:533719:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 3
00000400:00000200:26.0:1773851856.744115:0:533719:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26547@kfi7 local destination
00000400:00000200:26.0:1773851856.744116:0:533719:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768706:8768706:1024:4294967295] 26547@kfi7 LPNI seq info [184805:184805:16:4294967295]
00000400:00000200:26.0:1773851856.744118:0:533719:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003b1af627 nid 26547@kfi7 refs 2
00000400:00000200:26.0:1773851856.744119:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26547@kfi7 to cpt 6
00000400:00000200:26.0:1773851856.744121:0:533719:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26547@kfi7(26547@kfi7:26547@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851856.744122:0:533719:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 3
00000800:00000200:26.0:1773851856.744123:0:533719:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851856.744124:0:533719:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851856.744126:0:533719:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851856.744128:0:533719:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c Using peer 26547@kfi7(0x124c)
00000800:00000200:26.0:1773851856.744131:0:533719:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x124c: rc=0
00000800:00000200:26.0:1773851856.744132:0:533719:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851856.744134:0:533719:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.744135:0:533719:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c5e4a39 refcount 2 to 26483@kfi7
00010000:00000001:26.0:1773851856.744135:0:533719:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851856.744136:0:533719:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851856.744137:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000218fde82 x1858041764683328/t0(0) o103->a937d024-898f-4830-9525-051e39c8017b@26483@kfi7:583/0 lens 328/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:26.0:1773851856.744140:0:533719:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000218fde82 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:a937d024-898f-4830-9525-051e39c8017b+8:39819:x1858041764683328:12345-26483@kfi7:103: Request processed in 77us (113us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851856.744142:0:533719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26483@kfi7, seq: 105589642
00000100:00000040:26.0:1773851856.744143:0:533719:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f20dc80d : new rpc_count 0
00000100:00000001:26.0:1773851856.744144:0:533719:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851856.744144:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851856.744145:0:533719:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851856.744145:0:533719:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851856.744145:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851856.744146:0:533719:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000400:00000200:25.0:1773851856.744146:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26547@kfi7: PUT: OK
00000020:00000010:26.0:1773851856.744147:0:533719:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007e903d1e.
00000020:00000040:26.0:1773851856.744147:0:533719:0:(genops.c:882:class_export_put()) PUTting export 00000000f20dc80d : new refcount 7
00000400:00000200:25.0:1773851856.744147:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000453a77c2
00000400:00000010:25.0:1773851856.744147:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000453a77c2.
00000100:00000001:25.0:1773851856.744148:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851856.744148:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
02000000:00000001:26.0:1773851856.744149:0:533719:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000400:00000200:25.0:1773851856.744149:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003b1af627 nid 26547@kfi7 refs 2
02000000:00000010:26.0:1773851856.744150:0:533719:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cf433d41.
00000800:00000200:25.0:1773851856.744150:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 26547@kfi7(000000001515cd6b):0x0 lsk 4685 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x124c Transaction freed
02000000:00000001:26.0:1773851856.744151:0:533719:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
02000000:00000001:26.0:1773851856.744151:0:533719:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:26.0:1773851856.744151:0:533719:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bd49e8f6.
02000000:00000001:26.0:1773851856.744152:0:533719:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:26.0:1773851856.744152:0:533719:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000627f12de.
02000000:00000001:26.0:1773851856.744153:0:533719:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:26.0:1773851856.744154:0:533719:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005a01a116.
02000000:00000001:26.0:1773851856.744154:0:533719:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:26.0:1773851856.744155:0:533719:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031afaa57.
02000000:00000001:26.0:1773851856.744155:0:533719:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:26.0:1773851856.744156:0:533719:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd135460.
02000000:00000001:26.0:1773851856.744156:0:533719:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:26.0:1773851856.744157:0:533719:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008b7e9902.
02000000:00000001:26.0:1773851856.744157:0:533719:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:26.0:1773851856.744158:0:533719:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000932fc3e1.
02000000:00000001:26.0:1773851856.744158:0:533719:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:26.0:1773851856.744158:0:533719:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009ebc5be.
02000000:00000001:26.0:1773851856.744159:0:533719:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:26.0:1773851856.744160:0:533719:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005eb6339d.
02000000:00000001:26.0:1773851856.744161:0:533719:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:26.0:1773851856.744161:0:533719:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000219195b5.
02000000:00000001:26.0:1773851856.744162:0:533719:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:26.0:1773851856.744162:0:533719:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002d5e9b6f.
02000000:00000001:26.0:1773851856.744163:0:533719:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:26.0:1773851856.744164:0:533719:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004392d71d.
00000100:00000001:26.0:1773851856.744164:0:533719:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:26.0:1773851856.744165:0:533719:0:(niobuf.c:993:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17
00000400:00000010:26.0:1773851856.744166:0:533719:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000af3b30f4.
00000400:00000010:26.0:1773851856.744168:0:533719:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 000000000a8a7749 (tot 253200771).
00010000:00000010:15.1:1773851856.749728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000bdf7f3a8.
00010000:00000010:12.1:1773851856.749728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000ea70075e.
00010000:00000010:10.1F:1773851856.749728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000010c8de4a.
00010000:00000010:26.1:1773851856.753728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f6a91b8a.
00010000:00000010:11.1F:1773851856.753728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c148efd2.
00010000:00000010:11.1:1773851856.753729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000002d59cc31.
00010000:00000010:11.1:1773851856.753730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000031ad8e5c.
00010000:00000010:11.1:1773851856.753731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000dfbc811c.
00010000:00000010:11.1:1773851856.757727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d6844d18.
00010000:00000010:26.1:1773851856.757729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000006227810.
00000400:00000200:29.0:1773851856.777736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851856.777738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:13.0:1773851856.808401:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.808403:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851856.808404:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851856.808407:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851856.808413:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23826@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.808414:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23826@kfi7 : PUT - for me
00000400:00000200:13.0:1773851856.808416:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23826@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.808417:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c29e9eab nid 23826@kfi7 refs 1
00000400:00000200:13.0:1773851856.808419:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23826@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.808420:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c29e9eab nid 23826@kfi7 refs 2
00000400:00000200:13.0:1773851856.808421:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c29e9eab nid 23826@kfi7 refs 3
00000400:00000200:13.0:1773851856.808422:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24019@kfi7 to cpt 1
00000400:00000200:13.0:1773851856.808424:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24019@kfi7 of length 224 into portal 12 MB=0x699e152142fc0
00000400:00000200:13.0:1773851856.808426:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24019@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 16136
00000800:00000200:13.0:1773851856.808429:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.808431:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.808433:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23826@kfi7: PUT: OK
00000100:00000001:13.0:1773851856.808434:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851856.808435:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851856.808436:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000040797dee.
00000100:00000040:13.0:1773851856.808437:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000040797dee x1858042884009920 msgsize 224
00000100:00100000:13.0:1773851856.808439:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24019@kfi7 (source: 12345-23826@kfi7)
00000100:00000001:13.0:1773851856.808441:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851856.808442:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c29e9eab nid 23826@kfi7 refs 2
00000100:00000001:15.0:1773851856.808443:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851856.808444:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851856.808444:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851856.808445:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851856.808446:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851856.808447:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851856.808448:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042884009920
00000020:00000001:15.0:1773851856.808449:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851856.808450:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c77
00000020:00000001:15.0:1773851856.808451:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851856.808456:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007373d4cc refcount=7
00000020:00000001:15.0:1773851856.808458:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743950336 : -107128965601280 : ffff9e91180f6800)
00000020:00000001:15.0:1773851856.808459:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743950336 : -107128965601280 : ffff9e91180f6800)
00000100:00000001:15.0:1773851856.808460:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851856.808462:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851856.808463:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ad15dc46.
00000020:00000010:15.0:1773851856.808465:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851856.808466:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851856.808468:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851856.808469:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851856.808470:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851856.808472:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851856.808472:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851856.808473:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.808475:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851856.808477:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851856.808477:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851856.808478:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.808478:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851856.808479:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24019@kfi7, seq: 2289778
00000100:00000040:15.0:1773851856.808480:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007373d4cc : new rpc_count 1
00000100:00000001:13.0:1773851856.808480:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.808482:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197413760 : -106942512137856 : ffff9ebc818d7980)
00000100:00000001:13.0:1773851856.808482:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851856.808484:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000040797dee x1858042884009920/t0(0) o400->883d9792-a800-47c3-9d6c-7fed443f8469@24019@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1989-0'
00000100:00000001:15.0:1773851856.808488:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851856.808489:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851856.808490:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040797dee pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:883d9792-a800-47c3-9d6c-7fed443f8469+7:39675:x1858042884009920:12345-24019@kfi7:400:default-tuolumne1989-0
00000100:00000200:15.0:1773851856.808492:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042884009920
00000020:00000001:15.0:1773851856.808493:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851856.808494:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851856.808496:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.808497:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851856.808497:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851856.808499:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851856.808500:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042884009920, found 0 last_xid 1858042884009919
00000020:00000001:15.0:1773851856.808501:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851856.808502:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851856.808503:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851856.808503:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.808505:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851856.808507:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851856.808507:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851856.808508:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2922694.
02000000:00000001:15.0:1773851856.808510:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.808511:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.808512:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851856.808513:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425804670, transno 0, xid 1858042884009920
00010000:00000001:15.0:1773851856.808514:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851856.808516:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000040797dee x1858042884009920/t0(0) o400->883d9792-a800-47c3-9d6c-7fed443f8469@24019@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1989-0'
00010000:00000001:15.0:1773851856.808520:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851856.808521:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851856.808522:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851856.808524:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851856.808525:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002d7d8c28 refcount 3 to 24019@kfi7
00000100:00000001:15.0:1773851856.808526:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701152 : -107156155850464 : ffff9e8ac3652120)
02000000:00000001:15.0:1773851856.808527:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851856.808528:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.808529:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851856.808530:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23826@kfi7
00000400:00000010:15.0:1773851856.808531:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000db81fd34.
00000100:00000200:15.0:1773851856.808532:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042884009920, offset 224
00000400:00000200:15.0:1773851856.808535:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23826@kfi7
00000400:00000200:15.0:1773851856.808536:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23826@kfi7 to cpt 3
00000400:00000200:15.0:1773851856.808537:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c29e9eab nid 23826@kfi7 refs 1
00000400:00000200:15.0:1773851856.808539:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c29e9eab nid 23826@kfi7 refs 2
00000400:00000200:15.0:1773851856.808541:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c29e9eab nid 23826@kfi7 refs 3
00000400:00000200:15.0:1773851856.808543:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23826@kfi7 local destination
00000400:00000200:15.0:1773851856.808545:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768707:8768707:1024:4294967295] 23826@kfi7 LPNI seq info [9576800:9576800:16:4294967295]
00000400:00000200:15.0:1773851856.808547:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c29e9eab nid 23826@kfi7 refs 2
00000400:00000200:15.0:1773851856.808548:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23826@kfi7 to cpt 3
00000400:00000200:15.0:1773851856.808551:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23826@kfi7(23826@kfi7:23826@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851856.808554:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c29e9eab nid 23826@kfi7 refs 3
00000800:00000200:15.0:1773851856.808556:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851856.808558:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851856.808562:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851856.808566:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa4f Using peer 23826@kfi7(0xa4f)
00000800:00000200:15.0:1773851856.808571:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0xa4f: rc=0
00000800:00000200:15.0:1773851856.808573:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa4f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851856.808576:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851856.808578:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002d7d8c28 refcount 2 to 24019@kfi7
00010000:00000001:15.0:1773851856.808579:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851856.808580:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851856.808581:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851856.808582:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000040797dee x1858042884009920/t0(0) o400->883d9792-a800-47c3-9d6c-7fed443f8469@24019@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1989-0'
00000100:00100000:15.0:1773851856.808587:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040797dee pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:883d9792-a800-47c3-9d6c-7fed443f8469+7:39675:x1858042884009920:12345-24019@kfi7:400:default-tuolumne1989-0 Request processed in 98us (149us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851856.808588:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa4f TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851856.808590:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851856.808591:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24019@kfi7, seq: 2289778
00000400:00000200:13.0:1773851856.808592:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23826@kfi7: PUT: OK
00000100:00000040:15.0:1773851856.808593:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007373d4cc : new rpc_count 0
00000100:00000001:15.0:1773851856.808594:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851856.808594:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000db81fd34
00000100:00000001:15.0:1773851856.808595:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851856.808595:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000010:13.0:1773851856.808595:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000db81fd34.
00000100:00000001:13.0:1773851856.808596:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851856.808597:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000100:00000001:13.0:1773851856.808597:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851856.808598:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ad15dc46.
00000400:00000200:13.0:1773851856.808598:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c29e9eab nid 23826@kfi7 refs 2
00000020:00000040:15.0:1773851856.808599:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000007373d4cc : new refcount 6
00000100:00000001:15.0:1773851856.808600:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851856.808600:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 23826@kfi7(0000000018ca2dc0):0x0 lsk 2640 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa4f Transaction freed
00000800:00000200:5.0:1773851856.810612:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851856.810613:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851856.810614:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851856.810616:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851856.810618:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17843@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.810620:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17843@kfi7 : PUT - for me
00000400:00000200:5.0:1773851856.810621:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17843@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.810621:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000070ee934f nid 17843@kfi7 refs 1
00000400:00000200:5.0:1773851856.810622:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17843@kfi7 to cpt 1
00000400:00000200:5.0:1773851856.810623:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000070ee934f nid 17843@kfi7 refs 2
00000400:00000200:5.0:1773851856.810624:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000070ee934f nid 17843@kfi7 refs 3
00000400:00000200:5.0:1773851856.810625:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17778@kfi7 to cpt 2
00000400:00000200:5.0:1773851856.810626:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17778@kfi7 of length 224 into portal 12 MB=0x69b4bc48dac00
00000400:00000200:5.0:1773851856.810627:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17778@kfi7 of length 224/224 into md 0x793926dc5 [64] + 119816
00000800:00000200:5.0:1773851856.810629:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851856.810630:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851856.810631:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17843@kfi7: PUT: OK
00000100:00000001:5.0:1773851856.810632:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851856.810633:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851856.810634:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008834cef0.
00000100:00000040:5.0:1773851856.810635:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008834cef0 x1859599582735360 msgsize 224
00000100:00100000:5.0:1773851856.810636:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-17778@kfi7 (source: 12345-17843@kfi7)
00000100:00000001:5.0:1773851856.810638:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851856.810639:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000070ee934f nid 17843@kfi7 refs 2
00000100:00000001:7.0:1773851856.810640:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851856.810640:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851856.810640:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851856.810641:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851856.810641:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851856.810642:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851856.810642:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599582735360
00000020:00000001:7.0:1773851856.810643:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851856.810643:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82d7b
00000020:00000001:7.0:1773851856.810644:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851856.810645:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005c6d2021 refcount=169
00000020:00000001:7.0:1773851856.810646:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637094614307840 : -106979095243776 : ffff9eb3fd079400)
00000020:00000001:7.0:1773851856.810647:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637094614307840 : -106979095243776 : ffff9eb3fd079400)
00000100:00000001:7.0:1773851856.810648:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851856.810649:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851856.810649:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000020:00000010:7.0:1773851856.810651:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851856.810651:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851856.810652:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851856.810652:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851856.810653:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.810654:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851856.810654:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851856.810654:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.810655:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851856.810657:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851856.810657:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851856.810657:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851856.810657:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851856.810658:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17778@kfi7, seq: 2001858
00000100:00000040:7.0:1773851856.810659:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005c6d2021 : new rpc_count 1
00000100:00000001:5.0:1773851856.810659:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851856.810659:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.810660:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095588621312 : -106978120930304 : ffff9eb4371a6c00)
00000100:00000040:7.0:1773851856.810661:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008834cef0 x1859599582735360/t0(0) o400->4484b002-9275-45d1-b6d2-2961aa64a760@17778@kfi7:583/0 lens 224/0 e 0 to 0 dl 1773851943 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1594-0'
00000100:00000001:7.0:1773851856.810663:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851856.810664:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851856.810665:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008834cef0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4484b002-9275-45d1-b6d2-2961aa64a760+169:39698:x1859599582735360:12345-17778@kfi7:400:default-tuolumne1594-0
00000100:00000200:7.0:1773851856.810666:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599582735360
00000020:00000001:7.0:1773851856.810667:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851856.810667:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851856.810668:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.810669:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851856.810669:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851856.810670:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851856.810670:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599582735360, found 0 last_xid 1859599582316095
00000020:00000001:7.0:1773851856.810671:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851856.810672:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851856.810672:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851856.810673:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.810673:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851856.810674:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851856.810674:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851856.810675:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000c1e289c.
02000000:00000001:7.0:1773851856.810675:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.810676:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.810677:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851856.810677:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062907, transno 0, xid 1859599582735360
00010000:00000001:7.0:1773851856.810678:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851856.810679:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008834cef0 x1859599582735360/t0(0) o400->4484b002-9275-45d1-b6d2-2961aa64a760@17778@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1594-0'
00010000:00000001:7.0:1773851856.810681:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851856.810682:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851856.810682:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=88 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851856.810693:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851856.810694:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000073f3d8a5 refcount 3 to 17778@kfi7
00000100:00000001:7.0:1773851856.810695:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899609600 : -107146809942016 : ffff9e8cf0746000)
02000000:00000001:7.0:1773851856.810696:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851856.810696:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851856.810697:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851856.810698:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17843@kfi7
00000400:00000010:7.0:1773851856.810698:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c46149c8.
00000100:00000200:7.0:1773851856.810699:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599582735360, offset 224
00000400:00000200:7.0:1773851856.810700:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17843@kfi7
00000400:00000200:7.0:1773851856.810701:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17843@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.810702:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000070ee934f nid 17843@kfi7 refs 1
00000400:00000200:7.0:1773851856.810703:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000070ee934f nid 17843@kfi7 refs 2
00000400:00000200:7.0:1773851856.810704:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000070ee934f nid 17843@kfi7 refs 3
00000400:00000200:7.0:1773851856.810705:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17843@kfi7 local destination
00000400:00000200:7.0:1773851856.810706:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768708:8768708:1024:4294967295] 17843@kfi7 LPNI seq info [7779030:7779030:16:4294967295]
00000400:00000200:7.0:1773851856.810708:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000070ee934f nid 17843@kfi7 refs 2
00000400:00000200:7.0:1773851856.810708:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17843@kfi7 to cpt 1
00000400:00000200:7.0:1773851856.810710:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17843@kfi7(17843@kfi7:17843@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851856.810711:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000070ee934f nid 17843@kfi7 refs 3
00000800:00000200:7.0:1773851856.810713:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851856.810714:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851856.810716:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851856.810718:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6b Using peer 17843@kfi7(0xb6b)
00000800:00000200:7.0:1773851856.810721:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0xb6b: rc=0
00000800:00000200:7.0:1773851856.810723:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851856.810730:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851856.810732:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000073f3d8a5 refcount 2 to 17778@kfi7
00010000:00000001:7.0:1773851856.810732:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851856.810733:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851856.810733:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851856.810734:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008834cef0 x1859599582735360/t0(0) o400->4484b002-9275-45d1-b6d2-2961aa64a760@17778@kfi7:583/0 lens 224/224 e 0 to 0 dl 1773851943 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1594-0'
00000800:00000200:5.0:1773851856.810734:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6b TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851856.810736:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851856.810737:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008834cef0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4484b002-9275-45d1-b6d2-2961aa64a760+169:39698:x1859599582735360:12345-17778@kfi7:400:default-tuolumne1594-0 Request processed in 73us (101us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851856.810737:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17843@kfi7: PUT: OK
00000400:00000200:5.0:1773851856.810738:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c46149c8
00000400:00000010:5.0:1773851856.810738:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c46149c8.
00000100:00100000:7.0:1773851856.810739:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17778@kfi7, seq: 2001858
00000100:00000001:5.0:1773851856.810739:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000040:7.0:1773851856.810740:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005c6d2021 : new rpc_count 0
00000100:00000001:7.0:1773851856.810740:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851856.810740:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851856.810740:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000070ee934f nid 17843@kfi7 refs 2
00000100:00000001:7.0:1773851856.810741:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851856.810741:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851856.810742:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000800:00000200:5.0:1773851856.810742:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 17843@kfi7(000000006e8d56ca):0x0 lsk 2924 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6b Transaction freed
00000020:00000010:7.0:1773851856.810743:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000020:00000040:7.0:1773851856.810744:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000005c6d2021 : new refcount 168
00000100:00000001:7.0:1773851856.810744:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851856.815954:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851856.815955:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851856.815957:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851856.815959:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851856.815961:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10592@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.815963:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10592@kfi7 : PUT - for me
00000400:00000200:17.0:1773851856.815964:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10592@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.815965:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 1
00000400:00000200:17.0:1773851856.815966:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10592@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.815967:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 2
00000400:00000200:17.0:1773851856.815968:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 3
00000400:00000200:17.0:1773851856.815969:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10593@kfi7 to cpt 7
00000400:00000200:17.0:1773851856.815970:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10593@kfi7 of length 224 into portal 12 MB=0x69b4b57904c80
00000400:00000200:17.0:1773851856.815971:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10593@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 190976
00000800:00000200:17.0:1773851856.815973:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851856.815975:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.815977:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10592@kfi7: PUT: OK
00000100:00000001:17.0:1773851856.815978:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851856.815978:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851856.815980:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007580c285.
00000100:00000040:17.0:1773851856.815981:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000007580c285 x1859597754190976 msgsize 224
00000100:00100000:17.0:1773851856.815982:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-10593@kfi7 (source: 12345-10592@kfi7)
00000100:00000001:17.0:1773851856.815984:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851856.815985:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851856.815985:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 2
02000000:00000001:19.0:1773851856.815986:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851856.815986:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851856.815987:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851856.815987:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851856.815988:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851856.815989:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597754190976
00000020:00000001:19.0:1773851856.815990:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851856.815990:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7c109
00000020:00000001:19.0:1773851856.815991:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851856.815994:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000d40e1cb refcount=5
00000020:00000001:19.0:1773851856.815995:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105494674432 : -106968214877184 : ffff9eb6858ccc00)
00000020:00000001:19.0:1773851856.815996:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105494674432 : -106968214877184 : ffff9eb6858ccc00)
00000100:00000001:19.0:1773851856.815997:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851856.815998:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851856.815999:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851856.816000:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851856.816001:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d5b87f38.
00000100:00000001:19.0:1773851856.816002:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851856.816003:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851856.816003:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851856.816004:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851856.816005:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851856.816005:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.816007:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851856.816008:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851856.816008:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851856.816009:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851856.816009:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851856.816010:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10593@kfi7, seq: 2156265
00000100:00000001:19.0:1773851856.816011:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851856.816011:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000d40e1cb : new rpc_count 1
00000100:00000001:19.0:1773851856.816012:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.816012:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405306880 : -106994304244736 : ffff9eb07280a400)
00000100:00000040:18.0:1773851856.816014:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007580c285 x1859597754190976/t0(0) o400->ad73de82-5355-4781-bfe3-693ad83ff43d@10593@kfi7:644/0 lens 224/0 e 0 to 0 dl 1773852004 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1152-0'
00000100:00000001:18.0:1773851856.816018:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.816018:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851856.816019:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007580c285 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:ad73de82-5355-4781-bfe3-693ad83ff43d+5:39531:x1859597754190976:12345-10593@kfi7:400:default-tuolumne1152-0
00000100:00000200:18.0:1773851856.816021:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597754190976
00000020:00000001:18.0:1773851856.816022:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851856.816023:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851856.816023:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.816024:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851856.816025:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851856.816026:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851856.816027:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597754190976, found 0 last_xid 1859597754190975
00000020:00000001:18.0:1773851856.816028:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851856.816028:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851856.816029:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851856.816030:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.816031:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851856.816032:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851856.816032:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851856.816033:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003da7790a.
02000000:00000001:18.0:1773851856.816034:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.816035:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.816036:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851856.816037:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035367930, transno 0, xid 1859597754190976
00010000:00000001:18.0:1773851856.816038:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851856.816038:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007580c285 x1859597754190976/t0(0) o400->ad73de82-5355-4781-bfe3-693ad83ff43d@10593@kfi7:644/0 lens 224/224 e 0 to 0 dl 1773852004 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1152-0'
00010000:00000001:18.0:1773851856.816041:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851856.816041:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851856.816042:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=89 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851856.816043:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851856.816044:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000da2aa232 refcount 3 to 10593@kfi7
00000100:00000001:18.0:1773851856.816044:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412881440 : -107156296670176 : ffff9e8abb006420)
02000000:00000001:18.0:1773851856.816045:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851856.816046:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.816046:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851856.816047:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10592@kfi7
00000400:00000010:18.0:1773851856.816048:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d0a6e79d.
00000100:00000200:18.0:1773851856.816049:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597754190976, offset 224
00000400:00000200:18.0:1773851856.816050:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10592@kfi7
00000400:00000200:18.0:1773851856.816051:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10592@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.816052:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 1
00000400:00000200:18.0:1773851856.816053:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 2
00000400:00000200:18.0:1773851856.816054:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 3
00000400:00000200:18.0:1773851856.816055:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10592@kfi7 local destination
00000400:00000200:18.0:1773851856.816056:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768709:8768709:1024:4294967295] 10592@kfi7 LPNI seq info [5094191:5094191:16:4294967295]
00000400:00000200:18.0:1773851856.816058:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 2
00000400:00000200:18.0:1773851856.816058:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10592@kfi7 to cpt 4
00000400:00000200:18.0:1773851856.816060:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10592@kfi7(10592@kfi7:10592@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851856.816061:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 3
00000800:00000200:18.0:1773851856.816063:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851856.816064:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851856.816066:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851856.816068:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa67 Using peer 10592@kfi7(0xa67)
00000800:00000200:18.0:1773851856.816071:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000006c9a9e9c: Posted send of 324 bytes to peer 0xa67: rc=0
00000800:00000200:18.0:1773851856.816072:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa67 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851856.816074:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851856.816075:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000da2aa232 refcount 2 to 10593@kfi7
00010000:00000001:18.0:1773851856.816075:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851856.816076:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851856.816077:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851856.816077:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007580c285 x1859597754190976/t0(0) o400->ad73de82-5355-4781-bfe3-693ad83ff43d@10593@kfi7:644/0 lens 224/224 e 0 to 0 dl 1773852004 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1152-0'
00000100:00100000:18.0:1773851856.816080:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007580c285 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:ad73de82-5355-4781-bfe3-693ad83ff43d+5:39531:x1859597754190976:12345-10593@kfi7:400:default-tuolumne1152-0 Request processed in 62us (98us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851856.816082:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10593@kfi7, seq: 2156265
00000100:00000040:18.0:1773851856.816083:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000d40e1cb : new rpc_count 0
00000100:00000001:18.0:1773851856.816084:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851856.816084:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851856.816085:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851856.816085:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa67 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851856.816086:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d5b87f38.
00000020:00000010:18.0:1773851856.816087:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000020:00000040:18.0:1773851856.816087:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000000d40e1cb : new refcount 4
00000400:00000200:17.0:1773851856.816087:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851856.816088:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851856.816088:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10592@kfi7: PUT: OK
00000400:00000200:17.0:1773851856.816089:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d0a6e79d
00000400:00000010:17.0:1773851856.816090:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d0a6e79d.
00000100:00000001:17.0:1773851856.816090:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851856.816091:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851856.816092:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef9ba3e9 nid 10592@kfi7 refs 2
00000800:00000200:17.0:1773851856.816093:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 10592@kfi7(00000000fabbcee6):0x0 lsk 2664 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa67 Transaction freed
00000800:00000200:31.0:1773851856.852104:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851856.852106:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851856.852107:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851856.852110:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851856.852112:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24720@kfi7 to cpt 7
00000400:00000200:31.0:1773851856.852113:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24720@kfi7 : PUT - for me
00000400:00000200:31.0:1773851856.852114:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24720@kfi7 to cpt 7
00000400:00000200:31.0:1773851856.852115:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002976c07a nid 24720@kfi7 refs 1
00000400:00000200:31.0:1773851856.852116:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24720@kfi7 to cpt 7
00000400:00000200:31.0:1773851856.852117:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002976c07a nid 24720@kfi7 refs 2
00000400:00000200:31.0:1773851856.852118:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002976c07a nid 24720@kfi7 refs 3
00000400:00000200:31.0:1773851856.852119:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24656@kfi7 to cpt 4
00000400:00000200:31.0:1773851856.852120:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24656@kfi7 of length 224 into portal 12 MB=0x69b465a901300
00000400:00000200:31.0:1773851856.852122:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24656@kfi7 of length 224/224 into md 0x77fe139dd [64] + 164256
00000800:00000200:31.0:1773851856.852124:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851856.852125:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851856.852127:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24720@kfi7: PUT: OK
00000100:00000001:31.0:1773851856.852128:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851856.852129:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851856.852130:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004468da38.
00000100:00000040:31.0:1773851856.852131:0:2465875:0:(events.c:358:request_in_callback()) incoming req@000000004468da38 x1859576329671424 msgsize 224
00000100:00100000:31.0:1773851856.852132:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-24656@kfi7 (source: 12345-24720@kfi7)
00000100:00000001:31.0:1773851856.852133:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851856.852134:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002976c07a nid 24720@kfi7 refs 2
00000100:00000001:28.0:1773851856.852135:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:31.0:1773851856.852136:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d80c8618: 2069@kfi7:7 <- 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851856.852136:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851856.852136:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851856.852137:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851856.852137:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851856.852138:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576329671424
00000020:00000001:28.0:1773851856.852139:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851856.852139:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc3d2f5fa
00000020:00000001:28.0:1773851856.852140:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851856.852143:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a779ff98 refcount=5
00000020:00000001:28.0:1773851856.852144:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165831945216 : -106907877606400 : ffff9ec491ee7c00)
00000020:00000001:28.0:1773851856.852145:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165831945216 : -106907877606400 : ffff9ec491ee7c00)
00000100:00000001:28.0:1773851856.852146:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851856.852148:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851856.852149:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cd411c23.
00000020:00000010:28.0:1773851856.852150:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851856.852151:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a4752a66.
00000100:00000001:28.0:1773851856.852152:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851856.852152:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851856.852152:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851856.852154:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851856.852154:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851856.852155:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.852156:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851856.852157:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851856.852157:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851856.852157:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851856.852158:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851856.852158:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24656@kfi7, seq: 2055471
00000100:00000001:31.0:1773851856.852159:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851856.852159:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a779ff98 : new rpc_count 1
00000100:00000001:31.0:1773851856.852160:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.852160:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159395557376 : -106914313994240 : ffff9ec3124b0000)
00000100:00000040:28.0:1773851856.852161:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004468da38 x1859576329671424/t0(0) o400->37efa990-22bf-4bad-aa6d-f62247ececf3@24656@kfi7:644/0 lens 224/0 e 0 to 0 dl 1773852004 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2034-0'
00000100:00000001:28.0:1773851856.852164:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851856.852164:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851856.852165:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004468da38 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:37efa990-22bf-4bad-aa6d-f62247ececf3+5:39898:x1859576329671424:12345-24656@kfi7:400:default-tuolumne2034-0
00000100:00000200:28.0:1773851856.852167:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576329671424
00000020:00000001:28.0:1773851856.852168:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851856.852168:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851856.852169:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851856.852170:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851856.852170:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851856.852171:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851856.852172:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576329671424, found 0 last_xid 1859576329671423
00000020:00000001:28.0:1773851856.852172:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851856.852173:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851856.852174:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851856.852174:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851856.852175:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851856.852176:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851856.852177:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851856.852177:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008c112e85.
02000000:00000001:28.0:1773851856.852178:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.852179:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851856.852179:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851856.852180:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014408738, transno 0, xid 1859576329671424
00010000:00000001:28.0:1773851856.852181:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851856.852182:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004468da38 x1859576329671424/t0(0) o400->37efa990-22bf-4bad-aa6d-f62247ececf3@24656@kfi7:644/0 lens 224/224 e 0 to 0 dl 1773852004 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2034-0'
00010000:00000001:28.0:1773851856.852184:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851856.852185:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851856.852186:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=89 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851856.852187:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851856.852187:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000061498bdd refcount 3 to 24656@kfi7
00000100:00000001:28.0:1773851856.852188:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363995104 : -107142345556512 : ffff9e8dfa8d7de0)
02000000:00000001:28.0:1773851856.852189:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851856.852190:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851856.852190:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851856.852191:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24720@kfi7
00000400:00000010:28.0:1773851856.852192:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df8dec7a.
00000100:00000200:28.0:1773851856.852192:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576329671424, offset 224
00000400:00000200:28.0:1773851856.852194:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24720@kfi7
00000400:00000200:28.0:1773851856.852195:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24720@kfi7 to cpt 7
00000400:00000200:28.0:1773851856.852196:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002976c07a nid 24720@kfi7 refs 1
00000400:00000200:28.0:1773851856.852197:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002976c07a nid 24720@kfi7 refs 2
00000400:00000200:28.0:1773851856.852198:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002976c07a nid 24720@kfi7 refs 3
00000400:00000200:28.0:1773851856.852199:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24720@kfi7 local destination
00000400:00000200:28.0:1773851856.852200:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768710:8768710:1024:4294967295] 24720@kfi7 LPNI seq info [10489951:10489951:16:4294967295]
00000400:00000200:28.0:1773851856.852202:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002976c07a nid 24720@kfi7 refs 2
00000400:00000200:28.0:1773851856.852202:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24720@kfi7 to cpt 7
00000400:00000200:28.0:1773851856.852204:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24720@kfi7(24720@kfi7:24720@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851856.852206:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002976c07a nid 24720@kfi7 refs 3
00000800:00000200:28.0:1773851856.852207:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851856.852208:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851856.852211:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851856.852213:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10fd Using peer 24720@kfi7(0x10fd)
00000800:00000200:28.0:1773851856.852216:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x10fd: rc=0
00000800:00000200:28.0:1773851856.852218:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10fd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851856.852220:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851856.852221:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000061498bdd refcount 2 to 24656@kfi7
00010000:00000001:28.0:1773851856.852222:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851856.852222:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851856.852223:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851856.852223:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004468da38 x1859576329671424/t0(0) o400->37efa990-22bf-4bad-aa6d-f62247ececf3@24656@kfi7:644/0 lens 224/224 e 0 to 0 dl 1773852004 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2034-0'
00000100:00100000:28.0:1773851856.852228:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004468da38 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:37efa990-22bf-4bad-aa6d-f62247ececf3+5:39898:x1859576329671424:12345-24656@kfi7:400:default-tuolumne2034-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851856.852230:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24656@kfi7, seq: 2055471
00000100:00000040:28.0:1773851856.852231:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a779ff98 : new rpc_count 0
00000100:00000001:28.0:1773851856.852232:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851856.852233:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851856.852233:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851856.852234:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a4752a66.
00000020:00000010:28.0:1773851856.852235:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cd411c23.
00000020:00000040:28.0:1773851856.852236:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000a779ff98 : new refcount 4
00000100:00000001:28.0:1773851856.852237:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851856.852242:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10fd TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851856.852244:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851856.852245:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24720@kfi7: PUT: OK
00000400:00000200:31.0:1773851856.852246:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df8dec7a
00000400:00000010:31.0:1773851856.852246:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df8dec7a.
00000100:00000001:31.0:1773851856.852247:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851856.852248:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851856.852248:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002976c07a nid 24720@kfi7 refs 2
00000800:00000200:31.0:1773851856.852250:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 24720@kfi7(000000007ae5dc0c):0x0 lsk 4350 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10fd Transaction freed
00000800:00000200:17.0:1773851856.869127:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851856.869128:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851856.869130:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851856.869134:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851856.869137:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.869139:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9906@kfi7 : PUT - for me
00000400:00000200:17.0:1773851856.869141:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.869142:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 1
00000400:00000200:17.0:1773851856.869143:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.869144:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000400:00000200:17.0:1773851856.869147:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 3
00000400:00000200:17.0:1773851856.869148:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851856.869149:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9906@kfi7 of length 224 into portal 12 MB=0x69b4b60839280
00000400:00000200:17.0:1773851856.869151:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9906@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 191200
00000800:00000200:17.0:1773851856.869154:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851856.869157:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.869158:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9906@kfi7: PUT: OK
00000100:00000001:17.0:1773851856.869160:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851856.869160:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851856.869162:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc1b5484.
00000100:00000040:17.0:1773851856.869163:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bc1b5484 x1859597904351872 msgsize 224
00000100:00100000:17.0:1773851856.869166:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9906@kfi7 (source: 12345-9906@kfi7)
00000100:00000001:17.0:1773851856.869167:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851856.869168:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000100:00000001:18.0:1773851856.869169:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851856.869170:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851856.869171:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851856.869171:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851856.869172:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851856.869173:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851856.869174:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597904351872
00000020:00000001:18.0:1773851856.869175:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851856.869176:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7a25b
00000020:00000001:18.0:1773851856.869177:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851856.869181:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000023536866 refcount=5
00000020:00000001:18.0:1773851856.869182:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108661995520 : -106965047556096 : ffff9eb742564800)
00000020:00000001:18.0:1773851856.869183:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108661995520 : -106965047556096 : ffff9eb742564800)
00000100:00000001:18.0:1773851856.869184:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851856.869186:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851856.869187:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009c31097.
00000020:00000010:18.0:1773851856.869188:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851856.869190:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000059dcb8dd.
00000100:00000001:18.0:1773851856.869191:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851856.869192:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851856.869192:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851856.869194:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851856.869194:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851856.869195:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851856.869197:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851856.869198:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851856.869198:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851856.869199:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9906@kfi7, seq: 2156266
00000100:00000001:18.0:1773851856.869199:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851856.869199:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851856.869200:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000023536866 : new rpc_count 1
00000100:00000001:18.0:1773851856.869200:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.869201:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764351744 : -107095945199872 : ffff9e98c83abf00)
00000100:00000001:18.0:1773851856.869201:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851856.869202:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc1b5484 x1859597904351872/t0(0) o400->a9d92964-5099-4ac7-8280-1029cc3b4a3e@9906@kfi7:46/0 lens 224/0 e 0 to 0 dl 1773852161 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1098-0'
00000100:00000001:19.0:1773851856.869205:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851856.869205:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851856.869206:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc1b5484 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:a9d92964-5099-4ac7-8280-1029cc3b4a3e+5:39708:x1859597904351872:12345-9906@kfi7:400:default-tuolumne1098-0
00000100:00000200:19.0:1773851856.869207:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597904351872
00000020:00000001:19.0:1773851856.869208:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851856.869208:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851856.869209:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.869210:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851856.869210:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851856.869211:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851856.869211:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597904351872, found 0 last_xid 1859597904351871
00000020:00000001:19.0:1773851856.869212:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851856.869213:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851856.869213:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851856.869214:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.869215:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851856.869215:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851856.869215:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851856.869216:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002f678b40.
02000000:00000001:19.0:1773851856.869217:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.869218:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.869218:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851856.869220:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183258172994, transno 0, xid 1859597904351872
00010000:00000001:19.0:1773851856.869220:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851856.869221:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc1b5484 x1859597904351872/t0(0) o400->a9d92964-5099-4ac7-8280-1029cc3b4a3e@9906@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1098-0'
00010000:00000001:19.0:1773851856.869223:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851856.869224:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851856.869225:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=89 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851856.869226:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851856.869226:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000eabdece refcount 3 to 9906@kfi7
00000100:00000001:19.0:1773851856.869227:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517952 : -107156126033664 : ffff9e8ac52c1900)
02000000:00000001:19.0:1773851856.869228:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851856.869229:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851856.869229:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851856.869230:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9906@kfi7
00000400:00000010:19.0:1773851856.869231:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d89c953e.
00000100:00000200:19.0:1773851856.869231:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597904351872, offset 224
00000400:00000200:19.0:1773851856.869233:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9906@kfi7
00000400:00000200:19.0:1773851856.869233:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:19.0:1773851856.869234:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 1
00000400:00000200:19.0:1773851856.869235:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000400:00000200:19.0:1773851856.869237:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 3
00000400:00000200:19.0:1773851856.869238:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9906@kfi7 local destination
00000400:00000200:19.0:1773851856.869239:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768711:8768711:1024:4294967295] 9906@kfi7 LPNI seq info [1035666:1035666:16:4294967295]
00000400:00000200:19.0:1773851856.869240:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000400:00000200:19.0:1773851856.869241:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:19.0:1773851856.869243:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9906@kfi7(9906@kfi7:9906@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851856.869244:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 3
00000800:00000200:19.0:1773851856.869246:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851856.869247:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851856.869249:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851856.869251:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15c Using peer 9906@kfi7(0x15c)
00000800:00000200:19.0:1773851856.869254:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x15c: rc=0
00000800:00000200:19.0:1773851856.869255:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851856.869257:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851856.869258:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000eabdece refcount 2 to 9906@kfi7
00010000:00000001:19.0:1773851856.869259:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851856.869259:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851856.869260:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851856.869261:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc1b5484 x1859597904351872/t0(0) o400->a9d92964-5099-4ac7-8280-1029cc3b4a3e@9906@kfi7:46/0 lens 224/224 e 0 to 0 dl 1773852161 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1098-0'
00000100:00100000:19.0:1773851856.869263:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1b5484 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:a9d92964-5099-4ac7-8280-1029cc3b4a3e+5:39708:x1859597904351872:12345-9906@kfi7:400:default-tuolumne1098-0 Request processed in 58us (99us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851856.869266:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9906@kfi7, seq: 2156266
00000100:00000040:19.0:1773851856.869266:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000023536866 : new rpc_count 0
00000100:00000001:19.0:1773851856.869267:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851856.869267:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851856.869268:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:19.0:1773851856.869269:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000059dcb8dd.
00000020:00000010:19.0:1773851856.869270:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009c31097.
00000020:00000040:19.0:1773851856.869270:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000023536866 : new refcount 4
00000100:00000001:19.0:1773851856.869271:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851856.869271:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15c TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851856.869273:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851856.869275:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9906@kfi7: PUT: OK
00000400:00000200:17.0:1773851856.869276:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d89c953e
00000400:00000010:17.0:1773851856.869277:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d89c953e.
00000100:00000001:17.0:1773851856.869278:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851856.869279:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851856.869280:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000800:00000200:17.0:1773851856.869282:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 9906@kfi7(0000000062950ba6):0x0 lsk 349 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15c Transaction freed
00000800:00000200:13.0:1773851856.930359:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.930360:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851856.930361:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851856.930363:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851856.930365:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16930@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.930366:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16930@kfi7 : PUT - for me
00000400:00000200:13.0:1773851856.930367:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16930@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.930368:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b0806d nid 16930@kfi7 refs 1
00000400:00000200:13.0:1773851856.930369:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16930@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.930369:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b0806d nid 16930@kfi7 refs 2
00000400:00000200:13.0:1773851856.930370:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2b0806d nid 16930@kfi7 refs 3
00000400:00000200:13.0:1773851856.930371:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16931@kfi7 to cpt 6
00000400:00000200:13.0:1773851856.930372:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16931@kfi7 of length 224 into portal 12 MB=0x69b4b992351c0
00000400:00000200:13.0:1773851856.930373:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16931@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 16360
00000800:00000200:13.0:1773851856.930374:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851856.930376:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851856.930377:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16930@kfi7: PUT: OK
00000100:00000001:13.0:1773851856.930378:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851856.930378:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851856.930379:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005c714742.
00000100:00000040:13.0:1773851856.930379:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005c714742 x1859598854345152 msgsize 224
00000100:00100000:13.0:1773851856.930380:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-16931@kfi7 (source: 12345-16930@kfi7)
00000100:00000001:13.0:1773851856.930382:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851856.930383:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b0806d nid 16930@kfi7 refs 2
00000800:00000200:13.0:1773851856.930384:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851856.930385:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851856.930386:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851856.930387:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851856.930388:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851856.930389:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851856.930391:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598854345152
00000020:00000001:15.0:1773851856.930392:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851856.930392:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38936024
00000020:00000001:15.0:1773851856.930393:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851856.930398:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081005923 refcount=167
00000020:00000001:15.0:1773851856.930399:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106506684416 : -106967202867200 : ffff9eb6c1ded800)
00000020:00000001:15.0:1773851856.930401:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106506684416 : -106967202867200 : ffff9eb6c1ded800)
00000100:00000001:15.0:1773851856.930403:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851856.930404:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851856.930405:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ad15dc46.
00000020:00000010:15.0:1773851856.930407:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851856.930408:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851856.930409:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851856.930410:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851856.930411:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851856.930413:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851856.930413:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851856.930414:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851856.930416:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851856.930417:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851856.930418:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851856.930418:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851856.930418:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851856.930419:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16931@kfi7, seq: 2289779
00000100:00000040:13.0:1773851856.930419:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081005923 : new rpc_count 1
00000100:00000001:15.0:1773851856.930420:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.930420:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197386112 : -106942512165504 : ffff9ebc818d0d80)
00000100:00000001:15.0:1773851856.930421:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851856.930421:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005c714742 x1859598854345152/t0(0) o400->27c5fcd3-dd51-486b-846e-34d091ff1ad7@16931@kfi7:73/0 lens 224/0 e 0 to 0 dl 1773852188 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1547-0'
00000100:00000001:13.0:1773851856.930424:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851856.930425:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851856.930425:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c714742 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:27c5fcd3-dd51-486b-846e-34d091ff1ad7+167:39473:x1859598854345152:12345-16931@kfi7:400:default-tuolumne1547-0
00000100:00000200:13.0:1773851856.930427:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598854345152
00000020:00000001:13.0:1773851856.930427:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851856.930428:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851856.930429:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.930430:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851856.930430:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851856.930431:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851856.930432:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598854345152, found 0 last_xid 1859598853921087
00000020:00000001:13.0:1773851856.930432:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851856.930433:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851856.930433:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851856.930434:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.930435:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851856.930435:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851856.930436:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851856.930437:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000048afdaed.
02000000:00000001:13.0:1773851856.930437:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.930438:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.930441:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851856.930441:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063222, transno 0, xid 1859598854345152
00010000:00000001:13.0:1773851856.930442:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851856.930443:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005c714742 x1859598854345152/t0(0) o400->27c5fcd3-dd51-486b-846e-34d091ff1ad7@16931@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1547-0'
00010000:00000001:13.0:1773851856.930445:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851856.930446:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851856.930446:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=89 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851856.930448:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851856.930448:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002372816b refcount 3 to 16931@kfi7
00000100:00000001:13.0:1773851856.930449:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313741984 : -107139395809632 : ffff9e8eaa5f0ea0)
02000000:00000001:13.0:1773851856.930450:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851856.930450:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851856.930451:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851856.930452:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16930@kfi7
00000400:00000010:13.0:1773851856.930452:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008964c408.
00000100:00000200:13.0:1773851856.930453:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598854345152, offset 224
00000400:00000200:13.0:1773851856.930454:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16930@kfi7
00000400:00000200:13.0:1773851856.930455:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16930@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.930456:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b0806d nid 16930@kfi7 refs 1
00000400:00000200:13.0:1773851856.930457:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2b0806d nid 16930@kfi7 refs 2
00000400:00000200:13.0:1773851856.930458:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2b0806d nid 16930@kfi7 refs 3
00000400:00000200:13.0:1773851856.930459:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16930@kfi7 local destination
00000400:00000200:13.0:1773851856.930460:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768712:8768712:1024:4294967295] 16930@kfi7 LPNI seq info [7574217:7574217:16:4294967295]
00000400:00000200:13.0:1773851856.930462:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2b0806d nid 16930@kfi7 refs 2
00000400:00000200:13.0:1773851856.930462:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16930@kfi7 to cpt 3
00000400:00000200:13.0:1773851856.930464:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16930@kfi7(16930@kfi7:16930@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851856.930465:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2b0806d nid 16930@kfi7 refs 3
00000800:00000200:13.0:1773851856.930467:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851856.930468:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851856.930470:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851856.930472:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe8f Using peer 16930@kfi7(0xe8f)
00000800:00000200:13.0:1773851856.930476:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 324 bytes to peer 0xe8f: rc=0
00000800:00000200:13.0:1773851856.930477:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe8f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851856.930479:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851856.930480:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002372816b refcount 2 to 16931@kfi7
00010000:00000001:13.0:1773851856.930480:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851856.930481:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851856.930481:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851856.930482:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005c714742 x1859598854345152/t0(0) o400->27c5fcd3-dd51-486b-846e-34d091ff1ad7@16931@kfi7:73/0 lens 224/224 e 0 to 0 dl 1773852188 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1547-0'
00000100:00100000:13.0:1773851856.930485:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c714742 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:27c5fcd3-dd51-486b-846e-34d091ff1ad7+167:39473:x1859598854345152:12345-16931@kfi7:400:default-tuolumne1547-0 Request processed in 60us (105us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851856.930487:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16931@kfi7, seq: 2289779
00000100:00000040:13.0:1773851856.930488:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081005923 : new rpc_count 0
00000100:00000001:13.0:1773851856.930489:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851856.930489:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:14.0:1773851856.930490:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe8f TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851856.930490:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:13.0:1773851856.930491:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000400:00000200:14.0:1773851856.930492:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851856.930492:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ad15dc46.
00000400:00000200:14.0:1773851856.930493:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16930@kfi7: PUT: OK
00000020:00000040:13.0:1773851856.930493:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000081005923 : new refcount 166
00000100:00000001:13.0:1773851856.930493:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851856.930494:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008964c408
00000400:00000010:14.0:1773851856.930495:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008964c408.
00000100:00000001:14.0:1773851856.930495:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851856.930496:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851856.930497:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b0806d nid 16930@kfi7 refs 2
00000800:00000200:14.0:1773851856.930498:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 16930@kfi7(0000000019a95f79):0x0 lsk 3728 rsk 34 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe8f Transaction freed
00000800:00000200:1.0:1773851856.981718:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851856.981719:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851856.981720:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851856.981722:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851856.981724:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16832@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.981727:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16832@kfi7 : PUT - for me
00000400:00000200:1.0:1773851856.981728:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16832@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.981729:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d9c726de nid 16832@kfi7 refs 1
00000400:00000200:1.0:1773851856.981730:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16832@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.981731:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d9c726de nid 16832@kfi7 refs 2
00000400:00000200:1.0:1773851856.981732:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d9c726de nid 16832@kfi7 refs 3
00000400:00000200:1.0:1773851856.981732:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16832@kfi7 to cpt 0
00000400:00000200:1.0:1773851856.981734:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16832@kfi7 of length 224 into portal 12 MB=0x69bacb7924bc0
00000400:00000200:1.0:1773851856.981735:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16832@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 14912
00000800:00000200:1.0:1773851856.981737:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851856.981739:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851856.981740:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16832@kfi7: PUT: OK
00000100:00000001:1.0:1773851856.981741:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851856.981741:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851856.981742:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042b0b92a.
00000100:00000040:1.0:1773851856.981743:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000042b0b92a x1860015976762304 msgsize 224
00000100:00100000:1.0:1773851856.981744:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-16832@kfi7 (source: 12345-16832@kfi7)
00000100:00000001:1.0:1773851856.981745:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851856.981746:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d9c726de nid 16832@kfi7 refs 2
00000100:00000001:0.0:1773851856.981747:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851856.981747:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851856.981748:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851856.981748:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851856.981748:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851856.981749:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851856.981750:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860015976762304
00000020:00000001:0.0:1773851856.981750:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851856.981751:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a59f87
00000020:00000001:0.0:1773851856.981751:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851856.981752:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000159c6112 refcount=9
00000020:00000001:0.0:1773851856.981752:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636931172183040 : -107142537368576 : ffff9e8def1eac00)
00000020:00000001:0.0:1773851856.981753:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636931172183040 : -107142537368576 : ffff9e8def1eac00)
00000100:00000001:0.0:1773851856.981754:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851856.981755:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851856.981756:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851856.981757:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851856.981757:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851856.981758:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851856.981759:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851856.981759:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851856.981760:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851856.981761:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851856.981761:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.981762:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851856.981763:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.981764:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851856.981764:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851856.981764:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851856.981764:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16832@kfi7, seq: 1997499
00000100:00000001:1.0:1773851856.981765:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851856.981765:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000159c6112 : new rpc_count 1
00000100:00000001:1.0:1773851856.981766:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.981766:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605644288 : -106923103907328 : ffff9ec1065f9200)
00000100:00000040:0.0:1773851856.981767:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042b0b92a x1860015976762304/t0(0) o400->a16a2833-6ecd-400f-aadc-6aa5fd4dc37a@16832@kfi7:496/0 lens 224/0 e 0 to 0 dl 1773852611 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1539-0'
00000100:00000001:0.0:1773851856.981769:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851856.981770:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851856.981771:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042b0b92a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a16a2833-6ecd-400f-aadc-6aa5fd4dc37a+9:59211:x1860015976762304:12345-16832@kfi7:400:default-tuolumne1539-0
00000100:00000200:0.0:1773851856.981772:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860015976762304
00000020:00000001:0.0:1773851856.981772:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851856.981773:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851856.981773:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.981774:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851856.981774:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851856.981775:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851856.981775:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860015976762304, found 0 last_xid 1860015976762303
00000020:00000001:0.0:1773851856.981776:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851856.981777:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851856.981777:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851856.981778:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.981778:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851856.981779:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851856.981779:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851856.981780:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000ae9b14f.
02000000:00000001:0.0:1773851856.981780:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.981781:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.981781:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851856.981782:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860015976762304
00010000:00000001:0.0:1773851856.981783:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851856.981783:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042b0b92a x1860015976762304/t0(0) o400->a16a2833-6ecd-400f-aadc-6aa5fd4dc37a@16832@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1539-0'
00010000:00000001:0.0:1773851856.981785:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851856.981786:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851856.981786:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=89 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851856.981787:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851856.981788:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000031b1120 refcount 3 to 16832@kfi7
00000100:00000001:0.0:1773851856.981789:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636983281363584 : -107090428188032 : ffff9e9a1111aa80)
02000000:00000001:0.0:1773851856.981789:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851856.981790:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851856.981790:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851856.981791:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16832@kfi7
00000400:00000010:0.0:1773851856.981792:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ccec3e81.
00000100:00000200:0.0:1773851856.981792:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860015976762304, offset 224
00000400:00000200:0.0:1773851856.981794:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16832@kfi7
00000400:00000200:0.0:1773851856.981795:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16832@kfi7 to cpt 0
00000400:00000200:0.0:1773851856.981796:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d9c726de nid 16832@kfi7 refs 1
00000400:00000200:0.0:1773851856.981797:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d9c726de nid 16832@kfi7 refs 2
00000400:00000200:0.0:1773851856.981798:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d9c726de nid 16832@kfi7 refs 3
00000400:00000200:0.0:1773851856.981798:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16832@kfi7 local destination
00000400:00000200:0.0:1773851856.981800:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768713:8768713:1024:4294967295] 16832@kfi7 LPNI seq info [5659:5659:16:4294967295]
00000400:00000200:0.0:1773851856.981801:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d9c726de nid 16832@kfi7 refs 2
00000400:00000200:0.0:1773851856.981802:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16832@kfi7 to cpt 0
00000400:00000200:0.0:1773851856.981803:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16832@kfi7(16832@kfi7:16832@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851856.981805:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d9c726de nid 16832@kfi7 refs 3
00000800:00000200:0.0:1773851856.981806:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851856.981807:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851856.981809:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851856.981811:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x128a Using peer 16832@kfi7(0x128a)
00000800:00000200:0.0:1773851856.981813:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x128a: rc=0
00000800:00000200:0.0:1773851856.981815:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x128a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851856.981816:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851856.981817:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000031b1120 refcount 2 to 16832@kfi7
00010000:00000001:0.0:1773851856.981818:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851856.981818:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851856.981819:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851856.981819:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042b0b92a x1860015976762304/t0(0) o400->a16a2833-6ecd-400f-aadc-6aa5fd4dc37a@16832@kfi7:496/0 lens 224/224 e 0 to 0 dl 1773852611 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1539-0'
00000100:00100000:0.0:1773851856.981827:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042b0b92a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a16a2833-6ecd-400f-aadc-6aa5fd4dc37a+9:59211:x1860015976762304:12345-16832@kfi7:400:default-tuolumne1539-0 Request processed in 57us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851856.981829:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16832@kfi7, seq: 1997499
00000100:00000040:0.0:1773851856.981830:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000159c6112 : new rpc_count 0
00000100:00000001:0.0:1773851856.981831:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851856.981831:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851856.981832:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851856.981833:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851856.981834:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851856.981834:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000159c6112 : new refcount 8
00000100:00000001:0.0:1773851856.981835:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851856.981840:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x128a TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851856.981842:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851856.981843:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16832@kfi7: PUT: OK
00000400:00000200:1.0:1773851856.981844:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ccec3e81
00000400:00000010:1.0:1773851856.981844:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ccec3e81.
00000100:00000001:1.0:1773851856.981845:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851856.981845:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851856.981846:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d9c726de nid 16832@kfi7 refs 2
00000800:00000200:1.0:1773851856.981848:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 16832@kfi7(00000000e812fa01):0x0 lsk 4747 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x128a Transaction freed
00000800:00000200:5.0:1773851857.007971:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.007972:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851857.007973:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851857.007975:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851857.007977:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.007978:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26082@kfi7 : PUT - for me
00000400:00000200:5.0:1773851857.007979:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.007980:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 1
00000400:00000200:5.0:1773851857.007980:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.007981:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000400:00000200:5.0:1773851857.007982:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 3
00000400:00000200:5.0:1773851857.007983:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.007984:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26082@kfi7 of length 224 into portal 12 MB=0x69bab6e311fc0
00000400:00000200:5.0:1773851857.007985:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26082@kfi7 of length 224/224 into md 0x793926dc5 [64] + 120040
00000800:00000200:5.0:1773851857.007987:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851857.007988:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851857.007989:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26082@kfi7: PUT: OK
00000100:00000001:5.0:1773851857.007990:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851857.007990:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851857.007991:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005111fadc.
00000100:00000040:5.0:1773851857.007992:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000005111fadc x1860010450689984 msgsize 224
00000100:00100000:5.0:1773851857.007993:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26082@kfi7 (source: 12345-26082@kfi7)
00000100:00000001:5.0:1773851857.007994:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851857.007995:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851857.007995:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 2
02000000:00000001:7.0:1773851857.007996:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851857.007996:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851857.007996:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851857.007997:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.007997:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851857.007998:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860010450689984
00000020:00000001:7.0:1773851857.007999:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851857.007999:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a3ecc3
00000020:00000001:7.0:1773851857.008000:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851857.008000:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b01b6d34 refcount=6
00000020:00000001:7.0:1773851857.008001:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113618595840 : -106960090955776 : ffff9eb869c60000)
00000020:00000001:7.0:1773851857.008002:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113618595840 : -106960090955776 : ffff9eb869c60000)
00000100:00000001:7.0:1773851857.008003:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.008004:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851857.008004:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000020:00000010:7.0:1773851857.008005:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851857.008007:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851857.008007:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851857.008008:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851857.008008:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.008009:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851857.008009:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851857.008010:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.008011:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.008012:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851857.008012:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851857.008012:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851857.008012:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851857.008013:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26082@kfi7, seq: 2001859
00000100:00000040:7.0:1773851857.008014:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b01b6d34 : new rpc_count 1
00000100:00000001:7.0:1773851857.008014:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095588605184 : -106978120946432 : ffff9eb4371a2d00)
00000100:00000001:5.0:1773851857.008014:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.008014:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.008015:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005111fadc x1860010450689984/t0(0) o400->57c6abeb-2558-4462-b6dd-1b4491238d56@26082@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2107-0'
00000100:00000001:7.0:1773851857.008018:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.008018:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851857.008019:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005111fadc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:57c6abeb-2558-4462-b6dd-1b4491238d56+6:39496:x1860010450689984:12345-26082@kfi7:400:default-tuolumne2107-0
00000100:00000200:7.0:1773851857.008021:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860010450689984
00000020:00000001:7.0:1773851857.008021:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851857.008022:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851857.008022:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.008023:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851857.008024:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851857.008024:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851857.008025:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860010450689984, found 0 last_xid 1860010450689983
00000020:00000001:7.0:1773851857.008026:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851857.008026:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851857.008027:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851857.008027:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.008028:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851857.008028:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851857.008029:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851857.008030:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cd745753.
02000000:00000001:7.0:1773851857.008031:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.008031:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.008032:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851857.008033:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860010450689984
00010000:00000001:7.0:1773851857.008033:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851857.008034:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005111fadc x1860010450689984/t0(0) o400->57c6abeb-2558-4462-b6dd-1b4491238d56@26082@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2107-0'
00010000:00000001:7.0:1773851857.008037:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851857.008037:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851857.008038:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=89 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851857.008039:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851857.008039:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001557af9a refcount 3 to 26082@kfi7
00000100:00000001:7.0:1773851857.008040:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702400 : -107156155849216 : ffff9e8ac3652600)
02000000:00000001:7.0:1773851857.008041:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851857.008041:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.008042:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851857.008043:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26082@kfi7
00000400:00000010:7.0:1773851857.008043:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a17c530.
00000100:00000200:7.0:1773851857.008044:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860010450689984, offset 224
00000400:00000200:7.0:1773851857.008045:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26082@kfi7
00000400:00000200:7.0:1773851857.008046:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.008047:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 1
00000400:00000200:7.0:1773851857.008048:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000400:00000200:7.0:1773851857.008049:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 3
00000400:00000200:7.0:1773851857.008050:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26082@kfi7 local destination
00000400:00000200:7.0:1773851857.008051:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768714:8768714:1024:4294967295] 26082@kfi7 LPNI seq info [5155699:5155699:16:4294967295]
00000400:00000200:7.0:1773851857.008053:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000400:00000200:7.0:1773851857.008053:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.008055:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26082@kfi7(26082@kfi7:26082@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851857.008056:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 3
00000800:00000200:7.0:1773851857.008058:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851857.008060:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851857.008062:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851857.008064:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000479 Using peer 26082@kfi7(0x100000000000479)
00000800:00000200:7.0:1773851857.008067:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x100000000000479: rc=0
00000800:00000200:7.0:1773851857.008068:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000479 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851857.008070:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.008071:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001557af9a refcount 2 to 26082@kfi7
00010000:00000001:7.0:1773851857.008071:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851857.008072:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.008073:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851857.008073:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005111fadc x1860010450689984/t0(0) o400->57c6abeb-2558-4462-b6dd-1b4491238d56@26082@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2107-0'
00000100:00100000:7.0:1773851857.008077:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005111fadc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:57c6abeb-2558-4462-b6dd-1b4491238d56+6:39496:x1860010450689984:12345-26082@kfi7:400:default-tuolumne2107-0 Request processed in 58us (84us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851857.008079:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26082@kfi7, seq: 2001859
00000100:00000040:7.0:1773851857.008080:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b01b6d34 : new rpc_count 0
00000100:00000001:7.0:1773851857.008080:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851857.008080:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000479 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851857.008081:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851857.008081:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851857.008081:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851857.008082:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000400:00000200:5.0:1773851857.008082:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26082@kfi7: PUT: OK
00000020:00000010:7.0:1773851857.008083:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000020:00000040:7.0:1773851857.008083:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000b01b6d34 : new refcount 5
00000400:00000200:5.0:1773851857.008083:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a17c530
00000400:00000010:5.0:1773851857.008083:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a17c530.
00000100:00000001:7.0:1773851857.008084:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851857.008084:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851857.008085:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851857.008085:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000800:00000200:5.0:1773851857.008087:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 26082@kfi7(00000000f69d17d5):0x0 lsk 1146 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000479 Transaction freed
00000800:00000200:9.0:1773851857.013401:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851857.013403:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851857.013405:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851857.013413:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851857.013417:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25009@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.013419:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25009@kfi7 : PUT - for me
00000400:00000200:9.0:1773851857.013421:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25009@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.013422:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3af0176 nid 25009@kfi7 refs 1
00000400:00000200:9.0:1773851857.013424:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25009@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.013425:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3af0176 nid 25009@kfi7 refs 2
00000400:00000200:9.0:1773851857.013427:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f3af0176 nid 25009@kfi7 refs 3
00000400:00000200:9.0:1773851857.013428:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24944@kfi7 to cpt 4
00000400:00000200:9.0:1773851857.013430:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24944@kfi7 of length 224 into portal 12 MB=0x699e127fb1380
00000400:00000200:9.0:1773851857.013433:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24944@kfi7 of length 224/224 into md 0x78146ce49 [64] + 123208
00000800:00000200:9.0:1773851857.013436:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851857.013439:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851857.013441:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25009@kfi7: PUT: OK
00000100:00000001:9.0:1773851857.013443:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851857.013443:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851857.013445:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000afd40c55.
00000100:00000040:9.0:1773851857.013446:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000afd40c55 x1858042177721216 msgsize 224
00000100:00100000:9.0:1773851857.013449:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24944@kfi7 (source: 12345-25009@kfi7)
00000100:00000001:9.0:1773851857.013450:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851857.013452:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f3af0176 nid 25009@kfi7 refs 2
00000100:00000001:11.0:1773851857.013453:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851857.013454:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851857.013454:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851857.013455:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851857.013456:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851857.013457:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851857.013458:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042177721216
00000020:00000001:11.0:1773851857.013459:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851857.013460:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91491
00000020:00000001:11.0:1773851857.013461:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851857.013464:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001f4d8162 refcount=6
00000020:00000001:11.0:1773851857.013465:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240791040 : -107152468760576 : ffff9e8b9f29a800)
00000020:00000001:11.0:1773851857.013466:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240791040 : -107152468760576 : ffff9e8b9f29a800)
00000100:00000001:11.0:1773851857.013468:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.013469:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851857.013470:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000faab3b2c.
00000020:00000010:11.0:1773851857.013472:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851857.013473:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851857.013475:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851857.013475:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851857.013476:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.013478:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851857.013479:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851857.013479:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.013481:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.013483:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851857.013484:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851857.013484:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851857.013485:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851857.013486:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24944@kfi7, seq: 2130732
00000100:00000040:11.0:1773851857.013487:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001f4d8162 : new rpc_count 1
00000100:00000001:10.0:1773851857.013487:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.013488:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064869504 : -106983644682112 : ffff9eb2eddca880)
00000100:00000001:10.0:1773851857.013488:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.013490:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000afd40c55 x1858042177721216/t0(0) o400->26129747-492d-40ee-8367-aaa800880bc0@24944@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2046-0'
00000100:00000001:11.0:1773851857.013495:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.013497:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851857.013498:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afd40c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:26129747-492d-40ee-8367-aaa800880bc0+6:39673:x1858042177721216:12345-24944@kfi7:400:default-tuolumne2046-0
00000100:00000200:11.0:1773851857.013500:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042177721216
00000020:00000001:11.0:1773851857.013501:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851857.013502:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851857.013503:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.013504:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851857.013505:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851857.013507:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851857.013507:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042177721216, found 0 last_xid 1858042177721215
00000020:00000001:11.0:1773851857.013509:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851857.013510:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851857.013511:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851857.013512:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.013513:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851857.013514:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851857.013515:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851857.013516:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009503e737.
02000000:00000001:11.0:1773851857.013517:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.013518:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.013519:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851857.013520:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014443956, transno 0, xid 1858042177721216
00010000:00000001:11.0:1773851857.013521:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851857.013523:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000afd40c55 x1858042177721216/t0(0) o400->26129747-492d-40ee-8367-aaa800880bc0@24944@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2046-0'
00010000:00000001:11.0:1773851857.013527:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851857.013528:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851857.013529:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=90 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851857.013531:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851857.013532:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000029a682cd refcount 3 to 24944@kfi7
00000100:00000001:11.0:1773851857.013533:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517184 : -107156126034432 : ffff9e8ac52c1600)
02000000:00000001:11.0:1773851857.013534:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851857.013535:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.013537:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851857.013538:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25009@kfi7
00000400:00000010:11.0:1773851857.013539:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a4a49aeb.
00000100:00000200:11.0:1773851857.013540:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042177721216, offset 224
00000400:00000200:11.0:1773851857.013542:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25009@kfi7
00000400:00000200:11.0:1773851857.013544:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25009@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.013545:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3af0176 nid 25009@kfi7 refs 1
00000400:00000200:11.0:1773851857.013547:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f3af0176 nid 25009@kfi7 refs 2
00000400:00000200:11.0:1773851857.013548:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f3af0176 nid 25009@kfi7 refs 3
00000400:00000200:11.0:1773851857.013550:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25009@kfi7 local destination
00000400:00000200:11.0:1773851857.013552:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768715:8768715:1024:4294967295] 25009@kfi7 LPNI seq info [1421787:1421787:16:4294967295]
00000400:00000200:11.0:1773851857.013555:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f3af0176 nid 25009@kfi7 refs 2
00000400:00000200:11.0:1773851857.013556:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25009@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.013560:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25009@kfi7(25009@kfi7:25009@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851857.013562:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f3af0176 nid 25009@kfi7 refs 3
00000800:00000200:11.0:1773851857.013564:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851857.013566:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851857.013570:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851857.013573:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9b Using peer 25009@kfi7(0x100000000000f9b)
00000800:00000200:11.0:1773851857.013578:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x100000000000f9b: rc=0
00000800:00000200:11.0:1773851857.013581:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851857.013584:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.013585:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000029a682cd refcount 2 to 24944@kfi7
00010000:00000001:11.0:1773851857.013586:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851857.013587:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.013588:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851857.013589:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000afd40c55 x1858042177721216/t0(0) o400->26129747-492d-40ee-8367-aaa800880bc0@24944@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2046-0'
00000800:00000200:9.0:1773851857.013593:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9b TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851857.013596:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afd40c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:26129747-492d-40ee-8367-aaa800880bc0+6:39673:x1858042177721216:12345-24944@kfi7:400:default-tuolumne2046-0 Request processed in 100us (149us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851857.013596:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851857.013598:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25009@kfi7: PUT: OK
00000100:00100000:11.0:1773851857.013599:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24944@kfi7, seq: 2130732
00000100:00000040:11.0:1773851857.013600:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001f4d8162 : new rpc_count 0
00000400:00000200:9.0:1773851857.013600:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a4a49aeb
00000400:00000010:9.0:1773851857.013600:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a4a49aeb.
00000100:00000001:11.0:1773851857.013602:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851857.013602:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851857.013603:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851857.013603:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000100:00000001:9.0:1773851857.013603:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851857.013604:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f3af0176 nid 25009@kfi7 refs 2
00000020:00000010:11.0:1773851857.013605:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000020:00000010:11.0:1773851857.013606:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000faab3b2c.
00000020:00000040:11.0:1773851857.013607:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000001f4d8162 : new refcount 5
00000800:00000200:9.0:1773851857.013607:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 25009@kfi7(0000000083e38048):0x0 lsk 3996 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9b Transaction freed
00000100:00000001:11.0:1773851857.013608:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851857.033730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033730:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033732:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851857.033733:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851857.033733:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033735:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851857.033735:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033736:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033737:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033738:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851857.033738:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851857.033739:0:2506505:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851857.033739:0:2506505:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851857.033740:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033740:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851857.033741:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033741:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033742:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033743:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851857.033743:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851857.033743:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033744:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851857.033744:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033745:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033745:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851857.033749:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851857.033750:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851857.033750:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033750:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851857.033751:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033751:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851857.033752:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851857.033755:0:41154:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851857.033756:0:41154:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851857.033756:0:41154:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:9.0:1773851857.039661:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851857.039661:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851857.039662:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851857.039664:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851857.039665:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.039666:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18579@kfi7 : PUT - for me
00000400:00000200:9.0:1773851857.039667:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.039668:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 1
00000400:00000200:9.0:1773851857.039669:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.039669:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000400:00000200:9.0:1773851857.039670:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 3
00000400:00000200:9.0:1773851857.039671:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18514@kfi7 to cpt 3
00000400:00000200:9.0:1773851857.039671:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18514@kfi7 of length 224 into portal 12 MB=0x69b4b7e6f6dc0
00000400:00000200:9.0:1773851857.039672:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18514@kfi7 of length 224/224 into md 0x78146ce49 [64] + 123432
00000800:00000200:9.0:1773851857.039674:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851857.039675:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851857.039676:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18579@kfi7: PUT: OK
00000100:00000001:9.0:1773851857.039677:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851857.039677:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851857.039678:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009234d418.
00000100:00000040:9.0:1773851857.039678:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009234d418 x1859598406348224 msgsize 224
00000100:00100000:9.0:1773851857.039680:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18514@kfi7 (source: 12345-18579@kfi7)
00000100:00000001:9.0:1773851857.039680:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851857.039681:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000100:00000001:11.0:1773851857.039682:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851857.039682:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851857.039683:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851857.039683:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851857.039683:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851857.039684:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851857.039684:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598406348224
00000020:00000001:11.0:1773851857.039685:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851857.039685:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81d36
00000020:00000001:11.0:1773851857.039685:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851857.039687:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b29dcde6 refcount=3760
00000020:00000001:11.0:1773851857.039687:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144186622976 : -106929522928640 : ffff9ebf87c51400)
00000020:00000001:11.0:1773851857.039688:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144186622976 : -106929522928640 : ffff9ebf87c51400)
00000100:00000001:11.0:1773851857.039689:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.039689:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851857.039690:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000faab3b2c.
00000020:00000010:11.0:1773851857.039690:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851857.039691:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851857.039692:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851857.039692:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851857.039692:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.039693:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851857.039694:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851857.039695:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.039696:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.039696:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851857.039697:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851857.039697:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851857.039698:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18514@kfi7, seq: 2130733
00000100:00000040:11.0:1773851857.039698:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b29dcde6 : new rpc_count 11
00000100:00000001:10.0:1773851857.039698:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851857.039698:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.039699:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064879872 : -106983644671744 : ffff9eb2eddcd100)
00000100:00000001:10.0:1773851857.039699:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.039700:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009234d418 x1859598406348224/t0(0) o400->58d48bdb-5878-492a-901c-b1eaffa8fbe6@18514@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1654-0'
00000100:00000001:11.0:1773851857.039702:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.039703:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851857.039703:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009234d418 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:58d48bdb-5878-492a-901c-b1eaffa8fbe6+3760:39559:x1859598406348224:12345-18514@kfi7:400:default-tuolumne1654-0
00000100:00000200:11.0:1773851857.039704:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598406348224
00000020:00000001:11.0:1773851857.039705:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851857.039705:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851857.039706:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.039706:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851857.039707:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851857.039707:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851857.039708:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598406348224, found 0 last_xid 1859598405617727
00000020:00000001:11.0:1773851857.039709:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851857.039709:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851857.039709:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851857.039710:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.039710:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851857.039711:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851857.039711:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851857.039712:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dc6714b1.
02000000:00000001:11.0:1773851857.039712:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.039713:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.039713:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851857.039714:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592359, transno 0, xid 1859598406348224
00010000:00000001:11.0:1773851857.039715:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851857.039716:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009234d418 x1859598406348224/t0(0) o400->58d48bdb-5878-492a-901c-b1eaffa8fbe6@18514@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1654-0'
00010000:00000001:11.0:1773851857.039718:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851857.039719:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851857.039719:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=90 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851857.039720:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851857.039721:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006d4ea050 refcount 3 to 18514@kfi7
00000100:00000001:11.0:1773851857.039721:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298496 : -107155980253120 : ffff9e8acddc8840)
02000000:00000001:11.0:1773851857.039722:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851857.039722:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.039723:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851857.039723:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18579@kfi7
00000400:00000010:11.0:1773851857.039724:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090967037.
00000100:00000200:11.0:1773851857.039724:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598406348224, offset 224
00000400:00000200:11.0:1773851857.039729:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18579@kfi7
00000400:00000200:11.0:1773851857.039729:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.039730:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 1
00000400:00000200:11.0:1773851857.039731:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000400:00000200:11.0:1773851857.039732:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 3
00000400:00000200:11.0:1773851857.039733:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18579@kfi7 local destination
00000400:00000200:11.0:1773851857.039734:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768716:8768716:1024:4294967295] 18579@kfi7 LPNI seq info [7936755:7936755:16:4294967295]
00000400:00000200:11.0:1773851857.039735:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000400:00000200:11.0:1773851857.039736:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.039737:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18579@kfi7(18579@kfi7:18579@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851857.039738:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 3
00000800:00000200:11.0:1773851857.039740:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851857.039741:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851857.039742:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851857.039746:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000001ad Using peer 18579@kfi7(0x1000000000001ad)
00000800:00000200:11.0:1773851857.039749:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x1000000000001ad: rc=0
00000800:00000200:11.0:1773851857.039750:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000001ad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851857.039752:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.039752:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006d4ea050 refcount 2 to 18514@kfi7
00010000:00000001:11.0:1773851857.039753:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851857.039753:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.039754:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851857.039754:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009234d418 x1859598406348224/t0(0) o400->58d48bdb-5878-492a-901c-b1eaffa8fbe6@18514@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1654-0'
00000100:00100000:11.0:1773851857.039757:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009234d418 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:58d48bdb-5878-492a-901c-b1eaffa8fbe6+3760:39559:x1859598406348224:12345-18514@kfi7:400:default-tuolumne1654-0 Request processed in 54us (78us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851857.039759:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18514@kfi7, seq: 2130733
00000100:00000040:11.0:1773851857.039760:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b29dcde6 : new rpc_count 10
00000100:00000001:11.0:1773851857.039760:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851857.039761:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851857.039761:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000800:00000200:9.0:1773851857.039761:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000001ad TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851857.039762:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000020:00000010:11.0:1773851857.039763:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000faab3b2c.
00000020:00000040:11.0:1773851857.039763:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b29dcde6 : new refcount 3759
00000400:00000200:9.0:1773851857.039763:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851857.039764:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851857.039764:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18579@kfi7: PUT: OK
00000400:00000200:9.0:1773851857.039764:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090967037
00000400:00000010:9.0:1773851857.039765:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090967037.
00000100:00000001:9.0:1773851857.039765:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851857.039766:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851857.039766:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000800:00000200:9.0:1773851857.039767:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 18579@kfi7(0000000042b2a5bc):0x0 lsk 430 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000001ad Transaction freed
00000800:00000200:29.0:1773851857.068406:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851857.068408:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851857.068410:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851857.068413:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851857.068417:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16290@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.068419:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16290@kfi7 : PUT - for me
00000400:00000200:29.0:1773851857.068421:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16290@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.068423:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db8ab03e nid 16290@kfi7 refs 1
00000400:00000200:29.0:1773851857.068425:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16290@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.068426:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db8ab03e nid 16290@kfi7 refs 2
00000400:00000200:29.0:1773851857.068427:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db8ab03e nid 16290@kfi7 refs 3
00000400:00000200:29.0:1773851857.068429:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16291@kfi7 to cpt 2
00000400:00000200:29.0:1773851857.068431:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16291@kfi7 of length 224 into portal 12 MB=0x69b4b63cbd280
00000400:00000200:29.0:1773851857.068433:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16291@kfi7 of length 224/224 into md 0x77fe139dd [64] + 164480
00000800:00000200:29.0:1773851857.068436:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851857.068439:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851857.068440:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16290@kfi7: PUT: OK
00000100:00000001:29.0:1773851857.068442:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851857.068443:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851857.068444:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b1982c10.
00000100:00000040:29.0:1773851857.068445:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000b1982c10 x1859597959418496 msgsize 224
00000100:00100000:29.0:1773851857.068448:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16291@kfi7 (source: 12345-16290@kfi7)
00000100:00000001:29.0:1773851857.068449:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851857.068450:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db8ab03e nid 16290@kfi7 refs 2
00000100:00000001:28.0:1773851857.068452:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851857.068453:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851857.068454:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851857.068455:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851857.068456:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851857.068457:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851857.068459:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597959418496
00000020:00000001:28.0:1773851857.068460:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851857.068461:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2709e5a8
00000020:00000001:28.0:1773851857.068462:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851857.068467:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000091777828 refcount=5
00000020:00000001:28.0:1773851857.068468:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637080247916544 : -106993461635072 : ffff9eb0a4b9d800)
00000020:00000001:28.0:1773851857.068470:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637080247916544 : -106993461635072 : ffff9eb0a4b9d800)
00000100:00000001:28.0:1773851857.068472:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851857.068473:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851857.068474:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cd411c23.
00000020:00000010:28.0:1773851857.068476:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851857.068477:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a4752a66.
00000100:00000001:28.0:1773851857.068478:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851857.068478:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851857.068479:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851857.068480:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851857.068480:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851857.068481:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.068482:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851857.068483:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851857.068484:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851857.068484:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851857.068484:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851857.068485:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16291@kfi7, seq: 2055472
00000100:00000001:31.0:1773851857.068486:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851857.068486:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000091777828 : new rpc_count 1
00000100:00000001:31.0:1773851857.068487:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.068487:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221545216 : -106948488006400 : ffff9ebb1d5cf500)
00000100:00000040:28.0:1773851857.068488:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b1982c10 x1859597959418496/t0(0) o400->998ebe46-fe66-486f-ac68-768d64ddc8f2@16291@kfi7:645/0 lens 224/0 e 0 to 0 dl 1773852005 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1500-0'
00000100:00000001:28.0:1773851857.068492:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851857.068492:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851857.068493:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1982c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:998ebe46-fe66-486f-ac68-768d64ddc8f2+5:39556:x1859597959418496:12345-16291@kfi7:400:default-tuolumne1500-0
00000100:00000200:28.0:1773851857.068497:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597959418496
00000020:00000001:28.0:1773851857.068498:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851857.068498:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851857.068499:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851857.068500:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851857.068500:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851857.068502:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851857.068502:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597959418496, found 0 last_xid 1859597959418495
00000020:00000001:28.0:1773851857.068503:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851857.068504:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851857.068505:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851857.068505:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851857.068506:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851857.068507:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851857.068507:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851857.068508:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f37a3433.
02000000:00000001:28.0:1773851857.068509:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.068510:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851857.068510:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851857.068511:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044165619, transno 0, xid 1859597959418496
00010000:00000001:28.0:1773851857.068512:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851857.068513:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b1982c10 x1859597959418496/t0(0) o400->998ebe46-fe66-486f-ac68-768d64ddc8f2@16291@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1500-0'
00010000:00000001:28.0:1773851857.068516:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851857.068517:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851857.068518:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=90 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851857.068519:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851857.068519:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b6f479ad refcount 3 to 16291@kfi7
00000100:00000001:28.0:1773851857.068520:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902583040 : -107154806968576 : ffff9e8b13cb6f00)
02000000:00000001:28.0:1773851857.068521:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851857.068522:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.068522:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851857.068523:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16290@kfi7
00000400:00000010:28.0:1773851857.068524:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e5971693.
00000100:00000200:28.0:1773851857.068525:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597959418496, offset 224
00000400:00000200:28.0:1773851857.068526:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16290@kfi7
00000400:00000200:28.0:1773851857.068527:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16290@kfi7 to cpt 7
00000400:00000200:28.0:1773851857.068528:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db8ab03e nid 16290@kfi7 refs 1
00000400:00000200:28.0:1773851857.068529:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db8ab03e nid 16290@kfi7 refs 2
00000400:00000200:28.0:1773851857.068530:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db8ab03e nid 16290@kfi7 refs 3
00000400:00000200:28.0:1773851857.068531:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16290@kfi7 local destination
00000400:00000200:28.0:1773851857.068532:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768717:8768717:1024:4294967295] 16290@kfi7 LPNI seq info [264022:264022:16:4294967295]
00000400:00000200:28.0:1773851857.068534:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db8ab03e nid 16290@kfi7 refs 2
00000400:00000200:28.0:1773851857.068535:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16290@kfi7 to cpt 7
00000400:00000200:28.0:1773851857.068537:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16290@kfi7(16290@kfi7:16290@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851857.068538:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db8ab03e nid 16290@kfi7 refs 3
00000800:00000200:28.0:1773851857.068539:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851857.068540:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851857.068542:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851857.068544:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b8f Using peer 16290@kfi7(0x100000000000b8f)
00000800:00000200:28.0:1773851857.068547:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x100000000000b8f: rc=0
00000800:00000200:28.0:1773851857.068549:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b8f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851857.068551:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851857.068552:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b6f479ad refcount 2 to 16291@kfi7
00010000:00000001:28.0:1773851857.068552:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851857.068553:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851857.068553:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851857.068554:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b1982c10 x1859597959418496/t0(0) o400->998ebe46-fe66-486f-ac68-768d64ddc8f2@16291@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1500-0'
00000100:00100000:28.0:1773851857.068558:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1982c10 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:998ebe46-fe66-486f-ac68-768d64ddc8f2+5:39556:x1859597959418496:12345-16291@kfi7:400:default-tuolumne1500-0 Request processed in 66us (113us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851857.068561:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16291@kfi7, seq: 2055472
00000100:00000040:28.0:1773851857.068562:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000091777828 : new rpc_count 0
00000100:00000001:28.0:1773851857.068563:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851857.068563:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851857.068564:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851857.068565:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a4752a66.
00000020:00000010:28.0:1773851857.068565:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cd411c23.
00000020:00000040:28.0:1773851857.068566:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000091777828 : new refcount 4
00000100:00000001:28.0:1773851857.068567:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851857.068572:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b8f TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851857.068573:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851857.068574:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16290@kfi7: PUT: OK
00000400:00000200:29.0:1773851857.068575:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e5971693
00000400:00000010:29.0:1773851857.068576:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e5971693.
00000100:00000001:29.0:1773851857.068577:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851857.068577:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851857.068578:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db8ab03e nid 16290@kfi7 refs 2
00000800:00000200:29.0:1773851857.068580:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 16290@kfi7(000000005574966e):0x0 lsk 2960 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b8f Transaction freed
00000800:00000200:13.0:1773851857.075764:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.075764:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851857.075766:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851857.075768:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851857.075769:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12131@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.075771:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12131@kfi7 : PUT - for me
00000400:00000200:13.0:1773851857.075772:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12131@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.075773:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000149d7421 nid 12131@kfi7 refs 1
00000400:00000200:13.0:1773851857.075773:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12131@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.075774:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000149d7421 nid 12131@kfi7 refs 2
00000400:00000200:13.0:1773851857.075775:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000149d7421 nid 12131@kfi7 refs 3
00000400:00000200:13.0:1773851857.075775:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12195@kfi7 to cpt 6
00000400:00000200:13.0:1773851857.075776:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12195@kfi7 of length 224 into portal 12 MB=0x69b4b8af816c0
00000400:00000200:13.0:1773851857.075777:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12195@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 16584
00000800:00000200:13.0:1773851857.075779:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851857.075781:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851857.075782:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12131@kfi7: PUT: OK
00000100:00000001:13.0:1773851857.075783:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851857.075783:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851857.075784:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ded60745.
00000100:00000040:13.0:1773851857.075784:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ded60745 x1859598616630976 msgsize 224
00000100:00100000:13.0:1773851857.075786:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12195@kfi7 (source: 12345-12131@kfi7)
00000100:00000001:13.0:1773851857.075787:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851857.075788:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000149d7421 nid 12131@kfi7 refs 2
00000800:00000200:13.0:1773851857.075790:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851857.075792:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851857.075793:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851857.075793:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851857.075794:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851857.075794:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851857.075795:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598616630976
00000020:00000001:13.0:1773851857.075796:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851857.075796:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ea37
00000020:00000001:13.0:1773851857.075797:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851857.075799:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c82d519e refcount=4125
00000020:00000001:13.0:1773851857.075799:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121298387968 : -106952411163648 : ffff9eba33865400)
00000020:00000001:13.0:1773851857.075800:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121298387968 : -106952411163648 : ffff9eba33865400)
00000100:00000001:13.0:1773851857.075802:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.075802:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851857.075803:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851857.075804:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.075805:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851857.075806:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851857.075806:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851857.075807:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.075808:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851857.075808:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851857.075809:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.075809:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851857.075811:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.075811:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851857.075811:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851857.075811:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851857.075812:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12195@kfi7, seq: 2289780
00000100:00000001:15.0:1773851857.075813:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.075813:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c82d519e : new rpc_count 11
00000100:00000001:15.0:1773851857.075814:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.075814:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197411456 : -106942512140160 : ffff9ebc818d7080)
00000100:00000040:13.0:1773851857.075815:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ded60745 x1859598616630976/t0(0) o400->7b1daea4-d38a-432f-af17-f2c91421de37@12195@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1244-0'
00000100:00000001:13.0:1773851857.075817:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.075817:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851857.075818:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ded60745 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7b1daea4-d38a-432f-af17-f2c91421de37+4125:39574:x1859598616630976:12345-12195@kfi7:400:default-tuolumne1244-0
00000100:00000200:13.0:1773851857.075819:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598616630976
00000020:00000001:13.0:1773851857.075820:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851857.075820:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851857.075821:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.075822:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851857.075822:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851857.075823:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851857.075823:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598616630976, found 0 last_xid 1859598615901503
00000020:00000001:13.0:1773851857.075824:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851857.075825:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851857.075825:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851857.075826:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.075826:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851857.075827:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851857.075827:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851857.075828:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000940a044f.
02000000:00000001:13.0:1773851857.075829:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.075829:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.075830:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851857.075830:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264587636, transno 0, xid 1859598616630976
00010000:00000001:13.0:1773851857.075831:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851857.075832:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ded60745 x1859598616630976/t0(0) o400->7b1daea4-d38a-432f-af17-f2c91421de37@12195@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1244-0'
00010000:00000001:13.0:1773851857.075834:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851857.075835:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851857.075835:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=90 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851857.075836:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851857.075837:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004905e090 refcount 3 to 12195@kfi7
00000100:00000001:13.0:1773851857.075837:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985421184 : -107156724130432 : ffff9e8aa185dd80)
02000000:00000001:13.0:1773851857.075838:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851857.075839:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.075839:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851857.075840:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12131@kfi7
00000400:00000010:13.0:1773851857.075841:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070850cc4.
00000100:00000200:13.0:1773851857.075842:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598616630976, offset 224
00000400:00000200:13.0:1773851857.075843:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12131@kfi7
00000400:00000200:13.0:1773851857.075844:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12131@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.075844:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000149d7421 nid 12131@kfi7 refs 1
00000400:00000200:13.0:1773851857.075845:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000149d7421 nid 12131@kfi7 refs 2
00000400:00000200:13.0:1773851857.075846:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000149d7421 nid 12131@kfi7 refs 3
00000400:00000200:13.0:1773851857.075847:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12131@kfi7 local destination
00000400:00000200:13.0:1773851857.075848:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768718:8768718:1024:4294967295] 12131@kfi7 LPNI seq info [8709266:8709266:16:4294967295]
00000400:00000200:13.0:1773851857.075850:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000149d7421 nid 12131@kfi7 refs 2
00000400:00000200:13.0:1773851857.075850:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12131@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.075852:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12131@kfi7(12131@kfi7:12131@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851857.075853:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000149d7421 nid 12131@kfi7 refs 3
00000800:00000200:13.0:1773851857.075854:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.075855:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851857.075857:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851857.075859:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1253 Using peer 12131@kfi7(0x1253)
00000800:00000200:13.0:1773851857.075862:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 324 bytes to peer 0x1253: rc=0
00000800:00000200:13.0:1773851857.075864:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1253 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851857.075865:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.075866:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004905e090 refcount 2 to 12195@kfi7
00010000:00000001:13.0:1773851857.075867:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851857.075867:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.075868:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851857.075868:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ded60745 x1859598616630976/t0(0) o400->7b1daea4-d38a-432f-af17-f2c91421de37@12195@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1244-0'
00000100:00100000:13.0:1773851857.075871:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ded60745 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7b1daea4-d38a-432f-af17-f2c91421de37+4125:39574:x1859598616630976:12345-12195@kfi7:400:default-tuolumne1244-0 Request processed in 53us (86us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851857.075873:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12195@kfi7, seq: 2289780
00000100:00000040:13.0:1773851857.075874:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c82d519e : new rpc_count 10
00000100:00000001:13.0:1773851857.075875:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851857.075875:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851857.075875:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:14.0:1773851857.075876:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1253 TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851857.075876:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000020:00000010:13.0:1773851857.075877:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000400:00000200:14.0:1773851857.075878:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:13.0:1773851857.075878:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c82d519e : new refcount 4124
00000100:00000001:13.0:1773851857.075878:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851857.075879:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12131@kfi7: PUT: OK
00000400:00000200:14.0:1773851857.075880:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070850cc4
00000400:00000010:14.0:1773851857.075880:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070850cc4.
00000100:00000001:14.0:1773851857.075881:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851857.075882:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851857.075883:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000149d7421 nid 12131@kfi7 refs 2
00000800:00000200:14.0:1773851857.075884:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 12131@kfi7(00000000eeb0762c):0x0 lsk 4692 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1253 Transaction freed
00000800:00000200:1.0:1773851857.086747:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851857.086749:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851857.086751:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851857.086755:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851857.086758:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9952@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.086760:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9952@kfi7 : PUT - for me
00000400:00000200:1.0:1773851857.086762:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9952@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.086763:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f55d310 nid 9952@kfi7 refs 1
00000400:00000200:1.0:1773851857.086765:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9952@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.086766:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f55d310 nid 9952@kfi7 refs 2
00000400:00000200:1.0:1773851857.086767:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009f55d310 nid 9952@kfi7 refs 3
00000400:00000200:1.0:1773851857.086768:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9760@kfi7 to cpt 6
00000400:00000200:1.0:1773851857.086770:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9760@kfi7 of length 224 into portal 12 MB=0x699e1e0046fc0
00000400:00000200:1.0:1773851857.086772:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9760@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 15136
00000800:00000200:1.0:1773851857.086775:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851857.086777:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.086779:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9952@kfi7: PUT: OK
00000100:00000001:1.0:1773851857.086781:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851857.086781:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851857.086783:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000075dab385.
00000100:00000040:1.0:1773851857.086784:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000075dab385 x1858045265342400 msgsize 224
00000100:00100000:1.0:1773851857.086786:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9760@kfi7 (source: 12345-9952@kfi7)
00000100:00000001:1.0:1773851857.086788:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851857.086789:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009f55d310 nid 9952@kfi7 refs 2
00000100:00000001:0.0:1773851857.086791:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851857.086792:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851857.086792:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851857.086793:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851857.086793:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851857.086795:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.086796:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858045265342400
00000020:00000001:0.0:1773851857.086797:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851857.086797:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9156a
00000020:00000001:0.0:1773851857.086798:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851857.086801:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007454a070 refcount=166
00000020:00000001:0.0:1773851857.086802:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241015296 : -107152468536320 : ffff9e8b9f2d1400)
00000020:00000001:0.0:1773851857.086803:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241015296 : -107152468536320 : ffff9e8b9f2d1400)
00000100:00000001:0.0:1773851857.086805:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.086806:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851857.086807:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851857.086809:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.086810:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851857.086812:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851857.086813:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851857.086813:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.086815:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851857.086817:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851857.086817:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.086819:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.086821:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.086822:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.086822:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851857.086822:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851857.086823:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9760@kfi7, seq: 1997500
00000100:00000001:1.0:1773851857.086825:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.086825:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007454a070 : new rpc_count 1
00000100:00000001:1.0:1773851857.086826:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.086826:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605648896 : -106923103902720 : ffff9ec1065fa400)
00000100:00000040:0.0:1773851857.086828:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000075dab385 x1858045265342400/t0(0) o400->5bc4ae68-43c4-43e1-a1cc-cff6914f11a5@9760@kfi7:497/0 lens 224/0 e 0 to 0 dl 1773852612 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1103-0'
00000100:00000001:0.0:1773851857.086832:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.086833:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851857.086834:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075dab385 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5bc4ae68-43c4-43e1-a1cc-cff6914f11a5+166:39656:x1858045265342400:12345-9760@kfi7:400:default-tuolumne1103-0
00000100:00000200:0.0:1773851857.086837:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858045265342400
00000020:00000001:0.0:1773851857.086838:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851857.086839:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851857.086840:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.086841:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851857.086842:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851857.086843:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851857.086844:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858045265342400, found 0 last_xid 1858045264919551
00000020:00000001:0.0:1773851857.086845:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851857.086846:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851857.086847:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851857.086848:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.086849:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851857.086850:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851857.086851:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851857.086852:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008bca8dd1.
02000000:00000001:0.0:1773851857.086853:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.086854:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.086855:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851857.086856:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062615, transno 0, xid 1858045265342400
00010000:00000001:0.0:1773851857.086857:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851857.086859:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000075dab385 x1858045265342400/t0(0) o400->5bc4ae68-43c4-43e1-a1cc-cff6914f11a5@9760@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1103-0'
00010000:00000001:0.0:1773851857.086862:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851857.086863:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851857.086864:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=90 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851857.086866:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851857.086867:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eaf96cfe refcount 3 to 9760@kfi7
00000100:00000001:0.0:1773851857.086868:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330432 : -107155410221184 : ffff9e8aefd68780)
02000000:00000001:0.0:1773851857.086869:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851857.086870:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.086871:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851857.086872:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9952@kfi7
00000400:00000010:0.0:1773851857.086873:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007a35718f.
00000100:00000200:0.0:1773851857.086874:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858045265342400, offset 224
00000400:00000200:0.0:1773851857.086876:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9952@kfi7
00000400:00000200:0.0:1773851857.086877:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9952@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.086879:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f55d310 nid 9952@kfi7 refs 1
00000400:00000200:0.0:1773851857.086880:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009f55d310 nid 9952@kfi7 refs 2
00000400:00000200:0.0:1773851857.086882:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009f55d310 nid 9952@kfi7 refs 3
00000400:00000200:0.0:1773851857.086884:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9952@kfi7 local destination
00000400:00000200:0.0:1773851857.086886:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768719:8768719:1024:4294967295] 9952@kfi7 LPNI seq info [19121940:19121940:16:4294967295]
00000400:00000200:0.0:1773851857.086889:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009f55d310 nid 9952@kfi7 refs 2
00000400:00000200:0.0:1773851857.086890:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9952@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.086893:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9952@kfi7(9952@kfi7:9952@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851857.086895:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009f55d310 nid 9952@kfi7 refs 3
00000800:00000200:0.0:1773851857.086897:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851857.086899:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851857.086902:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851857.086906:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ffd Using peer 9952@kfi7(0x100000000000ffd)
00000800:00000200:0.0:1773851857.086910:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x100000000000ffd: rc=0
00000800:00000200:0.0:1773851857.086912:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ffd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851857.086916:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.086917:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eaf96cfe refcount 2 to 9760@kfi7
00010000:00000001:0.0:1773851857.086918:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851857.086919:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.086922:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851857.086923:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000075dab385 x1858045265342400/t0(0) o400->5bc4ae68-43c4-43e1-a1cc-cff6914f11a5@9760@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1103-0'
00000100:00100000:0.0:1773851857.086928:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075dab385 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5bc4ae68-43c4-43e1-a1cc-cff6914f11a5+166:39656:x1858045265342400:12345-9760@kfi7:400:default-tuolumne1103-0 Request processed in 94us (143us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851857.086931:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9760@kfi7, seq: 1997500
00000100:00000040:0.0:1773851857.086933:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007454a070 : new rpc_count 0
00000100:00000001:0.0:1773851857.086934:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851857.086934:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851857.086935:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.086936:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851857.086938:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851857.086938:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000007454a070 : new refcount 165
00000100:00000001:0.0:1773851857.086939:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851857.086948:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ffd TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851857.086951:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.086953:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9952@kfi7: PUT: OK
00000400:00000200:1.0:1773851857.086954:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007a35718f
00000400:00000010:1.0:1773851857.086955:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007a35718f.
00000100:00000001:1.0:1773851857.086956:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851857.086957:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851857.086958:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009f55d310 nid 9952@kfi7 refs 2
00000800:00000200:1.0:1773851857.086961:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 9952@kfi7(00000000c3fe6f07):0x0 lsk 4094 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ffd Transaction freed
00000800:00000200:1.0:1773851857.105426:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851857.105427:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851857.105429:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851857.105433:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851857.105437:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9795@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.105438:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9795@kfi7 : PUT - for me
00000400:00000200:1.0:1773851857.105440:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9795@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.105441:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a603f2b nid 9795@kfi7 refs 1
00000400:00000200:1.0:1773851857.105443:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9795@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.105444:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a603f2b nid 9795@kfi7 refs 2
00000400:00000200:1.0:1773851857.105446:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003a603f2b nid 9795@kfi7 refs 3
00000400:00000200:1.0:1773851857.105448:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:1.0:1773851857.105449:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9859@kfi7 of length 224 into portal 12 MB=0x69a9e47eb7a00
00000400:00000200:1.0:1773851857.105451:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9859@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 15360
00000800:00000200:1.0:1773851857.105454:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851857.105457:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.105459:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9795@kfi7: PUT: OK
00000100:00000001:1.0:1773851857.105461:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851857.105462:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851857.105463:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b1a8b5a2.
00000100:00000040:1.0:1773851857.105464:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000b1a8b5a2 x1858854462388736 msgsize 224
00000100:00100000:1.0:1773851857.105467:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9859@kfi7 (source: 12345-9795@kfi7)
00000100:00000001:1.0:1773851857.105469:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851857.105470:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003a603f2b nid 9795@kfi7 refs 2
00000100:00000001:0.0:1773851857.105471:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851857.105472:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851857.105472:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851857.105473:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851857.105473:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851857.105474:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.105475:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858854462388736
00000020:00000001:0.0:1773851857.105476:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851857.105476:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9205a
00000020:00000001:0.0:1773851857.105477:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851857.105479:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000013e0a55e refcount=1076
00000020:00000001:0.0:1773851857.105480:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629492736 : -107123080058880 : ffff9e9276dda800)
00000020:00000001:0.0:1773851857.105481:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629492736 : -107123080058880 : ffff9e9276dda800)
00000100:00000001:0.0:1773851857.105482:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.105483:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851857.105483:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851857.105484:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.105484:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851857.105485:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851857.105485:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851857.105486:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.105487:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851857.105487:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851857.105488:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.105488:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.105489:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.105490:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851857.105490:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851857.105491:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851857.105491:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9859@kfi7, seq: 1997501
00000100:00000001:1.0:1773851857.105492:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851857.105492:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.105492:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000013e0a55e : new rpc_count 3
00000100:00000001:0.0:1773851857.105492:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605667328 : -106923103884288 : ffff9ec1065fec00)
00000100:00000040:0.0:1773851857.105493:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b1a8b5a2 x1858854462388736/t0(0) o400->726a12db-5a5e-4487-b031-20a1f1bb333e@9859@kfi7:497/0 lens 224/0 e 0 to 0 dl 1773852612 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1112-0'
00000100:00000001:0.0:1773851857.105496:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.105497:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851857.105497:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1a8b5a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:726a12db-5a5e-4487-b031-20a1f1bb333e+1076:39835:x1858854462388736:12345-9859@kfi7:400:default-tuolumne1112-0
00000100:00000200:0.0:1773851857.105499:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858854462388736
00000020:00000001:0.0:1773851857.105499:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851857.105500:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851857.105500:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.105501:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851857.105501:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851857.105502:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851857.105502:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858854462388736, found 0 last_xid 1858854377157375
00000020:00000001:0.0:1773851857.105503:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851857.105504:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851857.105504:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851857.105505:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.105505:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851857.105506:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851857.105506:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851857.105506:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000afbd23bc.
02000000:00000001:0.0:1773851857.105507:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.105507:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.105508:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851857.105509:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590604, transno 0, xid 1858854462388736
00010000:00000001:0.0:1773851857.105509:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851857.105510:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b1a8b5a2 x1858854462388736/t0(0) o400->726a12db-5a5e-4487-b031-20a1f1bb333e@9859@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1112-0'
00010000:00000001:0.0:1773851857.105513:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851857.105513:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851857.105514:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=90 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851857.105515:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851857.105515:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bcf654c6 refcount 3 to 9859@kfi7
00000100:00000001:0.0:1773851857.105516:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363994048 : -107142345557568 : ffff9e8dfa8d79c0)
02000000:00000001:0.0:1773851857.105516:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851857.105517:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.105517:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851857.105518:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9795@kfi7
00000400:00000010:0.0:1773851857.105519:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028349810.
00000100:00000200:0.0:1773851857.105519:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858854462388736, offset 224
00000400:00000200:0.0:1773851857.105521:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9795@kfi7
00000400:00000200:0.0:1773851857.105522:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9795@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.105522:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a603f2b nid 9795@kfi7 refs 1
00000400:00000200:0.0:1773851857.105523:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003a603f2b nid 9795@kfi7 refs 2
00000400:00000200:0.0:1773851857.105525:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003a603f2b nid 9795@kfi7 refs 3
00000400:00000200:0.0:1773851857.105526:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9795@kfi7 local destination
00000400:00000200:0.0:1773851857.105527:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768720:8768720:1024:4294967295] 9795@kfi7 LPNI seq info [3699155:3699155:16:4294967295]
00000400:00000200:0.0:1773851857.105529:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003a603f2b nid 9795@kfi7 refs 2
00000400:00000200:0.0:1773851857.105529:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9795@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.105531:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9795@kfi7(9795@kfi7:9795@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851857.105533:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003a603f2b nid 9795@kfi7 refs 3
00000800:00000200:0.0:1773851857.105534:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851857.105535:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851857.105537:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851857.105539:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c7e Using peer 9795@kfi7(0x100000000000c7e)
00000800:00000200:0.0:1773851857.105542:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x100000000000c7e: rc=0
00000800:00000200:0.0:1773851857.105543:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c7e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851857.105545:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.105546:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bcf654c6 refcount 2 to 9859@kfi7
00010000:00000001:0.0:1773851857.105546:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851857.105547:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.105547:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851857.105548:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b1a8b5a2 x1858854462388736/t0(0) o400->726a12db-5a5e-4487-b031-20a1f1bb333e@9859@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1112-0'
00000100:00100000:0.0:1773851857.105553:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1a8b5a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:726a12db-5a5e-4487-b031-20a1f1bb333e+1076:39835:x1858854462388736:12345-9859@kfi7:400:default-tuolumne1112-0 Request processed in 56us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851857.105555:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9859@kfi7, seq: 1997501
00000100:00000040:0.0:1773851857.105556:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000013e0a55e : new rpc_count 2
00000100:00000001:0.0:1773851857.105556:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851857.105557:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851857.105557:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.105558:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851857.105558:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851857.105559:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000013e0a55e : new refcount 1075
00000100:00000001:0.0:1773851857.105560:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851857.105565:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c7e TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851857.105569:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851857.105570:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9795@kfi7: PUT: OK
00000400:00000200:2.0:1773851857.105571:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028349810
00000400:00000010:2.0:1773851857.105572:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028349810.
00000100:00000001:2.0:1773851857.105572:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851857.105573:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851857.105573:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003a603f2b nid 9795@kfi7 refs 2
00000800:00000200:2.0:1773851857.105575:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 9795@kfi7(0000000056aa10e7):0x0 lsk 3199 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c7e Transaction freed
00000800:00000200:14.0:1773851857.135432:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851857.135433:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851857.135435:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851857.135437:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851857.135439:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10097@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.135441:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10097@kfi7 : PUT - for me
00000400:00000200:14.0:1773851857.135442:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10097@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.135443:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1db8485 nid 10097@kfi7 refs 1
00000400:00000200:14.0:1773851857.135444:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10097@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.135445:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1db8485 nid 10097@kfi7 refs 2
00000400:00000200:14.0:1773851857.135446:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b1db8485 nid 10097@kfi7 refs 3
00000400:00000200:14.0:1773851857.135447:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10160@kfi7 to cpt 4
00000400:00000200:14.0:1773851857.135448:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10160@kfi7 of length 224 into portal 12 MB=0x699e17411d400
00000400:00000200:14.0:1773851857.135450:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10160@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 16808
00000800:00000200:14.0:1773851857.135452:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851857.135455:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851857.135456:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10097@kfi7: PUT: OK
00000100:00000001:14.0:1773851857.135457:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851857.135458:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851857.135459:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004dd789b1.
00000100:00000040:14.0:1773851857.135459:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000004dd789b1 x1858043454280704 msgsize 224
00000100:00100000:14.0:1773851857.135461:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-10160@kfi7 (source: 12345-10097@kfi7)
00000100:00000001:14.0:1773851857.135463:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851857.135464:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1db8485 nid 10097@kfi7 refs 2
00000800:00000200:14.0:1773851857.135465:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851857.135465:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851857.135465:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851857.135466:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851857.135466:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851857.135467:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851857.135468:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043454280704
00000020:00000001:13.0:1773851857.135469:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851857.135469:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91134
00000020:00000001:13.0:1773851857.135470:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851857.135472:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c090b44 refcount=6
00000020:00000001:13.0:1773851857.135472:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240350720 : -107152469200896 : ffff9e8b9f22f000)
00000020:00000001:13.0:1773851857.135473:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240350720 : -107152469200896 : ffff9e8b9f22f000)
00000100:00000001:13.0:1773851857.135474:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.135475:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851857.135476:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851857.135477:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.135478:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851857.135479:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851857.135479:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851857.135480:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.135481:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851857.135481:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851857.135482:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.135483:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851857.135484:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851857.135484:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.135485:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851857.135485:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851857.135486:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10160@kfi7, seq: 2289781
00000100:00000001:15.0:1773851857.135487:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.135487:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004c090b44 : new rpc_count 1
00000100:00000001:13.0:1773851857.135487:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341831424 : -106946367720192 : ffff9ebb9bbdf500)
00000100:00000001:15.0:1773851857.135488:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.135489:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004dd789b1 x1858043454280704/t0(0) o400->74cc5ad6-0e24-400b-946a-8e65209720bf@10160@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1118-0'
00000100:00000001:13.0:1773851857.135492:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.135492:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851857.135493:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004dd789b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:74cc5ad6-0e24-400b-946a-8e65209720bf+6:39678:x1858043454280704:12345-10160@kfi7:400:default-tuolumne1118-0
00000100:00000200:13.0:1773851857.135495:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043454280704
00000020:00000001:13.0:1773851857.135496:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851857.135497:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851857.135497:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.135498:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851857.135499:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851857.135499:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851857.135500:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043454280704, found 0 last_xid 1858043454280703
00000020:00000001:13.0:1773851857.135501:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851857.135502:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851857.135502:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851857.135503:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.135503:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851857.135504:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851857.135505:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851857.135505:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000933eedab.
02000000:00000001:13.0:1773851857.135506:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.135507:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.135507:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851857.135508:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183248430794, transno 0, xid 1858043454280704
00010000:00000001:13.0:1773851857.135509:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851857.135510:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004dd789b1 x1858043454280704/t0(0) o400->74cc5ad6-0e24-400b-946a-8e65209720bf@10160@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1118-0'
00010000:00000001:13.0:1773851857.135512:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851857.135513:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851857.135514:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=90 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851857.135515:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851857.135516:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000051d36a12 refcount 3 to 10160@kfi7
00000100:00000001:13.0:1773851857.135516:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332128 : -107155408219488 : ffff9e8aeff512a0)
02000000:00000001:13.0:1773851857.135517:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851857.135518:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.135518:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851857.135519:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10097@kfi7
00000400:00000010:13.0:1773851857.135520:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008e45278a.
00000100:00000200:13.0:1773851857.135521:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043454280704, offset 224
00000400:00000200:13.0:1773851857.135523:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10097@kfi7
00000400:00000200:13.0:1773851857.135524:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10097@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.135524:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1db8485 nid 10097@kfi7 refs 1
00000400:00000200:13.0:1773851857.135526:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b1db8485 nid 10097@kfi7 refs 2
00000400:00000200:13.0:1773851857.135527:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b1db8485 nid 10097@kfi7 refs 3
00000400:00000200:13.0:1773851857.135528:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10097@kfi7 local destination
00000400:00000200:13.0:1773851857.135529:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768721:8768721:1024:4294967295] 10097@kfi7 LPNI seq info [774253:774253:16:4294967295]
00000400:00000200:13.0:1773851857.135531:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b1db8485 nid 10097@kfi7 refs 2
00000400:00000200:13.0:1773851857.135532:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10097@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.135534:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10097@kfi7(10097@kfi7:10097@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851857.135536:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b1db8485 nid 10097@kfi7 refs 3
00000800:00000200:13.0:1773851857.135537:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.135539:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851857.135541:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851857.135543:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ab Using peer 10097@kfi7(0x1000000000005ab)
00000800:00000200:13.0:1773851857.135547:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008e3f5456: Posted send of 324 bytes to peer 0x1000000000005ab: rc=0
00000800:00000200:13.0:1773851857.135549:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851857.135552:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.135553:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000051d36a12 refcount 2 to 10160@kfi7
00010000:00000001:13.0:1773851857.135554:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851857.135555:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.135556:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851857.135557:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004dd789b1 x1858043454280704/t0(0) o400->74cc5ad6-0e24-400b-946a-8e65209720bf@10160@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1118-0'
00000100:00100000:13.0:1773851857.135563:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004dd789b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:74cc5ad6-0e24-400b-946a-8e65209720bf+6:39678:x1858043454280704:12345-10160@kfi7:400:default-tuolumne1118-0 Request processed in 70us (102us total) trans 0 rc 0/0
00000800:00000200:14.0:1773851857.135567:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ab TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851857.135568:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10160@kfi7, seq: 2289781
00000100:00000040:13.0:1773851857.135569:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004c090b44 : new rpc_count 0
00000100:00000001:13.0:1773851857.135570:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851857.135571:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851857.135572:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851857.135573:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851857.135573:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000020:00000010:13.0:1773851857.135575:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000400:00000200:14.0:1773851857.135576:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10097@kfi7: PUT: OK
00000020:00000040:13.0:1773851857.135576:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000004c090b44 : new refcount 5
00000400:00000200:14.0:1773851857.135577:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008e45278a
00000100:00000001:13.0:1773851857.135577:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:14.0:1773851857.135578:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008e45278a.
00000100:00000001:14.0:1773851857.135579:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851857.135580:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851857.135581:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1db8485 nid 10097@kfi7 refs 2
00000800:00000200:14.0:1773851857.135584:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10097@kfi7(000000004fb14509):0x0 lsk 1452 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005ab Transaction freed
00000800:00000200:21.0:1773851857.166878:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851857.166880:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851857.166881:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851857.166883:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851857.166886:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18339@kfi7 to cpt 5
00000400:00000200:21.0:1773851857.166887:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18339@kfi7 : PUT - for me
00000400:00000200:21.0:1773851857.166888:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18339@kfi7 to cpt 5
00000400:00000200:21.0:1773851857.166889:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001011d75 nid 18339@kfi7 refs 1
00000400:00000200:21.0:1773851857.166890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18339@kfi7 to cpt 5
00000400:00000200:21.0:1773851857.166891:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001011d75 nid 18339@kfi7 refs 2
00000400:00000200:21.0:1773851857.166891:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000001011d75 nid 18339@kfi7 refs 3
00000400:00000200:21.0:1773851857.166892:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18274@kfi7 to cpt 6
00000400:00000200:21.0:1773851857.166893:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18274@kfi7 of length 224 into portal 12 MB=0x69b0a1abeecc0
00000400:00000200:21.0:1773851857.166895:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18274@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 25832
00000800:00000200:21.0:1773851857.166897:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851857.166898:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851857.166899:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18339@kfi7: PUT: OK
00000100:00000001:21.0:1773851857.166900:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851857.166901:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851857.166902:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b65a11af.
00000100:00000040:21.0:1773851857.166903:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000b65a11af x1859317560962240 msgsize 224
00000100:00100000:21.0:1773851857.166904:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18274@kfi7 (source: 12345-18339@kfi7)
00000100:00000001:21.0:1773851857.166905:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851857.166906:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000001011d75 nid 18339@kfi7 refs 2
00000800:00000200:21.0:1773851857.166907:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851857.166908:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851857.166909:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851857.166910:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851857.166911:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851857.166912:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851857.166914:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317560962240
00000020:00000001:22.0:1773851857.166915:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851857.166915:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f73
00000020:00000001:22.0:1773851857.166916:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851857.166920:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e3cdad81 refcount=7
00000020:00000001:22.0:1773851857.166922:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628997120 : -107123080554496 : ffff9e9276d61800)
00000020:00000001:22.0:1773851857.166923:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628997120 : -107123080554496 : ffff9e9276d61800)
00000100:00000001:22.0:1773851857.166925:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851857.166926:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851857.166929:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c205ab6a.
00000020:00000010:22.0:1773851857.166931:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851857.166932:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008536c377.
00000100:00000001:22.0:1773851857.166934:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851857.166934:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851857.166935:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851857.166937:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851857.166938:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851857.166939:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851857.166941:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851857.166942:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851857.166943:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851857.166943:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851857.166943:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851857.166944:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18274@kfi7, seq: 1997934
00000100:00000040:23.0:1773851857.166944:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e3cdad81 : new rpc_count 1
00000100:00000001:23.0:1773851857.166945:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117341696 : -106995592209920 : ffff9eb025bbda00)
00000100:00000001:22.0:1773851857.166945:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851857.166946:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851857.166947:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b65a11af x1859317560962240/t0(0) o400->d17434e9-3dd4-4d96-99e5-ab7ad5e77c35@18274@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1628-0'
00000100:00000001:23.0:1773851857.166949:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851857.166950:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851857.166951:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b65a11af pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d17434e9-3dd4-4d96-99e5-ab7ad5e77c35+7:39568:x1859317560962240:12345-18274@kfi7:400:default-tuolumne1628-0
00000100:00000200:23.0:1773851857.166952:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317560962240
00000020:00000001:23.0:1773851857.166953:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851857.166954:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851857.166954:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851857.166955:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851857.166956:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851857.166956:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851857.166957:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317560962240, found 0 last_xid 1859317560962239
00000020:00000001:23.0:1773851857.166959:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851857.166959:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851857.166960:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851857.166960:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851857.166961:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851857.166962:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851857.166962:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851857.166963:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab1b10d5.
02000000:00000001:23.0:1773851857.166964:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851857.166964:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851857.166965:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851857.166966:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183208599059, transno 0, xid 1859317560962240
00010000:00000001:23.0:1773851857.166966:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851857.166967:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b65a11af x1859317560962240/t0(0) o400->d17434e9-3dd4-4d96-99e5-ab7ad5e77c35@18274@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1628-0'
00010000:00000001:23.0:1773851857.166969:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851857.166970:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851857.166971:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=90 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851857.166972:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851857.166972:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000279e89fb refcount 3 to 18274@kfi7
00000100:00000001:23.0:1773851857.166973:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739872 : -107139395811744 : ffff9e8eaa5f0660)
02000000:00000001:23.0:1773851857.166974:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851857.166974:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851857.166975:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851857.166976:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18339@kfi7
00000400:00000010:23.0:1773851857.166977:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000403003e5.
00000100:00000200:23.0:1773851857.166978:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317560962240, offset 224
00000400:00000200:23.0:1773851857.166979:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18339@kfi7
00000400:00000200:23.0:1773851857.166980:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18339@kfi7 to cpt 5
00000400:00000200:23.0:1773851857.166981:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001011d75 nid 18339@kfi7 refs 1
00000400:00000200:23.0:1773851857.166982:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000001011d75 nid 18339@kfi7 refs 2
00000400:00000200:23.0:1773851857.166983:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000001011d75 nid 18339@kfi7 refs 3
00000400:00000200:23.0:1773851857.166984:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18339@kfi7 local destination
00000400:00000200:23.0:1773851857.166985:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768722:8768722:1024:4294967295] 18339@kfi7 LPNI seq info [1126179:1126179:16:4294967295]
00000400:00000200:23.0:1773851857.166988:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000001011d75 nid 18339@kfi7 refs 2
00000400:00000200:23.0:1773851857.166988:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18339@kfi7 to cpt 5
00000400:00000200:23.0:1773851857.166990:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18339@kfi7(18339@kfi7:18339@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851857.166992:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000001011d75 nid 18339@kfi7 refs 3
00000800:00000200:23.0:1773851857.166993:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851857.166994:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851857.166996:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851857.166998:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000de8 Using peer 18339@kfi7(0x100000000000de8)
00000800:00000200:23.0:1773851857.167001:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x100000000000de8: rc=0
00000800:00000200:23.0:1773851857.167003:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000de8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851857.167005:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851857.167005:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000279e89fb refcount 2 to 18274@kfi7
00010000:00000001:23.0:1773851857.167006:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851857.167007:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851857.167007:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851857.167008:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b65a11af x1859317560962240/t0(0) o400->d17434e9-3dd4-4d96-99e5-ab7ad5e77c35@18274@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1628-0'
00000100:00100000:23.0:1773851857.167011:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b65a11af pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d17434e9-3dd4-4d96-99e5-ab7ad5e77c35+7:39568:x1859317560962240:12345-18274@kfi7:400:default-tuolumne1628-0 Request processed in 61us (107us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851857.167013:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18274@kfi7, seq: 1997934
00000800:00000200:21.0:1773851857.167013:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000de8 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851857.167014:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e3cdad81 : new rpc_count 0
00000100:00000001:23.0:1773851857.167014:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851857.167015:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851857.167015:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851857.167016:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:23.0:1773851857.167016:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008536c377.
00000400:00000200:21.0:1773851857.167016:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18339@kfi7: PUT: OK
00000020:00000010:23.0:1773851857.167017:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c205ab6a.
00000400:00000200:21.0:1773851857.167017:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000403003e5
00000400:00000010:21.0:1773851857.167018:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000403003e5.
00000100:00000001:21.0:1773851857.167018:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:23.0:1773851857.167019:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000e3cdad81 : new refcount 6
00000100:00000001:21.0:1773851857.167019:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851857.167020:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851857.167020:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000001011d75 nid 18339@kfi7 refs 2
00000800:00000200:21.0:1773851857.167021:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 18339@kfi7(00000000480385fa):0x0 lsk 3561 rsk 56 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000de8 Transaction freed
00000800:00000200:25.0:1773851857.174227:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851857.174227:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851857.174228:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851857.174230:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851857.174232:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11776@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.174233:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11776@kfi7 : PUT - for me
00000400:00000200:25.0:1773851857.174233:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11776@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.174234:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 1
00000400:00000200:25.0:1773851857.174235:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11776@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.174235:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 2
00000400:00000200:25.0:1773851857.174236:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 3
00000400:00000200:25.0:1773851857.174237:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11969@kfi7 to cpt 4
00000400:00000200:25.0:1773851857.174238:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11969@kfi7 of length 224 into portal 12 MB=0x69b4b57694100
00000400:00000200:25.0:1773851857.174239:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11969@kfi7 of length 224/224 into md 0x16159c6179 [64] + 183536
00000800:00000200:25.0:1773851857.174240:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851857.174242:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851857.174243:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11776@kfi7: PUT: OK
00000100:00000001:25.0:1773851857.174243:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851857.174244:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851857.174245:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009ab9ccb.
00000100:00000040:25.0:1773851857.174245:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000009ab9ccb x1859597751632128 msgsize 224
00000100:00100000:25.0:1773851857.174247:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-11969@kfi7 (source: 12345-11776@kfi7)
00000100:00000001:25.0:1773851857.174247:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851857.174248:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 2
00000800:00000200:25.0:1773851857.174249:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851857.174249:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851857.174250:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851857.174250:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851857.174250:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851857.174251:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851857.174252:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597751632128
00000020:00000001:24.0:1773851857.174253:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851857.174253:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7bb36
00000020:00000001:24.0:1773851857.174254:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851857.174255:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000078ec4fdb refcount=5
00000020:00000001:24.0:1773851857.174256:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112057498624 : -106961652052992 : ffff9eb80cb98c00)
00000020:00000001:24.0:1773851857.174257:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637112057498624 : -106961652052992 : ffff9eb80cb98c00)
00000100:00000001:24.0:1773851857.174258:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851857.174259:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851857.174260:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000705a3f71.
00000020:00000010:24.0:1773851857.174261:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851857.174262:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002065a558.
00000100:00000001:24.0:1773851857.174263:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851857.174263:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851857.174263:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851857.174264:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851857.174265:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851857.174265:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851857.174266:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851857.174267:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851857.174268:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851857.174268:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851857.174268:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851857.174269:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11969@kfi7, seq: 2025055
00000100:00000001:26.0:1773851857.174270:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851857.174270:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000078ec4fdb : new rpc_count 1
00000100:00000001:24.0:1773851857.174270:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636968615740544 : -107105093811072 : ffff9e96a6ee0480)
00000100:00000001:26.0:1773851857.174271:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851857.174272:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009ab9ccb x1859597751632128/t0(0) o400->40b869bf-a6bd-4118-96b9-2fce97581e2c@11969@kfi7:74/0 lens 224/0 e 0 to 0 dl 1773852189 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1235-0'
00000100:00000001:24.0:1773851857.174274:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851857.174275:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851857.174276:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009ab9ccb pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:40b869bf-a6bd-4118-96b9-2fce97581e2c+5:39731:x1859597751632128:12345-11969@kfi7:400:default-tuolumne1235-0
00000100:00000200:24.0:1773851857.174277:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597751632128
00000020:00000001:24.0:1773851857.174278:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851857.174279:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851857.174279:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851857.174280:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851857.174280:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851857.174281:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851857.174282:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597751632128, found 0 last_xid 1859597751632127
00000020:00000001:24.0:1773851857.174283:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851857.174283:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851857.174284:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851857.174284:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851857.174285:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851857.174285:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851857.174286:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851857.174288:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000046c5624b.
02000000:00000001:24.0:1773851857.174289:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851857.174289:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851857.174290:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851857.174291:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690943516, transno 0, xid 1859597751632128
00010000:00000001:24.0:1773851857.174291:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851857.174292:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009ab9ccb x1859597751632128/t0(0) o400->40b869bf-a6bd-4118-96b9-2fce97581e2c@11969@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1235-0'
00010000:00000001:24.0:1773851857.174294:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851857.174295:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851857.174296:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=90 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851857.174297:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851857.174297:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a9865e09 refcount 3 to 11969@kfi7
00000100:00000001:24.0:1773851857.174298:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959648 : -107156125591968 : ffff9e8ac532d660)
02000000:00000001:24.0:1773851857.174299:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851857.174300:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851857.174300:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851857.174301:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11776@kfi7
00000400:00000010:24.0:1773851857.174302:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098854375.
00000100:00000200:24.0:1773851857.174302:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597751632128, offset 224
00000400:00000200:24.0:1773851857.174304:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11776@kfi7
00000400:00000200:24.0:1773851857.174304:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11776@kfi7 to cpt 6
00000400:00000200:24.0:1773851857.174305:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 1
00000400:00000200:24.0:1773851857.174306:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 2
00000400:00000200:24.0:1773851857.174307:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 3
00000400:00000200:24.0:1773851857.174308:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11776@kfi7 local destination
00000400:00000200:24.0:1773851857.174310:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768723:8768723:1024:4294967295] 11776@kfi7 LPNI seq info [398926:398926:16:4294967295]
00000400:00000200:24.0:1773851857.174311:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 2
00000400:00000200:24.0:1773851857.174312:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11776@kfi7 to cpt 6
00000400:00000200:24.0:1773851857.174314:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11776@kfi7(11776@kfi7:11776@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851857.174315:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 3
00000800:00000200:24.0:1773851857.174316:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851857.174320:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851857.174322:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851857.174324:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b98 Using peer 11776@kfi7(0x100000000000b98)
00000800:00000200:24.0:1773851857.174327:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x100000000000b98: rc=0
00000800:00000200:24.0:1773851857.174329:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b98 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851857.174331:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851857.174332:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a9865e09 refcount 2 to 11969@kfi7
00010000:00000001:24.0:1773851857.174332:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851857.174333:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851857.174334:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851857.174334:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009ab9ccb x1859597751632128/t0(0) o400->40b869bf-a6bd-4118-96b9-2fce97581e2c@11969@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1235-0'
00000100:00100000:24.0:1773851857.174339:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009ab9ccb pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:40b869bf-a6bd-4118-96b9-2fce97581e2c+5:39731:x1859597751632128:12345-11969@kfi7:400:default-tuolumne1235-0 Request processed in 63us (93us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851857.174341:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11969@kfi7, seq: 2025055
00000100:00000040:24.0:1773851857.174342:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000078ec4fdb : new rpc_count 0
00000100:00000001:24.0:1773851857.174343:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851857.174343:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851857.174344:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851857.174344:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002065a558.
00000020:00000010:24.0:1773851857.174345:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000705a3f71.
00000020:00000040:24.0:1773851857.174346:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000078ec4fdb : new refcount 4
00000100:00000001:24.0:1773851857.174347:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851857.174351:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b98 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851857.174353:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851857.174354:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11776@kfi7: PUT: OK
00000400:00000200:25.0:1773851857.174355:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098854375
00000400:00000010:25.0:1773851857.174355:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098854375.
00000100:00000001:25.0:1773851857.174356:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851857.174356:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851857.174357:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000028fb8cc3 nid 11776@kfi7 refs 2
00000800:00000200:25.0:1773851857.174358:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 11776@kfi7(000000001e6a98b5):0x0 lsk 2969 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b98 Transaction freed
00000800:00000200:5.0:1773851857.178570:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.178571:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851857.178573:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851857.178578:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851857.178581:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.178584:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10227@kfi7 : PUT - for me
00000400:00000200:5.0:1773851857.178585:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.178587:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 1
00000400:00000200:5.0:1773851857.178588:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.178589:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000400:00000200:5.0:1773851857.178591:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 3
00000400:00000200:5.0:1773851857.178593:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10035@kfi7 to cpt 6
00000400:00000200:5.0:1773851857.178594:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10035@kfi7 of length 224 into portal 12 MB=0x699e12da78e80
00000400:00000200:5.0:1773851857.178597:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10035@kfi7 of length 224/224 into md 0x793926dc5 [64] + 120264
00000800:00000200:5.0:1773851857.178600:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851857.178603:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851857.178604:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10227@kfi7: PUT: OK
00000100:00000001:5.0:1773851857.178606:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851857.178607:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851857.178608:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000001d89969.
00000100:00000040:5.0:1773851857.178610:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000001d89969 x1858042272910976 msgsize 224
00000100:00100000:5.0:1773851857.178612:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10035@kfi7 (source: 12345-10227@kfi7)
00000100:00000001:5.0:1773851857.178614:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851857.178615:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000100:00000001:7.0:1773851857.178617:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851857.178618:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851857.178618:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851857.178619:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851857.178620:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.178622:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851857.178623:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042272910976
00000020:00000001:7.0:1773851857.178624:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851857.178625:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac927fb
00000020:00000001:7.0:1773851857.178626:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851857.178629:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000759bc648 refcount=6
00000020:00000001:7.0:1773851857.178630:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631495680 : -107123078055936 : ffff9e9276fc3800)
00000020:00000001:7.0:1773851857.178631:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631495680 : -107123078055936 : ffff9e9276fc3800)
00000100:00000001:7.0:1773851857.178633:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.178634:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851857.178635:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007fa448d1.
00000020:00000010:7.0:1773851857.178637:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851857.178639:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851857.178640:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851857.178641:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851857.178642:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.178644:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851857.178644:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851857.178645:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.178647:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.178649:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851857.178650:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851857.178650:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851857.178650:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851857.178652:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10035@kfi7, seq: 2001860
00000100:00000040:7.0:1773851857.178653:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000759bc648 : new rpc_count 1
00000100:00000001:5.0:1773851857.178653:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.178654:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117668555136 : -106956040996480 : ffff9eb95b2b7980)
00000100:00000001:5.0:1773851857.178654:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.178656:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000001d89969 x1858042272910976/t0(0) o400->c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5@10035@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1113-0'
00000100:00000001:7.0:1773851857.178662:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.178662:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851857.178664:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001d89969 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5+6:39725:x1858042272910976:12345-10035@kfi7:400:default-tuolumne1113-0
00000100:00000200:7.0:1773851857.178666:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042272910976
00000020:00000001:7.0:1773851857.178667:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851857.178669:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851857.178670:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.178671:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851857.178672:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851857.178674:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851857.178675:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042272910976, found 0 last_xid 1858042272910975
00000020:00000001:7.0:1773851857.178676:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851857.178678:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851857.178678:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851857.178679:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.178681:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851857.178681:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851857.178682:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851857.178685:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cc0a937a.
02000000:00000001:7.0:1773851857.178686:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.178687:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.178689:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851857.178690:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183097238425, transno 0, xid 1858042272910976
00010000:00000001:7.0:1773851857.178691:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851857.178693:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000001d89969 x1858042272910976/t0(0) o400->c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5@10035@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1113-0'
00010000:00000001:7.0:1773851857.178698:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851857.178699:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851857.178700:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=89 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851857.178702:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851857.178703:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d65da430 refcount 3 to 10035@kfi7
00000100:00000001:7.0:1773851857.178704:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299328704 : -107155410222912 : ffff9e8aefd680c0)
02000000:00000001:7.0:1773851857.178706:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851857.178706:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.178707:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851857.178709:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10227@kfi7
00000400:00000010:7.0:1773851857.178710:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc26fd9e.
00000100:00000200:7.0:1773851857.178711:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042272910976, offset 224
00000400:00000200:7.0:1773851857.178713:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10227@kfi7
00000400:00000200:7.0:1773851857.178714:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.178715:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 1
00000400:00000200:7.0:1773851857.178716:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000400:00000200:7.0:1773851857.178717:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 3
00000400:00000200:7.0:1773851857.178718:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10227@kfi7 local destination
00000400:00000200:7.0:1773851857.178720:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768724:8768724:1024:4294967295] 10227@kfi7 LPNI seq info [79184:79184:16:4294967295]
00000400:00000200:7.0:1773851857.178721:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000400:00000200:7.0:1773851857.178722:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.178728:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10227@kfi7(10227@kfi7:10227@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851857.178729:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 3
00000800:00000200:7.0:1773851857.178731:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851857.178732:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851857.178734:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851857.178737:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bb1 Using peer 10227@kfi7(0x100000000000bb1)
00000800:00000200:7.0:1773851857.178740:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x100000000000bb1: rc=0
00000800:00000200:7.0:1773851857.178742:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bb1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851857.178744:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.178745:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d65da430 refcount 2 to 10035@kfi7
00010000:00000001:7.0:1773851857.178746:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851857.178747:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.178748:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851857.178748:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000001d89969 x1858042272910976/t0(0) o400->c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5@10035@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1113-0'
00000100:00100000:7.0:1773851857.178752:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001d89969 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5+6:39725:x1858042272910976:12345-10035@kfi7:400:default-tuolumne1113-0 Request processed in 89us (141us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851857.178754:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10035@kfi7, seq: 2001860
00000800:00000200:5.0:1773851857.178755:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bb1 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851857.178756:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000759bc648 : new rpc_count 0
00000100:00000001:7.0:1773851857.178757:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851857.178757:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851857.178758:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851857.178758:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851857.178759:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000400:00000200:5.0:1773851857.178759:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10227@kfi7: PUT: OK
00000400:00000200:5.0:1773851857.178759:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc26fd9e
00000020:00000010:7.0:1773851857.178760:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007fa448d1.
00000020:00000040:7.0:1773851857.178760:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000759bc648 : new refcount 5
00000400:00000010:5.0:1773851857.178760:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc26fd9e.
00000100:00000001:5.0:1773851857.178761:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851857.178761:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851857.178762:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851857.178762:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000800:00000200:5.0:1773851857.178763:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10227@kfi7(00000000111533d5):0x0 lsk 2994 rsk 55 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000bb1 Transaction freed
00000800:00000200:1.0:1773851857.203964:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851857.203965:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851857.203966:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851857.203968:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851857.203970:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25537@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.203971:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25537@kfi7 : PUT - for me
00000400:00000200:1.0:1773851857.203972:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25537@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.203973:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fa5fa54 nid 25537@kfi7 refs 1
00000400:00000200:1.0:1773851857.203974:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25537@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.203974:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fa5fa54 nid 25537@kfi7 refs 2
00000400:00000200:1.0:1773851857.203975:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009fa5fa54 nid 25537@kfi7 refs 3
00000400:00000200:1.0:1773851857.203976:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25344@kfi7 to cpt 2
00000400:00000200:1.0:1773851857.203977:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25344@kfi7 of length 224 into portal 12 MB=0x699e08a130780
00000400:00000200:1.0:1773851857.203978:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25344@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 15584
00000800:00000200:1.0:1773851857.203979:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851857.203981:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.203982:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25537@kfi7: PUT: OK
00000100:00000001:1.0:1773851857.203983:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851857.203983:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851857.203984:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000019b77835.
00000100:00000040:1.0:1773851857.203985:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000019b77835 x1858039528490880 msgsize 224
00000100:00100000:1.0:1773851857.203987:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25344@kfi7 (source: 12345-25537@kfi7)
00000100:00000001:1.0:1773851857.203988:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851857.203988:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009fa5fa54 nid 25537@kfi7 refs 2
00000100:00000001:0.0:1773851857.203989:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851857.203990:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851857.203990:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851857.203990:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851857.203991:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851857.203991:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.203992:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039528490880
00000020:00000001:0.0:1773851857.203992:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851857.203993:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92802
00000020:00000001:0.0:1773851857.203993:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851857.203995:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f7158a33 refcount=10
00000020:00000001:0.0:1773851857.203996:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631496704 : -107123078054912 : ffff9e9276fc3c00)
00000020:00000001:0.0:1773851857.203997:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631496704 : -107123078054912 : ffff9e9276fc3c00)
00000100:00000001:0.0:1773851857.203998:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.203998:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851857.203999:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851857.204000:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.204001:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851857.204001:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851857.204002:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851857.204002:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.204003:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851857.204003:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851857.204004:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.204005:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851857.204006:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.204006:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851857.204006:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851857.204006:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851857.204007:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25344@kfi7, seq: 1997502
00000100:00000040:0.0:1773851857.204007:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f7158a33 : new rpc_count 1
00000100:00000001:1.0:1773851857.204008:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851857.204008:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.204008:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605647744 : -106923103903872 : ffff9ec1065f9f80)
00000100:00000040:0.0:1773851857.204009:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000019b77835 x1858039528490880/t0(0) o400->de4ac3d2-cfd1-4bf9-9c70-c791dc95eeec@25344@kfi7:497/0 lens 224/0 e 0 to 0 dl 1773852612 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2083-0'
00000100:00000001:0.0:1773851857.204011:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.204012:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851857.204013:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019b77835 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:de4ac3d2-cfd1-4bf9-9c70-c791dc95eeec+10:39629:x1858039528490880:12345-25344@kfi7:400:default-tuolumne2083-0
00000100:00000200:0.0:1773851857.204014:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039528490880
00000020:00000001:0.0:1773851857.204014:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851857.204015:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851857.204015:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.204016:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851857.204016:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851857.204017:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851857.204017:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039528490880, found 0 last_xid 1858039528490879
00000020:00000001:0.0:1773851857.204018:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851857.204019:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851857.204019:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851857.204019:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.204020:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851857.204020:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851857.204021:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851857.204021:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009af6d68f.
02000000:00000001:0.0:1773851857.204022:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.204022:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.204023:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851857.204024:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182749002415, transno 0, xid 1858039528490880
00010000:00000001:0.0:1773851857.204024:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851857.204025:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000019b77835 x1858039528490880/t0(0) o400->de4ac3d2-cfd1-4bf9-9c70-c791dc95eeec@25344@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2083-0'
00010000:00000001:0.0:1773851857.204027:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851857.204027:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851857.204028:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=90 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851857.204029:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851857.204029:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cdda38b0 refcount 3 to 25344@kfi7
00000100:00000001:0.0:1773851857.204030:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580448 : -107154806971168 : ffff9e8b13cb64e0)
02000000:00000001:0.0:1773851857.204031:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851857.204031:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.204032:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851857.204033:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25537@kfi7
00000400:00000010:0.0:1773851857.204033:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000487f5112.
00000100:00000200:0.0:1773851857.204034:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039528490880, offset 224
00000400:00000200:0.0:1773851857.204035:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25537@kfi7
00000400:00000200:0.0:1773851857.204035:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25537@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.204036:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fa5fa54 nid 25537@kfi7 refs 1
00000400:00000200:0.0:1773851857.204037:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009fa5fa54 nid 25537@kfi7 refs 2
00000400:00000200:0.0:1773851857.204038:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009fa5fa54 nid 25537@kfi7 refs 3
00000400:00000200:0.0:1773851857.204039:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25537@kfi7 local destination
00000400:00000200:0.0:1773851857.204040:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768725:8768725:1024:4294967295] 25537@kfi7 LPNI seq info [47704:47704:16:4294967295]
00000400:00000200:0.0:1773851857.204041:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009fa5fa54 nid 25537@kfi7 refs 2
00000400:00000200:0.0:1773851857.204042:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25537@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.204044:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25537@kfi7(25537@kfi7:25537@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851857.204045:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009fa5fa54 nid 25537@kfi7 refs 3
00000800:00000200:0.0:1773851857.204046:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851857.204047:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851857.204049:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851857.204051:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102d Using peer 25537@kfi7(0x102d)
00000800:00000200:0.0:1773851857.204053:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x102d: rc=0
00000800:00000200:0.0:1773851857.204054:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851857.204056:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.204057:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cdda38b0 refcount 2 to 25344@kfi7
00010000:00000001:0.0:1773851857.204057:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851857.204058:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.204058:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851857.204059:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000019b77835 x1858039528490880/t0(0) o400->de4ac3d2-cfd1-4bf9-9c70-c791dc95eeec@25344@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2083-0'
00000100:00100000:0.0:1773851857.204064:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019b77835 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:de4ac3d2-cfd1-4bf9-9c70-c791dc95eeec+10:39629:x1858039528490880:12345-25344@kfi7:400:default-tuolumne2083-0 Request processed in 50us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851857.204066:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25344@kfi7, seq: 1997502
00000100:00000040:0.0:1773851857.204067:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f7158a33 : new rpc_count 0
00000100:00000001:0.0:1773851857.204067:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851857.204068:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851857.204069:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.204069:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851857.204070:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851857.204071:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000f7158a33 : new refcount 9
00000100:00000001:0.0:1773851857.204072:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851857.204076:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851857.204078:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.204079:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25537@kfi7: PUT: OK
00000400:00000200:1.0:1773851857.204080:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000487f5112
00000400:00000010:1.0:1773851857.204080:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000487f5112.
00000100:00000001:1.0:1773851857.204081:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851857.204082:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851857.204082:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009fa5fa54 nid 25537@kfi7 refs 2
00000800:00000200:1.0:1773851857.204084:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25537@kfi7(000000000c330ca6):0x0 lsk 4142 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102d Transaction freed
00000800:00000200:17.0:1773851857.209788:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851857.209789:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851857.209790:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851857.209792:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851857.209794:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26337@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.209795:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26337@kfi7 : PUT - for me
00000400:00000200:17.0:1773851857.209796:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26337@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.209797:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d5690b33 nid 26337@kfi7 refs 1
00000400:00000200:17.0:1773851857.209797:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26337@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.209798:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d5690b33 nid 26337@kfi7 refs 2
00000400:00000200:17.0:1773851857.209799:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d5690b33 nid 26337@kfi7 refs 3
00000400:00000200:17.0:1773851857.209799:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26337@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.209800:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26337@kfi7 of length 224 into portal 12 MB=0x69b4775236800
00000400:00000200:17.0:1773851857.209801:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26337@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 191424
00000800:00000200:17.0:1773851857.209803:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851857.209804:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851857.209805:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26337@kfi7: PUT: OK
00000100:00000001:17.0:1773851857.209806:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851857.209806:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851857.209807:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000099ad4b79.
00000100:00000040:17.0:1773851857.209808:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000099ad4b79 x1859581070501888 msgsize 224
00000100:00100000:17.0:1773851857.209809:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26337@kfi7 (source: 12345-26337@kfi7)
00000100:00000001:17.0:1773851857.209810:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851857.209810:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d5690b33 nid 26337@kfi7 refs 2
00000100:00000001:19.0:1773851857.209811:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851857.209812:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851857.209812:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851857.209812:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851857.209813:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851857.209813:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851857.209814:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859581070501888
00000020:00000001:19.0:1773851857.209815:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851857.209815:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddd04967f
00000020:00000001:19.0:1773851857.209816:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851857.209817:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000050e8e160 refcount=7
00000020:00000001:19.0:1773851857.209818:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636980288858112 : -107093420693504 : ffff9e995eb3a800)
00000020:00000001:19.0:1773851857.209819:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636980288858112 : -107093420693504 : ffff9e995eb3a800)
00000100:00000001:19.0:1773851857.209819:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851857.209820:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851857.209822:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000099e6b427.
00000020:00000010:19.0:1773851857.209823:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851857.209823:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002737e6db.
00000100:00000001:19.0:1773851857.209824:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851857.209825:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851857.209825:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851857.209826:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851857.209826:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851857.209827:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851857.209828:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851857.209829:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851857.209829:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851857.209829:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851857.209829:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851857.209830:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26337@kfi7, seq: 2156267
00000100:00000001:19.0:1773851857.209831:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851857.209831:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000050e8e160 : new rpc_count 2
00000100:00000001:19.0:1773851857.209832:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.209832:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764335616 : -107095945216000 : ffff9e98c83a8000)
00000100:00000040:18.0:1773851857.209833:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000099ad4b79 x1859581070501888/t0(0) o400->66457748-d5c4-4587-842a-b9f28f8c396e@26337@kfi7:47/0 lens 224/0 e 0 to 0 dl 1773852162 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2127-0'
00000100:00000001:18.0:1773851857.209835:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.209836:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851857.209836:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099ad4b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:66457748-d5c4-4587-842a-b9f28f8c396e+7:39859:x1859581070501888:12345-26337@kfi7:400:default-tuolumne2127-0
00000100:00000200:18.0:1773851857.209838:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859581070501888
00000020:00000001:18.0:1773851857.209838:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851857.209839:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851857.209839:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.209840:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851857.209841:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851857.209842:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851857.209842:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859581070501888, found 0 last_xid 1859581069539071
00000020:00000001:18.0:1773851857.209843:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851857.209844:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851857.209844:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851857.209844:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.209845:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851857.209846:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851857.209846:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851857.209847:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000009c31097.
02000000:00000001:18.0:1773851857.209847:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.209848:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.209849:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851857.209849:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581532, transno 0, xid 1859581070501888
00010000:00000001:18.0:1773851857.209850:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851857.209851:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000099ad4b79 x1859581070501888/t0(0) o400->66457748-d5c4-4587-842a-b9f28f8c396e@26337@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2127-0'
00010000:00000001:18.0:1773851857.209854:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851857.209854:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851857.209855:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=90 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851857.209856:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851857.209857:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000132b3855 refcount 3 to 26337@kfi7
00000100:00000001:18.0:1773851857.209858:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516800 : -107156126034816 : ffff9e8ac52c1480)
02000000:00000001:18.0:1773851857.209858:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851857.209859:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.209860:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851857.209861:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26337@kfi7
00000400:00000010:18.0:1773851857.209861:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b6533870.
00000100:00000200:18.0:1773851857.209862:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859581070501888, offset 224
00000400:00000200:18.0:1773851857.209863:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26337@kfi7
00000400:00000200:18.0:1773851857.209864:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26337@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.209865:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d5690b33 nid 26337@kfi7 refs 1
00000400:00000200:18.0:1773851857.209866:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d5690b33 nid 26337@kfi7 refs 2
00000400:00000200:18.0:1773851857.209868:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d5690b33 nid 26337@kfi7 refs 3
00000400:00000200:18.0:1773851857.209869:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26337@kfi7 local destination
00000400:00000200:18.0:1773851857.209870:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768726:8768726:1024:4294967295] 26337@kfi7 LPNI seq info [1179947:1179947:16:4294967295]
00000400:00000200:18.0:1773851857.209871:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d5690b33 nid 26337@kfi7 refs 2
00000400:00000200:18.0:1773851857.209872:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26337@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.209874:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26337@kfi7(26337@kfi7:26337@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851857.209875:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d5690b33 nid 26337@kfi7 refs 3
00000800:00000200:18.0:1773851857.209876:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851857.209877:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851857.209880:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851857.209882:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x985 Using peer 26337@kfi7(0x985)
00000800:00000200:18.0:1773851857.209885:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000022b02854: Posted send of 324 bytes to peer 0x985: rc=0
00000800:00000200:18.0:1773851857.209886:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x985 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851857.209888:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851857.209889:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000132b3855 refcount 2 to 26337@kfi7
00010000:00000001:18.0:1773851857.209890:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851857.209890:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.209891:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851857.209892:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000099ad4b79 x1859581070501888/t0(0) o400->66457748-d5c4-4587-842a-b9f28f8c396e@26337@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2127-0'
00000100:00100000:18.0:1773851857.209895:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099ad4b79 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:66457748-d5c4-4587-842a-b9f28f8c396e+7:39859:x1859581070501888:12345-26337@kfi7:400:default-tuolumne2127-0 Request processed in 59us (86us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851857.209897:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26337@kfi7, seq: 2156267
00000100:00000040:18.0:1773851857.209898:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000050e8e160 : new rpc_count 1
00000100:00000001:18.0:1773851857.209899:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851857.209899:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x985 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851857.209900:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851857.209900:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851857.209900:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851857.209901:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002737e6db.
00000400:00000200:17.0:1773851857.209901:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26337@kfi7: PUT: OK
00000020:00000010:18.0:1773851857.209902:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000099e6b427.
00000400:00000200:17.0:1773851857.209902:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b6533870
00000400:00000010:17.0:1773851857.209902:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b6533870.
00000020:00000040:18.0:1773851857.209903:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000050e8e160 : new refcount 6
00000100:00000001:17.0:1773851857.209903:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851857.209903:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:18.0:1773851857.209904:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851857.209904:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d5690b33 nid 26337@kfi7 refs 2
00000800:00000200:17.0:1773851857.209905:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2069@kfi7:4 -> 26337@kfi7(00000000ab8b317a):0x0 lsk 2438 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x985 Transaction freed
00000004:00000001:11.0:1773851857.225731:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851857.225732:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:10.0:1773851857.225732:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851857.225732:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851857.225733:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000158ac04d.
00000100:00000010:10.0:1773851857.225733:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009d0add5.
00000020:00000040:11.0:1773851857.225734:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000020:00000040:10.0:1773851857.225734:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000001:11.0:1773851857.225735:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851857.225735:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851857.225735:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851857.225735:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851857.225736:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851857.225736:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851857.225737:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004dd7265c.
02000000:00000010:11.0:1773851857.225738:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d420c2f5.
00000100:00000001:11.0:1773851857.225738:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851857.225738:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.225739:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851857.225739:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851857.225740:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851857.225740:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.225742:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000158ac04d] to pc [ptlrpcd_02_03+3]  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851857.225742:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000009d0add5] to pc [ptlrpcd_02_02+2]  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:11.0:1773851857.225746:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851857.225746:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.225747:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851857.225748:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851857.225748:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851857.225748:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851857.225748:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851857.225748:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:8.0:1773851857.225749:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851857.225750:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851857.225752:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851857.225752:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851857.225753:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.225753:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.225753:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851857.225754:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851857.225754:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.225754:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851857.225755:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051924096:42@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851857.225755:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051924032:12@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851857.225756:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851857.225756:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851857.225757:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851857.225757:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851857.225758:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851857.225758:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851857.225758:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.225758:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851857.225759:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e50c3955.
02000000:00000010:8.0:1773851857.225759:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000001f164fb.
02000000:00000001:9.0:1773851857.225760:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.225760:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851857.225761:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:9.0:1773851857.225761:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000200:8.0:1773851857.225762:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:8.0:1773851857.225762:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000400:00000010:9.0:1773851857.225763:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000400:00000010:8.0:1773851857.225763:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000100:00000200:9.0:1773851857.225764:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924096, portal 4
00000100:00000200:8.0:1773851857.225764:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924032, portal 4
00000100:00000001:9.0:1773851857.225765:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851857.225765:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851857.225765:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077439616 : -106968632112000 : ffff9eb66cae4c80)
00000100:00000001:9.0:1773851857.225766:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889197696 : -106993820353920 : ffff9eb08f583a80)
00000100:00000040:8.0:1773851857.225766:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851857.225767:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851857.225769:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851857.225769:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851857.225769:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000100:00000040:9.0:1773851857.225770:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:8.0:1773851857.225770:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bae78c35.
00000400:00000010:9.0:1773851857.225771:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003dd826d2.
00000100:00000200:9.0:1773851857.225771:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924096, offset 0
00000100:00000200:8.0:1773851857.225771:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924032, offset 0
00000400:00000200:8.0:1773851857.225772:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:9.0:1773851857.225773:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:8.0:1773851857.225773:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851857.225774:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:8.0:1773851857.225775:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851857.225776:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:8.0:1773851857.225777:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000400:00000200:8.0:1773851857.225779:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768726, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768724, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851857.225781:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851857.225782:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851857.225782:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000400:00000200:8.0:1773851857.225783:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768727:8768727:1024:4294967295] 12@kfi7 LPNI seq info [5403454:5403454:16:4294967295]
00000400:00000200:8.0:1773851857.225785:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851857.225785:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851857.225787:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851857.225788:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851857.225789:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851857.225790:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000800:00000200:8.0:1773851857.225790:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851857.225791:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:8.0:1773851857.225791:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851857.225792:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:9.0:1773851857.225793:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000800:00000200:8.0:1773851857.225793:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851857.225794:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768726, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768727, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851857.225795:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Using peer 12@kfi7(0x200000000000473)
00000400:00000200:9.0:1773851857.225796:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851857.225797:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851857.225797:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:9.0:1773851857.225798:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768728:8768728:1024:4294967295] 42@kfi7 LPNI seq info [5404895:5404895:16:4294967295]
00000800:00000200:8.0:1773851857.225799:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x200000000000473: rc=0
00000400:00000200:9.0:1773851857.225800:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851857.225800:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000800:00000200:8.0:1773851857.225800:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851857.225802:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851857.225803:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851857.225803:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851857.225804:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000100:00000001:8.0:1773851857.225804:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851857.225805:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851857.225805:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851857.225806:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851857.225806:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851857.225807:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851857.225807:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:9.0:1773851857.225808:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851857.225810:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000100:00000001:8.0:1773851857.225810:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851857.225810:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851857.225813:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x17b: rc=0
00000800:00000200:9.0:1773851857.225814:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851857.225814:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.225814:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851857.225815:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851857.225817:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851857.225817:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851857.225817:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:10.0:1773851857.225818:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851857.225818:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851857.225819:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bae78c35
00000400:00000010:10.0:1773851857.225819:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bae78c35.
00000100:00000001:9.0:1773851857.225819:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851857.225819:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851857.225820:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851857.225820:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000200:10.0:1773851857.225821:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851857.225821:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851857.225821:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851857.225822:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851857.225822:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851857.225823:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851857.225823:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851857.225824:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851857.225825:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851857.225826:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851857.225827:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851857.225827:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851857.225828:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:10.0:1773851857.225828:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:11.0:1773851857.225829:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003dd826d2
00000400:00000010:11.0:1773851857.225830:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003dd826d2.
00000100:00000001:11.0:1773851857.225830:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:10.0:1773851857.225830:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Transaction freed
00000100:00000200:11.0:1773851857.225831:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851857.225834:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851857.225834:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851857.225837:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.225837:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851857.225838:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:11.0:1773851857.225840:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000800:00000200:9.0:1773851857.225848:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851857.225849:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851857.225850:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851857.225852:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851857.225854:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.225855:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:9.0:1773851857.225856:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.225856:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851857.225857:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.225858:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851857.225859:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851857.225859:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.225860:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2640
00000800:00000200:25.0:1773851857.225862:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851857.225862:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851857.225862:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.225863:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781696f09 [1] + 224
00000800:00000200:25.0:1773851857.225864:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851857.225864:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851857.225866:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851857.225866:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851857.225867:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851857.225867:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851857.225868:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851857.225869:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000100:00000200:9.0:1773851857.225869:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851857.225870:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.225871:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851857.225872:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.225872:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000040:9.0:1773851857.225872:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851857.225873:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851857.225874:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.225875:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2680
00000100:00000001:9.0:1773851857.225875:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:25.0:1773851857.225876:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851857.225876:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:8.0:1773851857.225876:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851857.225876:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:25.0:1773851857.225878:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b81bd9 [1] + 224
00000800:00000200:9.0:1773851857.225878:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:8.0:1773851857.225878:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851857.225878:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851857.225878:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000400:00000200:8.0:1773851857.225879:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000010:8.0:1773851857.225879:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000800:00000200:25.0:1773851857.225880:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851857.225880:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851857.225881:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:8.0:1773851857.225881:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851857.225882:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851857.225883:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851857.225884:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:25.0:1773851857.225885:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851857.225886:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851857.225886:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851857.225887:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851857.225887:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:25.0:1773851857.225888:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851857.225888:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851857.225889:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.225889:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851857.225890:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=90 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851857.225891:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=90 v=66 (1 1 1 1)
00000100:00000001:25.0:1773851857.225892:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851857.225892:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:25.0:1773851857.225893:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:8.0:1773851857.225893:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851857.225893:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000800:00000200:25.0:1773851857.225894:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851857.225894:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851857.225894:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00010000:00000001:8.0:1773851857.225894:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:9.0:1773851857.225895:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851857.225895:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851857.225895:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000010:9.0:1773851857.225896:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000100:00000040:8.0:1773851857.225896:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:8.0:1773851857.225896:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851857.225896:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851857.225897:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000400:00000010:9.0:1773851857.225897:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000100:00000040:8.0:1773851857.225897:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851857.225898:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851857.225899:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851857.225900:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:9.0:1773851857.225901:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851857.225901:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851857.225901:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851857.225902:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851857.225902:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851857.225903:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541614592 avail=351539581952 avail_mb=1373201492 hwm_mb=3131101 files=372136793 ffree=343302358 state=0: rc = 0
00000100:00000001:9.0:1773851857.225904:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851857.225904:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851857.225905:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851857.225905:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851857.225905:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851857.225906:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851857.225907:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851857.225907:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=90 v=66 (66 66 66 66)
00000004:00000020:8.0:1773851857.225907:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541614592 free, 351539581952 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136793 files, 343302358 free files
00000004:00000001:8.0:1773851857.225908:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851857.225909:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=90 v=66 (1 1 1 1)
00000100:00000040:8.0:1773851857.225909:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851857.225910:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851857.225910:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851857.225910:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851857.225911:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851857.225912:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851857.225912:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00100000:8.0:1773851857.225912:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051924032:12@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851857.225913:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851857.225913:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851857.225914:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851857.225914:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851857.225914:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851857.225914:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000009d0add5 x1859433051924032/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851857.225917:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851857.225917:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851857.225917:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851857.225917:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851857.225917:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000001f164fb.
00000100:00000001:9.0:1773851857.225918:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851857.225918:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:8.0:1773851857.225918:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000040:9.0:1773851857.225919:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000020:00000001:8.0:1773851857.225919:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851857.225919:0:41070:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000004:00000040:9.0:1773851857.225920:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351379065856 avail=351375919104 avail_mb=1372562184 hwm_mb=3131103 files=372019208 ffree=343143619 state=0: rc = 0
00000020:00000001:8.0:1773851857.225920:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851857.225920:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004dd7265c.
02000000:00000001:8.0:1773851857.225921:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000020:9.0:1773851857.225922:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351379065856 free, 351375919104 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019208 files, 343143619 free files
02000000:00000001:8.0:1773851857.225922:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851857.225922:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009d0add5.
00000004:00000001:9.0:1773851857.225923:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.225923:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851857.225923:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:9.0:1773851857.225924:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851857.225924:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851857.225924:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851857.225924:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.225925:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851857.225925:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851857.225926:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051924096:42@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851857.225927:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851857.225928:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851857.225929:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000158ac04d x1859433051924096/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851857.225931:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851857.225931:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851857.225932:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e50c3955.
02000000:00000001:9.0:1773851857.225933:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851857.225933:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851857.225934:0:41071:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:9.0:1773851857.225934:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851857.225935:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d420c2f5.
02000000:00000001:9.0:1773851857.225936:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851857.225936:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851857.225936:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000158ac04d.
00000100:00000001:9.0:1773851857.225938:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851857.225938:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851857.225939:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851857.225939:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851857.225940:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851857.225940:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851857.225940:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851857.248580:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851857.248581:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851857.248582:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851857.248583:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851857.248585:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16978@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.248586:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16978@kfi7 : PUT - for me
00000400:00000200:25.0:1773851857.248587:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16978@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.248587:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000935cef5c nid 16978@kfi7 refs 1
00000400:00000200:25.0:1773851857.248588:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16978@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.248588:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000935cef5c nid 16978@kfi7 refs 2
00000400:00000200:25.0:1773851857.248589:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000935cef5c nid 16978@kfi7 refs 3
00000400:00000200:25.0:1773851857.248590:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16978@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.248590:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16978@kfi7 of length 224 into portal 12 MB=0x699e1676bd780
00000400:00000200:25.0:1773851857.248591:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16978@kfi7 of length 224/224 into md 0x16159c6179 [64] + 183760
00000800:00000200:25.0:1773851857.248593:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851857.248594:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851857.248595:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16978@kfi7: PUT: OK
00000100:00000001:25.0:1773851857.248596:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851857.248596:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851857.248597:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000627f12de.
00000100:00000040:25.0:1773851857.248598:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000627f12de x1858043242076032 msgsize 224
00000100:00100000:25.0:1773851857.248600:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16978@kfi7 (source: 12345-16978@kfi7)
00000100:00000001:25.0:1773851857.248601:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851857.248601:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000935cef5c nid 16978@kfi7 refs 2
00000100:00000001:24.0:1773851857.248602:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851857.248603:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851857.248603:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851857.248603:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851857.248604:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851857.248605:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851857.248606:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043242076032
00000020:00000001:24.0:1773851857.248606:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851857.248607:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92172
00000020:00000001:24.0:1773851857.248607:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851857.248609:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b2831881 refcount=168
00000020:00000001:24.0:1773851857.248609:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629768192 : -107123079783424 : ffff9e9276e1dc00)
00000020:00000001:24.0:1773851857.248610:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629768192 : -107123079783424 : ffff9e9276e1dc00)
00000100:00000001:24.0:1773851857.248611:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851857.248612:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851857.248612:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000705a3f71.
00000020:00000010:24.0:1773851857.248614:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851857.248615:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002065a558.
00000100:00000001:24.0:1773851857.248616:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851857.248616:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851857.248616:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851857.248617:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851857.248618:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851857.248618:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851857.248619:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851857.248620:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851857.248621:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851857.248621:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851857.248621:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851857.248622:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16978@kfi7, seq: 2025056
00000100:00000040:26.0:1773851857.248623:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b2831881 : new rpc_count 1
00000100:00000001:24.0:1773851857.248623:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.248624:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636968615761280 : -107105093790336 : ffff9e96a6ee5580)
00000100:00000001:24.0:1773851857.248624:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.248625:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000627f12de x1858043242076032/t0(0) o400->745a2b3e-5353-4b51-8483-b8f22fae073e@16978@kfi7:74/0 lens 224/0 e 0 to 0 dl 1773852189 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1558-0'
00000100:00000001:26.0:1773851857.248628:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851857.248628:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851857.248629:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000627f12de pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:745a2b3e-5353-4b51-8483-b8f22fae073e+168:39826:x1858043242076032:12345-16978@kfi7:400:default-tuolumne1558-0
00000100:00000200:26.0:1773851857.248631:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043242076032
00000020:00000001:26.0:1773851857.248631:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851857.248632:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851857.248632:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.248633:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851857.248634:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851857.248635:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851857.248635:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043242076032, found 0 last_xid 1858043241652351
00000020:00000001:26.0:1773851857.248636:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851857.248637:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851857.248637:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851857.248638:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.248639:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851857.248639:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851857.248640:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851857.248640:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd49e8f6.
02000000:00000001:26.0:1773851857.248641:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.248642:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.248643:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851857.248644:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063080, transno 0, xid 1858043242076032
00010000:00000001:26.0:1773851857.248644:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851857.248645:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000627f12de x1858043242076032/t0(0) o400->745a2b3e-5353-4b51-8483-b8f22fae073e@16978@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1558-0'
00010000:00000001:26.0:1773851857.248648:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851857.248649:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851857.248649:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=90 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851857.248650:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851857.248651:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000009dc4a60 refcount 3 to 16978@kfi7
00000100:00000001:26.0:1773851857.248652:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985417824 : -107156724133792 : ffff9e8aa185d060)
02000000:00000001:26.0:1773851857.248653:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851857.248653:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.248654:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851857.248654:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16978@kfi7
00000400:00000010:26.0:1773851857.248655:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000520e24c5.
00000100:00000200:26.0:1773851857.248656:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043242076032, offset 224
00000400:00000200:26.0:1773851857.248658:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16978@kfi7
00000400:00000200:26.0:1773851857.248658:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16978@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.248659:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000935cef5c nid 16978@kfi7 refs 1
00000400:00000200:26.0:1773851857.248660:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000935cef5c nid 16978@kfi7 refs 2
00000400:00000200:26.0:1773851857.248661:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000935cef5c nid 16978@kfi7 refs 3
00000400:00000200:26.0:1773851857.248663:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16978@kfi7 local destination
00000400:00000200:26.0:1773851857.248664:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768729:8768729:1024:4294967295] 16978@kfi7 LPNI seq info [7175984:7175984:16:4294967295]
00000400:00000200:26.0:1773851857.248665:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000935cef5c nid 16978@kfi7 refs 2
00000400:00000200:26.0:1773851857.248666:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16978@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.248668:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16978@kfi7(16978@kfi7:16978@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851857.248669:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000935cef5c nid 16978@kfi7 refs 3
00000800:00000200:26.0:1773851857.248670:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851857.248671:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851857.248674:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851857.248676:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000008e9 Using peer 16978@kfi7(0x1000000000008e9)
00000800:00000200:26.0:1773851857.248680:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x1000000000008e9: rc=0
00000800:00000200:26.0:1773851857.248681:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000008e9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851857.248683:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.248684:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000009dc4a60 refcount 2 to 16978@kfi7
00010000:00000001:26.0:1773851857.248685:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851857.248686:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.248687:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851857.248687:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000627f12de x1858043242076032/t0(0) o400->745a2b3e-5353-4b51-8483-b8f22fae073e@16978@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1558-0'
00000100:00100000:26.0:1773851857.248690:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000627f12de pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:745a2b3e-5353-4b51-8483-b8f22fae073e+168:39826:x1858043242076032:12345-16978@kfi7:400:default-tuolumne1558-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851857.248693:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16978@kfi7, seq: 2025056
00000800:00000200:25.0:1773851857.248693:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000008e9 TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851857.248694:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b2831881 : new rpc_count 0
00000100:00000001:26.0:1773851857.248694:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851857.248695:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851857.248695:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851857.248696:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:26.0:1773851857.248696:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002065a558.
00000400:00000200:25.0:1773851857.248696:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16978@kfi7: PUT: OK
00000020:00000010:26.0:1773851857.248697:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000705a3f71.
00000400:00000200:25.0:1773851857.248697:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000520e24c5
00000400:00000010:25.0:1773851857.248697:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000520e24c5.
00000020:00000040:26.0:1773851857.248698:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000b2831881 : new refcount 167
00000100:00000001:25.0:1773851857.248698:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851857.248698:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:26.0:1773851857.248699:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851857.248699:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000935cef5c nid 16978@kfi7 refs 2
00000800:00000200:25.0:1773851857.248701:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 16978@kfi7(000000007e98e34a):0x0 lsk 2282 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000008e9 Transaction freed
00000800:00000200:13.0:1773851857.337625:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.337626:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851857.337628:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851857.337629:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851857.337631:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.337633:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22865@kfi7 : PUT - for me
00000400:00000200:13.0:1773851857.337633:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.337634:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 1
00000400:00000200:13.0:1773851857.337635:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.337635:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000400:00000200:13.0:1773851857.337636:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 3
00000400:00000200:13.0:1773851857.337637:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22928@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.337638:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22928@kfi7 of length 224 into portal 12 MB=0x69b0a457be3c0
00000400:00000200:13.0:1773851857.337639:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22928@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 17032
00000800:00000200:13.0:1773851857.337641:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851857.337642:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851857.337643:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22865@kfi7: PUT: OK
00000100:00000001:13.0:1773851857.337644:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851857.337645:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851857.337646:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009e144d9b.
00000100:00000040:13.0:1773851857.337647:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009e144d9b x1859318277989312 msgsize 224
00000100:00100000:13.0:1773851857.337648:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22928@kfi7 (source: 12345-22865@kfi7)
00000100:00000001:13.0:1773851857.337650:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851857.337650:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000800:00000200:13.0:1773851857.337652:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851857.337654:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851857.337655:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851857.337655:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851857.337656:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851857.337656:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851857.337657:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318277989312
00000020:00000001:13.0:1773851857.337658:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851857.337658:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929d7
00000020:00000001:13.0:1773851857.337659:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851857.337662:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8a278bf refcount=41
00000020:00000001:13.0:1773851857.337662:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743173120 : -107128966378496 : ffff9e9118038c00)
00000020:00000001:13.0:1773851857.337663:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743173120 : -107128966378496 : ffff9e9118038c00)
00000100:00000001:13.0:1773851857.337664:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.337664:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851857.337665:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851857.337666:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.337667:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851857.337668:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851857.337668:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851857.337668:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.337669:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851857.337670:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851857.337670:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.337671:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.337672:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.337673:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.337673:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851857.337673:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851857.337674:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22928@kfi7, seq: 2289782
00000100:00000001:15.0:1773851857.337675:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851857.337675:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.337675:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8a278bf : new rpc_count 2
00000100:00000001:13.0:1773851857.337675:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637131197387264 : -106942512164352 : ffff9ebc818d1200)
00000100:00000040:13.0:1773851857.337676:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009e144d9b x1859318277989312/t0(0) o400->a8ff8b7e-ac2d-4ced-8ea1-e1c76e70ab77@22928@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1922-0'
00000100:00000001:13.0:1773851857.337679:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.337679:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851857.337680:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e144d9b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a8ff8b7e-ac2d-4ced-8ea1-e1c76e70ab77+41:39931:x1859318277989312:12345-22928@kfi7:400:default-tuolumne1922-0
00000100:00000200:13.0:1773851857.337681:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318277989312
00000020:00000001:13.0:1773851857.337681:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851857.337682:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851857.337682:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.337683:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851857.337683:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851857.337684:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851857.337685:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318277989312, found 0 last_xid 1859318276881855
00000020:00000001:13.0:1773851857.337685:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851857.337686:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851857.337686:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851857.337687:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.337688:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851857.337688:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851857.337689:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851857.337689:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ec74fa1e.
02000000:00000001:13.0:1773851857.337690:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.337691:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.337691:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851857.337692:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586390, transno 0, xid 1859318277989312
00010000:00000001:13.0:1773851857.337692:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851857.337693:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009e144d9b x1859318277989312/t0(0) o400->a8ff8b7e-ac2d-4ced-8ea1-e1c76e70ab77@22928@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1922-0'
00010000:00000001:13.0:1773851857.337695:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851857.337696:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851857.337697:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=90 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851857.337698:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851857.337698:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000af4f7cac refcount 5 to 22928@kfi7
00000100:00000001:13.0:1773851857.337699:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521904800 : -107145187646816 : ffff9e8d5126a2a0)
02000000:00000001:13.0:1773851857.337699:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851857.337700:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.337700:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851857.337701:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22865@kfi7
00000400:00000010:13.0:1773851857.337702:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008e45278a.
00000100:00000200:13.0:1773851857.337702:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318277989312, offset 224
00000400:00000200:13.0:1773851857.337703:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22865@kfi7
00000400:00000200:13.0:1773851857.337704:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.337705:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 1
00000400:00000200:13.0:1773851857.337706:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000400:00000200:13.0:1773851857.337706:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 3
00000400:00000200:13.0:1773851857.337707:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22865@kfi7 local destination
00000400:00000200:13.0:1773851857.337708:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768730:8768730:1024:4294967295] 22865@kfi7 LPNI seq info [7351417:7351417:16:4294967295]
00000400:00000200:13.0:1773851857.337710:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000400:00000200:13.0:1773851857.337710:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.337712:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22865@kfi7(22865@kfi7:22865@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851857.337713:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 3
00000800:00000200:13.0:1773851857.337714:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.337715:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851857.337717:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851857.337719:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe50 Using peer 22865@kfi7(0xe50)
00000800:00000200:13.0:1773851857.337722:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008e3f5456: Posted send of 324 bytes to peer 0xe50: rc=0
00000800:00000200:13.0:1773851857.337723:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe50 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851857.337730:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.337731:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000af4f7cac refcount 4 to 22928@kfi7
00010000:00000001:13.0:1773851857.337731:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851857.337732:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.337732:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851857.337733:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009e144d9b x1859318277989312/t0(0) o400->a8ff8b7e-ac2d-4ced-8ea1-e1c76e70ab77@22928@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1922-0'
00000800:00000200:14.0:1773851857.337736:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe50 TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851857.337736:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e144d9b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a8ff8b7e-ac2d-4ced-8ea1-e1c76e70ab77+41:39931:x1859318277989312:12345-22928@kfi7:400:default-tuolumne1922-0 Request processed in 56us (88us total) trans 0 rc 0/0
00000400:00000200:14.0:1773851857.337738:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:13.0:1773851857.337738:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22928@kfi7, seq: 2289782
00000400:00000200:14.0:1773851857.337739:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22865@kfi7: PUT: OK
00000400:00000200:14.0:1773851857.337739:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008e45278a
00000100:00000040:13.0:1773851857.337739:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8a278bf : new rpc_count 1
00000100:00000001:13.0:1773851857.337739:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:14.0:1773851857.337740:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008e45278a.
00000100:00000001:13.0:1773851857.337740:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851857.337740:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000001:14.0:1773851857.337741:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851857.337741:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:13.0:1773851857.337741:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000400:00000200:14.0:1773851857.337742:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000020:00000010:13.0:1773851857.337742:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000020:00000040:13.0:1773851857.337742:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c8a278bf : new refcount 40
00000800:00000200:14.0:1773851857.337743:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22865@kfi7(00000000f8514172):0x0 lsk 3665 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe50 Transaction freed
00000100:00000001:13.0:1773851857.337743:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851857.341217:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851857.341218:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851857.341220:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851857.341223:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851857.341226:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14387@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.341228:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14387@kfi7 : PUT - for me
00000400:00000200:1.0:1773851857.341230:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14387@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.341231:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004374dddd nid 14387@kfi7 refs 1
00000400:00000200:1.0:1773851857.341232:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14387@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.341233:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004374dddd nid 14387@kfi7 refs 2
00000400:00000200:1.0:1773851857.341236:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004374dddd nid 14387@kfi7 refs 3
00000400:00000200:1.0:1773851857.341237:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14579@kfi7 to cpt 3
00000400:00000200:1.0:1773851857.341239:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14579@kfi7 of length 224 into portal 12 MB=0x69b7c9ed8f880
00000400:00000200:1.0:1773851857.341241:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14579@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 15808
00000800:00000200:1.0:1773851857.341244:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851857.341246:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.341248:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14387@kfi7: PUT: OK
00000100:00000001:1.0:1773851857.341249:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851857.341250:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851857.341251:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000687d17f3.
00000100:00000040:1.0:1773851857.341253:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000687d17f3 x1859809403533440 msgsize 224
00000100:00100000:1.0:1773851857.341255:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14579@kfi7 (source: 12345-14387@kfi7)
00000100:00000001:1.0:1773851857.341256:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851857.341258:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004374dddd nid 14387@kfi7 refs 2
00000100:00000001:0.0:1773851857.341259:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851857.341260:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851857.341260:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851857.341260:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851857.341261:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851857.341262:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.341263:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859809403533440
00000020:00000001:0.0:1773851857.341264:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851857.341265:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f085d7dcb435
00000020:00000001:0.0:1773851857.341266:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851857.341268:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e6365006 refcount=5
00000020:00000001:0.0:1773851857.341270:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120389321728 : -106953320229888 : ffff9eb9fd571400)
00000020:00000001:0.0:1773851857.341271:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637120389321728 : -106953320229888 : ffff9eb9fd571400)
00000100:00000001:0.0:1773851857.341272:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.341273:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851857.341274:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851857.341276:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.341277:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851857.341278:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851857.341279:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851857.341280:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.341281:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851857.341282:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851857.341282:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.341284:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.341286:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.341287:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.341287:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851857.341287:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851857.341288:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14579@kfi7, seq: 1997503
00000100:00000040:0.0:1773851857.341289:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e6365006 : new rpc_count 1
00000100:00000001:1.0:1773851857.341290:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851857.341291:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.341291:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605646592 : -106923103905024 : ffff9ec1065f9b00)
00000100:00000040:0.0:1773851857.341292:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000687d17f3 x1859809403533440/t0(0) o400->baa038cb-7198-4485-9a34-a01ee1bd8cc2@14579@kfi7:497/0 lens 224/0 e 0 to 0 dl 1773852612 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1385-0'
00000100:00000001:0.0:1773851857.341297:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.341298:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851857.341299:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000687d17f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:baa038cb-7198-4485-9a34-a01ee1bd8cc2+5:39439:x1859809403533440:12345-14579@kfi7:400:default-tuolumne1385-0
00000100:00000200:0.0:1773851857.341301:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859809403533440
00000020:00000001:0.0:1773851857.341302:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851857.341303:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851857.341304:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.341305:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851857.341306:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851857.341307:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851857.341308:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859809403533440, found 0 last_xid 1859809403533439
00000020:00000001:0.0:1773851857.341310:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851857.341311:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851857.341311:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851857.341312:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.341313:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851857.341314:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851857.341315:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851857.341316:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000006856a5c.
02000000:00000001:0.0:1773851857.341317:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.341318:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.341319:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851857.341320:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676018314, transno 0, xid 1859809403533440
00010000:00000001:0.0:1773851857.341322:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851857.341323:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000687d17f3 x1859809403533440/t0(0) o400->baa038cb-7198-4485-9a34-a01ee1bd8cc2@14579@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1385-0'
00010000:00000001:0.0:1773851857.341327:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851857.341328:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851857.341329:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=90 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851857.341330:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851857.341331:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000db075f17 refcount 3 to 14579@kfi7
00000100:00000001:0.0:1773851857.341333:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642468128 : -107157067083488 : ffff9e8a8d14d120)
02000000:00000001:0.0:1773851857.341334:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851857.341335:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.341336:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851857.341337:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14387@kfi7
00000400:00000010:0.0:1773851857.341338:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004dfb4d66.
00000100:00000200:0.0:1773851857.341339:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859809403533440, offset 224
00000400:00000200:0.0:1773851857.341341:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14387@kfi7
00000400:00000200:0.0:1773851857.341343:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14387@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.341344:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004374dddd nid 14387@kfi7 refs 1
00000400:00000200:0.0:1773851857.341346:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004374dddd nid 14387@kfi7 refs 2
00000400:00000200:0.0:1773851857.341348:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004374dddd nid 14387@kfi7 refs 3
00000400:00000200:0.0:1773851857.341349:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14387@kfi7 local destination
00000400:00000200:0.0:1773851857.341351:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768731:8768731:1024:4294967295] 14387@kfi7 LPNI seq info [402085:402085:16:4294967295]
00000400:00000200:0.0:1773851857.341354:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004374dddd nid 14387@kfi7 refs 2
00000400:00000200:0.0:1773851857.341355:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14387@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.341358:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14387@kfi7(14387@kfi7:14387@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851857.341360:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004374dddd nid 14387@kfi7 refs 3
00000800:00000200:0.0:1773851857.341362:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851857.341363:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851857.341367:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851857.341375:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a7d Using peer 14387@kfi7(0x100000000000a7d)
00000800:00000200:0.0:1773851857.341380:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x100000000000a7d: rc=0
00000800:00000200:0.0:1773851857.341382:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a7d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851857.341386:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.341387:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000db075f17 refcount 2 to 14579@kfi7
00010000:00000001:0.0:1773851857.341388:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851857.341391:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.341392:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851857.341393:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000687d17f3 x1859809403533440/t0(0) o400->baa038cb-7198-4485-9a34-a01ee1bd8cc2@14579@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1385-0'
00000100:00100000:0.0:1773851857.341398:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000687d17f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:baa038cb-7198-4485-9a34-a01ee1bd8cc2+5:39439:x1859809403533440:12345-14579@kfi7:400:default-tuolumne1385-0 Request processed in 100us (144us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851857.341402:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14579@kfi7, seq: 1997503
00000100:00000040:0.0:1773851857.341403:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e6365006 : new rpc_count 0
00000100:00000001:0.0:1773851857.341404:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851857.341405:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851857.341406:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.341407:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851857.341408:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851857.341409:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000e6365006 : new refcount 4
00000100:00000001:0.0:1773851857.341411:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851857.341418:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a7d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851857.341421:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.341422:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14387@kfi7: PUT: OK
00000400:00000200:1.0:1773851857.341423:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004dfb4d66
00000400:00000010:1.0:1773851857.341424:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004dfb4d66.
00000100:00000001:1.0:1773851857.341425:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851857.341426:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851857.341427:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004374dddd nid 14387@kfi7 refs 2
00000800:00000200:1.0:1773851857.341429:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 14387@kfi7(00000000122e8e9a):0x0 lsk 2686 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000a7d Transaction freed
00000800:00000200:17.0:1773851857.343460:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851857.343461:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851857.343462:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851857.343463:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851857.343465:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14176@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.343466:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14176@kfi7 : PUT - for me
00000400:00000200:17.0:1773851857.343467:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14176@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.343467:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007698a074 nid 14176@kfi7 refs 1
00000400:00000200:17.0:1773851857.343468:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14176@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.343469:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007698a074 nid 14176@kfi7 refs 2
00000400:00000200:17.0:1773851857.343470:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007698a074 nid 14176@kfi7 refs 3
00000400:00000200:17.0:1773851857.343470:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14176@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.343471:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14176@kfi7 of length 224 into portal 12 MB=0x699e0e19bca80
00000400:00000200:17.0:1773851857.343472:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14176@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 191648
00000800:00000200:17.0:1773851857.343474:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851857.343475:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851857.343476:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14176@kfi7: PUT: OK
00000100:00000001:17.0:1773851857.343477:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851857.343477:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851857.343478:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d5aa252d.
00000100:00000040:17.0:1773851857.343479:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000d5aa252d x1858040997071488 msgsize 224
00000100:00100000:17.0:1773851857.343480:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14176@kfi7 (source: 12345-14176@kfi7)
00000100:00000001:17.0:1773851857.343481:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851857.343482:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007698a074 nid 14176@kfi7 refs 2
00000100:00000001:18.0:1773851857.343483:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851857.343483:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851857.343483:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851857.343483:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851857.343484:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851857.343485:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851857.343486:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040997071488
00000020:00000001:18.0:1773851857.343486:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851857.343487:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91cbe
00000020:00000001:18.0:1773851857.343487:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851857.343489:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000597c9699 refcount=167
00000020:00000001:18.0:1773851857.343490:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628297728 : -107123081253888 : ffff9e9276cb6c00)
00000020:00000001:18.0:1773851857.343491:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628297728 : -107123081253888 : ffff9e9276cb6c00)
00000100:00000001:18.0:1773851857.343492:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.343492:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851857.343493:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2d6dcb1.
00000020:00000010:18.0:1773851857.343494:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851857.343495:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000059dcb8dd.
00000100:00000001:18.0:1773851857.343496:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851857.343496:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851857.343497:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851857.343498:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851857.343498:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851857.343499:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.343500:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851857.343501:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851857.343501:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851857.343501:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851857.343502:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851857.343502:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14176@kfi7, seq: 2156268
00000100:00000001:19.0:1773851857.343503:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851857.343503:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000597c9699 : new rpc_count 1
00000100:00000001:19.0:1773851857.343504:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.343504:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764365568 : -107095945186048 : ffff9e98c83af500)
00000100:00000040:18.0:1773851857.343505:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d5aa252d x1858040997071488/t0(0) o400->fecbee8c-622c-4b59-81ec-aec84c2ad1e1@14176@kfi7:47/0 lens 224/0 e 0 to 0 dl 1773852162 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1376-0'
00000100:00000001:18.0:1773851857.343507:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.343508:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851857.343509:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5aa252d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:fecbee8c-622c-4b59-81ec-aec84c2ad1e1+167:39649:x1858040997071488:12345-14176@kfi7:400:default-tuolumne1376-0
00000100:00000200:18.0:1773851857.343510:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040997071488
00000020:00000001:18.0:1773851857.343510:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851857.343511:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851857.343511:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.343512:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851857.343512:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851857.343513:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851857.343514:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040997071488, found 0 last_xid 1858040996648959
00000020:00000001:18.0:1773851857.343514:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851857.343515:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851857.343515:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851857.343516:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.343516:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851857.343517:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851857.343517:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851857.343518:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f516f763.
02000000:00000001:18.0:1773851857.343518:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.343519:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.343520:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851857.343520:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062525, transno 0, xid 1858040997071488
00010000:00000001:18.0:1773851857.343521:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851857.343522:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d5aa252d x1858040997071488/t0(0) o400->fecbee8c-622c-4b59-81ec-aec84c2ad1e1@14176@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1376-0'
00010000:00000001:18.0:1773851857.343524:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851857.343524:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851857.343525:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=90 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851857.343526:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851857.343527:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000057385023 refcount 3 to 14176@kfi7
00000100:00000001:18.0:1773851857.343527:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516320 : -107156126035296 : ffff9e8ac52c12a0)
02000000:00000001:18.0:1773851857.343528:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851857.343528:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.343529:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851857.343530:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14176@kfi7
00000400:00000010:18.0:1773851857.343530:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006aa0fdbb.
00000100:00000200:18.0:1773851857.343531:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040997071488, offset 224
00000400:00000200:18.0:1773851857.343532:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14176@kfi7
00000400:00000200:18.0:1773851857.343533:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14176@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.343534:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007698a074 nid 14176@kfi7 refs 1
00000400:00000200:18.0:1773851857.343535:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007698a074 nid 14176@kfi7 refs 2
00000400:00000200:18.0:1773851857.343536:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007698a074 nid 14176@kfi7 refs 3
00000400:00000200:18.0:1773851857.343537:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14176@kfi7 local destination
00000400:00000200:18.0:1773851857.343538:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768732:8768732:1024:4294967295] 14176@kfi7 LPNI seq info [688327:688327:16:4294967295]
00000400:00000200:18.0:1773851857.343539:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007698a074 nid 14176@kfi7 refs 2
00000400:00000200:18.0:1773851857.343539:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14176@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.343541:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14176@kfi7(14176@kfi7:14176@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851857.343542:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007698a074 nid 14176@kfi7 refs 3
00000800:00000200:18.0:1773851857.343543:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851857.343544:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851857.343546:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851857.343548:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000289 Using peer 14176@kfi7(0x100000000000289)
00000800:00000200:18.0:1773851857.343551:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000079f17c9e: Posted send of 324 bytes to peer 0x100000000000289: rc=0
00000800:00000200:18.0:1773851857.343552:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000289 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851857.343555:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851857.343556:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000057385023 refcount 2 to 14176@kfi7
00010000:00000001:18.0:1773851857.343557:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851857.343557:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.343558:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851857.343559:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d5aa252d x1858040997071488/t0(0) o400->fecbee8c-622c-4b59-81ec-aec84c2ad1e1@14176@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1376-0'
00000100:00100000:18.0:1773851857.343562:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5aa252d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:fecbee8c-622c-4b59-81ec-aec84c2ad1e1+167:39649:x1858040997071488:12345-14176@kfi7:400:default-tuolumne1376-0 Request processed in 53us (82us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851857.343564:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14176@kfi7, seq: 2156268
00000100:00000040:18.0:1773851857.343564:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000597c9699 : new rpc_count 0
00000100:00000001:18.0:1773851857.343565:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851857.343565:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000289 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851857.343566:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851857.343566:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851857.343566:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851857.343567:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000059dcb8dd.
00000020:00000010:18.0:1773851857.343567:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2d6dcb1.
00000400:00000200:17.0:1773851857.343567:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14176@kfi7: PUT: OK
00000020:00000040:18.0:1773851857.343568:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000597c9699 : new refcount 166
00000400:00000200:17.0:1773851857.343568:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006aa0fdbb
00000400:00000010:17.0:1773851857.343568:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006aa0fdbb.
00000100:00000001:18.0:1773851857.343569:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851857.343569:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851857.343569:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851857.343570:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007698a074 nid 14176@kfi7 refs 2
00000800:00000200:17.0:1773851857.343571:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 14176@kfi7(00000000e7a0e438):0x0 lsk 650 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000289 Transaction freed
00000800:00000200:17.0:1773851857.354062:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851857.354063:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851857.354064:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851857.354066:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851857.354067:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.354068:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.24@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851857.354069:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.354070:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851857.354071:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.24@o2ib60 to cpt 1
00000400:00000200:17.0:1773851857.354073:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 2
00000400:00000200:17.0:1773851857.354073:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 3
00000400:00000200:17.0:1773851857.354074:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.24@o2ib60 to cpt 1
00000400:00000200:17.0:1773851857.354075:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.24@o2ib60 of length 224 into portal 12 MB=0x69b1d59fcf300
00000400:00000200:17.0:1773851857.354077:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.24@o2ib60 of length 224/224 into md 0x793926dc5 [64] + 120488
00000800:00000200:17.0:1773851857.354078:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851857.354079:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851857.354081:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851857.354081:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851857.354082:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851857.354082:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c6fc24e4.
00000100:00000040:17.0:1773851857.354083:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000c6fc24e4 x1859400226370304 msgsize 224
00000100:00100000:17.0:1773851857.354085:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.24@o2ib60 (source: 12345-192.168.128.24@o2ib60)
00000100:00000001:17.0:1773851857.354086:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851857.354087:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851857.354088:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851857.354090:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851857.354090:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851857.354091:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851857.354091:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.354092:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851857.354093:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859400226370304
00000020:00000001:7.0:1773851857.354093:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851857.354094:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0797f3f6913
00000020:00000001:7.0:1773851857.354094:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851857.354095:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d2a81213 refcount=55818
00000020:00000001:7.0:1773851857.354096:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637057575048192 : -107016134503424 : ffff9eab5d515400)
00000020:00000001:7.0:1773851857.354097:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637057575048192 : -107016134503424 : ffff9eab5d515400)
00000100:00000001:7.0:1773851857.354098:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.354099:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851857.354100:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000636d72dc.
00000020:00000010:7.0:1773851857.354101:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851857.354102:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851857.354103:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851857.354103:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851857.354103:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.354104:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851857.354105:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851857.354105:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.354106:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.354108:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851857.354108:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851857.354108:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851857.354109:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.24@o2ib60, seq: 2001861
00000100:00000001:5.0:1773851857.354109:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851857.354111:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d2a81213 : new rpc_count 6
00000100:00000001:5.0:1773851857.354111:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.354112:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764343680 : -107095945207936 : ffff9e98c83a9f80)
00000100:00000001:5.0:1773851857.354112:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.354113:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c6fc24e4 x1859400226370304/t0(0) o400->16201831-9c16-4932-a3f9-8725aef4fea9@192.168.128.24@o2ib60:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix24-0'
00000100:00000001:7.0:1773851857.354116:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.354116:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851857.354118:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6fc24e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:16201831-9c16-4932-a3f9-8725aef4fea9+55818:40278:x1859400226370304:12345-192.168.128.24@o2ib60:400:default-matrix24-0
00000100:00000200:7.0:1773851857.354119:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859400226370304
00000020:00000001:7.0:1773851857.354120:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851857.354120:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851857.354121:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.354122:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851857.354122:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851857.354123:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851857.354123:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859400226370304, found 0 last_xid 1859400222779455
00000020:00000001:7.0:1773851857.354124:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851857.354125:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851857.354125:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851857.354126:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.354126:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851857.354127:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851857.354128:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851857.354128:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007fa448d1.
02000000:00000001:7.0:1773851857.354129:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.354129:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.354130:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851857.354130:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593886, transno 0, xid 1859400226370304
00010000:00000001:7.0:1773851857.354131:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851857.354132:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c6fc24e4 x1859400226370304/t0(0) o400->16201831-9c16-4932-a3f9-8725aef4fea9@192.168.128.24@o2ib60:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix24-0'
00010000:00000001:7.0:1773851857.354135:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851857.354135:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851857.354137:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=89 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851857.354138:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851857.354138:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ceff4c59 refcount 3 to 192.168.128.24@o2ib60
00000100:00000001:7.0:1773851857.354139:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703840 : -107156155847776 : ffff9e8ac3652ba0)
02000000:00000001:7.0:1773851857.354140:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851857.354140:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.354141:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851857.354142:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.24@o2ib60
00000400:00000010:7.0:1773851857.354143:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009424d83.
00000100:00000200:7.0:1773851857.354144:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859400226370304, offset 224
00000400:00000200:7.0:1773851857.354145:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.24@o2ib60
00000400:00000200:7.0:1773851857.354146:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.24@o2ib60 to cpt 1
00000400:00000200:7.0:1773851857.354148:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 2
00000400:00000200:7.0:1773851857.354149:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 3
00000400:00000200:7.0:1773851857.354150:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 4
00000400:00000200:7.0:1773851857.354152:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.24@o2ib60 routed destination
00000400:00000200:7.0:1773851857.354153:0:61015:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851857.354153:0:61015:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:7.0:1773851857.354155:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.24@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851857.354156:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851857.354157:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.24@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851857.354158:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851857.354159:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768733:8768733:1024:4294967295] 17@kfi7 LPNI seq info [1250891882:1250891882:16:4294967295]
00000400:00000200:7.0:1773851857.354160:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:7.0:1773851857.354161:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:7.0:1773851857.354164:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.24@o2ib60(192.168.128.24@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851857.354165:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 3
00000800:00000200:7.0:1773851857.354166:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851857.354167:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851857.354169:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851857.354172:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:7.0:1773851857.354175:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:7.0:1773851857.354176:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851857.354179:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.354180:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ceff4c59 refcount 2 to 192.168.128.24@o2ib60
00010000:00000001:7.0:1773851857.354181:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851857.354181:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.354182:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851857.354183:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c6fc24e4 x1859400226370304/t0(0) o400->16201831-9c16-4932-a3f9-8725aef4fea9@192.168.128.24@o2ib60:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix24-0'
00000100:00100000:7.0:1773851857.354186:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6fc24e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:16201831-9c16-4932-a3f9-8725aef4fea9+55818:40278:x1859400226370304:12345-192.168.128.24@o2ib60:400:default-matrix24-0 Request processed in 69us (102us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851857.354188:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851857.354189:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.24@o2ib60, seq: 2001861
00000100:00000040:7.0:1773851857.354189:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d2a81213 : new rpc_count 5
00000100:00000001:7.0:1773851857.354190:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851857.354190:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851857.354190:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851857.354191:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851857.354191:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000010:7.0:1773851857.354192:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000400:00000200:5.0:1773851857.354192:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009424d83
00000400:00000010:5.0:1773851857.354192:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009424d83.
00000020:00000010:7.0:1773851857.354193:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000636d72dc.
00000020:00000040:7.0:1773851857.354193:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000d2a81213 : new refcount 55817
00000100:00000001:5.0:1773851857.354193:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851857.354193:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851857.354194:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851857.354194:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:5.0:1773851857.354195:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Transaction freed
00000800:00000200:29.0:1773851857.376903:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851857.376904:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851857.376905:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851857.376908:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851857.376910:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15426@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.376911:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15426@kfi7 : PUT - for me
00000400:00000200:29.0:1773851857.376912:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15426@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.376913:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045c9d540 nid 15426@kfi7 refs 1
00000400:00000200:29.0:1773851857.376915:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15426@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.376915:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045c9d540 nid 15426@kfi7 refs 2
00000400:00000200:29.0:1773851857.376916:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000045c9d540 nid 15426@kfi7 refs 3
00000400:00000200:29.0:1773851857.376918:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15426@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.376919:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15426@kfi7 of length 224 into portal 12 MB=0x69b4b5e8c12c0
00000400:00000200:29.0:1773851857.376921:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15426@kfi7 of length 224/224 into md 0x77fe139dd [64] + 164704
00000800:00000200:29.0:1773851857.376924:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851857.376927:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851857.376928:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15426@kfi7: PUT: OK
00000100:00000001:29.0:1773851857.376930:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851857.376931:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851857.376933:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000083794617.
00000100:00000040:29.0:1773851857.376934:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000083794617 x1859597871354560 msgsize 224
00000100:00100000:29.0:1773851857.376937:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15426@kfi7 (source: 12345-15426@kfi7)
00000100:00000001:29.0:1773851857.376939:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851857.376940:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000045c9d540 nid 15426@kfi7 refs 2
00000100:00000001:28.0:1773851857.376942:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851857.376943:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851857.376943:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851857.376943:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851857.376944:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851857.376945:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851857.376947:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597871354560
00000020:00000001:28.0:1773851857.376948:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851857.376948:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23ec7988
00000020:00000001:28.0:1773851857.376949:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851857.376953:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000fa3b2b8 refcount=66
00000020:00000001:28.0:1773851857.376954:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164270600192 : -106909438951424 : ffff9ec434de4000)
00000020:00000001:28.0:1773851857.376956:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637164270600192 : -106909438951424 : ffff9ec434de4000)
00000100:00000001:28.0:1773851857.376957:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851857.376959:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851857.376960:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f9c7c302.
00000020:00000010:28.0:1773851857.376962:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851857.376963:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a4752a66.
00000100:00000001:28.0:1773851857.376965:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851857.376966:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851857.376967:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851857.376968:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851857.376969:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851857.376970:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.376972:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851857.376974:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851857.376975:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851857.376975:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851857.376975:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851857.376978:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15426@kfi7, seq: 2055473
00000100:00000040:31.0:1773851857.376979:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000fa3b2b8 : new rpc_count 3
00000100:00000001:28.0:1773851857.376979:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851857.376980:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221517568 : -106948488034048 : ffff9ebb1d5c8900)
00000100:00000001:28.0:1773851857.376980:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851857.376986:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000083794617 x1859597871354560/t0(0) o400->0e9dc097-bc4a-4195-abb5-413e5376081f@15426@kfi7:645/0 lens 224/0 e 0 to 0 dl 1773852005 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1464-0'
00000100:00000001:31.0:1773851857.376992:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851857.376992:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851857.376994:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083794617 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0e9dc097-bc4a-4195-abb5-413e5376081f+66:39712:x1859597871354560:12345-15426@kfi7:400:default-tuolumne1464-0
00000100:00000200:31.0:1773851857.376997:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597871354560
00000020:00000001:31.0:1773851857.376998:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851857.376999:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851857.377001:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.377002:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851857.377003:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851857.377005:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851857.377006:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597871354560, found 0 last_xid 1859597870784575
00000020:00000001:31.0:1773851857.377007:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851857.377009:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851857.377009:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851857.377011:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.377012:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851857.377013:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851857.377014:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851857.377016:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7e8ad0d.
02000000:00000001:31.0:1773851857.377017:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851857.377019:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.377020:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851857.377021:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588756, transno 0, xid 1859597871354560
00010000:00000001:31.0:1773851857.377023:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851857.377024:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000083794617 x1859597871354560/t0(0) o400->0e9dc097-bc4a-4195-abb5-413e5376081f@15426@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1464-0'
00010000:00000001:31.0:1773851857.377029:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851857.377030:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851857.377031:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=90 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851857.377034:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851857.377036:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cfe87ea1 refcount 3 to 15426@kfi7
00000100:00000001:31.0:1773851857.377037:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869934496 : -107137839617120 : ffff9e8f0720aba0)
02000000:00000001:31.0:1773851857.377039:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851857.377040:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851857.377041:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851857.377043:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15426@kfi7
00000400:00000010:31.0:1773851857.377044:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000200:31.0:1773851857.377045:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597871354560, offset 224
00000400:00000200:31.0:1773851857.377048:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15426@kfi7
00000400:00000200:31.0:1773851857.377050:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15426@kfi7 to cpt 7
00000400:00000200:31.0:1773851857.377051:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045c9d540 nid 15426@kfi7 refs 1
00000400:00000200:31.0:1773851857.377053:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000045c9d540 nid 15426@kfi7 refs 2
00000400:00000200:31.0:1773851857.377055:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000045c9d540 nid 15426@kfi7 refs 3
00000400:00000200:31.0:1773851857.377057:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15426@kfi7 local destination
00000400:00000200:31.0:1773851857.377060:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768734:8768734:1024:4294967295] 15426@kfi7 LPNI seq info [1376788:1376788:16:4294967295]
00000400:00000200:31.0:1773851857.377063:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000045c9d540 nid 15426@kfi7 refs 2
00000400:00000200:31.0:1773851857.377064:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15426@kfi7 to cpt 7
00000400:00000200:31.0:1773851857.377068:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15426@kfi7(15426@kfi7:15426@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851857.377070:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000045c9d540 nid 15426@kfi7 refs 3
00000800:00000200:31.0:1773851857.377073:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851857.377075:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851857.377079:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851857.377084:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000198 Using peer 15426@kfi7(0x100000000000198)
00000800:00000200:31.0:1773851857.377089:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x100000000000198: rc=0
00000800:00000200:31.0:1773851857.377092:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000198 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851857.377096:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851857.377098:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cfe87ea1 refcount 2 to 15426@kfi7
00010000:00000001:31.0:1773851857.377099:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851857.377100:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.377101:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851857.377102:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000083794617 x1859597871354560/t0(0) o400->0e9dc097-bc4a-4195-abb5-413e5376081f@15426@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1464-0'
00000800:00000200:29.0:1773851857.377107:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000198 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851857.377108:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083794617 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0e9dc097-bc4a-4195-abb5-413e5376081f+66:39712:x1859597871354560:12345-15426@kfi7:400:default-tuolumne1464-0 Request processed in 116us (173us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851857.377110:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851857.377112:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15426@kfi7: PUT: OK
00000100:00100000:31.0:1773851857.377113:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15426@kfi7, seq: 2055473
00000400:00000200:29.0:1773851857.377113:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000400:00000010:29.0:1773851857.377114:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000040:31.0:1773851857.377115:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000fa3b2b8 : new rpc_count 2
00000100:00000001:29.0:1773851857.377115:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851857.377116:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851857.377117:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851857.377118:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851857.377118:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000045c9d540 nid 15426@kfi7 refs 2
00000020:00000010:31.0:1773851857.377119:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000800:00000200:29.0:1773851857.377120:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 15426@kfi7(00000000cd94058f):0x0 lsk 409 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000198 Transaction freed
00000020:00000010:31.0:1773851857.377121:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a4752a66.
00000020:00000010:31.0:1773851857.377123:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f9c7c302.
00000020:00000040:31.0:1773851857.377124:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000000fa3b2b8 : new refcount 65
00000100:00000001:31.0:1773851857.377125:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851857.398421:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851857.398423:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851857.398425:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851857.398428:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851857.398431:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.398433:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26323@kfi7 : PUT - for me
00000400:00000200:9.0:1773851857.398435:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.398436:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 1
00000400:00000200:9.0:1773851857.398437:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.398439:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000400:00000200:9.0:1773851857.398440:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 3
00000400:00000200:9.0:1773851857.398442:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.398443:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 456 into portal 12 MB=0x69b4c65a343c0
00000400:00000200:9.0:1773851857.398445:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26323@kfi7 of length 456/456 into md 0x78146ce49 [64] + 123656
00000800:00000200:9.0:1773851857.398448:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851857.398451:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851857.398452:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26323@kfi7: PUT: OK
00000100:00000001:9.0:1773851857.398454:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851857.398455:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851857.398456:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000091dbb3ab.
00000100:00000040:9.0:1773851857.398457:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000091dbb3ab x1859602285282240 msgsize 456
00000100:00100000:9.0:1773851857.398459:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26323@kfi7)
00000100:00000001:9.0:1773851857.398461:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851857.398463:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851857.398463:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 2
02000000:00000001:11.0:1773851857.398464:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851857.398465:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851857.398465:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851857.398466:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851857.398467:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851857.398468:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602285282240
00000020:00000001:11.0:1773851857.398469:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851857.398470:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000020:00000001:11.0:1773851857.398471:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851857.398473:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=164
00000020:00000001:11.0:1773851857.398474:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000020:00000001:11.0:1773851857.398476:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:11.0:1773851857.398477:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.398478:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851857.398479:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000faab3b2c.
00000020:00000010:11.0:1773851857.398481:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851857.398482:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851857.398484:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851857.398485:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851857.398485:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.398487:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.398489:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.398491:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851857.398492:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851857.398492:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851857.398492:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851857.398493:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26323@kfi7, seq: 406391007
00000100:00000040:11.0:1773851857.398495:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e09d60f5 : new rpc_count 3
00000100:00000001:10.0:1773851857.398495:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.398496:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064882176 : -106983644669440 : ffff9eb2eddcda00)
00000100:00000001:10.0:1773851857.398496:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.398497:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000091dbb3ab x1859602285282240/t0(0) o17->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:584/0 lens 456/0 e 0 to 0 dl 1773851944 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2133-0'
00000100:00000001:11.0:1773851857.398502:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.398503:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851857.398504:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091dbb3ab pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fd96080a-33e6-4035-b5d5-c4f2e0fc3c75+164:39512:x1859602285282240:12345-26323@kfi7:17:default-tuolumne2133-0
00000100:00000200:11.0:1773851857.398507:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602285282240
00000020:00000001:11.0:1773851857.398508:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851857.398509:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851857.398510:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.398511:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851857.398512:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:11.0:1773851857.398513:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851857.398514:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602285282240, found 0 last_xid 1859602246540351
00000020:00000001:11.0:1773851857.398515:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851857.398517:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851857.398518:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851857.398519:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851857.398520:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:11.0:1773851857.398521:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851857.398522:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851857.398524:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000a2889d37.
02000000:00000001:11.0:1773851857.398525:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.398526:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.398527:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:11.0:1773851857.398528:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:11.0:1773851857.398529:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851857.398530:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.398531:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851857.398533:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli fd96080a-33e6-4035-b5d5-c4f2e0fc3c75/00000000e09d60f5 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851857.398534:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851857.398535:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli fd96080a-33e6-4035-b5d5-c4f2e0fc3c75/00000000e09d60f5 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851857.398537:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851857.398539:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:11.0:1773851857.398540:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli fd96080a-33e6-4035-b5d5-c4f2e0fc3c75/00000000e09d60f5 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:11.0:1773851857.398541:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:11.0:1773851857.398542:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:11.0:1773851857.398543:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851857.398544:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263881838, transno 0, xid 1859602285282240
00010000:00000001:11.0:1773851857.398545:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851857.398546:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000091dbb3ab x1859602285282240/t0(0) o17->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:584/0 lens 456/432 e 0 to 0 dl 1773851944 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2133-0'
00010000:00000001:11.0:1773851857.398551:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851857.398551:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851857.398552:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=90 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851857.398554:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851857.398555:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009e9c4a62 refcount 3 to 26323@kfi7
00000100:00000001:11.0:1773851857.398556:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058112 : -107146750493504 : ffff9e8cf3ff7cc0)
02000000:00000001:11.0:1773851857.398559:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851857.398560:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.398561:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851857.398562:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26323@kfi7
00000400:00000010:11.0:1773851857.398563:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6296e37.
00000100:00000200:11.0:1773851857.398564:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859602285282240, offset 224
00000400:00000200:11.0:1773851857.398566:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26323@kfi7
00000400:00000200:11.0:1773851857.398567:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.398569:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 1
00000400:00000200:11.0:1773851857.398570:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000400:00000200:11.0:1773851857.398572:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 3
00000400:00000200:11.0:1773851857.398574:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26323@kfi7 local destination
00000400:00000200:11.0:1773851857.398576:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768735:8768735:1024:4294967295] 26323@kfi7 LPNI seq info [1552831:1552831:16:4294967295]
00000400:00000200:11.0:1773851857.398579:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000400:00000200:11.0:1773851857.398580:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.398583:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26323@kfi7(26323@kfi7:26323@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851857.398585:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 3
00000800:00000200:11.0:1773851857.398587:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851857.398589:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:11.0:1773851857.398593:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851857.398596:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008b3 Using peer 26323@kfi7(0x1000000000008b3)
00000800:00000200:11.0:1773851857.398601:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 532 bytes to peer 0x1000000000008b3: rc=0
00000800:00000200:11.0:1773851857.398604:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851857.398607:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.398608:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009e9c4a62 refcount 2 to 26323@kfi7
00010000:00000001:11.0:1773851857.398609:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851857.398611:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.398612:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851857.398613:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000091dbb3ab x1859602285282240/t0(0) o17->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:584/0 lens 456/432 e 0 to 0 dl 1773851944 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2133-0'
00000100:00100000:11.0:1773851857.398619:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091dbb3ab pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fd96080a-33e6-4035-b5d5-c4f2e0fc3c75+164:39512:x1859602285282240:12345-26323@kfi7:17:default-tuolumne2133-0 Request processed in 115us (160us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851857.398619:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008b3 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851857.398622:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851857.398623:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26323@kfi7, seq: 406391007
00000400:00000200:9.0:1773851857.398623:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26323@kfi7: PUT: OK
00000100:00000040:11.0:1773851857.398624:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e09d60f5 : new rpc_count 2
00000100:00000001:11.0:1773851857.398625:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851857.398625:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6296e37
00000400:00000010:9.0:1773851857.398625:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6296e37.
00000100:00000001:11.0:1773851857.398626:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851857.398626:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851857.398627:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000100:00000001:9.0:1773851857.398627:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851857.398628:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000400:00000200:9.0:1773851857.398628:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000020:00000010:11.0:1773851857.398630:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000faab3b2c.
00000020:00000040:11.0:1773851857.398631:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 163
00000800:00000200:9.0:1773851857.398631:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008b3 Transaction freed
00000100:00000001:11.0:1773851857.398632:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851857.406706:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851857.406707:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851857.406708:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851857.406710:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851857.406712:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14897@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.406713:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14897@kfi7 : PUT - for me
00000400:00000200:29.0:1773851857.406714:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14897@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.406715:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afd016c2 nid 14897@kfi7 refs 1
00000400:00000200:29.0:1773851857.406716:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14897@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.406717:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afd016c2 nid 14897@kfi7 refs 2
00000400:00000200:29.0:1773851857.406718:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000afd016c2 nid 14897@kfi7 refs 3
00000400:00000200:29.0:1773851857.406719:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15088@kfi7 to cpt 6
00000400:00000200:29.0:1773851857.406720:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15088@kfi7 of length 224 into portal 12 MB=0x69b4b9e3d3540
00000400:00000200:29.0:1773851857.406722:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15088@kfi7 of length 224/224 into md 0x77fe139dd [64] + 164928
00000800:00000200:29.0:1773851857.406723:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851857.406728:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851857.406729:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14897@kfi7: PUT: OK
00000100:00000001:29.0:1773851857.406730:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851857.406731:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851857.406731:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad479508.
00000100:00000040:29.0:1773851857.406732:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ad479508 x1859598939927872 msgsize 224
00000100:00100000:29.0:1773851857.406734:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15088@kfi7 (source: 12345-14897@kfi7)
00000100:00000001:29.0:1773851857.406735:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851857.406736:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851857.406736:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000afd016c2 nid 14897@kfi7 refs 2
02000000:00000001:31.0:1773851857.406737:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851857.406737:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851857.406738:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851857.406738:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851857.406739:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851857.406740:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598939927872
00000020:00000001:31.0:1773851857.406740:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851857.406741:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f1ed
00000020:00000001:31.0:1773851857.406741:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851857.406745:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000100fae6b refcount=3365
00000020:00000001:31.0:1773851857.406746:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132127489024 : -106941582062592 : ffff9ebcb8fd4c00)
00000020:00000001:31.0:1773851857.406746:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132127489024 : -106941582062592 : ffff9ebcb8fd4c00)
00000100:00000001:31.0:1773851857.406748:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851857.406749:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851857.406750:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000015155d29.
00000020:00000010:31.0:1773851857.406751:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851857.406752:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851857.406753:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851857.406753:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851857.406754:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851857.406754:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851857.406755:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851857.406755:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851857.406756:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851857.406757:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851857.406758:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851857.406758:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851857.406758:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851857.406759:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15088@kfi7, seq: 2055474
00000100:00000040:31.0:1773851857.406760:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000100fae6b : new rpc_count 8
00000100:00000001:31.0:1773851857.406760:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221538304 : -106948488013312 : ffff9ebb1d5cda00)
00000100:00000001:28.0:1773851857.406760:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.406760:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851857.406762:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad479508 x1859598939927872/t0(0) o400->a1f766e7-45ca-4021-baf7-2869b78b4d58@15088@kfi7:645/0 lens 224/0 e 0 to 0 dl 1773852005 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1421-0'
00000100:00000001:31.0:1773851857.406764:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851857.406764:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851857.406765:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad479508 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:a1f766e7-45ca-4021-baf7-2869b78b4d58+3365:39802:x1859598939927872:12345-15088@kfi7:400:default-tuolumne1421-0
00000100:00000200:31.0:1773851857.406767:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598939927872
00000020:00000001:31.0:1773851857.406768:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851857.406768:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851857.406769:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.406770:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851857.406770:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851857.406771:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851857.406772:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598939927872, found 0 last_xid 1859598939174975
00000020:00000001:31.0:1773851857.406772:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851857.406773:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851857.406774:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851857.406774:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.406775:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851857.406775:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851857.406776:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851857.406777:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ceb3b4a6.
02000000:00000001:31.0:1773851857.406778:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851857.406778:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.406779:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851857.406780:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593897, transno 0, xid 1859598939927872
00010000:00000001:31.0:1773851857.406780:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851857.406781:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad479508 x1859598939927872/t0(0) o400->a1f766e7-45ca-4021-baf7-2869b78b4d58@15088@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1421-0'
00010000:00000001:31.0:1773851857.406783:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851857.406784:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851857.406785:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=90 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851857.406786:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851857.406786:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006c4e97cb refcount 3 to 15088@kfi7
00000100:00000001:31.0:1773851857.406787:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336544 : -107152617215072 : ffff9e8b96506ba0)
02000000:00000001:31.0:1773851857.406788:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851857.406788:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851857.406789:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851857.406790:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14897@kfi7
00000400:00000010:31.0:1773851857.406791:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000051546e8a.
00000100:00000200:31.0:1773851857.406791:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598939927872, offset 224
00000400:00000200:31.0:1773851857.406793:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14897@kfi7
00000400:00000200:31.0:1773851857.406793:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14897@kfi7 to cpt 7
00000400:00000200:31.0:1773851857.406794:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afd016c2 nid 14897@kfi7 refs 1
00000400:00000200:31.0:1773851857.406795:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000afd016c2 nid 14897@kfi7 refs 2
00000400:00000200:31.0:1773851857.406796:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000afd016c2 nid 14897@kfi7 refs 3
00000400:00000200:31.0:1773851857.406797:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14897@kfi7 local destination
00000400:00000200:31.0:1773851857.406799:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768736:8768736:1024:4294967295] 14897@kfi7 LPNI seq info [19411299:19411299:16:4294967295]
00000400:00000200:31.0:1773851857.406800:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000afd016c2 nid 14897@kfi7 refs 2
00000400:00000200:31.0:1773851857.406801:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14897@kfi7 to cpt 7
00000400:00000200:31.0:1773851857.406803:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14897@kfi7(14897@kfi7:14897@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851857.406804:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000afd016c2 nid 14897@kfi7 refs 3
00000800:00000200:31.0:1773851857.406805:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851857.406807:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851857.406809:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851857.406812:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010ea Using peer 14897@kfi7(0x1000000000010ea)
00000800:00000200:31.0:1773851857.406815:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x1000000000010ea: rc=0
00000800:00000200:31.0:1773851857.406816:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010ea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851857.406818:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851857.406819:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006c4e97cb refcount 2 to 15088@kfi7
00010000:00000001:31.0:1773851857.406819:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851857.406820:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851857.406820:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851857.406821:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad479508 x1859598939927872/t0(0) o400->a1f766e7-45ca-4021-baf7-2869b78b4d58@15088@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1421-0'
00000100:00100000:31.0:1773851857.406824:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad479508 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:a1f766e7-45ca-4021-baf7-2869b78b4d58+3365:39802:x1859598939927872:12345-15088@kfi7:400:default-tuolumne1421-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851857.406826:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15088@kfi7, seq: 2055474
00000100:00000040:31.0:1773851857.406827:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000100fae6b : new rpc_count 7
00000100:00000001:31.0:1773851857.406828:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851857.406828:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851857.406828:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010ea TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851857.406829:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851857.406829:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851857.406830:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000015155d29.
00000400:00000200:29.0:1773851857.406830:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851857.406831:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000100fae6b : new refcount 3364
00000100:00000001:31.0:1773851857.406831:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851857.406831:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14897@kfi7: PUT: OK
00000400:00000200:29.0:1773851857.406832:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000051546e8a
00000400:00000010:29.0:1773851857.406832:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000051546e8a.
00000100:00000001:29.0:1773851857.406833:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851857.406833:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851857.406834:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000afd016c2 nid 14897@kfi7 refs 2
00000800:00000200:29.0:1773851857.406836:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 14897@kfi7(00000000af27f943):0x0 lsk 4331 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010ea Transaction freed
00000800:00000200:5.0:1773851857.407313:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.407313:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851857.407314:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851857.407316:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851857.407318:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12128@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.407319:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12128@kfi7 : PUT - for me
00000400:00000200:5.0:1773851857.407320:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12128@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.407321:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000585294c1 nid 12128@kfi7 refs 1
00000400:00000200:5.0:1773851857.407322:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12128@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.407322:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000585294c1 nid 12128@kfi7 refs 2
00000400:00000200:5.0:1773851857.407323:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000585294c1 nid 12128@kfi7 refs 3
00000400:00000200:5.0:1773851857.407324:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12128@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.407325:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12128@kfi7 of length 224 into portal 12 MB=0x69b4b9fd0a7c0
00000400:00000200:5.0:1773851857.407326:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12128@kfi7 of length 224/224 into md 0x793926dc5 [64] + 120712
00000800:00000200:5.0:1773851857.407328:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851857.407330:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851857.407331:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12128@kfi7: PUT: OK
00000100:00000001:5.0:1773851857.407332:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851857.407332:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851857.407333:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dbe9feac.
00000100:00000040:5.0:1773851857.407334:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000dbe9feac x1859598966368192 msgsize 224
00000100:00100000:5.0:1773851857.407335:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12128@kfi7 (source: 12345-12128@kfi7)
00000100:00000001:5.0:1773851857.407336:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851857.407337:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000585294c1 nid 12128@kfi7 refs 2
00000100:00000001:7.0:1773851857.407338:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851857.407338:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851857.407338:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851857.407339:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851857.407339:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.407340:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851857.407341:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598966368192
00000020:00000001:7.0:1773851857.407341:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851857.407343:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e521
00000020:00000001:7.0:1773851857.407343:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851857.407345:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f9ceab8a refcount=3501
00000020:00000001:7.0:1773851857.407346:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072919478272 : -107000790073344 : ffff9eaeefeac000)
00000020:00000001:7.0:1773851857.407346:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072919478272 : -107000790073344 : ffff9eaeefeac000)
00000100:00000001:7.0:1773851857.407347:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.407348:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851857.407349:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000636d72dc.
00000020:00000010:7.0:1773851857.407350:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851857.407351:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851857.407352:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851857.407352:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851857.407353:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.407354:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851857.407354:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851857.407354:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.407355:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.407356:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851857.407357:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851857.407357:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851857.407357:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851857.407358:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12128@kfi7, seq: 2001862
00000100:00000040:7.0:1773851857.407359:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f9ceab8a : new rpc_count 17
00000100:00000001:7.0:1773851857.407359:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117668551680 : -106956040999936 : ffff9eb95b2b6c00)
00000100:00000001:5.0:1773851857.407359:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.407360:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.407361:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dbe9feac x1859598966368192/t0(0) o400->5292b7b9-533d-4f94-92b4-7c8c783359e6@12128@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1248-0'
00000100:00000001:7.0:1773851857.407363:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.407364:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851857.407365:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbe9feac pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5292b7b9-533d-4f94-92b4-7c8c783359e6+3501:39551:x1859598966368192:12345-12128@kfi7:400:default-tuolumne1248-0
00000100:00000200:7.0:1773851857.407366:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598966368192
00000020:00000001:7.0:1773851857.407367:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851857.407368:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851857.407369:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.407369:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851857.407371:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851857.407371:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851857.407372:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598966368192, found 0 last_xid 1859598965646015
00000020:00000001:7.0:1773851857.407373:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851857.407374:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851857.407374:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851857.407375:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.407375:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851857.407376:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851857.407377:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851857.407377:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a0b8e6fb.
02000000:00000001:7.0:1773851857.407378:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.407379:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.407379:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851857.407380:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589082, transno 0, xid 1859598966368192
00010000:00000001:7.0:1773851857.407381:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851857.407382:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dbe9feac x1859598966368192/t0(0) o400->5292b7b9-533d-4f94-92b4-7c8c783359e6@12128@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1248-0'
00010000:00000001:7.0:1773851857.407384:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851857.407385:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851857.407385:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=89 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851857.407386:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851857.407387:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cc9c9213 refcount 3 to 12128@kfi7
00000100:00000001:7.0:1773851857.407388:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327302496 : -107155382249120 : ffff9e8af1815960)
02000000:00000001:7.0:1773851857.407388:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851857.407389:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.407390:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851857.407391:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12128@kfi7
00000400:00000010:7.0:1773851857.407391:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edcc54b1.
00000100:00000200:7.0:1773851857.407392:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598966368192, offset 224
00000400:00000200:7.0:1773851857.407393:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12128@kfi7
00000400:00000200:7.0:1773851857.407394:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12128@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.407395:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000585294c1 nid 12128@kfi7 refs 1
00000400:00000200:7.0:1773851857.407396:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000585294c1 nid 12128@kfi7 refs 2
00000400:00000200:7.0:1773851857.407400:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000585294c1 nid 12128@kfi7 refs 3
00000400:00000200:7.0:1773851857.407401:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12128@kfi7 local destination
00000400:00000200:7.0:1773851857.407402:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768737:8768737:1024:4294967295] 12128@kfi7 LPNI seq info [14234132:14234132:16:4294967295]
00000400:00000200:7.0:1773851857.407404:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000585294c1 nid 12128@kfi7 refs 2
00000400:00000200:7.0:1773851857.407404:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12128@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.407407:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12128@kfi7(12128@kfi7:12128@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851857.407408:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000585294c1 nid 12128@kfi7 refs 3
00000800:00000200:7.0:1773851857.407409:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851857.407410:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851857.407413:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851857.407415:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000506 Using peer 12128@kfi7(0x100000000000506)
00000800:00000200:7.0:1773851857.407418:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x100000000000506: rc=0
00000800:00000200:7.0:1773851857.407419:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000506 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851857.407421:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.407422:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cc9c9213 refcount 2 to 12128@kfi7
00010000:00000001:7.0:1773851857.407423:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851857.407424:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.407424:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851857.407425:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dbe9feac x1859598966368192/t0(0) o400->5292b7b9-533d-4f94-92b4-7c8c783359e6@12128@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1248-0'
00000100:00100000:7.0:1773851857.407428:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbe9feac pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5292b7b9-533d-4f94-92b4-7c8c783359e6+3501:39551:x1859598966368192:12345-12128@kfi7:400:default-tuolumne1248-0 Request processed in 64us (93us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851857.407430:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12128@kfi7, seq: 2001862
00000100:00000040:7.0:1773851857.407431:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f9ceab8a : new rpc_count 16
00000800:00000200:5.0:1773851857.407431:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000506 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851857.407432:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851857.407433:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851857.407433:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851857.407433:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12128@kfi7: PUT: OK
00000020:00000010:7.0:1773851857.407434:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851857.407434:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edcc54b1
00000020:00000010:7.0:1773851857.407435:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000020:00000010:7.0:1773851857.407435:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000636d72dc.
00000400:00000010:5.0:1773851857.407435:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edcc54b1.
00000100:00000001:5.0:1773851857.407435:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:7.0:1773851857.407436:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000f9ceab8a : new refcount 3500
00000100:00000001:5.0:1773851857.407436:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851857.407436:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000585294c1 nid 12128@kfi7 refs 2
00000100:00000001:7.0:1773851857.407437:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851857.407438:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12128@kfi7(000000000ba262d0):0x0 lsk 1287 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000506 Transaction freed
00000800:00000200:5.0:1773851857.413731:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.413732:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851857.413733:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851857.413735:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851857.413737:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13937@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.413738:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13937@kfi7 : PUT - for me
00000400:00000200:5.0:1773851857.413738:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13937@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.413739:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087569bad nid 13937@kfi7 refs 1
00000400:00000200:5.0:1773851857.413740:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13937@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.413741:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087569bad nid 13937@kfi7 refs 2
00000400:00000200:5.0:1773851857.413741:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000087569bad nid 13937@kfi7 refs 3
00000400:00000200:5.0:1773851857.413742:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13936@kfi7 to cpt 6
00000400:00000200:5.0:1773851857.413743:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13936@kfi7 of length 224 into portal 12 MB=0x69a9e60eb2ec0
00000400:00000200:5.0:1773851857.413744:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13936@kfi7 of length 224/224 into md 0x793926dc5 [64] + 120936
00000800:00000200:5.0:1773851857.413745:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851857.413747:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851857.413747:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13937@kfi7: PUT: OK
00000100:00000001:5.0:1773851857.413748:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851857.413748:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851857.413750:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bda0e43e.
00000100:00000040:5.0:1773851857.413750:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000bda0e43e x1858854881799872 msgsize 224
00000100:00100000:5.0:1773851857.413751:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13936@kfi7 (source: 12345-13937@kfi7)
00000100:00000001:5.0:1773851857.413752:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851857.413753:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000087569bad nid 13937@kfi7 refs 2
00000100:00000001:7.0:1773851857.413754:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851857.413754:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851857.413754:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851857.413754:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851857.413755:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.413755:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851857.413756:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858854881799872
00000020:00000001:7.0:1773851857.413756:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851857.413757:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92030
00000020:00000001:7.0:1773851857.413757:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851857.413762:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000017bcb8d2 refcount=3925
00000020:00000001:7.0:1773851857.413762:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629262336 : -107123080289280 : ffff9e9276da2400)
00000020:00000001:7.0:1773851857.413763:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629262336 : -107123080289280 : ffff9e9276da2400)
00000100:00000001:7.0:1773851857.413764:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.413765:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851857.413765:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851857.413766:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851857.413767:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851857.413767:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851857.413768:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851857.413768:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.413769:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851857.413770:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851857.413770:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.413771:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.413772:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851857.413772:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851857.413772:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851857.413773:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13936@kfi7, seq: 2001863
00000100:00000040:7.0:1773851857.413773:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000017bcb8d2 : new rpc_count 43
00000100:00000001:5.0:1773851857.413773:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851857.413774:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.413774:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.413775:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637138506162048 : -106935203389568 : ffff9ebe35301f80)
00000100:00000040:7.0:1773851857.413776:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bda0e43e x1858854881799872/t0(0) o400->b12916bb-b658-4598-ba79-b5c5a218c697@13936@kfi7:74/0 lens 224/0 e 0 to 0 dl 1773852189 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1358-0'
00000100:00000001:7.0:1773851857.413778:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.413779:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851857.413779:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bda0e43e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b12916bb-b658-4598-ba79-b5c5a218c697+3925:39673:x1858854881799872:12345-13936@kfi7:400:default-tuolumne1358-0
00000100:00000200:7.0:1773851857.413781:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858854881799872
00000020:00000001:7.0:1773851857.413781:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851857.413782:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851857.413782:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.413783:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851857.413783:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851857.413784:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851857.413784:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858854881799872, found 0 last_xid 1858854880986559
00000020:00000001:7.0:1773851857.413785:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851857.413785:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851857.413786:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851857.413786:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.413787:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851857.413787:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851857.413788:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851857.413788:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003db12eb6.
02000000:00000001:7.0:1773851857.413789:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.413789:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.413790:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851857.413790:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593891, transno 0, xid 1858854881799872
00010000:00000001:7.0:1773851857.413791:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851857.413792:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bda0e43e x1858854881799872/t0(0) o400->b12916bb-b658-4598-ba79-b5c5a218c697@13936@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1358-0'
00010000:00000001:7.0:1773851857.413794:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851857.413794:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851857.413795:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=89 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851857.413796:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851857.413797:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000e65d12e refcount 3 to 13936@kfi7
00000100:00000001:7.0:1773851857.413798:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985418592 : -107156724133024 : ffff9e8aa185d360)
02000000:00000001:7.0:1773851857.413799:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851857.413799:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.413799:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851857.413800:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13937@kfi7
00000400:00000010:7.0:1773851857.413801:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000100:00000200:7.0:1773851857.413801:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858854881799872, offset 224
00000400:00000200:7.0:1773851857.413802:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13937@kfi7
00000400:00000200:7.0:1773851857.413803:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13937@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.413804:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087569bad nid 13937@kfi7 refs 1
00000400:00000200:7.0:1773851857.413805:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000087569bad nid 13937@kfi7 refs 2
00000400:00000200:7.0:1773851857.413806:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000087569bad nid 13937@kfi7 refs 3
00000400:00000200:7.0:1773851857.413807:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13937@kfi7 local destination
00000400:00000200:7.0:1773851857.413808:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768738:8768738:1024:4294967295] 13937@kfi7 LPNI seq info [28308484:28308484:16:4294967295]
00000400:00000200:7.0:1773851857.413809:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000087569bad nid 13937@kfi7 refs 2
00000400:00000200:7.0:1773851857.413810:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13937@kfi7 to cpt 1
00000400:00000200:7.0:1773851857.413812:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13937@kfi7(13937@kfi7:13937@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851857.413813:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000087569bad nid 13937@kfi7 refs 3
00000800:00000200:7.0:1773851857.413814:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851857.413815:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851857.413817:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851857.413819:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fe9 Using peer 13937@kfi7(0x100000000000fe9)
00000800:00000200:7.0:1773851857.413821:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x100000000000fe9: rc=0
00000800:00000200:7.0:1773851857.413822:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fe9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851857.413824:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.413825:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000e65d12e refcount 2 to 13936@kfi7
00010000:00000001:7.0:1773851857.413826:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851857.413826:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851857.413827:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851857.413827:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bda0e43e x1858854881799872/t0(0) o400->b12916bb-b658-4598-ba79-b5c5a218c697@13936@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1358-0'
00000100:00100000:7.0:1773851857.413830:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bda0e43e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b12916bb-b658-4598-ba79-b5c5a218c697+3925:39673:x1858854881799872:12345-13936@kfi7:400:default-tuolumne1358-0 Request processed in 51us (79us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851857.413832:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13936@kfi7, seq: 2001863
00000100:00000040:7.0:1773851857.413832:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000017bcb8d2 : new rpc_count 42
00000100:00000001:7.0:1773851857.413833:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851857.413833:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851857.413834:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851857.413834:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000020:00000010:7.0:1773851857.413835:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000020:00000040:7.0:1773851857.413835:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000017bcb8d2 : new refcount 3924
00000100:00000001:7.0:1773851857.413836:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851857.413836:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fe9 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851857.413837:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851857.413838:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13937@kfi7: PUT: OK
00000400:00000200:5.0:1773851857.413839:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000400:00000010:5.0:1773851857.413839:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:5.0:1773851857.413839:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851857.413840:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851857.413840:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000087569bad nid 13937@kfi7 refs 2
00000800:00000200:5.0:1773851857.413842:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 13937@kfi7(000000002f6aa89d):0x0 lsk 4074 rsk 61 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fe9 Transaction freed
00000800:00000200:14.0:1773851857.436614:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.436614:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851857.436615:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851857.436615:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851857.436616:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851857.436616:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851857.436618:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17184@kfi7(000000003753805e):0xca3 version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851857.436619:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851857.436620:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 Using peer 17184@kfi7(0xca3)
00000400:00000200:14.0:1773851857.436621:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.436622:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17184@kfi7 : PUT - for me
00000400:00000200:13.0:1773851857.436622:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.436623:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000800:00000200:13.0:1773851857.436623:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 38 bytes to peer 0xca3: rc=0
00000400:00000200:14.0:1773851857.436625:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 1
00000800:00000200:13.0:1773851857.436625:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851857.436626:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.436626:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000400:00000200:14.0:1773851857.436628:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 3
00000400:00000200:14.0:1773851857.436629:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17185@kfi7 to cpt 6
00000400:00000200:14.0:1773851857.436630:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17185@kfi7 of length 224 into portal 12 MB=0x69b4b7cb63b80
00000400:00000200:14.0:1773851857.436631:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17185@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 17256
00000800:00000200:14.0:1773851857.436633:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851857.436635:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851857.436635:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17184@kfi7: PUT: OK
00000100:00000001:14.0:1773851857.436636:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:13.0:1773851857.436636:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 TN_EVENT_TX_OK event status 0
00000100:00000200:14.0:1773851857.436637:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851857.436638:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000da229ea2.
00000100:00000040:14.0:1773851857.436639:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000da229ea2 x1859598377433984 msgsize 224
00000800:00000200:13.0:1773851857.436639:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 Transaction freed
00000100:00100000:14.0:1773851857.436640:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-17185@kfi7 (source: 12345-17184@kfi7)
00000100:00000001:14.0:1773851857.436641:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851857.436642:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000800:00000200:14.0:1773851857.436643:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851857.436643:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851857.436643:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851857.436644:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851857.436644:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851857.436645:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851857.436646:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598377433984
00000020:00000001:13.0:1773851857.436646:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851857.436647:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81882
00000020:00000001:13.0:1773851857.436647:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851857.436650:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074aec319 refcount=167
00000020:00000001:13.0:1773851857.436651:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111792243712 : -106961917307904 : ffff9eb7fcea1400)
00000020:00000001:13.0:1773851857.436652:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111792243712 : -106961917307904 : ffff9eb7fcea1400)
00000100:00000001:13.0:1773851857.436653:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.436653:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851857.436654:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851857.436655:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.436655:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851857.436656:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851857.436657:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851857.436657:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.436658:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851857.436658:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851857.436659:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.436659:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.436660:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.436661:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.436661:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851857.436661:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851857.436662:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851857.436662:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17185@kfi7, seq: 2289783
00000100:00000040:13.0:1773851857.436662:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074aec319 : new rpc_count 1
00000100:00000001:15.0:1773851857.436663:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.436663:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341809536 : -106946367742080 : ffff9ebb9bbd9f80)
00000100:00000040:13.0:1773851857.436664:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000da229ea2 x1859598377433984/t0(0) o400->eee653b6-2872-450b-b441-d87a5a423c5a@17185@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1567-0'
00000100:00000001:13.0:1773851857.436669:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.436669:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851857.436670:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da229ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:eee653b6-2872-450b-b441-d87a5a423c5a+167:39595:x1859598377433984:12345-17185@kfi7:400:default-tuolumne1567-0
00000100:00000200:13.0:1773851857.436672:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598377433984
00000020:00000001:13.0:1773851857.436672:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851857.436673:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851857.436673:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.436674:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851857.436674:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851857.436675:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851857.436676:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598377433984, found 0 last_xid 1859598377010815
00000020:00000001:13.0:1773851857.436676:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851857.436677:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851857.436677:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851857.436678:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.436678:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851857.436679:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851857.436679:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851857.436680:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000074aaa0ab.
02000000:00000001:13.0:1773851857.436681:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.436681:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.436682:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851857.436682:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061812, transno 0, xid 1859598377433984
00010000:00000001:13.0:1773851857.436683:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851857.436684:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000da229ea2 x1859598377433984/t0(0) o400->eee653b6-2872-450b-b441-d87a5a423c5a@17185@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1567-0'
00010000:00000001:13.0:1773851857.436686:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851857.436686:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851857.436687:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=90 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851857.436688:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851857.436689:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3d42dea refcount 3 to 17185@kfi7
00000100:00000001:13.0:1773851857.436689:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643689120 : -107157065862496 : ffff9e8a8d2772a0)
02000000:00000001:13.0:1773851857.436690:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851857.436691:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.436691:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851857.436692:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17184@kfi7
00000400:00000010:13.0:1773851857.436693:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070850cc4.
00000100:00000200:13.0:1773851857.436693:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598377433984, offset 224
00000400:00000200:13.0:1773851857.436695:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17184@kfi7
00000400:00000200:13.0:1773851857.436696:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.436697:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 1
00000400:00000200:13.0:1773851857.436698:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000400:00000200:13.0:1773851857.436699:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 3
00000400:00000200:13.0:1773851857.436700:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17184@kfi7 local destination
00000400:00000200:13.0:1773851857.436701:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768739:8768739:1024:4294967295] 17184@kfi7 LPNI seq info [4964064:4964064:16:4294967295]
00000400:00000200:13.0:1773851857.436702:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000400:00000200:13.0:1773851857.436703:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.436705:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17184@kfi7(17184@kfi7:17184@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851857.436706:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 3
00000800:00000200:13.0:1773851857.436707:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.436708:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851857.436710:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851857.436712:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 Using peer 17184@kfi7(0xca3)
00000800:00000200:13.0:1773851857.436714:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 324 bytes to peer 0xca3: rc=0
00000800:00000200:13.0:1773851857.436715:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851857.436717:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.436718:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3d42dea refcount 2 to 17185@kfi7
00010000:00000001:13.0:1773851857.436718:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851857.436719:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.436720:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851857.436720:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000da229ea2 x1859598377433984/t0(0) o400->eee653b6-2872-450b-b441-d87a5a423c5a@17185@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1567-0'
00000100:00100000:13.0:1773851857.436723:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da229ea2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:eee653b6-2872-450b-b441-d87a5a423c5a+167:39595:x1859598377433984:12345-17185@kfi7:400:default-tuolumne1567-0 Request processed in 53us (83us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851857.436728:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17185@kfi7, seq: 2289783
00000100:00000040:13.0:1773851857.436729:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074aec319 : new rpc_count 0
00000100:00000001:13.0:1773851857.436729:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851857.436730:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851857.436730:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:15.0:1773851857.436731:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851857.436731:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000020:00000010:13.0:1773851857.436731:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000020:00000040:13.0:1773851857.436732:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000074aec319 : new refcount 166
00000400:00000200:15.0:1773851857.436733:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851857.436733:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851857.436734:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17184@kfi7: PUT: OK
00000400:00000200:15.0:1773851857.436735:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070850cc4
00000400:00000010:15.0:1773851857.436736:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070850cc4.
00000100:00000001:15.0:1773851857.436737:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851857.436737:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851857.436738:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000800:00000200:15.0:1773851857.436740:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 17184@kfi7(000000003753805e):0x0 lsk 3236 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0xca3 Transaction freed
00000800:00000200:17.0:1773851857.467393:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851857.467394:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851857.467395:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851857.467397:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851857.467398:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12579@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.467399:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12579@kfi7 : PUT - for me
00000400:00000200:17.0:1773851857.467400:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12579@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.467401:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028c900d9 nid 12579@kfi7 refs 1
00000400:00000200:17.0:1773851857.467401:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12579@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.467402:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028c900d9 nid 12579@kfi7 refs 2
00000400:00000200:17.0:1773851857.467403:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000028c900d9 nid 12579@kfi7 refs 3
00000400:00000200:17.0:1773851857.467403:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12578@kfi7 to cpt 1
00000400:00000200:17.0:1773851857.467404:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12578@kfi7 of length 224 into portal 12 MB=0x699e0f3727500
00000400:00000200:17.0:1773851857.467405:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12578@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 191872
00000800:00000200:17.0:1773851857.467407:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851857.467408:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851857.467409:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12579@kfi7: PUT: OK
00000100:00000001:17.0:1773851857.467410:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851857.467410:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851857.467411:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bbb543dc.
00000100:00000040:17.0:1773851857.467412:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bbb543dc x1858041296352512 msgsize 224
00000100:00100000:17.0:1773851857.467414:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12578@kfi7 (source: 12345-12579@kfi7)
00000100:00000001:17.0:1773851857.467414:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851857.467415:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000028c900d9 nid 12579@kfi7 refs 2
00000100:00000001:18.0:1773851857.467416:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851857.467416:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851857.467416:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851857.467417:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851857.467417:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851857.467418:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851857.467418:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041296352512
00000020:00000001:18.0:1773851857.467419:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851857.467419:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a3a
00000020:00000001:18.0:1773851857.467420:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851857.467421:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055c1adde refcount=6
00000020:00000001:18.0:1773851857.467422:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627756032 : -107123081795584 : ffff9e9276c32800)
00000020:00000001:18.0:1773851857.467423:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627756032 : -107123081795584 : ffff9e9276c32800)
00000100:00000001:18.0:1773851857.467424:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.467425:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851857.467425:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2d6dcb1.
00000020:00000010:18.0:1773851857.467426:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851857.467427:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000059dcb8dd.
00000100:00000001:18.0:1773851857.467428:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851857.467428:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851857.467429:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851857.467429:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851857.467430:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851857.467430:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.467431:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851857.467432:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851857.467432:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851857.467432:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851857.467433:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851857.467434:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851857.467434:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12578@kfi7, seq: 2156269
00000100:00000040:18.0:1773851857.467434:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055c1adde : new rpc_count 1
00000100:00000001:19.0:1773851857.467435:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.467435:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764336768 : -107095945214848 : ffff9e98c83a8480)
00000100:00000040:18.0:1773851857.467436:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bbb543dc x1858041296352512/t0(0) o400->05397555-e26d-4a31-a495-c7bba8d69d20@12578@kfi7:47/0 lens 224/0 e 0 to 0 dl 1773852162 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1275-0'
00000100:00000001:18.0:1773851857.467439:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.467439:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851857.467440:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb543dc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:05397555-e26d-4a31-a495-c7bba8d69d20+6:39754:x1858041296352512:12345-12578@kfi7:400:default-tuolumne1275-0
00000100:00000200:18.0:1773851857.467441:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041296352512
00000020:00000001:18.0:1773851857.467442:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851857.467442:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851857.467443:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.467443:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851857.467444:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851857.467444:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851857.467445:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041296352512, found 0 last_xid 1858041296352511
00000020:00000001:18.0:1773851857.467446:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851857.467446:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851857.467447:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851857.467447:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.467448:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851857.467448:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851857.467449:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851857.467450:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fbe5d2bd.
02000000:00000001:18.0:1773851857.467450:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.467451:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.467452:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851857.467452:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096708048, transno 0, xid 1858041296352512
00010000:00000001:18.0:1773851857.467453:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851857.467454:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bbb543dc x1858041296352512/t0(0) o400->05397555-e26d-4a31-a495-c7bba8d69d20@12578@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1275-0'
00010000:00000001:18.0:1773851857.467456:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851857.467456:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851857.467457:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=90 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851857.467458:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851857.467459:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbb61f97 refcount 3 to 12578@kfi7
00000100:00000001:18.0:1773851857.467459:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410080 : -107145304141536 : ffff9e8d4a351120)
02000000:00000001:18.0:1773851857.467460:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851857.467460:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.467461:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851857.467462:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12579@kfi7
00000400:00000010:18.0:1773851857.467462:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e19b4c.
00000100:00000200:18.0:1773851857.467463:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041296352512, offset 224
00000400:00000200:18.0:1773851857.467464:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12579@kfi7
00000400:00000200:18.0:1773851857.467465:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12579@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.467466:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028c900d9 nid 12579@kfi7 refs 1
00000400:00000200:18.0:1773851857.467467:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000028c900d9 nid 12579@kfi7 refs 2
00000400:00000200:18.0:1773851857.467468:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000028c900d9 nid 12579@kfi7 refs 3
00000400:00000200:18.0:1773851857.467469:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12579@kfi7 local destination
00000400:00000200:18.0:1773851857.467470:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768740:8768740:1024:4294967295] 12579@kfi7 LPNI seq info [11998945:11998945:16:4294967295]
00000400:00000200:18.0:1773851857.467472:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000028c900d9 nid 12579@kfi7 refs 2
00000400:00000200:18.0:1773851857.467472:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12579@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.467474:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12579@kfi7(12579@kfi7:12579@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851857.467476:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000028c900d9 nid 12579@kfi7 refs 3
00000800:00000200:18.0:1773851857.467477:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851857.467478:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851857.467480:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851857.467482:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011d6 Using peer 12579@kfi7(0x1000000000011d6)
00000800:00000200:18.0:1773851857.467485:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000582ee624: Posted send of 324 bytes to peer 0x1000000000011d6: rc=0
00000800:00000200:18.0:1773851857.467486:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851857.467488:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851857.467488:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbb61f97 refcount 2 to 12578@kfi7
00010000:00000001:18.0:1773851857.467489:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851857.467490:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.467490:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851857.467491:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bbb543dc x1858041296352512/t0(0) o400->05397555-e26d-4a31-a495-c7bba8d69d20@12578@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1275-0'
00000100:00100000:18.0:1773851857.467494:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb543dc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:05397555-e26d-4a31-a495-c7bba8d69d20+6:39754:x1858041296352512:12345-12578@kfi7:400:default-tuolumne1275-0 Request processed in 54us (81us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851857.467496:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12578@kfi7, seq: 2156269
00000100:00000040:18.0:1773851857.467496:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055c1adde : new rpc_count 0
00000100:00000001:18.0:1773851857.467497:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851857.467497:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851857.467498:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000800:00000200:17.0:1773851857.467498:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011d6 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851857.467499:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000059dcb8dd.
00000020:00000010:18.0:1773851857.467499:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2d6dcb1.
00000400:00000200:17.0:1773851857.467499:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:18.0:1773851857.467500:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000055c1adde : new refcount 5
00000400:00000200:17.0:1773851857.467500:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12579@kfi7: PUT: OK
00000100:00000001:18.0:1773851857.467501:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851857.467501:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e19b4c
00000400:00000010:17.0:1773851857.467501:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e19b4c.
00000100:00000001:17.0:1773851857.467502:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851857.467502:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851857.467503:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000028c900d9 nid 12579@kfi7 refs 2
00000800:00000200:17.0:1773851857.467504:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2054@kfi7:4 -> 12579@kfi7(00000000c6aeede4):0x0 lsk 4567 rsk 56 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011d6 Transaction freed
00000800:00000200:1.0:1773851857.468533:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851857.468534:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851857.468535:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851857.468538:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851857.468540:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15586@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.468541:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15586@kfi7 : PUT - for me
00000400:00000200:1.0:1773851857.468542:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15586@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.468543:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c79b7f6 nid 15586@kfi7 refs 1
00000400:00000200:1.0:1773851857.468544:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15586@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.468545:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c79b7f6 nid 15586@kfi7 refs 2
00000400:00000200:1.0:1773851857.468546:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008c79b7f6 nid 15586@kfi7 refs 3
00000400:00000200:1.0:1773851857.468547:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15395@kfi7 to cpt 1
00000400:00000200:1.0:1773851857.468548:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15395@kfi7 of length 224 into portal 12 MB=0x69b4b58e5c8c0
00000400:00000200:1.0:1773851857.468549:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15395@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 16032
00000800:00000200:1.0:1773851857.468550:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851857.468552:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.468553:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15586@kfi7: PUT: OK
00000100:00000001:1.0:1773851857.468554:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851857.468554:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851857.468555:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a15705e9.
00000100:00000040:1.0:1773851857.468556:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a15705e9 x1859597776570560 msgsize 224
00000100:00100000:1.0:1773851857.468557:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-15395@kfi7 (source: 12345-15586@kfi7)
00000100:00000001:1.0:1773851857.468558:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851857.468559:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008c79b7f6 nid 15586@kfi7 refs 2
00000800:00000200:1.0:1773851857.468560:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851857.468560:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851857.468560:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851857.468561:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851857.468561:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851857.468562:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.468563:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597776570560
00000020:00000001:0.0:1773851857.468563:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851857.468564:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d791bb
00000020:00000001:0.0:1773851857.468565:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851857.468566:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a109b965 refcount=167
00000020:00000001:0.0:1773851857.468567:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636941370255360 : -107132339296256 : ffff9e904ef8e800)
00000020:00000001:0.0:1773851857.468567:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636941370255360 : -107132339296256 : ffff9e904ef8e800)
00000100:00000001:0.0:1773851857.468568:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.468569:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851857.468570:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851857.468571:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.468572:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851857.468572:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851857.468573:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851857.468573:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.468574:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851857.468575:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851857.468575:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.468576:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851857.468577:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851857.468577:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.468578:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851857.468578:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851857.468579:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.468579:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15395@kfi7, seq: 1997504
00000100:00000040:0.0:1773851857.468579:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a109b965 : new rpc_count 1
00000100:00000001:1.0:1773851857.468580:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.468580:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605661568 : -106923103890048 : ffff9ec1065fd580)
00000100:00000040:0.0:1773851857.468581:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a15705e9 x1859597776570560/t0(0) o400->9bb1d57f-ca9a-4ede-9a9f-808d7ee5dbd3@15395@kfi7:497/0 lens 224/0 e 0 to 0 dl 1773852612 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1451-0'
00000100:00000001:0.0:1773851857.468584:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.468584:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851857.468585:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a15705e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9bb1d57f-ca9a-4ede-9a9f-808d7ee5dbd3+167:39465:x1859597776570560:12345-15395@kfi7:400:default-tuolumne1451-0
00000100:00000200:0.0:1773851857.468586:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597776570560
00000020:00000001:0.0:1773851857.468587:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851857.468588:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851857.468588:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.468589:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851857.468590:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851857.468592:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851857.468592:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597776570560, found 0 last_xid 1859597776145599
00000020:00000001:0.0:1773851857.468593:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851857.468594:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851857.468594:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851857.468595:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.468595:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851857.468596:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851857.468596:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851857.468597:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ec7129f9.
02000000:00000001:0.0:1773851857.468598:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.468598:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.468599:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851857.468600:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061879, transno 0, xid 1859597776570560
00010000:00000001:0.0:1773851857.468600:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851857.468601:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a15705e9 x1859597776570560/t0(0) o400->9bb1d57f-ca9a-4ede-9a9f-808d7ee5dbd3@15395@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1451-0'
00010000:00000001:0.0:1773851857.468604:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851857.468604:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851857.468605:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=90 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851857.468606:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851857.468607:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000068d88510 refcount 3 to 15395@kfi7
00000100:00000001:0.0:1773851857.468608:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074950592 : -107155634601024 : ffff9e8ae276c3c0)
02000000:00000001:0.0:1773851857.468608:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851857.468609:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.468610:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851857.468611:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15586@kfi7
00000400:00000010:0.0:1773851857.468611:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a494ee40.
00000100:00000200:0.0:1773851857.468612:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597776570560, offset 224
00000400:00000200:0.0:1773851857.468613:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15586@kfi7
00000400:00000200:0.0:1773851857.468614:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15586@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.468615:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c79b7f6 nid 15586@kfi7 refs 1
00000400:00000200:0.0:1773851857.468616:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008c79b7f6 nid 15586@kfi7 refs 2
00000400:00000200:0.0:1773851857.468617:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008c79b7f6 nid 15586@kfi7 refs 3
00000400:00000200:0.0:1773851857.468619:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15586@kfi7 local destination
00000400:00000200:0.0:1773851857.468620:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768741:8768741:1024:4294967295] 15586@kfi7 LPNI seq info [196487:196487:16:4294967295]
00000400:00000200:0.0:1773851857.468622:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008c79b7f6 nid 15586@kfi7 refs 2
00000400:00000200:0.0:1773851857.468622:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15586@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.468625:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15586@kfi7(15586@kfi7:15586@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851857.468626:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008c79b7f6 nid 15586@kfi7 refs 3
00000800:00000200:0.0:1773851857.468627:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851857.468628:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851857.468630:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851857.468632:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1078 Using peer 15586@kfi7(0x1078)
00000800:00000200:0.0:1773851857.468635:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x1078: rc=0
00000800:00000200:0.0:1773851857.468637:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1078 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851857.468639:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.468640:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000068d88510 refcount 2 to 15395@kfi7
00010000:00000001:0.0:1773851857.468641:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851857.468641:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.468642:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851857.468642:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a15705e9 x1859597776570560/t0(0) o400->9bb1d57f-ca9a-4ede-9a9f-808d7ee5dbd3@15395@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1451-0'
00000100:00100000:0.0:1773851857.468647:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a15705e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9bb1d57f-ca9a-4ede-9a9f-808d7ee5dbd3+167:39465:x1859597776570560:12345-15395@kfi7:400:default-tuolumne1451-0 Request processed in 62us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851857.468649:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15395@kfi7, seq: 1997504
00000100:00000040:0.0:1773851857.468650:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a109b965 : new rpc_count 0
00000100:00000001:0.0:1773851857.468651:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851857.468651:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851857.468652:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.468653:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851857.468654:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851857.468655:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000a109b965 : new refcount 166
00000100:00000001:0.0:1773851857.468656:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851857.468660:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1078 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851857.468662:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.468663:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15586@kfi7: PUT: OK
00000400:00000200:1.0:1773851857.468663:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a494ee40
00000400:00000010:1.0:1773851857.468664:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a494ee40.
00000100:00000001:1.0:1773851857.468665:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851857.468665:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851857.468666:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008c79b7f6 nid 15586@kfi7 refs 2
00000800:00000200:1.0:1773851857.468668:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15586@kfi7(000000009b189fca):0x0 lsk 4217 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1078 Transaction freed
00000800:00000200:1.0:1773851857.546024:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851857.546026:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851857.546027:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851857.546031:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851857.546034:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17264@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.546035:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17264@kfi7 : PUT - for me
00000400:00000200:1.0:1773851857.546037:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17264@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.546039:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000264d6c97 nid 17264@kfi7 refs 1
00000400:00000200:1.0:1773851857.546040:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17264@kfi7 to cpt 0
00000400:00000200:1.0:1773851857.546041:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000264d6c97 nid 17264@kfi7 refs 2
00000400:00000200:1.0:1773851857.546043:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000264d6c97 nid 17264@kfi7 refs 3
00000400:00000200:1.0:1773851857.546044:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17265@kfi7 to cpt 3
00000400:00000200:1.0:1773851857.546045:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17265@kfi7 of length 224 into portal 12 MB=0x69b4b7f79f400
00000400:00000200:1.0:1773851857.546047:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17265@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 16256
00000800:00000200:1.0:1773851857.546050:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851857.546052:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.546054:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17264@kfi7: PUT: OK
00000100:00000001:1.0:1773851857.546055:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851857.546059:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851857.546060:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000da6147fc.
00000100:00000040:1.0:1773851857.546061:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000da6147fc x1859598423815168 msgsize 224
00000100:00100000:1.0:1773851857.546064:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-17265@kfi7 (source: 12345-17264@kfi7)
00000100:00000001:1.0:1773851857.546065:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851857.546066:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000264d6c97 nid 17264@kfi7 refs 2
00000100:00000001:0.0:1773851857.546066:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851857.546067:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851857.546067:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851857.546067:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851857.546068:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851857.546068:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.546069:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598423815168
00000020:00000001:0.0:1773851857.546069:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851857.546069:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80a04
00000020:00000001:0.0:1773851857.546070:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851857.546071:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eecc8659 refcount=5
00000020:00000001:0.0:1773851857.546072:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944059363328 : -107129650188288 : ffff9e90ef417000)
00000020:00000001:0.0:1773851857.546073:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944059363328 : -107129650188288 : ffff9e90ef417000)
00000100:00000001:0.0:1773851857.546074:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.546074:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851857.546075:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851857.546075:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.546076:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851857.546077:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851857.546077:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851857.546078:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.546078:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851857.546079:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851857.546079:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.546080:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.546081:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851857.546081:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851857.546082:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17265@kfi7, seq: 1997505
00000100:00000001:1.0:1773851857.546083:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:0.0:1773851857.546083:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eecc8659 : new rpc_count 1
00000100:00000001:1.0:1773851857.546084:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851857.546084:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.546084:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605655808 : -106923103895808 : ffff9ec1065fbf00)
00000100:00000001:1.0:1773851857.546085:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.546085:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000da6147fc x1859598423815168/t0(0) o400->34372365-9063-4b27-9f49-e23e7261de61@17265@kfi7:497/0 lens 224/0 e 0 to 0 dl 1773852612 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1566-0'
00000100:00000001:0.0:1773851857.546089:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.546089:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851857.546090:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da6147fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:34372365-9063-4b27-9f49-e23e7261de61+5:39701:x1859598423815168:12345-17265@kfi7:400:default-tuolumne1566-0
00000100:00000200:0.0:1773851857.546091:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598423815168
00000020:00000001:0.0:1773851857.546091:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851857.546092:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851857.546092:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.546093:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851857.546093:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851857.546094:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851857.546094:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598423815168, found 0 last_xid 1859598423815167
00000020:00000001:0.0:1773851857.546095:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851857.546096:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851857.546096:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851857.546096:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.546097:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851857.546098:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851857.546098:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851857.546098:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000876d1b44.
02000000:00000001:0.0:1773851857.546099:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.546100:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.546100:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851857.546101:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044120294, transno 0, xid 1859598423815168
00010000:00000001:0.0:1773851857.546101:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851857.546102:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000da6147fc x1859598423815168/t0(0) o400->34372365-9063-4b27-9f49-e23e7261de61@17265@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1566-0'
00010000:00000001:0.0:1773851857.546104:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851857.546105:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851857.546106:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=90 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851857.546107:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851857.546107:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008422eaa1 refcount 3 to 17265@kfi7
00000100:00000001:0.0:1773851857.546108:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621312 : -107151221930304 : ffff9e8be97ac6c0)
02000000:00000001:0.0:1773851857.546109:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851857.546109:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.546110:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851857.546111:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17264@kfi7
00000400:00000010:0.0:1773851857.546111:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f597ead9.
00000100:00000200:0.0:1773851857.546112:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598423815168, offset 224
00000400:00000200:0.0:1773851857.546113:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17264@kfi7
00000400:00000200:0.0:1773851857.546114:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17264@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.546115:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000264d6c97 nid 17264@kfi7 refs 1
00000400:00000200:0.0:1773851857.546116:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000264d6c97 nid 17264@kfi7 refs 2
00000400:00000200:0.0:1773851857.546117:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000264d6c97 nid 17264@kfi7 refs 3
00000400:00000200:0.0:1773851857.546118:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17264@kfi7 local destination
00000400:00000200:0.0:1773851857.546119:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768742:8768742:1024:4294967295] 17264@kfi7 LPNI seq info [8047604:8047604:16:4294967295]
00000400:00000200:0.0:1773851857.546121:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000264d6c97 nid 17264@kfi7 refs 2
00000400:00000200:0.0:1773851857.546121:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17264@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.546123:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17264@kfi7(17264@kfi7:17264@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851857.546124:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000264d6c97 nid 17264@kfi7 refs 3
00000800:00000200:0.0:1773851857.546125:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851857.546126:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851857.546128:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851857.546131:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe4b Using peer 17264@kfi7(0xe4b)
00000800:00000200:0.0:1773851857.546133:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0xe4b: rc=0
00000800:00000200:0.0:1773851857.546135:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe4b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851857.546136:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.546137:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008422eaa1 refcount 2 to 17265@kfi7
00010000:00000001:0.0:1773851857.546138:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851857.546138:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.546139:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851857.546140:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000da6147fc x1859598423815168/t0(0) o400->34372365-9063-4b27-9f49-e23e7261de61@17265@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1566-0'
00000100:00100000:0.0:1773851857.546144:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da6147fc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:34372365-9063-4b27-9f49-e23e7261de61+5:39701:x1859598423815168:12345-17265@kfi7:400:default-tuolumne1566-0 Request processed in 53us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851857.546146:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17265@kfi7, seq: 1997505
00000100:00000040:0.0:1773851857.546147:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eecc8659 : new rpc_count 0
00000100:00000001:0.0:1773851857.546148:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851857.546148:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851857.546148:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.546149:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851857.546150:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851857.546150:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000eecc8659 : new refcount 4
00000100:00000001:0.0:1773851857.546151:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851857.546157:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe4b TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851857.546160:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.546161:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17264@kfi7: PUT: OK
00000400:00000200:1.0:1773851857.546162:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f597ead9
00000400:00000010:1.0:1773851857.546163:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f597ead9.
00000100:00000001:1.0:1773851857.546164:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851857.546165:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851857.546166:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000264d6c97 nid 17264@kfi7 refs 2
00000800:00000200:1.0:1773851857.546168:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17264@kfi7(00000000e6c88d4e):0x0 lsk 3660 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe4b Transaction freed
00000800:00000200:5.0:1773851857.561854:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.561855:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851857.561856:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851857.561857:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851857.561859:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9714@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.561860:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9714@kfi7 : PUT - for me
00000400:00000200:5.0:1773851857.561861:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9714@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.561862:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 1
00000400:00000200:5.0:1773851857.561863:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9714@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.561863:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 2
00000400:00000200:5.0:1773851857.561864:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 3
00000400:00000200:5.0:1773851857.561865:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9715@kfi7 to cpt 4
00000400:00000200:5.0:1773851857.561865:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9715@kfi7 of length 224 into portal 12 MB=0x69b16e49a3080
00000400:00000200:5.0:1773851857.561866:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9715@kfi7 of length 224/224 into md 0x793926dc5 [64] + 121160
00000800:00000200:5.0:1773851857.561868:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851857.561870:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851857.561871:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9714@kfi7: PUT: OK
00000100:00000001:5.0:1773851857.561872:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851857.561872:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851857.561873:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000060c031d4.
00000100:00000040:5.0:1773851857.561873:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000060c031d4 x1859372487159936 msgsize 224
00000100:00100000:5.0:1773851857.561875:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-9715@kfi7 (source: 12345-9714@kfi7)
00000100:00000001:5.0:1773851857.561875:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851857.561876:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 2
00000800:00000200:5.0:1773851857.561877:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851857.561878:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851857.561879:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851857.561880:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851857.561880:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.561882:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851857.561883:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372487159936
00000020:00000001:7.0:1773851857.561884:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851857.561884:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793af84970
00000020:00000001:7.0:1773851857.561885:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851857.561887:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8065620 refcount=5
00000020:00000001:7.0:1773851857.561888:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934553468928 : -107139156082688 : ffff9e8eb8a90000)
00000020:00000001:7.0:1773851857.561889:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934553468928 : -107139156082688 : ffff9e8eb8a90000)
00000100:00000001:7.0:1773851857.561891:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851857.561892:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851857.561893:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851857.561894:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851857.561896:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ade43cf.
00000100:00000001:7.0:1773851857.561897:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851857.561898:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851857.561899:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.561900:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851857.561901:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851857.561902:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.561903:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.561905:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851857.561905:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851857.561905:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851857.561906:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851857.561906:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9715@kfi7, seq: 2001864
00000100:00000001:7.0:1773851857.561907:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851857.561907:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8065620 : new rpc_count 1
00000100:00000001:5.0:1773851857.561908:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637138506163200 : -106935203388416 : ffff9ebe35302400)
00000100:00000001:7.0:1773851857.561909:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851857.561909:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000060c031d4 x1859372487159936/t0(0) o400->75ed033d-bb0f-4f71-b591-4da9a4ac7715@9715@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1081-0'
00000100:00000001:5.0:1773851857.561912:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851857.561912:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851857.561913:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060c031d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:75ed033d-bb0f-4f71-b591-4da9a4ac7715+5:39458:x1859372487159936:12345-9715@kfi7:400:default-tuolumne1081-0
00000100:00000200:5.0:1773851857.561914:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372487159936
00000020:00000001:5.0:1773851857.561915:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851857.561916:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851857.561916:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.561917:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851857.561917:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851857.561918:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851857.561919:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372487159936, found 0 last_xid 1859372487159935
00000020:00000001:5.0:1773851857.561919:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851857.561920:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851857.561920:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851857.561921:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.561924:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851857.561924:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851857.561925:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851857.561926:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000829447ec.
02000000:00000001:5.0:1773851857.561926:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.561927:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.561928:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851857.561928:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180513099102, transno 0, xid 1859372487159936
00010000:00000001:5.0:1773851857.561929:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851857.561930:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000060c031d4 x1859372487159936/t0(0) o400->75ed033d-bb0f-4f71-b591-4da9a4ac7715@9715@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1081-0'
00010000:00000001:5.0:1773851857.561932:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851857.561933:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851857.561933:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=89 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851857.561934:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851857.561935:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000851f11dc refcount 3 to 9715@kfi7
00000100:00000001:5.0:1773851857.561936:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583952512 : -107156125599104 : ffff9e8ac532ba80)
02000000:00000001:5.0:1773851857.561936:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851857.561937:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.561937:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851857.561938:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9714@kfi7
00000400:00000010:5.0:1773851857.561939:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f7632a0.
00000100:00000200:5.0:1773851857.561940:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372487159936, offset 224
00000400:00000200:5.0:1773851857.561941:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9714@kfi7
00000400:00000200:5.0:1773851857.561942:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9714@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.561942:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 1
00000400:00000200:5.0:1773851857.561943:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 2
00000400:00000200:5.0:1773851857.561944:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 3
00000400:00000200:5.0:1773851857.561945:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9714@kfi7 local destination
00000400:00000200:5.0:1773851857.561946:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768743:8768743:1024:4294967295] 9714@kfi7 LPNI seq info [35688:35688:16:4294967295]
00000400:00000200:5.0:1773851857.561948:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 2
00000400:00000200:5.0:1773851857.561948:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9714@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.561950:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9714@kfi7(9714@kfi7:9714@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851857.561952:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 3
00000800:00000200:5.0:1773851857.561953:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.561954:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851857.561956:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851857.561958:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x64 Using peer 9714@kfi7(0x64)
00000800:00000200:5.0:1773851857.561961:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x64: rc=0
00000800:00000200:5.0:1773851857.561962:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x64 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851857.561964:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851857.561965:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000851f11dc refcount 2 to 9715@kfi7
00010000:00000001:5.0:1773851857.561966:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851857.561966:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.561967:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851857.561967:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000060c031d4 x1859372487159936/t0(0) o400->75ed033d-bb0f-4f71-b591-4da9a4ac7715@9715@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1081-0'
00000100:00100000:5.0:1773851857.561970:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060c031d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:75ed033d-bb0f-4f71-b591-4da9a4ac7715+5:39458:x1859372487159936:12345-9715@kfi7:400:default-tuolumne1081-0 Request processed in 57us (96us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851857.561972:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9715@kfi7, seq: 2001864
00000100:00000040:5.0:1773851857.561973:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8065620 : new rpc_count 0
00000100:00000001:5.0:1773851857.561974:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851857.561974:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851857.561975:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:5.0:1773851857.561976:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ade43cf.
00000020:00000010:5.0:1773851857.561977:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000020:00000040:5.0:1773851857.561977:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000a8065620 : new refcount 4
00000100:00000001:5.0:1773851857.561978:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851857.561979:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x64 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851857.561983:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851857.561986:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9714@kfi7: PUT: OK
00000400:00000200:6.0:1773851857.561987:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f7632a0
00000400:00000010:6.0:1773851857.561988:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f7632a0.
00000100:00000001:6.0:1773851857.561989:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851857.561990:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851857.561992:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cfa2a1c7 nid 9714@kfi7 refs 2
00000800:00000200:6.0:1773851857.561994:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 9714@kfi7(000000005bb017ed):0x0 lsk 101 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x64 Transaction freed
00000800:00000200:3.0:1773851857.663159:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851857.663160:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851857.663162:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851857.663163:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851857.663165:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15201@kfi7 to cpt 0
00000400:00000200:3.0:1773851857.663166:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15201@kfi7 : PUT - for me
00000400:00000200:3.0:1773851857.663167:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15201@kfi7 to cpt 0
00000400:00000200:3.0:1773851857.663168:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5235dda nid 15201@kfi7 refs 1
00000400:00000200:3.0:1773851857.663168:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15201@kfi7 to cpt 0
00000400:00000200:3.0:1773851857.663169:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5235dda nid 15201@kfi7 refs 2
00000400:00000200:3.0:1773851857.663170:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b5235dda nid 15201@kfi7 refs 3
00000400:00000200:3.0:1773851857.663171:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15264@kfi7 to cpt 0
00000400:00000200:3.0:1773851857.663171:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15264@kfi7 of length 224 into portal 12 MB=0x699e09ea35c00
00000400:00000200:3.0:1773851857.663173:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15264@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 16480
00000800:00000200:3.0:1773851857.663174:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851857.663176:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851857.663177:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15201@kfi7: PUT: OK
00000100:00000001:3.0:1773851857.663177:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851857.663178:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851857.663179:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c046e6e0.
00000100:00000040:3.0:1773851857.663179:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000c046e6e0 x1858039873494016 msgsize 224
00000100:00100000:3.0:1773851857.663181:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-15264@kfi7 (source: 12345-15201@kfi7)
00000100:00000001:3.0:1773851857.663182:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851857.663182:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b5235dda nid 15201@kfi7 refs 2
00000100:00000001:0.0:1773851857.663183:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:3.0:1773851857.663184:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851857.663184:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851857.663184:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851857.663184:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851857.663185:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851857.663186:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039873494016
00000020:00000001:0.0:1773851857.663186:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851857.663187:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e62
00000020:00000001:0.0:1773851857.663187:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851857.663189:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004fd3dad2 refcount=168
00000020:00000001:0.0:1773851857.663190:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628781056 : -107123080770560 : ffff9e9276d2cc00)
00000020:00000001:0.0:1773851857.663191:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628781056 : -107123080770560 : ffff9e9276d2cc00)
00000100:00000001:0.0:1773851857.663192:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.663193:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851857.663193:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851857.663194:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.663195:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851857.663196:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851857.663196:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851857.663197:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851857.663198:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851857.663198:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851857.663199:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.663200:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851857.663201:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851857.663201:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851857.663202:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851857.663202:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851857.663203:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15264@kfi7, seq: 1997506
00000100:00000040:0.0:1773851857.663203:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004fd3dad2 : new rpc_count 1
00000100:00000001:1.0:1773851857.663204:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851857.663204:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.663204:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288697856 : -106964420853760 : ffff9eb767b10000)
00000100:00000040:0.0:1773851857.663205:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c046e6e0 x1858039873494016/t0(0) o400->f18cc8f4-2a73-4a24-9eb4-c872250ccbf8@15264@kfi7:497/0 lens 224/0 e 0 to 0 dl 1773852612 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1440-0'
00000100:00000001:0.0:1773851857.663208:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851857.663208:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851857.663209:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c046e6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f18cc8f4-2a73-4a24-9eb4-c872250ccbf8+168:39627:x1858039873494016:12345-15264@kfi7:400:default-tuolumne1440-0
00000100:00000200:0.0:1773851857.663210:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039873494016
00000020:00000001:0.0:1773851857.663211:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851857.663212:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851857.663212:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.663213:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851857.663213:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851857.663214:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851857.663215:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039873494016, found 0 last_xid 1858039873068543
00000020:00000001:0.0:1773851857.663216:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851857.663216:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851857.663217:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851857.663217:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.663218:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851857.663218:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851857.663219:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851857.663220:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005ece4e34.
02000000:00000001:0.0:1773851857.663220:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.663221:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.663222:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851857.663223:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061867, transno 0, xid 1858039873494016
00010000:00000001:0.0:1773851857.663224:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851857.663225:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c046e6e0 x1858039873494016/t0(0) o400->f18cc8f4-2a73-4a24-9eb4-c872250ccbf8@15264@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1440-0'
00010000:00000001:0.0:1773851857.663227:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851857.663228:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851857.663228:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=90 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851857.663229:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851857.663230:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000327dcc85 refcount 3 to 15264@kfi7
00000100:00000001:0.0:1773851857.663231:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051008 : -107154804500608 : ffff9e8b13f11780)
02000000:00000001:0.0:1773851857.663232:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851857.663232:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851857.663233:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851857.663234:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15201@kfi7
00000400:00000010:0.0:1773851857.663234:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d94499d6.
00000100:00000200:0.0:1773851857.663235:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039873494016, offset 224
00000400:00000200:0.0:1773851857.663236:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15201@kfi7
00000400:00000200:0.0:1773851857.663237:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15201@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.663238:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5235dda nid 15201@kfi7 refs 1
00000400:00000200:0.0:1773851857.663239:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b5235dda nid 15201@kfi7 refs 2
00000400:00000200:0.0:1773851857.663241:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b5235dda nid 15201@kfi7 refs 3
00000400:00000200:0.0:1773851857.663242:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15201@kfi7 local destination
00000400:00000200:0.0:1773851857.663243:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768744:8768744:1024:4294967295] 15201@kfi7 LPNI seq info [551222:551222:16:4294967295]
00000400:00000200:0.0:1773851857.663244:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b5235dda nid 15201@kfi7 refs 2
00000400:00000200:0.0:1773851857.663245:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15201@kfi7 to cpt 0
00000400:00000200:0.0:1773851857.663247:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15201@kfi7(15201@kfi7:15201@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851857.663249:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b5235dda nid 15201@kfi7 refs 3
00000800:00000200:0.0:1773851857.663250:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851857.663251:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851857.663253:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851857.663256:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaf4 Using peer 15201@kfi7(0xaf4)
00000800:00000200:0.0:1773851857.663259:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0xaf4: rc=0
00000800:00000200:0.0:1773851857.663260:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaf4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851857.663262:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851857.663263:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000327dcc85 refcount 2 to 15264@kfi7
00010000:00000001:0.0:1773851857.663263:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851857.663264:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851857.663265:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851857.663265:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c046e6e0 x1858039873494016/t0(0) o400->f18cc8f4-2a73-4a24-9eb4-c872250ccbf8@15264@kfi7:497/0 lens 224/224 e 0 to 0 dl 1773852612 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1440-0'
00000100:00100000:0.0:1773851857.663270:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c046e6e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f18cc8f4-2a73-4a24-9eb4-c872250ccbf8+168:39627:x1858039873494016:12345-15264@kfi7:400:default-tuolumne1440-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851857.663272:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15264@kfi7, seq: 1997506
00000100:00000040:0.0:1773851857.663273:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004fd3dad2 : new rpc_count 0
00000100:00000001:0.0:1773851857.663273:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851857.663274:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851857.663275:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851857.663275:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851857.663276:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851857.663277:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004fd3dad2 : new refcount 167
00000100:00000001:0.0:1773851857.663277:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851857.663282:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaf4 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851857.663284:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851857.663285:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15201@kfi7: PUT: OK
00000400:00000200:1.0:1773851857.663286:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d94499d6
00000400:00000010:1.0:1773851857.663287:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d94499d6.
00000100:00000001:1.0:1773851857.663288:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851857.663289:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851857.663290:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b5235dda nid 15201@kfi7 refs 2
00000800:00000200:1.0:1773851857.663291:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15201@kfi7(00000000635163ee):0x0 lsk 2805 rsk 52 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaf4 Transaction freed
00000800:00000200:25.0:1773851857.718539:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851857.718540:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851857.718542:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851857.718544:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851857.718547:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17889@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.718549:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17889@kfi7 : PUT - for me
00000400:00000200:25.0:1773851857.718550:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17889@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.718551:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fe7f591 nid 17889@kfi7 refs 1
00000400:00000200:25.0:1773851857.718552:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17889@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.718552:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fe7f591 nid 17889@kfi7 refs 2
00000400:00000200:25.0:1773851857.718554:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003fe7f591 nid 17889@kfi7 refs 3
00000400:00000200:25.0:1773851857.718555:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17889@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.718556:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17889@kfi7 of length 224 into portal 12 MB=0x699e0a30458c0
00000400:00000200:25.0:1773851857.718558:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17889@kfi7 of length 224/224 into md 0x16159c6179 [64] + 183984
00000800:00000200:25.0:1773851857.718560:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851857.718562:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851857.718563:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17889@kfi7: PUT: OK
00000100:00000001:25.0:1773851857.718565:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851857.718565:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851857.718567:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000057d7ec23.
00000100:00000040:25.0:1773851857.718567:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000057d7ec23 x1858039946959040 msgsize 224
00000100:00100000:25.0:1773851857.718569:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17889@kfi7 (source: 12345-17889@kfi7)
00000100:00000001:25.0:1773851857.718570:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851857.718572:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003fe7f591 nid 17889@kfi7 refs 2
00000100:00000001:26.0:1773851857.718574:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851857.718574:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851857.718575:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851857.718576:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851857.718577:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851857.718578:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851857.718579:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039946959040
00000020:00000001:26.0:1773851857.718581:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851857.718581:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922a6
00000020:00000001:26.0:1773851857.718583:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851857.718585:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009b4ec215 refcount=3756
00000020:00000001:26.0:1773851857.718586:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630019072 : -107123079532544 : ffff9e9276e5b000)
00000020:00000001:26.0:1773851857.718588:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630019072 : -107123079532544 : ffff9e9276e5b000)
00000100:00000001:26.0:1773851857.718589:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851857.718591:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851857.718592:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:26.0:1773851857.718594:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851857.718595:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000001:26.0:1773851857.718597:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851857.718598:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851857.718599:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851857.718600:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851857.718601:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851857.718602:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.718604:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851857.718606:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851857.718607:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851857.718607:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851857.718608:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851857.718609:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17889@kfi7, seq: 2025057
00000100:00000040:26.0:1773851857.718611:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009b4ec215 : new rpc_count 14
00000100:00000001:24.0:1773851857.718611:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.718612:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023482843648 : -107050226707968 : ffff9ea36d439200)
00000100:00000001:24.0:1773851857.718612:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.718615:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000057d7ec23 x1858039946959040/t0(0) o400->c35a8c5b-aa0d-4a22-9eb6-09f250de07a7@17889@kfi7:74/0 lens 224/0 e 0 to 0 dl 1773852189 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1599-0'
00000100:00000001:26.0:1773851857.718620:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851857.718620:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851857.718622:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000057d7ec23 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c35a8c5b-aa0d-4a22-9eb6-09f250de07a7+3756:39700:x1858039946959040:12345-17889@kfi7:400:default-tuolumne1599-0
00000100:00000200:26.0:1773851857.718625:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039946959040
00000020:00000001:26.0:1773851857.718626:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851857.718627:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851857.718628:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.718629:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851857.718630:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851857.718632:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851857.718633:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039946959040, found 0 last_xid 1858039946215935
00000020:00000001:26.0:1773851857.718635:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851857.718636:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851857.718637:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851857.718637:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.718638:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851857.718639:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851857.718640:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851857.718640:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007e903d1e.
02000000:00000001:26.0:1773851857.718641:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.718642:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.718643:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851857.718644:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592961, transno 0, xid 1858039946959040
00010000:00000001:26.0:1773851857.718645:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851857.718646:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000057d7ec23 x1858039946959040/t0(0) o400->c35a8c5b-aa0d-4a22-9eb6-09f250de07a7@17889@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1599-0'
00010000:00000001:26.0:1773851857.718649:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851857.718650:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851857.718650:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=90 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851857.718652:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851857.718653:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000be0efdff refcount 3 to 17889@kfi7
00000100:00000001:26.0:1773851857.718653:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329088 : -107155410222528 : ffff9e8aefd68240)
02000000:00000001:26.0:1773851857.718655:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851857.718655:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.718656:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851857.718657:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17889@kfi7
00000400:00000010:26.0:1773851857.718658:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057e36a8a.
00000100:00000200:26.0:1773851857.718659:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039946959040, offset 224
00000400:00000200:26.0:1773851857.718661:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17889@kfi7
00000400:00000200:26.0:1773851857.718662:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17889@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.718663:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fe7f591 nid 17889@kfi7 refs 1
00000400:00000200:26.0:1773851857.718664:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003fe7f591 nid 17889@kfi7 refs 2
00000400:00000200:26.0:1773851857.718666:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003fe7f591 nid 17889@kfi7 refs 3
00000400:00000200:26.0:1773851857.718668:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17889@kfi7 local destination
00000400:00000200:26.0:1773851857.718670:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768745:8768745:1024:4294967295] 17889@kfi7 LPNI seq info [6044214:6044214:16:4294967295]
00000400:00000200:26.0:1773851857.718671:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003fe7f591 nid 17889@kfi7 refs 2
00000400:00000200:26.0:1773851857.718672:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17889@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.718675:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17889@kfi7(17889@kfi7:17889@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851857.718676:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003fe7f591 nid 17889@kfi7 refs 3
00000800:00000200:26.0:1773851857.718678:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851857.718679:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851857.718682:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851857.718684:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007f6 Using peer 17889@kfi7(0x1000000000007f6)
00000800:00000200:26.0:1773851857.718688:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x1000000000007f6: rc=0
00000800:00000200:26.0:1773851857.718689:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007f6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851857.718692:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.718693:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000be0efdff refcount 2 to 17889@kfi7
00010000:00000001:26.0:1773851857.718694:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851857.718694:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.718695:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851857.718696:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000057d7ec23 x1858039946959040/t0(0) o400->c35a8c5b-aa0d-4a22-9eb6-09f250de07a7@17889@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1599-0'
00000100:00100000:26.0:1773851857.718700:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000057d7ec23 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c35a8c5b-aa0d-4a22-9eb6-09f250de07a7+3756:39700:x1858039946959040:12345-17889@kfi7:400:default-tuolumne1599-0 Request processed in 79us (131us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851857.718702:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17889@kfi7, seq: 2025057
00000800:00000200:25.0:1773851857.718702:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007f6 TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851857.718703:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009b4ec215 : new rpc_count 13
00000100:00000001:26.0:1773851857.718704:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851857.718704:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851857.718705:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851857.718706:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17889@kfi7: PUT: OK
00000020:00000010:26.0:1773851857.718707:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851857.718707:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057e36a8a
00000400:00000010:25.0:1773851857.718707:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057e36a8a.
00000020:00000010:26.0:1773851857.718708:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000100:00000001:25.0:1773851857.718708:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851857.718708:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:26.0:1773851857.718709:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000400:00000200:25.0:1773851857.718709:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003fe7f591 nid 17889@kfi7 refs 2
00000020:00000040:26.0:1773851857.718710:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000009b4ec215 : new refcount 3755
00000100:00000001:26.0:1773851857.718710:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851857.718711:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 17889@kfi7(0000000049de9753):0x0 lsk 2039 rsk 56 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007f6 Transaction freed
00000800:00000200:14.0:1773851857.733785:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851857.733786:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851857.733787:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851857.733790:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851857.733791:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14977@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.733793:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14977@kfi7 : PUT - for me
00000400:00000200:14.0:1773851857.733794:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14977@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.733795:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000592d7993 nid 14977@kfi7 refs 1
00000400:00000200:14.0:1773851857.733796:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14977@kfi7 to cpt 3
00000400:00000200:14.0:1773851857.733797:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000592d7993 nid 14977@kfi7 refs 2
00000400:00000200:14.0:1773851857.733797:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000592d7993 nid 14977@kfi7 refs 3
00000400:00000200:14.0:1773851857.733798:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14912@kfi7 to cpt 5
00000400:00000200:14.0:1773851857.733800:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14912@kfi7 of length 224 into portal 12 MB=0x69b4b5e745b00
00000400:00000200:14.0:1773851857.733801:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14912@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 17480
00000800:00000200:14.0:1773851857.733803:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851857.733804:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851857.733806:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14977@kfi7: PUT: OK
00000100:00000001:14.0:1773851857.733807:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851857.733807:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851857.733808:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d82b51a8.
00000100:00000040:14.0:1773851857.733809:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000d82b51a8 x1859597869800192 msgsize 224
00000100:00100000:14.0:1773851857.733810:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-14912@kfi7 (source: 12345-14977@kfi7)
00000100:00000001:14.0:1773851857.733811:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851857.733812:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000592d7993 nid 14977@kfi7 refs 2
00000800:00000200:14.0:1773851857.733813:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e70f539d: 2069@kfi7:3 <- 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851857.733813:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851857.733814:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851857.733814:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851857.733814:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851857.733815:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851857.733816:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597869800192
00000020:00000001:13.0:1773851857.733816:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851857.733817:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80940
00000020:00000001:13.0:1773851857.733817:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851857.733820:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000061909358 refcount=169
00000020:00000001:13.0:1773851857.733820:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637059659981824 : -107014049569792 : ffff9eabd996e400)
00000020:00000001:13.0:1773851857.733821:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637059659981824 : -107014049569792 : ffff9eabd996e400)
00000100:00000001:13.0:1773851857.733822:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.733823:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851857.733823:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851857.733824:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.733825:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851857.733826:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851857.733829:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851857.733830:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.733830:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851857.733831:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851857.733831:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.733832:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.733833:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.733834:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851857.733834:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851857.733834:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851857.733835:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14912@kfi7, seq: 2289784
00000100:00000001:15.0:1773851857.733836:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851857.733836:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.733836:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000061909358 : new rpc_count 1
00000100:00000001:13.0:1773851857.733837:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341802624 : -106946367748992 : ffff9ebb9bbd8480)
00000100:00000040:13.0:1773851857.733838:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d82b51a8 x1859597869800192/t0(0) o400->4edc44b4-2aeb-4b04-9fcc-a1cebb66d421@14912@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1428-0'
00000100:00000001:13.0:1773851857.733841:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.733841:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851857.733842:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d82b51a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:4edc44b4-2aeb-4b04-9fcc-a1cebb66d421+169:39577:x1859597869800192:12345-14912@kfi7:400:default-tuolumne1428-0
00000100:00000200:13.0:1773851857.733843:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597869800192
00000020:00000001:13.0:1773851857.733844:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851857.733845:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851857.733845:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.733846:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851857.733847:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851857.733847:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851857.733848:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597869800192, found 0 last_xid 1859597869375551
00000020:00000001:13.0:1773851857.733849:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851857.733849:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851857.733850:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851857.733851:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.733851:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851857.733852:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851857.733852:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851857.733853:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000037976a3a.
02000000:00000001:13.0:1773851857.733854:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.733855:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.733855:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851857.733856:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063401, transno 0, xid 1859597869800192
00010000:00000001:13.0:1773851857.733857:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851857.733858:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d82b51a8 x1859597869800192/t0(0) o400->4edc44b4-2aeb-4b04-9fcc-a1cebb66d421@14912@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1428-0'
00010000:00000001:13.0:1773851857.733860:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851857.733861:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851857.733861:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=90 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851857.733862:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851857.733863:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000079355fac refcount 3 to 14912@kfi7
00000100:00000001:13.0:1773851857.733864:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106784 : -107156354444832 : ffff9e8ab78ed1e0)
02000000:00000001:13.0:1773851857.733864:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851857.733865:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.733866:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851857.733867:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14977@kfi7
00000400:00000010:13.0:1773851857.733867:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008964c408.
00000100:00000200:13.0:1773851857.733868:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597869800192, offset 224
00000400:00000200:13.0:1773851857.733869:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14977@kfi7
00000400:00000200:13.0:1773851857.733870:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14977@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.733871:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000592d7993 nid 14977@kfi7 refs 1
00000400:00000200:13.0:1773851857.733872:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000592d7993 nid 14977@kfi7 refs 2
00000400:00000200:13.0:1773851857.733873:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000592d7993 nid 14977@kfi7 refs 3
00000400:00000200:13.0:1773851857.733874:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14977@kfi7 local destination
00000400:00000200:13.0:1773851857.733876:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768746:8768746:1024:4294967295] 14977@kfi7 LPNI seq info [559167:559167:16:4294967295]
00000400:00000200:13.0:1773851857.733877:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000592d7993 nid 14977@kfi7 refs 2
00000400:00000200:13.0:1773851857.733878:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14977@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.733880:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14977@kfi7(14977@kfi7:14977@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851857.733881:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000592d7993 nid 14977@kfi7 refs 3
00000800:00000200:13.0:1773851857.733882:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.733883:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851857.733887:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851857.733890:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x717 Using peer 14977@kfi7(0x717)
00000800:00000200:13.0:1773851857.733893:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 324 bytes to peer 0x717: rc=0
00000800:00000200:13.0:1773851857.733895:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x717 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851857.733897:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.733898:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000079355fac refcount 2 to 14912@kfi7
00010000:00000001:13.0:1773851857.733899:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851857.733899:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.733900:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851857.733901:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d82b51a8 x1859597869800192/t0(0) o400->4edc44b4-2aeb-4b04-9fcc-a1cebb66d421@14912@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1428-0'
00000100:00100000:13.0:1773851857.733904:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d82b51a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:4edc44b4-2aeb-4b04-9fcc-a1cebb66d421+169:39577:x1859597869800192:12345-14912@kfi7:400:default-tuolumne1428-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851857.733906:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14912@kfi7, seq: 2289784
00000800:00000200:14.0:1773851857.733907:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x717 TN_EVENT_TX_OK event status 0
00000100:00000040:13.0:1773851857.733907:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000061909358 : new rpc_count 0
00000100:00000001:13.0:1773851857.733908:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851857.733908:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851857.733909:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851857.733909:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.733909:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000400:00000200:14.0:1773851857.733910:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14977@kfi7: PUT: OK
00000020:00000010:13.0:1773851857.733910:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000400:00000200:14.0:1773851857.733911:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008964c408
00000400:00000010:14.0:1773851857.733911:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008964c408.
00000020:00000040:13.0:1773851857.733911:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000061909358 : new refcount 168
00000100:00000001:14.0:1773851857.733912:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851857.733912:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851857.733913:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851857.733913:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000592d7993 nid 14977@kfi7 refs 2
00000800:00000200:14.0:1773851857.733915:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 14977@kfi7(000000009f07a36d):0x0 lsk 1816 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x717 Transaction freed
00000004:00000001:30.0:1773851857.737732:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:31.0:1773851857.737733:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851857.737733:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:6.0:1773851857.737733:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851857.737733:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851857.737734:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851857.737734:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061cdc96b.
00000020:00000040:30.0:1773851857.737734:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000004:00000001:10.0:1773851857.737734:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:9.0:1773851857.737734:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851857.737734:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851857.737734:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:5.0:1773851857.737734:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:31.0:1773851857.737735:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c01b7c03.
00000004:00000020:10.0:1773851857.737735:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:9.0:1773851857.737735:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:7.0:1773851857.737735:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851857.737735:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f81cec73.
00000100:00000010:6.0:1773851857.737735:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e16d771b.
00000100:00000010:5.0:1773851857.737735:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000053aa084a.
00000100:00000001:30.0:1773851857.737736:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851857.737736:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:10.0:1773851857.737736:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f2d41e54.
00000100:00000010:9.0:1773851857.737736:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000659d5d18.
00000020:00000040:7.0:1773851857.737736:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851857.737736:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000020:00000040:5.0:1773851857.737736:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
00000020:00000040:31.0:1773851857.737737:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
02000000:00000001:30.0:1773851857.737737:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851857.737737:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000020:00000040:9.0:1773851857.737737:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000100:00000001:7.0:1773851857.737737:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851857.737737:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851857.737737:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:31.0:1773851857.737738:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:30.0:1773851857.737738:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ce3b9347.
00000100:00000001:10.0:1773851857.737738:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851857.737738:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:9.0:1773851857.737738:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851857.737738:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851857.737738:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851857.737738:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:31.0:1773851857.737739:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851857.737739:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851857.737739:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:10.0:1773851857.737739:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851857.737739:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851857.737739:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851857.737739:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851857.737739:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851857.737740:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851857.737740:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851857.737740:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851857.737740:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006f706ecc.
02000000:00000010:5.0:1773851857.737740:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000100f702c.
00000100:00000040:30.0:1773851857.737741:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000061cdc96b] to pc [ptlrpcd_07_02+2]  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:10.0:1773851857.737741:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000009c52eb5f.
02000000:00000010:9.0:1773851857.737741:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
00000100:00000001:7.0:1773851857.737741:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851857.737741:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006fe63e6d.
00000100:00000001:5.0:1773851857.737741:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851857.737742:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000012eaad24.
00000100:00000001:10.0:1773851857.737742:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851857.737742:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.737742:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851857.737742:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851857.737742:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.737742:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:31.0:1773851857.737743:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851857.737743:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851857.737743:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851857.737743:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851857.737744:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851857.737744:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851857.737744:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851857.737744:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.737744:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f81cec73] to pc [ptlrpcd_01_02+2]  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851857.737744:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851857.737744:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000053aa084a] to pc [ptlrpcd_01_03+3]  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851857.737745:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851857.737745:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f2d41e54] to pc [ptlrpcd_02_00+0]  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851857.737745:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000659d5d18] to pc [ptlrpcd_02_01+1]  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851857.737745:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e16d771b] to pc [ptlrpcd_01_00+0]  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851857.737746:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c01b7c03] to pc [ptlrpcd_07_03+3]  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:30.0:1773851857.737746:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.737746:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851857.737747:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851857.737747:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851857.737747:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851857.737748:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851857.737748:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851857.737748:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851857.737748:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:5.0:1773851857.737749:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000570b570c.
00080000:00000001:31.0:1773851857.737750:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:29.0:1773851857.737750:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:10.0:1773851857.737750:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:9.0:1773851857.737750:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:5.0:1773851857.737750:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130419050496 : -106943290501120 : ffff9ebc53289800)
00000100:00000001:4.0:1773851857.737750:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:31.0:1773851857.737751:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000022fc6104.
00080000:00000001:31.0:1773851857.737751:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130098349056 : -106943611202560 : ffff9ebc400b1400)
00000100:00000001:29.0:1773851857.737751:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851857.737751:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851857.737751:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:10.0:1773851857.737751:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000907c4da0.
00080000:00000010:9.0:1773851857.737751:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e50c3955.
00000100:00000001:8.0:1773851857.737751:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:6.0:1773851857.737751:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851857.737751:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851857.737751:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851857.737751:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851857.737752:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:28.0:1773851857.737752:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737752:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851857.737752:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:10.0:1773851857.737752:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636935375688704 : -107138333862912 : ffff9e8ee9ab1400)
00080000:00000001:9.0:1773851857.737752:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121297526784 : -106952412024832 : ffff9eba33793000)
00000100:00000001:8.0:1773851857.737752:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851857.737752:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:7.0:1773851857.737752:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851857.737752:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851857.737752:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851857.737753:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:28.0:1773851857.737753:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851857.737753:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851857.737753:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:9.0:1773851857.737753:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851857.737753:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:5.0:1773851857.737753:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000100:00000040:4.0:1773851857.737753:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851857.737754:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:31.0:1773851857.737754:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000040:29.0:1773851857.737754:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:28.0:1773851857.737754:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051924160:13@kfi7:41:default-yuba2-0
00000100:00000040:11.0:1773851857.737754:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851857.737754:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851857.737754:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851857.737754:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851857.737754:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:5.0:1773851857.737754:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000197f651e.
00000004:00080000:5.0:1773851857.737754:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614132191030047ns, next at 614133191028975ns, rc = 0
00000004:00000010:31.0:1773851857.737755:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003ed318c4.
00000004:00001000:10.0:1773851857.737755:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00000004:00001000:9.0:1773851857.737755:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:6.0:1773851857.737755:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:6.0:1773851857.737755:0:41065:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:4.0:1773851857.737755:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:31.0:1773851857.737756:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614132191031690ns, next at 614133191030437ns, rc = 0
00000100:00000001:28.0:1773851857.737756:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851857.737756:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000010:9.0:1773851857.737756:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000634df95a.
00000100:00000001:6.0:1773851857.737756:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:5.0:1773851857.737756:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:5.0:1773851857.737756:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737756:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851857.737757:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:28.0:1773851857.737757:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737757:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851857.737757:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:10.0:1773851857.737757:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000e35028cc.
00000100:00000001:7.0:1773851857.737757:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851857.737757:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851857.737757:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851857.737757:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851857.737757:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851857.737758:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851857.737758:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:28.0:1773851857.737758:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001529c0f6.
02000000:00000001:11.0:1773851857.737758:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:10.0:1773851857.737758:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614132191033393ns, next at 614133191032000ns, rc = 0
02000000:00000001:7.0:1773851857.737758:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851857.737758:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851857.737758:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851857.737758:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851857.737758:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:4.0:1773851857.737758:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f81cec73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051924288:2074@kfi7:41:default-yuba2-0
00000004:00000001:31.0:1773851857.737759:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851857.737759:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:28.0:1773851857.737759:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851857.737759:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851857.737759:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:8.0:1773851857.737759:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00100000:7.0:1773851857.737759:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000053aa084a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051924224:2061@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851857.737759:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851857.737759:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851857.737759:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:5.0:1773851857.737759:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737759:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:29.0:1773851857.737760:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851857.737760:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00100000:11.0:1773851857.737760:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f2d41e54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051924416:37@kfi7:13:default-yuba2-0
00080000:00000001:10.0:1773851857.737760:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851857.737760:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737760:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.737760:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851857.737760:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851857.737761:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:28.0:1773851857.737761:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
02000000:00000001:8.0:1773851857.737761:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.737761:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851857.737761:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:6.0:1773851857.737761:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851857.737761:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851857.737761:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851857.737762:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:28.0:1773851857.737762:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081660f45.
00000100:00000001:11.0:1773851857.737762:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:11.0:1773851857.737762:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00100000:8.0:1773851857.737762:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000659d5d18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051924480:2060@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851857.737762:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.737762:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851857.737762:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007e3989c4.
00000100:00100000:29.0:1773851857.737763:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c01b7c03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051924544:60@kfi7:13:default-yuba2-0
00000100:00000200:28.0:1773851857.737763:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924160, portal 4
02000000:00000001:11.0:1773851857.737763:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737763:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851857.737763:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:7.0:1773851857.737763:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f3f77d39.
02000000:00000001:4.0:1773851857.737763:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851857.737764:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:28.0:1773851857.737764:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851857.737764:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832828032 : -106933876723584 : ffff9ebe84437080)
02000000:00000001:11.0:1773851857.737764:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851857.737764:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.737764:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:7.0:1773851857.737764:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851857.737764:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:6.0:1773851857.737764:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851857.737764:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851857.737764:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000010:4.0:1773851857.737764:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
02000000:00000001:29.0:1773851857.737765:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851857.737765:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851857.737765:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b91a248b.
02000000:00000001:11.0:1773851857.737765:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851857.737765:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000001f164fb.
02000000:00000001:8.0:1773851857.737765:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851857.737765:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
02000000:00000001:6.0:1773851857.737765:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:4.0:1773851857.737765:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
02000000:00000001:29.0:1773851857.737766:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:28.0:1773851857.737766:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851857.737766:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000004:00080000:9.0:1773851857.737766:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614132191042059ns, next at 614133191031139ns, rc = 0
00000400:00000010:7.0:1773851857.737766:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a1436362.
00000100:00000200:7.0:1773851857.737766:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924224, portal 4
02000000:00000001:6.0:1773851857.737766:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851857.737766:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924288, portal 4
02000000:00000010:29.0:1773851857.737767:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006ab5167d.
02000000:00000001:29.0:1773851857.737767:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851857.737767:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00080000:00000001:9.0:1773851857.737767:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:8.0:1773851857.737767:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:7.0:1773851857.737767:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00100000:6.0:1773851857.737767:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e16d771b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051924352:36@kfi7:13:default-yuba2-0
00000400:00000200:29.0:1773851857.737768:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00080000:00000001:9.0:1773851857.737768:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851857.737768:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000100:00000001:7.0:1773851857.737768:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636984866939904 : -107088842611712 : ffff9e9a6f93a400)
00000100:00000001:6.0:1773851857.737768:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:4.0:1773851857.737768:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851857.737768:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309151232 : -106994400400384 : ffff9eb06cc56c00)
00000400:00000010:29.0:1773851857.737769:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000060a59eec.
00000100:00000001:28.0:1773851857.737769:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:11.0:1773851857.737769:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d7cd332.
00000004:00000001:9.0:1773851857.737769:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851857.737769:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000100:00000040:7.0:1773851857.737769:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851857.737769:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851857.737769:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851857.737769:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:29.0:1773851857.737770:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000004015b2d.
00000100:00000040:28.0:1773851857.737770:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:28.0:1773851857.737770:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d36e974.
00000100:00000200:11.0:1773851857.737770:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924416, portal 4
00000100:00000200:8.0:1773851857.737770:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924480, portal 4
02000000:00000001:6.0:1773851857.737770:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:29.0:1773851857.737771:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924544, portal 4
00000100:00000001:11.0:1773851857.737771:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851857.737771:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077429248 : -106968632122368 : ffff9eb66cae2400)
00000100:00000001:8.0:1773851857.737771:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851857.737771:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637090064862592 : -106983644689024 : ffff9eb2eddc8d80)
02000000:00000010:6.0:1773851857.737771:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ecbfdd48.
00000100:00000001:29.0:1773851857.737772:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:28.0:1773851857.737772:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051924160, offset 0
00000100:00000040:11.0:1773851857.737772:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851857.737772:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851857.737772:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:6.0:1773851857.737772:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737772:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851857.737772:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000100:00000001:29.0:1773851857.737773:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637159395564288 : -106914313987328 : ffff9ec3124b1b00)
00000400:00000200:28.0:1773851857.737773:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000100:00000040:7.0:1773851857.737773:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:7.0:1773851857.737773:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012c6c860.
00000400:00000200:6.0:1773851857.737773:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:6.0:1773851857.737773:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000400:00000010:4.0:1773851857.737773:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e586845a.
00000100:00000040:29.0:1773851857.737774:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851857.737774:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000200:7.0:1773851857.737774:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924224, offset 0
00000400:00000010:6.0:1773851857.737774:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4270b1f.
00000100:00000200:4.0:1773851857.737774:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051924288, offset 0
00000400:00000200:28.0:1773851857.737775:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000001:11.0:1773851857.737775:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851857.737775:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851857.737775:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000100:00000001:29.0:1773851857.737776:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:28.0:1773851857.737776:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000040:11.0:1773851857.737776:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000400:00000010:11.0:1773851857.737776:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005f852466.
00000100:00000040:8.0:1773851857.737776:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:8.0:1773851857.737776:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b95ec19a.
00000400:00000200:7.0:1773851857.737776:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000100:00000200:6.0:1773851857.737776:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924352, portal 4
00000400:00000200:4.0:1773851857.737776:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000200:11.0:1773851857.737777:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924416, offset 0
00000100:00000200:8.0:1773851857.737777:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924480, offset 0
00000100:00000001:6.0:1773851857.737777:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851857.737777:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637093953697024 : -106979755854592 : ffff9eb3d5a77500)
00000400:00000200:4.0:1773851857.737777:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000100:00000040:29.0:1773851857.737778:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000400:00000010:29.0:1773851857.737778:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000906c4b9a.
00000400:00000200:28.0:1773851857.737778:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:8.0:1773851857.737778:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000200:4.0:1773851857.737778:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000200:29.0:1773851857.737779:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924544, offset 0
00000400:00000200:28.0:1773851857.737779:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:11.0:1773851857.737779:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000400:00000200:8.0:1773851857.737779:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000040:6.0:1773851857.737779:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851857.737779:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851857.737780:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:8.0:1773851857.737780:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:28.0:1773851857.737781:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768746, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768745, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851857.737781:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:6.0:1773851857.737781:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851857.737781:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000100:00000040:6.0:1773851857.737782:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000200:4.0:1773851857.737782:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768746, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768745, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851857.737783:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851857.737783:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:8.0:1773851857.737783:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000010:6.0:1773851857.737783:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047456fe2.
00000400:00000200:28.0:1773851857.737784:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000200:6.0:1773851857.737784:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924352, offset 0
00000400:00000200:4.0:1773851857.737784:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851857.737785:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851857.737785:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768746, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768745, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851857.737785:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:4.0:1773851857.737785:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851857.737786:0:41090:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133311, 23133310]
00000400:00000200:8.0:1773851857.737787:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851857.737787:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851857.737788:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000400:00000200:8.0:1773851857.737788:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851857.737788:0:41066:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425162, 23425161]
00000400:00000200:28.0:1773851857.737789:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768747:8768747:1024:4294967295] 13@kfi7 LPNI seq info [23133312:23133312:16:4294967295]
00000400:00000200:8.0:1773851857.737789:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000400:00000200:28.0:1773851857.737790:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:4.0:1773851857.737790:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000400:00000200:8.0:1773851857.737791:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768749:8768749:1024:4294967295] 2060@kfi7 LPNI seq info [5404991:5404991:16:4294967295]
00000400:00000200:4.0:1773851857.737791:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768749:8768749:1024:4294967295] 2081@kfi7 LPNI seq info [23425163:23425163:16:4294967295]
00000400:00000200:28.0:1773851857.737792:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:29.0:1773851857.737793:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:8.0:1773851857.737793:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:4.0:1773851857.737793:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:29.0:1773851857.737794:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:28.0:1773851857.737794:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851857.737794:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:4.0:1773851857.737794:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:29.0:1773851857.737795:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:28.0:1773851857.737795:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:11.0:1773851857.737795:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851857.737795:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.737796:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:11.0:1773851857.737796:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:7.0:1773851857.737796:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000800:00000200:28.0:1773851857.737797:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:11.0:1773851857.737797:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:8.0:1773851857.737797:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851857.737798:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:7.0:1773851857.737798:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:28.0:1773851857.737799:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851857.737799:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:8.0:1773851857.737799:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:29.0:1773851857.737800:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768746, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8768749, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851857.737800:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000400:00000200:7.0:1773851857.737800:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:4.0:1773851857.737800:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000800:00000200:28.0:1773851857.737801:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851857.737801:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:7.0:1773851857.737801:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000400:00000200:29.0:1773851857.737802:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:11.0:1773851857.737802:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768746, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8768749, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851857.737802:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851857.737802:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:7.0:1773851857.737803:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768746, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8768749, p:4294967295, g:4294967295, h:1000]
00000800:00000200:4.0:1773851857.737803:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:29.0:1773851857.737804:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:28.0:1773851857.737804:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c Using peer 13@kfi7(0x20000000000095c)
00000400:00000200:29.0:1773851857.737805:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:11.0:1773851857.737805:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:8.0:1773851857.737805:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851857.737805:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:4.0:1773851857.737805:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851857.737806:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768750:8768750:1024:4294967295] 60@kfi7 LPNI seq info [5404306:5404306:16:4294967295]
00000400:00000200:11.0:1773851857.737806:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851857.737806:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:28.0:1773851857.737807:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x20000000000095c: rc=0
00000400:00000200:11.0:1773851857.737807:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000800:00000200:8.0:1773851857.737807:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Using peer 2060@kfi7(0x2000000000001c1)
00000400:00000200:7.0:1773851857.737807:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000800:00000200:4.0:1773851857.737807:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851857.737808:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851857.737808:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768751:8768751:1024:4294967295] 37@kfi7 LPNI seq info [5403391:5403391:16:4294967295]
00000400:00000200:7.0:1773851857.737808:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768751:8768751:1024:4294967295] 2061@kfi7 LPNI seq info [5403457:5403457:16:4294967295]
00000400:00000200:29.0:1773851857.737809:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:28.0:1773851857.737809:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:7.0:1773851857.737809:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:4.0:1773851857.737809:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 Using peer 2081@kfi7(0x200000000000275)
00000400:00000200:11.0:1773851857.737810:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000800:00000200:8.0:1773851857.737810:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x2000000000001c1: rc=0
00000100:00000001:28.0:1773851857.737811:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851857.737811:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.737812:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851857.737812:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:8.0:1773851857.737812:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851857.737813:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:6.0:1773851857.737813:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000800:00000200:4.0:1773851857.737813:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x200000000000275: rc=0
00000400:00000200:29.0:1773851857.737814:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000001:28.0:1773851857.737814:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851857.737814:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851857.737814:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000800:00000200:4.0:1773851857.737814:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851857.737815:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737815:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:7.0:1773851857.737815:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:6.0:1773851857.737815:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:29.0:1773851857.737816:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:8.0:1773851857.737816:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737816:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851857.737817:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:28.0:1773851857.737817:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851857.737817:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:4.0:1773851857.737817:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851857.737818:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851857.737818:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737818:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:7.0:1773851857.737818:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851857.737818:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:4.0:1773851857.737818:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.737819:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851857.737819:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:11.0:1773851857.737819:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851857.737819:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:6.0:1773851857.737819:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000800:00000200:29.0:1773851857.737820:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:28.0:1773851857.737820:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:11.0:1773851857.737820:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:8.0:1773851857.737820:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851857.737820:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.737821:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851857.737821:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851857.737821:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:7.0:1773851857.737821:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851857.737821:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8768751, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8768749, p:4294967295, g:4294967295, h:1000]
00000100:00000001:4.0:1773851857.737821:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851857.737822:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:6.0:1773851857.737822:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:4.0:1773851857.737822:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851857.737822:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:29.0:1773851857.737823:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Using peer 60@kfi7(0x1e2)
00000800:00000200:11.0:1773851857.737823:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851857.737823:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000400:00000200:6.0:1773851857.737823:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:4.0:1773851857.737823:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851857.737823:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:6.0:1773851857.737824:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000100:00000001:4.0:1773851857.737824:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737824:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851857.737825:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768752:8768752:1021:4294967295] 36@kfi7 LPNI seq info [5403964:5403964:16:4294967295]
00000800:00000200:11.0:1773851857.737826:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851857.737826:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x19b: rc=0
00000400:00000200:6.0:1773851857.737826:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:29.0:1773851857.737827:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x1e2: rc=0
00000100:00000001:28.0:1773851857.737827:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851857.737827:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851857.737827:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737827:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851857.737827:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:30.0:1773851857.737828:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851857.737828:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851857.737828:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:7.0:1773851857.737828:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:29.0:1773851857.737829:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:11.0:1773851857.737829:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000400:00000200:30.0:1773851857.737830:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851857.737830:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851857.737830:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000100:00000001:7.0:1773851857.737830:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851857.737830:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000800:00000200:5.0:1773851857.737830:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851857.737831:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851857.737831:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851857.737831:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:30.0:1773851857.737832:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000400:00000200:30.0:1773851857.737832:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d36e974
00000100:00000001:29.0:1773851857.737832:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851857.737832:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x1a3: rc=0
00000100:00000001:7.0:1773851857.737832:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.737832:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851857.737832:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:30.0:1773851857.737833:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d36e974.
00000100:00000001:29.0:1773851857.737833:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.737833:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851857.737833:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851857.737833:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000400:00000200:5.0:1773851857.737833:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e586845a
00000100:00000001:30.0:1773851857.737834:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851857.737834:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851857.737834:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851857.737834:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851857.737834:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:6.0:1773851857.737834:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:5.0:1773851857.737834:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e586845a.
00000100:00000200:30.0:1773851857.737835:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851857.737835:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851857.737835:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851857.737835:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851857.737835:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851857.737835:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851857.737835:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851857.737836:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851857.737836:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737836:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851857.737836:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b95ec19a
00000400:00000010:9.0:1773851857.737836:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b95ec19a.
00000100:00000001:7.0:1773851857.737836:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851857.737836:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:30.0:1773851857.737837:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851857.737837:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851857.737837:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737837:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851857.737837:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:7.0:1773851857.737837:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851857.737838:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851857.737838:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851857.737838:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851857.737838:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000100:00000001:5.0:1773851857.737838:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851857.737839:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851857.737839:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000100:00000040:5.0:1773851857.737839:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851857.737840:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737840:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851857.737841:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851857.737841:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851857.737841:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851857.737841:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851857.737841:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:7.0:1773851857.737841:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851857.737841:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000001aa19562: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000100:00000001:5.0:1773851857.737841:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851857.737842:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:11.0:1773851857.737842:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851857.737842:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:9.0:1773851857.737842:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851857.737842:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851857.737843:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851857.737843:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737843:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851857.737843:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000800:00000200:6.0:1773851857.737843:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851857.737844:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c Transaction freed
00000800:00000200:10.0:1773851857.737844:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851857.737844:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851857.737844:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012c6c860
00000400:00000010:7.0:1773851857.737844:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012c6c860.
00000100:00000001:6.0:1773851857.737844:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851857.737844:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:29.0:1773851857.737845:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000400:00000200:10.0:1773851857.737845:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851857.737845:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:7.0:1773851857.737845:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:6.0:1773851857.737845:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851857.737846:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000906c4b9a
00000400:00000200:10.0:1773851857.737846:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:9.0:1773851857.737846:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000200:7.0:1773851857.737846:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851857.737846:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851857.737846:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851857.737846:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 Transaction freed
00000400:00000010:29.0:1773851857.737847:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000906c4b9a.
00000100:00000001:29.0:1773851857.737847:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:10.0:1773851857.737847:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005f852466
00000100:00000001:6.0:1773851857.737847:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:29.0:1773851857.737848:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:10.0:1773851857.737848:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005f852466.
00000100:00000001:10.0:1773851857.737848:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:9.0:1773851857.737848:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Transaction freed
00000100:00000200:10.0:1773851857.737849:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851857.737849:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851857.737850:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851857.737851:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851857.737852:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851857.737852:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851857.737853:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851857.737853:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.737853:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:29.0:1773851857.737854:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851857.737854:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851857.737855:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:10.0:1773851857.737855:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851857.737855:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:5.0:1773851857.737855:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851857.737856:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:10.0:1773851857.737856:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:7.0:1773851857.737856:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000400:00000200:5.0:1773851857.737856:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:10.0:1773851857.737857:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:5.0:1773851857.737857:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047456fe2
00000400:00000010:5.0:1773851857.737857:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047456fe2.
00000800:00000200:29.0:1773851857.737858:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Transaction freed
00000100:00000001:5.0:1773851857.737858:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:21.0:1773851857.737859:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:10.0:1773851857.737859:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000100:00000200:5.0:1773851857.737859:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851857.737860:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851857.737860:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851857.737861:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:5.0:1773851857.737861:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:21.0:1773851857.737862:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:5.0:1773851857.737862:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851857.737863:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851857.737864:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:5.0:1773851857.737864:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851857.737865:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:5.0:1773851857.737865:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851857.737866:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:21.0:1773851857.737867:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:22.0:1773851857.737868:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:21.0:1773851857.737868:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:17.0:1773851857.737868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:5.0:1773851857.737868:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:22.0:1773851857.737869:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851857.737869:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:17.0:1773851857.737869:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2060@kfi7 : PUT - for me
00000800:00000200:22.0:1773851857.737870:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851857.737870:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:21.0:1773851857.737871:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:17.0:1773851857.737871:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:21.0:1773851857.737872:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:22.0:1773851857.737873:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851857.737873:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:17.0:1773851857.737873:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.737873:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:29.0:1773851857.737874:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:21.0:1773851857.737874:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:17.0:1773851857.737874:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:29.0:1773851857.737875:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:22.0:1773851857.737875:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000800:00000200:29.0:1773851857.737876:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851857.737876:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:17.0:1773851857.737876:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:22.0:1773851857.737877:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2081@kfi7 : PUT - for me
00000800:00000200:29.0:1773851857.737878:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851857.737878:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851857.737878:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b26c0
00000400:00000200:17.0:1773851857.737878:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2800
00000800:00000200:30.0:1773851857.737879:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:22.0:1773851857.737879:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:17.0:1773851857.737879:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:30.0:1773851857.737880:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851857.737880:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851857.737880:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:17.0:1773851857.737880:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f07d1 [1] + 224
00000800:00000200:30.0:1773851857.737882:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851857.737882:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000400:00000200:22.0:1773851857.737882:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:29.0:1773851857.737883:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851857.737883:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000800:00000200:17.0:1773851857.737883:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851857.737884:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851857.737884:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:21.0:1773851857.737884:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:17.0:1773851857.737884:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851857.737885:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851857.737885:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851857.737885:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d05d5 [1] + 224
00000800:00000200:18.0:1773851857.737885:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:17.0:1773851857.737885:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000400:00000200:29.0:1773851857.737886:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:22.0:1773851857.737886:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2740
00000800:00000200:18.0:1773851857.737886:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851857.737887:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:17.0:1773851857.737887:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851857.737888:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:22.0:1773851857.737888:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:18.0:1773851857.737888:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:17.0:1773851857.737888:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:22.0:1773851857.737889:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78007fe3d [1] + 224
00000400:00000200:21.0:1773851857.737889:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851857.737890:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.737890:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:21.0:1773851857.737890:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000800:00000200:18.0:1773851857.737890:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851857.737891:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000100:00000001:21.0:1773851857.737891:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:17.0:1773851857.737891:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851857.737892:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.737892:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2700
00000800:00000200:22.0:1773851857.737892:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851857.737892:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:30.0:1773851857.737893:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:22.0:1773851857.737893:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:21.0:1773851857.737893:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851857.737893:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000400:00000200:18.0:1773851857.737894:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:30.0:1773851857.737895:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:30.0:1773851857.737895:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:22.0:1773851857.737895:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000400:00000200:18.0:1773851857.737895:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000100:00000001:17.0:1773851857.737895:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:30.0:1773851857.737896:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:22.0:1773851857.737896:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:21.0:1773851857.737896:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851857.737896:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000200:22.0:1773851857.737897:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851857.737897:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:8.0:1773851857.737897:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851857.737897:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851857.737898:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851857.737898:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:18.0:1773851857.737898:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000001:8.0:1773851857.737898:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:29.0:1773851857.737899:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x78007fe5d [1] + 224
00000400:00000200:17.0:1773851857.737899:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000001:8.0:1773851857.737899:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:30.0:1773851857.737900:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b27c0
00000100:00000040:22.0:1773851857.737900:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851857.737900:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:17.0:1773851857.737900:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000010:8.0:1773851857.737900:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000400:00000200:8.0:1773851857.737900:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000200:30.0:1773851857.737901:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:29.0:1773851857.737901:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851857.737901:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2780
00000400:00000010:8.0:1773851857.737901:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000100:00000001:21.0:1773851857.737902:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:18.0:1773851857.737902:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:8.0:1773851857.737902:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851857.737903:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x78007fe7d [1] + 224
00000400:00000200:29.0:1773851857.737903:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851857.737903:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000200:8.0:1773851857.737903:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851857.737904:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000100:00000001:28.0:1773851857.737904:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:22.0:1773851857.737904:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:18.0:1773851857.737904:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f07f1 [1] + 224
00000800:00000200:30.0:1773851857.737905:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:28.0:1773851857.737905:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:22.0:1773851857.737905:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:21.0:1773851857.737905:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851857.737906:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:28.0:1773851857.737906:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851857.737906:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:23.0:1773851857.737906:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851857.737906:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851857.737906:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000800:00000200:18.0:1773851857.737906:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:8.0:1773851857.737906:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851857.737906:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851857.737906:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851857.737907:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:29.0:1773851857.737907:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851857.737907:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000200:30.0:1773851857.737908:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:28.0:1773851857.737908:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081660f45
00000800:00000200:23.0:1773851857.737908:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851857.737908:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851857.737908:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:4.0:1773851857.737908:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851857.737908:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:28.0:1773851857.737909:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081660f45.
00000100:00000001:28.0:1773851857.737909:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:18.0:1773851857.737909:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000100:00000001:8.0:1773851857.737909:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851857.737909:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851857.737909:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:4.0:1773851857.737909:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851857.737909:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000100:00000040:29.0:1773851857.737910:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:28.0:1773851857.737910:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:23.0:1773851857.737910:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:8.0:1773851857.737910:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:4.0:1773851857.737910:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:30.0:1773851857.737911:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:18.0:1773851857.737911:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851857.737911:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851857.737911:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737911:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:23.0:1773851857.737912:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000200:18.0:1773851857.737912:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851857.737912:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=90 v=66 (66 66 66 66)
00000100:00000200:4.0:1773851857.737912:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851857.737913:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851857.737913:0:41069:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=90 v=66 (1 1 1 1)
00000100:00000001:29.0:1773851857.737914:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:28.0:1773851857.737914:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851857.737914:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 60@kfi7 : PUT - for me
00000100:00000001:8.0:1773851857.737914:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851857.737914:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851857.737915:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:23.0:1773851857.737915:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000040:18.0:1773851857.737915:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:8.0:1773851857.737915:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851857.737915:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851857.737916:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851857.737916:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851857.737916:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:23.0:1773851857.737916:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000100:00000001:8.0:1773851857.737916:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851857.737916:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851857.737916:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:4.0:1773851857.737916:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851857.737917:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851857.737917:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851857.737917:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:23.0:1773851857.737917:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000040:8.0:1773851857.737917:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000001:8.0:1773851857.737917:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000001:7.0:1773851857.737917:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:28.0:1773851857.737918:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:23.0:1773851857.737918:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:8.0:1773851857.737918:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:7.0:1773851857.737918:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:4.0:1773851857.737918:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851857.737919:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851857.737919:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851857.737919:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:23.0:1773851857.737919:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000001:18.0:1773851857.737919:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:8.0:1773851857.737919:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:7.0:1773851857.737919:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000400:00000200:7.0:1773851857.737919:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a1436362
00000100:00000001:4.0:1773851857.737919:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851857.737919:0:41066:0:(client.c:1428:after_reply()) Process entered
00000100:00001000:28.0:1773851857.737920:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=90 v=66 (66 66 66 66)
00000400:00000200:23.0:1773851857.737920:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851857.737920:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000010:7.0:1773851857.737920:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a1436362.
02000000:00000001:4.0:1773851857.737920:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851857.737920:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:30.0:1773851857.737921:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00001000:28.0:1773851857.737921:0:41090:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=90 v=66 (1 1 1 1)
00000400:00000200:23.0:1773851857.737921:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2840
00000100:00000001:11.0:1773851857.737921:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851857.737921:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851857.737921:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851857.737921:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851857.737921:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851857.737921:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.737922:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:23.0:1773851857.737922:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:18.0:1773851857.737922:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e2a52ba: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851857.737922:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851857.737922:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851857.737922:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:7.0:1773851857.737922:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:6.0:1773851857.737922:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
02000000:00000001:4.0:1773851857.737922:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851857.737922:0:41066:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=90 v=66 (66 66 66 66)
00000800:00000200:30.0:1773851857.737923:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851857.737923:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851857.737923:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000001:11.0:1773851857.737923:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851857.737923:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000001:8.0:1773851857.737923:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851857.737923:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000400:00000001:6.0:1773851857.737923:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:4.0:1773851857.737923:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=90 v=66 (1 1 1 1)
00010000:00000001:28.0:1773851857.737924:0:41090:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:23.0:1773851857.737924:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d05f5 [1] + 224
00000400:00000010:11.0:1773851857.737924:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000004:00000040:8.0:1773851857.737924:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504357376 avail=351502192640 avail_mb=1373055440 hwm_mb=3131103 files=372056295 ffree=343265974 state=0: rc = 0
00000400:00000010:6.0:1773851857.737924:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000100:00000001:28.0:1773851857.737925:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851857.737925:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000400:00000200:11.0:1773851857.737925:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d7cd332
00000100:00000200:7.0:1773851857.737925:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851857.737925:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4270b1f
00000100:00000001:4.0:1773851857.737925:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851857.737926:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000800:00000200:23.0:1773851857.737926:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:11.0:1773851857.737926:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d7cd332.
00000004:00000020:8.0:1773851857.737926:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504357376 free, 351502192640 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056295 files, 343265974 free files
00000400:00000010:6.0:1773851857.737926:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4270b1f.
00000100:00000001:4.0:1773851857.737926:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851857.737926:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851857.737927:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737927:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:8.0:1773851857.737927:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.737927:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851857.737927:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851857.737927:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:4.0:1773851857.737927:0:41066:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851857.737928:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:23.0:1773851857.737928:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:11.0:1773851857.737928:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851857.737928:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851857.737928:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:6.0:1773851857.737928:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851857.737928:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851857.737928:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000400:00000200:23.0:1773851857.737929:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000100:00000040:8.0:1773851857.737929:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851857.737929:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851857.737929:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737929:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851857.737929:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851857.737930:0:2495434:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:7.0:1773851857.737930:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851857.737930:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851857.737930:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851857.737931:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:11.0:1773851857.737931:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:7.0:1773851857.737931:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=90 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851857.737932:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851857.737932:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:23.0:1773851857.737932:0:2495434:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:8.0:1773851857.737932:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000659d5d18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051924480:2060@kfi7:13:default-yuba2-0
00000100:00001000:7.0:1773851857.737932:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=90 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851857.737932:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:28.0:1773851857.737933:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:8.0:1773851857.737933:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.737933:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851857.737933:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851857.737933:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851857.737933:0:41065:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:4.0:1773851857.737933:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:28.0:1773851857.737934:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097472 blocks, 31192443296 free, 31192381152 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238747 files, 2962368272 free files
00000100:00000001:11.0:1773851857.737934:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851857.737934:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851857.737934:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851857.737934:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000659d5d18 x1859433051924480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:7.0:1773851857.737934:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851857.737934:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851857.737934:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851857.737934:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851857.737934:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851857.737934:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:23.0:1773851857.737935:0:2495434:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851857.737935:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851857.737935:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851857.737935:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:6.0:1773851857.737935:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851857.737935:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851857.737935:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:28.0:1773851857.737936:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737936:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:7.0:1773851857.737936:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:7.0:1773851857.737936:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851857.737936:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851857.737936:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=90 v=66 (66 66 66 66)
00000004:00000020:4.0:1773851857.737936:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223712 blocks, 31250857664 free, 31250817024 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121448 files, 2868731074 free files
00000100:00000040:28.0:1773851857.737937:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851857.737937:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851857.737937:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737937:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851857.737937:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00001000:6.0:1773851857.737937:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=90 v=66 (1 1 1 1)
00000004:00000001:4.0:1773851857.737937:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851857.737938:0:41068:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=90 v=66 (66 66 66 66)
02000000:00000010:8.0:1773851857.737938:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000001f164fb.
00000100:00000040:7.0:1773851857.737938:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851857.737938:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851857.737938:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851857.737938:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:4.0:1773851857.737938:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:23.0:1773851857.737939:0:2495434:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:23.0:1773851857.737939:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00001000:11.0:1773851857.737939:0:41068:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=90 v=66 (1 1 1 1)
02000000:00000001:8.0:1773851857.737939:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851857.737939:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00010000:00000001:6.0:1773851857.737939:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851857.737940:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:28.0:1773851857.737940:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051924160:13@kfi7:41:default-yuba2-0
00000020:00000040:8.0:1773851857.737940:0:41069:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000020:00000001:8.0:1773851857.737940:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851857.737940:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851857.737940:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851857.737940:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:6.0:1773851857.737940:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851857.737941:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851857.737941:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:23.0:1773851857.737941:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851857.737941:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851857.737941:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851857.737941:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000100:00000001:7.0:1773851857.737941:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851857.737941:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851857.737941:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851857.737941:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f81cec73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051924288:2074@kfi7:41:default-yuba2-0
00000400:00000001:29.0:1773851857.737942:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851857.737942:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851857.737942:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00010000:00000001:11.0:1773851857.737942:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:8.0:1773851857.737942:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851857.737942:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000004:00000001:7.0:1773851857.737942:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851857.737942:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000100:00000040:6.0:1773851857.737942:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:29.0:1773851857.737943:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000060a59eec.
00000100:00000040:28.0:1773851857.737943:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000061cdc96b x1859433051924160/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:11.0:1773851857.737943:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:8.0:1773851857.737943:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000659d5d18.
00000004:00000040:7.0:1773851857.737943:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399726592 free=351492795392 avail=351490386944 avail_mb=1373009324 hwm_mb=3131103 files=372078162 ffree=343254683 state=0: rc = 0
00000100:00000001:4.0:1773851857.737943:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851857.737944:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000004015b2d
00000400:00000010:29.0:1773851857.737944:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000004015b2d.
00000100:00000001:11.0:1773851857.737944:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851857.737944:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000001:8.0:1773851857.737944:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851857.737944:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851857.737944:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851857.737944:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851857.737945:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851857.737945:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:11.0:1773851857.737945:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851857.737945:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737945:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851857.737945:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000020:7.0:1773851857.737945:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399726592 blocks, 351492795392 free, 351490386944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372078162 files, 343254683 free files
00000100:00000001:6.0:1773851857.737945:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851857.737945:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851857.737945:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:4.0:1773851857.737945:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f81cec73 x1859433051924288/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:29.0:1773851857.737946:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:28.0:1773851857.737946:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851857.737946:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001529c0f6.
00000100:00000040:11.0:1773851857.737946:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851857.737946:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851857.737946:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:7.0:1773851857.737946:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:6.0:1773851857.737946:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
02000000:00000001:28.0:1773851857.737947:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:8.0:1773851857.737947:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851857.737947:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:6.0:1773851857.737947:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500118016 avail=351498018816 avail_mb=1373039136 hwm_mb=3131103 files=372097772 ffree=343261834 state=0: rc = 0
00000100:00000001:4.0:1773851857.737947:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:28.0:1773851857.737948:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851857.737948:0:41090:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000004:00000020:6.0:1773851857.737948:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500118016 free, 351498018816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097772 files, 343261834 free files
02000000:00000001:4.0:1773851857.737948:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000200:29.0:1773851857.737949:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:28.0:1773851857.737949:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:11.0:1773851857.737949:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000010:4.0:1773851857.737949:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007e3989c4.
02000000:00000010:28.0:1773851857.737950:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ce3b9347.
00000100:00000001:11.0:1773851857.737950:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00100000:7.0:1773851857.737950:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000053aa084a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051924224:2061@kfi7:13:default-yuba2-0
02000000:00000001:4.0:1773851857.737950:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851857.737950:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:29.0:1773851857.737951:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:28.0:1773851857.737951:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851857.737951:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:11.0:1773851857.737951:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851857.737951:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:6.0:1773851857.737951:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:4.0:1773851857.737951:0:41066:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000001:4.0:1773851857.737951:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:29.0:1773851857.737952:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:28.0:1773851857.737952:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061cdc96b.
00000004:00000040:11.0:1773851857.737952:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000100:00000001:7.0:1773851857.737952:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.737952:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851857.737952:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:4.0:1773851857.737952:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006f706ecc.
00000100:00000001:29.0:1773851857.737953:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851857.737953:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851857.737953:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851857.737953:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:11.0:1773851857.737953:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690118144 avail=351687678976 avail_mb=1373779996 hwm_mb=3131103 files=372231270 ffree=343447381 state=0: rc = 0
00000100:00000040:7.0:1773851857.737953:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000053aa084a x1859433051924224/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:4.0:1773851857.737953:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:29.0:1773851857.737954:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851857.737954:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.737954:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851857.737954:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851857.737954:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f81cec73.
02000000:00000001:29.0:1773851857.737955:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851857.737955:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851857.737955:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:11.0:1773851857.737955:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690118144 free, 351687678976 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231270 files, 343447381 free files
00000100:00000001:7.0:1773851857.737955:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00100000:6.0:1773851857.737955:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e16d771b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051924352:36@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851857.737955:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00001000:29.0:1773851857.737956:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=90 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851857.737956:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:11.0:1773851857.737956:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851857.737956:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851857.737956:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f3f77d39.
00000100:00000001:4.0:1773851857.737956:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851857.737956:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:29.0:1773851857.737957:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=90 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851857.737957:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.737957:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851857.737957:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:6.0:1773851857.737957:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851857.737957:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851857.737957:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851857.737958:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000020:00000001:7.0:1773851857.737958:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851857.737958:0:41067:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000100:00000040:6.0:1773851857.737958:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e16d771b x1859433051924352/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851857.737958:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851857.737958:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851857.737959:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851857.737959:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000020:00000001:7.0:1773851857.737959:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851857.737959:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000100f702c.
00000100:00000001:4.0:1773851857.737959:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851857.737960:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851857.737960:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f2d41e54 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051924416:37@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851857.737960:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851857.737960:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851857.737961:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000053aa084a.
00000100:00000001:7.0:1773851857.737961:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851857.737961:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851857.737961:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851857.737961:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ecbfdd48.
00000100:00000001:11.0:1773851857.737962:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.737962:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851857.737962:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851857.737962:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851857.737963:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851857.737963:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000100:00000040:11.0:1773851857.737963:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f2d41e54 x1859433051924416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851857.737963:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851857.737963:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851857.737963:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851857.737963:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851857.737963:0:41065:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000100:00000001:29.0:1773851857.737964:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851857.737964:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851857.737964:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851857.737964:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851857.737964:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851857.737964:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006fe63e6d.
00000100:00000040:29.0:1773851857.737965:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851857.737965:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851857.737965:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851857.737966:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:6.0:1773851857.737966:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851857.737966:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e16d771b.
02000000:00000010:11.0:1773851857.737967:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b91a248b.
02000000:00000001:11.0:1773851857.737967:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:6.0:1773851857.737967:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851857.737967:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851857.737968:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:11.0:1773851857.737968:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:6.0:1773851857.737968:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851857.737968:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851857.737969:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851857.737969:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851857.737969:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851857.737969:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851857.737969:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851857.737970:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000040:11.0:1773851857.737970:0:41068:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000004:00000040:29.0:1773851857.737971:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000004:00000040:29.0:1773851857.737971:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351245824 avail=351348454400 avail_mb=1372454900 hwm_mb=3131103 files=372084135 ffree=343116451 state=0: rc = 0
00000020:00000001:11.0:1773851857.737971:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851857.737971:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000009c52eb5f.
02000000:00000001:11.0:1773851857.737972:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000020:29.0:1773851857.737973:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351245824 free, 351348454400 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372084135 files, 343116451 free files
02000000:00000001:11.0:1773851857.737973:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851857.737973:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f2d41e54.
00000100:00000001:11.0:1773851857.737974:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000001:29.0:1773851857.737975:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737975:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.737975:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:29.0:1773851857.737976:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851857.737976:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851857.737977:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.737977:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851857.737978:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851857.737979:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c01b7c03 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051924544:60@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851857.737980:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851857.737981:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851857.737982:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c01b7c03 x1859433051924544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852010 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851857.737984:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851857.737985:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851857.737985:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006ab5167d.
02000000:00000001:29.0:1773851857.737987:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851857.737987:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851857.737988:0:41091:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000020:00000001:29.0:1773851857.737988:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851857.737989:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000012eaad24.
02000000:00000001:29.0:1773851857.737990:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851857.737991:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851857.737991:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c01b7c03.
00000100:00000001:29.0:1773851857.737992:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851857.737993:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851857.737993:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851857.737994:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851857.737995:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851857.737995:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851857.737996:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851857.741067:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851857.741068:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851857.741069:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851857.741072:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851857.741074:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18642@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.741075:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18642@kfi7 : PUT - for me
00000400:00000200:9.0:1773851857.741076:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18642@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.741077:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8a782f9 nid 18642@kfi7 refs 1
00000400:00000200:9.0:1773851857.741078:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18642@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.741080:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8a782f9 nid 18642@kfi7 refs 2
00000400:00000200:9.0:1773851857.741081:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d8a782f9 nid 18642@kfi7 refs 3
00000400:00000200:9.0:1773851857.741082:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18642@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.741083:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18642@kfi7 of length 224 into portal 12 MB=0x69b4c65e6e040
00000400:00000200:9.0:1773851857.741084:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18642@kfi7 of length 224/224 into md 0x78146ce49 [64] + 124112
00000800:00000200:9.0:1773851857.741086:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851857.741087:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851857.741088:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18642@kfi7: PUT: OK
00000100:00000001:9.0:1773851857.741089:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851857.741090:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851857.741091:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000085061e2.
00000100:00000040:9.0:1773851857.741092:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000085061e2 x1859602289713216 msgsize 224
00000100:00100000:9.0:1773851857.741093:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18642@kfi7 (source: 12345-18642@kfi7)
00000100:00000001:9.0:1773851857.741094:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851857.741095:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d8a782f9 nid 18642@kfi7 refs 2
00000100:00000001:11.0:1773851857.741096:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851857.741096:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851857.741097:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851857.741097:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851857.741097:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851857.741098:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851857.741099:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602289713216
00000020:00000001:11.0:1773851857.741100:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851857.741100:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7afae
00000020:00000001:11.0:1773851857.741101:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851857.741103:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000aa7a468 refcount=2106
00000020:00000001:11.0:1773851857.741104:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637037010011136 : -107036699540480 : ffff9ea6938bc400)
00000020:00000001:11.0:1773851857.741104:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637037010011136 : -107036699540480 : ffff9ea6938bc400)
00000100:00000001:11.0:1773851857.741105:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.741106:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851857.741107:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000faab3b2c.
00000020:00000010:11.0:1773851857.741108:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851857.741109:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851857.741110:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851857.741110:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851857.741111:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.741112:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851857.741112:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851857.741113:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.741114:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.741115:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851857.741116:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851857.741116:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851857.741116:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851857.741117:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18642@kfi7, seq: 2130734
00000100:00000040:11.0:1773851857.741118:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000aa7a468 : new rpc_count 21
00000100:00000001:11.0:1773851857.741118:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064890240 : -106983644661376 : ffff9eb2eddcf980)
00000100:00000001:10.0:1773851857.741118:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851857.741118:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.741120:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000085061e2 x1859602289713216/t0(0) o400->d5d92dd5-7237-48c9-89c0-292bb907eb51@18642@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1653-0'
00000100:00000001:11.0:1773851857.741122:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.741123:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851857.741124:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000085061e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d5d92dd5-7237-48c9-89c0-292bb907eb51+2106:39665:x1859602289713216:12345-18642@kfi7:400:default-tuolumne1653-0
00000100:00000200:11.0:1773851857.741125:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602289713216
00000020:00000001:11.0:1773851857.741126:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851857.741126:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851857.741127:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.741128:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851857.741128:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851857.741129:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851857.741130:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602289713216, found 0 last_xid 1859602288981567
00000020:00000001:11.0:1773851857.741130:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851857.741131:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851857.741132:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851857.741132:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.741133:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851857.741133:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851857.741134:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851857.741135:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000058720a0e.
02000000:00000001:11.0:1773851857.741135:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.741136:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.741137:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851857.741137:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264577657, transno 0, xid 1859602289713216
00010000:00000001:11.0:1773851857.741138:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851857.741139:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000085061e2 x1859602289713216/t0(0) o400->d5d92dd5-7237-48c9-89c0-292bb907eb51@18642@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1653-0'
00010000:00000001:11.0:1773851857.741142:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851857.741142:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851857.741143:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=90 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851857.741144:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851857.741145:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006b125fea refcount 3 to 18642@kfi7
00000100:00000001:11.0:1773851857.741146:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058496 : -107146750493120 : ffff9e8cf3ff7e40)
02000000:00000001:11.0:1773851857.741146:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851857.741147:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.741148:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851857.741149:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18642@kfi7
00000400:00000010:11.0:1773851857.741149:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d7cd332.
00000100:00000200:11.0:1773851857.741150:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602289713216, offset 224
00000400:00000200:11.0:1773851857.741152:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18642@kfi7
00000400:00000200:11.0:1773851857.741153:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18642@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.741154:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8a782f9 nid 18642@kfi7 refs 1
00000400:00000200:11.0:1773851857.741155:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d8a782f9 nid 18642@kfi7 refs 2
00000400:00000200:11.0:1773851857.741156:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d8a782f9 nid 18642@kfi7 refs 3
00000400:00000200:11.0:1773851857.741157:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18642@kfi7 local destination
00000400:00000200:11.0:1773851857.741158:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768753:8768753:1024:4294967295] 18642@kfi7 LPNI seq info [18139649:18139649:16:4294967295]
00000400:00000200:11.0:1773851857.741160:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d8a782f9 nid 18642@kfi7 refs 2
00000400:00000200:11.0:1773851857.741160:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18642@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.741162:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18642@kfi7(18642@kfi7:18642@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851857.741163:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d8a782f9 nid 18642@kfi7 refs 3
00000800:00000200:11.0:1773851857.741165:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851857.741166:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851857.741168:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851857.741170:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ce Using peer 18642@kfi7(0x1000000000009ce)
00000800:00000200:11.0:1773851857.741175:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x1000000000009ce: rc=0
00000800:00000200:11.0:1773851857.741176:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851857.741179:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.741179:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006b125fea refcount 2 to 18642@kfi7
00010000:00000001:11.0:1773851857.741180:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851857.741181:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.741181:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851857.741182:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000085061e2 x1859602289713216/t0(0) o400->d5d92dd5-7237-48c9-89c0-292bb907eb51@18642@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1653-0'
00000100:00100000:11.0:1773851857.741185:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000085061e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d5d92dd5-7237-48c9-89c0-292bb907eb51+2106:39665:x1859602289713216:12345-18642@kfi7:400:default-tuolumne1653-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851857.741188:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18642@kfi7, seq: 2130734
00000800:00000200:9.0:1773851857.741188:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ce TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851857.741189:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000aa7a468 : new rpc_count 20
00000100:00000001:11.0:1773851857.741190:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851857.741190:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851857.741190:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851857.741191:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851857.741191:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18642@kfi7: PUT: OK
00000400:00000200:9.0:1773851857.741191:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d7cd332
00000020:00000010:11.0:1773851857.741192:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000400:00000010:9.0:1773851857.741192:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d7cd332.
00000020:00000010:11.0:1773851857.741193:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000faab3b2c.
00000100:00000001:9.0:1773851857.741193:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851857.741193:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:11.0:1773851857.741194:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000000aa7a468 : new refcount 2105
00000100:00000001:11.0:1773851857.741194:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851857.741194:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d8a782f9 nid 18642@kfi7 refs 2
00000800:00000200:9.0:1773851857.741196:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 18642@kfi7(0000000007101c00):0x0 lsk 2511 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ce Transaction freed
00000800:00000200:13.0:1773851857.749013:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.749014:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851857.749016:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851857.749018:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851857.749021:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.749022:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20946@kfi7 : PUT - for me
00000400:00000200:13.0:1773851857.749023:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.749024:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 1
00000400:00000200:13.0:1773851857.749025:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.749026:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000400:00000200:13.0:1773851857.749027:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 3
00000400:00000200:13.0:1773851857.749028:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20754@kfi7 to cpt 0
00000400:00000200:13.0:1773851857.749029:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20754@kfi7 of length 224 into portal 12 MB=0x69b4c5ccb2840
00000400:00000200:13.0:1773851857.749030:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20754@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 17704
00000800:00000200:13.0:1773851857.749032:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851857.749034:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851857.749036:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20946@kfi7: PUT: OK
00000100:00000001:13.0:1773851857.749037:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851857.749037:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851857.749039:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a37759a.
00000100:00000040:13.0:1773851857.749040:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000008a37759a x1859602136901696 msgsize 224
00000100:00100000:13.0:1773851857.749041:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20754@kfi7 (source: 12345-20946@kfi7)
00000100:00000001:13.0:1773851857.749043:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851857.749044:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000800:00000200:13.0:1773851857.749046:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851857.749048:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851857.749049:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851857.749049:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851857.749050:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851857.749051:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851857.749051:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602136901696
00000020:00000001:13.0:1773851857.749052:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851857.749053:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e62dab381
00000020:00000001:13.0:1773851857.749053:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851857.749058:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ecd9af3e refcount=3468
00000020:00000001:13.0:1773851857.749058:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636940889160704 : -107132820390912 : ffff9e90324bfc00)
00000020:00000001:13.0:1773851857.749059:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636940889160704 : -107132820390912 : ffff9e90324bfc00)
00000100:00000001:13.0:1773851857.749060:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.749061:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851857.749062:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851857.749063:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.749064:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851857.749065:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851857.749065:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851857.749065:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.749066:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851857.749067:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851857.749067:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.749068:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851857.749069:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851857.749070:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851857.749071:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:13.0:1773851857.749071:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20754@kfi7, seq: 2289785
00000100:00000040:13.0:1773851857.749071:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ecd9af3e : new rpc_count 8
00000100:00000001:15.0:1773851857.749072:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851857.749072:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.749072:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637080180726528 : -106993528825088 : ffff9eb0a0b89b00)
00000100:00000001:15.0:1773851857.749073:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.749073:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a37759a x1859602136901696/t0(0) o400->6eb2aa37-6a67-4af8-9d80-735dc4a16d05@20754@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1797-0'
00000100:00000001:13.0:1773851857.749076:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851857.749076:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851857.749077:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a37759a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:6eb2aa37-6a67-4af8-9d80-735dc4a16d05+3468:39469:x1859602136901696:12345-20754@kfi7:400:default-tuolumne1797-0
00000100:00000200:13.0:1773851857.749078:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602136901696
00000020:00000001:13.0:1773851857.749079:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851857.749080:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851857.749080:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.749081:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851857.749081:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851857.749082:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851857.749083:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602136901696, found 0 last_xid 1859602136174079
00000020:00000001:13.0:1773851857.749084:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851857.749084:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851857.749085:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851857.749085:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.749086:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851857.749086:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851857.749087:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851857.749088:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000018d0b88e.
02000000:00000001:13.0:1773851857.749088:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.749089:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.749089:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851857.749090:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583932, transno 0, xid 1859602136901696
00010000:00000001:13.0:1773851857.749091:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851857.749091:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008a37759a x1859602136901696/t0(0) o400->6eb2aa37-6a67-4af8-9d80-735dc4a16d05@20754@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1797-0'
00010000:00000001:13.0:1773851857.749093:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851857.749094:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851857.749095:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=90 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851857.749095:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851857.749096:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005bea2bdf refcount 3 to 20754@kfi7
00000100:00000001:13.0:1773851857.749097:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003136 : -107146751548480 : ffff9e8cf3ef63c0)
02000000:00000001:13.0:1773851857.749097:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851857.749098:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851857.749098:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851857.749099:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20946@kfi7
00000400:00000010:13.0:1773851857.749100:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b434206b.
00000100:00000200:13.0:1773851857.749100:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602136901696, offset 224
00000400:00000200:13.0:1773851857.749102:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20946@kfi7
00000400:00000200:13.0:1773851857.749102:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.749103:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 1
00000400:00000200:13.0:1773851857.749104:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000400:00000200:13.0:1773851857.749105:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 3
00000400:00000200:13.0:1773851857.749106:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20946@kfi7 local destination
00000400:00000200:13.0:1773851857.749107:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768754:8768754:1024:4294967295] 20946@kfi7 LPNI seq info [12875360:12875360:16:4294967295]
00000400:00000200:13.0:1773851857.749109:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000400:00000200:13.0:1773851857.749110:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851857.749112:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20946@kfi7(20946@kfi7:20946@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851857.749113:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 3
00000800:00000200:13.0:1773851857.749114:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851857.749115:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851857.749117:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851857.749119:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa Using peer 20946@kfi7(0xa)
00000800:00000200:13.0:1773851857.749122:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 324 bytes to peer 0xa: rc=0
00000800:00000200:13.0:1773851857.749123:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851857.749125:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851857.749126:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005bea2bdf refcount 2 to 20754@kfi7
00010000:00000001:13.0:1773851857.749127:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851857.749127:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851857.749128:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851857.749128:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a37759a x1859602136901696/t0(0) o400->6eb2aa37-6a67-4af8-9d80-735dc4a16d05@20754@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1797-0'
00000100:00100000:13.0:1773851857.749131:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a37759a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:6eb2aa37-6a67-4af8-9d80-735dc4a16d05+3468:39469:x1859602136901696:12345-20754@kfi7:400:default-tuolumne1797-0 Request processed in 54us (90us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851857.749133:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20754@kfi7, seq: 2289785
00000100:00000040:13.0:1773851857.749134:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ecd9af3e : new rpc_count 7
00000100:00000001:13.0:1773851857.749134:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851857.749135:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851857.749135:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851857.749136:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000800:00000200:14.0:1773851857.749137:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851857.749137:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000020:00000040:13.0:1773851857.749138:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000ecd9af3e : new refcount 3467
00000100:00000001:13.0:1773851857.749138:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851857.749139:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851857.749140:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20946@kfi7: PUT: OK
00000400:00000200:14.0:1773851857.749141:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b434206b
00000400:00000010:14.0:1773851857.749141:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b434206b.
00000100:00000001:14.0:1773851857.749142:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851857.749143:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851857.749144:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000800:00000200:14.0:1773851857.749145:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 20946@kfi7(00000000e6bdc768):0x0 lsk 11 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa Transaction freed
00000800:00000200:9.0:1773851857.761568:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851857.761569:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851857.761570:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851857.761573:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851857.761575:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17147@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.761576:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17147@kfi7 : PUT - for me
00000400:00000200:9.0:1773851857.761577:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17147@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.761578:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fdd7e47f nid 17147@kfi7 refs 1
00000400:00000200:9.0:1773851857.761579:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17147@kfi7 to cpt 2
00000400:00000200:9.0:1773851857.761579:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fdd7e47f nid 17147@kfi7 refs 2
00000400:00000200:9.0:1773851857.761580:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fdd7e47f nid 17147@kfi7 refs 3
00000400:00000200:9.0:1773851857.761581:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17146@kfi7 to cpt 7
00000400:00000200:9.0:1773851857.761582:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17146@kfi7 of length 224 into portal 12 MB=0x699de89e6b780
00000400:00000200:9.0:1773851857.761583:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17146@kfi7 of length 224/224 into md 0x78146ce49 [64] + 124336
00000800:00000200:9.0:1773851857.761586:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851857.761588:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851857.761589:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17147@kfi7: PUT: OK
00000100:00000001:9.0:1773851857.761590:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851857.761590:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851857.761591:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000445b4617.
00000100:00000040:9.0:1773851857.761592:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000445b4617 x1858030935652224 msgsize 224
00000100:00100000:9.0:1773851857.761594:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17146@kfi7 (source: 12345-17147@kfi7)
00000100:00000001:9.0:1773851857.761595:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851857.761596:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851857.761596:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fdd7e47f nid 17147@kfi7 refs 2
02000000:00000001:11.0:1773851857.761597:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851857.761597:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851857.761598:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851857.761598:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851857.761599:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851857.761600:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030935652224
00000020:00000001:11.0:1773851857.761601:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851857.761601:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fcf
00000020:00000001:11.0:1773851857.761602:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851857.761606:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000090035a11 refcount=6
00000020:00000001:11.0:1773851857.761607:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240100864 : -107152469450752 : ffff9e8b9f1f2000)
00000020:00000001:11.0:1773851857.761608:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240100864 : -107152469450752 : ffff9e8b9f1f2000)
00000100:00000001:11.0:1773851857.761610:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.761611:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851857.761611:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009caf48ee.
00000020:00000010:11.0:1773851857.761613:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851857.761613:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851857.761615:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851857.761615:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851857.761616:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.761617:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851857.761617:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851857.761618:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.761619:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851857.761620:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851857.761620:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851857.761621:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851857.761621:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851857.761622:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17146@kfi7, seq: 2130735
00000100:00000040:11.0:1773851857.761623:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000090035a11 : new rpc_count 1
00000100:00000001:11.0:1773851857.761623:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064864896 : -106983644686720 : ffff9eb2eddc9680)
00000100:00000001:10.0:1773851857.761623:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851857.761623:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.761625:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000445b4617 x1858030935652224/t0(0) o400->8e7205c2-f35c-4c78-a771-7aed3865a990@17146@kfi7:645/0 lens 224/0 e 0 to 0 dl 1773852005 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne235-0'
00000100:00000001:11.0:1773851857.761629:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851857.761629:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851857.761631:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000445b4617 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8e7205c2-f35c-4c78-a771-7aed3865a990+6:47803:x1858030935652224:12345-17146@kfi7:400:default-tuolumne235-0
00000100:00000200:11.0:1773851857.761633:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030935652224
00000020:00000001:11.0:1773851857.761634:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851857.761635:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851857.761636:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.761637:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851857.761638:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851857.761639:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851857.761640:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030935652224, found 0 last_xid 1858030935652223
00000020:00000001:11.0:1773851857.761642:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851857.761643:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851857.761644:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851857.761645:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.761646:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851857.761647:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851857.761648:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851857.761649:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000faab3b2c.
02000000:00000001:11.0:1773851857.761650:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.761651:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.761652:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851857.761654:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030935652224
00010000:00000001:11.0:1773851857.761655:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851857.761656:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000445b4617 x1858030935652224/t0(0) o400->8e7205c2-f35c-4c78-a771-7aed3865a990@17146@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne235-0'
00010000:00000001:11.0:1773851857.761661:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851857.761662:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851857.761663:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=90 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851857.761665:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851857.761667:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000028d9966a refcount 5 to 17146@kfi7
00000100:00000001:11.0:1773851857.761668:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918079257312 : -107155630294304 : ffff9e8ae2b87ae0)
02000000:00000001:11.0:1773851857.761669:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851857.761670:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851857.761671:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851857.761673:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17147@kfi7
00000400:00000010:11.0:1773851857.761674:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000177f1aa0.
00000100:00000200:11.0:1773851857.761675:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030935652224, offset 224
00000400:00000200:11.0:1773851857.761678:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17147@kfi7
00000400:00000200:11.0:1773851857.761679:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17147@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.761681:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fdd7e47f nid 17147@kfi7 refs 1
00000400:00000200:11.0:1773851857.761683:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fdd7e47f nid 17147@kfi7 refs 2
00000400:00000200:11.0:1773851857.761685:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fdd7e47f nid 17147@kfi7 refs 3
00000400:00000200:11.0:1773851857.761687:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17147@kfi7 local destination
00000400:00000200:11.0:1773851857.761690:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768755:8768755:1024:4294967295] 17147@kfi7 LPNI seq info [28011:28011:16:4294967295]
00000400:00000200:11.0:1773851857.761693:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fdd7e47f nid 17147@kfi7 refs 2
00000400:00000200:11.0:1773851857.761695:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17147@kfi7 to cpt 2
00000400:00000200:11.0:1773851857.761699:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17147@kfi7(17147@kfi7:17147@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851857.761701:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fdd7e47f nid 17147@kfi7 refs 3
00000800:00000200:11.0:1773851857.761704:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851857.761706:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851857.761710:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851857.761714:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e4 Using peer 17147@kfi7(0x1000000000000e4)
00000800:00000200:11.0:1773851857.761719:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x1000000000000e4: rc=0
00000800:00000200:11.0:1773851857.761722:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851857.761733:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851857.761735:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000028d9966a refcount 4 to 17146@kfi7
00010000:00000001:11.0:1773851857.761736:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851857.761737:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851857.761738:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851857.761739:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000445b4617 x1858030935652224/t0(0) o400->8e7205c2-f35c-4c78-a771-7aed3865a990@17146@kfi7:645/0 lens 224/224 e 0 to 0 dl 1773852005 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne235-0'
00000800:00000200:9.0:1773851857.761739:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e4 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851857.761742:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851857.761744:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17147@kfi7: PUT: OK
00000100:00100000:11.0:1773851857.761745:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000445b4617 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8e7205c2-f35c-4c78-a771-7aed3865a990+6:47803:x1858030935652224:12345-17146@kfi7:400:default-tuolumne235-0 Request processed in 115us (152us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851857.761746:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000177f1aa0
00000400:00000010:9.0:1773851857.761746:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000177f1aa0.
00000100:00000001:9.0:1773851857.761748:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851857.761749:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:11.0:1773851857.761750:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17146@kfi7, seq: 2130735
00000400:00000200:9.0:1773851857.761750:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fdd7e47f nid 17147@kfi7 refs 2
00000100:00000040:11.0:1773851857.761751:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000090035a11 : new rpc_count 0
00000100:00000001:11.0:1773851857.761752:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851857.761753:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851857.761753:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17147@kfi7(000000003d5a127a):0x0 lsk 229 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e4 Transaction freed
00000020:00000010:11.0:1773851857.761754:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851857.761756:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000020:00000010:11.0:1773851857.761757:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009caf48ee.
00000020:00000040:11.0:1773851857.761759:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000090035a11 : new refcount 5
00000100:00000001:11.0:1773851857.761760:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851857.790718:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851857.790720:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851857.790722:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851857.790733:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851857.790736:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15328@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.790738:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15328@kfi7 : PUT - for me
00000400:00000200:17.0:1773851857.790739:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15328@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.790741:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e02fa60 nid 15328@kfi7 refs 1
00000400:00000200:17.0:1773851857.790742:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15328@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.790743:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e02fa60 nid 15328@kfi7 refs 2
00000400:00000200:17.0:1773851857.790744:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008e02fa60 nid 15328@kfi7 refs 3
00000400:00000200:17.0:1773851857.790744:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15137@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.790745:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15137@kfi7 of length 224 into portal 12 MB=0x69b4b5a724e00
00000400:00000200:17.0:1773851857.790748:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15137@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 192096
00000800:00000200:17.0:1773851857.790750:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851857.790752:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851857.790753:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15328@kfi7: PUT: OK
00000100:00000001:17.0:1773851857.790754:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851857.790754:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851857.790755:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000576c05b6.
00000100:00000040:17.0:1773851857.790756:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000576c05b6 x1859597802556928 msgsize 224
00000100:00100000:17.0:1773851857.790758:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15137@kfi7 (source: 12345-15328@kfi7)
00000100:00000001:17.0:1773851857.790759:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851857.790760:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008e02fa60 nid 15328@kfi7 refs 2
00000100:00000001:18.0:1773851857.790761:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851857.790762:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851857.790762:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851857.790762:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851857.790763:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851857.790764:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851857.790765:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597802556928
00000020:00000001:18.0:1773851857.790765:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851857.790766:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2459d7e4
00000020:00000001:18.0:1773851857.790767:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851857.790768:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009fe8894f refcount=169
00000020:00000001:18.0:1773851857.790769:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128821924864 : -106944887626752 : ffff9ebbf3f66400)
00000020:00000001:18.0:1773851857.790770:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128821924864 : -106944887626752 : ffff9ebbf3f66400)
00000100:00000001:18.0:1773851857.790771:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.790772:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851857.790773:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2d6dcb1.
00000020:00000010:18.0:1773851857.790774:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851857.790775:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000059dcb8dd.
00000100:00000001:18.0:1773851857.790776:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851857.790776:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851857.790777:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851857.790778:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851857.790778:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851857.790779:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.790780:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851857.790781:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851857.790781:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851857.790782:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851857.790782:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851857.790783:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15137@kfi7, seq: 2156270
00000100:00000040:18.0:1773851857.790783:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009fe8894f : new rpc_count 1
00000100:00000001:19.0:1773851857.790784:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851857.790784:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.790784:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764355200 : -107095945196416 : ffff9e98c83acc80)
00000100:00000040:18.0:1773851857.790786:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000576c05b6 x1859597802556928/t0(0) o400->eb430038-f778-4932-abe4-8cfca1d040fb@15137@kfi7:47/0 lens 224/0 e 0 to 0 dl 1773852162 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1439-0'
00000100:00000001:18.0:1773851857.790789:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.790789:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851857.790790:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000576c05b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:eb430038-f778-4932-abe4-8cfca1d040fb+169:39547:x1859597802556928:12345-15137@kfi7:400:default-tuolumne1439-0
00000100:00000200:18.0:1773851857.790792:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597802556928
00000020:00000001:18.0:1773851857.790793:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851857.790793:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851857.790794:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.790795:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851857.790796:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851857.790797:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851857.790797:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597802556928, found 0 last_xid 1859597802130879
00000020:00000001:18.0:1773851857.790798:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851857.790799:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851857.790800:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851857.790800:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.790801:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851857.790802:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851857.790802:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851857.790805:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b60761c7.
02000000:00000001:18.0:1773851857.790805:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.790806:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.790807:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851857.790808:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063409, transno 0, xid 1859597802556928
00010000:00000001:18.0:1773851857.790809:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851857.790810:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000576c05b6 x1859597802556928/t0(0) o400->eb430038-f778-4932-abe4-8cfca1d040fb@15137@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1439-0'
00010000:00000001:18.0:1773851857.790813:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851857.790813:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851857.790814:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=90 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851857.790815:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851857.790816:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002fa22b52 refcount 3 to 15137@kfi7
00000100:00000001:18.0:1773851857.790817:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095774400 : -107152613777216 : ffff9e8b9684e0c0)
02000000:00000001:18.0:1773851857.790818:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851857.790819:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.790820:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851857.790821:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15328@kfi7
00000400:00000010:18.0:1773851857.790821:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009452328c.
00000100:00000200:18.0:1773851857.790822:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597802556928, offset 224
00000400:00000200:18.0:1773851857.790824:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15328@kfi7
00000400:00000200:18.0:1773851857.790825:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15328@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.790826:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e02fa60 nid 15328@kfi7 refs 1
00000400:00000200:18.0:1773851857.790827:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008e02fa60 nid 15328@kfi7 refs 2
00000400:00000200:18.0:1773851857.790829:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008e02fa60 nid 15328@kfi7 refs 3
00000400:00000200:18.0:1773851857.790830:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15328@kfi7 local destination
00000400:00000200:18.0:1773851857.790831:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768756:8768756:1024:4294967295] 15328@kfi7 LPNI seq info [445203:445203:16:4294967295]
00000400:00000200:18.0:1773851857.790833:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008e02fa60 nid 15328@kfi7 refs 2
00000400:00000200:18.0:1773851857.790834:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15328@kfi7 to cpt 4
00000400:00000200:18.0:1773851857.790836:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15328@kfi7(15328@kfi7:15328@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851857.790838:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008e02fa60 nid 15328@kfi7 refs 3
00000800:00000200:18.0:1773851857.790839:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851857.790840:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2054@kfi7:4 -> 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851857.790842:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2054@kfi7:4 -> 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851857.790845:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2054@kfi7:4 -> 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011c8 Using peer 15328@kfi7(0x1000000000011c8)
00000800:00000200:18.0:1773851857.790848:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008e2a52ba: Posted send of 324 bytes to peer 0x1000000000011c8: rc=0
00000800:00000200:18.0:1773851857.790850:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2054@kfi7:4 -> 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011c8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851857.790852:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851857.790853:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002fa22b52 refcount 2 to 15137@kfi7
00010000:00000001:18.0:1773851857.790854:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851857.790854:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851857.790855:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851857.790856:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000576c05b6 x1859597802556928/t0(0) o400->eb430038-f778-4932-abe4-8cfca1d040fb@15137@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1439-0'
00000100:00100000:18.0:1773851857.790858:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000576c05b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:eb430038-f778-4932-abe4-8cfca1d040fb+169:39547:x1859597802556928:12345-15137@kfi7:400:default-tuolumne1439-0 Request processed in 69us (101us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851857.790861:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2054@kfi7:4 -> 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011c8 TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851857.790862:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15137@kfi7, seq: 2156270
00000100:00000040:18.0:1773851857.790863:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009fe8894f : new rpc_count 0
00000400:00000200:17.0:1773851857.790863:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851857.790864:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851857.790864:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15328@kfi7: PUT: OK
00000100:00000001:18.0:1773851857.790865:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851857.790865:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851857.790865:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009452328c
00000400:00000010:17.0:1773851857.790865:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009452328c.
00000020:00000010:18.0:1773851857.790866:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000059dcb8dd.
00000100:00000001:17.0:1773851857.790866:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:18.0:1773851857.790867:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2d6dcb1.
00000100:00000001:17.0:1773851857.790867:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:18.0:1773851857.790868:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000009fe8894f : new refcount 168
00000100:00000001:18.0:1773851857.790868:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851857.790868:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008e02fa60 nid 15328@kfi7 refs 2
00000800:00000200:17.0:1773851857.790869:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2054@kfi7:4 -> 15328@kfi7(00000000c3571385):0x0 lsk 4553 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011c8 Transaction freed
00000400:00000200:29.0:1773851857.801732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851857.801733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:5.0:1773851857.821191:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.821192:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851857.821193:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851857.821195:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851857.821197:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8528@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.821198:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8528@kfi7 : PUT - for me
00000400:00000200:5.0:1773851857.821199:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8528@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.821200:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f964430e nid 8528@kfi7 refs 1
00000400:00000200:5.0:1773851857.821201:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8528@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.821201:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f964430e nid 8528@kfi7 refs 2
00000400:00000200:5.0:1773851857.821202:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f964430e nid 8528@kfi7 refs 3
00000400:00000200:5.0:1773851857.821203:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8592@kfi7 to cpt 4
00000400:00000200:5.0:1773851857.821204:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8592@kfi7 of length 224 into portal 12 MB=0x699e12fb80c00
00000400:00000200:5.0:1773851857.821205:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8592@kfi7 of length 224/224 into md 0x793926dc5 [64] + 121384
00000800:00000200:5.0:1773851857.821207:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851857.821208:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851857.821209:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8528@kfi7: PUT: OK
00000100:00000001:5.0:1773851857.821210:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851857.821210:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851857.821211:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000678c0caf.
00000100:00000040:5.0:1773851857.821212:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000678c0caf x1858042307546112 msgsize 224
00000100:00100000:5.0:1773851857.821213:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-8592@kfi7 (source: 12345-8528@kfi7)
00000100:00000001:5.0:1773851857.821214:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851857.821215:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f964430e nid 8528@kfi7 refs 2
00000800:00000200:5.0:1773851857.821217:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851857.821219:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851857.821219:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851857.821220:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851857.821220:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851857.821221:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851857.821222:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042307546112
00000020:00000001:5.0:1773851857.821223:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851857.821223:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91413
00000020:00000001:5.0:1773851857.821224:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851857.821225:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005dd2f4f7 refcount=18
00000020:00000001:5.0:1773851857.821225:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000020:00000001:5.0:1773851857.821226:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000100:00000001:5.0:1773851857.821227:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851857.821228:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851857.821228:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851857.821229:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851857.821230:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851857.821231:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851857.821232:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851857.821232:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851857.821233:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851857.821234:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851857.821234:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.821235:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851857.821236:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851857.821237:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851857.821237:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851857.821237:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851857.821238:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851857.821238:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8592@kfi7, seq: 2001865
00000100:00000040:5.0:1773851857.821238:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005dd2f4f7 : new rpc_count 3
00000100:00000001:7.0:1773851857.821239:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.821239:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866935296 : -107088842616320 : ffff9e9a6f939200)
00000100:00000040:5.0:1773851857.821240:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000678c0caf x1858042307546112/t0(0) o400->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:584/0 lens 224/0 e 0 to 0 dl 1773851944 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1026-0'
00000100:00000001:5.0:1773851857.821242:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851857.821242:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851857.821243:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000678c0caf pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7bede783-62a8-4786-99a3-9badf953921d+18:39687:x1858042307546112:12345-8592@kfi7:400:default-tuolumne1026-0
00000100:00000200:5.0:1773851857.821245:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042307546112
00000020:00000001:5.0:1773851857.821245:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851857.821246:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851857.821246:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.821247:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851857.821248:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851857.821248:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851857.821249:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042307546112, found 0 last_xid 1858042307467967
00000020:00000001:5.0:1773851857.821250:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851857.821250:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851857.821251:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851857.821251:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.821252:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851857.821252:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851857.821253:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851857.821254:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004dc22896.
02000000:00000001:5.0:1773851857.821254:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.821255:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.821255:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851857.821256:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106304180, transno 0, xid 1858042307546112
00010000:00000001:5.0:1773851857.821257:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851857.821257:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000678c0caf x1858042307546112/t0(0) o400->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1026-0'
00010000:00000001:5.0:1773851857.821260:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851857.821260:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851857.821261:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=89 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851857.821262:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851857.821262:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000615435d3 refcount 3 to 8592@kfi7
00000100:00000001:5.0:1773851857.821263:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517664 : -107156126033952 : ffff9e8ac52c17e0)
02000000:00000001:5.0:1773851857.821264:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851857.821264:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851857.821265:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851857.821265:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8528@kfi7
00000400:00000010:5.0:1773851857.821266:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c6d08d7.
00000100:00000200:5.0:1773851857.821267:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042307546112, offset 224
00000400:00000200:5.0:1773851857.821268:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8528@kfi7
00000400:00000200:5.0:1773851857.821269:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8528@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.821269:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f964430e nid 8528@kfi7 refs 1
00000400:00000200:5.0:1773851857.821270:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f964430e nid 8528@kfi7 refs 2
00000400:00000200:5.0:1773851857.821271:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f964430e nid 8528@kfi7 refs 3
00000400:00000200:5.0:1773851857.821272:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8528@kfi7 local destination
00000400:00000200:5.0:1773851857.821273:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768757:8768757:1024:4294967295] 8528@kfi7 LPNI seq info [4508238:4508238:16:4294967295]
00000400:00000200:5.0:1773851857.821275:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f964430e nid 8528@kfi7 refs 2
00000400:00000200:5.0:1773851857.821275:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8528@kfi7 to cpt 1
00000400:00000200:5.0:1773851857.821277:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8528@kfi7(8528@kfi7:8528@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851857.821278:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f964430e nid 8528@kfi7 refs 3
00000800:00000200:5.0:1773851857.821279:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851857.821281:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851857.821282:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851857.821285:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000695 Using peer 8528@kfi7(0x100000000000695)
00000800:00000200:5.0:1773851857.821287:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x100000000000695: rc=0
00000800:00000200:5.0:1773851857.821289:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000695 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851857.821291:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851857.821291:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000615435d3 refcount 2 to 8592@kfi7
00010000:00000001:5.0:1773851857.821292:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851857.821292:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851857.821293:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851857.821294:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000678c0caf x1858042307546112/t0(0) o400->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:584/0 lens 224/224 e 0 to 0 dl 1773851944 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1026-0'
00000100:00100000:5.0:1773851857.821296:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000678c0caf pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7bede783-62a8-4786-99a3-9badf953921d+18:39687:x1858042307546112:12345-8592@kfi7:400:default-tuolumne1026-0 Request processed in 53us (84us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851857.821298:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8592@kfi7, seq: 2001865
00000100:00000040:5.0:1773851857.821299:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005dd2f4f7 : new rpc_count 2
00000100:00000001:5.0:1773851857.821300:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851857.821300:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851857.821301:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851857.821301:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000800:00000200:6.0:1773851857.821302:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000695 TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851857.821302:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:5.0:1773851857.821303:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000005dd2f4f7 : new refcount 17
00000100:00000001:5.0:1773851857.821303:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851857.821304:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851857.821305:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8528@kfi7: PUT: OK
00000400:00000200:6.0:1773851857.821306:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c6d08d7
00000400:00000010:6.0:1773851857.821306:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c6d08d7.
00000100:00000001:6.0:1773851857.821307:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851857.821307:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851857.821308:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f964430e nid 8528@kfi7 refs 2
00000800:00000200:6.0:1773851857.821310:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 8528@kfi7(000000009cf91c3a):0x0 lsk 1686 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000695 Transaction freed
00000800:00000200:25.0:1773851857.918375:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851857.918376:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851857.918378:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851857.918382:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851857.918385:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24882@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.918388:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24882@kfi7 : PUT - for me
00000400:00000200:25.0:1773851857.918390:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24882@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.918391:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ee1ceab nid 24882@kfi7 refs 1
00000400:00000200:25.0:1773851857.918392:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24882@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.918393:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ee1ceab nid 24882@kfi7 refs 2
00000400:00000200:25.0:1773851857.918394:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004ee1ceab nid 24882@kfi7 refs 3
00000400:00000200:25.0:1773851857.918396:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24882@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.918397:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24882@kfi7 of length 224 into portal 12 MB=0x699e167d27cc0
00000400:00000200:25.0:1773851857.918399:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24882@kfi7 of length 224/224 into md 0x16159c6179 [64] + 184208
00000800:00000200:25.0:1773851857.918402:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851857.918405:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851857.918406:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24882@kfi7: PUT: OK
00000100:00000001:25.0:1773851857.918408:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851857.918408:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851857.918410:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000d0d2edc.
00000100:00000040:25.0:1773851857.918411:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000000d0d2edc x1858043248803008 msgsize 224
00000100:00100000:25.0:1773851857.918413:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24882@kfi7 (source: 12345-24882@kfi7)
00000100:00000001:25.0:1773851857.918415:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851857.918416:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004ee1ceab nid 24882@kfi7 refs 2
00000100:00000001:26.0:1773851857.918417:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851857.918418:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851857.918418:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851857.918419:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851857.918420:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851857.918421:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851857.918422:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043248803008
00000020:00000001:26.0:1773851857.918423:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851857.918424:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92db2
00000020:00000001:26.0:1773851857.918425:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851857.918426:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f91469f1 refcount=6
00000020:00000001:26.0:1773851857.918427:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744435712 : -107128965115904 : ffff9e911816d000)
00000020:00000001:26.0:1773851857.918429:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744435712 : -107128965115904 : ffff9e911816d000)
00000100:00000001:26.0:1773851857.918430:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851857.918431:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851857.918432:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:26.0:1773851857.918434:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851857.918435:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000001:26.0:1773851857.918436:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851857.918437:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851857.918438:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851857.918439:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851857.918440:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851857.918441:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.918442:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851857.918444:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851857.918445:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851857.918445:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851857.918445:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851857.918447:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24882@kfi7, seq: 2025058
00000100:00000040:26.0:1773851857.918448:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f91469f1 : new rpc_count 1
00000100:00000001:24.0:1773851857.918448:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.918449:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023482849408 : -107050226702208 : ffff9ea36d43a880)
00000100:00000001:24.0:1773851857.918449:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.918451:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000d0d2edc x1858043248803008/t0(0) o400->af16dfb1-1830-4dc6-8952-879f2b900648@24882@kfi7:74/0 lens 224/0 e 0 to 0 dl 1773852189 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2041-0'
00000100:00000001:26.0:1773851857.918456:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851857.918457:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851857.918459:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d0d2edc pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:af16dfb1-1830-4dc6-8952-879f2b900648+6:39838:x1858043248803008:12345-24882@kfi7:400:default-tuolumne2041-0
00000100:00000200:26.0:1773851857.918461:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043248803008
00000020:00000001:26.0:1773851857.918461:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851857.918462:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851857.918463:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.918465:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851857.918465:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851857.918467:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851857.918468:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043248803008, found 0 last_xid 1858043248803007
00000020:00000001:26.0:1773851857.918469:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851857.918470:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851857.918471:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851857.918472:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.918473:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851857.918474:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851857.918474:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851857.918475:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e6a23b2.
02000000:00000001:26.0:1773851857.918476:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.918477:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.918478:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851857.918479:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183047143912, transno 0, xid 1858043248803008
00010000:00000001:26.0:1773851857.918481:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851857.918482:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000d0d2edc x1858043248803008/t0(0) o400->af16dfb1-1830-4dc6-8952-879f2b900648@24882@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2041-0'
00010000:00000001:26.0:1773851857.918486:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851857.918487:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851857.918488:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=90 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851857.918490:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851857.918491:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c57c1bd7 refcount 3 to 24882@kfi7
00000100:00000001:26.0:1773851857.918492:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740928 : -107139395810688 : ffff9e8eaa5f0a80)
02000000:00000001:26.0:1773851857.918494:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851857.918495:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.918496:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851857.918497:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24882@kfi7
00000400:00000010:26.0:1773851857.918498:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f9444cf1.
00000100:00000200:26.0:1773851857.918499:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043248803008, offset 224
00000400:00000200:26.0:1773851857.918501:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24882@kfi7
00000400:00000200:26.0:1773851857.918503:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24882@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.918504:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ee1ceab nid 24882@kfi7 refs 1
00000400:00000200:26.0:1773851857.918506:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004ee1ceab nid 24882@kfi7 refs 2
00000400:00000200:26.0:1773851857.918508:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004ee1ceab nid 24882@kfi7 refs 3
00000400:00000200:26.0:1773851857.918510:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24882@kfi7 local destination
00000400:00000200:26.0:1773851857.918512:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768758:8768758:1024:4294967295] 24882@kfi7 LPNI seq info [1020002:1020002:16:4294967295]
00000400:00000200:26.0:1773851857.918514:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004ee1ceab nid 24882@kfi7 refs 2
00000400:00000200:26.0:1773851857.918516:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24882@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.918519:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24882@kfi7(24882@kfi7:24882@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851857.918521:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004ee1ceab nid 24882@kfi7 refs 3
00000800:00000200:26.0:1773851857.918523:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851857.918525:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851857.918529:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851857.918532:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x81a Using peer 24882@kfi7(0x81a)
00000800:00000200:26.0:1773851857.918537:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0x81a: rc=0
00000800:00000200:26.0:1773851857.918539:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x81a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851857.918542:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.918544:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c57c1bd7 refcount 2 to 24882@kfi7
00010000:00000001:26.0:1773851857.918545:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851857.918546:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.918547:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851857.918549:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000d0d2edc x1858043248803008/t0(0) o400->af16dfb1-1830-4dc6-8952-879f2b900648@24882@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2041-0'
00000100:00100000:26.0:1773851857.918554:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d0d2edc pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:af16dfb1-1830-4dc6-8952-879f2b900648+6:39838:x1858043248803008:12345-24882@kfi7:400:default-tuolumne2041-0 Request processed in 96us (142us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851857.918554:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x81a TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851857.918557:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24882@kfi7, seq: 2025058
00000400:00000200:25.0:1773851857.918557:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:26.0:1773851857.918558:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f91469f1 : new rpc_count 0
00000400:00000200:25.0:1773851857.918558:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24882@kfi7: PUT: OK
00000100:00000001:26.0:1773851857.918560:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851857.918560:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f9444cf1
00000400:00000010:25.0:1773851857.918560:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f9444cf1.
00000100:00000001:26.0:1773851857.918561:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851857.918561:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:26.0:1773851857.918562:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000100:00000001:25.0:1773851857.918562:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:26.0:1773851857.918563:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000400:00000200:25.0:1773851857.918563:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004ee1ceab nid 24882@kfi7 refs 2
00000020:00000010:26.0:1773851857.918564:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000020:00000040:26.0:1773851857.918565:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000f91469f1 : new refcount 5
00000100:00000001:26.0:1773851857.918566:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851857.918566:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 24882@kfi7(00000000fba49516):0x0 lsk 2075 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x81a Transaction freed
00000800:00000200:17.0:1773851857.925767:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851857.925768:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851857.925769:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851857.925771:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851857.925772:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.925775:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21585@kfi7 : PUT - for me
00000400:00000200:17.0:1773851857.925775:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.925776:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 1
00000400:00000200:17.0:1773851857.925777:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.925778:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000400:00000200:17.0:1773851857.925778:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 3
00000400:00000200:17.0:1773851857.925779:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851857.925780:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21585@kfi7 of length 224 into portal 12 MB=0x69b0a62863740
00000400:00000200:17.0:1773851857.925781:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21585@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 192320
00000800:00000200:17.0:1773851857.925783:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851857.925785:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851857.925786:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21585@kfi7: PUT: OK
00000100:00000001:17.0:1773851857.925787:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851857.925788:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851857.925788:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a9064e84.
00000100:00000040:17.0:1773851857.925789:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a9064e84 x1859318765205312 msgsize 224
00000100:00100000:17.0:1773851857.925791:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21585@kfi7 (source: 12345-21585@kfi7)
00000100:00000001:17.0:1773851857.925792:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:18.0:1773851857.925793:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851857.925793:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 2
02000000:00000001:18.0:1773851857.925794:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851857.925794:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851857.925794:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851857.925795:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851857.925796:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851857.925796:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318765205312
00000020:00000001:18.0:1773851857.925797:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851857.925797:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f8e
00000020:00000001:18.0:1773851857.925798:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851857.925800:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cc7a8a1a refcount=4084
00000020:00000001:18.0:1773851857.925801:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744911872 : -107128964639744 : ffff9e91181e1400)
00000020:00000001:18.0:1773851857.925801:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744911872 : -107128964639744 : ffff9e91181e1400)
00000100:00000001:18.0:1773851857.925802:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851857.925803:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851857.925804:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a2d6dcb1.
00000020:00000010:18.0:1773851857.925805:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851857.925805:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000059dcb8dd.
00000100:00000001:18.0:1773851857.925806:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851857.925806:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851857.925807:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851857.925808:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851857.925808:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851857.925808:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851857.925809:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851857.925811:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851857.925811:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851857.925811:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851857.925811:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851857.925812:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21585@kfi7, seq: 2156271
00000100:00000040:19.0:1773851857.925813:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cc7a8a1a : new rpc_count 22
00000100:00000001:18.0:1773851857.925813:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851857.925814:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764349440 : -107095945202176 : ffff9e98c83ab600)
00000100:00000001:18.0:1773851857.925814:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851857.925815:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a9064e84 x1859318765205312/t0(0) o400->592c507f-ccd6-4044-839f-fd99d46495b1@21585@kfi7:47/0 lens 224/0 e 0 to 0 dl 1773852162 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1842-0'
00000100:00000001:19.0:1773851857.925818:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851857.925819:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851857.925820:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9064e84 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:592c507f-ccd6-4044-839f-fd99d46495b1+4084:39445:x1859318765205312:12345-21585@kfi7:400:default-tuolumne1842-0
00000100:00000200:19.0:1773851857.925821:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318765205312
00000020:00000001:19.0:1773851857.925822:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851857.925822:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851857.925823:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851857.925824:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851857.925824:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851857.925825:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851857.925826:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318765205312, found 0 last_xid 1859318764449279
00000020:00000001:19.0:1773851857.925826:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851857.925827:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851857.925827:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851857.925828:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851857.925829:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851857.925829:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851857.925830:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851857.925830:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008fb2f5f8.
02000000:00000001:19.0:1773851857.925831:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851857.925832:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851857.925832:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851857.925833:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592388, transno 0, xid 1859318765205312
00010000:00000001:19.0:1773851857.925834:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851857.925835:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a9064e84 x1859318765205312/t0(0) o400->592c507f-ccd6-4044-839f-fd99d46495b1@21585@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1842-0'
00010000:00000001:19.0:1773851857.925837:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851857.925838:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851857.925838:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=90 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851857.925840:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851857.925841:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001bda23be refcount 3 to 21585@kfi7
00000100:00000001:19.0:1773851857.925841:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583903168 : -107156125648448 : ffff9e8ac531f9c0)
02000000:00000001:19.0:1773851857.925842:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851857.925843:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851857.925844:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851857.925844:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21585@kfi7
00000400:00000010:19.0:1773851857.925845:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a69e3aa9.
00000100:00000200:19.0:1773851857.925846:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318765205312, offset 224
00000400:00000200:19.0:1773851857.925847:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21585@kfi7
00000400:00000200:19.0:1773851857.925848:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:19.0:1773851857.925849:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 1
00000400:00000200:19.0:1773851857.925850:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000400:00000200:19.0:1773851857.925851:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 3
00000400:00000200:19.0:1773851857.925852:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21585@kfi7 local destination
00000400:00000200:19.0:1773851857.925853:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768759:8768759:1024:4294967295] 21585@kfi7 LPNI seq info [8783151:8783151:16:4294967295]
00000400:00000200:19.0:1773851857.925855:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000400:00000200:19.0:1773851857.925855:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:19.0:1773851857.925857:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21585@kfi7(21585@kfi7:21585@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851857.925858:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 3
00000800:00000200:19.0:1773851857.925860:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851857.925861:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851857.925863:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851857.925865:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000000fd Using peer 21585@kfi7(0x1000000000000fd)
00000800:00000200:19.0:1773851857.925868:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x1000000000000fd: rc=0
00000800:00000200:19.0:1773851857.925870:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000000fd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851857.925872:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851857.925873:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001bda23be refcount 2 to 21585@kfi7
00010000:00000001:19.0:1773851857.925874:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851857.925874:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851857.925875:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851857.925876:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a9064e84 x1859318765205312/t0(0) o400->592c507f-ccd6-4044-839f-fd99d46495b1@21585@kfi7:47/0 lens 224/224 e 0 to 0 dl 1773852162 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1842-0'
00000100:00100000:19.0:1773851857.925879:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9064e84 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:592c507f-ccd6-4044-839f-fd99d46495b1+4084:39445:x1859318765205312:12345-21585@kfi7:400:default-tuolumne1842-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851857.925881:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21585@kfi7, seq: 2156271
00000100:00000040:19.0:1773851857.925881:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cc7a8a1a : new rpc_count 21
00000800:00000200:17.0:1773851857.925881:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000000fd TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851857.925882:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851857.925882:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851857.925883:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851857.925883:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851857.925883:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21585@kfi7: PUT: OK
00000020:00000010:19.0:1773851857.925884:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000059dcb8dd.
00000400:00000200:17.0:1773851857.925884:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a69e3aa9
00000020:00000010:19.0:1773851857.925885:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a2d6dcb1.
00000400:00000010:17.0:1773851857.925885:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a69e3aa9.
00000100:00000001:17.0:1773851857.925885:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851857.925885:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:19.0:1773851857.925886:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000cc7a8a1a : new refcount 4083
00000100:00000001:19.0:1773851857.925886:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851857.925886:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000800:00000200:17.0:1773851857.925888:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 21585@kfi7(000000002c6dba9f):0x0 lsk 254 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000000fd Transaction freed
00000800:00000200:25.0:1773851857.995934:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851857.995935:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851857.995937:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851857.995940:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851857.995943:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10323@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.995945:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10323@kfi7 : PUT - for me
00000400:00000200:25.0:1773851857.995947:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10323@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.995948:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8de945 nid 10323@kfi7 refs 1
00000400:00000200:25.0:1773851857.995949:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10323@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.995950:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8de945 nid 10323@kfi7 refs 2
00000400:00000200:25.0:1773851857.995951:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b8de945 nid 10323@kfi7 refs 3
00000400:00000200:25.0:1773851857.995953:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10386@kfi7 to cpt 6
00000400:00000200:25.0:1773851857.995954:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10386@kfi7 of length 224 into portal 12 MB=0x69b44666442c0
00000400:00000200:25.0:1773851857.995956:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10386@kfi7 of length 224/224 into md 0x16159c6179 [64] + 184432
00000800:00000200:25.0:1773851857.995959:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851857.995961:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851857.995962:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10323@kfi7: PUT: OK
00000100:00000001:25.0:1773851857.995964:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851857.995964:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851857.995965:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004221a876.
00000100:00000040:25.0:1773851857.995966:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000004221a876 x1859567938192064 msgsize 224
00000100:00100000:25.0:1773851857.995969:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10386@kfi7 (source: 12345-10323@kfi7)
00000100:00000001:25.0:1773851857.995970:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851857.995971:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009b8de945 nid 10323@kfi7 refs 2
00000100:00000001:26.0:1773851857.995973:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851857.995973:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851857.995974:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851857.995974:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851857.995975:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851857.995976:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851857.995977:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859567938192064
00000020:00000001:26.0:1773851857.995978:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851857.995979:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07d911de64e
00000020:00000001:26.0:1773851857.995980:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851857.995982:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007c46430a refcount=40
00000020:00000001:26.0:1773851857.995983:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637116369824768 : -106957339726848 : ffff9eb90dc26c00)
00000020:00000001:26.0:1773851857.995984:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637116369824768 : -106957339726848 : ffff9eb90dc26c00)
00000100:00000001:26.0:1773851857.995986:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851857.995987:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851857.995988:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:26.0:1773851857.995990:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851857.995991:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000001:26.0:1773851857.995992:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851857.995993:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851857.995994:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851857.995996:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851857.995997:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851857.995997:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.995999:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851857.996001:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851857.996001:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851857.996002:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851857.996002:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851857.996004:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10386@kfi7, seq: 2025059
00000100:00000040:26.0:1773851857.996005:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007c46430a : new rpc_count 2
00000100:00000001:24.0:1773851857.996005:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.996006:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023482844800 : -107050226706816 : ffff9ea36d439680)
00000100:00000001:24.0:1773851857.996006:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.996008:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004221a876 x1859567938192064/t0(0) o400->49a8a4b7-74c4-47ed-b9ef-d4774f09047d@10386@kfi7:74/0 lens 224/0 e 0 to 0 dl 1773852189 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1142-0'
00000100:00000001:26.0:1773851857.996013:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851857.996013:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851857.996015:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004221a876 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:49a8a4b7-74c4-47ed-b9ef-d4774f09047d+40:39799:x1859567938192064:12345-10386@kfi7:400:default-tuolumne1142-0
00000100:00000200:26.0:1773851857.996017:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859567938192064
00000020:00000001:26.0:1773851857.996018:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851857.996019:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851857.996020:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.996021:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851857.996022:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851857.996023:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851857.996024:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859567938192064, found 0 last_xid 1859567937624063
00000020:00000001:26.0:1773851857.996026:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851857.996027:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851857.996028:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851857.996029:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.996030:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851857.996031:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851857.996032:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851857.996033:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd5c6346.
02000000:00000001:26.0:1773851857.996034:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.996035:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.996038:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851857.996039:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589112, transno 0, xid 1859567938192064
00010000:00000001:26.0:1773851857.996040:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851857.996042:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004221a876 x1859567938192064/t0(0) o400->49a8a4b7-74c4-47ed-b9ef-d4774f09047d@10386@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1142-0'
00010000:00000001:26.0:1773851857.996047:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851857.996047:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851857.996049:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=90 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851857.996051:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851857.996052:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000067dd3b7e refcount 3 to 10386@kfi7
00000100:00000001:26.0:1773851857.996053:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331872 : -107155410219744 : ffff9e8aefd68d20)
02000000:00000001:26.0:1773851857.996055:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851857.996056:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851857.996057:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851857.996058:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10323@kfi7
00000400:00000010:26.0:1773851857.996059:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d13b1817.
00000100:00000200:26.0:1773851857.996061:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859567938192064, offset 224
00000400:00000200:26.0:1773851857.996063:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10323@kfi7
00000400:00000200:26.0:1773851857.996065:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10323@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.996066:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8de945 nid 10323@kfi7 refs 1
00000400:00000200:26.0:1773851857.996068:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b8de945 nid 10323@kfi7 refs 2
00000400:00000200:26.0:1773851857.996071:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b8de945 nid 10323@kfi7 refs 3
00000400:00000200:26.0:1773851857.996073:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10323@kfi7 local destination
00000400:00000200:26.0:1773851857.996075:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768760:8768760:1024:4294967295] 10323@kfi7 LPNI seq info [10977960:10977960:16:4294967295]
00000400:00000200:26.0:1773851857.996078:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009b8de945 nid 10323@kfi7 refs 2
00000400:00000200:26.0:1773851857.996079:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10323@kfi7 to cpt 6
00000400:00000200:26.0:1773851857.996083:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10323@kfi7(10323@kfi7:10323@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851857.996085:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b8de945 nid 10323@kfi7 refs 3
00000800:00000200:26.0:1773851857.996088:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851857.996090:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851857.996094:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851857.996098:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c90 Using peer 10323@kfi7(0x100000000000c90)
00000800:00000200:26.0:1773851857.996104:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x100000000000c90: rc=0
00000800:00000200:26.0:1773851857.996106:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c90 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851857.996110:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851857.996111:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000067dd3b7e refcount 2 to 10386@kfi7
00010000:00000001:26.0:1773851857.996113:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851857.996114:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851857.996115:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851857.996116:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004221a876 x1859567938192064/t0(0) o400->49a8a4b7-74c4-47ed-b9ef-d4774f09047d@10386@kfi7:74/0 lens 224/224 e 0 to 0 dl 1773852189 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1142-0'
00000800:00000200:25.0:1773851857.996121:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c90 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851857.996122:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004221a876 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:49a8a4b7-74c4-47ed-b9ef-d4774f09047d+40:39799:x1859567938192064:12345-10386@kfi7:400:default-tuolumne1142-0 Request processed in 108us (154us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851857.996127:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10386@kfi7, seq: 2025059
00000100:00000040:26.0:1773851857.996128:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007c46430a : new rpc_count 1
00000400:00000200:25.0:1773851857.996128:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851857.996129:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851857.996130:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851857.996130:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10323@kfi7: PUT: OK
00000020:00000010:26.0:1773851857.996131:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851857.996131:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d13b1817
00000020:00000010:26.0:1773851857.996132:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000400:00000010:25.0:1773851857.996132:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d13b1817.
00000100:00000001:25.0:1773851857.996133:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:26.0:1773851857.996134:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000100:00000001:25.0:1773851857.996134:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:26.0:1773851857.996135:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000007c46430a : new refcount 39
00000400:00000200:25.0:1773851857.996135:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009b8de945 nid 10323@kfi7 refs 2
00000100:00000001:26.0:1773851857.996136:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851857.996138:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 10323@kfi7(00000000a37b8ba1):0x0 lsk 3217 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c90 Transaction freed
00000800:00000200:25.0:1773851858.006443:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.006444:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.006445:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.006447:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851858.006448:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13682@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.006449:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13682@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.006450:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13682@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.006451:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008289892d nid 13682@kfi7 refs 1
00000400:00000200:25.0:1773851858.006451:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13682@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.006452:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008289892d nid 13682@kfi7 refs 2
00000400:00000200:25.0:1773851858.006453:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008289892d nid 13682@kfi7 refs 3
00000400:00000200:25.0:1773851858.006453:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13683@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.006454:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13683@kfi7 of length 224 into portal 12 MB=0x69b0a42a69780
00000400:00000200:25.0:1773851858.006455:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13683@kfi7 of length 224/224 into md 0x16159c6179 [64] + 184656
00000800:00000200:25.0:1773851858.006456:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.006458:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.006458:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13682@kfi7: PUT: OK
00000100:00000001:25.0:1773851858.006459:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.006459:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851858.006460:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bbfcc57a.
00000100:00000040:25.0:1773851858.006461:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bbfcc57a x1859318230456192 msgsize 224
00000100:00100000:25.0:1773851858.006462:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-13683@kfi7 (source: 12345-13682@kfi7)
00000100:00000001:25.0:1773851858.006463:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851858.006463:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008289892d nid 13682@kfi7 refs 2
00000100:00000001:26.0:1773851858.006464:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851858.006464:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851858.006465:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851858.006465:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851858.006465:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851858.006466:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851858.006467:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318230456192
00000020:00000001:26.0:1773851858.006467:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851858.006467:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9186c
00000020:00000001:26.0:1773851858.006468:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851858.006469:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007665523a refcount=165
00000020:00000001:26.0:1773851858.006470:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241731072 : -107152467820544 : ffff9e8b9f380000)
00000020:00000001:26.0:1773851858.006471:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241731072 : -107152467820544 : ffff9e8b9f380000)
00000100:00000001:26.0:1773851858.006472:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851858.006472:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851858.006473:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:26.0:1773851858.006473:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851858.006474:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000001:26.0:1773851858.006474:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851858.006475:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851858.006475:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851858.006476:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851858.006476:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851858.006477:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.006477:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851858.006478:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851858.006478:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851858.006479:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13683@kfi7, seq: 2025060
00000100:00000001:24.0:1773851858.006479:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851858.006479:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851858.006480:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007665523a : new rpc_count 1
00000100:00000001:26.0:1773851858.006480:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023482858624 : -107050226692992 : ffff9ea36d43cc80)
00000100:00000001:24.0:1773851858.006480:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.006481:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851858.006482:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bbfcc57a x1859318230456192/t0(0) o400->7942ab61-ce00-451d-9039-e81b4360cc8c@13683@kfi7:75/0 lens 224/0 e 0 to 0 dl 1773852190 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1338-0'
00000100:00000001:26.0:1773851858.006484:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851858.006484:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851858.006485:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbfcc57a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7942ab61-ce00-451d-9039-e81b4360cc8c+165:39692:x1859318230456192:12345-13683@kfi7:400:default-tuolumne1338-0
00000100:00000200:26.0:1773851858.006486:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318230456192
00000020:00000001:26.0:1773851858.006487:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851858.006487:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851858.006488:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.006488:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851858.006489:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851858.006490:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851858.006490:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318230456192, found 0 last_xid 1859318230034111
00000020:00000001:26.0:1773851858.006491:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851858.006492:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851858.006492:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851858.006493:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.006493:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851858.006494:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851858.006494:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851858.006494:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea84f226.
02000000:00000001:26.0:1773851858.006495:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.006495:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.006496:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851858.006496:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063079, transno 0, xid 1859318230456192
00010000:00000001:26.0:1773851858.006497:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851858.006498:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bbfcc57a x1859318230456192/t0(0) o400->7942ab61-ce00-451d-9039-e81b4360cc8c@13683@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1338-0'
00010000:00000001:26.0:1773851858.006500:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851858.006501:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851858.006501:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=91 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851858.006502:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851858.006503:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f6ba3626 refcount 3 to 13683@kfi7
00000100:00000001:26.0:1773851858.006503:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231611744 : -107130477939872 : ffff9e90bdeaf360)
02000000:00000001:26.0:1773851858.006504:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851858.006505:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.006505:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851858.006506:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13682@kfi7
00000400:00000010:26.0:1773851858.006506:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079b55fe1.
00000100:00000200:26.0:1773851858.006507:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318230456192, offset 224
00000400:00000200:26.0:1773851858.006508:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13682@kfi7
00000400:00000200:26.0:1773851858.006509:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13682@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.006510:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008289892d nid 13682@kfi7 refs 1
00000400:00000200:26.0:1773851858.006511:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008289892d nid 13682@kfi7 refs 2
00000400:00000200:26.0:1773851858.006512:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008289892d nid 13682@kfi7 refs 3
00000400:00000200:26.0:1773851858.006513:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13682@kfi7 local destination
00000400:00000200:26.0:1773851858.006515:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768761:8768761:1024:4294967295] 13682@kfi7 LPNI seq info [8027450:8027450:16:4294967295]
00000400:00000200:26.0:1773851858.006516:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008289892d nid 13682@kfi7 refs 2
00000400:00000200:26.0:1773851858.006517:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13682@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.006518:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13682@kfi7(13682@kfi7:13682@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851858.006520:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008289892d nid 13682@kfi7 refs 3
00000800:00000200:26.0:1773851858.006521:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.006522:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851858.006523:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851858.006525:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb73 Using peer 13682@kfi7(0xb73)
00000800:00000200:26.0:1773851858.006528:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0xb73: rc=0
00000800:00000200:26.0:1773851858.006530:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb73 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851858.006531:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851858.006532:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f6ba3626 refcount 2 to 13683@kfi7
00010000:00000001:26.0:1773851858.006532:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851858.006533:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.006533:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851858.006534:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bbfcc57a x1859318230456192/t0(0) o400->7942ab61-ce00-451d-9039-e81b4360cc8c@13683@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1338-0'
00000100:00100000:26.0:1773851858.006537:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbfcc57a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7942ab61-ce00-451d-9039-e81b4360cc8c+165:39692:x1859318230456192:12345-13683@kfi7:400:default-tuolumne1338-0 Request processed in 52us (75us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851858.006539:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13683@kfi7, seq: 2025060
00000100:00000040:26.0:1773851858.006540:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007665523a : new rpc_count 0
00000100:00000001:26.0:1773851858.006541:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851858.006541:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851858.006541:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb73 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851858.006542:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851858.006542:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000400:00000200:25.0:1773851858.006542:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851858.006543:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000400:00000200:25.0:1773851858.006543:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13682@kfi7: PUT: OK
00000020:00000040:26.0:1773851858.006544:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000007665523a : new refcount 164
00000400:00000200:25.0:1773851858.006544:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079b55fe1
00000400:00000010:25.0:1773851858.006544:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079b55fe1.
00000100:00000001:26.0:1773851858.006545:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.006545:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851858.006545:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851858.006546:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008289892d nid 13682@kfi7 refs 2
00000800:00000200:25.0:1773851858.006547:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 13682@kfi7(00000000153cb346):0x0 lsk 2932 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb73 Transaction freed
00000800:00000200:17.0:1773851858.011018:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851858.011019:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851858.011020:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851858.011022:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851858.011024:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.011025:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21169@kfi7 : PUT - for me
00000400:00000200:17.0:1773851858.011026:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.011027:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 1
00000400:00000200:17.0:1773851858.011028:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.011028:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000400:00000200:17.0:1773851858.011029:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 3
00000400:00000200:17.0:1773851858.011030:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21104@kfi7 to cpt 6
00000400:00000200:17.0:1773851858.011031:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21104@kfi7 of length 224 into portal 12 MB=0x69b0a1bb72600
00000400:00000200:17.0:1773851858.011032:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21104@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 192544
00000800:00000200:17.0:1773851858.011034:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851858.011036:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851858.011037:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21169@kfi7: PUT: OK
00000100:00000001:17.0:1773851858.011037:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851858.011038:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851858.011039:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000082198b88.
00000100:00000040:17.0:1773851858.011040:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000082198b88 x1859317577229824 msgsize 224
00000100:00100000:17.0:1773851858.011041:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21104@kfi7 (source: 12345-21169@kfi7)
00000100:00000001:17.0:1773851858.011042:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851858.011043:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851858.011043:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
02000000:00000001:19.0:1773851858.011044:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851858.011044:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851858.011044:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851858.011045:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851858.011046:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851858.011047:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317577229824
00000020:00000001:19.0:1773851858.011047:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851858.011048:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9254d
00000020:00000001:19.0:1773851858.011048:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851858.011050:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001838e913 refcount=6
00000020:00000001:19.0:1773851858.011051:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630773760 : -107123078777856 : ffff9e9276f13400)
00000020:00000001:19.0:1773851858.011052:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630773760 : -107123078777856 : ffff9e9276f13400)
00000100:00000001:19.0:1773851858.011053:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.011054:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851858.011055:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851858.011056:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.011057:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851858.011058:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851858.011059:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851858.011059:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.011060:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851858.011061:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851858.011061:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.011062:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.011063:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851858.011064:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851858.011064:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851858.011064:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851858.011065:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21104@kfi7, seq: 2156272
00000100:00000040:19.0:1773851858.011066:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001838e913 : new rpc_count 1
00000100:00000001:18.0:1773851858.011066:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.011067:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764354048 : -107095945197568 : ffff9e98c83ac800)
00000100:00000001:18.0:1773851858.011067:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.011068:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000082198b88 x1859317577229824/t0(0) o400->19046a5a-1c0b-46ff-ba7a-6f763b9bf826@21104@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1806-0'
00000100:00000001:19.0:1773851858.011071:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.011071:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851858.011073:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082198b88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:19046a5a-1c0b-46ff-ba7a-6f763b9bf826+6:39731:x1859317577229824:12345-21104@kfi7:400:default-tuolumne1806-0
00000100:00000200:19.0:1773851858.011074:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317577229824
00000020:00000001:19.0:1773851858.011075:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851858.011076:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851858.011076:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.011077:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851858.011078:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851858.011079:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851858.011079:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317577229824, found 0 last_xid 1859317577229823
00000020:00000001:19.0:1773851858.011080:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851858.011081:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851858.011081:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851858.011082:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.011083:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851858.011083:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851858.011084:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851858.011085:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d828c161.
02000000:00000001:19.0:1773851858.011086:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.011086:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.011087:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851858.011088:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317577229824
00010000:00000001:19.0:1773851858.011089:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851858.011090:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000082198b88 x1859317577229824/t0(0) o400->19046a5a-1c0b-46ff-ba7a-6f763b9bf826@21104@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1806-0'
00010000:00000001:19.0:1773851858.011092:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851858.011093:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851858.011094:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=91 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851858.011095:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851858.011096:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000088756bad refcount 5 to 21104@kfi7
00000100:00000001:19.0:1773851858.011097:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092337312 : -107152617214304 : ffff9e8b96506ea0)
02000000:00000001:19.0:1773851858.011098:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851858.011098:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.011099:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851858.011100:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21169@kfi7
00000400:00000010:19.0:1773851858.011101:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001c1fd52d.
00000100:00000200:19.0:1773851858.011102:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317577229824, offset 224
00000400:00000200:19.0:1773851858.011104:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21169@kfi7
00000400:00000200:19.0:1773851858.011105:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.011106:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 1
00000400:00000200:19.0:1773851858.011108:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000400:00000200:19.0:1773851858.011110:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 3
00000400:00000200:19.0:1773851858.011112:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21169@kfi7 local destination
00000400:00000200:19.0:1773851858.011114:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768762:8768762:1024:4294967295] 21169@kfi7 LPNI seq info [386268:386268:16:4294967295]
00000400:00000200:19.0:1773851858.011116:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000400:00000200:19.0:1773851858.011118:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.011121:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21169@kfi7(21169@kfi7:21169@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851858.011124:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 3
00000800:00000200:19.0:1773851858.011126:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851858.011129:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851858.011133:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851858.011137:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000316 Using peer 21169@kfi7(0x100000000000316)
00000800:00000200:19.0:1773851858.011142:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x100000000000316: rc=0
00000800:00000200:19.0:1773851858.011145:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000316 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851858.011148:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.011149:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000088756bad refcount 4 to 21104@kfi7
00010000:00000001:19.0:1773851858.011151:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851858.011152:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.011153:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851858.011154:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000082198b88 x1859317577229824/t0(0) o400->19046a5a-1c0b-46ff-ba7a-6f763b9bf826@21104@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1806-0'
00000800:00000200:17.0:1773851858.011159:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000316 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851858.011160:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082198b88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:19046a5a-1c0b-46ff-ba7a-6f763b9bf826+6:39731:x1859317577229824:12345-21104@kfi7:400:default-tuolumne1806-0 Request processed in 88us (119us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851858.011164:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21104@kfi7, seq: 2156272
00000100:00000040:19.0:1773851858.011165:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001838e913 : new rpc_count 0
00000100:00000001:19.0:1773851858.011166:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851858.011166:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851858.011167:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851858.011168:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851858.011168:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21169@kfi7: PUT: OK
00000400:00000200:17.0:1773851858.011169:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001c1fd52d
00000020:00000010:19.0:1773851858.011170:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000020:00000010:19.0:1773851858.011171:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000400:00000010:17.0:1773851858.011171:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001c1fd52d.
00000100:00000001:17.0:1773851858.011172:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:19.0:1773851858.011173:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000001838e913 : new refcount 5
00000100:00000001:17.0:1773851858.011173:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:19.0:1773851858.011174:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851858.011174:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000800:00000200:17.0:1773851858.011177:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 21169@kfi7(000000008c468759):0x0 lsk 791 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000316 Transaction freed
00000800:00000200:14.0:1773851858.048150:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.048150:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851858.048151:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851858.048151:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851858.048153:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851858.048153:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851858.048155:0:2514739:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25936@kfi7(000000009af977e2):0xa1a version: 2; local version 2; negotiated version: 2
00000800:00000200:13.0:1773851858.048155:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851858.048157:0:2514739:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a Using peer 25936@kfi7(0x100000000000a1a)
00000400:00000200:13.0:1773851858.048157:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25936@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.048159:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25936@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.048159:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25936@kfi7 : PUT - for me
00000800:00000200:14.0:1773851858.048160:0:2514739:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000e70f539d: Posted send of 38 bytes to peer 0x100000000000a1a: rc=0
00000400:00000200:13.0:1773851858.048160:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25936@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.048161:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005872b2ef nid 25936@kfi7 refs 1
00000800:00000200:14.0:1773851858.048162:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:13.0:1773851858.048162:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25936@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.048162:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005872b2ef nid 25936@kfi7 refs 2
00000400:00000200:13.0:1773851858.048163:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005872b2ef nid 25936@kfi7 refs 3
00000400:00000200:13.0:1773851858.048164:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25937@kfi7 to cpt 6
00000400:00000200:13.0:1773851858.048165:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25937@kfi7 of length 224 into portal 12 MB=0x699e1717385c0
00000400:00000200:13.0:1773851858.048167:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25937@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 17928
00000800:00000200:13.0:1773851858.048169:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851858.048171:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851858.048172:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25936@kfi7: PUT: OK
00000100:00000001:13.0:1773851858.048173:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851858.048174:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851858.048175:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036632b53.
00000100:00000040:13.0:1773851858.048175:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000036632b53 x1858043410351552 msgsize 224
00000800:00000200:15.0:1773851858.048176:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851858.048177:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25937@kfi7 (source: 12345-25936@kfi7)
00000100:00000001:13.0:1773851858.048179:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:15.0:1773851858.048180:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e70f539d: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a Transaction freed
00000400:00000200:13.0:1773851858.048180:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005872b2ef nid 25936@kfi7 refs 2
00000800:00000200:13.0:1773851858.048182:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851858.048187:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851858.048188:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851858.048189:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851858.048190:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851858.048191:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851858.048192:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043410351552
00000020:00000001:13.0:1773851858.048192:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851858.048193:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f95
00000020:00000001:13.0:1773851858.048194:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851858.048197:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007965a68e refcount=11
00000020:00000001:13.0:1773851858.048198:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744929280 : -107128964622336 : ffff9e91181e5800)
00000020:00000001:13.0:1773851858.048199:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744929280 : -107128964622336 : ffff9e91181e5800)
00000100:00000001:13.0:1773851858.048200:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.048201:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851858.048202:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851858.048203:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.048204:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851858.048205:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851858.048206:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851858.048206:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.048208:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851858.048208:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851858.048209:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.048210:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.048211:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.048212:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.048212:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851858.048212:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851858.048213:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25937@kfi7, seq: 2289786
00000100:00000001:15.0:1773851858.048214:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.048214:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007965a68e : new rpc_count 3
00000100:00000001:15.0:1773851858.048215:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.048215:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637080180732288 : -106993528819328 : ffff9eb0a0b8b180)
00000100:00000040:13.0:1773851858.048217:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036632b53 x1858043410351552/t0(0) o400->58c93f4a-a669-458e-8eaa-6522874fc8ff@25937@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2114-0'
00000100:00000001:13.0:1773851858.048220:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.048221:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851858.048222:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036632b53 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:58c93f4a-a669-458e-8eaa-6522874fc8ff+11:39873:x1858043410351552:12345-25937@kfi7:400:default-tuolumne2114-0
00000100:00000200:13.0:1773851858.048224:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043410351552
00000020:00000001:13.0:1773851858.048225:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851858.048225:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851858.048226:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.048227:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851858.048228:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851858.048229:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851858.048229:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043410351552, found 0 last_xid 1858043409782591
00000020:00000001:13.0:1773851858.048230:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851858.048231:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851858.048232:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851858.048232:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.048233:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851858.048234:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851858.048234:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851858.048235:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000010735db5.
02000000:00000001:13.0:1773851858.048236:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.048237:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.048238:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851858.048239:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264050818, transno 0, xid 1858043410351552
00010000:00000001:13.0:1773851858.048239:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851858.048240:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036632b53 x1858043410351552/t0(0) o400->58c93f4a-a669-458e-8eaa-6522874fc8ff@25937@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2114-0'
00010000:00000001:13.0:1773851858.048243:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851858.048244:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851858.048245:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=91 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851858.048246:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851858.048247:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3a901d4 refcount 3 to 25937@kfi7
00000100:00000001:13.0:1773851858.048247:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335104 : -107152617216512 : ffff9e8b96506600)
02000000:00000001:13.0:1773851858.048248:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851858.048249:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.048249:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851858.048251:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25936@kfi7
00000400:00000010:13.0:1773851858.048252:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d85ae778.
00000100:00000200:13.0:1773851858.048253:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043410351552, offset 224
00000400:00000200:13.0:1773851858.048254:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25936@kfi7
00000400:00000200:13.0:1773851858.048255:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25936@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.048256:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005872b2ef nid 25936@kfi7 refs 1
00000400:00000200:13.0:1773851858.048257:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005872b2ef nid 25936@kfi7 refs 2
00000400:00000200:13.0:1773851858.048258:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005872b2ef nid 25936@kfi7 refs 3
00000400:00000200:13.0:1773851858.048260:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25936@kfi7 local destination
00000400:00000200:13.0:1773851858.048261:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768763:8768763:1024:4294967295] 25936@kfi7 LPNI seq info [15888220:15888220:16:4294967295]
00000400:00000200:13.0:1773851858.048263:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005872b2ef nid 25936@kfi7 refs 2
00000400:00000200:13.0:1773851858.048264:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25936@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.048266:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25936@kfi7(25936@kfi7:25936@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851858.048267:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005872b2ef nid 25936@kfi7 refs 3
00000800:00000200:13.0:1773851858.048269:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.048271:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851858.048274:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851858.048278:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a Using peer 25936@kfi7(0x100000000000a1a)
00000800:00000200:13.0:1773851858.048283:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000006c12e940: Posted send of 324 bytes to peer 0x100000000000a1a: rc=0
00000800:00000200:13.0:1773851858.048286:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851858.048289:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.048291:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3a901d4 refcount 2 to 25937@kfi7
00010000:00000001:13.0:1773851858.048292:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851858.048293:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.048294:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851858.048296:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036632b53 x1858043410351552/t0(0) o400->58c93f4a-a669-458e-8eaa-6522874fc8ff@25937@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2114-0'
00000800:00000200:14.0:1773851858.048301:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851858.048304:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851858.048306:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25936@kfi7: PUT: OK
00000400:00000200:14.0:1773851858.048307:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d85ae778
00000400:00000010:14.0:1773851858.048308:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d85ae778.
00000100:00100000:13.0:1773851858.048308:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036632b53 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:58c93f4a-a669-458e-8eaa-6522874fc8ff+11:39873:x1858043410351552:12345-25937@kfi7:400:default-tuolumne2114-0 Request processed in 87us (131us total) trans 0 rc 0/0
00000100:00000001:14.0:1773851858.048309:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851858.048310:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851858.048311:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005872b2ef nid 25936@kfi7 refs 2
00000800:00000200:14.0:1773851858.048313:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25936@kfi7(000000009af977e2):0x0 lsk 2587 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a1a Transaction freed
00000100:00100000:13.0:1773851858.048314:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25937@kfi7, seq: 2289786
00000100:00000040:13.0:1773851858.048315:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007965a68e : new rpc_count 2
00000100:00000001:13.0:1773851858.048317:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851858.048318:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851858.048319:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.048320:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000020:00000010:13.0:1773851858.048322:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000020:00000040:13.0:1773851858.048324:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000007965a68e : new refcount 10
00000100:00000001:13.0:1773851858.048325:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851858.057733:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057734:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851858.057736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851858.057737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851858.057739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851858.057741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851858.057743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851858.057744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851858.057746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851858.057746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.057752:0:849255:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851858.057752:0:849255:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851858.057754:0:849255:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:29.0:1773851858.097771:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851858.097772:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851858.097773:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851858.097775:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851858.097777:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20594@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.097778:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20594@kfi7 : PUT - for me
00000400:00000200:29.0:1773851858.097779:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20594@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.097780:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d3f9619 nid 20594@kfi7 refs 1
00000400:00000200:29.0:1773851858.097781:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20594@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.097782:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d3f9619 nid 20594@kfi7 refs 2
00000400:00000200:29.0:1773851858.097783:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009d3f9619 nid 20594@kfi7 refs 3
00000400:00000200:29.0:1773851858.097784:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20594@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.097785:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20594@kfi7 of length 224 into portal 12 MB=0x699e182534880
00000400:00000200:29.0:1773851858.097786:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20594@kfi7 of length 224/224 into md 0x77fe139dd [64] + 165152
00000800:00000200:29.0:1773851858.097788:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851858.097789:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851858.097791:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20594@kfi7: PUT: OK
00000100:00000001:29.0:1773851858.097792:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851858.097792:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851858.097793:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f3edd57a.
00000100:00000040:29.0:1773851858.097794:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f3edd57a x1858043693451392 msgsize 224
00000100:00100000:29.0:1773851858.097796:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-20594@kfi7 (source: 12345-20594@kfi7)
00000100:00000001:29.0:1773851858.097797:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851858.097798:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851858.097798:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009d3f9619 nid 20594@kfi7 refs 2
02000000:00000001:31.0:1773851858.097799:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851858.097799:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851858.097800:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851858.097800:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851858.097801:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851858.097802:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043693451392
00000020:00000001:31.0:1773851858.097803:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851858.097803:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91690
00000020:00000001:31.0:1773851858.097804:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851858.097808:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005f684dd6 refcount=3833
00000020:00000001:31.0:1773851858.097808:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241256960 : -107152468294656 : ffff9e8b9f30c400)
00000020:00000001:31.0:1773851858.097809:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241256960 : -107152468294656 : ffff9e8b9f30c400)
00000100:00000001:31.0:1773851858.097810:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.097811:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851858.097812:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ee5136e.
00000020:00000010:31.0:1773851858.097813:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.097814:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851858.097815:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851858.097815:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851858.097816:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.097817:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851858.097817:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851858.097817:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.097819:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.097820:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851858.097820:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851858.097821:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851858.097821:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851858.097822:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20594@kfi7, seq: 2055475
00000100:00000040:31.0:1773851858.097822:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005f684dd6 : new rpc_count 19
00000100:00000001:31.0:1773851858.097823:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221546368 : -106948488005248 : ffff9ebb1d5cf980)
00000100:00000001:28.0:1773851858.097823:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851858.097823:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.097824:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f3edd57a x1858043693451392/t0(0) o400->10c164be-21c2-4af7-bf32-80ca17bfc69c@20594@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1770-0'
00000100:00000001:31.0:1773851858.097827:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.097828:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851858.097828:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3edd57a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:10c164be-21c2-4af7-bf32-80ca17bfc69c+3833:39856:x1858043693451392:12345-20594@kfi7:400:default-tuolumne1770-0
00000100:00000200:31.0:1773851858.097830:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043693451392
00000020:00000001:31.0:1773851858.097831:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851858.097831:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851858.097832:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.097833:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851858.097833:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851858.097834:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851858.097835:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043693451392, found 0 last_xid 1858043692664575
00000020:00000001:31.0:1773851858.097836:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851858.097836:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851858.097837:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851858.097837:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.097838:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851858.097839:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851858.097839:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851858.097840:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000015155d29.
02000000:00000001:31.0:1773851858.097841:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.097841:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.097842:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851858.097843:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590440, transno 0, xid 1858043693451392
00010000:00000001:31.0:1773851858.097844:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851858.097844:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f3edd57a x1858043693451392/t0(0) o400->10c164be-21c2-4af7-bf32-80ca17bfc69c@20594@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1770-0'
00010000:00000001:31.0:1773851858.097847:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851858.097847:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851858.097848:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=91 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851858.097849:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851858.097850:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a174029 refcount 3 to 20594@kfi7
00000100:00000001:31.0:1773851858.097851:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064992 : -107155994486624 : ffff9e8acd0358a0)
02000000:00000001:31.0:1773851858.097851:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851858.097852:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.097853:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851858.097853:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20594@kfi7
00000400:00000010:31.0:1773851858.097854:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000051546e8a.
00000100:00000200:31.0:1773851858.097855:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043693451392, offset 224
00000400:00000200:31.0:1773851858.097857:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20594@kfi7
00000400:00000200:31.0:1773851858.097857:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20594@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.097858:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d3f9619 nid 20594@kfi7 refs 1
00000400:00000200:31.0:1773851858.097859:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009d3f9619 nid 20594@kfi7 refs 2
00000400:00000200:31.0:1773851858.097861:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009d3f9619 nid 20594@kfi7 refs 3
00000400:00000200:31.0:1773851858.097862:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20594@kfi7 local destination
00000400:00000200:31.0:1773851858.097863:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768764:8768764:1024:4294967295] 20594@kfi7 LPNI seq info [8235075:8235075:16:4294967295]
00000400:00000200:31.0:1773851858.097865:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009d3f9619 nid 20594@kfi7 refs 2
00000400:00000200:31.0:1773851858.097866:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20594@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.097867:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20594@kfi7(20594@kfi7:20594@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851858.097869:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009d3f9619 nid 20594@kfi7 refs 3
00000800:00000200:31.0:1773851858.097870:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851858.097871:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851858.097873:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851858.097875:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106d Using peer 20594@kfi7(0x106d)
00000800:00000200:31.0:1773851858.097878:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x106d: rc=0
00000800:00000200:31.0:1773851858.097880:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851858.097882:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.097883:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a174029 refcount 2 to 20594@kfi7
00010000:00000001:31.0:1773851858.097883:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851858.097884:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.097884:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851858.097885:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f3edd57a x1858043693451392/t0(0) o400->10c164be-21c2-4af7-bf32-80ca17bfc69c@20594@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1770-0'
00000100:00100000:31.0:1773851858.097888:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3edd57a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:10c164be-21c2-4af7-bf32-80ca17bfc69c+3833:39856:x1858043693451392:12345-20594@kfi7:400:default-tuolumne1770-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851858.097890:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20594@kfi7, seq: 2055475
00000100:00000040:31.0:1773851858.097891:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005f684dd6 : new rpc_count 18
00000100:00000001:31.0:1773851858.097891:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851858.097892:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851858.097892:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000800:00000200:29.0:1773851858.097892:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106d TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851858.097893:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000200:29.0:1773851858.097893:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851858.097894:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ee5136e.
00000020:00000040:31.0:1773851858.097895:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000005f684dd6 : new refcount 3832
00000400:00000200:29.0:1773851858.097895:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20594@kfi7: PUT: OK
00000100:00000001:31.0:1773851858.097896:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851858.097896:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000051546e8a
00000400:00000010:29.0:1773851858.097896:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000051546e8a.
00000100:00000001:29.0:1773851858.097897:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851858.097897:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851858.097898:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009d3f9619 nid 20594@kfi7 refs 2
00000800:00000200:29.0:1773851858.097900:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 20594@kfi7(000000009dc452cb):0x0 lsk 4206 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106d Transaction freed
00000800:00000200:2.0:1773851858.147165:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851858.147166:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851858.147167:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851858.147170:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851858.147172:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9122@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.147173:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9122@kfi7 : PUT - for me
00000400:00000200:2.0:1773851858.147174:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9122@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.147175:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2f10e73 nid 9122@kfi7 refs 1
00000400:00000200:2.0:1773851858.147176:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9122@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.147177:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2f10e73 nid 9122@kfi7 refs 2
00000400:00000200:2.0:1773851858.147178:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e2f10e73 nid 9122@kfi7 refs 3
00000400:00000200:2.0:1773851858.147179:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9122@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.147179:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9122@kfi7 of length 224 into portal 12 MB=0x69b464c050280
00000400:00000200:2.0:1773851858.147181:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9122@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 16704
00000800:00000200:2.0:1773851858.147183:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851858.147185:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851858.147186:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9122@kfi7: PUT: OK
00000100:00000001:2.0:1773851858.147187:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851858.147187:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851858.147189:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061559714.
00000100:00000040:2.0:1773851858.147190:0:2506505:0:(events.c:358:request_in_callback()) incoming req@0000000061559714 x1859576085676672 msgsize 224
00000100:00100000:2.0:1773851858.147191:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-9122@kfi7 (source: 12345-9122@kfi7)
00000100:00000001:2.0:1773851858.147192:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851858.147193:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2f10e73 nid 9122@kfi7 refs 2
00000100:00000001:0.0:1773851858.147193:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851858.147194:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851858.147194:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851858.147195:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851858.147195:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851858.147196:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851858.147197:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576085676672
00000020:00000001:0.0:1773851858.147198:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851858.147198:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc1622c6f
00000020:00000001:0.0:1773851858.147199:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851858.147200:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000078ad0c1c refcount=61
00000020:00000001:0.0:1773851858.147201:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135395258368 : -106938314293248 : ffff9ebd7bc38000)
00000020:00000001:0.0:1773851858.147202:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637135395258368 : -106938314293248 : ffff9ebd7bc38000)
00000100:00000001:0.0:1773851858.147203:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.147203:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851858.147204:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851858.147205:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.147206:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851858.147207:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851858.147207:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851858.147208:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.147209:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851858.147209:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851858.147210:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.147211:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.147212:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851858.147212:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851858.147213:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851858.147213:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851858.147213:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9122@kfi7, seq: 1997507
00000100:00000001:1.0:1773851858.147214:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.147214:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000078ad0c1c : new rpc_count 2
00000100:00000001:1.0:1773851858.147215:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.147215:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706801792 : -106953002749824 : ffff9eba10437080)
00000100:00000040:0.0:1773851858.147216:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000061559714 x1859576085676672/t0(0) o400->2d8f9495-8f4f-4c09-b69c-2829c6c49971@9122@kfi7:498/0 lens 224/0 e 0 to 0 dl 1773852613 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1052-0'
00000100:00000001:0.0:1773851858.147219:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.147219:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851858.147220:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061559714 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2d8f9495-8f4f-4c09-b69c-2829c6c49971+61:39800:x1859576085676672:12345-9122@kfi7:400:default-tuolumne1052-0
00000100:00000200:0.0:1773851858.147222:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576085676672
00000020:00000001:0.0:1773851858.147222:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851858.147223:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851858.147224:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.147225:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851858.147225:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851858.147226:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851858.147227:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576085676672, found 0 last_xid 1859576085105983
00000020:00000001:0.0:1773851858.147228:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851858.147228:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851858.147229:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851858.147230:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.147230:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851858.147231:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851858.147231:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851858.147232:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008e8624cb.
02000000:00000001:0.0:1773851858.147233:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.147234:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.147234:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851858.147235:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264582903, transno 0, xid 1859576085676672
00010000:00000001:0.0:1773851858.147236:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851858.147237:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000061559714 x1859576085676672/t0(0) o400->2d8f9495-8f4f-4c09-b69c-2829c6c49971@9122@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1052-0'
00010000:00000001:0.0:1773851858.147239:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851858.147240:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851858.147241:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=91 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851858.147242:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851858.147243:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091b7fff5 refcount 3 to 9122@kfi7
00000100:00000001:0.0:1773851858.147243:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729382240 : -107155980169376 : ffff9e8acdddcf60)
02000000:00000001:0.0:1773851858.147244:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851858.147245:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.147246:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851858.147246:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9122@kfi7
00000400:00000010:0.0:1773851858.147247:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c2d69e3.
00000100:00000200:0.0:1773851858.147248:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576085676672, offset 224
00000400:00000200:0.0:1773851858.147249:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9122@kfi7
00000400:00000200:0.0:1773851858.147250:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9122@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.147251:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2f10e73 nid 9122@kfi7 refs 1
00000400:00000200:0.0:1773851858.147252:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e2f10e73 nid 9122@kfi7 refs 2
00000400:00000200:0.0:1773851858.147253:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e2f10e73 nid 9122@kfi7 refs 3
00000400:00000200:0.0:1773851858.147255:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9122@kfi7 local destination
00000400:00000200:0.0:1773851858.147256:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768765:8768765:1024:4294967295] 9122@kfi7 LPNI seq info [10364228:10364228:16:4294967295]
00000400:00000200:0.0:1773851858.147258:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e2f10e73 nid 9122@kfi7 refs 2
00000400:00000200:0.0:1773851858.147258:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9122@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.147261:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9122@kfi7(9122@kfi7:9122@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851858.147262:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e2f10e73 nid 9122@kfi7 refs 3
00000800:00000200:0.0:1773851858.147263:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851858.147264:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851858.147266:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851858.147269:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfbb Using peer 9122@kfi7(0xfbb)
00000800:00000200:0.0:1773851858.147272:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0xfbb: rc=0
00000800:00000200:0.0:1773851858.147273:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfbb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851858.147275:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.147276:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091b7fff5 refcount 2 to 9122@kfi7
00010000:00000001:0.0:1773851858.147277:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851858.147277:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.147278:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851858.147279:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061559714 x1859576085676672/t0(0) o400->2d8f9495-8f4f-4c09-b69c-2829c6c49971@9122@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1052-0'
00000100:00100000:0.0:1773851858.147283:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061559714 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2d8f9495-8f4f-4c09-b69c-2829c6c49971+61:39800:x1859576085676672:12345-9122@kfi7:400:default-tuolumne1052-0 Request processed in 63us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851858.147285:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9122@kfi7, seq: 1997507
00000100:00000040:0.0:1773851858.147286:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000078ad0c1c : new rpc_count 1
00000100:00000001:0.0:1773851858.147296:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851858.147297:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851858.147297:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.147298:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851858.147299:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851858.147300:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000078ad0c1c : new refcount 60
00000100:00000001:0.0:1773851858.147300:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851858.147307:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfbb TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851858.147309:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.147310:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9122@kfi7: PUT: OK
00000400:00000200:1.0:1773851858.147310:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c2d69e3
00000400:00000010:1.0:1773851858.147311:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c2d69e3.
00000100:00000001:1.0:1773851858.147312:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851858.147312:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851858.147313:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2f10e73 nid 9122@kfi7 refs 2
00000800:00000200:1.0:1773851858.147315:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9122@kfi7(000000004fc5c7ca):0x0 lsk 4028 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfbb Transaction freed
00000800:00000200:25.0:1773851858.148805:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.148806:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851858.148807:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851858.148809:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.148809:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25649@kfi7(00000000b3d18874):0x5e1 version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851858.148810:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.148810:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 Using peer 25649@kfi7(0x5e1)
00000800:00000200:26.0:1773851858.148812:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.148812:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25649@kfi7 to cpt 6
00000800:00000200:26.0:1773851858.148814:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851858.148814:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x5e1: rc=0
00000400:00000200:26.0:1773851858.148816:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25649@kfi7 to cpt 6
00000800:00000200:25.0:1773851858.148816:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851858.148817:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25649@kfi7 : PUT - for me
00000400:00000200:26.0:1773851858.148818:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25649@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.148819:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025b0f668 nid 25649@kfi7 refs 1
00000400:00000200:26.0:1773851858.148820:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25649@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.148821:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025b0f668 nid 25649@kfi7 refs 2
00000400:00000200:26.0:1773851858.148822:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000025b0f668 nid 25649@kfi7 refs 3
00000400:00000200:26.0:1773851858.148823:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25649@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.148824:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25649@kfi7 of length 224 into portal 12 MB=0x69b196cc1cac0
00000400:00000200:26.0:1773851858.148825:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25649@kfi7 of length 224/224 into md 0x16159c6179 [64] + 184880
00000800:00000200:26.0:1773851858.148827:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.148828:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851858.148829:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851858.148830:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25649@kfi7: PUT: OK
00000800:00000200:25.0:1773851858.148830:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 Transaction freed
00000100:00000001:26.0:1773851858.148831:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.148832:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851858.148833:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eeeccb85.
00000100:00000040:26.0:1773851858.148833:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000eeeccb85 x1859383361391296 msgsize 224
00000100:00100000:26.0:1773851858.148835:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-25649@kfi7 (source: 12345-25649@kfi7)
00000100:00000001:26.0:1773851858.148836:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851858.148837:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000025b0f668 nid 25649@kfi7 refs 2
00000800:00000200:26.0:1773851858.148840:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851858.148843:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851858.148843:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851858.148844:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851858.148844:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851858.148845:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851858.148846:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859383361391296
00000020:00000001:26.0:1773851858.148846:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851858.148847:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079684591f1
00000020:00000001:26.0:1773851858.148847:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851858.148849:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000090403f5a refcount=5
00000020:00000001:26.0:1773851858.148850:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637030355538944 : -107043354012672 : ffff9ea506e89400)
00000020:00000001:26.0:1773851858.148850:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637030355538944 : -107043354012672 : ffff9ea506e89400)
00000100:00000001:26.0:1773851858.148851:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851858.148852:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851858.148853:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:26.0:1773851858.148854:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851858.148855:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000001:26.0:1773851858.148856:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851858.148856:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851858.148856:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851858.148857:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851858.148858:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851858.148858:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.148859:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851858.148860:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851858.148860:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851858.148861:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851858.148861:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851858.148862:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25649@kfi7, seq: 2025061
00000100:00000040:26.0:1773851858.148863:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000090403f5a : new rpc_count 1
00000100:00000001:26.0:1773851858.148863:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538631680 : -106958170919936 : ffff9eb8dc376c00)
00000100:00000001:24.0:1773851858.148863:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.148863:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851858.148865:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eeeccb85 x1859383361391296/t0(0) o400->3c70cb51-6475-41d9-b1f7-74a1661f5e7a@25649@kfi7:75/0 lens 224/0 e 0 to 0 dl 1773852190 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2093-0'
00000100:00000001:26.0:1773851858.148867:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851858.148868:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851858.148869:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eeeccb85 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:3c70cb51-6475-41d9-b1f7-74a1661f5e7a+5:39795:x1859383361391296:12345-25649@kfi7:400:default-tuolumne2093-0
00000100:00000200:26.0:1773851858.148870:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859383361391296
00000020:00000001:26.0:1773851858.148871:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851858.148871:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851858.148872:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.148873:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851858.148873:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851858.148874:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851858.148875:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859383361391296, found 0 last_xid 1859383361391295
00000020:00000001:26.0:1773851858.148876:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851858.148876:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851858.148877:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851858.148877:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.148878:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851858.148878:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851858.148879:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851858.148879:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab566ca3.
02000000:00000001:26.0:1773851858.148880:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.148881:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.148881:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851858.148882:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183002874612, transno 0, xid 1859383361391296
00010000:00000001:26.0:1773851858.148883:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851858.148883:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eeeccb85 x1859383361391296/t0(0) o400->3c70cb51-6475-41d9-b1f7-74a1661f5e7a@25649@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2093-0'
00010000:00000001:26.0:1773851858.148886:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851858.148886:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851858.148887:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=91 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851858.148888:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851858.148888:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001afe4f5a refcount 3 to 25649@kfi7
00000100:00000001:26.0:1773851858.148889:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643690272 : -107157065861344 : ffff9e8a8d277720)
02000000:00000001:26.0:1773851858.148890:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851858.148890:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.148892:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851858.148892:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25649@kfi7
00000400:00000010:26.0:1773851858.148893:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007ea02df2.
00000100:00000200:26.0:1773851858.148894:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859383361391296, offset 224
00000400:00000200:26.0:1773851858.148895:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25649@kfi7
00000400:00000200:26.0:1773851858.148896:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25649@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.148897:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025b0f668 nid 25649@kfi7 refs 1
00000400:00000200:26.0:1773851858.148898:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000025b0f668 nid 25649@kfi7 refs 2
00000400:00000200:26.0:1773851858.148899:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000025b0f668 nid 25649@kfi7 refs 3
00000400:00000200:26.0:1773851858.148900:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25649@kfi7 local destination
00000400:00000200:26.0:1773851858.148901:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768766:8768766:1024:4294967295] 25649@kfi7 LPNI seq info [9431993:9431993:16:4294967295]
00000400:00000200:26.0:1773851858.148903:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000025b0f668 nid 25649@kfi7 refs 2
00000400:00000200:26.0:1773851858.148903:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25649@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.148905:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25649@kfi7(25649@kfi7:25649@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851858.148906:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000025b0f668 nid 25649@kfi7 refs 3
00000800:00000200:26.0:1773851858.148907:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.148908:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851858.148910:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851858.148912:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 Using peer 25649@kfi7(0x5e1)
00000800:00000200:26.0:1773851858.148915:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 324 bytes to peer 0x5e1: rc=0
00000800:00000200:26.0:1773851858.148917:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851858.148919:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851858.148920:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001afe4f5a refcount 2 to 25649@kfi7
00010000:00000001:26.0:1773851858.148921:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851858.148921:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851858.148922:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851858.148922:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eeeccb85 x1859383361391296/t0(0) o400->3c70cb51-6475-41d9-b1f7-74a1661f5e7a@25649@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2093-0'
00000100:00100000:26.0:1773851858.148926:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eeeccb85 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:3c70cb51-6475-41d9-b1f7-74a1661f5e7a+5:39795:x1859383361391296:12345-25649@kfi7:400:default-tuolumne2093-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851858.148928:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851858.148929:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25649@kfi7, seq: 2025061
00000100:00000040:26.0:1773851858.148929:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000090403f5a : new rpc_count 0
00000400:00000200:25.0:1773851858.148929:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851858.148930:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851858.148930:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25649@kfi7: PUT: OK
00000100:00000001:26.0:1773851858.148931:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851858.148931:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851858.148931:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007ea02df2
00000400:00000010:25.0:1773851858.148931:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007ea02df2.
00000020:00000010:26.0:1773851858.148932:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000100:00000001:25.0:1773851858.148932:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851858.148932:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:26.0:1773851858.148933:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000020:00000040:26.0:1773851858.148933:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000090403f5a : new refcount 4
00000400:00000200:25.0:1773851858.148933:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000025b0f668 nid 25649@kfi7 refs 2
00000100:00000001:26.0:1773851858.148934:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851858.148934:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 25649@kfi7(00000000b3d18874):0x0 lsk 1506 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5e1 Transaction freed
00000800:00000200:17.0:1773851858.174227:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851858.174228:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851858.174229:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851858.174231:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851858.174233:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17378@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.174234:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17378@kfi7 : PUT - for me
00000400:00000200:17.0:1773851858.174235:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17378@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.174236:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000864e4f40 nid 17378@kfi7 refs 1
00000400:00000200:17.0:1773851858.174237:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17378@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.174238:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000864e4f40 nid 17378@kfi7 refs 2
00000400:00000200:17.0:1773851858.174238:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000864e4f40 nid 17378@kfi7 refs 3
00000400:00000200:17.0:1773851858.174239:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17378@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.174240:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17378@kfi7 of length 224 into portal 12 MB=0x69b4b56b07380
00000400:00000200:17.0:1773851858.174242:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17378@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 192768
00000800:00000200:17.0:1773851858.174244:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851858.174245:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851858.174246:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17378@kfi7: PUT: OK
00000100:00000001:17.0:1773851858.174247:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851858.174248:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851858.174249:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6a6a464.
00000100:00000040:17.0:1773851858.174249:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a6a6a464 x1859597739520896 msgsize 224
00000100:00100000:17.0:1773851858.174251:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-17378@kfi7 (source: 12345-17378@kfi7)
00000100:00000001:17.0:1773851858.174252:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851858.174253:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851858.174253:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000864e4f40 nid 17378@kfi7 refs 2
02000000:00000001:19.0:1773851858.174254:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851858.174254:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851858.174254:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851858.174255:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851858.174256:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851858.174257:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597739520896
00000020:00000001:19.0:1773851858.174257:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851858.174258:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81c8e
00000020:00000001:19.0:1773851858.174258:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851858.174260:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000078ade412 refcount=47
00000020:00000001:19.0:1773851858.174261:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136007000064 : -106937702551552 : ffff9ebda039f000)
00000020:00000001:19.0:1773851858.174262:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136007000064 : -106937702551552 : ffff9ebda039f000)
00000100:00000001:19.0:1773851858.174263:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.174264:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851858.174265:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851858.174266:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.174266:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851858.174267:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851858.174268:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851858.174268:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.174269:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851858.174269:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851858.174270:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.174271:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.174272:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851858.174272:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851858.174272:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851858.174272:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851858.174273:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17378@kfi7, seq: 2156273
00000100:00000040:19.0:1773851858.174274:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000078ade412 : new rpc_count 3
00000100:00000001:18.0:1773851858.174274:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.174275:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764363264 : -107095945188352 : ffff9e98c83aec00)
00000100:00000001:18.0:1773851858.174275:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.174276:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6a6a464 x1859597739520896/t0(0) o400->1d9cd995-f1e0-4691-b142-468e17c74a63@17378@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1563-0'
00000100:00000001:19.0:1773851858.174278:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.174278:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851858.174279:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6a6a464 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1d9cd995-f1e0-4691-b142-468e17c74a63+47:39701:x1859597739520896:12345-17378@kfi7:400:default-tuolumne1563-0
00000100:00000200:19.0:1773851858.174281:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597739520896
00000020:00000001:19.0:1773851858.174282:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851858.174283:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851858.174284:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.174284:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851858.174285:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851858.174285:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851858.174286:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597739520896, found 0 last_xid 1859597738954303
00000020:00000001:19.0:1773851858.174287:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851858.174288:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851858.174288:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851858.174288:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.174289:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851858.174290:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851858.174290:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851858.174291:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d3eb76a8.
02000000:00000001:19.0:1773851858.174291:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.174292:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.174292:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851858.174293:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584548, transno 0, xid 1859597739520896
00010000:00000001:19.0:1773851858.174294:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851858.174294:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6a6a464 x1859597739520896/t0(0) o400->1d9cd995-f1e0-4691-b142-468e17c74a63@17378@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1563-0'
00010000:00000001:19.0:1773851858.174297:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851858.174297:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851858.174298:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=91 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851858.174299:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851858.174300:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d08cd1a refcount 3 to 17378@kfi7
00000100:00000001:19.0:1773851858.174300:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992896 : -107142345558720 : ffff9e8dfa8d7540)
02000000:00000001:19.0:1773851858.174301:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851858.174302:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.174302:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851858.174303:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17378@kfi7
00000400:00000010:19.0:1773851858.174303:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c549776.
00000100:00000200:19.0:1773851858.174304:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597739520896, offset 224
00000400:00000200:19.0:1773851858.174305:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17378@kfi7
00000400:00000200:19.0:1773851858.174306:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17378@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.174310:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000864e4f40 nid 17378@kfi7 refs 1
00000400:00000200:19.0:1773851858.174311:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000864e4f40 nid 17378@kfi7 refs 2
00000400:00000200:19.0:1773851858.174312:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000864e4f40 nid 17378@kfi7 refs 3
00000400:00000200:19.0:1773851858.174313:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17378@kfi7 local destination
00000400:00000200:19.0:1773851858.174315:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768767:8768767:1024:4294967295] 17378@kfi7 LPNI seq info [324063:324063:16:4294967295]
00000400:00000200:19.0:1773851858.174316:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000864e4f40 nid 17378@kfi7 refs 2
00000400:00000200:19.0:1773851858.174317:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17378@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.174319:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17378@kfi7(17378@kfi7:17378@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851858.174320:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000864e4f40 nid 17378@kfi7 refs 3
00000800:00000200:19.0:1773851858.174321:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851858.174322:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851858.174324:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851858.174326:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000396 Using peer 17378@kfi7(0x100000000000396)
00000800:00000200:19.0:1773851858.174329:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0x100000000000396: rc=0
00000800:00000200:19.0:1773851858.174330:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000396 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851858.174332:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.174333:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d08cd1a refcount 2 to 17378@kfi7
00010000:00000001:19.0:1773851858.174334:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851858.174334:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.174335:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851858.174336:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6a6a464 x1859597739520896/t0(0) o400->1d9cd995-f1e0-4691-b142-468e17c74a63@17378@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1563-0'
00000100:00100000:19.0:1773851858.174339:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6a6a464 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1d9cd995-f1e0-4691-b142-468e17c74a63+47:39701:x1859597739520896:12345-17378@kfi7:400:default-tuolumne1563-0 Request processed in 60us (88us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851858.174341:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17378@kfi7, seq: 2156273
00000100:00000040:19.0:1773851858.174342:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000078ade412 : new rpc_count 2
00000100:00000001:19.0:1773851858.174342:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851858.174342:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000396 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851858.174343:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851858.174343:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851858.174343:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851858.174344:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000400:00000200:17.0:1773851858.174344:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17378@kfi7: PUT: OK
00000020:00000010:19.0:1773851858.174345:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000400:00000200:17.0:1773851858.174345:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c549776
00000400:00000010:17.0:1773851858.174345:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c549776.
00000020:00000040:19.0:1773851858.174346:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000078ade412 : new refcount 46
00000100:00000001:17.0:1773851858.174346:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851858.174347:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851858.174347:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851858.174347:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000864e4f40 nid 17378@kfi7 refs 2
00000800:00000200:17.0:1773851858.174349:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 17378@kfi7(00000000ea69584e):0x0 lsk 919 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000396 Transaction freed
00000800:00000200:29.0:1773851858.232632:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851858.232633:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851858.232635:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851858.232639:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851858.232642:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14787@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.232644:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14787@kfi7 : PUT - for me
00000400:00000200:29.0:1773851858.232646:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14787@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.232647:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a789027 nid 14787@kfi7 refs 1
00000400:00000200:29.0:1773851858.232650:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14787@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.232651:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a789027 nid 14787@kfi7 refs 2
00000400:00000200:29.0:1773851858.232653:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008a789027 nid 14787@kfi7 refs 3
00000400:00000200:29.0:1773851858.232654:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14786@kfi7 to cpt 4
00000400:00000200:29.0:1773851858.232656:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14786@kfi7 of length 224 into portal 12 MB=0x69b4b5c3b3fc0
00000400:00000200:29.0:1773851858.232659:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14786@kfi7 of length 224/224 into md 0x77fe139dd [64] + 165376
00000800:00000200:29.0:1773851858.232662:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851858.232665:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851858.232667:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14787@kfi7: PUT: OK
00000100:00000001:29.0:1773851858.232668:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851858.232669:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851858.232671:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000496b8f62.
00000100:00000040:29.0:1773851858.232672:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000496b8f62 x1859597832503232 msgsize 224
00000100:00100000:29.0:1773851858.232675:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-14786@kfi7 (source: 12345-14787@kfi7)
00000100:00000001:29.0:1773851858.232677:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851858.232678:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008a789027 nid 14787@kfi7 refs 2
00000100:00000001:31.0:1773851858.232680:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851858.232681:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851858.232681:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851858.232682:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851858.232683:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851858.232685:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851858.232686:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597832503232
00000020:00000001:31.0:1773851858.232688:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851858.232688:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80358
00000020:00000001:31.0:1773851858.232689:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851858.232697:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004bd72861 refcount=5
00000020:00000001:31.0:1773851858.232698:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117645083648 : -106956064467968 : ffff9eb959c55400)
00000020:00000001:31.0:1773851858.232700:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117645083648 : -106956064467968 : ffff9eb959c55400)
00000100:00000001:31.0:1773851858.232701:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.232703:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851858.232704:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ee5136e.
00000020:00000010:31.0:1773851858.232706:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.232707:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851858.232709:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851858.232709:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851858.232710:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.232712:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851858.232713:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851858.232714:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.232716:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.232718:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851858.232719:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851858.232719:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851858.232719:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851858.232721:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14786@kfi7, seq: 2055476
00000100:00000040:31.0:1773851858.232722:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004bd72861 : new rpc_count 1
00000100:00000001:28.0:1773851858.232722:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.232723:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221523328 : -106948488028288 : ffff9ebb1d5c9f80)
00000100:00000001:28.0:1773851858.232723:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.232731:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000496b8f62 x1859597832503232/t0(0) o400->33d4e642-0639-4723-9934-88ceddf231f8@14786@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1415-0'
00000100:00000001:31.0:1773851858.232737:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.232737:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851858.232739:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000496b8f62 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:33d4e642-0639-4723-9934-88ceddf231f8+5:39696:x1859597832503232:12345-14786@kfi7:400:default-tuolumne1415-0
00000100:00000200:31.0:1773851858.232741:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597832503232
00000020:00000001:31.0:1773851858.232743:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851858.232744:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851858.232745:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.232746:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851858.232747:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851858.232749:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851858.232750:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597832503232, found 0 last_xid 1859597832503231
00000020:00000001:31.0:1773851858.232751:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851858.232752:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851858.232753:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851858.232754:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.232755:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851858.232756:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851858.232757:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851858.232760:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000001e64c96.
02000000:00000001:31.0:1773851858.232761:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.232763:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.232764:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851858.232765:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096683560, transno 0, xid 1859597832503232
00010000:00000001:31.0:1773851858.232767:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851858.232768:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000496b8f62 x1859597832503232/t0(0) o400->33d4e642-0639-4723-9934-88ceddf231f8@14786@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1415-0'
00010000:00000001:31.0:1773851858.232773:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851858.232774:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851858.232775:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=91 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851858.232777:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851858.232778:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004767bdcd refcount 3 to 14786@kfi7
00000100:00000001:31.0:1773851858.232780:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517088 : -107156126034528 : ffff9e8ac52c15a0)
02000000:00000001:31.0:1773851858.232781:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851858.232782:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.232783:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851858.232785:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14787@kfi7
00000400:00000010:31.0:1773851858.232786:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000200:31.0:1773851858.232787:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597832503232, offset 224
00000400:00000200:31.0:1773851858.232790:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14787@kfi7
00000400:00000200:31.0:1773851858.232792:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14787@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.232793:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a789027 nid 14787@kfi7 refs 1
00000400:00000200:31.0:1773851858.232795:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008a789027 nid 14787@kfi7 refs 2
00000400:00000200:31.0:1773851858.232797:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008a789027 nid 14787@kfi7 refs 3
00000400:00000200:31.0:1773851858.232799:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14787@kfi7 local destination
00000400:00000200:31.0:1773851858.232802:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768768:8768768:1024:4294967295] 14787@kfi7 LPNI seq info [130218:130218:16:4294967295]
00000400:00000200:31.0:1773851858.232805:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008a789027 nid 14787@kfi7 refs 2
00000400:00000200:31.0:1773851858.232807:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14787@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.232810:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14787@kfi7(14787@kfi7:14787@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851858.232813:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008a789027 nid 14787@kfi7 refs 3
00000800:00000200:31.0:1773851858.232815:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851858.232817:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851858.232821:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851858.232825:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a0 Using peer 14787@kfi7(0x7a0)
00000800:00000200:31.0:1773851858.232830:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x7a0: rc=0
00000800:00000200:31.0:1773851858.232832:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851858.232836:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.232837:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004767bdcd refcount 2 to 14786@kfi7
00010000:00000001:31.0:1773851858.232838:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851858.232839:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.232840:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851858.232841:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000496b8f62 x1859597832503232/t0(0) o400->33d4e642-0639-4723-9934-88ceddf231f8@14786@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1415-0'
00000100:00100000:31.0:1773851858.232846:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000496b8f62 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:33d4e642-0639-4723-9934-88ceddf231f8+5:39696:x1859597832503232:12345-14786@kfi7:400:default-tuolumne1415-0 Request processed in 108us (172us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851858.232847:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a0 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851858.232849:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14786@kfi7, seq: 2055476
00000400:00000200:29.0:1773851858.232850:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851858.232852:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14787@kfi7: PUT: OK
00000400:00000200:29.0:1773851858.232853:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000400:00000010:29.0:1773851858.232854:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:29.0:1773851858.232855:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851858.232855:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851858.232857:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008a789027 nid 14787@kfi7 refs 2
00000800:00000200:29.0:1773851858.232859:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 14787@kfi7(0000000068d0e1d1):0x0 lsk 1953 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a0 Transaction freed
00000100:00000040:31.0:1773851858.232863:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004bd72861 : new rpc_count 0
00000100:00000001:31.0:1773851858.232864:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851858.232864:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851858.232865:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.232866:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851858.232868:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ee5136e.
00000020:00000040:31.0:1773851858.232869:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000004bd72861 : new refcount 4
00000100:00000001:31.0:1773851858.232870:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851858.249730:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851858.249731:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:25.0:1773851858.249731:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:29.0:1773851858.249732:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b01d5dd2.
00000004:00000020:25.0:1773851858.249732:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:29.0:1773851858.249733:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000100:00000010:25.0:1773851858.249733:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002c5ee9bb.
00000020:00000040:25.0:1773851858.249733:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000100:00000001:29.0:1773851858.249734:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851858.249734:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:25.0:1773851858.249734:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851858.249735:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851858.249735:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:29.0:1773851858.249736:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
02000000:00000001:25.0:1773851858.249736:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851858.249737:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000294dbfa2.
00000100:00000001:29.0:1773851858.249738:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851858.249738:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851858.249738:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851858.249739:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.249739:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:29.0:1773851858.249740:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b01d5dd2] to pc [ptlrpcd_07_00+0]  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851858.249740:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851858.249741:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002c5ee9bb] to pc [ptlrpcd_06_02+2]  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851858.249744:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851858.249745:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851858.249745:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:29.0:1773851858.249745:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006ab5167d.
00000100:00000001:28.0:1773851858.249745:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:25.0:1773851858.249745:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851858.249746:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851858.249746:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121623922688 : -106952085628928 : ffff9eba46ed9800)
00000100:00000001:28.0:1773851858.249746:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249746:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851858.249746:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:30.0:1773851858.249747:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851858.249747:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:27.0:1773851858.249747:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851858.249747:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:25.0:1773851858.249747:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000013d7dff7.
00080000:00000001:25.0:1773851858.249747:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637110622745600 : -106963086806016 : ffff9eb7b734f400)
00080000:00000001:29.0:1773851858.249748:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851858.249748:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000100:00000001:27.0:1773851858.249748:0:41086:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:25.0:1773851858.249748:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851858.249749:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:29.0:1773851858.249749:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005e45cc7b.
00000100:00000040:27.0:1773851858.249749:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851858.249750:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:29.0:1773851858.249750:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614132703025497ns, next at 614133703024475ns, rc = 0
02000000:00000001:30.0:1773851858.249751:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:29.0:1773851858.249751:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:30.0:1773851858.249752:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851858.249752:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851858.249752:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249752:0:41086:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:27.0:1773851858.249752:0:41086:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851858.249752:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:25.0:1773851858.249752:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000100:00100000:30.0:1773851858.249753:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b01d5dd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051924608:2090@kfi7:13:default-yuba2-0
02000000:00000001:27.0:1773851858.249753:0:41086:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:25.0:1773851858.249753:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c99d5fca.
00000100:00000001:30.0:1773851858.249754:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851858.249754:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:27.0:1773851858.249754:0:41086:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:25.0:1773851858.249754:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614132703029494ns, next at 614133703028462ns, rc = 0
02000000:00000001:30.0:1773851858.249755:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851858.249755:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:27.0:1773851858.249755:0:41086:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002c5ee9bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_02:lustre5-MDT0001-mdtlov_UUID:41086:1859433051924672:2068@kfi7:13:default-yuba2-0
00080000:00000001:25.0:1773851858.249755:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000010:30.0:1773851858.249756:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e7dccfaa.
00000100:00000001:27.0:1773851858.249756:0:41086:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:27.0:1773851858.249756:0:41086:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:25.0:1773851858.249756:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851858.249757:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851858.249757:0:41086:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851858.249757:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851858.249758:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:30.0:1773851858.249758:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
02000000:00000001:27.0:1773851858.249758:0:41086:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:30.0:1773851858.249759:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
02000000:00000010:27.0:1773851858.249759:0:41086:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e7d7e1a6.
02000000:00000001:27.0:1773851858.249759:0:41086:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851858.249760:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924608, portal 4
00000400:00000200:27.0:1773851858.249760:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000001:30.0:1773851858.249761:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851858.249761:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637125221515264 : -106948488036352 : ffff9ebb1d5c8000)
00000400:00000010:27.0:1773851858.249761:0:41086:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e475a717.
00000400:00000010:27.0:1773851858.249762:0:41086:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e26c5908.
00000100:00000040:30.0:1773851858.249763:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:27.0:1773851858.249763:0:41086:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924672, portal 4
00000100:00000001:27.0:1773851858.249764:0:41086:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:27.0:1773851858.249764:0:41086:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023482865536 : -107050226686080 : ffff9ea36d43e780)
00000100:00000001:30.0:1773851858.249765:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851858.249765:0:41086:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851858.249766:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:30.0:1773851858.249766:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000227bab5d.
00000100:00000200:30.0:1773851858.249767:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924608, offset 0
00000400:00000200:30.0:1773851858.249768:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000100:00000001:27.0:1773851858.249768:0:41086:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851858.249769:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000040:27.0:1773851858.249769:0:41086:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:27.0:1773851858.249769:0:41086:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000927ebb96.
00000400:00000200:30.0:1773851858.249770:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000100:00000200:27.0:1773851858.249770:0:41086:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924672, offset 0
00000400:00000200:30.0:1773851858.249771:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851858.249771:0:41086:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:30.0:1773851858.249772:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:30.0:1773851858.249773:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000200:27.0:1773851858.249773:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:27.0:1773851858.249773:0:41086:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:27.0:1773851858.249774:0:41086:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851858.249775:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768768, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768767, p:4294967295, g:4294967295, h:1000]
00000400:00000200:27.0:1773851858.249776:0:41086:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851858.249777:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:27.0:1773851858.249777:0:41086:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:30.0:1773851858.249778:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:27.0:1773851858.249778:0:41086:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768768, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768767, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851858.249779:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:30.0:1773851858.249780:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768769:8768769:1024:4294967295] 2090@kfi7 LPNI seq info [5404248:5404248:16:4294967295]
00000400:00000200:27.0:1773851858.249780:0:41086:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851858.249781:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851858.249781:0:41086:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851858.249782:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851858.249782:0:41086:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:27.0:1773851858.249784:0:41086:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768770:8768770:1024:4294967295] 2068@kfi7 LPNI seq info [5403696:5403696:16:4294967295]
00000400:00000200:30.0:1773851858.249785:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851858.249785:0:41086:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851858.249786:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:27.0:1773851858.249786:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:30.0:1773851858.249788:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851858.249789:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:27.0:1773851858.249789:0:41086:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851858.249790:0:41086:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:30.0:1773851858.249791:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851858.249792:0:41086:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:30.0:1773851858.249793:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f Using peer 2090@kfi7(0x20000000000002f)
00000800:00000200:27.0:1773851858.249793:0:41086:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851858.249795:0:41086:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851858.249796:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000fd057322: Posted send of 324 bytes to peer 0x20000000000002f: rc=0
00000800:00000200:27.0:1773851858.249797:0:41086:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Using peer 2068@kfi7(0x62f)
00000800:00000200:30.0:1773851858.249798:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851858.249800:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249800:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:27.0:1773851858.249800:0:41086:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0x62f: rc=0
00000100:00000001:30.0:1773851858.249801:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249801:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851858.249801:0:41086:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851858.249802:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851858.249803:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851858.249803:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:27.0:1773851858.249803:0:41086:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249804:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851858.249804:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851858.249804:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249804:0:41086:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:27.0:1773851858.249804:0:41086:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249805:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249805:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249806:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851858.249807:0:41086:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851858.249807:0:41086:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:29.0:1773851858.249808:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851858.249808:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851858.249809:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851858.249809:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851858.249809:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249809:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851858.249810:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2090@kfi7: PUT: OK
00000400:00000200:29.0:1773851858.249811:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000227bab5d
00000400:00000010:29.0:1773851858.249811:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000227bab5d.
00000800:00000200:25.0:1773851858.249811:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851858.249812:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851858.249813:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851858.249813:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.249814:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000100:00000001:29.0:1773851858.249815:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:25.0:1773851858.249815:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000927ebb96
00000400:00000010:25.0:1773851858.249815:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000927ebb96.
00000100:00000040:29.0:1773851858.249816:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851858.249816:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:25.0:1773851858.249817:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851858.249818:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851858.249819:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:25.0:1773851858.249819:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851858.249820:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000040:25.0:1773851858.249820:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851858.249821:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f Transaction freed
00000100:00000001:25.0:1773851858.249822:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.249823:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851858.249824:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:25.0:1773851858.249825:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Transaction freed
00000800:00000200:1.0:1773851858.249845:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851858.249846:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851858.249847:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851858.249849:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851858.249850:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.249851:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.249852:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851858.249852:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.249853:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2090@kfi7 : PUT - for me
00000800:00000200:21.0:1773851858.249854:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851858.249854:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.249855:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:21.0:1773851858.249856:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851858.249857:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851858.249858:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:1.0:1773851858.249858:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:21.0:1773851858.249859:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851858.249859:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:21.0:1773851858.249860:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:1.0:1773851858.249860:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851858.249861:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.249862:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:1.0:1773851858.249862:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2880
00000400:00000200:21.0:1773851858.249863:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:1.0:1773851858.249863:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851858.249864:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.249865:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b28c0
00000400:00000200:1.0:1773851858.249865:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71cec1 [1] + 224
00000400:00000200:21.0:1773851858.249866:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.249868:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d0615 [1] + 224
00000800:00000200:1.0:1773851858.249868:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.249870:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851858.249870:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.249871:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.249871:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2090@kfi7: PUT: OK
00000400:00000200:21.0:1773851858.249872:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000100:00000001:1.0:1773851858.249872:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:21.0:1773851858.249873:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:1.0:1773851858.249873:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:21.0:1773851858.249874:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851858.249877:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851858.249877:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851858.249881:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851858.249882:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:1.0:1773851858.249882:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851858.249883:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:30.0:1773851858.249884:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851858.249884:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:21.0:1773851858.249884:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:1.0:1773851858.249884:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000010:30.0:1773851858.249885:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851858.249885:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000200:21.0:1773851858.249885:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000010:30.0:1773851858.249886:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:27.0:1773851858.249886:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851858.249886:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851858.249887:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:27.0:1773851858.249887:0:41086:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:21.0:1773851858.249887:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:30.0:1773851858.249888:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:27.0:1773851858.249888:0:41086:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:27.0:1773851858.249889:0:41086:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e475a717.
00000400:00000200:27.0:1773851858.249889:0:41086:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e26c5908
00000100:00000200:30.0:1773851858.249890:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:27.0:1773851858.249890:0:41086:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e26c5908.
00000100:00000001:27.0:1773851858.249891:0:41086:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:27.0:1773851858.249891:0:41086:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851858.249893:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851858.249893:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851858.249893:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851858.249894:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851858.249894:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:27.0:1773851858.249894:0:41086:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851858.249895:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851858.249895:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851858.249896:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=91 v=66 (66 66 66 66)
00000100:00000001:27.0:1773851858.249896:0:41086:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:30.0:1773851858.249897:0:41088:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=91 v=66 (1 1 1 1)
00000100:00000001:27.0:1773851858.249897:0:41086:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851858.249898:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851858.249898:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851858.249898:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:27.0:1773851858.249898:0:41086:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:27.0:1773851858.249898:0:41086:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:27.0:1773851858.249898:0:41086:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:30.0:1773851858.249899:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249899:0:41086:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249900:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851858.249900:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:30.0:1773851858.249900:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000001:27.0:1773851858.249900:0:41086:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249901:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851858.249901:0:41086:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=91 v=66 (66 66 66 66)
00000100:00000040:30.0:1773851858.249902:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:27.0:1773851858.249902:0:41086:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=91 v=66 (1 1 1 1)
00000100:00000001:27.0:1773851858.249903:0:41086:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:27.0:1773851858.249903:0:41086:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249904:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851858.249904:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00010000:00000001:27.0:1773851858.249904:0:41086:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:27.0:1773851858.249904:0:41086:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851858.249905:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851858.249905:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:27.0:1773851858.249905:0:41086:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:27.0:1773851858.249905:0:41086:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000004:00000040:30.0:1773851858.249906:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000100:00000001:27.0:1773851858.249906:0:41086:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:27.0:1773851858.249906:0:41086:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:30.0:1773851858.249907:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351389027328 avail=351386313728 avail_mb=1372602788 hwm_mb=3131103 files=372019207 ffree=343153347 state=0: rc = 0
00000100:00000040:27.0:1773851858.249907:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:30.0:1773851858.249908:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351389027328 free, 351386313728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019207 files, 343153347 free files
00000004:00000001:30.0:1773851858.249909:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851858.249910:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:27.0:1773851858.249910:0:41086:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:27.0:1773851858.249913:0:41086:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:27.0:1773851858.249914:0:41086:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:27.0:1773851858.249914:0:41086:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:27.0:1773851858.249915:0:41086:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000100:00100000:30.0:1773851858.249916:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b01d5dd2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051924608:2090@kfi7:13:default-yuba2-0
00000004:00000040:27.0:1773851858.249916:0:41086:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350959050752 avail=350956926976 avail_mb=1370925496 hwm_mb=3131103 files=371564114 ffree=342733448 state=0: rc = 0
00000100:00000001:30.0:1773851858.249917:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:27.0:1773851858.249917:0:41086:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350959050752 free, 350956926976 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371564114 files, 342733448 free files
00000100:00000001:30.0:1773851858.249918:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851858.249919:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b01d5dd2 x1859433051924608/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:27.0:1773851858.249919:0:41086:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851858.249920:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851858.249921:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851858.249921:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851858.249921:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e7dccfaa.
02000000:00000001:30.0:1773851858.249922:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00100000:27.0:1773851858.249922:0:41086:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002c5ee9bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_02:lustre5-MDT0001-mdtlov_UUID:41086:1859433051924672:2068@kfi7:13:default-yuba2-0
00000020:00000001:30.0:1773851858.249923:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851858.249923:0:41088:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000001:30.0:1773851858.249924:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851858.249924:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
00000100:00000001:27.0:1773851858.249924:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851858.249925:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851858.249925:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:27.0:1773851858.249925:0:41086:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:27.0:1773851858.249925:0:41086:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002c5ee9bb x1859433051924672/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:30.0:1773851858.249926:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b01d5dd2.
00000100:00000001:30.0:1773851858.249926:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851858.249927:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851858.249927:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851858.249927:0:41086:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851858.249928:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851858.249928:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851858.249928:0:41086:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:27.0:1773851858.249928:0:41086:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e7d7e1a6.
00000100:00000001:30.0:1773851858.249929:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851858.249929:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851858.249929:0:41086:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:27.0:1773851858.249930:0:41086:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:27.0:1773851858.249930:0:41086:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:27.0:1773851858.249931:0:41086:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:27.0:1773851858.249931:0:41086:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000294dbfa2.
02000000:00000001:27.0:1773851858.249932:0:41086:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:27.0:1773851858.249933:0:41086:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:27.0:1773851858.249933:0:41086:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002c5ee9bb.
00000100:00000001:27.0:1773851858.249934:0:41086:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:27.0:1773851858.249934:0:41086:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851858.249935:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851858.249935:0:41086:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851858.249936:0:41086:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851858.249936:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851858.249937:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851858.270609:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851858.270610:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851858.270612:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851858.270614:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851858.270616:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15857@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.270618:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15857@kfi7 : PUT - for me
00000400:00000200:17.0:1773851858.270619:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15857@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.270620:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013db2662 nid 15857@kfi7 refs 1
00000400:00000200:17.0:1773851858.270620:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15857@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.270621:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013db2662 nid 15857@kfi7 refs 2
00000400:00000200:17.0:1773851858.270622:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013db2662 nid 15857@kfi7 refs 3
00000400:00000200:17.0:1773851858.270623:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15665@kfi7 to cpt 2
00000400:00000200:17.0:1773851858.270624:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15665@kfi7 of length 224 into portal 12 MB=0x69b4b5dc2cb40
00000400:00000200:17.0:1773851858.270625:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15665@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 192992
00000800:00000200:17.0:1773851858.270627:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851858.270629:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851858.270629:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15857@kfi7: PUT: OK
00000100:00000001:17.0:1773851858.270630:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851858.270631:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851858.270632:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000072b2a9a2.
00000100:00000040:17.0:1773851858.270632:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000072b2a9a2 x1859597858163520 msgsize 224
00000100:00100000:17.0:1773851858.270634:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15665@kfi7 (source: 12345-15857@kfi7)
00000100:00000001:17.0:1773851858.270635:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851858.270636:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851858.270636:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000013db2662 nid 15857@kfi7 refs 2
02000000:00000001:19.0:1773851858.270637:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851858.270637:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851858.270637:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851858.270638:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851858.270639:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851858.270639:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597858163520
00000020:00000001:19.0:1773851858.270640:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851858.270640:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8091d
00000020:00000001:19.0:1773851858.270641:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851858.270643:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007c5d5314 refcount=5
00000020:00000001:19.0:1773851858.270644:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150544967680 : -106923164583936 : ffff9ec102c1b800)
00000020:00000001:19.0:1773851858.270644:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637150544967680 : -106923164583936 : ffff9ec102c1b800)
00000100:00000001:19.0:1773851858.270645:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.270646:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851858.270647:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851858.270648:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.270649:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851858.270650:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851858.270650:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851858.270651:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.270652:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851858.270652:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851858.270653:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.270654:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.270655:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851858.270655:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851858.270655:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851858.270655:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851858.270656:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15665@kfi7, seq: 2156274
00000100:00000040:19.0:1773851858.270657:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007c5d5314 : new rpc_count 1
00000100:00000001:19.0:1773851858.270657:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764356352 : -107095945195264 : ffff9e98c83ad100)
00000100:00000001:18.0:1773851858.270657:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.270658:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000072b2a9a2 x1859597858163520/t0(0) o400->ec7c29a5-8c84-476d-919f-b2b2034d0207@15665@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1469-0'
00000100:00000001:18.0:1773851858.270658:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.270661:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.270661:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851858.270662:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000072b2a9a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ec7c29a5-8c84-476d-919f-b2b2034d0207+5:39534:x1859597858163520:12345-15665@kfi7:400:default-tuolumne1469-0
00000100:00000200:19.0:1773851858.270663:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597858163520
00000020:00000001:19.0:1773851858.270664:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851858.270664:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851858.270665:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.270666:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851858.270666:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851858.270667:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851858.270668:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597858163520, found 0 last_xid 1859597858163519
00000020:00000001:19.0:1773851858.270668:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851858.270669:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851858.270669:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851858.270670:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.270670:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851858.270671:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851858.270671:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851858.270672:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ac06634d.
02000000:00000001:19.0:1773851858.270673:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.270673:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.270674:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851858.270675:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183250624123, transno 0, xid 1859597858163520
00010000:00000001:19.0:1773851858.270675:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851858.270676:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000072b2a9a2 x1859597858163520/t0(0) o400->ec7c29a5-8c84-476d-919f-b2b2034d0207@15665@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1469-0'
00010000:00000001:19.0:1773851858.270678:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851858.270679:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851858.270681:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=91 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851858.270682:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851858.270682:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000070739cd3 refcount 3 to 15665@kfi7
00000100:00000001:19.0:1773851858.270683:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579200 : -107154806972416 : ffff9e8b13cb6000)
02000000:00000001:19.0:1773851858.270684:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851858.270684:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.270685:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851858.270686:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15857@kfi7
00000400:00000010:19.0:1773851858.270686:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c4b6298d.
00000100:00000200:19.0:1773851858.270687:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597858163520, offset 224
00000400:00000200:19.0:1773851858.270688:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15857@kfi7
00000400:00000200:19.0:1773851858.270689:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15857@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.270690:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013db2662 nid 15857@kfi7 refs 1
00000400:00000200:19.0:1773851858.270690:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013db2662 nid 15857@kfi7 refs 2
00000400:00000200:19.0:1773851858.270691:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013db2662 nid 15857@kfi7 refs 3
00000400:00000200:19.0:1773851858.270692:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15857@kfi7 local destination
00000400:00000200:19.0:1773851858.270694:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768771:8768771:1024:4294967295] 15857@kfi7 LPNI seq info [4662569:4662569:16:4294967295]
00000400:00000200:19.0:1773851858.270695:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000013db2662 nid 15857@kfi7 refs 2
00000400:00000200:19.0:1773851858.270696:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15857@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.270698:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15857@kfi7(15857@kfi7:15857@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851858.270699:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013db2662 nid 15857@kfi7 refs 3
00000800:00000200:19.0:1773851858.270700:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851858.270701:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851858.270703:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851858.270706:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000714 Using peer 15857@kfi7(0x100000000000714)
00000800:00000200:19.0:1773851858.270709:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0x100000000000714: rc=0
00000800:00000200:19.0:1773851858.270710:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000714 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851858.270715:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.270716:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000070739cd3 refcount 2 to 15665@kfi7
00010000:00000001:19.0:1773851858.270717:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851858.270717:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.270718:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851858.270718:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000072b2a9a2 x1859597858163520/t0(0) o400->ec7c29a5-8c84-476d-919f-b2b2034d0207@15665@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1469-0'
00000100:00100000:19.0:1773851858.270721:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000072b2a9a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ec7c29a5-8c84-476d-919f-b2b2034d0207+5:39534:x1859597858163520:12345-15665@kfi7:400:default-tuolumne1469-0 Request processed in 60us (88us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851858.270722:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000714 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851858.270723:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851858.270724:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15665@kfi7, seq: 2156274
00000400:00000200:17.0:1773851858.270728:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15857@kfi7: PUT: OK
00000100:00000040:19.0:1773851858.270729:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007c5d5314 : new rpc_count 0
00000100:00000001:19.0:1773851858.270729:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851858.270729:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c4b6298d
00000400:00000010:17.0:1773851858.270729:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c4b6298d.
00000100:00000001:19.0:1773851858.270730:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851858.270730:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000100:00000001:17.0:1773851858.270730:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851858.270730:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851858.270731:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000400:00000200:17.0:1773851858.270731:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000013db2662 nid 15857@kfi7 refs 2
00000020:00000010:19.0:1773851858.270732:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000800:00000200:17.0:1773851858.270732:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 15857@kfi7(000000000f1de133):0x0 lsk 1813 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000714 Transaction freed
00000020:00000040:19.0:1773851858.270733:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007c5d5314 : new refcount 4
00000100:00000001:19.0:1773851858.270733:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851858.278449:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851858.278449:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851858.278450:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851858.278452:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851858.278453:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26481@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.278455:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26481@kfi7 : PUT - for me
00000400:00000200:17.0:1773851858.278456:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26481@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.278456:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d05ee73 nid 26481@kfi7 refs 1
00000400:00000200:17.0:1773851858.278457:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26481@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.278458:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d05ee73 nid 26481@kfi7 refs 2
00000400:00000200:17.0:1773851858.278459:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007d05ee73 nid 26481@kfi7 refs 3
00000400:00000200:17.0:1773851858.278460:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26545@kfi7 to cpt 0
00000400:00000200:17.0:1773851858.278460:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26545@kfi7 of length 224 into portal 12 MB=0x69a9d2302f440
00000400:00000200:17.0:1773851858.278461:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26545@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 193216
00000800:00000200:17.0:1773851858.278463:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851858.278464:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851858.278465:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26481@kfi7: PUT: OK
00000100:00000001:17.0:1773851858.278466:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851858.278467:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851858.278467:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008247c0fe.
00000100:00000040:17.0:1773851858.278468:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000008247c0fe x1858849548203072 msgsize 224
00000100:00100000:17.0:1773851858.278470:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26545@kfi7 (source: 12345-26481@kfi7)
00000100:00000001:17.0:1773851858.278471:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851858.278471:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007d05ee73 nid 26481@kfi7 refs 2
00000100:00000001:19.0:1773851858.278472:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851858.278472:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851858.278473:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851858.278473:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851858.278473:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851858.278474:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851858.278474:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858849548203072
00000020:00000001:19.0:1773851858.278475:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851858.278475:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91af7
00000020:00000001:19.0:1773851858.278476:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851858.278477:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000246064cc refcount=10
00000020:00000001:19.0:1773851858.278478:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627767296 : -107123081784320 : ffff9e9276c35400)
00000020:00000001:19.0:1773851858.278478:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627767296 : -107123081784320 : ffff9e9276c35400)
00000100:00000001:19.0:1773851858.278479:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.278481:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851858.278481:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851858.278482:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.278483:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851858.278483:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851858.278483:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851858.278484:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.278485:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851858.278485:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851858.278485:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.278486:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.278487:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851858.278487:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851858.278487:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851858.278488:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26545@kfi7, seq: 2156275
00000100:00000001:18.0:1773851858.278488:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851858.278489:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000246064cc : new rpc_count 1
00000100:00000001:19.0:1773851858.278489:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764342528 : -107095945209088 : ffff9e98c83a9b00)
00000100:00000001:18.0:1773851858.278489:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851858.278489:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.278491:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008247c0fe x1858849548203072/t0(0) o400->ddb78d4e-8032-4be7-a152-356ecb7471ea@26545@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2142-0'
00000100:00000001:19.0:1773851858.278493:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.278494:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851858.278494:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008247c0fe pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ddb78d4e-8032-4be7-a152-356ecb7471ea+10:39647:x1858849548203072:12345-26545@kfi7:400:default-tuolumne2142-0
00000100:00000200:19.0:1773851858.278495:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858849548203072
00000020:00000001:19.0:1773851858.278496:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851858.278496:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851858.278497:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.278497:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851858.278498:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851858.278499:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851858.278499:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858849548203072, found 0 last_xid 1858849548203071
00000020:00000001:19.0:1773851858.278500:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851858.278500:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851858.278501:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851858.278501:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.278503:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851858.278503:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851858.278503:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851858.278504:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000098535041.
02000000:00000001:19.0:1773851858.278505:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.278505:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.278505:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851858.278506:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676271426, transno 0, xid 1858849548203072
00010000:00000001:19.0:1773851858.278507:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851858.278508:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008247c0fe x1858849548203072/t0(0) o400->ddb78d4e-8032-4be7-a152-356ecb7471ea@26545@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2142-0'
00010000:00000001:19.0:1773851858.278510:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851858.278510:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851858.278511:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=91 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851858.278512:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851858.278513:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ca202be9 refcount 3 to 26545@kfi7
00000100:00000001:19.0:1773851858.278513:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530570784 : -107154178980832 : ffff9e8b3939c420)
02000000:00000001:19.0:1773851858.278514:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851858.278514:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.278515:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851858.278515:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26481@kfi7
00000400:00000010:19.0:1773851858.278516:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008f376219.
00000100:00000200:19.0:1773851858.278517:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858849548203072, offset 224
00000400:00000200:19.0:1773851858.278518:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26481@kfi7
00000400:00000200:19.0:1773851858.278519:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26481@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.278520:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d05ee73 nid 26481@kfi7 refs 1
00000400:00000200:19.0:1773851858.278521:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007d05ee73 nid 26481@kfi7 refs 2
00000400:00000200:19.0:1773851858.278522:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007d05ee73 nid 26481@kfi7 refs 3
00000400:00000200:19.0:1773851858.278523:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26481@kfi7 local destination
00000400:00000200:19.0:1773851858.278524:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768772:8768772:1024:4294967295] 26481@kfi7 LPNI seq info [767085:767085:16:4294967295]
00000400:00000200:19.0:1773851858.278525:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007d05ee73 nid 26481@kfi7 refs 2
00000400:00000200:19.0:1773851858.278526:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26481@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.278528:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26481@kfi7(26481@kfi7:26481@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851858.278530:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007d05ee73 nid 26481@kfi7 refs 3
00000800:00000200:19.0:1773851858.278531:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851858.278532:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851858.278534:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851858.278536:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5d5 Using peer 26481@kfi7(0x5d5)
00000800:00000200:19.0:1773851858.278539:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x5d5: rc=0
00000800:00000200:19.0:1773851858.278540:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5d5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851858.278542:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.278543:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ca202be9 refcount 2 to 26545@kfi7
00010000:00000001:19.0:1773851858.278543:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851858.278544:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.278544:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851858.278545:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008247c0fe x1858849548203072/t0(0) o400->ddb78d4e-8032-4be7-a152-356ecb7471ea@26545@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2142-0'
00000100:00100000:19.0:1773851858.278548:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008247c0fe pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ddb78d4e-8032-4be7-a152-356ecb7471ea+10:39647:x1858849548203072:12345-26545@kfi7:400:default-tuolumne2142-0 Request processed in 54us (79us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851858.278550:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26545@kfi7, seq: 2156275
00000100:00000040:19.0:1773851858.278551:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000246064cc : new rpc_count 0
00000100:00000001:19.0:1773851858.278551:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851858.278552:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851858.278552:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851858.278552:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5d5 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851858.278553:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000020:00000010:19.0:1773851858.278553:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000020:00000040:19.0:1773851858.278554:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000246064cc : new refcount 9
00000400:00000200:17.0:1773851858.278554:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851858.278555:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851858.278555:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26481@kfi7: PUT: OK
00000400:00000200:17.0:1773851858.278555:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008f376219
00000400:00000010:17.0:1773851858.278556:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008f376219.
00000100:00000001:17.0:1773851858.278557:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851858.278557:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851858.278558:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007d05ee73 nid 26481@kfi7 refs 2
00000800:00000200:17.0:1773851858.278559:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 26481@kfi7(000000008e364aa6):0x0 lsk 1494 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5d5 Transaction freed
00000800:00000200:14.0:1773851858.285954:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851858.285955:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851858.285956:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2069@kfi7:3 <- 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851858.285959:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2069@kfi7:3 <- 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851858.285963:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20993@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.285964:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20993@kfi7 : PUT - for me
00000400:00000200:14.0:1773851858.285965:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20993@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.285966:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6828767 nid 20993@kfi7 refs 1
00000400:00000200:14.0:1773851858.285967:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20993@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.285967:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6828767 nid 20993@kfi7 refs 2
00000400:00000200:14.0:1773851858.285968:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d6828767 nid 20993@kfi7 refs 3
00000400:00000200:14.0:1773851858.285969:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21184@kfi7 to cpt 2
00000400:00000200:14.0:1773851858.285970:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21184@kfi7 of length 224 into portal 12 MB=0x69b0aaa9a5780
00000400:00000200:14.0:1773851858.285972:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21184@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 18152
00000800:00000200:14.0:1773851858.285973:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2069@kfi7:3 <- 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851858.285975:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851858.285976:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20993@kfi7: PUT: OK
00000100:00000001:14.0:1773851858.285977:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851858.285977:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851858.285978:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a35c2c8a.
00000100:00000040:14.0:1773851858.285979:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000a35c2c8a x1859319974483840 msgsize 224
00000100:00100000:14.0:1773851858.285980:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-21184@kfi7 (source: 12345-20993@kfi7)
00000100:00000001:14.0:1773851858.285981:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851858.285982:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d6828767 nid 20993@kfi7 refs 2
00000100:00000001:13.0:1773851858.285983:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851858.285984:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dac95d1f: 2069@kfi7:3 <- 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:13.0:1773851858.285984:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851858.285984:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851858.285984:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851858.285985:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851858.285986:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319974483840
00000020:00000001:13.0:1773851858.285987:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851858.285987:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92562
00000020:00000001:13.0:1773851858.285988:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851858.285993:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b03a3aed refcount=775
00000020:00000001:13.0:1773851858.285993:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630778880 : -107123078772736 : ffff9e9276f14800)
00000020:00000001:13.0:1773851858.285994:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630778880 : -107123078772736 : ffff9e9276f14800)
00000100:00000001:13.0:1773851858.285996:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.285996:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851858.285997:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851858.285998:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.285999:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851858.286000:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851858.286000:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851858.286001:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.286002:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851858.286003:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851858.286003:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.286004:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851858.286006:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.286006:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851858.286006:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851858.286006:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851858.286007:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21184@kfi7, seq: 2289787
00000100:00000001:15.0:1773851858.286008:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.286008:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b03a3aed : new rpc_count 3
00000100:00000001:15.0:1773851858.286009:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.286009:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341821056 : -106946367730560 : ffff9ebb9bbdcc80)
00000100:00000040:13.0:1773851858.286010:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a35c2c8a x1859319974483840/t0(0) o400->defbcc6c-3580-43a4-950c-b09516f54ec8@21184@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1811-0'
00000100:00000001:13.0:1773851858.286013:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.286013:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851858.286014:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a35c2c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:defbcc6c-3580-43a4-950c-b09516f54ec8+775:39680:x1859319974483840:12345-21184@kfi7:400:default-tuolumne1811-0
00000100:00000200:13.0:1773851858.286016:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319974483840
00000020:00000001:13.0:1773851858.286016:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851858.286017:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851858.286018:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.286018:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851858.286019:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851858.286020:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851858.286020:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319974483840, found 0 last_xid 1859319829991935
00000020:00000001:13.0:1773851858.286021:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851858.286022:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851858.286022:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851858.286023:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.286023:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851858.286024:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851858.286025:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851858.286025:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000241d2396.
02000000:00000001:13.0:1773851858.286026:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.286027:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.286027:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851858.286028:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584171, transno 0, xid 1859319974483840
00010000:00000001:13.0:1773851858.286029:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851858.286030:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a35c2c8a x1859319974483840/t0(0) o400->defbcc6c-3580-43a4-950c-b09516f54ec8@21184@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1811-0'
00010000:00000001:13.0:1773851858.286032:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851858.286033:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851858.286033:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=91 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851858.286035:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851858.286035:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000059e1f25a refcount 3 to 21184@kfi7
00000100:00000001:13.0:1773851858.286036:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551673440 : -107156157878176 : ffff9e8ac3463060)
02000000:00000001:13.0:1773851858.286037:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851858.286037:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.286038:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851858.286039:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20993@kfi7
00000400:00000010:13.0:1773851858.286039:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f7a58502.
00000100:00000200:13.0:1773851858.286040:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859319974483840, offset 224
00000400:00000200:13.0:1773851858.286041:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20993@kfi7
00000400:00000200:13.0:1773851858.286042:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20993@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.286043:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6828767 nid 20993@kfi7 refs 1
00000400:00000200:13.0:1773851858.286044:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d6828767 nid 20993@kfi7 refs 2
00000400:00000200:13.0:1773851858.286045:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d6828767 nid 20993@kfi7 refs 3
00000400:00000200:13.0:1773851858.286046:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20993@kfi7 local destination
00000400:00000200:13.0:1773851858.286047:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768773:8768773:1024:4294967295] 20993@kfi7 LPNI seq info [7244199:7244199:16:4294967295]
00000400:00000200:13.0:1773851858.286049:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d6828767 nid 20993@kfi7 refs 2
00000400:00000200:13.0:1773851858.286050:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20993@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.286052:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20993@kfi7(20993@kfi7:20993@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851858.286053:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d6828767 nid 20993@kfi7 refs 3
00000800:00000200:13.0:1773851858.286055:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.286056:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851858.286058:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851858.286062:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe5b Using peer 20993@kfi7(0xe5b)
00000800:00000200:13.0:1773851858.286065:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 324 bytes to peer 0xe5b: rc=0
00000800:00000200:13.0:1773851858.286067:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe5b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851858.286069:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.286070:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000059e1f25a refcount 2 to 21184@kfi7
00010000:00000001:13.0:1773851858.286070:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851858.286071:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.286072:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851858.286072:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a35c2c8a x1859319974483840/t0(0) o400->defbcc6c-3580-43a4-950c-b09516f54ec8@21184@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1811-0'
00000100:00100000:13.0:1773851858.286075:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a35c2c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:defbcc6c-3580-43a4-950c-b09516f54ec8+775:39680:x1859319974483840:12345-21184@kfi7:400:default-tuolumne1811-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851858.286078:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21184@kfi7, seq: 2289787
00000100:00000040:13.0:1773851858.286078:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b03a3aed : new rpc_count 2
00000800:00000200:14.0:1773851858.286079:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe5b TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851858.286079:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851858.286079:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851858.286080:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851858.286080:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.286081:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000400:00000200:14.0:1773851858.286082:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20993@kfi7: PUT: OK
00000400:00000200:14.0:1773851858.286082:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f7a58502
00000020:00000010:13.0:1773851858.286082:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000020:00000040:13.0:1773851858.286082:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000b03a3aed : new refcount 774
00000400:00000010:14.0:1773851858.286083:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f7a58502.
00000100:00000001:13.0:1773851858.286083:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.286084:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851858.286084:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851858.286086:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d6828767 nid 20993@kfi7 refs 2
00000800:00000200:14.0:1773851858.286087:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 20993@kfi7(000000008a403c65):0x0 lsk 3676 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe5b Transaction freed
00000800:00000200:9.0:1773851858.328447:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.328448:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851858.328449:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851858.328451:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851858.328453:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.328455:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.102@tcp : PUT - for me
00000400:00000200:9.0:1773851858.328456:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.328457:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851858.328458:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.102@tcp to cpt 2
00000400:00000200:9.0:1773851858.328459:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000749af961 nid 172.16.70.102@tcp refs 2
00000400:00000200:9.0:1773851858.328460:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000749af961 nid 172.16.70.102@tcp refs 3
00000400:00000200:9.0:1773851858.328461:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.102@tcp to cpt 2
00000400:00000200:9.0:1773851858.328462:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.102@tcp of length 224 into portal 12 MB=0x69a106541a180
00000400:00000200:9.0:1773851858.328463:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.102@tcp of length 224/224 into md 0x78146ce49 [64] + 124560
00000800:00000200:9.0:1773851858.328465:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851858.328467:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851858.328468:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851858.328469:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851858.328470:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851858.328470:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000032a1f052.
00000100:00000040:9.0:1773851858.328471:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000032a1f052 x1858245069218176 msgsize 224
00000100:00100000:9.0:1773851858.328473:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.102@tcp (source: 12345-172.16.70.102@tcp)
00000100:00000001:9.0:1773851858.328474:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851858.328475:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:11.0:1773851858.328476:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851858.328476:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851858.328477:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851858.328477:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851858.328477:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851858.328478:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851858.328479:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858245069218176
00000020:00000001:11.0:1773851858.328479:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851858.328480:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93044
00000020:00000001:11.0:1773851858.328480:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851858.328482:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000764c275c refcount=6
00000020:00000001:11.0:1773851858.328483:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745160704 : -107128964390912 : ffff9e911821e000)
00000020:00000001:11.0:1773851858.328484:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745160704 : -107128964390912 : ffff9e911821e000)
00000100:00000001:11.0:1773851858.328485:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851858.328485:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851858.328486:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009caf48ee.
00000020:00000010:11.0:1773851858.328487:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851858.328488:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005dedb898.
00000100:00000001:11.0:1773851858.328489:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851858.328489:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851858.328490:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851858.328491:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851858.328491:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851858.328492:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851858.328493:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851858.328494:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851858.328494:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851858.328494:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851858.328494:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851858.328496:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.102@tcp, seq: 2130736
00000100:00000001:11.0:1773851858.328497:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851858.328497:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.328497:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000764c275c : new rpc_count 1
00000100:00000001:10.0:1773851858.328498:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064878720 : -106983644672896 : ffff9eb2eddccc80)
00000100:00000040:10.0:1773851858.328499:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000032a1f052 x1858245069218176/t0(0) o400->5c3a37e8-885a-4231-a6fd-c6c56d620030@172.16.70.102@tcp:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic2-0'
00000100:00000001:10.0:1773851858.328502:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.328502:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851858.328503:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032a1f052 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5c3a37e8-885a-4231-a6fd-c6c56d620030+6:34209:x1858245069218176:12345-172.16.70.102@tcp:400:login-rzslic2-0
00000100:00000200:10.0:1773851858.328505:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858245069218176
00000020:00000001:10.0:1773851858.328506:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851858.328506:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851858.328507:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.328508:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851858.328508:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851858.328509:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851858.328509:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858245069218176, found 0 last_xid 1858245069218175
00000020:00000001:10.0:1773851858.328510:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851858.328511:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851858.328511:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851858.328512:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.328512:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851858.328513:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851858.328514:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851858.328515:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000014daa50c.
02000000:00000001:10.0:1773851858.328515:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.328516:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.328516:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851858.328517:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858245069218176
00010000:00000001:10.0:1773851858.328518:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851858.328519:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000032a1f052 x1858245069218176/t0(0) o400->5c3a37e8-885a-4231-a6fd-c6c56d620030@172.16.70.102@tcp:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic2-0'
00010000:00000001:10.0:1773851858.328522:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851858.328522:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851858.328523:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=91 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851858.328524:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851858.328525:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002fde0e75 refcount 3 to 172.16.70.102@tcp
00000100:00000001:10.0:1773851858.328526:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580160 : -107154806971456 : ffff9e8b13cb63c0)
02000000:00000001:10.0:1773851858.328527:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851858.328527:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.328528:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851858.328529:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.102@tcp
00000400:00000010:10.0:1773851858.328530:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009fd35021.
00000100:00000200:10.0:1773851858.328530:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858245069218176, offset 224
00000400:00000200:10.0:1773851858.328532:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.102@tcp
00000400:00000200:10.0:1773851858.328533:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.102@tcp to cpt 2
00000400:00000200:10.0:1773851858.328534:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000749af961 nid 172.16.70.102@tcp refs 2
00000400:00000200:10.0:1773851858.328535:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000749af961 nid 172.16.70.102@tcp refs 3
00000400:00000200:10.0:1773851858.328536:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000749af961 nid 172.16.70.102@tcp refs 4
00000400:00000200:10.0:1773851858.328538:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.102@tcp routed destination
00000400:00000200:10.0:1773851858.328539:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:10.0:1773851858.328540:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:10.0:1773851858.328542:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.102@tcp: rtr pref emtpy: 1
00000400:00000200:10.0:1773851858.328543:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:10.0:1773851858.328544:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.102@tcp: rtr pref emtpy: 1
00000400:00000200:10.0:1773851858.328545:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:10.0:1773851858.328546:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768774:8768774:1024:4294967295] 17@kfi7 LPNI seq info [1250891883:1250891883:16:4294967295]
00000400:00000200:10.0:1773851858.328548:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:10.0:1773851858.328549:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.328551:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.102@tcp(172.16.70.102@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851858.328552:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000749af961 nid 172.16.70.102@tcp refs 3
00000800:00000200:10.0:1773851858.328554:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851858.328555:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851858.328557:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851858.328561:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:10.0:1773851858.328565:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000000600ceff: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:10.0:1773851858.328566:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851858.328568:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.328569:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002fde0e75 refcount 2 to 172.16.70.102@tcp
00010000:00000001:10.0:1773851858.328570:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851858.328570:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.328571:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851858.328572:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000032a1f052 x1858245069218176/t0(0) o400->5c3a37e8-885a-4231-a6fd-c6c56d620030@172.16.70.102@tcp:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic2-0'
00000100:00100000:10.0:1773851858.328575:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032a1f052 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5c3a37e8-885a-4231-a6fd-c6c56d620030+6:34209:x1858245069218176:12345-172.16.70.102@tcp:400:login-rzslic2-0 Request processed in 72us (103us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851858.328578:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.102@tcp, seq: 2130736
00000100:00000040:10.0:1773851858.328578:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000764c275c : new rpc_count 0
00000800:00000200:9.0:1773851858.328578:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851858.328579:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851858.328579:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851858.328580:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851858.328580:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851858.328580:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000010:10.0:1773851858.328581:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005dedb898.
00000400:00000200:9.0:1773851858.328581:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009fd35021
00000020:00000010:10.0:1773851858.328582:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009caf48ee.
00000400:00000010:9.0:1773851858.328582:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009fd35021.
00000100:00000001:9.0:1773851858.328582:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:10.0:1773851858.328583:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000764c275c : new refcount 5
00000100:00000001:9.0:1773851858.328583:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:10.0:1773851858.328584:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851858.328584:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851858.328585:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000800:00000200:5.0:1773851858.333947:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851858.333949:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.333949:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851858.333950:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851858.333950:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851858.333952:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16144@kfi7(00000000b9840f18):0x2c1 version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851858.333953:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851858.333954:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 Using peer 16144@kfi7(0x1000000000002c1)
00000800:00000200:6.0:1773851858.333956:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851858.333956:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16144@kfi7 to cpt 1
00000800:00000200:5.0:1773851858.333958:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 38 bytes to peer 0x1000000000002c1: rc=0
00000800:00000200:5.0:1773851858.333959:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851858.333960:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16144@kfi7 to cpt 1
00000400:00000200:6.0:1773851858.333962:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16144@kfi7 : PUT - for me
00000400:00000200:6.0:1773851858.333964:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16144@kfi7 to cpt 1
00000400:00000200:6.0:1773851858.333965:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000089908e28 nid 16144@kfi7 refs 1
00000400:00000200:6.0:1773851858.333967:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16144@kfi7 to cpt 1
00000400:00000200:6.0:1773851858.333968:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000089908e28 nid 16144@kfi7 refs 2
00000400:00000200:6.0:1773851858.333969:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000089908e28 nid 16144@kfi7 refs 3
00000400:00000200:6.0:1773851858.333971:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16145@kfi7 to cpt 4
00000800:00000200:5.0:1773851858.333971:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851858.333973:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16145@kfi7 of length 224 into portal 12 MB=0x69b4b889d0880
00000800:00000200:5.0:1773851858.333973:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 Transaction freed
00000400:00000200:6.0:1773851858.333976:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16145@kfi7 of length 224/224 into md 0x793926dc5 [64] + 121608
00000800:00000200:6.0:1773851858.333979:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851858.333982:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851858.333984:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16144@kfi7: PUT: OK
00000100:00000001:6.0:1773851858.333986:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851858.333987:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851858.333988:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e16d771b.
00000100:00000040:6.0:1773851858.333990:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000e16d771b x1859598577109120 msgsize 224
00000100:00100000:6.0:1773851858.333992:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-16145@kfi7 (source: 12345-16144@kfi7)
00000100:00000001:6.0:1773851858.333994:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:5.0:1773851858.333995:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851858.333996:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000089908e28 nid 16144@kfi7 refs 2
02000000:00000001:5.0:1773851858.333996:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.333996:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851858.333997:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851858.333997:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851858.333998:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00100000:5.0:1773851858.333998:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598577109120
00000020:00000001:5.0:1773851858.333999:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851858.333999:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d814ed
00000020:00000001:5.0:1773851858.334000:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.334001:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000016e573e refcount=166
00000020:00000001:5.0:1773851858.334002:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110101419008 : -106963608132608 : ffff9eb798222400)
00000020:00000001:5.0:1773851858.334003:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110101419008 : -106963608132608 : ffff9eb798222400)
00000100:00000001:5.0:1773851858.334004:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.334005:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851858.334005:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851858.334006:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.334007:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851858.334008:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.334009:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851858.334009:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.334010:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851858.334011:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851858.334011:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.334012:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.334013:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851858.334014:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851858.334015:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:5.0:1773851858.334015:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16145@kfi7, seq: 2001866
00000100:00000040:5.0:1773851858.334015:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000016e573e : new rpc_count 1
00000100:00000001:7.0:1773851858.334016:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851858.334016:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.334016:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093953697024 : -106979755854592 : ffff9eb3d5a77500)
00000100:00000001:7.0:1773851858.334017:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.334017:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e16d771b x1859598577109120/t0(0) o400->7446b5a6-5ece-4de8-b704-bd7e84cce4c6@16145@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1505-0'
00000100:00000001:5.0:1773851858.334020:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.334020:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851858.334021:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e16d771b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7446b5a6-5ece-4de8-b704-bd7e84cce4c6+166:39613:x1859598577109120:12345-16145@kfi7:400:default-tuolumne1505-0
00000100:00000200:5.0:1773851858.334023:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598577109120
00000020:00000001:5.0:1773851858.334023:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851858.334024:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851858.334025:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.334025:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851858.334026:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851858.334027:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851858.334027:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598577109120, found 0 last_xid 1859598576685631
00000020:00000001:5.0:1773851858.334028:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851858.334029:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851858.334029:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851858.334030:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.334031:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851858.334031:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851858.334032:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851858.334032:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000093a22904.
02000000:00000001:5.0:1773851858.334033:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.334034:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.334034:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851858.334035:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062617, transno 0, xid 1859598577109120
00010000:00000001:5.0:1773851858.334036:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851858.334037:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e16d771b x1859598577109120/t0(0) o400->7446b5a6-5ece-4de8-b704-bd7e84cce4c6@16145@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1505-0'
00010000:00000001:5.0:1773851858.334039:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851858.334040:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851858.334040:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=90 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851858.334041:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851858.334042:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006b96d8be refcount 3 to 16145@kfi7
00000100:00000001:5.0:1773851858.334043:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095775936 : -107152613775680 : ffff9e8b9684e6c0)
02000000:00000001:5.0:1773851858.334043:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851858.334044:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.334045:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851858.334045:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16144@kfi7
00000400:00000010:5.0:1773851858.334046:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013dbcf4f.
00000100:00000200:5.0:1773851858.334047:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598577109120, offset 224
00000400:00000200:5.0:1773851858.334048:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16144@kfi7
00000400:00000200:5.0:1773851858.334049:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16144@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.334050:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000089908e28 nid 16144@kfi7 refs 1
00000400:00000200:5.0:1773851858.334051:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000089908e28 nid 16144@kfi7 refs 2
00000400:00000200:5.0:1773851858.334052:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000089908e28 nid 16144@kfi7 refs 3
00000400:00000200:5.0:1773851858.334053:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16144@kfi7 local destination
00000400:00000200:5.0:1773851858.334054:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768775:8768775:1024:4294967295] 16144@kfi7 LPNI seq info [3684284:3684284:16:4294967295]
00000400:00000200:5.0:1773851858.334055:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000089908e28 nid 16144@kfi7 refs 2
00000400:00000200:5.0:1773851858.334056:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16144@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.334058:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16144@kfi7(16144@kfi7:16144@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851858.334059:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000089908e28 nid 16144@kfi7 refs 3
00000800:00000200:5.0:1773851858.334060:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.334061:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851858.334065:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851858.334067:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 Using peer 16144@kfi7(0x1000000000002c1)
00000800:00000200:5.0:1773851858.334070:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x1000000000002c1: rc=0
00000800:00000200:5.0:1773851858.334071:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851858.334073:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.334074:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006b96d8be refcount 2 to 16145@kfi7
00010000:00000001:5.0:1773851858.334075:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851858.334075:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.334076:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851858.334077:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e16d771b x1859598577109120/t0(0) o400->7446b5a6-5ece-4de8-b704-bd7e84cce4c6@16145@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1505-0'
00000100:00100000:5.0:1773851858.334080:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e16d771b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7446b5a6-5ece-4de8-b704-bd7e84cce4c6+166:39613:x1859598577109120:12345-16145@kfi7:400:default-tuolumne1505-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851858.334082:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16145@kfi7, seq: 2001866
00000100:00000040:5.0:1773851858.334083:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000016e573e : new rpc_count 0
00000100:00000001:5.0:1773851858.334084:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851858.334084:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:6.0:1773851858.334085:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851858.334085:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.334085:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000020:00000010:5.0:1773851858.334086:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000400:00000200:6.0:1773851858.334087:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:5.0:1773851858.334087:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000016e573e : new refcount 165
00000100:00000001:5.0:1773851858.334087:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851858.334089:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16144@kfi7: PUT: OK
00000400:00000200:6.0:1773851858.334091:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013dbcf4f
00000400:00000010:6.0:1773851858.334091:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013dbcf4f.
00000100:00000001:6.0:1773851858.334093:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851858.334093:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851858.334095:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000089908e28 nid 16144@kfi7 refs 2
00000800:00000200:6.0:1773851858.334097:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 16144@kfi7(00000000b9840f18):0x0 lsk 706 rsk 30 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002c1 Transaction freed
00000800:00000200:13.0:1773851858.343439:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.343440:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851858.343442:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851858.343446:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851858.343449:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343451:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18171@kfi7 : PUT - for me
00000400:00000200:13.0:1773851858.343453:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343454:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 1
00000400:00000200:13.0:1773851858.343456:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343457:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000400:00000200:13.0:1773851858.343459:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 3
00000400:00000200:13.0:1773851858.343460:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343462:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18171@kfi7 of length 224 into portal 12 MB=0x699de89eac740
00000400:00000200:13.0:1773851858.343464:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18171@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 18376
00000800:00000200:13.0:1773851858.343467:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851858.343470:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851858.343472:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18171@kfi7: PUT: OK
00000100:00000001:13.0:1773851858.343474:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851858.343475:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851858.343476:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000940f31a7.
00000100:00000040:13.0:1773851858.343478:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000940f31a7 x1858030935918400 msgsize 224
00000100:00100000:13.0:1773851858.343480:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18171@kfi7 (source: 12345-18171@kfi7)
00000100:00000001:13.0:1773851858.343482:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851858.343484:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000800:00000200:13.0:1773851858.343487:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851858.343491:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851858.343492:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851858.343493:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851858.343494:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851858.343495:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851858.343496:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030935918400
00000020:00000001:13.0:1773851858.343497:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851858.343498:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910bd
00000020:00000001:13.0:1773851858.343499:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851858.343503:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000043aa5fd3 refcount=6
00000020:00000001:13.0:1773851858.343504:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240347648 : -107152469203968 : ffff9e8b9f22e400)
00000020:00000001:13.0:1773851858.343508:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240347648 : -107152469203968 : ffff9e8b9f22e400)
00000100:00000001:13.0:1773851858.343510:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.343511:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851858.343512:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851858.343514:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.343515:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851858.343516:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851858.343517:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851858.343518:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.343519:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851858.343520:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851858.343520:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343522:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.343524:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.343525:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.343525:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851858.343525:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851858.343527:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18171@kfi7, seq: 2289788
00000100:00000001:15.0:1773851858.343528:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.343528:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000043aa5fd3 : new rpc_count 1
00000100:00000001:15.0:1773851858.343529:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343529:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537169152 : -107002172382464 : ffff9eae9d866300)
00000100:00000040:13.0:1773851858.343531:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000940f31a7 x1858030935918400/t0(0) o400->eebfc0d8-33b7-4704-8f94-9568698e6b7b@18171@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne239-0'
00000100:00000001:13.0:1773851858.343535:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.343536:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851858.343537:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000940f31a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:eebfc0d8-33b7-4704-8f94-9568698e6b7b+6:47761:x1858030935918400:12345-18171@kfi7:400:default-tuolumne239-0
00000100:00000200:13.0:1773851858.343539:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030935918400
00000020:00000001:13.0:1773851858.343540:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851858.343541:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851858.343542:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343543:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851858.343544:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851858.343545:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851858.343546:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030935918400, found 0 last_xid 1858030935918399
00000020:00000001:13.0:1773851858.343547:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851858.343549:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851858.343550:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851858.343550:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343551:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851858.343552:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851858.343553:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851858.343554:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002e10b018.
02000000:00000001:13.0:1773851858.343555:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343556:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343557:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851858.343558:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030935918400
00010000:00000001:13.0:1773851858.343559:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851858.343561:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000940f31a7 x1858030935918400/t0(0) o400->eebfc0d8-33b7-4704-8f94-9568698e6b7b@18171@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne239-0'
00010000:00000001:13.0:1773851858.343565:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851858.343565:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851858.343566:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=91 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851858.343568:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851858.343569:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000027f6512e refcount 5 to 18171@kfi7
00000100:00000001:13.0:1773851858.343570:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487623232 : -107151221928384 : ffff9e8be97ace40)
02000000:00000001:13.0:1773851858.343571:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851858.343572:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343573:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851858.343574:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18171@kfi7
00000400:00000010:13.0:1773851858.343575:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000de6ab09e.
00000100:00000200:13.0:1773851858.343576:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030935918400, offset 224
00000400:00000200:13.0:1773851858.343578:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18171@kfi7
00000400:00000200:13.0:1773851858.343579:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343580:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 1
00000400:00000200:13.0:1773851858.343582:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000400:00000200:13.0:1773851858.343584:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 3
00000400:00000200:13.0:1773851858.343586:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18171@kfi7 local destination
00000400:00000200:13.0:1773851858.343588:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768776:8768776:1024:4294967295] 18171@kfi7 LPNI seq info [24456:24456:16:4294967295]
00000400:00000200:13.0:1773851858.343590:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000400:00000200:13.0:1773851858.343592:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343595:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18171@kfi7(18171@kfi7:18171@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851858.343597:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 3
00000800:00000200:13.0:1773851858.343599:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.343600:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851858.343604:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851858.343608:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000024d Using peer 18171@kfi7(0x10000000000024d)
00000800:00000200:13.0:1773851858.343612:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000af8ff251: Posted send of 324 bytes to peer 0x10000000000024d: rc=0
00000800:00000200:13.0:1773851858.343614:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000024d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851858.343617:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.343619:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000027f6512e refcount 4 to 18171@kfi7
00010000:00000001:13.0:1773851858.343620:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851858.343621:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343622:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851858.343623:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000940f31a7 x1858030935918400/t0(0) o400->eebfc0d8-33b7-4704-8f94-9568698e6b7b@18171@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne239-0'
00000100:00100000:13.0:1773851858.343628:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000940f31a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:eebfc0d8-33b7-4704-8f94-9568698e6b7b+6:47761:x1858030935918400:12345-18171@kfi7:400:default-tuolumne239-0 Request processed in 91us (149us total) trans 0 rc 0/0
00000800:00000200:14.0:1773851858.343630:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000024d TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851858.343631:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18171@kfi7, seq: 2289788
00000100:00000040:13.0:1773851858.343632:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000043aa5fd3 : new rpc_count 0
00000400:00000200:14.0:1773851858.343633:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851858.343633:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851858.343634:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18171@kfi7: PUT: OK
00000100:00000001:13.0:1773851858.343634:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851858.343635:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851858.343636:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000de6ab09e
00000400:00000010:14.0:1773851858.343636:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000de6ab09e.
00000020:00000010:13.0:1773851858.343636:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000100:00000001:14.0:1773851858.343637:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:13.0:1773851858.343637:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000100:00000001:14.0:1773851858.343638:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:13.0:1773851858.343638:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000043aa5fd3 : new refcount 5
00000400:00000200:14.0:1773851858.343639:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000100:00000001:13.0:1773851858.343640:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851858.343642:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 18171@kfi7(0000000087fdd1e1):0x0 lsk 590 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000024d Transaction freed
00000800:00000200:13.0:1773851858.343783:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.343784:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851858.343786:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851858.343790:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851858.343793:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343796:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18171@kfi7 : PUT - for me
00000400:00000200:13.0:1773851858.343798:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343799:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 1
00000400:00000200:13.0:1773851858.343801:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343802:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000400:00000200:13.0:1773851858.343803:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 3
00000400:00000200:13.0:1773851858.343805:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343807:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18171@kfi7 of length 224 into portal 12 MB=0x699de89eacec0
00000400:00000200:13.0:1773851858.343809:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18171@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 18600
00000800:00000200:13.0:1773851858.343812:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851858.343815:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851858.343817:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18171@kfi7: PUT: OK
00000100:00000001:13.0:1773851858.343819:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851858.343820:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851858.343821:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000089e9a3dd.
00000100:00000040:13.0:1773851858.343822:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000089e9a3dd x1858030935920320 msgsize 224
00000100:00100000:13.0:1773851858.343825:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18171@kfi7 (source: 12345-18171@kfi7)
00000100:00000001:13.0:1773851858.343827:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851858.343828:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000800:00000200:13.0:1773851858.343831:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851858.343835:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851858.343836:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851858.343837:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851858.343838:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851858.343839:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851858.343840:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030935920320
00000020:00000001:13.0:1773851858.343841:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851858.343842:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91196
00000020:00000001:13.0:1773851858.343843:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851858.343846:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000609560e4 refcount=6
00000020:00000001:13.0:1773851858.343847:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240527872 : -107152469023744 : ffff9e8b9f25a400)
00000020:00000001:13.0:1773851858.343849:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240527872 : -107152469023744 : ffff9e8b9f25a400)
00000100:00000001:13.0:1773851858.343850:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.343851:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851858.343852:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851858.343853:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.343855:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851858.343856:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851858.343856:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851858.343857:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.343858:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851858.343859:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851858.343859:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343860:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851858.343862:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851858.343862:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.343863:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851858.343863:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851858.343864:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18171@kfi7, seq: 2289789
00000100:00000001:15.0:1773851858.343865:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.343865:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000609560e4 : new rpc_count 1
00000100:00000001:15.0:1773851858.343866:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343866:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537150720 : -107002172400896 : ffff9eae9d861b00)
00000100:00000040:13.0:1773851858.343867:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000089e9a3dd x1858030935920320/t0(0) o400->36a4ef28-52e9-4abe-a0bc-fcf468bf2fba@18171@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne239-0'
00000100:00000001:13.0:1773851858.343870:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.343870:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851858.343871:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089e9a3dd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:36a4ef28-52e9-4abe-a0bc-fcf468bf2fba+6:47759:x1858030935920320:12345-18171@kfi7:400:default-tuolumne239-0
00000100:00000200:13.0:1773851858.343872:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030935920320
00000020:00000001:13.0:1773851858.343873:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851858.343873:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851858.343874:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343875:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851858.343875:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851858.343876:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851858.343876:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030935920320, found 0 last_xid 1858030935920319
00000020:00000001:13.0:1773851858.343877:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851858.343877:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851858.343878:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851858.343878:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343879:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851858.343879:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851858.343879:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851858.343881:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000073296cc8.
02000000:00000001:13.0:1773851858.343881:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343882:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343883:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851858.343883:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767983, transno 0, xid 1858030935920320
00010000:00000001:13.0:1773851858.343884:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851858.343885:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000089e9a3dd x1858030935920320/t0(0) o400->36a4ef28-52e9-4abe-a0bc-fcf468bf2fba@18171@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne239-0'
00010000:00000001:13.0:1773851858.343887:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851858.343888:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851858.343888:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=91 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851858.343889:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851858.343890:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000027f6512e refcount 5 to 18171@kfi7
00000100:00000001:13.0:1773851858.343890:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487623232 : -107151221928384 : ffff9e8be97ace40)
02000000:00000001:13.0:1773851858.343891:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851858.343891:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.343892:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851858.343893:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18171@kfi7
00000400:00000010:13.0:1773851858.343893:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022d7296e.
00000100:00000200:13.0:1773851858.343894:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030935920320, offset 224
00000400:00000200:13.0:1773851858.343895:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18171@kfi7
00000400:00000200:13.0:1773851858.343897:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343897:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 1
00000400:00000200:13.0:1773851858.343898:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000400:00000200:13.0:1773851858.343899:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 3
00000400:00000200:13.0:1773851858.343901:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18171@kfi7 local destination
00000400:00000200:13.0:1773851858.343902:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768777:8768777:1024:4294967295] 18171@kfi7 LPNI seq info [24457:24457:16:4294967295]
00000400:00000200:13.0:1773851858.343903:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000400:00000200:13.0:1773851858.343904:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18171@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.343906:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18171@kfi7(18171@kfi7:18171@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851858.343907:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 3
00000800:00000200:13.0:1773851858.343908:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.343908:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851858.343910:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851858.343912:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x24b Using peer 18171@kfi7(0x24b)
00000800:00000200:13.0:1773851858.343915:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000af8ff251: Posted send of 324 bytes to peer 0x24b: rc=0
00000800:00000200:13.0:1773851858.343916:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x24b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851858.343917:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.343918:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000027f6512e refcount 4 to 18171@kfi7
00010000:00000001:13.0:1773851858.343918:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851858.343919:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.343919:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851858.343920:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000089e9a3dd x1858030935920320/t0(0) o400->36a4ef28-52e9-4abe-a0bc-fcf468bf2fba@18171@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne239-0'
00000100:00100000:13.0:1773851858.343922:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089e9a3dd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:36a4ef28-52e9-4abe-a0bc-fcf468bf2fba+6:47759:x1858030935920320:12345-18171@kfi7:400:default-tuolumne239-0 Request processed in 52us (99us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851858.343924:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18171@kfi7, seq: 2289789
00000100:00000040:13.0:1773851858.343925:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000609560e4 : new rpc_count 0
00000100:00000001:13.0:1773851858.343926:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851858.343926:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851858.343927:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.343927:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000020:00000010:13.0:1773851858.343928:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000020:00000040:13.0:1773851858.343928:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000609560e4 : new refcount 5
00000800:00000200:14.0:1773851858.343929:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x24b TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851858.343929:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851858.343930:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851858.343931:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18171@kfi7: PUT: OK
00000400:00000200:14.0:1773851858.343932:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022d7296e
00000400:00000010:14.0:1773851858.343932:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022d7296e.
00000100:00000001:14.0:1773851858.343933:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851858.343933:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851858.343934:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001ee83271 nid 18171@kfi7 refs 2
00000800:00000200:14.0:1773851858.343935:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 18171@kfi7(00000000d51feb19):0x0 lsk 588 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x24b Transaction freed
00000800:00000200:26.0:1773851858.354469:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.354469:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.354470:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.354470:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851858.354471:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.354471:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851858.354472:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13907@kfi7(0000000078281e1f):0x87d version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851858.354473:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851858.354474:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d Using peer 13907@kfi7(0x10000000000087d)
00000400:00000200:26.0:1773851858.354475:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13907@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.354476:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13907@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.354476:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13907@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.354477:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13907@kfi7 to cpt 6
00000800:00000200:25.0:1773851858.354477:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x10000000000087d: rc=0
00000400:00000200:26.0:1773851858.354478:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cd35516 nid 13907@kfi7 refs 1
00000400:00000200:26.0:1773851858.354479:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13907@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.354479:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cd35516 nid 13907@kfi7 refs 2
00000800:00000200:25.0:1773851858.354479:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851858.354480:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006cd35516 nid 13907@kfi7 refs 3
00000400:00000200:26.0:1773851858.354481:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13907@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.354482:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13907@kfi7 of length 224 into portal 12 MB=0x699e0f0137940
00000400:00000200:26.0:1773851858.354484:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13907@kfi7 of length 224/224 into md 0x16159c6179 [64] + 185104
00000800:00000200:26.0:1773851858.354485:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851858.354487:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851858.354489:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13907@kfi7: PUT: OK
00000100:00000001:26.0:1773851858.354490:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.354490:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851858.354490:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d TN_EVENT_TX_OK event status 0
00000100:00000010:26.0:1773851858.354491:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d2e52283.
00000100:00000040:26.0:1773851858.354492:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000d2e52283 x1858041239796032 msgsize 224
00000100:00100000:26.0:1773851858.354493:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-13907@kfi7 (source: 12345-13907@kfi7)
00000100:00000001:26.0:1773851858.354494:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:25.0:1773851858.354494:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d Transaction freed
00000400:00000200:26.0:1773851858.354495:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006cd35516 nid 13907@kfi7 refs 2
00000800:00000200:26.0:1773851858.354497:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851858.354499:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851858.354500:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851858.354500:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851858.354501:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851858.354502:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851858.354502:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041239796032
00000020:00000001:25.0:1773851858.354503:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851858.354504:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e18c1225b
00000020:00000001:25.0:1773851858.354504:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851858.354506:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000579b8e3 refcount=167
00000020:00000001:25.0:1773851858.354507:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636967056439296 : -107106653112320 : ffff9e9649fcf800)
00000020:00000001:25.0:1773851858.354508:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636967056439296 : -107106653112320 : ffff9e9649fcf800)
00000100:00000001:25.0:1773851858.354509:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851858.354510:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851858.354510:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:25.0:1773851858.354511:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851858.354512:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006daec5af.
00000100:00000001:25.0:1773851858.354513:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851858.354513:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851858.354514:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.354515:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851858.354516:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851858.354516:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.354517:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.354518:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851858.354518:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851858.354519:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851858.354519:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851858.354520:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13907@kfi7, seq: 2025062
00000100:00000001:25.0:1773851858.354521:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.354521:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851858.354521:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000579b8e3 : new rpc_count 1
00000100:00000001:24.0:1773851858.354521:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637115538606336 : -106958170945280 : ffff9eb8dc370900)
00000100:00000040:24.0:1773851858.354522:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d2e52283 x1858041239796032/t0(0) o400->a2fa94f4-ff02-46b7-a1c6-6875a7c55483@13907@kfi7:75/0 lens 224/0 e 0 to 0 dl 1773852190 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1366-0'
00000100:00000001:24.0:1773851858.354525:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.354525:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851858.354526:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2e52283 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:a2fa94f4-ff02-46b7-a1c6-6875a7c55483+167:39659:x1858041239796032:12345-13907@kfi7:400:default-tuolumne1366-0
00000100:00000200:24.0:1773851858.354528:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041239796032
00000020:00000001:24.0:1773851858.354529:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851858.354529:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851858.354530:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.354531:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.354531:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851858.354532:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851858.354532:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041239796032, found 0 last_xid 1858041239371391
00000020:00000001:24.0:1773851858.354533:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851858.354534:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851858.354534:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.354535:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.354535:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851858.354536:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851858.354536:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851858.354538:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000705a3f71.
02000000:00000001:24.0:1773851858.354538:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.354539:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.354540:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851858.354540:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063247, transno 0, xid 1858041239796032
00010000:00000001:24.0:1773851858.354541:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851858.354542:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d2e52283 x1858041239796032/t0(0) o400->a2fa94f4-ff02-46b7-a1c6-6875a7c55483@13907@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1366-0'
00010000:00000001:24.0:1773851858.354544:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851858.354545:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851858.354545:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=91 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851858.354546:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851858.354547:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001cddbda0 refcount 3 to 13907@kfi7
00000100:00000001:24.0:1773851858.354548:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092334528 : -107152617217088 : ffff9e8b965063c0)
02000000:00000001:24.0:1773851858.354549:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851858.354549:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.354550:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851858.354550:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13907@kfi7
00000400:00000010:24.0:1773851858.354551:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047620e92.
00000100:00000200:24.0:1773851858.354552:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041239796032, offset 224
00000400:00000200:24.0:1773851858.354553:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13907@kfi7
00000400:00000200:24.0:1773851858.354554:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13907@kfi7 to cpt 6
00000400:00000200:24.0:1773851858.354554:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cd35516 nid 13907@kfi7 refs 1
00000400:00000200:24.0:1773851858.354555:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006cd35516 nid 13907@kfi7 refs 2
00000400:00000200:24.0:1773851858.354556:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006cd35516 nid 13907@kfi7 refs 3
00000400:00000200:24.0:1773851858.354557:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13907@kfi7 local destination
00000400:00000200:24.0:1773851858.354558:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768778:8768778:1024:4294967295] 13907@kfi7 LPNI seq info [8349454:8349454:16:4294967295]
00000400:00000200:24.0:1773851858.354560:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006cd35516 nid 13907@kfi7 refs 2
00000400:00000200:24.0:1773851858.354561:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13907@kfi7 to cpt 6
00000400:00000200:24.0:1773851858.354563:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13907@kfi7(13907@kfi7:13907@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851858.354564:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006cd35516 nid 13907@kfi7 refs 3
00000800:00000200:24.0:1773851858.354565:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851858.354566:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851858.354568:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851858.354570:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d Using peer 13907@kfi7(0x10000000000087d)
00000800:00000200:24.0:1773851858.354573:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x10000000000087d: rc=0
00000800:00000200:24.0:1773851858.354574:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851858.354576:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851858.354577:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001cddbda0 refcount 2 to 13907@kfi7
00010000:00000001:24.0:1773851858.354578:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851858.354578:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.354579:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851858.354580:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d2e52283 x1858041239796032/t0(0) o400->a2fa94f4-ff02-46b7-a1c6-6875a7c55483@13907@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1366-0'
00000100:00100000:24.0:1773851858.354584:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2e52283 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:a2fa94f4-ff02-46b7-a1c6-6875a7c55483+167:39659:x1858041239796032:12345-13907@kfi7:400:default-tuolumne1366-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851858.354587:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13907@kfi7, seq: 2025062
00000100:00000040:24.0:1773851858.354588:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000579b8e3 : new rpc_count 0
00000100:00000001:24.0:1773851858.354588:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851858.354589:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.354590:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851858.354590:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006daec5af.
00000020:00000010:24.0:1773851858.354591:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:24.0:1773851858.354592:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000000579b8e3 : new refcount 166
00000100:00000001:24.0:1773851858.354593:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851858.354597:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851858.354599:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.354600:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13907@kfi7: PUT: OK
00000400:00000200:25.0:1773851858.354601:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047620e92
00000400:00000010:25.0:1773851858.354602:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047620e92.
00000100:00000001:25.0:1773851858.354602:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851858.354603:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851858.354603:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006cd35516 nid 13907@kfi7 refs 2
00000800:00000200:25.0:1773851858.354605:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 13907@kfi7(0000000078281e1f):0x0 lsk 2174 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000087d Transaction freed
00000800:00000200:21.0:1773851858.364797:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.364798:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.364799:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.364801:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851858.364802:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16915@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.364803:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16915@kfi7 : PUT - for me
00000400:00000200:21.0:1773851858.364804:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16915@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.364805:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 1
00000400:00000200:21.0:1773851858.364806:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16915@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.364807:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 2
00000400:00000200:21.0:1773851858.364808:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 3
00000400:00000200:21.0:1773851858.364808:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17107@kfi7 to cpt 0
00000400:00000200:21.0:1773851858.364809:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17107@kfi7 of length 224 into portal 12 MB=0x699e0aae1ce00
00000400:00000200:21.0:1773851858.364810:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17107@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 26056
00000800:00000200:21.0:1773851858.364812:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851858.364814:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.364814:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16915@kfi7: PUT: OK
00000100:00000001:21.0:1773851858.364815:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.364816:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851858.364817:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000056b9e29c.
00000100:00000040:21.0:1773851858.364817:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000056b9e29c x1858040078913024 msgsize 224
00000100:00100000:21.0:1773851858.364819:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17107@kfi7 (source: 12345-16915@kfi7)
00000100:00000001:21.0:1773851858.364820:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851858.364821:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851858.364821:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 2
02000000:00000001:23.0:1773851858.364822:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851858.364822:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851858.364822:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851858.364823:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851858.364824:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851858.364825:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040078913024
00000020:00000001:23.0:1773851858.364825:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851858.364826:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92195
00000020:00000001:23.0:1773851858.364826:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851858.364830:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000045638001 refcount=170
00000020:00000001:23.0:1773851858.364831:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629765120 : -107123079786496 : ffff9e9276e1d000)
00000020:00000001:23.0:1773851858.364831:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629765120 : -107123079786496 : ffff9e9276e1d000)
00000100:00000001:23.0:1773851858.364832:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.364833:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851858.364834:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000170cfdb.
00000020:00000010:23.0:1773851858.364836:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.364836:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851858.364837:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851858.364838:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851858.364838:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.364839:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851858.364840:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851858.364840:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.364841:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.364843:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851858.364843:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851858.364843:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851858.364844:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17107@kfi7, seq: 1997935
00000100:00000001:22.0:1773851858.364844:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851858.364845:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000045638001 : new rpc_count 1
00000100:00000001:22.0:1773851858.364845:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.364846:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117327872 : -106995592223744 : ffff9eb025bba400)
00000100:00000001:22.0:1773851858.364846:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.364847:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000056b9e29c x1858040078913024/t0(0) o400->0dbcfa62-9b36-4002-90c7-b9e8591c6922@17107@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1557-0'
00000100:00000001:23.0:1773851858.364850:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.364850:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851858.364852:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056b9e29c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0dbcfa62-9b36-4002-90c7-b9e8591c6922+170:39633:x1858040078913024:12345-17107@kfi7:400:default-tuolumne1557-0
00000100:00000200:23.0:1773851858.364853:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040078913024
00000020:00000001:23.0:1773851858.364854:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851858.364854:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851858.364855:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.364856:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851858.364856:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851858.364857:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851858.364858:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040078913024, found 0 last_xid 1858040078487807
00000020:00000001:23.0:1773851858.364859:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851858.364859:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851858.364860:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851858.364860:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.364861:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851858.364861:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851858.364862:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851858.364863:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002b23d9d9.
02000000:00000001:23.0:1773851858.364864:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.364864:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.364865:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851858.364866:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062514, transno 0, xid 1858040078913024
00010000:00000001:23.0:1773851858.364866:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851858.364867:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000056b9e29c x1858040078913024/t0(0) o400->0dbcfa62-9b36-4002-90c7-b9e8591c6922@17107@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1557-0'
00010000:00000001:23.0:1773851858.364870:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851858.364870:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851858.364871:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=91 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851858.364872:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851858.364872:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eb185c0d refcount 3 to 17107@kfi7
00000100:00000001:23.0:1773851858.364873:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958004576 : -107146751547040 : ffff9e8cf3ef6960)
02000000:00000001:23.0:1773851858.364874:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851858.364874:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.364875:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851858.364876:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16915@kfi7
00000400:00000010:23.0:1773851858.364877:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003279a6c9.
00000100:00000200:23.0:1773851858.364878:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040078913024, offset 224
00000400:00000200:23.0:1773851858.364880:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16915@kfi7
00000400:00000200:23.0:1773851858.364880:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16915@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.364881:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 1
00000400:00000200:23.0:1773851858.364882:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 2
00000400:00000200:23.0:1773851858.364884:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 3
00000400:00000200:23.0:1773851858.364885:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16915@kfi7 local destination
00000400:00000200:23.0:1773851858.364886:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768779:8768779:1024:4294967295] 16915@kfi7 LPNI seq info [581208:581208:16:4294967295]
00000400:00000200:23.0:1773851858.364887:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 2
00000400:00000200:23.0:1773851858.364888:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16915@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.364890:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16915@kfi7(16915@kfi7:16915@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851858.364891:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 3
00000800:00000200:23.0:1773851858.364892:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851858.364894:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851858.364896:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851858.364898:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb0 Using peer 16915@kfi7(0xeb0)
00000800:00000200:23.0:1773851858.364901:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0xeb0: rc=0
00000800:00000200:23.0:1773851858.364903:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851858.364905:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.364906:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eb185c0d refcount 2 to 17107@kfi7
00010000:00000001:23.0:1773851858.364906:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851858.364907:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.364908:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851858.364908:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000056b9e29c x1858040078913024/t0(0) o400->0dbcfa62-9b36-4002-90c7-b9e8591c6922@17107@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1557-0'
00000100:00100000:23.0:1773851858.364914:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056b9e29c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0dbcfa62-9b36-4002-90c7-b9e8591c6922+170:39633:x1858040078913024:12345-17107@kfi7:400:default-tuolumne1557-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851858.364915:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb0 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851858.364916:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17107@kfi7, seq: 1997935
00000400:00000200:21.0:1773851858.364916:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:23.0:1773851858.364917:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000045638001 : new rpc_count 0
00000400:00000200:21.0:1773851858.364917:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16915@kfi7: PUT: OK
00000100:00000001:23.0:1773851858.364918:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851858.364918:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851858.364918:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003279a6c9
00000400:00000010:21.0:1773851858.364918:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003279a6c9.
00000020:00000010:23.0:1773851858.364919:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851858.364919:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851858.364919:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851858.364920:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851858.364920:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000170cfdb.
00000400:00000200:21.0:1773851858.364920:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac41c4e1 nid 16915@kfi7 refs 2
00000020:00000040:23.0:1773851858.364921:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000045638001 : new refcount 169
00000800:00000200:21.0:1773851858.364921:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 16915@kfi7(00000000b37754c1):0x0 lsk 3761 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb0 Transaction freed
00000100:00000001:23.0:1773851858.364922:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851858.376746:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.376747:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.376749:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.376751:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851858.376753:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.376755:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.376756:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.376756:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:25.0:1773851858.376757:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.376758:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:25.0:1773851858.376759:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:25.0:1773851858.376760:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.376761:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 520 into portal 12 MB=0x69a77b727e440
00000400:00000200:25.0:1773851858.376762:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9811@kfi7 of length 520/520 into md 0x16159c6179 [64] + 185328
00000800:00000200:25.0:1773851858.376764:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.376766:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.376767:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000100:00000001:25.0:1773851858.376769:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.376769:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851858.376770:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002c5ee9bb.
00000100:00000040:25.0:1773851858.376771:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000002c5ee9bb x1858688824894528 msgsize 520
00000100:00100000:25.0:1773851858.376772:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:25.0:1773851858.376774:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851858.376775:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000800:00000200:25.0:1773851858.376777:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851858.376777:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.376778:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.376779:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.376780:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.376782:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.376783:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688824894528
00000020:00000001:24.0:1773851858.376784:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.376785:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.376786:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.376788:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.376789:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.376791:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.376792:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.376793:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.376795:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.376797:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.376798:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008bd4011d.
00000100:00000001:24.0:1773851858.376800:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.376800:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851858.376802:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.376803:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:24.0:1773851858.376805:0:60973:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@000000002c5ee9bb x1858688824894528/t0(0) o38->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852058 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1110-0'
00000100:00000001:24.0:1773851858.376810:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851858.376811:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.376813:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.376814:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851858.376815:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851858.376815:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851858.376815:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851858.376817:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9811@kfi7, seq: 2025063
00000100:00000040:25.0:1773851858.376818:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c3e651d4 : new rpc_count 6
00000100:00000001:24.0:1773851858.376818:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.376819:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023482865536 : -107050226686080 : ffff9ea36d43e780)
00000100:00000001:24.0:1773851858.376819:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851858.376820:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002c5ee9bb x1858688824894528/t0(0) o38->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852058 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1110-0'
00000100:00000001:25.0:1773851858.376824:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851858.376824:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851858.376825:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c5ee9bb pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb+674:39541:x1858688824894528:12345-9811@kfi7:38:default-tuolumne1110-0
00000100:00000200:25.0:1773851858.376827:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858688824894528
00000020:00000001:25.0:1773851858.376828:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:25.0:1773851858.376829:0:41182:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:25.0:1773851858.376831:0:41182:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:25.0:1773851858.376833:0:41182:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:25.0:1773851858.376834:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851858.376835:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851858.376838:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 00000000432898d8.
02000000:00000001:25.0:1773851858.376839:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.376839:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:25.0:1773851858.376841:0:41182:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:25.0:1773851858.376842:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb (at 9811@kfi7) reconnecting
00010000:00000001:25.0:1773851858.376843:0:41182:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:25.0:1773851858.376844:0:41182:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:25.0:1773851858.376845:0:41182:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7 t183097408865 exp 00000000c3e651d4 cur 614132 last 1773851858
00010000:00000001:25.0:1773851858.376847:0:41182:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:25.0:1773851858.376848:0:41182:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:25.0:1773851858.376849:0:41182:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:25.0:1773851858.376850:0:41182:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:25.0:1773851858.376851:0:41182:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:25.0:1773851858.376852:0:41182:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:25.0:1773851858.376854:0:41182:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:25.0:1773851858.376854:0:41182:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:25.0:1773851858.376855:0:41182:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:25.0:1773851858.376856:0:41182:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.376857:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:25.0:1773851858.376858:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:25.0:1773851858.376859:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb/00000000c3e651d4 free: 126633370845184 avail: 126633368748032
00000020:00000001:25.0:1773851858.376861:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:25.0:1773851858.376861:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb/00000000c3e651d4 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:25.0:1773851858.376863:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:25.0:1773851858.376864:0:41182:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:25.0:1773851858.376865:0:41182:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:25.0:1773851858.376866:0:41182:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb/00000000c3e651d4 ocd_grant: 1882456063 want: 14942208 left: 112130449866752
00000020:00000001:25.0:1773851858.376867:0:41182:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:25.0:1773851858.376868:0:41182:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 9811@kfi7 supports cksum type f7, return f7
00000004:00000001:25.0:1773851858.376870:0:41182:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:25.0:1773851858.376871:0:41182:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:25.0:1773851858.376872:0:41182:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:25.0:1773851858.376873:0:41182:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851858.376874:0:41182:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:25.0:1773851858.376875:0:41182:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851858.376876:0:41182:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 00000000c3e651d4 : new rpc_count 5
00000020:00000040:25.0:1773851858.376877:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 674
00000020:00000040:25.0:1773851858.376878:0:41182:0:(genops.c:871:class_export_get()) GET export 00000000c3e651d4 refcount=675
00000100:00000040:25.0:1773851858.376879:0:41182:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 00000000c3e651d4 : new rpc_count 6
00000100:00000001:25.0:1773851858.376880:0:41182:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:25.0:1773851858.376881:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.376883:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13749e9 nid 9811@kfi7 refs 1
00000400:00000200:25.0:1773851858.376884:0:41182:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 00000000e13749e9 nid 9811@kfi7 refs 2
00000400:00000200:25.0:1773851858.376886:0:41182:0:(peer.c:1555:LNetPrimaryNID()) NID 9811@kfi7 primary NID 9811@kfi7 rc 0
00000100:00000001:25.0:1773851858.376929:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851858.376930:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005543abc2 refcount 3 to 9811@kfi7
00000100:00000001:25.0:1773851858.376930:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612320 : -107130477939296 : ffff9e90bdeaf5a0)
00000100:00000001:25.0:1773851858.376931:0:41182:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636943231612320 : -107130477939296 : 0xffff9e90bdeaf5a0)
00000100:00000040:25.0:1773851858.376933:0:41182:0:(connection.c:133:ptlrpc_connection_get()) conn=000000005543abc2 refcount 3 to 9811@kfi7
00000100:00080000:25.0:1773851858.376934:0:41182:0:(import.c:86:import_set_state_nolock()) 00000000efc82ac0 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:25.0:1773851858.376936:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005543abc2 refcount 2 to 9811@kfi7
00000100:00000001:25.0:1773851858.376937:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851858.376938:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005543abc2 refcount 3 to 9811@kfi7
00000100:00000001:25.0:1773851858.376939:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612320 : -107130477939296 : ffff9e90bdeaf5a0)
02000000:00000001:25.0:1773851858.376940:0:41182:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:25.0:1773851858.376941:0:41182:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:25.0:1773851858.376942:0:41182:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.376943:0:41182:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:25.0:1773851858.376945:0:41182:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:25.0:1773851858.376945:0:41182:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:25.0:1773851858.376946:0:41182:0:(import.c:86:import_set_state_nolock()) 00000000efc82ac0 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:25.0:1773851858.376947:0:41182:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:25.0:1773851858.376948:0:41182:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:25.0:1773851858.376948:0:41182:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:25.0:1773851858.376949:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 674
00000020:00000040:25.0:1773851858.376950:0:41182:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:25.0:1773851858.376951:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005543abc2 refcount 2 to 9811@kfi7
00010000:00000001:25.0:1773851858.376952:0:41182:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.376953:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851858.376953:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:25.0:1773851858.376954:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:25.0:1773851858.376955:0:41182:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851858.376956:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851858.376957:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851858.376957:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.376958:0:41182:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:25.0:1773851858.376959:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:25.0:1773851858.376960:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:25.0:1773851858.376961:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:25.0:1773851858.376961:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.376962:0:41182:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851858.376963:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589670, transno 0, xid 1858688824894528
00010000:00000001:25.0:1773851858.376964:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851858.376965:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002c5ee9bb x1858688824894528/t0(0) o38->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852058 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1110-0'
00010000:00000001:25.0:1773851858.376968:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851858.376969:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851858.376970:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=91 v=313 (313 212 1 1)
00000100:00001000:25.0:1773851858.376971:0:41182:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:25.0:1773851858.376973:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851858.376973:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005543abc2 refcount 3 to 9811@kfi7
00000100:00000001:25.0:1773851858.376974:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612320 : -107130477939296 : ffff9e90bdeaf5a0)
02000000:00000001:25.0:1773851858.376975:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851858.376976:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.376976:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851858.376977:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9810@kfi7
00000400:00000010:25.0:1773851858.376978:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006d3fafcf.
00000100:00000200:25.0:1773851858.376979:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858688824894528, offset 0
00000400:00000200:25.0:1773851858.376981:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9810@kfi7
00000400:00000200:25.0:1773851858.376982:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.376983:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:25.0:1773851858.376984:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:25.0:1773851858.376985:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:25.0:1773851858.376987:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9810@kfi7 local destination
00000400:00000200:25.0:1773851858.376988:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768780:8768780:1024:4294967295] 9810@kfi7 LPNI seq info [3397419:3397419:16:4294967295]
00000400:00000200:25.0:1773851858.376990:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:25.0:1773851858.376992:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.376994:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9810@kfi7(9810@kfi7:9810@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851858.376995:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000800:00000200:25.0:1773851858.376997:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.376998:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:25.0:1773851858.377001:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851858.377004:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf90 Using peer 9810@kfi7(0xf90)
00000800:00000200:25.0:1773851858.377007:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 516 bytes to peer 0xf90: rc=0
00000800:00000200:25.0:1773851858.377008:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf90 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851858.377010:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851858.377011:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005543abc2 refcount 2 to 9811@kfi7
00010000:00000001:25.0:1773851858.377012:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851858.377012:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.377013:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851858.377014:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002c5ee9bb x1858688824894528/t0(0) o38->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852058 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1110-0'
00000100:00100000:25.0:1773851858.377017:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c5ee9bb pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb+674:39541:x1858688824894528:12345-9811@kfi7:38:default-tuolumne1110-0 Request processed in 192us (245us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851858.377019:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9811@kfi7, seq: 2025063
00000100:00000040:25.0:1773851858.377020:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c3e651d4 : new rpc_count 5
00000800:00000200:26.0:1773851858.377021:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf90 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851858.377021:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851858.377022:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851858.377022:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:26.0:1773851858.377023:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851858.377023:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008bd4011d.
00000400:00000200:26.0:1773851858.377024:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000020:00000010:25.0:1773851858.377024:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000400:00000200:26.0:1773851858.377025:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006d3fafcf
00000400:00000010:26.0:1773851858.377025:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006d3fafcf.
00000020:00000040:25.0:1773851858.377025:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:26.0:1773851858.377026:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851858.377026:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:25.0:1773851858.377026:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851858.377027:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000800:00000200:26.0:1773851858.377029:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf90 Transaction freed
00000800:00000200:25.0:1773851858.377253:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.377254:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.377255:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.377257:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851858.377258:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377259:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.377260:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377261:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:25.0:1773851858.377262:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377262:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:25.0:1773851858.377263:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:25.0:1773851858.377264:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.377265:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 2528 into portal 12 MB=0x69a77b5ac2b80
00000400:00000200:25.0:1773851858.377266:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9811@kfi7 of length 2528/2528 into md 0x16159c6179 [64] + 185848
00000800:00000200:25.0:1773851858.377268:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.377270:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.377271:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000100:00000001:25.0:1773851858.377272:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.377272:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851858.377273:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009aa40f9f.
00000100:00000040:25.0:1773851858.377274:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000009aa40f9f x1858688800009088 msgsize 2528
00000100:00100000:25.0:1773851858.377275:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:25.0:1773851858.377276:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851858.377277:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000800:00000200:25.0:1773851858.377278:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:21.0:1773851858.377279:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.377280:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000100:00000001:25.0:1773851858.377281:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851858.377281:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
02000000:00000001:25.0:1773851858.377282:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851858.377282:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851858.377283:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851858.377283:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9875@kfi7(0000000009198122):0xb79 version: 2; local version 2; negotiated version: 2
02000000:00000001:25.0:1773851858.377284:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851858.377284:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688800009088
00000800:00000200:21.0:1773851858.377284:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b79 Using peer 9875@kfi7(0x100000000000b79)
00000020:00000001:25.0:1773851858.377285:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851858.377285:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000800:00000200:22.0:1773851858.377285:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000020:00000001:25.0:1773851858.377286:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:22.0:1773851858.377286:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851858.377286:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9875@kfi7 to cpt 5
00000800:00000200:26.0:1773851858.377287:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000020:00000040:25.0:1773851858.377287:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:25.0:1773851858.377287:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000800:00000200:22.0:1773851858.377287:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851858.377288:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:25.0:1773851858.377288:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000800:00000200:21.0:1773851858.377288:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000184df75a: Posted send of 38 bytes to peer 0x100000000000b79: rc=0
00000800:00000200:26.0:1773851858.377289:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851858.377289:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851858.377289:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851858.377289:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000336ac53.
00000800:00000200:22.0:1773851858.377289:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851858.377289:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000020:00000010:25.0:1773851858.377290:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000800:00000200:26.0:1773851858.377291:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:25.0:1773851858.377291:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a35ab917.
00000400:00000200:22.0:1773851858.377291:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9875@kfi7 to cpt 5
00000100:00000001:25.0:1773851858.377292:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851858.377292:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:26.0:1773851858.377293:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000004:00000001:25.0:1773851858.377293:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000400:00000200:22.0:1773851858.377293:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9875@kfi7 : PUT - for me
00000400:00000200:26.0:1773851858.377294:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:22.0:1773851858.377294:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9875@kfi7 to cpt 5
00000400:00000200:26.0:1773851858.377295:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000004:00100000:25.0:1773851858.377295:0:41182:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 000000000d67deda cookie 0x51399c0e76931e74  req@000000009aa40f9f x1858688800009088/t0(0) o101->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 2528/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:22.0:1773851858.377295:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001211fff0 nid 9875@kfi7 refs 1
00000400:00000200:26.0:1773851858.377296:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:22.0:1773851858.377297:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9875@kfi7 to cpt 5
00000400:00000200:22.0:1773851858.377297:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001211fff0 nid 9875@kfi7 refs 2
00010000:00000001:25.0:1773851858.377298:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:22.0:1773851858.377298:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001211fff0 nid 9875@kfi7 refs 3
00010000:00000001:25.0:1773851858.377299:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:25.0:1773851858.377299:0:41182:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.377299:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851858.377299:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:26.0:1773851858.377300:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:22.0:1773851858.377300:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 392 into portal 23 MB=0x69a77b6373cc0
00000400:00000200:26.0:1773851858.377301:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:26.0:1773851858.377302:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:22.0:1773851858.377302:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-9811@kfi7 of length 392/392 into md 0x6a34b15b5 [2] + 2016
00000800:00000200:21.0:1773851858.377302:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b79 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851858.377303:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:26.0:1773851858.377304:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5ab85c0
00000400:00000010:22.0:1773851858.377304:0:2456945:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000005f9a5f45.
00000800:00000200:21.0:1773851858.377304:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b79 Transaction freed
00000800:00000200:10.0:1773851858.377304:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.377304:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:22.0:1773851858.377305:0:2456945:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000b2774fcf
00000800:00000200:10.0:1773851858.377305:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851858.377305:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:26.0:1773851858.377306:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 180112
00000100:00080000:25.1F:1773851858.377306:0:41182:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000009aa40f9f x1858688800009088/t0(0) o101->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 2528/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000800:00000200:22.0:1773851858.377306:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851858.377306:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851858.377307:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851858.377307:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.377307:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377308:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851858.377308:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851858.377308:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851858.377308:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:22.0:1773851858.377309:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9875@kfi7: PUT: OK
00000800:00000200:10.0:1773851858.377309:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851858.377309:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9874@kfi7(000000001f537b77):0xda9 version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851858.377309:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851858.377309:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000400:00000200:26.0:1773851858.377310:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00080000:25.1:1773851858.377310:0:41182:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000005f18562 x1858688800009088/t0(0) o101->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:618/0 lens 2528/5304 e 11 to 0 dl 1773851822 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833579752824634368'
00000400:00000200:22.0:1773851858.377310:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b2774fcf
00000400:00000200:26.0:1773851858.377311:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000400:00000010:22.0:1773851858.377311:0:2456945:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000b2774fcf (tot 253200619).
00000800:00000200:9.0:1773851858.377311:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xda9 Using peer 9874@kfi7(0xda9)
00000800:00000200:5.0:1773851858.377311:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9811@kfi7(00000000cccbdef7):0x7eb version: 2; local version 2; negotiated version: 2
00000100:00000001:26.0:1773851858.377312:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.377312:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:22.0:1773851858.377312:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:10.0:1773851858.377312:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000800:00000200:6.0:1773851858.377312:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000010:26.0:1773851858.377313:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070067d23.
00000100:00000001:25.0:1773851858.377313:0:41182:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000200:22.0:1773851858.377313:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:9.0:1773851858.377313:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000400:00000200:6.0:1773851858.377313:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000100:00000040:26.0:1773851858.377314:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000070067d23 x1858688799966656 msgsize 488
00000100:00000001:25.0:1773851858.377314:0:41182:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000040:22.0:1773851858.377314:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000c47cfd62 x1858688809123008 msgsize 392
00000400:00000200:10.0:1773851858.377314:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9874@kfi7 : PUT - for me
00000800:00000200:5.0:1773851858.377314:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7eb Using peer 9811@kfi7(0x7eb)
00000100:00000001:25.0:1773851858.377315:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851858.377315:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851858.377315:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000800:00000200:9.0:1773851858.377315:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 38 bytes to peer 0xda9: rc=0
00000400:00000200:6.0:1773851858.377315:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9811@kfi7 : PUT - for me
00000100:00100000:26.0:1773851858.377316:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000020:00000010:25.0:1773851858.377316:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851858.377316:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a35ab917.
00000100:00100000:22.0:1773851858.377316:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9875@kfi7)
00000400:00000200:10.0:1773851858.377316:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b387838f nid 9874@kfi7 refs 1
00000400:00000200:5.0:1773851858.377316:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000100:00000001:26.0:1773851858.377317:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000010:25.0:1773851858.377317:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000336ac53.
00000020:00000040:25.0:1773851858.377317:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000040:22.0:1773851858.377317:0:2456945:0:(events.c:370:request_in_callback()) Buffer complete: 48 buffers still posted
00000800:00000200:9.0:1773851858.377317:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xda9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851858.377317:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:26.0:1773851858.377318:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000100:00000001:25.0:1773851858.377318:0:41182:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851858.377318:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000400:00000200:6.0:1773851858.377318:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13749e9 nid 9811@kfi7 refs 1
00000800:00000200:5.0:1773851858.377318:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046518b99: Posted send of 38 bytes to peer 0x7eb: rc=0
00000100:00000001:24.0:1773851858.377319:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:22.0:1773851858.377319:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851858.377319:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b387838f nid 9874@kfi7 refs 2
00000800:00000200:26.0:1773851858.377320:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851858.377320:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.377320:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:10.0:1773851858.377320:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b387838f nid 9874@kfi7 refs 3
00000400:00000200:6.0:1773851858.377320:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000800:00000200:5.0:1773851858.377320:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851858.377321:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.377321:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851858.377321:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001211fff0 nid 9875@kfi7 refs 2
00000400:00000200:10.0:1773851858.377321:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:6.0:1773851858.377321:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13749e9 nid 9811@kfi7 refs 2
00000100:00100000:24.0:1773851858.377322:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799966656
00000020:00000001:24.0:1773851858.377322:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377322:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000800:00000200:22.0:1773851858.377322:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000800:00000200:21.0:1773851858.377322:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:10.0:1773851858.377322:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 392 into portal 23 MB=0x69a77b5f7d3c0
00000400:00000200:6.0:1773851858.377322:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e13749e9 nid 9811@kfi7 refs 3
00000020:00000001:24.0:1773851858.377323:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:21.0:1773851858.377323:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:6.0:1773851858.377323:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000020:00000040:24.0:1773851858.377324:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.377324:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000800:00000200:21.0:1773851858.377324:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:20.0:1773851858.377324:0:83136:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:10.0:1773851858.377324:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-9811@kfi7 of length 392/392 into md 0x78166cd09 [2] + 784
00000400:00000200:6.0:1773851858.377324:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 392 into portal 23 MB=0x69a77b6370940
00000020:00000001:24.0:1773851858.377325:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
02000000:00000001:20.0:1773851858.377325:0:83136:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851858.377325:0:83136:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377326:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377326:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:21.0:1773851858.377326:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:20.0:1773851858.377326:0:83136:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851858.377326:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-9811@kfi7 of length 392/392 into md 0x793aea445 [2] + 1176
00000020:00000010:24.0:1773851858.377327:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.377327:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
02000000:00000001:20.0:1773851858.377327:0:83136:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851858.377327:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:24.0:1773851858.377328:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000400:00000200:21.0:1773851858.377328:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9875@kfi7 to cpt 5
00000100:00100000:20.0:1773851858.377328:0:83136:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688809123008
00000800:00000200:6.0:1773851858.377328:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377329:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.377329:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:21.0:1773851858.377329:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9875@kfi7 : PUT - for me
00000020:00000001:20.0:1773851858.377329:0:83136:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851858.377329:0:83136:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000400:00000200:10.0:1773851858.377329:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:24.0:1773851858.377330:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.377330:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:21.0:1773851858.377330:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9875@kfi7 to cpt 5
00000020:00000001:20.0:1773851858.377330:0:83136:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:11.0:1773851858.377330:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xda9 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851858.377330:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9874@kfi7: PUT: OK
00000400:00000200:6.0:1773851858.377330:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:24.0:1773851858.377331:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.377331:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:21.0:1773851858.377331:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001211fff0 nid 9875@kfi7 refs 1
00000400:00000200:21.0:1773851858.377331:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9875@kfi7 to cpt 5
00000100:00000001:10.0:1773851858.377331:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:6.0:1773851858.377331:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9811@kfi7: PUT: OK
00000020:00000001:24.0:1773851858.377332:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000400:00000200:21.0:1773851858.377332:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001211fff0 nid 9875@kfi7 refs 2
00000100:00000200:10.0:1773851858.377332:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000800:00000200:5.0:1773851858.377332:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7eb TN_EVENT_TX_OK event status 0
00000020:00000001:24.0:1773851858.377333:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377333:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851858.377333:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001211fff0 nid 9875@kfi7 refs 3
00000020:00000040:20.0:1773851858.377333:0:83136:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=675
00000800:00000200:11.0:1773851858.377333:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xda9 Transaction freed
00000100:00000010:10.0:1773851858.377333:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000094637c7a.
00000100:00000040:10.0:1773851858.377333:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000094637c7a x1858688804967360 msgsize 392
00000100:00000001:6.0:1773851858.377333:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851858.377333:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000001:00000001:24.0:1773851858.377334:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.377334:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851858.377334:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000001:00000001:24.0:1773851858.377335:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377335:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:21.0:1773851858.377335:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 392 into portal 23 MB=0x69a77b636dd40
00000020:00000001:20.0:1773851858.377335:0:83136:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:20.0:1773851858.377335:0:83136:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00100000:10.0:1773851858.377335:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9874@kfi7)
00000100:00000010:6.0:1773851858.377335:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000022ae51d.
00000800:00000200:5.0:1773851858.377335:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7eb Transaction freed
00000001:00000001:24.0:1773851858.377336:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377336:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:21.0:1773851858.377336:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-9811@kfi7 of length 392/392 into md 0x6a34b3935 [2] + 0
00000100:00000001:10.0:1773851858.377336:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000040:6.0:1773851858.377336:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000022ae51d x1858688809109824 msgsize 392
00000001:00000001:24.0:1773851858.377337:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377337:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851858.377337:0:83136:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851858.377337:0:83136:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:10.0:1773851858.377337:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b387838f nid 9874@kfi7 refs 2
00000020:00000001:24.0:1773851858.377338:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000800:00000200:21.0:1773851858.377338:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:20.0:1773851858.377338:0:83136:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f72a858.
00000100:00000001:8.0:1773851858.377338:0:60519:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00100000:6.0:1773851858.377338:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9811@kfi7)
00000020:00000001:24.0:1773851858.377339:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377339:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:20.0:1773851858.377339:0:83136:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000800:00000200:10.0:1773851858.377339:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 9874@kfi7(000000001f537b77):0x0 lsk 3498 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851858.377339:0:60519:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851858.377339:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:24.0:1773851858.377340:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851858.377340:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851858.377340:0:60519:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851858.377340:0:60519:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851858.377340:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e13749e9 nid 9811@kfi7 refs 2
00000100:00000001:5.0:1773851858.377340:0:61697:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00002000:00000001:24.0:1773851858.377341:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000400:00000200:21.0:1773851858.377341:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9875@kfi7: PUT: OK
00000020:00000010:20.0:1773851858.377341:0:83136:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
02000000:00000001:8.0:1773851858.377341:0:60519:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851858.377341:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:5.0:1773851858.377341:0:61697:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.377341:0:61697:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:24.0:1773851858.377342:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377342:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:21.0:1773851858.377342:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.377342:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000001:20.0:1773851858.377342:0:83136:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851858.377342:0:83136:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00100000:8.0:1773851858.377342:0:60519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688804967360
00000100:00000001:5.0:1773851858.377342:0:61697:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:21.0:1773851858.377343:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000931bf5fc.
00000100:00000040:21.0:1773851858.377343:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000931bf5fc x1858688809098560 msgsize 392
00000100:00000001:20.0:1773851858.377343:0:83136:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851858.377343:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851858.377343:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
02000000:00000001:5.0:1773851858.377343:0:61697:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851858.377343:0:61697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688809109824
00002000:00100000:24.0:1773851858.377344:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9d:0x0]  req@0000000070067d23 x1858688799966656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000020:00000001:8.0:1773851858.377344:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:5.0:1773851858.377344:0:61697:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851858.377344:0:61697:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000100:00100000:21.0:1773851858.377345:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9875@kfi7)
00000020:00000001:5.0:1773851858.377345:0:61697:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:21.0:1773851858.377346:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851858.377346:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001211fff0 nid 9875@kfi7 refs 2
00002000:00000001:24.0:1773851858.377347:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000040:8.0:1773851858.377347:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=676
00002000:00100000:24.0:1773851858.377348:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000070067d23 with x1858688799966656
00000800:00000200:21.0:1773851858.377348:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9875@kfi7(0000000009198122):0x0 lsk 2938 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000020:00000001:8.0:1773851858.377348:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000040:5.0:1773851858.377348:0:61697:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=677
00000020:00000001:5.0:1773851858.377348:0:61697:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00010000:00000001:24.0:1773851858.377349:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:8.0:1773851858.377349:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:5.0:1773851858.377349:0:61697:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377350:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377350:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d963ad4b refcount=3
00000100:00080000:20.1F:1773851858.377350:0:83136:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000c47cfd62 x1858688809123008/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 392/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000020:00000001:24.0:1773851858.377351:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104558431552 : -106969151120064 : ffff9eb64dbedd40)
00000100:00000001:8.0:1773851858.377351:0:60519:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851858.377351:0:60519:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:5.0:1773851858.377351:0:61697:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.377351:0:61697:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00010000:00000001:24.0:1773851858.377352:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104558431552 : -106969151120064 : ffff9eb64dbedd40)
00000020:00000010:8.0:1773851858.377352:0:60519:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025dffd82.
00000020:00000010:5.0:1773851858.377352:0:61697:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00010000:00000001:24.0:1773851858.377353:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377353:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000010:5.0:1773851858.377353:0:61697:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00002000:00000001:24.0:1773851858.377354:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000010:8.0:1773851858.377354:0:60519:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:5.0:1773851858.377354:0:61697:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00080000:20.1:1773851858.377355:0:83136:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000f9363768 x1858688809123008/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:141/0 lens 392/0 e 1 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000020:00000010:8.0:1773851858.377355:0:60519:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:5.0:1773851858.377355:0:61697:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.377355:0:61697:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00002000:00000001:24.0:1773851858.377356:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377356:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851858.377356:0:60519:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851858.377356:0:60519:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851858.377356:0:61697:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851858.377357:0:60519:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851858.377358:0:83136:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:20.0:1773851858.377359:0:83136:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:20.0:1773851858.377360:0:83136:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00080000:5.1F:1773851858.377364:0:61697:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000022ae51d x1858688809109824/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 392/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00080000:5.1:1773851858.377368:0:61697:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000008d39c694 x1858688809109824/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:141/0 lens 392/0 e 1 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:5.0:1773851858.377371:0:61697:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:5.0:1773851858.377372:0:61697:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00080000:24.1:1773851858.377373:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000070067d23 x1858688799966656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:5.0:1773851858.377373:0:61697:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00080000:24.1:1773851858.377376:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000005dae769 x1858688799966656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:607/0 lens 488/0 e 11 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.377378:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377379:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.377380:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.377381:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377382:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9d:0x0]  req@0000000070067d23 x1858688799966656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.377384:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00080000:8.1:1773851858.377384:0:60519:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000094637c7a x1858688804967360/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 392/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00002000:00100000:24.0:1773851858.377385:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000070067d23 with x1858688799966656
00010000:00000001:24.0:1773851858.377385:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377386:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377386:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d963ad4b refcount=3
00000020:00000001:24.0:1773851858.377387:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104558431552 : -106969151120064 : ffff9eb64dbedd40)
00010000:00000001:24.0:1773851858.377387:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104558431552 : -106969151120064 : ffff9eb64dbedd40)
00000100:00080000:8.1:1773851858.377387:0:60519:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000232baaa7 x1858688804967360/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:379/0 lens 392/0 e 1 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00010000:00000001:24.0:1773851858.377388:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377388:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377389:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377389:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851858.377390:0:83136:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:8.0:1773851858.377390:0:60519:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377391:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851858.377391:0:83136:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000100:00000001:5.0:1773851858.377391:0:61697:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851858.377391:0:61697:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:24.0:1773851858.377392:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:20.0:1773851858.377392:0:83136:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000100:00000001:8.0:1773851858.377392:0:60519:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:8.0:1773851858.377392:0:60519:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:5.0:1773851858.377392:0:61697:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000020:00000010:24.0:1773851858.377393:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:20.0:1773851858.377393:0:83136:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f72a858.
00000100:00000001:8.0:1773851858.377393:0:60519:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377394:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:20.0:1773851858.377394:0:83136:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 676
00000020:00000010:8.0:1773851858.377394:0:60519:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:5.0:1773851858.377394:0:61697:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:24.0:1773851858.377395:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 676
00000020:00000010:8.0:1773851858.377395:0:60519:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851858.377395:0:60519:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025dffd82.
00000020:00000040:5.0:1773851858.377395:0:61697:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 676
00000100:00000001:5.0:1773851858.377395:0:61697:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:8.0:1773851858.377396:0:60519:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 674
00000100:00000001:24.0:1773851858.377397:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:20.0:1773851858.377397:0:83136:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002585ab34.
00000100:00000001:8.0:1773851858.377397:0:60519:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:20.0:1773851858.377398:0:83136:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000060f07d77.
00000100:00000010:20.0:1773851858.377399:0:83136:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000400ea80a.
00000100:00000010:20.0:1773851858.377399:0:83136:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d77307e.
00000100:00000010:20.0:1773851858.377400:0:83136:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000083f87d18.
00000100:00000001:20.0:1773851858.377401:0:83136:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851858.377402:0:83136:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:26.0:1773851858.377403:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.377403:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
02000000:00000001:20.0:1773851858.377403:0:83136:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851858.377403:0:83136:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:26.0:1773851858.377404:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.377404:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:20.0:1773851858.377404:0:83136:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851858.377405:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.377405:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:20.0:1773851858.377405:0:83136:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851858.377405:0:83136:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688809098560
00000020:00000001:20.0:1773851858.377406:0:83136:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851858.377406:0:83136:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000800:00000200:26.0:1773851858.377407:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851858.377407:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:20.0:1773851858.377407:0:83136:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851858.377407:0:83136:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:20.0:1773851858.377408:0:83136:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000400:00000200:25.0:1773851858.377409:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:20.0:1773851858.377409:0:83136:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:20.0:1773851858.377409:0:83136:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:26.0:1773851858.377410:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00000001:20.0:1773851858.377410:0:83136:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851858.377410:0:83136:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f72a858.
00000400:00000200:26.0:1773851858.377411:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.377411:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.377411:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000010:20.0:1773851858.377411:0:83136:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000400:00000200:25.0:1773851858.377412:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000020:00000010:20.0:1773851858.377412:0:83136:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000400:00000200:25.0:1773851858.377413:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00000001:20.0:1773851858.377413:0:83136:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851858.377413:0:83136:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:25.0:1773851858.377414:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000100:00000001:20.0:1773851858.377414:0:83136:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851858.377415:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377415:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:26.0:1773851858.377416:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000100:00080000:20.1:1773851858.377416:0:83136:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000931bf5fc x1858688809098560/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 392/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000400:00000200:26.0:1773851858.377417:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377418:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00080000:20.1:1773851858.377418:0:83136:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000006a55f366 x1858688809098560/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:141/0 lens 392/0 e 1 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000400:00000200:26.0:1773851858.377419:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000400:00000200:25.0:1773851858.377420:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:26.0:1773851858.377421:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.377421:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 392 into portal 23 MB=0x69a77b63cda40
00000100:00000001:20.0:1773851858.377421:0:83136:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000800:00000200:27.0:1773851858.377422:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:26.0:1773851858.377422:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aacb40
00000100:00000001:20.0:1773851858.377422:0:83136:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:20.0:1773851858.377422:0:83136:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:27.0:1773851858.377423:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851858.377423:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-9811@kfi7 of length 392/392 into md 0x1615b62779 [2] + 1656
00000100:00000001:20.0:1773851858.377423:0:83136:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851858.377423:0:83136:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000800:00000200:27.0:1773851858.377424:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851858.377424:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 180600
00000800:00000200:25.0:1773851858.377424:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:20.0:1773851858.377424:0:83136:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851858.377425:0:83136:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f72a858.
00000020:00000040:20.0:1773851858.377425:0:83136:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000800:00000200:27.0:1773851858.377426:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:26.0:1773851858.377426:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.377426:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:20.0:1773851858.377426:0:83136:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851858.377427:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.377427:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000100:00000200:20.0:1773851858.377427:0:83136:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt_readpage: registering portal 23
00000400:00000200:27.0:1773851858.377428:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377428:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000100:00000001:25.0:1773851858.377428:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000400:00000010:20.0:1773851858.377428:0:83136:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000006cac8cb5.
00000400:00000200:27.0:1773851858.377429:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000100:00000001:26.0:1773851858.377429:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.377429:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000200:25.0:1773851858.377429:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:27.0:1773851858.377430:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00000010:26.0:1773851858.377430:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009a28985e.
00000100:00000010:25.0:1773851858.377430:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007419e707.
00000100:00000040:25.0:1773851858.377430:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000007419e707 x1858688809491008 msgsize 392
00000400:00000010:20.0:1773851858.377430:0:83136:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000cf4fd553 (tot 253200771).
00000400:00000200:27.0:1773851858.377431:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00000040:26.0:1773851858.377431:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000009a28985e x1858688799918912 msgsize 488
00000400:00000200:27.0:1773851858.377432:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:27.0:1773851858.377432:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000100:00100000:26.0:1773851858.377432:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00100000:25.0:1773851858.377432:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000400:00000200:27.0:1773851858.377433:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 5
00000100:00000001:26.0:1773851858.377433:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851858.377434:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000100:00000001:25.0:1773851858.377434:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:24.0:1773851858.377434:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:27.0:1773851858.377435:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
02000000:00000001:24.0:1773851858.377435:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.377435:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:27.0:1773851858.377436:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5ab8540
00000800:00000200:26.0:1773851858.377436:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851858.377436:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00000001:24.0:1773851858.377436:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.377436:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377437:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799918912
00000400:00000200:27.0:1773851858.377438:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 181088
00000100:00000001:26.0:1773851858.377438:0:61229:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851858.377438:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000001:24.0:1773851858.377438:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377438:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
02000000:00000001:26.0:1773851858.377439:0:61229:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851858.377439:0:61229:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:24.0:1773851858.377439:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377439:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000800:00000200:27.0:1773851858.377440:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:26.0:1773851858.377440:0:61229:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851858.377440:0:61229:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377440:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000400:00000200:27.0:1773851858.377441:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:26.0:1773851858.377441:0:61229:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688809491008
00000400:00000200:27.0:1773851858.377442:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000020:00000001:26.0:1773851858.377442:0:61229:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851858.377442:0:61229:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:26.0:1773851858.377442:0:61229:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:24.0:1773851858.377442:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:27.0:1773851858.377443:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851858.377443:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000040:26.0:1773851858.377443:0:61229:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=675
00000100:00000001:24.0:1773851858.377443:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000010:27.0:1773851858.377444:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000045bafd97.
00000100:00000040:27.0:1773851858.377444:0:2464256:0:(events.c:358:request_in_callback()) incoming req@0000000045bafd97 x1858688799966528 msgsize 488
00000020:00000001:26.0:1773851858.377444:0:61229:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.377444:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:26.0:1773851858.377445:0:61229:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00100000:27.0:1773851858.377446:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:27.0:1773851858.377446:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851858.377446:0:61229:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851858.377446:0:61229:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:27.0:1773851858.377447:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000020:00000010:26.0:1773851858.377447:0:61229:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:24.0:1773851858.377447:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:26.0:1773851858.377448:0:61229:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851858.377448:0:61229:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000800:00000200:25.0:1773851858.377448:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000020:00000010:24.0:1773851858.377448:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000800:00000200:27.0:1773851858.377449:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:25.0:1773851858.377449:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:24.0:1773851858.377449:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.377449:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851858.377450:0:61229:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851858.377450:0:61229:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:25.0:1773851858.377450:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377450:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.377450:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000100:00000001:26.0:1773851858.377451:0:61229:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377451:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.377451:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.377452:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.377452:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.377452:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377453:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377453:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00080000:26.1:1773851858.377454:0:61229:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000007419e707 x1858688809491008/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 392/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000800:00000200:25.0:1773851858.377454:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000001:00000001:24.0:1773851858.377454:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377454:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377455:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.377455:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377455:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:25.0:1773851858.377456:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000001:00000001:24.0:1773851858.377456:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377456:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:26.1:1773851858.377457:0:61229:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000006513c1dc x1858688809491008/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:141/0 lens 392/0 e 1 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000400:00000200:25.0:1773851858.377457:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.377458:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377458:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000020:00000001:24.0:1773851858.377458:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377458:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.377459:0:61229:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:25.0:1773851858.377459:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377459:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377459:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.377460:0:61229:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:25.0:1773851858.377460:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00002000:00000001:24.0:1773851858.377460:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.377460:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851858.377461:0:61229:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851858.377461:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00002000:00000001:24.0:1773851858.377461:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377461:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x381e:0x0]  req@000000009a28985e x1858688799918912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:26.0:1773851858.377462:0:61229:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851858.377462:0:61229:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851858.377462:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000020:00000010:26.0:1773851858.377463:0:61229:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000400:00000200:25.0:1773851858.377463:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aace00
00000020:00000010:26.0:1773851858.377464:0:61229:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000400:00000200:25.0:1773851858.377464:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 181576
00002000:00000001:24.0:1773851858.377464:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377464:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000009a28985e with x1858688799918912
00000020:00000040:26.0:1773851858.377465:0:61229:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 674
00000100:00000001:26.0:1773851858.377465:0:61229:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851858.377465:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377465:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:25.0:1773851858.377466:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.377467:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.377468:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000020:00000040:24.0:1773851858.377468:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002b9e7a8a refcount=3
00000020:00000001:24.0:1773851858.377468:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151437734464 : -106922271817152 : ffff9ec137f84240)
00000100:00000001:25.0:1773851858.377469:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.377469:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00010000:00000001:24.0:1773851858.377469:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637151437734464 : -106922271817152 : ffff9ec137f84240)
00000100:00000010:25.0:1773851858.377470:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003631b769.
00000100:00000040:25.0:1773851858.377470:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000003631b769 x1858688799919616 msgsize 488
00010000:00000001:24.0:1773851858.377470:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00100000:25.0:1773851858.377471:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00010000:00000001:24.0:1773851858.377471:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377471:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377471:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.377472:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:24.0:1773851858.377472:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377473:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000100:00080000:24.1:1773851858.377473:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000009a28985e x1858688799918912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000800:00000200:25.0:1773851858.377474:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00080000:24.1:1773851858.377477:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000007b09db27 x1858688799918912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.377480:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377480:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.377481:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.377481:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377482:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x381e:0x0]  req@000000009a28985e x1858688799918912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.377485:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377485:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000009a28985e with x1858688799918912
00010000:00000001:24.0:1773851858.377486:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377486:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377486:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002b9e7a8a refcount=3
00000020:00000001:24.0:1773851858.377487:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151437734464 : -106922271817152 : ffff9ec137f84240)
00010000:00000001:24.0:1773851858.377488:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637151437734464 : -106922271817152 : ffff9ec137f84240)
00010000:00000001:24.0:1773851858.377489:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377489:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377489:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377490:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377490:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377491:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377491:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.377492:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.377492:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.377493:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851858.377498:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377499:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377499:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.377499:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851858.377500:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.377500:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377501:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.377501:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:27.0:1773851858.377502:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851858.377502:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851858.377502:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851858.377502:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:24.0:1773851858.377502:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377502:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.377503:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377503:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799966528
00000800:00000200:27.0:1773851858.377504:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851858.377504:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377504:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377504:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000400:00000200:26.0:1773851858.377505:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000020:00000001:24.0:1773851858.377505:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377505:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000800:00000200:27.0:1773851858.377506:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851858.377506:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377506:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377506:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000400:00000200:26.0:1773851858.377507:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377507:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:25.0:1773851858.377507:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000100:00000001:24.0:1773851858.377507:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377507:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:26.0:1773851858.377508:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000010:24.0:1773851858.377508:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.377508:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000400:00000200:26.0:1773851858.377509:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000020:00000010:24.0:1773851858.377509:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.377509:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:26.0:1773851858.377510:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00000001:24.0:1773851858.377510:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.377510:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:27.0:1773851858.377511:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377511:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377511:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.377511:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:27.0:1773851858.377512:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.377512:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000020:00000001:24.0:1773851858.377512:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:25.0:1773851858.377513:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377513:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000020:00000001:24.0:1773851858.377513:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.377513:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377513:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377514:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000001:00000001:24.0:1773851858.377514:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.377514:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851858.377515:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000001:00000001:24.0:1773851858.377515:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:27.0:1773851858.377516:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377516:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5a92700
00000001:00000001:24.0:1773851858.377516:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:27.0:1773851858.377517:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:27.0:1773851858.377517:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377517:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 182064
00000001:00000001:24.0:1773851858.377517:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377517:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.377517:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:27.0:1773851858.377518:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000001:00000001:24.0:1773851858.377518:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377518:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:27.0:1773851858.377519:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 5
00000800:00000200:26.0:1773851858.377519:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.377519:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000020:00000001:24.0:1773851858.377519:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377519:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851858.377520:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.377520:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aacd80
00000020:00000001:24.0:1773851858.377520:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377520:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000400:00000200:27.0:1773851858.377521:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5ab86c0
00000400:00000200:26.0:1773851858.377521:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.377521:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 182552
00000020:00000001:24.0:1773851858.377521:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377521:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:26.0:1773851858.377522:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00002000:00100000:24.0:1773851858.377522:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9c:0x0]  req@0000000045bafd97 x1858688799966528/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:27.0:1773851858.377523:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 183040
00000800:00000200:25.0:1773851858.377523:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:26.0:1773851858.377524:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.377524:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:27.0:1773851858.377525:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000010:26.0:1773851858.377525:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f5ebef6c.
00000400:00000200:25.0:1773851858.377525:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00000001:24.0:1773851858.377525:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:27.0:1773851858.377526:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:26.0:1773851858.377526:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000f5ebef6c x1858688799811328 msgsize 488
00000400:00000200:25.0:1773851858.377526:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00002000:00100000:24.0:1773851858.377526:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000045bafd97 with x1858688799966528
00010000:00000001:24.0:1773851858.377526:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377526:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:27.0:1773851858.377527:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000100:00100000:26.0:1773851858.377527:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000020:00000040:24.0:1773851858.377527:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000079cc3da0 refcount=3
00000100:00000001:26.0:1773851858.377528:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:24.0:1773851858.377528:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157342682432 : -106916366869184 : ffff9ec297ee9d40)
00010000:00000001:24.0:1773851858.377528:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637157342682432 : -106916366869184 : ffff9ec297ee9d40)
00000400:00000200:26.0:1773851858.377529:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00010000:00000001:24.0:1773851858.377529:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000800:00000200:26.0:1773851858.377530:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851858.377530:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.377530:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00010000:00000001:24.0:1773851858.377530:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377530:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377530:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:25.0:1773851858.377531:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008d0c6b78.
00000100:00000001:24.0:1773851858.377531:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851858.377532:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000008d0c6b78 x1858688799919488 msgsize 488
00000100:00080000:24.1:1773851858.377532:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000045bafd97 x1858688799966528/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000800:00000200:26.0:1773851858.377533:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377533:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00100000:25.0:1773851858.377533:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000800:00000200:26.0:1773851858.377534:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851858.377534:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851858.377535:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00000001:27.0:1773851858.377536:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851858.377536:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:27.0:1773851858.377536:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004d4799b9.
00000800:00000200:25.0:1773851858.377536:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00080000:24.1:1773851858.377536:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e551b946 x1858688799966528/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:607/0 lens 488/0 e 11 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000040:27.0:1773851858.377537:0:2464256:0:(events.c:358:request_in_callback()) incoming req@000000004d4799b9 x1858688799966912 msgsize 488
00000800:00000200:26.0:1773851858.377537:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851858.377538:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00100000:27.0:1773851858.377539:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:27.0:1773851858.377539:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:24.0:1773851858.377539:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377539:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:27.0:1773851858.377540:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:26.0:1773851858.377540:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000100:00000001:24.0:1773851858.377540:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:27.0:1773851858.377541:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:26.0:1773851858.377541:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377541:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00002000:00000001:24.0:1773851858.377541:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377541:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9c:0x0]  req@0000000045bafd97 x1858688799966528/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:26.0:1773851858.377542:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377543:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:26.0:1773851858.377544:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00002000:00000001:24.0:1773851858.377544:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377544:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000045bafd97 with x1858688799966528
00000400:00000200:26.0:1773851858.377545:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00010000:00000001:24.0:1773851858.377545:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377545:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:26.0:1773851858.377546:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aacac0
00000020:00000040:24.0:1773851858.377546:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000079cc3da0 refcount=3
00000020:00000001:24.0:1773851858.377546:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157342682432 : -106916366869184 : ffff9ec297ee9d40)
00000400:00000200:26.0:1773851858.377547:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 183528
00010000:00000001:24.0:1773851858.377547:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637157342682432 : -106916366869184 : ffff9ec297ee9d40)
00010000:00000001:24.0:1773851858.377548:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377548:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:5.0:1773851858.377548:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377549:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:24.0:1773851858.377549:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377549:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851858.377549:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000100:00000001:24.0:1773851858.377550:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377550:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000800:00000200:5.0:1773851858.377550:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851858.377551:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:24.0:1773851858.377551:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.377551:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000400:00000200:26.0:1773851858.377552:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000020:00000040:24.0:1773851858.377552:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.377552:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851858.377552:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:26.0:1773851858.377553:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.377553:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:26.0:1773851858.377554:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004392d71d.
00000400:00000200:5.0:1773851858.377554:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000100:00000040:26.0:1773851858.377555:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000004392d71d x1858688799918784 msgsize 488
00000400:00000200:5.0:1773851858.377555:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9811@kfi7 : PUT - for me
00000400:00000200:5.0:1773851858.377556:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000100:00100000:26.0:1773851858.377557:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:26.0:1773851858.377557:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851858.377557:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13749e9 nid 9811@kfi7 refs 1
00000400:00000200:26.0:1773851858.377558:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000100:00000001:24.0:1773851858.377558:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851858.377558:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.377558:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13749e9 nid 9811@kfi7 refs 2
00000800:00000200:27.0:1773851858.377559:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377559:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:25.0:1773851858.377559:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.377559:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
02000000:00000001:24.0:1773851858.377559:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.377559:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377559:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851858.377559:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e13749e9 nid 9811@kfi7 refs 3
00000800:00000200:27.0:1773851858.377560:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
02000000:00000001:24.0:1773851858.377560:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851858.377560:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000800:00000200:27.0:1773851858.377561:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.377561:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:24.0:1773851858.377561:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799919616
00000020:00000001:24.0:1773851858.377561:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377561:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000400:00000200:5.0:1773851858.377561:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 8680 into portal 13 MB=0x69a77b5aacc40
00000800:00000200:26.0:1773851858.377562:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377562:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:24.0:1773851858.377562:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377562:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000800:00000200:27.0:1773851858.377563:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851858.377563:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:24.0:1773851858.377563:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377563:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000400:00000200:5.0:1773851858.377563:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 8680/8680 into md 0x79355bda5 [128] + 246072
00000800:00000200:26.0:1773851858.377564:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377564:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377564:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:25.0:1773851858.377565:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000010:24.0:1773851858.377565:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000800:00000200:5.0:1773851858.377565:0:2507993:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 8680 bytes in 3 frags
00000400:00000200:27.0:1773851858.377566:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000800:00000200:26.0:1773851858.377566:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851858.377566:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000020:00000010:24.0:1773851858.377566:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377566:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000400:00000200:27.0:1773851858.377567:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000100:00000001:24.0:1773851858.377567:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.377567:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:5.0:1773851858.377567:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000400:00000200:27.0:1773851858.377568:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377568:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377568:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.377568:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:27.0:1773851858.377569:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:26.0:1773851858.377569:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000020:00000001:24.0:1773851858.377569:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.377569:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:27.0:1773851858.377570:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377570:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.377570:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377570:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851858.377570:0:2507993:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb Using peer 9811@kfi7(0x1000000000007eb)
00000400:00000200:27.0:1773851858.377571:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000001:00000001:24.0:1773851858.377571:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.377571:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851858.377572:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:25.0:1773851858.377572:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000001:00000001:24.0:1773851858.377572:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377572:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:25.0:1773851858.377573:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000001:00000001:24.0:1773851858.377573:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377573:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:25.0:1773851858.377574:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000001:00000001:24.0:1773851858.377574:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377574:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851858.377574:0:2507993:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:1 TN 0000000046518b99: Posted read of 8680 bytes in 3 frags kp 9811@kfi7(00000000cccbdef7) rma_iov.key 3276801: rc=0
00000400:00000200:25.0:1773851858.377575:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000020:00000001:24.0:1773851858.377575:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377575:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377576:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000020:00000001:24.0:1773851858.377576:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377576:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851858.377576:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000400:00000200:26.0:1773851858.377577:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00002000:00000001:24.0:1773851858.377577:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.377577:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851858.377578:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00002000:00000001:24.0:1773851858.377578:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:26.0:1773851858.377579:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.377579:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00002000:00100000:24.0:1773851858.377579:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3820:0x0]  req@000000003631b769 x1858688799919616/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:26.0:1773851858.377580:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 5
00000400:00000200:27.0:1773851858.377581:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:27.0:1773851858.377582:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5ab8640
00000400:00000200:25.0:1773851858.377582:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00002000:00000001:24.0:1773851858.377582:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377582:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003631b769 with x1858688799919616
00000400:00000200:26.0:1773851858.377583:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.377583:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aacf00
00010000:00000001:24.0:1773851858.377583:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377583:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:27.0:1773851858.377584:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 184016
00000400:00000200:26.0:1773851858.377584:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5a92680
00000800:00000200:27.0:1773851858.377585:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.377585:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 184504
00000020:00000040:24.0:1773851858.377586:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b8dbeb31 refcount=3
00000400:00000200:27.0:1773851858.377587:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851858.377587:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 184992
00000800:00000200:25.0:1773851858.377587:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:24.0:1773851858.377587:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064986515648 : -107008723035968 : ffff9ead171358c0)
00000400:00000200:27.0:1773851858.377588:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000100:00000001:27.0:1773851858.377588:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851858.377588:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:25.0:1773851858.377588:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:24.0:1773851858.377588:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637064986515648 : -107008723035968 : ffff9ead171358c0)
00000100:00000010:27.0:1773851858.377589:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e7c314c5.
00000800:00000200:26.0:1773851858.377589:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.377589:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00010000:00000001:24.0:1773851858.377589:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377589:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377589:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000040:27.0:1773851858.377590:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000e7c314c5 x1858688799966784 msgsize 488
00000400:00000200:26.0:1773851858.377590:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00000001:24.0:1773851858.377590:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377590:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851858.377591:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000400:00000200:26.0:1773851858.377591:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000100:00080000:24.1:1773851858.377591:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000003631b769 x1858688799919616/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000800:00000200:5.0:1773851858.377591:0:2507993:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb TN_EVENT_TAG_TX_OK event status 0
00000100:00000001:27.0:1773851858.377592:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851858.377592:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000100:00000001:26.0:1773851858.377592:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.377593:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:26.0:1773851858.377593:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000219195b5.
00000400:00000200:5.0:1773851858.377593:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:27.0:1773851858.377594:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000040:26.0:1773851858.377594:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000219195b5 x1858688799811200 msgsize 488
00000100:00080000:24.1:1773851858.377594:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000001a89e601 x1858688799919616/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:5.0:1773851858.377594:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9811@kfi7: PUT: OK
00000100:00100000:26.0:1773851858.377595:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:5.0:1773851858.377595:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:26.0:1773851858.377596:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000200:5.0:1773851858.377596:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:5.0:1773851858.377596:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc13a529.
00000100:00000001:24.0:1773851858.377597:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377597:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000040:5.0:1773851858.377597:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000bc13a529 x1858688799919168 msgsize 8680
00000400:00000200:26.0:1773851858.377598:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00000001:24.0:1773851858.377598:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.377598:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:26.0:1773851858.377599:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851858.377599:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.377599:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00002000:00100000:24.0:1773851858.377599:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3820:0x0]  req@000000003631b769 x1858688799919616/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00100000:5.0:1773851858.377599:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9811@kfi7)
00000100:00000010:25.0:1773851858.377600:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005f0dac71.
00000100:00000001:5.0:1773851858.377600:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000040:25.0:1773851858.377601:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000005f0dac71 x1858688799919872 msgsize 488
00000400:00000200:5.0:1773851858.377601:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e13749e9 nid 9811@kfi7 refs 2
00000100:00100000:25.0:1773851858.377602:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00002000:00000001:24.0:1773851858.377602:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377602:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003631b769 with x1858688799919616
00010000:00000001:24.0:1773851858.377602:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:25.0:1773851858.377603:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:5.0:1773851858.377603:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb Transaction freed
00000400:00000200:25.0:1773851858.377604:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000020:00000001:24.0:1773851858.377604:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:25.0:1773851858.377605:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000040:24.0:1773851858.377605:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b8dbeb31 refcount=3
00000020:00000001:24.0:1773851858.377605:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064986515648 : -107008723035968 : ffff9ead171358c0)
00010000:00000001:24.0:1773851858.377606:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637064986515648 : -107008723035968 : ffff9ead171358c0)
00010000:00000001:24.0:1773851858.377606:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:5.0:1773851858.377606:0:61626:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00010000:00000001:24.0:1773851858.377607:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377607:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377607:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851858.377607:0:61626:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.377607:0:61626:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377608:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851858.377608:0:61626:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851858.377608:0:61626:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851858.377609:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377609:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000100:00100000:5.0:1773851858.377609:0:61626:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799919168
00000020:00000010:24.0:1773851858.377610:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000001:5.0:1773851858.377610:0:61626:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851858.377610:0:61626:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000040:24.0:1773851858.377611:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.377611:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851858.377611:0:61626:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.377612:0:61626:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:5.0:1773851858.377612:0:61626:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:5.0:1773851858.377613:0:61626:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:5.0:1773851858.377614:0:61626:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.377614:0:61626:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:25.0:1773851858.377615:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00000001:24.0:1773851858.377615:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000010:5.0:1773851858.377615:0:61626:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000800:00000200:25.0:1773851858.377616:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
02000000:00000001:24.0:1773851858.377616:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.377616:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000010:5.0:1773851858.377616:0:61626:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000800:00000200:25.0:1773851858.377617:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377617:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:5.0:1773851858.377617:0:61626:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
02000000:00000001:24.0:1773851858.377618:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.377618:0:61626:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.377618:0:61626:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:25.0:1773851858.377619:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00100000:24.0:1773851858.377619:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799811328
00000020:00000001:24.0:1773851858.377619:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377620:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.377620:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:25.0:1773851858.377621:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000040:24.0:1773851858.377621:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=675
00000020:00000001:24.0:1773851858.377621:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:5.0:1773851858.377621:0:61626:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:25.0:1773851858.377622:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000020:00000001:24.0:1773851858.377622:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:5.0:1773851858.377622:0:61626:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851858.377622:0:61626:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:25.0:1773851858.377623:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377623:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000100:00000001:24.0:1773851858.377623:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:5.0:1773851858.377623:0:61626:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:25.0:1773851858.377624:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00000001:24.0:1773851858.377624:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.377624:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000001:5.0:1773851858.377624:0:61626:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000010:24.0:1773851858.377625:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000001:5.0:1773851858.377625:0:61626:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:5.0:1773851858.377625:0:61626:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:5.0:1773851858.377626:0:61626:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:25.0:1773851858.377627:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000020:00000010:24.0:1773851858.377627:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000001:00000001:5.0:1773851858.377627:0:61626:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377628:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00000001:24.0:1773851858.377628:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000001:00000001:5.0:1773851858.377628:0:61626:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:5.0:1773851858.377628:0:61626:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:25.0:1773851858.377629:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000100:00000001:24.0:1773851858.377629:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.377629:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000001:00000001:5.0:1773851858.377629:0:61626:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:5.0:1773851858.377629:0:61626:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:25.0:1773851858.377630:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aacbc0
00000020:00000001:24.0:1773851858.377630:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.377630:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000001:00000001:5.0:1773851858.377630:0:61626:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:5.0:1773851858.377630:0:61626:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377631:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 185480
00000020:00000001:24.0:1773851858.377631:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851858.377631:0:61626:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377632:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.377632:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:5.0:1773851858.377632:0:61626:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851858.377633:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:24.0:1773851858.377633:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.377633:0:61626:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.377633:0:61626:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377634:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:24.0:1773851858.377634:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.377634:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:5.0:1773851858.377634:0:61626:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000400:00000200:25.0:1773851858.377635:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000001:00000001:24.0:1773851858.377635:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377635:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:5.0:1773851858.377635:0:61626:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.377636:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.377636:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000001:00000001:24.0:1773851858.377636:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377636:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00000001:5.0:1773851858.377636:0:61626:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000010:25.0:1773851858.377637:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000044c7d4e4.
00000001:00000001:24.0:1773851858.377637:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377637:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:5.0:1773851858.377637:0:61626:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io01_027: refresh rw locks for [0x24002621b:0xcbd3:0x0]  req@00000000bc13a529 x1858688799919168/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 8680/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000040:25.0:1773851858.377638:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000044c7d4e4 x1858688799919040 msgsize 488
00000020:00000001:24.0:1773851858.377638:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00100000:25.0:1773851858.377639:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000020:00000001:24.0:1773851858.377639:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.377640:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:24.0:1773851858.377640:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377640:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377641:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00002000:00000001:24.0:1773851858.377641:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00002000:00000001:5.0:1773851858.377641:0:61626:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:5.0:1773851858.377641:0:61626:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000bc13a529 with x1858688799919168
00000800:00000200:25.0:1773851858.377642:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000001:24.0:1773851858.377642:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377642:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:5.0:1773851858.377642:0:61626:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00002000:00100000:24.0:1773851858.377643:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3838:0x0]  req@00000000f5ebef6c x1858688799811328/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000020:00000001:5.0:1773851858.377643:0:61626:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:24.0:1773851858.377646:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377646:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000f5ebef6c with x1858688799811328
00010000:00000001:24.0:1773851858.377647:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377648:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.377648:0:61626:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c39670a3 refcount=3
00000020:00000001:5.0:1773851858.377649:0:61626:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113372648448 : -106960336903168 : ffff9eb85b1d2400)
00000020:00000040:24.0:1773851858.377650:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d3d7f61e refcount=3
00010000:00000001:5.0:1773851858.377650:0:61626:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637113372648448 : -106960336903168 : ffff9eb85b1d2400)
00000020:00000001:24.0:1773851858.377651:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637051847615488 : -107021861936128 : ffff9eaa07efa400)
00010000:00000001:5.0:1773851858.377651:0:61626:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377652:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637051847615488 : -107021861936128 : ffff9eaa07efa400)
00010000:00000001:5.0:1773851858.377652:0:61626:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:5.0:1773851858.377652:0:61626:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00010000:00000001:24.0:1773851858.377653:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377653:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:5.0:1773851858.377653:0:61626:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377654:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377654:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377655:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.377655:0:61626:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.377657:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000f5ebef6c x1858688799811328/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.377660:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000005c2dc1ad x1858688799811328/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:587/0 lens 488/448 e 21 to 0 dl 1773851822 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.377663:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377663:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.377664:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.377664:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:5.1:1773851858.377664:0:61626:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000bc13a529 x1858688799919168/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 8680/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00100000:24.0:1773851858.377665:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3838:0x0]  req@00000000f5ebef6c x1858688799811328/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:5.1:1773851858.377667:0:61626:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000a4186136 x1858688799919168/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 8680/0 e 21 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.377668:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377668:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000f5ebef6c with x1858688799811328
00010000:00000001:24.0:1773851858.377669:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377669:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377670:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d3d7f61e refcount=3
00000100:00000001:5.0:1773851858.377670:0:61626:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:5.0:1773851858.377670:0:61626:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:24.0:1773851858.377671:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637051847615488 : -107021861936128 : ffff9eaa07efa400)
00010000:00000001:24.0:1773851858.377671:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637051847615488 : -107021861936128 : ffff9eaa07efa400)
00000100:00000001:5.0:1773851858.377671:0:61626:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00010000:00000001:24.0:1773851858.377672:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377672:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:5.0:1773851858.377672:0:61626:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:24.0:1773851858.377673:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00100000:5.0:1773851858.377673:0:61626:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io01_027: refresh rw locks for [0x24002621b:0xcbd3:0x0]  req@00000000bc13a529 x1858688799919168/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 8680/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.377674:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377674:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377675:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377675:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00002000:00000001:5.0:1773851858.377675:0:61626:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000010:24.0:1773851858.377676:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00002000:00100000:5.0:1773851858.377676:0:61626:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000bc13a529 with x1858688799919168
00010000:00000001:5.0:1773851858.377676:0:61626:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000040:24.0:1773851858.377677:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 674
00000100:00000001:24.0:1773851858.377677:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851858.377677:0:61626:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:6.0:1773851858.377678:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000020:00000040:5.0:1773851858.377678:0:61626:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c39670a3 refcount=3
00000020:00000001:5.0:1773851858.377678:0:61626:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113372648448 : -106960336903168 : ffff9eb85b1d2400)
00000800:00000200:6.0:1773851858.377679:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00010000:00000001:5.0:1773851858.377679:0:61626:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637113372648448 : -106960336903168 : ffff9eb85b1d2400)
00010000:00000001:5.0:1773851858.377680:0:61626:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851858.377680:0:61626:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:6.0:1773851858.377681:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:5.0:1773851858.377681:0:61626:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:5.0:1773851858.377681:0:61626:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.377682:0:61626:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851858.377683:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:6.0:1773851858.377683:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:5.0:1773851858.377683:0:61626:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.377683:0:61626:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000800:00000200:27.0:1773851858.377684:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.377684:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.377684:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:5.0:1773851858.377684:0:61626:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000800:00000200:27.0:1773851858.377685:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851858.377685:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.377685:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377685:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.377685:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:6.0:1773851858.377685:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000020:00000040:5.0:1773851858.377685:0:61626:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000800:00000200:27.0:1773851858.377686:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377686:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377686:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851858.377686:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9811@kfi7 : PUT - for me
00000100:00000001:5.0:1773851858.377686:0:61626:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851858.377687:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.377687:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
02000000:00000001:24.0:1773851858.377687:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377687:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799919488
00000800:00000200:27.0:1773851858.377688:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:24.0:1773851858.377688:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377688:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.377688:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:6.0:1773851858.377688:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:6.0:1773851858.377688:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13749e9 nid 9811@kfi7 refs 1
00000800:00000200:26.0:1773851858.377689:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851858.377689:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000040:24.0:1773851858.377689:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000400:00000200:27.0:1773851858.377690:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377690:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377690:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000400:00000200:6.0:1773851858.377690:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:6.0:1773851858.377690:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13749e9 nid 9811@kfi7 refs 2
00000400:00000200:26.0:1773851858.377691:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377691:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000100:00000001:24.0:1773851858.377691:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:27.0:1773851858.377692:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:26.0:1773851858.377692:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9810@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.377692:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00000001:24.0:1773851858.377692:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.377692:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000400:00000200:6.0:1773851858.377692:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e13749e9 nid 9811@kfi7 refs 3
00000400:00000200:25.0:1773851858.377693:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000020:00000010:24.0:1773851858.377693:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000400:00000200:6.0:1773851858.377693:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.377694:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000010:24.0:1773851858.377694:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000400:00000200:6.0:1773851858.377694:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 12872 into portal 13 MB=0x69a77b5ab8740
00000400:00000200:25.0:1773851858.377695:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000100:00000001:24.0:1773851858.377695:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.377695:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.377695:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:6.0:1773851858.377695:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 12872/12872 into md 0x79355bda5 [128] + 254752
00000400:00000200:25.0:1773851858.377696:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000020:00000001:24.0:1773851858.377696:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.377696:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:27.0:1773851858.377697:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377697:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.377697:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000400:00000010:6.0:1773851858.377697:0:2499722:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d82621e8.
00000400:00000200:6.0:1773851858.377697:0:2499722:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 0000000036e8db60
00000400:00000200:27.0:1773851858.377698:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:27.0:1773851858.377698:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000001:24.0:1773851858.377698:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377698:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377698:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:27.0:1773851858.377699:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000001:00000001:24.0:1773851858.377699:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851858.377699:0:2499722:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 12872 bytes in 4 frags
00000400:00000200:27.0:1773851858.377700:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000001:00000001:24.0:1773851858.377700:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377700:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:26.0:1773851858.377701:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000001:00000001:24.0:1773851858.377701:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377701:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:6.0:1773851858.377701:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000400:00000200:26.0:1773851858.377702:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000400:00000200:26.0:1773851858.377702:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000001:00000001:24.0:1773851858.377702:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377702:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851858.377703:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00000020:00000001:24.0:1773851858.377703:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377703:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851858.377704:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 5
00000020:00000001:24.0:1773851858.377704:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377704:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851858.377704:0:2499722:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb Using peer 9811@kfi7(0x1000000000007eb)
00000400:00000200:25.0:1773851858.377705:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00002000:00000001:24.0:1773851858.377705:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.377705:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851858.377706:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:25.0:1773851858.377706:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aace80
00002000:00000001:24.0:1773851858.377706:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377706:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0xcbca:0x0]  req@000000008d0c6b78 x1858688799919488/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:27.0:1773851858.377707:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aaca40
00000400:00000200:26.0:1773851858.377707:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:26.0:1773851858.377707:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5aacd00
00000400:00000200:25.0:1773851858.377707:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 185968
00000400:00000200:27.0:1773851858.377709:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 186456
00000800:00000200:25.0:1773851858.377709:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:24.0:1773851858.377709:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000800:00000200:6.0:1773851858.377709:0:2499722:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:1 TN 000000001aa19562: Posted read of 12872 bytes in 4 frags kp 9811@kfi7(00000000cccbdef7) rma_iov.key 3276801: rc=0
00000400:00000200:26.0:1773851858.377710:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 186944
00000400:00000200:25.0:1773851858.377710:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00100000:24.0:1773851858.377710:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000008d0c6b78 with x1858688799919488
00010000:00000001:24.0:1773851858.377710:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000800:00000200:27.0:1773851858.377711:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:24.0:1773851858.377711:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:6.0:1773851858.377711:0:2499722:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000400:00000200:27.0:1773851858.377712:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:26.0:1773851858.377712:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.377712:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000100:00000001:25.0:1773851858.377712:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:27.0:1773851858.377713:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000400:00000200:26.0:1773851858.377713:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:25.0:1773851858.377713:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:25.0:1773851858.377713:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c3bf5870.
00000400:00000200:26.0:1773851858.377714:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9810@kfi7: PUT: OK
00000100:00000040:25.0:1773851858.377714:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c3bf5870 x1858688799919744 msgsize 488
00000100:00100000:25.0:1773851858.377715:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:25.0:1773851858.377715:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000040:24.0:1773851858.377716:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008e756a98 refcount=3
00000020:00000001:24.0:1773851858.377716:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146494712448 : -106927214839168 : ffff9ec01157ba80)
00000400:00000200:25.0:1773851858.377717:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 4
00010000:00000001:24.0:1773851858.377717:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637146494712448 : -106927214839168 : ffff9ec01157ba80)
00000100:00000001:27.0:1773851858.377718:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:25.0:1773851858.377718:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00010000:00000001:24.0:1773851858.377718:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000200:27.0:1773851858.377719:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:27.0:1773851858.377719:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eded8182.
00010000:00000001:24.0:1773851858.377719:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377719:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377719:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851858.377720:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000eded8182 x1858688799918656 msgsize 488
00000800:00000200:25.0:1773851858.377720:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:24.0:1773851858.377720:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851858.377721:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000800:00000200:25.0:1773851858.377721:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00080000:24.1:1773851858.377721:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000008d0c6b78 x1858688799919488/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:27.0:1773851858.377722:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:25.0:1773851858.377722:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851858.377723:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000800:00000200:27.0:1773851858.377724:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851858.377724:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.377724:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:25.0:1773851858.377724:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000010:26.0:1773851858.377725:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009ebc5be.
00000800:00000200:5.0:1773851858.377726:0:2507993:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb TN_EVENT_TAG_TX_OK event status 0
00000100:00000040:26.0:1773851858.377729:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000009ebc5be x1858688799919360 msgsize 488
00000100:00100000:26.0:1773851858.377730:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000400:00000200:25.0:1773851858.377730:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:5.0:1773851858.377730:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851858.377731:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851858.377731:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000400:00000200:25.0:1773851858.377731:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000800:00000200:26.0:1773851858.377732:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 9810@kfi7(0000000094cde786):0x0 lsk 586 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851858.377732:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00080000:24.1:1773851858.377732:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000c17d761d x1858688799919488/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:5.0:1773851858.377732:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9811@kfi7: PUT: OK
00000400:00000200:25.0:1773851858.377733:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000400:00000200:5.0:1773851858.377733:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036e8db60
00000400:00000010:5.0:1773851858.377733:0:2507993:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 2168 at 0000000036e8db60 (tot 253198603).
00000400:00000200:25.0:1773851858.377734:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377734:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000100:00000001:5.0:1773851858.377734:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:25.0:1773851858.377735:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00000100:00000200:5.0:1773851858.377735:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:25.0:1773851858.377736:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000100:00000040:5.0:1773851858.377736:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000065cff55 x1858688799967040 msgsize 12872
00000400:00000200:25.0:1773851858.377737:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5a92800
00000400:00000200:25.0:1773851858.377738:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 187432
00000100:00100000:5.0:1773851858.377738:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9811@kfi7)
00000100:00000001:24.0:1773851858.377739:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377739:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000040:5.0:1773851858.377739:0:2507993:0:(events.c:370:request_in_callback()) Buffer complete: 42 buffers still posted
00000800:00000200:25.0:1773851858.377740:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377740:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851858.377740:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:24.0:1773851858.377741:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:5.0:1773851858.377741:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e13749e9 nid 9811@kfi7 refs 2
00000400:00000200:25.0:1773851858.377742:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00100000:24.0:1773851858.377742:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0xcbca:0x0]  req@000000008d0c6b78 x1858688799919488/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:25.0:1773851858.377743:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000800:00000200:5.0:1773851858.377743:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 9811@kfi7(00000000cccbdef7):0x0 lsk 2028 rsk 50 tsk 50 trmk 1 tmk 0 trr 1 tta 0x1000000000007eb Transaction freed
00000100:00000001:25.0:1773851858.377744:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.377744:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:25.0:1773851858.377745:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000082285c8f.
00000100:00000040:25.0:1773851858.377746:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000082285c8f x1858688799811584 msgsize 488
00000100:00000001:5.0:1773851858.377746:0:61626:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851858.377746:0:61626:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.377746:0:61626:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851858.377747:0:61626:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851858.377748:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:25.0:1773851858.377748:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:24.0:1773851858.377748:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377748:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000008d0c6b78 with x1858688799919488
02000000:00000001:5.0:1773851858.377748:0:61626:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377749:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00010000:00000001:24.0:1773851858.377749:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377749:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:5.0:1773851858.377749:0:61626:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799967040
00000020:00000001:5.0:1773851858.377749:0:61626:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:25.0:1773851858.377750:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000040:24.0:1773851858.377750:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008e756a98 refcount=3
00000020:00000001:24.0:1773851858.377750:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146494712448 : -106927214839168 : ffff9ec01157ba80)
00000020:00000040:5.0:1773851858.377750:0:61626:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:5.0:1773851858.377750:0:61626:0:(lustre_handles.c:133:class_handle2object()) Process entered
00010000:00000001:24.0:1773851858.377751:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637146494712448 : -106927214839168 : ffff9ec01157ba80)
00000020:00000040:5.0:1773851858.377751:0:61626:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=675
00000020:00000001:5.0:1773851858.377751:0:61626:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00010000:00000001:24.0:1773851858.377752:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377752:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:5.0:1773851858.377752:0:61626:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00002000:00000001:24.0:1773851858.377753:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377753:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.377753:0:61626:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377754:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377754:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000100:00000001:5.0:1773851858.377754:0:61626:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851858.377754:0:61626:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:24.0:1773851858.377755:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:5.0:1773851858.377755:0:61626:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:24.0:1773851858.377756:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.377756:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 674
00000020:00000010:5.0:1773851858.377756:0:61626:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:24.0:1773851858.377757:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.377757:0:61626:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.377758:0:61626:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:5.0:1773851858.377758:0:61626:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:5.0:1773851858.377759:0:61626:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851858.377759:0:61626:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:5.0:1773851858.377760:0:61626:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851858.377760:0:61626:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:5.0:1773851858.377761:0:61626:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000800:00000200:25.0:1773851858.377762:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.377762:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:24.0:1773851858.377762:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.377762:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:5.0:1773851858.377762:0:61626:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:5.0:1773851858.377762:0:61626:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000800:00000200:25.0:1773851858.377763:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851858.377763:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377763:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:5.0:1773851858.377763:0:61626:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:5.0:1773851858.377763:0:61626:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
02000000:00000001:24.0:1773851858.377764:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377764:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799966912
00000800:00000200:25.0:1773851858.377765:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:24.0:1773851858.377765:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000001:00000001:5.0:1773851858.377765:0:61626:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:5.0:1773851858.377765:0:61626:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:5.0:1773851858.377765:0:61626:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000040:24.0:1773851858.377766:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.377766:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000001:00000001:5.0:1773851858.377766:0:61626:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:25.0:1773851858.377767:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000020:00000040:24.0:1773851858.377767:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=675
00000001:00000001:5.0:1773851858.377767:0:61626:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.377767:0:61626:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:25.0:1773851858.377768:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9810@kfi7 : PUT - for me
00000020:00000001:24.0:1773851858.377768:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377768:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:5.0:1773851858.377768:0:61626:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.377768:0:61626:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377769:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000100:00000001:24.0:1773851858.377769:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:5.0:1773851858.377769:0:61626:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377770:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 1
00000100:00000001:24.0:1773851858.377770:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.377770:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00002000:00000001:5.0:1773851858.377770:0:61626:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:5.0:1773851858.377770:0:61626:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377771:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9810@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.377771:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00000020:00000010:24.0:1773851858.377771:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00002000:00000001:5.0:1773851858.377771:0:61626:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:25.0:1773851858.377772:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 3
00002000:00100000:5.0:1773851858.377772:0:61626:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io01_027: refresh rw locks for [0x24002621b:0x1cba0:0x0]  req@00000000065cff55 x1858688799967040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 12872/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000200:25.0:1773851858.377773:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000020:00000010:24.0:1773851858.377773:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.377773:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:25.0:1773851858.377774:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 488 into portal 13 MB=0x69a77b5a92780
00000100:00000001:24.0:1773851858.377774:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.377774:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:25.0:1773851858.377775:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-9811@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 187920
00000020:00000001:24.0:1773851858.377775:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.377775:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00002000:00000001:5.0:1773851858.377775:0:61626:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:5.0:1773851858.377775:0:61626:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000065cff55 with x1858688799967040
00000020:00000001:24.0:1773851858.377776:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00010000:00000001:5.0:1773851858.377776:0:61626:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000800:00000200:25.0:1773851858.377777:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:24.0:1773851858.377777:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.377777:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:5.0:1773851858.377777:0:61626:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.377777:0:61626:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c648d975 refcount=3
00000400:00000200:25.0:1773851858.377778:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:24.0:1773851858.377778:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377778:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:5.0:1773851858.377778:0:61626:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636961138612992 : -107112570938624 : ffff9e94e9421b00)
00000400:00000200:25.0:1773851858.377779:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9810@kfi7: PUT: OK
00000001:00000001:24.0:1773851858.377779:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851858.377779:0:61626:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636961138612992 : -107112570938624 : ffff9e94e9421b00)
00000100:00000001:25.0:1773851858.377780:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000001:00000001:24.0:1773851858.377780:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377780:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00010000:00000001:5.0:1773851858.377780:0:61626:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851858.377780:0:61626:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000200:25.0:1773851858.377781:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000001:00000001:24.0:1773851858.377781:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377781:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.377781:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00002000:00000001:5.0:1773851858.377781:0:61626:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:5.0:1773851858.377781:0:61626:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:25.0:1773851858.377782:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000888b438d.
00000100:00000040:25.0:1773851858.377782:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000888b438d x1858688799811456 msgsize 488
00000001:00000001:24.0:1773851858.377782:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.377782:0:61626:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377783:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377783:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:5.1:1773851858.377783:0:61626:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000065cff55 x1858688799967040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 12872/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00100000:25.0:1773851858.377784:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9810@kfi7)
00000100:00000001:25.0:1773851858.377784:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:24.0:1773851858.377784:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377784:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851858.377785:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006548e4ae nid 9810@kfi7 refs 2
00002000:00000001:24.0:1773851858.377785:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000800:00000200:25.0:1773851858.377786:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 9810@kfi7(000000002d8a2ceb):0x0 lsk 3985 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000001:24.0:1773851858.377786:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377786:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:5.1:1773851858.377786:0:61626:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000158a1dc0 x1858688799967040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:607/0 lens 12872/0 e 11 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00100000:24.0:1773851858.377787:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9f:0x0]  req@000000004d4799b9 x1858688799966912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:5.0:1773851858.377788:0:61626:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:5.0:1773851858.377789:0:61626:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00002000:00000001:24.0:1773851858.377790:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377790:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000004d4799b9 with x1858688799966912
00000100:00000001:5.0:1773851858.377790:0:61626:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00010000:00000001:24.0:1773851858.377791:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377791:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:5.0:1773851858.377791:0:61626:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000040:24.0:1773851858.377792:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006503466d refcount=3
00002000:00100000:5.0:1773851858.377792:0:61626:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io01_027: refresh rw locks for [0x24002621b:0x1cba0:0x0]  req@00000000065cff55 x1858688799967040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 12872/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000020:00000001:24.0:1773851858.377793:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637090497414848 : -106983212136768 : ffff9eb307a4c6c0)
00010000:00000001:24.0:1773851858.377794:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637090497414848 : -106983212136768 : ffff9eb307a4c6c0)
00002000:00000001:5.0:1773851858.377794:0:61626:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00010000:00000001:24.0:1773851858.377795:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00100000:5.0:1773851858.377795:0:61626:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000065cff55 with x1858688799967040
00010000:00000001:24.0:1773851858.377796:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377796:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377796:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851858.377796:0:61626:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:5.0:1773851858.377796:0:61626:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851858.377797:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:5.0:1773851858.377797:0:61626:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c648d975 refcount=3
00000100:00080000:24.1:1773851858.377798:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000004d4799b9 x1858688799966912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000020:00000001:5.0:1773851858.377798:0:61626:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636961138612992 : -107112570938624 : ffff9e94e9421b00)
00010000:00000001:5.0:1773851858.377798:0:61626:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636961138612992 : -107112570938624 : ffff9e94e9421b00)
00010000:00000001:5.0:1773851858.377799:0:61626:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851858.377800:0:61626:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:5.0:1773851858.377800:0:61626:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00080000:24.1:1773851858.377801:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000007e940e1b x1858688799966912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:607/0 lens 488/0 e 11 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:5.0:1773851858.377801:0:61626:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377804:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377804:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:5.0:1773851858.377804:0:61626:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851858.377804:0:61626:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00000001:24.0:1773851858.377805:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:5.0:1773851858.377805:0:61626:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00002000:00000001:24.0:1773851858.377806:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:5.0:1773851858.377806:0:61626:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00002000:00100000:24.0:1773851858.377807:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9f:0x0]  req@000000004d4799b9 x1858688799966912/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000020:00000040:5.0:1773851858.377807:0:61626:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 674
00002000:00000001:24.0:1773851858.377809:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377810:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000004d4799b9 with x1858688799966912
00010000:00000001:24.0:1773851858.377810:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377811:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377811:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006503466d refcount=3
00000020:00000001:24.0:1773851858.377812:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637090497414848 : -106983212136768 : ffff9eb307a4c6c0)
00010000:00000001:24.0:1773851858.377813:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637090497414848 : -106983212136768 : ffff9eb307a4c6c0)
00010000:00000001:24.0:1773851858.377814:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377814:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377815:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377815:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377816:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377816:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377817:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.377818:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.377819:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.377819:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.377820:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.377820:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.377821:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377821:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.377822:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377822:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799918784
00000020:00000001:24.0:1773851858.377823:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377823:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.377824:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377824:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.377825:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377825:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.377826:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377826:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000010:5.0:1773851858.377826:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc13a529.
00000020:00000010:24.0:1773851858.377827:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000100:00000010:5.0:1773851858.377827:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000faed417e.
00000020:00000010:24.0:1773851858.377828:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377828:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000010:5.0:1773851858.377828:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000005ae69a0.
00000100:00000010:5.0:1773851858.377828:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000053da6f00.
00000100:00000001:24.0:1773851858.377829:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.377829:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000010:5.0:1773851858.377829:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c2bd7e31.
00000100:00000010:5.0:1773851858.377829:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e97e36e.
00000020:00000001:24.0:1773851858.377830:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.377830:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.377830:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000100:00000010:5.0:1773851858.377830:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f74b7d8.
00000020:00000001:24.0:1773851858.377831:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.377831:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000100:00000010:5.0:1773851858.377831:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000add9a3d8.
00000100:00000010:5.0:1773851858.377831:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cf40837.
00000020:00000001:24.0:1773851858.377832:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377832:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377832:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ca0c9ac8.
00000001:00000001:24.0:1773851858.377833:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.377833:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377833:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004f379937.
00000100:00000010:5.0:1773851858.377833:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e9ed7dc2.
00000001:00000001:24.0:1773851858.377834:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377834:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000010:5.0:1773851858.377834:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000038c1eab2.
00000100:00000010:5.0:1773851858.377834:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004947a669.
00000001:00000001:24.0:1773851858.377835:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377835:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000010:5.0:1773851858.377835:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000068789c41.
00000001:00000001:24.0:1773851858.377836:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377836:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377836:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000010:5.0:1773851858.377836:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef2c3e33.
00000100:00000010:5.0:1773851858.377836:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000066d07729.
00000020:00000001:24.0:1773851858.377837:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377837:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377837:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000082cf81f.
00000020:00000001:24.0:1773851858.377838:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377838:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000100:00000010:5.0:1773851858.377838:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dba6c613.
00000020:00000001:24.0:1773851858.377839:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377839:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000010:5.0:1773851858.377839:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003edd3add.
00002000:00100000:24.0:1773851858.377840:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3640:0x0]  req@000000004392d71d x1858688799918784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377840:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009e20093.
00000100:00000010:5.0:1773851858.377841:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000023fc2e36.
00000100:00000010:5.0:1773851858.377842:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000af4d4c55.
00000100:00000010:5.0:1773851858.377842:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002b6b44c1.
00000100:00000010:5.0:1773851858.377843:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a49395e3.
00000100:00000010:5.0:1773851858.377844:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003d57fa12.
00000100:00000010:5.0:1773851858.377844:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079f6c74c.
00000100:00000010:5.0:1773851858.377845:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000039ed676a.
00002000:00000001:24.0:1773851858.377846:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377846:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000004392d71d with x1858688799918784
00000100:00000010:5.0:1773851858.377846:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ee7cf13c.
00010000:00000001:24.0:1773851858.377847:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377847:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000010:5.0:1773851858.377847:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7f0e5ab.
00000100:00000010:5.0:1773851858.377848:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008713e098.
00000100:00000010:5.0:1773851858.377849:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079ceed67.
00000100:00000010:5.0:1773851858.377850:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008914a101.
00000100:00000010:5.0:1773851858.377850:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000065fd465d.
00000020:00000040:24.0:1773851858.377851:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b7aad46d refcount=3
00000100:00000010:5.0:1773851858.377851:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007615868.
00000020:00000001:24.0:1773851858.377852:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636996248828544 : -107077460723072 : ffff9e9d15fd7a80)
00000100:00000010:5.0:1773851858.377852:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004ed214fe.
00010000:00000001:24.0:1773851858.377853:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636996248828544 : -107077460723072 : ffff9e9d15fd7a80)
00010000:00000001:24.0:1773851858.377853:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000010:5.0:1773851858.377853:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009494250d.
00010000:00000001:24.0:1773851858.377854:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377854:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377854:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377854:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000bc7c6a9.
00000100:00000001:24.0:1773851858.377855:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377855:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001775134a.
00000100:00080000:24.1:1773851858.377856:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000004392d71d x1858688799918784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377856:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cf85b18.
00000100:00000010:5.0:1773851858.377857:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ba41ad91.
00000100:00000010:5.0:1773851858.377858:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b7becdfc.
00000100:00000010:5.0:1773851858.377858:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000029aabbbc.
00000100:00080000:24.1:1773851858.377859:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000021ed7b10 x1858688799918784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377859:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac7bcb57.
00000100:00000010:5.0:1773851858.377860:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b40c5bbd.
00000100:00000001:24.0:1773851858.377861:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000010:5.0:1773851858.377861:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000015634729.
00000100:00000001:24.0:1773851858.377862:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000010:5.0:1773851858.377862:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000078a2d7eb.
00000100:00000001:24.0:1773851858.377863:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.377863:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000010:5.0:1773851858.377863:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e4b9a8f4.
00002000:00100000:24.0:1773851858.377864:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3640:0x0]  req@000000004392d71d x1858688799918784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377864:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000785d07c9.
00000100:00000010:5.0:1773851858.377865:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a002ca8.
00002000:00000001:24.0:1773851858.377866:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000010:5.0:1773851858.377866:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006688b855.
00002000:00100000:24.0:1773851858.377867:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000004392d71d with x1858688799918784
00010000:00000001:24.0:1773851858.377867:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000010:5.0:1773851858.377867:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000585b39eb.
00000020:00000001:24.0:1773851858.377868:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377868:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b7aad46d refcount=3
00000100:00000010:5.0:1773851858.377868:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000a6492fa.
00000020:00000001:24.0:1773851858.377869:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636996248828544 : -107077460723072 : ffff9e9d15fd7a80)
00010000:00000001:24.0:1773851858.377869:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636996248828544 : -107077460723072 : ffff9e9d15fd7a80)
00000100:00000010:5.0:1773851858.377869:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000628e84ec.
00000100:00000010:5.0:1773851858.377869:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000099d34036.
00010000:00000001:24.0:1773851858.377870:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377870:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377870:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000010:5.0:1773851858.377870:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b3d98555.
00002000:00000001:24.0:1773851858.377871:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377871:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000010:5.0:1773851858.377871:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce97d16b.
00000020:00000010:24.0:1773851858.377872:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000100:00000010:5.0:1773851858.377872:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4d38089.
00000100:00000010:5.0:1773851858.377872:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8f15c53.
00000020:00000010:24.0:1773851858.377873:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.377873:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000100:00000010:5.0:1773851858.377873:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000051a61f21.
00000020:00000040:24.0:1773851858.377874:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.377874:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.377875:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000010:5.0:1773851858.377875:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae399870.
02000000:00000001:24.0:1773851858.377876:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.377876:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377876:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377876:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000053ade5d.
02000000:00000001:24.0:1773851858.377877:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377877:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799966784
00000100:00000010:5.0:1773851858.377877:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006bb39113.
00000020:00000001:24.0:1773851858.377878:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377878:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000100:00000010:5.0:1773851858.377878:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000013bd5a3f.
00000100:00000010:5.0:1773851858.377878:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006329a78.
00000020:00000001:24.0:1773851858.377879:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377879:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000100:00000010:5.0:1773851858.377879:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008037b192.
00000020:00000001:24.0:1773851858.377880:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377880:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000010:5.0:1773851858.377880:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003df450d1.
00000100:00000001:24.0:1773851858.377881:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377881:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000010:5.0:1773851858.377881:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019933c3c.
00000020:00000010:24.0:1773851858.377882:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.377882:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000100:00000010:5.0:1773851858.377882:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000013543d1d.
00000020:00000010:24.0:1773851858.377883:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000010:5.0:1773851858.377883:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e8640bb8.
00000100:00000001:24.0:1773851858.377884:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.377884:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000010:5.0:1773851858.377884:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a127fcd.
00000100:00000010:5.0:1773851858.377884:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004e3a4f26.
00000020:00000001:24.0:1773851858.377885:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.377885:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000010:5.0:1773851858.377885:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0f62695.
00000020:00000001:24.0:1773851858.377886:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.377886:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000010:5.0:1773851858.377886:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc5f61f0.
00000020:00000001:24.0:1773851858.377887:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.377887:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377887:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377887:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005079e4ce.
00000100:00000010:5.0:1773851858.377887:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004c4d438f.
00000001:00000001:24.0:1773851858.377888:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.377888:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377888:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d37c7bfd.
00000001:00000001:24.0:1773851858.377889:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377889:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000010:5.0:1773851858.377889:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bd0b3c03.
00000001:00000001:24.0:1773851858.377890:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377890:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000010:5.0:1773851858.377890:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000001a51fa9.
00000001:00000001:24.0:1773851858.377891:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377891:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377891:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000fe4ac96.
00000020:00000001:24.0:1773851858.377892:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377892:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377892:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079a429c5.
00000020:00000001:24.0:1773851858.377893:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377893:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377893:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e776f2d.
00002000:00000001:24.0:1773851858.377894:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.377894:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377894:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000949a9c8b.
00002000:00000001:24.0:1773851858.377895:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377895:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9e:0x0]  req@00000000e7c314c5 x1858688799966784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377895:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e97a8038.
00000100:00000010:5.0:1773851858.377895:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007dcdc29c.
00000100:00000010:5.0:1773851858.377896:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000000881c42.
00000100:00000010:5.0:1773851858.377897:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c55cd133.
00000100:00000010:5.0:1773851858.377897:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094d857a2.
00002000:00000001:24.0:1773851858.377898:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377898:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000e7c314c5 with x1858688799966784
00000100:00000010:5.0:1773851858.377898:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000047852588.
00010000:00000001:24.0:1773851858.377899:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377899:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000010:5.0:1773851858.377899:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a1987f5e.
00000020:00000040:24.0:1773851858.377900:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f0d92bc1 refcount=3
00000100:00000010:5.0:1773851858.377900:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098f7262e.
00000020:00000001:24.0:1773851858.377901:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636961997971904 : -107111711579712 : ffff9e951c7ae1c0)
00010000:00000001:24.0:1773851858.377901:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636961997971904 : -107111711579712 : ffff9e951c7ae1c0)
00000100:00000010:5.0:1773851858.377901:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a916e2d2.
00010000:00000001:24.0:1773851858.377902:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377902:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000010:5.0:1773851858.377902:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef4c1727.
00000100:00000010:5.0:1773851858.377902:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d7b544ce.
00002000:00000001:24.0:1773851858.377903:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377903:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377903:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004b6592a4.
00000100:00000001:24.0:1773851858.377904:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377904:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc43218c.
00000100:00080000:24.1:1773851858.377905:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000e7c314c5 x1858688799966784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377905:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ad2b3d0.
00000100:00000010:5.0:1773851858.377906:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004bf1225.
00000100:00080000:24.1:1773851858.377907:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000002e334c51 x1858688799966784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:607/0 lens 488/0 e 11 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377907:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d4a1efb.
00000100:00000010:5.0:1773851858.377907:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000057ccff1.
00000100:00000010:5.0:1773851858.377908:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7c877fa.
00000100:00000010:5.0:1773851858.377909:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000975ec356.
00000100:00000010:5.0:1773851858.377909:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f7143cb.
00000100:00000001:24.0:1773851858.377910:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377910:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000010:5.0:1773851858.377910:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000001a5bbaf.
00000100:00000001:24.0:1773851858.377911:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.377911:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000010:5.0:1773851858.377911:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7fa7c5a.
00002000:00100000:24.0:1773851858.377912:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0x1cb9e:0x0]  req@00000000e7c314c5 x1858688799966784/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000010:5.0:1773851858.377912:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000069abe1d5.
00000100:00000010:5.0:1773851858.377912:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006d25e156.
00000100:00000010:5.0:1773851858.377913:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a920fa0b.
00000100:00000010:5.0:1773851858.377914:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009bfb0afa.
00002000:00000001:24.0:1773851858.377915:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377915:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000e7c314c5 with x1858688799966784
00010000:00000001:24.0:1773851858.377915:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000010:5.0:1773851858.377915:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b78b7357.
00000020:00000001:24.0:1773851858.377916:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377916:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f0d92bc1 refcount=3
00000100:00000010:5.0:1773851858.377916:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000849effc7.
00000020:00000001:24.0:1773851858.377917:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636961997971904 : -107111711579712 : ffff9e951c7ae1c0)
00000100:00000010:5.0:1773851858.377917:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000026777ab2.
00010000:00000001:24.0:1773851858.377918:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636961997971904 : -107111711579712 : ffff9e951c7ae1c0)
00010000:00000001:24.0:1773851858.377918:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377918:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000010:5.0:1773851858.377918:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000824100d6.
00002000:00000001:24.0:1773851858.377919:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377919:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377919:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f0c6c0f.
00000100:00000001:24.0:1773851858.377920:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377920:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377921:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.377921:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000100:00000010:5.0:1773851858.377921:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000278a6f65.
00000100:00000010:5.0:1773851858.377921:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000096719ec9.
00000020:00000040:24.0:1773851858.377922:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000010:5.0:1773851858.377922:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f389a472.
00000100:00000001:24.0:1773851858.377923:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:5.0:1773851858.377923:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056c4c809.
00000100:00000001:24.0:1773851858.377924:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.377924:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000010:5.0:1773851858.377924:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b5273339.
00000100:00000010:5.0:1773851858.377924:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e00208d.
00000100:00000001:24.0:1773851858.377925:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377925:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377925:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5b02377.
02000000:00000001:24.0:1773851858.377926:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377926:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799811200
00000100:00000010:5.0:1773851858.377926:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000064c6c467.
00000020:00000001:24.0:1773851858.377927:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377927:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000100:00000010:5.0:1773851858.377927:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c8847ea.
00000100:00000010:5.0:1773851858.377927:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d974d1bc.
00000020:00000001:24.0:1773851858.377928:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377928:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000100:00000010:5.0:1773851858.377928:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd340062.
00000020:00000001:24.0:1773851858.377929:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377929:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000010:5.0:1773851858.377929:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007780332b.
00000100:00000001:24.0:1773851858.377930:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377930:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000010:5.0:1773851858.377930:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008252cbd9.
00000020:00000010:24.0:1773851858.377931:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.377931:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000100:00000010:5.0:1773851858.377931:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007ffd10a.
00000020:00000010:24.0:1773851858.377932:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.377932:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000010:5.0:1773851858.377932:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000953e77b6.
00000100:00000001:24.0:1773851858.377933:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.377933:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.377933:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000010:5.0:1773851858.377933:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ef17a58.
00000020:00000001:24.0:1773851858.377934:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000100:00000010:5.0:1773851858.377934:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cec945bc.
00000020:00000001:24.0:1773851858.377935:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.377935:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000100:00000010:5.0:1773851858.377935:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000269f1041.
00000020:00000001:24.0:1773851858.377936:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377936:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377936:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00000010:5.0:1773851858.377936:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f9f54e3.
00000001:00000001:24.0:1773851858.377937:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377937:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000010:5.0:1773851858.377937:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc37e059.
00000001:00000001:24.0:1773851858.377938:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.377938:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377938:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000010:5.0:1773851858.377938:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b99fc2fa.
00000100:00000010:5.0:1773851858.377938:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000706f53a0.
00000001:00000001:24.0:1773851858.377939:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377939:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851858.377939:0:61626:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f63690ce.
00000020:00000001:24.0:1773851858.377940:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377940:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.377940:0:61626:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851858.377941:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377941:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377942:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.377942:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851858.377942:0:61626:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt_io: registering portal 13
00002000:00000001:24.0:1773851858.377943:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000010:5.0:1773851858.377943:0:61626:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f228ac8a.
00002000:00100000:24.0:1773851858.377944:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3837:0x0]  req@00000000219195b5 x1858688799811200/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000400:00000010:5.0:1773851858.377944:0:61626:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 2168 at 00000000a15e45eb (tot 253200771).
00002000:00000001:24.0:1773851858.377947:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377947:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000219195b5 with x1858688799811200
00010000:00000001:24.0:1773851858.377948:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377948:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377951:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e9e83613 refcount=3
00000020:00000001:24.0:1773851858.377952:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636960410849216 : -107113298702400 : ffff9e94bde14fc0)
00010000:00000001:24.0:1773851858.377952:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636960410849216 : -107113298702400 : ffff9e94bde14fc0)
00010000:00000001:24.0:1773851858.377953:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377953:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377954:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377954:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377955:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.377956:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000219195b5 x1858688799811200/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.377959:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000037e55326 x1858688799811200/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:586/0 lens 488/448 e 21 to 0 dl 1773851822 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.377961:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.377963:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.377964:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.377964:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377965:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3837:0x0]  req@00000000219195b5 x1858688799811200/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.377968:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.377968:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000219195b5 with x1858688799811200
00010000:00000001:24.0:1773851858.377969:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.377969:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377970:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e9e83613 refcount=3
00000020:00000001:24.0:1773851858.377970:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636960410849216 : -107113298702400 : ffff9e94bde14fc0)
00010000:00000001:24.0:1773851858.377971:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636960410849216 : -107113298702400 : ffff9e94bde14fc0)
00010000:00000001:24.0:1773851858.377972:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.377972:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.377972:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.377973:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.377973:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.377974:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377974:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.377975:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.377975:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.377976:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.377977:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.377978:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.377978:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.377978:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.377979:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.377979:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799919872
00000020:00000001:24.0:1773851858.377980:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.377980:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.377981:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.377981:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.377982:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.377982:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.377984:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.377984:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.377984:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.377985:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.377985:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.377986:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.377986:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.377987:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.377987:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.377988:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.377988:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.377989:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.377989:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.377989:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377990:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.377990:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.377991:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377991:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.377992:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377992:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.377993:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.377993:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377994:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.377994:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377995:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.377995:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377996:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.377996:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.377997:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.377997:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0xca81:0x0]  req@000000005f0dac71 x1858688799919872/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378000:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378000:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000005f0dac71 with x1858688799919872
00010000:00000001:24.0:1773851858.378001:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378001:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378007:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000bf0aa3a2 refcount=3
00000020:00000001:24.0:1773851858.378007:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637043410336384 : -107030299215232 : ffff9ea81108fa80)
00010000:00000001:24.0:1773851858.378008:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637043410336384 : -107030299215232 : ffff9ea81108fa80)
00010000:00000001:24.0:1773851858.378009:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378009:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378010:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378010:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378011:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.378012:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000005f0dac71 x1858688799919872/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.378014:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000001aaac9c8 x1858688799919872/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.378017:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.378017:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.378018:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.378018:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378019:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0xca81:0x0]  req@000000005f0dac71 x1858688799919872/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378021:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378022:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000005f0dac71 with x1858688799919872
00010000:00000001:24.0:1773851858.378022:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378023:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378023:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000bf0aa3a2 refcount=3
00000020:00000001:24.0:1773851858.378024:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637043410336384 : -107030299215232 : ffff9ea81108fa80)
00010000:00000001:24.0:1773851858.378024:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637043410336384 : -107030299215232 : ffff9ea81108fa80)
00010000:00000001:24.0:1773851858.378025:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378025:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378025:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378026:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378026:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.378027:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378027:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.378028:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.378028:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.378029:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.378030:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.378030:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.378031:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.378032:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.378032:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.378033:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799919040
00000020:00000001:24.0:1773851858.378034:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.378034:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.378034:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378035:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.378035:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.378036:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.378037:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.378037:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.378037:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.378038:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378038:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.378039:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.378039:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.378040:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.378040:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.378041:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.378041:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.378042:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.378042:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.378042:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378043:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.378043:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378044:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378044:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378045:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378045:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378045:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378046:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378046:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.378047:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378047:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378048:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378049:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.378050:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378050:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378051:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3822:0x0]  req@0000000044c7d4e4 x1858688799919040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378054:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378054:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000044c7d4e4 with x1858688799919040
00010000:00000001:24.0:1773851858.378055:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378055:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378059:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000004ccac279 refcount=3
00000020:00000001:24.0:1773851858.378060:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077646276096 : -106996063275520 : ffff9eb009a7f600)
00010000:00000001:24.0:1773851858.378060:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077646276096 : -106996063275520 : ffff9eb009a7f600)
00010000:00000001:24.0:1773851858.378061:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378061:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378062:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378062:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378063:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.378064:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000044c7d4e4 x1858688799919040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.378067:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000b814ffe2 x1858688799919040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.378070:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.378070:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.378071:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.378071:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378072:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3822:0x0]  req@0000000044c7d4e4 x1858688799919040/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378074:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378075:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000044c7d4e4 with x1858688799919040
00010000:00000001:24.0:1773851858.378075:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378076:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378076:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000004ccac279 refcount=3
00000020:00000001:24.0:1773851858.378077:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077646276096 : -106996063275520 : ffff9eb009a7f600)
00010000:00000001:24.0:1773851858.378078:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077646276096 : -106996063275520 : ffff9eb009a7f600)
00010000:00000001:24.0:1773851858.378078:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378079:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378079:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378080:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378080:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.378081:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378081:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.378082:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.378082:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.378083:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.378084:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.378084:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.378084:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.378085:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.378085:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.378086:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799919744
00000020:00000001:24.0:1773851858.378086:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.378087:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.378087:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378087:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.378088:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.378088:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.378089:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.378089:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.378090:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.378090:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378091:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.378092:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.378092:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.378093:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.378093:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.378093:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.378094:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.378094:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.378095:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.378095:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378096:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.378096:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378097:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378098:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378098:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378099:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378099:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378100:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378100:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.378100:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378101:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378102:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378102:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.378103:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378103:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378104:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3824:0x0]  req@00000000c3bf5870 x1858688799919744/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378107:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378107:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c3bf5870 with x1858688799919744
00010000:00000001:24.0:1773851858.378107:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378108:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378111:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000003635d4a refcount=3
00000020:00000001:24.0:1773851858.378112:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083710046784 : -106989999504832 : ffff9eb17315c240)
00010000:00000001:24.0:1773851858.378113:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083710046784 : -106989999504832 : ffff9eb17315c240)
00010000:00000001:24.0:1773851858.378113:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378113:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378114:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378114:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378115:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.378116:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000c3bf5870 x1858688799919744/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.378118:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000000f72c7ed x1858688799919744/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.378121:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.378122:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.378122:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.378123:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378123:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3824:0x0]  req@00000000c3bf5870 x1858688799919744/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378130:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378131:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c3bf5870 with x1858688799919744
00010000:00000001:24.0:1773851858.378131:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378132:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378132:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000003635d4a refcount=3
00000020:00000001:24.0:1773851858.378133:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083710046784 : -106989999504832 : ffff9eb17315c240)
00010000:00000001:24.0:1773851858.378133:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083710046784 : -106989999504832 : ffff9eb17315c240)
00010000:00000001:24.0:1773851858.378134:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378134:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378135:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378135:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378135:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.378136:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378136:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.378137:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.378137:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.378138:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.378139:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.378139:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.378139:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.378140:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.378140:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.378141:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799918656
00000020:00000001:24.0:1773851858.378141:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.378142:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.378142:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378143:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.378143:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.378144:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.378144:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.378145:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.378145:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.378146:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378147:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.378147:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.378148:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.378148:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.378148:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.378149:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.378149:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.378150:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.378150:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.378151:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378151:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.378151:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378152:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378152:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378153:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378153:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378153:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378154:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378154:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.378155:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378155:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378156:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378156:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.378157:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378157:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378158:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x363f:0x0]  req@00000000eded8182 x1858688799918656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378160:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378161:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000eded8182 with x1858688799918656
00010000:00000001:24.0:1773851858.378161:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378162:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378165:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e8927c06 refcount=3
00000020:00000001:24.0:1773851858.378166:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166168651840 : -106907540899776 : ffff9ec4a6003840)
00010000:00000001:24.0:1773851858.378167:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166168651840 : -106907540899776 : ffff9ec4a6003840)
00010000:00000001:24.0:1773851858.378168:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378169:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378169:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378169:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378170:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.378171:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000eded8182 x1858688799918656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.378173:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000fc86ea9d x1858688799918656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.378176:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.378176:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.378177:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.378177:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378178:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x363f:0x0]  req@00000000eded8182 x1858688799918656/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378181:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378181:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000eded8182 with x1858688799918656
00010000:00000001:24.0:1773851858.378182:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378182:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378182:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e8927c06 refcount=3
00000020:00000001:24.0:1773851858.378183:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166168651840 : -106907540899776 : ffff9ec4a6003840)
00010000:00000001:24.0:1773851858.378183:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166168651840 : -106907540899776 : ffff9ec4a6003840)
00010000:00000001:24.0:1773851858.378184:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378184:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378185:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378185:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378186:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.378186:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378186:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.378187:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.378188:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.378188:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.378189:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.378190:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.378190:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.378190:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.378191:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.378192:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799919360
00000020:00000001:24.0:1773851858.378192:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.378193:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.378193:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378194:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.378194:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.378195:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.378195:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.378196:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.378196:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.378197:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378198:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.378198:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.378199:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.378199:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.378199:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.378200:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.378200:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.378201:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.378201:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.378202:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378202:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.378203:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378203:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378203:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378204:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378204:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378205:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378205:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378206:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.378206:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378207:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378207:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378208:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.378208:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378209:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378209:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0xcbc9:0x0]  req@0000000009ebc5be x1858688799919360/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378215:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378216:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000009ebc5be with x1858688799919360
00010000:00000001:24.0:1773851858.378216:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378216:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378220:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000091f16d55 refcount=3
00000020:00000001:24.0:1773851858.378221:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131469818688 : -106942239732928 : ffff9ebc91ca0b40)
00010000:00000001:24.0:1773851858.378222:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637131469818688 : -106942239732928 : ffff9ebc91ca0b40)
00010000:00000001:24.0:1773851858.378223:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378223:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378223:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378224:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378224:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.378225:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000009ebc5be x1858688799919360/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.378228:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000112f0b32 x1858688799919360/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:602/0 lens 488/0 e 20 to 0 dl 1773851822 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.378230:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.378231:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.378231:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.378232:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378233:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002621b:0xcbc9:0x0]  req@0000000009ebc5be x1858688799919360/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378235:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378235:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000009ebc5be with x1858688799919360
00010000:00000001:24.0:1773851858.378236:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378236:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378237:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000091f16d55 refcount=3
00000020:00000001:24.0:1773851858.378237:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131469818688 : -106942239732928 : ffff9ebc91ca0b40)
00010000:00000001:24.0:1773851858.378238:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637131469818688 : -106942239732928 : ffff9ebc91ca0b40)
00010000:00000001:24.0:1773851858.378238:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378239:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378239:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378239:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378240:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.378240:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378241:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.378242:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.378242:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.378243:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.378244:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.378244:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.378244:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.378245:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.378245:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.378246:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799811584
00000020:00000001:24.0:1773851858.378247:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.378247:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.378247:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378248:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.378248:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.378249:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.378249:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.378250:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.378250:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.378251:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378251:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.378252:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.378252:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.378253:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.378253:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.378253:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.378254:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.378254:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.378255:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.378255:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378256:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.378256:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378257:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378257:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378258:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378259:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378259:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378260:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378260:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.378261:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378261:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378262:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378262:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.378263:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378263:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378264:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3825:0x0]  req@0000000082285c8f x1858688799811584/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378267:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378267:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000082285c8f with x1858688799811584
00010000:00000001:24.0:1773851858.378268:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378268:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378271:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008ba4c4cb refcount=3
00000020:00000001:24.0:1773851858.378272:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133311638144 : -106940397913472 : ffff9ebcff91fa80)
00010000:00000001:24.0:1773851858.378272:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133311638144 : -106940397913472 : ffff9ebcff91fa80)
00010000:00000001:24.0:1773851858.378273:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378274:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378274:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378274:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378275:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.378276:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000082285c8f x1858688799811584/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.378279:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000912051f2 x1858688799811584/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:587/0 lens 488/448 e 21 to 0 dl 1773851822 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.378281:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.378282:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.378283:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.378283:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378283:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3825:0x0]  req@0000000082285c8f x1858688799811584/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378286:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378286:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000082285c8f with x1858688799811584
00010000:00000001:24.0:1773851858.378287:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378298:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378298:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008ba4c4cb refcount=3
00000020:00000001:24.0:1773851858.378299:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133311638144 : -106940397913472 : ffff9ebcff91fa80)
00010000:00000001:24.0:1773851858.378299:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637133311638144 : -106940397913472 : ffff9ebcff91fa80)
00010000:00000001:24.0:1773851858.378300:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378300:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378300:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378301:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378301:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.378302:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378302:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.378303:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.378304:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.378304:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851858.378305:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851858.378305:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851858.378306:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851858.378306:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851858.378306:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851858.378307:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688799811456
00000020:00000001:24.0:1773851858.378308:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851858.378308:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:24.0:1773851858.378308:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378309:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:24.0:1773851858.378309:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:24.0:1773851858.378310:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:24.0:1773851858.378311:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.378311:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851858.378311:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000675bd0ea.
00000020:00000010:24.0:1773851858.378312:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378312:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851858.378313:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851858.378313:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851858.378314:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851858.378314:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.378315:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851858.378316:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.378316:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851858.378317:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851858.378317:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378317:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851858.378318:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851858.378318:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378319:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378319:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378319:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851858.378320:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851858.378320:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378321:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851858.378321:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378322:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.378322:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378323:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851858.378323:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851858.378324:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378324:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3821:0x0]  req@00000000888b438d x1858688799811456/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378327:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378327:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000888b438d with x1858688799811456
00010000:00000001:24.0:1773851858.378328:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378328:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378333:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000795f4f04 refcount=3
00000020:00000001:24.0:1773851858.378334:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083806134080 : -106989903417536 : ffff9eb178cfef40)
00010000:00000001:24.0:1773851858.378335:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083806134080 : -106989903417536 : ffff9eb178cfef40)
00010000:00000001:24.0:1773851858.378335:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378336:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378336:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378336:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378337:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851858.378338:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000888b438d x1858688799811456/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00000100:00080000:24.1:1773851858.378341:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000ae4c19b9 x1858688799811456/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:587/0 lens 488/448 e 21 to 0 dl 1773851822 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833579752824634368'
00000100:00000001:24.0:1773851858.378343:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851858.378344:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851858.378345:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851858.378345:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851858.378346:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x24002899f:0x3821:0x0]  req@00000000888b438d x1858688799811456/t0(0) o4->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:343/0 lens 488/0 e 0 to 0 dl 1773852458 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833579752824634368'
00002000:00000001:24.0:1773851858.378348:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851858.378349:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000888b438d with x1858688799811456
00010000:00000001:24.0:1773851858.378349:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851858.378350:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851858.378350:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000795f4f04 refcount=3
00000020:00000001:24.0:1773851858.378351:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083806134080 : -106989903417536 : ffff9eb178cfef40)
00010000:00000001:24.0:1773851858.378351:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083806134080 : -106989903417536 : ffff9eb178cfef40)
00010000:00000001:24.0:1773851858.378352:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851858.378352:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851858.378353:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851858.378353:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.378353:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.378354:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851858.378354:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:24.0:1773851858.378355:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000675bd0ea.
00000020:00000040:24.0:1773851858.378355:0:61830:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:24.0:1773851858.378356:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851858.384687:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.384688:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851858.384689:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851858.384691:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851858.384693:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24001@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.384694:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24001@kfi7 : PUT - for me
00000400:00000200:9.0:1773851858.384695:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24001@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.384697:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000063cdd39 nid 24001@kfi7 refs 1
00000400:00000200:9.0:1773851858.384698:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24001@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.384698:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000063cdd39 nid 24001@kfi7 refs 2
00000400:00000200:9.0:1773851858.384699:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000063cdd39 nid 24001@kfi7 refs 3
00000400:00000200:9.0:1773851858.384700:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24000@kfi7 to cpt 7
00000400:00000200:9.0:1773851858.384701:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24000@kfi7 of length 224 into portal 12 MB=0x699e167492340
00000400:00000200:9.0:1773851858.384702:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24000@kfi7 of length 224/224 into md 0x78146ce49 [64] + 124784
00000800:00000200:9.0:1773851858.384704:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851858.384706:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851858.384707:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24001@kfi7: PUT: OK
00000100:00000001:9.0:1773851858.384708:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851858.384708:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851858.384709:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c4edb33f.
00000100:00000040:9.0:1773851858.384710:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c4edb33f x1858043239801664 msgsize 224
00000100:00100000:9.0:1773851858.384711:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24000@kfi7 (source: 12345-24001@kfi7)
00000100:00000001:9.0:1773851858.384712:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851858.384713:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000063cdd39 nid 24001@kfi7 refs 2
00000100:00000001:10.0:1773851858.384714:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851858.384714:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851858.384715:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851858.384715:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851858.384715:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:10.0:1773851858.384716:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851858.384717:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043239801664
00000020:00000001:10.0:1773851858.384718:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851858.384718:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c69
00000020:00000001:10.0:1773851858.384719:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851858.384722:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eccf522f refcount=6
00000020:00000001:10.0:1773851858.384723:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743936000 : -107128965615616 : ffff9e91180f3000)
00000020:00000001:10.0:1773851858.384724:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743936000 : -107128965615616 : ffff9e91180f3000)
00000100:00000001:10.0:1773851858.384729:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.384730:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851858.384731:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bad2aa93.
00000020:00000010:10.0:1773851858.384733:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851858.384733:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851858.384734:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851858.384734:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851858.384735:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.384736:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851858.384737:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851858.384737:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.384738:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.384739:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851858.384740:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851858.384740:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851858.384741:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851858.384741:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24000@kfi7, seq: 2130737
00000100:00000001:11.0:1773851858.384742:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851858.384742:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.384742:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eccf522f : new rpc_count 1
00000100:00000001:10.0:1773851858.384743:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064870656 : -106983644680960 : ffff9eb2eddcad00)
00000100:00000040:10.0:1773851858.384744:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c4edb33f x1858043239801664/t0(0) o400->9c4a2896-ce03-458d-80e1-20f0aa0e1999@24000@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1987-0'
00000100:00000001:10.0:1773851858.384746:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.384747:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851858.384748:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c4edb33f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9c4a2896-ce03-458d-80e1-20f0aa0e1999+6:39663:x1858043239801664:12345-24000@kfi7:400:default-tuolumne1987-0
00000100:00000200:10.0:1773851858.384749:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043239801664
00000020:00000001:10.0:1773851858.384750:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851858.384750:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851858.384751:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.384752:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851858.384752:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851858.384753:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851858.384754:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043239801664, found 0 last_xid 1858043239801663
00000020:00000001:10.0:1773851858.384755:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851858.384756:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851858.384756:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851858.384757:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.384757:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851858.384758:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851858.384759:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851858.384759:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000efbe3c36.
02000000:00000001:10.0:1773851858.384760:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.384761:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.384761:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851858.384762:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915841555, transno 0, xid 1858043239801664
00010000:00000001:10.0:1773851858.384763:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851858.384764:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c4edb33f x1858043239801664/t0(0) o400->9c4a2896-ce03-458d-80e1-20f0aa0e1999@24000@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1987-0'
00010000:00000001:10.0:1773851858.384766:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851858.384767:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851858.384768:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=91 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851858.384769:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851858.384770:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000050af399d refcount 3 to 24000@kfi7
00000100:00000001:10.0:1773851858.384770:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603211712 : -107155106339904 : ffff9e8b01f363c0)
02000000:00000001:10.0:1773851858.384771:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851858.384772:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.384772:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851858.384773:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24001@kfi7
00000400:00000010:10.0:1773851858.384774:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000053a50d5b.
00000100:00000200:10.0:1773851858.384774:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043239801664, offset 224
00000400:00000200:10.0:1773851858.384776:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24001@kfi7
00000400:00000200:10.0:1773851858.384777:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24001@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.384777:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000063cdd39 nid 24001@kfi7 refs 1
00000400:00000200:10.0:1773851858.384778:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000063cdd39 nid 24001@kfi7 refs 2
00000400:00000200:10.0:1773851858.384780:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000063cdd39 nid 24001@kfi7 refs 3
00000400:00000200:10.0:1773851858.384781:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24001@kfi7 local destination
00000400:00000200:10.0:1773851858.384782:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768781:8768781:1024:4294967295] 24001@kfi7 LPNI seq info [691188:691188:16:4294967295]
00000400:00000200:10.0:1773851858.384783:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000063cdd39 nid 24001@kfi7 refs 2
00000400:00000200:10.0:1773851858.384784:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24001@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.384786:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24001@kfi7(24001@kfi7:24001@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851858.384788:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000063cdd39 nid 24001@kfi7 refs 3
00000800:00000200:10.0:1773851858.384789:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851858.384790:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851858.384792:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851858.384794:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de2 Using peer 24001@kfi7(0x100000000000de2)
00000800:00000200:10.0:1773851858.384798:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000003858ee31: Posted send of 324 bytes to peer 0x100000000000de2: rc=0
00000800:00000200:10.0:1773851858.384799:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851858.384801:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.384802:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000050af399d refcount 2 to 24000@kfi7
00010000:00000001:10.0:1773851858.384803:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851858.384803:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.384804:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851858.384805:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c4edb33f x1858043239801664/t0(0) o400->9c4a2896-ce03-458d-80e1-20f0aa0e1999@24000@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1987-0'
00000100:00100000:10.0:1773851858.384808:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c4edb33f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9c4a2896-ce03-458d-80e1-20f0aa0e1999+6:39663:x1858043239801664:12345-24000@kfi7:400:default-tuolumne1987-0 Request processed in 60us (97us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851858.384810:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24000@kfi7, seq: 2130737
00000100:00000040:10.0:1773851858.384811:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eccf522f : new rpc_count 0
00000800:00000200:9.0:1773851858.384811:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de2 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851858.384812:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851858.384812:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851858.384813:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000400:00000200:9.0:1773851858.384813:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851858.384814:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:10.0:1773851858.384814:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bad2aa93.
00000400:00000200:9.0:1773851858.384814:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24001@kfi7: PUT: OK
00000020:00000040:10.0:1773851858.384815:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000eccf522f : new refcount 5
00000400:00000200:9.0:1773851858.384815:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000053a50d5b
00000400:00000010:9.0:1773851858.384815:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000053a50d5b.
00000100:00000001:9.0:1773851858.384816:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851858.384817:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851858.384817:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000063cdd39 nid 24001@kfi7 refs 2
00000100:00000001:10.0:1773851858.384819:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851858.384819:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 24001@kfi7(000000001447f4cd):0x0 lsk 3555 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de2 Transaction freed
00000800:00000200:9.0:1773851858.388157:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.388159:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851858.388160:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851858.388162:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.388162:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9874@kfi7(0000000039a9143d):0xd2c version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851858.388163:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851858.388163:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d2c Using peer 9874@kfi7(0x100000000000d2c)
00000800:00000200:10.0:1773851858.388164:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851858.388165:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000800:00000200:10.0:1773851858.388166:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851858.388167:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004481c792: Posted send of 38 bytes to peer 0x100000000000d2c: rc=0
00000400:00000200:10.0:1773851858.388168:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000800:00000200:9.0:1773851858.388168:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d2c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851858.388170:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9874@kfi7 : PUT - for me
00000400:00000200:10.0:1773851858.388170:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.388171:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b387838f nid 9874@kfi7 refs 1
00000400:00000200:10.0:1773851858.388172:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9874@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.388173:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b387838f nid 9874@kfi7 refs 2
00000400:00000200:10.0:1773851858.388174:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b387838f nid 9874@kfi7 refs 3
00000400:00000200:10.0:1773851858.388174:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9811@kfi7 to cpt 1
00000400:00000200:10.0:1773851858.388175:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9811@kfi7 of length 392 into portal 23 MB=0x69a77b5cd4a00
00000400:00000200:10.0:1773851858.388176:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-9811@kfi7 of length 392/392 into md 0x78166cd09 [2] + 1176
00000800:00000200:10.0:1773851858.388178:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851858.388180:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851858.388180:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d2c TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851858.388181:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9874@kfi7: PUT: OK
00000100:00000001:10.0:1773851858.388182:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851858.388182:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000800:00000200:9.0:1773851858.388182:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d2c Transaction freed
00000100:00000010:10.0:1773851858.388183:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f2d41e54.
00000100:00000040:10.0:1773851858.388183:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000f2d41e54 x1858688802179584 msgsize 392
00000100:00100000:10.0:1773851858.388185:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-9811@kfi7 (source: 12345-9874@kfi7)
00000100:00000001:10.0:1773851858.388186:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851858.388187:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b387838f nid 9874@kfi7 refs 2
00000800:00000200:10.0:1773851858.388188:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 9874@kfi7(0000000039a9143d):0x0 lsk 3373 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851858.388188:0:60519:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851858.388188:0:60519:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851858.388188:0:60519:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851858.388189:0:60519:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851858.388189:0:60519:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851858.388190:0:60519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858688802179584
00000020:00000001:8.0:1773851858.388190:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851858.388191:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91620
00000020:00000001:8.0:1773851858.388191:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851858.388192:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3e651d4 refcount=674
00000020:00000001:8.0:1773851858.388192:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000020:00000001:8.0:1773851858.388193:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241255936 : -107152468295680 : ffff9e8b9f30c000)
00000100:00000001:8.0:1773851858.388194:0:60519:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851858.388194:0:60519:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851858.388195:0:60519:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025dffd82.
00000020:00000010:8.0:1773851858.388196:0:60519:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851858.388197:0:60519:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851858.388197:0:60519:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851858.388198:0:60519:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851858.388198:0:60519:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:8.1:1773851858.388201:0:60519:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000f2d41e54 x1858688802179584/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:313/0 lens 392/0 e 0 to 0 dl 1773852428 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00080000:8.1:1773851858.388204:0:60519:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000001956661c x1858688802179584/t0(0) o35->ea8b823a-0ad5-4ef7-b41e-0ccc7f0556cb@9811@kfi7:468/0 lens 392/0 e 1 to 0 dl 1773851792 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:8.0:1773851858.388207:0:60519:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:8.0:1773851858.388207:0:60519:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:8.0:1773851858.388208:0:60519:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851858.388209:0:60519:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851858.388209:0:60519:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851858.388210:0:60519:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851858.388210:0:60519:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025dffd82.
00000020:00000040:8.0:1773851858.388211:0:60519:0:(genops.c:882:class_export_put()) PUTting export 00000000c3e651d4 : new refcount 673
00000100:00000001:8.0:1773851858.388212:0:60519:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851858.389289:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851858.389290:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851858.389291:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851858.389293:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851858.389295:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.389296:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22081@kfi7 : PUT - for me
00000400:00000200:30.0:1773851858.389297:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.389298:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 1
00000400:00000200:30.0:1773851858.389300:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.389301:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000400:00000200:30.0:1773851858.389302:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 3
00000400:00000200:30.0:1773851858.389303:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.389303:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22081@kfi7 of length 224 into portal 12 MB=0x699e0febf8940
00000400:00000200:30.0:1773851858.389305:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22081@kfi7 of length 224/224 into md 0x77fe139dd [64] + 165600
00000800:00000200:30.0:1773851858.389307:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851858.389309:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851858.389310:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22081@kfi7: PUT: OK
00000100:00000001:30.0:1773851858.389311:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851858.389311:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851858.389312:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005aaa3402.
00000100:00000040:30.0:1773851858.389313:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000005aaa3402 x1858041485953344 msgsize 224
00000100:00100000:30.0:1773851858.389314:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-22081@kfi7 (source: 12345-22081@kfi7)
00000100:00000001:30.0:1773851858.389315:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851858.389316:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000100:00000001:31.0:1773851858.389317:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851858.389318:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851858.389318:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851858.389318:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851858.389319:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851858.389319:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851858.389320:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041485953344
00000020:00000001:31.0:1773851858.389321:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851858.389321:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9299f
00000020:00000001:31.0:1773851858.389322:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851858.389325:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000017282155 refcount=6
00000020:00000001:31.0:1773851858.389325:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743191552 : -107128966360064 : ffff9e911803d400)
00000020:00000001:31.0:1773851858.389326:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743191552 : -107128966360064 : ffff9e911803d400)
00000100:00000001:31.0:1773851858.389327:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.389328:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851858.389328:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ee5136e.
00000020:00000010:31.0:1773851858.389329:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.389330:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851858.389331:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851858.389332:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851858.389332:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.389333:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851858.389334:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851858.389334:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.389335:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.389336:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851858.389337:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851858.389338:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22081@kfi7, seq: 2055477
00000100:00000001:28.0:1773851858.389338:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851858.389338:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851858.389339:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000017282155 : new rpc_count 1
00000100:00000001:31.0:1773851858.389340:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832803840 : -106933876747776 : ffff9ebe84431200)
00000100:00000001:28.0:1773851858.389340:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.389341:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005aaa3402 x1858041485953344/t0(0) o400->6e72f25a-084c-4639-bb1d-812ef8b57e86@22081@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1876-0'
00000100:00000001:28.0:1773851858.389341:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.389343:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.389344:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851858.389345:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005aaa3402 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6e72f25a-084c-4639-bb1d-812ef8b57e86+6:39619:x1858041485953344:12345-22081@kfi7:400:default-tuolumne1876-0
00000100:00000200:31.0:1773851858.389346:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041485953344
00000020:00000001:31.0:1773851858.389347:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851858.389347:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851858.389348:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.389349:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851858.389349:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851858.389350:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851858.389351:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041485953344, found 0 last_xid 1858041485953343
00000020:00000001:31.0:1773851858.389352:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851858.389352:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851858.389353:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851858.389353:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.389354:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851858.389354:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851858.389355:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851858.389356:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000309a702a.
02000000:00000001:31.0:1773851858.389356:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.389357:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.389358:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851858.389358:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252845152, transno 0, xid 1858041485953344
00010000:00000001:31.0:1773851858.389360:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851858.389360:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005aaa3402 x1858041485953344/t0(0) o400->6e72f25a-084c-4639-bb1d-812ef8b57e86@22081@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1876-0'
00010000:00000001:31.0:1773851858.389363:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851858.389364:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851858.389365:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=91 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851858.389366:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851858.389367:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e7b1e045 refcount 3 to 22081@kfi7
00000100:00000001:31.0:1773851858.389368:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603213152 : -107155106338464 : ffff9e8b01f36960)
02000000:00000001:31.0:1773851858.389369:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851858.389369:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.389370:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851858.389371:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22081@kfi7
00000400:00000010:31.0:1773851858.389371:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018a1fff7.
00000100:00000200:31.0:1773851858.389372:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041485953344, offset 224
00000400:00000200:31.0:1773851858.389373:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22081@kfi7
00000400:00000200:31.0:1773851858.389374:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.389375:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 1
00000400:00000200:31.0:1773851858.389376:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000400:00000200:31.0:1773851858.389377:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 3
00000400:00000200:31.0:1773851858.389378:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22081@kfi7 local destination
00000400:00000200:31.0:1773851858.389379:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768782:8768782:1024:4294967295] 22081@kfi7 LPNI seq info [297783:297783:16:4294967295]
00000400:00000200:31.0:1773851858.389381:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000400:00000200:31.0:1773851858.389381:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.389383:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22081@kfi7(22081@kfi7:22081@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851858.389385:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 3
00000800:00000200:31.0:1773851858.389386:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851858.389387:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851858.389389:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851858.389391:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x97c Using peer 22081@kfi7(0x97c)
00000800:00000200:31.0:1773851858.389394:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x97c: rc=0
00000800:00000200:31.0:1773851858.389396:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x97c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851858.389399:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.389400:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e7b1e045 refcount 2 to 22081@kfi7
00010000:00000001:31.0:1773851858.389401:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851858.389402:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.389402:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851858.389403:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005aaa3402 x1858041485953344/t0(0) o400->6e72f25a-084c-4639-bb1d-812ef8b57e86@22081@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1876-0'
00000100:00100000:31.0:1773851858.389406:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005aaa3402 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6e72f25a-084c-4639-bb1d-812ef8b57e86+6:39619:x1858041485953344:12345-22081@kfi7:400:default-tuolumne1876-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851858.389409:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22081@kfi7, seq: 2055477
00000100:00000040:31.0:1773851858.389409:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000017282155 : new rpc_count 0
00000800:00000200:29.0:1773851858.389409:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x97c TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851858.389410:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851858.389411:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851858.389411:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851858.389411:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851858.389412:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000200:29.0:1773851858.389412:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22081@kfi7: PUT: OK
00000400:00000200:29.0:1773851858.389412:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018a1fff7
00000020:00000010:31.0:1773851858.389413:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ee5136e.
00000020:00000040:31.0:1773851858.389413:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000017282155 : new refcount 5
00000400:00000010:29.0:1773851858.389413:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018a1fff7.
00000100:00000001:29.0:1773851858.389413:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851858.389414:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851858.389414:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851858.389415:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000800:00000200:29.0:1773851858.389416:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 22081@kfi7(00000000700433df):0x0 lsk 2429 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x97c Transaction freed
00000800:00000200:5.0:1773851858.396304:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.396305:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851858.396307:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851858.396309:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851858.396311:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23744@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.396312:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23744@kfi7 : PUT - for me
00000400:00000200:5.0:1773851858.396313:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23744@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.396314:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 1
00000400:00000200:5.0:1773851858.396315:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23744@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.396315:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 2
00000400:00000200:5.0:1773851858.396316:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 3
00000400:00000200:5.0:1773851858.396317:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23553@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.396318:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23553@kfi7 of length 224 into portal 12 MB=0x69b4b99dd7300
00000400:00000200:5.0:1773851858.396320:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23553@kfi7 of length 224/224 into md 0x793926dc5 [64] + 121832
00000800:00000200:5.0:1773851858.396322:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851858.396323:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851858.396324:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23744@kfi7: PUT: OK
00000100:00000001:5.0:1773851858.396325:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851858.396326:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851858.396327:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc13a529.
00000100:00000040:5.0:1773851858.396327:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000bc13a529 x1859598866543360 msgsize 224
00000100:00100000:5.0:1773851858.396329:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23553@kfi7 (source: 12345-23744@kfi7)
00000100:00000001:5.0:1773851858.396330:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851858.396331:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 2
00000800:00000200:5.0:1773851858.396332:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851858.396335:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851858.396335:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.396336:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851858.396336:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851858.396338:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851858.396338:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598866543360
00000020:00000001:5.0:1773851858.396339:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851858.396339:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38916e2f
00000020:00000001:5.0:1773851858.396340:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.396341:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de45296a refcount=5
00000020:00000001:5.0:1773851858.396342:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636927659769856 : -107146049781760 : ffff9e8d1dc38000)
00000020:00000001:5.0:1773851858.396343:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636927659769856 : -107146049781760 : ffff9e8d1dc38000)
00000100:00000001:5.0:1773851858.396344:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.396345:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851858.396345:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851858.396347:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.396347:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851858.396348:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.396349:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851858.396349:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.396350:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851858.396351:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851858.396351:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.396352:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.396353:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851858.396354:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851858.396354:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851858.396354:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851858.396355:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23553@kfi7, seq: 2001867
00000100:00000001:7.0:1773851858.396356:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.396356:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de45296a : new rpc_count 1
00000100:00000001:5.0:1773851858.396356:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866942208 : -107088842609408 : ffff9e9a6f93ad00)
00000100:00000001:7.0:1773851858.396357:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.396358:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc13a529 x1859598866543360/t0(0) o400->66a91a18-897a-406d-a651-5a89531c47c0@23553@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1971-0'
00000100:00000001:5.0:1773851858.396360:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.396361:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851858.396362:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc13a529 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:66a91a18-897a-406d-a651-5a89531c47c0+5:39616:x1859598866543360:12345-23553@kfi7:400:default-tuolumne1971-0
00000100:00000200:5.0:1773851858.396363:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598866543360
00000020:00000001:5.0:1773851858.396364:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851858.396365:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851858.396366:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.396366:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851858.396367:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851858.396368:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851858.396368:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598866543360, found 0 last_xid 1859598866543359
00000020:00000001:5.0:1773851858.396369:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851858.396370:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851858.396370:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851858.396371:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.396372:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851858.396372:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851858.396373:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851858.396373:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e6b8036f.
02000000:00000001:5.0:1773851858.396374:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.396375:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.396375:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851858.396376:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425191860, transno 0, xid 1859598866543360
00010000:00000001:5.0:1773851858.396377:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851858.396378:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc13a529 x1859598866543360/t0(0) o400->66a91a18-897a-406d-a651-5a89531c47c0@23553@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1971-0'
00010000:00000001:5.0:1773851858.396380:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851858.396381:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851858.396382:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=90 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851858.396383:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851858.396383:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a8a35b63 refcount 3 to 23553@kfi7
00000100:00000001:5.0:1773851858.396384:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701920 : -107156155849696 : ffff9e8ac3652420)
02000000:00000001:5.0:1773851858.396385:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851858.396386:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.396386:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851858.396387:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23744@kfi7
00000400:00000010:5.0:1773851858.396388:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d24f1d0e.
00000100:00000200:5.0:1773851858.396389:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598866543360, offset 224
00000400:00000200:5.0:1773851858.396390:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23744@kfi7
00000400:00000200:5.0:1773851858.396391:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23744@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.396392:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 1
00000400:00000200:5.0:1773851858.396393:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 2
00000400:00000200:5.0:1773851858.396394:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 3
00000400:00000200:5.0:1773851858.396395:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23744@kfi7 local destination
00000400:00000200:5.0:1773851858.396397:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768783:8768783:1024:4294967295] 23744@kfi7 LPNI seq info [8177527:8177527:16:4294967295]
00000400:00000200:5.0:1773851858.396398:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 2
00000400:00000200:5.0:1773851858.396399:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23744@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.396401:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23744@kfi7(23744@kfi7:23744@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851858.396402:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 3
00000800:00000200:5.0:1773851858.396403:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.396404:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851858.396406:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851858.396408:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001202 Using peer 23744@kfi7(0x100000000001202)
00000800:00000200:5.0:1773851858.396411:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x100000000001202: rc=0
00000800:00000200:5.0:1773851858.396413:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851858.396415:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.396415:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a8a35b63 refcount 2 to 23553@kfi7
00010000:00000001:5.0:1773851858.396416:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851858.396417:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.396417:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851858.396418:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc13a529 x1859598866543360/t0(0) o400->66a91a18-897a-406d-a651-5a89531c47c0@23553@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1971-0'
00000100:00100000:5.0:1773851858.396421:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc13a529 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:66a91a18-897a-406d-a651-5a89531c47c0+5:39616:x1859598866543360:12345-23553@kfi7:400:default-tuolumne1971-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851858.396423:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23553@kfi7, seq: 2001867
00000100:00000040:5.0:1773851858.396425:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de45296a : new rpc_count 0
00000100:00000001:5.0:1773851858.396425:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:6.0:1773851858.396426:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001202 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851858.396426:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851858.396427:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851858.396427:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.396427:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000400:00000200:6.0:1773851858.396428:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23744@kfi7: PUT: OK
00000020:00000010:5.0:1773851858.396428:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000400:00000200:6.0:1773851858.396429:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d24f1d0e
00000020:00000040:5.0:1773851858.396429:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000de45296a : new refcount 4
00000400:00000010:6.0:1773851858.396430:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d24f1d0e.
00000100:00000001:5.0:1773851858.396430:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851858.396431:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851858.396431:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851858.396432:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b39b1ae1 nid 23744@kfi7 refs 2
00000800:00000200:6.0:1773851858.396434:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 23744@kfi7(000000007f93bdc4):0x0 lsk 4611 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001202 Transaction freed
00000800:00000200:21.0:1773851858.415980:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.415981:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.415982:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.415983:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851858.415986:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17360@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.415988:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17360@kfi7 : PUT - for me
00000400:00000200:21.0:1773851858.415989:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17360@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.415989:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028cf873f nid 17360@kfi7 refs 1
00000400:00000200:21.0:1773851858.415990:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17360@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.415991:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028cf873f nid 17360@kfi7 refs 2
00000400:00000200:21.0:1773851858.415992:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000028cf873f nid 17360@kfi7 refs 3
00000400:00000200:21.0:1773851858.415992:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17360@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.415993:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17360@kfi7 of length 224 into portal 12 MB=0x69b61fd570940
00000400:00000200:21.0:1773851858.415994:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17360@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 26280
00000800:00000200:21.0:1773851858.415996:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851858.415997:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.415998:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17360@kfi7: PUT: OK
00000100:00000001:21.0:1773851858.415999:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.415999:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851858.416000:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eba4945b.
00000100:00000040:21.0:1773851858.416001:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000eba4945b x1859695024736576 msgsize 224
00000100:00100000:21.0:1773851858.416002:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17360@kfi7 (source: 12345-17360@kfi7)
00000100:00000001:21.0:1773851858.416003:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851858.416004:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000028cf873f nid 17360@kfi7 refs 2
00000800:00000200:21.0:1773851858.416005:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851858.416006:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851858.416007:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851858.416007:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851858.416008:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851858.416009:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851858.416011:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859695024736576
00000020:00000001:23.0:1773851858.416012:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851858.416012:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f081566e1a3d
00000020:00000001:23.0:1773851858.416013:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851858.416017:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d82940d9 refcount=169
00000020:00000001:23.0:1773851858.416019:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161778101248 : -106911931450368 : ffff9ec3a04dbc00)
00000020:00000001:23.0:1773851858.416020:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161778101248 : -106911931450368 : ffff9ec3a04dbc00)
00000100:00000001:23.0:1773851858.416022:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.416023:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851858.416025:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000170cfdb.
00000020:00000010:23.0:1773851858.416026:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.416028:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851858.416029:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851858.416030:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851858.416031:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.416032:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851858.416033:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851858.416034:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.416036:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.416038:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851858.416039:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851858.416039:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851858.416039:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851858.416040:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17360@kfi7, seq: 1997936
00000100:00000040:23.0:1773851858.416042:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d82940d9 : new rpc_count 1
00000100:00000001:22.0:1773851858.416042:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.416043:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117329024 : -106995592222592 : ffff9eb025bba880)
00000100:00000001:22.0:1773851858.416043:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.416045:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eba4945b x1859695024736576/t0(0) o400->6910f24b-1325-4279-a645-3cfc980f087a@17360@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1569-0'
00000100:00000001:23.0:1773851858.416050:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.416051:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851858.416052:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eba4945b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:6910f24b-1325-4279-a645-3cfc980f087a+169:39619:x1859695024736576:12345-17360@kfi7:400:default-tuolumne1569-0
00000100:00000200:23.0:1773851858.416054:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859695024736576
00000020:00000001:23.0:1773851858.416055:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851858.416056:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851858.416057:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.416058:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851858.416059:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851858.416060:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851858.416061:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859695024736576, found 0 last_xid 1859695024311679
00000020:00000001:23.0:1773851858.416063:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851858.416064:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851858.416065:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851858.416065:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.416066:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851858.416067:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851858.416068:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851858.416070:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001239a533.
02000000:00000001:23.0:1773851858.416071:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.416072:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.416073:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851858.416074:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062519, transno 0, xid 1859695024736576
00010000:00000001:23.0:1773851858.416076:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851858.416077:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eba4945b x1859695024736576/t0(0) o400->6910f24b-1325-4279-a645-3cfc980f087a@17360@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1569-0'
00010000:00000001:23.0:1773851858.416082:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851858.416083:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851858.416084:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=91 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851858.416086:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851858.416087:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006570ccb3 refcount 3 to 17360@kfi7
00000100:00000001:23.0:1773851858.416088:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096416 : -107139307455200 : ffff9e8eafa33d20)
02000000:00000001:23.0:1773851858.416089:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851858.416090:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.416091:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851858.416093:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17360@kfi7
00000400:00000010:23.0:1773851858.416093:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000598e4ceb.
00000100:00000200:23.0:1773851858.416095:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859695024736576, offset 224
00000400:00000200:23.0:1773851858.416097:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17360@kfi7
00000400:00000200:23.0:1773851858.416099:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17360@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.416100:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028cf873f nid 17360@kfi7 refs 1
00000400:00000200:23.0:1773851858.416102:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000028cf873f nid 17360@kfi7 refs 2
00000400:00000200:23.0:1773851858.416103:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000028cf873f nid 17360@kfi7 refs 3
00000400:00000200:23.0:1773851858.416105:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17360@kfi7 local destination
00000400:00000200:23.0:1773851858.416107:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768784:8768784:1024:4294967295] 17360@kfi7 LPNI seq info [7186150:7186150:16:4294967295]
00000400:00000200:23.0:1773851858.416110:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000028cf873f nid 17360@kfi7 refs 2
00000400:00000200:23.0:1773851858.416111:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17360@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.416115:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17360@kfi7(17360@kfi7:17360@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851858.416117:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000028cf873f nid 17360@kfi7 refs 3
00000800:00000200:23.0:1773851858.416119:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851858.416121:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851858.416125:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851858.416132:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x69e Using peer 17360@kfi7(0x69e)
00000800:00000200:23.0:1773851858.416137:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0x69e: rc=0
00000800:00000200:23.0:1773851858.416139:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x69e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851858.416143:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.416144:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006570ccb3 refcount 2 to 17360@kfi7
00010000:00000001:23.0:1773851858.416145:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851858.416146:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.416147:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851858.416148:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eba4945b x1859695024736576/t0(0) o400->6910f24b-1325-4279-a645-3cfc980f087a@17360@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1569-0'
00000800:00000200:21.0:1773851858.416152:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x69e TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851858.416153:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eba4945b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:6910f24b-1325-4279-a645-3cfc980f087a+169:39619:x1859695024736576:12345-17360@kfi7:400:default-tuolumne1569-0 Request processed in 102us (151us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851858.416153:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.416154:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17360@kfi7: PUT: OK
00000400:00000200:21.0:1773851858.416155:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000598e4ceb
00000400:00000010:21.0:1773851858.416155:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000598e4ceb.
00000100:00000001:21.0:1773851858.416156:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851858.416156:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:23.0:1773851858.416157:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17360@kfi7, seq: 1997936
00000400:00000200:21.0:1773851858.416157:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000028cf873f nid 17360@kfi7 refs 2
00000100:00000040:23.0:1773851858.416158:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d82940d9 : new rpc_count 0
00000100:00000001:23.0:1773851858.416159:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851858.416159:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 17360@kfi7(000000007552d7ab):0x0 lsk 1695 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x69e Transaction freed
00000100:00000001:23.0:1773851858.416160:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851858.416161:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.416162:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851858.416163:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000170cfdb.
00000020:00000040:23.0:1773851858.416165:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000d82940d9 : new refcount 168
00000100:00000001:23.0:1773851858.416166:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851858.455333:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851858.455334:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851858.455335:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851858.455337:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851858.455338:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21970@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.455339:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21970@kfi7 : PUT - for me
00000400:00000200:17.0:1773851858.455340:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21970@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.455341:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009854c579 nid 21970@kfi7 refs 1
00000400:00000200:17.0:1773851858.455342:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21970@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.455342:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009854c579 nid 21970@kfi7 refs 2
00000400:00000200:17.0:1773851858.455343:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009854c579 nid 21970@kfi7 refs 3
00000400:00000200:17.0:1773851858.455344:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21971@kfi7 to cpt 7
00000400:00000200:17.0:1773851858.455344:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21971@kfi7 of length 224 into portal 12 MB=0x69b4b97461980
00000400:00000200:17.0:1773851858.455345:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21971@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 193440
00000800:00000200:17.0:1773851858.455347:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851858.455348:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851858.455349:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21970@kfi7: PUT: OK
00000100:00000001:17.0:1773851858.455350:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851858.455350:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851858.455351:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed106d04.
00000100:00000040:17.0:1773851858.455351:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ed106d04 x1859598823070080 msgsize 224
00000100:00100000:17.0:1773851858.455353:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21971@kfi7 (source: 12345-21970@kfi7)
00000100:00000001:17.0:1773851858.455354:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851858.455354:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009854c579 nid 21970@kfi7 refs 2
00000100:00000001:19.0:1773851858.455355:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851858.455356:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851858.455356:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851858.455357:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851858.455357:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851858.455358:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851858.455359:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598823070080
00000020:00000001:19.0:1773851858.455359:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851858.455360:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389513d6
00000020:00000001:19.0:1773851858.455360:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851858.455361:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000019fe091e refcount=5
00000020:00000001:19.0:1773851858.455362:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157787781120 : -106915921770496 : ffff9ec2b2764800)
00000020:00000001:19.0:1773851858.455363:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157787781120 : -106915921770496 : ffff9ec2b2764800)
00000100:00000001:19.0:1773851858.455364:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.455365:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851858.455365:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851858.455366:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.455367:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851858.455368:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851858.455368:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851858.455369:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.455369:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851858.455370:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851858.455370:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.455371:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.455372:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851858.455372:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851858.455373:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851858.455373:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851858.455374:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21971@kfi7, seq: 2156276
00000100:00000040:19.0:1773851858.455374:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000019fe091e : new rpc_count 1
00000100:00000001:19.0:1773851858.455375:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764357504 : -107095945194112 : ffff9e98c83ad580)
00000100:00000001:18.0:1773851858.455375:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851858.455375:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.455376:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed106d04 x1859598823070080/t0(0) o400->d6cb457f-2138-44df-8653-86251cd4f40b@21971@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1861-0'
00000100:00000001:19.0:1773851858.455379:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.455379:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851858.455380:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed106d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:d6cb457f-2138-44df-8653-86251cd4f40b+5:39563:x1859598823070080:12345-21971@kfi7:400:default-tuolumne1861-0
00000100:00000200:19.0:1773851858.455381:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598823070080
00000020:00000001:19.0:1773851858.455382:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851858.455383:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851858.455383:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.455384:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851858.455385:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851858.455385:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851858.455386:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598823070080, found 0 last_xid 1859598823070079
00000020:00000001:19.0:1773851858.455387:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851858.455387:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851858.455388:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851858.455388:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.455389:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851858.455389:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851858.455390:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851858.455390:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004ce58a87.
02000000:00000001:19.0:1773851858.455391:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.455391:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.455392:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851858.455393:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262822632, transno 0, xid 1859598823070080
00010000:00000001:19.0:1773851858.455393:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851858.455394:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed106d04 x1859598823070080/t0(0) o400->d6cb457f-2138-44df-8653-86251cd4f40b@21971@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1861-0'
00010000:00000001:19.0:1773851858.455396:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851858.455397:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851858.455397:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=91 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851858.455398:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851858.455399:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008b6cd8bb refcount 3 to 21971@kfi7
00000100:00000001:19.0:1773851858.455400:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271488 : -107152618280128 : ffff9e8b96402b40)
02000000:00000001:19.0:1773851858.455401:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851858.455401:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.455402:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851858.455403:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21970@kfi7
00000400:00000010:19.0:1773851858.455403:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ff06d06d.
00000100:00000200:19.0:1773851858.455404:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598823070080, offset 224
00000400:00000200:19.0:1773851858.455405:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21970@kfi7
00000400:00000200:19.0:1773851858.455407:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21970@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.455407:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009854c579 nid 21970@kfi7 refs 1
00000400:00000200:19.0:1773851858.455409:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009854c579 nid 21970@kfi7 refs 2
00000400:00000200:19.0:1773851858.455410:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009854c579 nid 21970@kfi7 refs 3
00000400:00000200:19.0:1773851858.455411:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21970@kfi7 local destination
00000400:00000200:19.0:1773851858.455412:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768785:8768785:1024:4294967295] 21970@kfi7 LPNI seq info [300081:300081:16:4294967295]
00000400:00000200:19.0:1773851858.455413:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009854c579 nid 21970@kfi7 refs 2
00000400:00000200:19.0:1773851858.455414:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21970@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.455416:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21970@kfi7(21970@kfi7:21970@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851858.455417:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009854c579 nid 21970@kfi7 refs 3
00000800:00000200:19.0:1773851858.455418:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851858.455419:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851858.455421:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851858.455423:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa1c Using peer 21970@kfi7(0xa1c)
00000800:00000200:19.0:1773851858.455426:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0xa1c: rc=0
00000800:00000200:19.0:1773851858.455428:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa1c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851858.455430:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.455430:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008b6cd8bb refcount 2 to 21971@kfi7
00010000:00000001:19.0:1773851858.455431:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851858.455431:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.455432:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851858.455433:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed106d04 x1859598823070080/t0(0) o400->d6cb457f-2138-44df-8653-86251cd4f40b@21971@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1861-0'
00000100:00100000:19.0:1773851858.455436:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed106d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:d6cb457f-2138-44df-8653-86251cd4f40b+5:39563:x1859598823070080:12345-21971@kfi7:400:default-tuolumne1861-0 Request processed in 56us (83us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851858.455438:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21971@kfi7, seq: 2156276
00000100:00000040:19.0:1773851858.455439:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000019fe091e : new rpc_count 0
00000100:00000001:19.0:1773851858.455439:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851858.455439:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa1c TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851858.455440:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851858.455440:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.455441:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000020:00000010:19.0:1773851858.455442:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000020:00000040:19.0:1773851858.455442:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000019fe091e : new refcount 4
00000400:00000200:17.0:1773851858.455442:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851858.455443:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851858.455443:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21970@kfi7: PUT: OK
00000400:00000200:17.0:1773851858.455443:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ff06d06d
00000400:00000010:17.0:1773851858.455444:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ff06d06d.
00000100:00000001:17.0:1773851858.455444:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851858.455445:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851858.455445:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009854c579 nid 21970@kfi7 refs 2
00000800:00000200:17.0:1773851858.455447:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21970@kfi7(00000000235ad52b):0x0 lsk 2589 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa1c Transaction freed
00000800:00000200:3.0:1773851858.488683:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851858.488684:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851858.488685:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851858.488687:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851858.488689:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21618@kfi7 to cpt 0
00000400:00000200:3.0:1773851858.488690:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21618@kfi7 : PUT - for me
00000400:00000200:3.0:1773851858.488691:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21618@kfi7 to cpt 0
00000400:00000200:3.0:1773851858.488692:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003792048b nid 21618@kfi7 refs 1
00000400:00000200:3.0:1773851858.488693:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21618@kfi7 to cpt 0
00000400:00000200:3.0:1773851858.488693:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003792048b nid 21618@kfi7 refs 2
00000400:00000200:3.0:1773851858.488694:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003792048b nid 21618@kfi7 refs 3
00000400:00000200:3.0:1773851858.488695:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21682@kfi7 to cpt 4
00000400:00000200:3.0:1773851858.488697:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21682@kfi7 of length 224 into portal 12 MB=0x69b09a17892c0
00000400:00000200:3.0:1773851858.488698:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21682@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 16928
00000800:00000200:3.0:1773851858.488700:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851858.488701:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851858.488702:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21618@kfi7: PUT: OK
00000100:00000001:3.0:1773851858.488703:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851858.488704:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851858.488704:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c7b7d093.
00000100:00000040:3.0:1773851858.488705:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000c7b7d093 x1859315526308544 msgsize 224
00000100:00100000:3.0:1773851858.488707:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-21682@kfi7 (source: 12345-21618@kfi7)
00000100:00000001:3.0:1773851858.488708:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851858.488708:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003792048b nid 21618@kfi7 refs 2
00000100:00000001:0.0:1773851858.488709:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:3.0:1773851858.488710:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851858.488710:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851858.488710:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851858.488711:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851858.488711:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851858.488712:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315526308544
00000020:00000001:0.0:1773851858.488713:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851858.488713:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92edf
00000020:00000001:0.0:1773851858.488714:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851858.488715:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006cf3a6e refcount=4366
00000020:00000001:0.0:1773851858.488716:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744669184 : -107128964882432 : ffff9e91181a6000)
00000020:00000001:0.0:1773851858.488717:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744669184 : -107128964882432 : ffff9e91181a6000)
00000100:00000001:0.0:1773851858.488718:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.488718:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851858.488719:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000071766212.
00000020:00000010:0.0:1773851858.488720:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.488721:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851858.488722:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851858.488722:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851858.488723:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.488724:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851858.488728:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851858.488728:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.488729:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851858.488731:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851858.488731:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851858.488731:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851858.488731:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851858.488732:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21682@kfi7, seq: 1997508
00000100:00000001:1.0:1773851858.488733:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.488733:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006cf3a6e : new rpc_count 11
00000100:00000001:1.0:1773851858.488734:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.488734:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288727808 : -106964420823808 : ffff9eb767b17500)
00000100:00000040:0.0:1773851858.488736:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c7b7d093 x1859315526308544/t0(0) o400->c777fae8-84bf-407b-a2cc-2efec5d3519b@21682@kfi7:498/0 lens 224/0 e 0 to 0 dl 1773852613 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1834-0'
00000100:00000001:0.0:1773851858.488738:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.488739:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851858.488740:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7b7d093 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c777fae8-84bf-407b-a2cc-2efec5d3519b+4366:39556:x1859315526308544:12345-21682@kfi7:400:default-tuolumne1834-0
00000100:00000200:0.0:1773851858.488741:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315526308544
00000020:00000001:0.0:1773851858.488741:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851858.488742:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851858.488743:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.488743:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851858.488744:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851858.488745:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851858.488745:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315526308544, found 0 last_xid 1859315525546175
00000020:00000001:0.0:1773851858.488746:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851858.488747:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851858.488747:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851858.488748:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.488748:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851858.488749:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851858.488749:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851858.488750:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000748874a.
02000000:00000001:0.0:1773851858.488751:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.488751:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.488752:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851858.488753:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593877, transno 0, xid 1859315526308544
00010000:00000001:0.0:1773851858.488753:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851858.488754:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c7b7d093 x1859315526308544/t0(0) o400->c777fae8-84bf-407b-a2cc-2efec5d3519b@21682@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1834-0'
00010000:00000001:0.0:1773851858.488756:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851858.488757:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851858.488758:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=91 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851858.488759:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851858.488760:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000046554fec refcount 3 to 21682@kfi7
00000100:00000001:0.0:1773851858.488761:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960800 : -107156125590816 : ffff9e8ac532dae0)
02000000:00000001:0.0:1773851858.488762:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851858.488762:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.488763:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851858.488764:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21618@kfi7
00000400:00000010:0.0:1773851858.488764:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000485e1abd.
00000100:00000200:0.0:1773851858.488765:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315526308544, offset 224
00000400:00000200:0.0:1773851858.488767:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21618@kfi7
00000400:00000200:0.0:1773851858.488767:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21618@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.488768:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003792048b nid 21618@kfi7 refs 1
00000400:00000200:0.0:1773851858.488770:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003792048b nid 21618@kfi7 refs 2
00000400:00000200:0.0:1773851858.488771:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003792048b nid 21618@kfi7 refs 3
00000400:00000200:0.0:1773851858.488772:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21618@kfi7 local destination
00000400:00000200:0.0:1773851858.488773:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768786:8768786:1024:4294967295] 21618@kfi7 LPNI seq info [12616729:12616729:16:4294967295]
00000400:00000200:0.0:1773851858.488774:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003792048b nid 21618@kfi7 refs 2
00000400:00000200:0.0:1773851858.488775:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21618@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.488777:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21618@kfi7(21618@kfi7:21618@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851858.488778:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003792048b nid 21618@kfi7 refs 3
00000800:00000200:0.0:1773851858.488780:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851858.488781:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851858.488783:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851858.488785:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005f2 Using peer 21618@kfi7(0x1000000000005f2)
00000800:00000200:0.0:1773851858.488788:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x1000000000005f2: rc=0
00000800:00000200:0.0:1773851858.488789:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005f2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851858.488795:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.488796:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000046554fec refcount 2 to 21682@kfi7
00010000:00000001:0.0:1773851858.488798:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851858.488799:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.488799:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851858.488800:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c7b7d093 x1859315526308544/t0(0) o400->c777fae8-84bf-407b-a2cc-2efec5d3519b@21682@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1834-0'
00000100:00100000:0.0:1773851858.488803:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7b7d093 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c777fae8-84bf-407b-a2cc-2efec5d3519b+4366:39556:x1859315526308544:12345-21682@kfi7:400:default-tuolumne1834-0 Request processed in 64us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851858.488805:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21682@kfi7, seq: 1997508
00000100:00000040:0.0:1773851858.488806:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006cf3a6e : new rpc_count 10
00000100:00000001:0.0:1773851858.488807:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851858.488807:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851858.488808:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.488809:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851858.488809:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000071766212.
00000020:00000040:0.0:1773851858.488810:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000006cf3a6e : new refcount 4365
00000100:00000001:0.0:1773851858.488811:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851858.488817:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005f2 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851858.488819:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.488820:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21618@kfi7: PUT: OK
00000400:00000200:1.0:1773851858.488821:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000485e1abd
00000400:00000010:1.0:1773851858.488821:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000485e1abd.
00000100:00000001:1.0:1773851858.488822:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851858.488823:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851858.488824:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003792048b nid 21618@kfi7 refs 2
00000800:00000200:1.0:1773851858.488825:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 21618@kfi7(0000000024a928ce):0x0 lsk 1523 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005f2 Transaction freed
00000800:00000200:9.0:1773851858.491534:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.491535:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851858.491537:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851858.491540:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851858.491543:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19697@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.491545:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19697@kfi7 : PUT - for me
00000400:00000200:9.0:1773851858.491547:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19697@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.491548:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6d8101e nid 19697@kfi7 refs 1
00000400:00000200:9.0:1773851858.491550:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19697@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.491551:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6d8101e nid 19697@kfi7 refs 2
00000400:00000200:9.0:1773851858.491552:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b6d8101e nid 19697@kfi7 refs 3
00000400:00000200:9.0:1773851858.491554:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19696@kfi7 to cpt 7
00000400:00000200:9.0:1773851858.491555:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19696@kfi7 of length 224 into portal 12 MB=0x699e17154c000
00000400:00000200:9.0:1773851858.491557:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19696@kfi7 of length 224/224 into md 0x78146ce49 [64] + 125008
00000800:00000200:9.0:1773851858.491561:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851858.491563:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851858.491565:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19697@kfi7: PUT: OK
00000100:00000001:9.0:1773851858.491567:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851858.491567:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851858.491569:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000de40edea.
00000100:00000040:9.0:1773851858.491570:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000de40edea x1858043408334848 msgsize 224
00000100:00100000:9.0:1773851858.491572:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-19696@kfi7 (source: 12345-19697@kfi7)
00000100:00000001:9.0:1773851858.491574:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851858.491575:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6d8101e nid 19697@kfi7 refs 2
00000100:00000001:10.0:1773851858.491576:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851858.491577:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851858.491577:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851858.491578:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851858.491579:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851858.491580:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851858.491582:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043408334848
00000020:00000001:10.0:1773851858.491583:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851858.491583:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9193e
00000020:00000001:10.0:1773851858.491584:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851858.491588:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e50b2f1d refcount=6
00000020:00000001:10.0:1773851858.491589:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241965568 : -107152467586048 : ffff9e8b9f3b9400)
00000020:00000001:10.0:1773851858.491591:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241965568 : -107152467586048 : ffff9e8b9f3b9400)
00000100:00000001:10.0:1773851858.491592:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.491593:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851858.491594:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bad2aa93.
00000020:00000010:10.0:1773851858.491596:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851858.491597:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851858.491599:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851858.491599:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851858.491600:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.491602:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851858.491603:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851858.491604:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.491605:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.491607:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851858.491608:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851858.491608:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851858.491608:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851858.491610:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19696@kfi7, seq: 2130738
00000100:00000001:11.0:1773851858.491611:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.491611:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e50b2f1d : new rpc_count 1
00000100:00000001:11.0:1773851858.491612:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.491612:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064874112 : -106983644677504 : ffff9eb2eddcba80)
00000100:00000040:10.0:1773851858.491614:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000de40edea x1858043408334848/t0(0) o400->aca0001b-6649-43b4-b2f9-888ac2dbfe8f@19696@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1709-0'
00000100:00000001:10.0:1773851858.491618:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.491619:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851858.491621:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de40edea pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:aca0001b-6649-43b4-b2f9-888ac2dbfe8f+6:39625:x1858043408334848:12345-19696@kfi7:400:default-tuolumne1709-0
00000100:00000200:10.0:1773851858.491623:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043408334848
00000020:00000001:10.0:1773851858.491624:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851858.491625:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851858.491626:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.491627:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851858.491628:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851858.491629:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851858.491630:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043408334848, found 0 last_xid 1858043408334847
00000020:00000001:10.0:1773851858.491631:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851858.491632:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851858.491633:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851858.491634:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.491635:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851858.491636:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851858.491637:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851858.491638:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c63adb84.
02000000:00000001:10.0:1773851858.491639:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.491640:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.491641:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851858.491642:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691409, transno 0, xid 1858043408334848
00010000:00000001:10.0:1773851858.491644:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851858.491645:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000de40edea x1858043408334848/t0(0) o400->aca0001b-6649-43b4-b2f9-888ac2dbfe8f@19696@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1709-0'
00010000:00000001:10.0:1773851858.491649:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851858.491650:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851858.491651:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=91 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851858.491653:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851858.491654:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000012c45661 refcount 3 to 19696@kfi7
00000100:00000001:10.0:1773851858.491655:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921099508352 : -107152610043264 : ffff9e8b96bdda80)
02000000:00000001:10.0:1773851858.491656:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851858.491657:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.491658:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851858.491659:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19697@kfi7
00000400:00000010:10.0:1773851858.491660:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dea1ff36.
00000100:00000200:10.0:1773851858.491662:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043408334848, offset 224
00000400:00000200:10.0:1773851858.491664:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19697@kfi7
00000400:00000200:10.0:1773851858.491666:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19697@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.491667:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6d8101e nid 19697@kfi7 refs 1
00000400:00000200:10.0:1773851858.491669:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b6d8101e nid 19697@kfi7 refs 2
00000400:00000200:10.0:1773851858.491671:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b6d8101e nid 19697@kfi7 refs 3
00000400:00000200:10.0:1773851858.491672:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19697@kfi7 local destination
00000400:00000200:10.0:1773851858.491675:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768787:8768787:1024:4294967295] 19697@kfi7 LPNI seq info [3727202:3727202:16:4294967295]
00000400:00000200:10.0:1773851858.491677:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b6d8101e nid 19697@kfi7 refs 2
00000400:00000200:10.0:1773851858.491678:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19697@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.491681:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19697@kfi7(19697@kfi7:19697@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851858.491683:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b6d8101e nid 19697@kfi7 refs 3
00000800:00000200:10.0:1773851858.491686:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851858.491687:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851858.491691:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851858.491694:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa04 Using peer 19697@kfi7(0xa04)
00000800:00000200:10.0:1773851858.491699:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000333a7eb2: Posted send of 324 bytes to peer 0xa04: rc=0
00000800:00000200:10.0:1773851858.491702:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa04 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851858.491705:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.491706:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000012c45661 refcount 2 to 19696@kfi7
00010000:00000001:10.0:1773851858.491707:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851858.491708:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.491709:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851858.491711:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000de40edea x1858043408334848/t0(0) o400->aca0001b-6649-43b4-b2f9-888ac2dbfe8f@19696@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1709-0'
00000100:00100000:10.0:1773851858.491715:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de40edea pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:aca0001b-6649-43b4-b2f9-888ac2dbfe8f+6:39625:x1858043408334848:12345-19696@kfi7:400:default-tuolumne1709-0 Request processed in 96us (145us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851858.491715:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa04 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851858.491718:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:10.0:1773851858.491719:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19696@kfi7, seq: 2130738
00000400:00000200:9.0:1773851858.491719:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19697@kfi7: PUT: OK
00000100:00000040:10.0:1773851858.491721:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e50b2f1d : new rpc_count 0
00000400:00000200:9.0:1773851858.491721:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dea1ff36
00000400:00000010:9.0:1773851858.491721:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dea1ff36.
00000100:00000001:10.0:1773851858.491722:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851858.491722:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851858.491722:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:10.0:1773851858.491723:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000100:00000001:9.0:1773851858.491723:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:10.0:1773851858.491729:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:10.0:1773851858.491730:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bad2aa93.
00000400:00000200:9.0:1773851858.491730:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6d8101e nid 19697@kfi7 refs 2
00000020:00000040:10.0:1773851858.491731:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000e50b2f1d : new refcount 5
00000100:00000001:10.0:1773851858.491732:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851858.491732:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 19697@kfi7(0000000083fb4d25):0x0 lsk 2565 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa04 Transaction freed
00000800:00000200:9.0:1773851858.592870:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.592871:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851858.592872:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851858.592875:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13555@kfi7(00000000e06e6071):0x8fc version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851858.592876:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc Using peer 13555@kfi7(0x8fc)
00000400:00000200:9.0:1773851858.592878:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13555@kfi7 to cpt 2
00000800:00000200:9.0:1773851858.592880:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 38 bytes to peer 0x8fc: rc=0
00000800:00000200:9.0:1773851858.592881:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851858.592893:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851858.592896:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc Transaction freed
00000800:00000200:9.0:1773851858.592910:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.592910:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851858.592911:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851858.592913:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851858.592915:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13555@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.592916:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13555@kfi7 : PUT - for me
00000400:00000200:9.0:1773851858.592917:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13555@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.592918:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1e5f84d nid 13555@kfi7 refs 1
00000400:00000200:9.0:1773851858.592919:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13555@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.592920:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1e5f84d nid 13555@kfi7 refs 2
00000400:00000200:9.0:1773851858.592921:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c1e5f84d nid 13555@kfi7 refs 3
00000400:00000200:9.0:1773851858.592921:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13555@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.592922:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13555@kfi7 of length 224 into portal 12 MB=0x699e1ab13a380
00000400:00000200:9.0:1773851858.592923:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13555@kfi7 of length 224/224 into md 0x78146ce49 [64] + 125232
00000800:00000200:9.0:1773851858.592925:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851858.592926:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851858.592927:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13555@kfi7: PUT: OK
00000100:00000001:9.0:1773851858.592928:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851858.592928:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851858.592929:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ef7cbe1f.
00000100:00000040:9.0:1773851858.592929:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ef7cbe1f x1858044377146240 msgsize 224
00000100:00100000:9.0:1773851858.592931:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13555@kfi7 (source: 12345-13555@kfi7)
00000100:00000001:9.0:1773851858.592932:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:10.0:1773851858.592933:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851858.592933:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1e5f84d nid 13555@kfi7 refs 2
02000000:00000001:10.0:1773851858.592934:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851858.592934:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851858.592934:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851858.592934:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:10.0:1773851858.592935:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851858.592935:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044377146240
00000020:00000001:10.0:1773851858.592936:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851858.592936:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92998
00000020:00000001:10.0:1773851858.592937:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851858.592939:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000950dd8bd refcount=6
00000020:00000001:10.0:1773851858.592939:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743198720 : -107128966352896 : ffff9e911803f000)
00000020:00000001:10.0:1773851858.592940:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743198720 : -107128966352896 : ffff9e911803f000)
00000100:00000001:10.0:1773851858.592941:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.592942:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851858.592942:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000776bdb17.
00000020:00000010:10.0:1773851858.592943:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851858.592943:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851858.592944:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851858.592945:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851858.592945:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.592946:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851858.592946:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851858.592947:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.592947:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.592948:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851858.592949:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851858.592950:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:10.0:1773851858.592950:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13555@kfi7, seq: 2130739
00000100:00000001:11.0:1773851858.592951:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851858.592951:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.592951:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000950dd8bd : new rpc_count 1
00000100:00000001:10.0:1773851858.592951:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064876416 : -106983644675200 : ffff9eb2eddcc380)
00000100:00000001:11.0:1773851858.592952:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.592952:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ef7cbe1f x1858044377146240/t0(0) o400->da39f84a-3177-4f25-8b5b-444b223df97b@13555@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1321-0'
00000100:00000001:10.0:1773851858.592955:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.592955:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851858.592956:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef7cbe1f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:da39f84a-3177-4f25-8b5b-444b223df97b+6:39781:x1858044377146240:12345-13555@kfi7:400:default-tuolumne1321-0
00000100:00000200:10.0:1773851858.592957:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044377146240
00000020:00000001:10.0:1773851858.592958:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851858.592958:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851858.592959:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.592959:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851858.592960:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851858.592960:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851858.592961:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044377146240, found 0 last_xid 1858044377146239
00000020:00000001:10.0:1773851858.592961:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851858.592962:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851858.592963:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851858.592963:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.592963:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851858.592964:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851858.592964:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851858.592965:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bad2aa93.
02000000:00000001:10.0:1773851858.592965:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.592966:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.592966:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851858.592967:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693095, transno 0, xid 1858044377146240
00010000:00000001:10.0:1773851858.592967:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851858.592968:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ef7cbe1f x1858044377146240/t0(0) o400->da39f84a-3177-4f25-8b5b-444b223df97b@13555@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1321-0'
00010000:00000001:10.0:1773851858.592970:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851858.592971:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851858.592972:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=91 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851858.592973:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851858.592974:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000df653db1 refcount 3 to 13555@kfi7
00000100:00000001:10.0:1773851858.592974:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134080 : -107146658417536 : ffff9e8cf97c7480)
02000000:00000001:10.0:1773851858.592975:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851858.592975:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.592976:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851858.592977:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13555@kfi7
00000400:00000010:10.0:1773851858.592977:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008746fc24.
00000100:00000200:10.0:1773851858.592978:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044377146240, offset 224
00000400:00000200:10.0:1773851858.592979:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13555@kfi7
00000400:00000200:10.0:1773851858.592980:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13555@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.592981:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1e5f84d nid 13555@kfi7 refs 1
00000400:00000200:10.0:1773851858.592982:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c1e5f84d nid 13555@kfi7 refs 2
00000400:00000200:10.0:1773851858.592983:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c1e5f84d nid 13555@kfi7 refs 3
00000400:00000200:10.0:1773851858.592984:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13555@kfi7 local destination
00000400:00000200:10.0:1773851858.592985:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768788:8768788:1024:4294967295] 13555@kfi7 LPNI seq info [1293523:1293523:16:4294967295]
00000400:00000200:10.0:1773851858.592987:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c1e5f84d nid 13555@kfi7 refs 2
00000400:00000200:10.0:1773851858.592987:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13555@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.592989:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13555@kfi7(13555@kfi7:13555@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851858.592990:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c1e5f84d nid 13555@kfi7 refs 3
00000800:00000200:10.0:1773851858.592992:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851858.592992:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851858.592994:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851858.592997:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc Using peer 13555@kfi7(0x8fc)
00000800:00000200:10.0:1773851858.592999:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000333a7eb2: Posted send of 324 bytes to peer 0x8fc: rc=0
00000800:00000200:10.0:1773851858.593000:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851858.593003:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.593004:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000df653db1 refcount 2 to 13555@kfi7
00010000:00000001:10.0:1773851858.593005:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851858.593005:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.593006:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851858.593006:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ef7cbe1f x1858044377146240/t0(0) o400->da39f84a-3177-4f25-8b5b-444b223df97b@13555@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1321-0'
00000100:00100000:10.0:1773851858.593009:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef7cbe1f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:da39f84a-3177-4f25-8b5b-444b223df97b+6:39781:x1858044377146240:12345-13555@kfi7:400:default-tuolumne1321-0 Request processed in 53us (79us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851858.593012:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13555@kfi7, seq: 2130739
00000100:00000040:10.0:1773851858.593013:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000950dd8bd : new rpc_count 0
00000100:00000001:10.0:1773851858.593013:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851858.593013:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851858.593014:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851858.593014:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851858.593014:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000400:00000200:9.0:1773851858.593014:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851858.593015:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000776bdb17.
00000020:00000040:10.0:1773851858.593016:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000950dd8bd : new refcount 5
00000100:00000001:10.0:1773851858.593016:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851858.593016:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13555@kfi7: PUT: OK
00000400:00000200:9.0:1773851858.593016:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008746fc24
00000400:00000010:9.0:1773851858.593017:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008746fc24.
00000100:00000001:9.0:1773851858.593017:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851858.593017:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851858.593018:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1e5f84d nid 13555@kfi7 refs 2
00000800:00000200:9.0:1773851858.593019:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 13555@kfi7(00000000e06e6071):0x0 lsk 2301 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8fc Transaction freed
00000800:00000200:2.0:1773851858.617283:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851858.617284:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851858.617286:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851858.617288:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851858.617290:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17552@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.617291:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17552@kfi7 : PUT - for me
00000400:00000200:2.0:1773851858.617292:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17552@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.617293:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fe5ef3e nid 17552@kfi7 refs 1
00000400:00000200:2.0:1773851858.617295:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17552@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.617295:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fe5ef3e nid 17552@kfi7 refs 2
00000400:00000200:2.0:1773851858.617297:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000fe5ef3e nid 17552@kfi7 refs 3
00000400:00000200:2.0:1773851858.617298:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17488@kfi7 to cpt 4
00000400:00000200:2.0:1773851858.617299:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17488@kfi7 of length 224 into portal 12 MB=0x69b0a02c65ec0
00000400:00000200:2.0:1773851858.617301:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17488@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 17152
00000800:00000200:2.0:1773851858.617303:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851858.617304:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851858.617306:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17552@kfi7: PUT: OK
00000100:00000001:2.0:1773851858.617307:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851858.617307:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851858.617308:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006bedebf9.
00000100:00000040:2.0:1773851858.617309:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000006bedebf9 x1859317158796992 msgsize 224
00000100:00100000:2.0:1773851858.617310:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-17488@kfi7 (source: 12345-17552@kfi7)
00000100:00000001:2.0:1773851858.617311:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851858.617312:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000fe5ef3e nid 17552@kfi7 refs 2
00000100:00000001:0.0:1773851858.617312:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851858.617313:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851858.617313:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:2.0:1773851858.617314:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851858.617314:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851858.617315:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851858.617315:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317158796992
00000020:00000001:0.0:1773851858.617316:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851858.617316:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d89
00000020:00000001:0.0:1773851858.617317:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851858.617320:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001f49c5f2 refcount=168
00000020:00000001:0.0:1773851858.617320:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628521984 : -107123081029632 : ffff9e9276ced800)
00000020:00000001:0.0:1773851858.617321:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628521984 : -107123081029632 : ffff9e9276ced800)
00000100:00000001:0.0:1773851858.617322:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.617323:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851858.617324:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001431d72e.
00000020:00000010:0.0:1773851858.617325:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.617326:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851858.617327:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851858.617327:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851858.617328:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.617328:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851858.617329:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851858.617329:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.617330:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.617331:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851858.617332:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851858.617333:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851858.617333:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17488@kfi7, seq: 1997509
00000100:00000001:1.0:1773851858.617334:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851858.617334:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001f49c5f2 : new rpc_count 1
00000100:00000001:0.0:1773851858.617334:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706798336 : -106953002753280 : ffff9eba10436300)
00000100:00000001:1.0:1773851858.617335:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.617335:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006bedebf9 x1859317158796992/t0(0) o400->bdd7fbfb-283a-4d60-8d79-9a7c56e7f020@17488@kfi7:498/0 lens 224/0 e 0 to 0 dl 1773852613 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1586-0'
00000100:00000001:1.0:1773851858.617336:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.617338:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.617338:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851858.617339:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006bedebf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bdd7fbfb-283a-4d60-8d79-9a7c56e7f020+168:39702:x1859317158796992:12345-17488@kfi7:400:default-tuolumne1586-0
00000100:00000200:0.0:1773851858.617340:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317158796992
00000020:00000001:0.0:1773851858.617341:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851858.617342:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851858.617342:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.617343:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851858.617343:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851858.617344:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851858.617345:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317158796992, found 0 last_xid 1859317158376895
00000020:00000001:0.0:1773851858.617345:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851858.617346:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851858.617347:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851858.617347:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.617349:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851858.617349:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851858.617350:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851858.617350:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000071766212.
02000000:00000001:0.0:1773851858.617351:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.617351:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.617352:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851858.617353:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061792, transno 0, xid 1859317158796992
00010000:00000001:0.0:1773851858.617354:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851858.617354:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006bedebf9 x1859317158796992/t0(0) o400->bdd7fbfb-283a-4d60-8d79-9a7c56e7f020@17488@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1586-0'
00010000:00000001:0.0:1773851858.617357:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851858.617357:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851858.617358:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=91 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851858.617359:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851858.617359:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e188c62 refcount 3 to 17488@kfi7
00000100:00000001:0.0:1773851858.617360:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959936 : -107156125591680 : ffff9e8ac532d780)
02000000:00000001:0.0:1773851858.617361:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851858.617361:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.617362:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851858.617363:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17552@kfi7
00000400:00000010:0.0:1773851858.617364:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024fe8e76.
00000100:00000200:0.0:1773851858.617364:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317158796992, offset 224
00000400:00000200:0.0:1773851858.617366:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17552@kfi7
00000400:00000200:0.0:1773851858.617367:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17552@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.617367:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fe5ef3e nid 17552@kfi7 refs 1
00000400:00000200:0.0:1773851858.617369:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000fe5ef3e nid 17552@kfi7 refs 2
00000400:00000200:0.0:1773851858.617370:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000fe5ef3e nid 17552@kfi7 refs 3
00000400:00000200:0.0:1773851858.617371:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17552@kfi7 local destination
00000400:00000200:0.0:1773851858.617373:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768789:8768789:1024:4294967295] 17552@kfi7 LPNI seq info [155951:155951:16:4294967295]
00000400:00000200:0.0:1773851858.617374:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000fe5ef3e nid 17552@kfi7 refs 2
00000400:00000200:0.0:1773851858.617375:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17552@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.617376:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17552@kfi7(17552@kfi7:17552@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851858.617378:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000fe5ef3e nid 17552@kfi7 refs 3
00000800:00000200:0.0:1773851858.617379:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851858.617380:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851858.617382:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851858.617385:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10bc Using peer 17552@kfi7(0x10bc)
00000800:00000200:0.0:1773851858.617388:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x10bc: rc=0
00000800:00000200:0.0:1773851858.617389:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851858.617391:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.617392:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e188c62 refcount 2 to 17488@kfi7
00010000:00000001:0.0:1773851858.617393:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851858.617393:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.617394:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851858.617394:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006bedebf9 x1859317158796992/t0(0) o400->bdd7fbfb-283a-4d60-8d79-9a7c56e7f020@17488@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1586-0'
00000100:00100000:0.0:1773851858.617399:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006bedebf9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bdd7fbfb-283a-4d60-8d79-9a7c56e7f020+168:39702:x1859317158796992:12345-17488@kfi7:400:default-tuolumne1586-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851858.617401:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17488@kfi7, seq: 1997509
00000100:00000040:0.0:1773851858.617402:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001f49c5f2 : new rpc_count 0
00000100:00000001:0.0:1773851858.617403:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851858.617403:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851858.617404:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.617405:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851858.617405:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001431d72e.
00000020:00000040:0.0:1773851858.617406:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000001f49c5f2 : new refcount 167
00000100:00000001:0.0:1773851858.617407:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851858.617412:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10bc TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851858.617413:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851858.617415:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17552@kfi7: PUT: OK
00000400:00000200:2.0:1773851858.617415:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024fe8e76
00000400:00000010:2.0:1773851858.617416:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024fe8e76.
00000100:00000001:2.0:1773851858.617417:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851858.617417:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851858.617418:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000fe5ef3e nid 17552@kfi7 refs 2
00000800:00000200:2.0:1773851858.617419:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 17552@kfi7(000000009f8d74a0):0x0 lsk 4285 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10bc Transaction freed
00000800:00000200:13.0:1773851858.626869:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.626870:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851858.626872:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851858.626874:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851858.626876:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26512@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.626877:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26512@kfi7 : PUT - for me
00000400:00000200:13.0:1773851858.626878:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26512@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.626879:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8472ad3 nid 26512@kfi7 refs 1
00000400:00000200:13.0:1773851858.626880:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26512@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.626881:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8472ad3 nid 26512@kfi7 refs 2
00000400:00000200:13.0:1773851858.626881:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e8472ad3 nid 26512@kfi7 refs 3
00000400:00000200:13.0:1773851858.626882:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26449@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.626883:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26449@kfi7 of length 224 into portal 12 MB=0x699e16f06b180
00000400:00000200:13.0:1773851858.626884:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26449@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 18824
00000800:00000200:13.0:1773851858.626886:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851858.626888:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851858.626889:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26512@kfi7: PUT: OK
00000100:00000001:13.0:1773851858.626890:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851858.626890:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851858.626891:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000598d5e3e.
00000100:00000040:13.0:1773851858.626891:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000598d5e3e x1858043369664896 msgsize 224
00000100:00100000:13.0:1773851858.626894:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-26449@kfi7 (source: 12345-26512@kfi7)
00000100:00000001:13.0:1773851858.626895:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851858.626897:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8472ad3 nid 26512@kfi7 refs 2
00000800:00000200:13.0:1773851858.626898:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851858.626901:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851858.626901:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851858.626902:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851858.626902:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851858.626903:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851858.626904:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043369664896
00000020:00000001:13.0:1773851858.626904:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851858.626905:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93013
00000020:00000001:13.0:1773851858.626906:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851858.626908:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dcf2d352 refcount=9
00000020:00000001:13.0:1773851858.626909:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744936448 : -107128964615168 : ffff9e91181e7400)
00000020:00000001:13.0:1773851858.626910:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744936448 : -107128964615168 : ffff9e91181e7400)
00000100:00000001:13.0:1773851858.626911:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.626912:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851858.626912:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851858.626913:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.626914:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851858.626915:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851858.626915:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851858.626916:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.626917:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851858.626917:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851858.626918:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.626918:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851858.626920:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.626920:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851858.626920:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851858.626920:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851858.626921:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26449@kfi7, seq: 2289790
00000100:00000001:15.0:1773851858.626922:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.626922:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dcf2d352 : new rpc_count 1
00000100:00000001:15.0:1773851858.626923:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.626923:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537171456 : -107002172380160 : ffff9eae9d866c00)
00000100:00000040:13.0:1773851858.626924:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000598d5e3e x1858043369664896/t0(0) o400->fba487a7-3727-470d-9aac-8534cd30ce7a@26449@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2146-0'
00000100:00000001:13.0:1773851858.626927:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.626927:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851858.626928:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000598d5e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:fba487a7-3727-470d-9aac-8534cd30ce7a+9:39847:x1858043369664896:12345-26449@kfi7:400:default-tuolumne2146-0
00000100:00000200:13.0:1773851858.626929:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043369664896
00000020:00000001:13.0:1773851858.626930:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851858.626930:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851858.626931:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.626932:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851858.626932:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851858.626933:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851858.626934:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043369664896, found 0 last_xid 1858043369664895
00000020:00000001:13.0:1773851858.626934:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851858.626935:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851858.626936:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851858.626936:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.626937:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851858.626938:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851858.626938:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851858.626939:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000034babcb.
02000000:00000001:13.0:1773851858.626940:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.626940:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.626941:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851858.626942:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183258141780, transno 0, xid 1858043369664896
00010000:00000001:13.0:1773851858.626943:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851858.626943:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000598d5e3e x1858043369664896/t0(0) o400->fba487a7-3727-470d-9aac-8534cd30ce7a@26449@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2146-0'
00010000:00000001:13.0:1773851858.626945:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851858.626946:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851858.626947:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=91 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851858.626948:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851858.626948:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000052507a9a refcount 3 to 26449@kfi7
00000100:00000001:13.0:1773851858.626949:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152704 : -107139310398912 : ffff9e8eaf765240)
02000000:00000001:13.0:1773851858.626950:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851858.626950:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.626951:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851858.626952:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26512@kfi7
00000400:00000010:13.0:1773851858.626953:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000449f1b53.
00000100:00000200:13.0:1773851858.626953:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043369664896, offset 224
00000400:00000200:13.0:1773851858.626955:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26512@kfi7
00000400:00000200:13.0:1773851858.626956:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26512@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.626957:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8472ad3 nid 26512@kfi7 refs 1
00000400:00000200:13.0:1773851858.626958:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e8472ad3 nid 26512@kfi7 refs 2
00000400:00000200:13.0:1773851858.626959:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e8472ad3 nid 26512@kfi7 refs 3
00000400:00000200:13.0:1773851858.626960:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26512@kfi7 local destination
00000400:00000200:13.0:1773851858.626961:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768790:8768790:1024:4294967295] 26512@kfi7 LPNI seq info [17147780:17147780:16:4294967295]
00000400:00000200:13.0:1773851858.626963:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e8472ad3 nid 26512@kfi7 refs 2
00000400:00000200:13.0:1773851858.626963:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26512@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.626965:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26512@kfi7(26512@kfi7:26512@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851858.626966:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e8472ad3 nid 26512@kfi7 refs 3
00000800:00000200:13.0:1773851858.626968:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.626969:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851858.626971:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851858.626973:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ca3 Using peer 26512@kfi7(0x100000000000ca3)
00000800:00000200:13.0:1773851858.626976:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 324 bytes to peer 0x100000000000ca3: rc=0
00000800:00000200:13.0:1773851858.626977:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ca3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851858.626979:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.626980:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000052507a9a refcount 2 to 26449@kfi7
00010000:00000001:13.0:1773851858.626981:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851858.626982:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.626983:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851858.626983:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000598d5e3e x1858043369664896/t0(0) o400->fba487a7-3727-470d-9aac-8534cd30ce7a@26449@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2146-0'
00000100:00100000:13.0:1773851858.626987:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000598d5e3e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:fba487a7-3727-470d-9aac-8534cd30ce7a+9:39847:x1858043369664896:12345-26449@kfi7:400:default-tuolumne2146-0 Request processed in 59us (94us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851858.626989:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26449@kfi7, seq: 2289790
00000800:00000200:14.0:1773851858.626990:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ca3 TN_EVENT_TX_OK event status 0
00000100:00000040:13.0:1773851858.626990:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dcf2d352 : new rpc_count 0
00000100:00000001:13.0:1773851858.626991:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851858.626992:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851858.626992:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851858.626992:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851858.626993:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26512@kfi7: PUT: OK
00000020:00000010:13.0:1773851858.626993:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000400:00000200:14.0:1773851858.626994:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000449f1b53
00000400:00000010:14.0:1773851858.626994:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000449f1b53.
00000020:00000010:13.0:1773851858.626994:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000100:00000001:14.0:1773851858.626995:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851858.626995:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:13.0:1773851858.626995:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000dcf2d352 : new refcount 8
00000100:00000001:13.0:1773851858.626995:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851858.626996:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8472ad3 nid 26512@kfi7 refs 2
00000800:00000200:14.0:1773851858.626998:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 26512@kfi7(0000000006a5025a):0x0 lsk 3236 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ca3 Transaction freed
00000800:00000200:30.0:1773851858.628050:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851858.628050:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851858.628051:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851858.628051:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851858.628052:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851858.628052:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851858.628054:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851858.628054:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10881@kfi7(000000001db68922):0x949 version: 2; local version 2; negotiated version: 2
00000400:00000200:30.0:1773851858.628056:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10881@kfi7 to cpt 7
00000800:00000200:29.0:1773851858.628056:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 Using peer 10881@kfi7(0x949)
00000400:00000200:30.0:1773851858.628057:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10881@kfi7 : PUT - for me
00000400:00000200:30.0:1773851858.628058:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10881@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.628058:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4b673da nid 10881@kfi7 refs 1
00000400:00000200:30.0:1773851858.628060:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10881@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.628060:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4b673da nid 10881@kfi7 refs 2
00000400:00000200:30.0:1773851858.628061:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e4b673da nid 10881@kfi7 refs 3
00000400:00000200:29.0:1773851858.628062:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10881@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.628063:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10881@kfi7 to cpt 7
00000400:00000200:30.0:1773851858.628064:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10881@kfi7 of length 224 into portal 12 MB=0x69b097e54a840
00000800:00000200:29.0:1773851858.628064:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 38 bytes to peer 0x949: rc=0
00000400:00000200:30.0:1773851858.628065:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10881@kfi7 of length 224/224 into md 0x77fe139dd [64] + 165824
00000800:00000200:29.0:1773851858.628066:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851858.628067:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851858.628068:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851858.628069:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10881@kfi7: PUT: OK
00000100:00000001:30.0:1773851858.628070:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851858.628071:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851858.628072:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004e39c75d.
00000100:00000040:30.0:1773851858.628072:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000004e39c75d x1859314936752192 msgsize 224
00000100:00100000:30.0:1773851858.628074:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-10881@kfi7 (source: 12345-10881@kfi7)
00000100:00000001:30.0:1773851858.628075:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851858.628075:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e4b673da nid 10881@kfi7 refs 2
00000100:00000001:31.0:1773851858.628076:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851858.628077:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851858.628077:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851858.628077:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851858.628078:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851858.628078:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851858.628078:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851858.628079:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314936752192
00000020:00000001:31.0:1773851858.628080:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851858.628080:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac921d4
00000800:00000200:29.0:1773851858.628080:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 Transaction freed
00000020:00000001:31.0:1773851858.628081:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851858.628085:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bb633da4 refcount=6
00000020:00000001:31.0:1773851858.628086:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629770240 : -107123079781376 : ffff9e9276e1e400)
00000020:00000001:31.0:1773851858.628087:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629770240 : -107123079781376 : ffff9e9276e1e400)
00000100:00000001:31.0:1773851858.628088:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.628092:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851858.628093:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e268637b.
00000020:00000010:31.0:1773851858.628094:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.628095:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851858.628096:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851858.628096:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851858.628097:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.628098:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851858.628098:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851858.628099:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.628100:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.628101:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851858.628101:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851858.628101:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851858.628101:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851858.628102:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10881@kfi7, seq: 2055478
00000100:00000040:31.0:1773851858.628103:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bb633da4 : new rpc_count 1
00000100:00000001:31.0:1773851858.628103:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832821120 : -106933876730496 : ffff9ebe84435580)
00000100:00000001:28.0:1773851858.628103:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851858.628104:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.628105:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004e39c75d x1859314936752192/t0(0) o400->8d41e6ad-689e-4f58-90e1-e1dc861eab93@10881@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1172-0'
00000100:00000001:31.0:1773851858.628108:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.628108:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851858.628109:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e39c75d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:8d41e6ad-689e-4f58-90e1-e1dc861eab93+6:39771:x1859314936752192:12345-10881@kfi7:400:default-tuolumne1172-0
00000100:00000200:31.0:1773851858.628110:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314936752192
00000020:00000001:31.0:1773851858.628111:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851858.628112:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851858.628112:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.628113:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851858.628114:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851858.628114:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851858.628115:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314936752192, found 0 last_xid 1859314936752191
00000020:00000001:31.0:1773851858.628115:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851858.628116:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851858.628117:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851858.628117:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.628118:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851858.628119:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851858.628119:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851858.628120:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006ee5136e.
02000000:00000001:31.0:1773851858.628121:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.628121:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.628122:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851858.628122:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035343807, transno 0, xid 1859314936752192
00010000:00000001:31.0:1773851858.628123:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851858.628124:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004e39c75d x1859314936752192/t0(0) o400->8d41e6ad-689e-4f58-90e1-e1dc861eab93@10881@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1172-0'
00010000:00000001:31.0:1773851858.628127:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851858.628127:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851858.628128:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=91 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851858.628129:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851858.628129:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000131c78c refcount 3 to 10881@kfi7
00000100:00000001:31.0:1773851858.628130:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882592 : -107156296669024 : ffff9e8abb0068a0)
02000000:00000001:31.0:1773851858.628131:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851858.628132:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.628133:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851858.628133:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10881@kfi7
00000400:00000010:31.0:1773851858.628134:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088e46351.
00000100:00000200:31.0:1773851858.628135:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314936752192, offset 224
00000400:00000200:31.0:1773851858.628136:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10881@kfi7
00000400:00000200:31.0:1773851858.628137:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10881@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.628137:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4b673da nid 10881@kfi7 refs 1
00000400:00000200:31.0:1773851858.628138:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e4b673da nid 10881@kfi7 refs 2
00000400:00000200:31.0:1773851858.628140:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e4b673da nid 10881@kfi7 refs 3
00000400:00000200:31.0:1773851858.628141:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10881@kfi7 local destination
00000400:00000200:31.0:1773851858.628142:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768791:8768791:1024:4294967295] 10881@kfi7 LPNI seq info [7137390:7137390:16:4294967295]
00000400:00000200:31.0:1773851858.628143:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e4b673da nid 10881@kfi7 refs 2
00000400:00000200:31.0:1773851858.628144:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10881@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.628146:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10881@kfi7(10881@kfi7:10881@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851858.628148:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e4b673da nid 10881@kfi7 refs 3
00000800:00000200:31.0:1773851858.628149:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851858.628150:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851858.628152:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851858.628154:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 Using peer 10881@kfi7(0x949)
00000800:00000200:31.0:1773851858.628157:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x949: rc=0
00000800:00000200:31.0:1773851858.628158:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851858.628160:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.628161:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000131c78c refcount 2 to 10881@kfi7
00010000:00000001:31.0:1773851858.628162:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851858.628163:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.628163:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851858.628164:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004e39c75d x1859314936752192/t0(0) o400->8d41e6ad-689e-4f58-90e1-e1dc861eab93@10881@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1172-0'
00000100:00100000:31.0:1773851858.628167:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e39c75d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:8d41e6ad-689e-4f58-90e1-e1dc861eab93+6:39771:x1859314936752192:12345-10881@kfi7:400:default-tuolumne1172-0 Request processed in 58us (94us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851858.628169:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10881@kfi7, seq: 2055478
00000100:00000040:31.0:1773851858.628170:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bb633da4 : new rpc_count 0
00000800:00000200:29.0:1773851858.628170:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851858.628171:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851858.628171:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851858.628171:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851858.628172:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851858.628172:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10881@kfi7: PUT: OK
00000020:00000010:31.0:1773851858.628173:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851858.628173:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e268637b.
00000400:00000200:29.0:1773851858.628173:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088e46351
00000020:00000040:31.0:1773851858.628174:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000bb633da4 : new refcount 5
00000400:00000010:29.0:1773851858.628174:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088e46351.
00000100:00000001:29.0:1773851858.628174:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851858.628175:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851858.628175:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851858.628176:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e4b673da nid 10881@kfi7 refs 2
00000800:00000200:29.0:1773851858.628177:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10881@kfi7(000000001db68922):0x0 lsk 2378 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x949 Transaction freed
00000800:00000200:17.0:1773851858.629858:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851858.629858:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851858.629860:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851858.629861:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851858.629863:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15027@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.629864:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15027@kfi7 : PUT - for me
00000400:00000200:17.0:1773851858.629865:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15027@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.629865:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2586f12 nid 15027@kfi7 refs 1
00000400:00000200:17.0:1773851858.629866:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15027@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.629867:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2586f12 nid 15027@kfi7 refs 2
00000400:00000200:17.0:1773851858.629868:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e2586f12 nid 15027@kfi7 refs 3
00000400:00000200:17.0:1773851858.629868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14963@kfi7 to cpt 0
00000400:00000200:17.0:1773851858.629869:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14963@kfi7 of length 224 into portal 12 MB=0x69b4c3e2c2600
00000400:00000200:17.0:1773851858.629870:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14963@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 193664
00000800:00000200:17.0:1773851858.629872:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851858.629873:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851858.629874:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15027@kfi7: PUT: OK
00000100:00000001:17.0:1773851858.629874:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851858.629875:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851858.629876:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a5b9c7c8.
00000100:00000040:17.0:1773851858.629877:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a5b9c7c8 x1859601623164416 msgsize 224
00000100:00100000:17.0:1773851858.629878:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14963@kfi7 (source: 12345-15027@kfi7)
00000100:00000001:17.0:1773851858.629879:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851858.629879:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2586f12 nid 15027@kfi7 refs 2
00000100:00000001:19.0:1773851858.629881:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851858.629881:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851858.629882:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851858.629883:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851858.629883:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851858.629885:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851858.629886:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601623164416
00000020:00000001:19.0:1773851858.629887:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851858.629888:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff85d2d
00000020:00000001:19.0:1773851858.629889:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851858.629891:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029b2d30e refcount=167
00000020:00000001:19.0:1773851858.629892:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121241700352 : -106952467851264 : ffff9eba30255800)
00000020:00000001:19.0:1773851858.629894:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121241700352 : -106952467851264 : ffff9eba30255800)
00000100:00000001:19.0:1773851858.629895:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.629896:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851858.629897:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851858.629899:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.629900:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851858.629901:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851858.629902:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851858.629903:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.629904:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851858.629905:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851858.629906:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.629907:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.629909:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851858.629910:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851858.629910:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851858.629910:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851858.629911:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14963@kfi7, seq: 2156277
00000100:00000040:19.0:1773851858.629913:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000029b2d30e : new rpc_count 1
00000100:00000001:18.0:1773851858.629913:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.629914:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764364416 : -107095945187200 : ffff9e98c83af080)
00000100:00000001:18.0:1773851858.629914:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.629916:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a5b9c7c8 x1859601623164416/t0(0) o400->e9fb25d4-ba74-491d-b298-23dcdd3a56d3@14963@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1418-0'
00000100:00000001:19.0:1773851858.629921:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.629921:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851858.629923:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b9c7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e9fb25d4-ba74-491d-b298-23dcdd3a56d3+167:39710:x1859601623164416:12345-14963@kfi7:400:default-tuolumne1418-0
00000100:00000200:19.0:1773851858.629925:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601623164416
00000020:00000001:19.0:1773851858.629926:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851858.629927:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851858.629928:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.629929:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851858.629929:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851858.629931:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851858.629932:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601623164416, found 0 last_xid 1859601622741503
00000020:00000001:19.0:1773851858.629933:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851858.629934:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851858.629935:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851858.629936:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.629937:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851858.629937:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851858.629938:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851858.629939:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7291b04.
02000000:00000001:19.0:1773851858.629940:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.629941:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.629942:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851858.629943:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063392, transno 0, xid 1859601623164416
00010000:00000001:19.0:1773851858.629944:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851858.629946:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a5b9c7c8 x1859601623164416/t0(0) o400->e9fb25d4-ba74-491d-b298-23dcdd3a56d3@14963@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1418-0'
00010000:00000001:19.0:1773851858.629950:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851858.629951:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851858.629952:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=91 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851858.629954:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851858.629955:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007732d866 refcount 3 to 14963@kfi7
00000100:00000001:19.0:1773851858.629957:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729378688 : -107155980172928 : ffff9e8acdddc180)
02000000:00000001:19.0:1773851858.629958:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851858.629958:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.629959:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851858.629961:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15027@kfi7
00000400:00000010:19.0:1773851858.629962:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000094621db5.
00000100:00000200:19.0:1773851858.629963:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601623164416, offset 224
00000400:00000200:19.0:1773851858.629965:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15027@kfi7
00000400:00000200:19.0:1773851858.629966:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15027@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.629968:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2586f12 nid 15027@kfi7 refs 1
00000400:00000200:19.0:1773851858.629970:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e2586f12 nid 15027@kfi7 refs 2
00000400:00000200:19.0:1773851858.629971:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e2586f12 nid 15027@kfi7 refs 3
00000400:00000200:19.0:1773851858.629973:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15027@kfi7 local destination
00000400:00000200:19.0:1773851858.629975:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768792:8768792:1024:4294967295] 15027@kfi7 LPNI seq info [58915877:58915877:16:4294967295]
00000400:00000200:19.0:1773851858.629977:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e2586f12 nid 15027@kfi7 refs 2
00000400:00000200:19.0:1773851858.629979:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15027@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.629982:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15027@kfi7(15027@kfi7:15027@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851858.629984:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e2586f12 nid 15027@kfi7 refs 3
00000800:00000200:19.0:1773851858.629986:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851858.629988:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851858.629991:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851858.629995:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000df3 Using peer 15027@kfi7(0x100000000000df3)
00000800:00000200:19.0:1773851858.630000:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x100000000000df3: rc=0
00000800:00000200:19.0:1773851858.630002:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000df3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851858.630009:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.630010:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007732d866 refcount 2 to 14963@kfi7
00010000:00000001:19.0:1773851858.630011:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851858.630012:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851858.630012:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000df3 TN_EVENT_TX_OK event status 0
00000020:00000001:19.0:1773851858.630013:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000400:00000200:17.0:1773851858.630013:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:19.0:1773851858.630014:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a5b9c7c8 x1859601623164416/t0(0) o400->e9fb25d4-ba74-491d-b298-23dcdd3a56d3@14963@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1418-0'
00000400:00000200:17.0:1773851858.630014:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15027@kfi7: PUT: OK
00000400:00000200:17.0:1773851858.630015:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000094621db5
00000400:00000010:17.0:1773851858.630016:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000094621db5.
00000100:00000001:17.0:1773851858.630016:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851858.630017:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851858.630017:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2586f12 nid 15027@kfi7 refs 2
00000100:00100000:19.0:1773851858.630019:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b9c7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e9fb25d4-ba74-491d-b298-23dcdd3a56d3+167:39710:x1859601623164416:12345-14963@kfi7:400:default-tuolumne1418-0 Request processed in 98us (142us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851858.630019:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 15027@kfi7(00000000097a3bd9):0x0 lsk 3572 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000df3 Transaction freed
00000100:00100000:19.0:1773851858.630023:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14963@kfi7, seq: 2156277
00000100:00000040:19.0:1773851858.630024:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000029b2d30e : new rpc_count 0
00000100:00000001:19.0:1773851858.630026:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851858.630026:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851858.630027:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.630028:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000020:00000010:19.0:1773851858.630030:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000020:00000040:19.0:1773851858.630031:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000029b2d30e : new refcount 166
00000100:00000001:19.0:1773851858.630032:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851858.664253:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.664254:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851858.664255:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851858.664258:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851858.664260:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15458@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.664261:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15458@kfi7 : PUT - for me
00000400:00000200:5.0:1773851858.664262:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15458@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.664263:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004449bfcd nid 15458@kfi7 refs 1
00000400:00000200:5.0:1773851858.664263:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15458@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.664264:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004449bfcd nid 15458@kfi7 refs 2
00000400:00000200:5.0:1773851858.664265:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004449bfcd nid 15458@kfi7 refs 3
00000400:00000200:5.0:1773851858.664266:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15522@kfi7 to cpt 5
00000400:00000200:5.0:1773851858.664267:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15522@kfi7 of length 224 into portal 12 MB=0x69b4b62256940
00000400:00000200:5.0:1773851858.664268:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15522@kfi7 of length 224/224 into md 0x793926dc5 [64] + 122056
00000800:00000200:5.0:1773851858.664270:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851858.664272:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851858.664273:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15458@kfi7: PUT: OK
00000100:00000001:5.0:1773851858.664274:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851858.664274:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851858.664275:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000087bc2cd.
00000100:00000040:5.0:1773851858.664276:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000087bc2cd x1859597931735360 msgsize 224
00000100:00100000:5.0:1773851858.664278:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-15522@kfi7 (source: 12345-15458@kfi7)
00000100:00000001:5.0:1773851858.664280:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851858.664281:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004449bfcd nid 15458@kfi7 refs 2
00000800:00000200:5.0:1773851858.664282:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851858.664285:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851858.664285:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.664286:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851858.664286:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851858.664287:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851858.664288:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597931735360
00000020:00000001:5.0:1773851858.664288:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851858.664289:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8269e
00000020:00000001:5.0:1773851858.664289:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.664291:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d0437836 refcount=1290
00000020:00000001:5.0:1773851858.664292:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157028249600 : -106916681302016 : ffff9ec28530c000)
00000020:00000001:5.0:1773851858.664293:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157028249600 : -106916681302016 : ffff9ec28530c000)
00000100:00000001:5.0:1773851858.664294:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.664294:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851858.664295:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851858.664296:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.664297:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851858.664298:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.664298:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851858.664299:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.664299:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851858.664300:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851858.664300:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.664301:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.664302:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851858.664303:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851858.664303:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851858.664303:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851858.664304:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15522@kfi7, seq: 2001868
00000100:00000001:7.0:1773851858.664305:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851858.664305:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.664305:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d0437836 : new rpc_count 9
00000100:00000001:5.0:1773851858.664305:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866941056 : -107088842610560 : ffff9e9a6f93a880)
00000100:00000040:5.0:1773851858.664315:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000087bc2cd x1859597931735360/t0(0) o400->8162f468-ab4e-4359-855e-8e3883ad0f78@15522@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1452-0'
00000100:00000001:5.0:1773851858.664318:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.664318:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851858.664319:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000087bc2cd pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8162f468-ab4e-4359-855e-8e3883ad0f78+1290:39558:x1859597931735360:12345-15522@kfi7:400:default-tuolumne1452-0
00000100:00000200:5.0:1773851858.664321:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597931735360
00000020:00000001:5.0:1773851858.664321:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851858.664322:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851858.664323:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.664323:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851858.664324:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851858.664325:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851858.664325:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597931735360, found 0 last_xid 1859597931056191
00000020:00000001:5.0:1773851858.664326:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851858.664327:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851858.664327:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851858.664328:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.664328:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851858.664329:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851858.664330:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851858.664330:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e0f51cdd.
02000000:00000001:5.0:1773851858.664331:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.664332:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.664332:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851858.664333:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589572, transno 0, xid 1859597931735360
00010000:00000001:5.0:1773851858.664334:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851858.664335:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000087bc2cd x1859597931735360/t0(0) o400->8162f468-ab4e-4359-855e-8e3883ad0f78@15522@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1452-0'
00010000:00000001:5.0:1773851858.664337:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851858.664338:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851858.664338:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=90 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851858.664340:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851858.664343:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e9fbf45 refcount 3 to 15522@kfi7
00000100:00000001:5.0:1773851858.664344:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452864 : -107146752098752 : ffff9e8cf3e6fe40)
02000000:00000001:5.0:1773851858.664345:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851858.664346:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.664346:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851858.664347:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15458@kfi7
00000400:00000010:5.0:1773851858.664348:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cf92b3a6.
00000100:00000200:5.0:1773851858.664349:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597931735360, offset 224
00000400:00000200:5.0:1773851858.664350:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15458@kfi7
00000400:00000200:5.0:1773851858.664351:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15458@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.664352:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004449bfcd nid 15458@kfi7 refs 1
00000400:00000200:5.0:1773851858.664353:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004449bfcd nid 15458@kfi7 refs 2
00000400:00000200:5.0:1773851858.664354:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004449bfcd nid 15458@kfi7 refs 3
00000400:00000200:5.0:1773851858.664355:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15458@kfi7 local destination
00000400:00000200:5.0:1773851858.664356:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768793:8768793:1024:4294967295] 15458@kfi7 LPNI seq info [1905564:1905564:16:4294967295]
00000400:00000200:5.0:1773851858.664358:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004449bfcd nid 15458@kfi7 refs 2
00000400:00000200:5.0:1773851858.664359:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15458@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.664361:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15458@kfi7(15458@kfi7:15458@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851858.664362:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004449bfcd nid 15458@kfi7 refs 3
00000800:00000200:5.0:1773851858.664364:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.664365:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851858.664367:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851858.664370:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c13 Using peer 15458@kfi7(0x100000000000c13)
00000800:00000200:5.0:1773851858.664372:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x100000000000c13: rc=0
00000800:00000200:5.0:1773851858.664374:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c13 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851858.664376:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.664377:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e9fbf45 refcount 2 to 15522@kfi7
00010000:00000001:5.0:1773851858.664378:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851858.664378:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.664379:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851858.664379:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000087bc2cd x1859597931735360/t0(0) o400->8162f468-ab4e-4359-855e-8e3883ad0f78@15522@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1452-0'
00000100:00100000:5.0:1773851858.664383:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000087bc2cd pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8162f468-ab4e-4359-855e-8e3883ad0f78+1290:39558:x1859597931735360:12345-15522@kfi7:400:default-tuolumne1452-0 Request processed in 63us (106us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851858.664385:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15522@kfi7, seq: 2001868
00000800:00000200:6.0:1773851858.664386:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c13 TN_EVENT_TX_OK event status 0
00000100:00000040:5.0:1773851858.664386:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d0437836 : new rpc_count 8
00000100:00000001:5.0:1773851858.664386:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851858.664387:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851858.664387:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851858.664388:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851858.664388:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000400:00000200:6.0:1773851858.664389:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15458@kfi7: PUT: OK
00000020:00000010:5.0:1773851858.664389:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000400:00000200:6.0:1773851858.664390:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cf92b3a6
00000020:00000040:5.0:1773851858.664390:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000d0437836 : new refcount 1289
00000400:00000010:6.0:1773851858.664391:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cf92b3a6.
00000100:00000001:6.0:1773851858.664391:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851858.664391:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851858.664392:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851858.664393:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004449bfcd nid 15458@kfi7 refs 2
00000800:00000200:6.0:1773851858.664394:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 15458@kfi7(000000006c5d5a24):0x0 lsk 3092 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c13 Transaction freed
00000800:00000200:21.0:1773851858.698704:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.698705:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.698706:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.698708:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851858.698709:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14192@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.698710:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14192@kfi7 : PUT - for me
00000400:00000200:21.0:1773851858.698711:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14192@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.698712:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000184a9e3 nid 14192@kfi7 refs 1
00000400:00000200:21.0:1773851858.698713:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14192@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.698714:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000184a9e3 nid 14192@kfi7 refs 2
00000400:00000200:21.0:1773851858.698715:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000184a9e3 nid 14192@kfi7 refs 3
00000400:00000200:21.0:1773851858.698715:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14256@kfi7 to cpt 0
00000400:00000200:21.0:1773851858.698716:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14256@kfi7 of length 224 into portal 12 MB=0x69b0a66cb55c0
00000400:00000200:21.0:1773851858.698717:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14256@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 26504
00000800:00000200:21.0:1773851858.698719:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851858.698720:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.698721:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14192@kfi7: PUT: OK
00000100:00000001:21.0:1773851858.698723:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.698723:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851858.698724:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001775134a.
00000100:00000040:21.0:1773851858.698728:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000001775134a x1859318836843968 msgsize 224
00000100:00100000:21.0:1773851858.698730:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14256@kfi7 (source: 12345-14192@kfi7)
00000100:00000001:21.0:1773851858.698731:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851858.698732:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851858.698732:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000184a9e3 nid 14192@kfi7 refs 2
02000000:00000001:23.0:1773851858.698733:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851858.698733:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851858.698733:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851858.698734:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851858.698735:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851858.698735:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318836843968
00000020:00000001:23.0:1773851858.698736:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851858.698736:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a64
00000020:00000001:23.0:1773851858.698737:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851858.698741:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ace5e0c7 refcount=170
00000020:00000001:23.0:1773851858.698742:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627762176 : -107123081789440 : ffff9e9276c34000)
00000020:00000001:23.0:1773851858.698743:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627762176 : -107123081789440 : ffff9e9276c34000)
00000100:00000001:23.0:1773851858.698744:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.698745:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851858.698745:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000170cfdb.
00000020:00000010:23.0:1773851858.698746:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.698747:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851858.698748:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851858.698748:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851858.698749:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.698750:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851858.698750:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851858.698751:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.698751:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.698752:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851858.698753:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851858.698753:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851858.698754:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14256@kfi7, seq: 1997937
00000100:00000001:22.0:1773851858.698754:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851858.698755:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ace5e0c7 : new rpc_count 1
00000100:00000001:22.0:1773851858.698755:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.698756:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117348608 : -106995592203008 : ffff9eb025bbf500)
00000100:00000001:22.0:1773851858.698756:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.698757:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001775134a x1859318836843968/t0(0) o400->ffe94d8f-513a-40cc-9593-62eb041f5f3f@14256@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1374-0'
00000100:00000001:23.0:1773851858.698759:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.698760:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851858.698761:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001775134a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ffe94d8f-513a-40cc-9593-62eb041f5f3f+170:39875:x1859318836843968:12345-14256@kfi7:400:default-tuolumne1374-0
00000100:00000200:23.0:1773851858.698762:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318836843968
00000020:00000001:23.0:1773851858.698763:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851858.698763:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851858.698764:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.698765:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851858.698765:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851858.698777:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851858.698777:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318836843968, found 0 last_xid 1859318836420031
00000020:00000001:23.0:1773851858.698778:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851858.698779:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851858.698779:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851858.698780:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.698780:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851858.698781:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851858.698781:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851858.698783:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000160fc1b7.
02000000:00000001:23.0:1773851858.698784:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.698785:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.698785:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851858.698786:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063523, transno 0, xid 1859318836843968
00010000:00000001:23.0:1773851858.698787:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851858.698788:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001775134a x1859318836843968/t0(0) o400->ffe94d8f-513a-40cc-9593-62eb041f5f3f@14256@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1374-0'
00010000:00000001:23.0:1773851858.698790:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851858.698790:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851858.698791:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=91 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851858.698792:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851858.698793:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004bcb8972 refcount 3 to 14256@kfi7
00000100:00000001:23.0:1773851858.698794:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850079296 : -107143859472320 : ffff9e8da050f840)
02000000:00000001:23.0:1773851858.698795:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851858.698795:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.698796:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851858.698796:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14192@kfi7
00000400:00000010:23.0:1773851858.698797:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a342ba58.
00000100:00000200:23.0:1773851858.698798:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318836843968, offset 224
00000400:00000200:23.0:1773851858.698799:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14192@kfi7
00000400:00000200:23.0:1773851858.698800:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14192@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.698801:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000184a9e3 nid 14192@kfi7 refs 1
00000400:00000200:23.0:1773851858.698802:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000184a9e3 nid 14192@kfi7 refs 2
00000400:00000200:23.0:1773851858.698803:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000184a9e3 nid 14192@kfi7 refs 3
00000400:00000200:23.0:1773851858.698807:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14192@kfi7 local destination
00000400:00000200:23.0:1773851858.698808:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768794:8768794:1024:4294967295] 14192@kfi7 LPNI seq info [10411717:10411717:16:4294967295]
00000400:00000200:23.0:1773851858.698809:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000184a9e3 nid 14192@kfi7 refs 2
00000400:00000200:23.0:1773851858.698810:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14192@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.698812:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14192@kfi7(14192@kfi7:14192@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851858.698813:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000184a9e3 nid 14192@kfi7 refs 3
00000800:00000200:23.0:1773851858.698814:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851858.698815:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851858.698817:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851858.698820:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f25 Using peer 14192@kfi7(0x100000000000f25)
00000800:00000200:23.0:1773851858.698823:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x100000000000f25: rc=0
00000800:00000200:23.0:1773851858.698824:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f25 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851858.698826:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.698827:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004bcb8972 refcount 2 to 14256@kfi7
00010000:00000001:23.0:1773851858.698827:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851858.698828:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.698829:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851858.698829:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001775134a x1859318836843968/t0(0) o400->ffe94d8f-513a-40cc-9593-62eb041f5f3f@14256@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1374-0'
00000100:00100000:23.0:1773851858.698832:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001775134a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ffe94d8f-513a-40cc-9593-62eb041f5f3f+170:39875:x1859318836843968:12345-14256@kfi7:400:default-tuolumne1374-0 Request processed in 72us (107us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851858.698834:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14256@kfi7, seq: 1997937
00000800:00000200:21.0:1773851858.698834:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f25 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851858.698835:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ace5e0c7 : new rpc_count 0
00000100:00000001:23.0:1773851858.698835:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851858.698836:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851858.698836:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851858.698837:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851858.698837:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14192@kfi7: PUT: OK
00000400:00000200:21.0:1773851858.698837:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a342ba58
00000020:00000010:23.0:1773851858.698838:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851858.698838:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000170cfdb.
00000400:00000010:21.0:1773851858.698838:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a342ba58.
00000100:00000001:21.0:1773851858.698838:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:23.0:1773851858.698839:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000ace5e0c7 : new refcount 169
00000100:00000001:21.0:1773851858.698839:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851858.698839:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000184a9e3 nid 14192@kfi7 refs 2
00000100:00000001:23.0:1773851858.698840:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851858.698841:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 14192@kfi7(00000000096cea13):0x0 lsk 3878 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f25 Transaction freed
00000800:00000200:21.0:1773851858.702187:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.702188:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.702189:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.702190:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851858.702192:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.702193:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19970@kfi7 : PUT - for me
00000400:00000200:21.0:1773851858.702194:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.702194:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 1
00000400:00000200:21.0:1773851858.702195:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.702196:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000400:00000200:21.0:1773851858.702196:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 3
00000400:00000200:21.0:1773851858.702197:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20162@kfi7 to cpt 7
00000400:00000200:21.0:1773851858.702198:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20162@kfi7 of length 376 into portal 12 MB=0x69b0a12ceedc0
00000400:00000200:21.0:1773851858.702199:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20162@kfi7 of length 376/376 into md 0x6a32cacf5 [64] + 26728
00000800:00000200:21.0:1773851858.702200:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851858.702201:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.702202:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19970@kfi7: PUT: OK
00000100:00000001:21.0:1773851858.702203:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.702203:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851858.702204:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000bc7c6a9.
00000100:00000040:21.0:1773851858.702204:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000bc7c6a9 x1859317427793344 msgsize 376
00000100:00100000:21.0:1773851858.702205:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20162@kfi7 (source: 12345-19970@kfi7)
00000100:00000001:21.0:1773851858.702206:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851858.702207:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000100:00000001:23.0:1773851858.702208:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851858.702208:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851858.702208:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851858.702208:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851858.702209:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851858.702209:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851858.702210:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317427793344
00000020:00000001:23.0:1773851858.702211:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851858.702211:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92301
00000020:00000001:23.0:1773851858.702211:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851858.702215:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ff95e706 refcount=686
00000020:00000001:23.0:1773851858.702216:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630276096 : -107123079275520 : ffff9e9276e99c00)
00000020:00000001:23.0:1773851858.702216:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630276096 : -107123079275520 : ffff9e9276e99c00)
00000100:00000001:23.0:1773851858.702217:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.702218:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851858.702218:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000170cfdb.
00000020:00000010:23.0:1773851858.702219:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.702219:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851858.702220:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851858.702221:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:23.0:1773851858.702221:0:61145:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:23.0:1773851858.702222:0:61145:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.702222:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.702223:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.702224:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.702225:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851858.702226:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851858.702226:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851858.702226:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851858.702227:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20162@kfi7, seq: 335333143
00000100:00000040:23.0:1773851858.702227:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ff95e706 : new rpc_count 10
00000100:00000001:22.0:1773851858.702227:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.702228:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117323264 : -106995592228352 : ffff9eb025bb9200)
00000100:00000001:22.0:1773851858.702228:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.702229:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000bc7c6a9 x1859317427793344/t0(0) o101->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:585/0 lens 376/0 e 0 to 0 dl 1773851945 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111584628931584'
00000100:00000001:23.0:1773851858.702232:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.702232:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851858.702233:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000bc7c6a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:396b608f-c2d1-4dee-979d-4441a31d5059+686:579282:x1859317427793344:12345-20162@kfi7:101:tuolumne-833111584628931584
00000100:00000200:23.0:1773851858.702234:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317427793344
00000020:00000001:23.0:1773851858.702235:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851858.702235:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851858.702236:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.702236:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851858.702237:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:23.0:1773851858.702238:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851858.702238:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317427793344, found 0 last_xid 1859317421780543
00000020:00000001:23.0:1773851858.702239:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851858.702239:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851858.702239:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851858.702240:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.702241:0:61145:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:23.0:1773851858.702242:0:61145:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:23.0:1773851858.702242:0:61145:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:23.0:1773851858.702243:0:61145:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:23.0:1773851858.702244:0:61145:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.702248:0:61145:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:23.0:1773851858.702250:0:61145:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000aaabd963.
00010000:00000010:23.0:1773851858.702251:0:61145:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 000000000c1ce62d.
00010000:00000001:23.0:1773851858.702252:0:61145:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:23.0:1773851858.702253:0:61145:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000e7cde3c3.
00000020:00000001:23.0:1773851858.702254:0:61145:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:23.0:1773851858.702255:0:61145:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000e7cde3c3 with handle 0x21b6f08f07a6ad23 to hash
00000020:00000001:23.0:1773851858.702256:0:61145:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:23.0:1773851858.702257:0:61145:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158703508736 : -106915006042880 : ffff9ec2e90b2d00)
00010000:00000010:23.0:1773851858.702258:0:61145:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000eccdd647.
00010000:00000001:23.0:1773851858.702259:0:61145:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158703508736 : -106915006042880 : ffff9ec2e90b2d00)
00010000:00010000:23.0:1773851858.702260:0:61145:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7cde3c3/0x21b6f08f07a6ad23 lrc: 2/0,0 mode: --/CR res: [0x240028de2:0x19cb7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd8f535f7d406a0ec expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851858.702263:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000aaabd963 count: 1
00010000:00000040:23.0:1773851858.702265:0:61145:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ff95e706 : new locks_count 608
00000020:00000040:23.0:1773851858.702266:0:61145:0:(genops.c:871:class_export_get()) GET export 00000000ff95e706 refcount=687
00010000:00000001:23.0:1773851858.702267:0:61145:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:23.0:1773851858.702268:0:61145:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:23.0:1773851858.702270:0:61145:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:23.0:1773851858.702271:0:61145:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:23.0:1773851858.702271:0:61145:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851858.702272:0:61145:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:23.0:1773851858.702273:0:61145:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x240028de2:0x19cb7:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:23.0:1773851858.702274:0:61145:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:23.0:1773851858.702275:0:61145:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028de2:0x19cb7:0x0]
00000020:00000001:23.0:1773851858.702276:0:61145:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:23.0:1773851858.702277:0:61145:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637093170313080 : -106980539238536 : ffff9eb3a6f5f778)
00000004:00000001:23.0:1773851858.702278:0:61145:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637093170312992 : -106980539238624 : ffff9eb3a6f5f720)
00000004:00000001:23.0:1773851858.702280:0:61145:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:23.0:1773851858.702282:0:61145:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:23.0:1773851858.702283:0:61145:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:23.0:1773851858.702285:0:61145:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702286:0:61145:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702287:0:61145:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:23.0:1773851858.702288:0:61145:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:23.0:1773851858.702289:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851858.702289:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851858.702290:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 00000000c86c4e02.
02000000:00000001:23.0:1773851858.702290:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.702291:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851858.702292:0:61145:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:23.0:1773851858.702293:0:61145:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:23.0:1773851858.702294:0:61145:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:23.0:1773851858.702295:0:61145:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851858.702295:0:61145:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.702297:0:61145:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:23.0:1773851858.702297:0:61145:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:23.0:1773851858.702298:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851858.702299:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851858.702300:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851858.702300:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851858.702301:0:61145:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:23.0:1773851858.702302:0:61145:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:23.0:1773851858.702302:0:61145:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:23.0:1773851858.702303:0:61145:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:23.0:1773851858.702303:0:61145:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240028de2:0x19cb7:0x0].0x0 (00000000aaabd963) refcount = 1
00010000:00010000:23.0:1773851858.702305:0:61145:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7cde3c3/0x21b6f08f07a6ad23 lrc: 3/0,0 mode: CR/CR res: [0x240028de2:0x19cb7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 20162@kfi7 remote: 0xd8f535f7d406a0ec expref: 687 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851858.702307:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000aaabd963 count: 1
00010000:00000001:23.0:1773851858.702308:0:61145:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:23.0:1773851858.702309:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851858.702310:0:61145:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.702311:0:61145:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:23.0:1773851858.702311:0:61145:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851858.702312:0:61145:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.702313:0:61145:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851858.702314:0:61145:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:23.0:1773851858.702314:0:61145:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7cde3c3/0x21b6f08f07a6ad23 lrc: 3/0,0 mode: CR/CR res: [0x240028de2:0x19cb7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 20162@kfi7 remote: 0xd8f535f7d406a0ec expref: 687 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851858.702317:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000aaabd963 count: 1
00000004:00000001:23.0:1773851858.702318:0:61145:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:23.0:1773851858.702319:0:61145:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:23.0:1773851858.702319:0:61145:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028de2:0x19cb7:0x0]
00000020:00000001:23.0:1773851858.702320:0:61145:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:23.0:1773851858.702320:0:61145:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637093170313080 : -106980539238536 : ffff9eb3a6f5f778)
00000004:00000001:23.0:1773851858.702321:0:61145:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637093170312992 : -106980539238624 : ffff9eb3a6f5f720)
00000004:00000001:23.0:1773851858.702322:0:61145:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:23.0:1773851858.702323:0:61145:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:23.0:1773851858.702323:0:61145:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:23.0:1773851858.702324:0:61145:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702324:0:61145:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702325:0:61145:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702325:0:61145:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:23.0:1773851858.702326:0:61145:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:23.0:1773851858.702326:0:61145:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:23.0:1773851858.702327:0:61145:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702327:0:61145:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702328:0:61145:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851858.702328:0:61145:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:23.0:1773851858.702329:0:61145:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:23.0:1773851858.702329:0:61145:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:23.0:1773851858.702330:0:61145:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:23.0:1773851858.702331:0:61145:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:23.0:1773851858.702331:0:61145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028de2:0x19cb7:0x0].0x0 (00000000aaabd963)
00010000:00010000:23.0:1773851858.702332:0:61145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:23.0:1773851858.702333:0:61145:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851858.702334:0:61145:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.702334:0:61145:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:23.0:1773851858.702335:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851858.702335:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:23.0:1773851858.702336:0:61145:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e7cde3c3, rc 0)
00000020:00000001:23.0:1773851858.702337:0:61145:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851858.702337:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264557774, transno 0, xid 1859317427793344
00010000:00000001:23.0:1773851858.702338:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851858.702339:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000bc7c6a9 x1859317427793344/t0(0) o101->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:585/0 lens 376/1080 e 0 to 0 dl 1773851945 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111584628931584'
00010000:00000001:23.0:1773851858.702342:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851858.702342:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851858.702343:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=91 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851858.702344:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851858.702344:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008815f050 refcount 3 to 20162@kfi7
00000100:00000001:23.0:1773851858.702345:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270624 : -107152618280992 : ffff9e8b964027e0)
02000000:00000001:23.0:1773851858.702346:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851858.702346:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.702347:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851858.702348:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19970@kfi7
00000400:00000010:23.0:1773851858.702348:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000571e5f64.
00000100:00000200:23.0:1773851858.702349:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1859317427793344, offset 224
00000400:00000200:23.0:1773851858.702350:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19970@kfi7
00000400:00000200:23.0:1773851858.702351:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.702352:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 1
00000400:00000200:23.0:1773851858.702353:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000400:00000200:23.0:1773851858.702354:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 3
00000400:00000200:23.0:1773851858.702355:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19970@kfi7 local destination
00000400:00000200:23.0:1773851858.702357:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768795:8768795:1024:4294967295] 19970@kfi7 LPNI seq info [662767:662767:16:4294967295]
00000400:00000200:23.0:1773851858.702358:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000400:00000200:23.0:1773851858.702359:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.702360:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19970@kfi7(19970@kfi7:19970@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851858.702361:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 3
00000800:00000200:23.0:1773851858.702363:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851858.702364:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000800:00000200:23.0:1773851858.702366:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851858.702368:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e10 Using peer 19970@kfi7(0x100000000000e10)
00000800:00000200:23.0:1773851858.702371:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 1180 bytes to peer 0x100000000000e10: rc=0
00000800:00000200:23.0:1773851858.702372:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e10 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851858.702374:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.702375:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008815f050 refcount 2 to 20162@kfi7
00010000:00000001:23.0:1773851858.702375:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851858.702376:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.702376:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851858.702377:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000bc7c6a9 x1859317427793344/t0(0) o101->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:585/0 lens 376/1080 e 0 to 0 dl 1773851945 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111584628931584'
00000100:00100000:23.0:1773851858.702380:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000bc7c6a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:396b608f-c2d1-4dee-979d-4441a31d5059+687:579282:x1859317427793344:12345-20162@kfi7:101:tuolumne-833111584628931584 Request processed in 147us (175us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851858.702382:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20162@kfi7, seq: 335333143
00000800:00000200:21.0:1773851858.702382:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e10 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851858.702383:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ff95e706 : new rpc_count 9
00000100:00000001:23.0:1773851858.702383:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851858.702384:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851858.702384:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851858.702384:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.702384:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19970@kfi7: PUT: OK
00000020:00000010:23.0:1773851858.702385:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851858.702385:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000571e5f64
00000400:00000010:21.0:1773851858.702385:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000571e5f64.
00000020:00000010:23.0:1773851858.702386:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000170cfdb.
00000020:00000040:23.0:1773851858.702386:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000ff95e706 : new refcount 686
00000100:00000001:21.0:1773851858.702386:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851858.702386:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851858.702387:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851858.702387:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000800:00000200:21.0:1773851858.702388:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 19970@kfi7(0000000018bad0e7):0x0 lsk 3601 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e10 Transaction freed
00000800:00000200:21.0:1773851858.703202:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.703203:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.703204:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.703206:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851858.703207:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.703208:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19970@kfi7 : PUT - for me
00000400:00000200:21.0:1773851858.703209:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.703209:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 1
00000400:00000200:21.0:1773851858.703210:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.703210:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000400:00000200:21.0:1773851858.703211:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 3
00000400:00000200:21.0:1773851858.703212:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20162@kfi7 to cpt 7
00000400:00000200:21.0:1773851858.703212:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20162@kfi7 of length 328 into portal 12 MB=0x69b0a12ceee00
00000400:00000200:21.0:1773851858.703213:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20162@kfi7 of length 328/328 into md 0x6a32cacf5 [64] + 27104
00000800:00000200:21.0:1773851858.703215:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851858.703216:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.703217:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19970@kfi7: PUT: OK
00000100:00000001:21.0:1773851858.703217:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.703218:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851858.703218:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009494250d.
00000100:00000040:21.0:1773851858.703219:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009494250d x1859317427793408 msgsize 328
00000100:00100000:21.0:1773851858.703220:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20162@kfi7 (source: 12345-19970@kfi7)
00000100:00000001:21.0:1773851858.703220:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851858.703221:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000100:00000001:23.0:1773851858.703222:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851858.703222:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851858.703223:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851858.703223:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851858.703224:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851858.703224:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851858.703225:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317427793408
00000020:00000001:23.0:1773851858.703225:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851858.703225:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92301
00000020:00000001:23.0:1773851858.703226:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851858.703226:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ff95e706 refcount=687
00000020:00000001:23.0:1773851858.703227:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630276096 : -107123079275520 : ffff9e9276e99c00)
00000020:00000001:23.0:1773851858.703228:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630276096 : -107123079275520 : ffff9e9276e99c00)
00000100:00000001:23.0:1773851858.703228:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.703229:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851858.703229:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000170cfdb.
00000020:00000010:23.0:1773851858.703230:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.703230:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851858.703231:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851858.703231:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:23.0:1773851858.703232:0:61145:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:23.0:1773851858.703233:0:61145:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.703233:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.703234:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.703235:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.703236:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851858.703236:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851858.703236:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851858.703237:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20162@kfi7, seq: 335333144
00000100:00000040:23.0:1773851858.703237:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ff95e706 : new rpc_count 10
00000100:00000001:22.0:1773851858.703237:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851858.703238:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078117319808 : -106995592231808 : ffff9eb025bb8480)
00000100:00000001:22.0:1773851858.703238:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851858.703238:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.703239:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009494250d x1859317427793408/t0(0) o101->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:585/0 lens 328/0 e 0 to 0 dl 1773851945 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111584628931584'
00000100:00000001:23.0:1773851858.703242:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.703242:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851858.703243:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009494250d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:396b608f-c2d1-4dee-979d-4441a31d5059+687:39543:x1859317427793408:12345-20162@kfi7:101:tuolumne-833111584628931584
00000100:00000200:23.0:1773851858.703244:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317427793408
00000020:00000001:23.0:1773851858.703244:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851858.703245:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851858.703245:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.703246:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851858.703246:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:23.0:1773851858.703247:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851858.703248:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317427793408, found 0 last_xid 1859317421780543
00000020:00000001:23.0:1773851858.703248:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851858.703249:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851858.703249:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851858.703250:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.703250:0:61145:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:23.0:1773851858.703251:0:61145:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:23.0:1773851858.703251:0:61145:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:23.0:1773851858.703251:0:61145:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:23.0:1773851858.703252:0:61145:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.703253:0:61145:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:23.0:1773851858.703254:0:61145:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000aaabd963 count: 2
00010000:00000001:23.0:1773851858.703255:0:61145:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851858.703256:0:61145:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:23.0:1773851858.703256:0:61145:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000b867fac6.
00000020:00000001:23.0:1773851858.703257:0:61145:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:23.0:1773851858.703258:0:61145:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000b867fac6 with handle 0x21b6f08f07a6ad2a to hash
00000020:00000001:23.0:1773851858.703258:0:61145:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:23.0:1773851858.703259:0:61145:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158703503552 : -106915006048064 : ffff9ec2e90b18c0)
00010000:00000010:23.0:1773851858.703259:0:61145:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000007e9016.
00010000:00000001:23.0:1773851858.703260:0:61145:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158703503552 : -106915006048064 : ffff9ec2e90b18c0)
00010000:00010000:23.0:1773851858.703261:0:61145:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000b867fac6/0x21b6f08f07a6ad2a lrc: 2/0,0 mode: --/PR res: [0x240028de2:0x19cb7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd8f535f7d406a0f3 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851858.703263:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000aaabd963 count: 2
00010000:00000040:23.0:1773851858.703264:0:61145:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ff95e706 : new locks_count 609
00000020:00000040:23.0:1773851858.703264:0:61145:0:(genops.c:871:class_export_get()) GET export 00000000ff95e706 refcount=688
00010000:00000001:23.0:1773851858.703265:0:61145:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:23.0:1773851858.703266:0:61145:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00002000:00000001:23.0:1773851858.703267:0:61145:0:(mdt_io.c:1388:mdt_glimpse_enqueue()) Process entered
00000100:00000001:23.0:1773851858.703267:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851858.703268:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851858.703268:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 656 at 000000004e865a95.
02000000:00000001:23.0:1773851858.703269:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.703270:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.703271:0:61145:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:23.0:1773851858.703271:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851858.703272:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851858.703272:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851858.703272:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851858.703273:0:61145:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:23.0:1773851858.703273:0:61145:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:23.0:1773851858.703274:0:61145:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:23.0:1773851858.703274:0:61145:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:23.0:1773851858.703275:0:61145:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240028de2:0x19cb7:0x0].0x0 (00000000aaabd963) refcount = 2
00010000:00000040:23.0:1773851858.703276:0:61145:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:23.0:1773851858.703277:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7cde3c3/0x21b6f08f07a6ad23 lrc: 2/0,0 mode: CR/CR res: [0x240028de2:0x19cb7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 20162@kfi7 remote: 0xd8f535f7d406a0ec expref: 688 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851858.703279:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000aaabd963 count: 2
00010000:00010000:23.0:1773851858.703280:0:61145:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000b867fac6/0x21b6f08f07a6ad2a lrc: 3/0,0 mode: PR/PR res: [0x240028de2:0x19cb7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 20162@kfi7 remote: 0xd8f535f7d406a0f3 expref: 688 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851858.703282:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000aaabd963 count: 2
00010000:00000001:23.0:1773851858.703283:0:61145:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:23.0:1773851858.703283:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851858.703284:0:61145:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.703284:0:61145:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:23.0:1773851858.703285:0:61145:0:(ldlm_inodebits.c:406:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:23.0:1773851858.703285:0:61145:0:(mdt_io.c:1433:mdt_glimpse_enqueue()) Process leaving via fill_mbo (rc=302 : 302 : 0x12e)
00000004:00000001:23.0:1773851858.703286:0:61145:0:(mdt_lvb.c:155:mdt_dom_lvbo_update()) Process entered
00000004:00000010:23.0:1773851858.703287:0:61145:0:(mdt_lvb.c:58:mdt_dom_lvb_alloc()) kmalloced '(lvb)': 56 at 00000000f93b92c8.
00000004:00000001:23.0:1773851858.703288:0:61145:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:23.0:1773851858.703288:0:61145:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028de2:0x19cb7:0x0]
00000020:00000001:23.0:1773851858.703289:0:61145:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:23.0:1773851858.703289:0:61145:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637093170313080 : -106980539238536 : ffff9eb3a6f5f778)
00000004:00000001:23.0:1773851858.703290:0:61145:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637093170312992 : -106980539238624 : ffff9eb3a6f5f720)
00000004:00000001:23.0:1773851858.703291:0:61145:0:(mdt_lvb.c:91:mdt_dom_disk_lvbo_update()) Process entered
00000004:00000001:23.0:1773851858.703291:0:61145:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:23.0:1773851858.703293:0:61145:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00010000:23.0:1773851858.703294:0:61145:0:(mdt_lvb.c:110:mdt_dom_disk_lvbo_update()) res: [0x240028de2:0x19cb7:0x0] updating lvb size from disk: 0 -> 11
00000004:00010000:23.0:1773851858.703295:0:61145:0:(mdt_lvb.c:117:mdt_dom_disk_lvbo_update()) res: [0x240028de2:0x19cb7:0x0] updating lvb mtime from disk: 0 -> 1773778097
00000004:00010000:23.0:1773851858.703296:0:61145:0:(mdt_lvb.c:123:mdt_dom_disk_lvbo_update()) res: [0x240028de2:0x19cb7:0x0] updating lvb atime from disk: 0 -> 1773840992
00000004:00010000:23.0:1773851858.703297:0:61145:0:(mdt_lvb.c:129:mdt_dom_disk_lvbo_update()) res: [0x240028de2:0x19cb7:0x0] updating lvb ctime from disk: 0 -> 1773778097
00000004:00010000:23.0:1773851858.703298:0:61145:0:(mdt_lvb.c:135:mdt_dom_disk_lvbo_update()) res: [0x240028de2:0x19cb7:0x0] updating lvb blocks from disk: 18427282363563114435 -> 22
00000004:00000001:23.0:1773851858.703299:0:61145:0:(mdt_lvb.c:140:mdt_dom_disk_lvbo_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851858.703300:0:61145:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:23.0:1773851858.703300:0:61145:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00002000:00010000:23.0:1773851858.703301:0:61145:0:(mdt_io.c:1321:mdt_lvb2reply()) size 11
00002000:00000001:23.0:1773851858.703302:0:61145:0:(mdt_io.c:1461:mdt_glimpse_enqueue()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:23.0:1773851858.703303:0:61145:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:23.0:1773851858.703303:0:61145:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.703304:0:61145:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:23.0:1773851858.703305:0:61145:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000b867fac6/0x21b6f08f07a6ad2a lrc: 3/0,0 mode: PR/PR res: [0x240028de2:0x19cb7:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 20162@kfi7 remote: 0xd8f535f7d406a0f3 expref: 688 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851858.703307:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000aaabd963 count: 2
00000004:00000001:23.0:1773851858.703307:0:61145:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:23.0:1773851858.703308:0:61145:0:(mdt_lvb.c:377:mdt_lvbo_fill()) Process leaving via out (rc=56 : 56 : 0x38)
00000004:00000001:23.0:1773851858.703309:0:61145:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=56 : 56 : 38)
00010000:00000001:23.0:1773851858.703309:0:61145:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:23.0:1773851858.703310:0:61145:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:23.0:1773851858.703310:0:61145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028de2:0x19cb7:0x0].0x0 (00000000aaabd963)
00010000:00010000:23.0:1773851858.703311:0:61145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00000001:23.0:1773851858.703312:0:61145:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851858.703312:0:61145:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851858.703313:0:61145:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:23.0:1773851858.703313:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851858.703313:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:23.0:1773851858.703314:0:61145:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b867fac6, rc 0)
00000020:00000001:23.0:1773851858.703314:0:61145:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851858.703315:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264557774, transno 0, xid 1859317427793408
00010000:00000001:23.0:1773851858.703315:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851858.703316:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009494250d x1859317427793408/t0(0) o101->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:585/0 lens 328/400 e 0 to 0 dl 1773851945 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111584628931584'
00010000:00000001:23.0:1773851858.703318:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851858.703319:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851858.703319:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=91 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851858.703320:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851858.703321:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008815f050 refcount 3 to 20162@kfi7
00000100:00000001:23.0:1773851858.703321:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270624 : -107152618280992 : ffff9e8b964027e0)
02000000:00000001:23.0:1773851858.703322:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851858.703322:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.703323:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851858.703324:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19970@kfi7
00000400:00000010:23.0:1773851858.703324:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c56f69f.
00000100:00000200:23.0:1773851858.703325:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 400 bytes to portal 10, xid 1859317427793408, offset 224
00000400:00000200:23.0:1773851858.703326:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19970@kfi7
00000400:00000200:23.0:1773851858.703327:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.703327:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 1
00000400:00000200:23.0:1773851858.703328:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000400:00000200:23.0:1773851858.703329:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 3
00000400:00000200:23.0:1773851858.703330:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19970@kfi7 local destination
00000400:00000200:23.0:1773851858.703331:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768796:8768796:1024:4294967295] 19970@kfi7 LPNI seq info [662768:662768:16:4294967295]
00000400:00000200:23.0:1773851858.703333:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000400:00000200:23.0:1773851858.703334:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19970@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.703335:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19970@kfi7(19970@kfi7:19970@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851858.703336:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 3
00000800:00000200:23.0:1773851858.703338:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851858.703338:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 400 bytes in 1 frags
00000800:00000200:23.0:1773851858.703340:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851858.703343:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40f Using peer 19970@kfi7(0x40f)
00000800:00000200:23.0:1773851858.703346:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000003da230f: Posted send of 500 bytes to peer 0x40f: rc=0
00000800:00000200:23.0:1773851858.703347:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851858.703349:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.703350:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008815f050 refcount 2 to 20162@kfi7
00010000:00000001:23.0:1773851858.703350:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851858.703350:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.703351:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851858.703351:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009494250d x1859317427793408/t0(0) o101->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:585/0 lens 328/400 e 0 to 0 dl 1773851945 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111584628931584'
00000100:00100000:23.0:1773851858.703355:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009494250d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:396b608f-c2d1-4dee-979d-4441a31d5059+688:39543:x1859317427793408:12345-20162@kfi7:101:tuolumne-833111584628931584 Request processed in 113us (136us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851858.703358:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20162@kfi7, seq: 335333144
00000100:00000040:23.0:1773851858.703358:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ff95e706 : new rpc_count 9
00000100:00000001:23.0:1773851858.703359:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851858.703359:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851858.703359:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40f TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851858.703360:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.703360:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851858.703360:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851858.703361:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000170cfdb.
00000400:00000200:21.0:1773851858.703361:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19970@kfi7: PUT: OK
00000020:00000040:23.0:1773851858.703362:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000ff95e706 : new refcount 687
00000100:00000001:23.0:1773851858.703362:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851858.703362:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c56f69f
00000400:00000010:21.0:1773851858.703362:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c56f69f.
00000100:00000001:21.0:1773851858.703362:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851858.703363:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851858.703363:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6859e32 nid 19970@kfi7 refs 2
00000800:00000200:21.0:1773851858.703365:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 19970@kfi7(000000003ac479be):0x0 lsk 1040 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x40f Transaction freed
00000800:00000200:1.0:1773851858.730215:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851858.730216:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851858.730217:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851858.730219:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851858.730221:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23393@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.730222:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23393@kfi7 : PUT - for me
00000400:00000200:1.0:1773851858.730223:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23393@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.730225:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005f618ba nid 23393@kfi7 refs 1
00000400:00000200:1.0:1773851858.730226:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23393@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.730226:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005f618ba nid 23393@kfi7 refs 2
00000400:00000200:1.0:1773851858.730227:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000005f618ba nid 23393@kfi7 refs 3
00000400:00000200:1.0:1773851858.730228:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23392@kfi7 to cpt 5
00000400:00000200:1.0:1773851858.730229:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23392@kfi7 of length 224 into portal 12 MB=0x699e09088f280
00000400:00000200:1.0:1773851858.730230:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23392@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 17376
00000800:00000200:1.0:1773851858.730232:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851858.730234:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.730234:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23393@kfi7: PUT: OK
00000100:00000001:1.0:1773851858.730235:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851858.730236:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851858.730237:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000014656fac.
00000100:00000040:1.0:1773851858.730237:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000014656fac x1858039636882048 msgsize 224
00000100:00100000:1.0:1773851858.730239:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-23392@kfi7 (source: 12345-23393@kfi7)
00000100:00000001:1.0:1773851858.730240:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851858.730241:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000005f618ba nid 23393@kfi7 refs 2
00000800:00000200:1.0:1773851858.730242:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851858.730242:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851858.730243:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851858.730243:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851858.730244:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851858.730244:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851858.730245:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039636882048
00000020:00000001:0.0:1773851858.730246:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851858.730246:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b7b
00000020:00000001:0.0:1773851858.730247:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851858.730249:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000919ce349 refcount=6
00000020:00000001:0.0:1773851858.730250:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743661568 : -107128965890048 : ffff9e91180b0000)
00000020:00000001:0.0:1773851858.730251:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743661568 : -107128965890048 : ffff9e91180b0000)
00000100:00000001:0.0:1773851858.730252:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.730253:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851858.730253:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001431d72e.
00000020:00000010:0.0:1773851858.730254:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.730255:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851858.730256:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851858.730256:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851858.730257:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.730258:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851858.730258:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851858.730259:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.730260:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851858.730261:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851858.730261:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851858.730261:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851858.730262:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851858.730262:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23392@kfi7, seq: 1997510
00000100:00000040:0.0:1773851858.730263:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000919ce349 : new rpc_count 1
00000100:00000001:1.0:1773851858.730264:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851858.730264:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.730264:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605666176 : -106923103885440 : ffff9ec1065fe780)
00000100:00000040:0.0:1773851858.730265:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000014656fac x1858039636882048/t0(0) o400->31472e03-29a4-46ae-a735-0fefa7d17b77@23392@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1952-0'
00000100:00000001:0.0:1773851858.730268:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.730268:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851858.730269:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014656fac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:31472e03-29a4-46ae-a735-0fefa7d17b77+6:39785:x1858039636882048:12345-23392@kfi7:400:default-tuolumne1952-0
00000100:00000200:0.0:1773851858.730272:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039636882048
00000020:00000001:0.0:1773851858.730273:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851858.730273:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851858.730274:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.730275:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851858.730275:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851858.730276:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851858.730277:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039636882048, found 0 last_xid 1858039636882047
00000020:00000001:0.0:1773851858.730278:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851858.730278:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851858.730279:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851858.730280:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.730280:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851858.730281:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851858.730281:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851858.730282:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007514b21c.
02000000:00000001:0.0:1773851858.730283:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.730283:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.730284:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851858.730285:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014483694, transno 0, xid 1858039636882048
00010000:00000001:0.0:1773851858.730285:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851858.730286:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000014656fac x1858039636882048/t0(0) o400->31472e03-29a4-46ae-a735-0fefa7d17b77@23392@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1952-0'
00010000:00000001:0.0:1773851858.730289:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851858.730289:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851858.730290:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=91 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851858.730291:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851858.730292:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000767e1021 refcount 3 to 23392@kfi7
00000100:00000001:0.0:1773851858.730292:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109760 : -107156354441856 : ffff9e8ab78edd80)
02000000:00000001:0.0:1773851858.730293:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851858.730294:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.730295:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851858.730296:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23393@kfi7
00000400:00000010:0.0:1773851858.730296:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005abdc8a1.
00000100:00000200:0.0:1773851858.730298:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039636882048, offset 224
00000400:00000200:0.0:1773851858.730299:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23393@kfi7
00000400:00000200:0.0:1773851858.730300:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23393@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.730301:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005f618ba nid 23393@kfi7 refs 1
00000400:00000200:0.0:1773851858.730302:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000005f618ba nid 23393@kfi7 refs 2
00000400:00000200:0.0:1773851858.730303:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000005f618ba nid 23393@kfi7 refs 3
00000400:00000200:0.0:1773851858.730304:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23393@kfi7 local destination
00000400:00000200:0.0:1773851858.730305:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768797:8768797:1024:4294967295] 23393@kfi7 LPNI seq info [276171:276171:16:4294967295]
00000400:00000200:0.0:1773851858.730307:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000005f618ba nid 23393@kfi7 refs 2
00000400:00000200:0.0:1773851858.730307:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23393@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.730309:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23393@kfi7(23393@kfi7:23393@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851858.730311:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000005f618ba nid 23393@kfi7 refs 3
00000800:00000200:0.0:1773851858.730312:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851858.730313:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851858.730315:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851858.730317:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6c Using peer 23393@kfi7(0xa6c)
00000800:00000200:0.0:1773851858.730320:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0xa6c: rc=0
00000800:00000200:0.0:1773851858.730321:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851858.730323:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.730324:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000767e1021 refcount 2 to 23392@kfi7
00010000:00000001:0.0:1773851858.730325:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851858.730325:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.730326:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851858.730327:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000014656fac x1858039636882048/t0(0) o400->31472e03-29a4-46ae-a735-0fefa7d17b77@23392@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1952-0'
00000100:00100000:0.0:1773851858.730331:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014656fac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:31472e03-29a4-46ae-a735-0fefa7d17b77+6:39785:x1858039636882048:12345-23392@kfi7:400:default-tuolumne1952-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851858.730334:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23392@kfi7, seq: 1997510
00000100:00000040:0.0:1773851858.730334:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000919ce349 : new rpc_count 0
00000100:00000001:0.0:1773851858.730335:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851858.730336:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851858.730336:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.730337:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851858.730338:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001431d72e.
00000020:00000040:0.0:1773851858.730339:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000919ce349 : new refcount 5
00000100:00000001:0.0:1773851858.730340:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851858.730344:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6c TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851858.730346:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.730347:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23393@kfi7: PUT: OK
00000400:00000200:1.0:1773851858.730347:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005abdc8a1
00000400:00000010:1.0:1773851858.730348:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005abdc8a1.
00000100:00000001:1.0:1773851858.730348:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851858.730349:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851858.730350:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000005f618ba nid 23393@kfi7 refs 2
00000800:00000200:1.0:1773851858.730351:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23393@kfi7(00000000754a386f):0x0 lsk 2669 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6c Transaction freed
00000800:00000200:29.0:1773851858.735580:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851858.735582:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851858.735584:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851858.735588:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851858.735592:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17523@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.735594:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17523@kfi7 : PUT - for me
00000400:00000200:29.0:1773851858.735596:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17523@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.735597:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007702bf92 nid 17523@kfi7 refs 1
00000400:00000200:29.0:1773851858.735600:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17523@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.735601:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007702bf92 nid 17523@kfi7 refs 2
00000400:00000200:29.0:1773851858.735603:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007702bf92 nid 17523@kfi7 refs 3
00000400:00000200:29.0:1773851858.735605:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17523@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.735607:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17523@kfi7 of length 224 into portal 12 MB=0x69b4b572bb3c0
00000400:00000200:29.0:1773851858.735609:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17523@kfi7 of length 224/224 into md 0x77fe139dd [64] + 166048
00000800:00000200:29.0:1773851858.735613:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851858.735616:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851858.735618:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17523@kfi7: PUT: OK
00000100:00000001:29.0:1773851858.735620:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851858.735621:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851858.735622:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c71f8a20.
00000100:00000040:29.0:1773851858.735623:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000c71f8a20 x1859597747598272 msgsize 224
00000100:00100000:29.0:1773851858.735627:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17523@kfi7 (source: 12345-17523@kfi7)
00000100:00000001:29.0:1773851858.735628:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851858.735631:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851858.735631:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007702bf92 nid 17523@kfi7 refs 2
02000000:00000001:31.0:1773851858.735632:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851858.735633:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851858.735634:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851858.735635:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851858.735636:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851858.735637:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597747598272
00000020:00000001:31.0:1773851858.735638:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851858.735639:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d824c9
00000020:00000001:31.0:1773851858.735640:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851858.735646:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001d4cf576 refcount=5
00000020:00000001:31.0:1773851858.735647:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637038535612416 : -107035173939200 : ffff9ea6ee7a9800)
00000020:00000001:31.0:1773851858.735649:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637038535612416 : -107035173939200 : ffff9ea6ee7a9800)
00000100:00000001:31.0:1773851858.735651:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.735652:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851858.735653:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e268637b.
00000020:00000010:31.0:1773851858.735655:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.735656:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851858.735658:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851858.735658:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851858.735659:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.735661:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851858.735662:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851858.735663:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.735664:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.735667:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851858.735667:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851858.735667:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851858.735668:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851858.735669:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17523@kfi7, seq: 2055479
00000100:00000040:31.0:1773851858.735671:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001d4cf576 : new rpc_count 1
00000100:00000001:28.0:1773851858.735671:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.735672:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221519872 : -106948488031744 : ffff9ebb1d5c9200)
00000100:00000001:28.0:1773851858.735672:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.735674:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c71f8a20 x1859597747598272/t0(0) o400->aed76d8b-1e85-4758-abaa-a1be9a9c0353@17523@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1578-0'
00000100:00000001:31.0:1773851858.735679:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.735680:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851858.735682:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c71f8a20 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:aed76d8b-1e85-4758-abaa-a1be9a9c0353+5:39606:x1859597747598272:12345-17523@kfi7:400:default-tuolumne1578-0
00000100:00000200:31.0:1773851858.735684:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597747598272
00000020:00000001:31.0:1773851858.735687:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851858.735688:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851858.735689:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.735690:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851858.735691:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851858.735693:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851858.735694:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597747598272, found 0 last_xid 1859597747598271
00000020:00000001:31.0:1773851858.735695:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851858.735696:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851858.735697:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851858.735698:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.735699:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851858.735700:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851858.735701:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851858.735702:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000083005af7.
02000000:00000001:31.0:1773851858.735703:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.735705:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.735706:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851858.735707:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824333, transno 0, xid 1859597747598272
00010000:00000001:31.0:1773851858.735708:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851858.735709:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c71f8a20 x1859597747598272/t0(0) o400->aed76d8b-1e85-4758-abaa-a1be9a9c0353@17523@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1578-0'
00010000:00000001:31.0:1773851858.735713:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851858.735714:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851858.735715:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=91 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851858.735717:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851858.735718:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008ef4afe0 refcount 3 to 17523@kfi7
00000100:00000001:31.0:1773851858.735719:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803584 : -107130477748032 : ffff9e90bdede0c0)
02000000:00000001:31.0:1773851858.735720:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851858.735721:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.735722:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851858.735723:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17523@kfi7
00000400:00000010:31.0:1773851858.735724:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004e2b8359.
00000100:00000200:31.0:1773851858.735729:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597747598272, offset 224
00000400:00000200:31.0:1773851858.735731:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17523@kfi7
00000400:00000200:31.0:1773851858.735733:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17523@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.735735:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007702bf92 nid 17523@kfi7 refs 1
00000400:00000200:31.0:1773851858.735737:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007702bf92 nid 17523@kfi7 refs 2
00000400:00000200:31.0:1773851858.735739:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007702bf92 nid 17523@kfi7 refs 3
00000400:00000200:31.0:1773851858.735741:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17523@kfi7 local destination
00000400:00000200:31.0:1773851858.735743:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768798:8768798:1024:4294967295] 17523@kfi7 LPNI seq info [699606:699606:16:4294967295]
00000400:00000200:31.0:1773851858.735745:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007702bf92 nid 17523@kfi7 refs 2
00000400:00000200:31.0:1773851858.735746:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17523@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.735750:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17523@kfi7(17523@kfi7:17523@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851858.735752:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007702bf92 nid 17523@kfi7 refs 3
00000800:00000200:31.0:1773851858.735754:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851858.735756:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851858.735759:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851858.735763:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000050d Using peer 17523@kfi7(0x10000000000050d)
00000800:00000200:31.0:1773851858.735768:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x10000000000050d: rc=0
00000800:00000200:31.0:1773851858.735770:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000050d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851858.735773:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.735775:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008ef4afe0 refcount 2 to 17523@kfi7
00010000:00000001:31.0:1773851858.735776:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851858.735777:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.735778:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851858.735779:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c71f8a20 x1859597747598272/t0(0) o400->aed76d8b-1e85-4758-abaa-a1be9a9c0353@17523@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1578-0'
00000100:00100000:31.0:1773851858.735784:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c71f8a20 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:aed76d8b-1e85-4758-abaa-a1be9a9c0353+5:39606:x1859597747598272:12345-17523@kfi7:400:default-tuolumne1578-0 Request processed in 103us (159us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851858.735786:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000050d TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851858.735788:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851858.735790:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17523@kfi7, seq: 2055479
00000400:00000200:29.0:1773851858.735790:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17523@kfi7: PUT: OK
00000400:00000200:29.0:1773851858.735791:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004e2b8359
00000100:00000040:31.0:1773851858.735792:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001d4cf576 : new rpc_count 0
00000400:00000010:29.0:1773851858.735792:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004e2b8359.
00000100:00000001:31.0:1773851858.735793:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851858.735793:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851858.735794:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:29.0:1773851858.735794:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851858.735795:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851858.735795:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007702bf92 nid 17523@kfi7 refs 2
00000020:00000010:31.0:1773851858.735796:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851858.735797:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e268637b.
00000800:00000200:29.0:1773851858.735797:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 17523@kfi7(000000001fb0997d):0x0 lsk 1294 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000050d Transaction freed
00000020:00000040:31.0:1773851858.735798:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000001d4cf576 : new refcount 4
00000100:00000001:31.0:1773851858.735800:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851858.739285:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851858.739286:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851858.739288:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851858.739291:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851858.739294:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10401@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.739296:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10401@kfi7 : PUT - for me
00000400:00000200:17.0:1773851858.739297:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10401@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.739298:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087cfa753 nid 10401@kfi7 refs 1
00000400:00000200:17.0:1773851858.739300:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10401@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.739301:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087cfa753 nid 10401@kfi7 refs 2
00000400:00000200:17.0:1773851858.739302:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000087cfa753 nid 10401@kfi7 refs 3
00000400:00000200:17.0:1773851858.739303:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10401@kfi7 to cpt 4
00000400:00000200:17.0:1773851858.739306:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10401@kfi7 of length 224 into portal 12 MB=0x699e11132cb40
00000400:00000200:17.0:1773851858.739308:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10401@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 193888
00000800:00000200:17.0:1773851858.739311:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851858.739313:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851858.739315:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10401@kfi7: PUT: OK
00000100:00000001:17.0:1773851858.739316:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851858.739317:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851858.739318:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000341b955c.
00000100:00000040:17.0:1773851858.739319:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000341b955c x1858041795496768 msgsize 224
00000100:00100000:17.0:1773851858.739321:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-10401@kfi7 (source: 12345-10401@kfi7)
00000100:00000001:17.0:1773851858.739322:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851858.739324:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000087cfa753 nid 10401@kfi7 refs 2
00000100:00000001:19.0:1773851858.739325:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851858.739326:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851858.739326:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851858.739326:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851858.739327:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851858.739328:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851858.739329:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041795496768
00000020:00000001:19.0:1773851858.739330:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851858.739331:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91682
00000020:00000001:19.0:1773851858.739332:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851858.739334:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000221850a6 refcount=158
00000020:00000001:19.0:1773851858.739335:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241243648 : -107152468307968 : ffff9e8b9f309000)
00000020:00000001:19.0:1773851858.739336:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241243648 : -107152468307968 : ffff9e8b9f309000)
00000100:00000001:19.0:1773851858.739338:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.739340:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851858.739341:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851858.739342:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851858.739343:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851858.739344:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851858.739345:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851858.739346:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.739347:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851858.739348:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851858.739349:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.739350:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851858.739352:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851858.739353:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851858.739353:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851858.739353:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851858.739354:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10401@kfi7, seq: 2156278
00000100:00000040:19.0:1773851858.739355:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000221850a6 : new rpc_count 1
00000100:00000001:19.0:1773851858.739356:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764360960 : -107095945190656 : ffff9e98c83ae300)
00000100:00000001:18.0:1773851858.739356:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851858.739357:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.739358:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000341b955c x1858041795496768/t0(0) o400->b6f312c2-b0c0-43b6-87dd-7644fb88cd55@10401@kfi7:48/0 lens 224/0 e 0 to 0 dl 1773852163 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1136-0'
00000100:00000001:19.0:1773851858.739363:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851858.739363:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851858.739365:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000341b955c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b6f312c2-b0c0-43b6-87dd-7644fb88cd55+158:39872:x1858041795496768:12345-10401@kfi7:400:default-tuolumne1136-0
00000100:00000200:19.0:1773851858.739367:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041795496768
00000020:00000001:19.0:1773851858.739367:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851858.739368:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851858.739369:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.739370:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851858.739371:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851858.739372:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851858.739373:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041795496768, found 0 last_xid 1858041795082559
00000020:00000001:19.0:1773851858.739374:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851858.739375:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851858.739376:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851858.739377:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.739382:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851858.739382:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851858.739383:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851858.739384:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d118fe66.
02000000:00000001:19.0:1773851858.739385:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.739386:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.739387:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851858.739388:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062654, transno 0, xid 1858041795496768
00010000:00000001:19.0:1773851858.739389:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851858.739391:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000341b955c x1858041795496768/t0(0) o400->b6f312c2-b0c0-43b6-87dd-7644fb88cd55@10401@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1136-0'
00010000:00000001:19.0:1773851858.739395:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851858.739396:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851858.739397:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=91 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851858.739398:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851858.739399:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000002d9735d refcount 3 to 10401@kfi7
00000100:00000001:19.0:1773851858.739401:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301331648 : -107155408219968 : ffff9e8aeff510c0)
02000000:00000001:19.0:1773851858.739402:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851858.739403:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851858.739404:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851858.739405:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10401@kfi7
00000400:00000010:19.0:1773851858.739406:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7522538.
00000100:00000200:19.0:1773851858.739407:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041795496768, offset 224
00000400:00000200:19.0:1773851858.739409:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10401@kfi7
00000400:00000200:19.0:1773851858.739410:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10401@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.739412:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087cfa753 nid 10401@kfi7 refs 1
00000400:00000200:19.0:1773851858.739413:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000087cfa753 nid 10401@kfi7 refs 2
00000400:00000200:19.0:1773851858.739415:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000087cfa753 nid 10401@kfi7 refs 3
00000400:00000200:19.0:1773851858.739417:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10401@kfi7 local destination
00000400:00000200:19.0:1773851858.739419:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768799:8768799:1024:4294967295] 10401@kfi7 LPNI seq info [773562:773562:16:4294967295]
00000400:00000200:19.0:1773851858.739421:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000087cfa753 nid 10401@kfi7 refs 2
00000400:00000200:19.0:1773851858.739423:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10401@kfi7 to cpt 4
00000400:00000200:19.0:1773851858.739426:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10401@kfi7(10401@kfi7:10401@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851858.739429:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000087cfa753 nid 10401@kfi7 refs 3
00000800:00000200:19.0:1773851858.739431:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851858.739432:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851858.739436:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851858.739440:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005b2 Using peer 10401@kfi7(0x1000000000005b2)
00000800:00000200:19.0:1773851858.739444:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x1000000000005b2: rc=0
00000800:00000200:19.0:1773851858.739446:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005b2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851858.739449:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851858.739451:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000002d9735d refcount 2 to 10401@kfi7
00010000:00000001:19.0:1773851858.739452:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851858.739453:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851858.739454:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851858.739455:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000341b955c x1858041795496768/t0(0) o400->b6f312c2-b0c0-43b6-87dd-7644fb88cd55@10401@kfi7:48/0 lens 224/224 e 0 to 0 dl 1773852163 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1136-0'
00000100:00100000:19.0:1773851858.739460:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000341b955c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b6f312c2-b0c0-43b6-87dd-7644fb88cd55+158:39872:x1858041795496768:12345-10401@kfi7:400:default-tuolumne1136-0 Request processed in 96us (140us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851858.739460:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005b2 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851858.739462:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851858.739464:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10401@kfi7, seq: 2156278
00000400:00000200:17.0:1773851858.739464:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10401@kfi7: PUT: OK
00000100:00000040:19.0:1773851858.739465:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000221850a6 : new rpc_count 0
00000400:00000200:17.0:1773851858.739465:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7522538
00000100:00000001:19.0:1773851858.739466:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:17.0:1773851858.739466:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7522538.
00000100:00000001:19.0:1773851858.739467:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851858.739467:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000100:00000001:17.0:1773851858.739467:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851858.739467:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851858.739468:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000400:00000200:17.0:1773851858.739468:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000087cfa753 nid 10401@kfi7 refs 2
00000020:00000010:19.0:1773851858.739470:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000020:00000040:19.0:1773851858.739471:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000221850a6 : new refcount 157
00000800:00000200:17.0:1773851858.739471:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 10401@kfi7(000000003bc54275):0x0 lsk 1459 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005b2 Transaction freed
00000100:00000001:19.0:1773851858.739472:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851858.754734:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.754735:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851858.754736:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851858.754738:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851858.754739:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10882@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.754741:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10882@kfi7 : PUT - for me
00000400:00000200:9.0:1773851858.754741:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10882@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.754742:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000037d640a nid 10882@kfi7 refs 1
00000400:00000200:9.0:1773851858.754743:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10882@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.754744:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000037d640a nid 10882@kfi7 refs 2
00000400:00000200:9.0:1773851858.754745:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000037d640a nid 10882@kfi7 refs 3
00000400:00000200:9.0:1773851858.754746:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10819@kfi7 to cpt 2
00000400:00000200:9.0:1773851858.754746:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10819@kfi7 of length 224 into portal 12 MB=0x69b09f9a20000
00000400:00000200:9.0:1773851858.754747:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10819@kfi7 of length 224/224 into md 0x78146ce49 [64] + 125456
00000800:00000200:9.0:1773851858.754750:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851858.754752:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851858.754753:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10882@kfi7: PUT: OK
00000100:00000001:9.0:1773851858.754754:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851858.754754:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851858.754755:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b2003b69.
00000100:00000040:9.0:1773851858.754756:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000b2003b69 x1859317005418496 msgsize 224
00000100:00100000:9.0:1773851858.754757:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10819@kfi7 (source: 12345-10882@kfi7)
00000100:00000001:9.0:1773851858.754758:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:10.0:1773851858.754759:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851858.754759:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000037d640a nid 10882@kfi7 refs 2
02000000:00000001:10.0:1773851858.754760:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851858.754760:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851858.754760:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851858.754761:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851858.754762:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851858.754762:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317005418496
00000020:00000001:10.0:1773851858.754763:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851858.754763:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9100e
00000020:00000001:10.0:1773851858.754764:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851858.754767:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d30b94fe refcount=6
00000020:00000001:10.0:1773851858.754767:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240096768 : -107152469454848 : ffff9e8b9f1f1000)
00000020:00000001:10.0:1773851858.754768:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240096768 : -107152469454848 : ffff9e8b9f1f1000)
00000100:00000001:10.0:1773851858.754769:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.754771:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851858.754771:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000776bdb17.
00000020:00000010:10.0:1773851858.754772:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851858.754773:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851858.754774:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851858.754775:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851858.754775:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.754776:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851858.754776:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851858.754777:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.754778:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851858.754779:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851858.754780:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851858.754780:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851858.754780:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10819@kfi7, seq: 2130740
00000100:00000001:11.0:1773851858.754781:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:10.0:1773851858.754781:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d30b94fe : new rpc_count 1
00000100:00000001:11.0:1773851858.754782:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.754782:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064881024 : -106983644670592 : ffff9eb2eddcd580)
00000100:00000001:11.0:1773851858.754783:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.754783:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b2003b69 x1859317005418496/t0(0) o400->23aa6510-a442-4dcb-85ac-14e3205373c7@10819@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1176-0'
00000100:00000001:10.0:1773851858.754786:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851858.754786:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851858.754787:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b2003b69 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:23aa6510-a442-4dcb-85ac-14e3205373c7+6:39838:x1859317005418496:12345-10819@kfi7:400:default-tuolumne1176-0
00000100:00000200:10.0:1773851858.754789:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317005418496
00000020:00000001:10.0:1773851858.754789:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851858.754790:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851858.754790:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.754791:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851858.754792:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851858.754792:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851858.754793:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317005418496, found 0 last_xid 1859317005418495
00000020:00000001:10.0:1773851858.754794:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851858.754794:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851858.754795:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851858.754795:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.754797:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851858.754798:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851858.754798:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851858.754799:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f53147d2.
02000000:00000001:10.0:1773851858.754800:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.754800:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.754801:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851858.754802:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035347060, transno 0, xid 1859317005418496
00010000:00000001:10.0:1773851858.754803:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851858.754803:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b2003b69 x1859317005418496/t0(0) o400->23aa6510-a442-4dcb-85ac-14e3205373c7@10819@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1176-0'
00010000:00000001:10.0:1773851858.754806:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851858.754807:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851858.754807:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=91 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851858.754808:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851858.754809:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e050291 refcount 3 to 10819@kfi7
00000100:00000001:10.0:1773851858.754810:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580544 : -107154806971072 : ffff9e8b13cb6540)
02000000:00000001:10.0:1773851858.754810:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851858.754811:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.754812:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851858.754812:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10882@kfi7
00000400:00000010:10.0:1773851858.754813:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002710dee6.
00000100:00000200:10.0:1773851858.754814:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317005418496, offset 224
00000400:00000200:10.0:1773851858.754815:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10882@kfi7
00000400:00000200:10.0:1773851858.754815:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10882@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.754816:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000037d640a nid 10882@kfi7 refs 1
00000400:00000200:10.0:1773851858.754817:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000037d640a nid 10882@kfi7 refs 2
00000400:00000200:10.0:1773851858.754818:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000037d640a nid 10882@kfi7 refs 3
00000400:00000200:10.0:1773851858.754819:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10882@kfi7 local destination
00000400:00000200:10.0:1773851858.754820:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768800:8768800:1024:4294967295] 10882@kfi7 LPNI seq info [369008:369008:16:4294967295]
00000400:00000200:10.0:1773851858.754822:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000037d640a nid 10882@kfi7 refs 2
00000400:00000200:10.0:1773851858.754823:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10882@kfi7 to cpt 2
00000400:00000200:10.0:1773851858.754824:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10882@kfi7(10882@kfi7:10882@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851858.754826:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000037d640a nid 10882@kfi7 refs 3
00000800:00000200:10.0:1773851858.754827:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851858.754828:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851858.754830:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851858.754833:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b36 Using peer 10882@kfi7(0x100000000000b36)
00000800:00000200:10.0:1773851858.754836:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000003858ee31: Posted send of 324 bytes to peer 0x100000000000b36: rc=0
00000800:00000200:10.0:1773851858.754837:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b36 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851858.754839:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.754840:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e050291 refcount 2 to 10819@kfi7
00010000:00000001:10.0:1773851858.754841:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851858.754841:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851858.754842:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851858.754843:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b2003b69 x1859317005418496/t0(0) o400->23aa6510-a442-4dcb-85ac-14e3205373c7@10819@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1176-0'
00000100:00100000:10.0:1773851858.754846:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b2003b69 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:23aa6510-a442-4dcb-85ac-14e3205373c7+6:39838:x1859317005418496:12345-10819@kfi7:400:default-tuolumne1176-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851858.754848:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10819@kfi7, seq: 2130740
00000100:00000040:10.0:1773851858.754849:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d30b94fe : new rpc_count 0
00000100:00000001:10.0:1773851858.754849:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851858.754850:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851858.754850:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000800:00000200:9.0:1773851858.754850:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b36 TN_EVENT_TX_OK event status 0
00000020:00000010:10.0:1773851858.754851:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:10.0:1773851858.754852:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000776bdb17.
00000400:00000200:9.0:1773851858.754852:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:10.0:1773851858.754853:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000d30b94fe : new refcount 5
00000400:00000200:9.0:1773851858.754853:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10882@kfi7: PUT: OK
00000100:00000001:10.0:1773851858.754854:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851858.754854:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002710dee6
00000400:00000010:9.0:1773851858.754854:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002710dee6.
00000100:00000001:9.0:1773851858.754855:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851858.754855:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851858.754856:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000037d640a nid 10882@kfi7 refs 2
00000800:00000200:9.0:1773851858.754858:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 10882@kfi7(0000000089a675ec):0x0 lsk 2871 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b36 Transaction freed
00000800:00000200:2.0:1773851858.756626:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851858.756627:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851858.756628:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851858.756630:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851858.756633:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23152@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.756634:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23152@kfi7 : PUT - for me
00000400:00000200:2.0:1773851858.756635:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23152@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.756635:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000266c482f nid 23152@kfi7 refs 1
00000400:00000200:2.0:1773851858.756636:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23152@kfi7 to cpt 0
00000400:00000200:2.0:1773851858.756637:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000266c482f nid 23152@kfi7 refs 2
00000400:00000200:2.0:1773851858.756638:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000266c482f nid 23152@kfi7 refs 3
00000400:00000200:2.0:1773851858.756639:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23153@kfi7 to cpt 3
00000400:00000200:2.0:1773851858.756640:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23153@kfi7 of length 224 into portal 12 MB=0x69a9da365f3c0
00000400:00000200:2.0:1773851858.756641:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23153@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 17600
00000800:00000200:2.0:1773851858.756642:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851858.756644:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851858.756645:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23152@kfi7: PUT: OK
00000100:00000001:2.0:1773851858.756646:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851858.756647:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851858.756647:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003b49a468.
00000100:00000040:2.0:1773851858.756648:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000003b49a468 x1858851702174656 msgsize 224
00000100:00100000:2.0:1773851858.756649:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-23153@kfi7 (source: 12345-23152@kfi7)
00000100:00000001:2.0:1773851858.756650:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851858.756651:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000266c482f nid 23152@kfi7 refs 2
00000800:00000200:2.0:1773851858.756652:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851858.756652:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851858.756652:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851858.756653:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851858.756654:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851858.756654:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851858.756655:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858851702174656
00000020:00000001:0.0:1773851858.756655:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851858.756656:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9154e
00000020:00000001:0.0:1773851858.756657:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851858.756659:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d60c2590 refcount=57
00000020:00000001:0.0:1773851858.756659:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241016320 : -107152468535296 : ffff9e8b9f2d1800)
00000020:00000001:0.0:1773851858.756660:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241016320 : -107152468535296 : ffff9e8b9f2d1800)
00000100:00000001:0.0:1773851858.756661:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.756662:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851858.756662:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001e6315df.
00000020:00000010:0.0:1773851858.756663:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.756664:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851858.756665:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851858.756665:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851858.756666:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.756667:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851858.756667:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851858.756668:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.756668:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.756670:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851858.756671:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851858.756671:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851858.756671:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23153@kfi7, seq: 1997511
00000100:00000001:1.0:1773851858.756672:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851858.756672:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d60c2590 : new rpc_count 3
00000100:00000001:1.0:1773851858.756673:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.756673:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706797184 : -106953002754432 : ffff9eba10435e80)
00000100:00000001:1.0:1773851858.756674:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.756674:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003b49a468 x1858851702174656/t0(0) o400->ed7f393f-8111-4c3f-9ec0-8c7aba415125@23153@kfi7:498/0 lens 224/0 e 0 to 0 dl 1773852613 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1934-0'
00000100:00000001:0.0:1773851858.756677:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.756677:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851858.756678:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b49a468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ed7f393f-8111-4c3f-9ec0-8c7aba415125+57:39836:x1858851702174656:12345-23153@kfi7:400:default-tuolumne1934-0
00000100:00000200:0.0:1773851858.756680:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858851702174656
00000020:00000001:0.0:1773851858.756680:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851858.756681:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851858.756682:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.756682:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851858.756683:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851858.756683:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851858.756684:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858851702174656, found 0 last_xid 1858851701611199
00000020:00000001:0.0:1773851858.756685:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851858.756686:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851858.756686:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851858.756687:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.756687:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851858.756688:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851858.756688:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851858.756689:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005d739c68.
02000000:00000001:0.0:1773851858.756690:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.756690:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.756691:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851858.756692:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581941, transno 0, xid 1858851702174656
00010000:00000001:0.0:1773851858.756692:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851858.756693:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003b49a468 x1858851702174656/t0(0) o400->ed7f393f-8111-4c3f-9ec0-8c7aba415125@23153@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1934-0'
00010000:00000001:0.0:1773851858.756698:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851858.756699:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851858.756700:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=91 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851858.756701:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851858.756701:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cdeac6ff refcount 3 to 23153@kfi7
00000100:00000001:0.0:1773851858.756702:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729297920 : -107155980253696 : ffff9e8acddc8600)
02000000:00000001:0.0:1773851858.756703:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851858.756703:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.756704:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851858.756705:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23152@kfi7
00000400:00000010:0.0:1773851858.756705:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000009e6d8.
00000100:00000200:0.0:1773851858.756706:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858851702174656, offset 224
00000400:00000200:0.0:1773851858.756707:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23152@kfi7
00000400:00000200:0.0:1773851858.756708:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23152@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.756708:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000266c482f nid 23152@kfi7 refs 1
00000400:00000200:0.0:1773851858.756709:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000266c482f nid 23152@kfi7 refs 2
00000400:00000200:0.0:1773851858.756710:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000266c482f nid 23152@kfi7 refs 3
00000400:00000200:0.0:1773851858.756711:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23152@kfi7 local destination
00000400:00000200:0.0:1773851858.756713:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768801:8768801:1024:4294967295] 23152@kfi7 LPNI seq info [2013262:2013262:16:4294967295]
00000400:00000200:0.0:1773851858.756714:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000266c482f nid 23152@kfi7 refs 2
00000400:00000200:0.0:1773851858.756715:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23152@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.756717:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23152@kfi7(23152@kfi7:23152@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851858.756718:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000266c482f nid 23152@kfi7 refs 3
00000800:00000200:0.0:1773851858.756719:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851858.756720:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851858.756722:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851858.756724:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x111b Using peer 23152@kfi7(0x111b)
00000800:00000200:0.0:1773851858.756732:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x111b: rc=0
00000800:00000200:0.0:1773851858.756733:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x111b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851858.756735:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.756736:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cdeac6ff refcount 2 to 23153@kfi7
00010000:00000001:0.0:1773851858.756737:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851858.756737:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.756738:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851858.756739:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003b49a468 x1858851702174656/t0(0) o400->ed7f393f-8111-4c3f-9ec0-8c7aba415125@23153@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1934-0'
00000100:00100000:0.0:1773851858.756743:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b49a468 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ed7f393f-8111-4c3f-9ec0-8c7aba415125+57:39836:x1858851702174656:12345-23153@kfi7:400:default-tuolumne1934-0 Request processed in 65us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851858.756745:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23153@kfi7, seq: 1997511
00000100:00000040:0.0:1773851858.756746:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d60c2590 : new rpc_count 2
00000100:00000001:0.0:1773851858.756747:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851858.756747:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851858.756748:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.756749:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851858.756750:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001e6315df.
00000020:00000040:0.0:1773851858.756750:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000d60c2590 : new refcount 56
00000100:00000001:0.0:1773851858.756751:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851858.756756:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x111b TN_EVENT_TX_OK event status 0
00000400:00000200:3.0:1773851858.756757:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851858.756758:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23152@kfi7: PUT: OK
00000400:00000200:3.0:1773851858.756759:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000009e6d8
00000400:00000010:3.0:1773851858.756760:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000009e6d8.
00000100:00000001:3.0:1773851858.756760:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851858.756761:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851858.756762:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000266c482f nid 23152@kfi7 refs 2
00000800:00000200:3.0:1773851858.756763:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23152@kfi7(00000000374782f4):0x0 lsk 4380 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x111b Transaction freed
00000004:00000001:11.0:1773851858.761730:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851858.761730:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851858.761731:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851858.761731:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851858.761731:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009d0add5.
00000004:00000001:3.0:1773851858.761731:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:15.0:1773851858.761732:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:10.0:1773851858.761732:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000004:00000020:3.0:1773851858.761732:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:15.0:1773851858.761733:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851858.761733:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cd342c1.
00000100:00000001:10.0:1773851858.761733:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:3.0:1773851858.761733:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009621ded3.
00000020:00000040:11.0:1773851858.761734:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
02000000:00000001:10.0:1773851858.761734:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:3.0:1773851858.761734:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000100:00000010:15.0:1773851858.761735:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008c78df86.
02000000:00000001:10.0:1773851858.761735:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:15.0:1773851858.761736:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:11.0:1773851858.761736:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:10.0:1773851858.761736:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000002f6163b3.
00000100:00000001:3.0:1773851858.761736:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851858.761737:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851858.761737:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.761737:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851858.761737:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:15.0:1773851858.761738:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851858.761738:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:3.0:1773851858.761738:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851858.761739:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:11.0:1773851858.761739:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000011f33f0e.
00000100:00000001:10.0:1773851858.761739:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851858.761740:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000009d0add5] to pc [ptlrpcd_02_02+2]  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:15.0:1773851858.761741:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851858.761741:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851858.761741:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000064eaaa6.
02000000:00000010:15.0:1773851858.761742:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000174d8ecc.
00000100:00000001:11.0:1773851858.761742:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851858.761743:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851858.761744:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851858.761744:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851858.761744:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:3.0:1773851858.761744:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000010:10.0:1773851858.761745:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000028a8b02c.
00000100:00000001:9.0:1773851858.761745:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851858.761745:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851858.761745:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851858.761745:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:3.0:1773851858.761745:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851858.761746:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:11.0:1773851858.761746:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007cd342c1] to pc [ptlrpcd_02_03+3]  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851858.761746:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637111650063360 : -106962059488256 : ffff9eb7f4709400)
00000100:00000001:8.0:1773851858.761746:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:15.0:1773851858.761747:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851858.761747:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:8.0:1773851858.761747:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:3.0:1773851858.761747:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000009621ded3] to pc [ptlrpcd_00_01+1]  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851858.761748:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851858.761749:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000008c78df86] to pc [ptlrpcd_03_03+3]  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:10.0:1773851858.761749:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00000100:00000001:8.0:1773851858.761749:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:10.0:1773851858.761750:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000706ae8d9.
00000004:00080000:10.0:1773851858.761750:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614133215026017ns, next at 614134215024685ns, rc = 0
00000100:00000001:8.0:1773851858.761750:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851858.761751:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851858.761751:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:11.0:1773851858.761752:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851858.761752:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851858.761752:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851858.761753:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851858.761753:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851858.761753:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:8.0:1773851858.761753:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051924736:31@kfi7:13:default-yuba2-0
00080000:00000010:11.0:1773851858.761754:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b91a248b.
00000100:00000001:9.0:1773851858.761754:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851858.761754:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:3.0:1773851858.761754:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851858.761755:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637097647672320 : -106976061879296 : ffff9eb4b1d50c00)
00000100:00000040:9.0:1773851858.761755:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851858.761755:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851858.761755:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851858.761756:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:8.0:1773851858.761756:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851858.761756:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000001f164fb.
00080000:00000010:3.0:1773851858.761756:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c9e59110.
00000100:00000001:2.0:1773851858.761756:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851858.761756:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851858.761757:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851858.761757:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:8.0:1773851858.761757:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851858.761757:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637143394776064 : -106930314775552 : ffff9ebf58927400)
00000100:00000001:2.0:1773851858.761757:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851858.761757:0:41060:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00000001:1.0:1773851858.761757:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.761758:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851858.761758:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851858.761758:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851858.761758:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:1.0:1773851858.761758:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000010:15.0:1773851858.761759:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d7f380fd.
00000100:00000001:14.0:1773851858.761759:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851858.761759:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851858.761759:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851858.761759:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:8.0:1773851858.761759:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00080000:00000001:3.0:1773851858.761759:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:1.0:1773851858.761759:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:15.0:1773851858.761760:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636938047762432 : -107135661789184 : ffff9e8f88efb000)
00000100:00000001:14.0:1773851858.761760:0:41075:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:11.0:1773851858.761760:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
02000000:00000001:9.0:1773851858.761760:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851858.761760:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00080000:00000001:3.0:1773851858.761760:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851858.761760:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851858.761760:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:14.0:1773851858.761761:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:11.0:1773851858.761761:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c83f1478.
00000100:00100000:9.0:1773851858.761761:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051924800:6@kfi7:13:default-yuba2-0
00000100:00000001:1.0:1773851858.761761:0:41060:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:15.0:1773851858.761762:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851858.761762:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851858.761762:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:8.0:1773851858.761762:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924736, portal 4
00000004:00001000:3.0:1773851858.761762:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000100:00000040:1.0:1773851858.761762:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:11.0:1773851858.761763:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614133215038841ns, next at 614134215036276ns, rc = 0
02000000:00000001:9.0:1773851858.761763:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851858.761763:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:8.0:1773851858.761763:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851858.761763:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105077439616 : -106968632112000 : ffff9eb66cae4c80)
00000004:00000010:3.0:1773851858.761763:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001da9472f.
00080000:00000001:15.0:1773851858.761764:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851858.761764:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d9f9a1c1.
00000100:00000040:8.0:1773851858.761764:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:15.0:1773851858.761765:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00080000:00000001:11.0:1773851858.761765:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:9.0:1773851858.761765:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:3.0:1773851858.761765:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614133215040034ns, next at 614134215038270ns, rc = 0
00000100:00000001:1.0:1773851858.761765:0:41060:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:1.0:1773851858.761765:0:41060:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:15.0:1773851858.761766:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005f0cab20.
00000400:00000200:9.0:1773851858.761766:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00080000:00000001:3.0:1773851858.761766:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:1.0:1773851858.761766:0:41060:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:14.0:1773851858.761767:0:41075:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:11.0:1773851858.761767:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851858.761767:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000100:00000001:8.0:1773851858.761767:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00080000:00000001:3.0:1773851858.761767:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851858.761767:0:41060:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:15.0:1773851858.761768:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614133215043129ns, next at 614134215041256ns, rc = 0
00000100:00000001:14.0:1773851858.761768:0:41075:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851858.761768:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851858.761768:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000040:8.0:1773851858.761768:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:8.0:1773851858.761768:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028d4f432.
00000100:00100000:1.0:1773851858.761768:0:41060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009621ded3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051924864:2095@kfi7:13:default-yuba2-0
02000000:00000001:14.0:1773851858.761769:0:41075:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000200:9.0:1773851858.761769:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924800, portal 4
00000100:00000001:9.0:1773851858.761769:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:8.0:1773851858.761769:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924736, offset 0
00000004:00000001:3.0:1773851858.761769:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851858.761769:0:41060:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:15.0:1773851858.761770:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:9.0:1773851858.761770:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889187328 : -106993820364288 : ffff9eb08f581200)
00000400:00000200:8.0:1773851858.761770:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
02000000:00000001:1.0:1773851858.761770:0:41060:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:14.0:1773851858.761771:0:41075:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851858.761771:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851858.761771:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
02000000:00000001:1.0:1773851858.761771:0:41060:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851858.761771:0:41060:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:15.0:1773851858.761772:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851858.761772:0:41075:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008c78df86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051924928:54@kfi7:13:default-yuba2-0
00000400:00000200:8.0:1773851858.761772:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000004:00000001:15.0:1773851858.761773:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851858.761773:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851858.761773:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
02000000:00000010:1.0:1773851858.761773:0:41060:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003ef8b576.
02000000:00000001:1.0:1773851858.761773:0:41060:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.761774:0:41075:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:9.0:1773851858.761774:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000200:8.0:1773851858.761774:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:1.0:1773851858.761774:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
02000000:00000001:14.0:1773851858.761775:0:41075:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:9.0:1773851858.761775:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003289b6e6.
00000100:00000200:9.0:1773851858.761775:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924800, offset 0
00000400:00000010:1.0:1773851858.761775:0:41060:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001d866e0e.
02000000:00000001:14.0:1773851858.761776:0:41075:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851858.761776:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000400:00000200:8.0:1773851858.761776:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000010:1.0:1773851858.761776:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000b2d6ec9.
02000000:00000001:14.0:1773851858.761777:0:41075:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:8.0:1773851858.761777:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768801, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768800, p:4294967295, g:4294967295, h:1000]
00000100:00000200:1.0:1773851858.761777:0:41060:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924864, portal 4
02000000:00000010:14.0:1773851858.761778:0:41075:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
00000100:00000001:1.0:1773851858.761778:0:41060:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:1.0:1773851858.761778:0:41060:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288699008 : -106964420852608 : ffff9eb767b10480)
02000000:00000001:14.0:1773851858.761779:0:41075:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851858.761779:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851858.761780:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:1.0:1773851858.761780:0:41060:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:14.0:1773851858.761781:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851858.761781:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000010:14.0:1773851858.761782:0:41075:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000400:00000200:8.0:1773851858.761782:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768802:8768802:1024:4294967295] 31@kfi7 LPNI seq info [5403616:5403616:16:4294967295]
00000100:00000001:1.0:1773851858.761782:0:41060:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:14.0:1773851858.761783:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000100:00000040:1.0:1773851858.761783:0:41060:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000200:8.0:1773851858.761784:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000010:1.0:1773851858.761784:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e89a281.
00000100:00000200:1.0:1773851858.761784:0:41060:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924864, offset 0
00000100:00000200:14.0:1773851858.761785:0:41075:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924928, portal 4
00000400:00000200:8.0:1773851858.761785:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:14.0:1773851858.761786:0:41075:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:9.0:1773851858.761786:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.761786:0:41060:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000100:00000001:14.0:1773851858.761787:0:41075:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860199936 : -107049849351680 : ffff9ea383c19200)
00000400:00000200:9.0:1773851858.761787:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:9.0:1773851858.761787:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:8.0:1773851858.761787:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851858.761787:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:1.0:1773851858.761788:0:41060:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:9.0:1773851858.761789:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:8.0:1773851858.761789:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:1.0:1773851858.761789:0:41060:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000040:14.0:1773851858.761790:0:41075:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851858.761790:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000200:9.0:1773851858.761791:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768801, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768802, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851858.761791:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:1.0:1773851858.761791:0:41060:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000800:00000200:8.0:1773851858.761792:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:1.0:1773851858.761792:0:41060:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:9.0:1773851858.761793:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:14.0:1773851858.761794:0:41075:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851858.761794:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851858.761794:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:1.0:1773851858.761794:0:41060:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768801, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768802, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851858.761795:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000100:00000040:14.0:1773851858.761796:0:41075:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000200:9.0:1773851858.761796:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768803:8768803:1024:4294967295] 6@kfi7 LPNI seq info [5405029:5405029:16:4294967295]
00000400:00000200:1.0:1773851858.761796:0:41060:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000010:14.0:1773851858.761797:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000686c292d.
00000800:00000200:8.0:1773851858.761797:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Using peer 31@kfi7(0x200000000000560)
00000400:00000200:1.0:1773851858.761797:0:41060:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000200:14.0:1773851858.761798:0:41075:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051924928, offset 0
00000400:00000200:9.0:1773851858.761798:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:1.0:1773851858.761798:0:41060:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:9.0:1773851858.761799:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.761799:0:41060:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768804:8768804:1024:4294967295] 2095@kfi7 LPNI seq info [5406040:5406040:16:4294967295]
00000400:00000200:14.0:1773851858.761800:0:41075:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:1.0:1773851858.761801:0:41060:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:14.0:1773851858.761802:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:8.0:1773851858.761802:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x200000000000560: rc=0
00000400:00000200:1.0:1773851858.761802:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851858.761803:0:41075:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000800:00000200:8.0:1773851858.761804:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851858.761805:0:41075:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851858.761806:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851858.761806:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851858.761806:0:41060:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851858.761807:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:1.0:1773851858.761807:0:41060:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:14.0:1773851858.761808:0:41075:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851858.761808:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:8.0:1773851858.761808:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851858.761808:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851858.761809:0:41075:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000100:00000001:8.0:1773851858.761809:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851858.761809:0:41060:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:9.0:1773851858.761810:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851858.761810:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:9.0:1773851858.761811:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851858.761811:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:1.0:1773851858.761811:0:41060:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:14.0:1773851858.761812:0:41075:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8768804, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8768802, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851858.761813:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851858.761813:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851858.761814:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:1.0:1773851858.761814:0:41060:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:14.0:1773851858.761816:0:41075:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:9.0:1773851858.761816:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Using peer 6@kfi7(0x54b)
00000400:00000200:14.0:1773851858.761817:0:41075:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:8.0:1773851858.761817:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851858.761817:0:41060:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000100:00000001:8.0:1773851858.761818:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851858.761819:0:41075:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000800:00000200:10.0:1773851858.761819:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851858.761820:0:41075:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768805:8768805:1023:4294967295] 54@kfi7 LPNI seq info [5403920:5403920:16:4294967295]
00000800:00000200:9.0:1773851858.761820:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x54b: rc=0
00000400:00000200:10.0:1773851858.761821:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:1.0:1773851858.761821:0:41060:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 324 bytes to peer 0x5c0: rc=0
00000800:00000200:9.0:1773851858.761822:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:1.0:1773851858.761822:0:41060:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851858.761823:0:41075:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:10.0:1773851858.761823:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000400:00000200:14.0:1773851858.761824:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:10.0:1773851858.761824:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028d4f432
00000400:00000010:10.0:1773851858.761824:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028d4f432.
00000100:00000001:9.0:1773851858.761824:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851858.761824:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:1.0:1773851858.761824:0:41060:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.761825:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851858.761825:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851858.761825:0:41060:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:10.0:1773851858.761826:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851858.761826:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851858.761826:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851858.761826:0:41060:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851858.761827:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851858.761827:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851858.761827:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851858.761828:0:41075:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000100:00000001:10.0:1773851858.761828:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851858.761828:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851858.761828:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851858.761829:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851858.761829:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851858.761830:0:41075:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000100:00000040:10.0:1773851858.761830:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851858.761830:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851858.761832:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851858.761833:0:41075:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000001:10.0:1773851858.761833:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:9.0:1773851858.761833:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851858.761834:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:9.0:1773851858.761834:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:14.0:1773851858.761835:0:41075:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851858.761835:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Transaction freed
00000400:00000200:9.0:1773851858.761836:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000400:00000200:9.0:1773851858.761836:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003289b6e6
00000800:00000200:2.0:1773851858.761836:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000400:00000010:9.0:1773851858.761837:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003289b6e6.
00000100:00000001:9.0:1773851858.761837:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851858.761838:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:14.0:1773851858.761839:0:41075:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:2.0:1773851858.761839:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851858.761841:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:2.0:1773851858.761841:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000100:00000040:9.0:1773851858.761842:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851858.761842:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e89a281
00000800:00000200:14.0:1773851858.761843:0:41075:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000400:00000010:2.0:1773851858.761843:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e89a281.
00000100:00000001:9.0:1773851858.761844:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851858.761845:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:2.0:1773851858.761845:0:2506505:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:9.0:1773851858.761846:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:9.0:1773851858.761847:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Transaction freed
00000100:00000200:2.0:1773851858.761847:0:2506505:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:14.0:1773851858.761848:0:41075:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000dac95d1f: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000800:00000200:14.0:1773851858.761850:0:41075:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851858.761852:0:2506505:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:2.0:1773851858.761853:0:2506505:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851858.761854:0:41075:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.761855:0:41075:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851858.761856:0:41075:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.761857:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851858.761858:0:2506505:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.761859:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851858.761859:0:2506505:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:2.0:1773851858.761860:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:14.0:1773851858.761861:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:14.0:1773851858.761861:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:14.0:1773851858.761863:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:2.0:1773851858.761863:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000100:00000001:14.0:1773851858.761864:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:14.0:1773851858.761864:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851858.761865:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851858.761866:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851858.761867:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851858.761868:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851858.761868:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:18.0:1773851858.761870:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851858.761871:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:13.0:1773851858.761872:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000686c292d
00000800:00000200:18.0:1773851858.761873:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000010:13.0:1773851858.761873:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000686c292d.
00000100:00000001:13.0:1773851858.761874:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:18.0:1773851858.761876:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000200:13.0:1773851858.761876:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851858.761877:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:18.0:1773851858.761878:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:18.0:1773851858.761878:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000800:00000200:29.0:1773851858.761880:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:18.0:1773851858.761880:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:18.0:1773851858.761880:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:18.0:1773851858.761881:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000100:00000001:13.0:1773851858.761881:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:29.0:1773851858.761882:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:18.0:1773851858.761882:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:18.0:1773851858.761883:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2900
00000100:00000040:13.0:1773851858.761883:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851858.761884:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851858.761885:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:18.0:1773851858.761886:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f0931 [1] + 224
00000800:00000200:29.0:1773851858.761887:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:13.0:1773851858.761887:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.761888:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:18.0:1773851858.761889:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851858.761890:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:18.0:1773851858.761890:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851858.761890:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:29.0:1773851858.761892:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:18.0:1773851858.761892:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000100:00000001:18.0:1773851858.761893:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851858.761893:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000400:00000200:29.0:1773851858.761894:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000200:18.0:1773851858.761894:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851858.761894:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851858.761894:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851858.761895:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000800:00000200:1.0:1773851858.761896:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851858.761897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000040:18.0:1773851858.761897:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851858.761898:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000800:00000200:1.0:1773851858.761898:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851858.761899:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:1.0:1773851858.761900:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851858.761901:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:18.0:1773851858.761901:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851858.761902:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:29.0:1773851858.761903:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2980
00000400:00000200:18.0:1773851858.761903:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:8.0:1773851858.761903:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:1.0:1773851858.761903:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:18.0:1773851858.761904:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851858.761904:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:8.0:1773851858.761904:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:1.0:1773851858.761904:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:29.0:1773851858.761905:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000001:8.0:1773851858.761905:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:1.0:1773851858.761905:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000010:8.0:1773851858.761906:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000400:00000200:8.0:1773851858.761906:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000200:1.0:1773851858.761906:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:29.0:1773851858.761907:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78007ff9d [1] + 224
00000400:00000010:8.0:1773851858.761907:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000400:00000200:1.0:1773851858.761907:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000800:00000200:13.0:1773851858.761908:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000001:8.0:1773851858.761908:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851858.761909:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:8.0:1773851858.761909:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851858.761909:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:29.0:1773851858.761910:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851858.761910:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2940
00000400:00000200:1.0:1773851858.761911:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:13.0:1773851858.761912:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:8.0:1773851858.761912:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851858.761913:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.761913:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71cf61 [1] + 224
00000100:00000001:8.0:1773851858.761914:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851858.761915:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000800:00000200:13.0:1773851858.761915:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:8.0:1773851858.761915:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851858.761915:0:41070:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:1.0:1773851858.761915:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:8.0:1773851858.761916:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851858.761916:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851858.761917:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851858.761917:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851858.761918:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851858.761918:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:29.0:1773851858.761919:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851858.761919:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00001000:8.0:1773851858.761919:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=91 v=66 (66 66 66 66)
00000400:00000200:1.0:1773851858.761919:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000100:00001000:8.0:1773851858.761920:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=91 v=66 (1 1 1 1)
00000100:00000001:1.0:1773851858.761920:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851858.761921:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000100:00000200:1.0:1773851858.761921:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851858.761922:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:8.0:1773851858.761922:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851858.761922:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851858.761923:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:29.0:1773851858.761924:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851858.761924:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00010000:00000001:8.0:1773851858.761924:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851858.761925:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:8.0:1773851858.761925:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851858.761925:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000001:8.0:1773851858.761925:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:1.0:1773851858.761925:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851858.761926:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:8.0:1773851858.761926:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851858.761927:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:13.0:1773851858.761928:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000100:00000001:1.0:1773851858.761928:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851858.761929:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:13.0:1773851858.761930:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:9.0:1773851858.761930:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851858.761930:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851858.761931:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851858.761931:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b29c0
00000100:00000001:9.0:1773851858.761931:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851858.761931:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851858.761931:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851858.761931:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:9.0:1773851858.761932:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851858.761932:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000001:8.0:1773851858.761932:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:29.0:1773851858.761933:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:13.0:1773851858.761933:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000010:9.0:1773851858.761933:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000004:00000040:8.0:1773851858.761933:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851858.761933:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666737152 avail=351645490176 avail_mb=1373615196 hwm_mb=3131103 files=372237991 ffree=343424548 state=0: rc = 0
00000400:00000200:9.0:1773851858.761934:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000400:00000010:9.0:1773851858.761934:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000800:00000200:29.0:1773851858.761935:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851858.761935:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f598d [1] + 224
00000100:00000001:9.0:1773851858.761935:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000020:8.0:1773851858.761935:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666737152 free, 351645490176 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237991 files, 343424548 free files
00000100:00000001:3.0:1773851858.761935:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:9.0:1773851858.761936:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:8.0:1773851858.761936:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851858.761936:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:8.0:1773851858.761937:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:13.0:1773851858.761938:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:3.0:1773851858.761938:0:41060:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:3.0:1773851858.761938:0:41060:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:9.0:1773851858.761939:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:8.0:1773851858.761940:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000009d0add5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051924736:31@kfi7:13:default-yuba2-0
00000400:00000010:3.0:1773851858.761940:0:41060:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001d866e0e.
00000400:00000200:13.0:1773851858.761941:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851858.761941:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:3.0:1773851858.761941:0:41060:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000b2d6ec9
00000100:00000001:9.0:1773851858.761942:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851858.761942:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851858.761942:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851858.761942:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851858.761942:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:3.0:1773851858.761942:0:41060:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000b2d6ec9.
00000400:00000200:13.0:1773851858.761943:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000100:00000001:9.0:1773851858.761943:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:8.0:1773851858.761943:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000009d0add5 x1859433051924736/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:3.0:1773851858.761943:0:41060:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851858.761944:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851858.761944:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:3.0:1773851858.761944:0:41060:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851858.761945:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:9.0:1773851858.761945:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=91 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851858.761945:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:13.0:1773851858.761946:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:9.0:1773851858.761946:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=6 v=66 (1 1 1 1)
02000000:00000001:8.0:1773851858.761946:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:9.0:1773851858.761947:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851858.761947:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851858.761947:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000001f164fb.
00010000:00000001:9.0:1773851858.761948:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851858.761948:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851858.761948:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:9.0:1773851858.761949:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000020:00000001:8.0:1773851858.761949:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:9.0:1773851858.761950:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000001:9.0:1773851858.761950:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000020:00000040:8.0:1773851858.761950:0:41070:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000020:00000001:8.0:1773851858.761950:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000200:3.0:1773851858.761950:0:41060:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:13.0:1773851858.761951:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851858.761951:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851858.761951:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000002f6163b3.
00000100:00000040:9.0:1773851858.761952:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:8.0:1773851858.761952:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851858.761953:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851858.761953:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009d0add5.
00000100:00000001:9.0:1773851858.761954:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851858.761954:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851858.761954:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851858.761954:0:41060:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851858.761955:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851858.761955:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851858.761955:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851858.761955:0:41060:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851858.761956:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851858.761956:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000100:00000001:8.0:1773851858.761956:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851858.761956:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851858.761956:0:41060:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:13.0:1773851858.761957:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:9.0:1773851858.761957:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420305408 avail=351417826304 avail_mb=1372725884 hwm_mb=3131103 files=372009077 ffree=343183892 state=0: rc = 0
00000100:00000001:8.0:1773851858.761957:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851858.761957:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851858.761957:0:41060:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:3.0:1773851858.761957:0:41060:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:13.0:1773851858.761958:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:3.0:1773851858.761958:0:41060:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.761959:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851858.761959:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000020:9.0:1773851858.761959:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420305408 free, 351417826304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372009077 files, 343183892 free files
00000004:00000001:9.0:1773851858.761960:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851858.761960:0:41060:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:14.0:1773851858.761961:0:41075:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:14.0:1773851858.761961:0:41075:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:13.0:1773851858.761961:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000040:9.0:1773851858.761961:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:14.0:1773851858.761962:0:41075:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000100:00001000:3.0:1773851858.761962:0:41060:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=91 v=66 (66 66 66 66)
00000400:00000200:14.0:1773851858.761963:0:41075:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
00000400:00000010:14.0:1773851858.761964:0:41075:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000100:00100000:9.0:1773851858.761964:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051924800:6@kfi7:13:default-yuba2-0
00000100:00000001:14.0:1773851858.761965:0:41075:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851858.761965:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:3.0:1773851858.761965:0:41060:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=91 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851858.761966:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:3.0:1773851858.761966:0:41060:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:14.0:1773851858.761967:0:41075:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851858.761967:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007cd342c1 x1859433051924800/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:3.0:1773851858.761967:0:41060:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:3.0:1773851858.761968:0:41060:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:9.0:1773851858.761969:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851858.761969:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00010000:00000001:3.0:1773851858.761969:0:41060:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851858.761970:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d9f9a1c1.
02000000:00000001:9.0:1773851858.761971:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851858.761971:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851858.761971:0:41071:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000100:00000001:3.0:1773851858.761971:0:41060:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:3.0:1773851858.761971:0:41060:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000200:14.0:1773851858.761972:0:41075:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:9.0:1773851858.761972:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851858.761972:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000011f33f0e.
00000100:00000001:3.0:1773851858.761972:0:41060:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000001:9.0:1773851858.761973:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:3.0:1773851858.761973:0:41060:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851858.761974:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851858.761974:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cd342c1.
00000100:00000001:9.0:1773851858.761975:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851858.761975:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:3.0:1773851858.761975:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:14.0:1773851858.761976:0:41075:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851858.761976:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.761977:0:41075:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851858.761977:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:14.0:1773851858.761978:0:41075:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:14.0:1773851858.761978:0:41075:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851858.761978:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851858.761978:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851858.761979:0:41075:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851858.761979:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.761980:0:41075:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851858.761980:0:41060:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:14.0:1773851858.761981:0:41075:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851858.761981:0:41060:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:3.0:1773851858.761982:0:41060:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:14.0:1773851858.761983:0:41075:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=91 v=66 (66 66 66 66)
00000004:00000001:3.0:1773851858.761983:0:41060:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:3.0:1773851858.761984:0:41060:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000100:00001000:14.0:1773851858.761985:0:41075:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=91 v=66 (1 1 1 1)
00000004:00000040:3.0:1773851858.761986:0:41060:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449342976 avail=351446759424 avail_mb=1372838904 hwm_mb=3131103 files=372161050 ffree=343212249 state=0: rc = 0
00000100:00000001:14.0:1773851858.761987:0:41075:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:14.0:1773851858.761987:0:41075:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:14.0:1773851858.761988:0:41075:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:14.0:1773851858.761989:0:41075:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:3.0:1773851858.761989:0:41060:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449342976 free, 351446759424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372161050 files, 343212249 free files
00000100:00000001:14.0:1773851858.761991:0:41075:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:14.0:1773851858.761991:0:41075:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:14.0:1773851858.761992:0:41075:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:3.0:1773851858.761992:0:41060:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.761993:0:41075:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851858.761994:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:14.0:1773851858.761995:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:14.0:1773851858.761999:0:41075:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00100000:3.0:1773851858.761999:0:41060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009621ded3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051924864:2095@kfi7:13:default-yuba2-0
00000100:00000001:14.0:1773851858.762000:0:41075:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:14.0:1773851858.762001:0:41075:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:14.0:1773851858.762002:0:41075:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:3.0:1773851858.762002:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851858.762003:0:41060:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:3.0:1773851858.762004:0:41060:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000009621ded3 x1859433051924864/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:14.0:1773851858.762007:0:41075:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000004:00000040:14.0:1773851858.762008:0:41075:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399719424 free=351524111360 avail=351521354752 avail_mb=1373130292 hwm_mb=3131103 files=372113972 ffree=343285265 state=0: rc = 0
00000100:00000001:3.0:1773851858.762008:0:41060:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:3.0:1773851858.762009:0:41060:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000020:14.0:1773851858.762011:0:41075:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399719424 blocks, 351524111360 free, 351521354752 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113972 files, 343285265 free files
02000000:00000010:3.0:1773851858.762011:0:41060:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003ef8b576.
02000000:00000001:3.0:1773851858.762012:0:41060:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:3.0:1773851858.762013:0:41060:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000001:14.0:1773851858.762014:0:41075:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:3.0:1773851858.762014:0:41060:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000020:00000001:3.0:1773851858.762015:0:41060:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:14.0:1773851858.762016:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:3.0:1773851858.762016:0:41060:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000064eaaa6.
02000000:00000001:3.0:1773851858.762017:0:41060:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:3.0:1773851858.762018:0:41060:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:3.0:1773851858.762019:0:41060:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009621ded3.
00000100:00000001:3.0:1773851858.762020:0:41060:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00100000:14.0:1773851858.762021:0:41075:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008c78df86 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051924928:54@kfi7:13:default-yuba2-0
00000100:00000001:3.0:1773851858.762021:0:41060:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851858.762022:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.762023:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.762024:0:41075:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:3.0:1773851858.762024:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:14.0:1773851858.762025:0:41075:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000008c78df86 x1859433051924928/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852011 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:3.0:1773851858.762025:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851858.762026:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:3.0:1773851858.762026:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.762029:0:41075:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:14.0:1773851858.762030:0:41075:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:14.0:1773851858.762031:0:41075:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
02000000:00000001:14.0:1773851858.762033:0:41075:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:14.0:1773851858.762033:0:41075:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:14.0:1773851858.762034:0:41075:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000020:00000001:14.0:1773851858.762035:0:41075:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:14.0:1773851858.762036:0:41075:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000174d8ecc.
02000000:00000001:14.0:1773851858.762037:0:41075:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:14.0:1773851858.762038:0:41075:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:14.0:1773851858.762039:0:41075:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008c78df86.
00000100:00000001:14.0:1773851858.762040:0:41075:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:14.0:1773851858.762041:0:41075:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.762042:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.762044:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:14.0:1773851858.762044:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851858.762045:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851858.762046:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851858.818645:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.818645:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851858.818647:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.818647:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851858.818649:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.818649:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851858.818653:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851858.818653:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17232@kfi7(00000000cae34cb8):0xd0e version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851858.818656:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e Using peer 17232@kfi7(0xd0e)
00000400:00000200:26.0:1773851858.818657:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17232@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.818660:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17232@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.818660:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17232@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.818662:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17232@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.818663:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4900e03 nid 17232@kfi7 refs 1
00000800:00000200:25.0:1773851858.818663:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000016005f0: Posted send of 38 bytes to peer 0xd0e: rc=0
00000400:00000200:26.0:1773851858.818665:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17232@kfi7 to cpt 6
00000400:00000200:26.0:1773851858.818666:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4900e03 nid 17232@kfi7 refs 2
00000800:00000200:25.0:1773851858.818666:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851858.818668:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c4900e03 nid 17232@kfi7 refs 3
00000400:00000200:26.0:1773851858.818670:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17233@kfi7 to cpt 1
00000400:00000200:26.0:1773851858.818671:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17233@kfi7 of length 224 into portal 12 MB=0x69b4b5f718880
00000400:00000200:26.0:1773851858.818674:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17233@kfi7 of length 224/224 into md 0x16159c6179 [64] + 188376
00000800:00000200:26.0:1773851858.818677:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851858.818681:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851858.818681:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851858.818683:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17232@kfi7: PUT: OK
00000100:00000001:26.0:1773851858.818685:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851858.818686:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851858.818686:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e Transaction freed
00000100:00000010:26.0:1773851858.818687:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008b7e9902.
00000100:00000040:26.0:1773851858.818689:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000008b7e9902 x1859597886392448 msgsize 224
00000100:00100000:26.0:1773851858.818691:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-17233@kfi7 (source: 12345-17232@kfi7)
00000100:00000001:26.0:1773851858.818693:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851858.818695:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4900e03 nid 17232@kfi7 refs 2
00000100:00000001:25.0:1773851858.818696:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:26.0:1773851858.818698:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:25.0:1773851858.818698:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851858.818699:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851858.818700:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851858.818701:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851858.818703:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597886392448
00000020:00000001:25.0:1773851858.818704:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851858.818704:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822ed
00000020:00000001:25.0:1773851858.818706:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851858.818709:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000098935004 refcount=167
00000020:00000001:25.0:1773851858.818710:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131280827392 : -106942428724224 : ffff9ebc86864400)
00000020:00000001:25.0:1773851858.818711:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131280827392 : -106942428724224 : ffff9ebc86864400)
00000100:00000001:25.0:1773851858.818713:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851858.818715:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851858.818716:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000336ac53.
00000020:00000010:25.0:1773851858.818718:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851858.818720:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a35ab917.
00000100:00000001:25.0:1773851858.818721:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851858.818722:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851858.818723:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.818731:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851858.818732:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851858.818733:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.818735:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.818738:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851858.818738:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851858.818739:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851858.818739:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851858.818741:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17233@kfi7, seq: 2025064
00000100:00000040:25.0:1773851858.818743:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000098935004 : new rpc_count 1
00000100:00000001:24.0:1773851858.818743:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.818744:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139082136704 : -106934627414912 : ffff9ebe5784cc80)
00000100:00000001:24.0:1773851858.818744:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851858.818746:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008b7e9902 x1859597886392448/t0(0) o400->854a7fb4-d024-469b-8503-9ef1129b3fcf@17233@kfi7:75/0 lens 224/0 e 0 to 0 dl 1773852190 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1570-0'
00000100:00000001:25.0:1773851858.818752:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851858.818753:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851858.818754:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b7e9902 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:854a7fb4-d024-469b-8503-9ef1129b3fcf+167:39685:x1859597886392448:12345-17233@kfi7:400:default-tuolumne1570-0
00000100:00000200:25.0:1773851858.818757:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597886392448
00000020:00000001:25.0:1773851858.818759:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851858.818760:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851858.818761:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.818763:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851858.818764:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851858.818765:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851858.818767:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597886392448, found 0 last_xid 1859597885976255
00000020:00000001:25.0:1773851858.818769:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851858.818770:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851858.818771:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851858.818772:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.818773:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851858.818775:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851858.818776:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851858.818777:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000098cec3cc.
02000000:00000001:25.0:1773851858.818778:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.818780:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.818781:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851858.818782:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062804, transno 0, xid 1859597886392448
00010000:00000001:25.0:1773851858.818784:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851858.818786:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008b7e9902 x1859597886392448/t0(0) o400->854a7fb4-d024-469b-8503-9ef1129b3fcf@17233@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1570-0'
00010000:00000001:25.0:1773851858.818791:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851858.818792:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851858.818793:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=91 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851858.818795:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851858.818797:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dc464432 refcount 3 to 17233@kfi7
00000100:00000001:25.0:1773851858.818798:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232980864 : -107130476570752 : ffff9e90bdffd780)
02000000:00000001:25.0:1773851858.818800:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851858.818801:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.818802:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851858.818804:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17232@kfi7
00000400:00000010:25.0:1773851858.818805:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000092eda196.
00000100:00000200:25.0:1773851858.818806:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597886392448, offset 224
00000400:00000200:25.0:1773851858.818809:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17232@kfi7
00000400:00000200:25.0:1773851858.818811:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17232@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.818813:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4900e03 nid 17232@kfi7 refs 1
00000400:00000200:25.0:1773851858.818815:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c4900e03 nid 17232@kfi7 refs 2
00000400:00000200:25.0:1773851858.818817:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c4900e03 nid 17232@kfi7 refs 3
00000400:00000200:25.0:1773851858.818819:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17232@kfi7 local destination
00000400:00000200:25.0:1773851858.818823:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768806:8768806:1024:4294967295] 17232@kfi7 LPNI seq info [163112:163112:16:4294967295]
00000400:00000200:25.0:1773851858.818826:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c4900e03 nid 17232@kfi7 refs 2
00000400:00000200:25.0:1773851858.818827:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17232@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.818832:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17232@kfi7(17232@kfi7:17232@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851858.818834:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c4900e03 nid 17232@kfi7 refs 3
00000800:00000200:25.0:1773851858.818837:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.818839:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851858.818843:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851858.818848:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e Using peer 17232@kfi7(0xd0e)
00000800:00000200:25.0:1773851858.818853:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000016005f0: Posted send of 324 bytes to peer 0xd0e: rc=0
00000800:00000200:25.0:1773851858.818856:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851858.818860:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851858.818861:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dc464432 refcount 2 to 17233@kfi7
00010000:00000001:25.0:1773851858.818863:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851858.818864:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851858.818865:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851858.818866:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008b7e9902 x1859597886392448/t0(0) o400->854a7fb4-d024-469b-8503-9ef1129b3fcf@17233@kfi7:75/0 lens 224/224 e 0 to 0 dl 1773852190 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1570-0'
00000800:00000200:27.0:1773851858.818872:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e TN_EVENT_TX_OK event status 0
00000100:00100000:25.0:1773851858.818873:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b7e9902 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:854a7fb4-d024-469b-8503-9ef1129b3fcf+167:39685:x1859597886392448:12345-17233@kfi7:400:default-tuolumne1570-0 Request processed in 119us (183us total) trans 0 rc 0/0
00000400:00000200:27.0:1773851858.818875:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:25.0:1773851858.818877:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17233@kfi7, seq: 2025064
00000400:00000200:27.0:1773851858.818878:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17232@kfi7: PUT: OK
00000100:00000040:25.0:1773851858.818879:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000098935004 : new rpc_count 0
00000400:00000200:27.0:1773851858.818880:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000092eda196
00000400:00000010:27.0:1773851858.818881:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000092eda196.
00000100:00000001:25.0:1773851858.818881:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851858.818882:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851858.818882:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:27.0:1773851858.818883:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:25.0:1773851858.818883:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851858.818884:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a35ab917.
00000400:00000200:27.0:1773851858.818885:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4900e03 nid 17232@kfi7 refs 2
00000020:00000010:25.0:1773851858.818887:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000336ac53.
00000800:00000200:27.0:1773851858.818888:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 17232@kfi7(00000000cae34cb8):0x0 lsk 3343 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd0e Transaction freed
00000020:00000040:25.0:1773851858.818888:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000098935004 : new refcount 166
00000100:00000001:25.0:1773851858.818889:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851858.825732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851858.825734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:21.0:1773851858.831272:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.831274:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.831275:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.831279:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851858.831282:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.831284:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17915@kfi7 : PUT - for me
00000400:00000200:21.0:1773851858.831285:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.831287:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 1
00000400:00000200:21.0:1773851858.831288:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.831289:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000400:00000200:21.0:1773851858.831290:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 3
00000400:00000200:21.0:1773851858.831292:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.831293:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17915@kfi7 of length 224 into portal 12 MB=0x699de8729d8c0
00000400:00000200:21.0:1773851858.831295:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17915@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 27432
00000800:00000200:21.0:1773851858.831297:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851858.831300:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.831301:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17915@kfi7: PUT: OK
00000100:00000001:21.0:1773851858.831303:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.831303:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851858.831304:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e56070dc.
00000100:00000040:21.0:1773851858.831305:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e56070dc x1858030889720000 msgsize 224
00000100:00100000:21.0:1773851858.831308:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17915@kfi7 (source: 12345-17915@kfi7)
00000100:00000001:21.0:1773851858.831309:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851858.831310:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000100:00000001:23.0:1773851858.831312:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851858.831313:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851858.831313:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851858.831313:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851858.831314:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851858.831315:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851858.831317:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030889720000
00000020:00000001:23.0:1773851858.831318:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851858.831318:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911dc
00000020:00000001:23.0:1773851858.831319:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851858.831323:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000d388b6c refcount=6
00000020:00000001:23.0:1773851858.831325:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240534016 : -107152469017600 : ffff9e8b9f25bc00)
00000020:00000001:23.0:1773851858.831326:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240534016 : -107152469017600 : ffff9e8b9f25bc00)
00000100:00000001:23.0:1773851858.831327:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.831329:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851858.831330:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000170cfdb.
00000020:00000010:23.0:1773851858.831331:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.831332:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851858.831333:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851858.831334:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851858.831335:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.831337:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851858.831338:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851858.831339:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.831340:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.831342:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851858.831343:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851858.831343:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851858.831343:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851858.831345:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17915@kfi7, seq: 1997938
00000100:00000040:23.0:1773851858.831346:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000d388b6c : new rpc_count 1
00000100:00000001:22.0:1773851858.831346:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.831347:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637119644528768 : -106954065022848 : ffff9eb9d0f27080)
00000100:00000001:22.0:1773851858.831347:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.831349:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e56070dc x1858030889720000/t0(0) o400->035605b1-092d-4667-bee0-f2011802534f@17915@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne238-0'
00000100:00000001:23.0:1773851858.831353:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.831354:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851858.831355:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e56070dc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:035605b1-092d-4667-bee0-f2011802534f+6:47741:x1858030889720000:12345-17915@kfi7:400:default-tuolumne238-0
00000100:00000200:23.0:1773851858.831357:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030889720000
00000020:00000001:23.0:1773851858.831358:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851858.831359:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851858.831360:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.831361:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851858.831362:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851858.831363:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851858.831364:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030889720000, found 0 last_xid 1858030889719999
00000020:00000001:23.0:1773851858.831365:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851858.831366:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851858.831367:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851858.831368:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.831369:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851858.831370:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851858.831370:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851858.831372:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001d290916.
02000000:00000001:23.0:1773851858.831373:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.831374:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.831375:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851858.831376:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768280, transno 0, xid 1858030889720000
00010000:00000001:23.0:1773851858.831378:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851858.831380:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e56070dc x1858030889720000/t0(0) o400->035605b1-092d-4667-bee0-f2011802534f@17915@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne238-0'
00010000:00000001:23.0:1773851858.831384:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851858.831384:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851858.831386:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=91 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851858.831387:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851858.831388:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e6e7b546 refcount 5 to 17915@kfi7
00000100:00000001:23.0:1773851858.831389:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024416 : -107156745527200 : ffff9e8aa03f6060)
02000000:00000001:23.0:1773851858.831391:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851858.831391:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.831392:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851858.831393:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17915@kfi7
00000400:00000010:23.0:1773851858.831394:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000451cdaad.
00000100:00000200:23.0:1773851858.831396:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030889720000, offset 224
00000400:00000200:23.0:1773851858.831398:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17915@kfi7
00000400:00000200:23.0:1773851858.831399:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.831400:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 1
00000400:00000200:23.0:1773851858.831402:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000400:00000200:23.0:1773851858.831404:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 3
00000400:00000200:23.0:1773851858.831406:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17915@kfi7 local destination
00000400:00000200:23.0:1773851858.831408:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768807:8768807:1024:4294967295] 17915@kfi7 LPNI seq info [28027:28027:16:4294967295]
00000400:00000200:23.0:1773851858.831410:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000400:00000200:23.0:1773851858.831411:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.831415:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17915@kfi7(17915@kfi7:17915@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851858.831417:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 3
00000800:00000200:23.0:1773851858.831419:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851858.831421:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851858.831424:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851858.831428:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000034a Using peer 17915@kfi7(0x10000000000034a)
00000800:00000200:23.0:1773851858.831436:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x10000000000034a: rc=0
00000800:00000200:23.0:1773851858.831439:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000034a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851858.831442:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.831443:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e6e7b546 refcount 4 to 17915@kfi7
00010000:00000001:23.0:1773851858.831444:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851858.831445:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.831446:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851858.831447:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e56070dc x1858030889720000/t0(0) o400->035605b1-092d-4667-bee0-f2011802534f@17915@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne238-0'
00000800:00000200:21.0:1773851858.831451:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000034a TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851858.831452:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e56070dc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:035605b1-092d-4667-bee0-f2011802534f+6:47741:x1858030889720000:12345-17915@kfi7:400:default-tuolumne238-0 Request processed in 98us (145us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851858.831454:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851858.831455:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17915@kfi7, seq: 1997938
00000400:00000200:21.0:1773851858.831455:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17915@kfi7: PUT: OK
00000100:00000040:23.0:1773851858.831456:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000d388b6c : new rpc_count 0
00000400:00000200:21.0:1773851858.831456:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000451cdaad
00000400:00000010:21.0:1773851858.831457:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000451cdaad.
00000100:00000001:23.0:1773851858.831458:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851858.831458:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:21.0:1773851858.831458:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851858.831459:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851858.831459:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851858.831460:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851858.831462:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000170cfdb.
00000020:00000040:23.0:1773851858.831463:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000000d388b6c : new refcount 5
00000400:00000200:21.0:1773851858.831463:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000100:00000001:23.0:1773851858.831464:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851858.831465:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17915@kfi7(000000006d1ada4c):0x0 lsk 843 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000034a Transaction freed
00000800:00000200:14.0:1773851858.838651:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851858.838652:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851858.838653:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851858.838656:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851858.838658:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.838659:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25339@kfi7 : PUT - for me
00000400:00000200:14.0:1773851858.838660:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.838661:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 1
00000400:00000200:14.0:1773851858.838662:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.838663:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000400:00000200:14.0:1773851858.838664:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 3
00000400:00000200:14.0:1773851858.838664:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:14.0:1773851858.838665:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25339@kfi7 of length 224 into portal 12 MB=0x699de7e45d6c0
00000400:00000200:14.0:1773851858.838667:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25339@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 19048
00000800:00000200:14.0:1773851858.838668:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851858.838670:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851858.838672:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25339@kfi7: PUT: OK
00000100:00000001:14.0:1773851858.838673:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851858.838673:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851858.838674:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000075f3083c.
00000100:00000040:14.0:1773851858.838674:0:2514739:0:(events.c:358:request_in_callback()) incoming req@0000000075f3083c x1858030740559552 msgsize 224
00000100:00100000:14.0:1773851858.838676:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-25339@kfi7 (source: 12345-25339@kfi7)
00000100:00000001:14.0:1773851858.838677:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851858.838678:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000100:00000001:13.0:1773851858.838679:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851858.838680:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:13.0:1773851858.838680:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851858.838681:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851858.838681:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851858.838682:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851858.838683:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030740559552
00000020:00000001:13.0:1773851858.838683:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851858.838684:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fb3
00000020:00000001:13.0:1773851858.838684:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851858.838688:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b5131faf refcount=6
00000020:00000001:13.0:1773851858.838688:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239885824 : -107152469665792 : ffff9e8b9f1bd800)
00000020:00000001:13.0:1773851858.838689:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239885824 : -107152469665792 : ffff9e8b9f1bd800)
00000100:00000001:13.0:1773851858.838690:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.838691:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851858.838691:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851858.838692:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.838693:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851858.838694:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851858.838694:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851858.838695:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.838696:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851858.838696:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851858.838697:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.838698:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851858.838699:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851858.838699:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.838700:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851858.838700:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851858.838701:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25339@kfi7, seq: 2289791
00000100:00000001:15.0:1773851858.838702:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851858.838702:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.838702:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b5131faf : new rpc_count 1
00000100:00000001:13.0:1773851858.838702:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341804928 : -106946367746688 : ffff9ebb9bbd8d80)
00000100:00000040:13.0:1773851858.838703:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000075f3083c x1858030740559552/t0(0) o400->48dc0999-a31b-4205-a07c-b856cde88a70@25339@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne267-0'
00000100:00000001:13.0:1773851858.838706:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.838707:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851858.838708:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075f3083c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:48dc0999-a31b-4205-a07c-b856cde88a70+6:47804:x1858030740559552:12345-25339@kfi7:400:default-tuolumne267-0
00000100:00000200:13.0:1773851858.838711:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030740559552
00000020:00000001:13.0:1773851858.838711:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851858.838712:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851858.838713:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.838714:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851858.838714:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851858.838715:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851858.838716:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030740559552, found 0 last_xid 1858030740559551
00000020:00000001:13.0:1773851858.838717:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851858.838717:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851858.838718:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851858.838718:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.838719:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851858.838720:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851858.838720:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851858.838722:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b162e5b1.
02000000:00000001:13.0:1773851858.838722:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.838723:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.838724:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851858.838727:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030740559552
00010000:00000001:13.0:1773851858.838728:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851858.838729:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000075f3083c x1858030740559552/t0(0) o400->48dc0999-a31b-4205-a07c-b856cde88a70@25339@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne267-0'
00010000:00000001:13.0:1773851858.838731:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851858.838732:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851858.838732:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=91 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851858.838733:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851858.838734:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009d31f0c3 refcount 5 to 25339@kfi7
00000100:00000001:13.0:1773851858.838735:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150880 : -107154898400736 : ffff9e8b0e584a20)
02000000:00000001:13.0:1773851858.838736:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851858.838736:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.838737:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851858.838738:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25339@kfi7
00000400:00000010:13.0:1773851858.838738:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008b5248b5.
00000100:00000200:13.0:1773851858.838740:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030740559552, offset 224
00000400:00000200:13.0:1773851858.838741:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25339@kfi7
00000400:00000200:13.0:1773851858.838742:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.838743:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 1
00000400:00000200:13.0:1773851858.838744:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000400:00000200:13.0:1773851858.838745:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 3
00000400:00000200:13.0:1773851858.838746:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25339@kfi7 local destination
00000400:00000200:13.0:1773851858.838747:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768808:8768808:1024:4294967295] 25339@kfi7 LPNI seq info [24437:24437:16:4294967295]
00000400:00000200:13.0:1773851858.838749:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000400:00000200:13.0:1773851858.838750:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.838752:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25339@kfi7(25339@kfi7:25339@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851858.838753:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 3
00000800:00000200:13.0:1773851858.838754:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.838755:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851858.838757:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851858.838760:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000284 Using peer 25339@kfi7(0x100000000000284)
00000800:00000200:13.0:1773851858.838763:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000006c12e940: Posted send of 324 bytes to peer 0x100000000000284: rc=0
00000800:00000200:13.0:1773851858.838765:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000284 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851858.838767:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.838768:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009d31f0c3 refcount 4 to 25339@kfi7
00010000:00000001:13.0:1773851858.838769:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851858.838769:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.838770:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851858.838771:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000075f3083c x1858030740559552/t0(0) o400->48dc0999-a31b-4205-a07c-b856cde88a70@25339@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne267-0'
00000100:00100000:13.0:1773851858.838774:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075f3083c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:48dc0999-a31b-4205-a07c-b856cde88a70+6:47804:x1858030740559552:12345-25339@kfi7:400:default-tuolumne267-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851858.838776:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25339@kfi7, seq: 2289791
00000800:00000200:14.0:1773851858.838777:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000284 TN_EVENT_TX_OK event status 0
00000100:00000040:13.0:1773851858.838777:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b5131faf : new rpc_count 0
00000400:00000200:14.0:1773851858.838778:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851858.838778:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851858.838778:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851858.838779:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25339@kfi7: PUT: OK
00000020:00000010:13.0:1773851858.838779:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851858.838780:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008b5248b5
00000020:00000010:13.0:1773851858.838780:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000400:00000010:14.0:1773851858.838781:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008b5248b5.
00000020:00000010:13.0:1773851858.838781:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000020:00000040:13.0:1773851858.838781:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000b5131faf : new refcount 5
00000100:00000001:14.0:1773851858.838782:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851858.838782:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:13.0:1773851858.838782:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851858.838783:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000800:00000200:14.0:1773851858.838785:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 25339@kfi7(00000000c1d0ee88):0x0 lsk 645 rsk 86 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000284 Transaction freed
00000800:00000200:13.0:1773851858.839110:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.839110:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851858.839112:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851858.839114:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851858.839115:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.839117:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25339@kfi7 : PUT - for me
00000400:00000200:13.0:1773851858.839118:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.839118:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 1
00000400:00000200:13.0:1773851858.839119:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.839119:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000400:00000200:13.0:1773851858.839120:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 3
00000400:00000200:13.0:1773851858.839121:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.839122:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25339@kfi7 of length 224 into portal 12 MB=0x699de7e45de40
00000400:00000200:13.0:1773851858.839123:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25339@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 19272
00000800:00000200:13.0:1773851858.839125:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851858.839127:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851858.839127:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25339@kfi7: PUT: OK
00000100:00000001:13.0:1773851858.839128:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851858.839130:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851858.839130:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ca3df0e5.
00000100:00000040:13.0:1773851858.839131:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ca3df0e5 x1858030740561472 msgsize 224
00000100:00100000:13.0:1773851858.839132:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25339@kfi7 (source: 12345-25339@kfi7)
00000100:00000001:13.0:1773851858.839133:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851858.839134:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000800:00000200:13.0:1773851858.839136:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851858.839138:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851858.839138:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851858.839139:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851858.839139:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851858.839140:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851858.839140:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030740561472
00000020:00000001:13.0:1773851858.839141:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851858.839141:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9115e
00000020:00000001:13.0:1773851858.839141:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851858.839144:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f7beef1c refcount=6
00000020:00000001:13.0:1773851858.839144:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240342528 : -107152469209088 : ffff9e8b9f22d000)
00000020:00000001:13.0:1773851858.839145:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240342528 : -107152469209088 : ffff9e8b9f22d000)
00000100:00000001:13.0:1773851858.839146:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.839147:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851858.839147:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040a3ce5c.
00000020:00000010:13.0:1773851858.839148:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.839149:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851858.839149:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851858.839150:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851858.839150:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.839151:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851858.839151:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851858.839152:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.839152:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851858.839153:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.839154:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851858.839154:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851858.839154:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851858.839155:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25339@kfi7, seq: 2289792
00000100:00000001:15.0:1773851858.839158:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.839158:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f7beef1c : new rpc_count 1
00000100:00000001:13.0:1773851858.839158:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537170304 : -107002172381312 : ffff9eae9d866780)
00000100:00000001:15.0:1773851858.839159:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.839159:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ca3df0e5 x1858030740561472/t0(0) o400->17be264f-9fbd-4b0d-aa0c-2b867234f921@25339@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne267-0'
00000100:00000001:13.0:1773851858.839162:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851858.839162:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851858.839163:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca3df0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:17be264f-9fbd-4b0d-aa0c-2b867234f921+6:47802:x1858030740561472:12345-25339@kfi7:400:default-tuolumne267-0
00000100:00000200:13.0:1773851858.839164:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030740561472
00000020:00000001:13.0:1773851858.839165:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851858.839165:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851858.839166:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.839166:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851858.839167:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851858.839167:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851858.839168:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030740561472, found 0 last_xid 1858030740561471
00000020:00000001:13.0:1773851858.839169:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851858.839169:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851858.839169:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851858.839170:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.839170:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851858.839171:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851858.839171:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851858.839172:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000018f5f023.
02000000:00000001:13.0:1773851858.839173:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.839173:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.839174:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851858.839174:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768338, transno 0, xid 1858030740561472
00010000:00000001:13.0:1773851858.839175:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851858.839176:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ca3df0e5 x1858030740561472/t0(0) o400->17be264f-9fbd-4b0d-aa0c-2b867234f921@25339@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne267-0'
00010000:00000001:13.0:1773851858.839178:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851858.839178:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851858.839179:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=91 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851858.839180:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851858.839181:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009d31f0c3 refcount 5 to 25339@kfi7
00000100:00000001:13.0:1773851858.839182:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150880 : -107154898400736 : ffff9e8b0e584a20)
02000000:00000001:13.0:1773851858.839182:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851858.839183:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851858.839183:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851858.839184:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25339@kfi7
00000400:00000010:13.0:1773851858.839185:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f58b105f.
00000100:00000200:13.0:1773851858.839185:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030740561472, offset 224
00000400:00000200:13.0:1773851858.839186:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25339@kfi7
00000400:00000200:13.0:1773851858.839187:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.839188:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 1
00000400:00000200:13.0:1773851858.839188:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000400:00000200:13.0:1773851858.839189:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 3
00000400:00000200:13.0:1773851858.839190:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25339@kfi7 local destination
00000400:00000200:13.0:1773851858.839191:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768809:8768809:1024:4294967295] 25339@kfi7 LPNI seq info [24438:24438:16:4294967295]
00000400:00000200:13.0:1773851858.839193:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000400:00000200:13.0:1773851858.839193:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25339@kfi7 to cpt 3
00000400:00000200:13.0:1773851858.839195:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25339@kfi7(25339@kfi7:25339@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851858.839196:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 3
00000800:00000200:13.0:1773851858.839197:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851858.839198:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851858.839200:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851858.839202:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x6b3 Using peer 25339@kfi7(0x6b3)
00000800:00000200:13.0:1773851858.839205:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 324 bytes to peer 0x6b3: rc=0
00000800:00000200:13.0:1773851858.839206:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x6b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851858.839209:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851858.839210:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009d31f0c3 refcount 4 to 25339@kfi7
00010000:00000001:13.0:1773851858.839211:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851858.839211:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851858.839212:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851858.839212:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ca3df0e5 x1858030740561472/t0(0) o400->17be264f-9fbd-4b0d-aa0c-2b867234f921@25339@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne267-0'
00000100:00100000:13.0:1773851858.839215:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca3df0e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:17be264f-9fbd-4b0d-aa0c-2b867234f921+6:47802:x1858030740561472:12345-25339@kfi7:400:default-tuolumne267-0 Request processed in 52us (83us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851858.839218:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25339@kfi7, seq: 2289792
00000100:00000040:13.0:1773851858.839218:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f7beef1c : new rpc_count 0
00000800:00000200:14.0:1773851858.839219:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x6b3 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851858.839219:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851858.839219:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851858.839220:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851858.839220:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851858.839220:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000400:00000200:14.0:1773851858.839221:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25339@kfi7: PUT: OK
00000020:00000010:13.0:1773851858.839221:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040a3ce5c.
00000400:00000200:14.0:1773851858.839222:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f58b105f
00000400:00000010:14.0:1773851858.839222:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f58b105f.
00000100:00000001:14.0:1773851858.839222:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:13.0:1773851858.839222:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000f7beef1c : new refcount 5
00000100:00000001:13.0:1773851858.839222:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851858.839223:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851858.839224:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002f2f51a2 nid 25339@kfi7 refs 2
00000800:00000200:14.0:1773851858.839226:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 25339@kfi7(000000008112a5db):0x0 lsk 1716 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x6b3 Transaction freed
00000800:00000200:5.0:1773851858.888933:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.888935:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851858.888937:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851858.888941:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851858.888945:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14979@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.888947:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14979@kfi7 : PUT - for me
00000400:00000200:5.0:1773851858.888949:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14979@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.888950:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000add46f1e nid 14979@kfi7 refs 1
00000400:00000200:5.0:1773851858.888952:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14979@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.888953:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000add46f1e nid 14979@kfi7 refs 2
00000400:00000200:5.0:1773851858.888955:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000add46f1e nid 14979@kfi7 refs 3
00000400:00000200:5.0:1773851858.888957:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14915@kfi7 to cpt 6
00000400:00000200:5.0:1773851858.888959:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14915@kfi7 of length 224 into portal 12 MB=0x69b473b545d80
00000400:00000200:5.0:1773851858.888962:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14915@kfi7 of length 224/224 into md 0x793926dc5 [64] + 122280
00000800:00000200:5.0:1773851858.888965:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851858.888968:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851858.888970:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14979@kfi7: PUT: OK
00000100:00000001:5.0:1773851858.888972:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851858.888973:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851858.888975:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd6ded13.
00000100:00000040:5.0:1773851858.888976:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000dd6ded13 x1859580100631936 msgsize 224
00000100:00100000:5.0:1773851858.888979:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14915@kfi7 (source: 12345-14979@kfi7)
00000100:00000001:5.0:1773851858.888981:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851858.888982:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000add46f1e nid 14979@kfi7 refs 2
00000800:00000200:5.0:1773851858.888985:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851858.888990:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851858.888991:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.888992:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851858.888993:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851858.888994:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851858.888995:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580100631936
00000020:00000001:5.0:1773851858.888996:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851858.888996:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddd0666e7
00000020:00000001:5.0:1773851858.888997:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.888999:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de012bde refcount=167
00000020:00000001:5.0:1773851858.889000:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133561885696 : -106940147665920 : ffff9ebd0e7c7400)
00000020:00000001:5.0:1773851858.889001:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133561885696 : -106940147665920 : ffff9ebd0e7c7400)
00000100:00000001:5.0:1773851858.889003:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.889004:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851858.889005:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851858.889006:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.889008:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851858.889009:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.889010:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851858.889011:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.889013:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851858.889013:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851858.889014:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.889016:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851858.889018:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851858.889018:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851858.889018:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851858.889019:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851858.889020:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14915@kfi7, seq: 2001869
00000100:00000001:7.0:1773851858.889021:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.889021:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de012bde : new rpc_count 1
00000100:00000001:7.0:1773851858.889022:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.889022:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866947968 : -107088842603648 : ffff9e9a6f93c380)
00000100:00000040:5.0:1773851858.889024:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dd6ded13 x1859580100631936/t0(0) o400->16c1886b-0bf5-4608-aef8-bc708d72171f@14915@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1432-0'
00000100:00000001:5.0:1773851858.889029:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.889029:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851858.889031:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd6ded13 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:16c1886b-0bf5-4608-aef8-bc708d72171f+167:39677:x1859580100631936:12345-14915@kfi7:400:default-tuolumne1432-0
00000100:00000200:5.0:1773851858.889033:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580100631936
00000020:00000001:5.0:1773851858.889034:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851858.889035:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851858.889036:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.889037:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851858.889038:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851858.889039:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851858.889040:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580100631936, found 0 last_xid 1859580100206975
00000020:00000001:5.0:1773851858.889041:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851858.889042:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851858.889043:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851858.889044:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.889045:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851858.889045:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851858.889046:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851858.889048:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d500102a.
02000000:00000001:5.0:1773851858.889049:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.889050:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.889051:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851858.889052:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063189, transno 0, xid 1859580100631936
00010000:00000001:5.0:1773851858.889054:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851858.889055:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dd6ded13 x1859580100631936/t0(0) o400->16c1886b-0bf5-4608-aef8-bc708d72171f@14915@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1432-0'
00010000:00000001:5.0:1773851858.889059:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851858.889060:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851858.889061:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=90 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851858.889063:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851858.889064:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f8c55948 refcount 3 to 14915@kfi7
00000100:00000001:5.0:1773851858.889066:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985417728 : -107156724133888 : ffff9e8aa185d000)
02000000:00000001:5.0:1773851858.889067:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851858.889068:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.889069:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851858.889070:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14979@kfi7
00000400:00000010:5.0:1773851858.889071:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000046728b3e.
00000100:00000200:5.0:1773851858.889072:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580100631936, offset 224
00000400:00000200:5.0:1773851858.889075:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14979@kfi7
00000400:00000200:5.0:1773851858.889076:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14979@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.889077:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000add46f1e nid 14979@kfi7 refs 1
00000400:00000200:5.0:1773851858.889079:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000add46f1e nid 14979@kfi7 refs 2
00000400:00000200:5.0:1773851858.889080:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000add46f1e nid 14979@kfi7 refs 3
00000400:00000200:5.0:1773851858.889082:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14979@kfi7 local destination
00000400:00000200:5.0:1773851858.889084:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768810:8768810:1024:4294967295] 14979@kfi7 LPNI seq info [780011:780011:16:4294967295]
00000400:00000200:5.0:1773851858.889087:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000add46f1e nid 14979@kfi7 refs 2
00000400:00000200:5.0:1773851858.889088:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14979@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.889091:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14979@kfi7(14979@kfi7:14979@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851858.889093:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000add46f1e nid 14979@kfi7 refs 3
00000800:00000200:5.0:1773851858.889095:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.889097:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851858.889104:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851858.889107:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcc3 Using peer 14979@kfi7(0xcc3)
00000800:00000200:5.0:1773851858.889112:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 324 bytes to peer 0xcc3: rc=0
00000800:00000200:5.0:1773851858.889115:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcc3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851858.889118:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.889119:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f8c55948 refcount 2 to 14915@kfi7
00010000:00000001:5.0:1773851858.889120:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851858.889121:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.889122:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851858.889123:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd6ded13 x1859580100631936/t0(0) o400->16c1886b-0bf5-4608-aef8-bc708d72171f@14915@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1432-0'
00000800:00000200:6.0:1773851858.889127:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcc3 TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851858.889129:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd6ded13 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:16c1886b-0bf5-4608-aef8-bc708d72171f+167:39677:x1859580100631936:12345-14915@kfi7:400:default-tuolumne1432-0 Request processed in 99us (152us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851858.889130:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851858.889131:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14979@kfi7: PUT: OK
00000400:00000200:6.0:1773851858.889133:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000046728b3e
00000100:00100000:5.0:1773851858.889133:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14915@kfi7, seq: 2001869
00000400:00000010:6.0:1773851858.889134:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000046728b3e.
00000100:00000040:5.0:1773851858.889134:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de012bde : new rpc_count 0
00000100:00000001:6.0:1773851858.889135:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851858.889135:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851858.889136:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851858.889136:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851858.889137:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000add46f1e nid 14979@kfi7 refs 2
00000020:00000010:5.0:1773851858.889137:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.889138:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000020:00000010:5.0:1773851858.889139:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000800:00000200:6.0:1773851858.889140:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 14979@kfi7(0000000095a20ef8):0x0 lsk 3268 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcc3 Transaction freed
00000020:00000040:5.0:1773851858.889141:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000de012bde : new refcount 166
00000100:00000001:5.0:1773851858.889142:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851858.897226:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.897226:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851858.897228:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851858.897230:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851858.897232:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16000@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.897233:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16000@kfi7 : PUT - for me
00000400:00000200:5.0:1773851858.897234:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16000@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.897235:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 1
00000400:00000200:5.0:1773851858.897236:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16000@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.897236:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 2
00000400:00000200:5.0:1773851858.897237:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 3
00000400:00000200:5.0:1773851858.897238:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15937@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.897239:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15937@kfi7 of length 224 into portal 12 MB=0x69b4bb03a7880
00000400:00000200:5.0:1773851858.897240:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15937@kfi7 of length 224/224 into md 0x793926dc5 [64] + 122504
00000800:00000200:5.0:1773851858.897241:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851858.897243:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851858.897244:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16000@kfi7: PUT: OK
00000100:00000001:5.0:1773851858.897244:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851858.897245:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851858.897245:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000606334e.
00000100:00000040:5.0:1773851858.897246:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000000606334e x1859599241738368 msgsize 224
00000100:00100000:5.0:1773851858.897247:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-15937@kfi7 (source: 12345-16000@kfi7)
00000100:00000001:5.0:1773851858.897248:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851858.897249:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 2
00000800:00000200:5.0:1773851858.897250:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851858.897252:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851858.897253:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851858.897253:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851858.897254:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851858.897254:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851858.897255:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599241738368
00000020:00000001:5.0:1773851858.897255:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851858.897255:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fa3d
00000020:00000001:5.0:1773851858.897256:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851858.897258:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002dff0232 refcount=167
00000020:00000001:5.0:1773851858.897258:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125217110016 : -106948492441600 : ffff9ebb1d194800)
00000020:00000001:5.0:1773851858.897259:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125217110016 : -106948492441600 : ffff9ebb1d194800)
00000100:00000001:5.0:1773851858.897260:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.897261:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851858.897261:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851858.897262:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.897263:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851858.897263:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851858.897264:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851858.897264:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.897264:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851858.897265:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851858.897265:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.897266:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851858.897267:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851858.897267:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851858.897268:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851858.897268:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851858.897268:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15937@kfi7, seq: 2001870
00000100:00000001:7.0:1773851858.897269:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851858.897269:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.897269:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002dff0232 : new rpc_count 1
00000100:00000001:5.0:1773851858.897270:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866943360 : -107088842608256 : ffff9e9a6f93b180)
00000100:00000040:5.0:1773851858.897270:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000606334e x1859599241738368/t0(0) o400->f8433525-5654-4c28-923f-4a463922e065@15937@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1492-0'
00000100:00000001:5.0:1773851858.897273:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851858.897273:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851858.897274:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000606334e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f8433525-5654-4c28-923f-4a463922e065+167:39561:x1859599241738368:12345-15937@kfi7:400:default-tuolumne1492-0
00000100:00000200:5.0:1773851858.897276:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599241738368
00000020:00000001:5.0:1773851858.897276:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851858.897277:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851858.897277:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.897278:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851858.897278:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851858.897279:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851858.897280:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599241738368, found 0 last_xid 1859599241318463
00000020:00000001:5.0:1773851858.897280:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851858.897281:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851858.897281:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851858.897282:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.897282:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851858.897283:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851858.897283:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851858.897285:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000005dd8a6.
02000000:00000001:5.0:1773851858.897286:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.897286:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.897287:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851858.897288:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062884, transno 0, xid 1859599241738368
00010000:00000001:5.0:1773851858.897288:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851858.897289:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000606334e x1859599241738368/t0(0) o400->f8433525-5654-4c28-923f-4a463922e065@15937@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1492-0'
00010000:00000001:5.0:1773851858.897291:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851858.897292:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851858.897292:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=90 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851858.897293:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851858.897294:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b56847bb refcount 3 to 15937@kfi7
00000100:00000001:5.0:1773851858.897294:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636949266837056 : -107124442714560 : ffff9e9225a52e40)
02000000:00000001:5.0:1773851858.897295:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851858.897295:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851858.897296:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851858.897297:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16000@kfi7
00000400:00000010:5.0:1773851858.897297:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001026dec5.
00000100:00000200:5.0:1773851858.897298:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599241738368, offset 224
00000400:00000200:5.0:1773851858.897299:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16000@kfi7
00000400:00000200:5.0:1773851858.897299:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16000@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.897300:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 1
00000400:00000200:5.0:1773851858.897301:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 2
00000400:00000200:5.0:1773851858.897302:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 3
00000400:00000200:5.0:1773851858.897303:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16000@kfi7 local destination
00000400:00000200:5.0:1773851858.897305:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768811:8768811:1024:4294967295] 16000@kfi7 LPNI seq info [6827663:6827663:16:4294967295]
00000400:00000200:5.0:1773851858.897306:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 2
00000400:00000200:5.0:1773851858.897307:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16000@kfi7 to cpt 1
00000400:00000200:5.0:1773851858.897309:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16000@kfi7(16000@kfi7:16000@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851858.897310:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 3
00000800:00000200:5.0:1773851858.897311:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851858.897312:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851858.897314:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851858.897316:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001096 Using peer 16000@kfi7(0x100000000001096)
00000800:00000200:5.0:1773851858.897319:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 324 bytes to peer 0x100000000001096: rc=0
00000800:00000200:5.0:1773851858.897320:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001096 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851858.897322:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851858.897323:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b56847bb refcount 2 to 15937@kfi7
00010000:00000001:5.0:1773851858.897323:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851858.897324:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851858.897324:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851858.897325:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000606334e x1859599241738368/t0(0) o400->f8433525-5654-4c28-923f-4a463922e065@15937@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1492-0'
00000100:00100000:5.0:1773851858.897328:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000606334e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f8433525-5654-4c28-923f-4a463922e065+167:39561:x1859599241738368:12345-15937@kfi7:400:default-tuolumne1492-0 Request processed in 54us (81us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851858.897330:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15937@kfi7, seq: 2001870
00000100:00000040:5.0:1773851858.897330:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002dff0232 : new rpc_count 0
00000100:00000001:5.0:1773851858.897331:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851858.897331:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:6.0:1773851858.897332:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001096 TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851858.897332:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851858.897333:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000020:00000010:5.0:1773851858.897333:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000400:00000200:6.0:1773851858.897334:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:5.0:1773851858.897334:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000002dff0232 : new refcount 166
00000100:00000001:5.0:1773851858.897334:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851858.897335:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16000@kfi7: PUT: OK
00000400:00000200:6.0:1773851858.897335:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001026dec5
00000400:00000010:6.0:1773851858.897335:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001026dec5.
00000100:00000001:6.0:1773851858.897336:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851858.897336:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851858.897337:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fca7b2b4 nid 16000@kfi7 refs 2
00000800:00000200:6.0:1773851858.897338:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 16000@kfi7(00000000a9c6b045):0x0 lsk 4247 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001096 Transaction freed
00000800:00000200:1.0:1773851858.905666:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851858.905668:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851858.905670:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851858.905673:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851858.905676:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.905678:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25168@kfi7 : PUT - for me
00000400:00000200:1.0:1773851858.905679:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.905680:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 1
00000400:00000200:1.0:1773851858.905682:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:1.0:1773851858.905683:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000400:00000200:1.0:1773851858.905684:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 3
00000400:00000200:1.0:1773851858.905685:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25233@kfi7 to cpt 7
00000400:00000200:1.0:1773851858.905687:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25233@kfi7 of length 224 into portal 12 MB=0x69b4c69023b00
00000400:00000200:1.0:1773851858.905689:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25233@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 17824
00000800:00000200:1.0:1773851858.905692:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851858.905694:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.905697:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25168@kfi7: PUT: OK
00000100:00000001:1.0:1773851858.905698:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851858.905699:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851858.905700:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001ebb6f6d.
00000100:00000040:1.0:1773851858.905701:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000001ebb6f6d x1859602341837568 msgsize 224
00000100:00100000:1.0:1773851858.905704:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25233@kfi7 (source: 12345-25168@kfi7)
00000100:00000001:1.0:1773851858.905706:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851858.905707:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000100:00000001:0.0:1773851858.905708:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851858.905709:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851858.905709:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851858.905710:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851858.905710:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851858.905712:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851858.905713:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602341837568
00000020:00000001:0.0:1773851858.905714:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851858.905714:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8284b
00000020:00000001:0.0:1773851858.905715:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851858.905718:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000604f4e4 refcount=4099
00000020:00000001:0.0:1773851858.905720:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128025661440 : -106945683890176 : ffff9ebbc4806000)
00000020:00000001:0.0:1773851858.905722:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128025661440 : -106945683890176 : ffff9ebbc4806000)
00000100:00000001:0.0:1773851858.905723:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.905729:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851858.905730:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001e6315df.
00000020:00000010:0.0:1773851858.905732:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.905733:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851858.905735:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851858.905735:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851858.905736:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.905737:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851858.905738:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851858.905739:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.905740:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851858.905742:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851858.905743:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851858.905743:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851858.905743:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851858.905744:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25233@kfi7, seq: 1997512
00000100:00000001:1.0:1773851858.905746:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.905746:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000604f4e4 : new rpc_count 8
00000100:00000001:1.0:1773851858.905747:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.905747:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605665024 : -106923103886592 : ffff9ec1065fe300)
00000100:00000040:0.0:1773851858.905749:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001ebb6f6d x1859602341837568/t0(0) o400->81d8f0a6-5475-441f-8eb2-ba6da3482fdc@25233@kfi7:498/0 lens 224/0 e 0 to 0 dl 1773852613 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2066-0'
00000100:00000001:0.0:1773851858.905753:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851858.905754:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851858.905755:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ebb6f6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:81d8f0a6-5475-441f-8eb2-ba6da3482fdc+4099:39582:x1859602341837568:12345-25233@kfi7:400:default-tuolumne2066-0
00000100:00000200:0.0:1773851858.905758:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602341837568
00000020:00000001:0.0:1773851858.905759:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851858.905760:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851858.905761:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.905762:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851858.905762:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851858.905764:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851858.905765:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602341837568, found 0 last_xid 1859602341101951
00000020:00000001:0.0:1773851858.905767:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851858.905768:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851858.905769:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851858.905770:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.905771:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851858.905771:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851858.905772:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851858.905773:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001431d72e.
02000000:00000001:0.0:1773851858.905774:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.905775:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.905776:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851858.905777:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593894, transno 0, xid 1859602341837568
00010000:00000001:0.0:1773851858.905778:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851858.905780:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001ebb6f6d x1859602341837568/t0(0) o400->81d8f0a6-5475-441f-8eb2-ba6da3482fdc@25233@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2066-0'
00010000:00000001:0.0:1773851858.905784:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851858.905784:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851858.905786:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=91 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851858.905787:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851858.905788:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000042f5cb62 refcount 3 to 25233@kfi7
00000100:00000001:0.0:1773851858.905789:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214688 : -107155106336928 : ffff9e8b01f36f60)
02000000:00000001:0.0:1773851858.905791:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851858.905791:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851858.905792:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851858.905794:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25168@kfi7
00000400:00000010:0.0:1773851858.905795:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a3358ad2.
00000100:00000200:0.0:1773851858.905796:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602341837568, offset 224
00000400:00000200:0.0:1773851858.905798:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25168@kfi7
00000400:00000200:0.0:1773851858.905800:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.905801:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 1
00000400:00000200:0.0:1773851858.905803:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000400:00000200:0.0:1773851858.905804:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 3
00000400:00000200:0.0:1773851858.905806:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25168@kfi7 local destination
00000400:00000200:0.0:1773851858.905808:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768812:8768812:1024:4294967295] 25168@kfi7 LPNI seq info [9466695:9466695:16:4294967295]
00000400:00000200:0.0:1773851858.905812:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000400:00000200:0.0:1773851858.905813:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:0.0:1773851858.905815:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25168@kfi7(25168@kfi7:25168@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851858.905817:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 3
00000800:00000200:0.0:1773851858.905819:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851858.905820:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851858.905823:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851858.905826:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x209 Using peer 25168@kfi7(0x209)
00000800:00000200:0.0:1773851858.905829:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x209: rc=0
00000800:00000200:0.0:1773851858.905831:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x209 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851858.905833:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851858.905834:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000042f5cb62 refcount 2 to 25233@kfi7
00010000:00000001:0.0:1773851858.905835:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851858.905835:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851858.905836:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851858.905837:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001ebb6f6d x1859602341837568/t0(0) o400->81d8f0a6-5475-441f-8eb2-ba6da3482fdc@25233@kfi7:498/0 lens 224/224 e 0 to 0 dl 1773852613 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2066-0'
00000100:00100000:0.0:1773851858.905841:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ebb6f6d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:81d8f0a6-5475-441f-8eb2-ba6da3482fdc+4099:39582:x1859602341837568:12345-25233@kfi7:400:default-tuolumne2066-0 Request processed in 87us (139us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851858.905843:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25233@kfi7, seq: 1997512
00000100:00000040:0.0:1773851858.905844:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000604f4e4 : new rpc_count 7
00000100:00000001:0.0:1773851858.905845:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851858.905845:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851858.905846:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851858.905847:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851858.905847:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001e6315df.
00000020:00000040:0.0:1773851858.905849:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000000604f4e4 : new refcount 4098
00000100:00000001:0.0:1773851858.905849:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851858.905854:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x209 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851858.905856:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851858.905857:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25168@kfi7: PUT: OK
00000400:00000200:1.0:1773851858.905858:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a3358ad2
00000400:00000010:1.0:1773851858.905858:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a3358ad2.
00000100:00000001:1.0:1773851858.905859:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851858.905859:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851858.905860:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000800:00000200:1.0:1773851858.905861:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 25168@kfi7(0000000012f4f329):0x0 lsk 522 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x209 Transaction freed
00000800:00000200:25.0:1773851858.910063:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851858.910063:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851858.910065:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851858.910067:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851858.910069:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15347@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.910070:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15347@kfi7 : PUT - for me
00000400:00000200:25.0:1773851858.910071:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15347@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.910072:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 1
00000400:00000200:25.0:1773851858.910073:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15347@kfi7 to cpt 6
00000400:00000200:25.0:1773851858.910074:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 2
00000400:00000200:25.0:1773851858.910075:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 3
00000400:00000200:25.0:1773851858.910076:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15155@kfi7 to cpt 3
00000400:00000200:25.0:1773851858.910077:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15155@kfi7 of length 224 into portal 12 MB=0x69b4b5f79a480
00000400:00000200:25.0:1773851858.910078:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15155@kfi7 of length 224/224 into md 0x16159c6179 [64] + 188600
00000800:00000200:25.0:1773851858.910080:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851858.910081:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.910082:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15347@kfi7: PUT: OK
00000100:00000001:25.0:1773851858.910083:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851858.910084:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851858.910085:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000022be2f6e.
00000100:00000040:25.0:1773851858.910086:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000022be2f6e x1859597886923904 msgsize 224
00000100:00100000:25.0:1773851858.910087:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-15155@kfi7 (source: 12345-15347@kfi7)
00000100:00000001:25.0:1773851858.910088:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851858.910089:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 2
00000800:00000200:25.0:1773851858.910091:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851858.910096:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851858.910096:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851858.910097:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851858.910097:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851858.910098:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851858.910099:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597886923904
00000020:00000001:25.0:1773851858.910099:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851858.910100:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e245cf0b2
00000020:00000001:25.0:1773851858.910101:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851858.910104:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ba9687d8 refcount=167
00000020:00000001:25.0:1773851858.910105:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148924044288 : -106924785507328 : ffff9ec0a2246400)
00000020:00000001:25.0:1773851858.910106:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148924044288 : -106924785507328 : ffff9ec0a2246400)
00000100:00000001:25.0:1773851858.910107:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851858.910108:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851858.910108:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000336ac53.
00000020:00000010:25.0:1773851858.910109:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851858.910110:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a35ab917.
00000100:00000001:25.0:1773851858.910111:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851858.910112:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851858.910112:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.910113:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851858.910114:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851858.910114:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851858.910115:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851858.910116:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851858.910116:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851858.910117:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851858.910117:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851858.910118:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15155@kfi7, seq: 2025065
00000100:00000001:25.0:1773851858.910119:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851858.910119:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ba9687d8 : new rpc_count 1
00000100:00000001:25.0:1773851858.910120:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.910120:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637054961771264 : -107018747780352 : ffff9eaac18de300)
00000100:00000040:24.0:1773851858.910121:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000022be2f6e x1859597886923904/t0(0) o400->b12fd27e-5d7d-467c-babb-e02f175d2b7d@15155@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1433-0'
00000100:00000001:24.0:1773851858.910127:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851858.910127:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851858.910128:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022be2f6e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b12fd27e-5d7d-467c-babb-e02f175d2b7d+167:39696:x1859597886923904:12345-15155@kfi7:400:default-tuolumne1433-0
00000100:00000200:24.0:1773851858.910130:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597886923904
00000020:00000001:24.0:1773851858.910130:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851858.910131:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851858.910132:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.910133:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851858.910133:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851858.910134:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851858.910135:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597886923904, found 0 last_xid 1859597886502015
00000020:00000001:24.0:1773851858.910136:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851858.910136:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851858.910137:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851858.910138:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.910138:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851858.910139:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851858.910140:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851858.910140:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000675bd0ea.
02000000:00000001:24.0:1773851858.910141:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.910142:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.910142:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851858.910143:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264058326, transno 0, xid 1859597886923904
00010000:00000001:24.0:1773851858.910144:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851858.910145:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000022be2f6e x1859597886923904/t0(0) o400->b12fd27e-5d7d-467c-babb-e02f175d2b7d@15155@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1433-0'
00010000:00000001:24.0:1773851858.910147:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851858.910148:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851858.910149:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=91 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851858.910150:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851858.910150:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000535dc51a refcount 3 to 15155@kfi7
00000100:00000001:24.0:1773851858.910151:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149344 : -107154898402272 : ffff9e8b0e584420)
02000000:00000001:24.0:1773851858.910152:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851858.910153:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851858.910154:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851858.910155:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15347@kfi7
00000400:00000010:24.0:1773851858.910155:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f9a0eed.
00000100:00000200:24.0:1773851858.910156:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597886923904, offset 224
00000400:00000200:24.0:1773851858.910157:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15347@kfi7
00000400:00000200:24.0:1773851858.910158:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15347@kfi7 to cpt 6
00000400:00000200:24.0:1773851858.910159:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 1
00000400:00000200:24.0:1773851858.910160:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 2
00000400:00000200:24.0:1773851858.910162:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 3
00000400:00000200:24.0:1773851858.910163:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15347@kfi7 local destination
00000400:00000200:24.0:1773851858.910164:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768813:8768813:1024:4294967295] 15347@kfi7 LPNI seq info [691381:691381:16:4294967295]
00000400:00000200:24.0:1773851858.910166:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 2
00000400:00000200:24.0:1773851858.910166:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15347@kfi7 to cpt 6
00000400:00000200:24.0:1773851858.910168:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15347@kfi7(15347@kfi7:15347@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851858.910170:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 3
00000800:00000200:24.0:1773851858.910171:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851858.910172:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851858.910174:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851858.910177:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb1d Using peer 15347@kfi7(0xb1d)
00000800:00000200:24.0:1773851858.910180:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0xb1d: rc=0
00000800:00000200:24.0:1773851858.910181:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb1d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851858.910184:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851858.910184:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000535dc51a refcount 2 to 15155@kfi7
00010000:00000001:24.0:1773851858.910185:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851858.910186:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851858.910187:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851858.910188:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000022be2f6e x1859597886923904/t0(0) o400->b12fd27e-5d7d-467c-babb-e02f175d2b7d@15155@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1433-0'
00000100:00100000:24.0:1773851858.910192:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022be2f6e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b12fd27e-5d7d-467c-babb-e02f175d2b7d+167:39696:x1859597886923904:12345-15155@kfi7:400:default-tuolumne1433-0 Request processed in 64us (106us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851858.910195:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15155@kfi7, seq: 2025065
00000100:00000040:24.0:1773851858.910196:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ba9687d8 : new rpc_count 0
00000100:00000001:24.0:1773851858.910196:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851858.910197:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851858.910198:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851858.910198:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a35ab917.
00000020:00000010:24.0:1773851858.910199:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000336ac53.
00000020:00000040:24.0:1773851858.910200:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ba9687d8 : new refcount 166
00000100:00000001:24.0:1773851858.910201:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851858.910206:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb1d TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851858.910207:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851858.910208:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15347@kfi7: PUT: OK
00000400:00000200:25.0:1773851858.910209:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f9a0eed
00000400:00000010:25.0:1773851858.910210:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f9a0eed.
00000100:00000001:25.0:1773851858.910211:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851858.910212:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851858.910213:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d6f41aa6 nid 15347@kfi7 refs 2
00000800:00000200:25.0:1773851858.910214:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 15347@kfi7(00000000121ba89a):0x0 lsk 2846 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb1d Transaction freed
00000800:00000200:29.0:1773851858.927485:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851858.927487:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851858.927489:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851858.927492:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851858.927495:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18002@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.927497:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18002@kfi7 : PUT - for me
00000400:00000200:29.0:1773851858.927499:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18002@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.927500:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 1
00000400:00000200:29.0:1773851858.927501:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18002@kfi7 to cpt 7
00000400:00000200:29.0:1773851858.927503:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 2
00000400:00000200:29.0:1773851858.927504:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 3
00000400:00000200:29.0:1773851858.927505:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18067@kfi7 to cpt 5
00000400:00000200:29.0:1773851858.927507:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18067@kfi7 of length 224 into portal 12 MB=0x699e0bb3a96c0
00000400:00000200:29.0:1773851858.927509:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18067@kfi7 of length 224/224 into md 0x77fe139dd [64] + 166272
00000800:00000200:29.0:1773851858.927512:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851858.927515:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851858.927517:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18002@kfi7: PUT: OK
00000100:00000001:29.0:1773851858.927518:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851858.927519:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851858.927520:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004125a548.
00000100:00000040:29.0:1773851858.927521:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000004125a548 x1858040353167040 msgsize 224
00000100:00100000:29.0:1773851858.927524:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-18067@kfi7 (source: 12345-18002@kfi7)
00000100:00000001:29.0:1773851858.927526:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851858.927527:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 2
00000100:00000001:31.0:1773851858.927528:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851858.927529:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851858.927529:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851858.927530:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851858.927531:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851858.927532:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851858.927533:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040353167040
00000020:00000001:31.0:1773851858.927534:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851858.927535:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922fa
00000020:00000001:31.0:1773851858.927535:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851858.927540:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000619b7bb2 refcount=9
00000020:00000001:31.0:1773851858.927541:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630288384 : -107123079263232 : ffff9e9276e9cc00)
00000020:00000001:31.0:1773851858.927543:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630288384 : -107123079263232 : ffff9e9276e9cc00)
00000100:00000001:31.0:1773851858.927544:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.927545:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851858.927546:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e268637b.
00000020:00000010:31.0:1773851858.927548:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.927549:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851858.927550:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851858.927551:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851858.927551:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.927553:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851858.927554:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851858.927554:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.927556:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851858.927558:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851858.927558:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851858.927559:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851858.927559:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851858.927561:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18067@kfi7, seq: 2055480
00000100:00000040:31.0:1773851858.927562:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000619b7bb2 : new rpc_count 2
00000100:00000001:28.0:1773851858.927562:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.927563:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221525632 : -106948488025984 : ffff9ebb1d5ca880)
00000100:00000001:28.0:1773851858.927564:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.927565:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004125a548 x1858040353167040/t0(0) o400->5709935f-4ac6-4a50-9510-191ee8f51674@18067@kfi7:646/0 lens 224/0 e 0 to 0 dl 1773852006 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1622-0'
00000100:00000001:31.0:1773851858.927569:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851858.927570:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851858.927572:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004125a548 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5709935f-4ac6-4a50-9510-191ee8f51674+9:39667:x1858040353167040:12345-18067@kfi7:400:default-tuolumne1622-0
00000100:00000200:31.0:1773851858.927574:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040353167040
00000020:00000001:31.0:1773851858.927574:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851858.927575:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851858.927576:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.927577:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851858.927578:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851858.927579:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851858.927580:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040353167040, found 0 last_xid 1858040352483007
00000020:00000001:31.0:1773851858.927581:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851858.927582:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851858.927583:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851858.927584:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.927585:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851858.927586:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851858.927587:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851858.927588:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001595abdd.
02000000:00000001:31.0:1773851858.927589:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.927589:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.927591:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851858.927592:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183242758735, transno 0, xid 1858040353167040
00010000:00000001:31.0:1773851858.927593:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851858.927594:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004125a548 x1858040353167040/t0(0) o400->5709935f-4ac6-4a50-9510-191ee8f51674@18067@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1622-0'
00010000:00000001:31.0:1773851858.927603:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851858.927603:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851858.927605:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=91 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851858.927606:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851858.927607:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004614bb34 refcount 3 to 18067@kfi7
00000100:00000001:31.0:1773851858.927608:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449216 : -107146752102400 : ffff9e8cf3e6f000)
02000000:00000001:31.0:1773851858.927610:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851858.927610:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851858.927611:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851858.927613:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18002@kfi7
00000400:00000010:31.0:1773851858.927614:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001af55591.
00000100:00000200:31.0:1773851858.927615:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040353167040, offset 224
00000400:00000200:31.0:1773851858.927617:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18002@kfi7
00000400:00000200:31.0:1773851858.927619:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18002@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.927620:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 1
00000400:00000200:31.0:1773851858.927621:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 2
00000400:00000200:31.0:1773851858.927623:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 3
00000400:00000200:31.0:1773851858.927625:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18002@kfi7 local destination
00000400:00000200:31.0:1773851858.927627:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768814:8768814:1024:4294967295] 18002@kfi7 LPNI seq info [1264212:1264212:16:4294967295]
00000400:00000200:31.0:1773851858.927629:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 2
00000400:00000200:31.0:1773851858.927631:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18002@kfi7 to cpt 7
00000400:00000200:31.0:1773851858.927634:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18002@kfi7(18002@kfi7:18002@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851858.927636:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 3
00000800:00000200:31.0:1773851858.927638:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851858.927640:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851858.927643:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851858.927647:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x252 Using peer 18002@kfi7(0x252)
00000800:00000200:31.0:1773851858.927654:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x252: rc=0
00000800:00000200:31.0:1773851858.927656:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x252 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851858.927659:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851858.927661:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004614bb34 refcount 2 to 18067@kfi7
00010000:00000001:31.0:1773851858.927662:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851858.927662:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851858.927663:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851858.927665:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004125a548 x1858040353167040/t0(0) o400->5709935f-4ac6-4a50-9510-191ee8f51674@18067@kfi7:646/0 lens 224/224 e 0 to 0 dl 1773852006 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1622-0'
00000100:00100000:31.0:1773851858.927670:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004125a548 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5709935f-4ac6-4a50-9510-191ee8f51674+9:39667:x1858040353167040:12345-18067@kfi7:400:default-tuolumne1622-0 Request processed in 99us (147us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851858.927670:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x252 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851858.927673:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18067@kfi7, seq: 2055480
00000400:00000200:29.0:1773851858.927673:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:31.0:1773851858.927674:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000619b7bb2 : new rpc_count 1
00000100:00000001:31.0:1773851858.927675:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851858.927675:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18002@kfi7: PUT: OK
00000100:00000001:31.0:1773851858.927676:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851858.927676:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001af55591
00000400:00000010:29.0:1773851858.927676:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001af55591.
00000020:00000010:31.0:1773851858.927677:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851858.927678:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000100:00000001:29.0:1773851858.927678:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851858.927678:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851858.927679:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e268637b.
00000020:00000040:31.0:1773851858.927680:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000619b7bb2 : new refcount 8
00000400:00000200:29.0:1773851858.927680:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fd8a5a3a nid 18002@kfi7 refs 2
00000100:00000001:31.0:1773851858.927681:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851858.927682:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 18002@kfi7(000000005241bb58):0x0 lsk 595 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x252 Transaction freed
00000800:00000200:21.0:1773851858.941003:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851858.941004:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851858.941005:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851858.941007:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851858.941008:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9922@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.941010:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9922@kfi7 : PUT - for me
00000400:00000200:21.0:1773851858.941010:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9922@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.941011:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa30b97f nid 9922@kfi7 refs 1
00000400:00000200:21.0:1773851858.941012:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9922@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.941013:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa30b97f nid 9922@kfi7 refs 2
00000400:00000200:21.0:1773851858.941013:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fa30b97f nid 9922@kfi7 refs 3
00000400:00000200:21.0:1773851858.941014:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9731@kfi7 to cpt 5
00000400:00000200:21.0:1773851858.941015:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9731@kfi7 of length 224 into portal 12 MB=0x69aef3ee63340
00000400:00000200:21.0:1773851858.941016:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9731@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 27656
00000800:00000200:21.0:1773851858.941018:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851858.941019:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851858.941020:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9922@kfi7: PUT: OK
00000100:00000001:21.0:1773851858.941021:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851858.941021:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851858.941022:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008e508b29.
00000100:00000040:21.0:1773851858.941023:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008e508b29 x1859202203398976 msgsize 224
00000100:00100000:21.0:1773851858.941024:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9731@kfi7 (source: 12345-9922@kfi7)
00000100:00000001:21.0:1773851858.941025:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851858.941026:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851858.941026:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa30b97f nid 9922@kfi7 refs 2
02000000:00000001:23.0:1773851858.941027:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851858.941027:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851858.941027:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851858.941028:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851858.941029:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851858.941030:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859202203398976
00000020:00000001:23.0:1773851858.941030:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851858.941031:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926ab
00000020:00000001:23.0:1773851858.941031:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851858.941034:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000027235f37 refcount=6
00000020:00000001:23.0:1773851858.941036:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631278592 : -107123078273024 : ffff9e9276f8e800)
00000020:00000001:23.0:1773851858.941037:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631278592 : -107123078273024 : ffff9e9276f8e800)
00000100:00000001:23.0:1773851858.941038:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.941039:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851858.941039:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c42e6026.
00000020:00000010:23.0:1773851858.941040:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851858.941041:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851858.941042:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851858.941042:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851858.941043:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.941044:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851858.941044:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851858.941044:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.941045:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851858.941046:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851858.941047:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851858.941047:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851858.941047:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851858.941048:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9731@kfi7, seq: 1997939
00000100:00000040:23.0:1773851858.941049:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000027235f37 : new rpc_count 1
00000100:00000001:23.0:1773851858.941049:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121406872832 : -106952302678784 : ffff9eba39fdad00)
00000100:00000001:22.0:1773851858.941049:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851858.941050:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.941051:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008e508b29 x1859202203398976/t0(0) o400->12f4e4e0-d2ed-4d13-ae39-91a74ee76f37@9731@kfi7:585/0 lens 224/0 e 0 to 0 dl 1773851945 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1111-0'
00000100:00000001:23.0:1773851858.941053:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851858.941053:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851858.941055:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e508b29 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:12f4e4e0-d2ed-4d13-ae39-91a74ee76f37+6:39649:x1859202203398976:12345-9731@kfi7:400:default-tuolumne1111-0
00000100:00000200:23.0:1773851858.941056:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859202203398976
00000020:00000001:23.0:1773851858.941057:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851858.941057:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851858.941058:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.941058:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851858.941059:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851858.941060:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851858.941060:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859202203398976, found 0 last_xid 1859202203398975
00000020:00000001:23.0:1773851858.941061:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851858.941062:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851858.941062:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851858.941063:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.941064:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851858.941064:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851858.941065:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851858.941065:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f63708ae.
02000000:00000001:23.0:1773851858.941066:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.941066:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.941067:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851858.941068:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182330424862, transno 0, xid 1859202203398976
00010000:00000001:23.0:1773851858.941068:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851858.941069:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008e508b29 x1859202203398976/t0(0) o400->12f4e4e0-d2ed-4d13-ae39-91a74ee76f37@9731@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1111-0'
00010000:00000001:23.0:1773851858.941071:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851858.941072:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851858.941073:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=91 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851858.941074:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851858.941075:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000072857cd3 refcount 3 to 9731@kfi7
00000100:00000001:23.0:1773851858.941075:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956273216 : -107146753278400 : ffff9e8cf3d4fe40)
02000000:00000001:23.0:1773851858.941076:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851858.941077:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851858.941077:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851858.941078:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9922@kfi7
00000400:00000010:23.0:1773851858.941079:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a34f2baa.
00000100:00000200:23.0:1773851858.941079:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859202203398976, offset 224
00000400:00000200:23.0:1773851858.941081:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9922@kfi7
00000400:00000200:23.0:1773851858.941081:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9922@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.941082:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa30b97f nid 9922@kfi7 refs 1
00000400:00000200:23.0:1773851858.941083:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fa30b97f nid 9922@kfi7 refs 2
00000400:00000200:23.0:1773851858.941084:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fa30b97f nid 9922@kfi7 refs 3
00000400:00000200:23.0:1773851858.941086:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9922@kfi7 local destination
00000400:00000200:23.0:1773851858.941087:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768815:8768815:1024:4294967295] 9922@kfi7 LPNI seq info [1056662:1056662:16:4294967295]
00000400:00000200:23.0:1773851858.941089:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fa30b97f nid 9922@kfi7 refs 2
00000400:00000200:23.0:1773851858.941089:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9922@kfi7 to cpt 5
00000400:00000200:23.0:1773851858.941091:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9922@kfi7(9922@kfi7:9922@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851858.941092:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fa30b97f nid 9922@kfi7 refs 3
00000800:00000200:23.0:1773851858.941093:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851858.941095:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851858.941097:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851858.941099:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000008bd Using peer 9922@kfi7(0x1000000000008bd)
00000800:00000200:23.0:1773851858.941102:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x1000000000008bd: rc=0
00000800:00000200:23.0:1773851858.941103:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000008bd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851858.941105:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851858.941106:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000072857cd3 refcount 2 to 9731@kfi7
00010000:00000001:23.0:1773851858.941107:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851858.941107:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851858.941108:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851858.941109:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008e508b29 x1859202203398976/t0(0) o400->12f4e4e0-d2ed-4d13-ae39-91a74ee76f37@9731@kfi7:585/0 lens 224/224 e 0 to 0 dl 1773851945 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1111-0'
00000100:00100000:23.0:1773851858.941112:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e508b29 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:12f4e4e0-d2ed-4d13-ae39-91a74ee76f37+6:39649:x1859202203398976:12345-9731@kfi7:400:default-tuolumne1111-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851858.941114:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9731@kfi7, seq: 1997939
00000800:00000200:21.0:1773851858.941114:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000008bd TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851858.941115:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000027235f37 : new rpc_count 0
00000400:00000200:21.0:1773851858.941115:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851858.941116:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851858.941116:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851858.941116:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851858.941116:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9922@kfi7: PUT: OK
00000020:00000010:23.0:1773851858.941117:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851858.941117:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a34f2baa
00000400:00000010:21.0:1773851858.941117:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a34f2baa.
00000020:00000010:23.0:1773851858.941118:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c42e6026.
00000100:00000001:21.0:1773851858.941118:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851858.941118:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:23.0:1773851858.941119:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000027235f37 : new refcount 5
00000400:00000200:21.0:1773851858.941119:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa30b97f nid 9922@kfi7 refs 2
00000100:00000001:23.0:1773851858.941120:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851858.941120:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 9922@kfi7(00000000687b4969):0x0 lsk 2238 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000008bd Transaction freed
00000800:00000200:13.0:1773851859.006508:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.006509:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851859.006510:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.006512:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851859.006515:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15168@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.006516:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15168@kfi7 : PUT - for me
00000400:00000200:13.0:1773851859.006517:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15168@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.006518:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067eecab6 nid 15168@kfi7 refs 1
00000400:00000200:13.0:1773851859.006519:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15168@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.006520:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067eecab6 nid 15168@kfi7 refs 2
00000400:00000200:13.0:1773851859.006521:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000067eecab6 nid 15168@kfi7 refs 3
00000400:00000200:13.0:1773851859.006523:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15168@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.006524:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15168@kfi7 of length 224 into portal 12 MB=0x699e0a73b1200
00000400:00000200:13.0:1773851859.006525:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15168@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 19496
00000800:00000200:13.0:1773851859.006528:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851859.006529:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.006531:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15168@kfi7: PUT: OK
00000100:00000001:13.0:1773851859.006532:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851859.006532:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851859.006533:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000005ed2c00.
00000100:00000040:13.0:1773851859.006534:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000005ed2c00 x1858040017654272 msgsize 224
00000100:00100000:13.0:1773851859.006536:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-15168@kfi7 (source: 12345-15168@kfi7)
00000100:00000001:13.0:1773851859.006537:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851859.006538:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000067eecab6 nid 15168@kfi7 refs 2
00000800:00000200:13.0:1773851859.006539:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851859.006542:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851859.006542:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851859.006543:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851859.006544:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851859.006545:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851859.006545:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040017654272
00000020:00000001:13.0:1773851859.006546:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851859.006546:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e8c
00000020:00000001:13.0:1773851859.006547:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851859.006549:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009753de7f refcount=168
00000020:00000001:13.0:1773851859.006550:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628791296 : -107123080760320 : ffff9e9276d2f400)
00000020:00000001:13.0:1773851859.006551:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628791296 : -107123080760320 : ffff9e9276d2f400)
00000100:00000001:13.0:1773851859.006552:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851859.006553:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851859.006554:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a79b6cda.
00000020:00000010:13.0:1773851859.006555:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851859.006556:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002eeb256e.
00000100:00000001:13.0:1773851859.006557:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851859.006558:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851859.006558:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851859.006559:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851859.006560:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851859.006560:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.006561:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.006562:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851859.006562:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.006563:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851859.006563:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851859.006564:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15168@kfi7, seq: 2289793
00000100:00000040:15.0:1773851859.006565:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009753de7f : new rpc_count 1
00000100:00000001:15.0:1773851859.006565:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537173760 : -107002172377856 : ffff9eae9d867500)
00000100:00000001:13.0:1773851859.006565:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.006566:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851859.006567:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000005ed2c00 x1858040017654272/t0(0) o400->4456cb5b-6d36-4bbc-8af9-eba1e5a16ef3@15168@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1444-0'
00000100:00000001:15.0:1773851859.006569:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.006570:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851859.006571:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005ed2c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4456cb5b-6d36-4bbc-8af9-eba1e5a16ef3+168:39706:x1858040017654272:12345-15168@kfi7:400:default-tuolumne1444-0
00000100:00000200:15.0:1773851859.006572:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040017654272
00000020:00000001:15.0:1773851859.006573:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851859.006573:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851859.006574:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.006575:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851859.006575:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851859.006576:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851859.006577:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040017654272, found 0 last_xid 1858040017228543
00000020:00000001:15.0:1773851859.006578:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851859.006578:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851859.006579:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851859.006580:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.006581:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851859.006581:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851859.006582:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851859.006582:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad15dc46.
02000000:00000001:15.0:1773851859.006583:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.006584:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.006585:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851859.006586:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062264, transno 0, xid 1858040017654272
00010000:00000001:15.0:1773851859.006586:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851859.006587:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000005ed2c00 x1858040017654272/t0(0) o400->4456cb5b-6d36-4bbc-8af9-eba1e5a16ef3@15168@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1444-0'
00010000:00000001:15.0:1773851859.006590:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851859.006590:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851859.006591:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=92 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851859.006592:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851859.006593:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000020ce8cb1 refcount 3 to 15168@kfi7
00000100:00000001:15.0:1773851859.006594:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902776384 : -107154806775232 : ffff9e8b13ce6240)
02000000:00000001:15.0:1773851859.006595:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851859.006595:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.006596:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851859.006597:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15168@kfi7
00000400:00000010:15.0:1773851859.006598:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000067df834c.
00000100:00000200:15.0:1773851859.006599:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040017654272, offset 224
00000400:00000200:15.0:1773851859.006600:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15168@kfi7
00000400:00000200:15.0:1773851859.006602:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15168@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.006602:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067eecab6 nid 15168@kfi7 refs 1
00000400:00000200:15.0:1773851859.006604:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000067eecab6 nid 15168@kfi7 refs 2
00000400:00000200:15.0:1773851859.006605:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000067eecab6 nid 15168@kfi7 refs 3
00000400:00000200:15.0:1773851859.006606:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15168@kfi7 local destination
00000400:00000200:15.0:1773851859.006607:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768816:8768816:1024:4294967295] 15168@kfi7 LPNI seq info [776707:776707:16:4294967295]
00000400:00000200:15.0:1773851859.006609:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000067eecab6 nid 15168@kfi7 refs 2
00000400:00000200:15.0:1773851859.006610:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15168@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.006612:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15168@kfi7(15168@kfi7:15168@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851859.006613:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000067eecab6 nid 15168@kfi7 refs 3
00000800:00000200:15.0:1773851859.006615:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851859.006616:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851859.006618:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851859.006620:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005f6 Using peer 15168@kfi7(0x1000000000005f6)
00000800:00000200:15.0:1773851859.006624:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x1000000000005f6: rc=0
00000800:00000200:15.0:1773851859.006625:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005f6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851859.006627:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851859.006628:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000020ce8cb1 refcount 2 to 15168@kfi7
00010000:00000001:15.0:1773851859.006629:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851859.006629:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.006630:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851859.006630:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000005ed2c00 x1858040017654272/t0(0) o400->4456cb5b-6d36-4bbc-8af9-eba1e5a16ef3@15168@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1444-0'
00000100:00100000:15.0:1773851859.006634:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005ed2c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4456cb5b-6d36-4bbc-8af9-eba1e5a16ef3+168:39706:x1858040017654272:12345-15168@kfi7:400:default-tuolumne1444-0 Request processed in 63us (99us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851859.006636:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15168@kfi7, seq: 2289793
00000100:00000040:15.0:1773851859.006637:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009753de7f : new rpc_count 0
00000800:00000200:13.0:1773851859.006637:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005f6 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851859.006638:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851859.006638:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851859.006639:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:13.0:1773851859.006639:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851859.006640:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002eeb256e.
00000020:00000010:15.0:1773851859.006640:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a79b6cda.
00000400:00000200:13.0:1773851859.006640:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15168@kfi7: PUT: OK
00000020:00000040:15.0:1773851859.006641:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000009753de7f : new refcount 167
00000400:00000200:13.0:1773851859.006641:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000067df834c
00000100:00000001:15.0:1773851859.006642:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851859.006642:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000067df834c.
00000100:00000001:13.0:1773851859.006642:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851859.006643:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851859.006644:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000067eecab6 nid 15168@kfi7 refs 2
00000800:00000200:13.0:1773851859.006645:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 15168@kfi7(0000000054a8c5ef):0x0 lsk 1527 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005f6 Transaction freed
00000800:00000200:17.0:1773851859.018584:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851859.018585:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851859.018587:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851859.018590:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851859.018593:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22690@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.018596:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22690@kfi7 : PUT - for me
00000400:00000200:17.0:1773851859.018597:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22690@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.018598:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083c38ced nid 22690@kfi7 refs 1
00000400:00000200:17.0:1773851859.018600:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22690@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.018601:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083c38ced nid 22690@kfi7 refs 2
00000400:00000200:17.0:1773851859.018602:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083c38ced nid 22690@kfi7 refs 3
00000400:00000200:17.0:1773851859.018604:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22627@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.018605:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22627@kfi7 of length 224 into portal 12 MB=0x69b4b60998140
00000400:00000200:17.0:1773851859.018607:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22627@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 194112
00000800:00000200:17.0:1773851859.018610:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851859.018613:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851859.018615:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22690@kfi7: PUT: OK
00000100:00000001:17.0:1773851859.018616:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851859.018617:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851859.018618:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000635870f3.
00000100:00000040:17.0:1773851859.018619:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000635870f3 x1859597905789248 msgsize 224
00000100:00100000:17.0:1773851859.018622:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22627@kfi7 (source: 12345-22690@kfi7)
00000100:00000001:17.0:1773851859.018623:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851859.018625:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083c38ced nid 22690@kfi7 refs 2
00000100:00000001:19.0:1773851859.018626:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851859.018627:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851859.018627:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851859.018628:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851859.018629:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851859.018630:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851859.018631:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597905789248
00000020:00000001:19.0:1773851859.018632:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851859.018633:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2434d3f8
00000020:00000001:19.0:1773851859.018634:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851859.018636:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000effed7af refcount=5
00000020:00000001:19.0:1773851859.018637:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637147303032832 : -106926406518784 : ffff9ec04185b800)
00000020:00000001:19.0:1773851859.018638:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637147303032832 : -106926406518784 : ffff9ec04185b800)
00000100:00000001:19.0:1773851859.018640:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851859.018641:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851859.018642:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851859.018643:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851859.018645:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851859.018646:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851859.018647:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851859.018648:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851859.018649:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851859.018650:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851859.018650:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.018652:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851859.018654:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851859.018654:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851859.018655:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851859.018655:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851859.018656:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22627@kfi7, seq: 2156279
00000100:00000040:19.0:1773851859.018658:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000effed7af : new rpc_count 1
00000100:00000001:18.0:1773851859.018658:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.018659:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764359808 : -107095945191808 : ffff9e98c83ade80)
00000100:00000001:18.0:1773851859.018659:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851859.018660:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000635870f3 x1859597905789248/t0(0) o400->b2b1cb21-7b7d-4ed0-b7ea-796764e9a655@22627@kfi7:49/0 lens 224/0 e 0 to 0 dl 1773852164 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1900-0'
00000100:00000001:19.0:1773851859.018665:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851859.018665:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851859.018667:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000635870f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b2b1cb21-7b7d-4ed0-b7ea-796764e9a655+5:39556:x1859597905789248:12345-22627@kfi7:400:default-tuolumne1900-0
00000100:00000200:19.0:1773851859.018671:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597905789248
00000020:00000001:19.0:1773851859.018672:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851859.018673:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851859.018674:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.018675:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851859.018676:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851859.018677:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851859.018678:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597905789248, found 0 last_xid 1859597905789247
00000020:00000001:19.0:1773851859.018679:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851859.018680:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851859.018681:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851859.018682:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.018683:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851859.018684:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851859.018685:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851859.018686:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000099e6b427.
02000000:00000001:19.0:1773851859.018686:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.018687:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.018689:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851859.018690:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182729381573, transno 0, xid 1859597905789248
00010000:00000001:19.0:1773851859.018691:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851859.018692:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000635870f3 x1859597905789248/t0(0) o400->b2b1cb21-7b7d-4ed0-b7ea-796764e9a655@22627@kfi7:49/0 lens 224/224 e 0 to 0 dl 1773852164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1900-0'
00010000:00000001:19.0:1773851859.018696:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851859.018697:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851859.018698:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=92 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851859.018700:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851859.018701:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c3d50528 refcount 3 to 22627@kfi7
00000100:00000001:19.0:1773851859.018702:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332416 : -107155408219200 : ffff9e8aeff513c0)
02000000:00000001:19.0:1773851859.018704:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851859.018704:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.018705:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851859.018707:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22690@kfi7
00000400:00000010:19.0:1773851859.018708:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cf50fa01.
00000100:00000200:19.0:1773851859.018710:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597905789248, offset 224
00000400:00000200:19.0:1773851859.018712:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22690@kfi7
00000400:00000200:19.0:1773851859.018713:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22690@kfi7 to cpt 4
00000400:00000200:19.0:1773851859.018714:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083c38ced nid 22690@kfi7 refs 1
00000400:00000200:19.0:1773851859.018716:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083c38ced nid 22690@kfi7 refs 2
00000400:00000200:19.0:1773851859.018718:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083c38ced nid 22690@kfi7 refs 3
00000400:00000200:19.0:1773851859.018720:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22690@kfi7 local destination
00000400:00000200:19.0:1773851859.018722:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768817:8768817:1024:4294967295] 22690@kfi7 LPNI seq info [270102:270102:16:4294967295]
00000400:00000200:19.0:1773851859.018724:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083c38ced nid 22690@kfi7 refs 2
00000400:00000200:19.0:1773851859.018732:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22690@kfi7 to cpt 4
00000400:00000200:19.0:1773851859.018735:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22690@kfi7(22690@kfi7:22690@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851859.018737:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083c38ced nid 22690@kfi7 refs 3
00000800:00000200:19.0:1773851859.018740:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851859.018742:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851859.018745:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851859.018749:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005ee Using peer 22690@kfi7(0x1000000000005ee)
00000800:00000200:19.0:1773851859.018753:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x1000000000005ee: rc=0
00000800:00000200:19.0:1773851859.018756:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005ee TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851859.018759:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851859.018760:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c3d50528 refcount 2 to 22627@kfi7
00010000:00000001:19.0:1773851859.018761:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851859.018762:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.018763:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851859.018764:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000635870f3 x1859597905789248/t0(0) o400->b2b1cb21-7b7d-4ed0-b7ea-796764e9a655@22627@kfi7:49/0 lens 224/224 e 0 to 0 dl 1773852164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1900-0'
00000100:00100000:19.0:1773851859.018769:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000635870f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b2b1cb21-7b7d-4ed0-b7ea-796764e9a655+5:39556:x1859597905789248:12345-22627@kfi7:400:default-tuolumne1900-0 Request processed in 103us (149us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851859.018769:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005ee TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851859.018772:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851859.018773:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22627@kfi7, seq: 2156279
00000400:00000200:17.0:1773851859.018774:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22690@kfi7: PUT: OK
00000100:00000040:19.0:1773851859.018775:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000effed7af : new rpc_count 0
00000400:00000200:17.0:1773851859.018775:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cf50fa01
00000100:00000001:19.0:1773851859.018776:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:17.0:1773851859.018776:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cf50fa01.
00000100:00000001:19.0:1773851859.018777:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851859.018777:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000100:00000001:17.0:1773851859.018777:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851859.018777:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851859.018779:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000400:00000200:17.0:1773851859.018779:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083c38ced nid 22690@kfi7 refs 2
00000020:00000010:19.0:1773851859.018780:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000020:00000040:19.0:1773851859.018781:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000effed7af : new refcount 4
00000800:00000200:17.0:1773851859.018781:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22690@kfi7(00000000217ac28b):0x0 lsk 1519 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005ee Transaction freed
00000100:00000001:19.0:1773851859.018782:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851859.023110:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.023111:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.023112:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.023114:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.023116:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22723@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.023117:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22723@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.023118:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22723@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.023119:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df698d42 nid 22723@kfi7 refs 1
00000400:00000200:5.0:1773851859.023121:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22723@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.023121:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df698d42 nid 22723@kfi7 refs 2
00000400:00000200:5.0:1773851859.023122:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000df698d42 nid 22723@kfi7 refs 3
00000400:00000200:5.0:1773851859.023123:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22531@kfi7 to cpt 6
00000400:00000200:5.0:1773851859.023124:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22531@kfi7 of length 224 into portal 12 MB=0x699e5f3d8f180
00000400:00000200:5.0:1773851859.023125:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22531@kfi7 of length 224/224 into md 0x793926dc5 [64] + 122728
00000800:00000200:5.0:1773851859.023127:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.023129:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.023130:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22723@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.023130:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.023131:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.023132:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f51c0bff.
00000100:00000040:5.0:1773851859.023132:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000f51c0bff x1858062777905536 msgsize 224
00000100:00100000:5.0:1773851859.023134:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22531@kfi7 (source: 12345-22723@kfi7)
00000100:00000001:5.0:1773851859.023135:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851859.023136:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000df698d42 nid 22723@kfi7 refs 2
00000800:00000200:5.0:1773851859.023137:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851859.023140:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851859.023141:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851859.023141:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851859.023142:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851859.023143:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851859.023143:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062777905536
00000020:00000001:5.0:1773851859.023144:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851859.023144:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a6a
00000020:00000001:5.0:1773851859.023145:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851859.023150:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b8260c62 refcount=6
00000020:00000001:5.0:1773851859.023151:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743450624 : -107128966100992 : ffff9e911807c800)
00000020:00000001:5.0:1773851859.023151:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743450624 : -107128966100992 : ffff9e911807c800)
00000100:00000001:5.0:1773851859.023152:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851859.023153:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851859.023154:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047539c0b.
00000020:00000010:5.0:1773851859.023155:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851859.023156:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851859.023157:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851859.023157:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851859.023158:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851859.023159:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851859.023159:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851859.023160:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851859.023160:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851859.023161:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.023162:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.023162:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851859.023162:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851859.023163:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22531@kfi7, seq: 2001871
00000100:00000001:7.0:1773851859.023164:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.023164:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851859.023164:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b8260c62 : new rpc_count 1
00000100:00000001:5.0:1773851859.023165:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866936448 : -107088842615168 : ffff9e9a6f939680)
00000100:00000040:5.0:1773851859.023166:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f51c0bff x1858062777905536/t0(0) o400->e37c8c4c-f181-417b-afe5-27854c771094@22531@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1911-0'
00000100:00000001:5.0:1773851859.023168:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851859.023168:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851859.023170:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f51c0bff pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e37c8c4c-f181-417b-afe5-27854c771094+6:39773:x1858062777905536:12345-22531@kfi7:400:default-tuolumne1911-0
00000100:00000200:5.0:1773851859.023171:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062777905536
00000020:00000001:5.0:1773851859.023171:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851859.023172:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851859.023173:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851859.023173:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851859.023174:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851859.023175:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851859.023175:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858062777905536, found 0 last_xid 1858062777905535
00000020:00000001:5.0:1773851859.023176:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851859.023177:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851859.023177:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851859.023177:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851859.023178:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851859.023179:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851859.023179:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851859.023180:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000480faedd.
02000000:00000001:5.0:1773851859.023180:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851859.023181:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851859.023182:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851859.023182:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182844019521, transno 0, xid 1858062777905536
00010000:00000001:5.0:1773851859.023183:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851859.023184:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f51c0bff x1858062777905536/t0(0) o400->e37c8c4c-f181-417b-afe5-27854c771094@22531@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1911-0'
00010000:00000001:5.0:1773851859.023186:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851859.023186:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851859.023187:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851859.023188:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851859.023189:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032450707 refcount 3 to 22531@kfi7
00000100:00000001:5.0:1773851859.023190:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858976 : -107149578692640 : ffff9e8c4b6c97e0)
02000000:00000001:5.0:1773851859.023190:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851859.023191:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851859.023191:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851859.023193:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22723@kfi7
00000400:00000010:5.0:1773851859.023193:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a7a6c8b.
00000100:00000200:5.0:1773851859.023194:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858062777905536, offset 224
00000400:00000200:5.0:1773851859.023196:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22723@kfi7
00000400:00000200:5.0:1773851859.023196:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22723@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.023197:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df698d42 nid 22723@kfi7 refs 1
00000400:00000200:5.0:1773851859.023198:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000df698d42 nid 22723@kfi7 refs 2
00000400:00000200:5.0:1773851859.023199:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000df698d42 nid 22723@kfi7 refs 3
00000400:00000200:5.0:1773851859.023200:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22723@kfi7 local destination
00000400:00000200:5.0:1773851859.023201:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768818:8768818:1024:4294967295] 22723@kfi7 LPNI seq info [65260631:65260631:16:4294967295]
00000400:00000200:5.0:1773851859.023203:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000df698d42 nid 22723@kfi7 refs 2
00000400:00000200:5.0:1773851859.023203:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22723@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.023205:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22723@kfi7(22723@kfi7:22723@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851859.023206:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000df698d42 nid 22723@kfi7 refs 3
00000800:00000200:5.0:1773851859.023207:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.023208:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851859.023210:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851859.023212:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008da Using peer 22723@kfi7(0x1000000000008da)
00000800:00000200:5.0:1773851859.023215:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x1000000000008da: rc=0
00000800:00000200:5.0:1773851859.023217:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008da TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851859.023218:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851859.023219:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032450707 refcount 2 to 22531@kfi7
00010000:00000001:5.0:1773851859.023220:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851859.023220:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851859.023221:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851859.023222:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f51c0bff x1858062777905536/t0(0) o400->e37c8c4c-f181-417b-afe5-27854c771094@22531@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1911-0'
00000100:00100000:5.0:1773851859.023227:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f51c0bff pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e37c8c4c-f181-417b-afe5-27854c771094+6:39773:x1858062777905536:12345-22531@kfi7:400:default-tuolumne1911-0 Request processed in 58us (94us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851859.023229:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22531@kfi7, seq: 2001871
00000800:00000200:6.0:1773851859.023230:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008da TN_EVENT_TX_OK event status 0
00000100:00000040:5.0:1773851859.023230:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b8260c62 : new rpc_count 0
00000400:00000200:6.0:1773851859.023231:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851859.023231:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851859.023231:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851859.023232:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22723@kfi7: PUT: OK
00000020:00000010:5.0:1773851859.023232:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851859.023232:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000400:00000200:6.0:1773851859.023233:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a7a6c8b
00000400:00000010:6.0:1773851859.023233:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a7a6c8b.
00000020:00000010:5.0:1773851859.023233:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047539c0b.
00000100:00000001:6.0:1773851859.023234:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851859.023234:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:5.0:1773851859.023234:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000b8260c62 : new refcount 5
00000400:00000200:6.0:1773851859.023235:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000df698d42 nid 22723@kfi7 refs 2
00000100:00000001:5.0:1773851859.023235:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851859.023237:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 22723@kfi7(00000000cab91521):0x0 lsk 2267 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008da Transaction freed
00000800:00000200:21.0:1773851859.071059:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851859.071060:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851859.071061:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851859.071063:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851859.071065:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24866@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.071066:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24866@kfi7 : PUT - for me
00000400:00000200:21.0:1773851859.071067:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24866@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.071068:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c120254 nid 24866@kfi7 refs 1
00000400:00000200:21.0:1773851859.071070:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24866@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.071070:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c120254 nid 24866@kfi7 refs 2
00000400:00000200:21.0:1773851859.071071:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000c120254 nid 24866@kfi7 refs 3
00000400:00000200:21.0:1773851859.071072:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24867@kfi7 to cpt 0
00000400:00000200:21.0:1773851859.071073:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24867@kfi7 of length 224 into portal 12 MB=0x69b4befa320c0
00000400:00000200:21.0:1773851859.071074:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24867@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 27880
00000800:00000200:21.0:1773851859.071075:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851859.071076:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.071077:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24866@kfi7: PUT: OK
00000100:00000001:21.0:1773851859.071078:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851859.071079:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851859.071080:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009bfb0afa.
00000100:00000040:21.0:1773851859.071080:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009bfb0afa x1859600305561792 msgsize 224
00000100:00100000:21.0:1773851859.071082:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24867@kfi7 (source: 12345-24866@kfi7)
00000100:00000001:21.0:1773851859.071082:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851859.071083:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000c120254 nid 24866@kfi7 refs 2
00000100:00000001:23.0:1773851859.071084:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851859.071084:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851859.071085:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851859.071085:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851859.071086:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851859.071086:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.071087:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600305561792
00000020:00000001:23.0:1773851859.071088:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.071088:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3895ba1d
00000020:00000001:23.0:1773851859.071088:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.071091:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e440ecab refcount=5
00000020:00000001:23.0:1773851859.071092:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137288122368 : -106936421429248 : ffff9ebdec965000)
00000020:00000001:23.0:1773851859.071093:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637137288122368 : -106936421429248 : ffff9ebdec965000)
00000100:00000001:23.0:1773851859.071094:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.071094:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.071095:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c42e6026.
00000020:00000010:23.0:1773851859.071096:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.071097:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.071098:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.071098:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.071099:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.071099:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.071100:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.071100:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.071101:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.071102:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.071103:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851859.071103:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851859.071103:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851859.071104:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24867@kfi7, seq: 1997940
00000100:00000040:23.0:1773851859.071105:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e440ecab : new rpc_count 1
00000100:00000001:23.0:1773851859.071105:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073065989504 : -107000643562112 : ffff9eaef8a65580)
00000100:00000001:22.0:1773851859.071105:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851859.071105:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.071106:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009bfb0afa x1859600305561792/t0(0) o400->e56351f0-fd97-4408-9539-6df37a5a5762@24867@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2043-0'
00000100:00000001:23.0:1773851859.071109:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.071110:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.071111:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009bfb0afa pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e56351f0-fd97-4408-9539-6df37a5a5762+5:39599:x1859600305561792:12345-24867@kfi7:400:default-tuolumne2043-0
00000100:00000200:23.0:1773851859.071112:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600305561792
00000020:00000001:23.0:1773851859.071113:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.071113:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.071114:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.071115:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.071115:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.071116:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.071116:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600305561792, found 0 last_xid 1859600305561791
00000020:00000001:23.0:1773851859.071117:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.071118:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.071118:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.071119:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.071120:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.071120:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.071121:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.071121:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c6858664.
02000000:00000001:23.0:1773851859.071122:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.071123:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.071123:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.071124:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260562964, transno 0, xid 1859600305561792
00010000:00000001:23.0:1773851859.071124:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.071125:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009bfb0afa x1859600305561792/t0(0) o400->e56351f0-fd97-4408-9539-6df37a5a5762@24867@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2043-0'
00010000:00000001:23.0:1773851859.071127:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.071128:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.071129:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.071130:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.071130:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b2c3c5c0 refcount 3 to 24867@kfi7
00000100:00000001:23.0:1773851859.071131:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729378304 : -107155980173312 : ffff9e8acdddc000)
02000000:00000001:23.0:1773851859.071132:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.071132:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.071134:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.071134:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24866@kfi7
00000400:00000010:23.0:1773851859.071135:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007062c552.
00000100:00000200:23.0:1773851859.071136:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600305561792, offset 224
00000400:00000200:23.0:1773851859.071137:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24866@kfi7
00000400:00000200:23.0:1773851859.071138:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24866@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.071138:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c120254 nid 24866@kfi7 refs 1
00000400:00000200:23.0:1773851859.071139:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000c120254 nid 24866@kfi7 refs 2
00000400:00000200:23.0:1773851859.071141:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000c120254 nid 24866@kfi7 refs 3
00000400:00000200:23.0:1773851859.071142:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24866@kfi7 local destination
00000400:00000200:23.0:1773851859.071143:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768819:8768819:1024:4294967295] 24866@kfi7 LPNI seq info [167676:167676:16:4294967295]
00000400:00000200:23.0:1773851859.071144:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000c120254 nid 24866@kfi7 refs 2
00000400:00000200:23.0:1773851859.071145:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24866@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.071147:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24866@kfi7(24866@kfi7:24866@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.071148:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000c120254 nid 24866@kfi7 refs 3
00000800:00000200:23.0:1773851859.071149:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.071150:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.071152:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.071154:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa8 Using peer 24866@kfi7(0xaa8)
00000800:00000200:23.0:1773851859.071157:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0xaa8: rc=0
00000800:00000200:23.0:1773851859.071158:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.071160:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.071161:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b2c3c5c0 refcount 2 to 24867@kfi7
00010000:00000001:23.0:1773851859.071162:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.071162:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.071163:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.071163:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009bfb0afa x1859600305561792/t0(0) o400->e56351f0-fd97-4408-9539-6df37a5a5762@24867@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2043-0'
00000100:00100000:23.0:1773851859.071167:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009bfb0afa pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e56351f0-fd97-4408-9539-6df37a5a5762+5:39599:x1859600305561792:12345-24867@kfi7:400:default-tuolumne2043-0 Request processed in 57us (85us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851859.071169:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24867@kfi7, seq: 1997940
00000100:00000040:23.0:1773851859.071169:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e440ecab : new rpc_count 0
00000100:00000001:23.0:1773851859.071170:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851859.071170:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa8 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851859.071171:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851859.071171:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.071172:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851859.071172:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.071172:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24866@kfi7: PUT: OK
00000020:00000010:23.0:1773851859.071173:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c42e6026.
00000020:00000040:23.0:1773851859.071173:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000e440ecab : new refcount 4
00000400:00000200:21.0:1773851859.071173:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007062c552
00000400:00000010:21.0:1773851859.071173:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007062c552.
00000100:00000001:23.0:1773851859.071174:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851859.071174:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851859.071174:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851859.071175:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000c120254 nid 24866@kfi7 refs 2
00000800:00000200:21.0:1773851859.071176:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 24866@kfi7(00000000136a2a67):0x0 lsk 2729 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa8 Transaction freed
00000800:00000200:13.0:1773851859.074841:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.074842:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851859.074843:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.074845:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851859.074848:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17875@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.074849:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17875@kfi7 : PUT - for me
00000400:00000200:13.0:1773851859.074850:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17875@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.074851:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009818f1f nid 17875@kfi7 refs 1
00000400:00000200:13.0:1773851859.074853:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17875@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.074853:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009818f1f nid 17875@kfi7 refs 2
00000400:00000200:13.0:1773851859.074855:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000009818f1f nid 17875@kfi7 refs 3
00000400:00000200:13.0:1773851859.074856:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17875@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.074857:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17875@kfi7 of length 224 into portal 12 MB=0x69b4b6c826a40
00000400:00000200:13.0:1773851859.074858:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17875@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 19720
00000800:00000200:13.0:1773851859.074859:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851859.074861:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.074862:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17875@kfi7: PUT: OK
00000100:00000001:13.0:1773851859.074864:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851859.074864:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851859.074865:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d5838f1d.
00000100:00000040:13.0:1773851859.074866:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000d5838f1d x1859598105602624 msgsize 224
00000100:00100000:13.0:1773851859.074867:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-17875@kfi7 (source: 12345-17875@kfi7)
00000100:00000001:13.0:1773851859.074869:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851859.074870:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000009818f1f nid 17875@kfi7 refs 2
00000100:00000001:15.0:1773851859.074871:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851859.074871:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851859.074872:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851859.074873:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851859.074874:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851859.074875:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851859.074877:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598105602624
00000020:00000001:15.0:1773851859.074878:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851859.074879:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f84c
00000020:00000001:15.0:1773851859.074880:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851859.074884:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000021a0de50 refcount=5
00000020:00000001:15.0:1773851859.074886:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164300459008 : -106909409092608 : ffff9ec436a5dc00)
00000020:00000001:15.0:1773851859.074887:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637164300459008 : -106909409092608 : ffff9ec436a5dc00)
00000100:00000001:15.0:1773851859.074888:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.074890:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851859.074891:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b7d5d081.
00000020:00000010:15.0:1773851859.074893:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851859.074894:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007edbe72e.
00000100:00000001:15.0:1773851859.074896:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851859.074897:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851859.074898:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.074900:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851859.074900:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851859.074901:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.074903:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851859.074904:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.074905:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.074905:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851859.074905:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851859.074906:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17875@kfi7, seq: 2289794
00000100:00000001:15.0:1773851859.074907:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851859.074907:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000021a0de50 : new rpc_count 1
00000100:00000001:15.0:1773851859.074908:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.074908:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537151872 : -107002172399744 : ffff9eae9d861f80)
00000100:00000040:13.0:1773851859.074909:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d5838f1d x1859598105602624/t0(0) o400->ee242113-937a-432f-8d7b-24ceb822fb0b@17875@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1605-0'
00000100:00000001:13.0:1773851859.074912:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851859.074912:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851859.074913:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5838f1d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ee242113-937a-432f-8d7b-24ceb822fb0b+5:39663:x1859598105602624:12345-17875@kfi7:400:default-tuolumne1605-0
00000100:00000200:13.0:1773851859.074915:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598105602624
00000020:00000001:13.0:1773851859.074915:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851859.074916:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851859.074918:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.074919:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851859.074919:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851859.074920:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851859.074921:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598105602624, found 0 last_xid 1859598105602623
00000020:00000001:13.0:1773851859.074922:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851859.074922:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851859.074923:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851859.074924:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.074924:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851859.074925:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851859.074925:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851859.074926:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000058212853.
02000000:00000001:13.0:1773851859.074927:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.074928:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.074929:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851859.074929:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183099259509, transno 0, xid 1859598105602624
00010000:00000001:13.0:1773851859.074930:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851859.074931:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d5838f1d x1859598105602624/t0(0) o400->ee242113-937a-432f-8d7b-24ceb822fb0b@17875@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1605-0'
00010000:00000001:13.0:1773851859.074933:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851859.074934:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851859.074935:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=92 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851859.074936:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851859.074937:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000774b6b79 refcount 3 to 17875@kfi7
00000100:00000001:13.0:1773851859.074937:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621120 : -107151221930496 : ffff9e8be97ac600)
02000000:00000001:13.0:1773851859.074938:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851859.074939:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.074940:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851859.074940:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17875@kfi7
00000400:00000010:13.0:1773851859.074941:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000734400bf.
00000100:00000200:13.0:1773851859.074942:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598105602624, offset 224
00000400:00000200:13.0:1773851859.074943:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17875@kfi7
00000400:00000200:13.0:1773851859.074944:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17875@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.074944:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009818f1f nid 17875@kfi7 refs 1
00000400:00000200:13.0:1773851859.074946:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000009818f1f nid 17875@kfi7 refs 2
00000400:00000200:13.0:1773851859.074947:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000009818f1f nid 17875@kfi7 refs 3
00000400:00000200:13.0:1773851859.074948:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17875@kfi7 local destination
00000400:00000200:13.0:1773851859.074950:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768820:8768820:1024:4294967295] 17875@kfi7 LPNI seq info [13485775:13485775:16:4294967295]
00000400:00000200:13.0:1773851859.074951:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000009818f1f nid 17875@kfi7 refs 2
00000400:00000200:13.0:1773851859.074952:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17875@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.074954:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17875@kfi7(17875@kfi7:17875@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851859.074955:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000009818f1f nid 17875@kfi7 refs 3
00000800:00000200:13.0:1773851859.074956:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.074957:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851859.074960:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851859.074962:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000319 Using peer 17875@kfi7(0x100000000000319)
00000800:00000200:13.0:1773851859.074965:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 324 bytes to peer 0x100000000000319: rc=0
00000800:00000200:13.0:1773851859.074967:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000319 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851859.074969:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851859.074970:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000774b6b79 refcount 2 to 17875@kfi7
00010000:00000001:13.0:1773851859.074970:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851859.074971:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.074972:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851859.074973:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d5838f1d x1859598105602624/t0(0) o400->ee242113-937a-432f-8d7b-24ceb822fb0b@17875@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1605-0'
00000100:00100000:13.0:1773851859.074976:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5838f1d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ee242113-937a-432f-8d7b-24ceb822fb0b+5:39663:x1859598105602624:12345-17875@kfi7:400:default-tuolumne1605-0 Request processed in 63us (109us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851859.074978:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17875@kfi7, seq: 2289794
00000100:00000040:13.0:1773851859.074979:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000021a0de50 : new rpc_count 0
00000100:00000001:13.0:1773851859.074980:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851859.074981:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851859.074981:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:14.0:1773851859.074982:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000319 TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851859.074982:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007edbe72e.
00000020:00000010:13.0:1773851859.074983:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b7d5d081.
00000020:00000040:13.0:1773851859.074984:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000021a0de50 : new refcount 4
00000400:00000200:14.0:1773851859.074985:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851859.074985:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851859.074987:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17875@kfi7: PUT: OK
00000400:00000200:14.0:1773851859.074988:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000734400bf
00000400:00000010:14.0:1773851859.074989:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000734400bf.
00000100:00000001:14.0:1773851859.074990:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851859.074991:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851859.074992:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000009818f1f nid 17875@kfi7 refs 2
00000800:00000200:14.0:1773851859.074995:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 17875@kfi7(0000000091e6068e):0x0 lsk 794 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000319 Transaction freed
00010000:00000001:2.0:1773851859.081736:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081737:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081744:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851859.081745:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851859.081746:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081747:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851859.081747:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081748:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081749:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081750:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081751:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851859.081751:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851859.081752:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081753:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851859.081754:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081754:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081755:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081756:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081758:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851859.081758:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851859.081759:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081760:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851859.081760:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081761:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081762:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851859.081763:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851859.081764:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851859.081769:0:937841:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:31.0:1773851859.081770:0:937841:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:31.0:1773851859.081771:0:937841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:1.0:1773851859.118940:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851859.118941:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851859.118942:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851859.118944:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851859.118947:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11282@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.118948:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11282@kfi7 : PUT - for me
00000400:00000200:1.0:1773851859.118949:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11282@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.118951:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 1
00000400:00000200:1.0:1773851859.118951:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11282@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.118952:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 2
00000400:00000200:1.0:1773851859.118953:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 3
00000400:00000200:1.0:1773851859.118954:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11474@kfi7 to cpt 3
00000400:00000200:1.0:1773851859.118954:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11474@kfi7 of length 224 into portal 12 MB=0x69b43e5bc8fc0
00000400:00000200:1.0:1773851859.118956:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11474@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 18048
00000800:00000200:1.0:1773851859.118957:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851859.118959:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.118960:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11282@kfi7: PUT: OK
00000100:00000001:1.0:1773851859.118961:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851859.118961:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851859.118962:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005f04967a.
00000100:00000040:1.0:1773851859.118963:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000005f04967a x1859565779718080 msgsize 224
00000100:00100000:1.0:1773851859.118964:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11474@kfi7 (source: 12345-11282@kfi7)
00000100:00000001:1.0:1773851859.118965:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851859.118966:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 2
00000100:00000001:0.0:1773851859.118967:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851859.118967:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851859.118968:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851859.118968:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851859.118968:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851859.118969:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851859.118970:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859565779718080
00000020:00000001:0.0:1773851859.118970:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851859.118971:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07d911dc1db
00000020:00000001:0.0:1773851859.118971:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851859.118974:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047eac1cb refcount=5
00000020:00000001:0.0:1773851859.118974:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072946155520 : -107000763396096 : ffff9eaef181d000)
00000020:00000001:0.0:1773851859.118975:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072946155520 : -107000763396096 : ffff9eaef181d000)
00000100:00000001:0.0:1773851859.118976:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.118977:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851859.118978:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001e6315df.
00000020:00000010:0.0:1773851859.118979:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.118980:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851859.118981:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851859.118981:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851859.118981:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.118982:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851859.118983:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851859.118983:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.118984:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.118985:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851859.118986:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851859.118986:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851859.118986:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851859.118987:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11474@kfi7, seq: 1997513
00000100:00000001:1.0:1773851859.118988:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.118988:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.118988:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047eac1cb : new rpc_count 1
00000100:00000001:0.0:1773851859.118988:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605650048 : -106923103901568 : ffff9ec1065fa880)
00000100:00000040:0.0:1773851859.118990:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005f04967a x1859565779718080/t0(0) o400->4586f6b3-4fcc-4378-98a5-8a9e56279576@11474@kfi7:499/0 lens 224/0 e 0 to 0 dl 1773852614 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1205-0'
00000100:00000001:0.0:1773851859.118992:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.118993:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851859.118994:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f04967a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4586f6b3-4fcc-4378-98a5-8a9e56279576+5:39720:x1859565779718080:12345-11474@kfi7:400:default-tuolumne1205-0
00000100:00000200:0.0:1773851859.118996:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859565779718080
00000020:00000001:0.0:1773851859.118997:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851859.118997:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851859.118998:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.118999:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851859.118999:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851859.119000:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851859.119001:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859565779718080, found 0 last_xid 1859565779718079
00000020:00000001:0.0:1773851859.119001:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851859.119002:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851859.119002:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851859.119003:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.119004:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851859.119004:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851859.119005:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851859.119007:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002215396f.
02000000:00000001:0.0:1773851859.119008:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.119008:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.119009:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851859.119009:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035387788, transno 0, xid 1859565779718080
00010000:00000001:0.0:1773851859.119010:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851859.119011:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005f04967a x1859565779718080/t0(0) o400->4586f6b3-4fcc-4378-98a5-8a9e56279576@11474@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1205-0'
00010000:00000001:0.0:1773851859.119013:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851859.119013:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851859.119014:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=92 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851859.119015:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851859.119016:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0289591 refcount 3 to 11474@kfi7
00000100:00000001:0.0:1773851859.119017:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621792 : -107151221929824 : ffff9e8be97ac8a0)
02000000:00000001:0.0:1773851859.119017:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851859.119018:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.119021:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851859.119021:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11282@kfi7
00000400:00000010:0.0:1773851859.119022:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e89b889f.
00000100:00000200:0.0:1773851859.119023:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859565779718080, offset 224
00000400:00000200:0.0:1773851859.119024:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11282@kfi7
00000400:00000200:0.0:1773851859.119025:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11282@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.119026:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 1
00000400:00000200:0.0:1773851859.119027:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 2
00000400:00000200:0.0:1773851859.119028:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 3
00000400:00000200:0.0:1773851859.119029:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11282@kfi7 local destination
00000400:00000200:0.0:1773851859.119030:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768821:8768821:1024:4294967295] 11282@kfi7 LPNI seq info [6313328:6313328:16:4294967295]
00000400:00000200:0.0:1773851859.119032:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 2
00000400:00000200:0.0:1773851859.119032:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11282@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.119034:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11282@kfi7(11282@kfi7:11282@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851859.119035:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 3
00000800:00000200:0.0:1773851859.119036:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851859.119037:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851859.119040:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851859.119042:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x670 Using peer 11282@kfi7(0x670)
00000800:00000200:0.0:1773851859.119044:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x670: rc=0
00000800:00000200:0.0:1773851859.119046:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x670 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851859.119048:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.119049:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0289591 refcount 2 to 11474@kfi7
00010000:00000001:0.0:1773851859.119049:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851859.119050:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.119050:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851859.119051:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005f04967a x1859565779718080/t0(0) o400->4586f6b3-4fcc-4378-98a5-8a9e56279576@11474@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1205-0'
00000100:00100000:0.0:1773851859.119056:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f04967a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4586f6b3-4fcc-4378-98a5-8a9e56279576+5:39720:x1859565779718080:12345-11474@kfi7:400:default-tuolumne1205-0 Request processed in 63us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851859.119058:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11474@kfi7, seq: 1997513
00000100:00000040:0.0:1773851859.119059:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047eac1cb : new rpc_count 0
00000100:00000001:0.0:1773851859.119059:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851859.119060:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851859.119061:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.119061:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851859.119062:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001e6315df.
00000020:00000040:0.0:1773851859.119063:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000047eac1cb : new refcount 4
00000100:00000001:0.0:1773851859.119064:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851859.119068:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x670 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851859.119070:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.119071:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11282@kfi7: PUT: OK
00000400:00000200:1.0:1773851859.119072:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e89b889f
00000400:00000010:1.0:1773851859.119073:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e89b889f.
00000100:00000001:1.0:1773851859.119073:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851859.119074:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851859.119075:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000061b2b8e7 nid 11282@kfi7 refs 2
00000800:00000200:1.0:1773851859.119077:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 11282@kfi7(0000000034f8556a):0x0 lsk 1649 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x670 Transaction freed
00000800:00000200:1.0:1773851859.131934:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851859.131935:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851859.131936:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851859.131938:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851859.131940:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13138@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.131941:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13138@kfi7 : PUT - for me
00000400:00000200:1.0:1773851859.131942:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13138@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.131942:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 1
00000400:00000200:1.0:1773851859.131943:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13138@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.131944:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 2
00000400:00000200:1.0:1773851859.131944:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 3
00000400:00000200:1.0:1773851859.131945:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13202@kfi7 to cpt 3
00000400:00000200:1.0:1773851859.131946:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13202@kfi7 of length 224 into portal 12 MB=0x699e1395b9600
00000400:00000200:1.0:1773851859.131947:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13202@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 18272
00000800:00000200:1.0:1773851859.131948:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851859.131950:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.131951:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13138@kfi7: PUT: OK
00000100:00000001:1.0:1773851859.131951:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851859.131952:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851859.131952:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000069fe0cf5.
00000100:00000040:1.0:1773851859.131953:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000069fe0cf5 x1858042469258752 msgsize 224
00000100:00100000:1.0:1773851859.131954:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-13202@kfi7 (source: 12345-13138@kfi7)
00000100:00000001:1.0:1773851859.131955:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851859.131956:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 2
00000800:00000200:1.0:1773851859.131957:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851859.131957:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851859.131957:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851859.131957:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851859.131958:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851859.131958:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851859.131959:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042469258752
00000020:00000001:0.0:1773851859.131960:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851859.131960:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b21
00000020:00000001:0.0:1773851859.131960:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851859.131962:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005501ede9 refcount=6
00000020:00000001:0.0:1773851859.131962:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628014080 : -107123081537536 : ffff9e9276c71800)
00000020:00000001:0.0:1773851859.131963:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628014080 : -107123081537536 : ffff9e9276c71800)
00000100:00000001:0.0:1773851859.131964:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.131965:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851859.131966:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001e6315df.
00000020:00000010:0.0:1773851859.131966:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.131967:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851859.131968:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851859.131968:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851859.131968:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.131969:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851859.131970:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851859.131970:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.131971:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.131972:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.131972:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851859.131973:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851859.131973:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13202@kfi7, seq: 1997514
00000100:00000001:1.0:1773851859.131974:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851859.131974:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.131974:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.131974:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005501ede9 : new rpc_count 1
00000100:00000001:0.0:1773851859.131975:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605639680 : -106923103911936 : ffff9ec1065f8000)
00000100:00000040:0.0:1773851859.131976:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000069fe0cf5 x1858042469258752/t0(0) o400->7246f178-d601-4dd8-9ae2-a178943d5655@13202@kfi7:499/0 lens 224/0 e 0 to 0 dl 1773852614 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1318-0'
00000100:00000001:0.0:1773851859.131978:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.131979:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851859.131979:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000069fe0cf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7246f178-d601-4dd8-9ae2-a178943d5655+6:39660:x1858042469258752:12345-13202@kfi7:400:default-tuolumne1318-0
00000100:00000200:0.0:1773851859.131981:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042469258752
00000020:00000001:0.0:1773851859.131981:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851859.131982:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851859.131982:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.131983:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851859.131983:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851859.131984:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851859.131984:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042469258752, found 0 last_xid 1858042469258751
00000020:00000001:0.0:1773851859.131985:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851859.131985:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851859.131986:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851859.131986:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.131987:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851859.131987:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851859.131987:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851859.131988:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad8a9137.
02000000:00000001:0.0:1773851859.131989:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.131989:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.131990:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851859.131990:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182610091922, transno 0, xid 1858042469258752
00010000:00000001:0.0:1773851859.131991:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851859.131992:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000069fe0cf5 x1858042469258752/t0(0) o400->7246f178-d601-4dd8-9ae2-a178943d5655@13202@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1318-0'
00010000:00000001:0.0:1773851859.131994:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851859.131994:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851859.131995:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=92 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851859.131996:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851859.131996:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003019fb7e refcount 3 to 13202@kfi7
00000100:00000001:0.0:1773851859.131997:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521904992 : -107145187646624 : ffff9e8d5126a360)
02000000:00000001:0.0:1773851859.131998:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851859.131998:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.131998:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851859.131999:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13138@kfi7
00000400:00000010:0.0:1773851859.132000:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a92b0d66.
00000100:00000200:0.0:1773851859.132000:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042469258752, offset 224
00000400:00000200:0.0:1773851859.132001:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13138@kfi7
00000400:00000200:0.0:1773851859.132002:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13138@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.132003:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 1
00000400:00000200:0.0:1773851859.132003:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 2
00000400:00000200:0.0:1773851859.132005:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 3
00000400:00000200:0.0:1773851859.132005:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13138@kfi7 local destination
00000400:00000200:0.0:1773851859.132007:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768822:8768822:1024:4294967295] 13138@kfi7 LPNI seq info [862791:862791:16:4294967295]
00000400:00000200:0.0:1773851859.132008:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 2
00000400:00000200:0.0:1773851859.132008:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13138@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.132010:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13138@kfi7(13138@kfi7:13138@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851859.132011:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 3
00000800:00000200:0.0:1773851859.132013:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851859.132014:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851859.132016:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851859.132019:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb08 Using peer 13138@kfi7(0xb08)
00000800:00000200:0.0:1773851859.132021:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0xb08: rc=0
00000800:00000200:0.0:1773851859.132023:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb08 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851859.132024:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.132025:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003019fb7e refcount 2 to 13202@kfi7
00010000:00000001:0.0:1773851859.132025:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851859.132026:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.132026:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851859.132027:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000069fe0cf5 x1858042469258752/t0(0) o400->7246f178-d601-4dd8-9ae2-a178943d5655@13202@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1318-0'
00000100:00100000:0.0:1773851859.132029:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000069fe0cf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7246f178-d601-4dd8-9ae2-a178943d5655+6:39660:x1858042469258752:12345-13202@kfi7:400:default-tuolumne1318-0 Request processed in 50us (76us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851859.132033:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13202@kfi7, seq: 1997514
00000100:00000040:0.0:1773851859.132033:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005501ede9 : new rpc_count 0
00000100:00000001:0.0:1773851859.132034:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851859.132034:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851859.132035:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.132035:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851859.132036:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001e6315df.
00000020:00000040:0.0:1773851859.132037:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005501ede9 : new refcount 5
00000100:00000001:0.0:1773851859.132037:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851859.132042:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb08 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851859.132043:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.132044:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13138@kfi7: PUT: OK
00000400:00000200:1.0:1773851859.132045:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a92b0d66
00000400:00000010:1.0:1773851859.132045:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a92b0d66.
00000100:00000001:1.0:1773851859.132046:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851859.132046:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851859.132047:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003e1e8ed8 nid 13138@kfi7 refs 2
00000800:00000200:1.0:1773851859.132048:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13138@kfi7(00000000a8c0b6be):0x0 lsk 2825 rsk 76 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb08 Transaction freed
00000800:00000200:21.0:1773851859.140938:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851859.140939:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851859.140940:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851859.140940:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851859.140941:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851859.140942:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22562@kfi7(000000008fb021f8):0x123 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851859.140943:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851859.140943:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 Using peer 22562@kfi7(0x100000000000123)
00000400:00000200:21.0:1773851859.140945:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22562@kfi7 to cpt 5
00000800:00000200:22.0:1773851859.140947:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851859.140947:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000184df75a: Posted send of 38 bytes to peer 0x100000000000123: rc=0
00000800:00000200:21.0:1773851859.140949:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851859.140952:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22562@kfi7 to cpt 5
00000400:00000200:22.0:1773851859.140954:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22562@kfi7 : PUT - for me
00000400:00000200:22.0:1773851859.140955:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22562@kfi7 to cpt 5
00000400:00000200:22.0:1773851859.140957:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000117b4464 nid 22562@kfi7 refs 1
00000400:00000200:22.0:1773851859.140958:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22562@kfi7 to cpt 5
00000400:00000200:22.0:1773851859.140960:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000117b4464 nid 22562@kfi7 refs 2
00000800:00000200:21.0:1773851859.140960:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851859.140961:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000117b4464 nid 22562@kfi7 refs 3
00000800:00000200:21.0:1773851859.140962:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 Transaction freed
00000400:00000200:22.0:1773851859.140963:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22563@kfi7 to cpt 0
00000400:00000200:22.0:1773851859.140964:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22563@kfi7 of length 224 into portal 12 MB=0x699e14fa68240
00000400:00000200:22.0:1773851859.140967:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22563@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 28104
00000800:00000200:22.0:1773851859.140970:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851859.140973:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851859.140975:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22562@kfi7: PUT: OK
00000100:00000001:22.0:1773851859.140977:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851859.140977:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851859.140979:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000afec0aa7.
00000100:00000040:22.0:1773851859.140980:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000afec0aa7 x1858042843267648 msgsize 224
00000100:00100000:22.0:1773851859.140983:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-22563@kfi7 (source: 12345-22562@kfi7)
00000100:00000001:22.0:1773851859.140984:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851859.140986:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000117b4464 nid 22562@kfi7 refs 2
00000100:00000001:23.0:1773851859.140987:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851859.140988:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851859.140989:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851859.140989:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851859.140989:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851859.140991:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.140992:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042843267648
00000020:00000001:23.0:1773851859.140993:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.140993:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92665
00000020:00000001:23.0:1773851859.140994:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.140998:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a57c0e89 refcount=6
00000020:00000001:23.0:1773851859.140999:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631010304 : -107123078541312 : ffff9e9276f4d000)
00000020:00000001:23.0:1773851859.141000:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631010304 : -107123078541312 : ffff9e9276f4d000)
00000100:00000001:23.0:1773851859.141001:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.141003:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.141003:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c42e6026.
00000020:00000010:23.0:1773851859.141005:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.141006:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.141007:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.141008:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.141009:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.141010:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.141012:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.141013:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.141014:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.141016:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.141017:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851859.141017:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851859.141017:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851859.141018:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22563@kfi7, seq: 1997941
00000100:00000040:23.0:1773851859.141020:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a57c0e89 : new rpc_count 1
00000100:00000001:22.0:1773851859.141020:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.141021:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619638144 : -107003089913472 : ffff9eae66d5f980)
00000100:00000001:22.0:1773851859.141021:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.141022:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000afec0aa7 x1858042843267648/t0(0) o400->5c3e0b67-388d-47da-81d6-1e3509c061ba@22563@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1899-0'
00000100:00000001:23.0:1773851859.141027:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.141028:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.141029:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afec0aa7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:5c3e0b67-388d-47da-81d6-1e3509c061ba+6:39640:x1858042843267648:12345-22563@kfi7:400:default-tuolumne1899-0
00000100:00000200:23.0:1773851859.141031:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042843267648
00000020:00000001:23.0:1773851859.141032:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.141033:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.141034:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.141035:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.141036:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.141037:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.141038:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042843267648, found 0 last_xid 1858042843267647
00000020:00000001:23.0:1773851859.141039:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.141040:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.141041:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.141042:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.141043:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.141044:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.141045:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.141046:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003dc2dc4b.
02000000:00000001:23.0:1773851859.141047:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.141048:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.141049:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.141050:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692618, transno 0, xid 1858042843267648
00010000:00000001:23.0:1773851859.141052:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.141053:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000afec0aa7 x1858042843267648/t0(0) o400->5c3e0b67-388d-47da-81d6-1e3509c061ba@22563@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1899-0'
00010000:00000001:23.0:1773851859.141058:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.141058:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.141059:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.141061:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.141062:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005db4673a refcount 3 to 22563@kfi7
00000100:00000001:23.0:1773851859.141064:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005824 : -107146751545792 : ffff9e8cf3ef6e40)
02000000:00000001:23.0:1773851859.141065:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.141066:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.141067:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.141068:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22562@kfi7
00000400:00000010:23.0:1773851859.141069:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001f94b366.
00000100:00000200:23.0:1773851859.141070:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042843267648, offset 224
00000400:00000200:23.0:1773851859.141072:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22562@kfi7
00000400:00000200:23.0:1773851859.141074:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22562@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.141075:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000117b4464 nid 22562@kfi7 refs 1
00000400:00000200:23.0:1773851859.141077:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000117b4464 nid 22562@kfi7 refs 2
00000400:00000200:23.0:1773851859.141078:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000117b4464 nid 22562@kfi7 refs 3
00000400:00000200:23.0:1773851859.141080:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22562@kfi7 local destination
00000400:00000200:23.0:1773851859.141083:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768823:8768823:1024:4294967295] 22562@kfi7 LPNI seq info [6666440:6666440:16:4294967295]
00000400:00000200:23.0:1773851859.141085:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000117b4464 nid 22562@kfi7 refs 2
00000400:00000200:23.0:1773851859.141086:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22562@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.141090:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22562@kfi7(22562@kfi7:22562@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.141092:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000117b4464 nid 22562@kfi7 refs 3
00000800:00000200:23.0:1773851859.141094:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.141096:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.141100:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.141106:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 Using peer 22562@kfi7(0x100000000000123)
00000800:00000200:23.0:1773851859.141110:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x100000000000123: rc=0
00000800:00000200:23.0:1773851859.141113:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.141116:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.141118:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005db4673a refcount 2 to 22563@kfi7
00010000:00000001:23.0:1773851859.141119:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.141120:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.141121:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.141122:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000afec0aa7 x1858042843267648/t0(0) o400->5c3e0b67-388d-47da-81d6-1e3509c061ba@22563@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1899-0'
00000800:00000200:21.0:1773851859.141123:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851859.141124:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.141125:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22562@kfi7: PUT: OK
00000400:00000200:21.0:1773851859.141125:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001f94b366
00000400:00000010:21.0:1773851859.141126:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001f94b366.
00000100:00000001:21.0:1773851859.141126:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:23.0:1773851859.141127:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afec0aa7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:5c3e0b67-388d-47da-81d6-1e3509c061ba+6:39640:x1858042843267648:12345-22563@kfi7:400:default-tuolumne1899-0 Request processed in 99us (146us total) trans 0 rc 0/0
00000100:00000001:21.0:1773851859.141127:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851859.141128:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000117b4464 nid 22562@kfi7 refs 2
00000800:00000200:21.0:1773851859.141129:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 22562@kfi7(000000008fb021f8):0x0 lsk 292 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000123 Transaction freed
00000100:00100000:23.0:1773851859.141131:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22563@kfi7, seq: 1997941
00000100:00000040:23.0:1773851859.141132:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a57c0e89 : new rpc_count 0
00000100:00000001:23.0:1773851859.141133:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851859.141134:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851859.141135:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.141136:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851859.141138:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c42e6026.
00000020:00000040:23.0:1773851859.141139:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000a57c0e89 : new refcount 5
00000100:00000001:23.0:1773851859.141140:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:30.0:1773851859.168697:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851859.168699:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851859.168730:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851859.168730:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851859.168757:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851859.168757:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851859.168782:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851859.168783:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851859.168941:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000ce3b9347 (tot 253201027).
00000400:00000010:30.0:1773851859.168943:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000ce3b9347 (tot 253200771).
00000800:00000200:2.0:1773851859.187180:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851859.187181:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851859.187182:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851859.187184:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851859.187186:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15984@kfi7 to cpt 0
00000400:00000200:2.0:1773851859.187187:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15984@kfi7 : PUT - for me
00000400:00000200:2.0:1773851859.187187:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15984@kfi7 to cpt 0
00000400:00000200:2.0:1773851859.187189:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b4478d2 nid 15984@kfi7 refs 1
00000400:00000200:2.0:1773851859.187190:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15984@kfi7 to cpt 0
00000400:00000200:2.0:1773851859.187190:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b4478d2 nid 15984@kfi7 refs 2
00000400:00000200:2.0:1773851859.187191:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b4478d2 nid 15984@kfi7 refs 3
00000400:00000200:2.0:1773851859.187192:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000400:00000200:2.0:1773851859.187193:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16048@kfi7 of length 224 into portal 12 MB=0x69b4b67d98680
00000400:00000200:2.0:1773851859.187194:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16048@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 18496
00000800:00000200:2.0:1773851859.187196:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851859.187198:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851859.187199:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15984@kfi7: PUT: OK
00000100:00000001:2.0:1773851859.187199:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851859.187200:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851859.187201:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a0b72bf.
00000100:00000040:2.0:1773851859.187201:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000001a0b72bf x1859598027425408 msgsize 224
00000100:00100000:2.0:1773851859.187203:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-16048@kfi7 (source: 12345-15984@kfi7)
00000100:00000001:2.0:1773851859.187204:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851859.187205:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009b4478d2 nid 15984@kfi7 refs 2
00000800:00000200:2.0:1773851859.187206:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851859.187206:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851859.187206:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851859.187207:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851859.187207:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851859.187208:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851859.187208:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598027425408
00000020:00000001:0.0:1773851859.187209:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851859.187209:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8160c
00000020:00000001:0.0:1773851859.187210:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851859.187212:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b273a1db refcount=5
00000020:00000001:0.0:1773851859.187213:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119306433536 : -106954403118080 : ffff9eb9bccb8400)
00000020:00000001:0.0:1773851859.187214:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119306433536 : -106954403118080 : ffff9eb9bccb8400)
00000100:00000001:0.0:1773851859.187215:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.187216:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851859.187216:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000572c181b.
00000020:00000010:0.0:1773851859.187217:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.187218:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851859.187219:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851859.187219:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851859.187220:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.187221:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851859.187221:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851859.187222:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.187223:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851859.187224:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851859.187224:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851859.187224:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.187224:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851859.187225:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16048@kfi7, seq: 1997515
00000100:00000001:1.0:1773851859.187226:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.187226:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.187226:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b273a1db : new rpc_count 1
00000100:00000001:0.0:1773851859.187226:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706775296 : -106953002776320 : ffff9eba10430900)
00000100:00000040:0.0:1773851859.187227:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a0b72bf x1859598027425408/t0(0) o400->737cf554-1aa4-4cb0-ac32-575bd351219d@16048@kfi7:499/0 lens 224/0 e 0 to 0 dl 1773852614 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1486-0'
00000100:00000001:0.0:1773851859.187230:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.187230:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851859.187231:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a0b72bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:737cf554-1aa4-4cb0-ac32-575bd351219d+5:39524:x1859598027425408:12345-16048@kfi7:400:default-tuolumne1486-0
00000100:00000200:0.0:1773851859.187232:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598027425408
00000020:00000001:0.0:1773851859.187233:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851859.187233:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851859.187234:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.187235:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851859.187235:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851859.187236:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851859.187237:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598027425408, found 0 last_xid 1859598027425407
00000020:00000001:0.0:1773851859.187237:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851859.187238:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851859.187238:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851859.187239:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.187240:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851859.187240:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851859.187241:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851859.187241:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e6315df.
02000000:00000001:0.0:1773851859.187242:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.187242:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.187243:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851859.187244:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596422, transno 0, xid 1859598027425408
00010000:00000001:0.0:1773851859.187244:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851859.187245:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a0b72bf x1859598027425408/t0(0) o400->737cf554-1aa4-4cb0-ac32-575bd351219d@16048@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1486-0'
00010000:00000001:0.0:1773851859.187247:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851859.187248:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851859.187249:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=92 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851859.187250:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851859.187250:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000982743af refcount 3 to 16048@kfi7
00000100:00000001:0.0:1773851859.187251:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993664 : -107142345557952 : ffff9e8dfa8d7840)
02000000:00000001:0.0:1773851859.187252:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851859.187252:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.187253:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851859.187254:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15984@kfi7
00000400:00000010:0.0:1773851859.187254:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079ba0077.
00000100:00000200:0.0:1773851859.187255:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598027425408, offset 224
00000400:00000200:0.0:1773851859.187256:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15984@kfi7
00000400:00000200:0.0:1773851859.187257:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15984@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.187258:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b4478d2 nid 15984@kfi7 refs 1
00000400:00000200:0.0:1773851859.187258:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b4478d2 nid 15984@kfi7 refs 2
00000400:00000200:0.0:1773851859.187259:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b4478d2 nid 15984@kfi7 refs 3
00000400:00000200:0.0:1773851859.187261:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15984@kfi7 local destination
00000400:00000200:0.0:1773851859.187262:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768824:8768824:1024:4294967295] 15984@kfi7 LPNI seq info [3606859:3606859:16:4294967295]
00000400:00000200:0.0:1773851859.187263:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009b4478d2 nid 15984@kfi7 refs 2
00000400:00000200:0.0:1773851859.187264:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15984@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.187266:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15984@kfi7(15984@kfi7:15984@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851859.187267:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b4478d2 nid 15984@kfi7 refs 3
00000800:00000200:0.0:1773851859.187268:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851859.187269:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851859.187271:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851859.187273:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1221 Using peer 15984@kfi7(0x1221)
00000800:00000200:0.0:1773851859.187276:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x1221: rc=0
00000800:00000200:0.0:1773851859.187277:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1221 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851859.187279:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.187280:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000982743af refcount 2 to 16048@kfi7
00010000:00000001:0.0:1773851859.187281:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851859.187281:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.187282:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851859.187282:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a0b72bf x1859598027425408/t0(0) o400->737cf554-1aa4-4cb0-ac32-575bd351219d@16048@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1486-0'
00000100:00100000:0.0:1773851859.187287:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a0b72bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:737cf554-1aa4-4cb0-ac32-575bd351219d+5:39524:x1859598027425408:12345-16048@kfi7:400:default-tuolumne1486-0 Request processed in 56us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851859.187289:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16048@kfi7, seq: 1997515
00000100:00000040:0.0:1773851859.187289:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b273a1db : new rpc_count 0
00000100:00000001:0.0:1773851859.187290:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851859.187291:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851859.187292:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.187292:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851859.187293:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000572c181b.
00000020:00000040:0.0:1773851859.187294:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000b273a1db : new refcount 4
00000100:00000001:0.0:1773851859.187295:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851859.187300:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1221 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851859.187301:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.187302:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15984@kfi7: PUT: OK
00000400:00000200:1.0:1773851859.187303:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079ba0077
00000400:00000010:1.0:1773851859.187304:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079ba0077.
00000100:00000001:1.0:1773851859.187305:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851859.187306:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851859.187307:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009b4478d2 nid 15984@kfi7 refs 2
00000800:00000200:1.0:1773851859.187308:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15984@kfi7(00000000c08f300e):0x0 lsk 4642 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1221 Transaction freed
00000800:00000200:6.0:1773851859.207777:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.207777:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851859.207778:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.207778:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851859.207779:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.207779:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851859.207781:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851859.207781:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 24129@kfi7(000000007ba0fb4e):0x1125 version: 2; local version 2; negotiated version: 2
00000400:00000200:6.0:1773851859.207783:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24129@kfi7 to cpt 1
00000800:00000200:5.0:1773851859.207783:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 Using peer 24129@kfi7(0x100000000001125)
00000400:00000200:6.0:1773851859.207785:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24129@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.207785:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24129@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.207786:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24129@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.207787:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000057dfb94b nid 24129@kfi7 refs 1
00000800:00000200:5.0:1773851859.207787:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 38 bytes to peer 0x100000000001125: rc=0
00000400:00000200:6.0:1773851859.207788:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24129@kfi7 to cpt 1
00000800:00000200:5.0:1773851859.207788:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851859.207789:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000057dfb94b nid 24129@kfi7 refs 2
00000400:00000200:6.0:1773851859.207789:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000057dfb94b nid 24129@kfi7 refs 3
00000400:00000200:6.0:1773851859.207790:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24128@kfi7 to cpt 6
00000400:00000200:6.0:1773851859.207791:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24128@kfi7 of length 456 into portal 12 MB=0x699e145b02880
00000400:00000200:6.0:1773851859.207793:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24128@kfi7 of length 456/456 into md 0x793926dc5 [64] + 122952
00000800:00000200:6.0:1773851859.207795:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851859.207796:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851859.207797:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24129@kfi7: PUT: OK
00000100:00000001:6.0:1773851859.207798:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851859.207799:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851859.207800:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004eca398b.
00000100:00000040:6.0:1773851859.207800:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000004eca398b x1858042676127872 msgsize 456
00000800:00000200:5.0:1773851859.207800:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851859.207802:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-24128@kfi7 (source: 12345-24129@kfi7)
00000100:00000001:6.0:1773851859.207803:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:5.0:1773851859.207803:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 Transaction freed
00000400:00000200:6.0:1773851859.207804:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000057dfb94b nid 24129@kfi7 refs 2
00000100:00000001:7.0:1773851859.207805:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.207805:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851859.207805:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851859.207806:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.207806:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.207807:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.207809:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042676127872
00000020:00000001:7.0:1773851859.207809:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.207810:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92cf5
00000020:00000001:7.0:1773851859.207810:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.207814:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004ea3057c refcount=25
00000020:00000001:7.0:1773851859.207814:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744182784 : -107128965368832 : ffff9e911812f400)
00000020:00000001:7.0:1773851859.207815:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744182784 : -107128965368832 : ffff9e911812f400)
00000100:00000001:7.0:1773851859.207816:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.207817:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.207817:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851859.207818:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.207819:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c7f00787.
00000100:00000001:7.0:1773851859.207820:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.207820:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851859.207821:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.207822:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.207823:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.207825:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.207825:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.207826:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24128@kfi7, seq: 371100838
00000100:00000001:6.0:1773851859.207826:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.207826:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851859.207827:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004ea3057c : new rpc_count 2
00000100:00000001:6.0:1773851859.207827:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.207828:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123260370048 : -106950449181568 : ffff9ebaa877cc80)
00000100:00000001:6.0:1773851859.207828:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.207829:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004eca398b x1858042676127872/t0(0) o17->dc18368a-698b-4893-ba34-a9c0cf7621ac@24128@kfi7:109/0 lens 456/0 e 0 to 0 dl 1773852224 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2004-0'
00000100:00000001:7.0:1773851859.207831:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.207832:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.207833:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004eca398b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:dc18368a-698b-4893-ba34-a9c0cf7621ac+25:39699:x1858042676127872:12345-24128@kfi7:17:default-tuolumne2004-0
00000100:00000200:7.0:1773851859.207834:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042676127872
00000020:00000001:7.0:1773851859.207835:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.207836:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.207837:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.207837:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.207838:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:7.0:1773851859.207839:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.207839:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042676127872, found 0 last_xid 1858042675624319
00000020:00000001:7.0:1773851859.207840:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.207841:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.207841:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.207842:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.207842:0:60963:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:7.0:1773851859.207844:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.207844:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.207845:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000f3f77d39.
02000000:00000001:7.0:1773851859.207845:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.207846:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.207847:0:60963:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:7.0:1773851859.207847:0:60963:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:7.0:1773851859.207848:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851859.207850:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.207851:0:60963:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:7.0:1773851859.207852:0:60963:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli dc18368a-698b-4893-ba34-a9c0cf7621ac/000000004ea3057c free: 126633370845184 avail: 126633368748032
00000020:00000001:7.0:1773851859.207853:0:60963:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:7.0:1773851859.207853:0:60963:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli dc18368a-698b-4893-ba34-a9c0cf7621ac/000000004ea3057c avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:7.0:1773851859.207855:0:60963:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:7.0:1773851859.207856:0:60963:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:7.0:1773851859.207857:0:60963:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli dc18368a-698b-4893-ba34-a9c0cf7621ac/000000004ea3057c reports grant 1048576 dropped 0, local 2097152
00000020:00000001:7.0:1773851859.207858:0:60963:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:7.0:1773851859.207858:0:60963:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:7.0:1773851859.207859:0:60963:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.207860:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264524668, transno 0, xid 1858042676127872
00010000:00000001:7.0:1773851859.207860:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.207861:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004eca398b x1858042676127872/t0(0) o17->dc18368a-698b-4893-ba34-a9c0cf7621ac@24128@kfi7:109/0 lens 456/432 e 0 to 0 dl 1773852224 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2004-0'
00010000:00000001:7.0:1773851859.207864:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.207864:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.207865:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.207866:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.207867:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000008b8fa1c refcount 3 to 24128@kfi7
00000100:00000001:7.0:1773851859.207868:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329280 : -107155410222336 : ffff9e8aefd68300)
02000000:00000001:7.0:1773851859.207869:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.207869:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.207870:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.207871:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24129@kfi7
00000400:00000010:7.0:1773851859.207871:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a1436362.
00000100:00000200:7.0:1773851859.207872:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858042676127872, offset 224
00000400:00000200:7.0:1773851859.207874:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24129@kfi7
00000400:00000200:7.0:1773851859.207875:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24129@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.207876:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000057dfb94b nid 24129@kfi7 refs 1
00000400:00000200:7.0:1773851859.207877:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000057dfb94b nid 24129@kfi7 refs 2
00000400:00000200:7.0:1773851859.207878:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000057dfb94b nid 24129@kfi7 refs 3
00000400:00000200:7.0:1773851859.207879:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24129@kfi7 local destination
00000400:00000200:7.0:1773851859.207880:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768825:8768825:1024:4294967295] 24129@kfi7 LPNI seq info [46850:46850:16:4294967295]
00000400:00000200:7.0:1773851859.207882:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000057dfb94b nid 24129@kfi7 refs 2
00000400:00000200:7.0:1773851859.207882:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24129@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.207884:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24129@kfi7(24129@kfi7:24129@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.207885:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000057dfb94b nid 24129@kfi7 refs 3
00000800:00000200:7.0:1773851859.207887:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.207888:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:7.0:1773851859.207890:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.207892:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 Using peer 24129@kfi7(0x100000000001125)
00000800:00000200:7.0:1773851859.207895:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 532 bytes to peer 0x100000000001125: rc=0
00000800:00000200:7.0:1773851859.207897:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.207901:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.207902:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000008b8fa1c refcount 2 to 24128@kfi7
00010000:00000001:7.0:1773851859.207903:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.207903:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.207904:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.207905:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004eca398b x1858042676127872/t0(0) o17->dc18368a-698b-4893-ba34-a9c0cf7621ac@24128@kfi7:109/0 lens 456/432 e 0 to 0 dl 1773852224 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2004-0'
00000100:00100000:7.0:1773851859.207908:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004eca398b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:dc18368a-698b-4893-ba34-a9c0cf7621ac+25:39699:x1858042676127872:12345-24128@kfi7:17:default-tuolumne2004-0 Request processed in 75us (106us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851859.207908:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851859.207910:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851859.207911:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24128@kfi7, seq: 371100838
00000100:00000040:7.0:1773851859.207911:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004ea3057c : new rpc_count 1
00000400:00000200:5.0:1773851859.207911:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24129@kfi7: PUT: OK
00000100:00000001:7.0:1773851859.207912:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851859.207912:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a1436362
00000100:00000001:7.0:1773851859.207913:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.207913:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000010:5.0:1773851859.207913:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a1436362.
00000100:00000001:5.0:1773851859.207913:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851859.207914:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c7f00787.
00000100:00000001:5.0:1773851859.207914:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851859.207915:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000400:00000200:5.0:1773851859.207915:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000057dfb94b nid 24129@kfi7 refs 2
00000020:00000040:7.0:1773851859.207916:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000004ea3057c : new refcount 24
00000100:00000001:7.0:1773851859.207916:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851859.207916:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24129@kfi7(000000007ba0fb4e):0x0 lsk 4390 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001125 Transaction freed
00000800:00000200:29.0:1773851859.228848:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851859.228849:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851859.228850:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851859.228852:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851859.228854:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14321@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.228855:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14321@kfi7 : PUT - for me
00000400:00000200:29.0:1773851859.228856:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14321@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.228856:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c252d7f nid 14321@kfi7 refs 1
00000400:00000200:29.0:1773851859.228858:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14321@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.228859:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c252d7f nid 14321@kfi7 refs 2
00000400:00000200:29.0:1773851859.228860:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000c252d7f nid 14321@kfi7 refs 3
00000400:00000200:29.0:1773851859.228861:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14321@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.228862:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14321@kfi7 of length 224 into portal 12 MB=0x699e0e0ee3600
00000400:00000200:29.0:1773851859.228863:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14321@kfi7 of length 224/224 into md 0x77fe139dd [64] + 166496
00000800:00000200:29.0:1773851859.228865:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851859.228867:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.228868:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14321@kfi7: PUT: OK
00000100:00000001:29.0:1773851859.228869:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851859.228869:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851859.228870:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f5c688d.
00000100:00000040:29.0:1773851859.228871:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000002f5c688d x1858040985695744 msgsize 224
00000100:00100000:29.0:1773851859.228872:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-14321@kfi7 (source: 12345-14321@kfi7)
00000100:00000001:29.0:1773851859.228873:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851859.228874:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000c252d7f nid 14321@kfi7 refs 2
00000800:00000200:29.0:1773851859.228875:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851859.228876:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851859.228877:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851859.228878:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851859.228878:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851859.228880:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851859.228881:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040985695744
00000020:00000001:31.0:1773851859.228882:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851859.228883:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ccc
00000020:00000001:31.0:1773851859.228884:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851859.228888:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f6f2ff37 refcount=169
00000020:00000001:31.0:1773851859.228890:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628275200 : -107123081276416 : ffff9e9276cb1400)
00000020:00000001:31.0:1773851859.228891:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628275200 : -107123081276416 : ffff9e9276cb1400)
00000100:00000001:31.0:1773851859.228892:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851859.228893:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851859.228894:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e268637b.
00000020:00000010:31.0:1773851859.228896:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851859.228897:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851859.228898:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851859.228899:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851859.228900:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.228901:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851859.228902:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851859.228903:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.228904:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.228906:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851859.228906:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851859.228906:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851859.228907:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851859.228907:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14321@kfi7, seq: 2055481
00000100:00000001:31.0:1773851859.228908:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851859.228908:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f6f2ff37 : new rpc_count 1
00000100:00000001:31.0:1773851859.228909:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.228909:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221522176 : -106948488029440 : ffff9ebb1d5c9b00)
00000100:00000040:28.0:1773851859.228910:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f5c688d x1858040985695744/t0(0) o400->a66bc9af-c54e-47cd-86b7-8af6542e7495@14321@kfi7:647/0 lens 224/0 e 0 to 0 dl 1773852007 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1373-0'
00000100:00000001:28.0:1773851859.228913:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851859.228915:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851859.228916:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f5c688d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:a66bc9af-c54e-47cd-86b7-8af6542e7495+169:39670:x1858040985695744:12345-14321@kfi7:400:default-tuolumne1373-0
00000100:00000200:28.0:1773851859.228917:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040985695744
00000020:00000001:28.0:1773851859.228918:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851859.228919:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851859.228920:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.228920:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851859.228921:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851859.228922:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851859.228922:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040985695744, found 0 last_xid 1858040985271423
00000020:00000001:28.0:1773851859.228923:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851859.228924:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851859.228924:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851859.228925:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.228926:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851859.228926:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851859.228927:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851859.228928:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f9c7c302.
02000000:00000001:28.0:1773851859.228928:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.228929:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.228930:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851859.228930:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062456, transno 0, xid 1858040985695744
00010000:00000001:28.0:1773851859.228931:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851859.228932:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f5c688d x1858040985695744/t0(0) o400->a66bc9af-c54e-47cd-86b7-8af6542e7495@14321@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1373-0'
00010000:00000001:28.0:1773851859.228935:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851859.228935:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851859.228936:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=92 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851859.228937:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851859.228938:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e5a9615d refcount 3 to 14321@kfi7
00000100:00000001:28.0:1773851859.228939:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091268704 : -107152618282912 : ffff9e8b96402060)
02000000:00000001:28.0:1773851859.228940:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851859.228940:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.228941:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851859.228942:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14321@kfi7
00000400:00000010:28.0:1773851859.228943:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081660f45.
00000100:00000200:28.0:1773851859.228944:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040985695744, offset 224
00000400:00000200:28.0:1773851859.228945:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14321@kfi7
00000400:00000200:28.0:1773851859.228946:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14321@kfi7 to cpt 7
00000400:00000200:28.0:1773851859.228947:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c252d7f nid 14321@kfi7 refs 1
00000400:00000200:28.0:1773851859.228948:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000c252d7f nid 14321@kfi7 refs 2
00000400:00000200:28.0:1773851859.228949:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000c252d7f nid 14321@kfi7 refs 3
00000400:00000200:28.0:1773851859.228950:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14321@kfi7 local destination
00000400:00000200:28.0:1773851859.228951:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768826:8768826:1024:4294967295] 14321@kfi7 LPNI seq info [10383096:10383096:16:4294967295]
00000400:00000200:28.0:1773851859.228953:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000c252d7f nid 14321@kfi7 refs 2
00000400:00000200:28.0:1773851859.228953:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14321@kfi7 to cpt 7
00000400:00000200:28.0:1773851859.228955:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14321@kfi7(14321@kfi7:14321@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851859.228956:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000c252d7f nid 14321@kfi7 refs 3
00000800:00000200:28.0:1773851859.228958:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851859.228959:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851859.228961:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851859.228963:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x760 Using peer 14321@kfi7(0x760)
00000800:00000200:28.0:1773851859.228967:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x760: rc=0
00000800:00000200:28.0:1773851859.228968:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x760 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851859.228970:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851859.228971:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e5a9615d refcount 2 to 14321@kfi7
00010000:00000001:28.0:1773851859.228972:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851859.228972:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.228973:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851859.228974:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f5c688d x1858040985695744/t0(0) o400->a66bc9af-c54e-47cd-86b7-8af6542e7495@14321@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1373-0'
00000100:00100000:28.0:1773851859.228978:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f5c688d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:a66bc9af-c54e-47cd-86b7-8af6542e7495+169:39670:x1858040985695744:12345-14321@kfi7:400:default-tuolumne1373-0 Request processed in 64us (106us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851859.228981:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14321@kfi7, seq: 2055481
00000100:00000040:28.0:1773851859.228981:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f6f2ff37 : new rpc_count 0
00000100:00000001:28.0:1773851859.228982:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851859.228983:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851859.228984:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:28.0:1773851859.228984:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:28.0:1773851859.228985:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e268637b.
00000020:00000040:28.0:1773851859.228986:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000f6f2ff37 : new refcount 168
00000100:00000001:28.0:1773851859.228987:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851859.228992:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x760 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851859.228993:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.228995:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14321@kfi7: PUT: OK
00000400:00000200:29.0:1773851859.228995:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081660f45
00000400:00000010:29.0:1773851859.228996:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081660f45.
00000100:00000001:29.0:1773851859.228996:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851859.228997:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851859.228998:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000c252d7f nid 14321@kfi7 refs 2
00000800:00000200:29.0:1773851859.228999:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 14321@kfi7(00000000b8b7fdc0):0x0 lsk 1889 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x760 Transaction freed
00000800:00000200:21.0:1773851859.229222:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851859.229223:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851859.229224:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851859.229226:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851859.229227:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.229228:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18978@kfi7 : PUT - for me
00000400:00000200:21.0:1773851859.229229:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.229230:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 1
00000400:00000200:21.0:1773851859.229231:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.229232:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000400:00000200:21.0:1773851859.229232:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 3
00000400:00000200:21.0:1773851859.229233:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.229234:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18978@kfi7 of length 224 into portal 12 MB=0x69b4b895ef440
00000400:00000200:21.0:1773851859.229235:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18978@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 28328
00000800:00000200:21.0:1773851859.229236:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851859.229240:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.229241:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18978@kfi7: PUT: OK
00000100:00000001:21.0:1773851859.229242:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851859.229242:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851859.229243:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a920fa0b.
00000100:00000040:21.0:1773851859.229244:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000a920fa0b x1859598589817920 msgsize 224
00000100:00100000:21.0:1773851859.229245:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18978@kfi7 (source: 12345-18978@kfi7)
00000100:00000001:21.0:1773851859.229247:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851859.229247:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000100:00000001:23.0:1773851859.229248:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851859.229249:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851859.229249:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851859.229249:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851859.229250:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851859.229250:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.229251:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598589817920
00000020:00000001:23.0:1773851859.229252:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.229252:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8bf78
00000020:00000001:23.0:1773851859.229253:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.229257:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008ebc8cd1 refcount=5
00000020:00000001:23.0:1773851859.229258:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063872027648 : -107009837523968 : ffff9eacd4a59c00)
00000020:00000001:23.0:1773851859.229258:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637063872027648 : -107009837523968 : ffff9eacd4a59c00)
00000100:00000001:23.0:1773851859.229259:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.229260:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.229261:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c42e6026.
00000020:00000010:23.0:1773851859.229262:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.229262:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.229263:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.229264:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.229264:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.229265:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.229265:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.229266:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.229267:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.229268:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.229268:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851859.229268:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851859.229268:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851859.229269:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18978@kfi7, seq: 1997942
00000100:00000040:23.0:1773851859.229270:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008ebc8cd1 : new rpc_count 1
00000100:00000001:23.0:1773851859.229270:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073065974528 : -107000643577088 : ffff9eaef8a61b00)
00000100:00000001:22.0:1773851859.229270:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.229271:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a920fa0b x1859598589817920/t0(0) o400->b14b54a5-4b35-442e-8f31-00b32ef73b8d@18978@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1675-0'
00000100:00000001:22.0:1773851859.229271:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.229274:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.229274:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.229275:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a920fa0b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b14b54a5-4b35-442e-8f31-00b32ef73b8d+5:39609:x1859598589817920:12345-18978@kfi7:400:default-tuolumne1675-0
00000100:00000200:23.0:1773851859.229276:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598589817920
00000020:00000001:23.0:1773851859.229277:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.229277:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.229278:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.229279:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.229279:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.229280:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.229281:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598589817920, found 0 last_xid 1859598589817919
00000020:00000001:23.0:1773851859.229282:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.229282:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.229283:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.229283:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.229284:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.229284:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.229285:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.229286:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000877aa26f.
02000000:00000001:23.0:1773851859.229286:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.229287:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.229287:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.229288:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096696348, transno 0, xid 1859598589817920
00010000:00000001:23.0:1773851859.229289:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.229289:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a920fa0b x1859598589817920/t0(0) o400->b14b54a5-4b35-442e-8f31-00b32ef73b8d@18978@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1675-0'
00010000:00000001:23.0:1773851859.229292:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.229292:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.229293:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.229294:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.229295:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000050541258 refcount 3 to 18978@kfi7
00000100:00000001:23.0:1773851859.229295:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095360 : -107139307456256 : ffff9e8eafa33900)
02000000:00000001:23.0:1773851859.229296:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.229297:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.229297:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.229298:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18978@kfi7
00000400:00000010:23.0:1773851859.229298:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037bf7dea.
00000100:00000200:23.0:1773851859.229299:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598589817920, offset 224
00000400:00000200:23.0:1773851859.229300:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18978@kfi7
00000400:00000200:23.0:1773851859.229301:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.229302:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 1
00000400:00000200:23.0:1773851859.229303:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000400:00000200:23.0:1773851859.229304:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 3
00000400:00000200:23.0:1773851859.229306:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18978@kfi7 local destination
00000400:00000200:23.0:1773851859.229307:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768827:8768827:1024:4294967295] 18978@kfi7 LPNI seq info [21953450:21953450:16:4294967295]
00000400:00000200:23.0:1773851859.229308:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000400:00000200:23.0:1773851859.229309:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.229311:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18978@kfi7(18978@kfi7:18978@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.229312:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 3
00000800:00000200:23.0:1773851859.229313:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.229314:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.229316:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.229318:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000f8 Using peer 18978@kfi7(0x1000000000000f8)
00000800:00000200:23.0:1773851859.229321:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x1000000000000f8: rc=0
00000800:00000200:23.0:1773851859.229322:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000f8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.229324:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.229325:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000050541258 refcount 2 to 18978@kfi7
00010000:00000001:23.0:1773851859.229326:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.229326:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.229327:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.229327:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a920fa0b x1859598589817920/t0(0) o400->b14b54a5-4b35-442e-8f31-00b32ef73b8d@18978@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1675-0'
00000100:00100000:23.0:1773851859.229330:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a920fa0b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b14b54a5-4b35-442e-8f31-00b32ef73b8d+5:39609:x1859598589817920:12345-18978@kfi7:400:default-tuolumne1675-0 Request processed in 55us (85us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851859.229332:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18978@kfi7, seq: 1997942
00000800:00000200:21.0:1773851859.229332:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000f8 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851859.229333:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008ebc8cd1 : new rpc_count 0
00000100:00000001:23.0:1773851859.229334:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851859.229334:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851859.229334:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851859.229335:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851859.229335:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18978@kfi7: PUT: OK
00000020:00000010:23.0:1773851859.229336:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851859.229336:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037bf7dea
00000400:00000010:21.0:1773851859.229336:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037bf7dea.
00000020:00000010:23.0:1773851859.229337:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c42e6026.
00000020:00000040:23.0:1773851859.229337:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000008ebc8cd1 : new refcount 4
00000100:00000001:21.0:1773851859.229337:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851859.229338:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851859.229338:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851859.229338:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000800:00000200:21.0:1773851859.229340:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 18978@kfi7(000000003018c31a):0x0 lsk 249 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000f8 Transaction freed
00000800:00000200:9.0:1773851859.257028:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.257029:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851859.257031:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851859.257035:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851859.257038:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22739@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.257040:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22739@kfi7 : PUT - for me
00000400:00000200:9.0:1773851859.257042:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22739@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.257044:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018be0559 nid 22739@kfi7 refs 1
00000400:00000200:9.0:1773851859.257046:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22739@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.257047:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018be0559 nid 22739@kfi7 refs 2
00000400:00000200:9.0:1773851859.257048:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018be0559 nid 22739@kfi7 refs 3
00000400:00000200:9.0:1773851859.257050:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22546@kfi7 to cpt 4
00000400:00000200:9.0:1773851859.257051:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22546@kfi7 of length 224 into portal 12 MB=0x69a7234c95d40
00000400:00000200:9.0:1773851859.257053:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22546@kfi7 of length 224/224 into md 0x78146ce49 [64] + 125680
00000800:00000200:9.0:1773851859.257056:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851859.257059:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.257061:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22739@kfi7: PUT: OK
00000100:00000001:9.0:1773851859.257063:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851859.257063:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851859.257065:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c460dfba.
00000100:00000040:9.0:1773851859.257066:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c460dfba x1858665162825024 msgsize 224
00000100:00100000:9.0:1773851859.257068:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22546@kfi7 (source: 12345-22739@kfi7)
00000100:00000001:9.0:1773851859.257070:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851859.257071:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018be0559 nid 22739@kfi7 refs 2
00000100:00000001:10.0:1773851859.257073:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851859.257074:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851859.257074:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851859.257074:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851859.257075:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851859.257077:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851859.257078:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858665162825024
00000020:00000001:10.0:1773851859.257079:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851859.257080:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914f3
00000020:00000001:10.0:1773851859.257081:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.257084:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e705b3d4 refcount=6
00000020:00000001:10.0:1773851859.257085:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240812544 : -107152468739072 : ffff9e8b9f29fc00)
00000020:00000001:10.0:1773851859.257087:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240812544 : -107152468739072 : ffff9e8b9f29fc00)
00000100:00000001:10.0:1773851859.257088:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.257089:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851859.257090:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057130d88.
00000020:00000010:10.0:1773851859.257092:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851859.257093:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851859.257095:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851859.257096:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851859.257097:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851859.257098:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851859.257099:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851859.257100:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.257101:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.257104:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.257104:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.257104:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851859.257105:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851859.257106:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22546@kfi7, seq: 2130741
00000100:00000001:11.0:1773851859.257108:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.257108:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e705b3d4 : new rpc_count 1
00000100:00000001:11.0:1773851859.257109:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.257110:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064859136 : -106983644692480 : ffff9eb2eddc8000)
00000100:00000040:10.0:1773851859.257112:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c460dfba x1858665162825024/t0(0) o400->f1989cba-0383-4a8b-bb3e-ffcf68e7daea@22546@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1909-0'
00000100:00000001:10.0:1773851859.257116:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.257117:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851859.257119:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c460dfba pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f1989cba-0383-4a8b-bb3e-ffcf68e7daea+6:39530:x1858665162825024:12345-22546@kfi7:400:default-tuolumne1909-0
00000100:00000200:10.0:1773851859.257121:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858665162825024
00000020:00000001:10.0:1773851859.257122:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851859.257123:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851859.257124:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.257125:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851859.257125:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851859.257127:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851859.257128:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858665162825024, found 0 last_xid 1858665162825023
00000020:00000001:10.0:1773851859.257129:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851859.257130:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851859.257131:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851859.257132:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.257133:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851859.257134:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851859.257134:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851859.257136:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f4df4be3.
02000000:00000001:10.0:1773851859.257137:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.257137:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.257139:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851859.257140:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183230182024, transno 0, xid 1858665162825024
00010000:00000001:10.0:1773851859.257141:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851859.257142:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c460dfba x1858665162825024/t0(0) o400->f1989cba-0383-4a8b-bb3e-ffcf68e7daea@22546@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1909-0'
00010000:00000001:10.0:1773851859.257146:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851859.257147:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851859.257148:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=92 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851859.257151:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851859.257153:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a07916cb refcount 3 to 22546@kfi7
00000100:00000001:10.0:1773851859.257154:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583548256 : -107156126003360 : ffff9e8ac52c8f60)
02000000:00000001:10.0:1773851859.257155:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851859.257156:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.257157:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851859.257159:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22739@kfi7
00000400:00000010:10.0:1773851859.257160:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000038836b39.
00000100:00000200:10.0:1773851859.257161:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858665162825024, offset 224
00000400:00000200:10.0:1773851859.257163:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22739@kfi7
00000400:00000200:10.0:1773851859.257165:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22739@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.257167:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018be0559 nid 22739@kfi7 refs 1
00000400:00000200:10.0:1773851859.257168:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018be0559 nid 22739@kfi7 refs 2
00000400:00000200:10.0:1773851859.257170:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018be0559 nid 22739@kfi7 refs 3
00000400:00000200:10.0:1773851859.257172:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22739@kfi7 local destination
00000400:00000200:10.0:1773851859.257174:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768828:8768828:1024:4294967295] 22739@kfi7 LPNI seq info [596154:596154:16:4294967295]
00000400:00000200:10.0:1773851859.257177:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018be0559 nid 22739@kfi7 refs 2
00000400:00000200:10.0:1773851859.257178:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22739@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.257181:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22739@kfi7(22739@kfi7:22739@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851859.257183:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018be0559 nid 22739@kfi7 refs 3
00000800:00000200:10.0:1773851859.257186:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851859.257188:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851859.257191:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851859.257195:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xadf Using peer 22739@kfi7(0xadf)
00000800:00000200:10.0:1773851859.257200:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000000600ceff: Posted send of 324 bytes to peer 0xadf: rc=0
00000800:00000200:10.0:1773851859.257202:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xadf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851859.257206:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.257208:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a07916cb refcount 2 to 22546@kfi7
00010000:00000001:10.0:1773851859.257209:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851859.257210:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.257211:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851859.257212:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c460dfba x1858665162825024/t0(0) o400->f1989cba-0383-4a8b-bb3e-ffcf68e7daea@22546@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1909-0'
00000800:00000200:9.0:1773851859.257215:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xadf TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851859.257217:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c460dfba pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f1989cba-0383-4a8b-bb3e-ffcf68e7daea+6:39530:x1858665162825024:12345-22546@kfi7:400:default-tuolumne1909-0 Request processed in 100us (150us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851859.257218:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.257220:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22739@kfi7: PUT: OK
00000100:00100000:10.0:1773851859.257221:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22546@kfi7, seq: 2130741
00000400:00000200:9.0:1773851859.257221:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000038836b39
00000100:00000040:10.0:1773851859.257222:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e705b3d4 : new rpc_count 0
00000400:00000010:9.0:1773851859.257222:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000038836b39.
00000100:00000001:10.0:1773851859.257223:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851859.257223:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851859.257224:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851859.257224:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:10.0:1773851859.257225:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000400:00000200:9.0:1773851859.257225:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018be0559 nid 22739@kfi7 refs 2
00000020:00000010:10.0:1773851859.257226:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:10.0:1773851859.257228:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057130d88.
00000800:00000200:9.0:1773851859.257228:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 22739@kfi7(000000005927e4f4):0x0 lsk 2784 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xadf Transaction freed
00000020:00000040:10.0:1773851859.257229:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000e705b3d4 : new refcount 5
00000100:00000001:10.0:1773851859.257230:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851859.273732:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851859.273732:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:4.0:1773851859.273732:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851859.273733:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851859.273733:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:5.0:1773851859.273733:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f8986c13.
00000020:00000040:5.0:1773851859.273733:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000004:00000020:4.0:1773851859.273733:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:4.0:1773851859.273733:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001dbca77d.
00000004:00000020:30.0:1773851859.273734:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851859.273734:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004d5a724c.
00000004:00000020:7.0:1773851859.273734:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:5.0:1773851859.273734:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:4.0:1773851859.273734:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000010:7.0:1773851859.273735:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001bbc782a.
02000000:00000001:5.0:1773851859.273735:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851859.273735:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851859.273735:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:30.0:1773851859.273736:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000020:00000040:7.0:1773851859.273736:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
02000000:00000001:5.0:1773851859.273736:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851859.273736:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.273737:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851859.273737:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:7.0:1773851859.273737:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:5.0:1773851859.273737:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000097fed2c.
02000000:00000010:4.0:1773851859.273737:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000869d922.
02000000:00000001:7.0:1773851859.273738:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:5.0:1773851859.273738:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273738:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851859.273739:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.273739:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851859.273739:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851859.273739:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:30.0:1773851859.273740:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ce3b9347.
02000000:00000010:7.0:1773851859.273740:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d46f64ea.
00000100:00000001:5.0:1773851859.273740:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273740:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273741:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851859.273741:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f8986c13] to pc [ptlrpcd_01_01+1]  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851859.273741:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001dbca77d] to pc [ptlrpcd_01_02+2]  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851859.273742:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273742:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851859.273742:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.273743:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851859.273743:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.273743:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001bbc782a] to pc [ptlrpcd_01_03+3]  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851859.273745:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004d5a724c] to pc [ptlrpcd_07_01+1]  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851859.273746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851859.273746:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851859.273746:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:7.0:1773851859.273747:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273747:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:5.0:1773851859.273747:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003440fa5d.
00000004:00000001:4.0:1773851859.273747:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851859.273748:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851859.273748:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637160257620992 : -106913451930624 : ffff9ec345ad0c00)
00000100:00000001:4.0:1773851859.273748:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851859.273748:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851859.273749:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851859.273749:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851859.273749:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851859.273749:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851859.273750:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851859.273750:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:7.0:1773851859.273750:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851859.273750:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851859.273751:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851859.273751:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:30.0:1773851859.273751:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e7dccfaa.
00080000:00000001:30.0:1773851859.273751:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637034939038720 : -107038770512896 : ffff9ea6181b3c00)
00000100:00000001:28.0:1773851859.273751:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851859.273751:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851859.273751:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851859.273751:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851859.273751:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851859.273752:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:28.0:1773851859.273752:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:6.0:1773851859.273752:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:5.0:1773851859.273752:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000100:00000001:4.0:1773851859.273752:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:28.0:1773851859.273753:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.273753:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851859.273753:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851859.273753:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:5.0:1773851859.273753:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000799183f8.
00000004:00080000:5.0:1773851859.273753:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614133727029032ns, next at 614134727028020ns, rc = 0
00000100:00000001:4.0:1773851859.273753:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851859.273753:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851859.273754:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851859.273754:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
02000000:00000001:7.0:1773851859.273754:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851859.273754:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851859.273754:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f8986c13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051925056:3@kfi7:13:default-yuba2-0
02000000:00000001:4.0:1773851859.273754:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851859.273754:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001dbca77d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051924992:2098@kfi7:41:default-yuba2-0
00000004:00000010:30.0:1773851859.273755:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008c8e7541.
00000100:00000001:28.0:1773851859.273755:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00100000:7.0:1773851859.273755:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bbc782a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051925120:7@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851859.273755:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:5.0:1773851859.273755:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:5.0:1773851859.273755:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273755:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00080000:30.0:1773851859.273756:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614133727031216ns, next at 614134727030324ns, rc = 0
00000100:00000001:28.0:1773851859.273756:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273756:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851859.273756:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851859.273756:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851859.273756:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851859.273756:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851859.273756:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:30.0:1773851859.273757:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:28.0:1773851859.273757:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851859.273757:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.273757:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:6.0:1773851859.273757:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:4.0:1773851859.273757:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851859.273757:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:30.0:1773851859.273758:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851859.273758:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851859.273758:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851859.273758:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000053a6c80b.
02000000:00000010:6.0:1773851859.273758:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ecbfdd48.
02000000:00000001:6.0:1773851859.273758:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851859.273758:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007e3989c4.
02000000:00000001:4.0:1773851859.273758:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851859.273759:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d5a724c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051925184:2080@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851859.273759:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851859.273759:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:5.0:1773851859.273759:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851859.273760:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851859.273760:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:6.0:1773851859.273760:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:5.0:1773851859.273760:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851859.273760:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:4.0:1773851859.273760:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
02000000:00000001:28.0:1773851859.273761:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851859.273761:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:7.0:1773851859.273761:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:7.0:1773851859.273761:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000400:00000010:6.0:1773851859.273761:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4270b1f.
00000400:00000010:4.0:1773851859.273761:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
02000000:00000010:28.0:1773851859.273762:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001529c0f6.
00000400:00000010:7.0:1773851859.273762:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012c6c860.
00000100:00000200:6.0:1773851859.273762:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925056, portal 4
00000100:00000200:4.0:1773851859.273762:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051924992, portal 4
02000000:00000001:28.0:1773851859.273763:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851859.273763:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925120, portal 4
00000100:00000001:7.0:1773851859.273763:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851859.273763:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851859.273763:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636984866961792 : -107088842589824 : ffff9e9a6f93f980)
00000100:00000001:4.0:1773851859.273763:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851859.273763:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528715648 : -106978180835968 : ffff9eb433885580)
00000400:00000200:28.0:1773851859.273764:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000010:28.0:1773851859.273764:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000100:00000001:7.0:1773851859.273764:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309145472 : -106994400406144 : ffff9eb06cc55580)
00000100:00000040:6.0:1773851859.273764:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851859.273764:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851859.273765:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c31df675.
00000100:00000040:7.0:1773851859.273765:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:28.0:1773851859.273767:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925184, portal 4
00000100:00000001:28.0:1773851859.273767:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851859.273767:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851859.273767:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:4.0:1773851859.273767:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851859.273768:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832800384 : -106933876751232 : ffff9ebe84430480)
00000100:00000040:7.0:1773851859.273768:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:7.0:1773851859.273768:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000084a606f7.
00000100:00000040:6.0:1773851859.273768:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000010:6.0:1773851859.273768:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007fdfc970.
00000100:00000040:4.0:1773851859.273768:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:4.0:1773851859.273768:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098ca3a41.
00000100:00000200:7.0:1773851859.273769:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051925120, offset 0
00000100:00000200:6.0:1773851859.273769:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925056, offset 0
00000100:00000200:4.0:1773851859.273769:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051924992, offset 0
00000100:00000040:28.0:1773851859.273770:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851859.273770:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000200:7.0:1773851859.273771:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:6.0:1773851859.273771:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:28.0:1773851859.273772:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:6.0:1773851859.273772:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:4.0:1773851859.273772:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000100:00000040:28.0:1773851859.273773:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000200:6.0:1773851859.273773:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000010:28.0:1773851859.273774:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b417b847.
00000400:00000200:6.0:1773851859.273774:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000200:28.0:1773851859.273775:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925184, offset 0
00000400:00000200:6.0:1773851859.273775:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000400:00000200:6.0:1773851859.273776:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768828, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768827, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851859.273777:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:28.0:1773851859.273778:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851859.273778:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851859.273779:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:6.0:1773851859.273779:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851859.273780:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:6.0:1773851859.273780:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000400:00000200:6.0:1773851859.273781:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768829:8768829:1024:4294967295] 3@kfi7 LPNI seq info [5406218:5406218:16:4294967295]
00000400:00000200:28.0:1773851859.273782:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:28.0:1773851859.273783:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:28.0:1773851859.273784:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768828, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768829, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851859.273784:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:6.0:1773851859.273784:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:7.0:1773851859.273785:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:28.0:1773851859.273786:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851859.273786:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:28.0:1773851859.273787:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851859.273787:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:28.0:1773851859.273788:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:7.0:1773851859.273788:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:7.0:1773851859.273789:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000400:00000200:28.0:1773851859.273790:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768830:8768830:1024:4294967295] 2080@kfi7 LPNI seq info [5404389:5404389:16:4294967295]
00000400:00000200:28.0:1773851859.273791:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:28.0:1773851859.273792:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851859.273793:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768830, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768829, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851859.273795:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851859.273796:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.273796:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851859.273796:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851859.273796:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.273797:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340055, 17340057]
00000400:00000200:6.0:1773851859.273797:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:28.0:1773851859.273798:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:28.0:1773851859.273799:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:7.0:1773851859.273799:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 8@kfi7
00000800:00000200:6.0:1773851859.273799:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:7.0:1773851859.273800:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768831:8768831:1023:4294967295] 8@kfi7 LPNI seq info [17340058:17340058:16:4294967295]
00000800:00000200:6.0:1773851859.273800:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851859.273801:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851859.273801:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:7.0:1773851859.273802:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000800:00000200:6.0:1773851859.273802:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851859.273803:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851859.273803:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:4.0:1773851859.273803:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:7.0:1773851859.273804:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 8@kfi7(7@kfi7:8@kfi7) <?> : PUT try# 0
00000800:00000200:6.0:1773851859.273804:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Using peer 3@kfi7(0x2000000000003b5)
00000400:00000200:4.0:1773851859.273804:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:7.0:1773851859.273805:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:28.0:1773851859.273806:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Using peer 2080@kfi7(0x64e)
00000400:00000200:4.0:1773851859.273806:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:4.0:1773851859.273806:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000800:00000200:7.0:1773851859.273807:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851859.273807:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 324 bytes to peer 0x2000000000003b5: rc=0
00000800:00000200:7.0:1773851859.273808:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851859.273808:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768830, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8768831, p:4294967295, g:4294967295, h:1000]
00000800:00000200:28.0:1773851859.273809:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x64e: rc=0
00000800:00000200:6.0:1773851859.273809:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851859.273809:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:7.0:1773851859.273810:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851859.273810:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000800:00000200:28.0:1773851859.273811:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851859.273811:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273811:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851859.273811:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:6.0:1773851859.273812:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851859.273812:0:41066:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346198, 20346197]
00000100:00000001:28.0:1773851859.273813:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851859.273813:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000100:00000001:6.0:1773851859.273813:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273813:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851859.273813:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000100:00000001:28.0:1773851859.273814:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851859.273814:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:4.0:1773851859.273814:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768832:8768832:1023:4294967295] 2105@kfi7 LPNI seq info [20346199:20346199:16:4294967295]
00000100:00000001:28.0:1773851859.273815:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851859.273815:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x200000000001191: rc=0
00000100:00000001:6.0:1773851859.273815:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:6.0:1773851859.273815:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:4.0:1773851859.273815:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000800:00000200:7.0:1773851859.273816:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851859.273816:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851859.273816:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273816:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851859.273816:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000001:28.0:1773851859.273817:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.273817:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.273818:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851859.273818:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.273819:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851859.273819:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851859.273819:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.273820:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851859.273820:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851859.273820:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851859.273820:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851859.273821:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851859.273821:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:7.0:1773851859.273822:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851859.273822:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851859.273823:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851859.273823:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851859.273824:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.273825:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273825:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.273826:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851859.273827:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851859.273827:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851859.273827:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_EVENT_TX_OK event status 0
00000800:00000200:4.0:1773851859.273827:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851859.273828:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851859.273829:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851859.273829:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.273829:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851859.273830:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000400:00000200:5.0:1773851859.273830:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000400:00000200:30.0:1773851859.273831:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:6.0:1773851859.273831:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000084a606f7
00000400:00000010:6.0:1773851859.273831:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000084a606f7.
00000800:00000200:4.0:1773851859.273831:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851859.273832:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b417b847
00000100:00000001:6.0:1773851859.273832:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:5.0:1773851859.273832:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007fdfc970
00000400:00000010:30.0:1773851859.273833:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b417b847.
00000100:00000001:30.0:1773851859.273833:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851859.273833:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:5.0:1773851859.273833:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007fdfc970.
00000800:00000200:4.0:1773851859.273833:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000100:00000001:5.0:1773851859.273834:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851859.273835:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851859.273835:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851859.273836:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851859.273836:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851859.273836:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x4c6: rc=0
00000100:00000001:30.0:1773851859.273837:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851859.273837:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:4.0:1773851859.273837:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:5.0:1773851859.273838:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851859.273839:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851859.273839:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273839:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851859.273839:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851859.273840:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00000001:5.0:1773851859.273840:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273840:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851859.273840:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.273841:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851859.273841:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000001191 Transaction freed
00000100:00000001:5.0:1773851859.273841:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851859.273841:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.273842:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.273842:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:4.0:1773851859.273842:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851859.273843:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:5.0:1773851859.273844:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Transaction freed
00000100:00000001:4.0:1773851859.273844:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:30.0:1773851859.273845:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Transaction freed
00000100:00000001:4.0:1773851859.273845:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851859.273845:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851859.273846:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851859.273849:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851859.273850:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851859.273850:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851859.273852:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851859.273853:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:6.0:1773851859.273853:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098ca3a41
00000400:00000010:6.0:1773851859.273854:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098ca3a41.
00000100:00000001:6.0:1773851859.273854:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851859.273855:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851859.273858:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851859.273858:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851859.273860:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.273861:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:6.0:1773851859.273861:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273861:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:9.0:1773851859.273862:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851859.273862:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:6.0:1773851859.273863:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Transaction freed
00000800:00000200:9.0:1773851859.273864:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851859.273866:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.273867:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2080@kfi7 : PUT - for me
00000800:00000200:25.0:1773851859.273868:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:9.0:1773851859.273868:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:25.0:1773851859.273869:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851859.273869:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:9.0:1773851859.273870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:25.0:1773851859.273871:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851859.273871:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:29.0:1773851859.273872:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:9.0:1773851859.273872:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:29.0:1773851859.273873:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851859.273873:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851859.273873:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.273874:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2ac0
00000800:00000200:29.0:1773851859.273875:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851859.273875:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:9.0:1773851859.273875:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:29.0:1773851859.273877:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851859.273877:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:9.0:1773851859.273877:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781697109 [1] + 224
00000400:00000200:25.0:1773851859.273878:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:29.0:1773851859.273879:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851859.273879:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000800:00000200:9.0:1773851859.273879:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851859.273880:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:25.0:1773851859.273880:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:29.0:1773851859.273881:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851859.273881:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:9.0:1773851859.273881:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.273882:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:25.0:1773851859.273882:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:29.0:1773851859.273884:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851859.273884:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:29.0:1773851859.273885:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:25.0:1773851859.273885:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2a80
00000400:00000200:9.0:1773851859.273885:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:29.0:1773851859.273886:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:26.0:1773851859.273886:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851859.273886:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851859.273886:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:9.0:1773851859.273886:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851859.273887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851859.273887:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f5a4d [1] + 224
00000100:00000200:9.0:1773851859.273887:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851859.273888:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2a40
00000800:00000200:26.0:1773851859.273888:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851859.273889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:25.0:1773851859.273890:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:9.0:1773851859.273890:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851859.273891:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78007fffd [1] + 224
00000800:00000200:26.0:1773851859.273891:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851859.273891:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851859.273892:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.273892:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000800:00000200:29.0:1773851859.273893:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851859.273893:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851859.273894:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851859.273894:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000100:00000001:9.0:1773851859.273894:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851859.273895:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000400:00000200:26.0:1773851859.273895:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000200:25.0:1773851859.273895:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851859.273895:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:29.0:1773851859.273896:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851859.273896:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851859.273896:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:26.0:1773851859.273896:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000800:00000200:9.0:1773851859.273896:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:28.0:1773851859.273897:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:26.0:1773851859.273897:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000200:29.0:1773851859.273898:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:28.0:1773851859.273898:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:26.0:1773851859.273898:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000040:25.0:1773851859.273898:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851859.273899:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000200:28.0:1773851859.273899:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c31df675
00000400:00000200:26.0:1773851859.273899:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000100:00000040:29.0:1773851859.273900:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851859.273900:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c31df675.
00000400:00000200:26.0:1773851859.273900:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:28.0:1773851859.273901:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:26.0:1773851859.273901:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2a00
00000100:00000200:28.0:1773851859.273902:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:26.0:1773851859.273902:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:25.0:1773851859.273902:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:26.0:1773851859.273903:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b30405 [1] + 224
00000400:00000200:25.0:1773851859.273903:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00000001:29.0:1773851859.273904:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851859.273904:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851859.273904:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851859.273905:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000200:28.0:1773851859.273905:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851859.273905:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000001:7.0:1773851859.273905:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:26.0:1773851859.273906:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:7.0:1773851859.273906:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:6.0:1773851859.273906:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851859.273906:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851859.273907:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851859.273907:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:7.0:1773851859.273907:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000400:00000200:7.0:1773851859.273907:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012c6c860
00000400:00000001:6.0:1773851859.273907:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:28.0:1773851859.273908:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.273908:0:41089:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:26.0:1773851859.273908:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:7.0:1773851859.273908:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012c6c860.
00000100:00000001:7.0:1773851859.273908:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:6.0:1773851859.273908:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:6.0:1773851859.273908:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
02000000:00000001:28.0:1773851859.273909:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851859.273909:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:26.0:1773851859.273909:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00000200:7.0:1773851859.273909:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851859.273909:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4270b1f
00000400:00000010:6.0:1773851859.273909:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4270b1f.
00000100:00000001:28.0:1773851859.273910:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851859.273910:0:2507427:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851859.273910:0:41065:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:28.0:1773851859.273911:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851859.273912:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=92 v=66 (66 66 66 66)
00000100:00000200:26.0:1773851859.273912:0:2507427:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851859.273912:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:6.0:1773851859.273912:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:28.0:1773851859.273913:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=92 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851859.273914:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851859.273914:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851859.273914:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:28.0:1773851859.273915:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:26.0:1773851859.273915:0:2507427:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.273915:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851859.273915:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:28.0:1773851859.273916:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273916:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851859.273916:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851859.273916:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851859.273916:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.273917:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851859.273917:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00000001:7.0:1773851859.273917:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851859.273917:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851859.273917:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851859.273918:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851859.273918:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273918:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.273918:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273918:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851859.273918:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851859.273919:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851859.273919:0:2507427:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:7.0:1773851859.273919:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=118 v=66 (66 66 66 66)
02000000:00000001:6.0:1773851859.273919:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851859.273919:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=92 v=66 (66 66 66 66)
00000400:00000200:26.0:1773851859.273920:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00001000:7.0:1773851859.273920:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=124 v=66 (1 1 1 1)
00000100:00001000:6.0:1773851859.273920:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=92 v=66 (1 1 1 1)
00000800:00000200:26.0:1773851859.273921:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851859.273921:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851859.273921:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851859.273921:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851859.273921:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851859.273922:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851859.273922:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.273922:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:6.0:1773851859.273922:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.273922:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000001:4.0:1773851859.273922:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851859.273922:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851859.273923:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851859.273923:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.273923:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.273923:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851859.273923:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000004:00000001:28.0:1773851859.273924:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:7.0:1773851859.273924:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851859.273924:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:6.0:1773851859.273924:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851859.273924:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000400:00000200:4.0:1773851859.273924:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851859.273924:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000004:00000040:28.0:1773851859.273925:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000004:00000040:28.0:1773851859.273925:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510704128 avail=351508036608 avail_mb=1373078268 hwm_mb=3131103 files=372095891 ffree=343272172 state=0: rc = 0
00000100:00000001:7.0:1773851859.273925:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851859.273925:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273925:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851859.273925:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273925:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:7.0:1773851859.273926:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:6.0:1773851859.273926:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:4.0:1773851859.273926:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:28.0:1773851859.273927:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510704128 free, 351508036608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095891 files, 343272172 free files
00000100:00000001:7.0:1773851859.273928:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851859.273928:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:28.0:1773851859.273929:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273929:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851859.273929:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000200:4.0:1773851859.273929:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851859.273930:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.273930:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851859.273930:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:6.0:1773851859.273930:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851859.273930:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:6.0:1773851859.273931:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000004:00000040:6.0:1773851859.273931:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353644032 avail=351351203840 avail_mb=1372465640 hwm_mb=3131101 files=372083368 ffree=343118793 state=0: rc = 0
00000004:00000020:7.0:1773851859.273932:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031808 blocks, 31536853568 free, 31536803328 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425469 files, 2779493197 free files
00000100:00100000:28.0:1773851859.273933:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d5a724c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051925184:2080@kfi7:13:default-yuba2-0
00000004:00000001:7.0:1773851859.273933:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:6.0:1773851859.273933:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353644032 free, 351351203840 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083368 files, 343118793 free files
00000100:00000040:7.0:1773851859.273934:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:6.0:1773851859.273934:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273934:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851859.273934:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.273935:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.273935:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851859.273935:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851859.273935:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851859.273935:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851859.273935:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:28.0:1773851859.273936:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004d5a724c x1859433051925184/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851859.273936:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.273937:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bbc782a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051925120:7@kfi7:41:default-yuba2-0
02000000:00000001:4.0:1773851859.273937:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851859.273937:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=92 v=66 (66 66 66 66)
00000100:00100000:6.0:1773851859.273938:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f8986c13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051925056:3@kfi7:13:default-yuba2-0
00000100:00001000:4.0:1773851859.273938:0:41066:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=92 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851859.273939:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851859.273939:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851859.273939:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.273939:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851859.273939:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851859.273939:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851859.273939:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851859.273940:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001529c0f6.
00000100:00000040:7.0:1773851859.273940:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001bbc782a x1859433051925120/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851859.273940:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851859.273940:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f8986c13 x1859433051925056/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:4.0:1773851859.273940:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851859.273940:0:41066:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851859.273941:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:4.0:1773851859.273941:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851859.273941:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000020:00000001:28.0:1773851859.273942:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851859.273942:0:41089:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000100:00000001:7.0:1773851859.273942:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:6.0:1773851859.273942:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:4.0:1773851859.273942:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851859.273942:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.273943:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:7.0:1773851859.273943:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851859.273943:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000053a6c80b.
02000000:00000001:6.0:1773851859.273943:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851859.273943:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ecbfdd48.
00000100:00000040:4.0:1773851859.273943:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:28.0:1773851859.273944:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ce3b9347.
02000000:00000001:28.0:1773851859.273945:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851859.273945:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:7.0:1773851859.273945:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851859.273945:0:41067:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:6.0:1773851859.273945:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851859.273945:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:4.0:1773851859.273945:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000010:28.0:1773851859.273946:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d5a724c.
00000020:00000040:7.0:1773851859.273946:0:41067:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000001:7.0:1773851859.273946:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000040:6.0:1773851859.273946:0:41065:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000020:00000001:6.0:1773851859.273946:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:4.0:1773851859.273946:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851859.273946:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.273947:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851859.273947:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:7.0:1773851859.273947:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d46f64ea.
02000000:00000010:6.0:1773851859.273947:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000097fed2c.
00000004:00000001:4.0:1773851859.273947:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851859.273948:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.273948:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:7.0:1773851859.273948:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851859.273948:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851859.273948:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001bbc782a.
02000000:00000001:6.0:1773851859.273948:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851859.273948:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851859.273948:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f8986c13.
00000004:00000020:4.0:1773851859.273948:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000064 blocks, 31354646912 free, 31354614144 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064197 files, 2870603660 free files
00000100:00000001:28.0:1773851859.273949:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273949:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851859.273949:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000001:4.0:1773851859.273949:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.273950:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851859.273950:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273950:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.273950:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851859.273950:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851859.273950:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851859.273950:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.273951:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851859.273951:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851859.273952:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.273952:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851859.273952:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273952:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:4.0:1773851859.273952:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001dbca77d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051924992:2098@kfi7:41:default-yuba2-0
00000100:00000001:7.0:1773851859.273953:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.273953:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273954:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851859.273954:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851859.273955:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001dbca77d x1859433051924992/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851859.273960:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851859.273960:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851859.273960:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007e3989c4.
02000000:00000001:4.0:1773851859.273961:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851859.273962:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851859.273962:0:41066:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000020:00000001:4.0:1773851859.273963:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851859.273963:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000869d922.
02000000:00000001:4.0:1773851859.273964:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851859.273964:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851859.273964:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001dbca77d.
00000100:00000001:4.0:1773851859.273965:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851859.273966:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851859.273966:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851859.273967:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851859.273967:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.273967:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851859.273968:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851859.305169:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851859.305171:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851859.305172:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851859.305174:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851859.305176:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15634@kfi7 to cpt 3
00000400:00000200:14.0:1773851859.305179:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15634@kfi7 : PUT - for me
00000400:00000200:14.0:1773851859.305179:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15634@kfi7 to cpt 3
00000400:00000200:14.0:1773851859.305180:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000142516c7 nid 15634@kfi7 refs 1
00000400:00000200:14.0:1773851859.305181:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15634@kfi7 to cpt 3
00000400:00000200:14.0:1773851859.305182:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000142516c7 nid 15634@kfi7 refs 2
00000400:00000200:14.0:1773851859.305183:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000142516c7 nid 15634@kfi7 refs 3
00000400:00000200:14.0:1773851859.305183:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15635@kfi7 to cpt 6
00000400:00000200:14.0:1773851859.305184:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15635@kfi7 of length 224 into portal 12 MB=0x69b4b5a35b700
00000400:00000200:14.0:1773851859.305186:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15635@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 19944
00000800:00000200:14.0:1773851859.305188:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851859.305189:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851859.305191:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15634@kfi7: PUT: OK
00000100:00000001:14.0:1773851859.305192:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851859.305192:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851859.305193:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003a61f78f.
00000100:00000040:14.0:1773851859.305194:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000003a61f78f x1859597798586112 msgsize 224
00000100:00100000:14.0:1773851859.305196:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-15635@kfi7 (source: 12345-15634@kfi7)
00000100:00000001:14.0:1773851859.305196:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851859.305197:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000142516c7 nid 15634@kfi7 refs 2
00000800:00000200:14.0:1773851859.305199:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851859.305199:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851859.305201:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851859.305202:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851859.305202:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851859.305204:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851859.305205:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597798586112
00000020:00000001:13.0:1773851859.305206:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851859.305207:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24551375
00000020:00000001:13.0:1773851859.305208:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851859.305211:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000085dd4b88 refcount=165
00000020:00000001:13.0:1773851859.305212:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637071490375680 : -107002219175936 : ffff9eae9abc6000)
00000020:00000001:13.0:1773851859.305213:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637071490375680 : -107002219175936 : ffff9eae9abc6000)
00000100:00000001:13.0:1773851859.305215:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851859.305216:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851859.305217:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a79b6cda.
00000020:00000010:13.0:1773851859.305219:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851859.305221:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000096d84104.
00000100:00000001:13.0:1773851859.305222:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851859.305223:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851859.305224:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851859.305226:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851859.305226:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851859.305227:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.305229:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.305230:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.305231:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851859.305231:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851859.305232:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15635@kfi7, seq: 2289795
00000100:00000001:13.0:1773851859.305232:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851859.305233:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000085dd4b88 : new rpc_count 1
00000100:00000001:15.0:1773851859.305233:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341815296 : -106946367736320 : ffff9ebb9bbdb600)
00000100:00000001:13.0:1773851859.305233:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.305234:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851859.305235:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003a61f78f x1859597798586112/t0(0) o400->0473ceb1-503d-4a9a-b5a0-7154fe6e70dd@15635@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1477-0'
00000100:00000001:15.0:1773851859.305241:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.305241:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851859.305242:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a61f78f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:0473ceb1-503d-4a9a-b5a0-7154fe6e70dd+165:39597:x1859597798586112:12345-15635@kfi7:400:default-tuolumne1477-0
00000100:00000200:15.0:1773851859.305243:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597798586112
00000020:00000001:15.0:1773851859.305244:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851859.305245:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851859.305245:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.305246:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851859.305247:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851859.305248:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851859.305248:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597798586112, found 0 last_xid 1859597798166463
00000020:00000001:15.0:1773851859.305249:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851859.305250:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851859.305250:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851859.305251:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.305251:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851859.305252:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851859.305252:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851859.305253:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7d5d081.
02000000:00000001:15.0:1773851859.305254:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.305254:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.305255:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851859.305256:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062966, transno 0, xid 1859597798586112
00010000:00000001:15.0:1773851859.305257:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851859.305257:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003a61f78f x1859597798586112/t0(0) o400->0473ceb1-503d-4a9a-b5a0-7154fe6e70dd@15635@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1477-0'
00010000:00000001:15.0:1773851859.305260:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851859.305260:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851859.305261:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=92 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851859.305263:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851859.305263:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005eb01e7d refcount 3 to 15635@kfi7
00000100:00000001:15.0:1773851859.305264:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740160 : -107139395811456 : ffff9e8eaa5f0780)
02000000:00000001:15.0:1773851859.305265:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851859.305266:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.305267:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851859.305267:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15634@kfi7
00000400:00000010:15.0:1773851859.305268:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000db5fd08.
00000100:00000200:15.0:1773851859.305269:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597798586112, offset 224
00000400:00000200:15.0:1773851859.305271:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15634@kfi7
00000400:00000200:15.0:1773851859.305272:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15634@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.305273:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000142516c7 nid 15634@kfi7 refs 1
00000400:00000200:15.0:1773851859.305274:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000142516c7 nid 15634@kfi7 refs 2
00000400:00000200:15.0:1773851859.305275:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000142516c7 nid 15634@kfi7 refs 3
00000400:00000200:15.0:1773851859.305276:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15634@kfi7 local destination
00000400:00000200:15.0:1773851859.305278:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768833:8768833:1024:4294967295] 15634@kfi7 LPNI seq info [127956:127956:16:4294967295]
00000400:00000200:15.0:1773851859.305279:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000142516c7 nid 15634@kfi7 refs 2
00000400:00000200:15.0:1773851859.305280:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15634@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.305282:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15634@kfi7(15634@kfi7:15634@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851859.305283:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000142516c7 nid 15634@kfi7 refs 3
00000800:00000200:15.0:1773851859.305285:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851859.305286:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851859.305288:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851859.305291:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2ee Using peer 15634@kfi7(0x2ee)
00000800:00000200:15.0:1773851859.305294:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x2ee: rc=0
00000800:00000200:15.0:1773851859.305295:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2ee TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851859.305297:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851859.305298:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005eb01e7d refcount 2 to 15635@kfi7
00010000:00000001:15.0:1773851859.305299:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851859.305300:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.305301:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851859.305301:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003a61f78f x1859597798586112/t0(0) o400->0473ceb1-503d-4a9a-b5a0-7154fe6e70dd@15635@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1477-0'
00000100:00100000:15.0:1773851859.305304:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a61f78f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:0473ceb1-503d-4a9a-b5a0-7154fe6e70dd+165:39597:x1859597798586112:12345-15635@kfi7:400:default-tuolumne1477-0 Request processed in 63us (110us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851859.305306:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15635@kfi7, seq: 2289795
00000100:00000040:15.0:1773851859.305307:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000085dd4b88 : new rpc_count 0
00000100:00000001:15.0:1773851859.305308:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:14.0:1773851859.305308:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2ee TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851859.305309:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851859.305309:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851859.305309:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851859.305310:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000096d84104.
00000400:00000200:14.0:1773851859.305310:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15634@kfi7: PUT: OK
00000020:00000010:15.0:1773851859.305311:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a79b6cda.
00000400:00000200:14.0:1773851859.305311:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000db5fd08
00000020:00000040:15.0:1773851859.305312:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000085dd4b88 : new refcount 164
00000100:00000001:15.0:1773851859.305312:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:14.0:1773851859.305312:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000db5fd08.
00000100:00000001:14.0:1773851859.305313:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851859.305313:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851859.305314:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000142516c7 nid 15634@kfi7 refs 2
00000800:00000200:14.0:1773851859.305315:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 15634@kfi7(000000008400e6e4):0x0 lsk 751 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2ee Transaction freed
00000800:00000200:29.0:1773851859.341188:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851859.341189:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851859.341190:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851859.341193:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851859.341195:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14384@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.341197:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14384@kfi7 : PUT - for me
00000400:00000200:29.0:1773851859.341197:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14384@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.341199:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ddf45470 nid 14384@kfi7 refs 1
00000400:00000200:29.0:1773851859.341200:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14384@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.341200:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ddf45470 nid 14384@kfi7 refs 2
00000400:00000200:29.0:1773851859.341201:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ddf45470 nid 14384@kfi7 refs 3
00000400:00000200:29.0:1773851859.341202:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14385@kfi7 to cpt 2
00000400:00000200:29.0:1773851859.341203:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14385@kfi7 of length 224 into portal 12 MB=0x699e204e973c0
00000400:00000200:29.0:1773851859.341204:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14385@kfi7 of length 224/224 into md 0x77fe139dd [64] + 166720
00000800:00000200:29.0:1773851859.341206:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851859.341207:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.341209:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14384@kfi7: PUT: OK
00000100:00000001:29.0:1773851859.341210:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851859.341210:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851859.341211:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000388449aa.
00000100:00000040:29.0:1773851859.341211:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000388449aa x1858045884330944 msgsize 224
00000100:00100000:29.0:1773851859.341213:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-14385@kfi7 (source: 12345-14384@kfi7)
00000100:00000001:29.0:1773851859.341214:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851859.341215:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ddf45470 nid 14384@kfi7 refs 2
00000800:00000200:29.0:1773851859.341216:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851859.341216:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851859.341216:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851859.341217:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851859.341217:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851859.341218:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851859.341219:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858045884330944
00000020:00000001:28.0:1773851859.341220:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851859.341220:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9240b
00000020:00000001:28.0:1773851859.341221:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851859.341224:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bb7f50df refcount=168
00000020:00000001:28.0:1773851859.341225:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630522880 : -107123079028736 : ffff9e9276ed6000)
00000020:00000001:28.0:1773851859.341225:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630522880 : -107123079028736 : ffff9e9276ed6000)
00000100:00000001:28.0:1773851859.341226:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851859.341227:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851859.341228:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cd411c23.
00000020:00000010:28.0:1773851859.341229:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851859.341230:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055ef51a7.
00000100:00000001:28.0:1773851859.341231:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851859.341232:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851859.341232:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.341233:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851859.341234:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851859.341234:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.341235:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.341237:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851859.341237:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851859.341237:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851859.341237:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851859.341238:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14385@kfi7, seq: 2055482
00000100:00000040:31.0:1773851859.341239:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bb7f50df : new rpc_count 1
00000100:00000001:28.0:1773851859.341239:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.341240:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221539456 : -106948488012160 : ffff9ebb1d5cde80)
00000100:00000001:28.0:1773851859.341240:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851859.341241:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000388449aa x1858045884330944/t0(0) o400->5aeca130-4025-47f5-86be-076502129638@14385@kfi7:647/0 lens 224/0 e 0 to 0 dl 1773852007 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1389-0'
00000100:00000001:31.0:1773851859.341244:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851859.341245:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851859.341246:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000388449aa pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5aeca130-4025-47f5-86be-076502129638+168:39735:x1858045884330944:12345-14385@kfi7:400:default-tuolumne1389-0
00000100:00000200:31.0:1773851859.341249:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858045884330944
00000020:00000001:31.0:1773851859.341250:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851859.341250:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851859.341251:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851859.341252:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851859.341252:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851859.341253:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851859.341254:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858045884330944, found 0 last_xid 1858045883905983
00000020:00000001:31.0:1773851859.341255:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851859.341255:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851859.341256:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851859.341256:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851859.341257:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851859.341257:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851859.341258:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851859.341259:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e268637b.
02000000:00000001:31.0:1773851859.341259:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.341260:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851859.341261:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851859.341261:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062288, transno 0, xid 1858045884330944
00010000:00000001:31.0:1773851859.341262:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851859.341263:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000388449aa x1858045884330944/t0(0) o400->5aeca130-4025-47f5-86be-076502129638@14385@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1389-0'
00010000:00000001:31.0:1773851859.341265:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851859.341266:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851859.341266:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=92 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851859.341267:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851859.341268:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fc88a8c0 refcount 3 to 14385@kfi7
00000100:00000001:31.0:1773851859.341269:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134656 : -107146658416960 : ffff9e8cf97c76c0)
02000000:00000001:31.0:1773851859.341270:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851859.341270:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.341271:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851859.341272:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14384@kfi7
00000400:00000010:31.0:1773851859.341273:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002000cf5e.
00000100:00000200:31.0:1773851859.341274:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858045884330944, offset 224
00000400:00000200:31.0:1773851859.341275:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14384@kfi7
00000400:00000200:31.0:1773851859.341276:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14384@kfi7 to cpt 7
00000400:00000200:31.0:1773851859.341277:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ddf45470 nid 14384@kfi7 refs 1
00000400:00000200:31.0:1773851859.341278:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ddf45470 nid 14384@kfi7 refs 2
00000400:00000200:31.0:1773851859.341279:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ddf45470 nid 14384@kfi7 refs 3
00000400:00000200:31.0:1773851859.341281:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14384@kfi7 local destination
00000400:00000200:31.0:1773851859.341282:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768834:8768834:1024:4294967295] 14384@kfi7 LPNI seq info [7573777:7573777:16:4294967295]
00000400:00000200:31.0:1773851859.341283:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ddf45470 nid 14384@kfi7 refs 2
00000400:00000200:31.0:1773851859.341284:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14384@kfi7 to cpt 7
00000400:00000200:31.0:1773851859.341286:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14384@kfi7(14384@kfi7:14384@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851859.341287:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ddf45470 nid 14384@kfi7 refs 3
00000800:00000200:31.0:1773851859.341288:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851859.341289:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851859.341291:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851859.341293:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ef Using peer 14384@kfi7(0x1000000000000ef)
00000800:00000200:31.0:1773851859.341296:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x1000000000000ef: rc=0
00000800:00000200:31.0:1773851859.341298:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ef TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851859.341300:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851859.341301:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fc88a8c0 refcount 2 to 14385@kfi7
00010000:00000001:31.0:1773851859.341301:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851859.341302:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851859.341302:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851859.341303:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000388449aa x1858045884330944/t0(0) o400->5aeca130-4025-47f5-86be-076502129638@14385@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1389-0'
00000100:00100000:31.0:1773851859.341306:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000388449aa pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5aeca130-4025-47f5-86be-076502129638+168:39735:x1858045884330944:12345-14385@kfi7:400:default-tuolumne1389-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851859.341308:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14385@kfi7, seq: 2055482
00000100:00000040:31.0:1773851859.341309:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bb7f50df : new rpc_count 0
00000100:00000001:31.0:1773851859.341310:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851859.341310:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851859.341310:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ef TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851859.341311:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851859.341312:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055ef51a7.
00000400:00000200:29.0:1773851859.341312:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851859.341313:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cd411c23.
00000400:00000200:29.0:1773851859.341313:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14384@kfi7: PUT: OK
00000020:00000040:31.0:1773851859.341314:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000bb7f50df : new refcount 167
00000400:00000200:29.0:1773851859.341314:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002000cf5e
00000400:00000010:29.0:1773851859.341314:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002000cf5e.
00000100:00000001:31.0:1773851859.341315:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851859.341315:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851859.341316:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851859.341317:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ddf45470 nid 14384@kfi7 refs 2
00000800:00000200:29.0:1773851859.341318:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 14384@kfi7(00000000635716df):0x0 lsk 240 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ef Transaction freed
00000800:00000200:21.0:1773851859.348259:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851859.348260:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851859.348261:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851859.348263:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851859.348264:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15729@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.348265:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15729@kfi7 : PUT - for me
00000400:00000200:21.0:1773851859.348266:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15729@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.348267:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080bebc64 nid 15729@kfi7 refs 1
00000400:00000200:21.0:1773851859.348268:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15729@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.348269:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080bebc64 nid 15729@kfi7 refs 2
00000400:00000200:21.0:1773851859.348270:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000080bebc64 nid 15729@kfi7 refs 3
00000400:00000200:21.0:1773851859.348271:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15729@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.348272:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15729@kfi7 of length 224 into portal 12 MB=0x69b4b5dc25e80
00000400:00000200:21.0:1773851859.348273:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15729@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 28552
00000800:00000200:21.0:1773851859.348275:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851859.348276:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.348277:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15729@kfi7: PUT: OK
00000100:00000001:21.0:1773851859.348278:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851859.348279:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851859.348280:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005954abd8.
00000100:00000040:21.0:1773851859.348280:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005954abd8 x1859597858135680 msgsize 224
00000100:00100000:21.0:1773851859.348282:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15729@kfi7 (source: 12345-15729@kfi7)
00000100:00000001:21.0:1773851859.348283:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851859.348283:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000080bebc64 nid 15729@kfi7 refs 2
00000100:00000001:23.0:1773851859.348284:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851859.348285:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851859.348285:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851859.348285:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851859.348286:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851859.348286:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.348287:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597858135680
00000020:00000001:23.0:1773851859.348288:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.348288:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fc51
00000020:00000001:23.0:1773851859.348289:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.348293:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009cbe2b15 refcount=168
00000020:00000001:23.0:1773851859.348293:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144960726016 : -106928748825600 : ffff9ebfb5e8f400)
00000020:00000001:23.0:1773851859.348294:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144960726016 : -106928748825600 : ffff9ebfb5e8f400)
00000100:00000001:23.0:1773851859.348295:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.348296:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.348296:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c42e6026.
00000020:00000010:23.0:1773851859.348297:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.348298:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.348299:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.348299:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.348300:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.348301:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.348301:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.348302:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.348302:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.348304:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.348304:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851859.348304:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851859.348305:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15729@kfi7, seq: 1997943
00000100:00000001:22.0:1773851859.348305:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851859.348306:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009cbe2b15 : new rpc_count 1
00000100:00000001:23.0:1773851859.348306:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073065969920 : -107000643581696 : ffff9eaef8a60900)
00000100:00000001:22.0:1773851859.348306:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851859.348306:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.348307:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005954abd8 x1859597858135680/t0(0) o400->4ba95859-4be6-4d15-98cb-e271c2b6a0dc@15729@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1470-0'
00000100:00000001:23.0:1773851859.348311:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.348311:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.348312:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005954abd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:4ba95859-4be6-4d15-98cb-e271c2b6a0dc+168:39647:x1859597858135680:12345-15729@kfi7:400:default-tuolumne1470-0
00000100:00000200:23.0:1773851859.348313:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597858135680
00000020:00000001:23.0:1773851859.348314:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.348314:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.348315:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.348316:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.348316:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.348317:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.348317:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597858135680, found 0 last_xid 1859597857711935
00000020:00000001:23.0:1773851859.348318:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.348319:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.348320:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.348320:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.348321:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.348321:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.348322:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.348323:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000170cfdb.
02000000:00000001:23.0:1773851859.348323:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.348324:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.348325:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.348325:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063340, transno 0, xid 1859597858135680
00010000:00000001:23.0:1773851859.348326:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.348327:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005954abd8 x1859597858135680/t0(0) o400->4ba95859-4be6-4d15-98cb-e271c2b6a0dc@15729@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1470-0'
00010000:00000001:23.0:1773851859.348329:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.348329:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.348330:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.348331:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.348332:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e1cfd0f7 refcount 3 to 15729@kfi7
00000100:00000001:23.0:1773851859.348332:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108800 : -107156354442816 : ffff9e8ab78ed9c0)
02000000:00000001:23.0:1773851859.348334:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.348334:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.348335:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.348335:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15729@kfi7
00000400:00000010:23.0:1773851859.348336:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036e7b619.
00000100:00000200:23.0:1773851859.348336:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597858135680, offset 224
00000400:00000200:23.0:1773851859.348338:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15729@kfi7
00000400:00000200:23.0:1773851859.348338:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15729@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.348339:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080bebc64 nid 15729@kfi7 refs 1
00000400:00000200:23.0:1773851859.348340:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000080bebc64 nid 15729@kfi7 refs 2
00000400:00000200:23.0:1773851859.348341:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000080bebc64 nid 15729@kfi7 refs 3
00000400:00000200:23.0:1773851859.348342:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15729@kfi7 local destination
00000400:00000200:23.0:1773851859.348343:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768835:8768835:1024:4294967295] 15729@kfi7 LPNI seq info [383786:383786:16:4294967295]
00000400:00000200:23.0:1773851859.348344:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000080bebc64 nid 15729@kfi7 refs 2
00000400:00000200:23.0:1773851859.348345:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15729@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.348347:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15729@kfi7(15729@kfi7:15729@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.348348:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000080bebc64 nid 15729@kfi7 refs 3
00000800:00000200:23.0:1773851859.348349:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.348350:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.348352:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.348355:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8a8 Using peer 15729@kfi7(0x8a8)
00000800:00000200:23.0:1773851859.348358:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x8a8: rc=0
00000800:00000200:23.0:1773851859.348359:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.348361:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.348362:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e1cfd0f7 refcount 2 to 15729@kfi7
00010000:00000001:23.0:1773851859.348363:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.348363:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.348366:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.348367:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005954abd8 x1859597858135680/t0(0) o400->4ba95859-4be6-4d15-98cb-e271c2b6a0dc@15729@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1470-0'
00000100:00100000:23.0:1773851859.348370:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005954abd8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:4ba95859-4be6-4d15-98cb-e271c2b6a0dc+168:39647:x1859597858135680:12345-15729@kfi7:400:default-tuolumne1470-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851859.348371:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8a8 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851859.348372:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15729@kfi7, seq: 1997943
00000100:00000040:23.0:1773851859.348372:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009cbe2b15 : new rpc_count 0
00000400:00000200:21.0:1773851859.348372:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851859.348373:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851859.348373:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15729@kfi7: PUT: OK
00000100:00000001:23.0:1773851859.348374:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851859.348374:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851859.348374:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036e7b619
00000020:00000010:23.0:1773851859.348375:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000010:21.0:1773851859.348375:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036e7b619.
00000100:00000001:21.0:1773851859.348375:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851859.348376:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c42e6026.
00000020:00000040:23.0:1773851859.348376:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000009cbe2b15 : new refcount 167
00000100:00000001:21.0:1773851859.348376:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851859.348377:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851859.348377:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000080bebc64 nid 15729@kfi7 refs 2
00000800:00000200:21.0:1773851859.348378:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 15729@kfi7(000000002ebf86f3):0x0 lsk 2217 rsk 35 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8a8 Transaction freed
00000800:00000200:5.0:1773851859.352314:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.352315:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.352317:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.352319:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.352320:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.352322:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12539@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.352323:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.352324:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 1
00000400:00000200:5.0:1773851859.352325:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.352325:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000400:00000200:5.0:1773851859.352326:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 3
00000400:00000200:5.0:1773851859.352327:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12538@kfi7 to cpt 6
00000400:00000200:5.0:1773851859.352328:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12538@kfi7 of length 224 into portal 12 MB=0x699de8e35bd00
00000400:00000200:5.0:1773851859.352329:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12538@kfi7 of length 224/224 into md 0x793926dc5 [64] + 123408
00000800:00000200:5.0:1773851859.352332:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.352334:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.352335:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12539@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.352336:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.352336:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.352337:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e2906173.
00000100:00000040:5.0:1773851859.352338:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e2906173 x1858031007939840 msgsize 224
00000100:00100000:5.0:1773851859.352339:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12538@kfi7 (source: 12345-12539@kfi7)
00000100:00000001:5.0:1773851859.352340:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851859.352341:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000100:00000001:7.0:1773851859.352342:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.352342:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851859.352342:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851859.352343:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.352343:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.352344:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.352345:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031007939840
00000020:00000001:7.0:1773851859.352345:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.352346:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91031
00000020:00000001:7.0:1773851859.352347:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.352349:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a6f19a5 refcount=6
00000020:00000001:7.0:1773851859.352349:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240121344 : -107152469430272 : ffff9e8b9f1f7000)
00000020:00000001:7.0:1773851859.352350:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240121344 : -107152469430272 : ffff9e8b9f1f7000)
00000100:00000001:7.0:1773851859.352351:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.352352:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.352352:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851859.352354:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.352354:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c7f00787.
00000100:00000001:7.0:1773851859.352355:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.352356:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851859.352356:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.352357:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851859.352358:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851859.352358:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352359:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.352360:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.352361:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.352361:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.352361:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.352362:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12538@kfi7, seq: 2001872
00000100:00000040:7.0:1773851859.352362:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a6f19a5 : new rpc_count 1
00000100:00000001:6.0:1773851859.352362:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352363:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866946816 : -107088842604800 : ffff9e9a6f93bf00)
00000100:00000001:6.0:1773851859.352363:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.352364:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e2906173 x1858031007939840/t0(0) o400->da423c99-adc9-4aa1-bdc0-f27626e4dd6a@12538@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne217-0'
00000100:00000001:7.0:1773851859.352367:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.352367:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.352368:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2906173 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:da423c99-adc9-4aa1-bdc0-f27626e4dd6a+6:47672:x1858031007939840:12345-12538@kfi7:400:default-tuolumne217-0
00000100:00000200:7.0:1773851859.352370:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031007939840
00000020:00000001:7.0:1773851859.352370:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.352371:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.352371:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352372:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.352373:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851859.352374:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.352374:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031007939840, found 0 last_xid 1858031007939839
00000020:00000001:7.0:1773851859.352375:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.352376:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.352376:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.352377:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352378:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851859.352378:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.352379:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.352379:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000636d72dc.
02000000:00000001:7.0:1773851859.352380:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352381:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352381:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.352382:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858031007939840
00010000:00000001:7.0:1773851859.352383:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.352383:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e2906173 x1858031007939840/t0(0) o400->da423c99-adc9-4aa1-bdc0-f27626e4dd6a@12538@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne217-0'
00010000:00000001:7.0:1773851859.352386:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.352386:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.352387:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.352388:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.352389:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000acab48fa refcount 5 to 12538@kfi7
00000100:00000001:7.0:1773851859.352390:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857824 : -107149578693792 : ffff9e8c4b6c9360)
02000000:00000001:7.0:1773851859.352391:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.352391:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352392:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.352393:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12539@kfi7
00000400:00000010:7.0:1773851859.352393:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012c6c860.
00000100:00000200:7.0:1773851859.352394:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031007939840, offset 224
00000400:00000200:7.0:1773851859.352395:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12539@kfi7
00000400:00000200:7.0:1773851859.352396:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.352397:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 1
00000400:00000200:7.0:1773851859.352398:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000400:00000200:7.0:1773851859.352399:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 3
00000400:00000200:7.0:1773851859.352400:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12539@kfi7 local destination
00000400:00000200:7.0:1773851859.352401:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768836:8768836:1024:4294967295] 12539@kfi7 LPNI seq info [24445:24445:16:4294967295]
00000400:00000200:7.0:1773851859.352403:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000400:00000200:7.0:1773851859.352404:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.352406:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12539@kfi7(12539@kfi7:12539@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.352407:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 3
00000800:00000200:7.0:1773851859.352408:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.352409:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851859.352411:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.352413:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000210 Using peer 12539@kfi7(0x100000000000210)
00000800:00000200:7.0:1773851859.352416:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x100000000000210: rc=0
00000800:00000200:7.0:1773851859.352418:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000210 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.352420:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.352420:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000acab48fa refcount 4 to 12538@kfi7
00010000:00000001:7.0:1773851859.352421:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.352422:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352422:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.352423:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e2906173 x1858031007939840/t0(0) o400->da423c99-adc9-4aa1-bdc0-f27626e4dd6a@12538@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne217-0'
00000100:00100000:7.0:1773851859.352426:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2906173 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:da423c99-adc9-4aa1-bdc0-f27626e4dd6a+6:47672:x1858031007939840:12345-12538@kfi7:400:default-tuolumne217-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851859.352428:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12538@kfi7, seq: 2001872
00000100:00000040:7.0:1773851859.352428:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a6f19a5 : new rpc_count 0
00000100:00000001:7.0:1773851859.352429:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851859.352430:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.352431:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000800:00000200:5.0:1773851859.352431:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000210 TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851859.352432:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c7f00787.
00000020:00000010:7.0:1773851859.352432:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000400:00000200:5.0:1773851859.352432:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851859.352433:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009a6f19a5 : new refcount 5
00000400:00000200:5.0:1773851859.352433:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12539@kfi7: PUT: OK
00000100:00000001:7.0:1773851859.352434:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851859.352434:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012c6c860
00000400:00000010:5.0:1773851859.352434:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012c6c860.
00000100:00000001:5.0:1773851859.352435:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851859.352435:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.352436:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000800:00000200:5.0:1773851859.352437:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 12539@kfi7(000000008a7557ba):0x0 lsk 529 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000210 Transaction freed
00000800:00000200:5.0:1773851859.352553:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.352553:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.352554:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.352556:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.352558:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.352559:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12539@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.352560:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.352561:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 1
00000400:00000200:5.0:1773851859.352561:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.352562:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000400:00000200:5.0:1773851859.352563:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 3
00000400:00000200:5.0:1773851859.352564:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12538@kfi7 to cpt 6
00000400:00000200:5.0:1773851859.352564:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12538@kfi7 of length 224 into portal 12 MB=0x699de8e35c4c0
00000400:00000200:5.0:1773851859.352565:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12538@kfi7 of length 224/224 into md 0x793926dc5 [64] + 123632
00000800:00000200:5.0:1773851859.352567:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.352568:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.352569:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12539@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.352570:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.352570:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.352571:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000001b1afa4.
00000100:00000040:5.0:1773851859.352572:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000001b1afa4 x1858031007941824 msgsize 224
00000100:00100000:5.0:1773851859.352573:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12538@kfi7 (source: 12345-12539@kfi7)
00000100:00000001:5.0:1773851859.352574:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851859.352574:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000100:00000001:7.0:1773851859.352575:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.352575:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851859.352576:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.352576:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851859.352576:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851859.352577:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.352577:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031007941824
00000020:00000001:7.0:1773851859.352578:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.352578:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91325
00000020:00000001:7.0:1773851859.352579:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.352580:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c5b6c1df refcount=6
00000020:00000001:7.0:1773851859.352581:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716196352 : -107155993355264 : ffff9e8acd149c00)
00000020:00000001:7.0:1773851859.352581:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716196352 : -107155993355264 : ffff9e8acd149c00)
00000100:00000001:7.0:1773851859.352582:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.352582:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.352583:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851859.352583:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.352584:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c7f00787.
00000100:00000001:7.0:1773851859.352585:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.352585:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851859.352585:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.352586:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851859.352586:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851859.352587:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352588:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.352588:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.352589:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.352589:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.352589:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.352590:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12538@kfi7, seq: 2001873
00000100:00000040:7.0:1773851859.352590:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c5b6c1df : new rpc_count 1
00000100:00000001:6.0:1773851859.352590:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352591:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866930688 : -107088842620928 : ffff9e9a6f938000)
00000100:00000001:6.0:1773851859.352591:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.352592:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000001b1afa4 x1858031007941824/t0(0) o400->f2ffb2c8-cfc0-4b5a-85b1-89a8242a6f95@12538@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne217-0'
00000100:00000001:7.0:1773851859.352594:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.352595:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.352595:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001b1afa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f2ffb2c8-cfc0-4b5a-85b1-89a8242a6f95+6:47671:x1858031007941824:12345-12538@kfi7:400:default-tuolumne217-0
00000100:00000200:7.0:1773851859.352597:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031007941824
00000020:00000001:7.0:1773851859.352597:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.352598:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.352598:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352599:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.352599:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851859.352600:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.352600:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031007941824, found 0 last_xid 1858031007941823
00000020:00000001:7.0:1773851859.352601:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.352601:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.352602:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.352602:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352603:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851859.352603:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.352604:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.352604:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bbf5571a.
02000000:00000001:7.0:1773851859.352605:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352605:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352606:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.352606:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768259, transno 0, xid 1858031007941824
00010000:00000001:7.0:1773851859.352607:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.352608:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000001b1afa4 x1858031007941824/t0(0) o400->f2ffb2c8-cfc0-4b5a-85b1-89a8242a6f95@12538@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne217-0'
00010000:00000001:7.0:1773851859.352610:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.352610:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.352611:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.352612:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.352612:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000acab48fa refcount 5 to 12538@kfi7
00000100:00000001:7.0:1773851859.352613:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857824 : -107149578693792 : ffff9e8c4b6c9360)
02000000:00000001:7.0:1773851859.352614:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.352615:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.352615:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.352616:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12539@kfi7
00000400:00000010:7.0:1773851859.352616:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e33961df.
00000100:00000200:7.0:1773851859.352617:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031007941824, offset 224
00000400:00000200:7.0:1773851859.352618:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12539@kfi7
00000400:00000200:7.0:1773851859.352619:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.352619:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 1
00000400:00000200:7.0:1773851859.352620:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000400:00000200:7.0:1773851859.352621:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 3
00000400:00000200:7.0:1773851859.352622:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12539@kfi7 local destination
00000400:00000200:7.0:1773851859.352623:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768837:8768837:1024:4294967295] 12539@kfi7 LPNI seq info [24446:24446:16:4294967295]
00000400:00000200:7.0:1773851859.352624:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000400:00000200:7.0:1773851859.352625:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12539@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.352626:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12539@kfi7(12539@kfi7:12539@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.352627:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 3
00000800:00000200:7.0:1773851859.352628:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.352629:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851859.352631:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.352633:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x981 Using peer 12539@kfi7(0x981)
00000800:00000200:7.0:1773851859.352635:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x981: rc=0
00000800:00000200:7.0:1773851859.352637:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x981 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.352638:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.352639:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000acab48fa refcount 4 to 12538@kfi7
00010000:00000001:7.0:1773851859.352639:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.352640:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.352641:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.352641:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000001b1afa4 x1858031007941824/t0(0) o400->f2ffb2c8-cfc0-4b5a-85b1-89a8242a6f95@12538@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne217-0'
00000100:00100000:7.0:1773851859.352644:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001b1afa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f2ffb2c8-cfc0-4b5a-85b1-89a8242a6f95+6:47671:x1858031007941824:12345-12538@kfi7:400:default-tuolumne217-0 Request processed in 49us (72us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851859.352646:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12538@kfi7, seq: 2001873
00000100:00000040:7.0:1773851859.352646:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c5b6c1df : new rpc_count 0
00000100:00000001:7.0:1773851859.352647:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851859.352647:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.352648:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.352648:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c7f00787.
00000800:00000200:5.0:1773851859.352648:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x981 TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851859.352649:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000400:00000200:5.0:1773851859.352649:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851859.352650:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000c5b6c1df : new refcount 5
00000100:00000001:7.0:1773851859.352650:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851859.352650:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12539@kfi7: PUT: OK
00000400:00000200:5.0:1773851859.352651:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e33961df
00000400:00000010:5.0:1773851859.352651:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e33961df.
00000100:00000001:5.0:1773851859.352652:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851859.352652:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.352653:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007452368 nid 12539@kfi7 refs 2
00000800:00000200:5.0:1773851859.352654:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12539@kfi7(000000007b635150):0x0 lsk 2434 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x981 Transaction freed
00000800:00000200:21.0:1773851859.370393:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851859.370394:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851859.370396:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851859.370398:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851859.370400:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15585@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.370402:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15585@kfi7 : PUT - for me
00000400:00000200:21.0:1773851859.370403:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15585@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.370403:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b61ebe8a nid 15585@kfi7 refs 1
00000400:00000200:21.0:1773851859.370404:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15585@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.370405:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b61ebe8a nid 15585@kfi7 refs 2
00000400:00000200:21.0:1773851859.370406:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b61ebe8a nid 15585@kfi7 refs 3
00000400:00000200:21.0:1773851859.370407:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15393@kfi7 to cpt 2
00000400:00000200:21.0:1773851859.370408:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15393@kfi7 of length 224 into portal 12 MB=0x699e0ba9c7480
00000400:00000200:21.0:1773851859.370409:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15393@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 28776
00000800:00000200:21.0:1773851859.370411:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851859.370412:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.370413:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15585@kfi7: PUT: OK
00000100:00000001:21.0:1773851859.370414:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851859.370415:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851859.370416:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000096de6856.
00000100:00000040:21.0:1773851859.370416:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000096de6856 x1858040342803584 msgsize 224
00000100:00100000:21.0:1773851859.370417:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15393@kfi7 (source: 12345-15585@kfi7)
00000100:00000001:21.0:1773851859.370418:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851859.370419:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b61ebe8a nid 15585@kfi7 refs 2
00000100:00000001:23.0:1773851859.370420:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851859.370420:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851859.370420:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851859.370421:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851859.370421:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851859.370422:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.370423:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040342803584
00000020:00000001:23.0:1773851859.370424:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.370424:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ee0
00000020:00000001:23.0:1773851859.370425:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.370429:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d455fb21 refcount=166
00000020:00000001:23.0:1773851859.370429:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628992000 : -107123080559616 : ffff9e9276d60400)
00000020:00000001:23.0:1773851859.370430:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628992000 : -107123080559616 : ffff9e9276d60400)
00000100:00000001:23.0:1773851859.370431:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.370432:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.370433:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c42e6026.
00000020:00000010:23.0:1773851859.370434:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.370434:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.370435:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.370436:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.370437:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.370438:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.370438:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.370438:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.370439:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.370440:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.370441:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851859.370441:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851859.370441:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851859.370442:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15393@kfi7, seq: 1997944
00000100:00000040:23.0:1773851859.370443:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d455fb21 : new rpc_count 1
00000100:00000001:23.0:1773851859.370443:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636945614619520 : -107128094932096 : ffff9e914bf4c380)
00000100:00000001:22.0:1773851859.370443:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851859.370443:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.370445:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000096de6856 x1858040342803584/t0(0) o400->1c46fc79-8484-4fc4-9a0c-97f7f862c38f@15393@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1455-0'
00000100:00000001:23.0:1773851859.370447:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.370448:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.370449:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000096de6856 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1c46fc79-8484-4fc4-9a0c-97f7f862c38f+166:39666:x1858040342803584:12345-15393@kfi7:400:default-tuolumne1455-0
00000100:00000200:23.0:1773851859.370450:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040342803584
00000020:00000001:23.0:1773851859.370451:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.370451:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.370452:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.370453:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.370453:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.370454:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.370454:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040342803584, found 0 last_xid 1858040342380671
00000020:00000001:23.0:1773851859.370455:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.370456:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.370456:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.370457:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.370458:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.370458:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.370459:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.370459:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e9fc685e.
02000000:00000001:23.0:1773851859.370460:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.370461:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.370462:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.370462:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062986, transno 0, xid 1858040342803584
00010000:00000001:23.0:1773851859.370463:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.370464:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000096de6856 x1858040342803584/t0(0) o400->1c46fc79-8484-4fc4-9a0c-97f7f862c38f@15393@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1455-0'
00010000:00000001:23.0:1773851859.370466:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.370467:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.370467:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.370468:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.370469:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000f7786b2 refcount 3 to 15393@kfi7
00000100:00000001:23.0:1773851859.370470:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551675360 : -107156157876256 : ffff9e8ac34637e0)
02000000:00000001:23.0:1773851859.370470:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.370471:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.370472:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.370473:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15585@kfi7
00000400:00000010:23.0:1773851859.370473:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c7cc6c.
00000100:00000200:23.0:1773851859.370474:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040342803584, offset 224
00000400:00000200:23.0:1773851859.370475:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15585@kfi7
00000400:00000200:23.0:1773851859.370476:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15585@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.370477:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b61ebe8a nid 15585@kfi7 refs 1
00000400:00000200:23.0:1773851859.370478:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b61ebe8a nid 15585@kfi7 refs 2
00000400:00000200:23.0:1773851859.370479:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b61ebe8a nid 15585@kfi7 refs 3
00000400:00000200:23.0:1773851859.370480:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15585@kfi7 local destination
00000400:00000200:23.0:1773851859.370481:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768838:8768838:1024:4294967295] 15585@kfi7 LPNI seq info [282649:282649:16:4294967295]
00000400:00000200:23.0:1773851859.370482:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b61ebe8a nid 15585@kfi7 refs 2
00000400:00000200:23.0:1773851859.370483:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15585@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.370485:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15585@kfi7(15585@kfi7:15585@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.370486:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b61ebe8a nid 15585@kfi7 refs 3
00000800:00000200:23.0:1773851859.370487:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.370488:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.370492:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.370494:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e4 Using peer 15585@kfi7(0x1e4)
00000800:00000200:23.0:1773851859.370497:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x1e4: rc=0
00000800:00000200:23.0:1773851859.370499:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.370501:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.370502:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000f7786b2 refcount 2 to 15393@kfi7
00010000:00000001:23.0:1773851859.370502:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.370503:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.370504:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.370504:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000096de6856 x1858040342803584/t0(0) o400->1c46fc79-8484-4fc4-9a0c-97f7f862c38f@15393@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1455-0'
00000100:00100000:23.0:1773851859.370508:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000096de6856 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1c46fc79-8484-4fc4-9a0c-97f7f862c38f+166:39666:x1858040342803584:12345-15393@kfi7:400:default-tuolumne1455-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851859.370510:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15393@kfi7, seq: 1997944
00000800:00000200:21.0:1773851859.370510:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e4 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851859.370511:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d455fb21 : new rpc_count 0
00000100:00000001:23.0:1773851859.370512:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851859.370512:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851859.370512:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851859.370513:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.370513:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851859.370513:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15585@kfi7: PUT: OK
00000400:00000200:21.0:1773851859.370513:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c7cc6c
00000020:00000010:23.0:1773851859.370514:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c42e6026.
00000400:00000010:21.0:1773851859.370514:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c7cc6c.
00000020:00000040:23.0:1773851859.370515:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000d455fb21 : new refcount 165
00000100:00000001:21.0:1773851859.370515:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851859.370515:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851859.370516:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851859.370516:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b61ebe8a nid 15585@kfi7 refs 2
00000800:00000200:21.0:1773851859.370518:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 15585@kfi7(000000006a7322be):0x0 lsk 485 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e4 Transaction freed
00000800:00000200:25.0:1773851859.388317:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851859.388318:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851859.388319:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851859.388322:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851859.388324:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.388325:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16080@kfi7 : PUT - for me
00000400:00000200:25.0:1773851859.388326:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.388326:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 1
00000400:00000200:25.0:1773851859.388327:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.388328:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000400:00000200:25.0:1773851859.388329:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 3
00000400:00000200:25.0:1773851859.388329:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15889@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.388330:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15889@kfi7 of length 224 into portal 12 MB=0x69b4c4b48f880
00000400:00000200:25.0:1773851859.388332:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15889@kfi7 of length 224/224 into md 0x16159c6179 [64] + 188824
00000800:00000200:25.0:1773851859.388333:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851859.388335:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851859.388336:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16080@kfi7: PUT: OK
00000100:00000001:25.0:1773851859.388336:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851859.388337:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851859.388338:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008d492367.
00000100:00000040:25.0:1773851859.388338:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000008d492367 x1859601843157120 msgsize 224
00000100:00100000:25.0:1773851859.388340:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-15889@kfi7 (source: 12345-16080@kfi7)
00000100:00000001:25.0:1773851859.388341:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851859.388342:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000100:00000001:24.0:1773851859.388342:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851859.388343:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851859.388343:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851859.388343:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851859.388344:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851859.388345:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851859.388346:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601843157120
00000020:00000001:24.0:1773851859.388346:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851859.388347:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e6260b754
00000020:00000001:24.0:1773851859.388347:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851859.388348:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bfe20125 refcount=5
00000020:00000001:24.0:1773851859.388349:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134943534080 : -106938766017536 : ffff9ebd60d6bc00)
00000020:00000001:24.0:1773851859.388350:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134943534080 : -106938766017536 : ffff9ebd60d6bc00)
00000100:00000001:24.0:1773851859.388351:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851859.388352:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851859.388353:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058df43f4.
00000020:00000010:24.0:1773851859.388354:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851859.388354:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003f93d35f.
00000100:00000001:24.0:1773851859.388355:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851859.388355:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851859.388357:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851859.388357:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851859.388358:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851859.388358:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851859.388359:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851859.388361:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851859.388361:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851859.388362:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851859.388362:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851859.388363:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15889@kfi7, seq: 2025066
00000100:00000040:25.0:1773851859.388363:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bfe20125 : new rpc_count 1
00000100:00000001:24.0:1773851859.388363:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851859.388364:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637054961770112 : -107018747781504 : ffff9eaac18dde80)
00000100:00000001:24.0:1773851859.388364:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851859.388365:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008d492367 x1859601843157120/t0(0) o400->7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4@15889@kfi7:76/0 lens 224/0 e 0 to 0 dl 1773852191 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1489-0'
00000100:00000001:25.0:1773851859.388368:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851859.388368:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851859.388369:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d492367 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4+5:39559:x1859601843157120:12345-15889@kfi7:400:default-tuolumne1489-0
00000100:00000200:25.0:1773851859.388371:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601843157120
00000020:00000001:25.0:1773851859.388371:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851859.388372:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851859.388373:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.388374:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851859.388374:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851859.388375:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851859.388376:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601843157120, found 0 last_xid 1859601843157119
00000020:00000001:25.0:1773851859.388376:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851859.388377:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851859.388378:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851859.388378:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.388379:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851859.388379:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851859.388380:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851859.388381:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002af434f6.
02000000:00000001:25.0:1773851859.388382:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851859.388382:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.388383:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851859.388384:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154616931, transno 0, xid 1859601843157120
00010000:00000001:25.0:1773851859.388385:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851859.388385:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008d492367 x1859601843157120/t0(0) o400->7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4@15889@kfi7:76/0 lens 224/224 e 0 to 0 dl 1773852191 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1489-0'
00010000:00000001:25.0:1773851859.388389:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851859.388389:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851859.388390:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=92 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851859.388391:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851859.388392:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f6fb1437 refcount 3 to 15889@kfi7
00000100:00000001:25.0:1773851859.388393:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860608 : -107149578691008 : ffff9e8c4b6c9e40)
02000000:00000001:25.0:1773851859.388393:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851859.388394:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851859.388395:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851859.388395:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16080@kfi7
00000400:00000010:25.0:1773851859.388396:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006793fb59.
00000100:00000200:25.0:1773851859.388397:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601843157120, offset 224
00000400:00000200:25.0:1773851859.388398:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16080@kfi7
00000400:00000200:25.0:1773851859.388399:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.388400:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 1
00000400:00000200:25.0:1773851859.388401:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000400:00000200:25.0:1773851859.388402:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 3
00000400:00000200:25.0:1773851859.388403:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16080@kfi7 local destination
00000400:00000200:25.0:1773851859.388404:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768839:8768839:1024:4294967295] 16080@kfi7 LPNI seq info [4009742:4009742:16:4294967295]
00000400:00000200:25.0:1773851859.388406:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000400:00000200:25.0:1773851859.388406:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.388408:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16080@kfi7(16080@kfi7:16080@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851859.388409:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 3
00000800:00000200:25.0:1773851859.388410:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851859.388411:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851859.388413:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851859.388416:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0xbe7 Using peer 16080@kfi7(0xbe7)
00000800:00000200:25.0:1773851859.388430:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000009b172e83: Posted send of 324 bytes to peer 0xbe7: rc=0
00000800:00000200:25.0:1773851859.388431:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0xbe7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851859.388433:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851859.388434:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f6fb1437 refcount 2 to 15889@kfi7
00010000:00000001:25.0:1773851859.388435:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851859.388435:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.388436:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851859.388437:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008d492367 x1859601843157120/t0(0) o400->7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4@15889@kfi7:76/0 lens 224/224 e 0 to 0 dl 1773852191 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1489-0'
00000100:00100000:25.0:1773851859.388440:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d492367 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4+5:39559:x1859601843157120:12345-15889@kfi7:400:default-tuolumne1489-0 Request processed in 71us (100us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851859.388442:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15889@kfi7, seq: 2025066
00000800:00000200:26.0:1773851859.388443:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0xbe7 TN_EVENT_TX_OK event status 0
00000100:00000040:25.0:1773851859.388443:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bfe20125 : new rpc_count 0
00000100:00000001:25.0:1773851859.388444:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851859.388444:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:26.0:1773851859.388445:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851859.388445:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:25.0:1773851859.388445:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003f93d35f.
00000020:00000010:25.0:1773851859.388446:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058df43f4.
00000400:00000200:26.0:1773851859.388447:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16080@kfi7: PUT: OK
00000400:00000200:26.0:1773851859.388447:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006793fb59
00000020:00000040:25.0:1773851859.388447:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000bfe20125 : new refcount 4
00000400:00000010:26.0:1773851859.388448:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006793fb59.
00000100:00000001:25.0:1773851859.388448:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851859.388449:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851859.388449:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851859.388450:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000800:00000200:26.0:1773851859.388452:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 16080@kfi7(000000009f02bb49):0x0 lsk 3048 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0xbe7 Transaction freed
00000800:00000200:29.0:1773851859.401061:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851859.401061:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851859.401062:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851859.401065:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851859.401066:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21602@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.401067:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21602@kfi7 : PUT - for me
00000400:00000200:29.0:1773851859.401068:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21602@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.401069:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c74a353 nid 21602@kfi7 refs 1
00000400:00000200:29.0:1773851859.401070:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21602@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.401071:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c74a353 nid 21602@kfi7 refs 2
00000400:00000200:29.0:1773851859.401072:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000c74a353 nid 21602@kfi7 refs 3
00000400:00000200:29.0:1773851859.401073:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21667@kfi7 to cpt 6
00000400:00000200:29.0:1773851859.401073:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21667@kfi7 of length 224 into portal 12 MB=0x699e0e2fda700
00000400:00000200:29.0:1773851859.401075:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21667@kfi7 of length 224/224 into md 0x77fe139dd [64] + 166944
00000800:00000200:29.0:1773851859.401076:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851859.401078:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.401079:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21602@kfi7: PUT: OK
00000100:00000001:29.0:1773851859.401080:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851859.401080:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851859.401081:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c007e06.
00000100:00000040:29.0:1773851859.401081:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000001c007e06 x1858041020262144 msgsize 224
00000100:00100000:29.0:1773851859.401083:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21667@kfi7 (source: 12345-21602@kfi7)
00000100:00000001:29.0:1773851859.401084:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851859.401085:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851859.401085:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000c74a353 nid 21602@kfi7 refs 2
02000000:00000001:31.0:1773851859.401086:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851859.401086:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851859.401086:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851859.401087:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851859.401088:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851859.401088:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041020262144
00000020:00000001:31.0:1773851859.401089:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851859.401089:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9286b
00000020:00000001:31.0:1773851859.401090:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851859.401093:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ee8d87d6 refcount=3932
00000020:00000001:31.0:1773851859.401094:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742970368 : -107128966581248 : ffff9e9118007400)
00000020:00000001:31.0:1773851859.401095:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742970368 : -107128966581248 : ffff9e9118007400)
00000100:00000001:31.0:1773851859.401096:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851859.401096:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851859.401097:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000063ec6403.
00000020:00000010:31.0:1773851859.401098:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851859.401099:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851859.401100:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851859.401100:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851859.401101:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.401102:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851859.401102:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851859.401102:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.401103:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.401105:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851859.401105:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851859.401106:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851859.401106:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851859.401107:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21667@kfi7, seq: 2055483
00000100:00000040:28.0:1773851859.401107:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ee8d87d6 : new rpc_count 15
00000100:00000001:31.0:1773851859.401108:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.401108:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.401108:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221534848 : -106948488016768 : ffff9ebb1d5ccc80)
00000100:00000040:28.0:1773851859.401110:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c007e06 x1858041020262144/t0(0) o400->37374d32-bd31-4ece-8446-ba8f411b0df9@21667@kfi7:647/0 lens 224/0 e 0 to 0 dl 1773852007 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1836-0'
00000100:00000001:28.0:1773851859.401113:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851859.401113:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851859.401114:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c007e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:37374d32-bd31-4ece-8446-ba8f411b0df9+3932:39723:x1858041020262144:12345-21667@kfi7:400:default-tuolumne1836-0
00000100:00000200:28.0:1773851859.401116:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041020262144
00000020:00000001:28.0:1773851859.401116:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851859.401117:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851859.401118:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.401119:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851859.401119:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851859.401120:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851859.401121:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041020262144, found 0 last_xid 1858041019505983
00000020:00000001:28.0:1773851859.401122:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851859.401122:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851859.401123:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851859.401124:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.401124:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851859.401125:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851859.401125:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851859.401126:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cd411c23.
02000000:00000001:28.0:1773851859.401127:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.401128:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.401128:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851859.401129:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593498, transno 0, xid 1858041020262144
00010000:00000001:28.0:1773851859.401131:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851859.401132:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c007e06 x1858041020262144/t0(0) o400->37374d32-bd31-4ece-8446-ba8f411b0df9@21667@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1836-0'
00010000:00000001:28.0:1773851859.401135:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851859.401135:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851859.401136:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=92 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851859.401137:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851859.401138:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000037a946b0 refcount 3 to 21667@kfi7
00000100:00000001:28.0:1773851859.401139:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130856960 : -107149578694656 : ffff9e8c4b6c9000)
02000000:00000001:28.0:1773851859.401140:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851859.401140:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.401141:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851859.401142:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21602@kfi7
00000400:00000010:28.0:1773851859.401142:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c31df675.
00000100:00000200:28.0:1773851859.401143:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041020262144, offset 224
00000400:00000200:28.0:1773851859.401144:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21602@kfi7
00000400:00000200:28.0:1773851859.401145:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21602@kfi7 to cpt 7
00000400:00000200:28.0:1773851859.401146:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c74a353 nid 21602@kfi7 refs 1
00000400:00000200:28.0:1773851859.401147:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000c74a353 nid 21602@kfi7 refs 2
00000400:00000200:28.0:1773851859.401148:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000c74a353 nid 21602@kfi7 refs 3
00000400:00000200:28.0:1773851859.401149:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21602@kfi7 local destination
00000400:00000200:28.0:1773851859.401151:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768840:8768840:1024:4294967295] 21602@kfi7 LPNI seq info [7408207:7408207:16:4294967295]
00000400:00000200:28.0:1773851859.401152:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000c74a353 nid 21602@kfi7 refs 2
00000400:00000200:28.0:1773851859.401153:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21602@kfi7 to cpt 7
00000400:00000200:28.0:1773851859.401155:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21602@kfi7(21602@kfi7:21602@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851859.401156:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000c74a353 nid 21602@kfi7 refs 3
00000800:00000200:28.0:1773851859.401157:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851859.401159:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851859.401161:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851859.401165:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xc8b Using peer 21602@kfi7(0xc8b)
00000800:00000200:28.0:1773851859.401168:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0xc8b: rc=0
00000800:00000200:28.0:1773851859.401169:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xc8b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851859.401171:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851859.401172:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000037a946b0 refcount 2 to 21667@kfi7
00010000:00000001:28.0:1773851859.401173:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851859.401173:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.401174:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851859.401175:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c007e06 x1858041020262144/t0(0) o400->37374d32-bd31-4ece-8446-ba8f411b0df9@21667@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1836-0'
00000100:00100000:28.0:1773851859.401179:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c007e06 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:37374d32-bd31-4ece-8446-ba8f411b0df9+3932:39723:x1858041020262144:12345-21667@kfi7:400:default-tuolumne1836-0 Request processed in 65us (97us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851859.401182:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21667@kfi7, seq: 2055483
00000100:00000040:28.0:1773851859.401182:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ee8d87d6 : new rpc_count 14
00000100:00000001:28.0:1773851859.401183:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851859.401184:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851859.401184:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:28.0:1773851859.401185:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:28.0:1773851859.401186:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000063ec6403.
00000020:00000040:28.0:1773851859.401187:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000ee8d87d6 : new refcount 3931
00000100:00000001:28.0:1773851859.401187:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851859.401192:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xc8b TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851859.401194:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.401195:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21602@kfi7: PUT: OK
00000400:00000200:29.0:1773851859.401196:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c31df675
00000400:00000010:29.0:1773851859.401196:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c31df675.
00000100:00000001:29.0:1773851859.401197:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851859.401197:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851859.401198:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000c74a353 nid 21602@kfi7 refs 2
00000800:00000200:29.0:1773851859.401199:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 21602@kfi7(00000000474f6e0d):0x0 lsk 3212 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xc8b Transaction freed
00000800:00000200:25.0:1773851859.406465:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851859.406466:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851859.406467:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851859.406469:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851859.406471:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17745@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.406472:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17745@kfi7 : PUT - for me
00000400:00000200:25.0:1773851859.406473:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17745@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.406475:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000da2c9f8 nid 17745@kfi7 refs 1
00000400:00000200:25.0:1773851859.406475:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17745@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.406476:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000da2c9f8 nid 17745@kfi7 refs 2
00000400:00000200:25.0:1773851859.406477:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000da2c9f8 nid 17745@kfi7 refs 3
00000400:00000200:25.0:1773851859.406478:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17745@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.406479:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17745@kfi7 of length 224 into portal 12 MB=0x69b4b5c47c200
00000400:00000200:25.0:1773851859.406480:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17745@kfi7 of length 224/224 into md 0x16159c6179 [64] + 189048
00000800:00000200:25.0:1773851859.406482:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851859.406484:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851859.406485:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17745@kfi7: PUT: OK
00000100:00000001:25.0:1773851859.406486:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851859.406486:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851859.406487:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000efe81d94.
00000100:00000040:25.0:1773851859.406487:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000efe81d94 x1859597833323008 msgsize 224
00000100:00100000:25.0:1773851859.406489:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17745@kfi7 (source: 12345-17745@kfi7)
00000100:00000001:25.0:1773851859.406490:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851859.406491:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000da2c9f8 nid 17745@kfi7 refs 2
00000800:00000200:25.0:1773851859.406493:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851859.406495:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851859.406496:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851859.406496:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851859.406497:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851859.406498:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851859.406498:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597833323008
00000020:00000001:25.0:1773851859.406499:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851859.406500:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f56d
00000020:00000001:25.0:1773851859.406500:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851859.406503:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000048309389 refcount=166
00000020:00000001:25.0:1773851859.406503:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636997385484288 : -107076324067328 : ffff9e9d59bd7800)
00000020:00000001:25.0:1773851859.406504:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636997385484288 : -107076324067328 : ffff9e9d59bd7800)
00000100:00000001:25.0:1773851859.406505:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851859.406507:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851859.406507:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089cac470.
00000020:00000010:25.0:1773851859.406508:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851859.406509:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a35ab917.
00000100:00000001:25.0:1773851859.406510:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851859.406511:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851859.406511:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851859.406512:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851859.406513:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851859.406513:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851859.406514:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851859.406515:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851859.406515:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851859.406516:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:25.0:1773851859.406517:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17745@kfi7, seq: 2025067
00000100:00000040:25.0:1773851859.406517:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000048309389 : new rpc_count 1
00000100:00000001:24.0:1773851859.406517:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851859.406518:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637054961748224 : -107018747803392 : ffff9eaac18d8900)
00000100:00000001:24.0:1773851859.406518:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851859.406519:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000efe81d94 x1859597833323008/t0(0) o400->e9935e65-4158-4feb-914b-833bc49c07bc@17745@kfi7:76/0 lens 224/0 e 0 to 0 dl 1773852191 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1602-0'
00000100:00000001:24.0:1773851859.406519:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851859.406522:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851859.406522:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851859.406523:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000efe81d94 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e9935e65-4158-4feb-914b-833bc49c07bc+166:39499:x1859597833323008:12345-17745@kfi7:400:default-tuolumne1602-0
00000100:00000200:25.0:1773851859.406524:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597833323008
00000020:00000001:25.0:1773851859.406525:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851859.406526:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851859.406526:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.406527:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851859.406527:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851859.406528:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851859.406529:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597833323008, found 0 last_xid 1859597832904319
00000020:00000001:25.0:1773851859.406529:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851859.406530:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851859.406531:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851859.406531:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.406532:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851859.406532:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851859.406533:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851859.406534:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2a53643.
02000000:00000001:25.0:1773851859.406534:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851859.406535:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.406535:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851859.406536:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062310, transno 0, xid 1859597833323008
00010000:00000001:25.0:1773851859.406537:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851859.406538:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000efe81d94 x1859597833323008/t0(0) o400->e9935e65-4158-4feb-914b-833bc49c07bc@17745@kfi7:76/0 lens 224/224 e 0 to 0 dl 1773852191 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1602-0'
00010000:00000001:25.0:1773851859.406540:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851859.406541:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851859.406541:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=92 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851859.406542:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851859.406543:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000df78d73a refcount 3 to 17745@kfi7
00000100:00000001:25.0:1773851859.406544:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092337120 : -107152617214496 : ffff9e8b96506de0)
02000000:00000001:25.0:1773851859.406545:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851859.406545:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851859.406546:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851859.406547:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17745@kfi7
00000400:00000010:25.0:1773851859.406548:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c4f35ba3.
00000100:00000200:25.0:1773851859.406548:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597833323008, offset 224
00000400:00000200:25.0:1773851859.406550:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17745@kfi7
00000400:00000200:25.0:1773851859.406550:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17745@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.406551:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000da2c9f8 nid 17745@kfi7 refs 1
00000400:00000200:25.0:1773851859.406552:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000da2c9f8 nid 17745@kfi7 refs 2
00000400:00000200:25.0:1773851859.406553:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000da2c9f8 nid 17745@kfi7 refs 3
00000400:00000200:25.0:1773851859.406554:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17745@kfi7 local destination
00000400:00000200:25.0:1773851859.406555:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768841:8768841:1024:4294967295] 17745@kfi7 LPNI seq info [347129:347129:16:4294967295]
00000400:00000200:25.0:1773851859.406557:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000da2c9f8 nid 17745@kfi7 refs 2
00000400:00000200:25.0:1773851859.406557:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17745@kfi7 to cpt 6
00000400:00000200:25.0:1773851859.406559:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17745@kfi7(17745@kfi7:17745@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851859.406562:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000da2c9f8 nid 17745@kfi7 refs 3
00000800:00000200:25.0:1773851859.406563:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851859.406564:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851859.406566:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851859.406568:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000083f Using peer 17745@kfi7(0x10000000000083f)
00000800:00000200:25.0:1773851859.406572:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000f6d78ee2: Posted send of 324 bytes to peer 0x10000000000083f: rc=0
00000800:00000200:25.0:1773851859.406573:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000083f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851859.406575:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851859.406576:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000df78d73a refcount 2 to 17745@kfi7
00010000:00000001:25.0:1773851859.406577:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851859.406577:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851859.406578:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851859.406579:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000efe81d94 x1859597833323008/t0(0) o400->e9935e65-4158-4feb-914b-833bc49c07bc@17745@kfi7:76/0 lens 224/224 e 0 to 0 dl 1773852191 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1602-0'
00000100:00100000:25.0:1773851859.406582:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000efe81d94 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e9935e65-4158-4feb-914b-833bc49c07bc+166:39499:x1859597833323008:12345-17745@kfi7:400:default-tuolumne1602-0 Request processed in 59us (93us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851859.406584:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17745@kfi7, seq: 2025067
00000100:00000040:25.0:1773851859.406585:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000048309389 : new rpc_count 0
00000100:00000001:25.0:1773851859.406585:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851859.406586:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851859.406586:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851859.406587:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a35ab917.
00000800:00000200:27.0:1773851859.406588:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000083f TN_EVENT_TX_OK event status 0
00000020:00000010:25.0:1773851859.406588:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089cac470.
00000020:00000040:25.0:1773851859.406588:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000048309389 : new refcount 165
00000100:00000001:25.0:1773851859.406589:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851859.406590:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851859.406592:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17745@kfi7: PUT: OK
00000400:00000200:27.0:1773851859.406592:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c4f35ba3
00000400:00000010:27.0:1773851859.406593:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c4f35ba3.
00000100:00000001:27.0:1773851859.406594:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851859.406594:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851859.406595:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000da2c9f8 nid 17745@kfi7 refs 2
00000800:00000200:27.0:1773851859.406597:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 17745@kfi7(0000000060f54993):0x0 lsk 2112 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000083f Transaction freed
00000800:00000200:5.0:1773851859.407116:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.407118:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.407119:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.407121:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.407123:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12675@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.407124:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12675@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.407125:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12675@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.407126:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4856746 nid 12675@kfi7 refs 1
00000400:00000200:5.0:1773851859.407127:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12675@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.407128:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4856746 nid 12675@kfi7 refs 2
00000400:00000200:5.0:1773851859.407129:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c4856746 nid 12675@kfi7 refs 3
00000400:00000200:5.0:1773851859.407129:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12611@kfi7 to cpt 5
00000400:00000200:5.0:1773851859.407130:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12611@kfi7 of length 224 into portal 12 MB=0x69b4b62ee6580
00000400:00000200:5.0:1773851859.407131:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12611@kfi7 of length 224/224 into md 0x793926dc5 [64] + 123856
00000800:00000200:5.0:1773851859.407133:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.407134:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.407135:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12675@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.407136:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.407137:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.407137:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a07f8287.
00000100:00000040:5.0:1773851859.407138:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a07f8287 x1859597944907136 msgsize 224
00000100:00100000:5.0:1773851859.407139:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12611@kfi7 (source: 12345-12675@kfi7)
00000100:00000001:5.0:1773851859.407140:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851859.407141:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4856746 nid 12675@kfi7 refs 2
00000100:00000001:7.0:1773851859.407142:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.407142:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851859.407143:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.407143:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851859.407143:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851859.407144:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.407145:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597944907136
00000020:00000001:7.0:1773851859.407145:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.407145:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7c69d
00000020:00000001:7.0:1773851859.407146:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.407149:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055cd5dd3 refcount=167
00000020:00000001:7.0:1773851859.407149:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139351544832 : -106934358006784 : ffff9ebe6793a400)
00000020:00000001:7.0:1773851859.407150:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139351544832 : -106934358006784 : ffff9ebe6793a400)
00000100:00000001:7.0:1773851859.407151:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.407152:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.407152:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851859.407153:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.407154:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c7f00787.
00000100:00000001:7.0:1773851859.407155:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.407155:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851859.407156:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.407157:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851859.407157:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851859.407158:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.407159:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.407160:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.407160:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.407160:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.407160:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.407161:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12611@kfi7, seq: 2001874
00000100:00000040:7.0:1773851859.407162:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055cd5dd3 : new rpc_count 1
00000100:00000001:6.0:1773851859.407162:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.407163:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866960640 : -107088842590976 : ffff9e9a6f93f500)
00000100:00000001:6.0:1773851859.407163:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.407164:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a07f8287 x1859597944907136/t0(0) o400->ec2046a4-2a43-41b0-ab33-f81a9046ea80@12611@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1288-0'
00000100:00000001:7.0:1773851859.407166:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.407167:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.407167:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a07f8287 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ec2046a4-2a43-41b0-ab33-f81a9046ea80+167:39569:x1859597944907136:12345-12611@kfi7:400:default-tuolumne1288-0
00000100:00000200:7.0:1773851859.407169:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597944907136
00000020:00000001:7.0:1773851859.407169:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.407170:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.407170:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.407171:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.407171:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851859.407172:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.407173:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597944907136, found 0 last_xid 1859597944484991
00000020:00000001:7.0:1773851859.407173:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.407174:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.407175:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.407175:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.407176:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851859.407176:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.407177:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.407178:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4d2009b.
02000000:00000001:7.0:1773851859.407179:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.407179:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.407181:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.407181:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062509, transno 0, xid 1859597944907136
00010000:00000001:7.0:1773851859.407182:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.407183:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a07f8287 x1859597944907136/t0(0) o400->ec2046a4-2a43-41b0-ab33-f81a9046ea80@12611@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1288-0'
00010000:00000001:7.0:1773851859.407185:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.407185:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.407186:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.407187:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.407188:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000adf61af1 refcount 3 to 12611@kfi7
00000100:00000001:7.0:1773851859.407188:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026144 : -107156745525472 : ffff9e8aa03f6720)
02000000:00000001:7.0:1773851859.407189:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.407190:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.407190:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.407191:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12675@kfi7
00000400:00000010:7.0:1773851859.407192:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c188dd4f.
00000100:00000200:7.0:1773851859.407192:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597944907136, offset 224
00000400:00000200:7.0:1773851859.407194:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12675@kfi7
00000400:00000200:7.0:1773851859.407194:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12675@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.407195:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4856746 nid 12675@kfi7 refs 1
00000400:00000200:7.0:1773851859.407196:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c4856746 nid 12675@kfi7 refs 2
00000400:00000200:7.0:1773851859.407197:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c4856746 nid 12675@kfi7 refs 3
00000400:00000200:7.0:1773851859.407198:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12675@kfi7 local destination
00000400:00000200:7.0:1773851859.407199:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768842:8768842:1024:4294967295] 12675@kfi7 LPNI seq info [415945:415945:16:4294967295]
00000400:00000200:7.0:1773851859.407201:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c4856746 nid 12675@kfi7 refs 2
00000400:00000200:7.0:1773851859.407202:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12675@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.407204:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12675@kfi7(12675@kfi7:12675@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.407205:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c4856746 nid 12675@kfi7 refs 3
00000800:00000200:7.0:1773851859.407206:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.407207:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851859.407209:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.407212:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0xc1e Using peer 12675@kfi7(0xc1e)
00000800:00000200:7.0:1773851859.407215:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0xc1e: rc=0
00000800:00000200:7.0:1773851859.407216:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0xc1e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.407218:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.407219:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000adf61af1 refcount 2 to 12611@kfi7
00010000:00000001:7.0:1773851859.407220:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.407220:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.407221:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.407221:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a07f8287 x1859597944907136/t0(0) o400->ec2046a4-2a43-41b0-ab33-f81a9046ea80@12611@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1288-0'
00000100:00100000:7.0:1773851859.407224:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a07f8287 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ec2046a4-2a43-41b0-ab33-f81a9046ea80+167:39569:x1859597944907136:12345-12611@kfi7:400:default-tuolumne1288-0 Request processed in 57us (85us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851859.407226:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12611@kfi7, seq: 2001874
00000100:00000040:7.0:1773851859.407227:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055cd5dd3 : new rpc_count 0
00000100:00000001:7.0:1773851859.407228:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851859.407228:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.407229:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.407229:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c7f00787.
00000800:00000200:5.0:1773851859.407229:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0xc1e TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851859.407230:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000400:00000200:5.0:1773851859.407230:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851859.407231:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000055cd5dd3 : new refcount 166
00000100:00000001:7.0:1773851859.407231:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851859.407231:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12675@kfi7: PUT: OK
00000400:00000200:5.0:1773851859.407232:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c188dd4f
00000400:00000010:5.0:1773851859.407233:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c188dd4f.
00000100:00000001:5.0:1773851859.407233:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851859.407234:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.407235:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4856746 nid 12675@kfi7 refs 2
00000800:00000200:5.0:1773851859.407236:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 12675@kfi7(000000004ec31ae7):0x0 lsk 3103 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0xc1e Transaction freed
00000800:00000200:1.0:1773851859.445838:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851859.445840:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851859.445842:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851859.445846:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851859.445852:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16963@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.445854:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16963@kfi7 : PUT - for me
00000400:00000200:1.0:1773851859.445856:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16963@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.445857:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 1
00000400:00000200:1.0:1773851859.445859:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16963@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.445860:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 2
00000400:00000200:1.0:1773851859.445862:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 3
00000400:00000200:1.0:1773851859.445863:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16963@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.445865:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16963@kfi7 of length 224 into portal 12 MB=0x69b81a65e8840
00000400:00000200:1.0:1773851859.445868:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16963@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 18720
00000800:00000200:1.0:1773851859.445871:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851859.445875:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.445877:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16963@kfi7: PUT: OK
00000100:00000001:1.0:1773851859.445878:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851859.445879:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851859.445881:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005edaa73a.
00000100:00000040:1.0:1773851859.445882:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000005edaa73a x1859831004563520 msgsize 224
00000100:00100000:1.0:1773851859.445884:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-16963@kfi7 (source: 12345-16963@kfi7)
00000100:00000001:1.0:1773851859.445886:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851859.445888:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 2
00000100:00000001:0.0:1773851859.445889:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851859.445891:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851859.445891:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851859.445891:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851859.445892:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851859.445894:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851859.445895:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831004563520
00000020:00000001:0.0:1773851859.445896:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851859.445897:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce4c432
00000020:00000001:0.0:1773851859.445898:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851859.445902:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c0f5364b refcount=164
00000020:00000001:0.0:1773851859.445903:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637140684358656 : -106933025192960 : ffff9ebeb704c400)
00000020:00000001:0.0:1773851859.445904:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637140684358656 : -106933025192960 : ffff9ebeb704c400)
00000100:00000001:0.0:1773851859.445906:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.445907:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851859.445908:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000572c181b.
00000020:00000010:0.0:1773851859.445910:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.445911:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851859.445913:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851859.445913:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851859.445914:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.445916:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851859.445917:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851859.445918:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.445919:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.445921:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.445922:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851859.445923:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851859.445924:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851859.445924:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16963@kfi7, seq: 1997516
00000100:00000040:0.0:1773851859.445925:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c0f5364b : new rpc_count 1
00000100:00000001:1.0:1773851859.445926:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.445927:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.445927:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637150605656960 : -106923103894656 : ffff9ec1065fc380)
00000100:00000040:0.0:1773851859.445929:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005edaa73a x1859831004563520/t0(0) o400->ccc7f283-ce88-4049-b0b7-c53c16010a0f@16963@kfi7:499/0 lens 224/0 e 0 to 0 dl 1773852614 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1560-0'
00000100:00000001:0.0:1773851859.445934:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.445935:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851859.445937:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005edaa73a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ccc7f283-ce88-4049-b0b7-c53c16010a0f+164:39483:x1859831004563520:12345-16963@kfi7:400:default-tuolumne1560-0
00000100:00000200:0.0:1773851859.445939:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831004563520
00000020:00000001:0.0:1773851859.445940:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851859.445941:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851859.445942:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.445943:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851859.445944:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851859.445946:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851859.445947:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831004563520, found 0 last_xid 1859831004140095
00000020:00000001:0.0:1773851859.445948:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851859.445949:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851859.445950:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851859.445951:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.445952:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851859.445953:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851859.445954:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851859.445956:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b918adb.
02000000:00000001:0.0:1773851859.445957:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.445958:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.445959:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851859.445960:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063498, transno 0, xid 1859831004563520
00010000:00000001:0.0:1773851859.445962:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851859.445963:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005edaa73a x1859831004563520/t0(0) o400->ccc7f283-ce88-4049-b0b7-c53c16010a0f@16963@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1560-0'
00010000:00000001:0.0:1773851859.445968:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851859.445968:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851859.445970:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=92 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851859.445972:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851859.445973:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005f251b92 refcount 3 to 16963@kfi7
00000100:00000001:0.0:1773851859.445974:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572032 : -107154178979584 : ffff9e8b3939c900)
02000000:00000001:0.0:1773851859.445976:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851859.445977:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.445978:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851859.445980:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16963@kfi7
00000400:00000010:0.0:1773851859.445981:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b7cd9ccd.
00000100:00000200:0.0:1773851859.445982:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831004563520, offset 224
00000400:00000200:0.0:1773851859.445985:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16963@kfi7
00000400:00000200:0.0:1773851859.445986:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16963@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.445988:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 1
00000400:00000200:0.0:1773851859.445990:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 2
00000400:00000200:0.0:1773851859.445992:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 3
00000400:00000200:0.0:1773851859.445994:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16963@kfi7 local destination
00000400:00000200:0.0:1773851859.445997:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768843:8768843:1024:4294967295] 16963@kfi7 LPNI seq info [228618:228618:16:4294967295]
00000400:00000200:0.0:1773851859.445999:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 2
00000400:00000200:0.0:1773851859.446001:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16963@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.446005:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16963@kfi7(16963@kfi7:16963@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851859.446007:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 3
00000800:00000200:0.0:1773851859.446009:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851859.446011:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851859.446015:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851859.446020:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5ba Using peer 16963@kfi7(0x5ba)
00000800:00000200:0.0:1773851859.446025:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x5ba: rc=0
00000800:00000200:0.0:1773851859.446028:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5ba TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851859.446031:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.446033:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005f251b92 refcount 2 to 16963@kfi7
00010000:00000001:0.0:1773851859.446036:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851859.446037:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.446039:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851859.446040:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005edaa73a x1859831004563520/t0(0) o400->ccc7f283-ce88-4049-b0b7-c53c16010a0f@16963@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1560-0'
00000100:00100000:0.0:1773851859.446046:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005edaa73a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ccc7f283-ce88-4049-b0b7-c53c16010a0f+164:39483:x1859831004563520:12345-16963@kfi7:400:default-tuolumne1560-0 Request processed in 110us (163us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851859.446050:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16963@kfi7, seq: 1997516
00000100:00000040:0.0:1773851859.446051:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c0f5364b : new rpc_count 0
00000100:00000001:0.0:1773851859.446053:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851859.446054:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851859.446055:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.446056:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851859.446058:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000572c181b.
00000020:00000040:0.0:1773851859.446059:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000c0f5364b : new refcount 163
00000100:00000001:0.0:1773851859.446060:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851859.446069:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5ba TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851859.446072:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.446074:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16963@kfi7: PUT: OK
00000400:00000200:1.0:1773851859.446076:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b7cd9ccd
00000400:00000010:1.0:1773851859.446077:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b7cd9ccd.
00000100:00000001:1.0:1773851859.446078:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851859.446079:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851859.446081:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d7c7ef44 nid 16963@kfi7 refs 2
00000800:00000200:1.0:1773851859.446083:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 16963@kfi7(000000001501fc08):0x0 lsk 1467 rsk 30 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5ba Transaction freed
00000800:00000200:29.0:1773851859.460183:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851859.460185:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851859.460187:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851859.460190:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851859.460193:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15808@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.460195:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15808@kfi7 : PUT - for me
00000400:00000200:29.0:1773851859.460196:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15808@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.460198:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f729d96 nid 15808@kfi7 refs 1
00000400:00000200:29.0:1773851859.460199:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15808@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.460200:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f729d96 nid 15808@kfi7 refs 2
00000400:00000200:29.0:1773851859.460202:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008f729d96 nid 15808@kfi7 refs 3
00000400:00000200:29.0:1773851859.460204:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15808@kfi7 to cpt 7
00000400:00000200:29.0:1773851859.460205:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15808@kfi7 of length 224 into portal 12 MB=0x69b4b6fbe5dc0
00000400:00000200:29.0:1773851859.460207:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15808@kfi7 of length 224/224 into md 0x77fe139dd [64] + 167168
00000800:00000200:29.0:1773851859.460210:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851859.460212:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.460217:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15808@kfi7: PUT: OK
00000100:00000001:29.0:1773851859.460218:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851859.460219:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851859.460220:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000737c706c.
00000100:00000040:29.0:1773851859.460221:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000737c706c x1859598159863232 msgsize 224
00000100:00100000:29.0:1773851859.460223:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15808@kfi7 (source: 12345-15808@kfi7)
00000100:00000001:29.0:1773851859.460225:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851859.460226:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008f729d96 nid 15808@kfi7 refs 2
00000800:00000200:29.0:1773851859.460228:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851859.460228:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851859.460228:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851859.460229:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851859.460230:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851859.460231:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851859.460233:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598159863232
00000020:00000001:28.0:1773851859.460234:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851859.460234:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fc35
00000020:00000001:28.0:1773851859.460236:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851859.460240:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000058bbc423 refcount=5
00000020:00000001:28.0:1773851859.460241:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937489380352 : -107136220171264 : ffff9e8f67a77400)
00000020:00000001:28.0:1773851859.460242:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937489380352 : -107136220171264 : ffff9e8f67a77400)
00000100:00000001:28.0:1773851859.460244:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851859.460245:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851859.460247:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aceb0722.
00000020:00000010:28.0:1773851859.460249:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851859.460250:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a24bde0f.
00000100:00000001:28.0:1773851859.460252:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851859.460252:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851859.460253:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.460255:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851859.460256:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851859.460256:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.460258:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851859.460259:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851859.460260:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851859.460260:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851859.460261:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851859.460262:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15808@kfi7, seq: 2055484
00000100:00000001:31.0:1773851859.460263:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851859.460263:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000058bbc423 : new rpc_count 1
00000100:00000001:31.0:1773851859.460264:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.460264:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221524480 : -106948488027136 : ffff9ebb1d5ca400)
00000100:00000040:28.0:1773851859.460266:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000737c706c x1859598159863232/t0(0) o400->702a7185-2795-4c50-9035-469a7d2129e6@15808@kfi7:647/0 lens 224/0 e 0 to 0 dl 1773852007 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1475-0'
00000100:00000001:28.0:1773851859.460271:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851859.460272:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851859.460273:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000737c706c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:702a7185-2795-4c50-9035-469a7d2129e6+5:39577:x1859598159863232:12345-15808@kfi7:400:default-tuolumne1475-0
00000100:00000200:28.0:1773851859.460275:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598159863232
00000020:00000001:28.0:1773851859.460276:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851859.460277:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851859.460278:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.460279:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851859.460280:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851859.460293:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851859.460294:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598159863232, found 0 last_xid 1859598159863231
00000020:00000001:28.0:1773851859.460295:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851859.460296:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851859.460297:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851859.460298:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.460299:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851859.460300:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851859.460301:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851859.460302:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000899fc249.
02000000:00000001:28.0:1773851859.460303:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.460304:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.460305:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851859.460306:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154593208, transno 0, xid 1859598159863232
00010000:00000001:28.0:1773851859.460307:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851859.460309:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000737c706c x1859598159863232/t0(0) o400->702a7185-2795-4c50-9035-469a7d2129e6@15808@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1475-0'
00010000:00000001:28.0:1773851859.460313:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851859.460314:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851859.460315:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=92 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851859.460317:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851859.460318:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000076a0c3b0 refcount 3 to 15808@kfi7
00000100:00000001:28.0:1773851859.460319:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918079254720 : -107155630296896 : ffff9e8ae2b870c0)
02000000:00000001:28.0:1773851859.460321:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851859.460322:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.460323:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851859.460324:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15808@kfi7
00000400:00000010:28.0:1773851859.460325:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000069139332.
00000100:00000200:28.0:1773851859.460326:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598159863232, offset 224
00000400:00000200:28.0:1773851859.460328:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15808@kfi7
00000400:00000200:28.0:1773851859.460330:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15808@kfi7 to cpt 7
00000400:00000200:28.0:1773851859.460331:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f729d96 nid 15808@kfi7 refs 1
00000400:00000200:28.0:1773851859.460332:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008f729d96 nid 15808@kfi7 refs 2
00000400:00000200:28.0:1773851859.460334:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008f729d96 nid 15808@kfi7 refs 3
00000400:00000200:28.0:1773851859.460337:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15808@kfi7 local destination
00000400:00000200:28.0:1773851859.460339:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768844:8768844:1024:4294967295] 15808@kfi7 LPNI seq info [5125860:5125860:16:4294967295]
00000400:00000200:28.0:1773851859.460342:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008f729d96 nid 15808@kfi7 refs 2
00000400:00000200:28.0:1773851859.460343:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15808@kfi7 to cpt 7
00000400:00000200:28.0:1773851859.460346:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15808@kfi7(15808@kfi7:15808@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851859.460348:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008f729d96 nid 15808@kfi7 refs 3
00000800:00000200:28.0:1773851859.460350:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851859.460352:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851859.460356:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851859.460360:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000095b Using peer 15808@kfi7(0x10000000000095b)
00000800:00000200:28.0:1773851859.460364:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x10000000000095b: rc=0
00000800:00000200:28.0:1773851859.460367:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000095b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851859.460370:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851859.460371:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000076a0c3b0 refcount 2 to 15808@kfi7
00010000:00000001:28.0:1773851859.460373:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851859.460375:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851859.460376:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851859.460377:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000737c706c x1859598159863232/t0(0) o400->702a7185-2795-4c50-9035-469a7d2129e6@15808@kfi7:647/0 lens 224/224 e 0 to 0 dl 1773852007 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1475-0'
00000100:00100000:28.0:1773851859.460383:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000737c706c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:702a7185-2795-4c50-9035-469a7d2129e6+5:39577:x1859598159863232:12345-15808@kfi7:400:default-tuolumne1475-0 Request processed in 110us (160us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851859.460387:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15808@kfi7, seq: 2055484
00000100:00000040:28.0:1773851859.460388:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000058bbc423 : new rpc_count 0
00000100:00000001:28.0:1773851859.460389:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851859.460390:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851859.460392:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851859.460393:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a24bde0f.
00000020:00000010:28.0:1773851859.460395:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aceb0722.
00000020:00000040:28.0:1773851859.460396:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000058bbc423 : new refcount 4
00000100:00000001:28.0:1773851859.460397:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851859.460405:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000095b TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851859.460407:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851859.460409:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15808@kfi7: PUT: OK
00000400:00000200:29.0:1773851859.460410:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000069139332
00000400:00000010:29.0:1773851859.460411:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000069139332.
00000100:00000001:29.0:1773851859.460412:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851859.460413:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851859.460414:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008f729d96 nid 15808@kfi7 refs 2
00000800:00000200:29.0:1773851859.460416:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 15808@kfi7(00000000cbf733a2):0x0 lsk 2396 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000095b Transaction freed
00000800:00000200:1.0:1773851859.466810:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851859.466811:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851859.466814:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851859.466818:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851859.466821:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15730@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.466823:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15730@kfi7 : PUT - for me
00000400:00000200:1.0:1773851859.466825:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15730@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.466827:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000823963ad nid 15730@kfi7 refs 1
00000400:00000200:1.0:1773851859.466829:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15730@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.466830:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000823963ad nid 15730@kfi7 refs 2
00000400:00000200:1.0:1773851859.466831:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000823963ad nid 15730@kfi7 refs 3
00000400:00000200:1.0:1773851859.466833:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15731@kfi7 to cpt 3
00000400:00000200:1.0:1773851859.466835:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15731@kfi7 of length 224 into portal 12 MB=0x69b4b594ba0c0
00000400:00000200:1.0:1773851859.466837:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15731@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 18944
00000800:00000200:1.0:1773851859.466840:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851859.466843:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.466845:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15730@kfi7: PUT: OK
00000100:00000001:1.0:1773851859.466846:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851859.466847:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851859.466850:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000039c738ea.
00000100:00000040:1.0:1773851859.466851:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000039c738ea x1859597783244992 msgsize 224
00000100:00100000:1.0:1773851859.466853:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-15731@kfi7 (source: 12345-15730@kfi7)
00000100:00000001:1.0:1773851859.466856:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851859.466858:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000823963ad nid 15730@kfi7 refs 2
00000100:00000001:0.0:1773851859.466859:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851859.466860:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851859.466860:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851859.466861:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851859.466862:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851859.466863:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851859.466865:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597783244992
00000020:00000001:0.0:1773851859.466866:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851859.466867:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d83c1c
00000020:00000001:0.0:1773851859.466868:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851859.466871:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fe2a2c6b refcount=169
00000020:00000001:0.0:1773851859.466872:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110101432320 : -106963608119296 : ffff9eb798225800)
00000020:00000001:0.0:1773851859.466874:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110101432320 : -106963608119296 : ffff9eb798225800)
00000100:00000001:0.0:1773851859.466875:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.466877:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851859.466878:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000572c181b.
00000020:00000010:0.0:1773851859.466880:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.466881:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851859.466883:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851859.466884:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851859.466885:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.466887:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851859.466888:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851859.466888:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.466890:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.466892:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851859.466893:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.466893:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851859.466894:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851859.466895:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15731@kfi7, seq: 1997517
00000100:00000040:0.0:1773851859.466896:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fe2a2c6b : new rpc_count 1
00000100:00000001:1.0:1773851859.466897:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.466898:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.466898:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637059701002496 : -107014008549120 : ffff9eabdc08d100)
00000100:00000040:0.0:1773851859.466900:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000039c738ea x1859597783244992/t0(0) o400->f5799e18-7327-4b0c-90aa-cca7af6e8be2@15731@kfi7:499/0 lens 224/0 e 0 to 0 dl 1773852614 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1466-0'
00000100:00000001:0.0:1773851859.466905:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.466906:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851859.466907:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039c738ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f5799e18-7327-4b0c-90aa-cca7af6e8be2+169:39513:x1859597783244992:12345-15731@kfi7:400:default-tuolumne1466-0
00000100:00000200:0.0:1773851859.466910:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597783244992
00000020:00000001:0.0:1773851859.466911:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851859.466912:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851859.466914:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.466915:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851859.466915:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851859.466917:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851859.466918:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597783244992, found 0 last_xid 1859597782825151
00000020:00000001:0.0:1773851859.466919:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851859.466920:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851859.466921:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851859.466922:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.466923:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851859.466923:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851859.466924:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851859.466926:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c0b9d54f.
02000000:00000001:0.0:1773851859.466927:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.466928:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.466929:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851859.466929:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061881, transno 0, xid 1859597783244992
00010000:00000001:0.0:1773851859.466930:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851859.466931:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000039c738ea x1859597783244992/t0(0) o400->f5799e18-7327-4b0c-90aa-cca7af6e8be2@15731@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1466-0'
00010000:00000001:0.0:1773851859.466934:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851859.466935:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851859.466936:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=92 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851859.466937:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851859.466937:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009c9edb23 refcount 3 to 15731@kfi7
00000100:00000001:0.0:1773851859.466938:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148960 : -107154898402656 : ffff9e8b0e5842a0)
02000000:00000001:0.0:1773851859.466939:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851859.466940:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.466941:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851859.466942:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15730@kfi7
00000400:00000010:0.0:1773851859.466942:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050d1fed3.
00000100:00000200:0.0:1773851859.466943:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597783244992, offset 224
00000400:00000200:0.0:1773851859.466945:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15730@kfi7
00000400:00000200:0.0:1773851859.466946:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15730@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.466946:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000823963ad nid 15730@kfi7 refs 1
00000400:00000200:0.0:1773851859.466948:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000823963ad nid 15730@kfi7 refs 2
00000400:00000200:0.0:1773851859.466949:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000823963ad nid 15730@kfi7 refs 3
00000400:00000200:0.0:1773851859.466950:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15730@kfi7 local destination
00000400:00000200:0.0:1773851859.466952:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768845:8768845:1024:4294967295] 15730@kfi7 LPNI seq info [456829:456829:16:4294967295]
00000400:00000200:0.0:1773851859.466953:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000823963ad nid 15730@kfi7 refs 2
00000400:00000200:0.0:1773851859.466954:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15730@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.466956:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15730@kfi7(15730@kfi7:15730@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851859.466958:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000823963ad nid 15730@kfi7 refs 3
00000800:00000200:0.0:1773851859.466959:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851859.466960:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851859.466965:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851859.466968:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102f Using peer 15730@kfi7(0x102f)
00000800:00000200:0.0:1773851859.466971:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x102f: rc=0
00000800:00000200:0.0:1773851859.466973:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851859.466976:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.466977:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009c9edb23 refcount 2 to 15731@kfi7
00010000:00000001:0.0:1773851859.466977:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851859.466978:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.466979:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851859.466979:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000039c738ea x1859597783244992/t0(0) o400->f5799e18-7327-4b0c-90aa-cca7af6e8be2@15731@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1466-0'
00000100:00100000:0.0:1773851859.466985:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039c738ea pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f5799e18-7327-4b0c-90aa-cca7af6e8be2+169:39513:x1859597783244992:12345-15731@kfi7:400:default-tuolumne1466-0 Request processed in 79us (133us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851859.466987:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15731@kfi7, seq: 1997517
00000100:00000040:0.0:1773851859.466988:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fe2a2c6b : new rpc_count 0
00000100:00000001:0.0:1773851859.466989:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851859.466990:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851859.466990:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.466991:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851859.466992:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000572c181b.
00000020:00000040:0.0:1773851859.466993:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000fe2a2c6b : new refcount 168
00000100:00000001:0.0:1773851859.466994:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851859.466999:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102f TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851859.467001:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.467003:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15730@kfi7: PUT: OK
00000400:00000200:1.0:1773851859.467004:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050d1fed3
00000400:00000010:1.0:1773851859.467004:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050d1fed3.
00000100:00000001:1.0:1773851859.467005:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851859.467006:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851859.467006:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000823963ad nid 15730@kfi7 refs 2
00000800:00000200:1.0:1773851859.467008:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 15730@kfi7(00000000bb684516):0x0 lsk 4144 rsk 33 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102f Transaction freed
00000800:00000200:9.0:1773851859.525294:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.525295:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851859.525297:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851859.525300:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851859.525303:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13314@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.525305:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13314@kfi7 : PUT - for me
00000400:00000200:9.0:1773851859.525307:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13314@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.525308:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bdffb30 nid 13314@kfi7 refs 1
00000400:00000200:9.0:1773851859.525309:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13314@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.525311:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bdffb30 nid 13314@kfi7 refs 2
00000400:00000200:9.0:1773851859.525312:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007bdffb30 nid 13314@kfi7 refs 3
00000400:00000200:9.0:1773851859.525313:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13314@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.525315:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13314@kfi7 of length 224 into portal 12 MB=0x69b4bae0e9240
00000400:00000200:9.0:1773851859.525317:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13314@kfi7 of length 224/224 into md 0x78146ce49 [64] + 125904
00000800:00000200:9.0:1773851859.525320:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851859.525323:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.525325:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13314@kfi7: PUT: OK
00000100:00000001:9.0:1773851859.525326:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851859.525328:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851859.525329:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000058e8a409.
00000100:00000040:9.0:1773851859.525330:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000058e8a409 x1859599205306944 msgsize 224
00000100:00100000:9.0:1773851859.525333:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13314@kfi7 (source: 12345-13314@kfi7)
00000100:00000001:9.0:1773851859.525335:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851859.525336:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007bdffb30 nid 13314@kfi7 refs 2
00000100:00000001:10.0:1773851859.525337:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851859.525338:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851859.525339:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851859.525339:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851859.525340:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851859.525341:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851859.525342:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599205306944
00000020:00000001:10.0:1773851859.525343:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851859.525344:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7c3b7
00000020:00000001:10.0:1773851859.525345:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.525348:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000068497a5a refcount=5
00000020:00000001:10.0:1773851859.525349:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136154928128 : -106937554623488 : ffff9ebda90b2400)
00000020:00000001:10.0:1773851859.525350:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136154928128 : -106937554623488 : ffff9ebda90b2400)
00000100:00000001:10.0:1773851859.525352:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.525353:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851859.525354:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057130d88.
00000020:00000010:10.0:1773851859.525355:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851859.525357:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851859.525359:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851859.525359:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851859.525360:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851859.525362:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851859.525362:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851859.525363:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.525365:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.525367:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.525367:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.525367:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851859.525368:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851859.525369:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13314@kfi7, seq: 2130742
00000100:00000001:11.0:1773851859.525370:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.525370:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000068497a5a : new rpc_count 1
00000100:00000001:11.0:1773851859.525371:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.525371:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064884480 : -106983644667136 : ffff9eb2eddce300)
00000100:00000040:10.0:1773851859.525373:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000058e8a409 x1859599205306944/t0(0) o400->3fbec2db-beb8-4aac-8f6e-c6796fb249f1@13314@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1335-0'
00000100:00000001:10.0:1773851859.525378:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.525378:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851859.525380:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058e8a409 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3fbec2db-beb8-4aac-8f6e-c6796fb249f1+5:39688:x1859599205306944:12345-13314@kfi7:400:default-tuolumne1335-0
00000100:00000200:10.0:1773851859.525382:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599205306944
00000020:00000001:10.0:1773851859.525383:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851859.525384:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851859.525385:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.525386:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851859.525387:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851859.525388:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851859.525389:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599205306944, found 0 last_xid 1859599205306943
00000020:00000001:10.0:1773851859.525390:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851859.525391:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851859.525392:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851859.525393:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.525394:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851859.525395:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851859.525395:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851859.525397:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000776bdb17.
02000000:00000001:10.0:1773851859.525398:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.525399:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.525400:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851859.525401:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595212, transno 0, xid 1859599205306944
00010000:00000001:10.0:1773851859.525402:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851859.525404:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000058e8a409 x1859599205306944/t0(0) o400->3fbec2db-beb8-4aac-8f6e-c6796fb249f1@13314@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1335-0'
00010000:00000001:10.0:1773851859.525408:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851859.525409:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851859.525410:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=92 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851859.525412:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851859.525413:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000048a25e30 refcount 3 to 13314@kfi7
00000100:00000001:10.0:1773851859.525414:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810487040 : -107154899064576 : ffff9e8b0e4e2900)
02000000:00000001:10.0:1773851859.525415:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851859.525416:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.525417:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851859.525418:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13314@kfi7
00000400:00000010:10.0:1773851859.525419:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000014613f9b.
00000100:00000200:10.0:1773851859.525421:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599205306944, offset 224
00000400:00000200:10.0:1773851859.525423:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13314@kfi7
00000400:00000200:10.0:1773851859.525425:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13314@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.525426:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bdffb30 nid 13314@kfi7 refs 1
00000400:00000200:10.0:1773851859.525428:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007bdffb30 nid 13314@kfi7 refs 2
00000400:00000200:10.0:1773851859.525430:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007bdffb30 nid 13314@kfi7 refs 3
00000400:00000200:10.0:1773851859.525431:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13314@kfi7 local destination
00000400:00000200:10.0:1773851859.525434:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768846:8768846:1024:4294967295] 13314@kfi7 LPNI seq info [16027141:16027141:16:4294967295]
00000400:00000200:10.0:1773851859.525436:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007bdffb30 nid 13314@kfi7 refs 2
00000400:00000200:10.0:1773851859.525437:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13314@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.525441:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13314@kfi7(13314@kfi7:13314@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851859.525443:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007bdffb30 nid 13314@kfi7 refs 3
00000800:00000200:10.0:1773851859.525445:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851859.525448:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851859.525451:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851859.525455:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x9aa Using peer 13314@kfi7(0x9aa)
00000800:00000200:10.0:1773851859.525459:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000019dc57a6: Posted send of 324 bytes to peer 0x9aa: rc=0
00000800:00000200:10.0:1773851859.525462:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x9aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851859.525465:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.525466:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000048a25e30 refcount 2 to 13314@kfi7
00010000:00000001:10.0:1773851859.525467:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851859.525468:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.525469:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851859.525470:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000058e8a409 x1859599205306944/t0(0) o400->3fbec2db-beb8-4aac-8f6e-c6796fb249f1@13314@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1335-0'
00000100:00100000:10.0:1773851859.525475:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058e8a409 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3fbec2db-beb8-4aac-8f6e-c6796fb249f1+5:39688:x1859599205306944:12345-13314@kfi7:400:default-tuolumne1335-0 Request processed in 96us (143us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851859.525475:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x9aa TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851859.525477:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:10.0:1773851859.525479:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13314@kfi7, seq: 2130742
00000400:00000200:9.0:1773851859.525479:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13314@kfi7: PUT: OK
00000100:00000040:10.0:1773851859.525480:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000068497a5a : new rpc_count 0
00000400:00000200:9.0:1773851859.525480:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000014613f9b
00000100:00000001:10.0:1773851859.525481:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:9.0:1773851859.525481:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000014613f9b.
00000100:00000001:10.0:1773851859.525482:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851859.525482:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:10.0:1773851859.525483:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000100:00000001:9.0:1773851859.525483:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:10.0:1773851859.525484:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000400:00000200:9.0:1773851859.525484:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007bdffb30 nid 13314@kfi7 refs 2
00000020:00000010:10.0:1773851859.525486:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057130d88.
00000800:00000200:9.0:1773851859.525486:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 13314@kfi7(00000000e1229694):0x0 lsk 2475 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x9aa Transaction freed
00000020:00000040:10.0:1773851859.525487:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000068497a5a : new refcount 4
00000100:00000001:10.0:1773851859.525488:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851859.563206:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.563207:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851859.563208:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.563210:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851859.563212:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.563214:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000200:13.0:1773851859.563215:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.563216:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:13.0:1773851859.563216:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.563217:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:13.0:1773851859.563218:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:13.0:1773851859.563219:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.563220:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 224 into portal 12 MB=0x699e0ec01b900
00000400:00000200:13.0:1773851859.563222:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2057@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 20168
00000800:00000200:13.0:1773851859.563224:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851859.563225:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.563227:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00000100:00000001:13.0:1773851859.563228:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851859.563228:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851859.563229:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000675f4e9b.
00000100:00000040:13.0:1773851859.563230:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000675f4e9b x1858041171523840 msgsize 224
00000100:00100000:13.0:1773851859.563231:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-2057@kfi7 (source: 12345-2057@kfi7)
00000100:00000001:13.0:1773851859.563232:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851859.563233:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:15.0:1773851859.563234:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851859.563235:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851859.563235:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851859.563235:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851859.563236:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851859.563237:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851859.563238:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041171523840
00000020:00000001:15.0:1773851859.563238:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851859.563239:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acbc6ce
00000020:00000001:15.0:1773851859.563239:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851859.563242:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071d4c7c7 refcount=5
00000020:00000001:15.0:1773851859.563243:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946291941376 : -107127417610240 : ffff9e917453e000)
00000020:00000001:15.0:1773851859.563244:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946291941376 : -107127417610240 : ffff9e917453e000)
00000100:00000001:15.0:1773851859.563245:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.563245:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851859.563246:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9af698f.
00000020:00000010:15.0:1773851859.563248:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851859.563249:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851859.563249:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851859.563250:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851859.563251:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.563252:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851859.563252:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851859.563253:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.563254:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.563255:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.563255:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851859.563255:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851859.563255:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851859.563257:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2057@kfi7, seq: 2289796
00000100:00000040:15.0:1773851859.563257:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071d4c7c7 : new rpc_count 1
00000100:00000001:13.0:1773851859.563257:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.563258:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537144960 : -107002172406656 : ffff9eae9d860480)
00000100:00000040:15.0:1773851859.563259:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000675f4e9b x1858041171523840/t0(0) o400->lustre5-MDT0001-lwp-OST000a_UUID@2057@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba111-0'
00000100:00000001:13.0:1773851859.563259:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.563262:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.563263:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851859.563264:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000675f4e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:lustre5-MDT0001-lwp-OST000a_UUID+5:272663:x1858041171523840:12345-2057@kfi7:400:default-yuba111-0
00000100:00000200:15.0:1773851859.563265:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041171523840
00000020:00000001:15.0:1773851859.563266:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851859.563266:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851859.563267:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.563267:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851859.563268:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851859.563269:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:15.0:1773851859.563269:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851859.563270:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851859.563271:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851859.563271:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.563272:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851859.563272:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851859.563273:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851859.563274:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000027552f8a.
02000000:00000001:15.0:1773851859.563275:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.563275:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.563276:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851859.563277:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041171523840
00010000:00000001:15.0:1773851859.563278:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851859.563279:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000675f4e9b x1858041171523840/t0(0) o400->lustre5-MDT0001-lwp-OST000a_UUID@2057@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba111-0'
00010000:00000001:15.0:1773851859.563282:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851859.563282:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851859.563283:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=92 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851859.563284:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851859.563285:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dba79e6a refcount 7 to 2057@kfi7
00000100:00000001:15.0:1773851859.563285:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151552 : -107154898400064 : ffff9e8b0e584cc0)
02000000:00000001:15.0:1773851859.563286:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851859.563287:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.563287:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851859.563288:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000010:15.0:1773851859.563289:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006486d8f3.
00000100:00000200:15.0:1773851859.563290:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041171523840, offset 224
00000400:00000200:15.0:1773851859.563291:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:15.0:1773851859.563292:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.563293:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:15.0:1773851859.563294:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:15.0:1773851859.563296:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:15.0:1773851859.563297:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2057@kfi7 local destination
00000400:00000200:15.0:1773851859.563298:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768847:8768847:1024:4294967295] 2057@kfi7 LPNI seq info [5404104:5404104:16:4294967295]
00000400:00000200:15.0:1773851859.563300:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:15.0:1773851859.563300:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.563302:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851859.563304:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000800:00000200:15.0:1773851859.563305:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851859.563307:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851859.563309:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851859.563311:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x200000000000294 Using peer 2057@kfi7(0x200000000000294)
00000800:00000200:15.0:1773851859.563315:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x200000000000294: rc=0
00000800:00000200:15.0:1773851859.563317:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x200000000000294 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851859.563319:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851859.563320:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dba79e6a refcount 6 to 2057@kfi7
00010000:00000001:15.0:1773851859.563320:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851859.563321:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.563321:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851859.563322:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000675f4e9b x1858041171523840/t0(0) o400->lustre5-MDT0001-lwp-OST000a_UUID@2057@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba111-0'
00000100:00100000:15.0:1773851859.563325:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000675f4e9b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:lustre5-MDT0001-lwp-OST000a_UUID+5:272663:x1858041171523840:12345-2057@kfi7:400:default-yuba111-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851859.563327:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2057@kfi7, seq: 2289796
00000800:00000200:13.0:1773851859.563327:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x200000000000294 TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851859.563328:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071d4c7c7 : new rpc_count 0
00000100:00000001:15.0:1773851859.563329:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851859.563329:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851859.563329:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851859.563330:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851859.563330:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00000020:00000010:15.0:1773851859.563331:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000400:00000200:13.0:1773851859.563331:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006486d8f3
00000400:00000010:13.0:1773851859.563331:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006486d8f3.
00000020:00000010:15.0:1773851859.563332:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9af698f.
00000100:00000001:13.0:1773851859.563332:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:15.0:1773851859.563333:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000071d4c7c7 : new refcount 4
00000100:00000001:13.0:1773851859.563333:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851859.563333:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:15.0:1773851859.563334:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851859.563335:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x200000000000294 Transaction freed
00000800:00000200:9.0:1773851859.589877:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.589877:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851859.589878:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851859.589879:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851859.589879:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851859.589881:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19346@kfi7(00000000d1ef7f1c):0x29e version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851859.589882:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851859.589883:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e Using peer 19346@kfi7(0x29e)
00000400:00000200:9.0:1773851859.589885:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19346@kfi7 to cpt 2
00000800:00000200:9.0:1773851859.589887:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 38 bytes to peer 0x29e: rc=0
00000800:00000200:10.0:1773851859.589888:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851859.589888:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851859.589892:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19346@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.589894:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19346@kfi7 : PUT - for me
00000400:00000200:10.0:1773851859.589896:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19346@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.589897:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 1
00000400:00000200:10.0:1773851859.589899:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19346@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.589900:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 2
00000800:00000200:9.0:1773851859.589900:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851859.589901:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 3
00000800:00000200:9.0:1773851859.589902:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e Transaction freed
00000400:00000200:10.0:1773851859.589903:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19347@kfi7 to cpt 5
00000400:00000200:10.0:1773851859.589905:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19347@kfi7 of length 224 into portal 12 MB=0x699f59d0ef740
00000400:00000200:10.0:1773851859.589907:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19347@kfi7 of length 224/224 into md 0x78146ce49 [64] + 126128
00000800:00000200:10.0:1773851859.589911:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851859.589914:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851859.589916:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19346@kfi7: PUT: OK
00000100:00000001:10.0:1773851859.589918:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851859.589919:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851859.589920:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009d0add5.
00000100:00000040:10.0:1773851859.589922:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000009d0add5 x1858130041304896 msgsize 224
00000100:00100000:10.0:1773851859.589924:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-19347@kfi7 (source: 12345-19346@kfi7)
00000100:00000001:10.0:1773851859.589927:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851859.589928:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 2
00000800:00000200:10.0:1773851859.589931:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851859.589936:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851859.589937:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851859.589938:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851859.589938:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851859.589940:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851859.589941:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858130041304896
00000020:00000001:10.0:1773851859.589942:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851859.589946:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93021
00000020:00000001:10.0:1773851859.589947:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.589949:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f6dbde14 refcount=6
00000020:00000001:10.0:1773851859.589950:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745145344 : -107128964406272 : ffff9e911821a400)
00000020:00000001:10.0:1773851859.589952:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745145344 : -107128964406272 : ffff9e911821a400)
00000100:00000001:10.0:1773851859.589953:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.589954:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851859.589955:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057130d88.
00000020:00000010:10.0:1773851859.589957:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851859.589958:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851859.589959:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851859.589960:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851859.589961:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851859.589962:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851859.589963:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851859.589964:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.589965:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851859.589967:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851859.589968:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851859.589968:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851859.589968:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851859.589970:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19347@kfi7, seq: 2130743
00000100:00000001:11.0:1773851859.589971:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.589971:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f6dbde14 : new rpc_count 1
00000100:00000001:11.0:1773851859.589972:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.589972:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077439616 : -106968632112000 : ffff9eb66cae4c80)
00000100:00000040:10.0:1773851859.589974:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009d0add5 x1858130041304896/t0(0) o400->823698e3-d597-4e2d-b28c-a878c6a13e1f@19347@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1702-0'
00000100:00000001:10.0:1773851859.589978:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.589979:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851859.589981:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009d0add5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:823698e3-d597-4e2d-b28c-a878c6a13e1f+6:39889:x1858130041304896:12345-19347@kfi7:400:default-tuolumne1702-0
00000100:00000200:10.0:1773851859.589983:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858130041304896
00000020:00000001:10.0:1773851859.589984:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851859.589985:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851859.589986:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.589987:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851859.589988:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851859.589989:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851859.589990:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858130041304896, found 0 last_xid 1858130041304895
00000020:00000001:10.0:1773851859.589991:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851859.589992:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851859.589993:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851859.589994:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.589995:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851859.589996:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851859.589997:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851859.589999:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008d67886e.
02000000:00000001:10.0:1773851859.590000:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.590001:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.590003:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851859.590004:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695499, transno 0, xid 1858130041304896
00010000:00000001:10.0:1773851859.590005:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851859.590006:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009d0add5 x1858130041304896/t0(0) o400->823698e3-d597-4e2d-b28c-a878c6a13e1f@19347@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1702-0'
00010000:00000001:10.0:1773851859.590010:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851859.590011:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851859.590012:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=92 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851859.590014:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851859.590015:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b967f1f1 refcount 3 to 19347@kfi7
00000100:00000001:10.0:1773851859.590017:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402093056 : -107139307458560 : ffff9e8eafa33000)
02000000:00000001:10.0:1773851859.590018:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851859.590019:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.590020:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851859.590021:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19346@kfi7
00000400:00000010:10.0:1773851859.590022:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b1492f92.
00000100:00000200:10.0:1773851859.590023:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858130041304896, offset 224
00000400:00000200:10.0:1773851859.590026:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19346@kfi7
00000400:00000200:10.0:1773851859.590027:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19346@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.590029:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 1
00000400:00000200:10.0:1773851859.590030:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 2
00000400:00000200:10.0:1773851859.590033:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 3
00000400:00000200:10.0:1773851859.590035:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19346@kfi7 local destination
00000400:00000200:10.0:1773851859.590038:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768848:8768848:1024:4294967295] 19346@kfi7 LPNI seq info [8889593:8889593:16:4294967295]
00000400:00000200:10.0:1773851859.590040:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 2
00000400:00000200:10.0:1773851859.590042:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19346@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.590046:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19346@kfi7(19346@kfi7:19346@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851859.590048:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 3
00000800:00000200:10.0:1773851859.590050:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851859.590052:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851859.590056:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851859.590060:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e Using peer 19346@kfi7(0x29e)
00000800:00000200:10.0:1773851859.590065:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000005269f40f: Posted send of 324 bytes to peer 0x29e: rc=0
00000800:00000200:10.0:1773851859.590067:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851859.590071:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.590072:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b967f1f1 refcount 2 to 19347@kfi7
00010000:00000001:10.0:1773851859.590074:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851859.590074:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.590076:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851859.590077:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009d0add5 x1858130041304896/t0(0) o400->823698e3-d597-4e2d-b28c-a878c6a13e1f@19347@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1702-0'
00000800:00000200:9.0:1773851859.590078:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851859.590080:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.590082:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19346@kfi7: PUT: OK
00000100:00100000:10.0:1773851859.590083:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009d0add5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:823698e3-d597-4e2d-b28c-a878c6a13e1f+6:39889:x1858130041304896:12345-19347@kfi7:400:default-tuolumne1702-0 Request processed in 103us (160us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851859.590083:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b1492f92
00000400:00000010:9.0:1773851859.590083:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b1492f92.
00000100:00000001:9.0:1773851859.590084:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851859.590085:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851859.590086:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9f2fc47 nid 19346@kfi7 refs 2
00000100:00100000:10.0:1773851859.590087:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19347@kfi7, seq: 2130743
00000800:00000200:9.0:1773851859.590087:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 19346@kfi7(00000000d1ef7f1c):0x0 lsk 671 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x29e Transaction freed
00000100:00000040:10.0:1773851859.590089:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f6dbde14 : new rpc_count 0
00000100:00000001:10.0:1773851859.590090:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851859.590092:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851859.590093:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851859.590094:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:10.0:1773851859.590095:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057130d88.
00000020:00000040:10.0:1773851859.590097:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000f6dbde14 : new refcount 5
00000100:00000001:10.0:1773851859.590098:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851859.631278:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851859.631278:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851859.631279:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851859.631280:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:3.0:1773851859.631281:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851859.631281:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:3.0:1773851859.631283:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851859.631284:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17217@kfi7(00000000c0afde38):0xc0f version: 2; local version 2; negotiated version: 2
00000400:00000200:3.0:1773851859.631286:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17217@kfi7 to cpt 0
00000800:00000200:1.0:1773851859.631286:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f Using peer 17217@kfi7(0x100000000000c0f)
00000400:00000200:3.0:1773851859.631287:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17217@kfi7 : PUT - for me
00000400:00000200:3.0:1773851859.631288:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17217@kfi7 to cpt 0
00000400:00000200:3.0:1773851859.631289:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 1
00000400:00000200:3.0:1773851859.631290:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17217@kfi7 to cpt 0
00000400:00000200:3.0:1773851859.631291:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 2
00000400:00000200:3.0:1773851859.631292:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 3
00000400:00000200:1.0:1773851859.631293:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17217@kfi7 to cpt 0
00000400:00000200:3.0:1773851859.631294:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17280@kfi7 to cpt 1
00000400:00000200:3.0:1773851859.631295:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17280@kfi7 of length 224 into portal 12 MB=0x699e098f7ac80
00000800:00000200:1.0:1773851859.631296:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 38 bytes to peer 0x100000000000c0f: rc=0
00000400:00000200:3.0:1773851859.631297:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17280@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 19168
00000800:00000200:1.0:1773851859.631297:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:3.0:1773851859.631299:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851859.631303:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851859.631304:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17217@kfi7: PUT: OK
00000100:00000001:3.0:1773851859.631306:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851859.631306:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851859.631307:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009621ded3.
00000100:00000040:3.0:1773851859.631308:0:2506738:0:(events.c:358:request_in_callback()) incoming req@000000009621ded3 x1858039778356352 msgsize 224
00000100:00100000:3.0:1773851859.631310:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-17280@kfi7 (source: 12345-17217@kfi7)
00000100:00000001:3.0:1773851859.631311:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:1.0:1773851859.631311:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f TN_EVENT_TX_OK event status 0
00000400:00000200:3.0:1773851859.631312:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 2
00000100:00000001:0.0:1773851859.631313:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851859.631313:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851859.631314:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851859.631314:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851859.631315:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851859.631316:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f Transaction freed
02000000:00000001:0.0:1773851859.631316:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851859.631316:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039778356352
00000020:00000001:0.0:1773851859.631318:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851859.631318:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d36
00000020:00000001:0.0:1773851859.631319:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851859.631321:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000088fcfb8a refcount=172
00000020:00000001:0.0:1773851859.631321:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239496704 : -107152470054912 : ffff9e8b9f15e800)
00000020:00000001:0.0:1773851859.631322:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239496704 : -107152470054912 : ffff9e8b9f15e800)
00000100:00000001:0.0:1773851859.631324:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.631324:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851859.631325:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004240f088.
00000020:00000010:0.0:1773851859.631326:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.631327:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851859.631328:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851859.631329:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851859.631329:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.631330:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851859.631331:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851859.631331:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.631332:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851859.631334:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.631334:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.631334:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851859.631335:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851859.631336:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17280@kfi7, seq: 1997518
00000100:00000040:0.0:1773851859.631336:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000088fcfb8a : new rpc_count 1
00000100:00000001:1.0:1773851859.631337:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.631337:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.631337:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288699008 : -106964420852608 : ffff9eb767b10480)
00000100:00000040:0.0:1773851859.631339:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009621ded3 x1858039778356352/t0(0) o400->9a6d27bd-980d-49de-a508-e9c3c8348818@17280@kfi7:499/0 lens 224/0 e 0 to 0 dl 1773852614 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1572-0'
00000100:00000001:0.0:1773851859.631342:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.631342:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851859.631343:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009621ded3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9a6d27bd-980d-49de-a508-e9c3c8348818+172:39611:x1858039778356352:12345-17280@kfi7:400:default-tuolumne1572-0
00000100:00000200:0.0:1773851859.631345:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039778356352
00000020:00000001:0.0:1773851859.631345:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851859.631346:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851859.631347:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.631349:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851859.631350:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851859.631351:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851859.631352:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039778356352, found 0 last_xid 1858039777932415
00000020:00000001:0.0:1773851859.631352:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851859.631353:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851859.631354:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851859.631355:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.631355:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851859.631356:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851859.631356:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851859.631357:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000572c181b.
02000000:00000001:0.0:1773851859.631358:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.631358:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.631359:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851859.631360:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062385, transno 0, xid 1858039778356352
00010000:00000001:0.0:1773851859.631361:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851859.631362:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009621ded3 x1858039778356352/t0(0) o400->9a6d27bd-980d-49de-a508-e9c3c8348818@17280@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1572-0'
00010000:00000001:0.0:1773851859.631364:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851859.631365:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851859.631366:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=92 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851859.631367:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851859.631368:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e26aab27 refcount 3 to 17280@kfi7
00000100:00000001:0.0:1773851859.631368:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701632 : -107156155849984 : ffff9e8ac3652300)
02000000:00000001:0.0:1773851859.631369:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851859.631370:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.631371:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851859.631371:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17217@kfi7
00000400:00000010:0.0:1773851859.631372:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003e3aad49.
00000100:00000200:0.0:1773851859.631373:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039778356352, offset 224
00000400:00000200:0.0:1773851859.631374:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17217@kfi7
00000400:00000200:0.0:1773851859.631375:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17217@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.631375:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 1
00000400:00000200:0.0:1773851859.631377:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 2
00000400:00000200:0.0:1773851859.631378:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 3
00000400:00000200:0.0:1773851859.631379:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17217@kfi7 local destination
00000400:00000200:0.0:1773851859.631381:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768849:8768849:1024:4294967295] 17217@kfi7 LPNI seq info [414653:414653:16:4294967295]
00000400:00000200:0.0:1773851859.631382:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 2
00000400:00000200:0.0:1773851859.631383:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17217@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.631385:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17217@kfi7(17217@kfi7:17217@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851859.631386:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 3
00000800:00000200:0.0:1773851859.631387:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851859.631388:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851859.631390:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851859.631393:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f Using peer 17217@kfi7(0x100000000000c0f)
00000800:00000200:0.0:1773851859.631395:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x100000000000c0f: rc=0
00000800:00000200:0.0:1773851859.631396:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851859.631398:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.631399:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e26aab27 refcount 2 to 17280@kfi7
00010000:00000001:0.0:1773851859.631400:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851859.631400:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.631401:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851859.631402:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009621ded3 x1858039778356352/t0(0) o400->9a6d27bd-980d-49de-a508-e9c3c8348818@17280@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1572-0'
00000100:00100000:0.0:1773851859.631406:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009621ded3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9a6d27bd-980d-49de-a508-e9c3c8348818+172:39611:x1858039778356352:12345-17280@kfi7:400:default-tuolumne1572-0 Request processed in 63us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851859.631408:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17280@kfi7, seq: 1997518
00000100:00000040:0.0:1773851859.631409:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000088fcfb8a : new rpc_count 0
00000100:00000001:0.0:1773851859.631410:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851859.631411:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851859.631411:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.631412:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851859.631413:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004240f088.
00000020:00000040:0.0:1773851859.631413:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000088fcfb8a : new refcount 171
00000100:00000001:0.0:1773851859.631414:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851859.631419:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851859.631420:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.631421:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17217@kfi7: PUT: OK
00000400:00000200:1.0:1773851859.631422:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003e3aad49
00000400:00000010:1.0:1773851859.631423:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003e3aad49.
00000100:00000001:1.0:1773851859.631423:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851859.631424:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851859.631425:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cd1e3e44 nid 17217@kfi7 refs 2
00000800:00000200:1.0:1773851859.631427:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 17217@kfi7(00000000c0afde38):0x0 lsk 3088 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c0f Transaction freed
00000800:00000200:1.0:1773851859.632186:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851859.632187:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851859.632188:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851859.632190:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851859.632192:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9745@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.632193:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9745@kfi7 : PUT - for me
00000400:00000200:1.0:1773851859.632194:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9745@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.632194:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2d618f5 nid 9745@kfi7 refs 1
00000400:00000200:1.0:1773851859.632195:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9745@kfi7 to cpt 0
00000400:00000200:1.0:1773851859.632196:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2d618f5 nid 9745@kfi7 refs 2
00000400:00000200:1.0:1773851859.632197:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2d618f5 nid 9745@kfi7 refs 3
00000400:00000200:1.0:1773851859.632198:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9744@kfi7 to cpt 5
00000400:00000200:1.0:1773851859.632199:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9744@kfi7 of length 224 into portal 12 MB=0x69b4b88829640
00000400:00000200:1.0:1773851859.632201:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9744@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 19392
00000800:00000200:1.0:1773851859.632202:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851859.632204:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.632205:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9745@kfi7: PUT: OK
00000100:00000001:1.0:1773851859.632206:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851859.632207:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851859.632207:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a7c6c431.
00000100:00000040:1.0:1773851859.632208:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a7c6c431 x1859598575375936 msgsize 224
00000100:00100000:1.0:1773851859.632210:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9744@kfi7 (source: 12345-9745@kfi7)
00000100:00000001:1.0:1773851859.632210:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851859.632211:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2d618f5 nid 9745@kfi7 refs 2
00000100:00000001:0.0:1773851859.632212:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851859.632212:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851859.632213:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851859.632213:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851859.632213:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851859.632214:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851859.632214:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598575375936
00000020:00000001:0.0:1773851859.632215:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851859.632215:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79f44
00000020:00000001:0.0:1773851859.632215:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851859.632218:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fc6088a0 refcount=166
00000020:00000001:0.0:1773851859.632219:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637048890763264 : -107024818788352 : ffff9ea957b1a800)
00000020:00000001:0.0:1773851859.632219:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637048890763264 : -107024818788352 : ffff9ea957b1a800)
00000100:00000001:0.0:1773851859.632220:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.632220:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851859.632221:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004240f088.
00000020:00000010:0.0:1773851859.632221:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.632222:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851859.632223:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851859.632223:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851859.632223:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851859.632224:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851859.632225:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851859.632225:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.632226:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851859.632227:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.632227:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851859.632227:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851859.632228:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851859.632228:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9744@kfi7, seq: 1997519
00000100:00000001:1.0:1773851859.632229:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.632229:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.632229:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fc6088a0 : new rpc_count 1
00000100:00000001:0.0:1773851859.632230:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064180673792 : -107009528877824 : ffff9eace70b2d00)
00000100:00000040:0.0:1773851859.632231:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a7c6c431 x1859598575375936/t0(0) o400->5bbf59c3-3a7b-432b-ad1a-26c0212771ba@9744@kfi7:499/0 lens 224/0 e 0 to 0 dl 1773852614 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1105-0'
00000100:00000001:0.0:1773851859.632233:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851859.632234:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851859.632235:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a7c6c431 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5bbf59c3-3a7b-432b-ad1a-26c0212771ba+166:39512:x1859598575375936:12345-9744@kfi7:400:default-tuolumne1105-0
00000100:00000200:0.0:1773851859.632236:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598575375936
00000020:00000001:0.0:1773851859.632236:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851859.632237:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851859.632237:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.632238:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851859.632238:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851859.632239:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851859.632239:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598575375936, found 0 last_xid 1859598574953471
00000020:00000001:0.0:1773851859.632240:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851859.632240:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851859.632241:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851859.632241:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.632242:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851859.632242:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851859.632243:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851859.632244:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c9147985.
02000000:00000001:0.0:1773851859.632244:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.632245:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.632245:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851859.632246:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062425, transno 0, xid 1859598575375936
00010000:00000001:0.0:1773851859.632246:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851859.632247:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a7c6c431 x1859598575375936/t0(0) o400->5bbf59c3-3a7b-432b-ad1a-26c0212771ba@9744@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1105-0'
00010000:00000001:0.0:1773851859.632249:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851859.632250:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851859.632250:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=92 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851859.632251:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851859.632252:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004a970e45 refcount 3 to 9744@kfi7
00000100:00000001:0.0:1773851859.632253:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096608 : -107139307455008 : ffff9e8eafa33de0)
02000000:00000001:0.0:1773851859.632254:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851859.632254:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.632255:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851859.632256:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9745@kfi7
00000400:00000010:0.0:1773851859.632256:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af09dc10.
00000100:00000200:0.0:1773851859.632257:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598575375936, offset 224
00000400:00000200:0.0:1773851859.632258:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9745@kfi7
00000400:00000200:0.0:1773851859.632259:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9745@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.632259:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2d618f5 nid 9745@kfi7 refs 1
00000400:00000200:0.0:1773851859.632260:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2d618f5 nid 9745@kfi7 refs 2
00000400:00000200:0.0:1773851859.632261:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2d618f5 nid 9745@kfi7 refs 3
00000400:00000200:0.0:1773851859.632262:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9745@kfi7 local destination
00000400:00000200:0.0:1773851859.632264:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768850:8768850:1024:4294967295] 9745@kfi7 LPNI seq info [5787453:5787453:16:4294967295]
00000400:00000200:0.0:1773851859.632265:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2d618f5 nid 9745@kfi7 refs 2
00000400:00000200:0.0:1773851859.632266:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9745@kfi7 to cpt 0
00000400:00000200:0.0:1773851859.632267:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9745@kfi7(9745@kfi7:9745@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851859.632268:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2d618f5 nid 9745@kfi7 refs 3
00000800:00000200:0.0:1773851859.632270:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851859.632270:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851859.632272:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851859.632275:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x755 Using peer 9745@kfi7(0x755)
00000800:00000200:0.0:1773851859.632277:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x755: rc=0
00000800:00000200:0.0:1773851859.632279:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x755 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851859.632280:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851859.632282:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004a970e45 refcount 2 to 9744@kfi7
00010000:00000001:0.0:1773851859.632282:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851859.632282:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851859.632283:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851859.632284:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a7c6c431 x1859598575375936/t0(0) o400->5bbf59c3-3a7b-432b-ad1a-26c0212771ba@9744@kfi7:499/0 lens 224/224 e 0 to 0 dl 1773852614 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1105-0'
00000100:00100000:0.0:1773851859.632287:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a7c6c431 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5bbf59c3-3a7b-432b-ad1a-26c0212771ba+166:39512:x1859598575375936:12345-9744@kfi7:400:default-tuolumne1105-0 Request processed in 53us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851859.632289:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9744@kfi7, seq: 1997519
00000100:00000040:0.0:1773851859.632290:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fc6088a0 : new rpc_count 0
00000100:00000001:0.0:1773851859.632291:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851859.632291:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851859.632291:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851859.632292:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851859.632293:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004240f088.
00000020:00000040:0.0:1773851859.632293:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000fc6088a0 : new refcount 165
00000100:00000001:0.0:1773851859.632294:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851859.632298:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x755 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851859.632300:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851859.632301:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9745@kfi7: PUT: OK
00000400:00000200:1.0:1773851859.632302:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af09dc10
00000400:00000010:1.0:1773851859.632303:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af09dc10.
00000100:00000001:1.0:1773851859.632303:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851859.632303:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851859.632304:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2d618f5 nid 9745@kfi7 refs 2
00000800:00000200:1.0:1773851859.632306:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 9745@kfi7(00000000da4d60e8):0x0 lsk 1878 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x755 Transaction freed
00000800:00000200:17.0:1773851859.650364:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851859.650365:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851859.650366:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851859.650368:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851859.650369:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16289@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.650370:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16289@kfi7 : PUT - for me
00000400:00000200:17.0:1773851859.650371:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16289@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.650372:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000895e6ee nid 16289@kfi7 refs 1
00000400:00000200:17.0:1773851859.650373:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16289@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.650374:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000895e6ee nid 16289@kfi7 refs 2
00000400:00000200:17.0:1773851859.650375:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000895e6ee nid 16289@kfi7 refs 3
00000400:00000200:17.0:1773851859.650375:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16224@kfi7 to cpt 6
00000400:00000200:17.0:1773851859.650376:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16224@kfi7 of length 224 into portal 12 MB=0x69b4b7319dbc0
00000400:00000200:17.0:1773851859.650378:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16224@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 194336
00000800:00000200:17.0:1773851859.650379:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851859.650381:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851859.650382:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16289@kfi7: PUT: OK
00000100:00000001:17.0:1773851859.650382:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851859.650383:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851859.650384:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a9b42d8.
00000100:00000040:17.0:1773851859.650384:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000004a9b42d8 x1859598216190912 msgsize 224
00000100:00100000:17.0:1773851859.650386:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16224@kfi7 (source: 12345-16289@kfi7)
00000100:00000001:17.0:1773851859.650387:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851859.650388:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000895e6ee nid 16289@kfi7 refs 2
00000100:00000001:19.0:1773851859.650389:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851859.650389:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851859.650389:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851859.650390:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851859.650390:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851859.650391:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851859.650392:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598216190912
00000020:00000001:19.0:1773851859.650392:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851859.650393:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d811d6
00000020:00000001:19.0:1773851859.650393:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851859.650395:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006c91a4e5 refcount=167
00000020:00000001:19.0:1773851859.650396:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143294829568 : -106930414722048 : ffff9ebf529d6400)
00000020:00000001:19.0:1773851859.650397:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143294829568 : -106930414722048 : ffff9ebf529d6400)
00000100:00000001:19.0:1773851859.650398:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851859.650398:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851859.650399:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851859.650400:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851859.650401:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851859.650401:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851859.650402:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851859.650402:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851859.650403:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851859.650404:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851859.650404:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.650405:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851859.650407:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851859.650407:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851859.650407:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851859.650408:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16224@kfi7, seq: 2156280
00000100:00000001:18.0:1773851859.650408:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851859.650409:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006c91a4e5 : new rpc_count 1
00000100:00000001:18.0:1773851859.650409:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.650410:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764337920 : -107095945213696 : ffff9e98c83a8900)
00000100:00000001:18.0:1773851859.650410:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851859.650411:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a9b42d8 x1859598216190912/t0(0) o400->69079148-1c62-4a2b-9d73-dd3130b7ca93@16224@kfi7:49/0 lens 224/0 e 0 to 0 dl 1773852164 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1504-0'
00000100:00000001:19.0:1773851859.650414:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851859.650414:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851859.650415:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a9b42d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:69079148-1c62-4a2b-9d73-dd3130b7ca93+167:39533:x1859598216190912:12345-16224@kfi7:400:default-tuolumne1504-0
00000100:00000200:19.0:1773851859.650416:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598216190912
00000020:00000001:19.0:1773851859.650417:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851859.650417:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851859.650418:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.650419:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851859.650419:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851859.650420:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851859.650421:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598216190912, found 0 last_xid 1859598215767807
00000020:00000001:19.0:1773851859.650421:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851859.650422:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851859.650422:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851859.650423:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.650424:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851859.650424:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851859.650425:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851859.650425:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000583a54c2.
02000000:00000001:19.0:1773851859.650426:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.650426:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.650427:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851859.650428:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062561, transno 0, xid 1859598216190912
00010000:00000001:19.0:1773851859.650428:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851859.650429:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a9b42d8 x1859598216190912/t0(0) o400->69079148-1c62-4a2b-9d73-dd3130b7ca93@16224@kfi7:49/0 lens 224/224 e 0 to 0 dl 1773852164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1504-0'
00010000:00000001:19.0:1773851859.650434:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851859.650434:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851859.650435:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=92 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851859.650436:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851859.650437:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000033cd6e22 refcount 3 to 16224@kfi7
00000100:00000001:19.0:1773851859.650437:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420320 : -107156724131296 : ffff9e8aa185da20)
02000000:00000001:19.0:1773851859.650438:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851859.650439:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.650439:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851859.650440:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16289@kfi7
00000400:00000010:19.0:1773851859.650441:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9adaa40.
00000100:00000200:19.0:1773851859.650442:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598216190912, offset 224
00000400:00000200:19.0:1773851859.650443:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16289@kfi7
00000400:00000200:19.0:1773851859.650444:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16289@kfi7 to cpt 4
00000400:00000200:19.0:1773851859.650444:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000895e6ee nid 16289@kfi7 refs 1
00000400:00000200:19.0:1773851859.650445:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000895e6ee nid 16289@kfi7 refs 2
00000400:00000200:19.0:1773851859.650446:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000895e6ee nid 16289@kfi7 refs 3
00000400:00000200:19.0:1773851859.650448:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16289@kfi7 local destination
00000400:00000200:19.0:1773851859.650449:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768851:8768851:1024:4294967295] 16289@kfi7 LPNI seq info [197841:197841:16:4294967295]
00000400:00000200:19.0:1773851859.650450:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000895e6ee nid 16289@kfi7 refs 2
00000400:00000200:19.0:1773851859.650451:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16289@kfi7 to cpt 4
00000400:00000200:19.0:1773851859.650453:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16289@kfi7(16289@kfi7:16289@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851859.650454:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000895e6ee nid 16289@kfi7 refs 3
00000800:00000200:19.0:1773851859.650455:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851859.650456:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851859.650458:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851859.650460:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb42 Using peer 16289@kfi7(0xb42)
00000800:00000200:19.0:1773851859.650465:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0xb42: rc=0
00000800:00000200:19.0:1773851859.650466:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb42 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851859.650468:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851859.650469:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000033cd6e22 refcount 2 to 16224@kfi7
00010000:00000001:19.0:1773851859.650470:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851859.650470:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.650471:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851859.650471:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a9b42d8 x1859598216190912/t0(0) o400->69079148-1c62-4a2b-9d73-dd3130b7ca93@16224@kfi7:49/0 lens 224/224 e 0 to 0 dl 1773852164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1504-0'
00000100:00100000:19.0:1773851859.650474:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a9b42d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:69079148-1c62-4a2b-9d73-dd3130b7ca93+167:39533:x1859598216190912:12345-16224@kfi7:400:default-tuolumne1504-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851859.650476:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16224@kfi7, seq: 2156280
00000100:00000040:19.0:1773851859.650477:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006c91a4e5 : new rpc_count 0
00000100:00000001:19.0:1773851859.650478:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851859.650478:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851859.650478:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb42 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851859.650479:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851859.650479:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000020:00000010:19.0:1773851859.650480:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000020:00000040:19.0:1773851859.650481:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000006c91a4e5 : new refcount 166
00000100:00000001:19.0:1773851859.650481:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851859.650481:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851859.650482:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16289@kfi7: PUT: OK
00000400:00000200:17.0:1773851859.650483:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9adaa40
00000400:00000010:17.0:1773851859.650483:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9adaa40.
00000100:00000001:17.0:1773851859.650484:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851859.650485:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851859.650485:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000895e6ee nid 16289@kfi7 refs 2
00000800:00000200:17.0:1773851859.650487:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 16289@kfi7(0000000034047774):0x0 lsk 2883 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb42 Transaction freed
00000004:00000001:8.0:1773851859.785730:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851859.785731:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851859.785731:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851859.785732:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851859.785732:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:28.0:1773851859.785732:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851859.785732:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000861b9c78.
00000004:00000001:4.0:1773851859.785732:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:29.0:1773851859.785733:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5bb58f1.
00000100:00000010:28.0:1773851859.785733:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8e8c6f3.
00000020:00000040:8.0:1773851859.785733:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
00000004:00000001:6.0:1773851859.785733:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:4.0:1773851859.785733:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:0.0:1773851859.785733:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:29.0:1773851859.785734:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:8.0:1773851859.785734:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851859.785734:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:6.0:1773851859.785734:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:4.0:1773851859.785734:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001dbca77d.
00000004:00000020:0.0:1773851859.785734:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:29.0:1773851859.785735:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851859.785735:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:28.0:1773851859.785735:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
02000000:00000001:8.0:1773851859.785735:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:6.0:1773851859.785735:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f45454b.
00000020:00000040:4.0:1773851859.785735:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000100:00000010:0.0:1773851859.785735:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e0c8b8fc.
02000000:00000001:29.0:1773851859.785736:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.785736:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:8.0:1773851859.785736:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000020:00000040:0.0:1773851859.785736:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
02000000:00000010:29.0:1773851859.785737:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
02000000:00000001:28.0:1773851859.785737:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851859.785737:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:6.0:1773851859.785737:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000100:00000001:4.0:1773851859.785737:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851859.785738:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851859.785738:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851859.785738:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851859.785738:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851859.785738:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:0.0:1773851859.785738:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851859.785739:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:8.0:1773851859.785739:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851859.785739:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851859.785739:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851859.785739:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:0.0:1773851859.785739:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851859.785740:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851859.785740:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000861b9c78] to pc [ptlrpcd_02_00+0]  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:4.0:1773851859.785740:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000869d922.
00000100:00000040:29.0:1773851859.785741:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c5bb58f1] to pc [ptlrpcd_07_02+2]  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:28.0:1773851859.785741:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000018dd4826.
02000000:00000001:6.0:1773851859.785741:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.785741:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851859.785741:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000053550efe.
00000100:00000001:28.0:1773851859.785742:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851859.785742:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006fe63e6d.
00000100:00000001:4.0:1773851859.785742:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:0.0:1773851859.785742:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851859.785743:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851859.785743:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851859.785744:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851859.785744:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851859.785744:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001dbca77d] to pc [ptlrpcd_01_00+0]  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851859.785744:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851859.785745:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851859.785745:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:6.0:1773851859.785745:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:0.0:1773851859.785745:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e0c8b8fc] to pc [ptlrpcd_00_02+2]  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851859.785746:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851859.785746:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000001f164fb.
00080000:00000001:8.0:1773851859.785746:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636993072366592 : -107080637185024 : ffff9e9c58a88400)
00000100:00000040:28.0:1773851859.785747:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b8e8c6f3] to pc [ptlrpcd_07_03+3]  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851859.785747:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851859.785747:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851859.785747:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851859.785747:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.785747:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851859.785748:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851859.785748:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851859.785748:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:8.0:1773851859.785748:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851859.785748:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000008f45454b] to pc [ptlrpcd_01_01+1]  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:8.0:1773851859.785749:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000100:00000001:5.0:1773851859.785749:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:4.0:1773851859.785749:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851859.785750:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000010:8.0:1773851859.785750:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a6b19c62.
00000100:00000001:5.0:1773851859.785750:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000001:0.0:1773851859.785750:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785751:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851859.785751:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785751:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00080000:8.0:1773851859.785751:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614134239026617ns, next at 614135239025244ns, rc = 0
00000100:00000001:5.0:1773851859.785751:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:4.0:1773851859.785751:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000007e3989c4.
00080000:00000001:4.0:1773851859.785751:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637165032885248 : -106908676666368 : ffff9ec4624dcc00)
00000100:00000001:1.0:1773851859.785751:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851859.785752:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851859.785752:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:8.0:1773851859.785752:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:7.0:1773851859.785752:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:5.0:1773851859.785752:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851859.785752:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851859.785752:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.785752:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851859.785752:0:41062:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:30.0:1773851859.785753:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851859.785753:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851859.785753:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851859.785753:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851859.785753:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851859.785754:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:28.0:1773851859.785754:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:11.0:1773851859.785754:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851859.785754:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851859.785754:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.785754:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:6.0:1773851859.785754:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:4.0:1773851859.785754:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851859.785754:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851859.785755:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:11.0:1773851859.785755:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000861b9c78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051925248:2055@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851859.785755:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851859.785755:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851859.785755:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:4.0:1773851859.785755:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000100:00000001:31.0:1773851859.785756:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:28.0:1773851859.785756:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000001529c0f6.
00000100:00000001:7.0:1773851859.785756:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:6.0:1773851859.785756:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ecbfdd48.
02000000:00000001:5.0:1773851859.785756:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:4.0:1773851859.785756:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000053d71ce6.
00000004:00080000:4.0:1773851859.785756:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614134239032087ns, next at 614135239031145ns, rc = 0
00000100:00000001:30.0:1773851859.785757:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851859.785757:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851859.785757:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637131813889024 : -106941895662592 : ffff9ebca64c2400)
00000100:00000001:11.0:1773851859.785757:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:5.0:1773851859.785757:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851859.785758:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851859.785758:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:11.0:1773851859.785758:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851859.785758:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.785758:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851859.785758:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637122736871424 : -106950972680192 : ffff9eba8943d800)
00000100:00100000:5.0:1773851859.785758:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001dbca77d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051925376:2085@kfi7:13:default-yuba2-0
00080000:00000001:4.0:1773851859.785758:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:30.0:1773851859.785759:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851859.785759:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:11.0:1773851859.785759:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:5.0:1773851859.785759:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:4.0:1773851859.785759:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851859.785759:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851859.785760:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5bb58f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051925312:2056@kfi7:13:default-yuba2-0
02000000:00000010:11.0:1773851859.785760:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006e24c5d2.
02000000:00000001:11.0:1773851859.785760:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851859.785760:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:5.0:1773851859.785760:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851859.785760:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785761:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851859.785761:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:28.0:1773851859.785761:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851859.785761:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851859.785762:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851859.785762:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851859.785762:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851859.785762:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000400:00000200:11.0:1773851859.785762:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00080000:00000001:6.0:1773851859.785762:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851859.785762:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000031de34ed.
00000100:00000001:1.0:1773851859.785762:0:41062:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:31.0:1773851859.785763:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851859.785763:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851859.785763:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000010:28.0:1773851859.785763:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000090630051.
00000400:00000010:11.0:1773851859.785763:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000100:00000001:7.0:1773851859.785763:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:6.0:1773851859.785763:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
02000000:00000001:5.0:1773851859.785763:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.785763:0:41062:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851859.785763:0:41062:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:31.0:1773851859.785764:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b8e8c6f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051925504:2065@kfi7:13:default-yuba2-0
02000000:00000010:30.0:1773851859.785764:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005e1a67ac.
02000000:00000001:30.0:1773851859.785764:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851859.785764:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000177f1aa0.
00000100:00000001:7.0:1773851859.785764:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:6.0:1773851859.785764:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000af05def7.
00000400:00000200:5.0:1773851859.785764:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000010:5.0:1773851859.785764:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000044a0e143.
02000000:00000001:1.0:1773851859.785764:0:41062:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:28.0:1773851859.785765:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614134239040373ns, next at 614135239038409ns, rc = 0
00000100:00000200:11.0:1773851859.785765:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925248, portal 4
02000000:00000001:7.0:1773851859.785765:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:5.0:1773851859.785765:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000a4ed2b3.
00000100:00100000:1.0:1773851859.785765:0:41062:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e0c8b8fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051925440:2057@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851859.785766:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:30.0:1773851859.785766:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000010:30.0:1773851859.785766:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000001:11.0:1773851859.785766:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:7.0:1773851859.785766:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851859.785766:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614134239041575ns, next at 614135239039491ns, rc = 0
00000100:00000200:5.0:1773851859.785766:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925376, portal 4
02000000:00000001:31.0:1773851859.785767:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851859.785767:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851859.785767:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00080000:00000001:28.0:1773851859.785767:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:11.0:1773851859.785767:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491257472 : -107117218294144 : ffff9e93d4411680)
00000100:00000001:5.0:1773851859.785767:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:1.0:1773851859.785767:0:41062:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851859.785768:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:28.0:1773851859.785768:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.785768:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008f45454b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051925568:46@kfi7:13:default-yuba2-0
00080000:00000001:6.0:1773851859.785768:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:5.0:1773851859.785768:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528715648 : -106978180835968 : ffff9eb433885580)
02000000:00000001:1.0:1773851859.785768:0:41062:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:1.0:1773851859.785768:0:41062:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851859.785769:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ce89abbc.
02000000:00000001:31.0:1773851859.785769:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851859.785769:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925312, portal 4
00000100:00000001:30.0:1773851859.785769:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000004:00000001:28.0:1773851859.785769:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851859.785769:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851859.785769:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:1.0:1773851859.785769:0:41062:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:30.0:1773851859.785770:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637125221532544 : -106948488019072 : ffff9ebb1d5cc380)
00000100:00000001:7.0:1773851859.785770:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:6.0:1773851859.785770:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:1.0:1773851859.785770:0:41062:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003ef8b576.
00000400:00000200:31.0:1773851859.785771:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000010:31.0:1773851859.785771:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000100:00000040:30.0:1773851859.785771:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851859.785771:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:7.0:1773851859.785771:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851859.785771:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.785771:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851859.785771:0:41062:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851859.785772:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000eb85f77.
00000100:00000001:5.0:1773851859.785772:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:1.0:1773851859.785772:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000200:31.0:1773851859.785773:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925504, portal 4
00000100:00000040:11.0:1773851859.785773:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000010:11.0:1773851859.785773:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d7cd332.
02000000:00000001:7.0:1773851859.785773:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:5.0:1773851859.785773:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000010:5.0:1773851859.785773:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008cc726fa.
00000400:00000010:1.0:1773851859.785773:0:41062:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001712706d.
00000100:00000001:31.0:1773851859.785774:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851859.785774:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:11.0:1773851859.785774:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925248, offset 0
02000000:00000010:7.0:1773851859.785774:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000053a6c80b.
00000400:00000010:1.0:1773851859.785774:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f672ead.
00000100:00000001:31.0:1773851859.785775:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324220928 : -106976385330688 : ffff9eb49e8d9200)
00000100:00000040:30.0:1773851859.785775:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
02000000:00000001:7.0:1773851859.785775:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851859.785775:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925376, offset 0
00000100:00000200:1.0:1773851859.785775:0:41062:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925440, portal 4
00000100:00000040:31.0:1773851859.785776:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851859.785776:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000927f3e9e.
00000100:00000200:30.0:1773851859.785776:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925312, offset 0
00000400:00000200:11.0:1773851859.785776:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000100:00000001:1.0:1773851859.785776:0:41062:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:11.0:1773851859.785777:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851859.785777:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:5.0:1773851859.785777:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000100:00000001:1.0:1773851859.785777:0:41062:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203084032 : -107102506467584 : ffff9e974125bf00)
00000400:00000200:30.0:1773851859.785778:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000200:11.0:1773851859.785778:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000010:7.0:1773851859.785778:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000400:00000200:5.0:1773851859.785778:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000040:1.0:1773851859.785778:0:41062:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851859.785779:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851859.785779:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000010:7.0:1773851859.785779:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f88013b1.
00000400:00000200:5.0:1773851859.785779:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000040:31.0:1773851859.785780:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000200:30.0:1773851859.785780:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:11.0:1773851859.785780:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000010:31.0:1773851859.785781:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025a37126.
00000100:00000200:31.0:1773851859.785781:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925504, offset 0
00000400:00000200:30.0:1773851859.785781:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000200:7.0:1773851859.785781:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925568, portal 4
00000400:00000200:5.0:1773851859.785781:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:1.0:1773851859.785781:0:41062:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851859.785782:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000400:00000200:11.0:1773851859.785782:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000100:00000001:7.0:1773851859.785782:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851859.785782:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637123260371200 : -106950449180416 : ffff9ebaa877d100)
00000400:00000200:5.0:1773851859.785782:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000040:1.0:1773851859.785782:0:41062:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000010:1.0:1773851859.785782:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000237c3343.
00000400:00000200:30.0:1773851859.785783:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:11.0:1773851859.785783:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:5.0:1773851859.785783:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000100:00000200:1.0:1773851859.785783:0:41062:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925440, offset 0
00000400:00000200:30.0:1773851859.785784:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000100:00000040:7.0:1773851859.785785:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851859.785785:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768851, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768849, p:4294967295, g:4294967295, h:1000]
00000400:00000200:1.0:1773851859.785785:0:41062:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:30.0:1773851859.785786:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768851, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768849, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851859.785786:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768851, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768849, p:4294967295, g:4294967295, h:1000]
00000400:00000200:1.0:1773851859.785786:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:1.0:1773851859.785787:0:41062:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:11.0:1773851859.785788:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:5.0:1773851859.785788:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:1.0:1773851859.785788:0:41062:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:30.0:1773851859.785789:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:11.0:1773851859.785789:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:7.0:1773851859.785789:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:5.0:1773851859.785789:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:1.0:1773851859.785789:0:41062:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:30.0:1773851859.785790:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851859.785790:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:30.0:1773851859.785791:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000400:00000200:11.0:1773851859.785791:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000100:00000040:7.0:1773851859.785791:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000010:7.0:1773851859.785791:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000045c9ef1.
00000400:00000200:5.0:1773851859.785791:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768852:8768852:1024:4294967295] 2085@kfi7 LPNI seq info [5403238:5403238:16:4294967295]
00000400:00000200:1.0:1773851859.785791:0:41062:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:30.0:1773851859.785792:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768854:8768854:1024:4294967295] 2056@kfi7 LPNI seq info [5402398:5402398:16:4294967295]
00000400:00000200:11.0:1773851859.785792:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768854:8768854:1024:4294967295] 2055@kfi7 LPNI seq info [5404668:5404668:16:4294967295]
00000100:00000200:7.0:1773851859.785793:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925568, offset 0
00000400:00000200:5.0:1773851859.785793:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:1.0:1773851859.785793:0:41062:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768851, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768854, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851859.785794:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:5.0:1773851859.785794:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:30.0:1773851859.785795:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:11.0:1773851859.785795:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:7.0:1773851859.785795:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000200:1.0:1773851859.785795:0:41062:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851859.785796:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:11.0:1773851859.785796:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:1.0:1773851859.785796:0:41062:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851859.785797:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:5.0:1773851859.785797:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851859.785797:0:41062:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:5.0:1773851859.785798:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851859.785798:0:41062:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768855:8768855:1024:4294967295] 2057@kfi7 LPNI seq info [5404105:5404105:16:4294967295]
00000400:00000200:31.0:1773851859.785799:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:11.0:1773851859.785799:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851859.785800:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:7.0:1773851859.785800:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:5.0:1773851859.785800:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:1.0:1773851859.785800:0:41062:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:11.0:1773851859.785801:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:7.0:1773851859.785801:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000800:00000200:5.0:1773851859.785801:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:1.0:1773851859.785801:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:31.0:1773851859.785802:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000400:00000200:31.0:1773851859.785803:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768855, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8768854, p:4294967295, g:4294967295, h:1000]
00000800:00000200:11.0:1773851859.785803:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:7.0:1773851859.785803:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:5.0:1773851859.785804:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851859.785805:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851859.785805:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:1.0:1773851859.785805:0:41062:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851859.785806:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851859.785806:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000800:00000200:5.0:1773851859.785806:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Using peer 2085@kfi7(0x200000000000110)
00000400:00000200:31.0:1773851859.785807:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851859.785807:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000400:00000200:1.0:1773851859.785807:0:41062:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:31.0:1773851859.785808:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000400:00000200:30.0:1773851859.785808:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000800:00000200:11.0:1773851859.785808:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:31.0:1773851859.785809:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768856:8768856:1023:4294967295] 2065@kfi7 LPNI seq info [5402827:5402827:16:4294967295]
00000800:00000200:1.0:1773851859.785809:0:41062:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:30.0:1773851859.785810:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:11.0:1773851859.785810:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000400:00000200:7.0:1773851859.785810:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768856, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8768854, p:4294967295, g:4294967295, h:1000]
00000800:00000200:5.0:1773851859.785810:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 324 bytes to peer 0x200000000000110: rc=0
00000400:00000200:31.0:1773851859.785811:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:5.0:1773851859.785811:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:1.0:1773851859.785811:0:41062:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851859.785812:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:30.0:1773851859.785812:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851859.785813:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:5.0:1773851859.785813:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851859.785814:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851859.785814:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851859.785814:0:41062:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:31.0:1773851859.785815:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000800:00000200:30.0:1773851859.785815:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851859.785815:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000400:00000200:7.0:1773851859.785815:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:5.0:1773851859.785815:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851859.785816:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000100:00000001:5.0:1773851859.785816:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851859.785817:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000800:00000200:30.0:1773851859.785817:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000800:00000200:11.0:1773851859.785817:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851859.785817:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:1.0:1773851859.785817:0:41062:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000400:00000200:7.0:1773851859.785818:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768857:8768857:1022:4294967295] 46@kfi7 LPNI seq info [5403856:5403856:16:4294967295]
00000100:00000001:5.0:1773851859.785818:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:31.0:1773851859.785819:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:11.0:1773851859.785819:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.785819:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851859.785819:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851859.785819:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851859.785819:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.785820:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851859.785820:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:5.0:1773851859.785820:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851859.785821:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851859.785821:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bfd826e8: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000100:00000001:11.0:1773851859.785821:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851859.785821:0:41062:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 324 bytes to peer 0x295: rc=0
00000100:00000001:11.0:1773851859.785822:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851859.785822:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:1.0:1773851859.785822:0:41062:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851859.785823:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851859.785823:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851859.785823:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:5.0:1773851859.785823:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_EVENT_TX_OK event status 0
00000800:00000200:31.0:1773851859.785824:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:5.0:1773851859.785824:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851859.785824:0:41062:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785825:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851859.785825:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851859.785825:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000001:1.0:1773851859.785825:0:41062:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:31.0:1773851859.785826:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Using peer 2065@kfi7(0x5e8)
00000100:00000001:30.0:1773851859.785826:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851859.785826:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851859.785826:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008cc726fa
00000100:00000001:1.0:1773851859.785826:0:41062:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785827:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.785827:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851859.785827:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851859.785827:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000010:5.0:1773851859.785827:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008cc726fa.
00000100:00000001:5.0:1773851859.785827:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:1.0:1773851859.785827:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785828:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785828:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.785828:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851859.785828:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851859.785828:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851859.785829:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851859.785829:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:31.0:1773851859.785830:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x5e8: rc=0
00000100:00000001:30.0:1773851859.785830:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851859.785830:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:9.0:1773851859.785830:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000800:00000200:7.0:1773851859.785830:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:5.0:1773851859.785830:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:1.0:1773851859.785830:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851859.785831:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:7.0:1773851859.785831:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:5.0:1773851859.785831:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851859.785831:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851859.785831:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851859.785832:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851859.785832:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851859.785832:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851859.785832:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851859.785832:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785833:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851859.785833:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.785833:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785834:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851859.785834:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d7cd332
00000100:00000001:5.0:1773851859.785834:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.785834:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:31.0:1773851859.785835:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851859.785835:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000400:00000010:9.0:1773851859.785835:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d7cd332.
00000100:00000001:9.0:1773851859.785835:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:7.0:1773851859.785835:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851859.785835:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851859.785836:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785836:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851859.785836:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851859.785836:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Transaction freed
00000100:00000001:31.0:1773851859.785837:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851859.785837:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851859.785837:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851859.785838:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851859.785838:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851859.785839:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851859.785839:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851859.785839:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851859.785839:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000400:00000200:29.0:1773851859.785839:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000927f3e9e
00000100:00000001:9.0:1773851859.785839:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:7.0:1773851859.785839:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000400:00000200:2.0:1773851859.785839:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000100:00000001:31.0:1773851859.785840:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851859.785840:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851859.785840:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000237c3343
00000400:00000010:2.0:1773851859.785840:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000237c3343.
00000400:00000010:29.0:1773851859.785841:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000927f3e9e.
00000100:00000001:29.0:1773851859.785841:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:2.0:1773851859.785841:0:2506505:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:2.0:1773851859.785842:0:2506505:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851859.785843:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851859.785843:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851859.785843:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:7.0:1773851859.785844:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x3df: rc=0
00000800:00000200:30.0:1773851859.785845:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851859.785845:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:9.0:1773851859.785845:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:2.0:1773851859.785845:0:2506505:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:9.0:1773851859.785846:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Transaction freed
00000800:00000200:7.0:1773851859.785846:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:2.0:1773851859.785846:0:2506505:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851859.785847:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:29.0:1773851859.785847:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851859.785848:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000400:00000200:30.0:1773851859.785849:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025a37126
00000100:00000001:29.0:1773851859.785849:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851859.785849:0:2506505:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851859.785849:0:2506505:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:30.0:1773851859.785850:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025a37126.
00000100:00000001:30.0:1773851859.785850:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851859.785850:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:7.0:1773851859.785850:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851859.785850:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000200:30.0:1773851859.785851:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851859.785851:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:7.0:1773851859.785851:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851859.785852:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851859.785852:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000800:00000200:29.0:1773851859.785853:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Transaction freed
00000100:00000001:7.0:1773851859.785853:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785854:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851859.785854:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851859.785855:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.785855:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851859.785856:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851859.785857:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785857:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:7.0:1773851859.785857:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851859.785858:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:7.0:1773851859.785858:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851859.785858:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:7.0:1773851859.785859:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851859.785859:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851859.785860:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Transaction freed
00000100:00000001:7.0:1773851859.785860:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851859.785861:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851859.785861:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.785863:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851859.785864:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.785864:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.785866:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000400:00000200:5.0:1773851859.785866:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2085@kfi7 : PUT - for me
00000400:00000200:6.0:1773851859.785867:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000045c9ef1
00000400:00000200:5.0:1773851859.785867:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.785867:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000010:6.0:1773851859.785868:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000045c9ef1.
00000400:00000200:5.0:1773851859.785868:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:6.0:1773851859.785869:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:2.0:1773851859.785869:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:5.0:1773851859.785870:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:5.0:1773851859.785870:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000800:00000200:2.0:1773851859.785870:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:6.0:1773851859.785871:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851859.785871:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:2.0:1773851859.785871:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.785873:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2b80
00000800:00000200:2.0:1773851859.785873:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.785874:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:13.0:1773851859.785875:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:5.0:1773851859.785875:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b304e5 [1] + 224
00000400:00000200:2.0:1773851859.785875:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:13.0:1773851859.785876:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851859.785877:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.785877:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851859.785877:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.785878:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851859.785878:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:21.0:1773851859.785879:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:2.0:1773851859.785879:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000800:00000200:21.0:1773851859.785880:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851859.785880:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000400:00000200:2.0:1773851859.785880:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:13.0:1773851859.785881:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:6.0:1773851859.785881:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:2.0:1773851859.785881:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:21.0:1773851859.785882:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:6.0:1773851859.785882:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851859.785882:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:13.0:1773851859.785883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:5.0:1773851859.785883:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:17.0:1773851859.785884:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000200:5.0:1773851859.785884:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851859.785884:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:21.0:1773851859.785885:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851859.785885:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851859.785885:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000200:2.0:1773851859.785885:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2b40
00000100:00000001:6.0:1773851859.785886:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851859.785886:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:17.0:1773851859.785887:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851859.785887:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:6.0:1773851859.785887:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:5.0:1773851859.785887:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851859.785888:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:13.0:1773851859.785888:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:2.0:1773851859.785888:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71d0a1 [1] + 224
00000400:00000200:13.0:1773851859.785889:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:6.0:1773851859.785889:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:21.0:1773851859.785890:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000800:00000200:17.0:1773851859.785890:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851859.785890:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:5.0:1773851859.785890:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851859.785891:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:13.0:1773851859.785891:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:5.0:1773851859.785891:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:2.0:1773851859.785891:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851859.785892:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:13.0:1773851859.785892:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:6.0:1773851859.785892:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000400:00000200:2.0:1773851859.785892:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851859.785893:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:5.0:1773851859.785893:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000200:21.0:1773851859.785894:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.785894:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:17.0:1773851859.785894:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:13.0:1773851859.785894:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2bc0
00000400:00000200:2.0:1773851859.785894:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000400:00000200:21.0:1773851859.785895:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:13.0:1773851859.785895:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:5.0:1773851859.785895:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851859.785895:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851859.785896:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:5.0:1773851859.785896:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:5.0:1773851859.785896:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:2.0:1773851859.785896:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851859.785897:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:17.0:1773851859.785897:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:13.0:1773851859.785897:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f5aad [1] + 224
00000400:00000001:5.0:1773851859.785897:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:5.0:1773851859.785897:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000044a0e143.
00000400:00000200:21.0:1773851859.785898:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2b00
00000400:00000200:17.0:1773851859.785898:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:5.0:1773851859.785898:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000a4ed2b3
00000400:00000010:5.0:1773851859.785898:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000a4ed2b3.
00000400:00000200:17.0:1773851859.785899:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:5.0:1773851859.785899:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:2.0:1773851859.785899:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851859.785900:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:17.0:1773851859.785900:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000800:00000200:13.0:1773851859.785900:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:5.0:1773851859.785900:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851859.785901:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:21.0:1773851859.785902:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d07d5 [1] + 224
00000400:00000200:17.0:1773851859.785902:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2c00
00000400:00000200:13.0:1773851859.785902:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.785903:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000100:00000200:5.0:1773851859.785903:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851859.785904:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851859.785904:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.785905:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f0991 [1] + 224
00000100:00000001:13.0:1773851859.785905:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:5.0:1773851859.785905:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851859.785905:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851859.785905:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851859.785906:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:13.0:1773851859.785906:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851859.785906:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:30.0:1773851859.785907:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851859.785907:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851859.785907:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851859.785907:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851859.785908:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851859.785908:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000800:00000200:17.0:1773851859.785908:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851859.785908:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851859.785908:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851859.785909:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:21.0:1773851859.785909:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:13.0:1773851859.785909:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851859.785909:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
02000000:00000001:5.0:1773851859.785909:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:30.0:1773851859.785910:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:30.0:1773851859.785910:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:17.0:1773851859.785910:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851859.785910:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00001000:5.0:1773851859.785910:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=92 v=66 (66 66 66 66)
00000400:00000200:30.0:1773851859.785911:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:30.0:1773851859.785911:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000200:21.0:1773851859.785911:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851859.785911:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000100:00001000:5.0:1773851859.785911:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=92 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851859.785912:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:17.0:1773851859.785912:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:9.0:1773851859.785912:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851859.785912:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851859.785912:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851859.785913:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851859.785913:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:5.0:1773851859.785913:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851859.785913:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:17.0:1773851859.785914:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851859.785914:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:5.0:1773851859.785914:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851859.785914:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000040:21.0:1773851859.785915:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851859.785915:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:5.0:1773851859.785915:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851859.785915:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.785915:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:30.0:1773851859.785916:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851859.785916:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851859.785916:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:17.0:1773851859.785917:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851859.785917:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:5.0:1773851859.785917:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:1.0:1773851859.785917:0:41062:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:1.0:1773851859.785917:0:41062:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:30.0:1773851859.785918:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851859.785918:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851859.785918:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000400:00000010:1.0:1773851859.785918:0:41062:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001712706d.
00000100:00000001:30.0:1773851859.785919:0:41090:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:9.0:1773851859.785919:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:5.0:1773851859.785919:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:1.0:1773851859.785919:0:41062:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f672ead
02000000:00000001:30.0:1773851859.785920:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851859.785920:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851859.785920:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00000001:5.0:1773851859.785920:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851859.785920:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:1.0:1773851859.785920:0:41062:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f672ead.
00000100:00000001:30.0:1773851859.785921:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851859.785921:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:17.0:1773851859.785921:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:5.0:1773851859.785921:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851859.785921:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000100:00000001:1.0:1773851859.785921:0:41062:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:30.0:1773851859.785922:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851859.785922:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:9.0:1773851859.785922:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.785922:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000004:00000040:5.0:1773851859.785922:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351466027008 avail=351462859776 avail_mb=1372901796 hwm_mb=3131103 files=372062917 ffree=343228542 state=0: rc = 0
00000100:00000200:1.0:1773851859.785922:0:41062:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851859.785923:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:30.0:1773851859.785923:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=92 v=66 (66 66 66 66)
00000400:00000200:21.0:1773851859.785923:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:11.0:1773851859.785923:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851859.785923:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000001:31.0:1773851859.785924:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:30.0:1773851859.785924:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=92 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851859.785924:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000020:5.0:1773851859.785924:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351466027008 free, 351462859776 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062917 files, 343228542 free files
00000100:00000200:1.0:1773851859.785924:0:41062:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:31.0:1773851859.785925:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:30.0:1773851859.785925:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851859.785925:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851859.785925:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000800:00000200:17.0:1773851859.785925:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000001:11.0:1773851859.785925:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:9.0:1773851859.785925:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000001:31.0:1773851859.785926:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:30.0:1773851859.785926:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000001:11.0:1773851859.785926:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:9.0:1773851859.785926:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2c40
00000004:00000001:5.0:1773851859.785926:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851859.785927:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00010000:00000001:30.0:1773851859.785927:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785927:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000010:11.0:1773851859.785927:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000200:9.0:1773851859.785927:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:5.0:1773851859.785927:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:1.0:1773851859.785927:0:41062:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:1.0:1773851859.785927:0:41062:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851859.785928:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000eb85f77
00000400:00000010:31.0:1773851859.785928:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000eb85f77.
00000100:00000040:30.0:1773851859.785928:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:30.0:1773851859.785928:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:11.0:1773851859.785928:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000177f1aa0
00000100:00000001:1.0:1773851859.785928:0:41062:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851859.785929:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851859.785929:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851859.785929:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000177f1aa0.
00000400:00000200:9.0:1773851859.785929:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781697189 [1] + 224
02000000:00000001:1.0:1773851859.785929:0:41062:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:1.0:1773851859.785929:0:41062:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:31.0:1773851859.785930:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851859.785930:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851859.785930:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00100000:5.0:1773851859.785930:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001dbca77d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051925376:2085@kfi7:13:default-yuba2-0
00000100:00000001:1.0:1773851859.785930:0:41062:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851859.785931:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851859.785931:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851859.785931:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:1.0:1773851859.785931:0:41062:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785932:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851859.785932:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00001000:1.0:1773851859.785932:0:41062:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=92 v=66 (66 66 66 66)
00000100:00000200:31.0:1773851859.785933:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851859.785933:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851859.785933:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851859.785933:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:5.0:1773851859.785933:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001dbca77d x1859433051925376/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:1.0:1773851859.785933:0:41062:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=92 v=66 (1 1 1 1)
00000004:00000001:30.0:1773851859.785934:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:11.0:1773851859.785934:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851859.785934:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000001:1.0:1773851859.785934:0:41062:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:1.0:1773851859.785934:0:41062:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785935:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:30.0:1773851859.785935:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851859.785935:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545835520 avail=351536162816 avail_mb=1373188136 hwm_mb=3131103 files=372116513 ffree=343306480 state=0: rc = 0
00000100:00000001:9.0:1773851859.785935:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:5.0:1773851859.785935:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00010000:00000001:1.0:1773851859.785935:0:41062:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:1.0:1773851859.785935:0:41062:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785936:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.785936:0:41091:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:11.0:1773851859.785936:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:9.0:1773851859.785936:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:5.0:1773851859.785936:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851859.785936:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000031de34ed.
00000100:00000001:1.0:1773851859.785936:0:41062:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:31.0:1773851859.785937:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851859.785937:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000020:30.0:1773851859.785937:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545835520 free, 351536162816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116513 files, 343306480 free files
00000100:00000001:11.0:1773851859.785937:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:5.0:1773851859.785937:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:1.0:1773851859.785937:0:41062:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00000001:1.0:1773851859.785937:0:41062:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851859.785938:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.785938:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851859.785938:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000020:00000001:5.0:1773851859.785938:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851859.785938:0:41064:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000100:00000001:1.0:1773851859.785938:0:41062:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851859.785939:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851859.785939:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.785939:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:9.0:1773851859.785939:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:5.0:1773851859.785939:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851859.785939:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000869d922.
00000100:00000040:1.0:1773851859.785939:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:31.0:1773851859.785940:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=92 v=66 (66 66 66 66)
00000100:00000040:30.0:1773851859.785940:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851859.785940:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851859.785940:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851859.785940:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:31.0:1773851859.785941:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=92 v=66 (1 1 1 1)
00000100:00001000:11.0:1773851859.785941:0:41068:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=92 v=66 (66 66 66 66)
02000000:00000001:5.0:1773851859.785941:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851859.785941:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001dbca77d.
00000100:00000001:31.0:1773851859.785942:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851859.785942:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851859.785942:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5bb58f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051925312:2056@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851859.785942:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851859.785942:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851859.785942:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851859.785942:0:41062:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:1.0:1773851859.785942:0:41062:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00010000:00000001:31.0:1773851859.785943:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851859.785943:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851859.785943:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=92 v=66 (1 1 1 1)
00000400:00000200:9.0:1773851859.785943:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:5.0:1773851859.785943:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851859.785943:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851859.785943:0:41062:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.785944:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851859.785944:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851859.785944:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851859.785944:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000800:00000200:9.0:1773851859.785944:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851859.785944:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851859.785944:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:1.0:1773851859.785944:0:41062:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:1.0:1773851859.785944:0:41062:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000100:00000040:31.0:1773851859.785945:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000001:31.0:1773851859.785945:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:30.0:1773851859.785945:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c5bb58f1 x1859433051925312/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851859.785945:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.785945:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851859.785945:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851859.785945:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:1.0:1773851859.785945:0:41062:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406587904 avail=351404219392 avail_mb=1372672732 hwm_mb=3131103 files=372127340 ffree=343170496 state=0: rc = 0
00000100:00000001:31.0:1773851859.785946:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851859.785946:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:11.0:1773851859.785946:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851859.785947:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851859.785947:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:11.0:1773851859.785947:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:7.0:1773851859.785947:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851859.785947:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000020:1.0:1773851859.785947:0:41062:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406587904 free, 351404219392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127340 files, 343170496 free files
02000000:00000001:30.0:1773851859.785948:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:11.0:1773851859.785948:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:11.0:1773851859.785948:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:7.0:1773851859.785948:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000100:00000001:31.0:1773851859.785949:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000010:30.0:1773851859.785949:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005e1a67ac.
00000100:00000001:11.0:1773851859.785949:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851859.785949:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f88013b1
00000004:00000001:1.0:1773851859.785949:0:41062:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785950:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851859.785950:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851859.785950:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851859.785950:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:11.0:1773851859.785950:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:31.0:1773851859.785951:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000040:30.0:1773851859.785951:0:41090:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000020:00000001:30.0:1773851859.785951:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000010:7.0:1773851859.785951:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f88013b1.
00000100:00000040:1.0:1773851859.785951:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:31.0:1773851859.785952:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851859.785952:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464029184 avail=351458197504 avail_mb=1372883584 hwm_mb=3131101 files=372060715 ffree=343226591 state=0: rc = 0
02000000:00000010:30.0:1773851859.785952:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000100:00000001:11.0:1773851859.785952:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851859.785952:0:41065:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:30.0:1773851859.785953:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851859.785953:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851859.785953:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5bb58f1.
00000100:00000001:11.0:1773851859.785953:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000200:7.0:1773851859.785953:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:1.0:1773851859.785953:0:41062:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e0c8b8fc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051925440:2057@kfi7:13:default-yuba2-0
00000004:00000020:31.0:1773851859.785954:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464029184 free, 351458197504 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372060715 files, 343226591 free files
00000100:00000001:30.0:1773851859.785954:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851859.785954:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851859.785954:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:31.0:1773851859.785955:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851859.785955:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851859.785955:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:11.0:1773851859.785955:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00000001:1.0:1773851859.785955:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851859.785956:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851859.785956:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:11.0:1773851859.785956:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382730752 avail=351380667392 avail_mb=1372580732 hwm_mb=3131101 files=371978744 ffree=343147198 state=0: rc = 0
00000100:00000001:1.0:1773851859.785956:0:41062:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:1.0:1773851859.785956:0:41062:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e0c8b8fc x1859433051925440/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851859.785957:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851859.785957:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851859.785957:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:11.0:1773851859.785958:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382730752 free, 351380667392 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978744 files, 343147198 free files
00000100:00000200:7.0:1773851859.785958:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:31.0:1773851859.785959:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b8e8c6f3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051925504:2065@kfi7:13:default-yuba2-0
00000004:00000001:11.0:1773851859.785959:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.785959:0:41062:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:1.0:1773851859.785959:0:41062:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:11.0:1773851859.785960:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:1.0:1773851859.785960:0:41062:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003ef8b576.
00000100:00000001:31.0:1773851859.785961:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851859.785961:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:1.0:1773851859.785961:0:41062:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:1.0:1773851859.785961:0:41062:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:31.0:1773851859.785962:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b8e8c6f3 x1859433051925504/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:1.0:1773851859.785962:0:41062:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000020:00000001:1.0:1773851859.785962:0:41062:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00100000:11.0:1773851859.785963:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000861b9c78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051925248:2055@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851859.785963:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851859.785963:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:1.0:1773851859.785963:0:41062:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000053550efe.
00000100:00000001:31.0:1773851859.785964:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851859.785964:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:1.0:1773851859.785964:0:41062:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:1.0:1773851859.785964:0:41062:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:31.0:1773851859.785965:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851859.785965:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ce89abbc.
00000100:00000001:11.0:1773851859.785965:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.785965:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:7.0:1773851859.785965:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000010:1.0:1773851859.785965:0:41062:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e0c8b8fc.
02000000:00000001:31.0:1773851859.785966:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:11.0:1773851859.785966:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000861b9c78 x1859433051925248/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.785966:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851859.785966:0:41062:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:1.0:1773851859.785966:0:41062:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851859.785967:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851859.785967:0:41091:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000100:00000001:7.0:1773851859.785967:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.785967:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851859.785968:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:11.0:1773851859.785968:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851859.785968:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.785968:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:31.0:1773851859.785969:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000018dd4826.
02000000:00000001:31.0:1773851859.785969:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851859.785969:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00001000:7.0:1773851859.785969:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=92 v=66 (66 66 66 66)
00000100:00000001:1.0:1773851859.785969:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851859.785969:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851859.785969:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851859.785970:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851859.785970:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8e8c6f3.
02000000:00000010:11.0:1773851859.785970:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006e24c5d2.
00000100:00000001:31.0:1773851859.785971:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:11.0:1773851859.785971:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00001000:7.0:1773851859.785971:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=92 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851859.785972:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851859.785972:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851859.785973:0:41068:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000020:00000001:11.0:1773851859.785973:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851859.785973:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851859.785973:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851859.785974:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:31.0:1773851859.785975:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:11.0:1773851859.785975:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:7.0:1773851859.785975:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:31.0:1773851859.785976:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851859.785976:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851859.785976:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851859.785976:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000861b9c78.
00010000:00000001:7.0:1773851859.785976:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851859.785977:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851859.785977:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.785977:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851859.785977:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.785977:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851859.785977:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000001:11.0:1773851859.785978:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.785978:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851859.785979:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851859.785979:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.785979:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.785980:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851859.785980:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.785981:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.785985:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851859.785987:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851859.785987:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851859.785988:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851859.785990:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851859.785991:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489087488 avail=351486078976 avail_mb=1372992496 hwm_mb=3131103 files=372066885 ffree=343251062 state=0: rc = 0
00000004:00000020:7.0:1773851859.785994:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489087488 free, 351486078976 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066885 files, 343251062 free files
00000004:00000001:7.0:1773851859.785997:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.785998:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851859.786008:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008f45454b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051925568:46@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851859.786011:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.786012:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851859.786013:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000008f45454b x1859433051925568/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852012 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851859.786017:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851859.786018:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851859.786019:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000053a6c80b.
02000000:00000001:7.0:1773851859.786020:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851859.786021:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851859.786022:0:41065:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000020:00000001:7.0:1773851859.786023:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851859.786024:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006fe63e6d.
02000000:00000001:7.0:1773851859.786025:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851859.786026:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851859.786026:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008f45454b.
00000100:00000001:7.0:1773851859.786028:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851859.786029:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.786030:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.786031:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851859.786032:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.786033:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851859.786033:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:23.0:1773851859.787754:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.787755:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:23.0:1773851859.787757:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:23.0:1773851859.787759:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:23.0:1773851859.787762:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10642@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.787763:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10642@kfi7 : PUT - for me
00000400:00000200:23.0:1773851859.787764:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10642@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.787765:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006c72e01 nid 10642@kfi7 refs 1
00000400:00000200:23.0:1773851859.787766:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10642@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.787767:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006c72e01 nid 10642@kfi7 refs 2
00000400:00000200:23.0:1773851859.787768:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000006c72e01 nid 10642@kfi7 refs 3
00000400:00000200:23.0:1773851859.787769:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10643@kfi7 to cpt 0
00000400:00000200:23.0:1773851859.787770:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10643@kfi7 of length 224 into portal 12 MB=0x699e200385980
00000400:00000200:23.0:1773851859.787772:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10643@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 29000
00000800:00000200:23.0:1773851859.787774:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851859.787776:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:23.0:1773851859.787777:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10642@kfi7: PUT: OK
00000100:00000001:23.0:1773851859.787778:0:2495434:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:23.0:1773851859.787779:0:2495434:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:23.0:1773851859.787780:0:2495434:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000020427d48.
00000100:00000040:23.0:1773851859.787781:0:2495434:0:(events.c:358:request_in_callback()) incoming req@0000000020427d48 x1858045805615488 msgsize 224
00000100:00100000:23.0:1773851859.787782:0:2495434:0:(events.c:361:request_in_callback()) peer: 12345-10643@kfi7 (source: 12345-10642@kfi7)
00000100:00000001:23.0:1773851859.787784:0:2495434:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:23.0:1773851859.787785:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000006c72e01 nid 10642@kfi7 refs 2
00000800:00000200:23.0:1773851859.787786:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cf211825: 2054@kfi7:5 <- 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851859.787789:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851859.787789:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851859.787790:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851859.787790:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851859.787791:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.787792:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858045805615488
00000020:00000001:23.0:1773851859.787792:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.787793:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c2b
00000020:00000001:23.0:1773851859.787794:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.787797:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000015702540 refcount=169
00000020:00000001:23.0:1773851859.787798:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628274176 : -107123081277440 : ffff9e9276cb1000)
00000020:00000001:23.0:1773851859.787799:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628274176 : -107123081277440 : ffff9e9276cb1000)
00000100:00000001:23.0:1773851859.787800:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.787801:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.787801:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007f5732ba.
00000020:00000010:23.0:1773851859.787802:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.787803:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.787804:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.787805:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.787805:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.787806:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.787806:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.787807:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.787808:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.787809:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.787809:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851859.787810:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10643@kfi7, seq: 1997945
00000100:00000040:23.0:1773851859.787811:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000015702540 : new rpc_count 1
00000100:00000001:23.0:1773851859.787812:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133285632128 : -106940423919488 : ffff9ebcfe052880)
00000100:00000040:23.0:1773851859.787813:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000020427d48 x1858045805615488/t0(0) o400->7bd3e402-efc4-4de8-b0b2-384476d7baa9@10643@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1158-0'
00000100:00000001:23.0:1773851859.787816:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.787816:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.787817:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000020427d48 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:7bd3e402-efc4-4de8-b0b2-384476d7baa9+169:39811:x1858045805615488:12345-10643@kfi7:400:default-tuolumne1158-0
00000100:00000200:23.0:1773851859.787819:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858045805615488
00000020:00000001:23.0:1773851859.787819:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.787820:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.787821:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.787821:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.787822:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.787823:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.787823:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858045805615488, found 0 last_xid 1858045805192511
00000020:00000001:23.0:1773851859.787824:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.787825:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.787825:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.787826:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.787826:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.787827:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.787827:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.787828:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c42e6026.
02000000:00000001:23.0:1773851859.787829:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.787829:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.787830:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.787831:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062392, transno 0, xid 1858045805615488
00010000:00000001:23.0:1773851859.787831:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.787832:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000020427d48 x1858045805615488/t0(0) o400->7bd3e402-efc4-4de8-b0b2-384476d7baa9@10643@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1158-0'
00010000:00000001:23.0:1773851859.787834:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.787835:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.787836:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.787837:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.787837:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ca8ce3c8 refcount 3 to 10643@kfi7
00000100:00000001:23.0:1773851859.787838:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917415418976 : -107156294132640 : ffff9e8abb271c60)
02000000:00000001:23.0:1773851859.787839:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.787839:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.787840:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.787841:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10642@kfi7
00000400:00000010:23.0:1773851859.787841:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d878015d.
00000100:00000200:23.0:1773851859.787843:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858045805615488, offset 224
00000400:00000200:23.0:1773851859.787844:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10642@kfi7
00000400:00000200:23.0:1773851859.787844:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10642@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.787845:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006c72e01 nid 10642@kfi7 refs 1
00000400:00000200:23.0:1773851859.787846:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000006c72e01 nid 10642@kfi7 refs 2
00000400:00000200:23.0:1773851859.787847:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000006c72e01 nid 10642@kfi7 refs 3
00000400:00000200:23.0:1773851859.787848:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10642@kfi7 local destination
00000400:00000200:23.0:1773851859.787850:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768858:8768858:1024:4294967295] 10642@kfi7 LPNI seq info [1300964:1300964:16:4294967295]
00000400:00000200:23.0:1773851859.787852:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000006c72e01 nid 10642@kfi7 refs 2
00000400:00000200:23.0:1773851859.787853:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10642@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.787855:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10642@kfi7(10642@kfi7:10642@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.787856:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000006c72e01 nid 10642@kfi7 refs 3
00000800:00000200:23.0:1773851859.787857:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.787858:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.787860:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.787862:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007d1 Using peer 10642@kfi7(0x1000000000007d1)
00000800:00000200:23.0:1773851859.787865:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x1000000000007d1: rc=0
00000800:00000200:23.0:1773851859.787866:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.787868:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.787869:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ca8ce3c8 refcount 2 to 10643@kfi7
00010000:00000001:23.0:1773851859.787870:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.787870:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.787871:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.787872:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000020427d48 x1858045805615488/t0(0) o400->7bd3e402-efc4-4de8-b0b2-384476d7baa9@10643@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1158-0'
00000100:00100000:23.0:1773851859.787875:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000020427d48 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:7bd3e402-efc4-4de8-b0b2-384476d7baa9+169:39811:x1858045805615488:12345-10643@kfi7:400:default-tuolumne1158-0 Request processed in 58us (93us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851859.787877:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10643@kfi7, seq: 1997945
00000100:00000040:23.0:1773851859.787878:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000015702540 : new rpc_count 0
00000100:00000001:23.0:1773851859.787878:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851859.787879:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851859.787879:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851859.787880:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007d1 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851859.787881:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851859.787881:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007f5732ba.
00000020:00000040:23.0:1773851859.787882:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000015702540 : new refcount 168
00000100:00000001:23.0:1773851859.787883:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851859.787883:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.787885:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10642@kfi7: PUT: OK
00000400:00000200:21.0:1773851859.787887:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d878015d
00000400:00000010:21.0:1773851859.787887:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d878015d.
00000100:00000001:21.0:1773851859.787889:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851859.787889:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851859.787891:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000006c72e01 nid 10642@kfi7 refs 2
00000800:00000200:21.0:1773851859.787894:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10642@kfi7(0000000082fb07b6):0x0 lsk 2002 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007d1 Transaction freed
00000800:00000200:23.0:1773851859.797030:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.797031:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:23.0:1773851859.797032:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:23.0:1773851859.797034:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:23.0:1773851859.797036:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.797037:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17538@kfi7 : PUT - for me
00000400:00000200:23.0:1773851859.797038:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.797038:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 1
00000400:00000200:23.0:1773851859.797040:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.797041:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000400:00000200:23.0:1773851859.797041:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 3
00000400:00000200:23.0:1773851859.797042:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17539@kfi7 to cpt 0
00000400:00000200:23.0:1773851859.797043:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17539@kfi7 of length 224 into portal 12 MB=0x69b4be63ea2c0
00000400:00000200:23.0:1773851859.797044:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17539@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 29224
00000800:00000200:23.0:1773851859.797046:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851859.797047:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:23.0:1773851859.797048:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17538@kfi7: PUT: OK
00000100:00000001:23.0:1773851859.797049:0:2495434:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:23.0:1773851859.797050:0:2495434:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:23.0:1773851859.797050:0:2495434:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000866b771a.
00000100:00000040:23.0:1773851859.797051:0:2495434:0:(events.c:358:request_in_callback()) incoming req@00000000866b771a x1859600147980992 msgsize 224
00000100:00100000:23.0:1773851859.797052:0:2495434:0:(events.c:361:request_in_callback()) peer: 12345-17539@kfi7 (source: 12345-17538@kfi7)
00000100:00000001:23.0:1773851859.797053:0:2495434:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:23.0:1773851859.797055:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000800:00000200:23.0:1773851859.797056:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851859.797059:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851859.797059:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851859.797060:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851859.797060:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851859.797061:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.797061:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600147980992
00000020:00000001:23.0:1773851859.797062:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.797062:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82188
00000020:00000001:23.0:1773851859.797062:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.797067:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000687debe3 refcount=2660
00000020:00000001:23.0:1773851859.797068:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157028238336 : -106916681313280 : ffff9ec285309400)
00000020:00000001:23.0:1773851859.797069:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157028238336 : -106916681313280 : ffff9ec285309400)
00000100:00000001:23.0:1773851859.797069:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.797070:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.797071:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007f5732ba.
00000020:00000010:23.0:1773851859.797071:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.797072:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.797073:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.797073:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.797073:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.797074:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.797075:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.797075:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.797076:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.797076:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.797077:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851859.797078:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17539@kfi7, seq: 1997946
00000100:00000040:23.0:1773851859.797078:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000687debe3 : new rpc_count 8
00000100:00000001:23.0:1773851859.797079:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133285634432 : -106940423917184 : ffff9ebcfe053180)
00000100:00000001:22.0:1773851859.797079:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:23.0:1773851859.797080:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000866b771a x1859600147980992/t0(0) o400->e821b58d-0b5a-422e-ace5-6066ed9bda6c@17539@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1592-0'
00000100:00000001:22.0:1773851859.797080:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851859.797080:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.797082:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851859.797082:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.797083:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.797084:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000866b771a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e821b58d-0b5a-422e-ace5-6066ed9bda6c+2660:39512:x1859600147980992:12345-17539@kfi7:400:default-tuolumne1592-0
00000100:00000200:23.0:1773851859.797085:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600147980992
00000020:00000001:23.0:1773851859.797086:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.797086:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.797087:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.797087:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.797088:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.797088:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.797089:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600147980992, found 0 last_xid 1859600147284031
00000020:00000001:23.0:1773851859.797090:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.797090:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.797090:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.797091:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.797091:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.797092:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.797092:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.797093:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000044faf525.
02000000:00000001:23.0:1773851859.797094:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.797094:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.797095:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.797095:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264582885, transno 0, xid 1859600147980992
00010000:00000001:23.0:1773851859.797096:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.797097:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000866b771a x1859600147980992/t0(0) o400->e821b58d-0b5a-422e-ace5-6066ed9bda6c@17539@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1592-0'
00010000:00000001:23.0:1773851859.797099:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.797099:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.797100:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.797101:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.797102:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000056a3bbea refcount 3 to 17539@kfi7
00000100:00000001:23.0:1773851859.797102:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958006016 : -107146751545600 : ffff9e8cf3ef6f00)
02000000:00000001:23.0:1773851859.797103:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.797103:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.797104:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.797105:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17538@kfi7
00000400:00000010:23.0:1773851859.797106:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f219ead6.
00000100:00000200:23.0:1773851859.797106:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600147980992, offset 224
00000400:00000200:23.0:1773851859.797108:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17538@kfi7
00000400:00000200:23.0:1773851859.797108:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.797109:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 1
00000400:00000200:23.0:1773851859.797110:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000400:00000200:23.0:1773851859.797111:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 3
00000400:00000200:23.0:1773851859.797112:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17538@kfi7 local destination
00000400:00000200:23.0:1773851859.797113:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768859:8768859:1024:4294967295] 17538@kfi7 LPNI seq info [16807486:16807486:16:4294967295]
00000400:00000200:23.0:1773851859.797114:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000400:00000200:23.0:1773851859.797115:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.797117:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17538@kfi7(17538@kfi7:17538@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.797118:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 3
00000800:00000200:23.0:1773851859.797119:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.797119:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.797121:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.797123:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe9b Using peer 17538@kfi7(0xe9b)
00000800:00000200:23.0:1773851859.797126:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0xe9b: rc=0
00000800:00000200:23.0:1773851859.797127:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe9b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.797129:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.797130:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000056a3bbea refcount 2 to 17539@kfi7
00010000:00000001:23.0:1773851859.797130:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.797131:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.797131:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.797132:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000866b771a x1859600147980992/t0(0) o400->e821b58d-0b5a-422e-ace5-6066ed9bda6c@17539@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1592-0'
00000100:00100000:23.0:1773851859.797137:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000866b771a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e821b58d-0b5a-422e-ace5-6066ed9bda6c+2660:39512:x1859600147980992:12345-17539@kfi7:400:default-tuolumne1592-0 Request processed in 54us (85us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851859.797139:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17539@kfi7, seq: 1997946
00000100:00000040:23.0:1773851859.797140:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000687debe3 : new rpc_count 7
00000100:00000001:23.0:1773851859.797141:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851859.797141:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851859.797141:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.797142:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851859.797143:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007f5732ba.
00000020:00000040:23.0:1773851859.797143:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000687debe3 : new refcount 2659
00000100:00000001:23.0:1773851859.797144:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851859.797144:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe9b TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851859.797147:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.797148:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17538@kfi7: PUT: OK
00000400:00000200:21.0:1773851859.797149:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f219ead6
00000400:00000010:21.0:1773851859.797150:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f219ead6.
00000100:00000001:21.0:1773851859.797151:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851859.797152:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851859.797153:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000800:00000200:21.0:1773851859.797155:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 17538@kfi7(0000000017bf3282):0x0 lsk 3740 rsk 22 tsk 0 trmk 0 tmk 0 trr 5 tta 0xe9b Transaction freed
00000800:00000200:6.0:1773851859.807374:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.807374:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851859.807375:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851859.807376:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851859.807376:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851859.807378:0:2499722:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8803@kfi7(0000000061d57823):0xc28 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851859.807378:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851859.807380:0:2499722:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Using peer 8803@kfi7(0x100000000000c28)
00000800:00000200:5.0:1773851859.807381:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851859.807383:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000800:00000200:6.0:1773851859.807385:0:2499722:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 38 bytes to peer 0x100000000000c28: rc=0
00000400:00000200:5.0:1773851859.807385:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000800:00000200:6.0:1773851859.807386:0:2499722:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851859.807387:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8803@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.807388:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.807390:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 1
00000400:00000200:5.0:1773851859.807391:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.807393:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:5.0:1773851859.807394:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000400:00000200:5.0:1773851859.807396:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8867@kfi7 to cpt 5
00000400:00000200:5.0:1773851859.807397:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8867@kfi7 of length 576 into portal 12 MB=0x69b0909a44a40
00000800:00000200:6.0:1773851859.807398:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851859.807399:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8867@kfi7 of length 576/576 into md 0x793926dc5 [64] + 124080
00000800:00000200:6.0:1773851859.807400:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Transaction freed
00000800:00000200:5.0:1773851859.807403:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.807406:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.807407:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8803@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.807409:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.807410:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.807411:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aecbe4e2.
00000100:00000040:5.0:1773851859.807412:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000aecbe4e2 x1859312979036736 msgsize 576
00000100:00100000:5.0:1773851859.807415:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-8867@kfi7 (source: 12345-8803@kfi7)
00000100:00000001:5.0:1773851859.807416:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851859.807418:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000100:00000001:7.0:1773851859.807419:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.807420:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851859.807420:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851859.807421:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.807421:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.807423:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.807424:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859312979036736
00000020:00000001:7.0:1773851859.807425:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.807425:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d3c
00000020:00000001:7.0:1773851859.807426:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.807430:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e66c65f1 refcount=9
00000020:00000001:7.0:1773851859.807431:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000020:00000001:7.0:1773851859.807432:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000100:00000001:7.0:1773851859.807434:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.807435:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.807436:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851859.807437:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.807439:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c7f00787.
00000100:00000001:7.0:1773851859.807440:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.807441:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:7.0:1773851859.807442:0:60963:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:7.0:1773851859.807443:0:60963:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.807444:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.807445:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.807447:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851859.807448:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.807449:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.807449:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851859.807450:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851859.807450:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8867@kfi7, seq: 371100839
00000100:00000001:7.0:1773851859.807451:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851859.807451:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e66c65f1 : new rpc_count 1
00000100:00000001:7.0:1773851859.807452:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.807452:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866931840 : -107088842619776 : ffff9e9a6f938480)
00000100:00000040:6.0:1773851859.807453:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aecbe4e2 x1859312979036736/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 576/0 e 0 to 0 dl 1773851946 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1036-0'
00000100:00000001:6.0:1773851859.807460:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851859.807460:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851859.807461:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aecbe4e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:bda4aca7-bf68-47b3-9c19-b2ccadf24735+9:1597374:x1859312979036736:12345-8867@kfi7:101:default-tuolumne1036-0
00000100:00000200:6.0:1773851859.807463:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859312979036736
00000020:00000001:6.0:1773851859.807464:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851859.807465:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851859.807465:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851859.807466:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851859.807467:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:6.0:1773851859.807468:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851859.807468:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859312979036736, found 0 last_xid 1859312979036735
00000020:00000001:6.0:1773851859.807469:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851859.807470:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851859.807470:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851859.807471:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851859.807472:0:61015:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:6.0:1773851859.807473:0:61015:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:6.0:1773851859.807474:0:61015:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:6.0:1773851859.807474:0:61015:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:6.0:1773851859.807475:0:61015:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.807479:0:61015:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:6.0:1773851859.807481:0:61015:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 198
00010000:00000001:6.0:1773851859.807482:0:61015:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:6.0:1773851859.807483:0:61015:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:6.0:1773851859.807484:0:61015:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000d4391b74.
00000020:00000001:6.0:1773851859.807485:0:61015:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:6.0:1773851859.807486:0:61015:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000d4391b74 with handle 0x21b6f08f07a6ad31 to hash
00000020:00000001:6.0:1773851859.807487:0:61015:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:6.0:1773851859.807487:0:61015:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637105323157632 : -106968386393984 : ffff9eb67b53a880)
00010000:00000010:6.0:1773851859.807489:0:61015:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c9d9e1ba.
00010000:00000001:6.0:1773851859.807490:0:61015:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637105323157632 : -106968386393984 : ffff9eb67b53a880)
00010000:00010000:6.0:1773851859.807491:0:61015:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4391b74/0x21b6f08f07a6ad31 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 199 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcaff327788a52cb5 expref: -99 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807495:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000040:6.0:1773851859.807496:0:61015:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000e66c65f1 : new locks_count 4
00000020:00000040:6.0:1773851859.807497:0:61015:0:(genops.c:871:class_export_get()) GET export 00000000e66c65f1 refcount=10
00010000:00000001:6.0:1773851859.807499:0:61015:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:6.0:1773851859.807500:0:61015:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:6.0:1773851859.807502:0:61015:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:6.0:1773851859.807503:0:61015:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:6.0:1773851859.807504:0:61015:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:6.0:1773851859.807504:0:61015:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:6.0:1773851859.807505:0:61015:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:6.0:1773851859.807506:0:61015:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:6.0:1773851859.807507:0:61015:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:6.0:1773851859.807508:0:61015:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:6.0:1773851859.807509:0:61015:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.807510:0:61015:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:6.0:1773851859.807511:0:61015:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:6.0:1773851859.807512:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851859.807512:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851859.807514:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 000000003dcf7fdd.
02000000:00000001:6.0:1773851859.807514:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.807515:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.807516:0:61015:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.807516:0:61015:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:6.0:1773851859.807517:0:61015:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:6.0:1773851859.807518:0:61015:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:6.0:1773851859.807519:0:61015:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.807519:0:61015:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:6.0:1773851859.807520:0:61015:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.807520:0:61015:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:6.0:1773851859.807521:0:61015:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.807521:0:61015:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:6.0:1773851859.807521:0:61015:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.807522:0:61015:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:6.0:1773851859.807523:0:61015:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851859.807525:0:61015:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:6.0:1773851859.807526:0:61015:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:6.0:1773851859.807527:0:61015:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:6.0:1773851859.807528:0:61015:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.807528:0:61015:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:6.0:1773851859.807529:0:61015:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.807529:0:61015:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:6.0:1773851859.807530:0:61015:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.807531:0:61015:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:6.0:1773851859.807532:0:61015:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 00000000492474fd
00000004:00000001:6.0:1773851859.807533:0:61015:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:6.0:1773851859.807534:0:61015:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:6.0:1773851859.807535:0:61015:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:6.0:1773851859.807535:0:61015:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:6.0:1773851859.807536:0:61015:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 199
00010000:00000001:6.0:1773851859.807536:0:61015:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:6.0:1773851859.807537:0:61015:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:6.0:1773851859.807537:0:61015:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000075ca223d.
00000020:00000001:6.0:1773851859.807538:0:61015:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:6.0:1773851859.807539:0:61015:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000075ca223d with handle 0x21b6f08f07a6ad38 to hash
00000020:00000001:6.0:1773851859.807539:0:61015:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:6.0:1773851859.807539:0:61015:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000010:6.0:1773851859.807540:0:61015:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000008b7519f8.
00010000:00000001:6.0:1773851859.807541:0:61015:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000001:6.0:1773851859.807542:0:61015:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:6.0:1773851859.807543:0:61015:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:6.0:1773851859.807543:0:61015:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000075ca223d/0x21b6f08f07a6ad38 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 200 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807546:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:6.0:1773851859.807547:0:61015:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:6.0:1773851859.807548:0:61015:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:6.0:1773851859.807548:0:61015:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:6.0:1773851859.807549:0:61015:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:6.0:1773851859.807551:0:61015:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:6.0:1773851859.807551:0:61015:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:6.0:1773851859.807552:0:61015:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:6.0:1773851859.807553:0:61015:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:6.0:1773851859.807554:0:61015:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:6.0:1773851859.807554:0:61015:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:6.0:1773851859.807555:0:61015:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:6.0:1773851859.807555:0:61015:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 199
00010000:00000040:6.0:1773851859.807557:0:61015:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:6.0:1773851859.807559:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807561:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807564:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807566:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807568:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807570:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807572:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807574:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807576:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807578:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807579:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807581:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807593:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807595:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807597:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807599:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807600:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807603:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807604:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807606:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807608:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807610:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807611:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807613:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807614:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807617:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807618:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807620:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807622:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807624:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807626:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807628:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807629:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807631:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807632:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807634:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807636:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807638:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807639:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807641:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807643:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807645:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807647:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807649:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807651:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807653:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807654:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807656:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807657:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 10 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807659:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807660:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807662:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807663:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807665:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807667:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807669:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807671:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807673:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807674:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807676:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807678:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807680:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807681:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807683:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807684:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807686:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807687:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807689:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807690:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807692:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807694:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807696:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807697:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807699:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807700:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807702:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807704:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807706:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807707:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807709:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807710:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807712:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807714:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807715:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807716:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807718:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807720:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807722:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807723:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807729:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807730:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807732:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807734:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807736:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807737:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a4d807 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25b3 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807739:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807740:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062815ce5/0x21b6f08f07a4d7cf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b924a expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807742:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807743:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d2098ccc/0x21b6f08f07a4d797 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0f4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807745:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807747:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f2deef/0x21b6f08f07a4d75f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84ed expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807749:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807750:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807752:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807754:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807756:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807757:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807759:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807761:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807763:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807765:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807767:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807768:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807771:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807772:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807774:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807775:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807777:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807778:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807781:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807782:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807784:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807785:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807788:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807790:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807792:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807793:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807795:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807796:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807798:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807799:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807801:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807803:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807805:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807806:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807808:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807809:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807811:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807812:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807814:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807816:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807818:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807820:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807822:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807823:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807826:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807827:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807829:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807830:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807832:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807833:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807835:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807836:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807839:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807840:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807842:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807843:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807845:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807847:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807848:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807850:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807852:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807853:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807855:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807856:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807858:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807860:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807862:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807863:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807865:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807866:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807868:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807870:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807872:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807874:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807876:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807877:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807879:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807881:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807883:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807884:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807886:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807887:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807889:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807891:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807893:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807894:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807896:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807898:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807900:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807901:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807903:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807904:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807906:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807908:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807910:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807911:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807914:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807915:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807917:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807918:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807921:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807922:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807924:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807927:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807929:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807930:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807932:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807933:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807935:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807936:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807939:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807940:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807942:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807943:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807945:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807947:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807949:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807950:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807952:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807954:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807956:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807958:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807960:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807961:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807963:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807965:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807967:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807968:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807970:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807972:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807974:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807975:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807977:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807978:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807980:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807982:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807984:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807985:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807987:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807988:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807990:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807992:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807994:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807995:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.807997:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.807998:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808000:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808001:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808003:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808005:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808007:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808008:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808010:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808012:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808013:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808015:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808017:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808018:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808020:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808021:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808023:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808025:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808027:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808028:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808031:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808032:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808034:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808036:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808038:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808039:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808041:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808042:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808044:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808046:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808048:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808049:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808051:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808052:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808054:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808055:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808057:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808059:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808061:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808062:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808064:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808065:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808067:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808068:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808070:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808071:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808074:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808075:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808077:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808078:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808080:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808082:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808084:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808085:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808087:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808088:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808090:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808092:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808094:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808095:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808097:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808098:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808100:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808102:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808104:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808105:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808107:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808109:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808111:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808112:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808114:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808116:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808118:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808119:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808121:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808123:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808125:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808126:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808128:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808129:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808131:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808133:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808135:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808136:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808138:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808139:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808141:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808143:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808145:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808146:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808148:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808149:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808151:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808153:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808155:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808156:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808158:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808159:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808161:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808162:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808164:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808166:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808168:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808170:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808172:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808173:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808175:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808176:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808178:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808180:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808182:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808183:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808185:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808186:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808188:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808189:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808192:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808193:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808195:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808197:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808199:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808200:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808202:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808204:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808206:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808207:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808209:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808210:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808212:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808213:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808216:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808217:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808219:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808220:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808222:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808224:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808226:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808227:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808229:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808230:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808232:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808233:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808235:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808237:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808239:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808240:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808242:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808243:0:61015:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808245:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00010000:6.0:1773851859.808246:0:61015:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000075ca223d/0x21b6f08f07a6ad38 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808248:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:6.0:1773851859.808249:0:61015:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:6.0:1773851859.808251:0:61015:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:6.0:1773851859.808251:0:61015:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.808252:0:61015:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:6.0:1773851859.808253:0:61015:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:6.0:1773851859.808253:0:61015:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.808254:0:61015:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:6.0:1773851859.808255:0:61015:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:6.0:1773851859.808256:0:61015:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:6.0:1773851859.808256:0:61015:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000075ca223d/0x21b6f08f07a6ad38 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808259:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:6.0:1773851859.808259:0:61015:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:6.0:1773851859.808260:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:6.0:1773851859.808260:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:6.0:1773851859.808261:0:61015:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:6.0:1773851859.808261:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851859.808262:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000075ca223d refcount=3
00000020:00000001:6.0:1773851859.808262:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000001:6.0:1773851859.808263:0:61015:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000001:6.0:1773851859.808264:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:6.0:1773851859.808264:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:6.0:1773851859.808265:0:61015:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.808265:0:61015:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.808267:0:61015:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:6.0:1773851859.808268:0:61015:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:6.0:1773851859.808269:0:61015:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:6.0:1773851859.808276:0:61015:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.808277:0:61015:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:6.0:1773851859.808279:0:61015:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:6.0:1773851859.808279:0:61015:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:6.0:1773851859.808281:0:61015:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808282:0:61015:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808283:0:61015:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808284:0:61015:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:6.0:1773851859.808285:0:61015:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:6.0:1773851859.808285:0:61015:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:6.0:1773851859.808285:0:61015:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808286:0:61015:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808287:0:61015:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:6.0:1773851859.808288:0:61015:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:6.0:1773851859.808289:0:61015:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.808289:0:61015:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:6.0:1773851859.808290:0:61015:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.808290:0:61015:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:6.0:1773851859.808291:0:61015:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:6.0:1773851859.808291:0:61015:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:6.0:1773851859.808292:0:61015:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:6.0:1773851859.808292:0:61015:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:6.0:1773851859.808292:0:61015:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:6.0:1773851859.808293:0:61015:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:6.0:1773851859.808294:0:61015:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:6.0:1773851859.808295:0:61015:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:6.0:1773851859.808296:0:61015:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:6.0:1773851859.808297:0:61015:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:6.0:1773851859.808297:0:61015:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.808298:0:61015:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:6.0:1773851859.808299:0:61015:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:6.0:1773851859.808299:0:61015:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:6.0:1773851859.808300:0:61015:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:6.0:1773851859.808300:0:61015:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808301:0:61015:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808301:0:61015:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:6.0:1773851859.808303:0:61015:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851859.808304:0:61015:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:6.0:1773851859.808306:0:61015:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.808307:0:61015:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.808309:0:61015:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.808310:0:61015:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:6.0:1773851859.808310:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851859.808311:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000075ca223d refcount=3
00000020:00000001:6.0:1773851859.808312:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000001:6.0:1773851859.808312:0:61015:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00000004:00000040:6.0:1773851859.808313:0:61015:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000e66c65f1 : new locks_count 5
00000020:00000040:6.0:1773851859.808314:0:61015:0:(genops.c:871:class_export_get()) GET export 00000000e66c65f1 refcount=11
00010000:00000001:6.0:1773851859.808315:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:6.0:1773851859.808315:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:6.0:1773851859.808316:0:61015:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:6.0:1773851859.808316:0:61015:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:6.0:1773851859.808317:0:61015:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:6.0:1773851859.808318:0:61015:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:6.0:1773851859.808318:0:61015:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:6.0:1773851859.808319:0:61015:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:6.0:1773851859.808319:0:61015:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:6.0:1773851859.808320:0:61015:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:6.0:1773851859.808321:0:61015:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851859.808322:0:61015:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:6.0:1773851859.808323:0:61015:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:6.0:1773851859.808324:0:61015:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:6.0:1773851859.808325:0:61015:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:6.0:1773851859.808325:0:61015:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:6.0:1773851859.808326:0:61015:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:6.0:1773851859.808327:0:61015:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:6.0:1773851859.808328:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:6.0:1773851859.808328:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:6.0:1773851859.808328:0:61015:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:6.0:1773851859.808329:0:61015:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:6.0:1773851859.808330:0:61015:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d4391b74 with handle 0x21b6f08f07a6ad31 from hash
00010000:00000001:6.0:1773851859.808330:0:61015:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:6.0:1773851859.808331:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:6.0:1773851859.808331:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:6.0:1773851859.808331:0:61015:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:6.0:1773851859.808332:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:6.0:1773851859.808332:0:61015:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4391b74/0x21b6f08f07a6ad31 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x44000000000000 nid: 8867@kfi7 remote: 0xcaff327788a52cb5 expref: 11 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808337:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:6.0:1773851859.808338:0:61015:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e66c65f1 : new locks_count 4
00000020:00000040:6.0:1773851859.808339:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 10
00010000:00000010:6.0:1773851859.808339:0:61015:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c9d9e1ba.
00010000:00000040:6.0:1773851859.808341:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000001:6.0:1773851859.808341:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:6.0:1773851859.808342:0:61015:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.808343:0:61015:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:6.0:1773851859.808344:0:61015:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 0000000075ca223d/0x21b6f08f07a6ad38 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 199 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52cb5 expref: 10 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:6.0:1773851859.808346:0:61015:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000001:6.0:1773851859.808347:0:61015:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:6.0:1773851859.808348:0:61015:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:6.0:1773851859.808348:0:61015:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:6.0:1773851859.808349:0:61015:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:6.0:1773851859.808350:0:61015:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:6.0:1773851859.808351:0:61015:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851859.808352:0:61015:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:6.0:1773851859.808352:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:6.0:1773851859.808353:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:6.0:1773851859.808353:0:61015:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000075ca223d, rc 0)
00000020:00000001:6.0:1773851859.808354:0:61015:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851859.808355:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200607, transno 0, xid 1859312979036736
00010000:00000001:6.0:1773851859.808356:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851859.808356:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aecbe4e2 x1859312979036736/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 576/640 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1036-0'
00010000:00000001:6.0:1773851859.808359:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851859.808360:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851859.808360:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851859.808362:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851859.808363:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eed30efc refcount 3 to 8867@kfi7
00000100:00000001:6.0:1773851859.808363:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108704 : -107156354442912 : ffff9e8ab78ed960)
02000000:00000001:6.0:1773851859.808364:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851859.808365:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.808366:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851859.808366:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8803@kfi7
00000400:00000010:6.0:1773851859.808367:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4270b1f.
00000100:00000200:6.0:1773851859.808368:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859312979036736, offset 224
00000400:00000200:6.0:1773851859.808370:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8803@kfi7
00000400:00000200:6.0:1773851859.808371:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.808371:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 1
00000400:00000200:6.0:1773851859.808372:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:6.0:1773851859.808374:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000400:00000200:6.0:1773851859.808375:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8803@kfi7 local destination
00000400:00000200:6.0:1773851859.808376:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768860:8768860:1024:4294967295] 8803@kfi7 LPNI seq info [2360111:2360111:16:4294967295]
00000400:00000200:6.0:1773851859.808378:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:6.0:1773851859.808379:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.808381:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8803@kfi7(8803@kfi7:8803@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851859.808382:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000800:00000200:6.0:1773851859.808384:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851859.808385:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:6.0:1773851859.808387:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851859.808389:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Using peer 8803@kfi7(0x100000000000c28)
00000800:00000200:6.0:1773851859.808392:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 740 bytes to peer 0x100000000000c28: rc=0
00000800:00000200:6.0:1773851859.808394:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851859.808396:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851859.808399:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eed30efc refcount 2 to 8867@kfi7
00010000:00000001:6.0:1773851859.808400:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851859.808401:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851859.808401:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851859.808402:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aecbe4e2 x1859312979036736/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 576/640 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1036-0'
00000100:00100000:6.0:1773851859.808405:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aecbe4e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:bda4aca7-bf68-47b3-9c19-b2ccadf24735+10:1597374:x1859312979036736:12345-8867@kfi7:101:default-tuolumne1036-0 Request processed in 944us (992us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851859.808406:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851859.808407:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:6.0:1773851859.808408:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8867@kfi7, seq: 371100839
00000400:00000200:5.0:1773851859.808408:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8803@kfi7: PUT: OK
00000100:00000040:6.0:1773851859.808409:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e66c65f1 : new rpc_count 0
00000400:00000200:5.0:1773851859.808409:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4270b1f
00000100:00000001:6.0:1773851859.808410:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851859.808410:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:5.0:1773851859.808410:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4270b1f.
00000100:00000001:5.0:1773851859.808410:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:6.0:1773851859.808411:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000100:00000001:5.0:1773851859.808411:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:6.0:1773851859.808412:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c7f00787.
00000400:00000200:5.0:1773851859.808412:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000020:00000010:6.0:1773851859.808413:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000020:00000040:6.0:1773851859.808413:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 9
00000800:00000200:5.0:1773851859.808413:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Transaction freed
00000100:00000001:6.0:1773851859.808414:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851859.808567:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.808568:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851859.808569:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.808571:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851859.808572:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.808574:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:13.0:1773851859.808575:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.808576:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:13.0:1773851859.808576:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.808577:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:13.0:1773851859.808578:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:13.0:1773851859.808578:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.808579:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 328 into portal 24 MB=0x69b1a86090380
00000400:00000200:13.0:1773851859.808580:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 328/328 into md 0x8242bd2ed [256] + 2688
00000800:00000200:13.0:1773851859.808582:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851859.808583:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.808584:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000001:13.0:1773851859.808585:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851859.808586:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:13.0:1773851859.808587:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac1b2dc7.
00000800:00000200:10.0:1773851859.808587:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.808587:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.808587:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000100:00000040:13.0:1773851859.808588:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ac1b2dc7 x1859388080456576 msgsize 328
00000800:00000200:10.0:1773851859.808589:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851859.808589:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000100:00100000:13.0:1773851859.808590:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-7@kfi7)
00000800:00000200:10.0:1773851859.808590:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:13.0:1773851859.808591:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851859.808591:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:9.0:1773851859.808591:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8866@kfi7(0000000082476ad8):0x568 version: 2; local version 2; negotiated version: 2
00000800:00000200:13.0:1773851859.808593:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851859.808593:0:1537104:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851859.808593:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
02000000:00000001:12.0:1773851859.808594:0:1537104:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851859.808594:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Using peer 8866@kfi7(0x568)
00000100:00000001:12.0:1773851859.808595:0:1537104:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851859.808595:0:1537104:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851859.808595:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.808596:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
02000000:00000001:12.0:1773851859.808597:0:1537104:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851859.808597:0:1537104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080456576
00000400:00000200:10.0:1773851859.808597:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8866@kfi7 : PUT - for me
00000020:00000001:12.0:1773851859.808598:0:1537104:0:(genops.c:802:class_conn2export()) Process entered
00000400:00000200:10.0:1773851859.808598:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000800:00000200:9.0:1773851859.808598:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 38 bytes to peer 0x568: rc=0
00000020:00000040:12.0:1773851859.808599:0:1537104:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:12.0:1773851859.808599:0:1537104:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:9.0:1773851859.808599:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000020:00000040:12.0:1773851859.808600:0:1537104:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000400:00000200:10.0:1773851859.808600:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 1
00000020:00000001:12.0:1773851859.808601:0:1537104:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000400:00000200:10.0:1773851859.808601:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000020:00000001:12.0:1773851859.808602:0:1537104:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000400:00000200:10.0:1773851859.808602:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000100:00000001:12.0:1773851859.808603:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:10.0:1773851859.808603:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000100:00000001:12.0:1773851859.808604:0:1537104:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:10.0:1773851859.808604:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8867@kfi7 to cpt 5
00000020:00000010:12.0:1773851859.808605:0:1537104:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008761aa61.
00000400:00000200:10.0:1773851859.808605:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8867@kfi7 of length 328 into portal 17 MB=0x69b0909a44ac0
00000020:00000010:12.0:1773851859.808606:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851859.808607:0:1537104:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000422619af.
00000400:00000200:10.0:1773851859.808607:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8867@kfi7 of length 328/328 into md 0x781559fe9 [2] + 984
00000100:00000040:12.0:1773851859.808609:0:1537104:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000800:00000200:10.0:1773851859.808609:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851859.808609:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_EVENT_TX_OK event status 0
00000100:00000001:12.0:1773851859.808610:0:1537104:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851859.808610:0:1537104:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851859.808610:0:1537104:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851859.808611:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851859.808611:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Transaction freed
00000100:00000001:12.0:1773851859.808612:0:1537104:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851859.808612:0:1537104:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851859.808612:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8866@kfi7: PUT: OK
00000100:00000001:10.0:1773851859.808613:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:14.0:1773851859.808614:0:1537109:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851859.808614:0:1537104:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000200:10.0:1773851859.808614:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000001:14.0:1773851859.808615:0:1537109:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851859.808615:0:1537104:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851859.808616:0:1537104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 1164650
00000100:00000010:10.0:1773851859.808616:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000abde729d.
00000100:00000001:14.0:1773851859.808617:0:1537109:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851859.808617:0:1537109:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851859.808617:0:1537104:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:12.0:1773851859.808617:0:1537104:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537163392 : -107002172388224 : ffff9eae9d864c80)
00000100:00000040:10.0:1773851859.808617:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000abde729d x1859312979036864 msgsize 328
00000100:00000040:12.0:1773851859.808618:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ac1b2dc7 x1859388080456576/t0(0) o1000->lustre5-MDT0004-mdtlov_UUID@7@kfi7:586/0 lens 328/0 e 0 to 0 dl 1773851946 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00100000:10.0:1773851859.808618:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-8867@kfi7 (source: 12345-8866@kfi7)
00000100:00000001:10.0:1773851859.808620:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:12.0:1773851859.808621:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:10.0:1773851859.808621:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000100:00000001:12.0:1773851859.808622:0:1537104:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:11.0:1773851859.808622:0:145944:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851859.808622:0:145944:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00100000:12.0:1773851859.808623:0:1537104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac1b2dc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:71738:x1859388080456576:12345-7@kfi7:1000:default-yuba5-0
00000100:00000001:11.0:1773851859.808623:0:145944:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851859.808623:0:145944:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851859.808623:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000200:12.0:1773851859.808624:0:1537104:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080456576
02000000:00000001:11.0:1773851859.808624:0:145944:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851859.808625:0:1537104:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851859.808625:0:1537104:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00100000:11.0:1773851859.808625:0:145944:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859312979036864
00000020:00000001:12.0:1773851859.808626:0:1537104:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851859.808626:0:145944:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851859.808626:0:145944:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d3c
00000020:00000001:12.0:1773851859.808627:0:1537104:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851859.808627:0:1537104:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667521856 : -1042029760 : ffffffffc1e3e340)
00000020:00000001:11.0:1773851859.808627:0:145944:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:12.0:1773851859.808628:0:1537104:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:12.0:1773851859.808629:0:1537104:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851859.808629:0:1537104:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000040:11.0:1773851859.808629:0:145944:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e66c65f1 refcount=10
00000020:00000001:12.0:1773851859.808630:0:1537104:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851859.808630:0:145944:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000020:00000001:12.0:1773851859.808631:0:1537104:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851859.808631:0:145944:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000020:00000001:12.0:1773851859.808632:0:1537104:0:(out_handler.c:970:out_handle()) Process entered
00000100:00000001:11.0:1773851859.808632:0:145944:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000010:12.0:1773851859.808633:0:1537104:0:(out_handler.c:993:out_handle()) kmalloced '(update_bufs)': 8 at 0000000030c31b0a.
00000100:00000001:11.0:1773851859.808633:0:145944:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851859.808634:0:145944:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009caf48ee.
00000100:00000001:12.0:1773851859.808635:0:1537104:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851859.808635:0:1537104:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000010:11.0:1773851859.808635:0:145944:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851859.808636:0:145944:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000689f1d89.
02000000:00000010:12.0:1773851859.808637:0:1537104:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 4576 at 0000000045f2ca70.
00000100:00000040:11.0:1773851859.808637:0:145944:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
02000000:00000001:12.0:1773851859.808638:0:1537104:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851859.808638:0:1537104:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.808638:0:145944:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851859.808638:0:145944:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:12.0:1773851859.808639:0:1537104:0:(lu_object.c:823:lu_object_find_at()) Process entered
00010000:00000001:11.0:1773851859.808639:0:145944:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00000020:00000001:12.0:1773851859.808640:0:1537104:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00010000:00000001:11.0:1773851859.808640:0:145944:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851859.808641:0:145944:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00000020:00000001:12.0:1773851859.808642:0:1537104:0:(out_handler.c:356:out_index_lookup()) Process entered
00080000:00000001:12.0:1773851859.808642:0:1537104:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00010000:00000001:11.0:1773851859.808644:0:145944:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851859.808644:0:145944:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851859.808645:0:145944:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000075ca223d refcount=3
00000020:00000001:11.0:1773851859.808645:0:145944:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000001:11.0:1773851859.808646:0:145944:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000001:11.0:1773851859.808647:0:145944:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851859.808648:0:145944:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851859.808648:0:145944:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:12.0:1773851859.808649:0:1537104:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:12.0:1773851859.808649:0:1537104:0:(osd_index.c:965:osd_remote_fid()) Process entered
00000100:00000001:11.0:1773851859.808649:0:145944:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:12.0:1773851859.808650:0:1537104:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:12.0:1773851859.808650:0:1537104:0:(fld_handler.c:211:fld_local_lookup()) Process entered
00000100:00000001:11.0:1773851859.808650:0:145944:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:12.0:1773851859.808651:0:1537104:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
00000100:00000001:11.0:1773851859.808651:0:145944:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
80000000:00000001:12.0:1773851859.808652:0:1537104:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:12.0:1773851859.808653:0:1537104:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:12.0:1773851859.808653:0:1537104:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.808653:0:145944:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00080000:00000001:12.0:1773851859.808654:0:1537104:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.808654:0:145944:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851859.808654:0:146452:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.808654:0:146452:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000020:00000040:12.0:1773851859.808655:0:1537104:0:(out_handler.c:389:out_index_lookup()) lookup [0x24001b599:0x10e2:0x0] slingshotmon get [0x2800256ea:0x3d:0x0] rc 1
00000100:00100000:11.0:1773851859.808655:0:145944:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8867@kfi7, seq: 39215911
00000020:00000040:12.0:1773851859.808656:0:1537104:0:(out_handler.c:393:out_index_lookup()) lustre5-MDT0001: insert lookup reply 000000001ee8c0db index 0: rc = 1
00000100:00000040:11.0:1773851859.808656:0:145944:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e66c65f1 : new rpc_count 1
00000100:00000001:11.0:1773851859.808656:0:145944:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637075820486528 : -106997889065088 : ffff9eaf9cd49f80)
00000100:00000001:10.0:1773851859.808656:0:146452:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851859.808657:0:1537104:0:(out_handler.c:398:out_index_lookup()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:11.0:1773851859.808657:0:145944:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000abde729d x1859312979036864/t0(0) o103->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 328/0 e 0 to 0 dl 1773851946 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:10.0:1773851859.808657:0:146452:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000002:12.0:1773851859.808659:0:1537104:0:(lu_object.c:224:lu_object_put()) Add 000000003fbfefe6/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000020:00000010:12.0:1773851859.808660:0:1537104:0:(out_handler.c:1241:out_handle()) kfreed 'update_bufs': 8 at 0000000030c31b0a.
00000020:00000001:12.0:1773851859.808660:0:1537104:0:(out_handler.c:1247:out_handle()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.808660:0:145944:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00010000:00000040:12.0:1773851859.808661:0:1537104:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080456576
00000100:00000001:11.0:1773851859.808661:0:145944:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851859.808661:0:145944:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abde729d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_009:bda4aca7-bf68-47b3-9c19-b2ccadf24735+10:39812:x1859312979036864:12345-8867@kfi7:103:
00010000:00000001:12.0:1773851859.808662:0:1537104:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851859.808663:0:1537104:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ac1b2dc7 x1859388080456576/t0(0) o1000->lustre5-MDT0004-mdtlov_UUID@7@kfi7:586/0 lens 328/4320 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 1/0 job:'default-yuba5-0'
00000100:00000200:11.0:1773851859.808663:0:145944:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859312979036864
00010000:00000001:11.0:1773851859.808664:0:145944:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:11.0:1773851859.808665:0:145944:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:11.0:1773851859.808665:0:145944:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00010000:00000001:12.0:1773851859.808666:0:1537104:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851859.808666:0:1537104:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.808666:0:145944:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000100:00001000:12.0:1773851859.808667:0:1537104:0:(import.c:1951:at_measured()) add 1 to 00000000a8c7027b time=19 v=66 (1 1 1 1)
02000000:00000001:11.0:1773851859.808667:0:145944:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000001:12.0:1773851859.808668:0:1537104:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
02000000:00000010:11.0:1773851859.808668:0:145944:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4cc4180.
02000000:00000001:11.0:1773851859.808668:0:145944:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851859.808669:0:1537104:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:12.0:1773851859.808669:0:1537104:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
00000100:00000001:11.0:1773851859.808669:0:145944:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851859.808670:0:1537104:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00010000:00000001:11.0:1773851859.808670:0:145944:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:11.0:1773851859.808670:0:145944:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
02000000:00000001:12.0:1773851859.808671:0:1537104:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851859.808671:0:1537104:0:(niobuf.c:55:ptl_send_buf()) Process entered
00010000:00000001:11.0:1773851859.808671:0:145944:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000040:12.0:1773851859.808672:0:1537104:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000020:00000001:11.0:1773851859.808672:0:145944:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851859.808672:0:145944:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000075ca223d refcount=3
00000400:00000010:12.0:1773851859.808673:0:1537104:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 0000000016a23a18 (tot 253200923).
00000020:00000001:11.0:1773851859.808673:0:145944:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00010000:00000001:11.0:1773851859.808673:0:145944:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105323154752 : -106968386396864 : ffff9eb67b539d40)
00000100:00000200:12.0:1773851859.808674:0:1537104:0:(niobuf.c:86:ptl_send_buf()) Sending 4320 bytes to portal 4, xid 1859388080456576, offset 224
00010000:00000040:11.0:1773851859.808674:0:145944:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 199
00000004:00000001:11.0:1773851859.808675:0:145944:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000400:00000200:12.0:1773851859.808676:0:1537104:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00010000:00000001:11.0:1773851859.808676:0:145944:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000400:00000200:12.0:1773851859.808677:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000020:00000001:11.0:1773851859.808677:0:145944:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00000400:00000200:12.0:1773851859.808678:0:1537104:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00010000:00000001:11.0:1773851859.808678:0:145944:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:11.0:1773851859.808678:0:145944:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851859.808679:0:145944:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851859.808680:0:1537104:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00010000:00000001:11.0:1773851859.808680:0:145944:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00000400:00000200:12.0:1773851859.808681:0:1537104:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00010000:00000001:11.0:1773851859.808681:0:145944:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00000400:00000200:12.0:1773851859.808682:0:1537104:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  7@kfi7 local destination
00010000:00000001:11.0:1773851859.808682:0:145944:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851859.808682:0:145944:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:12.0:1773851859.808683:0:1537104:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768861:8768861:1024:4294967295] 7@kfi7 LPNI seq info [17340059:17340059:16:4294967295]
00010000:00000001:11.0:1773851859.808683:0:145944:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:11.0:1773851859.808683:0:145944:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851859.808684:0:145944:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000075ca223d with handle 0x21b6f08f07a6ad38 from hash
00000400:00000200:12.0:1773851859.808685:0:1537104:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:12.0:1773851859.808685:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00010000:00000001:11.0:1773851859.808685:0:145944:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:11.0:1773851859.808685:0:145944:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851859.808685:0:145944:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851859.808686:0:145944:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00000400:00000200:12.0:1773851859.808687:0:1537104:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00010000:00000001:11.0:1773851859.808687:0:145944:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:11.0:1773851859.808687:0:145944:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851859.808688:0:1537104:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00010000:00000001:11.0:1773851859.808688:0:145944:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:11.0:1773851859.808688:0:145944:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:11.0:1773851859.808689:0:145944:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000075ca223d/0x21b6f08f07a6ad38 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a01000000000 nid: 8867@kfi7 remote: 0xcaff327788a52cb5 expref: 10 pid: 61015 timeout: 0 lvb_type: 0
00000800:00000200:12.0:1773851859.808690:0:1537104:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 1 allocated
00000800:00000200:12.0:1773851859.808692:0:1537104:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00010000:00000040:11.0:1773851859.808692:0:145944:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:11.0:1773851859.808693:0:145944:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e66c65f1 : new locks_count 3
00000020:00000040:11.0:1773851859.808693:0:145944:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 9
00000800:00000200:12.0:1773851859.808694:0:1537104:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x0 TN_EVENT_INIT_BULK event status 0
00010000:00000010:11.0:1773851859.808694:0:145944:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000008b7519f8.
00010000:00000040:11.0:1773851859.808695:0:145944:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000001:11.0:1773851859.808696:0:145944:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851859.808697:0:145944:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:11.0:1773851859.808697:0:145944:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:11.0:1773851859.808698:0:145944:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:11.0:1773851859.808699:0:145944:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851859.808700:0:145944:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851859.808700:0:145944:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00000800:00000200:12.0:1773851859.808701:0:1537104:0:(kfilnd_ep.c:374:kfilnd_ep_post_tagged_recv()) 2069@kfi7:3 Transaction ID 00000000ad3645cb: Posted tagged recv of 4320 bytes (2 frags) with tag 0x11b20001: rc=0
00010000:00000040:11.0:1773851859.808701:0:145944:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 197
00010000:00010000:11.0:1773851859.808701:0:145944:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:11.0:1773851859.808702:0:145944:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:12.0:1773851859.808703:0:1537104:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_TAGGED_RECV_POSTED state change
00010000:00000001:11.0:1773851859.808703:0:145944:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851859.808703:0:145944:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851859.808704:0:145944:0:(import.c:1951:at_measured()) add 1 to 00000000a7d9b651 time=113 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851859.808705:0:145944:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000800:00000200:12.0:1773851859.808706:0:1537104:0:(kfilnd_tn.c:603:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000100:00000040:11.0:1773851859.808706:0:145944:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eed30efc refcount 3 to 8867@kfi7
00000100:00000001:11.0:1773851859.808707:0:145944:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108704 : -107156354442912 : ffff9e8ab78ed960)
00000800:00000200:12.0:1773851859.808708:0:1537104:0:(kfilnd_tn.c:610:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x11b1 Using peer 7@kfi7(0x11b1)
02000000:00000001:11.0:1773851859.808708:0:145944:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851859.808708:0:145944:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.808709:0:145944:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851859.808710:0:145944:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8866@kfi7
00000400:00000010:11.0:1773851859.808710:0:145944:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000177f1aa0.
00000800:00000200:12.0:1773851859.808711:0:1537104:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 110 bytes to peer 0x11b1: rc=0
00000100:00000200:11.0:1773851859.808711:0:145944:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859312979036864, offset 224
00000800:00000200:12.0:1773851859.808712:0:1537104:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x11b1 TN_STATE_TAGGED_RECV_POSTED -> TN_STATE_WAIT_COMP state change
00000400:00000200:11.0:1773851859.808713:0:145944:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8866@kfi7
00000100:00000001:12.0:1773851859.808714:0:1537104:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851859.808714:0:145944:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000100:00000040:12.0:1773851859.808715:0:1537104:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00000400:00000200:11.0:1773851859.808715:0:145944:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 1
00010000:00000001:12.0:1773851859.808716:0:1537104:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851859.808716:0:1537104:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851859.808716:0:145944:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000020:00000001:12.0:1773851859.808717:0:1537104:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000400:00000200:11.0:1773851859.808717:0:145944:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000100:00000040:12.0:1773851859.808718:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac1b2dc7 x1859388080456576/t0(0) o1000->lustre5-MDT0004-mdtlov_UUID@7@kfi7:586/0 lens 328/4320 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 1/1 job:'default-yuba5-0'
00000400:00000200:11.0:1773851859.808718:0:145944:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8866@kfi7 local destination
00000400:00000200:11.0:1773851859.808720:0:145944:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768862:8768862:1023:4294967295] 8866@kfi7 LPNI seq info [2360112:2360112:16:4294967295]
00000400:00000200:11.0:1773851859.808721:0:145944:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000400:00000200:11.0:1773851859.808722:0:145944:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000100:00100000:12.0:1773851859.808723:0:1537104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac1b2dc7 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:71738:x1859388080456576:12345-7@kfi7:1000:default-yuba5-0 Request processed in 100us (134us total) trans 0 rc 1/1
00000400:00000200:11.0:1773851859.808724:0:145944:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8866@kfi7(8866@kfi7:8866@kfi7) <?> : PUT try# 0
00000100:00100000:12.0:1773851859.808728:0:1537104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 1164650
00000100:00000040:12.0:1773851859.808729:0:1537104:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:12.0:1773851859.808730:0:1537104:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851859.808730:0:1537104:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:11.0:1773851859.808730:0:145944:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000020:00000010:12.0:1773851859.808731:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851859.808732:0:1537104:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000422619af.
00000800:00000200:11.0:1773851859.808732:0:145944:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000020:00000010:12.0:1773851859.808733:0:1537104:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008761aa61.
00000020:00000040:12.0:1773851859.808733:0:1537104:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000800:00000200:11.0:1773851859.808733:0:145944:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:12.0:1773851859.808734:0:1537104:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851859.808735:0:145944:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851859.808737:0:145944:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Using peer 8866@kfi7(0x568)
00000800:00000200:14.0:1773851859.808741:0:2514739:0:(kfilnd_tn.c:1127:kfilnd_tn_state_wait_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000800:00000200:11.0:1773851859.808742:0:145944:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x568: rc=0
00000800:00000200:14.0:1773851859.808744:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x11b1 TN_STATE_WAIT_COMP -> TN_STATE_WAIT_TAG_COMP state change
00000800:00000200:11.0:1773851859.808744:0:145944:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851859.808746:0:145944:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851859.808747:0:145944:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eed30efc refcount 2 to 8867@kfi7
00000800:00000200:13.0:1773851859.808748:0:2514888:0:(kfilnd_tn.c:1307:kfilnd_tn_state_wait_tag_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x11b1 TN_EVENT_TAG_RX_OK event status 0
00010000:00000001:11.0:1773851859.808748:0:145944:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851859.808749:0:145944:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851859.808750:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.808751:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000040:11.0:1773851859.808751:0:145944:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000abde729d x1859312979036864/t0(0) o103->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 328/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000400:00000200:13.0:1773851859.808752:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000016a23a18
00000400:00000010:13.0:1773851859.808752:0:2514888:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 0000000016a23a18 (tot 253200771).
00000100:00000001:13.0:1773851859.808753:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851859.808754:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:11.0:1773851859.808754:0:145944:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abde729d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_009:bda4aca7-bf68-47b3-9c19-b2ccadf24735+9:39812:x1859312979036864:12345-8867@kfi7:103: Request processed in 93us (136us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851859.808754:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851859.808755:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:13.0:1773851859.808756:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_BULK_PUT_REQ TN 00000000ad3645cb: 2069@kfi7:3 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 1 trr 3 tta 0x11b1 Transaction freed
00000100:00100000:11.0:1773851859.808756:0:145944:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8867@kfi7, seq: 39215911
00000400:00000200:9.0:1773851859.808756:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.808756:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8866@kfi7: PUT: OK
00000100:00000040:11.0:1773851859.808757:0:145944:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e66c65f1 : new rpc_count 0
00000400:00000200:9.0:1773851859.808757:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000177f1aa0
00000100:00000001:11.0:1773851859.808758:0:145944:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851859.808758:0:145944:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:9.0:1773851859.808758:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000177f1aa0.
00000020:00000010:11.0:1773851859.808759:0:145944:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000100:00000001:9.0:1773851859.808759:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851859.808759:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851859.808760:0:145944:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000689f1d89.
00000020:00000010:11.0:1773851859.808760:0:145944:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009caf48ee.
00000400:00000200:9.0:1773851859.808760:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000020:00000040:11.0:1773851859.808761:0:145944:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 8
00000800:00000200:9.0:1773851859.808761:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Transaction freed
00000100:00000001:11.0:1773851859.808762:0:145944:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851859.808868:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.808869:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.808870:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.808872:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.808874:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.808876:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8803@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.808876:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.808878:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 1
00000400:00000200:5.0:1773851859.808879:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.808880:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:5.0:1773851859.808880:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000400:00000200:5.0:1773851859.808881:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8867@kfi7 to cpt 5
00000400:00000200:5.0:1773851859.808882:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8867@kfi7 of length 584 into portal 12 MB=0x69b0909a44b80
00000400:00000200:5.0:1773851859.808883:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8867@kfi7 of length 584/584 into md 0x793926dc5 [64] + 124656
00000800:00000200:5.0:1773851859.808885:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.808887:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.808888:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8803@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.808889:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.808889:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.808890:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000040f5e380.
00000100:00000040:5.0:1773851859.808891:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000040f5e380 x1859312979037056 msgsize 584
00000100:00100000:5.0:1773851859.808892:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-8867@kfi7 (source: 12345-8803@kfi7)
00000100:00000001:5.0:1773851859.808893:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:6.0:1773851859.808894:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851859.808894:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 2
02000000:00000001:6.0:1773851859.808895:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851859.808895:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851859.808895:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851859.808896:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851859.808897:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851859.808898:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859312979037056
00000020:00000001:6.0:1773851859.808898:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851859.808899:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d3c
00000020:00000001:6.0:1773851859.808899:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851859.808900:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e66c65f1 refcount=9
00000020:00000001:6.0:1773851859.808901:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000020:00000001:6.0:1773851859.808901:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000100:00000001:6.0:1773851859.808903:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851859.808903:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851859.808904:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000086f510d0.
00000020:00000010:6.0:1773851859.808905:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000004b9828c5.
00000020:00000010:6.0:1773851859.808906:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002c2921c5.
00000100:00000001:6.0:1773851859.808907:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851859.808908:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:6.0:1773851859.808908:0:61015:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:6.0:1773851859.808909:0:61015:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.808909:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.808910:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.808911:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.808913:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.808913:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.808913:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.808913:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.808914:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8867@kfi7, seq: 371100840
00000100:00000040:7.0:1773851859.808915:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e66c65f1 : new rpc_count 1
00000100:00000001:6.0:1773851859.808915:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.808916:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866950272 : -107088842601344 : ffff9e9a6f93cc80)
00000100:00000001:6.0:1773851859.808916:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.808917:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000040f5e380 x1859312979037056/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 584/0 e 0 to 0 dl 1773851946 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1036-0'
00000100:00000001:7.0:1773851859.808919:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.808920:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.808921:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040f5e380 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bda4aca7-bf68-47b3-9c19-b2ccadf24735+9:1597374:x1859312979037056:12345-8867@kfi7:101:default-tuolumne1036-0
00000100:00000200:7.0:1773851859.808923:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859312979037056
00000020:00000001:7.0:1773851859.808923:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.808924:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.808924:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.808925:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.808927:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:7.0:1773851859.808928:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.808929:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859312979037056, found 0 last_xid 1859312979037055
00000020:00000001:7.0:1773851859.808929:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.808930:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.808931:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.808931:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.808932:0:60963:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:7.0:1773851859.808933:0:60963:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:7.0:1773851859.808933:0:60963:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:7.0:1773851859.808933:0:60963:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:7.0:1773851859.808934:0:60963:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.808935:0:60963:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:7.0:1773851859.808936:0:60963:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 198
00010000:00000001:7.0:1773851859.808937:0:60963:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.808938:0:60963:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:7.0:1773851859.808939:0:60963:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000da4403a4.
00000020:00000001:7.0:1773851859.808939:0:60963:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:7.0:1773851859.808940:0:60963:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000da4403a4 with handle 0x21b6f08f07a6ad3f to hash
00000020:00000001:7.0:1773851859.808941:0:60963:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:7.0:1773851859.808941:0:60963:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162604963968 : -106911104587648 : ffff9ec3d196a880)
00010000:00000010:7.0:1773851859.808942:0:60963:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000bdb31ccf.
00010000:00000001:7.0:1773851859.808943:0:60963:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162604963968 : -106911104587648 : ffff9ec3d196a880)
00010000:00010000:7.0:1773851859.808944:0:60963:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000da4403a4/0x21b6f08f07a6ad3f lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 199 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcaff327788a52cbc expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.808947:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000040:7.0:1773851859.808948:0:60963:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000e66c65f1 : new locks_count 4
00000020:00000040:7.0:1773851859.808949:0:60963:0:(genops.c:871:class_export_get()) GET export 00000000e66c65f1 refcount=10
00010000:00000001:7.0:1773851859.808950:0:60963:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:7.0:1773851859.808950:0:60963:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:7.0:1773851859.808951:0:60963:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:7.0:1773851859.808952:0:60963:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:7.0:1773851859.808952:0:60963:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:7.0:1773851859.808953:0:60963:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:7.0:1773851859.808953:0:60963:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:7.0:1773851859.808954:0:60963:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:7.0:1773851859.808955:0:60963:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:7.0:1773851859.808956:0:60963:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:7.0:1773851859.808957:0:60963:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.808957:0:60963:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:7.0:1773851859.808958:0:60963:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:7.0:1773851859.808959:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.808959:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.808961:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 0000000032e4dbe5.
02000000:00000001:7.0:1773851859.808961:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.808962:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.808962:0:60963:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.808963:0:60963:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:7.0:1773851859.808964:0:60963:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:7.0:1773851859.808964:0:60963:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:7.0:1773851859.808965:0:60963:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.808965:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.808966:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.808966:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.808966:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.808967:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.808968:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.808968:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.808968:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.808969:0:60963:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:7.0:1773851859.808970:0:60963:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:7.0:1773851859.808970:0:60963:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:7.0:1773851859.808971:0:60963:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.808971:0:60963:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:7.0:1773851859.808972:0:60963:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.808972:0:60963:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:7.0:1773851859.808973:0:60963:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.808974:0:60963:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:7.0:1773851859.808975:0:60963:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 00000000f5ea1bbf
00000004:00000001:7.0:1773851859.808977:0:60963:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:7.0:1773851859.808978:0:60963:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:7.0:1773851859.808978:0:60963:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:7.0:1773851859.808979:0:60963:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:7.0:1773851859.808979:0:60963:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:7.0:1773851859.808980:0:60963:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:7.0:1773851859.808980:0:60963:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.808981:0:60963:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.808982:0:60963:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:7.0:1773851859.808982:0:60963:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000865cf951.
00000020:00000001:7.0:1773851859.808983:0:60963:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:7.0:1773851859.808984:0:60963:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000865cf951 with handle 0x21b6f08f07a6ad46 to hash
00000020:00000001:7.0:1773851859.808984:0:60963:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:7.0:1773851859.808985:0:60963:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162604959360 : -106911104592256 : ffff9ec3d1969680)
00010000:00000010:7.0:1773851859.808985:0:60963:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000000d07c69d.
00010000:00000001:7.0:1773851859.808986:0:60963:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162604959360 : -106911104592256 : ffff9ec3d1969680)
00010000:00000001:7.0:1773851859.808987:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.808987:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.808988:0:60963:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 200 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.808991:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.808991:0:60963:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:7.0:1773851859.808992:0:60963:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:7.0:1773851859.808992:0:60963:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:7.0:1773851859.808993:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.808993:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.808994:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.808994:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.808995:0:60963:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:7.0:1773851859.808995:0:60963:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:7.0:1773851859.808996:0:60963:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:7.0:1773851859.808996:0:60963:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:7.0:1773851859.808997:0:60963:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 199
00010000:00000040:7.0:1773851859.808998:0:60963:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:7.0:1773851859.808999:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809003:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809004:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809006:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809007:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809009:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809010:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809012:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809014:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809016:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809017:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809019:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809020:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809022:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809023:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809025:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809026:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809029:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809030:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809032:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809033:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809035:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809036:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809038:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809039:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809041:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809042:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809044:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809045:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809047:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809047:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809049:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809050:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809053:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809054:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809056:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809057:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809059:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809060:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809062:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809063:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809065:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809066:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809068:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809069:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809071:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809072:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809074:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809074:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 10 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809078:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809079:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809081:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809082:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809084:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809085:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809087:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809088:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809090:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809090:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809093:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809093:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809095:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809096:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809098:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809099:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809102:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809104:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809105:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809106:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809109:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809110:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809112:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809113:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809115:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809116:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809118:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809119:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809121:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809121:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809124:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809125:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809128:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809129:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809131:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809132:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809134:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809135:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809137:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809138:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809140:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809141:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809143:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809143:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809145:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809146:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a4d807 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25b3 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809148:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809149:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062815ce5/0x21b6f08f07a4d7cf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b924a expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809152:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809153:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d2098ccc/0x21b6f08f07a4d797 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0f4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809155:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809155:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f2deef/0x21b6f08f07a4d75f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84ed expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809158:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809159:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809160:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809161:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809163:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809164:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809166:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809167:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809169:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809170:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809172:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809173:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809176:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809177:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809179:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809180:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809182:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809183:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809185:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809185:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809188:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809188:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809190:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809191:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809193:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809194:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809196:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809197:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809199:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809200:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809202:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809203:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809205:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809206:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809208:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809208:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809211:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809212:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809214:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809215:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809217:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809217:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809219:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809220:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809223:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809224:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809226:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809226:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809228:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809229:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809231:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809232:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809234:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809235:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809237:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809238:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809240:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809241:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809243:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809244:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809247:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809248:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809250:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809251:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809253:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809253:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809255:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809256:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809258:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809259:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809261:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809262:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809264:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809265:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809267:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809268:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809271:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809272:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809274:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809275:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809277:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809278:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809280:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809281:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809283:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809284:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809286:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809286:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809289:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809289:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809291:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809292:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809304:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809305:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809307:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809308:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809310:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809311:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809313:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809314:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809316:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809317:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809319:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809319:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809322:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809322:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809325:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809325:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809330:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809331:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809333:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809334:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809336:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809336:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809338:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809339:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809341:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809342:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809344:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809345:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809347:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809348:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809350:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809351:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809354:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809355:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809357:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809358:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809360:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809360:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809362:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809363:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809365:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809366:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809368:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809369:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809371:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809371:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809373:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809374:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809378:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809379:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809381:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809381:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809383:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809384:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809386:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809387:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809389:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809390:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809392:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809393:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809395:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809396:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809398:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809399:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809402:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809403:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809405:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809406:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809408:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809409:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809411:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809412:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809414:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809415:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809417:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809417:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809419:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809420:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809422:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809423:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809426:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809427:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809429:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809430:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809432:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809433:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809435:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809436:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809438:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809439:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809441:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809441:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809444:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809444:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809446:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809447:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809451:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809451:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809453:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809454:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809456:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809457:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809459:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809460:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809462:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809463:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809465:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809465:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809467:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809468:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809470:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809471:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809473:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809474:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809476:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809477:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809479:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809480:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809482:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809483:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809485:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809486:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809488:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809488:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809491:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809491:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809493:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809494:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809497:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809498:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809500:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809501:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809503:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809503:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809505:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809506:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809509:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809510:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809512:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809513:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809515:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809515:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809518:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809518:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809521:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809522:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809524:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809524:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809526:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809527:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809529:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809530:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809532:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809533:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809535:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809536:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809538:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809538:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809541:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809541:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809545:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809546:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809548:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809549:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809551:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809551:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809553:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809554:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809556:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809557:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809559:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809560:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809562:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809563:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809566:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809566:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809570:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809571:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809573:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809573:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809575:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809576:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809578:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809579:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809581:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809582:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809584:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809585:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809587:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809588:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809590:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809590:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809594:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809595:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809597:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809598:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809600:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809601:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809603:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000040:7.0:1773851859.809603:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809606:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00010000:7.0:1773851859.809606:0:60963:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809608:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.809609:0:60963:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:7.0:1773851859.809610:0:60963:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:7.0:1773851859.809610:0:60963:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.809611:0:60963:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:7.0:1773851859.809611:0:60963:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.809612:0:60963:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.809613:0:60963:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.809613:0:60963:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:7.0:1773851859.809614:0:60963:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.809614:0:60963:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809617:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.809618:0:60963:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:7.0:1773851859.809618:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.809619:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.809619:0:60963:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:7.0:1773851859.809620:0:60963:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:7.0:1773851859.809621:0:60963:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000000b8f05d6.
00010000:00000010:7.0:1773851859.809622:0:60963:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 0000000063c4a189.
00010000:00000001:7.0:1773851859.809623:0:60963:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:7.0:1773851859.809624:0:60963:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000039bbed88.
00000020:00000001:7.0:1773851859.809625:0:60963:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:7.0:1773851859.809625:0:60963:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000039bbed88 with handle 0x21b6f08f07a6ad4d to hash
00000020:00000001:7.0:1773851859.809626:0:60963:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:7.0:1773851859.809626:0:60963:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000010:7.0:1773851859.809627:0:60963:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000930113b7.
00010000:00000001:7.0:1773851859.809628:0:60963:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000001:7.0:1773851859.809628:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.809629:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.809629:0:60963:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809632:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.809632:0:60963:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:7.0:1773851859.809633:0:60963:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:7.0:1773851859.809633:0:60963:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:7.0:1773851859.809634:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.809634:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.809634:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.809635:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.809635:0:60963:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:7.0:1773851859.809636:0:60963:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:7.0:1773851859.809636:0:60963:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:7.0:1773851859.809637:0:60963:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:7.0:1773851859.809637:0:60963:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (000000000b8f05d6) refcount = 1
00010000:00010000:7.0:1773851859.809638:0:60963:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809641:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.809641:0:60963:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:7.0:1773851859.809642:0:60963:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:7.0:1773851859.809642:0:60963:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.809642:0:60963:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:7.0:1773851859.809643:0:60963:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.809643:0:60963:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.809644:0:60963:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.809644:0:60963:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:7.0:1773851859.809645:0:60963:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.809645:0:60963:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809648:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.809648:0:60963:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:7.0:1773851859.809648:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.809649:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.809649:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.809650:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.809650:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000039bbed88 refcount=3
00000020:00000001:7.0:1773851859.809651:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000001:7.0:1773851859.809652:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000001:7.0:1773851859.809652:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.809653:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.809653:0:60963:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.809654:0:60963:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.809655:0:60963:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:7.0:1773851859.809661:0:60963:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:7.0:1773851859.809662:0:60963:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:7.0:1773851859.809663:0:60963:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851859.809665:0:60963:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:7.0:1773851859.809673:0:60963:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:7.0:1773851859.809674:0:60963:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:7.0:1773851859.809675:0:60963:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:7.0:1773851859.809676:0:60963:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:7.0:1773851859.809677:0:60963:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:7.0:1773851859.809678:0:60963:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:7.0:1773851859.809679:0:60963:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851859.809680:0:60963:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851859.809681:0:60963:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851859.809681:0:60963:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.809682:0:60963:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.809682:0:60963:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:7.0:1773851859.809683:0:60963:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:7.0:1773851859.809684:0:60963:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:7.0:1773851859.809685:0:60963:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:7.0:1773851859.809686:0:60963:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:7.0:1773851859.809686:0:60963:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:7.0:1773851859.809687:0:60963:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:7.0:1773851859.809687:0:60963:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:7.0:1773851859.809688:0:60963:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:7.0:1773851859.809689:0:60963:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 233
00010000:00000001:7.0:1773851859.809689:0:60963:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.809690:0:60963:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:7.0:1773851859.809690:0:60963:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000c684550b.
00000020:00000001:7.0:1773851859.809691:0:60963:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:7.0:1773851859.809692:0:60963:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000c684550b with handle 0x21b6f08f07a6ad54 to hash
00000020:00000001:7.0:1773851859.809692:0:60963:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:7.0:1773851859.809692:0:60963:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000010:7.0:1773851859.809693:0:60963:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000003f1022c5.
00010000:00000001:7.0:1773851859.809694:0:60963:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:7.0:1773851859.809695:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.809695:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.809696:0:60963:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000c684550b/0x21b6f08f07a6ad54 lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 234 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809701:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:7.0:1773851859.809701:0:60963:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:7.0:1773851859.809702:0:60963:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:7.0:1773851859.809702:0:60963:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:7.0:1773851859.809703:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.809703:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.809704:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.809704:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.809705:0:60963:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:7.0:1773851859.809705:0:60963:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:7.0:1773851859.809706:0:60963:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:7.0:1773851859.809706:0:60963:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:7.0:1773851859.809706:0:60963:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 233
00010000:00000040:7.0:1773851859.809707:0:60963:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:7.0:1773851859.809708:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809711:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809712:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809714:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809715:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809717:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809718:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809720:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809721:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809733:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809734:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809736:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809737:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809739:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809740:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809743:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809744:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809746:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809747:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809749:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809750:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809752:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809753:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809755:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809757:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809762:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809763:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809765:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809766:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809768:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809769:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809772:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809773:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809775:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809776:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809778:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809779:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809781:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809782:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809785:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809786:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 10 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809791:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809792:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809794:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809795:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809797:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809798:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809800:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809802:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809804:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809805:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809807:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809808:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809810:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809812:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809814:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809815:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809819:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809820:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809822:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809823:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809825:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809827:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809829:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809830:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809832:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809833:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809836:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809837:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809839:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809840:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809842:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809843:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809845:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809846:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809848:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809850:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809852:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809853:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809855:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809856:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809858:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809859:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809861:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809863:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809865:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809866:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809868:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809869:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809873:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809874:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f504d49/0x21b6f08f07a4d823 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25ba expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809876:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809878:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d71abe2/0x21b6f08f07a4d7eb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b9251 expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809880:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809881:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000057d4c5f/0x21b6f08f07a4d7b3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0fb expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809883:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809884:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc5e9c7/0x21b6f08f07a4d77b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84f4 expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809886:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809888:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809891:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809892:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809894:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809895:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809897:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809898:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809902:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809903:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809905:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809906:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809908:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809909:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809911:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809912:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809914:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809915:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809917:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809918:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809920:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809921:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809923:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809924:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809927:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809928:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809930:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809931:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809934:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809935:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809937:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809938:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809940:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809941:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809943:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809944:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809947:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809947:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809949:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809950:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809953:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809954:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809956:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809957:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809959:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809961:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809962:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809964:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809965:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809967:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809969:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809969:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809971:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809972:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809974:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809975:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809978:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809979:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809981:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809982:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809985:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809986:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809988:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809989:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809991:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809992:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809994:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809995:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.809997:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.809998:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810000:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810001:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810004:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810005:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810007:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810008:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810010:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810011:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810013:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810014:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810016:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810017:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810019:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810020:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810023:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810023:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810025:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810026:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810029:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810030:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810032:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810033:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810036:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810037:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810039:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810039:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810041:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810042:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810044:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810045:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810047:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810048:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810050:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810051:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810054:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810055:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810057:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810058:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810061:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810063:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810065:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810066:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810068:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810069:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810071:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810072:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810074:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810075:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810077:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810078:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810081:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810082:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810084:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810085:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810088:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810089:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810091:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810092:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810094:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810095:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810097:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810098:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810100:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810101:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810103:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810104:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810107:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810108:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810110:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810111:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810113:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810114:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810117:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810118:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810120:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810121:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810122:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810124:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810126:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810128:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810130:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810132:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810136:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810137:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810139:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810140:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810143:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810144:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810146:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810147:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810149:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810150:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810152:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810153:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810155:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810156:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810158:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810159:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810164:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810165:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810167:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810169:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810171:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810173:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810175:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810176:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810178:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810179:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810181:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810183:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810185:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810186:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810188:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810189:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810192:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810193:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810195:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810197:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810199:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810200:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810202:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810203:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810205:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810207:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810209:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810210:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810212:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810213:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810215:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810217:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810219:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810221:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810223:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810224:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810226:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810227:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810230:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810231:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810233:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810234:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810236:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810237:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810239:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810240:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810242:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810243:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810246:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810247:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810249:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810251:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810253:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810254:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810256:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810257:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810259:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810261:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810263:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810264:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810266:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810267:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810269:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810270:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810273:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810274:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810276:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810277:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810280:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810281:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810283:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810284:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810286:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810287:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810289:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810290:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810293:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810293:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810296:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810297:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810300:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810302:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810304:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810305:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810307:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810308:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810310:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810312:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810314:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810315:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810317:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810318:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810320:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810321:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810323:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810324:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810327:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810328:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810330:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810331:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810334:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810335:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810337:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810338:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810340:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810341:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810343:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810344:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810346:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810347:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810349:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810350:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810353:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810354:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810356:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810357:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810359:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810361:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810363:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810365:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810367:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810368:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810370:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810371:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810373:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810374:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810376:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810377:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810380:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810381:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810383:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810384:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810386:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810387:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810389:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810390:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810392:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810394:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810396:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810397:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810399:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810400:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810402:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810403:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810406:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810407:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810409:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810410:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810412:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810414:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810415:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810417:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810419:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810420:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810422:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810423:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810425:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810426:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810428:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810429:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810432:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810433:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810435:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810437:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810439:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810441:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810442:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810443:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810445:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810447:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810449:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810450:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810452:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810453:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810455:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810457:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810460:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810461:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810463:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810464:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810466:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810468:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810470:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810471:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810473:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810474:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810476:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810477:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810479:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810480:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810482:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810484:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810486:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810487:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810489:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810490:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810493:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:7.0:1773851859.810494:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810496:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00010000:7.0:1773851859.810496:0:60963:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000c684550b/0x21b6f08f07a6ad54 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810499:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:7.0:1773851859.810499:0:60963:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:7.0:1773851859.810500:0:60963:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:7.0:1773851859.810500:0:60963:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810501:0:60963:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:7.0:1773851859.810501:0:60963:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.810502:0:60963:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810502:0:60963:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.810503:0:60963:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:7.0:1773851859.810503:0:60963:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.810504:0:60963:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000c684550b/0x21b6f08f07a6ad54 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810506:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:7.0:1773851859.810507:0:60963:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:7.0:1773851859.810507:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810508:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810508:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.810509:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.810509:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c684550b refcount=3
00000020:00000001:7.0:1773851859.810509:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:7.0:1773851859.810510:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:7.0:1773851859.810511:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810511:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.810511:0:60963:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.810514:0:60963:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:7.0:1773851859.810515:0:60963:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:7.0:1773851859.810516:0:60963:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.810517:0:60963:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.810518:0:60963:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:7.0:1773851859.810518:0:60963:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:7.0:1773851859.810519:0:60963:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:7.0:1773851859.810521:0:60963:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.810521:0:60963:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810522:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.810523:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.810523:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c684550b refcount=3
00000020:00000001:7.0:1773851859.810524:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:7.0:1773851859.810524:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00000004:00010000:7.0:1773851859.810525:0:60963:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000c684550b/0x21b6f08f07a6ad54 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810527:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:7.0:1773851859.810527:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810528:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.810528:0:60963:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:7.0:1773851859.810529:0:60963:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:7.0:1773851859.810530:0:60963:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:7.0:1773851859.810530:0:60963:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:7.0:1773851859.810531:0:60963:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:7.0:1773851859.810532:0:60963:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:7.0:1773851859.810533:0:60963:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:7.0:1773851859.810534:0:60963:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:7.0:1773851859.810534:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.810535:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.810535:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000865cf951 refcount=3
00000020:00000001:7.0:1773851859.810536:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604959360 : -106911104592256 : ffff9ec3d1969680)
00010000:00000001:7.0:1773851859.810536:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604959360 : -106911104592256 : ffff9ec3d1969680)
00010000:00000001:7.0:1773851859.810537:0:60963:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:7.0:1773851859.810538:0:60963:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810540:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.810541:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810541:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:7.0:1773851859.810541:0:60963:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810544:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.810544:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.810545:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810546:0:60963:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:7.0:1773851859.810546:0:60963:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810548:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00010000:7.0:1773851859.810549:0:60963:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000865cf951 already unused, calling callback (000000001690cbe4)
00000004:00000001:7.0:1773851859.810550:0:60963:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:7.0:1773851859.810551:0:60963:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:7.0:1773851859.810552:0:60963:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810554:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.810555:0:60963:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:7.0:1773851859.810556:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.810556:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.810557:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000865cf951 refcount=4
00000020:00000001:7.0:1773851859.810557:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604959360 : -106911104592256 : ffff9ec3d1969680)
00010000:00000001:7.0:1773851859.810558:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604959360 : -106911104592256 : ffff9ec3d1969680)
00010000:00000001:7.0:1773851859.810558:0:60963:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:7.0:1773851859.810559:0:60963:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810561:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.810562:0:60963:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:7.0:1773851859.810562:0:60963:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:7.0:1773851859.810563:0:60963:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810563:0:60963:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:7.0:1773851859.810564:0:60963:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:7.0:1773851859.810564:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.810565:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851859.810565:0:60963:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000865cf951 with handle 0x21b6f08f07a6ad46 from hash
00010000:00000001:7.0:1773851859.810566:0:60963:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:7.0:1773851859.810567:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810567:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810567:0:60963:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:7.0:1773851859.810568:0:60963:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:7.0:1773851859.810568:0:60963:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810569:0:60963:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:7.0:1773851859.810569:0:60963:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:7.0:1773851859.810570:0:60963:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:7.0:1773851859.810570:0:60963:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:7.0:1773851859.810571:0:60963:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:7.0:1773851859.810572:0:60963:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.810573:0:60963:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810574:0:60963:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:7.0:1773851859.810574:0:60963:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:7.0:1773851859.810575:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810575:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810576:0:60963:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810577:0:60963:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.810577:0:60963:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.810578:0:60963:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810580:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000001:7.0:1773851859.810581:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810581:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810581:0:60963:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:7.0:1773851859.810582:0:60963:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:7.0:1773851859.810582:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:7.0:1773851859.810583:0:60963:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000865cf951/0x21b6f08f07a6ad46 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810585:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 199
00010000:00000010:7.0:1773851859.810586:0:60963:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000000d07c69d.
00010000:00000040:7.0:1773851859.810586:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000001:7.0:1773851859.810587:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.810588:0:60963:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:7.0:1773851859.810588:0:60963:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:7.0:1773851859.810588:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.810589:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.810589:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000039bbed88 refcount=3
00000020:00000001:7.0:1773851859.810590:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000001:7.0:1773851859.810590:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000001:7.0:1773851859.810591:0:60963:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:7.0:1773851859.810591:0:60963:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810593:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.810594:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810595:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:7.0:1773851859.810595:0:60963:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810601:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.810601:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.810602:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810602:0:60963:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:7.0:1773851859.810603:0:60963:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810605:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00010000:7.0:1773851859.810605:0:60963:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000039bbed88 already unused, calling callback (000000001690cbe4)
00000004:00000001:7.0:1773851859.810606:0:60963:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:7.0:1773851859.810606:0:60963:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:7.0:1773851859.810607:0:60963:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810609:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.810610:0:60963:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:7.0:1773851859.810610:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.810610:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.810611:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000039bbed88 refcount=4
00000020:00000001:7.0:1773851859.810611:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000001:7.0:1773851859.810612:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604958784 : -106911104592832 : ffff9ec3d1969440)
00010000:00000001:7.0:1773851859.810612:0:60963:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:7.0:1773851859.810613:0:60963:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810615:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.810615:0:60963:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:7.0:1773851859.810616:0:60963:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:7.0:1773851859.810616:0:60963:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810616:0:60963:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:7.0:1773851859.810617:0:60963:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:7.0:1773851859.810617:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.810618:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851859.810618:0:60963:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000039bbed88 with handle 0x21b6f08f07a6ad4d from hash
00010000:00000001:7.0:1773851859.810619:0:60963:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:7.0:1773851859.810620:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810620:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810620:0:60963:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:7.0:1773851859.810620:0:60963:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:7.0:1773851859.810621:0:60963:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810621:0:60963:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:7.0:1773851859.810622:0:60963:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:7.0:1773851859.810622:0:60963:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:7.0:1773851859.810623:0:60963:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (000000000b8f05d6)
00010000:00010000:7.0:1773851859.810624:0:60963:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:7.0:1773851859.810624:0:60963:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.810625:0:60963:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810625:0:60963:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:7.0:1773851859.810626:0:60963:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:7.0:1773851859.810626:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810627:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810627:0:60963:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810628:0:60963:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.810628:0:60963:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.810629:0:60963:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810631:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000001:7.0:1773851859.810631:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810632:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810632:0:60963:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:7.0:1773851859.810632:0:60963:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:7.0:1773851859.810633:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:7.0:1773851859.810633:0:60963:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000039bbed88/0x21b6f08f07a6ad4d lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810635:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 1
00010000:00000010:7.0:1773851859.810636:0:60963:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000930113b7.
00010000:00000040:7.0:1773851859.810637:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000b8f05d6 count: 0
00010000:00000010:7.0:1773851859.810638:0:60963:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 0000000063c4a189.
00010000:00000001:7.0:1773851859.810638:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.810639:0:60963:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:7.0:1773851859.810639:0:60963:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:7.0:1773851859.810640:0:60963:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:7.0:1773851859.810640:0:60963:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:7.0:1773851859.810641:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.810641:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.810641:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c684550b refcount=3
00000020:00000001:7.0:1773851859.810642:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:7.0:1773851859.810642:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00000004:00000040:7.0:1773851859.810643:0:60963:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000e66c65f1 : new locks_count 5
00000020:00000040:7.0:1773851859.810644:0:60963:0:(genops.c:871:class_export_get()) GET export 00000000e66c65f1 refcount=11
00010000:00000001:7.0:1773851859.810644:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810645:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.810645:0:60963:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:7.0:1773851859.810646:0:60963:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:7.0:1773851859.810646:0:60963:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:7.0:1773851859.810647:0:60963:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:7.0:1773851859.810647:0:60963:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:7.0:1773851859.810647:0:60963:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:7.0:1773851859.810648:0:60963:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:7.0:1773851859.810648:0:60963:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:7.0:1773851859.810649:0:60963:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.810650:0:60963:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:7.0:1773851859.810650:0:60963:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:7.0:1773851859.810651:0:60963:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:7.0:1773851859.810652:0:60963:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:7.0:1773851859.810652:0:60963:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:7.0:1773851859.810653:0:60963:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:7.0:1773851859.810653:0:60963:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:7.0:1773851859.810654:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810654:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810654:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.810655:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851859.810656:0:60963:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000da4403a4 with handle 0x21b6f08f07a6ad3f from hash
00010000:00000001:7.0:1773851859.810657:0:60963:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:7.0:1773851859.810657:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810658:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810658:0:60963:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:7.0:1773851859.810658:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:7.0:1773851859.810659:0:60963:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000da4403a4/0x21b6f08f07a6ad3f lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 199 type: IBT gid 0 flags: 0x44000000000000 nid: 8867@kfi7 remote: 0xcaff327788a52cbc expref: 11 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810661:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000040:7.0:1773851859.810662:0:60963:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e66c65f1 : new locks_count 4
00000020:00000040:7.0:1773851859.810662:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 10
00010000:00000010:7.0:1773851859.810663:0:60963:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000bdb31ccf.
00010000:00000040:7.0:1773851859.810663:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 197
00010000:00000001:7.0:1773851859.810664:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.810664:0:60963:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810665:0:60963:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:7.0:1773851859.810666:0:60963:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000c684550b/0x21b6f08f07a6ad54 lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52cbc expref: 10 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.810668:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:7.0:1773851859.810669:0:60963:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:7.0:1773851859.810669:0:60963:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:7.0:1773851859.810670:0:60963:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:7.0:1773851859.810670:0:60963:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:7.0:1773851859.810671:0:60963:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.810672:0:60963:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.810672:0:60963:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:7.0:1773851859.810672:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.810673:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:7.0:1773851859.810673:0:60963:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c684550b, rc 0)
00000020:00000001:7.0:1773851859.810674:0:60963:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.810675:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200607, transno 0, xid 1859312979037056
00010000:00000001:7.0:1773851859.810676:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.810676:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000040f5e380 x1859312979037056/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 584/640 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1036-0'
00010000:00000001:7.0:1773851859.810679:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.810680:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.810680:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.810682:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.810682:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eed30efc refcount 3 to 8867@kfi7
00000100:00000001:7.0:1773851859.810683:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108704 : -107156354442912 : ffff9e8ab78ed960)
02000000:00000001:7.0:1773851859.810684:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.810684:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.810685:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.810686:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8803@kfi7
00000400:00000010:7.0:1773851859.810687:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f88013b1.
00000100:00000200:7.0:1773851859.810687:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859312979037056, offset 224
00000400:00000200:7.0:1773851859.810689:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8803@kfi7
00000400:00000200:7.0:1773851859.810690:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.810690:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 1
00000400:00000200:7.0:1773851859.810692:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:7.0:1773851859.810693:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000400:00000200:7.0:1773851859.810694:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8803@kfi7 local destination
00000400:00000200:7.0:1773851859.810695:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768863:8768863:1024:4294967295] 8803@kfi7 LPNI seq info [2360113:2360113:16:4294967295]
00000400:00000200:7.0:1773851859.810697:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:7.0:1773851859.810697:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.810700:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8803@kfi7(8803@kfi7:8803@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.810701:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000800:00000200:7.0:1773851859.810702:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.810703:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:7.0:1773851859.810706:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.810708:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Using peer 8803@kfi7(0x100000000000c28)
00000800:00000200:7.0:1773851859.810712:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 740 bytes to peer 0x100000000000c28: rc=0
00000800:00000200:7.0:1773851859.810713:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.810715:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.810716:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eed30efc refcount 2 to 8867@kfi7
00010000:00000001:7.0:1773851859.810717:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.810717:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.810718:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.810719:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000040f5e380 x1859312979037056/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 584/640 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1036-0'
00000100:00100000:7.0:1773851859.810722:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040f5e380 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bda4aca7-bf68-47b3-9c19-b2ccadf24735+10:1597374:x1859312979037056:12345-8867@kfi7:101:default-tuolumne1036-0 Request processed in 1802us (1830us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851859.810725:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851859.810727:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8867@kfi7, seq: 371100840
00000100:00000040:7.0:1773851859.810727:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e66c65f1 : new rpc_count 0
00000100:00000001:7.0:1773851859.810728:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851859.810729:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.810729:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000004b9828c5.
00000400:00000200:5.0:1773851859.810729:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851859.810730:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002c2921c5.
00000400:00000200:5.0:1773851859.810730:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8803@kfi7: PUT: OK
00000020:00000010:7.0:1773851859.810731:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000086f510d0.
00000400:00000200:5.0:1773851859.810731:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f88013b1
00000400:00000010:5.0:1773851859.810731:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f88013b1.
00000020:00000040:7.0:1773851859.810732:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 9
00000100:00000001:5.0:1773851859.810732:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851859.810733:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851859.810733:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.810733:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000800:00000200:5.0:1773851859.810735:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Transaction freed
00000800:00000200:9.0:1773851859.810841:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.810842:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851859.810844:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851859.810846:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851859.810847:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.810849:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8866@kfi7 : PUT - for me
00000400:00000200:9.0:1773851859.810849:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.810850:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 1
00000400:00000200:9.0:1773851859.810851:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.810853:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000400:00000200:9.0:1773851859.810853:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000400:00000200:9.0:1773851859.810854:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8867@kfi7 to cpt 5
00000400:00000200:9.0:1773851859.810855:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8867@kfi7 of length 328 into portal 17 MB=0x69b0909a44c00
00000400:00000200:9.0:1773851859.810857:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8867@kfi7 of length 328/328 into md 0x781559fe9 [2] + 1312
00000800:00000200:9.0:1773851859.810859:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851859.810860:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.810861:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8866@kfi7: PUT: OK
00000100:00000001:9.0:1773851859.810862:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851859.810863:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:9.0:1773851859.810864:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000171a07a9.
00000100:00000040:9.0:1773851859.810864:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000171a07a9 x1859312979037184 msgsize 328
00000100:00100000:9.0:1773851859.810866:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8867@kfi7 (source: 12345-8866@kfi7)
00000100:00000001:9.0:1773851859.810867:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851859.810868:0:145944:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851859.810868:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
02000000:00000001:11.0:1773851859.810869:0:145944:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851859.810869:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851859.810870:0:145944:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851859.810870:0:145944:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851859.810871:0:145944:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851859.810872:0:145944:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859312979037184
00000020:00000001:11.0:1773851859.810873:0:145944:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851859.810874:0:145944:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d3c
00000020:00000001:11.0:1773851859.810875:0:145944:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851859.810875:0:145944:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e66c65f1 refcount=10
00000020:00000001:11.0:1773851859.810876:0:145944:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000020:00000001:11.0:1773851859.810877:0:145944:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000100:00000001:11.0:1773851859.810878:0:145944:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851859.810878:0:145944:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851859.810879:0:145944:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000be46a1da.
00000020:00000010:11.0:1773851859.810880:0:145944:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851859.810881:0:145944:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000689f1d89.
00000100:00000040:11.0:1773851859.810882:0:145944:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:11.0:1773851859.810883:0:145944:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851859.810883:0:145944:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:11.0:1773851859.810883:0:145944:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:11.0:1773851859.810884:0:145944:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851859.810884:0:145944:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:11.0:1773851859.810885:0:145944:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:11.0:1773851859.810885:0:145944:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851859.810886:0:145944:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c684550b refcount=3
00000020:00000001:11.0:1773851859.810887:0:145944:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:11.0:1773851859.810888:0:145944:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:11.0:1773851859.810888:0:145944:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851859.810889:0:145944:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:11.0:1773851859.810889:0:145944:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.810890:0:145944:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.810891:0:145944:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.810892:0:145944:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.810893:0:145944:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.810893:0:146452:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.810893:0:146452:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851859.810894:0:145944:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851859.810895:0:146452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8867@kfi7, seq: 39215912
00000100:00000001:11.0:1773851859.810896:0:145944:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.810896:0:145944:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.810896:0:146452:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e66c65f1 : new rpc_count 1
00000100:00000001:10.0:1773851859.810896:0:146452:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064861440 : -106983644690176 : ffff9eb2eddc8900)
00000100:00000040:10.0:1773851859.810898:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000171a07a9 x1859312979037184/t0(0) o103->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 328/0 e 0 to 0 dl 1773851946 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:10.0:1773851859.810901:0:146452:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.810901:0:146452:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851859.810902:0:146452:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000171a07a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:bda4aca7-bf68-47b3-9c19-b2ccadf24735+10:39813:x1859312979037184:12345-8867@kfi7:103:
00000100:00000200:10.0:1773851859.810904:0:146452:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859312979037184
00010000:00000001:10.0:1773851859.810904:0:146452:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:10.0:1773851859.810905:0:146452:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:10.0:1773851859.810905:0:146452:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:10.0:1773851859.810906:0:146452:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851859.810907:0:146452:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851859.810907:0:146452:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000301023b1.
02000000:00000001:10.0:1773851859.810908:0:146452:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.810909:0:146452:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.810909:0:146452:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:10.0:1773851859.810910:0:146452:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:10.0:1773851859.810910:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851859.810911:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.810911:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c684550b refcount=3
00000020:00000001:10.0:1773851859.810912:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000001:10.0:1773851859.810912:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604957056 : -106911104594560 : ffff9ec3d1968d80)
00010000:00000040:10.0:1773851859.810913:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 234
00000004:00000001:10.0:1773851859.810914:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851859.810915:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851859.810915:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851859.810916:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851859.810916:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.810916:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.810918:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851859.810918:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851859.810919:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851859.810920:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851859.810920:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851859.810921:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851859.810922:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c684550b with handle 0x21b6f08f07a6ad54 from hash
00010000:00000001:10.0:1773851859.810922:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851859.810923:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851859.810923:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851859.810923:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851859.810924:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851859.810925:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.810925:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851859.810925:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851859.810926:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c684550b/0x21b6f08f07a6ad54 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 235 type: IBT gid 0 flags: 0x44a01000000000 nid: 8867@kfi7 remote: 0xcaff327788a52cbc expref: 10 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851859.810929:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 234
00010000:00000040:10.0:1773851859.810929:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e66c65f1 : new locks_count 3
00000020:00000040:10.0:1773851859.810930:0:146452:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 9
00010000:00000010:10.0:1773851859.810931:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003f1022c5.
00010000:00000040:10.0:1773851859.810932:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000001:10.0:1773851859.810932:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851859.810932:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851859.810933:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851859.810934:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:10.0:1773851859.810935:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851859.810936:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.810936:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851859.810936:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 232
00010000:00010000:10.0:1773851859.810937:0:146452:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:10.0:1773851859.810937:0:146452:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851859.810938:0:146452:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851859.810939:0:146452:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851859.810939:0:146452:0:(import.c:1951:at_measured()) add 1 to 00000000a7d9b651 time=113 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851859.810941:0:146452:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851859.810941:0:146452:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eed30efc refcount 3 to 8867@kfi7
00000100:00000001:10.0:1773851859.810942:0:146452:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108704 : -107156354442912 : ffff9e8ab78ed960)
02000000:00000001:10.0:1773851859.810943:0:146452:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851859.810943:0:146452:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.810944:0:146452:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851859.810945:0:146452:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8866@kfi7
00000400:00000010:10.0:1773851859.810945:0:146452:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004fc8f544.
00000100:00000200:10.0:1773851859.810946:0:146452:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859312979037184, offset 224
00000400:00000200:10.0:1773851859.810948:0:146452:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8866@kfi7
00000400:00000200:10.0:1773851859.810949:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.810949:0:146452:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 1
00000400:00000200:10.0:1773851859.810950:0:146452:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000400:00000200:10.0:1773851859.810951:0:146452:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000400:00000200:10.0:1773851859.810953:0:146452:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8866@kfi7 local destination
00000400:00000200:10.0:1773851859.810954:0:146452:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768864:8768864:1024:4294967295] 8866@kfi7 LPNI seq info [2360114:2360114:16:4294967295]
00000400:00000200:10.0:1773851859.810955:0:146452:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000400:00000200:10.0:1773851859.810956:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.810958:0:146452:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8866@kfi7(8866@kfi7:8866@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851859.810959:0:146452:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000800:00000200:10.0:1773851859.810960:0:146452:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851859.810961:0:146452:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851859.810963:0:146452:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851859.810966:0:146452:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Using peer 8866@kfi7(0x568)
00000800:00000200:10.0:1773851859.810969:0:146452:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000348da31e: Posted send of 324 bytes to peer 0x568: rc=0
00000800:00000200:10.0:1773851859.810970:0:146452:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851859.810972:0:146452:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.810973:0:146452:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eed30efc refcount 2 to 8867@kfi7
00010000:00000001:10.0:1773851859.810973:0:146452:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.810974:0:146452:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.810975:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000171a07a9 x1859312979037184/t0(0) o103->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 328/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:10.0:1773851859.810978:0:146452:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000171a07a9 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:bda4aca7-bf68-47b3-9c19-b2ccadf24735+9:39813:x1859312979037184:12345-8867@kfi7:103: Request processed in 76us (112us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851859.810980:0:146452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8867@kfi7, seq: 39215912
00000100:00000040:10.0:1773851859.810980:0:146452:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e66c65f1 : new rpc_count 0
00000800:00000200:9.0:1773851859.810980:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851859.810981:0:146452:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851859.810981:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851859.810982:0:146452:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851859.810982:0:146452:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000020:00000010:10.0:1773851859.810983:0:146452:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000689f1d89.
00000400:00000200:9.0:1773851859.810983:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8866@kfi7: PUT: OK
00000020:00000010:10.0:1773851859.810984:0:146452:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000be46a1da.
00000400:00000200:9.0:1773851859.810984:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004fc8f544
00000400:00000010:9.0:1773851859.810984:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004fc8f544.
00000020:00000040:10.0:1773851859.810985:0:146452:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 8
00000100:00000001:10.0:1773851859.810985:0:146452:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851859.810985:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851859.810986:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851859.810986:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000800:00000200:9.0:1773851859.810988:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Transaction freed
00000800:00000200:6.0:1773851859.812380:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851859.812381:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851859.812382:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851859.812384:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851859.812386:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.812387:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8803@kfi7 : PUT - for me
00000400:00000200:6.0:1773851859.812388:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.812389:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 1
00000400:00000200:6.0:1773851859.812390:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.812390:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:6.0:1773851859.812391:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000400:00000200:6.0:1773851859.812392:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8867@kfi7 to cpt 5
00000400:00000200:6.0:1773851859.812393:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8867@kfi7 of length 576 into portal 12 MB=0x69b0909a45000
00000400:00000200:6.0:1773851859.812394:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8867@kfi7 of length 576/576 into md 0x793926dc5 [64] + 125240
00000800:00000200:6.0:1773851859.812396:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851859.812398:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851859.812399:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8803@kfi7: PUT: OK
00000100:00000001:6.0:1773851859.812400:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851859.812401:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851859.812402:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f45454b.
00000100:00000040:6.0:1773851859.812403:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000008f45454b x1859312979038208 msgsize 576
00000100:00100000:6.0:1773851859.812404:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-8867@kfi7 (source: 12345-8803@kfi7)
00000100:00000001:6.0:1773851859.812405:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851859.812406:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851859.812406:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 2
02000000:00000001:7.0:1773851859.812407:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851859.812407:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851859.812407:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851859.812408:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.812409:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.812410:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859312979038208
00000020:00000001:7.0:1773851859.812410:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.812411:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d3c
00000020:00000001:7.0:1773851859.812411:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.812412:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e66c65f1 refcount=9
00000020:00000001:7.0:1773851859.812413:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000020:00000001:7.0:1773851859.812414:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000100:00000001:7.0:1773851859.812416:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.812416:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.812417:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851859.812418:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.812419:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851859.812419:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.812420:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:7.0:1773851859.812420:0:60963:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:7.0:1773851859.812421:0:60963:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.812421:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.812422:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.812423:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.812424:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.812424:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.812425:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.812425:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.812426:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8867@kfi7, seq: 371100841
00000100:00000040:7.0:1773851859.812427:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e66c65f1 : new rpc_count 1
00000100:00000001:7.0:1773851859.812427:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123260371200 : -106950449180416 : ffff9ebaa877d100)
00000100:00000001:6.0:1773851859.812427:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851859.812427:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.812428:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008f45454b x1859312979038208/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 576/0 e 0 to 0 dl 1773851946 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1036-0'
00000100:00000001:7.0:1773851859.812431:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.812431:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.812432:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f45454b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bda4aca7-bf68-47b3-9c19-b2ccadf24735+9:1597374:x1859312979038208:12345-8867@kfi7:101:default-tuolumne1036-0
00000100:00000200:7.0:1773851859.812434:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859312979038208
00000020:00000001:7.0:1773851859.812434:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.812435:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.812435:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.812436:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.812436:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:7.0:1773851859.812437:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.812437:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859312979038208, found 0 last_xid 1859312979038207
00000020:00000001:7.0:1773851859.812439:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.812439:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.812439:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.812440:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.812441:0:60963:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:7.0:1773851859.812441:0:60963:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:7.0:1773851859.812441:0:60963:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:7.0:1773851859.812442:0:60963:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:7.0:1773851859.812442:0:60963:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.812444:0:60963:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:7.0:1773851859.812445:0:60963:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 198
00010000:00000001:7.0:1773851859.812446:0:60963:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.812446:0:60963:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:7.0:1773851859.812447:0:60963:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000000bbf066c.
00000020:00000001:7.0:1773851859.812448:0:60963:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:7.0:1773851859.812448:0:60963:0:(lustre_handles.c:97:class_handle_hash()) added object 000000000bbf066c with handle 0x21b6f08f07a6ad5b to hash
00000020:00000001:7.0:1773851859.812449:0:60963:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:7.0:1773851859.812449:0:60963:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162604957632 : -106911104593984 : ffff9ec3d1968fc0)
00010000:00000010:7.0:1773851859.812450:0:60963:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000bdb31ccf.
00010000:00000001:7.0:1773851859.812451:0:60963:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162604957632 : -106911104593984 : ffff9ec3d1968fc0)
00010000:00010000:7.0:1773851859.812451:0:60963:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000000bbf066c/0x21b6f08f07a6ad5b lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 199 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xcaff327788a52ce6 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812454:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000040:7.0:1773851859.812455:0:60963:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000e66c65f1 : new locks_count 4
00000020:00000040:7.0:1773851859.812455:0:60963:0:(genops.c:871:class_export_get()) GET export 00000000e66c65f1 refcount=10
00010000:00000001:7.0:1773851859.812457:0:60963:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:7.0:1773851859.812457:0:60963:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:7.0:1773851859.812458:0:60963:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:7.0:1773851859.812458:0:60963:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:7.0:1773851859.812459:0:60963:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:7.0:1773851859.812459:0:60963:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:7.0:1773851859.812459:0:60963:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:7.0:1773851859.812460:0:60963:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:7.0:1773851859.812462:0:60963:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:7.0:1773851859.812463:0:60963:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:7.0:1773851859.812463:0:60963:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.812464:0:60963:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:7.0:1773851859.812465:0:60963:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:7.0:1773851859.812465:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.812466:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.812467:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 0000000050aaa03c.
02000000:00000001:7.0:1773851859.812468:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.812468:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.812469:0:60963:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.812469:0:60963:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:7.0:1773851859.812470:0:60963:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:7.0:1773851859.812470:0:60963:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:7.0:1773851859.812471:0:60963:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.812471:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.812472:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.812472:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.812472:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.812473:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.812473:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.812474:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.812474:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.812474:0:60963:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:7.0:1773851859.812475:0:60963:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:7.0:1773851859.812476:0:60963:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:7.0:1773851859.812476:0:60963:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.812477:0:60963:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:7.0:1773851859.812477:0:60963:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.812478:0:60963:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:7.0:1773851859.812478:0:60963:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.812478:0:60963:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:7.0:1773851859.812479:0:60963:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 00000000e3c02320
00000004:00000001:7.0:1773851859.812480:0:60963:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:7.0:1773851859.812480:0:60963:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:7.0:1773851859.812481:0:60963:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:7.0:1773851859.812481:0:60963:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:7.0:1773851859.812482:0:60963:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 199
00010000:00000001:7.0:1773851859.812482:0:60963:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.812483:0:60963:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:7.0:1773851859.812484:0:60963:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000028a79677.
00000020:00000001:7.0:1773851859.812484:0:60963:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:7.0:1773851859.812485:0:60963:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000028a79677 with handle 0x21b6f08f07a6ad62 to hash
00000020:00000001:7.0:1773851859.812486:0:60963:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:7.0:1773851859.812486:0:60963:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000010:7.0:1773851859.812487:0:60963:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000930113b7.
00010000:00000001:7.0:1773851859.812487:0:60963:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000001:7.0:1773851859.812488:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.812489:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.812489:0:60963:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000028a79677/0x21b6f08f07a6ad62 lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 200 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812492:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:7.0:1773851859.812492:0:60963:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:7.0:1773851859.812493:0:60963:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:7.0:1773851859.812493:0:60963:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:7.0:1773851859.812493:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.812494:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.812495:0:60963:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:7.0:1773851859.812495:0:60963:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.812496:0:60963:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:7.0:1773851859.812496:0:60963:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:7.0:1773851859.812497:0:60963:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:7.0:1773851859.812497:0:60963:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:7.0:1773851859.812497:0:60963:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 199
00010000:00000040:7.0:1773851859.812498:0:60963:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:7.0:1773851859.812499:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812501:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812503:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812505:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812506:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812508:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812509:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812511:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812512:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812514:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812515:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812517:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812518:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812520:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812522:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812524:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812525:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812528:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812529:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812531:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812533:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812535:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812535:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812538:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812538:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812541:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812542:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812544:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812545:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812547:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812548:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812550:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812551:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812553:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812554:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812556:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812557:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812559:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812560:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812562:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812563:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 10 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812565:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812565:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812567:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812568:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812570:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812571:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 7 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812574:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812574:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812576:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812588:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812590:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812591:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812593:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812594:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812596:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812597:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812599:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812600:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812602:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812603:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812605:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812607:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812609:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812610:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812612:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812614:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812616:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812617:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812619:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812621:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812623:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812623:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812626:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812627:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812629:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812630:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812632:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812634:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812636:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812637:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812639:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812641:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812643:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812644:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812646:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812647:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812649:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812650:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812652:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812653:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008294d81b/0x21b6f08f07a4d831 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25e4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812655:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812656:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6fd604e/0x21b6f08f07a4d7f9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b927b expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812658:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812659:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a4d7c1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc125 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812662:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812663:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000006bb1a52/0x21b6f08f07a4d789 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 18624@kfi7 remote: 0x235fb118a33c851e expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812665:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812668:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812670:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812671:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812673:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812674:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812676:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812677:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812678:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812679:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812681:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812682:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812684:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812686:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812688:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812689:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812691:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812692:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812694:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812695:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812697:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812699:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812701:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812702:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812704:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812705:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812707:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812708:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812710:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812711:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812713:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812714:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812716:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812718:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812720:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812721:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812723:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812724:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812728:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812729:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812731:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812732:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812734:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812736:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812737:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812738:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812740:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812741:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812743:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812745:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812747:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812749:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812750:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812752:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812754:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812754:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812756:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812758:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812760:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812761:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812763:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812764:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812766:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812767:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812769:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812770:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812772:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812774:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812776:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812776:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812779:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812780:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812782:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812783:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812785:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812786:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812788:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812789:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812791:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812792:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812795:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812796:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812799:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812799:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812801:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812802:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812804:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812806:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812808:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812809:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812811:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812812:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812814:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812815:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812817:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812818:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812820:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812822:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812825:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812826:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812828:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812829:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812831:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812833:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812835:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812836:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812838:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812839:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812842:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812842:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812845:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812846:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812848:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812850:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812852:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812853:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812855:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812856:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812858:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812859:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812860:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812861:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812863:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812865:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812867:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812868:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812870:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812871:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812873:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812874:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812877:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812878:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812880:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812881:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812883:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812884:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812886:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812887:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812889:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812890:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812892:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812893:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812895:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812896:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812898:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812899:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812902:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812903:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812905:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812906:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812908:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812909:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812911:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812912:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812914:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812915:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812917:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812919:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812921:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812922:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812924:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812926:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812928:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812929:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812931:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812932:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812934:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812936:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812938:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812939:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812941:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812942:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812944:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812945:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812947:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812948:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812950:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812952:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812954:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812955:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812957:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812958:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812961:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812962:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812964:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812965:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812967:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812968:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812970:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812971:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812973:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812975:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812976:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812978:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812980:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812981:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812983:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812984:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812986:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812987:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812989:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812990:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812992:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812993:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812995:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.812996:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.812998:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813000:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813001:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813003:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813005:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813007:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813009:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813010:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813012:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813013:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813015:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813016:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813019:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813020:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813021:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813023:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813025:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813026:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813028:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813029:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813031:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813032:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813034:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813035:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813037:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813039:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813041:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813042:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813044:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813045:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813047:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813048:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813050:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813051:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813053:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813055:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813057:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813058:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813060:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813061:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813063:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813064:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813066:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813067:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813068:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813070:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813072:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813073:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813075:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813076:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813078:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813081:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813083:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813085:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813087:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813088:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813090:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813091:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813093:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813094:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813096:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813097:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813099:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813100:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813103:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813104:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813106:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813108:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813110:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813111:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813113:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813114:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813116:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813117:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813119:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813120:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813122:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813123:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813125:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813126:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813129:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813130:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813132:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813134:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813136:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813137:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813139:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813140:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813142:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813143:0:60963:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813145:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00010000:7.0:1773851859.813145:0:60963:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000028a79677/0x21b6f08f07a6ad62 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813147:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:7.0:1773851859.813148:0:60963:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:7.0:1773851859.813149:0:60963:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:7.0:1773851859.813149:0:60963:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.813150:0:60963:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:7.0:1773851859.813150:0:60963:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.813151:0:60963:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.813151:0:60963:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851859.813152:0:60963:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:7.0:1773851859.813152:0:60963:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:7.0:1773851859.813153:0:60963:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000028a79677/0x21b6f08f07a6ad62 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813155:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000001:7.0:1773851859.813156:0:60963:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:7.0:1773851859.813157:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.813157:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.813157:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.813158:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.813158:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028a79677 refcount=3
00000020:00000001:7.0:1773851859.813159:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000001:7.0:1773851859.813159:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000001:7.0:1773851859.813160:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.813160:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.813161:0:60963:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.813161:0:60963:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.813162:0:60963:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:7.0:1773851859.813163:0:60963:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:7.0:1773851859.813163:0:60963:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:7.0:1773851859.813170:0:60963:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.813171:0:60963:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:7.0:1773851859.813171:0:60963:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:7.0:1773851859.813171:0:60963:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:7.0:1773851859.813173:0:60963:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813174:0:60963:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813174:0:60963:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813175:0:60963:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:7.0:1773851859.813175:0:60963:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:7.0:1773851859.813176:0:60963:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:7.0:1773851859.813176:0:60963:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813177:0:60963:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813177:0:60963:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:7.0:1773851859.813178:0:60963:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:7.0:1773851859.813179:0:60963:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.813179:0:60963:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:7.0:1773851859.813180:0:60963:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.813180:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.813180:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:7.0:1773851859.813181:0:60963:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:7.0:1773851859.813182:0:60963:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:7.0:1773851859.813182:0:60963:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:7.0:1773851859.813183:0:60963:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:7.0:1773851859.813184:0:60963:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:7.0:1773851859.813185:0:60963:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:7.0:1773851859.813186:0:60963:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:7.0:1773851859.813186:0:60963:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.813187:0:60963:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:7.0:1773851859.813187:0:60963:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:7.0:1773851859.813187:0:60963:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:7.0:1773851859.813188:0:60963:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:7.0:1773851859.813188:0:60963:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813189:0:60963:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813189:0:60963:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:7.0:1773851859.813190:0:60963:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.813191:0:60963:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:7.0:1773851859.813192:0:60963:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.813192:0:60963:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.813194:0:60963:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.813194:0:60963:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:7.0:1773851859.813195:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.813195:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028a79677 refcount=3
00000020:00000001:7.0:1773851859.813196:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000001:7.0:1773851859.813197:0:60963:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00000004:00000040:7.0:1773851859.813197:0:60963:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000e66c65f1 : new locks_count 5
00000020:00000040:7.0:1773851859.813198:0:60963:0:(genops.c:871:class_export_get()) GET export 00000000e66c65f1 refcount=11
00010000:00000001:7.0:1773851859.813199:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.813199:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:7.0:1773851859.813199:0:60963:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:7.0:1773851859.813200:0:60963:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:7.0:1773851859.813200:0:60963:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:7.0:1773851859.813201:0:60963:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:7.0:1773851859.813201:0:60963:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:7.0:1773851859.813201:0:60963:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:7.0:1773851859.813202:0:60963:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:7.0:1773851859.813202:0:60963:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:7.0:1773851859.813203:0:60963:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851859.813204:0:60963:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:7.0:1773851859.813204:0:60963:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:7.0:1773851859.813205:0:60963:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:7.0:1773851859.813206:0:60963:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:7.0:1773851859.813206:0:60963:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:7.0:1773851859.813207:0:60963:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:7.0:1773851859.813207:0:60963:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:7.0:1773851859.813208:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.813208:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.813208:0:60963:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:7.0:1773851859.813209:0:60963:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851859.813209:0:60963:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000000bbf066c with handle 0x21b6f08f07a6ad5b from hash
00010000:00000001:7.0:1773851859.813210:0:60963:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:7.0:1773851859.813211:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.813211:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.813211:0:60963:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:7.0:1773851859.813212:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:7.0:1773851859.813212:0:60963:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000000bbf066c/0x21b6f08f07a6ad5b lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 200 type: IBT gid 0 flags: 0x44000000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ce6 expref: 11 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813214:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:7.0:1773851859.813215:0:60963:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e66c65f1 : new locks_count 4
00000020:00000040:7.0:1773851859.813216:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 10
00010000:00000010:7.0:1773851859.813217:0:60963:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000bdb31ccf.
00010000:00000040:7.0:1773851859.813217:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000001:7.0:1773851859.813218:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:7.0:1773851859.813218:0:60963:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.813219:0:60963:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:7.0:1773851859.813219:0:60963:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 0000000028a79677/0x21b6f08f07a6ad62 lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 199 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ce6 expref: 10 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:7.0:1773851859.813222:0:60963:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000001:7.0:1773851859.813223:0:60963:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:7.0:1773851859.813223:0:60963:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:7.0:1773851859.813224:0:60963:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:7.0:1773851859.813225:0:60963:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:7.0:1773851859.813226:0:60963:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851859.813226:0:60963:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851859.813227:0:60963:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:7.0:1773851859.813227:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851859.813228:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:7.0:1773851859.813228:0:60963:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000028a79677, rc 0)
00000020:00000001:7.0:1773851859.813229:0:60963:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.813229:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200607, transno 0, xid 1859312979038208
00010000:00000001:7.0:1773851859.813230:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.813231:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008f45454b x1859312979038208/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 576/640 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1036-0'
00010000:00000001:7.0:1773851859.813233:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.813234:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.813234:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.813235:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.813236:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eed30efc refcount 3 to 8867@kfi7
00000100:00000001:7.0:1773851859.813237:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108704 : -107156354442912 : ffff9e8ab78ed960)
02000000:00000001:7.0:1773851859.813238:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.813238:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.813239:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.813239:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8803@kfi7
00000400:00000010:7.0:1773851859.813240:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b13b474a.
00000100:00000200:7.0:1773851859.813241:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859312979038208, offset 224
00000400:00000200:7.0:1773851859.813242:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8803@kfi7
00000400:00000200:7.0:1773851859.813243:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.813244:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 1
00000400:00000200:7.0:1773851859.813245:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:7.0:1773851859.813246:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000400:00000200:7.0:1773851859.813247:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8803@kfi7 local destination
00000400:00000200:7.0:1773851859.813248:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768865:8768865:1024:4294967295] 8803@kfi7 LPNI seq info [2360115:2360115:16:4294967295]
00000400:00000200:7.0:1773851859.813250:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000400:00000200:7.0:1773851859.813251:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8803@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.813253:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8803@kfi7(8803@kfi7:8803@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.813254:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 3
00000800:00000200:7.0:1773851859.813255:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.813256:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:7.0:1773851859.813258:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.813261:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Using peer 8803@kfi7(0x100000000000c28)
00000800:00000200:7.0:1773851859.813263:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 740 bytes to peer 0x100000000000c28: rc=0
00000800:00000200:7.0:1773851859.813265:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.813267:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.813268:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eed30efc refcount 2 to 8867@kfi7
00010000:00000001:7.0:1773851859.813268:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.813269:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.813269:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.813270:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f45454b x1859312979038208/t0(0) o101->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 576/640 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1036-0'
00000100:00100000:7.0:1773851859.813273:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f45454b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bda4aca7-bf68-47b3-9c19-b2ccadf24735+10:1597374:x1859312979038208:12345-8867@kfi7:101:default-tuolumne1036-0 Request processed in 841us (869us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851859.813275:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8867@kfi7, seq: 371100841
00000100:00000040:7.0:1773851859.813276:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e66c65f1 : new rpc_count 0
00000100:00000001:7.0:1773851859.813277:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:6.0:1773851859.813277:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851859.813278:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.813278:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.813279:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000400:00000200:6.0:1773851859.813279:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851859.813280:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000400:00000200:6.0:1773851859.813280:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8803@kfi7: PUT: OK
00000400:00000200:6.0:1773851859.813281:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b13b474a
00000400:00000010:6.0:1773851859.813281:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b13b474a.
00000020:00000040:7.0:1773851859.813282:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 9
00000100:00000001:7.0:1773851859.813282:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851859.813282:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851859.813283:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851859.813284:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006dabee32 nid 8803@kfi7 refs 2
00000800:00000200:6.0:1773851859.813285:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 8803@kfi7(0000000061d57823):0x0 lsk 3113 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c28 Transaction freed
00000800:00000200:9.0:1773851859.813428:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.813429:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851859.813430:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851859.813433:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851859.813435:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.813436:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8866@kfi7 : PUT - for me
00000400:00000200:9.0:1773851859.813437:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.813438:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 1
00000400:00000200:9.0:1773851859.813439:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.813439:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000400:00000200:9.0:1773851859.813440:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000400:00000200:9.0:1773851859.813441:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8867@kfi7 to cpt 5
00000400:00000200:9.0:1773851859.813442:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8867@kfi7 of length 328 into portal 17 MB=0x69b0909a45080
00000400:00000200:9.0:1773851859.813443:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8867@kfi7 of length 328/328 into md 0x781559fe9 [2] + 1640
00000800:00000200:9.0:1773851859.813445:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851859.813447:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.813448:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8866@kfi7: PUT: OK
00000100:00000001:9.0:1773851859.813449:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851859.813449:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:9.0:1773851859.813450:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005684d651.
00000100:00000040:9.0:1773851859.813451:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000005684d651 x1859312979038336 msgsize 328
00000100:00100000:9.0:1773851859.813452:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8867@kfi7 (source: 12345-8866@kfi7)
00000100:00000001:9.0:1773851859.813453:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:10.0:1773851859.813454:0:146452:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851859.813454:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
02000000:00000001:10.0:1773851859.813455:0:146452:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851859.813455:0:146452:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851859.813455:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851859.813456:0:146452:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851859.813456:0:146452:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851859.813457:0:146452:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859312979038336
00000020:00000001:10.0:1773851859.813458:0:146452:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851859.813458:0:146452:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d3c
00000020:00000001:10.0:1773851859.813459:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.813460:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e66c65f1 refcount=10
00000020:00000001:10.0:1773851859.813461:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000020:00000001:10.0:1773851859.813461:0:146452:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628526080 : -107123081025536 : ffff9e9276cee800)
00000100:00000001:10.0:1773851859.813462:0:146452:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.813463:0:146452:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851859.813463:0:146452:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e20f2dfd.
00000020:00000010:10.0:1773851859.813464:0:146452:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851859.813465:0:146452:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000040:10.0:1773851859.813466:0:146452:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:10.0:1773851859.813467:0:146452:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851859.813467:0:146452:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:10.0:1773851859.813467:0:146452:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:10.0:1773851859.813468:0:146452:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.813468:0:146452:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:10.0:1773851859.813469:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851859.813469:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.813470:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028a79677 refcount=3
00000020:00000001:10.0:1773851859.813471:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000001:10.0:1773851859.813471:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000001:10.0:1773851859.813472:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851859.813472:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851859.813473:0:146452:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.813473:0:146452:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.813474:0:146452:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.813475:0:146452:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.813476:0:145944:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.813476:0:146452:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851859.813477:0:145944:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851859.813477:0:146452:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851859.813478:0:146452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8867@kfi7, seq: 39215913
00000100:00000040:10.0:1773851859.813478:0:146452:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e66c65f1 : new rpc_count 1
00000100:00000001:11.0:1773851859.813479:0:145944:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.813479:0:146452:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064872960 : -106983644678656 : ffff9eb2eddcb600)
00000100:00000001:11.0:1773851859.813480:0:145944:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.813480:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005684d651 x1859312979038336/t0(0) o103->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 328/0 e 0 to 0 dl 1773851946 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:10.0:1773851859.813482:0:146452:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.813483:0:146452:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851859.813484:0:146452:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005684d651 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:bda4aca7-bf68-47b3-9c19-b2ccadf24735+10:39811:x1859312979038336:12345-8867@kfi7:103:
00000100:00000200:10.0:1773851859.813485:0:146452:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859312979038336
00010000:00000001:10.0:1773851859.813485:0:146452:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:10.0:1773851859.813486:0:146452:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:10.0:1773851859.813486:0:146452:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:10.0:1773851859.813487:0:146452:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851859.813487:0:146452:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851859.813488:0:146452:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057130d88.
02000000:00000001:10.0:1773851859.813488:0:146452:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.813489:0:146452:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.813490:0:146452:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:10.0:1773851859.813490:0:146452:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:10.0:1773851859.813490:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851859.813491:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.813491:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000028a79677 refcount=3
00000020:00000001:10.0:1773851859.813492:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000001:10.0:1773851859.813492:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637162604962240 : -106911104589376 : ffff9ec3d196a1c0)
00010000:00000040:10.0:1773851859.813493:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 199
00000004:00000001:10.0:1773851859.813493:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851859.813494:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851859.813494:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851859.813494:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851859.813495:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.813495:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.813496:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851859.813497:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851859.813498:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851859.813498:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851859.813499:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851859.813499:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851859.813500:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000028a79677 with handle 0x21b6f08f07a6ad62 from hash
00010000:00000001:10.0:1773851859.813500:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851859.813501:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851859.813501:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851859.813502:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851859.813502:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851859.813503:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.813503:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851859.813503:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851859.813504:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000028a79677/0x21b6f08f07a6ad62 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 200 type: IBT gid 0 flags: 0x44a01000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ce6 expref: 10 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851859.813507:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 199
00010000:00000040:10.0:1773851859.813507:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000e66c65f1 : new locks_count 3
00000020:00000040:10.0:1773851859.813508:0:146452:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 9
00010000:00000010:10.0:1773851859.813508:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000930113b7.
00010000:00000040:10.0:1773851859.813509:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000001:10.0:1773851859.813509:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851859.813510:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851859.813510:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851859.813511:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:10.0:1773851859.813512:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851859.813512:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.813513:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851859.813513:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 197
00010000:00010000:10.0:1773851859.813514:0:146452:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:10.0:1773851859.813514:0:146452:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851859.813515:0:146452:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851859.813515:0:146452:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851859.813516:0:146452:0:(import.c:1951:at_measured()) add 1 to 00000000a7d9b651 time=113 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851859.813517:0:146452:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851859.813517:0:146452:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eed30efc refcount 3 to 8867@kfi7
00000100:00000001:10.0:1773851859.813518:0:146452:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108704 : -107156354442912 : ffff9e8ab78ed960)
02000000:00000001:10.0:1773851859.813519:0:146452:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851859.813519:0:146452:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.813520:0:146452:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851859.813521:0:146452:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8866@kfi7
00000400:00000010:10.0:1773851859.813521:0:146452:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c9e6803.
00000100:00000200:10.0:1773851859.813522:0:146452:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859312979038336, offset 224
00000400:00000200:10.0:1773851859.813523:0:146452:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8866@kfi7
00000400:00000200:10.0:1773851859.813524:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.813525:0:146452:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 1
00000400:00000200:10.0:1773851859.813526:0:146452:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000400:00000200:10.0:1773851859.813527:0:146452:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000400:00000200:10.0:1773851859.813528:0:146452:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8866@kfi7 local destination
00000400:00000200:10.0:1773851859.813529:0:146452:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768866:8768866:1024:4294967295] 8866@kfi7 LPNI seq info [2360116:2360116:16:4294967295]
00000400:00000200:10.0:1773851859.813530:0:146452:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000400:00000200:10.0:1773851859.813531:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8866@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.813532:0:146452:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8866@kfi7(8866@kfi7:8866@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851859.813533:0:146452:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 3
00000800:00000200:10.0:1773851859.813534:0:146452:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851859.813535:0:146452:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851859.813537:0:146452:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851859.813539:0:146452:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Using peer 8866@kfi7(0x568)
00000800:00000200:10.0:1773851859.813541:0:146452:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d35a17e8: Posted send of 324 bytes to peer 0x568: rc=0
00000800:00000200:10.0:1773851859.813543:0:146452:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851859.813544:0:146452:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.813545:0:146452:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eed30efc refcount 2 to 8867@kfi7
00010000:00000001:10.0:1773851859.813545:0:146452:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851859.813546:0:146452:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.813547:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005684d651 x1859312979038336/t0(0) o103->bda4aca7-bf68-47b3-9c19-b2ccadf24735@8867@kfi7:586/0 lens 328/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:10.0:1773851859.813549:0:146452:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005684d651 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:bda4aca7-bf68-47b3-9c19-b2ccadf24735+9:39811:x1859312979038336:12345-8867@kfi7:103: Request processed in 66us (98us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851859.813551:0:146452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8867@kfi7, seq: 39215913
00000100:00000040:10.0:1773851859.813552:0:146452:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e66c65f1 : new rpc_count 0
00000100:00000001:10.0:1773851859.813553:0:146452:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851859.813553:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851859.813554:0:146452:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851859.813554:0:146452:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000400:00000200:9.0:1773851859.813554:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851859.813555:0:146452:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:10.0:1773851859.813555:0:146452:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e20f2dfd.
00000020:00000040:10.0:1773851859.813556:0:146452:0:(genops.c:882:class_export_put()) PUTting export 00000000e66c65f1 : new refcount 8
00000400:00000200:9.0:1773851859.813556:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8866@kfi7: PUT: OK
00000400:00000200:9.0:1773851859.813556:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c9e6803
00000100:00000001:10.0:1773851859.813557:0:146452:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851859.813557:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c9e6803.
00000100:00000001:9.0:1773851859.813558:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851859.813558:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851859.813559:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f080dbe6 nid 8866@kfi7 refs 2
00000800:00000200:9.0:1773851859.813560:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 8866@kfi7(0000000082476ad8):0x0 lsk 1385 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x568 Transaction freed
00010000:00000010:11.1:1773851859.815727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000075ca223d.
00010000:00000010:6.1F:1773851859.815727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d4391b74.
00000800:00000200:13.0:1773851859.818115:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.818116:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851859.818117:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.818119:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851859.818121:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16257@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.818122:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16257@kfi7 : PUT - for me
00000400:00000200:13.0:1773851859.818122:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16257@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.818123:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f069ac8c nid 16257@kfi7 refs 1
00000400:00000200:13.0:1773851859.818124:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16257@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.818125:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f069ac8c nid 16257@kfi7 refs 2
00000400:00000200:13.0:1773851859.818125:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f069ac8c nid 16257@kfi7 refs 3
00000400:00000200:13.0:1773851859.818126:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16257@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.818127:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16257@kfi7 of length 224 into portal 12 MB=0x69b4b604ce6c0
00000400:00000200:13.0:1773851859.818131:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16257@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 20392
00000800:00000200:13.0:1773851859.818132:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851859.818134:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.818135:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16257@kfi7: PUT: OK
00000100:00000001:13.0:1773851859.818136:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851859.818136:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851859.818137:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000295be08e.
00000100:00000040:13.0:1773851859.818138:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000295be08e x1859597900768960 msgsize 224
00000100:00100000:13.0:1773851859.818139:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-16257@kfi7 (source: 12345-16257@kfi7)
00000100:00000001:13.0:1773851859.818140:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851859.818141:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f069ac8c nid 16257@kfi7 refs 2
00000100:00000001:15.0:1773851859.818142:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851859.818142:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851859.818142:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851859.818143:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851859.818143:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851859.818144:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851859.818145:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597900768960
00000020:00000001:15.0:1773851859.818146:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851859.818146:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d814e6
00000020:00000001:15.0:1773851859.818147:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851859.818150:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000070a93b85 refcount=7
00000020:00000001:15.0:1773851859.818151:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131968922624 : -106941740628992 : ffff9ebcaf89c400)
00000020:00000001:15.0:1773851859.818152:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131968922624 : -106941740628992 : ffff9ebcaf89c400)
00000100:00000001:15.0:1773851859.818153:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.818154:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851859.818155:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9af698f.
00000020:00000010:15.0:1773851859.818156:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851859.818157:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851859.818157:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851859.818158:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851859.818158:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.818159:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851859.818160:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851859.818160:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.818161:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.818162:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.818163:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851859.818163:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851859.818164:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16257@kfi7, seq: 2289797
00000100:00000001:13.0:1773851859.818164:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851859.818165:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000070a93b85 : new rpc_count 1
00000100:00000001:15.0:1773851859.818165:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537147264 : -107002172404352 : ffff9eae9d860d80)
00000100:00000001:13.0:1773851859.818165:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.818165:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851859.818166:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000295be08e x1859597900768960/t0(0) o400->aaa616bd-0a27-4b74-b74e-c9975009b021@16257@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1508-0'
00000100:00000001:15.0:1773851859.818169:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.818169:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851859.818170:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000295be08e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:aaa616bd-0a27-4b74-b74e-c9975009b021+7:39586:x1859597900768960:12345-16257@kfi7:400:default-tuolumne1508-0
00000100:00000200:15.0:1773851859.818172:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597900768960
00000020:00000001:15.0:1773851859.818172:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851859.818173:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851859.818174:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.818174:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851859.818175:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851859.818176:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851859.818176:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597900768960, found 0 last_xid 1859597900768959
00000020:00000001:15.0:1773851859.818178:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851859.818178:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851859.818179:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851859.818179:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.818180:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851859.818181:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851859.818181:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851859.818182:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d490019c.
02000000:00000001:15.0:1773851859.818183:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.818183:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.818184:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851859.818185:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035325092, transno 0, xid 1859597900768960
00010000:00000001:15.0:1773851859.818186:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851859.818186:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000295be08e x1859597900768960/t0(0) o400->aaa616bd-0a27-4b74-b74e-c9975009b021@16257@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1508-0'
00010000:00000001:15.0:1773851859.818189:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851859.818189:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851859.818190:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=92 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851859.818191:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851859.818192:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004161f66c refcount 3 to 16257@kfi7
00000100:00000001:15.0:1773851859.818192:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621504 : -107151221930112 : ffff9e8be97ac780)
02000000:00000001:15.0:1773851859.818193:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851859.818193:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.818194:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851859.818195:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16257@kfi7
00000400:00000010:15.0:1773851859.818195:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000616bd872.
00000100:00000200:15.0:1773851859.818196:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597900768960, offset 224
00000400:00000200:15.0:1773851859.818197:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16257@kfi7
00000400:00000200:15.0:1773851859.818198:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16257@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.818199:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f069ac8c nid 16257@kfi7 refs 1
00000400:00000200:15.0:1773851859.818200:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f069ac8c nid 16257@kfi7 refs 2
00000400:00000200:15.0:1773851859.818201:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f069ac8c nid 16257@kfi7 refs 3
00000400:00000200:15.0:1773851859.818202:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16257@kfi7 local destination
00000400:00000200:15.0:1773851859.818204:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768867:8768867:1024:4294967295] 16257@kfi7 LPNI seq info [853969:853969:16:4294967295]
00000400:00000200:15.0:1773851859.818206:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f069ac8c nid 16257@kfi7 refs 2
00000400:00000200:15.0:1773851859.818207:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16257@kfi7 to cpt 3
00000400:00000200:15.0:1773851859.818209:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16257@kfi7(16257@kfi7:16257@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851859.818210:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f069ac8c nid 16257@kfi7 refs 3
00000800:00000200:15.0:1773851859.818211:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851859.818212:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851859.818214:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851859.818216:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bf Using peer 16257@kfi7(0x1000000000002bf)
00000800:00000200:15.0:1773851859.818219:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x1000000000002bf: rc=0
00000800:00000200:15.0:1773851859.818220:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851859.818222:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851859.818223:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004161f66c refcount 2 to 16257@kfi7
00010000:00000001:15.0:1773851859.818224:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851859.818224:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851859.818225:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851859.818226:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000295be08e x1859597900768960/t0(0) o400->aaa616bd-0a27-4b74-b74e-c9975009b021@16257@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1508-0'
00000100:00100000:15.0:1773851859.818228:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000295be08e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:aaa616bd-0a27-4b74-b74e-c9975009b021+7:39586:x1859597900768960:12345-16257@kfi7:400:default-tuolumne1508-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851859.818231:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16257@kfi7, seq: 2289797
00000100:00000040:15.0:1773851859.818231:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000070a93b85 : new rpc_count 0
00000100:00000001:15.0:1773851859.818232:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851859.818233:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851859.818233:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:13.0:1773851859.818233:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bf TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851859.818234:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000400:00000200:13.0:1773851859.818234:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851859.818235:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9af698f.
00000400:00000200:13.0:1773851859.818235:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16257@kfi7: PUT: OK
00000020:00000040:15.0:1773851859.818236:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000070a93b85 : new refcount 6
00000400:00000200:13.0:1773851859.818236:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000616bd872
00000400:00000010:13.0:1773851859.818236:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000616bd872.
00000100:00000001:15.0:1773851859.818237:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851859.818237:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851859.818238:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851859.818238:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f069ac8c nid 16257@kfi7 refs 2
00000800:00000200:13.0:1773851859.818240:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16257@kfi7(00000000d9175e7b):0x0 lsk 704 rsk 17 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bf Transaction freed
00010000:00000010:10.1:1773851859.822727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c684550b.
00010000:00000010:10.1:1773851859.822728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000028a79677.
00010000:00000010:7.1F:1773851859.822728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000865cf951.
00010000:00000010:7.1:1773851859.822730:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000000b8f05d6.
00010000:00000010:7.1:1773851859.822731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000039bbed88.
00010000:00000010:7.1:1773851859.822731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000da4403a4.
00010000:00000010:7.1:1773851859.830727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000000bbf066c.
00000800:00000200:5.0:1773851859.844237:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.844238:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851859.844240:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851859.844241:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14945@kfi7(000000008d62a3d0):0x570 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851859.844243:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 Using peer 14945@kfi7(0x570)
00000800:00000200:6.0:1773851859.844245:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851859.844245:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14945@kfi7 to cpt 1
00000800:00000200:6.0:1773851859.844246:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.844246:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 38 bytes to peer 0x570: rc=0
00000800:00000200:6.0:1773851859.844248:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.844248:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851859.844252:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851859.844255:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14945@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.844257:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14945@kfi7 : PUT - for me
00000400:00000200:6.0:1773851859.844258:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14945@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.844260:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a5c55f3 nid 14945@kfi7 refs 1
00000800:00000200:5.0:1773851859.844260:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851859.844261:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14945@kfi7 to cpt 1
00000800:00000200:5.0:1773851859.844262:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 Transaction freed
00000400:00000200:6.0:1773851859.844263:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a5c55f3 nid 14945@kfi7 refs 2
00000400:00000200:6.0:1773851859.844265:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a5c55f3 nid 14945@kfi7 refs 3
00000400:00000200:6.0:1773851859.844266:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14945@kfi7 to cpt 1
00000400:00000200:6.0:1773851859.844267:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14945@kfi7 of length 224 into portal 12 MB=0x69b82d37200c0
00000400:00000200:6.0:1773851859.844270:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14945@kfi7 of length 224/224 into md 0x793926dc5 [64] + 125816
00000800:00000200:6.0:1773851859.844273:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851859.844275:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851859.844277:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14945@kfi7: PUT: OK
00000100:00000001:6.0:1773851859.844279:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851859.844279:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851859.844281:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa4914c4.
00000100:00000040:6.0:1773851859.844282:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000aa4914c4 x1859836055781568 msgsize 224
00000100:00100000:6.0:1773851859.844285:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-14945@kfi7 (source: 12345-14945@kfi7)
00000100:00000001:6.0:1773851859.844286:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851859.844288:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a5c55f3 nid 14945@kfi7 refs 2
00000100:00000001:7.0:1773851859.844289:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.844290:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851859.844290:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851859.844291:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.844292:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.844293:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.844294:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836055781568
00000020:00000001:7.0:1773851859.844295:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.844296:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08778c56004
00000020:00000001:7.0:1773851859.844297:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.844299:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dd55076b refcount=167
00000020:00000001:7.0:1773851859.844300:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157139611648 : -106916569939968 : ffff9ec28bd40000)
00000020:00000001:7.0:1773851859.844302:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157139611648 : -106916569939968 : ffff9ec28bd40000)
00000100:00000001:7.0:1773851859.844303:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.844305:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.844306:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae7b5977.
00000020:00000010:7.0:1773851859.844307:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.844309:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851859.844310:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.844311:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851859.844312:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.844313:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851859.844314:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851859.844315:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.844317:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.844319:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.844319:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.844320:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.844320:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.844321:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14945@kfi7, seq: 2001875
00000100:00000040:7.0:1773851859.844323:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dd55076b : new rpc_count 1
00000100:00000001:6.0:1773851859.844323:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.844324:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637025854634624 : -107047854916992 : ffff9ea3faa23a80)
00000100:00000001:6.0:1773851859.844324:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.844326:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa4914c4 x1859836055781568/t0(0) o400->36361e6d-d0ea-4dc1-933a-ddef73e1468a@14945@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1424-0'
00000100:00000001:7.0:1773851859.844331:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.844333:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.844335:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa4914c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:36361e6d-d0ea-4dc1-933a-ddef73e1468a+167:39835:x1859836055781568:12345-14945@kfi7:400:default-tuolumne1424-0
00000100:00000200:7.0:1773851859.844337:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836055781568
00000020:00000001:7.0:1773851859.844338:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.844339:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.844340:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.844342:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.844342:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851859.844344:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.844345:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836055781568, found 0 last_xid 1859836055362559
00000020:00000001:7.0:1773851859.844346:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.844347:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.844348:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.844349:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.844350:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851859.844351:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.844352:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.844354:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000060faa268.
02000000:00000001:7.0:1773851859.844355:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.844356:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.844358:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.844359:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062756, transno 0, xid 1859836055781568
00010000:00000001:7.0:1773851859.844360:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.844361:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa4914c4 x1859836055781568/t0(0) o400->36361e6d-d0ea-4dc1-933a-ddef73e1468a@14945@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1424-0'
00010000:00000001:7.0:1773851859.844366:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.844366:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.844368:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.844369:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.844371:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000de3cf378 refcount 3 to 14945@kfi7
00000100:00000001:7.0:1773851859.844372:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701344 : -107156155850272 : ffff9e8ac36521e0)
02000000:00000001:7.0:1773851859.844373:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.844374:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.844376:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.844377:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14945@kfi7
00000400:00000010:7.0:1773851859.844378:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b13b474a.
00000100:00000200:7.0:1773851859.844380:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836055781568, offset 224
00000400:00000200:7.0:1773851859.844382:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14945@kfi7
00000400:00000200:7.0:1773851859.844383:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14945@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.844384:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a5c55f3 nid 14945@kfi7 refs 1
00000400:00000200:7.0:1773851859.844386:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a5c55f3 nid 14945@kfi7 refs 2
00000400:00000200:7.0:1773851859.844388:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a5c55f3 nid 14945@kfi7 refs 3
00000400:00000200:7.0:1773851859.844390:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14945@kfi7 local destination
00000400:00000200:7.0:1773851859.844392:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768868:8768868:1024:4294967295] 14945@kfi7 LPNI seq info [8913422:8913422:16:4294967295]
00000400:00000200:7.0:1773851859.844394:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a5c55f3 nid 14945@kfi7 refs 2
00000400:00000200:7.0:1773851859.844396:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14945@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.844399:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14945@kfi7(14945@kfi7:14945@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.844401:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a5c55f3 nid 14945@kfi7 refs 3
00000800:00000200:7.0:1773851859.844403:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.844405:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851859.844408:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.844412:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 Using peer 14945@kfi7(0x570)
00000800:00000200:7.0:1773851859.844418:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x570: rc=0
00000800:00000200:7.0:1773851859.844420:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.844423:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.844424:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000de3cf378 refcount 2 to 14945@kfi7
00010000:00000001:7.0:1773851859.844426:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.844426:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.844428:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.844429:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa4914c4 x1859836055781568/t0(0) o400->36361e6d-d0ea-4dc1-933a-ddef73e1468a@14945@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1424-0'
00000800:00000200:5.0:1773851859.844431:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851859.844433:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.844434:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14945@kfi7: PUT: OK
00000400:00000200:5.0:1773851859.844434:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b13b474a
00000100:00100000:7.0:1773851859.844435:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa4914c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:36361e6d-d0ea-4dc1-933a-ddef73e1468a+167:39835:x1859836055781568:12345-14945@kfi7:400:default-tuolumne1424-0 Request processed in 102us (151us total) trans 0 rc 0/0
00000400:00000010:5.0:1773851859.844435:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b13b474a.
00000100:00000001:5.0:1773851859.844435:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851859.844436:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.844437:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a5c55f3 nid 14945@kfi7 refs 2
00000100:00100000:7.0:1773851859.844438:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14945@kfi7, seq: 2001875
00000800:00000200:5.0:1773851859.844438:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 14945@kfi7(000000008d62a3d0):0x0 lsk 1393 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x570 Transaction freed
00000100:00000040:7.0:1773851859.844440:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dd55076b : new rpc_count 0
00000100:00000001:7.0:1773851859.844441:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851859.844442:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.844442:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.844444:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000020:00000010:7.0:1773851859.844445:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae7b5977.
00000020:00000040:7.0:1773851859.844446:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000dd55076b : new refcount 166
00000100:00000001:7.0:1773851859.844447:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851859.849428:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851859.849429:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851859.849430:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851859.849432:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851859.849434:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15747@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.849436:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15747@kfi7 : PUT - for me
00000400:00000200:17.0:1773851859.849437:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15747@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.849437:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 1
00000400:00000200:17.0:1773851859.849439:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15747@kfi7 to cpt 4
00000400:00000200:17.0:1773851859.849439:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 2
00000400:00000200:17.0:1773851859.849440:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 3
00000400:00000200:17.0:1773851859.849441:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15746@kfi7 to cpt 1
00000400:00000200:17.0:1773851859.849442:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15746@kfi7 of length 224 into portal 12 MB=0x69b4b6ee88700
00000400:00000200:17.0:1773851859.849443:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15746@kfi7 of length 224/224 into md 0x6ab0181b1 [64] + 194560
00000400:00000010:17.0:1773851859.849444:0:2511435:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b181646f.
00000400:00000200:17.0:1773851859.849445:0:2511435:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000bd719b4e
00000800:00000200:17.0:1773851859.849447:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851859.849448:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851859.849449:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15747@kfi7: PUT: OK
00000400:00000200:17.0:1773851859.849450:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bd719b4e
00000400:00000010:17.0:1773851859.849451:0:2511435:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 1144 at 00000000bd719b4e (tot 253199627).
00000100:00000001:17.0:1773851859.849454:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851859.849454:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000040:17.0:1773851859.849455:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009ee440ec x1859598145849088 msgsize 224
00000100:00100000:17.0:1773851859.849457:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15746@kfi7 (source: 12345-15747@kfi7)
00000100:00000040:17.0:1773851859.849457:0:2511435:0:(events.c:370:request_in_callback()) Buffer complete: 54 buffers still posted
00000100:00000001:17.0:1773851859.849458:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851859.849459:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 2
00000100:00000001:19.0:1773851859.849460:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851859.849460:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851859.849461:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851859.849461:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851859.849462:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851859.849462:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851859.849463:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598145849088
00000020:00000001:19.0:1773851859.849463:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851859.849464:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81580
00000020:00000001:19.0:1773851859.849464:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851859.849467:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007c2001cc refcount=169
00000020:00000001:19.0:1773851859.849467:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107984086016 : -106965725465600 : ffff9eb719ee3400)
00000020:00000001:19.0:1773851859.849469:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107984086016 : -106965725465600 : ffff9eb719ee3400)
00000100:00000001:19.0:1773851859.849470:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851859.849471:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851859.849471:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c43640a.
00000020:00000010:19.0:1773851859.849472:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851859.849473:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851859.849474:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851859.849474:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851859.849475:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851859.849476:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851859.849476:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851859.849476:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.849477:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851859.849479:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851859.849479:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851859.849480:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15746@kfi7, seq: 2156281
00000100:00000001:18.0:1773851859.849480:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:19.0:1773851859.849481:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007c2001cc : new rpc_count 1
00000100:00000001:18.0:1773851859.849481:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851859.849482:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636940450533456 : -107133259018160 : ffff9e9018271050)
00000100:00000001:18.0:1773851859.849482:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851859.849482:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851859.849483:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009ee440ec x1859598145849088/t0(0) o400->6b0e3ba6-536b-44cc-88c9-40bbde5ca29b@15746@kfi7:49/0 lens 224/0 e 0 to 0 dl 1773852164 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1480-0'
00000100:00000001:19.0:1773851859.849485:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851859.849486:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851859.849487:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ee440ec pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:6b0e3ba6-536b-44cc-88c9-40bbde5ca29b+169:39700:x1859598145849088:12345-15746@kfi7:400:default-tuolumne1480-0
00000100:00000200:19.0:1773851859.849488:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598145849088
00000020:00000001:19.0:1773851859.849489:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851859.849489:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851859.849490:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.849490:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851859.849491:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851859.849492:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851859.849492:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598145849088, found 0 last_xid 1859598145424959
00000020:00000001:19.0:1773851859.849493:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851859.849494:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851859.849495:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851859.849495:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.849496:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851859.849496:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851859.849497:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851859.849497:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000799785d1.
02000000:00000001:19.0:1773851859.849498:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.849499:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.849499:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851859.849500:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063269, transno 0, xid 1859598145849088
00010000:00000001:19.0:1773851859.849501:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851859.849502:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009ee440ec x1859598145849088/t0(0) o400->6b0e3ba6-536b-44cc-88c9-40bbde5ca29b@15746@kfi7:49/0 lens 224/224 e 0 to 0 dl 1773852164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1480-0'
00010000:00000001:19.0:1773851859.849504:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851859.849505:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851859.849505:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=92 v=290 (290 214 1 1)
00000100:00000001:19.0:1773851859.849506:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851859.849507:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000023e8acc5 refcount 3 to 15746@kfi7
00000100:00000001:19.0:1773851859.849508:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612800 : -107130477938816 : ffff9e90bdeaf780)
02000000:00000001:19.0:1773851859.849509:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851859.849509:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851859.849510:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851859.849511:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15747@kfi7
00000400:00000010:19.0:1773851859.849511:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000010bd7129.
00000100:00000200:19.0:1773851859.849512:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598145849088, offset 224
00000400:00000200:19.0:1773851859.849514:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15747@kfi7
00000400:00000200:19.0:1773851859.849514:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15747@kfi7 to cpt 4
00000400:00000200:19.0:1773851859.849515:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 1
00000400:00000200:19.0:1773851859.849516:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 2
00000400:00000200:19.0:1773851859.849517:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 3
00000400:00000200:19.0:1773851859.849518:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15747@kfi7 local destination
00000400:00000200:19.0:1773851859.849519:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768869:8768869:1024:4294967295] 15747@kfi7 LPNI seq info [535962:535962:16:4294967295]
00000400:00000200:19.0:1773851859.849521:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 2
00000400:00000200:19.0:1773851859.849522:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15747@kfi7 to cpt 4
00000400:00000200:19.0:1773851859.849524:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15747@kfi7(15747@kfi7:15747@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851859.849525:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 3
00000800:00000200:19.0:1773851859.849526:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851859.849528:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851859.849530:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851859.849532:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30a Using peer 15747@kfi7(0x30a)
00000800:00000200:19.0:1773851859.849535:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0x30a: rc=0
00000800:00000200:19.0:1773851859.849536:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851859.849538:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851859.849539:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000023e8acc5 refcount 2 to 15746@kfi7
00010000:00000001:19.0:1773851859.849540:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851859.849540:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851859.849541:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851859.849541:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009ee440ec x1859598145849088/t0(0) o400->6b0e3ba6-536b-44cc-88c9-40bbde5ca29b@15746@kfi7:49/0 lens 224/224 e 0 to 0 dl 1773852164 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1480-0'
00000100:00100000:19.0:1773851859.849544:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ee440ec pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:6b0e3ba6-536b-44cc-88c9-40bbde5ca29b+169:39700:x1859598145849088:12345-15746@kfi7:400:default-tuolumne1480-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851859.849546:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15746@kfi7, seq: 2156281
00000100:00000040:19.0:1773851859.849547:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007c2001cc : new rpc_count 0
00000100:00000001:19.0:1773851859.849548:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851859.849548:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851859.849549:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851859.849549:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30a TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851859.849550:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000020:00000010:19.0:1773851859.849551:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c43640a.
00000020:00000040:19.0:1773851859.849551:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007c2001cc : new refcount 168
00000400:00000200:17.0:1773851859.849551:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851859.849552:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15747@kfi7: PUT: OK
00000400:00000200:17.0:1773851859.849553:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000010bd7129
00000400:00000010:17.0:1773851859.849553:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000010bd7129.
00000100:00000001:17.0:1773851859.849554:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851859.849554:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851859.849555:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab7a3c66 nid 15747@kfi7 refs 2
00000800:00000200:17.0:1773851859.849557:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 15747@kfi7(00000000784facf3):0x0 lsk 779 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30a Transaction freed
02000000:00000001:19.0:1773851859.849631:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849632:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000799785d1.
02000000:00000001:19.0:1773851859.849633:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
02000000:00000001:19.0:1773851859.849633:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849633:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000583a54c2.
02000000:00000001:19.0:1773851859.849634:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849635:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004a9b42d8.
02000000:00000001:19.0:1773851859.849636:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849636:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000099e6b427.
02000000:00000001:19.0:1773851859.849636:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849637:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000635870f3.
02000000:00000001:19.0:1773851859.849638:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849638:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d118fe66.
02000000:00000001:19.0:1773851859.849638:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849639:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000341b955c.
02000000:00000001:19.0:1773851859.849639:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849640:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b7291b04.
02000000:00000001:19.0:1773851859.849641:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849641:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a5b9c7c8.
02000000:00000001:19.0:1773851859.849642:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849642:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ce58a87.
02000000:00000001:19.0:1773851859.849642:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849643:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed106d04.
02000000:00000001:19.0:1773851859.849643:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849644:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000098535041.
02000000:00000001:19.0:1773851859.849644:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849644:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008247c0fe.
02000000:00000001:19.0:1773851859.849645:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849645:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ac06634d.
02000000:00000001:19.0:1773851859.849646:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849646:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000072b2a9a2.
02000000:00000001:19.0:1773851859.849647:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849647:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d3eb76a8.
02000000:00000001:19.0:1773851859.849648:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849648:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6a6a464.
02000000:00000001:19.0:1773851859.849649:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849649:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d828c161.
02000000:00000001:19.0:1773851859.849649:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849650:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000082198b88.
02000000:00000001:19.0:1773851859.849651:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849651:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008fb2f5f8.
02000000:00000001:19.0:1773851859.849652:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849652:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a9064e84.
02000000:00000001:19.0:1773851859.849653:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849653:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b60761c7.
02000000:00000001:19.0:1773851859.849654:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849654:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000576c05b6.
02000000:00000001:19.0:1773851859.849655:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849655:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fbe5d2bd.
02000000:00000001:19.0:1773851859.849656:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849656:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bbb543dc.
02000000:00000001:19.0:1773851859.849657:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849657:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f516f763.
02000000:00000001:19.0:1773851859.849657:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849658:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5aa252d.
02000000:00000001:19.0:1773851859.849658:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849659:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000009c31097.
02000000:00000001:19.0:1773851859.849659:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849660:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000099ad4b79.
02000000:00000001:19.0:1773851859.849660:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849660:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002f678b40.
02000000:00000001:19.0:1773851859.849661:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849661:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc1b5484.
02000000:00000001:19.0:1773851859.849662:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849662:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003da7790a.
02000000:00000001:19.0:1773851859.849663:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849663:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007580c285.
02000000:00000001:19.0:1773851859.849664:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849664:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000380b86f9.
02000000:00000001:19.0:1773851859.849665:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849665:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094e0f615.
02000000:00000001:19.0:1773851859.849666:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849666:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000043b40cc9.
02000000:00000001:19.0:1773851859.849667:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849667:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a060c2e3.
02000000:00000001:19.0:1773851859.849668:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849668:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005445676a.
02000000:00000001:19.0:1773851859.849669:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849669:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f4ae4484.
02000000:00000001:19.0:1773851859.849670:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849670:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000029245368.
02000000:00000001:19.0:1773851859.849671:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849671:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002c6d032.
02000000:00000001:19.0:1773851859.849672:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849672:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008308567b.
02000000:00000001:19.0:1773851859.849673:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849673:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025e3f153.
02000000:00000001:19.0:1773851859.849674:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849674:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000025fb9ec7.
02000000:00000001:19.0:1773851859.849674:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849675:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001fe91f27.
02000000:00000001:19.0:1773851859.849676:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849676:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002a3a26dd.
02000000:00000001:19.0:1773851859.849676:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849677:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ed293b4.
02000000:00000001:19.0:1773851859.849678:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849678:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e7f7db99.
02000000:00000001:19.0:1773851859.849679:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849679:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed35718a.
02000000:00000001:19.0:1773851859.849679:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849680:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000007331ce8.
02000000:00000001:19.0:1773851859.849680:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849681:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b656cafc.
02000000:00000001:19.0:1773851859.849681:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849681:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000013afd4e8.
02000000:00000001:19.0:1773851859.849682:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849682:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fd3822b2.
02000000:00000001:19.0:1773851859.849683:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849683:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b5d5268b.
02000000:00000001:19.0:1773851859.849684:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849684:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000060cdda82.
02000000:00000001:19.0:1773851859.849685:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849685:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f8fc0f95.
02000000:00000001:19.0:1773851859.849686:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849686:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000340e4ee5.
02000000:00000001:19.0:1773851859.849687:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849687:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a408a807.
02000000:00000001:19.0:1773851859.849688:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849688:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000c7ef22a.
02000000:00000001:19.0:1773851859.849689:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849689:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b6c87683.
02000000:00000001:19.0:1773851859.849689:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849690:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006fcc29bf.
02000000:00000001:19.0:1773851859.849691:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849691:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000072ba4afe.
02000000:00000001:19.0:1773851859.849691:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849692:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d6e38e6d.
02000000:00000001:19.0:1773851859.849693:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849693:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000104bdc31.
02000000:00000001:19.0:1773851859.849693:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849694:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f638512.
02000000:00000001:19.0:1773851859.849694:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849695:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000020e4017.
02000000:00000001:19.0:1773851859.849695:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849695:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000144e137a.
02000000:00000001:19.0:1773851859.849697:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849697:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b0f8282b.
02000000:00000001:19.0:1773851859.849697:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849698:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cb6fe2e.
00000100:00000010:19.0:1773851859.849699:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dc4ed428.
02000000:00000001:19.0:1773851859.849700:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849700:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000011098c85.
02000000:00000001:19.0:1773851859.849701:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849701:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ab6ff233.
02000000:00000001:19.0:1773851859.849703:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849703:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e4b1e044.
02000000:00000001:19.0:1773851859.849704:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849704:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001ecc7e94.
02000000:00000001:19.0:1773851859.849704:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849705:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ef791807.
02000000:00000001:19.0:1773851859.849705:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849706:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f7101259.
02000000:00000001:19.0:1773851859.849706:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849710:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e96e8f6f.
02000000:00000001:19.0:1773851859.849710:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849710:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a3f6c2c.
02000000:00000001:19.0:1773851859.849711:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849711:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dec2f936.
02000000:00000001:19.0:1773851859.849712:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849712:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b12be0b0.
02000000:00000001:19.0:1773851859.849713:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849713:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000083b72841.
02000000:00000001:19.0:1773851859.849714:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849714:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001e66cc3e.
02000000:00000001:19.0:1773851859.849715:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849715:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aaef15b5.
02000000:00000001:19.0:1773851859.849715:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849716:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000778e9f55.
02000000:00000001:19.0:1773851859.849717:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849717:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ade6baf1.
02000000:00000001:19.0:1773851859.849718:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849718:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000915cf614.
02000000:00000001:19.0:1773851859.849718:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849719:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fdcbf452.
02000000:00000001:19.0:1773851859.849719:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849720:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076b20839.
02000000:00000001:19.0:1773851859.849720:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849720:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009b0b01f2.
02000000:00000001:19.0:1773851859.849722:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849722:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002df47272.
02000000:00000001:19.0:1773851859.849723:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849723:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004b9214a2.
02000000:00000001:19.0:1773851859.849723:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849724:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003b105c37.
02000000:00000001:19.0:1773851859.849724:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849729:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004b4112ad.
02000000:00000001:19.0:1773851859.849729:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849730:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e98cea0.
02000000:00000001:19.0:1773851859.849730:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849731:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bd868df9.
02000000:00000001:19.0:1773851859.849731:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000400:00000200:29.0:1773851859.849732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000100:00000010:19.0:1773851859.849732:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000099caa41.
02000000:00000001:19.0:1773851859.849733:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849733:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000050c5bc22.
00000400:00000200:29.0:1773851859.849734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
02000000:00000001:19.0:1773851859.849734:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849734:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000212eabd.
02000000:00000001:19.0:1773851859.849735:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849735:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ff8fca47.
02000000:00000001:19.0:1773851859.849736:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849736:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000018b7a8bf.
02000000:00000001:19.0:1773851859.849737:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849737:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000536c7f43.
02000000:00000001:19.0:1773851859.849737:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849738:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001865f496.
02000000:00000001:19.0:1773851859.849738:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849739:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dfd51703.
02000000:00000001:19.0:1773851859.849739:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849740:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000073176bf0.
02000000:00000001:19.0:1773851859.849740:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849741:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ea6a97e2.
02000000:00000001:19.0:1773851859.849741:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849741:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec4866a8.
02000000:00000001:19.0:1773851859.849742:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849743:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d2775dd3.
02000000:00000001:19.0:1773851859.849744:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849744:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a191f88.
02000000:00000001:19.0:1773851859.849745:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849745:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c5ddc52f.
02000000:00000001:19.0:1773851859.849745:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849746:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c19dbd67.
02000000:00000001:19.0:1773851859.849746:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849747:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000a41fda9.
02000000:00000001:19.0:1773851859.849747:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849748:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e97d03ee.
02000000:00000001:19.0:1773851859.849748:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849749:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000672aee44.
02000000:00000001:19.0:1773851859.849749:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849750:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa6bc937.
02000000:00000001:19.0:1773851859.849750:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849751:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001460052e.
02000000:00000001:19.0:1773851859.849752:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849752:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000083ead0f8.
02000000:00000001:19.0:1773851859.849753:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849753:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a4a969ad.
02000000:00000001:19.0:1773851859.849754:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849754:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000481aa674.
02000000:00000001:19.0:1773851859.849755:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849755:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000575b7763.
02000000:00000001:19.0:1773851859.849756:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849756:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a3ce8f7b.
02000000:00000001:19.0:1773851859.849756:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849757:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001b59fc07.
02000000:00000001:19.0:1773851859.849757:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849758:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005c3ddc1f.
02000000:00000001:19.0:1773851859.849758:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849759:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004c50a7a1.
02000000:00000001:19.0:1773851859.849760:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849760:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dc287a72.
02000000:00000001:19.0:1773851859.849760:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849761:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e1243d03.
02000000:00000001:19.0:1773851859.849761:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849762:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001296bcee.
02000000:00000001:19.0:1773851859.849762:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849762:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f6c2a130.
02000000:00000001:19.0:1773851859.849763:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849763:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa17ff8d.
02000000:00000001:19.0:1773851859.849764:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849764:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a2eeae8.
02000000:00000001:19.0:1773851859.849764:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849765:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d2d833e6.
02000000:00000001:19.0:1773851859.849766:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849766:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2be09d8.
02000000:00000001:19.0:1773851859.849767:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849767:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008b1565ed.
02000000:00000001:19.0:1773851859.849768:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849768:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008c69eb09.
02000000:00000001:19.0:1773851859.849768:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849769:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c8fba189.
02000000:00000001:19.0:1773851859.849770:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849770:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000079676f29.
02000000:00000001:19.0:1773851859.849770:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849771:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e94a6832.
02000000:00000001:19.0:1773851859.849772:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849772:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fed8364b.
02000000:00000001:19.0:1773851859.849772:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849773:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000087c1af3a.
02000000:00000001:19.0:1773851859.849773:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849774:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009bffe814.
02000000:00000001:19.0:1773851859.849774:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849775:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025d85fee.
02000000:00000001:19.0:1773851859.849775:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849776:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009cb03159.
02000000:00000001:19.0:1773851859.849776:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849776:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001ecc6bb5.
02000000:00000001:19.0:1773851859.849777:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849777:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a414e017.
02000000:00000001:19.0:1773851859.849778:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849778:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ea2030f8.
02000000:00000001:19.0:1773851859.849779:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849779:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b63bfef0.
02000000:00000001:19.0:1773851859.849780:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849780:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e79617a2.
02000000:00000001:19.0:1773851859.849781:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849781:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb5604de.
02000000:00000001:19.0:1773851859.849781:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849782:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000044c06fa8.
02000000:00000001:19.0:1773851859.849782:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849783:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a21b013b.
02000000:00000001:19.0:1773851859.849783:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849783:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ee12539.
02000000:00000001:19.0:1773851859.849784:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849785:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000986ea9cb.
02000000:00000001:19.0:1773851859.849785:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849785:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000046db045f.
02000000:00000001:19.0:1773851859.849786:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849787:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000809530b3.
02000000:00000001:19.0:1773851859.849787:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849788:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac4c275d.
02000000:00000001:19.0:1773851859.849788:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849789:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000005e0da50.
02000000:00000001:19.0:1773851859.849790:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849790:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000073406e35.
02000000:00000001:19.0:1773851859.849790:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849791:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cc30b336.
02000000:00000001:19.0:1773851859.849791:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849792:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ea6299d.
02000000:00000001:19.0:1773851859.849792:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849793:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000004eb99a5.
02000000:00000001:19.0:1773851859.849793:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849793:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000afe1958d.
02000000:00000001:19.0:1773851859.849794:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849794:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e4df641f.
02000000:00000001:19.0:1773851859.849795:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849795:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de0ffdee.
02000000:00000001:19.0:1773851859.849796:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849796:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005fbe82d7.
02000000:00000001:19.0:1773851859.849797:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849797:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002dc36526.
02000000:00000001:19.0:1773851859.849798:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849798:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000306dda57.
02000000:00000001:19.0:1773851859.849799:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849799:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007290475.
02000000:00000001:19.0:1773851859.849800:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849800:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000713554cf.
02000000:00000001:19.0:1773851859.849800:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849801:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005dc1f11c.
02000000:00000001:19.0:1773851859.849801:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849802:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed9be561.
02000000:00000001:19.0:1773851859.849802:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849802:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000838cc8d3.
02000000:00000001:19.0:1773851859.849803:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849803:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000031304ad0.
02000000:00000001:19.0:1773851859.849804:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849805:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e6dcf813.
02000000:00000001:19.0:1773851859.849805:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849806:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c743b497.
02000000:00000001:19.0:1773851859.849806:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849807:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000013e379e.
02000000:00000001:19.0:1773851859.849807:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849807:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ca89c4c.
02000000:00000001:19.0:1773851859.849808:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849808:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ded8871.
02000000:00000001:19.0:1773851859.849809:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849809:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d8c8ac2d.
02000000:00000001:19.0:1773851859.849810:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849810:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005d410507.
02000000:00000001:19.0:1773851859.849811:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849811:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003bfa6b0a.
02000000:00000001:19.0:1773851859.849812:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849812:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005bfc7103.
02000000:00000001:19.0:1773851859.849813:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849813:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000987df3cb.
02000000:00000001:19.0:1773851859.849814:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849814:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000046323210.
02000000:00000001:19.0:1773851859.849815:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849815:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cca4163a.
02000000:00000001:19.0:1773851859.849816:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849816:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e45141c.
02000000:00000001:19.0:1773851859.849817:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849817:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000071c8ca0.
02000000:00000001:19.0:1773851859.849818:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849818:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000030f21b4f.
02000000:00000001:19.0:1773851859.849819:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849819:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000afeb44d3.
02000000:00000001:19.0:1773851859.849820:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849820:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f4c24f49.
02000000:00000001:19.0:1773851859.849821:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849821:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007168b4bf.
02000000:00000001:19.0:1773851859.849822:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849822:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a1c7d26.
02000000:00000001:19.0:1773851859.849823:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849833:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004fc7aa7b.
02000000:00000001:19.0:1773851859.849833:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849833:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000eca030e.
02000000:00000001:19.0:1773851859.849834:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849835:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009d286b75.
02000000:00000001:19.0:1773851859.849835:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849836:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002ab9852a.
02000000:00000001:19.0:1773851859.849836:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849836:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007b3df1f8.
02000000:00000001:19.0:1773851859.849837:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849837:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f835ac3e.
02000000:00000001:19.0:1773851859.849838:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849838:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 000000005be36249.
02000000:00000001:19.0:1773851859.849839:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849840:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a92198bc.
02000000:00000001:19.0:1773851859.849841:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849841:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f1f9f806.
02000000:00000001:19.0:1773851859.849842:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849842:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000050480d87.
02000000:00000001:19.0:1773851859.849843:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849843:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000062e89fc0.
02000000:00000001:19.0:1773851859.849844:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849844:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006b87cbe9.
02000000:00000001:19.0:1773851859.849845:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849845:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000041f84cd0.
02000000:00000001:19.0:1773851859.849846:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849846:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a0df941.
02000000:00000001:19.0:1773851859.849847:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849847:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000071af72d7.
02000000:00000001:19.0:1773851859.849848:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849848:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c2a6e4df.
02000000:00000001:19.0:1773851859.849849:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849849:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002af652b6.
02000000:00000001:19.0:1773851859.849850:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849850:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036ef6fb6.
02000000:00000001:19.0:1773851859.849851:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849851:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ca0de6c.
02000000:00000001:19.0:1773851859.849852:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849853:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cd190731.
02000000:00000001:19.0:1773851859.849853:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849853:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000037281279.
02000000:00000001:19.0:1773851859.849854:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849854:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000780c0ea7.
02000000:00000001:19.0:1773851859.849855:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849855:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad805844.
02000000:00000001:19.0:1773851859.849856:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849856:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005879fe5d.
02000000:00000001:19.0:1773851859.849857:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849857:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a14518ef.
02000000:00000001:19.0:1773851859.849858:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849858:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000029951dab.
02000000:00000001:19.0:1773851859.849859:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849859:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000082c4a137.
02000000:00000001:19.0:1773851859.849860:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849860:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000584ddf2d.
02000000:00000001:19.0:1773851859.849861:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849861:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000179f0be8.
02000000:00000001:19.0:1773851859.849862:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849862:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e8b299c6.
02000000:00000001:19.0:1773851859.849863:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849863:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f9553dea.
02000000:00000001:19.0:1773851859.849864:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849864:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000070d816a2.
02000000:00000001:19.0:1773851859.849865:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849865:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012afe589.
02000000:00000001:19.0:1773851859.849866:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849866:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5b4cb35.
02000000:00000001:19.0:1773851859.849866:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849867:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000806a9289.
02000000:00000001:19.0:1773851859.849867:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849868:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fbf5742a.
02000000:00000001:19.0:1773851859.849868:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849868:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b650459d.
02000000:00000001:19.0:1773851859.849869:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849869:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000048362736.
02000000:00000001:19.0:1773851859.849870:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849871:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027fa3bc9.
02000000:00000001:19.0:1773851859.849871:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849872:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a671a9e3.
02000000:00000001:19.0:1773851859.849872:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849872:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed157dd4.
02000000:00000001:19.0:1773851859.849873:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849873:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000da34c4b5.
02000000:00000001:19.0:1773851859.849874:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849874:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004d6a5df9.
02000000:00000001:19.0:1773851859.849875:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849875:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003a044fc9.
02000000:00000001:19.0:1773851859.849876:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849876:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ca97399c.
02000000:00000001:19.0:1773851859.849877:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849877:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cf591cf5.
02000000:00000001:19.0:1773851859.849878:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849878:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ca10b5c1.
02000000:00000001:19.0:1773851859.849879:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849879:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e8edd7c.
02000000:00000001:19.0:1773851859.849880:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849880:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ca282a9c.
02000000:00000001:19.0:1773851859.849881:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849881:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c67a86d8.
02000000:00000001:19.0:1773851859.849882:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849882:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000937ece3b.
02000000:00000001:19.0:1773851859.849883:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849883:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ad7b0e2.
02000000:00000001:19.0:1773851859.849884:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849884:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f6568253.
02000000:00000001:19.0:1773851859.849885:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849885:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6050cf3.
02000000:00000001:19.0:1773851859.849886:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849886:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000524a6c01.
02000000:00000001:19.0:1773851859.849887:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849887:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009729d235.
02000000:00000001:19.0:1773851859.849888:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849888:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000034bd40cd.
02000000:00000001:19.0:1773851859.849889:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849890:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8a0b53c.
02000000:00000001:19.0:1773851859.849891:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849891:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000177e92b6.
02000000:00000001:19.0:1773851859.849892:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849892:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000081643365.
02000000:00000001:19.0:1773851859.849893:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849893:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eadd6191.
02000000:00000001:19.0:1773851859.849894:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849894:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000380c3fa0.
02000000:00000001:19.0:1773851859.849895:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849895:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000843f1d70.
02000000:00000001:19.0:1773851859.849896:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849896:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003d295f2d.
02000000:00000001:19.0:1773851859.849897:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849897:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ccf554d6.
02000000:00000001:19.0:1773851859.849898:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849898:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006f78f50f.
02000000:00000001:19.0:1773851859.849899:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849899:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000052d0fd63.
02000000:00000001:19.0:1773851859.849899:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849900:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8832e93.
02000000:00000001:19.0:1773851859.849900:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849901:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008bb3c7d4.
02000000:00000001:19.0:1773851859.849901:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849902:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e94b502a.
02000000:00000001:19.0:1773851859.849902:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849903:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000db32af56.
02000000:00000001:19.0:1773851859.849903:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849904:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007939ac9.
02000000:00000001:19.0:1773851859.849904:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849905:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000e86d12bb.
02000000:00000001:19.0:1773851859.849905:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849905:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a42500ca.
02000000:00000001:19.0:1773851859.849906:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849906:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ff7a2c4d.
02000000:00000001:19.0:1773851859.849907:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849907:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004174a48d.
02000000:00000001:19.0:1773851859.849908:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849909:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008ef8592b.
02000000:00000001:19.0:1773851859.849910:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849910:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b2bc1abe.
02000000:00000001:19.0:1773851859.849911:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849911:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002b3de2e8.
02000000:00000001:19.0:1773851859.849912:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849912:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000045f35cc0.
02000000:00000001:19.0:1773851859.849913:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849914:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000af9410e7.
02000000:00000001:19.0:1773851859.849914:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849914:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ee177c7.
02000000:00000001:19.0:1773851859.849915:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849915:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000051e18815.
02000000:00000001:19.0:1773851859.849916:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849917:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000069619314.
02000000:00000001:19.0:1773851859.849917:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849918:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b944be30.
02000000:00000001:19.0:1773851859.849918:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849919:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000054234e4e.
02000000:00000001:19.0:1773851859.849920:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849920:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000071fa1bb.
02000000:00000001:19.0:1773851859.849921:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849921:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005d7ebcaf.
02000000:00000001:19.0:1773851859.849922:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849922:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed6d3c8b.
02000000:00000001:19.0:1773851859.849923:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849923:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000792e6d9c.
02000000:00000001:19.0:1773851859.849924:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849924:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b0f53c0.
02000000:00000001:19.0:1773851859.849924:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849925:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c87a7cf.
02000000:00000001:19.0:1773851859.849926:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849926:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001a268218.
02000000:00000001:19.0:1773851859.849927:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849927:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076ac17f7.
02000000:00000001:19.0:1773851859.849928:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849928:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f9eff212.
02000000:00000001:19.0:1773851859.849929:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849929:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000069806f4b.
02000000:00000001:19.0:1773851859.849930:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849930:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000a781ea29.
02000000:00000001:19.0:1773851859.849931:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849931:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004bd1afc8.
02000000:00000001:19.0:1773851859.849932:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849932:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000099597817.
02000000:00000001:19.0:1773851859.849932:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849933:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098529090.
02000000:00000001:19.0:1773851859.849933:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849934:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a6d3a29e.
02000000:00000001:19.0:1773851859.849934:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849935:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c64db3ef.
02000000:00000001:19.0:1773851859.849936:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849936:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d55276f0.
02000000:00000001:19.0:1773851859.849937:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849937:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007407633a.
02000000:00000001:19.0:1773851859.849938:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849938:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094dadc4a.
02000000:00000001:19.0:1773851859.849938:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849939:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000923f819.
02000000:00000001:19.0:1773851859.849940:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849940:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005f163b6b.
02000000:00000001:19.0:1773851859.849940:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849941:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000204e526a.
02000000:00000001:19.0:1773851859.849941:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849942:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000002497511.
02000000:00000001:19.0:1773851859.849942:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849942:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000770786ff.
02000000:00000001:19.0:1773851859.849943:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849943:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000075eb5537.
02000000:00000001:19.0:1773851859.849944:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849944:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e8674683.
02000000:00000001:19.0:1773851859.849945:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849945:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000303ef651.
02000000:00000001:19.0:1773851859.849946:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849946:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7bf6343.
02000000:00000001:19.0:1773851859.849947:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849947:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c1357ff4.
02000000:00000001:19.0:1773851859.849948:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849948:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d6be6a8.
02000000:00000001:19.0:1773851859.849949:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849949:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a414cb04.
02000000:00000001:19.0:1773851859.849950:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849950:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e439d7b8.
02000000:00000001:19.0:1773851859.849951:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849951:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001397b562.
02000000:00000001:19.0:1773851859.849952:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849952:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009b71dccc.
02000000:00000001:19.0:1773851859.849953:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849953:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000beb36014.
02000000:00000001:19.0:1773851859.849954:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849955:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000069112a82.
02000000:00000001:19.0:1773851859.849955:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849956:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027855698.
02000000:00000001:19.0:1773851859.849956:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849957:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000015980d9e.
02000000:00000001:19.0:1773851859.849957:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849958:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001829ad5f.
02000000:00000001:19.0:1773851859.849958:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849958:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000af049c4.
02000000:00000001:19.0:1773851859.849959:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849959:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c031b030.
02000000:00000001:19.0:1773851859.849960:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849960:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a92ed2dc.
02000000:00000001:19.0:1773851859.849961:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849961:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c4ce0bc2.
02000000:00000001:19.0:1773851859.849962:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849963:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006b483b64.
02000000:00000001:19.0:1773851859.849963:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849964:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006dafd5fa.
02000000:00000001:19.0:1773851859.849964:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849965:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c90c81d9.
02000000:00000001:19.0:1773851859.849965:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849966:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f680e7c1.
02000000:00000001:19.0:1773851859.849966:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849967:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e4f97751.
02000000:00000001:19.0:1773851859.849967:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849968:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000071c0d6b2.
02000000:00000001:19.0:1773851859.849968:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849969:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ff847735.
02000000:00000001:19.0:1773851859.849970:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849970:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a1cea643.
02000000:00000001:19.0:1773851859.849970:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849971:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f0b9654c.
02000000:00000001:19.0:1773851859.849972:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849972:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b36d5f3e.
02000000:00000001:19.0:1773851859.849972:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849973:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d22e38e2.
02000000:00000001:19.0:1773851859.849973:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849974:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a1b30fce.
02000000:00000001:19.0:1773851859.849974:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849975:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a56828b.
02000000:00000001:19.0:1773851859.849975:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849976:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006f7edbc1.
02000000:00000001:19.0:1773851859.849976:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849977:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000da4e1094.
02000000:00000001:19.0:1773851859.849977:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849978:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed8e89c9.
02000000:00000001:19.0:1773851859.849978:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849978:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b4a1b09a.
02000000:00000001:19.0:1773851859.849979:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849979:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c844527f.
02000000:00000001:19.0:1773851859.849980:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849980:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e07612da.
02000000:00000001:19.0:1773851859.849981:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849981:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c707a6d6.
02000000:00000001:19.0:1773851859.849982:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849982:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a41f3f27.
02000000:00000001:19.0:1773851859.849983:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849983:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a87161a7.
02000000:00000001:19.0:1773851859.849984:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849984:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef38b212.
02000000:00000001:19.0:1773851859.849985:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849985:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000004955e8a.
02000000:00000001:19.0:1773851859.849986:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849986:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000051bd5402.
02000000:00000001:19.0:1773851859.849987:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849987:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009123223d.
02000000:00000001:19.0:1773851859.849988:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849988:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086de02d5.
02000000:00000001:19.0:1773851859.849989:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849989:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a7b7c8bf.
02000000:00000001:19.0:1773851859.849990:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849990:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f877619.
02000000:00000001:19.0:1773851859.849991:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849991:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000326489c1.
02000000:00000001:19.0:1773851859.849992:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849992:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c129d099.
02000000:00000001:19.0:1773851859.849993:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849994:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000a4a7b78.
02000000:00000001:19.0:1773851859.849994:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849995:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000a7aac80.
02000000:00000001:19.0:1773851859.849995:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849996:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006246c037.
02000000:00000001:19.0:1773851859.849996:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849997:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042a46325.
02000000:00000001:19.0:1773851859.849997:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.849998:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d452cf86.
02000000:00000001:19.0:1773851859.849998:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.849999:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fcbf481b.
02000000:00000001:19.0:1773851859.849999:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850000:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b0951f0e.
02000000:00000001:19.0:1773851859.850000:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850000:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e05c84f8.
02000000:00000001:19.0:1773851859.850001:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850001:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008373eb44.
02000000:00000001:19.0:1773851859.850002:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850002:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007e3eaaff.
02000000:00000001:19.0:1773851859.850003:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850003:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000521b6029.
02000000:00000001:19.0:1773851859.850004:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850004:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d0eec9af.
02000000:00000001:19.0:1773851859.850005:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850005:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b7df2fde.
02000000:00000001:19.0:1773851859.850006:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850006:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e97ef21e.
02000000:00000001:19.0:1773851859.850007:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850007:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005f1b1e1a.
02000000:00000001:19.0:1773851859.850008:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850008:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004041d889.
02000000:00000001:19.0:1773851859.850009:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850009:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000001de9ad3.
02000000:00000001:19.0:1773851859.850010:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850010:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bffc48d5.
02000000:00000001:19.0:1773851859.850011:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850011:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000000218e18.
02000000:00000001:19.0:1773851859.850012:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850012:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d33935e.
02000000:00000001:19.0:1773851859.850013:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850013:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb787869.
02000000:00000001:19.0:1773851859.850014:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850014:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aebbb58d.
02000000:00000001:19.0:1773851859.850015:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850015:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000082d0580.
02000000:00000001:19.0:1773851859.850016:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850016:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000065814e7b.
02000000:00000001:19.0:1773851859.850017:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850017:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000771474ba.
02000000:00000001:19.0:1773851859.850018:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850018:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef063acd.
02000000:00000001:19.0:1773851859.850019:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850019:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002861a015.
02000000:00000001:19.0:1773851859.850020:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850020:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa8fda36.
02000000:00000001:19.0:1773851859.850020:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850021:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007f722535.
02000000:00000001:19.0:1773851859.850021:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850022:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e80f8e7e.
02000000:00000001:19.0:1773851859.850022:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850025:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008d144c1f.
02000000:00000001:19.0:1773851859.850025:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850026:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c750ced0.
02000000:00000001:19.0:1773851859.850026:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850027:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a87ec3e3.
02000000:00000001:19.0:1773851859.850027:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850028:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000049dc0514.
02000000:00000001:19.0:1773851859.850028:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850029:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000093bcc724.
02000000:00000001:19.0:1773851859.850029:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850030:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000050773b4d.
02000000:00000001:19.0:1773851859.850030:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850030:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000022d5df20.
02000000:00000001:19.0:1773851859.850031:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850031:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000045963d54.
02000000:00000001:19.0:1773851859.850032:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850032:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a29ca8b.
02000000:00000001:19.0:1773851859.850033:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850033:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000018e4ffc1.
02000000:00000001:19.0:1773851859.850034:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850035:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f41547c1.
02000000:00000001:19.0:1773851859.850035:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850036:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008f0f1f09.
02000000:00000001:19.0:1773851859.850036:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850036:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003cd92af6.
02000000:00000001:19.0:1773851859.850038:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850038:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000569890a2.
02000000:00000001:19.0:1773851859.850038:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850039:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000197ba89.
02000000:00000001:19.0:1773851859.850039:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850040:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f50f372d.
02000000:00000001:19.0:1773851859.850040:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850041:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000015b5ad8c.
02000000:00000001:19.0:1773851859.850041:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850042:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d238373b.
02000000:00000001:19.0:1773851859.850042:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850043:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001a11f5ac.
02000000:00000001:19.0:1773851859.850043:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850044:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006d070ab8.
02000000:00000001:19.0:1773851859.850045:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850045:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002137ccdb.
02000000:00000001:19.0:1773851859.850046:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850046:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ffe4e866.
02000000:00000001:19.0:1773851859.850047:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850047:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000f4b4c85.
02000000:00000001:19.0:1773851859.850048:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850048:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005feaf29b.
02000000:00000001:19.0:1773851859.850049:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850049:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000066bb02f8.
02000000:00000001:19.0:1773851859.850050:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850050:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009ca778bc.
02000000:00000001:19.0:1773851859.850051:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850051:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008ca04f75.
02000000:00000001:19.0:1773851859.850052:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850053:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004cbf2019.
02000000:00000001:19.0:1773851859.850053:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850054:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000411f41f9.
02000000:00000001:19.0:1773851859.850054:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850054:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a6d6306.
02000000:00000001:19.0:1773851859.850056:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850056:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000043992ca1.
02000000:00000001:19.0:1773851859.850056:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850057:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009b5df7f0.
02000000:00000001:19.0:1773851859.850057:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850058:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008c9cd1ec.
02000000:00000001:19.0:1773851859.850058:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850058:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c1902cc9.
02000000:00000001:19.0:1773851859.850059:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850059:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ee28b333.
02000000:00000001:19.0:1773851859.850060:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850060:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ceb283e8.
02000000:00000001:19.0:1773851859.850061:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850061:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000025e4693b.
02000000:00000001:19.0:1773851859.850062:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850062:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002d1da931.
02000000:00000001:19.0:1773851859.850063:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850063:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000071035114.
02000000:00000001:19.0:1773851859.850064:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850064:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000920c0ca.
02000000:00000001:19.0:1773851859.850065:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850066:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000097eb3f3e.
02000000:00000001:19.0:1773851859.850066:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850066:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000093f1f2c6.
02000000:00000001:19.0:1773851859.850067:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850067:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f86e1679.
02000000:00000001:19.0:1773851859.850068:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850068:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000b822e59.
02000000:00000001:19.0:1773851859.850069:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850069:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000077af373c.
02000000:00000001:19.0:1773851859.850070:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850070:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb500703.
02000000:00000001:19.0:1773851859.850072:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850072:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000005a00e0c.
02000000:00000001:19.0:1773851859.850073:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850073:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c306bb6b.
02000000:00000001:19.0:1773851859.850074:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850074:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b6bf0d8.
02000000:00000001:19.0:1773851859.850075:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850075:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e15c22b5.
02000000:00000001:19.0:1773851859.850076:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850076:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000062dca249.
02000000:00000001:19.0:1773851859.850077:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850077:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008c97b0d9.
02000000:00000001:19.0:1773851859.850078:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850078:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000080149016.
02000000:00000001:19.0:1773851859.850079:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850079:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000232a44b5.
02000000:00000001:19.0:1773851859.850080:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850080:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001fa2fd58.
02000000:00000001:19.0:1773851859.850081:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850081:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000149d0293.
02000000:00000001:19.0:1773851859.850082:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850082:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000223ff4ca.
02000000:00000001:19.0:1773851859.850083:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850083:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000038ae3851.
02000000:00000001:19.0:1773851859.850084:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850085:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a19dface.
02000000:00000001:19.0:1773851859.850085:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850085:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a9b84c6e.
02000000:00000001:19.0:1773851859.850086:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850087:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007543213b.
02000000:00000001:19.0:1773851859.850087:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850087:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003123ab1d.
02000000:00000001:19.0:1773851859.850088:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850088:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b3f22ce3.
02000000:00000001:19.0:1773851859.850089:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850089:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000096be21b0.
02000000:00000001:19.0:1773851859.850090:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850090:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000093a4d0f8.
02000000:00000001:19.0:1773851859.850091:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850091:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000043ee9ab9.
02000000:00000001:19.0:1773851859.850092:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850092:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f9e1e4b8.
02000000:00000001:19.0:1773851859.850093:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850093:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e89de2ba.
02000000:00000001:19.0:1773851859.850094:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850094:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000102e115b.
02000000:00000001:19.0:1773851859.850095:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850095:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a2cb95b.
02000000:00000001:19.0:1773851859.850096:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850096:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001ac6b3a4.
02000000:00000001:19.0:1773851859.850097:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850097:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000060f92a14.
02000000:00000001:19.0:1773851859.850098:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850098:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fc93d8ff.
02000000:00000001:19.0:1773851859.850098:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850099:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042605167.
02000000:00000001:19.0:1773851859.850099:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850100:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002804aef6.
02000000:00000001:19.0:1773851859.850100:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850101:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000049bd301e.
02000000:00000001:19.0:1773851859.850101:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850102:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000537aab97.
02000000:00000001:19.0:1773851859.850102:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850103:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000071684c10.
02000000:00000001:19.0:1773851859.850103:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850104:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d9c29df5.
02000000:00000001:19.0:1773851859.850104:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850105:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b8bd9d4.
02000000:00000001:19.0:1773851859.850106:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850106:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000f0be3f3d.
02000000:00000001:19.0:1773851859.850107:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850107:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004b95668b.
02000000:00000001:19.0:1773851859.850107:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850108:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fc6ef339.
02000000:00000001:19.0:1773851859.850109:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850109:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3ee4033.
02000000:00000001:19.0:1773851859.850110:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850110:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000219a7cf3.
02000000:00000001:19.0:1773851859.850111:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850111:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000055be622.
02000000:00000001:19.0:1773851859.850112:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850112:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004f037cd3.
02000000:00000001:19.0:1773851859.850112:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850113:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005969e730.
02000000:00000001:19.0:1773851859.850113:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850114:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000065d9e710.
02000000:00000001:19.0:1773851859.850114:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850115:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000308eda8b.
02000000:00000001:19.0:1773851859.850115:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850116:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000424b42fd.
02000000:00000001:19.0:1773851859.850116:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850117:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f8e8edf2.
02000000:00000001:19.0:1773851859.850117:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850118:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012530bc3.
02000000:00000001:19.0:1773851859.850118:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850119:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000845d11ef.
02000000:00000001:19.0:1773851859.850119:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850119:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ee4e2eb.
02000000:00000001:19.0:1773851859.850120:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850121:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d705c960.
02000000:00000001:19.0:1773851859.850122:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850122:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d94fd92.
02000000:00000001:19.0:1773851859.850123:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850123:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1dffbd1.
02000000:00000001:19.0:1773851859.850124:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850124:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000368c3e67.
02000000:00000001:19.0:1773851859.850125:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850125:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008edf67bb.
02000000:00000001:19.0:1773851859.850126:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850126:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000074cabf4a.
02000000:00000001:19.0:1773851859.850127:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850127:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006b55a015.
02000000:00000001:19.0:1773851859.850128:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850128:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d50f0a67.
02000000:00000001:19.0:1773851859.850129:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850129:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d0ecfc2c.
02000000:00000001:19.0:1773851859.850130:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850130:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ef70f4e.
02000000:00000001:19.0:1773851859.850131:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850131:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009e66c2ed.
02000000:00000001:19.0:1773851859.850132:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850132:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001e3d289c.
02000000:00000001:19.0:1773851859.850133:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850133:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dcd1c62e.
02000000:00000001:19.0:1773851859.850134:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850134:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ab1064a1.
02000000:00000001:19.0:1773851859.850135:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850135:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d21f54a5.
02000000:00000001:19.0:1773851859.850136:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850136:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a5cc7800.
02000000:00000001:19.0:1773851859.850137:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850137:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000054a77f1c.
02000000:00000001:19.0:1773851859.850138:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850138:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000046c30fc6.
02000000:00000001:19.0:1773851859.850139:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850139:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000028a65d62.
02000000:00000001:19.0:1773851859.850140:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850141:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000f85d5e40.
02000000:00000001:19.0:1773851859.850142:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850142:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000068e42a0b.
02000000:00000001:19.0:1773851859.850143:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850143:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000525cd4bb.
02000000:00000001:19.0:1773851859.850144:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850144:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000068d5af25.
02000000:00000001:19.0:1773851859.850145:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850145:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f7ca9fcb.
02000000:00000001:19.0:1773851859.850146:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850146:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009189b769.
02000000:00000001:19.0:1773851859.850147:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850147:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000afe04362.
02000000:00000001:19.0:1773851859.850148:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850148:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d9b014ff.
02000000:00000001:19.0:1773851859.850149:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850149:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009fc0bbd0.
02000000:00000001:19.0:1773851859.850150:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850150:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000fcd120f.
02000000:00000001:19.0:1773851859.850151:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850151:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fa4d1d33.
02000000:00000001:19.0:1773851859.850152:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850152:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a270d1a.
02000000:00000001:19.0:1773851859.850153:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850153:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006bc3108e.
02000000:00000001:19.0:1773851859.850153:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850154:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000023249e9d.
02000000:00000001:19.0:1773851859.850155:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850155:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003af8630b.
02000000:00000001:19.0:1773851859.850156:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850156:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007b22f57f.
02000000:00000001:19.0:1773851859.850157:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850157:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000043dbf6be.
02000000:00000001:19.0:1773851859.850158:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850158:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa19a7bd.
02000000:00000001:19.0:1773851859.850159:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850159:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000215811b9.
02000000:00000001:19.0:1773851859.850160:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850160:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c441c7a.
02000000:00000001:19.0:1773851859.850161:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850161:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c43a43a.
02000000:00000001:19.0:1773851859.850162:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850162:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000081dedff0.
02000000:00000001:19.0:1773851859.850163:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850163:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce88c41a.
02000000:00000001:19.0:1773851859.850163:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850164:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d37d584.
02000000:00000001:19.0:1773851859.850165:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850165:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e3855829.
02000000:00000001:19.0:1773851859.850166:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850166:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003a21f092.
02000000:00000001:19.0:1773851859.850167:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850167:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007e25313a.
02000000:00000001:19.0:1773851859.850167:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850168:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000671815c4.
02000000:00000001:19.0:1773851859.850169:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850169:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e5f44f7d.
02000000:00000001:19.0:1773851859.850170:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850170:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c1c9cbf6.
02000000:00000001:19.0:1773851859.850170:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850171:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005df6760c.
02000000:00000001:19.0:1773851859.850171:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850172:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa8c41a6.
02000000:00000001:19.0:1773851859.850172:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850173:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b452f731.
02000000:00000001:19.0:1773851859.850173:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850174:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000062030eb7.
02000000:00000001:19.0:1773851859.850175:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850175:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ea20870e.
02000000:00000001:19.0:1773851859.850176:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850176:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e49488cb.
02000000:00000001:19.0:1773851859.850177:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850177:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012951313.
02000000:00000001:19.0:1773851859.850178:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850178:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d95ef812.
02000000:00000001:19.0:1773851859.850179:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850180:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000450e92c0.
02000000:00000001:19.0:1773851859.850180:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850181:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004217ed7c.
02000000:00000001:19.0:1773851859.850181:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850182:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2162e63.
02000000:00000001:19.0:1773851859.850182:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850183:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000093e7c0d5.
02000000:00000001:19.0:1773851859.850183:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850184:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005e4da891.
02000000:00000001:19.0:1773851859.850184:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850184:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b15b04ad.
02000000:00000001:19.0:1773851859.850186:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850186:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001dbd0137.
02000000:00000001:19.0:1773851859.850187:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850187:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009e478b2c.
02000000:00000001:19.0:1773851859.850188:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850188:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e11c5973.
02000000:00000001:19.0:1773851859.850189:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850189:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000109ca38a.
02000000:00000001:19.0:1773851859.850190:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850190:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000af77d779.
02000000:00000001:19.0:1773851859.850191:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850191:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a8d66f4.
02000000:00000001:19.0:1773851859.850192:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850192:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000040e901b3.
02000000:00000001:19.0:1773851859.850193:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850194:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000075a98d23.
02000000:00000001:19.0:1773851859.850195:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850195:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dfe030ef.
02000000:00000001:19.0:1773851859.850196:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850196:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001fe47ee3.
02000000:00000001:19.0:1773851859.850197:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850197:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004f55bf73.
02000000:00000001:19.0:1773851859.850197:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850198:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cab96bf5.
02000000:00000001:19.0:1773851859.850198:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850199:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c6bc745.
02000000:00000001:19.0:1773851859.850199:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850200:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000023ec9e79.
02000000:00000001:19.0:1773851859.850201:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850201:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b1a0391a.
02000000:00000001:19.0:1773851859.850202:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850203:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d3c4929c.
02000000:00000001:19.0:1773851859.850203:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850203:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000f46891e.
02000000:00000001:19.0:1773851859.850204:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850204:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000275d3270.
02000000:00000001:19.0:1773851859.850205:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850205:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000057bcb6ab.
02000000:00000001:19.0:1773851859.850206:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850206:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004e58d51.
02000000:00000001:19.0:1773851859.850207:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850207:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b77aa220.
02000000:00000001:19.0:1773851859.850208:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850208:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098b01b1c.
02000000:00000001:19.0:1773851859.850209:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850209:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000618adffa.
02000000:00000001:19.0:1773851859.850210:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850210:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002ec1df71.
02000000:00000001:19.0:1773851859.850211:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850212:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001091ca79.
02000000:00000001:19.0:1773851859.850212:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850212:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000530170fb.
02000000:00000001:19.0:1773851859.850213:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850213:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d55eb5a5.
02000000:00000001:19.0:1773851859.850214:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850214:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000008380117.
02000000:00000001:19.0:1773851859.850215:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850215:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007517f3cd.
02000000:00000001:19.0:1773851859.850216:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850216:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ccab8c8a.
02000000:00000001:19.0:1773851859.850217:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850217:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e3345833.
02000000:00000001:19.0:1773851859.850218:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850218:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009eeff480.
02000000:00000001:19.0:1773851859.850219:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850220:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000317e1e9c.
02000000:00000001:19.0:1773851859.850220:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850221:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f8861e0.
02000000:00000001:19.0:1773851859.850221:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850222:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000089247b1d.
02000000:00000001:19.0:1773851859.850222:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850222:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008562292d.
02000000:00000001:19.0:1773851859.850223:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850224:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000029e021b0.
02000000:00000001:19.0:1773851859.850225:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850225:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8355d51.
02000000:00000001:19.0:1773851859.850226:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850226:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001bc1c1c8.
02000000:00000001:19.0:1773851859.850227:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850227:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000069c87497.
02000000:00000001:19.0:1773851859.850228:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850229:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007b1d5dfe.
02000000:00000001:19.0:1773851859.850229:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850230:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000954463f0.
02000000:00000001:19.0:1773851859.850230:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850231:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e780a665.
02000000:00000001:19.0:1773851859.850231:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850232:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000010c7391.
02000000:00000001:19.0:1773851859.850233:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850233:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000a1f499df.
02000000:00000001:19.0:1773851859.850234:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850234:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000809b62eb.
02000000:00000001:19.0:1773851859.850235:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850235:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000072ade2e5.
02000000:00000001:19.0:1773851859.850236:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850236:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ea54f1f.
02000000:00000001:19.0:1773851859.850237:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850237:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d3c84bb7.
02000000:00000001:19.0:1773851859.850238:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850238:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a22c0ed.
00000100:00000010:19.0:1773851859.850239:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009b280808.
02000000:00000001:19.0:1773851859.850240:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850240:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000094ccf4d1.
02000000:00000001:19.0:1773851859.850242:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850242:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000095199f25.
02000000:00000001:19.0:1773851859.850243:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850243:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eae7145e.
02000000:00000001:19.0:1773851859.850244:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850244:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000099fb56c2.
02000000:00000001:19.0:1773851859.850245:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850245:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000006abde4b2.
02000000:00000001:19.0:1773851859.850246:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850247:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e9ed9423.
00000100:00000010:19.0:1773851859.850247:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000463a550a.
02000000:00000001:19.0:1773851859.850248:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850249:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000217c6248.
02000000:00000001:19.0:1773851859.850249:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850249:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ff83cf3b.
02000000:00000001:19.0:1773851859.850250:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850251:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007505438d.
02000000:00000001:19.0:1773851859.850251:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850252:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003f4fe1c3.
02000000:00000001:19.0:1773851859.850252:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850253:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030287477.
02000000:00000001:19.0:1773851859.850253:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850253:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c949d3bf.
02000000:00000001:19.0:1773851859.850255:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850255:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000066c37d24.
02000000:00000001:19.0:1773851859.850256:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850256:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017093a6a.
02000000:00000001:19.0:1773851859.850257:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850257:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd674b0c.
02000000:00000001:19.0:1773851859.850258:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850258:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ebd3455.
02000000:00000001:19.0:1773851859.850259:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850259:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000585d06df.
02000000:00000001:19.0:1773851859.850260:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850260:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e18e2448.
02000000:00000001:19.0:1773851859.850261:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850261:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000170df72f.
02000000:00000001:19.0:1773851859.850262:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850263:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000082b7098b.
02000000:00000001:19.0:1773851859.850263:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850264:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000001a8dfd27.
02000000:00000001:19.0:1773851859.850265:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850265:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c53e7ebb.
02000000:00000001:19.0:1773851859.850266:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850266:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000be664d77.
02000000:00000001:19.0:1773851859.850267:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850267:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d22b6dc2.
02000000:00000001:19.0:1773851859.850268:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850268:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000342373a5.
02000000:00000001:19.0:1773851859.850269:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850269:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6a10b3b.
02000000:00000001:19.0:1773851859.850270:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850270:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069670ecd.
02000000:00000001:19.0:1773851859.850271:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850271:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d64d535e.
02000000:00000001:19.0:1773851859.850272:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850273:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b0218e43.
02000000:00000001:19.0:1773851859.850273:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850274:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5fbc627.
02000000:00000001:19.0:1773851859.850275:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850275:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c2d8b55b.
02000000:00000001:19.0:1773851859.850276:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850276:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fd350121.
02000000:00000001:19.0:1773851859.850276:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850277:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b78fe83.
02000000:00000001:19.0:1773851859.850277:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850277:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ff645ba9.
02000000:00000001:19.0:1773851859.850278:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850279:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001fd48c4c.
02000000:00000001:19.0:1773851859.850279:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850280:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed3771ed.
02000000:00000001:19.0:1773851859.850280:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850281:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ff0875b3.
02000000:00000001:19.0:1773851859.850281:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850282:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c14abcfd.
02000000:00000001:19.0:1773851859.850283:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850283:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e1b76097.
02000000:00000001:19.0:1773851859.850283:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850284:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000021355aa0.
02000000:00000001:19.0:1773851859.850285:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850285:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c4a99def.
02000000:00000001:19.0:1773851859.850285:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850286:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005cab8264.
02000000:00000001:19.0:1773851859.850287:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850287:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 000000007b355c00.
02000000:00000001:19.0:1773851859.850288:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850288:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000088a1bcb0.
02000000:00000001:19.0:1773851859.850289:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850289:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004239cabc.
02000000:00000001:19.0:1773851859.850290:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850290:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001913a1f0.
02000000:00000001:19.0:1773851859.850291:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850292:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f5306568.
02000000:00000001:19.0:1773851859.850292:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850293:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001cce50a8.
02000000:00000001:19.0:1773851859.850293:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850294:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000033de672d.
02000000:00000001:19.0:1773851859.850294:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850295:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000bcff44c.
02000000:00000001:19.0:1773851859.850296:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850296:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001df824a3.
02000000:00000001:19.0:1773851859.850297:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850297:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024346b09.
02000000:00000001:19.0:1773851859.850298:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850298:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000056224a2a.
02000000:00000001:19.0:1773851859.850299:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850299:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e01e0da2.
02000000:00000001:19.0:1773851859.850300:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850300:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000db6b06bf.
02000000:00000001:19.0:1773851859.850301:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850301:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000072635912.
02000000:00000001:19.0:1773851859.850302:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850302:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000009da01f0.
02000000:00000001:19.0:1773851859.850303:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850304:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fe24a3ce.
02000000:00000001:19.0:1773851859.850304:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850305:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000651fbc8a.
02000000:00000001:19.0:1773851859.850305:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850306:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007041ddeb.
02000000:00000001:19.0:1773851859.850306:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850307:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000836eab59.
02000000:00000001:19.0:1773851859.850307:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850308:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006c5bf1ea.
02000000:00000001:19.0:1773851859.850309:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850309:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002234ff00.
02000000:00000001:19.0:1773851859.850309:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850310:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5cbe556.
02000000:00000001:19.0:1773851859.850311:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850311:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002533a3f3.
02000000:00000001:19.0:1773851859.850311:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850312:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a61a37df.
02000000:00000001:19.0:1773851859.850313:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850313:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 0000000020060bf6.
02000000:00000001:19.0:1773851859.850314:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850315:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005840701a.
02000000:00000001:19.0:1773851859.850316:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850316:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000df0a0acf.
02000000:00000001:19.0:1773851859.850316:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850317:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000053bfbbfe.
02000000:00000001:19.0:1773851859.850318:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850318:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd9dea5b.
02000000:00000001:19.0:1773851859.850318:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850319:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d56eec6.
02000000:00000001:19.0:1773851859.850320:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850320:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000067ff6a01.
02000000:00000001:19.0:1773851859.850321:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850321:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a35ee7f.
02000000:00000001:19.0:1773851859.850322:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850322:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000df0f4ec0.
02000000:00000001:19.0:1773851859.850323:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850323:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1123887.
02000000:00000001:19.0:1773851859.850324:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850325:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000612e3e4.
02000000:00000001:19.0:1773851859.850326:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850326:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000099bc48ba.
02000000:00000001:19.0:1773851859.850327:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850327:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a7cb922a.
02000000:00000001:19.0:1773851859.850328:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850329:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e90c2e51.
02000000:00000001:19.0:1773851859.850330:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850330:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb3406ca.
02000000:00000001:19.0:1773851859.850331:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850331:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c73189a7.
02000000:00000001:19.0:1773851859.850332:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850332:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000070a26515.
02000000:00000001:19.0:1773851859.850333:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850333:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c027f38f.
02000000:00000001:19.0:1773851859.850334:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850334:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fa8cbae6.
02000000:00000001:19.0:1773851859.850335:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850336:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024cc4485.
02000000:00000001:19.0:1773851859.850337:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850337:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000010a935d2.
02000000:00000001:19.0:1773851859.850337:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850338:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c341224e.
02000000:00000001:19.0:1773851859.850339:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850339:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000076eb1b0d.
02000000:00000001:19.0:1773851859.850339:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850340:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004a27f09a.
02000000:00000001:19.0:1773851859.850341:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850341:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e2b89cf.
02000000:00000001:19.0:1773851859.850341:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850342:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000057c5c3ff.
02000000:00000001:19.0:1773851859.850343:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850343:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce8793b5.
02000000:00000001:19.0:1773851859.850344:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850344:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000093e3ddf1.
02000000:00000001:19.0:1773851859.850345:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850345:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009bc44bd9.
02000000:00000001:19.0:1773851859.850346:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850349:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000756c1d71.
02000000:00000001:19.0:1773851859.850350:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850350:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000d50de7e.
02000000:00000001:19.0:1773851859.850351:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850352:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000297eb57e.
02000000:00000001:19.0:1773851859.850353:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850353:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000415d51ef.
02000000:00000001:19.0:1773851859.850353:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850354:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000003c7b6b0.
02000000:00000001:19.0:1773851859.850355:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850355:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006ef962a1.
02000000:00000001:19.0:1773851859.850356:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850356:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002dd7956d.
02000000:00000001:19.0:1773851859.850357:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850357:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000428c7829.
02000000:00000001:19.0:1773851859.850358:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850358:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000013f4269a.
02000000:00000001:19.0:1773851859.850360:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850360:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000075f6add7.
02000000:00000001:19.0:1773851859.850361:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850361:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bf029f1b.
02000000:00000001:19.0:1773851859.850362:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850363:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b23b8fc0.
02000000:00000001:19.0:1773851859.850363:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850364:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f15da627.
02000000:00000001:19.0:1773851859.850365:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850365:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005db84e4e.
02000000:00000001:19.0:1773851859.850365:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850366:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fcf3b4f9.
02000000:00000001:19.0:1773851859.850367:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850367:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001750a991.
02000000:00000001:19.0:1773851859.850368:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850369:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd3fe2b2.
02000000:00000001:19.0:1773851859.850369:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850370:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000926a7268.
02000000:00000001:19.0:1773851859.850370:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850371:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000adec4533.
02000000:00000001:19.0:1773851859.850372:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850373:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000047bafa6.
02000000:00000001:19.0:1773851859.850373:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850374:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000289dd977.
02000000:00000001:19.0:1773851859.850375:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850375:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d6b5dff.
02000000:00000001:19.0:1773851859.850376:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850376:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d9ba9ac1.
02000000:00000001:19.0:1773851859.850377:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850377:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a375a315.
02000000:00000001:19.0:1773851859.850378:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850379:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a9ffe534.
02000000:00000001:19.0:1773851859.850379:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850380:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e432db77.
02000000:00000001:19.0:1773851859.850380:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850381:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042b81953.
02000000:00000001:19.0:1773851859.850382:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850382:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000756827dd.
02000000:00000001:19.0:1773851859.850383:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850383:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bacab09f.
02000000:00000001:19.0:1773851859.850384:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850384:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ba6960e9.
02000000:00000001:19.0:1773851859.850385:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850385:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007ba92360.
02000000:00000001:19.0:1773851859.850386:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850386:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008270ec35.
02000000:00000001:19.0:1773851859.850387:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850387:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000047c0f6d.
02000000:00000001:19.0:1773851859.850388:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850388:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fa6b4b30.
02000000:00000001:19.0:1773851859.850389:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850389:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000030507f6.
02000000:00000001:19.0:1773851859.850390:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850391:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000074802942.
02000000:00000001:19.0:1773851859.850391:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850392:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b337f3ac.
02000000:00000001:19.0:1773851859.850393:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850393:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000510b6ae7.
02000000:00000001:19.0:1773851859.850394:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850395:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009b53f50a.
02000000:00000001:19.0:1773851859.850395:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850396:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027b95ac3.
02000000:00000001:19.0:1773851859.850396:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850397:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c6bca9d.
02000000:00000001:19.0:1773851859.850397:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850398:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c55f7d81.
02000000:00000001:19.0:1773851859.850398:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850399:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009972e054.
02000000:00000001:19.0:1773851859.850400:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850400:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6b1fbba.
02000000:00000001:19.0:1773851859.850401:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850401:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f03edab.
02000000:00000001:19.0:1773851859.850402:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850402:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 000000001d7b97ca.
02000000:00000001:19.0:1773851859.850403:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850403:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000237d7c51.
02000000:00000001:19.0:1773851859.850404:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850405:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000008a4cee59.
02000000:00000001:19.0:1773851859.850405:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850406:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cfd8eb7.
02000000:00000001:19.0:1773851859.850407:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850407:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000203b94f.
02000000:00000001:19.0:1773851859.850408:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850408:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cbc10bb.
02000000:00000001:19.0:1773851859.850410:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850410:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c9f4541d.
02000000:00000001:19.0:1773851859.850411:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850411:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006875b1d.
02000000:00000001:19.0:1773851859.850412:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850413:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b47aaf4c.
02000000:00000001:19.0:1773851859.850413:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850414:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a572783.
02000000:00000001:19.0:1773851859.850415:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850415:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003609aef7.
02000000:00000001:19.0:1773851859.850416:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850416:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a84393c9.
02000000:00000001:19.0:1773851859.850417:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850418:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f07c3a5a.
02000000:00000001:19.0:1773851859.850419:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850419:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b6a81fc2.
02000000:00000001:19.0:1773851859.850421:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850421:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000072d576b2.
02000000:00000001:19.0:1773851859.850422:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850422:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f615386f.
02000000:00000001:19.0:1773851859.850423:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850424:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000005c766d5.
02000000:00000001:19.0:1773851859.850425:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850425:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cfab4ed.
02000000:00000001:19.0:1773851859.850426:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850427:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000038166af3.
02000000:00000001:19.0:1773851859.850427:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850428:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036db96aa.
02000000:00000001:19.0:1773851859.850429:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850429:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000287a438b.
02000000:00000001:19.0:1773851859.850430:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850431:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005608f9b4.
02000000:00000001:19.0:1773851859.850432:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850432:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b92a470f.
02000000:00000001:19.0:1773851859.850433:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850433:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa4623a3.
02000000:00000001:19.0:1773851859.850434:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850434:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e7c81c04.
02000000:00000001:19.0:1773851859.850435:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850435:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3058eb1.
02000000:00000001:19.0:1773851859.850436:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850437:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004e58649f.
02000000:00000001:19.0:1773851859.850437:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850438:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a53f8ba.
02000000:00000001:19.0:1773851859.850439:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850439:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005eb56977.
02000000:00000001:19.0:1773851859.850440:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850440:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f19367ba.
02000000:00000001:19.0:1773851859.850441:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850441:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000073658142.
02000000:00000001:19.0:1773851859.850442:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850443:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001dc01b5a.
02000000:00000001:19.0:1773851859.850444:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850444:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000a0f71015.
02000000:00000001:19.0:1773851859.850445:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850445:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000875d40af.
02000000:00000001:19.0:1773851859.850447:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850447:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000074c4a488.
02000000:00000001:19.0:1773851859.850448:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850448:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004eca501c.
02000000:00000001:19.0:1773851859.850449:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850449:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000db4ae9a1.
02000000:00000001:19.0:1773851859.850450:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850450:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d88bc45b.
02000000:00000001:19.0:1773851859.850452:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850452:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c0ed44d3.
02000000:00000001:19.0:1773851859.850453:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850453:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006633bd3c.
02000000:00000001:19.0:1773851859.850454:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850455:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb5a33c5.
02000000:00000001:19.0:1773851859.850455:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850456:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000be89ff0f.
02000000:00000001:19.0:1773851859.850457:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850457:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000425ea2ac.
02000000:00000001:19.0:1773851859.850458:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850458:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005d9c3536.
02000000:00000001:19.0:1773851859.850459:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850460:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002acbad62.
02000000:00000001:19.0:1773851859.850460:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850461:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000086f7e7f.
02000000:00000001:19.0:1773851859.850462:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850462:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c05c0f7.
02000000:00000001:19.0:1773851859.850463:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850463:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009753d220.
02000000:00000001:19.0:1773851859.850464:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850465:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a977520.
02000000:00000001:19.0:1773851859.850466:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850466:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000008c788ad.
02000000:00000001:19.0:1773851859.850467:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850468:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000043021114.
02000000:00000001:19.0:1773851859.850468:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850469:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008f541eca.
02000000:00000001:19.0:1773851859.850470:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850470:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000866129c9.
02000000:00000001:19.0:1773851859.850471:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850472:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019c83baa.
02000000:00000001:19.0:1773851859.850473:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850473:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a24879d.
02000000:00000001:19.0:1773851859.850474:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850474:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005903fb7c.
02000000:00000001:19.0:1773851859.850476:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850476:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b8ac583.
02000000:00000001:19.0:1773851859.850477:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850477:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a808b47e.
02000000:00000001:19.0:1773851859.850478:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850479:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003960e0bf.
02000000:00000001:19.0:1773851859.850480:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850480:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000be074af3.
02000000:00000001:19.0:1773851859.850481:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850482:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fe243b36.
02000000:00000001:19.0:1773851859.850482:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850483:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b4a817ad.
02000000:00000001:19.0:1773851859.850484:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850484:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000001ae1ab4a.
02000000:00000001:19.0:1773851859.850485:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850485:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000014ba5466.
02000000:00000001:19.0:1773851859.850486:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850487:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fb2a2ac4.
02000000:00000001:19.0:1773851859.850487:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850488:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b3da9be2.
02000000:00000001:19.0:1773851859.850489:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850489:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d58b2451.
02000000:00000001:19.0:1773851859.850490:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850490:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002ddd92b5.
02000000:00000001:19.0:1773851859.850491:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850492:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000034fec7bf.
02000000:00000001:19.0:1773851859.850492:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850493:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a3b43983.
02000000:00000001:19.0:1773851859.850494:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850495:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000321f8c6a.
02000000:00000001:19.0:1773851859.850496:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850496:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002ffc61c7.
02000000:00000001:19.0:1773851859.850497:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850497:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000141aa2da.
02000000:00000001:19.0:1773851859.850498:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850499:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c2a1e6d5.
02000000:00000001:19.0:1773851859.850500:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850501:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000ce3f562e.
02000000:00000001:19.0:1773851859.850501:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850502:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d314aad9.
02000000:00000001:19.0:1773851859.850503:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850503:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000006d1b2d8c.
02000000:00000001:19.0:1773851859.850504:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850504:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d41b7241.
02000000:00000001:19.0:1773851859.850505:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850505:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c087bfc3.
02000000:00000001:19.0:1773851859.850506:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850507:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000827df06a.
02000000:00000001:19.0:1773851859.850508:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850508:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000100dbd31.
02000000:00000001:19.0:1773851859.850509:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850509:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000208acd37.
02000000:00000001:19.0:1773851859.850510:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850510:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000001a994083.
02000000:00000001:19.0:1773851859.850511:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850512:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000945bfabd.
02000000:00000001:19.0:1773851859.850513:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850513:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000de249e6f.
02000000:00000001:19.0:1773851859.850514:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850515:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e4fdb318.
02000000:00000001:19.0:1773851859.850516:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850517:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000f736784e.
02000000:00000001:19.0:1773851859.850518:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850518:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000085304571.
02000000:00000001:19.0:1773851859.850519:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850520:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000076416469.
02000000:00000001:19.0:1773851859.850521:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850521:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b7eda7a1.
02000000:00000001:19.0:1773851859.850522:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850523:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000c6a6c473.
02000000:00000001:19.0:1773851859.850524:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850524:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a18ef87a.
02000000:00000001:19.0:1773851859.850525:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850525:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002ecdb64a.
02000000:00000001:19.0:1773851859.850526:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850526:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061b0adcc.
02000000:00000001:19.0:1773851859.850527:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850528:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030aa3e7d.
02000000:00000001:19.0:1773851859.850528:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850529:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de7f8b62.
02000000:00000001:19.0:1773851859.850530:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850530:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b4b11e9a.
02000000:00000001:19.0:1773851859.850531:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850532:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eb25951a.
02000000:00000001:19.0:1773851859.850533:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850533:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007588660d.
02000000:00000001:19.0:1773851859.850534:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850535:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000689bc844.
02000000:00000001:19.0:1773851859.850536:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850536:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000df27dc8d.
02000000:00000001:19.0:1773851859.850537:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850537:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006cb4cd82.
02000000:00000001:19.0:1773851859.850539:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850539:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009aef08f8.
02000000:00000001:19.0:1773851859.850539:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850540:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000025e17eb.
02000000:00000001:19.0:1773851859.850541:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850542:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000095ba2d27.
02000000:00000001:19.0:1773851859.850542:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850543:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c33a0bf.
02000000:00000001:19.0:1773851859.850544:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850544:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ba77d68e.
02000000:00000001:19.0:1773851859.850545:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850546:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000793845b9.
02000000:00000001:19.0:1773851859.850547:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850547:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000aca21f2d.
02000000:00000001:19.0:1773851859.850548:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850549:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce3b5dd9.
02000000:00000001:19.0:1773851859.850550:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850550:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000c705b383.
02000000:00000001:19.0:1773851859.850550:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850551:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000693cab54.
02000000:00000001:19.0:1773851859.850552:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850552:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e287b3bd.
02000000:00000001:19.0:1773851859.850553:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850553:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e8f7d7f6.
02000000:00000001:19.0:1773851859.850554:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850554:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000035bf9d08.
02000000:00000001:19.0:1773851859.850555:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850555:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000548e2a8e.
02000000:00000001:19.0:1773851859.850556:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850557:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ef1450ec.
02000000:00000001:19.0:1773851859.850557:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850558:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000386a53a.
02000000:00000001:19.0:1773851859.850559:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850559:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e9128b3.
02000000:00000001:19.0:1773851859.850559:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850560:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000af2a9519.
02000000:00000001:19.0:1773851859.850560:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850561:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007673a8ee.
02000000:00000001:19.0:1773851859.850561:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850562:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006250069c.
02000000:00000001:19.0:1773851859.850563:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850564:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008283bb59.
02000000:00000001:19.0:1773851859.850564:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850565:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a4cbeba.
02000000:00000001:19.0:1773851859.850566:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850566:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000866eb49a.
02000000:00000001:19.0:1773851859.850567:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850567:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d0647fb3.
02000000:00000001:19.0:1773851859.850568:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850569:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a9fa9763.
02000000:00000001:19.0:1773851859.850569:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850570:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c42dc39b.
02000000:00000001:19.0:1773851859.850571:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850571:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004e47f245.
02000000:00000001:19.0:1773851859.850572:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850572:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005eeab67a.
02000000:00000001:19.0:1773851859.850573:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850573:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f8243809.
02000000:00000001:19.0:1773851859.850574:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850575:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e6bbb9eb.
02000000:00000001:19.0:1773851859.850576:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850576:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e5aab029.
02000000:00000001:19.0:1773851859.850577:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850578:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000064814a51.
02000000:00000001:19.0:1773851859.850579:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850579:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000f16d4b87.
02000000:00000001:19.0:1773851859.850580:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850581:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb7d22b3.
02000000:00000001:19.0:1773851859.850582:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850582:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000006c58ddc.
02000000:00000001:19.0:1773851859.850583:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850583:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000005e42e87.
02000000:00000001:19.0:1773851859.850584:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850584:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a197d99.
02000000:00000001:19.0:1773851859.850585:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850586:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003912d3d4.
02000000:00000001:19.0:1773851859.850587:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850587:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000c4428ac.
02000000:00000001:19.0:1773851859.850588:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850588:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7816563.
02000000:00000001:19.0:1773851859.850589:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850589:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000cb5475a.
02000000:00000001:19.0:1773851859.850590:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850590:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e55b3250.
02000000:00000001:19.0:1773851859.850591:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850592:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007c10daf0.
02000000:00000001:19.0:1773851859.850593:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850594:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007b2ab946.
02000000:00000001:19.0:1773851859.850594:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850595:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a081e6fa.
02000000:00000001:19.0:1773851859.850596:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850596:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000077151702.
02000000:00000001:19.0:1773851859.850597:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850597:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008e01721a.
02000000:00000001:19.0:1773851859.850598:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850598:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bae97fe4.
02000000:00000001:19.0:1773851859.850599:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850599:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000da2e4a53.
02000000:00000001:19.0:1773851859.850600:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850600:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef214091.
02000000:00000001:19.0:1773851859.850601:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850601:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000031bc4b85.
02000000:00000001:19.0:1773851859.850602:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850603:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f3df3700.
02000000:00000001:19.0:1773851859.850604:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850604:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c212a92a.
02000000:00000001:19.0:1773851859.850605:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850605:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000044bf726d.
02000000:00000001:19.0:1773851859.850606:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850607:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008fa08a83.
02000000:00000001:19.0:1773851859.850608:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850608:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002e54b38a.
02000000:00000001:19.0:1773851859.850609:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850609:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000912d0509.
02000000:00000001:19.0:1773851859.850610:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850610:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f913c3c8.
02000000:00000001:19.0:1773851859.850611:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850612:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a4a183f8.
02000000:00000001:19.0:1773851859.850613:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850613:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000028c04918.
02000000:00000001:19.0:1773851859.850614:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850614:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000121daf73.
02000000:00000001:19.0:1773851859.850615:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850615:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a696b126.
02000000:00000001:19.0:1773851859.850616:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850617:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000007af751f.
02000000:00000001:19.0:1773851859.850617:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850618:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000114b92b0.
02000000:00000001:19.0:1773851859.850619:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850619:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c0f24723.
02000000:00000001:19.0:1773851859.850620:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850620:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003e6f3f13.
02000000:00000001:19.0:1773851859.850621:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850621:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000076195463.
02000000:00000001:19.0:1773851859.850622:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850622:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000932c0aca.
02000000:00000001:19.0:1773851859.850624:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850624:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000042f4992.
02000000:00000001:19.0:1773851859.850625:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850625:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e5825baf.
02000000:00000001:19.0:1773851859.850626:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850627:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd1c5c5d.
02000000:00000001:19.0:1773851859.850627:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850628:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003540135e.
02000000:00000001:19.0:1773851859.850629:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850629:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000003782a777.
02000000:00000001:19.0:1773851859.850630:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850630:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc1f88d3.
02000000:00000001:19.0:1773851859.850631:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850631:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cb31ea05.
02000000:00000001:19.0:1773851859.850632:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850632:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a0b1085e.
02000000:00000001:19.0:1773851859.850633:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850634:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000008a98c00.
02000000:00000001:19.0:1773851859.850634:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850635:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009ad810ba.
02000000:00000001:19.0:1773851859.850636:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850636:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a7af6ea6.
02000000:00000001:19.0:1773851859.850637:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850637:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000092950123.
02000000:00000001:19.0:1773851859.850638:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850639:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e59e57b.
02000000:00000001:19.0:1773851859.850639:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850640:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ac3fb97.
02000000:00000001:19.0:1773851859.850641:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850641:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000034be735d.
02000000:00000001:19.0:1773851859.850642:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850643:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008dfd5237.
02000000:00000001:19.0:1773851859.850644:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850644:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c6a1039.
02000000:00000001:19.0:1773851859.850645:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850645:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009ae50ab6.
02000000:00000001:19.0:1773851859.850646:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850646:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000059092916.
02000000:00000001:19.0:1773851859.850647:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850647:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cdd22ebc.
02000000:00000001:19.0:1773851859.850648:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850649:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002f96cfbf.
02000000:00000001:19.0:1773851859.850650:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850650:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c03adc63.
02000000:00000001:19.0:1773851859.850651:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850651:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c850aaf.
02000000:00000001:19.0:1773851859.850652:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850652:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4179c7c.
02000000:00000001:19.0:1773851859.850653:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850653:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000205f81e3.
02000000:00000001:19.0:1773851859.850654:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850654:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000048a7bbde.
02000000:00000001:19.0:1773851859.850655:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850655:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f250af18.
02000000:00000001:19.0:1773851859.850656:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850656:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f690f3d.
02000000:00000001:19.0:1773851859.850657:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850658:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000080a59f6f.
02000000:00000001:19.0:1773851859.850658:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850658:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f2740eb.
02000000:00000001:19.0:1773851859.850659:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850660:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fc83e651.
02000000:00000001:19.0:1773851859.850660:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850661:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e04e439e.
02000000:00000001:19.0:1773851859.850661:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850662:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ac5aac5c.
02000000:00000001:19.0:1773851859.850663:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850663:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cd4dbf90.
02000000:00000001:19.0:1773851859.850664:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850664:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000086550cde.
02000000:00000001:19.0:1773851859.850665:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850665:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f9505d3.
02000000:00000001:19.0:1773851859.850666:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850667:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000040eca61d.
02000000:00000001:19.0:1773851859.850667:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850668:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007574b8c7.
02000000:00000001:19.0:1773851859.850669:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850669:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b8bf41c9.
02000000:00000001:19.0:1773851859.850670:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850670:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000092ce29c6.
02000000:00000001:19.0:1773851859.850671:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850672:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ac7748c8.
02000000:00000001:19.0:1773851859.850672:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850673:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002e49b11.
02000000:00000001:19.0:1773851859.850673:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850674:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fb7ce1a7.
02000000:00000001:19.0:1773851859.850674:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850675:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000604d22cb.
02000000:00000001:19.0:1773851859.850675:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850676:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000967370fc.
02000000:00000001:19.0:1773851859.850676:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850677:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d6522c78.
02000000:00000001:19.0:1773851859.850678:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850678:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004506cc1c.
02000000:00000001:19.0:1773851859.850678:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850679:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ecf6637.
02000000:00000001:19.0:1773851859.850680:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850680:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d720b4c1.
02000000:00000001:19.0:1773851859.850681:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850681:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e292d6e1.
02000000:00000001:19.0:1773851859.850682:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850682:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b9313bb5.
02000000:00000001:19.0:1773851859.850683:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850684:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076eb54fb.
02000000:00000001:19.0:1773851859.850685:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850685:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f927bf3c.
02000000:00000001:19.0:1773851859.850686:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850687:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009fd8dadf.
02000000:00000001:19.0:1773851859.850688:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850688:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d5fff064.
02000000:00000001:19.0:1773851859.850689:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850689:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b99113d6.
02000000:00000001:19.0:1773851859.850690:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850691:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000072081845.
02000000:00000001:19.0:1773851859.850691:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850692:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad36da86.
02000000:00000001:19.0:1773851859.850693:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850693:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b9bee40a.
02000000:00000001:19.0:1773851859.850694:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850694:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031d7d84c.
02000000:00000001:19.0:1773851859.850695:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850695:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000003b4b86d.
02000000:00000001:19.0:1773851859.850696:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850696:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004233e9bb.
02000000:00000001:19.0:1773851859.850698:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850698:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b0b5bc1.
02000000:00000001:19.0:1773851859.850699:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850699:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000078465d2.
02000000:00000001:19.0:1773851859.850700:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850700:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006268ef40.
02000000:00000001:19.0:1773851859.850701:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850701:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d2921f06.
02000000:00000001:19.0:1773851859.850702:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850703:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000492a9303.
02000000:00000001:19.0:1773851859.850703:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850704:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001bace5be.
02000000:00000001:19.0:1773851859.850705:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850705:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002a1e4753.
02000000:00000001:19.0:1773851859.850706:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850706:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008b2a4e62.
02000000:00000001:19.0:1773851859.850707:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850708:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e099347.
02000000:00000001:19.0:1773851859.850709:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850710:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa737a90.
02000000:00000001:19.0:1773851859.850711:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850711:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cbea3aa1.
02000000:00000001:19.0:1773851859.850712:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850712:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000093cf61af.
02000000:00000001:19.0:1773851859.850713:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850713:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000077c73a9.
02000000:00000001:19.0:1773851859.850714:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850715:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a1e3ff5.
02000000:00000001:19.0:1773851859.850715:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850716:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005bc903eb.
02000000:00000001:19.0:1773851859.850717:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850717:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d6f015c.
02000000:00000001:19.0:1773851859.850718:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850718:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005d93af63.
02000000:00000001:19.0:1773851859.850719:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850720:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031fa86c4.
02000000:00000001:19.0:1773851859.850720:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850721:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009ba89f7c.
02000000:00000001:19.0:1773851859.850721:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850722:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000797c6e12.
02000000:00000001:19.0:1773851859.850723:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850723:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001b6023d1.
02000000:00000001:19.0:1773851859.850724:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850724:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006c797590.
02000000:00000001:19.0:1773851859.850729:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850729:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002edb8b99.
02000000:00000001:19.0:1773851859.850730:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850730:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004a8e5c05.
02000000:00000001:19.0:1773851859.850731:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850731:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000953f3323.
02000000:00000001:19.0:1773851859.850732:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850732:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000044e4a7ce.
02000000:00000001:19.0:1773851859.850733:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850734:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000070afc260.
02000000:00000001:19.0:1773851859.850734:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850736:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d2a935e.
02000000:00000001:19.0:1773851859.850736:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850737:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001deff7cb.
02000000:00000001:19.0:1773851859.850737:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850738:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000beee36c4.
02000000:00000001:19.0:1773851859.850739:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850739:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000032cd10a2.
02000000:00000001:19.0:1773851859.850739:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850740:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000cee6f26.
02000000:00000001:19.0:1773851859.850741:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850741:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000048e3b96d.
02000000:00000001:19.0:1773851859.850742:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850742:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004df9f188.
02000000:00000001:19.0:1773851859.850743:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850744:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb557f8b.
02000000:00000001:19.0:1773851859.850744:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850745:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cb965562.
02000000:00000001:19.0:1773851859.850745:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850746:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000fd00144.
02000000:00000001:19.0:1773851859.850746:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850747:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000661f6085.
02000000:00000001:19.0:1773851859.850748:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850748:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000022b82e84.
02000000:00000001:19.0:1773851859.850749:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850749:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007b636535.
02000000:00000001:19.0:1773851859.850750:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850750:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002f9779dd.
02000000:00000001:19.0:1773851859.850751:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850751:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e5985adf.
02000000:00000001:19.0:1773851859.850752:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850752:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e5c0ef05.
02000000:00000001:19.0:1773851859.850753:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850753:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ff03930.
02000000:00000001:19.0:1773851859.850754:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850754:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000034d3f5f6.
02000000:00000001:19.0:1773851859.850755:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850755:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024505dc1.
02000000:00000001:19.0:1773851859.850756:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850758:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005da126e0.
02000000:00000001:19.0:1773851859.850759:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850759:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fdb9c5a0.
02000000:00000001:19.0:1773851859.850760:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850760:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005ce50da8.
02000000:00000001:19.0:1773851859.850761:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850762:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000120597cf.
02000000:00000001:19.0:1773851859.850762:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850763:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e3538a96.
02000000:00000001:19.0:1773851859.850764:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850764:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000038db4699.
02000000:00000001:19.0:1773851859.850765:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850765:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009b6e3394.
02000000:00000001:19.0:1773851859.850766:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850766:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a3564fdd.
02000000:00000001:19.0:1773851859.850767:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850767:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ccb6eaa4.
02000000:00000001:19.0:1773851859.850768:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850768:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c5d7583.
02000000:00000001:19.0:1773851859.850769:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850770:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cacf1d65.
02000000:00000001:19.0:1773851859.850770:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850771:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c24a3f06.
02000000:00000001:19.0:1773851859.850771:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850772:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007230ff17.
02000000:00000001:19.0:1773851859.850773:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850773:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000077fd8f8f.
02000000:00000001:19.0:1773851859.850774:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850774:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000a45c375e.
02000000:00000001:19.0:1773851859.850775:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850776:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a9a6f7d.
02000000:00000001:19.0:1773851859.850777:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850777:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000067a418c5.
02000000:00000001:19.0:1773851859.850778:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850778:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017b95cd1.
02000000:00000001:19.0:1773851859.850779:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850779:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000017d2da07.
02000000:00000001:19.0:1773851859.850780:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850781:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b0455ab3.
02000000:00000001:19.0:1773851859.850782:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850782:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000065b17e4d.
02000000:00000001:19.0:1773851859.850783:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850783:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004f56b6ed.
02000000:00000001:19.0:1773851859.850784:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850785:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 0000000076f97969.
02000000:00000001:19.0:1773851859.850786:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850786:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ba795b2.
02000000:00000001:19.0:1773851859.850787:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850787:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005fd3e7e5.
02000000:00000001:19.0:1773851859.850788:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850788:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001755686c.
02000000:00000001:19.0:1773851859.850789:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850790:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eee01117.
02000000:00000001:19.0:1773851859.850790:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850791:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa5dbdb5.
02000000:00000001:19.0:1773851859.850792:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850793:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dcc2e553.
02000000:00000001:19.0:1773851859.850793:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850794:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b5574df5.
02000000:00000001:19.0:1773851859.850795:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850795:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005524fc6c.
02000000:00000001:19.0:1773851859.850796:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850796:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000006763f.
02000000:00000001:19.0:1773851859.850797:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850798:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eabf090b.
02000000:00000001:19.0:1773851859.850798:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850799:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c134d4cb.
02000000:00000001:19.0:1773851859.850800:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850800:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a37d3a95.
02000000:00000001:19.0:1773851859.850801:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850801:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008136e4bd.
02000000:00000001:19.0:1773851859.850802:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850803:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bf518e48.
02000000:00000001:19.0:1773851859.850803:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850804:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c3bec198.
02000000:00000001:19.0:1773851859.850805:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850805:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002d047e40.
02000000:00000001:19.0:1773851859.850806:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850806:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079ee772a.
02000000:00000001:19.0:1773851859.850807:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850807:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084b9cd1a.
02000000:00000001:19.0:1773851859.850808:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850808:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000cac33a6.
02000000:00000001:19.0:1773851859.850809:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850810:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed1ae4ce.
02000000:00000001:19.0:1773851859.850810:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850811:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009665f9cc.
02000000:00000001:19.0:1773851859.850811:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850812:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000009b5f92b.
02000000:00000001:19.0:1773851859.850812:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850813:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007b0ad404.
02000000:00000001:19.0:1773851859.850814:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850814:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001187dc3e.
02000000:00000001:19.0:1773851859.850815:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850815:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000020f8e706.
02000000:00000001:19.0:1773851859.850816:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850816:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c5539866.
02000000:00000001:19.0:1773851859.850817:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850817:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c66a90dc.
02000000:00000001:19.0:1773851859.850818:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850819:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007b43659e.
02000000:00000001:19.0:1773851859.850819:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850820:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000060c5431c.
02000000:00000001:19.0:1773851859.850821:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850821:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ff803ba.
02000000:00000001:19.0:1773851859.850821:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850822:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fdf2070c.
02000000:00000001:19.0:1773851859.850823:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850823:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009e1dc61e.
02000000:00000001:19.0:1773851859.850824:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850824:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000028eda8b2.
02000000:00000001:19.0:1773851859.850825:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850826:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001bd9edf2.
02000000:00000001:19.0:1773851859.850826:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850827:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006b3e2ace.
02000000:00000001:19.0:1773851859.850828:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850828:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f76c3e7f.
02000000:00000001:19.0:1773851859.850829:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850829:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ff9fbb21.
02000000:00000001:19.0:1773851859.850830:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850830:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ee04f83c.
02000000:00000001:19.0:1773851859.850831:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850831:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b5d00d99.
02000000:00000001:19.0:1773851859.850832:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850832:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000df8151b.
02000000:00000001:19.0:1773851859.850833:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850833:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f0057291.
02000000:00000001:19.0:1773851859.850834:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850834:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004426de45.
02000000:00000001:19.0:1773851859.850835:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850835:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c9ac6fd.
02000000:00000001:19.0:1773851859.850836:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850837:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001095de82.
02000000:00000001:19.0:1773851859.850837:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850838:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e8cd0ee3.
02000000:00000001:19.0:1773851859.850839:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850839:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009a0a30b5.
02000000:00000001:19.0:1773851859.850840:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850840:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000093a608b7.
02000000:00000001:19.0:1773851859.850841:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850841:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000950762dd.
02000000:00000001:19.0:1773851859.850842:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850842:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003a7add4c.
02000000:00000001:19.0:1773851859.850843:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850843:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000142c3de1.
02000000:00000001:19.0:1773851859.850844:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850845:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b6048351.
02000000:00000001:19.0:1773851859.850845:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850846:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002d23fd49.
02000000:00000001:19.0:1773851859.850846:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850847:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c8255a9.
02000000:00000001:19.0:1773851859.850848:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850849:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000714d5208.
02000000:00000001:19.0:1773851859.850849:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850850:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fd6be4d5.
02000000:00000001:19.0:1773851859.850851:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850851:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000096b6068.
02000000:00000001:19.0:1773851859.850852:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850852:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bbdb4e61.
02000000:00000001:19.0:1773851859.850854:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850854:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fbbc184b.
02000000:00000001:19.0:1773851859.850855:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850855:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007ef9cc77.
02000000:00000001:19.0:1773851859.850856:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850857:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003e3128bf.
02000000:00000001:19.0:1773851859.850857:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850858:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dbcdff99.
02000000:00000001:19.0:1773851859.850859:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850859:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000f184558.
02000000:00000001:19.0:1773851859.850860:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850860:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006317cc41.
02000000:00000001:19.0:1773851859.850862:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850862:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000010829009.
02000000:00000001:19.0:1773851859.850863:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850863:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e38a1012.
02000000:00000001:19.0:1773851859.850864:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850864:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd7dffab.
02000000:00000001:19.0:1773851859.850865:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850865:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d9ebfb5.
02000000:00000001:19.0:1773851859.850867:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850867:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000579a7be1.
02000000:00000001:19.0:1773851859.850868:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850868:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000165a41dd.
02000000:00000001:19.0:1773851859.850869:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850869:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000072797f6c.
02000000:00000001:19.0:1773851859.850870:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850870:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000027a7097d.
02000000:00000001:19.0:1773851859.850872:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850872:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000004b56ec84.
02000000:00000001:19.0:1773851859.850873:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850874:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000f023a86.
02000000:00000001:19.0:1773851859.850875:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850875:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ebd10345.
02000000:00000001:19.0:1773851859.850876:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850877:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f7fe1462.
02000000:00000001:19.0:1773851859.850878:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850878:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000c8ce5d39.
02000000:00000001:19.0:1773851859.850879:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850879:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000918809b0.
02000000:00000001:19.0:1773851859.850880:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850880:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce1d3a62.
02000000:00000001:19.0:1773851859.850881:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850882:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000efedda36.
02000000:00000001:19.0:1773851859.850883:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850883:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ef3a5c5a.
02000000:00000001:19.0:1773851859.850884:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850884:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a2f1ed94.
02000000:00000001:19.0:1773851859.850885:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850886:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000afe7088e.
02000000:00000001:19.0:1773851859.850887:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850887:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d348d2c.
02000000:00000001:19.0:1773851859.850888:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850889:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce5976fa.
02000000:00000001:19.0:1773851859.850889:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850890:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000070b999d8.
02000000:00000001:19.0:1773851859.850891:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850891:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001070ec11.
02000000:00000001:19.0:1773851859.850892:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850892:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056f1af7a.
02000000:00000001:19.0:1773851859.850894:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850894:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000903a6a5f.
02000000:00000001:19.0:1773851859.850895:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850895:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d3063fa.
02000000:00000001:19.0:1773851859.850896:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850896:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a1700729.
02000000:00000001:19.0:1773851859.850897:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850897:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000df3bfc8d.
02000000:00000001:19.0:1773851859.850899:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850900:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6006ab5.
02000000:00000001:19.0:1773851859.850900:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850901:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dfeb9bfd.
02000000:00000001:19.0:1773851859.850902:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850902:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d3dd0c0.
02000000:00000001:19.0:1773851859.850903:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850903:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4a564a2.
02000000:00000001:19.0:1773851859.850904:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850905:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000050a3b672.
02000000:00000001:19.0:1773851859.850905:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850906:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ea7ac81.
02000000:00000001:19.0:1773851859.850907:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850907:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000048306117.
02000000:00000001:19.0:1773851859.850908:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850908:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001937abea.
02000000:00000001:19.0:1773851859.850909:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850910:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bfb7fb9e.
02000000:00000001:19.0:1773851859.850910:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850911:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009488938a.
02000000:00000001:19.0:1773851859.850912:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850912:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000ea21b4e0.
02000000:00000001:19.0:1773851859.850913:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850913:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007391cc99.
02000000:00000001:19.0:1773851859.850914:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850915:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008876431b.
02000000:00000001:19.0:1773851859.850916:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850916:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d16eaf3d.
02000000:00000001:19.0:1773851859.850917:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850917:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069380e4b.
02000000:00000001:19.0:1773851859.850918:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850918:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000003676c66.
02000000:00000001:19.0:1773851859.850919:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850919:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a3690ded.
02000000:00000001:19.0:1773851859.850920:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850920:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b847edc0.
02000000:00000001:19.0:1773851859.850921:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850922:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000061fcb28e.
02000000:00000001:19.0:1773851859.850922:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850923:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000014d73f8.
02000000:00000001:19.0:1773851859.850924:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850925:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003f13f5c7.
02000000:00000001:19.0:1773851859.850926:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850926:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079ebd8b3.
02000000:00000001:19.0:1773851859.850927:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850927:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b861abfa.
02000000:00000001:19.0:1773851859.850928:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850928:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086cf5214.
02000000:00000001:19.0:1773851859.850929:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850930:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000030842580.
02000000:00000001:19.0:1773851859.850930:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850931:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d3f01a9.
02000000:00000001:19.0:1773851859.850932:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850932:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bf088063.
02000000:00000001:19.0:1773851859.850933:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850933:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eb95e55c.
02000000:00000001:19.0:1773851859.850934:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850934:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000068e3d03f.
02000000:00000001:19.0:1773851859.850935:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850936:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000011dd21eb.
02000000:00000001:19.0:1773851859.850937:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850937:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005a37954d.
02000000:00000001:19.0:1773851859.850938:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850938:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006357fd5e.
02000000:00000001:19.0:1773851859.850939:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850940:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b9d75f5b.
02000000:00000001:19.0:1773851859.850940:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850941:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003287398f.
02000000:00000001:19.0:1773851859.850942:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850942:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002aa6d650.
02000000:00000001:19.0:1773851859.850943:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850943:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d52cb692.
02000000:00000001:19.0:1773851859.850944:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850945:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094a5bb0d.
02000000:00000001:19.0:1773851859.850945:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850946:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aade71c8.
02000000:00000001:19.0:1773851859.850946:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850947:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c8d945dd.
02000000:00000001:19.0:1773851859.850948:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850948:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005766c1d5.
02000000:00000001:19.0:1773851859.850949:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850949:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002d4463bd.
02000000:00000001:19.0:1773851859.850950:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850950:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ca2bb7b.
02000000:00000001:19.0:1773851859.850952:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850952:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dbc3f915.
02000000:00000001:19.0:1773851859.850953:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850953:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8602301.
02000000:00000001:19.0:1773851859.850954:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850954:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb78514b.
02000000:00000001:19.0:1773851859.850955:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850956:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e33d6275.
02000000:00000001:19.0:1773851859.850957:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850957:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a576d0f.
02000000:00000001:19.0:1773851859.850958:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850958:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004878e5d3.
02000000:00000001:19.0:1773851859.850959:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850959:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c7aea1de.
02000000:00000001:19.0:1773851859.850960:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850960:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004dd921d6.
02000000:00000001:19.0:1773851859.850961:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850961:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000977ecd11.
02000000:00000001:19.0:1773851859.850962:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850963:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fcc0831a.
02000000:00000001:19.0:1773851859.850963:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850964:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004c073a09.
02000000:00000001:19.0:1773851859.850964:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850965:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a51f295.
02000000:00000001:19.0:1773851859.850966:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850966:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c5eea433.
02000000:00000001:19.0:1773851859.850967:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850967:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000691a9424.
02000000:00000001:19.0:1773851859.850969:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850969:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bafc3493.
02000000:00000001:19.0:1773851859.850970:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850970:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e6971502.
02000000:00000001:19.0:1773851859.850971:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850972:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6235da1.
02000000:00000001:19.0:1773851859.850972:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850973:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004c1cbf64.
02000000:00000001:19.0:1773851859.850973:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850974:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000075370a24.
02000000:00000001:19.0:1773851859.850974:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850975:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ace9a970.
02000000:00000001:19.0:1773851859.850976:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850976:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dbb8fea7.
02000000:00000001:19.0:1773851859.850977:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850978:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006631208.
02000000:00000001:19.0:1773851859.850979:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850979:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005ea37f0b.
02000000:00000001:19.0:1773851859.850980:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850980:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001e321628.
02000000:00000001:19.0:1773851859.850981:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850981:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b7b9bb5d.
02000000:00000001:19.0:1773851859.850982:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850982:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006fb24a8a.
02000000:00000001:19.0:1773851859.850984:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850984:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000072a9f3da.
02000000:00000001:19.0:1773851859.850984:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850985:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000051ee02e8.
02000000:00000001:19.0:1773851859.850986:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850986:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000410e1dc7.
02000000:00000001:19.0:1773851859.850987:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850987:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bf327342.
02000000:00000001:19.0:1773851859.850988:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850989:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009315428b.
02000000:00000001:19.0:1773851859.850989:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850990:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003abfe6b4.
02000000:00000001:19.0:1773851859.850991:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850991:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005391cf1a.
02000000:00000001:19.0:1773851859.850992:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850992:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ba86cd7.
02000000:00000001:19.0:1773851859.850993:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850994:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e34f2e05.
02000000:00000001:19.0:1773851859.850995:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850996:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025019bf8.
02000000:00000001:19.0:1773851859.850997:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.850997:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009af7914d.
02000000:00000001:19.0:1773851859.850998:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.850998:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aca48d4f.
02000000:00000001:19.0:1773851859.850999:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851000:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ca2107b.
02000000:00000001:19.0:1773851859.851001:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851001:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036f32c51.
02000000:00000001:19.0:1773851859.851002:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851002:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000066242f24.
02000000:00000001:19.0:1773851859.851003:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851003:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cf80be40.
02000000:00000001:19.0:1773851859.851004:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851005:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b44a9549.
02000000:00000001:19.0:1773851859.851005:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851006:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a48056a.
02000000:00000001:19.0:1773851859.851007:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851007:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a129e65.
02000000:00000001:19.0:1773851859.851008:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851009:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003794b20d.
02000000:00000001:19.0:1773851859.851010:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851010:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007b037e4b.
02000000:00000001:19.0:1773851859.851011:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851011:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e66d097.
02000000:00000001:19.0:1773851859.851012:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851012:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008fd600c6.
02000000:00000001:19.0:1773851859.851013:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851013:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f10e1e7e.
02000000:00000001:19.0:1773851859.851014:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851014:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000042c48b8b.
02000000:00000001:19.0:1773851859.851015:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851016:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017ecc15c.
02000000:00000001:19.0:1773851859.851017:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851017:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000032176151.
02000000:00000001:19.0:1773851859.851018:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851019:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002468f698.
02000000:00000001:19.0:1773851859.851020:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851020:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000422e7c8a.
02000000:00000001:19.0:1773851859.851021:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851021:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036278325.
02000000:00000001:19.0:1773851859.851022:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851023:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000048e39ab1.
02000000:00000001:19.0:1773851859.851023:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851024:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000833926a5.
02000000:00000001:19.0:1773851859.851025:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851025:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e40c7f35.
02000000:00000001:19.0:1773851859.851026:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851026:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac144277.
02000000:00000001:19.0:1773851859.851027:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851027:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e3febd1e.
02000000:00000001:19.0:1773851859.851028:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851028:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a0e33d3.
02000000:00000001:19.0:1773851859.851029:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851029:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a0c799c.
02000000:00000001:19.0:1773851859.851030:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851030:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004fbe74fd.
02000000:00000001:19.0:1773851859.851031:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851032:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002235216f.
02000000:00000001:19.0:1773851859.851032:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851033:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa8dd4a5.
02000000:00000001:19.0:1773851859.851033:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851034:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000be08dfad.
02000000:00000001:19.0:1773851859.851034:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851035:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005d3592f4.
02000000:00000001:19.0:1773851859.851036:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851036:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000035eda42f.
02000000:00000001:19.0:1773851859.851037:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851037:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000715de835.
02000000:00000001:19.0:1773851859.851038:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851038:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001c56cd78.
02000000:00000001:19.0:1773851859.851039:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851039:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000211b859f.
02000000:00000001:19.0:1773851859.851040:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851041:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ba23324b.
02000000:00000001:19.0:1773851859.851042:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851042:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000010b27797.
02000000:00000001:19.0:1773851859.851043:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851043:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aa397ffb.
02000000:00000001:19.0:1773851859.851044:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851044:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000090435b0e.
02000000:00000001:19.0:1773851859.851046:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851046:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000350bb92.
02000000:00000001:19.0:1773851859.851047:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851048:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000677ef5a1.
02000000:00000001:19.0:1773851859.851049:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851049:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ecdecca0.
02000000:00000001:19.0:1773851859.851050:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851050:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c8d0d6b3.
02000000:00000001:19.0:1773851859.851051:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851052:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006370d0d8.
02000000:00000001:19.0:1773851859.851052:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851053:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004ee972de.
02000000:00000001:19.0:1773851859.851054:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851054:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008254aed0.
02000000:00000001:19.0:1773851859.851055:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851055:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a5b3163d.
02000000:00000001:19.0:1773851859.851056:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851056:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d2cac53b.
02000000:00000001:19.0:1773851859.851057:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851057:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000195d6ac2.
02000000:00000001:19.0:1773851859.851058:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851058:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000c5168fd.
02000000:00000001:19.0:1773851859.851059:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851059:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3705785.
02000000:00000001:19.0:1773851859.851061:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851061:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000876ba87d.
02000000:00000001:19.0:1773851859.851061:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851062:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006f8b5795.
02000000:00000001:19.0:1773851859.851063:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851063:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c48f7549.
02000000:00000001:19.0:1773851859.851064:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851065:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0d211c0.
02000000:00000001:19.0:1773851859.851065:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851066:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000555c299e.
02000000:00000001:19.0:1773851859.851066:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851067:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006838826.
02000000:00000001:19.0:1773851859.851067:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851068:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cb7021a4.
02000000:00000001:19.0:1773851859.851068:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851069:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005601d6f4.
02000000:00000001:19.0:1773851859.851069:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851070:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000042abef5d.
02000000:00000001:19.0:1773851859.851070:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851071:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fc3f9f09.
02000000:00000001:19.0:1773851859.851072:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851072:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000007c584d0.
02000000:00000001:19.0:1773851859.851073:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851073:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000021b7c1d9.
02000000:00000001:19.0:1773851859.851074:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851075:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000017355d15.
02000000:00000001:19.0:1773851859.851075:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851076:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006133841a.
02000000:00000001:19.0:1773851859.851077:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851078:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002758ca5a.
02000000:00000001:19.0:1773851859.851078:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851079:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db3b601f.
02000000:00000001:19.0:1773851859.851079:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851080:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000479a3cdc.
02000000:00000001:19.0:1773851859.851080:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851081:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008bfc2c28.
02000000:00000001:19.0:1773851859.851082:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851082:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000096efba11.
02000000:00000001:19.0:1773851859.851083:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851083:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce6f9852.
02000000:00000001:19.0:1773851859.851084:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851085:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000423bd6e4.
02000000:00000001:19.0:1773851859.851085:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851086:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000572d38c5.
02000000:00000001:19.0:1773851859.851087:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851088:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008b81c2cd.
02000000:00000001:19.0:1773851859.851088:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851089:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000867f7cd3.
02000000:00000001:19.0:1773851859.851090:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851090:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cc42264d.
02000000:00000001:19.0:1773851859.851091:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851091:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007840ff75.
02000000:00000001:19.0:1773851859.851092:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851093:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000a83083d0.
02000000:00000001:19.0:1773851859.851093:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851094:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cba47214.
02000000:00000001:19.0:1773851859.851095:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851095:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000e7d9c62b.
02000000:00000001:19.0:1773851859.851096:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851096:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000033027c30.
02000000:00000001:19.0:1773851859.851097:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851098:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000028a11141.
02000000:00000001:19.0:1773851859.851098:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851099:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3ff2f13.
02000000:00000001:19.0:1773851859.851100:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851100:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000005a7e815.
02000000:00000001:19.0:1773851859.851101:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851101:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005295f386.
02000000:00000001:19.0:1773851859.851102:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851103:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000410b9872.
02000000:00000001:19.0:1773851859.851103:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851104:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004372f111.
02000000:00000001:19.0:1773851859.851105:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851105:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004c72ef2e.
02000000:00000001:19.0:1773851859.851106:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851106:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002856329d.
02000000:00000001:19.0:1773851859.851107:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851107:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a579fac2.
02000000:00000001:19.0:1773851859.851108:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851109:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006870fb4d.
02000000:00000001:19.0:1773851859.851110:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851111:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ae071613.
02000000:00000001:19.0:1773851859.851111:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851112:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ef375c3.
02000000:00000001:19.0:1773851859.851113:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851114:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000098a68ffe.
02000000:00000001:19.0:1773851859.851114:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851115:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004ff44cfe.
02000000:00000001:19.0:1773851859.851116:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851117:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d1c7b689.
02000000:00000001:19.0:1773851859.851117:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851118:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000069b19d63.
02000000:00000001:19.0:1773851859.851119:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851119:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000da219f7e.
02000000:00000001:19.0:1773851859.851119:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851120:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061c645f0.
02000000:00000001:19.0:1773851859.851121:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851121:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000138973f5.
02000000:00000001:19.0:1773851859.851122:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851122:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004669f465.
02000000:00000001:19.0:1773851859.851123:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851123:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001039e798.
02000000:00000001:19.0:1773851859.851124:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851124:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cbbc47b.
02000000:00000001:19.0:1773851859.851126:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851126:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000931d9f7f.
02000000:00000001:19.0:1773851859.851126:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851127:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dc86e330.
02000000:00000001:19.0:1773851859.851128:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851128:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000045582e4b.
02000000:00000001:19.0:1773851859.851129:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851129:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b661bea0.
02000000:00000001:19.0:1773851859.851130:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851130:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000912bd7c0.
02000000:00000001:19.0:1773851859.851131:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851131:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000842cc52c.
02000000:00000001:19.0:1773851859.851132:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851133:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fed882bd.
02000000:00000001:19.0:1773851859.851133:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851134:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f6ebb50.
02000000:00000001:19.0:1773851859.851135:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851137:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000063f964f3.
02000000:00000001:19.0:1773851859.851137:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851138:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8c4d0c1.
02000000:00000001:19.0:1773851859.851138:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851139:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000683d910e.
02000000:00000001:19.0:1773851859.851139:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851140:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000057a2b145.
02000000:00000001:19.0:1773851859.851141:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851141:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000bbc0dda.
02000000:00000001:19.0:1773851859.851142:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851142:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005f9bae9b.
02000000:00000001:19.0:1773851859.851143:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851144:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e71e24f.
02000000:00000001:19.0:1773851859.851144:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851145:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009edd93dd.
02000000:00000001:19.0:1773851859.851146:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851146:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e52918f4.
02000000:00000001:19.0:1773851859.851147:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851148:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002788a5ce.
02000000:00000001:19.0:1773851859.851149:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851149:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000083044dd2.
02000000:00000001:19.0:1773851859.851150:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851150:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f9f4e6c.
02000000:00000001:19.0:1773851859.851151:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851152:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000090deb576.
02000000:00000001:19.0:1773851859.851152:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851153:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e2962f2c.
02000000:00000001:19.0:1773851859.851154:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851154:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d82d72cc.
02000000:00000001:19.0:1773851859.851155:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851155:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000698d96da.
02000000:00000001:19.0:1773851859.851156:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851156:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006d28212f.
02000000:00000001:19.0:1773851859.851157:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851157:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a440761.
02000000:00000001:19.0:1773851859.851158:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851159:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000091b5f500.
02000000:00000001:19.0:1773851859.851159:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851160:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000511b528f.
02000000:00000001:19.0:1773851859.851161:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851161:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cee7daa6.
02000000:00000001:19.0:1773851859.851162:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851162:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001fa637d3.
02000000:00000001:19.0:1773851859.851163:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851164:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000061ed5915.
02000000:00000001:19.0:1773851859.851164:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851165:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006a98158a.
02000000:00000001:19.0:1773851859.851166:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851166:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000087ad5a7e.
02000000:00000001:19.0:1773851859.851167:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851167:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d277c469.
02000000:00000001:19.0:1773851859.851168:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851168:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c4cd7857.
02000000:00000001:19.0:1773851859.851169:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851169:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000656674d2.
02000000:00000001:19.0:1773851859.851170:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851171:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b5921cbf.
02000000:00000001:19.0:1773851859.851171:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851172:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000968f328c.
02000000:00000001:19.0:1773851859.851173:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851173:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d5b72492.
02000000:00000001:19.0:1773851859.851174:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851174:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003261b071.
02000000:00000001:19.0:1773851859.851175:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851175:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000de16049d.
02000000:00000001:19.0:1773851859.851176:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851176:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000022e1103c.
02000000:00000001:19.0:1773851859.851177:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851177:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004210c38c.
02000000:00000001:19.0:1773851859.851178:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851179:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ab8250d3.
02000000:00000001:19.0:1773851859.851179:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851180:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003fa2fcad.
02000000:00000001:19.0:1773851859.851180:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851181:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008121a610.
02000000:00000001:19.0:1773851859.851182:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851183:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069d06ef3.
02000000:00000001:19.0:1773851859.851184:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851184:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009002bec.
02000000:00000001:19.0:1773851859.851185:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851185:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002fd33bff.
02000000:00000001:19.0:1773851859.851186:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851186:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d81f2c2f.
02000000:00000001:19.0:1773851859.851187:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851188:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000058697712.
02000000:00000001:19.0:1773851859.851188:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851189:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb9196ac.
02000000:00000001:19.0:1773851859.851190:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851190:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000851afca4.
02000000:00000001:19.0:1773851859.851191:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851191:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0304258.
02000000:00000001:19.0:1773851859.851192:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851192:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a941af2.
02000000:00000001:19.0:1773851859.851193:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851193:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000065092da7.
02000000:00000001:19.0:1773851859.851194:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851194:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000000c06fe9d.
02000000:00000001:19.0:1773851859.851195:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851195:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000953abe9d.
02000000:00000001:19.0:1773851859.851196:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851197:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000988ea016.
02000000:00000001:19.0:1773851859.851197:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851198:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000232b8977.
02000000:00000001:19.0:1773851859.851198:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851199:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000153da826.
02000000:00000001:19.0:1773851859.851199:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851200:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c66d318a.
02000000:00000001:19.0:1773851859.851201:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851201:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ebc3a854.
02000000:00000001:19.0:1773851859.851202:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851202:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000016034629.
02000000:00000001:19.0:1773851859.851203:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851204:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce9b606e.
02000000:00000001:19.0:1773851859.851204:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851205:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d72bffb1.
02000000:00000001:19.0:1773851859.851206:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851206:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004d7f4946.
02000000:00000001:19.0:1773851859.851207:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851207:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000089acaf6f.
02000000:00000001:19.0:1773851859.851208:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851209:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c4a723e1.
02000000:00000001:19.0:1773851859.851210:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851210:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bb7ef7c5.
02000000:00000001:19.0:1773851859.851211:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851211:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a720790b.
02000000:00000001:19.0:1773851859.851212:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851212:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8127821.
02000000:00000001:19.0:1773851859.851214:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851214:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ae1220d6.
02000000:00000001:19.0:1773851859.851215:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851215:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000918ac0e2.
02000000:00000001:19.0:1773851859.851216:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851216:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001c320f82.
02000000:00000001:19.0:1773851859.851217:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851218:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a4a680f.
02000000:00000001:19.0:1773851859.851219:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851219:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007dc8c3d0.
02000000:00000001:19.0:1773851859.851220:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851220:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001953a58e.
02000000:00000001:19.0:1773851859.851221:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851222:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c3291c9e.
02000000:00000001:19.0:1773851859.851222:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851223:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cab68373.
02000000:00000001:19.0:1773851859.851224:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851224:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005f4539f8.
02000000:00000001:19.0:1773851859.851225:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851225:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a344a603.
02000000:00000001:19.0:1773851859.851226:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851227:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 0000000022bfb1a7.
02000000:00000001:19.0:1773851859.851228:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851228:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000034e4ba3d.
02000000:00000001:19.0:1773851859.851229:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851239:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000071f4f187.
02000000:00000001:19.0:1773851859.851239:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851240:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000198483e1.
02000000:00000001:19.0:1773851859.851241:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851241:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000de3bd4a.
02000000:00000001:19.0:1773851859.851242:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851242:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061b1531f.
02000000:00000001:19.0:1773851859.851243:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851243:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000694b8ce3.
02000000:00000001:19.0:1773851859.851244:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851244:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c27a8e8e.
02000000:00000001:19.0:1773851859.851245:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851246:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b6ffa169.
02000000:00000001:19.0:1773851859.851247:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851247:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f9fc15c.
02000000:00000001:19.0:1773851859.851248:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851248:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000058fb38b9.
02000000:00000001:19.0:1773851859.851249:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851249:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000799c3eb8.
02000000:00000001:19.0:1773851859.851250:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851251:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008032e7ed.
02000000:00000001:19.0:1773851859.851252:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851252:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000480b0a12.
02000000:00000001:19.0:1773851859.851253:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851253:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000236ba6b6.
02000000:00000001:19.0:1773851859.851254:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851254:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000053645775.
02000000:00000001:19.0:1773851859.851255:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851256:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b4a14e1.
02000000:00000001:19.0:1773851859.851256:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851257:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056ce222a.
02000000:00000001:19.0:1773851859.851258:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851258:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d0378b95.
02000000:00000001:19.0:1773851859.851259:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851259:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008db30391.
02000000:00000001:19.0:1773851859.851260:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851261:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a98b1ae7.
02000000:00000001:19.0:1773851859.851261:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851262:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e1a021a6.
02000000:00000001:19.0:1773851859.851263:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851263:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c3dad96.
02000000:00000001:19.0:1773851859.851264:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851264:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce1f43ac.
02000000:00000001:19.0:1773851859.851265:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851266:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007b1e7f17.
02000000:00000001:19.0:1773851859.851267:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851267:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d38ed2d.
02000000:00000001:19.0:1773851859.851268:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851269:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006db90851.
02000000:00000001:19.0:1773851859.851269:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851270:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000093414630.
02000000:00000001:19.0:1773851859.851271:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851271:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000506a754c.
02000000:00000001:19.0:1773851859.851271:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851272:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001567e80d.
02000000:00000001:19.0:1773851859.851273:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851273:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cdf62e48.
02000000:00000001:19.0:1773851859.851274:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851275:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dcd9286d.
02000000:00000001:19.0:1773851859.851276:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851276:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eff06efc.
02000000:00000001:19.0:1773851859.851276:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851277:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005d5c8bc4.
02000000:00000001:19.0:1773851859.851277:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851278:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009ef8520c.
02000000:00000001:19.0:1773851859.851278:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851279:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000052f38db3.
02000000:00000001:19.0:1773851859.851280:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851280:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fff11997.
02000000:00000001:19.0:1773851859.851281:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851281:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000030cd578a.
02000000:00000001:19.0:1773851859.851283:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851283:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009fdc6850.
02000000:00000001:19.0:1773851859.851284:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851284:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae922ff1.
02000000:00000001:19.0:1773851859.851285:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851285:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000007ccf597.
02000000:00000001:19.0:1773851859.851286:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851286:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ab0ccb2.
02000000:00000001:19.0:1773851859.851287:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851288:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004216a994.
02000000:00000001:19.0:1773851859.851288:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851289:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f0f5fbbf.
02000000:00000001:19.0:1773851859.851290:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851290:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad85573f.
02000000:00000001:19.0:1773851859.851291:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851291:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8381a57.
02000000:00000001:19.0:1773851859.851292:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851292:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bf226ffb.
02000000:00000001:19.0:1773851859.851293:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851293:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aef58415.
02000000:00000001:19.0:1773851859.851294:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851295:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e125b33.
02000000:00000001:19.0:1773851859.851295:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851296:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006f37bda4.
02000000:00000001:19.0:1773851859.851297:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851297:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000046684bfb.
02000000:00000001:19.0:1773851859.851298:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851298:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae84b5d1.
02000000:00000001:19.0:1773851859.851299:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851299:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000375fcfcf.
02000000:00000001:19.0:1773851859.851300:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851300:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c4573e1b.
02000000:00000001:19.0:1773851859.851301:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851302:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ab0bb4a2.
02000000:00000001:19.0:1773851859.851302:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851303:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ee97d023.
02000000:00000001:19.0:1773851859.851304:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851304:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000a020815.
02000000:00000001:19.0:1773851859.851305:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851305:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000106324c9.
02000000:00000001:19.0:1773851859.851306:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851307:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dc0a2037.
02000000:00000001:19.0:1773851859.851307:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851308:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000040618c88.
02000000:00000001:19.0:1773851859.851309:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851310:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000073dc67f.
02000000:00000001:19.0:1773851859.851310:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851311:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000bb337ae.
02000000:00000001:19.0:1773851859.851312:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851312:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000066e351f1.
02000000:00000001:19.0:1773851859.851313:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851313:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b7b6badf.
02000000:00000001:19.0:1773851859.851314:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851315:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000fd72fa0c.
02000000:00000001:19.0:1773851859.851316:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851316:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025a96101.
02000000:00000001:19.0:1773851859.851317:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851317:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000615f4bca.
02000000:00000001:19.0:1773851859.851318:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851319:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ecded8b8.
02000000:00000001:19.0:1773851859.851320:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851320:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d3dabd9e.
02000000:00000001:19.0:1773851859.851321:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851321:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c3813960.
02000000:00000001:19.0:1773851859.851322:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851322:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000015904ce4.
02000000:00000001:19.0:1773851859.851323:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851323:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000264ea850.
02000000:00000001:19.0:1773851859.851324:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851325:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005002942e.
02000000:00000001:19.0:1773851859.851325:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851325:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003be6ca9a.
02000000:00000001:19.0:1773851859.851326:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851327:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a5366a5c.
02000000:00000001:19.0:1773851859.851327:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851328:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000081a4eae8.
02000000:00000001:19.0:1773851859.851329:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851330:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000025d394b6.
02000000:00000001:19.0:1773851859.851330:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851331:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000074be16db.
02000000:00000001:19.0:1773851859.851331:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851332:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009a33a19b.
02000000:00000001:19.0:1773851859.851333:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851333:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dc793554.
02000000:00000001:19.0:1773851859.851334:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851335:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005917e8ac.
02000000:00000001:19.0:1773851859.851335:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851336:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001da19cc5.
02000000:00000001:19.0:1773851859.851337:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851337:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007f0149ce.
02000000:00000001:19.0:1773851859.851338:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851338:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094833454.
02000000:00000001:19.0:1773851859.851339:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851339:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000018fcbeec.
02000000:00000001:19.0:1773851859.851340:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851340:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006f237ded.
02000000:00000001:19.0:1773851859.851341:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851342:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aa262126.
02000000:00000001:19.0:1773851859.851343:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851343:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f7bfcdd7.
02000000:00000001:19.0:1773851859.851344:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851344:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bc1f2ee7.
02000000:00000001:19.0:1773851859.851345:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851345:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000052f76f92.
02000000:00000001:19.0:1773851859.851346:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851347:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c89d95d6.
02000000:00000001:19.0:1773851859.851347:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851348:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f6cce105.
02000000:00000001:19.0:1773851859.851348:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851349:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fecf7d57.
02000000:00000001:19.0:1773851859.851349:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851350:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000071c93eb7.
02000000:00000001:19.0:1773851859.851351:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851351:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001bcef837.
02000000:00000001:19.0:1773851859.851352:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851352:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000005b3ddb6.
02000000:00000001:19.0:1773851859.851353:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851353:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ab3b5ac7.
02000000:00000001:19.0:1773851859.851354:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851355:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009313a4e8.
02000000:00000001:19.0:1773851859.851356:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851356:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000701e1342.
02000000:00000001:19.0:1773851859.851357:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851357:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000af21ea94.
02000000:00000001:19.0:1773851859.851359:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851359:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000077a7528f.
02000000:00000001:19.0:1773851859.851360:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851360:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d9dbaccb.
02000000:00000001:19.0:1773851859.851361:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851361:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000029070779.
02000000:00000001:19.0:1773851859.851362:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851363:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002fb2f7c0.
02000000:00000001:19.0:1773851859.851364:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851364:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e40a468b.
02000000:00000001:19.0:1773851859.851365:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851365:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc4d811f.
02000000:00000001:19.0:1773851859.851366:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851367:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d6c14788.
02000000:00000001:19.0:1773851859.851367:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851368:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000087798157.
02000000:00000001:19.0:1773851859.851369:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851369:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d6ca73ea.
02000000:00000001:19.0:1773851859.851370:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851370:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000089703d5e.
02000000:00000001:19.0:1773851859.851371:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851371:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000075f5cba9.
02000000:00000001:19.0:1773851859.851372:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851372:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec1b16b5.
02000000:00000001:19.0:1773851859.851373:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851374:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000faeca3c9.
02000000:00000001:19.0:1773851859.851374:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851375:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d78dc504.
02000000:00000001:19.0:1773851859.851376:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851376:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f9d38618.
02000000:00000001:19.0:1773851859.851377:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851378:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000045b7686f.
02000000:00000001:19.0:1773851859.851378:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851379:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000091e97528.
02000000:00000001:19.0:1773851859.851380:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851380:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c145bd26.
02000000:00000001:19.0:1773851859.851381:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851382:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000ce4b2d14.
02000000:00000001:19.0:1773851859.851382:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851383:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cca1288a.
02000000:00000001:19.0:1773851859.851384:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851384:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d953ebfb.
02000000:00000001:19.0:1773851859.851385:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851385:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bfc86ec8.
02000000:00000001:19.0:1773851859.851386:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851387:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000085564c64.
02000000:00000001:19.0:1773851859.851387:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851388:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b58be942.
02000000:00000001:19.0:1773851859.851389:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851389:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cc2a937c.
02000000:00000001:19.0:1773851859.851390:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851390:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000013d98cb9.
00000100:00000010:19.0:1773851859.851391:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004a94ef97.
02000000:00000001:19.0:1773851859.851392:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851393:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009e479250.
02000000:00000001:19.0:1773851859.851393:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851393:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098bd43d4.
02000000:00000001:19.0:1773851859.851394:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851395:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000015c1c0b8.
02000000:00000001:19.0:1773851859.851396:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851396:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c3e83d5f.
02000000:00000001:19.0:1773851859.851397:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851398:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000184faeb0.
02000000:00000001:19.0:1773851859.851398:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851399:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007040390e.
02000000:00000001:19.0:1773851859.851400:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851400:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000097513d98.
02000000:00000001:19.0:1773851859.851400:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851401:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000263d21d9.
02000000:00000001:19.0:1773851859.851402:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851402:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002deb9768.
02000000:00000001:19.0:1773851859.851403:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851404:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000caaf8611.
02000000:00000001:19.0:1773851859.851405:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851405:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a9fd828d.
02000000:00000001:19.0:1773851859.851406:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851406:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000033620ed4.
02000000:00000001:19.0:1773851859.851407:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851407:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003ca46287.
02000000:00000001:19.0:1773851859.851408:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851408:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a257c21c.
02000000:00000001:19.0:1773851859.851409:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851410:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dfa72aea.
02000000:00000001:19.0:1773851859.851410:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851411:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6324a13.
02000000:00000001:19.0:1773851859.851411:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851412:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ffb57dfb.
02000000:00000001:19.0:1773851859.851413:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851413:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001d874d2f.
02000000:00000001:19.0:1773851859.851414:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851414:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000f181e04d.
02000000:00000001:19.0:1773851859.851415:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851415:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004a7a4e7b.
02000000:00000001:19.0:1773851859.851416:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851417:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000a802ac91.
02000000:00000001:19.0:1773851859.851417:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851418:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000001d918fd.
02000000:00000001:19.0:1773851859.851419:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851419:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cfbec9f2.
02000000:00000001:19.0:1773851859.851420:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851420:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005cf4387d.
02000000:00000001:19.0:1773851859.851421:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851421:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ebba3dae.
02000000:00000001:19.0:1773851859.851422:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851422:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000016c92438.
02000000:00000001:19.0:1773851859.851423:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851423:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d1e0cc0d.
02000000:00000001:19.0:1773851859.851424:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851424:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000188b038f.
02000000:00000001:19.0:1773851859.851426:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851426:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000efc4870.
02000000:00000001:19.0:1773851859.851426:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851427:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000058bcdbf3.
02000000:00000001:19.0:1773851859.851428:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851428:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006da15f38.
02000000:00000001:19.0:1773851859.851428:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851429:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000074ebb67d.
02000000:00000001:19.0:1773851859.851430:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851430:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000034cade1d.
02000000:00000001:19.0:1773851859.851431:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851432:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007891e4da.
02000000:00000001:19.0:1773851859.851432:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851433:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000007a08ef3.
02000000:00000001:19.0:1773851859.851434:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851434:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc7e7ad4.
02000000:00000001:19.0:1773851859.851435:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851435:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006112784e.
02000000:00000001:19.0:1773851859.851436:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851436:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000502d9b01.
02000000:00000001:19.0:1773851859.851437:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851437:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000654ab517.
02000000:00000001:19.0:1773851859.851438:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851438:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f5c2aeae.
02000000:00000001:19.0:1773851859.851440:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851440:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b4c8993a.
02000000:00000001:19.0:1773851859.851441:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851442:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce4f531a.
02000000:00000001:19.0:1773851859.851442:0:60961:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:19.0:1773851859.851443:0:60961:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b03fc89e.
02000000:00000001:19.0:1773851859.851443:0:60961:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:19.0:1773851859.851444:0:60961:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce8bc3d5.
00000100:00000001:19.0:1773851859.851445:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:19.0:1773851859.851446:0:60961:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt: registering portal 12
00000400:00000010:19.0:1773851859.851448:0:60961:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f9209159.
00000400:00000010:19.0:1773851859.851449:0:60961:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 1144 at 00000000e3894f4e (tot 253200771).
00000800:00000200:13.0:1773851859.866282:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851859.866283:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.866283:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851859.866284:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851859.866285:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851859.866286:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.866288:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15409@kfi7(00000000d0c33ca9):0x11eb version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851859.866290:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851859.866290:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb Using peer 15409@kfi7(0x11eb)
00000400:00000200:13.0:1773851859.866292:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15409@kfi7 to cpt 3
00000400:00000200:14.0:1773851859.866293:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15409@kfi7 to cpt 3
00000800:00000200:13.0:1773851859.866294:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 38 bytes to peer 0x11eb: rc=0
00000400:00000200:14.0:1773851859.866295:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15409@kfi7 : PUT - for me
00000800:00000200:13.0:1773851859.866296:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851859.866297:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15409@kfi7 to cpt 3
00000400:00000200:14.0:1773851859.866298:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a25d356 nid 15409@kfi7 refs 1
00000400:00000200:14.0:1773851859.866300:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15409@kfi7 to cpt 3
00000400:00000200:14.0:1773851859.866301:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a25d356 nid 15409@kfi7 refs 2
00000400:00000200:14.0:1773851859.866302:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a25d356 nid 15409@kfi7 refs 3
00000400:00000200:14.0:1773851859.866304:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15600@kfi7 to cpt 3
00000400:00000200:14.0:1773851859.866306:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15600@kfi7 of length 224 into portal 12 MB=0x699eba0d049c0
00000400:00000200:14.0:1773851859.866308:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15600@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 20616
00000800:00000200:13.0:1773851859.866309:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb TN_EVENT_TX_OK event status 0
00000800:00000200:14.0:1773851859.866311:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.866311:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb Transaction freed
00000400:00000200:14.0:1773851859.866314:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851859.866316:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15409@kfi7: PUT: OK
00000100:00000001:14.0:1773851859.866317:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851859.866318:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851859.866319:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dea0264e.
00000100:00000040:14.0:1773851859.866321:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000dea0264e x1858087154633152 msgsize 224
00000100:00100000:14.0:1773851859.866324:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-15600@kfi7 (source: 12345-15409@kfi7)
00000100:00000001:14.0:1773851859.866325:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851859.866327:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a25d356 nid 15409@kfi7 refs 2
00000100:00000001:15.0:1773851859.866328:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851859.866329:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851859.866329:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:14.0:1773851859.866329:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851859.866330:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851859.866332:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851859.866333:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858087154633152
00000020:00000001:15.0:1773851859.866334:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851859.866334:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ecb
00000020:00000001:15.0:1773851859.866335:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851859.866339:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c6a938a9 refcount=170
00000020:00000001:15.0:1773851859.866341:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628990976 : -107123080560640 : ffff9e9276d60000)
00000020:00000001:15.0:1773851859.866342:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628990976 : -107123080560640 : ffff9e9276d60000)
00000100:00000001:15.0:1773851859.866344:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851859.866345:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851859.866346:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9af698f.
00000020:00000010:15.0:1773851859.866347:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851859.866349:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851859.866350:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851859.866351:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851859.866352:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.866353:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851859.866354:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851859.866355:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851859.866356:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851859.866358:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851859.866358:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851859.866358:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851859.866359:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851859.866359:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15600@kfi7, seq: 2289798
00000100:00000001:15.0:1773851859.866360:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851859.866360:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c6a938a9 : new rpc_count 1
00000100:00000001:15.0:1773851859.866361:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.866361:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341819904 : -106946367731712 : ffff9ebb9bbdc800)
00000100:00000040:13.0:1773851859.866362:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dea0264e x1858087154633152/t0(0) o400->3b6ddb7f-ba7c-4fdc-8cab-d607c460281a@15600@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1453-0'
00000100:00000001:13.0:1773851859.866365:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851859.866365:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851859.866366:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dea0264e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3b6ddb7f-ba7c-4fdc-8cab-d607c460281a+170:39692:x1858087154633152:12345-15600@kfi7:400:default-tuolumne1453-0
00000100:00000200:13.0:1773851859.866368:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858087154633152
00000020:00000001:13.0:1773851859.866368:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851859.866369:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851859.866370:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.866370:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851859.866371:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851859.866372:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851859.866372:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858087154633152, found 0 last_xid 1858087154209279
00000020:00000001:13.0:1773851859.866374:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851859.866374:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851859.866375:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851859.866376:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.866376:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851859.866377:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851859.866377:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851859.866379:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a79b6cda.
02000000:00000001:13.0:1773851859.866380:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.866380:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.866381:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851859.866381:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062569, transno 0, xid 1858087154633152
00010000:00000001:13.0:1773851859.866382:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851859.866383:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dea0264e x1858087154633152/t0(0) o400->3b6ddb7f-ba7c-4fdc-8cab-d607c460281a@15600@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1453-0'
00010000:00000001:13.0:1773851859.866385:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851859.866386:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851859.866387:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=92 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851859.866388:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851859.866388:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d480f6c2 refcount 3 to 15600@kfi7
00000100:00000001:13.0:1773851859.866389:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620928 : -107151221930688 : ffff9e8be97ac540)
02000000:00000001:13.0:1773851859.866390:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851859.866391:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.866391:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851859.866392:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15409@kfi7
00000400:00000010:13.0:1773851859.866393:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000beb6bb34.
00000100:00000200:13.0:1773851859.866393:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858087154633152, offset 224
00000400:00000200:13.0:1773851859.866395:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15409@kfi7
00000400:00000200:13.0:1773851859.866396:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15409@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.866396:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a25d356 nid 15409@kfi7 refs 1
00000400:00000200:13.0:1773851859.866397:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a25d356 nid 15409@kfi7 refs 2
00000400:00000200:13.0:1773851859.866399:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a25d356 nid 15409@kfi7 refs 3
00000400:00000200:13.0:1773851859.866400:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15409@kfi7 local destination
00000400:00000200:13.0:1773851859.866401:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768870:8768870:1024:4294967295] 15409@kfi7 LPNI seq info [8858732:8858732:16:4294967295]
00000400:00000200:13.0:1773851859.866403:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a25d356 nid 15409@kfi7 refs 2
00000400:00000200:13.0:1773851859.866403:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15409@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.866405:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15409@kfi7(15409@kfi7:15409@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851859.866407:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a25d356 nid 15409@kfi7 refs 3
00000800:00000200:13.0:1773851859.866408:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.866409:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851859.866411:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851859.866413:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb Using peer 15409@kfi7(0x11eb)
00000800:00000200:13.0:1773851859.866415:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 324 bytes to peer 0x11eb: rc=0
00000800:00000200:13.0:1773851859.866416:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851859.866418:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851859.866419:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d480f6c2 refcount 2 to 15600@kfi7
00010000:00000001:13.0:1773851859.866420:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851859.866420:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.866421:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851859.866421:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dea0264e x1858087154633152/t0(0) o400->3b6ddb7f-ba7c-4fdc-8cab-d607c460281a@15600@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1453-0'
00000100:00100000:13.0:1773851859.866424:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dea0264e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3b6ddb7f-ba7c-4fdc-8cab-d607c460281a+170:39692:x1858087154633152:12345-15600@kfi7:400:default-tuolumne1453-0 Request processed in 58us (102us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851859.866426:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15600@kfi7, seq: 2289798
00000100:00000040:13.0:1773851859.866427:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c6a938a9 : new rpc_count 0
00000100:00000001:13.0:1773851859.866428:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851859.866428:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851859.866429:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:13.0:1773851859.866430:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000020:00000010:13.0:1773851859.866431:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9af698f.
00000020:00000040:13.0:1773851859.866431:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c6a938a9 : new refcount 169
00000800:00000200:14.0:1773851859.866432:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851859.866432:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851859.866434:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851859.866436:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15409@kfi7: PUT: OK
00000400:00000200:14.0:1773851859.866437:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000beb6bb34
00000400:00000010:14.0:1773851859.866438:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000beb6bb34.
00000100:00000001:14.0:1773851859.866439:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851859.866440:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851859.866441:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a25d356 nid 15409@kfi7 refs 2
00000800:00000200:14.0:1773851859.866444:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 15409@kfi7(00000000d0c33ca9):0x0 lsk 4588 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11eb Transaction freed
00000800:00000200:21.0:1773851859.879056:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851859.879057:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851859.879058:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851859.879060:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851859.879064:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22049@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.879065:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22049@kfi7 : PUT - for me
00000400:00000200:21.0:1773851859.879066:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22049@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.879066:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c800daf0 nid 22049@kfi7 refs 1
00000400:00000200:21.0:1773851859.879068:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22049@kfi7 to cpt 5
00000400:00000200:21.0:1773851859.879069:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c800daf0 nid 22049@kfi7 refs 2
00000400:00000200:21.0:1773851859.879069:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c800daf0 nid 22049@kfi7 refs 3
00000400:00000200:21.0:1773851859.879070:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22241@kfi7 to cpt 0
00000400:00000200:21.0:1773851859.879071:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22241@kfi7 of length 224 into portal 12 MB=0x69b4b6113d5c0
00000400:00000200:21.0:1773851859.879072:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22241@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 29448
00000800:00000200:21.0:1773851859.879074:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851859.879076:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851859.879077:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22049@kfi7: PUT: OK
00000100:00000001:21.0:1773851859.879078:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851859.879078:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851859.879079:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce6f9852.
00000100:00000040:21.0:1773851859.879080:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ce6f9852 x1859597913806272 msgsize 224
00000100:00100000:21.0:1773851859.879081:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-22241@kfi7 (source: 12345-22049@kfi7)
00000100:00000001:21.0:1773851859.879082:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851859.879083:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c800daf0 nid 22049@kfi7 refs 2
00000100:00000001:23.0:1773851859.879084:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851859.879085:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851859.879085:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851859.879085:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851859.879086:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851859.879086:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851859.879087:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597913806272
00000020:00000001:23.0:1773851859.879088:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851859.879088:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2431bb7e
00000020:00000001:23.0:1773851859.879089:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851859.879091:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b0242d3 refcount=71
00000020:00000001:23.0:1773851859.879092:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637065660675072 : -107008048876544 : ffff9ead3f423400)
00000020:00000001:23.0:1773851859.879093:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637065660675072 : -107008048876544 : ffff9ead3f423400)
00000100:00000001:23.0:1773851859.879094:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.879095:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851859.879095:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000396642d.
00000020:00000010:23.0:1773851859.879096:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.879097:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851859.879098:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851859.879098:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851859.879099:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.879100:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851859.879101:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851859.879102:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.879102:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851859.879104:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851859.879104:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851859.879104:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851859.879105:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22241@kfi7, seq: 1997947
00000100:00000001:22.0:1773851859.879105:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851859.879106:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b0242d3 : new rpc_count 4
00000100:00000001:22.0:1773851859.879106:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.879107:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637148525842688 : -106925183708928 : ffff9ec08a685100)
00000100:00000001:22.0:1773851859.879107:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.879108:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ce6f9852 x1859597913806272/t0(0) o400->14b4eaeb-c743-40a6-933a-619c988afe22@22241@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1871-0'
00000100:00000001:23.0:1773851859.879110:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851859.879111:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851859.879112:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce6f9852 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:14b4eaeb-c743-40a6-933a-619c988afe22+71:39703:x1859597913806272:12345-22241@kfi7:400:default-tuolumne1871-0
00000100:00000200:23.0:1773851859.879113:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597913806272
00000020:00000001:23.0:1773851859.879114:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851859.879114:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851859.879115:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.879116:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851859.879116:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851859.879117:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851859.879117:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597913806272, found 0 last_xid 1859597913236159
00000020:00000001:23.0:1773851859.879118:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851859.879119:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851859.879119:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851859.879120:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.879120:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851859.879121:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851859.879121:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851859.879122:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007f5732ba.
02000000:00000001:23.0:1773851859.879123:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.879124:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.879124:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851859.879125:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590766, transno 0, xid 1859597913806272
00010000:00000001:23.0:1773851859.879126:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851859.879127:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ce6f9852 x1859597913806272/t0(0) o400->14b4eaeb-c743-40a6-933a-619c988afe22@22241@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1871-0'
00010000:00000001:23.0:1773851859.879129:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851859.879130:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851859.879130:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=92 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851859.879131:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851859.879132:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004e926e56 refcount 3 to 22241@kfi7
00000100:00000001:23.0:1773851859.879133:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049088 : -107154804502528 : ffff9e8b13f11000)
02000000:00000001:23.0:1773851859.879134:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851859.879134:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851859.879135:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851859.879136:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22049@kfi7
00000400:00000010:23.0:1773851859.879137:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4d95905.
00000100:00000200:23.0:1773851859.879137:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597913806272, offset 224
00000400:00000200:23.0:1773851859.879139:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22049@kfi7
00000400:00000200:23.0:1773851859.879139:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22049@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.879140:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c800daf0 nid 22049@kfi7 refs 1
00000400:00000200:23.0:1773851859.879141:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c800daf0 nid 22049@kfi7 refs 2
00000400:00000200:23.0:1773851859.879142:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c800daf0 nid 22049@kfi7 refs 3
00000400:00000200:23.0:1773851859.879143:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22049@kfi7 local destination
00000400:00000200:23.0:1773851859.879144:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768871:8768871:1024:4294967295] 22049@kfi7 LPNI seq info [780188:780188:16:4294967295]
00000400:00000200:23.0:1773851859.879146:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c800daf0 nid 22049@kfi7 refs 2
00000400:00000200:23.0:1773851859.879146:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22049@kfi7 to cpt 5
00000400:00000200:23.0:1773851859.879149:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22049@kfi7(22049@kfi7:22049@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851859.879150:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c800daf0 nid 22049@kfi7 refs 3
00000800:00000200:23.0:1773851859.879151:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851859.879152:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851859.879154:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851859.879158:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf09 Using peer 22049@kfi7(0xf09)
00000800:00000200:23.0:1773851859.879161:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0xf09: rc=0
00000800:00000200:23.0:1773851859.879162:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf09 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851859.879164:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851859.879165:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004e926e56 refcount 2 to 22241@kfi7
00010000:00000001:23.0:1773851859.879166:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851859.879166:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851859.879167:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851859.879167:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce6f9852 x1859597913806272/t0(0) o400->14b4eaeb-c743-40a6-933a-619c988afe22@22241@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1871-0'
00000100:00100000:23.0:1773851859.879170:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce6f9852 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:14b4eaeb-c743-40a6-933a-619c988afe22+71:39703:x1859597913806272:12345-22241@kfi7:400:default-tuolumne1871-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851859.879172:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22241@kfi7, seq: 1997947
00000100:00000040:23.0:1773851859.879173:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b0242d3 : new rpc_count 3
00000100:00000001:23.0:1773851859.879174:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851859.879174:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851859.879175:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851859.879175:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000800:00000200:21.0:1773851859.879175:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf09 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851859.879176:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000396642d.
00000400:00000200:21.0:1773851859.879176:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:23.0:1773851859.879177:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000004b0242d3 : new refcount 70
00000400:00000200:21.0:1773851859.879177:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22049@kfi7: PUT: OK
00000100:00000001:23.0:1773851859.879178:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851859.879178:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4d95905
00000400:00000010:21.0:1773851859.879178:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4d95905.
00000100:00000001:21.0:1773851859.879179:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851859.879179:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851859.879180:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c800daf0 nid 22049@kfi7 refs 2
00000800:00000200:21.0:1773851859.879181:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 22049@kfi7(000000000fbf56c4):0x0 lsk 3850 rsk 37 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf09 Transaction freed
00000800:00000200:9.0:1773851859.955685:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851859.955685:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851859.955687:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851859.955689:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851859.955691:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12992@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.955692:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12992@kfi7 : PUT - for me
00000400:00000200:9.0:1773851859.955693:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12992@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.955694:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bba3f78 nid 12992@kfi7 refs 1
00000400:00000200:9.0:1773851859.955695:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12992@kfi7 to cpt 2
00000400:00000200:9.0:1773851859.955695:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bba3f78 nid 12992@kfi7 refs 2
00000400:00000200:9.0:1773851859.955696:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000bba3f78 nid 12992@kfi7 refs 3
00000400:00000200:9.0:1773851859.955697:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12800@kfi7 to cpt 7
00000400:00000200:9.0:1773851859.955698:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12800@kfi7 of length 224 into portal 12 MB=0x69b0a1241b040
00000400:00000200:9.0:1773851859.955699:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12800@kfi7 of length 224/224 into md 0x78146ce49 [64] + 126352
00000800:00000200:9.0:1773851859.955701:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851859.955703:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.955703:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12992@kfi7: PUT: OK
00000100:00000001:9.0:1773851859.955704:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851859.955705:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851859.955705:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa1b7ab2.
00000100:00000040:9.0:1773851859.955706:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000aa1b7ab2 x1859317418537024 msgsize 224
00000100:00100000:9.0:1773851859.955707:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-12800@kfi7 (source: 12345-12992@kfi7)
00000100:00000001:9.0:1773851859.955708:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851859.955709:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000bba3f78 nid 12992@kfi7 refs 2
00000100:00000001:10.0:1773851859.955710:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851859.955711:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851859.955711:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851859.955711:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851859.955712:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851859.955712:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851859.955713:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317418537024
00000020:00000001:10.0:1773851859.955714:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851859.955714:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91803
00000020:00000001:10.0:1773851859.955715:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851859.955718:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c447482 refcount=6
00000020:00000001:10.0:1773851859.955718:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241741312 : -107152467810304 : ffff9e8b9f382800)
00000020:00000001:10.0:1773851859.955719:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241741312 : -107152467810304 : ffff9e8b9f382800)
00000100:00000001:10.0:1773851859.955720:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.955721:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851859.955721:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e20f2dfd.
00000020:00000010:10.0:1773851859.955722:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851859.955723:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851859.955724:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851859.955728:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851859.955728:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851859.955730:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851859.955730:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851859.955731:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.955732:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851859.955733:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851859.955733:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851859.955734:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851859.955734:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851859.955735:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12800@kfi7, seq: 2130744
00000100:00000001:11.0:1773851859.955739:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851859.955739:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.955739:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001c447482 : new rpc_count 1
00000100:00000001:10.0:1773851859.955739:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064886784 : -106983644664832 : ffff9eb2eddcec00)
00000100:00000040:10.0:1773851859.955740:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa1b7ab2 x1859317418537024/t0(0) o400->6b2820e9-1052-4f71-89fb-c09266c4a87d@12800@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1299-0'
00000100:00000001:10.0:1773851859.955743:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851859.955744:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851859.955745:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa1b7ab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:6b2820e9-1052-4f71-89fb-c09266c4a87d+6:39561:x1859317418537024:12345-12800@kfi7:400:default-tuolumne1299-0
00000100:00000200:10.0:1773851859.955746:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317418537024
00000020:00000001:10.0:1773851859.955747:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851859.955748:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851859.955748:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.955749:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851859.955750:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851859.955751:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851859.955751:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317418537024, found 0 last_xid 1859317418537023
00000020:00000001:10.0:1773851859.955752:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851859.955753:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851859.955754:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851859.955754:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.955755:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851859.955756:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851859.955756:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851859.955759:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ddad87af.
02000000:00000001:10.0:1773851859.955760:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.955761:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.955762:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851859.955764:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698175, transno 0, xid 1859317418537024
00010000:00000001:10.0:1773851859.955765:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851859.955767:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa1b7ab2 x1859317418537024/t0(0) o400->6b2820e9-1052-4f71-89fb-c09266c4a87d@12800@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1299-0'
00010000:00000001:10.0:1773851859.955772:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851859.955773:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851859.955774:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=92 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851859.955776:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851859.955777:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000630d4cb8 refcount 3 to 12800@kfi7
00000100:00000001:10.0:1773851859.955779:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214400 : -107155106337216 : ffff9e8b01f36e40)
02000000:00000001:10.0:1773851859.955780:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851859.955781:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851859.955782:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851859.955784:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12992@kfi7
00000400:00000010:10.0:1773851859.955785:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032abd4d6.
00000100:00000200:10.0:1773851859.955786:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317418537024, offset 224
00000400:00000200:10.0:1773851859.955789:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12992@kfi7
00000400:00000200:10.0:1773851859.955790:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12992@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.955792:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bba3f78 nid 12992@kfi7 refs 1
00000400:00000200:10.0:1773851859.955793:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000bba3f78 nid 12992@kfi7 refs 2
00000400:00000200:10.0:1773851859.955795:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000bba3f78 nid 12992@kfi7 refs 3
00000400:00000200:10.0:1773851859.955797:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12992@kfi7 local destination
00000400:00000200:10.0:1773851859.955800:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768872:8768872:1024:4294967295] 12992@kfi7 LPNI seq info [2360292:2360292:16:4294967295]
00000400:00000200:10.0:1773851859.955802:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000bba3f78 nid 12992@kfi7 refs 2
00000400:00000200:10.0:1773851859.955804:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12992@kfi7 to cpt 2
00000400:00000200:10.0:1773851859.955808:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12992@kfi7(12992@kfi7:12992@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851859.955810:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000bba3f78 nid 12992@kfi7 refs 3
00000800:00000200:10.0:1773851859.955813:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851859.955815:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851859.955819:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851859.955823:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b45 Using peer 12992@kfi7(0x100000000000b45)
00000800:00000200:10.0:1773851859.955828:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d35a17e8: Posted send of 324 bytes to peer 0x100000000000b45: rc=0
00000800:00000200:10.0:1773851859.955831:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b45 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851859.955839:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851859.955841:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000630d4cb8 refcount 2 to 12800@kfi7
00010000:00000001:10.0:1773851859.955842:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851859.955843:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851859.955844:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000800:00000200:9.0:1773851859.955845:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b45 TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851859.955846:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa1b7ab2 x1859317418537024/t0(0) o400->6b2820e9-1052-4f71-89fb-c09266c4a87d@12800@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1299-0'
00000400:00000200:9.0:1773851859.955848:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851859.955850:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12992@kfi7: PUT: OK
00000400:00000200:9.0:1773851859.955851:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032abd4d6
00000100:00100000:10.0:1773851859.955852:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa1b7ab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:6b2820e9-1052-4f71-89fb-c09266c4a87d+6:39561:x1859317418537024:12345-12800@kfi7:400:default-tuolumne1299-0 Request processed in 107us (144us total) trans 0 rc 0/0
00000400:00000010:9.0:1773851859.955852:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032abd4d6.
00000100:00000001:9.0:1773851859.955853:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851859.955854:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851859.955855:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000bba3f78 nid 12992@kfi7 refs 2
00000100:00100000:10.0:1773851859.955857:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12800@kfi7, seq: 2130744
00000100:00000040:10.0:1773851859.955858:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001c447482 : new rpc_count 0
00000800:00000200:9.0:1773851859.955858:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 12992@kfi7(0000000073738b6a):0x0 lsk 2886 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b45 Transaction freed
00000100:00000001:10.0:1773851859.955859:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851859.955860:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851859.955861:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851859.955863:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:10.0:1773851859.955864:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e20f2dfd.
00000020:00000040:10.0:1773851859.955866:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000001c447482 : new refcount 5
00000100:00000001:10.0:1773851859.955867:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851859.976889:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.976890:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.976891:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.976894:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.976896:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24307@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.976897:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24307@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.976899:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24307@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.976900:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003c9f49e6 nid 24307@kfi7 refs 1
00000400:00000200:5.0:1773851859.976902:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24307@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.976903:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003c9f49e6 nid 24307@kfi7 refs 2
00000400:00000200:5.0:1773851859.976905:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003c9f49e6 nid 24307@kfi7 refs 3
00000400:00000200:5.0:1773851859.976907:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24307@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.976908:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24307@kfi7 of length 224 into portal 12 MB=0x699e12eac8100
00000400:00000200:5.0:1773851859.976911:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24307@kfi7 of length 224/224 into md 0x793926dc5 [64] + 126040
00000800:00000200:5.0:1773851859.976914:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.976917:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.976919:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24307@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.976921:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.976922:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.976923:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa9c5494.
00000100:00000040:5.0:1773851859.976924:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000fa9c5494 x1858042290012416 msgsize 224
00000100:00100000:5.0:1773851859.976927:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-24307@kfi7 (source: 12345-24307@kfi7)
00000100:00000001:5.0:1773851859.976929:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851859.976930:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003c9f49e6 nid 24307@kfi7 refs 2
00000100:00000001:7.0:1773851859.976932:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.976933:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851859.976933:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851859.976934:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.976935:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851859.976936:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.976937:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042290012416
00000020:00000001:7.0:1773851859.976939:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.976939:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c9a
00000020:00000001:7.0:1773851859.976940:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.976945:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000018f2dcde refcount=6
00000020:00000001:7.0:1773851859.976947:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744168448 : -107128965383168 : ffff9e911812bc00)
00000020:00000001:7.0:1773851859.976948:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744168448 : -107128965383168 : ffff9e911812bc00)
00000100:00000001:7.0:1773851859.976950:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.976951:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.976952:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c654aa7b.
00000020:00000010:7.0:1773851859.976954:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.976956:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851859.976957:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.976958:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851859.976959:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.976960:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851859.976962:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851859.976963:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.976965:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.976967:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851859.976967:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.976968:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.976968:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851859.976969:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24307@kfi7, seq: 2001876
00000100:00000040:7.0:1773851859.976971:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000018f2dcde : new rpc_count 1
00000100:00000001:6.0:1773851859.976971:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.976972:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866934144 : -107088842617472 : ffff9e9a6f938d80)
00000100:00000001:6.0:1773851859.976972:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.976974:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fa9c5494 x1858042290012416/t0(0) o400->df282aff-ebb0-4b26-af85-25a3b5f03202@24307@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1993-0'
00000100:00000001:7.0:1773851859.976979:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.976980:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.976982:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa9c5494 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:df282aff-ebb0-4b26-af85-25a3b5f03202+6:39801:x1858042290012416:12345-24307@kfi7:400:default-tuolumne1993-0
00000100:00000200:7.0:1773851859.976984:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042290012416
00000020:00000001:7.0:1773851859.976985:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.976986:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.976988:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.976989:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.976990:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851859.976991:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.976992:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042290012416, found 0 last_xid 1858042290012415
00000020:00000001:7.0:1773851859.976994:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.976995:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.976996:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.976996:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.976997:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851859.976998:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.976999:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.977001:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ae7b5977.
02000000:00000001:7.0:1773851859.977002:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.977003:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.977004:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.977005:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263921279, transno 0, xid 1858042290012416
00010000:00000001:7.0:1773851859.977007:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.977009:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fa9c5494 x1858042290012416/t0(0) o400->df282aff-ebb0-4b26-af85-25a3b5f03202@24307@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1993-0'
00010000:00000001:7.0:1773851859.977014:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.977015:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.977016:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.977018:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.977019:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007f997bce refcount 3 to 24307@kfi7
00000100:00000001:7.0:1773851859.977021:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410560 : -107145304141056 : ffff9e8d4a351300)
02000000:00000001:7.0:1773851859.977022:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.977023:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.977024:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.977026:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24307@kfi7
00000400:00000010:7.0:1773851859.977027:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f88013b1.
00000100:00000200:7.0:1773851859.977028:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042290012416, offset 224
00000400:00000200:7.0:1773851859.977031:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24307@kfi7
00000400:00000200:7.0:1773851859.977032:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24307@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.977034:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003c9f49e6 nid 24307@kfi7 refs 1
00000400:00000200:7.0:1773851859.977035:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003c9f49e6 nid 24307@kfi7 refs 2
00000400:00000200:7.0:1773851859.977037:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003c9f49e6 nid 24307@kfi7 refs 3
00000400:00000200:7.0:1773851859.977039:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24307@kfi7 local destination
00000400:00000200:7.0:1773851859.977042:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768873:8768873:1024:4294967295] 24307@kfi7 LPNI seq info [494730:494730:16:4294967295]
00000400:00000200:7.0:1773851859.977044:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003c9f49e6 nid 24307@kfi7 refs 2
00000400:00000200:7.0:1773851859.977046:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24307@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.977049:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24307@kfi7(24307@kfi7:24307@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.977051:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003c9f49e6 nid 24307@kfi7 refs 3
00000800:00000200:7.0:1773851859.977053:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.977055:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851859.977059:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.977066:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000079e Using peer 24307@kfi7(0x10000000000079e)
00000800:00000200:7.0:1773851859.977071:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x10000000000079e: rc=0
00000800:00000200:7.0:1773851859.977073:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000079e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.977076:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.977078:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007f997bce refcount 2 to 24307@kfi7
00010000:00000001:7.0:1773851859.977079:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.977080:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.977081:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.977082:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa9c5494 x1858042290012416/t0(0) o400->df282aff-ebb0-4b26-af85-25a3b5f03202@24307@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1993-0'
00000800:00000200:5.0:1773851859.977086:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000079e TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851859.977087:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa9c5494 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:df282aff-ebb0-4b26-af85-25a3b5f03202+6:39801:x1858042290012416:12345-24307@kfi7:400:default-tuolumne1993-0 Request processed in 107us (162us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851859.977089:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851859.977091:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24307@kfi7, seq: 2001876
00000400:00000200:5.0:1773851859.977091:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24307@kfi7: PUT: OK
00000100:00000040:7.0:1773851859.977092:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000018f2dcde : new rpc_count 0
00000400:00000200:5.0:1773851859.977092:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f88013b1
00000400:00000010:5.0:1773851859.977093:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f88013b1.
00000100:00000001:7.0:1773851859.977094:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851859.977094:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851859.977094:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851859.977095:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000100:00000001:5.0:1773851859.977095:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851859.977096:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000400:00000200:5.0:1773851859.977096:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003c9f49e6 nid 24307@kfi7 refs 2
00000020:00000010:7.0:1773851859.977098:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c654aa7b.
00000800:00000200:5.0:1773851859.977098:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 24307@kfi7(000000000445ca56):0x0 lsk 1951 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000079e Transaction freed
00000020:00000040:7.0:1773851859.977099:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000018f2dcde : new refcount 5
00000100:00000001:7.0:1773851859.977100:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851859.979974:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.979975:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851859.979978:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851859.979982:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851859.979986:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14880@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.979988:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14880@kfi7 : PUT - for me
00000400:00000200:13.0:1773851859.979990:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14880@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.979991:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000003b08f8d nid 14880@kfi7 refs 1
00000400:00000200:13.0:1773851859.979993:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14880@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.979994:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000003b08f8d nid 14880@kfi7 refs 2
00000400:00000200:13.0:1773851859.979996:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000003b08f8d nid 14880@kfi7 refs 3
00000400:00000200:13.0:1773851859.979998:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14881@kfi7 to cpt 6
00000400:00000200:13.0:1773851859.980000:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14881@kfi7 of length 224 into portal 12 MB=0x69b4b5cd418c0
00000400:00000200:13.0:1773851859.980002:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14881@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 20840
00000800:00000200:13.0:1773851859.980006:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851859.980009:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851859.980011:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14880@kfi7: PUT: OK
00000100:00000001:13.0:1773851859.980013:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851859.980014:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851859.980015:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc9200e7.
00000100:00000040:13.0:1773851859.980017:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000cc9200e7 x1859597842520256 msgsize 224
00000100:00100000:13.0:1773851859.980019:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14881@kfi7 (source: 12345-14880@kfi7)
00000100:00000001:13.0:1773851859.980022:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851859.980023:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000003b08f8d nid 14880@kfi7 refs 2
00000800:00000200:13.0:1773851859.980026:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851859.980031:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851859.980034:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851859.980035:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851859.980035:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851859.980037:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851859.980039:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597842520256
00000020:00000001:13.0:1773851859.980040:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851859.980041:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8009c
00000020:00000001:13.0:1773851859.980042:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851859.980048:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7e3ca8a refcount=168
00000020:00000001:13.0:1773851859.980049:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148212942848 : -106925496608768 : ffff9ec077c1d800)
00000020:00000001:13.0:1773851859.980051:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148212942848 : -106925496608768 : ffff9ec077c1d800)
00000100:00000001:13.0:1773851859.980052:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851859.980054:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851859.980055:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b727378.
00000020:00000010:13.0:1773851859.980057:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851859.980058:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000000521e59.
00000100:00000001:13.0:1773851859.980060:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851859.980060:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851859.980061:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851859.980063:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851859.980064:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851859.980065:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.980066:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851859.980068:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.980069:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851859.980069:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851859.980069:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851859.980071:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14881@kfi7, seq: 2289799
00000100:00000001:15.0:1773851859.980072:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851859.980072:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7e3ca8a : new rpc_count 1
00000100:00000001:15.0:1773851859.980073:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.980073:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537165696 : -107002172385920 : ffff9eae9d865580)
00000100:00000040:13.0:1773851859.980075:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cc9200e7 x1859597842520256/t0(0) o400->dbaaf0d0-653d-4e03-8593-8ade057760cb@14881@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1423-0'
00000100:00000001:13.0:1773851859.980079:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851859.980080:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851859.980081:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc9200e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:dbaaf0d0-653d-4e03-8593-8ade057760cb+168:39586:x1859597842520256:12345-14881@kfi7:400:default-tuolumne1423-0
00000100:00000200:13.0:1773851859.980086:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597842520256
00000020:00000001:13.0:1773851859.980087:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851859.980088:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851859.980089:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.980090:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851859.980090:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851859.980092:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851859.980093:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597842520256, found 0 last_xid 1859597842095167
00000020:00000001:13.0:1773851859.980094:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851859.980095:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851859.980096:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851859.980097:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.980098:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851859.980099:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851859.980099:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851859.980101:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ac13726c.
02000000:00000001:13.0:1773851859.980102:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.980103:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.980104:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851859.980105:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264060652, transno 0, xid 1859597842520256
00010000:00000001:13.0:1773851859.980106:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851859.980108:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cc9200e7 x1859597842520256/t0(0) o400->dbaaf0d0-653d-4e03-8593-8ade057760cb@14881@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1423-0'
00010000:00000001:13.0:1773851859.980112:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851859.980113:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851859.980114:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=92 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851859.980116:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851859.980117:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007579d204 refcount 3 to 14881@kfi7
00000100:00000001:13.0:1773851859.980118:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739584 : -107139395812032 : ffff9e8eaa5f0540)
02000000:00000001:13.0:1773851859.980119:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851859.980120:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851859.980121:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851859.980122:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14880@kfi7
00000400:00000010:13.0:1773851859.980123:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e24e1739.
00000100:00000200:13.0:1773851859.980125:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597842520256, offset 224
00000400:00000200:13.0:1773851859.980127:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14880@kfi7
00000400:00000200:13.0:1773851859.980129:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14880@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.980130:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000003b08f8d nid 14880@kfi7 refs 1
00000400:00000200:13.0:1773851859.980131:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000003b08f8d nid 14880@kfi7 refs 2
00000400:00000200:13.0:1773851859.980133:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000003b08f8d nid 14880@kfi7 refs 3
00000400:00000200:13.0:1773851859.980135:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14880@kfi7 local destination
00000400:00000200:13.0:1773851859.980137:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768874:8768874:1024:4294967295] 14880@kfi7 LPNI seq info [283518:283518:16:4294967295]
00000400:00000200:13.0:1773851859.980140:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000003b08f8d nid 14880@kfi7 refs 2
00000400:00000200:13.0:1773851859.980141:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14880@kfi7 to cpt 3
00000400:00000200:13.0:1773851859.980144:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14880@kfi7(14880@kfi7:14880@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851859.980146:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000003b08f8d nid 14880@kfi7 refs 3
00000800:00000200:13.0:1773851859.980148:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851859.980150:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851859.980153:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851859.980157:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0xcdd Using peer 14880@kfi7(0xcdd)
00000800:00000200:13.0:1773851859.980162:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008e3f5456: Posted send of 324 bytes to peer 0xcdd: rc=0
00000800:00000200:13.0:1773851859.980164:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0xcdd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851859.980167:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851859.980168:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007579d204 refcount 2 to 14881@kfi7
00010000:00000001:13.0:1773851859.980169:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851859.980170:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851859.980171:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851859.980172:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc9200e7 x1859597842520256/t0(0) o400->dbaaf0d0-653d-4e03-8593-8ade057760cb@14881@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1423-0'
00000100:00100000:13.0:1773851859.980177:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc9200e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:dbaaf0d0-653d-4e03-8593-8ade057760cb+168:39586:x1859597842520256:12345-14881@kfi7:400:default-tuolumne1423-0 Request processed in 97us (159us total) trans 0 rc 0/0
00000800:00000200:14.0:1773851859.980179:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0xcdd TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851859.980181:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:13.0:1773851859.980181:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14881@kfi7, seq: 2289799
00000100:00000040:13.0:1773851859.980182:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7e3ca8a : new rpc_count 0
00000400:00000200:14.0:1773851859.980183:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14880@kfi7: PUT: OK
00000400:00000200:14.0:1773851859.980184:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e24e1739
00000100:00000001:13.0:1773851859.980184:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851859.980184:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:14.0:1773851859.980185:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e24e1739.
00000020:00000010:13.0:1773851859.980185:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000001:14.0:1773851859.980186:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:13.0:1773851859.980186:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000000521e59.
00000100:00000001:14.0:1773851859.980187:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851859.980188:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000003b08f8d nid 14880@kfi7 refs 2
00000020:00000010:13.0:1773851859.980188:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b727378.
00000020:00000040:13.0:1773851859.980189:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000a7e3ca8a : new refcount 167
00000800:00000200:14.0:1773851859.980190:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 14880@kfi7(0000000053dd8d78):0x0 lsk 3294 rsk 25 tsk 0 trmk 0 tmk 0 trr 3 tta 0xcdd Transaction freed
00000100:00000001:13.0:1773851859.980190:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851859.991128:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851859.991129:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851859.991130:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851859.991132:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851859.991134:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16864@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.991135:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16864@kfi7 : PUT - for me
00000400:00000200:5.0:1773851859.991136:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16864@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.991136:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366dd11b nid 16864@kfi7 refs 1
00000400:00000200:5.0:1773851859.991137:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16864@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.991138:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366dd11b nid 16864@kfi7 refs 2
00000400:00000200:5.0:1773851859.991139:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000366dd11b nid 16864@kfi7 refs 3
00000400:00000200:5.0:1773851859.991140:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16864@kfi7 to cpt 1
00000400:00000200:5.0:1773851859.991141:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16864@kfi7 of length 224 into portal 12 MB=0x69b4b608feac0
00000400:00000200:5.0:1773851859.991142:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16864@kfi7 of length 224/224 into md 0x793926dc5 [64] + 126264
00000800:00000200:5.0:1773851859.991143:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851859.991145:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.991146:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16864@kfi7: PUT: OK
00000100:00000001:5.0:1773851859.991147:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851859.991147:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851859.991148:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000466a294c.
00000100:00000040:5.0:1773851859.991149:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000466a294c x1859597905160896 msgsize 224
00000100:00100000:5.0:1773851859.991150:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-16864@kfi7 (source: 12345-16864@kfi7)
00000100:00000001:5.0:1773851859.991151:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851859.991151:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000366dd11b nid 16864@kfi7 refs 2
00000100:00000001:7.0:1773851859.991152:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851859.991152:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851859.991153:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851859.991153:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851859.991153:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851859.991154:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851859.991155:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597905160896
00000020:00000001:7.0:1773851859.991156:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851859.991156:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d824d0
00000020:00000001:7.0:1773851859.991158:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851859.991161:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000083e52af1 refcount=167
00000020:00000001:7.0:1773851859.991162:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109687016448 : -106964022535168 : ffff9eb77f6edc00)
00000020:00000001:7.0:1773851859.991163:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637109687016448 : -106964022535168 : ffff9eb77f6edc00)
00000100:00000001:7.0:1773851859.991164:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.991164:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851859.991165:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c654aa7b.
00000020:00000010:7.0:1773851859.991166:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.991167:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851859.991167:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851859.991168:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851859.991168:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.991169:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851859.991170:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851859.991170:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.991171:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851859.991172:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851859.991172:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851859.991172:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851859.991173:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16864@kfi7, seq: 2001877
00000100:00000001:6.0:1773851859.991173:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851859.991174:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000083e52af1 : new rpc_count 1
00000100:00000001:6.0:1773851859.991174:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.991175:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866944512 : -107088842607104 : ffff9e9a6f93b600)
00000100:00000001:6.0:1773851859.991175:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.991176:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000466a294c x1859597905160896/t0(0) o400->7f89c4e7-6b1a-440f-9a9c-ad5fc72d8263@16864@kfi7:586/0 lens 224/0 e 0 to 0 dl 1773851946 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1535-0'
00000100:00000001:7.0:1773851859.991178:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851859.991179:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851859.991179:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000466a294c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7f89c4e7-6b1a-440f-9a9c-ad5fc72d8263+167:39530:x1859597905160896:12345-16864@kfi7:400:default-tuolumne1535-0
00000100:00000200:7.0:1773851859.991181:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597905160896
00000020:00000001:7.0:1773851859.991181:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851859.991182:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851859.991183:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.991183:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851859.991184:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851859.991185:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851859.991186:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597905160896, found 0 last_xid 1859597904737023
00000020:00000001:7.0:1773851859.991187:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851859.991187:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851859.991188:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851859.991188:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.991189:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851859.991190:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851859.991190:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851859.991191:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000011e68cc6.
02000000:00000001:7.0:1773851859.991192:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.991192:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.991193:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851859.991194:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062752, transno 0, xid 1859597905160896
00010000:00000001:7.0:1773851859.991194:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851859.991195:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000466a294c x1859597905160896/t0(0) o400->7f89c4e7-6b1a-440f-9a9c-ad5fc72d8263@16864@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1535-0'
00010000:00000001:7.0:1773851859.991197:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851859.991198:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851859.991199:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=91 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851859.991200:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851859.991201:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000afa7098a refcount 3 to 16864@kfi7
00000100:00000001:7.0:1773851859.991201:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410752 : -107145304140864 : ffff9e8d4a3513c0)
02000000:00000001:7.0:1773851859.991202:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851859.991203:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851859.991203:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851859.991204:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16864@kfi7
00000400:00000010:7.0:1773851859.991205:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000045c9ef1.
00000100:00000200:7.0:1773851859.991205:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597905160896, offset 224
00000400:00000200:7.0:1773851859.991206:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16864@kfi7
00000400:00000200:7.0:1773851859.991207:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16864@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.991208:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366dd11b nid 16864@kfi7 refs 1
00000400:00000200:7.0:1773851859.991209:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000366dd11b nid 16864@kfi7 refs 2
00000400:00000200:7.0:1773851859.991210:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000366dd11b nid 16864@kfi7 refs 3
00000400:00000200:7.0:1773851859.991211:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16864@kfi7 local destination
00000400:00000200:7.0:1773851859.991213:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768875:8768875:1024:4294967295] 16864@kfi7 LPNI seq info [1177759:1177759:16:4294967295]
00000400:00000200:7.0:1773851859.991214:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000366dd11b nid 16864@kfi7 refs 2
00000400:00000200:7.0:1773851859.991215:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16864@kfi7 to cpt 1
00000400:00000200:7.0:1773851859.991216:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16864@kfi7(16864@kfi7:16864@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851859.991218:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000366dd11b nid 16864@kfi7 refs 3
00000800:00000200:7.0:1773851859.991219:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851859.991220:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851859.991222:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851859.991224:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c2 Using peer 16864@kfi7(0x1c2)
00000800:00000200:7.0:1773851859.991227:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x1c2: rc=0
00000800:00000200:7.0:1773851859.991228:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851859.991230:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851859.991231:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000afa7098a refcount 2 to 16864@kfi7
00010000:00000001:7.0:1773851859.991231:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851859.991232:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851859.991233:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851859.991233:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000466a294c x1859597905160896/t0(0) o400->7f89c4e7-6b1a-440f-9a9c-ad5fc72d8263@16864@kfi7:586/0 lens 224/224 e 0 to 0 dl 1773851946 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1535-0'
00000100:00100000:7.0:1773851859.991236:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000466a294c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:7f89c4e7-6b1a-440f-9a9c-ad5fc72d8263+167:39530:x1859597905160896:12345-16864@kfi7:400:default-tuolumne1535-0 Request processed in 57us (87us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851859.991238:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16864@kfi7, seq: 2001877
00000100:00000040:7.0:1773851859.991239:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000083e52af1 : new rpc_count 0
00000800:00000200:5.0:1773851859.991239:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c2 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851859.991240:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851859.991240:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851859.991241:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851859.991241:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000020:00000010:7.0:1773851859.991242:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c654aa7b.
00000020:00000040:7.0:1773851859.991243:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000083e52af1 : new refcount 166
00000100:00000001:7.0:1773851859.991244:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851859.991244:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851859.991245:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16864@kfi7: PUT: OK
00000400:00000200:5.0:1773851859.991246:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000045c9ef1
00000400:00000010:5.0:1773851859.991246:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000045c9ef1.
00000100:00000001:5.0:1773851859.991247:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851859.991247:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851859.991248:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000366dd11b nid 16864@kfi7 refs 2
00000800:00000200:5.0:1773851859.991250:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 16864@kfi7(00000000871d6769):0x0 lsk 451 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1c2 Transaction freed
00000800:00000200:13.0:1773851860.040956:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.040957:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851860.040958:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851860.040961:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851860.040963:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22242@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.040964:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22242@kfi7 : PUT - for me
00000400:00000200:13.0:1773851860.040965:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22242@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.040966:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000689989fe nid 22242@kfi7 refs 1
00000400:00000200:13.0:1773851860.040967:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22242@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.040967:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000689989fe nid 22242@kfi7 refs 2
00000400:00000200:13.0:1773851860.040968:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000689989fe nid 22242@kfi7 refs 3
00000400:00000200:13.0:1773851860.040969:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22051@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.040970:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22051@kfi7 of length 224 into portal 12 MB=0x69b4b62643c80
00000400:00000200:13.0:1773851860.040971:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22051@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 21064
00000800:00000200:13.0:1773851860.040973:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851860.040975:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851860.040976:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22242@kfi7: PUT: OK
00000100:00000001:13.0:1773851860.040977:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851860.040978:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851860.040979:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001fdb9ff8.
00000100:00000040:13.0:1773851860.040980:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000001fdb9ff8 x1859597935852672 msgsize 224
00000100:00100000:13.0:1773851860.040981:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22051@kfi7 (source: 12345-22242@kfi7)
00000100:00000001:13.0:1773851860.040983:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851860.040983:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000689989fe nid 22242@kfi7 refs 2
00000800:00000200:13.0:1773851860.040985:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e3f5456: 2069@kfi7:3 <- 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851860.040987:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851860.040988:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851860.040988:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851860.040989:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851860.040990:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851860.040990:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597935852672
00000020:00000001:13.0:1773851860.040991:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851860.040991:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2430c199
00000020:00000001:13.0:1773851860.040992:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851860.040995:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000570a0a14 refcount=5
00000020:00000001:13.0:1773851860.040996:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128066302976 : -106945643248640 : ffff9ebbc6ec8400)
00000020:00000001:13.0:1773851860.040997:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128066302976 : -106945643248640 : ffff9ebbc6ec8400)
00000100:00000001:13.0:1773851860.040998:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851860.040999:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851860.041000:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b727378.
00000020:00000010:13.0:1773851860.041001:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851860.041002:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000000521e59.
00000100:00000001:13.0:1773851860.041003:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851860.041003:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851860.041004:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851860.041005:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851860.041005:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851860.041006:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.041007:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.041008:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851860.041008:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851860.041008:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851860.041009:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851860.041009:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22051@kfi7, seq: 2289800
00000100:00000001:15.0:1773851860.041010:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851860.041010:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000570a0a14 : new rpc_count 1
00000100:00000001:15.0:1773851860.041011:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.041011:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537172608 : -107002172379008 : ffff9eae9d867080)
00000100:00000040:13.0:1773851860.041012:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001fdb9ff8 x1859597935852672/t0(0) o400->1224f00c-8bb9-4533-bd9b-6ec6a74a4d03@22051@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1867-0'
00000100:00000001:13.0:1773851860.041015:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851860.041015:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851860.041016:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fdb9ff8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:1224f00c-8bb9-4533-bd9b-6ec6a74a4d03+5:39696:x1859597935852672:12345-22051@kfi7:400:default-tuolumne1867-0
00000100:00000200:13.0:1773851860.041017:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597935852672
00000020:00000001:13.0:1773851860.041018:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851860.041019:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851860.041019:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.041020:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851860.041021:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851860.041022:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851860.041022:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597935852672, found 0 last_xid 1859597935852671
00000020:00000001:13.0:1773851860.041023:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851860.041024:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851860.041024:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851860.041025:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.041025:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851860.041026:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851860.041026:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851860.041027:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000688a16c8.
02000000:00000001:13.0:1773851860.041028:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.041028:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.041029:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851860.041030:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044170169, transno 0, xid 1859597935852672
00010000:00000001:13.0:1773851860.041031:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851860.041032:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001fdb9ff8 x1859597935852672/t0(0) o400->1224f00c-8bb9-4533-bd9b-6ec6a74a4d03@22051@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1867-0'
00010000:00000001:13.0:1773851860.041034:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851860.041035:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851860.041036:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851860.041037:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851860.041038:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000908ce16f refcount 3 to 22051@kfi7
00000100:00000001:13.0:1773851860.041038:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811152224 : -107154898399392 : ffff9e8b0e584f60)
02000000:00000001:13.0:1773851860.041039:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851860.041040:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.041040:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851860.041041:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22242@kfi7
00000400:00000010:13.0:1773851860.041042:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edba2261.
00000100:00000200:13.0:1773851860.041042:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597935852672, offset 224
00000400:00000200:13.0:1773851860.041044:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22242@kfi7
00000400:00000200:13.0:1773851860.041045:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22242@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.041045:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000689989fe nid 22242@kfi7 refs 1
00000400:00000200:13.0:1773851860.041046:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000689989fe nid 22242@kfi7 refs 2
00000400:00000200:13.0:1773851860.041047:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000689989fe nid 22242@kfi7 refs 3
00000400:00000200:13.0:1773851860.041048:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22242@kfi7 local destination
00000400:00000200:13.0:1773851860.041050:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768876:8768876:1024:4294967295] 22242@kfi7 LPNI seq info [13137503:13137503:16:4294967295]
00000400:00000200:13.0:1773851860.041051:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000689989fe nid 22242@kfi7 refs 2
00000400:00000200:13.0:1773851860.041052:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22242@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.041054:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22242@kfi7(22242@kfi7:22242@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851860.041055:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000689989fe nid 22242@kfi7 refs 3
00000800:00000200:13.0:1773851860.041056:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.041057:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851860.041059:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851860.041061:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1122 Using peer 22242@kfi7(0x1122)
00000800:00000200:13.0:1773851860.041064:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008e3f5456: Posted send of 324 bytes to peer 0x1122: rc=0
00000800:00000200:13.0:1773851860.041065:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1122 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851860.041069:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851860.041069:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000908ce16f refcount 2 to 22051@kfi7
00010000:00000001:13.0:1773851860.041070:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851860.041071:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.041071:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851860.041072:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001fdb9ff8 x1859597935852672/t0(0) o400->1224f00c-8bb9-4533-bd9b-6ec6a74a4d03@22051@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1867-0'
00000100:00100000:13.0:1773851860.041075:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fdb9ff8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:1224f00c-8bb9-4533-bd9b-6ec6a74a4d03+5:39696:x1859597935852672:12345-22051@kfi7:400:default-tuolumne1867-0 Request processed in 60us (95us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851860.041078:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22051@kfi7, seq: 2289800
00000800:00000200:14.0:1773851860.041079:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1122 TN_EVENT_TX_OK event status 0
00000100:00000040:13.0:1773851860.041079:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000570a0a14 : new rpc_count 0
00000400:00000200:14.0:1773851860.041080:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851860.041080:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851860.041080:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851860.041081:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22242@kfi7: PUT: OK
00000020:00000010:13.0:1773851860.041081:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851860.041081:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000000521e59.
00000400:00000200:14.0:1773851860.041082:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edba2261
00000400:00000010:14.0:1773851860.041082:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edba2261.
00000020:00000010:13.0:1773851860.041082:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b727378.
00000020:00000040:13.0:1773851860.041083:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000570a0a14 : new refcount 4
00000100:00000001:13.0:1773851860.041084:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851860.041093:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851860.041094:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851860.041095:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000689989fe nid 22242@kfi7 refs 2
00000800:00000200:14.0:1773851860.041096:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2069@kfi7:3 -> 22242@kfi7(0000000071a3e58a):0x0 lsk 4387 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1122 Transaction freed
00000800:00000200:9.0:1773851860.048399:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.048400:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.048401:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.048403:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.048404:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9552@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.048406:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9552@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.048407:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9552@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.048407:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000494e90af nid 9552@kfi7 refs 1
00000400:00000200:9.0:1773851860.048408:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9552@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.048409:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000494e90af nid 9552@kfi7 refs 2
00000400:00000200:9.0:1773851860.048410:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000494e90af nid 9552@kfi7 refs 3
00000400:00000200:9.0:1773851860.048411:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9616@kfi7 to cpt 5
00000400:00000200:9.0:1773851860.048412:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9616@kfi7 of length 224 into portal 12 MB=0x69a8a25127700
00000400:00000200:9.0:1773851860.048413:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9616@kfi7 of length 224/224 into md 0x78146ce49 [64] + 126576
00000800:00000200:9.0:1773851860.048414:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.048416:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.048418:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9552@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.048418:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.048419:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.048420:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000060822807.
00000100:00000040:9.0:1773851860.048420:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000060822807 x1858767978395392 msgsize 224
00000100:00100000:9.0:1773851860.048422:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-9616@kfi7 (source: 12345-9552@kfi7)
00000100:00000001:9.0:1773851860.048423:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.048423:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000494e90af nid 9552@kfi7 refs 2
00000100:00000001:10.0:1773851860.048424:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851860.048424:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851860.048425:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851860.048425:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851860.048425:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:10.0:1773851860.048426:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851860.048426:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858767978395392
00000020:00000001:10.0:1773851860.048427:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851860.048427:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914e5
00000020:00000001:10.0:1773851860.048428:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851860.048431:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000135aaf22 refcount=6
00000020:00000001:10.0:1773851860.048432:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240803328 : -107152468748288 : ffff9e8b9f29d800)
00000020:00000001:10.0:1773851860.048433:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240803328 : -107152468748288 : ffff9e8b9f29d800)
00000100:00000001:10.0:1773851860.048433:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851860.048434:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851860.048435:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e20f2dfd.
00000020:00000010:10.0:1773851860.048436:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851860.048437:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851860.048437:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851860.048438:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851860.048438:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851860.048439:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851860.048439:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851860.048440:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.048441:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.048442:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.048442:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851860.048442:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851860.048442:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851860.048443:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9616@kfi7, seq: 2130745
00000100:00000001:11.0:1773851860.048444:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.048444:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851860.048444:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000135aaf22 : new rpc_count 1
00000100:00000001:10.0:1773851860.048444:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064867200 : -106983644684416 : ffff9eb2eddc9f80)
00000100:00000040:10.0:1773851860.048445:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000060822807 x1858767978395392/t0(0) o400->7887ea9a-6d29-458c-9e06-db045bdceb6e@9616@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1090-0'
00000100:00000001:10.0:1773851860.048448:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851860.048448:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851860.048449:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060822807 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:7887ea9a-6d29-458c-9e06-db045bdceb6e+6:39362:x1858767978395392:12345-9616@kfi7:400:default-tuolumne1090-0
00000100:00000200:10.0:1773851860.048450:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858767978395392
00000020:00000001:10.0:1773851860.048451:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851860.048451:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851860.048452:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.048452:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851860.048453:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851860.048453:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851860.048454:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858767978395392, found 0 last_xid 1858767978395391
00000020:00000001:10.0:1773851860.048455:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851860.048455:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851860.048456:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851860.048456:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.048457:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851860.048457:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851860.048458:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851860.048459:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000780b9c29.
02000000:00000001:10.0:1773851860.048459:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.048460:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.048461:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851860.048461:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530917, transno 0, xid 1858767978395392
00010000:00000001:10.0:1773851860.048462:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851860.048463:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000060822807 x1858767978395392/t0(0) o400->7887ea9a-6d29-458c-9e06-db045bdceb6e@9616@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1090-0'
00010000:00000001:10.0:1773851860.048465:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851860.048465:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851860.048466:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851860.048467:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851860.048467:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ddff011 refcount 3 to 9616@kfi7
00000100:00000001:10.0:1773851860.048468:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095456 : -107139307456160 : ffff9e8eafa33960)
02000000:00000001:10.0:1773851860.048469:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851860.048469:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.048469:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851860.048470:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9552@kfi7
00000400:00000010:10.0:1773851860.048471:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cccb4b93.
00000100:00000200:10.0:1773851860.048472:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858767978395392, offset 224
00000400:00000200:10.0:1773851860.048473:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9552@kfi7
00000400:00000200:10.0:1773851860.048474:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9552@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.048474:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000494e90af nid 9552@kfi7 refs 1
00000400:00000200:10.0:1773851860.048475:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000494e90af nid 9552@kfi7 refs 2
00000400:00000200:10.0:1773851860.048476:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000494e90af nid 9552@kfi7 refs 3
00000400:00000200:10.0:1773851860.048477:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9552@kfi7 local destination
00000400:00000200:10.0:1773851860.048478:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768877:8768877:1024:4294967295] 9552@kfi7 LPNI seq info [17510:17510:16:4294967295]
00000400:00000200:10.0:1773851860.048480:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000494e90af nid 9552@kfi7 refs 2
00000400:00000200:10.0:1773851860.048480:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9552@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.048482:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9552@kfi7(9552@kfi7:9552@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851860.048483:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000494e90af nid 9552@kfi7 refs 3
00000800:00000200:10.0:1773851860.048485:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851860.048485:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851860.048487:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851860.048489:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11a0 Using peer 9552@kfi7(0x11a0)
00000800:00000200:10.0:1773851860.048492:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000348da31e: Posted send of 324 bytes to peer 0x11a0: rc=0
00000800:00000200:10.0:1773851860.048493:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11a0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851860.048495:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851860.048496:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ddff011 refcount 2 to 9616@kfi7
00010000:00000001:10.0:1773851860.048496:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851860.048497:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.048497:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851860.048498:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000060822807 x1858767978395392/t0(0) o400->7887ea9a-6d29-458c-9e06-db045bdceb6e@9616@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1090-0'
00000100:00100000:10.0:1773851860.048500:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060822807 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:7887ea9a-6d29-458c-9e06-db045bdceb6e+6:39362:x1858767978395392:12345-9616@kfi7:400:default-tuolumne1090-0 Request processed in 52us (79us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851860.048502:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9616@kfi7, seq: 2130745
00000100:00000040:10.0:1773851860.048503:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000135aaf22 : new rpc_count 0
00000100:00000001:10.0:1773851860.048503:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851860.048503:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11a0 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851860.048504:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851860.048504:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851860.048505:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000400:00000200:9.0:1773851860.048505:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851860.048506:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e20f2dfd.
00000020:00000040:10.0:1773851860.048506:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000135aaf22 : new refcount 5
00000400:00000200:9.0:1773851860.048506:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9552@kfi7: PUT: OK
00000400:00000200:9.0:1773851860.048506:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cccb4b93
00000100:00000001:10.0:1773851860.048507:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851860.048507:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cccb4b93.
00000100:00000001:9.0:1773851860.048508:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851860.048508:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851860.048509:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000494e90af nid 9552@kfi7 refs 2
00000800:00000200:9.0:1773851860.048510:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 9552@kfi7(00000000baed011e):0x0 lsk 4513 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11a0 Transaction freed
00000800:00000200:9.0:1773851860.052026:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.052027:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.052028:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.052030:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.052031:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12882@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.052032:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12882@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.052033:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12882@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.052033:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c43689d4 nid 12882@kfi7 refs 1
00000400:00000200:9.0:1773851860.052035:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12882@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.052035:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c43689d4 nid 12882@kfi7 refs 2
00000400:00000200:9.0:1773851860.052037:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c43689d4 nid 12882@kfi7 refs 3
00000400:00000200:9.0:1773851860.052037:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12883@kfi7 to cpt 5
00000400:00000200:9.0:1773851860.052038:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12883@kfi7 of length 224 into portal 12 MB=0x69b823a64f180
00000400:00000200:9.0:1773851860.052039:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12883@kfi7 of length 224/224 into md 0x78146ce49 [64] + 126800
00000800:00000200:9.0:1773851860.052041:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.052042:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.052043:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12882@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.052044:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.052044:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.052045:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005252f0a7.
00000100:00000040:9.0:1773851860.052045:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000005252f0a7 x1859833488011648 msgsize 224
00000100:00100000:9.0:1773851860.052047:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-12883@kfi7 (source: 12345-12882@kfi7)
00000100:00000001:9.0:1773851860.052047:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.052048:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c43689d4 nid 12882@kfi7 refs 2
00000100:00000001:10.0:1773851860.052049:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851860.052049:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851860.052049:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851860.052050:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851860.052050:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851860.052051:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851860.052052:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833488011648
00000020:00000001:10.0:1773851860.052052:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851860.052052:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c181bf1
00000020:00000001:10.0:1773851860.052053:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851860.052055:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000761dc406 refcount=167
00000020:00000001:10.0:1773851860.052056:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637070075004928 : -107003634546688 : ffff9eae465f8800)
00000020:00000001:10.0:1773851860.052056:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637070075004928 : -107003634546688 : ffff9eae465f8800)
00000100:00000001:10.0:1773851860.052058:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851860.052058:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851860.052059:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef78f1a0.
00000020:00000010:10.0:1773851860.052060:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851860.052060:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851860.052061:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851860.052062:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851860.052062:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851860.052063:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851860.052063:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851860.052064:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.052064:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851860.052065:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.052066:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.052066:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851860.052066:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851860.052067:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851860.052067:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12883@kfi7, seq: 2130746
00000100:00000040:10.0:1773851860.052067:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000761dc406 : new rpc_count 1
00000100:00000001:11.0:1773851860.052068:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.052068:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064889088 : -106983644662528 : ffff9eb2eddcf500)
00000100:00000040:10.0:1773851860.052069:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005252f0a7 x1859833488011648/t0(0) o400->b3201d7d-753a-4f48-9f85-cc017c9fec47@12883@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1302-0'
00000100:00000001:10.0:1773851860.052071:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851860.052072:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851860.052072:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005252f0a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b3201d7d-753a-4f48-9f85-cc017c9fec47+167:39935:x1859833488011648:12345-12883@kfi7:400:default-tuolumne1302-0
00000100:00000200:10.0:1773851860.052073:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833488011648
00000020:00000001:10.0:1773851860.052074:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851860.052074:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851860.052075:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.052076:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851860.052076:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851860.052077:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851860.052077:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833488011648, found 0 last_xid 1859833487587903
00000020:00000001:10.0:1773851860.052078:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851860.052079:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851860.052079:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851860.052079:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.052080:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851860.052080:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851860.052081:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851860.052081:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004316cd48.
02000000:00000001:10.0:1773851860.052082:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.052082:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.052083:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851860.052083:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063187, transno 0, xid 1859833488011648
00010000:00000001:10.0:1773851860.052084:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851860.052085:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005252f0a7 x1859833488011648/t0(0) o400->b3201d7d-753a-4f48-9f85-cc017c9fec47@12883@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1302-0'
00010000:00000001:10.0:1773851860.052087:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851860.052087:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851860.052088:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851860.052089:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851860.052089:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008bdc6f17 refcount 3 to 12883@kfi7
00000100:00000001:10.0:1773851860.052090:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096896 : -107139307454720 : ffff9e8eafa33f00)
02000000:00000001:10.0:1773851860.052091:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851860.052091:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.052092:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851860.052092:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12882@kfi7
00000400:00000010:10.0:1773851860.052093:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c83a86b9.
00000100:00000200:10.0:1773851860.052093:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833488011648, offset 224
00000400:00000200:10.0:1773851860.052094:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12882@kfi7
00000400:00000200:10.0:1773851860.052095:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12882@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.052096:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c43689d4 nid 12882@kfi7 refs 1
00000400:00000200:10.0:1773851860.052097:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c43689d4 nid 12882@kfi7 refs 2
00000400:00000200:10.0:1773851860.052098:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c43689d4 nid 12882@kfi7 refs 3
00000400:00000200:10.0:1773851860.052099:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12882@kfi7 local destination
00000400:00000200:10.0:1773851860.052100:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768878:8768878:1024:4294967295] 12882@kfi7 LPNI seq info [248213:248213:16:4294967295]
00000400:00000200:10.0:1773851860.052102:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c43689d4 nid 12882@kfi7 refs 2
00000400:00000200:10.0:1773851860.052102:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12882@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.052104:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12882@kfi7(12882@kfi7:12882@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851860.052106:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c43689d4 nid 12882@kfi7 refs 3
00000800:00000200:10.0:1773851860.052107:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851860.052108:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851860.052110:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851860.052112:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fb9 Using peer 12882@kfi7(0x100000000000fb9)
00000800:00000200:10.0:1773851860.052115:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000005269f40f: Posted send of 324 bytes to peer 0x100000000000fb9: rc=0
00000800:00000200:10.0:1773851860.052116:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fb9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851860.052118:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851860.052118:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008bdc6f17 refcount 2 to 12883@kfi7
00010000:00000001:10.0:1773851860.052119:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851860.052119:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.052120:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851860.052120:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005252f0a7 x1859833488011648/t0(0) o400->b3201d7d-753a-4f48-9f85-cc017c9fec47@12883@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1302-0'
00000100:00100000:10.0:1773851860.052123:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005252f0a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b3201d7d-753a-4f48-9f85-cc017c9fec47+167:39935:x1859833488011648:12345-12883@kfi7:400:default-tuolumne1302-0 Request processed in 51us (76us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851860.052126:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12883@kfi7, seq: 2130746
00000100:00000040:10.0:1773851860.052127:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000761dc406 : new rpc_count 0
00000100:00000001:10.0:1773851860.052128:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851860.052128:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851860.052129:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851860.052129:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000800:00000200:9.0:1773851860.052129:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fb9 TN_EVENT_TX_OK event status 0
00000020:00000010:10.0:1773851860.052130:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef78f1a0.
00000400:00000200:9.0:1773851860.052130:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:10.0:1773851860.052131:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000761dc406 : new refcount 166
00000400:00000200:9.0:1773851860.052131:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12882@kfi7: PUT: OK
00000100:00000001:10.0:1773851860.052132:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851860.052132:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c83a86b9
00000400:00000010:9.0:1773851860.052132:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c83a86b9.
00000100:00000001:9.0:1773851860.052132:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851860.052133:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851860.052134:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c43689d4 nid 12882@kfi7 refs 2
00000800:00000200:9.0:1773851860.052135:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 12882@kfi7(000000008d87be9f):0x0 lsk 4026 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fb9 Transaction freed
00000800:00000200:29.0:1773851860.094318:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851860.094319:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851860.094320:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851860.094323:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851860.094325:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16528@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.094326:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16528@kfi7 : PUT - for me
00000400:00000200:29.0:1773851860.094327:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16528@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.094329:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 1
00000400:00000200:29.0:1773851860.094331:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16528@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.094332:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 2
00000400:00000200:29.0:1773851860.094333:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 3
00000400:00000200:29.0:1773851860.094334:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16464@kfi7 to cpt 3
00000400:00000200:29.0:1773851860.094335:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16464@kfi7 of length 224 into portal 12 MB=0x69b9db161cc80
00000400:00000200:29.0:1773851860.094336:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16464@kfi7 of length 224/224 into md 0x77fe139dd [64] + 167392
00000800:00000200:29.0:1773851860.094338:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851860.094340:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.094341:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16528@kfi7: PUT: OK
00000100:00000001:29.0:1773851860.094342:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851860.094343:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851860.094344:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b4c75ac7.
00000100:00000040:29.0:1773851860.094344:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000b4c75ac7 x1859951448411264 msgsize 224
00000100:00100000:29.0:1773851860.094346:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16464@kfi7 (source: 12345-16528@kfi7)
00000100:00000001:29.0:1773851860.094347:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851860.094348:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 2
00000100:00000001:28.0:1773851860.094349:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851860.094350:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851860.094350:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851860.094350:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851860.094351:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851860.094352:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851860.094354:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859951448411264
00000020:00000001:28.0:1773851860.094354:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851860.094355:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08c84530d85
00000020:00000001:28.0:1773851860.094355:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851860.094360:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005e67efc1 refcount=168
00000020:00000001:28.0:1773851860.094361:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637084583698432 : -106989125853184 : ffff9eb1a728a000)
00000020:00000001:28.0:1773851860.094361:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637084583698432 : -106989125853184 : ffff9eb1a728a000)
00000100:00000001:28.0:1773851860.094363:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851860.094364:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851860.094364:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aceb0722.
00000020:00000010:28.0:1773851860.094366:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851860.094366:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a24bde0f.
00000100:00000001:28.0:1773851860.094368:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851860.094368:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851860.094369:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851860.094370:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851860.094371:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851860.094371:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.094372:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851860.094374:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851860.094374:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851860.094374:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851860.094374:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851860.094376:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16464@kfi7, seq: 2055485
00000100:00000001:31.0:1773851860.094377:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851860.094377:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005e67efc1 : new rpc_count 1
00000100:00000001:28.0:1773851860.094377:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221541760 : -106948488009856 : ffff9ebb1d5ce780)
00000100:00000001:31.0:1773851860.094378:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851860.094379:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b4c75ac7 x1859951448411264/t0(0) o400->db05533a-8558-4472-97ff-ec2fc477b9b3@16464@kfi7:648/0 lens 224/0 e 0 to 0 dl 1773852008 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1522-0'
00000100:00000001:28.0:1773851860.094382:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851860.094382:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851860.094383:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b4c75ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:db05533a-8558-4472-97ff-ec2fc477b9b3+168:39685:x1859951448411264:12345-16464@kfi7:400:default-tuolumne1522-0
00000100:00000200:28.0:1773851860.094385:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859951448411264
00000020:00000001:28.0:1773851860.094386:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851860.094386:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851860.094388:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.094389:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851860.094389:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851860.094390:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851860.094391:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859951448411264, found 0 last_xid 1859951447985599
00000020:00000001:28.0:1773851860.094392:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851860.094392:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851860.094393:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851860.094393:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.094394:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851860.094395:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851860.094395:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851860.094396:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000047dc5ef9.
02000000:00000001:28.0:1773851860.094397:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.094398:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.094398:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851860.094399:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062552, transno 0, xid 1859951448411264
00010000:00000001:28.0:1773851860.094400:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851860.094401:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b4c75ac7 x1859951448411264/t0(0) o400->db05533a-8558-4472-97ff-ec2fc477b9b3@16464@kfi7:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1522-0'
00010000:00000001:28.0:1773851860.094404:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851860.094404:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851860.094405:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=93 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851860.094406:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851860.094407:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d31849a refcount 3 to 16464@kfi7
00000100:00000001:28.0:1773851860.094407:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148768 : -107154898402848 : ffff9e8b0e5841e0)
02000000:00000001:28.0:1773851860.094408:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851860.094409:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.094410:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851860.094411:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16528@kfi7
00000400:00000010:28.0:1773851860.094411:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000015fd77cc.
00000100:00000200:28.0:1773851860.094412:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859951448411264, offset 224
00000400:00000200:28.0:1773851860.094414:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16528@kfi7
00000400:00000200:28.0:1773851860.094415:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16528@kfi7 to cpt 7
00000400:00000200:28.0:1773851860.094416:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 1
00000400:00000200:28.0:1773851860.094417:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 2
00000400:00000200:28.0:1773851860.094419:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 3
00000400:00000200:28.0:1773851860.094420:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16528@kfi7 local destination
00000400:00000200:28.0:1773851860.094421:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768879:8768879:1024:4294967295] 16528@kfi7 LPNI seq info [935441:935441:16:4294967295]
00000400:00000200:28.0:1773851860.094423:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 2
00000400:00000200:28.0:1773851860.094423:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16528@kfi7 to cpt 7
00000400:00000200:28.0:1773851860.094425:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16528@kfi7(16528@kfi7:16528@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851860.094427:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 3
00000800:00000200:28.0:1773851860.094429:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851860.094430:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851860.094432:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851860.094435:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x338 Using peer 16528@kfi7(0x338)
00000800:00000200:28.0:1773851860.094438:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x338: rc=0
00000800:00000200:28.0:1773851860.094439:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x338 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851860.094441:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851860.094442:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d31849a refcount 2 to 16464@kfi7
00010000:00000001:28.0:1773851860.094443:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851860.094443:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.094444:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851860.094445:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b4c75ac7 x1859951448411264/t0(0) o400->db05533a-8558-4472-97ff-ec2fc477b9b3@16464@kfi7:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1522-0'
00000100:00100000:28.0:1773851860.094449:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b4c75ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:db05533a-8558-4472-97ff-ec2fc477b9b3+168:39685:x1859951448411264:12345-16464@kfi7:400:default-tuolumne1522-0 Request processed in 67us (104us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851860.094452:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16464@kfi7, seq: 2055485
00000100:00000040:28.0:1773851860.094453:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005e67efc1 : new rpc_count 0
00000100:00000001:28.0:1773851860.094456:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851860.094457:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851860.094457:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851860.094458:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a24bde0f.
00000020:00000010:28.0:1773851860.094459:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aceb0722.
00000020:00000040:28.0:1773851860.094460:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000005e67efc1 : new refcount 167
00000100:00000001:28.0:1773851860.094461:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851860.094466:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x338 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851860.094468:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.094469:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16528@kfi7: PUT: OK
00000400:00000200:29.0:1773851860.094470:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000015fd77cc
00000400:00000010:29.0:1773851860.094470:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000015fd77cc.
00000100:00000001:29.0:1773851860.094471:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851860.094472:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851860.094473:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fc8e7bb3 nid 16528@kfi7 refs 2
00000800:00000200:29.0:1773851860.094474:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 16528@kfi7(000000003f9c482d):0x0 lsk 825 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x338 Transaction freed
00000800:00000200:18.0:1773851860.101652:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.101652:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.101653:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.101653:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851860.101654:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.101654:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851860.101656:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851860.101657:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18433@kfi7(00000000c80b6fd8):0xccc version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851860.101658:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18433@kfi7 to cpt 4
00000800:00000200:17.0:1773851860.101658:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc Using peer 18433@kfi7(0xccc)
00000400:00000200:18.0:1773851860.101659:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18433@kfi7 : PUT - for me
00000400:00000200:17.0:1773851860.101660:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18433@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.101661:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18433@kfi7 to cpt 4
00000800:00000200:17.0:1773851860.101662:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0xccc: rc=0
00000400:00000200:18.0:1773851860.101663:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000283c7e75 nid 18433@kfi7 refs 1
00000400:00000200:18.0:1773851860.101664:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18433@kfi7 to cpt 4
00000800:00000200:17.0:1773851860.101664:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851860.101665:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000283c7e75 nid 18433@kfi7 refs 2
00000400:00000200:18.0:1773851860.101666:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000283c7e75 nid 18433@kfi7 refs 3
00000400:00000200:18.0:1773851860.101667:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18624@kfi7 to cpt 3
00000400:00000200:18.0:1773851860.101668:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18624@kfi7 of length 336 into portal 17 MB=0x69b4b58846e80
00000400:00000200:18.0:1773851860.101670:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-18624@kfi7 of length 336/336 into md 0x6ab0f7c31 [2] + 440
00000800:00000200:18.0:1773851860.101672:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851860.101673:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851860.101675:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18433@kfi7: PUT: OK
00000100:00000001:18.0:1773851860.101676:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851860.101676:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000800:00000200:17.0:1773851860.101676:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc TN_EVENT_TX_OK event status 0
00000100:00000010:18.0:1773851860.101677:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e7bf6343.
00000100:00000040:18.0:1773851860.101678:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000e7bf6343 x1859597770190464 msgsize 336
00000800:00000200:17.0:1773851860.101679:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc Transaction freed
00000100:00100000:18.0:1773851860.101680:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-18624@kfi7 (source: 12345-18433@kfi7)
00000100:00000001:18.0:1773851860.101681:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851860.101683:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000283c7e75 nid 18433@kfi7 refs 2
00000800:00000200:18.0:1773851860.101684:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000658b1b4a: 2069@kfi7:4 <- 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851860.101687:0:154717:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851860.101688:0:154717:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851860.101688:0:154717:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851860.101689:0:154717:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.101689:0:154717:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851860.101690:0:154717:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597770190464
00000020:00000001:18.0:1773851860.101691:0:154717:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851860.101691:0:154717:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d811c8
00000020:00000001:18.0:1773851860.101692:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.101695:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006ccb942d refcount=8
00000020:00000001:18.0:1773851860.101696:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143294815232 : -106930414736384 : ffff9ebf529d2c00)
00000020:00000001:18.0:1773851860.101697:0:154717:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143294815232 : -106930414736384 : ffff9ebf529d2c00)
00000100:00000001:18.0:1773851860.101698:0:154717:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.101699:0:154717:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851860.101699:0:154717:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f516f763.
00000020:00000010:18.0:1773851860.101701:0:154717:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.101701:0:154717:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000040:18.0:1773851860.101702:0:154717:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:18.0:1773851860.101703:0:154717:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851860.101704:0:154717:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:18.0:1773851860.101704:0:154717:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:18.0:1773851860.101705:0:154717:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101706:0:154717:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:18.0:1773851860.101707:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851860.101707:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.101708:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006bb1a52 refcount=3
00000020:00000001:18.0:1773851860.101709:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113902094528 : -106959807457088 : ffff9eb87aabd8c0)
00010000:00000001:18.0:1773851860.101710:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637113902094528 : -106959807457088 : ffff9eb87aabd8c0)
00010000:00000001:18.0:1773851860.101711:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101711:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101712:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851860.101712:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.101713:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003bc5e9c7 refcount=3
00000020:00000001:18.0:1773851860.101714:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113902097408 : -106959807454208 : ffff9eb87aabe400)
00010000:00000001:18.0:1773851860.101715:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637113902097408 : -106959807454208 : ffff9eb87aabe400)
00010000:00000001:18.0:1773851860.101715:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101715:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101716:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851860.101716:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.101717:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000072f2deef refcount=3
00000020:00000001:18.0:1773851860.101718:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637071917556160 : -107001791995456 : ffff9eaeb432a1c0)
00010000:00000001:18.0:1773851860.101718:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637071917556160 : -107001791995456 : ffff9eaeb432a1c0)
00010000:00000001:18.0:1773851860.101719:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101719:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101720:0:154717:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.101720:0:154717:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.101722:0:154717:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.101722:0:154717:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.101724:0:154220:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851860.101724:0:154717:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.101729:0:154220:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851860.101729:0:154717:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.101730:0:154717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18624@kfi7, seq: 38350202
00000100:00000001:19.0:1773851860.101731:0:154220:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.101731:0:154220:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.101731:0:154717:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006ccb942d : new rpc_count 1
00000100:00000001:18.0:1773851860.101731:0:154717:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534642304 : -106946174909312 : ffff9ebba73c0480)
00000100:00000040:18.0:1773851860.101732:0:154717:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e7bf6343 x1859597770190464/t0(0) o103->d842cce6-a601-4784-b3ca-ae1a7ffbcd4e@18624@kfi7:587/0 lens 336/0 e 0 to 0 dl 1773851947 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:18.0:1773851860.101735:0:154717:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.101736:0:154717:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.101737:0:154717:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7bf6343 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_011:d842cce6-a601-4784-b3ca-ae1a7ffbcd4e+8:39499:x1859597770190464:12345-18624@kfi7:103:
00000100:00000200:18.0:1773851860.101738:0:154717:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597770190464
00010000:00000001:18.0:1773851860.101739:0:154717:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:18.0:1773851860.101739:0:154717:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:18.0:1773851860.101740:0:154717:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:18.0:1773851860.101741:0:154717:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.101742:0:154717:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.101742:0:154717:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2d6dcb1.
02000000:00000001:18.0:1773851860.101743:0:154717:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.101744:0:154717:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101745:0:154717:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:18.0:1773851860.101745:0:154717:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00000001:18.0:1773851860.101746:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851860.101746:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.101747:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006bb1a52 refcount=3
00000020:00000001:18.0:1773851860.101747:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113902094528 : -106959807457088 : ffff9eb87aabd8c0)
00010000:00000001:18.0:1773851860.101748:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637113902094528 : -106959807457088 : ffff9eb87aabd8c0)
00010000:00000040:18.0:1773851860.101749:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 198
00000004:00000001:18.0:1773851860.101750:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851860.101750:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851860.101751:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851860.101752:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851860.101752:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.101753:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101755:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851860.101755:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851860.101756:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101757:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101757:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851860.101758:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851860.101759:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000006bb1a52 with handle 0x21b6f08f07a4d789 from hash
00010000:00000001:18.0:1773851860.101760:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851860.101760:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101761:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101761:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851860.101762:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851860.101762:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101763:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851860.101763:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851860.101764:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000006bb1a52/0x21b6f08f07a4d789 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 199 type: IBT gid 0 flags: 0x44a01000000000 nid: 18624@kfi7 remote: 0x235fb118a33c851e expref: 8 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851860.101767:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 198
00010000:00000040:18.0:1773851860.101768:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000006ccb942d : new locks_count 2
00000020:00000040:18.0:1773851860.101769:0:154717:0:(genops.c:882:class_export_put()) PUTting export 000000006ccb942d : new refcount 7
00010000:00000010:18.0:1773851860.101769:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000011a96d62.
00010000:00000040:18.0:1773851860.101770:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 197
00010000:00000001:18.0:1773851860.101771:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101771:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851860.101772:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.101772:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003bc5e9c7 refcount=3
00000020:00000001:18.0:1773851860.101773:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113902097408 : -106959807454208 : ffff9eb87aabe400)
00010000:00000001:18.0:1773851860.101773:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637113902097408 : -106959807454208 : ffff9eb87aabe400)
00010000:00000001:18.0:1773851860.101774:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851860.101775:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851860.101775:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:18.0:1773851860.101777:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851860.101778:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101778:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851860.101779:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 196
00010000:00000040:18.0:1773851860.101780:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 233
00000004:00000001:18.0:1773851860.101781:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851860.101781:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851860.101782:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851860.101782:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851860.101782:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.101783:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101784:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851860.101785:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851860.101785:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101785:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101786:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851860.101786:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851860.101787:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000003bc5e9c7 with handle 0x21b6f08f07a4d77b from hash
00010000:00000001:18.0:1773851860.101788:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851860.101788:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101788:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101789:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851860.101789:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851860.101790:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101791:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851860.101791:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851860.101792:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc5e9c7/0x21b6f08f07a4d77b lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 234 type: IBT gid 0 flags: 0x44a01000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84f4 expref: 7 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851860.101794:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 233
00010000:00000040:18.0:1773851860.101795:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000006ccb942d : new locks_count 1
00000020:00000040:18.0:1773851860.101795:0:154717:0:(genops.c:882:class_export_put()) PUTting export 000000006ccb942d : new refcount 6
00010000:00000010:18.0:1773851860.101796:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000dcf1e31d.
00010000:00000040:18.0:1773851860.101796:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 232
00010000:00000001:18.0:1773851860.101797:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101797:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851860.101797:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.101798:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000072f2deef refcount=3
00000020:00000001:18.0:1773851860.101798:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637071917556160 : -107001791995456 : ffff9eaeb432a1c0)
00010000:00000001:18.0:1773851860.101799:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637071917556160 : -107001791995456 : ffff9eaeb432a1c0)
00010000:00000001:18.0:1773851860.101800:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851860.101800:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851860.101800:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:18.0:1773851860.101801:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851860.101802:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101802:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851860.101803:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 231
00010000:00000040:18.0:1773851860.101804:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 198
00000004:00000001:18.0:1773851860.101804:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851860.101805:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851860.101805:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851860.101805:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851860.101806:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.101806:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101808:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851860.101808:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851860.101809:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101809:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101813:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851860.101813:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851860.101814:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000072f2deef with handle 0x21b6f08f07a4d75f from hash
00010000:00000001:18.0:1773851860.101814:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851860.101815:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851860.101815:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101815:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851860.101816:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851860.101816:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101817:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851860.101817:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851860.101818:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f2deef/0x21b6f08f07a4d75f lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 199 type: IBT gid 0 flags: 0x44a01000000000 nid: 18624@kfi7 remote: 0x235fb118a33c84ed expref: 6 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851860.101820:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 198
00010000:00000040:18.0:1773851860.101821:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000006ccb942d : new locks_count 0
00000020:00000040:18.0:1773851860.101822:0:154717:0:(genops.c:882:class_export_put()) PUTting export 000000006ccb942d : new refcount 5
00010000:00000010:18.0:1773851860.101822:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a8cf8c2c.
00010000:00000040:18.0:1773851860.101823:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 197
00010000:00000001:18.0:1773851860.101823:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851860.101824:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851860.101824:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851860.101824:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:18.0:1773851860.101825:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851860.101826:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101826:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851860.101827:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00010000:18.0:1773851860.101827:0:154717:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:18.0:1773851860.101828:0:154717:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=3 : 3 : 3)
00010000:00000001:18.0:1773851860.101829:0:154717:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.101829:0:154717:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.101830:0:154717:0:(import.c:1951:at_measured()) add 1 to 000000001a540702 time=114 v=66 (1 0 0 1)
00000100:00000001:18.0:1773851860.101831:0:154717:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.101832:0:154717:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003afb7d9c refcount 3 to 18624@kfi7
00000100:00000001:18.0:1773851860.101833:0:154717:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621696 : -107151221929920 : ffff9e8be97ac840)
02000000:00000001:18.0:1773851860.101834:0:154717:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.101834:0:154717:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.101835:0:154717:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.101836:0:154717:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18433@kfi7
00000400:00000010:18.0:1773851860.101836:0:154717:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000065b23f2b.
00000100:00000200:18.0:1773851860.101837:0:154717:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859597770190464, offset 224
00000400:00000200:18.0:1773851860.101839:0:154717:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18433@kfi7
00000400:00000200:18.0:1773851860.101840:0:154717:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18433@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.101840:0:154717:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000283c7e75 nid 18433@kfi7 refs 1
00000400:00000200:18.0:1773851860.101841:0:154717:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000283c7e75 nid 18433@kfi7 refs 2
00000400:00000200:18.0:1773851860.101843:0:154717:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000283c7e75 nid 18433@kfi7 refs 3
00000400:00000200:18.0:1773851860.101844:0:154717:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18433@kfi7 local destination
00000400:00000200:18.0:1773851860.101845:0:154717:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768880:8768880:1024:4294967295] 18433@kfi7 LPNI seq info [588399:588399:16:4294967295]
00000400:00000200:18.0:1773851860.101847:0:154717:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000283c7e75 nid 18433@kfi7 refs 2
00000400:00000200:18.0:1773851860.101848:0:154717:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18433@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.101850:0:154717:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18433@kfi7(18433@kfi7:18433@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.101851:0:154717:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000283c7e75 nid 18433@kfi7 refs 3
00000800:00000200:18.0:1773851860.101852:0:154717:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.101854:0:154717:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.101856:0:154717:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.101858:0:154717:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc Using peer 18433@kfi7(0xccc)
00000800:00000200:18.0:1773851860.101861:0:154717:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000658b1b4a: Posted send of 324 bytes to peer 0xccc: rc=0
00000800:00000200:18.0:1773851860.101862:0:154717:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.101864:0:154717:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.101865:0:154717:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003afb7d9c refcount 2 to 18624@kfi7
00010000:00000001:18.0:1773851860.101866:0:154717:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.101866:0:154717:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.101868:0:154717:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e7bf6343 x1859597770190464/t0(0) o103->d842cce6-a601-4784-b3ca-ae1a7ffbcd4e@18624@kfi7:587/0 lens 336/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:18.0:1773851860.101871:0:154717:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7bf6343 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_011:d842cce6-a601-4784-b3ca-ae1a7ffbcd4e+5:39499:x1859597770190464:12345-18624@kfi7:103: Request processed in 134us (192us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851860.101873:0:154717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18624@kfi7, seq: 38350202
00000100:00000040:18.0:1773851860.101874:0:154717:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006ccb942d : new rpc_count 0
00000100:00000001:18.0:1773851860.101874:0:154717:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851860.101874:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851860.101875:0:154717:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851860.101875:0:154717:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.101876:0:154717:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000400:00000200:17.0:1773851860.101876:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851860.101877:0:154717:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f516f763.
00000020:00000040:18.0:1773851860.101877:0:154717:0:(genops.c:882:class_export_put()) PUTting export 000000006ccb942d : new refcount 4
00000400:00000200:17.0:1773851860.101877:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18433@kfi7: PUT: OK
00000100:00000001:18.0:1773851860.101878:0:154717:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851860.101878:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000065b23f2b
00000400:00000010:17.0:1773851860.101878:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000065b23f2b.
00000100:00000001:17.0:1773851860.101879:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.101880:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851860.101880:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000283c7e75 nid 18433@kfi7 refs 2
00000800:00000200:17.0:1773851860.101882:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 18433@kfi7(00000000c80b6fd8):0x0 lsk 3277 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xccc Transaction freed
00000800:00000200:13.0:1773851860.102244:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.102245:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851860.102247:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851860.102249:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851860.102251:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16176@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.102252:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16176@kfi7 : PUT - for me
00000400:00000200:13.0:1773851860.102254:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16176@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.102254:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4ce3016 nid 16176@kfi7 refs 1
00000400:00000200:13.0:1773851860.102255:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16176@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.102256:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4ce3016 nid 16176@kfi7 refs 2
00000400:00000200:13.0:1773851860.102257:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b4ce3016 nid 16176@kfi7 refs 3
00000400:00000200:13.0:1773851860.102259:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16369@kfi7 to cpt 1
00000400:00000200:13.0:1773851860.102259:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16369@kfi7 of length 224 into portal 12 MB=0x69b4b7cca2540
00000400:00000200:13.0:1773851860.102261:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16369@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 21288
00000800:00000200:13.0:1773851860.102263:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851860.102265:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851860.102266:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16176@kfi7: PUT: OK
00000100:00000001:13.0:1773851860.102267:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851860.102267:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851860.102268:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059fca923.
00000100:00000040:13.0:1773851860.102269:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000059fca923 x1859598378739008 msgsize 224
00000100:00100000:13.0:1773851860.102270:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-16369@kfi7 (source: 12345-16176@kfi7)
00000100:00000001:13.0:1773851860.102271:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851860.102272:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b4ce3016 nid 16176@kfi7 refs 2
00000800:00000200:13.0:1773851860.102274:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851860.102276:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851860.102277:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851860.102278:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851860.102278:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851860.102279:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851860.102280:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598378739008
00000020:00000001:13.0:1773851860.102280:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851860.102281:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a5d
00000020:00000001:13.0:1773851860.102282:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851860.102285:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dc63ce62 refcount=167
00000020:00000001:13.0:1773851860.102286:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063872051200 : -107009837500416 : ffff9eacd4a5f800)
00000020:00000001:13.0:1773851860.102287:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637063872051200 : -107009837500416 : ffff9eacd4a5f800)
00000100:00000001:13.0:1773851860.102288:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851860.102289:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851860.102290:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b727378.
00000020:00000010:13.0:1773851860.102291:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851860.102291:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000000521e59.
00000100:00000001:13.0:1773851860.102293:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851860.102293:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851860.102294:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851860.102295:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851860.102295:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851860.102295:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.102296:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851860.102297:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.102298:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.102298:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851860.102298:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851860.102299:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16369@kfi7, seq: 2289801
00000100:00000040:13.0:1773851860.102299:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dc63ce62 : new rpc_count 1
00000100:00000001:15.0:1773851860.102300:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.102300:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.102300:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537155328 : -107002172396288 : ffff9eae9d862d00)
00000100:00000040:13.0:1773851860.102302:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000059fca923 x1859598378739008/t0(0) o400->efb7a0d9-e5bd-41be-b394-f0453992f74b@16369@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1501-0'
00000100:00000001:13.0:1773851860.102304:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851860.102305:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851860.102306:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059fca923 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:efb7a0d9-e5bd-41be-b394-f0453992f74b+167:39571:x1859598378739008:12345-16369@kfi7:400:default-tuolumne1501-0
00000100:00000200:13.0:1773851860.102307:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598378739008
00000020:00000001:13.0:1773851860.102308:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851860.102308:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851860.102309:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.102310:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851860.102310:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851860.102311:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851860.102311:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598378739008, found 0 last_xid 1859598378316927
00000020:00000001:13.0:1773851860.102312:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851860.102313:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851860.102313:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851860.102314:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.102315:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851860.102315:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851860.102316:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851860.102316:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d4247a6e.
02000000:00000001:13.0:1773851860.102318:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.102318:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.102319:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851860.102320:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062567, transno 0, xid 1859598378739008
00010000:00000001:13.0:1773851860.102321:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851860.102321:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000059fca923 x1859598378739008/t0(0) o400->efb7a0d9-e5bd-41be-b394-f0453992f74b@16369@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1501-0'
00010000:00000001:13.0:1773851860.102324:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851860.102325:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851860.102325:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851860.102327:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851860.102327:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006bd1299d refcount 3 to 16369@kfi7
00000100:00000001:13.0:1773851860.102328:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412576 : -107145304139040 : ffff9e8d4a351ae0)
02000000:00000001:13.0:1773851860.102329:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851860.102329:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.102330:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851860.102331:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16176@kfi7
00000400:00000010:13.0:1773851860.102331:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000920d03d0.
00000100:00000200:13.0:1773851860.102332:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598378739008, offset 224
00000400:00000200:13.0:1773851860.102334:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16176@kfi7
00000400:00000200:13.0:1773851860.102334:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16176@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.102335:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4ce3016 nid 16176@kfi7 refs 1
00000400:00000200:13.0:1773851860.102336:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b4ce3016 nid 16176@kfi7 refs 2
00000400:00000200:13.0:1773851860.102337:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b4ce3016 nid 16176@kfi7 refs 3
00000400:00000200:13.0:1773851860.102339:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16176@kfi7 local destination
00000400:00000200:13.0:1773851860.102340:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768881:8768881:1024:4294967295] 16176@kfi7 LPNI seq info [822464:822464:16:4294967295]
00000400:00000200:13.0:1773851860.102342:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b4ce3016 nid 16176@kfi7 refs 2
00000400:00000200:13.0:1773851860.102342:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16176@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.102345:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16176@kfi7(16176@kfi7:16176@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851860.102346:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b4ce3016 nid 16176@kfi7 refs 3
00000800:00000200:13.0:1773851860.102347:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.102348:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851860.102351:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851860.102353:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb04 Using peer 16176@kfi7(0xb04)
00000800:00000200:13.0:1773851860.102356:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 324 bytes to peer 0xb04: rc=0
00000800:00000200:13.0:1773851860.102358:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb04 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851860.102360:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851860.102361:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006bd1299d refcount 2 to 16369@kfi7
00010000:00000001:13.0:1773851860.102361:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851860.102362:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851860.102363:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851860.102363:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059fca923 x1859598378739008/t0(0) o400->efb7a0d9-e5bd-41be-b394-f0453992f74b@16369@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1501-0'
00000100:00100000:13.0:1773851860.102366:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059fca923 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:efb7a0d9-e5bd-41be-b394-f0453992f74b+167:39571:x1859598378739008:12345-16369@kfi7:400:default-tuolumne1501-0 Request processed in 61us (97us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851860.102368:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16369@kfi7, seq: 2289801
00000100:00000040:13.0:1773851860.102369:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dc63ce62 : new rpc_count 0
00000800:00000200:14.0:1773851860.102370:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb04 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851860.102370:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851860.102371:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851860.102371:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851860.102372:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851860.102372:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000000521e59.
00000400:00000200:14.0:1773851860.102373:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16176@kfi7: PUT: OK
00000400:00000200:14.0:1773851860.102373:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000920d03d0
00000020:00000010:13.0:1773851860.102373:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b727378.
00000020:00000040:13.0:1773851860.102373:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000dc63ce62 : new refcount 166
00000400:00000010:14.0:1773851860.102374:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000920d03d0.
00000100:00000001:14.0:1773851860.102374:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851860.102374:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851860.102375:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851860.102376:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b4ce3016 nid 16176@kfi7 refs 2
00000800:00000200:14.0:1773851860.102377:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 16176@kfi7(00000000b18e0d91):0x0 lsk 2821 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb04 Transaction freed
00000800:00000200:30.0:1773851860.104220:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851860.104221:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851860.104223:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851860.104225:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851860.104227:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15363@kfi7 to cpt 7
00000400:00000200:30.0:1773851860.104228:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15363@kfi7 : PUT - for me
00000400:00000200:30.0:1773851860.104230:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15363@kfi7 to cpt 7
00000400:00000200:30.0:1773851860.104231:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 1
00000400:00000200:30.0:1773851860.104232:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15363@kfi7 to cpt 7
00000400:00000200:30.0:1773851860.104232:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 2
00000400:00000200:30.0:1773851860.104233:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 3
00000400:00000200:30.0:1773851860.104234:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15554@kfi7 to cpt 6
00000400:00000200:30.0:1773851860.104235:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15554@kfi7 of length 224 into portal 12 MB=0x69b4b58bdfd00
00000400:00000200:30.0:1773851860.104236:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15554@kfi7 of length 224/224 into md 0x77fe139dd [64] + 167616
00000800:00000200:30.0:1773851860.104239:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851860.104242:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851860.104243:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15363@kfi7: PUT: OK
00000100:00000001:30.0:1773851860.104244:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851860.104245:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851860.104246:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d1f7d67d.
00000100:00000040:30.0:1773851860.104247:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000d1f7d67d x1859597773962496 msgsize 224
00000100:00100000:30.0:1773851860.104248:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-15554@kfi7 (source: 12345-15363@kfi7)
00000100:00000001:30.0:1773851860.104249:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851860.104250:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 2
00000800:00000200:30.0:1773851860.104252:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851860.104252:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851860.104253:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851860.104254:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851860.104255:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851860.104256:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851860.104257:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597773962496
00000020:00000001:28.0:1773851860.104258:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851860.104259:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2464dcac
00000020:00000001:28.0:1773851860.104260:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851860.104264:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b08f6c9 refcount=170
00000020:00000001:28.0:1773851860.104265:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118009913344 : -106955699638272 : ffff9eb96f843000)
00000020:00000001:28.0:1773851860.104266:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118009913344 : -106955699638272 : ffff9eb96f843000)
00000100:00000001:28.0:1773851860.104268:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851860.104269:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851860.104270:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aceb0722.
00000020:00000010:28.0:1773851860.104272:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851860.104273:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a24bde0f.
00000100:00000001:28.0:1773851860.104274:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851860.104275:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851860.104276:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851860.104278:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851860.104278:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851860.104279:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.104281:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851860.104283:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851860.104283:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851860.104283:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851860.104284:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851860.104285:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15554@kfi7, seq: 2055486
00000100:00000001:31.0:1773851860.104286:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851860.104286:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b08f6c9 : new rpc_count 1
00000100:00000001:31.0:1773851860.104288:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.104288:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832824576 : -106933876727040 : ffff9ebe84436300)
00000100:00000040:28.0:1773851860.104290:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d1f7d67d x1859597773962496/t0(0) o400->c4ed6125-07eb-4cb8-a1f7-1a36ae253e22@15554@kfi7:648/0 lens 224/0 e 0 to 0 dl 1773852008 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1463-0'
00000100:00000001:28.0:1773851860.104295:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851860.104295:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851860.104297:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1f7d67d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c4ed6125-07eb-4cb8-a1f7-1a36ae253e22+170:39508:x1859597773962496:12345-15554@kfi7:400:default-tuolumne1463-0
00000100:00000200:28.0:1773851860.104299:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597773962496
00000020:00000001:28.0:1773851860.104300:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851860.104301:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851860.104302:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.104303:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851860.104304:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851860.104305:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851860.104306:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597773962496, found 0 last_xid 1859597773536511
00000020:00000001:28.0:1773851860.104307:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851860.104308:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851860.104309:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851860.104310:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.104311:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851860.104312:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851860.104312:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851860.104313:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004846a21a.
02000000:00000001:28.0:1773851860.104314:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.104315:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.104317:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851860.104318:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062577, transno 0, xid 1859597773962496
00010000:00000001:28.0:1773851860.104319:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851860.104320:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d1f7d67d x1859597773962496/t0(0) o400->c4ed6125-07eb-4cb8-a1f7-1a36ae253e22@15554@kfi7:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1463-0'
00010000:00000001:28.0:1773851860.104325:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851860.104325:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851860.104327:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=93 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851860.104329:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851860.104330:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006cfced2 refcount 3 to 15554@kfi7
00000100:00000001:28.0:1773851860.104332:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329760 : -107155410221856 : ffff9e8aefd684e0)
02000000:00000001:28.0:1773851860.104333:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851860.104334:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.104335:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851860.104336:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15363@kfi7
00000400:00000010:28.0:1773851860.104337:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000074a7a0bc.
00000100:00000200:28.0:1773851860.104338:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597773962496, offset 224
00000400:00000200:28.0:1773851860.104340:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15363@kfi7
00000400:00000200:28.0:1773851860.104342:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15363@kfi7 to cpt 7
00000400:00000200:28.0:1773851860.104343:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 1
00000400:00000200:28.0:1773851860.104344:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 2
00000400:00000200:28.0:1773851860.104347:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 3
00000400:00000200:28.0:1773851860.104348:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15363@kfi7 local destination
00000400:00000200:28.0:1773851860.104351:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768882:8768882:1024:4294967295] 15363@kfi7 LPNI seq info [473956:473956:16:4294967295]
00000400:00000200:28.0:1773851860.104353:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 2
00000400:00000200:28.0:1773851860.104354:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15363@kfi7 to cpt 7
00000400:00000200:28.0:1773851860.104357:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15363@kfi7(15363@kfi7:15363@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851860.104359:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 3
00000800:00000200:28.0:1773851860.104361:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851860.104363:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851860.104367:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851860.104371:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e1b Using peer 15363@kfi7(0x100000000000e1b)
00000800:00000200:28.0:1773851860.104375:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x100000000000e1b: rc=0
00000800:00000200:28.0:1773851860.104378:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e1b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851860.104381:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851860.104383:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006cfced2 refcount 2 to 15554@kfi7
00010000:00000001:28.0:1773851860.104386:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851860.104387:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.104388:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851860.104389:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d1f7d67d x1859597773962496/t0(0) o400->c4ed6125-07eb-4cb8-a1f7-1a36ae253e22@15554@kfi7:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1463-0'
00000100:00100000:28.0:1773851860.104395:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1f7d67d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c4ed6125-07eb-4cb8-a1f7-1a36ae253e22+170:39508:x1859597773962496:12345-15554@kfi7:400:default-tuolumne1463-0 Request processed in 99us (147us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851860.104398:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15554@kfi7, seq: 2055486
00000100:00000040:28.0:1773851860.104400:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b08f6c9 : new rpc_count 0
00000100:00000001:28.0:1773851860.104401:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851860.104402:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851860.104403:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851860.104404:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a24bde0f.
00000020:00000010:28.0:1773851860.104405:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aceb0722.
00000020:00000040:28.0:1773851860.104406:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000004b08f6c9 : new refcount 169
00000100:00000001:28.0:1773851860.104407:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851860.104414:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e1b TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851860.104415:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851860.104416:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15363@kfi7: PUT: OK
00000400:00000200:30.0:1773851860.104417:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000074a7a0bc
00000400:00000010:30.0:1773851860.104418:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000074a7a0bc.
00000100:00000001:30.0:1773851860.104418:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851860.104419:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851860.104420:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f7dae2e1 nid 15363@kfi7 refs 2
00000800:00000200:30.0:1773851860.104421:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15363@kfi7(00000000a390d146):0x0 lsk 3612 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e1b Transaction freed
00010000:00000001:2.0:1773851860.105732:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105733:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851860.105734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851860.105735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851860.105736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851860.105737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851860.105738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851860.105739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851860.105741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851860.105741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.105744:0:937836:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851860.105745:0:937836:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851860.105746:0:937836:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00000010:18.1:1773851860.107727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000006bb1a52.
00010000:00000010:18.1:1773851860.107729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000003bc5e9c7.
00010000:00000010:18.1:1773851860.107729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000072f2deef.
00000800:00000200:18.0:1773851860.109613:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.109614:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851860.109615:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851860.109617:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851860.109619:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16993@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.109620:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16993@kfi7 : PUT - for me
00000400:00000200:18.0:1773851860.109622:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16993@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.109622:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007f50754 nid 16993@kfi7 refs 1
00000400:00000200:18.0:1773851860.109624:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16993@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.109624:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007f50754 nid 16993@kfi7 refs 2
00000400:00000200:18.0:1773851860.109625:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007f50754 nid 16993@kfi7 refs 3
00000400:00000200:18.0:1773851860.109626:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16993@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.109627:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16993@kfi7 of length 224 into portal 12 MB=0x69b4b5c65cd00
00000400:00000200:18.0:1773851860.109629:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16993@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 0
00000800:00000200:18.0:1773851860.109631:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851860.109644:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851860.109645:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16993@kfi7: PUT: OK
00000100:00000001:18.0:1773851860.109647:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851860.109647:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851860.109648:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076ac17f7.
00000100:00000040:18.0:1773851860.109648:0:2507147:0:(events.c:358:request_in_callback()) incoming req@0000000076ac17f7 x1859597835291904 msgsize 224
00000100:00100000:18.0:1773851860.109650:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-16993@kfi7 (source: 12345-16993@kfi7)
00000100:00000001:18.0:1773851860.109651:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851860.109652:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007f50754 nid 16993@kfi7 refs 2
00000100:00000001:19.0:1773851860.109654:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851860.109654:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a37ded: 2054@kfi7:4 <- 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851860.109655:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851860.109656:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851860.109657:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851860.109658:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851860.109659:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597835291904
00000020:00000001:19.0:1773851860.109660:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851860.109661:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f853
00000020:00000001:19.0:1773851860.109662:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851860.109665:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000034af3316 refcount=167
00000020:00000001:19.0:1773851860.109666:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636975176053760 : -107098533497856 : ffff9e982df47400)
00000020:00000001:19.0:1773851860.109668:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636975176053760 : -107098533497856 : ffff9e982df47400)
00000100:00000001:19.0:1773851860.109669:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851860.109671:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851860.109672:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000013afd4e8.
00000020:00000010:19.0:1773851860.109673:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851860.109675:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000dfc0cad.
00000100:00000001:19.0:1773851860.109676:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851860.109677:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851860.109678:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.109680:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851860.109681:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851860.109681:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.109683:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.109684:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.109685:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851860.109685:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851860.109686:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.109686:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16993@kfi7, seq: 2156282
00000100:00000001:19.0:1773851860.109687:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.109687:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000034af3316 : new rpc_count 1
00000100:00000001:19.0:1773851860.109688:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.109688:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534660736 : -106946174890880 : ffff9ebba73c4c80)
00000100:00000040:18.0:1773851860.109689:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000076ac17f7 x1859597835291904/t0(0) o400->c9bd2fce-cb80-40b0-b511-2a3a04231025@16993@kfi7:50/0 lens 224/0 e 0 to 0 dl 1773852165 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1552-0'
00000100:00000001:18.0:1773851860.109692:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.109692:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.109693:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076ac17f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:c9bd2fce-cb80-40b0-b511-2a3a04231025+167:39691:x1859597835291904:12345-16993@kfi7:400:default-tuolumne1552-0
00000100:00000200:18.0:1773851860.109694:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597835291904
00000020:00000001:18.0:1773851860.109695:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851860.109696:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851860.109696:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.109697:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851860.109698:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851860.109698:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851860.109699:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597835291904, found 0 last_xid 1859597834869247
00000020:00000001:18.0:1773851860.109700:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851860.109701:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851860.109701:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851860.109702:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.109703:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851860.109703:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.109704:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.109704:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f516f763.
02000000:00000001:18.0:1773851860.109705:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.109706:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.109707:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851860.109707:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063290, transno 0, xid 1859597835291904
00010000:00000001:18.0:1773851860.109708:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851860.109709:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000076ac17f7 x1859597835291904/t0(0) o400->c9bd2fce-cb80-40b0-b511-2a3a04231025@16993@kfi7:50/0 lens 224/224 e 0 to 0 dl 1773852165 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1552-0'
00010000:00000001:18.0:1773851860.109711:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.109712:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.109713:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851860.109714:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.109714:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fea7dbf3 refcount 3 to 16993@kfi7
00000100:00000001:18.0:1773851860.109715:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516224 : -107156126035392 : ffff9e8ac52c1240)
02000000:00000001:18.0:1773851860.109716:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.109716:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.109717:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.109718:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16993@kfi7
00000400:00000010:18.0:1773851860.109718:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005732d1a1.
00000100:00000200:18.0:1773851860.109719:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597835291904, offset 224
00000400:00000200:18.0:1773851860.109720:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16993@kfi7
00000400:00000200:18.0:1773851860.109721:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16993@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.109722:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007f50754 nid 16993@kfi7 refs 1
00000400:00000200:18.0:1773851860.109723:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007f50754 nid 16993@kfi7 refs 2
00000400:00000200:18.0:1773851860.109724:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007f50754 nid 16993@kfi7 refs 3
00000400:00000200:18.0:1773851860.109728:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16993@kfi7 local destination
00000400:00000200:18.0:1773851860.109729:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768883:8768883:1024:4294967295] 16993@kfi7 LPNI seq info [207202:207202:16:4294967295]
00000400:00000200:18.0:1773851860.109730:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007f50754 nid 16993@kfi7 refs 2
00000400:00000200:18.0:1773851860.109731:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16993@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.109733:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16993@kfi7(16993@kfi7:16993@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.109734:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007f50754 nid 16993@kfi7 refs 3
00000800:00000200:18.0:1773851860.109735:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.109736:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.109738:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.109740:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000001f2 Using peer 16993@kfi7(0x1000000000001f2)
00000800:00000200:18.0:1773851860.109743:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000b4a37ded: Posted send of 324 bytes to peer 0x1000000000001f2: rc=0
00000800:00000200:18.0:1773851860.109745:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000001f2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.109747:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.109747:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fea7dbf3 refcount 2 to 16993@kfi7
00010000:00000001:18.0:1773851860.109748:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851860.109749:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.109750:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851860.109750:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000076ac17f7 x1859597835291904/t0(0) o400->c9bd2fce-cb80-40b0-b511-2a3a04231025@16993@kfi7:50/0 lens 224/224 e 0 to 0 dl 1773852165 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1552-0'
00000100:00100000:18.0:1773851860.109753:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076ac17f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:c9bd2fce-cb80-40b0-b511-2a3a04231025+167:39691:x1859597835291904:12345-16993@kfi7:400:default-tuolumne1552-0 Request processed in 61us (104us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851860.109755:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16993@kfi7, seq: 2156282
00000100:00000040:18.0:1773851860.109756:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000034af3316 : new rpc_count 0
00000100:00000001:18.0:1773851860.109757:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851860.109757:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851860.109758:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:18.0:1773851860.109759:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000dfc0cad.
00000020:00000010:18.0:1773851860.109760:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000013afd4e8.
00000020:00000040:18.0:1773851860.109760:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000034af3316 : new refcount 166
00000800:00000200:17.0:1773851860.109761:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000001f2 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851860.109762:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851860.109764:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.109766:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16993@kfi7: PUT: OK
00000400:00000200:17.0:1773851860.109767:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005732d1a1
00000400:00000010:17.0:1773851860.109768:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005732d1a1.
00000100:00000001:17.0:1773851860.109769:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.109769:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851860.109771:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007f50754 nid 16993@kfi7 refs 2
00000800:00000200:17.0:1773851860.109774:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 16993@kfi7(0000000097b1c373):0x0 lsk 499 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000001f2 Transaction freed
00000800:00000200:5.0:1773851860.109852:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.109853:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851860.109855:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851860.109859:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851860.109862:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15251@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.109864:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15251@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.109866:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15251@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.109867:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006472d0b2 nid 15251@kfi7 refs 1
00000400:00000200:5.0:1773851860.109868:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15251@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.109869:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006472d0b2 nid 15251@kfi7 refs 2
00000400:00000200:5.0:1773851860.109871:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006472d0b2 nid 15251@kfi7 refs 3
00000400:00000200:5.0:1773851860.109872:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15251@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.109874:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15251@kfi7 of length 224 into portal 12 MB=0x69a702ae47d40
00000400:00000200:5.0:1773851860.109876:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15251@kfi7 of length 224/224 into md 0x793926dc5 [64] + 126488
00000800:00000200:5.0:1773851860.109879:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851860.109882:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.109883:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15251@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.109885:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851860.109886:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851860.109888:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0cf12ab.
00000100:00000040:5.0:1773851860.109889:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a0cf12ab x1858656406895936 msgsize 224
00000100:00100000:5.0:1773851860.109891:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-15251@kfi7 (source: 12345-15251@kfi7)
00000100:00000001:5.0:1773851860.109893:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851860.109894:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006472d0b2 nid 15251@kfi7 refs 2
00000100:00000001:7.0:1773851860.109895:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851860.109896:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851860.109896:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851860.109897:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851860.109897:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851860.109899:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.109900:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858656406895936
00000020:00000001:7.0:1773851860.109901:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.109901:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91906
00000020:00000001:7.0:1773851860.109902:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.109905:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f1df9cc refcount=170
00000020:00000001:7.0:1773851860.109907:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241963520 : -107152467588096 : ffff9e8b9f3b8c00)
00000020:00000001:7.0:1773851860.109908:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241963520 : -107152467588096 : ffff9e8b9f3b8c00)
00000100:00000001:7.0:1773851860.109909:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.109911:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.109912:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db8fd2ed.
00000020:00000010:7.0:1773851860.109913:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851860.109915:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851860.109916:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.109916:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.109917:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.109919:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.109919:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.109920:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.109922:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.109924:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851860.109924:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.109925:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851860.109925:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851860.109926:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15251@kfi7, seq: 2001878
00000100:00000040:7.0:1773851860.109927:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f1df9cc : new rpc_count 1
00000100:00000001:7.0:1773851860.109928:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866949120 : -107088842602496 : ffff9e9a6f93c800)
00000100:00000001:6.0:1773851860.109928:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851860.109929:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.109930:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a0cf12ab x1858656406895936/t0(0) o400->6aea1e98-c793-44b2-819e-483a27f3a444@15251@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1446-0'
00000100:00000001:7.0:1773851860.109935:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.109936:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.109937:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0cf12ab pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6aea1e98-c793-44b2-819e-483a27f3a444+170:39655:x1858656406895936:12345-15251@kfi7:400:default-tuolumne1446-0
00000100:00000200:7.0:1773851860.109939:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858656406895936
00000020:00000001:7.0:1773851860.109940:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.109941:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.109942:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.109943:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.109944:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.109945:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.109946:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858656406895936, found 0 last_xid 1858656406470015
00000020:00000001:7.0:1773851860.109947:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.109949:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.109949:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.109950:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.109951:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.109952:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.109953:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.109954:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000058b791f.
02000000:00000001:7.0:1773851860.109955:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.109956:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.109957:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.109958:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061889, transno 0, xid 1858656406895936
00010000:00000001:7.0:1773851860.109959:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.109960:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a0cf12ab x1858656406895936/t0(0) o400->6aea1e98-c793-44b2-819e-483a27f3a444@15251@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1446-0'
00010000:00000001:7.0:1773851860.109964:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.109965:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.109966:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.109968:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.109969:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004e83728e refcount 3 to 15251@kfi7
00000100:00000001:7.0:1773851860.109970:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704320 : -107156155847296 : ffff9e8ac3652d80)
02000000:00000001:7.0:1773851860.109972:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.109972:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.109973:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.109975:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15251@kfi7
00000400:00000010:7.0:1773851860.109976:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c188dd4f.
00000100:00000200:7.0:1773851860.109977:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858656406895936, offset 224
00000400:00000200:7.0:1773851860.109979:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15251@kfi7
00000400:00000200:7.0:1773851860.109980:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15251@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.109982:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006472d0b2 nid 15251@kfi7 refs 1
00000400:00000200:7.0:1773851860.109983:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006472d0b2 nid 15251@kfi7 refs 2
00000400:00000200:7.0:1773851860.109985:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006472d0b2 nid 15251@kfi7 refs 3
00000400:00000200:7.0:1773851860.109987:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15251@kfi7 local destination
00000400:00000200:7.0:1773851860.109989:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768884:8768884:1024:4294967295] 15251@kfi7 LPNI seq info [349934:349934:16:4294967295]
00000400:00000200:7.0:1773851860.109991:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006472d0b2 nid 15251@kfi7 refs 2
00000400:00000200:7.0:1773851860.109992:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15251@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.109996:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15251@kfi7(15251@kfi7:15251@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.109998:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006472d0b2 nid 15251@kfi7 refs 3
00000800:00000200:7.0:1773851860.110000:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.110002:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.110005:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.110009:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x612 Using peer 15251@kfi7(0x612)
00000800:00000200:7.0:1773851860.110014:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x612: rc=0
00000800:00000200:7.0:1773851860.110016:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x612 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.110020:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.110022:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004e83728e refcount 2 to 15251@kfi7
00010000:00000001:7.0:1773851860.110023:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.110024:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.110026:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.110028:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0cf12ab x1858656406895936/t0(0) o400->6aea1e98-c793-44b2-819e-483a27f3a444@15251@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1446-0'
00000800:00000200:5.0:1773851860.110029:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x612 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851860.110031:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.110033:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15251@kfi7: PUT: OK
00000100:00100000:7.0:1773851860.110034:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0cf12ab pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6aea1e98-c793-44b2-819e-483a27f3a444+170:39655:x1858656406895936:12345-15251@kfi7:400:default-tuolumne1446-0 Request processed in 97us (144us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851860.110034:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c188dd4f
00000400:00000010:5.0:1773851860.110035:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c188dd4f.
00000100:00000001:5.0:1773851860.110037:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851860.110037:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:7.0:1773851860.110038:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15251@kfi7, seq: 2001878
00000100:00000040:7.0:1773851860.110039:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f1df9cc : new rpc_count 0
00000400:00000200:5.0:1773851860.110039:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006472d0b2 nid 15251@kfi7 refs 2
00000100:00000001:7.0:1773851860.110041:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851860.110041:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 15251@kfi7(00000000b9625198):0x0 lsk 1555 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x612 Transaction freed
00000100:00000001:7.0:1773851860.110042:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851860.110043:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851860.110044:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000020:00000010:7.0:1773851860.110046:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db8fd2ed.
00000020:00000040:7.0:1773851860.110047:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000004f1df9cc : new refcount 169
00000100:00000001:7.0:1773851860.110048:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851860.116640:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.116640:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.116641:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.116644:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.116646:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18818@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.116647:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18818@kfi7 : PUT - for me
00000400:00000200:17.0:1773851860.116648:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18818@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.116649:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c812a927 nid 18818@kfi7 refs 1
00000400:00000200:17.0:1773851860.116650:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18818@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.116650:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c812a927 nid 18818@kfi7 refs 2
00000400:00000200:17.0:1773851860.116651:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c812a927 nid 18818@kfi7 refs 3
00000400:00000200:17.0:1773851860.116652:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18819@kfi7 to cpt 7
00000400:00000200:17.0:1773851860.116653:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18819@kfi7 of length 224 into portal 12 MB=0x69b8199b3a300
00000400:00000200:17.0:1773851860.116654:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18819@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 224
00000800:00000200:17.0:1773851860.116655:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.116657:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.116658:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18818@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.116659:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.116660:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.116660:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005182f247.
00000100:00000040:17.0:1773851860.116661:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000005182f247 x1859830792037120 msgsize 224
00000100:00100000:17.0:1773851860.116662:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18819@kfi7 (source: 12345-18818@kfi7)
00000100:00000001:17.0:1773851860.116663:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.116664:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c812a927 nid 18818@kfi7 refs 2
00000100:00000001:18.0:1773851860.116665:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851860.116665:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851860.116666:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851860.116666:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851860.116667:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.116667:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851860.116668:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830792037120
00000020:00000001:18.0:1773851860.116669:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851860.116669:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce2f17e
00000020:00000001:18.0:1773851860.116670:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.116673:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b82e6ccf refcount=5
00000020:00000001:18.0:1773851860.116674:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123426244608 : -106950283307008 : ffff9ebab25ad800)
00000020:00000001:18.0:1773851860.116674:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123426244608 : -106950283307008 : ffff9ebab25ad800)
00000100:00000001:18.0:1773851860.116675:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.116676:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851860.116677:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddcf4a2a.
00000020:00000010:18.0:1773851860.116678:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.116679:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851860.116680:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851860.116680:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851860.116680:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.116681:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851860.116682:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851860.116682:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.116683:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.116684:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.116685:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.116685:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851860.116685:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.116686:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18819@kfi7, seq: 2156283
00000100:00000040:18.0:1773851860.116686:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b82e6ccf : new rpc_count 1
00000100:00000001:19.0:1773851860.116687:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.116687:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.116687:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764350592 : -107095945201024 : ffff9e98c83aba80)
00000100:00000040:18.0:1773851860.116688:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005182f247 x1859830792037120/t0(0) o400->3bdfe345-954d-4516-a733-9003cac8c4d6@18819@kfi7:50/0 lens 224/0 e 0 to 0 dl 1773852165 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1672-0'
00000100:00000001:18.0:1773851860.116691:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.116691:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.116692:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005182f247 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:3bdfe345-954d-4516-a733-9003cac8c4d6+5:39470:x1859830792037120:12345-18819@kfi7:400:default-tuolumne1672-0
00000100:00000200:18.0:1773851860.116694:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830792037120
00000020:00000001:18.0:1773851860.116694:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851860.116695:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851860.116695:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.116696:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851860.116697:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851860.116697:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851860.116698:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830792037120, found 0 last_xid 1859830792037119
00000020:00000001:18.0:1773851860.116699:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851860.116699:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851860.116700:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851860.116700:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.116701:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851860.116701:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.116702:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.116703:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f073570c.
02000000:00000001:18.0:1773851860.116703:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.116704:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.116705:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851860.116705:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096682341, transno 0, xid 1859830792037120
00010000:00000001:18.0:1773851860.116706:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851860.116707:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005182f247 x1859830792037120/t0(0) o400->3bdfe345-954d-4516-a733-9003cac8c4d6@18819@kfi7:50/0 lens 224/224 e 0 to 0 dl 1773852165 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1672-0'
00010000:00000001:18.0:1773851860.116709:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.116710:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.116711:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851860.116711:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.116712:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e3378fd3 refcount 3 to 18819@kfi7
00000100:00000001:18.0:1773851860.116713:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065760 : -107155994485856 : ffff9e8acd035ba0)
02000000:00000001:18.0:1773851860.116714:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.116714:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.116715:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.116716:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18818@kfi7
00000400:00000010:18.0:1773851860.116717:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c1f7852f.
00000100:00000200:18.0:1773851860.116717:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830792037120, offset 224
00000400:00000200:18.0:1773851860.116719:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18818@kfi7
00000400:00000200:18.0:1773851860.116719:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18818@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.116720:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c812a927 nid 18818@kfi7 refs 1
00000400:00000200:18.0:1773851860.116721:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c812a927 nid 18818@kfi7 refs 2
00000400:00000200:18.0:1773851860.116722:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c812a927 nid 18818@kfi7 refs 3
00000400:00000200:18.0:1773851860.116723:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18818@kfi7 local destination
00000400:00000200:18.0:1773851860.116724:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768885:8768885:1024:4294967295] 18818@kfi7 LPNI seq info [598470:598470:16:4294967295]
00000400:00000200:18.0:1773851860.116728:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c812a927 nid 18818@kfi7 refs 2
00000400:00000200:18.0:1773851860.116729:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18818@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.116730:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18818@kfi7(18818@kfi7:18818@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.116731:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c812a927 nid 18818@kfi7 refs 3
00000800:00000200:18.0:1773851860.116733:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.116734:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.116736:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.116738:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000137 Using peer 18818@kfi7(0x100000000000137)
00000800:00000200:18.0:1773851860.116741:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000b4a37ded: Posted send of 324 bytes to peer 0x100000000000137: rc=0
00000800:00000200:18.0:1773851860.116742:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000137 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.116744:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.116744:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e3378fd3 refcount 2 to 18819@kfi7
00010000:00000001:18.0:1773851860.116745:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851860.116746:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.116746:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851860.116747:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005182f247 x1859830792037120/t0(0) o400->3bdfe345-954d-4516-a733-9003cac8c4d6@18819@kfi7:50/0 lens 224/224 e 0 to 0 dl 1773852165 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1672-0'
00000100:00100000:18.0:1773851860.116753:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005182f247 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:3bdfe345-954d-4516-a733-9003cac8c4d6+5:39470:x1859830792037120:12345-18819@kfi7:400:default-tuolumne1672-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851860.116753:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000137 TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851860.116755:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18819@kfi7, seq: 2156283
00000400:00000200:17.0:1773851860.116755:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:18.0:1773851860.116756:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b82e6ccf : new rpc_count 0
00000400:00000200:17.0:1773851860.116756:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18818@kfi7: PUT: OK
00000100:00000001:18.0:1773851860.116757:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851860.116757:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851860.116757:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c1f7852f
00000400:00000010:17.0:1773851860.116757:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c1f7852f.
00000020:00000010:18.0:1773851860.116758:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.116758:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000100:00000001:17.0:1773851860.116758:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.116758:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:18.0:1773851860.116759:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddcf4a2a.
00000400:00000200:17.0:1773851860.116759:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c812a927 nid 18818@kfi7 refs 2
00000020:00000040:18.0:1773851860.116760:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b82e6ccf : new refcount 4
00000800:00000200:17.0:1773851860.116760:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a37ded: 2054@kfi7:4 -> 18818@kfi7(00000000d2d42ae8):0x0 lsk 312 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000137 Transaction freed
00000100:00000001:18.0:1773851860.116761:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851860.123146:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851860.123147:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851860.123148:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851860.123150:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851860.123153:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14531@kfi7 to cpt 0
00000400:00000200:2.0:1773851860.123154:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14531@kfi7 : PUT - for me
00000400:00000200:2.0:1773851860.123155:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14531@kfi7 to cpt 0
00000400:00000200:2.0:1773851860.123156:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000594a5a7d nid 14531@kfi7 refs 1
00000400:00000200:2.0:1773851860.123156:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14531@kfi7 to cpt 0
00000400:00000200:2.0:1773851860.123157:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000594a5a7d nid 14531@kfi7 refs 2
00000400:00000200:2.0:1773851860.123158:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000594a5a7d nid 14531@kfi7 refs 3
00000400:00000200:2.0:1773851860.123159:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14338@kfi7 to cpt 3
00000400:00000200:2.0:1773851860.123160:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14338@kfi7 of length 224 into portal 12 MB=0x699e121859500
00000400:00000200:2.0:1773851860.123161:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14338@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 19616
00000800:00000200:2.0:1773851860.123163:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851860.123164:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851860.123165:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14531@kfi7: PUT: OK
00000100:00000001:2.0:1773851860.123166:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851860.123167:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851860.123168:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fd5c0d10.
00000100:00000040:2.0:1773851860.123168:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000fd5c0d10 x1858042069357824 msgsize 224
00000100:00100000:2.0:1773851860.123170:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-14338@kfi7 (source: 12345-14531@kfi7)
00000100:00000001:2.0:1773851860.123170:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851860.123172:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000594a5a7d nid 14531@kfi7 refs 2
00000100:00000001:0.0:1773851860.123172:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851860.123173:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.123173:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.123174:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.123174:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.123175:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.123176:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042069357824
00000020:00000001:0.0:1773851860.123176:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.123177:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d74
00000020:00000001:0.0:1773851860.123177:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.123179:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d000bbba refcount=6
00000020:00000001:0.0:1773851860.123179:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628527104 : -107123081024512 : ffff9e9276ceec00)
00000020:00000001:0.0:1773851860.123180:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628527104 : -107123081024512 : ffff9e9276ceec00)
00000100:00000001:0.0:1773851860.123182:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.123183:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.123184:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004240f088.
00000020:00000010:0.0:1773851860.123185:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.123186:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.123187:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.123187:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.123188:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.123189:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.123189:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.123190:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.123191:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851860.123192:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851860.123192:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.123193:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.123193:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.123194:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14338@kfi7, seq: 1997520
00000100:00000040:0.0:1773851860.123194:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d000bbba : new rpc_count 1
00000100:00000001:1.0:1773851860.123195:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851860.123195:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.123195:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706787968 : -106953002763648 : ffff9eba10433a80)
00000100:00000040:0.0:1773851860.123196:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fd5c0d10 x1858042069357824/t0(0) o400->3889b89c-a118-4bc9-afb2-d5b44ba000e9@14338@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1399-0'
00000100:00000001:0.0:1773851860.123199:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.123200:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.123201:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd5c0d10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3889b89c-a118-4bc9-afb2-d5b44ba000e9+6:39714:x1858042069357824:12345-14338@kfi7:400:default-tuolumne1399-0
00000100:00000200:0.0:1773851860.123203:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042069357824
00000020:00000001:0.0:1773851860.123203:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.123204:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.123205:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.123205:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.123206:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.123207:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.123207:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042069357824, found 0 last_xid 1858042069357823
00000020:00000001:0.0:1773851860.123208:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.123209:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.123209:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.123210:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.123210:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.123211:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.123212:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.123213:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dc6c6e07.
02000000:00000001:0.0:1773851860.123213:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.123214:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.123215:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.123215:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676018319, transno 0, xid 1858042069357824
00010000:00000001:0.0:1773851860.123216:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.123217:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fd5c0d10 x1858042069357824/t0(0) o400->3889b89c-a118-4bc9-afb2-d5b44ba000e9@14338@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1399-0'
00010000:00000001:0.0:1773851860.123219:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.123220:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.123220:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.123221:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.123222:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008d7c8ee3 refcount 3 to 14338@kfi7
00000100:00000001:0.0:1773851860.123223:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902778592 : -107154806773024 : ffff9e8b13ce6ae0)
02000000:00000001:0.0:1773851860.123224:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.123224:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.123225:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.123226:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14531@kfi7
00000400:00000010:0.0:1773851860.123227:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ee348cea.
00000100:00000200:0.0:1773851860.123228:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042069357824, offset 224
00000400:00000200:0.0:1773851860.123229:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14531@kfi7
00000400:00000200:0.0:1773851860.123230:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14531@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.123231:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000594a5a7d nid 14531@kfi7 refs 1
00000400:00000200:0.0:1773851860.123232:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000594a5a7d nid 14531@kfi7 refs 2
00000400:00000200:0.0:1773851860.123233:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000594a5a7d nid 14531@kfi7 refs 3
00000400:00000200:0.0:1773851860.123234:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14531@kfi7 local destination
00000400:00000200:0.0:1773851860.123236:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768886:8768886:1024:4294967295] 14531@kfi7 LPNI seq info [654412:654412:16:4294967295]
00000400:00000200:0.0:1773851860.123237:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000594a5a7d nid 14531@kfi7 refs 2
00000400:00000200:0.0:1773851860.123238:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14531@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.123240:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14531@kfi7(14531@kfi7:14531@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.123241:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000594a5a7d nid 14531@kfi7 refs 3
00000800:00000200:0.0:1773851860.123242:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.123243:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.123246:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.123248:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afb Using peer 14531@kfi7(0x100000000000afb)
00000800:00000200:0.0:1773851860.123251:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x100000000000afb: rc=0
00000800:00000200:0.0:1773851860.123252:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.123254:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.123255:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008d7c8ee3 refcount 2 to 14338@kfi7
00010000:00000001:0.0:1773851860.123256:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.123256:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.123257:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.123258:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fd5c0d10 x1858042069357824/t0(0) o400->3889b89c-a118-4bc9-afb2-d5b44ba000e9@14338@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1399-0'
00000100:00100000:0.0:1773851860.123265:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd5c0d10 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3889b89c-a118-4bc9-afb2-d5b44ba000e9+6:39714:x1858042069357824:12345-14338@kfi7:400:default-tuolumne1399-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.123268:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14338@kfi7, seq: 1997520
00000100:00000040:0.0:1773851860.123268:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d000bbba : new rpc_count 0
00000100:00000001:0.0:1773851860.123269:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.123270:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.123270:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.123271:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.123272:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004240f088.
00000020:00000040:0.0:1773851860.123273:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000d000bbba : new refcount 5
00000100:00000001:0.0:1773851860.123273:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.123279:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afb TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.123280:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.123282:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14531@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.123282:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ee348cea
00000400:00000010:1.0:1773851860.123283:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ee348cea.
00000100:00000001:1.0:1773851860.123284:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.123285:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.123286:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000594a5a7d nid 14531@kfi7 refs 2
00000800:00000200:1.0:1773851860.123287:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14531@kfi7(000000004473ac2e):0x0 lsk 2812 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afb Transaction freed
00000800:00000200:13.0:1773851860.130708:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.130709:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851860.130710:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851860.130712:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851860.130715:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15922@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.130716:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15922@kfi7 : PUT - for me
00000400:00000200:13.0:1773851860.130717:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15922@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.130718:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9538782 nid 15922@kfi7 refs 1
00000400:00000200:13.0:1773851860.130719:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15922@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.130720:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9538782 nid 15922@kfi7 refs 2
00000400:00000200:13.0:1773851860.130721:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a9538782 nid 15922@kfi7 refs 3
00000400:00000200:13.0:1773851860.130722:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16115@kfi7 to cpt 1
00000400:00000200:13.0:1773851860.130723:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16115@kfi7 of length 224 into portal 12 MB=0x69b4b5532c3c0
00000400:00000200:13.0:1773851860.130724:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16115@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 21512
00000800:00000200:13.0:1773851860.130728:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851860.130729:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851860.130730:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15922@kfi7: PUT: OK
00000100:00000001:13.0:1773851860.130731:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851860.130732:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851860.130733:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000bc59c09.
00000100:00000040:13.0:1773851860.130733:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000000bc59c09 x1859597714506688 msgsize 224
00000100:00100000:13.0:1773851860.130735:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-16115@kfi7 (source: 12345-15922@kfi7)
00000100:00000001:13.0:1773851860.130736:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851860.130737:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9538782 nid 15922@kfi7 refs 2
00000800:00000200:13.0:1773851860.130738:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851860.130741:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851860.130741:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851860.130742:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851860.130742:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851860.130743:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851860.130744:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597714506688
00000020:00000001:13.0:1773851860.130745:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851860.130745:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80963
00000020:00000001:13.0:1773851860.130745:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851860.130751:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f2e2de2 refcount=8
00000020:00000001:13.0:1773851860.130752:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944059356160 : -107129650195456 : ffff9e90ef415400)
00000020:00000001:13.0:1773851860.130752:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944059356160 : -107129650195456 : ffff9e90ef415400)
00000100:00000001:13.0:1773851860.130753:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851860.130754:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851860.130755:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b727378.
00000020:00000010:13.0:1773851860.130756:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851860.130757:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000000521e59.
00000100:00000001:13.0:1773851860.130757:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851860.130758:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851860.130758:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851860.130759:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851860.130760:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851860.130760:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851860.130761:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.130762:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851860.130762:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.130763:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851860.130763:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851860.130764:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16115@kfi7, seq: 2289802
00000100:00000040:15.0:1773851860.130765:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f2e2de2 : new rpc_count 1
00000100:00000001:13.0:1773851860.130765:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.130766:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537143808 : -107002172407808 : ffff9eae9d860000)
00000100:00000001:13.0:1773851860.130766:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.130767:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000bc59c09 x1859597714506688/t0(0) o400->1999896a-fe7b-40d4-b18f-2ef9de73b5db@16115@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1481-0'
00000100:00000001:15.0:1773851860.130770:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.130770:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851860.130771:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000bc59c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1999896a-fe7b-40d4-b18f-2ef9de73b5db+8:39589:x1859597714506688:12345-16115@kfi7:400:default-tuolumne1481-0
00000100:00000200:15.0:1773851860.130772:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597714506688
00000020:00000001:15.0:1773851860.130773:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851860.130774:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851860.130774:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.130775:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851860.130775:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851860.130776:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851860.130777:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597714506688, found 0 last_xid 1859597714506687
00000020:00000001:15.0:1773851860.130777:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851860.130778:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851860.130778:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851860.130779:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.130780:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851860.130780:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851860.130781:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851860.130781:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d9af698f.
02000000:00000001:15.0:1773851860.130782:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.130783:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.130784:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851860.130784:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181931400368, transno 0, xid 1859597714506688
00010000:00000001:15.0:1773851860.130785:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851860.130786:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000bc59c09 x1859597714506688/t0(0) o400->1999896a-fe7b-40d4-b18f-2ef9de73b5db@16115@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1481-0'
00010000:00000001:15.0:1773851860.130788:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851860.130788:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851860.130789:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851860.130790:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851860.130791:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000039e39d86 refcount 3 to 16115@kfi7
00000100:00000001:15.0:1773851860.130792:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411616 : -107145304140000 : ffff9e8d4a351720)
02000000:00000001:15.0:1773851860.130792:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851860.130793:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.130794:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851860.130794:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15922@kfi7
00000400:00000010:15.0:1773851860.130795:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000077952c7.
00000100:00000200:15.0:1773851860.130796:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597714506688, offset 224
00000400:00000200:15.0:1773851860.130797:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15922@kfi7
00000400:00000200:15.0:1773851860.130798:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15922@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.130799:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9538782 nid 15922@kfi7 refs 1
00000400:00000200:15.0:1773851860.130800:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a9538782 nid 15922@kfi7 refs 2
00000400:00000200:15.0:1773851860.130801:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a9538782 nid 15922@kfi7 refs 3
00000400:00000200:15.0:1773851860.130802:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15922@kfi7 local destination
00000400:00000200:15.0:1773851860.130804:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768887:8768887:1024:4294967295] 15922@kfi7 LPNI seq info [9148972:9148972:16:4294967295]
00000400:00000200:15.0:1773851860.130805:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a9538782 nid 15922@kfi7 refs 2
00000400:00000200:15.0:1773851860.130806:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15922@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.130808:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15922@kfi7(15922@kfi7:15922@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851860.130809:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a9538782 nid 15922@kfi7 refs 3
00000800:00000200:15.0:1773851860.130811:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.130812:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851860.130815:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851860.130817:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x12e Using peer 15922@kfi7(0x12e)
00000800:00000200:15.0:1773851860.130820:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x12e: rc=0
00000800:00000200:15.0:1773851860.130822:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x12e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851860.130824:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.130825:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000039e39d86 refcount 2 to 16115@kfi7
00010000:00000001:15.0:1773851860.130825:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851860.130826:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.130826:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851860.130827:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000bc59c09 x1859597714506688/t0(0) o400->1999896a-fe7b-40d4-b18f-2ef9de73b5db@16115@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1481-0'
00000100:00100000:15.0:1773851860.130830:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000bc59c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1999896a-fe7b-40d4-b18f-2ef9de73b5db+8:39589:x1859597714506688:12345-16115@kfi7:400:default-tuolumne1481-0 Request processed in 59us (96us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851860.130832:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16115@kfi7, seq: 2289802
00000100:00000040:15.0:1773851860.130833:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f2e2de2 : new rpc_count 0
00000100:00000001:15.0:1773851860.130834:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851860.130834:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851860.130834:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x12e TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851860.130835:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:15.0:1773851860.130836:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000000521e59.
00000400:00000200:13.0:1773851860.130836:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851860.130837:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b727378.
00000020:00000040:15.0:1773851860.130837:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000003f2e2de2 : new refcount 7
00000400:00000200:13.0:1773851860.130837:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15922@kfi7: PUT: OK
00000100:00000001:15.0:1773851860.130838:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851860.130838:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000077952c7
00000400:00000010:13.0:1773851860.130838:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000077952c7.
00000100:00000001:13.0:1773851860.130839:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851860.130840:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851860.130840:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9538782 nid 15922@kfi7 refs 2
00000800:00000200:13.0:1773851860.130842:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 15922@kfi7(00000000eb0d2aaa):0x0 lsk 303 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x12e Transaction freed
00000800:00000200:17.0:1773851860.220051:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.220052:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.220053:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.220055:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.220057:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.220058:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.158@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851860.220059:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.220060:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851860.220061:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.158@o2ib600 to cpt 7
00000400:00000200:17.0:1773851860.220062:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a8d3a48 nid 172.19.3.158@o2ib600 refs 2
00000400:00000200:17.0:1773851860.220064:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a8d3a48 nid 172.19.3.158@o2ib600 refs 3
00000400:00000200:17.0:1773851860.220064:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.158@o2ib600 to cpt 7
00000400:00000200:17.0:1773851860.220065:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.158@o2ib600 of length 224 into portal 12 MB=0x699f502574780
00000400:00000200:17.0:1773851860.220067:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.158@o2ib600 of length 224/224 into md 0x77fe139dd [64] + 167840
00000800:00000200:17.0:1773851860.220069:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.220070:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.220071:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.220072:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.220072:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.220073:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f03d494.
00000100:00000040:17.0:1773851860.220074:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001f03d494 x1858127445575552 msgsize 224
00000100:00100000:17.0:1773851860.220075:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.158@o2ib600 (source: 12345-172.19.3.158@o2ib600)
00000100:00000001:17.0:1773851860.220077:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.220078:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851860.220079:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851860.220081:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851860.220082:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851860.220083:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851860.220084:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851860.220085:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851860.220086:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858127445575552
00000020:00000001:28.0:1773851860.220087:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851860.220088:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ea2
00000020:00000001:28.0:1773851860.220088:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851860.220092:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ca4c36cf refcount=6
00000020:00000001:28.0:1773851860.220093:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239663616 : -107152469888000 : ffff9e8b9f187400)
00000020:00000001:28.0:1773851860.220094:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239663616 : -107152469888000 : ffff9e8b9f187400)
00000100:00000001:28.0:1773851860.220096:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851860.220097:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851860.220098:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aceb0722.
00000020:00000010:28.0:1773851860.220100:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851860.220102:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a24bde0f.
00000100:00000001:28.0:1773851860.220103:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851860.220104:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851860.220105:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851860.220106:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851860.220107:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851860.220108:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.220110:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851860.220111:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851860.220112:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851860.220113:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851860.220113:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851860.220115:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.158@o2ib600, seq: 2055487
00000100:00000001:31.0:1773851860.220116:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851860.220116:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ca4c36cf : new rpc_count 1
00000100:00000001:31.0:1773851860.220117:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.220117:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764362112 : -107095945189504 : ffff9e98c83ae780)
00000100:00000040:28.0:1773851860.220120:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001f03d494 x1858127445575552/t0(0) o400->5c520c4b-c586-4616-b36c-9e11f5272a67@172.19.3.158@o2ib600:648/0 lens 224/0 e 0 to 0 dl 1773852008 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic8-0'
00000100:00000001:28.0:1773851860.220124:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851860.220125:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851860.220127:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f03d494 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:5c520c4b-c586-4616-b36c-9e11f5272a67+6:26561:x1858127445575552:12345-172.19.3.158@o2ib600:400:login-oslic8-0
00000100:00000200:28.0:1773851860.220129:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858127445575552
00000020:00000001:28.0:1773851860.220130:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851860.220131:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851860.220132:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.220133:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851860.220134:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851860.220135:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851860.220136:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858127445575552, found 0 last_xid 1858127445575551
00000020:00000001:28.0:1773851860.220138:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851860.220139:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851860.220140:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851860.220141:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.220142:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851860.220142:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851860.220143:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851860.220145:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e47eb631.
02000000:00000001:28.0:1773851860.220146:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.220147:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.220148:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851860.220149:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182615578100, transno 0, xid 1858127445575552
00010000:00000001:28.0:1773851860.220150:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851860.220152:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001f03d494 x1858127445575552/t0(0) o400->5c520c4b-c586-4616-b36c-9e11f5272a67@172.19.3.158@o2ib600:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic8-0'
00010000:00000001:28.0:1773851860.220156:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851860.220157:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851860.220158:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=93 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851860.220160:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851860.220161:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d9b54afe refcount 3 to 172.19.3.158@o2ib600
00000100:00000001:28.0:1773851860.220162:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806656 : -107130477744960 : ffff9e90bdedecc0)
02000000:00000001:28.0:1773851860.220164:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851860.220165:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.220166:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851860.220167:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.158@o2ib600
00000400:00000010:28.0:1773851860.220168:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e00fc912.
00000100:00000200:28.0:1773851860.220169:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858127445575552, offset 224
00000400:00000200:28.0:1773851860.220172:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.158@o2ib600
00000400:00000200:28.0:1773851860.220174:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.158@o2ib600 to cpt 7
00000400:00000200:28.0:1773851860.220176:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a8d3a48 nid 172.19.3.158@o2ib600 refs 2
00000400:00000200:28.0:1773851860.220178:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a8d3a48 nid 172.19.3.158@o2ib600 refs 3
00000400:00000200:28.0:1773851860.220180:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a8d3a48 nid 172.19.3.158@o2ib600 refs 4
00000400:00000200:28.0:1773851860.220183:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.158@o2ib600 routed destination
00000400:00000200:28.0:1773851860.220185:0:60533:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:28.0:1773851860.220186:0:60533:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:28.0:1773851860.220188:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.158@o2ib600: rtr pref emtpy: 1
00000400:00000200:28.0:1773851860.220191:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:28.0:1773851860.220192:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.158@o2ib600: rtr pref emtpy: 1
00000400:00000200:28.0:1773851860.220193:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:28.0:1773851860.220196:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768888:8768888:1024:4294967295] 17@kfi7 LPNI seq info [1250891884:1250891884:16:4294967295]
00000400:00000200:28.0:1773851860.220198:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:28.0:1773851860.220199:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:28.0:1773851860.220204:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.158@o2ib600(172.19.3.158@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851860.220206:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a8d3a48 nid 172.19.3.158@o2ib600 refs 3
00000800:00000200:28.0:1773851860.220209:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851860.220211:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851860.220214:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851860.220218:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:28.0:1773851860.220223:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:28.0:1773851860.220226:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851860.220229:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851860.220230:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d9b54afe refcount 2 to 172.19.3.158@o2ib600
00010000:00000001:28.0:1773851860.220234:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851860.220235:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.220236:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851860.220237:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f03d494 x1858127445575552/t0(0) o400->5c520c4b-c586-4616-b36c-9e11f5272a67@172.19.3.158@o2ib600:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic8-0'
00000100:00100000:28.0:1773851860.220243:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f03d494 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:5c520c4b-c586-4616-b36c-9e11f5272a67+6:26561:x1858127445575552:12345-172.19.3.158@o2ib600:400:login-oslic8-0 Request processed in 117us (168us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851860.220248:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.158@o2ib600, seq: 2055487
00000100:00000040:28.0:1773851860.220249:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ca4c36cf : new rpc_count 0
00000100:00000001:28.0:1773851860.220250:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851860.220251:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851860.220252:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851860.220254:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a24bde0f.
00000020:00000010:28.0:1773851860.220255:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aceb0722.
00000020:00000040:28.0:1773851860.220256:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000ca4c36cf : new refcount 5
00000100:00000001:28.0:1773851860.220258:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851860.220267:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851860.220270:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.220273:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:29.0:1773851860.220274:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e00fc912
00000400:00000010:29.0:1773851860.220275:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e00fc912.
00000100:00000001:29.0:1773851860.220276:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851860.220277:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851860.220279:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:29.0:1773851860.220282:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Transaction freed
00000800:00000200:5.0:1773851860.225287:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.225288:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851860.225289:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851860.225291:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851860.225294:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22914@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.225295:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22914@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.225296:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22914@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.225297:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002341fa52 nid 22914@kfi7 refs 1
00000400:00000200:5.0:1773851860.225298:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22914@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.225299:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002341fa52 nid 22914@kfi7 refs 2
00000400:00000200:5.0:1773851860.225300:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002341fa52 nid 22914@kfi7 refs 3
00000400:00000200:5.0:1773851860.225301:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22851@kfi7 to cpt 0
00000400:00000200:5.0:1773851860.225302:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22851@kfi7 of length 224 into portal 12 MB=0x699e0b5f64340
00000400:00000200:5.0:1773851860.225304:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22851@kfi7 of length 224/224 into md 0x793926dc5 [64] + 126712
00000800:00000200:5.0:1773851860.225307:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851860.225309:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.225310:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22914@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.225311:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851860.225311:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851860.225312:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fca201a1.
00000100:00000040:5.0:1773851860.225313:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000fca201a1 x1858040264803136 msgsize 224
00000100:00100000:5.0:1773851860.225314:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22851@kfi7 (source: 12345-22914@kfi7)
00000100:00000001:5.0:1773851860.225315:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851860.225316:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002341fa52 nid 22914@kfi7 refs 2
00000100:00000001:7.0:1773851860.225317:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851860.225318:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851860.225318:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851860.225318:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851860.225319:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851860.225320:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.225321:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040264803136
00000020:00000001:7.0:1773851860.225321:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.225322:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ae1
00000020:00000001:7.0:1773851860.225323:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.225324:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dfaac9d6 refcount=6
00000020:00000001:7.0:1773851860.225325:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743668736 : -107128965882880 : ffff9e91180b1c00)
00000020:00000001:7.0:1773851860.225326:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743668736 : -107128965882880 : ffff9e91180b1c00)
00000100:00000001:7.0:1773851860.225328:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.225329:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.225329:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db8fd2ed.
00000020:00000010:7.0:1773851860.225330:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851860.225331:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851860.225332:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.225333:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.225334:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.225335:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.225335:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.225336:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.225337:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.225338:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.225339:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851860.225339:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851860.225339:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851860.225340:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22851@kfi7, seq: 2001879
00000100:00000040:7.0:1773851860.225341:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dfaac9d6 : new rpc_count 1
00000100:00000001:6.0:1773851860.225341:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.225342:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866958336 : -107088842593280 : ffff9e9a6f93ec00)
00000100:00000001:6.0:1773851860.225342:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.225343:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fca201a1 x1858040264803136/t0(0) o400->2d872786-5e4e-4d61-b0dd-35a7ce84d73d@22851@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1928-0'
00000100:00000001:7.0:1773851860.225346:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.225347:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.225348:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fca201a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:2d872786-5e4e-4d61-b0dd-35a7ce84d73d+6:39683:x1858040264803136:12345-22851@kfi7:400:default-tuolumne1928-0
00000100:00000200:7.0:1773851860.225350:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040264803136
00000020:00000001:7.0:1773851860.225350:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.225351:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.225352:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.225353:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.225353:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.225354:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.225355:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040264803136, found 0 last_xid 1858040264803135
00000020:00000001:7.0:1773851860.225356:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.225357:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.225357:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.225358:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.225359:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.225359:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.225360:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.225361:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000000312d1c.
02000000:00000001:7.0:1773851860.225361:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.225362:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.225364:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.225364:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668658565, transno 0, xid 1858040264803136
00010000:00000001:7.0:1773851860.225366:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.225367:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fca201a1 x1858040264803136/t0(0) o400->2d872786-5e4e-4d61-b0dd-35a7ce84d73d@22851@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1928-0'
00010000:00000001:7.0:1773851860.225369:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.225370:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.225371:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.225372:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.225373:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000482498a6 refcount 3 to 22851@kfi7
00000100:00000001:7.0:1773851860.225374:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050144 : -107154804501472 : ffff9e8b13f11420)
02000000:00000001:7.0:1773851860.225375:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.225375:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.225376:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.225377:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22914@kfi7
00000400:00000010:7.0:1773851860.225378:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e33961df.
00000100:00000200:7.0:1773851860.225379:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040264803136, offset 224
00000400:00000200:7.0:1773851860.225381:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22914@kfi7
00000400:00000200:7.0:1773851860.225383:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22914@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.225384:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002341fa52 nid 22914@kfi7 refs 1
00000400:00000200:7.0:1773851860.225386:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002341fa52 nid 22914@kfi7 refs 2
00000400:00000200:7.0:1773851860.225388:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002341fa52 nid 22914@kfi7 refs 3
00000400:00000200:7.0:1773851860.225390:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22914@kfi7 local destination
00000400:00000200:7.0:1773851860.225392:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768889:8768889:1024:4294967295] 22914@kfi7 LPNI seq info [98391:98391:16:4294967295]
00000400:00000200:7.0:1773851860.225394:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002341fa52 nid 22914@kfi7 refs 2
00000400:00000200:7.0:1773851860.225396:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22914@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.225400:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22914@kfi7(22914@kfi7:22914@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.225402:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002341fa52 nid 22914@kfi7 refs 3
00000800:00000200:7.0:1773851860.225404:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.225406:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.225410:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.225416:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d03 Using peer 22914@kfi7(0x100000000000d03)
00000800:00000200:7.0:1773851860.225421:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x100000000000d03: rc=0
00000800:00000200:7.0:1773851860.225424:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d03 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.225427:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.225429:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000482498a6 refcount 2 to 22851@kfi7
00010000:00000001:7.0:1773851860.225430:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.225431:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.225432:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.225433:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fca201a1 x1858040264803136/t0(0) o400->2d872786-5e4e-4d61-b0dd-35a7ce84d73d@22851@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1928-0'
00000800:00000200:5.0:1773851860.225439:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d03 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851860.225440:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fca201a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:2d872786-5e4e-4d61-b0dd-35a7ce84d73d+6:39683:x1858040264803136:12345-22851@kfi7:400:default-tuolumne1928-0 Request processed in 92us (126us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851860.225442:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851860.225444:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22851@kfi7, seq: 2001879
00000400:00000200:5.0:1773851860.225444:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22914@kfi7: PUT: OK
00000100:00000040:7.0:1773851860.225446:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dfaac9d6 : new rpc_count 0
00000400:00000200:5.0:1773851860.225446:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e33961df
00000100:00000001:7.0:1773851860.225447:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:5.0:1773851860.225447:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e33961df.
00000100:00000001:7.0:1773851860.225448:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851860.225448:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851860.225449:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000100:00000001:5.0:1773851860.225449:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851860.225450:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000400:00000200:5.0:1773851860.225450:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002341fa52 nid 22914@kfi7 refs 2
00000020:00000010:7.0:1773851860.225452:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db8fd2ed.
00000020:00000040:7.0:1773851860.225453:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000dfaac9d6 : new refcount 5
00000800:00000200:5.0:1773851860.225453:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 22914@kfi7(00000000672e48a3):0x0 lsk 3332 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d03 Transaction freed
00000100:00000001:7.0:1773851860.225455:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851860.227662:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.227663:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.227664:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.227666:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.227668:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.227669:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.16@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851860.227670:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.227671:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851860.227672:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.16@o2ib60 to cpt 1
00000400:00000200:17.0:1773851860.227673:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d987b19d nid 192.168.128.16@o2ib60 refs 2
00000400:00000200:17.0:1773851860.227674:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d987b19d nid 192.168.128.16@o2ib60 refs 3
00000400:00000200:17.0:1773851860.227675:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.16@o2ib60 to cpt 1
00000400:00000200:17.0:1773851860.227676:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.16@o2ib60 of length 224 into portal 12 MB=0x69b1712244e40
00000400:00000200:17.0:1773851860.227677:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.16@o2ib60 of length 224/224 into md 0x793926dc5 [64] + 126936
00000800:00000200:17.0:1773851860.227679:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.227680:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.227681:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.227682:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.227683:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.227683:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a5650b57.
00000100:00000040:17.0:1773851860.227684:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a5650b57 x1859373251186240 msgsize 224
00000100:00100000:17.0:1773851860.227685:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.16@o2ib60 (source: 12345-192.168.128.16@o2ib60)
00000100:00000001:17.0:1773851860.227687:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.227688:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851860.227689:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851860.227690:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851860.227690:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851860.227690:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851860.227691:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851860.227692:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.227692:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373251186240
00000020:00000001:7.0:1773851860.227693:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.227693:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793b0adbab
00000020:00000001:7.0:1773851860.227694:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.227696:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cae39d54 refcount=6
00000020:00000001:7.0:1773851860.227696:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950708315136 : -107123001236480 : ffff9e927b906400)
00000020:00000001:7.0:1773851860.227697:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950708315136 : -107123001236480 : ffff9e927b906400)
00000100:00000001:7.0:1773851860.227698:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.227699:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.227699:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db8fd2ed.
00000020:00000010:7.0:1773851860.227700:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851860.227701:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851860.227702:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.227702:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.227702:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.227703:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.227704:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.227704:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.227705:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.227706:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.227706:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851860.227707:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.16@o2ib60, seq: 2001880
00000100:00000001:6.0:1773851860.227707:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851860.227707:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851860.227708:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cae39d54 : new rpc_count 2
00000100:00000001:6.0:1773851860.227708:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.227709:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764358656 : -107095945192960 : ffff9e98c83ada00)
00000100:00000001:6.0:1773851860.227709:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.227710:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a5650b57 x1859373251186240/t0(0) o400->1e3afd7d-88e3-45f5-a356-e7381235d26a@192.168.128.16@o2ib60:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix16-0'
00000100:00000001:7.0:1773851860.227713:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.227713:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.227714:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5650b57 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1e3afd7d-88e3-45f5-a356-e7381235d26a+6:39901:x1859373251186240:12345-192.168.128.16@o2ib60:400:default-matrix16-0
00000100:00000200:7.0:1773851860.227716:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373251186240
00000020:00000001:7.0:1773851860.227716:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.227717:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.227717:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.227718:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.227718:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.227719:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.227720:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373251186240, found 0 last_xid 1859373250376255
00000020:00000001:7.0:1773851860.227721:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.227721:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.227721:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.227722:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.227722:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.227723:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.227723:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.227724:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c654aa7b.
02000000:00000001:7.0:1773851860.227724:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.227728:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.227729:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.227729:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183220610500, transno 0, xid 1859373251186240
00010000:00000001:7.0:1773851860.227730:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.227731:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a5650b57 x1859373251186240/t0(0) o400->1e3afd7d-88e3-45f5-a356-e7381235d26a@192.168.128.16@o2ib60:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix16-0'
00010000:00000001:7.0:1773851860.227733:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.227733:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.227734:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.227735:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.227736:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004dd7f753 refcount 3 to 192.168.128.16@o2ib60
00000100:00000001:7.0:1773851860.227736:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981920 : -107130476569696 : ffff9e90bdffdba0)
02000000:00000001:7.0:1773851860.227737:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.227737:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.227738:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.227739:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.16@o2ib60
00000400:00000010:7.0:1773851860.227739:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012c6c860.
00000100:00000200:7.0:1773851860.227740:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373251186240, offset 224
00000400:00000200:7.0:1773851860.227741:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.16@o2ib60
00000400:00000200:7.0:1773851860.227742:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.16@o2ib60 to cpt 1
00000400:00000200:7.0:1773851860.227744:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d987b19d nid 192.168.128.16@o2ib60 refs 2
00000400:00000200:7.0:1773851860.227745:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d987b19d nid 192.168.128.16@o2ib60 refs 3
00000400:00000200:7.0:1773851860.227746:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d987b19d nid 192.168.128.16@o2ib60 refs 4
00000400:00000200:7.0:1773851860.227748:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.16@o2ib60 routed destination
00000400:00000200:7.0:1773851860.227749:0:60963:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851860.227751:0:60963:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:7.0:1773851860.227752:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.16@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851860.227754:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851860.227755:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.16@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851860.227756:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851860.227757:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768890:8768890:1024:4294967295] 2094@kfi7 LPNI seq info [1258746983:1258746983:16:4294967295]
00000400:00000200:7.0:1773851860.227758:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:7.0:1773851860.227759:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:7.0:1773851860.227762:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.16@o2ib60(192.168.128.16@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.227763:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d987b19d nid 192.168.128.16@o2ib60 refs 3
00000800:00000200:7.0:1773851860.227765:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.227765:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.227768:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.227770:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:7.0:1773851860.227773:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:7.0:1773851860.227774:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.227775:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.227776:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004dd7f753 refcount 2 to 192.168.128.16@o2ib60
00010000:00000001:7.0:1773851860.227777:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.227777:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.227778:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.227779:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a5650b57 x1859373251186240/t0(0) o400->1e3afd7d-88e3-45f5-a356-e7381235d26a@192.168.128.16@o2ib60:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix16-0'
00000100:00100000:7.0:1773851860.227781:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5650b57 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1e3afd7d-88e3-45f5-a356-e7381235d26a+6:39901:x1859373251186240:12345-192.168.128.16@o2ib60:400:default-matrix16-0 Request processed in 68us (97us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851860.227784:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851860.227785:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.16@o2ib60, seq: 2001880
00000100:00000040:7.0:1773851860.227785:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cae39d54 : new rpc_count 1
00000100:00000001:7.0:1773851860.227786:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851860.227786:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851860.227786:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851860.227787:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851860.227787:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000400:00000200:5.0:1773851860.227787:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:7.0:1773851860.227788:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db8fd2ed.
00000400:00000200:5.0:1773851860.227788:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012c6c860
00000400:00000010:5.0:1773851860.227788:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012c6c860.
00000020:00000040:7.0:1773851860.227789:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000cae39d54 : new refcount 5
00000100:00000001:7.0:1773851860.227789:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.227789:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851860.227789:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851860.227790:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:5.0:1773851860.227791:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Transaction freed
00000800:00000200:17.0:1773851860.261510:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.261511:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.261512:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.261514:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.261516:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19195@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.261517:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19195@kfi7 : PUT - for me
00000400:00000200:17.0:1773851860.261518:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19195@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.261518:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 1
00000400:00000200:17.0:1773851860.261519:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19195@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.261520:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 2
00000400:00000200:17.0:1773851860.261521:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 3
00000400:00000200:17.0:1773851860.261521:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19195@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.261522:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19195@kfi7 of length 224 into portal 12 MB=0x699de8c446640
00000400:00000200:17.0:1773851860.261523:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19195@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 448
00000800:00000200:17.0:1773851860.261524:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.261526:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.261527:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19195@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.261527:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.261528:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.261528:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8ce388e.
00000100:00000040:17.0:1773851860.261529:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b8ce388e x1858030975346240 msgsize 224
00000100:00100000:17.0:1773851860.261530:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19195@kfi7 (source: 12345-19195@kfi7)
00000100:00000001:17.0:1773851860.261531:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:18.0:1773851860.261532:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851860.261532:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 2
02000000:00000001:18.0:1773851860.261533:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851860.261533:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851860.261533:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851860.261534:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.261535:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851860.261536:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030975346240
00000020:00000001:18.0:1773851860.261536:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851860.261537:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9108c
00000020:00000001:18.0:1773851860.261537:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.261539:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000070a9b919 refcount=6
00000020:00000001:18.0:1773851860.261540:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240123392 : -107152469428224 : ffff9e8b9f1f7800)
00000020:00000001:18.0:1773851860.261541:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240123392 : -107152469428224 : ffff9e8b9f1f7800)
00000100:00000001:18.0:1773851860.261542:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.261542:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851860.261543:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddcf4a2a.
00000020:00000010:18.0:1773851860.261544:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.261545:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851860.261546:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851860.261546:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851860.261547:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.261547:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851860.261548:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851860.261548:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.261549:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.261550:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.261551:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851860.261551:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851860.261552:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.261552:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19195@kfi7, seq: 2156284
00000100:00000040:18.0:1773851860.261552:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000070a9b919 : new rpc_count 1
00000100:00000001:19.0:1773851860.261553:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.261553:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.261553:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764344832 : -107095945206784 : ffff9e98c83aa400)
00000100:00000040:18.0:1773851860.261554:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b8ce388e x1858030975346240/t0(0) o400->9ada845e-8164-484d-9b66-a0a6cc0fa9d1@19195@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne243-0'
00000100:00000001:18.0:1773851860.261557:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.261557:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.261558:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8ce388e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:9ada845e-8164-484d-9b66-a0a6cc0fa9d1+6:47726:x1858030975346240:12345-19195@kfi7:400:default-tuolumne243-0
00000100:00000200:18.0:1773851860.261560:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030975346240
00000020:00000001:18.0:1773851860.261560:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851860.261561:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851860.261561:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.261562:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851860.261563:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851860.261563:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851860.261564:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030975346240, found 0 last_xid 1858030975346239
00000020:00000001:18.0:1773851860.261565:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851860.261565:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851860.261566:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851860.261566:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.261567:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851860.261567:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.261568:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.261569:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003e30f45b.
02000000:00000001:18.0:1773851860.261569:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.261570:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.261570:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851860.261571:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030975346240
00010000:00000001:18.0:1773851860.261572:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851860.261573:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b8ce388e x1858030975346240/t0(0) o400->9ada845e-8164-484d-9b66-a0a6cc0fa9d1@19195@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne243-0'
00010000:00000001:18.0:1773851860.261575:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.261576:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.261576:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=290 (290 214 1 1)
00000100:00000001:18.0:1773851860.261577:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.261578:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009756e29e refcount 5 to 19195@kfi7
00000100:00000001:18.0:1773851860.261579:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370153728 : -107145339397888 : ffff9e8d481b1900)
02000000:00000001:18.0:1773851860.261579:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.261580:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.261581:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.261581:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19195@kfi7
00000400:00000010:18.0:1773851860.261582:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034d64fb2.
00000100:00000200:18.0:1773851860.261582:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030975346240, offset 224
00000400:00000200:18.0:1773851860.261584:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19195@kfi7
00000400:00000200:18.0:1773851860.261584:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19195@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.261585:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 1
00000400:00000200:18.0:1773851860.261586:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 2
00000400:00000200:18.0:1773851860.261587:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 3
00000400:00000200:18.0:1773851860.261588:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19195@kfi7 local destination
00000400:00000200:18.0:1773851860.261589:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768891:8768891:1024:4294967295] 19195@kfi7 LPNI seq info [24420:24420:16:4294967295]
00000400:00000200:18.0:1773851860.261591:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 2
00000400:00000200:18.0:1773851860.261591:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19195@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.261594:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19195@kfi7(19195@kfi7:19195@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.261595:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 3
00000800:00000200:18.0:1773851860.261596:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.261597:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.261599:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.261601:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x394 Using peer 19195@kfi7(0x394)
00000800:00000200:18.0:1773851860.261604:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000658b1b4a: Posted send of 324 bytes to peer 0x394: rc=0
00000800:00000200:18.0:1773851860.261605:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x394 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.261607:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.261608:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009756e29e refcount 4 to 19195@kfi7
00010000:00000001:18.0:1773851860.261609:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851860.261609:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.261610:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851860.261611:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8ce388e x1858030975346240/t0(0) o400->9ada845e-8164-484d-9b66-a0a6cc0fa9d1@19195@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne243-0'
00000100:00100000:18.0:1773851860.261613:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8ce388e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:9ada845e-8164-484d-9b66-a0a6cc0fa9d1+6:47726:x1858030975346240:12345-19195@kfi7:400:default-tuolumne243-0 Request processed in 55us (84us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851860.261616:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19195@kfi7, seq: 2156284
00000100:00000040:18.0:1773851860.261616:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000070a9b919 : new rpc_count 0
00000100:00000001:18.0:1773851860.261617:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851860.261618:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851860.261618:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000800:00000200:17.0:1773851860.261618:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x394 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851860.261619:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000400:00000200:17.0:1773851860.261619:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851860.261620:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddcf4a2a.
00000020:00000040:18.0:1773851860.261620:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000070a9b919 : new refcount 5
00000400:00000200:17.0:1773851860.261620:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19195@kfi7: PUT: OK
00000400:00000200:17.0:1773851860.261620:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034d64fb2
00000100:00000001:18.0:1773851860.261621:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:17.0:1773851860.261621:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034d64fb2.
00000100:00000001:17.0:1773851860.261621:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.261622:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851860.261623:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cbe9cc2e nid 19195@kfi7 refs 2
00000800:00000200:17.0:1773851860.261624:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000658b1b4a: 2069@kfi7:4 -> 19195@kfi7(0000000053843d73):0x0 lsk 917 rsk 88 tsk 0 trmk 0 tmk 0 trr 4 tta 0x394 Transaction freed
00000800:00000200:5.0:1773851860.261732:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.261733:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851860.261735:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851860.261736:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851860.261738:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19194@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.261740:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19194@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.261741:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19194@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.261742:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d3eb442 nid 19194@kfi7 refs 1
00000400:00000200:5.0:1773851860.261743:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19194@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.261743:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d3eb442 nid 19194@kfi7 refs 2
00000400:00000200:5.0:1773851860.261744:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002d3eb442 nid 19194@kfi7 refs 3
00000400:00000200:5.0:1773851860.261745:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19195@kfi7 to cpt 4
00000400:00000200:5.0:1773851860.261746:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19195@kfi7 of length 224 into portal 12 MB=0x699de8c446dc0
00000400:00000200:5.0:1773851860.261747:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19195@kfi7 of length 224/224 into md 0x793926dc5 [64] + 127160
00000800:00000200:5.0:1773851860.261749:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851860.261750:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.261751:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19194@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.261752:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851860.261752:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851860.261753:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000483dd3b1.
00000100:00000040:5.0:1773851860.261754:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000483dd3b1 x1858030975348160 msgsize 224
00000100:00100000:5.0:1773851860.261755:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19195@kfi7 (source: 12345-19194@kfi7)
00000100:00000001:5.0:1773851860.261757:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851860.261758:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851860.261758:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002d3eb442 nid 19194@kfi7 refs 2
02000000:00000001:7.0:1773851860.261759:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851860.261759:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851860.261759:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851860.261760:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851860.261760:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.261761:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030975348160
00000020:00000001:7.0:1773851860.261762:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.261762:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91387
00000020:00000001:7.0:1773851860.261763:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.261764:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f0b7f0bb refcount=6
00000020:00000001:7.0:1773851860.261765:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169300992 : -107127540250624 : ffff9e916d048800)
00000020:00000001:7.0:1773851860.261766:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169300992 : -107127540250624 : ffff9e916d048800)
00000100:00000001:7.0:1773851860.261767:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.261768:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.261768:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db8fd2ed.
00000020:00000010:7.0:1773851860.261769:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851860.261770:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000062644c14.
00000100:00000001:7.0:1773851860.261771:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.261771:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.261772:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.261773:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.261773:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.261773:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.261774:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.261776:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.261776:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851860.261776:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851860.261776:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851860.261777:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19195@kfi7, seq: 2001881
00000100:00000001:7.0:1773851860.261778:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851860.261778:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f0b7f0bb : new rpc_count 1
00000100:00000001:7.0:1773851860.261779:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851860.261779:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866951424 : -107088842600192 : ffff9e9a6f93d100)
00000100:00000040:6.0:1773851860.261780:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000483dd3b1 x1858030975348160/t0(0) o400->e71c9353-f074-4852-a235-8675bdd458f4@19195@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne243-0'
00000100:00000001:6.0:1773851860.261784:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851860.261784:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851860.261785:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000483dd3b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:e71c9353-f074-4852-a235-8675bdd458f4+6:47724:x1858030975348160:12345-19195@kfi7:400:default-tuolumne243-0
00000100:00000200:6.0:1773851860.261786:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030975348160
00000020:00000001:6.0:1773851860.261787:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851860.261788:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851860.261789:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851860.261789:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851860.261790:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:6.0:1773851860.261791:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:6.0:1773851860.261791:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030975348160, found 0 last_xid 1858030975348159
00000020:00000001:6.0:1773851860.261792:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851860.261793:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851860.261793:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851860.261794:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851860.261795:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:6.0:1773851860.261795:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851860.261796:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851860.261798:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000086f510d0.
02000000:00000001:6.0:1773851860.261798:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851860.261799:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851860.261800:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851860.261801:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768004, transno 0, xid 1858030975348160
00010000:00000001:6.0:1773851860.261801:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851860.261802:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000483dd3b1 x1858030975348160/t0(0) o400->e71c9353-f074-4852-a235-8675bdd458f4@19195@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne243-0'
00010000:00000001:6.0:1773851860.261805:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851860.261806:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851860.261806:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851860.261807:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851860.261808:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009756e29e refcount 5 to 19195@kfi7
00000100:00000001:6.0:1773851860.261809:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370153728 : -107145339397888 : ffff9e8d481b1900)
02000000:00000001:6.0:1773851860.261810:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851860.261810:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851860.261811:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851860.261812:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19194@kfi7
00000400:00000010:6.0:1773851860.261812:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009b8a7556.
00000100:00000200:6.0:1773851860.261813:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030975348160, offset 224
00000400:00000200:6.0:1773851860.261815:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19194@kfi7
00000400:00000200:6.0:1773851860.261815:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19194@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.261816:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d3eb442 nid 19194@kfi7 refs 1
00000400:00000200:6.0:1773851860.261817:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002d3eb442 nid 19194@kfi7 refs 2
00000400:00000200:6.0:1773851860.261818:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002d3eb442 nid 19194@kfi7 refs 3
00000400:00000200:6.0:1773851860.261820:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19194@kfi7 local destination
00000400:00000200:6.0:1773851860.261821:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768892:8768892:1024:4294967295] 19194@kfi7 LPNI seq info [24421:24421:16:4294967295]
00000400:00000200:6.0:1773851860.261822:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002d3eb442 nid 19194@kfi7 refs 2
00000400:00000200:6.0:1773851860.261823:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19194@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.261825:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19194@kfi7(19194@kfi7:19194@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851860.261826:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002d3eb442 nid 19194@kfi7 refs 3
00000800:00000200:6.0:1773851860.261828:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851860.261829:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851860.261831:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851860.261834:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000038d Using peer 19194@kfi7(0x10000000000038d)
00000800:00000200:6.0:1773851860.261837:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000e8b9920: Posted send of 324 bytes to peer 0x10000000000038d: rc=0
00000800:00000200:6.0:1773851860.261838:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000038d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851860.261840:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851860.261841:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009756e29e refcount 4 to 19195@kfi7
00010000:00000001:6.0:1773851860.261842:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851860.261842:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851860.261843:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851860.261843:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000483dd3b1 x1858030975348160/t0(0) o400->e71c9353-f074-4852-a235-8675bdd458f4@19195@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne243-0'
00000100:00100000:6.0:1773851860.261846:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000483dd3b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:e71c9353-f074-4852-a235-8675bdd458f4+6:47724:x1858030975348160:12345-19195@kfi7:400:default-tuolumne243-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851860.261849:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19195@kfi7, seq: 2001881
00000100:00000040:6.0:1773851860.261849:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f0b7f0bb : new rpc_count 0
00000100:00000001:6.0:1773851860.261850:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851860.261850:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000038d TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851860.261851:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851860.261851:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:6.0:1773851860.261852:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000062644c14.
00000400:00000200:5.0:1773851860.261852:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:6.0:1773851860.261853:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db8fd2ed.
00000400:00000200:5.0:1773851860.261853:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19194@kfi7: PUT: OK
00000400:00000200:5.0:1773851860.261853:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009b8a7556
00000020:00000040:6.0:1773851860.261854:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000f0b7f0bb : new refcount 5
00000400:00000010:5.0:1773851860.261854:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009b8a7556.
00000100:00000001:6.0:1773851860.261855:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.261855:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851860.261855:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851860.261856:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002d3eb442 nid 19194@kfi7 refs 2
00000800:00000200:5.0:1773851860.261857:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 19194@kfi7(00000000342b4655):0x0 lsk 910 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000038d Transaction freed
00000800:00000200:9.0:1773851860.273746:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.273747:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.273749:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.273755:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.273758:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17427@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.273760:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17427@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.273762:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17427@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.273764:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049506d8 nid 17427@kfi7 refs 1
00000400:00000200:9.0:1773851860.273766:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17427@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.273767:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049506d8 nid 17427@kfi7 refs 2
00000400:00000200:9.0:1773851860.273768:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000049506d8 nid 17427@kfi7 refs 3
00000400:00000200:9.0:1773851860.273770:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17618@kfi7 to cpt 1
00000400:00000200:9.0:1773851860.273771:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17618@kfi7 of length 224 into portal 12 MB=0x69b81a879ad40
00000400:00000200:9.0:1773851860.273773:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17618@kfi7 of length 224/224 into md 0x78146ce49 [64] + 127024
00000800:00000200:9.0:1773851860.273776:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.273779:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.273780:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17427@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.273782:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.273783:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.273784:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a37a333.
00000100:00000040:9.0:1773851860.273785:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000007a37a333 x1859831039896896 msgsize 224
00000100:00100000:9.0:1773851860.273787:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17618@kfi7 (source: 12345-17427@kfi7)
00000100:00000001:9.0:1773851860.273789:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.273790:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000049506d8 nid 17427@kfi7 refs 2
00000100:00000001:10.0:1773851860.273791:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851860.273792:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851860.273792:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851860.273793:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851860.273794:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851860.273795:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851860.273796:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831039896896
00000020:00000001:10.0:1773851860.273797:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851860.273797:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce505a8
00000020:00000001:10.0:1773851860.273798:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851860.273802:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f31d50c6 refcount=166
00000020:00000001:10.0:1773851860.273803:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636972805756928 : -107100903794688 : ffff9e97a0ac9800)
00000020:00000001:10.0:1773851860.273804:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636972805756928 : -107100903794688 : ffff9e97a0ac9800)
00000100:00000001:10.0:1773851860.273805:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851860.273807:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851860.273808:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef78f1a0.
00000020:00000010:10.0:1773851860.273809:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000efe9f2e0.
00000020:00000010:10.0:1773851860.273811:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cd32eb80.
00000100:00000001:10.0:1773851860.273812:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851860.273813:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:10.0:1773851860.273814:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851860.273815:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:10.0:1773851860.273816:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:10.0:1773851860.273817:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.273818:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.273821:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851860.273821:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.273822:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851860.273822:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.273824:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17618@kfi7, seq: 2130747
00000100:00000040:11.0:1773851860.273826:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f31d50c6 : new rpc_count 1
00000100:00000001:10.0:1773851860.273826:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.273827:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064871808 : -106983644679808 : ffff9eb2eddcb180)
00000100:00000001:10.0:1773851860.273827:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.273829:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007a37a333 x1859831039896896/t0(0) o400->681ab022-f57f-4e9a-9749-47d4f86a630a@17618@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1589-0'
00000100:00000001:11.0:1773851860.273834:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.273835:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.273837:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a37a333 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:681ab022-f57f-4e9a-9749-47d4f86a630a+166:39503:x1859831039896896:12345-17618@kfi7:400:default-tuolumne1589-0
00000100:00000200:11.0:1773851860.273839:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831039896896
00000020:00000001:11.0:1773851860.273840:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.273842:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.273843:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.273844:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.273845:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.273846:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.273847:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831039896896, found 0 last_xid 1859831039472831
00000020:00000001:11.0:1773851860.273848:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.273851:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.273852:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.273852:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.273854:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.273855:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.273855:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.273857:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000be46a1da.
02000000:00000001:11.0:1773851860.273858:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.273859:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.273860:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.273861:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062785, transno 0, xid 1859831039896896
00010000:00000001:11.0:1773851860.273862:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.273864:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007a37a333 x1859831039896896/t0(0) o400->681ab022-f57f-4e9a-9749-47d4f86a630a@17618@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1589-0'
00010000:00000001:11.0:1773851860.273868:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.273869:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.273870:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.273872:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.273874:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d261e776 refcount 3 to 17618@kfi7
00000100:00000001:11.0:1773851860.273875:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327301632 : -107155382249984 : ffff9e8af1815600)
02000000:00000001:11.0:1773851860.273876:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.273877:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.273878:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.273879:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17427@kfi7
00000400:00000010:11.0:1773851860.273881:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005f852466.
00000100:00000200:11.0:1773851860.273882:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831039896896, offset 224
00000400:00000200:11.0:1773851860.273885:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17427@kfi7
00000400:00000200:11.0:1773851860.273887:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17427@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.273889:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049506d8 nid 17427@kfi7 refs 1
00000400:00000200:11.0:1773851860.273890:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000049506d8 nid 17427@kfi7 refs 2
00000400:00000200:11.0:1773851860.273892:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000049506d8 nid 17427@kfi7 refs 3
00000400:00000200:11.0:1773851860.273894:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17427@kfi7 local destination
00000400:00000200:11.0:1773851860.273897:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768893:8768893:1024:4294967295] 17427@kfi7 LPNI seq info [748168:748168:16:4294967295]
00000400:00000200:11.0:1773851860.273899:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000049506d8 nid 17427@kfi7 refs 2
00000400:00000200:11.0:1773851860.273901:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17427@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.273905:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17427@kfi7(17427@kfi7:17427@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.273907:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000049506d8 nid 17427@kfi7 refs 3
00000800:00000200:11.0:1773851860.273909:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.273911:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.273915:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.273918:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000602 Using peer 17427@kfi7(0x100000000000602)
00000800:00000200:11.0:1773851860.273924:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x100000000000602: rc=0
00000800:00000200:11.0:1773851860.273926:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000602 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.273930:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.273931:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d261e776 refcount 2 to 17618@kfi7
00010000:00000001:11.0:1773851860.273932:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.273933:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.273934:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.273935:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a37a333 x1859831039896896/t0(0) o400->681ab022-f57f-4e9a-9749-47d4f86a630a@17618@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1589-0'
00000800:00000200:9.0:1773851860.273941:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000602 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851860.273942:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a37a333 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:681ab022-f57f-4e9a-9749-47d4f86a630a+166:39503:x1859831039896896:12345-17618@kfi7:400:default-tuolumne1589-0 Request processed in 106us (156us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851860.273944:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.273945:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17427@kfi7: PUT: OK
00000100:00100000:11.0:1773851860.273946:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17618@kfi7, seq: 2130747
00000100:00000040:11.0:1773851860.273947:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f31d50c6 : new rpc_count 0
00000400:00000200:9.0:1773851860.273947:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005f852466
00000400:00000010:9.0:1773851860.273947:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005f852466.
00000100:00000001:11.0:1773851860.273948:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851860.273949:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851860.273949:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851860.273950:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000efe9f2e0.
00000100:00000001:9.0:1773851860.273950:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851860.273951:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000049506d8 nid 17427@kfi7 refs 2
00000020:00000010:11.0:1773851860.273952:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cd32eb80.
00000020:00000010:11.0:1773851860.273953:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef78f1a0.
00000800:00000200:9.0:1773851860.273953:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17427@kfi7(00000000e025a855):0x0 lsk 1539 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000602 Transaction freed
00000020:00000040:11.0:1773851860.273955:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f31d50c6 : new refcount 165
00000100:00000001:11.0:1773851860.273956:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.277826:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.277827:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.277828:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.277830:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.277832:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26320@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.277833:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26320@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.277835:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26320@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.277835:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004c72bb00 nid 26320@kfi7 refs 1
00000400:00000200:1.0:1773851860.277836:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26320@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.277837:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004c72bb00 nid 26320@kfi7 refs 2
00000400:00000200:1.0:1773851860.277838:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004c72bb00 nid 26320@kfi7 refs 3
00000400:00000200:1.0:1773851860.277839:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26320@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.277840:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26320@kfi7 of length 224 into portal 12 MB=0x69b4c3a002100
00000400:00000200:1.0:1773851860.277842:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26320@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 19840
00000800:00000200:1.0:1773851860.277844:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.277845:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.277846:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26320@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.277847:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.277848:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.277848:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c1bdb32a.
00000100:00000040:1.0:1773851860.277849:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000c1bdb32a x1859601553170688 msgsize 224
00000100:00100000:1.0:1773851860.277851:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-26320@kfi7 (source: 12345-26320@kfi7)
00000100:00000001:1.0:1773851860.277851:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.277853:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004c72bb00 nid 26320@kfi7 refs 2
00000100:00000001:0.0:1773851860.277853:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.277854:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.277854:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.277854:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.277855:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.277855:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.277856:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601553170688
00000020:00000001:0.0:1773851860.277857:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.277857:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7d4ad
00000020:00000001:0.0:1773851860.277858:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.277860:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008d8edbc7 refcount=5
00000020:00000001:0.0:1773851860.277861:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637159436022784 : -106914273528832 : ffff9ec314b47400)
00000020:00000001:0.0:1773851860.277862:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637159436022784 : -106914273528832 : ffff9ec314b47400)
00000100:00000001:0.0:1773851860.277863:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.277864:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.277865:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004240f088.
00000020:00000010:0.0:1773851860.277866:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.277867:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.277867:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.277868:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.277868:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.277869:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.277870:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.277871:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.277872:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851860.277873:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851860.277873:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851860.277873:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851860.277874:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.277874:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26320@kfi7, seq: 1997521
00000100:00000001:1.0:1773851860.277875:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.277875:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008d8edbc7 : new rpc_count 1
00000100:00000001:1.0:1773851860.277876:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.277876:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064180662272 : -107009528889344 : ffff9eace70b0000)
00000100:00000040:0.0:1773851860.277877:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c1bdb32a x1859601553170688/t0(0) o400->56772b9c-0868-4d25-94c7-d4ad84eb44c2@26320@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2129-0'
00000100:00000001:0.0:1773851860.277880:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.277880:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.277881:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1bdb32a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:56772b9c-0868-4d25-94c7-d4ad84eb44c2+5:39631:x1859601553170688:12345-26320@kfi7:400:default-tuolumne2129-0
00000100:00000200:0.0:1773851860.277882:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601553170688
00000020:00000001:0.0:1773851860.277883:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.277884:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.277884:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.277885:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.277886:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.277886:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.277887:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601553170688, found 0 last_xid 1859601553170687
00000020:00000001:0.0:1773851860.277888:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.277888:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.277889:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.277889:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.277890:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.277891:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.277891:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.277893:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab1cd98d.
02000000:00000001:0.0:1773851860.277894:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.277895:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.277895:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.277896:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013999971, transno 0, xid 1859601553170688
00010000:00000001:0.0:1773851860.277897:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.277898:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c1bdb32a x1859601553170688/t0(0) o400->56772b9c-0868-4d25-94c7-d4ad84eb44c2@26320@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2129-0'
00010000:00000001:0.0:1773851860.277900:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.277901:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.277901:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.277903:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.277903:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006eaf8c21 refcount 3 to 26320@kfi7
00000100:00000001:0.0:1773851860.277904:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994449408 : -107149715102208 : ffff9e8c434b2600)
02000000:00000001:0.0:1773851860.277905:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.277905:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.277906:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.277907:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26320@kfi7
00000400:00000010:0.0:1773851860.277907:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bcd8159c.
00000100:00000200:0.0:1773851860.277908:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601553170688, offset 224
00000400:00000200:0.0:1773851860.277909:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26320@kfi7
00000400:00000200:0.0:1773851860.277910:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26320@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.277911:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004c72bb00 nid 26320@kfi7 refs 1
00000400:00000200:0.0:1773851860.277912:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004c72bb00 nid 26320@kfi7 refs 2
00000400:00000200:0.0:1773851860.277913:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004c72bb00 nid 26320@kfi7 refs 3
00000400:00000200:0.0:1773851860.277914:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26320@kfi7 local destination
00000400:00000200:0.0:1773851860.277916:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768894:8768894:1024:4294967295] 26320@kfi7 LPNI seq info [8402463:8402463:16:4294967295]
00000400:00000200:0.0:1773851860.277917:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004c72bb00 nid 26320@kfi7 refs 2
00000400:00000200:0.0:1773851860.277918:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26320@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.277920:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26320@kfi7(26320@kfi7:26320@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.277921:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004c72bb00 nid 26320@kfi7 refs 3
00000800:00000200:0.0:1773851860.277922:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.277923:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.277925:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.277929:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000908 Using peer 26320@kfi7(0x100000000000908)
00000800:00000200:0.0:1773851860.277932:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x100000000000908: rc=0
00000800:00000200:0.0:1773851860.277933:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000908 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.277935:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.277936:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006eaf8c21 refcount 2 to 26320@kfi7
00010000:00000001:0.0:1773851860.277937:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.277937:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.277938:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.277938:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c1bdb32a x1859601553170688/t0(0) o400->56772b9c-0868-4d25-94c7-d4ad84eb44c2@26320@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2129-0'
00000100:00100000:0.0:1773851860.277943:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1bdb32a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:56772b9c-0868-4d25-94c7-d4ad84eb44c2+5:39631:x1859601553170688:12345-26320@kfi7:400:default-tuolumne2129-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.277945:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26320@kfi7, seq: 1997521
00000100:00000040:0.0:1773851860.277946:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008d8edbc7 : new rpc_count 0
00000100:00000001:0.0:1773851860.277947:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.277947:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.277948:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.277948:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.277949:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004240f088.
00000020:00000040:0.0:1773851860.277950:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000008d8edbc7 : new refcount 4
00000100:00000001:0.0:1773851860.277950:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.277955:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000908 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.277957:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.277958:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26320@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.277959:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bcd8159c
00000400:00000010:1.0:1773851860.277959:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bcd8159c.
00000100:00000001:1.0:1773851860.277960:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.277960:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.277961:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004c72bb00 nid 26320@kfi7 refs 2
00000800:00000200:1.0:1773851860.277963:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 26320@kfi7(00000000743bb4f9):0x0 lsk 2313 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000908 Transaction freed
00000004:00000001:6.0:1773851860.297732:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851860.297733:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:18.0:1773851860.297735:0:61039:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000100:00000010:6.0:1773851860.297735:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001aff7355.
00000100:00000001:28.0:1773851860.297736:0:61389:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000020:00000040:6.0:1773851860.297736:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:12.0:1773851860.297737:0:62918:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000100:00000001:6.0:1773851860.297738:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851860.297739:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851860.297740:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.297742:0:61039:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +17s
02000000:00000010:6.0:1773851860.297742:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000075c954ba.
00000100:00001000:18.0:1773851860.297743:0:61039:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000100:00000001:6.0:1773851860.297743:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.297744:0:61039:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000001:6.0:1773851860.297745:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:28.0:1773851860.297746:0:61389:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +210s
00000100:00001000:18.0:1773851860.297746:0:61039:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -285s) for 290+30  req@0000000028026b49 x1860017285302400/t0(0) o101->77619cb0-8f4f-4f76-8139-796ed1eec537@8193@kfi7:505/0 lens 592/5304 e 8 to 0 dl 1773851865 ref 2 fl Interpret:/0/0 rc 0/0 job:'tuolumne-834501773553172480'
00000100:00000001:6.0:1773851860.297746:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851860.297747:0:61389:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +2s, asking for 30 secs on 1 early replies
00000100:00000040:12.0:1773851860.297747:0:62918:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +47s
00000100:00001000:12.0:1773851860.297748:0:62918:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +2s, asking for 30 secs on 1 early replies
00000100:00000040:6.0:1773851860.297748:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001aff7355] to pc [ptlrpcd_01_02+2]  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851860.297749:0:61389:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000001:12.0:1773851860.297750:0:62918:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00001000:28.0:1773851860.297752:0:61389:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +2s, margin -598s) for 600+30  req@0000000031e08781 x1859600015989568/t0(0) o3->2e4690cb-9273-47ad-9caf-9a633dba768d@14816@kfi7:502/0 lens 488/0 e 0 to 0 dl 1773851862 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833019073751284736'
00000100:00001000:18.0:1773851860.297752:0:61039:0:(import.c:1951:at_measured()) add 315 to 00000000268b17f2 time=93 v=290 (290 214 1 1)
00000100:00001000:12.0:1773851860.297753:0:62918:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +2s, margin -598s) for 600+30  req@000000001dacf8ea x1859581344341248/t0(0) o3->064db4fd-29a2-4998-87eb-87410af369ba@10289@kfi7:502/0 lens 488/0 e 0 to 0 dl 1773851862 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833019102440324096'
00000100:00001000:18.0:1773851860.297754:0:61039:0:(import.c:2016:at_measured()) AT 00000000268b17f2 change: old=290 new=315 delta=25 (val=315) hist 315 214 1 1
00080000:00000001:6.0:1773851860.297754:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000010:18.0:1773851860.297756:0:61039:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c87a7cf.
00000100:00000001:7.0:1773851860.297756:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851860.297756:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851860.297757:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:6.0:1773851860.297757:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008d7d4507.
00000100:00000001:4.0:1773851860.297757:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:28.0:1773851860.297758:0:61389:0:(import.c:1951:at_measured()) add 115 to 0000000024e3e702 time=5214 v=600 (690 0 337 237)
00000100:00000001:4.0:1773851860.297758:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000010:18.0:1773851860.297759:0:61039:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 592 at 000000000891e360.
00080000:00000001:6.0:1773851860.297759:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637101524774912 : -106972184776704 : ffff9eb598ecf000)
00000100:00000040:4.0:1773851860.297759:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:28.0:1773851860.297760:0:61389:0:(import.c:2016:at_measured()) AT 0000000024e3e702 change: old=600 new=115 delta=-485 (val=115) hist 115 0 0 0
00000020:00000001:18.0:1773851860.297760:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000100:00001000:12.0:1773851860.297760:0:62918:0:(import.c:1951:at_measured()) add 115 to 00000000e37a4de3 time=4314 v=600 (113 0 0 626)
00080000:00000001:6.0:1773851860.297760:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000020:00000040:18.0:1773851860.297761:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a66cfd
00080000:00000001:6.0:1773851860.297761:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:28.0:1773851860.297762:0:61389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061748571.
00000020:00000001:18.0:1773851860.297762:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.297762:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eeb0d8da refcount=9
00000100:00001000:12.0:1773851860.297762:0:62918:0:(import.c:2016:at_measured()) AT 00000000e37a4de3 change: old=600 new=115 delta=-485 (val=115) hist 115 0 0 0
00000004:00001000:6.0:1773851860.297762:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000100:00000010:28.0:1773851860.297763:0:61389:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 488 at 00000000aceb0722.
00000020:00000001:18.0:1773851860.297763:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132685773824 : -106941023777792 : ffff9ebcda440c00)
00000004:00000010:6.0:1773851860.297764:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008f1c72c4.
00000100:00000001:4.0:1773851860.297764:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851860.297764:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.297765:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:18.0:1773851860.297765:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132685773824 : -106941023777792 : ffff9ebcda440c00)
00000100:00000010:12.0:1773851860.297765:0:62918:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000561cc90f.
00000004:00080000:6.0:1773851860.297765:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614134751040513ns, next at 614135751038850ns, rc = 0
00000020:00000040:28.0:1773851860.297766:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eb8e
00000100:00000040:18.0:1773851860.297766:0:61039:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 00000000eeb0d8da : new rpc_count 2
00000100:00000010:12.0:1773851860.297766:0:62918:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 488 at 000000008761aa61.
00080000:00000001:6.0:1773851860.297766:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851860.297766:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000020:00000001:28.0:1773851860.297767:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:18.0:1773851860.297767:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851860.297767:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.297768:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000001:12.0:1773851860.297768:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851860.297768:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f110a
00080000:00000001:6.0:1773851860.297768:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851860.297768:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001aff7355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051925632:16@kfi7:13:default-yuba2-0
02000000:00000010:18.0:1773851860.297769:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d2c34f1.
00000020:00000001:12.0:1773851860.297769:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000004:00000001:6.0:1773851860.297769:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.297770:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851860.297770:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:18.0:1773851860.297771:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851860.297771:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851860.297771:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851860.297772:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
02000000:00000001:4.0:1773851860.297772:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000020:00000040:28.0:1773851860.297773:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b95f86f refcount=1259
00010000:00000001:18.0:1773851860.297773:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851860.297773:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000093f7bc7d refcount=2398
00000020:00000001:28.0:1773851860.297774:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959166629888 : -107114542921728 : ffff9e9473b80800)
00000100:00000001:18.0:1773851860.297774:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
02000000:00000010:4.0:1773851860.297774:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004e2bbea7.
00000100:00000040:18.0:1773851860.297775:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000118b0a6e refcount 5 to 8193@kfi7
00000020:00000001:12.0:1773851860.297775:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133707048960 : -106940002502656 : ffff9ebd17237800)
02000000:00000001:4.0:1773851860.297775:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851860.297776:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959166629888 : -107114542921728 : ffff9e9473b80800)
00000100:00000001:18.0:1773851860.297776:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231608608 : -107130477943008 : ffff9e90bdeae720)
00000020:00000001:12.0:1773851860.297776:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133707048960 : -106940002502656 : ffff9ebd17237800)
00000100:00000040:28.0:1773851860.297777:0:61389:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 000000004b95f86f : new rpc_count 8
02000000:00000001:18.0:1773851860.297777:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000001:28.0:1773851860.297778:0:61389:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000100:00000040:12.0:1773851860.297778:0:62918:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 0000000093f7bc7d : new rpc_count 11
00000400:00000200:4.0:1773851860.297778:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
02000000:00000001:28.0:1773851860.297779:0:61389:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000001:18.0:1773851860.297779:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851860.297779:0:62918:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000010:4.0:1773851860.297779:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000100:00000001:18.0:1773851860.297780:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:12.0:1773851860.297780:0:62918:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000010:4.0:1773851860.297780:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
02000000:00000010:28.0:1773851860.297781:0:61389:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000062db5345.
00000100:00000040:18.0:1773851860.297781:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8385@kfi7
02000000:00000010:12.0:1773851860.297781:0:62918:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003bdc2b77.
02000000:00000001:28.0:1773851860.297782:0:61389:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:18.0:1773851860.297782:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4427adb.
02000000:00000001:12.0:1773851860.297782:0:62918:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.297783:0:61389:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851860.297783:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925632, portal 4
00000100:00000001:4.0:1773851860.297783:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:18.0:1773851860.297784:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860017285302400, offset 0
00000100:00000001:12.0:1773851860.297784:0:62918:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851860.297784:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637127990089344 : -106945719462272 : ffff9ebbc2619680)
00010000:00000001:28.0:1773851860.297785:0:61389:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851860.297785:0:61389:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851860.297785:0:62918:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:28.0:1773851860.297786:0:61389:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000400:00000200:18.0:1773851860.297786:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8385@kfi7
00010000:00000001:12.0:1773851860.297786:0:62918:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851860.297786:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851860.297787:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8385@kfi7 to cpt 4
00000100:00000001:12.0:1773851860.297787:0:62918:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851860.297788:0:61389:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d828d9f5 refcount 3 to 14816@kfi7
00000100:00000001:28.0:1773851860.297789:0:61389:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412881536 : -107156296670080 : ffff9e8abb006480)
00000400:00000200:18.0:1773851860.297789:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df944ca6 nid 8385@kfi7 refs 1
00000100:00000040:12.0:1773851860.297789:0:62918:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d693aee3 refcount 3 to 10289@kfi7
02000000:00000001:28.0:1773851860.297790:0:61389:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000400:00000200:18.0:1773851860.297790:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000df944ca6 nid 8385@kfi7 refs 2
00000100:00000001:12.0:1773851860.297790:0:62918:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636956483013344 : -107117226538272 : ffff9e93d3c34ae0)
00000100:00000001:4.0:1773851860.297790:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:12.0:1773851860.297791:0:62918:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000400:00000200:18.0:1773851860.297792:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000df944ca6 nid 8385@kfi7 refs 3
00000100:00000040:4.0:1773851860.297792:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:4.0:1773851860.297793:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b96d8a3.
02000000:00000001:28.0:1773851860.297794:0:61389:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851860.297794:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8385@kfi7 local destination
00000100:00000001:28.0:1773851860.297795:0:61389:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:12.0:1773851860.297795:0:62918:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851860.297795:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925632, offset 0
00000400:00000200:18.0:1773851860.297796:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768895:8768895:1024:4294967295] 8385@kfi7 LPNI seq info [9187006:9187006:16:4294967295]
00000100:00000001:12.0:1773851860.297796:0:62918:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851860.297797:0:61389:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14816@kfi7
00000400:00000200:4.0:1773851860.297797:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000010:28.0:1773851860.297798:0:61389:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000077c78d1a.
00000400:00000200:18.0:1773851860.297798:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000df944ca6 nid 8385@kfi7 refs 2
00000100:00000040:12.0:1773851860.297798:0:62918:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10288@kfi7
00000100:00000200:28.0:1773851860.297799:0:61389:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600015989568, offset 0
00000400:00000200:18.0:1773851860.297799:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8385@kfi7 to cpt 4
00000400:00000010:12.0:1773851860.297799:0:62918:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009203df6c.
00000400:00000200:4.0:1773851860.297799:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000100:00000200:12.0:1773851860.297800:0:62918:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859581344341248, offset 0
00000400:00000200:4.0:1773851860.297801:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:28.0:1773851860.297802:0:61389:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14816@kfi7
00000400:00000200:4.0:1773851860.297802:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:12.0:1773851860.297803:0:62918:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10288@kfi7
00000400:00000200:28.0:1773851860.297804:0:61389:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14816@kfi7 to cpt 7
00000400:00000200:18.0:1773851860.297804:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8385@kfi7(8385@kfi7:8385@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851860.297804:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:28.0:1773851860.297805:0:61389:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54c326c nid 14816@kfi7 refs 1
00000400:00000200:12.0:1773851860.297805:0:62918:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10288@kfi7 to cpt 3
00000400:00000200:18.0:1773851860.297806:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000df944ca6 nid 8385@kfi7 refs 3
00000400:00000200:4.0:1773851860.297806:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:28.0:1773851860.297807:0:61389:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e54c326c nid 14816@kfi7 refs 2
00000400:00000200:12.0:1773851860.297807:0:62918:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0acdc2f nid 10288@kfi7 refs 1
00000800:00000200:18.0:1773851860.297808:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000400:00000200:28.0:1773851860.297809:0:61389:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e54c326c nid 14816@kfi7 refs 3
00000400:00000200:12.0:1773851860.297809:0:62918:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b0acdc2f nid 10288@kfi7 refs 2
00000400:00000200:4.0:1773851860.297809:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8768895, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768894, p:4294967295, g:4294967295, h:1000]
00000800:00000200:18.0:1773851860.297810:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:12.0:1773851860.297811:0:62918:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b0acdc2f nid 10288@kfi7 refs 3
00000400:00000200:28.0:1773851860.297812:0:61389:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14816@kfi7 local destination
00000400:00000200:4.0:1773851860.297812:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:18.0:1773851860.297814:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:12.0:1773851860.297814:0:62918:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10288@kfi7 local destination
00000400:00000200:4.0:1773851860.297814:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851860.297815:0:61389:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768896:8768896:1023:4294967295] 14816@kfi7 LPNI seq info [15965449:15965449:16:4294967295]
00000400:00000200:4.0:1773851860.297815:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:12.0:1773851860.297817:0:62918:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768897:8768897:1024:4294967295] 10288@kfi7 LPNI seq info [25143190:25143190:16:4294967295]
00000400:00000200:4.0:1773851860.297817:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768898:8768898:1024:4294967295] 16@kfi7 LPNI seq info [5403813:5403813:16:4294967295]
00000400:00000200:28.0:1773851860.297818:0:61389:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e54c326c nid 14816@kfi7 refs 2
00000800:00000200:18.0:1773851860.297818:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 Using peer 8385@kfi7(0xe38)
00000400:00000200:28.0:1773851860.297819:0:61389:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14816@kfi7 to cpt 7
00000400:00000200:12.0:1773851860.297820:0:62918:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b0acdc2f nid 10288@kfi7 refs 2
00000400:00000200:4.0:1773851860.297820:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:12.0:1773851860.297821:0:62918:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10288@kfi7 to cpt 3
00000800:00000200:18.0:1773851860.297822:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000008e2a52ba: Posted send of 324 bytes to peer 0xe38: rc=0
00000400:00000200:4.0:1773851860.297822:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:28.0:1773851860.297824:0:61389:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14816@kfi7(14816@kfi7:14816@kfi7) <?> : PUT try# 0
00000800:00000200:18.0:1773851860.297825:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851860.297826:0:61389:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e54c326c nid 14816@kfi7 refs 3
00000400:00000200:12.0:1773851860.297826:0:62918:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10288@kfi7(10288@kfi7:10288@kfi7) <?> : PUT try# 0
00000100:00000001:18.0:1773851860.297828:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851860.297829:0:61389:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:12.0:1773851860.297829:0:62918:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b0acdc2f nid 10288@kfi7 refs 3
00000100:00000040:18.0:1773851860.297830:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000118b0a6e refcount 4 to 8193@kfi7
00000800:00000200:28.0:1773851860.297831:0:61389:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:18.0:1773851860.297831:0:61039:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 00000000eeb0d8da : new rpc_count 1
00000400:00000200:4.0:1773851860.297831:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000020:00000040:18.0:1773851860.297832:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000eeb0d8da : new refcount 8
00000800:00000200:12.0:1773851860.297832:0:62918:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000010:18.0:1773851860.297833:0:61039:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 592 at 000000000891e360.
00000800:00000200:12.0:1773851860.297834:0:62918:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851860.297834:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:28.0:1773851860.297835:0:61389:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000010:18.0:1773851860.297835:0:61039:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c87a7cf.
00000100:00000001:18.0:1773851860.297836:0:61039:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.297837:0:61039:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:4.0:1773851860.297837:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:12.0:1773851860.297838:0:62918:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851860.297839:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851860.297840:0:61389:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 Using peer 14816@kfi7(0x57)
00000800:00000200:17.0:1773851860.297840:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 TN_EVENT_TX_OK event status 0
00000800:00000200:12.0:1773851860.297842:0:62918:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf Using peer 10288@kfi7(0x100000000000fbf)
00000400:00000200:17.0:1773851860.297843:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851860.297843:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851860.297845:0:61389:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x57: rc=0
00000400:00000200:17.0:1773851860.297845:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8385@kfi7: PUT: OK
00000400:00000200:17.0:1773851860.297846:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4427adb
00000400:00000010:17.0:1773851860.297846:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4427adb.
00000100:00000001:17.0:1773851860.297847:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000800:00000200:12.0:1773851860.297847:0:62918:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x100000000000fbf: rc=0
00000800:00000200:28.0:1773851860.297848:0:61389:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
02000000:00000001:17.0:1773851860.297848:0:2511435:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000800:00000200:4.0:1773851860.297848:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Using peer 16@kfi7(0x200000000000169)
02000000:00000010:17.0:1773851860.297850:0:2511435:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d2c34f1.
00000800:00000200:12.0:1773851860.297850:0:62918:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851860.297851:0:61389:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851860.297851:0:2511435:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:17.0:1773851860.297851:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:28.0:1773851860.297852:0:61389:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d828d9f5 refcount 2 to 14816@kfi7
00000400:00000200:17.0:1773851860.297853:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000df944ca6 nid 8385@kfi7 refs 2
00000100:00000001:12.0:1773851860.297853:0:62918:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851860.297853:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x200000000000169: rc=0
00000800:00000200:17.0:1773851860.297855:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e2a52ba: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 Transaction freed
00000100:00000040:12.0:1773851860.297855:0:62918:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d693aee3 refcount 2 to 10289@kfi7
00000800:00000200:4.0:1773851860.297855:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:28.0:1773851860.297856:0:61389:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 000000004b95f86f : new rpc_count 7
00000100:00000040:12.0:1773851860.297856:0:62918:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 0000000093f7bc7d : new rpc_count 10
00000020:00000040:28.0:1773851860.297857:0:61389:0:(genops.c:882:class_export_put()) PUTting export 000000004b95f86f : new refcount 1258
00000100:00000010:28.0:1773851860.297859:0:61389:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 488 at 00000000aceb0722.
00000020:00000040:12.0:1773851860.297859:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000093f7bc7d : new refcount 2397
00000100:00000001:4.0:1773851860.297859:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851860.297860:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000010:28.0:1773851860.297861:0:61389:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061748571.
00000100:00000010:12.0:1773851860.297861:0:62918:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 488 at 000000008761aa61.
00000100:00000001:4.0:1773851860.297861:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.297862:0:61389:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:12.0:1773851860.297862:0:62918:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000561cc90f.
00000100:00000040:28.0:1773851860.297863:0:61389:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +25s
00000100:00000001:12.0:1773851860.297863:0:62918:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851860.297864:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.297865:0:61389:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:12.0:1773851860.297865:0:62918:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +25s
00000100:00000001:12.0:1773851860.297866:0:62918:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851860.297866:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851860.297867:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851860.297868:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851860.297869:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851860.297870:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851860.297874:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 TN_EVENT_TX_OK event status 0
00000800:00000200:13.0:1773851860.297875:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851860.297876:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.297878:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14816@kfi7: PUT: OK
00000400:00000200:13.0:1773851860.297878:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851860.297878:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851860.297879:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851860.297879:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851860.297880:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000077c78d1a
00000400:00000010:29.0:1773851860.297880:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000077c78d1a.
00000400:00000200:13.0:1773851860.297880:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10288@kfi7: PUT: OK
00000100:00000001:29.0:1773851860.297881:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:29.0:1773851860.297882:0:2467684:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000400:00000200:6.0:1773851860.297882:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000010:29.0:1773851860.297883:0:2467684:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000062db5345.
00000400:00000200:13.0:1773851860.297883:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009203df6c
00000400:00000010:13.0:1773851860.297883:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009203df6c.
00000400:00000200:6.0:1773851860.297884:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
02000000:00000001:29.0:1773851860.297885:0:2467684:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:29.0:1773851860.297885:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:13.0:1773851860.297885:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:13.0:1773851860.297886:0:2514888:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000400:00000200:6.0:1773851860.297886:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b96d8a3
00000400:00000010:6.0:1773851860.297886:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b96d8a3.
00000400:00000200:29.0:1773851860.297887:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e54c326c nid 14816@kfi7 refs 2
02000000:00000010:13.0:1773851860.297887:0:2514888:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003bdc2b77.
00000100:00000001:6.0:1773851860.297887:0:2499722:0:(events.c:53:request_out_callback()) Process entered
02000000:00000001:13.0:1773851860.297888:0:2514888:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000800:00000200:29.0:1773851860.297889:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 Transaction freed
00000100:00000001:13.0:1773851860.297889:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000200:6.0:1773851860.297889:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851860.297890:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0acdc2f nid 10288@kfi7 refs 2
00000800:00000200:13.0:1773851860.297893:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf Transaction freed
00000100:00000001:6.0:1773851860.297893:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851860.297894:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851860.297898:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851860.297900:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851860.297902:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:6.0:1773851860.297905:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Transaction freed
00000800:00000200:29.0:1773851860.297915:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851860.297917:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851860.297919:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851860.297922:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851860.297925:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.297927:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851860.297928:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.297930:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851860.297931:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.297932:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851860.297935:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851860.297936:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.297938:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2c80
00000400:00000200:29.0:1773851860.297940:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.297942:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x78008013d [1] + 224
00000800:00000200:29.0:1773851860.297945:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851860.297947:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.297949:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851860.297951:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851860.297953:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851860.297958:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851860.297964:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851860.297965:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:4.0:1773851860.297967:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851860.297968:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851860.297968:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851860.297969:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851860.297970:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851860.297971:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851860.297972:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851860.297973:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:4.0:1773851860.297974:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851860.297975:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851860.297980:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851860.297984:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851860.297985:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851860.297986:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851860.297986:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851860.297987:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851860.297988:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851860.297989:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851860.297991:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=93 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851860.297993:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=93 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851860.297994:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851860.297995:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851860.297995:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851860.297996:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851860.297998:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851860.297998:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:4.0:1773851860.297999:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851860.298000:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851860.298001:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851860.298005:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851860.298007:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851860.298007:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851860.298008:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851860.298009:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851860.298010:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482231808 avail=351481182208 avail_mb=1372973368 hwm_mb=3131103 files=372097243 ffree=343244367 state=0: rc = 0
00000004:00000020:4.0:1773851860.298013:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482231808 free, 351481182208 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097243 files, 343244367 free files
00000004:00000001:4.0:1773851860.298016:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851860.298017:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851860.298022:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001aff7355 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051925632:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851860.298024:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851860.298025:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851860.298026:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001aff7355 x1859433051925632/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851860.298030:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851860.298031:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851860.298031:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004e2bbea7.
02000000:00000001:4.0:1773851860.298033:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851860.298034:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851860.298034:0:41066:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:4.0:1773851860.298035:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851860.298036:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000075c954ba.
02000000:00000001:4.0:1773851860.298037:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851860.298038:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851860.298038:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001aff7355.
00000100:00000001:4.0:1773851860.298040:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851860.298040:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851860.298041:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851860.298042:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851860.298043:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851860.298044:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851860.298044:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851860.308068:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.308068:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851860.308069:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.308069:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851860.308070:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.308070:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851860.308072:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851860.308072:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12704@kfi7(00000000fb467c46):0x88d version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851860.308074:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d Using peer 12704@kfi7(0x88d)
00000400:00000200:10.0:1773851860.308075:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12704@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.308076:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12704@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.308076:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12704@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.308077:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12704@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.308078:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000155c6af2 nid 12704@kfi7 refs 1
00000800:00000200:9.0:1773851860.308078:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 38 bytes to peer 0x88d: rc=0
00000400:00000200:10.0:1773851860.308079:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12704@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.308079:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000155c6af2 nid 12704@kfi7 refs 2
00000800:00000200:9.0:1773851860.308079:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851860.308080:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000155c6af2 nid 12704@kfi7 refs 3
00000400:00000200:10.0:1773851860.308081:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12641@kfi7 to cpt 1
00000400:00000200:10.0:1773851860.308082:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12641@kfi7 of length 224 into portal 12 MB=0x699e0dcc5d400
00000400:00000200:10.0:1773851860.308084:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12641@kfi7 of length 224/224 into md 0x78146ce49 [64] + 127248
00000800:00000200:10.0:1773851860.308086:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851860.308088:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851860.308089:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12704@kfi7: PUT: OK
00000100:00000001:10.0:1773851860.308090:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:9.0:1773851860.308090:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d TN_EVENT_TX_OK event status 0
00000100:00000200:10.0:1773851860.308091:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851860.308092:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce4f531a.
00000100:00000040:10.0:1773851860.308093:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000ce4f531a x1858040915940352 msgsize 224
00000800:00000200:9.0:1773851860.308093:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d Transaction freed
00000100:00100000:10.0:1773851860.308095:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-12641@kfi7 (source: 12345-12704@kfi7)
00000100:00000001:10.0:1773851860.308096:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851860.308097:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000155c6af2 nid 12704@kfi7 refs 2
00000100:00000001:11.0:1773851860.308098:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851860.308098:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851860.308098:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851860.308099:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851860.308099:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851860.308100:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851860.308101:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040915940352
00000020:00000001:11.0:1773851860.308102:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851860.308102:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ae2
00000020:00000001:11.0:1773851860.308103:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851860.308105:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a5d097b1 refcount=166
00000020:00000001:11.0:1773851860.308106:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627765248 : -107123081786368 : ffff9e9276c34c00)
00000020:00000001:11.0:1773851860.308107:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627765248 : -107123081786368 : ffff9e9276c34c00)
00000100:00000001:11.0:1773851860.308108:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.308109:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851860.308110:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009caf48ee.
00000020:00000010:11.0:1773851860.308111:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.308111:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507ae6bc.
00000100:00000001:11.0:1773851860.308113:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851860.308113:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851860.308114:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.308115:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851860.308115:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851860.308116:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.308117:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.308118:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851860.308118:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.308119:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851860.308119:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.308120:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12641@kfi7, seq: 2130748
00000100:00000040:11.0:1773851860.308121:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a5d097b1 : new rpc_count 1
00000100:00000001:10.0:1773851860.308121:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.308122:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610166272 : -107030099385344 : ffff9ea81cf22400)
00000100:00000001:10.0:1773851860.308122:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.308123:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ce4f531a x1858040915940352/t0(0) o400->97dd8ede-9a51-437a-bfb5-4de5d731233c@12641@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1280-0'
00000100:00000001:11.0:1773851860.308125:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.308126:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.308127:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce4f531a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:97dd8ede-9a51-437a-bfb5-4de5d731233c+166:39642:x1858040915940352:12345-12641@kfi7:400:default-tuolumne1280-0
00000100:00000200:11.0:1773851860.308129:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040915940352
00000020:00000001:11.0:1773851860.308129:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.308130:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.308131:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.308131:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.308132:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.308133:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.308133:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040915940352, found 0 last_xid 1858040915518015
00000020:00000001:11.0:1773851860.308134:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.308135:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.308135:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.308136:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.308137:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.308137:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.308138:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.308140:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000279b2c0f.
02000000:00000001:11.0:1773851860.308141:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.308141:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.308142:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.308143:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063442, transno 0, xid 1858040915940352
00010000:00000001:11.0:1773851860.308144:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.308145:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ce4f531a x1858040915940352/t0(0) o400->97dd8ede-9a51-437a-bfb5-4de5d731233c@12641@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1280-0'
00010000:00000001:11.0:1773851860.308147:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.308147:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.308148:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.308149:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.308150:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d267a382 refcount 3 to 12641@kfi7
00000100:00000001:11.0:1773851860.308151:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703552 : -107156155848064 : ffff9e8ac3652a80)
02000000:00000001:11.0:1773851860.308152:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.308152:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.308153:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.308155:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12704@kfi7
00000400:00000010:11.0:1773851860.308155:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6296e37.
00000100:00000200:11.0:1773851860.308156:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040915940352, offset 224
00000400:00000200:11.0:1773851860.308157:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12704@kfi7
00000400:00000200:11.0:1773851860.308158:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12704@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.308159:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000155c6af2 nid 12704@kfi7 refs 1
00000400:00000200:11.0:1773851860.308160:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000155c6af2 nid 12704@kfi7 refs 2
00000400:00000200:11.0:1773851860.308161:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000155c6af2 nid 12704@kfi7 refs 3
00000400:00000200:11.0:1773851860.308162:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12704@kfi7 local destination
00000400:00000200:11.0:1773851860.308164:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768899:8768899:1024:4294967295] 12704@kfi7 LPNI seq info [7681884:7681884:16:4294967295]
00000400:00000200:11.0:1773851860.308165:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000155c6af2 nid 12704@kfi7 refs 2
00000400:00000200:11.0:1773851860.308166:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12704@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.308168:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12704@kfi7(12704@kfi7:12704@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.308169:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000155c6af2 nid 12704@kfi7 refs 3
00000800:00000200:11.0:1773851860.308170:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.308171:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.308173:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.308176:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d Using peer 12704@kfi7(0x88d)
00000800:00000200:11.0:1773851860.308178:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x88d: rc=0
00000800:00000200:11.0:1773851860.308179:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.308181:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.308182:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d267a382 refcount 2 to 12641@kfi7
00010000:00000001:11.0:1773851860.308183:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.308184:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.308185:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.308186:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce4f531a x1858040915940352/t0(0) o400->97dd8ede-9a51-437a-bfb5-4de5d731233c@12641@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1280-0'
00000800:00000200:9.0:1773851860.308189:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851860.308191:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851860.308192:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce4f531a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:97dd8ede-9a51-437a-bfb5-4de5d731233c+166:39642:x1858040915940352:12345-12641@kfi7:400:default-tuolumne1280-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851860.308192:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12704@kfi7: PUT: OK
00000400:00000200:9.0:1773851860.308192:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6296e37
00000400:00000010:9.0:1773851860.308193:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6296e37.
00000100:00000001:9.0:1773851860.308194:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851860.308194:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:11.0:1773851860.308195:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12641@kfi7, seq: 2130748
00000400:00000200:9.0:1773851860.308195:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000155c6af2 nid 12704@kfi7 refs 2
00000100:00000040:11.0:1773851860.308196:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a5d097b1 : new rpc_count 0
00000100:00000001:11.0:1773851860.308196:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851860.308196:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 12704@kfi7(00000000fb467c46):0x0 lsk 2190 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x88d Transaction freed
00000100:00000001:11.0:1773851860.308197:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851860.308198:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.308198:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507ae6bc.
00000020:00000010:11.0:1773851860.308199:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009caf48ee.
00000020:00000040:11.0:1773851860.308200:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000a5d097b1 : new refcount 165
00000100:00000001:11.0:1773851860.308201:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0:1773851860.326053:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.326054:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.326054:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:19.0:1773851860.326055:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:19.0:1773851860.326056:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049addc73: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851860.326056:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.326057:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:19.0:1773851860.326058:0:2464491:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15938@kfi7(00000000b79d6096):0x1066 version: 2; local version 2; negotiated version: 2
00000400:00000200:17.0:1773851860.326059:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000800:00000200:19.0:1773851860.326060:0:2464491:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049addc73: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 Using peer 15938@kfi7(0x100000000001066)
00000400:00000200:17.0:1773851860.326060:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15938@kfi7 : PUT - for me
00000400:00000200:17.0:1773851860.326061:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.326062:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 1
00000400:00000200:17.0:1773851860.326063:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.326064:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000400:00000200:17.0:1773851860.326064:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 3
00000400:00000200:19.0:1773851860.326065:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.326066:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16002@kfi7 to cpt 7
00000800:00000200:19.0:1773851860.326067:0:2464491:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049addc73: Posted send of 38 bytes to peer 0x100000000001066: rc=0
00000400:00000200:17.0:1773851860.326067:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16002@kfi7 of length 224 into portal 12 MB=0x69b4b78f02a80
00000400:00000200:17.0:1773851860.326068:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16002@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 672
00000800:00000200:19.0:1773851860.326069:0:2464491:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000049addc73: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:17.0:1773851860.326070:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.326071:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.326072:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15938@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.326073:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.326074:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.326075:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000490776d4.
00000100:00000040:17.0:1773851860.326075:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000490776d4 x1859598314121856 msgsize 224
00000100:00100000:17.0:1773851860.326077:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16002@kfi7 (source: 12345-15938@kfi7)
00000100:00000001:17.0:1773851860.326078:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.326078:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000100:00000001:18.0:1773851860.326080:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851860.326080:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851860.326081:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851860.326082:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851860.326082:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000049addc73: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851860.326083:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.326084:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851860.326084:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049addc73: 2054@kfi7:4 <- 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 Transaction freed
00000100:00100000:18.0:1773851860.326085:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598314121856
00000020:00000001:18.0:1773851860.326086:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851860.326087:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d816ec
00000020:00000001:18.0:1773851860.326088:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.326091:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d2bd243c refcount=4330
00000020:00000001:18.0:1773851860.326092:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110101426176 : -106963608125440 : ffff9eb798224000)
00000020:00000001:18.0:1773851860.326093:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110101426176 : -106963608125440 : ffff9eb798224000)
00000100:00000001:18.0:1773851860.326095:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.326096:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851860.326097:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000079be9bfc.
00000020:00000010:18.0:1773851860.326099:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.326100:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000088aeabfc.
00000100:00000001:18.0:1773851860.326101:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851860.326102:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851860.326103:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.326104:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851860.326105:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851860.326106:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.326108:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.326109:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.326109:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851860.326109:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851860.326110:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16002@kfi7, seq: 2156285
00000100:00000001:18.0:1773851860.326110:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851860.326111:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d2bd243c : new rpc_count 22
00000100:00000001:19.0:1773851860.326112:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764340224 : -107095945211392 : ffff9e98c83a9200)
00000100:00000001:18.0:1773851860.326112:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.326113:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851860.326114:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000490776d4 x1859598314121856/t0(0) o400->cb351f9e-4d35-44da-826f-555f023ed859@16002@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1496-0'
00000100:00000001:19.0:1773851860.326116:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851860.326117:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851860.326118:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000490776d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cb351f9e-4d35-44da-826f-555f023ed859+4330:39554:x1859598314121856:12345-16002@kfi7:400:default-tuolumne1496-0
00000100:00000200:19.0:1773851860.326119:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598314121856
00000020:00000001:19.0:1773851860.326120:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851860.326120:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851860.326122:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.326122:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851860.326123:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851860.326124:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851860.326124:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598314121856, found 0 last_xid 1859598313386943
00000020:00000001:19.0:1773851860.326125:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851860.326126:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851860.326126:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851860.326127:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.326128:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851860.326128:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851860.326129:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851860.326130:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000007331ce8.
02000000:00000001:19.0:1773851860.326130:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.326131:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.326131:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851860.326132:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586029, transno 0, xid 1859598314121856
00010000:00000001:19.0:1773851860.326133:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851860.326134:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000490776d4 x1859598314121856/t0(0) o400->cb351f9e-4d35-44da-826f-555f023ed859@16002@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1496-0'
00010000:00000001:19.0:1773851860.326136:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851860.326137:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851860.326138:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851860.326139:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851860.326139:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000071723241 refcount 3 to 16002@kfi7
00000100:00000001:19.0:1773851860.326140:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869933536 : -107137839618080 : ffff9e8f0720a7e0)
02000000:00000001:19.0:1773851860.326141:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851860.326141:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.326142:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851860.326143:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15938@kfi7
00000400:00000010:19.0:1773851860.326143:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000488255c4.
00000100:00000200:19.0:1773851860.326144:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598314121856, offset 224
00000400:00000200:19.0:1773851860.326145:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15938@kfi7
00000400:00000200:19.0:1773851860.326146:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:19.0:1773851860.326147:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 1
00000400:00000200:19.0:1773851860.326148:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000400:00000200:19.0:1773851860.326149:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 3
00000400:00000200:19.0:1773851860.326151:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15938@kfi7 local destination
00000400:00000200:19.0:1773851860.326152:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768900:8768900:1024:4294967295] 15938@kfi7 LPNI seq info [7281080:7281080:16:4294967295]
00000400:00000200:19.0:1773851860.326154:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000400:00000200:19.0:1773851860.326154:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:19.0:1773851860.326156:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15938@kfi7(15938@kfi7:15938@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851860.326158:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 3
00000800:00000200:19.0:1773851860.326159:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851860.326160:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851860.326162:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851860.326164:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 Using peer 15938@kfi7(0x100000000001066)
00000800:00000200:19.0:1773851860.326167:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x100000000001066: rc=0
00000800:00000200:19.0:1773851860.326169:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851860.326171:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851860.326172:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000071723241 refcount 2 to 16002@kfi7
00010000:00000001:19.0:1773851860.326172:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851860.326173:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.326173:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851860.326174:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000490776d4 x1859598314121856/t0(0) o400->cb351f9e-4d35-44da-826f-555f023ed859@16002@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1496-0'
00000100:00100000:19.0:1773851860.326177:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000490776d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cb351f9e-4d35-44da-826f-555f023ed859+4330:39554:x1859598314121856:12345-16002@kfi7:400:default-tuolumne1496-0 Request processed in 59us (101us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851860.326179:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16002@kfi7, seq: 2156285
00000100:00000040:19.0:1773851860.326180:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d2bd243c : new rpc_count 21
00000800:00000200:17.0:1773851860.326180:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851860.326181:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851860.326182:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851860.326182:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.326183:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15938@kfi7: PUT: OK
00000400:00000200:17.0:1773851860.326183:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000488255c4
00000400:00000010:17.0:1773851860.326184:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000488255c4.
00000100:00000001:17.0:1773851860.326184:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.326184:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851860.326185:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851860.326185:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000020:00000010:19.0:1773851860.326186:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000088aeabfc.
00000020:00000010:19.0:1773851860.326187:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000079be9bfc.
00000800:00000200:17.0:1773851860.326187:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 15938@kfi7(00000000b79d6096):0x0 lsk 4199 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001066 Transaction freed
00000020:00000040:19.0:1773851860.326188:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000d2bd243c : new refcount 4329
00000100:00000001:19.0:1773851860.326188:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851860.333761:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.333761:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851860.333762:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851860.333762:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851860.333763:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851860.333763:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851860.333765:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851860.333765:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16691@kfi7(00000000d1246779):0x831 version: 2; local version 2; negotiated version: 2
00000400:00000200:6.0:1773851860.333767:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16691@kfi7 to cpt 1
00000800:00000200:5.0:1773851860.333767:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 Using peer 16691@kfi7(0x100000000000831)
00000400:00000200:6.0:1773851860.333769:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16691@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.333769:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16691@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.333770:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16691@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.333770:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006694b87c nid 16691@kfi7 refs 1
00000800:00000200:5.0:1773851860.333771:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 38 bytes to peer 0x100000000000831: rc=0
00000400:00000200:6.0:1773851860.333772:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16691@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.333772:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006694b87c nid 16691@kfi7 refs 2
00000800:00000200:5.0:1773851860.333772:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851860.333773:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006694b87c nid 16691@kfi7 refs 3
00000400:00000200:6.0:1773851860.333774:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16690@kfi7 to cpt 6
00000400:00000200:6.0:1773851860.333775:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16690@kfi7 of length 224 into portal 12 MB=0x699e0d49fb880
00000400:00000200:6.0:1773851860.333776:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16690@kfi7 of length 224/224 into md 0x793926dc5 [64] + 127384
00000800:00000200:6.0:1773851860.333778:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851860.333780:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851860.333781:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16691@kfi7: PUT: OK
00000100:00000001:6.0:1773851860.333782:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851860.333782:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851860.333783:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000faae98c3.
00000100:00000040:6.0:1773851860.333784:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000faae98c3 x1858040779225216 msgsize 224
00000800:00000200:5.0:1773851860.333784:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851860.333785:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-16690@kfi7 (source: 12345-16691@kfi7)
00000800:00000200:5.0:1773851860.333786:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 Transaction freed
00000100:00000001:6.0:1773851860.333787:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851860.333788:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006694b87c nid 16691@kfi7 refs 2
00000800:00000200:6.0:1773851860.333789:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851860.333791:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851860.333792:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851860.333792:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851860.333793:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851860.333794:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851860.333795:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040779225216
00000020:00000001:5.0:1773851860.333796:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851860.333796:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926ce
00000020:00000001:5.0:1773851860.333797:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851860.333799:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006f3d6864 refcount=169
00000020:00000001:5.0:1773851860.333800:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631268352 : -107123078283264 : ffff9e9276f8c000)
00000020:00000001:5.0:1773851860.333801:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631268352 : -107123078283264 : ffff9e9276f8c000)
00000100:00000001:5.0:1773851860.333802:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851860.333802:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851860.333803:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047539c0b.
00000020:00000010:5.0:1773851860.333804:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851860.333805:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000027d86e7a.
00000100:00000001:5.0:1773851860.333806:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851860.333807:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851860.333807:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.333808:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851860.333809:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851860.333809:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851860.333810:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.333812:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.333812:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851860.333812:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851860.333812:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851860.333813:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16690@kfi7, seq: 2001882
00000100:00000040:7.0:1773851860.333814:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006f3d6864 : new rpc_count 1
00000100:00000001:5.0:1773851860.333814:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.333815:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127990096256 : -106945719455360 : ffff9ebbc261b180)
00000100:00000001:5.0:1773851860.333815:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.333816:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000faae98c3 x1858040779225216/t0(0) o400->f6d31b93-99b1-43a3-bac3-0f4c09ec1156@16690@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1529-0'
00000100:00000001:7.0:1773851860.333818:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.333819:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.333820:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000faae98c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f6d31b93-99b1-43a3-bac3-0f4c09ec1156+169:39713:x1858040779225216:12345-16690@kfi7:400:default-tuolumne1529-0
00000100:00000200:7.0:1773851860.333821:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040779225216
00000020:00000001:7.0:1773851860.333822:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.333823:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.333823:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.333824:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.333824:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.333825:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.333826:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040779225216, found 0 last_xid 1858040778801855
00000020:00000001:7.0:1773851860.333827:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.333827:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.333828:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.333829:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.333829:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.333830:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.333830:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.333831:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000db8fd2ed.
02000000:00000001:7.0:1773851860.333832:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.333833:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.333834:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.333834:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062366, transno 0, xid 1858040779225216
00010000:00000001:7.0:1773851860.333835:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.333836:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000faae98c3 x1858040779225216/t0(0) o400->f6d31b93-99b1-43a3-bac3-0f4c09ec1156@16690@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1529-0'
00010000:00000001:7.0:1773851860.333838:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.333839:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.333839:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.333840:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.333841:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b5fc8739 refcount 3 to 16690@kfi7
00000100:00000001:7.0:1773851860.333842:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299328608 : -107155410223008 : ffff9e8aefd68060)
02000000:00000001:7.0:1773851860.333843:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.333843:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.333844:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.333845:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16691@kfi7
00000400:00000010:7.0:1773851860.333845:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000084a606f7.
00000100:00000200:7.0:1773851860.333846:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040779225216, offset 224
00000400:00000200:7.0:1773851860.333847:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16691@kfi7
00000400:00000200:7.0:1773851860.333848:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16691@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.333849:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006694b87c nid 16691@kfi7 refs 1
00000400:00000200:7.0:1773851860.333850:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006694b87c nid 16691@kfi7 refs 2
00000400:00000200:7.0:1773851860.333851:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006694b87c nid 16691@kfi7 refs 3
00000400:00000200:7.0:1773851860.333853:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16691@kfi7 local destination
00000400:00000200:7.0:1773851860.333854:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768901:8768901:1024:4294967295] 16691@kfi7 LPNI seq info [292654:292654:16:4294967295]
00000400:00000200:7.0:1773851860.333855:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006694b87c nid 16691@kfi7 refs 2
00000400:00000200:7.0:1773851860.333856:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16691@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.333858:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16691@kfi7(16691@kfi7:16691@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.333859:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006694b87c nid 16691@kfi7 refs 3
00000800:00000200:7.0:1773851860.333860:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.333861:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.333866:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.333868:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 Using peer 16691@kfi7(0x100000000000831)
00000800:00000200:7.0:1773851860.333871:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x100000000000831: rc=0
00000800:00000200:7.0:1773851860.333873:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.333875:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.333876:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b5fc8739 refcount 2 to 16690@kfi7
00010000:00000001:7.0:1773851860.333876:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.333877:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.333877:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.333878:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000faae98c3 x1858040779225216/t0(0) o400->f6d31b93-99b1-43a3-bac3-0f4c09ec1156@16690@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1529-0'
00000100:00100000:7.0:1773851860.333881:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000faae98c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f6d31b93-99b1-43a3-bac3-0f4c09ec1156+169:39713:x1858040779225216:12345-16690@kfi7:400:default-tuolumne1529-0 Request processed in 62us (97us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851860.333884:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16690@kfi7, seq: 2001882
00000800:00000200:5.0:1773851860.333884:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851860.333885:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006f3d6864 : new rpc_count 0
00000100:00000001:7.0:1773851860.333886:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851860.333886:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851860.333886:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851860.333887:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:7.0:1773851860.333887:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000027d86e7a.
00000400:00000200:5.0:1773851860.333887:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16691@kfi7: PUT: OK
00000020:00000010:7.0:1773851860.333888:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047539c0b.
00000400:00000200:5.0:1773851860.333888:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000084a606f7
00000400:00000010:5.0:1773851860.333888:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000084a606f7.
00000020:00000040:7.0:1773851860.333889:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000006f3d6864 : new refcount 168
00000100:00000001:5.0:1773851860.333889:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851860.333889:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851860.333890:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851860.333890:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006694b87c nid 16691@kfi7 refs 2
00000800:00000200:5.0:1773851860.333891:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16691@kfi7(00000000d1246779):0x0 lsk 2098 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000831 Transaction freed
00000800:00000200:1.0:1773851860.346770:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.346771:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.346772:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.346774:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.346776:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17403@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.346777:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17403@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.346778:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17403@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.346779:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000011e04a nid 17403@kfi7 refs 1
00000400:00000200:1.0:1773851860.346781:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17403@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.346781:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000011e04a nid 17403@kfi7 refs 2
00000400:00000200:1.0:1773851860.346782:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000011e04a nid 17403@kfi7 refs 3
00000400:00000200:1.0:1773851860.346783:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17402@kfi7 to cpt 5
00000400:00000200:1.0:1773851860.346784:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17402@kfi7 of length 224 into portal 12 MB=0x699de8c39ea40
00000400:00000200:1.0:1773851860.346786:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17402@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 20064
00000800:00000200:1.0:1773851860.346787:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.346789:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.346790:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17403@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.346791:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.346791:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.346793:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000838fd808.
00000100:00000040:1.0:1773851860.346793:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000838fd808 x1858030974659136 msgsize 224
00000100:00100000:1.0:1773851860.346795:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-17402@kfi7 (source: 12345-17403@kfi7)
00000100:00000001:1.0:1773851860.346796:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.346797:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000011e04a nid 17403@kfi7 refs 2
00000100:00000001:0.0:1773851860.346797:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.346798:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.346798:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.346798:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.346799:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.346799:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.346800:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974659136
00000020:00000001:0.0:1773851860.346801:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.346801:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f27
00000020:00000001:0.0:1773851860.346802:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.346807:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007ae72776 refcount=6
00000020:00000001:0.0:1773851860.346807:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239877632 : -107152469673984 : ffff9e8b9f1bb800)
00000020:00000001:0.0:1773851860.346808:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239877632 : -107152469673984 : ffff9e8b9f1bb800)
00000100:00000001:0.0:1773851860.346809:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.346810:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.346810:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004240f088.
00000020:00000010:0.0:1773851860.346811:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.346812:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.346813:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.346813:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.346814:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.346815:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.346815:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.346816:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.346817:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851860.346818:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.346818:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.346818:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851860.346818:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.346819:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17402@kfi7, seq: 1997522
00000100:00000001:1.0:1773851860.346820:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.346820:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007ae72776 : new rpc_count 1
00000100:00000001:1.0:1773851860.346821:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.346821:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064180688768 : -107009528862848 : ffff9eace70b6780)
00000100:00000040:0.0:1773851860.346822:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000838fd808 x1858030974659136/t0(0) o400->ad51eea5-4b04-4ea0-8ebe-6f95f2174c3c@17402@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne236-0'
00000100:00000001:0.0:1773851860.346824:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.346825:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.346826:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000838fd808 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ad51eea5-4b04-4ea0-8ebe-6f95f2174c3c+6:47615:x1858030974659136:12345-17402@kfi7:400:default-tuolumne236-0
00000100:00000200:0.0:1773851860.346827:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974659136
00000020:00000001:0.0:1773851860.346828:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.346829:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.346829:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.346830:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.346830:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.346831:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.346832:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974659136, found 0 last_xid 1858030974659135
00000020:00000001:0.0:1773851860.346833:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.346834:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.346834:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.346835:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.346835:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.346836:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.346836:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.346837:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008266dab9.
02000000:00000001:0.0:1773851860.346838:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.346838:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.346839:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.346840:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030974659136
00010000:00000001:0.0:1773851860.346840:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.346841:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000838fd808 x1858030974659136/t0(0) o400->ad51eea5-4b04-4ea0-8ebe-6f95f2174c3c@17402@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne236-0'
00010000:00000001:0.0:1773851860.346844:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.346844:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.346845:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.346846:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.346847:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000034159a99 refcount 5 to 17402@kfi7
00000100:00000001:0.0:1773851860.346847:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424333984 : -107145285217632 : ffff9e8d4b55d2a0)
02000000:00000001:0.0:1773851860.346848:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.346849:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.346849:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.346850:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17403@kfi7
00000400:00000010:0.0:1773851860.346851:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000080b751ba.
00000100:00000200:0.0:1773851860.346852:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974659136, offset 224
00000400:00000200:0.0:1773851860.346853:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17403@kfi7
00000400:00000200:0.0:1773851860.346854:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17403@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.346855:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000011e04a nid 17403@kfi7 refs 1
00000400:00000200:0.0:1773851860.346856:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000011e04a nid 17403@kfi7 refs 2
00000400:00000200:0.0:1773851860.346857:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000011e04a nid 17403@kfi7 refs 3
00000400:00000200:0.0:1773851860.346858:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17403@kfi7 local destination
00000400:00000200:0.0:1773851860.346860:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768902:8768902:1024:4294967295] 17403@kfi7 LPNI seq info [24399:24399:16:4294967295]
00000400:00000200:0.0:1773851860.346861:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000011e04a nid 17403@kfi7 refs 2
00000400:00000200:0.0:1773851860.346862:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17403@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.346864:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17403@kfi7(17403@kfi7:17403@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.346865:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000011e04a nid 17403@kfi7 refs 3
00000800:00000200:0.0:1773851860.346866:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.346867:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.346869:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.346872:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x656 Using peer 17403@kfi7(0x656)
00000800:00000200:0.0:1773851860.346875:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x656: rc=0
00000800:00000200:0.0:1773851860.346876:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x656 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.346878:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.346879:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000034159a99 refcount 4 to 17402@kfi7
00010000:00000001:0.0:1773851860.346880:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.346880:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.346881:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.346882:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000838fd808 x1858030974659136/t0(0) o400->ad51eea5-4b04-4ea0-8ebe-6f95f2174c3c@17402@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne236-0'
00000100:00100000:0.0:1773851860.346886:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000838fd808 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ad51eea5-4b04-4ea0-8ebe-6f95f2174c3c+6:47615:x1858030974659136:12345-17402@kfi7:400:default-tuolumne236-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.346888:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17402@kfi7, seq: 1997522
00000100:00000040:0.0:1773851860.346889:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007ae72776 : new rpc_count 0
00000100:00000001:0.0:1773851860.346890:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.346890:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.346891:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.346892:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.346893:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004240f088.
00000020:00000040:0.0:1773851860.346893:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000007ae72776 : new refcount 5
00000100:00000001:0.0:1773851860.346894:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.346899:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x656 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.346900:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.346902:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17403@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.346902:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000080b751ba
00000400:00000010:1.0:1773851860.346903:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000080b751ba.
00000100:00000001:1.0:1773851860.346904:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.346904:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.346905:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000011e04a nid 17403@kfi7 refs 2
00000800:00000200:1.0:1773851860.346907:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 17403@kfi7(00000000a4717f41):0x0 lsk 1623 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x656 Transaction freed
00000800:00000200:21.0:1773851860.347144:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851860.347145:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851860.347146:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851860.347148:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851860.347150:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17402@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.347151:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17402@kfi7 : PUT - for me
00000400:00000200:21.0:1773851860.347152:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17402@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.347152:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006d0eb266 nid 17402@kfi7 refs 1
00000400:00000200:21.0:1773851860.347153:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17402@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.347154:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006d0eb266 nid 17402@kfi7 refs 2
00000400:00000200:21.0:1773851860.347155:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006d0eb266 nid 17402@kfi7 refs 3
00000400:00000200:21.0:1773851860.347155:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17402@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.347156:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17402@kfi7 of length 224 into portal 12 MB=0x699de8c39f2c0
00000400:00000200:21.0:1773851860.347157:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17402@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 29672
00000800:00000200:21.0:1773851860.347159:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851860.347160:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851860.347162:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17402@kfi7: PUT: OK
00000100:00000001:21.0:1773851860.347162:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851860.347163:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851860.347164:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db3b601f.
00000100:00000040:21.0:1773851860.347164:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000db3b601f x1858030974661312 msgsize 224
00000100:00100000:21.0:1773851860.347166:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17402@kfi7 (source: 12345-17402@kfi7)
00000100:00000001:21.0:1773851860.347167:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851860.347168:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851860.347168:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006d0eb266 nid 17402@kfi7 refs 2
02000000:00000001:23.0:1773851860.347169:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851860.347169:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851860.347169:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851860.347170:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851860.347171:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851860.347171:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974661312
00000020:00000001:23.0:1773851860.347172:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851860.347172:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91188
00000020:00000001:23.0:1773851860.347174:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851860.347177:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007b257e8d refcount=6
00000020:00000001:23.0:1773851860.347178:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240546304 : -107152469005312 : ffff9e8b9f25ec00)
00000020:00000001:23.0:1773851860.347179:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240546304 : -107152469005312 : ffff9e8b9f25ec00)
00000100:00000001:23.0:1773851860.347180:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.347180:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851860.347181:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000396642d.
00000020:00000010:23.0:1773851860.347182:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.347183:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851860.347184:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851860.347184:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851860.347185:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.347186:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851860.347186:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851860.347187:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.347187:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.347189:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851860.347189:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851860.347189:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851860.347189:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851860.347190:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17402@kfi7, seq: 1997948
00000100:00000040:23.0:1773851860.347191:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007b257e8d : new rpc_count 1
00000100:00000001:23.0:1773851860.347191:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637148525821952 : -106925183729664 : ffff9ec08a680000)
00000100:00000001:22.0:1773851860.347191:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851860.347191:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.347192:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000db3b601f x1858030974661312/t0(0) o400->3e863713-63f9-4620-8917-23763279469e@17402@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne236-0'
00000100:00000001:23.0:1773851860.347195:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.347196:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851860.347197:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db3b601f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3e863713-63f9-4620-8917-23763279469e+6:47617:x1858030974661312:12345-17402@kfi7:400:default-tuolumne236-0
00000100:00000200:23.0:1773851860.347198:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974661312
00000020:00000001:23.0:1773851860.347199:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851860.347199:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851860.347200:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.347201:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851860.347201:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851860.347204:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851860.347205:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974661312, found 0 last_xid 1858030974661311
00000020:00000001:23.0:1773851860.347206:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851860.347207:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851860.347207:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851860.347207:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.347208:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851860.347209:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851860.347209:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851860.347211:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000d3396f4.
02000000:00000001:23.0:1773851860.347212:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.347212:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.347213:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851860.347214:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768287, transno 0, xid 1858030974661312
00010000:00000001:23.0:1773851860.347214:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851860.347215:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000db3b601f x1858030974661312/t0(0) o400->3e863713-63f9-4620-8917-23763279469e@17402@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne236-0'
00010000:00000001:23.0:1773851860.347218:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851860.347219:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851860.347219:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=93 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851860.347220:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851860.347221:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000034159a99 refcount 5 to 17402@kfi7
00000100:00000001:23.0:1773851860.347222:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424333984 : -107145285217632 : ffff9e8d4b55d2a0)
02000000:00000001:23.0:1773851860.347223:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851860.347223:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.347224:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851860.347225:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17402@kfi7
00000400:00000010:23.0:1773851860.347225:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000188fee2b.
00000100:00000200:23.0:1773851860.347226:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974661312, offset 224
00000400:00000200:23.0:1773851860.347228:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17402@kfi7
00000400:00000200:23.0:1773851860.347229:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17402@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.347229:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006d0eb266 nid 17402@kfi7 refs 1
00000400:00000200:23.0:1773851860.347231:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006d0eb266 nid 17402@kfi7 refs 2
00000400:00000200:23.0:1773851860.347232:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006d0eb266 nid 17402@kfi7 refs 3
00000400:00000200:23.0:1773851860.347233:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17402@kfi7 local destination
00000400:00000200:23.0:1773851860.347235:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768903:8768903:1024:4294967295] 17402@kfi7 LPNI seq info [24400:24400:16:4294967295]
00000400:00000200:23.0:1773851860.347236:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006d0eb266 nid 17402@kfi7 refs 2
00000400:00000200:23.0:1773851860.347237:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17402@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.347239:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17402@kfi7(17402@kfi7:17402@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851860.347240:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006d0eb266 nid 17402@kfi7 refs 3
00000800:00000200:23.0:1773851860.347241:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851860.347242:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851860.347244:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851860.347246:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000080c Using peer 17402@kfi7(0x10000000000080c)
00000800:00000200:23.0:1773851860.347249:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0x10000000000080c: rc=0
00000800:00000200:23.0:1773851860.347251:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000080c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851860.347253:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.347254:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000034159a99 refcount 4 to 17402@kfi7
00010000:00000001:23.0:1773851860.347254:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851860.347255:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.347256:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851860.347256:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db3b601f x1858030974661312/t0(0) o400->3e863713-63f9-4620-8917-23763279469e@17402@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne236-0'
00000100:00100000:23.0:1773851860.347259:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db3b601f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3e863713-63f9-4620-8917-23763279469e+6:47617:x1858030974661312:12345-17402@kfi7:400:default-tuolumne236-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851860.347261:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17402@kfi7, seq: 1997948
00000800:00000200:21.0:1773851860.347261:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000080c TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851860.347262:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007b257e8d : new rpc_count 0
00000100:00000001:23.0:1773851860.347262:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851860.347262:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851860.347263:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851860.347263:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17402@kfi7: PUT: OK
00000020:00000010:23.0:1773851860.347264:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.347264:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851860.347264:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000188fee2b
00000400:00000010:21.0:1773851860.347264:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000188fee2b.
00000020:00000010:23.0:1773851860.347265:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000396642d.
00000100:00000001:21.0:1773851860.347265:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851860.347265:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:23.0:1773851860.347266:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000007b257e8d : new refcount 5
00000400:00000200:21.0:1773851860.347266:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006d0eb266 nid 17402@kfi7 refs 2
00000100:00000001:23.0:1773851860.347267:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851860.347267:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 17402@kfi7(0000000089524b98):0x0 lsk 2061 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000080c Transaction freed
00000800:00000200:9.0:1773851860.353200:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.353203:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.353205:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.353208:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.353211:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14864@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.353213:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14864@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.353215:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14864@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.353216:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091a5ace6 nid 14864@kfi7 refs 1
00000400:00000200:9.0:1773851860.353218:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14864@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.353219:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091a5ace6 nid 14864@kfi7 refs 2
00000400:00000200:9.0:1773851860.353221:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000091a5ace6 nid 14864@kfi7 refs 3
00000400:00000200:9.0:1773851860.353222:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14864@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.353224:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14864@kfi7 of length 224 into portal 12 MB=0x69b4b5adabd80
00000400:00000200:9.0:1773851860.353226:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14864@kfi7 of length 224/224 into md 0x78146ce49 [64] + 127472
00000800:00000200:9.0:1773851860.353228:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.353231:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.353233:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14864@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.353234:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.353235:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.353236:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000659d5d18.
00000100:00000040:9.0:1773851860.353238:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000659d5d18 x1859597809401216 msgsize 224
00000100:00100000:9.0:1773851860.353240:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14864@kfi7 (source: 12345-14864@kfi7)
00000100:00000001:9.0:1773851860.353242:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.353243:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000091a5ace6 nid 14864@kfi7 refs 2
00000100:00000001:11.0:1773851860.353244:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851860.353245:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851860.353245:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851860.353246:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851860.353247:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851860.353248:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851860.353249:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597809401216
00000020:00000001:11.0:1773851860.353250:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851860.353251:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8092b
00000020:00000001:11.0:1773851860.353252:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851860.353256:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e7634d9d refcount=167
00000020:00000001:11.0:1773851860.353258:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117170342912 : -106956539208704 : ffff9eb93d795c00)
00000020:00000001:11.0:1773851860.353259:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117170342912 : -106956539208704 : ffff9eb93d795c00)
00000100:00000001:11.0:1773851860.353260:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.353262:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851860.353263:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000036174187.
00000020:00000010:11.0:1773851860.353264:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.353266:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507ae6bc.
00000100:00000001:11.0:1773851860.353267:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851860.353268:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851860.353269:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.353271:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851860.353272:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851860.353273:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.353275:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.353277:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.353277:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851860.353277:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851860.353278:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.353279:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14864@kfi7, seq: 2130749
00000100:00000040:11.0:1773851860.353280:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e7634d9d : new rpc_count 1
00000100:00000001:10.0:1773851860.353280:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.353281:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064862592 : -106983644689024 : ffff9eb2eddc8d80)
00000100:00000001:10.0:1773851860.353281:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.353283:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000659d5d18 x1859597809401216/t0(0) o400->9f2168a0-e583-436c-a696-427035fe7cc1@14864@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1425-0'
00000100:00000001:11.0:1773851860.353288:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.353288:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.353290:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000659d5d18 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9f2168a0-e583-436c-a696-427035fe7cc1+167:39724:x1859597809401216:12345-14864@kfi7:400:default-tuolumne1425-0
00000100:00000200:11.0:1773851860.353292:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597809401216
00000020:00000001:11.0:1773851860.353293:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.353294:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.353295:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.353297:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.353297:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.353299:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.353299:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597809401216, found 0 last_xid 1859597808981375
00000020:00000001:11.0:1773851860.353301:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.353302:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.353303:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.353303:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.353304:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.353305:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.353306:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.353307:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009caf48ee.
02000000:00000001:11.0:1773851860.353308:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.353309:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.353310:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.353311:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062897, transno 0, xid 1859597809401216
00010000:00000001:11.0:1773851860.353313:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.353315:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000659d5d18 x1859597809401216/t0(0) o400->9f2168a0-e583-436c-a696-427035fe7cc1@14864@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1425-0'
00010000:00000001:11.0:1773851860.353319:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.353319:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.353321:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.353322:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.353323:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c9e90c89 refcount 3 to 14864@kfi7
00000100:00000001:11.0:1773851860.353325:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810485792 : -107154899065824 : ffff9e8b0e4e2420)
02000000:00000001:11.0:1773851860.353326:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.353327:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.353328:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.353329:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14864@kfi7
00000400:00000010:11.0:1773851860.353330:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090967037.
00000100:00000200:11.0:1773851860.353331:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597809401216, offset 224
00000400:00000200:11.0:1773851860.353333:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14864@kfi7
00000400:00000200:11.0:1773851860.353335:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14864@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.353336:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091a5ace6 nid 14864@kfi7 refs 1
00000400:00000200:11.0:1773851860.353338:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000091a5ace6 nid 14864@kfi7 refs 2
00000400:00000200:11.0:1773851860.353340:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000091a5ace6 nid 14864@kfi7 refs 3
00000400:00000200:11.0:1773851860.353342:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14864@kfi7 local destination
00000400:00000200:11.0:1773851860.353344:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768904:8768904:1024:4294967295] 14864@kfi7 LPNI seq info [241992:241992:16:4294967295]
00000400:00000200:11.0:1773851860.353346:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000091a5ace6 nid 14864@kfi7 refs 2
00000400:00000200:11.0:1773851860.353347:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14864@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.353351:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14864@kfi7(14864@kfi7:14864@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.353353:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000091a5ace6 nid 14864@kfi7 refs 3
00000800:00000200:11.0:1773851860.353356:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.353357:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.353361:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.353365:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14c Using peer 14864@kfi7(0x14c)
00000800:00000200:11.0:1773851860.353370:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x14c: rc=0
00000800:00000200:11.0:1773851860.353372:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.353375:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.353378:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c9e90c89 refcount 2 to 14864@kfi7
00010000:00000001:11.0:1773851860.353380:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.353380:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.353381:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.353383:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000659d5d18 x1859597809401216/t0(0) o400->9f2168a0-e583-436c-a696-427035fe7cc1@14864@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1425-0'
00000800:00000200:9.0:1773851860.353385:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851860.353387:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851860.353388:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000659d5d18 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9f2168a0-e583-436c-a696-427035fe7cc1+167:39724:x1859597809401216:12345-14864@kfi7:400:default-tuolumne1425-0 Request processed in 99us (150us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851860.353389:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14864@kfi7: PUT: OK
00000400:00000200:9.0:1773851860.353391:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090967037
00000100:00100000:11.0:1773851860.353392:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14864@kfi7, seq: 2130749
00000400:00000010:9.0:1773851860.353392:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090967037.
00000100:00000001:9.0:1773851860.353393:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851860.353393:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:11.0:1773851860.353394:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e7634d9d : new rpc_count 0
00000100:00000001:11.0:1773851860.353395:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851860.353395:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000091a5ace6 nid 14864@kfi7 refs 2
00000100:00000001:11.0:1773851860.353396:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851860.353397:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000800:00000200:9.0:1773851860.353397:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 14864@kfi7(0000000096c0c9bb):0x0 lsk 333 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x14c Transaction freed
00000020:00000010:11.0:1773851860.353398:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507ae6bc.
00000020:00000010:11.0:1773851860.353399:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000036174187.
00000020:00000040:11.0:1773851860.353400:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e7634d9d : new refcount 166
00000100:00000001:11.0:1773851860.353402:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851860.375364:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.375365:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851860.375367:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851860.375369:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851860.375371:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11762@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.375373:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11762@kfi7 : PUT - for me
00000400:00000200:15.0:1773851860.375374:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11762@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.375375:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c539adf6 nid 11762@kfi7 refs 1
00000400:00000200:15.0:1773851860.375376:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11762@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.375376:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c539adf6 nid 11762@kfi7 refs 2
00000400:00000200:15.0:1773851860.375377:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c539adf6 nid 11762@kfi7 refs 3
00000400:00000200:15.0:1773851860.375378:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11570@kfi7 to cpt 0
00000400:00000200:15.0:1773851860.375379:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11570@kfi7 of length 224 into portal 12 MB=0x699e14f1a4ac0
00000400:00000200:15.0:1773851860.375381:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11570@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 21736
00000800:00000200:15.0:1773851860.375384:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851860.375385:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851860.375386:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11762@kfi7: PUT: OK
00000100:00000001:15.0:1773851860.375388:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851860.375388:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851860.375389:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009112e4dd.
00000100:00000040:15.0:1773851860.375390:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000009112e4dd x1858042834078400 msgsize 224
00000100:00100000:15.0:1773851860.375391:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-11570@kfi7 (source: 12345-11762@kfi7)
00000100:00000001:15.0:1773851860.375393:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851860.375394:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c539adf6 nid 11762@kfi7 refs 2
00000800:00000200:15.0:1773851860.375395:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851860.375398:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851860.375399:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851860.375399:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851860.375400:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851860.375401:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851860.375401:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042834078400
00000020:00000001:15.0:1773851860.375402:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851860.375402:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91826
00000020:00000001:15.0:1773851860.375403:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851860.375409:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005b269c1f refcount=6
00000020:00000001:15.0:1773851860.375409:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241756672 : -107152467794944 : ffff9e8b9f386400)
00000020:00000001:15.0:1773851860.375410:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241756672 : -107152467794944 : ffff9e8b9f386400)
00000100:00000001:15.0:1773851860.375411:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.375412:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851860.375413:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000514c091f.
00000020:00000010:15.0:1773851860.375414:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.375415:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851860.375416:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851860.375417:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851860.375417:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.375418:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851860.375419:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851860.375419:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.375420:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.375422:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.375422:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851860.375423:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11570@kfi7, seq: 2289803
00000100:00000040:15.0:1773851860.375424:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005b269c1f : new rpc_count 1
00000100:00000001:13.0:1773851860.375424:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851860.375424:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851860.375425:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860217216 : -107049849334400 : ffff9ea383c1d580)
00000100:00000001:13.0:1773851860.375425:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.375426:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009112e4dd x1858042834078400/t0(0) o400->122513c9-c34e-4f60-9e97-5eab9fd182cd@11570@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1209-0'
00000100:00000001:13.0:1773851860.375426:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.375428:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.375429:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851860.375430:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009112e4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:122513c9-c34e-4f60-9e97-5eab9fd182cd+6:39639:x1858042834078400:12345-11570@kfi7:400:default-tuolumne1209-0
00000100:00000200:15.0:1773851860.375431:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042834078400
00000020:00000001:15.0:1773851860.375432:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851860.375432:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851860.375433:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.375434:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851860.375434:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851860.375435:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851860.375436:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042834078400, found 0 last_xid 1858042834078399
00000020:00000001:15.0:1773851860.375437:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851860.375438:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851860.375438:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851860.375439:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.375439:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851860.375440:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851860.375440:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851860.375443:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006a817a79.
02000000:00000001:15.0:1773851860.375443:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.375444:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.375445:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851860.375445:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035352381, transno 0, xid 1858042834078400
00010000:00000001:15.0:1773851860.375446:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851860.375447:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009112e4dd x1858042834078400/t0(0) o400->122513c9-c34e-4f60-9e97-5eab9fd182cd@11570@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1209-0'
00010000:00000001:15.0:1773851860.375449:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851860.375450:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851860.375451:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851860.375452:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851860.375452:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fdcbf590 refcount 3 to 11570@kfi7
00000100:00000001:15.0:1773851860.375453:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441600 : -107146751110016 : ffff9e8cf3f61480)
02000000:00000001:15.0:1773851860.375454:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851860.375454:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.375455:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851860.375456:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11762@kfi7
00000400:00000010:15.0:1773851860.375456:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f009b6f1.
00000100:00000200:15.0:1773851860.375457:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042834078400, offset 224
00000400:00000200:15.0:1773851860.375458:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11762@kfi7
00000400:00000200:15.0:1773851860.375459:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11762@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.375460:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c539adf6 nid 11762@kfi7 refs 1
00000400:00000200:15.0:1773851860.375461:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c539adf6 nid 11762@kfi7 refs 2
00000400:00000200:15.0:1773851860.375462:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c539adf6 nid 11762@kfi7 refs 3
00000400:00000200:15.0:1773851860.375463:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11762@kfi7 local destination
00000400:00000200:15.0:1773851860.375465:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768905:8768905:1024:4294967295] 11762@kfi7 LPNI seq info [19192106:19192106:16:4294967295]
00000400:00000200:15.0:1773851860.375466:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c539adf6 nid 11762@kfi7 refs 2
00000400:00000200:15.0:1773851860.375467:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11762@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.375469:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11762@kfi7(11762@kfi7:11762@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851860.375470:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c539adf6 nid 11762@kfi7 refs 3
00000800:00000200:15.0:1773851860.375471:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.375472:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851860.375474:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851860.375476:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x669 Using peer 11762@kfi7(0x669)
00000800:00000200:15.0:1773851860.375480:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x669: rc=0
00000800:00000200:15.0:1773851860.375481:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x669 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851860.375483:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.375484:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fdcbf590 refcount 2 to 11570@kfi7
00010000:00000001:15.0:1773851860.375485:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851860.375485:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.375486:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851860.375486:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009112e4dd x1858042834078400/t0(0) o400->122513c9-c34e-4f60-9e97-5eab9fd182cd@11570@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1209-0'
00000100:00100000:15.0:1773851860.375489:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009112e4dd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:122513c9-c34e-4f60-9e97-5eab9fd182cd+6:39639:x1858042834078400:12345-11570@kfi7:400:default-tuolumne1209-0 Request processed in 60us (98us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851860.375492:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11570@kfi7, seq: 2289803
00000100:00000040:15.0:1773851860.375492:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005b269c1f : new rpc_count 0
00000100:00000001:15.0:1773851860.375493:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851860.375493:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851860.375494:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.375495:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000020:00000010:15.0:1773851860.375496:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000514c091f.
00000800:00000200:13.0:1773851860.375496:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x669 TN_EVENT_TX_OK event status 0
00000020:00000040:15.0:1773851860.375497:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000005b269c1f : new refcount 5
00000100:00000001:15.0:1773851860.375497:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851860.375499:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851860.375500:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11762@kfi7: PUT: OK
00000400:00000200:13.0:1773851860.375502:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f009b6f1
00000400:00000010:13.0:1773851860.375503:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f009b6f1.
00000100:00000001:13.0:1773851860.375504:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851860.375505:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851860.375506:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c539adf6 nid 11762@kfi7 refs 2
00000800:00000200:13.0:1773851860.375509:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 11762@kfi7(000000000dea0725):0x0 lsk 1642 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x669 Transaction freed
00000800:00000200:26.0:1773851860.428398:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851860.428398:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851860.428399:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851860.428400:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851860.428401:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851860.428403:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20769@kfi7(000000009a5605f6):0x120d version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851860.428403:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851860.428405:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d Using peer 20769@kfi7(0x10000000000120d)
00000400:00000200:26.0:1773851860.428407:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20769@kfi7 to cpt 6
00000800:00000200:25.0:1773851860.428407:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:26.0:1773851860.428409:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001c682e34: Posted send of 38 bytes to peer 0x10000000000120d: rc=0
00000400:00000200:25.0:1773851860.428410:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20769@kfi7 to cpt 6
00000800:00000200:26.0:1773851860.428411:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:25.0:1773851860.428412:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20769@kfi7 : PUT - for me
00000400:00000200:25.0:1773851860.428414:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20769@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.428415:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 1
00000400:00000200:25.0:1773851860.428416:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20769@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.428418:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 2
00000400:00000200:25.0:1773851860.428419:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 3
00000400:00000200:25.0:1773851860.428421:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20961@kfi7 to cpt 1
00000400:00000200:25.0:1773851860.428422:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20961@kfi7 of length 224 into portal 12 MB=0x69b09ad9d73c0
00000800:00000200:26.0:1773851860.428423:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851860.428424:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20961@kfi7 of length 224/224 into md 0x16159c6179 [64] + 189272
00000800:00000200:26.0:1773851860.428425:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d Transaction freed
00000800:00000200:25.0:1773851860.428427:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851860.428430:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851860.428432:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20769@kfi7: PUT: OK
00000100:00000001:25.0:1773851860.428434:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851860.428434:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851860.428436:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8f925ba.
00000100:00000040:25.0:1773851860.428437:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000a8f925ba x1859315730052032 msgsize 224
00000100:00100000:25.0:1773851860.428439:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20961@kfi7 (source: 12345-20769@kfi7)
00000100:00000001:25.0:1773851860.428442:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851860.428443:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 2
00000800:00000200:25.0:1773851860.428445:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851860.428450:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851860.428451:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851860.428452:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851860.428453:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851860.428454:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851860.428455:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315730052032
00000020:00000001:25.0:1773851860.428456:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851860.428457:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e5a
00000020:00000001:25.0:1773851860.428458:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851860.428461:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000027beeb13 refcount=557
00000020:00000001:25.0:1773851860.428462:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744644608 : -107128964907008 : ffff9e91181a0000)
00000020:00000001:25.0:1773851860.428464:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744644608 : -107128964907008 : ffff9e91181a0000)
00000100:00000001:25.0:1773851860.428465:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851860.428466:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851860.428467:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089cac470.
00000020:00000010:25.0:1773851860.428469:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851860.428470:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a35ab917.
00000100:00000001:25.0:1773851860.428472:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851860.428472:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851860.428473:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851860.428475:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851860.428476:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851860.428476:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851860.428478:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851860.428479:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851860.428480:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851860.428480:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851860.428480:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851860.428481:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20961@kfi7, seq: 2025068
00000100:00000001:25.0:1773851860.428482:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.428482:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000027beeb13 : new rpc_count 6
00000100:00000001:25.0:1773851860.428483:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.428483:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637054961760896 : -107018747790720 : ffff9eaac18dba80)
00000100:00000040:24.0:1773851860.428484:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a8f925ba x1859315730052032/t0(0) o400->429ba700-3a73-4a1e-94e0-f2d2c040c60e@20961@kfi7:77/0 lens 224/0 e 0 to 0 dl 1773852192 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1791-0'
00000100:00000001:24.0:1773851860.428487:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851860.428487:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851860.428488:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8f925ba pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:429ba700-3a73-4a1e-94e0-f2d2c040c60e+557:39507:x1859315730052032:12345-20961@kfi7:400:default-tuolumne1791-0
00000100:00000200:24.0:1773851860.428490:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315730052032
00000020:00000001:24.0:1773851860.428490:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851860.428491:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851860.428492:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.428492:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851860.428493:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851860.428494:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851860.428494:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315730052032, found 0 last_xid 1859315697686911
00000020:00000001:24.0:1773851860.428495:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851860.428496:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851860.428497:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851860.428497:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.428498:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851860.428499:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851860.428499:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851860.428500:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dcf76327.
02000000:00000001:24.0:1773851860.428501:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.428501:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.428502:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851860.428503:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592162, transno 0, xid 1859315730052032
00010000:00000001:24.0:1773851860.428504:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851860.428504:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a8f925ba x1859315730052032/t0(0) o400->429ba700-3a73-4a1e-94e0-f2d2c040c60e@20961@kfi7:77/0 lens 224/224 e 0 to 0 dl 1773852192 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1791-0'
00010000:00000001:24.0:1773851860.428507:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851860.428508:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851860.428508:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=93 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851860.428509:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851860.428510:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000024eff6a3 refcount 3 to 20961@kfi7
00000100:00000001:24.0:1773851860.428511:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413728 : -107145304137888 : ffff9e8d4a351f60)
02000000:00000001:24.0:1773851860.428512:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851860.428512:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.428513:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851860.428514:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20769@kfi7
00000400:00000010:24.0:1773851860.428514:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d7bd97df.
00000100:00000200:24.0:1773851860.428515:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315730052032, offset 224
00000400:00000200:24.0:1773851860.428517:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20769@kfi7
00000400:00000200:24.0:1773851860.428517:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20769@kfi7 to cpt 6
00000400:00000200:24.0:1773851860.428518:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 1
00000400:00000200:24.0:1773851860.428519:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 2
00000400:00000200:24.0:1773851860.428520:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 3
00000400:00000200:24.0:1773851860.428521:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20769@kfi7 local destination
00000400:00000200:24.0:1773851860.428523:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768906:8768906:1024:4294967295] 20769@kfi7 LPNI seq info [2566880:2566880:16:4294967295]
00000400:00000200:24.0:1773851860.428524:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 2
00000400:00000200:24.0:1773851860.428525:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20769@kfi7 to cpt 6
00000400:00000200:24.0:1773851860.428527:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20769@kfi7(20769@kfi7:20769@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851860.428528:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 3
00000800:00000200:24.0:1773851860.428530:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851860.428531:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851860.428533:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851860.428535:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d Using peer 20769@kfi7(0x10000000000120d)
00000800:00000200:24.0:1773851860.428538:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0x10000000000120d: rc=0
00000800:00000200:24.0:1773851860.428540:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851860.428542:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.428542:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000024eff6a3 refcount 2 to 20961@kfi7
00010000:00000001:24.0:1773851860.428543:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851860.428544:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.428544:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851860.428545:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a8f925ba x1859315730052032/t0(0) o400->429ba700-3a73-4a1e-94e0-f2d2c040c60e@20961@kfi7:77/0 lens 224/224 e 0 to 0 dl 1773852192 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1791-0'
00000100:00100000:24.0:1773851860.428550:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8f925ba pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:429ba700-3a73-4a1e-94e0-f2d2c040c60e+557:39507:x1859315730052032:12345-20961@kfi7:400:default-tuolumne1791-0 Request processed in 62us (112us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851860.428552:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20961@kfi7, seq: 2025068
00000100:00000040:24.0:1773851860.428553:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000027beeb13 : new rpc_count 5
00000100:00000001:24.0:1773851860.428553:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851860.428554:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851860.428554:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851860.428555:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a35ab917.
00000020:00000010:24.0:1773851860.428556:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089cac470.
00000020:00000040:24.0:1773851860.428557:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000027beeb13 : new refcount 556
00000100:00000001:24.0:1773851860.428560:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851860.428565:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851860.428567:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851860.428568:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20769@kfi7: PUT: OK
00000400:00000200:26.0:1773851860.428569:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d7bd97df
00000400:00000010:26.0:1773851860.428569:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d7bd97df.
00000100:00000001:26.0:1773851860.428570:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851860.428571:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851860.428572:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ccf3adc0 nid 20769@kfi7 refs 2
00000800:00000200:26.0:1773851860.428574:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 20769@kfi7(000000009a5605f6):0x0 lsk 4622 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000120d Transaction freed
00000800:00000200:17.0:1773851860.434913:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.434914:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.434916:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.434920:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.434925:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16082@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.434927:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16082@kfi7 : PUT - for me
00000400:00000200:17.0:1773851860.434929:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16082@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.434930:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006de74b34 nid 16082@kfi7 refs 1
00000400:00000200:17.0:1773851860.434932:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16082@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.434933:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006de74b34 nid 16082@kfi7 refs 2
00000400:00000200:17.0:1773851860.434935:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006de74b34 nid 16082@kfi7 refs 3
00000400:00000200:17.0:1773851860.434936:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16083@kfi7 to cpt 7
00000400:00000200:17.0:1773851860.434938:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16083@kfi7 of length 224 into portal 12 MB=0x69b4b5b7d41c0
00000400:00000200:17.0:1773851860.434940:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16083@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 896
00000800:00000200:17.0:1773851860.434943:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.434947:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.434949:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16082@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.434950:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.434951:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.434952:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008e50b604.
00000100:00000040:17.0:1773851860.434954:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000008e50b604 x1859597820051904 msgsize 224
00000100:00100000:17.0:1773851860.434956:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16083@kfi7 (source: 12345-16082@kfi7)
00000100:00000001:17.0:1773851860.434958:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.434960:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006de74b34 nid 16082@kfi7 refs 2
00000100:00000001:19.0:1773851860.434961:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851860.434962:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851860.434962:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851860.434963:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851860.434963:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851860.434965:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851860.434966:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597820051904
00000020:00000001:19.0:1773851860.434967:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851860.434968:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82d19
00000020:00000001:19.0:1773851860.434969:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851860.434973:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000357297fe refcount=166
00000020:00000001:19.0:1773851860.434974:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636964303989760 : -107109405561856 : ffff9e95a5edec00)
00000020:00000001:19.0:1773851860.434976:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636964303989760 : -107109405561856 : ffff9e95a5edec00)
00000100:00000001:19.0:1773851860.434978:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851860.434979:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851860.434980:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e7f7db99.
00000020:00000010:19.0:1773851860.434982:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851860.434983:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050de7c24.
00000100:00000001:19.0:1773851860.434985:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851860.434985:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851860.434986:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.434988:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851860.434989:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851860.434990:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.434992:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.434994:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851860.434994:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.434995:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851860.434995:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851860.434997:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16083@kfi7, seq: 2156286
00000100:00000040:19.0:1773851860.434998:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000357297fe : new rpc_count 1
00000100:00000001:18.0:1773851860.434998:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.434999:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764347136 : -107095945204480 : ffff9e98c83aad00)
00000100:00000001:18.0:1773851860.434999:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851860.435001:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008e50b604 x1859597820051904/t0(0) o400->64912edd-4a24-4f8f-aeb1-0c974bf06e15@16083@kfi7:50/0 lens 224/0 e 0 to 0 dl 1773852165 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1493-0'
00000100:00000001:19.0:1773851860.435007:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851860.435008:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851860.435009:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e50b604 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:64912edd-4a24-4f8f-aeb1-0c974bf06e15+166:39557:x1859597820051904:12345-16083@kfi7:400:default-tuolumne1493-0
00000100:00000200:19.0:1773851860.435012:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597820051904
00000020:00000001:19.0:1773851860.435013:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851860.435014:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851860.435015:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.435016:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851860.435017:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851860.435019:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851860.435019:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597820051904, found 0 last_xid 1859597819628287
00000020:00000001:19.0:1773851860.435021:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851860.435022:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851860.435023:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851860.435024:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.435025:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851860.435026:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851860.435027:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851860.435028:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000380b86f9.
02000000:00000001:19.0:1773851860.435029:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.435030:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.435032:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851860.435033:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062186, transno 0, xid 1859597820051904
00010000:00000001:19.0:1773851860.435034:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851860.435035:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008e50b604 x1859597820051904/t0(0) o400->64912edd-4a24-4f8f-aeb1-0c974bf06e15@16083@kfi7:50/0 lens 224/224 e 0 to 0 dl 1773852165 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1493-0'
00010000:00000001:19.0:1773851860.435040:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851860.435041:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851860.435042:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851860.435044:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851860.435045:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c58925a0 refcount 3 to 16083@kfi7
00000100:00000001:19.0:1773851860.435046:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272544 : -107152618279072 : ffff9e8b96402f60)
02000000:00000001:19.0:1773851860.435049:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851860.435050:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.435051:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851860.435052:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16082@kfi7
00000400:00000010:19.0:1773851860.435053:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cf6e4638.
00000100:00000200:19.0:1773851860.435055:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597820051904, offset 224
00000400:00000200:19.0:1773851860.435057:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16082@kfi7
00000400:00000200:19.0:1773851860.435058:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16082@kfi7 to cpt 4
00000400:00000200:19.0:1773851860.435060:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006de74b34 nid 16082@kfi7 refs 1
00000400:00000200:19.0:1773851860.435061:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006de74b34 nid 16082@kfi7 refs 2
00000400:00000200:19.0:1773851860.435063:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006de74b34 nid 16082@kfi7 refs 3
00000400:00000200:19.0:1773851860.435065:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16082@kfi7 local destination
00000400:00000200:19.0:1773851860.435068:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768907:8768907:1024:4294967295] 16082@kfi7 LPNI seq info [291939:291939:16:4294967295]
00000400:00000200:19.0:1773851860.435071:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006de74b34 nid 16082@kfi7 refs 2
00000400:00000200:19.0:1773851860.435072:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16082@kfi7 to cpt 4
00000400:00000200:19.0:1773851860.435076:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16082@kfi7(16082@kfi7:16082@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851860.435078:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006de74b34 nid 16082@kfi7 refs 3
00000800:00000200:19.0:1773851860.435080:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851860.435082:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851860.435086:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851860.435090:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0xce5 Using peer 16082@kfi7(0xce5)
00000800:00000200:19.0:1773851860.435094:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0xce5: rc=0
00000800:00000200:19.0:1773851860.435095:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0xce5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851860.435098:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851860.435099:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c58925a0 refcount 2 to 16083@kfi7
00010000:00000001:19.0:1773851860.435099:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851860.435100:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851860.435102:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851860.435102:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008e50b604 x1859597820051904/t0(0) o400->64912edd-4a24-4f8f-aeb1-0c974bf06e15@16083@kfi7:50/0 lens 224/224 e 0 to 0 dl 1773852165 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1493-0'
00000100:00100000:19.0:1773851860.435106:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e50b604 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:64912edd-4a24-4f8f-aeb1-0c974bf06e15+166:39557:x1859597820051904:12345-16083@kfi7:400:default-tuolumne1493-0 Request processed in 98us (151us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851860.435108:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0xce5 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851860.435109:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16083@kfi7, seq: 2156286
00000100:00000040:19.0:1773851860.435109:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000357297fe : new rpc_count 0
00000100:00000001:19.0:1773851860.435110:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851860.435110:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851860.435111:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851860.435111:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851860.435111:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16082@kfi7: PUT: OK
00000020:00000010:19.0:1773851860.435112:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050de7c24.
00000400:00000200:17.0:1773851860.435112:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cf6e4638
00000400:00000010:17.0:1773851860.435112:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cf6e4638.
00000020:00000010:19.0:1773851860.435113:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e7f7db99.
00000100:00000001:17.0:1773851860.435113:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.435113:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:19.0:1773851860.435114:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000357297fe : new refcount 165
00000400:00000200:17.0:1773851860.435114:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006de74b34 nid 16082@kfi7 refs 2
00000100:00000001:19.0:1773851860.435115:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851860.435116:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 16082@kfi7(000000006d8f8d8c):0x0 lsk 3302 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0xce5 Transaction freed
00000800:00000200:15.0:1773851860.459004:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.459005:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851860.459006:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851860.459008:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851860.459010:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21891@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.459012:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21891@kfi7 : PUT - for me
00000400:00000200:15.0:1773851860.459013:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21891@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.459013:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007441fc87 nid 21891@kfi7 refs 1
00000400:00000200:15.0:1773851860.459015:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21891@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.459015:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007441fc87 nid 21891@kfi7 refs 2
00000400:00000200:15.0:1773851860.459016:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007441fc87 nid 21891@kfi7 refs 3
00000400:00000200:15.0:1773851860.459017:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21826@kfi7 to cpt 4
00000400:00000200:15.0:1773851860.459018:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21826@kfi7 of length 224 into portal 12 MB=0x69b0a16a95dc0
00000400:00000200:15.0:1773851860.459019:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21826@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 21960
00000800:00000200:15.0:1773851860.459021:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851860.459023:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851860.459024:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21891@kfi7: PUT: OK
00000100:00000001:15.0:1773851860.459025:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851860.459026:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851860.459027:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002c9625a3.
00000100:00000040:15.0:1773851860.459027:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000002c9625a3 x1859317492440512 msgsize 224
00000100:00100000:15.0:1773851860.459029:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-21826@kfi7 (source: 12345-21891@kfi7)
00000100:00000001:15.0:1773851860.459030:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851860.459031:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007441fc87 nid 21891@kfi7 refs 2
00000800:00000200:15.0:1773851860.459033:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851860.459038:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851860.459038:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851860.459039:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851860.459039:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851860.459040:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851860.459041:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317492440512
00000020:00000001:15.0:1773851860.459041:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851860.459042:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92792
00000020:00000001:15.0:1773851860.459042:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851860.459046:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d886aa27 refcount=8
00000020:00000001:15.0:1773851860.459047:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631507968 : -107123078043648 : ffff9e9276fc6800)
00000020:00000001:15.0:1773851860.459048:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631507968 : -107123078043648 : ffff9e9276fc6800)
00000100:00000001:15.0:1773851860.459049:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.459050:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851860.459050:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000065e29ee.
00000020:00000010:15.0:1773851860.459052:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.459052:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851860.459053:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851860.459054:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851860.459054:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.459055:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851860.459056:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851860.459056:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.459057:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.459058:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.459059:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851860.459060:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21826@kfi7, seq: 2289804
00000100:00000040:15.0:1773851860.459060:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d886aa27 : new rpc_count 1
00000100:00000001:13.0:1773851860.459060:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851860.459060:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851860.459061:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860198784 : -107049849352832 : ffff9ea383c18d80)
00000100:00000001:13.0:1773851860.459061:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.459062:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002c9625a3 x1859317492440512/t0(0) o400->5f4706ab-43da-4e25-8b6c-e587db8f080a@21826@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1864-0'
00000100:00000001:13.0:1773851860.459062:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.459065:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.459065:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851860.459067:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c9625a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:5f4706ab-43da-4e25-8b6c-e587db8f080a+8:39518:x1859317492440512:12345-21826@kfi7:400:default-tuolumne1864-0
00000100:00000200:15.0:1773851860.459068:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317492440512
00000020:00000001:15.0:1773851860.459069:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851860.459069:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851860.459070:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.459071:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851860.459071:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851860.459072:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851860.459073:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317492440512, found 0 last_xid 1859317492440511
00000020:00000001:15.0:1773851860.459073:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851860.459074:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851860.459075:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851860.459075:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.459076:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851860.459076:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851860.459077:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851860.459078:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000514c091f.
02000000:00000001:15.0:1773851860.459078:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.459079:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.459080:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851860.459080:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044169476, transno 0, xid 1859317492440512
00010000:00000001:15.0:1773851860.459081:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851860.459082:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002c9625a3 x1859317492440512/t0(0) o400->5f4706ab-43da-4e25-8b6c-e587db8f080a@21826@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1864-0'
00010000:00000001:15.0:1773851860.459084:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851860.459085:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851860.459085:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851860.459086:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851860.459087:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f7ebdb3b refcount 3 to 21826@kfi7
00000100:00000001:15.0:1773851860.459088:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333952 : -107155408217664 : ffff9e8aeff519c0)
02000000:00000001:15.0:1773851860.459089:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851860.459089:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.459090:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851860.459091:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21891@kfi7
00000400:00000010:15.0:1773851860.459092:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a0412e34.
00000100:00000200:15.0:1773851860.459093:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317492440512, offset 224
00000400:00000200:15.0:1773851860.459094:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21891@kfi7
00000400:00000200:15.0:1773851860.459095:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21891@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.459096:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007441fc87 nid 21891@kfi7 refs 1
00000400:00000200:15.0:1773851860.459097:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007441fc87 nid 21891@kfi7 refs 2
00000400:00000200:15.0:1773851860.459097:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007441fc87 nid 21891@kfi7 refs 3
00000400:00000200:15.0:1773851860.459099:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21891@kfi7 local destination
00000400:00000200:15.0:1773851860.459100:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768908:8768908:1024:4294967295] 21891@kfi7 LPNI seq info [541454:541454:16:4294967295]
00000400:00000200:15.0:1773851860.459101:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007441fc87 nid 21891@kfi7 refs 2
00000400:00000200:15.0:1773851860.459102:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21891@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.459104:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21891@kfi7(21891@kfi7:21891@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851860.459105:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007441fc87 nid 21891@kfi7 refs 3
00000800:00000200:15.0:1773851860.459107:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.459108:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851860.459110:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851860.459112:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008b7 Using peer 21891@kfi7(0x1000000000008b7)
00000800:00000200:15.0:1773851860.459115:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x1000000000008b7: rc=0
00000800:00000200:15.0:1773851860.459117:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008b7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851860.459119:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.459119:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f7ebdb3b refcount 2 to 21826@kfi7
00010000:00000001:15.0:1773851860.459120:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851860.459121:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.459121:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851860.459122:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002c9625a3 x1859317492440512/t0(0) o400->5f4706ab-43da-4e25-8b6c-e587db8f080a@21826@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1864-0'
00000100:00100000:15.0:1773851860.459129:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c9625a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:5f4706ab-43da-4e25-8b6c-e587db8f080a+8:39518:x1859317492440512:12345-21826@kfi7:400:default-tuolumne1864-0 Request processed in 63us (101us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851860.459130:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008b7 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851860.459131:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21826@kfi7, seq: 2289804
00000100:00000040:15.0:1773851860.459132:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d886aa27 : new rpc_count 0
00000100:00000001:15.0:1773851860.459133:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851860.459133:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851860.459134:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851860.459134:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.459135:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000020:00000010:15.0:1773851860.459135:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000065e29ee.
00000400:00000200:13.0:1773851860.459135:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21891@kfi7: PUT: OK
00000020:00000040:15.0:1773851860.459136:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000d886aa27 : new refcount 7
00000400:00000200:13.0:1773851860.459136:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a0412e34
00000100:00000001:15.0:1773851860.459137:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851860.459137:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a0412e34.
00000100:00000001:13.0:1773851860.459139:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851860.459139:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851860.459140:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007441fc87 nid 21891@kfi7 refs 2
00000800:00000200:13.0:1773851860.459143:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 21891@kfi7(000000008a4eebca):0x0 lsk 2232 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008b7 Transaction freed
00000800:00000200:1.0:1773851860.466131:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.466132:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.466133:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.466138:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.466140:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11536@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.466141:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11536@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.466142:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11536@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.466143:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc0cf105 nid 11536@kfi7 refs 1
00000400:00000200:1.0:1773851860.466144:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11536@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.466144:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc0cf105 nid 11536@kfi7 refs 2
00000400:00000200:1.0:1773851860.466145:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fc0cf105 nid 11536@kfi7 refs 3
00000400:00000200:1.0:1773851860.466146:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11536@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.466147:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11536@kfi7 of length 224 into portal 12 MB=0x69b4b9e40ed80
00000400:00000200:1.0:1773851860.466148:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11536@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 20288
00000800:00000200:1.0:1773851860.466150:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.466152:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.466153:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11536@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.466154:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.466155:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.466155:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000621ba5f5.
00000100:00000040:1.0:1773851860.466156:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000621ba5f5 x1859598940171648 msgsize 224
00000100:00100000:1.0:1773851860.466158:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11536@kfi7 (source: 12345-11536@kfi7)
00000100:00000001:1.0:1773851860.466159:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.466159:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fc0cf105 nid 11536@kfi7 refs 2
00000100:00000001:0.0:1773851860.466160:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.466161:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.466161:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.466161:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.466162:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.466162:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.466163:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598940171648
00000020:00000001:0.0:1773851860.466164:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.466164:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3b6dbdea
00000020:00000001:0.0:1773851860.466165:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.466166:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008009c501 refcount=74
00000020:00000001:0.0:1773851860.466167:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148138082304 : -106925571469312 : ffff9ec0734b9000)
00000020:00000001:0.0:1773851860.466168:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148138082304 : -106925571469312 : ffff9ec0734b9000)
00000100:00000001:0.0:1773851860.466169:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.466169:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.466170:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851860.466171:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.466172:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.466173:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.466173:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.466173:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.466174:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.466175:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.466175:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.466176:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.466177:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.466178:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.466178:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.466178:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.466179:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11536@kfi7, seq: 1997523
00000100:00000001:1.0:1773851860.466180:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851860.466180:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.466180:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008009c501 : new rpc_count 2
00000100:00000001:0.0:1773851860.466180:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064180666880 : -107009528884736 : ffff9eace70b1200)
00000100:00000040:0.0:1773851860.466181:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000621ba5f5 x1859598940171648/t0(0) o400->47ac7234-bbb8-455f-b6d4-223893c86e76@11536@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1217-0'
00000100:00000001:0.0:1773851860.466184:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.466185:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.466186:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000621ba5f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:47ac7234-bbb8-455f-b6d4-223893c86e76+74:39712:x1859598940171648:12345-11536@kfi7:400:default-tuolumne1217-0
00000100:00000200:0.0:1773851860.466187:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598940171648
00000020:00000001:0.0:1773851860.466188:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.466188:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.466189:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.466190:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.466190:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.466191:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.466191:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598940171648, found 0 last_xid 1859598939603455
00000020:00000001:0.0:1773851860.466192:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.466193:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.466193:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.466194:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.466194:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.466195:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.466196:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.466196:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c7901888.
02000000:00000001:0.0:1773851860.466197:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.466198:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.466198:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.466199:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584825, transno 0, xid 1859598940171648
00010000:00000001:0.0:1773851860.466199:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.466200:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000621ba5f5 x1859598940171648/t0(0) o400->47ac7234-bbb8-455f-b6d4-223893c86e76@11536@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1217-0'
00010000:00000001:0.0:1773851860.466203:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.466203:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.466204:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.466205:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.466206:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000090f16c1a refcount 3 to 11536@kfi7
00000100:00000001:0.0:1773851860.466207:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050240 : -107154804501376 : ffff9e8b13f11480)
02000000:00000001:0.0:1773851860.466219:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.466220:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.466220:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.466221:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11536@kfi7
00000400:00000010:0.0:1773851860.466222:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013214890.
00000100:00000200:0.0:1773851860.466222:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598940171648, offset 224
00000400:00000200:0.0:1773851860.466224:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11536@kfi7
00000400:00000200:0.0:1773851860.466225:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11536@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.466225:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc0cf105 nid 11536@kfi7 refs 1
00000400:00000200:0.0:1773851860.466226:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fc0cf105 nid 11536@kfi7 refs 2
00000400:00000200:0.0:1773851860.466227:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fc0cf105 nid 11536@kfi7 refs 3
00000400:00000200:0.0:1773851860.466229:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11536@kfi7 local destination
00000400:00000200:0.0:1773851860.466230:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768909:8768909:1024:4294967295] 11536@kfi7 LPNI seq info [1060277:1060277:16:4294967295]
00000400:00000200:0.0:1773851860.466231:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fc0cf105 nid 11536@kfi7 refs 2
00000400:00000200:0.0:1773851860.466232:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11536@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.466234:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11536@kfi7(11536@kfi7:11536@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.466235:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fc0cf105 nid 11536@kfi7 refs 3
00000800:00000200:0.0:1773851860.466236:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.466237:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.466239:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.466241:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7d1 Using peer 11536@kfi7(0x7d1)
00000800:00000200:0.0:1773851860.466244:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x7d1: rc=0
00000800:00000200:0.0:1773851860.466245:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.466247:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.466248:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000090f16c1a refcount 2 to 11536@kfi7
00010000:00000001:0.0:1773851860.466249:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.466250:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.466251:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.466252:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000621ba5f5 x1859598940171648/t0(0) o400->47ac7234-bbb8-455f-b6d4-223893c86e76@11536@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1217-0'
00000100:00100000:0.0:1773851860.466257:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000621ba5f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:47ac7234-bbb8-455f-b6d4-223893c86e76+74:39712:x1859598940171648:12345-11536@kfi7:400:default-tuolumne1217-0 Request processed in 71us (99us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.466259:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11536@kfi7, seq: 1997523
00000100:00000040:0.0:1773851860.466259:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008009c501 : new rpc_count 1
00000100:00000001:0.0:1773851860.466260:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.466261:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.466261:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.466262:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.466263:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851860.466264:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000008009c501 : new refcount 73
00000100:00000001:0.0:1773851860.466264:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.466269:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7d1 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.466270:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.466272:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11536@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.466273:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013214890
00000400:00000010:1.0:1773851860.466273:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013214890.
00000100:00000001:1.0:1773851860.466274:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.466274:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.466275:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fc0cf105 nid 11536@kfi7 refs 2
00000800:00000200:1.0:1773851860.466277:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 11536@kfi7(00000000c7457c6d):0x0 lsk 2002 rsk 27 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7d1 Transaction freed
00000800:00000200:9.0:1773851860.470734:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.470734:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.470736:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.470738:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.470739:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17139@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.470741:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17139@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.470741:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17139@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.470742:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034f70bd4 nid 17139@kfi7 refs 1
00000400:00000200:9.0:1773851860.470743:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17139@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.470744:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034f70bd4 nid 17139@kfi7 refs 2
00000400:00000200:9.0:1773851860.470744:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000034f70bd4 nid 17139@kfi7 refs 3
00000400:00000200:9.0:1773851860.470745:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17139@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.470746:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17139@kfi7 of length 224 into portal 12 MB=0x69b4b740320c0
00000400:00000200:9.0:1773851860.470747:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17139@kfi7 of length 224/224 into md 0x78146ce49 [64] + 127696
00000800:00000200:9.0:1773851860.470749:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.470750:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.470751:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17139@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.470752:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.470753:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.470754:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e4fb9b89.
00000100:00000040:9.0:1773851860.470755:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e4fb9b89 x1859598231478464 msgsize 224
00000100:00100000:9.0:1773851860.470756:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17139@kfi7 (source: 12345-17139@kfi7)
00000100:00000001:9.0:1773851860.470758:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851860.470759:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851860.470759:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000034f70bd4 nid 17139@kfi7 refs 2
02000000:00000001:11.0:1773851860.470760:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851860.470760:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851860.470760:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851860.470761:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851860.470761:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851860.470762:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598231478464
00000020:00000001:11.0:1773851860.470763:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851860.470763:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a2c
00000020:00000001:11.0:1773851860.470764:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851860.470766:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006db8c375 refcount=169
00000020:00000001:11.0:1773851860.470766:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064125250560 : -107009584301056 : ffff9eace3bd7c00)
00000020:00000001:11.0:1773851860.470767:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637064125250560 : -107009584301056 : ffff9eace3bd7c00)
00000100:00000001:11.0:1773851860.470769:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.470769:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851860.470770:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000036174187.
00000020:00000010:11.0:1773851860.470771:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.470772:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507ae6bc.
00000100:00000001:11.0:1773851860.470773:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851860.470773:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851860.470774:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.470775:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851860.470775:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851860.470775:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.470776:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.470778:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.470778:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851860.470778:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851860.470778:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851860.470779:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17139@kfi7, seq: 2130750
00000100:00000001:11.0:1773851860.470780:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851860.470780:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006db8c375 : new rpc_count 1
00000100:00000001:11.0:1773851860.470781:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.470781:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922903936 : -107141786647680 : ffff9e8e1bddc380)
00000100:00000040:10.0:1773851860.470782:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e4fb9b89 x1859598231478464/t0(0) o400->b41e64fe-037f-4d4e-8965-c9908618df7e@17139@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1545-0'
00000100:00000001:10.0:1773851860.470785:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851860.470785:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851860.470786:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e4fb9b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b41e64fe-037f-4d4e-8965-c9908618df7e+169:39555:x1859598231478464:12345-17139@kfi7:400:default-tuolumne1545-0
00000100:00000200:10.0:1773851860.470787:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598231478464
00000020:00000001:10.0:1773851860.470788:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:10.0:1773851860.470789:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:10.0:1773851860.470789:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.470790:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851860.470790:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:10.0:1773851860.470791:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:10.0:1773851860.470792:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598231478464, found 0 last_xid 1859598231057023
00000020:00000001:10.0:1773851860.470793:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851860.470793:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:10.0:1773851860.470794:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851860.470794:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.470795:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:10.0:1773851860.470796:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851860.470797:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851860.470798:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001b5c1536.
02000000:00000001:10.0:1773851860.470799:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.470799:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.470800:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851860.470801:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063253, transno 0, xid 1859598231478464
00010000:00000001:10.0:1773851860.470801:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:10.0:1773851860.470802:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e4fb9b89 x1859598231478464/t0(0) o400->b41e64fe-037f-4d4e-8965-c9908618df7e@17139@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1545-0'
00010000:00000001:10.0:1773851860.470804:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851860.470805:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851860.470806:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851860.470807:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851860.470807:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b12190fc refcount 3 to 17139@kfi7
00000100:00000001:10.0:1773851860.470808:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899609696 : -107146809941920 : ffff9e8cf0746060)
02000000:00000001:10.0:1773851860.470809:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851860.470810:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.470810:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851860.470811:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17139@kfi7
00000400:00000010:10.0:1773851860.470812:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dbef00b4.
00000100:00000200:10.0:1773851860.470813:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598231478464, offset 224
00000400:00000200:10.0:1773851860.470814:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17139@kfi7
00000400:00000200:10.0:1773851860.470815:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17139@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.470815:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034f70bd4 nid 17139@kfi7 refs 1
00000400:00000200:10.0:1773851860.470816:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000034f70bd4 nid 17139@kfi7 refs 2
00000400:00000200:10.0:1773851860.470817:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000034f70bd4 nid 17139@kfi7 refs 3
00000400:00000200:10.0:1773851860.470818:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17139@kfi7 local destination
00000400:00000200:10.0:1773851860.470819:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768910:8768910:1024:4294967295] 17139@kfi7 LPNI seq info [1187332:1187332:16:4294967295]
00000400:00000200:10.0:1773851860.470821:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000034f70bd4 nid 17139@kfi7 refs 2
00000400:00000200:10.0:1773851860.470821:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17139@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.470823:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17139@kfi7(17139@kfi7:17139@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851860.470824:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000034f70bd4 nid 17139@kfi7 refs 3
00000800:00000200:10.0:1773851860.470826:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851860.470827:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851860.470829:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851860.470832:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000013b Using peer 17139@kfi7(0x10000000000013b)
00000800:00000200:10.0:1773851860.470835:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000019dc57a6: Posted send of 324 bytes to peer 0x10000000000013b: rc=0
00000800:00000200:10.0:1773851860.470836:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000013b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851860.470838:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851860.470839:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b12190fc refcount 2 to 17139@kfi7
00010000:00000001:10.0:1773851860.470840:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:10.0:1773851860.470840:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851860.470841:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:10.0:1773851860.470842:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e4fb9b89 x1859598231478464/t0(0) o400->b41e64fe-037f-4d4e-8965-c9908618df7e@17139@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1545-0'
00000100:00100000:10.0:1773851860.470845:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e4fb9b89 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b41e64fe-037f-4d4e-8965-c9908618df7e+169:39555:x1859598231478464:12345-17139@kfi7:400:default-tuolumne1545-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851860.470847:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17139@kfi7, seq: 2130750
00000100:00000040:10.0:1773851860.470847:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006db8c375 : new rpc_count 0
00000100:00000001:10.0:1773851860.470848:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851860.470848:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000013b TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851860.470849:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851860.470849:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:9.0:1773851860.470849:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851860.470850:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507ae6bc.
00000400:00000200:9.0:1773851860.470850:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17139@kfi7: PUT: OK
00000020:00000010:10.0:1773851860.470851:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000036174187.
00000020:00000040:10.0:1773851860.470851:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000006db8c375 : new refcount 168
00000400:00000200:9.0:1773851860.470851:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dbef00b4
00000400:00000010:9.0:1773851860.470851:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dbef00b4.
00000100:00000001:10.0:1773851860.470852:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851860.470852:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851860.470853:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851860.470853:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000034f70bd4 nid 17139@kfi7 refs 2
00000800:00000200:9.0:1773851860.470855:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2054@kfi7:2 -> 17139@kfi7(000000002595663f):0x0 lsk 316 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000013b Transaction freed
00000800:00000200:1.0:1773851860.505165:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.505166:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.505167:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.505169:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.505171:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14866@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.505172:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14866@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.505173:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14866@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.505174:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7583faf nid 14866@kfi7 refs 1
00000400:00000200:1.0:1773851860.505175:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14866@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.505176:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7583faf nid 14866@kfi7 refs 2
00000400:00000200:1.0:1773851860.505176:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e7583faf nid 14866@kfi7 refs 3
00000400:00000200:1.0:1773851860.505177:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14867@kfi7 to cpt 3
00000400:00000200:1.0:1773851860.505178:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14867@kfi7 of length 224 into portal 12 MB=0x69b4b5bee1240
00000400:00000200:1.0:1773851860.505179:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14867@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 20512
00000800:00000200:1.0:1773851860.505181:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.505183:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.505184:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14866@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.505185:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.505185:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.505186:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000090338c70.
00000100:00000040:1.0:1773851860.505186:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000090338c70 x1859597827445312 msgsize 224
00000100:00100000:1.0:1773851860.505189:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14867@kfi7 (source: 12345-14866@kfi7)
00000100:00000001:1.0:1773851860.505190:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.505191:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7583faf nid 14866@kfi7 refs 2
00000100:00000001:0.0:1773851860.505191:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.505192:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.505192:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.505192:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.505193:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.505194:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.505194:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597827445312
00000020:00000001:0.0:1773851860.505195:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.505195:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f06c
00000020:00000001:0.0:1773851860.505196:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.505197:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003107c576 refcount=167
00000020:00000001:0.0:1773851860.505198:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637115121514496 : -106958588037120 : ffff9eb8c35ab800)
00000020:00000001:0.0:1773851860.505199:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637115121514496 : -106958588037120 : ffff9eb8c35ab800)
00000100:00000001:0.0:1773851860.505200:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.505200:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.505201:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851860.505202:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.505203:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.505204:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.505204:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.505205:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.505206:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.505207:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.505207:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.505208:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.505209:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.505210:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.505210:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.505210:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.505211:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14867@kfi7, seq: 1997524
00000100:00000040:0.0:1773851860.505211:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003107c576 : new rpc_count 1
00000100:00000001:1.0:1773851860.505212:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851860.505212:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.505212:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064180664576 : -107009528887040 : ffff9eace70b0900)
00000100:00000040:0.0:1773851860.505213:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000090338c70 x1859597827445312/t0(0) o400->4127317b-d94b-4c17-9ae7-b7fcb6db47f4@14867@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1429-0'
00000100:00000001:0.0:1773851860.505216:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.505216:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.505217:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090338c70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4127317b-d94b-4c17-9ae7-b7fcb6db47f4+167:39706:x1859597827445312:12345-14867@kfi7:400:default-tuolumne1429-0
00000100:00000200:0.0:1773851860.505219:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597827445312
00000020:00000001:0.0:1773851860.505219:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.505220:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.505220:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.505221:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.505222:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.505222:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.505223:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597827445312, found 0 last_xid 1859597827025919
00000020:00000001:0.0:1773851860.505224:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.505224:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.505225:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.505225:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.505226:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.505227:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.505227:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.505228:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c28b7902.
02000000:00000001:0.0:1773851860.505228:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.505229:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.505230:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.505231:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062666, transno 0, xid 1859597827445312
00010000:00000001:0.0:1773851860.505232:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.505232:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000090338c70 x1859597827445312/t0(0) o400->4127317b-d94b-4c17-9ae7-b7fcb6db47f4@14867@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1429-0'
00010000:00000001:0.0:1773851860.505235:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.505235:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.505236:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.505237:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.505237:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d704668e refcount 3 to 14867@kfi7
00000100:00000001:0.0:1773851860.505238:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149728 : -107154898401888 : ffff9e8b0e5845a0)
02000000:00000001:0.0:1773851860.505239:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.505239:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.505240:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.505240:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14866@kfi7
00000400:00000010:0.0:1773851860.505241:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013214890.
00000100:00000200:0.0:1773851860.505242:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597827445312, offset 224
00000400:00000200:0.0:1773851860.505243:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14866@kfi7
00000400:00000200:0.0:1773851860.505244:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14866@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.505245:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7583faf nid 14866@kfi7 refs 1
00000400:00000200:0.0:1773851860.505246:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e7583faf nid 14866@kfi7 refs 2
00000400:00000200:0.0:1773851860.505247:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e7583faf nid 14866@kfi7 refs 3
00000400:00000200:0.0:1773851860.505248:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14866@kfi7 local destination
00000400:00000200:0.0:1773851860.505249:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768911:8768911:1024:4294967295] 14866@kfi7 LPNI seq info [564180:564180:16:4294967295]
00000400:00000200:0.0:1773851860.505250:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e7583faf nid 14866@kfi7 refs 2
00000400:00000200:0.0:1773851860.505251:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14866@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.505253:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14866@kfi7(14866@kfi7:14866@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.505254:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e7583faf nid 14866@kfi7 refs 3
00000800:00000200:0.0:1773851860.505255:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.505257:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.505258:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.505262:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11a9 Using peer 14866@kfi7(0x11a9)
00000800:00000200:0.0:1773851860.505264:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x11a9: rc=0
00000800:00000200:0.0:1773851860.505265:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11a9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.505267:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.505268:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d704668e refcount 2 to 14867@kfi7
00010000:00000001:0.0:1773851860.505269:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.505269:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.505270:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.505270:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000090338c70 x1859597827445312/t0(0) o400->4127317b-d94b-4c17-9ae7-b7fcb6db47f4@14867@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1429-0'
00000100:00100000:0.0:1773851860.505275:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090338c70 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4127317b-d94b-4c17-9ae7-b7fcb6db47f4+167:39706:x1859597827445312:12345-14867@kfi7:400:default-tuolumne1429-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.505277:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14867@kfi7, seq: 1997524
00000100:00000040:0.0:1773851860.505278:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003107c576 : new rpc_count 0
00000100:00000001:0.0:1773851860.505278:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.505279:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.505279:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.505280:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.505281:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851860.505282:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003107c576 : new refcount 166
00000100:00000001:0.0:1773851860.505282:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.505287:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11a9 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.505289:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.505290:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14866@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.505290:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013214890
00000400:00000010:1.0:1773851860.505291:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013214890.
00000100:00000001:1.0:1773851860.505292:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.505292:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.505293:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7583faf nid 14866@kfi7 refs 2
00000800:00000200:1.0:1773851860.505294:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14866@kfi7(000000000be70def):0x0 lsk 4522 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11a9 Transaction freed
00000800:00000200:29.0:1773851860.505780:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851860.505780:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851860.505782:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851860.505784:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851860.505785:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15968@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.505787:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15968@kfi7 : PUT - for me
00000400:00000200:29.0:1773851860.505787:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15968@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.505788:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f87d98bb nid 15968@kfi7 refs 1
00000400:00000200:29.0:1773851860.505789:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15968@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.505790:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f87d98bb nid 15968@kfi7 refs 2
00000400:00000200:29.0:1773851860.505791:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f87d98bb nid 15968@kfi7 refs 3
00000400:00000200:29.0:1773851860.505793:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16032@kfi7 to cpt 3
00000400:00000200:29.0:1773851860.505793:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16032@kfi7 of length 224 into portal 12 MB=0x69b4b59812c00
00000400:00000200:29.0:1773851860.505795:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16032@kfi7 of length 224/224 into md 0x77fe139dd [64] + 168064
00000800:00000200:29.0:1773851860.505797:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851860.505799:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.505800:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15968@kfi7: PUT: OK
00000100:00000001:29.0:1773851860.505801:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851860.505801:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851860.505802:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b5235fc3.
00000100:00000040:29.0:1773851860.505803:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000b5235fc3 x1859597786754048 msgsize 224
00000100:00100000:29.0:1773851860.505804:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16032@kfi7 (source: 12345-15968@kfi7)
00000100:00000001:29.0:1773851860.505805:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851860.505806:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f87d98bb nid 15968@kfi7 refs 2
00000100:00000001:28.0:1773851860.505807:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851860.505807:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851860.505808:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851860.505808:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851860.505809:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851860.505809:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851860.505810:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597786754048
00000020:00000001:28.0:1773851860.505811:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851860.505811:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82697
00000020:00000001:28.0:1773851860.505812:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851860.505816:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002ca0c1c4 refcount=167
00000020:00000001:28.0:1773851860.505817:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109687015424 : -106964022536192 : ffff9eb77f6ed800)
00000020:00000001:28.0:1773851860.505818:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637109687015424 : -106964022536192 : ffff9eb77f6ed800)
00000100:00000001:28.0:1773851860.505819:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851860.505820:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851860.505820:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aceb0722.
00000020:00000010:28.0:1773851860.505821:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851860.505822:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a24bde0f.
00000100:00000001:28.0:1773851860.505823:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851860.505824:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851860.505824:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851860.505826:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851860.505826:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851860.505827:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851860.505828:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851860.505829:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851860.505829:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851860.505830:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851860.505830:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851860.505832:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16032@kfi7, seq: 2055488
00000100:00000040:31.0:1773851860.505833:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002ca0c1c4 : new rpc_count 1
00000100:00000001:28.0:1773851860.505833:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.505834:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221529088 : -106948488022528 : ffff9ebb1d5cb600)
00000100:00000001:28.0:1773851860.505834:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851860.505836:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b5235fc3 x1859597786754048/t0(0) o400->5ef68508-0e37-4a63-b8d1-91a2f1213eb1@16032@kfi7:648/0 lens 224/0 e 0 to 0 dl 1773852008 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1488-0'
00000100:00000001:31.0:1773851860.505839:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851860.505839:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851860.505840:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5235fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5ef68508-0e37-4a63-b8d1-91a2f1213eb1+167:39702:x1859597786754048:12345-16032@kfi7:400:default-tuolumne1488-0
00000100:00000200:31.0:1773851860.505842:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597786754048
00000020:00000001:31.0:1773851860.505842:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851860.505843:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851860.505844:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.505845:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851860.505845:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851860.505846:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851860.505847:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597786754048, found 0 last_xid 1859597786330495
00000020:00000001:31.0:1773851860.505848:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851860.505849:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851860.505849:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851860.505850:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.505851:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851860.505852:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851860.505852:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851860.505853:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000063ec6403.
02000000:00000001:31.0:1773851860.505854:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.505855:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.505855:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851860.505856:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063633, transno 0, xid 1859597786754048
00010000:00000001:31.0:1773851860.505857:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851860.505859:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b5235fc3 x1859597786754048/t0(0) o400->5ef68508-0e37-4a63-b8d1-91a2f1213eb1@16032@kfi7:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1488-0'
00010000:00000001:31.0:1773851860.505861:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851860.505862:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851860.505862:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=93 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851860.505863:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851860.505864:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005ba7938c refcount 3 to 16032@kfi7
00000100:00000001:31.0:1773851860.505865:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150016 : -107154898401600 : ffff9e8b0e5846c0)
02000000:00000001:31.0:1773851860.505866:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851860.505867:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.505867:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851860.505868:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15968@kfi7
00000400:00000010:31.0:1773851860.505869:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000eb85f77.
00000100:00000200:31.0:1773851860.505870:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597786754048, offset 224
00000400:00000200:31.0:1773851860.505871:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15968@kfi7
00000400:00000200:31.0:1773851860.505872:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15968@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.505873:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f87d98bb nid 15968@kfi7 refs 1
00000400:00000200:31.0:1773851860.505874:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f87d98bb nid 15968@kfi7 refs 2
00000400:00000200:31.0:1773851860.505875:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f87d98bb nid 15968@kfi7 refs 3
00000400:00000200:31.0:1773851860.505877:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15968@kfi7 local destination
00000400:00000200:31.0:1773851860.505878:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768912:8768912:1024:4294967295] 15968@kfi7 LPNI seq info [260742:260742:16:4294967295]
00000400:00000200:31.0:1773851860.505880:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f87d98bb nid 15968@kfi7 refs 2
00000400:00000200:31.0:1773851860.505881:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15968@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.505883:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15968@kfi7(15968@kfi7:15968@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851860.505884:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f87d98bb nid 15968@kfi7 refs 3
00000800:00000200:31.0:1773851860.505885:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851860.505886:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851860.505888:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851860.505890:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x35a Using peer 15968@kfi7(0x35a)
00000800:00000200:31.0:1773851860.505893:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x35a: rc=0
00000800:00000200:31.0:1773851860.505894:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x35a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851860.505896:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851860.505897:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005ba7938c refcount 2 to 16032@kfi7
00010000:00000001:31.0:1773851860.505898:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851860.505898:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.505899:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851860.505900:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b5235fc3 x1859597786754048/t0(0) o400->5ef68508-0e37-4a63-b8d1-91a2f1213eb1@16032@kfi7:648/0 lens 224/224 e 0 to 0 dl 1773852008 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1488-0'
00000100:00100000:31.0:1773851860.505903:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5235fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5ef68508-0e37-4a63-b8d1-91a2f1213eb1+167:39702:x1859597786754048:12345-16032@kfi7:400:default-tuolumne1488-0 Request processed in 64us (100us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851860.505906:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16032@kfi7, seq: 2055488
00000100:00000040:31.0:1773851860.505907:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002ca0c1c4 : new rpc_count 0
00000100:00000001:31.0:1773851860.505907:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851860.505907:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x35a TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851860.505908:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851860.505908:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851860.505909:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000400:00000200:29.0:1773851860.505909:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15968@kfi7: PUT: OK
00000020:00000010:31.0:1773851860.505910:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a24bde0f.
00000400:00000200:29.0:1773851860.505910:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000eb85f77
00000400:00000010:29.0:1773851860.505910:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000eb85f77.
00000020:00000010:31.0:1773851860.505911:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aceb0722.
00000020:00000040:31.0:1773851860.505911:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000002ca0c1c4 : new refcount 166
00000100:00000001:29.0:1773851860.505911:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851860.505912:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851860.505912:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851860.505912:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f87d98bb nid 15968@kfi7 refs 2
00000800:00000200:29.0:1773851860.505914:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 15968@kfi7(000000000c886f6c):0x0 lsk 859 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x35a Transaction freed
00000800:00000200:13.0:1773851860.509282:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.509283:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851860.509285:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851860.509287:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851860.509289:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16608@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.509290:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16608@kfi7 : PUT - for me
00000400:00000200:13.0:1773851860.509291:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16608@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.509292:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 1
00000400:00000200:13.0:1773851860.509294:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16608@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.509294:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 2
00000400:00000200:13.0:1773851860.509295:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 3
00000400:00000200:13.0:1773851860.509296:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16609@kfi7 to cpt 6
00000400:00000200:13.0:1773851860.509297:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16609@kfi7 of length 224 into portal 12 MB=0x69b16f180a6c0
00000400:00000200:13.0:1773851860.509299:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16609@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 22184
00000800:00000200:13.0:1773851860.509301:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851860.509302:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851860.509304:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16608@kfi7: PUT: OK
00000100:00000001:13.0:1773851860.509304:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851860.509305:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851860.509306:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009612b2bb.
00000100:00000040:13.0:1773851860.509306:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009612b2bb x1859372703590080 msgsize 224
00000100:00100000:13.0:1773851860.509308:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-16609@kfi7 (source: 12345-16608@kfi7)
00000100:00000001:13.0:1773851860.509309:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851860.509310:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851860.509310:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 2
02000000:00000001:15.0:1773851860.509311:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851860.509311:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851860.509312:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851860.509312:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851860.509312:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00100000:15.0:1773851860.509313:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372703590080
00000020:00000001:15.0:1773851860.509314:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851860.509314:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92fb8
00000020:00000001:15.0:1773851860.509315:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851860.509319:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b7c4bcf4 refcount=6
00000020:00000001:15.0:1773851860.509319:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744922112 : -107128964629504 : ffff9e91181e3c00)
00000020:00000001:15.0:1773851860.509320:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744922112 : -107128964629504 : ffff9e91181e3c00)
00000100:00000001:15.0:1773851860.509321:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.509322:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851860.509323:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000065e29ee.
00000020:00000010:15.0:1773851860.509324:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.509325:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851860.509325:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851860.509326:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851860.509326:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.509327:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851860.509328:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851860.509329:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.509330:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.509331:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851860.509331:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.509332:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851860.509332:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851860.509333:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16609@kfi7, seq: 2289805
00000100:00000040:15.0:1773851860.509333:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b7c4bcf4 : new rpc_count 1
00000100:00000001:13.0:1773851860.509333:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.509334:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537161088 : -107002172390528 : ffff9eae9d864380)
00000100:00000001:13.0:1773851860.509334:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.509335:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009612b2bb x1859372703590080/t0(0) o400->b20df7c3-c022-4f06-bf75-e2d89dacab1d@16609@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1519-0'
00000100:00000001:15.0:1773851860.509338:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.509338:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851860.509339:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009612b2bb pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b20df7c3-c022-4f06-bf75-e2d89dacab1d+6:39717:x1859372703590080:12345-16609@kfi7:400:default-tuolumne1519-0
00000100:00000200:15.0:1773851860.509341:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372703590080
00000020:00000001:15.0:1773851860.509341:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851860.509342:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851860.509343:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.509343:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851860.509344:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851860.509345:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851860.509345:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372703590080, found 0 last_xid 1859372703590079
00000020:00000001:15.0:1773851860.509346:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851860.509347:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851860.509347:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851860.509348:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.509349:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851860.509349:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851860.509350:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851860.509351:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003b791d27.
02000000:00000001:15.0:1773851860.509351:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.509352:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.509353:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851860.509353:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035375040, transno 0, xid 1859372703590080
00010000:00000001:15.0:1773851860.509354:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851860.509355:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009612b2bb x1859372703590080/t0(0) o400->b20df7c3-c022-4f06-bf75-e2d89dacab1d@16609@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1519-0'
00010000:00000001:15.0:1773851860.509358:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851860.509358:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851860.509359:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851860.509360:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851860.509360:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000026f9fc57 refcount 3 to 16609@kfi7
00000100:00000001:15.0:1773851860.509361:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643689024 : -107157065862592 : ffff9e8a8d277240)
02000000:00000001:15.0:1773851860.509362:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851860.509363:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.509363:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851860.509364:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16608@kfi7
00000400:00000010:15.0:1773851860.509365:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000019bef8e5.
00000100:00000200:15.0:1773851860.509365:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372703590080, offset 224
00000400:00000200:15.0:1773851860.509367:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16608@kfi7
00000400:00000200:15.0:1773851860.509367:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16608@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.509368:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 1
00000400:00000200:15.0:1773851860.509370:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 2
00000400:00000200:15.0:1773851860.509371:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 3
00000400:00000200:15.0:1773851860.509372:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16608@kfi7 local destination
00000400:00000200:15.0:1773851860.509374:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768913:8768913:1024:4294967295] 16608@kfi7 LPNI seq info [754941:754941:16:4294967295]
00000400:00000200:15.0:1773851860.509375:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 2
00000400:00000200:15.0:1773851860.509376:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16608@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.509378:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16608@kfi7(16608@kfi7:16608@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851860.509380:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 3
00000800:00000200:15.0:1773851860.509382:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.509383:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851860.509385:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851860.509390:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001197 Using peer 16608@kfi7(0x100000000001197)
00000800:00000200:15.0:1773851860.509393:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x100000000001197: rc=0
00000800:00000200:15.0:1773851860.509394:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001197 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851860.509396:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.509397:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000026f9fc57 refcount 2 to 16609@kfi7
00010000:00000001:15.0:1773851860.509398:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851860.509399:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.509399:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851860.509400:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009612b2bb x1859372703590080/t0(0) o400->b20df7c3-c022-4f06-bf75-e2d89dacab1d@16609@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1519-0'
00000100:00100000:15.0:1773851860.509403:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009612b2bb pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b20df7c3-c022-4f06-bf75-e2d89dacab1d+6:39717:x1859372703590080:12345-16609@kfi7:400:default-tuolumne1519-0 Request processed in 64us (96us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851860.509406:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16609@kfi7, seq: 2289805
00000800:00000200:13.0:1773851860.509406:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001197 TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851860.509407:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b7c4bcf4 : new rpc_count 0
00000400:00000200:13.0:1773851860.509407:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851860.509408:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851860.509408:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851860.509409:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.509409:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:13.0:1773851860.509409:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16608@kfi7: PUT: OK
00000400:00000200:13.0:1773851860.509409:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000019bef8e5
00000020:00000010:15.0:1773851860.509410:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000065e29ee.
00000400:00000010:13.0:1773851860.509410:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000019bef8e5.
00000020:00000040:15.0:1773851860.509411:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000b7c4bcf4 : new refcount 5
00000100:00000001:13.0:1773851860.509411:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851860.509411:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851860.509412:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851860.509412:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d2bc8a11 nid 16608@kfi7 refs 2
00000800:00000200:13.0:1773851860.509414:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 16608@kfi7(000000002b000197):0x0 lsk 4504 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001197 Transaction freed
00000800:00000200:13.0:1773851860.539757:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.539757:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851860.539759:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851860.539760:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851860.539762:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14016@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.539763:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14016@kfi7 : PUT - for me
00000400:00000200:13.0:1773851860.539764:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14016@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.539765:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366cd986 nid 14016@kfi7 refs 1
00000400:00000200:13.0:1773851860.539766:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14016@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.539767:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366cd986 nid 14016@kfi7 refs 2
00000400:00000200:13.0:1773851860.539768:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000366cd986 nid 14016@kfi7 refs 3
00000400:00000200:13.0:1773851860.539769:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14016@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.539769:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14016@kfi7 of length 224 into portal 12 MB=0x69b1cecf9e600
00000400:00000200:13.0:1773851860.539770:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14016@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 22408
00000800:00000200:13.0:1773851860.539773:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851860.539774:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851860.539775:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14016@kfi7: PUT: OK
00000100:00000001:13.0:1773851860.539776:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851860.539776:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851860.539777:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000ce74a73.
00000100:00000040:13.0:1773851860.539778:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000000ce74a73 x1859398397453824 msgsize 224
00000100:00100000:13.0:1773851860.539779:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14016@kfi7 (source: 12345-14016@kfi7)
00000100:00000001:13.0:1773851860.539780:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851860.539781:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851860.539781:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000366cd986 nid 14016@kfi7 refs 2
02000000:00000001:15.0:1773851860.539782:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851860.539782:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851860.539782:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851860.539782:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851860.539783:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851860.539783:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859398397453824
00000020:00000001:15.0:1773851860.539784:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851860.539784:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07a57012828
00000020:00000001:15.0:1773851860.539785:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851860.539789:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000099ac1a90 refcount=170
00000020:00000001:15.0:1773851860.539790:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127200374784 : -106946509176832 : ffff9ebb934f8000)
00000020:00000001:15.0:1773851860.539791:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127200374784 : -106946509176832 : ffff9ebb934f8000)
00000100:00000001:15.0:1773851860.539792:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.539792:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851860.539793:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ba835c49.
00000020:00000010:15.0:1773851860.539794:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.539794:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851860.539795:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851860.539795:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851860.539795:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.539796:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851860.539797:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851860.539797:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.539798:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.539799:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.539799:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851860.539799:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851860.539800:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14016@kfi7, seq: 2289806
00000100:00000040:15.0:1773851860.539800:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000099ac1a90 : new rpc_count 1
00000100:00000001:13.0:1773851860.539800:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851860.539800:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.539801:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537158784 : -107002172392832 : ffff9eae9d863a80)
00000100:00000001:13.0:1773851860.539801:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.539802:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000ce74a73 x1859398397453824/t0(0) o400->23400b3a-61b1-4c12-b457-4f759058ca68@14016@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1363-0'
00000100:00000001:15.0:1773851860.539804:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.539805:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851860.539806:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ce74a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:23400b3a-61b1-4c12-b457-4f759058ca68+170:39887:x1859398397453824:12345-14016@kfi7:400:default-tuolumne1363-0
00000100:00000200:15.0:1773851860.539807:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859398397453824
00000020:00000001:15.0:1773851860.539807:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851860.539808:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851860.539808:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.539809:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851860.539809:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851860.539810:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851860.539811:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859398397453824, found 0 last_xid 1859398397030911
00000020:00000001:15.0:1773851860.539811:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851860.539812:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851860.539812:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851860.539813:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.539813:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851860.539814:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851860.539814:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851860.539815:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003b8f8bde.
02000000:00000001:15.0:1773851860.539815:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.539815:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.539816:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851860.539817:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062876, transno 0, xid 1859398397453824
00010000:00000001:15.0:1773851860.539817:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851860.539818:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000ce74a73 x1859398397453824/t0(0) o400->23400b3a-61b1-4c12-b457-4f759058ca68@14016@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1363-0'
00010000:00000001:15.0:1773851860.539820:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851860.539821:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851860.539821:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851860.539822:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851860.539823:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000380fb75d refcount 3 to 14016@kfi7
00000100:00000001:15.0:1773851860.539823:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637092938621888 : -106980770929728 : ffff9eb39926a3c0)
02000000:00000001:15.0:1773851860.539824:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851860.539824:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.539825:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851860.539826:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14016@kfi7
00000400:00000010:15.0:1773851860.539826:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c01d933.
00000100:00000200:15.0:1773851860.539827:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859398397453824, offset 224
00000400:00000200:15.0:1773851860.539828:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14016@kfi7
00000400:00000200:15.0:1773851860.539829:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14016@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.539830:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000366cd986 nid 14016@kfi7 refs 1
00000400:00000200:15.0:1773851860.539830:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000366cd986 nid 14016@kfi7 refs 2
00000400:00000200:15.0:1773851860.539831:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000366cd986 nid 14016@kfi7 refs 3
00000400:00000200:15.0:1773851860.539833:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14016@kfi7 local destination
00000400:00000200:15.0:1773851860.539834:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768914:8768914:1024:4294967295] 14016@kfi7 LPNI seq info [8212240:8212240:16:4294967295]
00000400:00000200:15.0:1773851860.539836:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000366cd986 nid 14016@kfi7 refs 2
00000400:00000200:15.0:1773851860.539837:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14016@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.539838:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14016@kfi7(14016@kfi7:14016@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851860.539840:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000366cd986 nid 14016@kfi7 refs 3
00000800:00000200:15.0:1773851860.539841:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.539842:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851860.539844:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851860.539846:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1249 Using peer 14016@kfi7(0x1249)
00000800:00000200:15.0:1773851860.539849:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x1249: rc=0
00000800:00000200:15.0:1773851860.539850:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1249 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851860.539852:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.539852:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000380fb75d refcount 2 to 14016@kfi7
00010000:00000001:15.0:1773851860.539853:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851860.539853:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.539854:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851860.539854:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000ce74a73 x1859398397453824/t0(0) o400->23400b3a-61b1-4c12-b457-4f759058ca68@14016@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1363-0'
00000100:00100000:15.0:1773851860.539857:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ce74a73 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:23400b3a-61b1-4c12-b457-4f759058ca68+170:39887:x1859398397453824:12345-14016@kfi7:400:default-tuolumne1363-0 Request processed in 52us (79us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851860.539860:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14016@kfi7, seq: 2289806
00000100:00000040:15.0:1773851860.539860:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000099ac1a90 : new rpc_count 0
00000100:00000001:15.0:1773851860.539861:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851860.539862:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851860.539862:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1249 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851860.539863:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.539864:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000020:00000010:15.0:1773851860.539864:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ba835c49.
00000400:00000200:13.0:1773851860.539864:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:15.0:1773851860.539865:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000099ac1a90 : new refcount 169
00000400:00000200:13.0:1773851860.539865:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14016@kfi7: PUT: OK
00000400:00000200:13.0:1773851860.539865:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c01d933
00000100:00000001:15.0:1773851860.539866:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851860.539866:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c01d933.
00000100:00000001:13.0:1773851860.539866:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851860.539867:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851860.539868:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000366cd986 nid 14016@kfi7 refs 2
00000800:00000200:13.0:1773851860.539869:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14016@kfi7(00000000366ee223):0x0 lsk 4682 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1249 Transaction freed
00000800:00000200:9.0:1773851860.564393:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.564394:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.564396:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.564400:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.564403:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.564405:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.48@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851860.564407:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.564408:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851860.564411:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.48@o2ib60 to cpt 1
00000400:00000200:9.0:1773851860.564413:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7d775f8 nid 192.168.128.48@o2ib60 refs 2
00000400:00000200:9.0:1773851860.564416:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b7d775f8 nid 192.168.128.48@o2ib60 refs 3
00000400:00000200:9.0:1773851860.564418:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.48@o2ib60 to cpt 1
00000400:00000200:9.0:1773851860.564420:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.48@o2ib60 of length 224 into portal 12 MB=0x69a8d857062c0
00000400:00000200:9.0:1773851860.564422:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.48@o2ib60 of length 224/224 into md 0x793926dc5 [64] + 127608
00000800:00000200:9.0:1773851860.564425:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.564431:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.564432:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.564434:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.564435:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.564436:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000024ae18fc.
00000100:00000040:9.0:1773851860.564437:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000024ae18fc x1858782480065216 msgsize 224
00000100:00100000:9.0:1773851860.564441:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.48@o2ib60 (source: 12345-192.168.128.48@o2ib60)
00000100:00000001:9.0:1773851860.564443:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.564445:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851860.564447:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851860.564447:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851860.564448:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851860.564449:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851860.564450:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851860.564451:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.564456:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858782480065216
00000020:00000001:7.0:1773851860.564457:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.564458:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac921b1
00000020:00000001:7.0:1773851860.564459:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.564462:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009894e6b8 refcount=6
00000020:00000001:7.0:1773851860.564463:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629754880 : -107123079796736 : ffff9e9276e1a800)
00000020:00000001:7.0:1773851860.564465:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629754880 : -107123079796736 : ffff9e9276e1a800)
00000100:00000001:7.0:1773851860.564467:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.564468:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.564469:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d2a17bef.
00000020:00000010:7.0:1773851860.564471:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851860.564472:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000080eb462c.
00000100:00000001:7.0:1773851860.564473:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.564474:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.564475:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.564477:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.564477:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.564478:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.564480:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.564482:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.564482:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851860.564483:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851860.564484:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851860.564485:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.48@o2ib60, seq: 2001883
00000100:00000040:7.0:1773851860.564486:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009894e6b8 : new rpc_count 1
00000100:00000001:5.0:1773851860.564486:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.564487:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922915456 : -107141786636160 : ffff9e8e1bddf080)
00000100:00000001:5.0:1773851860.564487:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.564490:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000024ae18fc x1858782480065216/t0(0) o400->dd7fd401-6fa9-4e5c-a8b0-de5eba3c34a9@192.168.128.48@o2ib60:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix48-0'
00000100:00000001:7.0:1773851860.564494:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.564495:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.564497:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024ae18fc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:dd7fd401-6fa9-4e5c-a8b0-de5eba3c34a9+6:40074:x1858782480065216:12345-192.168.128.48@o2ib60:400:default-matrix48-0
00000100:00000200:7.0:1773851860.564499:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858782480065216
00000020:00000001:7.0:1773851860.564500:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.564501:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.564504:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.564505:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.564505:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.564507:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.564508:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858782480065216, found 0 last_xid 1858782480065215
00000020:00000001:7.0:1773851860.564509:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.564510:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.564511:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.564512:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.564513:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.564514:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.564514:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.564517:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef97ecae.
02000000:00000001:7.0:1773851860.564518:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.564519:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.564520:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.564521:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254485573, transno 0, xid 1858782480065216
00010000:00000001:7.0:1773851860.564522:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.564524:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000024ae18fc x1858782480065216/t0(0) o400->dd7fd401-6fa9-4e5c-a8b0-de5eba3c34a9@192.168.128.48@o2ib60:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix48-0'
00010000:00000001:7.0:1773851860.564528:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.564529:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.564530:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.564532:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.564533:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009e9e33e2 refcount 3 to 192.168.128.48@o2ib60
00000100:00000001:7.0:1773851860.564535:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919543838496 : -107154165713120 : ffff9e8b3a043720)
02000000:00000001:7.0:1773851860.564536:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.564537:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.564538:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.564539:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.48@o2ib60
00000400:00000010:7.0:1773851860.564540:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a1436362.
00000100:00000200:7.0:1773851860.564542:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858782480065216, offset 224
00000400:00000200:7.0:1773851860.564545:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.48@o2ib60
00000400:00000200:7.0:1773851860.564546:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.48@o2ib60 to cpt 1
00000400:00000200:7.0:1773851860.564548:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7d775f8 nid 192.168.128.48@o2ib60 refs 2
00000400:00000200:7.0:1773851860.564551:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b7d775f8 nid 192.168.128.48@o2ib60 refs 3
00000400:00000200:7.0:1773851860.564553:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b7d775f8 nid 192.168.128.48@o2ib60 refs 4
00000400:00000200:7.0:1773851860.564556:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.48@o2ib60 routed destination
00000400:00000200:7.0:1773851860.564558:0:60963:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851860.564559:0:60963:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:7.0:1773851860.564561:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.48@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851860.564562:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851860.564564:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.48@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851860.564565:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851860.564567:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768915:8768915:1024:4294967295] 17@kfi7 LPNI seq info [1250891885:1250891885:16:4294967295]
00000400:00000200:7.0:1773851860.564569:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:7.0:1773851860.564571:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:7.0:1773851860.564575:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.48@o2ib60(192.168.128.48@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.564577:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b7d775f8 nid 192.168.128.48@o2ib60 refs 3
00000800:00000200:7.0:1773851860.564580:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.564582:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.564586:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.564590:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:7.0:1773851860.564595:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:7.0:1773851860.564597:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.564600:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.564602:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009e9e33e2 refcount 2 to 192.168.128.48@o2ib60
00010000:00000001:7.0:1773851860.564603:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.564604:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.564605:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.564607:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000024ae18fc x1858782480065216/t0(0) o400->dd7fd401-6fa9-4e5c-a8b0-de5eba3c34a9@192.168.128.48@o2ib60:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix48-0'
00000100:00100000:7.0:1773851860.564613:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024ae18fc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:dd7fd401-6fa9-4e5c-a8b0-de5eba3c34a9+6:40074:x1858782480065216:12345-192.168.128.48@o2ib60:400:default-matrix48-0 Request processed in 116us (174us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851860.564613:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851860.564616:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851860.564617:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.48@o2ib60, seq: 2001883
00000100:00000040:7.0:1773851860.564618:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009894e6b8 : new rpc_count 0
00000400:00000200:5.0:1773851860.564618:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:5.0:1773851860.564619:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a1436362
00000100:00000001:7.0:1773851860.564620:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:5.0:1773851860.564620:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a1436362.
00000100:00000001:7.0:1773851860.564621:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851860.564621:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851860.564622:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000100:00000001:5.0:1773851860.564622:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851860.564623:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000080eb462c.
00000400:00000200:5.0:1773851860.564623:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000010:7.0:1773851860.564624:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d2a17bef.
00000800:00000200:5.0:1773851860.564625:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Transaction freed
00000020:00000040:7.0:1773851860.564626:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009894e6b8 : new refcount 5
00000100:00000001:7.0:1773851860.564628:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851860.569974:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851860.569975:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851860.569977:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851860.569979:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851860.569981:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16593@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.569983:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16593@kfi7 : PUT - for me
00000400:00000200:21.0:1773851860.569984:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16593@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.569985:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 1
00000400:00000200:21.0:1773851860.569986:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16593@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.569987:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 2
00000400:00000200:21.0:1773851860.569988:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 3
00000400:00000200:21.0:1773851860.569989:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16593@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.569990:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16593@kfi7 of length 224 into portal 12 MB=0x69b4b9a1fcf00
00000400:00000200:21.0:1773851860.569991:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16593@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 29896
00000800:00000200:21.0:1773851860.569993:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851860.569995:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851860.569996:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16593@kfi7: PUT: OK
00000100:00000001:21.0:1773851860.569998:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851860.569999:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851860.570000:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006133841a.
00000100:00000040:21.0:1773851860.570000:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006133841a x1859598870892288 msgsize 224
00000100:00100000:21.0:1773851860.570002:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16593@kfi7 (source: 12345-16593@kfi7)
00000100:00000001:21.0:1773851860.570003:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851860.570005:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851860.570005:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 2
02000000:00000001:23.0:1773851860.570006:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851860.570006:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851860.570006:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851860.570007:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851860.570008:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851860.570009:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598870892288
00000020:00000001:23.0:1773851860.570010:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851860.570010:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389182cd
00000020:00000001:23.0:1773851860.570011:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851860.570015:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000028fe738 refcount=167
00000020:00000001:23.0:1773851860.570016:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134928576512 : -106938780975104 : ffff9ebd5ff28000)
00000020:00000001:23.0:1773851860.570017:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134928576512 : -106938780975104 : ffff9ebd5ff28000)
00000100:00000001:23.0:1773851860.570018:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.570019:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851860.570020:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000345a0e64.
00000020:00000010:23.0:1773851860.570021:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.570022:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851860.570023:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851860.570024:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851860.570024:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.570026:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851860.570026:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851860.570026:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.570028:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.570030:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851860.570030:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851860.570030:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851860.570031:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851860.570032:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16593@kfi7, seq: 1997949
00000100:00000040:23.0:1773851860.570033:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000028fe738 : new rpc_count 1
00000100:00000001:22.0:1773851860.570033:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.570034:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637148525848448 : -106925183703168 : ffff9ec08a686780)
00000100:00000001:22.0:1773851860.570034:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.570036:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006133841a x1859598870892288/t0(0) o400->45cf2c93-56e6-4337-b4fb-8b3b2791d2bc@16593@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1521-0'
00000100:00000001:23.0:1773851860.570041:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.570042:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851860.570044:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006133841a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:45cf2c93-56e6-4337-b4fb-8b3b2791d2bc+167:39375:x1859598870892288:12345-16593@kfi7:400:default-tuolumne1521-0
00000100:00000200:23.0:1773851860.570046:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598870892288
00000020:00000001:23.0:1773851860.570047:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851860.570048:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851860.570049:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.570051:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851860.570051:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851860.570053:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851860.570054:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598870892288, found 0 last_xid 1859598870466943
00000020:00000001:23.0:1773851860.570055:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851860.570056:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851860.570057:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851860.570058:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.570060:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851860.570061:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851860.570062:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851860.570063:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000396642d.
02000000:00000001:23.0:1773851860.570064:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.570065:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.570066:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851860.570067:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063009, transno 0, xid 1859598870892288
00010000:00000001:23.0:1773851860.570069:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851860.570070:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006133841a x1859598870892288/t0(0) o400->45cf2c93-56e6-4337-b4fb-8b3b2791d2bc@16593@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1521-0'
00010000:00000001:23.0:1773851860.570075:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851860.570076:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851860.570077:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=93 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851860.570079:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851860.570080:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f9f6c22f refcount 3 to 16593@kfi7
00000100:00000001:23.0:1773851860.570082:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095168 : -107139307456448 : ffff9e8eafa33840)
02000000:00000001:23.0:1773851860.570084:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851860.570085:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.570086:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851860.570087:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16593@kfi7
00000400:00000010:23.0:1773851860.570089:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009b97a0f1.
00000100:00000200:23.0:1773851860.570090:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598870892288, offset 224
00000400:00000200:23.0:1773851860.570092:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16593@kfi7
00000400:00000200:23.0:1773851860.570094:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16593@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.570095:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 1
00000400:00000200:23.0:1773851860.570097:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 2
00000400:00000200:23.0:1773851860.570099:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 3
00000400:00000200:23.0:1773851860.570101:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16593@kfi7 local destination
00000400:00000200:23.0:1773851860.570104:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768916:8768916:1024:4294967295] 16593@kfi7 LPNI seq info [373041:373041:16:4294967295]
00000400:00000200:23.0:1773851860.570106:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 2
00000400:00000200:23.0:1773851860.570108:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16593@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.570112:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16593@kfi7(16593@kfi7:16593@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851860.570114:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 3
00000800:00000200:23.0:1773851860.570116:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851860.570118:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851860.570122:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851860.570127:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000a3 Using peer 16593@kfi7(0x1000000000000a3)
00000800:00000200:23.0:1773851860.570132:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x1000000000000a3: rc=0
00000800:00000200:23.0:1773851860.570135:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851860.570138:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.570140:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f9f6c22f refcount 2 to 16593@kfi7
00010000:00000001:23.0:1773851860.570141:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851860.570143:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.570144:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851860.570145:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006133841a x1859598870892288/t0(0) o400->45cf2c93-56e6-4337-b4fb-8b3b2791d2bc@16593@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1521-0'
00000800:00000200:21.0:1773851860.570148:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000a3 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851860.570151:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006133841a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:45cf2c93-56e6-4337-b4fb-8b3b2791d2bc+167:39375:x1859598870892288:12345-16593@kfi7:400:default-tuolumne1521-0 Request processed in 108us (149us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851860.570151:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851860.570153:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16593@kfi7: PUT: OK
00000400:00000200:21.0:1773851860.570154:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009b97a0f1
00000400:00000010:21.0:1773851860.570155:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009b97a0f1.
00000100:00100000:23.0:1773851860.570156:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16593@kfi7, seq: 1997949
00000100:00000040:23.0:1773851860.570157:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000028fe738 : new rpc_count 0
00000100:00000001:21.0:1773851860.570157:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851860.570157:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851860.570159:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851860.570159:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851860.570159:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed3e89c2 nid 16593@kfi7 refs 2
00000020:00000010:23.0:1773851860.570160:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851860.570161:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16593@kfi7(0000000011ab4c15):0x0 lsk 164 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000000a3 Transaction freed
00000020:00000010:23.0:1773851860.570162:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851860.570163:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000345a0e64.
00000020:00000040:23.0:1773851860.570165:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000028fe738 : new refcount 166
00000100:00000001:23.0:1773851860.570166:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851860.591985:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851860.591985:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851860.591987:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851860.591989:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851860.591992:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13376@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.591993:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13376@kfi7 : PUT - for me
00000400:00000200:29.0:1773851860.591994:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13376@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.591995:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec8cf04 nid 13376@kfi7 refs 1
00000400:00000200:29.0:1773851860.591996:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13376@kfi7 to cpt 7
00000400:00000200:29.0:1773851860.591997:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec8cf04 nid 13376@kfi7 refs 2
00000400:00000200:29.0:1773851860.591998:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006ec8cf04 nid 13376@kfi7 refs 3
00000400:00000200:29.0:1773851860.591999:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13441@kfi7 to cpt 6
00000400:00000200:29.0:1773851860.592000:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13441@kfi7 of length 224 into portal 12 MB=0x69b0990d37280
00000400:00000200:29.0:1773851860.592001:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13441@kfi7 of length 224/224 into md 0x77fe139dd [64] + 168288
00000800:00000200:29.0:1773851860.592003:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851860.592005:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.592006:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13376@kfi7: PUT: OK
00000100:00000001:29.0:1773851860.592007:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851860.592008:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851860.592008:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f3f8f0d8.
00000100:00000040:29.0:1773851860.592009:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f3f8f0d8 x1859315247051392 msgsize 224
00000100:00100000:29.0:1773851860.592011:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13441@kfi7 (source: 12345-13376@kfi7)
00000100:00000001:29.0:1773851860.592012:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851860.592013:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec8cf04 nid 13376@kfi7 refs 2
00000100:00000001:31.0:1773851860.592014:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851860.592014:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851860.592015:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851860.592015:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851860.592016:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851860.592017:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851860.592018:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315247051392
00000020:00000001:31.0:1773851860.592018:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851860.592019:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b90
00000020:00000001:31.0:1773851860.592020:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851860.592024:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001216ef97 refcount=168
00000020:00000001:31.0:1773851860.592025:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743662592 : -107128965889024 : ffff9e91180b0400)
00000020:00000001:31.0:1773851860.592026:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743662592 : -107128965889024 : ffff9e91180b0400)
00000100:00000001:31.0:1773851860.592028:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851860.592028:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851860.592029:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000546cd5ce.
00000020:00000010:31.0:1773851860.592031:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851860.592031:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851860.592033:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851860.592033:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851860.592034:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851860.592036:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851860.592037:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851860.592038:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.592040:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851860.592042:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851860.592042:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851860.592043:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851860.592043:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851860.592044:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13441@kfi7, seq: 2055489
00000100:00000040:31.0:1773851860.592046:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001216ef97 : new rpc_count 1
00000100:00000001:28.0:1773851860.592046:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.592047:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221533696 : -106948488017920 : ffff9ebb1d5cc800)
00000100:00000001:28.0:1773851860.592048:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851860.592049:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f3f8f0d8 x1859315247051392/t0(0) o400->2fbea89a-36a0-4998-88a9-9911ab0be7d0@13441@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1332-0'
00000100:00000001:31.0:1773851860.592060:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851860.592060:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851860.592062:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3f8f0d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:2fbea89a-36a0-4998-88a9-9911ab0be7d0+168:39624:x1859315247051392:12345-13441@kfi7:400:default-tuolumne1332-0
00000100:00000200:31.0:1773851860.592065:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315247051392
00000020:00000001:31.0:1773851860.592066:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851860.592067:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851860.592069:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.592070:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851860.592071:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851860.592073:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851860.592074:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315247051392, found 0 last_xid 1859315246627583
00000020:00000001:31.0:1773851860.592076:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851860.592077:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851860.592078:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851860.592079:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.592080:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851860.592081:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851860.592082:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851860.592085:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b8ecea64.
02000000:00000001:31.0:1773851860.592086:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.592088:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.592089:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851860.592090:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063286, transno 0, xid 1859315247051392
00010000:00000001:31.0:1773851860.592092:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851860.592094:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f3f8f0d8 x1859315247051392/t0(0) o400->2fbea89a-36a0-4998-88a9-9911ab0be7d0@13441@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1332-0'
00010000:00000001:31.0:1773851860.592099:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851860.592100:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851860.592101:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=93 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851860.592103:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851860.592105:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007f8db18e refcount 3 to 13441@kfi7
00000100:00000001:31.0:1773851860.592106:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419360 : -107156724132256 : ffff9e8aa185d660)
02000000:00000001:31.0:1773851860.592109:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851860.592110:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.592111:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851860.592113:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13376@kfi7
00000400:00000010:31.0:1773851860.592114:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defdea60.
00000100:00000200:31.0:1773851860.592115:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315247051392, offset 224
00000400:00000200:31.0:1773851860.592118:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13376@kfi7
00000400:00000200:31.0:1773851860.592119:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13376@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.592121:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec8cf04 nid 13376@kfi7 refs 1
00000400:00000200:31.0:1773851860.592123:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006ec8cf04 nid 13376@kfi7 refs 2
00000400:00000200:31.0:1773851860.592125:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006ec8cf04 nid 13376@kfi7 refs 3
00000400:00000200:31.0:1773851860.592127:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13376@kfi7 local destination
00000400:00000200:31.0:1773851860.592130:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768917:8768917:1024:4294967295] 13376@kfi7 LPNI seq info [590233:590233:16:4294967295]
00000400:00000200:31.0:1773851860.592132:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006ec8cf04 nid 13376@kfi7 refs 2
00000400:00000200:31.0:1773851860.592134:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13376@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.592138:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13376@kfi7(13376@kfi7:13376@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851860.592140:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006ec8cf04 nid 13376@kfi7 refs 3
00000800:00000200:31.0:1773851860.592143:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851860.592145:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851860.592149:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851860.592153:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x115 Using peer 13376@kfi7(0x115)
00000800:00000200:31.0:1773851860.592159:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x115: rc=0
00000800:00000200:31.0:1773851860.592161:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x115 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851860.592165:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851860.592166:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007f8db18e refcount 2 to 13441@kfi7
00010000:00000001:31.0:1773851860.592168:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851860.592169:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.592171:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851860.592172:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f3f8f0d8 x1859315247051392/t0(0) o400->2fbea89a-36a0-4998-88a9-9911ab0be7d0@13441@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1332-0'
00000800:00000200:29.0:1773851860.592176:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x115 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851860.592178:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3f8f0d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:2fbea89a-36a0-4998-88a9-9911ab0be7d0+168:39624:x1859315247051392:12345-13441@kfi7:400:default-tuolumne1332-0 Request processed in 117us (167us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851860.592179:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.592181:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13376@kfi7: PUT: OK
00000100:00100000:31.0:1773851860.592182:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13441@kfi7, seq: 2055489
00000400:00000200:29.0:1773851860.592182:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defdea60
00000100:00000040:31.0:1773851860.592183:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001216ef97 : new rpc_count 0
00000400:00000010:29.0:1773851860.592183:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defdea60.
00000100:00000001:31.0:1773851860.592184:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851860.592185:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:29.0:1773851860.592185:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851860.592185:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851860.592186:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851860.592188:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000400:00000200:29.0:1773851860.592188:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec8cf04 nid 13376@kfi7 refs 2
00000020:00000010:31.0:1773851860.592189:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000546cd5ce.
00000800:00000200:29.0:1773851860.592190:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 13376@kfi7(000000008a02855a):0x0 lsk 278 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x115 Transaction freed
00000020:00000040:31.0:1773851860.592191:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000001216ef97 : new refcount 167
00000100:00000001:31.0:1773851860.592192:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.612262:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.612263:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.612264:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.612266:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.612268:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14290@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.612269:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14290@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.612270:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14290@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.612271:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c4f4eff nid 14290@kfi7 refs 1
00000400:00000200:1.0:1773851860.612272:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14290@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.612273:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c4f4eff nid 14290@kfi7 refs 2
00000400:00000200:1.0:1773851860.612274:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007c4f4eff nid 14290@kfi7 refs 3
00000400:00000200:1.0:1773851860.612275:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14291@kfi7 to cpt 3
00000400:00000200:1.0:1773851860.612276:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14291@kfi7 of length 224 into portal 12 MB=0x69b4b68eaeb80
00000400:00000200:1.0:1773851860.612277:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14291@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 20736
00000800:00000200:1.0:1773851860.612279:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.612281:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.612282:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14290@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.612283:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.612283:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.612284:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b564a3e4.
00000100:00000040:1.0:1773851860.612284:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000b564a3e4 x1859598045342592 msgsize 224
00000100:00100000:1.0:1773851860.612286:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14291@kfi7 (source: 12345-14290@kfi7)
00000100:00000001:1.0:1773851860.612287:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.612288:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007c4f4eff nid 14290@kfi7 refs 2
00000100:00000001:0.0:1773851860.612288:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.612289:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.612289:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.612289:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.612290:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.612291:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.612291:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598045342592
00000020:00000001:0.0:1773851860.612292:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.612292:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d78718
00000020:00000001:0.0:1773851860.612294:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.612295:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007fae2ae9 refcount=166
00000020:00000001:0.0:1773851860.612296:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134411489280 : -106939298062336 : ffff9ebd41206000)
00000020:00000001:0.0:1773851860.612296:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134411489280 : -106939298062336 : ffff9ebd41206000)
00000100:00000001:0.0:1773851860.612297:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.612298:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.612299:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851860.612300:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.612301:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.612302:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.612302:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.612302:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.612303:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.612304:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.612304:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.612305:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.612306:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.612307:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.612307:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.612307:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.612308:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14291@kfi7, seq: 1997525
00000100:00000001:1.0:1773851860.612309:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851860.612309:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.612309:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007fae2ae9 : new rpc_count 1
00000100:00000001:0.0:1773851860.612309:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064180685312 : -107009528866304 : ffff9eace70b5a00)
00000100:00000040:0.0:1773851860.612310:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b564a3e4 x1859598045342592/t0(0) o400->5f2a9d79-8f42-494c-b9e6-407fc4ec5c47@14291@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1381-0'
00000100:00000001:0.0:1773851860.612313:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.612314:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.612315:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b564a3e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5f2a9d79-8f42-494c-b9e6-407fc4ec5c47+166:39721:x1859598045342592:12345-14291@kfi7:400:default-tuolumne1381-0
00000100:00000200:0.0:1773851860.612316:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598045342592
00000020:00000001:0.0:1773851860.612317:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.612317:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.612318:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.612318:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.612319:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.612320:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.612321:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598045342592, found 0 last_xid 1859598044918207
00000020:00000001:0.0:1773851860.612321:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.612322:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.612323:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.612323:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.612324:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.612324:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.612325:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.612325:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000c846b9d.
02000000:00000001:0.0:1773851860.612326:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.612327:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.612327:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.612328:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063211, transno 0, xid 1859598045342592
00010000:00000001:0.0:1773851860.612328:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.612329:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b564a3e4 x1859598045342592/t0(0) o400->5f2a9d79-8f42-494c-b9e6-407fc4ec5c47@14291@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1381-0'
00010000:00000001:0.0:1773851860.612332:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.612332:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.612333:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.612334:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.612335:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000016176102 refcount 3 to 14291@kfi7
00000100:00000001:0.0:1773851860.612336:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150304 : -107154898401312 : ffff9e8b0e5847e0)
02000000:00000001:0.0:1773851860.612337:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.612337:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.612338:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.612339:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14290@kfi7
00000400:00000010:0.0:1773851860.612339:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000080b751ba.
00000100:00000200:0.0:1773851860.612340:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598045342592, offset 224
00000400:00000200:0.0:1773851860.612341:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14290@kfi7
00000400:00000200:0.0:1773851860.612342:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14290@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.612343:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c4f4eff nid 14290@kfi7 refs 1
00000400:00000200:0.0:1773851860.612344:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007c4f4eff nid 14290@kfi7 refs 2
00000400:00000200:0.0:1773851860.612345:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007c4f4eff nid 14290@kfi7 refs 3
00000400:00000200:0.0:1773851860.612347:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14290@kfi7 local destination
00000400:00000200:0.0:1773851860.612348:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768918:8768918:1024:4294967295] 14290@kfi7 LPNI seq info [1274947:1274947:16:4294967295]
00000400:00000200:0.0:1773851860.612350:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007c4f4eff nid 14290@kfi7 refs 2
00000400:00000200:0.0:1773851860.612350:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14290@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.612352:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14290@kfi7(14290@kfi7:14290@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.612353:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007c4f4eff nid 14290@kfi7 refs 3
00000800:00000200:0.0:1773851860.612355:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.612356:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.612358:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.612360:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000009fd Using peer 14290@kfi7(0x1000000000009fd)
00000800:00000200:0.0:1773851860.612363:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x1000000000009fd: rc=0
00000800:00000200:0.0:1773851860.612364:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000009fd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.612366:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.612367:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000016176102 refcount 2 to 14291@kfi7
00010000:00000001:0.0:1773851860.612368:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.612368:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.612369:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.612369:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b564a3e4 x1859598045342592/t0(0) o400->5f2a9d79-8f42-494c-b9e6-407fc4ec5c47@14291@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1381-0'
00000100:00100000:0.0:1773851860.612374:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b564a3e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5f2a9d79-8f42-494c-b9e6-407fc4ec5c47+166:39721:x1859598045342592:12345-14291@kfi7:400:default-tuolumne1381-0 Request processed in 60us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.612376:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14291@kfi7, seq: 1997525
00000100:00000040:0.0:1773851860.612377:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007fae2ae9 : new rpc_count 0
00000100:00000001:0.0:1773851860.612377:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.612378:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.612379:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.612380:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.612381:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851860.612382:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000007fae2ae9 : new refcount 165
00000100:00000001:0.0:1773851860.612382:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.612387:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000009fd TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.612389:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.612390:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14290@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.612390:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000080b751ba
00000400:00000010:1.0:1773851860.612391:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000080b751ba.
00000100:00000001:1.0:1773851860.612392:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.612392:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.612393:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007c4f4eff nid 14290@kfi7 refs 2
00000800:00000200:1.0:1773851860.612394:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 14290@kfi7(00000000a28b9b19):0x0 lsk 2558 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000009fd Transaction freed
00000800:00000200:6.0:1773851860.643497:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851860.643498:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851860.643499:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851860.643501:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851860.643503:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15217@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.643504:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15217@kfi7 : PUT - for me
00000400:00000200:6.0:1773851860.643505:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15217@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.643506:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009300b9b5 nid 15217@kfi7 refs 1
00000400:00000200:6.0:1773851860.643507:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15217@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.643508:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009300b9b5 nid 15217@kfi7 refs 2
00000400:00000200:6.0:1773851860.643509:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009300b9b5 nid 15217@kfi7 refs 3
00000400:00000200:6.0:1773851860.643509:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15217@kfi7 to cpt 1
00000400:00000200:6.0:1773851860.643511:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15217@kfi7 of length 224 into portal 12 MB=0x69b4b5a95acc0
00000400:00000200:6.0:1773851860.643512:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15217@kfi7 of length 224/224 into md 0x793926dc5 [64] + 127832
00000800:00000200:6.0:1773851860.643514:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851860.643516:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851860.643517:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15217@kfi7: PUT: OK
00000100:00000001:6.0:1773851860.643517:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851860.643518:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851860.643519:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001aff7355.
00000100:00000040:6.0:1773851860.643519:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000001aff7355 x1859597804874944 msgsize 224
00000100:00100000:6.0:1773851860.643521:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-15217@kfi7 (source: 12345-15217@kfi7)
00000100:00000001:6.0:1773851860.643522:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851860.643523:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009300b9b5 nid 15217@kfi7 refs 2
00000100:00000001:7.0:1773851860.643524:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851860.643524:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851860.643524:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851860.643525:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851860.643525:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851860.643526:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.643527:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597804874944
00000020:00000001:7.0:1773851860.643527:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.643527:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8074f
00000020:00000001:7.0:1773851860.643528:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.643532:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000046629b10 refcount=168
00000020:00000001:7.0:1773851860.643533:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143294813184 : -106930414738432 : ffff9ebf529d2400)
00000020:00000001:7.0:1773851860.643534:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143294813184 : -106930414738432 : ffff9ebf529d2400)
00000100:00000001:7.0:1773851860.643535:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.643536:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.643536:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d2a17bef.
00000020:00000010:7.0:1773851860.643537:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851860.643538:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000080eb462c.
00000100:00000001:7.0:1773851860.643539:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.643540:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.643541:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.643542:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.643542:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.643543:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.643544:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.643545:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.643545:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851860.643545:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851860.643546:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15217@kfi7, seq: 2001884
00000100:00000001:5.0:1773851860.643546:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851860.643547:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000046629b10 : new rpc_count 1
00000100:00000001:5.0:1773851860.643547:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.643548:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127990089344 : -106945719462272 : ffff9ebbc2619680)
00000100:00000001:5.0:1773851860.643548:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.643549:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001aff7355 x1859597804874944/t0(0) o400->f1b56db3-574f-48f0-a487-c7ecaab28e91@15217@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1438-0'
00000100:00000001:7.0:1773851860.643552:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.643552:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.643553:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001aff7355 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f1b56db3-574f-48f0-a487-c7ecaab28e91+168:39602:x1859597804874944:12345-15217@kfi7:400:default-tuolumne1438-0
00000100:00000200:7.0:1773851860.643555:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597804874944
00000020:00000001:7.0:1773851860.643555:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.643556:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.643556:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.643557:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.643558:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.643559:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.643559:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597804874944, found 0 last_xid 1859597804452415
00000020:00000001:7.0:1773851860.643560:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.643561:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.643561:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.643562:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.643562:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.643563:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.643563:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.643565:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004d7dd6a9.
02000000:00000001:7.0:1773851860.643565:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.643566:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.643567:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.643568:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061933, transno 0, xid 1859597804874944
00010000:00000001:7.0:1773851860.643569:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.643570:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001aff7355 x1859597804874944/t0(0) o400->f1b56db3-574f-48f0-a487-c7ecaab28e91@15217@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1438-0'
00010000:00000001:7.0:1773851860.643572:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.643572:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.643573:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.643574:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.643575:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000005de4b57 refcount 3 to 15217@kfi7
00000100:00000001:7.0:1773851860.643575:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410464 : -107145304141152 : ffff9e8d4a3512a0)
02000000:00000001:7.0:1773851860.643576:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.643577:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.643577:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.643578:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15217@kfi7
00000400:00000010:7.0:1773851860.643579:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000100:00000200:7.0:1773851860.643580:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597804874944, offset 224
00000400:00000200:7.0:1773851860.643581:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15217@kfi7
00000400:00000200:7.0:1773851860.643582:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15217@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.643583:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009300b9b5 nid 15217@kfi7 refs 1
00000400:00000200:7.0:1773851860.643584:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009300b9b5 nid 15217@kfi7 refs 2
00000400:00000200:7.0:1773851860.643585:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009300b9b5 nid 15217@kfi7 refs 3
00000400:00000200:7.0:1773851860.643587:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15217@kfi7 local destination
00000400:00000200:7.0:1773851860.643588:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768919:8768919:1024:4294967295] 15217@kfi7 LPNI seq info [717546:717546:16:4294967295]
00000400:00000200:7.0:1773851860.643589:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009300b9b5 nid 15217@kfi7 refs 2
00000400:00000200:7.0:1773851860.643590:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15217@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.643592:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15217@kfi7(15217@kfi7:15217@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.643593:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009300b9b5 nid 15217@kfi7 refs 3
00000800:00000200:7.0:1773851860.643594:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.643595:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.643597:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.643600:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000006d Using peer 15217@kfi7(0x10000000000006d)
00000800:00000200:7.0:1773851860.643603:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x10000000000006d: rc=0
00000800:00000200:7.0:1773851860.643604:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000006d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.643606:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.643607:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000005de4b57 refcount 2 to 15217@kfi7
00010000:00000001:7.0:1773851860.643608:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.643608:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.643609:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.643610:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001aff7355 x1859597804874944/t0(0) o400->f1b56db3-574f-48f0-a487-c7ecaab28e91@15217@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1438-0'
00000100:00100000:7.0:1773851860.643613:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001aff7355 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f1b56db3-574f-48f0-a487-c7ecaab28e91+168:39602:x1859597804874944:12345-15217@kfi7:400:default-tuolumne1438-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851860.643616:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15217@kfi7, seq: 2001884
00000100:00000040:7.0:1773851860.643616:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000046629b10 : new rpc_count 0
00000800:00000200:5.0:1773851860.643616:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000006d TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851860.643617:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851860.643617:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851860.643618:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851860.643618:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851860.643619:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000080eb462c.
00000020:00000010:7.0:1773851860.643619:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d2a17bef.
00000400:00000200:5.0:1773851860.643619:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15217@kfi7: PUT: OK
00000020:00000040:7.0:1773851860.643620:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000046629b10 : new refcount 167
00000400:00000200:5.0:1773851860.643620:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000400:00000010:5.0:1773851860.643620:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:7.0:1773851860.643621:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.643621:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851860.643621:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851860.643622:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009300b9b5 nid 15217@kfi7 refs 2
00000800:00000200:5.0:1773851860.643624:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15217@kfi7(00000000ac62f48b):0x0 lsk 110 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000006d Transaction freed
00000800:00000200:10.0:1773851860.650173:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.650173:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851860.650174:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.650174:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851860.650176:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.650176:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851860.650178:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851860.650178:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14961@kfi7(0000000091c7b7dd):0xb26 version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851860.650179:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 Using peer 14961@kfi7(0x100000000000b26)
00000400:00000200:10.0:1773851860.650180:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14961@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.650181:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14961@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.650182:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14961@kfi7 : PUT - for me
00000400:00000200:10.0:1773851860.650183:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14961@kfi7 to cpt 2
00000800:00000200:9.0:1773851860.650183:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004481c792: Posted send of 38 bytes to peer 0x100000000000b26: rc=0
00000400:00000200:10.0:1773851860.650184:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e95d70a0 nid 14961@kfi7 refs 1
00000400:00000200:10.0:1773851860.650184:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14961@kfi7 to cpt 2
00000800:00000200:9.0:1773851860.650184:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851860.650185:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e95d70a0 nid 14961@kfi7 refs 2
00000400:00000200:10.0:1773851860.650186:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e95d70a0 nid 14961@kfi7 refs 3
00000400:00000200:10.0:1773851860.650187:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15025@kfi7 to cpt 6
00000400:00000200:10.0:1773851860.650188:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15025@kfi7 of length 224 into portal 12 MB=0x69b4b5c7fdbc0
00000400:00000200:10.0:1773851860.650189:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15025@kfi7 of length 224/224 into md 0x78146ce49 [64] + 127920
00000800:00000200:10.0:1773851860.650191:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851860.650193:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851860.650194:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14961@kfi7: PUT: OK
00000100:00000001:10.0:1773851860.650195:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851860.650195:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851860.650196:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001da19cc5.
00000800:00000200:9.0:1773851860.650196:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851860.650197:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000001da19cc5 x1859597836999616 msgsize 224
00000800:00000200:9.0:1773851860.650198:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 Transaction freed
00000100:00100000:10.0:1773851860.650199:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-15025@kfi7 (source: 12345-14961@kfi7)
00000100:00000001:10.0:1773851860.650200:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851860.650201:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e95d70a0 nid 14961@kfi7 refs 2
00000800:00000200:10.0:1773851860.650202:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851860.650203:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851860.650204:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851860.650204:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851860.650205:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851860.650206:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851860.650207:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597836999616
00000020:00000001:9.0:1773851860.650208:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851860.650209:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ea84
00000020:00000001:9.0:1773851860.650209:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851860.650211:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f6ab727 refcount=167
00000020:00000001:9.0:1773851860.650212:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962295307264 : -107111414244352 : ffff9e952e33dc00)
00000020:00000001:9.0:1773851860.650213:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636962295307264 : -107111414244352 : ffff9e952e33dc00)
00000100:00000001:9.0:1773851860.650214:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851860.650215:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851860.650216:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004830a15b.
00000020:00000010:9.0:1773851860.650217:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851860.650218:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b4e7bb2.
00000100:00000001:9.0:1773851860.650219:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851860.650219:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851860.650220:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851860.650221:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851860.650221:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851860.650222:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.650223:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.650225:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.650225:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851860.650225:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851860.650225:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.650227:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15025@kfi7, seq: 2130751
00000100:00000040:11.0:1773851860.650228:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f6ab727 : new rpc_count 1
00000100:00000001:11.0:1773851860.650228:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610182400 : -107030099369216 : ffff9ea81cf26300)
00000100:00000001:9.0:1773851860.650228:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.650228:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.650230:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001da19cc5 x1859597836999616/t0(0) o400->9bc7aa7a-6966-4de1-8528-e0c2cf015742@15025@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1422-0'
00000100:00000001:11.0:1773851860.650233:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.650233:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.650234:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001da19cc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9bc7aa7a-6966-4de1-8528-e0c2cf015742+167:39722:x1859597836999616:12345-15025@kfi7:400:default-tuolumne1422-0
00000100:00000200:11.0:1773851860.650235:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597836999616
00000020:00000001:11.0:1773851860.650236:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.650237:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.650238:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.650238:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.650240:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.650240:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.650241:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597836999616, found 0 last_xid 1859597836574847
00000020:00000001:11.0:1773851860.650242:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.650243:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.650243:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.650244:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.650244:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.650245:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.650246:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.650246:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000036174187.
02000000:00000001:11.0:1773851860.650247:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.650248:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.650248:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.650249:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062977, transno 0, xid 1859597836999616
00010000:00000001:11.0:1773851860.650250:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.650251:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001da19cc5 x1859597836999616/t0(0) o400->9bc7aa7a-6966-4de1-8528-e0c2cf015742@15025@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1422-0'
00010000:00000001:11.0:1773851860.650253:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.650254:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.650255:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.650256:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.650256:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d620e2a7 refcount 3 to 15025@kfi7
00000100:00000001:11.0:1773851860.650258:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985421472 : -107156724130144 : ffff9e8aa185dea0)
02000000:00000001:11.0:1773851860.650259:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.650259:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.650260:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.650261:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14961@kfi7
00000400:00000010:11.0:1773851860.650261:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a4a49aeb.
00000100:00000200:11.0:1773851860.650262:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597836999616, offset 224
00000400:00000200:11.0:1773851860.650264:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14961@kfi7
00000400:00000200:11.0:1773851860.650265:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14961@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.650265:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e95d70a0 nid 14961@kfi7 refs 1
00000400:00000200:11.0:1773851860.650267:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e95d70a0 nid 14961@kfi7 refs 2
00000400:00000200:11.0:1773851860.650271:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e95d70a0 nid 14961@kfi7 refs 3
00000400:00000200:11.0:1773851860.650272:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14961@kfi7 local destination
00000400:00000200:11.0:1773851860.650274:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768920:8768920:1024:4294967295] 14961@kfi7 LPNI seq info [136807:136807:16:4294967295]
00000400:00000200:11.0:1773851860.650275:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e95d70a0 nid 14961@kfi7 refs 2
00000400:00000200:11.0:1773851860.650276:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14961@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.650278:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14961@kfi7(14961@kfi7:14961@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.650279:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e95d70a0 nid 14961@kfi7 refs 3
00000800:00000200:11.0:1773851860.650281:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.650282:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.650284:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.650286:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 Using peer 14961@kfi7(0x100000000000b26)
00000800:00000200:11.0:1773851860.650289:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x100000000000b26: rc=0
00000800:00000200:11.0:1773851860.650291:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.650293:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.650294:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d620e2a7 refcount 2 to 15025@kfi7
00010000:00000001:11.0:1773851860.650294:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.650295:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.650296:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.650296:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001da19cc5 x1859597836999616/t0(0) o400->9bc7aa7a-6966-4de1-8528-e0c2cf015742@15025@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1422-0'
00000100:00100000:11.0:1773851860.650300:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001da19cc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9bc7aa7a-6966-4de1-8528-e0c2cf015742+167:39722:x1859597836999616:12345-15025@kfi7:400:default-tuolumne1422-0 Request processed in 66us (102us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851860.650302:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851860.650303:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15025@kfi7, seq: 2130751
00000400:00000200:9.0:1773851860.650303:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851860.650304:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f6ab727 : new rpc_count 0
00000100:00000001:11.0:1773851860.650305:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851860.650305:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14961@kfi7: PUT: OK
00000400:00000200:9.0:1773851860.650305:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a4a49aeb
00000100:00000001:11.0:1773851860.650306:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:9.0:1773851860.650306:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a4a49aeb.
00000020:00000010:11.0:1773851860.650307:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000100:00000001:9.0:1773851860.650307:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851860.650307:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851860.650308:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b4e7bb2.
00000400:00000200:9.0:1773851860.650308:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e95d70a0 nid 14961@kfi7 refs 2
00000020:00000010:11.0:1773851860.650309:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004830a15b.
00000020:00000040:11.0:1773851860.650309:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004f6ab727 : new refcount 166
00000800:00000200:9.0:1773851860.650309:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 14961@kfi7(0000000091c7b7dd):0x0 lsk 2855 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b26 Transaction freed
00000100:00000001:11.0:1773851860.650310:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851860.651243:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.651244:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.651245:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.651247:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.651248:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16995@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.651249:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16995@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.651251:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16995@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.651251:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000030e710f3 nid 16995@kfi7 refs 1
00000400:00000200:9.0:1773851860.651253:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16995@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.651253:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000030e710f3 nid 16995@kfi7 refs 2
00000400:00000200:9.0:1773851860.651254:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000030e710f3 nid 16995@kfi7 refs 3
00000400:00000200:9.0:1773851860.651255:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16994@kfi7 to cpt 7
00000400:00000200:9.0:1773851860.651255:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16994@kfi7 of length 224 into portal 12 MB=0x69b4b584b1180
00000400:00000200:9.0:1773851860.651257:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16994@kfi7 of length 224/224 into md 0x78146ce49 [64] + 128144
00000800:00000200:9.0:1773851860.651258:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.651259:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.651260:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16995@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.651261:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.651261:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.651262:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000684c3a35.
00000100:00000040:9.0:1773851860.651263:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000684c3a35 x1859597766431104 msgsize 224
00000100:00100000:9.0:1773851860.651264:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-16994@kfi7 (source: 12345-16995@kfi7)
00000100:00000001:9.0:1773851860.651265:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851860.651266:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851860.651266:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000030e710f3 nid 16995@kfi7 refs 2
02000000:00000001:11.0:1773851860.651267:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851860.651267:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851860.651267:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851860.651267:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851860.651268:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851860.651269:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597766431104
00000020:00000001:11.0:1773851860.651269:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851860.651270:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80af2
00000020:00000001:11.0:1773851860.651270:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851860.651273:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ea38346c refcount=168
00000020:00000001:11.0:1773851860.651274:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134494408704 : -106939215142912 : ffff9ebd4611a000)
00000020:00000001:11.0:1773851860.651275:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134494408704 : -106939215142912 : ffff9ebd4611a000)
00000100:00000001:11.0:1773851860.651276:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.651276:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851860.651277:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006c3ed247.
00000020:00000010:11.0:1773851860.651278:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.651279:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a4701f2.
00000100:00000001:11.0:1773851860.651280:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851860.651280:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851860.651281:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.651282:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851860.651282:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851860.651283:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.651283:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.651284:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.651285:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851860.651285:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851860.651285:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.651286:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16994@kfi7, seq: 2130752
00000100:00000040:11.0:1773851860.651286:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ea38346c : new rpc_count 1
00000100:00000001:9.0:1773851860.651286:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.651287:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.651297:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922912000 : -107141786639616 : ffff9e8e1bdde300)
00000100:00000040:11.0:1773851860.651297:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000684c3a35 x1859597766431104/t0(0) o400->2f9f3282-c8a0-4a0c-8522-056ed21bf2b3@16994@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1548-0'
00000100:00000001:11.0:1773851860.651300:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.651300:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.651301:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000684c3a35 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2f9f3282-c8a0-4a0c-8522-056ed21bf2b3+168:39720:x1859597766431104:12345-16994@kfi7:400:default-tuolumne1548-0
00000100:00000200:11.0:1773851860.651302:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597766431104
00000020:00000001:11.0:1773851860.651303:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.651303:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.651304:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.651304:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.651305:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.651306:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.651306:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597766431104, found 0 last_xid 1859597766005951
00000020:00000001:11.0:1773851860.651307:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.651307:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.651308:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.651308:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.651308:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.651309:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.651309:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.651310:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000027f045be.
02000000:00000001:11.0:1773851860.651311:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.651311:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.651312:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.651312:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062214, transno 0, xid 1859597766431104
00010000:00000001:11.0:1773851860.651313:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.651314:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000684c3a35 x1859597766431104/t0(0) o400->2f9f3282-c8a0-4a0c-8522-056ed21bf2b3@16994@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1548-0'
00010000:00000001:11.0:1773851860.651316:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.651316:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.651317:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.651318:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.651319:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000ca4799d refcount 3 to 16994@kfi7
00000100:00000001:11.0:1773851860.651320:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063264 : -107155994488352 : ffff9e8acd0351e0)
02000000:00000001:11.0:1773851860.651321:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.651321:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.651322:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.651323:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16995@kfi7
00000400:00000010:11.0:1773851860.651323:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000110e0a3f.
00000100:00000200:11.0:1773851860.651324:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597766431104, offset 224
00000400:00000200:11.0:1773851860.651325:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16995@kfi7
00000400:00000200:11.0:1773851860.651326:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16995@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.651326:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000030e710f3 nid 16995@kfi7 refs 1
00000400:00000200:11.0:1773851860.651327:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000030e710f3 nid 16995@kfi7 refs 2
00000400:00000200:11.0:1773851860.651328:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000030e710f3 nid 16995@kfi7 refs 3
00000400:00000200:11.0:1773851860.651330:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16995@kfi7 local destination
00000400:00000200:11.0:1773851860.651331:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768921:8768921:1024:4294967295] 16995@kfi7 LPNI seq info [274080:274080:16:4294967295]
00000400:00000200:11.0:1773851860.651332:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000030e710f3 nid 16995@kfi7 refs 2
00000400:00000200:11.0:1773851860.651333:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16995@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.651335:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16995@kfi7(16995@kfi7:16995@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.651336:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000030e710f3 nid 16995@kfi7 refs 3
00000800:00000200:11.0:1773851860.651337:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.651338:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.651340:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.651342:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b0e Using peer 16995@kfi7(0x100000000000b0e)
00000800:00000200:11.0:1773851860.651345:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x100000000000b0e: rc=0
00000800:00000200:11.0:1773851860.651346:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b0e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.651348:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.651350:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000ca4799d refcount 2 to 16994@kfi7
00010000:00000001:11.0:1773851860.651350:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.651351:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.651351:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.651352:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000684c3a35 x1859597766431104/t0(0) o400->2f9f3282-c8a0-4a0c-8522-056ed21bf2b3@16994@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1548-0'
00000100:00100000:11.0:1773851860.651355:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000684c3a35 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2f9f3282-c8a0-4a0c-8522-056ed21bf2b3+168:39720:x1859597766431104:12345-16994@kfi7:400:default-tuolumne1548-0 Request processed in 54us (91us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851860.651357:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16994@kfi7, seq: 2130752
00000100:00000040:11.0:1773851860.651358:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ea38346c : new rpc_count 0
00000100:00000001:11.0:1773851860.651359:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851860.651359:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851860.651359:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b0e TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851860.651360:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.651360:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a4701f2.
00000400:00000200:9.0:1773851860.651360:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851860.651361:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006c3ed247.
00000400:00000200:9.0:1773851860.651361:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16995@kfi7: PUT: OK
00000400:00000200:9.0:1773851860.651361:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000110e0a3f
00000020:00000040:11.0:1773851860.651362:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000ea38346c : new refcount 167
00000100:00000001:11.0:1773851860.651362:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851860.651362:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000110e0a3f.
00000100:00000001:9.0:1773851860.651362:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851860.651363:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851860.651363:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000030e710f3 nid 16995@kfi7 refs 2
00000800:00000200:9.0:1773851860.651364:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 16995@kfi7(0000000099b376ec):0x0 lsk 2831 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b0e Transaction freed
00000800:00000200:21.0:1773851860.664025:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851860.664026:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851860.664028:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851860.664031:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851860.664034:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13027@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.664036:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13027@kfi7 : PUT - for me
00000400:00000200:21.0:1773851860.664037:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13027@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.664039:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c82d16d nid 13027@kfi7 refs 1
00000400:00000200:21.0:1773851860.664041:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13027@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.664042:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c82d16d nid 13027@kfi7 refs 2
00000400:00000200:21.0:1773851860.664043:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002c82d16d nid 13027@kfi7 refs 3
00000400:00000200:21.0:1773851860.664045:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13026@kfi7 to cpt 2
00000400:00000200:21.0:1773851860.664046:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13026@kfi7 of length 224 into portal 12 MB=0x69b4b5adc9a40
00000400:00000200:21.0:1773851860.664048:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13026@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 30120
00000800:00000200:21.0:1773851860.664051:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851860.664053:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851860.664055:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13027@kfi7: PUT: OK
00000100:00000001:21.0:1773851860.664056:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851860.664057:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851860.664058:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ef17a58.
00000100:00000040:21.0:1773851860.664059:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006ef17a58 x1859597809523264 msgsize 224
00000100:00100000:21.0:1773851860.664062:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13026@kfi7 (source: 12345-13027@kfi7)
00000100:00000001:21.0:1773851860.664064:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851860.664065:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002c82d16d nid 13027@kfi7 refs 2
00000100:00000001:23.0:1773851860.664066:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851860.664067:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851860.664068:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851860.664068:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851860.664069:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851860.664070:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851860.664071:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597809523264
00000020:00000001:23.0:1773851860.664072:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851860.664073:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d83aa9
00000020:00000001:23.0:1773851860.664074:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851860.664077:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c87fe3e refcount=171
00000020:00000001:23.0:1773851860.664078:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143388935168 : -106930320616448 : ffff9ebf58395400)
00000020:00000001:23.0:1773851860.664079:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143388935168 : -106930320616448 : ffff9ebf58395400)
00000100:00000001:23.0:1773851860.664081:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.664083:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851860.664084:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000345a0e64.
00000020:00000010:23.0:1773851860.664085:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.664087:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851860.664088:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851860.664090:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851860.664091:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.664092:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851860.664093:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851860.664094:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.664096:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.664098:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851860.664099:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851860.664099:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851860.664099:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851860.664100:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13026@kfi7, seq: 1997950
00000100:00000040:23.0:1773851860.664102:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004c87fe3e : new rpc_count 1
00000100:00000001:22.0:1773851860.664102:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.664103:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637148525840384 : -106925183711232 : ffff9ec08a684800)
00000100:00000001:22.0:1773851860.664103:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.664105:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ef17a58 x1859597809523264/t0(0) o400->3f0b9064-24dc-4145-8d9a-ea6d55d3c43a@13026@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1291-0'
00000100:00000001:23.0:1773851860.664110:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.664111:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851860.664112:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ef17a58 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3f0b9064-24dc-4145-8d9a-ea6d55d3c43a+171:39539:x1859597809523264:12345-13026@kfi7:400:default-tuolumne1291-0
00000100:00000200:23.0:1773851860.664115:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597809523264
00000020:00000001:23.0:1773851860.664116:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851860.664117:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851860.664118:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.664119:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851860.664120:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851860.664122:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851860.664123:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597809523264, found 0 last_xid 1859597809104639
00000020:00000001:23.0:1773851860.664124:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851860.664125:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851860.664126:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851860.664127:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.664128:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851860.664129:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851860.664130:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851860.664133:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d78e7af.
02000000:00000001:23.0:1773851860.664134:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.664136:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.664137:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851860.664139:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062211, transno 0, xid 1859597809523264
00010000:00000001:23.0:1773851860.664140:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851860.664141:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ef17a58 x1859597809523264/t0(0) o400->3f0b9064-24dc-4145-8d9a-ea6d55d3c43a@13026@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1291-0'
00010000:00000001:23.0:1773851860.664146:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851860.664147:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851860.664148:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=93 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851860.664150:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851860.664151:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003b1fae0f refcount 3 to 13026@kfi7
00000100:00000001:23.0:1773851860.664153:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810485600 : -107154899066016 : ffff9e8b0e4e2360)
02000000:00000001:23.0:1773851860.664154:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851860.664155:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.664156:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851860.664158:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13027@kfi7
00000400:00000010:23.0:1773851860.664159:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7e037cd.
00000100:00000200:23.0:1773851860.664160:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597809523264, offset 224
00000400:00000200:23.0:1773851860.664162:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13027@kfi7
00000400:00000200:23.0:1773851860.664163:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13027@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.664165:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c82d16d nid 13027@kfi7 refs 1
00000400:00000200:23.0:1773851860.664166:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002c82d16d nid 13027@kfi7 refs 2
00000400:00000200:23.0:1773851860.664168:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002c82d16d nid 13027@kfi7 refs 3
00000400:00000200:23.0:1773851860.664170:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13027@kfi7 local destination
00000400:00000200:23.0:1773851860.664172:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768922:8768922:1024:4294967295] 13027@kfi7 LPNI seq info [273175:273175:16:4294967295]
00000400:00000200:23.0:1773851860.664173:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002c82d16d nid 13027@kfi7 refs 2
00000400:00000200:23.0:1773851860.664174:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13027@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.664176:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13027@kfi7(13027@kfi7:13027@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851860.664178:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002c82d16d nid 13027@kfi7 refs 3
00000800:00000200:23.0:1773851860.664179:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851860.664180:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851860.664185:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851860.664188:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6e7 Using peer 13027@kfi7(0x6e7)
00000800:00000200:23.0:1773851860.664191:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x6e7: rc=0
00000800:00000200:23.0:1773851860.664193:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851860.664195:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.664196:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003b1fae0f refcount 2 to 13026@kfi7
00010000:00000001:23.0:1773851860.664197:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851860.664197:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.664198:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851860.664199:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ef17a58 x1859597809523264/t0(0) o400->3f0b9064-24dc-4145-8d9a-ea6d55d3c43a@13026@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1291-0'
00000100:00100000:23.0:1773851860.664203:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ef17a58 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3f0b9064-24dc-4145-8d9a-ea6d55d3c43a+171:39539:x1859597809523264:12345-13026@kfi7:400:default-tuolumne1291-0 Request processed in 92us (143us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851860.664205:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13026@kfi7, seq: 1997950
00000800:00000200:21.0:1773851860.664205:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6e7 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851860.664206:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004c87fe3e : new rpc_count 0
00000100:00000001:23.0:1773851860.664207:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851860.664207:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851860.664207:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851860.664208:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851860.664208:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13027@kfi7: PUT: OK
00000020:00000010:23.0:1773851860.664209:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851860.664209:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7e037cd
00000400:00000010:21.0:1773851860.664209:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7e037cd.
00000020:00000010:23.0:1773851860.664210:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000345a0e64.
00000020:00000040:23.0:1773851860.664210:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000004c87fe3e : new refcount 170
00000100:00000001:21.0:1773851860.664210:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851860.664211:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851860.664211:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851860.664212:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002c82d16d nid 13027@kfi7 refs 2
00000800:00000200:21.0:1773851860.664213:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13027@kfi7(000000004a6edb98):0x0 lsk 1768 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x6e7 Transaction freed
00000800:00000200:6.0:1773851860.682173:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851860.682174:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851860.682174:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.682175:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851860.682177:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851860.682177:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851860.682180:0:2499722:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16547@kfi7(000000007ce9b0be):0xb6c version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851860.682182:0:2499722:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c Using peer 16547@kfi7(0xb6c)
00000800:00000200:5.0:1773851860.682182:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851860.682184:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16547@kfi7 to cpt 1
00000800:00000200:6.0:1773851860.682187:0:2499722:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 38 bytes to peer 0xb6c: rc=0
00000400:00000200:5.0:1773851860.682187:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16547@kfi7 to cpt 1
00000800:00000200:6.0:1773851860.682188:0:2499722:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851860.682189:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16547@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.682191:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16547@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.682192:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024ee968d nid 16547@kfi7 refs 1
00000400:00000200:5.0:1773851860.682194:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16547@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.682196:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024ee968d nid 16547@kfi7 refs 2
00000400:00000200:5.0:1773851860.682197:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000024ee968d nid 16547@kfi7 refs 3
00000400:00000200:5.0:1773851860.682199:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16482@kfi7 to cpt 2
00000800:00000200:6.0:1773851860.682201:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851860.682201:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16482@kfi7 of length 224 into portal 12 MB=0x69b9dabec8440
00000800:00000200:6.0:1773851860.682204:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c Transaction freed
00000400:00000200:5.0:1773851860.682204:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16482@kfi7 of length 224/224 into md 0x793926dc5 [64] + 128056
00000800:00000200:5.0:1773851860.682208:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851860.682211:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.682213:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16547@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.682214:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851860.682215:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851860.682217:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf607b0b.
00000100:00000040:5.0:1773851860.682218:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000cf607b0b x1859951356838976 msgsize 224
00000100:00100000:5.0:1773851860.682221:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-16482@kfi7 (source: 12345-16547@kfi7)
00000100:00000001:5.0:1773851860.682222:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851860.682224:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851860.682224:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:5.0:1773851860.682224:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000024ee968d nid 16547@kfi7 refs 2
00000100:00000001:7.0:1773851860.682225:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851860.682225:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851860.682225:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851860.682226:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.682227:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859951356838976
00000020:00000001:7.0:1773851860.682228:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.682228:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08c8331ac15
00000020:00000001:7.0:1773851860.682230:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.682231:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000b3be791 refcount=168
00000020:00000001:7.0:1773851860.682232:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150094366720 : -106923615184896 : ffff9ec0e7e61800)
00000020:00000001:7.0:1773851860.682233:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637150094366720 : -106923615184896 : ffff9ec0e7e61800)
00000100:00000001:7.0:1773851860.682234:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.682235:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.682236:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d2a17bef.
00000020:00000010:7.0:1773851860.682237:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851860.682238:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000080eb462c.
00000100:00000001:7.0:1773851860.682239:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.682240:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.682240:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.682241:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.682242:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.682242:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.682243:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.682245:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.682245:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851860.682245:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851860.682246:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16482@kfi7, seq: 2001885
00000100:00000001:5.0:1773851860.682246:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851860.682247:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000b3be791 : new rpc_count 1
00000100:00000001:5.0:1773851860.682247:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.682248:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866937600 : -107088842614016 : ffff9e9a6f939b00)
00000100:00000001:5.0:1773851860.682248:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.682249:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cf607b0b x1859951356838976/t0(0) o400->a5baac08-ada4-4e91-80c9-f3fba4c7362d@16482@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1516-0'
00000100:00000001:7.0:1773851860.682253:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.682253:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.682254:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf607b0b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:a5baac08-ada4-4e91-80c9-f3fba4c7362d+168:39844:x1859951356838976:12345-16482@kfi7:400:default-tuolumne1516-0
00000100:00000200:7.0:1773851860.682256:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859951356838976
00000020:00000001:7.0:1773851860.682257:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.682257:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.682258:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.682259:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.682260:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.682261:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.682262:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859951356838976, found 0 last_xid 1859951356414207
00000020:00000001:7.0:1773851860.682263:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.682264:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.682264:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.682265:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.682266:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.682266:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.682267:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.682268:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f5da20f9.
02000000:00000001:7.0:1773851860.682268:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.682269:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.682270:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.682270:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062396, transno 0, xid 1859951356838976
00010000:00000001:7.0:1773851860.682271:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.682272:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cf607b0b x1859951356838976/t0(0) o400->a5baac08-ada4-4e91-80c9-f3fba4c7362d@16482@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1516-0'
00010000:00000001:7.0:1773851860.682275:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.682276:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.682276:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.682278:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.682278:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000895c1abf refcount 3 to 16482@kfi7
00000100:00000001:7.0:1773851860.682279:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899610176 : -107146809941440 : ffff9e8cf0746240)
02000000:00000001:7.0:1773851860.682280:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.682281:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.682282:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.682283:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16547@kfi7
00000400:00000010:7.0:1773851860.682283:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edcc54b1.
00000100:00000200:7.0:1773851860.682284:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859951356838976, offset 224
00000400:00000200:7.0:1773851860.682285:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16547@kfi7
00000400:00000200:7.0:1773851860.682286:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16547@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.682288:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024ee968d nid 16547@kfi7 refs 1
00000400:00000200:7.0:1773851860.682289:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000024ee968d nid 16547@kfi7 refs 2
00000400:00000200:7.0:1773851860.682290:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000024ee968d nid 16547@kfi7 refs 3
00000400:00000200:7.0:1773851860.682292:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16547@kfi7 local destination
00000400:00000200:7.0:1773851860.682293:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768923:8768923:1024:4294967295] 16547@kfi7 LPNI seq info [302297:302297:16:4294967295]
00000400:00000200:7.0:1773851860.682295:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000024ee968d nid 16547@kfi7 refs 2
00000400:00000200:7.0:1773851860.682296:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16547@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.682298:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16547@kfi7(16547@kfi7:16547@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.682299:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000024ee968d nid 16547@kfi7 refs 3
00000800:00000200:7.0:1773851860.682301:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.682302:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.682304:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.682306:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c Using peer 16547@kfi7(0xb6c)
00000800:00000200:7.0:1773851860.682309:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0xb6c: rc=0
00000800:00000200:7.0:1773851860.682310:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.682312:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.682313:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000895c1abf refcount 2 to 16482@kfi7
00010000:00000001:7.0:1773851860.682313:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.682314:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.682315:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.682315:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cf607b0b x1859951356838976/t0(0) o400->a5baac08-ada4-4e91-80c9-f3fba4c7362d@16482@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1516-0'
00000100:00100000:7.0:1773851860.682318:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf607b0b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:a5baac08-ada4-4e91-80c9-f3fba4c7362d+168:39844:x1859951356838976:12345-16482@kfi7:400:default-tuolumne1516-0 Request processed in 65us (100us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851860.682321:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16482@kfi7, seq: 2001885
00000100:00000040:7.0:1773851860.682322:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000b3be791 : new rpc_count 0
00000800:00000200:5.0:1773851860.682322:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851860.682323:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851860.682323:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851860.682323:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851860.682324:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851860.682324:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16547@kfi7: PUT: OK
00000020:00000010:7.0:1773851860.682325:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000080eb462c.
00000400:00000200:5.0:1773851860.682325:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edcc54b1
00000020:00000010:7.0:1773851860.682326:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d2a17bef.
00000400:00000010:5.0:1773851860.682326:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edcc54b1.
00000020:00000040:7.0:1773851860.682327:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000000b3be791 : new refcount 167
00000100:00000001:7.0:1773851860.682327:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.682327:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851860.682327:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851860.682328:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000024ee968d nid 16547@kfi7 refs 2
00000800:00000200:5.0:1773851860.682329:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 16547@kfi7(000000007ce9b0be):0x0 lsk 2925 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb6c Transaction freed
00000800:00000200:13.0:1773851860.686537:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851860.686538:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851860.686540:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851860.686542:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851860.686544:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17616@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.686546:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17616@kfi7 : PUT - for me
00000400:00000200:13.0:1773851860.686546:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17616@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.686547:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 1
00000400:00000200:13.0:1773851860.686548:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17616@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.686549:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 2
00000400:00000200:13.0:1773851860.686550:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 3
00000400:00000200:13.0:1773851860.686551:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17616@kfi7 to cpt 3
00000400:00000200:13.0:1773851860.686552:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17616@kfi7 of length 224 into portal 12 MB=0x69b1a2badfcc0
00000400:00000200:13.0:1773851860.686553:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17616@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 22632
00000800:00000200:13.0:1773851860.686555:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851860.686557:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851860.686558:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17616@kfi7: PUT: OK
00000100:00000001:13.0:1773851860.686559:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851860.686559:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851860.686560:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002fbd1716.
00000100:00000040:13.0:1773851860.686561:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000002fbd1716 x1859386564541632 msgsize 224
00000100:00100000:13.0:1773851860.686562:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-17616@kfi7 (source: 12345-17616@kfi7)
00000100:00000001:13.0:1773851860.686563:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851860.686564:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 2
00000100:00000001:15.0:1773851860.686565:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851860.686565:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851860.686565:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851860.686566:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851860.686566:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851860.686567:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851860.686568:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859386564541632
00000020:00000001:15.0:1773851860.686568:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851860.686569:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079a59897d6
00000020:00000001:15.0:1773851860.686569:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851860.686572:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bde40a28 refcount=168
00000020:00000001:15.0:1773851860.686573:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117226203136 : -106956483348480 : ffff9eb940cdb800)
00000020:00000001:15.0:1773851860.686574:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117226203136 : -106956483348480 : ffff9eb940cdb800)
00000100:00000001:15.0:1773851860.686575:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.686576:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851860.686576:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ba835c49.
00000020:00000010:15.0:1773851860.686577:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851860.686578:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851860.686579:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851860.686579:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851860.686580:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.686581:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851860.686581:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851860.686582:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.686582:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851860.686584:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851860.686584:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851860.686584:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851860.686584:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851860.686585:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17616@kfi7, seq: 2289807
00000100:00000040:15.0:1773851860.686586:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bde40a28 : new rpc_count 1
00000100:00000001:13.0:1773851860.686586:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.686587:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537168000 : -107002172383616 : ffff9eae9d865e80)
00000100:00000001:13.0:1773851860.686587:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.686588:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002fbd1716 x1859386564541632/t0(0) o400->0e5a5571-e48e-44ef-97f9-8979bd6a706c@17616@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1585-0'
00000100:00000001:15.0:1773851860.686591:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851860.686592:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851860.686593:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fbd1716 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:0e5a5571-e48e-44ef-97f9-8979bd6a706c+168:39627:x1859386564541632:12345-17616@kfi7:400:default-tuolumne1585-0
00000100:00000200:15.0:1773851860.686594:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859386564541632
00000020:00000001:15.0:1773851860.686595:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851860.686595:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851860.686596:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.686597:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851860.686597:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851860.686598:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851860.686598:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859386564541632, found 0 last_xid 1859386564119999
00000020:00000001:15.0:1773851860.686599:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851860.686600:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851860.686600:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851860.686601:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.686602:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851860.686602:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851860.686603:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851860.686604:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000070287909.
02000000:00000001:15.0:1773851860.686604:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.686605:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.686605:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851860.686606:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062154, transno 0, xid 1859386564541632
00010000:00000001:15.0:1773851860.686607:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851860.686608:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002fbd1716 x1859386564541632/t0(0) o400->0e5a5571-e48e-44ef-97f9-8979bd6a706c@17616@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1585-0'
00010000:00000001:15.0:1773851860.686610:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851860.686610:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851860.686612:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=93 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851860.686612:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851860.686613:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007feda9db refcount 3 to 17616@kfi7
00000100:00000001:15.0:1773851860.686614:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902778976 : -107154806772640 : ffff9e8b13ce6c60)
02000000:00000001:15.0:1773851860.686618:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851860.686619:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851860.686620:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851860.686620:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17616@kfi7
00000400:00000010:15.0:1773851860.686621:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034ed0079.
00000100:00000200:15.0:1773851860.686622:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859386564541632, offset 224
00000400:00000200:15.0:1773851860.686623:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17616@kfi7
00000400:00000200:15.0:1773851860.686624:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17616@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.686625:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 1
00000400:00000200:15.0:1773851860.686626:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 2
00000400:00000200:15.0:1773851860.686627:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 3
00000400:00000200:15.0:1773851860.686628:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17616@kfi7 local destination
00000400:00000200:15.0:1773851860.686629:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768924:8768924:1024:4294967295] 17616@kfi7 LPNI seq info [1811153:1811153:16:4294967295]
00000400:00000200:15.0:1773851860.686631:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 2
00000400:00000200:15.0:1773851860.686631:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17616@kfi7 to cpt 3
00000400:00000200:15.0:1773851860.686634:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17616@kfi7(17616@kfi7:17616@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851860.686635:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 3
00000800:00000200:15.0:1773851860.686636:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851860.686637:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851860.686639:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851860.686641:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8aa Using peer 17616@kfi7(0x8aa)
00000800:00000200:15.0:1773851860.686645:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x8aa: rc=0
00000800:00000200:15.0:1773851860.686646:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851860.686648:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851860.686649:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007feda9db refcount 2 to 17616@kfi7
00010000:00000001:15.0:1773851860.686650:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851860.686650:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851860.686652:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851860.686652:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002fbd1716 x1859386564541632/t0(0) o400->0e5a5571-e48e-44ef-97f9-8979bd6a706c@17616@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1585-0'
00000100:00100000:15.0:1773851860.686655:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fbd1716 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:0e5a5571-e48e-44ef-97f9-8979bd6a706c+168:39627:x1859386564541632:12345-17616@kfi7:400:default-tuolumne1585-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851860.686658:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17616@kfi7, seq: 2289807
00000100:00000040:15.0:1773851860.686658:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bde40a28 : new rpc_count 0
00000800:00000200:13.0:1773851860.686658:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8aa TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851860.686659:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851860.686659:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851860.686660:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851860.686660:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851860.686660:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17616@kfi7: PUT: OK
00000020:00000010:15.0:1773851860.686661:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000020:00000010:15.0:1773851860.686662:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ba835c49.
00000400:00000200:13.0:1773851860.686662:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034ed0079
00000400:00000010:13.0:1773851860.686662:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034ed0079.
00000020:00000040:15.0:1773851860.686663:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000bde40a28 : new refcount 167
00000100:00000001:15.0:1773851860.686663:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851860.686663:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851860.686664:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851860.686664:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cc1f9c5d nid 17616@kfi7 refs 2
00000800:00000200:13.0:1773851860.686666:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 17616@kfi7(0000000023e29d19):0x0 lsk 2219 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x8aa Transaction freed
00000800:00000200:2.0:1773851860.691384:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.691384:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.691385:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851860.691386:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851860.691388:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.691388:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:2.0:1773851860.691391:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851860.691392:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15298@kfi7(000000001749c54e):0x937 version: 2; local version 2; negotiated version: 2
00000400:00000200:2.0:1773851860.691395:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15298@kfi7 to cpt 0
00000800:00000200:1.0:1773851860.691395:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 Using peer 15298@kfi7(0x937)
00000400:00000200:2.0:1773851860.691397:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15298@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.691398:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15298@kfi7 to cpt 0
00000400:00000200:2.0:1773851860.691399:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15298@kfi7 to cpt 0
00000400:00000200:2.0:1773851860.691400:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082e85794 nid 15298@kfi7 refs 1
00000800:00000200:1.0:1773851860.691401:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 38 bytes to peer 0x937: rc=0
00000400:00000200:2.0:1773851860.691402:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15298@kfi7 to cpt 0
00000400:00000200:2.0:1773851860.691403:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082e85794 nid 15298@kfi7 refs 2
00000800:00000200:1.0:1773851860.691403:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851860.691405:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000082e85794 nid 15298@kfi7 refs 3
00000400:00000200:2.0:1773851860.691406:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15107@kfi7 to cpt 0
00000400:00000200:2.0:1773851860.691408:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15107@kfi7 of length 224 into portal 12 MB=0x69b4b58fc9480
00000400:00000200:2.0:1773851860.691410:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15107@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 20960
00000800:00000200:2.0:1773851860.691413:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851860.691416:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:1.0:1773851860.691417:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851860.691418:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15298@kfi7: PUT: OK
00000100:00000001:2.0:1773851860.691419:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851860.691420:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851860.691421:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b524ca45.
00000100:00000040:2.0:1773851860.691422:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000b524ca45 x1859597778064512 msgsize 224
00000800:00000200:1.0:1773851860.691422:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 Transaction freed
00000100:00100000:2.0:1773851860.691425:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-15107@kfi7 (source: 12345-15298@kfi7)
00000100:00000001:2.0:1773851860.691427:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851860.691428:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000082e85794 nid 15298@kfi7 refs 2
00000100:00000001:0.0:1773851860.691429:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851860.691430:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.691430:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.691431:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.691431:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.691433:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.691434:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597778064512
00000020:00000001:0.0:1773851860.691435:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.691435:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e4fe
00000020:00000001:0.0:1773851860.691436:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.691439:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000efb4b76 refcount=167
00000020:00000001:0.0:1773851860.691441:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148207232000 : -106925502319616 : ffff9ec0776ab400)
00000020:00000001:0.0:1773851860.691442:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148207232000 : -106925502319616 : ffff9ec0776ab400)
00000100:00000001:0.0:1773851860.691443:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.691445:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.691445:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851860.691447:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.691448:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.691449:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.691450:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.691451:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.691452:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.691453:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.691453:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.691455:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851860.691457:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851860.691457:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.691458:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.691458:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.691459:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15107@kfi7, seq: 1997526
00000100:00000040:0.0:1773851860.691460:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000efb4b76 : new rpc_count 1
00000100:00000001:1.0:1773851860.691461:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851860.691461:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.691461:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706799488 : -106953002752128 : ffff9eba10436780)
00000100:00000040:0.0:1773851860.691463:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b524ca45 x1859597778064512/t0(0) o400->62217b19-f1f3-4b67-835d-5fa0b5a2b304@15107@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1447-0'
00000100:00000001:0.0:1773851860.691468:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.691469:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.691470:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b524ca45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:62217b19-f1f3-4b67-835d-5fa0b5a2b304+167:39565:x1859597778064512:12345-15107@kfi7:400:default-tuolumne1447-0
00000100:00000200:0.0:1773851860.691472:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597778064512
00000020:00000001:0.0:1773851860.691473:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.691474:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.691475:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.691476:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.691477:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.691478:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.691479:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597778064512, found 0 last_xid 1859597777641983
00000020:00000001:0.0:1773851860.691481:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.691482:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.691482:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.691483:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.691484:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.691485:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.691486:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.691487:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000521d5970.
02000000:00000001:0.0:1773851860.691488:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.691489:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.691490:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.691491:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062658, transno 0, xid 1859597778064512
00010000:00000001:0.0:1773851860.691492:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.691493:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b524ca45 x1859597778064512/t0(0) o400->62217b19-f1f3-4b67-835d-5fa0b5a2b304@15107@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1447-0'
00010000:00000001:0.0:1773851860.691497:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.691498:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.691499:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.691501:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.691502:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ec716e6c refcount 3 to 15107@kfi7
00000100:00000001:0.0:1773851860.691503:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545857248 : -107154163694368 : ffff9e8b3a2304e0)
02000000:00000001:0.0:1773851860.691505:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.691506:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.691507:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.691508:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15298@kfi7
00000400:00000010:0.0:1773851860.691509:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bcd8159c.
00000100:00000200:0.0:1773851860.691510:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597778064512, offset 224
00000400:00000200:0.0:1773851860.691512:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15298@kfi7
00000400:00000200:0.0:1773851860.691513:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15298@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.691514:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082e85794 nid 15298@kfi7 refs 1
00000400:00000200:0.0:1773851860.691516:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000082e85794 nid 15298@kfi7 refs 2
00000400:00000200:0.0:1773851860.691518:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000082e85794 nid 15298@kfi7 refs 3
00000400:00000200:0.0:1773851860.691520:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15298@kfi7 local destination
00000400:00000200:0.0:1773851860.691522:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768925:8768925:1024:4294967295] 15298@kfi7 LPNI seq info [204039:204039:16:4294967295]
00000400:00000200:0.0:1773851860.691524:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000082e85794 nid 15298@kfi7 refs 2
00000400:00000200:0.0:1773851860.691525:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15298@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.691528:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15298@kfi7(15298@kfi7:15298@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.691530:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000082e85794 nid 15298@kfi7 refs 3
00000800:00000200:0.0:1773851860.691533:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.691534:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.691538:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.691541:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 Using peer 15298@kfi7(0x937)
00000800:00000200:0.0:1773851860.691546:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x937: rc=0
00000800:00000200:0.0:1773851860.691548:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.691551:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.691552:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ec716e6c refcount 2 to 15107@kfi7
00010000:00000001:0.0:1773851860.691554:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.691556:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.691558:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.691559:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b524ca45 x1859597778064512/t0(0) o400->62217b19-f1f3-4b67-835d-5fa0b5a2b304@15107@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1447-0'
00000100:00100000:0.0:1773851860.691564:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b524ca45 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:62217b19-f1f3-4b67-835d-5fa0b5a2b304+167:39565:x1859597778064512:12345-15107@kfi7:400:default-tuolumne1447-0 Request processed in 95us (141us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.691568:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15107@kfi7, seq: 1997526
00000100:00000040:0.0:1773851860.691569:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000efb4b76 : new rpc_count 0
00000100:00000001:0.0:1773851860.691570:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.691571:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.691572:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.691573:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.691575:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851860.691576:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000000efb4b76 : new refcount 166
00000100:00000001:0.0:1773851860.691577:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.691584:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.691586:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.691588:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15298@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.691589:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bcd8159c
00000400:00000010:1.0:1773851860.691590:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bcd8159c.
00000100:00000001:1.0:1773851860.691591:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.691592:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.691593:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000082e85794 nid 15298@kfi7 refs 2
00000800:00000200:1.0:1773851860.691596:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 15298@kfi7(000000001749c54e):0x0 lsk 2360 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x937 Transaction freed
00000800:00000200:5.0:1773851860.711146:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.711146:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851860.711148:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851860.711149:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851860.711151:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22778@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.711152:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22778@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.711153:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22778@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.711154:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071c7cc4d nid 22778@kfi7 refs 1
00000400:00000200:5.0:1773851860.711155:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22778@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.711155:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071c7cc4d nid 22778@kfi7 refs 2
00000400:00000200:5.0:1773851860.711156:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000071c7cc4d nid 22778@kfi7 refs 3
00000400:00000200:5.0:1773851860.711157:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22778@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.711158:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22778@kfi7 of length 224 into portal 12 MB=0x699de8c39a580
00000400:00000200:5.0:1773851860.711159:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22778@kfi7 of length 224/224 into md 0x793926dc5 [64] + 128280
00000800:00000200:5.0:1773851860.711161:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851860.711163:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.711164:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22778@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.711165:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851860.711165:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851860.711166:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c3b7c245.
00000100:00000040:5.0:1773851860.711167:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000c3b7c245 x1858030974641536 msgsize 224
00000100:00100000:5.0:1773851860.711168:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22778@kfi7 (source: 12345-22778@kfi7)
00000100:00000001:5.0:1773851860.711169:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851860.711170:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000071c7cc4d nid 22778@kfi7 refs 2
00000100:00000001:7.0:1773851860.711171:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851860.711171:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851860.711172:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851860.711172:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851860.711172:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851860.711173:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.711174:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974641536
00000020:00000001:7.0:1773851860.711174:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.711175:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91054
00000020:00000001:7.0:1773851860.711175:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.711177:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000e171558 refcount=6
00000020:00000001:7.0:1773851860.711178:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240102912 : -107152469448704 : ffff9e8b9f1f2800)
00000020:00000001:7.0:1773851860.711178:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240102912 : -107152469448704 : ffff9e8b9f1f2800)
00000100:00000001:7.0:1773851860.711179:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.711180:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.711181:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009ae7d441.
00000020:00000010:7.0:1773851860.711182:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851860.711183:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000080eb462c.
00000100:00000001:7.0:1773851860.711183:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.711184:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.711184:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.711185:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.711186:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.711186:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.711187:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.711188:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.711188:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851860.711188:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851860.711189:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22778@kfi7, seq: 2001886
00000100:00000001:5.0:1773851860.711189:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851860.711190:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000e171558 : new rpc_count 1
00000100:00000001:5.0:1773851860.711190:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.711191:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866952576 : -107088842599040 : ffff9e9a6f93d580)
00000100:00000001:5.0:1773851860.711191:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.711192:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c3b7c245 x1858030974641536/t0(0) o400->f62bbbec-8d69-457c-8753-311b51498aab@22778@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne257-0'
00000100:00000001:7.0:1773851860.711205:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.711205:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851860.711206:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3b7c245 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f62bbbec-8d69-457c-8753-311b51498aab+6:47656:x1858030974641536:12345-22778@kfi7:400:default-tuolumne257-0
00000100:00000200:7.0:1773851860.711208:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974641536
00000020:00000001:7.0:1773851860.711209:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851860.711209:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851860.711210:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.711211:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851860.711211:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851860.711212:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851860.711212:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974641536, found 0 last_xid 1858030974641535
00000020:00000001:7.0:1773851860.711213:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851860.711214:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851860.711214:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851860.711215:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.711216:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851860.711216:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851860.711217:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851860.711217:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001b52c285.
02000000:00000001:7.0:1773851860.711218:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.711219:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.711220:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851860.711220:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030974641536
00010000:00000001:7.0:1773851860.711221:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851860.711222:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c3b7c245 x1858030974641536/t0(0) o400->f62bbbec-8d69-457c-8753-311b51498aab@22778@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne257-0'
00010000:00000001:7.0:1773851860.711225:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851860.711225:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851860.711226:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851860.711227:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851860.711228:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002c68e303 refcount 5 to 22778@kfi7
00000100:00000001:7.0:1773851860.711229:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702016 : -107156155849600 : ffff9e8ac3652480)
02000000:00000001:7.0:1773851860.711230:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851860.711231:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.711232:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851860.711232:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22778@kfi7
00000400:00000010:7.0:1773851860.711233:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009424d83.
00000100:00000200:7.0:1773851860.711234:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974641536, offset 224
00000400:00000200:7.0:1773851860.711235:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22778@kfi7
00000400:00000200:7.0:1773851860.711236:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22778@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.711237:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071c7cc4d nid 22778@kfi7 refs 1
00000400:00000200:7.0:1773851860.711238:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000071c7cc4d nid 22778@kfi7 refs 2
00000400:00000200:7.0:1773851860.711239:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000071c7cc4d nid 22778@kfi7 refs 3
00000400:00000200:7.0:1773851860.711240:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22778@kfi7 local destination
00000400:00000200:7.0:1773851860.711241:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768926:8768926:1024:4294967295] 22778@kfi7 LPNI seq info [24422:24422:16:4294967295]
00000400:00000200:7.0:1773851860.711243:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000071c7cc4d nid 22778@kfi7 refs 2
00000400:00000200:7.0:1773851860.711243:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22778@kfi7 to cpt 1
00000400:00000200:7.0:1773851860.711245:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22778@kfi7(22778@kfi7:22778@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851860.711246:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000071c7cc4d nid 22778@kfi7 refs 3
00000800:00000200:7.0:1773851860.711247:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851860.711248:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851860.711250:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851860.711252:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000234 Using peer 22778@kfi7(0x100000000000234)
00000800:00000200:7.0:1773851860.711255:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x100000000000234: rc=0
00000800:00000200:7.0:1773851860.711257:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000234 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851860.711259:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851860.711260:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002c68e303 refcount 4 to 22778@kfi7
00010000:00000001:7.0:1773851860.711260:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851860.711261:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851860.711262:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851860.711262:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c3b7c245 x1858030974641536/t0(0) o400->f62bbbec-8d69-457c-8753-311b51498aab@22778@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne257-0'
00000100:00100000:7.0:1773851860.711265:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3b7c245 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f62bbbec-8d69-457c-8753-311b51498aab+6:47656:x1858030974641536:12345-22778@kfi7:400:default-tuolumne257-0 Request processed in 60us (98us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851860.711268:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22778@kfi7, seq: 2001886
00000100:00000040:7.0:1773851860.711269:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000e171558 : new rpc_count 0
00000100:00000001:7.0:1773851860.711269:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851860.711269:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000234 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851860.711270:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851860.711270:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851860.711270:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851860.711271:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000080eb462c.
00000400:00000200:5.0:1773851860.711271:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22778@kfi7: PUT: OK
00000020:00000010:7.0:1773851860.711272:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009ae7d441.
00000020:00000040:7.0:1773851860.711272:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000000e171558 : new refcount 5
00000400:00000200:5.0:1773851860.711272:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009424d83
00000400:00000010:5.0:1773851860.711272:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009424d83.
00000100:00000001:7.0:1773851860.711273:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.711273:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851860.711274:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851860.711274:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000071c7cc4d nid 22778@kfi7 refs 2
00000800:00000200:5.0:1773851860.711276:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22778@kfi7(0000000084148929):0x0 lsk 565 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000234 Transaction freed
00000800:00000200:18.0:1773851860.711522:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.711522:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.711523:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.711523:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851860.711524:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000582ee624: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.711524:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851860.711526:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000582ee624: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851860.711526:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22779@kfi7(00000000b67fbe83):0x236 version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851860.711528:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22779@kfi7 to cpt 4
00000800:00000200:17.0:1773851860.711528:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 Using peer 22779@kfi7(0x236)
00000400:00000200:17.0:1773851860.711529:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22779@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.711530:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22779@kfi7 : PUT - for me
00000400:00000200:18.0:1773851860.711531:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22779@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.711531:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c55fedc1 nid 22779@kfi7 refs 1
00000800:00000200:17.0:1773851860.711531:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x236: rc=0
00000400:00000200:18.0:1773851860.711533:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22779@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.711533:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c55fedc1 nid 22779@kfi7 refs 2
00000800:00000200:17.0:1773851860.711533:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851860.711534:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c55fedc1 nid 22779@kfi7 refs 3
00000400:00000200:18.0:1773851860.711535:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22778@kfi7 to cpt 1
00000400:00000200:18.0:1773851860.711536:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22778@kfi7 of length 224 into portal 12 MB=0x699de8c39adc0
00000400:00000200:18.0:1773851860.711538:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22778@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 1120
00000800:00000200:18.0:1773851860.711540:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000582ee624: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851860.711541:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851860.711542:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22779@kfi7: PUT: OK
00000100:00000001:18.0:1773851860.711544:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851860.711544:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:17.0:1773851860.711544:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 TN_EVENT_TX_OK event status 0
00000100:00000010:18.0:1773851860.711545:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c87a7cf.
00000100:00000040:18.0:1773851860.711546:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001c87a7cf x1858030974643648 msgsize 224
00000100:00100000:18.0:1773851860.711547:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-22778@kfi7 (source: 12345-22779@kfi7)
00000800:00000200:17.0:1773851860.711547:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 Transaction freed
00000100:00000001:18.0:1773851860.711548:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851860.711549:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c55fedc1 nid 22779@kfi7 refs 2
00000100:00000001:19.0:1773851860.711550:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851860.711551:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851860.711551:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:18.0:1773851860.711551:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000582ee624: 2069@kfi7:4 <- 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851860.711552:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851860.711552:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851860.711553:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974643648
00000020:00000001:19.0:1773851860.711554:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851860.711554:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912f4
00000020:00000001:19.0:1773851860.711554:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851860.711557:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007b6043f4 refcount=6
00000020:00000001:19.0:1773851860.711558:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716190208 : -107155993361408 : ffff9e8acd148400)
00000020:00000001:19.0:1773851860.711559:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716190208 : -107155993361408 : ffff9e8acd148400)
00000100:00000001:19.0:1773851860.711560:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851860.711561:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851860.711561:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e7f7db99.
00000020:00000010:19.0:1773851860.711562:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851860.711563:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050de7c24.
00000100:00000001:19.0:1773851860.711564:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851860.711564:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851860.711565:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.711566:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851860.711566:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851860.711567:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.711568:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.711569:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.711569:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851860.711569:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851860.711569:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.711570:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22778@kfi7, seq: 2156287
00000100:00000001:19.0:1773851860.711571:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.711571:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007b6043f4 : new rpc_count 1
00000100:00000001:19.0:1773851860.711572:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.711572:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534644608 : -106946174907008 : ffff9ebba73c0d80)
00000100:00000040:18.0:1773851860.711573:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c87a7cf x1858030974643648/t0(0) o400->0d9de588-fdcf-4907-9e12-60aa40c8d6d5@22778@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne257-0'
00000100:00000001:18.0:1773851860.711575:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.711576:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.711576:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c87a7cf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:0d9de588-fdcf-4907-9e12-60aa40c8d6d5+6:47657:x1858030974643648:12345-22778@kfi7:400:default-tuolumne257-0
00000100:00000200:18.0:1773851860.711578:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974643648
00000020:00000001:18.0:1773851860.711578:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851860.711579:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851860.711580:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.711580:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851860.711581:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851860.711582:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851860.711582:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974643648, found 0 last_xid 1858030974643647
00000020:00000001:18.0:1773851860.711583:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851860.711584:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851860.711584:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851860.711585:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.711585:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851860.711586:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.711587:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.711587:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000079be9bfc.
02000000:00000001:18.0:1773851860.711588:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.711588:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.711589:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851860.711590:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768250, transno 0, xid 1858030974643648
00010000:00000001:18.0:1773851860.711590:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851860.711591:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c87a7cf x1858030974643648/t0(0) o400->0d9de588-fdcf-4907-9e12-60aa40c8d6d5@22778@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne257-0'
00010000:00000001:18.0:1773851860.711594:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.711594:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.711595:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=315 (315 214 1 1)
00000100:00000001:18.0:1773851860.711596:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.711597:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002c68e303 refcount 5 to 22778@kfi7
00000100:00000001:18.0:1773851860.711597:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702016 : -107156155849600 : ffff9e8ac3652480)
02000000:00000001:18.0:1773851860.711598:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.711599:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.711599:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.711600:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22779@kfi7
00000400:00000010:18.0:1773851860.711600:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006b39e83d.
00000100:00000200:18.0:1773851860.711601:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974643648, offset 224
00000400:00000200:18.0:1773851860.711602:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22779@kfi7
00000400:00000200:18.0:1773851860.711603:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22779@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.711604:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c55fedc1 nid 22779@kfi7 refs 1
00000400:00000200:18.0:1773851860.711604:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c55fedc1 nid 22779@kfi7 refs 2
00000400:00000200:18.0:1773851860.711606:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c55fedc1 nid 22779@kfi7 refs 3
00000400:00000200:18.0:1773851860.711607:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22779@kfi7 local destination
00000400:00000200:18.0:1773851860.711609:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768927:8768927:1024:4294967295] 22779@kfi7 LPNI seq info [24423:24423:16:4294967295]
00000400:00000200:18.0:1773851860.711610:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c55fedc1 nid 22779@kfi7 refs 2
00000400:00000200:18.0:1773851860.711610:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22779@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.711612:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22779@kfi7(22779@kfi7:22779@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.711613:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c55fedc1 nid 22779@kfi7 refs 3
00000800:00000200:18.0:1773851860.711614:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.711615:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.711617:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.711619:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 Using peer 22779@kfi7(0x236)
00000800:00000200:18.0:1773851860.711622:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000582ee624: Posted send of 324 bytes to peer 0x236: rc=0
00000800:00000200:18.0:1773851860.711623:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.711625:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.711626:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002c68e303 refcount 4 to 22778@kfi7
00010000:00000001:18.0:1773851860.711627:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851860.711627:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.711628:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851860.711628:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c87a7cf x1858030974643648/t0(0) o400->0d9de588-fdcf-4907-9e12-60aa40c8d6d5@22778@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne257-0'
00000100:00100000:18.0:1773851860.711631:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c87a7cf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:0d9de588-fdcf-4907-9e12-60aa40c8d6d5+6:47657:x1858030974643648:12345-22778@kfi7:400:default-tuolumne257-0 Request processed in 55us (84us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851860.711633:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22778@kfi7, seq: 2156287
00000100:00000040:18.0:1773851860.711634:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007b6043f4 : new rpc_count 0
00000100:00000001:18.0:1773851860.711634:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851860.711635:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851860.711635:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851860.711636:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:18.0:1773851860.711636:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050de7c24.
00000400:00000200:17.0:1773851860.711636:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:18.0:1773851860.711637:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e7f7db99.
00000400:00000200:17.0:1773851860.711637:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22779@kfi7: PUT: OK
00000020:00000040:18.0:1773851860.711638:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000007b6043f4 : new refcount 5
00000400:00000200:17.0:1773851860.711638:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006b39e83d
00000400:00000010:17.0:1773851860.711638:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006b39e83d.
00000100:00000001:18.0:1773851860.711639:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851860.711639:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.711639:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851860.711640:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c55fedc1 nid 22779@kfi7 refs 2
00000800:00000200:17.0:1773851860.711641:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000582ee624: 2069@kfi7:4 -> 22779@kfi7(00000000b67fbe83):0x0 lsk 567 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x236 Transaction freed
00000800:00000200:25.0:1773851860.714851:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851860.714851:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851860.714853:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851860.714855:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851860.714857:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.714858:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:25.0:1773851860.714859:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.714860:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:25.0:1773851860.714861:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.714862:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851860.714862:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:25.0:1773851860.714863:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851860.714864:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed416440
00000400:00000200:25.0:1773851860.714866:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x160dfce379 [256] + 12944
00000800:00000200:25.0:1773851860.714868:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851860.714869:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851860.714870:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851860.714871:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851860.714872:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851860.714872:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c0b48888.
00000100:00000040:25.0:1773851860.714873:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c0b48888 x1858062667310144 msgsize 224
00000100:00100000:25.0:1773851860.714875:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000100:00000001:25.0:1773851860.714876:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851860.714877:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851860.714878:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851860.714881:0:1691804:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851860.714881:0:1691804:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851860.714882:0:1691804:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851860.714882:0:1691804:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851860.714883:0:1691804:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851860.714883:0:1691804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667310144
00000020:00000001:25.0:1773851860.714884:0:1691804:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851860.714884:0:1691804:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:25.0:1773851860.714885:0:1691804:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851860.714886:0:1691804:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:25.0:1773851860.714887:0:1691804:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:25.0:1773851860.714888:0:1691804:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:25.0:1773851860.714889:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851860.714890:0:1691804:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851860.714891:0:1691804:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000059c91f3.
00000020:00000010:25.0:1773851860.714892:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851860.714893:0:1691804:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006daec5af.
00000100:00000040:25.0:1773851860.714895:0:1691804:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:25.0:1773851860.714895:0:1691804:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851860.714896:0:1691804:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851860.714896:0:1691804:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851860.714897:0:1691804:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851860.714898:0:1691804:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851860.714899:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851860.714899:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851860.714900:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851860.714900:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851860.714901:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799980
00000100:00000001:25.0:1773851860.714902:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.714902:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:25.0:1773851860.714903:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.714903:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637054961772416 : -107018747779200 : ffff9eaac18de780)
00000100:00000040:24.0:1773851860.714904:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c0b48888 x1858062667310144/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:24.0:1773851860.714906:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851860.714907:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851860.714908:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0b48888 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667310144:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:24.0:1773851860.714909:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667310144
00000020:00000001:24.0:1773851860.714910:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851860.714910:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851860.714911:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.714912:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851860.714912:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851860.714913:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851860.714913:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851860.714914:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851860.714915:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851860.714915:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.714916:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851860.714916:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851860.714917:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000efbba8ad.
02000000:00000001:24.0:1773851860.714918:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.714919:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851860.714920:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851860.714920:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851860.714921:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851860.714922:0:1537164:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851860.714924:0:1537164:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851860.714924:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851860.714925:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851860.714928:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851860.714928:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667310144
00010000:00000001:24.0:1773851860.714929:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851860.714930:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c0b48888 x1858062667310144/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:587/0 lens 224/368 e 0 to 0 dl 1773851947 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:24.0:1773851860.714933:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851860.714933:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851860.714934:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=137 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851860.714935:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851860.714936:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:24.0:1773851860.714936:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:24.0:1773851860.714937:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851860.714938:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.714938:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851860.714939:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:24.0:1773851860.714940:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d7bd97df.
00000100:00000200:24.0:1773851860.714941:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667310144, offset 224
00000400:00000200:24.0:1773851860.714942:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:24.0:1773851860.714943:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851860.714944:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:24.0:1773851860.714945:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851860.714946:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:24.0:1773851860.714947:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2105@kfi7 local destination
00000400:00000200:24.0:1773851860.714948:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768928:8768928:1024:4294967295] 2105@kfi7 LPNI seq info [20346200:20346200:16:4294967295]
00000400:00000200:24.0:1773851860.714949:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851860.714950:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851860.714952:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851860.714953:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:24.0:1773851860.714955:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851860.714956:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851860.714958:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851860.714960:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000800:00000200:24.0:1773851860.714963:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000067401146: Posted send of 468 bytes to peer 0x20000000000085c: rc=0
00000800:00000200:24.0:1773851860.714965:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851860.714967:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.714967:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:24.0:1773851860.714968:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851860.714969:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.714969:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851860.714971:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c0b48888 x1858062667310144/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:587/0 lens 224/368 e 0 to 0 dl 1773851947 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:24.0:1773851860.714974:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0b48888 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667310144:12345-2098@kfi7:41:default-yuba6-0 Request processed in 67us (100us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851860.714976:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799980
00000100:00000040:24.0:1773851860.714977:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:24.0:1773851860.714978:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851860.714978:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851860.714979:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851860.714980:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006daec5af.
00000020:00000010:24.0:1773851860.714980:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000059c91f3.
00000020:00000040:24.0:1773851860.714981:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:24.0:1773851860.714982:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851860.714987:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851860.714988:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851860.714989:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000400:00000200:25.0:1773851860.714990:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d7bd97df
00000400:00000010:25.0:1773851860.714991:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d7bd97df.
00000100:00000001:25.0:1773851860.714992:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851860.714992:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851860.714993:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851860.714995:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c Transaction freed
00000800:00000200:17.0:1773851860.717931:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.717933:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.717935:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.717939:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.717942:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.717944:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.157@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851860.717945:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.717946:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851860.717948:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.157@o2ib600 to cpt 6
00000400:00000200:17.0:1773851860.717950:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027ea643b nid 172.19.3.157@o2ib600 refs 2
00000400:00000200:17.0:1773851860.717952:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000027ea643b nid 172.19.3.157@o2ib600 refs 3
00000400:00000200:17.0:1773851860.717954:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.157@o2ib600 to cpt 6
00000400:00000200:17.0:1773851860.717955:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.157@o2ib600 of length 224 into portal 12 MB=0x699fd45e45040
00000400:00000200:17.0:1773851860.717958:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.157@o2ib600 of length 224/224 into md 0x16159c6179 [64] + 189496
00000800:00000200:17.0:1773851860.717961:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.717963:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.717965:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.717966:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.717967:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.717968:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a44e8848.
00000100:00000040:17.0:1773851860.717969:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a44e8848 x1858162938630208 msgsize 224
00000100:00100000:17.0:1773851860.717972:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.157@o2ib600 (source: 12345-172.19.3.157@o2ib600)
00000100:00000001:17.0:1773851860.717974:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.717975:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851860.717977:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851860.717978:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851860.717979:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851860.717980:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851860.717981:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851860.717982:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851860.717983:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858162938630208
00000020:00000001:24.0:1773851860.717983:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851860.717984:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91555
00000020:00000001:24.0:1773851860.717986:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851860.717989:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003e55df29 refcount=7
00000020:00000001:24.0:1773851860.717990:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241018368 : -107152468533248 : ffff9e8b9f2d2000)
00000020:00000001:24.0:1773851860.717991:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241018368 : -107152468533248 : ffff9e8b9f2d2000)
00000100:00000001:24.0:1773851860.717992:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851860.717993:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851860.717994:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003f57bde1.
00000020:00000010:24.0:1773851860.717995:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851860.717996:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851860.717998:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851860.717999:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851860.717999:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851860.718001:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851860.718002:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851860.718002:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.718004:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851860.718006:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851860.718007:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851860.718007:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851860.718008:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851860.718009:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.157@o2ib600, seq: 2025069
00000100:00000001:25.0:1773851860.718010:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.718010:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003e55df29 : new rpc_count 1
00000100:00000001:25.0:1773851860.718011:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.718011:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764345984 : -107095945205632 : ffff9e98c83aa880)
00000100:00000040:24.0:1773851860.718013:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a44e8848 x1858162938630208/t0(0) o400->3a676bd1-0b40-46fb-b438-f80ad1693184@172.19.3.157@o2ib600:77/0 lens 224/0 e 0 to 0 dl 1773852192 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic7-0'
00000100:00000001:24.0:1773851860.718018:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851860.718019:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851860.718021:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a44e8848 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3a676bd1-0b40-46fb-b438-f80ad1693184+7:26532:x1858162938630208:12345-172.19.3.157@o2ib600:400:login-oslic7-0
00000100:00000200:24.0:1773851860.718023:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858162938630208
00000020:00000001:24.0:1773851860.718023:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851860.718024:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851860.718025:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.718026:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851860.718027:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851860.718029:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851860.718030:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858162938630208, found 0 last_xid 1858162938630207
00000020:00000001:24.0:1773851860.718031:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851860.718032:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851860.718032:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851860.718033:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.718034:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851860.718035:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851860.718035:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851860.718036:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000058df43f4.
02000000:00000001:24.0:1773851860.718037:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.718038:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.718039:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851860.718040:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183056743645, transno 0, xid 1858162938630208
00010000:00000001:24.0:1773851860.718041:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851860.718043:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a44e8848 x1858162938630208/t0(0) o400->3a676bd1-0b40-46fb-b438-f80ad1693184@172.19.3.157@o2ib600:77/0 lens 224/224 e 0 to 0 dl 1773852192 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic7-0'
00010000:00000001:24.0:1773851860.718047:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851860.718048:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851860.718049:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=93 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851860.718050:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851860.718052:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000079fd4f0c refcount 3 to 172.19.3.157@o2ib600
00000100:00000001:24.0:1773851860.718053:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299328512 : -107155410223104 : ffff9e8aefd68000)
02000000:00000001:24.0:1773851860.718054:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851860.718054:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.718055:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851860.718057:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.157@o2ib600
00000400:00000010:24.0:1773851860.718058:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f9a0eed.
00000100:00000200:24.0:1773851860.718059:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858162938630208, offset 224
00000400:00000200:24.0:1773851860.718061:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.157@o2ib600
00000400:00000200:24.0:1773851860.718063:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.157@o2ib600 to cpt 6
00000400:00000200:24.0:1773851860.718065:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027ea643b nid 172.19.3.157@o2ib600 refs 2
00000400:00000200:24.0:1773851860.718067:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000027ea643b nid 172.19.3.157@o2ib600 refs 3
00000400:00000200:24.0:1773851860.718069:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000027ea643b nid 172.19.3.157@o2ib600 refs 4
00000400:00000200:24.0:1773851860.718072:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.157@o2ib600 routed destination
00000400:00000200:24.0:1773851860.718074:0:60973:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:24.0:1773851860.718076:0:60973:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:24.0:1773851860.718078:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.157@o2ib600: rtr pref emtpy: 1
00000400:00000200:24.0:1773851860.718081:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:24.0:1773851860.718082:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.157@o2ib600: rtr pref emtpy: 1
00000400:00000200:24.0:1773851860.718084:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:24.0:1773851860.718085:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768929:8768929:1024:4294967295] 2094@kfi7 LPNI seq info [1258746984:1258746984:16:4294967295]
00000400:00000200:24.0:1773851860.718087:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:24.0:1773851860.718089:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:24.0:1773851860.718093:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.157@o2ib600(172.19.3.157@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851860.718095:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000027ea643b nid 172.19.3.157@o2ib600 refs 3
00000800:00000200:24.0:1773851860.718098:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851860.718099:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851860.718103:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851860.718107:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:24.0:1773851860.718111:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:24.0:1773851860.718113:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851860.718116:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.718117:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000079fd4f0c refcount 2 to 172.19.3.157@o2ib600
00010000:00000001:24.0:1773851860.718120:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851860.718121:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.718122:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851860.718123:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a44e8848 x1858162938630208/t0(0) o400->3a676bd1-0b40-46fb-b438-f80ad1693184@172.19.3.157@o2ib600:77/0 lens 224/224 e 0 to 0 dl 1773852192 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic7-0'
00000100:00100000:24.0:1773851860.718128:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a44e8848 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3a676bd1-0b40-46fb-b438-f80ad1693184+7:26532:x1858162938630208:12345-172.19.3.157@o2ib600:400:login-oslic7-0 Request processed in 109us (158us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851860.718133:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.157@o2ib600, seq: 2025069
00000100:00000040:24.0:1773851860.718134:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003e55df29 : new rpc_count 0
00000100:00000001:24.0:1773851860.718136:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851860.718136:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851860.718137:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851860.718138:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851860.718139:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003f57bde1.
00000020:00000040:24.0:1773851860.718140:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000003e55df29 : new refcount 6
00000100:00000001:24.0:1773851860.718141:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851860.718149:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851860.718151:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851860.718153:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:25.0:1773851860.718154:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f9a0eed
00000400:00000010:25.0:1773851860.718155:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f9a0eed.
00000100:00000001:25.0:1773851860.718157:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851860.718158:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851860.718159:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:25.0:1773851860.718162:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Transaction freed
00000800:00000200:5.0:1773851860.766232:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.766233:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851860.766234:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851860.766236:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851860.766238:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23587@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.766239:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23587@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.766240:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23587@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.766241:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043ee51de nid 23587@kfi7 refs 1
00000400:00000200:5.0:1773851860.766242:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23587@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.766242:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043ee51de nid 23587@kfi7 refs 2
00000400:00000200:5.0:1773851860.766243:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000043ee51de nid 23587@kfi7 refs 3
00000400:00000200:5.0:1773851860.766244:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23587@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.766246:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23587@kfi7 of length 224 into portal 12 MB=0x699e0e3e6cec0
00000400:00000200:5.0:1773851860.766248:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23587@kfi7 of length 224/224 into md 0x793926dc5 [64] + 128504
00000800:00000200:5.0:1773851860.766250:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851860.766251:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.766253:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23587@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.766254:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851860.766254:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851860.766255:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005711c521.
00000100:00000040:5.0:1773851860.766256:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000005711c521 x1858041035542208 msgsize 224
00000100:00100000:5.0:1773851860.766257:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23587@kfi7 (source: 12345-23587@kfi7)
00000100:00000001:5.0:1773851860.766259:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851860.766260:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851860.766260:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000043ee51de nid 23587@kfi7 refs 2
02000000:00000001:7.0:1773851860.766261:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851860.766261:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851860.766261:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851860.766262:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851860.766263:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851860.766264:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041035542208
00000020:00000001:7.0:1773851860.766264:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851860.766265:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bc8
00000020:00000001:7.0:1773851860.766266:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851860.766268:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005be9343e refcount=6
00000020:00000001:7.0:1773851860.766268:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743931904 : -107128965619712 : ffff9e91180f2000)
00000020:00000001:7.0:1773851860.766269:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743931904 : -107128965619712 : ffff9e91180f2000)
00000100:00000001:7.0:1773851860.766270:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851860.766271:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851860.766272:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009ae7d441.
00000020:00000010:7.0:1773851860.766273:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851860.766274:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000080eb462c.
00000100:00000001:7.0:1773851860.766275:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851860.766276:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851860.766276:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.766277:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851860.766278:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851860.766278:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.766279:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851860.766281:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.766281:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851860.766281:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851860.766281:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851860.766282:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23587@kfi7, seq: 2001887
00000100:00000040:5.0:1773851860.766283:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005be9343e : new rpc_count 1
00000100:00000001:7.0:1773851860.766284:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.766284:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851860.766284:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866959488 : -107088842592128 : ffff9e9a6f93f080)
00000100:00000040:5.0:1773851860.766286:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005711c521 x1858041035542208/t0(0) o400->12ae479a-a2f8-4038-9cf2-688479a0d6e5@23587@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1963-0'
00000100:00000001:5.0:1773851860.766289:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851860.766290:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851860.766291:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005711c521 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:12ae479a-a2f8-4038-9cf2-688479a0d6e5+6:39686:x1858041035542208:12345-23587@kfi7:400:default-tuolumne1963-0
00000100:00000200:5.0:1773851860.766292:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041035542208
00000020:00000001:5.0:1773851860.766293:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851860.766294:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851860.766295:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.766296:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851860.766296:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851860.766298:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851860.766299:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041035542208, found 0 last_xid 1858041035542207
00000020:00000001:5.0:1773851860.766300:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851860.766300:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851860.766301:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851860.766302:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.766303:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851860.766303:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851860.766304:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851860.766305:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000047539c0b.
02000000:00000001:5.0:1773851860.766306:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851860.766307:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.766308:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851860.766308:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425799632, transno 0, xid 1858041035542208
00010000:00000001:5.0:1773851860.766309:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851860.766310:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005711c521 x1858041035542208/t0(0) o400->12ae479a-a2f8-4038-9cf2-688479a0d6e5@23587@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1963-0'
00010000:00000001:5.0:1773851860.766313:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851860.766314:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851860.766315:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851860.766316:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851860.766317:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d5379a4f refcount 3 to 23587@kfi7
00000100:00000001:5.0:1773851860.766318:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701440 : -107156155850176 : ffff9e8ac3652240)
02000000:00000001:5.0:1773851860.766319:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851860.766320:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851860.766320:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851860.766321:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23587@kfi7
00000400:00000010:5.0:1773851860.766322:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000a4ed2b3.
00000100:00000200:5.0:1773851860.766324:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041035542208, offset 224
00000400:00000200:5.0:1773851860.766325:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23587@kfi7
00000400:00000200:5.0:1773851860.766326:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23587@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.766327:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043ee51de nid 23587@kfi7 refs 1
00000400:00000200:5.0:1773851860.766328:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000043ee51de nid 23587@kfi7 refs 2
00000400:00000200:5.0:1773851860.766329:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000043ee51de nid 23587@kfi7 refs 3
00000400:00000200:5.0:1773851860.766331:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23587@kfi7 local destination
00000400:00000200:5.0:1773851860.766333:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768930:8768930:1024:4294967295] 23587@kfi7 LPNI seq info [9671455:9671455:16:4294967295]
00000400:00000200:5.0:1773851860.766335:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000043ee51de nid 23587@kfi7 refs 2
00000400:00000200:5.0:1773851860.766336:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23587@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.766338:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23587@kfi7(23587@kfi7:23587@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851860.766340:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000043ee51de nid 23587@kfi7 refs 3
00000800:00000200:5.0:1773851860.766341:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.766342:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851860.766345:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851860.766348:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007e3 Using peer 23587@kfi7(0x1000000000007e3)
00000800:00000200:5.0:1773851860.766351:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 324 bytes to peer 0x1000000000007e3: rc=0
00000800:00000200:5.0:1773851860.766353:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007e3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851860.766356:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851860.766357:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d5379a4f refcount 2 to 23587@kfi7
00010000:00000001:5.0:1773851860.766358:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851860.766358:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.766359:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851860.766360:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005711c521 x1858041035542208/t0(0) o400->12ae479a-a2f8-4038-9cf2-688479a0d6e5@23587@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1963-0'
00000100:00100000:5.0:1773851860.766363:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005711c521 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:12ae479a-a2f8-4038-9cf2-688479a0d6e5+6:39686:x1858041035542208:12345-23587@kfi7:400:default-tuolumne1963-0 Request processed in 73us (106us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851860.766366:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007e3 TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851860.766366:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23587@kfi7, seq: 2001887
00000100:00000040:5.0:1773851860.766367:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005be9343e : new rpc_count 0
00000400:00000200:6.0:1773851860.766368:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851860.766368:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851860.766369:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23587@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.766369:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851860.766370:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000a4ed2b3
00000020:00000010:5.0:1773851860.766370:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000010:6.0:1773851860.766371:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000a4ed2b3.
00000020:00000010:5.0:1773851860.766371:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000080eb462c.
00000100:00000001:6.0:1773851860.766372:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:5.0:1773851860.766372:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009ae7d441.
00000100:00000001:6.0:1773851860.766373:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851860.766374:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000043ee51de nid 23587@kfi7 refs 2
00000020:00000040:5.0:1773851860.766374:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000005be9343e : new refcount 5
00000100:00000001:5.0:1773851860.766374:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851860.766375:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 23587@kfi7(00000000bee3b9f8):0x0 lsk 2020 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007e3 Transaction freed
00000800:00000200:5.0:1773851860.773426:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.773427:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851860.773428:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851860.773430:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851860.773433:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25315@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.773434:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25315@kfi7 : PUT - for me
00000400:00000200:5.0:1773851860.773435:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25315@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.773436:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbc79423 nid 25315@kfi7 refs 1
00000400:00000200:5.0:1773851860.773437:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25315@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.773437:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbc79423 nid 25315@kfi7 refs 2
00000400:00000200:5.0:1773851860.773438:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bbc79423 nid 25315@kfi7 refs 3
00000400:00000200:5.0:1773851860.773439:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25314@kfi7 to cpt 6
00000400:00000200:5.0:1773851860.773440:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25314@kfi7 of length 224 into portal 12 MB=0x699e0f855ad40
00000400:00000200:5.0:1773851860.773442:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25314@kfi7 of length 224/224 into md 0x793926dc5 [64] + 128728
00000800:00000200:5.0:1773851860.773443:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851860.773445:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851860.773447:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25315@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.773448:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851860.773448:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851860.773449:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a2b0f15c.
00000100:00000040:5.0:1773851860.773450:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a2b0f15c x1858041378352448 msgsize 224
00000100:00100000:5.0:1773851860.773451:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25314@kfi7 (source: 12345-25315@kfi7)
00000100:00000001:5.0:1773851860.773452:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851860.773453:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bbc79423 nid 25315@kfi7 refs 2
00000800:00000200:5.0:1773851860.773455:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851860.773458:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851860.773459:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851860.773459:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851860.773460:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851860.773461:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851860.773461:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041378352448
00000020:00000001:5.0:1773851860.773462:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851860.773462:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ab1
00000020:00000001:5.0:1773851860.773463:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851860.773465:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004a70b320 refcount=6
00000020:00000001:5.0:1773851860.773466:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627761152 : -107123081790464 : ffff9e9276c33c00)
00000020:00000001:5.0:1773851860.773467:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627761152 : -107123081790464 : ffff9e9276c33c00)
00000100:00000001:5.0:1773851860.773468:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851860.773469:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851860.773469:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851860.773470:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851860.773471:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002ba4d5c1.
00000100:00000001:5.0:1773851860.773472:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851860.773473:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851860.773474:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.773475:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851860.773475:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851860.773476:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851860.773477:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851860.773477:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851860.773478:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851860.773478:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851860.773479:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851860.773479:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25314@kfi7, seq: 2001888
00000100:00000001:7.0:1773851860.773480:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851860.773480:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851860.773480:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004a70b320 : new rpc_count 1
00000100:00000001:5.0:1773851860.773480:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866956032 : -107088842595584 : ffff9e9a6f93e300)
00000100:00000040:5.0:1773851860.773481:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a2b0f15c x1858041378352448/t0(0) o400->2171d5c1-3db9-4692-886d-68dafc81986c@25314@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2059-0'
00000100:00000001:5.0:1773851860.773485:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851860.773485:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851860.773486:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2b0f15c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:2171d5c1-3db9-4692-886d-68dafc81986c+6:39838:x1858041378352448:12345-25314@kfi7:400:default-tuolumne2059-0
00000100:00000200:5.0:1773851860.773488:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041378352448
00000020:00000001:5.0:1773851860.773489:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851860.773489:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851860.773490:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.773491:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851860.773491:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851860.773492:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851860.773492:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041378352448, found 0 last_xid 1858041378352447
00000020:00000001:5.0:1773851860.773493:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851860.773493:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851860.773494:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851860.773494:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.773495:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851860.773495:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851860.773496:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851860.773496:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b6084197.
02000000:00000001:5.0:1773851860.773497:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851860.773498:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.773498:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851860.773499:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014474849, transno 0, xid 1858041378352448
00010000:00000001:5.0:1773851860.773499:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851860.773500:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a2b0f15c x1858041378352448/t0(0) o400->2171d5c1-3db9-4692-886d-68dafc81986c@25314@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2059-0'
00010000:00000001:5.0:1773851860.773502:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851860.773503:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851860.773503:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=92 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851860.773504:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851860.773505:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ef1ff235 refcount 3 to 25314@kfi7
00000100:00000001:5.0:1773851860.773505:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329856 : -107155410221760 : ffff9e8aefd68540)
02000000:00000001:5.0:1773851860.773506:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851860.773506:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851860.773510:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851860.773511:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25315@kfi7
00000400:00000010:5.0:1773851860.773511:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008cc726fa.
00000100:00000200:5.0:1773851860.773512:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041378352448, offset 224
00000400:00000200:5.0:1773851860.773513:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25315@kfi7
00000400:00000200:5.0:1773851860.773514:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25315@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.773515:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbc79423 nid 25315@kfi7 refs 1
00000400:00000200:5.0:1773851860.773516:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bbc79423 nid 25315@kfi7 refs 2
00000400:00000200:5.0:1773851860.773517:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bbc79423 nid 25315@kfi7 refs 3
00000400:00000200:5.0:1773851860.773517:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25315@kfi7 local destination
00000400:00000200:5.0:1773851860.773519:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768931:8768931:1024:4294967295] 25315@kfi7 LPNI seq info [862790:862790:16:4294967295]
00000400:00000200:5.0:1773851860.773520:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bbc79423 nid 25315@kfi7 refs 2
00000400:00000200:5.0:1773851860.773521:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25315@kfi7 to cpt 1
00000400:00000200:5.0:1773851860.773522:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25315@kfi7(25315@kfi7:25315@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851860.773523:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bbc79423 nid 25315@kfi7 refs 3
00000800:00000200:5.0:1773851860.773524:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851860.773525:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851860.773527:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851860.773529:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x42d Using peer 25315@kfi7(0x42d)
00000800:00000200:5.0:1773851860.773532:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 324 bytes to peer 0x42d: rc=0
00000800:00000200:5.0:1773851860.773533:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x42d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851860.773535:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851860.773536:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ef1ff235 refcount 2 to 25314@kfi7
00010000:00000001:5.0:1773851860.773536:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851860.773537:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851860.773537:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851860.773538:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a2b0f15c x1858041378352448/t0(0) o400->2171d5c1-3db9-4692-886d-68dafc81986c@25314@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2059-0'
00000100:00100000:5.0:1773851860.773541:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2b0f15c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:2171d5c1-3db9-4692-886d-68dafc81986c+6:39838:x1858041378352448:12345-25314@kfi7:400:default-tuolumne2059-0 Request processed in 56us (91us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851860.773543:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25314@kfi7, seq: 2001888
00000100:00000040:5.0:1773851860.773544:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004a70b320 : new rpc_count 0
00000800:00000200:6.0:1773851860.773545:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x42d TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851860.773545:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851860.773545:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851860.773545:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851860.773546:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002ba4d5c1.
00000400:00000200:6.0:1773851860.773547:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851860.773547:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:5.0:1773851860.773547:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004a70b320 : new refcount 5
00000400:00000200:6.0:1773851860.773548:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25315@kfi7: PUT: OK
00000100:00000001:5.0:1773851860.773548:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851860.773549:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008cc726fa
00000400:00000010:6.0:1773851860.773549:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008cc726fa.
00000100:00000001:6.0:1773851860.773550:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851860.773550:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851860.773551:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bbc79423 nid 25315@kfi7 refs 2
00000800:00000200:6.0:1773851860.773553:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 25315@kfi7(0000000070b63ca2):0x0 lsk 1070 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x42d Transaction freed
00000004:00000001:11.0:1773851860.809734:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851860.809735:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851860.809736:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000432d25da.
00000020:00000040:11.0:1773851860.809738:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851860.809740:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851860.809741:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851860.809742:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851860.809744:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000cadaf1a7.
00000100:00000001:11.0:1773851860.809746:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.809748:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851860.809750:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.809752:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000432d25da] to pc [ptlrpcd_02_01+1]  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851860.809761:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851860.809762:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:11.0:1773851860.809763:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006e24c5d2.
00000100:00000001:10.0:1773851860.809763:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851860.809763:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851860.809764:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.809764:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:11.0:1773851860.809765:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637125672256512 : -106948037295104 : ffff9ebb383a4400)
00000100:00000040:9.0:1773851860.809765:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851860.809767:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:11.0:1773851860.809770:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851860.809771:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000100:00000001:9.0:1773851860.809771:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851860.809772:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:11.0:1773851860.809773:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000e71dcc48.
00000004:00080000:11.0:1773851860.809774:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614135263049569ns, next at 614136263047635ns, rc = 0
02000000:00000001:9.0:1773851860.809774:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851860.809775:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851860.809776:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:9.0:1773851860.809776:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000432d25da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051925696:2075@kfi7:13:default-yuba2-0
00080000:00000001:11.0:1773851860.809778:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851860.809779:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.809779:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851860.809780:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851860.809781:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851860.809782:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851860.809784:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d9f9a1c1.
02000000:00000001:9.0:1773851860.809785:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851860.809787:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:9.0:1773851860.809788:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000010:9.0:1773851860.809790:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000200:9.0:1773851860.809792:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925696, portal 4
00000100:00000001:9.0:1773851860.809793:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851860.809794:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889205760 : -106993820345856 : ffff9eb08f585a00)
00000100:00000040:9.0:1773851860.809797:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851860.809802:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851860.809803:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:9.0:1773851860.809804:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003289b6e6.
00000100:00000200:9.0:1773851860.809805:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925696, offset 0
00000400:00000200:9.0:1773851860.809807:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:9.0:1773851860.809809:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.809810:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851860.809812:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851860.809813:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851860.809814:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:9.0:1773851860.809816:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768931, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768930, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851860.809819:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851860.809819:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851860.809820:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:9.0:1773851860.809822:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768932:8768932:1024:4294967295] 2075@kfi7 LPNI seq info [5403909:5403909:16:4294967295]
00000400:00000200:9.0:1773851860.809823:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851860.809824:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.809826:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851860.809828:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:9.0:1773851860.809830:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.809831:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851860.809834:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851860.809837:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Using peer 2075@kfi7(0x2000000000004de)
00000800:00000200:9.0:1773851860.809840:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x2000000000004de: rc=0
00000800:00000200:9.0:1773851860.809842:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851860.809846:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.809847:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851860.809848:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.809849:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.809850:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851860.809851:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851860.809852:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851860.809852:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851860.809853:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851860.809853:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851860.809854:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851860.809854:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851860.809856:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851860.809857:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000400:00000200:10.0:1773851860.809858:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003289b6e6
00000400:00000010:10.0:1773851860.809859:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003289b6e6.
00000100:00000001:10.0:1773851860.809860:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851860.809861:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851860.809863:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851860.809864:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851860.809867:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851860.809867:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851860.809868:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:10.0:1773851860.809870:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Transaction freed
00000800:00000200:9.0:1773851860.809898:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.809899:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.809901:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.809903:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.809905:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.809906:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.809907:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.809908:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851860.809909:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.809910:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851860.809911:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851860.809912:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.809913:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2cc0
00000400:00000200:9.0:1773851860.809914:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.809915:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781697329 [1] + 224
00000800:00000200:9.0:1773851860.809918:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.809919:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.809920:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.809922:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851860.809923:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851860.809925:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851860.809929:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.809929:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851860.809931:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851860.809933:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851860.809933:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:9.0:1773851860.809934:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851860.809934:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851860.809935:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000400:00000200:9.0:1773851860.809936:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000400:00000010:9.0:1773851860.809936:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000100:00000001:9.0:1773851860.809937:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851860.809937:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851860.809940:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851860.809942:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851860.809943:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851860.809943:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851860.809944:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851860.809944:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851860.809945:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851860.809946:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851860.809947:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=93 v=66 (66 66 66 66)
00000100:00001000:9.0:1773851860.809948:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=93 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851860.809949:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851860.809949:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851860.809950:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851860.809950:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.809952:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851860.809952:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:9.0:1773851860.809953:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851860.809953:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851860.809954:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851860.809956:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851860.809957:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851860.809958:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851860.809958:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851860.809959:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851860.809960:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470736384 avail=351461714944 avail_mb=1372897324 hwm_mb=3131103 files=372064608 ffree=343233141 state=0: rc = 0
00000004:00000020:9.0:1773851860.809962:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470736384 free, 351461714944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064608 files, 343233141 free files
00000004:00000001:9.0:1773851860.809963:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851860.809964:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851860.809967:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000432d25da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051925696:2075@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851860.809968:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851860.809969:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851860.809970:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000432d25da x1859433051925696/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852013 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851860.809972:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851860.809973:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851860.809974:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d9f9a1c1.
02000000:00000001:9.0:1773851860.809974:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851860.809975:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851860.809975:0:41069:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:9.0:1773851860.809976:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851860.809976:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000cadaf1a7.
02000000:00000001:9.0:1773851860.809977:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851860.809978:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851860.809979:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000432d25da.
00000100:00000001:9.0:1773851860.809979:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851860.809979:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851860.809980:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851860.809981:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851860.809981:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851860.809982:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851860.809982:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851860.821604:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.821605:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.821606:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.821608:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.821610:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9042@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.821612:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9042@kfi7 : PUT - for me
00000400:00000200:17.0:1773851860.821612:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9042@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.821613:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a81bc50d nid 9042@kfi7 refs 1
00000400:00000200:17.0:1773851860.821614:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9042@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.821615:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a81bc50d nid 9042@kfi7 refs 2
00000400:00000200:17.0:1773851860.821615:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a81bc50d nid 9042@kfi7 refs 3
00000400:00000200:17.0:1773851860.821616:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9042@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.821617:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9042@kfi7 of length 224 into portal 12 MB=0x699e14e22d5c0
00000400:00000200:17.0:1773851860.821618:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9042@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 1344
00000800:00000200:17.0:1773851860.821620:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.821621:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.821622:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9042@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.821623:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.821623:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.821624:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bb03ac3e.
00000100:00000040:17.0:1773851860.821624:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bb03ac3e x1858042817861056 msgsize 224
00000100:00100000:17.0:1773851860.821626:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9042@kfi7 (source: 12345-9042@kfi7)
00000100:00000001:17.0:1773851860.821627:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.821627:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a81bc50d nid 9042@kfi7 refs 2
00000100:00000001:18.0:1773851860.821628:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851860.821628:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851860.821629:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851860.821629:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851860.821629:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851860.821630:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851860.821631:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042817861056
00000020:00000001:18.0:1773851860.821632:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851860.821632:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92825
00000020:00000001:18.0:1773851860.821632:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.821634:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000059713db3 refcount=170
00000020:00000001:18.0:1773851860.821635:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631498752 : -107123078052864 : ffff9e9276fc4400)
00000020:00000001:18.0:1773851860.821635:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631498752 : -107123078052864 : ffff9e9276fc4400)
00000100:00000001:18.0:1773851860.821636:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.821637:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851860.821637:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007d2c34f1.
00000020:00000010:18.0:1773851860.821638:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.821639:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004b65e428.
00000100:00000001:18.0:1773851860.821640:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851860.821640:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851860.821641:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.821642:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851860.821642:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851860.821643:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.821644:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851860.821645:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.821645:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851860.821645:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851860.821645:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.821646:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9042@kfi7, seq: 2156288
00000100:00000001:19.0:1773851860.821647:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.821647:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000059713db3 : new rpc_count 1
00000100:00000001:19.0:1773851860.821648:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.821648:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764352896 : -107095945198720 : ffff9e98c83ac380)
00000100:00000040:18.0:1773851860.821649:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bb03ac3e x1858042817861056/t0(0) o400->a21723b1-34e7-4d82-8dc4-233ebdaeb496@9042@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1062-0'
00000100:00000001:18.0:1773851860.821652:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.821652:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.821653:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb03ac3e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:a21723b1-34e7-4d82-8dc4-233ebdaeb496+170:39656:x1858042817861056:12345-9042@kfi7:400:default-tuolumne1062-0
00000100:00000200:18.0:1773851860.821654:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042817861056
00000020:00000001:18.0:1773851860.821654:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851860.821655:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851860.821656:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.821656:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851860.821657:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851860.821657:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851860.821658:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042817861056, found 0 last_xid 1858042817442943
00000020:00000001:18.0:1773851860.821659:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851860.821659:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851860.821660:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851860.821660:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.821661:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851860.821662:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.821662:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.821663:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ddcf4a2a.
02000000:00000001:18.0:1773851860.821663:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.821664:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.821665:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851860.821665:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061971, transno 0, xid 1858042817861056
00010000:00000001:18.0:1773851860.821666:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851860.821667:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bb03ac3e x1858042817861056/t0(0) o400->a21723b1-34e7-4d82-8dc4-233ebdaeb496@9042@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1062-0'
00010000:00000001:18.0:1773851860.821669:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.821669:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.821670:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=315 (315 214 1 1)
00000100:00000001:18.0:1773851860.821671:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.821672:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005b283093 refcount 3 to 9042@kfi7
00000100:00000001:18.0:1773851860.821672:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095777376 : -107152613774240 : ffff9e8b9684ec60)
02000000:00000001:18.0:1773851860.821674:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.821674:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.821675:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.821676:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9042@kfi7
00000400:00000010:18.0:1773851860.821677:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000008a44a3.
00000100:00000200:18.0:1773851860.821677:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042817861056, offset 224
00000400:00000200:18.0:1773851860.821678:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9042@kfi7
00000400:00000200:18.0:1773851860.821679:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9042@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.821680:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a81bc50d nid 9042@kfi7 refs 1
00000400:00000200:18.0:1773851860.821681:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a81bc50d nid 9042@kfi7 refs 2
00000400:00000200:18.0:1773851860.821682:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a81bc50d nid 9042@kfi7 refs 3
00000400:00000200:18.0:1773851860.821683:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9042@kfi7 local destination
00000400:00000200:18.0:1773851860.821684:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768933:8768933:1024:4294967295] 9042@kfi7 LPNI seq info [4122726:4122726:16:4294967295]
00000400:00000200:18.0:1773851860.821686:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a81bc50d nid 9042@kfi7 refs 2
00000400:00000200:18.0:1773851860.821686:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9042@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.821688:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9042@kfi7(9042@kfi7:9042@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.821689:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a81bc50d nid 9042@kfi7 refs 3
00000800:00000200:18.0:1773851860.821690:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.821691:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.821693:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.821696:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000002f6 Using peer 9042@kfi7(0x1000000000002f6)
00000800:00000200:18.0:1773851860.821699:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000079f17c9e: Posted send of 324 bytes to peer 0x1000000000002f6: rc=0
00000800:00000200:18.0:1773851860.821700:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000002f6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.821702:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.821703:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005b283093 refcount 2 to 9042@kfi7
00010000:00000001:18.0:1773851860.821703:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851860.821705:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.821705:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851860.821706:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bb03ac3e x1858042817861056/t0(0) o400->a21723b1-34e7-4d82-8dc4-233ebdaeb496@9042@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1062-0'
00000100:00100000:18.0:1773851860.821708:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb03ac3e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:a21723b1-34e7-4d82-8dc4-233ebdaeb496+170:39656:x1858042817861056:12345-9042@kfi7:400:default-tuolumne1062-0 Request processed in 56us (83us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851860.821711:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9042@kfi7, seq: 2156288
00000800:00000200:17.0:1773851860.821711:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000002f6 TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851860.821712:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000059713db3 : new rpc_count 0
00000100:00000001:18.0:1773851860.821712:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851860.821713:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851860.821713:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851860.821713:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.821713:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9042@kfi7: PUT: OK
00000020:00000010:18.0:1773851860.821714:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004b65e428.
00000400:00000200:17.0:1773851860.821714:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000008a44a3
00000400:00000010:17.0:1773851860.821714:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000008a44a3.
00000020:00000010:18.0:1773851860.821715:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007d2c34f1.
00000100:00000001:17.0:1773851860.821715:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.821715:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:18.0:1773851860.821716:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000059713db3 : new refcount 169
00000100:00000001:18.0:1773851860.821716:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851860.821716:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a81bc50d nid 9042@kfi7 refs 2
00000800:00000200:17.0:1773851860.821717:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000079f17c9e: 2054@kfi7:4 -> 9042@kfi7(00000000877aeacb):0x0 lsk 759 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000002f6 Transaction freed
00000400:00000200:29.0:1773851860.873735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851860.873738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:9.0:1773851860.886988:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.886989:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.886990:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.886992:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.886994:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.886995:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.155@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851860.886996:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.886997:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851860.886998:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.155@o2ib600 to cpt 4
00000400:00000200:9.0:1773851860.887000:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012362e2b nid 172.19.3.155@o2ib600 refs 2
00000400:00000200:9.0:1773851860.887001:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000012362e2b nid 172.19.3.155@o2ib600 refs 3
00000400:00000200:9.0:1773851860.887002:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.155@o2ib600 to cpt 4
00000400:00000200:9.0:1773851860.887003:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.155@o2ib600 of length 224 into portal 12 MB=0x699fe7536cf40
00000400:00000200:9.0:1773851860.887006:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.155@o2ib600 of length 224/224 into md 0x6ab01b5d1 [64] + 1568
00000800:00000200:9.0:1773851860.887008:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.887010:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.887011:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.887012:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.887012:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.887013:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000046bfce82.
00000100:00000040:9.0:1773851860.887014:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000046bfce82 x1858168027533120 msgsize 224
00000100:00100000:9.0:1773851860.887016:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.155@o2ib600 (source: 12345-172.19.3.155@o2ib600)
00000100:00000001:9.0:1773851860.887018:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.887019:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:18.0:1773851860.887021:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851860.887021:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:18.0:1773851860.887022:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851860.887022:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851860.887023:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.887024:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851860.887024:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858168027533120
00000020:00000001:18.0:1773851860.887025:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851860.887025:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e9b
00000020:00000001:18.0:1773851860.887025:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.887026:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b680dd97 refcount=6
00000020:00000001:18.0:1773851860.887027:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239654400 : -107152469897216 : ffff9e8b9f185000)
00000020:00000001:18.0:1773851860.887027:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239654400 : -107152469897216 : ffff9e8b9f185000)
00000100:00000001:18.0:1773851860.887028:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.887029:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851860.887029:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007d2c34f1.
00000020:00000010:18.0:1773851860.887030:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.887030:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004b65e428.
00000100:00000001:18.0:1773851860.887031:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851860.887032:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851860.887032:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.887033:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851860.887033:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851860.887034:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.887035:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.887035:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851860.887036:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851860.887037:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.887037:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.887037:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.155@o2ib600, seq: 2156289
00000100:00000001:19.0:1773851860.887038:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851860.887038:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.887038:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b680dd97 : new rpc_count 1
00000100:00000001:18.0:1773851860.887038:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922888960 : -107141786662656 : ffff9e8e1bdd8900)
00000100:00000040:18.0:1773851860.887040:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000046bfce82 x1858168027533120/t0(0) o400->6e4db45d-0302-4cb6-bf8f-049edd6669c8@172.19.3.155@o2ib600:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic5-0'
00000100:00000001:18.0:1773851860.887043:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.887043:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.887044:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046bfce82 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:6e4db45d-0302-4cb6-bf8f-049edd6669c8+6:26676:x1858168027533120:12345-172.19.3.155@o2ib600:400:login-oslic5-0
00000100:00000200:18.0:1773851860.887045:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858168027533120
00000020:00000001:18.0:1773851860.887046:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851860.887046:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851860.887047:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.887047:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851860.887047:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851860.887048:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851860.887048:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858168027533120, found 0 last_xid 1858168027533119
00000020:00000001:18.0:1773851860.887049:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851860.887050:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851860.887050:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851860.887050:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.887051:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851860.887052:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.887052:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.887053:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000386de793.
02000000:00000001:18.0:1773851860.887053:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.887054:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.887055:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851860.887055:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182977613255, transno 0, xid 1858168027533120
00010000:00000001:18.0:1773851860.887056:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851860.887057:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000046bfce82 x1858168027533120/t0(0) o400->6e4db45d-0302-4cb6-bf8f-049edd6669c8@172.19.3.155@o2ib600:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic5-0'
00010000:00000001:18.0:1773851860.887059:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.887060:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.887060:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=315 (315 214 1 1)
00000100:00000001:18.0:1773851860.887061:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.887062:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ca7b9e4b refcount 3 to 172.19.3.155@o2ib600
00000100:00000001:18.0:1773851860.887063:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583545280 : -107156126006336 : ffff9e8ac52c83c0)
02000000:00000001:18.0:1773851860.887063:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.887064:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.887064:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.887065:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.155@o2ib600
00000400:00000010:18.0:1773851860.887065:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3e93273.
00000100:00000200:18.0:1773851860.887066:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858168027533120, offset 224
00000400:00000200:18.0:1773851860.887068:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.155@o2ib600
00000400:00000200:18.0:1773851860.887069:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.155@o2ib600 to cpt 4
00000400:00000200:18.0:1773851860.887070:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012362e2b nid 172.19.3.155@o2ib600 refs 2
00000400:00000200:18.0:1773851860.887071:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000012362e2b nid 172.19.3.155@o2ib600 refs 3
00000400:00000200:18.0:1773851860.887072:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000012362e2b nid 172.19.3.155@o2ib600 refs 4
00000400:00000200:18.0:1773851860.887074:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.155@o2ib600 routed destination
00000400:00000200:18.0:1773851860.887075:0:61039:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:18.0:1773851860.887076:0:61039:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:18.0:1773851860.887077:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.155@o2ib600: rtr pref emtpy: 1
00000400:00000200:18.0:1773851860.887079:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:18.0:1773851860.887080:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.155@o2ib600: rtr pref emtpy: 1
00000400:00000200:18.0:1773851860.887080:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:18.0:1773851860.887082:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768934:8768934:1024:4294967295] 17@kfi7 LPNI seq info [1250891886:1250891886:16:4294967295]
00000400:00000200:18.0:1773851860.887083:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:18.0:1773851860.887085:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:18.0:1773851860.887087:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.155@o2ib600(172.19.3.155@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.887089:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000012362e2b nid 172.19.3.155@o2ib600 refs 3
00000800:00000200:18.0:1773851860.887090:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.887091:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.887093:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.887095:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:18.0:1773851860.887097:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000022b02854: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:18.0:1773851860.887099:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.887100:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.887101:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ca7b9e4b refcount 2 to 172.19.3.155@o2ib600
00010000:00000001:18.0:1773851860.887102:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851860.887102:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.887103:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851860.887103:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000046bfce82 x1858168027533120/t0(0) o400->6e4db45d-0302-4cb6-bf8f-049edd6669c8@172.19.3.155@o2ib600:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic5-0'
00000100:00100000:18.0:1773851860.887106:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046bfce82 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:6e4db45d-0302-4cb6-bf8f-049edd6669c8+6:26676:x1858168027533120:12345-172.19.3.155@o2ib600:400:login-oslic5-0 Request processed in 63us (91us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851860.887108:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.155@o2ib600, seq: 2156289
00000100:00000040:18.0:1773851860.887109:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b680dd97 : new rpc_count 0
00000100:00000001:18.0:1773851860.887110:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851860.887110:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851860.887110:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.887111:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004b65e428.
00000800:00000200:17.0:1773851860.887111:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000020:00000010:18.0:1773851860.887112:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007d2c34f1.
00000020:00000040:18.0:1773851860.887112:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b680dd97 : new refcount 5
00000400:00000200:17.0:1773851860.887113:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.887113:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:17.0:1773851860.887114:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3e93273
00000400:00000010:17.0:1773851860.887114:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3e93273.
00000100:00000001:18.0:1773851860.887115:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851860.887115:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.887115:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851860.887116:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:17.0:1773851860.887117:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022b02854: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a Transaction freed
00000800:00000200:21.0:1773851860.909779:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851860.909781:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851860.909783:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851860.909787:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851860.909791:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17025@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.909793:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17025@kfi7 : PUT - for me
00000400:00000200:21.0:1773851860.909795:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17025@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.909797:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8d7c74e nid 17025@kfi7 refs 1
00000400:00000200:21.0:1773851860.909798:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17025@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.909799:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8d7c74e nid 17025@kfi7 refs 2
00000400:00000200:21.0:1773851860.909801:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d8d7c74e nid 17025@kfi7 refs 3
00000400:00000200:21.0:1773851860.909803:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16961@kfi7 to cpt 2
00000400:00000200:21.0:1773851860.909804:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16961@kfi7 of length 224 into portal 12 MB=0x69b4b5c24d200
00000400:00000200:21.0:1773851860.909806:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16961@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 30344
00000800:00000200:21.0:1773851860.909809:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851860.909811:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851860.909813:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17025@kfi7: PUT: OK
00000100:00000001:21.0:1773851860.909814:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851860.909815:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851860.909816:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a9087110.
00000100:00000040:21.0:1773851860.909817:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000a9087110 x1859597831033344 msgsize 224
00000100:00100000:21.0:1773851860.909819:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16961@kfi7 (source: 12345-17025@kfi7)
00000100:00000001:21.0:1773851860.909821:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851860.909822:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d8d7c74e nid 17025@kfi7 refs 2
00000100:00000001:23.0:1773851860.909823:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851860.909824:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851860.909824:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851860.909825:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851860.909826:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851860.909827:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851860.909828:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597831033344
00000020:00000001:23.0:1773851860.909830:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851860.909831:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8193f
00000020:00000001:23.0:1773851860.909832:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851860.909835:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000293d02d1 refcount=172
00000020:00000001:23.0:1773851860.909836:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117420150784 : -106956289400832 : ffff9eb94c5d2000)
00000020:00000001:23.0:1773851860.909838:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117420150784 : -106956289400832 : ffff9eb94c5d2000)
00000100:00000001:23.0:1773851860.909839:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.909841:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851860.909842:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000345a0e64.
00000020:00000010:23.0:1773851860.909843:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.909844:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851860.909845:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851860.909846:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851860.909847:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.909848:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851860.909849:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851860.909850:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.909851:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.909853:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851860.909854:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851860.909854:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851860.909854:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851860.909856:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16961@kfi7, seq: 1997951
00000100:00000040:23.0:1773851860.909857:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000293d02d1 : new rpc_count 1
00000100:00000001:22.0:1773851860.909857:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.909858:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637148525828864 : -106925183722752 : ffff9ec08a681b00)
00000100:00000001:22.0:1773851860.909858:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.909860:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a9087110 x1859597831033344/t0(0) o400->1dfafdc3-f3bc-47ac-99ea-8b6d9ed2d7d2@16961@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1556-0'
00000100:00000001:23.0:1773851860.909864:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.909865:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851860.909867:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9087110 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1dfafdc3-f3bc-47ac-99ea-8b6d9ed2d7d2+172:39554:x1859597831033344:12345-16961@kfi7:400:default-tuolumne1556-0
00000100:00000200:23.0:1773851860.909869:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597831033344
00000020:00000001:23.0:1773851860.909870:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851860.909871:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851860.909872:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.909873:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851860.909874:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851860.909875:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851860.909876:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597831033344, found 0 last_xid 1859597830607359
00000020:00000001:23.0:1773851860.909877:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851860.909878:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851860.909879:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851860.909880:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.909881:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851860.909882:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851860.909882:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851860.909884:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008c467637.
02000000:00000001:23.0:1773851860.909885:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.909886:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.909887:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851860.909888:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063450, transno 0, xid 1859597831033344
00010000:00000001:23.0:1773851860.909889:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851860.909890:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a9087110 x1859597831033344/t0(0) o400->1dfafdc3-f3bc-47ac-99ea-8b6d9ed2d7d2@16961@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1556-0'
00010000:00000001:23.0:1773851860.909894:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851860.909895:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851860.909896:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=93 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851860.909898:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851860.909899:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000009a40f44 refcount 3 to 16961@kfi7
00000100:00000001:23.0:1773851860.909900:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274739968 : -107155434811648 : ffff9e8aee5f4f00)
02000000:00000001:23.0:1773851860.909902:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851860.909902:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.909903:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851860.909905:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17025@kfi7
00000400:00000010:23.0:1773851860.909906:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d909465f.
00000100:00000200:23.0:1773851860.909907:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597831033344, offset 224
00000400:00000200:23.0:1773851860.909909:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17025@kfi7
00000400:00000200:23.0:1773851860.909910:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17025@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.909912:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8d7c74e nid 17025@kfi7 refs 1
00000400:00000200:23.0:1773851860.909913:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d8d7c74e nid 17025@kfi7 refs 2
00000400:00000200:23.0:1773851860.909915:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d8d7c74e nid 17025@kfi7 refs 3
00000400:00000200:23.0:1773851860.909917:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17025@kfi7 local destination
00000400:00000200:23.0:1773851860.909919:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768935:8768935:1024:4294967295] 17025@kfi7 LPNI seq info [215760:215760:16:4294967295]
00000400:00000200:23.0:1773851860.909922:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d8d7c74e nid 17025@kfi7 refs 2
00000400:00000200:23.0:1773851860.909923:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17025@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.909926:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17025@kfi7(17025@kfi7:17025@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851860.909928:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d8d7c74e nid 17025@kfi7 refs 3
00000800:00000200:23.0:1773851860.909930:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851860.909932:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851860.909935:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851860.909939:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x472 Using peer 17025@kfi7(0x472)
00000800:00000200:23.0:1773851860.909944:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x472: rc=0
00000800:00000200:23.0:1773851860.909946:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x472 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851860.909949:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.909950:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000009a40f44 refcount 2 to 16961@kfi7
00010000:00000001:23.0:1773851860.909951:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851860.909952:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.909953:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851860.909954:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a9087110 x1859597831033344/t0(0) o400->1dfafdc3-f3bc-47ac-99ea-8b6d9ed2d7d2@16961@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1556-0'
00000100:00100000:23.0:1773851860.909959:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9087110 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1dfafdc3-f3bc-47ac-99ea-8b6d9ed2d7d2+172:39554:x1859597831033344:12345-16961@kfi7:400:default-tuolumne1556-0 Request processed in 94us (141us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851860.909961:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x472 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851860.909963:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16961@kfi7, seq: 1997951
00000100:00000040:23.0:1773851860.909964:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000293d02d1 : new rpc_count 0
00000400:00000200:21.0:1773851860.909964:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851860.909965:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851860.909965:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17025@kfi7: PUT: OK
00000400:00000200:21.0:1773851860.909966:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d909465f
00000400:00000010:21.0:1773851860.909967:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d909465f.
00000100:00000001:21.0:1773851860.909968:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851860.909969:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851860.909971:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d8d7c74e nid 17025@kfi7 refs 2
00000800:00000200:21.0:1773851860.909973:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 17025@kfi7(00000000e22c08e4):0x0 lsk 1139 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x472 Transaction freed
00000100:00000001:23.0:1773851860.909978:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851860.909979:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.909980:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851860.909982:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000345a0e64.
00000020:00000040:23.0:1773851860.909983:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000293d02d1 : new refcount 171
00000100:00000001:23.0:1773851860.909984:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851860.918700:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851860.918700:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851860.918701:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851860.918701:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:31.0:1773851860.918702:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851860.918704:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:31.0:1773851860.918705:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851860.918707:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22018@kfi7 to cpt 7
00000800:00000200:29.0:1773851860.918707:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22018@kfi7(00000000c212bda6):0x1df version: 2; local version 2; negotiated version: 2
00000400:00000200:31.0:1773851860.918709:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22018@kfi7 : PUT - for me
00000400:00000200:31.0:1773851860.918710:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22018@kfi7 to cpt 7
00000800:00000200:29.0:1773851860.918710:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df Using peer 22018@kfi7(0x1000000000001df)
00000400:00000200:31.0:1773851860.918711:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009150614a nid 22018@kfi7 refs 1
00000400:00000200:31.0:1773851860.918713:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22018@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.918713:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009150614a nid 22018@kfi7 refs 2
00000400:00000200:31.0:1773851860.918714:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009150614a nid 22018@kfi7 refs 3
00000400:00000200:29.0:1773851860.918715:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22018@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.918716:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22018@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.918718:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22018@kfi7 of length 224 into portal 12 MB=0x699e133b7cf00
00000400:00000200:31.0:1773851860.918719:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22018@kfi7 of length 224/224 into md 0x77fe139dd [64] + 168512
00000800:00000200:29.0:1773851860.918719:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 38 bytes to peer 0x1000000000001df: rc=0
00000800:00000200:31.0:1773851860.918722:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851860.918722:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851860.918728:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851860.918729:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22018@kfi7: PUT: OK
00000100:00000001:31.0:1773851860.918731:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851860.918731:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851860.918732:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c01b7c03.
00000100:00000040:31.0:1773851860.918733:0:2465875:0:(events.c:358:request_in_callback()) incoming req@00000000c01b7c03 x1858042374639360 msgsize 224
00000100:00100000:31.0:1773851860.918735:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-22018@kfi7 (source: 12345-22018@kfi7)
00000100:00000001:31.0:1773851860.918736:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:29.0:1773851860.918736:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851860.918738:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009150614a nid 22018@kfi7 refs 2
00000800:00000200:31.0:1773851860.918740:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:29.0:1773851860.918741:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df Transaction freed
00000100:00000001:31.0:1773851860.918743:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851860.918744:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851860.918744:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851860.918745:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851860.918746:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851860.918747:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042374639360
00000020:00000001:31.0:1773851860.918747:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851860.918748:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91fea
00000020:00000001:31.0:1773851860.918749:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851860.918751:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000052d4dab9 refcount=2044
00000020:00000001:31.0:1773851860.918752:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629283840 : -107123080267776 : ffff9e9276da7800)
00000020:00000001:31.0:1773851860.918753:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629283840 : -107123080267776 : ffff9e9276da7800)
00000100:00000001:31.0:1773851860.918754:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851860.918755:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851860.918756:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000546cd5ce.
00000020:00000010:31.0:1773851860.918757:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851860.918758:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851860.918759:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851860.918759:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851860.918760:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851860.918761:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851860.918762:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851860.918762:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.918764:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851860.918765:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851860.918766:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851860.918766:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851860.918767:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22018@kfi7, seq: 2055490
00000100:00000001:28.0:1773851860.918767:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851860.918768:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000052d4dab9 : new rpc_count 13
00000100:00000001:28.0:1773851860.918768:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.918769:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159395564288 : -106914313987328 : ffff9ec3124b1b00)
00000100:00000001:28.0:1773851860.918769:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851860.918770:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c01b7c03 x1858042374639360/t0(0) o400->0a4675d8-f1ca-49b3-9755-206acd16ceb9@22018@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1879-0'
00000100:00000001:31.0:1773851860.918773:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851860.918773:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851860.918774:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c01b7c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0a4675d8-f1ca-49b3-9755-206acd16ceb9+2044:39707:x1858042374639360:12345-22018@kfi7:400:default-tuolumne1879-0
00000100:00000200:31.0:1773851860.918776:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042374639360
00000020:00000001:31.0:1773851860.918777:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851860.918777:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851860.918778:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.918779:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851860.918779:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851860.918780:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851860.918781:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042374639360, found 0 last_xid 1858042373875647
00000020:00000001:31.0:1773851860.918782:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851860.918782:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851860.918783:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851860.918784:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.918784:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851860.918785:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851860.918785:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851860.918788:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a041213d.
02000000:00000001:31.0:1773851860.918789:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.918789:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.918790:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851860.918791:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592919, transno 0, xid 1858042374639360
00010000:00000001:31.0:1773851860.918792:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851860.918793:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c01b7c03 x1858042374639360/t0(0) o400->0a4675d8-f1ca-49b3-9755-206acd16ceb9@22018@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1879-0'
00010000:00000001:31.0:1773851860.918795:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851860.918796:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851860.918797:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=93 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851860.918798:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851860.918799:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004822be1c refcount 3 to 22018@kfi7
00000100:00000001:31.0:1773851860.918799:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603210848 : -107155106340768 : ffff9e8b01f36060)
02000000:00000001:31.0:1773851860.918800:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851860.918801:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851860.918802:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851860.918802:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22018@kfi7
00000400:00000010:31.0:1773851860.918803:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000811703b3.
00000100:00000200:31.0:1773851860.918804:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042374639360, offset 224
00000400:00000200:31.0:1773851860.918806:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22018@kfi7
00000400:00000200:31.0:1773851860.918807:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22018@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.918807:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009150614a nid 22018@kfi7 refs 1
00000400:00000200:31.0:1773851860.918808:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009150614a nid 22018@kfi7 refs 2
00000400:00000200:31.0:1773851860.918810:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009150614a nid 22018@kfi7 refs 3
00000400:00000200:31.0:1773851860.918811:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22018@kfi7 local destination
00000400:00000200:31.0:1773851860.918813:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768936:8768936:1024:4294967295] 22018@kfi7 LPNI seq info [15571846:15571846:16:4294967295]
00000400:00000200:31.0:1773851860.918814:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009150614a nid 22018@kfi7 refs 2
00000400:00000200:31.0:1773851860.918815:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22018@kfi7 to cpt 7
00000400:00000200:31.0:1773851860.918817:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22018@kfi7(22018@kfi7:22018@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851860.918819:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009150614a nid 22018@kfi7 refs 3
00000800:00000200:31.0:1773851860.918820:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851860.918821:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851860.918823:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851860.918826:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df Using peer 22018@kfi7(0x1000000000001df)
00000800:00000200:31.0:1773851860.918829:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x1000000000001df: rc=0
00000800:00000200:31.0:1773851860.918830:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851860.918832:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851860.918833:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004822be1c refcount 2 to 22018@kfi7
00010000:00000001:31.0:1773851860.918834:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851860.918834:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851860.918835:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851860.918835:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c01b7c03 x1858042374639360/t0(0) o400->0a4675d8-f1ca-49b3-9755-206acd16ceb9@22018@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1879-0'
00000100:00100000:31.0:1773851860.918838:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c01b7c03 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0a4675d8-f1ca-49b3-9755-206acd16ceb9+2044:39707:x1858042374639360:12345-22018@kfi7:400:default-tuolumne1879-0 Request processed in 64us (104us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851860.918841:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22018@kfi7, seq: 2055490
00000100:00000040:31.0:1773851860.918841:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000052d4dab9 : new rpc_count 12
00000100:00000001:31.0:1773851860.918842:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851860.918842:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851860.918843:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851860.918843:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851860.918844:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000546cd5ce.
00000020:00000040:31.0:1773851860.918845:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000052d4dab9 : new refcount 2043
00000800:00000200:29.0:1773851860.918845:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851860.918846:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851860.918848:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851860.918850:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22018@kfi7: PUT: OK
00000400:00000200:29.0:1773851860.918851:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000811703b3
00000400:00000010:29.0:1773851860.918852:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000811703b3.
00000100:00000001:29.0:1773851860.918853:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851860.918854:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851860.918855:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009150614a nid 22018@kfi7 refs 2
00000800:00000200:29.0:1773851860.918858:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22018@kfi7(00000000c212bda6):0x0 lsk 480 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001df Transaction freed
00000800:00000200:9.0:1773851860.918874:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.918876:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.918878:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.918881:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.918884:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11746@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.918886:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11746@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.918888:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11746@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.918889:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a7f3644 nid 11746@kfi7 refs 1
00000400:00000200:9.0:1773851860.918891:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11746@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.918892:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a7f3644 nid 11746@kfi7 refs 2
00000400:00000200:9.0:1773851860.918893:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a7f3644 nid 11746@kfi7 refs 3
00000400:00000200:9.0:1773851860.918895:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11555@kfi7 to cpt 3
00000400:00000200:9.0:1773851860.918896:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11555@kfi7 of length 224 into portal 12 MB=0x69b47331ed6c0
00000400:00000200:9.0:1773851860.918899:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11555@kfi7 of length 224/224 into md 0x78146ce49 [64] + 128368
00000800:00000200:9.0:1773851860.918901:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.918904:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.918906:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11746@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.918907:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.918908:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.918909:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000085d06088.
00000100:00000040:9.0:1773851860.918910:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000085d06088 x1859579962906304 msgsize 224
00000100:00100000:9.0:1773851860.918912:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-11555@kfi7 (source: 12345-11746@kfi7)
00000100:00000001:9.0:1773851860.918914:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851860.918916:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a7f3644 nid 11746@kfi7 refs 2
00000100:00000001:11.0:1773851860.918917:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851860.918918:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851860.918918:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851860.918918:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851860.918919:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851860.918920:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851860.918922:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859579962906304
00000020:00000001:11.0:1773851860.918922:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851860.918923:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f8b59
00000020:00000001:11.0:1773851860.918924:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851860.918929:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000096c46351 refcount=5
00000020:00000001:11.0:1773851860.918930:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138569715712 : -106935139835904 : ffff9ebe38f9e000)
00000020:00000001:11.0:1773851860.918931:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138569715712 : -106935139835904 : ffff9ebe38f9e000)
00000100:00000001:11.0:1773851860.918933:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.918934:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851860.918935:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006c3ed247.
00000020:00000010:11.0:1773851860.918936:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.918938:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a4701f2.
00000100:00000001:11.0:1773851860.918939:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851860.918940:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851860.918941:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.918943:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851860.918943:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851860.918944:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.918945:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.918947:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.918948:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851860.918948:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851860.918949:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.918950:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11555@kfi7, seq: 2130753
00000100:00000040:11.0:1773851860.918952:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000096c46351 : new rpc_count 1
00000100:00000001:9.0:1773851860.918952:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.918953:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922901632 : -107141786649984 : ffff9e8e1bddba80)
00000100:00000001:9.0:1773851860.918953:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.918955:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000085d06088 x1859579962906304/t0(0) o400->18691581-bba0-40dc-8f73-1b55543daaf3@11555@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1211-0'
00000100:00000001:11.0:1773851860.918959:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.918960:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.918962:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085d06088 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:18691581-bba0-40dc-8f73-1b55543daaf3+5:39748:x1859579962906304:12345-11555@kfi7:400:default-tuolumne1211-0
00000100:00000200:11.0:1773851860.918964:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859579962906304
00000020:00000001:11.0:1773851860.918965:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.918966:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.918967:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.918968:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.918969:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.918970:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.918971:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859579962906304, found 0 last_xid 1859579962906303
00000020:00000001:11.0:1773851860.918972:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.918973:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.918974:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.918975:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.918976:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.918976:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.918977:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.918979:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000970754c5.
02000000:00000001:11.0:1773851860.918980:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.918981:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.918982:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.918983:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035366431, transno 0, xid 1859579962906304
00010000:00000001:11.0:1773851860.918984:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.918985:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000085d06088 x1859579962906304/t0(0) o400->18691581-bba0-40dc-8f73-1b55543daaf3@11555@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1211-0'
00010000:00000001:11.0:1773851860.918990:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.918991:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.918992:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.918994:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.918995:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000024351b46 refcount 3 to 11555@kfi7
00000100:00000001:11.0:1773851860.918996:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487619968 : -107151221931648 : ffff9e8be97ac180)
02000000:00000001:11.0:1773851860.918998:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.918998:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.918999:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.919001:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11746@kfi7
00000400:00000010:11.0:1773851860.919002:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ed9687dd.
00000100:00000200:11.0:1773851860.919003:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859579962906304, offset 224
00000400:00000200:11.0:1773851860.919005:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11746@kfi7
00000400:00000200:11.0:1773851860.919007:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11746@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.919008:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a7f3644 nid 11746@kfi7 refs 1
00000400:00000200:11.0:1773851860.919010:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a7f3644 nid 11746@kfi7 refs 2
00000400:00000200:11.0:1773851860.919012:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a7f3644 nid 11746@kfi7 refs 3
00000400:00000200:11.0:1773851860.919013:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11746@kfi7 local destination
00000400:00000200:11.0:1773851860.919016:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768937:8768937:1024:4294967295] 11746@kfi7 LPNI seq info [732818:732818:16:4294967295]
00000400:00000200:11.0:1773851860.919018:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a7f3644 nid 11746@kfi7 refs 2
00000400:00000200:11.0:1773851860.919019:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11746@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.919022:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11746@kfi7(11746@kfi7:11746@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.919024:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a7f3644 nid 11746@kfi7 refs 3
00000800:00000200:11.0:1773851860.919027:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.919028:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.919032:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.919036:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdcc Using peer 11746@kfi7(0xdcc)
00000800:00000200:11.0:1773851860.919040:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0xdcc: rc=0
00000800:00000200:11.0:1773851860.919042:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdcc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.919051:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.919052:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000024351b46 refcount 2 to 11555@kfi7
00010000:00000001:11.0:1773851860.919054:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.919055:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851860.919055:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdcc TN_EVENT_TX_OK event status 0
00000020:00000001:11.0:1773851860.919056:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.919057:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000085d06088 x1859579962906304/t0(0) o400->18691581-bba0-40dc-8f73-1b55543daaf3@11555@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1211-0'
00000400:00000200:9.0:1773851860.919057:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.919059:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11746@kfi7: PUT: OK
00000400:00000200:9.0:1773851860.919060:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ed9687dd
00000400:00000010:9.0:1773851860.919061:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ed9687dd.
00000100:00000001:9.0:1773851860.919062:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:11.0:1773851860.919063:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085d06088 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:18691581-bba0-40dc-8f73-1b55543daaf3+5:39748:x1859579962906304:12345-11555@kfi7:400:default-tuolumne1211-0 Request processed in 102us (151us total) trans 0 rc 0/0
00000100:00000001:9.0:1773851860.919063:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851860.919065:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a7f3644 nid 11746@kfi7 refs 2
00000100:00100000:11.0:1773851860.919067:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11555@kfi7, seq: 2130753
00000800:00000200:9.0:1773851860.919067:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 11746@kfi7(0000000007ff200c):0x0 lsk 3533 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdcc Transaction freed
00000100:00000040:11.0:1773851860.919068:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000096c46351 : new rpc_count 0
00000100:00000001:11.0:1773851860.919069:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851860.919070:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851860.919071:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.919072:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a4701f2.
00000020:00000010:11.0:1773851860.919073:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006c3ed247.
00000020:00000040:11.0:1773851860.919074:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000096c46351 : new refcount 4
00000100:00000001:11.0:1773851860.919076:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.923954:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.923955:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.923956:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.923958:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.923961:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15010@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.923962:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15010@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.923963:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15010@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.923964:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ecf6043 nid 15010@kfi7 refs 1
00000400:00000200:1.0:1773851860.923965:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15010@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.923966:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ecf6043 nid 15010@kfi7 refs 2
00000400:00000200:1.0:1773851860.923966:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002ecf6043 nid 15010@kfi7 refs 3
00000400:00000200:1.0:1773851860.923967:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14946@kfi7 to cpt 5
00000400:00000200:1.0:1773851860.923968:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14946@kfi7 of length 224 into portal 12 MB=0x69b4b5fc57d80
00000400:00000200:1.0:1773851860.923970:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14946@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 21184
00000800:00000200:1.0:1773851860.923971:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.923973:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.923974:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15010@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.923975:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.923975:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.923976:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a951196d.
00000100:00000040:1.0:1773851860.923977:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a951196d x1859597891894656 msgsize 224
00000100:00100000:1.0:1773851860.923978:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14946@kfi7 (source: 12345-15010@kfi7)
00000100:00000001:1.0:1773851860.923979:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.923980:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002ecf6043 nid 15010@kfi7 refs 2
00000100:00000001:0.0:1773851860.923980:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.923981:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.923981:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.923981:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.923982:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.923983:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.923983:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597891894656
00000020:00000001:0.0:1773851860.923984:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.923984:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80167
00000020:00000001:0.0:1773851860.923985:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.923986:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004ba7a908 refcount=166
00000020:00000001:0.0:1773851860.923987:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139853364224 : -106933856187392 : ffff9ebe857ccc00)
00000020:00000001:0.0:1773851860.923988:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139853364224 : -106933856187392 : ffff9ebe857ccc00)
00000100:00000001:0.0:1773851860.923989:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.923990:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.923990:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851860.923991:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.923992:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.923993:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.923994:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.923994:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.923995:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.923995:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.923996:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.923997:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851860.923998:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.923998:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.923998:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851860.923998:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.923999:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14946@kfi7, seq: 1997527
00000100:00000001:1.0:1773851860.924000:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.924000:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004ba7a908 : new rpc_count 1
00000100:00000001:1.0:1773851860.924001:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.924001:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064180679552 : -107009528872064 : ffff9eace70b4380)
00000100:00000040:0.0:1773851860.924002:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a951196d x1859597891894656/t0(0) o400->6f6e77b7-9f72-4e5d-9880-0a7342d2b6db@14946@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1420-0'
00000100:00000001:0.0:1773851860.924004:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.924004:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.924006:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a951196d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6f6e77b7-9f72-4e5d-9880-0a7342d2b6db+166:39553:x1859597891894656:12345-14946@kfi7:400:default-tuolumne1420-0
00000100:00000200:0.0:1773851860.924007:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597891894656
00000020:00000001:0.0:1773851860.924008:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.924008:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.924009:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.924010:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.924010:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.924011:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.924011:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597891894656, found 0 last_xid 1859597891472063
00000020:00000001:0.0:1773851860.924012:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.924013:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.924013:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.924014:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.924014:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.924015:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.924015:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.924016:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b5344ac9.
02000000:00000001:0.0:1773851860.924017:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.924017:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.924018:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.924019:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061659, transno 0, xid 1859597891894656
00010000:00000001:0.0:1773851860.924019:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.924020:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a951196d x1859597891894656/t0(0) o400->6f6e77b7-9f72-4e5d-9880-0a7342d2b6db@14946@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1420-0'
00010000:00000001:0.0:1773851860.924023:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.924023:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.924024:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.924025:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.924025:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c57bc7a9 refcount 3 to 14946@kfi7
00000100:00000001:0.0:1773851860.924026:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449504 : -107146752102112 : ffff9e8cf3e6f120)
02000000:00000001:0.0:1773851860.924027:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.924027:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.924028:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.924029:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15010@kfi7
00000400:00000010:0.0:1773851860.924029:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ee348cea.
00000100:00000200:0.0:1773851860.924030:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597891894656, offset 224
00000400:00000200:0.0:1773851860.924031:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15010@kfi7
00000400:00000200:0.0:1773851860.924032:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15010@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.924033:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ecf6043 nid 15010@kfi7 refs 1
00000400:00000200:0.0:1773851860.924034:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002ecf6043 nid 15010@kfi7 refs 2
00000400:00000200:0.0:1773851860.924035:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002ecf6043 nid 15010@kfi7 refs 3
00000400:00000200:0.0:1773851860.924036:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15010@kfi7 local destination
00000400:00000200:0.0:1773851860.924037:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768938:8768938:1024:4294967295] 15010@kfi7 LPNI seq info [342796:342796:16:4294967295]
00000400:00000200:0.0:1773851860.924038:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002ecf6043 nid 15010@kfi7 refs 2
00000400:00000200:0.0:1773851860.924039:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15010@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.924041:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15010@kfi7(15010@kfi7:15010@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.924042:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002ecf6043 nid 15010@kfi7 refs 3
00000800:00000200:0.0:1773851860.924043:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.924044:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.924049:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.924051:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000be1 Using peer 15010@kfi7(0x100000000000be1)
00000800:00000200:0.0:1773851860.924054:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x100000000000be1: rc=0
00000800:00000200:0.0:1773851860.924056:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000be1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.924058:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.924059:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c57bc7a9 refcount 2 to 14946@kfi7
00010000:00000001:0.0:1773851860.924060:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.924060:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.924061:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.924062:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a951196d x1859597891894656/t0(0) o400->6f6e77b7-9f72-4e5d-9880-0a7342d2b6db@14946@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1420-0'
00000100:00100000:0.0:1773851860.924066:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a951196d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6f6e77b7-9f72-4e5d-9880-0a7342d2b6db+166:39553:x1859597891894656:12345-14946@kfi7:400:default-tuolumne1420-0 Request processed in 61us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.924069:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14946@kfi7, seq: 1997527
00000100:00000040:0.0:1773851860.924070:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004ba7a908 : new rpc_count 0
00000100:00000001:0.0:1773851860.924070:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.924071:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.924071:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.924072:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.924073:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851860.924074:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004ba7a908 : new refcount 165
00000100:00000001:0.0:1773851860.924074:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.924080:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000be1 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.924082:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.924083:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15010@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.924085:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ee348cea
00000400:00000010:1.0:1773851860.924085:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ee348cea.
00000100:00000001:1.0:1773851860.924086:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.924086:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.924087:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002ecf6043 nid 15010@kfi7 refs 2
00000800:00000200:1.0:1773851860.924088:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 15010@kfi7(0000000056195e1a):0x0 lsk 3042 rsk 38 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000be1 Transaction freed
00000800:00000200:1.0:1773851860.930773:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.930773:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.930774:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.930776:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.930778:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16450@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.930779:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16450@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.930780:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16450@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.930780:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a52849e4 nid 16450@kfi7 refs 1
00000400:00000200:1.0:1773851860.930782:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16450@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.930782:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a52849e4 nid 16450@kfi7 refs 2
00000400:00000200:1.0:1773851860.930783:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a52849e4 nid 16450@kfi7 refs 3
00000400:00000200:1.0:1773851860.930784:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16515@kfi7 to cpt 7
00000400:00000200:1.0:1773851860.930785:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16515@kfi7 of length 224 into portal 12 MB=0x69b9db13f8200
00000400:00000200:1.0:1773851860.930786:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16515@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 21408
00000800:00000200:1.0:1773851860.930787:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.930788:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.930789:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16450@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.930790:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.930790:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.930792:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f8861e0.
00000100:00000040:1.0:1773851860.930792:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007f8861e0 x1859951446163968 msgsize 224
00000100:00100000:1.0:1773851860.930793:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-16515@kfi7 (source: 12345-16450@kfi7)
00000100:00000001:1.0:1773851860.930795:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.930796:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a52849e4 nid 16450@kfi7 refs 2
00000100:00000001:0.0:1773851860.930796:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.930797:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.930797:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.930797:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.930797:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.930798:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.930799:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859951446163968
00000020:00000001:0.0:1773851860.930800:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.930800:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08c833259b7
00000020:00000001:0.0:1773851860.930800:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.930802:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ba3d821 refcount=167
00000020:00000001:0.0:1773851860.930802:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637066353334272 : -107007356217344 : ffff9ead688b5800)
00000020:00000001:0.0:1773851860.930803:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637066353334272 : -107007356217344 : ffff9ead688b5800)
00000100:00000001:0.0:1773851860.930804:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.930805:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.930805:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851860.930806:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.930807:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.930807:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.930808:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.930808:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.930809:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.930809:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.930809:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.930810:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.930811:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.930812:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.930812:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851860.930812:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.930812:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16515@kfi7, seq: 1997528
00000100:00000001:1.0:1773851860.930813:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.930813:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ba3d821 : new rpc_count 1
00000100:00000001:1.0:1773851860.930814:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.930814:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856605440 : -106915852946176 : ffff9ec2b6907500)
00000100:00000040:0.0:1773851860.930815:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007f8861e0 x1859951446163968/t0(0) o400->a277e44e-6d60-4275-a420-408bc42019ed@16515@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1528-0'
00000100:00000001:0.0:1773851860.930818:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.930818:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.930819:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f8861e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a277e44e-6d60-4275-a420-408bc42019ed+167:39686:x1859951446163968:12345-16515@kfi7:400:default-tuolumne1528-0
00000100:00000200:0.0:1773851860.930820:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859951446163968
00000020:00000001:0.0:1773851860.930821:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.930821:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.930822:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.930823:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.930823:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.930824:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.930824:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859951446163968, found 0 last_xid 1859951445743359
00000020:00000001:0.0:1773851860.930825:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.930826:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.930826:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.930827:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.930827:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.930827:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.930828:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.930828:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004240f088.
02000000:00000001:0.0:1773851860.930829:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.930829:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.930830:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.930830:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061770, transno 0, xid 1859951446163968
00010000:00000001:0.0:1773851860.930831:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.930832:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007f8861e0 x1859951446163968/t0(0) o400->a277e44e-6d60-4275-a420-408bc42019ed@16515@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1528-0'
00010000:00000001:0.0:1773851860.930834:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.930835:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.930835:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.930836:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.930837:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000023a677b refcount 3 to 16515@kfi7
00000100:00000001:0.0:1773851860.930837:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271680 : -107152618279936 : ffff9e8b96402c00)
02000000:00000001:0.0:1773851860.930838:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.930839:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.930839:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.930840:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16450@kfi7
00000400:00000010:0.0:1773851860.930840:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af09dc10.
00000100:00000200:0.0:1773851860.930841:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859951446163968, offset 224
00000400:00000200:0.0:1773851860.930842:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16450@kfi7
00000400:00000200:0.0:1773851860.930843:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16450@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.930843:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a52849e4 nid 16450@kfi7 refs 1
00000400:00000200:0.0:1773851860.930847:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a52849e4 nid 16450@kfi7 refs 2
00000400:00000200:0.0:1773851860.930848:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a52849e4 nid 16450@kfi7 refs 3
00000400:00000200:0.0:1773851860.930849:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16450@kfi7 local destination
00000400:00000200:0.0:1773851860.930850:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768939:8768939:1024:4294967295] 16450@kfi7 LPNI seq info [229680:229680:16:4294967295]
00000400:00000200:0.0:1773851860.930852:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a52849e4 nid 16450@kfi7 refs 2
00000400:00000200:0.0:1773851860.930852:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16450@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.930854:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16450@kfi7(16450@kfi7:16450@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.930855:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a52849e4 nid 16450@kfi7 refs 3
00000800:00000200:0.0:1773851860.930856:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.930857:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.930859:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.930862:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c22 Using peer 16450@kfi7(0x100000000000c22)
00000800:00000200:0.0:1773851860.930865:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x100000000000c22: rc=0
00000800:00000200:0.0:1773851860.930866:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c22 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.930868:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.930868:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000023a677b refcount 2 to 16515@kfi7
00010000:00000001:0.0:1773851860.930869:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.930869:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.930870:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.930871:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f8861e0 x1859951446163968/t0(0) o400->a277e44e-6d60-4275-a420-408bc42019ed@16515@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1528-0'
00000100:00100000:0.0:1773851860.930875:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f8861e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a277e44e-6d60-4275-a420-408bc42019ed+167:39686:x1859951446163968:12345-16515@kfi7:400:default-tuolumne1528-0 Request processed in 55us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.930877:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16515@kfi7, seq: 1997528
00000100:00000040:0.0:1773851860.930878:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ba3d821 : new rpc_count 0
00000100:00000001:0.0:1773851860.930879:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.930879:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.930880:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.930880:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.930881:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851860.930882:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003ba3d821 : new refcount 166
00000100:00000001:0.0:1773851860.930882:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.930887:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c22 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.930888:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.930890:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16450@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.930890:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af09dc10
00000400:00000010:1.0:1773851860.930891:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af09dc10.
00000100:00000001:1.0:1773851860.930891:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.930892:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.930893:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a52849e4 nid 16450@kfi7 refs 2
00000800:00000200:1.0:1773851860.930894:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 16450@kfi7(0000000073473ae7):0x0 lsk 3107 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c22 Transaction freed
00000800:00000200:21.0:1773851860.935152:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851860.935152:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851860.935154:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851860.935155:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851860.935157:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20219@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.935158:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20219@kfi7 : PUT - for me
00000400:00000200:21.0:1773851860.935159:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20219@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.935160:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000837b1af7 nid 20219@kfi7 refs 1
00000400:00000200:21.0:1773851860.935161:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20219@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.935161:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000837b1af7 nid 20219@kfi7 refs 2
00000400:00000200:21.0:1773851860.935162:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000837b1af7 nid 20219@kfi7 refs 3
00000400:00000200:21.0:1773851860.935163:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20219@kfi7 to cpt 5
00000400:00000200:21.0:1773851860.935163:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20219@kfi7 of length 224 into portal 12 MB=0x699de8e8bf300
00000400:00000200:21.0:1773851860.935164:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20219@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 30568
00000800:00000200:21.0:1773851860.935166:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851860.935167:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851860.935168:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20219@kfi7: PUT: OK
00000100:00000001:21.0:1773851860.935169:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851860.935170:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851860.935171:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f15da627.
00000100:00000040:21.0:1773851860.935172:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000f15da627 x1858031013589760 msgsize 224
00000100:00100000:21.0:1773851860.935173:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20219@kfi7 (source: 12345-20219@kfi7)
00000100:00000001:21.0:1773851860.935174:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851860.935175:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000837b1af7 nid 20219@kfi7 refs 2
00000100:00000001:23.0:1773851860.935176:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851860.935176:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851860.935176:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851860.935177:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851860.935177:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851860.935178:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851860.935179:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031013589760
00000020:00000001:23.0:1773851860.935179:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851860.935180:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9133a
00000020:00000001:23.0:1773851860.935180:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851860.935183:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000087dbbba4 refcount=6
00000020:00000001:23.0:1773851860.935183:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169312256 : -107127540239360 : ffff9e916d04b400)
00000020:00000001:23.0:1773851860.935184:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169312256 : -107127540239360 : ffff9e916d04b400)
00000100:00000001:23.0:1773851860.935185:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.935186:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851860.935187:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094554af3.
00000020:00000010:23.0:1773851860.935188:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.935189:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851860.935189:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851860.935190:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851860.935190:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.935191:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851860.935192:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851860.935192:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.935193:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851860.935194:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851860.935194:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851860.935194:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851860.935195:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851860.935196:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20219@kfi7, seq: 1997952
00000100:00000040:23.0:1773851860.935196:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000087dbbba4 : new rpc_count 1
00000100:00000001:22.0:1773851860.935196:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.935197:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637057733474944 : -107015976076672 : ffff9eab66c2ba80)
00000100:00000001:22.0:1773851860.935197:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.935199:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f15da627 x1858031013589760/t0(0) o400->f172e15b-68d2-4db8-91a6-6e125510e897@20219@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne247-0'
00000100:00000001:23.0:1773851860.935202:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851860.935202:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851860.935203:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f15da627 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f172e15b-68d2-4db8-91a6-6e125510e897+6:47853:x1858031013589760:12345-20219@kfi7:400:default-tuolumne247-0
00000100:00000200:23.0:1773851860.935204:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031013589760
00000020:00000001:23.0:1773851860.935205:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851860.935205:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851860.935206:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.935207:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851860.935207:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851860.935208:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851860.935209:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031013589760, found 0 last_xid 1858031013589759
00000020:00000001:23.0:1773851860.935209:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851860.935210:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851860.935210:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851860.935211:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.935211:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851860.935212:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851860.935212:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851860.935213:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000345a0e64.
02000000:00000001:23.0:1773851860.935213:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.935214:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.935215:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851860.935215:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768045, transno 0, xid 1858031013589760
00010000:00000001:23.0:1773851860.935216:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851860.935217:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f15da627 x1858031013589760/t0(0) o400->f172e15b-68d2-4db8-91a6-6e125510e897@20219@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne247-0'
00010000:00000001:23.0:1773851860.935219:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851860.935220:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851860.935220:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=93 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851860.935221:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851860.935222:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000007481b9f refcount 5 to 20219@kfi7
00000100:00000001:23.0:1773851860.935223:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956271104 : -107146753280512 : ffff9e8cf3d4f600)
02000000:00000001:23.0:1773851860.935224:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851860.935224:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851860.935225:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851860.935226:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20219@kfi7
00000400:00000010:23.0:1773851860.935226:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dffbbfb6.
00000100:00000200:23.0:1773851860.935227:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031013589760, offset 224
00000400:00000200:23.0:1773851860.935228:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20219@kfi7
00000400:00000200:23.0:1773851860.935229:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20219@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.935230:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000837b1af7 nid 20219@kfi7 refs 1
00000400:00000200:23.0:1773851860.935231:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000837b1af7 nid 20219@kfi7 refs 2
00000400:00000200:23.0:1773851860.935232:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000837b1af7 nid 20219@kfi7 refs 3
00000400:00000200:23.0:1773851860.935233:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20219@kfi7 local destination
00000400:00000200:23.0:1773851860.935234:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768940:8768940:1024:4294967295] 20219@kfi7 LPNI seq info [28021:28021:16:4294967295]
00000400:00000200:23.0:1773851860.935235:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000837b1af7 nid 20219@kfi7 refs 2
00000400:00000200:23.0:1773851860.935236:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20219@kfi7 to cpt 5
00000400:00000200:23.0:1773851860.935238:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20219@kfi7(20219@kfi7:20219@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851860.935239:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000837b1af7 nid 20219@kfi7 refs 3
00000800:00000200:23.0:1773851860.935240:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851860.935242:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851860.935244:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851860.935246:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005d5 Using peer 20219@kfi7(0x1000000000005d5)
00000800:00000200:23.0:1773851860.935248:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x1000000000005d5: rc=0
00000800:00000200:23.0:1773851860.935250:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005d5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851860.935252:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851860.935253:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000007481b9f refcount 4 to 20219@kfi7
00010000:00000001:23.0:1773851860.935253:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851860.935254:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851860.935255:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851860.935255:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f15da627 x1858031013589760/t0(0) o400->f172e15b-68d2-4db8-91a6-6e125510e897@20219@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne247-0'
00000100:00100000:23.0:1773851860.935258:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f15da627 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f172e15b-68d2-4db8-91a6-6e125510e897+6:47853:x1858031013589760:12345-20219@kfi7:400:default-tuolumne247-0 Request processed in 55us (85us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851860.935260:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20219@kfi7, seq: 1997952
00000800:00000200:21.0:1773851860.935260:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005d5 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851860.935261:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000087dbbba4 : new rpc_count 0
00000400:00000200:21.0:1773851860.935261:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851860.935262:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851860.935262:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851860.935262:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20219@kfi7: PUT: OK
00000020:00000010:23.0:1773851860.935263:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851860.935263:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851860.935263:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dffbbfb6
00000020:00000010:23.0:1773851860.935264:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094554af3.
00000400:00000010:21.0:1773851860.935264:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dffbbfb6.
00000100:00000001:21.0:1773851860.935264:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:23.0:1773851860.935265:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000087dbbba4 : new refcount 5
00000100:00000001:21.0:1773851860.935265:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851860.935265:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000837b1af7 nid 20219@kfi7 refs 2
00000100:00000001:23.0:1773851860.935266:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851860.935267:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 20219@kfi7(00000000375bea79):0x0 lsk 1494 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005d5 Transaction freed
00000800:00000200:25.0:1773851860.936180:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851860.936181:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851860.936182:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851860.936184:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851860.936186:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.936187:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851860.936188:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.936189:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851860.936190:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851860.936191:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851860.936191:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851860.936192:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851860.936193:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a86093280
00000400:00000200:25.0:1773851860.936194:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 13168
00000800:00000200:25.0:1773851860.936196:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851860.936198:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851860.936199:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851860.936199:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851860.936200:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851860.936201:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a51ce74.
00000100:00000040:25.0:1773851860.936202:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000008a51ce74 x1859388080468608 msgsize 224
00000100:00100000:25.0:1773851860.936203:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851860.936204:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851860.936204:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00000001:24.0:1773851860.936205:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851860.936206:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851860.936206:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851860.936206:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851860.936207:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851860.936207:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851860.936208:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080468608
00000020:00000001:24.0:1773851860.936208:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851860.936209:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:24.0:1773851860.936210:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851860.936211:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:24.0:1773851860.936211:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:24.0:1773851860.936212:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:24.0:1773851860.936213:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851860.936214:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851860.936214:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003f57bde1.
00000020:00000010:24.0:1773851860.936215:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851860.936216:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000040:24.0:1773851860.936217:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851860.936218:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851860.936218:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851860.936218:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.936219:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.936220:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851860.936221:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851860.936222:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851860.936222:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851860.936222:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851860.936223:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799981
00000100:00000001:25.0:1773851860.936224:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.936224:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:25.0:1773851860.936225:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.936225:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637054961768960 : -107018747782656 : ffff9eaac18dda00)
00000100:00000040:24.0:1773851860.936226:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a51ce74 x1859388080468608/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:24.0:1773851860.936229:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851860.936229:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851860.936230:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a51ce74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38114:x1859388080468608:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:24.0:1773851860.936231:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080468608
00000020:00000001:24.0:1773851860.936232:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851860.936233:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851860.936233:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.936234:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851860.936234:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851860.936235:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851860.936236:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851860.936236:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851860.936237:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851860.936237:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.936238:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851860.936238:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851860.936239:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000053354f3.
02000000:00000001:24.0:1773851860.936240:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.936241:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851860.936241:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851860.936242:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851860.936242:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851860.936243:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851860.936244:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851860.936246:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851860.936246:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080468608
00010000:00000001:24.0:1773851860.936247:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851860.936248:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008a51ce74 x1859388080468608/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:587/0 lens 224/368 e 0 to 0 dl 1773851947 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:24.0:1773851860.936250:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851860.936251:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851860.936252:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=137 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851860.936253:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851860.936254:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:24.0:1773851860.936254:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:24.0:1773851860.936255:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851860.936256:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851860.936256:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851860.936257:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:24.0:1773851860.936258:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047620e92.
00000100:00000200:24.0:1773851860.936258:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080468608, offset 224
00000400:00000200:24.0:1773851860.936259:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:24.0:1773851860.936260:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851860.936261:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:24.0:1773851860.936262:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851860.936263:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:24.0:1773851860.936264:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:24.0:1773851860.936265:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768941:8768941:1024:4294967295] 8@kfi7 LPNI seq info [17340060:17340060:16:4294967295]
00000400:00000200:24.0:1773851860.936267:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851860.936267:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851860.936269:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851860.936270:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:24.0:1773851860.936272:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851860.936273:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851860.936275:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851860.936277:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000800:00000200:24.0:1773851860.936282:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 468 bytes to peer 0x200000000001191: rc=0
00000800:00000200:24.0:1773851860.936284:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851860.936286:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851860.936286:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:24.0:1773851860.936287:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851860.936288:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851860.936288:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851860.936289:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a51ce74 x1859388080468608/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:587/0 lens 224/368 e 0 to 0 dl 1773851947 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:24.0:1773851860.936293:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a51ce74 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38114:x1859388080468608:12345-7@kfi7:41:default-yuba5-0 Request processed in 63us (91us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851860.936296:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799981
00000100:00000040:24.0:1773851860.936296:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:24.0:1773851860.936297:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851860.936297:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851860.936298:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851860.936299:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851860.936299:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003f57bde1.
00000020:00000040:24.0:1773851860.936300:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:24.0:1773851860.936301:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851860.936305:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851860.936307:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851860.936308:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000400:00000200:25.0:1773851860.936309:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047620e92
00000400:00000010:25.0:1773851860.936309:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047620e92.
00000100:00000001:25.0:1773851860.936310:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851860.936310:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851860.936311:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851860.936313:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Transaction freed
00000800:00000200:10.0:1773851860.970476:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851860.970477:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851860.970478:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851860.970480:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851860.970482:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19155@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.970483:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19155@kfi7 : PUT - for me
00000400:00000200:10.0:1773851860.970484:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19155@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.970485:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032d24843 nid 19155@kfi7 refs 1
00000400:00000200:10.0:1773851860.970487:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19155@kfi7 to cpt 2
00000400:00000200:10.0:1773851860.970487:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032d24843 nid 19155@kfi7 refs 2
00000400:00000200:10.0:1773851860.970488:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000032d24843 nid 19155@kfi7 refs 3
00000400:00000200:10.0:1773851860.970489:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18962@kfi7 to cpt 4
00000400:00000200:10.0:1773851860.970490:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18962@kfi7 of length 224 into portal 12 MB=0x699e0cf0e8e40
00000400:00000200:10.0:1773851860.970491:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18962@kfi7 of length 224/224 into md 0x78146ce49 [64] + 128592
00000800:00000200:10.0:1773851860.970493:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851860.970496:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851860.970497:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19155@kfi7: PUT: OK
00000100:00000001:10.0:1773851860.970498:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851860.970499:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851860.970500:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000081a4eae8.
00000100:00000040:10.0:1773851860.970500:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000081a4eae8 x1858040685825600 msgsize 224
00000100:00100000:10.0:1773851860.970502:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-18962@kfi7 (source: 12345-19155@kfi7)
00000100:00000001:10.0:1773851860.970503:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851860.970504:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:10.0:1773851860.970504:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000032d24843 nid 19155@kfi7 refs 2
02000000:00000001:11.0:1773851860.970505:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851860.970505:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851860.970505:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851860.970506:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851860.970506:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851860.970507:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040685825600
00000020:00000001:11.0:1773851860.970508:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851860.970508:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924ba
00000020:00000001:11.0:1773851860.970509:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851860.970512:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000367b03bd refcount=61
00000020:00000001:11.0:1773851860.970513:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630762496 : -107123078789120 : ffff9e9276f10800)
00000020:00000001:11.0:1773851860.970514:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630762496 : -107123078789120 : ffff9e9276f10800)
00000100:00000001:11.0:1773851860.970515:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.970516:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851860.970517:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006c3ed247.
00000020:00000010:11.0:1773851860.970518:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.970519:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a4701f2.
00000100:00000001:11.0:1773851860.970519:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851860.970520:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851860.970520:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.970521:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851860.970522:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851860.970522:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.970523:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.970524:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.970525:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.970526:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18962@kfi7, seq: 2130754
00000100:00000040:11.0:1773851860.970526:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000367b03bd : new rpc_count 2
00000100:00000001:9.0:1773851860.970526:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851860.970526:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851860.970527:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610157056 : -107030099394560 : ffff9ea81cf20000)
00000100:00000001:9.0:1773851860.970527:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.970528:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000081a4eae8 x1858040685825600/t0(0) o400->d1f64a63-eaca-46c8-b7f9-a99e22eb98f4@18962@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1685-0'
00000100:00000001:9.0:1773851860.970528:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.970531:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.970531:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.970532:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081a4eae8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d1f64a63-eaca-46c8-b7f9-a99e22eb98f4+61:39667:x1858040685825600:12345-18962@kfi7:400:default-tuolumne1685-0
00000100:00000200:11.0:1773851860.970533:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040685825600
00000020:00000001:11.0:1773851860.970534:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.970535:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.970535:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.970536:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.970537:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.970537:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.970538:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040685825600, found 0 last_xid 1858040685262783
00000020:00000001:11.0:1773851860.970539:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.970539:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.970540:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.970540:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.970541:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.970542:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.970542:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.970543:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d421023f.
02000000:00000001:11.0:1773851860.970544:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.970545:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.970545:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.970546:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588814, transno 0, xid 1858040685825600
00010000:00000001:11.0:1773851860.970547:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.970548:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000081a4eae8 x1858040685825600/t0(0) o400->d1f64a63-eaca-46c8-b7f9-a99e22eb98f4@18962@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1685-0'
00010000:00000001:11.0:1773851860.970550:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.970551:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.970552:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.970552:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.970553:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009f772234 refcount 3 to 18962@kfi7
00000100:00000001:11.0:1773851860.970554:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516416 : -107156126035200 : ffff9e8ac52c1300)
02000000:00000001:11.0:1773851860.970555:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.970555:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.970556:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.970557:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19155@kfi7
00000400:00000010:11.0:1773851860.970557:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1dd5303.
00000100:00000200:11.0:1773851860.970558:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040685825600, offset 224
00000400:00000200:11.0:1773851860.970559:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19155@kfi7
00000400:00000200:11.0:1773851860.970560:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19155@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.970561:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032d24843 nid 19155@kfi7 refs 1
00000400:00000200:11.0:1773851860.970562:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000032d24843 nid 19155@kfi7 refs 2
00000400:00000200:11.0:1773851860.970563:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000032d24843 nid 19155@kfi7 refs 3
00000400:00000200:11.0:1773851860.970564:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19155@kfi7 local destination
00000400:00000200:11.0:1773851860.970565:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768942:8768942:1024:4294967295] 19155@kfi7 LPNI seq info [1770985:1770985:16:4294967295]
00000400:00000200:11.0:1773851860.970567:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000032d24843 nid 19155@kfi7 refs 2
00000400:00000200:11.0:1773851860.970567:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19155@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.970569:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19155@kfi7(19155@kfi7:19155@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.970571:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000032d24843 nid 19155@kfi7 refs 3
00000800:00000200:11.0:1773851860.970573:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.970574:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.970576:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.970578:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000a6 Using peer 19155@kfi7(0x1000000000000a6)
00000800:00000200:11.0:1773851860.970581:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x1000000000000a6: rc=0
00000800:00000200:11.0:1773851860.970583:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000a6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.970585:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.970586:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009f772234 refcount 2 to 18962@kfi7
00010000:00000001:11.0:1773851860.970586:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.970587:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.970587:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.970588:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000081a4eae8 x1858040685825600/t0(0) o400->d1f64a63-eaca-46c8-b7f9-a99e22eb98f4@18962@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1685-0'
00000100:00100000:11.0:1773851860.970591:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081a4eae8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d1f64a63-eaca-46c8-b7f9-a99e22eb98f4+61:39667:x1858040685825600:12345-18962@kfi7:400:default-tuolumne1685-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851860.970594:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18962@kfi7, seq: 2130754
00000100:00000040:11.0:1773851860.970595:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000367b03bd : new rpc_count 1
00000100:00000001:11.0:1773851860.970596:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:10.0:1773851860.970596:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000a6 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851860.970597:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851860.970597:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:10.0:1773851860.970597:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851860.970598:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a4701f2.
00000400:00000200:10.0:1773851860.970598:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19155@kfi7: PUT: OK
00000020:00000010:11.0:1773851860.970599:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006c3ed247.
00000020:00000040:11.0:1773851860.970599:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000367b03bd : new refcount 60
00000400:00000200:10.0:1773851860.970599:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1dd5303
00000100:00000001:11.0:1773851860.970600:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:10.0:1773851860.970600:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1dd5303.
00000100:00000001:10.0:1773851860.970600:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851860.970601:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851860.970602:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000032d24843 nid 19155@kfi7 refs 2
00000800:00000200:10.0:1773851860.970603:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 19155@kfi7(000000008b372cfd):0x0 lsk 167 rsk 54 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000a6 Transaction freed
00000800:00000200:17.0:1773851860.976213:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851860.976214:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851860.976216:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851860.976219:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851860.976222:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.976224:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13985@kfi7 : PUT - for me
00000400:00000200:17.0:1773851860.976226:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.976227:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 1
00000400:00000200:17.0:1773851860.976228:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:17.0:1773851860.976229:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:17.0:1773851860.976231:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000400:00000200:17.0:1773851860.976232:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13921@kfi7 to cpt 0
00000400:00000200:17.0:1773851860.976233:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13921@kfi7 of length 224 into portal 12 MB=0x69b0a274eea40
00000400:00000200:17.0:1773851860.976235:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13921@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 1792
00000800:00000200:17.0:1773851860.976238:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851860.976244:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851860.976245:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13985@kfi7: PUT: OK
00000100:00000001:17.0:1773851860.976246:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851860.976247:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851860.976248:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003afaaa44.
00000100:00000040:17.0:1773851860.976249:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000003afaaa44 x1859317771725376 msgsize 224
00000100:00100000:17.0:1773851860.976252:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13921@kfi7 (source: 12345-13985@kfi7)
00000100:00000001:17.0:1773851860.976253:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851860.976254:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000100:00000001:18.0:1773851860.976255:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851860.976256:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851860.976256:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851860.976257:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851860.976258:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851860.976259:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851860.976260:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317771725376
00000020:00000001:18.0:1773851860.976261:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851860.976261:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9190d
00000020:00000001:18.0:1773851860.976262:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851860.976265:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000051d16bbe refcount=165
00000020:00000001:18.0:1773851860.976266:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241971712 : -107152467579904 : ffff9e8b9f3bac00)
00000020:00000001:18.0:1773851860.976267:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241971712 : -107152467579904 : ffff9e8b9f3bac00)
00000100:00000001:18.0:1773851860.976268:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.976269:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851860.976270:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007d2c34f1.
00000020:00000010:18.0:1773851860.976272:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.976273:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004b65e428.
00000100:00000001:18.0:1773851860.976274:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851860.976275:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:18.0:1773851860.976275:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.976277:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:18.0:1773851860.976277:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:18.0:1773851860.976278:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.976279:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851860.976281:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.976282:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851860.976282:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851860.976282:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851860.976284:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13921@kfi7, seq: 2156290
00000100:00000001:19.0:1773851860.976285:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.976285:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000051d16bbe : new rpc_count 1
00000100:00000001:19.0:1773851860.976286:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.976286:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764348288 : -107095945203328 : ffff9e98c83ab180)
00000100:00000040:18.0:1773851860.976287:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003afaaa44 x1859317771725376/t0(0) o400->9c3fe0ad-d92d-4a26-ab12-485047113a65@13921@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1360-0'
00000100:00000001:18.0:1773851860.976292:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851860.976293:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851860.976295:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003afaaa44 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:9c3fe0ad-d92d-4a26-ab12-485047113a65+165:39832:x1859317771725376:12345-13921@kfi7:400:default-tuolumne1360-0
00000100:00000200:18.0:1773851860.976297:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317771725376
00000020:00000001:18.0:1773851860.976298:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:18.0:1773851860.976299:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:18.0:1773851860.976300:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.976301:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:18.0:1773851860.976302:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:18.0:1773851860.976303:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:18.0:1773851860.976304:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317771725376, found 0 last_xid 1859317771008319
00000020:00000001:18.0:1773851860.976305:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:18.0:1773851860.976306:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:18.0:1773851860.976307:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:18.0:1773851860.976308:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.976309:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:18.0:1773851860.976309:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851860.976310:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851860.976313:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003f3ba7af.
02000000:00000001:18.0:1773851860.976314:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.976315:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.976316:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:18.0:1773851860.976317:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062543, transno 0, xid 1859317771725376
00010000:00000001:18.0:1773851860.976318:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:18.0:1773851860.976319:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003afaaa44 x1859317771725376/t0(0) o400->9c3fe0ad-d92d-4a26-ab12-485047113a65@13921@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1360-0'
00010000:00000001:18.0:1773851860.976323:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851860.976324:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851860.976325:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=93 v=315 (315 214 1 1)
00000100:00000001:18.0:1773851860.976327:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851860.976328:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e5915c6 refcount 5 to 13921@kfi7
00000100:00000001:18.0:1773851860.976329:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545858112 : -107154163693504 : ffff9e8b3a230840)
02000000:00000001:18.0:1773851860.976330:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851860.976331:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851860.976332:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851860.976334:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13985@kfi7
00000400:00000010:18.0:1773851860.976335:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079e512e5.
00000100:00000200:18.0:1773851860.976336:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317771725376, offset 224
00000400:00000200:18.0:1773851860.976338:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13985@kfi7
00000400:00000200:18.0:1773851860.976339:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.976341:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 1
00000400:00000200:18.0:1773851860.976342:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:18.0:1773851860.976344:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000400:00000200:18.0:1773851860.976346:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13985@kfi7 local destination
00000400:00000200:18.0:1773851860.976348:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768943:8768943:1024:4294967295] 13985@kfi7 LPNI seq info [7474936:7474936:16:4294967295]
00000400:00000200:18.0:1773851860.976350:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:18.0:1773851860.976351:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:18.0:1773851860.976354:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13985@kfi7(13985@kfi7:13985@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851860.976356:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000800:00000200:18.0:1773851860.976358:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851860.976360:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851860.976363:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851860.976367:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007f2 Using peer 13985@kfi7(0x1000000000007f2)
00000800:00000200:18.0:1773851860.976371:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006c9a9e9c: Posted send of 324 bytes to peer 0x1000000000007f2: rc=0
00000800:00000200:18.0:1773851860.976373:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007f2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851860.976376:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851860.976377:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e5915c6 refcount 4 to 13921@kfi7
00010000:00000001:18.0:1773851860.976379:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:18.0:1773851860.976379:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851860.976380:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:18.0:1773851860.976381:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003afaaa44 x1859317771725376/t0(0) o400->9c3fe0ad-d92d-4a26-ab12-485047113a65@13921@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1360-0'
00000800:00000200:17.0:1773851860.976388:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007f2 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851860.976390:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:18.0:1773851860.976391:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003afaaa44 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:9c3fe0ad-d92d-4a26-ab12-485047113a65+165:39832:x1859317771725376:12345-13921@kfi7:400:default-tuolumne1360-0 Request processed in 98us (141us total) trans 0 rc 0/0
00000400:00000200:17.0:1773851860.976392:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13985@kfi7: PUT: OK
00000400:00000200:17.0:1773851860.976393:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079e512e5
00000400:00000010:17.0:1773851860.976394:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079e512e5.
00000100:00100000:18.0:1773851860.976395:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13921@kfi7, seq: 2156290
00000100:00000001:17.0:1773851860.976395:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851860.976395:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:18.0:1773851860.976396:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000051d16bbe : new rpc_count 0
00000400:00000200:17.0:1773851860.976396:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000100:00000001:18.0:1773851860.976397:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851860.976398:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851860.976398:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2054@kfi7:4 -> 13985@kfi7(00000000a6349864):0x0 lsk 2035 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007f2 Transaction freed
00000020:00000010:18.0:1773851860.976399:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851860.976400:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004b65e428.
00000020:00000010:18.0:1773851860.976401:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007d2c34f1.
00000020:00000040:18.0:1773851860.976402:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000051d16bbe : new refcount 164
00000100:00000001:18.0:1773851860.976403:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851860.980762:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851860.980763:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851860.980764:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851860.980766:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851860.980768:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11649@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.980769:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11649@kfi7 : PUT - for me
00000400:00000200:9.0:1773851860.980770:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11649@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.980771:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e73d9225 nid 11649@kfi7 refs 1
00000400:00000200:9.0:1773851860.980772:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11649@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.980773:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e73d9225 nid 11649@kfi7 refs 2
00000400:00000200:9.0:1773851860.980774:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e73d9225 nid 11649@kfi7 refs 3
00000400:00000200:9.0:1773851860.980774:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11649@kfi7 to cpt 2
00000400:00000200:9.0:1773851860.980776:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11649@kfi7 of length 224 into portal 12 MB=0x699e10dde2040
00000400:00000200:9.0:1773851860.980777:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11649@kfi7 of length 224/224 into md 0x78146ce49 [64] + 128816
00000800:00000200:9.0:1773851860.980779:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851860.980781:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851860.980782:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11649@kfi7: PUT: OK
00000100:00000001:9.0:1773851860.980783:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851860.980784:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851860.980784:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004aa8acbf.
00000100:00000040:9.0:1773851860.980785:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004aa8acbf x1858041739616320 msgsize 224
00000100:00100000:9.0:1773851860.980786:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-11649@kfi7 (source: 12345-11649@kfi7)
00000100:00000001:9.0:1773851860.980787:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851860.980788:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851860.980788:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e73d9225 nid 11649@kfi7 refs 2
02000000:00000001:11.0:1773851860.980789:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851860.980789:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851860.980790:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851860.980790:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851860.980791:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851860.980792:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041739616320
00000020:00000001:11.0:1773851860.980792:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851860.980793:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918dc
00000020:00000001:11.0:1773851860.980794:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851860.980796:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e027408b refcount=168
00000020:00000001:11.0:1773851860.980797:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241969664 : -107152467581952 : ffff9e8b9f3ba400)
00000020:00000001:11.0:1773851860.980797:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241969664 : -107152467581952 : ffff9e8b9f3ba400)
00000100:00000001:11.0:1773851860.980798:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.980799:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851860.980800:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006c3ed247.
00000020:00000010:11.0:1773851860.980801:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851860.980802:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a4701f2.
00000100:00000001:11.0:1773851860.980803:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851860.980803:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851860.980803:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.980804:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851860.980805:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851860.980805:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.980806:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851860.980807:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851860.980807:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851860.980808:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11649@kfi7, seq: 2130755
00000100:00000001:9.0:1773851860.980808:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851860.980808:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851860.980809:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e027408b : new rpc_count 1
00000100:00000001:9.0:1773851860.980809:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.980810:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922913152 : -107141786638464 : ffff9e8e1bdde780)
00000100:00000001:9.0:1773851860.980810:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.980811:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004aa8acbf x1858041739616320/t0(0) o400->97f231cf-cca9-4b82-bf7f-d79a9b9855bc@11649@kfi7:587/0 lens 224/0 e 0 to 0 dl 1773851947 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1220-0'
00000100:00000001:11.0:1773851860.980813:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851860.980813:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851860.980814:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004aa8acbf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:97f231cf-cca9-4b82-bf7f-d79a9b9855bc+168:39686:x1858041739616320:12345-11649@kfi7:400:default-tuolumne1220-0
00000100:00000200:11.0:1773851860.980817:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041739616320
00000020:00000001:11.0:1773851860.980817:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851860.980818:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851860.980819:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.980819:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851860.980820:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851860.980821:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851860.980821:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041739616320, found 0 last_xid 1858041739193087
00000020:00000001:11.0:1773851860.980822:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851860.980823:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851860.980823:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851860.980824:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.980824:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851860.980825:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851860.980825:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851860.980826:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000026ee319c.
02000000:00000001:11.0:1773851860.980827:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.980828:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.980828:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851860.980829:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063066, transno 0, xid 1858041739616320
00010000:00000001:11.0:1773851860.980830:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851860.980830:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004aa8acbf x1858041739616320/t0(0) o400->97f231cf-cca9-4b82-bf7f-d79a9b9855bc@11649@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1220-0'
00010000:00000001:11.0:1773851860.980833:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851860.980833:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851860.980834:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=93 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851860.980835:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851860.980835:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008e0c0a5f refcount 3 to 11649@kfi7
00000100:00000001:11.0:1773851860.980836:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810487520 : -107154899064096 : ffff9e8b0e4e2ae0)
02000000:00000001:11.0:1773851860.980837:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851860.980837:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851860.980838:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851860.980839:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11649@kfi7
00000400:00000010:11.0:1773851860.980839:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2b33615.
00000100:00000200:11.0:1773851860.980841:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041739616320, offset 224
00000400:00000200:11.0:1773851860.980842:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11649@kfi7
00000400:00000200:11.0:1773851860.980843:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11649@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.980843:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e73d9225 nid 11649@kfi7 refs 1
00000400:00000200:11.0:1773851860.980844:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e73d9225 nid 11649@kfi7 refs 2
00000400:00000200:11.0:1773851860.980845:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e73d9225 nid 11649@kfi7 refs 3
00000400:00000200:11.0:1773851860.980847:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11649@kfi7 local destination
00000400:00000200:11.0:1773851860.980848:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768944:8768944:1024:4294967295] 11649@kfi7 LPNI seq info [7511660:7511660:16:4294967295]
00000400:00000200:11.0:1773851860.980849:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e73d9225 nid 11649@kfi7 refs 2
00000400:00000200:11.0:1773851860.980850:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11649@kfi7 to cpt 2
00000400:00000200:11.0:1773851860.980852:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11649@kfi7(11649@kfi7:11649@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851860.980853:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e73d9225 nid 11649@kfi7 refs 3
00000800:00000200:11.0:1773851860.980854:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851860.980855:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851860.980857:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851860.980860:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000449 Using peer 11649@kfi7(0x100000000000449)
00000800:00000200:11.0:1773851860.980862:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x100000000000449: rc=0
00000800:00000200:11.0:1773851860.980864:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000449 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851860.980866:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851860.980867:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008e0c0a5f refcount 2 to 11649@kfi7
00010000:00000001:11.0:1773851860.980868:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851860.980868:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851860.980869:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851860.980870:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004aa8acbf x1858041739616320/t0(0) o400->97f231cf-cca9-4b82-bf7f-d79a9b9855bc@11649@kfi7:587/0 lens 224/224 e 0 to 0 dl 1773851947 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1220-0'
00000100:00100000:11.0:1773851860.980873:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004aa8acbf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:97f231cf-cca9-4b82-bf7f-d79a9b9855bc+168:39686:x1858041739616320:12345-11649@kfi7:400:default-tuolumne1220-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851860.980876:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000449 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851860.980878:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11649@kfi7, seq: 2130755
00000400:00000200:9.0:1773851860.980878:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851860.980879:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e027408b : new rpc_count 0
00000100:00000001:11.0:1773851860.980879:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851860.980879:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11649@kfi7: PUT: OK
00000100:00000001:11.0:1773851860.980880:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851860.980880:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:9.0:1773851860.980880:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2b33615
00000400:00000010:9.0:1773851860.980880:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2b33615.
00000020:00000010:11.0:1773851860.980881:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a4701f2.
00000100:00000001:9.0:1773851860.980881:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851860.980882:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006c3ed247.
00000100:00000001:9.0:1773851860.980882:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:11.0:1773851860.980883:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e027408b : new refcount 167
00000100:00000001:11.0:1773851860.980883:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851860.980883:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e73d9225 nid 11649@kfi7 refs 2
00000800:00000200:9.0:1773851860.980884:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 11649@kfi7(0000000027af018a):0x0 lsk 1098 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000449 Transaction freed
00000800:00000200:1.0:1773851860.999375:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851860.999376:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851860.999378:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851860.999381:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851860.999384:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24448@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.999387:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24448@kfi7 : PUT - for me
00000400:00000200:1.0:1773851860.999388:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24448@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.999390:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003cdb556d nid 24448@kfi7 refs 1
00000400:00000200:1.0:1773851860.999391:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24448@kfi7 to cpt 0
00000400:00000200:1.0:1773851860.999392:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003cdb556d nid 24448@kfi7 refs 2
00000400:00000200:1.0:1773851860.999394:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003cdb556d nid 24448@kfi7 refs 3
00000400:00000200:1.0:1773851860.999395:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24449@kfi7 to cpt 3
00000400:00000200:1.0:1773851860.999397:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24449@kfi7 of length 224 into portal 12 MB=0x69b4c658b5240
00000400:00000200:1.0:1773851860.999399:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24449@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 21632
00000800:00000200:1.0:1773851860.999402:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851860.999405:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.999406:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24448@kfi7: PUT: OK
00000100:00000001:1.0:1773851860.999408:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851860.999408:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851860.999410:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009eeff480.
00000100:00000040:1.0:1773851860.999411:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000009eeff480 x1859602283713088 msgsize 224
00000100:00100000:1.0:1773851860.999413:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24449@kfi7 (source: 12345-24448@kfi7)
00000100:00000001:1.0:1773851860.999415:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851860.999416:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003cdb556d nid 24448@kfi7 refs 2
00000100:00000001:0.0:1773851860.999417:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851860.999418:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851860.999418:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851860.999419:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851860.999419:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851860.999421:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851860.999422:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602283713088
00000020:00000001:0.0:1773851860.999423:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851860.999423:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff74f75
00000020:00000001:0.0:1773851860.999424:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851860.999427:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000322336c0 refcount=5
00000020:00000001:0.0:1773851860.999428:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105448986624 : -106968260564992 : ffff9eb682d3a800)
00000020:00000001:0.0:1773851860.999429:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105448986624 : -106968260564992 : ffff9eb682d3a800)
00000100:00000001:0.0:1773851860.999431:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.999432:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851860.999433:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851860.999434:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.999436:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851860.999437:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851860.999437:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851860.999438:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.999440:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851860.999440:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851860.999441:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.999443:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851860.999444:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851860.999445:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851860.999445:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851860.999446:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851860.999447:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24449@kfi7, seq: 1997529
00000100:00000001:1.0:1773851860.999448:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.999448:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000322336c0 : new rpc_count 1
00000100:00000001:1.0:1773851860.999449:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.999450:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856583552 : -106915852968064 : ffff9ec2b6901f80)
00000100:00000040:0.0:1773851860.999451:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009eeff480 x1859602283713088/t0(0) o400->0780dfd1-4e62-4a5d-9f84-d5fda04c9a89@24449@kfi7:500/0 lens 224/0 e 0 to 0 dl 1773852615 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2020-0'
00000100:00000001:0.0:1773851860.999456:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851860.999457:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851860.999458:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eeff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0780dfd1-4e62-4a5d-9f84-d5fda04c9a89+5:39554:x1859602283713088:12345-24449@kfi7:400:default-tuolumne2020-0
00000100:00000200:0.0:1773851860.999460:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602283713088
00000020:00000001:0.0:1773851860.999461:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851860.999462:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851860.999463:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.999464:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851860.999465:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851860.999466:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851860.999467:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602283713088, found 0 last_xid 1859602283713087
00000020:00000001:0.0:1773851860.999469:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851860.999470:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851860.999470:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851860.999471:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.999472:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851860.999473:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851860.999474:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851860.999476:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d4c8ff48.
02000000:00000001:0.0:1773851860.999476:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.999477:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.999479:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851860.999480:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046950541, transno 0, xid 1859602283713088
00010000:00000001:0.0:1773851860.999481:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851860.999482:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009eeff480 x1859602283713088/t0(0) o400->0780dfd1-4e62-4a5d-9f84-d5fda04c9a89@24449@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2020-0'
00010000:00000001:0.0:1773851860.999486:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851860.999487:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851860.999488:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=93 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851860.999491:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851860.999492:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c31bccc6 refcount 3 to 24449@kfi7
00000100:00000001:0.0:1773851860.999493:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902777632 : -107154806773984 : ffff9e8b13ce6720)
02000000:00000001:0.0:1773851860.999495:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851860.999495:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851860.999496:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851860.999498:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24448@kfi7
00000400:00000010:0.0:1773851860.999499:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003e3aad49.
00000100:00000200:0.0:1773851860.999500:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602283713088, offset 224
00000400:00000200:0.0:1773851860.999502:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24448@kfi7
00000400:00000200:0.0:1773851860.999503:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24448@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.999505:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003cdb556d nid 24448@kfi7 refs 1
00000400:00000200:0.0:1773851860.999506:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003cdb556d nid 24448@kfi7 refs 2
00000400:00000200:0.0:1773851860.999508:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003cdb556d nid 24448@kfi7 refs 3
00000400:00000200:0.0:1773851860.999510:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24448@kfi7 local destination
00000400:00000200:0.0:1773851860.999512:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768945:8768945:1024:4294967295] 24448@kfi7 LPNI seq info [8521183:8521183:16:4294967295]
00000400:00000200:0.0:1773851860.999515:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003cdb556d nid 24448@kfi7 refs 2
00000400:00000200:0.0:1773851860.999516:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24448@kfi7 to cpt 0
00000400:00000200:0.0:1773851860.999519:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24448@kfi7(24448@kfi7:24448@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851860.999521:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003cdb556d nid 24448@kfi7 refs 3
00000800:00000200:0.0:1773851860.999523:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851860.999525:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851860.999528:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851860.999532:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000008b9 Using peer 24448@kfi7(0x1000000000008b9)
00000800:00000200:0.0:1773851860.999536:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x1000000000008b9: rc=0
00000800:00000200:0.0:1773851860.999539:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000008b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851860.999542:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851860.999544:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c31bccc6 refcount 2 to 24449@kfi7
00010000:00000001:0.0:1773851860.999545:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851860.999548:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851860.999549:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851860.999550:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009eeff480 x1859602283713088/t0(0) o400->0780dfd1-4e62-4a5d-9f84-d5fda04c9a89@24449@kfi7:500/0 lens 224/224 e 0 to 0 dl 1773852615 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2020-0'
00000100:00100000:0.0:1773851860.999555:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eeff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0780dfd1-4e62-4a5d-9f84-d5fda04c9a89+5:39554:x1859602283713088:12345-24449@kfi7:400:default-tuolumne2020-0 Request processed in 98us (143us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851860.999559:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24449@kfi7, seq: 1997529
00000100:00000040:0.0:1773851860.999560:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000322336c0 : new rpc_count 0
00000100:00000001:0.0:1773851860.999561:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851860.999562:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851860.999563:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851860.999564:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851860.999565:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851860.999566:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000322336c0 : new refcount 4
00000100:00000001:0.0:1773851860.999567:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851860.999575:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000008b9 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851860.999577:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851860.999579:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24448@kfi7: PUT: OK
00000400:00000200:1.0:1773851860.999580:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003e3aad49
00000400:00000010:1.0:1773851860.999581:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003e3aad49.
00000100:00000001:1.0:1773851860.999582:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851860.999583:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851860.999584:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003cdb556d nid 24448@kfi7 refs 2
00000800:00000200:1.0:1773851860.999586:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 24448@kfi7(0000000062606cd8):0x0 lsk 2234 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000008b9 Transaction freed
00000800:00000200:25.0:1773851861.005686:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.005687:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851861.005688:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851861.005689:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.005689:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851861.005691:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.005691:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21680@kfi7(000000002b30baaa):0x2d3 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851861.005692:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 Using peer 21680@kfi7(0x2d3)
00000800:00000200:27.0:1773851861.005693:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.005694:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21680@kfi7 to cpt 6
00000400:00000200:27.0:1773851861.005696:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21680@kfi7 to cpt 6
00000800:00000200:25.0:1773851861.005696:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000055b583f: Posted send of 38 bytes to peer 0x2d3: rc=0
00000400:00000200:27.0:1773851861.005697:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21680@kfi7 : PUT - for me
00000800:00000200:25.0:1773851861.005698:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851861.005699:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21680@kfi7 to cpt 6
00000400:00000200:27.0:1773851861.005700:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056200348 nid 21680@kfi7 refs 1
00000400:00000200:27.0:1773851861.005702:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21680@kfi7 to cpt 6
00000400:00000200:27.0:1773851861.005702:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056200348 nid 21680@kfi7 refs 2
00000400:00000200:27.0:1773851861.005703:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000056200348 nid 21680@kfi7 refs 3
00000400:00000200:27.0:1773851861.005705:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21680@kfi7 to cpt 6
00000400:00000200:27.0:1773851861.005706:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21680@kfi7 of length 336 into portal 17 MB=0x69b0a12c60300
00000400:00000200:27.0:1773851861.005708:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-21680@kfi7 of length 336/336 into md 0x1615af82d9 [2] + 0
00000800:00000200:27.0:1773851861.005710:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851861.005712:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851861.005712:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851861.005713:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21680@kfi7: PUT: OK
00000100:00000001:27.0:1773851861.005714:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851861.005715:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000800:00000200:25.0:1773851861.005715:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 Transaction freed
00000100:00000010:27.0:1773851861.005717:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a6ac42d.
00000100:00000040:27.0:1773851861.005718:0:2464256:0:(events.c:358:request_in_callback()) incoming req@000000008a6ac42d x1859317427208960 msgsize 336
00000100:00100000:27.0:1773851861.005719:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-21680@kfi7 (source: 12345-21680@kfi7)
00000100:00000001:27.0:1773851861.005721:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851861.005722:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000056200348 nid 21680@kfi7 refs 2
00000800:00000200:27.0:1773851861.005724:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851861.005724:0:533719:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851861.005730:0:533719:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851861.005731:0:533719:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851861.005732:0:533719:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851861.005734:0:533719:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851861.005735:0:533719:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317427208960
00000020:00000001:26.0:1773851861.005736:0:533719:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851861.005737:0:533719:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926c0
00000020:00000001:26.0:1773851861.005738:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851861.005742:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074a436c9 refcount=9
00000020:00000001:26.0:1773851861.005744:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631263232 : -107123078288384 : ffff9e9276f8ac00)
00000020:00000001:26.0:1773851861.005745:0:533719:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631263232 : -107123078288384 : ffff9e9276f8ac00)
00000100:00000001:26.0:1773851861.005747:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851861.005748:0:533719:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851861.005750:0:533719:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:26.0:1773851861.005752:0:533719:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851861.005753:0:533719:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000040:26.0:1773851861.005756:0:533719:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:26.0:1773851861.005757:0:533719:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851861.005758:0:533719:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:26.0:1773851861.005759:0:533719:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:26.0:1773851861.005760:0:533719:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005761:0:533719:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:26.0:1773851861.005762:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851861.005763:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851861.005764:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=3
00000020:00000001:26.0:1773851861.005766:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:26.0:1773851861.005768:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:26.0:1773851861.005769:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005770:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005771:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851861.005771:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851861.005773:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000057d4c5f refcount=3
00000020:00000001:26.0:1773851861.005775:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077455024512 : -106996254527104 : ffff9eaffe41b180)
00010000:00000001:26.0:1773851861.005776:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077455024512 : -106996254527104 : ffff9eaffe41b180)
00010000:00000001:26.0:1773851861.005778:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005778:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005779:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851861.005780:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851861.005781:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d2098ccc refcount=3
00000020:00000001:26.0:1773851861.005782:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077455017600 : -106996254534016 : ffff9eaffe419680)
00010000:00000001:26.0:1773851861.005783:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077455017600 : -106996254534016 : ffff9eaffe419680)
00010000:00000001:26.0:1773851861.005784:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005785:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005786:0:533719:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851861.005787:0:533719:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851861.005789:0:533719:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851861.005790:0:533719:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851861.005792:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851861.005793:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851861.005793:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851861.005794:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851861.005794:0:533719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21680@kfi7, seq: 105589643
00000100:00000001:27.0:1773851861.005795:0:184027:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851861.005795:0:533719:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074a436c9 : new rpc_count 1
00000100:00000001:27.0:1773851861.005796:0:184027:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851861.005796:0:533719:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998391680 : -107053711159936 : ffff9ea29d930d80)
00000100:00000040:26.0:1773851861.005797:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a6ac42d x1859317427208960/t0(0) o103->20b688a9-22c8-47aa-ac20-7a66bebd32cd@21680@kfi7:588/0 lens 336/0 e 0 to 0 dl 1773851948 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:26.0:1773851861.005801:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851861.005801:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851861.005802:0:533719:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a6ac42d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:20b688a9-22c8-47aa-ac20-7a66bebd32cd+9:39486:x1859317427208960:12345-21680@kfi7:103:
00000100:00000200:26.0:1773851861.005804:0:533719:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317427208960
00010000:00000001:26.0:1773851861.005805:0:533719:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:26.0:1773851861.005806:0:533719:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:26.0:1773851861.005806:0:533719:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:26.0:1773851861.005808:0:533719:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851861.005809:0:533719:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851861.005809:0:533719:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001b486fec.
02000000:00000001:26.0:1773851861.005810:0:533719:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851861.005812:0:533719:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005813:0:533719:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:26.0:1773851861.005813:0:533719:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00000001:26.0:1773851861.005814:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851861.005814:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851861.005815:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=3
00000020:00000001:26.0:1773851861.005816:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:26.0:1773851861.005817:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000040:26.0:1773851861.005818:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 197
00000004:00000001:26.0:1773851861.005818:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851861.005819:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851861.005820:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851861.005820:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851861.005821:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851861.005822:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005823:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851861.005824:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851861.005825:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005826:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005826:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851861.005827:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851861.005828:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000008ce5b96 with handle 0x21b6f08f07a4d7c1 from hash
00010000:00000001:26.0:1773851861.005829:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851861.005829:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005830:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005830:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851861.005832:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851861.005832:0:533719:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005833:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851861.005834:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851861.005835:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a4d7c1 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 198 type: IBT gid 0 flags: 0x44a01000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc125 expref: 9 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851861.005838:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 197
00010000:00000040:26.0:1773851861.005839:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000074a436c9 : new locks_count 2
00000020:00000040:26.0:1773851861.005840:0:533719:0:(genops.c:882:class_export_put()) PUTting export 0000000074a436c9 : new refcount 8
00010000:00000010:26.0:1773851861.005841:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000006c50efcf.
00010000:00000040:26.0:1773851861.005843:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 196
00010000:00000001:26.0:1773851861.005843:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005844:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851861.005844:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851861.005845:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000057d4c5f refcount=3
00000020:00000001:26.0:1773851861.005845:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077455024512 : -106996254527104 : ffff9eaffe41b180)
00010000:00000001:26.0:1773851861.005846:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077455024512 : -106996254527104 : ffff9eaffe41b180)
00010000:00000001:26.0:1773851861.005847:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851861.005848:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851861.005848:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:26.0:1773851861.005850:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851861.005850:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005851:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851861.005852:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851861.005853:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 232
00000004:00000001:26.0:1773851861.005853:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851861.005854:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851861.005854:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851861.005855:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851861.005855:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851861.005856:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005857:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851861.005858:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851861.005858:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005859:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005859:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851861.005860:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851861.005861:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000057d4c5f with handle 0x21b6f08f07a4d7b3 from hash
00010000:00000001:26.0:1773851861.005862:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851861.005862:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005862:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005863:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851861.005863:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851861.005864:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005865:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851861.005865:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851861.005866:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000057d4c5f/0x21b6f08f07a4d7b3 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 233 type: IBT gid 0 flags: 0x44a01000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0fb expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851861.005869:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 232
00010000:00000040:26.0:1773851861.005870:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000074a436c9 : new locks_count 1
00000020:00000040:26.0:1773851861.005870:0:533719:0:(genops.c:882:class_export_put()) PUTting export 0000000074a436c9 : new refcount 7
00010000:00000010:26.0:1773851861.005871:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000088054b53.
00010000:00000040:26.0:1773851861.005872:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 231
00010000:00000001:26.0:1773851861.005873:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005873:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851861.005873:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851861.005874:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d2098ccc refcount=3
00000020:00000001:26.0:1773851861.005875:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077455017600 : -106996254534016 : ffff9eaffe419680)
00010000:00000001:26.0:1773851861.005875:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077455017600 : -106996254534016 : ffff9eaffe419680)
00010000:00000001:26.0:1773851861.005876:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851861.005877:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851861.005877:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:26.0:1773851861.005878:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851861.005879:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005880:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851861.005880:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00010000:00000040:26.0:1773851861.005881:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 197
00000004:00000001:26.0:1773851861.005882:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851861.005882:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851861.005883:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851861.005883:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851861.005884:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851861.005884:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005886:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851861.005886:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851861.005887:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005887:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005888:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851861.005889:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851861.005890:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d2098ccc with handle 0x21b6f08f07a4d797 from hash
00010000:00000001:26.0:1773851861.005891:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851861.005891:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851861.005892:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005892:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851861.005893:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851861.005893:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005894:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851861.005894:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851861.005895:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d2098ccc/0x21b6f08f07a4d797 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 198 type: IBT gid 0 flags: 0x44a01000000000 nid: 21680@kfi7 remote: 0x2b31c8dfebcbc0f4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851861.005898:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 197
00010000:00000040:26.0:1773851861.005898:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000074a436c9 : new locks_count 0
00000020:00000040:26.0:1773851861.005899:0:533719:0:(genops.c:882:class_export_put()) PUTting export 0000000074a436c9 : new refcount 6
00010000:00000010:26.0:1773851861.005900:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000047743cd7.
00010000:00000040:26.0:1773851861.005900:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851861.005901:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851861.005902:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851861.005902:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851861.005902:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:26.0:1773851861.005903:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851861.005904:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005905:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851861.005905:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:26.0:1773851861.005906:0:533719:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:26.0:1773851861.005907:0:533719:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=3 : 3 : 3)
00010000:00000001:26.0:1773851861.005908:0:533719:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851861.005909:0:533719:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851861.005909:0:533719:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=115 v=66 (1 1 0 1)
00000100:00000001:26.0:1773851861.005911:0:533719:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851861.005911:0:533719:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002a3a9f0b refcount 3 to 21680@kfi7
00000100:00000001:26.0:1773851861.005912:0:533719:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739392 : -107139395812224 : ffff9e8eaa5f0480)
02000000:00000001:26.0:1773851861.005913:0:533719:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851861.005914:0:533719:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851861.005915:0:533719:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851861.005916:0:533719:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21680@kfi7
00000400:00000010:26.0:1773851861.005917:0:533719:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000001d16f21.
00000100:00000200:26.0:1773851861.005918:0:533719:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859317427208960, offset 224
00000400:00000200:26.0:1773851861.005919:0:533719:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21680@kfi7
00000400:00000200:26.0:1773851861.005920:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21680@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.005921:0:533719:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056200348 nid 21680@kfi7 refs 1
00000400:00000200:26.0:1773851861.005922:0:533719:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000056200348 nid 21680@kfi7 refs 2
00000400:00000200:26.0:1773851861.005923:0:533719:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000056200348 nid 21680@kfi7 refs 3
00000400:00000200:26.0:1773851861.005925:0:533719:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21680@kfi7 local destination
00000400:00000200:26.0:1773851861.005926:0:533719:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768946:8768946:1024:4294967295] 21680@kfi7 LPNI seq info [421197:421197:16:4294967295]
00000400:00000200:26.0:1773851861.005927:0:533719:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000056200348 nid 21680@kfi7 refs 2
00000400:00000200:26.0:1773851861.005928:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21680@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.005930:0:533719:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21680@kfi7(21680@kfi7:21680@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851861.005931:0:533719:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000056200348 nid 21680@kfi7 refs 3
00000800:00000200:26.0:1773851861.005933:0:533719:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851861.005934:0:533719:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851861.005936:0:533719:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851861.005938:0:533719:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 Using peer 21680@kfi7(0x2d3)
00000800:00000200:26.0:1773851861.005941:0:533719:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001c682e34: Posted send of 324 bytes to peer 0x2d3: rc=0
00000800:00000200:26.0:1773851861.005942:0:533719:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851861.005944:0:533719:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851861.005945:0:533719:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002a3a9f0b refcount 2 to 21680@kfi7
00010000:00000001:26.0:1773851861.005946:0:533719:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851861.005946:0:533719:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851861.005950:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a6ac42d x1859317427208960/t0(0) o103->20b688a9-22c8-47aa-ac20-7a66bebd32cd@21680@kfi7:588/0 lens 336/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:26.0:1773851861.005953:0:533719:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a6ac42d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:20b688a9-22c8-47aa-ac20-7a66bebd32cd+6:39486:x1859317427208960:12345-21680@kfi7:103: Request processed in 152us (235us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851861.005954:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851861.005956:0:533719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21680@kfi7, seq: 105589643
00000100:00000040:26.0:1773851861.005957:0:533719:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074a436c9 : new rpc_count 0
00000400:00000200:25.0:1773851861.005957:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851861.005958:0:533719:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851861.005958:0:533719:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851861.005958:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21680@kfi7: PUT: OK
00000020:00000010:26.0:1773851861.005959:0:533719:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851861.005959:0:533719:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000400:00000200:25.0:1773851861.005959:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000001d16f21
00000400:00000010:25.0:1773851861.005959:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000001d16f21.
00000020:00000010:26.0:1773851861.005960:0:533719:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000100:00000001:25.0:1773851861.005960:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.005960:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:26.0:1773851861.005961:0:533719:0:(genops.c:882:class_export_put()) PUTting export 0000000074a436c9 : new refcount 5
00000400:00000200:25.0:1773851861.005961:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000056200348 nid 21680@kfi7 refs 2
00000100:00000001:26.0:1773851861.005962:0:533719:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.005963:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 21680@kfi7(000000002b30baaa):0x0 lsk 724 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2d3 Transaction freed
00000800:00000200:29.0:1773851861.006195:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.006196:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.006197:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.006199:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.006201:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17392@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.006202:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17392@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.006203:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17392@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.006204:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006d4e25b5 nid 17392@kfi7 refs 1
00000400:00000200:29.0:1773851861.006205:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17392@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.006206:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006d4e25b5 nid 17392@kfi7 refs 2
00000400:00000200:29.0:1773851861.006207:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006d4e25b5 nid 17392@kfi7 refs 3
00000400:00000200:29.0:1773851861.006208:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17392@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.006209:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17392@kfi7 of length 224 into portal 12 MB=0x69b4b85359840
00000400:00000200:29.0:1773851861.006211:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17392@kfi7 of length 224/224 into md 0x77fe139dd [64] + 168736
00000800:00000200:29.0:1773851861.006213:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.006214:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.006215:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17392@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.006216:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.006217:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.006218:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cb4a8fc1.
00000100:00000040:29.0:1773851861.006218:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000cb4a8fc1 x1859598519998528 msgsize 224
00000100:00100000:29.0:1773851861.006220:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17392@kfi7 (source: 12345-17392@kfi7)
00000100:00000001:29.0:1773851861.006221:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851861.006222:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851861.006222:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006d4e25b5 nid 17392@kfi7 refs 2
02000000:00000001:31.0:1773851861.006223:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851861.006223:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851861.006223:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851861.006224:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.006224:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851861.006225:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598519998528
00000020:00000001:31.0:1773851861.006226:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851861.006226:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82e1c
00000020:00000001:31.0:1773851861.006227:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851861.006230:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c494de7 refcount=170
00000020:00000001:31.0:1773851861.006231:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136641161216 : -106937068390400 : ffff9ebdc6067800)
00000020:00000001:31.0:1773851861.006232:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136641161216 : -106937068390400 : ffff9ebdc6067800)
00000100:00000001:31.0:1773851861.006233:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.006233:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851861.006234:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000546cd5ce.
00000020:00000010:31.0:1773851861.006235:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851861.006236:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851861.006236:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851861.006237:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851861.006237:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.006238:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851861.006238:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851861.006239:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.006240:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.006241:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.006241:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.006241:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.006241:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851861.006242:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17392@kfi7, seq: 2055491
00000100:00000040:31.0:1773851861.006243:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c494de7 : new rpc_count 1
00000100:00000001:31.0:1773851861.006243:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221526784 : -106948488024832 : ffff9ebb1d5cad00)
00000100:00000001:28.0:1773851861.006243:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.006244:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cb4a8fc1 x1859598519998528/t0(0) o400->eb016a4c-4761-44c0-ae51-303c1ec4ee32@17392@kfi7:649/0 lens 224/0 e 0 to 0 dl 1773852009 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1565-0'
00000100:00000001:28.0:1773851861.006244:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.006247:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.006247:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851861.006248:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb4a8fc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:eb016a4c-4761-44c0-ae51-303c1ec4ee32+170:39534:x1859598519998528:12345-17392@kfi7:400:default-tuolumne1565-0
00000100:00000200:31.0:1773851861.006249:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598519998528
00000020:00000001:31.0:1773851861.006250:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851861.006250:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851861.006251:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.006252:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851861.006252:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851861.006253:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851861.006253:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598519998528, found 0 last_xid 1859598519573247
00000020:00000001:31.0:1773851861.006255:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851861.006255:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851861.006256:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851861.006256:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.006257:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851861.006257:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851861.006258:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851861.006259:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000fa543a7.
02000000:00000001:31.0:1773851861.006260:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.006260:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.006261:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851861.006262:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061835, transno 0, xid 1859598519998528
00010000:00000001:31.0:1773851861.006262:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851861.006263:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cb4a8fc1 x1859598519998528/t0(0) o400->eb016a4c-4761-44c0-ae51-303c1ec4ee32@17392@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1565-0'
00010000:00000001:31.0:1773851861.006265:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851861.006266:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851861.006266:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851861.006267:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851861.006268:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000069595514 refcount 3 to 17392@kfi7
00000100:00000001:31.0:1773851861.006268:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603210944 : -107155106340672 : ffff9e8b01f360c0)
02000000:00000001:31.0:1773851861.006269:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851861.006270:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.006270:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851861.006271:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17392@kfi7
00000400:00000010:31.0:1773851861.006271:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007bba7902.
00000100:00000200:31.0:1773851861.006272:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598519998528, offset 224
00000400:00000200:31.0:1773851861.006273:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17392@kfi7
00000400:00000200:31.0:1773851861.006274:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17392@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.006275:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006d4e25b5 nid 17392@kfi7 refs 1
00000400:00000200:31.0:1773851861.006276:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006d4e25b5 nid 17392@kfi7 refs 2
00000400:00000200:31.0:1773851861.006277:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006d4e25b5 nid 17392@kfi7 refs 3
00000400:00000200:31.0:1773851861.006277:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17392@kfi7 local destination
00000400:00000200:31.0:1773851861.006279:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768947:8768947:1024:4294967295] 17392@kfi7 LPNI seq info [8255084:8255084:16:4294967295]
00000400:00000200:31.0:1773851861.006280:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006d4e25b5 nid 17392@kfi7 refs 2
00000400:00000200:31.0:1773851861.006281:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17392@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.006283:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17392@kfi7(17392@kfi7:17392@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851861.006285:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006d4e25b5 nid 17392@kfi7 refs 3
00000800:00000200:31.0:1773851861.006286:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851861.006287:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851861.006289:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851861.006291:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000976 Using peer 17392@kfi7(0x100000000000976)
00000800:00000200:31.0:1773851861.006295:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x100000000000976: rc=0
00000800:00000200:31.0:1773851861.006296:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000976 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851861.006298:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.006299:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000069595514 refcount 2 to 17392@kfi7
00010000:00000001:31.0:1773851861.006299:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851861.006300:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.006301:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851861.006301:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cb4a8fc1 x1859598519998528/t0(0) o400->eb016a4c-4761-44c0-ae51-303c1ec4ee32@17392@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1565-0'
00000100:00100000:31.0:1773851861.006304:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb4a8fc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:eb016a4c-4761-44c0-ae51-303c1ec4ee32+170:39534:x1859598519998528:12345-17392@kfi7:400:default-tuolumne1565-0 Request processed in 57us (85us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851861.006306:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17392@kfi7, seq: 2055491
00000100:00000040:31.0:1773851861.006307:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c494de7 : new rpc_count 0
00000100:00000001:31.0:1773851861.006308:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851861.006308:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851861.006308:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000800:00000200:29.0:1773851861.006308:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000976 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851861.006309:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851861.006310:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000546cd5ce.
00000020:00000040:31.0:1773851861.006311:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000000c494de7 : new refcount 169
00000400:00000200:29.0:1773851861.006311:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851861.006312:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851861.006312:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17392@kfi7: PUT: OK
00000400:00000200:29.0:1773851861.006313:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007bba7902
00000400:00000010:29.0:1773851861.006313:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007bba7902.
00000100:00000001:29.0:1773851861.006314:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.006314:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.006315:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006d4e25b5 nid 17392@kfi7 refs 2
00000800:00000200:29.0:1773851861.006317:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17392@kfi7(00000000b33c86a2):0x0 lsk 2423 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000976 Transaction freed
00000800:00000200:5.0:1773851861.009628:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.009629:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851861.009631:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851861.009633:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851861.009635:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.009636:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851861.009637:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.009638:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851861.009639:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.009640:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851861.009641:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851861.009641:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851861.009642:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c941000
00000400:00000200:5.0:1773851861.009644:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x793844545 [256] + 5616
00000800:00000200:5.0:1773851861.009646:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851861.009647:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851861.009649:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851861.009650:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851861.009651:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851861.009652:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005dbf468a.
00000100:00000040:5.0:1773851861.009653:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000005dbf468a x1858065608740864 msgsize 224
00000100:00100000:5.0:1773851861.009654:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00000100:00000001:5.0:1773851861.009656:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851861.009657:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851861.009658:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851861.009661:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851861.009662:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851861.009662:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851861.009663:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851861.009663:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851861.009664:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608740864
00000020:00000001:5.0:1773851861.009665:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851861.009665:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:5.0:1773851861.009666:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851861.009666:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:5.0:1773851861.009667:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:5.0:1773851861.009668:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:5.0:1773851861.009669:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.009670:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851861.009671:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851861.009672:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.009673:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002ba4d5c1.
00000100:00000040:5.0:1773851861.009674:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851861.009674:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851861.009675:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851861.009675:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.009676:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.009677:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851861.009679:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851861.009679:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851861.009679:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851861.009679:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851861.009681:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314076
00000100:00000040:6.0:1773851861.009682:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:6.0:1773851861.009682:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866954880 : -107088842596736 : ffff9e9a6f93de80)
00000100:00000001:5.0:1773851861.009682:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.009682:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851861.009684:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005dbf468a x1858065608740864/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:6.0:1773851861.009686:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851861.009687:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851861.009688:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005dbf468a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065608740864:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:6.0:1773851861.009689:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608740864
00000020:00000001:6.0:1773851861.009690:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851861.009691:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851861.009691:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851861.009692:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851861.009692:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851861.009693:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851861.009694:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851861.009695:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851861.009695:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851861.009696:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.009696:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851861.009697:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851861.009698:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000002f134385.
02000000:00000001:6.0:1773851861.009699:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.009699:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851861.009701:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851861.009702:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851861.009702:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851861.009703:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851861.009704:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851861.009706:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851861.009707:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608740864
00010000:00000001:6.0:1773851861.009708:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851861.009709:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005dbf468a x1858065608740864/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:588/0 lens 224/368 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:6.0:1773851861.009712:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851861.009712:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851861.009713:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=90 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851861.009714:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851861.009715:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:6.0:1773851861.009716:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:6.0:1773851861.009717:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851861.009718:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.009718:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851861.009719:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000400:00000010:6.0:1773851861.009720:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000183eed5a.
00000100:00000200:6.0:1773851861.009721:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608740864, offset 224
00000400:00000200:6.0:1773851861.009722:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000400:00000200:6.0:1773851861.009723:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.009724:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:6.0:1773851861.009729:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851861.009731:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:6.0:1773851861.009732:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  30@kfi7 local destination
00000400:00000200:6.0:1773851861.009734:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768948:8768948:1024:4294967295] 30@kfi7 LPNI seq info [23133313:23133313:16:4294967295]
00000400:00000200:6.0:1773851861.009736:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851861.009737:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.009739:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851861.009740:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000800:00000200:6.0:1773851861.009742:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851861.009743:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851861.009745:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851861.009749:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 Using peer 30@kfi7(0xa16)
00000800:00000200:6.0:1773851861.009752:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 468 bytes to peer 0xa16: rc=0
00000800:00000200:6.0:1773851861.009753:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851861.009755:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851861.009756:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:6.0:1773851861.009757:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851861.009758:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851861.009758:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851861.009759:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005dbf468a x1858065608740864/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:588/0 lens 224/368 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:6.0:1773851861.009762:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005dbf468a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065608740864:12345-13@kfi7:41:default-yuba3-0 Request processed in 75us (108us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851861.009765:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314076
00000100:00000040:6.0:1773851861.009766:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000800:00000200:5.0:1773851861.009766:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851861.009767:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851861.009767:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851861.009768:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:5.0:1773851861.009768:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:6.0:1773851861.009769:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002ba4d5c1.
00000400:00000200:5.0:1773851861.009769:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000400:00000200:5.0:1773851861.009769:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000183eed5a
00000020:00000010:6.0:1773851861.009770:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:6.0:1773851861.009770:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000400:00000010:5.0:1773851861.009770:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000183eed5a.
00000100:00000001:6.0:1773851861.009771:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.009771:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851861.009771:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851861.009772:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851861.009774:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 Transaction freed
00010000:00000010:26.1:1773851861.011727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000008ce5b96.
00010000:00000010:26.1:1773851861.011729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000057d4c5f.
00010000:00000010:26.1:1773851861.011729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d2098ccc.
00000800:00000200:5.0:1773851861.014218:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.014219:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851861.014220:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851861.014222:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851861.014224:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13586@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.014225:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13586@kfi7 : PUT - for me
00000400:00000200:5.0:1773851861.014225:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13586@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.014226:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cd7a32a nid 13586@kfi7 refs 1
00000400:00000200:5.0:1773851861.014227:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13586@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.014228:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cd7a32a nid 13586@kfi7 refs 2
00000400:00000200:5.0:1773851861.014228:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001cd7a32a nid 13586@kfi7 refs 3
00000400:00000200:5.0:1773851861.014229:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13778@kfi7 to cpt 3
00000400:00000200:5.0:1773851861.014230:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13778@kfi7 of length 224 into portal 12 MB=0x69b4b985c3680
00000400:00000200:5.0:1773851861.014231:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13778@kfi7 of length 224/224 into md 0x793926dc5 [64] + 128952
00000800:00000200:5.0:1773851861.014233:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851861.014234:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851861.014236:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13586@kfi7: PUT: OK
00000100:00000001:5.0:1773851861.014236:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851861.014237:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851861.014238:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dbb3703a.
00000100:00000040:5.0:1773851861.014238:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000dbb3703a x1859598841296512 msgsize 224
00000100:00100000:5.0:1773851861.014239:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13778@kfi7 (source: 12345-13586@kfi7)
00000100:00000001:5.0:1773851861.014241:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851861.014242:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001cd7a32a nid 13586@kfi7 refs 2
00000800:00000200:5.0:1773851861.014243:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851861.014246:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851861.014246:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851861.014246:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851861.014247:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851861.014247:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851861.014248:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598841296512
00000020:00000001:5.0:1773851861.014248:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851861.014249:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f551
00000020:00000001:5.0:1773851861.014249:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851861.014252:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e994c9cf refcount=166
00000020:00000001:5.0:1773851861.014252:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636997385465856 : -107076324085760 : ffff9e9d59bd3000)
00000020:00000001:5.0:1773851861.014253:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636997385465856 : -107076324085760 : ffff9e9d59bd3000)
00000100:00000001:5.0:1773851861.014254:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.014254:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851861.014255:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851861.014256:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.014256:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006f259d27.
00000100:00000001:5.0:1773851861.014257:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851861.014257:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851861.014258:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.014259:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851861.014259:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851861.014260:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.014260:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.014261:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851861.014262:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851861.014263:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:5.0:1773851861.014263:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13778@kfi7, seq: 2001889
00000100:00000001:7.0:1773851861.014264:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:5.0:1773851861.014264:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e994c9cf : new rpc_count 1
00000100:00000001:7.0:1773851861.014265:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.014265:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866932992 : -107088842618624 : ffff9e9a6f938900)
00000100:00000001:7.0:1773851861.014266:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851861.014266:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dbb3703a x1859598841296512/t0(0) o400->0f63a077-19b5-4018-85bf-1c860301b215@13778@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1349-0'
00000100:00000001:5.0:1773851861.014268:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.014269:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851861.014269:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbb3703a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:0f63a077-19b5-4018-85bf-1c860301b215+166:39574:x1859598841296512:12345-13778@kfi7:400:default-tuolumne1349-0
00000100:00000200:5.0:1773851861.014271:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598841296512
00000020:00000001:5.0:1773851861.014271:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851861.014272:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851861.014272:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.014273:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851861.014273:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851861.014274:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851861.014275:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598841296512, found 0 last_xid 1859598840873087
00000020:00000001:5.0:1773851861.014276:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851861.014276:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851861.014277:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851861.014277:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.014278:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851861.014278:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851861.014279:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851861.014280:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f9afcebb.
02000000:00000001:5.0:1773851861.014280:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.014281:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.014282:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851861.014282:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063196, transno 0, xid 1859598841296512
00010000:00000001:5.0:1773851861.014283:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851861.014284:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dbb3703a x1859598841296512/t0(0) o400->0f63a077-19b5-4018-85bf-1c860301b215@13778@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1349-0'
00010000:00000001:5.0:1773851861.014286:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851861.014287:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851861.014288:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=93 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851861.014289:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851861.014289:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000009526ca2 refcount 3 to 13778@kfi7
00000100:00000001:5.0:1773851861.014290:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902776672 : -107154806774944 : ffff9e8b13ce6360)
02000000:00000001:5.0:1773851861.014291:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851861.014291:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.014292:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851861.014292:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13586@kfi7
00000400:00000010:5.0:1773851861.014293:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001f116a32.
00000100:00000200:5.0:1773851861.014293:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598841296512, offset 224
00000400:00000200:5.0:1773851861.014295:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13586@kfi7
00000400:00000200:5.0:1773851861.014295:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13586@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.014296:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cd7a32a nid 13586@kfi7 refs 1
00000400:00000200:5.0:1773851861.014297:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001cd7a32a nid 13586@kfi7 refs 2
00000400:00000200:5.0:1773851861.014298:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001cd7a32a nid 13586@kfi7 refs 3
00000400:00000200:5.0:1773851861.014299:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13586@kfi7 local destination
00000400:00000200:5.0:1773851861.014300:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768949:8768949:1024:4294967295] 13586@kfi7 LPNI seq info [10550893:10550893:16:4294967295]
00000400:00000200:5.0:1773851861.014302:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001cd7a32a nid 13586@kfi7 refs 2
00000400:00000200:5.0:1773851861.014302:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13586@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.014304:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13586@kfi7(13586@kfi7:13586@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851861.014305:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001cd7a32a nid 13586@kfi7 refs 3
00000800:00000200:5.0:1773851861.014306:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.014307:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851861.014309:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851861.014311:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d1a Using peer 13586@kfi7(0x100000000000d1a)
00000800:00000200:5.0:1773851861.014314:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x100000000000d1a: rc=0
00000800:00000200:5.0:1773851861.014315:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d1a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851861.014317:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851861.014319:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000009526ca2 refcount 2 to 13778@kfi7
00010000:00000001:5.0:1773851861.014319:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851861.014320:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.014320:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851861.014321:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dbb3703a x1859598841296512/t0(0) o400->0f63a077-19b5-4018-85bf-1c860301b215@13778@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1349-0'
00000100:00100000:5.0:1773851861.014324:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbb3703a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:0f63a077-19b5-4018-85bf-1c860301b215+166:39574:x1859598841296512:12345-13778@kfi7:400:default-tuolumne1349-0 Request processed in 55us (85us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851861.014326:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13778@kfi7, seq: 2001889
00000100:00000040:5.0:1773851861.014327:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e994c9cf : new rpc_count 0
00000100:00000001:5.0:1773851861.014327:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851861.014328:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851861.014328:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.014329:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006f259d27.
00000020:00000010:5.0:1773851861.014329:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:5.0:1773851861.014330:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e994c9cf : new refcount 165
00000100:00000001:5.0:1773851861.014330:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851861.014331:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d1a TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851861.014334:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851861.014336:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13586@kfi7: PUT: OK
00000400:00000200:6.0:1773851861.014337:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001f116a32
00000400:00000010:6.0:1773851861.014338:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001f116a32.
00000100:00000001:6.0:1773851861.014339:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851861.014340:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851861.014342:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001cd7a32a nid 13586@kfi7 refs 2
00000800:00000200:6.0:1773851861.014344:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 13586@kfi7(000000002dba56d1):0x0 lsk 3355 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d1a Transaction freed
00000800:00000200:21.0:1773851861.026247:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851861.026247:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851861.026248:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851861.026249:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851861.026249:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851861.026250:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19554@kfi7(000000006ef31aac):0x565 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851861.026252:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851861.026252:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 Using peer 19554@kfi7(0x565)
00000400:00000200:21.0:1773851861.026254:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19554@kfi7 to cpt 5
00000800:00000200:21.0:1773851861.026256:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000184df75a: Posted send of 38 bytes to peer 0x565: rc=0
00000800:00000200:22.0:1773851861.026257:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851861.026258:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851861.026260:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19554@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.026263:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19554@kfi7 : PUT - for me
00000400:00000200:22.0:1773851861.026265:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19554@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.026267:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073b3d156 nid 19554@kfi7 refs 1
00000400:00000200:22.0:1773851861.026269:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19554@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.026270:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073b3d156 nid 19554@kfi7 refs 2
00000800:00000200:21.0:1773851861.026271:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851861.026272:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000073b3d156 nid 19554@kfi7 refs 3
00000400:00000200:22.0:1773851861.026273:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19555@kfi7 to cpt 0
00000800:00000200:21.0:1773851861.026273:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 Transaction freed
00000400:00000200:22.0:1773851861.026275:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19555@kfi7 of length 224 into portal 12 MB=0x69b4b911ccb80
00000400:00000200:22.0:1773851861.026278:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19555@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 30792
00000800:00000200:22.0:1773851861.026282:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851861.026285:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851861.026287:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19554@kfi7: PUT: OK
00000100:00000001:22.0:1773851861.026288:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851861.026289:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851861.026291:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8ecce89.
00000100:00000040:22.0:1773851861.026292:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000e8ecce89 x1859598719699840 msgsize 224
00000100:00100000:22.0:1773851861.026295:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-19555@kfi7 (source: 12345-19554@kfi7)
00000100:00000001:22.0:1773851861.026297:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851861.026298:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000073b3d156 nid 19554@kfi7 refs 2
00000100:00000001:23.0:1773851861.026299:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851861.026300:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851861.026301:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:22.0:1773851861.026301:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851861.026302:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851861.026303:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851861.026304:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598719699840
00000020:00000001:23.0:1773851861.026305:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851861.026306:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e243835ac
00000020:00000001:23.0:1773851861.026306:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851861.026311:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dcf0a4ac refcount=5
00000020:00000001:23.0:1773851861.026312:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132746079232 : -106940963472384 : ffff9ebcdddc3c00)
00000020:00000001:23.0:1773851861.026314:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132746079232 : -106940963472384 : ffff9ebcdddc3c00)
00000100:00000001:23.0:1773851861.026315:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.026316:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851861.026317:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094554af3.
00000020:00000010:23.0:1773851861.026319:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851861.026324:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851861.026325:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851861.026326:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851861.026327:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.026328:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851861.026329:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851861.026330:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.026331:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.026333:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851861.026334:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851861.026334:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851861.026334:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851861.026335:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19555@kfi7, seq: 1997953
00000100:00000040:23.0:1773851861.026337:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dcf0a4ac : new rpc_count 1
00000100:00000001:22.0:1773851861.026337:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.026338:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619623168 : -107003089928448 : ffff9eae66d5bf00)
00000100:00000001:22.0:1773851861.026338:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.026340:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e8ecce89 x1859598719699840/t0(0) o400->b233655e-74dd-411a-ba81-a1486b8e4fc7@19555@kfi7:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1708-0'
00000100:00000001:23.0:1773851861.026345:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.026345:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851861.026347:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8ecce89 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b233655e-74dd-411a-ba81-a1486b8e4fc7+5:39699:x1859598719699840:12345-19555@kfi7:400:default-tuolumne1708-0
00000100:00000200:23.0:1773851861.026349:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598719699840
00000020:00000001:23.0:1773851861.026350:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851861.026351:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851861.026352:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.026353:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851861.026354:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851861.026355:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851861.026356:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598719699840, found 0 last_xid 1859598719699839
00000020:00000001:23.0:1773851861.026358:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851861.026359:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851861.026360:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851861.026360:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.026361:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851861.026362:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851861.026363:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851861.026365:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009049da9c.
02000000:00000001:23.0:1773851861.026366:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.026367:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.026368:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851861.026369:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096697071, transno 0, xid 1859598719699840
00010000:00000001:23.0:1773851861.026370:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851861.026372:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e8ecce89 x1859598719699840/t0(0) o400->b233655e-74dd-411a-ba81-a1486b8e4fc7@19555@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1708-0'
00010000:00000001:23.0:1773851861.026376:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851861.026377:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851861.026378:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=94 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851861.026380:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851861.026381:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000012c00ae6 refcount 3 to 19555@kfi7
00000100:00000001:23.0:1773851861.026382:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530571072 : -107154178980544 : ffff9e8b3939c540)
02000000:00000001:23.0:1773851861.026384:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851861.026385:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.026386:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851861.026387:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19554@kfi7
00000400:00000010:23.0:1773851861.026388:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a16c98de.
00000100:00000200:23.0:1773851861.026389:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598719699840, offset 224
00000400:00000200:23.0:1773851861.026391:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19554@kfi7
00000400:00000200:23.0:1773851861.026392:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19554@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.026394:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073b3d156 nid 19554@kfi7 refs 1
00000400:00000200:23.0:1773851861.026396:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000073b3d156 nid 19554@kfi7 refs 2
00000400:00000200:23.0:1773851861.026398:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000073b3d156 nid 19554@kfi7 refs 3
00000400:00000200:23.0:1773851861.026400:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19554@kfi7 local destination
00000400:00000200:23.0:1773851861.026402:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768950:8768950:1024:4294967295] 19554@kfi7 LPNI seq info [9915337:9915337:16:4294967295]
00000400:00000200:23.0:1773851861.026404:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000073b3d156 nid 19554@kfi7 refs 2
00000400:00000200:23.0:1773851861.026405:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19554@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.026409:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19554@kfi7(19554@kfi7:19554@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851861.026411:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000073b3d156 nid 19554@kfi7 refs 3
00000800:00000200:23.0:1773851861.026413:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851861.026415:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851861.026419:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851861.026423:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 Using peer 19554@kfi7(0x565)
00000800:00000200:23.0:1773851861.026427:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x565: rc=0
00000800:00000200:23.0:1773851861.026430:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851861.026433:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.026434:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000012c00ae6 refcount 2 to 19555@kfi7
00010000:00000001:23.0:1773851861.026436:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851861.026437:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.026438:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851861.026439:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8ecce89 x1859598719699840/t0(0) o400->b233655e-74dd-411a-ba81-a1486b8e4fc7@19555@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1708-0'
00000800:00000200:21.0:1773851861.026440:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851861.026441:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851861.026442:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19554@kfi7: PUT: OK
00000400:00000200:21.0:1773851861.026443:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a16c98de
00000100:00100000:23.0:1773851861.026444:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8ecce89 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b233655e-74dd-411a-ba81-a1486b8e4fc7+5:39699:x1859598719699840:12345-19555@kfi7:400:default-tuolumne1708-0 Request processed in 98us (151us total) trans 0 rc 0/0
00000400:00000010:21.0:1773851861.026446:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a16c98de.
00000100:00000001:21.0:1773851861.026447:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851861.026447:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:23.0:1773851861.026448:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19555@kfi7, seq: 1997953
00000400:00000200:21.0:1773851861.026448:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000073b3d156 nid 19554@kfi7 refs 2
00000100:00000040:23.0:1773851861.026449:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dcf0a4ac : new rpc_count 0
00000800:00000200:21.0:1773851861.026449:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 19554@kfi7(000000006ef31aac):0x0 lsk 1382 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x565 Transaction freed
00000100:00000001:23.0:1773851861.026450:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851861.026451:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851861.026452:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851861.026453:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851861.026454:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094554af3.
00000020:00000040:23.0:1773851861.026456:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000dcf0a4ac : new refcount 4
00000100:00000001:23.0:1773851861.026457:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851861.067136:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851861.067137:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851861.067138:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851861.067140:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851861.067142:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16403@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.067143:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16403@kfi7 : PUT - for me
00000400:00000200:6.0:1773851861.067144:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16403@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.067145:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007564c425 nid 16403@kfi7 refs 1
00000400:00000200:6.0:1773851861.067146:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16403@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.067147:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007564c425 nid 16403@kfi7 refs 2
00000400:00000200:6.0:1773851861.067148:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007564c425 nid 16403@kfi7 refs 3
00000400:00000200:6.0:1773851861.067148:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16594@kfi7 to cpt 0
00000400:00000200:6.0:1773851861.067149:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16594@kfi7 of length 224 into portal 12 MB=0x69b4b59b5fb00
00000400:00000200:6.0:1773851861.067151:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16594@kfi7 of length 224/224 into md 0x793926dc5 [64] + 129176
00000800:00000200:6.0:1773851861.067153:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851861.067154:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851861.067155:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16403@kfi7: PUT: OK
00000100:00000001:6.0:1773851861.067156:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851861.067156:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851861.067157:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000010c7391.
00000100:00000040:6.0:1773851861.067158:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000010c7391 x1859597790214912 msgsize 224
00000100:00100000:6.0:1773851861.067159:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-16594@kfi7 (source: 12345-16403@kfi7)
00000100:00000001:6.0:1773851861.067161:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851861.067162:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007564c425 nid 16403@kfi7 refs 2
00000800:00000200:6.0:1773851861.067163:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851861.067163:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851861.067164:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851861.067165:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851861.067166:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851861.067167:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851861.067168:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597790214912
00000020:00000001:5.0:1773851861.067169:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851861.067170:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822d8
00000020:00000001:5.0:1773851861.067171:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851861.067174:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000db47bf79 refcount=168
00000020:00000001:5.0:1773851861.067175:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157028235264 : -106916681316352 : ffff9ec285308800)
00000020:00000001:5.0:1773851861.067177:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157028235264 : -106916681316352 : ffff9ec285308800)
00000100:00000001:5.0:1773851861.067178:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.067180:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851861.067181:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851861.067182:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.067184:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006f259d27.
00000100:00000001:5.0:1773851861.067185:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851861.067186:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851861.067187:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.067188:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851861.067189:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851861.067190:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.067191:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851861.067193:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851861.067193:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851861.067194:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851861.067194:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851861.067195:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16594@kfi7, seq: 2001890
00000100:00000040:5.0:1773851861.067196:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000db47bf79 : new rpc_count 1
00000100:00000001:7.0:1773851861.067197:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851861.067198:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.067198:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637012926960128 : -107060782591488 : ffff9ea0f8159200)
00000100:00000040:5.0:1773851861.067199:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000010c7391 x1859597790214912/t0(0) o400->6bdafd76-87f0-4676-a5f9-ca6aa86286d8@16594@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1525-0'
00000100:00000001:5.0:1773851861.067204:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.067204:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851861.067206:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000010c7391 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6bdafd76-87f0-4676-a5f9-ca6aa86286d8+168:39576:x1859597790214912:12345-16594@kfi7:400:default-tuolumne1525-0
00000100:00000200:5.0:1773851861.067208:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597790214912
00000020:00000001:5.0:1773851861.067209:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851861.067210:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851861.067211:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.067212:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851861.067213:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851861.067214:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851861.067215:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597790214912, found 0 last_xid 1859597789794431
00000020:00000001:5.0:1773851861.067217:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851861.067218:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851861.067218:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851861.067219:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.067221:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851861.067222:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851861.067222:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851861.067224:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009ed0a171.
02000000:00000001:5.0:1773851861.067225:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.067226:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.067227:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851861.067228:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062540, transno 0, xid 1859597790214912
00010000:00000001:5.0:1773851861.067229:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851861.067231:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000010c7391 x1859597790214912/t0(0) o400->6bdafd76-87f0-4676-a5f9-ca6aa86286d8@16594@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1525-0'
00010000:00000001:5.0:1773851861.067235:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851861.067236:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851861.067237:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=93 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851861.067239:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851861.067240:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000038424cae refcount 3 to 16594@kfi7
00000100:00000001:5.0:1773851861.067241:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052928 : -107154804498688 : ffff9e8b13f11f00)
02000000:00000001:5.0:1773851861.067242:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851861.067243:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.067244:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851861.067245:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16403@kfi7
00000400:00000010:5.0:1773851861.067246:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000401e06b4.
00000100:00000200:5.0:1773851861.067247:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597790214912, offset 224
00000400:00000200:5.0:1773851861.067249:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16403@kfi7
00000400:00000200:5.0:1773851861.067251:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16403@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.067252:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007564c425 nid 16403@kfi7 refs 1
00000400:00000200:5.0:1773851861.067253:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007564c425 nid 16403@kfi7 refs 2
00000400:00000200:5.0:1773851861.067255:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007564c425 nid 16403@kfi7 refs 3
00000400:00000200:5.0:1773851861.067257:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16403@kfi7 local destination
00000400:00000200:5.0:1773851861.067259:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768951:8768951:1024:4294967295] 16403@kfi7 LPNI seq info [549957:549957:16:4294967295]
00000400:00000200:5.0:1773851861.067262:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007564c425 nid 16403@kfi7 refs 2
00000400:00000200:5.0:1773851861.067263:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16403@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.067266:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16403@kfi7(16403@kfi7:16403@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851861.067269:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007564c425 nid 16403@kfi7 refs 3
00000800:00000200:5.0:1773851861.067271:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.067273:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851861.067276:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851861.067280:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x112 Using peer 16403@kfi7(0x112)
00000800:00000200:5.0:1773851861.067284:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 324 bytes to peer 0x112: rc=0
00000800:00000200:5.0:1773851861.067287:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x112 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851861.067290:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851861.067291:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000038424cae refcount 2 to 16594@kfi7
00010000:00000001:5.0:1773851861.067293:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851861.067294:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.067295:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851861.067296:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000010c7391 x1859597790214912/t0(0) o400->6bdafd76-87f0-4676-a5f9-ca6aa86286d8@16594@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1525-0'
00000800:00000200:6.0:1773851861.067298:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x112 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851861.067300:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851861.067301:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16403@kfi7: PUT: OK
00000100:00100000:5.0:1773851861.067301:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000010c7391 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6bdafd76-87f0-4676-a5f9-ca6aa86286d8+168:39576:x1859597790214912:12345-16594@kfi7:400:default-tuolumne1525-0 Request processed in 96us (142us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851861.067302:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000401e06b4
00000400:00000010:6.0:1773851861.067302:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000401e06b4.
00000100:00000001:6.0:1773851861.067303:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851861.067303:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851861.067304:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007564c425 nid 16403@kfi7 refs 2
00000800:00000200:6.0:1773851861.067305:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 16403@kfi7(00000000dcfee060):0x0 lsk 275 rsk 28 tsk 0 trmk 0 tmk 0 trr 1 tta 0x112 Transaction freed
00000100:00100000:5.0:1773851861.067305:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16594@kfi7, seq: 2001890
00000100:00000040:5.0:1773851861.067306:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000db47bf79 : new rpc_count 0
00000100:00000001:5.0:1773851861.067307:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851861.067308:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851861.067309:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.067310:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006f259d27.
00000020:00000010:5.0:1773851861.067312:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:5.0:1773851861.067313:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000db47bf79 : new refcount 167
00000100:00000001:5.0:1773851861.067314:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.101234:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851861.101236:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.101236:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:1.0:1773851861.101238:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:3.0:1773851861.101239:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851861.101242:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.101245:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17170@kfi7(0000000027ea9b23):0x71e version: 2; local version 2; negotiated version: 2
00000800:00000200:3.0:1773851861.101248:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851861.101248:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e Using peer 17170@kfi7(0x71e)
00000400:00000200:1.0:1773851861.101252:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17170@kfi7 to cpt 0
00000400:00000200:3.0:1773851861.101254:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17170@kfi7 to cpt 0
00000800:00000200:1.0:1773851861.101255:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 38 bytes to peer 0x71e: rc=0
00000400:00000200:3.0:1773851861.101256:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17170@kfi7 : PUT - for me
00000800:00000200:1.0:1773851861.101258:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:3.0:1773851861.101259:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17170@kfi7 to cpt 0
00000400:00000200:3.0:1773851861.101261:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002622201f nid 17170@kfi7 refs 1
00000400:00000200:3.0:1773851861.101264:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17170@kfi7 to cpt 0
00000400:00000200:3.0:1773851861.101266:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002622201f nid 17170@kfi7 refs 2
00000400:00000200:3.0:1773851861.101268:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002622201f nid 17170@kfi7 refs 3
00000400:00000200:3.0:1773851861.101270:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17171@kfi7 to cpt 4
00000400:00000200:3.0:1773851861.101272:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17171@kfi7 of length 224 into portal 12 MB=0x69b4b5cf31600
00000800:00000200:1.0:1773851861.101273:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e TN_EVENT_TX_OK event status 0
00000400:00000200:3.0:1773851861.101275:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17171@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 21856
00000800:00000200:1.0:1773851861.101278:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e Transaction freed
00000800:00000200:3.0:1773851861.101280:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851861.101283:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851861.101286:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17170@kfi7: PUT: OK
00000100:00000001:3.0:1773851861.101289:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851861.101290:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851861.101291:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa31d3c5.
00000100:00000040:3.0:1773851861.101293:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000aa31d3c5 x1859597844551168 msgsize 224
00000100:00100000:3.0:1773851861.101296:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-17171@kfi7 (source: 12345-17170@kfi7)
00000100:00000001:3.0:1773851861.101299:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851861.101301:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002622201f nid 17170@kfi7 refs 2
00000100:00000001:0.0:1773851861.101301:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.101302:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.101303:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:3.0:1773851861.101304:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b5c1c28f: 2069@kfi7:0 <- 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.101304:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.101305:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.101307:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597844551168
00000020:00000001:0.0:1773851861.101308:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.101309:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81fa5
00000020:00000001:0.0:1773851861.101310:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.101312:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a3057c2c refcount=168
00000020:00000001:0.0:1773851861.101313:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637149806695424 : -106923902856192 : ffff9ec0d6c09400)
00000020:00000001:0.0:1773851861.101315:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637149806695424 : -106923902856192 : ffff9ec0d6c09400)
00000100:00000001:0.0:1773851861.101317:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.101319:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.101320:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe7fef92.
00000020:00000010:0.0:1773851861.101322:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.101324:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.101326:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.101326:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.101327:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.101329:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.101330:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.101330:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.101332:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851861.101334:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.101334:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.101334:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.101335:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.101336:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17171@kfi7, seq: 1997530
00000100:00000001:1.0:1773851861.101337:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.101337:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a3057c2c : new rpc_count 1
00000100:00000001:1.0:1773851861.101338:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.101338:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288717440 : -106964420834176 : ffff9eb767b14c80)
00000100:00000040:0.0:1773851861.101340:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa31d3c5 x1859597844551168/t0(0) o400->1ee42e26-cf39-4035-85e6-737f17a400c4@17171@kfi7:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1573-0'
00000100:00000001:0.0:1773851861.101343:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.101344:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.101345:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa31d3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:1ee42e26-cf39-4035-85e6-737f17a400c4+168:39665:x1859597844551168:12345-17171@kfi7:400:default-tuolumne1573-0
00000100:00000200:0.0:1773851861.101347:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597844551168
00000020:00000001:0.0:1773851861.101348:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.101348:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.101349:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.101350:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.101350:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.101351:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.101352:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597844551168, found 0 last_xid 1859597844125695
00000020:00000001:0.0:1773851861.101353:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.101354:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.101354:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.101355:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.101355:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.101356:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.101357:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.101359:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c2377fb9.
02000000:00000001:0.0:1773851861.101359:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.101360:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.101361:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.101361:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063505, transno 0, xid 1859597844551168
00010000:00000001:0.0:1773851861.101362:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.101363:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa31d3c5 x1859597844551168/t0(0) o400->1ee42e26-cf39-4035-85e6-737f17a400c4@17171@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1573-0'
00010000:00000001:0.0:1773851861.101366:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.101367:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.101367:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.101369:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.101369:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006fdabea8 refcount 3 to 17171@kfi7
00000100:00000001:0.0:1773851861.101370:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583951264 : -107156125600352 : ffff9e8ac532b5a0)
02000000:00000001:0.0:1773851861.101371:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.101372:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.101372:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.101373:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17170@kfi7
00000400:00000010:0.0:1773851861.101374:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050d1fed3.
00000100:00000200:0.0:1773851861.101375:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597844551168, offset 224
00000400:00000200:0.0:1773851861.101377:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17170@kfi7
00000400:00000200:0.0:1773851861.101377:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17170@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.101378:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002622201f nid 17170@kfi7 refs 1
00000400:00000200:0.0:1773851861.101380:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002622201f nid 17170@kfi7 refs 2
00000400:00000200:0.0:1773851861.101381:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002622201f nid 17170@kfi7 refs 3
00000400:00000200:0.0:1773851861.101382:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17170@kfi7 local destination
00000400:00000200:0.0:1773851861.101384:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768952:8768952:1024:4294967295] 17170@kfi7 LPNI seq info [153967:153967:16:4294967295]
00000400:00000200:0.0:1773851861.101386:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002622201f nid 17170@kfi7 refs 2
00000400:00000200:0.0:1773851861.101387:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17170@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.101389:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17170@kfi7(17170@kfi7:17170@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.101391:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002622201f nid 17170@kfi7 refs 3
00000800:00000200:0.0:1773851861.101392:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.101394:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.101397:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.101399:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e Using peer 17170@kfi7(0x71e)
00000800:00000200:0.0:1773851861.101402:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x71e: rc=0
00000800:00000200:0.0:1773851861.101404:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.101406:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.101407:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006fdabea8 refcount 2 to 17171@kfi7
00010000:00000001:0.0:1773851861.101408:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.101409:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.101409:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.101410:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa31d3c5 x1859597844551168/t0(0) o400->1ee42e26-cf39-4035-85e6-737f17a400c4@17171@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1573-0'
00000100:00100000:0.0:1773851861.101415:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa31d3c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:1ee42e26-cf39-4035-85e6-737f17a400c4+168:39665:x1859597844551168:12345-17171@kfi7:400:default-tuolumne1573-0 Request processed in 71us (122us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.101418:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17171@kfi7, seq: 1997530
00000100:00000040:0.0:1773851861.101419:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a3057c2c : new rpc_count 0
00000100:00000001:0.0:1773851861.101419:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.101420:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.101421:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.101422:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.101423:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe7fef92.
00000020:00000040:0.0:1773851861.101424:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000a3057c2c : new refcount 167
00000100:00000001:0.0:1773851861.101424:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.101430:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.101431:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.101432:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17170@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.101433:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050d1fed3
00000400:00000010:1.0:1773851861.101434:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050d1fed3.
00000100:00000001:1.0:1773851861.101435:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.101435:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.101436:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002622201f nid 17170@kfi7 refs 2
00000800:00000200:1.0:1773851861.101438:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 17170@kfi7(0000000027ea9b23):0x0 lsk 1823 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x71e Transaction freed
00000800:00000200:13.0:1773851861.115229:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.115230:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.115233:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.115236:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.115240:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16113@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.115242:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16113@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.115243:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16113@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.115245:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000410b16f2 nid 16113@kfi7 refs 1
00000400:00000200:13.0:1773851861.115246:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16113@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.115247:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000410b16f2 nid 16113@kfi7 refs 2
00000400:00000200:13.0:1773851861.115249:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000410b16f2 nid 16113@kfi7 refs 3
00000400:00000200:13.0:1773851861.115250:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15921@kfi7 to cpt 0
00000400:00000200:13.0:1773851861.115252:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15921@kfi7 of length 224 into portal 12 MB=0x69b4b578593c0
00000400:00000200:13.0:1773851861.115254:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15921@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 22856
00000800:00000200:13.0:1773851861.115257:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851861.115260:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.115262:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16113@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.115263:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851861.115264:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851861.115265:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b1b0530f.
00000100:00000040:13.0:1773851861.115267:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000b1b0530f x1859597753488320 msgsize 224
00000100:00100000:13.0:1773851861.115269:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-15921@kfi7 (source: 12345-16113@kfi7)
00000100:00000001:13.0:1773851861.115272:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.115273:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000410b16f2 nid 16113@kfi7 refs 2
00000100:00000001:15.0:1773851861.115275:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851861.115276:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851861.115276:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851861.115276:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851861.115277:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851861.115279:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851861.115280:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597753488320
00000020:00000001:15.0:1773851861.115281:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851861.115282:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a33
00000020:00000001:15.0:1773851861.115283:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851861.115286:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000a1406da refcount=168
00000020:00000001:15.0:1773851861.115287:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063872039936 : -107009837511680 : ffff9eacd4a5cc00)
00000020:00000001:15.0:1773851861.115289:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637063872039936 : -107009837511680 : ffff9eacd4a5cc00)
00000100:00000001:15.0:1773851861.115290:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851861.115291:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851861.115292:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ba835c49.
00000020:00000010:15.0:1773851861.115294:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851861.115295:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851861.115297:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851861.115298:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851861.115299:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.115300:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851861.115301:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851861.115302:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.115304:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.115306:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.115306:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.115307:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.115307:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851861.115308:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15921@kfi7, seq: 2289808
00000100:00000040:15.0:1773851861.115309:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000a1406da : new rpc_count 1
00000100:00000001:13.0:1773851861.115310:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.115311:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537146112 : -107002172405504 : ffff9eae9d860900)
00000100:00000001:13.0:1773851861.115311:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851861.115312:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b1b0530f x1859597753488320/t0(0) o400->e2467d76-3b16-4939-b466-9bcfd13a2b24@15921@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1485-0'
00000100:00000001:15.0:1773851861.115317:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851861.115318:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851861.115319:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1b0530f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e2467d76-3b16-4939-b466-9bcfd13a2b24+168:39562:x1859597753488320:12345-15921@kfi7:400:default-tuolumne1485-0
00000100:00000200:15.0:1773851861.115321:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597753488320
00000020:00000001:15.0:1773851861.115322:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851861.115323:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851861.115324:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.115325:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851861.115326:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851861.115327:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851861.115328:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597753488320, found 0 last_xid 1859597753064767
00000020:00000001:15.0:1773851861.115329:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851861.115330:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851861.115331:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851861.115332:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.115333:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851861.115334:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851861.115335:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851861.115336:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000065e29ee.
02000000:00000001:15.0:1773851861.115337:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.115339:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.115340:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851861.115341:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061803, transno 0, xid 1859597753488320
00010000:00000001:15.0:1773851861.115342:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851861.115343:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b1b0530f x1859597753488320/t0(0) o400->e2467d76-3b16-4939-b466-9bcfd13a2b24@15921@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1485-0'
00010000:00000001:15.0:1773851861.115347:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851861.115348:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851861.115349:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851861.115351:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851861.115352:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000002240651 refcount 3 to 15921@kfi7
00000100:00000001:15.0:1773851861.115354:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729381952 : -107155980169664 : ffff9e8acdddce40)
02000000:00000001:15.0:1773851861.115355:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851861.115355:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.115357:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851861.115358:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16113@kfi7
00000400:00000010:15.0:1773851861.115359:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e35829f1.
00000100:00000200:15.0:1773851861.115360:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597753488320, offset 224
00000400:00000200:15.0:1773851861.115362:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16113@kfi7
00000400:00000200:15.0:1773851861.115364:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16113@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.115365:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000410b16f2 nid 16113@kfi7 refs 1
00000400:00000200:15.0:1773851861.115367:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000410b16f2 nid 16113@kfi7 refs 2
00000400:00000200:15.0:1773851861.115369:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000410b16f2 nid 16113@kfi7 refs 3
00000400:00000200:15.0:1773851861.115371:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16113@kfi7 local destination
00000400:00000200:15.0:1773851861.115373:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768953:8768953:1024:4294967295] 16113@kfi7 LPNI seq info [179315:179315:16:4294967295]
00000400:00000200:15.0:1773851861.115375:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000410b16f2 nid 16113@kfi7 refs 2
00000400:00000200:15.0:1773851861.115376:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16113@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.115380:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16113@kfi7(16113@kfi7:16113@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851861.115382:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000410b16f2 nid 16113@kfi7 refs 3
00000800:00000200:15.0:1773851861.115384:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851861.115386:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851861.115393:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851861.115397:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc96 Using peer 16113@kfi7(0xc96)
00000800:00000200:15.0:1773851861.115402:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0xc96: rc=0
00000800:00000200:15.0:1773851861.115405:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc96 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851861.115408:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851861.115409:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000002240651 refcount 2 to 15921@kfi7
00010000:00000001:15.0:1773851861.115410:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851861.115411:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.115412:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851861.115413:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b1b0530f x1859597753488320/t0(0) o400->e2467d76-3b16-4939-b466-9bcfd13a2b24@15921@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1485-0'
00000800:00000200:13.0:1773851861.115419:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc96 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851861.115420:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1b0530f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e2467d76-3b16-4939-b466-9bcfd13a2b24+168:39562:x1859597753488320:12345-15921@kfi7:400:default-tuolumne1485-0 Request processed in 102us (152us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851861.115422:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851861.115424:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15921@kfi7, seq: 2289808
00000400:00000200:13.0:1773851861.115424:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16113@kfi7: PUT: OK
00000100:00000040:15.0:1773851861.115425:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000a1406da : new rpc_count 0
00000400:00000200:13.0:1773851861.115425:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e35829f1
00000100:00000001:15.0:1773851861.115426:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:13.0:1773851861.115426:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e35829f1.
00000100:00000001:15.0:1773851861.115427:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:13.0:1773851861.115427:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851861.115428:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000100:00000001:13.0:1773851861.115428:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851861.115429:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:13.0:1773851861.115429:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000410b16f2 nid 16113@kfi7 refs 2
00000020:00000010:15.0:1773851861.115431:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ba835c49.
00000800:00000200:13.0:1773851861.115431:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16113@kfi7(000000000c47cc49):0x0 lsk 3223 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc96 Transaction freed
00000020:00000040:15.0:1773851861.115432:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000000a1406da : new refcount 167
00000100:00000001:15.0:1773851861.115433:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.126278:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.126279:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.126280:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.126282:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.126285:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25922@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.126286:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25922@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.126287:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25922@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.126287:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000146386c9 nid 25922@kfi7 refs 1
00000400:00000200:1.0:1773851861.126288:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25922@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.126289:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000146386c9 nid 25922@kfi7 refs 2
00000400:00000200:1.0:1773851861.126289:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000146386c9 nid 25922@kfi7 refs 3
00000400:00000200:1.0:1773851861.126290:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:1.0:1773851861.126291:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25986@kfi7 of length 224 into portal 12 MB=0x699e10ccca800
00000400:00000200:1.0:1773851861.126292:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25986@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 22080
00000800:00000200:1.0:1773851861.126294:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.126296:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.126296:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25922@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.126297:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.126298:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.126299:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ccab8c8a.
00000100:00000040:1.0:1773851861.126299:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000ccab8c8a x1858041721694208 msgsize 224
00000100:00100000:1.0:1773851861.126301:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25986@kfi7 (source: 12345-25922@kfi7)
00000100:00000001:1.0:1773851861.126302:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.126302:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000146386c9 nid 25922@kfi7 refs 2
00000100:00000001:0.0:1773851861.126303:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.126303:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851861.126304:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.126304:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.126304:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.126305:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.126306:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041721694208
00000020:00000001:0.0:1773851861.126307:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.126307:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91efc
00000020:00000001:0.0:1773851861.126308:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.126310:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a86137e3 refcount=9
00000020:00000001:0.0:1773851861.126310:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629008384 : -107123080543232 : ffff9e9276d64400)
00000020:00000001:0.0:1773851861.126311:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629008384 : -107123080543232 : ffff9e9276d64400)
00000100:00000001:0.0:1773851861.126312:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.126313:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.126313:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000437b6b0.
00000020:00000010:0.0:1773851861.126314:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.126315:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.126316:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.126316:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.126317:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.126318:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.126318:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.126319:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.126319:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.126320:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.126321:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.126321:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851861.126321:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.126322:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25986@kfi7, seq: 1997531
00000100:00000001:1.0:1773851861.126323:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851861.126323:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.126323:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a86137e3 : new rpc_count 2
00000100:00000001:0.0:1773851861.126323:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856576640 : -106915852974976 : ffff9ec2b6900480)
00000100:00000040:0.0:1773851861.126324:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ccab8c8a x1858041721694208/t0(0) o400->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2120-0'
00000100:00000001:0.0:1773851861.126327:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.126327:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.126329:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccab8c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:86175010-6b73-4218-8cde-3f3a1c0aa50a+9:39830:x1858041721694208:12345-25986@kfi7:400:default-tuolumne2120-0
00000100:00000200:0.0:1773851861.126330:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041721694208
00000020:00000001:0.0:1773851861.126331:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.126331:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.126333:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.126333:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.126334:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.126335:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.126335:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041721694208, found 0 last_xid 1858041720887487
00000020:00000001:0.0:1773851861.126336:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.126337:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.126337:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.126338:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.126338:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.126339:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.126339:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.126340:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fe7fef92.
02000000:00000001:0.0:1773851861.126341:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.126341:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.126342:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.126343:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183220364662, transno 0, xid 1858041721694208
00010000:00000001:0.0:1773851861.126343:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.126344:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ccab8c8a x1858041721694208/t0(0) o400->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2120-0'
00010000:00000001:0.0:1773851861.126346:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.126347:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.126347:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.126348:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.126349:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000065a40ac2 refcount 3 to 25986@kfi7
00000100:00000001:0.0:1773851861.126350:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959840 : -107156125591776 : ffff9e8ac532d720)
02000000:00000001:0.0:1773851861.126350:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.126351:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.126352:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.126352:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25922@kfi7
00000400:00000010:0.0:1773851861.126353:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b7cd9ccd.
00000100:00000200:0.0:1773851861.126353:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041721694208, offset 224
00000400:00000200:0.0:1773851861.126355:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25922@kfi7
00000400:00000200:0.0:1773851861.126355:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25922@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.126356:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000146386c9 nid 25922@kfi7 refs 1
00000400:00000200:0.0:1773851861.126358:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000146386c9 nid 25922@kfi7 refs 2
00000400:00000200:0.0:1773851861.126358:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000146386c9 nid 25922@kfi7 refs 3
00000400:00000200:0.0:1773851861.126360:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25922@kfi7 local destination
00000400:00000200:0.0:1773851861.126361:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768954:8768954:1024:4294967295] 25922@kfi7 LPNI seq info [8088242:8088242:16:4294967295]
00000400:00000200:0.0:1773851861.126362:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000146386c9 nid 25922@kfi7 refs 2
00000400:00000200:0.0:1773851861.126363:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25922@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.126365:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25922@kfi7(25922@kfi7:25922@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.126366:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000146386c9 nid 25922@kfi7 refs 3
00000800:00000200:0.0:1773851861.126367:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.126368:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.126370:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.126372:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x377 Using peer 25922@kfi7(0x377)
00000800:00000200:0.0:1773851861.126375:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x377: rc=0
00000800:00000200:0.0:1773851861.126376:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x377 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.126378:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.126379:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000065a40ac2 refcount 2 to 25986@kfi7
00010000:00000001:0.0:1773851861.126379:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.126380:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.126381:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.126381:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ccab8c8a x1858041721694208/t0(0) o400->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2120-0'
00000100:00100000:0.0:1773851861.126385:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccab8c8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:86175010-6b73-4218-8cde-3f3a1c0aa50a+9:39830:x1858041721694208:12345-25986@kfi7:400:default-tuolumne2120-0 Request processed in 57us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.126387:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25986@kfi7, seq: 1997531
00000100:00000040:0.0:1773851861.126388:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a86137e3 : new rpc_count 1
00000100:00000001:0.0:1773851861.126390:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.126390:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.126391:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.126392:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.126392:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000437b6b0.
00000020:00000040:0.0:1773851861.126393:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000a86137e3 : new refcount 8
00000100:00000001:0.0:1773851861.126394:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.126399:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x377 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.126400:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.126401:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25922@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.126402:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b7cd9ccd
00000400:00000010:1.0:1773851861.126403:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b7cd9ccd.
00000100:00000001:1.0:1773851861.126403:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.126404:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.126405:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000146386c9 nid 25922@kfi7 refs 2
00000800:00000200:1.0:1773851861.126406:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 25922@kfi7(000000007f2b947d):0x0 lsk 888 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x377 Transaction freed
00000800:00000200:25.0:1773851861.128459:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.128459:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.128461:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.128463:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.128465:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12339@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.128467:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12339@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.128468:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12339@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.128469:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000330e0575 nid 12339@kfi7 refs 1
00000400:00000200:25.0:1773851861.128469:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12339@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.128470:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000330e0575 nid 12339@kfi7 refs 2
00000400:00000200:25.0:1773851861.128471:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000330e0575 nid 12339@kfi7 refs 3
00000400:00000200:25.0:1773851861.128472:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12338@kfi7 to cpt 3
00000400:00000200:25.0:1773851861.128473:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12338@kfi7 of length 224 into portal 12 MB=0x69b4b97963cc0
00000400:00000200:25.0:1773851861.128475:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12338@kfi7 of length 224/224 into md 0x16159c6179 [64] + 189720
00000800:00000200:25.0:1773851861.128476:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851861.128478:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.128479:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12339@kfi7: PUT: OK
00000100:00000001:25.0:1773851861.128480:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851861.128480:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851861.128482:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3f68576.
00000100:00000040:25.0:1773851861.128482:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000e3f68576 x1859598828321984 msgsize 224
00000100:00100000:25.0:1773851861.128484:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12338@kfi7 (source: 12345-12339@kfi7)
00000100:00000001:25.0:1773851861.128485:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851861.128486:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000330e0575 nid 12339@kfi7 refs 2
00000100:00000001:24.0:1773851861.128486:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851861.128487:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851861.128487:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851861.128487:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.128488:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.128489:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.128489:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598828321984
00000020:00000001:24.0:1773851861.128490:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.128490:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389245d1
00000020:00000001:24.0:1773851861.128491:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.128492:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000008c935d7 refcount=5
00000020:00000001:24.0:1773851861.128493:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121234483200 : -106952475068416 : ffff9eba2fb73800)
00000020:00000001:24.0:1773851861.128494:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121234483200 : -106952475068416 : ffff9eba2fb73800)
00000100:00000001:24.0:1773851861.128495:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.128496:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.128496:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003f57bde1.
00000020:00000010:24.0:1773851861.128497:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.128498:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.128499:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.128499:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.128500:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.128501:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.128501:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.128502:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.128503:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851861.128504:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.128504:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.128504:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851861.128505:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851861.128506:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12338@kfi7, seq: 2025070
00000100:00000040:24.0:1773851861.128506:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000008c935d7 : new rpc_count 1
00000100:00000001:25.0:1773851861.128507:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851861.128507:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.128507:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637054961755136 : -107018747796480 : ffff9eaac18da400)
00000100:00000040:24.0:1773851861.128508:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3f68576 x1859598828321984/t0(0) o400->110fff0d-94d8-49ca-aeae-423770e769c6@12338@kfi7:78/0 lens 224/0 e 0 to 0 dl 1773852193 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1257-0'
00000100:00000001:24.0:1773851861.128511:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.128511:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.128512:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f68576 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:110fff0d-94d8-49ca-aeae-423770e769c6+5:39646:x1859598828321984:12345-12338@kfi7:400:default-tuolumne1257-0
00000100:00000200:24.0:1773851861.128514:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598828321984
00000020:00000001:24.0:1773851861.128514:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.128515:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.128516:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.128516:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.128517:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.128517:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.128518:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598828321984, found 0 last_xid 1859598828321983
00000020:00000001:24.0:1773851861.128519:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.128520:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.128521:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.128521:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.128522:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.128523:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.128523:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.128525:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008b2c37ad.
02000000:00000001:24.0:1773851861.128526:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.128526:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.128527:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.128527:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181461483704, transno 0, xid 1859598828321984
00010000:00000001:24.0:1773851861.128528:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.128529:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3f68576 x1859598828321984/t0(0) o400->110fff0d-94d8-49ca-aeae-423770e769c6@12338@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1257-0'
00010000:00000001:24.0:1773851861.128532:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.128532:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.128533:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.128534:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.128535:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008fba383f refcount 3 to 12338@kfi7
00000100:00000001:24.0:1773851861.128535:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299552 : -107155980252064 : ffff9e8acddc8c60)
02000000:00000001:24.0:1773851861.128536:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.128537:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.128538:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.128539:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12339@kfi7
00000400:00000010:24.0:1773851861.128539:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098854375.
00000100:00000200:24.0:1773851861.128540:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598828321984, offset 224
00000400:00000200:24.0:1773851861.128541:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12339@kfi7
00000400:00000200:24.0:1773851861.128542:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12339@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.128543:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000330e0575 nid 12339@kfi7 refs 1
00000400:00000200:24.0:1773851861.128544:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000330e0575 nid 12339@kfi7 refs 2
00000400:00000200:24.0:1773851861.128545:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000330e0575 nid 12339@kfi7 refs 3
00000400:00000200:24.0:1773851861.128547:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12339@kfi7 local destination
00000400:00000200:24.0:1773851861.128548:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768955:8768955:1024:4294967295] 12339@kfi7 LPNI seq info [211791:211791:16:4294967295]
00000400:00000200:24.0:1773851861.128549:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000330e0575 nid 12339@kfi7 refs 2
00000400:00000200:24.0:1773851861.128551:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12339@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.128553:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12339@kfi7(12339@kfi7:12339@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.128554:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000330e0575 nid 12339@kfi7 refs 3
00000800:00000200:24.0:1773851861.128556:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.128556:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.128559:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.128561:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000938 Using peer 12339@kfi7(0x100000000000938)
00000800:00000200:24.0:1773851861.128564:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x100000000000938: rc=0
00000800:00000200:24.0:1773851861.128565:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000938 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.128567:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.128568:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008fba383f refcount 2 to 12338@kfi7
00010000:00000001:24.0:1773851861.128569:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.128570:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.128570:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.128571:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3f68576 x1859598828321984/t0(0) o400->110fff0d-94d8-49ca-aeae-423770e769c6@12338@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1257-0'
00000100:00100000:24.0:1773851861.128576:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f68576 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:110fff0d-94d8-49ca-aeae-423770e769c6+5:39646:x1859598828321984:12345-12338@kfi7:400:default-tuolumne1257-0 Request processed in 64us (92us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.128578:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12338@kfi7, seq: 2025070
00000100:00000040:24.0:1773851861.128579:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000008c935d7 : new rpc_count 0
00000100:00000001:24.0:1773851861.128580:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.128580:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.128581:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.128581:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.128582:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003f57bde1.
00000020:00000040:24.0:1773851861.128583:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000008c935d7 : new refcount 4
00000100:00000001:24.0:1773851861.128584:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.128589:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000938 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851861.128591:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.128592:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12339@kfi7: PUT: OK
00000400:00000200:25.0:1773851861.128593:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098854375
00000400:00000010:25.0:1773851861.128594:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098854375.
00000100:00000001:25.0:1773851861.128594:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.128595:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.128596:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000330e0575 nid 12339@kfi7 refs 2
00000800:00000200:25.0:1773851861.128597:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 12339@kfi7(00000000b13ce50c):0x0 lsk 2361 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000938 Transaction freed
00010000:00000001:2.0:1773851861.129731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129732:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851861.129734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851861.129735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851861.129736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851861.129737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851861.129738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851861.129739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851861.129740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851861.129740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851861.129743:0:61303:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851861.129743:0:61303:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851861.129744:0:61303:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:9.0:1773851861.169376:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.169377:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.169378:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.169381:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.169383:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.169384:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.159@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851861.169385:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.169386:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851861.169387:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.159@o2ib600 to cpt 0
00000400:00000200:9.0:1773851861.169388:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab5c99ab nid 172.19.3.159@o2ib600 refs 2
00000400:00000200:9.0:1773851861.169390:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ab5c99ab nid 172.19.3.159@o2ib600 refs 3
00000400:00000200:9.0:1773851861.169391:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.159@o2ib600 to cpt 0
00000400:00000200:9.0:1773851861.169392:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.159@o2ib600 of length 224 into portal 12 MB=0x69a037305c8c0
00000400:00000200:9.0:1773851861.169393:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.159@o2ib600 of length 224/224 into md 0x7fb56e801 [64] + 22304
00000800:00000200:9.0:1773851861.169395:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.169397:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.169398:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.169399:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.169400:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.169401:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000058bfd93.
00000100:00000040:9.0:1773851861.169401:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000058bfd93 x1858189465602240 msgsize 224
00000100:00100000:9.0:1773851861.169403:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.159@o2ib600 (source: 12345-172.19.3.159@o2ib600)
00000100:00000001:9.0:1773851861.169405:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.169406:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851861.169407:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.169408:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.169408:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.169409:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.169409:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.169410:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.169411:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858189465602240
00000020:00000001:0.0:1773851861.169411:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.169412:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac915da
00000020:00000001:0.0:1773851861.169413:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.169415:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003d9fdf5a refcount=567
00000020:00000001:0.0:1773851861.169415:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241260032 : -107152468291584 : ffff9e8b9f30d000)
00000020:00000001:0.0:1773851861.169416:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241260032 : -107152468291584 : ffff9e8b9f30d000)
00000100:00000001:0.0:1773851861.169417:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.169418:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.169419:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000437b6b0.
00000020:00000010:0.0:1773851861.169420:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.169421:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.169422:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.169422:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.169423:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.169424:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.169424:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.169425:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.169426:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851861.169427:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.169427:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.169427:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.169428:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.169429:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.159@o2ib600, seq: 1997532
00000100:00000040:0.0:1773851861.169429:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003d9fdf5a : new rpc_count 2
00000100:00000001:1.0:1773851861.169430:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851861.169431:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.169431:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922909696 : -107141786641920 : ffff9e8e1bddda00)
00000100:00000040:0.0:1773851861.169432:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000058bfd93 x1858189465602240/t0(0) o400->6b961906-a990-4fc6-bce7-0acb8f475996@172.19.3.159@o2ib600:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic9-0'
00000100:00000001:0.0:1773851861.169435:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.169435:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.169436:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000058bfd93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6b961906-a990-4fc6-bce7-0acb8f475996+567:26571:x1858189465602240:12345-172.19.3.159@o2ib600:400:login-oslic9-0
00000100:00000200:0.0:1773851861.169438:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858189465602240
00000020:00000001:0.0:1773851861.169438:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.169439:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.169440:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.169440:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.169441:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.169442:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.169442:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858189465602240, found 0 last_xid 1858189388123135
00000020:00000001:0.0:1773851861.169443:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.169444:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.169444:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.169445:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.169445:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.169446:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.169447:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.169448:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aaf55971.
02000000:00000001:0.0:1773851861.169448:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.169449:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.169450:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.169450:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183119681125, transno 0, xid 1858189465602240
00010000:00000001:0.0:1773851861.169451:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.169452:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000058bfd93 x1858189465602240/t0(0) o400->6b961906-a990-4fc6-bce7-0acb8f475996@172.19.3.159@o2ib600:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic9-0'
00010000:00000001:0.0:1773851861.169454:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.169455:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.169456:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.169457:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.169458:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001ebd68e5 refcount 3 to 172.19.3.159@o2ib600
00000100:00000001:0.0:1773851861.169459:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715817024 : -107155993734592 : ffff9e8acd0ed240)
02000000:00000001:0.0:1773851861.169460:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.169460:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.169461:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.169462:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.159@o2ib600
00000400:00000010:0.0:1773851861.169463:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079ba0077.
00000100:00000200:0.0:1773851861.169463:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858189465602240, offset 224
00000400:00000200:0.0:1773851861.169465:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.159@o2ib600
00000400:00000200:0.0:1773851861.169466:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.159@o2ib600 to cpt 0
00000400:00000200:0.0:1773851861.169467:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab5c99ab nid 172.19.3.159@o2ib600 refs 2
00000400:00000200:0.0:1773851861.169468:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ab5c99ab nid 172.19.3.159@o2ib600 refs 3
00000400:00000200:0.0:1773851861.169469:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ab5c99ab nid 172.19.3.159@o2ib600 refs 4
00000400:00000200:0.0:1773851861.169471:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.159@o2ib600 routed destination
00000400:00000200:0.0:1773851861.169472:0:60951:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:0.0:1773851861.169473:0:60951:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:0.0:1773851861.169474:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.159@o2ib600: rtr pref emtpy: 1
00000400:00000200:0.0:1773851861.169476:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:0.0:1773851861.169477:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.159@o2ib600: rtr pref emtpy: 1
00000400:00000200:0.0:1773851861.169477:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:0.0:1773851861.169478:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768956:8768956:1024:4294967295] 2094@kfi7 LPNI seq info [1258746985:1258746985:16:4294967295]
00000400:00000200:0.0:1773851861.169480:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:0.0:1773851861.169481:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:0.0:1773851861.169483:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.159@o2ib600(172.19.3.159@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.169485:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ab5c99ab nid 172.19.3.159@o2ib600 refs 3
00000800:00000200:0.0:1773851861.169486:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.169487:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.169490:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.169494:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:0.0:1773851861.169497:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:0.0:1773851861.169498:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.169501:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.169502:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001ebd68e5 refcount 2 to 172.19.3.159@o2ib600
00010000:00000001:0.0:1773851861.169503:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.169505:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.169506:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.169506:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000058bfd93 x1858189465602240/t0(0) o400->6b961906-a990-4fc6-bce7-0acb8f475996@172.19.3.159@o2ib600:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic9-0'
00000100:00100000:0.0:1773851861.169510:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000058bfd93 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6b961906-a990-4fc6-bce7-0acb8f475996+567:26571:x1858189465602240:12345-172.19.3.159@o2ib600:400:login-oslic9-0 Request processed in 74us (107us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.169512:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.159@o2ib600, seq: 1997532
00000100:00000040:0.0:1773851861.169513:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003d9fdf5a : new rpc_count 1
00000100:00000001:0.0:1773851861.169514:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.169514:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.169515:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.169516:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.169517:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000437b6b0.
00000020:00000040:0.0:1773851861.169517:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003d9fdf5a : new refcount 566
00000100:00000001:0.0:1773851861.169518:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.169523:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.169524:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.169525:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.169526:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079ba0077
00000400:00000010:1.0:1773851861.169527:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079ba0077.
00000100:00000001:1.0:1773851861.169527:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.169528:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.169529:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:1.0:1773851861.169530:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Transaction freed
00000800:00000200:14.0:1773851861.171810:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.171810:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851861.171811:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.171811:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851861.171812:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.171812:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851861.171814:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851861.171814:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15697@kfi7(000000007ef49575):0x104 version: 2; local version 2; negotiated version: 2
00000400:00000200:14.0:1773851861.171816:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15697@kfi7 to cpt 3
00000800:00000200:13.0:1773851861.171816:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 Using peer 15697@kfi7(0x104)
00000400:00000200:14.0:1773851861.171817:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15697@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.171818:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15697@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.171819:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15697@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.171820:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004692f185 nid 15697@kfi7 refs 1
00000800:00000200:13.0:1773851861.171820:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 38 bytes to peer 0x104: rc=0
00000400:00000200:14.0:1773851861.171821:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15697@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.171822:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004692f185 nid 15697@kfi7 refs 2
00000800:00000200:13.0:1773851861.171822:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851861.171823:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004692f185 nid 15697@kfi7 refs 3
00000400:00000200:14.0:1773851861.171823:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15697@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.171824:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15697@kfi7 of length 224 into portal 12 MB=0x69b4b5c50df40
00000400:00000200:14.0:1773851861.171826:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15697@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 23080
00000800:00000200:14.0:1773851861.171828:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851861.171830:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851861.171831:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15697@kfi7: PUT: OK
00000100:00000001:14.0:1773851861.171832:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851861.171833:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851861.171834:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf89b907.
00000100:00000040:14.0:1773851861.171834:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000cf89b907 x1859597833920320 msgsize 224
00000800:00000200:13.0:1773851861.171834:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851861.171836:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-15697@kfi7 (source: 12345-15697@kfi7)
00000100:00000001:14.0:1773851861.171837:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:13.0:1773851861.171837:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 Transaction freed
00000400:00000200:14.0:1773851861.171838:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004692f185 nid 15697@kfi7 refs 2
00000100:00000001:15.0:1773851861.171840:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851861.171840:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002eb192a5: 2069@kfi7:3 <- 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851861.171841:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851861.171841:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851861.171842:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851861.171843:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851861.171845:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597833920320
00000020:00000001:15.0:1773851861.171857:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851861.171858:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8100f
00000020:00000001:15.0:1773851861.171858:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851861.171862:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c2f54720 refcount=165
00000020:00000001:15.0:1773851861.171863:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143294808064 : -106930414743552 : ffff9ebf529d1000)
00000020:00000001:15.0:1773851861.171864:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143294808064 : -106930414743552 : ffff9ebf529d1000)
00000100:00000001:15.0:1773851861.171866:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851861.171867:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851861.171868:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ba835c49.
00000020:00000010:15.0:1773851861.171870:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851861.171871:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851861.171873:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851861.171873:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851861.171874:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.171876:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851861.171876:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851861.171877:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.171879:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.171880:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.171881:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.171881:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.171881:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.171882:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15697@kfi7, seq: 2289809
00000100:00000001:15.0:1773851861.171883:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.171883:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c2f54720 : new rpc_count 1
00000100:00000001:15.0:1773851861.171884:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.171884:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341829120 : -106946367722496 : ffff9ebb9bbdec00)
00000100:00000040:13.0:1773851861.171885:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cf89b907 x1859597833920320/t0(0) o400->e19f469b-d2cd-4764-9843-223086f47f25@15697@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1474-0'
00000100:00000001:13.0:1773851861.171888:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.171889:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.171890:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf89b907 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e19f469b-d2cd-4764-9843-223086f47f25+165:39543:x1859597833920320:12345-15697@kfi7:400:default-tuolumne1474-0
00000100:00000200:13.0:1773851861.171891:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597833920320
00000020:00000001:13.0:1773851861.171892:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.171892:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.171893:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.171894:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.171895:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.171895:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.171896:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597833920320, found 0 last_xid 1859597833497407
00000020:00000001:13.0:1773851861.171897:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.171897:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.171898:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.171899:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.171899:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.171900:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851861.171900:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.171901:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004b727378.
02000000:00000001:13.0:1773851861.171902:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.171903:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.171903:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.171904:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063444, transno 0, xid 1859597833920320
00010000:00000001:13.0:1773851861.171905:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851861.171906:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cf89b907 x1859597833920320/t0(0) o400->e19f469b-d2cd-4764-9843-223086f47f25@15697@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1474-0'
00010000:00000001:13.0:1773851861.171909:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851861.171909:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851861.171910:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851861.171911:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.171912:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000132072cf refcount 3 to 15697@kfi7
00000100:00000001:13.0:1773851861.171913:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155296 : -107139310396320 : ffff9e8eaf765c60)
02000000:00000001:13.0:1773851861.171914:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851861.171914:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.171915:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.171916:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15697@kfi7
00000400:00000010:13.0:1773851861.171917:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000045c0b9f8.
00000100:00000200:13.0:1773851861.171918:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597833920320, offset 224
00000400:00000200:13.0:1773851861.171919:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15697@kfi7
00000400:00000200:13.0:1773851861.171920:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15697@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.171921:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004692f185 nid 15697@kfi7 refs 1
00000400:00000200:13.0:1773851861.171922:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004692f185 nid 15697@kfi7 refs 2
00000400:00000200:13.0:1773851861.171924:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004692f185 nid 15697@kfi7 refs 3
00000400:00000200:13.0:1773851861.171925:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15697@kfi7 local destination
00000400:00000200:13.0:1773851861.171926:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768957:8768957:1024:4294967295] 15697@kfi7 LPNI seq info [616286:616286:16:4294967295]
00000400:00000200:13.0:1773851861.171928:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004692f185 nid 15697@kfi7 refs 2
00000400:00000200:13.0:1773851861.171928:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15697@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.171930:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15697@kfi7(15697@kfi7:15697@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.171932:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004692f185 nid 15697@kfi7 refs 3
00000800:00000200:13.0:1773851861.171933:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.171934:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851861.171936:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851861.171938:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 Using peer 15697@kfi7(0x104)
00000800:00000200:13.0:1773851861.171942:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 324 bytes to peer 0x104: rc=0
00000800:00000200:13.0:1773851861.171944:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851861.171946:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.171947:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000132072cf refcount 2 to 15697@kfi7
00010000:00000001:13.0:1773851861.171947:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.171948:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.171948:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851861.171949:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cf89b907 x1859597833920320/t0(0) o400->e19f469b-d2cd-4764-9843-223086f47f25@15697@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1474-0'
00000100:00100000:13.0:1773851861.171953:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf89b907 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e19f469b-d2cd-4764-9843-223086f47f25+165:39543:x1859597833920320:12345-15697@kfi7:400:default-tuolumne1474-0 Request processed in 63us (117us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851861.171955:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15697@kfi7, seq: 2289809
00000100:00000040:13.0:1773851861.171956:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c2f54720 : new rpc_count 0
00000800:00000200:14.0:1773851861.171957:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851861.171957:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851861.171958:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851861.171958:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851861.171958:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:13.0:1773851861.171959:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:14.0:1773851861.171960:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15697@kfi7: PUT: OK
00000400:00000200:14.0:1773851861.171960:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000045c0b9f8
00000020:00000010:13.0:1773851861.171960:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ba835c49.
00000400:00000010:14.0:1773851861.171961:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000045c0b9f8.
00000020:00000040:13.0:1773851861.171961:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c2f54720 : new refcount 164
00000100:00000001:13.0:1773851861.171961:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851861.171962:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851861.171962:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851861.171963:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004692f185 nid 15697@kfi7 refs 2
00000800:00000200:14.0:1773851861.171964:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 15697@kfi7(000000007ef49575):0x0 lsk 261 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104 Transaction freed
00000800:00000200:1.0:1773851861.176967:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.176968:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.176969:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.176972:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.176973:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12659@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.176975:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12659@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.176976:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12659@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.176978:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004dcda8e1 nid 12659@kfi7 refs 1
00000400:00000200:1.0:1773851861.176979:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12659@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.176980:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004dcda8e1 nid 12659@kfi7 refs 2
00000400:00000200:1.0:1773851861.176981:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004dcda8e1 nid 12659@kfi7 refs 3
00000400:00000200:1.0:1773851861.176982:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12722@kfi7 to cpt 1
00000400:00000200:1.0:1773851861.176983:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12722@kfi7 of length 224 into portal 12 MB=0x69b4b83116d00
00000400:00000200:1.0:1773851861.176984:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12722@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 22528
00000800:00000200:1.0:1773851861.176986:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.176988:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.176988:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12659@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.176989:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.176990:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.176991:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000530170fb.
00000100:00000040:1.0:1773851861.176992:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000530170fb x1859598484073728 msgsize 224
00000100:00100000:1.0:1773851861.176993:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-12722@kfi7 (source: 12345-12659@kfi7)
00000100:00000001:1.0:1773851861.176994:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.176995:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004dcda8e1 nid 12659@kfi7 refs 2
00000800:00000200:1.0:1773851861.176996:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.176996:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.176996:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.176997:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.176997:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.176998:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.176999:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598484073728
00000020:00000001:0.0:1773851861.176999:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.177000:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eb6b
00000020:00000001:0.0:1773851861.177001:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.177004:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029d3c4c1 refcount=5
00000020:00000001:0.0:1773851861.177005:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138480614400 : -106935228937216 : ffff9ebe33aa4c00)
00000020:00000001:0.0:1773851861.177005:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138480614400 : -106935228937216 : ffff9ebe33aa4c00)
00000100:00000001:0.0:1773851861.177006:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.177007:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.177008:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000437b6b0.
00000020:00000010:0.0:1773851861.177009:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.177009:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.177010:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.177011:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.177011:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.177012:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.177012:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.177013:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.177014:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851861.177015:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.177015:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.177015:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.177016:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.177016:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12722@kfi7, seq: 1997533
00000100:00000001:1.0:1773851861.177017:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.177017:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000029d3c4c1 : new rpc_count 1
00000100:00000001:1.0:1773851861.177018:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.177018:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856595072 : -106915852956544 : ffff9ec2b6904c80)
00000100:00000040:0.0:1773851861.177019:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000530170fb x1859598484073728/t0(0) o400->5d44e512-07b4-43f3-9238-b388eb6c8855@12722@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1274-0'
00000100:00000001:0.0:1773851861.177022:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.177022:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.177023:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000530170fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5d44e512-07b4-43f3-9238-b388eb6c8855+5:39579:x1859598484073728:12345-12722@kfi7:400:default-tuolumne1274-0
00000100:00000200:0.0:1773851861.177025:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598484073728
00000020:00000001:0.0:1773851861.177025:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.177026:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.177026:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.177027:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.177030:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.177031:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.177032:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598484073728, found 0 last_xid 1859598484073727
00000020:00000001:0.0:1773851861.177033:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.177033:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.177034:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.177034:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.177035:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.177036:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.177036:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.177038:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002ac814a3.
02000000:00000001:0.0:1773851861.177039:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.177040:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.177041:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.177041:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595623, transno 0, xid 1859598484073728
00010000:00000001:0.0:1773851861.177042:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.177043:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000530170fb x1859598484073728/t0(0) o400->5d44e512-07b4-43f3-9238-b388eb6c8855@12722@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1274-0'
00010000:00000001:0.0:1773851861.177046:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.177046:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.177047:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.177048:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.177049:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000038145f9e refcount 3 to 12722@kfi7
00000100:00000001:0.0:1773851861.177050:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412096 : -107145304139520 : ffff9e8d4a351900)
02000000:00000001:0.0:1773851861.177051:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.177051:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.177052:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.177053:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12659@kfi7
00000400:00000010:0.0:1773851861.177054:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a92b0d66.
00000100:00000200:0.0:1773851861.177055:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598484073728, offset 224
00000400:00000200:0.0:1773851861.177057:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12659@kfi7
00000400:00000200:0.0:1773851861.177057:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12659@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.177058:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004dcda8e1 nid 12659@kfi7 refs 1
00000400:00000200:0.0:1773851861.177060:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004dcda8e1 nid 12659@kfi7 refs 2
00000400:00000200:0.0:1773851861.177062:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004dcda8e1 nid 12659@kfi7 refs 3
00000400:00000200:0.0:1773851861.177064:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12659@kfi7 local destination
00000400:00000200:0.0:1773851861.177067:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768958:8768958:1024:4294967295] 12659@kfi7 LPNI seq info [13995164:13995164:16:4294967295]
00000400:00000200:0.0:1773851861.177069:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004dcda8e1 nid 12659@kfi7 refs 2
00000400:00000200:0.0:1773851861.177070:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12659@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.177075:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12659@kfi7(12659@kfi7:12659@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.177077:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004dcda8e1 nid 12659@kfi7 refs 3
00000800:00000200:0.0:1773851861.177079:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.177081:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.177085:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.177090:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaa6 Using peer 12659@kfi7(0xaa6)
00000800:00000200:0.0:1773851861.177095:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0xaa6: rc=0
00000800:00000200:0.0:1773851861.177098:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaa6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.177101:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.177105:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000038145f9e refcount 2 to 12722@kfi7
00010000:00000001:0.0:1773851861.177106:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.177107:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.177108:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.177110:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000530170fb x1859598484073728/t0(0) o400->5d44e512-07b4-43f3-9238-b388eb6c8855@12722@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1274-0'
00000100:00100000:0.0:1773851861.177116:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000530170fb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5d44e512-07b4-43f3-9238-b388eb6c8855+5:39579:x1859598484073728:12345-12722@kfi7:400:default-tuolumne1274-0 Request processed in 92us (122us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.177120:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12722@kfi7, seq: 1997533
00000100:00000040:0.0:1773851861.177121:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000029d3c4c1 : new rpc_count 0
00000100:00000001:0.0:1773851861.177123:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.177124:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.177125:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.177126:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.177128:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000437b6b0.
00000020:00000040:0.0:1773851861.177129:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000029d3c4c1 : new refcount 4
00000100:00000001:0.0:1773851861.177130:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.177137:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaa6 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.177139:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.177140:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12659@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.177141:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a92b0d66
00000400:00000010:1.0:1773851861.177141:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a92b0d66.
00000100:00000001:1.0:1773851861.177142:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.177143:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.177144:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004dcda8e1 nid 12659@kfi7 refs 2
00000800:00000200:1.0:1773851861.177145:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 12659@kfi7(000000000b1098e6):0x0 lsk 2727 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0xaa6 Transaction freed
00000800:00000200:29.0:1773851861.208892:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.208893:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.208894:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.208896:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.208898:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12499@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.208899:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12499@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.208900:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12499@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.208901:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec73e85e nid 12499@kfi7 refs 1
00000400:00000200:29.0:1773851861.208902:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12499@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.208903:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec73e85e nid 12499@kfi7 refs 2
00000400:00000200:29.0:1773851861.208904:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ec73e85e nid 12499@kfi7 refs 3
00000400:00000200:29.0:1773851861.208905:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12498@kfi7 to cpt 4
00000400:00000200:29.0:1773851861.208905:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12498@kfi7 of length 224 into portal 12 MB=0x69b7bcc346940
00000400:00000200:29.0:1773851861.208907:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12498@kfi7 of length 224/224 into md 0x77fe139dd [64] + 168960
00000800:00000200:29.0:1773851861.208909:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.208911:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.208912:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12499@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.208913:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.208913:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.208915:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000080859878.
00000100:00000040:29.0:1773851861.208915:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000080859878 x1859805869533504 msgsize 224
00000100:00100000:29.0:1773851861.208917:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12498@kfi7 (source: 12345-12499@kfi7)
00000100:00000001:29.0:1773851861.208918:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851861.208919:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec73e85e nid 12499@kfi7 refs 2
00000100:00000001:31.0:1773851861.208920:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851861.208920:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851861.208921:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851861.208922:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851861.208923:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.208924:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851861.208925:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859805869533504
00000020:00000001:31.0:1773851861.208926:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851861.208927:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0858fedc453
00000020:00000001:31.0:1773851861.208928:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851861.208932:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076e84b43 refcount=166
00000020:00000001:31.0:1773851861.208933:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636936022925312 : -107137686626304 : ffff9e8f103f2000)
00000020:00000001:31.0:1773851861.208935:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636936022925312 : -107137686626304 : ffff9e8f103f2000)
00000100:00000001:31.0:1773851861.208936:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.208938:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851861.208939:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003eec177.
00000020:00000010:31.0:1773851861.208940:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851861.208942:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851861.208943:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851861.208943:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851861.208944:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.208946:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851861.208947:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851861.208947:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.208949:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851861.208950:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.208951:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.208951:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.208951:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851861.208952:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12498@kfi7, seq: 2055492
00000100:00000040:28.0:1773851861.208953:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000076e84b43 : new rpc_count 1
00000100:00000001:31.0:1773851861.208954:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.208954:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221542912 : -106948488008704 : ffff9ebb1d5cec00)
00000100:00000001:31.0:1773851861.208955:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.208955:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000080859878 x1859805869533504/t0(0) o400->c70342de-253f-4241-b778-22a0fde48108@12498@kfi7:649/0 lens 224/0 e 0 to 0 dl 1773852009 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1269-0'
00000100:00000001:28.0:1773851861.208958:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.208959:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851861.208959:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080859878 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c70342de-253f-4241-b778-22a0fde48108+166:39656:x1859805869533504:12345-12498@kfi7:400:default-tuolumne1269-0
00000100:00000200:28.0:1773851861.208961:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859805869533504
00000020:00000001:28.0:1773851861.208962:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851861.208962:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851861.208963:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.208964:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851861.208964:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851861.208965:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851861.208966:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859805869533504, found 0 last_xid 1859805869111807
00000020:00000001:28.0:1773851861.208966:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851861.208967:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851861.208968:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851861.208968:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.208969:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851861.208970:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851861.208971:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851861.208972:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad2b899b.
02000000:00000001:28.0:1773851861.208973:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.208974:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.208974:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851861.208975:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062470, transno 0, xid 1859805869533504
00010000:00000001:28.0:1773851861.208976:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851861.208977:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000080859878 x1859805869533504/t0(0) o400->c70342de-253f-4241-b778-22a0fde48108@12498@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1269-0'
00010000:00000001:28.0:1773851861.208979:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851861.208979:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851861.208980:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851861.208981:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851861.208982:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fa7ecbd3 refcount 3 to 12498@kfi7
00000100:00000001:28.0:1773851861.208983:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926931069664 : -107146778481952 : ffff9e8cf2546ae0)
02000000:00000001:28.0:1773851861.208984:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851861.208984:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.208985:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851861.208986:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12499@kfi7
00000400:00000010:28.0:1773851861.208986:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5e5a670.
00000100:00000200:28.0:1773851861.208987:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859805869533504, offset 224
00000400:00000200:28.0:1773851861.208988:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12499@kfi7
00000400:00000200:28.0:1773851861.208989:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12499@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.208990:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec73e85e nid 12499@kfi7 refs 1
00000400:00000200:28.0:1773851861.208991:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ec73e85e nid 12499@kfi7 refs 2
00000400:00000200:28.0:1773851861.208992:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ec73e85e nid 12499@kfi7 refs 3
00000400:00000200:28.0:1773851861.208993:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12499@kfi7 local destination
00000400:00000200:28.0:1773851861.208995:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768959:8768959:1024:4294967295] 12499@kfi7 LPNI seq info [946971:946971:16:4294967295]
00000400:00000200:28.0:1773851861.208996:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ec73e85e nid 12499@kfi7 refs 2
00000400:00000200:28.0:1773851861.208997:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12499@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.208999:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12499@kfi7(12499@kfi7:12499@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851861.209000:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ec73e85e nid 12499@kfi7 refs 3
00000800:00000200:28.0:1773851861.209002:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851861.209003:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851861.209005:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851861.209007:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x11f8 Using peer 12499@kfi7(0x11f8)
00000800:00000200:28.0:1773851861.209010:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x11f8: rc=0
00000800:00000200:28.0:1773851861.209012:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x11f8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851861.209014:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.209015:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fa7ecbd3 refcount 2 to 12498@kfi7
00010000:00000001:28.0:1773851861.209016:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851861.209016:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.209017:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851861.209017:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000080859878 x1859805869533504/t0(0) o400->c70342de-253f-4241-b778-22a0fde48108@12498@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1269-0'
00000100:00100000:28.0:1773851861.209022:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080859878 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c70342de-253f-4241-b778-22a0fde48108+166:39656:x1859805869533504:12345-12498@kfi7:400:default-tuolumne1269-0 Request processed in 63us (106us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851861.209024:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12498@kfi7, seq: 2055492
00000100:00000040:28.0:1773851861.209025:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000076e84b43 : new rpc_count 0
00000100:00000001:28.0:1773851861.209026:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851861.209026:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851861.209027:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:28.0:1773851861.209028:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:28.0:1773851861.209029:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003eec177.
00000020:00000040:28.0:1773851861.209030:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000076e84b43 : new refcount 165
00000100:00000001:28.0:1773851861.209030:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851861.209035:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x11f8 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851861.209036:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.209038:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12499@kfi7: PUT: OK
00000400:00000200:29.0:1773851861.209039:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5e5a670
00000400:00000010:29.0:1773851861.209039:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5e5a670.
00000100:00000001:29.0:1773851861.209040:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.209040:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.209041:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec73e85e nid 12499@kfi7 refs 2
00000800:00000200:29.0:1773851861.209042:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12499@kfi7(00000000e0c00d0c):0x0 lsk 4601 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x11f8 Transaction freed
00000800:00000200:29.0:1773851861.213019:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.213019:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.213021:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.213023:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.213024:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17345@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.213026:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17345@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.213026:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17345@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.213027:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000108d45d0 nid 17345@kfi7 refs 1
00000400:00000200:29.0:1773851861.213028:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17345@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.213029:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000108d45d0 nid 17345@kfi7 refs 2
00000400:00000200:29.0:1773851861.213030:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000108d45d0 nid 17345@kfi7 refs 3
00000400:00000200:29.0:1773851861.213030:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17152@kfi7 to cpt 1
00000400:00000200:29.0:1773851861.213031:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17152@kfi7 of length 224 into portal 12 MB=0x69b82e19ddd40
00000400:00000200:29.0:1773851861.213033:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17152@kfi7 of length 224/224 into md 0x77fe139dd [64] + 169184
00000800:00000200:29.0:1773851861.213034:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.213036:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.213036:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17345@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.213037:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.213038:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.213038:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5bb58f1.
00000100:00000040:29.0:1773851861.213039:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000c5bb58f1 x1859836293537088 msgsize 224
00000100:00100000:29.0:1773851861.213040:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17152@kfi7 (source: 12345-17345@kfi7)
00000100:00000001:29.0:1773851861.213041:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851861.213042:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000108d45d0 nid 17345@kfi7 refs 2
00000800:00000200:29.0:1773851861.213043:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851861.213043:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851861.213043:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851861.213043:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851861.213044:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851861.213045:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851861.213046:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836293537088
00000020:00000001:28.0:1773851861.213046:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851861.213047:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d6001e
00000020:00000001:28.0:1773851861.213047:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851861.213052:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a826bfb6 refcount=167
00000020:00000001:28.0:1773851861.213052:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029661680640 : -107044047870976 : ffff9ea4dd8d2400)
00000020:00000001:28.0:1773851861.213053:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029661680640 : -107044047870976 : ffff9ea4dd8d2400)
00000100:00000001:28.0:1773851861.213054:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.213055:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851861.213055:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000041347fd5.
00000020:00000010:28.0:1773851861.213056:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851861.213057:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095ed4c73.
00000100:00000001:28.0:1773851861.213058:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851861.213058:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851861.213059:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851861.213059:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851861.213060:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851861.213060:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.213061:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851861.213062:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.213062:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851861.213063:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.213063:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851861.213063:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17152@kfi7, seq: 2055493
00000100:00000001:31.0:1773851861.213064:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.213064:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.213064:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a826bfb6 : new rpc_count 1
00000100:00000001:28.0:1773851861.213065:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221532544 : -106948488019072 : ffff9ebb1d5cc380)
00000100:00000040:28.0:1773851861.213066:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c5bb58f1 x1859836293537088/t0(0) o400->99cd9bad-32b8-494f-8119-f19960e9e1ff@17152@kfi7:649/0 lens 224/0 e 0 to 0 dl 1773852009 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1571-0'
00000100:00000001:28.0:1773851861.213068:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.213069:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851861.213069:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5bb58f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:99cd9bad-32b8-494f-8119-f19960e9e1ff+167:40396:x1859836293537088:12345-17152@kfi7:400:default-tuolumne1571-0
00000100:00000200:28.0:1773851861.213070:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836293537088
00000020:00000001:28.0:1773851861.213072:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851861.213073:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851861.213073:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.213074:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851861.213074:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851861.213075:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851861.213075:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836293537088, found 0 last_xid 1859836293117055
00000020:00000001:28.0:1773851861.213076:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851861.213076:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851861.213077:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851861.213077:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.213078:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851861.213078:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851861.213079:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851861.213079:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000536cf4d6.
02000000:00000001:28.0:1773851861.213080:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.213080:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.213081:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851861.213081:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063259, transno 0, xid 1859836293537088
00010000:00000001:28.0:1773851861.213082:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851861.213083:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c5bb58f1 x1859836293537088/t0(0) o400->99cd9bad-32b8-494f-8119-f19960e9e1ff@17152@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1571-0'
00010000:00000001:28.0:1773851861.213085:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851861.213085:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851861.213086:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851861.213087:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851861.213088:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004292f0dc refcount 3 to 17152@kfi7
00000100:00000001:28.0:1773851861.213088:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413344 : -107145304138272 : ffff9e8d4a351de0)
02000000:00000001:28.0:1773851861.213089:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851861.213089:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.213090:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851861.213091:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17345@kfi7
00000400:00000010:28.0:1773851861.213091:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024587145.
00000100:00000200:28.0:1773851861.213092:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836293537088, offset 224
00000400:00000200:28.0:1773851861.213093:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17345@kfi7
00000400:00000200:28.0:1773851861.213095:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17345@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.213096:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000108d45d0 nid 17345@kfi7 refs 1
00000400:00000200:28.0:1773851861.213097:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000108d45d0 nid 17345@kfi7 refs 2
00000400:00000200:28.0:1773851861.213098:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000108d45d0 nid 17345@kfi7 refs 3
00000400:00000200:28.0:1773851861.213099:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17345@kfi7 local destination
00000400:00000200:28.0:1773851861.213100:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768960:8768960:1024:4294967295] 17345@kfi7 LPNI seq info [138812:138812:16:4294967295]
00000400:00000200:28.0:1773851861.213101:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000108d45d0 nid 17345@kfi7 refs 2
00000400:00000200:28.0:1773851861.213102:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17345@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.213104:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17345@kfi7(17345@kfi7:17345@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851861.213105:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000108d45d0 nid 17345@kfi7 refs 3
00000800:00000200:28.0:1773851861.213106:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851861.213107:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851861.213109:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851861.213111:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d1e Using peer 17345@kfi7(0x100000000000d1e)
00000800:00000200:28.0:1773851861.213114:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x100000000000d1e: rc=0
00000800:00000200:28.0:1773851861.213116:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d1e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851861.213118:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.213118:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004292f0dc refcount 2 to 17152@kfi7
00010000:00000001:28.0:1773851861.213119:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851861.213119:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.213120:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851861.213120:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5bb58f1 x1859836293537088/t0(0) o400->99cd9bad-32b8-494f-8119-f19960e9e1ff@17152@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1571-0'
00000100:00100000:28.0:1773851861.213125:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5bb58f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:99cd9bad-32b8-494f-8119-f19960e9e1ff+167:40396:x1859836293537088:12345-17152@kfi7:400:default-tuolumne1571-0 Request processed in 56us (85us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851861.213131:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17152@kfi7, seq: 2055493
00000100:00000040:28.0:1773851861.213132:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a826bfb6 : new rpc_count 0
00000100:00000001:28.0:1773851861.213133:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851861.213133:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851861.213133:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851861.213134:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095ed4c73.
00000020:00000010:28.0:1773851861.213135:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000041347fd5.
00000020:00000040:28.0:1773851861.213135:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000a826bfb6 : new refcount 166
00000100:00000001:28.0:1773851861.213136:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851861.213140:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d1e TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851861.213142:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.213143:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17345@kfi7: PUT: OK
00000400:00000200:29.0:1773851861.213143:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024587145
00000400:00000010:29.0:1773851861.213144:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024587145.
00000100:00000001:29.0:1773851861.213144:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.213145:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.213146:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000108d45d0 nid 17345@kfi7 refs 2
00000800:00000200:29.0:1773851861.213147:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 17345@kfi7(000000001510e445):0x0 lsk 3359 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d1e Transaction freed
00000800:00000200:13.0:1773851861.244498:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.244499:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.244501:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.244503:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.244505:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10898@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.244507:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10898@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.244508:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10898@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.244509:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000037d6015a nid 10898@kfi7 refs 1
00000400:00000200:13.0:1773851861.244510:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10898@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.244511:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000037d6015a nid 10898@kfi7 refs 2
00000400:00000200:13.0:1773851861.244512:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000037d6015a nid 10898@kfi7 refs 3
00000400:00000200:13.0:1773851861.244513:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10899@kfi7 to cpt 6
00000400:00000200:13.0:1773851861.244514:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10899@kfi7 of length 224 into portal 12 MB=0x699e1cec73980
00000400:00000200:13.0:1773851861.244515:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10899@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 23304
00000800:00000200:13.0:1773851861.244517:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851861.244519:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.244520:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10898@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.244522:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851861.244522:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851861.244523:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6979a07.
00000100:00000040:13.0:1773851861.244523:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000a6979a07 x1858044976118144 msgsize 224
00000100:00100000:13.0:1773851861.244525:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10899@kfi7 (source: 12345-10898@kfi7)
00000100:00000001:13.0:1773851861.244526:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.244527:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000037d6015a nid 10898@kfi7 refs 2
00000800:00000200:13.0:1773851861.244529:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851861.244531:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851861.244532:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851861.244532:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851861.244533:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851861.244534:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851861.244535:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044976118144
00000020:00000001:13.0:1773851861.244535:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851861.244536:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91777
00000020:00000001:13.0:1773851861.244536:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851861.244539:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074c509c1 refcount=160
00000020:00000001:13.0:1773851861.244540:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241470976 : -107152468080640 : ffff9e8b9f340800)
00000020:00000001:13.0:1773851861.244540:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241470976 : -107152468080640 : ffff9e8b9f340800)
00000100:00000001:13.0:1773851861.244541:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.244543:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851861.244545:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c6d32409.
00000020:00000010:13.0:1773851861.244546:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851861.244547:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007398a894.
00000100:00000001:13.0:1773851861.244548:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851861.244548:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851861.244549:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.244550:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851861.244550:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851861.244551:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.244552:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.244553:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.244553:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.244554:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.244554:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.244555:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10899@kfi7, seq: 2289810
00000100:00000040:13.0:1773851861.244555:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074c509c1 : new rpc_count 1
00000100:00000001:15.0:1773851861.244556:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.244556:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.244556:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537164544 : -107002172387072 : ffff9eae9d865100)
00000100:00000040:13.0:1773851861.244557:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6979a07 x1858044976118144/t0(0) o400->7e90dac2-9caa-4c1a-9bb9-7611eb269d24@10899@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1174-0'
00000100:00000001:13.0:1773851861.244560:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.244560:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.244561:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6979a07 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7e90dac2-9caa-4c1a-9bb9-7611eb269d24+160:39734:x1858044976118144:12345-10899@kfi7:400:default-tuolumne1174-0
00000100:00000200:13.0:1773851861.244563:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044976118144
00000020:00000001:13.0:1773851861.244563:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.244564:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.244565:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.244565:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.244566:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.244567:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.244567:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044976118144, found 0 last_xid 1858044975693183
00000020:00000001:13.0:1773851861.244568:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.244569:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.244569:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.244570:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.244571:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.244572:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851861.244572:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.244573:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005ae78246.
02000000:00000001:13.0:1773851861.244574:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.244574:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.244575:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.244576:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063307, transno 0, xid 1858044976118144
00010000:00000001:13.0:1773851861.244577:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851861.244578:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6979a07 x1858044976118144/t0(0) o400->7e90dac2-9caa-4c1a-9bb9-7611eb269d24@10899@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1174-0'
00010000:00000001:13.0:1773851861.244580:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851861.244581:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851861.244581:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851861.244582:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.244583:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a5392c13 refcount 3 to 10899@kfi7
00000100:00000001:13.0:1773851861.244584:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857536 : -107149578694080 : ffff9e8c4b6c9240)
02000000:00000001:13.0:1773851861.244585:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851861.244585:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.244586:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.244587:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10898@kfi7
00000400:00000010:13.0:1773851861.244587:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002b0682bf.
00000100:00000200:13.0:1773851861.244588:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044976118144, offset 224
00000400:00000200:13.0:1773851861.244589:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10898@kfi7
00000400:00000200:13.0:1773851861.244590:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10898@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.244591:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000037d6015a nid 10898@kfi7 refs 1
00000400:00000200:13.0:1773851861.244592:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000037d6015a nid 10898@kfi7 refs 2
00000400:00000200:13.0:1773851861.244593:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000037d6015a nid 10898@kfi7 refs 3
00000400:00000200:13.0:1773851861.244595:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10898@kfi7 local destination
00000400:00000200:13.0:1773851861.244596:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768961:8768961:1024:4294967295] 10898@kfi7 LPNI seq info [551229:551229:16:4294967295]
00000400:00000200:13.0:1773851861.244597:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000037d6015a nid 10898@kfi7 refs 2
00000400:00000200:13.0:1773851861.244598:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10898@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.244600:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10898@kfi7(10898@kfi7:10898@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.244601:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000037d6015a nid 10898@kfi7 refs 3
00000800:00000200:13.0:1773851861.244602:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.244603:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851861.244606:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851861.244608:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x116e Using peer 10898@kfi7(0x116e)
00000800:00000200:13.0:1773851861.244611:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 324 bytes to peer 0x116e: rc=0
00000800:00000200:13.0:1773851861.244612:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x116e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851861.244614:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.244615:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a5392c13 refcount 2 to 10899@kfi7
00010000:00000001:13.0:1773851861.244616:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.244616:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.244617:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851861.244618:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6979a07 x1858044976118144/t0(0) o400->7e90dac2-9caa-4c1a-9bb9-7611eb269d24@10899@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1174-0'
00000100:00100000:13.0:1773851861.244621:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6979a07 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7e90dac2-9caa-4c1a-9bb9-7611eb269d24+160:39734:x1858044976118144:12345-10899@kfi7:400:default-tuolumne1174-0 Request processed in 60us (96us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851861.244623:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10899@kfi7, seq: 2289810
00000100:00000040:13.0:1773851861.244624:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074c509c1 : new rpc_count 0
00000100:00000001:13.0:1773851861.244625:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851861.244625:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:15.0:1773851861.244626:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x116e TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851861.244626:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851861.244626:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007398a894.
00000400:00000200:15.0:1773851861.244627:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851861.244627:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c6d32409.
00000020:00000040:13.0:1773851861.244628:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000074c509c1 : new refcount 159
00000400:00000200:15.0:1773851861.244629:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10898@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.244629:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851861.244630:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002b0682bf
00000400:00000010:15.0:1773851861.244630:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002b0682bf.
00000100:00000001:15.0:1773851861.244631:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851861.244632:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851861.244633:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000037d6015a nid 10898@kfi7 refs 2
00000800:00000200:15.0:1773851861.244635:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 10898@kfi7(00000000709759ca):0x0 lsk 4463 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x116e Transaction freed
00000800:00000200:5.0:1773851861.255711:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.255713:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851861.255716:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851861.255720:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851861.255723:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14547@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.255732:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14547@kfi7 : PUT - for me
00000400:00000200:5.0:1773851861.255734:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14547@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.255735:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8f0a105 nid 14547@kfi7 refs 1
00000400:00000200:5.0:1773851861.255736:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14547@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.255738:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8f0a105 nid 14547@kfi7 refs 2
00000400:00000200:5.0:1773851861.255739:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b8f0a105 nid 14547@kfi7 refs 3
00000400:00000200:5.0:1773851861.255741:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14546@kfi7 to cpt 6
00000400:00000200:5.0:1773851861.255742:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14546@kfi7 of length 224 into portal 12 MB=0x69b190ef58600
00000400:00000200:5.0:1773851861.255744:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14546@kfi7 of length 224/224 into md 0x793926dc5 [64] + 129400
00000800:00000200:5.0:1773851861.255747:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851861.255750:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851861.255752:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14547@kfi7: PUT: OK
00000100:00000001:5.0:1773851861.255754:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851861.255755:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851861.255756:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ede92ee0.
00000100:00000040:5.0:1773851861.255757:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ede92ee0 x1859381787723264 msgsize 224
00000100:00100000:5.0:1773851861.255759:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14546@kfi7 (source: 12345-14547@kfi7)
00000100:00000001:5.0:1773851861.255762:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851861.255763:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8f0a105 nid 14547@kfi7 refs 2
00000800:00000200:5.0:1773851861.255766:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851861.255770:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851861.255771:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851861.255772:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851861.255773:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851861.255774:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851861.255776:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381787723264
00000020:00000001:5.0:1773851861.255777:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851861.255778:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0796768ea2f
00000020:00000001:5.0:1773851861.255779:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851861.255780:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004565b840 refcount=167
00000020:00000001:5.0:1773851861.255781:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637040613218304 : -107033096333312 : ffff9ea76a505800)
00000020:00000001:5.0:1773851861.255783:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637040613218304 : -107033096333312 : ffff9ea76a505800)
00000100:00000001:5.0:1773851861.255784:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.255785:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851861.255786:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851861.255788:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.255789:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006f259d27.
00000100:00000001:5.0:1773851861.255791:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851861.255791:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851861.255792:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.255794:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851861.255794:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851861.255795:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.255797:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851861.255799:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851861.255799:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851861.255800:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851861.255800:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851861.255801:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14546@kfi7, seq: 2001891
00000100:00000001:7.0:1773851861.255803:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851861.255803:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004565b840 : new rpc_count 1
00000100:00000001:7.0:1773851861.255804:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.255804:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866945664 : -107088842605952 : ffff9e9a6f93ba80)
00000100:00000040:5.0:1773851861.255805:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ede92ee0 x1859381787723264/t0(0) o400->d001d61c-6820-4ab0-9e2b-f7db7ab82c4f@14546@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1397-0'
00000100:00000001:5.0:1773851861.255810:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.255810:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851861.255812:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ede92ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:d001d61c-6820-4ab0-9e2b-f7db7ab82c4f+167:39801:x1859381787723264:12345-14546@kfi7:400:default-tuolumne1397-0
00000100:00000200:5.0:1773851861.255814:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381787723264
00000020:00000001:5.0:1773851861.255815:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851861.255816:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851861.255818:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.255819:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851861.255820:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851861.255821:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851861.255822:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381787723264, found 0 last_xid 1859381787298111
00000020:00000001:5.0:1773851861.255823:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851861.255824:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851861.255825:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851861.255826:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.255827:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851861.255828:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851861.255828:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851861.255830:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000014ea6158.
02000000:00000001:5.0:1773851861.255831:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.255832:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.255833:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851861.255834:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062556, transno 0, xid 1859381787723264
00010000:00000001:5.0:1773851861.255835:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851861.255836:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ede92ee0 x1859381787723264/t0(0) o400->d001d61c-6820-4ab0-9e2b-f7db7ab82c4f@14546@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1397-0'
00010000:00000001:5.0:1773851861.255841:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851861.255841:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851861.255843:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=93 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851861.255844:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851861.255845:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008c341960 refcount 3 to 14546@kfi7
00000100:00000001:5.0:1773851861.255847:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643688640 : -107157065862976 : ffff9e8a8d2770c0)
02000000:00000001:5.0:1773851861.255848:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851861.255849:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.255850:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851861.255851:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14547@kfi7
00000400:00000010:5.0:1773851861.255852:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f7d4a8eb.
00000100:00000200:5.0:1773851861.255853:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859381787723264, offset 224
00000400:00000200:5.0:1773851861.255855:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14547@kfi7
00000400:00000200:5.0:1773851861.255857:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14547@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.255858:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8f0a105 nid 14547@kfi7 refs 1
00000400:00000200:5.0:1773851861.255860:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b8f0a105 nid 14547@kfi7 refs 2
00000400:00000200:5.0:1773851861.255862:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b8f0a105 nid 14547@kfi7 refs 3
00000400:00000200:5.0:1773851861.255864:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14547@kfi7 local destination
00000400:00000200:5.0:1773851861.255866:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768962:8768962:1024:4294967295] 14547@kfi7 LPNI seq info [170045:170045:16:4294967295]
00000400:00000200:5.0:1773851861.255868:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b8f0a105 nid 14547@kfi7 refs 2
00000400:00000200:5.0:1773851861.255870:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14547@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.255873:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14547@kfi7(14547@kfi7:14547@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851861.255875:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b8f0a105 nid 14547@kfi7 refs 3
00000800:00000200:5.0:1773851861.255877:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.255879:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851861.255882:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851861.255886:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c73 Using peer 14547@kfi7(0x100000000000c73)
00000800:00000200:5.0:1773851861.255891:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 324 bytes to peer 0x100000000000c73: rc=0
00000800:00000200:5.0:1773851861.255893:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c73 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851861.255896:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851861.255898:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008c341960 refcount 2 to 14546@kfi7
00010000:00000001:5.0:1773851861.255899:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851861.255900:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.255901:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851861.255902:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ede92ee0 x1859381787723264/t0(0) o400->d001d61c-6820-4ab0-9e2b-f7db7ab82c4f@14546@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1397-0'
00000800:00000200:6.0:1773851861.255907:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c73 TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851861.255907:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ede92ee0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:d001d61c-6820-4ab0-9e2b-f7db7ab82c4f+167:39801:x1859381787723264:12345-14546@kfi7:400:default-tuolumne1397-0 Request processed in 96us (149us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851861.255910:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851861.255911:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14547@kfi7: PUT: OK
00000100:00100000:5.0:1773851861.255911:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14546@kfi7, seq: 2001891
00000400:00000200:6.0:1773851861.255912:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f7d4a8eb
00000100:00000040:5.0:1773851861.255912:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004565b840 : new rpc_count 0
00000400:00000010:6.0:1773851861.255913:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f7d4a8eb.
00000100:00000001:6.0:1773851861.255915:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851861.255915:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851861.255917:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8f0a105 nid 14547@kfi7 refs 2
00000800:00000200:6.0:1773851861.255919:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14547@kfi7(000000009fd5fb50):0x0 lsk 3188 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000c73 Transaction freed
00000100:00000001:5.0:1773851861.255924:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851861.255924:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851861.255925:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.255926:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006f259d27.
00000020:00000010:5.0:1773851861.255928:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:5.0:1773851861.255929:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004565b840 : new refcount 166
00000100:00000001:5.0:1773851861.255930:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851861.262907:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.262908:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.262910:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.262914:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.262917:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.262931:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2074@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.262932:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.262933:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851861.262935:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.262937:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851861.262938:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851861.262939:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.262941:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee0b3c0
00000400:00000200:29.0:1773851861.262943:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x77ec58b3d [256] + 20776
00000800:00000200:29.0:1773851861.262947:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.262949:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.262951:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2074@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.262952:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.262953:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:29.0:1773851861.262954:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b01d5dd2.
00000100:00000040:29.0:1773851861.262955:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000b01d5dd2 x1858059204867008 msgsize 224
00000100:00100000:29.0:1773851861.262958:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2074@kfi7)
00000100:00000001:29.0:1773851861.262960:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851861.262961:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:30.0:1773851861.262963:0:157090:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851861.262963:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:30.0:1773851861.262964:0:157090:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851861.262965:0:157090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851861.262966:0:157090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851861.262968:0:157090:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851861.262969:0:157090:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204867008
00000020:00000001:30.0:1773851861.262971:0:157090:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851861.262971:0:157090:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:30.0:1773851861.262972:0:157090:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851861.262975:0:157090:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:30.0:1773851861.262976:0:157090:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:30.0:1773851861.262978:0:157090:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:30.0:1773851861.262980:0:157090:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851861.262981:0:157090:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851861.262983:0:157090:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851861.262985:0:157090:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851861.262986:0:157090:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065770fbe.
00000100:00000040:30.0:1773851861.262988:0:157090:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:30.0:1773851861.262990:0:157090:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851861.262991:0:157090:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851861.262991:0:157090:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.262994:0:157090:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.262995:0:157090:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851861.262998:0:157090:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.262998:0:41218:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851861.262999:0:157090:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.262999:0:41218:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851861.263001:0:41218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 6571510
00000100:00000001:30.0:1773851861.263002:0:157090:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.263002:0:41218:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:30.0:1773851861.263003:0:157090:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.263003:0:41218:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221515264 : -106948488036352 : ffff9ebb1d5c8000)
00000100:00000040:28.0:1773851861.263005:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b01d5dd2 x1858059204867008/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:28.0:1773851861.263010:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.263010:0:41218:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851861.263012:0:41218:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b01d5dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52354:x1858059204867008:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:28.0:1773851861.263014:0:41218:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204867008
00000020:00000001:28.0:1773851861.263015:0:41218:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851861.263016:0:41218:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851861.263017:0:41218:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.263018:0:41218:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851861.263019:0:41218:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:28.0:1773851861.263020:0:41218:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:28.0:1773851861.263021:0:41218:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851861.263022:0:41218:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851861.263023:0:41218:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851861.263024:0:41218:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.263025:0:41218:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851861.263027:0:41218:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851861.263028:0:41218:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000f2d93b62.
02000000:00000001:28.0:1773851861.263029:0:41218:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.263031:0:41218:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851861.263032:0:41218:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:28.0:1773851861.263033:0:41218:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:28.0:1773851861.263034:0:41218:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:28.0:1773851861.263035:0:41218:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:28.0:1773851861.263037:0:41218:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:28.0:1773851861.263039:0:41218:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851861.263041:0:41218:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204867008
00010000:00000001:28.0:1773851861.263042:0:41218:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851861.263043:0:41218:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b01d5dd2 x1858059204867008/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:588/0 lens 224/368 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:28.0:1773851861.263047:0:41218:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851861.263048:0:41218:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851861.263049:0:41218:0:(import.c:1951:at_measured()) add 1 to 00000000f04ba3b2 time=115 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851861.263051:0:41218:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851861.263052:0:41218:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:28.0:1773851861.263053:0:41218:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:28.0:1773851861.263054:0:41218:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851861.263055:0:41218:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.263056:0:41218:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851861.263058:0:41218:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:28.0:1773851861.263059:0:41218:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000aa6119c.
00000100:00000200:28.0:1773851861.263060:0:41218:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204867008, offset 224
00000400:00000200:28.0:1773851861.263062:0:41218:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:28.0:1773851861.263063:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.263065:0:41218:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:28.0:1773851861.263067:0:41218:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851861.263068:0:41218:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851861.263070:0:41218:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851861.263073:0:41218:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768963:8768963:1024:4294967295] 2074@kfi7 LPNI seq info [23425164:23425164:16:4294967295]
00000400:00000200:28.0:1773851861.263076:0:41218:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851861.263077:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.263080:0:41218:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851861.263082:0:41218:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:28.0:1773851861.263084:0:41218:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851861.263086:0:41218:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:28.0:1773851861.263090:0:41218:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851861.263094:0:41218:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 Using peer 2074@kfi7(0x7a8)
00000800:00000200:28.0:1773851861.263098:0:41218:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 468 bytes to peer 0x7a8: rc=0
00000800:00000200:28.0:1773851861.263101:0:41218:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851861.263104:0:41218:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.263107:0:41218:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:28.0:1773851861.263109:0:41218:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851861.263109:0:41218:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.263111:0:41218:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851861.263112:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b01d5dd2 x1858059204867008/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:588/0 lens 224/368 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:28.0:1773851861.263117:0:41218:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b01d5dd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52354:x1858059204867008:12345-2074@kfi7:41:default-yuba4-0 Request processed in 106us (160us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851861.263121:0:41218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 6571510
00000100:00000040:28.0:1773851861.263122:0:41218:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:28.0:1773851861.263123:0:41218:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851861.263124:0:41218:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851861.263125:0:41218:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:28.0:1773851861.263127:0:41218:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065770fbe.
00000020:00000010:28.0:1773851861.263128:0:41218:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000020:00000040:28.0:1773851861.263131:0:41218:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:28.0:1773851861.263132:0:41218:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851861.263139:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851861.263142:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.263143:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2074@kfi7: PUT: OK
00000400:00000200:29.0:1773851861.263145:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000aa6119c
00000400:00000010:29.0:1773851861.263146:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000aa6119c.
00000100:00000001:29.0:1773851861.263147:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.263148:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.263149:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851861.263151:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 Transaction freed
00000800:00000200:17.0:1773851861.273540:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.273540:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.273542:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.273543:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851861.273545:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.273547:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.47@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851861.273547:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.273548:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851861.273552:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.47@o2ib60 to cpt 0
00000400:00000200:17.0:1773851861.273553:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013e17024 nid 192.168.128.47@o2ib60 refs 2
00000400:00000200:17.0:1773851861.273554:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013e17024 nid 192.168.128.47@o2ib60 refs 3
00000400:00000200:17.0:1773851861.273555:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.47@o2ib60 to cpt 0
00000400:00000200:17.0:1773851861.273556:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.47@o2ib60 of length 224 into portal 12 MB=0x69a3c9695fbc0
00000400:00000200:17.0:1773851861.273558:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.47@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 22752
00000800:00000200:17.0:1773851861.273560:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851861.273561:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.273562:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.273563:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851861.273563:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851861.273564:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ba9cdfd9.
00000100:00000040:17.0:1773851861.273565:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ba9cdfd9 x1858434875390912 msgsize 224
00000100:00100000:17.0:1773851861.273566:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.47@o2ib60 (source: 12345-192.168.128.47@o2ib60)
00000100:00000001:17.0:1773851861.273568:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851861.273569:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851861.273570:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.273571:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.273572:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.273572:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.273573:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.273573:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.273574:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858434875390912
00000020:00000001:0.0:1773851861.273575:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.273575:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dd7
00000020:00000001:0.0:1773851861.273576:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.273577:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000656cfed1 refcount=7
00000020:00000001:0.0:1773851861.273577:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239479296 : -107152470072320 : ffff9e8b9f15a400)
00000020:00000001:0.0:1773851861.273578:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239479296 : -107152470072320 : ffff9e8b9f15a400)
00000100:00000001:0.0:1773851861.273579:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.273580:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.273581:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b71b1f21.
00000020:00000010:0.0:1773851861.273582:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.273583:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.273584:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.273584:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.273585:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.273586:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.273586:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.273587:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.273588:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.273589:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.273589:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.273590:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.273591:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.273591:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.47@o2ib60, seq: 1997534
00000100:00000001:1.0:1773851861.273592:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851861.273592:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.273592:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000656cfed1 : new rpc_count 2
00000100:00000001:0.0:1773851861.273592:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764341376 : -107095945210240 : ffff9e98c83a9680)
00000100:00000040:0.0:1773851861.273594:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ba9cdfd9 x1858434875390912/t0(0) o400->f220ade3-5682-445b-b86a-d9e335002574@192.168.128.47@o2ib60:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix47-0'
00000100:00000001:0.0:1773851861.273597:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.273598:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.273599:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba9cdfd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f220ade3-5682-445b-b86a-d9e335002574+7:39751:x1858434875390912:12345-192.168.128.47@o2ib60:400:default-matrix47-0
00000100:00000200:0.0:1773851861.273600:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858434875390912
00000020:00000001:0.0:1773851861.273601:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.273602:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.273602:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.273603:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.273604:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.273604:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.273605:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858434875390912, found 0 last_xid 1858434874616063
00000020:00000001:0.0:1773851861.273606:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.273606:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.273607:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.273608:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.273609:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.273609:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.273610:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.273610:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000437b6b0.
02000000:00000001:0.0:1773851861.273611:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.273612:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.273612:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.273613:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183117727568, transno 0, xid 1858434875390912
00010000:00000001:0.0:1773851861.273614:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.273615:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ba9cdfd9 x1858434875390912/t0(0) o400->f220ade3-5682-445b-b86a-d9e335002574@192.168.128.47@o2ib60:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix47-0'
00010000:00000001:0.0:1773851861.273617:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.273617:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.273618:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.273619:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.273621:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009a42333b refcount 3 to 192.168.128.47@o2ib60
00000100:00000001:0.0:1773851861.273621:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994447968 : -107149715103648 : ffff9e8c434b2060)
02000000:00000001:0.0:1773851861.273622:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.273623:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.273623:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.273624:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.47@o2ib60
00000400:00000010:0.0:1773851861.273625:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e89b889f.
00000100:00000200:0.0:1773851861.273626:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858434875390912, offset 224
00000400:00000200:0.0:1773851861.273627:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.47@o2ib60
00000400:00000200:0.0:1773851861.273628:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.47@o2ib60 to cpt 0
00000400:00000200:0.0:1773851861.273629:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013e17024 nid 192.168.128.47@o2ib60 refs 2
00000400:00000200:0.0:1773851861.273630:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013e17024 nid 192.168.128.47@o2ib60 refs 3
00000400:00000200:0.0:1773851861.273632:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013e17024 nid 192.168.128.47@o2ib60 refs 4
00000400:00000200:0.0:1773851861.273633:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.47@o2ib60 routed destination
00000400:00000200:0.0:1773851861.273634:0:60951:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:0.0:1773851861.273635:0:60951:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:0.0:1773851861.273636:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.47@o2ib60: rtr pref emtpy: 1
00000400:00000200:0.0:1773851861.273637:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:0.0:1773851861.273638:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.47@o2ib60: rtr pref emtpy: 1
00000400:00000200:0.0:1773851861.273638:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:0.0:1773851861.273640:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768964:8768964:1024:4294967295] 2094@kfi7 LPNI seq info [1258746986:1258746986:16:4294967295]
00000400:00000200:0.0:1773851861.273641:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:0.0:1773851861.273642:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:0.0:1773851861.273644:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.47@o2ib60(192.168.128.47@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.273646:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013e17024 nid 192.168.128.47@o2ib60 refs 3
00000800:00000200:0.0:1773851861.273647:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.273648:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.273650:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.273653:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:0.0:1773851861.273656:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:0.0:1773851861.273658:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.273660:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.273661:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009a42333b refcount 2 to 192.168.128.47@o2ib60
00010000:00000001:0.0:1773851861.273661:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.273662:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.273664:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.273665:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ba9cdfd9 x1858434875390912/t0(0) o400->f220ade3-5682-445b-b86a-d9e335002574@192.168.128.47@o2ib60:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix47-0'
00000100:00100000:0.0:1773851861.273668:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba9cdfd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f220ade3-5682-445b-b86a-d9e335002574+7:39751:x1858434875390912:12345-192.168.128.47@o2ib60:400:default-matrix47-0 Request processed in 70us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.273671:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.47@o2ib60, seq: 1997534
00000100:00000040:0.0:1773851861.273671:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000656cfed1 : new rpc_count 1
00000100:00000001:0.0:1773851861.273672:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.273673:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.273673:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.273674:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.273675:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b71b1f21.
00000020:00000040:0.0:1773851861.273676:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000656cfed1 : new refcount 6
00000100:00000001:0.0:1773851861.273677:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.273682:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.273683:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.273684:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.273685:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e89b889f
00000400:00000010:1.0:1773851861.273686:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e89b889f.
00000100:00000001:1.0:1773851861.273687:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.273687:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.273688:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:1.0:1773851861.273689:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Transaction freed
00000800:00000200:10.0:1773851861.301057:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.301057:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851861.301058:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.301058:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851861.301059:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.301059:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851861.301061:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851861.301061:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11424@kfi7(00000000af8910bc):0xdd9 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851861.301063:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11424@kfi7 to cpt 2
00000800:00000200:9.0:1773851861.301063:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 Using peer 11424@kfi7(0x100000000000dd9)
00000400:00000200:10.0:1773851861.301065:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11424@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.301065:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11424@kfi7 to cpt 2
00000400:00000200:10.0:1773851861.301066:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11424@kfi7 to cpt 2
00000400:00000200:10.0:1773851861.301067:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009109ef98 nid 11424@kfi7 refs 1
00000800:00000200:9.0:1773851861.301067:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 38 bytes to peer 0x100000000000dd9: rc=0
00000800:00000200:9.0:1773851861.301069:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851861.301071:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11424@kfi7 to cpt 2
00000400:00000200:10.0:1773851861.301071:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009109ef98 nid 11424@kfi7 refs 2
00000400:00000200:10.0:1773851861.301072:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009109ef98 nid 11424@kfi7 refs 3
00000400:00000200:10.0:1773851861.301073:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11425@kfi7 to cpt 5
00000400:00000200:10.0:1773851861.301074:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11425@kfi7 of length 224 into portal 12 MB=0x69b4bfc84eb40
00000400:00000200:10.0:1773851861.301075:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11425@kfi7 of length 224/224 into md 0x78146ce49 [64] + 129040
00000800:00000200:10.0:1773851861.301077:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851861.301079:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851861.301080:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11424@kfi7: PUT: OK
00000100:00000001:10.0:1773851861.301081:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851861.301081:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851861.301082:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd643a58.
00000800:00000200:9.0:1773851861.301082:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851861.301083:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000dd643a58 x1859600521685824 msgsize 224
00000100:00100000:10.0:1773851861.301084:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-11425@kfi7 (source: 12345-11424@kfi7)
00000800:00000200:9.0:1773851861.301084:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 Transaction freed
00000100:00000001:10.0:1773851861.301085:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851861.301086:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009109ef98 nid 11424@kfi7 refs 2
00000100:00000001:11.0:1773851861.301087:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851861.301087:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851861.301088:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851861.301088:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851861.301088:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851861.301089:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851861.301090:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600521685824
00000020:00000001:11.0:1773851861.301090:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851861.301091:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d84c01
00000020:00000001:11.0:1773851861.301091:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851861.301094:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c3cd16d6 refcount=5
00000020:00000001:11.0:1773851861.301095:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142633389056 : -106931076162560 : ffff9ebf2b309c00)
00000020:00000001:11.0:1773851861.301095:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142633389056 : -106931076162560 : ffff9ebf2b309c00)
00000100:00000001:11.0:1773851861.301097:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851861.301098:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851861.301098:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006c3ed247.
00000020:00000010:11.0:1773851861.301099:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851861.301100:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a4701f2.
00000100:00000001:11.0:1773851861.301101:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851861.301101:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851861.301101:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851861.301102:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851861.301103:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851861.301103:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851861.301104:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851861.301106:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.301106:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851861.301106:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.301106:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.301107:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11425@kfi7, seq: 2130756
00000100:00000001:11.0:1773851861.301108:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.301108:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c3cd16d6 : new rpc_count 1
00000100:00000001:11.0:1773851861.301109:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.301109:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610172032 : -107030099379584 : ffff9ea81cf23a80)
00000100:00000040:9.0:1773851861.301110:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dd643a58 x1859600521685824/t0(0) o400->63c9b6ba-bf02-4a62-a6d5-f1f6960df17e@11425@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1200-0'
00000100:00000001:9.0:1773851861.301114:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.301114:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.301115:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd643a58 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:63c9b6ba-bf02-4a62-a6d5-f1f6960df17e+5:39481:x1859600521685824:12345-11425@kfi7:400:default-tuolumne1200-0
00000100:00000200:9.0:1773851861.301117:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600521685824
00000020:00000001:9.0:1773851861.301117:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.301118:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.301119:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.301119:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.301120:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.301121:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.301122:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600521685824, found 0 last_xid 1859600521685823
00000020:00000001:9.0:1773851861.301123:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.301123:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.301125:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.301125:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.301126:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.301126:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.301127:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.301128:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000050a2a715.
02000000:00000001:9.0:1773851861.301129:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.301129:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.301130:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.301131:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254359118, transno 0, xid 1859600521685824
00010000:00000001:9.0:1773851861.301132:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.301132:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dd643a58 x1859600521685824/t0(0) o400->63c9b6ba-bf02-4a62-a6d5-f1f6960df17e@11425@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1200-0'
00010000:00000001:9.0:1773851861.301135:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.301136:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.301136:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.301138:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.301138:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000071210b1e refcount 3 to 11425@kfi7
00000100:00000001:9.0:1773851861.301139:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026720 : -107156745524896 : ffff9e8aa03f6960)
02000000:00000001:9.0:1773851861.301140:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.301141:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.301141:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.301142:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11424@kfi7
00000400:00000010:9.0:1773851861.301143:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000200:9.0:1773851861.301144:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600521685824, offset 224
00000400:00000200:9.0:1773851861.301145:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11424@kfi7
00000400:00000200:9.0:1773851861.301146:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11424@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.301147:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009109ef98 nid 11424@kfi7 refs 1
00000400:00000200:9.0:1773851861.301148:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009109ef98 nid 11424@kfi7 refs 2
00000400:00000200:9.0:1773851861.301149:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009109ef98 nid 11424@kfi7 refs 3
00000400:00000200:9.0:1773851861.301150:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11424@kfi7 local destination
00000400:00000200:9.0:1773851861.301152:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768965:8768965:1024:4294967295] 11424@kfi7 LPNI seq info [262232:262232:16:4294967295]
00000400:00000200:9.0:1773851861.301153:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009109ef98 nid 11424@kfi7 refs 2
00000400:00000200:9.0:1773851861.301155:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11424@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.301157:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11424@kfi7(11424@kfi7:11424@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.301158:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009109ef98 nid 11424@kfi7 refs 3
00000800:00000200:9.0:1773851861.301160:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.301161:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.301163:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.301165:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 Using peer 11424@kfi7(0x100000000000dd9)
00000800:00000200:9.0:1773851861.301168:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x100000000000dd9: rc=0
00000800:00000200:9.0:1773851861.301169:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.301171:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.301172:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000071210b1e refcount 2 to 11425@kfi7
00010000:00000001:9.0:1773851861.301173:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.301173:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.301174:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.301175:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd643a58 x1859600521685824/t0(0) o400->63c9b6ba-bf02-4a62-a6d5-f1f6960df17e@11425@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1200-0'
00000100:00100000:9.0:1773851861.301178:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd643a58 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:63c9b6ba-bf02-4a62-a6d5-f1f6960df17e+5:39481:x1859600521685824:12345-11425@kfi7:400:default-tuolumne1200-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851861.301180:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11425@kfi7, seq: 2130756
00000100:00000040:9.0:1773851861.301181:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c3cd16d6 : new rpc_count 0
00000100:00000001:9.0:1773851861.301182:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:10.0:1773851861.301183:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851861.301183:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851861.301183:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:10.0:1773851861.301184:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851861.301184:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a4701f2.
00000400:00000200:10.0:1773851861.301185:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11424@kfi7: PUT: OK
00000020:00000010:9.0:1773851861.301185:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006c3ed247.
00000400:00000200:10.0:1773851861.301186:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000020:00000040:9.0:1773851861.301186:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000c3cd16d6 : new refcount 4
00000400:00000010:10.0:1773851861.301187:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000100:00000001:10.0:1773851861.301188:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851861.301188:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851861.301189:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009109ef98 nid 11424@kfi7 refs 2
00000100:00000001:9.0:1773851861.301189:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851861.301190:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 11424@kfi7(00000000af8910bc):0x0 lsk 3546 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dd9 Transaction freed
00000800:00000200:29.0:1773851861.305075:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.305076:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.305077:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.305079:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.305081:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11889@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.305082:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11889@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.305083:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11889@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.305084:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ecb1138 nid 11889@kfi7 refs 1
00000400:00000200:29.0:1773851861.305085:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11889@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.305085:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ecb1138 nid 11889@kfi7 refs 2
00000400:00000200:29.0:1773851861.305086:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ecb1138 nid 11889@kfi7 refs 3
00000400:00000200:29.0:1773851861.305087:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11953@kfi7 to cpt 3
00000400:00000200:29.0:1773851861.305088:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11953@kfi7 of length 224 into portal 12 MB=0x69b4b5e85ee80
00000400:00000200:29.0:1773851861.305089:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11953@kfi7 of length 224/224 into md 0x77fe139dd [64] + 169408
00000800:00000200:29.0:1773851861.305091:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.305093:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.305094:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11889@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.305095:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.305095:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.305096:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036759c4c.
00000100:00000040:29.0:1773851861.305096:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000036759c4c x1859597870952064 msgsize 224
00000100:00100000:29.0:1773851861.305098:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11953@kfi7 (source: 12345-11889@kfi7)
00000100:00000001:29.0:1773851861.305099:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851861.305100:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ecb1138 nid 11889@kfi7 refs 2
00000800:00000200:29.0:1773851861.305101:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851861.305101:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851861.305101:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851861.305102:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851861.305102:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851861.305103:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851861.305104:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597870952064
00000020:00000001:28.0:1773851861.305105:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851861.305105:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d77e19
00000020:00000001:28.0:1773851861.305106:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851861.305110:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000878c1c97 refcount=167
00000020:00000001:28.0:1773851861.305111:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637089094803456 : -106984614748160 : ffff9eb2b40aa000)
00000020:00000001:28.0:1773851861.305112:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637089094803456 : -106984614748160 : ffff9eb2b40aa000)
00000100:00000001:28.0:1773851861.305113:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.305114:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851861.305115:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000041347fd5.
00000020:00000010:28.0:1773851861.305116:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851861.305117:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095ed4c73.
00000100:00000001:28.0:1773851861.305118:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851861.305118:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851861.305119:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851861.305120:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851861.305120:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851861.305121:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.305122:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.305123:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.305123:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.305124:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.305124:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851861.305125:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11953@kfi7, seq: 2055494
00000100:00000040:28.0:1773851861.305125:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000878c1c97 : new rpc_count 1
00000100:00000001:31.0:1773851861.305126:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.305126:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.305126:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125221518720 : -106948488032896 : ffff9ebb1d5c8d80)
00000100:00000040:28.0:1773851861.305127:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036759c4c x1859597870952064/t0(0) o400->5d86713b-2b9d-42ca-a4a5-f95d329c9652@11953@kfi7:649/0 lens 224/0 e 0 to 0 dl 1773852009 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1230-0'
00000100:00000001:28.0:1773851861.305130:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.305131:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851861.305132:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036759c4c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:5d86713b-2b9d-42ca-a4a5-f95d329c9652+167:39693:x1859597870952064:12345-11953@kfi7:400:default-tuolumne1230-0
00000100:00000200:28.0:1773851861.305134:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597870952064
00000020:00000001:28.0:1773851861.305135:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851861.305135:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851861.305136:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.305137:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851861.305137:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851861.305138:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851861.305139:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597870952064, found 0 last_xid 1859597870527551
00000020:00000001:28.0:1773851861.305140:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851861.305140:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851861.305141:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851861.305141:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.305142:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851861.305143:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851861.305143:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851861.305143:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ede70ba4.
02000000:00000001:28.0:1773851861.305144:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.305145:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.305145:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851861.305146:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063349, transno 0, xid 1859597870952064
00010000:00000001:28.0:1773851861.305147:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851861.305147:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036759c4c x1859597870952064/t0(0) o400->5d86713b-2b9d-42ca-a4a5-f95d329c9652@11953@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1230-0'
00010000:00000001:28.0:1773851861.305150:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851861.305150:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851861.305151:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851861.305152:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851861.305152:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003cbac848 refcount 3 to 11953@kfi7
00000100:00000001:28.0:1773851861.305153:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729297632 : -107155980253984 : ffff9e8acddc84e0)
02000000:00000001:28.0:1773851861.305154:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851861.305154:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.305155:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851861.305156:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11889@kfi7
00000400:00000010:28.0:1773851861.305157:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000919a9384.
00000100:00000200:28.0:1773851861.305158:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597870952064, offset 224
00000400:00000200:28.0:1773851861.305159:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11889@kfi7
00000400:00000200:28.0:1773851861.305160:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11889@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.305161:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ecb1138 nid 11889@kfi7 refs 1
00000400:00000200:28.0:1773851861.305162:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ecb1138 nid 11889@kfi7 refs 2
00000400:00000200:28.0:1773851861.305163:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ecb1138 nid 11889@kfi7 refs 3
00000400:00000200:28.0:1773851861.305164:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11889@kfi7 local destination
00000400:00000200:28.0:1773851861.305165:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768966:8768966:1024:4294967295] 11889@kfi7 LPNI seq info [4519246:4519246:16:4294967295]
00000400:00000200:28.0:1773851861.305167:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ecb1138 nid 11889@kfi7 refs 2
00000400:00000200:28.0:1773851861.305167:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11889@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.305169:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11889@kfi7(11889@kfi7:11889@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851861.305171:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ecb1138 nid 11889@kfi7 refs 3
00000800:00000200:28.0:1773851861.305172:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851861.305173:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851861.305175:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851861.305177:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ae4 Using peer 11889@kfi7(0x100000000000ae4)
00000800:00000200:28.0:1773851861.305181:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x100000000000ae4: rc=0
00000800:00000200:28.0:1773851861.305182:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ae4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851861.305184:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.305185:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003cbac848 refcount 2 to 11953@kfi7
00010000:00000001:28.0:1773851861.305186:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851861.305186:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.305187:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851861.305188:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036759c4c x1859597870952064/t0(0) o400->5d86713b-2b9d-42ca-a4a5-f95d329c9652@11953@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1230-0'
00000100:00100000:28.0:1773851861.305193:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036759c4c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:5d86713b-2b9d-42ca-a4a5-f95d329c9652+167:39693:x1859597870952064:12345-11953@kfi7:400:default-tuolumne1230-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851861.305195:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11953@kfi7, seq: 2055494
00000100:00000040:28.0:1773851861.305196:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000878c1c97 : new rpc_count 0
00000100:00000001:28.0:1773851861.305197:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851861.305197:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851861.305198:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851861.305198:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095ed4c73.
00000020:00000010:28.0:1773851861.305199:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000041347fd5.
00000020:00000040:28.0:1773851861.305200:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000878c1c97 : new refcount 166
00000100:00000001:28.0:1773851861.305200:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851861.305205:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ae4 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851861.305208:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.305209:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11889@kfi7: PUT: OK
00000400:00000200:29.0:1773851861.305210:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000919a9384
00000400:00000010:29.0:1773851861.305211:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000919a9384.
00000100:00000001:29.0:1773851861.305211:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.305212:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.305213:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ecb1138 nid 11889@kfi7 refs 2
00000800:00000200:29.0:1773851861.305214:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 11889@kfi7(00000000bbff750f):0x0 lsk 2789 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ae4 Transaction freed
00000800:00000200:9.0:1773851861.317692:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.317693:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.317694:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.317696:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.317698:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16097@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.317699:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16097@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.317700:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16097@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.317702:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000262b6379 nid 16097@kfi7 refs 1
00000400:00000200:9.0:1773851861.317703:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16097@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.317704:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000262b6379 nid 16097@kfi7 refs 2
00000400:00000200:9.0:1773851861.317705:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000262b6379 nid 16097@kfi7 refs 3
00000400:00000200:9.0:1773851861.317706:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16096@kfi7 to cpt 7
00000400:00000200:9.0:1773851861.317707:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16096@kfi7 of length 224 into portal 12 MB=0x69b4b90535e00
00000400:00000200:9.0:1773851861.317708:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16096@kfi7 of length 224/224 into md 0x78146ce49 [64] + 129264
00000800:00000200:9.0:1773851861.317710:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.317712:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.317713:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16097@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.317714:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.317715:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.317716:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d752d235.
00000100:00000040:9.0:1773851861.317717:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d752d235 x1859598706499072 msgsize 224
00000100:00100000:9.0:1773851861.317719:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-16096@kfi7 (source: 12345-16097@kfi7)
00000100:00000001:9.0:1773851861.317720:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.317721:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000262b6379 nid 16097@kfi7 refs 2
00000800:00000200:9.0:1773851861.317723:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.317730:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851861.317730:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851861.317731:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.317732:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.317733:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.317733:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598706499072
00000020:00000001:9.0:1773851861.317734:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851861.317734:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d800cd
00000020:00000001:9.0:1773851861.317735:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851861.317739:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003343d51f refcount=164
00000020:00000001:9.0:1773851861.317740:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636992402837504 : -107081306714112 : ffff9e9c30c05000)
00000020:00000001:9.0:1773851861.317741:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636992402837504 : -107081306714112 : ffff9e9c30c05000)
00000100:00000001:9.0:1773851861.317742:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.317743:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851861.317743:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851861.317745:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.317745:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851861.317746:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851861.317747:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851861.317747:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.317748:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851861.317749:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851861.317749:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.317750:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851861.317752:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.317752:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851861.317752:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.317752:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.317753:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16096@kfi7, seq: 2130757
00000100:00000001:11.0:1773851861.317754:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.317754:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003343d51f : new rpc_count 1
00000100:00000001:11.0:1773851861.317755:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.317755:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922895872 : -107141786655744 : ffff9e8e1bdda400)
00000100:00000040:9.0:1773851861.317756:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d752d235 x1859598706499072/t0(0) o400->9f4565ea-41b8-4988-9d56-b588e79f976b@16096@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1487-0'
00000100:00000001:9.0:1773851861.317758:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.317759:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.317760:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d752d235 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9f4565ea-41b8-4988-9d56-b588e79f976b+164:39602:x1859598706499072:12345-16096@kfi7:400:default-tuolumne1487-0
00000100:00000200:9.0:1773851861.317761:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598706499072
00000020:00000001:9.0:1773851861.317763:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.317763:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.317764:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.317765:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.317765:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.317766:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.317766:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598706499072, found 0 last_xid 1859598706075839
00000020:00000001:9.0:1773851861.317767:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.317768:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.317768:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.317769:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.317769:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.317770:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.317771:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.317771:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e59692ec.
02000000:00000001:9.0:1773851861.317772:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.317772:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.317773:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.317774:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062272, transno 0, xid 1859598706499072
00010000:00000001:9.0:1773851861.317775:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.317775:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d752d235 x1859598706499072/t0(0) o400->9f4565ea-41b8-4988-9d56-b588e79f976b@16096@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1487-0'
00010000:00000001:9.0:1773851861.317778:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.317778:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.317779:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.317780:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.317781:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008004e751 refcount 3 to 16096@kfi7
00000100:00000001:9.0:1773851861.317781:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271872 : -107152618279744 : ffff9e8b96402cc0)
02000000:00000001:9.0:1773851861.317782:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.317783:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.317783:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.317784:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16097@kfi7
00000400:00000010:9.0:1773851861.317785:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000347c88aa.
00000100:00000200:9.0:1773851861.317786:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598706499072, offset 224
00000400:00000200:9.0:1773851861.317787:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16097@kfi7
00000400:00000200:9.0:1773851861.317788:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16097@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.317789:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000262b6379 nid 16097@kfi7 refs 1
00000400:00000200:9.0:1773851861.317791:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000262b6379 nid 16097@kfi7 refs 2
00000400:00000200:9.0:1773851861.317792:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000262b6379 nid 16097@kfi7 refs 3
00000400:00000200:9.0:1773851861.317793:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16097@kfi7 local destination
00000400:00000200:9.0:1773851861.317794:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768967:8768967:1024:4294967295] 16097@kfi7 LPNI seq info [591490:591490:16:4294967295]
00000400:00000200:9.0:1773851861.317796:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000262b6379 nid 16097@kfi7 refs 2
00000400:00000200:9.0:1773851861.317796:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16097@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.317798:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16097@kfi7(16097@kfi7:16097@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.317799:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000262b6379 nid 16097@kfi7 refs 3
00000800:00000200:9.0:1773851861.317801:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.317802:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.317804:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.317806:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa35 Using peer 16097@kfi7(0xa35)
00000800:00000200:9.0:1773851861.317809:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0xa35: rc=0
00000800:00000200:9.0:1773851861.317810:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa35 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.317812:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.317813:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008004e751 refcount 2 to 16096@kfi7
00010000:00000001:9.0:1773851861.317814:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.317814:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.317815:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.317815:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d752d235 x1859598706499072/t0(0) o400->9f4565ea-41b8-4988-9d56-b588e79f976b@16096@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1487-0'
00000100:00100000:9.0:1773851861.317818:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d752d235 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9f4565ea-41b8-4988-9d56-b588e79f976b+164:39602:x1859598706499072:12345-16096@kfi7:400:default-tuolumne1487-0 Request processed in 59us (101us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851861.317821:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa35 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851861.317821:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16096@kfi7, seq: 2130757
00000100:00000040:9.0:1773851861.317822:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003343d51f : new rpc_count 0
00000100:00000001:9.0:1773851861.317823:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851861.317823:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851861.317824:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851861.317824:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851861.317825:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16097@kfi7: PUT: OK
00000400:00000200:10.0:1773851861.317825:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000347c88aa
00000020:00000010:9.0:1773851861.317825:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000010:10.0:1773851861.317826:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000347c88aa.
00000020:00000010:9.0:1773851861.317826:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851861.317826:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000003343d51f : new refcount 163
00000100:00000001:10.0:1773851861.317827:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851861.317827:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851861.317827:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851861.317828:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000262b6379 nid 16097@kfi7 refs 2
00000800:00000200:10.0:1773851861.317829:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 16097@kfi7(0000000084b6ff11):0x0 lsk 2614 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa35 Transaction freed
00000004:00000001:7.0:1773851861.321732:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851861.321733:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851861.321734:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001bbc782a.
00000020:00000040:7.0:1773851861.321735:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851861.321735:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851861.321736:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851861.321737:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851861.321738:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d46f64ea.
00000100:00000001:7.0:1773851861.321739:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851861.321740:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851861.321741:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851861.321742:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001bbc782a] to pc [ptlrpcd_01_03+3]  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851861.321747:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:7.0:1773851861.321749:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000053a6c80b.
00080000:00000001:7.0:1773851861.321749:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637129396029440 : -106944313522176 : ffff9ebc162e8800)
00000100:00000001:5.0:1773851861.321749:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851861.321749:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:7.0:1773851861.321750:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851861.321750:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321750:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851861.321751:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:7.0:1773851861.321753:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851861.321753:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:7.0:1773851861.321754:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000004:00000010:7.0:1773851861.321755:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a5f9be4a.
00000004:00080000:7.0:1773851861.321756:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614135775031644ns, next at 614136775030281ns, rc = 0
00080000:00000001:7.0:1773851861.321757:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851861.321757:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:7.0:1773851861.321758:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321758:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851861.321759:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851861.321759:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851861.321760:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851861.321762:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001bbc782a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051925760:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851861.321764:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851861.321765:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851861.321765:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851861.321766:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851861.321768:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004e2bbea7.
02000000:00000001:4.0:1773851861.321769:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851861.321771:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:4.0:1773851861.321772:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000400:00000010:4.0:1773851861.321773:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:4.0:1773851861.321775:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925760, portal 4
00000100:00000001:4.0:1773851861.321776:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851861.321777:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309145472 : -106994400406144 : ffff9eb06cc55580)
00000100:00000040:4.0:1773851861.321779:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851861.321783:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851861.321784:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851861.321785:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b96d8a3.
00000100:00000200:4.0:1773851861.321786:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925760, offset 0
00000400:00000200:4.0:1773851861.321789:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851861.321790:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851861.321792:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851861.321793:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851861.321797:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851861.321798:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851861.321801:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8768967, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8768966, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851861.321804:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851861.321805:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851861.321807:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851861.321808:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768968:8768968:1024:4294967295] 2099@kfi7 LPNI seq info [5403429:5403429:16:4294967295]
00000400:00000200:4.0:1773851861.321811:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851861.321812:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851861.321816:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851861.321818:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851861.321821:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851861.321823:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851861.321827:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851861.321831:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Using peer 2099@kfi7(0x2000000000002c4)
00000800:00000200:4.0:1773851861.321836:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x2000000000002c4: rc=0
00000800:00000200:4.0:1773851861.321839:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851861.321842:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321845:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851861.321846:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321848:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321849:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851861.321851:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851861.321851:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851861.321853:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851861.321853:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851861.321859:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851861.321859:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321860:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851861.321861:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851861.321862:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851861.321863:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b96d8a3
00000400:00000010:5.0:1773851861.321864:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b96d8a3.
00000100:00000001:5.0:1773851861.321864:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851861.321865:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851861.321868:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851861.321868:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851861.321871:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.321872:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851861.321873:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851861.321874:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Transaction freed
00000800:00000200:17.0:1773851861.321885:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.321886:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.321887:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.321889:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851861.321891:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.321892:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.321892:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.321893:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851861.321894:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.321894:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851861.321896:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851861.321897:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.321897:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2d00
00000400:00000200:17.0:1773851861.321898:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.321900:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f0b51 [1] + 224
00000800:00000200:17.0:1773851861.321901:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851861.321903:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.321903:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.321905:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851861.321906:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851861.321908:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851861.321912:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851861.321913:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851861.321914:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851861.321915:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851861.321916:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851861.321917:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851861.321918:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851861.321919:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851861.321920:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851861.321920:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:4.0:1773851861.321922:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851861.321923:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851861.321928:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851861.321932:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851861.321933:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851861.321934:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851861.321935:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851861.321936:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851861.321937:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851861.321938:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851861.321939:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=94 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851861.321941:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=94 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851861.321943:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851861.321943:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851861.321944:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851861.321945:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321947:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851861.321947:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851861.321949:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851861.321949:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851861.321951:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851861.321955:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851861.321956:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851861.321957:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851861.321959:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851861.321959:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851861.321961:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409117184 avail=351407043584 avail_mb=1372683764 hwm_mb=3131101 files=372011349 ffree=343172966 state=0: rc = 0
00000004:00000020:4.0:1773851861.321963:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409117184 free, 351407043584 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011349 files, 343172966 free files
00000004:00000001:4.0:1773851861.321966:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851861.321967:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851861.321972:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001bbc782a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051925760:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851861.321974:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851861.321975:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851861.321976:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001bbc782a x1859433051925760/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851861.321980:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851861.321981:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851861.321981:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004e2bbea7.
02000000:00000001:4.0:1773851861.321983:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851861.321984:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851861.321984:0:41067:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851861.321985:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851861.321986:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d46f64ea.
02000000:00000001:4.0:1773851861.321987:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851861.321988:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851861.321989:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001bbc782a.
00000100:00000001:4.0:1773851861.321990:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851861.321990:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851861.321991:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851861.321993:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851861.321993:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851861.321994:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851861.321995:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851861.344064:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.344066:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.344067:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.344069:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.344071:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12529@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.344072:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12529@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.344073:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12529@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.344073:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000513cec4e nid 12529@kfi7 refs 1
00000400:00000200:13.0:1773851861.344074:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12529@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.344075:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000513cec4e nid 12529@kfi7 refs 2
00000400:00000200:13.0:1773851861.344076:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000513cec4e nid 12529@kfi7 refs 3
00000400:00000200:13.0:1773851861.344077:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12529@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.344078:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12529@kfi7 of length 224 into portal 12 MB=0x69b4b849d6040
00000400:00000200:13.0:1773851861.344079:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12529@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 23528
00000800:00000200:13.0:1773851861.344081:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851861.344082:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.344083:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12529@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.344084:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851861.344085:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851861.344086:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000082515cf7.
00000100:00000040:13.0:1773851861.344087:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000082515cf7 x1859598510022720 msgsize 224
00000100:00100000:13.0:1773851861.344088:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12529@kfi7 (source: 12345-12529@kfi7)
00000100:00000001:13.0:1773851861.344089:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.344090:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000513cec4e nid 12529@kfi7 refs 2
00000800:00000200:13.0:1773851861.344091:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c12e940: 2069@kfi7:3 <- 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851861.344094:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851861.344094:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851861.344095:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851861.344096:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851861.344097:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851861.344097:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598510022720
00000020:00000001:13.0:1773851861.344098:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851861.344098:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f520
00000020:00000001:13.0:1773851861.344099:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851861.344103:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000045096bf0 refcount=167
00000020:00000001:13.0:1773851861.344104:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959166651392 : -107114542900224 : ffff9e9473b85c00)
00000020:00000001:13.0:1773851861.344104:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959166651392 : -107114542900224 : ffff9e9473b85c00)
00000100:00000001:13.0:1773851861.344105:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.344106:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851861.344107:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064d4ea1c.
00000020:00000010:13.0:1773851861.344108:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851861.344109:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007398a894.
00000100:00000001:13.0:1773851861.344110:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851861.344111:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851861.344111:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.344112:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851861.344112:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851861.344113:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.344114:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.344115:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.344115:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.344115:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851861.344116:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.344116:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12529@kfi7, seq: 2289811
00000100:00000001:15.0:1773851861.344117:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.344117:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.344117:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000045096bf0 : new rpc_count 1
00000100:00000001:13.0:1773851861.344118:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637071537148416 : -107002172403200 : ffff9eae9d861200)
00000100:00000040:13.0:1773851861.344119:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000082515cf7 x1859598510022720/t0(0) o400->bef101e9-3dff-4771-937a-ffe70e4a12ca@12529@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1261-0'
00000100:00000001:13.0:1773851861.344121:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.344122:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.344122:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082515cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bef101e9-3dff-4771-937a-ffe70e4a12ca+167:39764:x1859598510022720:12345-12529@kfi7:400:default-tuolumne1261-0
00000100:00000200:13.0:1773851861.344124:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598510022720
00000020:00000001:13.0:1773851861.344124:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.344126:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.344126:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.344127:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.344127:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.344128:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.344129:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598510022720, found 0 last_xid 1859598509601023
00000020:00000001:13.0:1773851861.344130:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.344130:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.344131:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.344131:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.344132:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.344132:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851861.344133:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.344134:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bec325fa.
02000000:00000001:13.0:1773851861.344134:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.344135:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.344136:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.344136:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062917, transno 0, xid 1859598510022720
00010000:00000001:13.0:1773851861.344137:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851861.344138:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000082515cf7 x1859598510022720/t0(0) o400->bef101e9-3dff-4771-937a-ffe70e4a12ca@12529@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1261-0'
00010000:00000001:13.0:1773851861.344140:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851861.344141:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851861.344142:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851861.344143:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.344144:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e9a7414c refcount 3 to 12529@kfi7
00000100:00000001:13.0:1773851861.344144:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298400 : -107155980253216 : ffff9e8acddc87e0)
02000000:00000001:13.0:1773851861.344145:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851861.344146:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.344146:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.344147:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12529@kfi7
00000400:00000010:13.0:1773851861.344148:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000084e43b96.
00000100:00000200:13.0:1773851861.344148:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598510022720, offset 224
00000400:00000200:13.0:1773851861.344150:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12529@kfi7
00000400:00000200:13.0:1773851861.344150:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12529@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.344154:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000513cec4e nid 12529@kfi7 refs 1
00000400:00000200:13.0:1773851861.344155:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000513cec4e nid 12529@kfi7 refs 2
00000400:00000200:13.0:1773851861.344156:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000513cec4e nid 12529@kfi7 refs 3
00000400:00000200:13.0:1773851861.344157:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12529@kfi7 local destination
00000400:00000200:13.0:1773851861.344158:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768969:8768969:1024:4294967295] 12529@kfi7 LPNI seq info [1811345:1811345:16:4294967295]
00000400:00000200:13.0:1773851861.344160:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000513cec4e nid 12529@kfi7 refs 2
00000400:00000200:13.0:1773851861.344160:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12529@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.344162:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12529@kfi7(12529@kfi7:12529@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.344163:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000513cec4e nid 12529@kfi7 refs 3
00000800:00000200:13.0:1773851861.344164:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.344165:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851861.344167:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851861.344169:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x175 Using peer 12529@kfi7(0x175)
00000800:00000200:13.0:1773851861.344172:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000006c12e940: Posted send of 324 bytes to peer 0x175: rc=0
00000800:00000200:13.0:1773851861.344174:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x175 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851861.344176:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.344176:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e9a7414c refcount 2 to 12529@kfi7
00010000:00000001:13.0:1773851861.344177:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.344178:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.344178:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851861.344179:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000082515cf7 x1859598510022720/t0(0) o400->bef101e9-3dff-4771-937a-ffe70e4a12ca@12529@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1261-0'
00000100:00100000:13.0:1773851861.344182:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082515cf7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bef101e9-3dff-4771-937a-ffe70e4a12ca+167:39764:x1859598510022720:12345-12529@kfi7:400:default-tuolumne1261-0 Request processed in 59us (94us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851861.344184:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12529@kfi7, seq: 2289811
00000100:00000040:13.0:1773851861.344185:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000045096bf0 : new rpc_count 0
00000800:00000200:14.0:1773851861.344186:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x175 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851861.344186:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851861.344187:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851861.344187:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851861.344187:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851861.344188:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12529@kfi7: PUT: OK
00000020:00000010:13.0:1773851861.344188:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007398a894.
00000400:00000200:14.0:1773851861.344189:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000084e43b96
00000020:00000010:13.0:1773851861.344189:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064d4ea1c.
00000400:00000010:14.0:1773851861.344190:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000084e43b96.
00000020:00000040:13.0:1773851861.344190:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000045096bf0 : new refcount 166
00000100:00000001:14.0:1773851861.344191:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851861.344191:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:13.0:1773851861.344191:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851861.344192:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000513cec4e nid 12529@kfi7 refs 2
00000800:00000200:14.0:1773851861.344193:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2069@kfi7:3 -> 12529@kfi7(000000002fa897a5):0x0 lsk 374 rsk 23 tsk 0 trmk 0 tmk 0 trr 3 tta 0x175 Transaction freed
00000800:00000200:21.0:1773851861.347144:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851861.347144:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851861.347145:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851861.347147:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851861.347149:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26578@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.347150:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26578@kfi7 : PUT - for me
00000400:00000200:21.0:1773851861.347151:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26578@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.347151:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006810f6d3 nid 26578@kfi7 refs 1
00000400:00000200:21.0:1773851861.347152:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26578@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.347153:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006810f6d3 nid 26578@kfi7 refs 2
00000400:00000200:21.0:1773851861.347154:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006810f6d3 nid 26578@kfi7 refs 3
00000400:00000200:21.0:1773851861.347154:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26578@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.347155:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26578@kfi7 of length 224 into portal 12 MB=0x699e750f06b40
00000400:00000200:21.0:1773851861.347157:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26578@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 31016
00000800:00000200:21.0:1773851861.347158:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851861.347160:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851861.347160:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26578@kfi7: PUT: OK
00000100:00000001:21.0:1773851861.347161:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851861.347162:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851861.347163:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bf029f1b.
00000100:00000040:21.0:1773851861.347163:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000bf029f1b x1858068634692416 msgsize 224
00000100:00100000:21.0:1773851861.347165:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-26578@kfi7 (source: 12345-26578@kfi7)
00000100:00000001:21.0:1773851861.347165:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851861.347167:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851861.347167:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006810f6d3 nid 26578@kfi7 refs 2
02000000:00000001:23.0:1773851861.347168:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851861.347168:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851861.347169:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851861.347169:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851861.347169:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00100000:23.0:1773851861.347171:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858068634692416
00000020:00000001:23.0:1773851861.347171:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851861.347172:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926b9
00000020:00000001:23.0:1773851861.347172:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851861.347175:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f6ac7fd refcount=20
00000020:00000001:23.0:1773851861.347176:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631255040 : -107123078296576 : ffff9e9276f88c00)
00000020:00000001:23.0:1773851861.347177:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631255040 : -107123078296576 : ffff9e9276f88c00)
00000100:00000001:23.0:1773851861.347178:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.347178:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851861.347179:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094554af3.
00000020:00000010:23.0:1773851861.347180:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851861.347181:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851861.347182:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851861.347182:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851861.347183:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.347184:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851861.347184:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851861.347185:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.347185:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.347187:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851861.347187:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851861.347187:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851861.347188:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26578@kfi7, seq: 1997954
00000100:00000001:22.0:1773851861.347188:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851861.347189:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f6ac7fd : new rpc_count 8
00000100:00000001:23.0:1773851861.347189:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637057733485312 : -107015976066304 : ffff9eab66c2e300)
00000100:00000001:22.0:1773851861.347189:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851861.347189:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.347191:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bf029f1b x1858068634692416/t0(0) o400->9a397082-c833-42f8-9bae-0377ad59b12d@26578@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne2149-0'
00000100:00000001:23.0:1773851861.347193:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.347194:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851861.347195:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf029f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:9a397082-c833-42f8-9bae-0377ad59b12d+20:40714:x1858068634692416:12345-26578@kfi7:400:login-tuolumne2149-0
00000100:00000200:23.0:1773851861.347196:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858068634692416
00000020:00000001:23.0:1773851861.347197:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851861.347197:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000800:00000200:21.0:1773851861.363890:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851861.363891:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851861.363892:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851861.363892:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851861.363894:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851861.363894:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17457@kfi7(00000000609d5675):0xf96 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851861.363896:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851861.363896:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 Using peer 17457@kfi7(0xf96)
00000400:00000200:21.0:1773851861.363897:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17457@kfi7 to cpt 5
00000800:00000200:22.0:1773851861.363899:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851861.363900:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000184df75a: Posted send of 38 bytes to peer 0xf96: rc=0
00000800:00000200:21.0:1773851861.363901:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851861.363902:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17457@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.363904:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17457@kfi7 : PUT - for me
00000400:00000200:22.0:1773851861.363906:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17457@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.363907:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000491e14ec nid 17457@kfi7 refs 1
00000400:00000200:22.0:1773851861.363908:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17457@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.363910:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000491e14ec nid 17457@kfi7 refs 2
00000400:00000200:22.0:1773851861.363911:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000491e14ec nid 17457@kfi7 refs 3
00000400:00000200:22.0:1773851861.363912:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17649@kfi7 to cpt 0
00000400:00000200:22.0:1773851861.363914:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17649@kfi7 of length 224 into portal 12 MB=0x69b62033e1b40
00000800:00000200:21.0:1773851861.363914:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851861.363916:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17649@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 31240
00000800:00000200:21.0:1773851861.363916:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 Transaction freed
00000800:00000200:22.0:1773851861.363918:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851861.363921:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851861.363923:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17457@kfi7: PUT: OK
00000100:00000001:22.0:1773851861.363924:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851861.363925:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851861.363926:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007b6151e7.
00000100:00000040:22.0:1773851861.363927:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000007b6151e7 x1859695123766080 msgsize 224
00000100:00100000:22.0:1773851861.363929:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-17649@kfi7 (source: 12345-17457@kfi7)
00000100:00000001:22.0:1773851861.363931:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851861.363932:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000491e14ec nid 17457@kfi7 refs 2
00000800:00000200:22.0:1773851861.363934:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851861.363939:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851861.363941:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851861.363943:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851861.363943:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851861.363945:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851861.363947:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859695123766080
00000020:00000001:22.0:1773851861.363948:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851861.363949:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f081566e3701
00000020:00000001:22.0:1773851861.363951:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851861.363955:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000025a67d0 refcount=169
00000020:00000001:22.0:1773851861.363957:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130169073664 : -106943540477952 : ffff9ebc44424000)
00000020:00000001:22.0:1773851861.363958:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130169073664 : -106943540477952 : ffff9ebc44424000)
00000100:00000001:22.0:1773851861.363961:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851861.363962:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851861.363964:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c205ab6a.
00000020:00000010:22.0:1773851861.363966:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851861.363968:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851861.363970:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851861.363971:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851861.363972:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851861.363975:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851861.363976:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851861.363976:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851861.363980:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851861.363982:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851861.363982:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851861.363984:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17649@kfi7, seq: 1997955
00000100:00000040:22.0:1773851861.363985:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000025a67d0 : new rpc_count 1
00000100:00000001:20.0:1773851861.363985:0:60531:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851861.363986:0:60531:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851861.363987:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619607040 : -107003089944576 : ffff9eae66d58000)
00000100:00000001:20.0:1773851861.363987:0:60531:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851861.363988:0:60531:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851861.363989:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007b6151e7 x1859695123766080/t0(0) o400->a655c6da-8b04-40b4-9137-c5762235c3dd@17649@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1581-0'
00000100:00000001:22.0:1773851861.363995:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851861.363996:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851861.363997:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b6151e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:a655c6da-8b04-40b4-9137-c5762235c3dd+169:39390:x1859695123766080:12345-17649@kfi7:400:default-tuolumne1581-0
00000100:00000200:22.0:1773851861.364003:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859695123766080
00000020:00000001:22.0:1773851861.364004:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851861.364006:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851861.364007:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851861.364008:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851861.364009:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851861.364011:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851861.364012:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859695123766080, found 0 last_xid 1859695123342143
00000020:00000001:22.0:1773851861.364014:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851861.364015:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851861.364016:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851861.364017:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851861.364018:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851861.364020:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851861.364021:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851861.364023:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d1d5b0e0.
02000000:00000001:22.0:1773851861.364024:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851861.364025:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851861.364027:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851861.364028:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061592, transno 0, xid 1859695123766080
00010000:00000001:22.0:1773851861.364030:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851861.364031:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007b6151e7 x1859695123766080/t0(0) o400->a655c6da-8b04-40b4-9137-c5762235c3dd@17649@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1581-0'
00010000:00000001:22.0:1773851861.364037:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851861.364038:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851861.364039:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=94 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851861.364042:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851861.364043:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004e752533 refcount 3 to 17649@kfi7
00000100:00000001:22.0:1773851861.364044:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049664 : -107154804501952 : ffff9e8b13f11240)
02000000:00000001:22.0:1773851861.364046:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851861.364046:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851861.364048:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851861.364049:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17457@kfi7
00000400:00000010:22.0:1773851861.364050:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001a3c4634.
00000100:00000200:22.0:1773851861.364053:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859695123766080, offset 224
00000400:00000200:22.0:1773851861.364055:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17457@kfi7
00000400:00000200:22.0:1773851861.364058:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17457@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.364059:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000491e14ec nid 17457@kfi7 refs 1
00000400:00000200:22.0:1773851861.364061:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000491e14ec nid 17457@kfi7 refs 2
00000400:00000200:22.0:1773851861.364063:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000491e14ec nid 17457@kfi7 refs 3
00000400:00000200:22.0:1773851861.364065:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17457@kfi7 local destination
00000400:00000200:22.0:1773851861.364068:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768970:8768970:1024:4294967295] 17457@kfi7 LPNI seq info [973916:973916:16:4294967295]
00000400:00000200:22.0:1773851861.364071:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000491e14ec nid 17457@kfi7 refs 2
00000400:00000200:22.0:1773851861.364072:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17457@kfi7 to cpt 5
00000400:00000200:22.0:1773851861.364076:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17457@kfi7(17457@kfi7:17457@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851861.364078:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000491e14ec nid 17457@kfi7 refs 3
00000800:00000200:22.0:1773851861.364081:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851861.364083:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851861.364087:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851861.364092:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 Using peer 17457@kfi7(0xf96)
00000800:00000200:22.0:1773851861.364097:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000007ee9d6e: Posted send of 324 bytes to peer 0xf96: rc=0
00000800:00000200:22.0:1773851861.364100:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851861.364104:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851861.364105:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004e752533 refcount 2 to 17649@kfi7
00010000:00000001:22.0:1773851861.364107:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851861.364108:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851861.364109:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851861.364110:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007b6151e7 x1859695123766080/t0(0) o400->a655c6da-8b04-40b4-9137-c5762235c3dd@17649@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1581-0'
00000800:00000200:21.0:1773851861.364112:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851861.364113:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851861.364114:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17457@kfi7: PUT: OK
00000400:00000200:21.0:1773851861.364115:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001a3c4634
00000400:00000010:21.0:1773851861.364115:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001a3c4634.
00000100:00100000:22.0:1773851861.364116:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b6151e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:a655c6da-8b04-40b4-9137-c5762235c3dd+169:39390:x1859695123766080:12345-17649@kfi7:400:default-tuolumne1581-0 Request processed in 119us (187us total) trans 0 rc 0/0
00000100:00000001:21.0:1773851861.364116:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851861.364116:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851861.364117:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000491e14ec nid 17457@kfi7 refs 2
00000800:00000200:21.0:1773851861.364119:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17457@kfi7(00000000609d5675):0x0 lsk 3991 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf96 Transaction freed
00000100:00100000:22.0:1773851861.364120:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17649@kfi7, seq: 1997955
00000100:00000040:22.0:1773851861.364122:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000025a67d0 : new rpc_count 0
00000100:00000001:22.0:1773851861.364123:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851861.364124:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851861.364125:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851861.364127:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851861.364129:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c205ab6a.
00000020:00000040:22.0:1773851861.364130:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000025a67d0 : new refcount 168
00000100:00000001:22.0:1773851861.364132:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851861.367245:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.367246:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851861.367246:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851861.367247:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851861.367252:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858068634692416, found 0 last_xid 1858046240820223
00000020:00000001:23.0:1773851861.367252:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851861.367253:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851861.367253:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851861.367254:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.367254:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851861.367255:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851861.367255:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851861.367257:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dbd6402b.
02000000:00000001:23.0:1773851861.367258:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.367259:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.367259:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851861.367260:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183222908683, transno 0, xid 1858068634692416
00010000:00000001:23.0:1773851861.367260:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851861.367262:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bf029f1b x1858068634692416/t0(0) o400->9a397082-c833-42f8-9bae-0377ad59b12d@26578@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2149-0'
00010000:00000001:23.0:1773851861.367264:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851861.367265:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851861.367265:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=94 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851861.367266:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851861.367267:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000392b75c2 refcount 3 to 26578@kfi7
00000100:00000001:23.0:1773851861.367268:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095264 : -107139307456352 : ffff9e8eafa338a0)
02000000:00000001:23.0:1773851861.367268:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851861.367268:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.367269:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851861.367270:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26578@kfi7
00000400:00000010:23.0:1773851861.367271:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002ad30f6f.
00000100:00000200:23.0:1773851861.367272:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858068634692416, offset 224
00000400:00000200:23.0:1773851861.367273:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26578@kfi7
00000400:00000200:23.0:1773851861.367274:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26578@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.367275:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006810f6d3 nid 26578@kfi7 refs 1
00000400:00000200:23.0:1773851861.367277:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006810f6d3 nid 26578@kfi7 refs 2
00000400:00000200:23.0:1773851861.367278:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006810f6d3 nid 26578@kfi7 refs 3
00000400:00000200:23.0:1773851861.367279:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26578@kfi7 local destination
00000400:00000200:23.0:1773851861.367281:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768971:8768971:1024:4294967295] 26578@kfi7 LPNI seq info [32294355:32294355:16:4294967295]
00000400:00000200:23.0:1773851861.367282:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006810f6d3 nid 26578@kfi7 refs 2
00000400:00000200:23.0:1773851861.367283:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26578@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.367285:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26578@kfi7(26578@kfi7:26578@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851861.367286:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006810f6d3 nid 26578@kfi7 refs 3
00000800:00000200:23.0:1773851861.367289:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851861.367290:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851861.367292:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851861.367294:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x30000000000079e Using peer 26578@kfi7(0x30000000000079e)
00000800:00000200:23.0:1773851861.367299:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x30000000000079e: rc=0
00000800:00000200:23.0:1773851861.367300:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x30000000000079e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851861.367302:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.367302:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000392b75c2 refcount 2 to 26578@kfi7
00010000:00000001:23.0:1773851861.367303:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851861.367303:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.367304:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851861.367304:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bf029f1b x1858068634692416/t0(0) o400->9a397082-c833-42f8-9bae-0377ad59b12d@26578@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2149-0'
00000100:00100000:23.0:1773851861.367307:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf029f1b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:9a397082-c833-42f8-9bae-0377ad59b12d+20:40714:x1858068634692416:12345-26578@kfi7:400:login-tuolumne2149-0 Request processed in 20113us (20143us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851861.367310:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26578@kfi7, seq: 1997954
00000100:00000040:23.0:1773851861.367311:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f6ac7fd : new rpc_count 7
00000100:00000001:23.0:1773851861.367311:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851861.367312:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851861.367313:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851861.367313:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x30000000000079e TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851861.367314:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851861.367315:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094554af3.
00000400:00000200:21.0:1773851861.367315:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:23.0:1773851861.367316:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000003f6ac7fd : new refcount 19
00000400:00000200:21.0:1773851861.367316:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26578@kfi7: PUT: OK
00000400:00000200:21.0:1773851861.367316:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002ad30f6f
00000400:00000010:21.0:1773851861.367316:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002ad30f6f.
00000100:00000001:23.0:1773851861.367317:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851861.367317:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851861.367317:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851861.367318:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006810f6d3 nid 26578@kfi7 refs 2
00000800:00000200:21.0:1773851861.367319:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 26578@kfi7(00000000402b61ff):0x0 lsk 1951 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x30000000000079e Transaction freed
00000800:00000200:17.0:1773851861.367421:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851861.367422:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851861.367423:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.367423:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:19.0:1773851861.367424:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.367425:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:19.0:1773851861.367427:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851861.367428:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15171@kfi7(00000000c5a3473c):0x5db version: 2; local version 2; negotiated version: 2
00000400:00000200:19.0:1773851861.367429:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15171@kfi7 to cpt 4
00000800:00000200:17.0:1773851861.367430:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db Using peer 15171@kfi7(0x5db)
00000400:00000200:19.0:1773851861.367431:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15171@kfi7 : PUT - for me
00000400:00000200:19.0:1773851861.367432:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15171@kfi7 to cpt 4
00000400:00000200:19.0:1773851861.367433:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c67e0cde nid 15171@kfi7 refs 1
00000400:00000200:19.0:1773851861.367435:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15171@kfi7 to cpt 4
00000400:00000200:19.0:1773851861.367436:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c67e0cde nid 15171@kfi7 refs 2
00000400:00000200:19.0:1773851861.367437:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c67e0cde nid 15171@kfi7 refs 3
00000400:00000200:17.0:1773851861.367438:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15171@kfi7 to cpt 4
00000400:00000200:19.0:1773851861.367439:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15170@kfi7 to cpt 1
00000400:00000200:19.0:1773851861.367441:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15170@kfi7 of length 224 into portal 12 MB=0x69af276a40cc0
00000800:00000200:17.0:1773851861.367441:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x5db: rc=0
00000400:00000200:19.0:1773851861.367443:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15170@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 2016
00000800:00000200:17.0:1773851861.367443:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:19.0:1773851861.367446:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851861.367448:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851861.367449:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15171@kfi7: PUT: OK
00000100:00000001:19.0:1773851861.367450:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851861.367451:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851861.367452:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000029951dab.
00000100:00000040:19.0:1773851861.367453:0:2464491:0:(events.c:358:request_in_callback()) incoming req@0000000029951dab x1859216023489728 msgsize 224
00000100:00100000:19.0:1773851861.367455:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-15170@kfi7 (source: 12345-15171@kfi7)
00000100:00000001:19.0:1773851861.367457:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851861.367457:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851861.367458:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c67e0cde nid 15171@kfi7 refs 2
00000800:00000200:19.0:1773851861.367460:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851861.367460:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851861.367461:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db Transaction freed
02000000:00000001:16.0:1773851861.367462:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.367463:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851861.367464:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.367466:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.367467:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859216023489728
00000020:00000001:16.0:1773851861.367468:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.367468:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929de
00000020:00000001:16.0:1773851861.367469:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.367471:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000012e67495 refcount=6
00000020:00000001:16.0:1773851861.367472:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743181312 : -107128966370304 : ffff9e911803ac00)
00000020:00000001:16.0:1773851861.367473:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743181312 : -107128966370304 : ffff9e911803ac00)
00000100:00000001:16.0:1773851861.367475:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.367476:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851861.367477:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000ac9f40b.
00000020:00000010:16.0:1773851861.367479:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.367480:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:16.0:1773851861.367481:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.367481:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.367482:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851861.367483:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851861.367484:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851861.367484:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.367485:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851861.367487:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851861.367487:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851861.367488:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851861.367488:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851861.367489:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15170@kfi7, seq: 2156291
00000100:00000001:19.0:1773851861.367490:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851861.367490:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000012e67495 : new rpc_count 1
00000100:00000001:19.0:1773851861.367491:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.367491:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339149056 : -106987370402560 : ffff9eb20fcaad00)
00000100:00000040:16.0:1773851861.367493:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000029951dab x1859216023489728/t0(0) o400->a7cff12b-06e7-4da7-80a5-dd9f4b44e1fe@15170@kfi7:82/0 lens 224/0 e 0 to 0 dl 1773852197 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1448-0'
00000100:00000001:16.0:1773851861.367499:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.367500:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851861.367501:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029951dab pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:a7cff12b-06e7-4da7-80a5-dd9f4b44e1fe+6:80333:x1859216023489728:12345-15170@kfi7:400:default-tuolumne1448-0
00000100:00000200:16.0:1773851861.367502:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859216023489728
00000020:00000001:16.0:1773851861.367503:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851861.367504:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851861.367505:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.367505:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851861.367506:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851861.367507:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851861.367508:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859216023489728, found 0 last_xid 1859216023489727
00000020:00000001:16.0:1773851861.367509:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851861.367509:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851861.367510:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851861.367511:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.367511:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851861.367512:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851861.367513:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851861.367514:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0218e43.
02000000:00000001:16.0:1773851861.367514:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.367515:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.367516:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851861.367517:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044145359, transno 0, xid 1859216023489728
00010000:00000001:16.0:1773851861.367517:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851861.367518:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000029951dab x1859216023489728/t0(0) o400->a7cff12b-06e7-4da7-80a5-dd9f4b44e1fe@15170@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1448-0'
00010000:00000001:16.0:1773851861.367521:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851861.367522:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851861.367523:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=94 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851861.367524:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851861.367525:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000048491727 refcount 3 to 15170@kfi7
00000100:00000001:16.0:1773851861.367526:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327300192 : -107155382251424 : ffff9e8af1815060)
02000000:00000001:16.0:1773851861.367527:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851861.367528:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.367528:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851861.367529:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15171@kfi7
00000400:00000010:16.0:1773851861.367530:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000090de02a.
00000100:00000200:16.0:1773851861.367531:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859216023489728, offset 224
00000400:00000200:16.0:1773851861.367533:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15171@kfi7
00000400:00000200:16.0:1773851861.367534:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15171@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.367535:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c67e0cde nid 15171@kfi7 refs 1
00000400:00000200:16.0:1773851861.367536:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c67e0cde nid 15171@kfi7 refs 2
00000400:00000200:16.0:1773851861.367537:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c67e0cde nid 15171@kfi7 refs 3
00000400:00000200:16.0:1773851861.367539:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15171@kfi7 local destination
00000400:00000200:16.0:1773851861.367540:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768972:8768972:1024:4294967295] 15171@kfi7 LPNI seq info [441597:441597:16:4294967295]
00000400:00000200:16.0:1773851861.367542:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c67e0cde nid 15171@kfi7 refs 2
00000400:00000200:16.0:1773851861.367542:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15171@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.367545:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15171@kfi7(15171@kfi7:15171@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851861.367546:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c67e0cde nid 15171@kfi7 refs 3
00000800:00000200:16.0:1773851861.367548:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851861.367549:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851861.367552:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851861.367554:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db Using peer 15171@kfi7(0x5db)
00000800:00000200:16.0:1773851861.367557:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009aebe925: Posted send of 324 bytes to peer 0x5db: rc=0
00000800:00000200:16.0:1773851861.367559:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851861.367561:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851861.367561:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000048491727 refcount 2 to 15170@kfi7
00010000:00000001:16.0:1773851861.367562:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851861.367563:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.367563:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851861.367564:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000029951dab x1859216023489728/t0(0) o400->a7cff12b-06e7-4da7-80a5-dd9f4b44e1fe@15170@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1448-0'
00000100:00100000:16.0:1773851861.367569:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029951dab pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:a7cff12b-06e7-4da7-80a5-dd9f4b44e1fe+6:80333:x1859216023489728:12345-15170@kfi7:400:default-tuolumne1448-0 Request processed in 69us (116us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851861.367572:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15170@kfi7, seq: 2156291
00000100:00000040:16.0:1773851861.367573:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000012e67495 : new rpc_count 0
00000100:00000001:16.0:1773851861.367573:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.367574:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851861.367574:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.367575:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000020:00000010:16.0:1773851861.367576:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000ac9f40b.
00000020:00000040:16.0:1773851861.367577:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000012e67495 : new refcount 5
00000100:00000001:16.0:1773851861.367578:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851861.367583:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851861.367585:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.367586:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15171@kfi7: PUT: OK
00000400:00000200:17.0:1773851861.367586:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000090de02a
00000400:00000010:17.0:1773851861.367587:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000090de02a.
00000100:00000001:17.0:1773851861.367588:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851861.367588:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851861.367589:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c67e0cde nid 15171@kfi7 refs 2
00000800:00000200:17.0:1773851861.367590:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 15171@kfi7(00000000c5a3473c):0x0 lsk 1500 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5db Transaction freed
00000800:00000200:26.0:1773851861.372041:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.372041:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851861.372042:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.372042:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851861.372043:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.372043:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851861.372045:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851861.372045:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22002@kfi7(00000000389734fd):0x8fe version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851861.372047:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe Using peer 22002@kfi7(0x8fe)
00000400:00000200:26.0:1773851861.372048:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22002@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.372049:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22002@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.372049:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22002@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.372050:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22002@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.372051:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0c87f1c nid 22002@kfi7 refs 1
00000800:00000200:25.0:1773851861.372051:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000055b583f: Posted send of 38 bytes to peer 0x8fe: rc=0
00000400:00000200:26.0:1773851861.372052:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22002@kfi7 to cpt 6
00000800:00000200:25.0:1773851861.372052:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851861.372053:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0c87f1c nid 22002@kfi7 refs 2
00000400:00000200:26.0:1773851861.372054:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b0c87f1c nid 22002@kfi7 refs 3
00000400:00000200:26.0:1773851861.372055:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22002@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.372056:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22002@kfi7 of length 224 into portal 12 MB=0x69b4b6c5f2400
00000400:00000200:26.0:1773851861.372058:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22002@kfi7 of length 224/224 into md 0x16159c6179 [64] + 189944
00000800:00000200:26.0:1773851861.372060:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851861.372064:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851861.372064:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851861.372065:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22002@kfi7: PUT: OK
00000100:00000001:26.0:1773851861.372066:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851861.372066:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851861.372066:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe Transaction freed
00000100:00000010:26.0:1773851861.372067:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003d57fa12.
00000100:00000040:26.0:1773851861.372068:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000003d57fa12 x1859598103290880 msgsize 224
00000100:00100000:26.0:1773851861.372070:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22002@kfi7 (source: 12345-22002@kfi7)
00000100:00000001:26.0:1773851861.372071:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851861.372072:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0c87f1c nid 22002@kfi7 refs 2
00000100:00000001:24.0:1773851861.372072:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851861.372073:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851861.372073:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:26.0:1773851861.372074:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851861.372074:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.372074:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.372075:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598103290880
00000020:00000001:24.0:1773851861.372076:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.372076:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24302beb
00000020:00000001:24.0:1773851861.372077:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.372080:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d711b4d8 refcount=22
00000020:00000001:24.0:1773851861.372081:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636961499193344 : -107112210358272 : ffff9e94fec02000)
00000020:00000001:24.0:1773851861.372082:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636961499193344 : -107112210358272 : ffff9e94fec02000)
00000100:00000001:24.0:1773851861.372083:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.372084:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.372084:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003f57bde1.
00000020:00000010:24.0:1773851861.372085:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.372086:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.372087:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.372087:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.372088:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.372089:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.372089:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.372090:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.372091:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851861.372092:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851861.372092:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851861.372092:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.372092:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851861.372094:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.372094:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22002@kfi7, seq: 2025071
00000100:00000040:24.0:1773851861.372094:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d711b4d8 : new rpc_count 2
00000100:00000001:25.0:1773851861.372095:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.372095:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150710272 : -106980558841344 : ffff9eb3a5cada00)
00000100:00000040:24.0:1773851861.372096:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003d57fa12 x1859598103290880/t0(0) o400->6adfce06-1874-4549-bcd7-31756e5bb1f6@22002@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1849-0'
00000100:00000001:24.0:1773851861.372099:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.372099:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.372101:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003d57fa12 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:6adfce06-1874-4549-bcd7-31756e5bb1f6+22:39484:x1859598103290880:12345-22002@kfi7:400:default-tuolumne1849-0
00000100:00000200:24.0:1773851861.372102:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598103290880
00000020:00000001:24.0:1773851861.372103:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.372104:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.372104:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.372105:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.372105:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.372106:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.372107:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598103290880, found 0 last_xid 1859598099295359
00000020:00000001:24.0:1773851861.372107:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.372108:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.372109:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.372109:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.372110:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.372110:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.372111:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.372112:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007e245e60.
02000000:00000001:24.0:1773851861.372112:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.372113:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.372114:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.372114:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253303495, transno 0, xid 1859598103290880
00010000:00000001:24.0:1773851861.372115:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.372116:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003d57fa12 x1859598103290880/t0(0) o400->6adfce06-1874-4549-bcd7-31756e5bb1f6@22002@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1849-0'
00010000:00000001:24.0:1773851861.372118:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.372119:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.372119:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.372120:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.372121:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c2fc3379 refcount 3 to 22002@kfi7
00000100:00000001:24.0:1773851861.372122:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860128 : -107149578691488 : ffff9e8c4b6c9c60)
02000000:00000001:24.0:1773851861.372123:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.372123:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.372124:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.372125:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22002@kfi7
00000400:00000010:24.0:1773851861.372126:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000043f7937d.
00000100:00000200:24.0:1773851861.372126:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598103290880, offset 224
00000400:00000200:24.0:1773851861.372128:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22002@kfi7
00000400:00000200:24.0:1773851861.372129:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22002@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.372129:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0c87f1c nid 22002@kfi7 refs 1
00000400:00000200:24.0:1773851861.372130:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b0c87f1c nid 22002@kfi7 refs 2
00000400:00000200:24.0:1773851861.372131:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b0c87f1c nid 22002@kfi7 refs 3
00000400:00000200:24.0:1773851861.372132:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22002@kfi7 local destination
00000400:00000200:24.0:1773851861.372133:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768973:8768973:1024:4294967295] 22002@kfi7 LPNI seq info [637963:637963:16:4294967295]
00000400:00000200:24.0:1773851861.372135:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b0c87f1c nid 22002@kfi7 refs 2
00000400:00000200:24.0:1773851861.372135:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22002@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.372137:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22002@kfi7(22002@kfi7:22002@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.372138:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b0c87f1c nid 22002@kfi7 refs 3
00000800:00000200:24.0:1773851861.372139:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.372141:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.372143:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.372145:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe Using peer 22002@kfi7(0x8fe)
00000800:00000200:24.0:1773851861.372148:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0x8fe: rc=0
00000800:00000200:24.0:1773851861.372149:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.372151:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.372152:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c2fc3379 refcount 2 to 22002@kfi7
00010000:00000001:24.0:1773851861.372153:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.372153:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.372154:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.372154:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003d57fa12 x1859598103290880/t0(0) o400->6adfce06-1874-4549-bcd7-31756e5bb1f6@22002@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1849-0'
00000100:00100000:24.0:1773851861.372162:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003d57fa12 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:6adfce06-1874-4549-bcd7-31756e5bb1f6+22:39484:x1859598103290880:12345-22002@kfi7:400:default-tuolumne1849-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.372164:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22002@kfi7, seq: 2025071
00000100:00000040:24.0:1773851861.372165:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d711b4d8 : new rpc_count 1
00000100:00000001:24.0:1773851861.372166:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.372166:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.372167:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.372168:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.372168:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003f57bde1.
00000020:00000040:24.0:1773851861.372169:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000d711b4d8 : new refcount 21
00000100:00000001:24.0:1773851861.372170:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.372174:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851861.372176:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.372177:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22002@kfi7: PUT: OK
00000400:00000200:25.0:1773851861.372178:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000043f7937d
00000400:00000010:25.0:1773851861.372178:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000043f7937d.
00000100:00000001:25.0:1773851861.372179:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.372180:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.372181:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0c87f1c nid 22002@kfi7 refs 2
00000800:00000200:25.0:1773851861.372182:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22002@kfi7(00000000389734fd):0x0 lsk 2303 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fe Transaction freed
00000800:00000200:13.0:1773851861.399685:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.399686:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.399688:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.399690:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.399692:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17121@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.399693:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17121@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.399694:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17121@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.399695:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042791277 nid 17121@kfi7 refs 1
00000400:00000200:13.0:1773851861.399696:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17121@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.399696:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042791277 nid 17121@kfi7 refs 2
00000400:00000200:13.0:1773851861.399697:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042791277 nid 17121@kfi7 refs 3
00000400:00000200:13.0:1773851861.399698:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16929@kfi7 to cpt 0
00000400:00000200:13.0:1773851861.399699:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16929@kfi7 of length 224 into portal 12 MB=0x69b4b5cf5e400
00000400:00000200:13.0:1773851861.399700:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16929@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 23752
00000800:00000200:13.0:1773851861.399702:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851861.399704:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.399705:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17121@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.399706:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851861.399706:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851861.399708:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c027f38f.
00000100:00000040:13.0:1773851861.399708:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c027f38f x1859597844734976 msgsize 224
00000100:00100000:13.0:1773851861.399710:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-16929@kfi7 (source: 12345-17121@kfi7)
00000100:00000001:13.0:1773851861.399711:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.399712:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042791277 nid 17121@kfi7 refs 2
00000800:00000200:13.0:1773851861.399714:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851861.399717:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851861.399717:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851861.399718:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851861.399718:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851861.399719:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851861.399720:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597844734976
00000020:00000001:13.0:1773851861.399721:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851861.399721:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d811e4
00000020:00000001:13.0:1773851861.399722:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851861.399728:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000929577e7 refcount=165
00000020:00000001:13.0:1773851861.399728:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119306436608 : -106954403115008 : ffff9eb9bccb9000)
00000020:00000001:13.0:1773851861.399729:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119306436608 : -106954403115008 : ffff9eb9bccb9000)
00000100:00000001:13.0:1773851861.399730:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.399731:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851861.399732:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064d4ea1c.
00000020:00000010:13.0:1773851861.399733:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851861.399734:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007398a894.
00000100:00000001:13.0:1773851861.399735:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851861.399736:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851861.399736:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.399737:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851861.399738:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851861.399738:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.399739:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.399740:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.399741:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851861.399742:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.399742:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.399742:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16929@kfi7, seq: 2289812
00000100:00000040:13.0:1773851861.399742:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000929577e7 : new rpc_count 1
00000100:00000001:15.0:1773851861.399743:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.399743:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637152534620032 : -106921174931584 : ffff9ec179596780)
00000100:00000001:15.0:1773851861.399744:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.399745:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c027f38f x1859597844734976/t0(0) o400->7b6f2c30-5b3c-4bdb-ae2c-b4abcbb9b49e@16929@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1551-0'
00000100:00000001:13.0:1773851861.399747:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.399747:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.399748:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c027f38f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7b6f2c30-5b3c-4bdb-ae2c-b4abcbb9b49e+165:39707:x1859597844734976:12345-16929@kfi7:400:default-tuolumne1551-0
00000100:00000200:13.0:1773851861.399750:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597844734976
00000020:00000001:13.0:1773851861.399750:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.399751:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.399751:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.399752:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.399753:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.399753:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.399754:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597844734976, found 0 last_xid 1859597844312575
00000020:00000001:13.0:1773851861.399755:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.399755:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.399756:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.399756:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.399757:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.399758:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851861.399758:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.399759:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dc058056.
02000000:00000001:13.0:1773851861.399759:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.399760:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.399761:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.399762:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062507, transno 0, xid 1859597844734976
00010000:00000001:13.0:1773851861.399762:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851861.399763:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c027f38f x1859597844734976/t0(0) o400->7b6f2c30-5b3c-4bdb-ae2c-b4abcbb9b49e@16929@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1551-0'
00010000:00000001:13.0:1773851861.399766:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851861.399766:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851861.399767:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851861.399768:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.399770:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f95faacf refcount 3 to 16929@kfi7
00000100:00000001:13.0:1773851861.399770:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850079776 : -107143859471840 : ffff9e8da050fa20)
02000000:00000001:13.0:1773851861.399771:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851861.399771:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.399772:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.399773:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17121@kfi7
00000400:00000010:13.0:1773851861.399774:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037a1375e.
00000100:00000200:13.0:1773851861.399774:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597844734976, offset 224
00000400:00000200:13.0:1773851861.399776:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17121@kfi7
00000400:00000200:13.0:1773851861.399776:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17121@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.399777:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042791277 nid 17121@kfi7 refs 1
00000400:00000200:13.0:1773851861.399778:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042791277 nid 17121@kfi7 refs 2
00000400:00000200:13.0:1773851861.399779:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042791277 nid 17121@kfi7 refs 3
00000400:00000200:13.0:1773851861.399780:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17121@kfi7 local destination
00000400:00000200:13.0:1773851861.399782:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768974:8768974:1024:4294967295] 17121@kfi7 LPNI seq info [849183:849183:16:4294967295]
00000400:00000200:13.0:1773851861.399783:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042791277 nid 17121@kfi7 refs 2
00000400:00000200:13.0:1773851861.399784:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17121@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.399786:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17121@kfi7(17121@kfi7:17121@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.399787:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042791277 nid 17121@kfi7 refs 3
00000800:00000200:13.0:1773851861.399788:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.399789:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851861.399791:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851861.399793:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000848 Using peer 17121@kfi7(0x100000000000848)
00000800:00000200:13.0:1773851861.399796:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 324 bytes to peer 0x100000000000848: rc=0
00000800:00000200:13.0:1773851861.399798:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000848 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851861.399800:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.399801:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f95faacf refcount 2 to 16929@kfi7
00010000:00000001:13.0:1773851861.399802:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.399802:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.399803:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851861.399804:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c027f38f x1859597844734976/t0(0) o400->7b6f2c30-5b3c-4bdb-ae2c-b4abcbb9b49e@16929@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1551-0'
00000100:00100000:13.0:1773851861.399807:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c027f38f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7b6f2c30-5b3c-4bdb-ae2c-b4abcbb9b49e+165:39707:x1859597844734976:12345-16929@kfi7:400:default-tuolumne1551-0 Request processed in 59us (98us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851861.399809:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16929@kfi7, seq: 2289812
00000100:00000040:13.0:1773851861.399810:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000929577e7 : new rpc_count 0
00000100:00000001:13.0:1773851861.399811:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851861.399811:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851861.399812:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:14.0:1773851861.399813:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000848 TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851861.399813:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007398a894.
00000020:00000010:13.0:1773851861.399814:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064d4ea1c.
00000020:00000040:13.0:1773851861.399814:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000929577e7 : new refcount 164
00000100:00000001:13.0:1773851861.399815:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851861.399816:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851861.399818:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17121@kfi7: PUT: OK
00000400:00000200:14.0:1773851861.399819:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037a1375e
00000400:00000010:14.0:1773851861.399820:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037a1375e.
00000100:00000001:14.0:1773851861.399821:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851861.399822:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851861.399823:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042791277 nid 17121@kfi7 refs 2
00000800:00000200:14.0:1773851861.399825:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 17121@kfi7(00000000ed14dafb):0x0 lsk 2121 rsk 21 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000848 Transaction freed
00000800:00000200:14.0:1773851861.406762:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851861.406763:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851861.406764:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851861.406766:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851861.406768:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24059@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.406769:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24059@kfi7 : PUT - for me
00000400:00000200:14.0:1773851861.406770:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24059@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.406770:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e966d6ad nid 24059@kfi7 refs 1
00000400:00000200:14.0:1773851861.406772:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24059@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.406772:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e966d6ad nid 24059@kfi7 refs 2
00000400:00000200:14.0:1773851861.406773:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e966d6ad nid 24059@kfi7 refs 3
00000400:00000200:14.0:1773851861.406774:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24059@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.406775:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24059@kfi7 of length 224 into portal 12 MB=0x699de8bbd62c0
00000400:00000200:14.0:1773851861.406776:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24059@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 23976
00000800:00000200:14.0:1773851861.406777:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851861.406779:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851861.406780:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24059@kfi7: PUT: OK
00000100:00000001:14.0:1773851861.406781:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851861.406781:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851861.406782:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d57a9782.
00000100:00000040:14.0:1773851861.406782:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000d57a9782 x1858030966497984 msgsize 224
00000100:00100000:14.0:1773851861.406784:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-24059@kfi7 (source: 12345-24059@kfi7)
00000100:00000001:14.0:1773851861.406784:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851861.406785:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e966d6ad nid 24059@kfi7 refs 2
00000800:00000200:14.0:1773851861.406786:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851861.406786:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851861.406786:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851861.406787:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851861.406787:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851861.406788:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851861.406788:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966497984
00000020:00000001:13.0:1773851861.406789:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851861.406789:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f7b
00000020:00000001:13.0:1773851861.406789:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851861.406792:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eb660dd3 refcount=6
00000020:00000001:13.0:1773851861.406792:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239875584 : -107152469676032 : ffff9e8b9f1bb000)
00000020:00000001:13.0:1773851861.406793:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239875584 : -107152469676032 : ffff9e8b9f1bb000)
00000100:00000001:13.0:1773851861.406794:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.406794:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851861.406795:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064d4ea1c.
00000020:00000010:13.0:1773851861.406795:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851861.406797:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007398a894.
00000100:00000001:13.0:1773851861.406797:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851861.406798:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851861.406798:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.406799:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851861.406799:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851861.406799:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.406800:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.406801:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.406802:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.406802:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.406802:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.406802:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24059@kfi7, seq: 2289813
00000100:00000001:15.0:1773851861.406803:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.406803:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eb660dd3 : new rpc_count 1
00000100:00000001:15.0:1773851861.406804:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.406804:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341822208 : -106946367729408 : ffff9ebb9bbdd100)
00000100:00000040:13.0:1773851861.406805:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d57a9782 x1858030966497984/t0(0) o400->3a05153b-fddd-494e-bb28-df6b02fe6ad3@24059@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne262-0'
00000100:00000001:13.0:1773851861.406807:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.406808:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.406809:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d57a9782 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3a05153b-fddd-494e-bb28-df6b02fe6ad3+6:47811:x1858030966497984:12345-24059@kfi7:400:default-tuolumne262-0
00000100:00000200:13.0:1773851861.406810:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966497984
00000020:00000001:13.0:1773851861.406810:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.406811:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.406811:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.406812:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.406812:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.406813:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.406813:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966497984, found 0 last_xid 1858030966497983
00000020:00000001:13.0:1773851861.406814:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.406815:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.406815:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.406815:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.406816:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.406816:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851861.406817:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.406818:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004781ca74.
02000000:00000001:13.0:1773851861.406819:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.406819:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.406820:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.406820:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030966497984
00010000:00000001:13.0:1773851861.406821:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851861.406822:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d57a9782 x1858030966497984/t0(0) o400->3a05153b-fddd-494e-bb28-df6b02fe6ad3@24059@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne262-0'
00010000:00000001:13.0:1773851861.406824:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851861.406824:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851861.406825:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851861.406826:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.406826:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b8e402c refcount 5 to 24059@kfi7
00000100:00000001:13.0:1773851861.406827:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902779648 : -107154806771968 : ffff9e8b13ce6f00)
02000000:00000001:13.0:1773851861.406827:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851861.406828:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.406828:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.406829:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24059@kfi7
00000400:00000010:13.0:1773851861.406830:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007ca08bf6.
00000100:00000200:13.0:1773851861.406830:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966497984, offset 224
00000400:00000200:13.0:1773851861.406831:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24059@kfi7
00000400:00000200:13.0:1773851861.406832:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24059@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.406833:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e966d6ad nid 24059@kfi7 refs 1
00000400:00000200:13.0:1773851861.406834:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e966d6ad nid 24059@kfi7 refs 2
00000400:00000200:13.0:1773851861.406835:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e966d6ad nid 24059@kfi7 refs 3
00000400:00000200:13.0:1773851861.406836:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24059@kfi7 local destination
00000400:00000200:13.0:1773851861.406837:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768975:8768975:1024:4294967295] 24059@kfi7 LPNI seq info [24449:24449:16:4294967295]
00000400:00000200:13.0:1773851861.406839:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e966d6ad nid 24059@kfi7 refs 2
00000400:00000200:13.0:1773851861.406839:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24059@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.406841:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24059@kfi7(24059@kfi7:24059@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.406842:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e966d6ad nid 24059@kfi7 refs 3
00000800:00000200:13.0:1773851861.406843:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.406845:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851861.406847:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851861.406849:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008cb Using peer 24059@kfi7(0x1000000000008cb)
00000800:00000200:13.0:1773851861.406851:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000af8ff251: Posted send of 324 bytes to peer 0x1000000000008cb: rc=0
00000800:00000200:13.0:1773851861.406852:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851861.406854:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.406855:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b8e402c refcount 4 to 24059@kfi7
00010000:00000001:13.0:1773851861.406855:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.406856:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.406856:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851861.406857:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d57a9782 x1858030966497984/t0(0) o400->3a05153b-fddd-494e-bb28-df6b02fe6ad3@24059@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne262-0'
00000100:00100000:13.0:1773851861.406860:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d57a9782 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3a05153b-fddd-494e-bb28-df6b02fe6ad3+6:47811:x1858030966497984:12345-24059@kfi7:400:default-tuolumne262-0 Request processed in 52us (77us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851861.406862:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24059@kfi7, seq: 2289813
00000100:00000040:13.0:1773851861.406863:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eb660dd3 : new rpc_count 0
00000100:00000001:13.0:1773851861.406863:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851861.406864:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851861.406864:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:15.0:1773851861.406865:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008cb TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851861.406865:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007398a894.
00000020:00000010:13.0:1773851861.406865:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064d4ea1c.
00000020:00000040:13.0:1773851861.406866:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000eb660dd3 : new refcount 5
00000100:00000001:13.0:1773851861.406866:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851861.406867:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851861.406868:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24059@kfi7: PUT: OK
00000400:00000200:15.0:1773851861.406869:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007ca08bf6
00000400:00000010:15.0:1773851861.406869:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007ca08bf6.
00000100:00000001:15.0:1773851861.406870:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851861.406870:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851861.406871:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e966d6ad nid 24059@kfi7 refs 2
00000800:00000200:15.0:1773851861.406873:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2054@kfi7:3 -> 24059@kfi7(000000006a0525b7):0x0 lsk 2252 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008cb Transaction freed
00000800:00000200:1.0:1773851861.407282:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.407283:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.407284:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.407286:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.407289:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24058@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.407290:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24058@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.407291:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24058@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.407292:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006257015e nid 24058@kfi7 refs 1
00000400:00000200:1.0:1773851861.407293:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24058@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.407294:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006257015e nid 24058@kfi7 refs 2
00000400:00000200:1.0:1773851861.407295:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006257015e nid 24058@kfi7 refs 3
00000400:00000200:1.0:1773851861.407296:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24059@kfi7 to cpt 3
00000400:00000200:1.0:1773851861.407296:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24059@kfi7 of length 224 into portal 12 MB=0x699de8bbd6a40
00000400:00000200:1.0:1773851861.407298:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24059@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 22976
00000800:00000200:1.0:1773851861.407299:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.407301:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.407303:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24058@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.407303:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.407304:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.407305:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ec1df71.
00000100:00000040:1.0:1773851861.407306:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000002ec1df71 x1858030966499904 msgsize 224
00000100:00100000:1.0:1773851861.407307:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24059@kfi7 (source: 12345-24058@kfi7)
00000100:00000001:1.0:1773851861.407308:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.407309:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006257015e nid 24058@kfi7 refs 2
00000800:00000200:1.0:1773851861.407310:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.407310:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.407310:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.407311:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.407311:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.407312:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.407312:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966499904
00000020:00000001:0.0:1773851861.407313:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.407313:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9124c
00000020:00000001:0.0:1773851861.407314:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.407317:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d92522c7 refcount=6
00000020:00000001:0.0:1773851861.407318:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240520704 : -107152469030912 : ffff9e8b9f258800)
00000020:00000001:0.0:1773851861.407319:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240520704 : -107152469030912 : ffff9e8b9f258800)
00000100:00000001:0.0:1773851861.407320:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.407321:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.407321:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b71b1f21.
00000020:00000010:0.0:1773851861.407323:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.407323:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.407324:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.407325:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.407325:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.407326:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.407326:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.407327:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.407328:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851861.407329:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.407329:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.407329:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.407330:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.407330:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24059@kfi7, seq: 1997535
00000100:00000001:1.0:1773851861.407331:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.407331:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d92522c7 : new rpc_count 1
00000100:00000001:1.0:1773851861.407332:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.407332:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856578944 : -106915852972672 : ffff9ec2b6900d80)
00000100:00000040:0.0:1773851861.407333:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002ec1df71 x1858030966499904/t0(0) o400->47846cb9-328e-4968-8e43-08b856efa877@24059@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne262-0'
00000100:00000001:0.0:1773851861.407335:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.407336:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.407337:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ec1df71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:47846cb9-328e-4968-8e43-08b856efa877+6:47809:x1858030966499904:12345-24059@kfi7:400:default-tuolumne262-0
00000100:00000200:0.0:1773851861.407338:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966499904
00000020:00000001:0.0:1773851861.407339:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.407339:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.407340:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.407341:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.407341:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.407342:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.407343:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966499904, found 0 last_xid 1858030966499903
00000020:00000001:0.0:1773851861.407344:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.407344:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.407345:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.407345:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.407346:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.407346:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.407347:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.407348:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000318eb73f.
02000000:00000001:0.0:1773851861.407348:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.407349:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.407349:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.407350:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768289, transno 0, xid 1858030966499904
00010000:00000001:0.0:1773851861.407351:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.407351:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002ec1df71 x1858030966499904/t0(0) o400->47846cb9-328e-4968-8e43-08b856efa877@24059@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne262-0'
00010000:00000001:0.0:1773851861.407354:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.407354:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.407355:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.407356:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.407357:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b8e402c refcount 5 to 24059@kfi7
00000100:00000001:0.0:1773851861.407357:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902779648 : -107154806771968 : ffff9e8b13ce6f00)
02000000:00000001:0.0:1773851861.407358:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.407358:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.407359:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.407360:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24058@kfi7
00000400:00000010:0.0:1773851861.407360:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a3358ad2.
00000100:00000200:0.0:1773851861.407361:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966499904, offset 224
00000400:00000200:0.0:1773851861.407362:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24058@kfi7
00000400:00000200:0.0:1773851861.407363:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24058@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.407364:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006257015e nid 24058@kfi7 refs 1
00000400:00000200:0.0:1773851861.407365:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006257015e nid 24058@kfi7 refs 2
00000400:00000200:0.0:1773851861.407366:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006257015e nid 24058@kfi7 refs 3
00000400:00000200:0.0:1773851861.407367:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24058@kfi7 local destination
00000400:00000200:0.0:1773851861.407368:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768976:8768976:1024:4294967295] 24058@kfi7 LPNI seq info [24450:24450:16:4294967295]
00000400:00000200:0.0:1773851861.407370:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006257015e nid 24058@kfi7 refs 2
00000400:00000200:0.0:1773851861.407371:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24058@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.407373:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24058@kfi7(24058@kfi7:24058@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.407375:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006257015e nid 24058@kfi7 refs 3
00000800:00000200:0.0:1773851861.407376:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.407377:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.407379:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.407381:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5e7 Using peer 24058@kfi7(0x5e7)
00000800:00000200:0.0:1773851861.407384:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x5e7: rc=0
00000800:00000200:0.0:1773851861.407386:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.407388:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.407389:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b8e402c refcount 4 to 24059@kfi7
00010000:00000001:0.0:1773851861.407389:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.407390:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.407390:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.407391:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002ec1df71 x1858030966499904/t0(0) o400->47846cb9-328e-4968-8e43-08b856efa877@24059@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne262-0'
00000100:00100000:0.0:1773851861.407395:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ec1df71 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:47846cb9-328e-4968-8e43-08b856efa877+6:47809:x1858030966499904:12345-24059@kfi7:400:default-tuolumne262-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.407398:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24059@kfi7, seq: 1997535
00000100:00000040:0.0:1773851861.407399:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d92522c7 : new rpc_count 0
00000100:00000001:0.0:1773851861.407399:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.407400:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.407400:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.407401:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.407402:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b71b1f21.
00000020:00000040:0.0:1773851861.407403:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000d92522c7 : new refcount 5
00000100:00000001:0.0:1773851861.407404:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.407409:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5e7 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.407410:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.407412:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24058@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.407412:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a3358ad2
00000400:00000010:1.0:1773851861.407413:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a3358ad2.
00000100:00000001:1.0:1773851861.407414:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.407414:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.407415:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006257015e nid 24058@kfi7 refs 2
00000800:00000200:1.0:1773851861.407416:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 24058@kfi7(00000000414dec36):0x0 lsk 1512 rsk 88 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5e7 Transaction freed
00000800:00000200:26.0:1773851861.432438:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851861.432439:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851861.432440:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851861.432442:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851861.432444:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16211@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.432446:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16211@kfi7 : PUT - for me
00000400:00000200:26.0:1773851861.432447:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16211@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.432448:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d225e6f6 nid 16211@kfi7 refs 1
00000400:00000200:26.0:1773851861.432449:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16211@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.432450:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d225e6f6 nid 16211@kfi7 refs 2
00000400:00000200:26.0:1773851861.432451:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d225e6f6 nid 16211@kfi7 refs 3
00000400:00000200:26.0:1773851861.432452:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16210@kfi7 to cpt 3
00000400:00000200:26.0:1773851861.432453:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16210@kfi7 of length 224 into portal 12 MB=0x69b4b5757f840
00000400:00000200:26.0:1773851861.432454:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16210@kfi7 of length 224/224 into md 0x16159c6179 [64] + 190168
00000800:00000200:26.0:1773851861.432456:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851861.432458:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851861.432459:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16211@kfi7: PUT: OK
00000100:00000001:26.0:1773851861.432460:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851861.432461:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851861.432462:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a49395e3.
00000100:00000040:26.0:1773851861.432463:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000a49395e3 x1859597750499392 msgsize 224
00000100:00100000:26.0:1773851861.432464:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-16210@kfi7 (source: 12345-16211@kfi7)
00000100:00000001:26.0:1773851861.432465:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851861.432466:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d225e6f6 nid 16211@kfi7 refs 2
00000100:00000001:24.0:1773851861.432467:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851861.432467:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851861.432468:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851861.432468:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.432468:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.432469:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.432470:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597750499392
00000020:00000001:24.0:1773851861.432470:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.432471:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d816e5
00000020:00000001:24.0:1773851861.432471:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.432477:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000417b6975 refcount=169
00000020:00000001:24.0:1773851861.432478:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098014304256 : -106975695247360 : ffff9eb4c7af6800)
00000020:00000001:24.0:1773851861.432479:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098014304256 : -106975695247360 : ffff9eb4c7af6800)
00000100:00000001:24.0:1773851861.432480:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.432481:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.432481:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8ced97a.
00000020:00000010:24.0:1773851861.432482:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.432483:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.432484:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.432484:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.432485:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.432486:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.432488:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.432489:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.432490:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.432491:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851861.432492:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.432492:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851861.432493:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851861.432493:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16210@kfi7, seq: 2025072
00000100:00000040:24.0:1773851861.432493:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000417b6975 : new rpc_count 1
00000100:00000001:25.0:1773851861.432494:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.432494:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150709120 : -106980558842496 : ffff9eb3a5cad580)
00000100:00000001:25.0:1773851861.432495:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.432495:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a49395e3 x1859597750499392/t0(0) o400->c50ff5a4-7248-473e-8fa2-4c9141049526@16210@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1510-0'
00000100:00000001:24.0:1773851861.432498:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.432498:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.432499:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a49395e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:c50ff5a4-7248-473e-8fa2-4c9141049526+169:39727:x1859597750499392:12345-16210@kfi7:400:default-tuolumne1510-0
00000100:00000200:24.0:1773851861.432501:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597750499392
00000020:00000001:24.0:1773851861.432501:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.432502:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.432503:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.432503:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.432504:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.432505:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.432505:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597750499392, found 0 last_xid 1859597750079103
00000020:00000001:24.0:1773851861.432506:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.432507:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.432507:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.432508:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.432508:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.432509:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.432509:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.432510:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000672bd0ce.
02000000:00000001:24.0:1773851861.432511:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.432512:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.432512:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.432513:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062504, transno 0, xid 1859597750499392
00010000:00000001:24.0:1773851861.432514:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.432515:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a49395e3 x1859597750499392/t0(0) o400->c50ff5a4-7248-473e-8fa2-4c9141049526@16210@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1510-0'
00010000:00000001:24.0:1773851861.432517:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.432518:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.432519:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.432520:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.432520:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000112755d7 refcount 3 to 16210@kfi7
00000100:00000001:24.0:1773851861.432521:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637068625336960 : -107005084214656 : ffff9eadeff75a80)
02000000:00000001:24.0:1773851861.432522:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.432522:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.432523:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.432524:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16211@kfi7
00000400:00000010:24.0:1773851861.432524:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cd21ec1b.
00000100:00000200:24.0:1773851861.432525:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597750499392, offset 224
00000400:00000200:24.0:1773851861.432526:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16211@kfi7
00000400:00000200:24.0:1773851861.432527:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16211@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.432528:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d225e6f6 nid 16211@kfi7 refs 1
00000400:00000200:24.0:1773851861.432529:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d225e6f6 nid 16211@kfi7 refs 2
00000400:00000200:24.0:1773851861.432530:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d225e6f6 nid 16211@kfi7 refs 3
00000400:00000200:24.0:1773851861.432532:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16211@kfi7 local destination
00000400:00000200:24.0:1773851861.432533:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768977:8768977:1024:4294967295] 16211@kfi7 LPNI seq info [7859944:7859944:16:4294967295]
00000400:00000200:24.0:1773851861.432535:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d225e6f6 nid 16211@kfi7 refs 2
00000400:00000200:24.0:1773851861.432535:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16211@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.432538:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16211@kfi7(16211@kfi7:16211@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.432539:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d225e6f6 nid 16211@kfi7 refs 3
00000800:00000200:24.0:1773851861.432540:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.432542:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.432544:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.432549:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001234 Using peer 16211@kfi7(0x100000000001234)
00000800:00000200:24.0:1773851861.432553:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000358ab717: Posted send of 324 bytes to peer 0x100000000001234: rc=0
00000800:00000200:24.0:1773851861.432554:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001234 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.432557:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.432558:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000112755d7 refcount 2 to 16210@kfi7
00010000:00000001:24.0:1773851861.432559:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.432559:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.432560:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.432561:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a49395e3 x1859597750499392/t0(0) o400->c50ff5a4-7248-473e-8fa2-4c9141049526@16210@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1510-0'
00000100:00100000:24.0:1773851861.432566:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a49395e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:c50ff5a4-7248-473e-8fa2-4c9141049526+169:39727:x1859597750499392:12345-16210@kfi7:400:default-tuolumne1510-0 Request processed in 67us (102us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.432569:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16210@kfi7, seq: 2025072
00000100:00000040:24.0:1773851861.432570:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000417b6975 : new rpc_count 0
00000100:00000001:24.0:1773851861.432570:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.432571:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.432572:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.432573:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.432573:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8ced97a.
00000020:00000040:24.0:1773851861.432574:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000417b6975 : new refcount 168
00000100:00000001:24.0:1773851861.432575:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.432581:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001234 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851861.432583:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.432584:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16211@kfi7: PUT: OK
00000400:00000200:25.0:1773851861.432585:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cd21ec1b
00000400:00000010:25.0:1773851861.432585:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cd21ec1b.
00000100:00000001:25.0:1773851861.432586:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.432587:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.432588:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d225e6f6 nid 16211@kfi7 refs 2
00000800:00000200:25.0:1773851861.432589:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16211@kfi7(0000000035717b51):0x0 lsk 4661 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001234 Transaction freed
00000800:00000200:17.0:1773851861.436174:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.436174:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.436176:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.436177:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851861.436179:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22033@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.436180:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22033@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.436181:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22033@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.436182:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000386fa25f nid 22033@kfi7 refs 1
00000400:00000200:17.0:1773851861.436182:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22033@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.436183:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000386fa25f nid 22033@kfi7 refs 2
00000400:00000200:17.0:1773851861.436184:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000386fa25f nid 22033@kfi7 refs 3
00000400:00000200:17.0:1773851861.436184:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22033@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.436185:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22033@kfi7 of length 224 into portal 12 MB=0x69b4b5d51b680
00000400:00000200:17.0:1773851861.436186:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22033@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 2240
00000800:00000200:17.0:1773851861.436188:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851861.436190:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.436191:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22033@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.436192:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851861.436192:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851861.436193:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000006629da.
00000100:00000040:17.0:1773851861.436193:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000006629da x1859597850752640 msgsize 224
00000100:00100000:17.0:1773851861.436195:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22033@kfi7 (source: 12345-22033@kfi7)
00000100:00000001:17.0:1773851861.436196:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851861.436196:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000386fa25f nid 22033@kfi7 refs 2
00000100:00000001:16.0:1773851861.436197:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851861.436198:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851861.436198:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.436198:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851861.436199:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.436200:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.436200:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597850752640
00000020:00000001:16.0:1773851861.436201:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.436201:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2431e5fc
00000020:00000001:16.0:1773851861.436202:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.436204:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009370ce1e refcount=5
00000020:00000001:16.0:1773851861.436205:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092422672384 : -106981286879232 : ffff9eb37a65e000)
00000020:00000001:16.0:1773851861.436205:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637092422672384 : -106981286879232 : ffff9eb37a65e000)
00000100:00000001:16.0:1773851861.436206:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.436207:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851861.436207:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:16.0:1773851861.436209:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.436209:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:16.0:1773851861.436210:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.436210:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.436211:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851861.436212:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851861.436213:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851861.436213:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.436214:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851861.436215:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851861.436215:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851861.436215:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851861.436216:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851861.436216:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22033@kfi7, seq: 2156292
00000100:00000001:19.0:1773851861.436217:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851861.436217:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009370ce1e : new rpc_count 1
00000100:00000001:19.0:1773851861.436218:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.436218:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764366720 : -107095945184896 : ffff9e98c83af980)
00000100:00000040:16.0:1773851861.436218:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000006629da x1859597850752640/t0(0) o400->856b865e-41d9-4c6f-9e43-251a387233f6@22033@kfi7:51/0 lens 224/0 e 0 to 0 dl 1773852166 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1873-0'
00000100:00000001:16.0:1773851861.436221:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.436221:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851861.436222:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000006629da pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:856b865e-41d9-4c6f-9e43-251a387233f6+5:39586:x1859597850752640:12345-22033@kfi7:400:default-tuolumne1873-0
00000100:00000200:16.0:1773851861.436224:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597850752640
00000020:00000001:16.0:1773851861.436224:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851861.436225:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851861.436226:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.436226:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851861.436227:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851861.436228:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851861.436228:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597850752640, found 0 last_xid 1859597850752639
00000020:00000001:16.0:1773851861.436229:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851861.436230:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851861.436230:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851861.436231:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.436231:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851861.436232:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851861.436232:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851861.436233:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000beb125b8.
02000000:00000001:16.0:1773851861.436233:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.436234:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.436235:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851861.436235:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684236, transno 0, xid 1859597850752640
00010000:00000001:16.0:1773851861.436236:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851861.436237:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000006629da x1859597850752640/t0(0) o400->856b865e-41d9-4c6f-9e43-251a387233f6@22033@kfi7:51/0 lens 224/224 e 0 to 0 dl 1773852166 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1873-0'
00010000:00000001:16.0:1773851861.436239:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851861.436240:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851861.436241:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=94 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851861.436242:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851861.436242:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000df826a08 refcount 3 to 22033@kfi7
00000100:00000001:16.0:1773851861.436243:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547872 : -107156126003744 : ffff9e8ac52c8de0)
02000000:00000001:16.0:1773851861.436244:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851861.436244:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.436245:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851861.436246:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22033@kfi7
00000400:00000010:16.0:1773851861.436246:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000493fb085.
00000100:00000200:16.0:1773851861.436247:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597850752640, offset 224
00000400:00000200:16.0:1773851861.436248:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22033@kfi7
00000400:00000200:16.0:1773851861.436249:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22033@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.436250:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000386fa25f nid 22033@kfi7 refs 1
00000400:00000200:16.0:1773851861.436251:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000386fa25f nid 22033@kfi7 refs 2
00000400:00000200:16.0:1773851861.436252:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000386fa25f nid 22033@kfi7 refs 3
00000400:00000200:16.0:1773851861.436254:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22033@kfi7 local destination
00000400:00000200:16.0:1773851861.436255:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768978:8768978:1024:4294967295] 22033@kfi7 LPNI seq info [185477:185477:16:4294967295]
00000400:00000200:16.0:1773851861.436256:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000386fa25f nid 22033@kfi7 refs 2
00000400:00000200:16.0:1773851861.436257:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22033@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.436259:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22033@kfi7(22033@kfi7:22033@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851861.436260:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000386fa25f nid 22033@kfi7 refs 3
00000800:00000200:16.0:1773851861.436262:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851861.436263:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851861.436265:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851861.436268:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bf Using peer 22033@kfi7(0x1000000000009bf)
00000800:00000200:16.0:1773851861.436271:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x1000000000009bf: rc=0
00000800:00000200:16.0:1773851861.436273:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851861.436275:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851861.436276:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000df826a08 refcount 2 to 22033@kfi7
00010000:00000001:16.0:1773851861.436277:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851861.436277:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.436278:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851861.436278:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000006629da x1859597850752640/t0(0) o400->856b865e-41d9-4c6f-9e43-251a387233f6@22033@kfi7:51/0 lens 224/224 e 0 to 0 dl 1773852166 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1873-0'
00000100:00100000:16.0:1773851861.436283:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000006629da pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:856b865e-41d9-4c6f-9e43-251a387233f6+5:39586:x1859597850752640:12345-22033@kfi7:400:default-tuolumne1873-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851861.436286:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22033@kfi7, seq: 2156292
00000100:00000040:16.0:1773851861.436286:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009370ce1e : new rpc_count 0
00000100:00000001:16.0:1773851861.436287:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.436288:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851861.436288:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.436289:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000020:00000010:16.0:1773851861.436290:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851861.436291:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000009370ce1e : new refcount 4
00000100:00000001:16.0:1773851861.436291:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851861.436297:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bf TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851861.436299:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.436300:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22033@kfi7: PUT: OK
00000400:00000200:17.0:1773851861.436300:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000493fb085
00000400:00000010:17.0:1773851861.436301:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000493fb085.
00000100:00000001:17.0:1773851861.436301:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851861.436301:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851861.436302:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000386fa25f nid 22033@kfi7 refs 2
00000800:00000200:17.0:1773851861.436304:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 22033@kfi7(00000000e83d5d08):0x0 lsk 2496 rsk 33 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bf Transaction freed
00000800:00000200:1.0:1773851861.455149:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.455149:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.455151:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.455153:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.455155:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9075@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.455156:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9075@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.455157:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9075@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.455159:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000216841 nid 9075@kfi7 refs 1
00000400:00000200:1.0:1773851861.455160:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9075@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.455160:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000216841 nid 9075@kfi7 refs 2
00000400:00000200:1.0:1773851861.455161:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000000216841 nid 9075@kfi7 refs 3
00000400:00000200:1.0:1773851861.455162:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9139@kfi7 to cpt 4
00000400:00000200:1.0:1773851861.455163:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9139@kfi7 of length 376 into portal 12 MB=0x69b47355764c0
00000400:00000200:1.0:1773851861.455164:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9139@kfi7 of length 376/376 into md 0x7fb56e801 [64] + 23200
00000800:00000200:1.0:1773851861.455166:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.455167:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.455168:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9075@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.455169:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.455170:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.455170:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000098b01b1c.
00000100:00000040:1.0:1773851861.455171:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000098b01b1c x1859580000167104 msgsize 376
00000100:00100000:1.0:1773851861.455172:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9139@kfi7 (source: 12345-9075@kfi7)
00000100:00000001:1.0:1773851861.455173:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.455174:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000000216841 nid 9075@kfi7 refs 2
00000100:00000001:0.0:1773851861.455175:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.455175:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851861.455176:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.455176:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.455176:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.455177:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.455178:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580000167104
00000020:00000001:0.0:1773851861.455178:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.455179:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f2729
00000020:00000001:0.0:1773851861.455179:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.455181:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bd88ff41 refcount=437
00000020:00000001:0.0:1773851861.455181:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131019194368 : -106942690357248 : ffff9ebc76ee1000)
00000020:00000001:0.0:1773851861.455182:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131019194368 : -106942690357248 : ffff9ebc76ee1000)
00000100:00000001:0.0:1773851861.455183:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.455184:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.455185:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c5bdc42.
00000020:00000010:0.0:1773851861.455186:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.455187:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.455187:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.455188:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:0.0:1773851861.455188:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:0.0:1773851861.455189:0:60951:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.455189:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.455191:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.455191:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851861.455193:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.455193:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851861.455193:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.455193:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.455194:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9139@kfi7, seq: 408701477
00000100:00000001:1.0:1773851861.455195:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.455195:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bd88ff41 : new rpc_count 14
00000100:00000001:1.0:1773851861.455196:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.455196:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856589312 : -106915852962304 : ffff9ec2b6903600)
00000100:00000040:0.0:1773851861.455197:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000098b01b1c x1859580000167104/t0(0) o101->45481d71-4346-4520-8d8e-2ec07865c4a5@9139@kfi7:588/0 lens 376/0 e 0 to 0 dl 1773851948 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833573727925042176'
00000100:00000001:0.0:1773851861.455200:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.455201:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.455201:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098b01b1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:45481d71-4346-4520-8d8e-2ec07865c4a5+437:297344:x1859580000167104:12345-9139@kfi7:101:tuolumne-833573727925042176
00000100:00000200:0.0:1773851861.455203:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580000167104
00000020:00000001:0.0:1773851861.455204:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.455204:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.455205:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.455206:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.455206:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:0.0:1773851861.455207:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.455207:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580000167104, found 0 last_xid 1859579993325567
00000020:00000001:0.0:1773851861.455208:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.455209:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.455209:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.455210:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.455211:0:60951:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:0.0:1773851861.455212:0:60951:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:0.0:1773851861.455212:0:60951:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:0.0:1773851861.455213:0:60951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:0.0:1773851861.455213:0:60951:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851861.455216:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:0.0:1773851861.455219:0:60951:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 0000000079760c6b.
00010000:00000010:0.0:1773851861.455220:0:60951:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 0000000084718ce4.
00010000:00000001:0.0:1773851861.455220:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851861.455221:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000e59309ca.
00000020:00000001:0.0:1773851861.455222:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851861.455223:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000e59309ca with handle 0x21b6f08f07a6ad69 to hash
00000020:00000001:0.0:1773851861.455224:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851861.455224:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509341824 : -106909200209792 : ffff9ec443192880)
00010000:00000010:0.0:1773851861.455225:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000fc9b7725.
00010000:00000001:0.0:1773851861.455226:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509341824 : -106909200209792 : ffff9ec443192880)
00010000:00010000:0.0:1773851861.455227:0:60951:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000e59309ca/0x21b6f08f07a6ad69 lrc: 2/0,0 mode: --/CR res: [0x240024bb6:0x998a:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xfa70210923323f19 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851861.455233:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000079760c6b count: 1
00010000:00000040:0.0:1773851861.455234:0:60951:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000bd88ff41 : new locks_count 361
00000020:00000040:0.0:1773851861.455235:0:60951:0:(genops.c:871:class_export_get()) GET export 00000000bd88ff41 refcount=438
00010000:00000001:0.0:1773851861.455237:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:0.0:1773851861.455237:0:60951:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:0.0:1773851861.455238:0:60951:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:0.0:1773851861.455239:0:60951:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:0.0:1773851861.455239:0:60951:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851861.455241:0:60951:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:0.0:1773851861.455241:0:60951:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x240024bb6:0x998a:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:0.0:1773851861.455243:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851861.455243:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240024bb6:0x998a:0x0]
00000020:00000001:0.0:1773851861.455244:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851861.455245:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637109038826568 : -106964670725048 : ffff9eb758cc4448)
00000004:00000001:0.0:1773851861.455246:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637109038826480 : -106964670725136 : ffff9eb758cc43f0)
00000004:00000001:0.0:1773851861.455248:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851861.455250:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851861.455250:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851861.455252:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455253:0:60951:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455253:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:0.0:1773851861.455254:0:60951:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:0.0:1773851861.455255:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.455255:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.455257:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 00000000e2a0fba1.
02000000:00000001:0.0:1773851861.455257:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.455258:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851861.455259:0:60951:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:0.0:1773851861.455260:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:0.0:1773851861.455260:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851861.455261:0:60951:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851861.455262:0:60951:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851861.455262:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851861.455264:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851861.455264:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851861.455265:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851861.455265:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851861.455266:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851861.455267:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851861.455267:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851861.455268:0:60951:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851861.455268:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851861.455269:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240024bb6:0x998a:0x0].0x0 (0000000079760c6b) refcount = 1
00010000:00010000:0.0:1773851861.455270:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000e59309ca/0x21b6f08f07a6ad69 lrc: 3/0,0 mode: CR/CR res: [0x240024bb6:0x998a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 9139@kfi7 remote: 0xfa70210923323f19 expref: 438 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851861.455273:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000079760c6b count: 1
00010000:00000001:0.0:1773851861.455274:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851861.455274:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851861.455275:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851861.455275:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851861.455276:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851861.455276:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851861.455277:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851861.455278:0:60951:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:0.0:1773851861.455279:0:60951:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000e59309ca/0x21b6f08f07a6ad69 lrc: 3/0,0 mode: CR/CR res: [0x240024bb6:0x998a:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 9139@kfi7 remote: 0xfa70210923323f19 expref: 438 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851861.455281:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000079760c6b count: 1
00000004:00000001:0.0:1773851861.455282:0:60951:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:0.0:1773851861.455284:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851861.455284:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240024bb6:0x998a:0x0]
00000020:00000001:0.0:1773851861.455285:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851861.455285:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637109038826568 : -106964670725048 : ffff9eb758cc4448)
00000004:00000001:0.0:1773851861.455286:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637109038826480 : -106964670725136 : ffff9eb758cc43f0)
00000004:00000001:0.0:1773851861.455287:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851861.455287:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851861.455288:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851861.455289:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455289:0:60951:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455290:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455290:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851861.455291:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851861.455291:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851861.455292:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455292:0:60951:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455293:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:0.0:1773851861.455293:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:0.0:1773851861.455294:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851861.455294:0:60951:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:0.0:1773851861.455295:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851861.455296:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851861.455296:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024bb6:0x998a:0x0].0x0 (0000000079760c6b)
00010000:00010000:0.0:1773851861.455297:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:0.0:1773851861.455298:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851861.455299:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851861.455299:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851861.455300:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851861.455300:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851861.455301:0:60951:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e59309ca, rc 0)
00000020:00000001:0.0:1773851861.455302:0:60951:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.455302:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592074, transno 0, xid 1859580000167104
00010000:00000001:0.0:1773851861.455303:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.455304:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000098b01b1c x1859580000167104/t0(0) o101->45481d71-4346-4520-8d8e-2ec07865c4a5@9139@kfi7:588/0 lens 376/1080 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833573727925042176'
00010000:00000001:0.0:1773851861.455307:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.455307:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.455308:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.455309:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.455310:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006eb9d3ee refcount 3 to 9139@kfi7
00000100:00000001:0.0:1773851861.455311:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517376 : -107156126034240 : ffff9e8ac52c16c0)
02000000:00000001:0.0:1773851861.455312:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.455312:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.455313:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.455314:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9075@kfi7
00000400:00000010:0.0:1773851861.455314:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000009e6d8.
00000100:00000200:0.0:1773851861.455315:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1859580000167104, offset 224
00000400:00000200:0.0:1773851861.455317:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9075@kfi7
00000400:00000200:0.0:1773851861.455318:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9075@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.455319:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000216841 nid 9075@kfi7 refs 1
00000400:00000200:0.0:1773851861.455320:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000000216841 nid 9075@kfi7 refs 2
00000400:00000200:0.0:1773851861.455321:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000000216841 nid 9075@kfi7 refs 3
00000400:00000200:0.0:1773851861.455322:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9075@kfi7 local destination
00000400:00000200:0.0:1773851861.455323:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768979:8768979:1024:4294967295] 9075@kfi7 LPNI seq info [4910099:4910099:16:4294967295]
00000400:00000200:0.0:1773851861.455325:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000000216841 nid 9075@kfi7 refs 2
00000400:00000200:0.0:1773851861.455326:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9075@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.455327:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9075@kfi7(9075@kfi7:9075@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.455329:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000000216841 nid 9075@kfi7 refs 3
00000800:00000200:0.0:1773851861.455330:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.455331:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000800:00000200:0.0:1773851861.455333:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.455336:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bcd Using peer 9075@kfi7(0x100000000000bcd)
00000800:00000200:0.0:1773851861.455339:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 1180 bytes to peer 0x100000000000bcd: rc=0
00000800:00000200:0.0:1773851861.455340:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bcd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.455342:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.455343:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006eb9d3ee refcount 2 to 9139@kfi7
00010000:00000001:0.0:1773851861.455344:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.455344:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.455345:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.455346:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098b01b1c x1859580000167104/t0(0) o101->45481d71-4346-4520-8d8e-2ec07865c4a5@9139@kfi7:588/0 lens 376/1080 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833573727925042176'
00000100:00100000:0.0:1773851861.455351:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098b01b1c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:45481d71-4346-4520-8d8e-2ec07865c4a5+438:297344:x1859580000167104:12345-9139@kfi7:101:tuolumne-833573727925042176 Request processed in 150us (179us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.455354:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9139@kfi7, seq: 408701477
00000100:00000040:0.0:1773851861.455354:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bd88ff41 : new rpc_count 13
00000100:00000001:0.0:1773851861.455355:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.455356:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.455357:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.455357:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.455358:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c5bdc42.
00000020:00000040:0.0:1773851861.455359:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000bd88ff41 : new refcount 437
00000100:00000001:0.0:1773851861.455360:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.455364:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bcd TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.455366:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.455367:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9075@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.455368:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000009e6d8
00000400:00000010:1.0:1773851861.455369:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000009e6d8.
00000100:00000001:1.0:1773851861.455369:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.455370:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.455370:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000000216841 nid 9075@kfi7 refs 2
00000800:00000200:1.0:1773851861.455372:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9075@kfi7(000000007b624a37):0x0 lsk 3022 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bcd Transaction freed
00000800:00000200:5.0:1773851861.461175:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.461176:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851861.461177:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851861.461179:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851861.461181:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.461185:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851861.461185:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.461186:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851861.461187:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.461188:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851861.461189:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851861.461190:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851861.461191:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a879dc9c0
00000400:00000200:5.0:1773851861.461192:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 5840
00000800:00000200:5.0:1773851861.461194:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851861.461196:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851861.461197:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851861.461198:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851861.461198:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851861.461199:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006f66b467.
00000100:00000040:5.0:1773851861.461200:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000006f66b467 x1859388106983872 msgsize 224
00000100:00100000:5.0:1773851861.461202:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851861.461202:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851861.461203:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000100:00000001:6.0:1773851861.461204:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851861.461205:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851861.461205:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851861.461205:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851861.461206:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851861.461207:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851861.461207:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388106983872
00000020:00000001:6.0:1773851861.461208:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851861.461209:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:6.0:1773851861.461209:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851861.461210:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:6.0:1773851861.461211:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:6.0:1773851861.461212:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:6.0:1773851861.461213:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851861.461214:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851861.461215:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851861.461216:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851861.461217:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f897dd3e.
00000100:00000040:6.0:1773851861.461218:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851861.461219:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851861.461220:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851861.461220:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.461221:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.461222:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851861.461223:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851861.461224:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851861.461224:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851861.461224:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851861.461225:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314077
00000100:00000040:6.0:1773851861.461226:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:6.0:1773851861.461226:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866957184 : -107088842594432 : ffff9e9a6f93e780)
00000100:00000001:5.0:1773851861.461226:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.461226:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851861.461227:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006f66b467 x1859388106983872/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:6.0:1773851861.461230:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851861.461231:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851861.461232:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f66b467 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40155:x1859388106983872:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:6.0:1773851861.461233:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388106983872
00000020:00000001:6.0:1773851861.461234:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851861.461234:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851861.461235:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851861.461236:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851861.461236:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851861.461237:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851861.461237:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851861.461238:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851861.461239:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851861.461239:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.461240:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851861.461241:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851861.461242:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000e7aecc5c.
02000000:00000001:6.0:1773851861.461243:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.461243:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851861.461244:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851861.461245:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851861.461245:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851861.461246:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851861.461247:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851861.461248:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851861.461249:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388106983872
00010000:00000001:6.0:1773851861.461250:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851861.461251:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006f66b467 x1859388106983872/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:588/0 lens 224/368 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:6.0:1773851861.461253:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851861.461254:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851861.461255:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=90 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851861.461256:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851861.461256:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:6.0:1773851861.461257:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:6.0:1773851861.461258:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851861.461258:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851861.461259:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851861.461260:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:6.0:1773851861.461261:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb11c5dc.
00000100:00000200:6.0:1773851861.461261:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388106983872, offset 224
00000400:00000200:6.0:1773851861.461263:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:6.0:1773851861.461264:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.461264:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:6.0:1773851861.461266:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851861.461267:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:6.0:1773851861.461268:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:6.0:1773851861.461269:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768980:8768980:1024:4294967295] 43@kfi7 LPNI seq info [37492099:37492099:16:4294967295]
00000400:00000200:6.0:1773851861.461270:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851861.461271:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.461273:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851861.461274:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:6.0:1773851861.461276:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851861.461277:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851861.461279:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851861.461281:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Using peer 43@kfi7(0x20000000000070b)
00000800:00000200:6.0:1773851861.461284:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000235b3e16: Posted send of 468 bytes to peer 0x20000000000070b: rc=0
00000800:00000200:6.0:1773851861.461285:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851861.461287:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851861.461288:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:6.0:1773851861.461289:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851861.461289:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851861.461290:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851861.461290:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006f66b467 x1859388106983872/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:588/0 lens 224/368 e 0 to 0 dl 1773851948 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:6.0:1773851861.461293:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f66b467 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40155:x1859388106983872:12345-61@kfi7:41:default-yuba1-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851861.461296:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314077
00000100:00000040:6.0:1773851861.461296:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:6.0:1773851861.461297:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851861.461297:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851861.461298:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851861.461298:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:6.0:1773851861.461299:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f897dd3e.
00000400:00000200:5.0:1773851861.461299:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:6.0:1773851861.461300:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000400:00000200:5.0:1773851861.461300:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000020:00000040:6.0:1773851861.461301:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000400:00000200:5.0:1773851861.461301:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb11c5dc
00000400:00000010:5.0:1773851861.461301:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb11c5dc.
00000100:00000001:6.0:1773851861.461302:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.461302:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851861.461303:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851861.461304:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851861.461305:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Transaction freed
00000800:00000200:29.0:1773851861.472842:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.472843:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.472844:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.472846:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.472848:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12080@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.472849:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12080@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.472850:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12080@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.472851:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000143b332d nid 12080@kfi7 refs 1
00000400:00000200:29.0:1773851861.472852:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12080@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.472853:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000143b332d nid 12080@kfi7 refs 2
00000400:00000200:29.0:1773851861.472854:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000143b332d nid 12080@kfi7 refs 3
00000400:00000200:29.0:1773851861.472855:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12272@kfi7 to cpt 2
00000400:00000200:29.0:1773851861.472855:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12272@kfi7 of length 224 into portal 12 MB=0x699e101d03f80
00000400:00000200:29.0:1773851861.472857:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12272@kfi7 of length 224/224 into md 0x77fe139dd [64] + 169632
00000800:00000200:29.0:1773851861.472859:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.472860:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.472861:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12080@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.472862:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.472862:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.472864:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c843f8ed.
00000100:00000040:29.0:1773851861.472865:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000c843f8ed x1858041537380224 msgsize 224
00000100:00100000:29.0:1773851861.472866:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12272@kfi7 (source: 12345-12080@kfi7)
00000100:00000001:29.0:1773851861.472867:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851861.472868:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000143b332d nid 12080@kfi7 refs 2
00000800:00000200:29.0:1773851861.472869:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851861.472869:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851861.472870:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851861.472871:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851861.472871:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851861.472873:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851861.472874:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041537380224
00000020:00000001:28.0:1773851861.472875:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851861.472875:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91929
00000020:00000001:28.0:1773851861.472876:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851861.472880:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dfd5850d refcount=161
00000020:00000001:28.0:1773851861.472881:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241968640 : -107152467582976 : ffff9e8b9f3ba000)
00000020:00000001:28.0:1773851861.472882:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241968640 : -107152467582976 : ffff9e8b9f3ba000)
00000100:00000001:28.0:1773851861.472884:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.472885:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851861.472886:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000041347fd5.
00000020:00000010:28.0:1773851861.472887:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851861.472889:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095ed4c73.
00000100:00000001:28.0:1773851861.472890:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851861.472890:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851861.472891:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851861.472893:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851861.472895:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851861.472895:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.472897:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.472898:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.472899:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.472899:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.472899:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851861.472900:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12272@kfi7, seq: 2055495
00000100:00000040:31.0:1773851861.472901:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dfd5850d : new rpc_count 1
00000100:00000001:28.0:1773851861.472901:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.472902:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637103781734272 : -106969927817344 : ffff9eb61f736780)
00000100:00000001:28.0:1773851861.472902:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.472903:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c843f8ed x1858041537380224/t0(0) o400->2ab62f37-9b9a-41b1-936a-025483f1a40f@12272@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1245-0'
00000100:00000001:31.0:1773851861.472906:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.472906:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851861.472907:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c843f8ed pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:2ab62f37-9b9a-41b1-936a-025483f1a40f+161:39813:x1858041537380224:12345-12272@kfi7:400:default-tuolumne1245-0
00000100:00000200:31.0:1773851861.472909:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041537380224
00000020:00000001:31.0:1773851861.472909:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851861.472910:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851861.472911:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.472911:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851861.472912:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851861.472913:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851861.472913:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041537380224, found 0 last_xid 1858041536956607
00000020:00000001:31.0:1773851861.472914:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851861.472915:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851861.472916:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851861.472916:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.472917:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851861.472918:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851861.472918:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851861.472919:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000003eec177.
02000000:00000001:31.0:1773851861.472920:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.472920:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.472921:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851861.472922:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063430, transno 0, xid 1858041537380224
00010000:00000001:31.0:1773851861.472923:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851861.472924:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c843f8ed x1858041537380224/t0(0) o400->2ab62f37-9b9a-41b1-936a-025483f1a40f@12272@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1245-0'
00010000:00000001:31.0:1773851861.472926:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851861.472927:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851861.472928:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851861.472929:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851861.472930:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000abe13ab4 refcount 3 to 12272@kfi7
00000100:00000001:31.0:1773851861.472930:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526776064 : -107156182775552 : ffff9e8ac1ca4900)
02000000:00000001:31.0:1773851861.472931:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851861.472931:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.472932:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851861.472933:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12080@kfi7
00000400:00000010:31.0:1773851861.472933:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fab8ac69.
00000100:00000200:31.0:1773851861.472934:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041537380224, offset 224
00000400:00000200:31.0:1773851861.472936:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12080@kfi7
00000400:00000200:31.0:1773851861.472936:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12080@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.472937:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000143b332d nid 12080@kfi7 refs 1
00000400:00000200:31.0:1773851861.472939:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000143b332d nid 12080@kfi7 refs 2
00000400:00000200:31.0:1773851861.472940:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000143b332d nid 12080@kfi7 refs 3
00000400:00000200:31.0:1773851861.472941:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12080@kfi7 local destination
00000400:00000200:31.0:1773851861.472942:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768981:8768981:1024:4294967295] 12080@kfi7 LPNI seq info [9247394:9247394:16:4294967295]
00000400:00000200:31.0:1773851861.472944:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000143b332d nid 12080@kfi7 refs 2
00000400:00000200:31.0:1773851861.472944:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12080@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.472946:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12080@kfi7(12080@kfi7:12080@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851861.472947:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000143b332d nid 12080@kfi7 refs 3
00000800:00000200:31.0:1773851861.472948:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851861.472949:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851861.472951:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851861.472957:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xcb6 Using peer 12080@kfi7(0xcb6)
00000800:00000200:31.0:1773851861.472961:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0xcb6: rc=0
00000800:00000200:31.0:1773851861.472962:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xcb6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851861.472965:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.472965:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000abe13ab4 refcount 2 to 12272@kfi7
00010000:00000001:31.0:1773851861.472966:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851861.472967:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.472967:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851861.472968:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c843f8ed x1858041537380224/t0(0) o400->2ab62f37-9b9a-41b1-936a-025483f1a40f@12272@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1245-0'
00000100:00100000:31.0:1773851861.472971:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c843f8ed pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:2ab62f37-9b9a-41b1-936a-025483f1a40f+161:39813:x1858041537380224:12345-12272@kfi7:400:default-tuolumne1245-0 Request processed in 65us (106us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851861.472974:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12272@kfi7, seq: 2055495
00000100:00000040:31.0:1773851861.472974:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dfd5850d : new rpc_count 0
00000800:00000200:29.0:1773851861.472975:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xcb6 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851861.472976:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851861.472976:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851861.472976:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851861.472977:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851861.472978:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095ed4c73.
00000400:00000200:29.0:1773851861.472978:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12080@kfi7: PUT: OK
00000020:00000010:31.0:1773851861.472979:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000041347fd5.
00000400:00000200:29.0:1773851861.472979:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fab8ac69
00000400:00000010:29.0:1773851861.472979:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fab8ac69.
00000020:00000040:31.0:1773851861.472980:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000dfd5850d : new refcount 160
00000100:00000001:31.0:1773851861.472980:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851861.472980:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.472980:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.472981:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000143b332d nid 12080@kfi7 refs 2
00000800:00000200:29.0:1773851861.472983:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 12080@kfi7(000000007ea1e862):0x0 lsk 3255 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xcb6 Transaction freed
00000800:00000200:30.0:1773851861.495582:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.495582:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851861.495583:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.495583:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851861.495585:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.495585:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:29.0:1773851861.495588:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26131@kfi7(0000000076f1bd1b):0xb76 version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851861.495589:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851861.495591:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 Using peer 26131@kfi7(0xb76)
00000400:00000200:30.0:1773851861.495592:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26131@kfi7 to cpt 7
00000400:00000200:30.0:1773851861.495594:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26131@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.495594:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26131@kfi7 to cpt 7
00000400:00000200:30.0:1773851861.495595:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26131@kfi7 to cpt 7
00000800:00000200:29.0:1773851861.495597:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 38 bytes to peer 0xb76: rc=0
00000400:00000200:30.0:1773851861.495598:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000caf493af nid 26131@kfi7 refs 1
00000800:00000200:29.0:1773851861.495599:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851861.495600:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26131@kfi7 to cpt 7
00000400:00000200:30.0:1773851861.495601:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000caf493af nid 26131@kfi7 refs 2
00000400:00000200:30.0:1773851861.495602:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000caf493af nid 26131@kfi7 refs 3
00000400:00000200:30.0:1773851861.495603:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:30.0:1773851861.495605:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 520 into portal 12 MB=0x69b4c65a3ce00
00000400:00000200:30.0:1773851861.495607:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26323@kfi7 of length 520/520 into md 0x77fe139dd [64] + 169856
00000800:00000200:30.0:1773851861.495610:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851861.495613:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:29.0:1773851861.495613:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851861.495615:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26131@kfi7: PUT: OK
00000100:00000001:30.0:1773851861.495616:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851861.495617:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:29.0:1773851861.495617:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 Transaction freed
00000100:00000010:30.0:1773851861.495618:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000828a2183.
00000100:00000040:30.0:1773851861.495619:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000828a2183 x1859602285317632 msgsize 520
00000100:00100000:30.0:1773851861.495621:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26131@kfi7)
00000100:00000001:30.0:1773851861.495623:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851861.495624:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000caf493af nid 26131@kfi7 refs 2
00000100:00000001:31.0:1773851861.495625:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851861.495626:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851861.495627:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851861.495627:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851861.495628:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.495629:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851861.495630:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602285317632
00000020:00000001:31.0:1773851861.495631:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851861.495631:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000020:00000001:31.0:1773851861.495644:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851861.495648:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=164
00000020:00000001:31.0:1773851861.495649:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000020:00000001:31.0:1773851861.495650:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:31.0:1773851861.495651:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.495652:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851861.495653:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000546cd5ce.
00000020:00000010:31.0:1773851861.495654:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851861.495655:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851861.495657:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851861.495657:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851861.495658:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.495659:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:31.0:1773851861.495661:0:42267:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@00000000828a2183 x1859602285317632/t0(0) o38->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852061 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2133-0'
00000100:00000001:31.0:1773851861.495665:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851861.495665:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.495667:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.495669:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.495669:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.495670:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.495670:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851861.495671:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26323@kfi7, seq: 2055496
00000100:00000040:31.0:1773851861.495672:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e09d60f5 : new rpc_count 3
00000100:00000001:28.0:1773851861.495672:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.495673:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832809600 : -106933876742016 : ffff9ebe84432880)
00000100:00000001:28.0:1773851861.495673:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.495674:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000828a2183 x1859602285317632/t0(0) o38->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852061 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2133-0'
00000100:00000001:31.0:1773851861.495678:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.495679:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851861.495680:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000828a2183 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:fd96080a-33e6-4035-b5d5-c4f2e0fc3c75+164:39497:x1859602285317632:12345-26323@kfi7:38:default-tuolumne2133-0
00000100:00000200:31.0:1773851861.495682:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602285317632
00000020:00000001:31.0:1773851861.495683:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:31.0:1773851861.495684:0:42267:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:31.0:1773851861.495690:0:42267:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:31.0:1773851861.495691:0:42267:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:31.0:1773851861.495694:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851861.495695:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851861.495695:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 00000000ce89abbc.
02000000:00000001:31.0:1773851861.495696:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.495697:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851861.495700:0:42267:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:31.0:1773851861.495701:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fd96080a-33e6-4035-b5d5-c4f2e0fc3c75 (at 26323@kfi7) reconnecting
00010000:00000001:31.0:1773851861.495703:0:42267:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:31.0:1773851861.495704:0:42267:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:31.0:1773851861.495706:0:42267:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7 t183230420474 exp 00000000e09d60f5 cur 614135 last 1773851861
00010000:00000001:31.0:1773851861.495709:0:42267:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:31.0:1773851861.495711:0:42267:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:31.0:1773851861.495712:0:42267:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:31.0:1773851861.495713:0:42267:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:31.0:1773851861.495714:0:42267:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:31.0:1773851861.495715:0:42267:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:31.0:1773851861.495717:0:42267:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:31.0:1773851861.495718:0:42267:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:31.0:1773851861.495719:0:42267:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:31.0:1773851861.495720:0:42267:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.495721:0:42267:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:31.0:1773851861.495722:0:42267:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851861.495724:0:42267:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.495729:0:42267:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:31.0:1773851861.495730:0:42267:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli fd96080a-33e6-4035-b5d5-c4f2e0fc3c75/00000000e09d60f5 free: 126633370845184 avail: 126633368748032
00000020:00000001:31.0:1773851861.495731:0:42267:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:31.0:1773851861.495732:0:42267:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli fd96080a-33e6-4035-b5d5-c4f2e0fc3c75/00000000e09d60f5 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:31.0:1773851861.495733:0:42267:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:31.0:1773851861.495734:0:42267:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:31.0:1773851861.495735:0:42267:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:31.0:1773851861.495736:0:42267:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli fd96080a-33e6-4035-b5d5-c4f2e0fc3c75/00000000e09d60f5 ocd_grant: 1879048191 want: 2097152 left: 112130449866752
00000020:00000001:31.0:1773851861.495737:0:42267:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:31.0:1773851861.495738:0:42267:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 26323@kfi7 supports cksum type f7, return f7
00000004:00000001:31.0:1773851861.495739:0:42267:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:31.0:1773851861.495740:0:42267:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:31.0:1773851861.495741:0:42267:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:31.0:1773851861.495742:0:42267:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851861.495743:0:42267:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851861.495743:0:42267:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.495744:0:42267:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 00000000e09d60f5 : new rpc_count 2
00000020:00000040:31.0:1773851861.495745:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 164
00000020:00000040:31.0:1773851861.495745:0:42267:0:(genops.c:871:class_export_get()) GET export 00000000e09d60f5 refcount=165
00000100:00000040:31.0:1773851861.495746:0:42267:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 00000000e09d60f5 : new rpc_count 3
00000100:00000001:31.0:1773851861.495747:0:42267:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:31.0:1773851861.495748:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:31.0:1773851861.495749:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 1
00000400:00000200:31.0:1773851861.495750:0:42267:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000400:00000200:31.0:1773851861.495752:0:42267:0:(peer.c:1555:LNetPrimaryNID()) NID 26323@kfi7 primary NID 26323@kfi7 rc 0
00000100:00000001:31.0:1773851861.495893:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851861.495894:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009e9c4a62 refcount 3 to 26323@kfi7
00000100:00000001:31.0:1773851861.495895:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058112 : -107146750493504 : ffff9e8cf3ff7cc0)
00000100:00000001:31.0:1773851861.495895:0:42267:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636926959058112 : -107146750493504 : 0xffff9e8cf3ff7cc0)
00000100:00000040:31.0:1773851861.495897:0:42267:0:(connection.c:133:ptlrpc_connection_get()) conn=000000009e9c4a62 refcount 3 to 26323@kfi7
00000100:00080000:31.0:1773851861.495898:0:42267:0:(import.c:86:import_set_state_nolock()) 00000000b033e745 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:31.0:1773851861.495899:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009e9c4a62 refcount 2 to 26323@kfi7
00000100:00000001:31.0:1773851861.495900:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851861.495901:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009e9c4a62 refcount 3 to 26323@kfi7
00000100:00000001:31.0:1773851861.495901:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058112 : -107146750493504 : ffff9e8cf3ff7cc0)
02000000:00000001:31.0:1773851861.495903:0:42267:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:31.0:1773851861.495904:0:42267:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:31.0:1773851861.495905:0:42267:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.495906:0:42267:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:31.0:1773851861.495907:0:42267:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:31.0:1773851861.495908:0:42267:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:31.0:1773851861.495909:0:42267:0:(import.c:86:import_set_state_nolock()) 00000000b033e745 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:31.0:1773851861.495909:0:42267:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:31.0:1773851861.495910:0:42267:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:31.0:1773851861.495911:0:42267:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:31.0:1773851861.495911:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 164
00000020:00000040:31.0:1773851861.495912:0:42267:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:31.0:1773851861.495913:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009e9c4a62 refcount 2 to 26323@kfi7
00010000:00000001:31.0:1773851861.495914:0:42267:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.495914:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851861.495915:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:31.0:1773851861.495916:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:31.0:1773851861.495916:0:42267:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851861.495917:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851861.495917:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851861.495918:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.495919:0:42267:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:31.0:1773851861.495920:0:42267:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:31.0:1773851861.495921:0:42267:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:31.0:1773851861.495921:0:42267:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:31.0:1773851861.495922:0:42267:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.495922:0:42267:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851861.495923:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263881838, transno 0, xid 1859602285317632
00010000:00000001:31.0:1773851861.495923:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851861.495924:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000828a2183 x1859602285317632/t0(0) o38->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852061 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2133-0'
00010000:00000001:31.0:1773851861.495927:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851861.495927:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851861.495927:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00001000:31.0:1773851861.495929:0:42267:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:31.0:1773851861.495930:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851861.495931:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009e9c4a62 refcount 3 to 26323@kfi7
00000100:00000001:31.0:1773851861.495931:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058112 : -107146750493504 : ffff9e8cf3ff7cc0)
02000000:00000001:31.0:1773851861.495932:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851861.495932:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.495933:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851861.495934:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26131@kfi7
00000400:00000010:31.0:1773851861.495934:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f9abbdbd.
00000100:00000200:31.0:1773851861.495935:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1859602285317632, offset 0
00000400:00000200:31.0:1773851861.495936:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26131@kfi7
00000400:00000200:31.0:1773851861.495937:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26131@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.495938:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000caf493af nid 26131@kfi7 refs 1
00000400:00000200:31.0:1773851861.495939:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000caf493af nid 26131@kfi7 refs 2
00000400:00000200:31.0:1773851861.495940:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000caf493af nid 26131@kfi7 refs 3
00000400:00000200:31.0:1773851861.495941:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26131@kfi7 local destination
00000400:00000200:31.0:1773851861.495942:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768982:8768982:1024:4294967295] 26131@kfi7 LPNI seq info [1552832:1552832:16:4294967295]
00000400:00000200:31.0:1773851861.495943:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000caf493af nid 26131@kfi7 refs 2
00000400:00000200:31.0:1773851861.495944:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26131@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.495946:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26131@kfi7(26131@kfi7:26131@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851861.495947:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000caf493af nid 26131@kfi7 refs 3
00000800:00000200:31.0:1773851861.495948:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851861.495949:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:31.0:1773851861.495951:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851861.495954:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 Using peer 26131@kfi7(0xb76)
00000800:00000200:31.0:1773851861.495957:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 516 bytes to peer 0xb76: rc=0
00000800:00000200:31.0:1773851861.495958:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851861.495959:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.495960:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009e9c4a62 refcount 2 to 26323@kfi7
00010000:00000001:31.0:1773851861.495961:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851861.495961:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.495962:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851861.495963:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000828a2183 x1859602285317632/t0(0) o38->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852061 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2133-0'
00000100:00100000:31.0:1773851861.495965:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000828a2183 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:fd96080a-33e6-4035-b5d5-c4f2e0fc3c75+164:39497:x1859602285317632:12345-26323@kfi7:38:default-tuolumne2133-0 Request processed in 286us (346us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851861.495968:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26323@kfi7, seq: 2055496
00000100:00000040:31.0:1773851861.495969:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e09d60f5 : new rpc_count 2
00000100:00000001:31.0:1773851861.495970:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851861.495970:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851861.495970:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851861.495971:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851861.495971:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000400:00000200:29.0:1773851861.495971:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851861.495972:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000546cd5ce.
00000400:00000200:29.0:1773851861.495972:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26131@kfi7: PUT: OK
00000020:00000040:31.0:1773851861.495973:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 163
00000100:00000001:31.0:1773851861.495973:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851861.495973:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f9abbdbd
00000400:00000010:29.0:1773851861.495973:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f9abbdbd.
00000100:00000001:29.0:1773851861.495974:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.495974:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.495975:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000caf493af nid 26131@kfi7 refs 2
00000800:00000200:29.0:1773851861.495976:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 26131@kfi7(0000000076f1bd1b):0x0 lsk 2935 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb76 Transaction freed
00000800:00000200:25.0:1773851861.496223:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.496224:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.496225:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 26322@kfi7(00000000035a103c):0x0 lsk 3719 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.496227:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 26322@kfi7(00000000035a103c):0x0 lsk 3719 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.496229:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26322@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.496230:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26322@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.496231:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26322@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.496232:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed3307b4 nid 26322@kfi7 refs 1
00000400:00000200:25.0:1773851861.496233:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26322@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.496234:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed3307b4 nid 26322@kfi7 refs 2
00000400:00000200:25.0:1773851861.496235:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed3307b4 nid 26322@kfi7 refs 3
00000400:00000200:25.0:1773851861.496236:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:25.0:1773851861.496237:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 392 into portal 23 MB=0x69b4c6361fbc0
00000800:00000200:17.0:1773851861.496237:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000400:00000200:25.0:1773851861.496238:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-26323@kfi7 of length 392/392 into md 0x1615b62779 [2] + 2048
00000800:00000200:17.0:1773851861.496238:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.496239:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:25.0:1773851861.496240:0:2494371:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b8c2e8b5.
00000400:00000200:25.0:1773851861.496240:0:2494371:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000eea138e6
00000800:00000200:17.0:1773851861.496241:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851861.496242:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 26322@kfi7(00000000035a103c):0x0 lsk 3719 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851861.496242:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.496243:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26130@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.496244:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.496244:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:25.0:1773851861.496245:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26322@kfi7: PUT: OK
00000400:00000200:17.0:1773851861.496245:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 1
00000400:00000200:25.0:1773851861.496246:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eea138e6
00000400:00000010:25.0:1773851861.496246:0:2494371:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000eea138e6 (tot 253200619).
00000100:00000001:25.0:1773851861.496247:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:17.0:1773851861.496247:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.496247:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 2
00000100:00000200:25.0:1773851861.496248:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:17.0:1773851861.496248:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 3
00000100:00000040:25.0:1773851861.496249:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000007d18bcfb x1859602247449536 msgsize 392
00000400:00000200:17.0:1773851861.496249:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:17.0:1773851861.496250:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 392 into portal 23 MB=0x69b4c63b10d80
00000100:00100000:25.0:1773851861.496251:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26322@kfi7)
00000100:00000040:25.0:1773851861.496251:0:2494371:0:(events.c:370:request_in_callback()) Buffer complete: 56 buffers still posted
00000400:00000200:17.0:1773851861.496251:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-26323@kfi7 of length 392/392 into md 0x6ab1cec91 [2] + 392
00000800:00000200:26.0:1773851861.496253:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:25.0:1773851861.496253:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851861.496253:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851861.496254:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:25.0:1773851861.496254:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed3307b4 nid 26322@kfi7 refs 2
00000400:00000200:17.0:1773851861.496254:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851861.496255:0:61229:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851861.496255:0:61229:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851861.496256:0:61229:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:26.0:1773851861.496256:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851861.496256:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 26322@kfi7(00000000035a103c):0x0 lsk 3719 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851861.496256:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26130@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.496256:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:27.0:1773851861.496257:0:61229:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851861.496257:0:61229:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:17.0:1773851861.496257:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00100000:27.0:1773851861.496258:0:61229:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602247449536
00000800:00000200:26.0:1773851861.496258:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26322@kfi7(000000002d93ca90):0xeca version: 2; local version 2; negotiated version: 2
00000100:00000010:17.0:1773851861.496258:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc1b5484.
00000100:00000040:17.0:1773851861.496258:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bc1b5484 x1859602252631424 msgsize 392
00000020:00000001:27.0:1773851861.496259:0:61229:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851861.496259:0:61229:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000800:00000200:25.0:1773851861.496259:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000020:00000001:27.0:1773851861.496260:0:61229:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:26.0:1773851861.496260:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeca Using peer 26322@kfi7(0xeca)
00000800:00000200:25.0:1773851861.496260:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00100000:17.0:1773851861.496260:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26130@kfi7)
00000800:00000200:25.0:1773851861.496261:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:17.0:1773851861.496261:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851861.496262:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26322@kfi7 to cpt 6
00000400:00000200:17.0:1773851861.496262:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 2
00000800:00000200:25.0:1773851861.496263:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851861.496263:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851861.496263:0:61342:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000040:27.0:1773851861.496264:0:61229:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=164
00000020:00000001:27.0:1773851861.496264:0:61229:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000800:00000200:26.0:1773851861.496264:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001c682e34: Posted send of 38 bytes to peer 0xeca: rc=0
02000000:00000001:16.0:1773851861.496264:0:61342:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.496264:0:61342:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:27.0:1773851861.496265:0:61229:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000800:00000200:26.0:1773851861.496265:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeca TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851861.496265:0:61342:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.496265:0:61342:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851861.496266:0:61229:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00100000:16.0:1773851861.496266:0:61342:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602252631424
00000100:00000001:27.0:1773851861.496267:0:61229:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:25.0:1773851861.496267:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26322@kfi7 to cpt 6
00000020:00000010:27.0:1773851861.496268:0:61229:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000400:00000200:25.0:1773851861.496268:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26322@kfi7 : PUT - for me
00000020:00000001:16.0:1773851861.496268:0:61342:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.496268:0:61342:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000020:00000010:27.0:1773851861.496269:0:61229:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000022b22b54.
00000400:00000200:25.0:1773851861.496269:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26322@kfi7 to cpt 6
00000020:00000010:27.0:1773851861.496270:0:61229:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000400:00000200:25.0:1773851861.496270:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed3307b4 nid 26322@kfi7 refs 1
00000020:00000001:16.0:1773851861.496270:0:61342:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:27.0:1773851861.496271:0:61229:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851861.496271:0:61229:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:25.0:1773851861.496271:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26322@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.496271:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed3307b4 nid 26322@kfi7 refs 2
00000100:00000001:27.0:1773851861.496272:0:61229:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851861.496272:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed3307b4 nid 26322@kfi7 refs 3
00000020:00000040:16.0:1773851861.496272:0:61342:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=165
00000400:00000200:25.0:1773851861.496273:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000020:00000001:16.0:1773851861.496273:0:61342:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000400:00000200:25.0:1773851861.496274:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 2528 into portal 12 MB=0x69b4c63541c40
00000020:00000001:16.0:1773851861.496274:0:61342:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000400:00000200:25.0:1773851861.496275:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26323@kfi7 of length 2528/2528 into md 0x16159c6179 [64] + 190392
00000100:00000001:16.0:1773851861.496275:0:61342:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.496275:0:61342:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00080000:27.1:1773851861.496276:0:61229:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000007d18bcfb x1859602247449536/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:346/0 lens 392/0 e 0 to 0 dl 1773852461 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000020:00000010:16.0:1773851861.496276:0:61342:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000800:00000200:25.0:1773851861.496277:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:16.0:1773851861.496277:0:61342:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000800:00000200:26.0:1773851861.496278:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeca TN_EVENT_TX_OK event status 0
00000020:00000010:16.0:1773851861.496278:0:61342:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00080000:27.1:1773851861.496279:0:61229:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000002456d266 x1859602247449536/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:682/0 lens 392/456 e 2 to 0 dl 1773852308 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000400:00000200:25.0:1773851861.496279:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:16.0:1773851861.496279:0:61342:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.496279:0:61342:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.496279:0:61342:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851861.496280:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0xeca Transaction freed
00000400:00000200:25.0:1773851861.496280:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26322@kfi7: PUT: OK
00000100:00000001:25.0:1773851861.496281:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851861.496281:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000001:27.0:1773851861.496282:0:61229:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:27.0:1773851861.496283:0:61229:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000010:25.0:1773851861.496283:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b996e0dd.
00000100:00000040:25.0:1773851861.496283:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b996e0dd x1859602246540352 msgsize 2528
00000100:00000001:27.0:1773851861.496284:0:61229:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00100000:25.0:1773851861.496285:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26322@kfi7)
00000100:00080000:16.1F:1773851861.496285:0:61342:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000bc1b5484 x1859602252631424/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:346/0 lens 392/0 e 0 to 0 dl 1773852461 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000800:00000200:9.0:1773851861.496285:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:25.0:1773851861.496286:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851861.496286:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851861.496287:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed3307b4 nid 26322@kfi7 refs 2
00000800:00000200:25.0:1773851861.496288:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 26322@kfi7(000000002d93ca90):0x0 lsk 3787 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851861.496288:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00080000:16.1:1773851861.496288:0:61342:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000c91746f0 x1859602252631424/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:593/0 lens 392/0 e 1 to 0 dl 1773852308 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000800:00000200:9.0:1773851861.496288:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:24.0:1773851861.496289:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851861.496289:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.496290:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851861.496290:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:27.0:1773851861.496291:0:61229:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
02000000:00000001:24.0:1773851861.496291:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.496291:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602246540352
00000100:00000001:16.0:1773851861.496291:0:61342:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000010:27.0:1773851861.496292:0:61229:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000022b22b54.
00000020:00000010:27.0:1773851861.496292:0:61229:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000020:00000001:24.0:1773851861.496292:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.496292:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000100:00000001:16.0:1773851861.496292:0:61342:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:9.0:1773851861.496292:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000020:00000010:27.0:1773851861.496293:0:61229:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000020:00000001:24.0:1773851861.496293:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:16.0:1773851861.496293:0:61342:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.496293:0:61342:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851861.496293:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26323@kfi7 : PUT - for me
00000020:00000040:27.0:1773851861.496294:0:61229:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 164
00000020:00000010:16.0:1773851861.496294:0:61342:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000400:00000200:9.0:1773851861.496294:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000100:00000010:27.0:1773851861.496295:0:61229:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007419e707.
00000020:00000040:24.0:1773851861.496295:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=165
00000020:00000001:24.0:1773851861.496295:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000020:00000010:16.0:1773851861.496295:0:61342:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000400:00000200:9.0:1773851861.496295:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 1
00000100:00000010:27.0:1773851861.496296:0:61229:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001072e527.
00000100:00000010:27.0:1773851861.496296:0:61229:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8655de8.
00000020:00000001:24.0:1773851861.496296:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000020:00000010:16.0:1773851861.496296:0:61342:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851861.496296:0:61342:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 164
00000400:00000200:9.0:1773851861.496296:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.496296:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000100:00000010:27.0:1773851861.496297:0:61229:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e793c66.
00000100:00000001:24.0:1773851861.496297:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.496297:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:16.0:1773851861.496297:0:61342:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851861.496297:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 3
00000100:00000010:27.0:1773851861.496298:0:61229:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db2aace9.
00000100:00000001:27.0:1773851861.496298:0:61229:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:24.0:1773851861.496298:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8ced97a.
00000400:00000200:9.0:1773851861.496298:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000020:00000010:24.0:1773851861.496299:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000400:00000200:9.0:1773851861.496299:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 392 into portal 23 MB=0x69b4c64493640
00000100:00000200:27.0:1773851861.496300:0:61229:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt_readpage: registering portal 23
00000020:00000010:24.0:1773851861.496300:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.496300:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:9.0:1773851861.496300:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-26323@kfi7 of length 392/392 into md 0x78166cd09 [2] + 1568
00000400:00000010:27.0:1773851861.496301:0:61229:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e475a717.
00000100:00000001:24.0:1773851861.496301:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:24.0:1773851861.496301:0:60973:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000400:00000010:27.0:1773851861.496302:0:61229:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000db542999 (tot 253200771).
00000800:00000200:9.0:1773851861.496302:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00100000:24.0:1773851861.496303:0:60973:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000e2c6cdfd cookie 0xfb8778c7a5e6bd21  req@00000000b996e0dd x1859602246540352/t0(0) o101->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:346/0 lens 2528/0 e 0 to 0 dl 1773852461 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833576640986610688'
00000800:00000200:17.0:1773851861.496303:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851861.496304:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.496304:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851861.496304:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:19.0:1773851861.496305:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.496305:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.496305:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26323@kfi7: PUT: OK
00010000:00000001:24.0:1773851861.496306:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851861.496306:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:19.0:1773851861.496306:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851861.496306:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.496306:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000004:00000001:24.0:1773851861.496307:0:60973:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:19.0:1773851861.496307:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851861.496307:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000010:9.0:1773851861.496307:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f54b12bf.
00000100:00000001:24.0:1773851861.496308:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.496308:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f54b12bf x1859602262603328 msgsize 392
00000100:00080000:24.1:1773851861.496309:0:60973:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000b996e0dd x1859602246540352/t0(0) o101->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:346/0 lens 2528/0 e 0 to 0 dl 1773852461 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833576640986610688'
00000400:00000200:19.0:1773851861.496310:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.496310:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000100:00100000:9.0:1773851861.496310:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26323@kfi7)
00000400:00000200:19.0:1773851861.496311:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26130@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.496311:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26130@kfi7 : PUT - for me
00000100:00000001:9.0:1773851861.496311:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851861.496312:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:9.0:1773851861.496312:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000031466a2e nid 26323@kfi7 refs 2
00000100:00080000:24.1:1773851861.496313:0:60973:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000b0e32dc8 x1859602246540352/t0(0) o101->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:16/0 lens 2528/5304 e 2 to 0 dl 1773852308 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833576640986610688'
00000400:00000200:19.0:1773851861.496313:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 1
00000400:00000200:19.0:1773851861.496314:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000800:00000200:18.0:1773851861.496314:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.496314:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 26323@kfi7(000000002a675953):0x0 lsk 2228 rsk 18 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851861.496314:0:60519:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851861.496314:0:60519:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:19.0:1773851861.496315:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 2
00000800:00000200:18.0:1773851861.496315:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:8.0:1773851861.496315:0:60519:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.496316:0:60973:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:19.0:1773851861.496316:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 3
00000800:00000200:18.0:1773851861.496316:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851861.496316:0:60519:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.496317:0:60973:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851861.496317:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851861.496317:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.496317:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 2
02000000:00000001:8.0:1773851861.496317:0:60519:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.496318:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.496318:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000800:00000200:18.0:1773851861.496318:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851861.496318:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000100:00100000:8.0:1773851861.496318:0:60519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602262603328
00000020:00000001:8.0:1773851861.496318:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000010:24.0:1773851861.496319:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000400:00000200:17.0:1773851861.496319:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 3
00000400:00000200:17.0:1773851861.496319:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 4
00000020:00000040:8.0:1773851861.496319:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000020:00000010:24.0:1773851861.496320:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8ced97a.
00000020:00000001:8.0:1773851861.496320:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.496321:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 164
00000400:00000200:19.0:1773851861.496321:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:18.0:1773851861.496321:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000020:00000040:8.0:1773851861.496321:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=165
00000020:00000001:8.0:1773851861.496321:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:24.0:1773851861.496322:0:60973:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851861.496322:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 392 into portal 23 MB=0x69b4c638bf4c0
00000400:00000200:17.0:1773851861.496322:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000020:00000001:8.0:1773851861.496322:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000400:00000200:19.0:1773851861.496323:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-26323@kfi7 of length 392/392 into md 0x6ab1cec91 [2] + 784
00000400:00000200:18.0:1773851861.496323:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26130@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.496323:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 392 into portal 23 MB=0x69b4c644b47c0
00000100:00000001:8.0:1773851861.496323:0:60519:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:18.0:1773851861.496324:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.496324:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-26323@kfi7 of length 392/392 into md 0x6ab1cec91 [2] + 1176
00000100:00000001:8.0:1773851861.496324:0:60519:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:19.0:1773851861.496325:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851861.496325:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 3
00000020:00000010:8.0:1773851861.496325:0:60519:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000025dffd82.
00000400:00000200:18.0:1773851861.496326:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26130@kfi7 to cpt 4
00000400:00000200:18.0:1773851861.496326:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000541b9bc nid 26130@kfi7 refs 4
00000800:00000200:17.0:1773851861.496326:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:8.0:1773851861.496326:0:60519:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000400:00000200:19.0:1773851861.496327:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851861.496327:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26130@kfi7: PUT: OK
00000400:00000200:18.0:1773851861.496327:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 5
00000020:00000010:8.0:1773851861.496327:0:60519:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:19.0:1773851861.496328:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:18.0:1773851861.496328:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26323@kfi7 to cpt 2
00000400:00000200:17.0:1773851861.496328:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851861.496328:0:60519:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851861.496328:0:60519:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000200:19.0:1773851861.496329:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:18.0:1773851861.496329:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26323@kfi7 of length 392 into portal 23 MB=0x69b4c6449fb80
00000400:00000200:17.0:1773851861.496329:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26130@kfi7: PUT: OK
00000100:00000001:8.0:1773851861.496329:0:60519:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:19.0:1773851861.496330:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e97d03ee.
00000100:00000040:19.0:1773851861.496330:0:2464491:0:(events.c:358:request_in_callback()) incoming req@00000000e97d03ee x1859602250200256 msgsize 392
00000400:00000200:18.0:1773851861.496330:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-26323@kfi7 of length 392/392 into md 0x6ab1cec91 [2] + 1568
00000100:00100000:19.0:1773851861.496332:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26130@kfi7)
00000800:00000200:18.0:1773851861.496332:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00080000:8.1:1773851861.496332:0:60519:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000f54b12bf x1859602262603328/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:588/0 lens 392/0 e 0 to 0 dl 1773851948 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00000001:19.0:1773851861.496333:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851861.496333:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851861.496334:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 4
00000100:00000001:16.0:1773851861.496334:0:61342:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:19.0:1773851861.496335:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c0436e42: 2069@kfi7:4 <- 26130@kfi7(0000000068bc6f0a):0x0 lsk 1486 rsk 17 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:18.0:1773851861.496335:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26130@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.496335:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851861.496335:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
02000000:00000001:16.0:1773851861.496335:0:61342:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.496335:0:61342:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00080000:8.1:1773851861.496335:0:60519:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000332d598e x1859602262603328/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:57/0 lens 392/0 e 0 to 0 dl 1773851795 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000010:17.0:1773851861.496336:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000099ad4b79.
00000100:00000040:17.0:1773851861.496336:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000099ad4b79 x1859602262738880 msgsize 392
00000100:00000001:16.0:1773851861.496336:0:61342:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.496336:0:61342:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.496337:0:61342:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602250200256
00000100:00100000:17.0:1773851861.496338:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26130@kfi7)
00000020:00000001:16.0:1773851861.496338:0:61342:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.496338:0:61342:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000100:00000001:8.0:1773851861.496338:0:60519:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:17.0:1773851861.496339:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:16.0:1773851861.496339:0:61342:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.496339:0:61342:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=165
00000100:00000001:8.0:1773851861.496339:0:60519:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:17.0:1773851861.496340:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 3
00000020:00000001:16.0:1773851861.496340:0:61342:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:8.0:1773851861.496340:0:60519:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851861.496341:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851861.496341:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000800:00000200:17.0:1773851861.496341:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000020:00000001:16.0:1773851861.496341:0:61342:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:8.0:1773851861.496341:0:60519:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851861.496341:0:60519:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000100:00000010:18.0:1773851861.496342:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000792e6d9c.
00000100:00000040:18.0:1773851861.496342:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000792e6d9c x1859602262653824 msgsize 392
00000100:00000001:16.0:1773851861.496342:0:61342:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.496342:0:61342:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851861.496342:0:60519:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:16.0:1773851861.496343:0:61342:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:8.0:1773851861.496343:0:60519:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000025dffd82.
00000100:00100000:18.0:1773851861.496344:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-26323@kfi7 (source: 12345-26130@kfi7)
00000020:00000010:16.0:1773851861.496344:0:61342:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000040:8.0:1773851861.496344:0:60519:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 164
00000100:00000001:18.0:1773851861.496345:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000010:16.0:1773851861.496345:0:61342:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:8.0:1773851861.496345:0:60519:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851861.496346:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000541b9bc nid 26130@kfi7 refs 2
00000100:00000001:16.0:1773851861.496346:0:61342:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.496346:0:61342:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:18.0:1773851861.496347:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 26130@kfi7(0000000008bb6085):0x0 lsk 4642 rsk 16 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851861.496347:0:61342:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.1:1773851861.496348:0:61342:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000e97d03ee x1859602250200256/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:346/0 lens 392/0 e 0 to 0 dl 1773852461 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00080000:16.1:1773851861.496351:0:61342:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000002f987dbe x1859602250200256/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:749/0 lens 392/0 e 1 to 0 dl 1773852308 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:16.0:1773851861.496353:0:61342:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:16.0:1773851861.496354:0:61342:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:16.0:1773851861.496355:0:61342:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.496355:0:61342:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851861.496356:0:61342:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.496356:0:61342:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000020:00000010:16.0:1773851861.496357:0:61342:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851861.496358:0:61342:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 163
00000100:00000001:16.0:1773851861.496358:0:61342:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851861.496359:0:61342:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851861.496359:0:61342:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.496360:0:61342:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851861.496360:0:61342:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.496361:0:61342:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.496361:0:61342:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602262738880
00000020:00000001:16.0:1773851861.496362:0:61342:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.496362:0:61342:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000020:00000001:16.0:1773851861.496363:0:61342:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.496363:0:61342:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=164
00000020:00000001:16.0:1773851861.496364:0:61342:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000020:00000001:16.0:1773851861.496364:0:61342:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:16.0:1773851861.496365:0:61342:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.496365:0:61342:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851861.496365:0:61342:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:16.0:1773851861.496366:0:61342:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.496366:0:61342:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:16.0:1773851861.496367:0:61342:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.496368:0:61342:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.496368:0:61342:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.1:1773851861.496369:0:61342:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000099ad4b79 x1859602262738880/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:346/0 lens 392/0 e 0 to 0 dl 1773852461 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00080000:16.1:1773851861.496372:0:61342:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000b2d6c7ef x1859602262738880/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:193/0 lens 392/0 e 1 to 0 dl 1773852308 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:16.0:1773851861.496374:0:61342:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:16.0:1773851861.496375:0:61342:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:16.0:1773851861.496375:0:61342:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.496376:0:61342:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851861.496376:0:61342:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.496377:0:61342:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000020:00000010:16.0:1773851861.496377:0:61342:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851861.496378:0:61342:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 163
00000100:00000001:16.0:1773851861.496378:0:61342:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851861.496379:0:61342:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851861.496379:0:61342:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.496380:0:61342:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851861.496380:0:61342:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.496381:0:61342:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.496381:0:61342:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602262653824
00000020:00000001:16.0:1773851861.496381:0:61342:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.496382:0:61342:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f8ed
00000020:00000001:16.0:1773851861.496382:0:61342:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.496383:0:61342:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09d60f5 refcount=164
00000020:00000001:16.0:1773851861.496383:0:61342:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000020:00000001:16.0:1773851861.496384:0:61342:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102876328960 : -106970833222656 : ffff9eb5e97c0400)
00000100:00000001:16.0:1773851861.496384:0:61342:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.496384:0:61342:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851861.496385:0:61342:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:16.0:1773851861.496385:0:61342:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.496386:0:61342:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:16.0:1773851861.496386:0:61342:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.496387:0:61342:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.496387:0:61342:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.1:1773851861.496388:0:61342:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000792e6d9c x1859602262653824/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:346/0 lens 392/0 e 0 to 0 dl 1773852461 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00080000:16.1:1773851861.496391:0:61342:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000cc3537ed x1859602262653824/t0(0) o35->fd96080a-33e6-4035-b5d5-c4f2e0fc3c75@26323@kfi7:193/0 lens 392/0 e 1 to 0 dl 1773852308 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:16.0:1773851861.496393:0:61342:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:16.0:1773851861.496394:0:61342:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:16.0:1773851861.496394:0:61342:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.496395:0:61342:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851861.496396:0:61342:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.496396:0:61342:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000020:00000010:16.0:1773851861.496397:0:61342:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851861.496397:0:61342:0:(genops.c:882:class_export_put()) PUTting export 00000000e09d60f5 : new refcount 163
00000100:00000001:16.0:1773851861.496398:0:61342:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851861.534876:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.534877:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.534878:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.534881:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851861.534883:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15425@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.534884:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15425@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.534885:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15425@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.534886:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073e1142c nid 15425@kfi7 refs 1
00000400:00000200:17.0:1773851861.534887:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15425@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.534888:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073e1142c nid 15425@kfi7 refs 2
00000400:00000200:17.0:1773851861.534888:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000073e1142c nid 15425@kfi7 refs 3
00000400:00000200:17.0:1773851861.534889:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15488@kfi7 to cpt 5
00000400:00000200:17.0:1773851861.534890:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15488@kfi7 of length 224 into portal 12 MB=0x69b4b5b562ec0
00000400:00000200:17.0:1773851861.534891:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15488@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 2464
00000800:00000200:17.0:1773851861.534892:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851861.534894:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.534895:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15425@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.534896:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851861.534896:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851861.534897:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d5aa252d.
00000100:00000040:17.0:1773851861.534897:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000d5aa252d x1859597817491136 msgsize 224
00000100:00100000:17.0:1773851861.534898:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15488@kfi7 (source: 12345-15425@kfi7)
00000100:00000001:17.0:1773851861.534899:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851861.534900:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000073e1142c nid 15425@kfi7 refs 2
00000800:00000200:17.0:1773851861.534901:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851861.534901:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851861.534901:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.534901:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851861.534901:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.534902:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.534902:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597817491136
00000020:00000001:16.0:1773851861.534903:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.534903:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81c87
00000020:00000001:16.0:1773851861.534904:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.534906:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b7502ada refcount=170
00000020:00000001:16.0:1773851861.534906:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151316290560 : -106922393261056 : ffff9ec130bb2c00)
00000020:00000001:16.0:1773851861.534907:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637151316290560 : -106922393261056 : ffff9ec130bb2c00)
00000100:00000001:16.0:1773851861.534908:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.534909:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851861.534909:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:16.0:1773851861.534910:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.534910:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:16.0:1773851861.534911:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.534911:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.534911:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851861.534912:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851861.534913:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851861.534913:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.534914:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851861.534915:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851861.534915:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851861.534916:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851861.534916:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851861.534917:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.534917:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15488@kfi7, seq: 2156293
00000100:00000040:16.0:1773851861.534917:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b7502ada : new rpc_count 1
00000100:00000001:19.0:1773851861.534918:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.534918:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764365568 : -107095945186048 : ffff9e98c83af500)
00000100:00000040:16.0:1773851861.534919:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d5aa252d x1859597817491136/t0(0) o400->f920bebe-788d-4be2-8d05-6738b016b355@15488@kfi7:82/0 lens 224/0 e 0 to 0 dl 1773852197 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1460-0'
00000100:00000001:16.0:1773851861.534922:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.534922:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851861.534923:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5aa252d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f920bebe-788d-4be2-8d05-6738b016b355+170:39547:x1859597817491136:12345-15488@kfi7:400:default-tuolumne1460-0
00000100:00000200:16.0:1773851861.534924:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597817491136
00000020:00000001:16.0:1773851861.534924:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851861.534925:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851861.534926:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.534926:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851861.534927:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851861.534927:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851861.534928:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597817491136, found 0 last_xid 1859597817067135
00000020:00000001:16.0:1773851861.534929:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851861.534929:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851861.534930:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851861.534930:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.534931:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851861.534931:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851861.534932:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851861.534932:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000ac9f40b.
02000000:00000001:16.0:1773851861.534933:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.534933:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.534934:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851861.534935:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063428, transno 0, xid 1859597817491136
00010000:00000001:16.0:1773851861.534935:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851861.534936:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d5aa252d x1859597817491136/t0(0) o400->f920bebe-788d-4be2-8d05-6738b016b355@15488@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1460-0'
00010000:00000001:16.0:1773851861.534938:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851861.534939:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851861.534939:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=94 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851861.534940:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851861.534942:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000efcb7f38 refcount 3 to 15488@kfi7
00000100:00000001:16.0:1773851861.534942:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449600 : -107146752102016 : ffff9e8cf3e6f180)
02000000:00000001:16.0:1773851861.534943:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851861.534944:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.534944:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851861.534945:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15425@kfi7
00000400:00000010:16.0:1773851861.534946:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003d3d92cb.
00000100:00000200:16.0:1773851861.534947:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597817491136, offset 224
00000400:00000200:16.0:1773851861.534948:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15425@kfi7
00000400:00000200:16.0:1773851861.534949:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15425@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.534950:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073e1142c nid 15425@kfi7 refs 1
00000400:00000200:16.0:1773851861.534951:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000073e1142c nid 15425@kfi7 refs 2
00000400:00000200:16.0:1773851861.534952:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000073e1142c nid 15425@kfi7 refs 3
00000400:00000200:16.0:1773851861.534953:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15425@kfi7 local destination
00000400:00000200:16.0:1773851861.534954:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768983:8768983:1024:4294967295] 15425@kfi7 LPNI seq info [156982:156982:16:4294967295]
00000400:00000200:16.0:1773851861.534956:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000073e1142c nid 15425@kfi7 refs 2
00000400:00000200:16.0:1773851861.534956:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15425@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.534958:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15425@kfi7(15425@kfi7:15425@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851861.534959:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000073e1142c nid 15425@kfi7 refs 3
00000800:00000200:16.0:1773851861.534961:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851861.534962:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851861.534964:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851861.534966:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe82 Using peer 15425@kfi7(0xe82)
00000800:00000200:16.0:1773851861.534969:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0xe82: rc=0
00000800:00000200:16.0:1773851861.534970:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851861.534972:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851861.534972:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000efcb7f38 refcount 2 to 15488@kfi7
00010000:00000001:16.0:1773851861.534973:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851861.534974:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.534974:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851861.534975:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d5aa252d x1859597817491136/t0(0) o400->f920bebe-788d-4be2-8d05-6738b016b355@15488@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1460-0'
00000100:00100000:16.0:1773851861.534980:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5aa252d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f920bebe-788d-4be2-8d05-6738b016b355+170:39547:x1859597817491136:12345-15488@kfi7:400:default-tuolumne1460-0 Request processed in 56us (80us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851861.534982:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15488@kfi7, seq: 2156293
00000100:00000040:16.0:1773851861.534983:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b7502ada : new rpc_count 0
00000100:00000001:16.0:1773851861.534983:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.534983:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851861.534984:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.534984:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000020:00000010:16.0:1773851861.534985:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851861.534985:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b7502ada : new refcount 169
00000100:00000001:16.0:1773851861.534986:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851861.534991:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe82 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851861.534993:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.534994:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15425@kfi7: PUT: OK
00000400:00000200:17.0:1773851861.534995:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003d3d92cb
00000400:00000010:17.0:1773851861.534995:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003d3d92cb.
00000100:00000001:17.0:1773851861.534996:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851861.534996:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851861.534997:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000073e1142c nid 15425@kfi7 refs 2
00000800:00000200:17.0:1773851861.534998:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 15425@kfi7(00000000e7f89bf7):0x0 lsk 3715 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe82 Transaction freed
00000800:00000200:13.0:1773851861.547033:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.547033:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.547035:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.547039:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.547041:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16129@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.547042:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16129@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.547043:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16129@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.547044:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001294df08 nid 16129@kfi7 refs 1
00000400:00000200:13.0:1773851861.547045:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16129@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.547046:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001294df08 nid 16129@kfi7 refs 2
00000400:00000200:13.0:1773851861.547047:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001294df08 nid 16129@kfi7 refs 3
00000400:00000200:13.0:1773851861.547048:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16129@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.547048:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16129@kfi7 of length 224 into portal 12 MB=0x69b4b58e19dc0
00000400:00000200:13.0:1773851861.547050:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16129@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 24200
00000800:00000200:13.0:1773851861.547052:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851861.547054:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.547055:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16129@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.547056:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851861.547056:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851861.547057:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003f4fe1c3.
00000100:00000040:13.0:1773851861.547058:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003f4fe1c3 x1859597776297408 msgsize 224
00000100:00100000:13.0:1773851861.547059:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-16129@kfi7 (source: 12345-16129@kfi7)
00000100:00000001:13.0:1773851861.547061:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.547062:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001294df08 nid 16129@kfi7 refs 2
00000800:00000200:13.0:1773851861.547063:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851861.547066:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851861.547066:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851861.547067:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851861.547067:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851861.547068:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851861.547069:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597776297408
00000020:00000001:13.0:1773851861.547070:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851861.547070:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80f52
00000020:00000001:13.0:1773851861.547071:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851861.547075:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000040ad1c23 refcount=167
00000020:00000001:13.0:1773851861.547076:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072919472128 : -107000790079488 : ffff9eaeefeaa800)
00000020:00000001:13.0:1773851861.547077:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072919472128 : -107000790079488 : ffff9eaeefeaa800)
00000100:00000001:13.0:1773851861.547078:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.547079:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851861.547080:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064d4ea1c.
00000020:00000010:13.0:1773851861.547081:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851861.547082:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007398a894.
00000100:00000001:13.0:1773851861.547082:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851861.547083:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851861.547084:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.547084:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851861.547085:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851861.547085:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.547086:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.547088:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.547088:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.547088:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.547088:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.547089:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16129@kfi7, seq: 2289814
00000100:00000001:15.0:1773851861.547090:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.547090:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000040ad1c23 : new rpc_count 1
00000100:00000001:15.0:1773851861.547091:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.547091:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637152534594688 : -106921174956928 : ffff9ec179590480)
00000100:00000040:13.0:1773851861.547092:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003f4fe1c3 x1859597776297408/t0(0) o400->9f03d7bb-7dac-4838-a79c-6b365f41ac8c@16129@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1507-0'
00000100:00000001:13.0:1773851861.547095:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.547095:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.547096:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f4fe1c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9f03d7bb-7dac-4838-a79c-6b365f41ac8c+167:39568:x1859597776297408:12345-16129@kfi7:400:default-tuolumne1507-0
00000100:00000200:13.0:1773851861.547098:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597776297408
00000020:00000001:13.0:1773851861.547098:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.547099:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.547099:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.547101:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.547101:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.547102:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.547103:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597776297408, found 0 last_xid 1859597775875391
00000020:00000001:13.0:1773851861.547104:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.547104:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.547105:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.547105:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851861.547106:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851861.547106:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:13.0:1773851861.547106:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.547106:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000800:00000200:14.0:1773851861.547107:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:13.0:1773851861.547107:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.547108:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000047c0f1a5.
02000000:00000001:13.0:1773851861.547108:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851861.547109:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:13.0:1773851861.547109:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.547110:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.547110:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062647, transno 0, xid 1859597776297408
00000400:00000200:14.0:1773851861.547111:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20082@kfi7 to cpt 3
00010000:00000001:13.0:1773851861.547111:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000400:00000200:14.0:1773851861.547112:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20082@kfi7 : PUT - for me
00010000:00000200:13.0:1773851861.547112:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003f4fe1c3 x1859597776297408/t0(0) o400->9f03d7bb-7dac-4838-a79c-6b365f41ac8c@16129@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1507-0'
00000400:00000200:14.0:1773851861.547113:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20082@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.547113:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b7b7f79 nid 20082@kfi7 refs 1
00010000:00000001:13.0:1773851861.547114:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000400:00000200:14.0:1773851861.547115:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20082@kfi7 to cpt 3
00000400:00000200:14.0:1773851861.547115:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b7b7f79 nid 20082@kfi7 refs 2
00010000:00000001:13.0:1773851861.547115:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851861.547116:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b7b7f79 nid 20082@kfi7 refs 3
00000100:00001000:13.0:1773851861.547116:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000400:00000200:14.0:1773851861.547117:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20147@kfi7 to cpt 1
00000100:00000001:13.0:1773851861.547117:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.547117:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b69b5314 refcount 3 to 16129@kfi7
00000400:00000200:14.0:1773851861.547118:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20147@kfi7 of length 224 into portal 12 MB=0x699e0c50f95c0
00000100:00000001:13.0:1773851861.547118:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487622752 : -107151221928864 : ffff9e8be97acc60)
00000400:00000200:14.0:1773851861.547119:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20147@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 24424
02000000:00000001:13.0:1773851861.547119:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000800:00000200:14.0:1773851861.547120:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:13.0:1773851861.547120:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.547120:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.547121:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16129@kfi7
00000400:00000200:14.0:1773851861.547122:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:13.0:1773851861.547122:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bcbfe65f.
00000100:00000200:13.0:1773851861.547122:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597776297408, offset 224
00000400:00000200:14.0:1773851861.547123:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20082@kfi7: PUT: OK
00000400:00000200:13.0:1773851861.547123:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16129@kfi7
00000100:00000001:14.0:1773851861.547124:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851861.547124:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000400:00000200:13.0:1773851861.547124:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16129@kfi7 to cpt 3
00000100:00000010:14.0:1773851861.547125:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000032706e87.
00000400:00000200:13.0:1773851861.547125:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001294df08 nid 16129@kfi7 refs 1
00000100:00000040:14.0:1773851861.547126:0:2514739:0:(events.c:358:request_in_callback()) incoming req@0000000032706e87 x1858040518120896 msgsize 224
00000400:00000200:13.0:1773851861.547126:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001294df08 nid 16129@kfi7 refs 2
00000100:00100000:14.0:1773851861.547127:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-20147@kfi7 (source: 12345-20082@kfi7)
00000400:00000200:13.0:1773851861.547127:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001294df08 nid 16129@kfi7 refs 3
00000100:00000001:14.0:1773851861.547128:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.547128:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16129@kfi7 local destination
00000100:00000001:15.0:1773851861.547130:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851861.547130:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:13.0:1773851861.547130:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768984:8768984:1024:4294967295] 16129@kfi7 LPNI seq info [856234:856234:16:4294967295]
00000100:00000001:15.0:1773851861.547131:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851861.547131:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851861.547131:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001294df08 nid 16129@kfi7 refs 2
02000000:00000001:15.0:1773851861.547132:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851861.547132:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040518120896
00000400:00000200:13.0:1773851861.547132:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16129@kfi7 to cpt 3
00000020:00000001:15.0:1773851861.547133:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851861.547133:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925fc
00000020:00000001:15.0:1773851861.547134:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:13.0:1773851861.547134:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16129@kfi7(16129@kfi7:16129@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.547135:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001294df08 nid 16129@kfi7 refs 3
00000020:00000040:15.0:1773851861.547136:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bfc9ce3f refcount=6
00000400:00000200:14.0:1773851861.547136:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b7b7f79 nid 20082@kfi7 refs 2
00000020:00000001:15.0:1773851861.547137:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631008256 : -107123078543360 : ffff9e9276f4c800)
00000020:00000001:15.0:1773851861.547137:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631008256 : -107123078543360 : ffff9e9276f4c800)
00000800:00000200:13.0:1773851861.547137:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:15.0:1773851861.547138:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:14.0:1773851861.547138:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002eb192a5: 2054@kfi7:3 <- 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000800:00000200:13.0:1773851861.547138:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:15.0:1773851861.547139:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851861.547140:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ba835c49.
00000020:00000010:15.0:1773851861.547140:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000800:00000200:13.0:1773851861.547140:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000020:00000010:15.0:1773851861.547141:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851861.547142:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000800:00000200:13.0:1773851861.547142:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x93c Using peer 16129@kfi7(0x93c)
00000100:00000001:15.0:1773851861.547143:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851861.547143:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.547144:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851861.547144:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851861.547145:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851861.547145:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000af8ff251: Posted send of 324 bytes to peer 0x93c: rc=0
00000100:00000001:15.0:1773851861.547146:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851861.547146:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x93c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851861.547147:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.547148:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.547148:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851861.547149:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20147@kfi7, seq: 2289815
00000100:00000040:13.0:1773851861.547149:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b69b5314 refcount 2 to 16129@kfi7
00000100:00000001:12.0:1773851861.547149:0:59132:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851861.547149:0:59132:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851861.547150:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bfc9ce3f : new rpc_count 1
00000100:00000001:15.0:1773851861.547150:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341808384 : -106946367743232 : ffff9ebb9bbd9b00)
00010000:00000001:13.0:1773851861.547150:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.547150:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851861.547150:0:59132:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851861.547150:0:59132:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.547151:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851861.547152:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000032706e87 x1858040518120896/t0(0) o400->f4ed6918-a047-40ce-82d4-ad9a88f342f6@20147@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1738-0'
00000100:00000040:13.0:1773851861.547152:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003f4fe1c3 x1859597776297408/t0(0) o400->9f03d7bb-7dac-4838-a79c-6b365f41ac8c@16129@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1507-0'
00000100:00000001:15.0:1773851861.547154:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851861.547155:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851861.547155:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032706e87 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f4ed6918-a047-40ce-82d4-ad9a88f342f6+6:39789:x1858040518120896:12345-20147@kfi7:400:default-tuolumne1738-0
00000100:00100000:13.0:1773851861.547155:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f4fe1c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9f03d7bb-7dac-4838-a79c-6b365f41ac8c+167:39568:x1859597776297408:12345-16129@kfi7:400:default-tuolumne1507-0 Request processed in 59us (96us total) trans 0 rc 0/0
00000100:00000200:15.0:1773851861.547157:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040518120896
00000020:00000001:15.0:1773851861.547157:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000100:00100000:13.0:1773851861.547157:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16129@kfi7, seq: 2289814
00000020:00000001:15.0:1773851861.547158:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00000040:13.0:1773851861.547158:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000040ad1c23 : new rpc_count 0
00000100:00000001:13.0:1773851861.547158:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:14.0:1773851861.547159:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x93c TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851861.547159:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:15.0:1773851861.547160:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851861.547160:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000001:15.0:1773851861.547161:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:14.0:1773851861.547161:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851861.547161:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007398a894.
00000020:00000001:15.0:1773851861.547162:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851861.547162:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000400:00000200:14.0:1773851861.547162:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16129@kfi7: PUT: OK
00000400:00000200:14.0:1773851861.547162:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bcbfe65f
00000020:00000010:13.0:1773851861.547162:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064d4ea1c.
00000020:00000040:13.0:1773851861.547162:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000040ad1c23 : new refcount 166
00000001:00000001:15.0:1773851861.547163:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040518120896, found 0 last_xid 1858040518120895
00000020:00000001:15.0:1773851861.547163:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:14.0:1773851861.547163:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bcbfe65f.
00000100:00000001:14.0:1773851861.547163:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851861.547163:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851861.547164:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851861.547164:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:14.0:1773851861.547164:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000001:15.0:1773851861.547165:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851861.547165:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001294df08 nid 16129@kfi7 refs 2
00000020:00000001:15.0:1773851861.547166:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851861.547166:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851861.547166:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000800:00000200:14.0:1773851861.547166:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000af8ff251: 2069@kfi7:3 -> 16129@kfi7(00000000891edce5):0x0 lsk 2365 rsk 20 tsk 0 trmk 0 tmk 0 trr 3 tta 0x93c Transaction freed
02000000:00000010:15.0:1773851861.547168:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000007e05974.
02000000:00000001:15.0:1773851861.547168:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.547169:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.547169:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851861.547170:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096705522, transno 0, xid 1858040518120896
00010000:00000001:15.0:1773851861.547171:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851861.547171:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000032706e87 x1858040518120896/t0(0) o400->f4ed6918-a047-40ce-82d4-ad9a88f342f6@20147@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1738-0'
00010000:00000001:15.0:1773851861.547174:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851861.547174:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851861.547175:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851861.547176:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851861.547176:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a10856d2 refcount 3 to 20147@kfi7
00000100:00000001:15.0:1773851861.547177:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612704 : -107130477938912 : ffff9e90bdeaf720)
02000000:00000001:15.0:1773851861.547178:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851861.547178:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.547178:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851861.547179:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20082@kfi7
00000400:00000010:15.0:1773851861.547180:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001650250b.
00000100:00000200:15.0:1773851861.547180:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040518120896, offset 224
00000400:00000200:15.0:1773851861.547182:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20082@kfi7
00000400:00000200:15.0:1773851861.547183:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20082@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.547184:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b7b7f79 nid 20082@kfi7 refs 1
00000400:00000200:15.0:1773851861.547185:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b7b7f79 nid 20082@kfi7 refs 2
00000400:00000200:15.0:1773851861.547186:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b7b7f79 nid 20082@kfi7 refs 3
00000400:00000200:15.0:1773851861.547187:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20082@kfi7 local destination
00000400:00000200:15.0:1773851861.547189:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768985:8768985:1024:4294967295] 20082@kfi7 LPNI seq info [8697677:8697677:16:4294967295]
00000400:00000200:15.0:1773851861.547190:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b7b7f79 nid 20082@kfi7 refs 2
00000400:00000200:15.0:1773851861.547191:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20082@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.547193:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20082@kfi7(20082@kfi7:20082@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851861.547194:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b7b7f79 nid 20082@kfi7 refs 3
00000800:00000200:15.0:1773851861.547195:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851861.547196:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851861.547198:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851861.547200:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000106a Using peer 20082@kfi7(0x10000000000106a)
00000800:00000200:15.0:1773851861.547204:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x10000000000106a: rc=0
00000800:00000200:15.0:1773851861.547205:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000106a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851861.547206:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851861.547207:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a10856d2 refcount 2 to 20147@kfi7
00010000:00000001:15.0:1773851861.547208:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851861.547209:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.547209:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851861.547210:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000032706e87 x1858040518120896/t0(0) o400->f4ed6918-a047-40ce-82d4-ad9a88f342f6@20147@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1738-0'
00000100:00100000:15.0:1773851861.547213:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032706e87 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f4ed6918-a047-40ce-82d4-ad9a88f342f6+6:39789:x1858040518120896:12345-20147@kfi7:400:default-tuolumne1738-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851861.547215:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20147@kfi7, seq: 2289815
00000100:00000040:15.0:1773851861.547217:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bfc9ce3f : new rpc_count 0
00000800:00000200:13.0:1773851861.547217:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000106a TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851861.547218:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851861.547218:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851861.547218:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851861.547218:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851861.547219:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000020:00000010:15.0:1773851861.547220:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ba835c49.
00000020:00000040:15.0:1773851861.547220:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000bfc9ce3f : new refcount 5
00000400:00000200:13.0:1773851861.547220:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20082@kfi7: PUT: OK
00000100:00000001:15.0:1773851861.547221:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851861.547221:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001650250b
00000400:00000010:13.0:1773851861.547221:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001650250b.
00000100:00000001:13.0:1773851861.547222:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851861.547222:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851861.547223:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b7b7f79 nid 20082@kfi7 refs 2
00000800:00000200:13.0:1773851861.547225:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 20082@kfi7(000000003ec56142):0x0 lsk 4203 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000106a Transaction freed
00000800:00000200:13.0:1773851861.568170:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.568171:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.568172:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.568174:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.568176:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.568177:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13872@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.568178:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.568179:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 1
00000400:00000200:13.0:1773851861.568180:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.568181:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000400:00000200:13.0:1773851861.568181:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 3
00000400:00000200:13.0:1773851861.568182:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.568183:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13872@kfi7 of length 224 into portal 12 MB=0x69b0a0dfe0c00
00000400:00000200:13.0:1773851861.568184:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13872@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 24648
00000800:00000200:13.0:1773851861.568186:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851861.568188:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.568189:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13872@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.568190:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851861.568190:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851861.568191:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000095199f25.
00000100:00000040:13.0:1773851861.568192:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000095199f25 x1859317346995200 msgsize 224
00000100:00100000:13.0:1773851861.568193:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13872@kfi7 (source: 12345-13872@kfi7)
00000100:00000001:13.0:1773851861.568194:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.568194:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000100:00000001:15.0:1773851861.568196:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851861.568196:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851861.568197:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851861.568198:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851861.568198:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851861.568199:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851861.568200:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317346995200
00000020:00000001:15.0:1773851861.568201:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851861.568202:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918e3
00000020:00000001:15.0:1773851861.568203:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851861.568206:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b973362c refcount=161
00000020:00000001:15.0:1773851861.568207:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241990144 : -107152467561472 : ffff9e8b9f3bf400)
00000020:00000001:15.0:1773851861.568208:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241990144 : -107152467561472 : ffff9e8b9f3bf400)
00000100:00000001:15.0:1773851861.568210:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851861.568211:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851861.568212:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007b1dfd0a.
00000020:00000010:15.0:1773851861.568213:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851861.568214:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851861.568215:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851861.568216:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851861.568217:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.568218:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851861.568219:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851861.568219:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.568221:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.568222:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.568223:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.568223:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.568223:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.568224:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13872@kfi7, seq: 2289816
00000100:00000040:13.0:1773851861.568224:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b973362c : new rpc_count 1
00000100:00000001:15.0:1773851861.568225:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.568225:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637152534624640 : -106921174926976 : ffff9ec179597980)
00000100:00000001:15.0:1773851861.568226:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.568226:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000095199f25 x1859317346995200/t0(0) o400->d16ca4d9-fe5e-4fc4-a5c2-322d76678650@13872@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1357-0'
00000100:00000001:13.0:1773851861.568229:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.568229:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.568230:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095199f25 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:d16ca4d9-fe5e-4fc4-a5c2-322d76678650+161:39836:x1859317346995200:12345-13872@kfi7:400:default-tuolumne1357-0
00000100:00000200:13.0:1773851861.568231:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317346995200
00000020:00000001:13.0:1773851861.568232:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.568233:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.568233:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.568234:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.568234:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.568235:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.568235:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317346995200, found 0 last_xid 1859317346280319
00000020:00000001:13.0:1773851861.568245:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.568246:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.568246:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.568247:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.568247:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.568248:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851861.568248:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.568249:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000064d4ea1c.
02000000:00000001:13.0:1773851861.568249:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.568250:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.568250:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.568251:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062833, transno 0, xid 1859317346995200
00010000:00000001:13.0:1773851861.568251:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851861.568252:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000095199f25 x1859317346995200/t0(0) o400->d16ca4d9-fe5e-4fc4-a5c2-322d76678650@13872@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1357-0'
00010000:00000001:13.0:1773851861.568254:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851861.568255:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851861.568255:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851861.568256:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.568257:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cceb951d refcount 5 to 13872@kfi7
00000100:00000001:13.0:1773851861.568257:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521907776 : -107145187643840 : ffff9e8d5126ae40)
02000000:00000001:13.0:1773851861.568258:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851861.568258:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.568259:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.568260:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13872@kfi7
00000400:00000010:13.0:1773851861.568260:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5e8c091.
00000100:00000200:13.0:1773851861.568261:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317346995200, offset 224
00000400:00000200:13.0:1773851861.568262:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13872@kfi7
00000400:00000200:13.0:1773851861.568263:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.568264:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 1
00000400:00000200:13.0:1773851861.568264:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000400:00000200:13.0:1773851861.568265:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 3
00000400:00000200:13.0:1773851861.568266:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13872@kfi7 local destination
00000400:00000200:13.0:1773851861.568267:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768986:8768986:1024:4294967295] 13872@kfi7 LPNI seq info [1102684:1102684:16:4294967295]
00000400:00000200:13.0:1773851861.568272:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000400:00000200:13.0:1773851861.568273:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.568274:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13872@kfi7(13872@kfi7:13872@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.568275:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 3
00000800:00000200:13.0:1773851861.568276:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.568278:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851861.568280:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851861.568281:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x464 Using peer 13872@kfi7(0x464)
00000800:00000200:13.0:1773851861.568284:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 324 bytes to peer 0x464: rc=0
00000800:00000200:13.0:1773851861.568286:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x464 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851861.568287:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.568288:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cceb951d refcount 4 to 13872@kfi7
00010000:00000001:13.0:1773851861.568289:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.568289:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.568290:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851861.568290:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000095199f25 x1859317346995200/t0(0) o400->d16ca4d9-fe5e-4fc4-a5c2-322d76678650@13872@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1357-0'
00000100:00100000:13.0:1773851861.568293:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095199f25 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:d16ca4d9-fe5e-4fc4-a5c2-322d76678650+161:39836:x1859317346995200:12345-13872@kfi7:400:default-tuolumne1357-0 Request processed in 63us (101us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851861.568295:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13872@kfi7, seq: 2289816
00000100:00000040:13.0:1773851861.568296:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b973362c : new rpc_count 0
00000100:00000001:13.0:1773851861.568296:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851861.568297:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851861.568297:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:13.0:1773851861.568298:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000800:00000200:14.0:1773851861.568299:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x464 TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851861.568299:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007b1dfd0a.
00000400:00000200:14.0:1773851861.568300:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:13.0:1773851861.568300:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000b973362c : new refcount 160
00000100:00000001:13.0:1773851861.568300:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851861.568301:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13872@kfi7: PUT: OK
00000400:00000200:14.0:1773851861.568301:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5e8c091
00000400:00000010:14.0:1773851861.568302:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5e8c091.
00000100:00000001:14.0:1773851861.568302:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851861.568303:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851861.568304:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000800:00000200:14.0:1773851861.568305:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2069@kfi7:3 -> 13872@kfi7(000000006d110a0c):0x0 lsk 1125 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x464 Transaction freed
00000800:00000200:15.0:1773851861.570712:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851861.570713:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851861.570714:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2054@kfi7:3 <- 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851861.570716:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2054@kfi7:3 <- 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851861.570719:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9267@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.570720:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9267@kfi7 : PUT - for me
00000400:00000200:15.0:1773851861.570721:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9267@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.570722:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf339c18 nid 9267@kfi7 refs 1
00000400:00000200:15.0:1773851861.570723:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9267@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.570723:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf339c18 nid 9267@kfi7 refs 2
00000400:00000200:15.0:1773851861.570724:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf339c18 nid 9267@kfi7 refs 3
00000400:00000200:15.0:1773851861.570728:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.570729:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9458@kfi7 of length 224 into portal 12 MB=0x699e1bd4b06c0
00000400:00000200:15.0:1773851861.570730:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9458@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 24872
00000800:00000200:15.0:1773851861.570732:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2054@kfi7:3 <- 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851861.570734:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851861.570735:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9267@kfi7: PUT: OK
00000100:00000001:15.0:1773851861.570736:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851861.570736:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851861.570737:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000005b679de.
00000100:00000040:15.0:1773851861.570738:0:2513974:0:(events.c:358:request_in_callback()) incoming req@0000000005b679de x1858044682766016 msgsize 224
00000100:00100000:15.0:1773851861.570739:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-9458@kfi7 (source: 12345-9267@kfi7)
00000100:00000001:15.0:1773851861.570740:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851861.570741:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf339c18 nid 9267@kfi7 refs 2
00000800:00000200:15.0:1773851861.570743:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2054@kfi7:3 <- 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851861.570743:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851861.570744:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851861.570744:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851861.570745:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851861.570746:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851861.570747:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044682766016
00000020:00000001:13.0:1773851861.570748:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851861.570749:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917bd
00000020:00000001:13.0:1773851861.570750:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851861.570755:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000578952df refcount=431
00000020:00000001:13.0:1773851861.570756:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241748480 : -107152467803136 : ffff9e8b9f384400)
00000020:00000001:13.0:1773851861.570758:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241748480 : -107152467803136 : ffff9e8b9f384400)
00000100:00000001:13.0:1773851861.570759:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.570760:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851861.570761:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ea486345.
00000020:00000010:13.0:1773851861.570762:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851861.570763:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007398a894.
00000100:00000001:13.0:1773851861.570764:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851861.570765:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851861.570766:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851861.570767:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851861.570768:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851861.570769:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.570770:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.570771:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851861.570772:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851861.570772:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.570772:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851861.570773:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9458@kfi7, seq: 2289817
00000100:00000040:15.0:1773851861.570774:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000578952df : new rpc_count 3
00000100:00000001:13.0:1773851861.570774:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.570775:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860214912 : -107049849336704 : ffff9ea383c1cc80)
00000100:00000001:13.0:1773851861.570775:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851861.570776:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000005b679de x1858044682766016/t0(0) o400->e2a26e9b-6b8c-46e2-80ee-c334700fa96c@9458@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1065-0'
00000100:00000001:15.0:1773851861.570778:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851861.570779:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851861.570780:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005b679de pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e2a26e9b-6b8c-46e2-80ee-c334700fa96c+431:39824:x1858044682766016:12345-9458@kfi7:400:default-tuolumne1065-0
00000100:00000200:15.0:1773851861.570781:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044682766016
00000020:00000001:15.0:1773851861.570782:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851861.570782:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851861.570783:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.570783:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851861.570784:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851861.570785:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851861.570785:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044682766016, found 0 last_xid 1858044636790463
00000020:00000001:15.0:1773851861.570786:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851861.570786:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851861.570787:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851861.570787:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.570788:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851861.570788:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851861.570789:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851861.570789:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007b1dfd0a.
02000000:00000001:15.0:1773851861.570790:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.570790:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.570791:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851861.570791:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264556328, transno 0, xid 1858044682766016
00010000:00000001:15.0:1773851861.570792:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851861.570793:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000005b679de x1858044682766016/t0(0) o400->e2a26e9b-6b8c-46e2-80ee-c334700fa96c@9458@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1065-0'
00010000:00000001:15.0:1773851861.570795:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851861.570796:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851861.570797:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851861.570798:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851861.570799:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000022bae6c refcount 3 to 9458@kfi7
00000100:00000001:15.0:1773851861.570800:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521907968 : -107145187643648 : ffff9e8d5126af00)
02000000:00000001:15.0:1773851861.570801:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851861.570801:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.570802:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851861.570803:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9267@kfi7
00000400:00000010:15.0:1773851861.570804:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039cd6bfe.
00000100:00000200:15.0:1773851861.570804:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044682766016, offset 224
00000400:00000200:15.0:1773851861.570806:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9267@kfi7
00000400:00000200:15.0:1773851861.570807:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9267@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.570808:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf339c18 nid 9267@kfi7 refs 1
00000400:00000200:15.0:1773851861.570809:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf339c18 nid 9267@kfi7 refs 2
00000400:00000200:15.0:1773851861.570810:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf339c18 nid 9267@kfi7 refs 3
00000400:00000200:15.0:1773851861.570811:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9267@kfi7 local destination
00000400:00000200:15.0:1773851861.570813:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768987:8768987:1024:4294967295] 9267@kfi7 LPNI seq info [10948074:10948074:16:4294967295]
00000400:00000200:15.0:1773851861.570814:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf339c18 nid 9267@kfi7 refs 2
00000400:00000200:15.0:1773851861.570815:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9267@kfi7 to cpt 3
00000400:00000200:15.0:1773851861.570817:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9267@kfi7(9267@kfi7:9267@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851861.570819:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf339c18 nid 9267@kfi7 refs 3
00000800:00000200:15.0:1773851861.570820:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851861.570821:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851861.570823:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851861.570826:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e4a Using peer 9267@kfi7(0x100000000000e4a)
00000800:00000200:15.0:1773851861.570829:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x100000000000e4a: rc=0
00000800:00000200:15.0:1773851861.570831:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e4a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851861.570835:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851861.570836:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000022bae6c refcount 2 to 9458@kfi7
00010000:00000001:15.0:1773851861.570837:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851861.570837:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851861.570838:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851861.570839:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000005b679de x1858044682766016/t0(0) o400->e2a26e9b-6b8c-46e2-80ee-c334700fa96c@9458@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1065-0'
00000100:00100000:15.0:1773851861.570842:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005b679de pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e2a26e9b-6b8c-46e2-80ee-c334700fa96c+431:39824:x1858044682766016:12345-9458@kfi7:400:default-tuolumne1065-0 Request processed in 63us (104us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851861.570846:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9458@kfi7, seq: 2289817
00000100:00000040:15.0:1773851861.570847:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000578952df : new rpc_count 2
00000100:00000001:15.0:1773851861.570847:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851861.570847:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e4a TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851861.570848:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851861.570848:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:15.0:1773851861.570849:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007398a894.
00000020:00000010:15.0:1773851861.570850:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ea486345.
00000400:00000200:13.0:1773851861.570850:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:15.0:1773851861.570851:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000578952df : new refcount 430
00000100:00000001:15.0:1773851861.570852:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851861.570852:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9267@kfi7: PUT: OK
00000400:00000200:13.0:1773851861.570853:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039cd6bfe
00000400:00000010:13.0:1773851861.570855:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039cd6bfe.
00000100:00000001:13.0:1773851861.570856:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851861.570857:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851861.570858:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf339c18 nid 9267@kfi7 refs 2
00000800:00000200:13.0:1773851861.570861:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 9267@kfi7(000000009394a8d3):0x0 lsk 3659 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e4a Transaction freed
00000800:00000200:5.0:1773851861.574918:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.574919:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851861.574920:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851861.574922:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851861.574924:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23265@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.574926:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23265@kfi7 : PUT - for me
00000400:00000200:5.0:1773851861.574926:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23265@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.574927:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c44e017 nid 23265@kfi7 refs 1
00000400:00000200:5.0:1773851861.574928:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23265@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.574929:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c44e017 nid 23265@kfi7 refs 2
00000400:00000200:5.0:1773851861.574929:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001c44e017 nid 23265@kfi7 refs 3
00000400:00000200:5.0:1773851861.574930:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23264@kfi7 to cpt 6
00000400:00000200:5.0:1773851861.574931:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23264@kfi7 of length 224 into portal 12 MB=0x699e09000a800
00000400:00000200:5.0:1773851861.574933:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23264@kfi7 of length 224/224 into md 0x793926dc5 [64] + 129624
00000800:00000200:5.0:1773851861.574934:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851861.574936:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851861.574937:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23265@kfi7: PUT: OK
00000100:00000001:5.0:1773851861.574938:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851861.574938:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851861.574939:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e890784c.
00000100:00000040:5.0:1773851861.574940:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e890784c x1858039627950080 msgsize 224
00000100:00100000:5.0:1773851861.574941:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23264@kfi7 (source: 12345-23265@kfi7)
00000100:00000001:5.0:1773851861.574942:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851861.574943:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001c44e017 nid 23265@kfi7 refs 2
00000800:00000200:5.0:1773851861.574944:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851861.574948:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851861.574948:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851861.574949:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851861.574949:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851861.574950:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851861.574951:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039627950080
00000020:00000001:5.0:1773851861.574951:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851861.574952:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92650
00000020:00000001:5.0:1773851861.574952:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851861.574954:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000011e3db8a refcount=6
00000020:00000001:5.0:1773851861.574955:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630996992 : -107123078554624 : ffff9e9276f49c00)
00000020:00000001:5.0:1773851861.574955:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630996992 : -107123078554624 : ffff9e9276f49c00)
00000100:00000001:5.0:1773851861.574956:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.574957:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851861.574958:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851861.574959:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.574960:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006f259d27.
00000100:00000001:5.0:1773851861.574961:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851861.574961:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851861.574962:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.574963:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851861.574963:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851861.574964:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.574965:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851861.574966:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851861.574966:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851861.574966:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851861.574967:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851861.574967:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23264@kfi7, seq: 2001892
00000100:00000001:7.0:1773851861.574968:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851861.574968:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000011e3db8a : new rpc_count 1
00000100:00000001:7.0:1773851861.574969:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.574969:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866953728 : -107088842597888 : ffff9e9a6f93da00)
00000100:00000040:5.0:1773851861.574970:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e890784c x1858039627950080/t0(0) o400->6f0ce435-71ee-474e-9f98-4a4a89d5deee@23264@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1935-0'
00000100:00000001:5.0:1773851861.574973:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.574973:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851861.574975:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e890784c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6f0ce435-71ee-474e-9f98-4a4a89d5deee+6:39818:x1858039627950080:12345-23264@kfi7:400:default-tuolumne1935-0
00000100:00000200:5.0:1773851861.574976:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039627950080
00000020:00000001:5.0:1773851861.574977:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851861.574977:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851861.574978:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.574978:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851861.574979:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851861.574980:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851861.574980:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039627950080, found 0 last_xid 1858039627950079
00000020:00000001:5.0:1773851861.574981:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851861.574982:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851861.574982:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851861.574983:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.574983:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851861.574984:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851861.574984:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851861.574986:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000db5bd417.
02000000:00000001:5.0:1773851861.574986:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.574987:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.574988:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851861.574988:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183250008361, transno 0, xid 1858039627950080
00010000:00000001:5.0:1773851861.574989:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851861.574990:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e890784c x1858039627950080/t0(0) o400->6f0ce435-71ee-474e-9f98-4a4a89d5deee@23264@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1935-0'
00010000:00000001:5.0:1773851861.574992:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851861.574993:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851861.574994:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=93 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851861.574995:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851861.574995:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004a9a1ac6 refcount 3 to 23264@kfi7
00000100:00000001:5.0:1773851861.574996:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739200 : -107139395812416 : ffff9e8eaa5f03c0)
02000000:00000001:5.0:1773851861.574997:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851861.574997:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.574998:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851861.575000:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23265@kfi7
00000400:00000010:5.0:1773851861.575000:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f7d4a8eb.
00000100:00000200:5.0:1773851861.575001:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039627950080, offset 224
00000400:00000200:5.0:1773851861.575003:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23265@kfi7
00000400:00000200:5.0:1773851861.575004:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23265@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.575004:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c44e017 nid 23265@kfi7 refs 1
00000400:00000200:5.0:1773851861.575005:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001c44e017 nid 23265@kfi7 refs 2
00000400:00000200:5.0:1773851861.575006:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001c44e017 nid 23265@kfi7 refs 3
00000400:00000200:5.0:1773851861.575008:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23265@kfi7 local destination
00000400:00000200:5.0:1773851861.575009:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768988:8768988:1024:4294967295] 23265@kfi7 LPNI seq info [138415:138415:16:4294967295]
00000400:00000200:5.0:1773851861.575010:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001c44e017 nid 23265@kfi7 refs 2
00000400:00000200:5.0:1773851861.575011:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23265@kfi7 to cpt 1
00000400:00000200:5.0:1773851861.575013:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23265@kfi7(23265@kfi7:23265@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851861.575014:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001c44e017 nid 23265@kfi7 refs 3
00000800:00000200:5.0:1773851861.575015:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851861.575016:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851861.575018:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851861.575020:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7db Using peer 23265@kfi7(0x7db)
00000800:00000200:5.0:1773851861.575023:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x7db: rc=0
00000800:00000200:5.0:1773851861.575025:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7db TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851861.575027:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851861.575028:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004a9a1ac6 refcount 2 to 23264@kfi7
00010000:00000001:5.0:1773851861.575028:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851861.575029:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851861.575029:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851861.575030:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e890784c x1858039627950080/t0(0) o400->6f0ce435-71ee-474e-9f98-4a4a89d5deee@23264@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1935-0'
00000100:00100000:5.0:1773851861.575036:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e890784c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6f0ce435-71ee-474e-9f98-4a4a89d5deee+6:39818:x1858039627950080:12345-23264@kfi7:400:default-tuolumne1935-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000800:00000200:7.0:1773851861.575038:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7db TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851861.575038:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23264@kfi7, seq: 2001892
00000100:00000040:5.0:1773851861.575039:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000011e3db8a : new rpc_count 0
00000400:00000200:7.0:1773851861.575040:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851861.575040:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851861.575040:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:7.0:1773851861.575041:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23265@kfi7: PUT: OK
00000020:00000010:5.0:1773851861.575041:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:7.0:1773851861.575042:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f7d4a8eb
00000400:00000010:7.0:1773851861.575042:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f7d4a8eb.
00000020:00000010:5.0:1773851861.575042:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006f259d27.
00000100:00000001:7.0:1773851861.575043:0:2507579:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:5.0:1773851861.575043:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000100:00000001:7.0:1773851861.575044:0:2507579:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:5.0:1773851861.575044:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000011e3db8a : new refcount 5
00000100:00000001:5.0:1773851861.575044:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851861.575045:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001c44e017 nid 23265@kfi7 refs 2
00000800:00000200:7.0:1773851861.575046:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 23265@kfi7(0000000005a2b600):0x0 lsk 2012 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7db Transaction freed
00000800:00000200:9.0:1773851861.583883:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.583884:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.583887:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.583891:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.583894:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9840@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.583897:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9840@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.583898:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9840@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.583900:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064cae50d nid 9840@kfi7 refs 1
00000400:00000200:9.0:1773851861.583901:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9840@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.583903:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064cae50d nid 9840@kfi7 refs 2
00000400:00000200:9.0:1773851861.583904:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000064cae50d nid 9840@kfi7 refs 3
00000400:00000200:9.0:1773851861.583906:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9904@kfi7 to cpt 6
00000400:00000200:9.0:1773851861.583908:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9904@kfi7 of length 224 into portal 12 MB=0x69b4b5ea00ec0
00000400:00000200:9.0:1773851861.583910:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9904@kfi7 of length 224/224 into md 0x78146ce49 [64] + 129488
00000800:00000200:9.0:1773851861.583913:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.583916:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.583918:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9840@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.583920:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.583921:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.583922:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e896475f.
00000100:00000040:9.0:1773851861.583924:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e896475f x1859597872664256 msgsize 224
00000100:00100000:9.0:1773851861.583927:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-9904@kfi7 (source: 12345-9840@kfi7)
00000100:00000001:9.0:1773851861.583929:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.583931:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000064cae50d nid 9840@kfi7 refs 2
00000800:00000200:9.0:1773851861.583935:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.583939:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851861.583940:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851861.583941:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.583942:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.583944:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.583945:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597872664256
00000020:00000001:9.0:1773851861.583946:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851861.583947:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7d759
00000020:00000001:9.0:1773851861.583948:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851861.583955:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003a9a7b2f refcount=5
00000020:00000001:9.0:1773851861.583956:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637147373939712 : -106926335611904 : ffff9ec045bfac00)
00000020:00000001:9.0:1773851861.583957:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637147373939712 : -106926335611904 : ffff9ec045bfac00)
00000100:00000001:9.0:1773851861.583959:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.583960:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851861.583961:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851861.583963:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.583964:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851861.583966:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851861.583967:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851861.583968:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.583970:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851861.583971:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851861.583972:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.583973:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851861.583976:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.583976:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.583977:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851861.583977:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.583979:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9904@kfi7, seq: 2130758
00000100:00000001:11.0:1773851861.583980:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.583980:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003a9a7b2f : new rpc_count 1
00000100:00000001:11.0:1773851861.583981:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.583981:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922898176 : -107141786653440 : ffff9e8e1bddad00)
00000100:00000040:9.0:1773851861.583983:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e896475f x1859597872664256/t0(0) o400->2b7cbb51-ff95-400b-87ac-becbda91e093@9904@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1102-0'
00000100:00000001:9.0:1773851861.583989:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.583990:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.583992:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e896475f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:2b7cbb51-ff95-400b-87ac-becbda91e093+5:39530:x1859597872664256:12345-9904@kfi7:400:default-tuolumne1102-0
00000100:00000200:9.0:1773851861.583995:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597872664256
00000020:00000001:9.0:1773851861.583996:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.583997:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.583998:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.583999:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.584000:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.584002:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.584003:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597872664256, found 0 last_xid 1859597872664255
00000020:00000001:9.0:1773851861.584004:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.584005:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.584006:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.584007:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.584008:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.584009:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.584010:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.584011:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009f825a64.
02000000:00000001:9.0:1773851861.584013:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.584014:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.584015:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.584016:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035341386, transno 0, xid 1859597872664256
00010000:00000001:9.0:1773851861.584018:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.584019:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e896475f x1859597872664256/t0(0) o400->2b7cbb51-ff95-400b-87ac-becbda91e093@9904@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1102-0'
00010000:00000001:9.0:1773851861.584024:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.584025:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.584026:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.584028:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.584030:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000008ad50e4 refcount 3 to 9904@kfi7
00000100:00000001:9.0:1773851861.584031:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643690656 : -107157065860960 : ffff9e8a8d2778a0)
02000000:00000001:9.0:1773851861.584033:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.584033:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.584036:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.584037:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9840@kfi7
00000400:00000010:9.0:1773851861.584038:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002185eb96.
00000100:00000200:9.0:1773851861.584040:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597872664256, offset 224
00000400:00000200:9.0:1773851861.584042:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9840@kfi7
00000400:00000200:9.0:1773851861.584044:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9840@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.584045:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064cae50d nid 9840@kfi7 refs 1
00000400:00000200:9.0:1773851861.584047:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000064cae50d nid 9840@kfi7 refs 2
00000400:00000200:9.0:1773851861.584049:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000064cae50d nid 9840@kfi7 refs 3
00000400:00000200:9.0:1773851861.584052:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9840@kfi7 local destination
00000400:00000200:9.0:1773851861.584054:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768989:8768989:1024:4294967295] 9840@kfi7 LPNI seq info [291447:291447:16:4294967295]
00000400:00000200:9.0:1773851861.584057:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000064cae50d nid 9840@kfi7 refs 2
00000400:00000200:9.0:1773851861.584058:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9840@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.584062:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9840@kfi7(9840@kfi7:9840@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.584064:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000064cae50d nid 9840@kfi7 refs 3
00000800:00000200:9.0:1773851861.584066:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.584068:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.584073:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.584077:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000abe Using peer 9840@kfi7(0x100000000000abe)
00000800:00000200:9.0:1773851861.584082:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000438708cd: Posted send of 324 bytes to peer 0x100000000000abe: rc=0
00000800:00000200:9.0:1773851861.584085:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000abe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.584089:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.584090:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000008ad50e4 refcount 2 to 9904@kfi7
00010000:00000001:9.0:1773851861.584092:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.584092:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.584094:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.584095:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e896475f x1859597872664256/t0(0) o400->2b7cbb51-ff95-400b-87ac-becbda91e093@9904@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1102-0'
00000800:00000200:10.0:1773851861.584100:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000abe TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851861.584101:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e896475f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:2b7cbb51-ff95-400b-87ac-becbda91e093+5:39530:x1859597872664256:12345-9904@kfi7:400:default-tuolumne1102-0 Request processed in 111us (176us total) trans 0 rc 0/0
00000400:00000200:10.0:1773851861.584103:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851861.584105:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9840@kfi7: PUT: OK
00000100:00100000:9.0:1773851861.584106:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9904@kfi7, seq: 2130758
00000400:00000200:10.0:1773851861.584107:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002185eb96
00000100:00000040:9.0:1773851861.584107:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003a9a7b2f : new rpc_count 0
00000400:00000010:10.0:1773851861.584108:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002185eb96.
00000100:00000001:10.0:1773851861.584109:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851861.584109:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851861.584109:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851861.584110:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851861.584111:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000064cae50d nid 9840@kfi7 refs 2
00000020:00000010:9.0:1773851861.584111:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.584112:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000800:00000200:10.0:1773851861.584114:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 9840@kfi7(00000000819faddc):0x0 lsk 2751 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000abe Transaction freed
00000020:00000010:9.0:1773851861.584114:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851861.584115:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000003a9a7b2f : new refcount 4
00000100:00000001:9.0:1773851861.584116:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851861.591722:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851861.591722:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851861.591723:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851861.591729:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851861.591731:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16784@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.591732:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16784@kfi7 : PUT - for me
00000400:00000200:21.0:1773851861.591733:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16784@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.591734:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a18a55e nid 16784@kfi7 refs 1
00000400:00000200:21.0:1773851861.591735:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16784@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.591735:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a18a55e nid 16784@kfi7 refs 2
00000400:00000200:21.0:1773851861.591736:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008a18a55e nid 16784@kfi7 refs 3
00000400:00000200:21.0:1773851861.591737:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16721@kfi7 to cpt 4
00000400:00000200:21.0:1773851861.591738:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16721@kfi7 of length 224 into portal 12 MB=0x69b4b58e89340
00000400:00000200:21.0:1773851861.591739:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16721@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 31464
00000800:00000200:21.0:1773851861.591740:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851861.591742:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851861.591743:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16784@kfi7: PUT: OK
00000100:00000001:21.0:1773851861.591744:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851861.591744:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851861.591745:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd340062.
00000100:00000040:21.0:1773851861.591746:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000dd340062 x1859597776753472 msgsize 224
00000100:00100000:21.0:1773851861.591748:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16721@kfi7 (source: 12345-16784@kfi7)
00000100:00000001:21.0:1773851861.591749:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851861.591750:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008a18a55e nid 16784@kfi7 refs 2
00000100:00000001:23.0:1773851861.591751:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851861.591751:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851861.591751:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851861.591752:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851861.591752:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851861.591753:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851861.591754:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597776753472
00000020:00000001:23.0:1773851861.591754:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851861.591755:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2454cb53
00000020:00000001:23.0:1773851861.591755:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851861.591759:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a2956610 refcount=167
00000020:00000001:23.0:1773851861.591760:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114723851264 : -106958985700352 : ffff9eb8aba6dc00)
00000020:00000001:23.0:1773851861.591760:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637114723851264 : -106958985700352 : ffff9eb8aba6dc00)
00000100:00000001:23.0:1773851861.591762:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.591762:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851861.591763:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094554af3.
00000020:00000010:23.0:1773851861.591764:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851861.591765:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851861.591766:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851861.591766:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851861.591767:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.591768:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851861.591768:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851861.591769:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.591770:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.591771:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851861.591771:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851861.591771:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851861.591772:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16721@kfi7, seq: 1997956
00000100:00000001:22.0:1773851861.591772:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851861.591774:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a2956610 : new rpc_count 1
00000100:00000001:22.0:1773851861.591774:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.591775:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637057733469184 : -107015976082432 : ffff9eab66c2a400)
00000100:00000001:22.0:1773851861.591775:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.591776:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dd340062 x1859597776753472/t0(0) o400->ce48d17e-1973-456c-afe2-c0e897c518a3@16721@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1538-0'
00000100:00000001:23.0:1773851861.591778:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.591779:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851861.591780:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd340062 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ce48d17e-1973-456c-afe2-c0e897c518a3+167:39574:x1859597776753472:12345-16721@kfi7:400:default-tuolumne1538-0
00000100:00000200:23.0:1773851861.591781:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597776753472
00000020:00000001:23.0:1773851861.591781:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851861.591782:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851861.591783:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.591783:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851861.591784:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851861.591784:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851861.591785:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597776753472, found 0 last_xid 1859597776331903
00000020:00000001:23.0:1773851861.591786:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851861.591787:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851861.591787:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851861.591788:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.591788:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851861.591789:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851861.591789:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851861.591790:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000697f1763.
02000000:00000001:23.0:1773851861.591791:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.591791:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.591792:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851861.591793:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062797, transno 0, xid 1859597776753472
00010000:00000001:23.0:1773851861.591793:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851861.591794:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dd340062 x1859597776753472/t0(0) o400->ce48d17e-1973-456c-afe2-c0e897c518a3@16721@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1538-0'
00010000:00000001:23.0:1773851861.591797:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851861.591797:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851861.591798:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=94 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851861.591799:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851861.591800:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e189b848 refcount 3 to 16721@kfi7
00000100:00000001:23.0:1773851861.591801:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095778144 : -107152613773472 : ffff9e8b9684ef60)
02000000:00000001:23.0:1773851861.591802:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851861.591802:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.591803:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851861.591804:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16784@kfi7
00000400:00000010:23.0:1773851861.591804:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a2dbc8f9.
00000100:00000200:23.0:1773851861.591805:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597776753472, offset 224
00000400:00000200:23.0:1773851861.591807:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16784@kfi7
00000400:00000200:23.0:1773851861.591807:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16784@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.591808:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a18a55e nid 16784@kfi7 refs 1
00000400:00000200:23.0:1773851861.591809:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008a18a55e nid 16784@kfi7 refs 2
00000400:00000200:23.0:1773851861.591810:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008a18a55e nid 16784@kfi7 refs 3
00000400:00000200:23.0:1773851861.591812:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16784@kfi7 local destination
00000400:00000200:23.0:1773851861.591813:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768990:8768990:1024:4294967295] 16784@kfi7 LPNI seq info [586564:586564:16:4294967295]
00000400:00000200:23.0:1773851861.591814:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008a18a55e nid 16784@kfi7 refs 2
00000400:00000200:23.0:1773851861.591815:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16784@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.591817:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16784@kfi7(16784@kfi7:16784@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851861.591818:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008a18a55e nid 16784@kfi7 refs 3
00000800:00000200:23.0:1773851861.591820:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851861.591821:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851861.591824:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851861.591826:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a8f Using peer 16784@kfi7(0x100000000000a8f)
00000800:00000200:23.0:1773851861.591831:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x100000000000a8f: rc=0
00000800:00000200:23.0:1773851861.591832:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a8f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851861.591837:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.591838:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e189b848 refcount 2 to 16721@kfi7
00010000:00000001:23.0:1773851861.591839:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851861.591840:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.591840:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851861.591841:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd340062 x1859597776753472/t0(0) o400->ce48d17e-1973-456c-afe2-c0e897c518a3@16721@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1538-0'
00000800:00000200:21.0:1773851861.591843:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a8f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851861.591844:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851861.591845:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd340062 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ce48d17e-1973-456c-afe2-c0e897c518a3+167:39574:x1859597776753472:12345-16721@kfi7:400:default-tuolumne1538-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851861.591845:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16784@kfi7: PUT: OK
00000400:00000200:21.0:1773851861.591846:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a2dbc8f9
00000400:00000010:21.0:1773851861.591846:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a2dbc8f9.
00000100:00000001:21.0:1773851861.591847:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851861.591847:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:23.0:1773851861.591848:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16721@kfi7, seq: 1997956
00000100:00000040:23.0:1773851861.591848:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a2956610 : new rpc_count 0
00000400:00000200:21.0:1773851861.591848:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008a18a55e nid 16784@kfi7 refs 2
00000100:00000001:23.0:1773851861.591849:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851861.591849:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 16784@kfi7(0000000033864b16):0x0 lsk 2704 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a8f Transaction freed
00000100:00000001:23.0:1773851861.591850:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851861.591850:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851861.591851:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851861.591852:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094554af3.
00000020:00000040:23.0:1773851861.591853:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000a2956610 : new refcount 166
00000100:00000001:23.0:1773851861.591854:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851861.592941:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.592941:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851861.592942:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.592942:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851861.592944:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.592944:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851861.592946:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19187@kfi7(00000000dfd3eab4):0x594 version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851861.592947:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851861.592948:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 Using peer 19187@kfi7(0x100000000000594)
00000400:00000200:18.0:1773851861.592949:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19187@kfi7 to cpt 4
00000400:00000200:18.0:1773851861.592951:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19187@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.592951:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19187@kfi7 to cpt 4
00000400:00000200:18.0:1773851861.592952:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19187@kfi7 to cpt 4
00000400:00000200:18.0:1773851861.592953:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 1
00000800:00000200:17.0:1773851861.592953:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x100000000000594: rc=0
00000400:00000200:18.0:1773851861.592954:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19187@kfi7 to cpt 4
00000400:00000200:18.0:1773851861.592955:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 2
00000800:00000200:17.0:1773851861.592955:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851861.592957:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 3
00000400:00000200:18.0:1773851861.592958:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19186@kfi7 to cpt 1
00000400:00000200:18.0:1773851861.592959:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19186@kfi7 of length 224 into portal 12 MB=0x699e0afda5080
00000400:00000200:18.0:1773851861.592961:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19186@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 2688
00000800:00000200:18.0:1773851861.592963:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851861.592965:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851861.592967:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19187@kfi7: PUT: OK
00000100:00000001:18.0:1773851861.592968:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851861.592968:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:17.0:1773851861.592968:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 TN_EVENT_TX_OK event status 0
00000100:00000010:18.0:1773851861.592970:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005d7ebcaf.
00000100:00000040:18.0:1773851861.592971:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000005d7ebcaf x1858040162308224 msgsize 224
00000800:00000200:17.0:1773851861.592971:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 Transaction freed
00000100:00100000:18.0:1773851861.592973:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-19186@kfi7 (source: 12345-19187@kfi7)
00000100:00000001:18.0:1773851861.592974:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851861.592975:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 2
00000100:00000001:16.0:1773851861.592975:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851861.592976:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2054@kfi7:4 <- 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851861.592976:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.592976:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851861.592977:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.592978:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.592979:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040162308224
00000020:00000001:16.0:1773851861.592979:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.592980:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b89
00000020:00000001:16.0:1773851861.592980:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.592983:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cdf80bbf refcount=6
00000020:00000001:16.0:1773851861.592984:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743676928 : -107128965874688 : ffff9e91180b3c00)
00000020:00000001:16.0:1773851861.592985:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743676928 : -107128965874688 : ffff9e91180b3c00)
00000100:00000001:16.0:1773851861.592986:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.592986:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851861.592987:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:16.0:1773851861.592988:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.592989:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:16.0:1773851861.592993:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.592994:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.592994:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851861.592995:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851861.592996:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851861.592996:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.592997:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851861.592999:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851861.592999:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851861.592999:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851861.593000:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851861.593000:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19186@kfi7, seq: 2156294
00000100:00000001:19.0:1773851861.593001:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851861.593001:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cdf80bbf : new rpc_count 1
00000100:00000001:19.0:1773851861.593002:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.593002:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534659584 : -106946174892032 : ffff9ebba73c4800)
00000100:00000040:16.0:1773851861.593003:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005d7ebcaf x1858040162308224/t0(0) o400->e07b322b-b0d3-494f-8ea1-5b194b877eba@19186@kfi7:78/0 lens 224/0 e 0 to 0 dl 1773852193 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1673-0'
00000100:00000001:16.0:1773851861.593006:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.593006:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851861.593007:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d7ebcaf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e07b322b-b0d3-494f-8ea1-5b194b877eba+6:39660:x1858040162308224:12345-19186@kfi7:400:default-tuolumne1673-0
00000100:00000200:16.0:1773851861.593009:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040162308224
00000020:00000001:16.0:1773851861.593009:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851861.593010:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851861.593011:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.593011:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851861.593012:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851861.593013:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851861.593013:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040162308224, found 0 last_xid 1858040162308223
00000020:00000001:16.0:1773851861.593014:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851861.593015:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851861.593016:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851861.593016:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.593017:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851861.593017:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851861.593018:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851861.593019:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004eec5b3e.
02000000:00000001:16.0:1773851861.593020:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.593021:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.593022:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851861.593022:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183234607669, transno 0, xid 1858040162308224
00010000:00000001:16.0:1773851861.593023:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851861.593024:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005d7ebcaf x1858040162308224/t0(0) o400->e07b322b-b0d3-494f-8ea1-5b194b877eba@19186@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1673-0'
00010000:00000001:16.0:1773851861.593027:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851861.593028:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851861.593029:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=94 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851861.593030:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851861.593031:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000214d5e04 refcount 3 to 19186@kfi7
00000100:00000001:16.0:1773851861.593032:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327300672 : -107155382250944 : ffff9e8af1815240)
02000000:00000001:16.0:1773851861.593033:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851861.593033:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.593034:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851861.593035:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19187@kfi7
00000400:00000010:16.0:1773851861.593036:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003d3d92cb.
00000100:00000200:16.0:1773851861.593037:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040162308224, offset 224
00000400:00000200:16.0:1773851861.593038:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19187@kfi7
00000400:00000200:16.0:1773851861.593039:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19187@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.593040:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 1
00000400:00000200:16.0:1773851861.593042:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 2
00000400:00000200:16.0:1773851861.593043:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 3
00000400:00000200:16.0:1773851861.593044:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19187@kfi7 local destination
00000400:00000200:16.0:1773851861.593046:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768991:8768991:1024:4294967295] 19187@kfi7 LPNI seq info [671323:671323:16:4294967295]
00000400:00000200:16.0:1773851861.593048:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 2
00000400:00000200:16.0:1773851861.593049:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19187@kfi7 to cpt 4
00000400:00000200:16.0:1773851861.593051:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19187@kfi7(19187@kfi7:19187@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851861.593053:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 3
00000800:00000200:16.0:1773851861.593054:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851861.593055:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851861.593058:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851861.593060:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 Using peer 19187@kfi7(0x100000000000594)
00000800:00000200:16.0:1773851861.593063:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x100000000000594: rc=0
00000800:00000200:16.0:1773851861.593065:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851861.593067:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851861.593068:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000214d5e04 refcount 2 to 19186@kfi7
00010000:00000001:16.0:1773851861.593069:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851861.593069:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851861.593070:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851861.593070:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005d7ebcaf x1858040162308224/t0(0) o400->e07b322b-b0d3-494f-8ea1-5b194b877eba@19186@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1673-0'
00000100:00100000:16.0:1773851861.593075:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d7ebcaf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e07b322b-b0d3-494f-8ea1-5b194b877eba+6:39660:x1858040162308224:12345-19186@kfi7:400:default-tuolumne1673-0 Request processed in 68us (103us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851861.593077:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19186@kfi7, seq: 2156294
00000100:00000040:16.0:1773851861.593078:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cdf80bbf : new rpc_count 0
00000100:00000001:16.0:1773851861.593079:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851861.593079:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851861.593080:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.593080:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000020:00000010:16.0:1773851861.593081:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851861.593082:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000cdf80bbf : new refcount 5
00000100:00000001:16.0:1773851861.593083:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851861.593087:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851861.593089:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.593090:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19187@kfi7: PUT: OK
00000400:00000200:17.0:1773851861.593091:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003d3d92cb
00000400:00000010:17.0:1773851861.593091:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003d3d92cb.
00000100:00000001:17.0:1773851861.593092:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851861.593092:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851861.593093:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f9faf9f5 nid 19187@kfi7 refs 2
00000800:00000200:17.0:1773851861.593094:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 19187@kfi7(00000000dfd3eab4):0x0 lsk 1429 rsk 60 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000594 Transaction freed
00000800:00000200:25.0:1773851861.609822:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.609823:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.609825:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.609827:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.609829:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15538@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.609830:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15538@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.609831:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15538@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.609831:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c00521c4 nid 15538@kfi7 refs 1
00000400:00000200:25.0:1773851861.609832:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15538@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.609833:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c00521c4 nid 15538@kfi7 refs 2
00000400:00000200:25.0:1773851861.609834:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c00521c4 nid 15538@kfi7 refs 3
00000400:00000200:25.0:1773851861.609834:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15474@kfi7 to cpt 2
00000400:00000200:25.0:1773851861.609836:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15474@kfi7 of length 224 into portal 12 MB=0x69b4b5cb2dcc0
00000400:00000200:25.0:1773851861.609837:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15474@kfi7 of length 224/224 into md 0x16159c6179 [64] + 192920
00000800:00000200:25.0:1773851861.609838:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851861.609840:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.609841:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15538@kfi7: PUT: OK
00000100:00000001:25.0:1773851861.609842:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851861.609842:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851861.609843:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001153fcf2.
00000100:00000040:25.0:1773851861.609844:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000001153fcf2 x1859597840342208 msgsize 224
00000100:00100000:25.0:1773851861.609845:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-15474@kfi7 (source: 12345-15538@kfi7)
00000100:00000001:25.0:1773851861.609846:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851861.609847:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c00521c4 nid 15538@kfi7 refs 2
00000800:00000200:25.0:1773851861.609848:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851861.609848:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851861.609848:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851861.609848:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.609849:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.609850:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.609850:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597840342208
00000020:00000001:24.0:1773851861.609851:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.609852:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d809b7
00000020:00000001:24.0:1773851861.609852:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.609854:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c0ae279 refcount=167
00000020:00000001:24.0:1773851861.609855:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150544978944 : -106923164572672 : ffff9ec102c1e400)
00000020:00000001:24.0:1773851861.609855:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637150544978944 : -106923164572672 : ffff9ec102c1e400)
00000100:00000001:24.0:1773851861.609856:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.609857:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.609857:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8ced97a.
00000020:00000010:24.0:1773851861.609858:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.609859:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.609860:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.609860:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.609861:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.609862:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.609862:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.609863:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.609864:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851861.609865:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851861.609865:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851861.609865:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.609865:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851861.609866:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15474@kfi7, seq: 2025073
00000100:00000001:25.0:1773851861.609867:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.609867:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c0ae279 : new rpc_count 1
00000100:00000001:25.0:1773851861.609868:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.609868:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478774272 : -106938230777344 : ffff9ebd80bdda00)
00000100:00000040:24.0:1773851861.609869:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001153fcf2 x1859597840342208/t0(0) o400->77dcecd7-5e65-45dc-9a02-c55cb2ccee9e@15474@kfi7:78/0 lens 224/0 e 0 to 0 dl 1773852193 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1450-0'
00000100:00000001:24.0:1773851861.609871:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.609872:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.609873:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001153fcf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:77dcecd7-5e65-45dc-9a02-c55cb2ccee9e+167:39582:x1859597840342208:12345-15474@kfi7:400:default-tuolumne1450-0
00000100:00000200:24.0:1773851861.609874:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597840342208
00000020:00000001:24.0:1773851861.609875:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.609875:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.609876:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.609877:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.609878:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.609878:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.609879:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597840342208, found 0 last_xid 1859597839921151
00000020:00000001:24.0:1773851861.609880:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.609880:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.609881:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.609881:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.609882:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.609882:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.609883:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.609884:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005db884a2.
02000000:00000001:24.0:1773851861.609884:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.609885:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.609885:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.609886:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063471, transno 0, xid 1859597840342208
00010000:00000001:24.0:1773851861.609887:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.609888:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001153fcf2 x1859597840342208/t0(0) o400->77dcecd7-5e65-45dc-9a02-c55cb2ccee9e@15474@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1450-0'
00010000:00000001:24.0:1773851861.609890:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.609891:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.609891:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.609892:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.609893:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ae968702 refcount 3 to 15474@kfi7
00000100:00000001:24.0:1773851861.609894:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899612672 : -107146809938944 : ffff9e8cf0746c00)
02000000:00000001:24.0:1773851861.609895:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.609895:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.609896:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.609897:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15538@kfi7
00000400:00000010:24.0:1773851861.609897:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a14eb2ca.
00000100:00000200:24.0:1773851861.609898:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597840342208, offset 224
00000400:00000200:24.0:1773851861.609899:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15538@kfi7
00000400:00000200:24.0:1773851861.609900:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15538@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.609901:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c00521c4 nid 15538@kfi7 refs 1
00000400:00000200:24.0:1773851861.609902:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c00521c4 nid 15538@kfi7 refs 2
00000400:00000200:24.0:1773851861.609903:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c00521c4 nid 15538@kfi7 refs 3
00000400:00000200:24.0:1773851861.609904:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15538@kfi7 local destination
00000400:00000200:24.0:1773851861.609905:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768992:8768992:1024:4294967295] 15538@kfi7 LPNI seq info [640333:640333:16:4294967295]
00000400:00000200:24.0:1773851861.609907:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c00521c4 nid 15538@kfi7 refs 2
00000400:00000200:24.0:1773851861.609908:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15538@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.609909:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15538@kfi7(15538@kfi7:15538@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.609910:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c00521c4 nid 15538@kfi7 refs 3
00000800:00000200:24.0:1773851861.609912:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.609913:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.609915:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.609917:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x143 Using peer 15538@kfi7(0x143)
00000800:00000200:24.0:1773851861.609920:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x143: rc=0
00000800:00000200:24.0:1773851861.609922:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x143 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.609924:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.609924:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ae968702 refcount 2 to 15474@kfi7
00010000:00000001:24.0:1773851861.609925:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.609926:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.609926:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.609927:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001153fcf2 x1859597840342208/t0(0) o400->77dcecd7-5e65-45dc-9a02-c55cb2ccee9e@15474@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1450-0'
00000100:00100000:24.0:1773851861.609931:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001153fcf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:77dcecd7-5e65-45dc-9a02-c55cb2ccee9e+167:39582:x1859597840342208:12345-15474@kfi7:400:default-tuolumne1450-0 Request processed in 59us (86us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.609933:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15474@kfi7, seq: 2025073
00000100:00000040:24.0:1773851861.609934:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c0ae279 : new rpc_count 0
00000100:00000001:24.0:1773851861.609935:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.609936:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.609936:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.609937:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.609938:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8ced97a.
00000020:00000040:24.0:1773851861.609939:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000000c0ae279 : new refcount 166
00000100:00000001:24.0:1773851861.609939:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.609944:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x143 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851861.609945:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.609947:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15538@kfi7: PUT: OK
00000400:00000200:25.0:1773851861.609947:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a14eb2ca
00000400:00000010:25.0:1773851861.609948:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a14eb2ca.
00000100:00000001:25.0:1773851861.609949:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.609949:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.609950:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c00521c4 nid 15538@kfi7 refs 2
00000800:00000200:25.0:1773851861.609951:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 15538@kfi7(000000000de2657b):0x0 lsk 324 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x143 Transaction freed
00000800:00000200:21.0:1773851861.623764:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851861.623765:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851861.623766:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851861.623768:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851861.623769:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.623771:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25730@kfi7 : PUT - for me
00000400:00000200:21.0:1773851861.623771:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.623773:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 1
00000400:00000200:21.0:1773851861.623774:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.623774:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000400:00000200:21.0:1773851861.623775:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 3
00000400:00000200:21.0:1773851861.623776:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:21.0:1773851861.623777:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25667@kfi7 of length 224 into portal 12 MB=0x69b4b61bea500
00000400:00000200:21.0:1773851861.623778:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25667@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 31688
00000800:00000200:21.0:1773851861.623780:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851861.623781:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851861.623782:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25730@kfi7: PUT: OK
00000100:00000001:21.0:1773851861.623783:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851861.623784:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851861.623784:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000099037d71.
00000100:00000040:21.0:1773851861.623785:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000099037d71 x1859597925000448 msgsize 224
00000100:00100000:21.0:1773851861.623786:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25667@kfi7 (source: 12345-25730@kfi7)
00000100:00000001:21.0:1773851861.623787:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851861.623788:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000100:00000001:23.0:1773851861.623789:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851861.623789:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851861.623790:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851861.623790:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851861.623790:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851861.623791:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851861.623791:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597925000448
00000020:00000001:23.0:1773851861.623792:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851861.623792:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74122
00000020:00000001:23.0:1773851861.623793:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851861.623796:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d60686f refcount=469
00000020:00000001:23.0:1773851861.623797:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000020:00000001:23.0:1773851861.623798:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000100:00000001:23.0:1773851861.623798:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.623800:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851861.623800:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094554af3.
00000020:00000010:23.0:1773851861.623801:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851861.623802:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851861.623803:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851861.623803:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851861.623804:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.623805:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851861.623805:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851861.623806:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.623807:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851861.623808:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851861.623808:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851861.623808:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851861.623808:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851861.623809:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25667@kfi7, seq: 1997957
00000100:00000040:23.0:1773851861.623810:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009d60686f : new rpc_count 11
00000100:00000001:23.0:1773851861.623810:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637057733491072 : -107015976060544 : ffff9eab66c2f980)
00000100:00000001:22.0:1773851861.623810:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851861.623810:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.623812:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000099037d71 x1859597925000448/t0(0) o400->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2104-0'
00000100:00000001:23.0:1773851861.623814:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851861.623815:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851861.623815:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099037d71 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:edddd82f-128c-4bbd-98a4-4162bc248cc0+469:39589:x1859597925000448:12345-25667@kfi7:400:default-tuolumne2104-0
00000100:00000200:23.0:1773851861.623817:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597925000448
00000020:00000001:23.0:1773851861.623817:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851861.623818:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851861.623819:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.623819:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851861.623820:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851861.623820:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851861.623821:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597925000448, found 0 last_xid 1859597917438335
00000020:00000001:23.0:1773851861.623822:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851861.623822:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851861.623823:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851861.623823:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.623824:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851861.623825:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851861.623825:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851861.623826:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f50b9b46.
02000000:00000001:23.0:1773851861.623827:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.623827:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.623828:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851861.623829:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584921, transno 0, xid 1859597925000448
00010000:00000001:23.0:1773851861.623830:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851861.623830:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000099037d71 x1859597925000448/t0(0) o400->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2104-0'
00010000:00000001:23.0:1773851861.623833:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851861.623833:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851861.623834:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=94 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851861.623835:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851861.623836:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc978f5f refcount 3 to 25667@kfi7
00000100:00000001:23.0:1773851861.623836:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106880 : -107156354444736 : ffff9e8ab78ed240)
02000000:00000001:23.0:1773851861.623837:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851861.623837:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851861.623838:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851861.623839:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25730@kfi7
00000400:00000010:23.0:1773851861.623839:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000427f6e00.
00000100:00000200:23.0:1773851861.623840:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597925000448, offset 224
00000400:00000200:23.0:1773851861.623841:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25730@kfi7
00000400:00000200:23.0:1773851861.623842:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.623842:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 1
00000400:00000200:23.0:1773851861.623843:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000400:00000200:23.0:1773851861.623845:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 3
00000400:00000200:23.0:1773851861.623846:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25730@kfi7 local destination
00000400:00000200:23.0:1773851861.623847:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768993:8768993:1024:4294967295] 25730@kfi7 LPNI seq info [611805:611805:16:4294967295]
00000400:00000200:23.0:1773851861.623848:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000400:00000200:23.0:1773851861.623849:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:23.0:1773851861.623851:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25730@kfi7(25730@kfi7:25730@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851861.623852:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 3
00000800:00000200:23.0:1773851861.623853:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851861.623854:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851861.623856:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851861.623858:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 Using peer 25730@kfi7(0x100000000000ee8)
00000800:00000200:23.0:1773851861.623861:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x100000000000ee8: rc=0
00000800:00000200:23.0:1773851861.623863:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851861.623864:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851861.623865:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc978f5f refcount 2 to 25667@kfi7
00010000:00000001:23.0:1773851861.623866:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851861.623867:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851861.623867:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851861.623868:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000099037d71 x1859597925000448/t0(0) o400->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2104-0'
00000100:00100000:23.0:1773851861.623871:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099037d71 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:edddd82f-128c-4bbd-98a4-4162bc248cc0+469:39589:x1859597925000448:12345-25667@kfi7:400:default-tuolumne2104-0 Request processed in 56us (85us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851861.623873:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25667@kfi7, seq: 1997957
00000100:00000040:23.0:1773851861.623874:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009d60686f : new rpc_count 10
00000800:00000200:22.0:1773851861.623874:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851861.623875:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851861.623875:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851861.623876:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851861.623876:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:22.0:1773851861.623876:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851861.623877:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094554af3.
00000400:00000200:22.0:1773851861.623877:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25730@kfi7: PUT: OK
00000400:00000200:22.0:1773851861.623877:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000427f6e00
00000020:00000040:23.0:1773851861.623878:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 468
00000100:00000001:23.0:1773851861.623878:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:22.0:1773851861.623878:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000427f6e00.
00000100:00000001:22.0:1773851861.623879:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851861.623879:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851861.623880:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000800:00000200:22.0:1773851861.623882:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 Transaction freed
00000800:00000200:25.0:1773851861.660174:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.660176:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.660178:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.660182:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.660186:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17075@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.660188:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17075@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.660190:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17075@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.660192:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b9d47e7f nid 17075@kfi7 refs 1
00000400:00000200:25.0:1773851861.660194:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17075@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.660195:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b9d47e7f nid 17075@kfi7 refs 2
00000400:00000200:25.0:1773851861.660197:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b9d47e7f nid 17075@kfi7 refs 3
00000400:00000200:25.0:1773851861.660199:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17010@kfi7 to cpt 0
00000400:00000200:25.0:1773851861.660201:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17010@kfi7 of length 224 into portal 12 MB=0x699e1484b5640
00000400:00000200:25.0:1773851861.660203:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17010@kfi7 of length 224/224 into md 0x16159c6179 [64] + 193144
00000800:00000200:25.0:1773851861.660207:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851861.660210:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.660212:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17075@kfi7: PUT: OK
00000100:00000001:25.0:1773851861.660214:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851861.660215:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851861.660217:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000034c48f85.
00000100:00000040:25.0:1773851861.660218:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000034c48f85 x1858042719852096 msgsize 224
00000100:00100000:25.0:1773851861.660221:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17010@kfi7 (source: 12345-17075@kfi7)
00000100:00000001:25.0:1773851861.660223:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851861.660224:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b9d47e7f nid 17075@kfi7 refs 2
00000100:00000001:24.0:1773851861.660225:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851861.660226:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851861.660226:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851861.660227:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.660227:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.660229:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.660230:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042719852096
00000020:00000001:24.0:1773851861.660230:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.660231:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9213a
00000020:00000001:24.0:1773851861.660232:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.660235:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f29cf131 refcount=168
00000020:00000001:24.0:1773851861.660236:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629744640 : -107123079806976 : ffff9e9276e18000)
00000020:00000001:24.0:1773851861.660237:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629744640 : -107123079806976 : ffff9e9276e18000)
00000100:00000001:24.0:1773851861.660238:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.660239:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.660240:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8ced97a.
00000020:00000010:24.0:1773851861.660242:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.660244:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.660245:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.660245:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.660246:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.660248:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.660248:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.660249:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.660251:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851861.660253:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.660253:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.660253:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851861.660254:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851861.660255:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17010@kfi7, seq: 2025074
00000100:00000040:24.0:1773851861.660256:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f29cf131 : new rpc_count 1
00000100:00000001:25.0:1773851861.660257:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.660257:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478763904 : -106938230787712 : ffff9ebd80bdb180)
00000100:00000001:25.0:1773851861.660258:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.660260:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000034c48f85 x1858042719852096/t0(0) o400->ee0b7bea-34a6-4a5f-900c-7e2132c7f70f@17010@kfi7:78/0 lens 224/0 e 0 to 0 dl 1773852193 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1546-0'
00000100:00000001:24.0:1773851861.660265:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.660265:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.660267:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034c48f85 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ee0b7bea-34a6-4a5f-900c-7e2132c7f70f+168:39638:x1858042719852096:12345-17010@kfi7:400:default-tuolumne1546-0
00000100:00000200:24.0:1773851861.660269:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042719852096
00000020:00000001:24.0:1773851861.660270:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.660271:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.660272:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.660273:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.660274:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.660275:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.660276:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042719852096, found 0 last_xid 1858042719426943
00000020:00000001:24.0:1773851861.660277:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.660278:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.660279:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.660280:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.660281:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.660282:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.660283:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.660283:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003f57bde1.
02000000:00000001:24.0:1773851861.660284:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.660285:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.660286:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.660288:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062661, transno 0, xid 1858042719852096
00010000:00000001:24.0:1773851861.660289:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.660290:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000034c48f85 x1858042719852096/t0(0) o400->ee0b7bea-34a6-4a5f-900c-7e2132c7f70f@17010@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1546-0'
00010000:00000001:24.0:1773851861.660294:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.660295:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.660296:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.660298:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.660300:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000025eb64be refcount 3 to 17010@kfi7
00000100:00000001:24.0:1773851861.660301:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958004000 : -107146751547616 : ffff9e8cf3ef6720)
02000000:00000001:24.0:1773851861.660302:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.660303:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.660304:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.660305:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17075@kfi7
00000400:00000010:24.0:1773851861.660306:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6088efc.
00000100:00000200:24.0:1773851861.660307:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042719852096, offset 224
00000400:00000200:24.0:1773851861.660309:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17075@kfi7
00000400:00000200:24.0:1773851861.660311:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17075@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.660312:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b9d47e7f nid 17075@kfi7 refs 1
00000400:00000200:24.0:1773851861.660314:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b9d47e7f nid 17075@kfi7 refs 2
00000400:00000200:24.0:1773851861.660315:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b9d47e7f nid 17075@kfi7 refs 3
00000400:00000200:24.0:1773851861.660317:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17075@kfi7 local destination
00000400:00000200:24.0:1773851861.660319:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768994:8768994:1024:4294967295] 17075@kfi7 LPNI seq info [403968:403968:16:4294967295]
00000400:00000200:24.0:1773851861.660322:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b9d47e7f nid 17075@kfi7 refs 2
00000400:00000200:24.0:1773851861.660323:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17075@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.660326:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17075@kfi7(17075@kfi7:17075@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.660328:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b9d47e7f nid 17075@kfi7 refs 3
00000800:00000200:24.0:1773851861.660330:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.660332:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.660336:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.660339:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c7 Using peer 17075@kfi7(0x1000000000010c7)
00000800:00000200:24.0:1773851861.660344:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x1000000000010c7: rc=0
00000800:00000200:24.0:1773851861.660346:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.660349:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.660351:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000025eb64be refcount 2 to 17010@kfi7
00010000:00000001:24.0:1773851861.660352:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.660355:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.660356:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.660357:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000034c48f85 x1858042719852096/t0(0) o400->ee0b7bea-34a6-4a5f-900c-7e2132c7f70f@17010@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1546-0'
00000100:00100000:24.0:1773851861.660362:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034c48f85 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ee0b7bea-34a6-4a5f-900c-7e2132c7f70f+168:39638:x1858042719852096:12345-17010@kfi7:400:default-tuolumne1546-0 Request processed in 96us (143us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.660366:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17010@kfi7, seq: 2025074
00000100:00000040:24.0:1773851861.660367:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f29cf131 : new rpc_count 0
00000100:00000001:24.0:1773851861.660368:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.660369:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.660370:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.660371:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.660372:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8ced97a.
00000020:00000040:24.0:1773851861.660373:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000f29cf131 : new refcount 167
00000100:00000001:24.0:1773851861.660374:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.660382:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c7 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851861.660385:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.660386:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17075@kfi7: PUT: OK
00000400:00000200:25.0:1773851861.660388:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6088efc
00000400:00000010:25.0:1773851861.660389:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6088efc.
00000100:00000001:25.0:1773851861.660390:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.660390:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.660392:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b9d47e7f nid 17075@kfi7 refs 2
00000800:00000200:25.0:1773851861.660394:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 17075@kfi7(000000007d541bfc):0x0 lsk 4296 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c7 Transaction freed
00000800:00000200:9.0:1773851861.663525:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.663526:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.663527:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.663530:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.663532:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8955@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.663533:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8955@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.663534:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8955@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.663535:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061d53476 nid 8955@kfi7 refs 1
00000400:00000200:9.0:1773851861.663536:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8955@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.663536:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061d53476 nid 8955@kfi7 refs 2
00000400:00000200:9.0:1773851861.663537:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000061d53476 nid 8955@kfi7 refs 3
00000400:00000200:9.0:1773851861.663538:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8954@kfi7 to cpt 7
00000400:00000200:9.0:1773851861.663539:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8954@kfi7 of length 224 into portal 12 MB=0x699de8b1d1a40
00000400:00000200:9.0:1773851861.663540:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8954@kfi7 of length 224/224 into md 0x78146ce49 [64] + 129712
00000800:00000200:9.0:1773851861.663542:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.663544:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.663545:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8955@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.663546:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.663547:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.663548:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad4aa7c8.
00000100:00000040:9.0:1773851861.663548:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ad4aa7c8 x1858030955993664 msgsize 224
00000100:00100000:9.0:1773851861.663550:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8954@kfi7 (source: 12345-8955@kfi7)
00000100:00000001:9.0:1773851861.663552:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.663553:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000061d53476 nid 8955@kfi7 refs 2
00000800:00000200:9.0:1773851861.663554:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.663557:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851861.663557:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851861.663558:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.663558:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.663559:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.663560:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030955993664
00000020:00000001:9.0:1773851861.663561:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851861.663561:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91015
00000020:00000001:9.0:1773851861.663562:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851861.663564:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000334feb08 refcount=6
00000020:00000001:9.0:1773851861.663565:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240094720 : -107152469456896 : ffff9e8b9f1f0800)
00000020:00000001:9.0:1773851861.663565:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240094720 : -107152469456896 : ffff9e8b9f1f0800)
00000100:00000001:9.0:1773851861.663567:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.663568:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851861.663568:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851861.663569:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.663570:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851861.663571:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851861.663572:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851861.663572:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.663573:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851861.663573:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851861.663574:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.663575:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.663576:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.663577:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.663577:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851861.663578:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.663578:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8954@kfi7, seq: 2130759
00000100:00000001:11.0:1773851861.663579:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.663579:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000334feb08 : new rpc_count 1
00000100:00000001:11.0:1773851861.663580:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.663580:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922897024 : -107141786654592 : ffff9e8e1bdda880)
00000100:00000040:9.0:1773851861.663581:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad4aa7c8 x1858030955993664/t0(0) o400->e49f533b-0861-466a-95c3-1e9c3972e343@8954@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne203-0'
00000100:00000001:9.0:1773851861.663584:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.663584:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.663585:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4aa7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:e49f533b-0861-466a-95c3-1e9c3972e343+6:51537:x1858030955993664:12345-8954@kfi7:400:default-tuolumne203-0
00000100:00000200:9.0:1773851861.663586:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030955993664
00000020:00000001:9.0:1773851861.663587:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.663588:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.663588:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.663589:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.663589:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.663590:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.663591:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030955993664, found 0 last_xid 1858030955993663
00000020:00000001:9.0:1773851861.663592:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.663593:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.663593:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.663594:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.663594:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.663595:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.663595:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.663596:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000bb7f08e.
02000000:00000001:9.0:1773851861.663597:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.663598:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.663598:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.663599:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030955993664
00010000:00000001:9.0:1773851861.663600:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.663601:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad4aa7c8 x1858030955993664/t0(0) o400->e49f533b-0861-466a-95c3-1e9c3972e343@8954@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne203-0'
00010000:00000001:9.0:1773851861.663603:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.663604:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.663605:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.663606:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.663607:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000adaffc62 refcount 5 to 8954@kfi7
00000100:00000001:9.0:1773851861.663608:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231804448 : -107130477747168 : ffff9e90bdede420)
02000000:00000001:9.0:1773851861.663609:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.663609:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.663610:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.663611:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8955@kfi7
00000400:00000010:9.0:1773851861.663611:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f03fb0b.
00000100:00000200:9.0:1773851861.663612:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030955993664, offset 224
00000400:00000200:9.0:1773851861.663613:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8955@kfi7
00000400:00000200:9.0:1773851861.663614:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8955@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.663615:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061d53476 nid 8955@kfi7 refs 1
00000400:00000200:9.0:1773851861.663616:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000061d53476 nid 8955@kfi7 refs 2
00000400:00000200:9.0:1773851861.663617:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000061d53476 nid 8955@kfi7 refs 3
00000400:00000200:9.0:1773851861.663618:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8955@kfi7 local destination
00000400:00000200:9.0:1773851861.663619:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768995:8768995:1024:4294967295] 8955@kfi7 LPNI seq info [24438:24438:16:4294967295]
00000400:00000200:9.0:1773851861.663620:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000061d53476 nid 8955@kfi7 refs 2
00000400:00000200:9.0:1773851861.663621:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8955@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.663623:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8955@kfi7(8955@kfi7:8955@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.663624:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000061d53476 nid 8955@kfi7 refs 3
00000800:00000200:9.0:1773851861.663625:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.663626:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.663628:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.663630:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000053c Using peer 8955@kfi7(0x10000000000053c)
00000800:00000200:9.0:1773851861.663633:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x10000000000053c: rc=0
00000800:00000200:9.0:1773851861.663634:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000053c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.663637:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.663638:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000adaffc62 refcount 4 to 8954@kfi7
00010000:00000001:9.0:1773851861.663639:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.663639:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.663640:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.663641:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad4aa7c8 x1858030955993664/t0(0) o400->e49f533b-0861-466a-95c3-1e9c3972e343@8954@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne203-0'
00000100:00100000:9.0:1773851861.663644:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4aa7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:e49f533b-0861-466a-95c3-1e9c3972e343+6:51537:x1858030955993664:12345-8954@kfi7:400:default-tuolumne203-0 Request processed in 59us (95us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851861.663647:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8954@kfi7, seq: 2130759
00000100:00000040:9.0:1773851861.663648:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000334feb08 : new rpc_count 0
00000100:00000001:9.0:1773851861.663648:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:10.0:1773851861.663649:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000053c TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851861.663649:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851861.663650:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.663650:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000020:00000010:9.0:1773851861.663651:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851861.663652:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:9.0:1773851861.663652:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000334feb08 : new refcount 5
00000100:00000001:9.0:1773851861.663653:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851861.663654:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8955@kfi7: PUT: OK
00000400:00000200:10.0:1773851861.663655:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f03fb0b
00000400:00000010:10.0:1773851861.663656:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f03fb0b.
00000100:00000001:10.0:1773851861.663657:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851861.663658:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851861.663659:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000061d53476 nid 8955@kfi7 refs 2
00000800:00000200:10.0:1773851861.663662:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 8955@kfi7(000000000df874e6):0x0 lsk 1341 rsk 218 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000053c Transaction freed
00000800:00000200:29.0:1773851861.664080:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.664081:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.664083:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.664088:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.664091:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8954@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.664093:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8954@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.664095:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8954@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.664097:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac276d29 nid 8954@kfi7 refs 1
00000400:00000200:29.0:1773851861.664099:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8954@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.664100:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac276d29 nid 8954@kfi7 refs 2
00000400:00000200:29.0:1773851861.664102:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ac276d29 nid 8954@kfi7 refs 3
00000400:00000200:29.0:1773851861.664103:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8954@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.664105:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8954@kfi7 of length 224 into portal 12 MB=0x699de8b1d22c0
00000400:00000200:29.0:1773851861.664108:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8954@kfi7 of length 224/224 into md 0x77fe139dd [64] + 170376
00000800:00000200:29.0:1773851861.664111:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.664114:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.664116:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8954@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.664119:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.664119:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.664122:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002856329d.
00000100:00000040:29.0:1773851861.664123:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000002856329d x1858030955995840 msgsize 224
00000100:00100000:29.0:1773851861.664126:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-8954@kfi7 (source: 12345-8954@kfi7)
00000100:00000001:29.0:1773851861.664128:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851861.664129:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac276d29 nid 8954@kfi7 refs 2
00000100:00000001:31.0:1773851861.664131:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851861.664132:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851861.664132:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851861.664133:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851861.664134:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.664136:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851861.664137:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030955995840
00000020:00000001:31.0:1773851861.664138:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851861.664138:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91380
00000020:00000001:31.0:1773851861.664139:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851861.664144:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac2e85a4 refcount=6
00000020:00000001:31.0:1773851861.664145:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169303040 : -107127540248576 : ffff9e916d049000)
00000020:00000001:31.0:1773851861.664146:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169303040 : -107127540248576 : ffff9e916d049000)
00000100:00000001:31.0:1773851861.664147:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.664148:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851861.664149:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000546cd5ce.
00000020:00000010:31.0:1773851861.664150:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851861.664151:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851861.664152:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851861.664153:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851861.664153:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.664155:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851861.664155:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851861.664155:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.664157:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.664158:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.664158:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.664159:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.664159:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851861.664160:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8954@kfi7, seq: 2055497
00000100:00000040:31.0:1773851861.664161:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac2e85a4 : new rpc_count 1
00000100:00000001:28.0:1773851861.664161:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.664162:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105603203328 : -106968106348288 : ffff9eb68c04d100)
00000100:00000001:28.0:1773851861.664162:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.664163:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002856329d x1858030955995840/t0(0) o400->c683ee4c-08df-4e30-afa0-036cb9298962@8954@kfi7:649/0 lens 224/0 e 0 to 0 dl 1773852009 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne203-0'
00000100:00000001:31.0:1773851861.664166:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.664166:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851861.664167:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002856329d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:c683ee4c-08df-4e30-afa0-036cb9298962+6:51539:x1858030955995840:12345-8954@kfi7:400:default-tuolumne203-0
00000100:00000200:31.0:1773851861.664169:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030955995840
00000020:00000001:31.0:1773851861.664170:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851861.664170:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851861.664171:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.664172:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851861.664172:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851861.664173:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851861.664174:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030955995840, found 0 last_xid 1858030955995839
00000020:00000001:31.0:1773851861.664175:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851861.664176:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851861.664176:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851861.664177:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.664178:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851861.664178:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851861.664179:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851861.664180:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d78bc747.
02000000:00000001:31.0:1773851861.664181:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.664182:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.664183:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851861.664184:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767969, transno 0, xid 1858030955995840
00010000:00000001:31.0:1773851861.664184:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851861.664185:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002856329d x1858030955995840/t0(0) o400->c683ee4c-08df-4e30-afa0-036cb9298962@8954@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne203-0'
00010000:00000001:31.0:1773851861.664188:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851861.664189:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851861.664190:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851861.664191:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851861.664191:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000adaffc62 refcount 5 to 8954@kfi7
00000100:00000001:31.0:1773851861.664192:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231804448 : -107130477747168 : ffff9e90bdede420)
02000000:00000001:31.0:1773851861.664193:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851861.664193:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.664194:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851861.664195:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8954@kfi7
00000400:00000010:31.0:1773851861.664195:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa0db5be.
00000100:00000200:31.0:1773851861.664196:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030955995840, offset 224
00000400:00000200:31.0:1773851861.664197:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8954@kfi7
00000400:00000200:31.0:1773851861.664198:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8954@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.664199:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac276d29 nid 8954@kfi7 refs 1
00000400:00000200:31.0:1773851861.664200:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ac276d29 nid 8954@kfi7 refs 2
00000400:00000200:31.0:1773851861.664201:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ac276d29 nid 8954@kfi7 refs 3
00000400:00000200:31.0:1773851861.664203:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8954@kfi7 local destination
00000400:00000200:31.0:1773851861.664204:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768996:8768996:1024:4294967295] 8954@kfi7 LPNI seq info [24439:24439:16:4294967295]
00000400:00000200:31.0:1773851861.664205:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ac276d29 nid 8954@kfi7 refs 2
00000400:00000200:31.0:1773851861.664206:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8954@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.664208:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8954@kfi7(8954@kfi7:8954@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851861.664209:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ac276d29 nid 8954@kfi7 refs 3
00000800:00000200:31.0:1773851861.664210:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851861.664211:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851861.664214:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851861.664216:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x884 Using peer 8954@kfi7(0x884)
00000800:00000200:31.0:1773851861.664219:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x884: rc=0
00000800:00000200:31.0:1773851861.664220:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x884 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851861.664222:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.664223:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000adaffc62 refcount 4 to 8954@kfi7
00010000:00000001:31.0:1773851861.664224:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851861.664224:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.664225:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851861.664226:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002856329d x1858030955995840/t0(0) o400->c683ee4c-08df-4e30-afa0-036cb9298962@8954@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne203-0'
00000100:00100000:31.0:1773851861.664228:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002856329d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:c683ee4c-08df-4e30-afa0-036cb9298962+6:51539:x1858030955995840:12345-8954@kfi7:400:default-tuolumne203-0 Request processed in 62us (105us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851861.664231:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8954@kfi7, seq: 2055497
00000100:00000040:31.0:1773851861.664232:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac2e85a4 : new rpc_count 0
00000800:00000200:29.0:1773851861.664232:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x884 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851861.664233:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851861.664233:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851861.664234:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851861.664234:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851861.664235:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000020:00000010:31.0:1773851861.664235:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000546cd5ce.
00000400:00000200:29.0:1773851861.664235:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8954@kfi7: PUT: OK
00000020:00000040:31.0:1773851861.664236:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000ac2e85a4 : new refcount 5
00000400:00000200:29.0:1773851861.664236:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa0db5be
00000400:00000010:29.0:1773851861.664236:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa0db5be.
00000100:00000001:31.0:1773851861.664237:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851861.664237:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.664237:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.664238:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac276d29 nid 8954@kfi7 refs 2
00000800:00000200:29.0:1773851861.664240:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 8954@kfi7(000000009367f51c):0x0 lsk 2181 rsk 232 tsk 0 trmk 0 tmk 0 trr 7 tta 0x884 Transaction freed
00000800:00000200:9.0:1773851861.693322:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.693324:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.693326:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.693329:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.693332:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24865@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.693334:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24865@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.693336:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24865@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.693337:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aedeea98 nid 24865@kfi7 refs 1
00000400:00000200:9.0:1773851861.693339:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24865@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.693340:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aedeea98 nid 24865@kfi7 refs 2
00000400:00000200:9.0:1773851861.693341:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aedeea98 nid 24865@kfi7 refs 3
00000400:00000200:9.0:1773851861.693355:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24864@kfi7 to cpt 7
00000400:00000200:9.0:1773851861.693356:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24864@kfi7 of length 224 into portal 12 MB=0x69b4c3b618cc0
00000400:00000200:9.0:1773851861.693358:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24864@kfi7 of length 224/224 into md 0x78146ce49 [64] + 129936
00000800:00000200:9.0:1773851861.693361:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.693364:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.693366:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24865@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.693367:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.693368:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.693369:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e2d87661.
00000100:00000040:9.0:1773851861.693370:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e2d87661 x1859601576332480 msgsize 224
00000100:00100000:9.0:1773851861.693372:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24864@kfi7 (source: 12345-24865@kfi7)
00000100:00000001:9.0:1773851861.693374:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.693376:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aedeea98 nid 24865@kfi7 refs 2
00000800:00000200:9.0:1773851861.693378:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.693382:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851861.693383:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851861.693384:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.693384:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.693386:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.693387:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601576332480
00000020:00000001:9.0:1773851861.693388:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851861.693388:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7d023
00000020:00000001:9.0:1773851861.693389:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851861.693392:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000033f70467 refcount=5
00000020:00000001:9.0:1773851861.693393:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105525086208 : -106968184465408 : ffff9eb6875cd800)
00000020:00000001:9.0:1773851861.693394:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105525086208 : -106968184465408 : ffff9eb6875cd800)
00000100:00000001:9.0:1773851861.693396:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.693397:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851861.693398:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851861.693399:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.693401:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851861.693402:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851861.693403:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851861.693404:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.693405:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851861.693406:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851861.693407:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.693408:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851861.693410:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.693410:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.693411:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851861.693411:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.693412:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24864@kfi7, seq: 2130760
00000100:00000040:9.0:1773851861.693413:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000033f70467 : new rpc_count 1
00000100:00000001:11.0:1773851861.693414:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.693414:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922899328 : -107141786652288 : ffff9e8e1bddb180)
00000100:00000001:11.0:1773851861.693415:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.693416:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e2d87661 x1859601576332480/t0(0) o400->f045788a-55fc-4c00-8dfd-ce1703d82cb2@24864@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2047-0'
00000100:00000001:9.0:1773851861.693420:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.693421:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.693423:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2d87661 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f045788a-55fc-4c00-8dfd-ce1703d82cb2+5:39651:x1859601576332480:12345-24864@kfi7:400:default-tuolumne2047-0
00000100:00000200:9.0:1773851861.693425:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601576332480
00000020:00000001:9.0:1773851861.693426:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.693427:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.693427:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.693428:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.693429:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.693430:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.693431:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601576332480, found 0 last_xid 1859601576332479
00000020:00000001:9.0:1773851861.693433:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.693434:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.693435:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.693435:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.693436:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.693437:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.693438:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.693439:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000efa72d70.
02000000:00000001:9.0:1773851861.693443:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.693444:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.693445:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.693446:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046856918, transno 0, xid 1859601576332480
00010000:00000001:9.0:1773851861.693447:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.693449:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e2d87661 x1859601576332480/t0(0) o400->f045788a-55fc-4c00-8dfd-ce1703d82cb2@24864@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2047-0'
00010000:00000001:9.0:1773851861.693453:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.693453:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.693454:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.693456:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.693457:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000add9ce9b refcount 3 to 24864@kfi7
00000100:00000001:9.0:1773851861.693458:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066144 : -107155994485472 : ffff9e8acd035d20)
02000000:00000001:9.0:1773851861.693459:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.693460:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.693461:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.693462:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24865@kfi7
00000400:00000010:9.0:1773851861.693463:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001df4b781.
00000100:00000200:9.0:1773851861.693464:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601576332480, offset 224
00000400:00000200:9.0:1773851861.693467:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24865@kfi7
00000400:00000200:9.0:1773851861.693468:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24865@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.693469:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aedeea98 nid 24865@kfi7 refs 1
00000400:00000200:9.0:1773851861.693470:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aedeea98 nid 24865@kfi7 refs 2
00000400:00000200:9.0:1773851861.693472:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aedeea98 nid 24865@kfi7 refs 3
00000400:00000200:9.0:1773851861.693474:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24865@kfi7 local destination
00000400:00000200:9.0:1773851861.693476:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768997:8768997:1024:4294967295] 24865@kfi7 LPNI seq info [377346:377346:16:4294967295]
00000400:00000200:9.0:1773851861.693478:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aedeea98 nid 24865@kfi7 refs 2
00000400:00000200:9.0:1773851861.693479:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24865@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.693482:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24865@kfi7(24865@kfi7:24865@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.693484:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aedeea98 nid 24865@kfi7 refs 3
00000800:00000200:9.0:1773851861.693486:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.693488:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.693492:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.693495:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11d2 Using peer 24865@kfi7(0x11d2)
00000800:00000200:9.0:1773851861.693500:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x11d2: rc=0
00000800:00000200:9.0:1773851861.693502:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.693505:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.693506:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000add9ce9b refcount 2 to 24864@kfi7
00010000:00000001:9.0:1773851861.693508:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.693508:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.693509:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.693510:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e2d87661 x1859601576332480/t0(0) o400->f045788a-55fc-4c00-8dfd-ce1703d82cb2@24864@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2047-0'
00000800:00000200:10.0:1773851861.693515:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11d2 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851861.693515:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2d87661 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f045788a-55fc-4c00-8dfd-ce1703d82cb2+5:39651:x1859601576332480:12345-24864@kfi7:400:default-tuolumne2047-0 Request processed in 94us (144us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851861.693519:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24864@kfi7, seq: 2130760
00000400:00000200:10.0:1773851861.693520:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:9.0:1773851861.693520:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000033f70467 : new rpc_count 0
00000100:00000001:9.0:1773851861.693521:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851861.693522:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24865@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.693522:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851861.693523:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001df4b781
00000020:00000010:9.0:1773851861.693523:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000010:10.0:1773851861.693524:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001df4b781.
00000020:00000010:9.0:1773851861.693524:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000100:00000001:10.0:1773851861.693525:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:9.0:1773851861.693525:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000100:00000001:10.0:1773851861.693526:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851861.693527:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aedeea98 nid 24865@kfi7 refs 2
00000020:00000040:9.0:1773851861.693527:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000033f70467 : new refcount 4
00000100:00000001:9.0:1773851861.693528:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851861.693529:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 24865@kfi7(00000000a83d1a73):0x0 lsk 4563 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11d2 Transaction freed
00000800:00000200:1.0:1773851861.705358:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.705359:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.705360:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.705363:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.705365:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23715@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.705366:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23715@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.705367:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23715@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.705368:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be1b2b53 nid 23715@kfi7 refs 1
00000400:00000200:1.0:1773851861.705369:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23715@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.705369:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be1b2b53 nid 23715@kfi7 refs 2
00000400:00000200:1.0:1773851861.705370:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be1b2b53 nid 23715@kfi7 refs 3
00000400:00000200:1.0:1773851861.705371:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23714@kfi7 to cpt 5
00000400:00000200:1.0:1773851861.705372:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23714@kfi7 of length 224 into portal 12 MB=0x69b4b955a0700
00000400:00000200:1.0:1773851861.705373:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23714@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 23576
00000800:00000200:1.0:1773851861.705375:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.705377:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.705378:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23715@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.705379:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.705379:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.705380:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000275d3270.
00000100:00000040:1.0:1773851861.705381:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000275d3270 x1859598790821632 msgsize 224
00000100:00100000:1.0:1773851861.705382:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-23714@kfi7 (source: 12345-23715@kfi7)
00000100:00000001:1.0:1773851861.705383:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.705384:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be1b2b53 nid 23715@kfi7 refs 2
00000100:00000001:0.0:1773851861.705384:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.705385:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.705385:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851861.705386:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.705386:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.705386:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.705387:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598790821632
00000020:00000001:0.0:1773851861.705388:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.705388:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38943c49
00000020:00000001:0.0:1773851861.705389:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.705391:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000598511d5 refcount=5
00000020:00000001:0.0:1773851861.705391:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135696457728 : -106938013093888 : ffff9ebd8db77000)
00000020:00000001:0.0:1773851861.705392:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637135696457728 : -106938013093888 : ffff9ebd8db77000)
00000100:00000001:0.0:1773851861.705393:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.705393:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.705394:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c5bdc42.
00000020:00000010:0.0:1773851861.705395:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.705396:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.705397:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.705397:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.705398:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.705399:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.705402:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.705402:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.705403:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.705404:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.705405:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.705405:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.705406:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.705406:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23714@kfi7, seq: 1997536
00000100:00000001:1.0:1773851861.705407:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851861.705407:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.705407:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000598511d5 : new rpc_count 1
00000100:00000001:0.0:1773851861.705407:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856603136 : -106915852948480 : ffff9ec2b6906c00)
00000100:00000040:0.0:1773851861.705408:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000275d3270 x1859598790821632/t0(0) o400->f55e7f61-b6de-4df3-8cdf-198cc0ed4bc0@23714@kfi7:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1964-0'
00000100:00000001:0.0:1773851861.705411:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.705412:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.705413:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000275d3270 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f55e7f61-b6de-4df3-8cdf-198cc0ed4bc0+5:39573:x1859598790821632:12345-23714@kfi7:400:default-tuolumne1964-0
00000100:00000200:0.0:1773851861.705414:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598790821632
00000020:00000001:0.0:1773851861.705415:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.705415:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.705416:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.705417:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.705417:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.705418:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.705419:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598790821632, found 0 last_xid 1859598790821631
00000020:00000001:0.0:1773851861.705419:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.705420:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.705420:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.705421:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.705422:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.705422:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.705423:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.705423:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bc1a9614.
02000000:00000001:0.0:1773851861.705424:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.705425:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.705425:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.705426:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014225297, transno 0, xid 1859598790821632
00010000:00000001:0.0:1773851861.705427:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.705428:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000275d3270 x1859598790821632/t0(0) o400->f55e7f61-b6de-4df3-8cdf-198cc0ed4bc0@23714@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1964-0'
00010000:00000001:0.0:1773851861.705430:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.705431:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.705432:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.705433:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.705433:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009016a0ca refcount 3 to 23714@kfi7
00000100:00000001:0.0:1773851861.705434:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402093536 : -107139307458080 : ffff9e8eafa331e0)
02000000:00000001:0.0:1773851861.705435:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.705435:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.705436:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.705437:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23715@kfi7
00000400:00000010:0.0:1773851861.705438:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005abdc8a1.
00000100:00000200:0.0:1773851861.705438:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598790821632, offset 224
00000400:00000200:0.0:1773851861.705440:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23715@kfi7
00000400:00000200:0.0:1773851861.705441:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23715@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.705441:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be1b2b53 nid 23715@kfi7 refs 1
00000400:00000200:0.0:1773851861.705442:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be1b2b53 nid 23715@kfi7 refs 2
00000400:00000200:0.0:1773851861.705444:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be1b2b53 nid 23715@kfi7 refs 3
00000400:00000200:0.0:1773851861.705445:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23715@kfi7 local destination
00000400:00000200:0.0:1773851861.705446:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8768998:8768998:1024:4294967295] 23715@kfi7 LPNI seq info [920236:920236:16:4294967295]
00000400:00000200:0.0:1773851861.705447:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be1b2b53 nid 23715@kfi7 refs 2
00000400:00000200:0.0:1773851861.705448:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23715@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.705450:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23715@kfi7(23715@kfi7:23715@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.705451:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be1b2b53 nid 23715@kfi7 refs 3
00000800:00000200:0.0:1773851861.705452:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.705453:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.705456:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.705460:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f49 Using peer 23715@kfi7(0x100000000000f49)
00000800:00000200:0.0:1773851861.705463:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x100000000000f49: rc=0
00000800:00000200:0.0:1773851861.705464:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f49 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.705466:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.705467:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009016a0ca refcount 2 to 23714@kfi7
00010000:00000001:0.0:1773851861.705467:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.705468:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.705468:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.705469:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000275d3270 x1859598790821632/t0(0) o400->f55e7f61-b6de-4df3-8cdf-198cc0ed4bc0@23714@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1964-0'
00000100:00100000:0.0:1773851861.705473:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000275d3270 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f55e7f61-b6de-4df3-8cdf-198cc0ed4bc0+5:39573:x1859598790821632:12345-23714@kfi7:400:default-tuolumne1964-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.705476:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23714@kfi7, seq: 1997536
00000100:00000040:0.0:1773851861.705476:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000598511d5 : new rpc_count 0
00000100:00000001:0.0:1773851861.705477:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.705478:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.705478:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.705479:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.705480:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c5bdc42.
00000020:00000040:0.0:1773851861.705480:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000598511d5 : new refcount 4
00000100:00000001:0.0:1773851861.705481:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.705486:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f49 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.705488:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.705489:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23715@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.705490:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005abdc8a1
00000400:00000010:1.0:1773851861.705490:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005abdc8a1.
00000100:00000001:1.0:1773851861.705491:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.705492:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.705492:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be1b2b53 nid 23715@kfi7 refs 2
00000800:00000200:1.0:1773851861.705494:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 23715@kfi7(00000000fcf0e612):0x0 lsk 3914 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f49 Transaction freed
00000800:00000200:9.0:1773851861.706841:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.706842:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.706843:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.706846:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.706848:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16016@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.706849:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16016@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.706850:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16016@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.706851:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b44618 nid 16016@kfi7 refs 1
00000400:00000200:9.0:1773851861.706852:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16016@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.706852:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b44618 nid 16016@kfi7 refs 2
00000400:00000200:9.0:1773851861.706853:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2b44618 nid 16016@kfi7 refs 3
00000400:00000200:9.0:1773851861.706854:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16017@kfi7 to cpt 5
00000400:00000200:9.0:1773851861.706855:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16017@kfi7 of length 224 into portal 12 MB=0x69b4b5c33cc00
00000400:00000200:9.0:1773851861.706856:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16017@kfi7 of length 224/224 into md 0x78146ce49 [64] + 130160
00000800:00000200:9.0:1773851861.706857:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.706859:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.706860:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16016@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.706861:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.706861:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.706862:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000361c8698.
00000100:00000040:9.0:1773851861.706863:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000361c8698 x1859597832014848 msgsize 224
00000100:00100000:9.0:1773851861.706864:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-16017@kfi7 (source: 12345-16016@kfi7)
00000100:00000001:9.0:1773851861.706865:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.706866:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b44618 nid 16016@kfi7 refs 2
00000800:00000200:9.0:1773851861.706867:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.706869:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851861.706870:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851861.706870:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.706871:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.706872:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.706872:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597832014848
00000020:00000001:9.0:1773851861.706873:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851861.706873:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d816d7
00000020:00000001:9.0:1773851861.706874:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851861.706877:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000299200a0 refcount=7
00000020:00000001:9.0:1773851861.706877:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637101371633664 : -106972337917952 : ffff9eb58fcc3000)
00000020:00000001:9.0:1773851861.706878:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637101371633664 : -106972337917952 : ffff9eb58fcc3000)
00000100:00000001:9.0:1773851861.706879:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.706880:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851861.706881:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851861.706882:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.706883:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851861.706883:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851861.706884:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851861.706884:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.706885:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851861.706885:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851861.706886:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.706887:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851861.706888:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.706888:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851861.706888:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.706888:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.706889:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16017@kfi7, seq: 2130761
00000100:00000001:11.0:1773851861.706890:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851861.706890:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.706890:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000299200a0 : new rpc_count 1
00000100:00000001:9.0:1773851861.706890:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922892416 : -107141786659200 : ffff9e8e1bdd9680)
00000100:00000040:9.0:1773851861.706891:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000361c8698 x1859597832014848/t0(0) o400->5f09009d-7538-4d18-8de4-ca7a37ffb868@16017@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1490-0'
00000100:00000001:9.0:1773851861.706894:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.706894:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.706895:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000361c8698 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5f09009d-7538-4d18-8de4-ca7a37ffb868+7:39581:x1859597832014848:12345-16017@kfi7:400:default-tuolumne1490-0
00000100:00000200:9.0:1773851861.706897:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597832014848
00000020:00000001:9.0:1773851861.706897:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.706898:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.706898:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.706899:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.706899:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.706900:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.706901:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597832014848, found 0 last_xid 1859597832014847
00000020:00000001:9.0:1773851861.706902:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.706902:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.706903:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.706903:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.706904:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.706904:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.706905:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.706906:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ffd011ea.
02000000:00000001:9.0:1773851861.706906:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.706907:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.706908:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.706908:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044175389, transno 0, xid 1859597832014848
00010000:00000001:9.0:1773851861.706909:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.706910:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000361c8698 x1859597832014848/t0(0) o400->5f09009d-7538-4d18-8de4-ca7a37ffb868@16017@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1490-0'
00010000:00000001:9.0:1773851861.706912:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.706913:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.706913:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.706914:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.706915:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000041a48adf refcount 3 to 16017@kfi7
00000100:00000001:9.0:1773851861.706915:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025088 : -107156745526528 : ffff9e8aa03f6300)
02000000:00000001:9.0:1773851861.706916:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.706917:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.706917:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.706918:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16016@kfi7
00000400:00000010:9.0:1773851861.706919:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000488434fa.
00000100:00000200:9.0:1773851861.706920:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597832014848, offset 224
00000400:00000200:9.0:1773851861.706921:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16016@kfi7
00000400:00000200:9.0:1773851861.706922:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16016@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.706922:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b44618 nid 16016@kfi7 refs 1
00000400:00000200:9.0:1773851861.706923:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2b44618 nid 16016@kfi7 refs 2
00000400:00000200:9.0:1773851861.706924:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2b44618 nid 16016@kfi7 refs 3
00000400:00000200:9.0:1773851861.706925:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16016@kfi7 local destination
00000400:00000200:9.0:1773851861.706927:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8768999:8768999:1024:4294967295] 16016@kfi7 LPNI seq info [1672294:1672294:16:4294967295]
00000400:00000200:9.0:1773851861.706928:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2b44618 nid 16016@kfi7 refs 2
00000400:00000200:9.0:1773851861.706929:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16016@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.706931:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16016@kfi7(16016@kfi7:16016@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.706932:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2b44618 nid 16016@kfi7 refs 3
00000800:00000200:9.0:1773851861.706933:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.706934:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.706936:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.706938:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x122a Using peer 16016@kfi7(0x122a)
00000800:00000200:9.0:1773851861.706940:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x122a: rc=0
00000800:00000200:9.0:1773851861.706942:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x122a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.706944:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.706944:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000041a48adf refcount 2 to 16017@kfi7
00010000:00000001:9.0:1773851861.706945:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.706946:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.706946:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.706947:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000361c8698 x1859597832014848/t0(0) o400->5f09009d-7538-4d18-8de4-ca7a37ffb868@16017@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1490-0'
00000100:00100000:9.0:1773851861.706949:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000361c8698 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5f09009d-7538-4d18-8de4-ca7a37ffb868+7:39581:x1859597832014848:12345-16017@kfi7:400:default-tuolumne1490-0 Request processed in 55us (86us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851861.706952:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x122a TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851861.706952:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16017@kfi7, seq: 2130761
00000100:00000040:9.0:1773851861.706952:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000299200a0 : new rpc_count 0
00000400:00000200:10.0:1773851861.706953:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851861.706953:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851861.706954:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16016@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.706954:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851861.706954:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851861.706955:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000488434fa
00000400:00000010:10.0:1773851861.706955:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000488434fa.
00000020:00000010:9.0:1773851861.706955:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000100:00000001:10.0:1773851861.706956:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851861.706956:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:9.0:1773851861.706956:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851861.706957:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b44618 nid 16016@kfi7 refs 2
00000020:00000040:9.0:1773851861.706957:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000299200a0 : new refcount 6
00000100:00000001:9.0:1773851861.706958:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851861.706959:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 16016@kfi7(0000000064b17218):0x0 lsk 4651 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x122a Transaction freed
00000800:00000200:17.0:1773851861.720223:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.720223:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.720225:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.720227:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851861.720229:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16467@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.720231:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16467@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.720232:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16467@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.720233:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018e36094 nid 16467@kfi7 refs 1
00000400:00000200:17.0:1773851861.720234:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16467@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.720235:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018e36094 nid 16467@kfi7 refs 2
00000400:00000200:17.0:1773851861.720236:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018e36094 nid 16467@kfi7 refs 3
00000400:00000200:17.0:1773851861.720237:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16530@kfi7 to cpt 5
00000400:00000200:17.0:1773851861.720239:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16530@kfi7 of length 224 into portal 12 MB=0x699e0d3fdc500
00000400:00000200:17.0:1773851861.720240:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16530@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 2912
00000800:00000200:17.0:1773851861.720242:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851861.720243:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.720244:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16467@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.720245:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851861.720246:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851861.720247:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bbb543dc.
00000100:00000040:17.0:1773851861.720247:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bbb543dc x1858040768611584 msgsize 224
00000100:00100000:17.0:1773851861.720249:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16530@kfi7 (source: 12345-16467@kfi7)
00000100:00000001:17.0:1773851861.720250:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851861.720251:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018e36094 nid 16467@kfi7 refs 2
00000100:00000001:16.0:1773851861.720251:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851861.720252:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851861.720252:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851861.720252:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851861.720253:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851861.720254:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851861.720255:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040768611584
00000020:00000001:16.0:1773851861.720256:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851861.720256:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92092
00000020:00000001:16.0:1773851861.720257:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851861.720259:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000035733da4 refcount=168
00000020:00000001:16.0:1773851861.720260:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629490688 : -107123080060928 : ffff9e9276dda000)
00000020:00000001:16.0:1773851861.720261:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629490688 : -107123080060928 : ffff9e9276dda000)
00000100:00000001:16.0:1773851861.720262:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851861.720263:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851861.720263:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:16.0:1773851861.720264:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851861.720265:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002b7e6ec1.
00000100:00000001:16.0:1773851861.720266:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851861.720266:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851861.720267:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851861.720268:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851861.720268:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851861.720269:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851861.720270:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851861.720271:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851861.720271:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851861.720271:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851861.720271:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851861.720272:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16530@kfi7, seq: 2156295
00000100:00000040:19.0:1773851861.720273:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000035733da4 : new rpc_count 1
00000100:00000001:16.0:1773851861.720273:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851861.720274:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764336768 : -107095945214848 : ffff9e98c83a8480)
00000100:00000001:16.0:1773851861.720274:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851861.720275:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bbb543dc x1858040768611584/t0(0) o400->2ce99abf-a18e-4e1d-ad2c-e1528d3362b1@16530@kfi7:82/0 lens 224/0 e 0 to 0 dl 1773852197 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1526-0'
00000100:00000001:19.0:1773851861.720279:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851861.720279:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851861.720280:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbb543dc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2ce99abf-a18e-4e1d-ad2c-e1528d3362b1+168:39796:x1858040768611584:12345-16530@kfi7:400:default-tuolumne1526-0
00000100:00000200:19.0:1773851861.720282:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040768611584
00000020:00000001:19.0:1773851861.720282:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851861.720283:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851861.720284:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.720284:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851861.720285:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851861.720286:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851861.720286:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040768611584, found 0 last_xid 1858040768188159
00000020:00000001:19.0:1773851861.720287:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851861.720288:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851861.720288:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851861.720289:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.720289:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851861.720290:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851861.720290:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851861.720291:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002f678b40.
02000000:00000001:19.0:1773851861.720292:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851861.720293:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.720293:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851861.720294:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062517, transno 0, xid 1858040768611584
00010000:00000001:19.0:1773851861.720295:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851861.720296:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bbb543dc x1858040768611584/t0(0) o400->2ce99abf-a18e-4e1d-ad2c-e1528d3362b1@16530@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1526-0'
00010000:00000001:19.0:1773851861.720298:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851861.720299:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851861.720299:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=94 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851861.720301:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851861.720302:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002a132fe0 refcount 3 to 16530@kfi7
00000100:00000001:19.0:1773851861.720302:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449696 : -107146752101920 : ffff9e8cf3e6f1e0)
02000000:00000001:19.0:1773851861.720303:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851861.720304:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851861.720305:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851861.720305:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16467@kfi7
00000400:00000010:19.0:1773851861.720306:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000059017436.
00000100:00000200:19.0:1773851861.720307:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040768611584, offset 224
00000400:00000200:19.0:1773851861.720308:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16467@kfi7
00000400:00000200:19.0:1773851861.720309:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16467@kfi7 to cpt 4
00000400:00000200:19.0:1773851861.720310:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018e36094 nid 16467@kfi7 refs 1
00000400:00000200:19.0:1773851861.720311:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018e36094 nid 16467@kfi7 refs 2
00000400:00000200:19.0:1773851861.720312:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018e36094 nid 16467@kfi7 refs 3
00000400:00000200:19.0:1773851861.720313:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16467@kfi7 local destination
00000400:00000200:19.0:1773851861.720315:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769000:8769000:1024:4294967295] 16467@kfi7 LPNI seq info [2294215:2294215:16:4294967295]
00000400:00000200:19.0:1773851861.720316:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018e36094 nid 16467@kfi7 refs 2
00000400:00000200:19.0:1773851861.720317:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16467@kfi7 to cpt 4
00000400:00000200:19.0:1773851861.720319:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16467@kfi7(16467@kfi7:16467@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851861.720320:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018e36094 nid 16467@kfi7 refs 3
00000800:00000200:19.0:1773851861.720321:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851861.720322:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851861.720324:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851861.720327:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11d6 Using peer 16467@kfi7(0x11d6)
00000800:00000200:19.0:1773851861.720330:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x11d6: rc=0
00000800:00000200:19.0:1773851861.720332:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851861.720334:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851861.720335:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002a132fe0 refcount 2 to 16530@kfi7
00010000:00000001:19.0:1773851861.720335:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851861.720336:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.720337:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851861.720337:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bbb543dc x1858040768611584/t0(0) o400->2ce99abf-a18e-4e1d-ad2c-e1528d3362b1@16530@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1526-0'
00000100:00100000:19.0:1773851861.720340:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbb543dc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2ce99abf-a18e-4e1d-ad2c-e1528d3362b1+168:39796:x1858040768611584:12345-16530@kfi7:400:default-tuolumne1526-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851861.720343:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16530@kfi7, seq: 2156295
00000800:00000200:17.0:1773851861.720343:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11d6 TN_EVENT_TX_OK event status 0
00000100:00000040:19.0:1773851861.720344:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000035733da4 : new rpc_count 0
00000100:00000001:19.0:1773851861.720345:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851861.720345:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851861.720345:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851861.720346:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000400:00000200:17.0:1773851861.720346:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16467@kfi7: PUT: OK
00000400:00000200:17.0:1773851861.720346:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000059017436
00000020:00000010:19.0:1773851861.720347:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002b7e6ec1.
00000400:00000010:17.0:1773851861.720347:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000059017436.
00000100:00000001:17.0:1773851861.720347:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:19.0:1773851861.720348:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000100:00000001:17.0:1773851861.720348:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851861.720348:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018e36094 nid 16467@kfi7 refs 2
00000020:00000040:19.0:1773851861.720349:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000035733da4 : new refcount 167
00000100:00000001:19.0:1773851861.720349:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851861.720350:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16467@kfi7(00000000106e969d):0x0 lsk 4567 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11d6 Transaction freed
00000800:00000200:13.0:1773851861.723036:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.723037:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851861.723038:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.723040:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.723043:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12995@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.723044:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12995@kfi7 : PUT - for me
00000400:00000200:13.0:1773851861.723045:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12995@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.723046:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0d2d00 nid 12995@kfi7 refs 1
00000400:00000200:13.0:1773851861.723048:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12995@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.723048:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0d2d00 nid 12995@kfi7 refs 2
00000400:00000200:13.0:1773851861.723049:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b0d2d00 nid 12995@kfi7 refs 3
00000400:00000200:13.0:1773851861.723050:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12803@kfi7 to cpt 0
00000400:00000200:13.0:1773851861.723051:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12803@kfi7 of length 224 into portal 12 MB=0x69b0a6aca5a40
00000400:00000200:13.0:1773851861.723053:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12803@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 25096
00000800:00000200:13.0:1773851861.723055:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851861.723056:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.723057:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12995@kfi7: PUT: OK
00000100:00000001:13.0:1773851861.723058:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851861.723059:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851861.723060:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009b280808.
00000100:00000040:13.0:1773851861.723061:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009b280808 x1859318903888448 msgsize 224
00000100:00100000:13.0:1773851861.723062:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12803@kfi7 (source: 12345-12995@kfi7)
00000100:00000001:13.0:1773851861.723063:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.723065:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0d2d00 nid 12995@kfi7 refs 2
00000100:00000001:15.0:1773851861.723066:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851861.723066:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c12e940: 2054@kfi7:3 <- 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851861.723067:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851861.723068:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851861.723068:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851861.723070:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851861.723071:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318903888448
00000020:00000001:15.0:1773851861.723072:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851861.723073:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91842
00000020:00000001:15.0:1773851861.723074:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851861.723077:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000faa89df2 refcount=168
00000020:00000001:15.0:1773851861.723078:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241758720 : -107152467792896 : ffff9e8b9f386c00)
00000020:00000001:15.0:1773851861.723080:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241758720 : -107152467792896 : ffff9e8b9f386c00)
00000100:00000001:15.0:1773851861.723081:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851861.723083:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851861.723084:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ba835c49.
00000020:00000010:15.0:1773851861.723086:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851861.723087:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002bafee4d.
00000100:00000001:15.0:1773851861.723089:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851861.723089:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851861.723090:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.723092:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851861.723093:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851861.723093:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851861.723095:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851861.723097:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.723097:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851861.723097:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851861.723098:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851861.723098:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12803@kfi7, seq: 2289818
00000100:00000001:15.0:1773851861.723099:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.723099:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000faa89df2 : new rpc_count 1
00000100:00000001:15.0:1773851861.723100:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.723100:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637152534602752 : -106921174948864 : ffff9ec179592400)
00000100:00000040:13.0:1773851861.723101:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009b280808 x1859318903888448/t0(0) o400->09fb575b-ce24-48c9-9e85-9c4f23276d6b@12803@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1303-0'
00000100:00000001:13.0:1773851861.723104:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851861.723104:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851861.723105:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b280808 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:09fb575b-ce24-48c9-9e85-9c4f23276d6b+168:39563:x1859318903888448:12345-12803@kfi7:400:default-tuolumne1303-0
00000100:00000200:13.0:1773851861.723107:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318903888448
00000020:00000001:13.0:1773851861.723108:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851861.723108:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851861.723109:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.723110:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851861.723110:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851861.723111:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851861.723112:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318903888448, found 0 last_xid 1859318903464255
00000020:00000001:13.0:1773851861.723113:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851861.723113:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851861.723114:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851861.723114:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.723115:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851861.723116:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851861.723116:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851861.723117:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d688f55d.
02000000:00000001:13.0:1773851861.723118:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.723118:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.723119:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851861.723120:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264060823, transno 0, xid 1859318903888448
00010000:00000001:13.0:1773851861.723121:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851861.723122:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009b280808 x1859318903888448/t0(0) o400->09fb575b-ce24-48c9-9e85-9c4f23276d6b@12803@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1303-0'
00010000:00000001:13.0:1773851861.723124:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851861.723125:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851861.723126:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=94 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851861.723127:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851861.723127:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c7f9427 refcount 3 to 12803@kfi7
00000100:00000001:13.0:1773851861.723128:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958442368 : -107146751109248 : ffff9e8cf3f61780)
02000000:00000001:13.0:1773851861.723129:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851861.723129:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851861.723130:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851861.723131:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12995@kfi7
00000400:00000010:13.0:1773851861.723132:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001703e8ae.
00000100:00000200:13.0:1773851861.723132:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318903888448, offset 224
00000400:00000200:13.0:1773851861.723134:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12995@kfi7
00000400:00000200:13.0:1773851861.723134:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12995@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.723135:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0d2d00 nid 12995@kfi7 refs 1
00000400:00000200:13.0:1773851861.723137:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b0d2d00 nid 12995@kfi7 refs 2
00000400:00000200:13.0:1773851861.723138:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b0d2d00 nid 12995@kfi7 refs 3
00000400:00000200:13.0:1773851861.723139:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12995@kfi7 local destination
00000400:00000200:13.0:1773851861.723140:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769001:8769001:1024:4294967295] 12995@kfi7 LPNI seq info [9466792:9466792:16:4294967295]
00000400:00000200:13.0:1773851861.723141:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b0d2d00 nid 12995@kfi7 refs 2
00000400:00000200:13.0:1773851861.723142:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12995@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.723144:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12995@kfi7(12995@kfi7:12995@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851861.723146:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b0d2d00 nid 12995@kfi7 refs 3
00000800:00000200:13.0:1773851861.723147:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851861.723148:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851861.723150:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851861.723154:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fba Using peer 12995@kfi7(0x100000000000fba)
00000800:00000200:13.0:1773851861.723157:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000006c12e940: Posted send of 324 bytes to peer 0x100000000000fba: rc=0
00000800:00000200:13.0:1773851861.723159:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fba TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851861.723161:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851861.723162:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c7f9427 refcount 2 to 12803@kfi7
00010000:00000001:13.0:1773851861.723163:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851861.723163:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851861.723164:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851861.723164:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009b280808 x1859318903888448/t0(0) o400->09fb575b-ce24-48c9-9e85-9c4f23276d6b@12803@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1303-0'
00000100:00100000:13.0:1773851861.723168:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b280808 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:09fb575b-ce24-48c9-9e85-9c4f23276d6b+168:39563:x1859318903888448:12345-12803@kfi7:400:default-tuolumne1303-0 Request processed in 63us (106us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851861.723170:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12803@kfi7, seq: 2289818
00000100:00000040:13.0:1773851861.723171:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000faa89df2 : new rpc_count 0
00000100:00000001:13.0:1773851861.723172:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851861.723172:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851861.723173:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:13.0:1773851861.723174:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002bafee4d.
00000800:00000200:14.0:1773851861.723175:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fba TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851861.723175:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ba835c49.
00000020:00000040:13.0:1773851861.723175:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000faa89df2 : new refcount 167
00000100:00000001:13.0:1773851861.723176:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851861.723178:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851861.723180:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12995@kfi7: PUT: OK
00000400:00000200:14.0:1773851861.723181:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001703e8ae
00000400:00000010:14.0:1773851861.723183:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001703e8ae.
00000100:00000001:14.0:1773851861.723184:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851861.723185:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851861.723187:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0d2d00 nid 12995@kfi7 refs 2
00000800:00000200:14.0:1773851861.723189:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 12995@kfi7(00000000c21a26e8):0x0 lsk 4027 rsk 67 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fba Transaction freed
00000800:00000200:29.0:1773851861.756498:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.756499:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.756501:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.756505:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.756508:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26016@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.756510:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26016@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.756511:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26016@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.756513:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000877ec23a nid 26016@kfi7 refs 1
00000400:00000200:29.0:1773851861.756514:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26016@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.756516:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000877ec23a nid 26016@kfi7 refs 2
00000400:00000200:29.0:1773851861.756517:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000877ec23a nid 26016@kfi7 refs 3
00000400:00000200:29.0:1773851861.756519:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26017@kfi7 to cpt 2
00000400:00000200:29.0:1773851861.756521:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26017@kfi7 of length 224 into portal 12 MB=0x699e0a589b580
00000400:00000200:29.0:1773851861.756523:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26017@kfi7 of length 224/224 into md 0x77fe139dd [64] + 170600
00000800:00000200:29.0:1773851861.756526:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.756529:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.756531:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26016@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.756532:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.756533:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.756534:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004372f111.
00000100:00000040:29.0:1773851861.756536:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000004372f111 x1858039989253504 msgsize 224
00000100:00100000:29.0:1773851861.756538:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26017@kfi7 (source: 12345-26016@kfi7)
00000100:00000001:29.0:1773851861.756540:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851861.756541:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851861.756541:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000877ec23a nid 26016@kfi7 refs 2
02000000:00000001:31.0:1773851861.756542:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851861.756543:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851861.756543:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.756544:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851861.756544:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00100000:31.0:1773851861.756545:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039989253504
00000020:00000001:31.0:1773851861.756546:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851861.756546:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f64
00000020:00000001:31.0:1773851861.756547:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851861.756549:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000045cff170 refcount=6
00000020:00000001:31.0:1773851861.756550:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744932352 : -107128964619264 : ffff9e91181e6400)
00000020:00000001:31.0:1773851861.756551:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744932352 : -107128964619264 : ffff9e91181e6400)
00000100:00000001:31.0:1773851861.756552:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.756553:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851861.756553:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000546cd5ce.
00000020:00000010:31.0:1773851861.756554:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851861.756555:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851861.756556:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851861.756556:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851861.756557:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.756558:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851861.756558:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851861.756559:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.756560:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.756561:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851861.756562:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851861.756562:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851861.756563:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26017@kfi7, seq: 2055498
00000100:00000040:31.0:1773851861.756563:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000045cff170 : new rpc_count 1
00000100:00000001:28.0:1773851861.756563:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851861.756564:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105603184896 : -106968106366720 : ffff9eb68c048900)
00000100:00000001:28.0:1773851861.756564:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.756565:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004372f111 x1858039989253504/t0(0) o400->d5c9b638-fe97-4032-a414-9a4675845b0e@26017@kfi7:649/0 lens 224/0 e 0 to 0 dl 1773852009 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2112-0'
00000100:00000001:28.0:1773851861.756565:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.756568:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.756568:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851861.756569:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004372f111 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:d5c9b638-fe97-4032-a414-9a4675845b0e+6:39796:x1858039989253504:12345-26017@kfi7:400:default-tuolumne2112-0
00000100:00000200:31.0:1773851861.756571:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039989253504
00000020:00000001:31.0:1773851861.756571:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851861.756572:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851861.756573:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.756574:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851861.756574:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851861.756575:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851861.756576:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039989253504, found 0 last_xid 1858039989253503
00000020:00000001:31.0:1773851861.756576:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851861.756577:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851861.756578:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851861.756578:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.756579:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851861.756580:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851861.756580:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851861.756581:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006fc03af3.
02000000:00000001:31.0:1773851861.756582:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.756582:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.756583:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851861.756584:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182878651959, transno 0, xid 1858039989253504
00010000:00000001:31.0:1773851861.756584:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851861.756585:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004372f111 x1858039989253504/t0(0) o400->d5c9b638-fe97-4032-a414-9a4675845b0e@26017@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2112-0'
00010000:00000001:31.0:1773851861.756588:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851861.756588:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851861.756589:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851861.756590:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851861.756591:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000385905c3 refcount 3 to 26017@kfi7
00000100:00000001:31.0:1773851861.756591:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580832 : -107154806970784 : ffff9e8b13cb6660)
02000000:00000001:31.0:1773851861.756592:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851861.756593:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.756593:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851861.756594:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26016@kfi7
00000400:00000010:31.0:1773851861.756595:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e37bb3ee.
00000100:00000200:31.0:1773851861.756595:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039989253504, offset 224
00000400:00000200:31.0:1773851861.756597:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26016@kfi7
00000400:00000200:31.0:1773851861.756597:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26016@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.756598:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000877ec23a nid 26016@kfi7 refs 1
00000400:00000200:31.0:1773851861.756599:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000877ec23a nid 26016@kfi7 refs 2
00000400:00000200:31.0:1773851861.756601:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000877ec23a nid 26016@kfi7 refs 3
00000400:00000200:31.0:1773851861.756602:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26016@kfi7 local destination
00000400:00000200:31.0:1773851861.756603:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769002:8769002:1024:4294967295] 26016@kfi7 LPNI seq info [186638:186638:16:4294967295]
00000400:00000200:31.0:1773851861.756605:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000877ec23a nid 26016@kfi7 refs 2
00000400:00000200:31.0:1773851861.756606:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26016@kfi7 to cpt 7
00000400:00000200:31.0:1773851861.756608:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26016@kfi7(26016@kfi7:26016@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851861.756609:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000877ec23a nid 26016@kfi7 refs 3
00000800:00000200:31.0:1773851861.756610:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851861.756611:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851861.756613:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851861.756615:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10ca Using peer 26016@kfi7(0x10ca)
00000800:00000200:31.0:1773851861.756618:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x10ca: rc=0
00000800:00000200:31.0:1773851861.756619:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10ca TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851861.756621:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.756622:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000385905c3 refcount 2 to 26017@kfi7
00010000:00000001:31.0:1773851861.756623:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851861.756623:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.756624:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851861.756625:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004372f111 x1858039989253504/t0(0) o400->d5c9b638-fe97-4032-a414-9a4675845b0e@26017@kfi7:649/0 lens 224/224 e 0 to 0 dl 1773852009 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2112-0'
00000100:00100000:31.0:1773851861.756628:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004372f111 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:d5c9b638-fe97-4032-a414-9a4675845b0e+6:39796:x1858039989253504:12345-26017@kfi7:400:default-tuolumne2112-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851861.756630:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26017@kfi7, seq: 2055498
00000100:00000040:31.0:1773851861.756631:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000045cff170 : new rpc_count 0
00000100:00000001:31.0:1773851861.756631:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851861.756634:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851861.756634:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851861.756635:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000800:00000200:29.0:1773851861.756635:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10ca TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851861.756636:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000546cd5ce.
00000020:00000040:31.0:1773851861.756636:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000045cff170 : new refcount 5
00000100:00000001:31.0:1773851861.756637:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851861.756637:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.756639:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26016@kfi7: PUT: OK
00000400:00000200:29.0:1773851861.756640:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e37bb3ee
00000400:00000010:29.0:1773851861.756641:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e37bb3ee.
00000100:00000001:29.0:1773851861.756642:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.756643:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.756644:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000877ec23a nid 26016@kfi7 refs 2
00000800:00000200:29.0:1773851861.756647:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 26016@kfi7(00000000f88da98b):0x0 lsk 4299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10ca Transaction freed
00000800:00000200:17.0:1773851861.768144:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851861.768145:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851861.768147:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851861.768150:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851861.768154:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8626@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.768156:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8626@kfi7 : PUT - for me
00000400:00000200:17.0:1773851861.768157:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8626@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.768159:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a03b9040 nid 8626@kfi7 refs 1
00000400:00000200:17.0:1773851861.768160:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8626@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.768161:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a03b9040 nid 8626@kfi7 refs 2
00000400:00000200:17.0:1773851861.768163:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a03b9040 nid 8626@kfi7 refs 3
00000400:00000200:17.0:1773851861.768164:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8626@kfi7 to cpt 4
00000400:00000200:17.0:1773851861.768165:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8626@kfi7 of length 224 into portal 12 MB=0x69a9dbacd2f00
00000400:00000200:17.0:1773851861.768167:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8626@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 3136
00000800:00000200:17.0:1773851861.768170:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851861.768173:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.768174:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8626@kfi7: PUT: OK
00000100:00000001:17.0:1773851861.768175:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851861.768176:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851861.768177:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000576c05b6.
00000100:00000040:17.0:1773851861.768178:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000576c05b6 x1858852094816000 msgsize 224
00000100:00100000:17.0:1773851861.768180:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8626@kfi7 (source: 12345-8626@kfi7)
00000100:00000001:17.0:1773851861.768182:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851861.768183:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a03b9040 nid 8626@kfi7 refs 2
00000100:00000001:19.0:1773851861.768185:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851861.768185:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851861.768185:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851861.768186:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851861.768187:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851861.768188:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851861.768190:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858852094816000
00000020:00000001:19.0:1773851861.768191:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851861.768191:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d52
00000020:00000001:19.0:1773851861.768192:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851861.768195:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081b62708 refcount=8
00000020:00000001:19.0:1773851861.768196:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239486464 : -107152470065152 : ffff9e8b9f15c000)
00000020:00000001:19.0:1773851861.768198:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239486464 : -107152470065152 : ffff9e8b9f15c000)
00000100:00000001:19.0:1773851861.768199:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851861.768200:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851861.768201:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851861.768202:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851861.768203:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851861.768203:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851861.768204:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851861.768205:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851861.768206:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851861.768206:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851861.768207:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851861.768208:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851861.768209:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851861.768209:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851861.768210:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8626@kfi7, seq: 2156296
00000100:00000001:16.0:1773851861.768210:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:19.0:1773851861.768211:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081b62708 : new rpc_count 2
00000100:00000001:16.0:1773851861.768211:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851861.768212:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764355200 : -107095945196416 : ffff9e98c83acc80)
00000100:00000001:16.0:1773851861.768212:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851861.768213:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000576c05b6 x1858852094816000/t0(0) o400->8c66ca05-2d1d-4b3b-811b-2355d8f81d11@8626@kfi7:82/0 lens 224/0 e 0 to 0 dl 1773852197 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1018-0'
00000100:00000001:16.0:1773851861.768213:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851861.768216:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851861.768216:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851861.768217:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000576c05b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8c66ca05-2d1d-4b3b-811b-2355d8f81d11+8:39794:x1858852094816000:12345-8626@kfi7:400:default-tuolumne1018-0
00000100:00000200:19.0:1773851861.768219:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858852094816000
00000020:00000001:19.0:1773851861.768219:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851861.768220:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851861.768221:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.768222:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851861.768222:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851861.768223:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851861.768224:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858852094816000, found 0 last_xid 1858852094397055
00000020:00000001:19.0:1773851861.768225:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851861.768226:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851861.768226:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851861.768227:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.768228:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851861.768228:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851861.768229:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851861.768229:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d828c161.
02000000:00000001:19.0:1773851861.768230:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851861.768231:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.768232:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851861.768233:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183174381293, transno 0, xid 1858852094816000
00010000:00000001:19.0:1773851861.768234:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851861.768235:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000576c05b6 x1858852094816000/t0(0) o400->8c66ca05-2d1d-4b3b-811b-2355d8f81d11@8626@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1018-0'
00010000:00000001:19.0:1773851861.768237:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851861.768238:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851861.768239:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=94 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851861.768240:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851861.768241:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000086e1d6be refcount 3 to 8626@kfi7
00000100:00000001:19.0:1773851861.768242:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917805147264 : -107155904404352 : ffff9e8ad261e480)
02000000:00000001:19.0:1773851861.768243:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851861.768243:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851861.768244:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851861.768245:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8626@kfi7
00000400:00000010:19.0:1773851861.768246:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000001916757.
00000100:00000200:19.0:1773851861.768246:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858852094816000, offset 224
00000400:00000200:19.0:1773851861.768247:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8626@kfi7
00000400:00000200:19.0:1773851861.768248:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8626@kfi7 to cpt 4
00000400:00000200:19.0:1773851861.768249:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a03b9040 nid 8626@kfi7 refs 1
00000400:00000200:19.0:1773851861.768250:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a03b9040 nid 8626@kfi7 refs 2
00000400:00000200:19.0:1773851861.768251:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a03b9040 nid 8626@kfi7 refs 3
00000400:00000200:19.0:1773851861.768252:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8626@kfi7 local destination
00000400:00000200:19.0:1773851861.768253:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769003:8769003:1024:4294967295] 8626@kfi7 LPNI seq info [4607766:4607766:16:4294967295]
00000400:00000200:19.0:1773851861.768255:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a03b9040 nid 8626@kfi7 refs 2
00000400:00000200:19.0:1773851861.768255:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8626@kfi7 to cpt 4
00000400:00000200:19.0:1773851861.768257:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8626@kfi7(8626@kfi7:8626@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851861.768258:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a03b9040 nid 8626@kfi7 refs 3
00000800:00000200:19.0:1773851861.768259:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851861.768260:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851861.768262:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851861.768265:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2e2 Using peer 8626@kfi7(0x2e2)
00000800:00000200:19.0:1773851861.768268:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x2e2: rc=0
00000800:00000200:19.0:1773851861.768270:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851861.768272:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851861.768273:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000086e1d6be refcount 2 to 8626@kfi7
00010000:00000001:19.0:1773851861.768273:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851861.768274:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851861.768275:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851861.768275:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000576c05b6 x1858852094816000/t0(0) o400->8c66ca05-2d1d-4b3b-811b-2355d8f81d11@8626@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1018-0'
00000100:00100000:19.0:1773851861.768278:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000576c05b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8c66ca05-2d1d-4b3b-811b-2355d8f81d11+8:39794:x1858852094816000:12345-8626@kfi7:400:default-tuolumne1018-0 Request processed in 61us (99us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851861.768280:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8626@kfi7, seq: 2156296
00000100:00000040:19.0:1773851861.768281:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081b62708 : new rpc_count 1
00000100:00000001:19.0:1773851861.768281:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851861.768282:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851861.768282:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2e2 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851861.768283:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851861.768284:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000400:00000200:17.0:1773851861.768284:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851861.768284:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8626@kfi7: PUT: OK
00000020:00000010:19.0:1773851861.768285:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000020:00000040:19.0:1773851861.768285:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000081b62708 : new refcount 7
00000400:00000200:17.0:1773851861.768285:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000001916757
00000100:00000001:19.0:1773851861.768286:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:17.0:1773851861.768286:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000001916757.
00000100:00000001:17.0:1773851861.768286:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851861.768286:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851861.768287:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a03b9040 nid 8626@kfi7 refs 2
00000800:00000200:17.0:1773851861.768288:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 8626@kfi7(00000000b33c9497):0x0 lsk 739 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2e2 Transaction freed
00000800:00000200:6.0:1773851861.807220:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851861.807221:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851861.807222:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851861.807225:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851861.807227:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11523@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.807229:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11523@kfi7 : PUT - for me
00000400:00000200:6.0:1773851861.807230:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11523@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.807231:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007dc332dc nid 11523@kfi7 refs 1
00000400:00000200:6.0:1773851861.807232:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11523@kfi7 to cpt 1
00000400:00000200:6.0:1773851861.807233:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007dc332dc nid 11523@kfi7 refs 2
00000400:00000200:6.0:1773851861.807234:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007dc332dc nid 11523@kfi7 refs 3
00000400:00000200:6.0:1773851861.807235:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11715@kfi7 to cpt 3
00000400:00000200:6.0:1773851861.807236:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11715@kfi7 of length 224 into portal 12 MB=0x69b4bc847e340
00000400:00000200:6.0:1773851861.807238:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11715@kfi7 of length 224/224 into md 0x793926dc5 [64] + 129848
00000800:00000200:6.0:1773851861.807240:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851861.807242:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851861.807243:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11523@kfi7: PUT: OK
00000100:00000001:6.0:1773851861.807244:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851861.807245:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851861.807246:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003ff3b5a6.
00000100:00000040:6.0:1773851861.807247:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000003ff3b5a6 x1859599645270848 msgsize 224
00000100:00100000:6.0:1773851861.807248:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-11715@kfi7 (source: 12345-11523@kfi7)
00000100:00000001:6.0:1773851861.807250:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851861.807251:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007dc332dc nid 11523@kfi7 refs 2
00000100:00000001:5.0:1773851861.807252:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851861.807253:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:5.0:1773851861.807253:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851861.807254:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851861.807255:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851861.807256:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851861.807258:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599645270848
00000020:00000001:5.0:1773851861.807259:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851861.807260:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79a97
00000020:00000001:5.0:1773851861.807261:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851861.807263:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f011623 refcount=169
00000020:00000001:5.0:1773851861.807264:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636941370238976 : -107132339312640 : ffff9e904ef8a800)
00000020:00000001:5.0:1773851861.807266:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636941370238976 : -107132339312640 : ffff9e904ef8a800)
00000100:00000001:5.0:1773851861.807268:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851861.807269:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851861.807270:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005299f7bc.
00000020:00000010:5.0:1773851861.807272:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851861.807273:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006f259d27.
00000100:00000001:5.0:1773851861.807275:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851861.807276:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851861.807277:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851861.807278:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851861.807280:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851861.807281:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.807283:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851861.807285:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851861.807285:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851861.807285:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851861.807286:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11715@kfi7, seq: 2001893
00000100:00000001:5.0:1773851861.807286:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851861.807287:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f011623 : new rpc_count 1
00000100:00000001:7.0:1773851861.807288:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637012926984320 : -107060782567296 : ffff9ea0f815f080)
00000100:00000001:5.0:1773851861.807288:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851861.807289:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851861.807290:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003ff3b5a6 x1859599645270848/t0(0) o400->969de6db-b80f-4ff2-a7fa-86443a1728a3@11715@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1223-0'
00000100:00000001:7.0:1773851861.807294:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851861.807294:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851861.807295:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ff3b5a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:969de6db-b80f-4ff2-a7fa-86443a1728a3+169:39548:x1859599645270848:12345-11715@kfi7:400:default-tuolumne1223-0
00000100:00000200:7.0:1773851861.807297:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599645270848
00000020:00000001:7.0:1773851861.807298:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851861.807298:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851861.807299:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851861.807300:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851861.807301:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851861.807301:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851861.807302:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599645270848, found 0 last_xid 1859599644853759
00000020:00000001:7.0:1773851861.807303:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851861.807304:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851861.807304:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851861.807305:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851861.807306:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851861.807306:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851861.807307:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851861.807308:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000adb13680.
02000000:00000001:7.0:1773851861.807309:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851861.807310:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851861.807310:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851861.807311:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062676, transno 0, xid 1859599645270848
00010000:00000001:7.0:1773851861.807312:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851861.807313:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003ff3b5a6 x1859599645270848/t0(0) o400->969de6db-b80f-4ff2-a7fa-86443a1728a3@11715@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1223-0'
00010000:00000001:7.0:1773851861.807315:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851861.807316:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851861.807317:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=93 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851861.807318:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851861.807319:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ebe3f692 refcount 3 to 11715@kfi7
00000100:00000001:7.0:1773851861.807320:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487622080 : -107151221929536 : ffff9e8be97ac9c0)
02000000:00000001:7.0:1773851861.807321:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851861.807321:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851861.807322:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851861.807323:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11523@kfi7
00000400:00000010:7.0:1773851861.807324:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc26fd9e.
00000100:00000200:7.0:1773851861.807325:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599645270848, offset 224
00000400:00000200:7.0:1773851861.807326:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11523@kfi7
00000400:00000200:7.0:1773851861.807327:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11523@kfi7 to cpt 1
00000400:00000200:7.0:1773851861.807328:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007dc332dc nid 11523@kfi7 refs 1
00000400:00000200:7.0:1773851861.807329:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007dc332dc nid 11523@kfi7 refs 2
00000400:00000200:7.0:1773851861.807331:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007dc332dc nid 11523@kfi7 refs 3
00000400:00000200:7.0:1773851861.807332:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11523@kfi7 local destination
00000400:00000200:7.0:1773851861.807334:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769004:8769004:1024:4294967295] 11523@kfi7 LPNI seq info [4224940:4224940:16:4294967295]
00000400:00000200:7.0:1773851861.807336:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007dc332dc nid 11523@kfi7 refs 2
00000400:00000200:7.0:1773851861.807337:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11523@kfi7 to cpt 1
00000400:00000200:7.0:1773851861.807339:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11523@kfi7(11523@kfi7:11523@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851861.807341:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007dc332dc nid 11523@kfi7 refs 3
00000800:00000200:7.0:1773851861.807342:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851861.807343:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851861.807346:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851861.807348:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d4 Using peer 11523@kfi7(0x7d4)
00000800:00000200:7.0:1773851861.807352:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x7d4: rc=0
00000800:00000200:7.0:1773851861.807353:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851861.807356:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851861.807357:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ebe3f692 refcount 2 to 11715@kfi7
00010000:00000001:7.0:1773851861.807358:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851861.807358:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851861.807359:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851861.807360:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003ff3b5a6 x1859599645270848/t0(0) o400->969de6db-b80f-4ff2-a7fa-86443a1728a3@11715@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1223-0'
00000100:00100000:7.0:1773851861.807363:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ff3b5a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:969de6db-b80f-4ff2-a7fa-86443a1728a3+169:39548:x1859599645270848:12345-11715@kfi7:400:default-tuolumne1223-0 Request processed in 69us (115us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851861.807367:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11715@kfi7, seq: 2001893
00000100:00000040:7.0:1773851861.807367:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f011623 : new rpc_count 0
00000800:00000200:6.0:1773851861.807367:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d4 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851861.807368:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851861.807369:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851861.807369:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851861.807370:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:7.0:1773851861.807370:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006f259d27.
00000400:00000200:6.0:1773851861.807370:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11523@kfi7: PUT: OK
00000020:00000010:7.0:1773851861.807371:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005299f7bc.
00000400:00000200:6.0:1773851861.807371:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc26fd9e
00000020:00000040:7.0:1773851861.807372:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000004f011623 : new refcount 168
00000400:00000010:6.0:1773851861.807372:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc26fd9e.
00000100:00000001:7.0:1773851861.807373:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851861.807373:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851861.807373:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851861.807374:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007dc332dc nid 11523@kfi7 refs 2
00000800:00000200:6.0:1773851861.807376:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 11523@kfi7(00000000a683a843):0x0 lsk 2005 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d4 Transaction freed
00000004:00000001:29.0:1773851861.833734:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851861.833734:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:30.0:1773851861.833735:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851861.833735:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:8.0:1773851861.833735:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851861.833736:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851861.833736:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dbf510ca.
00000004:00000020:28.0:1773851861.833736:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:8.0:1773851861.833736:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:29.0:1773851861.833737:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
00000100:00000010:28.0:1773851861.833737:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061748571.
00000100:00000010:8.0:1773851861.833737:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000148d1fa7.
00000100:00000010:30.0:1773851861.833738:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004f53da15.
00000100:00000001:29.0:1773851861.833738:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:30.0:1773851861.833739:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
02000000:00000001:29.0:1773851861.833739:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:28.0:1773851861.833739:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000020:00000040:8.0:1773851861.833739:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000100:00000001:30.0:1773851861.833741:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851861.833741:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.833741:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851861.833742:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:28.0:1773851861.833742:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:28.0:1773851861.833742:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851861.833742:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851861.833743:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851861.833743:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
02000000:00000001:8.0:1773851861.833743:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:30.0:1773851861.833744:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006dbfd28d.
02000000:00000010:28.0:1773851861.833744:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b1be4c3e.
02000000:00000001:8.0:1773851861.833744:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851861.833745:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833746:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851861.833746:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851861.833746:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851861.833746:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:29.0:1773851861.833747:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.833747:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851861.833748:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:8.0:1773851861.833748:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833749:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851861.833749:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000dbf510ca] to pc [ptlrpcd_07_00+0]  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851861.833749:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851861.833749:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:30.0:1773851861.833751:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004f53da15] to pc [ptlrpcd_07_02+2]  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851861.833751:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000061748571] to pc [ptlrpcd_07_01+1]  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851861.833751:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851861.833753:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000148d1fa7] to pc [ptlrpcd_02_02+2]  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851861.833758:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851861.833759:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:29.0:1773851861.833759:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851861.833759:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851861.833760:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851861.833760:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:31.0:1773851861.833761:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:29.0:1773851861.833761:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006df664c6.
00080000:00000010:28.0:1773851861.833761:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d5f17566.
00080000:00000001:8.0:1773851861.833761:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:30.0:1773851861.833762:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000005e1a67ac.
00080000:00000001:29.0:1773851861.833762:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637123698729984 : -106950010821632 : ffff9ebac298a400)
00080000:00000001:28.0:1773851861.833762:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637132447355904 : -106941262195712 : ffff9ebccc0e1400)
00000100:00000001:9.0:1773851861.833762:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:30.0:1773851861.833763:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637158083485696 : -106915626065920 : ffff9ec2c4166000)
00000100:00000001:10.0:1773851861.833763:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851861.833763:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:8.0:1773851861.833763:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a4109f11.
00080000:00000001:29.0:1773851861.833764:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851861.833764:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:10.0:1773851861.833764:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.833764:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851861.833764:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637160280077312 : -106913429474304 : ffff9ec34703b400)
00080000:00000001:30.0:1773851861.833765:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851861.833765:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.833766:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:30.0:1773851861.833766:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851861.833766:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00000100:00000040:9.0:1773851861.833766:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851861.833766:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851861.833767:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851861.833767:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00080000:00000001:28.0:1773851861.833767:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.833768:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:29.0:1773851861.833768:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000253c1061.
00000004:00001000:28.0:1773851861.833768:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00080000:00000001:8.0:1773851861.833768:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.833769:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:30.0:1773851861.833769:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000fc7f4eb5.
00000004:00080000:29.0:1773851861.833769:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614136287044626ns, next at 614137287042873ns, rc = 0
00000004:00000010:28.0:1773851861.833769:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000706dd0eb.
00000004:00001000:8.0:1773851861.833769:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00000004:00080000:30.0:1773851861.833770:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614136287045468ns, next at 614137287043875ns, rc = 0
00000100:00100000:31.0:1773851861.833771:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbf510ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051925824:47@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851861.833771:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00080000:28.0:1773851861.833771:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614136287046269ns, next at 614137287044716ns, rc = 0
00000100:00000001:9.0:1773851861.833771:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851861.833771:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851861.833771:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008377153f.
00080000:00000001:29.0:1773851861.833772:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851861.833772:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:31.0:1773851861.833773:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:30.0:1773851861.833773:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00000001:29.0:1773851861.833773:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.833773:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:8.0:1773851861.833773:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614136287047772ns, next at 614137287045558ns, rc = 0
02000000:00000001:31.0:1773851861.833774:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:30.0:1773851861.833774:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851861.833774:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.833774:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851861.833774:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851861.833775:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851861.833775:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851861.833775:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.833775:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000148d1fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051926016:2084@kfi7:13:default-yuba2-0
02000000:00000001:31.0:1773851861.833776:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:8.0:1773851861.833776:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851861.833777:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851861.833777:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:8.0:1773851861.833777:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833778:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851861.833778:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851861.833778:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:9.0:1773851861.833778:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:31.0:1773851861.833779:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000594e0e9d.
00000100:00000001:30.0:1773851861.833779:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:9.0:1773851861.833779:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.833780:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833780:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:29.0:1773851861.833780:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851861.833780:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:30.0:1773851861.833781:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851861.833781:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851861.833782:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:28.0:1773851861.833782:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851861.833782:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d9f9a1c1.
00000400:00000010:31.0:1773851861.833783:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
02000000:00000001:9.0:1773851861.833783:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851861.833784:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000030edd6e9.
00000400:00000200:9.0:1773851861.833784:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:30.0:1773851861.833785:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851861.833785:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000010:9.0:1773851861.833785:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000100:00000200:31.0:1773851861.833786:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925824, portal 4
00000100:00000001:30.0:1773851861.833786:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851861.833786:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.833787:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:30.0:1773851861.833787:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851861.833787:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:9.0:1773851861.833787:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052ffe31c.
00000100:00000001:31.0:1773851861.833788:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637105603199872 : -106968106351744 : ffff9eb68c04c380)
02000000:00000001:30.0:1773851861.833789:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851861.833789:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851861.833789:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926016, portal 4
00000100:00000040:31.0:1773851861.833790:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:30.0:1773851861.833790:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004f53da15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051925952:2104@kfi7:13:default-yuba2-0
00000100:00100000:29.0:1773851861.833790:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061748571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051925888:9@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851861.833790:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851861.833790:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491252864 : -107117218298752 : ffff9e93d4410480)
00000100:00000001:30.0:1773851861.833792:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:29.0:1773851861.833792:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851861.833793:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851861.833793:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:9.0:1773851861.833793:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851861.833794:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851861.833794:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.833795:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:30.0:1773851861.833795:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851861.833795:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:31.0:1773851861.833796:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000400:00000010:31.0:1773851861.833797:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defe7a25.
02000000:00000010:30.0:1773851861.833797:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000edd2b3c3.
02000000:00000010:29.0:1773851861.833797:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000dfd73cf0.
00000100:00000001:9.0:1773851861.833797:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:31.0:1773851861.833798:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925824, offset 0
02000000:00000001:30.0:1773851861.833798:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851861.833798:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851861.833799:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000040:9.0:1773851861.833799:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000200:31.0:1773851861.833800:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000010:9.0:1773851861.833800:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000096f4c744.
00000400:00000010:30.0:1773851861.833801:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000200:29.0:1773851861.833801:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000200:9.0:1773851861.833801:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926016, offset 0
00000400:00000010:30.0:1773851861.833802:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000400:00000010:29.0:1773851861.833802:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000060a59eec.
00000400:00000200:31.0:1773851861.833803:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000010:29.0:1773851861.833803:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000004015b2d.
00000400:00000200:9.0:1773851861.833803:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:31.0:1773851861.833804:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000200:30.0:1773851861.833804:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925952, portal 4
00000400:00000200:9.0:1773851861.833804:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:30.0:1773851861.833805:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:29.0:1773851861.833805:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051925888, portal 4
00000400:00000200:31.0:1773851861.833806:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:30.0:1773851861.833806:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832814208 : -106933876737408 : ffff9ebe84433a80)
00000100:00000001:29.0:1773851861.833806:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:9.0:1773851861.833806:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000100:00000001:29.0:1773851861.833807:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324230144 : -106976385321472 : ffff9eb49e8db600)
00000400:00000200:31.0:1773851861.833808:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000040:30.0:1773851861.833808:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851861.833809:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851861.833809:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851861.833810:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000400:00000200:9.0:1773851861.833811:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000001:30.0:1773851861.833812:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851861.833812:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000200:31.0:1773851861.833813:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769004, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769001, p:4294967295, g:4294967295, h:1000]
00000100:00000040:30.0:1773851861.833813:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:30.0:1773851861.833814:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ea7638e8.
00000100:00000001:29.0:1773851861.833814:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:30.0:1773851861.833815:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925952, offset 0
00000100:00000040:29.0:1773851861.833815:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000200:9.0:1773851861.833815:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769004, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769001, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851861.833816:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000010:29.0:1773851861.833816:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000906c4b9a.
00000400:00000200:30.0:1773851861.833817:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:31.0:1773851861.833818:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000200:29.0:1773851861.833818:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051925888, offset 0
00000400:00000200:31.0:1773851861.833819:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000400:00000200:9.0:1773851861.833819:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851861.833820:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851861.833821:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769005:8769005:1024:4294967295] 47@kfi7 LPNI seq info [5403018:5403018:16:4294967295]
00000400:00000200:29.0:1773851861.833821:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000400:00000200:9.0:1773851861.833822:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:31.0:1773851861.833823:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:9.0:1773851861.833824:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769006:8769006:1024:4294967295] 2084@kfi7 LPNI seq info [5402743:5402743:16:4294967295]
00000400:00000200:31.0:1773851861.833825:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:30.0:1773851861.833826:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:9.0:1773851861.833826:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:30.0:1773851861.833828:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:9.0:1773851861.833828:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851861.833829:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851861.833830:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:31.0:1773851861.833832:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:30.0:1773851861.833832:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:9.0:1773851861.833832:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000800:00000200:31.0:1773851861.833834:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:30.0:1773851861.833834:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000400:00000200:9.0:1773851861.833835:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:31.0:1773851861.833836:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851861.833837:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769004, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769006, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851861.833837:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:31.0:1773851861.833840:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851861.833840:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:9.0:1773851861.833840:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851861.833842:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851861.833843:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000800:00000200:9.0:1773851861.833844:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851861.833845:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000400:00000200:30.0:1773851861.833845:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769007:8769007:1024:4294967295] 2104@kfi7 LPNI seq info [5403375:5403375:16:4294967295]
00000400:00000200:30.0:1773851861.833847:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:9.0:1773851861.833848:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Using peer 2084@kfi7(0x2000000000000ff)
00000400:00000200:30.0:1773851861.833849:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:31.0:1773851861.833850:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000400:00000200:29.0:1773851861.833850:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:29.0:1773851861.833852:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000800:00000200:31.0:1773851861.833853:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851861.833853:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851861.833853:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:9.0:1773851861.833853:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x2000000000000ff: rc=0
00000400:00000200:29.0:1773851861.833855:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:31.0:1773851861.833856:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851861.833856:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000800:00000200:9.0:1773851861.833856:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851861.833857:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851861.833857:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000100:00000001:31.0:1773851861.833858:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851861.833858:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:31.0:1773851861.833859:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.833859:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851861.833860:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851861.833860:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769007, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769006, p:4294967295, g:4294967295, h:1000]
00000100:00000001:9.0:1773851861.833860:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851861.833861:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.833861:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.833862:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851861.833862:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851861.833863:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:9.0:1773851861.833863:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.833864:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:30.0:1773851861.833864:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851861.833864:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851861.833865:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851861.833865:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851861.833866:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851861.833866:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000100:00000001:9.0:1773851861.833866:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851861.833867:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851861.833867:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769008:8769008:1023:4294967295] 9@kfi7 LPNI seq info [5403007:5403007:16:4294967295]
00000100:00000001:9.0:1773851861.833867:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851861.833868:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851861.833868:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Using peer 2104@kfi7(0x19d)
00000800:00000200:10.0:1773851861.833869:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851861.833869:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851861.833870:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:9.0:1773851861.833870:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.833871:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851861.833872:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851861.833872:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:10.0:1773851861.833872:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:30.0:1773851861.833874:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x19d: rc=0
00000400:00000200:10.0:1773851861.833874:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000400:00000200:31.0:1773851861.833875:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851861.833875:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000096f4c744
00000400:00000200:29.0:1773851861.833876:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000400:00000010:10.0:1773851861.833876:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000096f4c744.
00000400:00000200:31.0:1773851861.833877:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000800:00000200:30.0:1773851861.833877:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851861.833877:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851861.833878:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:31.0:1773851861.833879:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defe7a25
00000100:00000200:10.0:1773851861.833879:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851861.833880:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defe7a25.
00000100:00000001:30.0:1773851861.833880:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.833881:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851861.833881:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851861.833881:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000200:31.0:1773851861.833882:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851861.833882:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833883:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851861.833883:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:10.0:1773851861.833884:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851861.833885:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:10.0:1773851861.833885:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851861.833886:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851861.833886:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:31.0:1773851861.833887:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851861.833887:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000040:31.0:1773851861.833888:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851861.833888:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851861.833889:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851861.833890:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851861.833890:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833891:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851861.833891:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000100:00000001:10.0:1773851861.833891:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851861.833893:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851861.833893:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:31.0:1773851861.833894:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:31.0:1773851861.833895:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000800:00000200:30.0:1773851861.833896:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851861.833896:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x31e: rc=0
00000800:00000200:10.0:1773851861.833896:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Transaction freed
00000800:00000200:31.0:1773851861.833898:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000800:00000200:29.0:1773851861.833898:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851861.833899:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851861.833901:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.833901:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851861.833902:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ea7638e8
00000400:00000010:30.0:1773851861.833902:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ea7638e8.
00000100:00000001:29.0:1773851861.833902:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851861.833903:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833904:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851861.833904:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851861.833905:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851861.833905:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.833906:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00000001:29.0:1773851861.833907:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851861.833907:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:25.0:1773851861.833907:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:29.0:1773851861.833909:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851861.833909:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:25.0:1773851861.833909:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:29.0:1773851861.833910:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851861.833911:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851861.833912:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851861.833912:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851861.833913:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851861.833913:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851861.833915:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.833916:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851861.833917:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000100:00000001:30.0:1773851861.833917:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851861.833918:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000906c4b9a
00000100:00000001:30.0:1773851861.833918:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.833918:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2084@kfi7 : PUT - for me
00000400:00000010:31.0:1773851861.833919:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000906c4b9a.
00000800:00000200:21.0:1773851861.833919:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000001:31.0:1773851861.833920:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:30.0:1773851861.833920:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:25.0:1773851861.833920:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000200:31.0:1773851861.833921:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851861.833921:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000800:00000200:21.0:1773851861.833921:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851861.833922:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Transaction freed
00000400:00000200:25.0:1773851861.833923:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:21.0:1773851861.833923:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851861.833925:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:25.0:1773851861.833925:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000040:31.0:1773851861.833926:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851861.833927:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:21.0:1773851861.833927:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.833929:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.833930:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2e00
00000400:00000200:21.0:1773851861.833930:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851861.833932:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851861.833932:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000400:00000200:21.0:1773851861.833934:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851861.833935:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b81ef9 [1] + 224
00000400:00000200:21.0:1773851861.833935:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000800:00000200:13.0:1773851861.833936:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:31.0:1773851861.833937:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851861.833937:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:31.0:1773851861.833938:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:25.0:1773851861.833938:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851861.833938:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851861.833939:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:31.0:1773851861.833940:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:21.0:1773851861.833940:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000800:00000200:13.0:1773851861.833940:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851861.833941:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851861.833941:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:31.0:1773851861.833943:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000400:00000200:25.0:1773851861.833943:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000400:00000200:21.0:1773851861.833943:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2d40
00000800:00000200:13.0:1773851861.833944:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:25.0:1773851861.833945:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851861.833945:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000200:25.0:1773851861.833947:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851861.833947:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:21.0:1773851861.833948:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d0995 [1] + 224
00000400:00000200:13.0:1773851861.833950:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2104@kfi7 : PUT - for me
00000800:00000200:21.0:1773851861.833951:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:25.0:1773851861.833952:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851861.833952:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851861.833953:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:13.0:1773851861.833956:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:21.0:1773851861.833957:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851861.833957:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:25.0:1773851861.833958:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.833958:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:25.0:1773851861.833959:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:21.0:1773851861.833959:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000400:00000200:13.0:1773851861.833960:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:25.0:1773851861.833961:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:21.0:1773851861.833961:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851861.833961:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851861.833961:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:13.0:1773851861.833962:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2dc0
00000100:00000200:21.0:1773851861.833963:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:9.0:1773851861.833963:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:5.0:1773851861.833963:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:13.0:1773851861.833964:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000001:9.0:1773851861.833964:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:5.0:1773851861.833964:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000010:9.0:1773851861.833965:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000400:00000200:9.0:1773851861.833966:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052ffe31c
00000400:00000200:13.0:1773851861.833967:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f5dcd [1] + 224
00000400:00000010:9.0:1773851861.833967:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052ffe31c.
00000800:00000200:5.0:1773851861.833967:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851861.833968:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:21.0:1773851861.833969:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851861.833970:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:9.0:1773851861.833970:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851861.833971:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851861.833973:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851861.833974:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:21.0:1773851861.833975:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851861.833975:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000100:00000200:9.0:1773851861.833975:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851861.833976:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000400:00000200:21.0:1773851861.833977:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:13.0:1773851861.833977:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851861.833978:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:31.0:1773851861.833979:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851861.833979:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851861.833979:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:13.0:1773851861.833979:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851861.833979:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851861.833980:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851861.833980:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000001:31.0:1773851861.833981:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:9.0:1773851861.833981:0:41070:0:(client.c:1428:after_reply()) Process entered
00000400:00000001:31.0:1773851861.833982:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:9.0:1773851861.833982:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:5.0:1773851861.833982:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:31.0:1773851861.833983:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000100:00000001:9.0:1773851861.833983:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:5.0:1773851861.833983:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:31.0:1773851861.833984:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000030edd6e9
00000100:00000040:13.0:1773851861.833984:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851861.833984:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851861.833984:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000010:31.0:1773851861.833985:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000030edd6e9.
02000000:00000001:9.0:1773851861.833985:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.833986:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851861.833986:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000200:31.0:1773851861.833987:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:9.0:1773851861.833987:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=94 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851861.833987:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2d80
00000100:00001000:9.0:1773851861.833988:0:41070:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=94 v=66 (1 1 1 1)
00000400:00000200:5.0:1773851861.833989:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:13.0:1773851861.833990:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851861.833990:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851861.833991:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851861.833992:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851861.833992:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00010000:00000001:9.0:1773851861.833992:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:5.0:1773851861.833992:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b30885 [1] + 224
00010000:00000001:9.0:1773851861.833993:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.833994:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851861.833994:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:13.0:1773851861.833995:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.833995:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000800:00000200:5.0:1773851861.833995:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851861.833996:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:30.0:1773851861.833996:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851861.833996:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:9.0:1773851861.833996:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000100:00000001:31.0:1773851861.833997:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.833997:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851861.833997:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.833998:0:41088:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:30.0:1773851861.833998:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851861.833998:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000200:5.0:1773851861.833998:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:31.0:1773851861.833999:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851861.833999:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:30.0:1773851861.833999:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000040:9.0:1773851861.833999:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851861.834000:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.834000:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851861.834000:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
02000000:00000001:31.0:1773851861.834001:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851861.834002:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851861.834002:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:31.0:1773851861.834003:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=94 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851861.834003:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:5.0:1773851861.834003:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851861.834005:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.834005:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851861.834006:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851861.834006:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.834007:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851861.834007:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:9.0:1773851861.834008:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00010000:00000001:31.0:1773851861.834009:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000040:9.0:1773851861.834009:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000100:00000040:5.0:1773851861.834009:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:31.0:1773851861.834010:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.834010:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:9.0:1773851861.834010:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593720832 avail=351576860672 avail_mb=1373347112 hwm_mb=3131103 files=372190095 ffree=343353243 state=0: rc = 0
00000100:00000001:31.0:1773851861.834011:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851861.834011:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851861.834012:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00000001:30.0:1773851861.834012:0:41090:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851861.834013:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851861.834013:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851861.834013:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851861.834013:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000020:9.0:1773851861.834013:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593720832 free, 351576860672 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190095 files, 343353243 free files
00000100:00000001:30.0:1773851861.834014:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851861.834015:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:30.0:1773851861.834015:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851861.834016:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851861.834017:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=94 v=66 (66 66 66 66)
00000100:00000040:9.0:1773851861.834018:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:30.0:1773851861.834019:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=94 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851861.834020:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851861.834020:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851861.834020:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851861.834021:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851861.834021:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851861.834021:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:31.0:1773851861.834022:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:30.0:1773851861.834022:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851861.834022:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000004:00000001:31.0:1773851861.834023:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:30.0:1773851861.834023:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:29.0:1773851861.834023:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:9.0:1773851861.834023:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000148d1fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051926016:2084@kfi7:13:default-yuba2-0
00000004:00000040:31.0:1773851861.834024:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000100:00000040:30.0:1773851861.834024:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000001:29.0:1773851861.834024:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851861.834024:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000004:00000040:31.0:1773851861.834025:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603978240 avail=351601716224 avail_mb=1373444204 hwm_mb=3131103 files=372190526 ffree=343363260 state=0: rc = 0
00000100:00000001:30.0:1773851861.834025:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851861.834025:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:29.0:1773851861.834025:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:9.0:1773851861.834025:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:29.0:1773851861.834026:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:9.0:1773851861.834026:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851861.834027:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:29.0:1773851861.834027:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000060a59eec.
00000004:00000020:31.0:1773851861.834028:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603978240 free, 351601716224 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190526 files, 343363260 free files
00000400:00000200:29.0:1773851861.834028:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000004015b2d
00000100:00000040:9.0:1773851861.834028:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000148d1fa7 x1859433051926016/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:29.0:1773851861.834029:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000004015b2d.
00000100:00000001:29.0:1773851861.834030:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:31.0:1773851861.834031:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.834031:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:31.0:1773851861.834032:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851861.834032:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000200:29.0:1773851861.834032:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851861.834032:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851861.834033:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:9.0:1773851861.834033:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:30.0:1773851861.834034:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000010:9.0:1773851861.834034:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d9f9a1c1.
00000004:00000040:30.0:1773851861.834035:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851861.834036:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615864832 avail=351613251584 avail_mb=1373489264 hwm_mb=3131103 files=372043488 ffree=343374868 state=0: rc = 0
00000100:00000200:29.0:1773851861.834036:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851861.834036:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00100000:31.0:1773851861.834037:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbf510ca pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051925824:47@kfi7:13:default-yuba2-0
00000020:00000001:9.0:1773851861.834037:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851861.834037:0:41070:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000020:00000001:9.0:1773851861.834038:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:31.0:1773851861.834039:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:30.0:1773851861.834039:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615864832 free, 351613251584 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043488 files, 343374868 free files
02000000:00000010:9.0:1773851861.834039:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:31.0:1773851861.834040:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:30.0:1773851861.834041:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851861.834041:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851861.834041:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:9.0:1773851861.834041:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:31.0:1773851861.834042:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000dbf510ca x1859433051925824/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851861.834042:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851861.834042:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851861.834042:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851861.834042:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000148d1fa7.
02000000:00000001:29.0:1773851861.834043:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851861.834044:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.834044:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851861.834044:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.834045:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:29.0:1773851861.834045:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.834045:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851861.834046:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:29.0:1773851861.834046:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851861.834047:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000594e0e9d.
00000100:00100000:30.0:1773851861.834047:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004f53da15 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051925952:2104@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851861.834047:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851861.834047:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851861.834048:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=94 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851861.834048:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:31.0:1773851861.834049:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851861.834049:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.834049:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851861.834050:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851861.834050:0:41088:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000100:00000001:30.0:1773851861.834050:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00001000:29.0:1773851861.834050:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=15 v=66 (1 1 1 1)
00000100:00000040:30.0:1773851861.834051:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004f53da15 x1859433051925952/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851861.834051:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000020:00000001:31.0:1773851861.834052:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851861.834052:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
00000100:00000001:29.0:1773851861.834052:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851861.834053:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:31.0:1773851861.834054:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851861.834054:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00010000:00000001:29.0:1773851861.834054:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:31.0:1773851861.834055:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dbf510ca.
00000100:00000001:29.0:1773851861.834055:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851861.834056:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000100:00000001:31.0:1773851861.834057:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851861.834057:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851861.834057:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851861.834057:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.834058:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851861.834059:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:29.0:1773851861.834059:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851861.834060:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:30.0:1773851861.834060:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851861.834060:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000edd2b3c3.
00000100:00000001:31.0:1773851861.834061:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.834062:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:30.0:1773851861.834062:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:31.0:1773851861.834063:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851861.834063:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851861.834063:0:41090:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000100:00000001:29.0:1773851861.834063:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:30.0:1773851861.834064:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:29.0:1773851861.834064:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000010:30.0:1773851861.834065:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006dbfd28d.
00000100:00000001:29.0:1773851861.834065:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851861.834066:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000001:29.0:1773851861.834066:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:30.0:1773851861.834067:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851861.834067:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004f53da15.
00000004:00000040:29.0:1773851861.834067:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000004:00000040:29.0:1773851861.834068:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480053760 avail=351478759424 avail_mb=1372963904 hwm_mb=3131101 files=372073195 ffree=343242240 state=0: rc = 0
00000100:00000001:30.0:1773851861.834069:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851861.834069:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851861.834070:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851861.834071:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000020:29.0:1773851861.834071:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480053760 free, 351478759424 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073195 files, 343242240 free files
00000100:00000001:30.0:1773851861.834072:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851861.834072:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851861.834073:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851861.834074:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851861.834075:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:29.0:1773851861.834080:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061748571 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051925888:9@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851861.834082:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851861.834083:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851861.834084:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000061748571 x1859433051925888/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852014 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851861.834088:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851861.834089:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851861.834090:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000dfd73cf0.
02000000:00000001:29.0:1773851861.834092:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851861.834092:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851861.834093:0:41089:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000020:00000001:29.0:1773851861.834094:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851861.834095:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b1be4c3e.
02000000:00000001:29.0:1773851861.834096:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851861.834097:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851861.834097:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061748571.
00000100:00000001:29.0:1773851861.834099:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851861.834099:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851861.834100:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851861.834102:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851861.834102:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851861.834103:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851861.834104:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851861.852663:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851861.852663:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851861.852665:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851861.852667:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851861.852669:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17104@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.852670:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17104@kfi7 : PUT - for me
00000400:00000200:29.0:1773851861.852671:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17104@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.852672:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6107991 nid 17104@kfi7 refs 1
00000400:00000200:29.0:1773851861.852673:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17104@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.852674:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6107991 nid 17104@kfi7 refs 2
00000400:00000200:29.0:1773851861.852674:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d6107991 nid 17104@kfi7 refs 3
00000400:00000200:29.0:1773851861.852675:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17104@kfi7 to cpt 7
00000400:00000200:29.0:1773851861.852676:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17104@kfi7 of length 224 into portal 12 MB=0x69b4b5c852140
00000400:00000200:29.0:1773851861.852678:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17104@kfi7 of length 224/224 into md 0x77fe139dd [64] + 170824
00000800:00000200:29.0:1773851861.852679:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851861.852681:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.852682:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17104@kfi7: PUT: OK
00000100:00000001:29.0:1773851861.852683:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851861.852684:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851861.852685:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dbf510ca.
00000100:00000040:29.0:1773851861.852685:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000dbf510ca x1859597837345088 msgsize 224
00000100:00100000:29.0:1773851861.852687:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17104@kfi7 (source: 12345-17104@kfi7)
00000100:00000001:29.0:1773851861.852688:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851861.852689:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d6107991 nid 17104@kfi7 refs 2
00000800:00000200:29.0:1773851861.852690:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851861.852691:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851861.852692:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851861.852692:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851861.852693:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851861.852694:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851861.852696:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597837345088
00000020:00000001:31.0:1773851861.852697:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851861.852697:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f631
00000020:00000001:31.0:1773851861.852698:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851861.852703:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000955a2824 refcount=166
00000020:00000001:31.0:1773851861.852704:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636975176054784 : -107098533496832 : ffff9e982df47800)
00000020:00000001:31.0:1773851861.852705:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636975176054784 : -107098533496832 : ffff9e982df47800)
00000100:00000001:31.0:1773851861.852707:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851861.852708:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851861.852709:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000546cd5ce.
00000020:00000010:31.0:1773851861.852711:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851861.852712:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851861.852714:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851861.852714:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851861.852715:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.852717:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851861.852718:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851861.852718:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851861.852720:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851861.852722:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.852722:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851861.852722:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851861.852723:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851861.852723:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17104@kfi7, seq: 2055499
00000100:00000040:28.0:1773851861.852724:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000955a2824 : new rpc_count 1
00000100:00000001:28.0:1773851861.852727:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105603199872 : -106968106351744 : ffff9eb68c04c380)
00000100:00000001:31.0:1773851861.852728:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.852728:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dbf510ca x1859597837345088/t0(0) o400->6ddf01e1-0880-4d34-b10a-b3847f0db02e@17104@kfi7:82/0 lens 224/0 e 0 to 0 dl 1773852197 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1553-0'
00000100:00000001:31.0:1773851861.852729:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.852731:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851861.852732:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851861.852733:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbf510ca pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:6ddf01e1-0880-4d34-b10a-b3847f0db02e+166:39535:x1859597837345088:12345-17104@kfi7:400:default-tuolumne1553-0
00000100:00000200:28.0:1773851861.852734:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597837345088
00000020:00000001:28.0:1773851861.852735:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851861.852735:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851861.852736:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.852737:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851861.852737:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851861.852738:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851861.852739:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597837345088, found 0 last_xid 1859597836920319
00000020:00000001:28.0:1773851861.852739:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851861.852740:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851861.852741:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851861.852741:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.852742:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851861.852743:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851861.852744:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851861.852744:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001375c5db.
02000000:00000001:28.0:1773851861.852745:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.852746:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.852746:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851861.852747:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062541, transno 0, xid 1859597837345088
00010000:00000001:28.0:1773851861.852748:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851861.852749:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dbf510ca x1859597837345088/t0(0) o400->6ddf01e1-0880-4d34-b10a-b3847f0db02e@17104@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1553-0'
00010000:00000001:28.0:1773851861.852751:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851861.852752:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851861.852752:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=94 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851861.852753:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851861.852754:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000060ca9dc refcount 3 to 17104@kfi7
00000100:00000001:28.0:1773851861.852755:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805792 : -107130477745824 : ffff9e90bdede960)
02000000:00000001:28.0:1773851861.852756:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851861.852756:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851861.852757:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851861.852757:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17104@kfi7
00000400:00000010:28.0:1773851861.852758:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088fd99e5.
00000100:00000200:28.0:1773851861.852759:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597837345088, offset 224
00000400:00000200:28.0:1773851861.852760:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17104@kfi7
00000400:00000200:28.0:1773851861.852761:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17104@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.852762:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d6107991 nid 17104@kfi7 refs 1
00000400:00000200:28.0:1773851861.852763:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d6107991 nid 17104@kfi7 refs 2
00000400:00000200:28.0:1773851861.852764:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d6107991 nid 17104@kfi7 refs 3
00000400:00000200:28.0:1773851861.852765:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17104@kfi7 local destination
00000400:00000200:28.0:1773851861.852767:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769009:8769009:1024:4294967295] 17104@kfi7 LPNI seq info [150856:150856:16:4294967295]
00000400:00000200:28.0:1773851861.852768:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d6107991 nid 17104@kfi7 refs 2
00000400:00000200:28.0:1773851861.852769:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17104@kfi7 to cpt 7
00000400:00000200:28.0:1773851861.852771:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17104@kfi7(17104@kfi7:17104@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851861.852772:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d6107991 nid 17104@kfi7 refs 3
00000800:00000200:28.0:1773851861.852774:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851861.852775:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851861.852777:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851861.852779:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000863 Using peer 17104@kfi7(0x100000000000863)
00000800:00000200:28.0:1773851861.852782:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x100000000000863: rc=0
00000800:00000200:28.0:1773851861.852784:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000863 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851861.852786:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851861.852786:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000060ca9dc refcount 2 to 17104@kfi7
00010000:00000001:28.0:1773851861.852787:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851861.852788:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851861.852788:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851861.852789:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dbf510ca x1859597837345088/t0(0) o400->6ddf01e1-0880-4d34-b10a-b3847f0db02e@17104@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1553-0'
00000100:00100000:28.0:1773851861.852794:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbf510ca pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:6ddf01e1-0880-4d34-b10a-b3847f0db02e+166:39535:x1859597837345088:12345-17104@kfi7:400:default-tuolumne1553-0 Request processed in 61us (107us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851861.852796:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17104@kfi7, seq: 2055499
00000100:00000040:28.0:1773851861.852797:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000955a2824 : new rpc_count 0
00000100:00000001:28.0:1773851861.852797:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851861.852798:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851861.852799:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:28.0:1773851861.852799:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000020:00000010:28.0:1773851861.852800:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000546cd5ce.
00000020:00000040:28.0:1773851861.852801:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000955a2824 : new refcount 165
00000100:00000001:28.0:1773851861.852802:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851861.852807:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000863 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851861.852808:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851861.852809:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17104@kfi7: PUT: OK
00000400:00000200:29.0:1773851861.852810:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088fd99e5
00000400:00000010:29.0:1773851861.852810:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088fd99e5.
00000100:00000001:29.0:1773851861.852811:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851861.852812:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851861.852812:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d6107991 nid 17104@kfi7 refs 2
00000800:00000200:29.0:1773851861.852814:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 17104@kfi7(00000000f11dcb16):0x0 lsk 2148 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000863 Transaction freed
00000800:00000200:25.0:1773851861.853762:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.853763:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.853764:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.853766:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.853768:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16834@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.853769:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16834@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.853770:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16834@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.853771:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033e4f07a nid 16834@kfi7 refs 1
00000400:00000200:25.0:1773851861.853771:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16834@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.853772:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033e4f07a nid 16834@kfi7 refs 2
00000400:00000200:25.0:1773851861.853774:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000033e4f07a nid 16834@kfi7 refs 3
00000400:00000200:25.0:1773851861.853775:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16834@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.853775:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16834@kfi7 of length 224 into portal 12 MB=0x69b82e19c6a80
00000400:00000200:25.0:1773851861.853777:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16834@kfi7 of length 224/224 into md 0x16159c6179 [64] + 193368
00000800:00000200:25.0:1773851861.853778:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851861.853780:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.853781:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16834@kfi7: PUT: OK
00000100:00000001:25.0:1773851861.853782:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851861.853782:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851861.853783:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b61f28b9.
00000100:00000040:25.0:1773851861.853784:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b61f28b9 x1859836293442176 msgsize 224
00000100:00100000:25.0:1773851861.853786:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16834@kfi7 (source: 12345-16834@kfi7)
00000100:00000001:25.0:1773851861.853787:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851861.853788:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000033e4f07a nid 16834@kfi7 refs 2
00000100:00000001:24.0:1773851861.853788:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851861.853789:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851861.853789:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851861.853789:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.853789:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.853790:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.853791:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836293442176
00000020:00000001:24.0:1773851861.853791:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.853792:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d96911
00000020:00000001:24.0:1773851861.853793:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.853795:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007e16f225 refcount=167
00000020:00000001:24.0:1773851861.853795:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637122132333568 : -106951577218048 : ffff9eba653b5400)
00000020:00000001:24.0:1773851861.853796:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637122132333568 : -106951577218048 : ffff9eba653b5400)
00000100:00000001:24.0:1773851861.853797:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.853798:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.853799:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8ced97a.
00000020:00000010:24.0:1773851861.853800:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.853801:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.853802:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.853802:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.853803:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.853803:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.853804:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.853804:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.853805:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.853806:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851861.853807:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851861.853807:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851861.853807:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851861.853808:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16834@kfi7, seq: 2025075
00000100:00000001:25.0:1773851861.853809:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851861.853809:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.853809:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007e16f225 : new rpc_count 1
00000100:00000001:24.0:1773851861.853809:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478770816 : -106938230780800 : ffff9ebd80bdcc80)
00000100:00000040:24.0:1773851861.853810:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b61f28b9 x1859836293442176/t0(0) o400->ea1235ca-f554-4171-a8be-27a13e37ec9c@16834@kfi7:78/0 lens 224/0 e 0 to 0 dl 1773852193 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1543-0'
00000100:00000001:24.0:1773851861.853813:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.853813:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.853814:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b61f28b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ea1235ca-f554-4171-a8be-27a13e37ec9c+167:39836:x1859836293442176:12345-16834@kfi7:400:default-tuolumne1543-0
00000100:00000200:24.0:1773851861.853815:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836293442176
00000020:00000001:24.0:1773851861.853816:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.853817:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.853817:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.853818:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.853818:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.853819:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.853820:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836293442176, found 0 last_xid 1859836293018815
00000020:00000001:24.0:1773851861.853820:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.853821:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.853821:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.853822:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.853823:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.853823:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.853824:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.853825:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000064d730de.
02000000:00000001:24.0:1773851861.853826:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.853826:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.853827:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.853828:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063371, transno 0, xid 1859836293442176
00010000:00000001:24.0:1773851861.853828:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.853829:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b61f28b9 x1859836293442176/t0(0) o400->ea1235ca-f554-4171-a8be-27a13e37ec9c@16834@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1543-0'
00010000:00000001:24.0:1773851861.853831:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.853832:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.853833:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.853834:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.853834:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3c00de7 refcount 3 to 16834@kfi7
00000100:00000001:24.0:1773851861.853835:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366318368 : -107142343233248 : ffff9e8dfab0f120)
02000000:00000001:24.0:1773851861.853836:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.853836:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.853837:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.853838:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16834@kfi7
00000400:00000010:24.0:1773851861.853838:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000473d3742.
00000100:00000200:24.0:1773851861.853839:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836293442176, offset 224
00000400:00000200:24.0:1773851861.853840:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16834@kfi7
00000400:00000200:24.0:1773851861.853841:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16834@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.853842:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033e4f07a nid 16834@kfi7 refs 1
00000400:00000200:24.0:1773851861.853843:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000033e4f07a nid 16834@kfi7 refs 2
00000400:00000200:24.0:1773851861.853844:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000033e4f07a nid 16834@kfi7 refs 3
00000400:00000200:24.0:1773851861.853845:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16834@kfi7 local destination
00000400:00000200:24.0:1773851861.853847:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769010:8769010:1024:4294967295] 16834@kfi7 LPNI seq info [333526:333526:16:4294967295]
00000400:00000200:24.0:1773851861.853848:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000033e4f07a nid 16834@kfi7 refs 2
00000400:00000200:24.0:1773851861.853849:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16834@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.853851:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16834@kfi7(16834@kfi7:16834@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.853852:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000033e4f07a nid 16834@kfi7 refs 3
00000800:00000200:24.0:1773851861.853853:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.853854:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.853857:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.853859:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000ea Using peer 16834@kfi7(0x1000000000000ea)
00000800:00000200:24.0:1773851861.853862:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000358ab717: Posted send of 324 bytes to peer 0x1000000000000ea: rc=0
00000800:00000200:24.0:1773851861.853863:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000ea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.853865:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.853866:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3c00de7 refcount 2 to 16834@kfi7
00010000:00000001:24.0:1773851861.853867:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.853867:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.853868:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.853869:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b61f28b9 x1859836293442176/t0(0) o400->ea1235ca-f554-4171-a8be-27a13e37ec9c@16834@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1543-0'
00000100:00100000:24.0:1773851861.853873:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b61f28b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ea1235ca-f554-4171-a8be-27a13e37ec9c+167:39836:x1859836293442176:12345-16834@kfi7:400:default-tuolumne1543-0 Request processed in 60us (88us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.853876:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16834@kfi7, seq: 2025075
00000100:00000040:24.0:1773851861.853876:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007e16f225 : new rpc_count 0
00000100:00000001:24.0:1773851861.853877:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.853878:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.853878:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.853879:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.853880:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8ced97a.
00000020:00000040:24.0:1773851861.853880:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000007e16f225 : new refcount 166
00000100:00000001:24.0:1773851861.853881:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.853886:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000ea TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851861.853888:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.853889:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16834@kfi7: PUT: OK
00000400:00000200:25.0:1773851861.853890:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000473d3742
00000400:00000010:25.0:1773851861.853890:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000473d3742.
00000100:00000001:25.0:1773851861.853891:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.853891:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.853892:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000033e4f07a nid 16834@kfi7 refs 2
00000800:00000200:25.0:1773851861.853893:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 16834@kfi7(0000000094fa58df):0x0 lsk 235 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000ea Transaction freed
00000800:00000200:1.0:1773851861.876984:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.876985:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.876988:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.876991:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.876995:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16738@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.876997:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16738@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.876998:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16738@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.877000:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076853391 nid 16738@kfi7 refs 1
00000400:00000200:1.0:1773851861.877001:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16738@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.877002:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076853391 nid 16738@kfi7 refs 2
00000400:00000200:1.0:1773851861.877004:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076853391 nid 16738@kfi7 refs 3
00000400:00000200:1.0:1773851861.877006:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16803@kfi7 to cpt 7
00000400:00000200:1.0:1773851861.877007:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16803@kfi7 of length 224 into portal 12 MB=0x69b4c83ef8100
00000400:00000200:1.0:1773851861.877009:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16803@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 23800
00000800:00000200:1.0:1773851861.877012:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.877015:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.877018:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16738@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.877020:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.877020:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.877022:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cab96bf5.
00000100:00000040:1.0:1773851861.877023:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000cab96bf5 x1859602793595136 msgsize 224
00000100:00100000:1.0:1773851861.877025:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-16803@kfi7 (source: 12345-16738@kfi7)
00000100:00000001:1.0:1773851861.877027:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.877028:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076853391 nid 16738@kfi7 refs 2
00000100:00000001:0.0:1773851861.877030:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.877030:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851861.877031:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.877031:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.877032:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.877033:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.877034:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602793595136
00000020:00000001:0.0:1773851861.877035:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.877036:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff82ddf
00000020:00000001:0.0:1773851861.877038:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.877041:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8bee6f9 refcount=5
00000020:00000001:0.0:1773851861.877042:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131138866176 : -106942570685440 : ffff9ebc7e101c00)
00000020:00000001:0.0:1773851861.877043:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131138866176 : -106942570685440 : ffff9ebc7e101c00)
00000100:00000001:0.0:1773851861.877045:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.877046:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.877047:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c5bdc42.
00000020:00000010:0.0:1773851861.877049:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.877050:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.877052:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.877052:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.877053:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.877055:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.877055:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.877056:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.877058:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.877059:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.877060:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.877060:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.877061:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.877062:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16803@kfi7, seq: 1997537
00000100:00000001:1.0:1773851861.877063:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.877063:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8bee6f9 : new rpc_count 1
00000100:00000001:1.0:1773851861.877064:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.877064:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856596224 : -106915852955392 : ffff9ec2b6905100)
00000100:00000040:0.0:1773851861.877066:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cab96bf5 x1859602793595136/t0(0) o400->f1ec393b-f01c-47c8-a930-4645ed0ab569@16803@kfi7:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1532-0'
00000100:00000001:0.0:1773851861.877071:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.877072:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.877073:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cab96bf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f1ec393b-f01c-47c8-a930-4645ed0ab569+5:39680:x1859602793595136:12345-16803@kfi7:400:default-tuolumne1532-0
00000100:00000200:0.0:1773851861.877076:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602793595136
00000020:00000001:0.0:1773851861.877077:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.877078:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.877078:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.877080:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.877080:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.877083:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.877083:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602793595136, found 0 last_xid 1859602793595135
00000020:00000001:0.0:1773851861.877085:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.877086:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.877087:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.877087:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.877089:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.877089:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.877090:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.877091:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b71b1f21.
02000000:00000001:0.0:1773851861.877092:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.877093:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.877094:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.877095:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105027320, transno 0, xid 1859602793595136
00010000:00000001:0.0:1773851861.877096:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.877098:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cab96bf5 x1859602793595136/t0(0) o400->f1ec393b-f01c-47c8-a930-4645ed0ab569@16803@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1532-0'
00010000:00000001:0.0:1773851861.877102:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.877103:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.877104:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.877105:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.877106:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ad34d53f refcount 3 to 16803@kfi7
00000100:00000001:0.0:1773851861.877108:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269856 : -107152618281760 : ffff9e8b964024e0)
02000000:00000001:0.0:1773851861.877109:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.877110:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.877111:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.877112:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16738@kfi7
00000400:00000010:0.0:1773851861.877113:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024fe8e76.
00000100:00000200:0.0:1773851861.877114:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602793595136, offset 224
00000400:00000200:0.0:1773851861.877117:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16738@kfi7
00000400:00000200:0.0:1773851861.877118:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16738@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.877119:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076853391 nid 16738@kfi7 refs 1
00000400:00000200:0.0:1773851861.877121:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076853391 nid 16738@kfi7 refs 2
00000400:00000200:0.0:1773851861.877122:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076853391 nid 16738@kfi7 refs 3
00000400:00000200:0.0:1773851861.877125:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16738@kfi7 local destination
00000400:00000200:0.0:1773851861.877127:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769011:8769011:1024:4294967295] 16738@kfi7 LPNI seq info [23162849:23162849:16:4294967295]
00000400:00000200:0.0:1773851861.877129:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076853391 nid 16738@kfi7 refs 2
00000400:00000200:0.0:1773851861.877131:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16738@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.877134:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16738@kfi7(16738@kfi7:16738@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.877136:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076853391 nid 16738@kfi7 refs 3
00000800:00000200:0.0:1773851861.877138:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.877140:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.877144:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.877147:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10ff Using peer 16738@kfi7(0x10ff)
00000800:00000200:0.0:1773851861.877152:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x10ff: rc=0
00000800:00000200:0.0:1773851861.877154:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.877158:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.877159:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ad34d53f refcount 2 to 16803@kfi7
00010000:00000001:0.0:1773851861.877162:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.877163:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.877164:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.877165:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cab96bf5 x1859602793595136/t0(0) o400->f1ec393b-f01c-47c8-a930-4645ed0ab569@16803@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1532-0'
00000100:00100000:0.0:1773851861.877170:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cab96bf5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f1ec393b-f01c-47c8-a930-4645ed0ab569+5:39680:x1859602793595136:12345-16803@kfi7:400:default-tuolumne1532-0 Request processed in 98us (146us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.877174:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16803@kfi7, seq: 1997537
00000100:00000040:0.0:1773851861.877175:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8bee6f9 : new rpc_count 0
00000100:00000001:0.0:1773851861.877177:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.877177:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.877179:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.877180:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.877182:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c5bdc42.
00000020:00000040:0.0:1773851861.877183:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000c8bee6f9 : new refcount 4
00000100:00000001:0.0:1773851861.877184:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.877192:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10ff TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.877195:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.877196:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16738@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.877198:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024fe8e76
00000400:00000010:1.0:1773851861.877199:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024fe8e76.
00000100:00000001:1.0:1773851861.877200:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.877200:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.877202:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076853391 nid 16738@kfi7 refs 2
00000800:00000200:1.0:1773851861.877205:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16738@kfi7(000000007988ab2d):0x0 lsk 4352 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10ff Transaction freed
00000800:00000200:1.0:1773851861.886752:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.886753:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.886755:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.886759:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.886762:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15091@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.886765:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15091@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.886766:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15091@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.886768:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1c2504e nid 15091@kfi7 refs 1
00000400:00000200:1.0:1773851861.886770:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15091@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.886772:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1c2504e nid 15091@kfi7 refs 2
00000400:00000200:1.0:1773851861.886773:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c1c2504e nid 15091@kfi7 refs 3
00000400:00000200:1.0:1773851861.886775:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14899@kfi7 to cpt 5
00000400:00000200:1.0:1773851861.886776:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14899@kfi7 of length 224 into portal 12 MB=0x69b4baca7ed00
00000400:00000200:1.0:1773851861.886778:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14899@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 24024
00000800:00000200:1.0:1773851861.886781:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.886784:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.886786:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15091@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.886787:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.886788:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.886789:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001fe47ee3.
00000100:00000040:1.0:1773851861.886790:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000001fe47ee3 x1859599181802752 msgsize 224
00000100:00100000:1.0:1773851861.886793:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14899@kfi7 (source: 12345-15091@kfi7)
00000100:00000001:1.0:1773851861.886794:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.886796:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1c2504e nid 15091@kfi7 refs 2
00000100:00000001:0.0:1773851861.886797:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851861.886798:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851861.886798:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.886799:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.886800:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.886801:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.886802:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599181802752
00000020:00000001:0.0:1773851861.886803:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.886804:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d809a2
00000020:00000001:0.0:1773851861.886805:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.886809:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004653eff8 refcount=166
00000020:00000001:0.0:1773851861.886810:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117170330624 : -106956539220992 : ffff9eb93d792c00)
00000020:00000001:0.0:1773851861.886811:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117170330624 : -106956539220992 : ffff9eb93d792c00)
00000100:00000001:0.0:1773851861.886813:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.886814:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.886815:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c5bdc42.
00000020:00000010:0.0:1773851861.886816:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.886818:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.886819:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.886820:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.886821:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.886822:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.886823:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.886823:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.886825:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.886827:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.886828:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.886828:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851861.886828:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.886829:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14899@kfi7, seq: 1997538
00000100:00000001:1.0:1773851861.886831:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.886831:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004653eff8 : new rpc_count 1
00000100:00000001:1.0:1773851861.886832:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.886832:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856582400 : -106915852969216 : ffff9ec2b6901b00)
00000100:00000040:0.0:1773851861.886833:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001fe47ee3 x1859599181802752/t0(0) o400->92663247-6017-41e1-b37a-a0ef78564c7e@14899@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1417-0'
00000100:00000001:0.0:1773851861.886839:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.886840:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.886841:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fe47ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:92663247-6017-41e1-b37a-a0ef78564c7e+166:39586:x1859599181802752:12345-14899@kfi7:400:default-tuolumne1417-0
00000100:00000200:0.0:1773851861.886843:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599181802752
00000020:00000001:0.0:1773851861.886844:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.886845:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.886845:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.886846:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.886847:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.886848:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.886849:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599181802752, found 0 last_xid 1859599181378879
00000020:00000001:0.0:1773851861.886850:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.886851:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.886851:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.886852:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.886853:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.886853:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.886854:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.886854:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000009e4fdc9.
02000000:00000001:0.0:1773851861.886855:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.886856:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.886856:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.886857:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063258, transno 0, xid 1859599181802752
00010000:00000001:0.0:1773851861.886858:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.886859:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001fe47ee3 x1859599181802752/t0(0) o400->92663247-6017-41e1-b37a-a0ef78564c7e@14899@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1417-0'
00010000:00000001:0.0:1773851861.886861:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.886862:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.886862:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.886863:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.886864:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009e1a5536 refcount 3 to 14899@kfi7
00000100:00000001:0.0:1773851861.886865:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452192 : -107146752099424 : ffff9e8cf3e6fba0)
02000000:00000001:0.0:1773851861.886866:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.886866:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.886867:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.886868:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15091@kfi7
00000400:00000010:0.0:1773851861.886869:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000485e1abd.
00000100:00000200:0.0:1773851861.886869:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599181802752, offset 224
00000400:00000200:0.0:1773851861.886871:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15091@kfi7
00000400:00000200:0.0:1773851861.886872:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15091@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.886873:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1c2504e nid 15091@kfi7 refs 1
00000400:00000200:0.0:1773851861.886874:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c1c2504e nid 15091@kfi7 refs 2
00000400:00000200:0.0:1773851861.886875:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c1c2504e nid 15091@kfi7 refs 3
00000400:00000200:0.0:1773851861.886876:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15091@kfi7 local destination
00000400:00000200:0.0:1773851861.886877:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769012:8769012:1024:4294967295] 15091@kfi7 LPNI seq info [5219414:5219414:16:4294967295]
00000400:00000200:0.0:1773851861.886879:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c1c2504e nid 15091@kfi7 refs 2
00000400:00000200:0.0:1773851861.886880:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15091@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.886882:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15091@kfi7(15091@kfi7:15091@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.886883:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c1c2504e nid 15091@kfi7 refs 3
00000800:00000200:0.0:1773851861.886885:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.886886:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.886888:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.886891:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb59 Using peer 15091@kfi7(0xb59)
00000800:00000200:0.0:1773851861.886894:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0xb59: rc=0
00000800:00000200:0.0:1773851861.886895:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb59 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.886897:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.886898:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009e1a5536 refcount 2 to 14899@kfi7
00010000:00000001:0.0:1773851861.886899:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.886899:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.886900:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.886901:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001fe47ee3 x1859599181802752/t0(0) o400->92663247-6017-41e1-b37a-a0ef78564c7e@14899@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1417-0'
00000100:00100000:0.0:1773851861.886906:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fe47ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:92663247-6017-41e1-b37a-a0ef78564c7e+166:39586:x1859599181802752:12345-14899@kfi7:400:default-tuolumne1417-0 Request processed in 66us (115us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.886909:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14899@kfi7, seq: 1997538
00000100:00000040:0.0:1773851861.886909:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004653eff8 : new rpc_count 0
00000100:00000001:0.0:1773851861.886910:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.886911:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.886911:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.886912:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.886913:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c5bdc42.
00000020:00000040:0.0:1773851861.886913:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004653eff8 : new refcount 165
00000100:00000001:0.0:1773851861.886914:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.886919:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb59 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.886920:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.886921:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15091@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.886922:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000485e1abd
00000400:00000010:1.0:1773851861.886922:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000485e1abd.
00000100:00000001:1.0:1773851861.886923:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.886923:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.886924:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1c2504e nid 15091@kfi7 refs 2
00000800:00000200:1.0:1773851861.886935:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 15091@kfi7(000000005879a9bc):0x0 lsk 2906 rsk 18 tsk 0 trmk 0 tmk 0 trr 0 tta 0xb59 Transaction freed
00000800:00000200:9.0:1773851861.891344:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.891346:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.891347:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.891349:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.891351:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891353:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10963@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.891354:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891354:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 1
00000400:00000200:9.0:1773851861.891355:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891356:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000400:00000200:9.0:1773851861.891357:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 3
00000400:00000200:9.0:1773851861.891358:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891359:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10963@kfi7 of length 224 into portal 12 MB=0x69b09625f4dc0
00000400:00000200:9.0:1773851861.891360:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10963@kfi7 of length 224/224 into md 0x78146ce49 [64] + 130384
00000800:00000200:9.0:1773851861.891362:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.891364:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.891365:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10963@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.891366:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.891366:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.891367:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e9cd4914.
00000100:00000040:9.0:1773851861.891368:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e9cd4914 x1859314467687872 msgsize 224
00000100:00100000:9.0:1773851861.891369:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10963@kfi7 (source: 12345-10963@kfi7)
00000100:00000001:9.0:1773851861.891371:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.891372:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000800:00000200:9.0:1773851861.891373:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.891376:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851861.891376:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851861.891377:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.891377:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.891378:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.891379:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314467687872
00000020:00000001:9.0:1773851861.891380:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851861.891380:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92913
00000020:00000001:9.0:1773851861.891381:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851861.891384:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c161c64 refcount=6
00000020:00000001:9.0:1773851861.891385:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742958080 : -107128966593536 : ffff9e9118004400)
00000020:00000001:9.0:1773851861.891386:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742958080 : -107128966593536 : ffff9e9118004400)
00000100:00000001:9.0:1773851861.891387:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.891388:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851861.891389:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851861.891390:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.891391:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851861.891392:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851861.891392:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851861.891393:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.891394:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851861.891395:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851861.891395:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891396:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851861.891398:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.891398:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851861.891398:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.891398:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.891399:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10963@kfi7, seq: 2130762
00000100:00000001:11.0:1773851861.891400:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.891400:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001c161c64 : new rpc_count 1
00000100:00000001:11.0:1773851861.891401:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891401:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922917760 : -107141786633856 : ffff9e8e1bddf980)
00000100:00000040:9.0:1773851861.891402:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e9cd4914 x1859314467687872/t0(0) o400->3888c8fa-e3a1-42ee-bbcc-17154c917465@10963@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1173-0'
00000100:00000001:9.0:1773851861.891405:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.891406:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.891407:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9cd4914 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3888c8fa-e3a1-42ee-bbcc-17154c917465+6:39730:x1859314467687872:12345-10963@kfi7:400:default-tuolumne1173-0
00000100:00000200:9.0:1773851861.891409:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314467687872
00000020:00000001:9.0:1773851861.891409:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.891411:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.891411:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891412:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.891413:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.891414:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.891414:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314467687872, found 0 last_xid 1859314467687871
00000020:00000001:9.0:1773851861.891415:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.891416:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.891417:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.891417:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891418:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.891419:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.891419:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.891420:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000817653bb.
02000000:00000001:9.0:1773851861.891421:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891422:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891423:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.891424:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314467687872
00010000:00000001:9.0:1773851861.891425:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.891426:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e9cd4914 x1859314467687872/t0(0) o400->3888c8fa-e3a1-42ee-bbcc-17154c917465@10963@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1173-0'
00010000:00000001:9.0:1773851861.891430:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.891431:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.891432:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.891434:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.891435:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003f6ded9c refcount 5 to 10963@kfi7
00000100:00000001:9.0:1773851861.891436:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899609888 : -107146809941728 : ffff9e8cf0746120)
02000000:00000001:9.0:1773851861.891438:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.891439:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891440:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.891442:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10963@kfi7
00000400:00000010:9.0:1773851861.891443:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052ffe31c.
00000100:00000200:9.0:1773851861.891444:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314467687872, offset 224
00000400:00000200:9.0:1773851861.891447:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10963@kfi7
00000400:00000200:9.0:1773851861.891448:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891450:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 1
00000400:00000200:9.0:1773851861.891452:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000400:00000200:9.0:1773851861.891454:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 3
00000400:00000200:9.0:1773851861.891456:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10963@kfi7 local destination
00000400:00000200:9.0:1773851861.891458:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769013:8769013:1024:4294967295] 10963@kfi7 LPNI seq info [287272:287272:16:4294967295]
00000400:00000200:9.0:1773851861.891461:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000400:00000200:9.0:1773851861.891463:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891466:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10963@kfi7(10963@kfi7:10963@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.891469:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 3
00000800:00000200:9.0:1773851861.891471:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.891473:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.891477:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.891481:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000148 Using peer 10963@kfi7(0x100000000000148)
00000800:00000200:9.0:1773851861.891486:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000438708cd: Posted send of 324 bytes to peer 0x100000000000148: rc=0
00000800:00000200:9.0:1773851861.891489:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000148 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.891493:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.891494:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003f6ded9c refcount 4 to 10963@kfi7
00010000:00000001:9.0:1773851861.891496:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.891497:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891498:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.891499:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e9cd4914 x1859314467687872/t0(0) o400->3888c8fa-e3a1-42ee-bbcc-17154c917465@10963@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1173-0'
00000800:00000200:10.0:1773851861.891504:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000148 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851861.891505:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9cd4914 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3888c8fa-e3a1-42ee-bbcc-17154c917465+6:39730:x1859314467687872:12345-10963@kfi7:400:default-tuolumne1173-0 Request processed in 99us (136us total) trans 0 rc 0/0
00000400:00000200:10.0:1773851861.891508:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851861.891510:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10963@kfi7: PUT: OK
00000100:00100000:9.0:1773851861.891510:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10963@kfi7, seq: 2130762
00000400:00000200:10.0:1773851861.891511:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052ffe31c
00000400:00000010:10.0:1773851861.891512:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052ffe31c.
00000100:00000040:9.0:1773851861.891512:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001c161c64 : new rpc_count 0
00000100:00000001:9.0:1773851861.891513:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851861.891514:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851861.891514:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851861.891514:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851861.891515:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851861.891516:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000020:00000010:9.0:1773851861.891517:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000800:00000200:10.0:1773851861.891519:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 10963@kfi7(0000000001da08f4):0x0 lsk 329 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000148 Transaction freed
00000020:00000010:9.0:1773851861.891519:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851861.891520:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000001c161c64 : new refcount 5
00000100:00000001:9.0:1773851861.891522:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851861.891736:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.891737:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851861.891739:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851861.891742:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851861.891745:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891747:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10963@kfi7 : PUT - for me
00000400:00000200:9.0:1773851861.891749:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891750:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 1
00000400:00000200:9.0:1773851861.891751:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891752:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000400:00000200:9.0:1773851861.891754:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 3
00000400:00000200:9.0:1773851861.891755:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891757:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10963@kfi7 of length 224 into portal 12 MB=0x69b09625f5640
00000400:00000200:9.0:1773851861.891758:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10963@kfi7 of length 224/224 into md 0x78146ce49 [64] + 130608
00000800:00000200:9.0:1773851861.891761:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851861.891764:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851861.891765:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10963@kfi7: PUT: OK
00000100:00000001:9.0:1773851861.891767:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851861.891767:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851861.891768:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f32b1661.
00000100:00000040:9.0:1773851861.891769:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f32b1661 x1859314467690048 msgsize 224
00000100:00100000:9.0:1773851861.891772:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10963@kfi7 (source: 12345-10963@kfi7)
00000100:00000001:9.0:1773851861.891774:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851861.891776:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000800:00000200:9.0:1773851861.891778:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851861.891782:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851861.891782:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851861.891783:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851861.891784:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851861.891785:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851861.891786:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314467690048
00000020:00000001:9.0:1773851861.891786:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851861.891787:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92936
00000020:00000001:9.0:1773851861.891788:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851861.891791:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000359941f refcount=6
00000020:00000001:9.0:1773851861.891792:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743192576 : -107128966359040 : ffff9e911803d800)
00000020:00000001:9.0:1773851861.891793:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743192576 : -107128966359040 : ffff9e911803d800)
00000100:00000001:9.0:1773851861.891795:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.891796:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851861.891796:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851861.891798:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851861.891799:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851861.891800:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851861.891801:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851861.891801:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.891803:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851861.891803:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851861.891804:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891805:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851861.891807:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851861.891807:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851861.891808:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851861.891808:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851861.891809:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10963@kfi7, seq: 2130763
00000100:00000001:11.0:1773851861.891810:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.891810:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000359941f : new rpc_count 1
00000100:00000001:11.0:1773851861.891811:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891811:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922902784 : -107141786648832 : ffff9e8e1bddbf00)
00000100:00000040:9.0:1773851861.891812:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f32b1661 x1859314467690048/t0(0) o400->7bd77c6c-a86f-4e2a-a43a-9366c220d06c@10963@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1173-0'
00000100:00000001:9.0:1773851861.891817:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851861.891818:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851861.891819:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f32b1661 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:7bd77c6c-a86f-4e2a-a43a-9366c220d06c+6:39728:x1859314467690048:12345-10963@kfi7:400:default-tuolumne1173-0
00000100:00000200:9.0:1773851861.891821:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314467690048
00000020:00000001:9.0:1773851861.891822:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851861.891822:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851861.891823:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891824:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851861.891825:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851861.891826:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851861.891827:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314467690048, found 0 last_xid 1859314467690047
00000020:00000001:9.0:1773851861.891828:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851861.891829:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851861.891829:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851861.891830:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891831:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851861.891832:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851861.891832:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851861.891833:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d53429e0.
02000000:00000001:9.0:1773851861.891834:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891835:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891836:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851861.891837:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693288, transno 0, xid 1859314467690048
00010000:00000001:9.0:1773851861.891838:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851861.891839:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f32b1661 x1859314467690048/t0(0) o400->7bd77c6c-a86f-4e2a-a43a-9366c220d06c@10963@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1173-0'
00010000:00000001:9.0:1773851861.891843:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851861.891844:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851861.891844:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=94 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851861.891846:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851861.891847:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003f6ded9c refcount 5 to 10963@kfi7
00000100:00000001:9.0:1773851861.891848:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899609888 : -107146809941728 : ffff9e8cf0746120)
02000000:00000001:9.0:1773851861.891853:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851861.891853:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851861.891854:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851861.891856:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10963@kfi7
00000400:00000010:9.0:1773851861.891856:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a560bc2c.
00000100:00000200:9.0:1773851861.891858:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314467690048, offset 224
00000400:00000200:9.0:1773851861.891859:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10963@kfi7
00000400:00000200:9.0:1773851861.891861:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891862:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 1
00000400:00000200:9.0:1773851861.891863:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000400:00000200:9.0:1773851861.891864:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 3
00000400:00000200:9.0:1773851861.891866:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10963@kfi7 local destination
00000400:00000200:9.0:1773851861.891868:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769014:8769014:1024:4294967295] 10963@kfi7 LPNI seq info [287273:287273:16:4294967295]
00000400:00000200:9.0:1773851861.891870:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000400:00000200:9.0:1773851861.891872:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10963@kfi7 to cpt 2
00000400:00000200:9.0:1773851861.891875:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10963@kfi7(10963@kfi7:10963@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851861.891877:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 3
00000800:00000200:9.0:1773851861.891879:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851861.891880:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851861.891883:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851861.891887:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x13f Using peer 10963@kfi7(0x13f)
00000800:00000200:9.0:1773851861.891891:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x13f: rc=0
00000800:00000200:9.0:1773851861.891894:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x13f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851861.891897:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851861.891898:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003f6ded9c refcount 4 to 10963@kfi7
00010000:00000001:9.0:1773851861.891899:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851861.891899:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851861.891901:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851861.891902:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f32b1661 x1859314467690048/t0(0) o400->7bd77c6c-a86f-4e2a-a43a-9366c220d06c@10963@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1173-0'
00000800:00000200:10.0:1773851861.891907:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x13f TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851861.891907:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f32b1661 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:7bd77c6c-a86f-4e2a-a43a-9366c220d06c+6:39728:x1859314467690048:12345-10963@kfi7:400:default-tuolumne1173-0 Request processed in 88us (136us total) trans 0 rc 0/0
00000400:00000200:10.0:1773851861.891909:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:9.0:1773851861.891910:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10963@kfi7, seq: 2130763
00000400:00000200:10.0:1773851861.891911:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10963@kfi7: PUT: OK
00000100:00000040:9.0:1773851861.891911:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000359941f : new rpc_count 0
00000400:00000200:10.0:1773851861.891912:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a560bc2c
00000400:00000010:10.0:1773851861.891913:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a560bc2c.
00000100:00000001:9.0:1773851861.891913:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851861.891914:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851861.891914:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851861.891914:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851861.891914:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851861.891915:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001b86cb10 nid 10963@kfi7 refs 2
00000020:00000010:9.0:1773851861.891915:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000020:00000010:9.0:1773851861.891916:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851861.891917:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000000359941f : new refcount 5
00000800:00000200:10.0:1773851861.891918:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 10963@kfi7(00000000ddc75b06):0x0 lsk 320 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x13f Transaction freed
00000100:00000001:9.0:1773851861.891918:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851861.897736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851861.897738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:26.0:1773851861.960394:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851861.960395:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851861.960397:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851861.960399:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851861.960401:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20578@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.960403:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20578@kfi7 : PUT - for me
00000400:00000200:26.0:1773851861.960404:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20578@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.960405:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052fbb8cf nid 20578@kfi7 refs 1
00000400:00000200:26.0:1773851861.960406:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20578@kfi7 to cpt 6
00000400:00000200:26.0:1773851861.960406:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052fbb8cf nid 20578@kfi7 refs 2
00000400:00000200:26.0:1773851861.960407:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000052fbb8cf nid 20578@kfi7 refs 3
00000400:00000200:26.0:1773851861.960408:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20642@kfi7 to cpt 2
00000400:00000200:26.0:1773851861.960409:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20642@kfi7 of length 224 into portal 12 MB=0x699e15dea8640
00000400:00000200:26.0:1773851861.960410:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20642@kfi7 of length 224/224 into md 0x16159c6179 [64] + 193592
00000800:00000200:26.0:1773851861.960412:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851861.960414:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851861.960416:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20578@kfi7: PUT: OK
00000100:00000001:26.0:1773851861.960417:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851861.960417:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851861.960418:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b6b44c1.
00000100:00000040:26.0:1773851861.960419:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000002b6b44c1 x1858043082606144 msgsize 224
00000100:00100000:26.0:1773851861.960421:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-20642@kfi7 (source: 12345-20578@kfi7)
00000100:00000001:26.0:1773851861.960422:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851861.960423:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000052fbb8cf nid 20578@kfi7 refs 2
00000100:00000001:24.0:1773851861.960423:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851861.960424:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851861.960424:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:26.0:1773851861.960425:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851861.960425:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.960426:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.960427:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043082606144
00000020:00000001:24.0:1773851861.960428:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.960428:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92339
00000020:00000001:24.0:1773851861.960429:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.960431:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007256f1bb refcount=631
00000020:00000001:24.0:1773851861.960431:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630295552 : -107123079256064 : ffff9e9276e9e800)
00000020:00000001:24.0:1773851861.960432:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630295552 : -107123079256064 : ffff9e9276e9e800)
00000100:00000001:24.0:1773851861.960433:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.960434:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.960435:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000041548332.
00000020:00000010:24.0:1773851861.960436:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.960437:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.960438:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.960438:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.960438:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.960439:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.960440:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.960440:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.960441:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.960442:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.960443:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851861.960444:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:24.0:1773851861.960444:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20642@kfi7, seq: 2025076
00000100:00000040:24.0:1773851861.960445:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007256f1bb : new rpc_count 10
00000100:00000001:24.0:1773851861.960445:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150695296 : -106980558856320 : ffff9eb3a5ca9f80)
00000100:00000040:24.0:1773851861.960446:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002b6b44c1 x1858043082606144/t0(0) o400->c04f0787-7df2-4df9-9a2b-817efb3a3a03@20642@kfi7:78/0 lens 224/0 e 0 to 0 dl 1773852193 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1772-0'
00000100:00000001:25.0:1773851861.960447:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851861.960448:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851861.960449:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.960449:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.960449:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.960450:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b6b44c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:c04f0787-7df2-4df9-9a2b-817efb3a3a03+631:39625:x1858043082606144:12345-20642@kfi7:400:default-tuolumne1772-0
00000100:00000200:24.0:1773851861.960452:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043082606144
00000020:00000001:24.0:1773851861.960452:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.960456:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.960456:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.960457:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.960457:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.960458:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.960459:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043082606144, found 0 last_xid 1858043034847679
00000020:00000001:24.0:1773851861.960460:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.960460:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.960461:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.960461:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.960462:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.960462:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.960463:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.960463:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b8ced97a.
02000000:00000001:24.0:1773851861.960464:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.960465:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.960465:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.960466:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581372, transno 0, xid 1858043082606144
00010000:00000001:24.0:1773851861.960467:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.960468:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002b6b44c1 x1858043082606144/t0(0) o400->c04f0787-7df2-4df9-9a2b-817efb3a3a03@20642@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1772-0'
00010000:00000001:24.0:1773851861.960470:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.960470:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.960471:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.960472:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.960473:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000043f8a262 refcount 3 to 20642@kfi7
00000100:00000001:24.0:1773851861.960474:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959055520 : -107146750496096 : ffff9e8cf3ff72a0)
02000000:00000001:24.0:1773851861.960474:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.960475:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.960476:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.960476:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20578@kfi7
00000400:00000010:24.0:1773851861.960477:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002fb795f8.
00000100:00000200:24.0:1773851861.960478:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043082606144, offset 224
00000400:00000200:24.0:1773851861.960479:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20578@kfi7
00000400:00000200:24.0:1773851861.960480:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20578@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.960481:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052fbb8cf nid 20578@kfi7 refs 1
00000400:00000200:24.0:1773851861.960482:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000052fbb8cf nid 20578@kfi7 refs 2
00000400:00000200:24.0:1773851861.960483:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000052fbb8cf nid 20578@kfi7 refs 3
00000400:00000200:24.0:1773851861.960485:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20578@kfi7 local destination
00000400:00000200:24.0:1773851861.960486:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769015:8769015:1024:4294967295] 20578@kfi7 LPNI seq info [9853552:9853552:16:4294967295]
00000400:00000200:24.0:1773851861.960487:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000052fbb8cf nid 20578@kfi7 refs 2
00000400:00000200:24.0:1773851861.960488:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20578@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.960490:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20578@kfi7(20578@kfi7:20578@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.960491:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000052fbb8cf nid 20578@kfi7 refs 3
00000800:00000200:24.0:1773851861.960492:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.960493:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.960495:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.960497:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005d7 Using peer 20578@kfi7(0x1000000000005d7)
00000800:00000200:24.0:1773851861.960500:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0x1000000000005d7: rc=0
00000800:00000200:24.0:1773851861.960501:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.960503:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.960504:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000043f8a262 refcount 2 to 20642@kfi7
00010000:00000001:24.0:1773851861.960505:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.960505:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.960506:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.960506:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002b6b44c1 x1858043082606144/t0(0) o400->c04f0787-7df2-4df9-9a2b-817efb3a3a03@20642@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1772-0'
00000100:00100000:24.0:1773851861.960511:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b6b44c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:c04f0787-7df2-4df9-9a2b-817efb3a3a03+631:39625:x1858043082606144:12345-20642@kfi7:400:default-tuolumne1772-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.960513:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20642@kfi7, seq: 2025076
00000100:00000040:24.0:1773851861.960514:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007256f1bb : new rpc_count 9
00000100:00000001:24.0:1773851861.960515:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.960515:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.960516:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.960516:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.960517:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000041548332.
00000020:00000040:24.0:1773851861.960518:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000007256f1bb : new refcount 630
00000100:00000001:24.0:1773851861.960519:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851861.960524:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005d7 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851861.960526:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851861.960527:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20578@kfi7: PUT: OK
00000400:00000200:26.0:1773851861.960528:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002fb795f8
00000400:00000010:26.0:1773851861.960528:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002fb795f8.
00000100:00000001:26.0:1773851861.960529:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851861.960530:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851861.960531:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000052fbb8cf nid 20578@kfi7 refs 2
00000800:00000200:26.0:1773851861.960532:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 20578@kfi7(0000000020d5b68d):0x0 lsk 1496 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005d7 Transaction freed
00000800:00000200:1.0:1773851861.979200:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.979201:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.979203:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.979205:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.979207:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979208:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12282@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.979209:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979210:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 1
00000400:00000200:1.0:1773851861.979211:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979212:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000400:00000200:1.0:1773851861.979212:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 3
00000400:00000200:1.0:1773851861.979214:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979214:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12282@kfi7 of length 224 into portal 12 MB=0x699de8cc18840
00000400:00000200:1.0:1773851861.979216:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12282@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 24248
00000800:00000200:1.0:1773851861.979217:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.979219:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.979220:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12282@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.979221:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.979221:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.979222:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000075a98d23.
00000100:00000040:1.0:1773851861.979223:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000075a98d23 x1858030983546944 msgsize 224
00000100:00100000:1.0:1773851861.979224:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-12282@kfi7 (source: 12345-12282@kfi7)
00000100:00000001:1.0:1773851861.979225:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.979226:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000100:00000001:0.0:1773851861.979227:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851861.979227:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851861.979228:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851861.979228:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.979228:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.979229:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.979230:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030983546944
00000020:00000001:0.0:1773851861.979231:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.979231:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f51
00000020:00000001:0.0:1773851861.979232:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.979233:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d5be9543 refcount=6
00000020:00000001:0.0:1773851861.979234:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239882752 : -107152469668864 : ffff9e8b9f1bcc00)
00000020:00000001:0.0:1773851861.979234:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239882752 : -107152469668864 : ffff9e8b9f1bcc00)
00000100:00000001:0.0:1773851861.979235:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.979236:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.979237:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c5bdc42.
00000020:00000010:0.0:1773851861.979238:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.979238:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.979239:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.979240:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.979241:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.979242:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.979242:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.979243:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979243:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851861.979245:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.979245:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851861.979245:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851861.979246:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12282@kfi7, seq: 1997539
00000100:00000001:1.0:1773851861.979247:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.979247:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.979247:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d5be9543 : new rpc_count 1
00000100:00000001:1.0:1773851861.979248:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979248:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856597376 : -106915852954240 : ffff9ec2b6905580)
00000100:00000040:0.0:1773851861.979249:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000075a98d23 x1858030983546944/t0(0) o400->c4fcba6d-b593-46c4-aa8d-3a65331aeb62@12282@kfi7:501/0 lens 224/0 e 0 to 0 dl 1773852616 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne216-0'
00000100:00000001:0.0:1773851861.979252:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.979252:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.979253:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075a98d23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c4fcba6d-b593-46c4-aa8d-3a65331aeb62+6:47760:x1858030983546944:12345-12282@kfi7:400:default-tuolumne216-0
00000100:00000200:0.0:1773851861.979254:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030983546944
00000020:00000001:0.0:1773851861.979255:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.979256:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.979256:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979257:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.979257:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.979258:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.979259:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030983546944, found 0 last_xid 1858030983546943
00000020:00000001:0.0:1773851861.979260:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.979260:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.979261:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.979262:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979262:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.979263:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.979263:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.979264:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001356fcb6.
02000000:00000001:0.0:1773851861.979265:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979265:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979266:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.979267:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030983546944
00010000:00000001:0.0:1773851861.979268:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.979269:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000075a98d23 x1858030983546944/t0(0) o400->c4fcba6d-b593-46c4-aa8d-3a65331aeb62@12282@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne216-0'
00010000:00000001:0.0:1773851861.979271:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.979271:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.979272:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.979273:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.979273:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005e2281ca refcount 5 to 12282@kfi7
00000100:00000001:0.0:1773851861.979274:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155872 : -107139310395744 : ffff9e8eaf765ea0)
02000000:00000001:0.0:1773851861.979275:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.979275:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979276:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.979277:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12282@kfi7
00000400:00000010:0.0:1773851861.979278:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c2d69e3.
00000100:00000200:0.0:1773851861.979278:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030983546944, offset 224
00000400:00000200:0.0:1773851861.979280:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12282@kfi7
00000400:00000200:0.0:1773851861.979280:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.979281:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 1
00000400:00000200:0.0:1773851861.979282:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000400:00000200:0.0:1773851861.979283:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 3
00000400:00000200:0.0:1773851861.979284:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12282@kfi7 local destination
00000400:00000200:0.0:1773851861.979286:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769016:8769016:1024:4294967295] 12282@kfi7 LPNI seq info [24407:24407:16:4294967295]
00000400:00000200:0.0:1773851861.979287:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000400:00000200:0.0:1773851861.979288:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.979289:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12282@kfi7(12282@kfi7:12282@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.979290:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 3
00000800:00000200:0.0:1773851861.979292:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.979293:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.979295:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.979298:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003e9 Using peer 12282@kfi7(0x1000000000003e9)
00000800:00000200:0.0:1773851861.979301:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x1000000000003e9: rc=0
00000800:00000200:0.0:1773851861.979303:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003e9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.979305:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.979306:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005e2281ca refcount 4 to 12282@kfi7
00010000:00000001:0.0:1773851861.979306:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.979307:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979308:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.979308:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000075a98d23 x1858030983546944/t0(0) o400->c4fcba6d-b593-46c4-aa8d-3a65331aeb62@12282@kfi7:501/0 lens 224/224 e 0 to 0 dl 1773852616 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne216-0'
00000100:00100000:0.0:1773851861.979313:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075a98d23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c4fcba6d-b593-46c4-aa8d-3a65331aeb62+6:47760:x1858030983546944:12345-12282@kfi7:400:default-tuolumne216-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.979315:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12282@kfi7, seq: 1997539
00000100:00000040:0.0:1773851861.979316:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d5be9543 : new rpc_count 0
00000100:00000001:0.0:1773851861.979316:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.979317:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.979318:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.979318:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.979319:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c5bdc42.
00000020:00000040:0.0:1773851861.979320:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000d5be9543 : new refcount 5
00000100:00000001:0.0:1773851861.979321:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.979327:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003e9 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.979329:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.979330:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12282@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.979331:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c2d69e3
00000400:00000010:1.0:1773851861.979331:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c2d69e3.
00000100:00000001:1.0:1773851861.979332:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.979332:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.979333:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000800:00000200:1.0:1773851861.979335:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 12282@kfi7(00000000fa6c35fa):0x0 lsk 1002 rsk 134 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003e9 Transaction freed
00000800:00000200:1.0:1773851861.979646:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851861.979647:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851861.979648:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851861.979650:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851861.979652:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979653:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12282@kfi7 : PUT - for me
00000400:00000200:1.0:1773851861.979654:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979654:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 1
00000400:00000200:1.0:1773851861.979655:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979656:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000400:00000200:1.0:1773851861.979656:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 3
00000400:00000200:1.0:1773851861.979657:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:1.0:1773851861.979658:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12282@kfi7 of length 224 into portal 12 MB=0x699de8cc18fc0
00000400:00000200:1.0:1773851861.979659:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12282@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 24472
00000800:00000200:1.0:1773851861.979661:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851861.979662:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.979664:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12282@kfi7: PUT: OK
00000100:00000001:1.0:1773851861.979665:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851861.979665:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851861.979666:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a8d66f4.
00000100:00000040:1.0:1773851861.979667:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000008a8d66f4 x1858030983548864 msgsize 224
00000100:00100000:1.0:1773851861.979668:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-12282@kfi7 (source: 12345-12282@kfi7)
00000100:00000001:1.0:1773851861.979669:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851861.979670:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000100:00000001:0.0:1773851861.979670:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851861.979671:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851861.979671:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851861.979671:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851861.979671:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851861.979672:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.979673:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030983548864
00000020:00000001:0.0:1773851861.979673:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851861.979673:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912d1
00000020:00000001:0.0:1773851861.979675:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851861.979677:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006a26f618 refcount=6
00000020:00000001:0.0:1773851861.979678:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716207616 : -107155993344000 : ffff9e8acd14c800)
00000020:00000001:0.0:1773851861.979678:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716207616 : -107155993344000 : ffff9e8acd14c800)
00000100:00000001:0.0:1773851861.979679:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.979680:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851861.979680:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f8f6276b.
00000020:00000010:0.0:1773851861.979681:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.979682:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851861.979682:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851861.979683:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851861.979683:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.979684:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851861.979684:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851861.979685:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979686:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851861.979686:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.979687:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851861.979687:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851861.979687:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851861.979688:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851861.979688:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12282@kfi7, seq: 1997540
00000100:00000040:0.0:1773851861.979688:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006a26f618 : new rpc_count 1
00000100:00000001:1.0:1773851861.979689:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979689:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856577792 : -106915852973824 : ffff9ec2b6900900)
00000100:00000040:0.0:1773851861.979690:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a8d66f4 x1858030983548864/t0(0) o400->a910dbe7-e831-4eae-8e93-4d412751f77f@12282@kfi7:588/0 lens 224/0 e 0 to 0 dl 1773851948 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne216-0'
00000100:00000001:0.0:1773851861.979692:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851861.979693:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851861.979694:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a8d66f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a910dbe7-e831-4eae-8e93-4d412751f77f+6:47757:x1858030983548864:12345-12282@kfi7:400:default-tuolumne216-0
00000100:00000200:0.0:1773851861.979695:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030983548864
00000020:00000001:0.0:1773851861.979696:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851861.979696:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851861.979697:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979697:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851861.979697:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851861.979707:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851861.979707:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030983548864, found 0 last_xid 1858030983548863
00000020:00000001:0.0:1773851861.979708:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851861.979708:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851861.979709:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851861.979709:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979709:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851861.979710:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851861.979710:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851861.979711:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009c5bdc42.
02000000:00000001:0.0:1773851861.979711:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979712:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979712:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851861.979713:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768126, transno 0, xid 1858030983548864
00010000:00000001:0.0:1773851861.979713:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851861.979714:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008a8d66f4 x1858030983548864/t0(0) o400->a910dbe7-e831-4eae-8e93-4d412751f77f@12282@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne216-0'
00010000:00000001:0.0:1773851861.979716:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851861.979717:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851861.979717:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=94 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851861.979718:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851861.979719:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005e2281ca refcount 5 to 12282@kfi7
00000100:00000001:0.0:1773851861.979719:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155872 : -107139310395744 : ffff9e8eaf765ea0)
02000000:00000001:0.0:1773851861.979720:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851861.979720:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851861.979721:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851861.979722:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12282@kfi7
00000400:00000010:0.0:1773851861.979722:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d94499d6.
00000100:00000200:0.0:1773851861.979723:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030983548864, offset 224
00000400:00000200:0.0:1773851861.979724:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12282@kfi7
00000400:00000200:0.0:1773851861.979729:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.979729:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 1
00000400:00000200:0.0:1773851861.979730:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000400:00000200:0.0:1773851861.979731:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 3
00000400:00000200:0.0:1773851861.979732:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12282@kfi7 local destination
00000400:00000200:0.0:1773851861.979734:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769017:8769017:1024:4294967295] 12282@kfi7 LPNI seq info [24408:24408:16:4294967295]
00000400:00000200:0.0:1773851861.979735:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000400:00000200:0.0:1773851861.979736:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12282@kfi7 to cpt 0
00000400:00000200:0.0:1773851861.979738:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12282@kfi7(12282@kfi7:12282@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851861.979739:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 3
00000800:00000200:0.0:1773851861.979740:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851861.979741:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851861.979743:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851861.979745:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ef Using peer 12282@kfi7(0x3ef)
00000800:00000200:0.0:1773851861.979748:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x3ef: rc=0
00000800:00000200:0.0:1773851861.979750:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ef TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851861.979751:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851861.979752:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005e2281ca refcount 4 to 12282@kfi7
00010000:00000001:0.0:1773851861.979753:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851861.979753:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851861.979754:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851861.979754:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a8d66f4 x1858030983548864/t0(0) o400->a910dbe7-e831-4eae-8e93-4d412751f77f@12282@kfi7:588/0 lens 224/224 e 0 to 0 dl 1773851948 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne216-0'
00000100:00100000:0.0:1773851861.979758:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a8d66f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a910dbe7-e831-4eae-8e93-4d412751f77f+6:47757:x1858030983548864:12345-12282@kfi7:400:default-tuolumne216-0 Request processed in 64us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851861.979760:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12282@kfi7, seq: 1997540
00000100:00000040:0.0:1773851861.979761:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006a26f618 : new rpc_count 0
00000100:00000001:0.0:1773851861.979762:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851861.979762:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851861.979766:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851861.979766:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851861.979767:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f8f6276b.
00000020:00000040:0.0:1773851861.979768:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000006a26f618 : new refcount 5
00000100:00000001:0.0:1773851861.979769:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851861.979773:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ef TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851861.979775:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851861.979776:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12282@kfi7: PUT: OK
00000400:00000200:1.0:1773851861.979777:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d94499d6
00000400:00000010:1.0:1773851861.979777:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d94499d6.
00000100:00000001:1.0:1773851861.979778:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851861.979778:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851861.979779:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c083ff66 nid 12282@kfi7 refs 2
00000800:00000200:1.0:1773851861.979780:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 12282@kfi7(000000003e9db5f1):0x0 lsk 1008 rsk 135 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ef Transaction freed
00000800:00000200:25.0:1773851861.985083:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851861.985084:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851861.985086:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851861.985090:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851861.985093:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18931@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.985095:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18931@kfi7 : PUT - for me
00000400:00000200:25.0:1773851861.985096:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18931@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.985098:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006644cb85 nid 18931@kfi7 refs 1
00000400:00000200:25.0:1773851861.985099:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18931@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.985100:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006644cb85 nid 18931@kfi7 refs 2
00000400:00000200:25.0:1773851861.985102:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006644cb85 nid 18931@kfi7 refs 3
00000400:00000200:25.0:1773851861.985103:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18931@kfi7 to cpt 6
00000400:00000200:25.0:1773851861.985105:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18931@kfi7 of length 224 into portal 12 MB=0x69b4b57231d80
00000400:00000200:25.0:1773851861.985107:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18931@kfi7 of length 224/224 into md 0x16159c6179 [64] + 193816
00000800:00000200:25.0:1773851861.985110:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851861.985112:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.985114:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18931@kfi7: PUT: OK
00000100:00000001:25.0:1773851861.985116:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851861.985116:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851861.985118:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa0be8a5.
00000100:00000040:25.0:1773851861.985119:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000fa0be8a5 x1859597747035520 msgsize 224
00000100:00100000:25.0:1773851861.985121:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-18931@kfi7 (source: 12345-18931@kfi7)
00000100:00000001:25.0:1773851861.985123:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851861.985124:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006644cb85 nid 18931@kfi7 refs 2
00000100:00000001:24.0:1773851861.985125:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851861.985126:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851861.985127:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851861.985127:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851861.985128:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851861.985129:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851861.985130:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597747035520
00000020:00000001:24.0:1773851861.985131:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851861.985132:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80cc0
00000020:00000001:24.0:1773851861.985133:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851861.985135:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000008806859 refcount=5
00000020:00000001:24.0:1773851861.985136:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127708160000 : -106946001391616 : ffff9ebbb193b000)
00000020:00000001:24.0:1773851861.985137:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127708160000 : -106946001391616 : ffff9ebbb193b000)
00000100:00000001:24.0:1773851861.985139:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.985140:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851861.985141:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000041548332.
00000020:00000010:24.0:1773851861.985142:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.985144:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851861.985145:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851861.985145:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851861.985146:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851861.985148:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851861.985149:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851861.985149:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.985151:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851861.985153:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.985153:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851861.985154:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851861.985155:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851861.985155:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18931@kfi7, seq: 2025077
00000100:00000040:24.0:1773851861.985157:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000008806859 : new rpc_count 1
00000100:00000001:25.0:1773851861.985158:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851861.985159:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.985159:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478781184 : -106938230770432 : ffff9ebd80bdf500)
00000100:00000040:24.0:1773851861.985160:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fa0be8a5 x1859597747035520/t0(0) o400->b5b211b9-1ae7-4f2c-bc53-108fb8507774@18931@kfi7:78/0 lens 224/0 e 0 to 0 dl 1773852193 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1657-0'
00000100:00000001:24.0:1773851861.985165:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851861.985165:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851861.985167:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa0be8a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b5b211b9-1ae7-4f2c-bc53-108fb8507774+5:39693:x1859597747035520:12345-18931@kfi7:400:default-tuolumne1657-0
00000100:00000200:24.0:1773851861.985168:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597747035520
00000020:00000001:24.0:1773851861.985170:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851861.985171:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851861.985172:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.985173:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851861.985174:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851861.985175:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851861.985176:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597747035520, found 0 last_xid 1859597747035519
00000020:00000001:24.0:1773851861.985177:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851861.985178:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851861.985179:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851861.985180:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.985181:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851861.985182:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851861.985182:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851861.985184:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000012e7cd8f.
02000000:00000001:24.0:1773851861.985185:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.985186:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.985187:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851861.985188:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044104341, transno 0, xid 1859597747035520
00010000:00000001:24.0:1773851861.985189:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851861.985190:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fa0be8a5 x1859597747035520/t0(0) o400->b5b211b9-1ae7-4f2c-bc53-108fb8507774@18931@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1657-0'
00010000:00000001:24.0:1773851861.985195:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851861.985195:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851861.985197:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=94 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851861.985199:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851861.985200:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000087b86069 refcount 3 to 18931@kfi7
00000100:00000001:24.0:1773851861.985201:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858112 : -107149578693504 : ffff9e8c4b6c9480)
02000000:00000001:24.0:1773851861.985203:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851861.985203:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851861.985204:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851861.985206:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18931@kfi7
00000400:00000010:24.0:1773851861.985207:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000040aa4957.
00000100:00000200:24.0:1773851861.985208:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597747035520, offset 224
00000400:00000200:24.0:1773851861.985210:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18931@kfi7
00000400:00000200:24.0:1773851861.985211:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18931@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.985212:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006644cb85 nid 18931@kfi7 refs 1
00000400:00000200:24.0:1773851861.985214:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006644cb85 nid 18931@kfi7 refs 2
00000400:00000200:24.0:1773851861.985216:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006644cb85 nid 18931@kfi7 refs 3
00000400:00000200:24.0:1773851861.985217:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18931@kfi7 local destination
00000400:00000200:24.0:1773851861.985219:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769018:8769018:1024:4294967295] 18931@kfi7 LPNI seq info [1090379:1090379:16:4294967295]
00000400:00000200:24.0:1773851861.985222:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006644cb85 nid 18931@kfi7 refs 2
00000400:00000200:24.0:1773851861.985223:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18931@kfi7 to cpt 6
00000400:00000200:24.0:1773851861.985226:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18931@kfi7(18931@kfi7:18931@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851861.985228:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006644cb85 nid 18931@kfi7 refs 3
00000800:00000200:24.0:1773851861.985230:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851861.985232:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851861.985235:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851861.985239:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000238 Using peer 18931@kfi7(0x100000000000238)
00000800:00000200:24.0:1773851861.985243:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x100000000000238: rc=0
00000800:00000200:24.0:1773851861.985246:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000238 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851861.985252:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851861.985256:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000087b86069 refcount 2 to 18931@kfi7
00010000:00000001:24.0:1773851861.985257:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851861.985258:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851861.985259:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851861.985260:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa0be8a5 x1859597747035520/t0(0) o400->b5b211b9-1ae7-4f2c-bc53-108fb8507774@18931@kfi7:78/0 lens 224/224 e 0 to 0 dl 1773852193 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1657-0'
00000100:00100000:24.0:1773851861.985265:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa0be8a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b5b211b9-1ae7-4f2c-bc53-108fb8507774+5:39693:x1859597747035520:12345-18931@kfi7:400:default-tuolumne1657-0 Request processed in 99us (145us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851861.985269:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18931@kfi7, seq: 2025077
00000100:00000040:24.0:1773851861.985270:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000008806859 : new rpc_count 0
00000100:00000001:24.0:1773851861.985271:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851861.985272:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851861.985273:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851861.985274:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851861.985276:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000041548332.
00000020:00000040:24.0:1773851861.985277:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000008806859 : new refcount 4
00000100:00000001:24.0:1773851861.985278:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851861.985285:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000238 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851861.985288:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851861.985290:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18931@kfi7: PUT: OK
00000400:00000200:25.0:1773851861.985291:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000040aa4957
00000400:00000010:25.0:1773851861.985292:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000040aa4957.
00000100:00000001:25.0:1773851861.985293:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851861.985294:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851861.985295:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006644cb85 nid 18931@kfi7 refs 2
00000800:00000200:25.0:1773851861.985297:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 18931@kfi7(00000000af26f8aa):0x0 lsk 569 rsk 4 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000238 Transaction freed
00000800:00000200:9.0:1773851862.060939:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.060940:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851862.060941:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851862.060943:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851862.060945:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25331@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.060946:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25331@kfi7 : PUT - for me
00000400:00000200:9.0:1773851862.060947:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25331@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.060948:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e5400a7 nid 25331@kfi7 refs 1
00000400:00000200:9.0:1773851862.060949:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25331@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.060949:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e5400a7 nid 25331@kfi7 refs 2
00000400:00000200:9.0:1773851862.060950:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002e5400a7 nid 25331@kfi7 refs 3
00000400:00000200:9.0:1773851862.060951:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25138@kfi7 to cpt 5
00000400:00000200:9.0:1773851862.060952:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25138@kfi7 of length 224 into portal 12 MB=0x699e11d701e80
00000400:00000200:9.0:1773851862.060953:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25138@kfi7 of length 224/224 into md 0x78146ce49 [64] + 130832
00000800:00000200:9.0:1773851862.060955:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851862.060957:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851862.060958:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25331@kfi7: PUT: OK
00000100:00000001:9.0:1773851862.060959:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851862.060959:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851862.060960:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000014285ae7.
00000100:00000040:9.0:1773851862.060961:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000014285ae7 x1858042000842368 msgsize 224
00000100:00100000:9.0:1773851862.060963:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-25138@kfi7 (source: 12345-25331@kfi7)
00000100:00000001:9.0:1773851862.060964:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851862.060965:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002e5400a7 nid 25331@kfi7 refs 2
00000800:00000200:9.0:1773851862.060966:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851862.060969:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851862.060969:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851862.060970:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851862.060970:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.060971:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851862.060972:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042000842368
00000020:00000001:9.0:1773851862.060973:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851862.060973:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91937
00000020:00000001:9.0:1773851862.060974:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851862.060977:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b0d91b02 refcount=6
00000020:00000001:9.0:1773851862.060977:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241973760 : -107152467577856 : ffff9e8b9f3bb400)
00000020:00000001:9.0:1773851862.060978:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241973760 : -107152467577856 : ffff9e8b9f3bb400)
00000100:00000001:9.0:1773851862.060979:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.060980:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851862.060981:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851862.060982:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851862.060983:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851862.060984:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851862.060984:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851862.060985:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.060986:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851862.060986:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851862.060987:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.060988:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.060989:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851862.060989:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851862.060990:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851862.060991:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851862.060991:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25138@kfi7, seq: 2130764
00000100:00000040:9.0:1773851862.060991:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b0d91b02 : new rpc_count 1
00000100:00000001:11.0:1773851862.060992:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.060992:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922886656 : -107141786664960 : ffff9e8e1bdd8000)
00000100:00000001:11.0:1773851862.060993:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.060993:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000014285ae7 x1858042000842368/t0(0) o400->f6ad2e19-f1cb-4f50-a001-7fb4839fd174@25138@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2057-0'
00000100:00000001:9.0:1773851862.060996:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.060996:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851862.060997:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014285ae7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f6ad2e19-f1cb-4f50-a001-7fb4839fd174+6:39646:x1858042000842368:12345-25138@kfi7:400:default-tuolumne2057-0
00000100:00000200:9.0:1773851862.060998:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042000842368
00000020:00000001:9.0:1773851862.060999:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851862.061000:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851862.061000:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.061001:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851862.061001:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851862.061002:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851862.061003:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042000842368, found 0 last_xid 1858042000842367
00000020:00000001:9.0:1773851862.061004:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851862.061004:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851862.061005:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851862.061006:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.061006:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851862.061007:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851862.061007:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851862.061008:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003690256b.
02000000:00000001:9.0:1773851862.061009:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.061009:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.061010:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851862.061011:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260598962, transno 0, xid 1858042000842368
00010000:00000001:9.0:1773851862.061011:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851862.061013:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000014285ae7 x1858042000842368/t0(0) o400->f6ad2e19-f1cb-4f50-a001-7fb4839fd174@25138@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2057-0'
00010000:00000001:9.0:1773851862.061015:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851862.061015:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851862.061016:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=95 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851862.061017:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851862.061018:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002b43d21b refcount 3 to 25138@kfi7
00000100:00000001:9.0:1773851862.061019:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108992 : -107156354442624 : ffff9e8ab78eda80)
02000000:00000001:9.0:1773851862.061019:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851862.061020:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.061020:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851862.061021:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25331@kfi7
00000400:00000010:9.0:1773851862.061022:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a560bc2c.
00000100:00000200:9.0:1773851862.061023:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042000842368, offset 224
00000400:00000200:9.0:1773851862.061024:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25331@kfi7
00000400:00000200:9.0:1773851862.061025:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25331@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.061025:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e5400a7 nid 25331@kfi7 refs 1
00000400:00000200:9.0:1773851862.061026:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002e5400a7 nid 25331@kfi7 refs 2
00000400:00000200:9.0:1773851862.061027:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002e5400a7 nid 25331@kfi7 refs 3
00000400:00000200:9.0:1773851862.061029:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25331@kfi7 local destination
00000400:00000200:9.0:1773851862.061030:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769019:8769019:1024:4294967295] 25331@kfi7 LPNI seq info [1306870:1306870:16:4294967295]
00000400:00000200:9.0:1773851862.061031:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002e5400a7 nid 25331@kfi7 refs 2
00000400:00000200:9.0:1773851862.061032:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25331@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.061034:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25331@kfi7(25331@kfi7:25331@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851862.061035:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002e5400a7 nid 25331@kfi7 refs 3
00000800:00000200:9.0:1773851862.061036:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.061037:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851862.061039:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851862.061041:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fe6 Using peer 25331@kfi7(0x100000000000fe6)
00000800:00000200:9.0:1773851862.061045:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x100000000000fe6: rc=0
00000800:00000200:9.0:1773851862.061046:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fe6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851862.061048:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.061049:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002b43d21b refcount 2 to 25138@kfi7
00010000:00000001:9.0:1773851862.061049:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851862.061050:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.061051:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851862.061051:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000014285ae7 x1858042000842368/t0(0) o400->f6ad2e19-f1cb-4f50-a001-7fb4839fd174@25138@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2057-0'
00000100:00100000:9.0:1773851862.061054:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014285ae7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f6ad2e19-f1cb-4f50-a001-7fb4839fd174+6:39646:x1858042000842368:12345-25138@kfi7:400:default-tuolumne2057-0 Request processed in 57us (92us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851862.061056:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25138@kfi7, seq: 2130764
00000100:00000040:9.0:1773851862.061057:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b0d91b02 : new rpc_count 0
00000100:00000001:9.0:1773851862.061058:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851862.061058:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:10.0:1773851862.061059:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fe6 TN_EVENT_TX_OK event status 0
00000020:00000010:9.0:1773851862.061059:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851862.061060:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000020:00000010:9.0:1773851862.061060:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851862.061061:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:9.0:1773851862.061061:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000b0d91b02 : new refcount 5
00000400:00000200:10.0:1773851862.061062:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25331@kfi7: PUT: OK
00000100:00000001:9.0:1773851862.061062:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851862.061063:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a560bc2c
00000400:00000010:10.0:1773851862.061072:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a560bc2c.
00000100:00000001:10.0:1773851862.061073:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851862.061073:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851862.061074:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002e5400a7 nid 25331@kfi7 refs 2
00000800:00000200:10.0:1773851862.061076:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 25331@kfi7(0000000060b410ea):0x0 lsk 4071 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000fe6 Transaction freed
00000800:00000200:2.0:1773851862.101893:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851862.101894:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851862.101896:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851862.101898:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851862.101900:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11426@kfi7 to cpt 0
00000400:00000200:2.0:1773851862.101901:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11426@kfi7 : PUT - for me
00000400:00000200:2.0:1773851862.101902:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11426@kfi7 to cpt 0
00000400:00000200:2.0:1773851862.101903:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c39318f nid 11426@kfi7 refs 1
00000400:00000200:2.0:1773851862.101904:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11426@kfi7 to cpt 0
00000400:00000200:2.0:1773851862.101905:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c39318f nid 11426@kfi7 refs 2
00000400:00000200:2.0:1773851862.101906:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006c39318f nid 11426@kfi7 refs 3
00000400:00000200:2.0:1773851862.101907:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11363@kfi7 to cpt 0
00000400:00000200:2.0:1773851862.101908:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11363@kfi7 of length 224 into portal 12 MB=0x69b4bff4957c0
00000400:00000200:2.0:1773851862.101909:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11363@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 24696
00000800:00000200:2.0:1773851862.101911:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851862.101912:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851862.101913:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11426@kfi7: PUT: OK
00000100:00000001:2.0:1773851862.101915:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851862.101915:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851862.101916:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a2901e1e.
00000100:00000040:2.0:1773851862.101917:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000a2901e1e x1859600568113088 msgsize 224
00000100:00100000:2.0:1773851862.101919:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-11363@kfi7 (source: 12345-11426@kfi7)
00000100:00000001:2.0:1773851862.101920:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851862.101921:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006c39318f nid 11426@kfi7 refs 2
00000100:00000001:0.0:1773851862.101921:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851862.101922:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851862.101922:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851862.101922:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851862.101923:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851862.101924:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851862.101924:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600568113088
00000020:00000001:0.0:1773851862.101925:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851862.101925:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d87b64
00000020:00000001:0.0:1773851862.101926:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851862.101928:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000056f13a76 refcount=57
00000020:00000001:0.0:1773851862.101929:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637154630026240 : -106919079525376 : ffff9ec1f63ec400)
00000020:00000001:0.0:1773851862.101930:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637154630026240 : -106919079525376 : ffff9ec1f63ec400)
00000100:00000001:0.0:1773851862.101931:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851862.101931:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851862.101932:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f8f6276b.
00000020:00000010:0.0:1773851862.101933:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851862.101934:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851862.101935:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851862.101935:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851862.101935:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851862.101936:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851862.101937:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851862.101937:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851862.101938:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851862.101939:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851862.101939:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851862.101940:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851862.101940:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851862.101941:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11363@kfi7, seq: 1997541
00000100:00000001:1.0:1773851862.101942:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851862.101942:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851862.101942:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000056f13a76 : new rpc_count 2
00000100:00000001:0.0:1773851862.101942:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706796032 : -106953002755584 : ffff9eba10435a00)
00000100:00000040:0.0:1773851862.101943:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a2901e1e x1859600568113088/t0(0) o400->cf92737d-a747-44ac-b7f8-8f7f96aa3b76@11363@kfi7:502/0 lens 224/0 e 0 to 0 dl 1773852617 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1196-0'
00000100:00000001:0.0:1773851862.101946:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851862.101947:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851862.101948:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2901e1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:cf92737d-a747-44ac-b7f8-8f7f96aa3b76+57:39683:x1859600568113088:12345-11363@kfi7:400:default-tuolumne1196-0
00000100:00000200:0.0:1773851862.101949:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600568113088
00000020:00000001:0.0:1773851862.101949:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851862.101950:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851862.101951:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.101951:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851862.101952:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851862.101953:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851862.101953:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600568113088, found 0 last_xid 1859600567544319
00000020:00000001:0.0:1773851862.101954:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851862.101955:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851862.101955:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851862.101956:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.101956:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851862.101957:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851862.101957:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851862.101958:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000094213a1a.
02000000:00000001:0.0:1773851862.101959:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851862.101959:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.101960:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851862.101961:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592494, transno 0, xid 1859600568113088
00010000:00000001:0.0:1773851862.101961:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851862.101962:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a2901e1e x1859600568113088/t0(0) o400->cf92737d-a747-44ac-b7f8-8f7f96aa3b76@11363@kfi7:502/0 lens 224/224 e 0 to 0 dl 1773852617 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1196-0'
00010000:00000001:0.0:1773851862.101964:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851862.101965:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851862.101965:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=95 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851862.101966:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851862.101967:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e03b5417 refcount 3 to 11363@kfi7
00000100:00000001:0.0:1773851862.101968:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003904 : -107146751547712 : ffff9e8cf3ef66c0)
02000000:00000001:0.0:1773851862.101969:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851862.101970:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851862.101971:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851862.101971:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11426@kfi7
00000400:00000010:0.0:1773851862.101972:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f597ead9.
00000100:00000200:0.0:1773851862.101973:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600568113088, offset 224
00000400:00000200:0.0:1773851862.101974:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11426@kfi7
00000400:00000200:0.0:1773851862.101975:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11426@kfi7 to cpt 0
00000400:00000200:0.0:1773851862.101976:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c39318f nid 11426@kfi7 refs 1
00000400:00000200:0.0:1773851862.101977:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006c39318f nid 11426@kfi7 refs 2
00000400:00000200:0.0:1773851862.101978:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006c39318f nid 11426@kfi7 refs 3
00000400:00000200:0.0:1773851862.101980:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11426@kfi7 local destination
00000400:00000200:0.0:1773851862.101981:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769020:8769020:1024:4294967295] 11426@kfi7 LPNI seq info [675047:675047:16:4294967295]
00000400:00000200:0.0:1773851862.101982:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006c39318f nid 11426@kfi7 refs 2
00000400:00000200:0.0:1773851862.101983:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11426@kfi7 to cpt 0
00000400:00000200:0.0:1773851862.101985:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11426@kfi7(11426@kfi7:11426@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851862.101986:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006c39318f nid 11426@kfi7 refs 3
00000800:00000200:0.0:1773851862.101987:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851862.101988:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851862.101990:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851862.101993:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d0b Using peer 11426@kfi7(0x100000000000d0b)
00000800:00000200:0.0:1773851862.101995:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x100000000000d0b: rc=0
00000800:00000200:0.0:1773851862.101997:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d0b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851862.101999:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851862.102000:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e03b5417 refcount 2 to 11363@kfi7
00010000:00000001:0.0:1773851862.102000:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851862.102002:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.102002:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851862.102003:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a2901e1e x1859600568113088/t0(0) o400->cf92737d-a747-44ac-b7f8-8f7f96aa3b76@11363@kfi7:502/0 lens 224/224 e 0 to 0 dl 1773852617 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1196-0'
00000100:00100000:0.0:1773851862.102007:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2901e1e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:cf92737d-a747-44ac-b7f8-8f7f96aa3b76+57:39683:x1859600568113088:12345-11363@kfi7:400:default-tuolumne1196-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851862.102009:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11363@kfi7, seq: 1997541
00000100:00000040:0.0:1773851862.102010:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000056f13a76 : new rpc_count 1
00000100:00000001:0.0:1773851862.102011:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851862.102011:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851862.102012:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851862.102012:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851862.102013:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f8f6276b.
00000020:00000040:0.0:1773851862.102014:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000056f13a76 : new refcount 56
00000100:00000001:0.0:1773851862.102015:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851862.102019:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d0b TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851862.102021:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851862.102022:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11426@kfi7: PUT: OK
00000400:00000200:1.0:1773851862.102023:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f597ead9
00000400:00000010:1.0:1773851862.102024:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f597ead9.
00000100:00000001:1.0:1773851862.102025:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851862.102025:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851862.102026:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006c39318f nid 11426@kfi7 refs 2
00000800:00000200:1.0:1773851862.102027:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 11426@kfi7(00000000b4d870aa):0x0 lsk 3340 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d0b Transaction freed
00000800:00000200:22.0:1773851862.152227:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851862.152228:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851862.152229:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851862.152233:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851862.152235:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16627@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.152236:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16627@kfi7 : PUT - for me
00000400:00000200:22.0:1773851862.152237:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16627@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.152238:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a18ebcf nid 16627@kfi7 refs 1
00000400:00000200:22.0:1773851862.152239:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16627@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.152240:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a18ebcf nid 16627@kfi7 refs 2
00000400:00000200:22.0:1773851862.152241:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003a18ebcf nid 16627@kfi7 refs 3
00000400:00000200:22.0:1773851862.152242:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16435@kfi7 to cpt 3
00000400:00000200:22.0:1773851862.152243:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16435@kfi7 of length 224 into portal 12 MB=0x69b4b576f3cc0
00000400:00000200:22.0:1773851862.152244:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16435@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 31912
00000800:00000200:22.0:1773851862.152246:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851862.152248:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851862.152249:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16627@kfi7: PUT: OK
00000100:00000001:22.0:1773851862.152250:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851862.152251:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851862.152252:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003f7c9316.
00000100:00000040:22.0:1773851862.152252:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000003f7c9316 x1859597752024256 msgsize 224
00000100:00100000:22.0:1773851862.152254:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-16435@kfi7 (source: 12345-16627@kfi7)
00000100:00000001:22.0:1773851862.152255:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851862.152256:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:22.0:1773851862.152256:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003a18ebcf nid 16627@kfi7 refs 2
00000800:00000200:22.0:1773851862.152257:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851862.152258:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851862.152258:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851862.152259:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851862.152259:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851862.152260:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597752024256
00000020:00000001:23.0:1773851862.152261:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851862.152261:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822df
00000020:00000001:23.0:1773851862.152262:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851862.152265:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006af26a1c refcount=167
00000020:00000001:23.0:1773851862.152265:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139323341824 : -106934386209792 : ffff9ebe65e54c00)
00000020:00000001:23.0:1773851862.152266:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139323341824 : -106934386209792 : ffff9ebe65e54c00)
00000100:00000001:23.0:1773851862.152267:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.152268:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851862.152269:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094554af3.
00000020:00000010:23.0:1773851862.152270:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.152271:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851862.152271:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851862.152272:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851862.152272:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.152273:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851862.152274:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851862.152274:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.152275:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.152276:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851862.152276:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851862.152277:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851862.152277:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851862.152278:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16435@kfi7, seq: 1997958
00000100:00000040:23.0:1773851862.152278:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006af26a1c : new rpc_count 1
00000100:00000001:22.0:1773851862.152278:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.152279:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619636992 : -107003089914624 : ffff9eae66d5f500)
00000100:00000001:22.0:1773851862.152279:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.152280:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003f7c9316 x1859597752024256/t0(0) o400->2b7429a1-47e0-447d-b9d9-cf6f7a57e3f0@16435@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1513-0'
00000100:00000001:23.0:1773851862.152283:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.152283:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851862.152284:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f7c9316 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:2b7429a1-47e0-447d-b9d9-cf6f7a57e3f0+167:39588:x1859597752024256:12345-16435@kfi7:400:default-tuolumne1513-0
00000100:00000200:23.0:1773851862.152287:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597752024256
00000020:00000001:23.0:1773851862.152287:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851862.152288:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851862.152289:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.152289:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851862.152290:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851862.152291:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851862.152291:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597752024256, found 0 last_xid 1859597751600703
00000020:00000001:23.0:1773851862.152292:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851862.152293:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851862.152293:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851862.152294:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.152294:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851862.152295:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851862.152296:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851862.152296:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fb81c79b.
02000000:00000001:23.0:1773851862.152297:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.152298:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.152298:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851862.152299:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062910, transno 0, xid 1859597752024256
00010000:00000001:23.0:1773851862.152300:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851862.152300:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003f7c9316 x1859597752024256/t0(0) o400->2b7429a1-47e0-447d-b9d9-cf6f7a57e3f0@16435@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1513-0'
00010000:00000001:23.0:1773851862.152303:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851862.152303:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851862.152304:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=95 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851862.152305:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851862.152306:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000986e0b6e refcount 3 to 16435@kfi7
00000100:00000001:23.0:1773851862.152306:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902777056 : -107154806774560 : ffff9e8b13ce64e0)
02000000:00000001:23.0:1773851862.152307:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851862.152308:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.152308:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851862.152309:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16627@kfi7
00000400:00000010:23.0:1773851862.152310:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000427f6e00.
00000100:00000200:23.0:1773851862.152312:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597752024256, offset 224
00000400:00000200:23.0:1773851862.152313:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16627@kfi7
00000400:00000200:23.0:1773851862.152314:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16627@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.152314:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a18ebcf nid 16627@kfi7 refs 1
00000400:00000200:23.0:1773851862.152315:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003a18ebcf nid 16627@kfi7 refs 2
00000400:00000200:23.0:1773851862.152316:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003a18ebcf nid 16627@kfi7 refs 3
00000400:00000200:23.0:1773851862.152317:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16627@kfi7 local destination
00000400:00000200:23.0:1773851862.152318:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769021:8769021:1024:4294967295] 16627@kfi7 LPNI seq info [178810:178810:16:4294967295]
00000400:00000200:23.0:1773851862.152320:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003a18ebcf nid 16627@kfi7 refs 2
00000400:00000200:23.0:1773851862.152321:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16627@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.152322:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16627@kfi7(16627@kfi7:16627@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851862.152324:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003a18ebcf nid 16627@kfi7 refs 3
00000800:00000200:23.0:1773851862.152326:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851862.152327:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851862.152329:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851862.152331:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001075 Using peer 16627@kfi7(0x100000000001075)
00000800:00000200:23.0:1773851862.152334:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x100000000001075: rc=0
00000800:00000200:23.0:1773851862.152335:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001075 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851862.152337:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.152338:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000986e0b6e refcount 2 to 16435@kfi7
00010000:00000001:23.0:1773851862.152339:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851862.152339:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.152340:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851862.152340:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003f7c9316 x1859597752024256/t0(0) o400->2b7429a1-47e0-447d-b9d9-cf6f7a57e3f0@16435@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1513-0'
00000100:00100000:23.0:1773851862.152343:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f7c9316 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:2b7429a1-47e0-447d-b9d9-cf6f7a57e3f0+167:39588:x1859597752024256:12345-16435@kfi7:400:default-tuolumne1513-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000800:00000200:22.0:1773851862.152346:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001075 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851862.152349:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16435@kfi7, seq: 1997958
00000400:00000200:22.0:1773851862.152349:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:23.0:1773851862.152350:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006af26a1c : new rpc_count 0
00000400:00000200:22.0:1773851862.152350:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16627@kfi7: PUT: OK
00000100:00000001:23.0:1773851862.152351:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851862.152351:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851862.152351:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:22.0:1773851862.152351:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000427f6e00
00000400:00000010:22.0:1773851862.152351:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000427f6e00.
00000020:00000010:23.0:1773851862.152352:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000100:00000001:22.0:1773851862.152352:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851862.152352:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851862.152353:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094554af3.
00000400:00000200:22.0:1773851862.152353:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003a18ebcf nid 16627@kfi7 refs 2
00000020:00000040:23.0:1773851862.152354:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000006af26a1c : new refcount 166
00000100:00000001:23.0:1773851862.152354:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851862.152355:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 16627@kfi7(0000000059d0d93d):0x0 lsk 4214 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001075 Transaction freed
00010000:00000001:2.0:1773851862.153732:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851862.153733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851862.153734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851862.153735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851862.153736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851862.153737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851862.153738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851862.153739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851862.153739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.153744:0:61289:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:25.0:1773851862.153745:0:61289:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:25.0:1773851862.153745:0:61289:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:21.0:1773851862.170908:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.170910:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851862.170912:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851862.170916:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851862.170920:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.170922:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20986@kfi7 : PUT - for me
00000400:00000200:21.0:1773851862.170924:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.170925:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 1
00000400:00000200:21.0:1773851862.170927:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.170928:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000400:00000200:21.0:1773851862.170929:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 3
00000400:00000200:21.0:1773851862.170931:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.170933:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20986@kfi7 of length 224 into portal 12 MB=0x699de8ddd3340
00000400:00000200:21.0:1773851862.170935:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20986@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 32136
00000800:00000200:21.0:1773851862.170938:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851862.170941:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851862.170944:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20986@kfi7: PUT: OK
00000100:00000001:21.0:1773851862.170946:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851862.170946:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851862.170948:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004892225b.
00000100:00000040:21.0:1773851862.170949:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000004892225b x1858031002137408 msgsize 224
00000100:00100000:21.0:1773851862.170952:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20986@kfi7 (source: 12345-20986@kfi7)
00000100:00000001:21.0:1773851862.170954:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851862.170955:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000100:00000001:23.0:1773851862.170956:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851862.170957:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851862.170957:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851862.170958:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851862.170958:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851862.170959:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851862.170960:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031002137408
00000020:00000001:23.0:1773851862.170961:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851862.170961:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91062
00000020:00000001:23.0:1773851862.170962:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851862.170965:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000aa6e4bf0 refcount=6
00000020:00000001:23.0:1773851862.170966:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240095744 : -107152469455872 : ffff9e8b9f1f0c00)
00000020:00000001:23.0:1773851862.170967:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240095744 : -107152469455872 : ffff9e8b9f1f0c00)
00000100:00000001:23.0:1773851862.170968:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.170969:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851862.170970:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094554af3.
00000020:00000010:23.0:1773851862.170971:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.170972:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851862.170974:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851862.170974:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851862.170975:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.170976:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851862.170977:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851862.170977:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.170979:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.170981:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851862.170982:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851862.170982:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851862.170982:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851862.170983:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20986@kfi7, seq: 1997959
00000100:00000040:23.0:1773851862.170984:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000aa6e4bf0 : new rpc_count 1
00000100:00000001:22.0:1773851862.170984:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.170985:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637057733472640 : -107015976078976 : ffff9eab66c2b180)
00000100:00000001:22.0:1773851862.170985:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.170987:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004892225b x1858031002137408/t0(0) o400->b9b6a788-11b2-4162-b2fc-6c2e1055c266@20986@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne250-0'
00000100:00000001:23.0:1773851862.170991:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.170992:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851862.170993:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004892225b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b9b6a788-11b2-4162-b2fc-6c2e1055c266+6:47612:x1858031002137408:12345-20986@kfi7:400:default-tuolumne250-0
00000100:00000200:23.0:1773851862.170995:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031002137408
00000020:00000001:23.0:1773851862.170996:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851862.170997:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851862.170998:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.170999:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851862.170999:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851862.171000:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851862.171001:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031002137408, found 0 last_xid 1858031002137407
00000020:00000001:23.0:1773851862.171002:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851862.171003:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851862.171004:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851862.171004:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.171005:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851862.171006:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851862.171007:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851862.171009:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001364cdae.
02000000:00000001:23.0:1773851862.171010:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.171010:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.171011:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851862.171012:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858031002137408
00010000:00000001:23.0:1773851862.171013:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851862.171015:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004892225b x1858031002137408/t0(0) o400->b9b6a788-11b2-4162-b2fc-6c2e1055c266@20986@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne250-0'
00010000:00000001:23.0:1773851862.171023:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851862.171024:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851862.171025:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=95 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851862.171027:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851862.171028:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c294a03 refcount 5 to 20986@kfi7
00000100:00000001:23.0:1773851862.171029:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451616 : -107146752100000 : ffff9e8cf3e6f960)
02000000:00000001:23.0:1773851862.171030:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851862.171030:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.171031:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851862.171032:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20986@kfi7
00000400:00000010:23.0:1773851862.171033:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a2dbc8f9.
00000100:00000200:23.0:1773851862.171034:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031002137408, offset 224
00000400:00000200:23.0:1773851862.171036:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20986@kfi7
00000400:00000200:23.0:1773851862.171038:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.171039:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 1
00000400:00000200:23.0:1773851862.171040:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000400:00000200:23.0:1773851862.171042:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 3
00000400:00000200:23.0:1773851862.171043:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20986@kfi7 local destination
00000400:00000200:23.0:1773851862.171045:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769022:8769022:1024:4294967295] 20986@kfi7 LPNI seq info [24403:24403:16:4294967295]
00000400:00000200:23.0:1773851862.171046:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000400:00000200:23.0:1773851862.171047:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.171050:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20986@kfi7(20986@kfi7:20986@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851862.171051:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 3
00000800:00000200:23.0:1773851862.171053:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851862.171054:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851862.171056:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851862.171059:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1ff Using peer 20986@kfi7(0x1ff)
00000800:00000200:23.0:1773851862.171064:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x1ff: rc=0
00000800:00000200:23.0:1773851862.171065:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851862.171067:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.171067:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c294a03 refcount 4 to 20986@kfi7
00010000:00000001:23.0:1773851862.171068:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851862.171068:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.171069:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851862.171070:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004892225b x1858031002137408/t0(0) o400->b9b6a788-11b2-4162-b2fc-6c2e1055c266@20986@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne250-0'
00000100:00100000:23.0:1773851862.171072:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004892225b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b9b6a788-11b2-4162-b2fc-6c2e1055c266+6:47612:x1858031002137408:12345-20986@kfi7:400:default-tuolumne250-0 Request processed in 80us (122us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851862.171074:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20986@kfi7, seq: 1997959
00000100:00000040:23.0:1773851862.171075:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000aa6e4bf0 : new rpc_count 0
00000100:00000001:23.0:1773851862.171075:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851862.171076:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851862.171077:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.171077:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000800:00000200:21.0:1773851862.171077:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1ff TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851862.171078:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094554af3.
00000020:00000040:23.0:1773851862.171078:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000aa6e4bf0 : new refcount 5
00000100:00000001:23.0:1773851862.171079:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851862.171079:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851862.171080:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20986@kfi7: PUT: OK
00000400:00000200:21.0:1773851862.171081:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a2dbc8f9
00000400:00000010:21.0:1773851862.171082:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a2dbc8f9.
00000100:00000001:21.0:1773851862.171082:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851862.171083:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851862.171084:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000800:00000200:21.0:1773851862.171085:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 20986@kfi7(000000005ddd8b02):0x0 lsk 512 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1ff Transaction freed
00000800:00000200:21.0:1773851862.171194:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.171194:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851862.171195:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851862.171197:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851862.171199:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.171200:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20986@kfi7 : PUT - for me
00000400:00000200:21.0:1773851862.171201:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.171201:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 1
00000400:00000200:21.0:1773851862.171202:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.171203:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000400:00000200:21.0:1773851862.171204:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 3
00000400:00000200:21.0:1773851862.171205:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.171206:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20986@kfi7 of length 224 into portal 12 MB=0x699de8ddd3b00
00000400:00000200:21.0:1773851862.171207:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20986@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 32360
00000800:00000200:21.0:1773851862.171208:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851862.171210:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851862.171211:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20986@kfi7: PUT: OK
00000100:00000001:21.0:1773851862.171211:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851862.171212:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851862.171213:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000df01bf53.
00000100:00000040:21.0:1773851862.171214:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000df01bf53 x1858031002139392 msgsize 224
00000100:00100000:21.0:1773851862.171215:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20986@kfi7 (source: 12345-20986@kfi7)
00000100:00000001:21.0:1773851862.171216:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851862.171216:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000100:00000001:23.0:1773851862.171217:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851862.171217:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851862.171218:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851862.171218:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851862.171218:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851862.171219:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851862.171220:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031002139392
00000020:00000001:23.0:1773851862.171220:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851862.171220:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911f8
00000020:00000001:23.0:1773851862.171221:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851862.171223:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c5fdb54f refcount=6
00000020:00000001:23.0:1773851862.171223:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240543232 : -107152469008384 : ffff9e8b9f25e000)
00000020:00000001:23.0:1773851862.171225:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240543232 : -107152469008384 : ffff9e8b9f25e000)
00000100:00000001:23.0:1773851862.171225:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.171226:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851862.171227:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c7cc222.
00000020:00000010:23.0:1773851862.171228:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.171228:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851862.171229:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851862.171229:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851862.171230:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.171230:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851862.171231:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851862.171231:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.171232:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.171233:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851862.171233:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851862.171233:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851862.171234:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20986@kfi7, seq: 1997960
00000100:00000040:23.0:1773851862.171234:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c5fdb54f : new rpc_count 1
00000100:00000001:22.0:1773851862.171234:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851862.171234:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.171235:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132564937344 : -106941144614272 : ffff9ebcd3103a80)
00000100:00000001:22.0:1773851862.171235:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.171236:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000df01bf53 x1858031002139392/t0(0) o400->c1e159f0-5f10-4689-8f95-b15676ef9c89@20986@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne250-0'
00000100:00000001:23.0:1773851862.171238:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.171238:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851862.171239:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df01bf53 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:c1e159f0-5f10-4689-8f95-b15676ef9c89+6:47611:x1858031002139392:12345-20986@kfi7:400:default-tuolumne250-0
00000100:00000200:23.0:1773851862.171240:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031002139392
00000020:00000001:23.0:1773851862.171241:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851862.171241:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851862.171242:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.171242:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851862.171243:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851862.171243:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851862.171244:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031002139392, found 0 last_xid 1858031002139391
00000020:00000001:23.0:1773851862.171244:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851862.171246:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851862.171246:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851862.171246:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.171247:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851862.171247:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851862.171247:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851862.171248:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000094554af3.
02000000:00000001:23.0:1773851862.171248:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.171249:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.171249:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851862.171250:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768028, transno 0, xid 1858031002139392
00010000:00000001:23.0:1773851862.171251:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851862.171251:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000df01bf53 x1858031002139392/t0(0) o400->c1e159f0-5f10-4689-8f95-b15676ef9c89@20986@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne250-0'
00010000:00000001:23.0:1773851862.171254:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851862.171254:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851862.171254:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=95 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851862.171255:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851862.171256:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c294a03 refcount 5 to 20986@kfi7
00000100:00000001:23.0:1773851862.171256:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451616 : -107146752100000 : ffff9e8cf3e6f960)
02000000:00000001:23.0:1773851862.171257:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851862.171257:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.171258:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851862.171258:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20986@kfi7
00000400:00000010:23.0:1773851862.171259:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002ad30f6f.
00000100:00000200:23.0:1773851862.171259:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031002139392, offset 224
00000400:00000200:23.0:1773851862.171261:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20986@kfi7
00000400:00000200:23.0:1773851862.171261:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.171262:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 1
00000400:00000200:23.0:1773851862.171263:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000400:00000200:23.0:1773851862.171264:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 3
00000400:00000200:23.0:1773851862.171264:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20986@kfi7 local destination
00000400:00000200:23.0:1773851862.171266:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769023:8769023:1024:4294967295] 20986@kfi7 LPNI seq info [24404:24404:16:4294967295]
00000400:00000200:23.0:1773851862.171267:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000400:00000200:23.0:1773851862.171268:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20986@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.171270:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20986@kfi7(20986@kfi7:20986@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851862.171271:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 3
00000800:00000200:23.0:1773851862.171273:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851862.171274:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851862.171275:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851862.171277:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007a3 Using peer 20986@kfi7(0x1000000000007a3)
00000800:00000200:23.0:1773851862.171280:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x1000000000007a3: rc=0
00000800:00000200:23.0:1773851862.171281:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851862.171283:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.171283:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c294a03 refcount 4 to 20986@kfi7
00010000:00000001:23.0:1773851862.171284:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851862.171284:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.171285:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851862.171285:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000df01bf53 x1858031002139392/t0(0) o400->c1e159f0-5f10-4689-8f95-b15676ef9c89@20986@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne250-0'
00000100:00100000:23.0:1773851862.171288:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df01bf53 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:c1e159f0-5f10-4689-8f95-b15676ef9c89+6:47611:x1858031002139392:12345-20986@kfi7:400:default-tuolumne250-0 Request processed in 49us (73us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851862.171290:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20986@kfi7, seq: 1997960
00000100:00000040:23.0:1773851862.171291:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c5fdb54f : new rpc_count 0
00000800:00000200:21.0:1773851862.171291:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007a3 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851862.171292:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851862.171292:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851862.171292:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.171293:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851862.171293:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851862.171293:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20986@kfi7: PUT: OK
00000020:00000010:23.0:1773851862.171294:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c7cc222.
00000020:00000040:23.0:1773851862.171294:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000c5fdb54f : new refcount 5
00000400:00000200:21.0:1773851862.171294:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002ad30f6f
00000400:00000010:21.0:1773851862.171294:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002ad30f6f.
00000100:00000001:23.0:1773851862.171295:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851862.171295:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851862.171295:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851862.171296:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cffe7d20 nid 20986@kfi7 refs 2
00000800:00000200:21.0:1773851862.171297:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20986@kfi7(000000007769bed1):0x0 lsk 1956 rsk 90 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007a3 Transaction freed
00000800:00000200:18.0:1773851862.284954:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851862.284955:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851862.284955:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851862.284955:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851862.284956:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851862.284957:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851862.284958:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20627@kfi7(000000006c706324):0xb3b version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851862.284959:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851862.284960:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20627@kfi7 to cpt 4
00000800:00000200:17.0:1773851862.284960:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b Using peer 20627@kfi7(0xb3b)
00000400:00000200:18.0:1773851862.284962:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20627@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.284962:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20627@kfi7 to cpt 4
00000400:00000200:18.0:1773851862.284963:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20627@kfi7 to cpt 4
00000800:00000200:17.0:1773851862.284963:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0xb3b: rc=0
00000400:00000200:18.0:1773851862.284964:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 1
00000800:00000200:17.0:1773851862.284964:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851862.284966:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20627@kfi7 to cpt 4
00000400:00000200:18.0:1773851862.284966:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 2
00000400:00000200:18.0:1773851862.284967:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 3
00000400:00000200:18.0:1773851862.284968:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20626@kfi7 to cpt 1
00000400:00000200:18.0:1773851862.284969:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20626@kfi7 of length 336 into portal 17 MB=0x69b473821a440
00000400:00000200:18.0:1773851862.284971:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-20626@kfi7 of length 336/336 into md 0x6ab0f7c31 [2] + 776
00000800:00000200:18.0:1773851862.284972:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851862.284974:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851862.284975:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20627@kfi7: PUT: OK
00000100:00000001:18.0:1773851862.284976:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851862.284976:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:18.0:1773851862.284977:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a42500ca.
00000800:00000200:17.0:1773851862.284977:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851862.284978:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000a42500ca x1859580046976064 msgsize 336
00000800:00000200:17.0:1773851862.284979:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b Transaction freed
00000100:00100000:18.0:1773851862.284980:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-20626@kfi7 (source: 12345-20627@kfi7)
00000100:00000001:18.0:1773851862.284982:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851862.284982:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 2
00000800:00000200:18.0:1773851862.284984:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006c9a9e9c: 2069@kfi7:4 <- 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851862.284986:0:154717:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851862.284987:0:154717:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851862.284988:0:154717:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851862.284988:0:154717:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851862.284989:0:154717:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851862.284990:0:154717:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580046976064
00000020:00000001:18.0:1773851862.284990:0:154717:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851862.284990:0:154717:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dde0e9adf
00000020:00000001:18.0:1773851862.284991:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851862.284995:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000251a439c refcount=8
00000020:00000001:18.0:1773851862.284996:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637155351422976 : -106918358128640 : ffff9ec2213e6800)
00000020:00000001:18.0:1773851862.284997:0:154717:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637155351422976 : -106918358128640 : ffff9ec2213e6800)
00000100:00000001:18.0:1773851862.284998:0:154717:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851862.284998:0:154717:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851862.284999:0:154717:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0c86ad4.
00000020:00000010:18.0:1773851862.285000:0:154717:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851862.285001:0:154717:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004b65e428.
00000100:00000040:18.0:1773851862.285002:0:154717:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:18.0:1773851862.285003:0:154717:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851862.285003:0:154717:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:18.0:1773851862.285004:0:154717:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:18.0:1773851862.285004:0:154717:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285005:0:154717:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:18.0:1773851862.285006:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851862.285006:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851862.285007:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d6fd604e refcount=3
00000020:00000001:18.0:1773851862.285008:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105732348032 : -106967977203584 : ffff9eb693b76880)
00010000:00000001:18.0:1773851862.285009:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105732348032 : -106967977203584 : ffff9eb693b76880)
00010000:00000001:18.0:1773851862.285010:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285010:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285011:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851862.285012:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851862.285012:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008d71abe2 refcount=3
00000020:00000001:18.0:1773851862.285013:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105732347456 : -106967977204160 : ffff9eb693b76640)
00010000:00000001:18.0:1773851862.285013:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105732347456 : -106967977204160 : ffff9eb693b76640)
00010000:00000001:18.0:1773851862.285014:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285014:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285015:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851862.285015:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851862.285016:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000062815ce5 refcount=3
00000020:00000001:18.0:1773851862.285016:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962503743104 : -107111205808512 : ffff9e953aa05680)
00010000:00000001:18.0:1773851862.285017:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962503743104 : -107111205808512 : ffff9e953aa05680)
00010000:00000001:18.0:1773851862.285018:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285018:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285019:0:154717:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851862.285019:0:154717:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851862.285020:0:154717:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851862.285021:0:154717:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851862.285022:0:154717:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.285023:0:154220:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.285023:0:154220:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851862.285023:0:154717:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:18.0:1773851862.285024:0:154717:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20626@kfi7, seq: 38350203
00000100:00000001:19.0:1773851862.285025:0:154220:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851862.285025:0:154717:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000251a439c : new rpc_count 1
00000100:00000001:18.0:1773851862.285025:0:154717:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534661888 : -106946174889728 : ffff9ebba73c5100)
00000100:00000001:19.0:1773851862.285026:0:154220:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851862.285026:0:154717:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a42500ca x1859580046976064/t0(0) o103->6e922287-eb1b-4418-9256-5464348c892c@20626@kfi7:589/0 lens 336/0 e 0 to 0 dl 1773851949 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:18.0:1773851862.285029:0:154717:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851862.285030:0:154717:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:18.0:1773851862.285030:0:154717:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a42500ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_011:6e922287-eb1b-4418-9256-5464348c892c+8:39707:x1859580046976064:12345-20626@kfi7:103:
00000100:00000200:18.0:1773851862.285032:0:154717:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580046976064
00010000:00000001:18.0:1773851862.285032:0:154717:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:18.0:1773851862.285033:0:154717:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:18.0:1773851862.285033:0:154717:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:18.0:1773851862.285035:0:154717:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:18.0:1773851862.285035:0:154717:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:18.0:1773851862.285036:0:154717:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d2c34f1.
02000000:00000001:18.0:1773851862.285037:0:154717:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851862.285037:0:154717:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285038:0:154717:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:18.0:1773851862.285039:0:154717:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00000001:18.0:1773851862.285039:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851862.285040:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851862.285040:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d6fd604e refcount=3
00000020:00000001:18.0:1773851862.285041:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105732348032 : -106967977203584 : ffff9eb693b76880)
00010000:00000001:18.0:1773851862.285041:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105732348032 : -106967977203584 : ffff9eb693b76880)
00010000:00000040:18.0:1773851862.285042:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 196
00000004:00000001:18.0:1773851862.285043:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851862.285043:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851862.285044:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851862.285045:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851862.285045:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851862.285046:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285047:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851862.285048:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851862.285049:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285049:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285050:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851862.285050:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851862.285051:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d6fd604e with handle 0x21b6f08f07a4d7f9 from hash
00010000:00000001:18.0:1773851862.285052:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851862.285052:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285053:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285053:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851862.285054:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851862.285054:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285055:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851862.285055:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851862.285056:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6fd604e/0x21b6f08f07a4d7f9 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x44a01000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b927b expref: 8 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851862.285059:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 196
00010000:00000040:18.0:1773851862.285060:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000251a439c : new locks_count 2
00000020:00000040:18.0:1773851862.285061:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000251a439c : new refcount 7
00010000:00000010:18.0:1773851862.285061:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000f2299b7c.
00010000:00000040:18.0:1773851862.285062:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:18.0:1773851862.285063:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285063:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851862.285064:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851862.285064:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008d71abe2 refcount=3
00000020:00000001:18.0:1773851862.285065:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105732347456 : -106967977204160 : ffff9eb693b76640)
00010000:00000001:18.0:1773851862.285065:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637105732347456 : -106967977204160 : ffff9eb693b76640)
00010000:00000001:18.0:1773851862.285066:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851862.285067:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851862.285067:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:18.0:1773851862.285068:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851862.285069:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285069:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851862.285070:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000040:18.0:1773851862.285071:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 231
00000004:00000001:18.0:1773851862.285071:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851862.285072:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851862.285072:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851862.285073:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851862.285073:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851862.285073:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285075:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851862.285075:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851862.285076:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285076:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285077:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851862.285077:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851862.285077:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000008d71abe2 with handle 0x21b6f08f07a4d7eb from hash
00010000:00000001:18.0:1773851862.285078:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851862.285079:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285079:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285079:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851862.285080:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851862.285080:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285081:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851862.285081:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851862.285082:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000008d71abe2/0x21b6f08f07a4d7eb lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 232 type: IBT gid 0 flags: 0x44a01000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b9251 expref: 7 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851862.285084:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 231
00010000:00000040:18.0:1773851862.285084:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000251a439c : new locks_count 1
00000020:00000040:18.0:1773851862.285085:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000251a439c : new refcount 6
00010000:00000010:18.0:1773851862.285085:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000008ec69933.
00010000:00000040:18.0:1773851862.285086:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00010000:00000001:18.0:1773851862.285087:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285087:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851862.285087:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851862.285087:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000062815ce5 refcount=3
00000020:00000001:18.0:1773851862.285088:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962503743104 : -107111205808512 : ffff9e953aa05680)
00010000:00000001:18.0:1773851862.285089:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962503743104 : -107111205808512 : ffff9e953aa05680)
00010000:00000001:18.0:1773851862.285089:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851862.285090:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851862.285090:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:18.0:1773851862.285091:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851862.285092:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285092:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851862.285092:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:18.0:1773851862.285093:0:154717:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 196
00000004:00000001:18.0:1773851862.285094:0:154717:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:18.0:1773851862.285094:0:154717:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:18.0:1773851862.285095:0:154717:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:18.0:1773851862.285095:0:154717:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:18.0:1773851862.285095:0:154717:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:18.0:1773851862.285096:0:154717:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285097:0:154717:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:18.0:1773851862.285098:0:154717:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:18.0:1773851862.285099:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285099:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285100:0:154717:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:18.0:1773851862.285100:0:154717:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:18.0:1773851862.285101:0:154717:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000062815ce5 with handle 0x21b6f08f07a4d7cf from hash
00010000:00000001:18.0:1773851862.285102:0:154717:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:18.0:1773851862.285102:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851862.285102:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285103:0:154717:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:18.0:1773851862.285103:0:154717:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:18.0:1773851862.285103:0:154717:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285104:0:154717:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:18.0:1773851862.285104:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:18.0:1773851862.285105:0:154717:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000062815ce5/0x21b6f08f07a4d7cf lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x44a01000000000 nid: 20626@kfi7 remote: 0x7f056d0f1b924a expref: 6 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:18.0:1773851862.285107:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:18.0:1773851862.285108:0:154717:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000251a439c : new locks_count 0
00000020:00000040:18.0:1773851862.285108:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000251a439c : new refcount 5
00010000:00000010:18.0:1773851862.285109:0:154717:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000054843ea9.
00010000:00000040:18.0:1773851862.285109:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:18.0:1773851862.285110:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851862.285110:0:154717:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:18.0:1773851862.285111:0:154717:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:18.0:1773851862.285111:0:154717:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:18.0:1773851862.285112:0:154717:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:18.0:1773851862.285112:0:154717:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285113:0:154717:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:18.0:1773851862.285114:0:154717:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00010000:18.0:1773851862.285114:0:154717:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:18.0:1773851862.285115:0:154717:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=3 : 3 : 3)
00010000:00000001:18.0:1773851862.285116:0:154717:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:18.0:1773851862.285117:0:154717:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:18.0:1773851862.285118:0:154717:0:(import.c:1951:at_measured()) add 1 to 000000001a540702 time=116 v=66 (1 0 0 1)
00000100:00000001:18.0:1773851862.285119:0:154717:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:18.0:1773851862.285120:0:154717:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006590ccfa refcount 3 to 20626@kfi7
00000100:00000001:18.0:1773851862.285121:0:154717:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232982016 : -107130476569600 : ffff9e90bdffdc00)
02000000:00000001:18.0:1773851862.285122:0:154717:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:18.0:1773851862.285122:0:154717:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851862.285123:0:154717:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:18.0:1773851862.285124:0:154717:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20627@kfi7
00000400:00000010:18.0:1773851862.285125:0:154717:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006f6119f8.
00000100:00000200:18.0:1773851862.285126:0:154717:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859580046976064, offset 224
00000400:00000200:18.0:1773851862.285127:0:154717:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20627@kfi7
00000400:00000200:18.0:1773851862.285128:0:154717:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20627@kfi7 to cpt 4
00000400:00000200:18.0:1773851862.285129:0:154717:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 1
00000400:00000200:18.0:1773851862.285130:0:154717:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 2
00000400:00000200:18.0:1773851862.285131:0:154717:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 3
00000400:00000200:18.0:1773851862.285133:0:154717:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20627@kfi7 local destination
00000400:00000200:18.0:1773851862.285134:0:154717:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769024:8769024:1024:4294967295] 20627@kfi7 LPNI seq info [9242467:9242467:16:4294967295]
00000400:00000200:18.0:1773851862.285136:0:154717:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 2
00000400:00000200:18.0:1773851862.285137:0:154717:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20627@kfi7 to cpt 4
00000400:00000200:18.0:1773851862.285139:0:154717:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20627@kfi7(20627@kfi7:20627@kfi7) <?> : PUT try# 0
00000400:00000200:18.0:1773851862.285140:0:154717:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 3
00000800:00000200:18.0:1773851862.285142:0:154717:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851862.285143:0:154717:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:18.0:1773851862.285145:0:154717:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851862.285148:0:154717:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b Using peer 20627@kfi7(0xb3b)
00000800:00000200:18.0:1773851862.285151:0:154717:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000006c9a9e9c: Posted send of 324 bytes to peer 0xb3b: rc=0
00000800:00000200:18.0:1773851862.285153:0:154717:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:18.0:1773851862.285155:0:154717:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851862.285156:0:154717:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006590ccfa refcount 2 to 20626@kfi7
00010000:00000001:18.0:1773851862.285158:0:154717:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851862.285158:0:154717:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851862.285159:0:154717:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a42500ca x1859580046976064/t0(0) o103->6e922287-eb1b-4418-9256-5464348c892c@20626@kfi7:589/0 lens 336/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:18.0:1773851862.285163:0:154717:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a42500ca pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_011:6e922287-eb1b-4418-9256-5464348c892c+5:39707:x1859580046976064:12345-20626@kfi7:103: Request processed in 133us (184us total) trans 0 rc 0/0
00000100:00100000:18.0:1773851862.285166:0:154717:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20626@kfi7, seq: 38350203
00000800:00000200:17.0:1773851862.285166:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851862.285167:0:154717:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000251a439c : new rpc_count 0
00000400:00000200:17.0:1773851862.285168:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:18.0:1773851862.285169:0:154717:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851862.285170:0:154717:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:18.0:1773851862.285170:0:154717:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000200:17.0:1773851862.285170:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20627@kfi7: PUT: OK
00000400:00000200:17.0:1773851862.285171:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006f6119f8
00000020:00000010:18.0:1773851862.285172:0:154717:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004b65e428.
00000400:00000010:17.0:1773851862.285172:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006f6119f8.
00000100:00000001:17.0:1773851862.285172:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:18.0:1773851862.285173:0:154717:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0c86ad4.
00000100:00000001:17.0:1773851862.285173:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:18.0:1773851862.285174:0:154717:0:(genops.c:882:class_export_put()) PUTting export 00000000251a439c : new refcount 4
00000400:00000200:17.0:1773851862.285174:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8bfd1fd nid 20627@kfi7 refs 2
00000100:00000001:18.0:1773851862.285175:0:154717:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851862.285176:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c9a9e9c: 2069@kfi7:4 -> 20627@kfi7(000000006c706324):0x0 lsk 2876 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0xb3b Transaction freed
00010000:00000010:18.1:1773851862.290727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d6fd604e.
00010000:00000010:18.1:1773851862.290729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000008d71abe2.
00010000:00000010:18.1:1773851862.290729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000062815ce5.
00000004:00000001:11.0:1773851862.345731:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851862.345731:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851862.345732:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851862.345732:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851862.345732:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c778dfc2.
00000100:00000010:11.0:1773851862.345733:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000432d25da.
00000020:00000040:10.0:1773851862.345733:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000020:00000040:11.0:1773851862.345734:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000100:00000001:11.0:1773851862.345735:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851862.345735:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851862.345735:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851862.345735:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851862.345736:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851862.345736:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851862.345738:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004f719342.
02000000:00000010:10.0:1773851862.345738:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000f701454e.
00000100:00000001:11.0:1773851862.345739:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851862.345739:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851862.345740:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851862.345740:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851862.345741:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851862.345741:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851862.345742:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000432d25da] to pc [ptlrpcd_02_03+3]  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851862.345742:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c778dfc2] to pc [ptlrpcd_02_00+0]  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:10.0:1773851862.345748:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.345748:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:11.0:1773851862.345749:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.345749:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851862.345750:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851862.345751:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:8.0:1773851862.345751:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851862.345752:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851862.345752:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:10.0:1773851862.345753:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851862.345753:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.345753:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851862.345754:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851862.345754:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.345754:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851862.345755:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.345756:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:8.0:1773851862.345756:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:9.0:1773851862.345757:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.345757:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.345758:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851862.345758:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851862.345758:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c778dfc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051926144:12@kfi7:13:default-yuba2-0
00000100:00100000:9.0:1773851862.345759:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000432d25da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051926080:42@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851862.345760:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851862.345760:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:9.0:1773851862.345761:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851862.345761:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851862.345761:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.345762:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.345762:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:9.0:1773851862.345763:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851862.345763:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d9f9a1c1.
02000000:00000010:8.0:1773851862.345763:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003e1bc6ec.
02000000:00000001:9.0:1773851862.345764:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.345764:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851862.345765:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:9.0:1773851862.345766:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000200:8.0:1773851862.345766:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:9.0:1773851862.345767:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052ffe31c.
00000400:00000010:8.0:1773851862.345767:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000100:00000200:9.0:1773851862.345768:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926080, portal 4
00000400:00000010:8.0:1773851862.345768:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000100:00000001:9.0:1773851862.345769:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:8.0:1773851862.345769:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926144, portal 4
00000100:00000001:9.0:1773851862.345770:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889205760 : -106993820345856 : ffff9eb08f585a00)
00000100:00000001:8.0:1773851862.345770:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851862.345770:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637043610180096 : -107030099371520 : ffff9ea81cf25a00)
00000100:00000040:9.0:1773851862.345771:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851862.345772:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851862.345774:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851862.345774:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851862.345775:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000100:00000040:8.0:1773851862.345775:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:9.0:1773851862.345776:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000096f4c744.
00000100:00000200:9.0:1773851862.345776:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926080, offset 0
00000400:00000010:8.0:1773851862.345776:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e5dfdd1.
00000100:00000200:8.0:1773851862.345777:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926144, offset 0
00000400:00000200:9.0:1773851862.345778:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:9.0:1773851862.345779:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851862.345779:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:9.0:1773851862.345780:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:9.0:1773851862.345781:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851862.345782:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:9.0:1773851862.345783:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:9.0:1773851862.345785:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769024, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769023, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851862.345787:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851862.345788:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851862.345789:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:9.0:1773851862.345790:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769025:8769025:1024:4294967295] 42@kfi7 LPNI seq info [5404896:5404896:16:4294967295]
00000400:00000200:9.0:1773851862.345791:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851862.345792:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851862.345794:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851862.345794:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851862.345795:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851862.345796:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851862.345797:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:8.0:1773851862.345797:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:9.0:1773851862.345798:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:8.0:1773851862.345798:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000800:00000200:9.0:1773851862.345799:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:8.0:1773851862.345800:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769024, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769025, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851862.345802:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:8.0:1773851862.345802:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851862.345803:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851862.345804:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000800:00000200:9.0:1773851862.345805:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Using peer 42@kfi7(0x200000000000183)
00000400:00000200:8.0:1773851862.345805:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769026:8769026:1024:4294967295] 12@kfi7 LPNI seq info [5403455:5403455:16:4294967295]
00000400:00000200:8.0:1773851862.345807:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:9.0:1773851862.345808:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x200000000000183: rc=0
00000400:00000200:8.0:1773851862.345808:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:9.0:1773851862.345810:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:8.0:1773851862.345810:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851862.345811:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000100:00000001:9.0:1773851862.345812:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.345813:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851862.345813:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851862.345813:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:9.0:1773851862.345814:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851862.345814:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851862.345815:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.345816:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851862.345817:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851862.345818:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851862.345818:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851862.345819:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.345819:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851862.345824:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_EVENT_TX_OK event status 0
00000800:00000200:8.0:1773851862.345824:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851862.345826:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:8.0:1773851862.345826:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Using peer 12@kfi7(0x47e)
00000400:00000200:9.0:1773851862.345827:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000400:00000200:9.0:1773851862.345828:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000096f4c744
00000400:00000010:9.0:1773851862.345829:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000096f4c744.
00000100:00000001:9.0:1773851862.345829:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:8.0:1773851862.345829:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x47e: rc=0
00000100:00000200:9.0:1773851862.345830:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851862.345830:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851862.345832:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.345833:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851862.345833:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851862.345833:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.345834:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.345834:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.345835:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.345836:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.345836:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851862.345836:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851862.345837:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:8.0:1773851862.345837:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851862.345837:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851862.345838:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:9.0:1773851862.345839:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Transaction freed
00000100:00000001:8.0:1773851862.345840:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851862.345841:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851862.345841:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851862.345843:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851862.345844:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000400:00000200:10.0:1773851862.345844:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e5dfdd1
00000400:00000010:10.0:1773851862.345845:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e5dfdd1.
00000100:00000001:10.0:1773851862.345845:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851862.345846:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851862.345849:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851862.345849:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851862.345852:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851862.345853:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851862.345854:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:10.0:1773851862.345855:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Transaction freed
00000800:00000200:25.0:1773851862.345859:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.345859:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851862.345861:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851862.345863:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851862.345864:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.345866:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851862.345866:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.345867:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851862.345868:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.345869:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:25.0:1773851862.345870:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851862.345871:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.345871:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2e40
00000400:00000200:25.0:1773851862.345873:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.345875:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b81f79 [1] + 224
00000800:00000200:25.0:1773851862.345877:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851862.345878:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.345879:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851862.345880:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851862.345881:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851862.345884:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851862.345888:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:25.0:1773851862.345889:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:25.0:1773851862.345890:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851862.345890:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851862.345890:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:9.0:1773851862.345891:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851862.345892:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851862.345892:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000800:00000200:11.0:1773851862.345893:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851862.345893:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052ffe31c
00000800:00000200:11.0:1773851862.345894:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000010:9.0:1773851862.345894:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052ffe31c.
00000100:00000001:9.0:1773851862.345894:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:11.0:1773851862.345895:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:9.0:1773851862.345895:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851862.345898:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:9.0:1773851862.345898:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851862.345900:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:11.0:1773851862.345901:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12@kfi7 : PUT - for me
00000100:00000001:9.0:1773851862.345901:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851862.345901:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:11.0:1773851862.345902:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:9.0:1773851862.345902:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851862.345902:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:11.0:1773851862.345903:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000100:00000001:9.0:1773851862.345903:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851862.345903:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851862.345904:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:11.0:1773851862.345904:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
02000000:00000001:9.0:1773851862.345904:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851862.345905:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000100:00001000:9.0:1773851862.345905:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=95 v=66 (66 66 66 66)
00000400:00000200:11.0:1773851862.345906:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00001000:9.0:1773851862.345906:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=95 v=66 (1 1 1 1)
00000400:00000200:11.0:1773851862.345907:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2e80
00000100:00000001:9.0:1773851862.345907:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851862.345907:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851862.345908:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00010000:00000001:9.0:1773851862.345908:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:11.0:1773851862.345909:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781697509 [1] + 224
00010000:00000001:9.0:1773851862.345909:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.345909:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851862.345910:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000001:9.0:1773851862.345910:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851862.345911:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851862.345912:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:9.0:1773851862.345912:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:11.0:1773851862.345914:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851862.345914:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:11.0:1773851862.345915:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851862.345915:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851862.345915:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851862.345916:0:2510946:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:9.0:1773851862.345916:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:11.0:1773851862.345917:0:2510946:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:9.0:1773851862.345917:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851862.345917:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351378948096 avail=351375970304 avail_mb=1372562384 hwm_mb=3131103 files=372019050 ffree=343143504 state=0: rc = 0
00000004:00000020:9.0:1773851862.345919:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351378948096 free, 351375970304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019050 files, 343143504 free files
00000100:00000040:11.0:1773851862.345921:0:2510946:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:9.0:1773851862.345921:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.345922:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851862.345924:0:2510946:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00100000:9.0:1773851862.345924:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000432d25da pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051926080:42@kfi7:13:default-yuba2-0
00000400:00000200:11.0:1773851862.345925:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:8.0:1773851862.345925:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851862.345925:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851862.345926:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:8.0:1773851862.345926:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851862.345926:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:11.0:1773851862.345927:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851862.345927:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851862.345927:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000432d25da x1859433051926080/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:8.0:1773851862.345927:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000400:00000200:8.0:1773851862.345927:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000010:8.0:1773851862.345928:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000100:00000001:8.0:1773851862.345928:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851862.345929:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:8.0:1773851862.345929:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851862.345930:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851862.345930:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d9f9a1c1.
02000000:00000001:9.0:1773851862.345931:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851862.345932:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851862.345932:0:41071:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000100:00000200:8.0:1773851862.345932:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:9.0:1773851862.345933:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851862.345933:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004f719342.
02000000:00000001:9.0:1773851862.345934:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851862.345934:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:9.0:1773851862.345935:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851862.345935:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000432d25da.
00000100:00000001:8.0:1773851862.345935:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851862.345935:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:9.0:1773851862.345936:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851862.345936:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851862.345936:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851862.345936:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851862.345937:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851862.345937:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.345937:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.345938:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851862.345938:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851862.345938:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=95 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851862.345939:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851862.345939:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851862.345939:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=95 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851862.345940:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851862.345941:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851862.345941:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851862.345942:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.345943:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851862.345943:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:8.0:1773851862.345944:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851862.345944:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851862.345945:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.345947:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851862.345948:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851862.345948:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851862.345949:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851862.345950:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851862.345950:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541614592 avail=351539512320 avail_mb=1373201220 hwm_mb=3131101 files=372136793 ffree=343302358 state=0: rc = 0
00000004:00000020:8.0:1773851862.345952:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541614592 free, 351539512320 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136793 files, 343302358 free files
00000004:00000001:8.0:1773851862.345953:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851862.345954:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:8.0:1773851862.345957:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c778dfc2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051926144:12@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851862.345958:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851862.345959:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851862.345960:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c778dfc2 x1859433051926144/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.345962:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851862.345963:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851862.345963:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003e1bc6ec.
02000000:00000001:8.0:1773851862.345964:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851862.345964:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851862.345964:0:41068:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:8.0:1773851862.345965:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851862.345965:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000f701454e.
02000000:00000001:8.0:1773851862.345966:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851862.345967:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851862.345967:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c778dfc2.
00000100:00000001:8.0:1773851862.345968:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851862.345968:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851862.345969:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851862.345969:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851862.345970:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.345970:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851862.345971:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851862.376312:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851862.376312:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851862.376313:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851862.376313:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851862.376315:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851862.376315:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:29.0:1773851862.376316:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17282@kfi7(00000000682e496b):0xd63 version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851862.376317:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851862.376318:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 Using peer 17282@kfi7(0x100000000000d63)
00000400:00000200:30.0:1773851862.376319:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17282@kfi7 to cpt 7
00000400:00000200:30.0:1773851862.376320:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17282@kfi7 : PUT - for me
00000400:00000200:29.0:1773851862.376320:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17282@kfi7 to cpt 7
00000400:00000200:30.0:1773851862.376321:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17282@kfi7 to cpt 7
00000400:00000200:30.0:1773851862.376321:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034a48512 nid 17282@kfi7 refs 1
00000800:00000200:29.0:1773851862.376322:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 38 bytes to peer 0x100000000000d63: rc=0
00000400:00000200:30.0:1773851862.376323:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17282@kfi7 to cpt 7
00000400:00000200:30.0:1773851862.376324:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034a48512 nid 17282@kfi7 refs 2
00000400:00000200:30.0:1773851862.376324:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000034a48512 nid 17282@kfi7 refs 3
00000800:00000200:29.0:1773851862.376324:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851862.376325:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17283@kfi7 to cpt 2
00000400:00000200:30.0:1773851862.376326:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17283@kfi7 of length 224 into portal 12 MB=0x69b4b85fac800
00000400:00000200:30.0:1773851862.376327:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17283@kfi7 of length 224/224 into md 0x77fe139dd [64] + 171048
00000800:00000200:30.0:1773851862.376329:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851862.376331:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851862.376332:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17282@kfi7: PUT: OK
00000100:00000001:30.0:1773851862.376333:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851862.376333:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851862.376334:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004f53da15.
00000100:00000040:30.0:1773851862.376335:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000004f53da15 x1859598532921344 msgsize 224
00000100:00100000:30.0:1773851862.376337:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-17283@kfi7 (source: 12345-17282@kfi7)
00000100:00000001:30.0:1773851862.376337:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:31.0:1773851862.376338:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851862.376338:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000034a48512 nid 17282@kfi7 refs 2
00000100:00000001:28.0:1773851862.376339:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:31.0:1773851862.376340:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 Transaction freed
00000800:00000200:30.0:1773851862.376340:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851862.376340:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851862.376340:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851862.376342:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851862.376343:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851862.376344:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598532921344
00000020:00000001:28.0:1773851862.376344:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851862.376345:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d803eb
00000020:00000001:28.0:1773851862.376345:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851862.376347:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000060896fc5 refcount=167
00000020:00000001:28.0:1773851862.376348:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636992402818048 : -107081306733568 : ffff9e9c30c00400)
00000020:00000001:28.0:1773851862.376349:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636992402818048 : -107081306733568 : ffff9e9c30c00400)
00000100:00000001:28.0:1773851862.376350:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851862.376351:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851862.376351:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9820241.
00000020:00000010:28.0:1773851862.376352:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851862.376353:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003e75757e.
00000100:00000001:28.0:1773851862.376354:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851862.376355:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851862.376355:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851862.376356:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851862.376357:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851862.376357:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.376358:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851862.376359:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851862.376360:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851862.376360:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851862.376361:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851862.376361:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17283@kfi7, seq: 2055500
00000100:00000001:31.0:1773851862.376362:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.376362:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000060896fc5 : new rpc_count 1
00000100:00000001:31.0:1773851862.376363:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.376363:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832814208 : -106933876737408 : ffff9ebe84433a80)
00000100:00000040:28.0:1773851862.376364:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004f53da15 x1859598532921344/t0(0) o400->e1c6b307-b697-4dc3-a988-697985ba3742@17283@kfi7:650/0 lens 224/0 e 0 to 0 dl 1773852010 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1576-0'
00000100:00000001:28.0:1773851862.376366:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851862.376366:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851862.376367:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f53da15 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e1c6b307-b697-4dc3-a988-697985ba3742+167:39518:x1859598532921344:12345-17283@kfi7:400:default-tuolumne1576-0
00000100:00000200:28.0:1773851862.376369:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598532921344
00000020:00000001:28.0:1773851862.376371:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851862.376371:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851862.376372:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.376373:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851862.376373:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851862.376374:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851862.376375:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598532921344, found 0 last_xid 1859598532498879
00000020:00000001:28.0:1773851862.376375:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851862.376376:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851862.376376:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851862.376377:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.376378:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851862.376378:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851862.376379:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851862.376380:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008fa1195c.
02000000:00000001:28.0:1773851862.376380:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.376381:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.376382:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851862.376382:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062490, transno 0, xid 1859598532921344
00010000:00000001:28.0:1773851862.376383:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851862.376384:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004f53da15 x1859598532921344/t0(0) o400->e1c6b307-b697-4dc3-a988-697985ba3742@17283@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1576-0'
00010000:00000001:28.0:1773851862.376386:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851862.376387:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851862.376387:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=95 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851862.376388:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851862.376389:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000044d3468f refcount 3 to 17283@kfi7
00000100:00000001:28.0:1773851862.376390:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994448064 : -107149715103552 : ffff9e8c434b20c0)
02000000:00000001:28.0:1773851862.376391:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851862.376391:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.376392:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851862.376393:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17282@kfi7
00000400:00000010:28.0:1773851862.376394:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088fd99e5.
00000100:00000200:28.0:1773851862.376395:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598532921344, offset 224
00000400:00000200:28.0:1773851862.376396:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17282@kfi7
00000400:00000200:28.0:1773851862.376398:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17282@kfi7 to cpt 7
00000400:00000200:28.0:1773851862.376398:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034a48512 nid 17282@kfi7 refs 1
00000400:00000200:28.0:1773851862.376399:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000034a48512 nid 17282@kfi7 refs 2
00000400:00000200:28.0:1773851862.376401:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000034a48512 nid 17282@kfi7 refs 3
00000400:00000200:28.0:1773851862.376402:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17282@kfi7 local destination
00000400:00000200:28.0:1773851862.376403:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769027:8769027:1024:4294967295] 17282@kfi7 LPNI seq info [8458433:8458433:16:4294967295]
00000400:00000200:28.0:1773851862.376405:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000034a48512 nid 17282@kfi7 refs 2
00000400:00000200:28.0:1773851862.376405:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17282@kfi7 to cpt 7
00000400:00000200:28.0:1773851862.376407:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17282@kfi7(17282@kfi7:17282@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851862.376408:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000034a48512 nid 17282@kfi7 refs 3
00000800:00000200:28.0:1773851862.376410:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851862.376411:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851862.376413:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851862.376415:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 Using peer 17282@kfi7(0x100000000000d63)
00000800:00000200:28.0:1773851862.376418:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x100000000000d63: rc=0
00000800:00000200:28.0:1773851862.376419:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851862.376421:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.376422:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000044d3468f refcount 2 to 17283@kfi7
00010000:00000001:28.0:1773851862.376423:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851862.376423:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.376424:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851862.376425:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004f53da15 x1859598532921344/t0(0) o400->e1c6b307-b697-4dc3-a988-697985ba3742@17283@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1576-0'
00000100:00100000:28.0:1773851862.376429:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f53da15 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e1c6b307-b697-4dc3-a988-697985ba3742+167:39518:x1859598532921344:12345-17283@kfi7:400:default-tuolumne1576-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851862.376434:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17283@kfi7, seq: 2055500
00000100:00000040:28.0:1773851862.376435:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000060896fc5 : new rpc_count 0
00000100:00000001:28.0:1773851862.376436:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851862.376436:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851862.376437:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851862.376438:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003e75757e.
00000020:00000010:28.0:1773851862.376438:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9820241.
00000020:00000040:28.0:1773851862.376439:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000060896fc5 : new refcount 166
00000100:00000001:28.0:1773851862.376440:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851862.376445:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851862.376446:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.376447:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17282@kfi7: PUT: OK
00000400:00000200:29.0:1773851862.376449:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088fd99e5
00000400:00000010:29.0:1773851862.376449:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088fd99e5.
00000100:00000001:29.0:1773851862.376450:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851862.376450:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851862.376451:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000034a48512 nid 17282@kfi7 refs 2
00000800:00000200:29.0:1773851862.376452:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17282@kfi7(00000000682e496b):0x0 lsk 3428 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d63 Transaction freed
00000800:00000200:25.0:1773851862.382142:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.382144:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851862.382146:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851862.382149:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851862.382153:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.382154:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10234@kfi7 : PUT - for me
00000400:00000200:25.0:1773851862.382156:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.382157:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 1
00000400:00000200:25.0:1773851862.382159:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.382160:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000400:00000200:25.0:1773851862.382161:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 3
00000400:00000200:25.0:1773851862.382163:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.382164:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10234@kfi7 of length 224 into portal 12 MB=0x699de8e7a0200
00000400:00000200:25.0:1773851862.382167:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10234@kfi7 of length 224/224 into md 0x16159c6179 [64] + 194040
00000800:00000200:25.0:1773851862.382169:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851862.382173:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.382174:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10234@kfi7: PUT: OK
00000100:00000001:25.0:1773851862.382176:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851862.382176:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851862.382178:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bd36394d.
00000100:00000040:25.0:1773851862.382179:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bd36394d x1858031012413952 msgsize 224
00000100:00100000:25.0:1773851862.382181:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10234@kfi7 (source: 12345-10234@kfi7)
00000100:00000001:25.0:1773851862.382183:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851862.382184:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000100:00000001:24.0:1773851862.382185:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851862.382186:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851862.382187:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851862.382187:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851862.382188:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851862.382189:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851862.382190:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031012413952
00000020:00000001:24.0:1773851862.382191:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851862.382191:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910fc
00000020:00000001:24.0:1773851862.382192:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851862.382194:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000031e31796 refcount=6
00000020:00000001:24.0:1773851862.382196:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240336384 : -107152469215232 : ffff9e8b9f22b800)
00000020:00000001:24.0:1773851862.382197:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240336384 : -107152469215232 : ffff9e8b9f22b800)
00000100:00000001:24.0:1773851862.382198:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851862.382200:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851862.382201:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851862.382203:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851862.382204:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851862.382205:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851862.382206:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851862.382207:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851862.382208:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851862.382209:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851862.382209:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.382211:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.382213:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.382213:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.382213:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851862.382214:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851862.382215:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10234@kfi7, seq: 2025078
00000100:00000001:25.0:1773851862.382216:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851862.382216:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000031e31796 : new rpc_count 1
00000100:00000001:25.0:1773851862.382217:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.382217:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478760448 : -106938230791168 : ffff9ebd80bda400)
00000100:00000040:24.0:1773851862.382219:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bd36394d x1858031012413952/t0(0) o400->43133e37-2809-4fba-b229-c5c475001cc2@10234@kfi7:79/0 lens 224/0 e 0 to 0 dl 1773852194 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne208-0'
00000100:00000001:24.0:1773851862.382224:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851862.382224:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851862.382226:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd36394d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:43133e37-2809-4fba-b229-c5c475001cc2+6:47875:x1858031012413952:12345-10234@kfi7:400:default-tuolumne208-0
00000100:00000200:24.0:1773851862.382228:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031012413952
00000020:00000001:24.0:1773851862.382229:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851862.382230:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851862.382231:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.382232:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851862.382233:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851862.382234:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851862.382235:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031012413952, found 0 last_xid 1858031012413951
00000020:00000001:24.0:1773851862.382236:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851862.382237:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851862.382238:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851862.382239:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.382240:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851862.382241:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851862.382242:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851862.382243:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000041548332.
02000000:00000001:24.0:1773851862.382244:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.382245:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.382246:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851862.382247:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858031012413952
00010000:00000001:24.0:1773851862.382248:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851862.382249:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bd36394d x1858031012413952/t0(0) o400->43133e37-2809-4fba-b229-c5c475001cc2@10234@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne208-0'
00010000:00000001:24.0:1773851862.382253:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851862.382254:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851862.382255:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=95 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851862.382257:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851862.382258:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aa3fe92f refcount 5 to 10234@kfi7
00000100:00000001:24.0:1773851862.382259:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336352 : -107152617215264 : ffff9e8b96506ae0)
02000000:00000001:24.0:1773851862.382260:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851862.382261:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.382262:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851862.382263:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10234@kfi7
00000400:00000010:24.0:1773851862.382264:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000049ef55f5.
00000100:00000200:24.0:1773851862.382266:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031012413952, offset 224
00000400:00000200:24.0:1773851862.382268:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10234@kfi7
00000400:00000200:24.0:1773851862.382269:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:24.0:1773851862.382270:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 1
00000400:00000200:24.0:1773851862.382272:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000400:00000200:24.0:1773851862.382274:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 3
00000400:00000200:24.0:1773851862.382276:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10234@kfi7 local destination
00000400:00000200:24.0:1773851862.382278:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769028:8769028:1024:4294967295] 10234@kfi7 LPNI seq info [28012:28012:16:4294967295]
00000400:00000200:24.0:1773851862.382280:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000400:00000200:24.0:1773851862.382281:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:24.0:1773851862.382284:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10234@kfi7(10234@kfi7:10234@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851862.382287:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 3
00000800:00000200:24.0:1773851862.382289:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851862.382290:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851862.382294:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851862.382298:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x443 Using peer 10234@kfi7(0x443)
00000800:00000200:24.0:1773851862.382302:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x443: rc=0
00000800:00000200:24.0:1773851862.382305:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x443 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851862.382309:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851862.382310:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aa3fe92f refcount 4 to 10234@kfi7
00010000:00000001:24.0:1773851862.382311:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851862.382314:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.382316:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851862.382317:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bd36394d x1858031012413952/t0(0) o400->43133e37-2809-4fba-b229-c5c475001cc2@10234@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne208-0'
00000100:00100000:24.0:1773851862.382323:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd36394d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:43133e37-2809-4fba-b229-c5c475001cc2+6:47875:x1858031012413952:12345-10234@kfi7:400:default-tuolumne208-0 Request processed in 98us (143us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851862.382327:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10234@kfi7, seq: 2025078
00000100:00000040:24.0:1773851862.382329:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000031e31796 : new rpc_count 0
00000100:00000001:24.0:1773851862.382330:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851862.382331:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851862.382332:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851862.382333:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851862.382335:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851862.382336:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000031e31796 : new refcount 5
00000100:00000001:24.0:1773851862.382337:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851862.382346:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x443 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851862.382349:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.382351:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10234@kfi7: PUT: OK
00000400:00000200:25.0:1773851862.382353:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000049ef55f5
00000400:00000010:25.0:1773851862.382354:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000049ef55f5.
00000100:00000001:25.0:1773851862.382355:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851862.382356:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851862.382357:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea337c67 nid 10234@kfi7 refs 2
00000800:00000200:25.0:1773851862.382360:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 10234@kfi7(0000000008fdd2e7):0x0 lsk 1092 rsk 135 tsk 0 trmk 0 tmk 0 trr 6 tta 0x443 Transaction freed
00000800:00000200:25.0:1773851862.397896:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.397897:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851862.397898:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851862.397900:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851862.397902:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14928@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.397903:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14928@kfi7 : PUT - for me
00000400:00000200:25.0:1773851862.397904:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14928@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.397905:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b040a61 nid 14928@kfi7 refs 1
00000400:00000200:25.0:1773851862.397906:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14928@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.397906:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b040a61 nid 14928@kfi7 refs 2
00000400:00000200:25.0:1773851862.397907:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b040a61 nid 14928@kfi7 refs 3
00000400:00000200:25.0:1773851862.397908:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14928@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.397909:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14928@kfi7 of length 224 into portal 12 MB=0x69b4b64bee2c0
00000400:00000200:25.0:1773851862.397909:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14928@kfi7 of length 224/224 into md 0x16159c6179 [64] + 194264
00000800:00000200:25.0:1773851862.397911:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851862.397913:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.397914:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14928@kfi7: PUT: OK
00000100:00000001:25.0:1773851862.397915:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851862.397915:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851862.397916:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000e9cae52.
00000100:00000040:25.0:1773851862.397916:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000000e9cae52 x1859597975347904 msgsize 224
00000100:00100000:25.0:1773851862.397918:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-14928@kfi7 (source: 12345-14928@kfi7)
00000100:00000001:25.0:1773851862.397918:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851862.397919:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009b040a61 nid 14928@kfi7 refs 2
00000800:00000200:25.0:1773851862.397920:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851862.397920:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851862.397921:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851862.397921:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851862.397921:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851862.397922:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851862.397922:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597975347904
00000020:00000001:24.0:1773851862.397923:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851862.397923:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d808fa
00000020:00000001:24.0:1773851862.397924:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851862.397926:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7dfcf23 refcount=167
00000020:00000001:24.0:1773851862.397926:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150544969728 : -106923164581888 : ffff9ec102c1c000)
00000020:00000001:24.0:1773851862.397927:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637150544969728 : -106923164581888 : ffff9ec102c1c000)
00000100:00000001:24.0:1773851862.397927:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851862.397928:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851862.397929:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851862.397929:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851862.397930:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851862.397930:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851862.397931:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851862.397931:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851862.397931:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851862.397932:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851862.397932:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.397933:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.397934:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.397934:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.397934:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851862.397935:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851862.397935:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14928@kfi7, seq: 2025079
00000100:00000001:25.0:1773851862.397936:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.397936:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851862.397936:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7dfcf23 : new rpc_count 1
00000100:00000001:24.0:1773851862.397936:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478751232 : -106938230800384 : ffff9ebd80bd8000)
00000100:00000040:24.0:1773851862.397937:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000e9cae52 x1859597975347904/t0(0) o400->99fe3856-aa45-431c-bc28-95d5f3c66008@14928@kfi7:79/0 lens 224/0 e 0 to 0 dl 1773852194 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1426-0'
00000100:00000001:24.0:1773851862.397939:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851862.397940:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851862.397941:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e9cae52 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:99fe3856-aa45-431c-bc28-95d5f3c66008+167:39456:x1859597975347904:12345-14928@kfi7:400:default-tuolumne1426-0
00000100:00000200:24.0:1773851862.397943:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597975347904
00000020:00000001:24.0:1773851862.397944:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851862.397945:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851862.397945:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.397946:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851862.397946:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851862.397947:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851862.397947:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597975347904, found 0 last_xid 1859597974925311
00000020:00000001:24.0:1773851862.397948:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851862.397949:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851862.397949:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851862.397949:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.397950:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851862.397950:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851862.397951:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851862.397953:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e68cadd8.
02000000:00000001:24.0:1773851862.397954:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.397954:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.397955:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851862.397955:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062633, transno 0, xid 1859597975347904
00010000:00000001:24.0:1773851862.397956:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851862.397957:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000e9cae52 x1859597975347904/t0(0) o400->99fe3856-aa45-431c-bc28-95d5f3c66008@14928@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1426-0'
00010000:00000001:24.0:1773851862.397959:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851862.397959:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851862.397960:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=95 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851862.397961:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851862.397962:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c94f32ee refcount 3 to 14928@kfi7
00000100:00000001:24.0:1773851862.397962:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313738432 : -107139395813184 : ffff9e8eaa5f00c0)
02000000:00000001:24.0:1773851862.397963:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851862.397963:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.397964:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851862.397964:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14928@kfi7
00000400:00000010:24.0:1773851862.397965:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000460dc888.
00000100:00000200:24.0:1773851862.397966:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597975347904, offset 224
00000400:00000200:24.0:1773851862.397968:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14928@kfi7
00000400:00000200:24.0:1773851862.397968:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14928@kfi7 to cpt 6
00000400:00000200:24.0:1773851862.397969:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b040a61 nid 14928@kfi7 refs 1
00000400:00000200:24.0:1773851862.397970:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b040a61 nid 14928@kfi7 refs 2
00000400:00000200:24.0:1773851862.397971:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b040a61 nid 14928@kfi7 refs 3
00000400:00000200:24.0:1773851862.397972:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14928@kfi7 local destination
00000400:00000200:24.0:1773851862.397973:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769029:8769029:1024:4294967295] 14928@kfi7 LPNI seq info [457477:457477:16:4294967295]
00000400:00000200:24.0:1773851862.397975:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009b040a61 nid 14928@kfi7 refs 2
00000400:00000200:24.0:1773851862.397975:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14928@kfi7 to cpt 6
00000400:00000200:24.0:1773851862.397977:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14928@kfi7(14928@kfi7:14928@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851862.397978:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b040a61 nid 14928@kfi7 refs 3
00000800:00000200:24.0:1773851862.397979:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851862.397980:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851862.397982:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851862.397984:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x998 Using peer 14928@kfi7(0x998)
00000800:00000200:24.0:1773851862.397987:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x998: rc=0
00000800:00000200:24.0:1773851862.397988:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x998 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851862.397990:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851862.397991:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c94f32ee refcount 2 to 14928@kfi7
00010000:00000001:24.0:1773851862.397991:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851862.397992:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851862.397992:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851862.397993:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000e9cae52 x1859597975347904/t0(0) o400->99fe3856-aa45-431c-bc28-95d5f3c66008@14928@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1426-0'
00000100:00100000:24.0:1773851862.397997:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e9cae52 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:99fe3856-aa45-431c-bc28-95d5f3c66008+167:39456:x1859597975347904:12345-14928@kfi7:400:default-tuolumne1426-0 Request processed in 55us (79us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851862.397999:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14928@kfi7, seq: 2025079
00000100:00000040:24.0:1773851862.398000:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7dfcf23 : new rpc_count 0
00000100:00000001:24.0:1773851862.398001:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851862.398001:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851862.398001:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851862.398002:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:24.0:1773851862.398003:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851862.398004:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000a7dfcf23 : new refcount 166
00000100:00000001:24.0:1773851862.398004:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851862.398009:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x998 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851862.398010:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.398011:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14928@kfi7: PUT: OK
00000400:00000200:25.0:1773851862.398012:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000460dc888
00000400:00000010:25.0:1773851862.398012:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000460dc888.
00000100:00000001:25.0:1773851862.398013:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851862.398013:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851862.398014:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009b040a61 nid 14928@kfi7 refs 2
00000800:00000200:25.0:1773851862.398015:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 14928@kfi7(000000009a05cd68):0x0 lsk 2457 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x998 Transaction freed
00000800:00000200:29.0:1773851862.451470:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851862.451470:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851862.451472:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851862.451474:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851862.451475:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.451477:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2061@kfi7 : PUT - for me
00000400:00000200:29.0:1773851862.451478:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.451478:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:29.0:1773851862.451479:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.451480:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:29.0:1773851862.451481:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:29.0:1773851862.451481:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.451482:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 224 into portal 12 MB=0x699e0eaa274c0
00000400:00000200:29.0:1773851862.451484:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2061@kfi7 of length 224/224 into md 0x77fe139dd [64] + 171272
00000800:00000200:29.0:1773851862.451485:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851862.451489:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.451490:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000100:00000001:29.0:1773851862.451491:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851862.451491:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851862.451492:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000011bf6eb6.
00000100:00000040:29.0:1773851862.451493:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000011bf6eb6 x1858041148503232 msgsize 224
00000100:00100000:29.0:1773851862.451495:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2061@kfi7 (source: 12345-2061@kfi7)
00000100:00000001:29.0:1773851862.451496:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851862.451496:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:28.0:1773851862.451497:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851862.451498:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851862.451498:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851862.451499:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851862.451499:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851862.451500:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851862.451501:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041148503232
00000020:00000001:28.0:1773851862.451501:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851862.451502:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793accc751
00000020:00000001:28.0:1773851862.451503:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851862.451506:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000363403ba refcount=5
00000020:00000001:28.0:1773851862.451507:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946244807680 : -107127464743936 : ffff9e917184ac00)
00000020:00000001:28.0:1773851862.451508:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946244807680 : -107127464743936 : ffff9e917184ac00)
00000100:00000001:28.0:1773851862.451509:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851862.451510:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851862.451511:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9820241.
00000020:00000010:28.0:1773851862.451512:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851862.451513:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003e75757e.
00000100:00000001:28.0:1773851862.451514:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851862.451514:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851862.451515:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851862.451516:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851862.451516:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851862.451517:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.451518:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851862.451520:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851862.451520:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851862.451520:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851862.451520:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851862.451521:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2061@kfi7, seq: 2055501
00000100:00000040:31.0:1773851862.451522:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000363403ba : new rpc_count 1
00000100:00000001:28.0:1773851862.451522:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851862.451523:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343721472 : -106994365830144 : ffff9eb06ed4ec00)
00000100:00000001:28.0:1773851862.451523:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851862.451524:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000011bf6eb6 x1858041148503232/t0(0) o400->lustre5-MDT0001-lwp-OST000e_UUID@2061@kfi7:650/0 lens 224/0 e 0 to 0 dl 1773852010 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba115-0'
00000100:00000001:31.0:1773851862.451527:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851862.451527:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851862.451528:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000011bf6eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST000e_UUID+5:272626:x1858041148503232:12345-2061@kfi7:400:default-yuba115-0
00000100:00000200:31.0:1773851862.451530:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041148503232
00000020:00000001:31.0:1773851862.451530:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851862.451531:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851862.451532:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851862.451532:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851862.451533:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851862.451534:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:31.0:1773851862.451535:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851862.451535:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851862.451536:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851862.451537:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851862.451537:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851862.451538:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851862.451538:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851862.451539:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000546cd5ce.
02000000:00000001:31.0:1773851862.451540:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851862.451540:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851862.451541:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851862.451542:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041148503232
00010000:00000001:31.0:1773851862.451543:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851862.451544:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000011bf6eb6 x1858041148503232/t0(0) o400->lustre5-MDT0001-lwp-OST000e_UUID@2061@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba115-0'
00010000:00000001:31.0:1773851862.451547:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851862.451547:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851862.451548:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=95 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851862.451549:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851862.451550:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000183d9829 refcount 7 to 2061@kfi7
00000100:00000001:31.0:1773851862.451551:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066240 : -107155994485376 : ffff9e8acd035d80)
02000000:00000001:31.0:1773851862.451552:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851862.451552:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851862.451553:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851862.451554:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:31.0:1773851862.451554:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000030edd6e9.
00000100:00000200:31.0:1773851862.451555:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041148503232, offset 224
00000400:00000200:31.0:1773851862.451556:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:31.0:1773851862.451557:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:31.0:1773851862.451558:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:31.0:1773851862.451560:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:31.0:1773851862.451561:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:31.0:1773851862.451562:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2061@kfi7 local destination
00000400:00000200:31.0:1773851862.451563:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769030:8769030:1024:4294967295] 2061@kfi7 LPNI seq info [5403458:5403458:16:4294967295]
00000400:00000200:31.0:1773851862.451564:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:31.0:1773851862.451565:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:31.0:1773851862.451567:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851862.451568:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000800:00000200:31.0:1773851862.451569:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851862.451571:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851862.451573:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851862.451575:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019b Using peer 2061@kfi7(0x20000000000019b)
00000800:00000200:31.0:1773851862.451581:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x20000000000019b: rc=0
00000800:00000200:31.0:1773851862.451584:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851862.451587:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851862.451588:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000183d9829 refcount 6 to 2061@kfi7
00010000:00000001:31.0:1773851862.451589:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851862.451590:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851862.451591:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851862.451592:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000011bf6eb6 x1858041148503232/t0(0) o400->lustre5-MDT0001-lwp-OST000e_UUID@2061@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba115-0'
00000800:00000200:29.0:1773851862.451596:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019b TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851862.451598:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000011bf6eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST000e_UUID+5:272626:x1858041148503232:12345-2061@kfi7:400:default-yuba115-0 Request processed in 70us (103us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851862.451598:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.451600:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000400:00000200:29.0:1773851862.451601:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000030edd6e9
00000100:00100000:31.0:1773851862.451602:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2061@kfi7, seq: 2055501
00000400:00000010:29.0:1773851862.451602:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000030edd6e9.
00000100:00000040:31.0:1773851862.451603:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000363403ba : new rpc_count 0
00000100:00000001:29.0:1773851862.451603:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851862.451604:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851862.451604:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851862.451605:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851862.451605:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000020:00000010:31.0:1773851862.451606:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851862.451607:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003e75757e.
00000800:00000200:29.0:1773851862.451607:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019b Transaction freed
00000020:00000010:31.0:1773851862.451609:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9820241.
00000020:00000040:31.0:1773851862.451610:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000363403ba : new refcount 4
00000100:00000001:31.0:1773851862.451611:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851862.479618:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851862.479619:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851862.479620:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851862.479623:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851862.479625:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19602@kfi7 to cpt 0
00000400:00000200:1.0:1773851862.479627:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19602@kfi7 : PUT - for me
00000400:00000200:1.0:1773851862.479628:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19602@kfi7 to cpt 0
00000400:00000200:1.0:1773851862.479629:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8513f68 nid 19602@kfi7 refs 1
00000400:00000200:1.0:1773851862.479630:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19602@kfi7 to cpt 0
00000400:00000200:1.0:1773851862.479631:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8513f68 nid 19602@kfi7 refs 2
00000400:00000200:1.0:1773851862.479632:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e8513f68 nid 19602@kfi7 refs 3
00000400:00000200:1.0:1773851862.479633:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19539@kfi7 to cpt 7
00000400:00000200:1.0:1773851862.479634:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19539@kfi7 of length 224 into portal 12 MB=0x69b4b5ba826c0
00000400:00000200:1.0:1773851862.479636:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19539@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 24920
00000800:00000200:1.0:1773851862.479638:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851862.479640:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851862.479641:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19602@kfi7: PUT: OK
00000100:00000001:1.0:1773851862.479642:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851862.479643:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851862.479644:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000109ca38a.
00000100:00000040:1.0:1773851862.479645:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000109ca38a x1859597822863040 msgsize 224
00000100:00100000:1.0:1773851862.479647:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-19539@kfi7 (source: 12345-19602@kfi7)
00000100:00000001:1.0:1773851862.479648:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851862.479650:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8513f68 nid 19602@kfi7 refs 2
00000100:00000001:0.0:1773851862.479650:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851862.479650:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851862.479651:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851862.479652:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851862.479652:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851862.479652:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851862.479653:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597822863040
00000020:00000001:0.0:1773851862.479654:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851862.479654:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2438a33d
00000020:00000001:0.0:1773851862.479655:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851862.479657:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000859d031e refcount=5
00000020:00000001:0.0:1773851862.479658:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103090952192 : -106970618599424 : ffff9eb5f646e800)
00000020:00000001:0.0:1773851862.479658:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637103090952192 : -106970618599424 : ffff9eb5f646e800)
00000100:00000001:0.0:1773851862.479660:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851862.479661:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851862.479661:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f8f6276b.
00000020:00000010:0.0:1773851862.479662:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851862.479663:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851862.479664:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851862.479665:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851862.479666:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851862.479667:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851862.479667:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851862.479668:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851862.479669:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851862.479670:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851862.479671:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851862.479671:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851862.479671:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851862.479672:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19539@kfi7, seq: 1997542
00000100:00000001:1.0:1773851862.479673:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851862.479673:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000859d031e : new rpc_count 1
00000100:00000001:0.0:1773851862.479673:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856590464 : -106915852961152 : ffff9ec2b6903a80)
00000100:00000001:1.0:1773851862.479674:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851862.479675:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000109ca38a x1859597822863040/t0(0) o400->cfc4b74a-21a1-45e9-a7d5-7856cb71ee6a@19539@kfi7:502/0 lens 224/0 e 0 to 0 dl 1773852617 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1718-0'
00000100:00000001:0.0:1773851862.479678:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851862.479678:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851862.479679:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000109ca38a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:cfc4b74a-21a1-45e9-a7d5-7856cb71ee6a+5:39603:x1859597822863040:12345-19539@kfi7:400:default-tuolumne1718-0
00000100:00000200:0.0:1773851862.479681:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597822863040
00000020:00000001:0.0:1773851862.479681:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851862.479682:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851862.479683:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.479684:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851862.479684:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851862.479685:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851862.479686:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597822863040, found 0 last_xid 1859597822863039
00000020:00000001:0.0:1773851862.479686:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851862.479687:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851862.479688:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851862.479688:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.479689:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851862.479690:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851862.479690:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851862.479692:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b565012b.
02000000:00000001:0.0:1773851862.479693:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851862.479694:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.479695:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851862.479696:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181817279120, transno 0, xid 1859597822863040
00010000:00000001:0.0:1773851862.479696:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851862.479697:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000109ca38a x1859597822863040/t0(0) o400->cfc4b74a-21a1-45e9-a7d5-7856cb71ee6a@19539@kfi7:502/0 lens 224/224 e 0 to 0 dl 1773852617 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1718-0'
00010000:00000001:0.0:1773851862.479700:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851862.479701:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851862.479701:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=95 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851862.479703:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851862.479703:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b191c0f1 refcount 3 to 19539@kfi7
00000100:00000001:0.0:1773851862.479704:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212000 : -107155106339616 : ffff9e8b01f364e0)
02000000:00000001:0.0:1773851862.479705:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851862.479705:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851862.479706:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851862.479707:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19602@kfi7
00000400:00000010:0.0:1773851862.479708:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a494ee40.
00000100:00000200:0.0:1773851862.479708:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597822863040, offset 224
00000400:00000200:0.0:1773851862.479709:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19602@kfi7
00000400:00000200:0.0:1773851862.479710:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19602@kfi7 to cpt 0
00000400:00000200:0.0:1773851862.479711:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8513f68 nid 19602@kfi7 refs 1
00000400:00000200:0.0:1773851862.479712:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e8513f68 nid 19602@kfi7 refs 2
00000400:00000200:0.0:1773851862.479713:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e8513f68 nid 19602@kfi7 refs 3
00000400:00000200:0.0:1773851862.479714:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19602@kfi7 local destination
00000400:00000200:0.0:1773851862.479715:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769031:8769031:1024:4294967295] 19602@kfi7 LPNI seq info [373874:373874:16:4294967295]
00000400:00000200:0.0:1773851862.479717:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e8513f68 nid 19602@kfi7 refs 2
00000400:00000200:0.0:1773851862.479717:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19602@kfi7 to cpt 0
00000400:00000200:0.0:1773851862.479719:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19602@kfi7(19602@kfi7:19602@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851862.479720:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e8513f68 nid 19602@kfi7 refs 3
00000800:00000200:0.0:1773851862.479722:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851862.479723:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851862.479730:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851862.479733:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001225 Using peer 19602@kfi7(0x100000000001225)
00000800:00000200:0.0:1773851862.479736:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x100000000001225: rc=0
00000800:00000200:0.0:1773851862.479737:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001225 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851862.479739:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851862.479740:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b191c0f1 refcount 2 to 19539@kfi7
00010000:00000001:0.0:1773851862.479741:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851862.479741:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851862.479742:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851862.479743:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000109ca38a x1859597822863040/t0(0) o400->cfc4b74a-21a1-45e9-a7d5-7856cb71ee6a@19539@kfi7:502/0 lens 224/224 e 0 to 0 dl 1773852617 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1718-0'
00000100:00100000:0.0:1773851862.479748:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000109ca38a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:cfc4b74a-21a1-45e9-a7d5-7856cb71ee6a+5:39603:x1859597822863040:12345-19539@kfi7:400:default-tuolumne1718-0 Request processed in 69us (101us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851862.479750:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19539@kfi7, seq: 1997542
00000100:00000040:0.0:1773851862.479750:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000859d031e : new rpc_count 0
00000100:00000001:0.0:1773851862.479751:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851862.479752:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851862.479752:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851862.479753:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851862.479754:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f8f6276b.
00000020:00000040:0.0:1773851862.479755:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000859d031e : new refcount 4
00000100:00000001:0.0:1773851862.479755:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851862.479760:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001225 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851862.479762:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851862.479763:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19602@kfi7: PUT: OK
00000400:00000200:1.0:1773851862.479764:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a494ee40
00000400:00000010:1.0:1773851862.479764:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a494ee40.
00000100:00000001:1.0:1773851862.479765:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851862.479766:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851862.479767:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8513f68 nid 19602@kfi7 refs 2
00000800:00000200:1.0:1773851862.479768:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 19602@kfi7(000000002cc4f0b0):0x0 lsk 4646 rsk 22 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001225 Transaction freed
00000800:00000200:5.0:1773851862.484536:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851862.484537:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851862.484539:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851862.484541:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851862.484544:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14704@kfi7 to cpt 1
00000400:00000200:5.0:1773851862.484545:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14704@kfi7 : PUT - for me
00000400:00000200:5.0:1773851862.484546:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14704@kfi7 to cpt 1
00000400:00000200:5.0:1773851862.484547:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000181187f6 nid 14704@kfi7 refs 1
00000400:00000200:5.0:1773851862.484548:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14704@kfi7 to cpt 1
00000400:00000200:5.0:1773851862.484549:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000181187f6 nid 14704@kfi7 refs 2
00000400:00000200:5.0:1773851862.484550:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000181187f6 nid 14704@kfi7 refs 3
00000400:00000200:5.0:1773851862.484551:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14769@kfi7 to cpt 0
00000400:00000200:5.0:1773851862.484552:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14769@kfi7 of length 224 into portal 12 MB=0x69b4b57d0f1c0
00000400:00000200:5.0:1773851862.484554:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14769@kfi7 of length 224/224 into md 0x793926dc5 [64] + 130072
00000800:00000200:5.0:1773851862.484556:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851862.484558:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851862.484559:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14704@kfi7: PUT: OK
00000100:00000001:5.0:1773851862.484560:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851862.484561:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851862.484562:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f8986c13.
00000100:00000040:5.0:1773851862.484563:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000f8986c13 x1859597758427584 msgsize 224
00000100:00100000:5.0:1773851862.484564:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14769@kfi7 (source: 12345-14704@kfi7)
00000100:00000001:5.0:1773851862.484566:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851862.484567:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851862.484568:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851862.484568:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:5.0:1773851862.484568:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000181187f6 nid 14704@kfi7 refs 2
00000100:00000001:7.0:1773851862.484569:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851862.484569:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851862.484570:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851862.484570:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597758427584
00000020:00000001:7.0:1773851862.484571:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851862.484571:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80320
00000020:00000001:7.0:1773851862.484572:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851862.484574:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d1ff8e8a refcount=5
00000020:00000001:7.0:1773851862.484575:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072919473152 : -107000790078464 : ffff9eaeefeaac00)
00000020:00000001:7.0:1773851862.484575:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072919473152 : -107000790078464 : ffff9eaeefeaac00)
00000100:00000001:7.0:1773851862.484576:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851862.484577:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851862.484578:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f72fd39.
00000020:00000010:7.0:1773851862.484579:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851862.484580:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851862.484581:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851862.484582:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851862.484582:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851862.484584:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851862.484584:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851862.484585:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.484586:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851862.484587:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851862.484587:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851862.484587:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851862.484588:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14769@kfi7, seq: 2001894
00000100:00000001:5.0:1773851862.484588:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851862.484589:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d1ff8e8a : new rpc_count 1
00000100:00000001:5.0:1773851862.484589:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.484590:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866961792 : -107088842589824 : ffff9e9a6f93f980)
00000100:00000001:5.0:1773851862.484590:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851862.484591:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f8986c13 x1859597758427584/t0(0) o400->6d94557b-6882-49a6-8560-3cc7c59c9eb2@14769@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1406-0'
00000100:00000001:7.0:1773851862.484593:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851862.484594:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851862.484595:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8986c13 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6d94557b-6882-49a6-8560-3cc7c59c9eb2+5:39543:x1859597758427584:12345-14769@kfi7:400:default-tuolumne1406-0
00000100:00000200:7.0:1773851862.484596:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597758427584
00000020:00000001:7.0:1773851862.484597:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851862.484597:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851862.484598:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.484599:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851862.484599:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851862.484600:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851862.484601:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597758427584, found 0 last_xid 1859597758427583
00000020:00000001:7.0:1773851862.484601:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851862.484602:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851862.484603:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851862.484603:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.484604:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851862.484604:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851862.484605:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851862.484605:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000431baa50.
02000000:00000001:7.0:1773851862.484607:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.484607:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.484608:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851862.484609:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686802, transno 0, xid 1859597758427584
00010000:00000001:7.0:1773851862.484609:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851862.484610:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f8986c13 x1859597758427584/t0(0) o400->6d94557b-6882-49a6-8560-3cc7c59c9eb2@14769@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1406-0'
00010000:00000001:7.0:1773851862.484613:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851862.484613:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851862.484614:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=94 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851862.484615:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851862.484615:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003ec9b9f1 refcount 3 to 14769@kfi7
00000100:00000001:7.0:1773851862.484616:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441696 : -107146751109920 : ffff9e8cf3f614e0)
02000000:00000001:7.0:1773851862.484617:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851862.484618:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.484618:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851862.484619:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14704@kfi7
00000400:00000010:7.0:1773851862.484620:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a17c530.
00000100:00000200:7.0:1773851862.484621:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597758427584, offset 224
00000400:00000200:7.0:1773851862.484623:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14704@kfi7
00000400:00000200:7.0:1773851862.484624:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14704@kfi7 to cpt 1
00000400:00000200:7.0:1773851862.484624:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000181187f6 nid 14704@kfi7 refs 1
00000400:00000200:7.0:1773851862.484626:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000181187f6 nid 14704@kfi7 refs 2
00000400:00000200:7.0:1773851862.484627:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000181187f6 nid 14704@kfi7 refs 3
00000400:00000200:7.0:1773851862.484628:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14704@kfi7 local destination
00000400:00000200:7.0:1773851862.484629:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769032:8769032:1024:4294967295] 14704@kfi7 LPNI seq info [229451:229451:16:4294967295]
00000400:00000200:7.0:1773851862.484631:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000181187f6 nid 14704@kfi7 refs 2
00000400:00000200:7.0:1773851862.484632:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14704@kfi7 to cpt 1
00000400:00000200:7.0:1773851862.484634:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14704@kfi7(14704@kfi7:14704@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851862.484636:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000181187f6 nid 14704@kfi7 refs 3
00000800:00000200:7.0:1773851862.484639:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851862.484640:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851862.484645:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851862.484649:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000109e Using peer 14704@kfi7(0x10000000000109e)
00000800:00000200:7.0:1773851862.484654:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x10000000000109e: rc=0
00000800:00000200:7.0:1773851862.484657:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000109e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851862.484660:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851862.484662:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003ec9b9f1 refcount 2 to 14769@kfi7
00010000:00000001:7.0:1773851862.484663:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851862.484664:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.484665:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851862.484666:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f8986c13 x1859597758427584/t0(0) o400->6d94557b-6882-49a6-8560-3cc7c59c9eb2@14769@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1406-0'
00000800:00000200:5.0:1773851862.484671:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000109e TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851862.484672:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8986c13 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6d94557b-6882-49a6-8560-3cc7c59c9eb2+5:39543:x1859597758427584:12345-14769@kfi7:400:default-tuolumne1406-0 Request processed in 77us (108us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851862.484674:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851862.484676:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14769@kfi7, seq: 2001894
00000400:00000200:5.0:1773851862.484676:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14704@kfi7: PUT: OK
00000100:00000040:7.0:1773851862.484677:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d1ff8e8a : new rpc_count 0
00000400:00000200:5.0:1773851862.484678:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a17c530
00000100:00000001:7.0:1773851862.484679:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:5.0:1773851862.484679:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a17c530.
00000100:00000001:7.0:1773851862.484680:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851862.484680:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851862.484681:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000100:00000001:5.0:1773851862.484681:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851862.484682:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000400:00000200:5.0:1773851862.484682:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000181187f6 nid 14704@kfi7 refs 2
00000020:00000010:7.0:1773851862.484683:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f72fd39.
00000020:00000040:7.0:1773851862.484685:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000d1ff8e8a : new refcount 4
00000800:00000200:5.0:1773851862.484685:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 14704@kfi7(0000000064522e7d):0x0 lsk 4255 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000109e Transaction freed
00000100:00000001:7.0:1773851862.484686:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851862.570055:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851862.570056:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851862.570057:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851862.570059:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851862.570061:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.570062:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22643@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.570063:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.570064:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 1
00000400:00000200:17.0:1773851862.570065:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.570065:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000400:00000200:17.0:1773851862.570066:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 3
00000400:00000200:17.0:1773851862.570067:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22642@kfi7 to cpt 1
00000400:00000200:17.0:1773851862.570068:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22642@kfi7 of length 376 into portal 12 MB=0x69b4b627d5a80
00000400:00000200:17.0:1773851862.570069:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22642@kfi7 of length 376/376 into md 0x6ab01b5d1 [64] + 3360
00000800:00000200:17.0:1773851862.570071:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851862.570072:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851862.570073:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22643@kfi7: PUT: OK
00000100:00000001:17.0:1773851862.570074:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851862.570074:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851862.570075:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a9064e84.
00000100:00000040:17.0:1773851862.570076:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a9064e84 x1859597937498752 msgsize 376
00000100:00100000:17.0:1773851862.570077:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22642@kfi7 (source: 12345-22643@kfi7)
00000100:00000001:17.0:1773851862.570078:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851862.570079:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851862.570079:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
02000000:00000001:19.0:1773851862.570080:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851862.570080:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851862.570080:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851862.570081:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851862.570082:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851862.570083:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597937498752
00000020:00000001:19.0:1773851862.570083:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851862.570084:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2432de75
00000020:00000001:19.0:1773851862.570084:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851862.570088:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000049b021a0 refcount=524
00000020:00000001:19.0:1773851862.570088:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126463292416 : -106947246259200 : ffff9ebb67608400)
00000020:00000001:19.0:1773851862.570089:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126463292416 : -106947246259200 : ffff9ebb67608400)
00000100:00000001:19.0:1773851862.570091:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.570091:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851862.570092:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851862.570093:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.570094:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851862.570095:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851862.570095:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:19.0:1773851862.570096:0:60961:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:19.0:1773851862.570096:0:60961:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570097:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570098:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570099:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.570100:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.570101:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851862.570102:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22642@kfi7, seq: 323103284
00000100:00000001:16.0:1773851862.570102:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:19.0:1773851862.570103:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000049b021a0 : new rpc_count 5
00000100:00000001:19.0:1773851862.570103:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764349440 : -107095945202176 : ffff9e98c83ab600)
00000100:00000001:16.0:1773851862.570103:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851862.570104:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a9064e84 x1859597937498752/t0(0) o101->99980d39-4618-4308-b620-5cf6e74a4e01@22642@kfi7:589/0 lens 376/0 e 0 to 0 dl 1773851949 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111579377662976'
00000100:00000001:16.0:1773851862.570104:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851862.570105:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570107:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.570107:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851862.570108:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9064e84 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:99980d39-4618-4308-b620-5cf6e74a4e01+524:327063:x1859597937498752:12345-22642@kfi7:101:tuolumne-833111579377662976
00000100:00000200:19.0:1773851862.570110:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597937498752
00000020:00000001:19.0:1773851862.570110:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851862.570111:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851862.570112:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.570113:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851862.570113:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:19.0:1773851862.570114:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851862.570115:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597937498752, found 0 last_xid 1859597930344639
00000020:00000001:19.0:1773851862.570116:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851862.570117:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851862.570117:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851862.570118:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.570118:0:60961:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:19.0:1773851862.570119:0:60961:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:19.0:1773851862.570120:0:60961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:19.0:1773851862.570120:0:60961:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:19.0:1773851862.570121:0:60961:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570124:0:60961:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:19.0:1773851862.570126:0:60961:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000008873599 count: 3
00010000:00000001:19.0:1773851862.570126:0:60961:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:19.0:1773851862.570128:0:60961:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:19.0:1773851862.570129:0:60961:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000e6fbaaed.
00000020:00000001:19.0:1773851862.570130:0:60961:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:19.0:1773851862.570131:0:60961:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000e6fbaaed with handle 0x21b6f08f07a6ad70 to hash
00000020:00000001:19.0:1773851862.570132:0:60961:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:19.0:1773851862.570132:0:60961:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637150713693312 : -106922995858304 : ffff9ec10cd04480)
00010000:00000010:19.0:1773851862.570134:0:60961:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a490b3f6.
00010000:00000001:19.0:1773851862.570135:0:60961:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637150713693312 : -106922995858304 : ffff9ec10cd04480)
00010000:00010000:19.0:1773851862.570135:0:60961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6fbaaed/0x21b6f08f07a6ad70 lrc: 2/0,0 mode: --/CR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f98ed8a9fecdd9f expref: -99 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570139:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 3
00010000:00000040:19.0:1773851862.570140:0:60961:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000049b021a0 : new locks_count 448
00000020:00000040:19.0:1773851862.570141:0:60961:0:(genops.c:871:class_export_get()) GET export 0000000049b021a0 refcount=525
00010000:00000001:19.0:1773851862.570143:0:60961:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:19.0:1773851862.570143:0:60961:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:19.0:1773851862.570146:0:60961:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:19.0:1773851862.570146:0:60961:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:19.0:1773851862.570147:0:60961:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.570148:0:60961:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:19.0:1773851862.570149:0:60961:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x240028de2:0x19a80:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:19.0:1773851862.570150:0:60961:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:19.0:1773851862.570151:0:60961:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028de2:0x19a80:0x0]
00000020:00000001:19.0:1773851862.570151:0:60961:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:19.0:1773851862.570153:0:60961:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637086584697064 : -106987124854552 : ffff9eb21e6d70e8)
00000004:00000001:19.0:1773851862.570153:0:60961:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637086584696976 : -106987124854640 : ffff9eb21e6d7090)
00000004:00000001:19.0:1773851862.570155:0:60961:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:19.0:1773851862.570157:0:60961:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:19.0:1773851862.570158:0:60961:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:19.0:1773851862.570161:0:60961:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570162:0:60961:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570163:0:60961:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:19.0:1773851862.570163:0:60961:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:19.0:1773851862.570164:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851862.570165:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851862.570166:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 00000000c713ed9e.
02000000:00000001:19.0:1773851862.570167:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570167:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.570168:0:60961:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:19.0:1773851862.570169:0:60961:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:19.0:1773851862.570170:0:60961:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:19.0:1773851862.570171:0:60961:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.570171:0:60961:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570172:0:60961:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:19.0:1773851862.570173:0:60961:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:19.0:1773851862.570174:0:60961:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:19.0:1773851862.570175:0:60961:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851862.570175:0:60961:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:19.0:1773851862.570176:0:60961:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851862.570177:0:60961:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:19.0:1773851862.570177:0:60961:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:19.0:1773851862.570178:0:60961:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:19.0:1773851862.570182:0:60961:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:19.0:1773851862.570182:0:60961:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240028de2:0x19a80:0x0].0x0 (0000000008873599) refcount = 3
00010000:00000040:19.0:1773851862.570184:0:60961:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:19.0:1773851862.570185:0:60961:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000049d83495/0x21b6f08f07a2b972 lrc: 2/0,0 mode: CR/CR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 14656@kfi7 remote: 0xee46395ebb62477a expref: 571 pid: 41964 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570188:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 3
00010000:00000040:19.0:1773851862.570189:0:60961:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c347d0b/0x21b6f08f07a2b979 lrc: 2/0,0 mode: PR/PR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 14656@kfi7 remote: 0xee46395ebb624781 expref: 571 pid: 41964 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570191:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 3
00010000:00010000:19.0:1773851862.570192:0:60961:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6fbaaed/0x21b6f08f07a6ad70 lrc: 3/0,0 mode: CR/CR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9fecdd9f expref: 525 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570194:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 3
00010000:00000001:19.0:1773851862.570195:0:60961:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:19.0:1773851862.570195:0:60961:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:19.0:1773851862.570196:0:60961:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570197:0:60961:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:19.0:1773851862.570197:0:60961:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851862.570198:0:60961:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570198:0:60961:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:19.0:1773851862.570200:0:60961:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:19.0:1773851862.570201:0:60961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6fbaaed/0x21b6f08f07a6ad70 lrc: 3/0,0 mode: CR/CR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9fecdd9f expref: 525 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570203:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 3
00000004:00000001:19.0:1773851862.570204:0:60961:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:19.0:1773851862.570205:0:60961:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:19.0:1773851862.570206:0:60961:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028de2:0x19a80:0x0]
00000020:00000001:19.0:1773851862.570206:0:60961:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:19.0:1773851862.570207:0:60961:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637086584697064 : -106987124854552 : ffff9eb21e6d70e8)
00000004:00000001:19.0:1773851862.570207:0:60961:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637086584696976 : -106987124854640 : ffff9eb21e6d7090)
00000004:00000001:19.0:1773851862.570208:0:60961:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:19.0:1773851862.570209:0:60961:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:19.0:1773851862.570209:0:60961:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:19.0:1773851862.570210:0:60961:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570211:0:60961:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570211:0:60961:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570212:0:60961:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:19.0:1773851862.570212:0:60961:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:19.0:1773851862.570212:0:60961:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:19.0:1773851862.570213:0:60961:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570214:0:60961:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570214:0:60961:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:19.0:1773851862.570215:0:60961:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:19.0:1773851862.570215:0:60961:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:19.0:1773851862.570216:0:60961:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:19.0:1773851862.570216:0:60961:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:19.0:1773851862.570217:0:60961:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:19.0:1773851862.570217:0:60961:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028de2:0x19a80:0x0].0x0 (0000000008873599)
00010000:00010000:19.0:1773851862.570218:0:60961:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:19.0:1773851862.570219:0:60961:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851862.570220:0:60961:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570220:0:60961:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:19.0:1773851862.570221:0:60961:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:19.0:1773851862.570221:0:60961:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:19.0:1773851862.570221:0:60961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e6fbaaed, rc 0)
00000020:00000001:19.0:1773851862.570223:0:60961:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851862.570223:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588733, transno 0, xid 1859597937498752
00010000:00000001:19.0:1773851862.570224:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851862.570225:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a9064e84 x1859597937498752/t0(0) o101->99980d39-4618-4308-b620-5cf6e74a4e01@22642@kfi7:589/0 lens 376/1080 e 0 to 0 dl 1773851949 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111579377662976'
00010000:00000001:19.0:1773851862.570227:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851862.570228:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851862.570229:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=95 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851862.570230:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851862.570231:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fc23532b refcount 3 to 22642@kfi7
00000100:00000001:19.0:1773851862.570231:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412000 : -107145304139616 : ffff9e8d4a3518a0)
02000000:00000001:19.0:1773851862.570232:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851862.570233:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570234:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851862.570235:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22643@kfi7
00000400:00000010:19.0:1773851862.570235:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000211a6341.
00000100:00000200:19.0:1773851862.570236:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1859597937498752, offset 224
00000400:00000200:19.0:1773851862.570238:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22643@kfi7
00000400:00000200:19.0:1773851862.570239:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.570239:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 1
00000400:00000200:19.0:1773851862.570240:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000400:00000200:19.0:1773851862.570241:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 3
00000400:00000200:19.0:1773851862.570243:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22643@kfi7 local destination
00000400:00000200:19.0:1773851862.570244:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769033:8769033:1024:4294967295] 22643@kfi7 LPNI seq info [464182:464182:16:4294967295]
00000400:00000200:19.0:1773851862.570246:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000400:00000200:19.0:1773851862.570247:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.570248:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22643@kfi7(22643@kfi7:22643@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851862.570249:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 3
00000800:00000200:19.0:1773851862.570251:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851862.570252:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000800:00000200:19.0:1773851862.570254:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851862.570256:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9a Using peer 22643@kfi7(0x9a)
00000800:00000200:19.0:1773851862.570259:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 1180 bytes to peer 0x9a: rc=0
00000800:00000200:19.0:1773851862.570261:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851862.570263:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.570264:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fc23532b refcount 2 to 22642@kfi7
00010000:00000001:19.0:1773851862.570264:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851862.570265:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.570266:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851862.570267:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a9064e84 x1859597937498752/t0(0) o101->99980d39-4618-4308-b620-5cf6e74a4e01@22642@kfi7:589/0 lens 376/1080 e 0 to 0 dl 1773851949 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111579377662976'
00000100:00100000:19.0:1773851862.570270:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9064e84 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:99980d39-4618-4308-b620-5cf6e74a4e01+525:327063:x1859597937498752:12345-22642@kfi7:101:tuolumne-833111579377662976 Request processed in 162us (194us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851862.570272:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22642@kfi7, seq: 323103284
00000100:00000040:19.0:1773851862.570273:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000049b021a0 : new rpc_count 4
00000100:00000001:19.0:1773851862.570274:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851862.570274:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9a TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851862.570275:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851862.570275:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.570276:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000400:00000200:17.0:1773851862.570276:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851862.570277:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000400:00000200:17.0:1773851862.570277:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22643@kfi7: PUT: OK
00000400:00000200:17.0:1773851862.570277:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000211a6341
00000020:00000040:19.0:1773851862.570278:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000049b021a0 : new refcount 524
00000100:00000001:19.0:1773851862.570278:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:17.0:1773851862.570278:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000211a6341.
00000100:00000001:17.0:1773851862.570279:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851862.570279:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851862.570280:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000800:00000200:17.0:1773851862.570281:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2069@kfi7:4 -> 22643@kfi7(00000000b17746a4):0x0 lsk 155 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9a Transaction freed
00000800:00000200:17.0:1773851862.570695:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851862.570696:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851862.570696:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851862.570696:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:17.0:1773851862.570697:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851862.570698:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851862.570699:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22643@kfi7(0000000026c3231e):0xade version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851862.570700:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851862.570700:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade Using peer 22643@kfi7(0x100000000000ade)
00000400:00000200:18.0:1773851862.570701:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:18.0:1773851862.570702:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22643@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.570702:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:18.0:1773851862.570703:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:18.0:1773851862.570704:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 1
00000800:00000200:17.0:1773851862.570704:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x100000000000ade: rc=0
00000400:00000200:18.0:1773851862.570705:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000800:00000200:17.0:1773851862.570705:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851862.570706:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000400:00000200:18.0:1773851862.570707:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 3
00000400:00000200:18.0:1773851862.570707:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22642@kfi7 to cpt 1
00000400:00000200:18.0:1773851862.570708:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22642@kfi7 of length 328 into portal 12 MB=0x69b4b627d5ac0
00000400:00000200:18.0:1773851862.570709:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22642@kfi7 of length 328/328 into md 0x6ab01b5d1 [64] + 3736
00000800:00000200:18.0:1773851862.570712:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851862.570714:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851862.570715:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22643@kfi7: PUT: OK
00000100:00000001:18.0:1773851862.570716:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851862.570716:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851862.570717:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c67a86d8.
00000100:00000040:18.0:1773851862.570717:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000c67a86d8 x1859597937498816 msgsize 328
00000800:00000200:17.0:1773851862.570717:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851862.570719:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-22642@kfi7 (source: 12345-22643@kfi7)
00000100:00000001:18.0:1773851862.570719:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851862.570719:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade Transaction freed
00000400:00000200:18.0:1773851862.570720:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000100:00000001:19.0:1773851862.570721:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851862.570721:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851862.570722:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851862.570722:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851862.570722:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851862.570723:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851862.570723:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597937498816
00000020:00000001:19.0:1773851862.570724:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851862.570724:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2432de75
00000020:00000001:19.0:1773851862.570729:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851862.570729:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000049b021a0 refcount=525
00000020:00000001:19.0:1773851862.570730:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126463292416 : -106947246259200 : ffff9ebb67608400)
00000020:00000001:19.0:1773851862.570730:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126463292416 : -106947246259200 : ffff9ebb67608400)
00000100:00000001:19.0:1773851862.570731:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.570732:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851862.570732:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851862.570733:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.570734:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851862.570734:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851862.570735:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:19.0:1773851862.570736:0:60961:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:19.0:1773851862.570736:0:60961:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570737:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570738:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570738:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.570739:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.570740:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851862.570740:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851862.570740:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851862.570741:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22642@kfi7, seq: 323103285
00000100:00000040:19.0:1773851862.570741:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000049b021a0 : new rpc_count 5
00000100:00000001:16.0:1773851862.570741:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570742:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534648064 : -106946174903552 : ffff9ebba73c1b00)
00000100:00000001:16.0:1773851862.570742:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.570743:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c67a86d8 x1859597937498816/t0(0) o101->99980d39-4618-4308-b620-5cf6e74a4e01@22642@kfi7:145/0 lens 328/0 e 0 to 0 dl 1773852260 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111579377662976'
00000100:00000001:19.0:1773851862.570746:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.570746:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851862.570747:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c67a86d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:99980d39-4618-4308-b620-5cf6e74a4e01+525:39634:x1859597937498816:12345-22642@kfi7:101:tuolumne-833111579377662976
00000100:00000200:19.0:1773851862.570748:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597937498816
00000020:00000001:19.0:1773851862.570749:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851862.570749:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851862.570750:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.570750:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851862.570750:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:19.0:1773851862.570751:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851862.570752:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597937498816, found 0 last_xid 1859597930344639
00000020:00000001:19.0:1773851862.570752:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851862.570753:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851862.570753:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851862.570754:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.570754:0:60961:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:19.0:1773851862.570755:0:60961:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:19.0:1773851862.570755:0:60961:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:19.0:1773851862.570755:0:60961:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:19.0:1773851862.570756:0:60961:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570757:0:60961:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:19.0:1773851862.570758:0:60961:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000008873599 count: 4
00010000:00000001:19.0:1773851862.570759:0:60961:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:19.0:1773851862.570759:0:60961:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:19.0:1773851862.570760:0:60961:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000002a063c9c.
00000020:00000001:19.0:1773851862.570761:0:60961:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:19.0:1773851862.570761:0:60961:0:(lustre_handles.c:97:class_handle_hash()) added object 000000002a063c9c with handle 0x21b6f08f07a6ad77 to hash
00000020:00000001:19.0:1773851862.570762:0:60961:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:19.0:1773851862.570762:0:60961:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637150713700800 : -106922995850816 : ffff9ec10cd061c0)
00010000:00000010:19.0:1773851862.570763:0:60961:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000b8a6b3f0.
00010000:00000001:19.0:1773851862.570763:0:60961:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637150713700800 : -106922995850816 : ffff9ec10cd061c0)
00010000:00010000:19.0:1773851862.570764:0:60961:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000002a063c9c/0x21b6f08f07a6ad77 lrc: 2/0,0 mode: --/PR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f98ed8a9fecdda6 expref: -99 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570767:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 4
00010000:00000040:19.0:1773851862.570767:0:60961:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000049b021a0 : new locks_count 449
00000020:00000040:19.0:1773851862.570768:0:60961:0:(genops.c:871:class_export_get()) GET export 0000000049b021a0 refcount=526
00010000:00000001:19.0:1773851862.570769:0:60961:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:19.0:1773851862.570769:0:60961:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00002000:00000001:19.0:1773851862.570770:0:60961:0:(mdt_io.c:1388:mdt_glimpse_enqueue()) Process entered
00000100:00000001:19.0:1773851862.570771:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851862.570771:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851862.570772:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 656 at 000000006d1b2d8c.
02000000:00000001:19.0:1773851862.570772:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570773:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570774:0:60961:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:19.0:1773851862.570774:0:60961:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:19.0:1773851862.570775:0:60961:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851862.570775:0:60961:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:19.0:1773851862.570776:0:60961:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851862.570776:0:60961:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:19.0:1773851862.570776:0:60961:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:19.0:1773851862.570777:0:60961:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:19.0:1773851862.570777:0:60961:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:19.0:1773851862.570778:0:60961:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240028de2:0x19a80:0x0].0x0 (0000000008873599) refcount = 4
00010000:00000040:19.0:1773851862.570779:0:60961:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:19.0:1773851862.570780:0:60961:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6fbaaed/0x21b6f08f07a6ad70 lrc: 2/0,0 mode: CR/CR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9fecdd9f expref: 526 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570782:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 4
00010000:00000040:19.0:1773851862.570783:0:60961:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000049d83495/0x21b6f08f07a2b972 lrc: 2/0,0 mode: CR/CR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 14656@kfi7 remote: 0xee46395ebb62477a expref: 571 pid: 41964 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570785:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 4
00010000:00000040:19.0:1773851862.570786:0:60961:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c347d0b/0x21b6f08f07a2b979 lrc: 2/0,0 mode: PR/PR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 14656@kfi7 remote: 0xee46395ebb624781 expref: 571 pid: 41964 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570788:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 4
00010000:00010000:19.0:1773851862.570789:0:60961:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000002a063c9c/0x21b6f08f07a6ad77 lrc: 3/0,0 mode: PR/PR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9fecdda6 expref: 526 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570791:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 4
00010000:00000001:19.0:1773851862.570791:0:60961:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:19.0:1773851862.570792:0:60961:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:19.0:1773851862.570792:0:60961:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570793:0:60961:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:19.0:1773851862.570793:0:60961:0:(ldlm_inodebits.c:406:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:19.0:1773851862.570794:0:60961:0:(mdt_io.c:1433:mdt_glimpse_enqueue()) Process leaving via fill_mbo (rc=302 : 302 : 0x12e)
00002000:00010000:19.0:1773851862.570795:0:60961:0:(mdt_io.c:1321:mdt_lvb2reply()) size 11
00002000:00000001:19.0:1773851862.570796:0:60961:0:(mdt_io.c:1461:mdt_glimpse_enqueue()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:19.0:1773851862.570797:0:60961:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:19.0:1773851862.570797:0:60961:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570798:0:60961:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:19.0:1773851862.570799:0:60961:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000002a063c9c/0x21b6f08f07a6ad77 lrc: 3/0,0 mode: PR/PR res: [0x240028de2:0x19a80:0x0].0x0 bits 0x40/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9fecdda6 expref: 526 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851862.570801:0:60961:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000008873599 count: 4
00000004:00000001:19.0:1773851862.570802:0:60961:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:19.0:1773851862.570802:0:60961:0:(mdt_lvb.c:377:mdt_lvbo_fill()) Process leaving via out (rc=56 : 56 : 0x38)
00000004:00000001:19.0:1773851862.570803:0:60961:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=56 : 56 : 38)
00010000:00000001:19.0:1773851862.570805:0:60961:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:19.0:1773851862.570805:0:60961:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:19.0:1773851862.570806:0:60961:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028de2:0x19a80:0x0].0x0 (0000000008873599)
00010000:00010000:19.0:1773851862.570807:0:60961:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00000001:19.0:1773851862.570807:0:60961:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851862.570808:0:60961:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851862.570808:0:60961:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:19.0:1773851862.570808:0:60961:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:19.0:1773851862.570809:0:60961:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:19.0:1773851862.570809:0:60961:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002a063c9c, rc 0)
00000020:00000001:19.0:1773851862.570810:0:60961:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851862.570810:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588733, transno 0, xid 1859597937498816
00010000:00000001:19.0:1773851862.570811:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851862.570812:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c67a86d8 x1859597937498816/t0(0) o101->99980d39-4618-4308-b620-5cf6e74a4e01@22642@kfi7:145/0 lens 328/400 e 0 to 0 dl 1773852260 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111579377662976'
00010000:00000001:19.0:1773851862.570814:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851862.570815:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851862.570815:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=95 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851862.570816:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851862.570817:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fc23532b refcount 3 to 22642@kfi7
00000100:00000001:19.0:1773851862.570818:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412000 : -107145304139616 : ffff9e8d4a3518a0)
02000000:00000001:19.0:1773851862.570818:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851862.570819:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.570819:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851862.570820:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22643@kfi7
00000400:00000010:19.0:1773851862.570821:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018126296.
00000100:00000200:19.0:1773851862.570821:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 400 bytes to portal 10, xid 1859597937498816, offset 224
00000400:00000200:19.0:1773851862.570822:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22643@kfi7
00000400:00000200:19.0:1773851862.570823:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.570824:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 1
00000400:00000200:19.0:1773851862.570825:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000400:00000200:19.0:1773851862.570826:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 3
00000400:00000200:19.0:1773851862.570827:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22643@kfi7 local destination
00000400:00000200:19.0:1773851862.570829:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769034:8769034:1024:4294967295] 22643@kfi7 LPNI seq info [464183:464183:16:4294967295]
00000400:00000200:19.0:1773851862.570830:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000400:00000200:19.0:1773851862.570831:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22643@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.570833:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22643@kfi7(22643@kfi7:22643@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851862.570834:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 3
00000800:00000200:19.0:1773851862.570835:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851862.570836:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 400 bytes in 1 frags
00000800:00000200:19.0:1773851862.570838:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851862.570840:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade Using peer 22643@kfi7(0x100000000000ade)
00000800:00000200:19.0:1773851862.570843:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 500 bytes to peer 0x100000000000ade: rc=0
00000800:00000200:19.0:1773851862.570844:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851862.570846:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.570847:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fc23532b refcount 2 to 22642@kfi7
00010000:00000001:19.0:1773851862.570847:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851862.570848:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.570848:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851862.570849:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c67a86d8 x1859597937498816/t0(0) o101->99980d39-4618-4308-b620-5cf6e74a4e01@22642@kfi7:145/0 lens 328/400 e 0 to 0 dl 1773852260 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111579377662976'
00000100:00100000:19.0:1773851862.570852:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c67a86d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:99980d39-4618-4308-b620-5cf6e74a4e01+526:39634:x1859597937498816:12345-22642@kfi7:101:tuolumne-833111579377662976 Request processed in 106us (134us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851862.570854:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22642@kfi7, seq: 323103285
00000100:00000040:19.0:1773851862.570855:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000049b021a0 : new rpc_count 4
00000800:00000200:17.0:1773851862.570855:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851862.570856:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851862.570856:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851862.570857:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851862.570857:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851862.570857:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22643@kfi7: PUT: OK
00000020:00000010:19.0:1773851862.570858:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000400:00000200:17.0:1773851862.570858:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018126296
00000400:00000010:17.0:1773851862.570858:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018126296.
00000020:00000010:19.0:1773851862.570859:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000020:00000040:19.0:1773851862.570859:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000049b021a0 : new refcount 525
00000100:00000001:17.0:1773851862.570859:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851862.570859:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:19.0:1773851862.570860:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851862.570860:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000bb50eb4 nid 22643@kfi7 refs 2
00000800:00000200:17.0:1773851862.570861:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 22643@kfi7(0000000026c3231e):0x0 lsk 2783 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ade Transaction freed
00000800:00000200:25.0:1773851862.600388:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.600389:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851862.600390:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851862.600392:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851862.600394:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17939@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.600395:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17939@kfi7 : PUT - for me
00000400:00000200:25.0:1773851862.600397:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17939@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.600397:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e42803f3 nid 17939@kfi7 refs 1
00000400:00000200:25.0:1773851862.600398:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17939@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.600399:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e42803f3 nid 17939@kfi7 refs 2
00000400:00000200:25.0:1773851862.600400:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e42803f3 nid 17939@kfi7 refs 3
00000400:00000200:25.0:1773851862.600400:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18130@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.600401:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18130@kfi7 of length 224 into portal 12 MB=0x69b4b8b5dc580
00000400:00000200:25.0:1773851862.600402:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18130@kfi7 of length 224/224 into md 0x16159c6179 [64] + 194488
00000400:00000010:25.0:1773851862.600403:0:2494371:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000003207d8c5.
00000400:00000200:25.0:1773851862.600404:0:2494371:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000a1e9dfd6
00000800:00000200:25.0:1773851862.600405:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851862.600407:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.600408:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17939@kfi7: PUT: OK
00000400:00000200:25.0:1773851862.600409:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a1e9dfd6
00000400:00000010:25.0:1773851862.600409:0:2494371:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 1144 at 00000000a1e9dfd6 (tot 253199627).
00000100:00000001:25.0:1773851862.600411:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851862.600411:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000040:25.0:1773851862.600412:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000034a07382 x1859598623294848 msgsize 224
00000100:00100000:25.0:1773851862.600414:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-18130@kfi7 (source: 12345-17939@kfi7)
00000100:00000040:25.0:1773851862.600415:0:2494371:0:(events.c:370:request_in_callback()) Buffer complete: 49 buffers still posted
00000100:00000001:25.0:1773851862.600416:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851862.600417:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e42803f3 nid 17939@kfi7 refs 2
00000800:00000200:25.0:1773851862.600418:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851862.600418:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851862.600419:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851862.600420:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851862.600421:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851862.600422:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851862.600423:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598623294848
00000020:00000001:24.0:1773851862.600424:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851862.600425:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d808c2
00000020:00000001:24.0:1773851862.600426:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851862.600427:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b07f7d3a refcount=5
00000020:00000001:24.0:1773851862.600428:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132181345280 : -106941528206336 : ffff9ebcbc331400)
00000020:00000001:24.0:1773851862.600429:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132181345280 : -106941528206336 : ffff9ebcbc331400)
00000100:00000001:24.0:1773851862.600431:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851862.600432:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851862.600433:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851862.600434:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851862.600436:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e07feb15.
00000100:00000001:24.0:1773851862.600437:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851862.600437:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851862.600438:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851862.600440:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851862.600441:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851862.600441:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.600443:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.600444:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851862.600445:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851862.600446:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18130@kfi7, seq: 2025080
00000100:00000001:24.0:1773851862.600446:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.600446:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:25.0:1773851862.600447:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b07f7d3a : new rpc_count 1
00000100:00000001:25.0:1773851862.600447:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636930012923984 : -107143696627632 : ffff9e8daa05c850)
00000100:00000001:24.0:1773851862.600447:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.600448:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851862.600449:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000034a07382 x1859598623294848/t0(0) o400->1b56f6b0-a4fe-4c6b-8a26-c08efbfb266c@18130@kfi7:79/0 lens 224/0 e 0 to 0 dl 1773852194 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1621-0'
00000100:00000001:25.0:1773851862.600451:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851862.600452:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851862.600453:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034a07382 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1b56f6b0-a4fe-4c6b-8a26-c08efbfb266c+5:39733:x1859598623294848:12345-18130@kfi7:400:default-tuolumne1621-0
00000100:00000200:25.0:1773851862.600454:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598623294848
00000020:00000001:25.0:1773851862.600455:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851862.600456:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851862.600457:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.600457:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851862.600458:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851862.600459:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851862.600459:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598623294848, found 0 last_xid 1859598623294847
00000020:00000001:25.0:1773851862.600460:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851862.600461:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851862.600461:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851862.600462:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.600463:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851862.600463:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851862.600464:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851862.600465:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000072fb7443.
02000000:00000001:25.0:1773851862.600465:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.600467:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.600468:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851862.600468:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262834304, transno 0, xid 1859598623294848
00010000:00000001:25.0:1773851862.600469:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851862.600470:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000034a07382 x1859598623294848/t0(0) o400->1b56f6b0-a4fe-4c6b-8a26-c08efbfb266c@18130@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1621-0'
00010000:00000001:25.0:1773851862.600473:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851862.600473:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851862.600474:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=95 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851862.600475:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851862.600476:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009df38717 refcount 3 to 18130@kfi7
00000100:00000001:25.0:1773851862.600476:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335008 : -107152617216608 : ffff9e8b965065a0)
02000000:00000001:25.0:1773851862.600477:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851862.600478:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.600479:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851862.600480:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17939@kfi7
00000400:00000010:25.0:1773851862.600480:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004613deb6.
00000100:00000200:25.0:1773851862.600481:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598623294848, offset 224
00000400:00000200:25.0:1773851862.600482:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17939@kfi7
00000400:00000200:25.0:1773851862.600483:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17939@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.600484:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e42803f3 nid 17939@kfi7 refs 1
00000400:00000200:25.0:1773851862.600485:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e42803f3 nid 17939@kfi7 refs 2
00000400:00000200:25.0:1773851862.600486:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e42803f3 nid 17939@kfi7 refs 3
00000400:00000200:25.0:1773851862.600487:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17939@kfi7 local destination
00000400:00000200:25.0:1773851862.600489:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769035:8769035:1024:4294967295] 17939@kfi7 LPNI seq info [14996776:14996776:16:4294967295]
00000400:00000200:25.0:1773851862.600490:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e42803f3 nid 17939@kfi7 refs 2
00000400:00000200:25.0:1773851862.600491:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17939@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.600493:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17939@kfi7(17939@kfi7:17939@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851862.600494:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e42803f3 nid 17939@kfi7 refs 3
00000800:00000200:25.0:1773851862.600495:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.600496:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851862.600501:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851862.600504:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd16 Using peer 17939@kfi7(0xd16)
00000800:00000200:25.0:1773851862.600507:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000055b583f: Posted send of 324 bytes to peer 0xd16: rc=0
00000800:00000200:25.0:1773851862.600508:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851862.600511:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851862.600511:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009df38717 refcount 2 to 18130@kfi7
00010000:00000001:25.0:1773851862.600512:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851862.600513:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.600513:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851862.600514:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000034a07382 x1859598623294848/t0(0) o400->1b56f6b0-a4fe-4c6b-8a26-c08efbfb266c@18130@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1621-0'
00000100:00100000:25.0:1773851862.600517:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034a07382 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1b56f6b0-a4fe-4c6b-8a26-c08efbfb266c+5:39733:x1859598623294848:12345-18130@kfi7:400:default-tuolumne1621-0 Request processed in 65us (104us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851862.600520:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18130@kfi7, seq: 2025080
00000100:00000040:25.0:1773851862.600521:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b07f7d3a : new rpc_count 0
00000100:00000001:25.0:1773851862.600522:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851862.600522:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851862.600523:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000800:00000200:27.0:1773851862.600524:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd16 TN_EVENT_TX_OK event status 0
00000020:00000010:25.0:1773851862.600524:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e07feb15.
00000020:00000010:25.0:1773851862.600525:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000400:00000200:27.0:1773851862.600526:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:25.0:1773851862.600526:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000b07f7d3a : new refcount 4
00000400:00000200:27.0:1773851862.600528:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17939@kfi7: PUT: OK
00000400:00000200:27.0:1773851862.600528:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004613deb6
00000400:00000010:27.0:1773851862.600529:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004613deb6.
00000100:00000001:27.0:1773851862.600529:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851862.600530:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851862.600531:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e42803f3 nid 17939@kfi7 refs 2
00000800:00000200:27.0:1773851862.600532:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 17939@kfi7(00000000d6bb1c04):0x0 lsk 3351 rsk 34 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd16 Transaction freed
02000000:00000001:25.0:1773851862.600599:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600599:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000072fb7443.
02000000:00000001:25.0:1773851862.600600:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
02000000:00000001:25.0:1773851862.600601:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600601:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e68cadd8.
02000000:00000001:25.0:1773851862.600602:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600602:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e9cae52.
02000000:00000001:25.0:1773851862.600604:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600604:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000041548332.
02000000:00000001:25.0:1773851862.600605:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600605:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bd36394d.
02000000:00000001:25.0:1773851862.600606:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600606:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012e7cd8f.
02000000:00000001:25.0:1773851862.600607:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600607:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa0be8a5.
02000000:00000001:25.0:1773851862.600608:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600609:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b8ced97a.
02000000:00000001:25.0:1773851862.600609:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600610:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002b6b44c1.
02000000:00000001:25.0:1773851862.600610:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600611:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000064d730de.
02000000:00000001:25.0:1773851862.600611:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600611:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b61f28b9.
02000000:00000001:25.0:1773851862.600612:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600612:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003f57bde1.
02000000:00000001:25.0:1773851862.600613:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600613:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000034c48f85.
02000000:00000001:25.0:1773851862.600614:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600614:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005db884a2.
02000000:00000001:25.0:1773851862.600615:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600615:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001153fcf2.
00000100:00000010:25.0:1773851862.600616:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b996e0dd.
02000000:00000001:25.0:1773851862.600616:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600617:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000672bd0ce.
02000000:00000001:25.0:1773851862.600617:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600618:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a49395e3.
02000000:00000001:25.0:1773851862.600618:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600619:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007e245e60.
02000000:00000001:25.0:1773851862.600619:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600619:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003d57fa12.
02000000:00000001:25.0:1773851862.600620:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600620:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008b2c37ad.
02000000:00000001:25.0:1773851862.600621:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600621:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3f68576.
02000000:00000001:25.0:1773851862.600622:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600623:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000058df43f4.
02000000:00000001:25.0:1773851862.600623:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600624:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a44e8848.
02000000:00000001:25.0:1773851862.600624:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600625:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dcf76327.
02000000:00000001:25.0:1773851862.600625:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600626:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8f925ba.
02000000:00000001:25.0:1773851862.600627:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600627:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a2a53643.
02000000:00000001:25.0:1773851862.600627:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600628:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000efe81d94.
02000000:00000001:25.0:1773851862.600628:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600629:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002af434f6.
02000000:00000001:25.0:1773851862.600629:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600630:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008d492367.
02000000:00000001:25.0:1773851862.600630:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600631:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000675bd0ea.
02000000:00000001:25.0:1773851862.600631:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600632:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000022be2f6e.
02000000:00000001:25.0:1773851862.600632:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600633:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000098cec3cc.
02000000:00000001:25.0:1773851862.600633:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600634:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008b7e9902.
00000100:00000010:25.0:1773851862.600634:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009aa40f9f.
02000000:00000001:25.0:1773851862.600635:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600635:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000432898d8.
02000000:00000001:25.0:1773851862.600636:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600636:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002c5ee9bb.
02000000:00000001:25.0:1773851862.600637:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600637:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000705a3f71.
02000000:00000001:25.0:1773851862.600638:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600638:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d2e52283.
02000000:00000001:25.0:1773851862.600639:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600639:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ab566ca3.
02000000:00000001:25.0:1773851862.600640:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600640:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eeeccb85.
02000000:00000001:25.0:1773851862.600641:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600641:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ea84f226.
02000000:00000001:25.0:1773851862.600643:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600643:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bbfcc57a.
02000000:00000001:25.0:1773851862.600644:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600644:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bd5c6346.
02000000:00000001:25.0:1773851862.600645:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600645:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004221a876.
02000000:00000001:25.0:1773851862.600646:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600646:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004e6a23b2.
02000000:00000001:25.0:1773851862.600647:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600647:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000d0d2edc.
02000000:00000001:25.0:1773851862.600648:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600648:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007e903d1e.
02000000:00000001:25.0:1773851862.600648:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600649:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000057d7ec23.
02000000:00000001:25.0:1773851862.600649:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600650:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bd49e8f6.
02000000:00000001:25.0:1773851862.600650:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600651:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000627f12de.
02000000:00000001:25.0:1773851862.600651:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600652:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000046c5624b.
02000000:00000001:25.0:1773851862.600652:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600652:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009ab9ccb.
02000000:00000001:25.0:1773851862.600653:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600653:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000c38d331.
02000000:00000001:25.0:1773851862.600654:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600654:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b64ba1d.
02000000:00000001:25.0:1773851862.600655:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600656:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000abee30ba.
02000000:00000001:25.0:1773851862.600656:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600656:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000555f5694.
02000000:00000001:25.0:1773851862.600657:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600658:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d5f0d58.
02000000:00000001:25.0:1773851862.600658:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600658:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000085e48411.
02000000:00000001:25.0:1773851862.600659:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600659:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f009aeee.
02000000:00000001:25.0:1773851862.600660:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600660:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cdaa9e3f.
02000000:00000001:25.0:1773851862.600661:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600661:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000608ed6cb.
02000000:00000001:25.0:1773851862.600662:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600662:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000208dfb3.
02000000:00000001:25.0:1773851862.600663:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600663:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009a093184.
02000000:00000001:25.0:1773851862.600664:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600664:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fcf8e826.
02000000:00000001:25.0:1773851862.600665:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600665:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000042031ddd.
02000000:00000001:25.0:1773851862.600666:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600666:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d89d810c.
02000000:00000001:25.0:1773851862.600667:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600667:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 000000007aa6ae5c.
02000000:00000001:25.0:1773851862.600668:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600668:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000944814f9.
02000000:00000001:25.0:1773851862.600669:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600669:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000a514a942.
02000000:00000001:25.0:1773851862.600670:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600670:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a7622945.
02000000:00000001:25.0:1773851862.600671:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600671:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f28122c3.
02000000:00000001:25.0:1773851862.600672:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600672:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004c01fc4.
02000000:00000001:25.0:1773851862.600673:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600673:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000051edfd8a.
02000000:00000001:25.0:1773851862.600673:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600674:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006d31b448.
02000000:00000001:25.0:1773851862.600674:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600675:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005928d584.
02000000:00000001:25.0:1773851862.600675:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600676:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8e67710.
02000000:00000001:25.0:1773851862.600676:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600676:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ef92a63.
02000000:00000001:25.0:1773851862.600677:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600677:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bb16047f.
02000000:00000001:25.0:1773851862.600678:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600678:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001eed40ae.
02000000:00000001:25.0:1773851862.600679:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600679:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a66fb627.
02000000:00000001:25.0:1773851862.600680:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600681:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000513e7f5d.
02000000:00000001:25.0:1773851862.600681:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600681:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000084986d7.
02000000:00000001:25.0:1773851862.600682:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600682:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000098c1846a.
02000000:00000001:25.0:1773851862.600683:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600683:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059547c5c.
02000000:00000001:25.0:1773851862.600684:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600684:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ab401516.
02000000:00000001:25.0:1773851862.600685:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600685:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000183c91d2.
02000000:00000001:25.0:1773851862.600685:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600686:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000da174bc7.
02000000:00000001:25.0:1773851862.600686:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600687:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000028637c2.
02000000:00000001:25.0:1773851862.600687:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600687:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000551f1b10.
02000000:00000001:25.0:1773851862.600689:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600689:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009a2f06a.
02000000:00000001:25.0:1773851862.600690:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600690:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b7c3de4.
02000000:00000001:25.0:1773851862.600690:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600691:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e1d60491.
02000000:00000001:25.0:1773851862.600692:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600692:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008455af9f.
02000000:00000001:25.0:1773851862.600693:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600693:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dc7c2ddc.
02000000:00000001:25.0:1773851862.600694:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600694:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000034faa970.
02000000:00000001:25.0:1773851862.600694:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600695:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c856867b.
02000000:00000001:25.0:1773851862.600695:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600696:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008385752c.
02000000:00000001:25.0:1773851862.600696:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600696:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004b40f7a7.
02000000:00000001:25.0:1773851862.600698:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600698:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eb31c54c.
02000000:00000001:25.0:1773851862.600698:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600699:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ee8342d1.
02000000:00000001:25.0:1773851862.600699:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600700:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000005e9bf30.
02000000:00000001:25.0:1773851862.600700:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600700:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b9614c8c.
02000000:00000001:25.0:1773851862.600701:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600701:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001febf1e2.
02000000:00000001:25.0:1773851862.600702:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600702:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bbc4c3a8.
02000000:00000001:25.0:1773851862.600703:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600703:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a145e70f.
02000000:00000001:25.0:1773851862.600704:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600704:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006fc2723e.
02000000:00000001:25.0:1773851862.600705:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600705:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a6d93ea.
02000000:00000001:25.0:1773851862.600706:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600706:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de404431.
02000000:00000001:25.0:1773851862.600707:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600708:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000018144b84.
02000000:00000001:25.0:1773851862.600708:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600708:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000141c4f41.
02000000:00000001:25.0:1773851862.600709:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600710:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e0eb9528.
02000000:00000001:25.0:1773851862.600710:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600711:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0ee1094.
02000000:00000001:25.0:1773851862.600711:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600712:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003510becf.
02000000:00000001:25.0:1773851862.600712:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600713:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000220e4f48.
02000000:00000001:25.0:1773851862.600713:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600714:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2acf0ac.
02000000:00000001:25.0:1773851862.600714:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600715:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009de18498.
02000000:00000001:25.0:1773851862.600715:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600716:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000a162df5.
02000000:00000001:25.0:1773851862.600717:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600717:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000799807de.
02000000:00000001:25.0:1773851862.600718:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600718:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e7a55f53.
02000000:00000001:25.0:1773851862.600719:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600719:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000effa70cf.
02000000:00000001:25.0:1773851862.600720:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600720:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d6e438f.
02000000:00000001:25.0:1773851862.600721:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600721:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019f4fbde.
02000000:00000001:25.0:1773851862.600722:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600722:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fb90590c.
02000000:00000001:25.0:1773851862.600723:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600723:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000096a30520.
02000000:00000001:25.0:1773851862.600724:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600730:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fc35920a.
02000000:00000001:25.0:1773851862.600731:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600731:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000091974c3.
02000000:00000001:25.0:1773851862.600732:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600732:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006141ce54.
02000000:00000001:25.0:1773851862.600733:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600733:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000073ba5f86.
02000000:00000001:25.0:1773851862.600734:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600734:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ef27e244.
02000000:00000001:25.0:1773851862.600735:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600735:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000014024df8.
02000000:00000001:25.0:1773851862.600736:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600736:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000212fefaf.
02000000:00000001:25.0:1773851862.600737:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600737:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a051d7b9.
02000000:00000001:25.0:1773851862.600738:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600739:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000032c8824f.
02000000:00000001:25.0:1773851862.600739:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600740:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000148c428c.
02000000:00000001:25.0:1773851862.600740:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600741:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003b1c1f82.
02000000:00000001:25.0:1773851862.600741:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600742:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059041441.
02000000:00000001:25.0:1773851862.600745:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600746:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fafa2dd4.
02000000:00000001:25.0:1773851862.600746:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600747:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000088dd1c52.
02000000:00000001:25.0:1773851862.600748:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600748:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a5a8426.
02000000:00000001:25.0:1773851862.600749:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600749:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000000d2a136.
02000000:00000001:25.0:1773851862.600750:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600750:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d9da52d7.
02000000:00000001:25.0:1773851862.600751:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600752:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3f7432e.
02000000:00000001:25.0:1773851862.600752:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600753:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009e7a1a5c.
02000000:00000001:25.0:1773851862.600754:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600754:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000080b8baeb.
02000000:00000001:25.0:1773851862.600755:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600755:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bafb0391.
02000000:00000001:25.0:1773851862.600756:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600756:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000032a4fb2f.
02000000:00000001:25.0:1773851862.600757:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600757:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000058bf6f62.
02000000:00000001:25.0:1773851862.600758:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600758:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000048cfb8d.
02000000:00000001:25.0:1773851862.600759:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600760:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000070096ce4.
02000000:00000001:25.0:1773851862.600761:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600761:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006148d14d.
02000000:00000001:25.0:1773851862.600762:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600762:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009a0afe1c.
02000000:00000001:25.0:1773851862.600763:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600763:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a0b14edb.
02000000:00000001:25.0:1773851862.600764:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600764:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009761a980.
02000000:00000001:25.0:1773851862.600765:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600765:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f304db48.
02000000:00000001:25.0:1773851862.600766:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600766:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000235e3072.
02000000:00000001:25.0:1773851862.600767:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600768:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f2cd5a8.
02000000:00000001:25.0:1773851862.600769:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600769:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007604b982.
02000000:00000001:25.0:1773851862.600770:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600770:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002105edc.
02000000:00000001:25.0:1773851862.600771:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600771:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a92a00a.
02000000:00000001:25.0:1773851862.600772:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600773:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c09f87b6.
02000000:00000001:25.0:1773851862.600774:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600774:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094623f1c.
02000000:00000001:25.0:1773851862.600775:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600775:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc558864.
02000000:00000001:25.0:1773851862.600776:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600776:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000406c5c5d.
02000000:00000001:25.0:1773851862.600777:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600777:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b135396e.
02000000:00000001:25.0:1773851862.600778:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600779:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009de66690.
02000000:00000001:25.0:1773851862.600779:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600779:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef38cee9.
02000000:00000001:25.0:1773851862.600780:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600781:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e0b1d4df.
02000000:00000001:25.0:1773851862.600781:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600782:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f583c4e5.
02000000:00000001:25.0:1773851862.600782:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600783:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002680675f.
02000000:00000001:25.0:1773851862.600783:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600784:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008f2d22e1.
02000000:00000001:25.0:1773851862.600785:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600785:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a1dce4c.
02000000:00000001:25.0:1773851862.600786:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600786:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000f4696a5.
02000000:00000001:25.0:1773851862.600787:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600787:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e6f98a36.
02000000:00000001:25.0:1773851862.600788:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600788:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a59368d2.
02000000:00000001:25.0:1773851862.600789:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600790:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 0000000077722c8b.
02000000:00000001:25.0:1773851862.600790:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600791:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000099a9d79f.
02000000:00000001:25.0:1773851862.600792:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600792:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000078d8cb2.
02000000:00000001:25.0:1773851862.600793:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600793:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000346cb435.
02000000:00000001:25.0:1773851862.600794:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600794:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ed66348.
02000000:00000001:25.0:1773851862.600795:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600796:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008c0662e2.
02000000:00000001:25.0:1773851862.600797:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600797:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a209cb56.
02000000:00000001:25.0:1773851862.600798:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600798:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad67d367.
02000000:00000001:25.0:1773851862.600799:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600799:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cf930eb1.
02000000:00000001:25.0:1773851862.600800:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600800:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eea97453.
02000000:00000001:25.0:1773851862.600801:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600801:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000096e9a685.
02000000:00000001:25.0:1773851862.600802:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600802:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d673ba28.
02000000:00000001:25.0:1773851862.600803:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600804:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a577a8ee.
02000000:00000001:25.0:1773851862.600804:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600805:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000d8082cf.
02000000:00000001:25.0:1773851862.600806:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600806:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d844fe80.
02000000:00000001:25.0:1773851862.600807:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600807:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004aefacb6.
02000000:00000001:25.0:1773851862.600808:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600808:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000fdacfcb.
02000000:00000001:25.0:1773851862.600809:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600809:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005abc3cdc.
02000000:00000001:25.0:1773851862.600810:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600811:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000701caed7.
02000000:00000001:25.0:1773851862.600812:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600812:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006f14baa6.
02000000:00000001:25.0:1773851862.600813:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600814:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e3711358.
02000000:00000001:25.0:1773851862.600814:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600814:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019d9ce3f.
02000000:00000001:25.0:1773851862.600815:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600816:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fdbe9526.
02000000:00000001:25.0:1773851862.600816:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600817:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e6c76313.
02000000:00000001:25.0:1773851862.600818:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600818:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000008ce1370.
02000000:00000001:25.0:1773851862.600819:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600819:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004018af9.
02000000:00000001:25.0:1773851862.600820:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600820:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000a5f70c88.
02000000:00000001:25.0:1773851862.600821:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600822:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004e0d19c.
02000000:00000001:25.0:1773851862.600823:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600823:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f59bcba6.
02000000:00000001:25.0:1773851862.600824:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600824:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b3324020.
02000000:00000001:25.0:1773851862.600825:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600825:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a04e43cf.
02000000:00000001:25.0:1773851862.600826:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600827:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005458c11e.
02000000:00000001:25.0:1773851862.600828:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600828:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d49fc790.
02000000:00000001:25.0:1773851862.600829:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600829:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ac61fd2.
02000000:00000001:25.0:1773851862.600830:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600830:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cb6b840d.
02000000:00000001:25.0:1773851862.600831:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600831:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000041618f55.
02000000:00000001:25.0:1773851862.600832:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600832:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003169c902.
02000000:00000001:25.0:1773851862.600833:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600833:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001eaca096.
02000000:00000001:25.0:1773851862.600834:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600835:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e6203540.
02000000:00000001:25.0:1773851862.600835:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600836:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e198c7f.
02000000:00000001:25.0:1773851862.600836:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600837:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007e74f954.
02000000:00000001:25.0:1773851862.600837:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600838:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004f8a81ec.
02000000:00000001:25.0:1773851862.600838:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600839:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000595ead8e.
02000000:00000001:25.0:1773851862.600840:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600840:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002fe71d34.
02000000:00000001:25.0:1773851862.600841:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600841:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001a4d8d2b.
02000000:00000001:25.0:1773851862.600842:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600842:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005aac1b69.
02000000:00000001:25.0:1773851862.600843:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600843:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000006c60091.
02000000:00000001:25.0:1773851862.600844:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600844:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000022fbe4e.
02000000:00000001:25.0:1773851862.600845:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600845:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003315cf47.
02000000:00000001:25.0:1773851862.600846:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600846:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e5cd3255.
02000000:00000001:25.0:1773851862.600847:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600847:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a47c1d3e.
02000000:00000001:25.0:1773851862.600848:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600848:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000225d5d21.
02000000:00000001:25.0:1773851862.600849:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600850:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005aa1af90.
02000000:00000001:25.0:1773851862.600851:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600851:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b62568d0.
02000000:00000001:25.0:1773851862.600852:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600852:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000ce8cfc9a.
02000000:00000001:25.0:1773851862.600853:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600853:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ff117436.
02000000:00000001:25.0:1773851862.600854:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600855:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e35eaf8a.
02000000:00000001:25.0:1773851862.600855:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600856:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008eaf1457.
02000000:00000001:25.0:1773851862.600857:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600857:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009c4b10b3.
02000000:00000001:25.0:1773851862.600858:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600858:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb3be497.
02000000:00000001:25.0:1773851862.600859:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600860:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000ba33b6e.
02000000:00000001:25.0:1773851862.600860:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600861:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009fd1188.
02000000:00000001:25.0:1773851862.600861:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600862:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b896761.
02000000:00000001:25.0:1773851862.600862:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600863:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000077dee1e0.
02000000:00000001:25.0:1773851862.600863:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600864:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000080c5dea5.
02000000:00000001:25.0:1773851862.600864:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600865:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cc6c6d7.
02000000:00000001:25.0:1773851862.600865:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600866:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d0f4f7ce.
02000000:00000001:25.0:1773851862.600867:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600867:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa944152.
02000000:00000001:25.0:1773851862.600868:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600868:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ccd1d304.
02000000:00000001:25.0:1773851862.600869:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600869:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac6bf677.
02000000:00000001:25.0:1773851862.600870:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600871:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007014c28b.
02000000:00000001:25.0:1773851862.600871:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600872:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001074a3fb.
02000000:00000001:25.0:1773851862.600873:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600873:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000afa555c.
02000000:00000001:25.0:1773851862.600874:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600874:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b134057a.
02000000:00000001:25.0:1773851862.600875:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600876:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ab086da7.
02000000:00000001:25.0:1773851862.600876:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600877:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000affcb1f.
02000000:00000001:25.0:1773851862.600878:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600879:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000062e9d44a.
02000000:00000001:25.0:1773851862.600879:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600880:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac47081b.
02000000:00000001:25.0:1773851862.600881:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600881:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004f3e931b.
02000000:00000001:25.0:1773851862.600882:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600882:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8729e19.
02000000:00000001:25.0:1773851862.600883:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600883:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d6d4411f.
02000000:00000001:25.0:1773851862.600884:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600885:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000506195cb.
02000000:00000001:25.0:1773851862.600885:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600886:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e94d05e9.
02000000:00000001:25.0:1773851862.600886:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600887:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f227d1de.
02000000:00000001:25.0:1773851862.600887:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600888:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000040fcb889.
02000000:00000001:25.0:1773851862.600888:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600889:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a10de78a.
02000000:00000001:25.0:1773851862.600890:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600890:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000478910dd.
02000000:00000001:25.0:1773851862.600891:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600891:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fbda7d6a.
02000000:00000001:25.0:1773851862.600892:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600892:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cbf2f99f.
02000000:00000001:25.0:1773851862.600893:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600893:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f2dd2d8c.
02000000:00000001:25.0:1773851862.600894:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600894:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000015569857.
02000000:00000001:25.0:1773851862.600895:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600895:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007ef5e3e1.
02000000:00000001:25.0:1773851862.600896:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600896:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000004dd39f85.
02000000:00000001:25.0:1773851862.600897:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600898:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000475f68c8.
02000000:00000001:25.0:1773851862.600898:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600899:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e35d61d.
02000000:00000001:25.0:1773851862.600900:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600900:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bd1998f3.
02000000:00000001:25.0:1773851862.600901:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600901:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000484380f2.
02000000:00000001:25.0:1773851862.600902:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600902:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f32a98e2.
02000000:00000001:25.0:1773851862.600903:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600904:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002ef88b8b.
02000000:00000001:25.0:1773851862.600904:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600905:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aba1de74.
02000000:00000001:25.0:1773851862.600905:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600906:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000d1951e94.
02000000:00000001:25.0:1773851862.600906:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600907:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aab39da6.
02000000:00000001:25.0:1773851862.600908:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600908:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000eb9da9ee.
02000000:00000001:25.0:1773851862.600909:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600909:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c24f6328.
02000000:00000001:25.0:1773851862.600910:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600910:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007f709d10.
02000000:00000001:25.0:1773851862.600911:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600911:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a578e67d.
02000000:00000001:25.0:1773851862.600912:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600913:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000518204c1.
02000000:00000001:25.0:1773851862.600914:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600914:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b35d66de.
02000000:00000001:25.0:1773851862.600915:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600915:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000020a39a23.
02000000:00000001:25.0:1773851862.600916:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600916:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000113419e5.
02000000:00000001:25.0:1773851862.600917:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600917:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000380c6d33.
02000000:00000001:25.0:1773851862.600918:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600918:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000214d7383.
02000000:00000001:25.0:1773851862.600919:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600919:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d912681d.
02000000:00000001:25.0:1773851862.600920:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600920:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c8d74690.
02000000:00000001:25.0:1773851862.600922:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600922:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bf7ee703.
02000000:00000001:25.0:1773851862.600923:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600923:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002bca2e7f.
02000000:00000001:25.0:1773851862.600924:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600925:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000adb1c912.
02000000:00000001:25.0:1773851862.600925:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600926:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002c6895b2.
02000000:00000001:25.0:1773851862.600927:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600927:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f0ece6aa.
02000000:00000001:25.0:1773851862.600928:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600928:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6ff09e1.
02000000:00000001:25.0:1773851862.600929:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600929:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000544aee6d.
02000000:00000001:25.0:1773851862.600930:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600930:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000005fb469a.
02000000:00000001:25.0:1773851862.600931:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600932:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e34febe9.
02000000:00000001:25.0:1773851862.600932:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600932:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bf914492.
02000000:00000001:25.0:1773851862.600933:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600933:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b5632e2e.
02000000:00000001:25.0:1773851862.600934:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600934:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a321871.
02000000:00000001:25.0:1773851862.600935:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600935:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000f63bebdf.
02000000:00000001:25.0:1773851862.600936:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600936:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cbc3fcc6.
02000000:00000001:25.0:1773851862.600937:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600937:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e1133071.
02000000:00000001:25.0:1773851862.600938:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600938:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000726c42bc.
02000000:00000001:25.0:1773851862.600939:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600939:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005b64f45e.
02000000:00000001:25.0:1773851862.600940:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600940:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a0808b38.
02000000:00000001:25.0:1773851862.600940:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600941:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001e2b870f.
02000000:00000001:25.0:1773851862.600942:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600942:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036c651b3.
02000000:00000001:25.0:1773851862.600943:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600943:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000063f32784.
02000000:00000001:25.0:1773851862.600944:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600944:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e108f3b1.
02000000:00000001:25.0:1773851862.600945:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600945:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d9e2ce2b.
02000000:00000001:25.0:1773851862.600945:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600946:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c37eff7d.
02000000:00000001:25.0:1773851862.600946:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600947:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012ffae59.
02000000:00000001:25.0:1773851862.600947:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600948:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006eb1fdc1.
02000000:00000001:25.0:1773851862.600948:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600949:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d444da2.
02000000:00000001:25.0:1773851862.600949:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600950:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f2c69afa.
02000000:00000001:25.0:1773851862.600950:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600951:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007db11619.
02000000:00000001:25.0:1773851862.600951:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600952:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec036e0e.
02000000:00000001:25.0:1773851862.600952:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600953:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000070cf1539.
02000000:00000001:25.0:1773851862.600954:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600954:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009584d2d2.
02000000:00000001:25.0:1773851862.600954:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600955:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000088244b38.
02000000:00000001:25.0:1773851862.600955:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600956:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000015141a84.
02000000:00000001:25.0:1773851862.600956:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600957:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c9e6a04.
02000000:00000001:25.0:1773851862.600957:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600958:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008c2297ed.
02000000:00000001:25.0:1773851862.600959:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600959:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000597fc94.
02000000:00000001:25.0:1773851862.600959:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600960:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004fb15b8b.
02000000:00000001:25.0:1773851862.600961:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600961:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008506402b.
02000000:00000001:25.0:1773851862.600962:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600962:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f09d431f.
02000000:00000001:25.0:1773851862.600963:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600963:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b340f2af.
02000000:00000001:25.0:1773851862.600964:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600964:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005a176b85.
02000000:00000001:25.0:1773851862.600965:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600965:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000234c7c6e.
02000000:00000001:25.0:1773851862.600966:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600966:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002015821e.
02000000:00000001:25.0:1773851862.600967:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600967:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008d541088.
02000000:00000001:25.0:1773851862.600968:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600968:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a9011dfb.
02000000:00000001:25.0:1773851862.600969:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600969:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000043d0394d.
02000000:00000001:25.0:1773851862.600970:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600970:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001b36d944.
02000000:00000001:25.0:1773851862.600971:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600971:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001b4ca844.
02000000:00000001:25.0:1773851862.600971:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600972:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037904bea.
02000000:00000001:25.0:1773851862.600973:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600973:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d6c60253.
02000000:00000001:25.0:1773851862.600973:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600974:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d27d8f9f.
02000000:00000001:25.0:1773851862.600974:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600975:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000984a8ba3.
02000000:00000001:25.0:1773851862.600975:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600975:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c1734e63.
02000000:00000001:25.0:1773851862.600976:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600976:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000001cad9d1.
02000000:00000001:25.0:1773851862.600977:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600977:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006cf44ced.
02000000:00000001:25.0:1773851862.600977:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600978:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000054360810.
02000000:00000001:25.0:1773851862.600979:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600979:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000048de3a3a.
02000000:00000001:25.0:1773851862.600980:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600981:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d67847c3.
02000000:00000001:25.0:1773851862.600981:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600981:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b4b3eec.
02000000:00000001:25.0:1773851862.600982:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600982:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008233a45c.
02000000:00000001:25.0:1773851862.600983:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600983:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000748508ef.
02000000:00000001:25.0:1773851862.600983:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600984:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000340eb03e.
02000000:00000001:25.0:1773851862.600984:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600985:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002bf25e30.
02000000:00000001:25.0:1773851862.600985:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600986:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000afc76ff2.
02000000:00000001:25.0:1773851862.600986:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600986:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c98d2093.
02000000:00000001:25.0:1773851862.600987:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600987:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000cd7337e7.
02000000:00000001:25.0:1773851862.600988:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600988:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037d6c505.
02000000:00000001:25.0:1773851862.600989:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600989:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006d023ec5.
02000000:00000001:25.0:1773851862.600990:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600990:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd21bdbb.
02000000:00000001:25.0:1773851862.600991:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600991:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005f93c966.
02000000:00000001:25.0:1773851862.600991:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600992:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad2aeba4.
02000000:00000001:25.0:1773851862.600992:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600993:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b9c56ef.
02000000:00000001:25.0:1773851862.600993:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600994:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007e3965ac.
00000100:00000010:25.0:1773851862.600994:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e3b68a3.
00000100:00000010:25.0:1773851862.600995:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002bbac90d.
02000000:00000001:25.0:1773851862.600996:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600996:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094305bc7.
02000000:00000001:25.0:1773851862.600997:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600997:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef6d5fdf.
02000000:00000001:25.0:1773851862.600998:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.600998:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d45f71fb.
02000000:00000001:25.0:1773851862.600999:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.600999:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c2642f5a.
02000000:00000001:25.0:1773851862.601000:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601000:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d79f050.
02000000:00000001:25.0:1773851862.601001:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601001:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ec7f862.
02000000:00000001:25.0:1773851862.601002:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601002:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000037843346.
02000000:00000001:25.0:1773851862.601003:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601003:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000781762b2.
02000000:00000001:25.0:1773851862.601004:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601004:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002052a33f.
02000000:00000001:25.0:1773851862.601005:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601005:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5e6c55d.
02000000:00000001:25.0:1773851862.601006:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601006:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000576d2344.
02000000:00000001:25.0:1773851862.601007:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601008:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d9026bde.
02000000:00000001:25.0:1773851862.601009:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601009:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a08af97f.
02000000:00000001:25.0:1773851862.601009:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601010:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dcd5b4dd.
02000000:00000001:25.0:1773851862.601011:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601011:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eaf8ee9c.
02000000:00000001:25.0:1773851862.601012:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601012:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b26abaab.
02000000:00000001:25.0:1773851862.601013:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601013:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f3230d51.
02000000:00000001:25.0:1773851862.601014:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601014:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ab30cfd0.
02000000:00000001:25.0:1773851862.601015:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601015:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001250cd49.
02000000:00000001:25.0:1773851862.601016:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601017:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006e39f5c1.
02000000:00000001:25.0:1773851862.601017:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601018:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b83bc4fb.
02000000:00000001:25.0:1773851862.601018:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601019:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eef55fb9.
02000000:00000001:25.0:1773851862.601019:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601020:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003e3f849f.
02000000:00000001:25.0:1773851862.601020:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601020:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a1dbb62.
02000000:00000001:25.0:1773851862.601021:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601021:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000051c4f9c3.
02000000:00000001:25.0:1773851862.601022:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601022:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d168a8c5.
02000000:00000001:25.0:1773851862.601023:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601023:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cf2e8ec6.
02000000:00000001:25.0:1773851862.601024:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601025:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b05c918b.
02000000:00000001:25.0:1773851862.601025:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601025:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a505153.
02000000:00000001:25.0:1773851862.601026:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601026:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002bdc99d8.
02000000:00000001:25.0:1773851862.601027:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601027:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006ebb92f5.
02000000:00000001:25.0:1773851862.601028:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601028:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024eb5b9f.
02000000:00000001:25.0:1773851862.601029:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601029:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000059c4c7b2.
02000000:00000001:25.0:1773851862.601030:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601030:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fe48352d.
02000000:00000001:25.0:1773851862.601030:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601031:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c1d64839.
02000000:00000001:25.0:1773851862.601031:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601032:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000090b6b8a6.
02000000:00000001:25.0:1773851862.601032:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601032:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005b63bd43.
02000000:00000001:25.0:1773851862.601033:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601033:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000015f0d13.
02000000:00000001:25.0:1773851862.601034:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601034:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094b42665.
02000000:00000001:25.0:1773851862.601035:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601035:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dea8c683.
02000000:00000001:25.0:1773851862.601036:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601037:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000665199af.
02000000:00000001:25.0:1773851862.601037:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601037:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d474fd46.
02000000:00000001:25.0:1773851862.601038:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601038:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000c06fd804.
02000000:00000001:25.0:1773851862.601039:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601039:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8144ec5.
02000000:00000001:25.0:1773851862.601040:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601040:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ffdf2984.
02000000:00000001:25.0:1773851862.601041:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601041:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a05fbc91.
02000000:00000001:25.0:1773851862.601042:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601042:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003f22a999.
02000000:00000001:25.0:1773851862.601043:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601043:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006c134c4d.
02000000:00000001:25.0:1773851862.601044:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601045:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000315c62e0.
02000000:00000001:25.0:1773851862.601045:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601046:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c3bca27.
02000000:00000001:25.0:1773851862.601046:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601047:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002515f83d.
02000000:00000001:25.0:1773851862.601047:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601048:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d08bd7e.
02000000:00000001:25.0:1773851862.601048:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601048:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000774d9dff.
02000000:00000001:25.0:1773851862.601049:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601049:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ff7c238f.
02000000:00000001:25.0:1773851862.601050:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601051:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000033c9872.
02000000:00000001:25.0:1773851862.601051:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601052:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000532282c0.
02000000:00000001:25.0:1773851862.601052:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601053:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069c57ba4.
02000000:00000001:25.0:1773851862.601053:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601054:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000473bf405.
02000000:00000001:25.0:1773851862.601055:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601055:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cd7ae2bc.
02000000:00000001:25.0:1773851862.601056:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601056:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000fb26bbb.
02000000:00000001:25.0:1773851862.601057:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601057:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005f081a8f.
02000000:00000001:25.0:1773851862.601058:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601058:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000065f48b03.
02000000:00000001:25.0:1773851862.601059:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601059:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bcfbef52.
02000000:00000001:25.0:1773851862.601059:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601060:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa10787b.
02000000:00000001:25.0:1773851862.601060:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601061:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003aebad29.
02000000:00000001:25.0:1773851862.601061:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601062:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000082103b3d.
02000000:00000001:25.0:1773851862.601062:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601062:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000df520c99.
02000000:00000001:25.0:1773851862.601063:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601063:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005f7bca6d.
02000000:00000001:25.0:1773851862.601064:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601064:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000057eb748.
02000000:00000001:25.0:1773851862.601065:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601065:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5a8b775.
02000000:00000001:25.0:1773851862.601065:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601066:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d970038c.
02000000:00000001:25.0:1773851862.601066:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601067:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002c1a939e.
02000000:00000001:25.0:1773851862.601068:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601068:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000037ba630a.
02000000:00000001:25.0:1773851862.601069:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601069:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002b3ced59.
02000000:00000001:25.0:1773851862.601070:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601070:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dee278ba.
02000000:00000001:25.0:1773851862.601071:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601071:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004543c73d.
02000000:00000001:25.0:1773851862.601071:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601074:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000e82d1399.
02000000:00000001:25.0:1773851862.601075:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601075:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000002c4656.
02000000:00000001:25.0:1773851862.601076:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601076:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ff958e1a.
02000000:00000001:25.0:1773851862.601077:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601077:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094c67333.
02000000:00000001:25.0:1773851862.601078:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601078:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d1f1abd8.
02000000:00000001:25.0:1773851862.601079:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601079:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000927dde8f.
02000000:00000001:25.0:1773851862.601079:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601080:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f439e7a8.
02000000:00000001:25.0:1773851862.601080:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601081:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003cf3879b.
02000000:00000001:25.0:1773851862.601081:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601082:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006c26fa97.
02000000:00000001:25.0:1773851862.601082:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601083:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e5928711.
02000000:00000001:25.0:1773851862.601083:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601084:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000de394f56.
02000000:00000001:25.0:1773851862.601084:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601084:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002e80d50a.
02000000:00000001:25.0:1773851862.601085:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601085:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005de3b971.
02000000:00000001:25.0:1773851862.601086:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601086:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d7fe3e71.
02000000:00000001:25.0:1773851862.601087:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601087:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000827449dc.
02000000:00000001:25.0:1773851862.601088:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601088:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024e7fa8e.
02000000:00000001:25.0:1773851862.601089:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601089:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fafae5e9.
02000000:00000001:25.0:1773851862.601090:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601090:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f89e289e.
02000000:00000001:25.0:1773851862.601091:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601091:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d98938b3.
02000000:00000001:25.0:1773851862.601092:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601092:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025fa8e38.
02000000:00000001:25.0:1773851862.601093:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601093:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008d2af7f5.
02000000:00000001:25.0:1773851862.601094:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601094:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d2847d14.
02000000:00000001:25.0:1773851862.601095:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601095:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000083533ee1.
02000000:00000001:25.0:1773851862.601096:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601096:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000040e009fc.
02000000:00000001:25.0:1773851862.601097:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601097:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000008c83f9c.
02000000:00000001:25.0:1773851862.601098:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601098:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000be0ae069.
02000000:00000001:25.0:1773851862.601099:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601099:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f33100c5.
02000000:00000001:25.0:1773851862.601100:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601100:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ac001dc.
02000000:00000001:25.0:1773851862.601101:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601101:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002566126a.
02000000:00000001:25.0:1773851862.601102:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601102:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007ccaba6.
02000000:00000001:25.0:1773851862.601103:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601103:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b2f1368.
02000000:00000001:25.0:1773851862.601103:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601104:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000047db666c.
02000000:00000001:25.0:1773851862.601104:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601105:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000092a3d83.
02000000:00000001:25.0:1773851862.601105:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601105:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c9bc02f8.
02000000:00000001:25.0:1773851862.601106:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601106:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000cdf9c17.
02000000:00000001:25.0:1773851862.601107:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601107:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094526129.
02000000:00000001:25.0:1773851862.601108:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601108:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003f8789ef.
02000000:00000001:25.0:1773851862.601109:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601109:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fe784b79.
02000000:00000001:25.0:1773851862.601110:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601110:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009c9ea9ff.
02000000:00000001:25.0:1773851862.601111:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601111:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ea16e1f1.
02000000:00000001:25.0:1773851862.601112:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601112:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000021f531b0.
02000000:00000001:25.0:1773851862.601113:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601113:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004fa26256.
02000000:00000001:25.0:1773851862.601114:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601115:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003e592339.
02000000:00000001:25.0:1773851862.601115:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601116:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc0031e2.
02000000:00000001:25.0:1773851862.601116:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601117:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d04b376c.
02000000:00000001:25.0:1773851862.601117:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601117:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad3f4743.
02000000:00000001:25.0:1773851862.601118:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601118:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000180663bf.
02000000:00000001:25.0:1773851862.601119:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601119:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000425b61f5.
02000000:00000001:25.0:1773851862.601120:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601120:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000028f962.
02000000:00000001:25.0:1773851862.601121:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601121:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001084d7ed.
02000000:00000001:25.0:1773851862.601122:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601122:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ae51d10.
02000000:00000001:25.0:1773851862.601123:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601123:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cb78fdde.
02000000:00000001:25.0:1773851862.601124:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601124:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002df47426.
02000000:00000001:25.0:1773851862.601125:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601125:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000018a5f714.
02000000:00000001:25.0:1773851862.601126:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601127:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000df273c39.
02000000:00000001:25.0:1773851862.601127:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601127:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f062172b.
02000000:00000001:25.0:1773851862.601128:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601129:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000db598119.
02000000:00000001:25.0:1773851862.601129:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601130:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ae94b46.
02000000:00000001:25.0:1773851862.601131:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601131:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007e7e9012.
02000000:00000001:25.0:1773851862.601132:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601132:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000837d256e.
02000000:00000001:25.0:1773851862.601133:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601134:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f52f9fc5.
02000000:00000001:25.0:1773851862.601134:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601134:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000003b8133c.
02000000:00000001:25.0:1773851862.601135:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601135:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000004ed91d8b.
02000000:00000001:25.0:1773851862.601136:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601136:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b03b0112.
02000000:00000001:25.0:1773851862.601137:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601137:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002ccd440f.
02000000:00000001:25.0:1773851862.601138:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601139:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000078ec5d9d.
02000000:00000001:25.0:1773851862.601139:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601140:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000076cd9455.
02000000:00000001:25.0:1773851862.601140:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601140:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cf0dcbf.
02000000:00000001:25.0:1773851862.601141:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601142:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000791e7564.
02000000:00000001:25.0:1773851862.601142:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601142:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ec99cde.
02000000:00000001:25.0:1773851862.601143:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601143:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c92d8f22.
02000000:00000001:25.0:1773851862.601144:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601144:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000049dd7f6f.
02000000:00000001:25.0:1773851862.601145:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601145:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002076162a.
02000000:00000001:25.0:1773851862.601146:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601146:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000080d27dd.
02000000:00000001:25.0:1773851862.601147:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601147:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a5f90344.
02000000:00000001:25.0:1773851862.601148:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601148:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000074cbb0b2.
02000000:00000001:25.0:1773851862.601149:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601149:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad34cfa7.
02000000:00000001:25.0:1773851862.601150:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601150:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dda20cda.
02000000:00000001:25.0:1773851862.601151:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601151:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005dacbf68.
02000000:00000001:25.0:1773851862.601152:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601152:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b6c7f87b.
02000000:00000001:25.0:1773851862.601153:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601153:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000049594d42.
02000000:00000001:25.0:1773851862.601154:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601154:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a4d023c9.
02000000:00000001:25.0:1773851862.601155:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601155:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000118e29c5.
02000000:00000001:25.0:1773851862.601156:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601156:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ac56eb5.
02000000:00000001:25.0:1773851862.601157:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601157:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000065f7d440.
02000000:00000001:25.0:1773851862.601158:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601158:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ae836e8.
02000000:00000001:25.0:1773851862.601159:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601159:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008be1209c.
02000000:00000001:25.0:1773851862.601160:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601160:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007aee9a98.
02000000:00000001:25.0:1773851862.601161:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601161:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dc6de66f.
02000000:00000001:25.0:1773851862.601162:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601162:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eb28bb44.
02000000:00000001:25.0:1773851862.601163:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601163:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 656 at 00000000733493cd.
02000000:00000001:25.0:1773851862.601164:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601164:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000cd23a73.
02000000:00000001:25.0:1773851862.601165:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601165:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 1336 at 00000000596b4df7.
02000000:00000001:25.0:1773851862.601166:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601166:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000052c9fab.
02000000:00000001:25.0:1773851862.601167:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601168:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 000000006133b8aa.
02000000:00000001:25.0:1773851862.601168:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601169:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b2772bea.
02000000:00000001:25.0:1773851862.601170:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601170:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 656 at 0000000034c388a3.
02000000:00000001:25.0:1773851862.601171:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601171:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c2d7d05.
02000000:00000001:25.0:1773851862.601172:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601173:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a3523ba1.
02000000:00000001:25.0:1773851862.601173:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601174:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042e04729.
02000000:00000001:25.0:1773851862.601174:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601175:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f3612753.
02000000:00000001:25.0:1773851862.601175:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601176:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce99d349.
02000000:00000001:25.0:1773851862.601177:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601177:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000488e1eac.
02000000:00000001:25.0:1773851862.601178:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601178:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eaba38c3.
02000000:00000001:25.0:1773851862.601179:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601180:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a539b16.
02000000:00000001:25.0:1773851862.601180:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601181:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000635a3e74.
02000000:00000001:25.0:1773851862.601181:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601182:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ea93d355.
02000000:00000001:25.0:1773851862.601182:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601183:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1860a60.
02000000:00000001:25.0:1773851862.601184:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601184:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce2082d2.
02000000:00000001:25.0:1773851862.601185:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601185:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006a980a26.
02000000:00000001:25.0:1773851862.601186:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601187:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000e4e8a39a.
02000000:00000001:25.0:1773851862.601187:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601188:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bb962da6.
02000000:00000001:25.0:1773851862.601189:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601189:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a214d956.
02000000:00000001:25.0:1773851862.601190:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601190:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000046ed559f.
02000000:00000001:25.0:1773851862.601191:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601192:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a7c7dc80.
02000000:00000001:25.0:1773851862.601192:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601193:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ba376a50.
02000000:00000001:25.0:1773851862.601194:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601194:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ec5db8bb.
02000000:00000001:25.0:1773851862.601195:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601195:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cef87f28.
02000000:00000001:25.0:1773851862.601196:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601197:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f30471a2.
02000000:00000001:25.0:1773851862.601197:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601198:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000533cba0b.
02000000:00000001:25.0:1773851862.601199:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601199:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000035313b5a.
02000000:00000001:25.0:1773851862.601200:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601200:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de5d5732.
02000000:00000001:25.0:1773851862.601201:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601202:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000c0699804.
02000000:00000001:25.0:1773851862.601203:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601203:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000070aebb79.
02000000:00000001:25.0:1773851862.601204:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601205:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001de32758.
02000000:00000001:25.0:1773851862.601205:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601206:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c702876.
02000000:00000001:25.0:1773851862.601207:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601207:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000037269236.
02000000:00000001:25.0:1773851862.601208:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601208:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000946deecf.
02000000:00000001:25.0:1773851862.601209:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601209:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b15efa03.
02000000:00000001:25.0:1773851862.601210:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601211:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c80c5126.
02000000:00000001:25.0:1773851862.601212:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601212:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001a651699.
02000000:00000001:25.0:1773851862.601213:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601213:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006a6ecae2.
02000000:00000001:25.0:1773851862.601214:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601215:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004c720c84.
02000000:00000001:25.0:1773851862.601215:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601216:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dbf66437.
02000000:00000001:25.0:1773851862.601217:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601217:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000003975acc.
02000000:00000001:25.0:1773851862.601218:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601218:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086a8e9fb.
02000000:00000001:25.0:1773851862.601219:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601219:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b3e751d7.
02000000:00000001:25.0:1773851862.601220:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601220:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000170ee750.
02000000:00000001:25.0:1773851862.601221:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601222:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f57cf986.
02000000:00000001:25.0:1773851862.601222:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601223:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009dd021c0.
02000000:00000001:25.0:1773851862.601224:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601224:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f39bdba5.
02000000:00000001:25.0:1773851862.601225:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601226:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000304a7289.
02000000:00000001:25.0:1773851862.601227:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601227:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d410cdf7.
02000000:00000001:25.0:1773851862.601228:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601228:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce65e29d.
02000000:00000001:25.0:1773851862.601229:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601230:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000659a43d8.
02000000:00000001:25.0:1773851862.601231:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601231:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000df9e5aaf.
02000000:00000001:25.0:1773851862.601232:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601233:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000048245a9a.
02000000:00000001:25.0:1773851862.601234:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601234:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f4cb4fb9.
02000000:00000001:25.0:1773851862.601235:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601236:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ba4ba55.
02000000:00000001:25.0:1773851862.601236:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601237:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b7f6aee8.
02000000:00000001:25.0:1773851862.601238:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601238:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000178f856c.
02000000:00000001:25.0:1773851862.601239:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601239:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000082e7bbec.
02000000:00000001:25.0:1773851862.601240:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601242:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000002d1232e7.
02000000:00000001:25.0:1773851862.601242:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601243:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c164e5ae.
02000000:00000001:25.0:1773851862.601244:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601245:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b63f4f1.
02000000:00000001:25.0:1773851862.601245:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601246:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a3531ec8.
02000000:00000001:25.0:1773851862.601247:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601247:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009909a32a.
02000000:00000001:25.0:1773851862.601248:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601248:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a1aea4cc.
02000000:00000001:25.0:1773851862.601249:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601250:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e8ca31ca.
02000000:00000001:25.0:1773851862.601250:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601251:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a1ce4a05.
02000000:00000001:25.0:1773851862.601252:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601253:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000652352e7.
02000000:00000001:25.0:1773851862.601253:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601254:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa39c445.
02000000:00000001:25.0:1773851862.601255:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601255:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a6766d5.
02000000:00000001:25.0:1773851862.601256:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601256:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000028a1e96.
02000000:00000001:25.0:1773851862.601257:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601258:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e45ef1a2.
02000000:00000001:25.0:1773851862.601259:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601259:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000616503e1.
02000000:00000001:25.0:1773851862.601260:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601260:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000063c76a3.
02000000:00000001:25.0:1773851862.601261:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601261:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d2205db8.
02000000:00000001:25.0:1773851862.601263:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601263:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000a8c2790d.
02000000:00000001:25.0:1773851862.601264:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601264:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f79276ad.
02000000:00000001:25.0:1773851862.601265:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601266:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002828d14d.
02000000:00000001:25.0:1773851862.601266:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601267:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e17d80e2.
02000000:00000001:25.0:1773851862.601268:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601268:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009b7c8b01.
02000000:00000001:25.0:1773851862.601269:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601269:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000a06133c.
02000000:00000001:25.0:1773851862.601270:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601271:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004448c33f.
02000000:00000001:25.0:1773851862.601271:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601272:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bce1fc82.
02000000:00000001:25.0:1773851862.601272:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601273:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000423fcf42.
02000000:00000001:25.0:1773851862.601273:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601274:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002094f8b0.
02000000:00000001:25.0:1773851862.601275:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601275:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000084a82b3b.
02000000:00000001:25.0:1773851862.601276:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601276:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059e24874.
02000000:00000001:25.0:1773851862.601277:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601277:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000baf98ee9.
02000000:00000001:25.0:1773851862.601278:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601278:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000040120796.
02000000:00000001:25.0:1773851862.601279:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601280:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000070ac4be2.
02000000:00000001:25.0:1773851862.601280:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601280:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb3676a3.
02000000:00000001:25.0:1773851862.601282:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601282:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001a9457e7.
02000000:00000001:25.0:1773851862.601282:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601283:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009da49841.
00000100:00000010:25.0:1773851862.601284:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa9a3aa3.
00000100:00000010:25.0:1773851862.601285:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000da8069be.
02000000:00000001:25.0:1773851862.601286:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601286:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006d2811d7.
02000000:00000001:25.0:1773851862.601287:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601287:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000010dbfc33.
02000000:00000001:25.0:1773851862.601288:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601289:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c90ff9ac.
02000000:00000001:25.0:1773851862.601289:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601300:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009ffe88b1.
02000000:00000001:25.0:1773851862.601301:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601301:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f481404e.
02000000:00000001:25.0:1773851862.601302:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601302:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003401b322.
02000000:00000001:25.0:1773851862.601303:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601303:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000008ea88b2.
02000000:00000001:25.0:1773851862.601304:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601305:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000091513113.
02000000:00000001:25.0:1773851862.601306:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601306:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ea89001f.
02000000:00000001:25.0:1773851862.601307:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601307:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036c3a6f9.
02000000:00000001:25.0:1773851862.601308:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601309:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004655ba30.
02000000:00000001:25.0:1773851862.601310:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601310:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000869b375a.
02000000:00000001:25.0:1773851862.601311:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601312:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004138e24a.
02000000:00000001:25.0:1773851862.601312:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601313:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000244a3b5c.
02000000:00000001:25.0:1773851862.601314:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601314:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000fb32478d.
02000000:00000001:25.0:1773851862.601315:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601315:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000022ea6573.
02000000:00000001:25.0:1773851862.601316:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601317:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000b3a345e3.
02000000:00000001:25.0:1773851862.601318:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601318:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000550178d3.
02000000:00000001:25.0:1773851862.601319:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601319:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000023d55fe6.
02000000:00000001:25.0:1773851862.601320:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601320:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000055a5c7ae.
02000000:00000001:25.0:1773851862.601321:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601322:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007cfda220.
02000000:00000001:25.0:1773851862.601323:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601323:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000054996a6e.
02000000:00000001:25.0:1773851862.601324:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601325:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000ca5f9ef6.
02000000:00000001:25.0:1773851862.601326:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601326:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000029f0cb5e.
02000000:00000001:25.0:1773851862.601328:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601328:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005d360902.
02000000:00000001:25.0:1773851862.601329:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601329:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000abb4a894.
02000000:00000001:25.0:1773851862.601330:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601331:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000ad86d74a.
02000000:00000001:25.0:1773851862.601332:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601332:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa0660fc.
02000000:00000001:25.0:1773851862.601333:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601333:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f57690b5.
02000000:00000001:25.0:1773851862.601334:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601334:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef01fbef.
02000000:00000001:25.0:1773851862.601336:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601336:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000efe18d51.
02000000:00000001:25.0:1773851862.601337:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601338:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ccb443a9.
02000000:00000001:25.0:1773851862.601339:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601339:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000008dc05228.
02000000:00000001:25.0:1773851862.601340:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601341:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000526fd27f.
02000000:00000001:25.0:1773851862.601342:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601342:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000011478f43.
02000000:00000001:25.0:1773851862.601343:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601343:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c735e8f4.
02000000:00000001:25.0:1773851862.601344:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601344:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000d0374c6b.
02000000:00000001:25.0:1773851862.601345:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601346:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fc7b2ce6.
02000000:00000001:25.0:1773851862.601347:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601347:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000fa9ff628.
02000000:00000001:25.0:1773851862.601348:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601348:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003604e5ad.
02000000:00000001:25.0:1773851862.601349:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601349:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084bf2afe.
02000000:00000001:25.0:1773851862.601350:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601351:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b3300e14.
02000000:00000001:25.0:1773851862.601352:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601352:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000001e128d8a.
02000000:00000001:25.0:1773851862.601353:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601354:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003d0074e8.
02000000:00000001:25.0:1773851862.601354:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601355:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d2f448b9.
02000000:00000001:25.0:1773851862.601355:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601356:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004e637026.
02000000:00000001:25.0:1773851862.601357:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601357:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000982f1fca.
02000000:00000001:25.0:1773851862.601358:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601359:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bd5dafe0.
02000000:00000001:25.0:1773851862.601360:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601360:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000008a80827b.
02000000:00000001:25.0:1773851862.601361:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601362:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b3583177.
02000000:00000001:25.0:1773851862.601363:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601363:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000283b27a.
02000000:00000001:25.0:1773851862.601364:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601364:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d7594987.
02000000:00000001:25.0:1773851862.601366:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601366:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000006acfebf8.
02000000:00000001:25.0:1773851862.601367:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601367:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b6187f02.
02000000:00000001:25.0:1773851862.601369:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601369:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000346f26f2.
02000000:00000001:25.0:1773851862.601370:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601370:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000944fc8ee.
02000000:00000001:25.0:1773851862.601372:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601372:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069554f7e.
02000000:00000001:25.0:1773851862.601373:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601373:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000943c56d1.
02000000:00000001:25.0:1773851862.601374:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601374:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c45fa4e2.
02000000:00000001:25.0:1773851862.601375:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601375:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002be1309.
02000000:00000001:25.0:1773851862.601377:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601378:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000003a08ca42.
02000000:00000001:25.0:1773851862.601379:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601379:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d462bc12.
02000000:00000001:25.0:1773851862.601380:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601381:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000004f5da70.
02000000:00000001:25.0:1773851862.601381:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601382:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e06e3e2f.
02000000:00000001:25.0:1773851862.601383:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601383:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004283da99.
02000000:00000001:25.0:1773851862.601384:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601385:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d9702010.
02000000:00000001:25.0:1773851862.601386:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601386:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000db99714b.
02000000:00000001:25.0:1773851862.601387:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601387:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e91682c.
02000000:00000001:25.0:1773851862.601388:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601389:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aea6c4bc.
02000000:00000001:25.0:1773851862.601390:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601390:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007360b5af.
02000000:00000001:25.0:1773851862.601391:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601392:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cc15c04b.
02000000:00000001:25.0:1773851862.601392:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601393:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000088e94cf.
02000000:00000001:25.0:1773851862.601394:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601394:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005a95ff56.
02000000:00000001:25.0:1773851862.601395:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601396:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e09be8a.
02000000:00000001:25.0:1773851862.601397:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601397:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b04e8f6.
02000000:00000001:25.0:1773851862.601398:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601398:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b9040ca1.
02000000:00000001:25.0:1773851862.601399:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601400:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001d352bbb.
02000000:00000001:25.0:1773851862.601400:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601401:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008683d18d.
02000000:00000001:25.0:1773851862.601402:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601403:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000074bdab09.
02000000:00000001:25.0:1773851862.601403:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601404:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a3354d40.
02000000:00000001:25.0:1773851862.601405:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601406:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006582de51.
02000000:00000001:25.0:1773851862.601407:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601407:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000060abe4d.
02000000:00000001:25.0:1773851862.601408:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601409:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006bb767ed.
02000000:00000001:25.0:1773851862.601409:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601410:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d2e4fd80.
02000000:00000001:25.0:1773851862.601411:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601411:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e85a73e6.
02000000:00000001:25.0:1773851862.601412:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601412:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d1938902.
02000000:00000001:25.0:1773851862.601414:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601414:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a13cde1f.
02000000:00000001:25.0:1773851862.601415:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601416:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000899c8b9e.
02000000:00000001:25.0:1773851862.601416:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601417:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b6cbb943.
02000000:00000001:25.0:1773851862.601418:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601418:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000049235545.
02000000:00000001:25.0:1773851862.601419:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601419:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084524a26.
02000000:00000001:25.0:1773851862.601420:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601420:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002518fa72.
02000000:00000001:25.0:1773851862.601421:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601422:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002087ca72.
02000000:00000001:25.0:1773851862.601422:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601423:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c7632a5.
02000000:00000001:25.0:1773851862.601424:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601424:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bdd233f6.
02000000:00000001:25.0:1773851862.601425:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601425:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cd799adc.
02000000:00000001:25.0:1773851862.601426:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601427:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dbd7b7c6.
02000000:00000001:25.0:1773851862.601428:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601428:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000159e0f29.
02000000:00000001:25.0:1773851862.601429:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601430:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005136c2a8.
02000000:00000001:25.0:1773851862.601430:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601431:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004351741d.
02000000:00000001:25.0:1773851862.601431:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601432:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a4ebd033.
02000000:00000001:25.0:1773851862.601432:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601433:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000021e4a655.
02000000:00000001:25.0:1773851862.601434:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601434:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aaaa1687.
02000000:00000001:25.0:1773851862.601435:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601435:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002919607e.
02000000:00000001:25.0:1773851862.601436:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601437:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ae2d80c7.
02000000:00000001:25.0:1773851862.601437:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601438:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f030d4c.
02000000:00000001:25.0:1773851862.601439:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601439:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ae333941.
02000000:00000001:25.0:1773851862.601440:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601440:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002d30ccc4.
02000000:00000001:25.0:1773851862.601441:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601441:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084645655.
02000000:00000001:25.0:1773851862.601442:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601442:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000030e77ab1.
02000000:00000001:25.0:1773851862.601443:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601444:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007c03fdac.
02000000:00000001:25.0:1773851862.601444:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601445:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000becc523.
02000000:00000001:25.0:1773851862.601446:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601446:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000045d3b64d.
02000000:00000001:25.0:1773851862.601447:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601447:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c6972e4.
02000000:00000001:25.0:1773851862.601448:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601449:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000065df6b6b.
02000000:00000001:25.0:1773851862.601449:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601450:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000652b10e.
02000000:00000001:25.0:1773851862.601451:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601451:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000062c7d38d.
02000000:00000001:25.0:1773851862.601452:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601455:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000081c778b5.
02000000:00000001:25.0:1773851862.601456:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601456:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000fe261b87.
02000000:00000001:25.0:1773851862.601457:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601457:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a4ab634.
02000000:00000001:25.0:1773851862.601458:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601459:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ff69ea78.
02000000:00000001:25.0:1773851862.601459:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601460:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a774343a.
02000000:00000001:25.0:1773851862.601461:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601461:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d0ee788f.
02000000:00000001:25.0:1773851862.601462:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601462:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ca5508d9.
02000000:00000001:25.0:1773851862.601463:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601463:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fb0ea35b.
02000000:00000001:25.0:1773851862.601464:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601464:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002870b775.
02000000:00000001:25.0:1773851862.601465:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601466:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005ccc8d12.
02000000:00000001:25.0:1773851862.601467:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601467:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d43aa887.
02000000:00000001:25.0:1773851862.601468:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601468:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000064ef0516.
02000000:00000001:25.0:1773851862.601469:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601469:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006e65be55.
02000000:00000001:25.0:1773851862.601470:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601471:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000074dd49da.
02000000:00000001:25.0:1773851862.601471:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601472:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000095a30ef4.
02000000:00000001:25.0:1773851862.601473:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601473:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad6e8f29.
02000000:00000001:25.0:1773851862.601474:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601474:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000561ee69d.
02000000:00000001:25.0:1773851862.601476:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601476:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000753b6218.
02000000:00000001:25.0:1773851862.601477:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601477:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000062237768.
02000000:00000001:25.0:1773851862.601478:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601479:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008fc528f7.
02000000:00000001:25.0:1773851862.601480:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601480:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000048fee307.
02000000:00000001:25.0:1773851862.601481:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601482:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a924a3a7.
02000000:00000001:25.0:1773851862.601482:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601483:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d1b2bf03.
02000000:00000001:25.0:1773851862.601484:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601484:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004cd0bcff.
02000000:00000001:25.0:1773851862.601485:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601486:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009cdf2285.
00000100:00000010:25.0:1773851862.601487:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000025aa61c.
02000000:00000001:25.0:1773851862.601488:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601488:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000b5c12946.
02000000:00000001:25.0:1773851862.601489:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601489:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000052273c93.
02000000:00000001:25.0:1773851862.601490:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601491:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006d3a74bd.
02000000:00000001:25.0:1773851862.601492:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601492:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000065c37812.
02000000:00000001:25.0:1773851862.601493:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601494:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000011db2335.
02000000:00000001:25.0:1773851862.601494:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601495:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0f22edf.
02000000:00000001:25.0:1773851862.601496:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601496:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f08ac255.
02000000:00000001:25.0:1773851862.601497:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601497:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031bd7f73.
02000000:00000001:25.0:1773851862.601498:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601499:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001d00b494.
02000000:00000001:25.0:1773851862.601500:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601500:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000407cf96.
02000000:00000001:25.0:1773851862.601501:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601502:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009ea7b328.
02000000:00000001:25.0:1773851862.601502:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601503:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000627cb71a.
02000000:00000001:25.0:1773851862.601504:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601504:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000079541c8.
02000000:00000001:25.0:1773851862.601506:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601506:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f4c5afb5.
02000000:00000001:25.0:1773851862.601507:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601508:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000db047993.
02000000:00000001:25.0:1773851862.601509:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601509:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000049f14ceb.
02000000:00000001:25.0:1773851862.601510:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601510:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000011a9417a.
02000000:00000001:25.0:1773851862.601511:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601511:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002dbbe82.
02000000:00000001:25.0:1773851862.601512:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601513:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000972b0b5d.
02000000:00000001:25.0:1773851862.601513:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601514:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000539876ee.
02000000:00000001:25.0:1773851862.601515:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601515:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000080e323f9.
02000000:00000001:25.0:1773851862.601516:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601516:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d305c2f.
02000000:00000001:25.0:1773851862.601517:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601518:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aefef33b.
02000000:00000001:25.0:1773851862.601518:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601519:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f06a3a1.
02000000:00000001:25.0:1773851862.601520:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601520:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bdc2b353.
02000000:00000001:25.0:1773851862.601521:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601522:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f131f50f.
02000000:00000001:25.0:1773851862.601522:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601523:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001d5834db.
02000000:00000001:25.0:1773851862.601523:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601524:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c223513.
02000000:00000001:25.0:1773851862.601525:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601525:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001ac2513e.
02000000:00000001:25.0:1773851862.601526:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601526:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad66f0f3.
02000000:00000001:25.0:1773851862.601528:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601528:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d3fd0d0d.
02000000:00000001:25.0:1773851862.601529:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601529:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000308343e7.
02000000:00000001:25.0:1773851862.601531:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601531:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009f5cb6f5.
02000000:00000001:25.0:1773851862.601532:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601532:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000437800b6.
02000000:00000001:25.0:1773851862.601533:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601534:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000051c1d96a.
02000000:00000001:25.0:1773851862.601534:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601535:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000daa24fb8.
02000000:00000001:25.0:1773851862.601536:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601536:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000040d436f8.
02000000:00000001:25.0:1773851862.601537:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601537:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006eb9e38.
02000000:00000001:25.0:1773851862.601538:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601539:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000008ccb74e.
02000000:00000001:25.0:1773851862.601539:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601540:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005c6f97f7.
02000000:00000001:25.0:1773851862.601541:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601541:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000002bdaa04d.
02000000:00000001:25.0:1773851862.601542:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601542:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b94fbbbf.
02000000:00000001:25.0:1773851862.601543:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601544:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000082e728c1.
02000000:00000001:25.0:1773851862.601544:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601545:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003d42f101.
02000000:00000001:25.0:1773851862.601546:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601546:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000d94e93bb.
02000000:00000001:25.0:1773851862.601547:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601547:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f23d846a.
02000000:00000001:25.0:1773851862.601549:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601549:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fe518d95.
02000000:00000001:25.0:1773851862.601550:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601550:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000040d60049.
02000000:00000001:25.0:1773851862.601551:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601551:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000569b29d8.
02000000:00000001:25.0:1773851862.601552:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601552:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000057f27648.
02000000:00000001:25.0:1773851862.601553:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601554:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad223029.
02000000:00000001:25.0:1773851862.601555:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601555:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000070643c96.
02000000:00000001:25.0:1773851862.601556:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601557:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eadf8630.
02000000:00000001:25.0:1773851862.601558:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601558:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000087d4a464.
02000000:00000001:25.0:1773851862.601559:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601560:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ea1ea638.
02000000:00000001:25.0:1773851862.601560:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601561:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e94cc1c2.
02000000:00000001:25.0:1773851862.601562:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601562:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bcca4ec8.
02000000:00000001:25.0:1773851862.601563:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601564:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002f8f5d7.
02000000:00000001:25.0:1773851862.601565:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601565:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed799e8c.
02000000:00000001:25.0:1773851862.601566:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601566:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000005a4d823.
02000000:00000001:25.0:1773851862.601567:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601567:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000005a946da.
02000000:00000001:25.0:1773851862.601568:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601569:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002999865e.
02000000:00000001:25.0:1773851862.601570:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601570:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000025c16693.
02000000:00000001:25.0:1773851862.601571:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601571:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000253e18e1.
02000000:00000001:25.0:1773851862.601573:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601573:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007a38903e.
02000000:00000001:25.0:1773851862.601574:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601574:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8bb984d.
02000000:00000001:25.0:1773851862.601575:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601576:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001c27f3f1.
02000000:00000001:25.0:1773851862.601576:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601576:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004003ac3d.
02000000:00000001:25.0:1773851862.601578:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601578:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ae30acbd.
02000000:00000001:25.0:1773851862.601579:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601579:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007fef036d.
02000000:00000001:25.0:1773851862.601581:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601581:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000784fb07d.
02000000:00000001:25.0:1773851862.601582:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601582:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009550634e.
02000000:00000001:25.0:1773851862.601584:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601584:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e3b690f6.
02000000:00000001:25.0:1773851862.601585:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601585:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000045389d3f.
02000000:00000001:25.0:1773851862.601586:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601587:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000096623fe3.
02000000:00000001:25.0:1773851862.601588:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601588:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002c68581.
02000000:00000001:25.0:1773851862.601589:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601589:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000002d959c3.
02000000:00000001:25.0:1773851862.601590:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601590:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d3ca664f.
02000000:00000001:25.0:1773851862.601591:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601591:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003bab7bdf.
02000000:00000001:25.0:1773851862.601592:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601592:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000058bc1cff.
02000000:00000001:25.0:1773851862.601594:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601594:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007eb94c63.
02000000:00000001:25.0:1773851862.601595:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601595:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000075215978.
02000000:00000001:25.0:1773851862.601596:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601596:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a513b836.
02000000:00000001:25.0:1773851862.601597:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601597:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000900cb3a5.
02000000:00000001:25.0:1773851862.601598:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601599:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000076b97209.
02000000:00000001:25.0:1773851862.601599:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601599:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000748d00c.
02000000:00000001:25.0:1773851862.601600:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601601:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6739af4.
02000000:00000001:25.0:1773851862.601602:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601602:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009146dfd3.
02000000:00000001:25.0:1773851862.601603:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601603:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000daaa269.
02000000:00000001:25.0:1773851862.601604:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601605:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000030d5b751.
02000000:00000001:25.0:1773851862.601606:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601606:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000fed6925.
02000000:00000001:25.0:1773851862.601607:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601607:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ddee6adf.
02000000:00000001:25.0:1773851862.601609:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601609:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003250fbef.
02000000:00000001:25.0:1773851862.601610:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601610:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a4b46f2f.
02000000:00000001:25.0:1773851862.601611:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601611:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001ca96bec.
02000000:00000001:25.0:1773851862.601612:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601612:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000717d48e5.
02000000:00000001:25.0:1773851862.601613:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601614:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000020a7853e.
02000000:00000001:25.0:1773851862.601614:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601615:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000082e80aba.
02000000:00000001:25.0:1773851862.601616:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601617:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002b2f779f.
02000000:00000001:25.0:1773851862.601617:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601618:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005675a25b.
02000000:00000001:25.0:1773851862.601619:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601619:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000890af667.
02000000:00000001:25.0:1773851862.601620:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601620:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000742ba96d.
02000000:00000001:25.0:1773851862.601621:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601622:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e0b6f125.
02000000:00000001:25.0:1773851862.601622:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601623:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000299a90a6.
02000000:00000001:25.0:1773851862.601624:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601624:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b50d6e78.
02000000:00000001:25.0:1773851862.601625:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601625:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ab085a00.
02000000:00000001:25.0:1773851862.601626:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601626:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e83c7622.
02000000:00000001:25.0:1773851862.601627:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601627:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d0927bc5.
02000000:00000001:25.0:1773851862.601629:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601629:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001e9b52f6.
02000000:00000001:25.0:1773851862.601630:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601630:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a99e6bed.
02000000:00000001:25.0:1773851862.601631:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601631:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005497fea9.
02000000:00000001:25.0:1773851862.601632:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601633:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000063fe7644.
02000000:00000001:25.0:1773851862.601634:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601634:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009a05e684.
02000000:00000001:25.0:1773851862.601635:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601635:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006d502ab9.
02000000:00000001:25.0:1773851862.601636:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601637:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008e0c9739.
02000000:00000001:25.0:1773851862.601637:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601638:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e6dcd85.
02000000:00000001:25.0:1773851862.601639:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601639:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000744a721.
02000000:00000001:25.0:1773851862.601640:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601640:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c29cad4f.
02000000:00000001:25.0:1773851862.601641:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601642:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000018ed08fe.
02000000:00000001:25.0:1773851862.601642:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601642:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000aa4b145.
02000000:00000001:25.0:1773851862.601644:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601644:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e600ddea.
02000000:00000001:25.0:1773851862.601645:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601645:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004247a3a.
02000000:00000001:25.0:1773851862.601646:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601647:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000856c52d3.
02000000:00000001:25.0:1773851862.601647:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601648:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a5b799be.
02000000:00000001:25.0:1773851862.601649:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601649:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000047471d28.
02000000:00000001:25.0:1773851862.601650:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601650:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008925c0d0.
02000000:00000001:25.0:1773851862.601651:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601651:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006748969a.
02000000:00000001:25.0:1773851862.601653:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601653:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f4a8d80d.
02000000:00000001:25.0:1773851862.601654:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601654:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007abe17ce.
02000000:00000001:25.0:1773851862.601655:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601656:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c285ee2d.
02000000:00000001:25.0:1773851862.601657:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601657:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008052dcee.
02000000:00000001:25.0:1773851862.601658:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601658:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006b1c5f5.
02000000:00000001:25.0:1773851862.601659:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601659:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c945d63.
02000000:00000001:25.0:1773851862.601660:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601660:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8672263.
02000000:00000001:25.0:1773851862.601661:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601662:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000615cd7fe.
02000000:00000001:25.0:1773851862.601662:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601663:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000600a8f9e.
02000000:00000001:25.0:1773851862.601663:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601664:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005eb8368c.
02000000:00000001:25.0:1773851862.601664:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601665:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000082c4c701.
02000000:00000001:25.0:1773851862.601666:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601666:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000beb694e2.
02000000:00000001:25.0:1773851862.601667:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601667:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a91e5f6b.
02000000:00000001:25.0:1773851862.601668:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601669:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008eb2081c.
02000000:00000001:25.0:1773851862.601669:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601670:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000cd24303.
02000000:00000001:25.0:1773851862.601671:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601671:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b11fe04a.
02000000:00000001:25.0:1773851862.601672:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601672:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000421be92d.
02000000:00000001:25.0:1773851862.601673:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601673:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6e63853.
02000000:00000001:25.0:1773851862.601674:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601674:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b028de51.
02000000:00000001:25.0:1773851862.601676:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601676:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b26d05eb.
02000000:00000001:25.0:1773851862.601677:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601677:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006814f68d.
02000000:00000001:25.0:1773851862.601678:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601678:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e2653e1.
02000000:00000001:25.0:1773851862.601679:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601679:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc294865.
02000000:00000001:25.0:1773851862.601680:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601680:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002fdf030a.
02000000:00000001:25.0:1773851862.601681:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601681:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b5171a89.
02000000:00000001:25.0:1773851862.601682:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601683:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002beb2f0c.
02000000:00000001:25.0:1773851862.601683:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601684:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000634dfd71.
02000000:00000001:25.0:1773851862.601685:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601685:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000e43e410d.
02000000:00000001:25.0:1773851862.601686:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601686:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009776ec47.
02000000:00000001:25.0:1773851862.601687:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601688:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd1ea107.
02000000:00000001:25.0:1773851862.601688:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601689:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007ce9ea27.
02000000:00000001:25.0:1773851862.601690:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601690:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e74e9568.
02000000:00000001:25.0:1773851862.601691:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601691:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000765709be.
02000000:00000001:25.0:1773851862.601692:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601692:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad89aed1.
02000000:00000001:25.0:1773851862.601693:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601693:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000028119431.
02000000:00000001:25.0:1773851862.601695:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601695:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a21b136.
02000000:00000001:25.0:1773851862.601696:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601696:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076e5aaaf.
02000000:00000001:25.0:1773851862.601697:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601697:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e40643b9.
02000000:00000001:25.0:1773851862.601699:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601699:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000011ea29e2.
02000000:00000001:25.0:1773851862.601700:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601700:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2d7b2d2.
02000000:00000001:25.0:1773851862.601701:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601701:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fdc607a3.
00000100:00000010:25.0:1773851862.601703:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000983d5af5.
00000100:00000010:25.0:1773851862.601703:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059cdd635.
00000100:00000010:25.0:1773851862.601704:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000096545a13.
00000100:00000010:25.0:1773851862.601705:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a17b279.
00000100:00000010:25.0:1773851862.601706:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3f3d1b1.
00000100:00000010:25.0:1773851862.601707:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002ad7ec7b.
00000100:00000010:25.0:1773851862.601708:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000763fdf5.
02000000:00000001:25.0:1773851862.601709:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601709:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000023171e1c.
02000000:00000001:25.0:1773851862.601710:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601710:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004569a6cd.
02000000:00000001:25.0:1773851862.601711:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601711:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d36b3f7d.
02000000:00000001:25.0:1773851862.601712:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601712:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000b1f22ce.
02000000:00000001:25.0:1773851862.601713:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601713:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000062130ed1.
02000000:00000001:25.0:1773851862.601714:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601714:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007e13b3e4.
02000000:00000001:25.0:1773851862.601716:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601716:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000026d48f37.
02000000:00000001:25.0:1773851862.601717:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601717:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d28203fb.
02000000:00000001:25.0:1773851862.601719:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601719:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001c523c91.
02000000:00000001:25.0:1773851862.601720:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601720:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e2a451c.
02000000:00000001:25.0:1773851862.601721:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601722:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b0b32d07.
02000000:00000001:25.0:1773851862.601722:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601723:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003a919149.
02000000:00000001:25.0:1773851862.601724:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601728:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d259d090.
02000000:00000001:25.0:1773851862.601729:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601730:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e40c89db.
02000000:00000001:25.0:1773851862.601731:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601731:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000297f9cfe.
02000000:00000001:25.0:1773851862.601732:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601732:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000480408e4.
02000000:00000001:25.0:1773851862.601733:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601734:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000096cc3a73.
02000000:00000001:25.0:1773851862.601735:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601735:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bf65054b.
02000000:00000001:25.0:1773851862.601736:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601736:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000177a224.
02000000:00000001:25.0:1773851862.601737:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601737:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad0c87eb.
02000000:00000001:25.0:1773851862.601738:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601739:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000075db92e9.
02000000:00000001:25.0:1773851862.601739:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601740:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cf9b4ca0.
02000000:00000001:25.0:1773851862.601741:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601741:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6001d98.
02000000:00000001:25.0:1773851862.601743:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601743:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e85993f.
02000000:00000001:25.0:1773851862.601744:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601744:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000014ff3d87.
02000000:00000001:25.0:1773851862.601745:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601745:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac9aa500.
02000000:00000001:25.0:1773851862.601747:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601748:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a6fb101.
02000000:00000001:25.0:1773851862.601749:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601749:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b7304861.
02000000:00000001:25.0:1773851862.601750:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601750:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000089789ccf.
02000000:00000001:25.0:1773851862.601751:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601752:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f7f3b463.
02000000:00000001:25.0:1773851862.601753:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601754:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b685fee2.
02000000:00000001:25.0:1773851862.601754:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601755:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007b3e98a2.
02000000:00000001:25.0:1773851862.601756:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601756:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad892b1d.
02000000:00000001:25.0:1773851862.601757:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601757:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002ff97ce3.
02000000:00000001:25.0:1773851862.601758:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601758:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000488d9999.
02000000:00000001:25.0:1773851862.601759:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601759:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b3afa289.
02000000:00000001:25.0:1773851862.601760:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601761:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007694300f.
02000000:00000001:25.0:1773851862.601762:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601762:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006304a0aa.
02000000:00000001:25.0:1773851862.601763:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601763:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000317dde4f.
02000000:00000001:25.0:1773851862.601764:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601765:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000068807788.
02000000:00000001:25.0:1773851862.601766:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601766:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c301719a.
02000000:00000001:25.0:1773851862.601767:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601768:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000015ae8909.
02000000:00000001:25.0:1773851862.601768:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601769:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000060c38065.
02000000:00000001:25.0:1773851862.601770:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601770:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a27a5e5.
02000000:00000001:25.0:1773851862.601771:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601772:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006193e230.
02000000:00000001:25.0:1773851862.601772:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601773:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c7cbdaff.
02000000:00000001:25.0:1773851862.601774:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601774:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000416a9b29.
02000000:00000001:25.0:1773851862.601775:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601775:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000070ab6a76.
02000000:00000001:25.0:1773851862.601776:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601777:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000997a2956.
02000000:00000001:25.0:1773851862.601777:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601778:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007e811a71.
02000000:00000001:25.0:1773851862.601780:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601780:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000052781c2d.
02000000:00000001:25.0:1773851862.601781:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601781:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5750996.
02000000:00000001:25.0:1773851862.601782:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601782:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005b1b0e85.
02000000:00000001:25.0:1773851862.601783:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601783:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000654c9862.
02000000:00000001:25.0:1773851862.601784:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601784:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006f3e70a2.
02000000:00000001:25.0:1773851862.601785:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601785:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000087242084.
02000000:00000001:25.0:1773851862.601786:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601787:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007f8f240a.
02000000:00000001:25.0:1773851862.601787:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601788:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009bf1eb78.
02000000:00000001:25.0:1773851862.601789:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601789:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000010328a93.
02000000:00000001:25.0:1773851862.601790:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601790:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098cb1bf5.
02000000:00000001:25.0:1773851862.601791:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601791:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006126ad0f.
02000000:00000001:25.0:1773851862.601792:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601792:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000541398ec.
02000000:00000001:25.0:1773851862.601793:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601794:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000716eb6b2.
02000000:00000001:25.0:1773851862.601794:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601795:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a5fc0d7.
02000000:00000001:25.0:1773851862.601796:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601796:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000016917766.
02000000:00000001:25.0:1773851862.601797:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601797:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001ccfd5ff.
02000000:00000001:25.0:1773851862.601798:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601798:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006c2904c3.
02000000:00000001:25.0:1773851862.601799:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601799:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003112c8b5.
02000000:00000001:25.0:1773851862.601800:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601801:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009bfa1592.
02000000:00000001:25.0:1773851862.601801:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601802:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079b50dc3.
02000000:00000001:25.0:1773851862.601803:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601803:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d8afac3e.
02000000:00000001:25.0:1773851862.601804:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601804:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f08ce9ae.
02000000:00000001:25.0:1773851862.601805:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601805:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f991f47b.
02000000:00000001:25.0:1773851862.601806:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601806:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076337484.
02000000:00000001:25.0:1773851862.601807:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601807:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000b86a27d6.
02000000:00000001:25.0:1773851862.601808:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601809:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000afa7a022.
02000000:00000001:25.0:1773851862.601809:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601810:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000973547ae.
02000000:00000001:25.0:1773851862.601811:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601811:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000080010178.
02000000:00000001:25.0:1773851862.601812:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601812:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f47d5445.
02000000:00000001:25.0:1773851862.601813:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601813:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009cc47151.
02000000:00000001:25.0:1773851862.601814:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601814:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000e52ccc2.
02000000:00000001:25.0:1773851862.601815:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601815:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dc8a408f.
02000000:00000001:25.0:1773851862.601816:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601816:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cfab79b9.
02000000:00000001:25.0:1773851862.601817:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601817:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000028844eaa.
02000000:00000001:25.0:1773851862.601818:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601818:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000024e5a498.
02000000:00000001:25.0:1773851862.601819:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601819:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d26ab6f4.
02000000:00000001:25.0:1773851862.601820:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601820:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000138f387f.
02000000:00000001:25.0:1773851862.601821:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601822:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5d7e268.
02000000:00000001:25.0:1773851862.601822:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601823:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb903051.
02000000:00000001:25.0:1773851862.601823:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601824:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000063ddd704.
02000000:00000001:25.0:1773851862.601825:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601825:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000031642598.
02000000:00000001:25.0:1773851862.601826:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601826:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f23228ed.
02000000:00000001:25.0:1773851862.601827:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601827:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a36b4a03.
02000000:00000001:25.0:1773851862.601828:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601828:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000352d29fa.
02000000:00000001:25.0:1773851862.601829:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601830:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a8f56b7.
02000000:00000001:25.0:1773851862.601830:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601831:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c935d195.
02000000:00000001:25.0:1773851862.601832:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601832:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f1bfbdd1.
02000000:00000001:25.0:1773851862.601833:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601833:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d1db4f8f.
02000000:00000001:25.0:1773851862.601834:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601834:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005f5ff0e9.
02000000:00000001:25.0:1773851862.601835:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601835:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fcb948b9.
02000000:00000001:25.0:1773851862.601836:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601837:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000090bf3062.
02000000:00000001:25.0:1773851862.601837:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601838:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ceed1c96.
02000000:00000001:25.0:1773851862.601838:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601839:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f38fc58d.
02000000:00000001:25.0:1773851862.601839:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601840:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f5bf258f.
00000100:00000010:25.0:1773851862.601841:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ba2bfe6.
02000000:00000001:25.0:1773851862.601842:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601842:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d20f5fec.
02000000:00000001:25.0:1773851862.601843:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601843:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f87d32a.
02000000:00000001:25.0:1773851862.601847:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601847:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000af2dea3f.
02000000:00000001:25.0:1773851862.601848:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601848:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a50e0467.
02000000:00000001:25.0:1773851862.601849:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601849:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000067f6679.
02000000:00000001:25.0:1773851862.601850:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601850:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5b6d08f.
02000000:00000001:25.0:1773851862.601851:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601851:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a9fc3acc.
02000000:00000001:25.0:1773851862.601852:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601852:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d3f3955e.
02000000:00000001:25.0:1773851862.601853:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601853:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001841f238.
02000000:00000001:25.0:1773851862.601854:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601854:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac4c9453.
02000000:00000001:25.0:1773851862.601855:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601855:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cace0420.
02000000:00000001:25.0:1773851862.601856:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601856:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c0e3730.
02000000:00000001:25.0:1773851862.601858:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601858:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6ec10e0.
02000000:00000001:25.0:1773851862.601859:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601859:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009cfd476.
02000000:00000001:25.0:1773851862.601860:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601860:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008d4a67d1.
02000000:00000001:25.0:1773851862.601861:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601861:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009742bce8.
02000000:00000001:25.0:1773851862.601862:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601862:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000037d85621.
02000000:00000001:25.0:1773851862.601863:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601863:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f3c5b5f0.
02000000:00000001:25.0:1773851862.601864:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601864:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a1ab649f.
02000000:00000001:25.0:1773851862.601865:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601865:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b772ddc9.
02000000:00000001:25.0:1773851862.601866:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601867:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000922e9f51.
02000000:00000001:25.0:1773851862.601868:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601868:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bb94e5cc.
02000000:00000001:25.0:1773851862.601869:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601869:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007f95d171.
02000000:00000001:25.0:1773851862.601870:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601870:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042c2206e.
02000000:00000001:25.0:1773851862.601872:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601872:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000572d0213.
02000000:00000001:25.0:1773851862.601873:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601873:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c9b89916.
02000000:00000001:25.0:1773851862.601874:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601875:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003268b48c.
02000000:00000001:25.0:1773851862.601875:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601876:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000084c910f9.
02000000:00000001:25.0:1773851862.601876:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601877:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007c2d1eb7.
02000000:00000001:25.0:1773851862.601877:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601878:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000066bf2cd0.
02000000:00000001:25.0:1773851862.601878:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601879:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000056a551bc.
02000000:00000001:25.0:1773851862.601879:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601880:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c99383ef.
02000000:00000001:25.0:1773851862.601880:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601881:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c65fd1c0.
02000000:00000001:25.0:1773851862.601881:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601882:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000765833cf.
02000000:00000001:25.0:1773851862.601883:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601883:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000087a4f68f.
02000000:00000001:25.0:1773851862.601883:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601884:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ba0f465.
02000000:00000001:25.0:1773851862.601885:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601885:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000ff6d777.
02000000:00000001:25.0:1773851862.601885:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601886:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d42645fb.
02000000:00000001:25.0:1773851862.601887:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601887:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004eec8881.
02000000:00000001:25.0:1773851862.601888:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601888:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000adcd63a3.
02000000:00000001:25.0:1773851862.601889:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601889:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000e6f5910.
02000000:00000001:25.0:1773851862.601890:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601890:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025fe9373.
02000000:00000001:25.0:1773851862.601891:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601891:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000365680b4.
02000000:00000001:25.0:1773851862.601892:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601892:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002e96ec60.
02000000:00000001:25.0:1773851862.601893:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601894:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000df7b5cc.
02000000:00000001:25.0:1773851862.601894:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601894:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003680650d.
02000000:00000001:25.0:1773851862.601895:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601896:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000038573927.
02000000:00000001:25.0:1773851862.601896:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601897:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000010d12885.
02000000:00000001:25.0:1773851862.601898:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601898:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b7c80f5.
02000000:00000001:25.0:1773851862.601899:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601899:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ddd02f81.
02000000:00000001:25.0:1773851862.601900:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601900:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b2de7b89.
02000000:00000001:25.0:1773851862.601901:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601901:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042fb68a8.
02000000:00000001:25.0:1773851862.601902:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601902:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000059eb0fc5.
02000000:00000001:25.0:1773851862.601903:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601903:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dfb36aad.
02000000:00000001:25.0:1773851862.601904:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601905:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000154123d7.
02000000:00000001:25.0:1773851862.601905:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601906:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000679a1b31.
02000000:00000001:25.0:1773851862.601907:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601907:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000057609044.
02000000:00000001:25.0:1773851862.601908:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601908:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004fdaa3a0.
02000000:00000001:25.0:1773851862.601909:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601909:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f7651e92.
02000000:00000001:25.0:1773851862.601910:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601911:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000afa8b3be.
02000000:00000001:25.0:1773851862.601912:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601912:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aaff20d7.
02000000:00000001:25.0:1773851862.601913:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601913:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e0f65e84.
02000000:00000001:25.0:1773851862.601914:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601915:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000058315682.
02000000:00000001:25.0:1773851862.601916:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601916:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a98478e1.
02000000:00000001:25.0:1773851862.601917:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601917:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fa620996.
02000000:00000001:25.0:1773851862.601918:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601918:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b471409f.
02000000:00000001:25.0:1773851862.601920:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601920:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000da725006.
02000000:00000001:25.0:1773851862.601921:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601921:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eb3d5804.
02000000:00000001:25.0:1773851862.601922:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601922:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000022780ace.
02000000:00000001:25.0:1773851862.601923:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601923:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a7add25a.
02000000:00000001:25.0:1773851862.601924:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601925:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2ceec06.
02000000:00000001:25.0:1773851862.601925:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601925:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000d6641aa.
02000000:00000001:25.0:1773851862.601926:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601927:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ee58d8c4.
02000000:00000001:25.0:1773851862.601927:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601928:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dbad923b.
02000000:00000001:25.0:1773851862.601929:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601929:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bc472507.
02000000:00000001:25.0:1773851862.601930:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601930:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017c4ac27.
02000000:00000001:25.0:1773851862.601931:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601931:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b76aadc6.
02000000:00000001:25.0:1773851862.601932:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601932:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002c478d6c.
02000000:00000001:25.0:1773851862.601934:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601935:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000091913928.
02000000:00000001:25.0:1773851862.601935:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601936:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000507a1c45.
02000000:00000001:25.0:1773851862.601937:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601937:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000de66e282.
02000000:00000001:25.0:1773851862.601938:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601938:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e57f485b.
02000000:00000001:25.0:1773851862.601940:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601940:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000022bcb904.
02000000:00000001:25.0:1773851862.601941:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601941:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007b47e614.
02000000:00000001:25.0:1773851862.601942:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601942:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000624ca04e.
02000000:00000001:25.0:1773851862.601943:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601943:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae0a7ba1.
02000000:00000001:25.0:1773851862.601944:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601944:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000eb626245.
02000000:00000001:25.0:1773851862.601946:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601946:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003bfdcf1a.
02000000:00000001:25.0:1773851862.601947:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601948:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005d06c8c0.
02000000:00000001:25.0:1773851862.601948:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601949:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006cbd1df6.
02000000:00000001:25.0:1773851862.601950:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601950:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000932101dc.
02000000:00000001:25.0:1773851862.601951:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601951:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000058d95ff4.
02000000:00000001:25.0:1773851862.601952:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601952:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000075e36665.
02000000:00000001:25.0:1773851862.601953:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601953:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000005e7b206.
02000000:00000001:25.0:1773851862.601954:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601955:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002c4d2c10.
02000000:00000001:25.0:1773851862.601955:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601956:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000081a0d06b.
02000000:00000001:25.0:1773851862.601956:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601957:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094208da2.
02000000:00000001:25.0:1773851862.601958:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601958:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c9358a1d.
02000000:00000001:25.0:1773851862.601959:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601959:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084fe948f.
02000000:00000001:25.0:1773851862.601960:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601960:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001d614a50.
02000000:00000001:25.0:1773851862.601962:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601962:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000099f0ac88.
02000000:00000001:25.0:1773851862.601962:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601963:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000047704e7a.
02000000:00000001:25.0:1773851862.601964:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601964:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d19f83c7.
02000000:00000001:25.0:1773851862.601965:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601965:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c27bf67.
02000000:00000001:25.0:1773851862.601966:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601966:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b0fbf03.
02000000:00000001:25.0:1773851862.601967:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601967:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cf1d76a8.
02000000:00000001:25.0:1773851862.601968:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601968:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000fa028b7.
02000000:00000001:25.0:1773851862.601969:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601969:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e687f07.
02000000:00000001:25.0:1773851862.601970:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601971:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008ff4bbd4.
02000000:00000001:25.0:1773851862.601971:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601972:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f91bbe56.
02000000:00000001:25.0:1773851862.601973:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601973:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000043f9c799.
02000000:00000001:25.0:1773851862.601974:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601974:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1b6c2e9.
02000000:00000001:25.0:1773851862.601975:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601975:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c7c9e709.
02000000:00000001:25.0:1773851862.601976:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601976:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000077d6a65d.
02000000:00000001:25.0:1773851862.601977:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601977:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000019780417.
02000000:00000001:25.0:1773851862.601978:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601978:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003bce4d2e.
02000000:00000001:25.0:1773851862.601980:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601980:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d5dea478.
02000000:00000001:25.0:1773851862.601981:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601981:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005645cbb9.
02000000:00000001:25.0:1773851862.601982:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601983:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a3d2df03.
02000000:00000001:25.0:1773851862.601983:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601983:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000effe0912.
02000000:00000001:25.0:1773851862.601984:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601985:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000204b4750.
02000000:00000001:25.0:1773851862.601985:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601986:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4fb0060.
02000000:00000001:25.0:1773851862.601986:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601987:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d042713a.
02000000:00000001:25.0:1773851862.601987:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601988:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000788907d7.
02000000:00000001:25.0:1773851862.601988:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601989:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030dcd89d.
02000000:00000001:25.0:1773851862.601989:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601990:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001fb466cf.
02000000:00000001:25.0:1773851862.601991:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601991:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d76fa827.
02000000:00000001:25.0:1773851862.601992:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601992:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079af219c.
02000000:00000001:25.0:1773851862.601993:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601993:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a1a175ba.
02000000:00000001:25.0:1773851862.601994:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601994:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000027ba9933.
02000000:00000001:25.0:1773851862.601995:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601996:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d5d697a8.
02000000:00000001:25.0:1773851862.601996:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601997:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e813c29.
02000000:00000001:25.0:1773851862.601998:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.601998:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000054aad40b.
02000000:00000001:25.0:1773851862.601999:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.601999:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000f847a50.
02000000:00000001:25.0:1773851862.602000:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602001:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000041045080.
02000000:00000001:25.0:1773851862.602002:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602002:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000170c96d5.
02000000:00000001:25.0:1773851862.602003:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602003:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e68f55c.
02000000:00000001:25.0:1773851862.602004:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602004:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000091cdbf7b.
02000000:00000001:25.0:1773851862.602005:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602005:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000086b74a33.
02000000:00000001:25.0:1773851862.602006:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602007:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e456f7cb.
02000000:00000001:25.0:1773851862.602008:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602008:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000267186cc.
02000000:00000001:25.0:1773851862.602009:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602009:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000531fd133.
02000000:00000001:25.0:1773851862.602010:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602010:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ac6481ed.
02000000:00000001:25.0:1773851862.602011:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602011:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000043cfe397.
02000000:00000001:25.0:1773851862.602012:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602013:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000860b557b.
02000000:00000001:25.0:1773851862.602014:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602014:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c367f3b7.
02000000:00000001:25.0:1773851862.602015:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602015:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000009a939c.
02000000:00000001:25.0:1773851862.602016:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602017:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009ad0b08c.
02000000:00000001:25.0:1773851862.602017:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602018:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007f6f1de7.
02000000:00000001:25.0:1773851862.602018:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602019:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004318f696.
02000000:00000001:25.0:1773851862.602019:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602020:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002ceacb36.
02000000:00000001:25.0:1773851862.602020:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602021:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004514335e.
02000000:00000001:25.0:1773851862.602021:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602022:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000261639b.
02000000:00000001:25.0:1773851862.602023:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602023:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006b224caf.
02000000:00000001:25.0:1773851862.602024:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602024:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000018a1f692.
02000000:00000001:25.0:1773851862.602025:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602025:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f0a3aece.
02000000:00000001:25.0:1773851862.602026:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602026:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005a3cd18d.
02000000:00000001:25.0:1773851862.602027:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602027:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f97dd472.
02000000:00000001:25.0:1773851862.602028:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602028:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000749dc5fd.
02000000:00000001:25.0:1773851862.602029:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602029:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000432424dd.
02000000:00000001:25.0:1773851862.602030:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602030:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004e1a1898.
02000000:00000001:25.0:1773851862.602031:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602031:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d462a956.
02000000:00000001:25.0:1773851862.602032:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602033:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084cbb911.
02000000:00000001:25.0:1773851862.602033:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602034:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a09a141c.
00000100:00000010:25.0:1773851862.602034:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f72b8945.
02000000:00000001:25.0:1773851862.602035:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602036:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000031dd9f6f.
02000000:00000001:25.0:1773851862.602036:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602037:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a1d08efb.
02000000:00000001:25.0:1773851862.602038:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602038:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008c366c68.
02000000:00000001:25.0:1773851862.602039:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602039:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000091b13a06.
02000000:00000001:25.0:1773851862.602040:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602040:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000ff4064d.
02000000:00000001:25.0:1773851862.602041:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602041:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003df303c5.
02000000:00000001:25.0:1773851862.602042:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602043:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002a0ced7d.
02000000:00000001:25.0:1773851862.602043:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602044:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086519b37.
02000000:00000001:25.0:1773851862.602044:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602045:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e283aeb.
02000000:00000001:25.0:1773851862.602046:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602046:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d2e7c5e1.
02000000:00000001:25.0:1773851862.602047:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602048:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030607ff5.
02000000:00000001:25.0:1773851862.602048:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602049:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000b384d37.
02000000:00000001:25.0:1773851862.602049:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602050:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d7882f25.
02000000:00000001:25.0:1773851862.602050:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602051:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed2b5058.
02000000:00000001:25.0:1773851862.602051:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602052:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006d5da263.
02000000:00000001:25.0:1773851862.602052:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602052:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003d5769b9.
02000000:00000001:25.0:1773851862.602053:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602054:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008b53a2fb.
02000000:00000001:25.0:1773851862.602054:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602055:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024253d81.
02000000:00000001:25.0:1773851862.602056:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602056:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000040ad87c7.
02000000:00000001:25.0:1773851862.602057:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602057:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c6232926.
02000000:00000001:25.0:1773851862.602058:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602058:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000054d0af79.
02000000:00000001:25.0:1773851862.602059:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602059:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef2fbf3e.
02000000:00000001:25.0:1773851862.602060:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602060:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000ac3bc87.
02000000:00000001:25.0:1773851862.602061:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602061:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000642bcd0d.
02000000:00000001:25.0:1773851862.602062:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602062:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000049d93b60.
02000000:00000001:25.0:1773851862.602063:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602063:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a59ffd2.
02000000:00000001:25.0:1773851862.602064:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602064:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001d63e91d.
02000000:00000001:25.0:1773851862.602065:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602066:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007d1842b.
02000000:00000001:25.0:1773851862.602066:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602066:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000643e8a74.
02000000:00000001:25.0:1773851862.602067:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602067:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000032f8c960.
02000000:00000001:25.0:1773851862.602068:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602068:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000af197cfb.
02000000:00000001:25.0:1773851862.602069:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602069:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f9d9f5aa.
02000000:00000001:25.0:1773851862.602071:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602071:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ded0ec1.
02000000:00000001:25.0:1773851862.602072:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602072:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001b9ac0f5.
02000000:00000001:25.0:1773851862.602073:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602073:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fd19edcb.
02000000:00000001:25.0:1773851862.602074:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602074:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c8aeddc7.
02000000:00000001:25.0:1773851862.602075:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602075:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002a730017.
02000000:00000001:25.0:1773851862.602075:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602076:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000027a6b51e.
02000000:00000001:25.0:1773851862.602077:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602077:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fbef2367.
02000000:00000001:25.0:1773851862.602078:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602078:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000970d3567.
02000000:00000001:25.0:1773851862.602079:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602079:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000181a3762.
02000000:00000001:25.0:1773851862.602079:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602080:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025dfdf14.
02000000:00000001:25.0:1773851862.602081:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602081:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a826fa5.
02000000:00000001:25.0:1773851862.602081:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602082:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cf67eb4f.
02000000:00000001:25.0:1773851862.602082:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602083:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000041fd8fb8.
02000000:00000001:25.0:1773851862.602083:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602084:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e54d0cc.
02000000:00000001:25.0:1773851862.602084:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602085:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a0a4ec7d.
02000000:00000001:25.0:1773851862.602086:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602086:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f84047a.
02000000:00000001:25.0:1773851862.602087:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602087:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000046e68fb9.
02000000:00000001:25.0:1773851862.602088:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602088:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d0548631.
02000000:00000001:25.0:1773851862.602089:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602089:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008dddbf7e.
02000000:00000001:25.0:1773851862.602090:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602090:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f5b7d858.
02000000:00000001:25.0:1773851862.602091:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602091:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 000000004a748a1f.
02000000:00000001:25.0:1773851862.602092:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602093:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000095bd404b.
02000000:00000001:25.0:1773851862.602094:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602094:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b2b9ae5c.
02000000:00000001:25.0:1773851862.602095:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602095:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002c90f6ee.
02000000:00000001:25.0:1773851862.602096:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602096:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006a888106.
02000000:00000001:25.0:1773851862.602097:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602097:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001cd2d984.
02000000:00000001:25.0:1773851862.602098:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602099:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd64f4ea.
02000000:00000001:25.0:1773851862.602099:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602100:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a09b153c.
02000000:00000001:25.0:1773851862.602101:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602101:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a6542cbe.
02000000:00000001:25.0:1773851862.602101:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602102:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002ed09867.
02000000:00000001:25.0:1773851862.602103:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602103:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eb5c0885.
02000000:00000001:25.0:1773851862.602103:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602104:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd0f35f8.
02000000:00000001:25.0:1773851862.602105:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602105:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001b7f1c5c.
02000000:00000001:25.0:1773851862.602105:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602106:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000040651af8.
02000000:00000001:25.0:1773851862.602107:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602107:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004eaf2255.
02000000:00000001:25.0:1773851862.602108:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602108:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009761f1cb.
02000000:00000001:25.0:1773851862.602109:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602110:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a22e7741.
02000000:00000001:25.0:1773851862.602110:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602110:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004aa0e4ce.
02000000:00000001:25.0:1773851862.602111:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602112:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e44fd886.
02000000:00000001:25.0:1773851862.602112:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602112:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a38f03b5.
02000000:00000001:25.0:1773851862.602113:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602114:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f177cc55.
02000000:00000001:25.0:1773851862.602114:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602115:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059de6620.
02000000:00000001:25.0:1773851862.602115:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602116:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a23a362f.
02000000:00000001:25.0:1773851862.602116:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602117:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005f382d65.
02000000:00000001:25.0:1773851862.602118:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602118:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000031ae3c3.
02000000:00000001:25.0:1773851862.602119:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602119:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000162f8eb9.
02000000:00000001:25.0:1773851862.602120:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602121:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000006799f437.
02000000:00000001:25.0:1773851862.602121:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602122:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042f14510.
02000000:00000001:25.0:1773851862.602123:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602123:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fb62eead.
02000000:00000001:25.0:1773851862.602124:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602125:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001836ec84.
02000000:00000001:25.0:1773851862.602126:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602126:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fb80c74d.
02000000:00000001:25.0:1773851862.602127:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602127:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000298dd7d3.
02000000:00000001:25.0:1773851862.602128:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602129:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000089d92c9e.
02000000:00000001:25.0:1773851862.602129:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602130:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a711dccf.
02000000:00000001:25.0:1773851862.602130:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602131:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000023d88651.
02000000:00000001:25.0:1773851862.602131:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602132:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000097102045.
02000000:00000001:25.0:1773851862.602132:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602133:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006aa73752.
02000000:00000001:25.0:1773851862.602133:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602134:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000469e2a6b.
02000000:00000001:25.0:1773851862.602135:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602135:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069e68ce7.
02000000:00000001:25.0:1773851862.602135:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602136:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c03d5ba.
02000000:00000001:25.0:1773851862.602137:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602137:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d3aabafc.
02000000:00000001:25.0:1773851862.602138:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602138:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000794439fe.
02000000:00000001:25.0:1773851862.602139:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602139:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000020b31f4c.
02000000:00000001:25.0:1773851862.602140:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602140:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000752108f7.
02000000:00000001:25.0:1773851862.602141:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602141:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d2142977.
02000000:00000001:25.0:1773851862.602142:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602142:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d585a1ba.
02000000:00000001:25.0:1773851862.602143:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602143:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000035b46874.
02000000:00000001:25.0:1773851862.602144:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602144:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db32c4b6.
02000000:00000001:25.0:1773851862.602145:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602145:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000061c8ebd4.
02000000:00000001:25.0:1773851862.602146:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602146:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e2df9cf7.
02000000:00000001:25.0:1773851862.602147:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602147:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a4c0e901.
02000000:00000001:25.0:1773851862.602148:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602149:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002026a18a.
02000000:00000001:25.0:1773851862.602149:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602150:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f67074e5.
02000000:00000001:25.0:1773851862.602150:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602151:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001eef7707.
02000000:00000001:25.0:1773851862.602151:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602152:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 000000008ce6ea93.
02000000:00000001:25.0:1773851862.602152:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602153:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001040ca8f.
02000000:00000001:25.0:1773851862.602154:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602154:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002dd23e0b.
02000000:00000001:25.0:1773851862.602155:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602155:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f175d812.
02000000:00000001:25.0:1773851862.602156:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602156:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000791f206d.
02000000:00000001:25.0:1773851862.602157:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602157:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000af15af77.
02000000:00000001:25.0:1773851862.602158:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602159:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000092c6c7dd.
02000000:00000001:25.0:1773851862.602159:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602160:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b919a217.
02000000:00000001:25.0:1773851862.602161:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602161:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001e9cc040.
02000000:00000001:25.0:1773851862.602162:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602162:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c6aaa74.
02000000:00000001:25.0:1773851862.602163:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602164:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009c8fdc5b.
02000000:00000001:25.0:1773851862.602164:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602164:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f3d6eb1.
02000000:00000001:25.0:1773851862.602165:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602166:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000df36fa9.
02000000:00000001:25.0:1773851862.602167:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602167:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024b85fc4.
02000000:00000001:25.0:1773851862.602168:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602168:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed2c86ad.
02000000:00000001:25.0:1773851862.602169:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602169:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000374e1e9f.
02000000:00000001:25.0:1773851862.602170:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602171:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000099a1c079.
02000000:00000001:25.0:1773851862.602171:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602172:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ae3d1a3.
02000000:00000001:25.0:1773851862.602173:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602173:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c07faa31.
02000000:00000001:25.0:1773851862.602174:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602174:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a5e1f125.
02000000:00000001:25.0:1773851862.602175:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602175:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eb211190.
02000000:00000001:25.0:1773851862.602176:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602176:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c57e563d.
02000000:00000001:25.0:1773851862.602177:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602177:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d526343c.
02000000:00000001:25.0:1773851862.602178:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602178:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000022ac85c6.
02000000:00000001:25.0:1773851862.602179:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602179:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000369803f8.
02000000:00000001:25.0:1773851862.602180:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602181:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ca6aeeb8.
02000000:00000001:25.0:1773851862.602181:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602182:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002326a975.
02000000:00000001:25.0:1773851862.602182:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602183:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000830a006b.
02000000:00000001:25.0:1773851862.602184:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602184:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001ed1989b.
02000000:00000001:25.0:1773851862.602185:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602185:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000462756c5.
02000000:00000001:25.0:1773851862.602186:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602186:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000e560427f.
02000000:00000001:25.0:1773851862.602188:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602188:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002826a21a.
02000000:00000001:25.0:1773851862.602189:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602189:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d3545690.
02000000:00000001:25.0:1773851862.602190:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602190:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb1bc0b6.
02000000:00000001:25.0:1773851862.602191:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602192:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000052e6b682.
02000000:00000001:25.0:1773851862.602192:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602196:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c404e6b7.
02000000:00000001:25.0:1773851862.602197:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602197:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000847beaa2.
02000000:00000001:25.0:1773851862.602198:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602198:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006734c1e.
02000000:00000001:25.0:1773851862.602199:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602200:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001dc1b060.
02000000:00000001:25.0:1773851862.602200:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602201:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cf28743f.
02000000:00000001:25.0:1773851862.602202:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602202:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005b020f9c.
02000000:00000001:25.0:1773851862.602203:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602203:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cad949aa.
02000000:00000001:25.0:1773851862.602204:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602204:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000014472865.
02000000:00000001:25.0:1773851862.602205:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602205:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c32d6c7e.
02000000:00000001:25.0:1773851862.602206:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602206:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007a9d1e0f.
02000000:00000001:25.0:1773851862.602207:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602208:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e3259bc.
02000000:00000001:25.0:1773851862.602209:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602209:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004534ce1e.
02000000:00000001:25.0:1773851862.602210:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602210:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008d43c5cb.
02000000:00000001:25.0:1773851862.602211:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602212:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000099f7d48c.
02000000:00000001:25.0:1773851862.602212:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602213:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000097ec637e.
02000000:00000001:25.0:1773851862.602213:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602214:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6e8dc74.
02000000:00000001:25.0:1773851862.602214:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602215:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009beee574.
02000000:00000001:25.0:1773851862.602216:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602216:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006001cede.
02000000:00000001:25.0:1773851862.602217:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602217:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000023a79b97.
02000000:00000001:25.0:1773851862.602218:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602219:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000053f91661.
02000000:00000001:25.0:1773851862.602220:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602220:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001e29fc0e.
02000000:00000001:25.0:1773851862.602221:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602221:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000031e87e9d.
02000000:00000001:25.0:1773851862.602222:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602223:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001581485e.
02000000:00000001:25.0:1773851862.602223:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602224:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a7c96c2e.
02000000:00000001:25.0:1773851862.602225:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602225:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006dc06bc9.
02000000:00000001:25.0:1773851862.602226:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602226:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e4e92719.
02000000:00000001:25.0:1773851862.602228:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602228:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f58b8666.
02000000:00000001:25.0:1773851862.602229:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602229:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b226fbd.
02000000:00000001:25.0:1773851862.602230:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602231:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000064e13148.
02000000:00000001:25.0:1773851862.602232:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602232:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000903175d.
02000000:00000001:25.0:1773851862.602233:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602233:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8618837.
02000000:00000001:25.0:1773851862.602234:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602234:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a6024c50.
02000000:00000001:25.0:1773851862.602235:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602235:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002af685e1.
02000000:00000001:25.0:1773851862.602236:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602236:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000090f30f30.
02000000:00000001:25.0:1773851862.602237:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602237:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000935dfc3c.
02000000:00000001:25.0:1773851862.602238:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602239:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 0000000001f7f75a.
02000000:00000001:25.0:1773851862.602239:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602240:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eb8518c4.
02000000:00000001:25.0:1773851862.602241:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602241:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000040eab48e.
02000000:00000001:25.0:1773851862.602242:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602243:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000068435085.
02000000:00000001:25.0:1773851862.602244:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602244:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008d096de4.
02000000:00000001:25.0:1773851862.602245:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602245:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b6f100a6.
02000000:00000001:25.0:1773851862.602246:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602246:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000039e27847.
02000000:00000001:25.0:1773851862.602247:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602247:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f67a5f4.
02000000:00000001:25.0:1773851862.602248:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602249:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000064211812.
02000000:00000001:25.0:1773851862.602249:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602250:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dadf01d3.
02000000:00000001:25.0:1773851862.602251:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602251:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002cb0998d.
02000000:00000001:25.0:1773851862.602252:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602252:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006edf22d1.
02000000:00000001:25.0:1773851862.602253:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602253:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002035df90.
02000000:00000001:25.0:1773851862.602254:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602254:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076b4fff5.
02000000:00000001:25.0:1773851862.602255:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602255:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d39d7b35.
02000000:00000001:25.0:1773851862.602256:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602257:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd9df8e1.
02000000:00000001:25.0:1773851862.602258:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602258:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000029318578.
02000000:00000001:25.0:1773851862.602259:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602259:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061ea7d1f.
02000000:00000001:25.0:1773851862.602260:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602260:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008bc13d96.
02000000:00000001:25.0:1773851862.602261:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602261:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000af1bb412.
02000000:00000001:25.0:1773851862.602262:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602262:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fc844a13.
02000000:00000001:25.0:1773851862.602263:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602264:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009eef6b1c.
02000000:00000001:25.0:1773851862.602265:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602266:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001f9e30f1.
02000000:00000001:25.0:1773851862.602266:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602267:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004ba7254.
02000000:00000001:25.0:1773851862.602268:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602268:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000001686e81.
02000000:00000001:25.0:1773851862.602269:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602269:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a15b85e3.
02000000:00000001:25.0:1773851862.602270:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602270:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000031371c34.
02000000:00000001:25.0:1773851862.602271:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602271:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000023c4c4b2.
02000000:00000001:25.0:1773851862.602272:0:41182:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:25.0:1773851862.602272:0:41182:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008960026e.
02000000:00000001:25.0:1773851862.602273:0:41182:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:25.0:1773851862.602274:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004b435882.
00000100:00000001:25.0:1773851862.602275:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:25.0:1773851862.602276:0:41182:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt: registering portal 12
00000400:00000010:25.0:1773851862.602277:0:41182:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b8c2e8b5.
00000400:00000010:25.0:1773851862.602278:0:41182:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 1144 at 0000000009177b08 (tot 253200771).
00000800:00000200:29.0:1773851862.602862:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851862.602863:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851862.602864:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851862.602866:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851862.602868:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20688@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.602869:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20688@kfi7 : PUT - for me
00000400:00000200:29.0:1773851862.602870:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20688@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.602871:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009252edd7 nid 20688@kfi7 refs 1
00000400:00000200:29.0:1773851862.602872:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20688@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.602873:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009252edd7 nid 20688@kfi7 refs 2
00000400:00000200:29.0:1773851862.602874:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009252edd7 nid 20688@kfi7 refs 3
00000400:00000200:29.0:1773851862.602875:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20688@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.602876:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20688@kfi7 of length 224 into portal 12 MB=0x69b82402ba640
00000400:00000200:29.0:1773851862.602877:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20688@kfi7 of length 224/224 into md 0x77fe139dd [64] + 171496
00000800:00000200:29.0:1773851862.602879:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851862.602880:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.602881:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20688@kfi7: PUT: OK
00000100:00000001:29.0:1773851862.602882:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851862.602882:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851862.602883:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b0276502.
00000100:00000040:29.0:1773851862.602884:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000b0276502 x1859833584920128 msgsize 224
00000100:00100000:29.0:1773851862.602886:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-20688@kfi7 (source: 12345-20688@kfi7)
00000100:00000001:29.0:1773851862.602887:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851862.602887:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009252edd7 nid 20688@kfi7 refs 2
00000100:00000001:31.0:1773851862.602888:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851862.602889:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851862.602889:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851862.602889:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851862.602889:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851862.602890:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851862.602891:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833584920128
00000020:00000001:31.0:1773851862.602892:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851862.602893:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875d33ef03
00000020:00000001:31.0:1773851862.602893:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851862.602895:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000036e8e88d refcount=5
00000020:00000001:31.0:1773851862.602897:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095681564672 : -106978027986944 : ffff9eb43ca4a000)
00000020:00000001:31.0:1773851862.602898:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637095681564672 : -106978027986944 : ffff9eb43ca4a000)
00000100:00000001:31.0:1773851862.602899:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851862.602900:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851862.602901:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000259b265.
00000020:00000010:31.0:1773851862.602902:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851862.602902:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bcd0c99c.
00000100:00000001:31.0:1773851862.602903:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851862.602904:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851862.602904:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851862.602905:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851862.602906:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851862.602906:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851862.602907:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851862.602908:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851862.602909:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851862.602909:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851862.602909:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851862.602910:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20688@kfi7, seq: 2055502
00000100:00000001:31.0:1773851862.602911:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.602911:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000036e8e88d : new rpc_count 1
00000100:00000001:28.0:1773851862.602911:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343696128 : -106994365855488 : ffff9eb06ed48900)
00000100:00000001:31.0:1773851862.602912:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.602913:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b0276502 x1859833584920128/t0(0) o400->37996173-8e53-4bd7-a44a-52df61f107da@20688@kfi7:650/0 lens 224/0 e 0 to 0 dl 1773852010 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1777-0'
00000100:00000001:28.0:1773851862.602915:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851862.602916:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851862.602917:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0276502 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:37996173-8e53-4bd7-a44a-52df61f107da+5:39750:x1859833584920128:12345-20688@kfi7:400:default-tuolumne1777-0
00000100:00000200:28.0:1773851862.602918:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833584920128
00000020:00000001:28.0:1773851862.602919:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851862.602919:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851862.602920:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.602921:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851862.602921:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851862.602922:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851862.602922:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833584920128, found 0 last_xid 1859833584920127
00000020:00000001:28.0:1773851862.602923:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851862.602924:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851862.602925:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851862.602925:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.602926:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851862.602926:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851862.602927:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851862.602928:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000052fa1d65.
02000000:00000001:28.0:1773851862.602928:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.602929:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.602929:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851862.602933:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262824183, transno 0, xid 1859833584920128
00010000:00000001:28.0:1773851862.602934:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851862.602935:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b0276502 x1859833584920128/t0(0) o400->37996173-8e53-4bd7-a44a-52df61f107da@20688@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1777-0'
00010000:00000001:28.0:1773851862.602937:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851862.602937:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851862.602938:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=95 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851862.602939:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851862.602940:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009a51bd93 refcount 3 to 20688@kfi7
00000100:00000001:28.0:1773851862.602941:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063744 : -107155994487872 : ffff9e8acd0353c0)
02000000:00000001:28.0:1773851862.602942:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851862.602942:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.602943:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851862.602944:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20688@kfi7
00000400:00000010:28.0:1773851862.602945:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000919a9384.
00000100:00000200:28.0:1773851862.602945:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833584920128, offset 224
00000400:00000200:28.0:1773851862.602947:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20688@kfi7
00000400:00000200:28.0:1773851862.602948:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20688@kfi7 to cpt 7
00000400:00000200:28.0:1773851862.602949:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009252edd7 nid 20688@kfi7 refs 1
00000400:00000200:28.0:1773851862.602950:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009252edd7 nid 20688@kfi7 refs 2
00000400:00000200:28.0:1773851862.602951:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009252edd7 nid 20688@kfi7 refs 3
00000400:00000200:28.0:1773851862.602952:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20688@kfi7 local destination
00000400:00000200:28.0:1773851862.602953:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769036:8769036:1024:4294967295] 20688@kfi7 LPNI seq info [8415643:8415643:16:4294967295]
00000400:00000200:28.0:1773851862.602954:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009252edd7 nid 20688@kfi7 refs 2
00000400:00000200:28.0:1773851862.602955:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20688@kfi7 to cpt 7
00000400:00000200:28.0:1773851862.602957:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20688@kfi7(20688@kfi7:20688@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851862.602958:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009252edd7 nid 20688@kfi7 refs 3
00000800:00000200:28.0:1773851862.602959:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851862.602960:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851862.602962:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851862.602965:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x969 Using peer 20688@kfi7(0x969)
00000800:00000200:28.0:1773851862.602968:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x969: rc=0
00000800:00000200:28.0:1773851862.602969:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x969 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851862.602971:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.602972:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009a51bd93 refcount 2 to 20688@kfi7
00010000:00000001:28.0:1773851862.602972:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851862.602973:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.602974:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851862.602974:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b0276502 x1859833584920128/t0(0) o400->37996173-8e53-4bd7-a44a-52df61f107da@20688@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1777-0'
00000100:00100000:28.0:1773851862.602979:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0276502 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:37996173-8e53-4bd7-a44a-52df61f107da+5:39750:x1859833584920128:12345-20688@kfi7:400:default-tuolumne1777-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851862.602981:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20688@kfi7, seq: 2055502
00000100:00000040:28.0:1773851862.602981:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000036e8e88d : new rpc_count 0
00000100:00000001:28.0:1773851862.602982:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851862.602983:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851862.602983:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:28.0:1773851862.602984:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bcd0c99c.
00000020:00000010:28.0:1773851862.602985:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000259b265.
00000020:00000040:28.0:1773851862.602986:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000036e8e88d : new refcount 4
00000100:00000001:28.0:1773851862.602986:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851862.602991:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x969 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851862.602993:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.602994:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20688@kfi7: PUT: OK
00000400:00000200:29.0:1773851862.602995:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000919a9384
00000400:00000010:29.0:1773851862.602995:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000919a9384.
00000100:00000001:29.0:1773851862.602996:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851862.602996:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851862.602997:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009252edd7 nid 20688@kfi7 refs 2
00000800:00000200:29.0:1773851862.602998:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 20688@kfi7(000000001cbed3a7):0x0 lsk 2410 rsk 16 tsk 0 trmk 0 tmk 0 trr 7 tta 0x969 Transaction freed
00000800:00000200:17.0:1773851862.603732:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851862.603733:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851862.603735:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851862.603737:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851862.603739:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603740:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14074@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.603740:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603741:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 1
00000400:00000200:17.0:1773851862.603742:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603743:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 2
00000400:00000200:17.0:1773851862.603743:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 3
00000400:00000200:17.0:1773851862.603744:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603745:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14074@kfi7 of length 224 into portal 12 MB=0x699de89b4fc40
00000400:00000200:17.0:1773851862.603746:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14074@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 4064
00000800:00000200:17.0:1773851862.603748:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851862.603749:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851862.603750:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14074@kfi7: PUT: OK
00000100:00000001:17.0:1773851862.603751:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851862.603751:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851862.603752:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000082198b88.
00000100:00000040:17.0:1773851862.603752:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000082198b88 x1858030932393024 msgsize 224
00000100:00100000:17.0:1773851862.603754:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14074@kfi7 (source: 12345-14074@kfi7)
00000100:00000001:17.0:1773851862.603754:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851862.603755:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 2
00000100:00000001:19.0:1773851862.603756:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851862.603756:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851862.603757:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851862.603757:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851862.603757:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851862.603758:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851862.603759:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030932393024
00000020:00000001:19.0:1773851862.603759:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851862.603760:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ff2
00000020:00000001:19.0:1773851862.603760:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851862.603762:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000016362519 refcount=6
00000020:00000001:19.0:1773851862.603763:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240092672 : -107152469458944 : ffff9e8b9f1f0000)
00000020:00000001:19.0:1773851862.603764:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240092672 : -107152469458944 : ffff9e8b9f1f0000)
00000100:00000001:19.0:1773851862.603764:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.603765:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851862.603766:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851862.603767:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.603768:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851862.603769:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851862.603769:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851862.603769:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.603770:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851862.603771:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851862.603771:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.603772:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.603773:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.603774:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851862.603774:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851862.603774:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851862.603775:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14074@kfi7, seq: 2156297
00000100:00000040:19.0:1773851862.603776:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000016362519 : new rpc_count 1
00000100:00000001:19.0:1773851862.603776:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764354048 : -107095945197568 : ffff9e98c83ac800)
00000100:00000001:16.0:1773851862.603776:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851862.603776:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.603778:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000082198b88 x1858030932393024/t0(0) o400->1731dbc9-aa1f-4234-9fa1-7f8cae5b6599@14074@kfi7:83/0 lens 224/0 e 0 to 0 dl 1773852198 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne223-0'
00000100:00000001:19.0:1773851862.603781:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.603781:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851862.603782:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000082198b88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1731dbc9-aa1f-4234-9fa1-7f8cae5b6599+6:47843:x1858030932393024:12345-14074@kfi7:400:default-tuolumne223-0
00000100:00000200:19.0:1773851862.603784:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030932393024
00000020:00000001:19.0:1773851862.603784:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851862.603785:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851862.603786:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.603786:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851862.603787:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851862.603788:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851862.603788:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030932393024, found 0 last_xid 1858030932393023
00000020:00000001:19.0:1773851862.603789:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851862.603790:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851862.603791:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851862.603791:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.603792:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851862.603793:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851862.603793:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851862.603794:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d3eb76a8.
02000000:00000001:19.0:1773851862.603794:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.603795:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.603796:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851862.603796:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030932393024
00010000:00000001:19.0:1773851862.603797:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851862.603798:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000082198b88 x1858030932393024/t0(0) o400->1731dbc9-aa1f-4234-9fa1-7f8cae5b6599@14074@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne223-0'
00010000:00000001:19.0:1773851862.603800:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851862.603801:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851862.603801:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=95 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851862.603802:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851862.603803:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f9f5973e refcount 5 to 14074@kfi7
00000100:00000001:19.0:1773851862.603804:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518816 : -107156126032800 : ffff9e8ac52c1c60)
02000000:00000001:19.0:1773851862.603806:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851862.603806:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.603807:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851862.603808:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14074@kfi7
00000400:00000010:19.0:1773851862.603808:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a8e16822.
00000100:00000200:19.0:1773851862.603809:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030932393024, offset 224
00000400:00000200:19.0:1773851862.603810:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14074@kfi7
00000400:00000200:19.0:1773851862.603811:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.603812:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 1
00000400:00000200:19.0:1773851862.603813:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 2
00000400:00000200:19.0:1773851862.603814:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 3
00000400:00000200:19.0:1773851862.603816:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14074@kfi7 local destination
00000400:00000200:19.0:1773851862.603817:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769037:8769037:1024:4294967295] 14074@kfi7 LPNI seq info [24441:24441:16:4294967295]
00000400:00000200:19.0:1773851862.603818:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 2
00000400:00000200:19.0:1773851862.603819:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.603821:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14074@kfi7(14074@kfi7:14074@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851862.603822:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 3
00000800:00000200:19.0:1773851862.603823:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851862.603824:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851862.603826:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851862.603828:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x165 Using peer 14074@kfi7(0x165)
00000800:00000200:19.0:1773851862.603831:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x165: rc=0
00000800:00000200:19.0:1773851862.603833:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x165 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851862.603834:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.603835:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f9f5973e refcount 4 to 14074@kfi7
00010000:00000001:19.0:1773851862.603836:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851862.603836:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.603837:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851862.603838:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000082198b88 x1858030932393024/t0(0) o400->1731dbc9-aa1f-4234-9fa1-7f8cae5b6599@14074@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne223-0'
00000100:00100000:19.0:1773851862.603841:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000082198b88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1731dbc9-aa1f-4234-9fa1-7f8cae5b6599+6:47843:x1858030932393024:12345-14074@kfi7:400:default-tuolumne223-0 Request processed in 59us (87us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851862.603843:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14074@kfi7, seq: 2156297
00000100:00000040:19.0:1773851862.603843:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000016362519 : new rpc_count 0
00000100:00000001:19.0:1773851862.603845:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851862.603845:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851862.603845:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x165 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851862.603846:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.603846:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000400:00000200:17.0:1773851862.603846:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851862.603847:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000400:00000200:17.0:1773851862.603847:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14074@kfi7: PUT: OK
00000020:00000040:19.0:1773851862.603848:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000016362519 : new refcount 5
00000400:00000200:17.0:1773851862.603848:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a8e16822
00000100:00000001:19.0:1773851862.603849:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:17.0:1773851862.603849:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a8e16822.
00000100:00000001:17.0:1773851862.603850:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851862.603850:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851862.603851:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 2
00000800:00000200:17.0:1773851862.603852:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 14074@kfi7(000000003a9dacbb):0x0 lsk 358 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x165 Transaction freed
00000800:00000200:17.0:1773851862.603945:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851862.603946:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851862.603947:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851862.603949:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851862.603951:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603952:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14074@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.603953:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603953:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 1
00000400:00000200:17.0:1773851862.603954:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603955:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 2
00000400:00000200:17.0:1773851862.603955:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 3
00000400:00000200:17.0:1773851862.603956:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.603957:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14074@kfi7 of length 224 into portal 12 MB=0x699de89b503c0
00000400:00000200:17.0:1773851862.603958:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14074@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 4288
00000800:00000200:17.0:1773851862.603959:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851862.603961:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851862.603962:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14074@kfi7: PUT: OK
00000100:00000001:17.0:1773851862.603963:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851862.603963:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851862.603964:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6a6a464.
00000100:00000040:17.0:1773851862.603964:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a6a6a464 x1858030932394944 msgsize 224
00000100:00100000:17.0:1773851862.603965:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14074@kfi7 (source: 12345-14074@kfi7)
00000100:00000001:17.0:1773851862.603966:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851862.603967:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851862.603967:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 2
02000000:00000001:19.0:1773851862.603968:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851862.603968:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851862.603968:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851862.603969:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851862.603969:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851862.603970:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030932394944
00000020:00000001:19.0:1773851862.603970:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851862.603971:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9134f
00000020:00000001:19.0:1773851862.603971:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851862.603975:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005c72c0f9 refcount=6
00000020:00000001:19.0:1773851862.603975:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169317376 : -107127540234240 : ffff9e916d04c800)
00000020:00000001:19.0:1773851862.603976:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169317376 : -107127540234240 : ffff9e916d04c800)
00000100:00000001:19.0:1773851862.603977:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.603977:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851862.603978:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851862.603978:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.603979:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851862.603980:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851862.603980:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851862.603981:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.603982:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851862.603982:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851862.603983:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.603983:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.603985:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.603985:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851862.603985:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851862.603985:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851862.603986:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14074@kfi7, seq: 2156298
00000100:00000040:19.0:1773851862.603987:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005c72c0f9 : new rpc_count 1
00000100:00000001:19.0:1773851862.603987:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764363264 : -107095945188352 : ffff9e98c83aec00)
00000100:00000001:16.0:1773851862.603987:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851862.603987:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.603988:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6a6a464 x1858030932394944/t0(0) o400->ec75e2c3-b833-4d9f-b61d-3b8cc29a5fe0@14074@kfi7:83/0 lens 224/0 e 0 to 0 dl 1773852198 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne223-0'
00000100:00000001:19.0:1773851862.603991:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.603991:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851862.603992:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6a6a464 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ec75e2c3-b833-4d9f-b61d-3b8cc29a5fe0+6:47841:x1858030932394944:12345-14074@kfi7:400:default-tuolumne223-0
00000100:00000200:19.0:1773851862.603993:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030932394944
00000020:00000001:19.0:1773851862.603993:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851862.603994:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851862.603994:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.603995:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851862.603995:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851862.603996:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851862.603996:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030932394944, found 0 last_xid 1858030932394943
00000020:00000001:19.0:1773851862.603997:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851862.603998:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851862.603998:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851862.603999:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.603999:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851862.604000:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851862.604001:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851862.604001:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ac06634d.
02000000:00000001:19.0:1773851862.604002:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.604002:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.604003:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851862.604004:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768306, transno 0, xid 1858030932394944
00010000:00000001:19.0:1773851862.604004:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851862.604005:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6a6a464 x1858030932394944/t0(0) o400->ec75e2c3-b833-4d9f-b61d-3b8cc29a5fe0@14074@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne223-0'
00010000:00000001:19.0:1773851862.604007:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851862.604008:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851862.604008:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=95 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851862.604009:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851862.604010:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f9f5973e refcount 5 to 14074@kfi7
00000100:00000001:19.0:1773851862.604010:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518816 : -107156126032800 : ffff9e8ac52c1c60)
02000000:00000001:19.0:1773851862.604011:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851862.604011:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.604012:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851862.604012:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14074@kfi7
00000400:00000010:19.0:1773851862.604013:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000094eafa05.
00000100:00000200:19.0:1773851862.604013:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030932394944, offset 224
00000400:00000200:19.0:1773851862.604015:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14074@kfi7
00000400:00000200:19.0:1773851862.604015:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.604016:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 1
00000400:00000200:19.0:1773851862.604017:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 2
00000400:00000200:19.0:1773851862.604018:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 3
00000400:00000200:19.0:1773851862.604019:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14074@kfi7 local destination
00000400:00000200:19.0:1773851862.604020:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769038:8769038:1024:4294967295] 14074@kfi7 LPNI seq info [24442:24442:16:4294967295]
00000400:00000200:19.0:1773851862.604021:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007104372a nid 14074@kfi7 refs 2
00000400:00000200:19.0:1773851862.604022:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14074@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.604024:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14074@kfi7(14074@kfi7:14074@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851862.604025:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 3
00000800:00000200:19.0:1773851862.604026:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851862.604027:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851862.604029:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851862.604031:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000077a Using peer 14074@kfi7(0x10000000000077a)
00000800:00000200:19.0:1773851862.604035:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x10000000000077a: rc=0
00000800:00000200:19.0:1773851862.604036:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000077a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851862.604038:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.604038:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f9f5973e refcount 4 to 14074@kfi7
00010000:00000001:19.0:1773851862.604039:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851862.604039:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.604040:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851862.604041:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6a6a464 x1858030932394944/t0(0) o400->ec75e2c3-b833-4d9f-b61d-3b8cc29a5fe0@14074@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne223-0'
00000100:00100000:19.0:1773851862.604043:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6a6a464 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ec75e2c3-b833-4d9f-b61d-3b8cc29a5fe0+6:47841:x1858030932394944:12345-14074@kfi7:400:default-tuolumne223-0 Request processed in 52us (79us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851862.604045:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14074@kfi7, seq: 2156298
00000100:00000040:19.0:1773851862.604046:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005c72c0f9 : new rpc_count 0
00000100:00000001:19.0:1773851862.604047:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851862.604047:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851862.604048:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851862.604048:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000077a TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851862.604049:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000020:00000010:19.0:1773851862.604049:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000400:00000200:17.0:1773851862.604049:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:19.0:1773851862.604050:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000005c72c0f9 : new refcount 5
00000100:00000001:19.0:1773851862.604050:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851862.604050:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14074@kfi7: PUT: OK
00000400:00000200:17.0:1773851862.604051:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000094eafa05
00000400:00000010:17.0:1773851862.604051:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000094eafa05.
00000100:00000001:17.0:1773851862.604052:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851862.604052:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851862.604053:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007104372a nid 14074@kfi7 refs 2
00000800:00000200:17.0:1773851862.604054:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 14074@kfi7(000000002d26c87b):0x0 lsk 1915 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000077a Transaction freed
00000800:00000200:29.0:1773851862.629182:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851862.629182:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851862.629184:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851862.629186:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851862.629187:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15824@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.629188:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15824@kfi7 : PUT - for me
00000400:00000200:29.0:1773851862.629189:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15824@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.629190:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2d7521a nid 15824@kfi7 refs 1
00000400:00000200:29.0:1773851862.629191:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15824@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.629192:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2d7521a nid 15824@kfi7 refs 2
00000400:00000200:29.0:1773851862.629193:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e2d7521a nid 15824@kfi7 refs 3
00000400:00000200:29.0:1773851862.629193:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15824@kfi7 to cpt 7
00000400:00000200:29.0:1773851862.629195:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15824@kfi7 of length 224 into portal 12 MB=0x69b4b60477c00
00000400:00000200:29.0:1773851862.629196:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15824@kfi7 of length 224/224 into md 0x77fe139dd [64] + 171720
00000800:00000200:29.0:1773851862.629198:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851862.629199:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.629200:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15824@kfi7: PUT: OK
00000100:00000001:29.0:1773851862.629201:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851862.629201:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851862.629202:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec3041ec.
00000100:00000040:29.0:1773851862.629203:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ec3041ec x1859597900413952 msgsize 224
00000100:00100000:29.0:1773851862.629204:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15824@kfi7 (source: 12345-15824@kfi7)
00000100:00000001:29.0:1773851862.629205:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851862.629206:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2d7521a nid 15824@kfi7 refs 2
00000800:00000200:29.0:1773851862.629207:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851862.629207:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851862.629207:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851862.629208:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851862.629208:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851862.629209:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851862.629210:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597900413952
00000020:00000001:28.0:1773851862.629210:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851862.629211:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80534
00000020:00000001:28.0:1773851862.629212:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851862.629215:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000034fd7fd1 refcount=5
00000020:00000001:28.0:1773851862.629216:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637122517745664 : -106951191805952 : ffff9eba7c344000)
00000020:00000001:28.0:1773851862.629217:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637122517745664 : -106951191805952 : ffff9eba7c344000)
00000100:00000001:28.0:1773851862.629218:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851862.629218:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851862.629219:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000021731e2.
00000020:00000010:28.0:1773851862.629220:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851862.629221:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d66f3d8.
00000100:00000001:28.0:1773851862.629221:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851862.629222:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851862.629222:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851862.629223:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851862.629224:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851862.629224:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.629225:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851862.629226:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851862.629226:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851862.629227:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851862.629227:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851862.629227:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15824@kfi7, seq: 2055503
00000100:00000001:31.0:1773851862.629228:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.629228:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000034fd7fd1 : new rpc_count 1
00000100:00000001:31.0:1773851862.629229:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.629229:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343716864 : -106994365834752 : ffff9eb06ed4da00)
00000100:00000040:28.0:1773851862.629230:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ec3041ec x1859597900413952/t0(0) o400->f8ce5f42-f563-4c9e-b183-f6740ebf6eeb@15824@kfi7:650/0 lens 224/0 e 0 to 0 dl 1773852010 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1473-0'
00000100:00000001:28.0:1773851862.629232:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851862.629233:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851862.629234:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec3041ec pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f8ce5f42-f563-4c9e-b183-f6740ebf6eeb+5:39519:x1859597900413952:12345-15824@kfi7:400:default-tuolumne1473-0
00000100:00000200:28.0:1773851862.629235:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597900413952
00000020:00000001:28.0:1773851862.629235:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851862.629236:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851862.629237:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.629237:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851862.629238:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851862.629239:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851862.629240:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597900413952, found 0 last_xid 1859597900413951
00000020:00000001:28.0:1773851862.629241:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851862.629242:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851862.629242:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851862.629243:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.629243:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851862.629244:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851862.629244:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851862.629245:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ddcc3c3f.
02000000:00000001:28.0:1773851862.629245:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.629246:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.629247:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851862.629247:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183182606209, transno 0, xid 1859597900413952
00010000:00000001:28.0:1773851862.629248:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851862.629249:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ec3041ec x1859597900413952/t0(0) o400->f8ce5f42-f563-4c9e-b183-f6740ebf6eeb@15824@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1473-0'
00010000:00000001:28.0:1773851862.629251:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851862.629251:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851862.629252:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=95 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851862.629253:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851862.629254:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e109b5ea refcount 3 to 15824@kfi7
00000100:00000001:28.0:1773851862.629254:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214496 : -107155106337120 : ffff9e8b01f36ea0)
02000000:00000001:28.0:1773851862.629255:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851862.629256:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.629257:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851862.629257:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15824@kfi7
00000400:00000010:28.0:1773851862.629258:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000aa6119c.
00000100:00000200:28.0:1773851862.629258:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597900413952, offset 224
00000400:00000200:28.0:1773851862.629260:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15824@kfi7
00000400:00000200:28.0:1773851862.629260:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15824@kfi7 to cpt 7
00000400:00000200:28.0:1773851862.629261:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2d7521a nid 15824@kfi7 refs 1
00000400:00000200:28.0:1773851862.629262:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e2d7521a nid 15824@kfi7 refs 2
00000400:00000200:28.0:1773851862.629263:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e2d7521a nid 15824@kfi7 refs 3
00000400:00000200:28.0:1773851862.629265:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15824@kfi7 local destination
00000400:00000200:28.0:1773851862.629266:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769039:8769039:1024:4294967295] 15824@kfi7 LPNI seq info [5397034:5397034:16:4294967295]
00000400:00000200:28.0:1773851862.629268:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e2d7521a nid 15824@kfi7 refs 2
00000400:00000200:28.0:1773851862.629268:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15824@kfi7 to cpt 7
00000400:00000200:28.0:1773851862.629270:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15824@kfi7(15824@kfi7:15824@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851862.629271:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e2d7521a nid 15824@kfi7 refs 3
00000800:00000200:28.0:1773851862.629272:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851862.629273:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851862.629275:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851862.629278:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6b4 Using peer 15824@kfi7(0x6b4)
00000800:00000200:28.0:1773851862.629280:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x6b4: rc=0
00000800:00000200:28.0:1773851862.629282:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6b4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851862.629284:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.629284:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e109b5ea refcount 2 to 15824@kfi7
00010000:00000001:28.0:1773851862.629285:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851862.629286:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851862.629286:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851862.629287:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec3041ec x1859597900413952/t0(0) o400->f8ce5f42-f563-4c9e-b183-f6740ebf6eeb@15824@kfi7:650/0 lens 224/224 e 0 to 0 dl 1773852010 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1473-0'
00000100:00100000:28.0:1773851862.629291:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec3041ec pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f8ce5f42-f563-4c9e-b183-f6740ebf6eeb+5:39519:x1859597900413952:12345-15824@kfi7:400:default-tuolumne1473-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851862.629293:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15824@kfi7, seq: 2055503
00000100:00000040:28.0:1773851862.629294:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000034fd7fd1 : new rpc_count 0
00000100:00000001:28.0:1773851862.629295:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851862.629296:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851862.629296:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851862.629297:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d66f3d8.
00000020:00000010:28.0:1773851862.629298:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000021731e2.
00000020:00000040:28.0:1773851862.629299:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000034fd7fd1 : new refcount 4
00000100:00000001:28.0:1773851862.629300:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851862.629304:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6b4 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851862.629306:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.629307:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15824@kfi7: PUT: OK
00000400:00000200:29.0:1773851862.629308:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000aa6119c
00000400:00000010:29.0:1773851862.629309:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000aa6119c.
00000100:00000001:29.0:1773851862.629309:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851862.629310:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851862.629311:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2d7521a nid 15824@kfi7 refs 2
00000800:00000200:29.0:1773851862.629312:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 15824@kfi7(00000000441493c3):0x0 lsk 1717 rsk 4 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6b4 Transaction freed
00000800:00000200:21.0:1773851862.660976:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.660977:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851862.660978:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851862.660983:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851862.660985:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23795@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.660987:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23795@kfi7 : PUT - for me
00000400:00000200:21.0:1773851862.660988:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23795@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.660989:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038bb138e nid 23795@kfi7 refs 1
00000400:00000200:21.0:1773851862.660990:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23795@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.660991:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038bb138e nid 23795@kfi7 refs 2
00000400:00000200:21.0:1773851862.660992:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000038bb138e nid 23795@kfi7 refs 3
00000400:00000200:21.0:1773851862.660993:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23795@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.660994:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23795@kfi7 of length 224 into portal 12 MB=0x69b4c381dcf40
00000400:00000200:21.0:1773851862.660995:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23795@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 32584
00000800:00000200:21.0:1773851862.660997:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851862.660999:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851862.661000:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23795@kfi7: PUT: OK
00000100:00000001:21.0:1773851862.661001:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851862.661002:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851862.661003:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000093a0aff4.
00000100:00000040:21.0:1773851862.661004:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000093a0aff4 x1859601521561408 msgsize 224
00000100:00100000:21.0:1773851862.661005:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23795@kfi7 (source: 12345-23795@kfi7)
00000100:00000001:21.0:1773851862.661006:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851862.661007:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000038bb138e nid 23795@kfi7 refs 2
00000100:00000001:23.0:1773851862.661009:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851862.661009:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851862.661009:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2054@kfi7:5 <- 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851862.661010:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851862.661010:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851862.661011:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851862.661012:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601521561408
00000020:00000001:23.0:1773851862.661013:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851862.661013:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e628f7510
00000020:00000001:23.0:1773851862.661014:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851862.661018:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000124600a8 refcount=5
00000020:00000001:23.0:1773851862.661019:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636973098120192 : -107100611431424 : ffff9e97b219b400)
00000020:00000001:23.0:1773851862.661020:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636973098120192 : -107100611431424 : ffff9e97b219b400)
00000100:00000001:23.0:1773851862.661021:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.661022:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851862.661023:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c7cc222.
00000020:00000010:23.0:1773851862.661024:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.661025:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851862.661025:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851862.661026:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851862.661026:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.661027:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851862.661028:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851862.661028:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.661029:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.661031:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851862.661031:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851862.661031:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851862.661032:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23795@kfi7, seq: 1997961
00000100:00000001:22.0:1773851862.661032:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851862.661033:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000124600a8 : new rpc_count 1
00000100:00000001:22.0:1773851862.661033:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.661034:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132564922368 : -106941144629248 : ffff9ebcd3100000)
00000100:00000001:22.0:1773851862.661034:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.661035:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000093a0aff4 x1859601521561408/t0(0) o400->03be0b72-4271-4137-bba7-2a0b8eeba780@23795@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1961-0'
00000100:00000001:23.0:1773851862.661038:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.661038:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851862.661040:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093a0aff4 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:03be0b72-4271-4137-bba7-2a0b8eeba780+5:39475:x1859601521561408:12345-23795@kfi7:400:default-tuolumne1961-0
00000100:00000200:23.0:1773851862.661041:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601521561408
00000020:00000001:23.0:1773851862.661041:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851862.661042:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851862.661043:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.661043:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851862.661044:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851862.661044:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851862.661045:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601521561408, found 0 last_xid 1859601521561407
00000020:00000001:23.0:1773851862.661046:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851862.661046:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851862.661047:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851862.661047:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.661048:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851862.661049:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851862.661049:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851862.661050:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005259effa.
02000000:00000001:23.0:1773851862.661050:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.661051:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.661051:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851862.661052:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044182210, transno 0, xid 1859601521561408
00010000:00000001:23.0:1773851862.661053:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851862.661054:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000093a0aff4 x1859601521561408/t0(0) o400->03be0b72-4271-4137-bba7-2a0b8eeba780@23795@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1961-0'
00010000:00000001:23.0:1773851862.661056:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851862.661056:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851862.661057:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=95 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851862.661058:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851862.661059:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000022cd7086 refcount 3 to 23795@kfi7
00000100:00000001:23.0:1773851862.661059:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424335808 : -107145285215808 : ffff9e8d4b55d9c0)
02000000:00000001:23.0:1773851862.661060:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851862.661061:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.661061:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851862.661063:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23795@kfi7
00000400:00000010:23.0:1773851862.661063:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a16c98de.
00000100:00000200:23.0:1773851862.661064:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601521561408, offset 224
00000400:00000200:23.0:1773851862.661065:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23795@kfi7
00000400:00000200:23.0:1773851862.661066:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23795@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.661067:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038bb138e nid 23795@kfi7 refs 1
00000400:00000200:23.0:1773851862.661068:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000038bb138e nid 23795@kfi7 refs 2
00000400:00000200:23.0:1773851862.661069:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000038bb138e nid 23795@kfi7 refs 3
00000400:00000200:23.0:1773851862.661070:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23795@kfi7 local destination
00000400:00000200:23.0:1773851862.661071:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769040:8769040:1024:4294967295] 23795@kfi7 LPNI seq info [168312:168312:16:4294967295]
00000400:00000200:23.0:1773851862.661072:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000038bb138e nid 23795@kfi7 refs 2
00000400:00000200:23.0:1773851862.661073:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23795@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.661075:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23795@kfi7(23795@kfi7:23795@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851862.661076:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000038bb138e nid 23795@kfi7 refs 3
00000800:00000200:23.0:1773851862.661077:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851862.661079:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851862.661081:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851862.661083:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000015 Using peer 23795@kfi7(0x100000000000015)
00000800:00000200:23.0:1773851862.661086:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x100000000000015: rc=0
00000800:00000200:23.0:1773851862.661087:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000015 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851862.661089:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.661090:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000022cd7086 refcount 2 to 23795@kfi7
00010000:00000001:23.0:1773851862.661091:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851862.661091:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.661092:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851862.661092:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000093a0aff4 x1859601521561408/t0(0) o400->03be0b72-4271-4137-bba7-2a0b8eeba780@23795@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1961-0'
00000100:00100000:23.0:1773851862.661098:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093a0aff4 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:03be0b72-4271-4137-bba7-2a0b8eeba780+5:39475:x1859601521561408:12345-23795@kfi7:400:default-tuolumne1961-0 Request processed in 60us (94us total) trans 0 rc 0/0
00000800:00000200:22.0:1773851862.661098:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000015 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851862.661099:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851862.661100:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23795@kfi7, seq: 1997961
00000400:00000200:22.0:1773851862.661100:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23795@kfi7: PUT: OK
00000100:00000040:23.0:1773851862.661101:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000124600a8 : new rpc_count 0
00000400:00000200:22.0:1773851862.661101:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a16c98de
00000400:00000010:22.0:1773851862.661101:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a16c98de.
00000100:00000001:23.0:1773851862.661102:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851862.661102:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:22.0:1773851862.661102:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851862.661102:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851862.661103:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.661103:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:22.0:1773851862.661103:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000038bb138e nid 23795@kfi7 refs 2
00000020:00000010:23.0:1773851862.661104:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c7cc222.
00000020:00000040:23.0:1773851862.661105:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000124600a8 : new refcount 4
00000100:00000001:23.0:1773851862.661105:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851862.661105:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 23795@kfi7(000000006ff386d6):0x0 lsk 22 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000015 Transaction freed
00000800:00000200:9.0:1773851862.680349:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.680350:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851862.680351:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851862.680353:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851862.680355:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15249@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.680356:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15249@kfi7 : PUT - for me
00000400:00000200:9.0:1773851862.680357:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15249@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.680358:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2aa7cae nid 15249@kfi7 refs 1
00000400:00000200:9.0:1773851862.680359:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15249@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.680360:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2aa7cae nid 15249@kfi7 refs 2
00000400:00000200:9.0:1773851862.680361:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c2aa7cae nid 15249@kfi7 refs 3
00000400:00000200:9.0:1773851862.680362:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15249@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.680362:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15249@kfi7 of length 224 into portal 12 MB=0x699e093d7af40
00000400:00000200:9.0:1773851862.680364:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15249@kfi7 of length 224/224 into md 0x78146ce49 [64] + 131056
00000800:00000200:9.0:1773851862.680366:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851862.680367:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851862.680369:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15249@kfi7: PUT: OK
00000100:00000001:9.0:1773851862.680370:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851862.680370:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851862.680371:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000923dc1b9.
00000100:00000040:9.0:1773851862.680372:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000923dc1b9 x1858039692373824 msgsize 224
00000100:00100000:9.0:1773851862.680374:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-15249@kfi7 (source: 12345-15249@kfi7)
00000100:00000001:9.0:1773851862.680375:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851862.680376:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c2aa7cae nid 15249@kfi7 refs 2
00000800:00000200:9.0:1773851862.680377:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851862.680382:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851862.680383:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851862.680383:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851862.680384:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.680385:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851862.680385:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039692373824
00000020:00000001:9.0:1773851862.680386:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851862.680387:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e9a
00000020:00000001:9.0:1773851862.680387:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851862.680391:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000969ebd83 refcount=168
00000020:00000001:9.0:1773851862.680391:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628999168 : -107123080552448 : ffff9e9276d62000)
00000020:00000001:9.0:1773851862.680392:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628999168 : -107123080552448 : ffff9e9276d62000)
00000100:00000001:9.0:1773851862.680394:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.680394:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851862.680395:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851862.680396:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851862.680397:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851862.680398:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851862.680398:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851862.680399:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.680400:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851862.680400:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851862.680401:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.680401:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851862.680403:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851862.680403:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851862.680403:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851862.680404:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851862.680404:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15249@kfi7, seq: 2130765
00000100:00000001:11.0:1773851862.680405:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.680405:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000969ebd83 : new rpc_count 1
00000100:00000001:11.0:1773851862.680406:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.680406:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922916608 : -107141786635008 : ffff9e8e1bddf500)
00000100:00000040:9.0:1773851862.680407:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000923dc1b9 x1858039692373824/t0(0) o400->c57395c0-3fa6-419f-a38f-1741f2d104dc@15249@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1442-0'
00000100:00000001:9.0:1773851862.680410:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.680410:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851862.680412:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000923dc1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c57395c0-3fa6-419f-a38f-1741f2d104dc+168:39814:x1858039692373824:12345-15249@kfi7:400:default-tuolumne1442-0
00000100:00000200:9.0:1773851862.680413:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039692373824
00000020:00000001:9.0:1773851862.680414:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851862.680414:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851862.680415:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.680416:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851862.680416:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851862.680417:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851862.680418:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039692373824, found 0 last_xid 1858039691948991
00000020:00000001:9.0:1773851862.680419:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851862.680419:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851862.680420:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851862.680420:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.680421:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851862.680421:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851862.680422:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851862.680422:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000df818c97.
02000000:00000001:9.0:1773851862.680423:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.680424:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.680425:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851862.680425:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062459, transno 0, xid 1858039692373824
00010000:00000001:9.0:1773851862.680426:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851862.680427:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000923dc1b9 x1858039692373824/t0(0) o400->c57395c0-3fa6-419f-a38f-1741f2d104dc@15249@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1442-0'
00010000:00000001:9.0:1773851862.680429:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851862.680430:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851862.680431:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=95 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851862.680432:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851862.680432:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc6381ec refcount 3 to 15249@kfi7
00000100:00000001:9.0:1773851862.680433:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551674976 : -107156157876640 : ffff9e8ac3463660)
02000000:00000001:9.0:1773851862.680434:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851862.680434:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.680435:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851862.680436:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15249@kfi7
00000400:00000010:9.0:1773851862.680437:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052ffe31c.
00000100:00000200:9.0:1773851862.680438:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039692373824, offset 224
00000400:00000200:9.0:1773851862.680439:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15249@kfi7
00000400:00000200:9.0:1773851862.680440:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15249@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.680440:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2aa7cae nid 15249@kfi7 refs 1
00000400:00000200:9.0:1773851862.680441:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c2aa7cae nid 15249@kfi7 refs 2
00000400:00000200:9.0:1773851862.680443:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c2aa7cae nid 15249@kfi7 refs 3
00000400:00000200:9.0:1773851862.680444:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15249@kfi7 local destination
00000400:00000200:9.0:1773851862.680445:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769041:8769041:1024:4294967295] 15249@kfi7 LPNI seq info [864362:864362:16:4294967295]
00000400:00000200:9.0:1773851862.680447:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c2aa7cae nid 15249@kfi7 refs 2
00000400:00000200:9.0:1773851862.680448:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15249@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.680449:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15249@kfi7(15249@kfi7:15249@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851862.680451:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c2aa7cae nid 15249@kfi7 refs 3
00000800:00000200:9.0:1773851862.680452:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.680453:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851862.680455:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851862.680457:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x7e0 Using peer 15249@kfi7(0x7e0)
00000800:00000200:9.0:1773851862.680460:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x7e0: rc=0
00000800:00000200:9.0:1773851862.680461:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x7e0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851862.680463:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.680464:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc6381ec refcount 2 to 15249@kfi7
00010000:00000001:9.0:1773851862.680465:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851862.680466:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.680466:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851862.680467:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000923dc1b9 x1858039692373824/t0(0) o400->c57395c0-3fa6-419f-a38f-1741f2d104dc@15249@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1442-0'
00000800:00000200:10.0:1773851862.680472:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x7e0 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851862.680473:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000923dc1b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c57395c0-3fa6-419f-a38f-1741f2d104dc+168:39814:x1858039692373824:12345-15249@kfi7:400:default-tuolumne1442-0 Request processed in 62us (100us total) trans 0 rc 0/0
00000400:00000200:10.0:1773851862.680474:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851862.680475:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15249@kfi7: PUT: OK
00000400:00000200:10.0:1773851862.680475:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052ffe31c
00000100:00100000:9.0:1773851862.680475:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15249@kfi7, seq: 2130765
00000400:00000010:10.0:1773851862.680476:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052ffe31c.
00000100:00000001:10.0:1773851862.680476:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000040:9.0:1773851862.680476:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000969ebd83 : new rpc_count 0
00000100:00000001:10.0:1773851862.680477:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851862.680477:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851862.680477:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851862.680478:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c2aa7cae nid 15249@kfi7 refs 2
00000020:00000010:9.0:1773851862.680478:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851862.680478:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000800:00000200:10.0:1773851862.680479:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 15249@kfi7(000000009a5a1131):0x0 lsk 2017 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x7e0 Transaction freed
00000020:00000010:9.0:1773851862.680479:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851862.680480:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000969ebd83 : new refcount 167
00000100:00000001:9.0:1773851862.680481:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851862.728274:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851862.728275:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851862.728277:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851862.728279:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851862.728281:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18512@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.728282:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18512@kfi7 : PUT - for me
00000400:00000200:22.0:1773851862.728283:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18512@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.728284:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088394324 nid 18512@kfi7 refs 1
00000400:00000200:22.0:1773851862.728285:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18512@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.728286:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088394324 nid 18512@kfi7 refs 2
00000400:00000200:22.0:1773851862.728287:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000088394324 nid 18512@kfi7 refs 3
00000400:00000200:22.0:1773851862.728287:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18512@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.728288:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18512@kfi7 of length 224 into portal 12 MB=0x69b4b5ce1a900
00000400:00000200:22.0:1773851862.728290:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18512@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 32808
00000800:00000200:22.0:1773851862.728291:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851862.728293:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851862.728294:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18512@kfi7: PUT: OK
00000100:00000001:22.0:1773851862.728295:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851862.728295:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851862.728296:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd7cb510.
00000100:00000040:22.0:1773851862.728297:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000dd7cb510 x1859597843409152 msgsize 224
00000100:00100000:22.0:1773851862.728298:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-18512@kfi7 (source: 12345-18512@kfi7)
00000100:00000001:22.0:1773851862.728299:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851862.728300:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000088394324 nid 18512@kfi7 refs 2
00000100:00000001:23.0:1773851862.728301:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851862.728301:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851862.728302:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851862.728302:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851862.728302:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851862.728303:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851862.728304:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597843409152
00000020:00000001:23.0:1773851862.728304:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851862.728305:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81cb8
00000020:00000001:23.0:1773851862.728305:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851862.728308:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a6b59030 refcount=5
00000020:00000001:23.0:1773851862.728309:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119306456064 : -106954403095552 : ffff9eb9bccbdc00)
00000020:00000001:23.0:1773851862.728310:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119306456064 : -106954403095552 : ffff9eb9bccbdc00)
00000100:00000001:23.0:1773851862.728311:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.728311:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851862.728312:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e3f29f72.
00000020:00000010:23.0:1773851862.728313:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.728314:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851862.728315:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851862.728315:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851862.728316:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.728317:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851862.728317:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851862.728318:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.728319:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.728320:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851862.728320:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851862.728321:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851862.728321:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851862.728322:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18512@kfi7, seq: 1997962
00000100:00000040:23.0:1773851862.728322:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a6b59030 : new rpc_count 1
00000100:00000001:22.0:1773851862.728322:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.728323:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619615104 : -107003089936512 : ffff9eae66d59f80)
00000100:00000001:22.0:1773851862.728323:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.728324:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dd7cb510 x1859597843409152/t0(0) o400->91d72e71-6c7c-484c-a1c4-b97028a58f05@18512@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1650-0'
00000100:00000001:23.0:1773851862.728327:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.728327:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851862.728328:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd7cb510 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:91d72e71-6c7c-484c-a1c4-b97028a58f05+5:39733:x1859597843409152:12345-18512@kfi7:400:default-tuolumne1650-0
00000100:00000200:23.0:1773851862.728329:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597843409152
00000020:00000001:23.0:1773851862.728330:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851862.728330:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851862.728331:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.728332:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851862.728332:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851862.728333:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851862.728333:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597843409152, found 0 last_xid 1859597843409151
00000020:00000001:23.0:1773851862.728334:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851862.728335:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851862.728335:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851862.728336:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.728337:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851862.728337:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851862.728338:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851862.728339:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b15b1461.
02000000:00000001:23.0:1773851862.728339:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.728340:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.728340:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851862.728341:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262837320, transno 0, xid 1859597843409152
00010000:00000001:23.0:1773851862.728342:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851862.728343:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dd7cb510 x1859597843409152/t0(0) o400->91d72e71-6c7c-484c-a1c4-b97028a58f05@18512@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1650-0'
00010000:00000001:23.0:1773851862.728345:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851862.728346:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851862.728347:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=95 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851862.728348:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851862.728348:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dc8993ea refcount 3 to 18512@kfi7
00000100:00000001:23.0:1773851862.728349:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451040 : -107146752100576 : ffff9e8cf3e6f720)
02000000:00000001:23.0:1773851862.728350:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851862.728350:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.728351:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851862.728352:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18512@kfi7
00000400:00000010:23.0:1773851862.728352:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dffbbfb6.
00000100:00000200:23.0:1773851862.728353:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597843409152, offset 224
00000400:00000200:23.0:1773851862.728354:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18512@kfi7
00000400:00000200:23.0:1773851862.728355:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18512@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.728356:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088394324 nid 18512@kfi7 refs 1
00000400:00000200:23.0:1773851862.728357:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000088394324 nid 18512@kfi7 refs 2
00000400:00000200:23.0:1773851862.728358:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000088394324 nid 18512@kfi7 refs 3
00000400:00000200:23.0:1773851862.728359:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18512@kfi7 local destination
00000400:00000200:23.0:1773851862.728360:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769042:8769042:1024:4294967295] 18512@kfi7 LPNI seq info [269142:269142:16:4294967295]
00000400:00000200:23.0:1773851862.728362:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000088394324 nid 18512@kfi7 refs 2
00000400:00000200:23.0:1773851862.728362:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18512@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.728364:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18512@kfi7(18512@kfi7:18512@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851862.728366:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000088394324 nid 18512@kfi7 refs 3
00000800:00000200:23.0:1773851862.728367:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851862.728368:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851862.728370:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851862.728373:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7d2 Using peer 18512@kfi7(0x7d2)
00000800:00000200:23.0:1773851862.728377:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0x7d2: rc=0
00000800:00000200:23.0:1773851862.728378:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851862.728380:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851862.728381:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dc8993ea refcount 2 to 18512@kfi7
00010000:00000001:23.0:1773851862.728382:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851862.728382:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851862.728383:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851862.728383:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd7cb510 x1859597843409152/t0(0) o400->91d72e71-6c7c-484c-a1c4-b97028a58f05@18512@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1650-0'
00000100:00100000:23.0:1773851862.728386:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd7cb510 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:91d72e71-6c7c-484c-a1c4-b97028a58f05+5:39733:x1859597843409152:12345-18512@kfi7:400:default-tuolumne1650-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851862.728388:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18512@kfi7, seq: 1997962
00000100:00000040:23.0:1773851862.728389:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a6b59030 : new rpc_count 0
00000100:00000001:23.0:1773851862.728390:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851862.728391:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851862.728392:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.728392:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000800:00000200:22.0:1773851862.728392:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7d2 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851862.728393:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e3f29f72.
00000020:00000040:23.0:1773851862.728394:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000a6b59030 : new refcount 4
00000400:00000200:22.0:1773851862.728394:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851862.728395:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:22.0:1773851862.728395:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18512@kfi7: PUT: OK
00000400:00000200:22.0:1773851862.728396:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dffbbfb6
00000400:00000010:22.0:1773851862.728396:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dffbbfb6.
00000100:00000001:22.0:1773851862.728397:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851862.728397:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851862.728398:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000088394324 nid 18512@kfi7 refs 2
00000800:00000200:22.0:1773851862.728399:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18512@kfi7(00000000f730074d):0x0 lsk 2003 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7d2 Transaction freed
00000800:00000200:21.0:1773851862.766224:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.766225:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851862.766226:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851862.766228:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20177@kfi7(0000000085513fc7):0x1189 version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851862.766230:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 Using peer 20177@kfi7(0x1189)
00000400:00000200:21.0:1773851862.766232:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20177@kfi7 to cpt 5
00000800:00000200:21.0:1773851862.766234:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000184df75a: Posted send of 38 bytes to peer 0x1189: rc=0
00000800:00000200:21.0:1773851862.766235:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:21.0:1773851862.766238:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.766239:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851862.766240:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851862.766241:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851862.766243:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20177@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.766244:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20177@kfi7 : PUT - for me
00000400:00000200:21.0:1773851862.766245:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20177@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.766246:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026dbf822 nid 20177@kfi7 refs 1
00000400:00000200:21.0:1773851862.766247:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20177@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.766248:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026dbf822 nid 20177@kfi7 refs 2
00000400:00000200:21.0:1773851862.766248:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000026dbf822 nid 20177@kfi7 refs 3
00000800:00000200:22.0:1773851862.766249:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851862.766249:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19984@kfi7 to cpt 7
00000400:00000200:21.0:1773851862.766250:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19984@kfi7 of length 224 into portal 12 MB=0x69b81b9ce8400
00000800:00000200:22.0:1773851862.766251:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000184df75a: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 Transaction freed
00000400:00000200:21.0:1773851862.766251:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19984@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 33032
00000800:00000200:21.0:1773851862.766253:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851862.766255:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851862.766256:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20177@kfi7: PUT: OK
00000100:00000001:21.0:1773851862.766257:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851862.766257:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851862.766258:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000882769c4.
00000100:00000040:21.0:1773851862.766259:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000882769c4 x1859831330669568 msgsize 224
00000100:00100000:21.0:1773851862.766260:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-19984@kfi7 (source: 12345-20177@kfi7)
00000100:00000001:21.0:1773851862.766261:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851862.766262:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000026dbf822 nid 20177@kfi7 refs 2
00000800:00000200:21.0:1773851862.766263:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851862.766264:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851862.766265:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851862.766265:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851862.766266:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851862.766267:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851862.766268:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831330669568
00000020:00000001:23.0:1773851862.766269:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851862.766269:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce7c84d
00000020:00000001:23.0:1773851862.766271:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851862.766274:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d1005465 refcount=5
00000020:00000001:23.0:1773851862.766275:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134598252544 : -106939111299072 : ffff9ebd4c422800)
00000020:00000001:23.0:1773851862.766277:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134598252544 : -106939111299072 : ffff9ebd4c422800)
00000100:00000001:23.0:1773851862.766278:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851862.766278:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851862.766279:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e3f29f72.
00000020:00000010:23.0:1773851862.766280:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851862.766282:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851862.766283:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851862.766284:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851862.766284:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.766286:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851862.766286:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851862.766287:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851862.766288:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.766290:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851862.766290:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851862.766290:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851862.766291:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851862.766291:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19984@kfi7, seq: 1997963
00000100:00000001:23.0:1773851862.766292:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851862.766292:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d1005465 : new rpc_count 1
00000100:00000001:22.0:1773851862.766292:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132564936192 : -106941144615424 : ffff9ebcd3103600)
00000100:00000001:23.0:1773851862.766293:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851862.766294:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000882769c4 x1859831330669568/t0(0) o400->c8895faf-4139-4cbe-83c7-44cf0f4537f5@19984@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1745-0'
00000100:00000001:22.0:1773851862.766297:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851862.766297:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851862.766298:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000882769c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c8895faf-4139-4cbe-83c7-44cf0f4537f5+5:39657:x1859831330669568:12345-19984@kfi7:400:default-tuolumne1745-0
00000100:00000200:22.0:1773851862.766299:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831330669568
00000020:00000001:22.0:1773851862.766300:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851862.766300:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851862.766301:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.766302:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851862.766302:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851862.766303:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851862.766303:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831330669568, found 0 last_xid 1859831330669567
00000020:00000001:22.0:1773851862.766304:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851862.766305:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851862.766305:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851862.766306:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.766307:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851862.766307:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851862.766307:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851862.766308:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c205ab6a.
02000000:00000001:22.0:1773851862.766309:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851862.766309:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.766310:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851862.766310:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096682898, transno 0, xid 1859831330669568
00010000:00000001:22.0:1773851862.766311:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851862.766312:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000882769c4 x1859831330669568/t0(0) o400->c8895faf-4139-4cbe-83c7-44cf0f4537f5@19984@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1745-0'
00010000:00000001:22.0:1773851862.766314:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851862.766315:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851862.766315:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=95 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851862.766316:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851862.766317:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cf25380f refcount 3 to 19984@kfi7
00000100:00000001:22.0:1773851862.766318:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271584 : -107152618280032 : ffff9e8b96402ba0)
02000000:00000001:22.0:1773851862.766318:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851862.766319:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851862.766319:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851862.766320:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20177@kfi7
00000400:00000010:22.0:1773851862.766321:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034621184.
00000100:00000200:22.0:1773851862.766322:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831330669568, offset 224
00000400:00000200:22.0:1773851862.766323:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20177@kfi7
00000400:00000200:22.0:1773851862.766324:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20177@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.766324:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026dbf822 nid 20177@kfi7 refs 1
00000400:00000200:22.0:1773851862.766325:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000026dbf822 nid 20177@kfi7 refs 2
00000400:00000200:22.0:1773851862.766327:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000026dbf822 nid 20177@kfi7 refs 3
00000400:00000200:22.0:1773851862.766327:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20177@kfi7 local destination
00000400:00000200:22.0:1773851862.766329:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769043:8769043:1024:4294967295] 20177@kfi7 LPNI seq info [6936736:6936736:16:4294967295]
00000400:00000200:22.0:1773851862.766331:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000026dbf822 nid 20177@kfi7 refs 2
00000400:00000200:22.0:1773851862.766332:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20177@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.766334:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20177@kfi7(20177@kfi7:20177@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851862.766335:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000026dbf822 nid 20177@kfi7 refs 3
00000800:00000200:22.0:1773851862.766336:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851862.766337:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851862.766339:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851862.766341:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 Using peer 20177@kfi7(0x1189)
00000800:00000200:22.0:1773851862.766344:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 324 bytes to peer 0x1189: rc=0
00000800:00000200:22.0:1773851862.766345:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851862.766347:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851862.766348:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cf25380f refcount 2 to 19984@kfi7
00010000:00000001:22.0:1773851862.766348:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851862.766349:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.766349:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851862.766350:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000882769c4 x1859831330669568/t0(0) o400->c8895faf-4139-4cbe-83c7-44cf0f4537f5@19984@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1745-0'
00000100:00100000:22.0:1773851862.766353:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000882769c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c8895faf-4139-4cbe-83c7-44cf0f4537f5+5:39657:x1859831330669568:12345-19984@kfi7:400:default-tuolumne1745-0 Request processed in 55us (93us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851862.766355:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19984@kfi7, seq: 1997963
00000100:00000040:22.0:1773851862.766356:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d1005465 : new rpc_count 0
00000100:00000001:22.0:1773851862.766356:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851862.766357:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851862.766357:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:22.0:1773851862.766358:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000800:00000200:21.0:1773851862.766358:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 TN_EVENT_TX_OK event status 0
00000020:00000010:22.0:1773851862.766359:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e3f29f72.
00000400:00000200:21.0:1773851862.766359:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:22.0:1773851862.766360:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000d1005465 : new refcount 4
00000400:00000200:21.0:1773851862.766360:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20177@kfi7: PUT: OK
00000100:00000001:22.0:1773851862.766361:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851862.766361:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034621184
00000400:00000010:21.0:1773851862.766361:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034621184.
00000100:00000001:21.0:1773851862.766362:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851862.766362:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851862.766363:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000026dbf822 nid 20177@kfi7 refs 2
00000800:00000200:21.0:1773851862.766364:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 20177@kfi7(0000000085513fc7):0x0 lsk 4490 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1189 Transaction freed
00000800:00000200:5.0:1773851862.837775:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851862.837776:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851862.837778:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851862.837779:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851862.837781:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15649@kfi7 to cpt 1
00000400:00000200:5.0:1773851862.837782:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15649@kfi7 : PUT - for me
00000400:00000200:5.0:1773851862.837783:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15649@kfi7 to cpt 1
00000400:00000200:5.0:1773851862.837784:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 1
00000400:00000200:5.0:1773851862.837785:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15649@kfi7 to cpt 1
00000400:00000200:5.0:1773851862.837786:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 2
00000400:00000200:5.0:1773851862.837786:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 3
00000400:00000200:5.0:1773851862.837787:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15649@kfi7 to cpt 1
00000400:00000200:5.0:1773851862.837788:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15649@kfi7 of length 224 into portal 12 MB=0x69b4b5d185880
00000400:00000200:5.0:1773851862.837790:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15649@kfi7 of length 224/224 into md 0x793926dc5 [64] + 130296
00000800:00000200:5.0:1773851862.837792:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851862.837793:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851862.837794:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15649@kfi7: PUT: OK
00000100:00000001:5.0:1773851862.837795:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851862.837796:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851862.837797:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000053aa084a.
00000100:00000040:5.0:1773851862.837797:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000053aa084a x1859597846993024 msgsize 224
00000100:00100000:5.0:1773851862.837799:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-15649@kfi7 (source: 12345-15649@kfi7)
00000100:00000001:5.0:1773851862.837800:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851862.837800:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 2
00000100:00000001:7.0:1773851862.837801:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851862.837802:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851862.837802:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851862.837802:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851862.837802:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851862.837803:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851862.837805:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597846993024
00000020:00000001:7.0:1773851862.837805:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851862.837806:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82317
00000020:00000001:7.0:1773851862.837806:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851862.837808:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000039276183 refcount=5
00000020:00000001:7.0:1773851862.837809:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107603092480 : -106966106459136 : ffff9eb70338b400)
00000020:00000001:7.0:1773851862.837810:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107603092480 : -106966106459136 : ffff9eb70338b400)
00000100:00000001:7.0:1773851862.837810:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851862.837811:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851862.837812:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f72fd39.
00000020:00000010:7.0:1773851862.837813:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851862.837814:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851862.837815:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851862.837815:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851862.837816:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851862.837817:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851862.837817:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851862.837818:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.837819:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851862.837820:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851862.837820:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851862.837820:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851862.837820:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851862.837821:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15649@kfi7, seq: 2001895
00000100:00000040:7.0:1773851862.837822:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000039276183 : new rpc_count 1
00000100:00000001:5.0:1773851862.837822:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.837823:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984866939904 : -107088842611712 : ffff9e9a6f93a400)
00000100:00000001:5.0:1773851862.837823:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851862.837824:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000053aa084a x1859597846993024/t0(0) o400->8d231b3c-7cd1-49d7-a9f2-2d4919474f7a@15649@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1471-0'
00000100:00000001:7.0:1773851862.837827:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851862.837827:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851862.837828:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053aa084a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8d231b3c-7cd1-49d7-a9f2-2d4919474f7a+5:39683:x1859597846993024:12345-15649@kfi7:400:default-tuolumne1471-0
00000100:00000200:7.0:1773851862.837829:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597846993024
00000020:00000001:7.0:1773851862.837830:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851862.837830:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851862.837831:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.837832:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851862.837833:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851862.837834:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851862.837834:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597846993024, found 0 last_xid 1859597846993023
00000020:00000001:7.0:1773851862.837835:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851862.837835:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851862.837836:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851862.837836:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.837837:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851862.837838:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851862.837838:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851862.837839:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000340f234.
02000000:00000001:7.0:1773851862.837839:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.837840:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.837841:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851862.837841:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824841, transno 0, xid 1859597846993024
00010000:00000001:7.0:1773851862.837842:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851862.837843:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000053aa084a x1859597846993024/t0(0) o400->8d231b3c-7cd1-49d7-a9f2-2d4919474f7a@15649@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1471-0'
00010000:00000001:7.0:1773851862.837845:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851862.837845:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851862.837846:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=94 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851862.837847:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851862.837848:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003cba8924 refcount 3 to 15649@kfi7
00000100:00000001:7.0:1773851862.837848:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232982400 : -107130476569216 : ffff9e90bdffdd80)
02000000:00000001:7.0:1773851862.837849:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851862.837850:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.837850:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851862.837851:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15649@kfi7
00000400:00000010:7.0:1773851862.837851:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c46149c8.
00000100:00000200:7.0:1773851862.837852:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597846993024, offset 224
00000400:00000200:7.0:1773851862.837853:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15649@kfi7
00000400:00000200:7.0:1773851862.837854:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15649@kfi7 to cpt 1
00000400:00000200:7.0:1773851862.837855:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 1
00000400:00000200:7.0:1773851862.837856:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 2
00000400:00000200:7.0:1773851862.837857:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 3
00000400:00000200:7.0:1773851862.837858:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15649@kfi7 local destination
00000400:00000200:7.0:1773851862.837859:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769044:8769044:1024:4294967295] 15649@kfi7 LPNI seq info [847038:847038:16:4294967295]
00000400:00000200:7.0:1773851862.837861:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 2
00000400:00000200:7.0:1773851862.837861:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15649@kfi7 to cpt 1
00000400:00000200:7.0:1773851862.837863:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15649@kfi7(15649@kfi7:15649@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851862.837864:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 3
00000800:00000200:7.0:1773851862.837866:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851862.837867:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851862.837869:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851862.837871:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003f0 Using peer 15649@kfi7(0x1000000000003f0)
00000800:00000200:7.0:1773851862.837874:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x1000000000003f0: rc=0
00000800:00000200:7.0:1773851862.837876:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003f0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851862.837877:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851862.837878:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003cba8924 refcount 2 to 15649@kfi7
00010000:00000001:7.0:1773851862.837879:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851862.837880:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851862.837880:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851862.837881:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000053aa084a x1859597846993024/t0(0) o400->8d231b3c-7cd1-49d7-a9f2-2d4919474f7a@15649@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1471-0'
00000100:00100000:7.0:1773851862.837884:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053aa084a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8d231b3c-7cd1-49d7-a9f2-2d4919474f7a+5:39683:x1859597846993024:12345-15649@kfi7:400:default-tuolumne1471-0 Request processed in 56us (86us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851862.837887:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15649@kfi7, seq: 2001895
00000800:00000200:5.0:1773851862.837887:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003f0 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851862.837888:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000039276183 : new rpc_count 0
00000100:00000001:7.0:1773851862.837889:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851862.837889:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851862.837890:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851862.837890:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851862.837890:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15649@kfi7: PUT: OK
00000020:00000010:7.0:1773851862.837891:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000400:00000200:5.0:1773851862.837891:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c46149c8
00000400:00000010:5.0:1773851862.837891:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c46149c8.
00000020:00000010:7.0:1773851862.837892:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f72fd39.
00000020:00000040:7.0:1773851862.837892:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000039276183 : new refcount 4
00000100:00000001:5.0:1773851862.837892:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851862.837892:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851862.837893:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851862.837893:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bb4e62d2 nid 15649@kfi7 refs 2
00000800:00000200:5.0:1773851862.837895:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 15649@kfi7(000000008aa20f74):0x0 lsk 1009 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000003f0 Transaction freed
00000800:00000200:25.0:1773851862.838165:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.838166:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851862.838167:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851862.838170:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851862.838171:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24675@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.838173:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24675@kfi7 : PUT - for me
00000400:00000200:25.0:1773851862.838174:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24675@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.838175:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b34b6a9 nid 24675@kfi7 refs 1
00000400:00000200:25.0:1773851862.838176:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24675@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.838176:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b34b6a9 nid 24675@kfi7 refs 2
00000400:00000200:25.0:1773851862.838177:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b34b6a9 nid 24675@kfi7 refs 3
00000400:00000200:25.0:1773851862.838178:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24675@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.838179:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24675@kfi7 of length 224 into portal 12 MB=0x699e121c3f0c0
00000400:00000200:25.0:1773851862.838180:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24675@kfi7 of length 224/224 into md 0x16159c9699 [64] + 0
00000800:00000200:25.0:1773851862.838183:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851862.838185:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.838186:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24675@kfi7: PUT: OK
00000100:00000001:25.0:1773851862.838187:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851862.838187:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851862.838188:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b996e0dd.
00000100:00000040:25.0:1773851862.838189:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b996e0dd x1858042073444544 msgsize 224
00000100:00100000:25.0:1773851862.838190:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24675@kfi7 (source: 12345-24675@kfi7)
00000100:00000001:25.0:1773851862.838191:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851862.838192:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b34b6a9 nid 24675@kfi7 refs 2
00000800:00000200:25.0:1773851862.838194:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851862.838196:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851862.838197:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851862.838198:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851862.838198:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851862.838199:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851862.838200:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042073444544
00000020:00000001:25.0:1773851862.838200:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851862.838201:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d73
00000020:00000001:25.0:1773851862.838201:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851862.838204:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fc4afac5 refcount=6
00000020:00000001:25.0:1773851862.838204:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744167424 : -107128965384192 : ffff9e911812b800)
00000020:00000001:25.0:1773851862.838205:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744167424 : -107128965384192 : ffff9e911812b800)
00000100:00000001:25.0:1773851862.838206:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851862.838208:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851862.838208:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000212fefaf.
00000020:00000010:25.0:1773851862.838209:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851862.838210:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094918347.
00000100:00000001:25.0:1773851862.838211:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851862.838211:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851862.838212:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.838213:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851862.838214:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851862.838214:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.838215:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.838217:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851862.838217:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851862.838217:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.838217:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851862.838218:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24675@kfi7, seq: 2025081
00000100:00000040:25.0:1773851862.838219:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fc4afac5 : new rpc_count 1
00000100:00000001:24.0:1773851862.838219:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851862.838219:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.838220:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478771968 : -106938230779648 : ffff9ebd80bdd100)
00000100:00000040:25.0:1773851862.838220:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b996e0dd x1858042073444544/t0(0) o400->4a5cbe42-3580-47c3-b71c-87c489f298b5@24675@kfi7:79/0 lens 224/0 e 0 to 0 dl 1773852194 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2028-0'
00000100:00000001:25.0:1773851862.838223:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851862.838223:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851862.838224:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b996e0dd pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4a5cbe42-3580-47c3-b71c-87c489f298b5+6:39856:x1858042073444544:12345-24675@kfi7:400:default-tuolumne2028-0
00000100:00000200:25.0:1773851862.838226:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042073444544
00000020:00000001:25.0:1773851862.838226:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851862.838227:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851862.838227:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.838228:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851862.838229:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851862.838229:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851862.838230:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042073444544, found 0 last_xid 1858042073444543
00000020:00000001:25.0:1773851862.838231:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851862.838231:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851862.838232:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851862.838232:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.838233:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851862.838234:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851862.838234:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851862.838235:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000098cec3cc.
02000000:00000001:25.0:1773851862.838235:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.838236:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.838237:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851862.838237:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260468943, transno 0, xid 1858042073444544
00010000:00000001:25.0:1773851862.838239:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851862.838240:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b996e0dd x1858042073444544/t0(0) o400->4a5cbe42-3580-47c3-b71c-87c489f298b5@24675@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2028-0'
00010000:00000001:25.0:1773851862.838242:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851862.838243:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851862.838243:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=95 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851862.838244:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851862.838245:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001eb75c09 refcount 3 to 24675@kfi7
00000100:00000001:25.0:1773851862.838246:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740832 : -107139395810784 : ffff9e8eaa5f0a20)
02000000:00000001:25.0:1773851862.838247:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851862.838247:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.838248:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851862.838249:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24675@kfi7
00000400:00000010:25.0:1773851862.838249:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004324fea4.
00000100:00000200:25.0:1773851862.838250:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042073444544, offset 224
00000400:00000200:25.0:1773851862.838251:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24675@kfi7
00000400:00000200:25.0:1773851862.838252:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24675@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.838252:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b34b6a9 nid 24675@kfi7 refs 1
00000400:00000200:25.0:1773851862.838253:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b34b6a9 nid 24675@kfi7 refs 2
00000400:00000200:25.0:1773851862.838254:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b34b6a9 nid 24675@kfi7 refs 3
00000400:00000200:25.0:1773851862.838255:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24675@kfi7 local destination
00000400:00000200:25.0:1773851862.838257:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769045:8769045:1024:4294967295] 24675@kfi7 LPNI seq info [9039924:9039924:16:4294967295]
00000400:00000200:25.0:1773851862.838258:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b34b6a9 nid 24675@kfi7 refs 2
00000400:00000200:25.0:1773851862.838259:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24675@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.838261:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24675@kfi7(24675@kfi7:24675@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851862.838262:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b34b6a9 nid 24675@kfi7 refs 3
00000800:00000200:25.0:1773851862.838263:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.838264:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851862.838266:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851862.838270:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002f1 Using peer 24675@kfi7(0x1000000000002f1)
00000800:00000200:25.0:1773851862.838273:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 324 bytes to peer 0x1000000000002f1: rc=0
00000800:00000200:25.0:1773851862.838275:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002f1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851862.838277:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851862.838277:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001eb75c09 refcount 2 to 24675@kfi7
00010000:00000001:25.0:1773851862.838278:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851862.838279:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.838279:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851862.838280:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b996e0dd x1858042073444544/t0(0) o400->4a5cbe42-3580-47c3-b71c-87c489f298b5@24675@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2028-0'
00000100:00100000:25.0:1773851862.838283:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b996e0dd pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4a5cbe42-3580-47c3-b71c-87c489f298b5+6:39856:x1858042073444544:12345-24675@kfi7:400:default-tuolumne2028-0 Request processed in 59us (93us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851862.838286:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24675@kfi7, seq: 2025081
00000100:00000040:25.0:1773851862.838286:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fc4afac5 : new rpc_count 0
00000800:00000200:26.0:1773851862.838287:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002f1 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851862.838287:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851862.838288:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851862.838288:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000400:00000200:26.0:1773851862.838289:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851862.838289:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094918347.
00000400:00000200:26.0:1773851862.838290:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24675@kfi7: PUT: OK
00000020:00000010:25.0:1773851862.838290:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000212fefaf.
00000020:00000040:25.0:1773851862.838290:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000fc4afac5 : new refcount 5
00000400:00000200:26.0:1773851862.838291:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004324fea4
00000400:00000010:26.0:1773851862.838291:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004324fea4.
00000100:00000001:25.0:1773851862.838291:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851862.838292:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851862.838293:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851862.838293:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b34b6a9 nid 24675@kfi7 refs 2
00000800:00000200:26.0:1773851862.838295:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 24675@kfi7(000000005e7c1f97):0x0 lsk 754 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000002f1 Transaction freed
00000004:00000001:31.0:1773851862.857730:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851862.857730:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851862.857730:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851862.857731:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851862.857731:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:10.0:1773851862.857731:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:9.0:1773851862.857731:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851862.857731:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851862.857731:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851862.857732:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000912e612e.
00000004:00000020:10.0:1773851862.857732:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:9.0:1773851862.857732:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:7.0:1773851862.857732:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851862.857732:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:6.0:1773851862.857732:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:5.0:1773851862.857732:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000298dd7d3.
00000100:00000010:31.0:1773851862.857733:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000055bd4bee.
00000020:00000040:30.0:1773851862.857733:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000010:10.0:1773851862.857733:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000024de9a79.
00000020:00000040:10.0:1773851862.857733:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000100:00000010:9.0:1773851862.857733:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003b9a437e.
00000100:00000010:7.0:1773851862.857733:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000026196639.
00000100:00000010:6.0:1773851862.857733:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000044ace912.
00000020:00000040:5.0:1773851862.857733:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
00000020:00000040:31.0:1773851862.857734:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000100:00000001:30.0:1773851862.857734:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851862.857734:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:9.0:1773851862.857734:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000020:00000040:6.0:1773851862.857734:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
02000000:00000001:30.0:1773851862.857735:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851862.857735:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851862.857735:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:9.0:1773851862.857735:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:7.0:1773851862.857735:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000001:6.0:1773851862.857735:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851862.857735:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:31.0:1773851862.857736:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:30.0:1773851862.857736:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006dbfd28d.
02000000:00000001:10.0:1773851862.857736:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.857736:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:7.0:1773851862.857736:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851862.857736:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851862.857736:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851862.857736:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:31.0:1773851862.857737:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851862.857737:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851862.857737:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000469124a5.
02000000:00000001:7.0:1773851862.857737:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851862.857737:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851862.857737:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851862.857738:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857738:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851862.857738:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.857738:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857739:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851862.857739:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851862.857739:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851862.857739:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000010:7.0:1773851862.857739:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ed33a1f5.
02000000:00000010:6.0:1773851862.857739:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000078f43d8e.
00000100:00000001:6.0:1773851862.857739:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851862.857739:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ef164abb.
02000000:00000010:31.0:1773851862.857740:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001bb8430c.
00000100:00000040:30.0:1773851862.857740:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000912e612e] to pc [ptlrpcd_07_03+3]  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851862.857740:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857740:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851862.857740:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851862.857740:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851862.857740:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:31.0:1773851862.857741:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851862.857741:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000024de9a79] to pc [ptlrpcd_02_01+1]  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851862.857741:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857741:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857741:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851862.857741:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851862.857742:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851862.857742:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851862.857742:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851862.857742:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000026196639] to pc [ptlrpcd_01_01+1]  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851862.857742:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000044ace912] to pc [ptlrpcd_01_00+0]  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851862.857742:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000298dd7d3] to pc [ptlrpcd_01_02+2]  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851862.857743:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851862.857744:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000055bd4bee] to pc [ptlrpcd_07_00+0]  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851862.857744:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003b9a437e] to pc [ptlrpcd_02_02+2]  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:30.0:1773851862.857745:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851862.857745:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:28.0:1773851862.857746:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851862.857746:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851862.857746:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:10.0:1773851862.857746:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000fb8666f8.
00000100:00000001:8.0:1773851862.857746:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851862.857747:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851862.857747:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851862.857747:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851862.857747:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851862.857747:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637086953436160 : -106986756115456 : ffff9eb23467f400)
00080000:00000001:10.0:1773851862.857747:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:8.0:1773851862.857747:0:41068:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00000001:8.0:1773851862.857747:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851862.857747:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851862.857747:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.857748:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.857748:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:5.0:1773851862.857748:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:11.0:1773851862.857749:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851862.857749:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:10.0:1773851862.857749:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851862.857749:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00000100:00000001:8.0:1773851862.857749:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851862.857749:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:5.0:1773851862.857749:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000031de34ed.
00000100:00000001:4.0:1773851862.857749:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851862.857750:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851862.857750:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:9.0:1773851862.857750:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851862.857750:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851862.857750:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851862.857750:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637102014057472 : -106971695494144 : ffff9eb5b616cc00)
00000100:00000001:4.0:1773851862.857750:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851862.857751:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851862.857751:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:10.0:1773851862.857751:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ea1b325f.
00080000:00000010:9.0:1773851862.857751:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d9f9a1c1.
00080000:00000001:9.0:1773851862.857751:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637114717390848 : -106958992160768 : ffff9eb8ab444800)
00000100:00000040:8.0:1773851862.857751:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851862.857751:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851862.857751:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:28.0:1773851862.857752:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:10.0:1773851862.857752:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614137311027163ns, next at 614138311026070ns, rc = 0
00080000:00000001:9.0:1773851862.857752:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851862.857752:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851862.857752:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851862.857752:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851862.857752:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851862.857752:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:31.0:1773851862.857753:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851862.857753:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851862.857753:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:28.0:1773851862.857753:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851862.857753:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:7.0:1773851862.857753:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851862.857753:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851862.857753:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000100:00000040:4.0:1773851862.857753:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:31.0:1773851862.857754:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000594e0e9d.
00080000:00000001:31.0:1773851862.857754:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637089268229120 : -106984441322496 : ffff9eb2be60e400)
00000100:00000001:30.0:1773851862.857754:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851862.857754:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851862.857754:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851862.857754:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000912e612e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051926208:13@kfi7:41:default-yuba2-0
00000100:00000001:11.0:1773851862.857754:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851862.857754:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851862.857754:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851862.857754:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851862.857754:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.857754:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851862.857754:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:5.0:1773851862.857754:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d25043e1.
00000100:00000040:30.0:1773851862.857755:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851862.857755:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851862.857755:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851862.857755:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:9.0:1773851862.857755:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
02000000:00000001:8.0:1773851862.857755:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:5.0:1773851862.857755:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614137311030258ns, next at 614138311029006ns, rc = 0
00080000:00000001:31.0:1773851862.857756:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:28.0:1773851862.857756:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851862.857756:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:9.0:1773851862.857756:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000429993f6.
02000000:00000001:8.0:1773851862.857756:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857756:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851862.857756:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857756:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851862.857756:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851862.857756:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:31.0:1773851862.857757:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857757:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:28.0:1773851862.857757:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:11.0:1773851862.857757:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003b9a437e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051926528:2060@kfi7:13:default-yuba2-0
00000004:00080000:9.0:1773851862.857757:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614137311032623ns, next at 614138311031030ns, rc = 0
00000100:00100000:8.0:1773851862.857757:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024de9a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051926272:37@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851862.857757:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:6.0:1773851862.857757:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851862.857757:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851862.857757:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:31.0:1773851862.857758:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:30.0:1773851862.857758:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851862.857758:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000db9da5d9.
00000100:00000001:11.0:1773851862.857758:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:9.0:1773851862.857758:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:8.0:1773851862.857758:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851862.857758:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851862.857758:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851862.857758:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:31.0:1773851862.857759:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009e1af12d.
00000004:00080000:31.0:1773851862.857759:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614137311035057ns, next at 614138311033665ns, rc = 0
02000000:00000001:30.0:1773851862.857759:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:30.0:1773851862.857759:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851862.857759:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851862.857759:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:10.0:1773851862.857759:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851862.857759:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851862.857759:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.857759:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851862.857759:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851862.857759:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000044ace912 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051926336:36@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851862.857759:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851862.857760:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055bd4bee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051926592:60@kfi7:13:default-yuba2-0
00000400:00000200:28.0:1773851862.857760:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:28.0:1773851862.857760:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
02000000:00000001:11.0:1773851862.857760:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851862.857760:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000001:9.0:1773851862.857760:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.857760:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:7.0:1773851862.857760:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851862.857760:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:31.0:1773851862.857761:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000010:28.0:1773851862.857761:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024587145.
02000000:00000010:8.0:1773851862.857761:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003e1bc6ec.
02000000:00000001:7.0:1773851862.857761:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851862.857761:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857761:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851862.857761:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851862.857761:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851862.857762:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857762:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851862.857762:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851862.857762:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851862.857762:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000083609603.
02000000:00000001:11.0:1773851862.857762:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.857762:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851862.857762:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851862.857762:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851862.857762:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000298dd7d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051926400:2061@kfi7:13:default-yuba2-0
00000004:00000001:31.0:1773851862.857763:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851862.857763:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:28.0:1773851862.857763:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926208, portal 4
00000100:00000001:28.0:1773851862.857763:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:8.0:1773851862.857763:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
02000000:00000001:7.0:1773851862.857763:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:30.0:1773851862.857764:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000edd2b3c3.
00000100:00000001:28.0:1773851862.857764:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832826880 : -106933876724736 : ffff9ebe84436c00)
00000400:00000200:11.0:1773851862.857764:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000010:11.0:1773851862.857764:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000400:00000010:8.0:1773851862.857764:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000400:00000010:8.0:1773851862.857764:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
02000000:00000010:7.0:1773851862.857764:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002b002509.
00000100:00100000:6.0:1773851862.857764:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000026196639 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051926464:2074@kfi7:41:default-yuba2-0
00000100:00000001:4.0:1773851862.857764:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851862.857765:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851862.857765:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:11.0:1773851862.857765:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
02000000:00000001:7.0:1773851862.857765:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857765:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851862.857765:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851862.857765:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:30.0:1773851862.857766:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000200:11.0:1773851862.857766:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926528, portal 4
00000100:00000200:8.0:1773851862.857766:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926272, portal 4
00000100:00000001:8.0:1773851862.857766:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:7.0:1773851862.857766:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
02000000:00000001:6.0:1773851862.857766:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851862.857766:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:4.0:1773851862.857766:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851862.857767:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000001:11.0:1773851862.857767:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851862.857767:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636931922894720 : -107141786656896 : ffff9e8e1bdd9f80)
00000100:00000001:8.0:1773851862.857767:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637043610174336 : -107030099377280 : ffff9ea81cf24380)
00000400:00000010:7.0:1773851862.857767:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
02000000:00000010:6.0:1773851862.857767:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f4faae6e.
02000000:00000001:4.0:1773851862.857767:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:30.0:1773851862.857768:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00000001:28.0:1773851862.857768:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851862.857768:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:7.0:1773851862.857768:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
02000000:00000001:6.0:1773851862.857768:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851862.857768:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004e2bbea7.
00000100:00000200:30.0:1773851862.857769:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926592, portal 4
00000400:00000010:28.0:1773851862.857769:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5e5a670.
00000100:00000040:11.0:1773851862.857769:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851862.857769:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851862.857769:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926336, portal 4
00000400:00000200:6.0:1773851862.857769:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
02000000:00000001:4.0:1773851862.857769:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857770:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:28.0:1773851862.857770:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051926208, offset 0
00000100:00000001:7.0:1773851862.857770:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851862.857770:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637012926971648 : -107060782579968 : ffff9ea0f815bf00)
00000400:00000010:6.0:1773851862.857770:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:30.0:1773851862.857771:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999065856 : -107038710485760 : ffff9ea61baf2d00)
00000400:00000200:28.0:1773851862.857771:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000100:00000001:8.0:1773851862.857771:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:6.0:1773851862.857771:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5d4425b.
00000400:00000200:4.0:1773851862.857771:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000010:4.0:1773851862.857771:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000100:00000040:30.0:1773851862.857772:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851862.857772:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851862.857772:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000100:00000040:7.0:1773851862.857772:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851862.857773:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000040:11.0:1773851862.857773:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:11.0:1773851862.857773:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008f5867f4.
00000400:00000010:8.0:1773851862.857773:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e5dfdd1.
00000100:00000200:8.0:1773851862.857773:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926272, offset 0
00000100:00000200:6.0:1773851862.857773:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926464, portal 4
00000400:00000200:28.0:1773851862.857774:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000200:11.0:1773851862.857774:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926528, offset 0
00000100:00000001:6.0:1773851862.857774:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:4.0:1773851862.857774:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000001:30.0:1773851862.857775:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:28.0:1773851862.857775:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:8.0:1773851862.857775:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000100:00000001:7.0:1773851862.857775:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851862.857775:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309132800 : -106994400418816 : ffff9eb06cc52400)
00000100:00000200:4.0:1773851862.857775:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926400, portal 4
00000100:00000040:30.0:1773851862.857776:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000400:00000200:11.0:1773851862.857776:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000200:8.0:1773851862.857776:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000040:7.0:1773851862.857776:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000100:00000040:6.0:1773851862.857776:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851862.857776:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:30.0:1773851862.857777:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ea7638e8.
00000400:00000200:28.0:1773851862.857777:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:8.0:1773851862.857777:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000010:7.0:1773851862.857777:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c74d75.
00000100:00000001:4.0:1773851862.857777:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136106907520 : -106937602644096 : ffff9ebda62e6780)
00000100:00000200:30.0:1773851862.857778:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926592, offset 0
00000400:00000200:28.0:1773851862.857778:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:8.0:1773851862.857778:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000200:7.0:1773851862.857778:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926336, offset 0
00000400:00000200:28.0:1773851862.857779:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769043, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769045, p:4294967295, g:4294967295, h:1000]
00000100:00000001:6.0:1773851862.857779:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851862.857779:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851862.857780:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:8.0:1773851862.857780:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:7.0:1773851862.857780:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:7.0:1773851862.857780:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000040:6.0:1773851862.857780:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000200:8.0:1773851862.857781:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000400:00000200:7.0:1773851862.857781:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000010:6.0:1773851862.857781:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003599bb60.
00000100:00000200:6.0:1773851862.857781:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051926464, offset 0
00000400:00000200:28.0:1773851862.857782:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851862.857782:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:28.0:1773851862.857783:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851862.857783:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769043, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769045, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851862.857783:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000100:00000001:4.0:1773851862.857783:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:28.0:1773851862.857784:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851862.857784:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000040:4.0:1773851862.857784:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000200:28.0:1773851862.857785:0:41091:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133313, 23133312]
00000400:00000200:8.0:1773851862.857785:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000010:4.0:1773851862.857785:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098ca3a41.
00000400:00000200:8.0:1773851862.857786:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851862.857786:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000200:7.0:1773851862.857786:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000100:00000200:4.0:1773851862.857786:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926400, offset 0
00000400:00000200:28.0:1773851862.857787:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000400:00000200:8.0:1773851862.857788:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769046:8769046:1024:4294967295] 37@kfi7 LPNI seq info [5403392:5403392:16:4294967295]
00000400:00000200:7.0:1773851862.857788:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769043, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769045, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851862.857788:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:28.0:1773851862.857789:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769047:8769047:1024:4294967295] 13@kfi7 LPNI seq info [23133314:23133314:16:4294967295]
00000400:00000200:8.0:1773851862.857789:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:28.0:1773851862.857790:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:8.0:1773851862.857790:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851862.857790:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851862.857791:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:7.0:1773851862.857791:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851862.857792:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:7.0:1773851862.857792:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000400:00000200:30.0:1773851862.857793:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:30.0:1773851862.857795:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:11.0:1773851862.857795:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:7.0:1773851862.857795:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769048:8769048:1024:4294967295] 36@kfi7 LPNI seq info [5403965:5403965:16:4294967295]
00000400:00000200:30.0:1773851862.857796:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851862.857796:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:7.0:1773851862.857796:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:30.0:1773851862.857797:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:28.0:1773851862.857797:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851862.857797:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:7.0:1773851862.857797:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:28.0:1773851862.857798:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:30.0:1773851862.857799:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:11.0:1773851862.857799:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000200:6.0:1773851862.857799:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:28.0:1773851862.857800:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:6.0:1773851862.857800:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:30.0:1773851862.857801:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769047, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769048, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851862.857801:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769047, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769048, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851862.857801:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851862.857801:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:28.0:1773851862.857802:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851862.857802:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:30.0:1773851862.857803:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851862.857803:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:28.0:1773851862.857804:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851862.857804:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:7.0:1773851862.857804:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:6.0:1773851862.857804:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000400:00000200:30.0:1773851862.857805:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851862.857805:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851862.857805:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769047, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769048, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851862.857806:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:11.0:1773851862.857806:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000800:00000200:7.0:1773851862.857806:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851862.857807:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769049:8769049:1023:4294967295] 60@kfi7 LPNI seq info [5404307:5404307:16:4294967295]
00000800:00000200:28.0:1773851862.857807:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Using peer 13@kfi7(0x102)
00000400:00000200:6.0:1773851862.857807:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:11.0:1773851862.857808:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769050:8769050:1023:4294967295] 2060@kfi7 LPNI seq info [5404992:5404992:16:4294967295]
00000400:00000200:6.0:1773851862.857808:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851862.857809:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:30.0:1773851862.857809:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:28.0:1773851862.857809:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x102: rc=0
00000400:00000200:11.0:1773851862.857809:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:7.0:1773851862.857809:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851862.857809:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851862.857810:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:6.0:1773851862.857810:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425164, 23425163]
00000800:00000200:28.0:1773851862.857811:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851862.857812:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000400:00000200:6.0:1773851862.857812:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000400:00000200:30.0:1773851862.857813:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000100:00000001:28.0:1773851862.857813:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851862.857813:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851862.857814:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000001:28.0:1773851862.857814:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851862.857814:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851862.857814:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851862.857814:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769051:8769051:1023:4294967295] 2081@kfi7 LPNI seq info [23425165:23425165:16:4294967295]
00000100:00000001:28.0:1773851862.857815:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851862.857815:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:8.0:1773851862.857815:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000800:00000200:7.0:1773851862.857815:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000400:00000200:6.0:1773851862.857815:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000800:00000200:30.0:1773851862.857816:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:28.0:1773851862.857816:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:8.0:1773851862.857816:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:7.0:1773851862.857816:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851862.857817:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851862.857817:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:6.0:1773851862.857817:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000800:00000200:11.0:1773851862.857818:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851862.857818:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:7.0:1773851862.857818:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851862.857818:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:30.0:1773851862.857819:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:28.0:1773851862.857819:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851862.857819:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851862.857819:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851862.857819:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000100:00000001:28.0:1773851862.857820:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851862.857820:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:8.0:1773851862.857820:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:7.0:1773851862.857820:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857820:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851862.857820:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000800:00000200:30.0:1773851862.857821:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Using peer 60@kfi7(0x1e2)
00000800:00000200:11.0:1773851862.857821:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:7.0:1773851862.857821:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851862.857821:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:4.0:1773851862.857821:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:7.0:1773851862.857822:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851862.857823:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:6.0:1773851862.857823:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:11.0:1773851862.857824:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Using peer 2060@kfi7(0x1c0)
00000800:00000200:8.0:1773851862.857824:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000100:00000001:7.0:1773851862.857824:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851862.857824:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851862.857824:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851862.857824:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851862.857825:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x1e2: rc=0
00000800:00000200:29.0:1773851862.857825:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851862.857825:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857825:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851862.857825:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000800:00000200:30.0:1773851862.857826:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851862.857826:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851862.857827:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:11.0:1773851862.857827:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x1c0: rc=0
00000800:00000200:6.0:1773851862.857827:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851862.857827:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000100:00000001:30.0:1773851862.857828:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857828:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851862.857828:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000800:00000200:8.0:1773851862.857828:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x1a3: rc=0
00000100:00000001:30.0:1773851862.857829:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851862.857829:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5e5a670
00000400:00000010:29.0:1773851862.857829:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5e5a670.
00000800:00000200:11.0:1773851862.857829:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:8.0:1773851862.857829:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851862.857829:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1020, d:10, s:8769050, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769051, p:4294967295, g:4294967295, h:1000]
00000100:00000001:30.0:1773851862.857830:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857830:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851862.857830:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:6.0:1773851862.857830:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 Using peer 2081@kfi7(0x200000000000275)
00000100:00000001:30.0:1773851862.857831:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000200:29.0:1773851862.857831:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.857831:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857832:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851862.857832:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851862.857832:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851862.857832:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857833:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851862.857833:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851862.857833:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000618b435b: Posted send of 324 bytes to peer 0x200000000000275: rc=0
00000400:00000200:4.0:1773851862.857833:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:30.0:1773851862.857834:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851862.857834:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851862.857834:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851862.857834:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:29.0:1773851862.857835:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.857835:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851862.857835:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851862.857835:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000100:00000001:11.0:1773851862.857836:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851862.857837:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851862.857837:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851862.857837:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851862.857837:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857837:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851862.857837:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769052:8769052:1022:4294967295] 2061@kfi7 LPNI seq info [5403459:5403459:16:4294967295]
00000400:00000200:30.0:1773851862.857838:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851862.857838:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:11.0:1773851862.857838:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857838:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851862.857839:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000400:00000200:29.0:1773851862.857839:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:11.0:1773851862.857839:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857839:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851862.857839:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:30.0:1773851862.857840:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ea7638e8
00000400:00000010:30.0:1773851862.857840:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ea7638e8.
00000100:00000001:30.0:1773851862.857840:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:11.0:1773851862.857840:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851862.857840:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:30.0:1773851862.857841:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851862.857841:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Transaction freed
00000100:00000001:11.0:1773851862.857841:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851862.857841:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:10.0:1773851862.857841:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851862.857841:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851862.857841:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:4.0:1773851862.857841:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:11.0:1773851862.857842:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851862.857842:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:11.0:1773851862.857843:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851862.857843:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851862.857843:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851862.857843:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851862.857843:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851862.857843:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851862.857843:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857844:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851862.857844:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851862.857844:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:9.0:1773851862.857844:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000100:00000001:6.0:1773851862.857844:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851862.857845:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851862.857845:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e5dfdd1
00000400:00000200:4.0:1773851862.857845:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000400:00000010:10.0:1773851862.857846:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e5dfdd1.
00000100:00000001:10.0:1773851862.857846:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:9.0:1773851862.857846:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008f5867f4
00000100:00000001:30.0:1773851862.857847:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851862.857847:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851862.857847:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008f5867f4.
00000100:00000001:9.0:1773851862.857847:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:4.0:1773851862.857847:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:30.0:1773851862.857848:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:9.0:1773851862.857848:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851862.857849:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:30.0:1773851862.857850:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Transaction freed
00000100:00000001:10.0:1773851862.857850:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851862.857851:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851862.857851:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851862.857851:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851862.857853:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.857853:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851862.857854:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851862.857854:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851862.857855:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:9.0:1773851862.857855:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:6.0:1773851862.857855:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851862.857855:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000800:00000200:21.0:1773851862.857856:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.857857:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851862.857857:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000800:00000200:9.0:1773851862.857857:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Transaction freed
00000400:00000200:6.0:1773851862.857857:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851862.857857:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851862.857857:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.857858:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851862.857858:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000400:00000200:5.0:1773851862.857858:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:5.0:1773851862.857859:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c74d75
00000800:00000200:4.0:1773851862.857859:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:21.0:1773851862.857860:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851862.857860:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003599bb60
00000400:00000010:5.0:1773851862.857860:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c74d75.
00000100:00000001:5.0:1773851862.857860:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000010:6.0:1773851862.857861:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003599bb60.
00000100:00000001:6.0:1773851862.857861:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851862.857861:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851862.857862:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000200:6.0:1773851862.857862:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851862.857863:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000800:00000200:4.0:1773851862.857863:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:21.0:1773851862.857864:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:5.0:1773851862.857864:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:21.0:1773851862.857865:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000001:6.0:1773851862.857865:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851862.857865:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851862.857865:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851862.857866:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:17.0:1773851862.857866:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:21.0:1773851862.857867:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:17.0:1773851862.857867:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:5.0:1773851862.857867:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851862.857867:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Using peer 2061@kfi7(0x20000000000019b)
00000400:00000200:21.0:1773851862.857868:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:17.0:1773851862.857868:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851862.857868:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857868:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851862.857868:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851862.857870:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:5.0:1773851862.857870:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:22.0:1773851862.857871:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851862.857871:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851862.857871:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:17.0:1773851862.857871:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:22.0:1773851862.857872:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851862.857872:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2ec0
00000800:00000200:6.0:1773851862.857872:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 Transaction freed
00000800:00000200:5.0:1773851862.857872:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:4.0:1773851862.857872:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x20000000000019b: rc=0
00000400:00000200:17.0:1773851862.857873:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:21.0:1773851862.857874:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:22.0:1773851862.857875:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851862.857875:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d0a75 [1] + 224
00000400:00000200:17.0:1773851862.857875:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000800:00000200:4.0:1773851862.857875:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:17.0:1773851862.857876:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:22.0:1773851862.857877:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:17.0:1773851862.857877:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000800:00000200:29.0:1773851862.857878:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851862.857878:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:22.0:1773851862.857878:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 60@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.857878:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:22.0:1773851862.857879:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:21.0:1773851862.857879:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851862.857879:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:29.0:1773851862.857880:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851862.857880:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000800:00000200:18.0:1773851862.857880:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851862.857880:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851862.857880:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:4.0:1773851862.857880:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851862.857881:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:4.0:1773851862.857881:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851862.857882:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851862.857882:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:18.0:1773851862.857882:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851862.857882:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2f40
00000100:00000001:4.0:1773851862.857882:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851862.857883:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:22.0:1773851862.857883:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:21.0:1773851862.857883:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851862.857883:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851862.857884:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000200:17.0:1773851862.857884:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:4.0:1773851862.857884:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851862.857885:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851862.857885:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:21.0:1773851862.857885:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:18.0:1773851862.857885:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:4.0:1773851862.857885:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:29.0:1773851862.857886:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000400:00000200:22.0:1773851862.857886:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3040
00000400:00000200:17.0:1773851862.857886:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f0cf1 [1] + 224
00000100:00000001:4.0:1773851862.857886:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:22.0:1773851862.857887:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000200:21.0:1773851862.857887:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851862.857887:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:4.0:1773851862.857887:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851862.857888:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:17.0:1773851862.857888:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:4.0:1773851862.857888:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851862.857889:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:22.0:1773851862.857889:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d0a95 [1] + 224
00000400:00000200:18.0:1773851862.857889:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2060@kfi7 : PUT - for me
00000400:00000200:29.0:1773851862.857890:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000040:21.0:1773851862.857890:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851862.857890:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:29.0:1773851862.857891:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000800:00000200:22.0:1773851862.857891:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851862.857891:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:29.0:1773851862.857892:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:18.0:1773851862.857892:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.857892:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.857893:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851862.857893:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851862.857893:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:17.0:1773851862.857893:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000100:00000001:21.0:1773851862.857894:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:18.0:1773851862.857894:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000100:00000001:17.0:1773851862.857894:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:4.0:1773851862.857894:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851862.857895:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2f00
00000400:00000200:22.0:1773851862.857895:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000400:00000200:21.0:1773851862.857895:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:18.0:1773851862.857895:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:5.0:1773851862.857895:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851862.857895:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851862.857896:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:28.0:1773851862.857896:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:23.0:1773851862.857896:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000001:22.0:1773851862.857896:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851862.857896:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:17.0:1773851862.857896:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851862.857896:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851862.857897:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x7800803fd [1] + 224
00000100:00000001:28.0:1773851862.857897:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:23.0:1773851862.857897:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:22.0:1773851862.857897:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851862.857897:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3000
00000400:00000001:28.0:1773851862.857898:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851862.857898:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:18.0:1773851862.857898:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:5.0:1773851862.857898:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000400:00000200:5.0:1773851862.857898:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098ca3a41
00000800:00000200:29.0:1773851862.857899:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:28.0:1773851862.857899:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000800:00000200:23.0:1773851862.857899:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:17.0:1773851862.857899:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:5.0:1773851862.857899:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098ca3a41.
00000400:00000200:28.0:1773851862.857900:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024587145
00000100:00000040:22.0:1773851862.857900:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851862.857900:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f0cd1 [1] + 224
00000100:00000001:5.0:1773851862.857900:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851862.857901:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:28.0:1773851862.857901:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024587145.
00000800:00000200:23.0:1773851862.857901:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:5.0:1773851862.857901:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851862.857902:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000100:00000001:28.0:1773851862.857902:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:28.0:1773851862.857902:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:18.0:1773851862.857902:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851862.857903:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:17.0:1773851862.857903:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851862.857903:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851862.857904:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:22.0:1773851862.857904:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851862.857904:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000040:5.0:1773851862.857904:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851862.857905:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851862.857905:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:22.0:1773851862.857905:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:18.0:1773851862.857905:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851862.857905:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:28.0:1773851862.857906:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851862.857906:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000800:00000200:17.0:1773851862.857906:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851862.857906:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851862.857907:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851862.857907:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:23.0:1773851862.857907:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.857907:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000800:00000200:22.0:1773851862.857907:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:7.0:1773851862.857907:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851862.857907:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:5.0:1773851862.857907:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851862.857907:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000001:30.0:1773851862.857908:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:29.0:1773851862.857908:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851862.857908:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:7.0:1773851862.857908:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000400:00000001:30.0:1773851862.857909:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851862.857909:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851862.857909:0:41091:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:23.0:1773851862.857909:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:23.0:1773851862.857909:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:7.0:1773851862.857909:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000400:00000010:7.0:1773851862.857909:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000400:00000200:5.0:1773851862.857909:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000010:30.0:1773851862.857910:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851862.857910:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
02000000:00000001:28.0:1773851862.857910:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851862.857910:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:23.0:1773851862.857910:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000100:00000001:18.0:1773851862.857910:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851862.857910:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:30.0:1773851862.857911:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:29.0:1773851862.857911:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851862.857911:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:23.0:1773851862.857911:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:5.0:1773851862.857911:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Transaction freed
00000100:00000001:30.0:1773851862.857912:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851862.857912:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
02000000:00000001:28.0:1773851862.857912:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:18.0:1773851862.857912:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851862.857912:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851862.857913:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:28.0:1773851862.857913:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=95 v=66 (66 66 66 66)
00000400:00000200:23.0:1773851862.857913:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2fc0
00000100:00000001:8.0:1773851862.857913:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851862.857914:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00001000:28.0:1773851862.857914:0:41091:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=95 v=66 (1 1 1 1)
00000400:00000200:23.0:1773851862.857914:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:8.0:1773851862.857914:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851862.857915:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851862.857915:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:8.0:1773851862.857915:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851862.857915:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:7.0:1773851862.857915:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851862.857916:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:28.0:1773851862.857916:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:28.0:1773851862.857916:0:41091:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851862.857916:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:8.0:1773851862.857916:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000100:00000001:28.0:1773851862.857917:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:8.0:1773851862.857917:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000010:8.0:1773851862.857917:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000100:00000001:7.0:1773851862.857917:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851862.857918:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:28.0:1773851862.857918:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000100:00000001:28.0:1773851862.857918:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851862.857918:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851862.857918:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851862.857919:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851862.857919:0:41088:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:28.0:1773851862.857919:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:23.0:1773851862.857919:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78008043d [1] + 224
00000100:00000001:18.0:1773851862.857919:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:8.0:1773851862.857919:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851862.857919:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851862.857919:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:30.0:1773851862.857920:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:28.0:1773851862.857920:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:18.0:1773851862.857920:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:7.0:1773851862.857920:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851862.857921:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851862.857921:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851862.857921:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851862.857921:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851862.857922:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:23.0:1773851862.857922:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851862.857922:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851862.857922:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:8.0:1773851862.857922:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851862.857922:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851862.857923:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=95 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851862.857923:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:23.0:1773851862.857923:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:11.0:1773851862.857923:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851862.857923:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:7.0:1773851862.857923:0:41064:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=95 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851862.857924:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851862.857924:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:11.0:1773851862.857924:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000100:00001000:30.0:1773851862.857925:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=95 v=66 (1 1 1 1)
00000004:00000001:28.0:1773851862.857925:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:23.0:1773851862.857925:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000400:00000200:11.0:1773851862.857925:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000400:00000010:11.0:1773851862.857925:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000100:00000001:8.0:1773851862.857925:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851862.857925:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:7.0:1773851862.857925:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=95 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851862.857926:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000020:28.0:1773851862.857926:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097376 blocks, 31192444384 free, 31192385696 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238815 files, 2962368375 free files
00000100:00000001:23.0:1773851862.857926:0:2495434:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851862.857926:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851862.857926:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851862.857926:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851862.857926:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851862.857926:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857927:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851862.857927:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:23.0:1773851862.857927:0:2495434:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:11.0:1773851862.857927:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.857927:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851862.857927:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851862.857927:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851862.857928:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851862.857928:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851862.857928:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851862.857928:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857929:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851862.857929:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:8.0:1773851862.857929:0:41068:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=95 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851862.857929:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851862.857930:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000100:00000001:30.0:1773851862.857930:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000200:11.0:1773851862.857930:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851862.857930:0:41068:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=95 v=66 (1 1 1 1)
00000100:00000040:7.0:1773851862.857930:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:30.0:1773851862.857931:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851862.857931:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000912e612e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051926208:13@kfi7:41:default-yuba2-0
00000100:00000040:23.0:1773851862.857931:0:2495434:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.857931:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851862.857931:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851862.857931:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851862.857932:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851862.857932:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851862.857932:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851862.857933:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851862.857933:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851862.857933:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851862.857933:0:41070:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:8.0:1773851862.857933:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851862.857933:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851862.857934:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851862.857934:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:11.0:1773851862.857934:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:11.0:1773851862.857934:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851862.857934:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851862.857935:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851862.857935:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:28.0:1773851862.857935:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000912e612e x1859433051926208/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:23.0:1773851862.857935:0:2495434:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851862.857935:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851862.857935:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851862.857935:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000001:8.0:1773851862.857935:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851862.857935:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:30.0:1773851862.857936:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:23.0:1773851862.857936:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:8.0:1773851862.857936:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857936:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000040:30.0:1773851862.857937:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851862.857937:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351236608 avail=351348468736 avail_mb=1372454956 hwm_mb=3131103 files=372084109 ffree=343116442 state=0: rc = 0
00000800:00000200:23.0:1773851862.857937:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00001000:11.0:1773851862.857937:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=95 v=66 (66 66 66 66)
00000100:00000040:8.0:1773851862.857937:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851862.857937:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851862.857937:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851862.857937:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:11.0:1773851862.857938:0:41070:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=95 v=66 (1 1 1 1)
00000004:00000001:7.0:1773851862.857938:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851862.857938:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000400:00000001:6.0:1773851862.857938:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000004:00000020:30.0:1773851862.857939:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351236608 free, 351348468736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372084109 files, 343116442 free files
00000100:00000001:28.0:1773851862.857939:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851862.857939:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851862.857939:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851862.857939:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851862.857939:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851862.857939:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:7.0:1773851862.857939:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500123136 avail=351498040320 avail_mb=1373039220 hwm_mb=3131103 files=372097760 ffree=343261839 state=0: rc = 0
00000400:00000001:6.0:1773851862.857939:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000010:28.0:1773851862.857940:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000db9da5d9.
00010000:00000001:11.0:1773851862.857940:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.857940:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851862.857940:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851862.857940:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851862.857940:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5d4425b
00000004:00000001:30.0:1773851862.857941:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851862.857941:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:11.0:1773851862.857941:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851862.857941:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000004:00000001:8.0:1773851862.857941:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:7.0:1773851862.857941:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500123136 free, 351498040320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097760 files, 343261839 free files
00000400:00000010:6.0:1773851862.857941:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5d4425b.
00000100:00000040:30.0:1773851862.857942:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:28.0:1773851862.857942:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:11.0:1773851862.857942:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851862.857942:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:8.0:1773851862.857942:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851862.857942:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690114048 avail=351687681024 avail_mb=1373780004 hwm_mb=3131103 files=372231248 ffree=343447377 state=0: rc = 0
00000100:00000001:6.0:1773851862.857942:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000020:00000040:28.0:1773851862.857943:0:41091:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000001:28.0:1773851862.857943:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:11.0:1773851862.857943:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:7.0:1773851862.857943:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851862.857943:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:28.0:1773851862.857944:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006dbfd28d.
00000004:00000020:8.0:1773851862.857944:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690114048 free, 351687681024 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231248 files, 343447377 free files
00000100:00000040:7.0:1773851862.857944:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:30.0:1773851862.857945:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055bd4bee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051926592:60@kfi7:13:default-yuba2-0
02000000:00000001:28.0:1773851862.857945:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851862.857945:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:30.0:1773851862.857946:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:28.0:1773851862.857946:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000912e612e.
00000100:00000001:11.0:1773851862.857946:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851862.857946:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000001:8.0:1773851862.857946:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851862.857946:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851862.857947:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851862.857947:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851862.857947:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851862.857947:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851862.857947:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:8.0:1773851862.857947:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851862.857947:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000044ace912 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051926336:36@kfi7:13:default-yuba2-0
00000100:00000040:30.0:1773851862.857948:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000055bd4bee x1859433051926592/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851862.857948:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:11.0:1773851862.857948:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000004:00000040:11.0:1773851862.857948:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504356352 avail=351502185472 avail_mb=1373055412 hwm_mb=3131103 files=372056274 ffree=343265973 state=0: rc = 0
00000100:00000001:6.0:1773851862.857948:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851862.857949:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851862.857949:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857949:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851862.857949:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851862.857950:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851862.857950:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:28.0:1773851862.857950:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851862.857950:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:11.0:1773851862.857950:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504356352 free, 351502185472 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056274 files, 343265973 free files
00000100:00100000:8.0:1773851862.857950:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024de9a79 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051926272:37@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851862.857950:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851862.857950:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851862.857950:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000010:30.0:1773851862.857951:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000edd2b3c3.
00000100:00000001:8.0:1773851862.857951:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851862.857951:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000044ace912 x1859433051926336/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851862.857951:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851862.857951:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851862.857952:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000001:11.0:1773851862.857952:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.857952:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:6.0:1773851862.857952:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851862.857953:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851862.857953:0:41088:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00000040:11.0:1773851862.857953:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851862.857953:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000024de9a79 x1859433051926272/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851862.857953:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00001000:6.0:1773851862.857953:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=95 v=66 (66 66 66 66)
00000020:00000001:30.0:1773851862.857954:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851862.857954:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001bb8430c.
02000000:00000001:7.0:1773851862.857954:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00001000:6.0:1773851862.857954:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=95 v=66 (1 1 1 1)
02000000:00000001:30.0:1773851862.857955:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851862.857955:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00100000:11.0:1773851862.857955:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003b9a437e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051926528:2060@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851862.857955:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000010:7.0:1773851862.857955:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002b002509.
00000100:00000001:6.0:1773851862.857955:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000010:30.0:1773851862.857956:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000055bd4bee.
00000800:00000200:29.0:1773851862.857956:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
02000000:00000001:8.0:1773851862.857956:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:7.0:1773851862.857956:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851862.857956:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:6.0:1773851862.857956:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851862.857956:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851862.857957:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851862.857957:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851862.857957:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:11.0:1773851862.857957:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:8.0:1773851862.857957:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003e1bc6ec.
00000020:00000040:7.0:1773851862.857957:0:41064:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000020:00000001:7.0:1773851862.857957:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00010000:00000001:6.0:1773851862.857957:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857958:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851862.857958:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851862.857958:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:11.0:1773851862.857958:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851862.857958:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003b9a437e x1859433051926528/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:8.0:1773851862.857958:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851862.857958:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851862.857958:0:41068:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
02000000:00000010:7.0:1773851862.857958:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000078f43d8e.
00000100:00000001:6.0:1773851862.857958:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851862.857959:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851862.857959:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000001:8.0:1773851862.857959:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:7.0:1773851862.857959:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:6.0:1773851862.857959:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00000001:6.0:1773851862.857959:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851862.857960:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851862.857960:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
02000000:00000010:8.0:1773851862.857960:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000469124a5.
02000000:00000001:7.0:1773851862.857960:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851862.857960:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000044ace912.
00000100:00000001:6.0:1773851862.857960:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851862.857961:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851862.857961:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:8.0:1773851862.857961:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851862.857961:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:7.0:1773851862.857961:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:6.0:1773851862.857961:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:29.0:1773851862.857962:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
02000000:00000010:11.0:1773851862.857962:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000083609603.
00000100:00000010:8.0:1773851862.857962:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024de9a79.
00000100:00000001:8.0:1773851862.857962:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851862.857962:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851862.857962:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851862.857963:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2061@kfi7 : PUT - for me
02000000:00000001:11.0:1773851862.857963:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:8.0:1773851862.857963:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851862.857963:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851862.857963:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851862.857964:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000020:00000001:11.0:1773851862.857964:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851862.857964:0:41070:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000100:00000001:8.0:1773851862.857964:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851862.857964:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851862.857964:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851862.857964:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851862.857964:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:29.0:1773851862.857965:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000020:00000001:11.0:1773851862.857965:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851862.857965:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000100:00000001:8.0:1773851862.857965:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851862.857965:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851862.857965:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857965:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851862.857965:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:29.0:1773851862.857966:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
02000000:00000001:11.0:1773851862.857966:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851862.857966:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:8.0:1773851862.857966:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:6.0:1773851862.857966:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223712 blocks, 31250858240 free, 31250812032 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121490 files, 2868731127 free files
00000400:00000200:29.0:1773851862.857967:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:29.0:1773851862.857967:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000010:11.0:1773851862.857967:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003b9a437e.
00000400:00000200:29.0:1773851862.857968:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:11.0:1773851862.857968:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851862.857968:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851862.857968:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851862.857968:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851862.857969:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b2f80
00000100:00000001:11.0:1773851862.857969:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:6.0:1773851862.857969:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:29.0:1773851862.857970:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:11.0:1773851862.857970:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851862.857970:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851862.857970:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851862.857971:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x78008045d [1] + 224
00000100:00100000:6.0:1773851862.857972:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000026196639 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051926464:2074@kfi7:41:default-yuba2-0
00000800:00000200:29.0:1773851862.857973:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851862.857973:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851862.857974:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851862.857975:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:6.0:1773851862.857975:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000026196639 x1859433051926464/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:29.0:1773851862.857976:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000100:00000001:29.0:1773851862.857977:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851862.857977:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851862.857978:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851862.857978:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f4faae6e.
00000100:00000200:29.0:1773851862.857979:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851862.857979:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851862.857980:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851862.857980:0:41065:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000040:29.0:1773851862.857981:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:6.0:1773851862.857981:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851862.857981:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ed33a1f5.
02000000:00000001:6.0:1773851862.857982:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851862.857983:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851862.857983:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000026196639.
00000100:00000001:6.0:1773851862.857984:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851862.857984:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851862.857985:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851862.857986:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:6.0:1773851862.857986:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851862.857986:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851862.857987:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851862.857987:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851862.857987:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851862.857988:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851862.857988:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851862.857989:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851862.857990:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851862.857991:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851862.857992:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851862.857993:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851862.857994:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:4.0:1773851862.857995:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851862.857996:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851862.858001:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851862.858005:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851862.858006:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851862.858007:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851862.858007:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851862.858008:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851862.858009:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851862.858010:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851862.858011:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=95 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851862.858013:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=95 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851862.858014:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851862.858015:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851862.858016:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851862.858017:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851862.858018:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851862.858018:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:4.0:1773851862.858019:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851862.858020:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851862.858021:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851862.858026:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851862.858027:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851862.858027:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851862.858028:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851862.858029:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851862.858030:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399726592 free=351492777984 avail=351490345984 avail_mb=1373009164 hwm_mb=3131103 files=372078129 ffree=343254666 state=0: rc = 0
00000004:00000020:4.0:1773851862.858033:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399726592 blocks, 351492777984 free, 351490345984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372078129 files, 343254666 free files
00000004:00000001:4.0:1773851862.858035:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851862.858037:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851862.858041:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000298dd7d3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051926400:2061@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851862.858044:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851862.858045:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851862.858046:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000298dd7d3 x1859433051926400/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852015 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851862.858050:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851862.858050:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851862.858051:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004e2bbea7.
02000000:00000001:4.0:1773851862.858053:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851862.858053:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851862.858054:0:41066:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000020:00000001:4.0:1773851862.858055:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851862.858056:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ef164abb.
02000000:00000001:4.0:1773851862.858057:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851862.858057:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851862.858058:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000298dd7d3.
00000100:00000001:4.0:1773851862.858059:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851862.858060:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851862.858061:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851862.858062:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851862.858062:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851862.858063:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851862.858064:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851862.881964:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.881964:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851862.881966:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851862.881968:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851862.881970:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15618@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.881971:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15618@kfi7 : PUT - for me
00000400:00000200:9.0:1773851862.881972:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15618@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.881973:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a034d3d nid 15618@kfi7 refs 1
00000400:00000200:9.0:1773851862.881973:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15618@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.881974:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a034d3d nid 15618@kfi7 refs 2
00000400:00000200:9.0:1773851862.881975:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001a034d3d nid 15618@kfi7 refs 3
00000400:00000200:9.0:1773851862.881976:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000400:00000200:9.0:1773851862.881977:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15619@kfi7 of length 224 into portal 12 MB=0x69b4b9e662d00
00000400:00000200:9.0:1773851862.881979:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15619@kfi7 of length 224/224 into md 0x78146ce49 [64] + 131280
00000800:00000200:9.0:1773851862.881981:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851862.881982:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851862.881984:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15618@kfi7: PUT: OK
00000100:00000001:9.0:1773851862.881985:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851862.881985:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851862.881986:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009e8926a1.
00000100:00000040:9.0:1773851862.881987:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009e8926a1 x1859598942612736 msgsize 224
00000100:00100000:9.0:1773851862.881988:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-15619@kfi7 (source: 12345-15618@kfi7)
00000100:00000001:9.0:1773851862.881990:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851862.881991:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001a034d3d nid 15618@kfi7 refs 2
00000800:00000200:9.0:1773851862.881992:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851862.881995:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851862.881996:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851862.881996:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851862.881997:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.881998:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851862.881999:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598942612736
00000020:00000001:9.0:1773851862.881999:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851862.882000:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d816f3
00000020:00000001:9.0:1773851862.882000:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851862.882003:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002da34f3f refcount=612
00000020:00000001:9.0:1773851862.882003:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139351546880 : -106934358004736 : ffff9ebe6793ac00)
00000020:00000001:9.0:1773851862.882004:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139351546880 : -106934358004736 : ffff9ebe6793ac00)
00000100:00000001:9.0:1773851862.882005:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.882006:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851862.882006:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851862.882008:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851862.882009:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851862.882010:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851862.882011:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851862.882011:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.882012:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851862.882013:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851862.882013:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.882014:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851862.882016:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851862.882016:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851862.882016:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851862.882017:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851862.882017:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15619@kfi7, seq: 2130766
00000100:00000001:11.0:1773851862.882018:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.882018:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002da34f3f : new rpc_count 3
00000100:00000001:11.0:1773851862.882019:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.882019:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922887808 : -107141786663808 : ffff9e8e1bdd8480)
00000100:00000040:9.0:1773851862.882020:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009e8926a1 x1859598942612736/t0(0) o400->deec8167-560d-484b-8611-2c460a2db78b@15619@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1479-0'
00000100:00000001:9.0:1773851862.882022:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.882023:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851862.882023:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e8926a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:deec8167-560d-484b-8611-2c460a2db78b+612:39566:x1859598942612736:12345-15619@kfi7:400:default-tuolumne1479-0
00000100:00000200:9.0:1773851862.882025:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598942612736
00000020:00000001:9.0:1773851862.882026:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851862.882026:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851862.882027:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.882028:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851862.882028:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851862.882029:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851862.882030:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598942612736, found 0 last_xid 1859598925326527
00000020:00000001:9.0:1773851862.882031:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851862.882031:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851862.882032:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851862.882032:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.882033:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851862.882034:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851862.882034:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851862.882036:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004830a15b.
02000000:00000001:9.0:1773851862.882036:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.882037:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.882037:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851862.882038:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593780, transno 0, xid 1859598942612736
00010000:00000001:9.0:1773851862.882039:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851862.882040:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009e8926a1 x1859598942612736/t0(0) o400->deec8167-560d-484b-8611-2c460a2db78b@15619@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1479-0'
00010000:00000001:9.0:1773851862.882042:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851862.882043:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851862.882044:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=95 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851862.882045:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851862.882045:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b8759961 refcount 3 to 15619@kfi7
00000100:00000001:9.0:1773851862.882046:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024608 : -107156745527008 : ffff9e8aa03f6120)
02000000:00000001:9.0:1773851862.882047:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851862.882048:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.882048:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851862.882049:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15618@kfi7
00000400:00000010:9.0:1773851862.882050:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000096f4c744.
00000100:00000200:9.0:1773851862.882051:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598942612736, offset 224
00000400:00000200:9.0:1773851862.882052:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15618@kfi7
00000400:00000200:9.0:1773851862.882053:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15618@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.882053:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a034d3d nid 15618@kfi7 refs 1
00000400:00000200:9.0:1773851862.882054:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001a034d3d nid 15618@kfi7 refs 2
00000400:00000200:9.0:1773851862.882055:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001a034d3d nid 15618@kfi7 refs 3
00000400:00000200:9.0:1773851862.882056:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15618@kfi7 local destination
00000400:00000200:9.0:1773851862.882058:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769053:8769053:1024:4294967295] 15618@kfi7 LPNI seq info [3661789:3661789:16:4294967295]
00000400:00000200:9.0:1773851862.882059:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001a034d3d nid 15618@kfi7 refs 2
00000400:00000200:9.0:1773851862.882060:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15618@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.882062:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15618@kfi7(15618@kfi7:15618@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851862.882063:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001a034d3d nid 15618@kfi7 refs 3
00000800:00000200:9.0:1773851862.882065:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.882069:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851862.882071:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851862.882073:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbd1 Using peer 15618@kfi7(0xbd1)
00000800:00000200:9.0:1773851862.882076:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0xbd1: rc=0
00000800:00000200:9.0:1773851862.882077:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbd1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851862.882079:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.882080:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b8759961 refcount 2 to 15619@kfi7
00010000:00000001:9.0:1773851862.882081:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851862.882081:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.882082:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851862.882082:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009e8926a1 x1859598942612736/t0(0) o400->deec8167-560d-484b-8611-2c460a2db78b@15619@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1479-0'
00000100:00100000:9.0:1773851862.882085:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e8926a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:deec8167-560d-484b-8611-2c460a2db78b+612:39566:x1859598942612736:12345-15619@kfi7:400:default-tuolumne1479-0 Request processed in 62us (97us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851862.882088:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbd1 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851862.882088:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15619@kfi7, seq: 2130766
00000100:00000040:9.0:1773851862.882088:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002da34f3f : new rpc_count 2
00000100:00000001:9.0:1773851862.882089:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851862.882089:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851862.882090:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851862.882090:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851862.882091:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15618@kfi7: PUT: OK
00000020:00000010:9.0:1773851862.882091:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851862.882092:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000096f4c744
00000400:00000010:10.0:1773851862.882092:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000096f4c744.
00000020:00000010:9.0:1773851862.882092:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851862.882092:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000002da34f3f : new refcount 611
00000100:00000001:10.0:1773851862.882093:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851862.882093:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851862.882093:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851862.882094:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001a034d3d nid 15618@kfi7 refs 2
00000800:00000200:10.0:1773851862.882095:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15618@kfi7(0000000077410d1a):0x0 lsk 3026 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbd1 Transaction freed
00000800:00000200:25.0:1773851862.912206:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.912207:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851862.912208:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851862.912210:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851862.912212:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20722@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.912214:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20722@kfi7 : PUT - for me
00000400:00000200:25.0:1773851862.912215:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20722@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.912216:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acca95d7 nid 20722@kfi7 refs 1
00000400:00000200:25.0:1773851862.912217:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20722@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.912217:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acca95d7 nid 20722@kfi7 refs 2
00000400:00000200:25.0:1773851862.912218:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000acca95d7 nid 20722@kfi7 refs 3
00000400:00000200:25.0:1773851862.912219:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20722@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.912220:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20722@kfi7 of length 224 into portal 12 MB=0x69b0a8ed56700
00000400:00000200:25.0:1773851862.912221:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20722@kfi7 of length 224/224 into md 0x16159c9699 [64] + 224
00000800:00000200:25.0:1773851862.912223:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851862.912224:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.912225:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20722@kfi7: PUT: OK
00000100:00000001:25.0:1773851862.912226:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851862.912227:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851862.912228:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001153fcf2.
00000100:00000040:25.0:1773851862.912228:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000001153fcf2 x1859319508592384 msgsize 224
00000100:00100000:25.0:1773851862.912230:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20722@kfi7 (source: 12345-20722@kfi7)
00000100:00000001:25.0:1773851862.912231:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851862.912232:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000acca95d7 nid 20722@kfi7 refs 2
00000800:00000200:25.0:1773851862.912234:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851862.912236:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851862.912237:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851862.912237:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851862.912238:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851862.912239:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851862.912239:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319508592384
00000020:00000001:25.0:1773851862.912240:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851862.912240:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92474
00000020:00000001:25.0:1773851862.912241:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851862.912242:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000466f3600 refcount=2681
00000020:00000001:25.0:1773851862.912243:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630513664 : -107123079037952 : ffff9e9276ed3c00)
00000020:00000001:25.0:1773851862.912245:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630513664 : -107123079037952 : ffff9e9276ed3c00)
00000100:00000001:25.0:1773851862.912245:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851862.912246:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851862.912247:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000212fefaf.
00000020:00000010:25.0:1773851862.912248:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851862.912249:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094918347.
00000100:00000001:25.0:1773851862.912249:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851862.912250:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851862.912250:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.912251:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851862.912252:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851862.912252:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.912253:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.912254:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.912254:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851862.912255:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851862.912255:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20722@kfi7, seq: 2025082
00000100:00000001:24.0:1773851862.912255:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:25.0:1773851862.912256:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000466f3600 : new rpc_count 8
00000100:00000001:24.0:1773851862.912256:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.912257:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478774272 : -106938230777344 : ffff9ebd80bdda00)
00000100:00000001:24.0:1773851862.912257:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851862.912258:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001153fcf2 x1859319508592384/t0(0) o400->c3cf85f9-085b-4799-9c8b-160b726ef4b9@20722@kfi7:79/0 lens 224/0 e 0 to 0 dl 1773852194 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1769-0'
00000100:00000001:25.0:1773851862.912260:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851862.912261:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851862.912261:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001153fcf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c3cf85f9-085b-4799-9c8b-160b726ef4b9+2681:39487:x1859319508592384:12345-20722@kfi7:400:default-tuolumne1769-0
00000100:00000200:25.0:1773851862.912263:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319508592384
00000020:00000001:25.0:1773851862.912263:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851862.912264:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851862.912264:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.912265:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851862.912265:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851862.912266:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851862.912267:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319508592384, found 0 last_xid 1859319507907903
00000020:00000001:25.0:1773851862.912268:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851862.912269:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851862.912269:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851862.912270:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.912270:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851862.912271:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851862.912271:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851862.912272:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002af434f6.
02000000:00000001:25.0:1773851862.912273:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.912273:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.912274:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851862.912274:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583865, transno 0, xid 1859319508592384
00010000:00000001:25.0:1773851862.912276:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851862.912276:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001153fcf2 x1859319508592384/t0(0) o400->c3cf85f9-085b-4799-9c8b-160b726ef4b9@20722@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1769-0'
00010000:00000001:25.0:1773851862.912279:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851862.912279:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851862.912280:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=95 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851862.912281:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851862.912281:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008ad01126 refcount 3 to 20722@kfi7
00000100:00000001:25.0:1773851862.912282:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858496 : -107149578693120 : ffff9e8c4b6c9600)
02000000:00000001:25.0:1773851862.912283:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851862.912283:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.912284:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851862.912285:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20722@kfi7
00000400:00000010:25.0:1773851862.912285:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ad25a34d.
00000100:00000200:25.0:1773851862.912286:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859319508592384, offset 224
00000400:00000200:25.0:1773851862.912287:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20722@kfi7
00000400:00000200:25.0:1773851862.912288:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20722@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.912289:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acca95d7 nid 20722@kfi7 refs 1
00000400:00000200:25.0:1773851862.912290:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000acca95d7 nid 20722@kfi7 refs 2
00000400:00000200:25.0:1773851862.912291:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000acca95d7 nid 20722@kfi7 refs 3
00000400:00000200:25.0:1773851862.912292:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20722@kfi7 local destination
00000400:00000200:25.0:1773851862.912293:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769054:8769054:1024:4294967295] 20722@kfi7 LPNI seq info [25201614:25201614:16:4294967295]
00000400:00000200:25.0:1773851862.912294:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000acca95d7 nid 20722@kfi7 refs 2
00000400:00000200:25.0:1773851862.912296:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20722@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.912298:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20722@kfi7(20722@kfi7:20722@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851862.912299:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000acca95d7 nid 20722@kfi7 refs 3
00000800:00000200:25.0:1773851862.912300:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.912301:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851862.912303:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851862.912305:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b0 Using peer 20722@kfi7(0x6b0)
00000800:00000200:25.0:1773851862.912308:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000878f9def: Posted send of 324 bytes to peer 0x6b0: rc=0
00000800:00000200:25.0:1773851862.912310:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851862.912312:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851862.912313:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008ad01126 refcount 2 to 20722@kfi7
00010000:00000001:25.0:1773851862.912313:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851862.912314:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.912314:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851862.912315:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001153fcf2 x1859319508592384/t0(0) o400->c3cf85f9-085b-4799-9c8b-160b726ef4b9@20722@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1769-0'
00000100:00100000:25.0:1773851862.912318:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001153fcf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c3cf85f9-085b-4799-9c8b-160b726ef4b9+2681:39487:x1859319508592384:12345-20722@kfi7:400:default-tuolumne1769-0 Request processed in 57us (89us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851862.912320:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20722@kfi7, seq: 2025082
00000100:00000040:25.0:1773851862.912321:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000466f3600 : new rpc_count 7
00000100:00000001:25.0:1773851862.912322:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851862.912322:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:26.0:1773851862.912323:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b0 TN_EVENT_TX_OK event status 0
00000020:00000010:25.0:1773851862.912323:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000400:00000200:26.0:1773851862.912324:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851862.912324:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094918347.
00000020:00000010:25.0:1773851862.912325:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000212fefaf.
00000020:00000040:25.0:1773851862.912325:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000466f3600 : new refcount 2680
00000400:00000200:26.0:1773851862.912326:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20722@kfi7: PUT: OK
00000400:00000200:26.0:1773851862.912326:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ad25a34d
00000100:00000001:25.0:1773851862.912326:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:26.0:1773851862.912327:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ad25a34d.
00000100:00000001:26.0:1773851862.912327:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851862.912328:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851862.912329:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000acca95d7 nid 20722@kfi7 refs 2
00000800:00000200:26.0:1773851862.912330:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 20722@kfi7(000000003f1e5277):0x0 lsk 1713 rsk 61 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b0 Transaction freed
00000800:00000200:21.0:1773851862.912417:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851862.912418:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851862.912420:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851862.912422:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851862.912424:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15378@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.912426:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15378@kfi7 : PUT - for me
00000400:00000200:21.0:1773851862.912427:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15378@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.912428:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a8ba774 nid 15378@kfi7 refs 1
00000400:00000200:21.0:1773851862.912429:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15378@kfi7 to cpt 5
00000400:00000200:21.0:1773851862.912430:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a8ba774 nid 15378@kfi7 refs 2
00000400:00000200:21.0:1773851862.912431:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008a8ba774 nid 15378@kfi7 refs 3
00000400:00000200:21.0:1773851862.912432:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15571@kfi7 to cpt 2
00000400:00000200:21.0:1773851862.912433:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15571@kfi7 of length 224 into portal 12 MB=0x69b4b5ae4a9c0
00000400:00000200:21.0:1773851862.912435:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15571@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 33256
00000800:00000200:21.0:1773851862.912437:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851862.912439:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851862.912441:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15378@kfi7: PUT: OK
00000100:00000001:21.0:1773851862.912442:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851862.912442:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851862.912443:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000007421b3d.
00000100:00000040:21.0:1773851862.912444:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000007421b3d x1859597810051520 msgsize 224
00000100:00100000:21.0:1773851862.912446:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15571@kfi7 (source: 12345-15378@kfi7)
00000100:00000001:21.0:1773851862.912447:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851862.912448:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008a8ba774 nid 15378@kfi7 refs 2
00000100:00000001:22.0:1773851862.912449:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851862.912450:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851862.912450:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851862.912450:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851862.912451:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851862.912453:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851862.912454:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597810051520
00000020:00000001:22.0:1773851862.912455:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851862.912456:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fc20
00000020:00000001:22.0:1773851862.912457:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851862.912461:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000890db0c1 refcount=5
00000020:00000001:22.0:1773851862.912462:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637040039143424 : -107033670408192 : ffff9ea74818a800)
00000020:00000001:22.0:1773851862.912463:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637040039143424 : -107033670408192 : ffff9ea74818a800)
00000100:00000001:22.0:1773851862.912465:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851862.912466:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851862.912467:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e2bf2194.
00000020:00000010:22.0:1773851862.912469:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851862.912470:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851862.912472:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851862.912472:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851862.912474:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851862.912475:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851862.912476:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851862.912477:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851862.912479:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851862.912481:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851862.912481:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851862.912482:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851862.912482:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851862.912483:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15571@kfi7, seq: 1997964
00000100:00000001:23.0:1773851862.912485:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851862.912485:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000890db0c1 : new rpc_count 1
00000100:00000001:23.0:1773851862.912486:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851862.912486:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132564925824 : -106941144625792 : ffff9ebcd3100d80)
00000100:00000040:22.0:1773851862.912488:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000007421b3d x1859597810051520/t0(0) o400->e8736801-753f-4015-b4c9-22e72c7ec5e0@15571@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1461-0'
00000100:00000001:22.0:1773851862.912493:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851862.912494:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851862.912496:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007421b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e8736801-753f-4015-b4c9-22e72c7ec5e0+5:39720:x1859597810051520:12345-15571@kfi7:400:default-tuolumne1461-0
00000100:00000200:22.0:1773851862.912498:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597810051520
00000020:00000001:22.0:1773851862.912499:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851862.912500:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851862.912502:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.912503:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851862.912504:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851862.912505:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851862.912506:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597810051520, found 0 last_xid 1859597810051519
00000020:00000001:22.0:1773851862.912508:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851862.912509:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851862.912510:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851862.912511:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.912512:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851862.912513:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851862.912514:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851862.912515:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f6e17dd1.
02000000:00000001:22.0:1773851862.912516:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851862.912517:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.912519:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851862.912520:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035347769, transno 0, xid 1859597810051520
00010000:00000001:22.0:1773851862.912521:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851862.912523:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000007421b3d x1859597810051520/t0(0) o400->e8736801-753f-4015-b4c9-22e72c7ec5e0@15571@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1461-0'
00010000:00000001:22.0:1773851862.912528:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851862.912529:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851862.912530:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=95 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851862.912532:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851862.912533:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ec47b216 refcount 3 to 15571@kfi7
00000100:00000001:22.0:1773851862.912535:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579776 : -107154806971840 : ffff9e8b13cb6240)
02000000:00000001:22.0:1773851862.912536:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851862.912537:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851862.912538:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851862.912541:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15378@kfi7
00000400:00000010:22.0:1773851862.912542:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a20de60f.
00000100:00000200:22.0:1773851862.912543:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597810051520, offset 224
00000400:00000200:22.0:1773851862.912546:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15378@kfi7
00000400:00000200:22.0:1773851862.912547:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15378@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.912548:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a8ba774 nid 15378@kfi7 refs 1
00000400:00000200:22.0:1773851862.912550:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008a8ba774 nid 15378@kfi7 refs 2
00000400:00000200:22.0:1773851862.912552:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008a8ba774 nid 15378@kfi7 refs 3
00000400:00000200:22.0:1773851862.912554:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15378@kfi7 local destination
00000400:00000200:22.0:1773851862.912556:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769055:8769055:1024:4294967295] 15378@kfi7 LPNI seq info [1146585:1146585:16:4294967295]
00000400:00000200:22.0:1773851862.912559:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008a8ba774 nid 15378@kfi7 refs 2
00000400:00000200:22.0:1773851862.912560:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15378@kfi7 to cpt 5
00000400:00000200:22.0:1773851862.912563:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15378@kfi7(15378@kfi7:15378@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851862.912565:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008a8ba774 nid 15378@kfi7 refs 3
00000800:00000200:22.0:1773851862.912568:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851862.912570:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851862.912573:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851862.912577:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa7 Using peer 15378@kfi7(0xaa7)
00000800:00000200:22.0:1773851862.912582:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 324 bytes to peer 0xaa7: rc=0
00000800:00000200:22.0:1773851862.912585:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851862.912588:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851862.912590:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ec47b216 refcount 2 to 15571@kfi7
00010000:00000001:22.0:1773851862.912591:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851862.912591:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851862.912592:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851862.912593:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000007421b3d x1859597810051520/t0(0) o400->e8736801-753f-4015-b4c9-22e72c7ec5e0@15571@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1461-0'
00000800:00000200:21.0:1773851862.912599:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa7 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851862.912601:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:22.0:1773851862.912603:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007421b3d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e8736801-753f-4015-b4c9-22e72c7ec5e0+5:39720:x1859597810051520:12345-15571@kfi7:400:default-tuolumne1461-0 Request processed in 109us (158us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851862.912603:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15378@kfi7: PUT: OK
00000400:00000200:21.0:1773851862.912604:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a20de60f
00000400:00000010:21.0:1773851862.912605:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a20de60f.
00000100:00000001:21.0:1773851862.912606:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:22.0:1773851862.912607:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15571@kfi7, seq: 1997964
00000100:00000001:21.0:1773851862.912607:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:22.0:1773851862.912608:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000890db0c1 : new rpc_count 0
00000400:00000200:21.0:1773851862.912608:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008a8ba774 nid 15378@kfi7 refs 2
00000100:00000001:22.0:1773851862.912609:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851862.912610:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851862.912610:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 15378@kfi7(0000000004d50331):0x0 lsk 2728 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xaa7 Transaction freed
00000020:00000010:22.0:1773851862.912611:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851862.912612:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851862.912614:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e2bf2194.
00000020:00000040:22.0:1773851862.912615:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000890db0c1 : new refcount 4
00000100:00000001:22.0:1773851862.912616:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851862.921736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851862.921738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:17.0:1773851862.922202:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851862.922203:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851862.922205:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851862.922208:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851862.922212:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18001@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.922214:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18001@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.922215:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18001@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.922217:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4482361 nid 18001@kfi7 refs 1
00000400:00000200:17.0:1773851862.922218:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18001@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.922219:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4482361 nid 18001@kfi7 refs 2
00000400:00000200:17.0:1773851862.922221:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b4482361 nid 18001@kfi7 refs 3
00000400:00000200:17.0:1773851862.922222:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18001@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.922223:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18001@kfi7 of length 224 into portal 12 MB=0x69b4b8676eac0
00000400:00000200:17.0:1773851862.922225:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18001@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 4512
00000800:00000200:17.0:1773851862.922228:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851862.922230:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851862.922233:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18001@kfi7: PUT: OK
00000100:00000001:17.0:1773851862.922234:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851862.922235:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851862.922236:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000072b2a9a2.
00000100:00000040:17.0:1773851862.922237:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000072b2a9a2 x1859598541056704 msgsize 224
00000100:00100000:17.0:1773851862.922240:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18001@kfi7 (source: 12345-18001@kfi7)
00000100:00000001:17.0:1773851862.922241:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851862.922243:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b4482361 nid 18001@kfi7 refs 2
00000100:00000001:19.0:1773851862.922244:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851862.922244:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851862.922245:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851862.922245:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851862.922246:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851862.922247:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851862.922248:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598541056704
00000020:00000001:19.0:1773851862.922249:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851862.922250:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81c9c
00000020:00000001:19.0:1773851862.922254:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851862.922257:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dfdd610d refcount=5
00000020:00000001:19.0:1773851862.922258:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139323337728 : -106934386213888 : ffff9ebe65e53c00)
00000020:00000001:19.0:1773851862.922260:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139323337728 : -106934386213888 : ffff9ebe65e53c00)
00000100:00000001:19.0:1773851862.922261:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.922262:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851862.922263:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851862.922265:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.922266:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851862.922267:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851862.922268:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851862.922269:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.922270:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851862.922271:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851862.922271:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.922273:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.922275:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851862.922275:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.922276:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851862.922276:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851862.922277:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18001@kfi7, seq: 2156299
00000100:00000040:19.0:1773851862.922278:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dfdd610d : new rpc_count 1
00000100:00000001:19.0:1773851862.922279:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764356352 : -107095945195264 : ffff9e98c83ad100)
00000100:00000001:16.0:1773851862.922279:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851862.922280:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.922282:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000072b2a9a2 x1859598541056704/t0(0) o400->216ec3e7-12e8-44d7-aa34-8c56b8a786ff@18001@kfi7:83/0 lens 224/0 e 0 to 0 dl 1773852198 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1618-0'
00000100:00000001:19.0:1773851862.922286:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.922287:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851862.922288:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000072b2a9a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:216ec3e7-12e8-44d7-aa34-8c56b8a786ff+5:39651:x1859598541056704:12345-18001@kfi7:400:default-tuolumne1618-0
00000100:00000200:19.0:1773851862.922290:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598541056704
00000020:00000001:19.0:1773851862.922291:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851862.922292:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851862.922293:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.922294:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851862.922295:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851862.922297:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851862.922298:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598541056704, found 0 last_xid 1859598541056703
00000020:00000001:19.0:1773851862.922299:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851862.922300:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851862.922300:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851862.922301:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.922302:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851862.922303:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851862.922304:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851862.922305:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000098535041.
02000000:00000001:19.0:1773851862.922306:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.922307:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.922308:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851862.922309:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262832741, transno 0, xid 1859598541056704
00010000:00000001:19.0:1773851862.922310:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851862.922311:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000072b2a9a2 x1859598541056704/t0(0) o400->216ec3e7-12e8-44d7-aa34-8c56b8a786ff@18001@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1618-0'
00010000:00000001:19.0:1773851862.922315:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851862.922316:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851862.922317:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=95 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851862.922319:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851862.922320:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f1b236d0 refcount 3 to 18001@kfi7
00000100:00000001:19.0:1773851862.922321:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583544704 : -107156126006912 : ffff9e8ac52c8180)
02000000:00000001:19.0:1773851862.922322:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851862.922323:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.922324:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851862.922325:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18001@kfi7
00000400:00000010:19.0:1773851862.922326:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2381311.
00000100:00000200:19.0:1773851862.922328:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598541056704, offset 224
00000400:00000200:19.0:1773851862.922330:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18001@kfi7
00000400:00000200:19.0:1773851862.922332:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18001@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.922333:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4482361 nid 18001@kfi7 refs 1
00000400:00000200:19.0:1773851862.922335:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b4482361 nid 18001@kfi7 refs 2
00000400:00000200:19.0:1773851862.922337:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b4482361 nid 18001@kfi7 refs 3
00000400:00000200:19.0:1773851862.922339:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18001@kfi7 local destination
00000400:00000200:19.0:1773851862.922341:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769056:8769056:1024:4294967295] 18001@kfi7 LPNI seq info [13557898:13557898:16:4294967295]
00000400:00000200:19.0:1773851862.922343:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b4482361 nid 18001@kfi7 refs 2
00000400:00000200:19.0:1773851862.922345:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18001@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.922348:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18001@kfi7(18001@kfi7:18001@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851862.922350:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b4482361 nid 18001@kfi7 refs 3
00000800:00000200:19.0:1773851862.922352:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851862.922354:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851862.922357:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851862.922361:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bb Using peer 18001@kfi7(0x1000000000009bb)
00000800:00000200:19.0:1773851862.922365:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x1000000000009bb: rc=0
00000800:00000200:19.0:1773851862.922368:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851862.922371:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.922372:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f1b236d0 refcount 2 to 18001@kfi7
00010000:00000001:19.0:1773851862.922373:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851862.922374:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.922375:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851862.922376:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000072b2a9a2 x1859598541056704/t0(0) o400->216ec3e7-12e8-44d7-aa34-8c56b8a786ff@18001@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1618-0'
00000100:00100000:19.0:1773851862.922381:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000072b2a9a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:216ec3e7-12e8-44d7-aa34-8c56b8a786ff+5:39651:x1859598541056704:12345-18001@kfi7:400:default-tuolumne1618-0 Request processed in 94us (143us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851862.922384:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bb TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851862.922386:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18001@kfi7, seq: 2156299
00000100:00000040:19.0:1773851862.922387:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dfdd610d : new rpc_count 0
00000400:00000200:17.0:1773851862.922387:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851862.922389:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851862.922389:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18001@kfi7: PUT: OK
00000100:00000001:19.0:1773851862.922390:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851862.922390:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2381311
00000400:00000010:17.0:1773851862.922391:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2381311.
00000020:00000010:19.0:1773851862.922392:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.922393:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000100:00000001:17.0:1773851862.922393:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851862.922393:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851862.922395:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000400:00000200:17.0:1773851862.922395:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b4482361 nid 18001@kfi7 refs 2
00000020:00000040:19.0:1773851862.922396:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000dfdd610d : new refcount 4
00000100:00000001:19.0:1773851862.922397:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851862.922397:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 18001@kfi7(000000001a86e570):0x0 lsk 2492 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009bb Transaction freed
00000800:00000200:25.0:1773851862.934454:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.934456:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851862.934458:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851862.934463:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851862.934466:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23120@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.934468:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23120@kfi7 : PUT - for me
00000400:00000200:25.0:1773851862.934470:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23120@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.934472:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e07f8e3d nid 23120@kfi7 refs 1
00000400:00000200:25.0:1773851862.934473:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23120@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.934475:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e07f8e3d nid 23120@kfi7 refs 2
00000400:00000200:25.0:1773851862.934476:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e07f8e3d nid 23120@kfi7 refs 3
00000400:00000200:25.0:1773851862.934478:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23185@kfi7 to cpt 5
00000400:00000200:25.0:1773851862.934480:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23185@kfi7 of length 224 into portal 12 MB=0x699e0c2b3f640
00000400:00000200:25.0:1773851862.934482:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23185@kfi7 of length 224/224 into md 0x16159c9699 [64] + 448
00000800:00000200:25.0:1773851862.934485:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851862.934489:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851862.934491:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23120@kfi7: PUT: OK
00000100:00000001:25.0:1773851862.934492:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851862.934493:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851862.934494:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000034c48f85.
00000100:00000040:25.0:1773851862.934496:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000034c48f85 x1858040478561856 msgsize 224
00000100:00100000:25.0:1773851862.934499:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-23185@kfi7 (source: 12345-23120@kfi7)
00000100:00000001:25.0:1773851862.934501:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851862.934503:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e07f8e3d nid 23120@kfi7 refs 2
00000800:00000200:25.0:1773851862.934505:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851862.934510:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851862.934511:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851862.934512:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851862.934514:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851862.934516:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851862.934517:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040478561856
00000020:00000001:25.0:1773851862.934518:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851862.934519:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b6e
00000020:00000001:25.0:1773851862.934520:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851862.934523:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007e1d019f refcount=6
00000020:00000001:25.0:1773851862.934524:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628008960 : -107123081542656 : ffff9e9276c70400)
00000020:00000001:25.0:1773851862.934526:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628008960 : -107123081542656 : ffff9e9276c70400)
00000100:00000001:25.0:1773851862.934527:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851862.934529:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851862.934530:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000212fefaf.
00000020:00000010:25.0:1773851862.934531:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851862.934533:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094918347.
00000100:00000001:25.0:1773851862.934534:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851862.934535:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851862.934536:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.934538:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851862.934538:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851862.934539:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.934541:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851862.934543:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851862.934544:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851862.934544:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851862.934544:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851862.934546:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23185@kfi7, seq: 2025083
00000100:00000040:25.0:1773851862.934547:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007e1d019f : new rpc_count 1
00000100:00000001:24.0:1773851862.934548:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.934549:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478763904 : -106938230787712 : ffff9ebd80bdb180)
00000100:00000001:24.0:1773851862.934549:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851862.934551:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000034c48f85 x1858040478561856/t0(0) o400->68cce1bc-33b7-4a90-8ec3-1bc3fe4b378f@23185@kfi7:79/0 lens 224/0 e 0 to 0 dl 1773852194 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1938-0'
00000100:00000001:25.0:1773851862.934556:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851862.934557:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851862.934558:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000034c48f85 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:68cce1bc-33b7-4a90-8ec3-1bc3fe4b378f+6:39651:x1858040478561856:12345-23185@kfi7:400:default-tuolumne1938-0
00000100:00000200:25.0:1773851862.934561:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040478561856
00000020:00000001:25.0:1773851862.934563:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851862.934564:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851862.934565:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.934566:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851862.934567:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851862.934568:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851862.934569:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040478561856, found 0 last_xid 1858040478561855
00000020:00000001:25.0:1773851862.934571:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851862.934572:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851862.934573:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851862.934574:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.934575:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851862.934576:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851862.934577:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851862.934578:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2a53643.
02000000:00000001:25.0:1773851862.934579:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.934580:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.934582:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851862.934583:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183250008362, transno 0, xid 1858040478561856
00010000:00000001:25.0:1773851862.934584:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851862.934586:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000034c48f85 x1858040478561856/t0(0) o400->68cce1bc-33b7-4a90-8ec3-1bc3fe4b378f@23185@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1938-0'
00010000:00000001:25.0:1773851862.934591:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851862.934591:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851862.934593:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=95 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851862.934595:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851862.934596:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004af7281b refcount 3 to 23185@kfi7
00000100:00000001:25.0:1773851862.934598:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107072 : -107156354444544 : ffff9e8ab78ed300)
02000000:00000001:25.0:1773851862.934599:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851862.934600:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851862.934601:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851862.934602:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23120@kfi7
00000400:00000010:25.0:1773851862.934604:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c416d51.
00000100:00000200:25.0:1773851862.934605:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040478561856, offset 224
00000400:00000200:25.0:1773851862.934607:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23120@kfi7
00000400:00000200:25.0:1773851862.934609:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23120@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.934611:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e07f8e3d nid 23120@kfi7 refs 1
00000400:00000200:25.0:1773851862.934612:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e07f8e3d nid 23120@kfi7 refs 2
00000400:00000200:25.0:1773851862.934614:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e07f8e3d nid 23120@kfi7 refs 3
00000400:00000200:25.0:1773851862.934616:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23120@kfi7 local destination
00000400:00000200:25.0:1773851862.934619:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769057:8769057:1024:4294967295] 23120@kfi7 LPNI seq info [854538:854538:16:4294967295]
00000400:00000200:25.0:1773851862.934621:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e07f8e3d nid 23120@kfi7 refs 2
00000400:00000200:25.0:1773851862.934623:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23120@kfi7 to cpt 6
00000400:00000200:25.0:1773851862.934627:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23120@kfi7(23120@kfi7:23120@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851862.934629:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e07f8e3d nid 23120@kfi7 refs 3
00000800:00000200:25.0:1773851862.934631:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851862.934633:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851862.934636:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851862.934640:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a83 Using peer 23120@kfi7(0x100000000000a83)
00000800:00000200:25.0:1773851862.934645:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000878f9def: Posted send of 324 bytes to peer 0x100000000000a83: rc=0
00000800:00000200:25.0:1773851862.934647:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a83 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851862.934650:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851862.934652:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004af7281b refcount 2 to 23185@kfi7
00010000:00000001:25.0:1773851862.934653:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851862.934653:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851862.934654:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851862.934656:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000034c48f85 x1858040478561856/t0(0) o400->68cce1bc-33b7-4a90-8ec3-1bc3fe4b378f@23185@kfi7:79/0 lens 224/224 e 0 to 0 dl 1773852194 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1938-0'
00000100:00100000:25.0:1773851862.934661:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000034c48f85 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:68cce1bc-33b7-4a90-8ec3-1bc3fe4b378f+6:39651:x1858040478561856:12345-23185@kfi7:400:default-tuolumne1938-0 Request processed in 104us (164us total) trans 0 rc 0/0
00000800:00000200:26.0:1773851862.934662:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a83 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851862.934665:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851862.934666:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23120@kfi7: PUT: OK
00000400:00000200:26.0:1773851862.934668:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c416d51
00000400:00000010:26.0:1773851862.934668:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c416d51.
00000100:00000001:26.0:1773851862.934669:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851862.934670:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851862.934671:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e07f8e3d nid 23120@kfi7 refs 2
00000100:00100000:25.0:1773851862.934671:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23185@kfi7, seq: 2025083
00000100:00000040:25.0:1773851862.934672:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007e1d019f : new rpc_count 0
00000800:00000200:26.0:1773851862.934673:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 23120@kfi7(0000000074f006f6):0x0 lsk 2692 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a83 Transaction freed
00000100:00000001:25.0:1773851862.934673:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851862.934674:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851862.934675:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851862.934676:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094918347.
00000020:00000010:25.0:1773851862.934678:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000212fefaf.
00000020:00000040:25.0:1773851862.934679:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000007e1d019f : new refcount 5
00000100:00000001:25.0:1773851862.934680:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851862.963588:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.963589:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851862.963590:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851862.963594:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851862.963596:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25441@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.963597:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25441@kfi7 : PUT - for me
00000400:00000200:9.0:1773851862.963598:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25441@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.963599:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010b4b18d nid 25441@kfi7 refs 1
00000400:00000200:9.0:1773851862.963600:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25441@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.963601:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010b4b18d nid 25441@kfi7 refs 2
00000400:00000200:9.0:1773851862.963601:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010b4b18d nid 25441@kfi7 refs 3
00000400:00000200:9.0:1773851862.963602:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25440@kfi7 to cpt 7
00000400:00000200:9.0:1773851862.963603:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25440@kfi7 of length 224 into portal 12 MB=0x699e1c0854700
00000400:00000200:9.0:1773851862.963604:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25440@kfi7 of length 224/224 into md 0x78146ce49 [64] + 131504
00000800:00000200:9.0:1773851862.963606:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851862.963608:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851862.963609:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25441@kfi7: PUT: OK
00000100:00000001:9.0:1773851862.963610:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851862.963611:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851862.963611:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007ee7a79d.
00000100:00000040:9.0:1773851862.963612:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000007ee7a79d x1858044736915200 msgsize 224
00000100:00100000:9.0:1773851862.963613:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-25440@kfi7 (source: 12345-25441@kfi7)
00000100:00000001:9.0:1773851862.963615:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851862.963615:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010b4b18d nid 25441@kfi7 refs 2
00000800:00000200:9.0:1773851862.963617:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851862.963619:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851862.963620:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851862.963621:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851862.963621:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851862.963622:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851862.963622:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044736915200
00000020:00000001:9.0:1773851862.963624:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851862.963624:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e99
00000020:00000001:9.0:1773851862.963625:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851862.963628:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009e71035b refcount=6
00000020:00000001:9.0:1773851862.963628:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744664064 : -107128964887552 : ffff9e91181a4c00)
00000020:00000001:9.0:1773851862.963629:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744664064 : -107128964887552 : ffff9e91181a4c00)
00000100:00000001:9.0:1773851862.963631:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.963631:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851862.963632:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851862.963633:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851862.963634:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851862.963635:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851862.963635:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851862.963636:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.963636:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851862.963637:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851862.963637:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.963638:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851862.963639:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851862.963640:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851862.963640:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851862.963640:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851862.963641:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25440@kfi7, seq: 2130767
00000100:00000001:11.0:1773851862.963642:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.963642:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009e71035b : new rpc_count 1
00000100:00000001:11.0:1773851862.963643:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.963643:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922906240 : -107141786645376 : ffff9e8e1bddcc80)
00000100:00000040:9.0:1773851862.963644:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007ee7a79d x1858044736915200/t0(0) o400->ff01d87d-c029-44ba-a41b-11c03ae2785c@25440@kfi7:589/0 lens 224/0 e 0 to 0 dl 1773851949 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2080-0'
00000100:00000001:9.0:1773851862.963646:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851862.963647:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851862.963647:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ee7a79d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:ff01d87d-c029-44ba-a41b-11c03ae2785c+6:39642:x1858044736915200:12345-25440@kfi7:400:default-tuolumne2080-0
00000100:00000200:9.0:1773851862.963649:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044736915200
00000020:00000001:9.0:1773851862.963649:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851862.963650:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851862.963651:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.963652:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851862.963652:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851862.963653:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851862.963654:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044736915200, found 0 last_xid 1858044736915199
00000020:00000001:9.0:1773851862.963655:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851862.963655:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851862.963656:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851862.963656:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.963657:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851862.963658:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851862.963658:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851862.963659:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008f78eeee.
02000000:00000001:9.0:1773851862.963660:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.963660:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.963661:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851862.963662:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105027828, transno 0, xid 1858044736915200
00010000:00000001:9.0:1773851862.963663:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851862.963664:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007ee7a79d x1858044736915200/t0(0) o400->ff01d87d-c029-44ba-a41b-11c03ae2785c@25440@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2080-0'
00010000:00000001:9.0:1773851862.963666:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851862.963667:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851862.963667:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=95 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851862.963668:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851862.963669:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000068e9ae9f refcount 3 to 25440@kfi7
00000100:00000001:9.0:1773851862.963670:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603211520 : -107155106340096 : ffff9e8b01f36300)
02000000:00000001:9.0:1773851862.963671:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851862.963671:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851862.963672:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851862.963673:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25441@kfi7
00000400:00000010:9.0:1773851862.963673:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000488434fa.
00000100:00000200:9.0:1773851862.963674:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044736915200, offset 224
00000400:00000200:9.0:1773851862.963675:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25441@kfi7
00000400:00000200:9.0:1773851862.963676:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25441@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.963677:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010b4b18d nid 25441@kfi7 refs 1
00000400:00000200:9.0:1773851862.963678:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000010b4b18d nid 25441@kfi7 refs 2
00000400:00000200:9.0:1773851862.963679:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000010b4b18d nid 25441@kfi7 refs 3
00000400:00000200:9.0:1773851862.963681:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25441@kfi7 local destination
00000400:00000200:9.0:1773851862.963682:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769058:8769058:1024:4294967295] 25441@kfi7 LPNI seq info [4063719:4063719:16:4294967295]
00000400:00000200:9.0:1773851862.963684:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000010b4b18d nid 25441@kfi7 refs 2
00000400:00000200:9.0:1773851862.963684:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25441@kfi7 to cpt 2
00000400:00000200:9.0:1773851862.963686:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25441@kfi7(25441@kfi7:25441@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851862.963687:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000010b4b18d nid 25441@kfi7 refs 3
00000800:00000200:9.0:1773851862.963688:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851862.963689:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851862.963691:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851862.963694:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d4d Using peer 25441@kfi7(0x100000000000d4d)
00000800:00000200:9.0:1773851862.963697:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x100000000000d4d: rc=0
00000800:00000200:9.0:1773851862.963698:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d4d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851862.963700:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851862.963701:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000068e9ae9f refcount 2 to 25440@kfi7
00010000:00000001:9.0:1773851862.963702:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851862.963703:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851862.963703:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851862.963704:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007ee7a79d x1858044736915200/t0(0) o400->ff01d87d-c029-44ba-a41b-11c03ae2785c@25440@kfi7:589/0 lens 224/224 e 0 to 0 dl 1773851949 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2080-0'
00000100:00100000:9.0:1773851862.963707:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ee7a79d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:ff01d87d-c029-44ba-a41b-11c03ae2785c+6:39642:x1858044736915200:12345-25440@kfi7:400:default-tuolumne2080-0 Request processed in 60us (94us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851862.963709:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25440@kfi7, seq: 2130767
00000100:00000040:9.0:1773851862.963710:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009e71035b : new rpc_count 0
00000800:00000200:10.0:1773851862.963711:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d4d TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851862.963711:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851862.963712:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851862.963712:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851862.963713:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851862.963713:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851862.963714:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25441@kfi7: PUT: OK
00000020:00000010:9.0:1773851862.963714:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851862.963715:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000488434fa
00000400:00000010:10.0:1773851862.963715:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000488434fa.
00000020:00000040:9.0:1773851862.963715:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000009e71035b : new refcount 5
00000100:00000001:10.0:1773851862.963716:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851862.963716:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851862.963716:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851862.963717:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000010b4b18d nid 25441@kfi7 refs 2
00000800:00000200:10.0:1773851862.963719:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25441@kfi7(00000000a3b99c25):0x0 lsk 3406 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d4d Transaction freed
00000800:00000200:17.0:1773851862.990935:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851862.990936:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851862.990937:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851862.990939:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851862.990941:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11770@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.990942:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11770@kfi7 : PUT - for me
00000400:00000200:17.0:1773851862.990943:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11770@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.990944:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8227508 nid 11770@kfi7 refs 1
00000400:00000200:17.0:1773851862.990945:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11770@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.990945:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8227508 nid 11770@kfi7 refs 2
00000400:00000200:17.0:1773851862.990947:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a8227508 nid 11770@kfi7 refs 3
00000400:00000200:17.0:1773851862.990948:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11770@kfi7 to cpt 4
00000400:00000200:17.0:1773851862.990949:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11770@kfi7 of length 440 into portal 12 MB=0x699de8cea7140
00000400:00000200:17.0:1773851862.990950:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11770@kfi7 of length 440/440 into md 0x6ab01b5d1 [64] + 4736
00000800:00000200:17.0:1773851862.990952:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851862.990953:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851862.990954:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11770@kfi7: PUT: OK
00000100:00000001:17.0:1773851862.990955:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851862.990955:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851862.990956:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008247c0fe.
00000100:00000040:17.0:1773851862.990957:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000008247c0fe x1858030986228032 msgsize 440
00000100:00100000:17.0:1773851862.990958:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-11770@kfi7 (source: 12345-11770@kfi7)
00000100:00000001:17.0:1773851862.990959:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851862.990960:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8227508 nid 11770@kfi7 refs 2
00000100:00000001:19.0:1773851862.990961:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851862.990961:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851862.990962:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851862.990962:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851862.990962:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851862.990963:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851862.990964:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030986228032
00000020:00000001:19.0:1773851862.990964:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851862.990965:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9113b
00000020:00000001:19.0:1773851862.990965:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851862.990967:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bd076807 refcount=6
00000020:00000001:19.0:1773851862.990967:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240343552 : -107152469208064 : ffff9e8b9f22d400)
00000020:00000001:19.0:1773851862.990968:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240343552 : -107152469208064 : ffff9e8b9f22d400)
00000100:00000001:19.0:1773851862.990969:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.990970:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851862.990970:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851862.990971:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851862.990972:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851862.990973:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851862.990973:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851862.990974:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.990974:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.990975:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851862.990976:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851862.990977:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851862.990977:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851862.990977:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851862.990978:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11770@kfi7, seq: 323103286
00000100:00000040:19.0:1773851862.990979:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bd076807 : new rpc_count 1
00000100:00000001:16.0:1773851862.990979:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.990980:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764342528 : -107095945209088 : ffff9e98c83a9b00)
00000100:00000001:16.0:1773851862.990980:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.990981:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008247c0fe x1858030986228032/t0(0) o41->cced01bb-930a-4bbc-a102-e3e13c8e8b37@11770@kfi7:114/0 lens 440/0 e 0 to 0 dl 1773852229 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne214-0'
00000100:00000001:19.0:1773851862.990987:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851862.990987:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851862.990988:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008247c0fe pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cced01bb-930a-4bbc-a102-e3e13c8e8b37+6:1849256:x1858030986228032:12345-11770@kfi7:41:default-tuolumne214-0
00000100:00000200:19.0:1773851862.990989:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030986228032
00000020:00000001:19.0:1773851862.990990:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851862.990990:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851862.990991:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.990992:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851862.990992:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:19.0:1773851862.990993:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851862.990994:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030986228032, found 0 last_xid 1858030986228031
00000020:00000001:19.0:1773851862.990995:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851862.990995:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851862.990996:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851862.990996:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.990997:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851862.990998:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851862.990999:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000ce3f562e.
02000000:00000001:19.0:1773851862.990999:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.991000:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991001:0:60961:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:19.0:1773851862.991002:0:60961:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:19.0:1773851862.991002:0:60961:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991004:0:60961:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:19.0:1773851862.991006:0:60961:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:19.0:1773851862.991008:0:60961:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991010:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:19.0:1773851862.991011:0:60961:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991012:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:19.0:1773851862.991013:0:60961:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991014:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:19.0:1773851862.991014:0:60961:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991015:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:19.0:1773851862.991016:0:60961:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991017:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:19.0:1773851862.991018:0:60961:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991020:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991020:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500123136 free, 351498040320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097760 files, 343261839 free files
00000004:00000001:19.0:1773851862.991022:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991023:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991024:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504356352 free, 351502185472 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056274 files, 343265973 free files
00000004:00000001:19.0:1773851862.991025:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991026:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991027:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690114048 free, 351687681024 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231248 files, 343447377 free files
00000004:00000001:19.0:1773851862.991028:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991029:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991030:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382730752 free, 351380667392 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978744 files, 343147198 free files
00000004:00000001:19.0:1773851862.991031:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991032:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991033:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350959050752 free, 350956926976 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371564114 files, 342733448 free files
00000004:00000001:19.0:1773851862.991034:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991035:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991036:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351236608 free, 351348468736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084109 files, 343116442 free files
00000004:00000001:19.0:1773851862.991037:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991038:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991038:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482231808 free, 351481182208 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097243 files, 343244367 free files
00000004:00000001:19.0:1773851862.991040:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991041:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991041:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449342976 free, 351446759424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372161050 files, 343212249 free files
00000004:00000001:19.0:1773851862.991043:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991043:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991044:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353644032 free, 351351203840 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083368 files, 343118793 free files
00000004:00000001:19.0:1773851862.991045:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991047:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991047:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351389027328 free, 351386313728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019207 files, 343153347 free files
00000004:00000001:19.0:1773851862.991048:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991049:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991050:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406587904 free, 351404219392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127340 files, 343170496 free files
00000004:00000001:19.0:1773851862.991051:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991052:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991053:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378948096 free, 351375970304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019050 files, 343143504 free files
00000004:00000001:19.0:1773851862.991054:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991055:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991055:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466027008 free, 351462859776 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062917 files, 343228542 free files
00000004:00000001:19.0:1773851862.991057:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991057:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991058:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489087488 free, 351486078976 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066885 files, 343251062 free files
00000004:00000001:19.0:1773851862.991059:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991060:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991061:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399726592 blocks, 351492777984 free, 351490345984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078129 files, 343254666 free files
00000004:00000001:19.0:1773851862.991062:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991063:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991064:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399719424 blocks, 351524111360 free, 351521354752 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113972 files, 343285265 free files
00000004:00000001:19.0:1773851862.991065:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991066:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991067:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510704128 free, 351508036608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095891 files, 343272172 free files
00000004:00000001:19.0:1773851862.991068:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991069:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991069:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541614592 free, 351539512320 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136793 files, 343302358 free files
00000004:00000001:19.0:1773851862.991071:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991073:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991073:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470736384 free, 351461714944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064608 files, 343233141 free files
00000004:00000001:19.0:1773851862.991074:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991075:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991075:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666737152 free, 351645490176 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237991 files, 343424548 free files
00000004:00000001:19.0:1773851862.991076:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991077:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991078:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545835520 free, 351536162816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116513 files, 343306480 free files
00000004:00000001:19.0:1773851862.991079:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991080:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991081:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603978240 free, 351601716224 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190526 files, 343363260 free files
00000004:00000001:19.0:1773851862.991082:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991083:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991083:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615864832 free, 351613251584 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043488 files, 343374868 free files
00000004:00000001:19.0:1773851862.991084:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991085:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991086:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420305408 free, 351417826304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372009077 files, 343183892 free files
00000004:00000001:19.0:1773851862.991087:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991088:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991088:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409117184 free, 351407043584 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011349 files, 343172966 free files
00000004:00000001:19.0:1773851862.991089:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991091:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991091:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480053760 free, 351478759424 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073195 files, 343242240 free files
00000004:00000001:19.0:1773851862.991092:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991093:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991094:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593720832 free, 351576860672 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190095 files, 343353243 free files
00000004:00000001:19.0:1773851862.991095:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991096:0:60961:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:19.0:1773851862.991097:0:60961:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464029184 free, 351458197504 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372060715 files, 343226591 free files
00000004:00000001:19.0:1773851862.991098:0:60961:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991098:0:60961:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991099:0:60961:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:19.0:1773851862.991100:0:60961:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 40309318020497408 avail 40308838406029312
00000004:00000020:19.0:1773851862.991102:0:60961:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841142094848 free, 9841024892992 avail; 10969026118 objects: 9610490327 free; state 100
00000020:00000001:19.0:1773851862.991104:0:60961:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:19.0:1773851862.991106:0:60961:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851862.991107:0:60961:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851862.991108:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767786, transno 0, xid 1858030986228032
00010000:00000001:19.0:1773851862.991109:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851862.991109:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008247c0fe x1858030986228032/t0(0) o41->cced01bb-930a-4bbc-a102-e3e13c8e8b37@11770@kfi7:114/0 lens 440/368 e 0 to 0 dl 1773852229 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne214-0'
00010000:00000001:19.0:1773851862.991112:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851862.991112:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851862.991113:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=95 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851862.991114:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851862.991115:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005cfbebc1 refcount 5 to 11770@kfi7
00000100:00000001:19.0:1773851862.991116:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992224 : -107142345559392 : ffff9e8dfa8d72a0)
02000000:00000001:19.0:1773851862.991117:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851862.991117:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851862.991118:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851862.991118:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11770@kfi7
00000400:00000010:19.0:1773851862.991119:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000851767a5.
00000100:00000200:19.0:1773851862.991120:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030986228032, offset 224
00000400:00000200:19.0:1773851862.991121:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11770@kfi7
00000400:00000200:19.0:1773851862.991122:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11770@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.991123:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8227508 nid 11770@kfi7 refs 1
00000400:00000200:19.0:1773851862.991124:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a8227508 nid 11770@kfi7 refs 2
00000400:00000200:19.0:1773851862.991125:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a8227508 nid 11770@kfi7 refs 3
00000400:00000200:19.0:1773851862.991126:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11770@kfi7 local destination
00000400:00000200:19.0:1773851862.991127:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769059:8769059:1024:4294967295] 11770@kfi7 LPNI seq info [28045:28045:16:4294967295]
00000400:00000200:19.0:1773851862.991129:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a8227508 nid 11770@kfi7 refs 2
00000400:00000200:19.0:1773851862.991130:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11770@kfi7 to cpt 4
00000400:00000200:19.0:1773851862.991132:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11770@kfi7(11770@kfi7:11770@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851862.991133:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a8227508 nid 11770@kfi7 refs 3
00000800:00000200:19.0:1773851862.991134:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851862.991135:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:19.0:1773851862.991137:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851862.991139:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003f4 Using peer 11770@kfi7(0x1000000000003f4)
00000800:00000200:19.0:1773851862.991143:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 468 bytes to peer 0x1000000000003f4: rc=0
00000800:00000200:19.0:1773851862.991144:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003f4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851862.991146:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851862.991147:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005cfbebc1 refcount 4 to 11770@kfi7
00010000:00000001:19.0:1773851862.991148:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851862.991148:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851862.991149:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851862.991150:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008247c0fe x1858030986228032/t0(0) o41->cced01bb-930a-4bbc-a102-e3e13c8e8b37@11770@kfi7:114/0 lens 440/368 e 0 to 0 dl 1773852229 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne214-0'
00000100:00100000:19.0:1773851862.991153:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008247c0fe pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cced01bb-930a-4bbc-a102-e3e13c8e8b37+6:1849256:x1858030986228032:12345-11770@kfi7:41:default-tuolumne214-0 Request processed in 165us (195us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851862.991155:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11770@kfi7, seq: 323103286
00000100:00000040:19.0:1773851862.991156:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bd076807 : new rpc_count 0
00000800:00000200:17.0:1773851862.991156:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003f4 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851862.991157:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851862.991157:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851862.991157:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851862.991158:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851862.991158:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11770@kfi7: PUT: OK
00000020:00000010:19.0:1773851862.991159:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000400:00000200:17.0:1773851862.991159:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000851767a5
00000020:00000010:19.0:1773851862.991160:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000020:00000040:19.0:1773851862.991160:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000bd076807 : new refcount 5
00000400:00000010:17.0:1773851862.991160:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000851767a5.
00000100:00000001:17.0:1773851862.991160:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851862.991161:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851862.991161:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851862.991162:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8227508 nid 11770@kfi7 refs 2
00000800:00000200:17.0:1773851862.991163:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 11770@kfi7(00000000cea5cc97):0x0 lsk 1013 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003f4 Transaction freed
00000800:00000200:5.0:1773851863.034305:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.034306:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851863.034307:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851863.034309:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851863.034311:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11298@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.034312:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11298@kfi7 : PUT - for me
00000400:00000200:5.0:1773851863.034313:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11298@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.034314:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f71112a nid 11298@kfi7 refs 1
00000400:00000200:5.0:1773851863.034315:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11298@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.034316:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f71112a nid 11298@kfi7 refs 2
00000400:00000200:5.0:1773851863.034317:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000f71112a nid 11298@kfi7 refs 3
00000400:00000200:5.0:1773851863.034318:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11490@kfi7 to cpt 4
00000400:00000200:5.0:1773851863.034319:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11490@kfi7 of length 224 into portal 12 MB=0x69b4bfd232e00
00000400:00000200:5.0:1773851863.034320:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11490@kfi7 of length 224/224 into md 0x793926dc5 [64] + 130520
00000800:00000200:5.0:1773851863.034322:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851863.034324:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851863.034325:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11298@kfi7: PUT: OK
00000100:00000001:5.0:1773851863.034326:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851863.034327:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851863.034328:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005f382d65.
00000100:00000040:5.0:1773851863.034328:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000005f382d65 x1859600532057600 msgsize 224
00000100:00100000:5.0:1773851863.034330:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-11490@kfi7 (source: 12345-11298@kfi7)
00000100:00000001:5.0:1773851863.034331:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851863.034332:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851863.034332:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000f71112a nid 11298@kfi7 refs 2
02000000:00000001:7.0:1773851863.034333:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851863.034333:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851863.034334:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851863.034334:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851863.034335:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851863.034336:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600532057600
00000020:00000001:7.0:1773851863.034336:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851863.034337:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7e2c9
00000020:00000001:7.0:1773851863.034337:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851863.034340:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007390e510 refcount=5
00000020:00000001:7.0:1773851863.034341:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118949155840 : -106954760395776 : ffff9eb9a77fe400)
00000020:00000001:7.0:1773851863.034341:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118949155840 : -106954760395776 : ffff9eb9a77fe400)
00000100:00000001:7.0:1773851863.034342:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851863.034343:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851863.034344:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f72fd39.
00000020:00000010:7.0:1773851863.034345:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851863.034346:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851863.034347:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851863.034347:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851863.034348:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.034349:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851863.034350:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851863.034350:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.034351:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.034353:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851863.034353:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851863.034353:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851863.034353:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851863.034354:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11490@kfi7, seq: 2001896
00000100:00000040:7.0:1773851863.034355:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007390e510 : new rpc_count 1
00000100:00000001:5.0:1773851863.034355:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.034356:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136106904064 : -106937602647552 : ffff9ebda62e5a00)
00000100:00000001:5.0:1773851863.034356:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851863.034357:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005f382d65 x1859600532057600/t0(0) o400->be1b9c2d-c49a-4bfb-8458-68dbbfe94e8d@11490@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1195-0'
00000100:00000001:7.0:1773851863.034360:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851863.034360:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851863.034361:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f382d65 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:be1b9c2d-c49a-4bfb-8458-68dbbfe94e8d+5:39481:x1859600532057600:12345-11490@kfi7:400:default-tuolumne1195-0
00000100:00000200:7.0:1773851863.034363:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600532057600
00000020:00000001:7.0:1773851863.034363:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851863.034364:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851863.034365:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.034365:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851863.034366:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851863.034367:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851863.034368:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600532057600, found 0 last_xid 1859600532057599
00000020:00000001:7.0:1773851863.034368:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851863.034369:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851863.034370:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851863.034370:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.034371:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851863.034371:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851863.034372:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851863.034373:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f355abbe.
02000000:00000001:7.0:1773851863.034373:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.034374:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.034378:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851863.034378:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035343249, transno 0, xid 1859600532057600
00010000:00000001:7.0:1773851863.034379:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851863.034380:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005f382d65 x1859600532057600/t0(0) o400->be1b9c2d-c49a-4bfb-8458-68dbbfe94e8d@11490@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1195-0'
00010000:00000001:7.0:1773851863.034382:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851863.034383:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851863.034383:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=95 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851863.034385:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851863.034385:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002746893d refcount 3 to 11490@kfi7
00000100:00000001:7.0:1773851863.034386:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333568 : -107155408218048 : ffff9e8aeff51840)
02000000:00000001:7.0:1773851863.034387:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851863.034387:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.034388:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851863.034389:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11298@kfi7
00000400:00000010:7.0:1773851863.034390:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000100:00000200:7.0:1773851863.034391:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600532057600, offset 224
00000400:00000200:7.0:1773851863.034392:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11298@kfi7
00000400:00000200:7.0:1773851863.034393:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11298@kfi7 to cpt 1
00000400:00000200:7.0:1773851863.034394:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f71112a nid 11298@kfi7 refs 1
00000400:00000200:7.0:1773851863.034395:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000f71112a nid 11298@kfi7 refs 2
00000400:00000200:7.0:1773851863.034396:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000f71112a nid 11298@kfi7 refs 3
00000400:00000200:7.0:1773851863.034397:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11298@kfi7 local destination
00000400:00000200:7.0:1773851863.034398:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769060:8769060:1024:4294967295] 11298@kfi7 LPNI seq info [268229:268229:16:4294967295]
00000400:00000200:7.0:1773851863.034400:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000f71112a nid 11298@kfi7 refs 2
00000400:00000200:7.0:1773851863.034400:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11298@kfi7 to cpt 1
00000400:00000200:7.0:1773851863.034402:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11298@kfi7(11298@kfi7:11298@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851863.034403:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000f71112a nid 11298@kfi7 refs 3
00000800:00000200:7.0:1773851863.034405:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851863.034406:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851863.034408:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851863.034411:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000523 Using peer 11298@kfi7(0x100000000000523)
00000800:00000200:7.0:1773851863.034414:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x100000000000523: rc=0
00000800:00000200:7.0:1773851863.034415:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000523 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851863.034417:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851863.034418:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002746893d refcount 2 to 11490@kfi7
00010000:00000001:7.0:1773851863.034419:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851863.034419:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.034420:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851863.034421:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005f382d65 x1859600532057600/t0(0) o400->be1b9c2d-c49a-4bfb-8458-68dbbfe94e8d@11490@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1195-0'
00000100:00100000:7.0:1773851863.034424:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f382d65 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:be1b9c2d-c49a-4bfb-8458-68dbbfe94e8d+5:39481:x1859600532057600:12345-11490@kfi7:400:default-tuolumne1195-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851863.034426:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11490@kfi7, seq: 2001896
00000800:00000200:5.0:1773851863.034427:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000523 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851863.034428:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007390e510 : new rpc_count 0
00000100:00000001:7.0:1773851863.034428:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851863.034429:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851863.034429:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851863.034429:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851863.034430:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000400:00000200:5.0:1773851863.034430:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11298@kfi7: PUT: OK
00000020:00000010:7.0:1773851863.034431:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f72fd39.
00000400:00000200:5.0:1773851863.034431:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000400:00000010:5.0:1773851863.034431:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000020:00000040:7.0:1773851863.034432:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000007390e510 : new refcount 4
00000100:00000001:7.0:1773851863.034432:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851863.034432:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851863.034433:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851863.034434:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000f71112a nid 11298@kfi7 refs 2
00000800:00000200:5.0:1773851863.034435:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 11298@kfi7(000000004cfdabfc):0x0 lsk 1316 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000523 Transaction freed
00000800:00000200:13.0:1773851863.040886:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851863.040887:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851863.040888:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851863.040891:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851863.040893:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24818@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.040894:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24818@kfi7 : PUT - for me
00000400:00000200:13.0:1773851863.040895:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24818@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.040897:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000001d558f nid 24818@kfi7 refs 1
00000400:00000200:13.0:1773851863.040898:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24818@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.040899:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000001d558f nid 24818@kfi7 refs 2
00000400:00000200:13.0:1773851863.040900:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000001d558f nid 24818@kfi7 refs 3
00000400:00000200:13.0:1773851863.040901:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24627@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.040902:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24627@kfi7 of length 224 into portal 12 MB=0x699e172fb54c0
00000400:00000200:13.0:1773851863.040903:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24627@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 25320
00000800:00000200:13.0:1773851863.040905:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851863.040907:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851863.040908:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24818@kfi7: PUT: OK
00000100:00000001:13.0:1773851863.040909:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851863.040909:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851863.040911:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000089c8d317.
00000100:00000040:13.0:1773851863.040911:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000089c8d317 x1858043436029120 msgsize 224
00000100:00100000:13.0:1773851863.040913:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24627@kfi7 (source: 12345-24818@kfi7)
00000100:00000001:13.0:1773851863.040915:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851863.040916:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000001d558f nid 24818@kfi7 refs 2
00000800:00000200:13.0:1773851863.040917:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2054@kfi7:3 <- 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851863.040920:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851863.040921:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851863.040921:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851863.040922:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851863.040923:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851863.040924:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043436029120
00000020:00000001:13.0:1773851863.040924:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851863.040925:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924f9
00000020:00000001:13.0:1773851863.040925:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851863.040929:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001e16eaec refcount=6
00000020:00000001:13.0:1773851863.040930:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630790144 : -107123078761472 : ffff9e9276f17400)
00000020:00000001:13.0:1773851863.040931:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630790144 : -107123078761472 : ffff9e9276f17400)
00000100:00000001:13.0:1773851863.040932:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851863.040933:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851863.040934:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092eb84b1.
00000020:00000010:13.0:1773851863.040935:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851863.040936:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009802e6cf.
00000100:00000001:13.0:1773851863.040937:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851863.040937:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851863.040938:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851863.040939:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851863.040939:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851863.040940:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.040941:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851863.040943:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851863.040943:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851863.040943:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851863.040943:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851863.040944:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24627@kfi7, seq: 2289819
00000100:00000001:15.0:1773851863.040945:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851863.040945:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001e16eaec : new rpc_count 1
00000100:00000001:15.0:1773851863.040946:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.040946:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637152534622336 : -106921174929280 : ffff9ec179597080)
00000100:00000040:13.0:1773851863.040947:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000089c8d317 x1858043436029120/t0(0) o400->8c42733a-1d15-4eb1-9053-db8c6b6119ce@24627@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2025-0'
00000100:00000001:13.0:1773851863.040949:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851863.040950:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851863.040951:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089c8d317 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:8c42733a-1d15-4eb1-9053-db8c6b6119ce+6:39845:x1858043436029120:12345-24627@kfi7:400:default-tuolumne2025-0
00000100:00000200:13.0:1773851863.040952:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043436029120
00000020:00000001:13.0:1773851863.040953:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851863.040953:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851863.040954:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.040955:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851863.040955:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851863.040956:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851863.040957:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043436029120, found 0 last_xid 1858043436029119
00000020:00000001:13.0:1773851863.040957:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851863.040958:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851863.040959:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851863.040959:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.040961:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851863.040961:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851863.040962:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851863.040962:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fb3b1532.
02000000:00000001:13.0:1773851863.040963:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.040964:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.040964:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851863.040965:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915826494, transno 0, xid 1858043436029120
00010000:00000001:13.0:1773851863.040966:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851863.040967:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000089c8d317 x1858043436029120/t0(0) o400->8c42733a-1d15-4eb1-9053-db8c6b6119ce@24627@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2025-0'
00010000:00000001:13.0:1773851863.040969:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851863.040970:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851863.040971:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=96 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851863.040972:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851863.040972:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000004598d7a refcount 3 to 24627@kfi7
00000100:00000001:13.0:1773851863.040973:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149824 : -107154898401792 : ffff9e8b0e584600)
02000000:00000001:13.0:1773851863.040974:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851863.040974:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.040975:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851863.040976:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24818@kfi7
00000400:00000010:13.0:1773851863.040977:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000077b1e550.
00000100:00000200:13.0:1773851863.040978:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043436029120, offset 224
00000400:00000200:13.0:1773851863.040979:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24818@kfi7
00000400:00000200:13.0:1773851863.040980:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24818@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.040981:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000001d558f nid 24818@kfi7 refs 1
00000400:00000200:13.0:1773851863.040982:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000001d558f nid 24818@kfi7 refs 2
00000400:00000200:13.0:1773851863.040983:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000001d558f nid 24818@kfi7 refs 3
00000400:00000200:13.0:1773851863.040984:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24818@kfi7 local destination
00000400:00000200:13.0:1773851863.040986:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769061:8769061:1024:4294967295] 24818@kfi7 LPNI seq info [8548837:8548837:16:4294967295]
00000400:00000200:13.0:1773851863.040987:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000001d558f nid 24818@kfi7 refs 2
00000400:00000200:13.0:1773851863.040988:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24818@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.040990:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24818@kfi7(24818@kfi7:24818@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851863.040992:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000001d558f nid 24818@kfi7 refs 3
00000800:00000200:13.0:1773851863.040993:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851863.040994:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851863.040996:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851863.040999:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000257 Using peer 24818@kfi7(0x100000000000257)
00000800:00000200:13.0:1773851863.041002:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 324 bytes to peer 0x100000000000257: rc=0
00000800:00000200:13.0:1773851863.041003:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000257 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851863.041005:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851863.041006:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000004598d7a refcount 2 to 24627@kfi7
00010000:00000001:13.0:1773851863.041007:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851863.041007:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.041008:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851863.041009:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000089c8d317 x1858043436029120/t0(0) o400->8c42733a-1d15-4eb1-9053-db8c6b6119ce@24627@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2025-0'
00000100:00100000:13.0:1773851863.041011:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089c8d317 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:8c42733a-1d15-4eb1-9053-db8c6b6119ce+6:39845:x1858043436029120:12345-24627@kfi7:400:default-tuolumne2025-0 Request processed in 61us (99us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851863.041014:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24627@kfi7, seq: 2289819
00000100:00000040:13.0:1773851863.041015:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001e16eaec : new rpc_count 0
00000800:00000200:14.0:1773851863.041016:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000257 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851863.041016:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851863.041016:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851863.041017:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851863.041017:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851863.041017:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009802e6cf.
00000400:00000200:14.0:1773851863.041018:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24818@kfi7: PUT: OK
00000020:00000010:13.0:1773851863.041018:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092eb84b1.
00000400:00000200:14.0:1773851863.041019:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000077b1e550
00000020:00000040:13.0:1773851863.041019:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000001e16eaec : new refcount 5
00000400:00000010:14.0:1773851863.041020:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000077b1e550.
00000100:00000001:14.0:1773851863.041020:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851863.041020:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851863.041021:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851863.041022:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000001d558f nid 24818@kfi7 refs 2
00000800:00000200:14.0:1773851863.041023:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2054@kfi7:3 -> 24818@kfi7(000000009647948a):0x0 lsk 600 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000257 Transaction freed
00000800:00000200:9.0:1773851863.043831:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.043833:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851863.043835:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851863.043839:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851863.043843:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10746@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.043845:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10746@kfi7 : PUT - for me
00000400:00000200:9.0:1773851863.043847:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10746@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.043849:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000843886c5 nid 10746@kfi7 refs 1
00000400:00000200:9.0:1773851863.043850:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10746@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.043852:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000843886c5 nid 10746@kfi7 refs 2
00000400:00000200:9.0:1773851863.043853:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000843886c5 nid 10746@kfi7 refs 3
00000400:00000200:9.0:1773851863.043855:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10747@kfi7 to cpt 6
00000400:00000200:9.0:1773851863.043857:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10747@kfi7 of length 224 into portal 12 MB=0x699de8d75d8c0
00000400:00000200:9.0:1773851863.043859:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10747@kfi7 of length 224/224 into md 0x78146ce49 [64] + 131728
00000800:00000200:9.0:1773851863.043863:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851863.043866:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851863.043868:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10746@kfi7: PUT: OK
00000100:00000001:9.0:1773851863.043870:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851863.043871:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851863.043872:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000c9a83eb.
00000100:00000040:9.0:1773851863.043874:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000000c9a83eb x1858030995364032 msgsize 224
00000100:00100000:9.0:1773851863.043877:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10747@kfi7 (source: 12345-10746@kfi7)
00000100:00000001:9.0:1773851863.043880:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851863.043881:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000843886c5 nid 10746@kfi7 refs 2
00000800:00000200:9.0:1773851863.043884:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851863.043889:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851863.043890:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851863.043891:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851863.043892:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.043893:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851863.043895:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030995364032
00000020:00000001:9.0:1773851863.043896:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851863.043896:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ff9
00000020:00000001:9.0:1773851863.043898:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851863.043902:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000658d923a refcount=6
00000020:00000001:9.0:1773851863.043903:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240107008 : -107152469444608 : ffff9e8b9f1f3800)
00000020:00000001:9.0:1773851863.043905:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240107008 : -107152469444608 : ffff9e8b9f1f3800)
00000100:00000001:9.0:1773851863.043907:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.043908:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851863.043909:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851863.043911:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.043913:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851863.043914:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851863.043915:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851863.043916:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.043917:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851863.043918:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851863.043919:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.043920:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851863.043922:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851863.043922:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851863.043923:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851863.043923:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851863.043924:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10747@kfi7, seq: 2130768
00000100:00000040:9.0:1773851863.043925:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000658d923a : new rpc_count 1
00000100:00000001:11.0:1773851863.043926:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851863.043927:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.043927:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922890112 : -107141786661504 : ffff9e8e1bdd8d80)
00000100:00000040:9.0:1773851863.043928:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000c9a83eb x1858030995364032/t0(0) o400->da393bf3-b92d-45b1-addf-2da95f05f375@10747@kfi7:80/0 lens 224/0 e 0 to 0 dl 1773852195 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne210-0'
00000100:00000001:9.0:1773851863.043934:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.043934:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851863.043936:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c9a83eb pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:da393bf3-b92d-45b1-addf-2da95f05f375+6:47971:x1858030995364032:12345-10747@kfi7:400:default-tuolumne210-0
00000100:00000200:9.0:1773851863.043938:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030995364032
00000020:00000001:9.0:1773851863.043939:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851863.043940:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851863.043941:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.043942:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851863.043943:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851863.043944:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851863.043945:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030995364032, found 0 last_xid 1858030995364031
00000020:00000001:9.0:1773851863.043946:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851863.043947:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851863.043948:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851863.043949:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.043950:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851863.043951:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851863.043952:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851863.043953:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000039038d05.
02000000:00000001:9.0:1773851863.043954:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.043955:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.043956:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851863.043957:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030995364032
00010000:00000001:9.0:1773851863.043958:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851863.043960:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000c9a83eb x1858030995364032/t0(0) o400->da393bf3-b92d-45b1-addf-2da95f05f375@10747@kfi7:80/0 lens 224/224 e 0 to 0 dl 1773852195 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne210-0'
00010000:00000001:9.0:1773851863.043963:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851863.043964:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851863.043965:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=96 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851863.043967:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851863.043968:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d277b6ca refcount 5 to 10747@kfi7
00000100:00000001:9.0:1773851863.043970:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923993439328 : -107149716112288 : ffff9e8c433bbc60)
02000000:00000001:9.0:1773851863.043972:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851863.043972:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.043973:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851863.043975:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10746@kfi7
00000400:00000010:9.0:1773851863.043976:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001df4b781.
00000100:00000200:9.0:1773851863.043977:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030995364032, offset 224
00000400:00000200:9.0:1773851863.043979:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10746@kfi7
00000400:00000200:9.0:1773851863.043981:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10746@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.043982:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000843886c5 nid 10746@kfi7 refs 1
00000400:00000200:9.0:1773851863.043983:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000843886c5 nid 10746@kfi7 refs 2
00000400:00000200:9.0:1773851863.043985:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000843886c5 nid 10746@kfi7 refs 3
00000400:00000200:9.0:1773851863.043987:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10746@kfi7 local destination
00000400:00000200:9.0:1773851863.043990:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769062:8769062:1024:4294967295] 10746@kfi7 LPNI seq info [24406:24406:16:4294967295]
00000400:00000200:9.0:1773851863.043992:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000843886c5 nid 10746@kfi7 refs 2
00000400:00000200:9.0:1773851863.043993:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10746@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.043996:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10746@kfi7(10746@kfi7:10746@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851863.043998:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000843886c5 nid 10746@kfi7 refs 3
00000800:00000200:9.0:1773851863.044001:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.044002:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.044006:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851863.044009:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009f3 Using peer 10746@kfi7(0x1000000000009f3)
00000800:00000200:9.0:1773851863.044014:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x1000000000009f3: rc=0
00000800:00000200:9.0:1773851863.044017:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851863.044020:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.044021:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d277b6ca refcount 4 to 10747@kfi7
00010000:00000001:9.0:1773851863.044022:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851863.044024:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.044025:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851863.044026:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000c9a83eb x1858030995364032/t0(0) o400->da393bf3-b92d-45b1-addf-2da95f05f375@10747@kfi7:80/0 lens 224/224 e 0 to 0 dl 1773852195 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne210-0'
00000100:00100000:9.0:1773851863.044031:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c9a83eb pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:da393bf3-b92d-45b1-addf-2da95f05f375+6:47971:x1858030995364032:12345-10747@kfi7:400:default-tuolumne210-0 Request processed in 96us (156us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851863.044032:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009f3 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851863.044035:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:9.0:1773851863.044035:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10747@kfi7, seq: 2130768
00000400:00000200:10.0:1773851863.044036:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10746@kfi7: PUT: OK
00000100:00000040:9.0:1773851863.044036:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000658d923a : new rpc_count 0
00000100:00000001:9.0:1773851863.044037:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851863.044038:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001df4b781
00000400:00000010:10.0:1773851863.044038:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001df4b781.
00000100:00000001:9.0:1773851863.044038:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851863.044039:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000100:00000001:10.0:1773851863.044040:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851863.044040:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:9.0:1773851863.044040:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000020:00000010:9.0:1773851863.044041:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851863.044042:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000843886c5 nid 10746@kfi7 refs 2
00000020:00000040:9.0:1773851863.044042:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000658d923a : new refcount 5
00000800:00000200:10.0:1773851863.044044:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 10746@kfi7(0000000079e518ae):0x0 lsk 2548 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009f3 Transaction freed
00000100:00000001:9.0:1773851863.044044:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851863.044121:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851863.044122:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851863.044125:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851863.044128:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851863.044132:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10747@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.044134:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10747@kfi7 : PUT - for me
00000400:00000200:25.0:1773851863.044135:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10747@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.044137:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b82ee21 nid 10747@kfi7 refs 1
00000400:00000200:25.0:1773851863.044138:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10747@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.044139:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b82ee21 nid 10747@kfi7 refs 2
00000400:00000200:25.0:1773851863.044141:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b82ee21 nid 10747@kfi7 refs 3
00000400:00000200:25.0:1773851863.044142:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10747@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.044144:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10747@kfi7 of length 224 into portal 12 MB=0x699de8d75e040
00000400:00000200:25.0:1773851863.044146:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10747@kfi7 of length 224/224 into md 0x16159c9699 [64] + 672
00000800:00000200:25.0:1773851863.044149:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851863.044151:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851863.044153:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10747@kfi7: PUT: OK
00000100:00000001:25.0:1773851863.044155:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851863.044156:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851863.044157:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b61f28b9.
00000100:00000040:25.0:1773851863.044158:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b61f28b9 x1858030995365952 msgsize 224
00000100:00100000:25.0:1773851863.044161:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10747@kfi7 (source: 12345-10747@kfi7)
00000100:00000001:25.0:1773851863.044163:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851863.044164:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b82ee21 nid 10747@kfi7 refs 2
00000800:00000200:25.0:1773851863.044167:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851863.044171:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851863.044172:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851863.044173:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851863.044173:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851863.044175:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851863.044176:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030995365952
00000020:00000001:25.0:1773851863.044177:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851863.044177:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9136b
00000020:00000001:25.0:1773851863.044179:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851863.044182:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008651a9e7 refcount=6
00000020:00000001:25.0:1773851863.044183:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169314304 : -107127540237312 : ffff9e916d04bc00)
00000020:00000001:25.0:1773851863.044184:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169314304 : -107127540237312 : ffff9e916d04bc00)
00000100:00000001:25.0:1773851863.044186:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851863.044187:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851863.044188:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000212fefaf.
00000020:00000010:25.0:1773851863.044189:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851863.044191:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094918347.
00000100:00000001:25.0:1773851863.044192:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851863.044193:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851863.044194:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851863.044195:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851863.044196:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851863.044196:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.044198:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851863.044200:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851863.044200:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851863.044200:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851863.044201:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851863.044202:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10747@kfi7, seq: 2025084
00000100:00000040:25.0:1773851863.044204:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008651a9e7 : new rpc_count 1
00000100:00000001:24.0:1773851863.044204:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.044205:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478770816 : -106938230780800 : ffff9ebd80bdcc80)
00000100:00000001:24.0:1773851863.044205:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851863.044207:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b61f28b9 x1858030995365952/t0(0) o400->8bfbcbd7-2778-429a-bc3b-f8ff51d17592@10747@kfi7:80/0 lens 224/0 e 0 to 0 dl 1773852195 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne210-0'
00000100:00000001:25.0:1773851863.044211:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851863.044212:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851863.044213:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b61f28b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:8bfbcbd7-2778-429a-bc3b-f8ff51d17592+6:47969:x1858030995365952:12345-10747@kfi7:400:default-tuolumne210-0
00000100:00000200:25.0:1773851863.044215:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030995365952
00000020:00000001:25.0:1773851863.044216:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851863.044217:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851863.044218:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.044219:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851863.044220:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851863.044221:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851863.044222:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030995365952, found 0 last_xid 1858030995365951
00000020:00000001:25.0:1773851863.044223:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851863.044224:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851863.044225:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851863.044226:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.044227:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851863.044227:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851863.044228:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851863.044229:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000072fb7443.
02000000:00000001:25.0:1773851863.044230:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.044231:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.044232:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851863.044233:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768352, transno 0, xid 1858030995365952
00010000:00000001:25.0:1773851863.044234:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851863.044235:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b61f28b9 x1858030995365952/t0(0) o400->8bfbcbd7-2778-429a-bc3b-f8ff51d17592@10747@kfi7:80/0 lens 224/224 e 0 to 0 dl 1773852195 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne210-0'
00010000:00000001:25.0:1773851863.044240:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851863.044240:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851863.044242:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=96 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851863.044244:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851863.044245:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d277b6ca refcount 5 to 10747@kfi7
00000100:00000001:25.0:1773851863.044246:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923993439328 : -107149716112288 : ffff9e8c433bbc60)
02000000:00000001:25.0:1773851863.044248:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851863.044248:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.044249:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851863.044251:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10747@kfi7
00000400:00000010:25.0:1773851863.044252:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000010a804c.
00000100:00000200:25.0:1773851863.044253:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030995365952, offset 224
00000400:00000200:25.0:1773851863.044255:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10747@kfi7
00000400:00000200:25.0:1773851863.044256:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10747@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.044257:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b82ee21 nid 10747@kfi7 refs 1
00000400:00000200:25.0:1773851863.044259:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b82ee21 nid 10747@kfi7 refs 2
00000400:00000200:25.0:1773851863.044260:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b82ee21 nid 10747@kfi7 refs 3
00000400:00000200:25.0:1773851863.044262:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10747@kfi7 local destination
00000400:00000200:25.0:1773851863.044264:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769063:8769063:1024:4294967295] 10747@kfi7 LPNI seq info [24407:24407:16:4294967295]
00000400:00000200:25.0:1773851863.044267:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b82ee21 nid 10747@kfi7 refs 2
00000400:00000200:25.0:1773851863.044268:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10747@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.044271:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10747@kfi7(10747@kfi7:10747@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851863.044273:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b82ee21 nid 10747@kfi7 refs 3
00000800:00000200:25.0:1773851863.044275:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851863.044277:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851863.044280:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851863.044284:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b Using peer 10747@kfi7(0x3b)
00000800:00000200:25.0:1773851863.044288:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 324 bytes to peer 0x3b: rc=0
00000800:00000200:25.0:1773851863.044291:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851863.044297:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851863.044298:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d277b6ca refcount 4 to 10747@kfi7
00010000:00000001:25.0:1773851863.044299:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851863.044300:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.044301:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851863.044303:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b61f28b9 x1858030995365952/t0(0) o400->8bfbcbd7-2778-429a-bc3b-f8ff51d17592@10747@kfi7:80/0 lens 224/224 e 0 to 0 dl 1773852195 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne210-0'
00000800:00000200:27.0:1773851863.044306:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b TN_EVENT_TX_OK event status 0
00000100:00100000:25.0:1773851863.044308:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b61f28b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:8bfbcbd7-2778-429a-bc3b-f8ff51d17592+6:47969:x1858030995365952:12345-10747@kfi7:400:default-tuolumne210-0 Request processed in 95us (148us total) trans 0 rc 0/0
00000400:00000200:27.0:1773851863.044309:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851863.044310:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10747@kfi7: PUT: OK
00000100:00100000:25.0:1773851863.044311:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10747@kfi7, seq: 2025084
00000400:00000200:27.0:1773851863.044312:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000010a804c
00000400:00000010:27.0:1773851863.044312:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000010a804c.
00000100:00000040:25.0:1773851863.044313:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008651a9e7 : new rpc_count 0
00000100:00000001:27.0:1773851863.044314:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851863.044314:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:25.0:1773851863.044314:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:27.0:1773851863.044315:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b82ee21 nid 10747@kfi7 refs 2
00000100:00000001:25.0:1773851863.044315:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851863.044315:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851863.044316:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094918347.
00000800:00000200:27.0:1773851863.044318:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 10747@kfi7(00000000d0290249):0x0 lsk 60 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b Transaction freed
00000020:00000010:25.0:1773851863.044318:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000212fefaf.
00000020:00000040:25.0:1773851863.044319:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000008651a9e7 : new refcount 5
00000100:00000001:25.0:1773851863.044320:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851863.075860:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851863.075860:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851863.075862:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851863.075864:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851863.075866:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23890@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.075867:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23890@kfi7 : PUT - for me
00000400:00000200:29.0:1773851863.075868:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23890@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.075869:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0875795 nid 23890@kfi7 refs 1
00000400:00000200:29.0:1773851863.075871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23890@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.075871:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0875795 nid 23890@kfi7 refs 2
00000400:00000200:29.0:1773851863.075872:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f0875795 nid 23890@kfi7 refs 3
00000400:00000200:29.0:1773851863.075873:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23890@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.075874:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23890@kfi7 of length 224 into portal 12 MB=0x69b465f460b80
00000400:00000200:29.0:1773851863.075875:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23890@kfi7 of length 224/224 into md 0x77fe139dd [64] + 171944
00000800:00000200:29.0:1773851863.075877:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851863.075879:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851863.075880:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23890@kfi7: PUT: OK
00000100:00000001:29.0:1773851863.075881:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851863.075881:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851863.075882:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000863ffac5.
00000100:00000040:29.0:1773851863.075883:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000863ffac5 x1859576408705920 msgsize 224
00000100:00100000:29.0:1773851863.075884:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23890@kfi7 (source: 12345-23890@kfi7)
00000100:00000001:29.0:1773851863.075885:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851863.075886:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0875795 nid 23890@kfi7 refs 2
00000800:00000200:29.0:1773851863.075887:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851863.075888:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851863.075890:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851863.075891:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851863.075892:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851863.075893:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851863.075894:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576408705920
00000020:00000001:28.0:1773851863.075895:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851863.075896:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc31a796a
00000020:00000001:28.0:1773851863.075897:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851863.075901:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000034f737bc refcount=5
00000020:00000001:28.0:1773851863.075902:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143376714752 : -106930332836864 : ffff9ebf577edc00)
00000020:00000001:28.0:1773851863.075903:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143376714752 : -106930332836864 : ffff9ebf577edc00)
00000100:00000001:28.0:1773851863.075905:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851863.075906:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851863.075907:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000021731e2.
00000020:00000010:28.0:1773851863.075908:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851863.075909:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d66f3d8.
00000100:00000001:28.0:1773851863.075911:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851863.075911:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851863.075912:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851863.075914:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851863.075915:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851863.075916:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851863.075917:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.075919:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851863.075919:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851863.075920:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851863.075920:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851863.075921:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23890@kfi7, seq: 2055504
00000100:00000040:31.0:1773851863.075922:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000034f737bc : new rpc_count 1
00000100:00000001:28.0:1773851863.075922:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.075923:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343719168 : -106994365832448 : ffff9eb06ed4e300)
00000100:00000001:28.0:1773851863.075923:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851863.075924:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000863ffac5 x1859576408705920/t0(0) o400->74356ed7-bca1-426d-b19a-4b90e4100c4c@23890@kfi7:651/0 lens 224/0 e 0 to 0 dl 1773852011 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1990-0'
00000100:00000001:31.0:1773851863.075927:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851863.075927:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851863.075928:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000863ffac5 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:74356ed7-bca1-426d-b19a-4b90e4100c4c+5:39915:x1859576408705920:12345-23890@kfi7:400:default-tuolumne1990-0
00000100:00000200:31.0:1773851863.075929:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576408705920
00000020:00000001:31.0:1773851863.075930:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851863.075931:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851863.075931:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.075932:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851863.075932:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851863.075933:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851863.075934:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576408705920, found 0 last_xid 1859576408705919
00000020:00000001:31.0:1773851863.075935:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851863.075936:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851863.075936:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851863.075937:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.075938:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851863.075938:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851863.075939:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851863.075939:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000082af503b.
02000000:00000001:31.0:1773851863.075940:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.075941:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.075941:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851863.075942:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263920693, transno 0, xid 1859576408705920
00010000:00000001:31.0:1773851863.075943:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851863.075944:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000863ffac5 x1859576408705920/t0(0) o400->74356ed7-bca1-426d-b19a-4b90e4100c4c@23890@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1990-0'
00010000:00000001:31.0:1773851863.075946:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851863.075947:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851863.075947:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=96 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851863.075948:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851863.075949:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a94e99fc refcount 3 to 23890@kfi7
00000100:00000001:31.0:1773851863.075950:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603211808 : -107155106339808 : ffff9e8b01f36420)
02000000:00000001:31.0:1773851863.075951:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851863.075951:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.075952:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851863.075953:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23890@kfi7
00000400:00000010:31.0:1773851863.075953:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defe7a25.
00000100:00000200:31.0:1773851863.075954:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576408705920, offset 224
00000400:00000200:31.0:1773851863.075956:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23890@kfi7
00000400:00000200:31.0:1773851863.075956:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23890@kfi7 to cpt 7
00000400:00000200:31.0:1773851863.075957:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0875795 nid 23890@kfi7 refs 1
00000400:00000200:31.0:1773851863.075958:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f0875795 nid 23890@kfi7 refs 2
00000400:00000200:31.0:1773851863.075959:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f0875795 nid 23890@kfi7 refs 3
00000400:00000200:31.0:1773851863.075960:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23890@kfi7 local destination
00000400:00000200:31.0:1773851863.075962:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769064:8769064:1024:4294967295] 23890@kfi7 LPNI seq info [1013831:1013831:16:4294967295]
00000400:00000200:31.0:1773851863.075963:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f0875795 nid 23890@kfi7 refs 2
00000400:00000200:31.0:1773851863.075964:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23890@kfi7 to cpt 7
00000400:00000200:31.0:1773851863.075966:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23890@kfi7(23890@kfi7:23890@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851863.075967:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f0875795 nid 23890@kfi7 refs 3
00000800:00000200:31.0:1773851863.075968:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851863.075969:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851863.075971:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851863.075974:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002a6 Using peer 23890@kfi7(0x1000000000002a6)
00000800:00000200:31.0:1773851863.075977:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x1000000000002a6: rc=0
00000800:00000200:31.0:1773851863.075978:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002a6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851863.075980:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851863.075981:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a94e99fc refcount 2 to 23890@kfi7
00010000:00000001:31.0:1773851863.075981:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851863.075982:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.075982:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851863.075983:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000863ffac5 x1859576408705920/t0(0) o400->74356ed7-bca1-426d-b19a-4b90e4100c4c@23890@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1990-0'
00000100:00100000:31.0:1773851863.075986:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000863ffac5 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:74356ed7-bca1-426d-b19a-4b90e4100c4c+5:39915:x1859576408705920:12345-23890@kfi7:400:default-tuolumne1990-0 Request processed in 58us (102us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851863.075988:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23890@kfi7, seq: 2055504
00000100:00000040:31.0:1773851863.075989:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000034f737bc : new rpc_count 0
00000100:00000001:31.0:1773851863.075990:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851863.075991:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851863.075991:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000800:00000200:29.0:1773851863.075991:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002a6 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851863.075992:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d66f3d8.
00000400:00000200:29.0:1773851863.075992:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851863.075993:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000021731e2.
00000400:00000200:29.0:1773851863.075993:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23890@kfi7: PUT: OK
00000020:00000040:31.0:1773851863.075994:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000034f737bc : new refcount 4
00000400:00000200:29.0:1773851863.075994:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defe7a25
00000100:00000001:31.0:1773851863.075995:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851863.075995:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defe7a25.
00000100:00000001:29.0:1773851863.075995:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851863.075996:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851863.075996:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0875795 nid 23890@kfi7 refs 2
00000800:00000200:29.0:1773851863.075998:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 23890@kfi7(00000000688a0ac6):0x0 lsk 679 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002a6 Transaction freed
00000800:00000200:10.0:1773851863.174036:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851863.174037:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851863.174039:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851863.174043:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851863.174046:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15906@kfi7 to cpt 2
00000400:00000200:10.0:1773851863.174048:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15906@kfi7 : PUT - for me
00000400:00000200:10.0:1773851863.174050:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15906@kfi7 to cpt 2
00000400:00000200:10.0:1773851863.174051:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f752c7e8 nid 15906@kfi7 refs 1
00000400:00000200:10.0:1773851863.174054:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15906@kfi7 to cpt 2
00000400:00000200:10.0:1773851863.174055:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f752c7e8 nid 15906@kfi7 refs 2
00000400:00000200:10.0:1773851863.174056:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f752c7e8 nid 15906@kfi7 refs 3
00000400:00000200:10.0:1773851863.174058:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16099@kfi7 to cpt 0
00000400:00000200:10.0:1773851863.174059:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16099@kfi7 of length 224 into portal 12 MB=0x69b4b9ec800c0
00000400:00000200:10.0:1773851863.174062:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16099@kfi7 of length 224/224 into md 0x78146ce49 [64] + 131952
00000800:00000200:10.0:1773851863.174065:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851863.174068:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851863.174070:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15906@kfi7: PUT: OK
00000100:00000001:10.0:1773851863.174071:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851863.174072:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851863.174074:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000086a345ee.
00000100:00000040:10.0:1773851863.174075:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000086a345ee x1859598949023936 msgsize 224
00000100:00100000:10.0:1773851863.174077:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-16099@kfi7 (source: 12345-15906@kfi7)
00000100:00000001:10.0:1773851863.174079:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851863.174080:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f752c7e8 nid 15906@kfi7 refs 2
00000100:00000001:9.0:1773851863.174082:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851863.174083:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:9.0:1773851863.174083:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851863.174083:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851863.174084:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.174085:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851863.174087:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598949023936
00000020:00000001:9.0:1773851863.174088:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851863.174088:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38968054
00000020:00000001:9.0:1773851863.174090:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851863.174095:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c16356dc refcount=169
00000020:00000001:9.0:1773851863.174096:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636974790369280 : -107098919182336 : ffff9e9816f76000)
00000020:00000001:9.0:1773851863.174097:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636974790369280 : -107098919182336 : ffff9e9816f76000)
00000100:00000001:9.0:1773851863.174099:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.174100:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851863.174101:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851863.174103:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.174104:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851863.174105:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851863.174107:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851863.174108:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.174109:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851863.174110:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851863.174110:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.174112:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851863.174114:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851863.174114:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851863.174115:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851863.174115:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851863.174116:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16099@kfi7, seq: 2130769
00000100:00000040:9.0:1773851863.174117:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c16356dc : new rpc_count 1
00000100:00000001:11.0:1773851863.174118:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.174118:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610187008 : -107030099364608 : ffff9ea81cf27500)
00000100:00000001:11.0:1773851863.174119:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.174120:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000086a345ee x1859598949023936/t0(0) o400->754185ba-462f-4d90-8973-f571c611bdc5@16099@kfi7:503/0 lens 224/0 e 0 to 0 dl 1773852618 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1483-0'
00000100:00000001:9.0:1773851863.174124:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.174125:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851863.174126:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086a345ee pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:754185ba-462f-4d90-8973-f571c611bdc5+169:39490:x1859598949023936:12345-16099@kfi7:400:default-tuolumne1483-0
00000100:00000200:9.0:1773851863.174128:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598949023936
00000020:00000001:9.0:1773851863.174129:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851863.174130:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851863.174131:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.174133:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851863.174133:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851863.174134:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851863.174135:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598949023936, found 0 last_xid 1859598948600447
00000020:00000001:9.0:1773851863.174137:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851863.174138:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851863.174138:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851863.174139:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.174140:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851863.174141:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851863.174142:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851863.174143:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008bf14ee0.
02000000:00000001:9.0:1773851863.174144:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.174146:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.174147:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851863.174148:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061748, transno 0, xid 1859598949023936
00010000:00000001:9.0:1773851863.174150:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851863.174151:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000086a345ee x1859598949023936/t0(0) o400->754185ba-462f-4d90-8973-f571c611bdc5@16099@kfi7:503/0 lens 224/224 e 0 to 0 dl 1773852618 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1483-0'
00010000:00000001:9.0:1773851863.174155:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851863.174156:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851863.174157:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=96 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851863.174159:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851863.174160:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000419a6e15 refcount 3 to 16099@kfi7
00000100:00000001:9.0:1773851863.174161:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530570976 : -107154178980640 : ffff9e8b3939c4e0)
02000000:00000001:9.0:1773851863.174162:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851863.174163:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.174164:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851863.174165:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15906@kfi7
00000400:00000010:9.0:1773851863.174166:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f03fb0b.
00000100:00000200:9.0:1773851863.174167:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598949023936, offset 224
00000400:00000200:9.0:1773851863.174169:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15906@kfi7
00000400:00000200:9.0:1773851863.174171:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15906@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.174172:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f752c7e8 nid 15906@kfi7 refs 1
00000400:00000200:9.0:1773851863.174174:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f752c7e8 nid 15906@kfi7 refs 2
00000400:00000200:9.0:1773851863.174175:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f752c7e8 nid 15906@kfi7 refs 3
00000400:00000200:9.0:1773851863.174177:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15906@kfi7 local destination
00000400:00000200:9.0:1773851863.174179:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769065:8769065:1024:4294967295] 15906@kfi7 LPNI seq info [1019242:1019242:16:4294967295]
00000400:00000200:9.0:1773851863.174181:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f752c7e8 nid 15906@kfi7 refs 2
00000400:00000200:9.0:1773851863.174183:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15906@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.174186:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15906@kfi7(15906@kfi7:15906@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851863.174188:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f752c7e8 nid 15906@kfi7 refs 3
00000800:00000200:9.0:1773851863.174190:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.174192:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.174199:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851863.174203:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f50 Using peer 15906@kfi7(0x100000000000f50)
00000800:00000200:9.0:1773851863.174207:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x100000000000f50: rc=0
00000800:00000200:9.0:1773851863.174210:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f50 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851863.174213:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.174214:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000419a6e15 refcount 2 to 16099@kfi7
00010000:00000001:9.0:1773851863.174216:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851863.174216:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.174217:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851863.174218:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000086a345ee x1859598949023936/t0(0) o400->754185ba-462f-4d90-8973-f571c611bdc5@16099@kfi7:503/0 lens 224/224 e 0 to 0 dl 1773852618 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1483-0'
00000100:00100000:9.0:1773851863.174224:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086a345ee pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:754185ba-462f-4d90-8973-f571c611bdc5+169:39490:x1859598949023936:12345-16099@kfi7:400:default-tuolumne1483-0 Request processed in 98us (148us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851863.174226:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f50 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851863.174228:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:9.0:1773851863.174228:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16099@kfi7, seq: 2130769
00000100:00000040:9.0:1773851863.174229:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c16356dc : new rpc_count 0
00000400:00000200:10.0:1773851863.174230:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15906@kfi7: PUT: OK
00000100:00000001:9.0:1773851863.174230:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851863.174231:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f03fb0b
00000100:00000001:9.0:1773851863.174231:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:10.0:1773851863.174232:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f03fb0b.
00000020:00000010:9.0:1773851863.174232:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000100:00000001:10.0:1773851863.174233:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851863.174233:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:9.0:1773851863.174233:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000020:00000010:9.0:1773851863.174234:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851863.174235:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f752c7e8 nid 15906@kfi7 refs 2
00000020:00000040:9.0:1773851863.174235:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000c16356dc : new refcount 168
00000100:00000001:9.0:1773851863.174236:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851863.174237:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 15906@kfi7(0000000083b0b317):0x0 lsk 3921 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f50 Transaction freed
00010000:00000001:2.0:1773851863.177734:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177735:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.177737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.177739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.177740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.177742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.177743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.177746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.177748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851863.177749:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851863.177754:0:937829:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:19.0:1773851863.177755:0:937829:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:19.0:1773851863.177756:0:937829:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851863.208014:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851863.208016:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851863.208018:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851863.208022:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851863.208025:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8336@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.208027:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8336@kfi7 : PUT - for me
00000400:00000200:25.0:1773851863.208029:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8336@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.208031:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5d433a1 nid 8336@kfi7 refs 1
00000400:00000200:25.0:1773851863.208033:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8336@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.208034:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5d433a1 nid 8336@kfi7 refs 2
00000400:00000200:25.0:1773851863.208035:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a5d433a1 nid 8336@kfi7 refs 3
00000400:00000200:25.0:1773851863.208038:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8336@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.208040:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8336@kfi7 of length 224 into portal 12 MB=0x69b95a0ded4c0
00000400:00000200:25.0:1773851863.208042:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8336@kfi7 of length 224/224 into md 0x16159c9699 [64] + 896
00000800:00000200:25.0:1773851863.208045:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851863.208048:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851863.208050:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8336@kfi7: PUT: OK
00000100:00000001:25.0:1773851863.208052:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851863.208053:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851863.208054:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa0be8a5.
00000100:00000040:25.0:1773851863.208055:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000fa0be8a5 x1859916811654336 msgsize 224
00000100:00100000:25.0:1773851863.208058:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8336@kfi7 (source: 12345-8336@kfi7)
00000100:00000001:25.0:1773851863.208060:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851863.208062:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5d433a1 nid 8336@kfi7 refs 2
00000800:00000200:25.0:1773851863.208064:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851863.208069:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851863.208070:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851863.208071:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851863.208072:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851863.208073:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851863.208074:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859916811654336
00000020:00000001:25.0:1773851863.208075:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851863.208076:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b64981ec2
00000020:00000001:25.0:1773851863.208077:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851863.208081:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003d2ad46e refcount=10
00000020:00000001:25.0:1773851863.208082:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111165563904 : -106962543987712 : ffff9eb7d78fb400)
00000020:00000001:25.0:1773851863.208084:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111165563904 : -106962543987712 : ffff9eb7d78fb400)
00000100:00000001:25.0:1773851863.208085:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851863.208087:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851863.208088:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000212fefaf.
00000020:00000010:25.0:1773851863.208089:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851863.208091:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094918347.
00000100:00000001:25.0:1773851863.208093:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851863.208094:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851863.208095:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851863.208097:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851863.208098:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851863.208098:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.208100:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851863.208102:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851863.208103:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851863.208103:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851863.208103:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851863.208105:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8336@kfi7, seq: 2025085
00000100:00000040:25.0:1773851863.208106:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003d2ad46e : new rpc_count 2
00000100:00000001:24.0:1773851863.208106:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851863.208107:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.208108:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478781184 : -106938230770432 : ffff9ebd80bdf500)
00000100:00000040:25.0:1773851863.208110:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fa0be8a5 x1859916811654336/t0(0) o400->3c6dca2e-bb6d-4ce0-864d-e220cb5c77a9@8336@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1010-0'
00000100:00000001:25.0:1773851863.208115:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851863.208115:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851863.208117:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa0be8a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:3c6dca2e-bb6d-4ce0-864d-e220cb5c77a9+10:39718:x1859916811654336:12345-8336@kfi7:400:default-tuolumne1010-0
00000100:00000200:25.0:1773851863.208119:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859916811654336
00000020:00000001:25.0:1773851863.208120:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851863.208121:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851863.208122:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.208124:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851863.208125:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851863.208126:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851863.208127:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859916811654336, found 0 last_xid 1859916811246271
00000020:00000001:25.0:1773851863.208128:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851863.208130:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851863.208130:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851863.208131:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.208132:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851863.208133:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851863.208134:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851863.208135:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f1b5abd0.
02000000:00000001:25.0:1773851863.208137:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.208139:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.208140:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851863.208141:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183109468271, transno 0, xid 1859916811654336
00010000:00000001:25.0:1773851863.208142:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851863.208144:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fa0be8a5 x1859916811654336/t0(0) o400->3c6dca2e-bb6d-4ce0-864d-e220cb5c77a9@8336@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1010-0'
00010000:00000001:25.0:1773851863.208149:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851863.208150:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851863.208151:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=96 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851863.208153:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851863.208154:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000899b4450 refcount 3 to 8336@kfi7
00000100:00000001:25.0:1773851863.208155:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858304 : -107149578693312 : ffff9e8c4b6c9540)
02000000:00000001:25.0:1773851863.208157:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851863.208158:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.208159:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851863.208160:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8336@kfi7
00000400:00000010:25.0:1773851863.208161:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006277e937.
00000100:00000200:25.0:1773851863.208162:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859916811654336, offset 224
00000400:00000200:25.0:1773851863.208165:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8336@kfi7
00000400:00000200:25.0:1773851863.208166:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8336@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.208167:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5d433a1 nid 8336@kfi7 refs 1
00000400:00000200:25.0:1773851863.208169:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a5d433a1 nid 8336@kfi7 refs 2
00000400:00000200:25.0:1773851863.208171:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a5d433a1 nid 8336@kfi7 refs 3
00000400:00000200:25.0:1773851863.208173:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8336@kfi7 local destination
00000400:00000200:25.0:1773851863.208175:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769066:8769066:1024:4294967295] 8336@kfi7 LPNI seq info [4525347:4525347:16:4294967295]
00000400:00000200:25.0:1773851863.208177:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a5d433a1 nid 8336@kfi7 refs 2
00000400:00000200:25.0:1773851863.208179:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8336@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.208182:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8336@kfi7(8336@kfi7:8336@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851863.208185:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a5d433a1 nid 8336@kfi7 refs 3
00000800:00000200:25.0:1773851863.208187:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851863.208189:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851863.208194:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851863.208198:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x28f Using peer 8336@kfi7(0x28f)
00000800:00000200:25.0:1773851863.208202:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000055b583f: Posted send of 324 bytes to peer 0x28f: rc=0
00000800:00000200:25.0:1773851863.208205:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x28f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851863.208209:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851863.208210:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000899b4450 refcount 2 to 8336@kfi7
00010000:00000001:25.0:1773851863.208211:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851863.208212:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.208213:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851863.208215:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa0be8a5 x1859916811654336/t0(0) o400->3c6dca2e-bb6d-4ce0-864d-e220cb5c77a9@8336@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1010-0'
00000100:00100000:25.0:1773851863.208221:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa0be8a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:3c6dca2e-bb6d-4ce0-864d-e220cb5c77a9+10:39718:x1859916811654336:12345-8336@kfi7:400:default-tuolumne1010-0 Request processed in 105us (164us total) trans 0 rc 0/0
00000800:00000200:26.0:1773851863.208222:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x28f TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851863.208225:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:25.0:1773851863.208225:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8336@kfi7, seq: 2025085
00000100:00000040:25.0:1773851863.208226:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003d2ad46e : new rpc_count 1
00000400:00000200:26.0:1773851863.208227:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8336@kfi7: PUT: OK
00000100:00000001:25.0:1773851863.208228:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:26.0:1773851863.208229:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006277e937
00000400:00000010:26.0:1773851863.208229:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006277e937.
00000100:00000001:25.0:1773851863.208229:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851863.208229:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000100:00000001:26.0:1773851863.208231:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851863.208231:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:25.0:1773851863.208231:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094918347.
00000020:00000010:25.0:1773851863.208232:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000212fefaf.
00000400:00000200:26.0:1773851863.208233:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5d433a1 nid 8336@kfi7 refs 2
00000020:00000040:25.0:1773851863.208234:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000003d2ad46e : new refcount 9
00000800:00000200:26.0:1773851863.208235:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 8336@kfi7(00000000bce798ef):0x0 lsk 656 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x28f Transaction freed
00000100:00000001:25.0:1773851863.208235:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:28.0:1773851863.369730:0:2514903:0:(pinger.c:251:ptlrpc_pinger_process_import()) e9e27651-4029-46dc-9e7a-b4f399592379->MGS: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000004:00000001:29.0:1773851863.369731:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:25.0:1773851863.369731:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:28.0:1773851863.369732:0:2514903:0:(pinger.c:136:ptlrpc_ping()) Process entered
00000004:00000020:25.0:1773851863.369732:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:25.0:1773851863.369732:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bd36394d.
00000100:00000010:28.0:1773851863.369733:0:2514903:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006123b392.
00000020:00000040:25.0:1773851863.369733:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000020:00000040:28.0:1773851863.369734:0:2514903:0:(genops.c:1094:class_import_get()) import 0000000088f36656 refcount=4 obd=MGC2054@kfi7
00000100:00000001:25.0:1773851863.369734:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:29.0:1773851863.369735:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:28.0:1773851863.369735:0:2514903:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851863.369735:0:2514903:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:29.0:1773851863.369736:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059df2607.
02000000:00000001:28.0:1773851863.369736:0:2514903:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851863.369737:0:2514903:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006d804786.
00000020:00000040:29.0:1773851863.369738:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000100:00000001:29.0:1773851863.369739:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:28.0:1773851863.369739:0:2514903:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851863.369740:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:28.0:1773851863.369740:0:2514903:0:(pinger.c:151:ptlrpc_ping()) @@@ pinging e9e27651-4029-46dc-9e7a-b4f399592379->MGS  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
02000000:00000001:29.0:1773851863.369741:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851863.369742:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
00000100:00000001:28.0:1773851863.369743:0:2514903:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851863.369744:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851863.369744:0:2514903:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851863.369744:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:25.0:1773851863.369744:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851863.369745:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:28.0:1773851863.369745:0:2514903:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006123b392] to pc [ptlrpcd_07_01+1]  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:25.0:1773851863.369745:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000014a6e7aa.
00000100:00000001:29.0:1773851863.369746:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.369746:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.369747:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:29.0:1773851863.369748:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000059df2607] to pc [ptlrpcd_07_02+2]  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851863.369748:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851863.369749:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000bd36394d] to pc [ptlrpcd_06_03+3]  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851863.369750:0:2514903:0:(pinger.c:160:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851863.369751:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851863.369752:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851863.369753:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851863.369753:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:25.0:1773851863.369753:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851863.369754:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851863.369754:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851863.369754:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:25.0:1773851863.369754:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000432898d8.
00000100:00000001:27.0:1773851863.369755:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851863.369755:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851863.369755:0:41087:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:25.0:1773851863.369755:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637142473011200 : -106931236540416 : ffff9ebf21a17000)
00080000:00000001:29.0:1773851863.369756:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:27.0:1773851863.369756:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851863.369756:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:25.0:1773851863.369756:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851863.369757:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851863.369757:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851863.369757:0:2514903:0:(pinger.c:320:ptlrpc_pinger_main()) next wakeup in 23 (614187)
00080000:00000001:25.0:1773851863.369757:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851863.369758:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:30.0:1773851863.369758:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:29.0:1773851863.369758:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000dfd73cf0.
00000004:00001000:25.0:1773851863.369758:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000004:00000010:25.0:1773851863.369758:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b54ed174.
00080000:00000001:29.0:1773851863.369759:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637155588356096 : -106918121195520 : ffff9ec22f5db800)
00000100:00000001:26.0:1773851863.369759:0:41087:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:25.0:1773851863.369759:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614137823034716ns, next at 614138823033644ns, rc = 0
00000100:00000001:31.0:1773851863.369760:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:30.0:1773851863.369760:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006123b392 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:e9e27651-4029-46dc-9e7a-b4f399592379:41089:1859433051926656:61@kfi7:400:default-yuba2-0
00080000:00000001:29.0:1773851863.369760:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:26.0:1773851863.369760:0:41087:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851863.369760:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:31.0:1773851863.369761:0:41091:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:30.0:1773851863.369761:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:28.0:1773851863.369761:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:26.0:1773851863.369761:0:41087:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:26.0:1773851863.369761:0:41087:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851863.369761:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851863.369761:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.369762:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851863.369762:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851863.369762:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851863.369762:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851863.369762:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851863.369762:0:41087:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bd36394d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_03:lustre5-MDT0001-mdtlov_UUID:41087:1859433051926784:2068@kfi7:13:default-yuba2-0
02000000:00000001:30.0:1773851863.369763:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00001000:29.0:1773851863.369763:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000100:00000001:26.0:1773851863.369763:0:41087:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851863.369764:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:30.0:1773851863.369764:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000061212b89.
02000000:00000001:30.0:1773851863.369764:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:29.0:1773851863.369764:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ecd0f679.
02000000:00000001:26.0:1773851863.369764:0:41087:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:31.0:1773851863.369765:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851863.369765:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
02000000:00000001:26.0:1773851863.369765:0:41087:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851863.369765:0:41087:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851863.369766:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851863.369766:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:30.0:1773851863.369766:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000004:00080000:29.0:1773851863.369766:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614137823041288ns, next at 614138823039555ns, rc = 0
02000000:00000010:26.0:1773851863.369766:0:41087:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e7700903.
00000100:00000001:31.0:1773851863.369767:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000010:30.0:1773851863.369767:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00080000:00000001:29.0:1773851863.369767:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:26.0:1773851863.369767:0:41087:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851863.369768:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851863.369768:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1859433051926656, portal 25
00000400:00000200:26.0:1773851863.369768:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000010:26.0:1773851863.369768:0:41087:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f00e36c9.
00000100:00000001:30.0:1773851863.369769:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851863.369769:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324247424 : -106976385304192 : ffff9eb49e8df980)
00080000:00000001:29.0:1773851863.369769:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:26.0:1773851863.369769:0:41087:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000445da448.
00000100:00000040:30.0:1773851863.369770:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:29.0:1773851863.369770:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:26.0:1773851863.369771:0:41087:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926784, portal 4
00000100:00000001:26.0:1773851863.369771:0:41087:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851863.369772:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:26.0:1773851863.369772:0:41087:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637135478760448 : -106938230791168 : ffff9ebd80bda400)
00000100:00000001:31.0:1773851863.369773:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:30.0:1773851863.369773:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-61@kfi7
00000100:00000001:31.0:1773851863.369774:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851863.369774:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ea7638e8.
00000100:00000040:26.0:1773851863.369774:0:41087:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851863.369775:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000200:30.0:1773851863.369775:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 26, xid 1859433051926656, offset 0
02000000:00000001:31.0:1773851863.369776:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851863.369776:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-61@kfi7
00000100:00000001:26.0:1773851863.369776:0:41087:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851863.369777:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000040:26.0:1773851863.369777:0:41087:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:26.0:1773851863.369777:0:41087:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e163307.
00000100:00100000:31.0:1773851863.369778:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000059df2607 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051926720:2090@kfi7:13:default-yuba2-0
00000400:00000200:30.0:1773851863.369778:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000100:00000200:26.0:1773851863.369778:0:41087:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926784, offset 0
00000400:00000200:30.0:1773851863.369779:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:31.0:1773851863.369780:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851863.369780:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:26.0:1773851863.369780:0:41087:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
02000000:00000001:31.0:1773851863.369781:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851863.369781:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:26.0:1773851863.369781:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:26.0:1773851863.369781:0:41087:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
02000000:00000001:31.0:1773851863.369782:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:30.0:1773851863.369782:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  61@kfi7 local destination
00000400:00000200:26.0:1773851863.369782:0:41087:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
02000000:00000010:31.0:1773851863.369784:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f353b924.
00000400:00000200:30.0:1773851863.369784:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769066, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769065, p:4294967295, g:4294967295, h:1000]
00000400:00000200:26.0:1773851863.369784:0:41087:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
02000000:00000001:31.0:1773851863.369785:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851863.369785:0:41087:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:30.0:1773851863.369786:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851863.369787:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851863.369787:0:41087:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769066, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769065, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851863.369788:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851863.369789:0:41087:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851863.369790:0:41089:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[43@kfi7, 61@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[37492099, 37492096]
00000400:00000200:26.0:1773851863.369790:0:41087:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851863.369791:0:41087:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:30.0:1773851863.369792:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 61@kfi7
00000400:00000200:26.0:1773851863.369792:0:41087:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769067:8769067:1024:4294967295] 2068@kfi7 LPNI seq info [5403697:5403697:16:4294967295]
00000400:00000200:30.0:1773851863.369793:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769068:8769068:1024:4294967295] 61@kfi7 LPNI seq info [37492100:37492100:16:4294967295]
00000400:00000200:26.0:1773851863.369794:0:41087:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851863.369795:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:30.0:1773851863.369795:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:26.0:1773851863.369795:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851863.369797:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:31.0:1773851863.369798:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000010:31.0:1773851863.369799:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000761d5a45.
00000400:00000200:30.0:1773851863.369799:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 61@kfi7(61@kfi7:61@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851863.369799:0:41087:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851863.369800:0:41087:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000100:00000200:31.0:1773851863.369801:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926720, portal 4
00000400:00000200:30.0:1773851863.369801:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000100:00000001:31.0:1773851863.369802:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:26.0:1773851863.369802:0:41087:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00000001:31.0:1773851863.369803:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079343700736 : -106994365850880 : ffff9eb06ed49b00)
00000800:00000200:30.0:1773851863.369803:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:26.0:1773851863.369803:0:41087:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:31.0:1773851863.369805:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851863.369805:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851863.369805:0:41087:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851863.369807:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851863.369808:0:41087:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000100:00000001:31.0:1773851863.369809:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851863.369810:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000800:00000200:30.0:1773851863.369810:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e Using peer 61@kfi7(0x20000000000081e)
00000400:00000010:31.0:1773851863.369811:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000800:00000200:26.0:1773851863.369811:0:41087:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001c682e34: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000800:00000200:26.0:1773851863.369812:0:41087:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000200:31.0:1773851863.369813:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926720, offset 0
00000800:00000200:30.0:1773851863.369813:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x20000000000081e: rc=0
00000400:00000200:31.0:1773851863.369815:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000800:00000200:30.0:1773851863.369815:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851863.369815:0:41087:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369815:0:41087:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851863.369816:0:41087:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851863.369817:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369817:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369817:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851863.369818:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000100:00000001:30.0:1773851863.369818:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851863.369818:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851863.369819:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851863.369819:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369819:0:41087:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:31.0:1773851863.369820:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851863.369820:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851863.369821:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851863.369821:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:26.0:1773851863.369821:0:41087:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:31.0:1773851863.369822:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000001:30.0:1773851863.369822:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851863.369822:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851863.369822:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851863.369823:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851863.369823:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369823:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851863.369823:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851863.369824:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000100:00000001:30.0:1773851863.369824:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369824:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851863.369824:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851863.369826:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769066, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769068, p:4294967295, g:4294967295, h:1000]
00000400:00000200:25.0:1773851863.369826:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000400:00000200:25.0:1773851863.369826:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e163307
00000800:00000200:30.0:1773851863.369827:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e TN_EVENT_TX_OK event status 0
00000400:00000010:25.0:1773851863.369827:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e163307.
00000100:00000001:25.0:1773851863.369827:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:30.0:1773851863.369828:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:25.0:1773851863.369828:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851863.369829:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851863.369829:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000400:00000200:30.0:1773851863.369830:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ea7638e8
00000400:00000010:30.0:1773851863.369830:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ea7638e8.
00000400:00000200:31.0:1773851863.369831:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:30.0:1773851863.369831:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:25.0:1773851863.369831:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:31.0:1773851863.369832:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000100:00000200:30.0:1773851863.369832:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851863.369832:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851863.369834:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769069:8769069:1024:4294967295] 2090@kfi7 LPNI seq info [5404249:5404249:16:4294967295]
00000100:00000001:30.0:1773851863.369834:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:25.0:1773851863.369834:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851863.369835:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 2 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851863.369835:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:31.0:1773851863.369836:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:31.0:1773851863.369837:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369837:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851863.369837:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:30.0:1773851863.369838:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851863.369838:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:25.0:1773851863.369838:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Transaction freed
00000800:00000200:30.0:1773851863.369840:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e Transaction freed
00000400:00000200:31.0:1773851863.369842:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851863.369844:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:31.0:1773851863.369846:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851863.369848:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851863.369852:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851863.369856:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000800:00000200:31.0:1773851863.369860:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:31.0:1773851863.369862:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851863.369864:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000001:31.0:1773851863.369865:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851863.369865:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851863.369866:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:2.0:1773851863.369866:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851863.369867:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:23.0:1773851863.369868:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851863.369868:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851863.369868:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851863.369869:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:23.0:1773851863.369870:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851863.369871:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851863.369871:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000800:00000200:23.0:1773851863.369872:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851863.369872:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 61@kfi7 : PUT - for me
00000800:00000200:30.0:1773851863.369873:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851863.369874:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:23.0:1773851863.369874:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:2.0:1773851863.369874:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:30.0:1773851863.369875:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:23.0:1773851863.369875:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:2.0:1773851863.369875:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:30.0:1773851863.369876:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000400:00000010:30.0:1773851863.369876:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000400:00000200:23.0:1773851863.369876:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:2.0:1773851863.369876:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369877:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851863.369877:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851863.369877:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:2.0:1773851863.369877:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:23.0:1773851863.369878:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:2.0:1773851863.369878:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:2.0:1773851863.369879:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369880:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851863.369880:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851863.369880:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:2.0:1773851863.369881:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 25 MB=0x69b24fe8b3080
00000100:00000001:30.0:1773851863.369882:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851863.369882:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369883:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851863.369884:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:23.0:1773851863.369884:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:2.0:1773851863.369884:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 19 from 12345-61@kfi7 of length 224/224 into md 0x7fb71d3e1 [1] + 224
00000800:00000200:30.0:1773851863.369885:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000400:00000200:23.0:1773851863.369885:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:23.0:1773851863.369886:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3100
00000800:00000200:2.0:1773851863.369886:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851863.369887:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:2.0:1773851863.369888:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:23.0:1773851863.369889:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d0ad5 [1] + 224
00000400:00000200:2.0:1773851863.369889:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000100:00000001:2.0:1773851863.369890:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:23.0:1773851863.369891:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851863.369892:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:2.0:1773851863.369892:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851863.369893:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:23.0:1773851863.369895:0:2495434:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:2.0:1773851863.369895:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:23.0:1773851863.369896:0:2495434:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:23.0:1773851863.369899:0:2495434:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851863.369899:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:2.0:1773851863.369900:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:30.0:1773851863.369901:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851863.369901:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:30.0:1773851863.369902:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851863.369902:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:2.0:1773851863.369902:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000010:30.0:1773851863.369903:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:23.0:1773851863.369903:0:2495434:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:30.0:1773851863.369904:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:30.0:1773851863.369904:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000400:00000200:23.0:1773851863.369904:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:30.0:1773851863.369905:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:26.0:1773851863.369905:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851863.369905:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:23.0:1773851863.369905:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003a94a903: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:30.0:1773851863.369906:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:26.0:1773851863.369906:0:41087:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:26.0:1773851863.369907:0:41087:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:30.0:1773851863.369908:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RNQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:26.0:1773851863.369908:0:41087:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f00e36c9.
00000400:00000200:26.0:1773851863.369908:0:41087:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000445da448
00000400:00000010:26.0:1773851863.369909:0:41087:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000445da448.
00000100:00000001:30.0:1773851863.369910:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851863.369910:0:41087:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:1.0:1773851863.369910:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00000001:30.0:1773851863.369911:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851863.369911:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:26.0:1773851863.369911:0:41087:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851863.369912:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851863.369912:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851863.369912:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851863.369913:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851863.369913:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:26.0:1773851863.369913:0:41087:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851863.369913:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:30.0:1773851863.369914:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000ae3303b5 time=100 v=66 (66 66 66 66)
00000100:00001000:30.0:1773851863.369915:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000d45f84a1 time=100 v=66 (1 1 1 1)
00000800:00000200:1.0:1773851863.369915:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:30.0:1773851863.369916:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851863.369916:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369916:0:41087:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851863.369916:0:41087:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:30.0:1773851863.369917:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851863.369917:0:41089:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369917:0:41087:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:26.0:1773851863.369917:0:41087:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:1.0:1773851863.369917:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369918:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851863.369918:0:41087:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:30.0:1773851863.369919:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851863.369919:0:41087:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851863.369919:0:41087:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851863.369919:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000100:00001000:26.0:1773851863.369920:0:41087:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=96 v=66 (66 66 66 66)
00000400:00000200:1.0:1773851863.369920:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369921:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:26.0:1773851863.369921:0:41087:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=96 v=66 (1 1 1 1)
00000400:00000200:1.0:1773851863.369921:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000100:00000001:30.0:1773851863.369922:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:26.0:1773851863.369922:0:41087:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:1.0:1773851863.369922:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:30.0:1773851863.369923:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851863.369923:0:41087:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851863.369923:0:41087:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:1.0:1773851863.369923:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000040:30.0:1773851863.369924:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:26.0:1773851863.369924:0:41087:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851863.369924:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000001:26.0:1773851863.369925:0:41087:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:1.0:1773851863.369925:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00100000:30.0:1773851863.369926:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006123b392 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:e9e27651-4029-46dc-9e7a-b4f399592379:41089:1859433051926656:61@kfi7:400:default-yuba2-0
00000100:00000040:26.0:1773851863.369926:0:41087:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:26.0:1773851863.369926:0:41087:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:1.0:1773851863.369926:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b30c0
00000100:00000001:30.0:1773851863.369927:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851863.369927:0:41087:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851863.369928:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851863.369928:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851863.369929:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006123b392 x1859433051926656/t0(0) o400->MGC2054@kfi7@61@kfi7:26/25 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Complete:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:1.0:1773851863.369929:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:26.0:1773851863.369930:0:41087:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851863.369931:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851863.369931:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:26.0:1773851863.369931:0:41087:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:1.0:1773851863.369931:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71d401 [1] + 224
02000000:00000010:30.0:1773851863.369932:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000061212b89.
00000100:00000001:26.0:1773851863.369932:0:41087:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851863.369932:0:41087:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:30.0:1773851863.369933:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851863.369933:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851863.369933:0:41089:0:(genops.c:1107:class_import_put()) import 0000000088f36656 refcount=3 obd=MGC2054@kfi7
00000004:00000040:26.0:1773851863.369933:0:41087:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000800:00000200:1.0:1773851863.369933:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:30.0:1773851863.369934:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851863.369934:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006d804786.
00000004:00000040:26.0:1773851863.369934:0:41087:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350959011840 avail=350956919808 avail_mb=1370925468 hwm_mb=3131103 files=371564058 ffree=342733410 state=0: rc = 0
02000000:00000001:30.0:1773851863.369935:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000200:1.0:1773851863.369935:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:30.0:1773851863.369936:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851863.369936:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006123b392.
00000004:00000020:26.0:1773851863.369936:0:41087:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350959011840 free, 350956919808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371564058 files, 342733410 free files
00000400:00000200:1.0:1773851863.369936:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000100:00000001:30.0:1773851863.369937:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851863.369937:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851863.369937:0:41087:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851863.369937:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851863.369938:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851863.369938:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851863.369939:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851863.369939:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:26.0:1773851863.369939:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:1.0:1773851863.369939:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851863.369940:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851863.369941:0:41087:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bd36394d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_03:lustre5-MDT0001-mdtlov_UUID:41087:1859433051926784:2068@kfi7:13:default-yuba2-0
00000100:00000040:1.0:1773851863.369942:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851863.369943:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851863.369943:0:41087:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851863.369944:0:41087:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000bd36394d x1859433051926784/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851863.369946:0:41087:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:1.0:1773851863.369946:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:26.0:1773851863.369947:0:41087:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:26.0:1773851863.369947:0:41087:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e7700903.
00000400:00000200:1.0:1773851863.369947:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:31.0:1773851863.369949:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851863.369949:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:26.0:1773851863.369949:0:41087:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851863.369949:0:41087:0:(genops.c:1101:class_import_put()) Process entered
00000800:00000200:1.0:1773851863.369949:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000020:00000040:26.0:1773851863.369950:0:41087:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:26.0:1773851863.369950:0:41087:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000001:31.0:1773851863.369951:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
02000000:00000010:26.0:1773851863.369951:0:41087:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000014a6e7aa.
00000400:00000001:31.0:1773851863.369952:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:26.0:1773851863.369952:0:41087:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000010:31.0:1773851863.369953:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
02000000:00000001:26.0:1773851863.369953:0:41087:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851863.369953:0:41087:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bd36394d.
00000400:00000200:31.0:1773851863.369954:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000761d5a45
00000100:00000001:26.0:1773851863.369954:0:41087:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851863.369954:0:41087:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:31.0:1773851863.369955:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000761d5a45.
00000100:00000001:26.0:1773851863.369955:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.369956:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:26.0:1773851863.369956:0:41087:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851863.369956:0:41087:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851863.369957:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851863.369957:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851863.369957:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851863.369963:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851863.369967:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851863.369968:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.369969:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851863.369969:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851863.369970:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851863.369971:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851863.369972:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851863.369974:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=96 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851863.369976:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=96 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851863.369977:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851863.369978:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851863.369979:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851863.369980:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.369981:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851863.369982:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:31.0:1773851863.369983:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851863.369984:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851863.369986:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851863.369990:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851863.369991:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851863.369992:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851863.369993:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851863.369995:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851863.369996:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351389039616 avail=351386320896 avail_mb=1372602816 hwm_mb=3131103 files=372019202 ffree=343153359 state=0: rc = 0
00000004:00000020:31.0:1773851863.370000:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351389039616 free, 351386320896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019202 files, 343153359 free files
00000004:00000001:31.0:1773851863.370002:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851863.370004:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851863.370008:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000059df2607 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051926720:2090@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851863.370011:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.370012:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851863.370013:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000059df2607 x1859433051926720/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851863.370017:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851863.370018:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851863.370019:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f353b924.
02000000:00000001:31.0:1773851863.370020:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851863.370021:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851863.370022:0:41091:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000001:31.0:1773851863.370023:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851863.370024:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
02000000:00000001:31.0:1773851863.370025:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851863.370026:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851863.370026:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059df2607.
00000100:00000001:31.0:1773851863.370028:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851863.370028:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.370030:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.370031:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851863.370031:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.370033:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851863.370033:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851863.395649:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851863.395650:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851863.395651:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851863.395655:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851863.395657:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.395658:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:17.0:1773851863.395659:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.395660:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851863.395661:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.395661:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851863.395662:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851863.395663:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:17.0:1773851863.395664:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e35240
00000400:00000200:17.0:1773851863.395665:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 5176
00000800:00000200:17.0:1773851863.395667:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851863.395669:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851863.395670:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000100:00000001:17.0:1773851863.395671:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851863.395671:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851863.395672:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed106d04.
00000100:00000040:17.0:1773851863.395673:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ed106d04 x1859316187615808 msgsize 224
00000100:00100000:17.0:1773851863.395674:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:17.0:1773851863.395675:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851863.395676:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000100:00000001:19.0:1773851863.395677:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851863.395677:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851863.395677:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851863.395678:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851863.395678:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851863.395679:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851863.395680:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187615808
00000020:00000001:19.0:1773851863.395680:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851863.395681:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:19.0:1773851863.395681:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851863.395682:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:19.0:1773851863.395683:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:19.0:1773851863.395684:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:19.0:1773851863.395684:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851863.395686:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851863.395686:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851863.395687:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851863.395688:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851863.395689:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851863.395690:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851863.395690:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851863.395691:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851863.395691:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851863.395692:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851863.395693:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851863.395694:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851863.395694:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851863.395694:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851863.395695:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156300
00000100:00000001:16.0:1773851863.395695:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851863.395696:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:16.0:1773851863.395696:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851863.395697:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764357504 : -107095945194112 : ffff9e98c83ad580)
00000100:00000001:16.0:1773851863.395697:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851863.395698:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed106d04 x1859316187615808/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:115/0 lens 224/0 e 0 to 0 dl 1773852230 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:19.0:1773851863.395701:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851863.395701:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851863.395702:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed106d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39684:x1859316187615808:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:19.0:1773851863.395704:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187615808
00000020:00000001:19.0:1773851863.395704:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851863.395705:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851863.395706:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851863.395706:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851863.395707:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851863.395708:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851863.395708:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187615808, found 0 last_xid 1859316186815935
00000020:00000001:19.0:1773851863.395709:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851863.395710:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851863.395710:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851863.395711:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851863.395711:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851863.395712:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851863.395712:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851863.395713:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004ce58a87.
02000000:00000001:19.0:1773851863.395713:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851863.395714:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851863.395715:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851863.395715:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187615808
00010000:00000001:19.0:1773851863.395716:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851863.395717:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed106d04 x1859316187615808/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:115/0 lens 224/224 e 0 to 0 dl 1773852230 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:19.0:1773851863.395719:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851863.395719:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851863.395720:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=96 v=315 (315 214 1 1)
00000100:00000001:19.0:1773851863.395722:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851863.395723:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:19.0:1773851863.395723:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:19.0:1773851863.395724:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851863.395729:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851863.395729:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851863.395730:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:19.0:1773851863.395731:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d7fd7892.
00000100:00000200:19.0:1773851863.395731:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187615808, offset 224
00000400:00000200:19.0:1773851863.395733:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:19.0:1773851863.395733:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:19.0:1773851863.395734:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:19.0:1773851863.395735:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:19.0:1773851863.395736:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:19.0:1773851863.395737:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:19.0:1773851863.395739:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769070:8769070:1024:4294967295] 20881@kfi7 LPNI seq info [16890552:16890552:16:4294967295]
00000400:00000200:19.0:1773851863.395740:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:19.0:1773851863.395741:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:19.0:1773851863.395743:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851863.395744:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:19.0:1773851863.395745:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851863.395746:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851863.395748:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851863.395750:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Using peer 20881@kfi7(0x10000000000027f)
00000800:00000200:19.0:1773851863.395753:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x10000000000027f: rc=0
00000800:00000200:19.0:1773851863.395755:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851863.395756:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851863.395758:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:19.0:1773851863.395758:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851863.395759:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851863.395760:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851863.395760:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed106d04 x1859316187615808/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:115/0 lens 224/224 e 0 to 0 dl 1773852230 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000100:00100000:19.0:1773851863.395763:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed106d04 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39684:x1859316187615808:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851863.395766:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156300
00000800:00000200:17.0:1773851863.395766:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_EVENT_TX_OK event status 0
00000100:00000040:19.0:1773851863.395767:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000100:00000001:19.0:1773851863.395768:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851863.395768:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851863.395768:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851863.395769:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851863.395769:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000400:00000200:17.0:1773851863.395769:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000400:00000200:17.0:1773851863.395769:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d7fd7892
00000020:00000010:19.0:1773851863.395770:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000400:00000010:17.0:1773851863.395770:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d7fd7892.
00000020:00000040:19.0:1773851863.395771:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:19.0:1773851863.395771:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851863.395771:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851863.395771:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851863.395772:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:17.0:1773851863.395774:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Transaction freed
00000800:00000200:5.0:1773851863.466904:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.466905:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851863.466907:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851863.466910:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851863.466913:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.466915:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16034@kfi7 : PUT - for me
00000400:00000200:5.0:1773851863.466917:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.466918:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 1
00000400:00000200:5.0:1773851863.466920:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.466921:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000400:00000200:5.0:1773851863.466923:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 3
00000400:00000200:5.0:1773851863.466924:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:5.0:1773851863.466926:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16035@kfi7 of length 224 into portal 12 MB=0x69b0a099aae00
00000400:00000200:5.0:1773851863.466928:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16035@kfi7 of length 224/224 into md 0x793926dc5 [64] + 130744
00000800:00000200:5.0:1773851863.466931:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851863.466934:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851863.466935:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16034@kfi7: PUT: OK
00000100:00000001:5.0:1773851863.466936:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851863.466937:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851863.466939:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059de6620.
00000100:00000040:5.0:1773851863.466940:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000059de6620 x1859317273374208 msgsize 224
00000100:00100000:5.0:1773851863.466942:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-16035@kfi7 (source: 12345-16034@kfi7)
00000100:00000001:5.0:1773851863.466944:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851863.466945:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000100:00000001:7.0:1773851863.466946:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851863.466947:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851863.466947:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851863.466948:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851863.466949:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851863.466950:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851863.466951:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317273374208
00000020:00000001:7.0:1773851863.466952:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851863.466953:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91be5
00000020:00000001:7.0:1773851863.466954:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851863.466957:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000089dee026 refcount=6
00000020:00000001:7.0:1773851863.466958:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628011008 : -107123081540608 : ffff9e9276c70c00)
00000020:00000001:7.0:1773851863.466959:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628011008 : -107123081540608 : ffff9e9276c70c00)
00000100:00000001:7.0:1773851863.466961:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851863.466962:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851863.466963:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f72fd39.
00000020:00000010:7.0:1773851863.466965:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851863.466966:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851863.466967:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851863.466968:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851863.466969:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.466970:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851863.466971:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851863.466971:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.466973:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.466975:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851863.466976:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851863.466976:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851863.466976:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851863.466977:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16035@kfi7, seq: 2001897
00000100:00000040:7.0:1773851863.466979:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000089dee026 : new rpc_count 1
00000100:00000001:5.0:1773851863.466979:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.466980:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136106890240 : -106937602661376 : ffff9ebda62e2400)
00000100:00000001:5.0:1773851863.466980:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851863.466981:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000059de6620 x1859317273374208/t0(0) o400->e667f051-7107-4062-bad8-d119f0e87c98@16035@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1484-0'
00000100:00000001:7.0:1773851863.466986:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851863.466986:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851863.466988:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059de6620 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e667f051-7107-4062-bad8-d119f0e87c98+6:39863:x1859317273374208:12345-16035@kfi7:400:default-tuolumne1484-0
00000100:00000200:7.0:1773851863.466990:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317273374208
00000020:00000001:7.0:1773851863.466991:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851863.466992:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851863.466993:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.466994:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851863.466995:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851863.466997:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851863.466998:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317273374208, found 0 last_xid 1859317273374207
00000020:00000001:7.0:1773851863.467000:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851863.467001:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851863.467002:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851863.467002:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.467003:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851863.467004:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851863.467005:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851863.467006:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007c052b15.
02000000:00000001:7.0:1773851863.467007:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.467008:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.467009:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851863.467010:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044157664, transno 0, xid 1859317273374208
00010000:00000001:7.0:1773851863.467011:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851863.467013:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000059de6620 x1859317273374208/t0(0) o400->e667f051-7107-4062-bad8-d119f0e87c98@16035@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1484-0'
00010000:00000001:7.0:1773851863.467017:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851863.467018:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851863.467019:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=95 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851863.467021:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851863.467022:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3423137 refcount 5 to 16035@kfi7
00000100:00000001:7.0:1773851863.467023:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519008 : -107156126032608 : ffff9e8ac52c1d20)
02000000:00000001:7.0:1773851863.467024:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851863.467025:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.467026:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851863.467028:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16034@kfi7
00000400:00000010:7.0:1773851863.467028:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
00000100:00000200:7.0:1773851863.467030:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317273374208, offset 224
00000400:00000200:7.0:1773851863.467032:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16034@kfi7
00000400:00000200:7.0:1773851863.467033:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:7.0:1773851863.467035:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 1
00000400:00000200:7.0:1773851863.467036:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000400:00000200:7.0:1773851863.467038:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 3
00000400:00000200:7.0:1773851863.467041:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16034@kfi7 local destination
00000400:00000200:7.0:1773851863.467043:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769071:8769071:1024:4294967295] 16034@kfi7 LPNI seq info [1163066:1163066:16:4294967295]
00000400:00000200:7.0:1773851863.467045:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000400:00000200:7.0:1773851863.467047:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16034@kfi7 to cpt 1
00000400:00000200:7.0:1773851863.467050:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16034@kfi7(16034@kfi7:16034@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851863.467052:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 3
00000800:00000200:7.0:1773851863.467054:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851863.467056:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851863.467060:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851863.467064:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fea Using peer 16034@kfi7(0x100000000000fea)
00000800:00000200:7.0:1773851863.467068:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x100000000000fea: rc=0
00000800:00000200:7.0:1773851863.467070:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851863.467074:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851863.467075:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3423137 refcount 4 to 16035@kfi7
00010000:00000001:7.0:1773851863.467076:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851863.467077:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.467078:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851863.467079:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059de6620 x1859317273374208/t0(0) o400->e667f051-7107-4062-bad8-d119f0e87c98@16035@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1484-0'
00000800:00000200:5.0:1773851863.467082:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fea TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851863.467085:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059de6620 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e667f051-7107-4062-bad8-d119f0e87c98+6:39863:x1859317273374208:12345-16035@kfi7:400:default-tuolumne1484-0 Request processed in 98us (144us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851863.467085:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851863.467087:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16034@kfi7: PUT: OK
00000400:00000200:5.0:1773851863.467088:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000100:00100000:7.0:1773851863.467089:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16035@kfi7, seq: 2001897
00000400:00000010:5.0:1773851863.467089:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000100:00000040:7.0:1773851863.467090:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000089dee026 : new rpc_count 0
00000100:00000001:5.0:1773851863.467090:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851863.467091:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851863.467091:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851863.467092:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851863.467092:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e597bb9f nid 16034@kfi7 refs 2
00000020:00000010:7.0:1773851863.467094:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000800:00000200:5.0:1773851863.467094:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 16034@kfi7(0000000038355ef0):0x0 lsk 4075 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000fea Transaction freed
00000020:00000010:7.0:1773851863.467095:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000020:00000010:7.0:1773851863.467096:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f72fd39.
00000020:00000040:7.0:1773851863.467097:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000089dee026 : new refcount 5
00000100:00000001:7.0:1773851863.467099:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851863.514357:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.514358:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851863.514359:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851863.514361:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851863.514362:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10083@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.514363:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10083@kfi7 : PUT - for me
00000400:00000200:5.0:1773851863.514364:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10083@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.514365:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000885e6838 nid 10083@kfi7 refs 1
00000400:00000200:5.0:1773851863.514366:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10083@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.514367:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000885e6838 nid 10083@kfi7 refs 2
00000400:00000200:5.0:1773851863.514367:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000885e6838 nid 10083@kfi7 refs 3
00000400:00000200:5.0:1773851863.514368:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10083@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.514369:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10083@kfi7 of length 224 into portal 12 MB=0x699e178ebf900
00000400:00000200:5.0:1773851863.514370:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10083@kfi7 of length 224/224 into md 0x793926dc5 [64] + 130968
00000800:00000200:5.0:1773851863.514371:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851863.514373:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851863.514377:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10083@kfi7: PUT: OK
00000100:00000001:5.0:1773851863.514378:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851863.514378:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851863.514379:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a38f03b5.
00000100:00000040:5.0:1773851863.514379:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a38f03b5 x1858043535685888 msgsize 224
00000100:00100000:5.0:1773851863.514380:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10083@kfi7 (source: 12345-10083@kfi7)
00000100:00000001:5.0:1773851863.514382:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851863.514382:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000885e6838 nid 10083@kfi7 refs 2
00000100:00000001:7.0:1773851863.514383:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851863.514383:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851863.514384:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851863.514384:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851863.514384:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851863.514385:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851863.514385:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043535685888
00000020:00000001:7.0:1773851863.514386:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851863.514386:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913f0
00000020:00000001:7.0:1773851863.514387:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851863.514389:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000003a3e153 refcount=6
00000020:00000001:7.0:1773851863.514390:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169310208 : -107127540241408 : ffff9e916d04ac00)
00000020:00000001:7.0:1773851863.514391:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169310208 : -107127540241408 : ffff9e916d04ac00)
00000100:00000001:7.0:1773851863.514392:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851863.514392:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851863.514393:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f72fd39.
00000020:00000010:7.0:1773851863.514393:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851863.514394:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851863.514395:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851863.514395:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851863.514395:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.514396:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851863.514397:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851863.514397:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.514398:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.514399:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851863.514399:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851863.514399:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851863.514399:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851863.514400:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10083@kfi7, seq: 2001898
00000100:00000040:7.0:1773851863.514400:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000003a3e153 : new rpc_count 1
00000100:00000001:5.0:1773851863.514400:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.514401:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136106884480 : -106937602667136 : ffff9ebda62e0d80)
00000100:00000001:5.0:1773851863.514401:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851863.514402:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a38f03b5 x1858043535685888/t0(0) o400->3d1372c9-e069-4648-9922-1645199e4754@10083@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1116-0'
00000100:00000001:7.0:1773851863.514405:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851863.514406:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851863.514406:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a38f03b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:3d1372c9-e069-4648-9922-1645199e4754+6:39744:x1858043535685888:12345-10083@kfi7:400:default-tuolumne1116-0
00000100:00000200:7.0:1773851863.514408:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043535685888
00000020:00000001:7.0:1773851863.514408:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851863.514408:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851863.514409:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.514410:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851863.514410:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851863.514411:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851863.514411:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043535685888, found 0 last_xid 1858043535685887
00000020:00000001:7.0:1773851863.514412:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851863.514412:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851863.514413:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851863.514413:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.514414:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851863.514414:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851863.514414:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851863.514415:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009ae7d441.
02000000:00000001:7.0:1773851863.514415:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.514416:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.514416:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851863.514417:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182768031223, transno 0, xid 1858043535685888
00010000:00000001:7.0:1773851863.514417:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851863.514418:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a38f03b5 x1858043535685888/t0(0) o400->3d1372c9-e069-4648-9922-1645199e4754@10083@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1116-0'
00010000:00000001:7.0:1773851863.514420:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851863.514421:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851863.514421:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=95 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851863.514422:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851863.514423:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ffc71a5 refcount 3 to 10083@kfi7
00000100:00000001:7.0:1773851863.514424:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553700960 : -107156155850656 : ffff9e8ac3652060)
02000000:00000001:7.0:1773851863.514424:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851863.514425:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.514425:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851863.514426:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10083@kfi7
00000400:00000010:7.0:1773851863.514427:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012526ad9.
00000100:00000200:7.0:1773851863.514427:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043535685888, offset 224
00000400:00000200:7.0:1773851863.514428:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10083@kfi7
00000400:00000200:7.0:1773851863.514429:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10083@kfi7 to cpt 1
00000400:00000200:7.0:1773851863.514429:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000885e6838 nid 10083@kfi7 refs 1
00000400:00000200:7.0:1773851863.514430:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000885e6838 nid 10083@kfi7 refs 2
00000400:00000200:7.0:1773851863.514431:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000885e6838 nid 10083@kfi7 refs 3
00000400:00000200:7.0:1773851863.514432:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10083@kfi7 local destination
00000400:00000200:7.0:1773851863.514433:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769072:8769072:1024:4294967295] 10083@kfi7 LPNI seq info [313844:313844:16:4294967295]
00000400:00000200:7.0:1773851863.514435:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000885e6838 nid 10083@kfi7 refs 2
00000400:00000200:7.0:1773851863.514435:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10083@kfi7 to cpt 1
00000400:00000200:7.0:1773851863.514437:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10083@kfi7(10083@kfi7:10083@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851863.514439:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000885e6838 nid 10083@kfi7 refs 3
00000800:00000200:7.0:1773851863.514440:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851863.514441:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851863.514443:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851863.514446:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d6 Using peer 10083@kfi7(0x7d6)
00000800:00000200:7.0:1773851863.514449:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x7d6: rc=0
00000800:00000200:7.0:1773851863.514450:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851863.514453:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851863.514453:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ffc71a5 refcount 2 to 10083@kfi7
00010000:00000001:7.0:1773851863.514454:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851863.514455:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851863.514456:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851863.514457:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a38f03b5 x1858043535685888/t0(0) o400->3d1372c9-e069-4648-9922-1645199e4754@10083@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1116-0'
00000100:00100000:7.0:1773851863.514460:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a38f03b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:3d1372c9-e069-4648-9922-1645199e4754+6:39744:x1858043535685888:12345-10083@kfi7:400:default-tuolumne1116-0 Request processed in 54us (80us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851863.514462:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d6 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851863.514463:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10083@kfi7, seq: 2001898
00000100:00000040:7.0:1773851863.514464:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000003a3e153 : new rpc_count 0
00000100:00000001:7.0:1773851863.514464:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851863.514464:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851863.514465:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851863.514465:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851863.514465:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10083@kfi7: PUT: OK
00000020:00000010:7.0:1773851863.514466:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000400:00000200:5.0:1773851863.514466:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012526ad9
00000400:00000010:5.0:1773851863.514466:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012526ad9.
00000020:00000010:7.0:1773851863.514467:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f72fd39.
00000100:00000001:5.0:1773851863.514467:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851863.514467:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:7.0:1773851863.514468:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000003a3e153 : new refcount 5
00000100:00000001:7.0:1773851863.514468:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851863.514468:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000885e6838 nid 10083@kfi7 refs 2
00000800:00000200:5.0:1773851863.514470:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10083@kfi7(00000000dd3fc593):0x0 lsk 2007 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7d6 Transaction freed
00000800:00000200:10.0:1773851863.549877:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851863.549878:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851863.549880:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851863.549882:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851863.549884:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:10.0:1773851863.549885:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14843@kfi7 : PUT - for me
00000400:00000200:10.0:1773851863.549886:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:10.0:1773851863.549887:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 1
00000400:00000200:10.0:1773851863.549888:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:10.0:1773851863.549889:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000400:00000200:10.0:1773851863.549889:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 3
00000400:00000200:10.0:1773851863.549890:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:10.0:1773851863.549891:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14843@kfi7 of length 224 into portal 12 MB=0x699de8bfe1900
00000400:00000200:10.0:1773851863.549892:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14843@kfi7 of length 224/224 into md 0x78146ce49 [64] + 132176
00000800:00000200:10.0:1773851863.549894:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851863.549895:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851863.549896:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14843@kfi7: PUT: OK
00000100:00000001:10.0:1773851863.549897:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851863.549898:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851863.549899:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000150f129.
00000100:00000040:10.0:1773851863.549900:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000000150f129 x1858030970738944 msgsize 224
00000100:00100000:10.0:1773851863.549901:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-14843@kfi7 (source: 12345-14843@kfi7)
00000100:00000001:10.0:1773851863.549902:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851863.549903:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000100:00000001:9.0:1773851863.549903:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851863.549904:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:9.0:1773851863.549904:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851863.549904:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851863.549905:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.549906:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851863.549907:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030970738944
00000020:00000001:9.0:1773851863.549908:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851863.549908:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f89
00000020:00000001:9.0:1773851863.549909:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851863.549911:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006441d1fa refcount=6
00000020:00000001:9.0:1773851863.549912:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239887872 : -107152469663744 : ffff9e8b9f1be000)
00000020:00000001:9.0:1773851863.549913:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239887872 : -107152469663744 : ffff9e8b9f1be000)
00000100:00000001:9.0:1773851863.549914:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.549915:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851863.549915:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851863.549916:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.549917:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851863.549918:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851863.549918:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851863.549919:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.549920:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851863.549920:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851863.549921:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.549922:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851863.549923:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851863.549923:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851863.549923:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851863.549924:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851863.549924:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14843@kfi7, seq: 2130770
00000100:00000001:11.0:1773851863.549925:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.549925:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006441d1fa : new rpc_count 1
00000100:00000001:11.0:1773851863.549926:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.549926:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610177792 : -107030099373824 : ffff9ea81cf25100)
00000100:00000040:9.0:1773851863.549927:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000150f129 x1858030970738944/t0(0) o400->34cffbe6-aac2-4969-8b74-a09d2e79ad3d@14843@kfi7:651/0 lens 224/0 e 0 to 0 dl 1773852011 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne226-0'
00000100:00000001:9.0:1773851863.549929:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.549930:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851863.549931:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000150f129 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:34cffbe6-aac2-4969-8b74-a09d2e79ad3d+6:47786:x1858030970738944:12345-14843@kfi7:400:default-tuolumne226-0
00000100:00000200:9.0:1773851863.549932:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030970738944
00000020:00000001:9.0:1773851863.549933:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851863.549933:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851863.549935:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.549935:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851863.549936:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851863.549936:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851863.549937:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030970738944, found 0 last_xid 1858030970738943
00000020:00000001:9.0:1773851863.549938:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851863.549938:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851863.549939:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851863.549939:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.549940:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851863.549940:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851863.549941:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851863.549942:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d6e0a3e0.
02000000:00000001:9.0:1773851863.549942:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.549943:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.549944:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851863.549944:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030970738944
00010000:00000001:9.0:1773851863.549945:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851863.549946:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000150f129 x1858030970738944/t0(0) o400->34cffbe6-aac2-4969-8b74-a09d2e79ad3d@14843@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne226-0'
00010000:00000001:9.0:1773851863.549948:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851863.549949:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851863.549950:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=96 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851863.549951:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851863.549951:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000094960c5a refcount 5 to 14843@kfi7
00000100:00000001:9.0:1773851863.549952:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582944 : -107154806968672 : ffff9e8b13cb6ea0)
02000000:00000001:9.0:1773851863.549953:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851863.549953:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.549954:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851863.549955:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14843@kfi7
00000400:00000010:9.0:1773851863.549955:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002185eb96.
00000100:00000200:9.0:1773851863.549956:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030970738944, offset 224
00000400:00000200:9.0:1773851863.549957:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14843@kfi7
00000400:00000200:9.0:1773851863.549958:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.549959:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 1
00000400:00000200:9.0:1773851863.549960:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000400:00000200:9.0:1773851863.549961:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 3
00000400:00000200:9.0:1773851863.549963:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14843@kfi7 local destination
00000400:00000200:9.0:1773851863.549964:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769073:8769073:1024:4294967295] 14843@kfi7 LPNI seq info [24409:24409:16:4294967295]
00000400:00000200:9.0:1773851863.549965:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000400:00000200:9.0:1773851863.549966:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.549968:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14843@kfi7(14843@kfi7:14843@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851863.549969:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 3
00000800:00000200:9.0:1773851863.549970:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.549971:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.549973:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851863.549976:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x28b Using peer 14843@kfi7(0x28b)
00000800:00000200:9.0:1773851863.549979:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x28b: rc=0
00000800:00000200:9.0:1773851863.549981:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x28b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851863.549982:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.549983:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000094960c5a refcount 4 to 14843@kfi7
00010000:00000001:9.0:1773851863.549984:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851863.549984:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.549985:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851863.549986:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000150f129 x1858030970738944/t0(0) o400->34cffbe6-aac2-4969-8b74-a09d2e79ad3d@14843@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne226-0'
00000100:00100000:9.0:1773851863.549989:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000150f129 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:34cffbe6-aac2-4969-8b74-a09d2e79ad3d+6:47786:x1858030970738944:12345-14843@kfi7:400:default-tuolumne226-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851863.549991:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x28b TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851863.549991:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14843@kfi7, seq: 2130770
00000100:00000040:9.0:1773851863.549992:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006441d1fa : new rpc_count 0
00000400:00000200:10.0:1773851863.549993:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851863.549994:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14843@kfi7: PUT: OK
00000400:00000200:10.0:1773851863.549995:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002185eb96
00000100:00000001:9.0:1773851863.549995:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:10.0:1773851863.549996:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002185eb96.
00000100:00000001:10.0:1773851863.549996:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851863.549996:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851863.549996:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000100:00000001:10.0:1773851863.549997:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:9.0:1773851863.549997:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851863.549998:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000020:00000010:9.0:1773851863.549998:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851863.549998:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000006441d1fa : new refcount 5
00000800:00000200:10.0:1773851863.549999:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2069@kfi7:2 -> 14843@kfi7(000000005a887352):0x0 lsk 652 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x28b Transaction freed
00000100:00000001:9.0:1773851863.549999:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851863.550327:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.550327:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851863.550329:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851863.550331:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851863.550332:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.550333:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14843@kfi7 : PUT - for me
00000400:00000200:9.0:1773851863.550334:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.550335:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 1
00000400:00000200:9.0:1773851863.550335:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.550336:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000400:00000200:9.0:1773851863.550337:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 3
00000400:00000200:9.0:1773851863.550338:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.550339:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14843@kfi7 of length 224 into portal 12 MB=0x699de8bfe2140
00000400:00000200:9.0:1773851863.550340:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14843@kfi7 of length 224/224 into md 0x78146ce49 [64] + 132400
00000800:00000200:9.0:1773851863.550341:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851863.550343:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851863.550344:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14843@kfi7: PUT: OK
00000100:00000001:9.0:1773851863.550345:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851863.550345:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851863.550346:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009efde58a.
00000100:00000040:9.0:1773851863.550347:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009efde58a x1858030970741056 msgsize 224
00000100:00100000:9.0:1773851863.550348:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14843@kfi7 (source: 12345-14843@kfi7)
00000100:00000001:9.0:1773851863.550350:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851863.550351:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000800:00000200:9.0:1773851863.550352:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851863.550355:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851863.550355:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851863.550355:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851863.550356:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.550356:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851863.550357:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030970741056
00000020:00000001:9.0:1773851863.550357:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851863.550358:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912b5
00000020:00000001:9.0:1773851863.550358:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851863.550360:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e23c0120 refcount=6
00000020:00000001:9.0:1773851863.550360:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716216832 : -107155993334784 : ffff9e8acd14ec00)
00000020:00000001:9.0:1773851863.550361:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716216832 : -107155993334784 : ffff9e8acd14ec00)
00000100:00000001:9.0:1773851863.550362:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.550362:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851863.550363:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851863.550363:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.550364:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851863.550365:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851863.550365:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851863.550365:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.550366:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851863.550366:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851863.550367:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.550368:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.550368:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851863.550369:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851863.550369:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851863.550369:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851863.550370:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14843@kfi7, seq: 2130771
00000100:00000040:9.0:1773851863.550370:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e23c0120 : new rpc_count 1
00000100:00000001:11.0:1773851863.550371:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851863.550371:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.550371:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922900480 : -107141786651136 : ffff9e8e1bddb600)
00000100:00000040:9.0:1773851863.550372:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009efde58a x1858030970741056/t0(0) o400->f87235dc-354e-4886-b21f-7869219bea87@14843@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne226-0'
00000100:00000001:9.0:1773851863.550374:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.550375:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851863.550376:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009efde58a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f87235dc-354e-4886-b21f-7869219bea87+6:47787:x1858030970741056:12345-14843@kfi7:400:default-tuolumne226-0
00000100:00000200:9.0:1773851863.550377:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030970741056
00000020:00000001:9.0:1773851863.550377:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851863.550377:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851863.550378:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.550378:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851863.550379:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851863.550380:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851863.550380:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030970741056, found 0 last_xid 1858030970741055
00000020:00000001:9.0:1773851863.550381:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851863.550381:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851863.550382:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851863.550382:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.550383:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851863.550383:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851863.550383:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851863.550385:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000052556309.
02000000:00000001:9.0:1773851863.550385:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.550386:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.550386:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851863.550387:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768337, transno 0, xid 1858030970741056
00010000:00000001:9.0:1773851863.550388:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851863.550388:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009efde58a x1858030970741056/t0(0) o400->f87235dc-354e-4886-b21f-7869219bea87@14843@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne226-0'
00010000:00000001:9.0:1773851863.550390:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851863.550391:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851863.550391:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=96 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851863.550392:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851863.550393:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000094960c5a refcount 5 to 14843@kfi7
00000100:00000001:9.0:1773851863.550393:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582944 : -107154806968672 : ffff9e8b13cb6ea0)
02000000:00000001:9.0:1773851863.550394:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851863.550395:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.550395:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851863.550396:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14843@kfi7
00000400:00000010:9.0:1773851863.550397:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000347c88aa.
00000100:00000200:9.0:1773851863.550397:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030970741056, offset 224
00000400:00000200:9.0:1773851863.550398:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14843@kfi7
00000400:00000200:9.0:1773851863.550399:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.550400:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 1
00000400:00000200:9.0:1773851863.550400:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000400:00000200:9.0:1773851863.550401:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 3
00000400:00000200:9.0:1773851863.550402:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14843@kfi7 local destination
00000400:00000200:9.0:1773851863.550403:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769074:8769074:1024:4294967295] 14843@kfi7 LPNI seq info [24410:24410:16:4294967295]
00000400:00000200:9.0:1773851863.550404:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000400:00000200:9.0:1773851863.550405:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14843@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.550407:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14843@kfi7(14843@kfi7:14843@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851863.550408:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 3
00000800:00000200:9.0:1773851863.550409:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.550410:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.550412:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851863.550414:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000028e Using peer 14843@kfi7(0x10000000000028e)
00000800:00000200:9.0:1773851863.550417:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000438708cd: Posted send of 324 bytes to peer 0x10000000000028e: rc=0
00000800:00000200:9.0:1773851863.550418:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000028e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851863.550420:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.550420:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000094960c5a refcount 4 to 14843@kfi7
00010000:00000001:9.0:1773851863.550421:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851863.550422:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.550422:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851863.550423:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009efde58a x1858030970741056/t0(0) o400->f87235dc-354e-4886-b21f-7869219bea87@14843@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne226-0'
00000100:00100000:9.0:1773851863.550426:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009efde58a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f87235dc-354e-4886-b21f-7869219bea87+6:47787:x1858030970741056:12345-14843@kfi7:400:default-tuolumne226-0 Request processed in 50us (78us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851863.550428:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14843@kfi7, seq: 2130771
00000100:00000040:9.0:1773851863.550428:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e23c0120 : new rpc_count 0
00000100:00000001:9.0:1773851863.550429:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851863.550429:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:10.0:1773851863.550430:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000028e TN_EVENT_TX_OK event status 0
00000020:00000010:9.0:1773851863.550430:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.550430:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000020:00000010:9.0:1773851863.550431:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851863.550432:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:9.0:1773851863.550432:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000e23c0120 : new refcount 5
00000100:00000001:9.0:1773851863.550432:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851863.550433:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14843@kfi7: PUT: OK
00000400:00000200:10.0:1773851863.550434:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000347c88aa
00000400:00000010:10.0:1773851863.550434:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000347c88aa.
00000100:00000001:10.0:1773851863.550435:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851863.550435:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851863.550436:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000241383dd nid 14843@kfi7 refs 2
00000800:00000200:10.0:1773851863.550437:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 14843@kfi7(000000006acbad17):0x0 lsk 655 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000028e Transaction freed
00000800:00000200:29.0:1773851863.648729:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851863.648730:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851863.648731:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851863.648734:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851863.648736:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21730@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.648738:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21730@kfi7 : PUT - for me
00000400:00000200:29.0:1773851863.648739:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21730@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.648740:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c3cb711 nid 21730@kfi7 refs 1
00000400:00000200:29.0:1773851863.648742:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21730@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.648743:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c3cb711 nid 21730@kfi7 refs 2
00000400:00000200:29.0:1773851863.648744:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008c3cb711 nid 21730@kfi7 refs 3
00000400:00000200:29.0:1773851863.648745:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21539@kfi7 to cpt 7
00000400:00000200:29.0:1773851863.648746:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21539@kfi7 of length 224 into portal 12 MB=0x69b0974984680
00000400:00000200:29.0:1773851863.648748:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21539@kfi7 of length 224/224 into md 0x77fe139dd [64] + 172168
00000800:00000200:29.0:1773851863.648750:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851863.648752:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851863.648753:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21730@kfi7: PUT: OK
00000100:00000001:29.0:1773851863.648754:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851863.648755:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851863.648756:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cb82d82f.
00000100:00000040:29.0:1773851863.648756:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000cb82d82f x1859314773411456 msgsize 224
00000100:00100000:29.0:1773851863.648758:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21539@kfi7 (source: 12345-21730@kfi7)
00000100:00000001:29.0:1773851863.648759:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851863.648760:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008c3cb711 nid 21730@kfi7 refs 2
00000100:00000001:31.0:1773851863.648762:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851863.648762:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851863.648762:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851863.648763:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851863.648764:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851863.648765:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851863.648766:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314773411456
00000020:00000001:31.0:1773851863.648767:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851863.648767:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bc1
00000020:00000001:31.0:1773851863.648768:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851863.648771:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006109841f refcount=6
00000020:00000001:31.0:1773851863.648771:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743929856 : -107128965621760 : ffff9e91180f1800)
00000020:00000001:31.0:1773851863.648773:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743929856 : -107128965621760 : ffff9e91180f1800)
00000100:00000001:31.0:1773851863.648774:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851863.648775:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851863.648775:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000259b265.
00000020:00000010:31.0:1773851863.648777:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851863.648777:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851863.648779:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851863.648779:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851863.648780:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.648781:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851863.648782:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851863.648783:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.648784:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851863.648785:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851863.648785:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851863.648786:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851863.648786:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851863.648787:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21539@kfi7, seq: 2055505
00000100:00000040:31.0:1773851863.648788:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006109841f : new rpc_count 1
00000100:00000001:28.0:1773851863.648788:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.648789:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343697280 : -106994365854336 : ffff9eb06ed48d80)
00000100:00000001:28.0:1773851863.648789:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851863.648791:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cb82d82f x1859314773411456/t0(0) o400->ada49b25-91bb-4d2e-a198-f089492085f2@21539@kfi7:651/0 lens 224/0 e 0 to 0 dl 1773852011 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1835-0'
00000100:00000001:31.0:1773851863.648796:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851863.648797:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851863.648799:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb82d82f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ada49b25-91bb-4d2e-a198-f089492085f2+6:39777:x1859314773411456:12345-21539@kfi7:400:default-tuolumne1835-0
00000100:00000200:31.0:1773851863.648801:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314773411456
00000020:00000001:31.0:1773851863.648807:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851863.648808:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851863.648809:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.648810:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851863.648811:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851863.648813:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851863.648814:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314773411456, found 0 last_xid 1859314773411455
00000020:00000001:31.0:1773851863.648815:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851863.648817:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851863.648817:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851863.648818:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.648820:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851863.648821:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851863.648822:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851863.648824:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004da15451.
02000000:00000001:31.0:1773851863.648825:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.648826:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.648828:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851863.648829:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106928050, transno 0, xid 1859314773411456
00010000:00000001:31.0:1773851863.648831:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851863.648832:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cb82d82f x1859314773411456/t0(0) o400->ada49b25-91bb-4d2e-a198-f089492085f2@21539@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1835-0'
00010000:00000001:31.0:1773851863.648837:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851863.648838:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851863.648839:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=96 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851863.648841:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851863.648842:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d2d61f69 refcount 3 to 21539@kfi7
00000100:00000001:31.0:1773851863.648844:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412880576 : -107156296671040 : ffff9e8abb0060c0)
02000000:00000001:31.0:1773851863.648845:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851863.648846:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851863.648847:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851863.648849:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21730@kfi7
00000400:00000010:31.0:1773851863.648850:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000761d5a45.
00000100:00000200:31.0:1773851863.648851:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314773411456, offset 224
00000400:00000200:31.0:1773851863.648854:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21730@kfi7
00000400:00000200:31.0:1773851863.648856:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21730@kfi7 to cpt 7
00000400:00000200:31.0:1773851863.648857:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c3cb711 nid 21730@kfi7 refs 1
00000400:00000200:31.0:1773851863.648859:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008c3cb711 nid 21730@kfi7 refs 2
00000400:00000200:31.0:1773851863.648861:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008c3cb711 nid 21730@kfi7 refs 3
00000400:00000200:31.0:1773851863.648864:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21730@kfi7 local destination
00000400:00000200:31.0:1773851863.648866:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769075:8769075:1024:4294967295] 21730@kfi7 LPNI seq info [5865618:5865618:16:4294967295]
00000400:00000200:31.0:1773851863.648869:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008c3cb711 nid 21730@kfi7 refs 2
00000400:00000200:31.0:1773851863.648870:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21730@kfi7 to cpt 7
00000400:00000200:31.0:1773851863.648874:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21730@kfi7(21730@kfi7:21730@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851863.648876:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008c3cb711 nid 21730@kfi7 refs 3
00000800:00000200:31.0:1773851863.648879:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851863.648881:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851863.648885:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851863.648889:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f8e Using peer 21730@kfi7(0x100000000000f8e)
00000800:00000200:31.0:1773851863.648894:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x100000000000f8e: rc=0
00000800:00000200:31.0:1773851863.648896:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f8e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851863.648900:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851863.648901:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d2d61f69 refcount 2 to 21539@kfi7
00010000:00000001:31.0:1773851863.648902:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851863.648903:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851863.648904:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851863.648905:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cb82d82f x1859314773411456/t0(0) o400->ada49b25-91bb-4d2e-a198-f089492085f2@21539@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1835-0'
00000800:00000200:30.0:1773851863.648908:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f8e TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851863.648909:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851863.648910:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21730@kfi7: PUT: OK
00000100:00100000:31.0:1773851863.648911:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb82d82f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ada49b25-91bb-4d2e-a198-f089492085f2+6:39777:x1859314773411456:12345-21539@kfi7:400:default-tuolumne1835-0 Request processed in 114us (153us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851863.648911:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000761d5a45
00000400:00000010:30.0:1773851863.648911:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000761d5a45.
00000100:00000001:30.0:1773851863.648912:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851863.648912:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851863.648913:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008c3cb711 nid 21730@kfi7 refs 2
00000800:00000200:30.0:1773851863.648915:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 21730@kfi7(00000000c2d87702):0x0 lsk 3983 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f8e Transaction freed
00000100:00100000:31.0:1773851863.648918:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21539@kfi7, seq: 2055505
00000100:00000040:31.0:1773851863.648919:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006109841f : new rpc_count 0
00000100:00000001:31.0:1773851863.648921:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851863.648922:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851863.648923:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851863.648924:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000020:00000010:31.0:1773851863.648925:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000259b265.
00000020:00000040:31.0:1773851863.648927:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000006109841f : new refcount 5
00000100:00000001:31.0:1773851863.648928:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851863.660944:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.660944:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851863.660946:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851863.660948:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851863.660950:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18961@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.660951:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18961@kfi7 : PUT - for me
00000400:00000200:5.0:1773851863.660952:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18961@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.660954:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009438a317 nid 18961@kfi7 refs 1
00000400:00000200:5.0:1773851863.660955:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18961@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.660955:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009438a317 nid 18961@kfi7 refs 2
00000400:00000200:5.0:1773851863.660956:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009438a317 nid 18961@kfi7 refs 3
00000400:00000200:5.0:1773851863.660957:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19152@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.660958:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19152@kfi7 of length 224 into portal 12 MB=0x699e1316e9700
00000400:00000200:5.0:1773851863.660959:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19152@kfi7 of length 224/224 into md 0x793926dc5 [64] + 131192
00000800:00000200:5.0:1773851863.660961:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851863.660963:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851863.660964:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18961@kfi7: PUT: OK
00000100:00000001:5.0:1773851863.660965:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851863.660965:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851863.660966:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f63690ce.
00000100:00000040:5.0:1773851863.660967:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000f63690ce x1858042336286464 msgsize 224
00000100:00100000:5.0:1773851863.660968:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19152@kfi7 (source: 12345-18961@kfi7)
00000100:00000001:5.0:1773851863.660969:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851863.660970:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851863.660970:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009438a317 nid 18961@kfi7 refs 2
02000000:00000001:7.0:1773851863.660971:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851863.660971:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851863.660971:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851863.660972:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851863.660973:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851863.660973:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042336286464
00000020:00000001:7.0:1773851863.660974:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851863.660974:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b0b
00000020:00000001:7.0:1773851863.660975:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851863.660977:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000054eb332c refcount=6
00000020:00000001:7.0:1773851863.660978:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743673856 : -107128965877760 : ffff9e91180b3000)
00000020:00000001:7.0:1773851863.660979:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743673856 : -107128965877760 : ffff9e91180b3000)
00000100:00000001:7.0:1773851863.660980:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851863.660981:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851863.660981:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f72fd39.
00000020:00000010:7.0:1773851863.660982:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851863.660983:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851863.660984:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851863.660985:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851863.660986:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.660987:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851863.660987:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851863.660988:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851863.660989:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.660990:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851863.660990:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851863.660990:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851863.660990:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851863.660992:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851863.660992:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19152@kfi7, seq: 2001899
00000100:00000040:5.0:1773851863.660992:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000054eb332c : new rpc_count 1
00000100:00000001:7.0:1773851863.660993:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.660993:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136106896000 : -106937602655616 : ffff9ebda62e3a80)
00000100:00000040:5.0:1773851863.660994:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f63690ce x1858042336286464/t0(0) o400->8b5d51b5-2404-40ca-bd2c-67e0b501d7ec@19152@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1681-0'
00000100:00000001:5.0:1773851863.660997:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851863.660997:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851863.660998:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f63690ce pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:8b5d51b5-2404-40ca-bd2c-67e0b501d7ec+6:39644:x1858042336286464:12345-19152@kfi7:400:default-tuolumne1681-0
00000100:00000200:5.0:1773851863.661001:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042336286464
00000020:00000001:5.0:1773851863.661002:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851863.661003:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851863.661004:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.661004:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851863.661005:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851863.661006:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851863.661006:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042336286464, found 0 last_xid 1858042336286463
00000020:00000001:5.0:1773851863.661007:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851863.661008:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851863.661008:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851863.661009:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.661010:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851863.661010:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851863.661011:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851863.661011:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005299f7bc.
02000000:00000001:5.0:1773851863.661012:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.661013:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.661013:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851863.661014:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693532, transno 0, xid 1858042336286464
00010000:00000001:5.0:1773851863.661015:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851863.661016:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f63690ce x1858042336286464/t0(0) o400->8b5d51b5-2404-40ca-bd2c-67e0b501d7ec@19152@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1681-0'
00010000:00000001:5.0:1773851863.661018:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851863.661019:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851863.661019:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=95 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851863.661021:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851863.661021:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e4f30647 refcount 3 to 19152@kfi7
00000100:00000001:5.0:1773851863.661022:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405409984 : -107145304141632 : ffff9e8d4a3510c0)
02000000:00000001:5.0:1773851863.661023:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851863.661023:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.661024:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851863.661025:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18961@kfi7
00000400:00000010:5.0:1773851863.661025:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000401e06b4.
00000100:00000200:5.0:1773851863.661027:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042336286464, offset 224
00000400:00000200:5.0:1773851863.661028:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18961@kfi7
00000400:00000200:5.0:1773851863.661029:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18961@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.661030:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009438a317 nid 18961@kfi7 refs 1
00000400:00000200:5.0:1773851863.661031:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009438a317 nid 18961@kfi7 refs 2
00000400:00000200:5.0:1773851863.661032:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009438a317 nid 18961@kfi7 refs 3
00000400:00000200:5.0:1773851863.661033:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18961@kfi7 local destination
00000400:00000200:5.0:1773851863.661034:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769076:8769076:1024:4294967295] 18961@kfi7 LPNI seq info [18340754:18340754:16:4294967295]
00000400:00000200:5.0:1773851863.661036:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009438a317 nid 18961@kfi7 refs 2
00000400:00000200:5.0:1773851863.661036:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18961@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.661038:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18961@kfi7(18961@kfi7:18961@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851863.661040:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009438a317 nid 18961@kfi7 refs 3
00000800:00000200:5.0:1773851863.661041:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.661042:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851863.661044:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851863.661046:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe4c Using peer 18961@kfi7(0xe4c)
00000800:00000200:5.0:1773851863.661049:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0xe4c: rc=0
00000800:00000200:5.0:1773851863.661050:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe4c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851863.661053:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851863.661054:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e4f30647 refcount 2 to 19152@kfi7
00010000:00000001:5.0:1773851863.661054:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851863.661055:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.661056:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851863.661056:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f63690ce x1858042336286464/t0(0) o400->8b5d51b5-2404-40ca-bd2c-67e0b501d7ec@19152@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1681-0'
00000100:00100000:5.0:1773851863.661060:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f63690ce pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:8b5d51b5-2404-40ca-bd2c-67e0b501d7ec+6:39644:x1858042336286464:12345-19152@kfi7:400:default-tuolumne1681-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851863.661062:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19152@kfi7, seq: 2001899
00000100:00000040:5.0:1773851863.661063:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000054eb332c : new rpc_count 0
00000100:00000001:5.0:1773851863.661064:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851863.661064:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:6.0:1773851863.661065:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe4c TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851863.661065:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:5.0:1773851863.661066:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000400:00000200:6.0:1773851863.661067:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851863.661067:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f72fd39.
00000400:00000200:6.0:1773851863.661068:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18961@kfi7: PUT: OK
00000020:00000040:5.0:1773851863.661068:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000054eb332c : new refcount 5
00000400:00000200:6.0:1773851863.661069:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000401e06b4
00000400:00000010:6.0:1773851863.661069:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000401e06b4.
00000100:00000001:5.0:1773851863.661069:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851863.661070:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851863.661071:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851863.661072:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009438a317 nid 18961@kfi7 refs 2
00000800:00000200:6.0:1773851863.661073:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 18961@kfi7(000000009711ca66):0x0 lsk 3661 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe4c Transaction freed
00000800:00000200:1.0:1773851863.692130:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851863.692131:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851863.692133:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851863.692135:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851863.692137:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17840@kfi7 to cpt 0
00000400:00000200:1.0:1773851863.692138:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17840@kfi7 : PUT - for me
00000400:00000200:1.0:1773851863.692139:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17840@kfi7 to cpt 0
00000400:00000200:1.0:1773851863.692140:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b710544c nid 17840@kfi7 refs 1
00000400:00000200:1.0:1773851863.692141:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17840@kfi7 to cpt 0
00000400:00000200:1.0:1773851863.692142:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b710544c nid 17840@kfi7 refs 2
00000400:00000200:1.0:1773851863.692143:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b710544c nid 17840@kfi7 refs 3
00000400:00000200:1.0:1773851863.692144:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17777@kfi7 to cpt 7
00000400:00000200:1.0:1773851863.692145:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17777@kfi7 of length 224 into portal 12 MB=0x69b1714574780
00000400:00000200:1.0:1773851863.692146:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17777@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 25144
00000800:00000200:1.0:1773851863.692148:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851863.692150:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851863.692151:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17840@kfi7: PUT: OK
00000100:00000001:1.0:1773851863.692152:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851863.692152:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851863.692153:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009e478b2c.
00000100:00000040:1.0:1773851863.692154:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000009e478b2c x1859373288081280 msgsize 224
00000100:00100000:1.0:1773851863.692155:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-17777@kfi7 (source: 12345-17840@kfi7)
00000100:00000001:1.0:1773851863.692156:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851863.692157:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b710544c nid 17840@kfi7 refs 2
00000100:00000001:0.0:1773851863.692158:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851863.692159:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851863.692159:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851863.692159:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851863.692160:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851863.692160:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851863.692162:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373288081280
00000020:00000001:0.0:1773851863.692162:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851863.692163:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d0c
00000020:00000001:0.0:1773851863.692163:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851863.692166:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7cea650 refcount=168
00000020:00000001:0.0:1773851863.692166:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395720192 : -107136313831424 : ffff9e8f62125000)
00000020:00000001:0.0:1773851863.692167:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395720192 : -107136313831424 : ffff9e8f62125000)
00000100:00000001:0.0:1773851863.692168:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851863.692169:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851863.692169:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d0934e84.
00000020:00000010:0.0:1773851863.692170:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851863.692171:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851863.692172:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851863.692173:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851863.692173:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851863.692174:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851863.692175:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851863.692175:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.692176:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851863.692177:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851863.692177:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851863.692178:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851863.692178:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851863.692178:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17777@kfi7, seq: 1997543
00000100:00000001:1.0:1773851863.692179:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851863.692179:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7cea650 : new rpc_count 1
00000100:00000001:1.0:1773851863.692180:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.692180:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856591616 : -106915852960000 : ffff9ec2b6903f00)
00000100:00000040:0.0:1773851863.692181:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009e478b2c x1859373288081280/t0(0) o400->43552797-cdad-44d1-ae09-5f3ead2cfc26@17777@kfi7:503/0 lens 224/0 e 0 to 0 dl 1773852618 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1598-0'
00000100:00000001:0.0:1773851863.692183:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851863.692184:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851863.692185:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e478b2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:43552797-cdad-44d1-ae09-5f3ead2cfc26+168:39674:x1859373288081280:12345-17777@kfi7:400:default-tuolumne1598-0
00000100:00000200:0.0:1773851863.692186:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373288081280
00000020:00000001:0.0:1773851863.692187:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851863.692187:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851863.692189:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.692189:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851863.692190:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851863.692191:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851863.692191:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373288081280, found 0 last_xid 1859373287662591
00000020:00000001:0.0:1773851863.692192:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851863.692193:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851863.692193:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851863.692194:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.692194:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851863.692195:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851863.692195:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851863.692196:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008efe7923.
02000000:00000001:0.0:1773851863.692196:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.692197:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.692198:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851863.692198:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062231, transno 0, xid 1859373288081280
00010000:00000001:0.0:1773851863.692199:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851863.692200:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009e478b2c x1859373288081280/t0(0) o400->43552797-cdad-44d1-ae09-5f3ead2cfc26@17777@kfi7:503/0 lens 224/224 e 0 to 0 dl 1773852618 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1598-0'
00010000:00000001:0.0:1773851863.692202:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851863.692202:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851863.692203:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=96 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851863.692204:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851863.692205:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007c44c38b refcount 3 to 17777@kfi7
00000100:00000001:0.0:1773851863.692206:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065280 : -107155994486336 : ffff9e8acd0359c0)
02000000:00000001:0.0:1773851863.692207:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851863.692207:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.692208:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851863.692209:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17840@kfi7
00000400:00000010:0.0:1773851863.692209:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004dfb4d66.
00000100:00000200:0.0:1773851863.692210:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373288081280, offset 224
00000400:00000200:0.0:1773851863.692212:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17840@kfi7
00000400:00000200:0.0:1773851863.692212:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17840@kfi7 to cpt 0
00000400:00000200:0.0:1773851863.692213:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b710544c nid 17840@kfi7 refs 1
00000400:00000200:0.0:1773851863.692215:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b710544c nid 17840@kfi7 refs 2
00000400:00000200:0.0:1773851863.692216:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b710544c nid 17840@kfi7 refs 3
00000400:00000200:0.0:1773851863.692217:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17840@kfi7 local destination
00000400:00000200:0.0:1773851863.692218:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769077:8769077:1024:4294967295] 17840@kfi7 LPNI seq info [5092552:5092552:16:4294967295]
00000400:00000200:0.0:1773851863.692220:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b710544c nid 17840@kfi7 refs 2
00000400:00000200:0.0:1773851863.692220:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17840@kfi7 to cpt 0
00000400:00000200:0.0:1773851863.692222:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17840@kfi7(17840@kfi7:17840@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851863.692223:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b710544c nid 17840@kfi7 refs 3
00000800:00000200:0.0:1773851863.692225:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851863.692226:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851863.692228:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851863.692230:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000076d Using peer 17840@kfi7(0x10000000000076d)
00000800:00000200:0.0:1773851863.692234:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x10000000000076d: rc=0
00000800:00000200:0.0:1773851863.692235:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000076d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851863.692237:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851863.692238:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007c44c38b refcount 2 to 17777@kfi7
00010000:00000001:0.0:1773851863.692238:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851863.692239:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.692239:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851863.692240:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009e478b2c x1859373288081280/t0(0) o400->43552797-cdad-44d1-ae09-5f3ead2cfc26@17777@kfi7:503/0 lens 224/224 e 0 to 0 dl 1773852618 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1598-0'
00000100:00100000:0.0:1773851863.692244:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e478b2c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:43552797-cdad-44d1-ae09-5f3ead2cfc26+168:39674:x1859373288081280:12345-17777@kfi7:400:default-tuolumne1598-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851863.692247:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17777@kfi7, seq: 1997543
00000100:00000040:0.0:1773851863.692248:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7cea650 : new rpc_count 0
00000100:00000001:0.0:1773851863.692249:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851863.692249:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851863.692250:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851863.692251:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851863.692251:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d0934e84.
00000020:00000040:0.0:1773851863.692252:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000a7cea650 : new refcount 167
00000100:00000001:0.0:1773851863.692253:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851863.692259:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000076d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851863.692260:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851863.692262:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17840@kfi7: PUT: OK
00000400:00000200:1.0:1773851863.692262:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004dfb4d66
00000400:00000010:1.0:1773851863.692263:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004dfb4d66.
00000100:00000001:1.0:1773851863.692264:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851863.692264:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851863.692265:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b710544c nid 17840@kfi7 refs 2
00000800:00000200:1.0:1773851863.692267:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 17840@kfi7(0000000041ef26a1):0x0 lsk 1902 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000076d Transaction freed
00000800:00000200:13.0:1773851863.720771:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851863.720773:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851863.720775:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851863.720777:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851863.720779:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22386@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.720780:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22386@kfi7 : PUT - for me
00000400:00000200:13.0:1773851863.720781:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22386@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.720783:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009185bbe5 nid 22386@kfi7 refs 1
00000400:00000200:13.0:1773851863.720784:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22386@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.720784:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009185bbe5 nid 22386@kfi7 refs 2
00000400:00000200:13.0:1773851863.720785:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009185bbe5 nid 22386@kfi7 refs 3
00000400:00000200:13.0:1773851863.720786:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22450@kfi7 to cpt 7
00000400:00000200:13.0:1773851863.720787:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22450@kfi7 of length 224 into portal 12 MB=0x69aef7335fa40
00000400:00000200:13.0:1773851863.720789:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22450@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 25544
00000800:00000200:13.0:1773851863.720790:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851863.720792:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851863.720793:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22386@kfi7: PUT: OK
00000100:00000001:13.0:1773851863.720794:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851863.720795:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851863.720796:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b91cf882.
00000100:00000040:13.0:1773851863.720797:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000b91cf882 x1859203081042496 msgsize 224
00000100:00100000:13.0:1773851863.720799:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22450@kfi7 (source: 12345-22386@kfi7)
00000100:00000001:13.0:1773851863.720800:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851863.720801:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009185bbe5 nid 22386@kfi7 refs 2
00000800:00000200:13.0:1773851863.720802:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2069@kfi7:3 <- 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851863.720805:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851863.720806:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851863.720806:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851863.720807:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851863.720808:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851863.720809:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859203081042496
00000020:00000001:13.0:1773851863.720809:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851863.720810:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bd6
00000020:00000001:13.0:1773851863.720810:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851863.720815:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c4224209 refcount=8
00000020:00000001:13.0:1773851863.720816:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743937024 : -107128965614592 : ffff9e91180f3400)
00000020:00000001:13.0:1773851863.720817:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743937024 : -107128965614592 : ffff9e91180f3400)
00000100:00000001:13.0:1773851863.720817:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851863.720818:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851863.720819:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092eb84b1.
00000020:00000010:13.0:1773851863.720820:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851863.720821:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009802e6cf.
00000100:00000001:13.0:1773851863.720822:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851863.720822:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851863.720823:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851863.720824:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851863.720824:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851863.720825:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.720826:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851863.720827:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851863.720827:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851863.720827:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851863.720828:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851863.720829:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851863.720829:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22450@kfi7, seq: 2289820
00000100:00000040:13.0:1773851863.720829:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c4224209 : new rpc_count 1
00000100:00000001:15.0:1773851863.720830:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.720830:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637152534596992 : -106921174954624 : ffff9ec179590d80)
00000100:00000040:13.0:1773851863.720831:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b91cf882 x1859203081042496/t0(0) o400->74ab6528-f4ea-47e3-9c39-7f8171aa91b9@22450@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1882-0'
00000100:00000001:13.0:1773851863.720834:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851863.720834:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851863.720835:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b91cf882 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:74ab6528-f4ea-47e3-9c39-7f8171aa91b9+8:39832:x1859203081042496:12345-22450@kfi7:400:default-tuolumne1882-0
00000100:00000200:13.0:1773851863.720837:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859203081042496
00000020:00000001:13.0:1773851863.720837:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851863.720838:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851863.720839:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.720840:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851863.720840:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851863.720841:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851863.720842:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859203081042496, found 0 last_xid 1859203081042495
00000020:00000001:13.0:1773851863.720842:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851863.720843:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851863.720844:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851863.720844:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.720845:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851863.720845:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851863.720846:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851863.720846:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000822bb132.
02000000:00000001:13.0:1773851863.720847:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.720848:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.720848:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851863.720849:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044131942, transno 0, xid 1859203081042496
00010000:00000001:13.0:1773851863.720850:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851863.720851:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b91cf882 x1859203081042496/t0(0) o400->74ab6528-f4ea-47e3-9c39-7f8171aa91b9@22450@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1882-0'
00010000:00000001:13.0:1773851863.720853:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851863.720854:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851863.720854:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=96 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851863.720855:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851863.720856:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ce29657 refcount 3 to 22450@kfi7
00000100:00000001:13.0:1773851863.720857:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932384 : -107137839619232 : ffff9e8f0720a360)
02000000:00000001:13.0:1773851863.720858:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851863.720858:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851863.720859:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851863.720860:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22386@kfi7
00000400:00000010:13.0:1773851863.720860:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000a09a418.
00000100:00000200:13.0:1773851863.720861:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859203081042496, offset 224
00000400:00000200:13.0:1773851863.720862:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22386@kfi7
00000400:00000200:13.0:1773851863.720863:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22386@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.720865:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009185bbe5 nid 22386@kfi7 refs 1
00000400:00000200:13.0:1773851863.720866:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009185bbe5 nid 22386@kfi7 refs 2
00000400:00000200:13.0:1773851863.720867:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009185bbe5 nid 22386@kfi7 refs 3
00000400:00000200:13.0:1773851863.720868:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22386@kfi7 local destination
00000400:00000200:13.0:1773851863.720869:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769078:8769078:1024:4294967295] 22386@kfi7 LPNI seq info [12047084:12047084:16:4294967295]
00000400:00000200:13.0:1773851863.720871:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009185bbe5 nid 22386@kfi7 refs 2
00000400:00000200:13.0:1773851863.720871:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22386@kfi7 to cpt 3
00000400:00000200:13.0:1773851863.720873:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22386@kfi7(22386@kfi7:22386@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851863.720874:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009185bbe5 nid 22386@kfi7 refs 3
00000800:00000200:13.0:1773851863.720876:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851863.720877:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851863.720879:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851863.720881:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc79 Using peer 22386@kfi7(0xc79)
00000800:00000200:13.0:1773851863.720884:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 324 bytes to peer 0xc79: rc=0
00000800:00000200:13.0:1773851863.720886:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851863.720888:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851863.720890:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ce29657 refcount 2 to 22450@kfi7
00010000:00000001:13.0:1773851863.720890:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851863.720891:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851863.720892:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851863.720893:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b91cf882 x1859203081042496/t0(0) o400->74ab6528-f4ea-47e3-9c39-7f8171aa91b9@22450@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1882-0'
00000100:00100000:13.0:1773851863.720896:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b91cf882 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:74ab6528-f4ea-47e3-9c39-7f8171aa91b9+8:39832:x1859203081042496:12345-22450@kfi7:400:default-tuolumne1882-0 Request processed in 62us (99us total) trans 0 rc 0/0
00000800:00000200:15.0:1773851863.720899:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc79 TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851863.720899:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22450@kfi7, seq: 2289820
00000400:00000200:15.0:1773851863.720901:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:13.0:1773851863.720901:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c4224209 : new rpc_count 0
00000100:00000001:13.0:1773851863.720902:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:15.0:1773851863.720903:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22386@kfi7: PUT: OK
00000100:00000001:13.0:1773851863.720903:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:15.0:1773851863.720904:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000a09a418
00000020:00000010:13.0:1773851863.720904:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851863.720904:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009802e6cf.
00000400:00000010:15.0:1773851863.720905:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000a09a418.
00000100:00000001:15.0:1773851863.720905:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:13.0:1773851863.720905:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092eb84b1.
00000100:00000001:15.0:1773851863.720906:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:13.0:1773851863.720906:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c4224209 : new refcount 7
00000400:00000200:15.0:1773851863.720907:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009185bbe5 nid 22386@kfi7 refs 2
00000100:00000001:13.0:1773851863.720907:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851863.720909:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2069@kfi7:3 -> 22386@kfi7(000000001ac8e635):0x0 lsk 3194 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc79 Transaction freed
00000800:00000200:25.0:1773851863.759937:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851863.759938:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851863.759939:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851863.759942:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851863.759943:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.759944:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9467@kfi7 : PUT - for me
00000400:00000200:25.0:1773851863.759945:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.759946:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 1
00000400:00000200:25.0:1773851863.759947:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.759947:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 2
00000400:00000200:25.0:1773851863.759948:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 3
00000400:00000200:25.0:1773851863.759949:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.759950:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9467@kfi7 of length 224 into portal 12 MB=0x699de8d13b840
00000400:00000200:25.0:1773851863.759952:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9467@kfi7 of length 224/224 into md 0x16159c9699 [64] + 1120
00000800:00000200:25.0:1773851863.759953:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851863.759955:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851863.759956:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9467@kfi7: PUT: OK
00000100:00000001:25.0:1773851863.759957:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851863.759957:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851863.759958:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000e9cae52.
00000100:00000040:25.0:1773851863.759959:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000000e9cae52 x1858030988933184 msgsize 224
00000100:00100000:25.0:1773851863.759960:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9467@kfi7 (source: 12345-9467@kfi7)
00000100:00000001:25.0:1773851863.759962:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851863.759962:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 2
00000800:00000200:25.0:1773851863.759964:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851863.759968:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851863.759969:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851863.759969:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851863.759970:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851863.759971:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851863.759972:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030988933184
00000020:00000001:25.0:1773851863.759972:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851863.759972:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9131e
00000020:00000001:25.0:1773851863.759973:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851863.759975:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006972e7e0 refcount=6
00000020:00000001:25.0:1773851863.759976:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716208640 : -107155993342976 : ffff9e8acd14cc00)
00000020:00000001:25.0:1773851863.759976:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716208640 : -107155993342976 : ffff9e8acd14cc00)
00000100:00000001:25.0:1773851863.759978:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851863.759978:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851863.759979:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000212fefaf.
00000020:00000010:25.0:1773851863.759980:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851863.759981:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094918347.
00000100:00000001:25.0:1773851863.759982:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851863.759982:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851863.759982:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851863.759983:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851863.759984:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851863.759984:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.759985:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851863.759986:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851863.759986:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851863.759987:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851863.759987:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851863.759988:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9467@kfi7, seq: 2025086
00000100:00000040:25.0:1773851863.759988:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006972e7e0 : new rpc_count 1
00000100:00000001:25.0:1773851863.759989:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478751232 : -106938230800384 : ffff9ebd80bd8000)
00000100:00000001:24.0:1773851863.759989:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851863.759989:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851863.759990:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000e9cae52 x1858030988933184/t0(0) o400->b9acd434-b4ab-4b3d-b3d1-fa5f3bc1d943@9467@kfi7:80/0 lens 224/0 e 0 to 0 dl 1773852195 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne205-0'
00000100:00000001:25.0:1773851863.759993:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851863.759993:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851863.759994:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e9cae52 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b9acd434-b4ab-4b3d-b3d1-fa5f3bc1d943+6:47865:x1858030988933184:12345-9467@kfi7:400:default-tuolumne205-0
00000100:00000200:25.0:1773851863.759996:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030988933184
00000020:00000001:25.0:1773851863.759996:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851863.759997:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851863.759997:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.759998:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851863.759999:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851863.759999:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851863.760000:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030988933184, found 0 last_xid 1858030988933183
00000020:00000001:25.0:1773851863.760001:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851863.760001:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851863.760002:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851863.760002:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.760003:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851863.760004:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851863.760004:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851863.760005:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005eaccae8.
02000000:00000001:25.0:1773851863.760005:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.760006:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.760007:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851863.760007:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768355, transno 0, xid 1858030988933184
00010000:00000001:25.0:1773851863.760008:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851863.760009:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000e9cae52 x1858030988933184/t0(0) o400->b9acd434-b4ab-4b3d-b3d1-fa5f3bc1d943@9467@kfi7:80/0 lens 224/224 e 0 to 0 dl 1773852195 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne205-0'
00010000:00000001:25.0:1773851863.760011:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851863.760012:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851863.760013:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=96 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851863.760014:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851863.760014:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f29464b0 refcount 5 to 9467@kfi7
00000100:00000001:25.0:1773851863.760015:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329568 : -107155410222048 : ffff9e8aefd68420)
02000000:00000001:25.0:1773851863.760016:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851863.760016:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851863.760017:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851863.760018:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9467@kfi7
00000400:00000010:25.0:1773851863.760019:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007af4f389.
00000100:00000200:25.0:1773851863.760019:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030988933184, offset 224
00000400:00000200:25.0:1773851863.760021:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9467@kfi7
00000400:00000200:25.0:1773851863.760021:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.760022:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 1
00000400:00000200:25.0:1773851863.760023:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 2
00000400:00000200:25.0:1773851863.760024:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 3
00000400:00000200:25.0:1773851863.760025:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9467@kfi7 local destination
00000400:00000200:25.0:1773851863.760026:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769079:8769079:1024:4294967295] 9467@kfi7 LPNI seq info [28172:28172:16:4294967295]
00000400:00000200:25.0:1773851863.760028:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 2
00000400:00000200:25.0:1773851863.760028:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851863.760030:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9467@kfi7(9467@kfi7:9467@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851863.760031:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 3
00000800:00000200:25.0:1773851863.760032:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851863.760033:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2069@kfi7:6 -> 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851863.760035:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2069@kfi7:6 -> 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851863.760037:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2069@kfi7:6 -> 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x476 Using peer 9467@kfi7(0x476)
00000800:00000200:25.0:1773851863.760040:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000f6d78ee2: Posted send of 324 bytes to peer 0x476: rc=0
00000800:00000200:25.0:1773851863.760041:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2069@kfi7:6 -> 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x476 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851863.760043:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851863.760044:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f29464b0 refcount 4 to 9467@kfi7
00010000:00000001:25.0:1773851863.760045:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851863.760045:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851863.760046:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851863.760046:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000e9cae52 x1858030988933184/t0(0) o400->b9acd434-b4ab-4b3d-b3d1-fa5f3bc1d943@9467@kfi7:80/0 lens 224/224 e 0 to 0 dl 1773852195 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne205-0'
00000100:00100000:25.0:1773851863.760052:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e9cae52 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b9acd434-b4ab-4b3d-b3d1-fa5f3bc1d943+6:47865:x1858030988933184:12345-9467@kfi7:400:default-tuolumne205-0 Request processed in 58us (93us total) trans 0 rc 0/0
00000800:00000200:27.0:1773851863.760054:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2069@kfi7:6 -> 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x476 TN_EVENT_TX_OK event status 0
00000100:00100000:25.0:1773851863.760055:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9467@kfi7, seq: 2025086
00000100:00000040:25.0:1773851863.760055:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006972e7e0 : new rpc_count 0
00000400:00000200:27.0:1773851863.760056:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851863.760056:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9467@kfi7: PUT: OK
00000100:00000001:25.0:1773851863.760056:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:27.0:1773851863.760057:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007af4f389
00000400:00000010:27.0:1773851863.760057:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007af4f389.
00000100:00000001:25.0:1773851863.760057:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851863.760057:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000100:00000001:27.0:1773851863.760058:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851863.760058:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:25.0:1773851863.760058:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094918347.
00000400:00000200:27.0:1773851863.760059:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 2
00000020:00000010:25.0:1773851863.760059:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000212fefaf.
00000020:00000040:25.0:1773851863.760059:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000006972e7e0 : new refcount 5
00000800:00000200:27.0:1773851863.760060:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2069@kfi7:6 -> 9467@kfi7(0000000029d9a91e):0x0 lsk 1143 rsk 85 tsk 0 trmk 0 tmk 0 trr 6 tta 0x476 Transaction freed
00000100:00000001:25.0:1773851863.760060:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851863.763412:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.763413:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851863.763414:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851863.763416:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851863.763419:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21553@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.763420:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21553@kfi7 : PUT - for me
00000400:00000200:9.0:1773851863.763421:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21553@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.763422:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ac6e46a nid 21553@kfi7 refs 1
00000400:00000200:9.0:1773851863.763423:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21553@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.763424:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ac6e46a nid 21553@kfi7 refs 2
00000400:00000200:9.0:1773851863.763425:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ac6e46a nid 21553@kfi7 refs 3
00000400:00000200:9.0:1773851863.763426:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21552@kfi7 to cpt 7
00000400:00000200:9.0:1773851863.763427:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21552@kfi7 of length 224 into portal 12 MB=0x699e150014200
00000400:00000200:9.0:1773851863.763428:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21552@kfi7 of length 224/224 into md 0x78146ce49 [64] + 132624
00000800:00000200:9.0:1773851863.763431:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851863.763432:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851863.763433:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21553@kfi7: PUT: OK
00000100:00000001:9.0:1773851863.763434:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851863.763435:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851863.763436:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000027c81be9.
00000100:00000040:9.0:1773851863.763437:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000027c81be9 x1858042849214976 msgsize 224
00000100:00100000:9.0:1773851863.763438:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21552@kfi7 (source: 12345-21553@kfi7)
00000100:00000001:9.0:1773851863.763439:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851863.763440:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ac6e46a nid 21553@kfi7 refs 2
00000800:00000200:9.0:1773851863.763442:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851863.763444:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851863.763445:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851863.763445:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851863.763446:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.763446:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851863.763447:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042849214976
00000020:00000001:9.0:1773851863.763448:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851863.763448:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92895
00000020:00000001:9.0:1773851863.763449:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851863.763451:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000134ecf31 refcount=6
00000020:00000001:9.0:1773851863.763451:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742951936 : -107128966599680 : ffff9e9118002c00)
00000020:00000001:9.0:1773851863.763452:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742951936 : -107128966599680 : ffff9e9118002c00)
00000100:00000001:9.0:1773851863.763453:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.763454:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851863.763455:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851863.763456:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.763456:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851863.763457:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851863.763457:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851863.763458:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.763459:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851863.763460:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851863.763460:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.763461:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851863.763462:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851863.763462:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851863.763463:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851863.763463:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851863.763464:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21552@kfi7, seq: 2130772
00000100:00000040:9.0:1773851863.763464:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000134ecf31 : new rpc_count 1
00000100:00000001:11.0:1773851863.763465:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851863.763465:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.763465:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922905088 : -107141786646528 : ffff9e8e1bddc800)
00000100:00000040:9.0:1773851863.763466:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000027c81be9 x1858042849214976/t0(0) o400->a6e240e5-4b3b-408a-acfe-9ce1cd23d483@21552@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1837-0'
00000100:00000001:9.0:1773851863.763469:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.763469:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851863.763470:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027c81be9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a6e240e5-4b3b-408a-acfe-9ce1cd23d483+6:39891:x1858042849214976:12345-21552@kfi7:400:default-tuolumne1837-0
00000100:00000200:9.0:1773851863.763471:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042849214976
00000020:00000001:9.0:1773851863.763472:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851863.763472:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851863.763473:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.763474:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851863.763474:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851863.763475:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851863.763476:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042849214976, found 0 last_xid 1858042849214975
00000020:00000001:9.0:1773851863.763476:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851863.763477:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851863.763478:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851863.763478:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.763479:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851863.763479:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851863.763480:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851863.763481:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a8762f07.
02000000:00000001:9.0:1773851863.763481:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.763482:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.763483:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851863.763483:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105530785, transno 0, xid 1858042849214976
00010000:00000001:9.0:1773851863.763485:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851863.763485:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000027c81be9 x1858042849214976/t0(0) o400->a6e240e5-4b3b-408a-acfe-9ce1cd23d483@21552@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1837-0'
00010000:00000001:9.0:1773851863.763488:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851863.763488:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851863.763489:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=96 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851863.763490:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851863.763490:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd877f9a refcount 3 to 21552@kfi7
00000100:00000001:9.0:1773851863.763491:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269376 : -107152618282240 : ffff9e8b96402300)
02000000:00000001:9.0:1773851863.763492:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851863.763493:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.763493:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851863.763494:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21553@kfi7
00000400:00000010:9.0:1773851863.763495:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000200:9.0:1773851863.763495:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042849214976, offset 224
00000400:00000200:9.0:1773851863.763496:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21553@kfi7
00000400:00000200:9.0:1773851863.763497:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21553@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.763498:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ac6e46a nid 21553@kfi7 refs 1
00000400:00000200:9.0:1773851863.763499:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ac6e46a nid 21553@kfi7 refs 2
00000400:00000200:9.0:1773851863.763500:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ac6e46a nid 21553@kfi7 refs 3
00000400:00000200:9.0:1773851863.763501:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21553@kfi7 local destination
00000400:00000200:9.0:1773851863.763502:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769080:8769080:1024:4294967295] 21553@kfi7 LPNI seq info [5606353:5606353:16:4294967295]
00000400:00000200:9.0:1773851863.763504:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ac6e46a nid 21553@kfi7 refs 2
00000400:00000200:9.0:1773851863.763505:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21553@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.763507:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21553@kfi7(21553@kfi7:21553@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851863.763508:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ac6e46a nid 21553@kfi7 refs 3
00000800:00000200:9.0:1773851863.763509:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.763510:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.763512:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851863.763516:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf85 Using peer 21553@kfi7(0xf85)
00000800:00000200:9.0:1773851863.763519:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0xf85: rc=0
00000800:00000200:9.0:1773851863.763520:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf85 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851863.763522:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.763523:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd877f9a refcount 2 to 21552@kfi7
00010000:00000001:9.0:1773851863.763524:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851863.763525:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.763525:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851863.763526:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000027c81be9 x1858042849214976/t0(0) o400->a6e240e5-4b3b-408a-acfe-9ce1cd23d483@21552@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1837-0'
00000100:00100000:9.0:1773851863.763529:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027c81be9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a6e240e5-4b3b-408a-acfe-9ce1cd23d483+6:39891:x1858042849214976:12345-21552@kfi7:400:default-tuolumne1837-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851863.763531:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21552@kfi7, seq: 2130772
00000800:00000200:11.0:1773851863.763532:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf85 TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851863.763532:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000134ecf31 : new rpc_count 0
00000100:00000001:9.0:1773851863.763532:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851863.763533:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851863.763533:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:11.0:1773851863.763534:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851863.763534:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:11.0:1773851863.763535:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21553@kfi7: PUT: OK
00000020:00000010:9.0:1773851863.763535:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:11.0:1773851863.763536:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000020:00000040:9.0:1773851863.763536:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000134ecf31 : new refcount 5
00000100:00000001:9.0:1773851863.763536:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:11.0:1773851863.763537:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000100:00000001:11.0:1773851863.763538:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851863.763538:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851863.763539:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ac6e46a nid 21553@kfi7 refs 2
00000800:00000200:11.0:1773851863.763541:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 21553@kfi7(00000000cd936665):0x0 lsk 3974 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf85 Transaction freed
00000800:00000200:9.0:1773851863.771688:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.771688:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851863.771690:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851863.771692:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851863.771694:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13280@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.771704:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13280@kfi7 : PUT - for me
00000400:00000200:9.0:1773851863.771705:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13280@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.771706:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be950bd7 nid 13280@kfi7 refs 1
00000400:00000200:9.0:1773851863.771707:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13280@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.771708:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be950bd7 nid 13280@kfi7 refs 2
00000400:00000200:9.0:1773851863.771708:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be950bd7 nid 13280@kfi7 refs 3
00000400:00000200:9.0:1773851863.771709:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13281@kfi7 to cpt 5
00000400:00000200:9.0:1773851863.771710:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13281@kfi7 of length 224 into portal 12 MB=0x69b4b59629880
00000400:00000200:9.0:1773851863.771711:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13281@kfi7 of length 224/224 into md 0x78146ce49 [64] + 132848
00000800:00000200:9.0:1773851863.771713:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851863.771714:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851863.771716:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13280@kfi7: PUT: OK
00000100:00000001:9.0:1773851863.771717:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851863.771717:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851863.771718:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000266058e9.
00000100:00000040:9.0:1773851863.771718:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000266058e9 x1859597784750208 msgsize 224
00000100:00100000:9.0:1773851863.771720:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13281@kfi7 (source: 12345-13280@kfi7)
00000100:00000001:9.0:1773851863.771721:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851863.771722:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be950bd7 nid 13280@kfi7 refs 2
00000800:00000200:9.0:1773851863.771723:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851863.771728:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851863.771729:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851863.771729:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851863.771729:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.771730:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851863.771731:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597784750208
00000020:00000001:9.0:1773851863.771731:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851863.771731:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7b3e9
00000020:00000001:9.0:1773851863.771732:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851863.771735:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d2184bf9 refcount=5
00000020:00000001:9.0:1773851863.771735:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136154933248 : -106937554618368 : ffff9ebda90b3800)
00000020:00000001:9.0:1773851863.771737:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136154933248 : -106937554618368 : ffff9ebda90b3800)
00000100:00000001:9.0:1773851863.771738:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.771739:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851863.771739:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851863.771740:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.771741:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851863.771741:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851863.771742:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851863.771742:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.771743:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851863.771743:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851863.771743:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.771744:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.771745:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851863.771746:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851863.771746:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851863.771746:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851863.771747:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851863.771747:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13281@kfi7, seq: 2130773
00000100:00000040:9.0:1773851863.771747:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d2184bf9 : new rpc_count 1
00000100:00000001:11.0:1773851863.771748:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.771748:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922914304 : -107141786637312 : ffff9e8e1bddec00)
00000100:00000040:9.0:1773851863.771749:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000266058e9 x1859597784750208/t0(0) o400->a9734765-7b0e-4601-9e25-f6e9ce4dbaa5@13281@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1311-0'
00000100:00000001:9.0:1773851863.771751:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851863.771751:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851863.771752:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000266058e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a9734765-7b0e-4601-9e25-f6e9ce4dbaa5+5:39723:x1859597784750208:12345-13281@kfi7:400:default-tuolumne1311-0
00000100:00000200:9.0:1773851863.771753:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597784750208
00000020:00000001:9.0:1773851863.771754:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851863.771754:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851863.771755:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.771755:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851863.771756:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851863.771757:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851863.771757:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597784750208, found 0 last_xid 1859597784750207
00000020:00000001:9.0:1773851863.771757:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851863.771759:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851863.771759:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851863.771759:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.771760:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851863.771760:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851863.771761:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851863.771762:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c5a11e25.
02000000:00000001:9.0:1773851863.771762:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.771763:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.771763:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851863.771764:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181461483842, transno 0, xid 1859597784750208
00010000:00000001:9.0:1773851863.771765:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851863.771765:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000266058e9 x1859597784750208/t0(0) o400->a9734765-7b0e-4601-9e25-f6e9ce4dbaa5@13281@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1311-0'
00010000:00000001:9.0:1773851863.771768:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851863.771768:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851863.771769:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=96 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851863.771769:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851863.771770:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000025dfc3d refcount 3 to 13281@kfi7
00000100:00000001:9.0:1773851863.771771:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027200 : -107156745524416 : ffff9e8aa03f6b40)
02000000:00000001:9.0:1773851863.771771:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851863.771772:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.771772:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851863.771773:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13280@kfi7
00000400:00000010:9.0:1773851863.771773:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003289b6e6.
00000100:00000200:9.0:1773851863.771774:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597784750208, offset 224
00000400:00000200:9.0:1773851863.771775:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13280@kfi7
00000400:00000200:9.0:1773851863.771776:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13280@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.771777:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be950bd7 nid 13280@kfi7 refs 1
00000400:00000200:9.0:1773851863.771777:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be950bd7 nid 13280@kfi7 refs 2
00000400:00000200:9.0:1773851863.771778:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be950bd7 nid 13280@kfi7 refs 3
00000400:00000200:9.0:1773851863.771779:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13280@kfi7 local destination
00000400:00000200:9.0:1773851863.771780:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769081:8769081:1024:4294967295] 13280@kfi7 LPNI seq info [521320:521320:16:4294967295]
00000400:00000200:9.0:1773851863.771782:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be950bd7 nid 13280@kfi7 refs 2
00000400:00000200:9.0:1773851863.771783:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13280@kfi7 to cpt 2
00000400:00000200:9.0:1773851863.771785:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13280@kfi7(13280@kfi7:13280@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851863.771786:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be950bd7 nid 13280@kfi7 refs 3
00000800:00000200:9.0:1773851863.771787:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851863.771788:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.771790:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851863.771792:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x119d Using peer 13280@kfi7(0x119d)
00000800:00000200:9.0:1773851863.771795:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x119d: rc=0
00000800:00000200:9.0:1773851863.771797:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x119d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851863.771798:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.771799:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000025dfc3d refcount 2 to 13281@kfi7
00010000:00000001:9.0:1773851863.771799:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851863.771800:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851863.771800:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851863.771801:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000266058e9 x1859597784750208/t0(0) o400->a9734765-7b0e-4601-9e25-f6e9ce4dbaa5@13281@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1311-0'
00000100:00100000:9.0:1773851863.771804:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000266058e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a9734765-7b0e-4601-9e25-f6e9ce4dbaa5+5:39723:x1859597784750208:12345-13281@kfi7:400:default-tuolumne1311-0 Request processed in 52us (85us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851863.771806:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13281@kfi7, seq: 2130773
00000800:00000200:10.0:1773851863.771807:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x119d TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851863.771807:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d2184bf9 : new rpc_count 0
00000400:00000200:10.0:1773851863.771808:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851863.771808:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851863.771808:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851863.771808:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851863.771809:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851863.771810:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13280@kfi7: PUT: OK
00000400:00000200:10.0:1773851863.771810:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003289b6e6
00000020:00000010:9.0:1773851863.771810:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851863.771810:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000d2184bf9 : new refcount 4
00000400:00000010:10.0:1773851863.771811:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003289b6e6.
00000100:00000001:10.0:1773851863.771811:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851863.771811:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851863.771811:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851863.771812:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be950bd7 nid 13280@kfi7 refs 2
00000800:00000200:10.0:1773851863.771813:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 13280@kfi7(000000008954b8b2):0x0 lsk 4510 rsk 57 tsk 0 trmk 0 tmk 0 trr 2 tta 0x119d Transaction freed
00000800:00000200:1.0:1773851863.824346:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851863.824346:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851863.824347:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851863.824349:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851863.824352:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10787@kfi7 to cpt 0
00000400:00000200:1.0:1773851863.824353:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10787@kfi7 : PUT - for me
00000400:00000200:1.0:1773851863.824354:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10787@kfi7 to cpt 0
00000400:00000200:1.0:1773851863.824355:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 1
00000400:00000200:1.0:1773851863.824356:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10787@kfi7 to cpt 0
00000400:00000200:1.0:1773851863.824356:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 2
00000400:00000200:1.0:1773851863.824357:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 3
00000400:00000200:1.0:1773851863.824358:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10978@kfi7 to cpt 7
00000400:00000200:1.0:1773851863.824359:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10978@kfi7 of length 224 into portal 12 MB=0x69b47743bd480
00000400:00000200:1.0:1773851863.824360:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10978@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 25368
00000800:00000200:1.0:1773851863.824362:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851863.824363:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851863.824364:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10787@kfi7: PUT: OK
00000100:00000001:1.0:1773851863.824365:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851863.824366:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851863.824367:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b15b04ad.
00000100:00000040:1.0:1773851863.824367:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000b15b04ad x1859581055325312 msgsize 224
00000100:00100000:1.0:1773851863.824369:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-10978@kfi7 (source: 12345-10787@kfi7)
00000100:00000001:1.0:1773851863.824370:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851863.824370:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 2
00000100:00000001:0.0:1773851863.824371:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851863.824371:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851863.824372:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851863.824372:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851863.824372:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851863.824373:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851863.824374:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859581055325312
00000020:00000001:0.0:1773851863.824375:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851863.824375:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f21d4
00000020:00000001:0.0:1773851863.824376:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851863.824379:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dc41e497 refcount=5
00000020:00000001:0.0:1773851863.824380:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134974525440 : -106938735026176 : ffff9ebd62afa000)
00000020:00000001:0.0:1773851863.824380:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134974525440 : -106938735026176 : ffff9ebd62afa000)
00000100:00000001:0.0:1773851863.824381:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851863.824382:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851863.824382:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d0934e84.
00000020:00000010:0.0:1773851863.824383:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851863.824384:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851863.824385:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851863.824385:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851863.824386:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851863.824387:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851863.824387:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851863.824388:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.824388:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851863.824390:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851863.824390:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851863.824390:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851863.824390:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851863.824391:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10978@kfi7, seq: 1997544
00000100:00000040:0.0:1773851863.824392:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dc41e497 : new rpc_count 1
00000100:00000001:1.0:1773851863.824393:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851863.824393:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.824393:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856575488 : -106915852976128 : ffff9ec2b6900000)
00000100:00000040:0.0:1773851863.824394:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b15b04ad x1859581055325312/t0(0) o400->bbdd31ce-3e45-4b70-8534-40e5c25186ba@10978@kfi7:503/0 lens 224/0 e 0 to 0 dl 1773852618 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1163-0'
00000100:00000001:0.0:1773851863.824397:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851863.824397:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851863.824398:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b15b04ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bbdd31ce-3e45-4b70-8534-40e5c25186ba+5:39679:x1859581055325312:12345-10978@kfi7:400:default-tuolumne1163-0
00000100:00000200:0.0:1773851863.824399:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859581055325312
00000020:00000001:0.0:1773851863.824400:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851863.824401:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851863.824401:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.824402:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851863.824402:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851863.824403:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851863.824404:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859581055325312, found 0 last_xid 1859581055325311
00000020:00000001:0.0:1773851863.824404:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851863.824405:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851863.824406:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851863.824406:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.824407:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851863.824407:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851863.824408:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851863.824408:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c52335c6.
02000000:00000001:0.0:1773851863.824409:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.824409:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.824410:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851863.824411:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182968754200, transno 0, xid 1859581055325312
00010000:00000001:0.0:1773851863.824412:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851863.824412:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b15b04ad x1859581055325312/t0(0) o400->bbdd31ce-3e45-4b70-8534-40e5c25186ba@10978@kfi7:503/0 lens 224/224 e 0 to 0 dl 1773852618 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1163-0'
00010000:00000001:0.0:1773851863.824415:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851863.824415:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851863.824416:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=96 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851863.824417:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851863.824418:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3adb748 refcount 3 to 10978@kfi7
00000100:00000001:0.0:1773851863.824419:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412883168 : -107156296668448 : ffff9e8abb006ae0)
02000000:00000001:0.0:1773851863.824419:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851863.824420:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851863.824421:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851863.824422:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10787@kfi7
00000400:00000010:0.0:1773851863.824422:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000487f5112.
00000100:00000200:0.0:1773851863.824423:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859581055325312, offset 224
00000400:00000200:0.0:1773851863.824424:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10787@kfi7
00000400:00000200:0.0:1773851863.824425:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10787@kfi7 to cpt 0
00000400:00000200:0.0:1773851863.824426:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 1
00000400:00000200:0.0:1773851863.824427:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 2
00000400:00000200:0.0:1773851863.824428:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 3
00000400:00000200:0.0:1773851863.824429:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10787@kfi7 local destination
00000400:00000200:0.0:1773851863.824430:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769082:8769082:1024:4294967295] 10787@kfi7 LPNI seq info [4971436:4971436:16:4294967295]
00000400:00000200:0.0:1773851863.824432:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 2
00000400:00000200:0.0:1773851863.824432:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10787@kfi7 to cpt 0
00000400:00000200:0.0:1773851863.824434:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10787@kfi7(10787@kfi7:10787@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851863.824436:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 3
00000800:00000200:0.0:1773851863.824437:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851863.824438:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851863.824440:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851863.824442:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ad9 Using peer 10787@kfi7(0x100000000000ad9)
00000800:00000200:0.0:1773851863.824445:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x100000000000ad9: rc=0
00000800:00000200:0.0:1773851863.824447:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ad9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851863.824450:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851863.824452:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3adb748 refcount 2 to 10978@kfi7
00010000:00000001:0.0:1773851863.824452:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851863.824453:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851863.824455:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851863.824455:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b15b04ad x1859581055325312/t0(0) o400->bbdd31ce-3e45-4b70-8534-40e5c25186ba@10978@kfi7:503/0 lens 224/224 e 0 to 0 dl 1773852618 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1163-0'
00000100:00100000:0.0:1773851863.824459:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b15b04ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bbdd31ce-3e45-4b70-8534-40e5c25186ba+5:39679:x1859581055325312:12345-10978@kfi7:400:default-tuolumne1163-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851863.824461:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10978@kfi7, seq: 1997544
00000100:00000040:0.0:1773851863.824462:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dc41e497 : new rpc_count 0
00000100:00000001:0.0:1773851863.824463:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851863.824463:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851863.824463:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851863.824464:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851863.824465:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d0934e84.
00000020:00000040:0.0:1773851863.824466:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000dc41e497 : new refcount 4
00000100:00000001:0.0:1773851863.824466:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851863.824472:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ad9 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851863.824473:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851863.824474:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10787@kfi7: PUT: OK
00000400:00000200:1.0:1773851863.824476:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000487f5112
00000400:00000010:1.0:1773851863.824476:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000487f5112.
00000100:00000001:1.0:1773851863.824477:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851863.824478:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851863.824478:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6bbaa3f nid 10787@kfi7 refs 2
00000800:00000200:1.0:1773851863.824480:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 10787@kfi7(000000000c3b777c):0x0 lsk 2778 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000ad9 Transaction freed
00000800:00000200:5.0:1773851863.838791:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.838792:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851863.838794:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851863.838798:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851863.838801:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19571@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.838803:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19571@kfi7 : PUT - for me
00000400:00000200:5.0:1773851863.838804:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19571@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.838805:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078d561ed nid 19571@kfi7 refs 1
00000400:00000200:5.0:1773851863.838807:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19571@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.838808:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078d561ed nid 19571@kfi7 refs 2
00000400:00000200:5.0:1773851863.838810:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000078d561ed nid 19571@kfi7 refs 3
00000400:00000200:5.0:1773851863.838812:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19634@kfi7 to cpt 2
00000400:00000200:5.0:1773851863.838813:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19634@kfi7 of length 224 into portal 12 MB=0x699e104384cc0
00000400:00000200:5.0:1773851863.838815:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19634@kfi7 of length 224/224 into md 0x793926dc5 [64] + 131416
00000800:00000200:5.0:1773851863.838818:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851863.838821:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851863.838823:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19571@kfi7: PUT: OK
00000100:00000001:5.0:1773851863.838824:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851863.838826:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851863.838827:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000706f53a0.
00000100:00000040:5.0:1773851863.838828:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000706f53a0 x1858041577753792 msgsize 224
00000100:00100000:5.0:1773851863.838831:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19634@kfi7 (source: 12345-19571@kfi7)
00000100:00000001:5.0:1773851863.838833:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851863.838834:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000078d561ed nid 19571@kfi7 refs 2
00000800:00000200:5.0:1773851863.838836:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851863.838841:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851863.838842:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851863.838842:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851863.838843:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851863.838845:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851863.838846:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041577753792
00000020:00000001:5.0:1773851863.838847:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851863.838848:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92531
00000020:00000001:5.0:1773851863.838848:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851863.838850:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e3783373 refcount=6
00000020:00000001:5.0:1773851863.838851:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630776832 : -107123078774784 : ffff9e9276f14000)
00000020:00000001:5.0:1773851863.838853:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630776832 : -107123078774784 : ffff9e9276f14000)
00000100:00000001:5.0:1773851863.838855:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851863.838856:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851863.838857:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002d92bd59.
00000020:00000010:5.0:1773851863.838859:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851863.838860:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851863.838861:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851863.838862:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851863.838863:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851863.838865:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851863.838866:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851863.838866:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.838868:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.838870:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851863.838870:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851863.838871:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851863.838871:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851863.838872:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19634@kfi7, seq: 2001900
00000100:00000001:7.0:1773851863.838874:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851863.838874:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e3783373 : new rpc_count 1
00000100:00000001:7.0:1773851863.838875:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.838875:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136106891392 : -106937602660224 : ffff9ebda62e2880)
00000100:00000040:5.0:1773851863.838877:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000706f53a0 x1858041577753792/t0(0) o400->32e6327d-6be9-43ee-b7ad-4f898891644f@19634@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1706-0'
00000100:00000001:5.0:1773851863.838881:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851863.838882:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851863.838883:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000706f53a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:32e6327d-6be9-43ee-b7ad-4f898891644f+6:39631:x1858041577753792:12345-19634@kfi7:400:default-tuolumne1706-0
00000100:00000200:5.0:1773851863.838885:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041577753792
00000020:00000001:5.0:1773851863.838886:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851863.838887:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851863.838888:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.838890:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851863.838890:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851863.838892:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851863.838893:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041577753792, found 0 last_xid 1858041577753791
00000020:00000001:5.0:1773851863.838894:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851863.838895:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851863.838896:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851863.838896:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.838897:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851863.838898:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851863.838899:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851863.838902:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007dee5cfa.
02000000:00000001:5.0:1773851863.838903:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.838904:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.838905:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851863.838906:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096685821, transno 0, xid 1858041577753792
00010000:00000001:5.0:1773851863.838907:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851863.838909:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000706f53a0 x1858041577753792/t0(0) o400->32e6327d-6be9-43ee-b7ad-4f898891644f@19634@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1706-0'
00010000:00000001:5.0:1773851863.838913:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851863.838914:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851863.838916:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=95 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851863.838918:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851863.838919:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eefa75c2 refcount 3 to 19634@kfi7
00000100:00000001:5.0:1773851863.838920:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526776544 : -107156182775072 : ffff9e8ac1ca4ae0)
02000000:00000001:5.0:1773851863.838921:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851863.838922:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.838923:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851863.838924:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19571@kfi7
00000400:00000010:5.0:1773851863.838925:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001f116a32.
00000100:00000200:5.0:1773851863.838927:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041577753792, offset 224
00000400:00000200:5.0:1773851863.838929:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19571@kfi7
00000400:00000200:5.0:1773851863.838930:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19571@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.838931:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078d561ed nid 19571@kfi7 refs 1
00000400:00000200:5.0:1773851863.838933:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000078d561ed nid 19571@kfi7 refs 2
00000400:00000200:5.0:1773851863.838934:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000078d561ed nid 19571@kfi7 refs 3
00000400:00000200:5.0:1773851863.838936:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19571@kfi7 local destination
00000400:00000200:5.0:1773851863.838938:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769083:8769083:1024:4294967295] 19571@kfi7 LPNI seq info [8774185:8774185:16:4294967295]
00000400:00000200:5.0:1773851863.838941:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000078d561ed nid 19571@kfi7 refs 2
00000400:00000200:5.0:1773851863.838942:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19571@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.838945:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19571@kfi7(19571@kfi7:19571@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851863.838947:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000078d561ed nid 19571@kfi7 refs 3
00000800:00000200:5.0:1773851863.838949:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.838951:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851863.838955:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851863.838958:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b1 Using peer 19571@kfi7(0x1000000000005b1)
00000800:00000200:5.0:1773851863.838963:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x1000000000005b1: rc=0
00000800:00000200:5.0:1773851863.838966:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851863.838972:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851863.838973:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eefa75c2 refcount 2 to 19634@kfi7
00010000:00000001:5.0:1773851863.838975:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851863.838975:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.838976:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851863.838977:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000706f53a0 x1858041577753792/t0(0) o400->32e6327d-6be9-43ee-b7ad-4f898891644f@19634@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1706-0'
00000800:00000200:6.0:1773851863.838979:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b1 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851863.838982:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:5.0:1773851863.838982:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000706f53a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:32e6327d-6be9-43ee-b7ad-4f898891644f+6:39631:x1858041577753792:12345-19634@kfi7:400:default-tuolumne1706-0 Request processed in 100us (153us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851863.838983:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19571@kfi7: PUT: OK
00000400:00000200:6.0:1773851863.838985:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001f116a32
00000400:00000010:6.0:1773851863.838985:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001f116a32.
00000100:00000001:6.0:1773851863.838986:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:5.0:1773851863.838986:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19634@kfi7, seq: 2001900
00000100:00000001:6.0:1773851863.838987:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:5.0:1773851863.838987:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e3783373 : new rpc_count 0
00000400:00000200:6.0:1773851863.838988:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000078d561ed nid 19571@kfi7 refs 2
00000100:00000001:5.0:1773851863.838989:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851863.838989:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851863.838990:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851863.838991:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2054@kfi7:1 -> 19571@kfi7(0000000032ec032e):0x0 lsk 1458 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b1 Transaction freed
00000020:00000010:5.0:1773851863.838991:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000020:00000010:5.0:1773851863.838993:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002d92bd59.
00000020:00000040:5.0:1773851863.838994:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e3783373 : new refcount 5
00000100:00000001:5.0:1773851863.838995:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0:1773851863.871937:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851863.871937:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851863.871938:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851863.871938:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:19.0:1773851863.871939:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851863.871939:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:19.0:1773851863.871941:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851863.871941:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 23122@kfi7(00000000156cd624):0xd94 version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851863.871943:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 Using peer 23122@kfi7(0xd94)
00000400:00000200:19.0:1773851863.871944:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23122@kfi7 to cpt 4
00000400:00000200:19.0:1773851863.871945:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23122@kfi7 : PUT - for me
00000400:00000200:17.0:1773851863.871945:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23122@kfi7 to cpt 4
00000400:00000200:19.0:1773851863.871946:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23122@kfi7 to cpt 4
00000400:00000200:19.0:1773851863.871947:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c192e0d4 nid 23122@kfi7 refs 1
00000800:00000200:17.0:1773851863.871947:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0xd94: rc=0
00000800:00000200:17.0:1773851863.871948:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:19.0:1773851863.871949:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23122@kfi7 to cpt 4
00000400:00000200:19.0:1773851863.871950:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c192e0d4 nid 23122@kfi7 refs 2
00000400:00000200:19.0:1773851863.871950:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c192e0d4 nid 23122@kfi7 refs 3
00000400:00000200:19.0:1773851863.871951:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23123@kfi7 to cpt 7
00000400:00000200:19.0:1773851863.871953:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23123@kfi7 of length 224 into portal 12 MB=0x69b0a58b91e80
00000400:00000200:19.0:1773851863.871954:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23123@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 5400
00000800:00000200:19.0:1773851863.871956:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851863.871958:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851863.871959:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23122@kfi7: PUT: OK
00000100:00000001:19.0:1773851863.871960:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851863.871961:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851863.871962:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002df47272.
00000100:00000040:19.0:1773851863.871963:0:2464491:0:(events.c:358:request_in_callback()) incoming req@000000002df47272 x1859318600769152 msgsize 224
00000800:00000200:17.0:1773851863.871963:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851863.871964:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-23123@kfi7 (source: 12345-23122@kfi7)
00000800:00000200:17.0:1773851863.871965:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 Transaction freed
00000100:00000001:19.0:1773851863.871966:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851863.871967:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c192e0d4 nid 23122@kfi7 refs 2
00000800:00000200:19.0:1773851863.871968:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851863.871971:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851863.871972:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851863.871972:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851863.871973:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851863.871974:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851863.871975:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318600769152
00000020:00000001:17.0:1773851863.871976:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851863.871976:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ab0
00000020:00000001:17.0:1773851863.871977:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851863.871981:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007ed8921b refcount=6
00000020:00000001:17.0:1773851863.871982:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743455744 : -107128966095872 : ffff9e911807dc00)
00000020:00000001:17.0:1773851863.871983:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743455744 : -107128966095872 : ffff9e911807dc00)
00000100:00000001:17.0:1773851863.871984:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851863.871985:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851863.871986:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005aa634fd.
00000020:00000010:17.0:1773851863.871987:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851863.871988:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851863.871989:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851863.871990:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851863.871991:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851863.871992:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851863.871993:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851863.871993:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.871994:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851863.871996:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851863.871997:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851863.871997:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851863.871997:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851863.871998:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23123@kfi7, seq: 2156301
00000100:00000040:17.0:1773851863.871999:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007ed8921b : new rpc_count 1
00000100:00000001:17.0:1773851863.871999:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339146752 : -106987370404864 : ffff9eb20fcaa400)
00000100:00000001:16.0:1773851863.871999:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851863.872000:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851863.872001:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002df47272 x1859318600769152/t0(0) o400->115dbaa9-9414-40e5-81ac-be8baa56fcc1@23123@kfi7:651/0 lens 224/0 e 0 to 0 dl 1773852011 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1942-0'
00000100:00000001:17.0:1773851863.872003:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851863.872004:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851863.872005:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002df47272 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:115dbaa9-9414-40e5-81ac-be8baa56fcc1+6:39499:x1859318600769152:12345-23123@kfi7:400:default-tuolumne1942-0
00000100:00000200:17.0:1773851863.872007:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318600769152
00000020:00000001:17.0:1773851863.872007:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851863.872008:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851863.872009:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.872010:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851863.872011:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851863.872012:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851863.872012:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318600769152, found 0 last_xid 1859318600769151
00000020:00000001:17.0:1773851863.872013:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851863.872014:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851863.872015:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851863.872015:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.872016:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851863.872017:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851863.872018:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851863.872018:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000acb4c682.
02000000:00000001:17.0:1773851863.872019:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.872020:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.872020:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851863.872021:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044168201, transno 0, xid 1859318600769152
00010000:00000001:17.0:1773851863.872022:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851863.872023:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002df47272 x1859318600769152/t0(0) o400->115dbaa9-9414-40e5-81ac-be8baa56fcc1@23123@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1942-0'
00010000:00000001:17.0:1773851863.872025:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851863.872026:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851863.872026:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=96 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851863.872028:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851863.872029:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cdba43c5 refcount 3 to 23123@kfi7
00000100:00000001:17.0:1773851863.872029:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231807040 : -107130477744576 : ffff9e90bdedee40)
02000000:00000001:17.0:1773851863.872030:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851863.872031:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.872031:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851863.872032:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23122@kfi7
00000400:00000010:17.0:1773851863.872033:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006a8bd081.
00000100:00000200:17.0:1773851863.872034:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318600769152, offset 224
00000400:00000200:17.0:1773851863.872035:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23122@kfi7
00000400:00000200:17.0:1773851863.872036:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23122@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.872037:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c192e0d4 nid 23122@kfi7 refs 1
00000400:00000200:17.0:1773851863.872038:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c192e0d4 nid 23122@kfi7 refs 2
00000400:00000200:17.0:1773851863.872039:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c192e0d4 nid 23122@kfi7 refs 3
00000400:00000200:17.0:1773851863.872041:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23122@kfi7 local destination
00000400:00000200:17.0:1773851863.872042:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769084:8769084:1024:4294967295] 23122@kfi7 LPNI seq info [9511698:9511698:16:4294967295]
00000400:00000200:17.0:1773851863.872044:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c192e0d4 nid 23122@kfi7 refs 2
00000400:00000200:17.0:1773851863.872044:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23122@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.872047:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23122@kfi7(23122@kfi7:23122@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851863.872048:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c192e0d4 nid 23122@kfi7 refs 3
00000800:00000200:17.0:1773851863.872050:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851863.872051:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851863.872053:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851863.872055:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 Using peer 23122@kfi7(0xd94)
00000800:00000200:17.0:1773851863.872058:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0xd94: rc=0
00000800:00000200:17.0:1773851863.872059:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851863.872061:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851863.872062:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cdba43c5 refcount 2 to 23123@kfi7
00010000:00000001:17.0:1773851863.872063:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851863.872063:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.872064:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851863.872065:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002df47272 x1859318600769152/t0(0) o400->115dbaa9-9414-40e5-81ac-be8baa56fcc1@23123@kfi7:651/0 lens 224/224 e 0 to 0 dl 1773852011 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1942-0'
00000100:00100000:17.0:1773851863.872068:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002df47272 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:115dbaa9-9414-40e5-81ac-be8baa56fcc1+6:39499:x1859318600769152:12345-23123@kfi7:400:default-tuolumne1942-0 Request processed in 63us (104us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851863.872070:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23123@kfi7, seq: 2156301
00000100:00000040:17.0:1773851863.872071:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007ed8921b : new rpc_count 0
00000100:00000001:17.0:1773851863.872072:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851863.872073:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851863.872073:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000800:00000200:19.0:1773851863.872074:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851863.872074:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:19.0:1773851863.872075:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851863.872075:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005aa634fd.
00000020:00000040:17.0:1773851863.872076:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007ed8921b : new refcount 5
00000400:00000200:19.0:1773851863.872077:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23122@kfi7: PUT: OK
00000100:00000001:17.0:1773851863.872077:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851863.872078:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006a8bd081
00000400:00000010:19.0:1773851863.872078:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006a8bd081.
00000100:00000001:19.0:1773851863.872079:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851863.872080:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851863.872081:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c192e0d4 nid 23122@kfi7 refs 2
00000800:00000200:19.0:1773851863.872082:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23122@kfi7(00000000156cd624):0x0 lsk 3477 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd94 Transaction freed
00000004:00000001:15.0:1773851863.881734:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851863.881734:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851863.881734:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:15.0:1773851863.881735:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851863.881735:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:11.0:1773851863.881736:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851863.881736:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eba50e83.
00000100:00000010:11.0:1773851863.881737:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cd342c1.
00000020:00000040:10.0:1773851863.881737:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000100:00000010:15.0:1773851863.881738:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000059918df.
00000020:00000040:11.0:1773851863.881738:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000100:00000001:10.0:1773851863.881738:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:3.0:1773851863.881738:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:15.0:1773851863.881739:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
02000000:00000001:10.0:1773851863.881739:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:3.0:1773851863.881739:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:11.0:1773851863.881740:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:3.0:1773851863.881740:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004bf45d08.
00000100:00000001:15.0:1773851863.881741:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851863.881741:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851863.881741:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851863.881741:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851863.881742:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:3.0:1773851863.881742:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
02000000:00000001:15.0:1773851863.881743:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851863.881743:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000019672f28.
02000000:00000010:10.0:1773851863.881743:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a6c4d9d1.
00000100:00000001:11.0:1773851863.881744:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851863.881744:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851863.881744:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:15.0:1773851863.881745:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ffa7e932.
02000000:00000001:3.0:1773851863.881745:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:11.0:1773851863.881746:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851863.881746:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:3.0:1773851863.881746:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851863.881747:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851863.881747:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851863.881747:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851863.881748:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:3.0:1773851863.881748:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000064eaaa6.
00000100:00000040:11.0:1773851863.881749:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007cd342c1] to pc [ptlrpcd_02_00+0]  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851863.881749:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000eba50e83] to pc [ptlrpcd_02_03+3]  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:15.0:1773851863.881750:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851863.881750:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851863.881752:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000059918df] to pc [ptlrpcd_03_00+0]  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851863.881752:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851863.881753:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851863.881755:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004bf45d08] to pc [ptlrpcd_00_03+3]  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851863.881756:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851863.881757:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851863.881757:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851863.881757:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851863.881757:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851863.881758:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851863.881758:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:11.0:1773851863.881759:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000083609603.
00080000:00000010:10.0:1773851863.881759:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000cd20ccf6.
00000100:00000001:9.0:1773851863.881759:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:15.0:1773851863.881760:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851863.881760:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637099300563968 : -106974408987648 : ffff9eb5145a2c00)
00080000:00000001:10.0:1773851863.881760:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637086953418752 : -106986756132864 : ffff9eb23467b000)
00000100:00000040:9.0:1773851863.881760:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851863.881760:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:15.0:1773851863.881761:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000042cf1abb.
00000100:00000001:14.0:1773851863.881762:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851863.881762:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851863.881762:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851863.881762:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:15.0:1773851863.881763:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637092528635904 : -106981180915712 : ffff9eb380b6c000)
00000100:00100000:14.0:1773851863.881763:0:41073:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00080000:00000001:10.0:1773851863.881763:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851863.881763:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:15.0:1773851863.881764:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:14.0:1773851863.881764:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851863.881764:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851863.881764:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851863.881764:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00001000:10.0:1773851863.881764:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00000100:00000001:8.0:1773851863.881764:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851863.881765:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851863.881765:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851863.881765:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:3.0:1773851863.881765:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000325cdf72.
00000100:00000001:2.0:1773851863.881765:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851863.881765:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851863.881766:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000010:11.0:1773851863.881766:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d7484e9e.
00000004:00000010:10.0:1773851863.881766:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d4a3afe9.
02000000:00000001:8.0:1773851863.881766:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:3.0:1773851863.881766:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637105074591744 : -106968634959872 : ffff9eb66c82d800)
00000100:00000001:2.0:1773851863.881766:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:14.0:1773851863.881767:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000004:00080000:11.0:1773851863.881767:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614138335042930ns, next at 614139335041027ns, rc = 0
00000004:00080000:10.0:1773851863.881767:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614138335042880ns, next at 614139335040756ns, rc = 0
02000000:00000001:9.0:1773851863.881767:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851863.881767:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881767:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851863.881767:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851863.881768:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.881768:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:9.0:1773851863.881768:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851863.881768:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00001000:15.0:1773851863.881769:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00000100:00000001:14.0:1773851863.881769:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:11.0:1773851863.881769:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851863.881769:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:9.0:1773851863.881769:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051926848:31@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851863.881769:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051926912:6@kfi7:13:default-yuba2-0
00000100:00000040:2.0:1773851863.881769:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851863.881770:0:41073:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:10.0:1773851863.881770:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851863.881770:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:15.0:1773851863.881771:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000fac8fb13.
00000100:00000040:14.0:1773851863.881771:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851863.881771:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851863.881771:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851863.881771:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881771:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851863.881771:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851863.881771:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00080000:15.0:1773851863.881772:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614138335047760ns, next at 614139335046036ns, rc = 0
02000000:00000001:9.0:1773851863.881772:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851863.881772:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:3.0:1773851863.881772:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
02000000:00000001:9.0:1773851863.881773:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851863.881773:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:2.0:1773851863.881773:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:15.0:1773851863.881774:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:9.0:1773851863.881774:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851863.881774:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003e1bc6ec.
00000004:00000010:3.0:1773851863.881774:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004c78f4bd.
00000100:00000001:2.0:1773851863.881774:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851863.881775:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:8.0:1773851863.881775:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:3.0:1773851863.881775:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614138335050645ns, next at 614139335048100ns, rc = 0
00080000:00000001:15.0:1773851863.881776:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.881776:0:41073:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851863.881776:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851863.881776:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000001:15.0:1773851863.881777:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.881777:0:41073:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851863.881777:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bcc4b05c.
00000400:00000200:8.0:1773851863.881777:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00080000:00000001:3.0:1773851863.881777:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:2.0:1773851863.881777:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.881778:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851863.881778:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000100:00100000:2.0:1773851863.881778:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004bf45d08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051927040:2095@kfi7:13:default-yuba2-0
02000000:00000001:14.0:1773851863.881779:0:41073:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:9.0:1773851863.881779:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00080000:00000001:3.0:1773851863.881779:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851863.881780:0:41073:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851863.881780:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:9.0:1773851863.881780:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000010:8.0:1773851863.881780:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000004:00000001:3.0:1773851863.881780:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851863.881781:0:41073:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000059918df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051926976:54@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851863.881781:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851863.881781:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926912, portal 4
00000100:00000001:2.0:1773851863.881781:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:9.0:1773851863.881782:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003dd826d2.
00000100:00000001:8.0:1773851863.881782:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:2.0:1773851863.881782:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:14.0:1773851863.881783:0:41073:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851863.881783:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889187328 : -106993820364288 : ffff9eb08f581200)
02000000:00000001:2.0:1773851863.881783:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851863.881784:0:41073:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:9.0:1773851863.881784:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926848, portal 4
02000000:00000001:2.0:1773851863.881784:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:14.0:1773851863.881785:0:41073:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881785:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:8.0:1773851863.881785:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:2.0:1773851863.881785:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d3421c59.
00000100:00000001:9.0:1773851863.881786:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637043610181248 : -107030099370368 : ffff9ea81cf25e80)
02000000:00000001:2.0:1773851863.881786:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851863.881788:0:41073:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:9.0:1773851863.881788:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851863.881788:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
02000000:00000010:14.0:1773851863.881789:0:41073:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
00000100:00000001:8.0:1773851863.881789:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:2.0:1773851863.881789:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
02000000:00000001:14.0:1773851863.881790:0:41073:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851863.881791:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:2.0:1773851863.881791:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000182753b4.
00000400:00000200:14.0:1773851863.881792:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:9.0:1773851863.881792:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:8.0:1773851863.881792:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028d4f432.
00000400:00000010:14.0:1773851863.881793:0:41073:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000100:00000040:9.0:1773851863.881793:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000100:00000200:8.0:1773851863.881793:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926912, offset 0
00000100:00000200:2.0:1773851863.881793:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927040, portal 4
00000400:00000010:9.0:1773851863.881794:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa4a0339.
00000100:00000001:2.0:1773851863.881794:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:14.0:1773851863.881795:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000400:00000200:8.0:1773851863.881795:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000100:00000001:2.0:1773851863.881795:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288701312 : -106964420850304 : ffff9eb767b10d80)
00000100:00000200:14.0:1773851863.881796:0:41073:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051926976, portal 4
00000100:00000200:9.0:1773851863.881796:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926848, offset 0
00000400:00000200:8.0:1773851863.881796:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000040:2.0:1773851863.881797:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851863.881798:0:41073:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:14.0:1773851863.881798:0:41073:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860195328 : -107049849356288 : ffff9ea383c18000)
00000400:00000200:9.0:1773851863.881798:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000400:00000200:8.0:1773851863.881798:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:8.0:1773851863.881799:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000040:14.0:1773851863.881801:0:41073:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851863.881801:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:2.0:1773851863.881802:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851863.881803:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000100:00000040:2.0:1773851863.881803:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000010:2.0:1773851863.881804:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000ad01dff.
00000100:00000001:14.0:1773851863.881805:0:41073:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851863.881806:0:41073:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000200:8.0:1773851863.881806:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769084, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769083, p:4294967295, g:4294967295, h:1000]
00000100:00000200:2.0:1773851863.881806:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927040, offset 0
00000400:00000010:14.0:1773851863.881807:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000045e97c7a.
00000100:00000200:14.0:1773851863.881808:0:41073:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051926976, offset 0
00000400:00000200:8.0:1773851863.881809:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:2.0:1773851863.881809:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:8.0:1773851863.881810:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851863.881810:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851863.881811:0:41073:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:8.0:1773851863.881811:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:2.0:1773851863.881812:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:14.0:1773851863.881813:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851863.881813:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769085:8769085:1024:4294967295] 6@kfi7 LPNI seq info [5405030:5405030:16:4294967295]
00000400:00000200:2.0:1773851863.881813:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:14.0:1773851863.881814:0:41073:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:8.0:1773851863.881815:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:14.0:1773851863.881816:0:41073:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:14.0:1773851863.881817:0:41073:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851863.881817:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851863.881817:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:9.0:1773851863.881818:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:14.0:1773851863.881819:0:41073:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:9.0:1773851863.881819:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:2.0:1773851863.881819:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:9.0:1773851863.881821:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:14.0:1773851863.881822:0:41073:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769084, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769085, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851863.881822:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769084, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769085, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851863.881823:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:9.0:1773851863.881825:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000200:2.0:1773851863.881825:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:14.0:1773851863.881826:0:41073:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:2.0:1773851863.881827:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:14.0:1773851863.881828:0:41073:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851863.881828:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769084, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769085, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851863.881828:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:14.0:1773851863.881829:0:41073:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:2.0:1773851863.881830:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769086:8769086:1024:4294967295] 2095@kfi7 LPNI seq info [5406041:5406041:16:4294967295]
00000400:00000200:14.0:1773851863.881831:0:41073:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769087:8769087:1024:4294967295] 54@kfi7 LPNI seq info [5403921:5403921:16:4294967295]
00000400:00000200:9.0:1773851863.881832:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851863.881833:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851863.881833:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:14.0:1773851863.881834:0:41073:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851863.881834:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000200:2.0:1773851863.881835:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851863.881836:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851863.881836:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769088:8769088:1024:4294967295] 31@kfi7 LPNI seq info [5403617:5403617:16:4294967295]
00000400:00000200:9.0:1773851863.881838:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:8.0:1773851863.881839:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851863.881840:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:2.0:1773851863.881840:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851863.881841:0:41073:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851863.881842:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:2.0:1773851863.881842:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:9.0:1773851863.881843:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851863.881844:0:41073:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851863.881845:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:8.0:1773851863.881845:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:2.0:1773851863.881845:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:14.0:1773851863.881847:0:41073:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:8.0:1773851863.881847:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.881848:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:2.0:1773851863.881848:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851863.881849:0:41073:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851863.881850:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851863.881851:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851863.881852:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851863.881854:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851863.881855:0:41073:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851863.881855:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000800:00000200:2.0:1773851863.881856:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000800:00000200:9.0:1773851863.881858:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Using peer 31@kfi7(0x200000000000560)
00000800:00000200:14.0:1773851863.881859:0:41073:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b Using peer 54@kfi7(0x33b)
00000800:00000200:8.0:1773851863.881860:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000800:00000200:2.0:1773851863.881862:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000e8d7e86a: Posted send of 324 bytes to peer 0x5c0: rc=0
00000800:00000200:9.0:1773851863.881863:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x200000000000560: rc=0
00000800:00000200:8.0:1773851863.881863:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:14.0:1773851863.881864:0:41073:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000002eb192a5: Posted send of 324 bytes to peer 0x33b: rc=0
00000800:00000200:2.0:1773851863.881864:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851863.881865:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851863.881866:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851863.881867:0:41073:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851863.881867:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851863.881868:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881868:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881869:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881869:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851863.881870:0:41073:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881870:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851863.881871:0:41073:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851863.881871:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881871:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.881872:0:41073:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881872:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881873:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851863.881873:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.881874:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851863.881874:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851863.881874:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851863.881875:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881875:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.881876:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851863.881876:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851863.881876:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851863.881876:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851863.881877:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851863.881877:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851863.881877:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:1.0:1773851863.881877:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851863.881878:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851863.881879:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851863.881879:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851863.881879:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851863.881880:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881880:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851863.881880:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851863.881881:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881881:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851863.881882:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851863.881882:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851863.881882:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:1.0:1773851863.881883:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000ad01dff
00000400:00000010:1.0:1773851863.881884:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000ad01dff.
00000400:00000200:13.0:1773851863.881885:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851863.881886:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851863.881886:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851863.881886:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:8.0:1773851863.881887:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851863.881887:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851863.881888:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->54@kfi7: PUT: OK
00000800:00000200:10.0:1773851863.881888:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851863.881889:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000045e97c7a
00000400:00000010:13.0:1773851863.881890:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000045e97c7a.
00000400:00000200:10.0:1773851863.881891:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851863.881892:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:1.0:1773851863.881892:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:13.0:1773851863.881893:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851863.881893:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000400:00000200:9.0:1773851863.881893:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:1.0:1773851863.881893:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851863.881894:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa4a0339
00000400:00000010:10.0:1773851863.881895:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa4a0339.
00000400:00000200:9.0:1773851863.881895:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:10.0:1773851863.881896:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:9.0:1773851863.881896:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028d4f432
00000100:00000200:10.0:1773851863.881897:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851863.881897:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028d4f432.
00000100:00000001:13.0:1773851863.881898:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851863.881898:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:1.0:1773851863.881898:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851863.881899:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:13.0:1773851863.881900:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851863.881900:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851863.881900:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:10.0:1773851863.881902:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851863.881903:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851863.881903:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000100:00000001:13.0:1773851863.881904:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881904:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:14.0:1773851863.881905:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:13.0:1773851863.881905:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:14.0:1773851863.881906:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851863.881907:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:10.0:1773851863.881907:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851863.881908:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851863.881908:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:9.0:1773851863.881909:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851863.881910:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b Transaction freed
00000400:00000200:10.0:1773851863.881910:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:14.0:1773851863.881912:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:10.0:1773851863.881913:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Transaction freed
00000400:00000200:14.0:1773851863.881914:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:9.0:1773851863.881915:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851863.881916:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 54@kfi7 : PUT - for me
00000100:00000001:9.0:1773851863.881916:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851863.881917:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:29.0:1773851863.881918:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:14.0:1773851863.881918:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:1.0:1773851863.881919:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:29.0:1773851863.881920:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:14.0:1773851863.881920:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000800:00000200:9.0:1773851863.881920:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Transaction freed
00000400:00000200:14.0:1773851863.881921:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:1.0:1773851863.881921:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851863.881922:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851863.881922:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:14.0:1773851863.881923:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000800:00000200:1.0:1773851863.881923:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851863.881924:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:14.0:1773851863.881924:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000800:00000200:29.0:1773851863.881925:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851863.881926:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:17.0:1773851863.881927:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851863.881927:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851863.881928:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851863.881928:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b31c0
00000400:00000200:29.0:1773851863.881930:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:14.0:1773851863.881930:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851863.881930:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851863.881931:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:17.0:1773851863.881931:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851863.881932:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f5e2d [1] + 224
00000400:00000200:29.0:1773851863.881933:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:17.0:1773851863.881934:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:1.0:1773851863.881934:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000800:00000200:14.0:1773851863.881935:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851863.881936:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:1.0:1773851863.881936:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851863.881937:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:17.0:1773851863.881937:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:1.0:1773851863.881938:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:29.0:1773851863.881939:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:17.0:1773851863.881939:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:1.0:1773851863.881940:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851863.881941:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851863.881941:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:14.0:1773851863.881941:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851863.881941:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:29.0:1773851863.881943:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3200
00000400:00000200:17.0:1773851863.881943:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:14.0:1773851863.881943:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->54@kfi7: PUT: OK
00000400:00000200:1.0:1773851863.881943:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:17.0:1773851863.881944:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:29.0:1773851863.881945:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:1.0:1773851863.881945:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:17.0:1773851863.881946:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000100:00000001:14.0:1773851863.881947:0:2514739:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851863.881947:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3180
00000400:00000200:29.0:1773851863.881948:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78008051d [1] + 224
00000400:00000200:17.0:1773851863.881948:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000200:14.0:1773851863.881948:0:2514739:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851863.881949:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:17.0:1773851863.881950:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3140
00000800:00000200:29.0:1773851863.881951:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851863.881951:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71d461 [1] + 224
00000400:00000200:17.0:1773851863.881952:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000040:14.0:1773851863.881953:0:2514739:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851863.881954:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851863.881954:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f0d91 [1] + 224
00000800:00000200:1.0:1773851863.881954:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851863.881955:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000100:00000001:29.0:1773851863.881957:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851863.881957:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851863.881958:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:29.0:1773851863.881959:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851863.881959:0:2514739:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851863.881959:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000400:00000200:17.0:1773851863.881960:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851863.881961:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:1.0:1773851863.881961:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851863.881963:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000800:00000200:14.0:1773851863.881963:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000200:1.0:1773851863.881963:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851863.881964:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851863.881965:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851863.881967:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851863.881968:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851863.881968:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:1.0:1773851863.881968:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851863.881969:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:14.0:1773851863.881969:0:41073:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:14.0:1773851863.881970:0:41073:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851863.881971:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000010:14.0:1773851863.881971:0:41073:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000100:00000040:17.0:1773851863.881972:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:14.0:1773851863.881972:0:41073:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
00000100:00000001:2.0:1773851863.881972:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851863.881973:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000010:14.0:1773851863.881973:0:41073:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000100:00000001:2.0:1773851863.881973:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:14.0:1773851863.881974:0:41073:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:2.0:1773851863.881974:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:1.0:1773851863.881974:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:2.0:1773851863.881975:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:14.0:1773851863.881976:0:41073:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851863.881976:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:1.0:1773851863.881976:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000001:8.0:1773851863.881977:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:2.0:1773851863.881977:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000100:00000001:17.0:1773851863.881978:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:8.0:1773851863.881978:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:2.0:1773851863.881978:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000182753b4
00000400:00000010:2.0:1773851863.881978:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000182753b4.
00000800:00000200:1.0:1773851863.881978:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851863.881979:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000001:8.0:1773851863.881979:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:14.0:1773851863.881980:0:41073:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:8.0:1773851863.881980:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000100:00000001:2.0:1773851863.881980:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851863.881981:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:8.0:1773851863.881981:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000100:00000200:2.0:1773851863.881981:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851863.881982:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851863.881982:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:8.0:1773851863.881982:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000400:00000001:9.0:1773851863.881983:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851863.881983:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:14.0:1773851863.881984:0:41073:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:9.0:1773851863.881984:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:8.0:1773851863.881984:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851863.881985:0:41073:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851863.881985:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000100:00000001:14.0:1773851863.881986:0:41073:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:9.0:1773851863.881986:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003dd826d2
02000000:00000001:14.0:1773851863.881987:0:41073:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:9.0:1773851863.881987:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003dd826d2.
00000100:00000200:2.0:1773851863.881987:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851863.881988:0:41073:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851863.881988:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:14.0:1773851863.881989:0:41073:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851863.881989:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851863.881989:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:14.0:1773851863.881990:0:41073:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.881991:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:14.0:1773851863.881992:0:41073:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=96 v=66 (66 66 66 66)
00000100:00000001:2.0:1773851863.881992:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:14.0:1773851863.881993:0:41073:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=96 v=66 (1 1 1 1)
00000100:00000001:2.0:1773851863.881993:0:41063:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:2.0:1773851863.881993:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:9.0:1773851863.881994:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851863.881994:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851863.881994:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851863.881994:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851863.881995:0:41073:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851863.881995:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:2.0:1773851863.881995:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.881996:0:41073:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851863.881996:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851863.881997:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000001:2.0:1773851863.881997:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:14.0:1773851863.881998:0:41073:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:9.0:1773851863.881998:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851863.881998:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851863.881998:0:41063:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=96 v=66 (66 66 66 66)
00010000:00000001:14.0:1773851863.881999:0:41073:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.881999:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851863.881999:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.882000:0:41073:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851863.882000:0:41071:0:(client.c:1428:after_reply()) Process entered
00000100:00001000:8.0:1773851863.882000:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=96 v=66 (66 66 66 66)
00000100:00000040:14.0:1773851863.882001:0:41073:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
02000000:00000001:9.0:1773851863.882001:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851863.882001:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:2.0:1773851863.882001:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=96 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851863.882002:0:41073:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851863.882002:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851863.882002:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=11 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851863.882003:0:41073:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.882003:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.882003:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851863.882003:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851863.882004:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851863.882004:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851863.882004:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:14.0:1773851863.882005:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:8.0:1773851863.882005:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:2.0:1773851863.882005:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851863.882006:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=96 v=66 (66 66 66 66)
00010000:00000001:8.0:1773851863.882006:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851863.882007:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:2.0:1773851863.882007:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00001000:9.0:1773851863.882008:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=96 v=66 (1 1 1 1)
00000100:00000040:8.0:1773851863.882008:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000040:2.0:1773851863.882008:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000001:14.0:1773851863.882009:0:41073:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851863.882009:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851863.882009:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:14.0:1773851863.882010:0:41073:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851863.882010:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851863.882010:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851863.882010:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.882010:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.882011:0:41073:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:9.0:1773851863.882011:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851863.882011:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:14.0:1773851863.882012:0:41073:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:8.0:1773851863.882012:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:2.0:1773851863.882012:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:14.0:1773851863.882013:0:41073:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851863.882013:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851863.882013:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000001:9.0:1773851863.882014:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000040:14.0:1773851863.882015:0:41073:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399719424 free=351524100096 avail=351521339392 avail_mb=1373130232 hwm_mb=3131103 files=372113947 ffree=343285254 state=0: rc = 0
00000100:00000001:9.0:1773851863.882015:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.882016:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:9.0:1773851863.882017:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851863.882017:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:14.0:1773851863.882018:0:41073:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399719424 blocks, 351524100096 free, 351521339392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113947 files, 343285254 free files
00000100:00000001:8.0:1773851863.882018:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851863.882018:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851863.882018:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851863.882019:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851863.882020:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:2.0:1773851863.882020:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:14.0:1773851863.882021:0:41073:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.882021:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:8.0:1773851863.882021:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000100:00000040:14.0:1773851863.882022:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851863.882022:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000040:8.0:1773851863.882022:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420288000 avail=351417816064 avail_mb=1372725844 hwm_mb=3131103 files=372009047 ffree=343183875 state=0: rc = 0
00000004:00000040:2.0:1773851863.882022:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851863.882023:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:2.0:1773851863.882023:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449338880 avail=351446756352 avail_mb=1372838892 hwm_mb=3131103 files=372161028 ffree=343212245 state=0: rc = 0
00000004:00000001:9.0:1773851863.882024:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851863.882025:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000004:00000020:8.0:1773851863.882025:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420288000 free, 351417816064 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372009047 files, 343183875 free files
00000100:00100000:14.0:1773851863.882027:0:41073:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000059918df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051926976:54@kfi7:13:default-yuba2-0
00000004:00000040:9.0:1773851863.882027:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666708480 avail=351645480960 avail_mb=1373615160 hwm_mb=3131103 files=372237950 ffree=343424520 state=0: rc = 0
00000004:00000020:2.0:1773851863.882027:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449338880 free, 351446756352 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372161028 files, 343212245 free files
00000004:00000001:8.0:1773851863.882028:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851863.882029:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:2.0:1773851863.882029:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851863.882030:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:9.0:1773851863.882030:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666708480 free, 351645480960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237950 files, 343424520 free files
00000100:00000001:14.0:1773851863.882031:0:41073:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:2.0:1773851863.882031:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:14.0:1773851863.882032:0:41073:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000059918df x1859433051926976/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851863.882033:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851863.882034:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:8.0:1773851863.882034:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051926912:6@kfi7:13:default-yuba2-0
00000100:00000001:14.0:1773851863.882036:0:41073:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00100000:2.0:1773851863.882036:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004bf45d08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051927040:2095@kfi7:13:default-yuba2-0
02000000:00000001:14.0:1773851863.882037:0:41073:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:8.0:1773851863.882037:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:14.0:1773851863.882038:0:41073:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
00000100:00000001:8.0:1773851863.882038:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:14.0:1773851863.882039:0:41073:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00100000:9.0:1773851863.882039:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051926848:31@kfi7:13:default-yuba2-0
00000100:00000040:8.0:1773851863.882039:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007cd342c1 x1859433051926912/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851863.882039:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851863.882040:0:41073:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:14.0:1773851863.882040:0:41073:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:2.0:1773851863.882040:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:14.0:1773851863.882041:0:41073:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:2.0:1773851863.882041:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004bf45d08 x1859433051927040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851863.882042:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:14.0:1773851863.882043:0:41073:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ffa7e932.
00000100:00000001:9.0:1773851863.882043:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851863.882043:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:14.0:1773851863.882044:0:41073:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:9.0:1773851863.882044:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000eba50e83 x1859433051926848/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852016 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:8.0:1773851863.882044:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:14.0:1773851863.882045:0:41073:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:8.0:1773851863.882045:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003e1bc6ec.
00000100:00000001:2.0:1773851863.882045:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000010:14.0:1773851863.882046:0:41073:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000059918df.
02000000:00000001:2.0:1773851863.882046:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:14.0:1773851863.882047:0:41073:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:8.0:1773851863.882047:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851863.882047:0:41068:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:2.0:1773851863.882047:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d3421c59.
00000100:00000001:14.0:1773851863.882048:0:41073:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:8.0:1773851863.882048:0:41068:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
02000000:00000001:2.0:1773851863.882048:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:14.0:1773851863.882049:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.882049:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:8.0:1773851863.882049:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:2.0:1773851863.882049:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:14.0:1773851863.882050:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:9.0:1773851863.882050:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851863.882050:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000019672f28.
00000020:00000040:2.0:1773851863.882050:0:41063:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000100:00000001:14.0:1773851863.882051:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851863.882051:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bcc4b05c.
02000000:00000001:8.0:1773851863.882051:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:2.0:1773851863.882051:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:14.0:1773851863.882052:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:8.0:1773851863.882052:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:2.0:1773851863.882052:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000064eaaa6.
00000100:00000001:14.0:1773851863.882053:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:8.0:1773851863.882053:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cd342c1.
02000000:00000001:2.0:1773851863.882053:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851863.882054:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:2.0:1773851863.882054:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:8.0:1773851863.882055:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:2.0:1773851863.882055:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004bf45d08.
02000000:00000001:9.0:1773851863.882056:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:8.0:1773851863.882056:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851863.882056:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000020:00000001:9.0:1773851863.882057:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851863.882057:0:41071:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:8.0:1773851863.882057:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851863.882057:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851863.882058:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851863.882059:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:2.0:1773851863.882059:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851863.882060:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851863.882061:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851863.882061:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:9.0:1773851863.882062:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a6c4d9d1.
00000100:00000001:8.0:1773851863.882062:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851863.882062:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.882063:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851863.882063:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851863.882064:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851863.882065:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eba50e83.
00000100:00000001:9.0:1773851863.882066:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851863.882067:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.882068:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851863.882069:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851863.882070:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851863.882071:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851863.882072:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851863.882072:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.882073:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851863.882075:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851863.882079:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851863.882083:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.882084:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13819@kfi7 : PUT - for me
00000400:00000200:5.0:1773851863.882086:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.882087:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 1
00000400:00000200:5.0:1773851863.882089:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.882090:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000400:00000200:5.0:1773851863.882091:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 3
00000400:00000200:5.0:1773851863.882094:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.882096:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13819@kfi7 of length 224 into portal 12 MB=0x699de8c317f00
00000400:00000200:5.0:1773851863.882098:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13819@kfi7 of length 224/224 into md 0x793926dc5 [64] + 131640
00000800:00000200:5.0:1773851863.882100:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851863.882104:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851863.882105:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13819@kfi7: PUT: OK
00000100:00000001:5.0:1773851863.882107:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851863.882107:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851863.882109:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000298dd7d3.
00000100:00000040:5.0:1773851863.882110:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000298dd7d3 x1858030974107392 msgsize 224
00000100:00100000:5.0:1773851863.882113:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13819@kfi7 (source: 12345-13819@kfi7)
00000100:00000001:5.0:1773851863.882115:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851863.882117:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000800:00000200:5.0:1773851863.882119:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851863.882123:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851863.882124:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851863.882125:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851863.882126:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851863.882127:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851863.882128:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974107392
00000020:00000001:5.0:1773851863.882129:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851863.882130:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fa5
00000020:00000001:5.0:1773851863.882130:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851863.882133:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008448863e refcount=6
00000020:00000001:5.0:1773851863.882134:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239880704 : -107152469670912 : ffff9e8b9f1bc400)
00000020:00000001:5.0:1773851863.882136:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239880704 : -107152469670912 : ffff9e8b9f1bc400)
00000100:00000001:5.0:1773851863.882137:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851863.882139:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851863.882140:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cc00b94f.
00000020:00000010:5.0:1773851863.882142:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851863.882143:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851863.882146:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851863.882147:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851863.882148:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851863.882149:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851863.882150:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851863.882151:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.882153:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851863.882155:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851863.882155:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851863.882156:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851863.882156:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851863.882158:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13819@kfi7, seq: 2001901
00000100:00000001:7.0:1773851863.882159:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851863.882159:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008448863e : new rpc_count 1
00000100:00000001:7.0:1773851863.882160:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.882160:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136106907520 : -106937602644096 : ffff9ebda62e6780)
00000100:00000040:5.0:1773851863.882162:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000298dd7d3 x1858030974107392/t0(0) o400->c84ff3af-22be-4ac2-9b5e-c273649e2e5e@13819@kfi7:590/0 lens 224/0 e 0 to 0 dl 1773851950 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne222-0'
00000100:00000001:5.0:1773851863.882167:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851863.882168:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851863.882170:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000298dd7d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c84ff3af-22be-4ac2-9b5e-c273649e2e5e+6:50173:x1858030974107392:12345-13819@kfi7:400:default-tuolumne222-0
00000100:00000200:5.0:1773851863.882173:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974107392
00000020:00000001:5.0:1773851863.882174:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851863.882175:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851863.882176:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.882177:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851863.882178:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851863.882180:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851863.882181:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974107392, found 0 last_xid 1858030974107391
00000020:00000001:5.0:1773851863.882182:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851863.882183:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851863.882184:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851863.882185:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.882186:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851863.882187:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851863.882188:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851863.882189:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002d92bd59.
02000000:00000001:5.0:1773851863.882192:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.882193:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.882194:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851863.882195:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030974107392
00010000:00000001:5.0:1773851863.882197:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851863.882198:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000298dd7d3 x1858030974107392/t0(0) o400->c84ff3af-22be-4ac2-9b5e-c273649e2e5e@13819@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne222-0'
00010000:00000001:5.0:1773851863.882203:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851863.882204:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851863.882205:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=95 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851863.882208:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851863.882209:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000112f6e4e refcount 5 to 13819@kfi7
00000100:00000001:5.0:1773851863.882210:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931325663872 : -107142383887744 : ffff9e8df8449a80)
02000000:00000001:5.0:1773851863.882212:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851863.882213:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851863.882214:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851863.882215:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13819@kfi7
00000400:00000010:5.0:1773851863.882216:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008cc726fa.
00000100:00000200:5.0:1773851863.882218:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974107392, offset 224
00000400:00000200:5.0:1773851863.882220:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13819@kfi7
00000400:00000200:5.0:1773851863.882222:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.882223:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 1
00000400:00000200:5.0:1773851863.882225:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000400:00000200:5.0:1773851863.882227:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 3
00000400:00000200:5.0:1773851863.882229:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13819@kfi7 local destination
00000400:00000200:5.0:1773851863.882231:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769089:8769089:1024:4294967295] 13819@kfi7 LPNI seq info [28026:28026:16:4294967295]
00000400:00000200:5.0:1773851863.882234:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000400:00000200:5.0:1773851863.882235:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:5.0:1773851863.882239:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13819@kfi7(13819@kfi7:13819@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851863.882241:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 3
00000800:00000200:5.0:1773851863.882243:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851863.882245:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851863.882250:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851863.882255:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d6 Using peer 13819@kfi7(0x3d6)
00000800:00000200:5.0:1773851863.882260:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x3d6: rc=0
00000800:00000200:5.0:1773851863.882262:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851863.882266:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851863.882267:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000112f6e4e refcount 4 to 13819@kfi7
00010000:00000001:5.0:1773851863.882269:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851863.882269:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851863.882271:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851863.882272:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000298dd7d3 x1858030974107392/t0(0) o400->c84ff3af-22be-4ac2-9b5e-c273649e2e5e@13819@kfi7:590/0 lens 224/224 e 0 to 0 dl 1773851950 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne222-0'
00000100:00100000:5.0:1773851863.882278:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000298dd7d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c84ff3af-22be-4ac2-9b5e-c273649e2e5e+6:50173:x1858030974107392:12345-13819@kfi7:400:default-tuolumne222-0 Request processed in 109us (166us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851863.882279:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d6 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851863.882282:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:5.0:1773851863.882282:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13819@kfi7, seq: 2001901
00000400:00000200:6.0:1773851863.882284:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13819@kfi7: PUT: OK
00000100:00000040:5.0:1773851863.882284:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008448863e : new rpc_count 0
00000400:00000200:6.0:1773851863.882285:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008cc726fa
00000100:00000001:5.0:1773851863.882285:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:6.0:1773851863.882286:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008cc726fa.
00000100:00000001:5.0:1773851863.882286:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851863.882287:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00000001:6.0:1773851863.882288:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851863.882288:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:5.0:1773851863.882288:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000020:00000010:5.0:1773851863.882290:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cc00b94f.
00000400:00000200:6.0:1773851863.882291:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094e3c3c0 nid 13819@kfi7 refs 2
00000020:00000040:5.0:1773851863.882291:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000008448863e : new refcount 5
00000100:00000001:5.0:1773851863.882292:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851863.882293:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 13819@kfi7(0000000094f58c2b):0x0 lsk 983 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d6 Transaction freed
00000800:00000200:17.0:1773851863.886121:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851863.886122:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851863.886123:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851863.886126:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851863.886128:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13600@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.886129:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13600@kfi7 : PUT - for me
00000400:00000200:17.0:1773851863.886130:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13600@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.886131:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a3707ab nid 13600@kfi7 refs 1
00000400:00000200:17.0:1773851863.886132:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13600@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.886133:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a3707ab nid 13600@kfi7 refs 2
00000400:00000200:17.0:1773851863.886134:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007a3707ab nid 13600@kfi7 refs 3
00000400:00000200:17.0:1773851863.886134:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13601@kfi7 to cpt 7
00000400:00000200:17.0:1773851863.886135:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13601@kfi7 of length 224 into portal 12 MB=0x69b8234613340
00000400:00000200:17.0:1773851863.886137:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13601@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 5624
00000800:00000200:17.0:1773851863.886138:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851863.886140:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851863.886141:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13600@kfi7: PUT: OK
00000100:00000001:17.0:1773851863.886142:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851863.886143:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851863.886144:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a5b9c7c8.
00000100:00000040:17.0:1773851863.886144:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a5b9c7c8 x1859833387103040 msgsize 224
00000100:00100000:17.0:1773851863.886146:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13601@kfi7 (source: 12345-13600@kfi7)
00000100:00000001:17.0:1773851863.886147:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851863.886148:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007a3707ab nid 13600@kfi7 refs 2
00000800:00000200:17.0:1773851863.886149:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851863.886152:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851863.886152:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851863.886153:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851863.886153:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851863.886154:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851863.886154:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833387103040
00000020:00000001:17.0:1773851863.886155:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851863.886156:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c18d508
00000020:00000001:17.0:1773851863.886157:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851863.886159:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c19c56ae refcount=5
00000020:00000001:17.0:1773851863.886159:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637073223818240 : -107000485733376 : ffff9eaf020e9c00)
00000020:00000001:17.0:1773851863.886160:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637073223818240 : -107000485733376 : ffff9eaf020e9c00)
00000100:00000001:17.0:1773851863.886161:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851863.886162:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851863.886163:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005aa634fd.
00000020:00000010:17.0:1773851863.886164:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851863.886165:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851863.886166:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851863.886166:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851863.886167:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851863.886168:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851863.886168:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851863.886169:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.886170:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851863.886171:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851863.886171:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851863.886171:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851863.886172:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13601@kfi7, seq: 2156302
00000100:00000001:16.0:1773851863.886172:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851863.886173:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c19c56ae : new rpc_count 1
00000100:00000001:16.0:1773851863.886173:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.886174:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764364416 : -107095945187200 : ffff9e98c83af080)
00000100:00000001:16.0:1773851863.886174:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851863.886175:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a5b9c7c8 x1859833387103040/t0(0) o400->bd35f8be-f354-4d5a-bf24-dfdda0ddd602@13601@kfi7:84/0 lens 224/0 e 0 to 0 dl 1773852199 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1343-0'
00000100:00000001:17.0:1773851863.886178:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851863.886178:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851863.886179:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a5b9c7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:bd35f8be-f354-4d5a-bf24-dfdda0ddd602+5:39695:x1859833387103040:12345-13601@kfi7:400:default-tuolumne1343-0
00000100:00000200:17.0:1773851863.886181:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833387103040
00000020:00000001:17.0:1773851863.886181:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851863.886182:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851863.886183:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.886183:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851863.886184:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851863.886185:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851863.886186:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833387103040, found 0 last_xid 1859833387103039
00000020:00000001:17.0:1773851863.886187:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851863.886187:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851863.886188:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851863.886188:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.886189:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851863.886190:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851863.886190:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851863.886191:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fbd28a5c.
02000000:00000001:17.0:1773851863.886192:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.886192:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.886193:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851863.886194:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688351, transno 0, xid 1859833387103040
00010000:00000001:17.0:1773851863.886195:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851863.886196:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a5b9c7c8 x1859833387103040/t0(0) o400->bd35f8be-f354-4d5a-bf24-dfdda0ddd602@13601@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1343-0'
00010000:00000001:17.0:1773851863.886198:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851863.886199:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851863.886200:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=96 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851863.886201:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851863.886201:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005a046a68 refcount 3 to 13601@kfi7
00000100:00000001:17.0:1773851863.886202:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214112 : -107155106337504 : ffff9e8b01f36d20)
02000000:00000001:17.0:1773851863.886203:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851863.886204:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.886204:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851863.886205:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13600@kfi7
00000400:00000010:17.0:1773851863.886206:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004cb7cc9f.
00000100:00000200:17.0:1773851863.886207:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833387103040, offset 224
00000400:00000200:17.0:1773851863.886208:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13600@kfi7
00000400:00000200:17.0:1773851863.886209:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13600@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.886210:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a3707ab nid 13600@kfi7 refs 1
00000400:00000200:17.0:1773851863.886211:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007a3707ab nid 13600@kfi7 refs 2
00000400:00000200:17.0:1773851863.886213:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007a3707ab nid 13600@kfi7 refs 3
00000400:00000200:17.0:1773851863.886214:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13600@kfi7 local destination
00000400:00000200:17.0:1773851863.886215:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769090:8769090:1024:4294967295] 13600@kfi7 LPNI seq info [241750:241750:16:4294967295]
00000400:00000200:17.0:1773851863.886217:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007a3707ab nid 13600@kfi7 refs 2
00000400:00000200:17.0:1773851863.886218:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13600@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.886220:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13600@kfi7(13600@kfi7:13600@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851863.886221:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007a3707ab nid 13600@kfi7 refs 3
00000800:00000200:17.0:1773851863.886222:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851863.886223:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851863.886225:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851863.886227:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007a5 Using peer 13600@kfi7(0x1000000000007a5)
00000800:00000200:17.0:1773851863.886231:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x1000000000007a5: rc=0
00000800:00000200:17.0:1773851863.886233:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007a5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851863.886235:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851863.886236:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005a046a68 refcount 2 to 13601@kfi7
00010000:00000001:17.0:1773851863.886237:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851863.886237:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.886238:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851863.886238:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a5b9c7c8 x1859833387103040/t0(0) o400->bd35f8be-f354-4d5a-bf24-dfdda0ddd602@13601@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1343-0'
00000100:00100000:17.0:1773851863.886242:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a5b9c7c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:bd35f8be-f354-4d5a-bf24-dfdda0ddd602+5:39695:x1859833387103040:12345-13601@kfi7:400:default-tuolumne1343-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851863.886245:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007a5 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851863.886245:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13601@kfi7, seq: 2156302
00000100:00000040:17.0:1773851863.886246:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c19c56ae : new rpc_count 0
00000100:00000001:17.0:1773851863.886246:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851863.886247:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851863.886247:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:18.0:1773851863.886248:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13600@kfi7: PUT: OK
00000020:00000010:17.0:1773851863.886248:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851863.886249:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004cb7cc9f
00000400:00000010:18.0:1773851863.886249:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004cb7cc9f.
00000020:00000010:17.0:1773851863.886249:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000100:00000001:18.0:1773851863.886250:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851863.886250:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:17.0:1773851863.886250:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005aa634fd.
00000020:00000040:17.0:1773851863.886250:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000c19c56ae : new refcount 4
00000400:00000200:18.0:1773851863.886251:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007a3707ab nid 13600@kfi7 refs 2
00000100:00000001:17.0:1773851863.886251:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851863.886253:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 13600@kfi7(00000000b2fcfd74):0x0 lsk 1958 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007a5 Transaction freed
00000800:00000200:17.0:1773851863.945292:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851863.945293:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851863.945294:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851863.945296:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851863.945298:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.945299:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20064@kfi7 : PUT - for me
00000400:00000200:17.0:1773851863.945300:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.945301:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021369ba6 nid 20064@kfi7 refs 1
00000400:00000200:17.0:1773851863.945302:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.945303:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021369ba6 nid 20064@kfi7 refs 2
00000400:00000200:17.0:1773851863.945303:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021369ba6 nid 20064@kfi7 refs 3
00000400:00000200:17.0:1773851863.945304:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.945305:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20064@kfi7 of length 224 into portal 12 MB=0x69b16f5d4b380
00000400:00000200:17.0:1773851863.945306:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20064@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 5848
00000800:00000200:17.0:1773851863.945308:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851863.945309:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851863.945310:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20064@kfi7: PUT: OK
00000100:00000001:17.0:1773851863.945311:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851863.945311:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851863.945312:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000341b955c.
00000100:00000040:17.0:1773851863.945312:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000341b955c x1859372776207232 msgsize 224
00000100:00100000:17.0:1773851863.945314:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20064@kfi7 (source: 12345-20064@kfi7)
00000100:00000001:17.0:1773851863.945315:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851863.945316:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021369ba6 nid 20064@kfi7 refs 2
00000800:00000200:17.0:1773851863.945317:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851863.945320:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851863.945320:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851863.945321:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851863.945321:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851863.945322:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851863.945322:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372776207232
00000020:00000001:17.0:1773851863.945323:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851863.945323:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793af9d4a3
00000020:00000001:17.0:1773851863.945324:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851863.945328:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005a4dfb5d refcount=300
00000020:00000001:17.0:1773851863.945328:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946285607936 : -107127423943680 : ffff9e9173f33c00)
00000020:00000001:17.0:1773851863.945329:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946285607936 : -107127423943680 : ffff9e9173f33c00)
00000100:00000001:17.0:1773851863.945330:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851863.945331:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851863.945331:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005aa634fd.
00000020:00000010:17.0:1773851863.945332:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851863.945333:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851863.945333:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851863.945334:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851863.945334:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851863.945335:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851863.945335:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851863.945336:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.945337:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851863.945338:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851863.945338:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851863.945338:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851863.945339:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20064@kfi7, seq: 2156303
00000100:00000001:16.0:1773851863.945339:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851863.945340:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005a4dfb5d : new rpc_count 11
00000100:00000001:17.0:1773851863.945340:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764360960 : -107095945190656 : ffff9e98c83ae300)
00000100:00000001:16.0:1773851863.945340:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851863.945340:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851863.945341:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000341b955c x1859372776207232/t0(0) o400->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:84/0 lens 224/0 e 0 to 0 dl 1773852199 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1744-0'
00000100:00000001:17.0:1773851863.945347:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851863.945347:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851863.945348:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000341b955c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:179dc248-1257-4dfe-bb71-f157f3daaf14+300:39774:x1859372776207232:12345-20064@kfi7:400:default-tuolumne1744-0
00000100:00000200:17.0:1773851863.945349:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372776207232
00000020:00000001:17.0:1773851863.945350:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851863.945350:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851863.945351:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.945352:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851863.945352:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851863.945353:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851863.945353:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372776207232, found 0 last_xid 1859372770172415
00000020:00000001:17.0:1773851863.945354:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851863.945355:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851863.945355:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851863.945355:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.945356:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851863.945357:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851863.945357:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851863.945358:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009fc37a49.
02000000:00000001:17.0:1773851863.945358:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.945359:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.945360:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851863.945360:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588432, transno 0, xid 1859372776207232
00010000:00000001:17.0:1773851863.945361:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851863.945362:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000341b955c x1859372776207232/t0(0) o400->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1744-0'
00010000:00000001:17.0:1773851863.945364:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851863.945364:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851863.945365:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=96 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851863.945366:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851863.945366:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000061de2c3f refcount 3 to 20064@kfi7
00000100:00000001:17.0:1773851863.945367:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333280 : -107155408218336 : ffff9e8aeff51720)
02000000:00000001:17.0:1773851863.945371:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851863.945371:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851863.945371:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851863.945372:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20064@kfi7
00000400:00000010:17.0:1773851863.945373:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057d98c22.
00000100:00000200:17.0:1773851863.945374:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372776207232, offset 224
00000400:00000200:17.0:1773851863.945375:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20064@kfi7
00000400:00000200:17.0:1773851863.945376:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.945376:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021369ba6 nid 20064@kfi7 refs 1
00000400:00000200:17.0:1773851863.945377:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021369ba6 nid 20064@kfi7 refs 2
00000400:00000200:17.0:1773851863.945378:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021369ba6 nid 20064@kfi7 refs 3
00000400:00000200:17.0:1773851863.945379:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20064@kfi7 local destination
00000400:00000200:17.0:1773851863.945380:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769091:8769091:1024:4294967295] 20064@kfi7 LPNI seq info [370257:370257:16:4294967295]
00000400:00000200:17.0:1773851863.945382:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021369ba6 nid 20064@kfi7 refs 2
00000400:00000200:17.0:1773851863.945382:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:17.0:1773851863.945384:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20064@kfi7(20064@kfi7:20064@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851863.945385:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021369ba6 nid 20064@kfi7 refs 3
00000800:00000200:17.0:1773851863.945386:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851863.945387:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851863.945389:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851863.945392:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c8 Using peer 20064@kfi7(0x1000000000005c8)
00000800:00000200:17.0:1773851863.945395:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x1000000000005c8: rc=0
00000800:00000200:17.0:1773851863.945396:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851863.945398:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851863.945399:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000061de2c3f refcount 2 to 20064@kfi7
00010000:00000001:17.0:1773851863.945399:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851863.945400:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851863.945401:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851863.945401:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000341b955c x1859372776207232/t0(0) o400->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1744-0'
00000100:00100000:17.0:1773851863.945405:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000341b955c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:179dc248-1257-4dfe-bb71-f157f3daaf14+300:39774:x1859372776207232:12345-20064@kfi7:400:default-tuolumne1744-0 Request processed in 57us (92us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851863.945408:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20064@kfi7, seq: 2156303
00000100:00000040:17.0:1773851863.945408:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005a4dfb5d : new rpc_count 10
00000800:00000200:18.0:1773851863.945409:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c8 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851863.945409:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851863.945409:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:18.0:1773851863.945410:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851863.945410:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851863.945410:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851863.945411:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20064@kfi7: PUT: OK
00000020:00000010:17.0:1773851863.945411:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005aa634fd.
00000400:00000200:18.0:1773851863.945412:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057d98c22
00000400:00000010:18.0:1773851863.945412:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057d98c22.
00000020:00000040:17.0:1773851863.945412:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000005a4dfb5d : new refcount 299
00000100:00000001:18.0:1773851863.945413:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851863.945413:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851863.945413:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851863.945414:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021369ba6 nid 20064@kfi7 refs 2
00000800:00000200:18.0:1773851863.945415:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 20064@kfi7(000000002eba39d5):0x0 lsk 1481 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c8 Transaction freed
00000400:00000200:29.0:1773851863.945731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851863.945732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:25.0:1773851864.068182:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851864.068183:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851864.068185:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851864.068189:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851864.068193:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25827@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.068194:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25827@kfi7 : PUT - for me
00000400:00000200:25.0:1773851864.068196:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25827@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.068197:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093046c79 nid 25827@kfi7 refs 1
00000400:00000200:25.0:1773851864.068199:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25827@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.068200:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093046c79 nid 25827@kfi7 refs 2
00000400:00000200:25.0:1773851864.068201:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000093046c79 nid 25827@kfi7 refs 3
00000400:00000200:25.0:1773851864.068203:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25634@kfi7 to cpt 0
00000400:00000200:25.0:1773851864.068204:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25634@kfi7 of length 224 into portal 12 MB=0x69b4b5a2f5900
00000400:00000200:25.0:1773851864.068206:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25634@kfi7 of length 224/224 into md 0x16159c9699 [64] + 1344
00000800:00000200:25.0:1773851864.068209:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851864.068212:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851864.068218:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25827@kfi7: PUT: OK
00000100:00000001:25.0:1773851864.068219:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851864.068220:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851864.068221:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000049020113.
00000100:00000040:25.0:1773851864.068222:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000049020113 x1859597798168832 msgsize 224
00000100:00100000:25.0:1773851864.068225:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-25634@kfi7 (source: 12345-25827@kfi7)
00000100:00000001:25.0:1773851864.068227:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851864.068228:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000093046c79 nid 25827@kfi7 refs 2
00000800:00000200:25.0:1773851864.068231:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851864.068235:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851864.068236:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851864.068236:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851864.068237:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851864.068238:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851864.068239:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597798168832
00000020:00000001:25.0:1773851864.068240:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851864.068241:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e71125
00000020:00000001:25.0:1773851864.068242:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851864.068244:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000428e0946 refcount=5
00000020:00000001:25.0:1773851864.068245:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934251969536 : -107139457582080 : ffff9e8ea6b07c00)
00000020:00000001:25.0:1773851864.068246:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934251969536 : -107139457582080 : ffff9e8ea6b07c00)
00000100:00000001:25.0:1773851864.068247:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851864.068249:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851864.068249:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000212fefaf.
00000020:00000010:25.0:1773851864.068251:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851864.068252:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094918347.
00000100:00000001:25.0:1773851864.068253:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851864.068254:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851864.068255:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851864.068256:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851864.068257:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851864.068258:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851864.068259:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851864.068261:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851864.068261:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851864.068262:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851864.068263:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851864.068264:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25634@kfi7, seq: 2025087
00000100:00000040:24.0:1773851864.068265:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000428e0946 : new rpc_count 1
00000100:00000001:25.0:1773851864.068266:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851864.068266:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.068267:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478759296 : -106938230792320 : ffff9ebd80bd9f80)
00000100:00000040:24.0:1773851864.068269:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000049020113 x1859597798168832/t0(0) o400->549eec84-ebbe-4fe4-a239-cb987e6f0495@25634@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2091-0'
00000100:00000001:24.0:1773851864.068279:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851864.068279:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851864.068281:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049020113 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:549eec84-ebbe-4fe4-a239-cb987e6f0495+5:39458:x1859597798168832:12345-25634@kfi7:400:default-tuolumne2091-0
00000100:00000200:24.0:1773851864.068283:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597798168832
00000020:00000001:24.0:1773851864.068284:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851864.068285:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851864.068286:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.068287:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851864.068288:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851864.068289:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851864.068290:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597798168832, found 0 last_xid 1859597798168831
00000020:00000001:24.0:1773851864.068291:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851864.068293:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851864.068293:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851864.068294:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.068296:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851864.068297:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851864.068297:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851864.068299:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000012e7cd8f.
02000000:00000001:24.0:1773851864.068300:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.068301:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.068302:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851864.068303:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106669102, transno 0, xid 1859597798168832
00010000:00000001:24.0:1773851864.068304:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851864.068305:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000049020113 x1859597798168832/t0(0) o400->549eec84-ebbe-4fe4-a239-cb987e6f0495@25634@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2091-0'
00010000:00000001:24.0:1773851864.068310:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851864.068310:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851864.068312:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=97 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851864.068314:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851864.068315:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000064ec5252 refcount 3 to 25634@kfi7
00000100:00000001:24.0:1773851864.068316:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729380320 : -107155980171296 : ffff9e8acdddc7e0)
02000000:00000001:24.0:1773851864.068318:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851864.068319:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.068320:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851864.068321:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25827@kfi7
00000400:00000010:24.0:1773851864.068322:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c206b7b6.
00000100:00000200:24.0:1773851864.068323:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597798168832, offset 224
00000400:00000200:24.0:1773851864.068325:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25827@kfi7
00000400:00000200:24.0:1773851864.068327:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25827@kfi7 to cpt 6
00000400:00000200:24.0:1773851864.068328:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093046c79 nid 25827@kfi7 refs 1
00000400:00000200:24.0:1773851864.068329:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000093046c79 nid 25827@kfi7 refs 2
00000400:00000200:24.0:1773851864.068331:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000093046c79 nid 25827@kfi7 refs 3
00000400:00000200:24.0:1773851864.068333:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25827@kfi7 local destination
00000400:00000200:24.0:1773851864.068335:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769092:8769092:1024:4294967295] 25827@kfi7 LPNI seq info [910362:910362:16:4294967295]
00000400:00000200:24.0:1773851864.068338:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000093046c79 nid 25827@kfi7 refs 2
00000400:00000200:24.0:1773851864.068339:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25827@kfi7 to cpt 6
00000400:00000200:24.0:1773851864.068342:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25827@kfi7(25827@kfi7:25827@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851864.068344:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000093046c79 nid 25827@kfi7 refs 3
00000800:00000200:24.0:1773851864.068346:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851864.068348:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851864.068351:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851864.068355:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x84c Using peer 25827@kfi7(0x84c)
00000800:00000200:24.0:1773851864.068360:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0x84c: rc=0
00000800:00000200:24.0:1773851864.068362:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x84c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851864.068365:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851864.068366:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000064ec5252 refcount 2 to 25634@kfi7
00010000:00000001:24.0:1773851864.068368:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851864.068371:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.068375:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851864.068376:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000049020113 x1859597798168832/t0(0) o400->549eec84-ebbe-4fe4-a239-cb987e6f0495@25634@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2091-0'
00000100:00100000:24.0:1773851864.068381:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049020113 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:549eec84-ebbe-4fe4-a239-cb987e6f0495+5:39458:x1859597798168832:12345-25634@kfi7:400:default-tuolumne2091-0 Request processed in 101us (158us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851864.068385:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25634@kfi7, seq: 2025087
00000100:00000040:24.0:1773851864.068386:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000428e0946 : new rpc_count 0
00000100:00000001:24.0:1773851864.068387:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851864.068388:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851864.068389:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851864.068390:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094918347.
00000020:00000010:24.0:1773851864.068391:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000212fefaf.
00000020:00000040:24.0:1773851864.068392:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000428e0946 : new refcount 4
00000100:00000001:24.0:1773851864.068394:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851864.068401:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x84c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851864.068404:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851864.068405:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25827@kfi7: PUT: OK
00000400:00000200:25.0:1773851864.068407:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c206b7b6
00000400:00000010:25.0:1773851864.068407:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c206b7b6.
00000100:00000001:25.0:1773851864.068408:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851864.068409:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851864.068411:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000093046c79 nid 25827@kfi7 refs 2
00000800:00000200:25.0:1773851864.068413:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 25827@kfi7(00000000eda2df33):0x0 lsk 2125 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x84c Transaction freed
00000800:00000200:17.0:1773851864.094282:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.094282:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851864.094284:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.094286:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851864.094288:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14930@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.094289:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14930@kfi7 : PUT - for me
00000400:00000200:17.0:1773851864.094290:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14930@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.094291:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f30af454 nid 14930@kfi7 refs 1
00000400:00000200:17.0:1773851864.094292:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14930@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.094292:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f30af454 nid 14930@kfi7 refs 2
00000400:00000200:17.0:1773851864.094293:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f30af454 nid 14930@kfi7 refs 3
00000400:00000200:17.0:1773851864.094294:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14994@kfi7 to cpt 7
00000400:00000200:17.0:1773851864.094295:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14994@kfi7 of length 224 into portal 12 MB=0x69b0a09732cc0
00000400:00000200:17.0:1773851864.094296:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14994@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 6072
00000800:00000200:17.0:1773851864.094298:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851864.094300:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.094301:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14930@kfi7: PUT: OK
00000100:00000001:17.0:1773851864.094302:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851864.094302:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851864.094303:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000635870f3.
00000100:00000040:17.0:1773851864.094304:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000635870f3 x1859317270785216 msgsize 224
00000100:00100000:17.0:1773851864.094305:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14994@kfi7 (source: 12345-14930@kfi7)
00000100:00000001:17.0:1773851864.094307:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851864.094307:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f30af454 nid 14930@kfi7 refs 2
00000800:00000200:17.0:1773851864.094309:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851864.094311:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851864.094312:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851864.094312:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851864.094313:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851864.094314:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851864.094314:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317270785216
00000020:00000001:17.0:1773851864.094315:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851864.094315:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9196f
00000020:00000001:17.0:1773851864.094316:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851864.094318:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac2b121c refcount=6
00000020:00000001:17.0:1773851864.094318:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242246144 : -107152467305472 : ffff9e8b9f3fdc00)
00000020:00000001:17.0:1773851864.094319:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242246144 : -107152467305472 : ffff9e8b9f3fdc00)
00000100:00000001:17.0:1773851864.094320:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851864.094321:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851864.094322:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005aa634fd.
00000020:00000010:17.0:1773851864.094323:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851864.094324:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851864.094325:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851864.094325:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851864.094326:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851864.094326:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851864.094328:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851864.094328:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.094329:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851864.094330:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851864.094330:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851864.094330:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851864.094331:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851864.094332:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14994@kfi7, seq: 2156304
00000100:00000040:17.0:1773851864.094332:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac2b121c : new rpc_count 1
00000100:00000001:16.0:1773851864.094332:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.094333:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764359808 : -107095945191808 : ffff9e98c83ade80)
00000100:00000001:16.0:1773851864.094333:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851864.094334:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000635870f3 x1859317270785216/t0(0) o400->258cb97d-2155-4bff-a1ab-e06461c5533a@14994@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1430-0'
00000100:00000001:17.0:1773851864.094337:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851864.094337:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851864.094338:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000635870f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:258cb97d-2155-4bff-a1ab-e06461c5533a+6:39617:x1859317270785216:12345-14994@kfi7:400:default-tuolumne1430-0
00000100:00000200:17.0:1773851864.094340:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317270785216
00000020:00000001:17.0:1773851864.094340:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851864.094341:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851864.094341:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.094342:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851864.094343:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851864.094343:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851864.094344:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317270785216, found 0 last_xid 1859317270785215
00000020:00000001:17.0:1773851864.094345:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851864.094345:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851864.094346:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851864.094347:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.094347:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851864.094348:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851864.094348:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851864.094349:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003f3a0201.
02000000:00000001:17.0:1773851864.094350:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.094350:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.094351:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851864.094352:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255655022, transno 0, xid 1859317270785216
00010000:00000001:17.0:1773851864.094353:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851864.094354:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000635870f3 x1859317270785216/t0(0) o400->258cb97d-2155-4bff-a1ab-e06461c5533a@14994@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1430-0'
00010000:00000001:17.0:1773851864.094356:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851864.094356:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851864.094357:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=97 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851864.094358:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851864.094359:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b406a98a refcount 3 to 14994@kfi7
00000100:00000001:17.0:1773851864.094359:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270240 : -107152618281376 : ffff9e8b96402660)
02000000:00000001:17.0:1773851864.094360:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851864.094360:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.094361:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851864.094362:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14930@kfi7
00000400:00000010:17.0:1773851864.094362:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003fab839b.
00000100:00000200:17.0:1773851864.094363:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317270785216, offset 224
00000400:00000200:17.0:1773851864.094364:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14930@kfi7
00000400:00000200:17.0:1773851864.094365:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14930@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.094366:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f30af454 nid 14930@kfi7 refs 1
00000400:00000200:17.0:1773851864.094367:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f30af454 nid 14930@kfi7 refs 2
00000400:00000200:17.0:1773851864.094367:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f30af454 nid 14930@kfi7 refs 3
00000400:00000200:17.0:1773851864.094368:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14930@kfi7 local destination
00000400:00000200:17.0:1773851864.094370:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769093:8769093:1024:4294967295] 14930@kfi7 LPNI seq info [691473:691473:16:4294967295]
00000400:00000200:17.0:1773851864.094371:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f30af454 nid 14930@kfi7 refs 2
00000400:00000200:17.0:1773851864.094371:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14930@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.094373:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14930@kfi7(14930@kfi7:14930@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851864.094374:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f30af454 nid 14930@kfi7 refs 3
00000800:00000200:17.0:1773851864.094375:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.094376:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851864.094378:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851864.094381:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000044e Using peer 14930@kfi7(0x10000000000044e)
00000800:00000200:17.0:1773851864.094384:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x10000000000044e: rc=0
00000800:00000200:17.0:1773851864.094385:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000044e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851864.094387:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851864.094387:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b406a98a refcount 2 to 14994@kfi7
00010000:00000001:17.0:1773851864.094388:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851864.094388:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.094389:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851864.094390:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000635870f3 x1859317270785216/t0(0) o400->258cb97d-2155-4bff-a1ab-e06461c5533a@14994@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1430-0'
00000100:00100000:17.0:1773851864.094393:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000635870f3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:258cb97d-2155-4bff-a1ab-e06461c5533a+6:39617:x1859317270785216:12345-14994@kfi7:400:default-tuolumne1430-0 Request processed in 55us (87us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851864.094395:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14994@kfi7, seq: 2156304
00000100:00000040:17.0:1773851864.094395:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac2b121c : new rpc_count 0
00000100:00000001:17.0:1773851864.094396:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851864.094397:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851864.094397:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000800:00000200:18.0:1773851864.094398:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000044e TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851864.094398:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851864.094399:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851864.094399:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005aa634fd.
00000020:00000040:17.0:1773851864.094399:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000ac2b121c : new refcount 5
00000400:00000200:18.0:1773851864.094400:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14930@kfi7: PUT: OK
00000100:00000001:17.0:1773851864.094400:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851864.094401:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003fab839b
00000400:00000010:18.0:1773851864.094401:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003fab839b.
00000100:00000001:18.0:1773851864.094402:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851864.094402:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851864.094403:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f30af454 nid 14930@kfi7 refs 2
00000800:00000200:18.0:1773851864.094404:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 14930@kfi7(00000000cbb8e873):0x0 lsk 1103 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000044e Transaction freed
00000800:00000200:17.0:1773851864.099058:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.099059:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:17.0:1773851864.099060:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851864.099062:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18496@kfi7(00000000f4c18295):0xc4a version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851864.099063:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.099063:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a Using peer 18496@kfi7(0xc4a)
00000800:00000200:18.0:1773851864.099064:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851864.099065:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851864.099065:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18496@kfi7 to cpt 4
00000800:00000200:18.0:1773851864.099067:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851864.099067:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 38 bytes to peer 0xc4a: rc=0
00000400:00000200:18.0:1773851864.099069:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18496@kfi7 to cpt 4
00000800:00000200:17.0:1773851864.099069:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851864.099070:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18496@kfi7 : PUT - for me
00000400:00000200:18.0:1773851864.099071:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18496@kfi7 to cpt 4
00000400:00000200:18.0:1773851864.099072:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080fbdc5c nid 18496@kfi7 refs 1
00000400:00000200:18.0:1773851864.099074:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18496@kfi7 to cpt 4
00000400:00000200:18.0:1773851864.099075:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080fbdc5c nid 18496@kfi7 refs 2
00000400:00000200:18.0:1773851864.099075:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000080fbdc5c nid 18496@kfi7 refs 3
00000400:00000200:18.0:1773851864.099076:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18561@kfi7 to cpt 3
00000400:00000200:18.0:1773851864.099077:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18561@kfi7 of length 224 into portal 12 MB=0x699e0f706c800
00000400:00000200:18.0:1773851864.099078:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18561@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 6296
00000800:00000200:18.0:1773851864.099080:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.099080:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851864.099081:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851864.099082:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18496@kfi7: PUT: OK
00000800:00000200:17.0:1773851864.099082:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a Transaction freed
00000100:00000001:18.0:1773851864.099084:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851864.099084:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851864.099085:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000e8edd7c.
00000100:00000040:18.0:1773851864.099086:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000000e8edd7c x1858041356404736 msgsize 224
00000100:00100000:18.0:1773851864.099087:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-18561@kfi7 (source: 12345-18496@kfi7)
00000100:00000001:18.0:1773851864.099088:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851864.099089:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000080fbdc5c nid 18496@kfi7 refs 2
00000100:00000001:17.0:1773851864.099089:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851864.099090:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:17.0:1773851864.099090:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851864.099090:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851864.099090:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851864.099091:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851864.099091:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041356404736
00000020:00000001:17.0:1773851864.099092:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851864.099092:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac923d3
00000020:00000001:17.0:1773851864.099092:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851864.099095:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006178859b refcount=6
00000020:00000001:17.0:1773851864.099096:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630292480 : -107123079259136 : ffff9e9276e9dc00)
00000020:00000001:17.0:1773851864.099096:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630292480 : -107123079259136 : ffff9e9276e9dc00)
00000100:00000001:17.0:1773851864.099097:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851864.099098:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851864.099099:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005aa634fd.
00000020:00000010:17.0:1773851864.099099:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851864.099100:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851864.099100:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851864.099101:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851864.099101:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851864.099102:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851864.099102:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851864.099103:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.099103:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851864.099104:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851864.099105:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851864.099106:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851864.099106:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851864.099107:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18561@kfi7, seq: 2156305
00000100:00000040:17.0:1773851864.099107:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006178859b : new rpc_count 1
00000100:00000001:16.0:1773851864.099107:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.099108:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534663040 : -106946174888576 : ffff9ebba73c5580)
00000100:00000001:16.0:1773851864.099108:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851864.099109:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000e8edd7c x1858041356404736/t0(0) o400->e64f2cf4-78ee-44fb-aa12-3d71a9e3a0a0@18561@kfi7:652/0 lens 224/0 e 0 to 0 dl 1773852012 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1652-0'
00000100:00000001:17.0:1773851864.099111:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851864.099112:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851864.099113:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e8edd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e64f2cf4-78ee-44fb-aa12-3d71a9e3a0a0+6:39812:x1858041356404736:12345-18561@kfi7:400:default-tuolumne1652-0
00000100:00000200:17.0:1773851864.099114:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041356404736
00000020:00000001:17.0:1773851864.099114:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851864.099115:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851864.099115:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.099116:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851864.099116:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851864.099117:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851864.099117:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041356404736, found 0 last_xid 1858041356404735
00000020:00000001:17.0:1773851864.099118:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851864.099119:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851864.099119:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851864.099119:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.099120:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851864.099120:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851864.099121:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851864.099121:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002576ab00.
02000000:00000001:17.0:1773851864.099122:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.099123:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.099123:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851864.099124:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260700648, transno 0, xid 1858041356404736
00010000:00000001:17.0:1773851864.099124:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851864.099125:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000e8edd7c x1858041356404736/t0(0) o400->e64f2cf4-78ee-44fb-aa12-3d71a9e3a0a0@18561@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1652-0'
00010000:00000001:17.0:1773851864.099128:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851864.099129:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851864.099129:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=97 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851864.099130:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851864.099131:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000de868249 refcount 3 to 18561@kfi7
00000100:00000001:17.0:1773851864.099131:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620160 : -107151221931456 : ffff9e8be97ac240)
02000000:00000001:17.0:1773851864.099132:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851864.099132:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.099133:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851864.099133:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18496@kfi7
00000400:00000010:17.0:1773851864.099134:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000094b822eb.
00000100:00000200:17.0:1773851864.099135:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041356404736, offset 224
00000400:00000200:17.0:1773851864.099136:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18496@kfi7
00000400:00000200:17.0:1773851864.099137:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18496@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.099137:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080fbdc5c nid 18496@kfi7 refs 1
00000400:00000200:17.0:1773851864.099138:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000080fbdc5c nid 18496@kfi7 refs 2
00000400:00000200:17.0:1773851864.099139:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000080fbdc5c nid 18496@kfi7 refs 3
00000400:00000200:17.0:1773851864.099140:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18496@kfi7 local destination
00000400:00000200:17.0:1773851864.099141:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769094:8769094:1024:4294967295] 18496@kfi7 LPNI seq info [1004759:1004759:16:4294967295]
00000400:00000200:17.0:1773851864.099143:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000080fbdc5c nid 18496@kfi7 refs 2
00000400:00000200:17.0:1773851864.099143:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18496@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.099145:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18496@kfi7(18496@kfi7:18496@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851864.099146:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000080fbdc5c nid 18496@kfi7 refs 3
00000800:00000200:17.0:1773851864.099147:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.099148:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851864.099150:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851864.099152:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a Using peer 18496@kfi7(0xc4a)
00000800:00000200:17.0:1773851864.099155:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0xc4a: rc=0
00000800:00000200:17.0:1773851864.099156:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851864.099158:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851864.099159:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000de868249 refcount 2 to 18561@kfi7
00010000:00000001:17.0:1773851864.099160:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851864.099160:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.099161:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851864.099161:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000e8edd7c x1858041356404736/t0(0) o400->e64f2cf4-78ee-44fb-aa12-3d71a9e3a0a0@18561@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1652-0'
00000100:00100000:17.0:1773851864.099164:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e8edd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e64f2cf4-78ee-44fb-aa12-3d71a9e3a0a0+6:39812:x1858041356404736:12345-18561@kfi7:400:default-tuolumne1652-0 Request processed in 52us (78us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851864.099167:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18561@kfi7, seq: 2156305
00000800:00000200:18.0:1773851864.099168:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851864.099168:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006178859b : new rpc_count 0
00000100:00000001:17.0:1773851864.099168:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851864.099169:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851864.099169:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851864.099170:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851864.099170:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851864.099171:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18496@kfi7: PUT: OK
00000400:00000200:18.0:1773851864.099171:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000094b822eb
00000020:00000010:17.0:1773851864.099171:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005aa634fd.
00000020:00000040:17.0:1773851864.099171:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000006178859b : new refcount 5
00000400:00000010:18.0:1773851864.099172:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000094b822eb.
00000100:00000001:18.0:1773851864.099172:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851864.099172:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851864.099173:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851864.099173:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000080fbdc5c nid 18496@kfi7 refs 2
00000800:00000200:18.0:1773851864.099175:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 18496@kfi7(00000000f4c18295):0x0 lsk 3147 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc4a Transaction freed
00000800:00000200:5.0:1773851864.122410:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.122411:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851864.122413:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851864.122417:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851864.122421:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15505@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.122423:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15505@kfi7 : PUT - for me
00000400:00000200:5.0:1773851864.122424:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15505@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.122426:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd00b748 nid 15505@kfi7 refs 1
00000400:00000200:5.0:1773851864.122427:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15505@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.122428:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd00b748 nid 15505@kfi7 refs 2
00000400:00000200:5.0:1773851864.122430:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fd00b748 nid 15505@kfi7 refs 3
00000400:00000200:5.0:1773851864.122431:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15504@kfi7 to cpt 6
00000400:00000200:5.0:1773851864.122433:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15504@kfi7 of length 224 into portal 12 MB=0x69b4b5b47c200
00000400:00000200:5.0:1773851864.122435:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15504@kfi7 of length 224/224 into md 0x793926dc5 [64] + 131864
00000800:00000200:5.0:1773851864.122438:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851864.122441:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.122443:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15505@kfi7: PUT: OK
00000100:00000001:5.0:1773851864.122444:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851864.122445:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851864.122447:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d43aa887.
00000100:00000040:5.0:1773851864.122448:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d43aa887 x1859597816545792 msgsize 224
00000100:00100000:5.0:1773851864.122450:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-15504@kfi7 (source: 12345-15505@kfi7)
00000100:00000001:5.0:1773851864.122452:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851864.122453:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fd00b748 nid 15505@kfi7 refs 2
00000800:00000200:5.0:1773851864.122456:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851864.122460:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851864.122461:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851864.122462:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851864.122463:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.122464:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851864.122465:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597816545792
00000020:00000001:5.0:1773851864.122466:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851864.122467:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d824c2
00000020:00000001:5.0:1773851864.122468:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851864.122471:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ddcade45 refcount=5
00000020:00000001:5.0:1773851864.122472:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113519887360 : -106960189664256 : ffff9eb863e3d400)
00000020:00000001:5.0:1773851864.122474:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113519887360 : -106960189664256 : ffff9eb863e3d400)
00000100:00000001:5.0:1773851864.122475:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.122477:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851864.122478:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cc00b94f.
00000020:00000010:5.0:1773851864.122479:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.122481:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851864.122482:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851864.122483:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851864.122484:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.122485:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851864.122486:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851864.122487:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.122488:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.122490:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.122491:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.122491:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851864.122491:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851864.122493:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15504@kfi7, seq: 2001902
00000100:00000001:7.0:1773851864.122494:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.122494:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ddcade45 : new rpc_count 1
00000100:00000001:7.0:1773851864.122495:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.122495:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886761216 : -106955822790400 : ffff9eb9682d0900)
00000100:00000040:5.0:1773851864.122497:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d43aa887 x1859597816545792/t0(0) o400->14284d43-cd55-484c-ab70-a6712feea0ac@15504@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1458-0'
00000100:00000001:5.0:1773851864.122502:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.122503:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851864.122504:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d43aa887 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:14284d43-cd55-484c-ab70-a6712feea0ac+5:39588:x1859597816545792:12345-15504@kfi7:400:default-tuolumne1458-0
00000100:00000200:5.0:1773851864.122506:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597816545792
00000020:00000001:5.0:1773851864.122507:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851864.122508:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851864.122509:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.122510:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851864.122511:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851864.122512:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851864.122514:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597816545792, found 0 last_xid 1859597816545791
00000020:00000001:5.0:1773851864.122515:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851864.122516:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851864.122517:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851864.122518:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.122519:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851864.122520:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851864.122520:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851864.122522:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004438806d.
02000000:00000001:5.0:1773851864.122523:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.122524:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.122525:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851864.122526:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915825925, transno 0, xid 1859597816545792
00010000:00000001:5.0:1773851864.122527:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851864.122528:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d43aa887 x1859597816545792/t0(0) o400->14284d43-cd55-484c-ab70-a6712feea0ac@15504@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1458-0'
00010000:00000001:5.0:1773851864.122533:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851864.122533:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851864.122535:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=96 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851864.122536:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851864.122537:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000792a64ac refcount 3 to 15504@kfi7
00000100:00000001:5.0:1773851864.122539:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985417920 : -107156724133696 : ffff9e8aa185d0c0)
02000000:00000001:5.0:1773851864.122540:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851864.122541:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.122542:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851864.122543:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15505@kfi7
00000400:00000010:5.0:1773851864.122544:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000a4ed2b3.
00000100:00000200:5.0:1773851864.122546:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597816545792, offset 224
00000400:00000200:5.0:1773851864.122548:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15505@kfi7
00000400:00000200:5.0:1773851864.122549:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15505@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.122550:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd00b748 nid 15505@kfi7 refs 1
00000400:00000200:5.0:1773851864.122552:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fd00b748 nid 15505@kfi7 refs 2
00000400:00000200:5.0:1773851864.122553:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fd00b748 nid 15505@kfi7 refs 3
00000400:00000200:5.0:1773851864.122555:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15505@kfi7 local destination
00000400:00000200:5.0:1773851864.122561:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769095:8769095:1024:4294967295] 15505@kfi7 LPNI seq info [962485:962485:16:4294967295]
00000400:00000200:5.0:1773851864.122564:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fd00b748 nid 15505@kfi7 refs 2
00000400:00000200:5.0:1773851864.122565:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15505@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.122568:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15505@kfi7(15505@kfi7:15505@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851864.122571:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fd00b748 nid 15505@kfi7 refs 3
00000800:00000200:5.0:1773851864.122573:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.122575:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851864.122578:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851864.122582:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122 Using peer 15505@kfi7(0x122)
00000800:00000200:5.0:1773851864.122587:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x122: rc=0
00000800:00000200:5.0:1773851864.122590:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851864.122593:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.122595:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000792a64ac refcount 2 to 15504@kfi7
00010000:00000001:5.0:1773851864.122597:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851864.122597:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.122599:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851864.122600:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d43aa887 x1859597816545792/t0(0) o400->14284d43-cd55-484c-ab70-a6712feea0ac@15504@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1458-0'
00000800:00000200:6.0:1773851864.122603:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851864.122606:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:5.0:1773851864.122606:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d43aa887 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:14284d43-cd55-484c-ab70-a6712feea0ac+5:39588:x1859597816545792:12345-15504@kfi7:400:default-tuolumne1458-0 Request processed in 102us (156us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851864.122608:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15505@kfi7: PUT: OK
00000400:00000200:6.0:1773851864.122610:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000a4ed2b3
00000400:00000010:6.0:1773851864.122610:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000a4ed2b3.
00000100:00100000:5.0:1773851864.122610:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15504@kfi7, seq: 2001902
00000100:00000040:5.0:1773851864.122611:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ddcade45 : new rpc_count 0
00000100:00000001:6.0:1773851864.122612:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851864.122612:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851864.122613:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851864.122613:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851864.122614:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fd00b748 nid 15505@kfi7 refs 2
00000020:00000010:5.0:1773851864.122614:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851864.122616:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 15505@kfi7(00000000fcf80e1d):0x0 lsk 291 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122 Transaction freed
00000020:00000010:5.0:1773851864.122616:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000020:00000010:5.0:1773851864.122618:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cc00b94f.
00000020:00000040:5.0:1773851864.122619:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000ddcade45 : new refcount 4
00000100:00000001:5.0:1773851864.122620:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851864.133077:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851864.133078:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851864.133079:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851864.133081:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851864.133083:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12035@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.133084:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12035@kfi7 : PUT - for me
00000400:00000200:21.0:1773851864.133085:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12035@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.133087:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c60f9295 nid 12035@kfi7 refs 1
00000400:00000200:21.0:1773851864.133088:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12035@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.133088:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c60f9295 nid 12035@kfi7 refs 2
00000400:00000200:21.0:1773851864.133090:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c60f9295 nid 12035@kfi7 refs 3
00000400:00000200:21.0:1773851864.133091:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12034@kfi7 to cpt 2
00000400:00000200:21.0:1773851864.133092:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12034@kfi7 of length 224 into portal 12 MB=0x69b4b57c10bc0
00000400:00000200:21.0:1773851864.133093:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12034@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 33480
00000800:00000200:21.0:1773851864.133095:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851864.133096:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851864.133097:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12035@kfi7: PUT: OK
00000100:00000001:21.0:1773851864.133098:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851864.133099:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851864.133100:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db1a7c02.
00000100:00000040:21.0:1773851864.133100:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000db1a7c02 x1859597757385664 msgsize 224
00000100:00100000:21.0:1773851864.133102:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12034@kfi7 (source: 12345-12035@kfi7)
00000100:00000001:21.0:1773851864.133103:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:22.0:1773851864.133104:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851864.133104:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c60f9295 nid 12035@kfi7 refs 2
02000000:00000001:22.0:1773851864.133105:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851864.133105:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851864.133105:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851864.133106:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851864.133107:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851864.133107:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597757385664
00000020:00000001:22.0:1773851864.133108:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851864.133108:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eac3
00000020:00000001:22.0:1773851864.133109:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851864.133111:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000da001caf refcount=5
00000020:00000001:22.0:1773851864.133112:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636958833994752 : -107114875556864 : ffff9e945fe46c00)
00000020:00000001:22.0:1773851864.133113:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636958833994752 : -107114875556864 : ffff9e945fe46c00)
00000100:00000001:22.0:1773851864.133114:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.133115:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851864.133115:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e2bf2194.
00000020:00000010:22.0:1773851864.133117:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851864.133117:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851864.133118:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851864.133119:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851864.133119:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851864.133120:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851864.133121:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851864.133122:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.133122:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851864.133124:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851864.133124:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851864.133124:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851864.133125:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851864.133125:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12034@kfi7, seq: 1997965
00000100:00000001:23.0:1773851864.133126:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.133126:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000da001caf : new rpc_count 1
00000100:00000001:23.0:1773851864.133127:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.133127:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132564948864 : -106941144602752 : ffff9ebcd3106780)
00000100:00000040:22.0:1773851864.133128:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000db1a7c02 x1859597757385664/t0(0) o400->0b930976-72df-475f-a2a7-d1e05f77e1e7@12034@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1255-0'
00000100:00000001:22.0:1773851864.133130:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.133131:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851864.133131:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db1a7c02 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0b930976-72df-475f-a2a7-d1e05f77e1e7+5:39567:x1859597757385664:12345-12034@kfi7:400:default-tuolumne1255-0
00000100:00000200:22.0:1773851864.133133:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597757385664
00000020:00000001:22.0:1773851864.133133:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851864.133134:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851864.133135:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.133135:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851864.133136:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851864.133137:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851864.133137:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597757385664, found 0 last_xid 1859597757385663
00000020:00000001:22.0:1773851864.133138:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851864.133139:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851864.133139:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851864.133140:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.133140:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851864.133141:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851864.133141:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851864.133142:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005a626a9d.
02000000:00000001:22.0:1773851864.133143:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.133143:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.133144:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851864.133145:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692605, transno 0, xid 1859597757385664
00010000:00000001:22.0:1773851864.133149:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851864.133150:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000db1a7c02 x1859597757385664/t0(0) o400->0b930976-72df-475f-a2a7-d1e05f77e1e7@12034@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1255-0'
00010000:00000001:22.0:1773851864.133152:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851864.133153:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851864.133153:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=97 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851864.133154:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851864.133155:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dbd3eca3 refcount 3 to 12034@kfi7
00000100:00000001:22.0:1773851864.133156:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581024 : -107154806970592 : ffff9e8b13cb6720)
02000000:00000001:22.0:1773851864.133157:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851864.133157:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.133158:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851864.133159:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12035@kfi7
00000400:00000010:22.0:1773851864.133159:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000642a3145.
00000100:00000200:22.0:1773851864.133160:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597757385664, offset 224
00000400:00000200:22.0:1773851864.133162:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12035@kfi7
00000400:00000200:22.0:1773851864.133162:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12035@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.133163:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c60f9295 nid 12035@kfi7 refs 1
00000400:00000200:22.0:1773851864.133164:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c60f9295 nid 12035@kfi7 refs 2
00000400:00000200:22.0:1773851864.133166:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c60f9295 nid 12035@kfi7 refs 3
00000400:00000200:22.0:1773851864.133167:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12035@kfi7 local destination
00000400:00000200:22.0:1773851864.133168:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769096:8769096:1024:4294967295] 12035@kfi7 LPNI seq info [289400:289400:16:4294967295]
00000400:00000200:22.0:1773851864.133170:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c60f9295 nid 12035@kfi7 refs 2
00000400:00000200:22.0:1773851864.133170:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12035@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.133172:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12035@kfi7(12035@kfi7:12035@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851864.133173:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c60f9295 nid 12035@kfi7 refs 3
00000800:00000200:22.0:1773851864.133175:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851864.133176:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851864.133178:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851864.133182:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd6e Using peer 12035@kfi7(0xd6e)
00000800:00000200:22.0:1773851864.133186:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000007ee9d6e: Posted send of 324 bytes to peer 0xd6e: rc=0
00000800:00000200:22.0:1773851864.133187:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd6e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851864.133189:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.133190:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dbd3eca3 refcount 2 to 12034@kfi7
00010000:00000001:22.0:1773851864.133191:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851864.133191:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.133192:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851864.133193:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db1a7c02 x1859597757385664/t0(0) o400->0b930976-72df-475f-a2a7-d1e05f77e1e7@12034@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1255-0'
00000100:00100000:22.0:1773851864.133196:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db1a7c02 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0b930976-72df-475f-a2a7-d1e05f77e1e7+5:39567:x1859597757385664:12345-12034@kfi7:400:default-tuolumne1255-0 Request processed in 65us (94us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851864.133198:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12034@kfi7, seq: 1997965
00000100:00000040:22.0:1773851864.133199:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000da001caf : new rpc_count 0
00000100:00000001:22.0:1773851864.133199:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851864.133199:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd6e TN_EVENT_TX_OK event status 0
00000100:00000001:22.0:1773851864.133200:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851864.133200:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851864.133201:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851864.133201:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851864.133202:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e2bf2194.
00000400:00000200:21.0:1773851864.133202:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12035@kfi7: PUT: OK
00000020:00000040:22.0:1773851864.133203:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000da001caf : new refcount 4
00000400:00000200:21.0:1773851864.133203:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000642a3145
00000400:00000010:21.0:1773851864.133203:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000642a3145.
00000100:00000001:22.0:1773851864.133204:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851864.133204:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851864.133204:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851864.133205:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c60f9295 nid 12035@kfi7 refs 2
00000800:00000200:21.0:1773851864.133206:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 12035@kfi7(00000000dfc65c02):0x0 lsk 3439 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd6e Transaction freed
00000800:00000200:26.0:1773851864.154596:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851864.154596:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851864.154596:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851864.154597:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851864.154598:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851864.154598:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851864.154600:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851864.154600:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19617@kfi7(000000000ae711a2):0x9c9 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851864.154601:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 Using peer 19617@kfi7(0x1000000000009c9)
00000400:00000200:26.0:1773851864.154602:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19617@kfi7 to cpt 6
00000400:00000200:26.0:1773851864.154603:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19617@kfi7 : PUT - for me
00000400:00000200:25.0:1773851864.154603:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19617@kfi7 to cpt 6
00000400:00000200:26.0:1773851864.154604:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19617@kfi7 to cpt 6
00000400:00000200:26.0:1773851864.154605:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000504b4a48 nid 19617@kfi7 refs 1
00000800:00000200:25.0:1773851864.154605:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000009b172e83: Posted send of 38 bytes to peer 0x1000000000009c9: rc=0
00000400:00000200:26.0:1773851864.154606:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19617@kfi7 to cpt 6
00000400:00000200:26.0:1773851864.154607:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000504b4a48 nid 19617@kfi7 refs 2
00000800:00000200:25.0:1773851864.154607:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851864.154608:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000504b4a48 nid 19617@kfi7 refs 3
00000400:00000200:26.0:1773851864.154609:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19617@kfi7 to cpt 6
00000400:00000200:26.0:1773851864.154610:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19617@kfi7 of length 224 into portal 12 MB=0x699e0b6dc57c0
00000400:00000200:26.0:1773851864.154611:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19617@kfi7 of length 224/224 into md 0x16159c9699 [64] + 1568
00000800:00000200:26.0:1773851864.154613:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851864.154615:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851864.154616:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19617@kfi7: PUT: OK
00000100:00000001:26.0:1773851864.154617:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851864.154617:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851864.154618:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009e20093.
00000800:00000200:25.0:1773851864.154618:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851864.154619:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000009e20093 x1858040279881664 msgsize 224
00000100:00100000:26.0:1773851864.154620:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-19617@kfi7 (source: 12345-19617@kfi7)
00000800:00000200:25.0:1773851864.154621:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 Transaction freed
00000100:00000001:26.0:1773851864.154622:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851864.154623:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000504b4a48 nid 19617@kfi7 refs 2
00000100:00000001:24.0:1773851864.154623:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:26.0:1773851864.154624:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851864.154624:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851864.154624:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851864.154624:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851864.154625:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851864.154626:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040279881664
00000020:00000001:24.0:1773851864.154627:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851864.154627:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92577
00000020:00000001:24.0:1773851864.154628:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851864.154631:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f02b899c refcount=8
00000020:00000001:24.0:1773851864.154632:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630774784 : -107123078776832 : ffff9e9276f13800)
00000020:00000001:24.0:1773851864.154632:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630774784 : -107123078776832 : ffff9e9276f13800)
00000100:00000001:24.0:1773851864.154634:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851864.154635:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851864.154635:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851864.154637:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851864.154637:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005179b485.
00000100:00000001:24.0:1773851864.154638:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851864.154639:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851864.154640:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851864.154641:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851864.154641:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851864.154642:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.154643:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851864.154644:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851864.154644:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851864.154644:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851864.154644:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851864.154645:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19617@kfi7, seq: 2025088
00000100:00000001:25.0:1773851864.154646:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851864.154646:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f02b899c : new rpc_count 2
00000100:00000001:25.0:1773851864.154647:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.154647:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150703360 : -106980558848256 : ffff9eb3a5cabf00)
00000100:00000040:24.0:1773851864.154648:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009e20093 x1858040279881664/t0(0) o400->f0b7562b-8bd0-4d58-abfb-b60e73f92c80@19617@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1712-0'
00000100:00000001:24.0:1773851864.154650:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851864.154651:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851864.154652:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009e20093 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:f0b7562b-8bd0-4d58-abfb-b60e73f92c80+8:39817:x1858040279881664:12345-19617@kfi7:400:default-tuolumne1712-0
00000100:00000200:24.0:1773851864.154653:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040279881664
00000020:00000001:24.0:1773851864.154654:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851864.154654:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851864.154655:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.154655:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851864.154656:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851864.154657:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851864.154657:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040279881664, found 0 last_xid 1858040279317375
00000020:00000001:24.0:1773851864.154658:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851864.154659:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851864.154659:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851864.154659:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.154660:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851864.154661:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851864.154661:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851864.154663:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000020eac626.
02000000:00000001:24.0:1773851864.154664:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.154664:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.154665:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851864.154666:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264520001, transno 0, xid 1858040279881664
00010000:00000001:24.0:1773851864.154667:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851864.154667:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009e20093 x1858040279881664/t0(0) o400->f0b7562b-8bd0-4d58-abfb-b60e73f92c80@19617@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1712-0'
00010000:00000001:24.0:1773851864.154670:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851864.154670:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851864.154671:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=97 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851864.154672:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851864.154672:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f034c7a3 refcount 3 to 19617@kfi7
00000100:00000001:24.0:1773851864.154673:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691136 : -107157065860480 : ffff9e8a8d277a80)
02000000:00000001:24.0:1773851864.154674:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851864.154674:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.154675:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851864.154675:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19617@kfi7
00000400:00000010:24.0:1773851864.154676:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007c583f63.
00000100:00000200:24.0:1773851864.154677:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040279881664, offset 224
00000400:00000200:24.0:1773851864.154678:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19617@kfi7
00000400:00000200:24.0:1773851864.154679:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19617@kfi7 to cpt 6
00000400:00000200:24.0:1773851864.154679:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000504b4a48 nid 19617@kfi7 refs 1
00000400:00000200:24.0:1773851864.154680:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000504b4a48 nid 19617@kfi7 refs 2
00000400:00000200:24.0:1773851864.154681:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000504b4a48 nid 19617@kfi7 refs 3
00000400:00000200:24.0:1773851864.154682:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19617@kfi7 local destination
00000400:00000200:24.0:1773851864.154684:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769097:8769097:1024:4294967295] 19617@kfi7 LPNI seq info [415976:415976:16:4294967295]
00000400:00000200:24.0:1773851864.154685:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000504b4a48 nid 19617@kfi7 refs 2
00000400:00000200:24.0:1773851864.154685:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19617@kfi7 to cpt 6
00000400:00000200:24.0:1773851864.154688:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19617@kfi7(19617@kfi7:19617@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851864.154689:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000504b4a48 nid 19617@kfi7 refs 3
00000800:00000200:24.0:1773851864.154690:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851864.154691:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851864.154693:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851864.154695:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 Using peer 19617@kfi7(0x1000000000009c9)
00000800:00000200:24.0:1773851864.154698:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0x1000000000009c9: rc=0
00000800:00000200:24.0:1773851864.154700:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851864.154701:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851864.154702:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f034c7a3 refcount 2 to 19617@kfi7
00010000:00000001:24.0:1773851864.154703:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851864.154703:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.154704:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851864.154705:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009e20093 x1858040279881664/t0(0) o400->f0b7562b-8bd0-4d58-abfb-b60e73f92c80@19617@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1712-0'
00000100:00100000:24.0:1773851864.154709:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009e20093 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:f0b7562b-8bd0-4d58-abfb-b60e73f92c80+8:39817:x1858040279881664:12345-19617@kfi7:400:default-tuolumne1712-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851864.154711:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19617@kfi7, seq: 2025088
00000100:00000040:24.0:1773851864.154712:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f02b899c : new rpc_count 1
00000100:00000001:24.0:1773851864.154712:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851864.154713:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851864.154713:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851864.154714:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005179b485.
00000020:00000010:24.0:1773851864.154715:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851864.154716:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000f02b899c : new refcount 7
00000100:00000001:24.0:1773851864.154716:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851864.154721:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851864.154722:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851864.154723:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19617@kfi7: PUT: OK
00000400:00000200:25.0:1773851864.154724:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007c583f63
00000400:00000010:25.0:1773851864.154729:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007c583f63.
00000100:00000001:25.0:1773851864.154730:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851864.154730:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851864.154731:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000504b4a48 nid 19617@kfi7 refs 2
00000800:00000200:25.0:1773851864.154732:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 19617@kfi7(000000000ae711a2):0x0 lsk 2506 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c9 Transaction freed
00080000:00000001:30.0:1773851864.169592:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851864.169594:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851864.169643:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851864.169644:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851864.169691:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851864.169692:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851864.169748:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851864.169749:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851864.169914:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000a709584c (tot 253201027).
00000400:00000010:30.0:1773851864.169916:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000a709584c (tot 253200771).
00000800:00000200:21.0:1773851864.183946:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851864.183947:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851864.183948:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851864.183950:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851864.183952:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25104@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.183954:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25104@kfi7 : PUT - for me
00000400:00000200:21.0:1773851864.183955:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25104@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.183956:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051d263ee nid 25104@kfi7 refs 1
00000400:00000200:21.0:1773851864.183957:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25104@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.183958:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051d263ee nid 25104@kfi7 refs 2
00000400:00000200:21.0:1773851864.183959:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000051d263ee nid 25104@kfi7 refs 3
00000400:00000200:21.0:1773851864.183959:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25104@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.183960:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25104@kfi7 of length 224 into portal 12 MB=0x699e1697012c0
00000400:00000200:21.0:1773851864.183962:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25104@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 33704
00000800:00000200:21.0:1773851864.183963:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851864.183965:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851864.183966:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25104@kfi7: PUT: OK
00000100:00000001:21.0:1773851864.183967:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851864.183967:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851864.183969:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000c8bcae1.
00000100:00000040:21.0:1773851864.183970:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000c8bcae1 x1858043275907776 msgsize 224
00000100:00100000:21.0:1773851864.183971:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25104@kfi7 (source: 12345-25104@kfi7)
00000100:00000001:21.0:1773851864.183972:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851864.183973:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000051d263ee nid 25104@kfi7 refs 2
00000100:00000001:22.0:1773851864.183974:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851864.183974:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851864.183974:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851864.183975:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851864.183975:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851864.183976:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851864.183976:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043275907776
00000020:00000001:22.0:1773851864.183977:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851864.183977:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e45
00000020:00000001:22.0:1773851864.183978:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851864.183981:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006cbbba50 refcount=6
00000020:00000001:22.0:1773851864.183982:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744430592 : -107128965121024 : ffff9e911816bc00)
00000020:00000001:22.0:1773851864.183983:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744430592 : -107128965121024 : ffff9e911816bc00)
00000100:00000001:22.0:1773851864.183984:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.183985:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851864.183986:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e2bf2194.
00000020:00000010:22.0:1773851864.183987:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851864.183987:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851864.183988:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851864.183988:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851864.183989:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851864.183990:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851864.183990:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851864.183991:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.183992:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851864.183993:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851864.183993:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851864.183993:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851864.183994:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851864.183994:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25104@kfi7, seq: 1997966
00000100:00000001:23.0:1773851864.183995:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.183995:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006cbbba50 : new rpc_count 1
00000100:00000001:23.0:1773851864.183996:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.183996:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082395183360 : -106991314368256 : ffff9eb124b68900)
00000100:00000040:22.0:1773851864.183997:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000c8bcae1 x1858043275907776/t0(0) o400->25ebf77f-58a0-40c3-95c5-7ac03f1f89d0@25104@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2065-0'
00000100:00000001:22.0:1773851864.184000:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.184000:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851864.184001:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c8bcae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:25ebf77f-58a0-40c3-95c5-7ac03f1f89d0+6:39669:x1858043275907776:12345-25104@kfi7:400:default-tuolumne2065-0
00000100:00000200:22.0:1773851864.184002:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043275907776
00000020:00000001:22.0:1773851864.184003:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851864.184004:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851864.184004:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.184005:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851864.184006:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851864.184007:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851864.184007:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043275907776, found 0 last_xid 1858043275907775
00000020:00000001:22.0:1773851864.184008:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851864.184009:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851864.184009:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851864.184010:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.184010:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851864.184011:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851864.184011:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851864.184012:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000024c5c06c.
02000000:00000001:22.0:1773851864.184013:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.184013:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.184014:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851864.184015:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013970474, transno 0, xid 1858043275907776
00010000:00000001:22.0:1773851864.184015:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851864.184016:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000c8bcae1 x1858043275907776/t0(0) o400->25ebf77f-58a0-40c3-95c5-7ac03f1f89d0@25104@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2065-0'
00010000:00000001:22.0:1773851864.184018:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851864.184019:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851864.184020:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=97 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851864.184021:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851864.184021:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000077ba8138 refcount 3 to 25104@kfi7
00000100:00000001:22.0:1773851864.184022:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451424 : -107146752100192 : ffff9e8cf3e6f8a0)
02000000:00000001:22.0:1773851864.184023:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851864.184024:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.184024:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851864.184025:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25104@kfi7
00000400:00000010:22.0:1773851864.184025:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fda32665.
00000100:00000200:22.0:1773851864.184026:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043275907776, offset 224
00000400:00000200:22.0:1773851864.184028:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25104@kfi7
00000400:00000200:22.0:1773851864.184028:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25104@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.184029:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051d263ee nid 25104@kfi7 refs 1
00000400:00000200:22.0:1773851864.184030:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000051d263ee nid 25104@kfi7 refs 2
00000400:00000200:22.0:1773851864.184031:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000051d263ee nid 25104@kfi7 refs 3
00000400:00000200:22.0:1773851864.184033:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25104@kfi7 local destination
00000400:00000200:22.0:1773851864.184034:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769098:8769098:1024:4294967295] 25104@kfi7 LPNI seq info [443318:443318:16:4294967295]
00000400:00000200:22.0:1773851864.184036:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000051d263ee nid 25104@kfi7 refs 2
00000400:00000200:22.0:1773851864.184036:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25104@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.184039:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25104@kfi7(25104@kfi7:25104@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851864.184040:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000051d263ee nid 25104@kfi7 refs 3
00000800:00000200:22.0:1773851864.184042:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851864.184043:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851864.184044:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851864.184047:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x999 Using peer 25104@kfi7(0x999)
00000800:00000200:22.0:1773851864.184049:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000bfc5a5ad: Posted send of 324 bytes to peer 0x999: rc=0
00000800:00000200:22.0:1773851864.184051:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x999 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851864.184052:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.184053:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000077ba8138 refcount 2 to 25104@kfi7
00010000:00000001:22.0:1773851864.184054:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851864.184054:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.184055:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851864.184056:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000c8bcae1 x1858043275907776/t0(0) o400->25ebf77f-58a0-40c3-95c5-7ac03f1f89d0@25104@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2065-0'
00000100:00100000:22.0:1773851864.184059:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c8bcae1 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:25ebf77f-58a0-40c3-95c5-7ac03f1f89d0+6:39669:x1858043275907776:12345-25104@kfi7:400:default-tuolumne2065-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851864.184061:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25104@kfi7, seq: 1997966
00000100:00000040:22.0:1773851864.184061:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006cbbba50 : new rpc_count 0
00000100:00000001:22.0:1773851864.184062:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851864.184063:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851864.184064:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851864.184064:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000800:00000200:21.0:1773851864.184064:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x999 TN_EVENT_TX_OK event status 0
00000020:00000010:22.0:1773851864.184065:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e2bf2194.
00000400:00000200:21.0:1773851864.184065:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:22.0:1773851864.184066:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000006cbbba50 : new refcount 5
00000400:00000200:21.0:1773851864.184066:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25104@kfi7: PUT: OK
00000100:00000001:22.0:1773851864.184067:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851864.184067:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fda32665
00000400:00000010:21.0:1773851864.184068:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fda32665.
00000100:00000001:21.0:1773851864.184068:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851864.184069:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851864.184070:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000051d263ee nid 25104@kfi7 refs 2
00000800:00000200:21.0:1773851864.184071:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 25104@kfi7(00000000972d2b98):0x0 lsk 2458 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x999 Transaction freed
00000800:00000200:25.0:1773851864.187669:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851864.187670:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851864.187671:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851864.187673:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851864.187675:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19761@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.187676:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19761@kfi7 : PUT - for me
00000400:00000200:25.0:1773851864.187677:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19761@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.187678:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9de60b5 nid 19761@kfi7 refs 1
00000400:00000200:25.0:1773851864.187678:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19761@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.187679:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9de60b5 nid 19761@kfi7 refs 2
00000400:00000200:25.0:1773851864.187680:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c9de60b5 nid 19761@kfi7 refs 3
00000400:00000200:25.0:1773851864.187681:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19952@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.187682:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19952@kfi7 of length 224 into portal 12 MB=0x699e130a241c0
00000400:00000200:25.0:1773851864.187683:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19952@kfi7 of length 224/224 into md 0x16159c9699 [64] + 1792
00000800:00000200:25.0:1773851864.187684:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851864.187686:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851864.187687:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19761@kfi7: PUT: OK
00000100:00000001:25.0:1773851864.187688:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851864.187689:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851864.187689:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009f0c4b9b.
00000100:00000040:25.0:1773851864.187690:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000009f0c4b9b x1858042322895296 msgsize 224
00000100:00100000:25.0:1773851864.187692:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19952@kfi7 (source: 12345-19761@kfi7)
00000100:00000001:25.0:1773851864.187692:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851864.187693:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9de60b5 nid 19761@kfi7 refs 2
00000800:00000200:25.0:1773851864.187694:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851864.187694:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851864.187694:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851864.187695:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851864.187695:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851864.187696:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851864.187696:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042322895296
00000020:00000001:24.0:1773851864.187697:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851864.187697:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91cda
00000020:00000001:24.0:1773851864.187698:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851864.187700:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000512ed22f refcount=6
00000020:00000001:24.0:1773851864.187701:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628530176 : -107123081021440 : ffff9e9276cef800)
00000020:00000001:24.0:1773851864.187701:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628530176 : -107123081021440 : ffff9e9276cef800)
00000100:00000001:24.0:1773851864.187702:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851864.187703:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851864.187704:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851864.187704:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851864.187705:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005179b485.
00000100:00000001:24.0:1773851864.187706:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851864.187706:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851864.187707:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851864.187708:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851864.187708:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851864.187708:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.187709:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851864.187710:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851864.187711:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851864.187711:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851864.187711:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851864.187712:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19952@kfi7, seq: 2025089
00000100:00000040:24.0:1773851864.187712:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000512ed22f : new rpc_count 1
00000100:00000001:25.0:1773851864.187713:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851864.187713:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.187713:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478768512 : -106938230783104 : ffff9ebd80bdc380)
00000100:00000040:24.0:1773851864.187714:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009f0c4b9b x1858042322895296/t0(0) o400->564ec374-83c6-4e0a-8848-12a9c5469979@19952@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1725-0'
00000100:00000001:24.0:1773851864.187717:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851864.187717:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851864.187718:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f0c4b9b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:564ec374-83c6-4e0a-8848-12a9c5469979+6:39625:x1858042322895296:12345-19952@kfi7:400:default-tuolumne1725-0
00000100:00000200:24.0:1773851864.187719:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042322895296
00000020:00000001:24.0:1773851864.187719:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851864.187720:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851864.187720:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.187721:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851864.187722:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851864.187734:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851864.187735:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042322895296, found 0 last_xid 1858042322895295
00000020:00000001:24.0:1773851864.187735:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851864.187736:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851864.187737:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851864.187737:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.187738:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851864.187738:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851864.187739:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851864.187740:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000b3bba8d.
02000000:00000001:24.0:1773851864.187740:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.187741:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.187741:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851864.187742:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183249746309, transno 0, xid 1858042322895296
00010000:00000001:24.0:1773851864.187743:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851864.187743:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009f0c4b9b x1858042322895296/t0(0) o400->564ec374-83c6-4e0a-8848-12a9c5469979@19952@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1725-0'
00010000:00000001:24.0:1773851864.187746:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851864.187746:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851864.187747:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=97 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851864.187748:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851864.187749:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005470bc35 refcount 3 to 19952@kfi7
00000100:00000001:24.0:1773851864.187749:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313738624 : -107139395812992 : ffff9e8eaa5f0180)
02000000:00000001:24.0:1773851864.187750:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851864.187751:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.187751:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851864.187752:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19761@kfi7
00000400:00000010:24.0:1773851864.187752:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000094777d.
00000100:00000200:24.0:1773851864.187753:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042322895296, offset 224
00000400:00000200:24.0:1773851864.187755:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19761@kfi7
00000400:00000200:24.0:1773851864.187755:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19761@kfi7 to cpt 6
00000400:00000200:24.0:1773851864.187756:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9de60b5 nid 19761@kfi7 refs 1
00000400:00000200:24.0:1773851864.187757:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c9de60b5 nid 19761@kfi7 refs 2
00000400:00000200:24.0:1773851864.187758:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c9de60b5 nid 19761@kfi7 refs 3
00000400:00000200:24.0:1773851864.187759:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19761@kfi7 local destination
00000400:00000200:24.0:1773851864.187761:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769099:8769099:1024:4294967295] 19761@kfi7 LPNI seq info [3210189:3210189:16:4294967295]
00000400:00000200:24.0:1773851864.187762:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c9de60b5 nid 19761@kfi7 refs 2
00000400:00000200:24.0:1773851864.187763:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19761@kfi7 to cpt 6
00000400:00000200:24.0:1773851864.187764:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19761@kfi7(19761@kfi7:19761@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851864.187766:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c9de60b5 nid 19761@kfi7 refs 3
00000800:00000200:24.0:1773851864.187767:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851864.187768:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851864.187770:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851864.187772:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10dd Using peer 19761@kfi7(0x10dd)
00000800:00000200:24.0:1773851864.187775:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x10dd: rc=0
00000800:00000200:24.0:1773851864.187776:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10dd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851864.187778:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851864.187779:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005470bc35 refcount 2 to 19952@kfi7
00010000:00000001:24.0:1773851864.187779:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851864.187780:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.187781:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851864.187781:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009f0c4b9b x1858042322895296/t0(0) o400->564ec374-83c6-4e0a-8848-12a9c5469979@19952@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1725-0'
00000100:00100000:24.0:1773851864.187785:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f0c4b9b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:564ec374-83c6-4e0a-8848-12a9c5469979+6:39625:x1858042322895296:12345-19952@kfi7:400:default-tuolumne1725-0 Request processed in 68us (94us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851864.187788:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19952@kfi7, seq: 2025089
00000100:00000040:24.0:1773851864.187788:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000512ed22f : new rpc_count 0
00000100:00000001:24.0:1773851864.187789:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851864.187790:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851864.187790:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851864.187791:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005179b485.
00000020:00000010:24.0:1773851864.187792:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851864.187793:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000512ed22f : new refcount 5
00000100:00000001:24.0:1773851864.187793:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851864.187798:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10dd TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851864.187800:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851864.187801:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19761@kfi7: PUT: OK
00000400:00000200:25.0:1773851864.187802:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000094777d
00000400:00000010:25.0:1773851864.187802:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000094777d.
00000100:00000001:25.0:1773851864.187803:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851864.187803:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851864.187804:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9de60b5 nid 19761@kfi7 refs 2
00000800:00000200:25.0:1773851864.187805:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 19761@kfi7(0000000073d1da41):0x0 lsk 4318 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10dd Transaction freed
00010000:00000001:2.0:1773851864.201731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851864.201733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851864.201734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851864.201735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851864.201736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851864.201738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851864.201739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851864.201740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851864.201740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851864.201744:0:937830:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851864.201744:0:937830:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851864.201745:0:937830:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:29.0:1773851864.226864:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851864.226866:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851864.226868:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851864.226871:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851864.226874:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24081@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.226876:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24081@kfi7 : PUT - for me
00000400:00000200:29.0:1773851864.226878:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24081@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.226879:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2de0f7f nid 24081@kfi7 refs 1
00000400:00000200:29.0:1773851864.226882:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24081@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.226883:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2de0f7f nid 24081@kfi7 refs 2
00000400:00000200:29.0:1773851864.226885:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2de0f7f nid 24081@kfi7 refs 3
00000400:00000200:29.0:1773851864.226887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24273@kfi7 to cpt 1
00000400:00000200:29.0:1773851864.226888:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24273@kfi7 of length 224 into portal 12 MB=0x69b4c76481200
00000400:00000200:29.0:1773851864.226891:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24273@kfi7 of length 224/224 into md 0x77fe139dd [64] + 172392
00000800:00000200:29.0:1773851864.226893:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851864.226896:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851864.226898:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24081@kfi7: PUT: OK
00000100:00000001:29.0:1773851864.226899:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851864.226900:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851864.226901:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000848e3fb7.
00000100:00000040:29.0:1773851864.226902:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000848e3fb7 x1859602564518400 msgsize 224
00000100:00100000:29.0:1773851864.226904:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-24273@kfi7 (source: 12345-24081@kfi7)
00000100:00000001:29.0:1773851864.226905:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851864.226906:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2de0f7f nid 24081@kfi7 refs 2
00000800:00000200:29.0:1773851864.226907:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851864.226908:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851864.226909:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851864.226910:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851864.226911:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851864.226912:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851864.226913:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602564518400
00000020:00000001:31.0:1773851864.226915:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851864.226915:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7e9ad
00000020:00000001:31.0:1773851864.226916:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851864.226919:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004a80310a refcount=5
00000020:00000001:31.0:1773851864.226920:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110386530304 : -106963323021312 : ffff9eb7a9209800)
00000020:00000001:31.0:1773851864.226922:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110386530304 : -106963323021312 : ffff9eb7a9209800)
00000100:00000001:31.0:1773851864.226923:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851864.226925:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851864.226926:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000259b265.
00000020:00000010:31.0:1773851864.226928:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851864.226929:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851864.226931:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851864.226931:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851864.226932:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851864.226934:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851864.226935:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851864.226936:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.226938:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851864.226939:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851864.226940:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851864.226940:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851864.226941:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851864.226941:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24273@kfi7, seq: 2055506
00000100:00000001:31.0:1773851864.226942:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851864.226942:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004a80310a : new rpc_count 1
00000100:00000001:28.0:1773851864.226943:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343703040 : -106994365848576 : ffff9eb06ed4a400)
00000100:00000001:31.0:1773851864.226944:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851864.226945:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000848e3fb7 x1859602564518400/t0(0) o400->d1a7f973-e12b-4f0e-b81c-8ab21fcbbe2a@24273@kfi7:652/0 lens 224/0 e 0 to 0 dl 1773852012 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2001-0'
00000100:00000001:28.0:1773851864.226948:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851864.226949:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851864.226950:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000848e3fb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d1a7f973-e12b-4f0e-b81c-8ab21fcbbe2a+5:39709:x1859602564518400:12345-24273@kfi7:400:default-tuolumne2001-0
00000100:00000200:28.0:1773851864.226951:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602564518400
00000020:00000001:28.0:1773851864.226952:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851864.226953:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851864.226953:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.226954:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851864.226955:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851864.226955:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851864.226957:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602564518400, found 0 last_xid 1859602564518399
00000020:00000001:28.0:1773851864.226958:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851864.226958:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851864.226959:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851864.226959:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.226960:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851864.226961:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851864.226961:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851864.226962:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000021731e2.
02000000:00000001:28.0:1773851864.226963:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.226963:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.226964:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851864.226965:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183047031379, transno 0, xid 1859602564518400
00010000:00000001:28.0:1773851864.226966:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851864.226966:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000848e3fb7 x1859602564518400/t0(0) o400->d1a7f973-e12b-4f0e-b81c-8ab21fcbbe2a@24273@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2001-0'
00010000:00000001:28.0:1773851864.226969:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851864.226969:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851864.226970:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=97 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851864.226971:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851864.226972:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000078f0d2de refcount 3 to 24273@kfi7
00000100:00000001:28.0:1773851864.226973:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074952992 : -107155634598624 : ffff9e8ae276cd20)
02000000:00000001:28.0:1773851864.226974:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851864.226974:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.226975:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851864.226976:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24081@kfi7
00000400:00000010:28.0:1773851864.226976:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024587145.
00000100:00000200:28.0:1773851864.226978:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602564518400, offset 224
00000400:00000200:28.0:1773851864.226979:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24081@kfi7
00000400:00000200:28.0:1773851864.226980:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24081@kfi7 to cpt 7
00000400:00000200:28.0:1773851864.226981:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2de0f7f nid 24081@kfi7 refs 1
00000400:00000200:28.0:1773851864.226982:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2de0f7f nid 24081@kfi7 refs 2
00000400:00000200:28.0:1773851864.226984:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2de0f7f nid 24081@kfi7 refs 3
00000400:00000200:28.0:1773851864.226985:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24081@kfi7 local destination
00000400:00000200:28.0:1773851864.226987:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769100:8769100:1024:4294967295] 24081@kfi7 LPNI seq info [12041348:12041348:16:4294967295]
00000400:00000200:28.0:1773851864.226988:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b2de0f7f nid 24081@kfi7 refs 2
00000400:00000200:28.0:1773851864.226989:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24081@kfi7 to cpt 7
00000400:00000200:28.0:1773851864.226991:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24081@kfi7(24081@kfi7:24081@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851864.226993:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2de0f7f nid 24081@kfi7 refs 3
00000800:00000200:28.0:1773851864.226994:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851864.226995:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851864.226997:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851864.227000:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1154 Using peer 24081@kfi7(0x1154)
00000800:00000200:28.0:1773851864.227003:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x1154: rc=0
00000800:00000200:28.0:1773851864.227004:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1154 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851864.227007:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851864.227008:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000078f0d2de refcount 2 to 24273@kfi7
00010000:00000001:28.0:1773851864.227008:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851864.227009:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.227010:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851864.227010:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000848e3fb7 x1859602564518400/t0(0) o400->d1a7f973-e12b-4f0e-b81c-8ab21fcbbe2a@24273@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2001-0'
00000100:00100000:28.0:1773851864.227013:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000848e3fb7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d1a7f973-e12b-4f0e-b81c-8ab21fcbbe2a+5:39709:x1859602564518400:12345-24273@kfi7:400:default-tuolumne2001-0 Request processed in 64us (110us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851864.227016:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24273@kfi7, seq: 2055506
00000100:00000040:28.0:1773851864.227017:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004a80310a : new rpc_count 0
00000100:00000001:28.0:1773851864.227018:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851864.227018:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851864.227019:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:28.0:1773851864.227020:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000020:00000010:28.0:1773851864.227022:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000259b265.
00000020:00000040:28.0:1773851864.227023:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000004a80310a : new refcount 4
00000100:00000001:28.0:1773851864.227024:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851864.227029:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1154 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851864.227030:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851864.227031:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24081@kfi7: PUT: OK
00000400:00000200:29.0:1773851864.227032:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024587145
00000400:00000010:29.0:1773851864.227032:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024587145.
00000100:00000001:29.0:1773851864.227033:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851864.227034:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851864.227035:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2de0f7f nid 24081@kfi7 refs 2
00000800:00000200:29.0:1773851864.227036:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24081@kfi7(00000000d43794c8):0x0 lsk 4437 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1154 Transaction freed
00000800:00000200:9.0:1773851864.325816:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.325817:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851864.325819:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851864.325821:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851864.325823:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10018@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.325824:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10018@kfi7 : PUT - for me
00000400:00000200:9.0:1773851864.325825:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10018@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.325826:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a19cbda nid 10018@kfi7 refs 1
00000400:00000200:9.0:1773851864.325827:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10018@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.325828:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a19cbda nid 10018@kfi7 refs 2
00000400:00000200:9.0:1773851864.325829:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006a19cbda nid 10018@kfi7 refs 3
00000400:00000200:9.0:1773851864.325830:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10019@kfi7 to cpt 5
00000400:00000200:9.0:1773851864.325831:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10019@kfi7 of length 224 into portal 12 MB=0x69aed813c3c00
00000400:00000200:9.0:1773851864.325832:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10019@kfi7 of length 224/224 into md 0x78146ce49 [64] + 133072
00000800:00000200:9.0:1773851864.325834:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.325836:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851864.325838:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10018@kfi7: PUT: OK
00000100:00000001:9.0:1773851864.325839:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851864.325839:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851864.325840:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007d1b68b3.
00000100:00000040:9.0:1773851864.325841:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000007d1b68b3 x1859194726398976 msgsize 224
00000100:00100000:9.0:1773851864.325842:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10019@kfi7 (source: 12345-10018@kfi7)
00000100:00000001:9.0:1773851864.325844:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851864.325845:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006a19cbda nid 10018@kfi7 refs 2
00000800:00000200:9.0:1773851864.325847:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851864.325850:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851864.325851:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851864.325851:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851864.325852:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851864.325853:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851864.325854:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859194726398976
00000020:00000001:9.0:1773851864.325854:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851864.325855:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e78
00000020:00000001:9.0:1773851864.325855:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851864.325858:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b9ffb7e1 refcount=6
00000020:00000001:9.0:1773851864.325859:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239651328 : -107152469900288 : ffff9e8b9f184400)
00000020:00000001:9.0:1773851864.325860:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239651328 : -107152469900288 : ffff9e8b9f184400)
00000100:00000001:9.0:1773851864.325861:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.325862:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851864.325863:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851864.325864:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851864.325865:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851864.325866:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851864.325866:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851864.325867:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.325868:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851864.325868:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851864.325869:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.325869:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.325871:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.325872:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851864.325872:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851864.325873:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851864.325873:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10019@kfi7, seq: 2130774
00000100:00000040:9.0:1773851864.325873:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b9ffb7e1 : new rpc_count 1
00000100:00000001:11.0:1773851864.325874:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.325874:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922907392 : -107141786644224 : ffff9e8e1bddd100)
00000100:00000001:11.0:1773851864.325875:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851864.325876:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007d1b68b3 x1859194726398976/t0(0) o400->3c2dc56e-ded6-460b-a21c-9e2e12429ae4@10019@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1115-0'
00000100:00000001:9.0:1773851864.325878:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.325879:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851864.325880:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d1b68b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3c2dc56e-ded6-460b-a21c-9e2e12429ae4+6:40339:x1859194726398976:12345-10019@kfi7:400:default-tuolumne1115-0
00000100:00000200:9.0:1773851864.325881:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859194726398976
00000020:00000001:9.0:1773851864.325882:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851864.325883:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851864.325883:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.325884:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851864.325885:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851864.325886:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851864.325886:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859194726398976, found 0 last_xid 1859194726398975
00000020:00000001:9.0:1773851864.325887:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851864.325888:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851864.325888:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851864.325889:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.325890:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851864.325890:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851864.325891:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851864.325894:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7ce171a.
02000000:00000001:9.0:1773851864.325894:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.325895:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.325895:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851864.325896:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096699301, transno 0, xid 1859194726398976
00010000:00000001:9.0:1773851864.325897:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851864.325898:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007d1b68b3 x1859194726398976/t0(0) o400->3c2dc56e-ded6-460b-a21c-9e2e12429ae4@10019@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1115-0'
00010000:00000001:9.0:1773851864.325901:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851864.325902:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851864.325903:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=97 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851864.325904:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851864.325905:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee549be8 refcount 3 to 10019@kfi7
00000100:00000001:9.0:1773851864.325905:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107168 : -107156354444448 : ffff9e8ab78ed360)
02000000:00000001:9.0:1773851864.325906:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851864.325907:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.325907:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851864.325908:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10018@kfi7
00000400:00000010:9.0:1773851864.325909:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003dd826d2.
00000100:00000200:9.0:1773851864.325910:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859194726398976, offset 224
00000400:00000200:9.0:1773851864.325911:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10018@kfi7
00000400:00000200:9.0:1773851864.325912:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10018@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.325913:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006a19cbda nid 10018@kfi7 refs 1
00000400:00000200:9.0:1773851864.325914:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006a19cbda nid 10018@kfi7 refs 2
00000400:00000200:9.0:1773851864.325915:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006a19cbda nid 10018@kfi7 refs 3
00000400:00000200:9.0:1773851864.325916:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10018@kfi7 local destination
00000400:00000200:9.0:1773851864.325918:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769101:8769101:1024:4294967295] 10018@kfi7 LPNI seq info [10971226:10971226:16:4294967295]
00000400:00000200:9.0:1773851864.325919:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006a19cbda nid 10018@kfi7 refs 2
00000400:00000200:9.0:1773851864.325920:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10018@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.325921:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10018@kfi7(10018@kfi7:10018@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851864.325923:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006a19cbda nid 10018@kfi7 refs 3
00000800:00000200:9.0:1773851864.325924:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.325925:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851864.325927:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851864.325930:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x80 Using peer 10018@kfi7(0x80)
00000800:00000200:9.0:1773851864.325933:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x80: rc=0
00000800:00000200:9.0:1773851864.325934:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x80 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851864.325937:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851864.325938:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee549be8 refcount 2 to 10019@kfi7
00010000:00000001:9.0:1773851864.325939:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851864.325939:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.325940:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851864.325940:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007d1b68b3 x1859194726398976/t0(0) o400->3c2dc56e-ded6-460b-a21c-9e2e12429ae4@10019@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1115-0'
00000100:00100000:9.0:1773851864.325944:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d1b68b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3c2dc56e-ded6-460b-a21c-9e2e12429ae4+6:40339:x1859194726398976:12345-10019@kfi7:400:default-tuolumne1115-0 Request processed in 64us (102us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851864.325946:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10019@kfi7, seq: 2130774
00000800:00000200:10.0:1773851864.325947:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x80 TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851864.325947:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b9ffb7e1 : new rpc_count 0
00000100:00000001:9.0:1773851864.325947:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851864.325948:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851864.325949:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851864.325949:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851864.325950:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851864.325950:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000020:00000040:9.0:1773851864.325951:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000b9ffb7e1 : new refcount 5
00000400:00000200:10.0:1773851864.325952:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10018@kfi7: PUT: OK
00000100:00000001:9.0:1773851864.325952:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851864.325953:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003dd826d2
00000400:00000010:10.0:1773851864.325954:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003dd826d2.
00000100:00000001:10.0:1773851864.325955:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851864.325956:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851864.325957:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006a19cbda nid 10018@kfi7 refs 2
00000800:00000200:10.0:1773851864.325960:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 10018@kfi7(00000000bdc0b653):0x0 lsk 129 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x80 Transaction freed
00000800:00000200:29.0:1773851864.359744:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851864.359746:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851864.359748:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851864.359751:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851864.359755:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21107@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.359757:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21107@kfi7 : PUT - for me
00000400:00000200:29.0:1773851864.359758:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21107@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.359759:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e52a2599 nid 21107@kfi7 refs 1
00000400:00000200:29.0:1773851864.359761:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21107@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.359762:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e52a2599 nid 21107@kfi7 refs 2
00000400:00000200:29.0:1773851864.359764:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e52a2599 nid 21107@kfi7 refs 3
00000400:00000200:29.0:1773851864.359765:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21171@kfi7 to cpt 2
00000400:00000200:29.0:1773851864.359766:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21171@kfi7 of length 224 into portal 12 MB=0x69b0a11c58600
00000400:00000200:29.0:1773851864.359768:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21171@kfi7 of length 224/224 into md 0x77fe139dd [64] + 172616
00000800:00000200:29.0:1773851864.359771:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851864.359773:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851864.359775:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21107@kfi7: PUT: OK
00000100:00000001:29.0:1773851864.359776:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851864.359777:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851864.359778:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008b9dc5f9.
00000100:00000040:29.0:1773851864.359779:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000008b9dc5f9 x1859317410399744 msgsize 224
00000100:00100000:29.0:1773851864.359781:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21171@kfi7 (source: 12345-21107@kfi7)
00000100:00000001:29.0:1773851864.359783:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851864.359784:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e52a2599 nid 21107@kfi7 refs 2
00000800:00000200:29.0:1773851864.359786:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851864.359786:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851864.359786:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851864.359787:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851864.359788:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851864.359789:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851864.359791:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317410399744
00000020:00000001:28.0:1773851864.359792:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851864.359792:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92497
00000020:00000001:28.0:1773851864.359793:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851864.359796:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000057da4ad9 refcount=6
00000020:00000001:28.0:1773851864.359797:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630515712 : -107123079035904 : ffff9e9276ed4400)
00000020:00000001:28.0:1773851864.359798:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630515712 : -107123079035904 : ffff9e9276ed4400)
00000100:00000001:28.0:1773851864.359799:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851864.359801:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851864.359802:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9820241.
00000020:00000010:28.0:1773851864.359803:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851864.359804:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f776f930.
00000100:00000001:28.0:1773851864.359806:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851864.359807:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851864.359808:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851864.359809:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851864.359810:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851864.359811:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.359813:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851864.359815:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851864.359815:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851864.359815:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851864.359816:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851864.359817:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21171@kfi7, seq: 2055507
00000100:00000001:31.0:1773851864.359818:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851864.359818:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000057da4ad9 : new rpc_count 1
00000100:00000001:31.0:1773851864.359819:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.359819:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343698432 : -106994365853184 : ffff9eb06ed49200)
00000100:00000040:28.0:1773851864.359821:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008b9dc5f9 x1859317410399744/t0(0) o400->923c6c1e-4721-4971-9f6f-96a2dc317dbe@21171@kfi7:652/0 lens 224/0 e 0 to 0 dl 1773852012 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1802-0'
00000100:00000001:28.0:1773851864.359831:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851864.359831:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851864.359833:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b9dc5f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:923c6c1e-4721-4971-9f6f-96a2dc317dbe+6:39471:x1859317410399744:12345-21171@kfi7:400:default-tuolumne1802-0
00000100:00000200:28.0:1773851864.359835:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317410399744
00000020:00000001:28.0:1773851864.359836:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851864.359837:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851864.359838:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.359839:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851864.359840:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851864.359842:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851864.359842:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317410399744, found 0 last_xid 1859317410399743
00000020:00000001:28.0:1773851864.359844:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851864.359845:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851864.359846:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851864.359846:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.359847:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851864.359848:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851864.359849:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851864.359850:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000041347fd5.
02000000:00000001:28.0:1773851864.359851:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.359852:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.359853:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851864.359854:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260590547, transno 0, xid 1859317410399744
00010000:00000001:28.0:1773851864.359856:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851864.359857:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008b9dc5f9 x1859317410399744/t0(0) o400->923c6c1e-4721-4971-9f6f-96a2dc317dbe@21171@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1802-0'
00010000:00000001:28.0:1773851864.359861:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851864.359862:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851864.359863:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=97 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851864.359865:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851864.359866:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e29eb266 refcount 3 to 21171@kfi7
00000100:00000001:28.0:1773851864.359868:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810486272 : -107154899065344 : ffff9e8b0e4e2600)
02000000:00000001:28.0:1773851864.359870:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851864.359871:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.359872:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851864.359873:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21107@kfi7
00000400:00000010:28.0:1773851864.359874:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000077c78d1a.
00000100:00000200:28.0:1773851864.359875:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317410399744, offset 224
00000400:00000200:28.0:1773851864.359877:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21107@kfi7
00000400:00000200:28.0:1773851864.359879:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21107@kfi7 to cpt 7
00000400:00000200:28.0:1773851864.359880:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e52a2599 nid 21107@kfi7 refs 1
00000400:00000200:28.0:1773851864.359882:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e52a2599 nid 21107@kfi7 refs 2
00000400:00000200:28.0:1773851864.359884:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e52a2599 nid 21107@kfi7 refs 3
00000400:00000200:28.0:1773851864.359886:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21107@kfi7 local destination
00000400:00000200:28.0:1773851864.359888:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769102:8769102:1024:4294967295] 21107@kfi7 LPNI seq info [463222:463222:16:4294967295]
00000400:00000200:28.0:1773851864.359890:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e52a2599 nid 21107@kfi7 refs 2
00000400:00000200:28.0:1773851864.359891:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21107@kfi7 to cpt 7
00000400:00000200:28.0:1773851864.359895:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21107@kfi7(21107@kfi7:21107@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851864.359897:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e52a2599 nid 21107@kfi7 refs 3
00000800:00000200:28.0:1773851864.359899:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851864.359901:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851864.359904:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851864.359908:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ffb Using peer 21107@kfi7(0x100000000000ffb)
00000800:00000200:28.0:1773851864.359913:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x100000000000ffb: rc=0
00000800:00000200:28.0:1773851864.359915:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ffb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851864.359918:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851864.359920:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e29eb266 refcount 2 to 21171@kfi7
00010000:00000001:28.0:1773851864.359921:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851864.359928:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.359929:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851864.359930:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008b9dc5f9 x1859317410399744/t0(0) o400->923c6c1e-4721-4971-9f6f-96a2dc317dbe@21171@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1802-0'
00000100:00100000:28.0:1773851864.359935:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b9dc5f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:923c6c1e-4721-4971-9f6f-96a2dc317dbe+6:39471:x1859317410399744:12345-21171@kfi7:400:default-tuolumne1802-0 Request processed in 103us (155us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851864.359939:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21171@kfi7, seq: 2055507
00000100:00000040:28.0:1773851864.359940:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000057da4ad9 : new rpc_count 0
00000100:00000001:28.0:1773851864.359942:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851864.359942:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851864.359943:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851864.359944:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f776f930.
00000020:00000010:28.0:1773851864.359946:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9820241.
00000020:00000040:28.0:1773851864.359947:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000057da4ad9 : new refcount 5
00000100:00000001:28.0:1773851864.359948:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851864.359956:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ffb TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851864.359958:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851864.359960:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21107@kfi7: PUT: OK
00000400:00000200:29.0:1773851864.359962:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000077c78d1a
00000400:00000010:29.0:1773851864.359963:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000077c78d1a.
00000100:00000001:29.0:1773851864.359964:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851864.359964:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851864.359966:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e52a2599 nid 21107@kfi7 refs 2
00000800:00000200:29.0:1773851864.359969:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 21107@kfi7(00000000eb51270b):0x0 lsk 4092 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ffb Transaction freed
00000800:00000200:21.0:1773851864.392627:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851864.392628:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851864.392629:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851864.392631:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851864.392633:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22625@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.392634:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22625@kfi7 : PUT - for me
00000400:00000200:21.0:1773851864.392635:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22625@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.392636:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000718f270c nid 22625@kfi7 refs 1
00000400:00000200:21.0:1773851864.392637:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22625@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.392638:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000718f270c nid 22625@kfi7 refs 2
00000400:00000200:21.0:1773851864.392639:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000718f270c nid 22625@kfi7 refs 3
00000400:00000200:21.0:1773851864.392640:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22689@kfi7 to cpt 1
00000400:00000200:21.0:1773851864.392641:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22689@kfi7 of length 224 into portal 12 MB=0x699e0d7c13d80
00000400:00000200:21.0:1773851864.392642:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22689@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 33928
00000800:00000200:21.0:1773851864.392643:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851864.392645:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851864.392646:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22625@kfi7: PUT: OK
00000100:00000001:21.0:1773851864.392647:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851864.392647:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851864.392648:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007e37a010.
00000100:00000040:21.0:1773851864.392649:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000007e37a010 x1858040831753600 msgsize 224
00000100:00100000:21.0:1773851864.392651:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-22689@kfi7 (source: 12345-22625@kfi7)
00000100:00000001:21.0:1773851864.392651:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851864.392652:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000718f270c nid 22625@kfi7 refs 2
00000100:00000001:22.0:1773851864.392653:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851864.392654:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851864.392654:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851864.392654:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851864.392654:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851864.392655:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851864.392656:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040831753600
00000020:00000001:22.0:1773851864.392656:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851864.392657:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a47
00000020:00000001:22.0:1773851864.392657:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851864.392660:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002a76cae1 refcount=6
00000020:00000001:22.0:1773851864.392660:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743440384 : -107128966111232 : ffff9e911807a000)
00000020:00000001:22.0:1773851864.392661:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743440384 : -107128966111232 : ffff9e911807a000)
00000100:00000001:22.0:1773851864.392662:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.392662:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851864.392663:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000da424327.
00000020:00000010:22.0:1773851864.392664:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851864.392665:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851864.392666:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851864.392666:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851864.392667:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851864.392667:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851864.392668:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851864.392668:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.392669:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851864.392670:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851864.392671:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851864.392671:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851864.392671:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851864.392672:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22689@kfi7, seq: 1997967
00000100:00000040:22.0:1773851864.392672:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002a76cae1 : new rpc_count 1
00000100:00000001:23.0:1773851864.392673:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851864.392673:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.392673:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840038528 : -106961869513088 : ffff9eb7ffc35e80)
00000100:00000040:22.0:1773851864.392674:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007e37a010 x1858040831753600/t0(0) o400->096437db-3db7-4bf7-9009-11f1740340c0@22689@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1904-0'
00000100:00000001:22.0:1773851864.392678:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.392678:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851864.392679:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e37a010 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:096437db-3db7-4bf7-9009-11f1740340c0+6:39641:x1858040831753600:12345-22689@kfi7:400:default-tuolumne1904-0
00000100:00000200:22.0:1773851864.392680:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040831753600
00000020:00000001:22.0:1773851864.392681:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851864.392681:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851864.392682:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.392683:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851864.392683:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851864.392684:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851864.392684:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040831753600, found 0 last_xid 1858040831753599
00000020:00000001:22.0:1773851864.392685:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851864.392686:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851864.392687:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851864.392687:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.392688:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851864.392689:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851864.392689:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851864.392690:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e2bf2194.
02000000:00000001:22.0:1773851864.392690:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.392691:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.392692:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851864.392692:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098910795, transno 0, xid 1858040831753600
00010000:00000001:22.0:1773851864.392693:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851864.392694:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007e37a010 x1858040831753600/t0(0) o400->096437db-3db7-4bf7-9009-11f1740340c0@22689@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1904-0'
00010000:00000001:22.0:1773851864.392696:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851864.392696:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851864.392697:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=97 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851864.392698:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851864.392699:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d4f77020 refcount 3 to 22689@kfi7
00000100:00000001:22.0:1773851864.392700:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702688 : -107156155848928 : ffff9e8ac3652720)
02000000:00000001:22.0:1773851864.392701:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851864.392702:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.392702:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851864.392703:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22625@kfi7
00000400:00000010:22.0:1773851864.392704:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024da156c.
00000100:00000200:22.0:1773851864.392704:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040831753600, offset 224
00000400:00000200:22.0:1773851864.392705:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22625@kfi7
00000400:00000200:22.0:1773851864.392706:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22625@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.392707:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000718f270c nid 22625@kfi7 refs 1
00000400:00000200:22.0:1773851864.392708:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000718f270c nid 22625@kfi7 refs 2
00000400:00000200:22.0:1773851864.392709:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000718f270c nid 22625@kfi7 refs 3
00000400:00000200:22.0:1773851864.392710:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22625@kfi7 local destination
00000400:00000200:22.0:1773851864.392712:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769103:8769103:1024:4294967295] 22625@kfi7 LPNI seq info [114194:114194:16:4294967295]
00000400:00000200:22.0:1773851864.392713:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000718f270c nid 22625@kfi7 refs 2
00000400:00000200:22.0:1773851864.392714:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22625@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.392715:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22625@kfi7(22625@kfi7:22625@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851864.392716:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000718f270c nid 22625@kfi7 refs 3
00000800:00000200:22.0:1773851864.392718:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851864.392719:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851864.392721:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851864.392724:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d10 Using peer 22625@kfi7(0x100000000000d10)
00000800:00000200:22.0:1773851864.392729:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000008ad6e841: Posted send of 324 bytes to peer 0x100000000000d10: rc=0
00000800:00000200:22.0:1773851864.392731:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d10 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851864.392733:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.392733:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d4f77020 refcount 2 to 22689@kfi7
00010000:00000001:22.0:1773851864.392734:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000800:00000200:21.0:1773851864.392741:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d10 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851864.392743:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:22.0:1773851864.392744:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851864.392744:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22625@kfi7: PUT: OK
00000020:00000001:22.0:1773851864.392745:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851864.392745:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007e37a010 x1858040831753600/t0(0) o400->096437db-3db7-4bf7-9009-11f1740340c0@22689@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1904-0'
00000400:00000200:21.0:1773851864.392745:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024da156c
00000400:00000010:21.0:1773851864.392745:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024da156c.
00000100:00000001:21.0:1773851864.392746:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851864.392746:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851864.392747:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000718f270c nid 22625@kfi7 refs 2
00000100:00100000:22.0:1773851864.392748:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e37a010 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:096437db-3db7-4bf7-9009-11f1740340c0+6:39641:x1858040831753600:12345-22689@kfi7:400:default-tuolumne1904-0 Request processed in 70us (98us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851864.392748:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 22625@kfi7(0000000017079c7d):0x0 lsk 3345 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d10 Transaction freed
00000100:00100000:22.0:1773851864.392751:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22689@kfi7, seq: 1997967
00000100:00000040:22.0:1773851864.392751:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002a76cae1 : new rpc_count 0
00000100:00000001:22.0:1773851864.392752:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851864.392753:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851864.392753:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851864.392754:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851864.392755:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000da424327.
00000020:00000040:22.0:1773851864.392756:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000002a76cae1 : new refcount 5
00000100:00000001:22.0:1773851864.392756:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851864.393732:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851864.393732:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851864.393733:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:7.0:1773851864.393733:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851864.393733:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:5.0:1773851864.393733:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:4.0:1773851864.393733:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:30.0:1773851864.393734:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000912e612e.
00000100:00000010:7.0:1773851864.393734:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000fec111f.
00000100:00000010:5.0:1773851864.393734:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076eb54fb.
00000004:00000020:4.0:1773851864.393734:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:7.0:1773851864.393735:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000040:5.0:1773851864.393735:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000100:00000010:4.0:1773851864.393735:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006d58ea18.
00000020:00000040:30.0:1773851864.393736:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000100:00000001:7.0:1773851864.393736:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851864.393736:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:4.0:1773851864.393736:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:30.0:1773851864.393737:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851864.393737:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851864.393737:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851864.393737:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851864.393737:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851864.393738:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851864.393738:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.393738:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851864.393738:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851864.393739:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851864.393739:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e1ee070a.
02000000:00000010:5.0:1773851864.393739:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b255b11b.
02000000:00000010:4.0:1773851864.393739:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d7ad89bf.
02000000:00000010:30.0:1773851864.393740:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a709584c.
00000100:00000001:7.0:1773851864.393740:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.393740:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393740:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.393741:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393741:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851864.393741:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.393741:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851864.393741:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393741:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851864.393741:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.393742:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851864.393743:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851864.393743:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000fec111f] to pc [ptlrpcd_01_01+1]  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851864.393743:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000076eb54fb] to pc [ptlrpcd_01_00+0]  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851864.393743:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006d58ea18] to pc [ptlrpcd_01_03+3]  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851864.393744:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000912e612e] to pc [ptlrpcd_07_03+3]  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851864.393748:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851864.393748:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:4.0:1773851864.393748:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851864.393749:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851864.393749:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851864.393749:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851864.393749:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:5.0:1773851864.393749:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000075148370.
00000100:00000001:4.0:1773851864.393749:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851864.393749:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.393750:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:30.0:1773851864.393750:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000edd2b3c3.
00000100:00000001:28.0:1773851864.393750:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851864.393750:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851864.393750:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851864.393750:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851864.393750:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636945216538624 : -107128493012992 : ffff9e91343a8800)
00000100:00000001:31.0:1773851864.393751:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851864.393751:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851864.393751:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637158083479552 : -106915626072064 : ffff9ec2c4164800)
00000100:00000001:28.0:1773851864.393751:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851864.393751:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851864.393751:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851864.393751:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:31.0:1773851864.393752:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851864.393752:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:5.0:1773851864.393752:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393752:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:30.0:1773851864.393753:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851864.393753:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000100:00000001:4.0:1773851864.393753:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851864.393753:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:30.0:1773851864.393754:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00000001:7.0:1773851864.393754:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851864.393754:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851864.393754:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851864.393754:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:5.0:1773851864.393754:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ad1e99c7.
00000100:00000040:4.0:1773851864.393754:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851864.393755:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851864.393755:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:30.0:1773851864.393755:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000896751b1.
02000000:00000001:7.0:1773851864.393755:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851864.393755:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851864.393755:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851864.393755:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851864.393755:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614138847030767ns, next at 614139847029515ns, rc = 0
02000000:00000001:31.0:1773851864.393756:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:30.0:1773851864.393756:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614138847031408ns, next at 614139847030016ns, rc = 0
00000100:00100000:7.0:1773851864.393756:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076eb54fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051927104:3@kfi7:13:default-yuba2-0
00000100:00100000:6.0:1773851864.393756:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006d58ea18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051927232:2098@kfi7:41:default-yuba2-0
00080000:00000001:5.0:1773851864.393756:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851864.393756:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:31.0:1773851864.393757:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851864.393757:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:5.0:1773851864.393757:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393757:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851864.393757:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:31.0:1773851864.393758:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000912e612e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051927296:2080@kfi7:13:default-yuba2-0
00080000:00000001:30.0:1773851864.393758:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393758:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851864.393758:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:6.0:1773851864.393758:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851864.393758:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:5.0:1773851864.393758:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851864.393758:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.393759:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:30.0:1773851864.393759:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.393759:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.393759:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:6.0:1773851864.393759:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851864.393759:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:4.0:1773851864.393759:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000fec111f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051927168:7@kfi7:41:default-yuba2-0
02000000:00000001:31.0:1773851864.393760:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851864.393760:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851864.393760:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002b002509.
02000000:00000010:6.0:1773851864.393760:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f4faae6e.
00000100:00000001:4.0:1773851864.393760:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851864.393761:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:7.0:1773851864.393761:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851864.393761:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851864.393761:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851864.393761:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851864.393762:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f353b924.
00000400:00000200:6.0:1773851864.393762:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
02000000:00000001:4.0:1773851864.393762:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851864.393762:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004e2bbea7.
02000000:00000001:31.0:1773851864.393763:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851864.393763:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000010:7.0:1773851864.393763:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000400:00000010:6.0:1773851864.393763:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000400:00000010:6.0:1773851864.393763:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5d4425b.
02000000:00000001:4.0:1773851864.393763:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851864.393764:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000010:7.0:1773851864.393764:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000100:00000200:6.0:1773851864.393764:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927232, portal 4
00000400:00000200:4.0:1773851864.393764:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:31.0:1773851864.393765:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000100:00000200:7.0:1773851864.393765:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927104, portal 4
00000400:00000010:4.0:1773851864.393765:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000400:00000010:31.0:1773851864.393766:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d81a04c.
00000100:00000001:7.0:1773851864.393766:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851864.393766:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637117886775040 : -106955822776576 : ffff9eb9682d3f00)
00000100:00000001:6.0:1773851864.393766:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851864.393766:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528700672 : -106978180850944 : ffff9eb433881b00)
00000400:00000010:4.0:1773851864.393766:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:31.0:1773851864.393767:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927296, portal 4
00000100:00000040:7.0:1773851864.393767:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851864.393767:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851864.393767:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927168, portal 4
00000100:00000001:31.0:1773851864.393768:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851864.393768:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851864.393768:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309138560 : -106994400413056 : ffff9eb06cc53a80)
00000100:00000001:31.0:1773851864.393769:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832826880 : -106933876724736 : ffff9ebe84436c00)
00000100:00000040:4.0:1773851864.393769:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851864.393770:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851864.393770:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851864.393770:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851864.393771:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000010:7.0:1773851864.393771:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000232fbe3.
00000100:00000040:6.0:1773851864.393771:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:6.0:1773851864.393771:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003599bb60.
00000100:00000001:4.0:1773851864.393771:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:7.0:1773851864.393772:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927104, offset 0
00000100:00000200:6.0:1773851864.393772:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051927232, offset 0
00000100:00000040:4.0:1773851864.393772:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000100:00000001:31.0:1773851864.393773:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851864.393773:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000010:4.0:1773851864.393773:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e586845a.
00000100:00000040:31.0:1773851864.393774:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000010:31.0:1773851864.393774:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
00000400:00000200:7.0:1773851864.393774:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:6.0:1773851864.393774:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:7.0:1773851864.393775:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000200:4.0:1773851864.393775:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051927168, offset 0
00000100:00000200:31.0:1773851864.393776:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927296, offset 0
00000400:00000200:7.0:1773851864.393776:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:4.0:1773851864.393776:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:31.0:1773851864.393777:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:31.0:1773851864.393778:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851864.393778:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:31.0:1773851864.393779:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:7.0:1773851864.393779:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000400:00000200:31.0:1773851864.393780:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851864.393781:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769101, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769103, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851864.393782:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:31.0:1773851864.393783:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:7.0:1773851864.393783:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851864.393784:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769101, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769103, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851864.393784:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851864.393785:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000400:00000200:31.0:1773851864.393786:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:7.0:1773851864.393786:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769104:8769104:1024:4294967295] 3@kfi7 LPNI seq info [5406219:5406219:16:4294967295]
00000400:00000200:31.0:1773851864.393787:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851864.393788:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:7.0:1773851864.393788:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:31.0:1773851864.393789:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769105:8769105:1024:4294967295] 2080@kfi7 LPNI seq info [5404390:5404390:16:4294967295]
00000400:00000200:7.0:1773851864.393789:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:6.0:1773851864.393790:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851864.393790:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:31.0:1773851864.393791:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:31.0:1773851864.393791:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851864.393791:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851864.393793:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:6.0:1773851864.393794:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000400:00000200:31.0:1773851864.393795:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851864.393795:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851864.393796:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769104, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769105, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851864.393797:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851864.393797:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:6.0:1773851864.393797:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:7.0:1773851864.393798:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:6.0:1773851864.393798:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000800:00000200:31.0:1773851864.393799:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:6.0:1773851864.393799:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851864.393800:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851864.393800:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346198, 20346200]
00000800:00000200:31.0:1773851864.393801:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851864.393802:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000800:00000200:31.0:1773851864.393803:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851864.393803:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851864.393803:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769106:8769106:1023:4294967295] 2105@kfi7 LPNI seq info [20346201:20346201:16:4294967295]
00000400:00000200:6.0:1773851864.393804:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000800:00000200:7.0:1773851864.393805:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Using peer 3@kfi7(0x3b9)
00000400:00000200:6.0:1773851864.393805:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:31.0:1773851864.393806:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000400:00000200:4.0:1773851864.393806:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:4.0:1773851864.393807:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000800:00000200:7.0:1773851864.393808:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x3b9: rc=0
00000400:00000200:6.0:1773851864.393808:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851864.393808:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:31.0:1773851864.393809:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000400:00000200:6.0:1773851864.393809:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:4.0:1773851864.393809:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:4.0:1773851864.393810:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000800:00000200:31.0:1773851864.393811:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851864.393811:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851864.393811:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851864.393812:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851864.393812:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769106, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769105, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851864.393813:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393813:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393813:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851864.393813:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:31.0:1773851864.393814:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851864.393814:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393814:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851864.393814:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851864.393815:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393815:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851864.393815:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851864.393815:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851864.393816:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851864.393816:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851864.393816:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340060, 17340059]
00000100:00000001:7.0:1773851864.393817:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:6.0:1773851864.393817:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000100:00000001:31.0:1773851864.393818:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851864.393818:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851864.393818:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851864.393818:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.393819:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.393819:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851864.393819:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851864.393819:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851864.393819:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000100:00000001:31.0:1773851864.393820:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393820:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851864.393820:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000618b435b: Posted send of 324 bytes to peer 0x4c6: rc=0
00000400:00000200:4.0:1773851864.393820:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769107:8769107:1023:4294967295] 7@kfi7 LPNI seq info [17340061:17340061:16:4294967295]
00000100:00000001:31.0:1773851864.393821:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851864.393821:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000400:00000200:4.0:1773851864.393821:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:6.0:1773851864.393822:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851864.393822:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:30.0:1773851864.393823:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851864.393824:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000100:00000001:6.0:1773851864.393824:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851864.393824:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851864.393825:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000100:00000001:6.0:1773851864.393825:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851864.393825:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000010:30.0:1773851864.393826:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000100:00000001:30.0:1773851864.393826:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:6.0:1773851864.393826:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851864.393826:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851864.393826:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:6.0:1773851864.393827:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000200:30.0:1773851864.393828:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851864.393828:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:6.0:1773851864.393829:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851864.393829:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851864.393829:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.393830:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851864.393830:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851864.393831:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.393833:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851864.393833:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_EVENT_TX_OK event status 0
00000800:00000200:4.0:1773851864.393833:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:30.0:1773851864.393834:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851864.393834:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851864.393834:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851864.393835:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:7.0:1773851864.393835:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851864.393836:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Transaction freed
00000400:00000200:5.0:1773851864.393836:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000400:00000200:5.0:1773851864.393836:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000232fbe3
00000400:00000200:7.0:1773851864.393837:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:5.0:1773851864.393837:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000232fbe3.
00000800:00000200:4.0:1773851864.393837:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851864.393838:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00000001:5.0:1773851864.393838:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:7.0:1773851864.393839:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003599bb60
00000400:00000010:7.0:1773851864.393839:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003599bb60.
00000100:00000200:5.0:1773851864.393839:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851864.393839:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a Using peer 7@kfi7(0x20000000000119a)
00000100:00000001:7.0:1773851864.393840:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:7.0:1773851864.393841:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851864.393841:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851864.393842:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851864.393842:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x20000000000119a: rc=0
00000100:00000001:7.0:1773851864.393843:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:4.0:1773851864.393843:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:7.0:1773851864.393844:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851864.393844:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.393845:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:7.0:1773851864.393846:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851864.393846:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:7.0:1773851864.393847:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:7.0:1773851864.393848:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:5.0:1773851864.393848:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Transaction freed
00000800:00000200:7.0:1773851864.393849:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Transaction freed
00000100:00000001:4.0:1773851864.393849:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393849:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851864.393850:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393852:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393852:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.393853:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851864.393853:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851864.393854:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851864.393854:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851864.393858:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851864.393858:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393858:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851864.393860:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.393861:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000400:00000200:5.0:1773851864.393862:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e586845a
00000400:00000010:5.0:1773851864.393862:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e586845a.
00000100:00000001:5.0:1773851864.393863:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851864.393864:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851864.393866:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851864.393867:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851864.393869:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:5.0:1773851864.393869:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.393869:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:30.0:1773851864.393870:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851864.393870:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:5.0:1773851864.393870:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:30.0:1773851864.393871:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851864.393872:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851864.393872:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a Transaction freed
00000800:00000200:30.0:1773851864.393873:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851864.393873:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851864.393875:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:25.0:1773851864.393875:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851864.393876:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 3@kfi7 : PUT - for me
00000800:00000200:9.0:1773851864.393876:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:25.0:1773851864.393877:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:9.0:1773851864.393877:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:30.0:1773851864.393878:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:9.0:1773851864.393878:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851864.393879:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:25.0:1773851864.393879:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:30.0:1773851864.393880:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851864.393880:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:9.0:1773851864.393880:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851864.393881:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:25.0:1773851864.393881:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:30.0:1773851864.393882:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:9.0:1773851864.393882:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:30.0:1773851864.393883:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851864.393883:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851864.393884:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:30.0:1773851864.393885:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3240
00000400:00000200:25.0:1773851864.393885:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:30.0:1773851864.393886:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851864.393886:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851864.393886:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:25.0:1773851864.393887:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b32c0
00000400:00000200:9.0:1773851864.393887:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:30.0:1773851864.393888:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78008057d [1] + 224
00000400:00000200:25.0:1773851864.393888:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851864.393888:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000800:00000200:30.0:1773851864.393890:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851864.393890:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b30a25 [1] + 224
00000400:00000200:9.0:1773851864.393890:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.393890:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:13.0:1773851864.393891:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851864.393891:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:30.0:1773851864.393892:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851864.393892:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851864.393893:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000800:00000200:13.0:1773851864.393893:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851864.393893:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:30.0:1773851864.393894:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851864.393894:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851864.393894:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.393894:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3300
00000100:00000200:30.0:1773851864.393895:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851864.393895:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:9.0:1773851864.393895:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:25.0:1773851864.393896:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851864.393897:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851864.393897:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851864.393897:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781697729 [1] + 224
00000100:00000040:30.0:1773851864.393898:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851864.393899:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:9.0:1773851864.393899:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:25.0:1773851864.393900:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851864.393901:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:9.0:1773851864.393901:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851864.393902:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851864.393902:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000400:00000200:30.0:1773851864.393903:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:9.0:1773851864.393903:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:25.0:1773851864.393904:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:9.0:1773851864.393904:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851864.393904:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:30.0:1773851864.393905:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851864.393905:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:13.0:1773851864.393905:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:7.0:1773851864.393905:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:25.0:1773851864.393906:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000001:7.0:1773851864.393906:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851864.393906:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:6.0:1773851864.393906:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851864.393906:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:13.0:1773851864.393907:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:13.0:1773851864.393907:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000040:9.0:1773851864.393907:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:7.0:1773851864.393907:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000400:00000001:6.0:1773851864.393907:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:13.0:1773851864.393908:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:7.0:1773851864.393908:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000400:00000010:7.0:1773851864.393908:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000400:00000001:6.0:1773851864.393908:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:6.0:1773851864.393908:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:13.0:1773851864.393909:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:7.0:1773851864.393909:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:6.0:1773851864.393909:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5d4425b
00000400:00000200:13.0:1773851864.393910:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000200:7.0:1773851864.393910:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851864.393910:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5d4425b.
00000100:00000001:6.0:1773851864.393910:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851864.393911:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3280
00000100:00000001:9.0:1773851864.393911:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:6.0:1773851864.393911:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851864.393912:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851864.393912:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:31.0:1773851864.393913:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.393913:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851864.393913:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000200:7.0:1773851864.393913:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:31.0:1773851864.393914:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851864.393914:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:13.0:1773851864.393914:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f5e6d [1] + 224
00000100:00000200:6.0:1773851864.393914:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851864.393915:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000100:00000001:7.0:1773851864.393915:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:31.0:1773851864.393916:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d81a04c
00000400:00000010:31.0:1773851864.393916:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d81a04c.
00000800:00000200:13.0:1773851864.393916:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851864.393916:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851864.393916:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:6.0:1773851864.393916:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851864.393916:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851864.393917:0:41091:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:7.0:1773851864.393917:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851864.393917:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851864.393917:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851864.393917:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851864.393917:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:31.0:1773851864.393918:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851864.393918:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851864.393918:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851864.393918:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851864.393919:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
02000000:00000001:7.0:1773851864.393919:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851864.393919:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=97 v=66 (66 66 66 66)
02000000:00000001:6.0:1773851864.393919:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851864.393920:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:7.0:1773851864.393920:0:41064:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=97 v=66 (1 1 1 1)
00000100:00001000:6.0:1773851864.393920:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=97 v=66 (66 66 66 66)
00000100:00001000:6.0:1773851864.393920:0:41067:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=97 v=66 (1 1 1 1)
00000100:00000200:31.0:1773851864.393921:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:13.0:1773851864.393922:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851864.393922:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851864.393922:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851864.393922:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851864.393922:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851864.393923:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851864.393923:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851864.393923:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851864.393923:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.393924:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851864.393924:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:13.0:1773851864.393924:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851864.393924:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:6.0:1773851864.393924:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851864.393924:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:31.0:1773851864.393925:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851864.393925:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:7.0:1773851864.393925:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:7.0:1773851864.393925:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851864.393925:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851864.393925:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.393926:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851864.393926:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393926:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851864.393927:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851864.393927:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:6.0:1773851864.393927:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:31.0:1773851864.393928:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=97 v=66 (66 66 66 66)
00000100:00000001:13.0:1773851864.393928:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:31.0:1773851864.393929:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=97 v=66 (1 1 1 1)
00000400:00000200:13.0:1773851864.393929:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:7.0:1773851864.393929:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851864.393929:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851864.393930:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851864.393930:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851864.393930:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851864.393930:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851864.393930:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851864.393930:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851864.393930:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.393930:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851864.393930:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00010000:00000001:31.0:1773851864.393931:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851864.393931:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851864.393931:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:6.0:1773851864.393931:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000001:4.0:1773851864.393931:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851864.393931:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851864.393932:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000040:7.0:1773851864.393932:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851864.393932:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353623552 avail=351351217152 avail_mb=1372465692 hwm_mb=3131101 files=372083323 ffree=343118773 state=0: rc = 0
00000004:00000020:6.0:1773851864.393932:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000064 blocks, 31354646240 free, 31354589664 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064141 files, 2870603598 free files
00000400:00000010:4.0:1773851864.393932:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851864.393932:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000100:00000040:31.0:1773851864.393933:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00000001:31.0:1773851864.393933:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:6.0:1773851864.393933:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851864.393933:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:31.0:1773851864.393934:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:7.0:1773851864.393934:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353623552 free, 351351217152 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083323 files, 343118773 free files
00000100:00000040:6.0:1773851864.393934:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851864.393934:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851864.393934:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851864.393935:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:7.0:1773851864.393936:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851864.393937:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:6.0:1773851864.393937:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006d58ea18 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051927232:2098@kfi7:41:default-yuba2-0
00000100:00000200:4.0:1773851864.393937:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851864.393938:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851864.393939:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851864.393939:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:7.0:1773851864.393939:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076eb54fb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051927104:3@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851864.393939:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851864.393939:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851864.393939:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:31.0:1773851864.393940:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:6.0:1773851864.393940:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006d58ea18 x1859433051927232/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851864.393940:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.393940:0:41065:0:(client.c:1428:after_reply()) Process entered
00000004:00000040:31.0:1773851864.393941:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851864.393941:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510687744 avail=351508057088 avail_mb=1373078348 hwm_mb=3131103 files=372095858 ffree=343272156 state=0: rc = 0
00000100:00000001:7.0:1773851864.393941:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851864.393941:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851864.393941:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851864.393942:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851864.393942:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000076eb54fb x1859433051927104/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851864.393942:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:4.0:1773851864.393942:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851864.393942:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:31.0:1773851864.393943:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510687744 free, 351508057088 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095858 files, 343272156 free files
02000000:00000001:6.0:1773851864.393943:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851864.393943:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f4faae6e.
00000100:00001000:4.0:1773851864.393943:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=123 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851864.393944:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851864.393944:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00001000:4.0:1773851864.393944:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=129 v=66 (1 1 1 1)
00000004:00000001:31.0:1773851864.393945:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.393945:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851864.393945:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002b002509.
00000020:00000001:6.0:1773851864.393945:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851864.393945:0:41067:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:4.0:1773851864.393945:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851864.393945:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851864.393946:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:6.0:1773851864.393946:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851864.393946:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d7ad89bf.
00010000:00000001:4.0:1773851864.393946:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851864.393946:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.393947:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851864.393947:0:41064:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:6.0:1773851864.393947:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000040:7.0:1773851864.393948:0:41064:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000020:00000001:7.0:1773851864.393948:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:6.0:1773851864.393948:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851864.393948:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006d58ea18.
00000100:00000001:4.0:1773851864.393948:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851864.393948:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00100000:31.0:1773851864.393949:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000912e612e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051927296:2080@kfi7:13:default-yuba2-0
02000000:00000010:7.0:1773851864.393949:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b255b11b.
00000100:00000001:6.0:1773851864.393949:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851864.393949:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851864.393949:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.393950:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851864.393950:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851864.393950:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851864.393950:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076eb54fb.
00000100:00000001:6.0:1773851864.393950:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851864.393950:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851864.393950:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851864.393951:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851864.393951:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851864.393951:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851864.393951:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851864.393951:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851864.393951:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:31.0:1773851864.393952:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000912e612e x1859433051927296/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851864.393952:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851864.393952:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393953:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851864.393953:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.393953:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851864.393953:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851864.393953:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851864.393954:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851864.393954:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851864.393954:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393954:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851864.393954:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000010:31.0:1773851864.393955:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f353b924.
00000004:00000020:4.0:1773851864.393955:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031776 blocks, 31536852640 free, 31536812384 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425386 files, 2779493115 free files
02000000:00000001:31.0:1773851864.393956:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851864.393957:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851864.393957:0:41091:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000004:00000001:4.0:1773851864.393957:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851864.393958:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:4.0:1773851864.393958:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:31.0:1773851864.393959:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a709584c.
02000000:00000001:31.0:1773851864.393959:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851864.393960:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851864.393960:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000912e612e.
00000100:00000001:31.0:1773851864.393961:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00100000:4.0:1773851864.393961:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000fec111f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051927168:7@kfi7:41:default-yuba2-0
00000100:00000001:31.0:1773851864.393962:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.393962:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851864.393963:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851864.393963:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851864.393963:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851864.393964:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851864.393964:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000fec111f x1859433051927168/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851864.393965:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.393965:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393966:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851864.393967:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851864.393967:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004e2bbea7.
02000000:00000001:4.0:1773851864.393968:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851864.393969:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851864.393969:0:41065:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000001:4.0:1773851864.393970:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851864.393971:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e1ee070a.
02000000:00000001:4.0:1773851864.393971:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851864.393972:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851864.393972:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000fec111f.
00000100:00000001:4.0:1773851864.393973:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851864.393973:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.393975:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.393975:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851864.393976:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.393976:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851864.393977:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851864.410451:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851864.410451:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851864.410453:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851864.410454:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851864.410456:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14833@kfi7 to cpt 3
00000400:00000200:13.0:1773851864.410457:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14833@kfi7 : PUT - for me
00000400:00000200:13.0:1773851864.410458:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14833@kfi7 to cpt 3
00000400:00000200:13.0:1773851864.410459:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afabe1b4 nid 14833@kfi7 refs 1
00000400:00000200:13.0:1773851864.410461:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14833@kfi7 to cpt 3
00000400:00000200:13.0:1773851864.410462:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afabe1b4 nid 14833@kfi7 refs 2
00000400:00000200:13.0:1773851864.410463:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000afabe1b4 nid 14833@kfi7 refs 3
00000400:00000200:13.0:1773851864.410463:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14832@kfi7 to cpt 0
00000400:00000200:13.0:1773851864.410464:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14832@kfi7 of length 224 into portal 12 MB=0x69b4b57c70b40
00000400:00000200:13.0:1773851864.410465:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14832@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 25768
00000800:00000200:13.0:1773851864.410467:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851864.410469:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851864.410470:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14833@kfi7: PUT: OK
00000100:00000001:13.0:1773851864.410471:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851864.410471:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851864.410473:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c80c5126.
00000100:00000040:13.0:1773851864.410474:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c80c5126 x1859597757778752 msgsize 224
00000100:00100000:13.0:1773851864.410475:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14832@kfi7 (source: 12345-14833@kfi7)
00000100:00000001:13.0:1773851864.410476:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851864.410477:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000afabe1b4 nid 14833@kfi7 refs 2
00000800:00000200:13.0:1773851864.410478:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851864.410481:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851864.410482:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851864.410482:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851864.410483:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851864.410484:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851864.410485:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597757778752
00000020:00000001:13.0:1773851864.410485:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851864.410486:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81024
00000020:00000001:13.0:1773851864.410487:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851864.410488:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000765d556f refcount=5
00000020:00000001:13.0:1773851864.410489:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104430200832 : -106969279350784 : ffff9eb6461a3800)
00000020:00000001:13.0:1773851864.410490:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637104430200832 : -106969279350784 : ffff9eb6461a3800)
00000100:00000001:13.0:1773851864.410491:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851864.410492:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851864.410493:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092eb84b1.
00000020:00000010:13.0:1773851864.410494:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851864.410495:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009802e6cf.
00000100:00000001:13.0:1773851864.410496:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851864.410496:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851864.410497:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851864.410498:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851864.410499:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851864.410499:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851864.410500:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851864.410502:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851864.410502:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851864.410502:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851864.410502:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851864.410504:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14832@kfi7, seq: 2289821
00000100:00000040:15.0:1773851864.410504:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000765d556f : new rpc_count 1
00000100:00000001:13.0:1773851864.410504:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.410505:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637152534601600 : -106921174950016 : ffff9ec179591f80)
00000100:00000001:13.0:1773851864.410505:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851864.410507:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c80c5126 x1859597757778752/t0(0) o400->48d2d453-ab4b-41b2-861d-7c621760806c@14832@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1405-0'
00000100:00000001:15.0:1773851864.410510:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851864.410510:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851864.410511:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c80c5126 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:48d2d453-ab4b-41b2-861d-7c621760806c+5:39527:x1859597757778752:12345-14832@kfi7:400:default-tuolumne1405-0
00000100:00000200:15.0:1773851864.410514:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597757778752
00000020:00000001:15.0:1773851864.410515:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851864.410516:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851864.410517:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.410517:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851864.410518:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851864.410519:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851864.410520:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597757778752, found 0 last_xid 1859597757778751
00000020:00000001:15.0:1773851864.410520:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851864.410521:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851864.410522:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851864.410522:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.410523:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851864.410524:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851864.410524:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851864.410525:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ba835c49.
02000000:00000001:15.0:1773851864.410526:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.410526:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.410527:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851864.410528:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688276, transno 0, xid 1859597757778752
00010000:00000001:15.0:1773851864.410529:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851864.410530:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c80c5126 x1859597757778752/t0(0) o400->48d2d453-ab4b-41b2-861d-7c621760806c@14832@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1405-0'
00010000:00000001:15.0:1773851864.410532:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851864.410533:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851864.410533:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=97 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851864.410535:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851864.410536:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009d7553bd refcount 3 to 14832@kfi7
00000100:00000001:15.0:1773851864.410536:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003328 : -107146751548288 : ffff9e8cf3ef6480)
02000000:00000001:15.0:1773851864.410537:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851864.410538:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.410538:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851864.410539:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14833@kfi7
00000400:00000010:15.0:1773851864.410540:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fd79a325.
00000100:00000200:15.0:1773851864.410541:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597757778752, offset 224
00000400:00000200:15.0:1773851864.410543:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14833@kfi7
00000400:00000200:15.0:1773851864.410544:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14833@kfi7 to cpt 3
00000400:00000200:15.0:1773851864.410545:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afabe1b4 nid 14833@kfi7 refs 1
00000400:00000200:15.0:1773851864.410546:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000afabe1b4 nid 14833@kfi7 refs 2
00000400:00000200:15.0:1773851864.410547:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000afabe1b4 nid 14833@kfi7 refs 3
00000400:00000200:15.0:1773851864.410548:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14833@kfi7 local destination
00000400:00000200:15.0:1773851864.410549:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769108:8769108:1024:4294967295] 14833@kfi7 LPNI seq info [284417:284417:16:4294967295]
00000400:00000200:15.0:1773851864.410551:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000afabe1b4 nid 14833@kfi7 refs 2
00000400:00000200:15.0:1773851864.410552:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14833@kfi7 to cpt 3
00000400:00000200:15.0:1773851864.410554:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14833@kfi7(14833@kfi7:14833@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851864.410555:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000afabe1b4 nid 14833@kfi7 refs 3
00000800:00000200:15.0:1773851864.410556:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851864.410557:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851864.410560:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851864.410562:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa25 Using peer 14833@kfi7(0xa25)
00000800:00000200:15.0:1773851864.410565:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0xa25: rc=0
00000800:00000200:15.0:1773851864.410567:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa25 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851864.410569:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851864.410570:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009d7553bd refcount 2 to 14832@kfi7
00010000:00000001:15.0:1773851864.410571:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851864.410571:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.410572:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851864.410573:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c80c5126 x1859597757778752/t0(0) o400->48d2d453-ab4b-41b2-861d-7c621760806c@14832@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1405-0'
00000100:00100000:15.0:1773851864.410576:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c80c5126 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:48d2d453-ab4b-41b2-861d-7c621760806c+5:39527:x1859597757778752:12345-14832@kfi7:400:default-tuolumne1405-0 Request processed in 65us (101us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851864.410579:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14832@kfi7, seq: 2289821
00000800:00000200:13.0:1773851864.410579:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa25 TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851864.410580:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000765d556f : new rpc_count 0
00000100:00000001:15.0:1773851864.410581:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851864.410581:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851864.410581:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851864.410582:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:13.0:1773851864.410582:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14833@kfi7: PUT: OK
00000020:00000010:15.0:1773851864.410583:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009802e6cf.
00000400:00000200:13.0:1773851864.410583:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fd79a325
00000020:00000010:15.0:1773851864.410584:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092eb84b1.
00000020:00000040:15.0:1773851864.410584:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000765d556f : new refcount 4
00000400:00000010:13.0:1773851864.410584:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fd79a325.
00000100:00000001:13.0:1773851864.410584:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851864.410585:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851864.410585:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851864.410586:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000afabe1b4 nid 14833@kfi7 refs 2
00000800:00000200:13.0:1773851864.410587:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 14833@kfi7(0000000033fee709):0x0 lsk 2598 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa25 Transaction freed
00000800:00000200:17.0:1773851864.416433:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.416434:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851864.416435:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.416437:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851864.416440:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.416441:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.21@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851864.416442:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.416443:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851864.416445:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.21@o2ib60 to cpt 6
00000400:00000200:17.0:1773851864.416446:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a255edaf nid 192.168.128.21@o2ib60 refs 2
00000400:00000200:17.0:1773851864.416448:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a255edaf nid 192.168.128.21@o2ib60 refs 3
00000400:00000200:17.0:1773851864.416450:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.21@o2ib60 to cpt 6
00000400:00000200:17.0:1773851864.416451:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.21@o2ib60 of length 224 into portal 12 MB=0x69b2164344ac0
00000400:00000200:17.0:1773851864.416453:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.21@o2ib60 of length 224/224 into md 0x16159c9699 [64] + 2016
00000800:00000200:17.0:1773851864.416455:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851864.416457:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.416459:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851864.416460:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851864.416460:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851864.416461:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a9b42d8.
00000100:00000040:17.0:1773851864.416462:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000004a9b42d8 x1859417577638592 msgsize 224
00000100:00100000:17.0:1773851864.416464:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.21@o2ib60 (source: 12345-192.168.128.21@o2ib60)
00000100:00000001:17.0:1773851864.416466:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851864.416467:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:24.0:1773851864.416469:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851864.416469:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851864.416469:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851864.416470:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851864.416470:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851864.416471:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851864.416472:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859417577638592
00000020:00000001:24.0:1773851864.416473:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851864.416473:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ab6d
00000020:00000001:24.0:1773851864.416473:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851864.416475:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000086cbc828 refcount=5
00000020:00000001:24.0:1773851864.416476:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118343460864 : -106955366090752 : ffff9eb98365b800)
00000020:00000001:24.0:1773851864.416476:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118343460864 : -106955366090752 : ffff9eb98365b800)
00000100:00000001:24.0:1773851864.416477:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851864.416478:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851864.416479:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000019f92fd.
00000020:00000010:24.0:1773851864.416480:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851864.416481:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005179b485.
00000100:00000001:24.0:1773851864.416481:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851864.416482:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851864.416482:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851864.416483:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851864.416484:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851864.416484:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.416485:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851864.416486:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851864.416487:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851864.416488:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:24.0:1773851864.416488:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.21@o2ib60, seq: 2025090
00000100:00000001:25.0:1773851864.416489:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:24.0:1773851864.416489:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000086cbc828 : new rpc_count 1
00000100:00000001:25.0:1773851864.416490:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.416490:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764337920 : -107095945213696 : ffff9e98c83a8900)
00000100:00000001:25.0:1773851864.416491:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851864.416491:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a9b42d8 x1859417577638592/t0(0) o400->9fb0687b-c41b-4463-8974-93af6503dffa@192.168.128.21@o2ib60:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix21-0'
00000100:00000001:24.0:1773851864.416494:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851864.416494:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851864.416495:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a9b42d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:9fb0687b-c41b-4463-8974-93af6503dffa+5:39952:x1859417577638592:12345-192.168.128.21@o2ib60:400:default-matrix21-0
00000100:00000200:24.0:1773851864.416497:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859417577638592
00000020:00000001:24.0:1773851864.416497:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851864.416498:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851864.416498:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.416499:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851864.416499:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851864.416500:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851864.416501:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859417577638592, found 0 last_xid 1859417577638591
00000020:00000001:24.0:1773851864.416502:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851864.416502:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851864.416503:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851864.416503:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.416504:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851864.416504:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851864.416505:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851864.416505:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000240eacc0.
02000000:00000001:24.0:1773851864.416506:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.416507:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.416507:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851864.416508:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183047293204, transno 0, xid 1859417577638592
00010000:00000001:24.0:1773851864.416509:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851864.416509:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a9b42d8 x1859417577638592/t0(0) o400->9fb0687b-c41b-4463-8974-93af6503dffa@192.168.128.21@o2ib60:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix21-0'
00010000:00000001:24.0:1773851864.416512:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851864.416512:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851864.416513:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=97 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851864.416514:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851864.416515:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ede85fc refcount 3 to 192.168.128.21@o2ib60
00000100:00000001:24.0:1773851864.416516:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858016 : -107149578693600 : ffff9e8c4b6c9420)
02000000:00000001:24.0:1773851864.416517:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851864.416517:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851864.416518:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851864.416519:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.21@o2ib60
00000400:00000010:24.0:1773851864.416520:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c502b5b.
00000100:00000200:24.0:1773851864.416521:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859417577638592, offset 224
00000400:00000200:24.0:1773851864.416522:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.21@o2ib60
00000400:00000200:24.0:1773851864.416523:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.21@o2ib60 to cpt 6
00000400:00000200:24.0:1773851864.416524:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a255edaf nid 192.168.128.21@o2ib60 refs 2
00000400:00000200:24.0:1773851864.416525:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a255edaf nid 192.168.128.21@o2ib60 refs 3
00000400:00000200:24.0:1773851864.416526:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a255edaf nid 192.168.128.21@o2ib60 refs 4
00000400:00000200:24.0:1773851864.416527:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.21@o2ib60 routed destination
00000400:00000200:24.0:1773851864.416528:0:60973:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:24.0:1773851864.416529:0:60973:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:24.0:1773851864.416531:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.21@o2ib60: rtr pref emtpy: 1
00000400:00000200:24.0:1773851864.416532:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:24.0:1773851864.416533:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.21@o2ib60: rtr pref emtpy: 1
00000400:00000200:24.0:1773851864.416534:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:24.0:1773851864.416535:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769109:8769109:1024:4294967295] 17@kfi7 LPNI seq info [1250891887:1250891887:16:4294967295]
00000400:00000200:24.0:1773851864.416536:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:24.0:1773851864.416537:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:24.0:1773851864.416539:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.21@o2ib60(192.168.128.21@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851864.416540:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a255edaf nid 192.168.128.21@o2ib60 refs 3
00000800:00000200:24.0:1773851864.416542:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851864.416543:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851864.416545:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851864.416547:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:24.0:1773851864.416550:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:24.0:1773851864.416552:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851864.416554:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851864.416555:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ede85fc refcount 2 to 192.168.128.21@o2ib60
00010000:00000001:24.0:1773851864.416555:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851864.416556:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851864.416556:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851864.416557:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a9b42d8 x1859417577638592/t0(0) o400->9fb0687b-c41b-4463-8974-93af6503dffa@192.168.128.21@o2ib60:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix21-0'
00000100:00100000:24.0:1773851864.416562:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a9b42d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:9fb0687b-c41b-4463-8974-93af6503dffa+5:39952:x1859417577638592:12345-192.168.128.21@o2ib60:400:default-matrix21-0 Request processed in 67us (99us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851864.416564:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.21@o2ib60, seq: 2025090
00000100:00000040:24.0:1773851864.416565:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000086cbc828 : new rpc_count 0
00000100:00000001:24.0:1773851864.416565:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851864.416566:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851864.416567:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851864.416567:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005179b485.
00000020:00000010:24.0:1773851864.416568:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000019f92fd.
00000020:00000040:24.0:1773851864.416569:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000086cbc828 : new refcount 4
00000100:00000001:24.0:1773851864.416569:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851864.416576:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851864.416578:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851864.416580:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:25.0:1773851864.416581:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c502b5b
00000400:00000010:25.0:1773851864.416582:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c502b5b.
00000100:00000001:25.0:1773851864.416583:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851864.416584:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851864.416586:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:25.0:1773851864.416588:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Transaction freed
00000800:00000200:29.0:1773851864.471530:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851864.471531:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851864.471532:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851864.471535:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851864.471536:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22369@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.471537:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22369@kfi7 : PUT - for me
00000400:00000200:29.0:1773851864.471538:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22369@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.471539:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edb6bac7 nid 22369@kfi7 refs 1
00000400:00000200:29.0:1773851864.471541:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22369@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.471541:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edb6bac7 nid 22369@kfi7 refs 2
00000400:00000200:29.0:1773851864.471542:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000edb6bac7 nid 22369@kfi7 refs 3
00000400:00000200:29.0:1773851864.471543:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22369@kfi7 to cpt 7
00000400:00000200:29.0:1773851864.471544:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22369@kfi7 of length 224 into portal 12 MB=0x699e170de4a40
00000400:00000200:29.0:1773851864.471545:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22369@kfi7 of length 224/224 into md 0x77fe139dd [64] + 172840
00000800:00000200:29.0:1773851864.471547:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851864.471548:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851864.471549:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22369@kfi7: PUT: OK
00000100:00000001:29.0:1773851864.471550:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851864.471551:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851864.471551:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ad871fc.
00000100:00000040:29.0:1773851864.471552:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000005ad871fc x1858043400571456 msgsize 224
00000100:00100000:29.0:1773851864.471553:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22369@kfi7 (source: 12345-22369@kfi7)
00000100:00000001:29.0:1773851864.471555:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851864.471555:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000edb6bac7 nid 22369@kfi7 refs 2
00000100:00000001:28.0:1773851864.471556:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851864.471557:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851864.471557:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851864.471557:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851864.471558:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851864.471559:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851864.471559:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043400571456
00000020:00000001:28.0:1773851864.471560:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851864.471560:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91310
00000020:00000001:28.0:1773851864.471561:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851864.471565:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000030496d8c refcount=6
00000020:00000001:28.0:1773851864.471566:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716206592 : -107155993345024 : ffff9e8acd14c400)
00000020:00000001:28.0:1773851864.471567:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716206592 : -107155993345024 : ffff9e8acd14c400)
00000100:00000001:28.0:1773851864.471568:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851864.471569:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851864.471569:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9820241.
00000020:00000010:28.0:1773851864.471570:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851864.471571:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f776f930.
00000100:00000001:28.0:1773851864.471572:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851864.471573:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851864.471573:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851864.471574:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851864.471575:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851864.471575:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.471576:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851864.471577:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851864.471578:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851864.471579:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:28.0:1773851864.471579:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22369@kfi7, seq: 2055508
00000100:00000040:28.0:1773851864.471579:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000030496d8c : new rpc_count 1
00000100:00000001:31.0:1773851864.471580:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851864.471580:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343705344 : -106994365846272 : ffff9eb06ed4ad00)
00000100:00000001:31.0:1773851864.471581:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851864.471581:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005ad871fc x1858043400571456/t0(0) o400->ef50b087-7c51-471b-8965-0a9085aa5f62@22369@kfi7:504/0 lens 224/0 e 0 to 0 dl 1773852619 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1888-0'
00000100:00000001:31.0:1773851864.471582:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.471584:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851864.471585:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851864.471586:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ad871fc pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ef50b087-7c51-471b-8965-0a9085aa5f62+6:39803:x1858043400571456:12345-22369@kfi7:400:default-tuolumne1888-0
00000100:00000200:28.0:1773851864.471587:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043400571456
00000020:00000001:28.0:1773851864.471588:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851864.471588:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851864.471589:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.471590:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851864.471590:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851864.471591:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851864.471592:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043400571456, found 0 last_xid 1858043400571455
00000020:00000001:28.0:1773851864.471593:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851864.471593:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851864.471594:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851864.471595:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.471595:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851864.471596:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851864.471596:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851864.471597:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aceb0722.
02000000:00000001:28.0:1773851864.471598:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.471598:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.471599:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851864.471600:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182931090137, transno 0, xid 1858043400571456
00010000:00000001:28.0:1773851864.471600:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851864.471601:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005ad871fc x1858043400571456/t0(0) o400->ef50b087-7c51-471b-8965-0a9085aa5f62@22369@kfi7:504/0 lens 224/224 e 0 to 0 dl 1773852619 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1888-0'
00010000:00000001:28.0:1773851864.471604:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851864.471604:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851864.471605:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=97 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851864.471606:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851864.471607:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000097a0a355 refcount 3 to 22369@kfi7
00000100:00000001:28.0:1773851864.471607:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882208 : -107156296669408 : ffff9e8abb006720)
02000000:00000001:28.0:1773851864.471608:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851864.471609:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.471610:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851864.471610:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22369@kfi7
00000400:00000010:28.0:1773851864.471611:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e00fc912.
00000100:00000200:28.0:1773851864.471612:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043400571456, offset 224
00000400:00000200:28.0:1773851864.471613:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22369@kfi7
00000400:00000200:28.0:1773851864.471614:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22369@kfi7 to cpt 7
00000400:00000200:28.0:1773851864.471615:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edb6bac7 nid 22369@kfi7 refs 1
00000400:00000200:28.0:1773851864.471616:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000edb6bac7 nid 22369@kfi7 refs 2
00000400:00000200:28.0:1773851864.471617:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000edb6bac7 nid 22369@kfi7 refs 3
00000400:00000200:28.0:1773851864.471618:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22369@kfi7 local destination
00000400:00000200:28.0:1773851864.471619:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769110:8769110:1024:4294967295] 22369@kfi7 LPNI seq info [17009048:17009048:16:4294967295]
00000400:00000200:28.0:1773851864.471621:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000edb6bac7 nid 22369@kfi7 refs 2
00000400:00000200:28.0:1773851864.471622:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22369@kfi7 to cpt 7
00000400:00000200:28.0:1773851864.471624:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22369@kfi7(22369@kfi7:22369@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851864.471625:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000edb6bac7 nid 22369@kfi7 refs 3
00000800:00000200:28.0:1773851864.471626:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851864.471628:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851864.471630:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851864.471632:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000750 Using peer 22369@kfi7(0x100000000000750)
00000800:00000200:28.0:1773851864.471635:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x100000000000750: rc=0
00000800:00000200:28.0:1773851864.471636:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000750 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851864.471638:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851864.471639:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000097a0a355 refcount 2 to 22369@kfi7
00010000:00000001:28.0:1773851864.471640:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851864.471640:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851864.471641:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851864.471641:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ad871fc x1858043400571456/t0(0) o400->ef50b087-7c51-471b-8965-0a9085aa5f62@22369@kfi7:504/0 lens 224/224 e 0 to 0 dl 1773852619 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1888-0'
00000100:00100000:28.0:1773851864.471646:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ad871fc pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ef50b087-7c51-471b-8965-0a9085aa5f62+6:39803:x1858043400571456:12345-22369@kfi7:400:default-tuolumne1888-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851864.471648:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22369@kfi7, seq: 2055508
00000100:00000040:28.0:1773851864.471649:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000030496d8c : new rpc_count 0
00000100:00000001:28.0:1773851864.471650:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851864.471651:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851864.471651:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851864.471652:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f776f930.
00000020:00000010:28.0:1773851864.471653:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9820241.
00000020:00000040:28.0:1773851864.471653:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000030496d8c : new refcount 5
00000100:00000001:28.0:1773851864.471654:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851864.471659:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000750 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851864.471661:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851864.471662:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22369@kfi7: PUT: OK
00000400:00000200:29.0:1773851864.471662:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e00fc912
00000400:00000010:29.0:1773851864.471663:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e00fc912.
00000100:00000001:29.0:1773851864.471664:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851864.471664:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851864.471665:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000edb6bac7 nid 22369@kfi7 refs 2
00000800:00000200:29.0:1773851864.471666:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22369@kfi7(00000000725fb2ff):0x0 lsk 1873 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000750 Transaction freed
00000800:00000200:5.0:1773851864.474802:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.474803:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851864.474804:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851864.474806:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851864.474810:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22867@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.474811:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22867@kfi7 : PUT - for me
00000400:00000200:5.0:1773851864.474812:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22867@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.474813:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 1
00000400:00000200:5.0:1773851864.474814:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22867@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.474815:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 2
00000400:00000200:5.0:1773851864.474816:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 3
00000400:00000200:5.0:1773851864.474817:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22930@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.474818:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22930@kfi7 of length 224 into portal 12 MB=0x69b0954c87d40
00000400:00000200:5.0:1773851864.474819:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22930@kfi7 of length 224/224 into md 0x793926dc5 [64] + 132088
00000800:00000200:5.0:1773851864.474821:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851864.474823:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.474824:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22867@kfi7: PUT: OK
00000100:00000001:5.0:1773851864.474825:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851864.474825:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851864.474826:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e292d6e1.
00000100:00000040:5.0:1773851864.474827:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e292d6e1 x1859314239700288 msgsize 224
00000100:00100000:5.0:1773851864.474828:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22930@kfi7 (source: 12345-22867@kfi7)
00000100:00000001:5.0:1773851864.474830:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851864.474831:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 2
00000800:00000200:5.0:1773851864.474832:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851864.474835:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851864.474835:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851864.474836:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851864.474836:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.474837:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851864.474838:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314239700288
00000020:00000001:5.0:1773851864.474838:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851864.474839:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ed8
00000020:00000001:5.0:1773851864.474839:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851864.474843:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005d586301 refcount=6
00000020:00000001:5.0:1773851864.474844:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744671232 : -107128964880384 : ffff9e91181a6800)
00000020:00000001:5.0:1773851864.474845:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744671232 : -107128964880384 : ffff9e91181a6800)
00000100:00000001:5.0:1773851864.474846:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.474847:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851864.474847:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9b9985c.
00000020:00000010:5.0:1773851864.474848:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.474849:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851864.474850:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851864.474851:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851864.474851:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.474852:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851864.474853:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851864.474853:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.474854:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851864.474856:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.474856:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851864.474856:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851864.474856:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851864.474857:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22930@kfi7, seq: 2001903
00000100:00000001:7.0:1773851864.474858:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.474858:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005d586301 : new rpc_count 1
00000100:00000001:7.0:1773851864.474859:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.474859:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886758912 : -106955822792704 : ffff9eb9682d0000)
00000100:00000040:5.0:1773851864.474860:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e292d6e1 x1859314239700288/t0(0) o400->a15c13bb-4227-4ab4-8d35-d8d9a414953b@22930@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1926-0'
00000100:00000001:5.0:1773851864.474862:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.474863:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851864.474864:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e292d6e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:a15c13bb-4227-4ab4-8d35-d8d9a414953b+6:39597:x1859314239700288:12345-22930@kfi7:400:default-tuolumne1926-0
00000100:00000200:5.0:1773851864.474865:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314239700288
00000020:00000001:5.0:1773851864.474866:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851864.474866:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851864.474867:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.474868:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851864.474868:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851864.474869:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851864.474871:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314239700288, found 0 last_xid 1859314239700287
00000020:00000001:5.0:1773851864.474871:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851864.474872:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851864.474873:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851864.474873:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.474874:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851864.474874:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851864.474875:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851864.474876:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000508fa8d6.
02000000:00000001:5.0:1773851864.474876:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.474877:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.474877:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851864.474878:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098827059, transno 0, xid 1859314239700288
00010000:00000001:5.0:1773851864.474879:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851864.474880:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e292d6e1 x1859314239700288/t0(0) o400->a15c13bb-4227-4ab4-8d35-d8d9a414953b@22930@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1926-0'
00010000:00000001:5.0:1773851864.474882:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851864.474883:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851864.474883:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=96 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851864.474884:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851864.474885:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000c1ef35a refcount 3 to 22930@kfi7
00000100:00000001:5.0:1773851864.474886:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413056 : -107145304138560 : ffff9e8d4a351cc0)
02000000:00000001:5.0:1773851864.474887:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851864.474887:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.474888:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851864.474888:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22867@kfi7
00000400:00000010:5.0:1773851864.474889:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a7a6c8b.
00000100:00000200:5.0:1773851864.474890:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314239700288, offset 224
00000400:00000200:5.0:1773851864.474891:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22867@kfi7
00000400:00000200:5.0:1773851864.474892:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22867@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.474893:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 1
00000400:00000200:5.0:1773851864.474894:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 2
00000400:00000200:5.0:1773851864.474895:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 3
00000400:00000200:5.0:1773851864.474896:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22867@kfi7 local destination
00000400:00000200:5.0:1773851864.474898:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769111:8769111:1024:4294967295] 22867@kfi7 LPNI seq info [585701:585701:16:4294967295]
00000400:00000200:5.0:1773851864.474899:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 2
00000400:00000200:5.0:1773851864.474900:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22867@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.474902:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22867@kfi7(22867@kfi7:22867@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851864.474903:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 3
00000800:00000200:5.0:1773851864.474905:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.474906:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851864.474908:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851864.474910:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000009b Using peer 22867@kfi7(0x10000000000009b)
00000800:00000200:5.0:1773851864.474913:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x10000000000009b: rc=0
00000800:00000200:5.0:1773851864.474914:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000009b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851864.474916:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.474917:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000c1ef35a refcount 2 to 22930@kfi7
00010000:00000001:5.0:1773851864.474918:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851864.474919:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.474919:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851864.474920:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e292d6e1 x1859314239700288/t0(0) o400->a15c13bb-4227-4ab4-8d35-d8d9a414953b@22930@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1926-0'
00000100:00100000:5.0:1773851864.474923:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e292d6e1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:a15c13bb-4227-4ab4-8d35-d8d9a414953b+6:39597:x1859314239700288:12345-22930@kfi7:400:default-tuolumne1926-0 Request processed in 59us (95us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851864.474925:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22930@kfi7, seq: 2001903
00000800:00000200:6.0:1773851864.474926:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000009b TN_EVENT_TX_OK event status 0
00000100:00000040:5.0:1773851864.474926:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005d586301 : new rpc_count 0
00000100:00000001:5.0:1773851864.474927:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851864.474928:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851864.474928:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851864.474928:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851864.474929:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22867@kfi7: PUT: OK
00000020:00000010:5.0:1773851864.474929:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000400:00000200:6.0:1773851864.474930:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a7a6c8b
00000020:00000010:5.0:1773851864.474930:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9b9985c.
00000400:00000010:6.0:1773851864.474931:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a7a6c8b.
00000100:00000001:6.0:1773851864.474931:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:5.0:1773851864.474931:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000005d586301 : new refcount 5
00000100:00000001:6.0:1773851864.474932:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851864.474932:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851864.474933:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc0c4fbf nid 22867@kfi7 refs 2
00000800:00000200:6.0:1773851864.474934:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 22867@kfi7(000000000de7c939):0x0 lsk 156 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000009b Transaction freed
00000800:00000200:5.0:1773851864.528502:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.528503:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851864.528505:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851864.528509:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851864.528513:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25985@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.528515:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25985@kfi7 : PUT - for me
00000400:00000200:5.0:1773851864.528517:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25985@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.528518:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016184834 nid 25985@kfi7 refs 1
00000400:00000200:5.0:1773851864.528520:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25985@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.528521:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016184834 nid 25985@kfi7 refs 2
00000400:00000200:5.0:1773851864.528522:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000016184834 nid 25985@kfi7 refs 3
00000400:00000200:5.0:1773851864.528524:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25920@kfi7 to cpt 2
00000400:00000200:5.0:1773851864.528526:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25920@kfi7 of length 224 into portal 12 MB=0x69b4cb2403080
00000400:00000200:5.0:1773851864.528528:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25920@kfi7 of length 224/224 into md 0x793926dc5 [64] + 132312
00000800:00000200:5.0:1773851864.528531:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851864.528534:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.528536:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25985@kfi7: PUT: OK
00000100:00000001:5.0:1773851864.528537:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851864.528538:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851864.528539:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ecf6637.
00000100:00000040:5.0:1773851864.528541:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000006ecf6637 x1859603570634880 msgsize 224
00000100:00100000:5.0:1773851864.528543:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25920@kfi7 (source: 12345-25985@kfi7)
00000100:00000001:5.0:1773851864.528545:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851864.528547:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000016184834 nid 25985@kfi7 refs 2
00000800:00000200:5.0:1773851864.528549:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851864.528555:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851864.528556:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851864.528557:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851864.528557:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.528559:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851864.528560:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603570634880
00000020:00000001:5.0:1773851864.528561:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851864.528561:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff802dc
00000020:00000001:5.0:1773851864.528562:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851864.528565:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000d6a8ba8 refcount=5
00000020:00000001:5.0:1773851864.528566:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121156700160 : -106952552851456 : ffff9eba2b145800)
00000020:00000001:5.0:1773851864.528567:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121156700160 : -106952552851456 : ffff9eba2b145800)
00000100:00000001:5.0:1773851864.528569:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.528570:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851864.528571:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9b9985c.
00000020:00000010:5.0:1773851864.528572:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.528573:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851864.528575:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851864.528575:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851864.528576:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.528577:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851864.528578:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851864.528579:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.528580:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.528582:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.528583:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851864.528583:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851864.528584:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851864.528585:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25920@kfi7, seq: 2001904
00000100:00000001:7.0:1773851864.528586:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.528586:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000d6a8ba8 : new rpc_count 1
00000100:00000001:7.0:1773851864.528587:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.528587:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886788864 : -106955822762752 : ffff9eb9682d7500)
00000100:00000040:5.0:1773851864.528589:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ecf6637 x1859603570634880/t0(0) o400->936fe7ed-28d6-4295-9462-28e772d6ba3d@25920@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2116-0'
00000100:00000001:5.0:1773851864.528594:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.528595:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851864.528597:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ecf6637 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:936fe7ed-28d6-4295-9462-28e772d6ba3d+5:39743:x1859603570634880:12345-25920@kfi7:400:default-tuolumne2116-0
00000100:00000200:5.0:1773851864.528600:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603570634880
00000020:00000001:5.0:1773851864.528601:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851864.528601:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851864.528602:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.528603:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851864.528604:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851864.528605:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851864.528606:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603570634880, found 0 last_xid 1859603570634879
00000020:00000001:5.0:1773851864.528608:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851864.528609:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851864.528609:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851864.528610:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.528611:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851864.528612:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851864.528613:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851864.528613:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cc00b94f.
02000000:00000001:5.0:1773851864.528614:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.528615:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.528617:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851864.528618:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183000171718, transno 0, xid 1859603570634880
00010000:00000001:5.0:1773851864.528619:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851864.528620:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ecf6637 x1859603570634880/t0(0) o400->936fe7ed-28d6-4295-9462-28e772d6ba3d@25920@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2116-0'
00010000:00000001:5.0:1773851864.528625:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851864.528626:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851864.528627:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=96 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851864.528629:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851864.528630:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008727554c refcount 3 to 25920@kfi7
00000100:00000001:5.0:1773851864.528631:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580640 : -107154806970976 : ffff9e8b13cb65a0)
02000000:00000001:5.0:1773851864.528632:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851864.528633:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.528634:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851864.528636:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25985@kfi7
00000400:00000010:5.0:1773851864.528637:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001026dec5.
00000100:00000200:5.0:1773851864.528638:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859603570634880, offset 224
00000400:00000200:5.0:1773851864.528640:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25985@kfi7
00000400:00000200:5.0:1773851864.528641:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25985@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.528642:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016184834 nid 25985@kfi7 refs 1
00000400:00000200:5.0:1773851864.528644:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000016184834 nid 25985@kfi7 refs 2
00000400:00000200:5.0:1773851864.528645:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000016184834 nid 25985@kfi7 refs 3
00000400:00000200:5.0:1773851864.528647:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25985@kfi7 local destination
00000400:00000200:5.0:1773851864.528649:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769112:8769112:1024:4294967295] 25985@kfi7 LPNI seq info [10015588:10015588:16:4294967295]
00000400:00000200:5.0:1773851864.528652:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000016184834 nid 25985@kfi7 refs 2
00000400:00000200:5.0:1773851864.528653:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25985@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.528656:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25985@kfi7(25985@kfi7:25985@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851864.528658:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000016184834 nid 25985@kfi7 refs 3
00000800:00000200:5.0:1773851864.528660:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.528662:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851864.528665:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851864.528669:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x28e Using peer 25985@kfi7(0x28e)
00000800:00000200:5.0:1773851864.528674:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 324 bytes to peer 0x28e: rc=0
00000800:00000200:5.0:1773851864.528676:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x28e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851864.528679:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.528681:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008727554c refcount 2 to 25920@kfi7
00010000:00000001:5.0:1773851864.528682:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851864.528682:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.528683:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851864.528684:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ecf6637 x1859603570634880/t0(0) o400->936fe7ed-28d6-4295-9462-28e772d6ba3d@25920@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2116-0'
00000800:00000200:6.0:1773851864.528690:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x28e TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851864.528693:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851864.528695:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25985@kfi7: PUT: OK
00000100:00100000:5.0:1773851864.528695:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ecf6637 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:936fe7ed-28d6-4295-9462-28e772d6ba3d+5:39743:x1859603570634880:12345-25920@kfi7:400:default-tuolumne2116-0 Request processed in 100us (153us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851864.528696:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001026dec5
00000400:00000010:6.0:1773851864.528697:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001026dec5.
00000100:00000001:6.0:1773851864.528697:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851864.528698:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851864.528699:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000016184834 nid 25985@kfi7 refs 2
00000100:00100000:5.0:1773851864.528699:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25920@kfi7, seq: 2001904
00000100:00000040:5.0:1773851864.528700:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000d6a8ba8 : new rpc_count 0
00000100:00000001:5.0:1773851864.528701:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:6.0:1773851864.528702:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 25985@kfi7(000000000c5f034f):0x0 lsk 655 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x28e Transaction freed
00000100:00000001:5.0:1773851864.528702:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851864.528702:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.528703:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000020:00000010:5.0:1773851864.528705:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9b9985c.
00000020:00000040:5.0:1773851864.528706:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000000d6a8ba8 : new refcount 4
00000100:00000001:5.0:1773851864.528707:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851864.579651:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.579651:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851864.579652:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.579654:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851864.579657:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.579658:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23169@kfi7 : PUT - for me
00000400:00000200:17.0:1773851864.579659:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.579660:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 1
00000400:00000200:17.0:1773851864.579661:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.579661:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
00000400:00000200:17.0:1773851864.579662:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 3
00000400:00000200:17.0:1773851864.579663:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23105@kfi7 to cpt 0
00000400:00000200:17.0:1773851864.579664:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23105@kfi7 of length 224 into portal 12 MB=0x69b09504387c0
00000400:00000200:17.0:1773851864.579666:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23105@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 6520
00000800:00000200:17.0:1773851864.579668:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851864.579669:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.579670:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23169@kfi7: PUT: OK
00000100:00000001:17.0:1773851864.579671:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851864.579672:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851864.579673:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a44e8848.
00000100:00000040:17.0:1773851864.579673:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a44e8848 x1859314163877824 msgsize 224
00000100:00100000:17.0:1773851864.579675:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23105@kfi7 (source: 12345-23169@kfi7)
00000100:00000001:17.0:1773851864.579677:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851864.579677:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
00000800:00000200:17.0:1773851864.579679:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851864.579681:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851864.579682:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851864.579682:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851864.579683:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851864.579683:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851864.579684:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314163877824
00000020:00000001:17.0:1773851864.579685:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851864.579685:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d3b
00000020:00000001:17.0:1773851864.579686:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:18.0:1773851864.579688:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851864.579689:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000040:17.0:1773851864.579689:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008c8709eb refcount=6
00000020:00000001:17.0:1773851864.579689:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744161280 : -107128965390336 : ffff9e911812a000)
00000800:00000200:18.0:1773851864.579690:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:17.0:1773851864.579690:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744161280 : -107128965390336 : ffff9e911812a000)
00000100:00000001:17.0:1773851864.579691:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:18.0:1773851864.579692:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:17.0:1773851864.579692:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:18.0:1773851864.579694:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000020:00000010:17.0:1773851864.579694:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005aa634fd.
00000400:00000200:18.0:1773851864.579695:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23169@kfi7 : PUT - for me
00000020:00000010:17.0:1773851864.579695:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851864.579696:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000020:00000010:17.0:1773851864.579696:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851864.579697:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 1
00000100:00000001:17.0:1773851864.579697:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:18.0:1773851864.579698:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000400:00000200:18.0:1773851864.579698:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
00000100:00000001:17.0:1773851864.579698:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851864.579698:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851864.579699:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 3
00000100:00000001:17.0:1773851864.579699:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851864.579699:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851864.579700:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851864.579701:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23105@kfi7 to cpt 0
00000400:00000200:18.0:1773851864.579701:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23105@kfi7 of length 224 into portal 12 MB=0x69b0950438880
00000100:00000001:17.0:1773851864.579701:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851864.579702:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851864.579702:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851864.579702:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000400:00000200:18.0:1773851864.579703:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23105@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 6744
00000100:00100000:17.0:1773851864.579703:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23105@kfi7, seq: 2156306
00000100:00000001:16.0:1773851864.579703:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000800:00000200:18.0:1773851864.579704:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:17.0:1773851864.579704:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008c8709eb : new rpc_count 1
00000100:00000001:16.0:1773851864.579704:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.579705:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977764345984 : -107095945205632 : ffff9e98c83aa880)
00000100:00000001:16.0:1773851864.579705:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851864.579706:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:17.0:1773851864.579706:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a44e8848 x1859314163877824/t0(0) o400->d27db38f-1445-497b-a99c-681b3c563685@23105@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1940-0'
00000400:00000200:18.0:1773851864.579707:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23169@kfi7: PUT: OK
00000100:00000001:18.0:1773851864.579707:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851864.579708:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851864.579708:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fbf5742a.
00000100:00000040:18.0:1773851864.579709:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000fbf5742a x1859314163878016 msgsize 224
00000100:00000001:17.0:1773851864.579709:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851864.579709:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851864.579710:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a44e8848 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:d27db38f-1445-497b-a99c-681b3c563685+6:39864:x1859314163877824:12345-23105@kfi7:400:default-tuolumne1940-0
00000100:00100000:18.0:1773851864.579711:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-23105@kfi7 (source: 12345-23169@kfi7)
00000100:00000001:18.0:1773851864.579711:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851864.579712:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
00000100:00000200:17.0:1773851864.579712:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314163877824
00000020:00000001:17.0:1773851864.579712:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851864.579713:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851864.579713:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.579713:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851864.579713:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851864.579714:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000020:00000001:17.0:1773851864.579714:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:16.0:1773851864.579714:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851864.579714:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.579715:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851864.579715:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
02000000:00000001:16.0:1773851864.579715:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851864.579715:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314163878016
00000001:00000001:17.0:1773851864.579716:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314163877824, found 0 last_xid 1859314163877823
00000020:00000001:16.0:1773851864.579716:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851864.579716:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d57
00000020:00000001:17.0:1773851864.579717:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851864.579717:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:17.0:1773851864.579718:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851864.579718:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851864.579719:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851864.579719:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000020:00000040:16.0:1773851864.579719:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000aac9e0e0 refcount=6
00000100:00000001:17.0:1773851864.579720:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851864.579720:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000001:16.0:1773851864.579720:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744175616 : -107128965376000 : ffff9e911812d800)
02000000:00000010:17.0:1773851864.579721:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000495e8a01.
00000020:00000001:16.0:1773851864.579721:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744175616 : -107128965376000 : ffff9e911812d800)
00000100:00000001:16.0:1773851864.579721:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
02000000:00000001:17.0:1773851864.579722:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.579722:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:17.0:1773851864.579723:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:16.0:1773851864.579723:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069670ecd.
00000020:00000010:16.0:1773851864.579723:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000001:17.0:1773851864.579724:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:16.0:1773851864.579724:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000082cc22fe.
00010000:00000040:17.0:1773851864.579729:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314163877824
00000100:00000001:16.0:1773851864.579729:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851864.579729:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:17.0:1773851864.579730:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000100:00000001:16.0:1773851864.579730:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851864.579730:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00010000:00000200:17.0:1773851864.579731:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a44e8848 x1859314163877824/t0(0) o400->d27db38f-1445-497b-a99c-681b3c563685@23105@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1940-0'
00000100:00000001:16.0:1773851864.579731:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851864.579731:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:17.0:1773851864.579733:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:16.0:1773851864.579733:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:17.0:1773851864.579734:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.579734:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851864.579734:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00001000:17.0:1773851864.579735:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=97 v=315 (315 214 1 1)
00000100:00100000:16.0:1773851864.579735:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23105@kfi7, seq: 2156307
00000100:00000001:18.0:1773851864.579736:0:59124:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851864.579736:0:59124:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851864.579736:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851864.579736:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000aac9e0e0 : new rpc_count 1
00000100:00000001:18.0:1773851864.579737:0:59124:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851864.579737:0:59124:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851864.579737:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004fcc5744 refcount 5 to 23105@kfi7
00000100:00000001:17.0:1773851864.579737:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715818560 : -107155993733056 : ffff9e8acd0ed840)
00000100:00000001:16.0:1773851864.579737:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534666496 : -106946174885120 : ffff9ebba73c6300)
02000000:00000001:17.0:1773851864.579738:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851864.579739:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.579739:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851864.579739:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fbf5742a x1859314163878016/t0(0) o400->0edd99a4-db58-492f-8f03-c47294da31e6@23105@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1940-0'
00000100:00000040:17.0:1773851864.579740:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23169@kfi7
00000100:00000001:16.0:1773851864.579741:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851864.579742:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851864.579743:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fbf5742a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:0edd99a4-db58-492f-8f03-c47294da31e6+6:39867:x1859314163878016:12345-23105@kfi7:400:default-tuolumne1940-0
00000100:00000200:16.0:1773851864.579744:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314163878016
00000020:00000001:16.0:1773851864.579744:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851864.579745:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851864.579745:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.579746:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000010:17.0:1773851864.579747:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081e4cca7.
00000020:00000001:16.0:1773851864.579747:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851864.579747:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000100:00000200:17.0:1773851864.579748:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314163877824, offset 224
00000001:00000001:16.0:1773851864.579748:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314163878016, found 0 last_xid 1859314163878015
00000020:00000001:16.0:1773851864.579748:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851864.579749:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851864.579749:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:17.0:1773851864.579750:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23169@kfi7
00000400:00000200:17.0:1773851864.579750:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000020:00000001:16.0:1773851864.579750:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.579750:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000400:00000200:17.0:1773851864.579751:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 1
00000100:00000001:16.0:1773851864.579751:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851864.579751:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:17.0:1773851864.579752:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
02000000:00000010:16.0:1773851864.579752:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008a2235d5.
00000400:00000200:17.0:1773851864.579753:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 3
02000000:00000001:16.0:1773851864.579753:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.579753:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851864.579754:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23169@kfi7 local destination
00000020:00000001:16.0:1773851864.579754:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851864.579754:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044133732, transno 0, xid 1859314163878016
00010000:00000001:16.0:1773851864.579755:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000400:00000200:17.0:1773851864.579756:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769113:8769113:1024:4294967295] 23169@kfi7 LPNI seq info [71089:71089:16:4294967295]
00010000:00000200:16.0:1773851864.579756:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fbf5742a x1859314163878016/t0(0) o400->0edd99a4-db58-492f-8f03-c47294da31e6@23105@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1940-0'
00000400:00000200:17.0:1773851864.579757:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
00000400:00000200:17.0:1773851864.579758:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00010000:00000001:16.0:1773851864.579758:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851864.579759:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851864.579759:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=97 v=315 (315 214 1 1)
00000400:00000200:17.0:1773851864.579760:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23169@kfi7(23169@kfi7:23169@kfi7) <?> : PUT try# 0
00000100:00000001:16.0:1773851864.579760:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000400:00000200:17.0:1773851864.579761:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 3
00000100:00000040:16.0:1773851864.579761:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004fcc5744 refcount 6 to 23105@kfi7
00000800:00000200:17.0:1773851864.579762:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:16.0:1773851864.579762:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715818560 : -107155993733056 : ffff9e8acd0ed840)
00000800:00000200:17.0:1773851864.579763:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
02000000:00000001:16.0:1773851864.579763:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851864.579763:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.579764:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851864.579765:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23169@kfi7
00000400:00000010:16.0:1773851864.579765:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000493fb085.
00000100:00000200:16.0:1773851864.579766:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314163878016, offset 224
00000800:00000200:17.0:1773851864.579767:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:16.0:1773851864.579767:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23169@kfi7
00000400:00000200:16.0:1773851864.579768:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000800:00000200:17.0:1773851864.579769:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x112f Using peer 23169@kfi7(0x112f)
00000400:00000200:16.0:1773851864.579769:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
00000400:00000200:16.0:1773851864.579770:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 3
00000400:00000200:16.0:1773851864.579771:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 4
00000400:00000200:16.0:1773851864.579772:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23169@kfi7 local destination
00000800:00000200:17.0:1773851864.579773:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x112f: rc=0
00000400:00000200:16.0:1773851864.579773:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769114:8769114:1024:4294967295] 23169@kfi7 LPNI seq info [71090:71090:15:4294967295]
00000800:00000200:17.0:1773851864.579774:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x112f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:16.0:1773851864.579774:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 3
00000400:00000200:16.0:1773851864.579775:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23169@kfi7 to cpt 4
00000100:00000001:17.0:1773851864.579776:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851864.579777:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004fcc5744 refcount 5 to 23105@kfi7
00010000:00000001:17.0:1773851864.579778:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851864.579778:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:16.0:1773851864.579778:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23169@kfi7(23169@kfi7:23169@kfi7) <?> : PUT try# 0
00000020:00000001:17.0:1773851864.579779:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000400:00000200:16.0:1773851864.579779:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 4
00000100:00000040:17.0:1773851864.579780:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a44e8848 x1859314163877824/t0(0) o400->d27db38f-1445-497b-a99c-681b3c563685@23105@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1940-0'
00000800:00000200:16.0:1773851864.579780:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000100:00100000:17.0:1773851864.579783:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a44e8848 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:d27db38f-1445-497b-a99c-681b3c563685+6:39864:x1859314163877824:12345-23105@kfi7:400:default-tuolumne1940-0 Request processed in 73us (108us total) trans 0 rc 0/0
00000800:00000200:16.0:1773851864.579783:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00100000:17.0:1773851864.579785:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23105@kfi7, seq: 2156306
00000100:00000040:17.0:1773851864.579786:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008c8709eb : new rpc_count 0
00000100:00000001:17.0:1773851864.579786:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851864.579787:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851864.579788:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851864.579789:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000800:00000200:16.0:1773851864.579789:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:18.0:1773851864.579790:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x112f TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851864.579790:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005aa634fd.
00000020:00000040:17.0:1773851864.579790:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000008c8709eb : new refcount 5
00000400:00000200:18.0:1773851864.579791:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851864.579791:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:16.0:1773851864.579791:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001117 Using peer 23169@kfi7(0x100000000001117)
00000400:00000200:18.0:1773851864.579792:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23169@kfi7: PUT: OK
00000400:00000200:18.0:1773851864.579793:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081e4cca7
00000400:00000010:18.0:1773851864.579793:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081e4cca7.
00000100:00000001:18.0:1773851864.579794:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851864.579795:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851864.579795:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 3
00000800:00000200:16.0:1773851864.579795:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x100000000001117: rc=0
00000800:00000200:16.0:1773851864.579796:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001117 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:18.0:1773851864.579797:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 23169@kfi7(00000000fda3db4b):0x0 lsk 4400 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x112f Transaction freed
00000100:00000001:16.0:1773851864.579798:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851864.579800:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004fcc5744 refcount 4 to 23105@kfi7
00010000:00000001:16.0:1773851864.579800:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851864.579801:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.579801:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851864.579802:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fbf5742a x1859314163878016/t0(0) o400->0edd99a4-db58-492f-8f03-c47294da31e6@23105@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1940-0'
00000100:00100000:16.0:1773851864.579806:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fbf5742a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:0edd99a4-db58-492f-8f03-c47294da31e6+6:39867:x1859314163878016:12345-23105@kfi7:400:default-tuolumne1940-0 Request processed in 64us (96us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851864.579809:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23105@kfi7, seq: 2156307
00000100:00000040:16.0:1773851864.579809:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000aac9e0e0 : new rpc_count 0
00000100:00000001:16.0:1773851864.579810:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851864.579810:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851864.579811:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851864.579812:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000082cc22fe.
00000020:00000010:16.0:1773851864.579812:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069670ecd.
00000020:00000040:16.0:1773851864.579813:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000aac9e0e0 : new refcount 5
00000100:00000001:16.0:1773851864.579814:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851864.579818:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001117 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851864.579820:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.579822:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23169@kfi7: PUT: OK
00000400:00000200:17.0:1773851864.579822:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000493fb085
00000400:00000010:17.0:1773851864.579824:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000493fb085.
00000100:00000001:17.0:1773851864.579825:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851864.579825:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851864.579826:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf91d4e7 nid 23169@kfi7 refs 2
00000800:00000200:17.0:1773851864.579828:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23169@kfi7(000000001c669e51):0x0 lsk 4376 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001117 Transaction freed
00000800:00000200:5.0:1773851864.589946:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.589947:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851864.589948:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851864.589950:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851864.589952:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.589953:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25595@kfi7 : PUT - for me
00000400:00000200:5.0:1773851864.589954:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.589955:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 1
00000400:00000200:5.0:1773851864.589956:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.589956:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000400:00000200:5.0:1773851864.589957:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 3
00000400:00000200:5.0:1773851864.589958:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.589959:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25595@kfi7 of length 224 into portal 12 MB=0x699df74098580
00000400:00000200:5.0:1773851864.589960:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25595@kfi7 of length 224/224 into md 0x793926dc5 [64] + 132536
00000800:00000200:5.0:1773851864.589961:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851864.589963:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.589965:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25595@kfi7: PUT: OK
00000100:00000001:5.0:1773851864.589965:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851864.589966:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851864.589967:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d6522c78.
00000100:00000040:5.0:1773851864.589968:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d6522c78 x1858034863801728 msgsize 224
00000100:00100000:5.0:1773851864.589969:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25595@kfi7 (source: 12345-25595@kfi7)
00000100:00000001:5.0:1773851864.589971:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851864.589972:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000800:00000200:5.0:1773851864.589973:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851864.589976:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851864.589976:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851864.589977:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851864.589977:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.589978:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851864.589979:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858034863801728
00000020:00000001:5.0:1773851864.589979:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851864.589980:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9119d
00000020:00000001:5.0:1773851864.589981:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851864.589984:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffb0feb1 refcount=6
00000020:00000001:5.0:1773851864.589984:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240540160 : -107152469011456 : ffff9e8b9f25d400)
00000020:00000001:5.0:1773851864.589985:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240540160 : -107152469011456 : ffff9e8b9f25d400)
00000100:00000001:5.0:1773851864.589986:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.589987:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851864.589988:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9b9985c.
00000020:00000010:5.0:1773851864.589989:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.589989:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851864.589990:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851864.589991:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851864.589991:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.589992:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851864.589992:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851864.589993:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.589994:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851864.589995:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851864.589995:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.589996:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851864.589996:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851864.589997:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25595@kfi7, seq: 2001905
00000100:00000040:5.0:1773851864.589997:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffb0feb1 : new rpc_count 1
00000100:00000001:7.0:1773851864.589998:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.589998:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.589998:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886766976 : -106955822784640 : ffff9eb9682d1f80)
00000100:00000040:5.0:1773851864.589999:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d6522c78 x1858034863801728/t0(0) o400->5d1041e6-7769-4592-bdd6-76a96d044f83@25595@kfi7:81/0 lens 224/0 e 0 to 0 dl 1773852196 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne268-0'
00000100:00000001:5.0:1773851864.590002:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.590002:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851864.590003:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d6522c78 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5d1041e6-7769-4592-bdd6-76a96d044f83+6:41975:x1858034863801728:12345-25595@kfi7:400:default-tuolumne268-0
00000100:00000200:5.0:1773851864.590005:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858034863801728
00000020:00000001:5.0:1773851864.590005:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851864.590006:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851864.590007:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.590008:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851864.590008:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851864.590009:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851864.590009:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858034863801728, found 0 last_xid 1858034863801727
00000020:00000001:5.0:1773851864.590011:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851864.590011:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851864.590012:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851864.590012:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.590013:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851864.590014:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851864.590014:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851864.590015:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000046878ef4.
02000000:00000001:5.0:1773851864.590016:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.590016:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.590017:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851864.590018:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768351, transno 0, xid 1858034863801728
00010000:00000001:5.0:1773851864.590018:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851864.590019:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d6522c78 x1858034863801728/t0(0) o400->5d1041e6-7769-4592-bdd6-76a96d044f83@25595@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne268-0'
00010000:00000001:5.0:1773851864.590022:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851864.590023:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851864.590024:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=96 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851864.590025:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851864.590025:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000be4a1a4d refcount 5 to 25595@kfi7
00000100:00000001:5.0:1773851864.590026:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931325661760 : -107142383889856 : ffff9e8df8449240)
02000000:00000001:5.0:1773851864.590027:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851864.590027:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.590028:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851864.590029:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25595@kfi7
00000400:00000010:5.0:1773851864.590030:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000046728b3e.
00000100:00000200:5.0:1773851864.590030:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858034863801728, offset 224
00000400:00000200:5.0:1773851864.590032:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25595@kfi7
00000400:00000200:5.0:1773851864.590033:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.590033:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 1
00000400:00000200:5.0:1773851864.590034:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000400:00000200:5.0:1773851864.590035:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 3
00000400:00000200:5.0:1773851864.590037:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25595@kfi7 local destination
00000400:00000200:5.0:1773851864.590038:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769115:8769115:1024:4294967295] 25595@kfi7 LPNI seq info [28051:28051:16:4294967295]
00000400:00000200:5.0:1773851864.590039:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000400:00000200:5.0:1773851864.590040:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.590042:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25595@kfi7(25595@kfi7:25595@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851864.590043:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 3
00000800:00000200:5.0:1773851864.590044:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.590045:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851864.590047:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851864.590049:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004dd Using peer 25595@kfi7(0x1000000000004dd)
00000800:00000200:5.0:1773851864.590052:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 324 bytes to peer 0x1000000000004dd: rc=0
00000800:00000200:5.0:1773851864.590054:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004dd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851864.590056:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.590057:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000be4a1a4d refcount 4 to 25595@kfi7
00010000:00000001:5.0:1773851864.590058:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851864.590058:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.590059:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851864.590060:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d6522c78 x1858034863801728/t0(0) o400->5d1041e6-7769-4592-bdd6-76a96d044f83@25595@kfi7:81/0 lens 224/224 e 0 to 0 dl 1773852196 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne268-0'
00000100:00100000:5.0:1773851864.590063:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d6522c78 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5d1041e6-7769-4592-bdd6-76a96d044f83+6:41975:x1858034863801728:12345-25595@kfi7:400:default-tuolumne268-0 Request processed in 60us (94us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851864.590065:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25595@kfi7, seq: 2001905
00000100:00000040:5.0:1773851864.590065:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffb0feb1 : new rpc_count 0
00000800:00000200:6.0:1773851864.590066:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004dd TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851864.590066:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851864.590067:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851864.590067:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851864.590068:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851864.590068:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000400:00000200:6.0:1773851864.590069:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25595@kfi7: PUT: OK
00000020:00000010:5.0:1773851864.590069:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9b9985c.
00000020:00000040:5.0:1773851864.590069:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000ffb0feb1 : new refcount 5
00000400:00000200:6.0:1773851864.590070:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000046728b3e
00000400:00000010:6.0:1773851864.590070:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000046728b3e.
00000100:00000001:5.0:1773851864.590070:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851864.590071:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851864.590071:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851864.590072:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000800:00000200:6.0:1773851864.590074:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 25595@kfi7(00000000b9d66c22):0x0 lsk 1246 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004dd Transaction freed
00000800:00000200:17.0:1773851864.622254:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.622255:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851864.622256:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.622258:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851864.622260:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8576@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.622261:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8576@kfi7 : PUT - for me
00000400:00000200:17.0:1773851864.622262:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8576@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.622263:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bbe498f nid 8576@kfi7 refs 1
00000400:00000200:17.0:1773851864.622265:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8576@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.622265:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bbe498f nid 8576@kfi7 refs 2
00000400:00000200:17.0:1773851864.622266:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004bbe498f nid 8576@kfi7 refs 3
00000400:00000200:17.0:1773851864.622267:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8512@kfi7 to cpt 0
00000400:00000200:17.0:1773851864.622268:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8512@kfi7 of length 224 into portal 12 MB=0x69b96006a2340
00000400:00000200:17.0:1773851864.622269:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8512@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 6968
00000800:00000200:17.0:1773851864.622271:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851864.622273:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.622274:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8576@kfi7: PUT: OK
00000100:00000001:17.0:1773851864.622275:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851864.622275:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851864.622277:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000081212c9.
00000100:00000040:17.0:1773851864.622277:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000081212c9 x1859918414619456 msgsize 224
00000100:00100000:17.0:1773851864.622279:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8512@kfi7 (source: 12345-8576@kfi7)
00000100:00000001:17.0:1773851864.622280:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:16.0:1773851864.622281:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851864.622282:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851864.622282:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851864.622283:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851864.622284:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004bbe498f nid 8576@kfi7 refs 2
02000000:00000001:16.0:1773851864.622284:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851864.622284:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859918414619456
00000800:00000200:17.0:1773851864.622285:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000020:00000001:16.0:1773851864.622285:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851864.622285:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b6e30c9bf
00000020:00000001:16.0:1773851864.622286:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851864.622289:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000035defd71 refcount=9
00000020:00000001:16.0:1773851864.622289:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637059031891968 : -107014677659648 : ffff9eabb4270000)
00000020:00000001:16.0:1773851864.622290:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637059031891968 : -107014677659648 : ffff9eabb4270000)
00000100:00000001:16.0:1773851864.622291:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851864.622292:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851864.622293:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d3b15942.
00000020:00000010:16.0:1773851864.622294:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851864.622296:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000082cc22fe.
00000100:00000001:16.0:1773851864.622296:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851864.622297:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851864.622297:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851864.622298:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851864.622299:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851864.622299:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.622300:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851864.622301:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851864.622301:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851864.622302:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851864.622302:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851864.622303:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8512@kfi7, seq: 2156308
00000100:00000001:17.0:1773851864.622304:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851864.622304:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851864.622304:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000035defd71 : new rpc_count 2
00000100:00000001:16.0:1773851864.622304:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637118842708992 : -106954866842624 : ffff9eb9a127a400)
00000100:00000040:16.0:1773851864.622305:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000081212c9 x1859918414619456/t0(0) o400->f71d6347-d17b-4175-91ba-fe9fc5ec9478@8512@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1028-0'
00000100:00000001:16.0:1773851864.622308:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851864.622309:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851864.622310:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000081212c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f71d6347-d17b-4175-91ba-fe9fc5ec9478+9:40161:x1859918414619456:12345-8512@kfi7:400:default-tuolumne1028-0
00000100:00000200:16.0:1773851864.622311:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859918414619456
00000020:00000001:16.0:1773851864.622312:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851864.622313:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851864.622313:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.622314:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851864.622315:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851864.622315:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851864.622316:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859918414619456, found 0 last_xid 1859918414308671
00000020:00000001:16.0:1773851864.622317:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851864.622317:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851864.622318:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851864.622318:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.622319:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851864.622320:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851864.622320:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851864.622321:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000069670ecd.
02000000:00000001:16.0:1773851864.622322:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.622322:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.622323:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851864.622324:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183107437015, transno 0, xid 1859918414619456
00010000:00000001:16.0:1773851864.622324:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851864.622325:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000081212c9 x1859918414619456/t0(0) o400->f71d6347-d17b-4175-91ba-fe9fc5ec9478@8512@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1028-0'
00010000:00000001:16.0:1773851864.622328:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851864.622328:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851864.622329:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=97 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851864.622330:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851864.622331:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000092b9c6f4 refcount 3 to 8512@kfi7
00000100:00000001:16.0:1773851864.622332:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637111849848000 : -106961859703616 : ffff9eb800590cc0)
02000000:00000001:16.0:1773851864.622332:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851864.622333:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.622334:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851864.622334:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8576@kfi7
00000400:00000010:16.0:1773851864.622335:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000090de02a.
00000100:00000200:16.0:1773851864.622336:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859918414619456, offset 224
00000400:00000200:16.0:1773851864.622337:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8576@kfi7
00000400:00000200:16.0:1773851864.622338:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8576@kfi7 to cpt 4
00000400:00000200:16.0:1773851864.622339:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bbe498f nid 8576@kfi7 refs 1
00000400:00000200:16.0:1773851864.622340:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004bbe498f nid 8576@kfi7 refs 2
00000400:00000200:16.0:1773851864.622341:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004bbe498f nid 8576@kfi7 refs 3
00000400:00000200:16.0:1773851864.622342:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8576@kfi7 local destination
00000400:00000200:16.0:1773851864.622344:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769116:8769116:1024:4294967295] 8576@kfi7 LPNI seq info [1949686:1949686:16:4294967295]
00000400:00000200:16.0:1773851864.622345:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004bbe498f nid 8576@kfi7 refs 2
00000400:00000200:16.0:1773851864.622346:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8576@kfi7 to cpt 4
00000400:00000200:16.0:1773851864.622348:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8576@kfi7(8576@kfi7:8576@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851864.622349:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004bbe498f nid 8576@kfi7 refs 3
00000800:00000200:16.0:1773851864.622352:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851864.622354:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851864.622355:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851864.622357:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1261 Using peer 8576@kfi7(0x1261)
00000800:00000200:16.0:1773851864.622360:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x1261: rc=0
00000800:00000200:16.0:1773851864.622362:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1261 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851864.622364:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851864.622365:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000092b9c6f4 refcount 2 to 8512@kfi7
00010000:00000001:16.0:1773851864.622365:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851864.622366:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.622367:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851864.622367:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000081212c9 x1859918414619456/t0(0) o400->f71d6347-d17b-4175-91ba-fe9fc5ec9478@8512@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1028-0'
00000100:00100000:16.0:1773851864.622372:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000081212c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f71d6347-d17b-4175-91ba-fe9fc5ec9478+9:40161:x1859918414619456:12345-8512@kfi7:400:default-tuolumne1028-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851864.622374:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8512@kfi7, seq: 2156308
00000100:00000040:16.0:1773851864.622375:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000035defd71 : new rpc_count 1
00000100:00000001:16.0:1773851864.622375:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851864.622376:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851864.622377:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851864.622377:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000082cc22fe.
00000020:00000010:16.0:1773851864.622378:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d3b15942.
00000020:00000040:16.0:1773851864.622379:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000035defd71 : new refcount 8
00000100:00000001:16.0:1773851864.622379:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851864.622384:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1261 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851864.622386:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.622387:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8576@kfi7: PUT: OK
00000400:00000200:17.0:1773851864.622388:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000090de02a
00000400:00000010:17.0:1773851864.622388:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000090de02a.
00000100:00000001:17.0:1773851864.622389:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851864.622389:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851864.622390:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004bbe498f nid 8576@kfi7 refs 2
00000800:00000200:17.0:1773851864.622392:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8576@kfi7(00000000e807ae88):0x0 lsk 4706 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1261 Transaction freed
00000800:00000200:21.0:1773851864.637152:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851864.637153:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851864.637153:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851864.637154:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851864.637155:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851864.637156:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000389ce1b3: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851864.637159:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 23041@kfi7(00000000846b9ed2):0x5f4 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851864.637160:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000389ce1b3: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851864.637161:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 Using peer 23041@kfi7(0x1000000000005f4)
00000400:00000200:22.0:1773851864.637163:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23041@kfi7 to cpt 5
00000400:00000200:21.0:1773851864.637164:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23041@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.637165:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23041@kfi7 : PUT - for me
00000400:00000200:22.0:1773851864.637167:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23041@kfi7 to cpt 5
00000800:00000200:21.0:1773851864.637167:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0x1000000000005f4: rc=0
00000400:00000200:22.0:1773851864.637169:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000047f5aedb nid 23041@kfi7 refs 1
00000800:00000200:21.0:1773851864.637170:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851864.637171:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23041@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.637172:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000047f5aedb nid 23041@kfi7 refs 2
00000400:00000200:22.0:1773851864.637173:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000047f5aedb nid 23041@kfi7 refs 3
00000400:00000200:22.0:1773851864.637175:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23232@kfi7 to cpt 4
00000400:00000200:22.0:1773851864.637176:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23232@kfi7 of length 224 into portal 12 MB=0x699e0abde4600
00000400:00000200:22.0:1773851864.637178:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23232@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 34152
00000800:00000200:21.0:1773851864.637182:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 TN_EVENT_TX_OK event status 0
00000800:00000200:22.0:1773851864.637183:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000389ce1b3: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851864.637185:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851864.637186:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 Transaction freed
00000400:00000200:22.0:1773851864.637187:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23041@kfi7: PUT: OK
00000100:00000001:22.0:1773851864.637189:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851864.637190:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851864.637191:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000081e9d487.
00000100:00000040:22.0:1773851864.637192:0:2456945:0:(events.c:358:request_in_callback()) incoming req@0000000081e9d487 x1858040095458816 msgsize 224
00000100:00100000:22.0:1773851864.637195:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-23232@kfi7 (source: 12345-23041@kfi7)
00000100:00000001:22.0:1773851864.637197:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851864.637199:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000047f5aedb nid 23041@kfi7 refs 2
00000800:00000200:22.0:1773851864.637201:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000389ce1b3: 2054@kfi7:5 <- 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851864.637206:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851864.637207:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851864.637208:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851864.637208:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851864.637209:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851864.637211:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040095458816
00000020:00000001:22.0:1773851864.637212:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851864.637212:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b2e
00000020:00000001:22.0:1773851864.637213:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851864.637217:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000023271f48 refcount=6
00000020:00000001:22.0:1773851864.637218:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743672832 : -107128965878784 : ffff9e91180b2c00)
00000020:00000001:22.0:1773851864.637219:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743672832 : -107128965878784 : ffff9e91180b2c00)
00000100:00000001:22.0:1773851864.637220:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.637221:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851864.637222:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000da424327.
00000020:00000010:22.0:1773851864.637224:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851864.637225:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851864.637226:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851864.637227:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851864.637228:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851864.637229:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851864.637230:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851864.637231:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.637232:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851864.637234:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851864.637235:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851864.637236:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851864.637237:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851864.637237:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23232@kfi7, seq: 1997968
00000100:00000001:23.0:1773851864.637238:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.637238:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000023271f48 : new rpc_count 1
00000100:00000001:22.0:1773851864.637239:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619608192 : -107003089943424 : ffff9eae66d58480)
00000100:00000001:23.0:1773851864.637241:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.637241:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000081e9d487 x1858040095458816/t0(0) o400->8e142f8d-5550-4aaa-b9db-3530f4267472@23232@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1939-0'
00000100:00000001:22.0:1773851864.637245:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851864.637246:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851864.637247:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000081e9d487 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:8e142f8d-5550-4aaa-b9db-3530f4267472+6:39690:x1858040095458816:12345-23232@kfi7:400:default-tuolumne1939-0
00000100:00000200:22.0:1773851864.637249:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040095458816
00000020:00000001:22.0:1773851864.637250:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851864.637251:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851864.637252:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.637253:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851864.637253:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851864.637255:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851864.637255:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040095458816, found 0 last_xid 1858040095458815
00000020:00000001:22.0:1773851864.637257:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851864.637258:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851864.637258:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851864.637259:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.637260:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851864.637261:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851864.637262:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851864.637265:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d40e35ba.
02000000:00000001:22.0:1773851864.637266:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.637267:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.637268:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851864.637269:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044144078, transno 0, xid 1858040095458816
00010000:00000001:22.0:1773851864.637271:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851864.637272:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000081e9d487 x1858040095458816/t0(0) o400->8e142f8d-5550-4aaa-b9db-3530f4267472@23232@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1939-0'
00010000:00000001:22.0:1773851864.637276:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851864.637277:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851864.637278:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=97 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851864.637279:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851864.637280:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009747d814 refcount 3 to 23232@kfi7
00000100:00000001:22.0:1773851864.637282:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332992 : -107155408218624 : ffff9e8aeff51600)
02000000:00000001:22.0:1773851864.637283:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851864.637284:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851864.637285:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851864.637286:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23041@kfi7
00000400:00000010:22.0:1773851864.637287:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032962c0f.
00000100:00000200:22.0:1773851864.637288:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040095458816, offset 224
00000400:00000200:22.0:1773851864.637290:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23041@kfi7
00000400:00000200:22.0:1773851864.637291:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23041@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.637292:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000047f5aedb nid 23041@kfi7 refs 1
00000400:00000200:22.0:1773851864.637294:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000047f5aedb nid 23041@kfi7 refs 2
00000400:00000200:22.0:1773851864.637295:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000047f5aedb nid 23041@kfi7 refs 3
00000400:00000200:22.0:1773851864.637297:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23041@kfi7 local destination
00000400:00000200:22.0:1773851864.637299:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769117:8769117:1024:4294967295] 23041@kfi7 LPNI seq info [217878:217878:16:4294967295]
00000400:00000200:22.0:1773851864.637301:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000047f5aedb nid 23041@kfi7 refs 2
00000400:00000200:22.0:1773851864.637302:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23041@kfi7 to cpt 5
00000400:00000200:22.0:1773851864.637306:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23041@kfi7(23041@kfi7:23041@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851864.637308:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000047f5aedb nid 23041@kfi7 refs 3
00000800:00000200:22.0:1773851864.637309:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851864.637311:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851864.637314:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851864.637320:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 Using peer 23041@kfi7(0x1000000000005f4)
00000800:00000200:22.0:1773851864.637325:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000389ce1b3: Posted send of 324 bytes to peer 0x1000000000005f4: rc=0
00000800:00000200:22.0:1773851864.637327:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851864.637330:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851864.637332:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009747d814 refcount 2 to 23232@kfi7
00010000:00000001:22.0:1773851864.637333:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851864.637333:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851864.637334:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851864.637336:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000081e9d487 x1858040095458816/t0(0) o400->8e142f8d-5550-4aaa-b9db-3530f4267472@23232@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1939-0'
00000100:00100000:22.0:1773851864.637340:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000081e9d487 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:8e142f8d-5550-4aaa-b9db-3530f4267472+6:39690:x1858040095458816:12345-23232@kfi7:400:default-tuolumne1939-0 Request processed in 94us (147us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851864.637340:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851864.637342:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:22.0:1773851864.637344:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23232@kfi7, seq: 1997968
00000400:00000200:21.0:1773851864.637344:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23041@kfi7: PUT: OK
00000100:00000040:22.0:1773851864.637345:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000023271f48 : new rpc_count 0
00000100:00000001:22.0:1773851864.637346:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851864.637346:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032962c0f
00000400:00000010:21.0:1773851864.637346:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032962c0f.
00000100:00000001:22.0:1773851864.637347:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851864.637348:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000100:00000001:21.0:1773851864.637348:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851864.637348:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851864.637349:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851864.637349:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000047f5aedb nid 23041@kfi7 refs 2
00000020:00000010:22.0:1773851864.637350:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000da424327.
00000020:00000040:22.0:1773851864.637351:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000023271f48 : new refcount 5
00000800:00000200:21.0:1773851864.637351:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 23041@kfi7(00000000846b9ed2):0x0 lsk 1525 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000005f4 Transaction freed
00000100:00000001:22.0:1773851864.637352:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851864.652333:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.652335:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851864.652337:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851864.652340:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851864.652344:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.652346:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.26@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851864.652348:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.652349:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851864.652352:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.26@o2ib60 to cpt 3
00000400:00000200:9.0:1773851864.652354:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de451981 nid 192.168.128.26@o2ib60 refs 2
00000400:00000200:9.0:1773851864.652356:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de451981 nid 192.168.128.26@o2ib60 refs 3
00000400:00000200:9.0:1773851864.652358:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.26@o2ib60 to cpt 3
00000400:00000200:9.0:1773851864.652361:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.26@o2ib60 of length 224 into portal 12 MB=0x69b22d67baf80
00000400:00000200:9.0:1773851864.652364:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.26@o2ib60 of length 224/224 into md 0x82a36e8ed [64] + 25992
00000800:00000200:9.0:1773851864.652368:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.652371:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851864.652373:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851864.652374:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851864.652375:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851864.652377:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bb5a744e.
00000100:00000040:9.0:1773851864.652378:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000bb5a744e x1859423789887360 msgsize 224
00000100:00100000:9.0:1773851864.652381:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.26@o2ib60 (source: 12345-192.168.128.26@o2ib60)
00000100:00000001:9.0:1773851864.652384:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851864.652386:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:15.0:1773851864.652388:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851864.652388:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851864.652389:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851864.652390:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851864.652391:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851864.652393:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851864.652394:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859423789887360
00000020:00000001:15.0:1773851864.652395:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851864.652396:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2cee37
00000020:00000001:15.0:1773851864.652397:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851864.652400:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e7548f6d refcount=5
00000020:00000001:15.0:1773851864.652401:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637078820705280 : -106994888846336 : ffff9eb04fa85400)
00000020:00000001:15.0:1773851864.652402:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637078820705280 : -106994888846336 : ffff9eb04fa85400)
00000100:00000001:15.0:1773851864.652404:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851864.652405:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851864.652406:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002b762ff1.
00000020:00000010:15.0:1773851864.652408:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851864.652409:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851864.652411:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851864.652412:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851864.652413:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851864.652415:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851864.652416:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851864.652416:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.652418:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851864.652421:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851864.652422:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851864.652422:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851864.652423:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851864.652425:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.26@o2ib60, seq: 2289822
00000100:00000040:15.0:1773851864.652426:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e7548f6d : new rpc_count 1
00000100:00000001:13.0:1773851864.652426:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.652427:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922893568 : -107141786658048 : ffff9e8e1bdd9b00)
00000100:00000001:13.0:1773851864.652427:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851864.652429:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bb5a744e x1859423789887360/t0(0) o400->415ba80d-8442-4a60-aad7-55812cfd0c5e@192.168.128.26@o2ib60:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix26-0'
00000100:00000001:15.0:1773851864.652434:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851864.652435:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851864.652437:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb5a744e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:415ba80d-8442-4a60-aad7-55812cfd0c5e+5:39998:x1859423789887360:12345-192.168.128.26@o2ib60:400:default-matrix26-0
00000100:00000200:15.0:1773851864.652439:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859423789887360
00000020:00000001:15.0:1773851864.652440:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851864.652442:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851864.652443:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.652444:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851864.652444:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851864.652446:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851864.652447:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859423789887360, found 0 last_xid 1859423789887359
00000020:00000001:15.0:1773851864.652448:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851864.652449:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851864.652450:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851864.652451:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.652452:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851864.652453:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851864.652454:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851864.652455:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b55ca958.
02000000:00000001:15.0:1773851864.652456:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.652457:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.652458:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851864.652460:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182562244951, transno 0, xid 1859423789887360
00010000:00000001:15.0:1773851864.652461:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851864.652463:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bb5a744e x1859423789887360/t0(0) o400->415ba80d-8442-4a60-aad7-55812cfd0c5e@192.168.128.26@o2ib60:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix26-0'
00010000:00000001:15.0:1773851864.652471:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851864.652472:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851864.652474:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=97 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851864.652476:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851864.652477:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003ee6a44e refcount 3 to 192.168.128.26@o2ib60
00000100:00000001:15.0:1773851864.652479:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298784 : -107155980252832 : ffff9e8acddc8960)
02000000:00000001:15.0:1773851864.652480:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851864.652481:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.652482:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851864.652484:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.26@o2ib60
00000400:00000010:15.0:1773851864.652485:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022f323c7.
00000100:00000200:15.0:1773851864.652486:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859423789887360, offset 224
00000400:00000200:15.0:1773851864.652489:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.26@o2ib60
00000400:00000200:15.0:1773851864.652491:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.26@o2ib60 to cpt 3
00000400:00000200:15.0:1773851864.652493:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de451981 nid 192.168.128.26@o2ib60 refs 2
00000400:00000200:15.0:1773851864.652495:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de451981 nid 192.168.128.26@o2ib60 refs 3
00000400:00000200:15.0:1773851864.652498:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de451981 nid 192.168.128.26@o2ib60 refs 4
00000400:00000200:15.0:1773851864.652500:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.26@o2ib60 routed destination
00000400:00000200:15.0:1773851864.652502:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851864.652504:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:15.0:1773851864.652507:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.26@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851864.652509:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851864.652511:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.26@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851864.652512:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851864.652514:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769118:8769118:1024:4294967295] 2094@kfi7 LPNI seq info [1258746987:1258746987:16:4294967295]
00000400:00000200:15.0:1773851864.652517:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:15.0:1773851864.652518:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:15.0:1773851864.652522:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.26@o2ib60(192.168.128.26@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851864.652525:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de451981 nid 192.168.128.26@o2ib60 refs 3
00000800:00000200:15.0:1773851864.652528:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851864.652531:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851864.652534:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851864.652538:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:15.0:1773851864.652543:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:15.0:1773851864.652545:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851864.652549:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851864.652550:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003ee6a44e refcount 2 to 192.168.128.26@o2ib60
00010000:00000001:15.0:1773851864.652552:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851864.652552:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.652554:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851864.652555:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bb5a744e x1859423789887360/t0(0) o400->415ba80d-8442-4a60-aad7-55812cfd0c5e@192.168.128.26@o2ib60:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix26-0'
00000800:00000200:13.0:1773851864.652559:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851864.652562:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb5a744e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:415ba80d-8442-4a60-aad7-55812cfd0c5e+5:39998:x1859423789887360:12345-192.168.128.26@o2ib60:400:default-matrix26-0 Request processed in 126us (182us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851864.652562:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851864.652564:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00100000:15.0:1773851864.652566:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.26@o2ib60, seq: 2289822
00000400:00000200:13.0:1773851864.652566:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022f323c7
00000100:00000040:15.0:1773851864.652567:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e7548f6d : new rpc_count 0
00000400:00000010:13.0:1773851864.652567:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022f323c7.
00000100:00000001:15.0:1773851864.652568:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851864.652569:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:13.0:1773851864.652569:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851864.652570:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000100:00000001:13.0:1773851864.652570:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851864.652571:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000400:00000200:13.0:1773851864.652572:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:15.0:1773851864.652573:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002b762ff1.
00000020:00000040:15.0:1773851864.652574:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000e7548f6d : new refcount 4
00000800:00000200:13.0:1773851864.652574:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00000100:00000001:15.0:1773851864.652575:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851864.661626:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.661627:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851864.661629:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851864.661633:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851864.661637:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25729@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.661639:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25729@kfi7 : PUT - for me
00000400:00000200:9.0:1773851864.661641:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25729@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.661642:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021e73b0d nid 25729@kfi7 refs 1
00000400:00000200:9.0:1773851864.661644:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25729@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.661645:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021e73b0d nid 25729@kfi7 refs 2
00000400:00000200:9.0:1773851864.661647:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021e73b0d nid 25729@kfi7 refs 3
00000400:00000200:9.0:1773851864.661648:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000400:00000200:9.0:1773851864.661650:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25665@kfi7 of length 224 into portal 12 MB=0x699e0ecf1f280
00000400:00000200:9.0:1773851864.661652:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25665@kfi7 of length 224/224 into md 0x78146ce49 [64] + 133296
00000800:00000200:9.0:1773851864.661656:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.661659:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851864.661662:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25729@kfi7: PUT: OK
00000100:00000001:9.0:1773851864.661663:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851864.661664:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851864.661665:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c58f9a30.
00000100:00000040:9.0:1773851864.661666:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c58f9a30 x1858041187267200 msgsize 224
00000100:00100000:9.0:1773851864.661669:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-25665@kfi7 (source: 12345-25729@kfi7)
00000100:00000001:9.0:1773851864.661671:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851864.661672:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021e73b0d nid 25729@kfi7 refs 2
00000800:00000200:9.0:1773851864.661675:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851864.661680:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851864.661681:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851864.661681:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851864.661682:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851864.661684:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851864.661685:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041187267200
00000020:00000001:9.0:1773851864.661687:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851864.661687:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a6b
00000020:00000001:9.0:1773851864.661688:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851864.661692:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000abf47023 refcount=6
00000020:00000001:9.0:1773851864.661693:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627751936 : -107123081799680 : ffff9e9276c31800)
00000020:00000001:9.0:1773851864.661694:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627751936 : -107123081799680 : ffff9e9276c31800)
00000100:00000001:9.0:1773851864.661696:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.661697:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851864.661699:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851864.661700:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851864.661702:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851864.661703:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851864.661704:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851864.661705:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.661707:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851864.661708:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851864.661709:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.661711:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.661713:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.661714:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851864.661714:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851864.661715:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851864.661716:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25665@kfi7, seq: 2130775
00000100:00000001:11.0:1773851864.661717:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851864.661717:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000abf47023 : new rpc_count 1
00000100:00000001:11.0:1773851864.661719:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.661719:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922908544 : -107141786643072 : ffff9e8e1bddd580)
00000100:00000040:9.0:1773851864.661721:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c58f9a30 x1858041187267200/t0(0) o400->4d62ce7a-d894-4ab1-87c4-4305d73f0dfa@25665@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2100-0'
00000100:00000001:9.0:1773851864.661733:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.661734:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851864.661735:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c58f9a30 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:4d62ce7a-d894-4ab1-87c4-4305d73f0dfa+6:39645:x1858041187267200:12345-25665@kfi7:400:default-tuolumne2100-0
00000100:00000200:9.0:1773851864.661738:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041187267200
00000020:00000001:9.0:1773851864.661739:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851864.661740:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851864.661741:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.661742:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851864.661743:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851864.661744:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851864.661745:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041187267200, found 0 last_xid 1858041187267199
00000020:00000001:9.0:1773851864.661746:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851864.661747:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851864.661747:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851864.661748:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.661749:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851864.661750:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851864.661750:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851864.661753:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004ae051af.
02000000:00000001:9.0:1773851864.661753:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.661754:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.661755:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851864.661756:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183066172622, transno 0, xid 1858041187267200
00010000:00000001:9.0:1773851864.661757:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851864.661758:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c58f9a30 x1858041187267200/t0(0) o400->4d62ce7a-d894-4ab1-87c4-4305d73f0dfa@25665@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2100-0'
00010000:00000001:9.0:1773851864.661761:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851864.661762:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851864.661762:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=97 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851864.661764:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851864.661764:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000daa428b1 refcount 3 to 25665@kfi7
00000100:00000001:9.0:1773851864.661765:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412883264 : -107156296668352 : ffff9e8abb006b40)
02000000:00000001:9.0:1773851864.661766:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851864.661767:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.661768:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851864.661769:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25729@kfi7
00000400:00000010:9.0:1773851864.661769:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003d28ebe7.
00000100:00000200:9.0:1773851864.661771:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041187267200, offset 224
00000400:00000200:9.0:1773851864.661772:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25729@kfi7
00000400:00000200:9.0:1773851864.661773:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25729@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.661774:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021e73b0d nid 25729@kfi7 refs 1
00000400:00000200:9.0:1773851864.661775:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021e73b0d nid 25729@kfi7 refs 2
00000400:00000200:9.0:1773851864.661776:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021e73b0d nid 25729@kfi7 refs 3
00000400:00000200:9.0:1773851864.661777:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25729@kfi7 local destination
00000400:00000200:9.0:1773851864.661779:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769119:8769119:1024:4294967295] 25729@kfi7 LPNI seq info [8595005:8595005:16:4294967295]
00000400:00000200:9.0:1773851864.661781:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021e73b0d nid 25729@kfi7 refs 2
00000400:00000200:9.0:1773851864.661781:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25729@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.661784:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25729@kfi7(25729@kfi7:25729@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851864.661786:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021e73b0d nid 25729@kfi7 refs 3
00000800:00000200:9.0:1773851864.661787:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.661788:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851864.661791:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851864.661795:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001114 Using peer 25729@kfi7(0x100000000001114)
00000800:00000200:9.0:1773851864.661800:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000438708cd: Posted send of 324 bytes to peer 0x100000000001114: rc=0
00000800:00000200:9.0:1773851864.661801:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001114 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851864.661804:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851864.661805:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000daa428b1 refcount 2 to 25665@kfi7
00010000:00000001:9.0:1773851864.661806:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851864.661806:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.661807:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851864.661808:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c58f9a30 x1858041187267200/t0(0) o400->4d62ce7a-d894-4ab1-87c4-4305d73f0dfa@25665@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2100-0'
00000100:00100000:9.0:1773851864.661811:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c58f9a30 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:4d62ce7a-d894-4ab1-87c4-4305d73f0dfa+6:39645:x1858041187267200:12345-25665@kfi7:400:default-tuolumne2100-0 Request processed in 77us (144us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851864.661814:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25665@kfi7, seq: 2130775
00000800:00000200:10.0:1773851864.661815:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001114 TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851864.661815:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000abf47023 : new rpc_count 0
00000100:00000001:9.0:1773851864.661816:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851864.661816:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851864.661817:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851864.661817:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851864.661818:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25729@kfi7: PUT: OK
00000020:00000010:9.0:1773851864.661818:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851864.661819:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003d28ebe7
00000020:00000010:9.0:1773851864.661819:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000010:10.0:1773851864.661820:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003d28ebe7.
00000100:00000001:10.0:1773851864.661820:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:9.0:1773851864.661820:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000abf47023 : new refcount 5
00000100:00000001:9.0:1773851864.661820:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851864.661821:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851864.661822:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021e73b0d nid 25729@kfi7 refs 2
00000800:00000200:10.0:1773851864.661823:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 25729@kfi7(00000000878d8c98):0x0 lsk 4373 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001114 Transaction freed
00000800:00000200:13.0:1773851864.690918:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851864.690920:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851864.690922:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851864.690926:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851864.690930:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24402@kfi7 to cpt 3
00000400:00000200:13.0:1773851864.690932:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24402@kfi7 : PUT - for me
00000400:00000200:13.0:1773851864.690934:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24402@kfi7 to cpt 3
00000400:00000200:13.0:1773851864.690936:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e063dadc nid 24402@kfi7 refs 1
00000400:00000200:13.0:1773851864.690938:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24402@kfi7 to cpt 3
00000400:00000200:13.0:1773851864.690939:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e063dadc nid 24402@kfi7 refs 2
00000400:00000200:13.0:1773851864.690940:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e063dadc nid 24402@kfi7 refs 3
00000400:00000200:13.0:1773851864.690942:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24403@kfi7 to cpt 7
00000400:00000200:13.0:1773851864.690944:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24403@kfi7 of length 224 into portal 12 MB=0x69b7c9bc228c0
00000400:00000200:13.0:1773851864.690946:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24403@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 26216
00000800:00000200:13.0:1773851864.690949:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851864.690952:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851864.690954:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24402@kfi7: PUT: OK
00000100:00000001:13.0:1773851864.690955:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851864.690956:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851864.690959:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000869802b1.
00000100:00000040:13.0:1773851864.690960:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000869802b1 x1859809351706816 msgsize 224
00000100:00100000:13.0:1773851864.690962:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24403@kfi7 (source: 12345-24402@kfi7)
00000100:00000001:13.0:1773851864.690964:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851864.690966:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851864.690966:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e063dadc nid 24402@kfi7 refs 2
02000000:00000001:15.0:1773851864.690967:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851864.690968:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851864.690968:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851864.690969:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851864.690971:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851864.690972:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859809351706816
00000020:00000001:15.0:1773851864.690973:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851864.690973:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f085d78fa07e
00000020:00000001:15.0:1773851864.690974:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851864.690979:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000040669bea refcount=5
00000020:00000001:15.0:1773851864.690980:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636984955340800 : -107088754210816 : ffff9e9a74d88800)
00000020:00000001:15.0:1773851864.690982:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636984955340800 : -107088754210816 : ffff9e9a74d88800)
00000100:00000001:15.0:1773851864.690983:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851864.690984:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851864.690986:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002b762ff1.
00000020:00000010:15.0:1773851864.690987:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851864.690988:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851864.690990:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851864.690991:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851864.690991:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851864.690993:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851864.690994:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851864.690994:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.690996:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851864.690998:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851864.690998:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851864.690999:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851864.690999:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851864.691000:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24403@kfi7, seq: 2289823
00000100:00000040:15.0:1773851864.691001:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000040669bea : new rpc_count 1
00000100:00000001:13.0:1773851864.691002:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.691003:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123338764288 : -106950370787328 : ffff9ebaad240000)
00000100:00000001:13.0:1773851864.691003:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851864.691005:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000869802b1 x1859809351706816/t0(0) o400->b15264c1-a39f-4aea-956a-36a266ef6d4e@24403@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2022-0'
00000100:00000001:15.0:1773851864.691009:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851864.691010:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851864.691011:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000869802b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b15264c1-a39f-4aea-956a-36a266ef6d4e+5:39561:x1859809351706816:12345-24403@kfi7:400:default-tuolumne2022-0
00000100:00000200:15.0:1773851864.691014:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859809351706816
00000020:00000001:15.0:1773851864.691014:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851864.691016:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851864.691017:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.691018:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851864.691019:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851864.691020:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851864.691021:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859809351706816, found 0 last_xid 1859809351706815
00000020:00000001:15.0:1773851864.691022:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851864.691023:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851864.691024:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851864.691025:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.691026:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851864.691027:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851864.691028:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851864.691030:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001694f82f.
02000000:00000001:15.0:1773851864.691031:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.691032:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.691033:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851864.691034:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044152558, transno 0, xid 1859809351706816
00010000:00000001:15.0:1773851864.691036:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851864.691037:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000869802b1 x1859809351706816/t0(0) o400->b15264c1-a39f-4aea-956a-36a266ef6d4e@24403@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2022-0'
00010000:00000001:15.0:1773851864.691041:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851864.691042:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851864.691043:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=97 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851864.691045:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851864.691046:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007b915290 refcount 3 to 24403@kfi7
00000100:00000001:15.0:1773851864.691047:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603213536 : -107155106338080 : ffff9e8b01f36ae0)
02000000:00000001:15.0:1773851864.691048:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851864.691049:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851864.691050:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851864.691051:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24402@kfi7
00000400:00000010:15.0:1773851864.691052:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dbadbd2e.
00000100:00000200:15.0:1773851864.691053:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859809351706816, offset 224
00000400:00000200:15.0:1773851864.691055:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24402@kfi7
00000400:00000200:15.0:1773851864.691057:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24402@kfi7 to cpt 3
00000400:00000200:15.0:1773851864.691059:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e063dadc nid 24402@kfi7 refs 1
00000400:00000200:15.0:1773851864.691060:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e063dadc nid 24402@kfi7 refs 2
00000400:00000200:15.0:1773851864.691062:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e063dadc nid 24402@kfi7 refs 3
00000400:00000200:15.0:1773851864.691064:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24402@kfi7 local destination
00000400:00000200:15.0:1773851864.691066:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769120:8769120:1024:4294967295] 24402@kfi7 LPNI seq info [269988:269988:16:4294967295]
00000400:00000200:15.0:1773851864.691068:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e063dadc nid 24402@kfi7 refs 2
00000400:00000200:15.0:1773851864.691070:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24402@kfi7 to cpt 3
00000400:00000200:15.0:1773851864.691073:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24402@kfi7(24402@kfi7:24402@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851864.691074:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e063dadc nid 24402@kfi7 refs 3
00000800:00000200:15.0:1773851864.691077:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851864.691078:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851864.691082:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851864.691086:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f40 Using peer 24402@kfi7(0x100000000000f40)
00000800:00000200:15.0:1773851864.691090:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x100000000000f40: rc=0
00000800:00000200:15.0:1773851864.691092:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f40 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851864.691096:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851864.691097:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007b915290 refcount 2 to 24403@kfi7
00010000:00000001:15.0:1773851864.691098:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851864.691099:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851864.691100:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851864.691101:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000869802b1 x1859809351706816/t0(0) o400->b15264c1-a39f-4aea-956a-36a266ef6d4e@24403@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2022-0'
00000100:00100000:15.0:1773851864.691106:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000869802b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b15264c1-a39f-4aea-956a-36a266ef6d4e+5:39561:x1859809351706816:12345-24403@kfi7:400:default-tuolumne2022-0 Request processed in 96us (145us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851864.691106:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f40 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851864.691109:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851864.691110:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24403@kfi7, seq: 2289823
00000400:00000200:13.0:1773851864.691110:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24402@kfi7: PUT: OK
00000100:00000040:15.0:1773851864.691111:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000040669bea : new rpc_count 0
00000400:00000200:13.0:1773851864.691112:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dbadbd2e
00000100:00000001:15.0:1773851864.691113:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851864.691113:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:13.0:1773851864.691113:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dbadbd2e.
00000020:00000010:15.0:1773851864.691114:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000100:00000001:13.0:1773851864.691114:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851864.691115:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000100:00000001:13.0:1773851864.691115:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851864.691116:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e063dadc nid 24402@kfi7 refs 2
00000020:00000010:15.0:1773851864.691117:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002b762ff1.
00000020:00000040:15.0:1773851864.691118:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000040669bea : new refcount 4
00000800:00000200:13.0:1773851864.691118:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 24402@kfi7(00000000a22e9bff):0x0 lsk 3905 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f40 Transaction freed
00000100:00000001:15.0:1773851864.691119:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851864.697857:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.697858:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851864.697859:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851864.697861:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851864.697863:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13699@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.697865:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13699@kfi7 : PUT - for me
00000400:00000200:9.0:1773851864.697865:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13699@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.697866:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032222da0 nid 13699@kfi7 refs 1
00000400:00000200:9.0:1773851864.697868:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13699@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.697869:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032222da0 nid 13699@kfi7 refs 2
00000400:00000200:9.0:1773851864.697869:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000032222da0 nid 13699@kfi7 refs 3
00000400:00000200:9.0:1773851864.697870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13635@kfi7 to cpt 6
00000400:00000200:9.0:1773851864.697871:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13635@kfi7 of length 224 into portal 12 MB=0x69b4b61606cc0
00000400:00000200:9.0:1773851864.697873:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13635@kfi7 of length 224/224 into md 0x78146ce49 [64] + 133520
00000800:00000200:9.0:1773851864.697874:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.697876:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851864.697877:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13699@kfi7: PUT: OK
00000100:00000001:9.0:1773851864.697878:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851864.697879:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851864.697880:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003b9a437e.
00000100:00000040:9.0:1773851864.697880:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003b9a437e x1859597918825664 msgsize 224
00000100:00100000:9.0:1773851864.697882:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13635@kfi7 (source: 12345-13699@kfi7)
00000100:00000001:9.0:1773851864.697883:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851864.697884:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000032222da0 nid 13699@kfi7 refs 2
00000800:00000200:9.0:1773851864.697886:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851864.697888:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851864.697889:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851864.697889:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851864.697890:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851864.697890:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851864.697891:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597918825664
00000020:00000001:9.0:1773851864.697892:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851864.697892:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d800b1
00000020:00000001:9.0:1773851864.697893:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851864.697895:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002487f0bd refcount=5
00000020:00000001:9.0:1773851864.697896:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636992402839552 : -107081306712064 : ffff9e9c30c05800)
00000020:00000001:9.0:1773851864.697897:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636992402839552 : -107081306712064 : ffff9e9c30c05800)
00000100:00000001:9.0:1773851864.697898:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.697899:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851864.697899:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f92f2f8.
00000020:00000010:9.0:1773851864.697900:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851864.697901:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851864.697902:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851864.697902:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851864.697903:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.697904:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851864.697904:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851864.697905:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.697905:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.697906:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.697907:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.697907:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851864.697907:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851864.697908:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13635@kfi7, seq: 2130776
00000100:00000040:9.0:1773851864.697908:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002487f0bd : new rpc_count 1
00000100:00000001:11.0:1773851864.697909:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851864.697909:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.697909:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636931922894720 : -107141786656896 : ffff9e8e1bdd9f80)
00000100:00000040:9.0:1773851864.697910:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003b9a437e x1859597918825664/t0(0) o400->e4348ea3-db6b-4fea-ae84-f3b5e6afb837@13635@kfi7:652/0 lens 224/0 e 0 to 0 dl 1773852012 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1352-0'
00000100:00000001:9.0:1773851864.697913:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.697913:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851864.697914:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b9a437e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:e4348ea3-db6b-4fea-ae84-f3b5e6afb837+5:39753:x1859597918825664:12345-13635@kfi7:400:default-tuolumne1352-0
00000100:00000200:9.0:1773851864.697915:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597918825664
00000020:00000001:9.0:1773851864.697916:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851864.697917:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851864.697917:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.697918:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851864.697918:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851864.697919:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851864.697920:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597918825664, found 0 last_xid 1859597918825663
00000020:00000001:9.0:1773851864.697921:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851864.697922:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851864.697922:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851864.697923:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.697924:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851864.697924:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851864.697925:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851864.697925:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a73a22e0.
02000000:00000001:9.0:1773851864.697926:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.697927:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.697927:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851864.697928:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684897, transno 0, xid 1859597918825664
00010000:00000001:9.0:1773851864.697929:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851864.697930:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003b9a437e x1859597918825664/t0(0) o400->e4348ea3-db6b-4fea-ae84-f3b5e6afb837@13635@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1352-0'
00010000:00000001:9.0:1773851864.697932:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851864.697933:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851864.697933:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=97 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851864.697934:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851864.697935:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000075c051ce refcount 3 to 13635@kfi7
00000100:00000001:9.0:1773851864.697936:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691808 : -107157065859808 : ffff9e8a8d277d20)
02000000:00000001:9.0:1773851864.697937:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851864.697937:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.697938:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851864.697938:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13699@kfi7
00000400:00000010:9.0:1773851864.697939:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000146cbe4e.
00000100:00000200:9.0:1773851864.697940:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597918825664, offset 224
00000400:00000200:9.0:1773851864.697941:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13699@kfi7
00000400:00000200:9.0:1773851864.697942:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13699@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.697942:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032222da0 nid 13699@kfi7 refs 1
00000400:00000200:9.0:1773851864.697943:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000032222da0 nid 13699@kfi7 refs 2
00000400:00000200:9.0:1773851864.697944:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000032222da0 nid 13699@kfi7 refs 3
00000400:00000200:9.0:1773851864.697945:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13699@kfi7 local destination
00000400:00000200:9.0:1773851864.697946:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769121:8769121:1024:4294967295] 13699@kfi7 LPNI seq info [1023150:1023150:16:4294967295]
00000400:00000200:9.0:1773851864.697948:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000032222da0 nid 13699@kfi7 refs 2
00000400:00000200:9.0:1773851864.697949:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13699@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.697951:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13699@kfi7(13699@kfi7:13699@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851864.697952:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000032222da0 nid 13699@kfi7 refs 3
00000800:00000200:9.0:1773851864.697953:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.697954:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851864.697956:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851864.697959:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d7a Using peer 13699@kfi7(0x100000000000d7a)
00000800:00000200:9.0:1773851864.697962:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x100000000000d7a: rc=0
00000800:00000200:9.0:1773851864.697963:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d7a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851864.697965:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851864.697966:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000075c051ce refcount 2 to 13635@kfi7
00010000:00000001:9.0:1773851864.697967:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851864.697967:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.697968:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851864.697969:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003b9a437e x1859597918825664/t0(0) o400->e4348ea3-db6b-4fea-ae84-f3b5e6afb837@13635@kfi7:652/0 lens 224/224 e 0 to 0 dl 1773852012 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1352-0'
00000100:00100000:9.0:1773851864.697972:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b9a437e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:e4348ea3-db6b-4fea-ae84-f3b5e6afb837+5:39753:x1859597918825664:12345-13635@kfi7:400:default-tuolumne1352-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851864.697974:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13635@kfi7, seq: 2130776
00000800:00000200:10.0:1773851864.697975:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d7a TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851864.697975:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002487f0bd : new rpc_count 0
00000100:00000001:9.0:1773851864.697975:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851864.697976:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851864.697976:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000400:00000200:10.0:1773851864.697977:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851864.697977:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851864.697978:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13699@kfi7: PUT: OK
00000020:00000010:9.0:1773851864.697978:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f92f2f8.
00000400:00000200:10.0:1773851864.697979:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000146cbe4e
00000400:00000010:10.0:1773851864.697979:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000146cbe4e.
00000020:00000040:9.0:1773851864.697979:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000002487f0bd : new refcount 4
00000100:00000001:10.0:1773851864.697980:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851864.697980:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851864.697980:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851864.697981:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000032222da0 nid 13699@kfi7 refs 2
00000800:00000200:10.0:1773851864.697983:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 13699@kfi7(000000009cb8a6c6):0x0 lsk 3451 rsk 32 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d7a Transaction freed
00000800:00000200:1.0:1773851864.708221:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851864.708222:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851864.708223:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851864.708226:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851864.708228:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9376@kfi7 to cpt 0
00000400:00000200:1.0:1773851864.708229:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9376@kfi7 : PUT - for me
00000400:00000200:1.0:1773851864.708230:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9376@kfi7 to cpt 0
00000400:00000200:1.0:1773851864.708232:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000852c5818 nid 9376@kfi7 refs 1
00000400:00000200:1.0:1773851864.708233:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9376@kfi7 to cpt 0
00000400:00000200:1.0:1773851864.708234:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000852c5818 nid 9376@kfi7 refs 2
00000400:00000200:1.0:1773851864.708235:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000852c5818 nid 9376@kfi7 refs 3
00000400:00000200:1.0:1773851864.708236:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9313@kfi7 to cpt 0
00000400:00000200:1.0:1773851864.708237:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9313@kfi7 of length 224 into portal 12 MB=0x699e239dc7c00
00000400:00000200:1.0:1773851864.708238:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9313@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 25592
00000800:00000200:1.0:1773851864.708240:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851864.708241:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851864.708243:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9376@kfi7: PUT: OK
00000100:00000001:1.0:1773851864.708244:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851864.708244:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851864.708245:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a71834c.
00000100:00000040:1.0:1773851864.708246:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007a71834c x1858046772673536 msgsize 224
00000100:00100000:1.0:1773851864.708248:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9313@kfi7 (source: 12345-9376@kfi7)
00000100:00000001:1.0:1773851864.708249:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851864.708250:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000852c5818 nid 9376@kfi7 refs 2
00000100:00000001:0.0:1773851864.708250:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851864.708251:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851864.708251:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851864.708251:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851864.708252:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851864.708253:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851864.708253:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858046772673536
00000020:00000001:0.0:1773851864.708254:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851864.708254:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913cd
00000020:00000001:0.0:1773851864.708255:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851864.708257:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c545977d refcount=6
00000020:00000001:0.0:1773851864.708258:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169311232 : -107127540240384 : ffff9e916d04b000)
00000020:00000001:0.0:1773851864.708258:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169311232 : -107127540240384 : ffff9e916d04b000)
00000100:00000001:0.0:1773851864.708259:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851864.708261:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851864.708262:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d0934e84.
00000020:00000010:0.0:1773851864.708263:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851864.708264:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851864.708265:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851864.708265:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851864.708266:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851864.708266:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851864.708267:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851864.708267:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851864.708268:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851864.708269:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851864.708270:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851864.708270:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851864.708270:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851864.708271:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9313@kfi7, seq: 1997545
00000100:00000001:1.0:1773851864.708272:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851864.708272:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c545977d : new rpc_count 1
00000100:00000001:0.0:1773851864.708272:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856604288 : -106915852947328 : ffff9ec2b6907080)
00000100:00000001:1.0:1773851864.708273:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851864.708274:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007a71834c x1858046772673536/t0(0) o400->ebc5276e-656a-4905-8ccc-304bb61fc553@9313@kfi7:504/0 lens 224/0 e 0 to 0 dl 1773852619 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1072-0'
00000100:00000001:0.0:1773851864.708276:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851864.708277:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851864.708278:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a71834c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ebc5276e-656a-4905-8ccc-304bb61fc553+6:39650:x1858046772673536:12345-9313@kfi7:400:default-tuolumne1072-0
00000100:00000200:0.0:1773851864.708279:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858046772673536
00000020:00000001:0.0:1773851864.708280:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851864.708280:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851864.708281:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851864.708282:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851864.708282:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851864.708283:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851864.708283:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858046772673536, found 0 last_xid 1858046772673535
00000020:00000001:0.0:1773851864.708284:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851864.708285:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851864.708285:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851864.708286:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851864.708287:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851864.708288:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851864.708288:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851864.708289:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f8f6276b.
02000000:00000001:0.0:1773851864.708290:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851864.708290:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851864.708291:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851864.708291:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183045906484, transno 0, xid 1858046772673536
00010000:00000001:0.0:1773851864.708292:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851864.708293:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007a71834c x1858046772673536/t0(0) o400->ebc5276e-656a-4905-8ccc-304bb61fc553@9313@kfi7:504/0 lens 224/224 e 0 to 0 dl 1773852619 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1072-0'
00010000:00000001:0.0:1773851864.708295:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851864.708296:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851864.708297:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=97 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851864.708298:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851864.708298:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000094e9aab1 refcount 3 to 9313@kfi7
00000100:00000001:0.0:1773851864.708299:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530570400 : -107154178981216 : ffff9e8b3939c2a0)
02000000:00000001:0.0:1773851864.708300:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851864.708300:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851864.708301:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851864.708302:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9376@kfi7
00000400:00000010:0.0:1773851864.708302:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028349810.
00000100:00000200:0.0:1773851864.708303:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858046772673536, offset 224
00000400:00000200:0.0:1773851864.708305:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9376@kfi7
00000400:00000200:0.0:1773851864.708306:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9376@kfi7 to cpt 0
00000400:00000200:0.0:1773851864.708307:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000852c5818 nid 9376@kfi7 refs 1
00000400:00000200:0.0:1773851864.708308:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000852c5818 nid 9376@kfi7 refs 2
00000400:00000200:0.0:1773851864.708309:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000852c5818 nid 9376@kfi7 refs 3
00000400:00000200:0.0:1773851864.708310:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9376@kfi7 local destination
00000400:00000200:0.0:1773851864.708311:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769122:8769122:1024:4294967295] 9376@kfi7 LPNI seq info [7171185:7171185:16:4294967295]
00000400:00000200:0.0:1773851864.708313:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000852c5818 nid 9376@kfi7 refs 2
00000400:00000200:0.0:1773851864.708313:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9376@kfi7 to cpt 0
00000400:00000200:0.0:1773851864.708315:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9376@kfi7(9376@kfi7:9376@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851864.708320:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000852c5818 nid 9376@kfi7 refs 3
00000800:00000200:0.0:1773851864.708321:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851864.708322:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851864.708324:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851864.708326:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc91 Using peer 9376@kfi7(0xc91)
00000800:00000200:0.0:1773851864.708329:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0xc91: rc=0
00000800:00000200:0.0:1773851864.708331:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc91 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851864.708333:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851864.708334:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000094e9aab1 refcount 2 to 9313@kfi7
00010000:00000001:0.0:1773851864.708334:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851864.708335:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851864.708336:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851864.708336:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a71834c x1858046772673536/t0(0) o400->ebc5276e-656a-4905-8ccc-304bb61fc553@9313@kfi7:504/0 lens 224/224 e 0 to 0 dl 1773852619 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1072-0'
00000100:00100000:0.0:1773851864.708340:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a71834c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ebc5276e-656a-4905-8ccc-304bb61fc553+6:39650:x1858046772673536:12345-9313@kfi7:400:default-tuolumne1072-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851864.708343:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9313@kfi7, seq: 1997545
00000100:00000040:0.0:1773851864.708343:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c545977d : new rpc_count 0
00000100:00000001:0.0:1773851864.708344:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851864.708345:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851864.708345:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851864.708346:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851864.708347:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d0934e84.
00000020:00000040:0.0:1773851864.708347:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000c545977d : new refcount 5
00000100:00000001:0.0:1773851864.708348:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851864.708353:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc91 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851864.708355:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851864.708356:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9376@kfi7: PUT: OK
00000400:00000200:1.0:1773851864.708357:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028349810
00000400:00000010:1.0:1773851864.708357:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028349810.
00000100:00000001:1.0:1773851864.708358:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851864.708358:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851864.708359:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000852c5818 nid 9376@kfi7 refs 2
00000800:00000200:1.0:1773851864.708361:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9376@kfi7(000000001475d827):0x0 lsk 3218 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc91 Transaction freed
00000800:00000200:17.0:1773851864.709502:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.709503:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851864.709504:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.709506:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851864.709508:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.709510:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.161@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851864.709511:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.709511:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851864.709513:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.161@o2ib600 to cpt 2
00000400:00000200:17.0:1773851864.709514:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfe535f9 nid 172.19.3.161@o2ib600 refs 2
00000400:00000200:17.0:1773851864.709516:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cfe535f9 nid 172.19.3.161@o2ib600 refs 3
00000400:00000200:17.0:1773851864.709517:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.161@o2ib600 to cpt 2
00000400:00000200:17.0:1773851864.709518:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.161@o2ib600 of length 224 into portal 12 MB=0x699f2797f3b40
00000400:00000200:17.0:1773851864.709520:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.161@o2ib600 of length 224/224 into md 0x78146ce49 [64] + 133744
00000800:00000200:17.0:1773851864.709522:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851864.709524:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.709525:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851864.709526:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851864.709527:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851864.709527:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000224d2273.
00000100:00000040:17.0:1773851864.709528:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000224d2273 x1858116559780672 msgsize 224
00000100:00100000:17.0:1773851864.709530:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.161@o2ib600 (source: 12345-172.19.3.161@o2ib600)
00000100:00000001:17.0:1773851864.709532:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851864.709533:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851864.709534:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851864.709535:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851864.709536:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851864.709536:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851864.709536:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851864.709537:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851864.709538:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858116559780672
00000020:00000001:9.0:1773851864.709538:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851864.709539:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e63
00000020:00000001:9.0:1773851864.709540:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851864.709542:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fc730c77 refcount=6
00000020:00000001:9.0:1773851864.709543:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239634944 : -107152469916672 : ffff9e8b9f180400)
00000020:00000001:9.0:1773851864.709544:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239634944 : -107152469916672 : ffff9e8b9f180400)
00000100:00000001:9.0:1773851864.709545:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.709546:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851864.709546:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000275fbc19.
00000020:00000010:9.0:1773851864.709547:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851864.709548:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851864.709549:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851864.709549:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851864.709550:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.709551:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851864.709551:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851864.709552:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.709553:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.709554:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.709555:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.709555:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851864.709555:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851864.709556:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.161@o2ib600, seq: 2130777
00000100:00000001:11.0:1773851864.709557:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851864.709557:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851864.709557:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fc730c77 : new rpc_count 1
00000100:00000001:9.0:1773851864.709557:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637118842710144 : -106954866841472 : ffff9eb9a127a880)
00000100:00000040:9.0:1773851864.709559:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000224d2273 x1858116559780672/t0(0) o400->57796cd2-0c6d-42e1-b419-024a7d561c3c@172.19.3.161@o2ib600:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic11-0'
00000100:00000001:9.0:1773851864.709561:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.709565:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851864.709566:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000224d2273 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:57796cd2-0c6d-42e1-b419-024a7d561c3c+6:24729:x1858116559780672:12345-172.19.3.161@o2ib600:400:default-oslic11-0
00000100:00000200:9.0:1773851864.709567:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858116559780672
00000020:00000001:9.0:1773851864.709568:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851864.709569:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851864.709569:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.709570:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851864.709571:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851864.709571:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851864.709572:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858116559780672, found 0 last_xid 1858116559780671
00000020:00000001:9.0:1773851864.709573:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851864.709573:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851864.709574:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851864.709574:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.709575:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851864.709576:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851864.709576:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851864.709577:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006f92f2f8.
02000000:00000001:9.0:1773851864.709577:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.709578:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.709579:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851864.709579:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183211358144, transno 0, xid 1858116559780672
00010000:00000001:9.0:1773851864.709580:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851864.709581:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000224d2273 x1858116559780672/t0(0) o400->57796cd2-0c6d-42e1-b419-024a7d561c3c@172.19.3.161@o2ib600:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic11-0'
00010000:00000001:9.0:1773851864.709583:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851864.709584:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851864.709584:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=97 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851864.709585:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851864.709586:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cb01e3a1 refcount 3 to 172.19.3.161@o2ib600
00000100:00000001:9.0:1773851864.709587:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551676992 : -107156157874624 : ffff9e8ac3463e40)
02000000:00000001:9.0:1773851864.709588:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851864.709588:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.709589:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851864.709590:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.161@o2ib600
00000400:00000010:9.0:1773851864.709591:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001328b840.
00000100:00000200:9.0:1773851864.709592:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858116559780672, offset 224
00000400:00000200:9.0:1773851864.709593:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.161@o2ib600
00000400:00000200:9.0:1773851864.709594:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.161@o2ib600 to cpt 2
00000400:00000200:9.0:1773851864.709595:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfe535f9 nid 172.19.3.161@o2ib600 refs 2
00000400:00000200:9.0:1773851864.709596:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cfe535f9 nid 172.19.3.161@o2ib600 refs 3
00000400:00000200:9.0:1773851864.709598:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cfe535f9 nid 172.19.3.161@o2ib600 refs 4
00000400:00000200:9.0:1773851864.709599:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.161@o2ib600 routed destination
00000400:00000200:9.0:1773851864.709601:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:9.0:1773851864.709601:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:9.0:1773851864.709603:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.161@o2ib600: rtr pref emtpy: 1
00000400:00000200:9.0:1773851864.709604:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:9.0:1773851864.709605:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.161@o2ib600: rtr pref emtpy: 1
00000400:00000200:9.0:1773851864.709606:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:9.0:1773851864.709607:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769123:8769123:1024:4294967295] 17@kfi7 LPNI seq info [1250891888:1250891888:16:4294967295]
00000400:00000200:9.0:1773851864.709609:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851864.709610:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.709612:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.161@o2ib600(172.19.3.161@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851864.709613:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cfe535f9 nid 172.19.3.161@o2ib600 refs 3
00000800:00000200:9.0:1773851864.709615:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.709616:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851864.709618:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851864.709620:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:9.0:1773851864.709623:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:9.0:1773851864.709624:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851864.709626:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851864.709627:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cb01e3a1 refcount 2 to 172.19.3.161@o2ib600
00010000:00000001:9.0:1773851864.709628:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851864.709628:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851864.709629:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851864.709630:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000224d2273 x1858116559780672/t0(0) o400->57796cd2-0c6d-42e1-b419-024a7d561c3c@172.19.3.161@o2ib600:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic11-0'
00000100:00100000:9.0:1773851864.709633:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000224d2273 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:57796cd2-0c6d-42e1-b419-024a7d561c3c+6:24729:x1858116559780672:12345-172.19.3.161@o2ib600:400:default-oslic11-0 Request processed in 70us (104us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851864.709635:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.161@o2ib600, seq: 2130777
00000100:00000040:9.0:1773851864.709636:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fc730c77 : new rpc_count 0
00000800:00000200:10.0:1773851864.709637:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851864.709637:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851864.709637:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851864.709638:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851864.709638:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000400:00000200:10.0:1773851864.709639:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851864.709639:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000275fbc19.
00000400:00000200:10.0:1773851864.709640:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000040:9.0:1773851864.709640:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000fc730c77 : new refcount 5
00000100:00000001:9.0:1773851864.709640:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851864.709641:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001328b840
00000400:00000010:10.0:1773851864.709641:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001328b840.
00000100:00000001:10.0:1773851864.709642:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851864.709642:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851864.709643:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:10.0:1773851864.709644:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000800:00000200:5.0:1773851864.755902:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.755903:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851864.755904:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851864.755906:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851864.755909:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.755910:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26514@kfi7 : PUT - for me
00000400:00000200:5.0:1773851864.755910:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.755911:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 1
00000400:00000200:5.0:1773851864.755912:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.755913:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000400:00000200:5.0:1773851864.755914:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 3
00000400:00000200:5.0:1773851864.755918:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:5.0:1773851864.755919:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 224 into portal 12 MB=0x699e78c5de840
00000400:00000200:5.0:1773851864.755920:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 224/224 into md 0x793926dc5 [64] + 132760
00000800:00000200:5.0:1773851864.755922:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851864.755924:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.755925:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26514@kfi7: PUT: OK
00000100:00000001:5.0:1773851864.755925:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851864.755926:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851864.755927:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000604d22cb.
00000100:00000040:5.0:1773851864.755927:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000604d22cb x1858069631723584 msgsize 224
00000100:00100000:5.0:1773851864.755929:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26514@kfi7)
00000100:00000001:5.0:1773851864.755930:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851864.755931:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000800:00000200:5.0:1773851864.755932:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851864.755935:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851864.755935:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851864.755936:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851864.755936:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.755937:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851864.755938:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069631723584
00000020:00000001:5.0:1773851864.755938:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851864.755939:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000020:00000001:5.0:1773851864.755939:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851864.755941:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=23
00000020:00000001:5.0:1773851864.755942:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000020:00000001:5.0:1773851864.755943:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000001:5.0:1773851864.755944:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.755944:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851864.755945:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9b9985c.
00000020:00000010:5.0:1773851864.755946:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.755947:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851864.755948:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851864.755949:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851864.755949:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.755950:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851864.755951:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851864.755951:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.755952:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.755953:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.755954:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.755954:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851864.755954:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851864.755954:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26450@kfi7, seq: 2001906
00000100:00000001:7.0:1773851864.755955:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.755955:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004c7f489e : new rpc_count 8
00000100:00000001:7.0:1773851864.755956:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.755956:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886778496 : -106955822773120 : ffff9eb9682d4c80)
00000100:00000040:5.0:1773851864.755957:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000604d22cb x1858069631723584/t0(0) o400->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne2150-0'
00000100:00000001:5.0:1773851864.755959:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.755959:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851864.755960:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000604d22cb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:fd24374c-b27d-48f0-a139-ff2894eae03b+23:40621:x1858069631723584:12345-26450@kfi7:400:login-tuolumne2150-0
00000100:00000200:5.0:1773851864.755962:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858069631723584
00000020:00000001:5.0:1773851864.755962:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851864.755963:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851864.755964:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.755964:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851864.755965:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851864.755965:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851864.755966:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858069631723584, found 0 last_xid 1858069630475583
00000020:00000001:5.0:1773851864.755967:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851864.755967:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851864.755968:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851864.755968:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.755969:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851864.755970:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851864.755970:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851864.755971:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000015602a01.
02000000:00000001:5.0:1773851864.755972:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.755973:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.755973:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851864.755974:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183257563043, transno 0, xid 1858069631723584
00010000:00000001:5.0:1773851864.755975:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851864.755975:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000604d22cb x1858069631723584/t0(0) o400->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2150-0'
00010000:00000001:5.0:1773851864.755978:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851864.755978:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851864.755979:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=96 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851864.755980:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851864.755981:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091d18785 refcount 3 to 26450@kfi7
00000100:00000001:5.0:1773851864.755981:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419456 : -107156724132160 : ffff9e8aa185d6c0)
02000000:00000001:5.0:1773851864.755982:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851864.755982:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.755983:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851864.755984:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26514@kfi7
00000400:00000010:5.0:1773851864.755984:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cf92b3a6.
00000100:00000200:5.0:1773851864.755985:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858069631723584, offset 224
00000400:00000200:5.0:1773851864.755986:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26514@kfi7
00000400:00000200:5.0:1773851864.755987:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.755987:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 1
00000400:00000200:5.0:1773851864.755988:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000400:00000200:5.0:1773851864.755989:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 3
00000400:00000200:5.0:1773851864.755990:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26514@kfi7 local destination
00000400:00000200:5.0:1773851864.755992:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769124:8769124:1024:4294967295] 26514@kfi7 LPNI seq info [35577975:35577975:16:4294967295]
00000400:00000200:5.0:1773851864.755993:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000400:00000200:5.0:1773851864.755994:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.755996:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26514@kfi7(26514@kfi7:26514@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851864.755997:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 3
00000800:00000200:5.0:1773851864.755998:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.755999:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851864.756002:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851864.756004:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c2 Using peer 26514@kfi7(0x3000000000000c2)
00000800:00000200:5.0:1773851864.756007:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x3000000000000c2: rc=0
00000800:00000200:5.0:1773851864.756008:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851864.756010:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.756011:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091d18785 refcount 2 to 26450@kfi7
00010000:00000001:5.0:1773851864.756012:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851864.756013:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.756013:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851864.756014:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000604d22cb x1858069631723584/t0(0) o400->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2150-0'
00000100:00100000:5.0:1773851864.756017:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000604d22cb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:fd24374c-b27d-48f0-a139-ff2894eae03b+23:40621:x1858069631723584:12345-26450@kfi7:400:login-tuolumne2150-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851864.756019:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26450@kfi7, seq: 2001906
00000100:00000040:5.0:1773851864.756020:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004c7f489e : new rpc_count 7
00000100:00000001:5.0:1773851864.756020:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851864.756021:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851864.756021:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.756022:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000020:00000010:5.0:1773851864.756023:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9b9985c.
00000020:00000040:5.0:1773851864.756024:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 22
00000100:00000001:5.0:1773851864.756024:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851864.756027:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c2 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851864.756028:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.756030:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26514@kfi7: PUT: OK
00000400:00000200:5.0:1773851864.756030:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cf92b3a6
00000400:00000010:5.0:1773851864.756032:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cf92b3a6.
00000100:00000001:5.0:1773851864.756033:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851864.756033:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851864.756034:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000800:00000200:5.0:1773851864.756035:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c2 Transaction freed
00000800:00000200:6.0:1773851864.816299:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851864.816301:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851864.816303:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851864.816306:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851864.816309:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12099@kfi7 to cpt 1
00000400:00000200:6.0:1773851864.816311:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12099@kfi7 : PUT - for me
00000400:00000200:6.0:1773851864.816313:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12099@kfi7 to cpt 1
00000400:00000200:6.0:1773851864.816314:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab0e87a nid 12099@kfi7 refs 1
00000400:00000200:6.0:1773851864.816315:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12099@kfi7 to cpt 1
00000400:00000200:6.0:1773851864.816316:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab0e87a nid 12099@kfi7 refs 2
00000400:00000200:6.0:1773851864.816318:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aab0e87a nid 12099@kfi7 refs 3
00000400:00000200:6.0:1773851864.816319:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12098@kfi7 to cpt 6
00000400:00000200:6.0:1773851864.816321:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12098@kfi7 of length 224 into portal 12 MB=0x69b4b57b19100
00000400:00000200:6.0:1773851864.816323:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12098@kfi7 of length 224/224 into md 0x793926dc5 [64] + 132984
00000800:00000200:6.0:1773851864.816326:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851864.816329:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851864.816330:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12099@kfi7: PUT: OK
00000100:00000001:6.0:1773851864.816331:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851864.816332:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851864.816333:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000044ace912.
00000100:00000040:6.0:1773851864.816334:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000044ace912 x1859597756371200 msgsize 224
00000100:00100000:6.0:1773851864.816337:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-12098@kfi7 (source: 12345-12099@kfi7)
00000100:00000001:6.0:1773851864.816339:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851864.816341:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aab0e87a nid 12099@kfi7 refs 2
00000100:00000001:5.0:1773851864.816342:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851864.816342:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851864.816343:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851864.816343:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851864.816344:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.816345:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851864.816346:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597756371200
00000020:00000001:5.0:1773851864.816346:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851864.816347:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8053b
00000020:00000001:5.0:1773851864.816348:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851864.816350:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004245f4f0 refcount=5
00000020:00000001:5.0:1773851864.816351:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117645090816 : -106956064460800 : ffff9eb959c57000)
00000020:00000001:5.0:1773851864.816352:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117645090816 : -106956064460800 : ffff9eb959c57000)
00000100:00000001:5.0:1773851864.816353:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.816354:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851864.816355:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9b9985c.
00000020:00000010:5.0:1773851864.816356:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.816357:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851864.816359:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851864.816359:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851864.816360:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.816361:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851864.816362:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851864.816362:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.816364:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.816365:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.816366:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851864.816366:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851864.816367:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851864.816368:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12098@kfi7, seq: 2001907
00000100:00000001:7.0:1773851864.816369:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.816369:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004245f4f0 : new rpc_count 1
00000100:00000001:5.0:1773851864.816369:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637012926971648 : -107060782579968 : ffff9ea0f815bf00)
00000100:00000001:7.0:1773851864.816370:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.816372:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000044ace912 x1859597756371200/t0(0) o400->485a1210-5247-4b63-b349-41ce6b53aae4@12098@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1256-0'
00000100:00000001:5.0:1773851864.816376:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.816377:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851864.816378:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000044ace912 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:485a1210-5247-4b63-b349-41ce6b53aae4+5:39545:x1859597756371200:12345-12098@kfi7:400:default-tuolumne1256-0
00000100:00000200:5.0:1773851864.816380:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597756371200
00000020:00000001:5.0:1773851864.816381:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851864.816382:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851864.816383:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.816384:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851864.816384:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851864.816386:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851864.816386:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597756371200, found 0 last_xid 1859597756371199
00000020:00000001:5.0:1773851864.816387:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851864.816388:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851864.816389:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851864.816390:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.816390:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851864.816391:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851864.816392:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851864.816393:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b35f6434.
02000000:00000001:5.0:1773851864.816394:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.816394:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.816395:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851864.816396:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698871, transno 0, xid 1859597756371200
00010000:00000001:5.0:1773851864.816397:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851864.816399:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000044ace912 x1859597756371200/t0(0) o400->485a1210-5247-4b63-b349-41ce6b53aae4@12098@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1256-0'
00010000:00000001:5.0:1773851864.816403:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851864.816403:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851864.816404:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=96 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851864.816406:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851864.816408:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dbcd2a60 refcount 3 to 12098@kfi7
00000100:00000001:5.0:1773851864.816409:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637057863257472 : -107015846294144 : ffff9eab6e7f0d80)
02000000:00000001:5.0:1773851864.816410:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851864.816410:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.816411:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851864.816413:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12099@kfi7
00000400:00000010:5.0:1773851864.816414:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cf92b3a6.
00000100:00000200:5.0:1773851864.816415:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597756371200, offset 224
00000400:00000200:5.0:1773851864.816417:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12099@kfi7
00000400:00000200:5.0:1773851864.816418:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12099@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.816419:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab0e87a nid 12099@kfi7 refs 1
00000400:00000200:5.0:1773851864.816420:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aab0e87a nid 12099@kfi7 refs 2
00000400:00000200:5.0:1773851864.816422:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aab0e87a nid 12099@kfi7 refs 3
00000400:00000200:5.0:1773851864.816424:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12099@kfi7 local destination
00000400:00000200:5.0:1773851864.816426:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769125:8769125:1024:4294967295] 12099@kfi7 LPNI seq info [7282726:7282726:16:4294967295]
00000400:00000200:5.0:1773851864.816428:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aab0e87a nid 12099@kfi7 refs 2
00000400:00000200:5.0:1773851864.816429:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12099@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.816432:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12099@kfi7(12099@kfi7:12099@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851864.816434:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aab0e87a nid 12099@kfi7 refs 3
00000800:00000200:5.0:1773851864.816437:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.816438:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851864.816441:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851864.816445:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122f Using peer 12099@kfi7(0x122f)
00000800:00000200:5.0:1773851864.816449:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x122f: rc=0
00000800:00000200:5.0:1773851864.816451:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851864.816454:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.816455:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dbcd2a60 refcount 2 to 12098@kfi7
00010000:00000001:5.0:1773851864.816457:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851864.816457:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.816458:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851864.816459:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000044ace912 x1859597756371200/t0(0) o400->485a1210-5247-4b63-b349-41ce6b53aae4@12098@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1256-0'
00000100:00100000:5.0:1773851864.816464:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000044ace912 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:485a1210-5247-4b63-b349-41ce6b53aae4+5:39545:x1859597756371200:12345-12098@kfi7:400:default-tuolumne1256-0 Request processed in 87us (129us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851864.816467:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122f TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851864.816468:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12098@kfi7, seq: 2001907
00000100:00000040:5.0:1773851864.816469:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004245f4f0 : new rpc_count 0
00000400:00000200:6.0:1773851864.816470:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851864.816470:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851864.816471:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851864.816471:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851864.816472:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12099@kfi7: PUT: OK
00000020:00000010:5.0:1773851864.816472:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000400:00000200:6.0:1773851864.816473:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cf92b3a6
00000400:00000010:6.0:1773851864.816473:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cf92b3a6.
00000100:00000001:6.0:1773851864.816474:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:5.0:1773851864.816474:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9b9985c.
00000020:00000040:5.0:1773851864.816474:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004245f4f0 : new refcount 4
00000100:00000001:6.0:1773851864.816475:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851864.816475:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851864.816476:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aab0e87a nid 12099@kfi7 refs 2
00000800:00000200:6.0:1773851864.816478:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 12099@kfi7(00000000a348a896):0x0 lsk 4656 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x122f Transaction freed
00000800:00000200:9.0:1773851864.834264:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.834265:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851864.834266:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851864.834269:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851864.834270:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20561@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.834272:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20561@kfi7 : PUT - for me
00000400:00000200:9.0:1773851864.834273:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20561@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.834273:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005581d350 nid 20561@kfi7 refs 1
00000400:00000200:9.0:1773851864.834274:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20561@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.834275:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005581d350 nid 20561@kfi7 refs 2
00000400:00000200:9.0:1773851864.834276:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005581d350 nid 20561@kfi7 refs 3
00000400:00000200:9.0:1773851864.834277:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20560@kfi7 to cpt 7
00000400:00000200:9.0:1773851864.834278:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20560@kfi7 of length 336 into portal 17 MB=0x69b095d4de900
00000400:00000200:9.0:1773851864.834280:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-20560@kfi7 of length 336/336 into md 0x781559fe9 [2] + 1968
00000400:00000010:9.0:1773851864.834281:0:2458095:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000091895b26.
00000400:00000200:9.0:1773851864.834282:0:2458095:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000c42f65f2
00000800:00000200:9.0:1773851864.834283:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.834285:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851864.834285:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20561@kfi7: PUT: OK
00000400:00000200:9.0:1773851864.834286:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c42f65f2
00000400:00000010:9.0:1773851864.834287:0:2458095:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000c42f65f2 (tot 253200619).
00000100:00000001:9.0:1773851864.834288:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851864.834289:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000040:9.0:1773851864.834290:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000548396ee x1859314382661888 msgsize 336
00000100:00100000:9.0:1773851864.834291:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20560@kfi7 (source: 12345-20561@kfi7)
00000100:00000040:9.0:1773851864.834292:0:2458095:0:(events.c:370:request_in_callback()) Buffer complete: 63 buffers still posted
00000100:00000001:9.0:1773851864.834293:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851864.834293:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005581d350 nid 20561@kfi7 refs 2
00000100:00000001:10.0:1773851864.834295:0:146452:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851864.834295:0:146452:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851864.834295:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851864.834296:0:146452:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851864.834297:0:146452:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851864.834297:0:146452:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851864.834298:0:146452:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314382661888
00000020:00000001:10.0:1773851864.834299:0:146452:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851864.834299:0:146452:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a08
00000020:00000001:10.0:1773851864.834300:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851864.834303:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001d929202 refcount=9
00000020:00000001:10.0:1773851864.834303:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743444480 : -107128966107136 : ffff9e911807b000)
00000020:00000001:10.0:1773851864.834304:0:146452:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743444480 : -107128966107136 : ffff9e911807b000)
00000100:00000001:10.0:1773851864.834305:0:146452:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851864.834306:0:146452:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851864.834307:0:146452:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cc19fc79.
00000020:00000010:10.0:1773851864.834308:0:146452:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851864.834309:0:146452:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000100:00000040:10.0:1773851864.834310:0:146452:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:10.0:1773851864.834311:0:146452:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851864.834311:0:146452:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:10.0:1773851864.834312:0:146452:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:10.0:1773851864.834316:0:146452:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834316:0:146452:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:10.0:1773851864.834317:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851864.834317:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851864.834318:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008294d81b refcount=3
00000020:00000001:10.0:1773851864.834319:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103067800576 : -106970641751040 : ffff9eb5f4e5a400)
00010000:00000001:10.0:1773851864.834319:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637103067800576 : -106970641751040 : ffff9eb5f4e5a400)
00010000:00000001:10.0:1773851864.834320:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834321:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834321:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851864.834321:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851864.834322:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005f504d49 refcount=3
00000020:00000001:10.0:1773851864.834323:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077455025664 : -106996254525952 : ffff9eaffe41b600)
00010000:00000001:10.0:1773851864.834323:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077455025664 : -106996254525952 : ffff9eaffe41b600)
00010000:00000001:10.0:1773851864.834324:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834324:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834325:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851864.834325:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851864.834326:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:10.0:1773851864.834326:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:10.0:1773851864.834327:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:10.0:1773851864.834327:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834327:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834328:0:146452:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.834329:0:146452:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.834330:0:146452:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.834331:0:146452:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851864.834332:0:145944:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851864.834332:0:146452:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.834333:0:145944:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851864.834333:0:146452:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851864.834334:0:145944:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851864.834334:0:146452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20560@kfi7, seq: 39215914
00000100:00000040:10.0:1773851864.834334:0:146452:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001d929202 : new rpc_count 1
00000100:00000001:11.0:1773851864.834335:0:145944:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.834335:0:146452:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128874313808 : -106944835237808 : ffff9ebbf715c850)
00000100:00000040:10.0:1773851864.834336:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000548396ee x1859314382661888/t0(0) o103->c88cb638-383b-4e24-9d87-bb7aa4738387@20560@kfi7:591/0 lens 336/0 e 0 to 0 dl 1773851951 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:10.0:1773851864.834342:0:146452:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851864.834342:0:146452:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851864.834343:0:146452:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000548396ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:c88cb638-383b-4e24-9d87-bb7aa4738387+9:39683:x1859314382661888:12345-20560@kfi7:103:
00000100:00000200:10.0:1773851864.834345:0:146452:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314382661888
00010000:00000001:10.0:1773851864.834345:0:146452:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:10.0:1773851864.834346:0:146452:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:10.0:1773851864.834346:0:146452:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:10.0:1773851864.834347:0:146452:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851864.834348:0:146452:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851864.834349:0:146452:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef78f1a0.
02000000:00000001:10.0:1773851864.834349:0:146452:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.834350:0:146452:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834351:0:146452:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:10.0:1773851864.834351:0:146452:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00000001:10.0:1773851864.834352:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851864.834352:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851864.834353:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008294d81b refcount=3
00000020:00000001:10.0:1773851864.834353:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103067800576 : -106970641751040 : ffff9eb5f4e5a400)
00010000:00000001:10.0:1773851864.834354:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637103067800576 : -106970641751040 : ffff9eb5f4e5a400)
00010000:00000040:10.0:1773851864.834355:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00000004:00000001:10.0:1773851864.834356:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851864.834356:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851864.834357:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851864.834357:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851864.834358:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851864.834358:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834360:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851864.834360:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851864.834361:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834362:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834362:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851864.834363:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851864.834364:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000008294d81b with handle 0x21b6f08f07a4d831 from hash
00010000:00000001:10.0:1773851864.834364:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851864.834366:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834366:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834366:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851864.834367:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851864.834368:0:146452:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834368:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851864.834369:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851864.834370:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000008294d81b/0x21b6f08f07a4d831 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25e4 expref: 9 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851864.834372:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:10.0:1773851864.834373:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000001d929202 : new locks_count 2
00000020:00000040:10.0:1773851864.834374:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000001d929202 : new refcount 8
00010000:00000010:10.0:1773851864.834375:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003bbd5036.
00010000:00000040:10.0:1773851864.834376:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:10.0:1773851864.834376:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834377:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851864.834377:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851864.834377:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005f504d49 refcount=3
00000020:00000001:10.0:1773851864.834378:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077455025664 : -106996254525952 : ffff9eaffe41b600)
00010000:00000001:10.0:1773851864.834378:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637077455025664 : -106996254525952 : ffff9eaffe41b600)
00010000:00000001:10.0:1773851864.834379:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851864.834380:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851864.834380:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:10.0:1773851864.834381:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851864.834382:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834383:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851864.834383:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00000040:10.0:1773851864.834384:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 230
00000004:00000001:10.0:1773851864.834384:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851864.834385:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851864.834385:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851864.834386:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851864.834386:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851864.834386:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834388:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851864.834389:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851864.834390:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834390:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834391:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851864.834391:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851864.834391:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000005f504d49 with handle 0x21b6f08f07a4d823 from hash
00010000:00000001:10.0:1773851864.834392:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851864.834393:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834393:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834393:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851864.834394:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851864.834394:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834395:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851864.834395:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851864.834396:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000005f504d49/0x21b6f08f07a4d823 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 231 type: IBT gid 0 flags: 0x44a01000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25ba expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851864.834398:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00010000:00000040:10.0:1773851864.834399:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000001d929202 : new locks_count 1
00000020:00000040:10.0:1773851864.834399:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000001d929202 : new refcount 7
00010000:00000010:10.0:1773851864.834400:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002b870c51.
00010000:00000040:10.0:1773851864.834400:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:10.0:1773851864.834401:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834401:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851864.834402:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851864.834402:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:10.0:1773851864.834403:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:10.0:1773851864.834403:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:10.0:1773851864.834404:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851864.834404:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851864.834405:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:10.0:1773851864.834405:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851864.834406:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834407:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851864.834407:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00000040:10.0:1773851864.834408:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00000004:00000001:10.0:1773851864.834408:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851864.834409:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851864.834409:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851864.834409:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851864.834410:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851864.834410:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834412:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851864.834412:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851864.834412:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834413:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834413:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851864.834414:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851864.834414:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000097d489dd with handle 0x21b6f08f07a4d807 from hash
00010000:00000001:10.0:1773851864.834415:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851864.834415:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851864.834416:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834416:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851864.834416:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851864.834417:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834417:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851864.834418:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851864.834418:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a4d807 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 20560@kfi7 remote: 0xfcd9da8f3b9b25b3 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851864.834420:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:10.0:1773851864.834421:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000001d929202 : new locks_count 0
00000020:00000040:10.0:1773851864.834422:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000001d929202 : new refcount 6
00010000:00000010:10.0:1773851864.834422:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a3815e88.
00010000:00000040:10.0:1773851864.834423:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:10.0:1773851864.834423:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851864.834424:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851864.834424:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851864.834425:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:10.0:1773851864.834426:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851864.834426:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834427:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851864.834427:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00010000:00010000:10.0:1773851864.834428:0:146452:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:10.0:1773851864.834429:0:146452:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=3 : 3 : 3)
00010000:00000001:10.0:1773851864.834429:0:146452:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851864.834430:0:146452:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851864.834431:0:146452:0:(import.c:1951:at_measured()) add 1 to 00000000a7d9b651 time=118 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851864.834432:0:146452:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851864.834432:0:146452:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c0e93087 refcount 3 to 20560@kfi7
00000100:00000001:10.0:1773851864.834433:0:146452:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091268992 : -107152618282624 : ffff9e8b96402180)
02000000:00000001:10.0:1773851864.834434:0:146452:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851864.834434:0:146452:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.834435:0:146452:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851864.834436:0:146452:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20561@kfi7
00000400:00000010:10.0:1773851864.834436:0:146452:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009692103c.
00000100:00000200:10.0:1773851864.834437:0:146452:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859314382661888, offset 224
00000400:00000200:10.0:1773851864.834439:0:146452:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20561@kfi7
00000400:00000200:10.0:1773851864.834440:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20561@kfi7 to cpt 2
00000400:00000200:10.0:1773851864.834440:0:146452:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005581d350 nid 20561@kfi7 refs 1
00000400:00000200:10.0:1773851864.834441:0:146452:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005581d350 nid 20561@kfi7 refs 2
00000400:00000200:10.0:1773851864.834443:0:146452:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005581d350 nid 20561@kfi7 refs 3
00000400:00000200:10.0:1773851864.834444:0:146452:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20561@kfi7 local destination
00000400:00000200:10.0:1773851864.834445:0:146452:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769126:8769126:1024:4294967295] 20561@kfi7 LPNI seq info [227088:227088:16:4294967295]
00000400:00000200:10.0:1773851864.834447:0:146452:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005581d350 nid 20561@kfi7 refs 2
00000400:00000200:10.0:1773851864.834448:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20561@kfi7 to cpt 2
00000400:00000200:10.0:1773851864.834450:0:146452:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20561@kfi7(20561@kfi7:20561@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851864.834451:0:146452:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005581d350 nid 20561@kfi7 refs 3
00000800:00000200:10.0:1773851864.834452:0:146452:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851864.834453:0:146452:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851864.834457:0:146452:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851864.834460:0:146452:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3ca Using peer 20561@kfi7(0x3ca)
00000800:00000200:10.0:1773851864.834463:0:146452:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000000600ceff: Posted send of 324 bytes to peer 0x3ca: rc=0
00000800:00000200:10.0:1773851864.834464:0:146452:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3ca TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851864.834466:0:146452:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851864.834467:0:146452:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c0e93087 refcount 2 to 20560@kfi7
00010000:00000001:10.0:1773851864.834467:0:146452:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.834468:0:146452:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851864.834469:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000548396ee x1859314382661888/t0(0) o103->c88cb638-383b-4e24-9d87-bb7aa4738387@20560@kfi7:591/0 lens 336/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:10.0:1773851864.834472:0:146452:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000548396ee pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:c88cb638-383b-4e24-9d87-bb7aa4738387+6:39683:x1859314382661888:12345-20560@kfi7:103: Request processed in 129us (181us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851864.834474:0:146452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20560@kfi7, seq: 39215914
00000100:00000040:10.0:1773851864.834475:0:146452:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001d929202 : new rpc_count 0
00000800:00000200:9.0:1773851864.834475:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3ca TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851864.834476:0:146452:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851864.834476:0:146452:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851864.834476:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851864.834477:0:146452:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000400:00000200:9.0:1773851864.834477:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20561@kfi7: PUT: OK
00000020:00000010:10.0:1773851864.834478:0:146452:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000400:00000200:9.0:1773851864.834478:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009692103c
00000400:00000010:9.0:1773851864.834478:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009692103c.
00000020:00000010:10.0:1773851864.834479:0:146452:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cc19fc79.
00000020:00000040:10.0:1773851864.834479:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000001d929202 : new refcount 5
00000100:00000001:9.0:1773851864.834479:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851864.834479:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851864.834480:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005581d350 nid 20561@kfi7 refs 2
02000000:00000001:10.0:1773851864.834481:0:146452:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:10.0:1773851864.834481:0:146452:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ef78f1a0.
00000800:00000200:9.0:1773851864.834481:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 20561@kfi7(000000006fe3ac7a):0x0 lsk 971 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3ca Transaction freed
02000000:00000001:10.0:1773851864.834482:0:146452:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
02000000:00000001:10.0:1773851864.834482:0:146452:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:10.0:1773851864.834483:0:146452:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000057130d88.
02000000:00000001:10.0:1773851864.834483:0:146452:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:10.0:1773851864.834484:0:146452:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005684d651.
02000000:00000001:10.0:1773851864.834485:0:146452:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:10.0:1773851864.834486:0:146452:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000301023b1.
02000000:00000001:10.0:1773851864.834486:0:146452:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:10.0:1773851864.834486:0:146452:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000171a07a9.
02000000:00000001:10.0:1773851864.834487:0:146452:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:10.0:1773851864.834487:0:146452:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e4cc4180.
02000000:00000001:10.0:1773851864.834488:0:146452:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:10.0:1773851864.834488:0:146452:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000abde729d.
02000000:00000001:10.0:1773851864.834489:0:146452:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:10.0:1773851864.834489:0:146452:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e71bdf2a.
02000000:00000001:10.0:1773851864.834490:0:146452:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:10.0:1773851864.834490:0:146452:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004c424742.
02000000:00000001:10.0:1773851864.834491:0:146452:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:10.0:1773851864.834491:0:146452:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000c029529.
02000000:00000001:10.0:1773851864.834492:0:146452:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:10.0:1773851864.834493:0:146452:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eadcee3f.
02000000:00000001:10.0:1773851864.834493:0:146452:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:10.0:1773851864.834494:0:146452:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003e76e6d0.
02000000:00000001:10.0:1773851864.834495:0:146452:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:10.0:1773851864.834495:0:146452:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004e9d6eb4.
00000100:00000001:10.0:1773851864.834496:0:146452:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:10.0:1773851864.834497:0:146452:0:(niobuf.c:993:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17
00000400:00000010:10.0:1773851864.834498:0:146452:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000784143ff.
00000400:00000010:10.0:1773851864.834499:0:146452:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 000000002621910c (tot 253200771).
00000800:00000200:17.0:1773851864.835141:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.835142:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851864.835143:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.835145:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851864.835147:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25041@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.835148:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25041@kfi7 : PUT - for me
00000400:00000200:17.0:1773851864.835149:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25041@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.835150:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060b443a3 nid 25041@kfi7 refs 1
00000400:00000200:17.0:1773851864.835151:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25041@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.835152:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060b443a3 nid 25041@kfi7 refs 2
00000400:00000200:17.0:1773851864.835153:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000060b443a3 nid 25041@kfi7 refs 3
00000400:00000200:17.0:1773851864.835153:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25041@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.835154:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25041@kfi7 of length 224 into portal 12 MB=0x699e1b6187480
00000400:00000200:17.0:1773851864.835156:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25041@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 7192
00000800:00000200:17.0:1773851864.835157:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851864.835159:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.835160:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25041@kfi7: PUT: OK
00000100:00000001:17.0:1773851864.835161:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851864.835162:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851864.835162:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000237d7c51.
00000100:00000040:17.0:1773851864.835163:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000237d7c51 x1858044562011264 msgsize 224
00000100:00100000:17.0:1773851864.835165:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25041@kfi7 (source: 12345-25041@kfi7)
00000100:00000001:17.0:1773851864.835166:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851864.835166:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000060b443a3 nid 25041@kfi7 refs 2
00000100:00000001:16.0:1773851864.835167:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851864.835168:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851864.835168:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851864.835168:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851864.835169:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851864.835170:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851864.835171:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044562011264
00000020:00000001:16.0:1773851864.835172:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851864.835172:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92dea
00000020:00000001:16.0:1773851864.835173:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851864.835174:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006611202f refcount=6
00000020:00000001:16.0:1773851864.835175:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744426496 : -107128965125120 : ffff9e911816ac00)
00000020:00000001:16.0:1773851864.835176:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744426496 : -107128965125120 : ffff9e911816ac00)
00000100:00000001:16.0:1773851864.835177:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851864.835178:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851864.835178:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d3b15942.
00000020:00000010:16.0:1773851864.835179:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851864.835180:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000082cc22fe.
00000100:00000001:16.0:1773851864.835181:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851864.835181:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851864.835182:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851864.835183:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851864.835183:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851864.835184:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.835185:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851864.835186:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851864.835186:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851864.835186:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851864.835187:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851864.835187:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25041@kfi7, seq: 2156309
00000100:00000001:17.0:1773851864.835188:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851864.835188:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006611202f : new rpc_count 1
00000100:00000001:17.0:1773851864.835189:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.835189:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093921024 : -107022615630592 : ffff9ea9db032d00)
00000100:00000040:16.0:1773851864.835190:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000237d7c51 x1858044562011264/t0(0) o400->cd2248a5-3ed4-438f-956a-aebcef2affaa@25041@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2049-0'
00000100:00000001:16.0:1773851864.835192:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851864.835193:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851864.835194:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000237d7c51 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:cd2248a5-3ed4-438f-956a-aebcef2affaa+6:39638:x1858044562011264:12345-25041@kfi7:400:default-tuolumne2049-0
00000100:00000200:16.0:1773851864.835195:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044562011264
00000020:00000001:16.0:1773851864.835196:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851864.835196:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851864.835198:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.835199:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851864.835199:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851864.835200:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851864.835201:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044562011264, found 0 last_xid 1858044562011263
00000020:00000001:16.0:1773851864.835202:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851864.835202:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851864.835203:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851864.835203:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.835204:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851864.835204:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851864.835205:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851864.835206:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aa23db16.
02000000:00000001:16.0:1773851864.835207:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.835207:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.835208:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851864.835209:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105081928, transno 0, xid 1858044562011264
00010000:00000001:16.0:1773851864.835210:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851864.835210:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000237d7c51 x1858044562011264/t0(0) o400->cd2248a5-3ed4-438f-956a-aebcef2affaa@25041@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2049-0'
00010000:00000001:16.0:1773851864.835213:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851864.835213:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851864.835214:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=97 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851864.835215:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851864.835216:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007db6a267 refcount 3 to 25041@kfi7
00000100:00000001:16.0:1773851864.835216:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095774208 : -107152613777408 : ffff9e8b9684e000)
02000000:00000001:16.0:1773851864.835218:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851864.835218:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851864.835219:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851864.835220:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25041@kfi7
00000400:00000010:16.0:1773851864.835220:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000287d02c3.
00000100:00000200:16.0:1773851864.835221:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044562011264, offset 224
00000400:00000200:16.0:1773851864.835222:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25041@kfi7
00000400:00000200:16.0:1773851864.835223:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25041@kfi7 to cpt 4
00000400:00000200:16.0:1773851864.835224:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060b443a3 nid 25041@kfi7 refs 1
00000400:00000200:16.0:1773851864.835226:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000060b443a3 nid 25041@kfi7 refs 2
00000400:00000200:16.0:1773851864.835227:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000060b443a3 nid 25041@kfi7 refs 3
00000400:00000200:16.0:1773851864.835228:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25041@kfi7 local destination
00000400:00000200:16.0:1773851864.835229:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769127:8769127:1024:4294967295] 25041@kfi7 LPNI seq info [12424289:12424289:16:4294967295]
00000400:00000200:16.0:1773851864.835231:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000060b443a3 nid 25041@kfi7 refs 2
00000400:00000200:16.0:1773851864.835231:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25041@kfi7 to cpt 4
00000400:00000200:16.0:1773851864.835233:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25041@kfi7(25041@kfi7:25041@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851864.835234:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000060b443a3 nid 25041@kfi7 refs 3
00000800:00000200:16.0:1773851864.835236:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851864.835237:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851864.835239:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851864.835241:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x38d Using peer 25041@kfi7(0x38d)
00000800:00000200:16.0:1773851864.835244:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x38d: rc=0
00000800:00000200:16.0:1773851864.835246:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x38d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851864.835248:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851864.835248:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007db6a267 refcount 2 to 25041@kfi7
00010000:00000001:16.0:1773851864.835249:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851864.835249:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851864.835250:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851864.835251:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000237d7c51 x1858044562011264/t0(0) o400->cd2248a5-3ed4-438f-956a-aebcef2affaa@25041@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2049-0'
00000100:00100000:16.0:1773851864.835255:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000237d7c51 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:cd2248a5-3ed4-438f-956a-aebcef2affaa+6:39638:x1858044562011264:12345-25041@kfi7:400:default-tuolumne2049-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851864.835257:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25041@kfi7, seq: 2156309
00000100:00000040:16.0:1773851864.835258:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006611202f : new rpc_count 0
00000100:00000001:16.0:1773851864.835260:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851864.835261:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851864.835261:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851864.835262:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000082cc22fe.
00000020:00000010:16.0:1773851864.835263:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d3b15942.
00000020:00000040:16.0:1773851864.835264:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000006611202f : new refcount 5
00000100:00000001:16.0:1773851864.835264:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851864.835269:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x38d TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851864.835270:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851864.835271:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25041@kfi7: PUT: OK
00000400:00000200:17.0:1773851864.835272:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000287d02c3
00000400:00000010:17.0:1773851864.835273:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000287d02c3.
00000100:00000001:17.0:1773851864.835274:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851864.835274:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851864.835275:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000060b443a3 nid 25041@kfi7 refs 2
00000800:00000200:17.0:1773851864.835276:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 25041@kfi7(000000002b7c84bf):0x0 lsk 910 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x38d Transaction freed
00010000:00000010:10.1:1773851864.839726:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000008294d81b.
00010000:00000010:10.1:1773851864.839727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000005f504d49.
00010000:00000010:10.1:1773851864.839728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000097d489dd.
00000004:00000001:6.0:1773851864.905731:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:4.0:1773851864.905731:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851864.905732:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:4.0:1773851864.905732:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:4.0:1773851864.905732:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000026a80641.
00000004:00000001:0.0:1773851864.905732:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:6.0:1773851864.905733:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000067340e10.
00000020:00000040:4.0:1773851864.905733:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000004:00000020:0.0:1773851864.905733:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851864.905734:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851864.905734:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:28.0:1773851864.905734:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:8.0:1773851864.905734:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:6.0:1773851864.905734:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000100:00000001:4.0:1773851864.905734:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:0.0:1773851864.905734:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000813226cd.
00000004:00000020:28.0:1773851864.905735:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:8.0:1773851864.905735:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:6.0:1773851864.905735:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851864.905735:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851864.905735:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:0.0:1773851864.905735:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000100:00000010:29.0:1773851864.905736:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000242f3500.
00000100:00000010:28.0:1773851864.905736:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000080f3d539.
00000100:00000010:8.0:1773851864.905736:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec171328.
02000000:00000001:6.0:1773851864.905736:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851864.905736:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851864.905736:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:29.0:1773851864.905737:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000020:00000040:28.0:1773851864.905737:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
02000000:00000010:6.0:1773851864.905737:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000c0831f5b.
02000000:00000010:4.0:1773851864.905737:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d7ad89bf.
02000000:00000001:0.0:1773851864.905737:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:0.0:1773851864.905737:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851864.905738:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:8.0:1773851864.905738:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
00000100:00000001:6.0:1773851864.905738:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.905738:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851864.905738:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000076d63e2f.
02000000:00000001:29.0:1773851864.905739:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851864.905739:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851864.905739:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.905739:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851864.905739:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851864.905739:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851864.905740:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.905740:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:8.0:1773851864.905740:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:0.0:1773851864.905740:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:28.0:1773851864.905741:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:8.0:1773851864.905741:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:6.0:1773851864.905741:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000067340e10] to pc [ptlrpcd_01_02+2]  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851864.905741:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000026a80641] to pc [ptlrpcd_01_03+3]  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851864.905741:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851864.905742:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
02000000:00000001:28.0:1773851864.905742:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851864.905742:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851864.905742:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000813226cd] to pc [ptlrpcd_00_00+0]  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851864.905743:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851864.905744:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:28.0:1773851864.905744:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000aecc56ef.
02000000:00000010:8.0:1773851864.905744:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00080000:00000001:6.0:1773851864.905745:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:4.0:1773851864.905745:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:29.0:1773851864.905746:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.905746:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851864.905746:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:6.0:1773851864.905746:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f4faae6e.
00080000:00000010:4.0:1773851864.905746:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004e2bbea7.
00000004:00000001:0.0:1773851864.905746:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851864.905747:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000242f3500] to pc [ptlrpcd_07_00+0]  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851864.905747:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851864.905747:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851864.905747:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:6.0:1773851864.905747:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637152957972480 : -106920751579136 : ffff9ec192954000)
00080000:00000001:4.0:1773851864.905747:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637132678817792 : -106941030733824 : ffff9ebcd9d9e800)
00000100:00000001:3.0:1773851864.905747:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851864.905747:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851864.905748:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851864.905748:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851864.905748:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:4.0:1773851864.905748:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:3.0:1773851864.905748:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:3.0:1773851864.905748:0:41060:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:2.0:1773851864.905748:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851864.905749:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851864.905749:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851864.905749:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851864.905749:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851864.905749:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00080000:00000001:4.0:1773851864.905749:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:4.0:1773851864.905749:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000100:00000040:3.0:1773851864.905749:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:4.0:1773851864.905750:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009b391394.
00000100:00000040:28.0:1773851864.905751:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000080f3d539] to pc [ptlrpcd_07_01+1]  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851864.905751:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ec171328] to pc [ptlrpcd_02_01+1]  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:4.0:1773851864.905751:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614139359026833ns, next at 614140359025741ns, rc = 0
00080000:00000001:4.0:1773851864.905752:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:3.0:1773851864.905752:0:41060:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:4.0:1773851864.905753:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905753:0:41060:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851864.905754:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851864.905754:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851864.905754:0:41060:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:31.0:1773851864.905755:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.905755:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851864.905755:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851864.905755:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851864.905755:0:41060:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905756:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:30.0:1773851864.905756:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851864.905756:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:28.0:1773851864.905756:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:7.0:1773851864.905756:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851864.905756:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:3.0:1773851864.905756:0:41060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000813226cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051927488:2057@kfi7:13:default-yuba2-0
00000100:00000040:31.0:1773851864.905757:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.905757:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00100000:7.0:1773851864.905757:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067340e10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051927424:46@kfi7:13:default-yuba2-0
00000100:00000040:30.0:1773851864.905758:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:28.0:1773851864.905758:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000db9da5d9.
00000100:00000001:3.0:1773851864.905758:0:41060:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:3.0:1773851864.905758:0:41060:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:28.0:1773851864.905759:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636956269841408 : -107117439710208 : ffff9e93c70e8c00)
00080000:00000001:8.0:1773851864.905759:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851864.905759:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851864.905759:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000010:6.0:1773851864.905759:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009ca37ed5.
02000000:00000001:3.0:1773851864.905759:0:41060:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905760:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851864.905760:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.905760:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851864.905760:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.905760:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851864.905760:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003e1bc6ec.
02000000:00000001:7.0:1773851864.905760:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.905760:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00080000:6.0:1773851864.905760:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614139359035569ns, next at 614140359034778ns, rc = 0
02000000:00000001:3.0:1773851864.905760:0:41060:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:31.0:1773851864.905761:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:30.0:1773851864.905761:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:28.0:1773851864.905761:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:10.0:1773851864.905761:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851864.905761:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:7.0:1773851864.905761:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002b002509.
00080000:00000001:6.0:1773851864.905761:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000010:3.0:1773851864.905761:0:41060:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001093bef2.
02000000:00000001:31.0:1773851864.905762:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851864.905762:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851864.905762:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.905762:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851864.905762:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636935180657664 : -107138528893952 : ffff9e8ede0b2400)
02000000:00000001:7.0:1773851864.905762:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851864.905762:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851864.905762:0:41060:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851864.905763:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000242f3500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051927552:2056@kfi7:13:default-yuba2-0
00000100:00100000:30.0:1773851864.905763:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000080f3d539 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051927680:2065@kfi7:13:default-yuba2-0
00000004:00001000:28.0:1773851864.905763:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000100:00000040:10.0:1773851864.905763:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851864.905763:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851864.905763:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000400:00000200:7.0:1773851864.905763:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000004:00000001:6.0:1773851864.905763:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:3.0:1773851864.905763:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:31.0:1773851864.905764:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851864.905764:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:30.0:1773851864.905764:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851864.905764:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:7.0:1773851864.905764:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00000400:00000010:3.0:1773851864.905764:0:41060:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ac2e5b72.
02000000:00000001:31.0:1773851864.905765:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851864.905765:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:30.0:1773851864.905765:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851864.905765:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000010:28.0:1773851864.905765:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f3d9766b.
00080000:00000001:8.0:1773851864.905765:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851864.905765:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000400:00000010:3.0:1773851864.905765:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006aa38b71.
02000000:00000010:31.0:1773851864.905766:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f353b924.
00000004:00080000:28.0:1773851864.905766:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614139359041691ns, next at 614140359039957ns, rc = 0
00000004:00001000:8.0:1773851864.905766:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000100:00000200:7.0:1773851864.905766:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927424, portal 4
02000000:00000001:31.0:1773851864.905767:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851864.905767:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008f05475e.
02000000:00000001:30.0:1773851864.905767:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851864.905767:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001b9bf2f8.
00000100:00000001:7.0:1773851864.905767:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851864.905767:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139802804480 : -106933906747136 : ffff9ebe82795100)
00000100:00000200:3.0:1773851864.905767:0:41060:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927488, portal 4
00000100:00000001:3.0:1773851864.905767:0:41060:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:31.0:1773851864.905768:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00080000:00000001:28.0:1773851864.905768:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:10.0:1773851864.905768:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:3.0:1773851864.905768:0:41060:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203099008 : -107102506452608 : ffff9e974125f980)
00000400:00000010:31.0:1773851864.905769:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000010:31.0:1773851864.905769:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d81a04c.
00000400:00000200:30.0:1773851864.905769:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00080000:00000001:28.0:1773851864.905769:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.905769:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:8.0:1773851864.905769:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614139359044275ns, next at 614140359042352ns, rc = 0
00000100:00000040:7.0:1773851864.905769:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851864.905770:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000004:00000001:28.0:1773851864.905770:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851864.905770:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:8.0:1773851864.905770:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:3.0:1773851864.905770:0:41060:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851864.905771:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927552, portal 4
00000100:00000001:31.0:1773851864.905771:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:30.0:1773851864.905771:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
02000000:00000001:10.0:1773851864.905771:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.905771:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:31.0:1773851864.905772:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079343711104 : -106994365840512 : ffff9eb06ed4c380)
00000100:00000200:30.0:1773851864.905772:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927680, portal 4
00080000:00000001:8.0:1773851864.905772:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851864.905772:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000100:00000040:31.0:1773851864.905773:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.905773:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851864.905773:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324233600 : -106976385318016 : ffff9eb49e8dc380)
00000100:00100000:10.0:1773851864.905773:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec171328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051927616:2055@kfi7:13:default-yuba2-0
00000004:00000001:8.0:1773851864.905773:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851864.905773:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036a990bc.
00000100:00000001:3.0:1773851864.905773:0:41060:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:7.0:1773851864.905774:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927424, offset 0
00000100:00000040:3.0:1773851864.905774:0:41060:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000010:3.0:1773851864.905774:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f32b85c1.
00000100:00000040:30.0:1773851864.905775:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851864.905775:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:7.0:1773851864.905775:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000100:00000200:3.0:1773851864.905775:0:41060:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927488, offset 0
00000100:00000001:31.0:1773851864.905776:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:10.0:1773851864.905776:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:7.0:1773851864.905776:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:31.0:1773851864.905777:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000010:31.0:1773851864.905777:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c70e405.
00000100:00000001:30.0:1773851864.905777:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:10.0:1773851864.905777:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851864.905777:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:3.0:1773851864.905777:0:41060:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000100:00000200:31.0:1773851864.905778:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927552, offset 0
00000100:00000040:30.0:1773851864.905778:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000200:7.0:1773851864.905778:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:3.0:1773851864.905778:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000010:30.0:1773851864.905779:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ea7638e8.
02000000:00000001:10.0:1773851864.905779:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:31.0:1773851864.905780:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000100:00000200:30.0:1773851864.905780:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927680, offset 0
00000400:00000200:7.0:1773851864.905780:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:3.0:1773851864.905780:0:41060:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:31.0:1773851864.905781:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
02000000:00000010:10.0:1773851864.905781:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bef83544.
00000400:00000200:7.0:1773851864.905781:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000400:00000200:3.0:1773851864.905781:0:41060:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851864.905782:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:30.0:1773851864.905782:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
02000000:00000001:10.0:1773851864.905782:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851864.905782:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769127, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769123, p:4294967295, g:4294967295, h:1000]
00000400:00000200:3.0:1773851864.905782:0:41060:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:31.0:1773851864.905783:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:3.0:1773851864.905783:0:41060:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:31.0:1773851864.905784:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:10.0:1773851864.905784:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:31.0:1773851864.905785:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000400:00000010:10.0:1773851864.905785:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d3517e37.
00000400:00000200:7.0:1773851864.905785:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:3.0:1773851864.905785:0:41060:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769127, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769123, p:4294967295, g:4294967295, h:1000]
00000400:00000010:10.0:1773851864.905786:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000033620fd9.
00000400:00000200:31.0:1773851864.905787:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769127, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769123, p:4294967295, g:4294967295, h:1000]
00000400:00000200:3.0:1773851864.905787:0:41060:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000200:10.0:1773851864.905788:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927616, portal 4
00000400:00000200:7.0:1773851864.905788:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:3.0:1773851864.905788:0:41060:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851864.905789:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:10.0:1773851864.905789:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:7.0:1773851864.905789:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000400:00000200:31.0:1773851864.905790:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:10.0:1773851864.905790:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491264384 : -107117218287232 : ffff9e93d4413180)
00000400:00000200:3.0:1773851864.905790:0:41060:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:31.0:1773851864.905791:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000400:00000200:7.0:1773851864.905791:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769128:8769128:1024:4294967295] 46@kfi7 LPNI seq info [5403857:5403857:16:4294967295]
00000400:00000200:31.0:1773851864.905792:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769129:8769129:1024:4294967295] 2056@kfi7 LPNI seq info [5402399:5402399:16:4294967295]
00000100:00000040:10.0:1773851864.905792:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:3.0:1773851864.905792:0:41060:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769128:8769128:1024:4294967295] 2057@kfi7 LPNI seq info [5404106:5404106:16:4294967295]
00000400:00000200:7.0:1773851864.905793:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:31.0:1773851864.905794:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:3.0:1773851864.905794:0:41060:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851864.905795:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:7.0:1773851864.905795:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:3.0:1773851864.905795:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:30.0:1773851864.905797:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:10.0:1773851864.905797:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851864.905798:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000100:00000040:10.0:1773851864.905798:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000200:30.0:1773851864.905799:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000010:10.0:1773851864.905799:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000062864d0e.
00000400:00000200:7.0:1773851864.905799:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000400:00000200:3.0:1773851864.905799:0:41060:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851864.905800:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851864.905800:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000200:10.0:1773851864.905800:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927616, offset 0
00000400:00000200:3.0:1773851864.905800:0:41060:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:31.0:1773851864.905801:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:30.0:1773851864.905801:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000400:00000200:7.0:1773851864.905801:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:3.0:1773851864.905802:0:41060:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:31.0:1773851864.905803:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:30.0:1773851864.905803:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769127, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8769129, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851864.905803:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000800:00000200:7.0:1773851864.905803:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:10.0:1773851864.905804:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:31.0:1773851864.905805:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851864.905805:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:10.0:1773851864.905805:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000800:00000200:7.0:1773851864.905805:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:3.0:1773851864.905805:0:41060:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b5c1c28f: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851864.905806:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851864.905807:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000400:00000200:10.0:1773851864.905807:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:3.0:1773851864.905807:0:41060:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b5c1c28f: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851864.905808:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851864.905808:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851864.905809:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769130:8769130:1024:4294967295] 2065@kfi7 LPNI seq info [5402828:5402828:16:4294967295]
00000400:00000200:10.0:1773851864.905809:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:31.0:1773851864.905810:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000400:00000200:30.0:1773851864.905811:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:10.0:1773851864.905811:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000800:00000200:7.0:1773851864.905811:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de Using peer 46@kfi7(0x2000000000003de)
00000800:00000200:3.0:1773851864.905811:0:41060:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b5c1c28f: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 Using peer 2057@kfi7(0x200000000000294)
00000400:00000200:30.0:1773851864.905812:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:31.0:1773851864.905814:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000400:00000200:10.0:1773851864.905814:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769130, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8769129, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851864.905815:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000800:00000200:7.0:1773851864.905815:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x2000000000003de: rc=0
00000800:00000200:3.0:1773851864.905815:0:41060:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b5c1c28f: Posted send of 324 bytes to peer 0x200000000000294: rc=0
00000800:00000200:31.0:1773851864.905816:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851864.905817:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000800:00000200:7.0:1773851864.905817:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:3.0:1773851864.905817:0:41060:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b5c1c28f: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851864.905818:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:31.0:1773851864.905819:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905819:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:30.0:1773851864.905819:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:10.0:1773851864.905819:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:7.0:1773851864.905819:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905819:0:41060:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905820:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851864.905820:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851864.905820:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000100:00000001:7.0:1773851864.905820:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851864.905820:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905820:0:41060:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851864.905821:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.905821:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905821:0:41060:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905822:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851864.905822:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851864.905822:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769131:8769131:1023:4294967295] 2055@kfi7 LPNI seq info [5404669:5404669:16:4294967295]
00000100:00000001:7.0:1773851864.905822:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851864.905822:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905823:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851864.905824:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:10.0:1773851864.905824:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:7.0:1773851864.905824:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851864.905824:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:3.0:1773851864.905824:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851864.905825:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851864.905825:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851864.905825:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:3.0:1773851864.905825:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851864.905826:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.905826:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:10.0:1773851864.905826:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:7.0:1773851864.905826:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905826:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.905827:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851864.905827:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Using peer 2065@kfi7(0x5e8)
00000100:00100000:7.0:1773851864.905827:0:41066:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00000001:7.0:1773851864.905827:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851864.905827:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:3.0:1773851864.905827:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851864.905827:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b5c1c28f: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851864.905828:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851864.905828:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851864.905828:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:5.0:1773851864.905828:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de TN_EVENT_TX_OK event status 0
00000100:00000001:3.0:1773851864.905828:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.905829:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851864.905829:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:2.0:1773851864.905829:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:30.0:1773851864.905830:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x5e8: rc=0
00000400:00000200:10.0:1773851864.905830:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851864.905830:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851864.905830:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:5.0:1773851864.905830:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851864.905830:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851864.905831:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.905831:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000100:00000001:4.0:1773851864.905831:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851864.905831:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00000800:00000200:30.0:1773851864.905832:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851864.905832:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000100:00000040:7.0:1773851864.905832:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851864.905832:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036a990bc
00000400:00000200:2.0:1773851864.905832:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f32b85c1
00000400:00000200:29.0:1773851864.905833:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000400:00000010:5.0:1773851864.905833:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036a990bc.
00000400:00000010:2.0:1773851864.905833:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f32b85c1.
00000400:00000200:29.0:1773851864.905834:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c70e405
00000800:00000200:10.0:1773851864.905834:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:5.0:1773851864.905834:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:2.0:1773851864.905834:0:2506505:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851864.905835:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.905835:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000010:29.0:1773851864.905835:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c70e405.
00000100:00000001:7.0:1773851864.905835:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851864.905835:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851864.905835:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:2.0:1773851864.905835:0:2506505:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.905836:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851864.905836:0:2467684:0:(events.c:53:request_out_callback()) Process entered
02000000:00000001:7.0:1773851864.905836:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851864.905836:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.905837:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851864.905837:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00100000:7.0:1773851864.905837:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000026a80641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051927360:2085@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851864.905838:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:29.0:1773851864.905838:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851864.905838:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:2.0:1773851864.905838:0:2506505:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851864.905839:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851864.905839:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851864.905839:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:5.0:1773851864.905839:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:2.0:1773851864.905839:0:2506505:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.905840:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851864.905840:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:7.0:1773851864.905840:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.905840:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:30.0:1773851864.905841:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851864.905841:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851864.905841:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
02000000:00000010:7.0:1773851864.905841:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000077b7cdda.
00000100:00000001:5.0:1773851864.905841:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851864.905841:0:2506505:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.905842:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.905842:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.905842:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:2.0:1773851864.905842:0:2506505:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:29.0:1773851864.905843:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:7.0:1773851864.905843:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.905843:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:31.0:1773851864.905844:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_EVENT_TX_OK event status 0
00000400:00000010:7.0:1773851864.905844:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000775957d3.
00000400:00000010:7.0:1773851864.905844:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000068cc9555.
00000400:00000200:2.0:1773851864.905844:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851864.905845:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:29.0:1773851864.905845:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:10.0:1773851864.905845:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Using peer 2055@kfi7(0x2f3)
00000100:00000200:7.0:1773851864.905845:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927360, portal 4
00000800:00000200:5.0:1773851864.905845:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de Transaction freed
00000100:00000001:7.0:1773851864.905846:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851864.905846:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528714496 : -106978180837120 : ffff9eb433885100)
00000800:00000200:2.0:1773851864.905846:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b5c1c28f: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 Transaction freed
00000400:00000200:31.0:1773851864.905847:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000400:00000200:31.0:1773851864.905847:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ea7638e8
00000400:00000010:31.0:1773851864.905848:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ea7638e8.
00000100:00000040:7.0:1773851864.905848:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851864.905849:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851864.905849:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851864.905850:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851864.905850:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:10.0:1773851864.905850:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000003858ee31: Posted send of 324 bytes to peer 0x2f3: rc=0
00000100:00000001:7.0:1773851864.905850:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851864.905851:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000100:00000001:31.0:1773851864.905852:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851864.905852:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000010:7.0:1773851864.905852:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000100:00000200:7.0:1773851864.905852:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927360, offset 0
00000100:00000040:31.0:1773851864.905853:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:10.0:1773851864.905853:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:29.0:1773851864.905854:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Transaction freed
00000400:00000200:7.0:1773851864.905854:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000400:00000200:7.0:1773851864.905854:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851864.905855:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851864.905855:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000001:31.0:1773851864.905856:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:10.0:1773851864.905856:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851864.905856:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:31.0:1773851864.905857:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:10.0:1773851864.905857:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:7.0:1773851864.905857:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000001:10.0:1773851864.905858:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851864.905859:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Transaction freed
00000400:00000200:7.0:1773851864.905859:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000800:00000200:2.0:1773851864.905859:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000001:10.0:1773851864.905860:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851864.905860:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769131, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769129, p:4294967295, g:4294967295, h:1000]
00000800:00000200:2.0:1773851864.905860:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:10.0:1773851864.905861:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851864.905862:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:2.0:1773851864.905862:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851864.905863:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:10.0:1773851864.905863:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:9.0:1773851864.905863:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_EVENT_TX_OK event status 0
00000800:00000200:13.0:1773851864.905864:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851864.905864:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:7.0:1773851864.905864:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:2.0:1773851864.905864:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:10.0:1773851864.905865:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:7.0:1773851864.905865:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851864.905865:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000800:00000200:11.0:1773851864.905866:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:10.0:1773851864.905866:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851864.905866:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851864.905866:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851864.905866:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:13.0:1773851864.905867:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:11.0:1773851864.905867:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:10.0:1773851864.905867:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851864.905867:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769132:8769132:1024:4294967295] 2085@kfi7 LPNI seq info [5403239:5403239:16:4294967295]
00000400:00000200:9.0:1773851864.905868:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000400:00000200:7.0:1773851864.905868:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:2.0:1773851864.905868:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:13.0:1773851864.905869:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:11.0:1773851864.905869:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000077a0c43c: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.905869:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000062864d0e
00000400:00000200:7.0:1773851864.905869:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:2.0:1773851864.905869:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000010:9.0:1773851864.905870:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000062864d0e.
00000400:00000200:2.0:1773851864.905870:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:13.0:1773851864.905871:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2057@kfi7 : PUT - for me
00000100:00000001:9.0:1773851864.905871:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:2.0:1773851864.905871:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:13.0:1773851864.905872:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:11.0:1773851864.905872:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000077a0c43c: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:9.0:1773851864.905872:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851864.905872:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851864.905872:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:13.0:1773851864.905873:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:7.0:1773851864.905873:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:2.0:1773851864.905873:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:13.0:1773851864.905874:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851864.905875:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:11.0:1773851864.905875:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:7.0:1773851864.905875:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:2.0:1773851864.905875:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:13.0:1773851864.905876:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:11.0:1773851864.905876:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 46@kfi7 : PUT - for me
00000800:00000200:7.0:1773851864.905876:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:2.0:1773851864.905876:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3400
00000400:00000200:11.0:1773851864.905877:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:9.0:1773851864.905877:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:2.0:1773851864.905877:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:13.0:1773851864.905878:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000040:9.0:1773851864.905878:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851864.905879:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b33c0
00000400:00000200:11.0:1773851864.905879:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000800:00000200:7.0:1773851864.905879:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851864.905880:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:2.0:1773851864.905880:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71d4c1 [1] + 224
00000400:00000200:13.0:1773851864.905881:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:11.0:1773851864.905881:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:11.0:1773851864.905882:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:7.0:1773851864.905882:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Using peer 2085@kfi7(0x200000000000110)
00000800:00000200:2.0:1773851864.905882:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851864.905883:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851864.905883:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851864.905883:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f5eed [1] + 224
00000400:00000200:11.0:1773851864.905883:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:9.0:1773851864.905883:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851864.905884:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3380
00000100:00000001:9.0:1773851864.905884:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:2.0:1773851864.905884:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851864.905885:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851864.905885:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851864.905885:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.905885:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:7.0:1773851864.905885:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x200000000000110: rc=0
00000400:00000200:2.0:1773851864.905885:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000100:00000001:2.0:1773851864.905886:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851864.905887:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851864.905887:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x7816977e9 [1] + 224
00000800:00000200:7.0:1773851864.905887:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:17.0:1773851864.905888:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851864.905888:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00000800:00000200:9.0:1773851864.905888:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Transaction freed
00000100:00000200:2.0:1773851864.905888:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851864.905889:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000077a0c43c: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851864.905889:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.905889:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:17.0:1773851864.905890:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:13.0:1773851864.905890:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851864.905890:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:13.0:1773851864.905891:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851864.905891:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851864.905891:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.905891:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851864.905891:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851864.905892:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:11.0:1773851864.905892:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000400:00000200:17.0:1773851864.905893:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:11.0:1773851864.905893:0:2510946:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851864.905894:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000100:00000040:13.0:1773851864.905894:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851864.905894:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:11.0:1773851864.905895:0:2510946:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851864.905895:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:17.0:1773851864.905896:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:17.0:1773851864.905896:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:31.0:1773851864.905897:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.905897:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:17.0:1773851864.905897:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000001:13.0:1773851864.905897:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:11.0:1773851864.905897:0:2510946:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:2.0:1773851864.905897:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851864.905898:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:13.0:1773851864.905898:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:6.0:1773851864.905898:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_EVENT_TX_OK event status 0
00000400:00000001:31.0:1773851864.905899:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851864.905899:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000200:17.0:1773851864.905899:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:6.0:1773851864.905899:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:3.0:1773851864.905899:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851864.905900:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d81a04c
00000400:00000200:17.0:1773851864.905900:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3480
00000800:00000200:13.0:1773851864.905900:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:6.0:1773851864.905900:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000001:3.0:1773851864.905900:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:31.0:1773851864.905901:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d81a04c.
00000100:00000001:31.0:1773851864.905901:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851864.905901:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:11.0:1773851864.905901:0:2510946:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:6.0:1773851864.905901:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000001:3.0:1773851864.905901:0:41060:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:3.0:1773851864.905901:0:41060:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:31.0:1773851864.905902:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851864.905902:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f0eb1 [1] + 224
00000400:00000200:11.0:1773851864.905902:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000010:6.0:1773851864.905902:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000100:00000001:6.0:1773851864.905902:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000010:3.0:1773851864.905902:0:41060:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ac2e5b72.
00000100:00000001:7.0:1773851864.905903:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:6.0:1773851864.905903:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:3.0:1773851864.905903:0:41060:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006aa38b71
00000400:00000010:3.0:1773851864.905903:0:41060:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006aa38b71.
00000800:00000200:17.0:1773851864.905904:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851864.905904:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000077a0c43c: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851864.905904:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:3.0:1773851864.905904:0:41060:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:7.0:1773851864.905905:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851864.905905:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:3.0:1773851864.905905:0:41060:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851864.905906:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851864.905906:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:7.0:1773851864.905906:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000100:00000001:6.0:1773851864.905906:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:17.0:1773851864.905907:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000400:00000200:7.0:1773851864.905907:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000400:00000010:7.0:1773851864.905907:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000100:00000040:6.0:1773851864.905907:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851864.905908:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851864.905908:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:17.0:1773851864.905908:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851864.905908:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:3.0:1773851864.905908:0:41060:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851864.905909:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851864.905909:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905910:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:21.0:1773851864.905910:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:17.0:1773851864.905910:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851864.905910:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:3.0:1773851864.905910:0:41060:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851864.905911:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851864.905911:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:3.0:1773851864.905911:0:41060:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851864.905911:0:41060:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851864.905912:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851864.905912:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000800:00000200:21.0:1773851864.905912:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:7.0:1773851864.905912:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:3.0:1773851864.905912:0:41060:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851864.905913:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:17.0:1773851864.905913:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851864.905913:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Transaction freed
00000100:00000001:3.0:1773851864.905913:0:41060:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:3.0:1773851864.905913:0:41060:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905914:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851864.905914:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
02000000:00000001:3.0:1773851864.905914:0:41060:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851864.905915:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851864.905915:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2055@kfi7 : PUT - for me
00000100:00000001:7.0:1773851864.905915:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851864.905915:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:3.0:1773851864.905915:0:41060:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=97 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851864.905916:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=97 v=66 (66 66 66 66)
00000400:00000200:21.0:1773851864.905916:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:7.0:1773851864.905916:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851864.905916:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:31.0:1773851864.905917:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=97 v=66 (1 1 1 1)
00000400:00000200:21.0:1773851864.905917:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000100:00000001:17.0:1773851864.905917:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851864.905917:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:3.0:1773851864.905917:0:41060:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=97 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851864.905918:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851864.905918:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:21.0:1773851864.905918:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:17.0:1773851864.905918:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:7.0:1773851864.905918:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851864.905918:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905918:0:41060:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:3.0:1773851864.905918:0:41060:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905919:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.905919:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851864.905919:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:17.0:1773851864.905919:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00001000:7.0:1773851864.905919:0:41066:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=97 v=66 (66 66 66 66)
00010000:00000001:3.0:1773851864.905919:0:41060:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:3.0:1773851864.905919:0:41060:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851864.905920:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851864.905920:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:30.0:1773851864.905920:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:21.0:1773851864.905920:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000100:00001000:7.0:1773851864.905920:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=97 v=66 (1 1 1 1)
00000100:00000001:3.0:1773851864.905920:0:41060:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851864.905921:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:30.0:1773851864.905921:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:21.0:1773851864.905921:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:7.0:1773851864.905921:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:3.0:1773851864.905921:0:41060:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00000001:3.0:1773851864.905921:0:41060:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:31.0:1773851864.905922:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:31.0:1773851864.905922:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:30.0:1773851864.905922:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851864.905922:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000200:21.0:1773851864.905922:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3440
00000100:00000001:7.0:1773851864.905922:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851864.905922:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:3.0:1773851864.905922:0:41060:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905923:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851864.905923:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000400:00000200:21.0:1773851864.905923:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00010000:00000001:7.0:1773851864.905923:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851864.905923:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851864.905924:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.905924:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851864.905924:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d0b75 [1] + 224
00000100:00000001:7.0:1773851864.905924:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851864.905924:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000200:30.0:1773851864.905925:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851864.905925:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851864.905925:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851864.905925:0:41060:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:21.0:1773851864.905926:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:3.0:1773851864.905926:0:41060:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851864.905927:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851864.905927:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:7.0:1773851864.905927:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:3.0:1773851864.905927:0:41060:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:3.0:1773851864.905927:0:41060:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851864.905928:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:30.0:1773851864.905928:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851864.905928:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000040:3.0:1773851864.905928:0:41060:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000004:00000001:31.0:1773851864.905929:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851864.905929:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000400:00000200:21.0:1773851864.905929:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:7.0:1773851864.905929:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:3.0:1773851864.905929:0:41060:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406570496 avail=351404219392 avail_mb=1372672732 hwm_mb=3131103 files=372127307 ffree=343170479 state=0: rc = 0
00000004:00000040:31.0:1773851864.905930:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545871360 avail=351536201728 avail_mb=1373188288 hwm_mb=3131103 files=372116519 ffree=343306515 state=0: rc = 0
00000100:00000001:21.0:1773851864.905930:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851864.905930:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851864.905930:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851864.905931:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851864.905931:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:21.0:1773851864.905931:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851864.905931:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:3.0:1773851864.905931:0:41060:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406570496 free, 351404219392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127307 files, 343170479 free files
00000004:00000020:31.0:1773851864.905932:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545871360 free, 351536201728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116519 files, 343306515 free files
00000100:00000001:30.0:1773851864.905932:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851864.905932:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000040:7.0:1773851864.905932:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851864.905932:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489089536 avail=351486044160 avail_mb=1372992360 hwm_mb=3131103 files=372066870 ffree=343251064 state=0: rc = 0
00000800:00000200:5.0:1773851864.905932:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:30.0:1773851864.905933:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851864.905933:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000004:00000001:3.0:1773851864.905933:0:41060:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851864.905934:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851864.905934:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851864.905934:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851864.905934:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:7.0:1773851864.905934:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489089536 free, 351486044160 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066870 files, 343251064 free files
00000100:00000040:3.0:1773851864.905934:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851864.905935:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:5.0:1773851864.905935:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:30.0:1773851864.905936:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=97 v=66 (66 66 66 66)
00000004:00000001:7.0:1773851864.905936:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851864.905936:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:3.0:1773851864.905936:0:41060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000813226cd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051927488:2057@kfi7:13:default-yuba2-0
00000100:00001000:30.0:1773851864.905937:0:41089:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=97 v=66 (1 1 1 1)
00000800:00000200:5.0:1773851864.905937:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00100000:31.0:1773851864.905938:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000242f3500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051927552:2056@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851864.905938:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851864.905938:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851864.905938:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:3.0:1773851864.905938:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:30.0:1773851864.905939:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:5.0:1773851864.905939:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:3.0:1773851864.905939:0:41060:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:3.0:1773851864.905939:0:41060:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000813226cd x1859433051927488/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:30.0:1773851864.905940:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851864.905940:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:5.0:1773851864.905940:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2085@kfi7 : PUT - for me
00000100:00000001:31.0:1773851864.905941:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851864.905941:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851864.905941:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851864.905941:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000800:00000200:21.0:1773851864.905941:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:5.0:1773851864.905941:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:30.0:1773851864.905942:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851864.905942:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.905942:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851864.905942:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:7.0:1773851864.905942:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067340e10 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051927424:46@kfi7:13:default-yuba2-0
00000400:00000200:5.0:1773851864.905942:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000001:3.0:1773851864.905942:0:41060:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:3.0:1773851864.905942:0:41060:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:31.0:1773851864.905943:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000242f3500 x1859433051927552/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851864.905943:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851864.905943:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
02000000:00000010:3.0:1773851864.905943:0:41060:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001093bef2.
00000400:00000001:10.0:1773851864.905944:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:7.0:1773851864.905944:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.905944:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851864.905944:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
02000000:00000001:3.0:1773851864.905944:0:41060:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:3.0:1773851864.905944:0:41060:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:31.0:1773851864.905945:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000001:10.0:1773851864.905945:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:7.0:1773851864.905945:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000067340e10 x1859433051927424/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851864.905945:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000020:00000040:3.0:1773851864.905945:0:41060:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000020:00000001:3.0:1773851864.905945:0:41060:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:31.0:1773851864.905946:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851864.905946:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f353b924.
00000100:00000001:30.0:1773851864.905946:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:10.0:1773851864.905946:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d3517e37.
00000400:00000200:5.0:1773851864.905946:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
02000000:00000010:3.0:1773851864.905946:0:41060:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000076d63e2f.
02000000:00000001:31.0:1773851864.905947:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851864.905947:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:10.0:1773851864.905947:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000033620fd9
00000400:00000200:5.0:1773851864.905947:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3340
02000000:00000001:3.0:1773851864.905947:0:41060:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:31.0:1773851864.905948:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851864.905948:0:41088:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:30.0:1773851864.905948:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851864.905948:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000010:10.0:1773851864.905948:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000033620fd9.
00000100:00000001:7.0:1773851864.905948:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851864.905948:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:5.0:1773851864.905948:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
02000000:00000001:3.0:1773851864.905948:0:41060:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:3.0:1773851864.905948:0:41060:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000813226cd.
00000020:00000001:31.0:1773851864.905949:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000040:30.0:1773851864.905949:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000100:00000001:10.0:1773851864.905949:0:41069:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000010:7.0:1773851864.905949:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002b002509.
00000400:00000200:5.0:1773851864.905949:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b30b65 [1] + 224
00000100:00000001:3.0:1773851864.905949:0:41060:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:3.0:1773851864.905949:0:41060:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:31.0:1773851864.905950:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000004:00000040:30.0:1773851864.905950:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464092672 avail=351458266112 avail_mb=1372883852 hwm_mb=3131101 files=372060756 ffree=343226653 state=0: rc = 0
00000100:00000200:10.0:1773851864.905950:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851864.905950:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851864.905951:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851864.905951:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:7.0:1773851864.905951:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851864.905951:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851864.905951:0:41066:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000800:00000200:5.0:1773851864.905951:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:3.0:1773851864.905951:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:3.0:1773851864.905951:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:31.0:1773851864.905952:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000242f3500.
00000004:00000020:30.0:1773851864.905952:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464092672 free, 351458266112 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372060756 files, 343226653 free files
00000020:00000001:7.0:1773851864.905952:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:3.0:1773851864.905952:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:3.0:1773851864.905952:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851864.905953:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851864.905953:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851864.905953:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851864.905953:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000c0831f5b.
00000400:00000200:5.0:1773851864.905953:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851864.905954:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851864.905954:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851864.905954:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851864.905954:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000400:00000200:5.0:1773851864.905954:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000001:31.0:1773851864.905955:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851864.905955:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:7.0:1773851864.905955:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000067340e10.
00000100:00000001:5.0:1773851864.905955:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851864.905956:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851864.905956:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851864.905956:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851864.905956:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851864.905956:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:5.0:1773851864.905956:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:30.0:1773851864.905957:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000080f3d539 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051927680:2065@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851864.905957:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.905957:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851864.905958:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851864.905959:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851864.905959:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851864.905959:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851864.905960:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000080f3d539 x1859433051927680/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851864.905960:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851864.905961:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851864.905962:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:10.0:1773851864.905962:0:41069:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:5.0:1773851864.905962:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:30.0:1773851864.905963:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851864.905963:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008f05475e.
02000000:00000001:10.0:1773851864.905963:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851864.905964:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:5.0:1773851864.905964:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
02000000:00000001:30.0:1773851864.905965:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851864.905965:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:10.0:1773851864.905965:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:30.0:1773851864.905966:0:41089:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
02000000:00000001:10.0:1773851864.905966:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851864.905966:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:4.0:1773851864.905966:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851864.905966:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000020:00000001:30.0:1773851864.905967:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851864.905967:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000aecc56ef.
00000400:00000010:4.0:1773851864.905967:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000775957d3.
00000400:00000200:4.0:1773851864.905967:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000068cc9555
02000000:00000001:30.0:1773851864.905968:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:10.0:1773851864.905968:0:41069:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=97 v=66 (66 66 66 66)
00000400:00000010:4.0:1773851864.905968:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000068cc9555.
02000000:00000001:30.0:1773851864.905969:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851864.905969:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000080f3d539.
00000100:00000001:4.0:1773851864.905969:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:10.0:1773851864.905970:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=97 v=66 (1 1 1 1)
00000100:00000200:4.0:1773851864.905970:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.905971:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851864.905971:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851864.905971:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851864.905972:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851864.905972:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851864.905973:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.905973:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851864.905973:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851864.905974:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851864.905974:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851864.905974:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851864.905975:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.905975:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851864.905975:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851864.905976:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:4.0:1773851864.905976:0:41066:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:10.0:1773851864.905977:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
02000000:00000001:4.0:1773851864.905977:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851864.905977:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851864.905978:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851864.905978:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851864.905978:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.905979:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851864.905980:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:4.0:1773851864.905980:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=97 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851864.905980:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=97 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851864.905981:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851864.905982:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851864.905982:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851864.905983:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.905984:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851864.905984:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000001:10.0:1773851864.905985:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851864.905985:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851864.905985:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.905986:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851864.905987:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851864.905987:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:10.0:1773851864.905988:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851864.905989:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00000001:4.0:1773851864.905989:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851864.905990:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851864.905990:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:10.0:1773851864.905991:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382762496 avail=351380691968 avail_mb=1372580828 hwm_mb=3131101 files=371978746 ffree=343147229 state=0: rc = 0
00000004:00000001:4.0:1773851864.905991:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851864.905991:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851864.905992:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351466000384 avail=351462857728 avail_mb=1372901788 hwm_mb=3131103 files=372062875 ffree=343228516 state=0: rc = 0
00000004:00000020:10.0:1773851864.905994:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382762496 free, 351380691968 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978746 files, 343147229 free files
00000004:00000020:4.0:1773851864.905994:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351466000384 free, 351462857728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062875 files, 343228516 free files
00000004:00000001:4.0:1773851864.905995:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851864.905996:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:10.0:1773851864.905997:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851864.905999:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851864.905999:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000026a80641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051927360:2085@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851864.906001:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.906002:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851864.906002:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000026a80641 x1859433051927360/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851864.906004:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec171328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051927616:2055@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851864.906005:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851864.906005:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851864.906006:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000077b7cdda.
00000100:00000001:10.0:1773851864.906007:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851864.906007:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851864.906007:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851864.906007:0:41066:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000100:00000001:10.0:1773851864.906008:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:4.0:1773851864.906008:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:10.0:1773851864.906009:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ec171328 x1859433051927616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852017 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:4.0:1773851864.906009:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d7ad89bf.
02000000:00000001:4.0:1773851864.906009:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851864.906010:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851864.906010:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000026a80641.
00000100:00000001:4.0:1773851864.906011:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851864.906012:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.906012:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851864.906013:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851864.906014:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851864.906014:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851864.906015:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.906018:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851864.906019:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851864.906020:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bef83544.
02000000:00000001:10.0:1773851864.906022:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851864.906022:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851864.906023:0:41069:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000020:00000001:10.0:1773851864.906024:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851864.906025:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:10.0:1773851864.906027:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851864.906027:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851864.906028:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec171328.
00000100:00000001:10.0:1773851864.906029:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851864.906030:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851864.906031:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851864.906032:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851864.906033:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851864.906034:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851864.906035:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851864.947231:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851864.947231:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851864.947232:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851864.947232:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851864.947233:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851864.947234:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851864.947235:0:2464469:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14034@kfi7(00000000a2eece40):0x8ea version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851864.947237:0:2464469:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea Using peer 14034@kfi7(0x1000000000008ea)
00000800:00000200:9.0:1773851864.947238:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851864.947239:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14034@kfi7 to cpt 2
00000800:00000200:10.0:1773851864.947241:0:2464469:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000333a7eb2: Posted send of 38 bytes to peer 0x1000000000008ea: rc=0
00000400:00000200:9.0:1773851864.947241:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14034@kfi7 to cpt 2
00000800:00000200:10.0:1773851864.947242:0:2464469:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851864.947242:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14034@kfi7 : PUT - for me
00000400:00000200:9.0:1773851864.947244:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14034@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.947245:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aee430be nid 14034@kfi7 refs 1
00000400:00000200:9.0:1773851864.947247:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14034@kfi7 to cpt 2
00000400:00000200:9.0:1773851864.947248:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aee430be nid 14034@kfi7 refs 2
00000400:00000200:9.0:1773851864.947250:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aee430be nid 14034@kfi7 refs 3
00000400:00000200:9.0:1773851864.947251:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14035@kfi7 to cpt 5
00000400:00000200:9.0:1773851864.947253:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14035@kfi7 of length 224 into portal 12 MB=0x699e0df31b880
00000800:00000200:10.0:1773851864.947256:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851864.947256:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14035@kfi7 of length 224/224 into md 0x78146ce49 [64] + 133968
00000800:00000200:10.0:1773851864.947259:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea Transaction freed
00000800:00000200:9.0:1773851864.947259:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851864.947262:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851864.947263:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14034@kfi7: PUT: OK
00000100:00000001:9.0:1773851864.947265:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851864.947266:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851864.947268:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000887c70bf.
00000100:00000040:9.0:1773851864.947269:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000887c70bf x1858040956565632 msgsize 224
00000100:00100000:9.0:1773851864.947272:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14035@kfi7 (source: 12345-14034@kfi7)
00000100:00000001:9.0:1773851864.947274:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851864.947275:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aee430be nid 14034@kfi7 refs 2
00000800:00000200:9.0:1773851864.947277:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851864.947282:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851864.947283:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851864.947284:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851864.947285:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851864.947286:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851864.947287:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040956565632
00000020:00000001:9.0:1773851864.947288:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851864.947289:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ca2
00000020:00000001:9.0:1773851864.947290:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851864.947293:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000b7d1370 refcount=6
00000020:00000001:9.0:1773851864.947294:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628295680 : -107123081255936 : ffff9e9276cb6400)
00000020:00000001:9.0:1773851864.947295:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628295680 : -107123081255936 : ffff9e9276cb6400)
00000100:00000001:9.0:1773851864.947297:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851864.947298:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851864.947299:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000275fbc19.
00000020:00000010:9.0:1773851864.947301:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851864.947302:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000198be600.
00000100:00000001:9.0:1773851864.947303:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851864.947304:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851864.947306:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851864.947307:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851864.947308:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851864.947309:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.947310:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851864.947312:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851864.947312:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851864.947313:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851864.947313:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851864.947314:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14035@kfi7, seq: 2130778
00000100:00000040:11.0:1773851864.947315:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000b7d1370 : new rpc_count 1
00000100:00000001:11.0:1773851864.947315:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637056510618624 : -107017198932992 : ffff9eab1ddf6c00)
00000100:00000001:9.0:1773851864.947315:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851864.947316:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851864.947317:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000887c70bf x1858040956565632/t0(0) o400->8ba1d058-c553-4348-991a-4ae5ee2fe901@14035@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1365-0'
00000100:00000001:11.0:1773851864.947320:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851864.947320:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851864.947321:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000887c70bf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8ba1d058-c553-4348-991a-4ae5ee2fe901+6:39693:x1858040956565632:12345-14035@kfi7:400:default-tuolumne1365-0
00000100:00000200:11.0:1773851864.947322:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040956565632
00000020:00000001:11.0:1773851864.947323:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851864.947323:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851864.947324:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851864.947325:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851864.947325:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851864.947326:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851864.947326:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040956565632, found 0 last_xid 1858040956565631
00000020:00000001:11.0:1773851864.947327:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851864.947328:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851864.947328:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851864.947329:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851864.947330:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851864.947330:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851864.947331:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851864.947331:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006c3ed247.
02000000:00000001:11.0:1773851864.947332:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851864.947333:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851864.947334:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851864.947334:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096699206, transno 0, xid 1858040956565632
00010000:00000001:11.0:1773851864.947335:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851864.947336:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000887c70bf x1858040956565632/t0(0) o400->8ba1d058-c553-4348-991a-4ae5ee2fe901@14035@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1365-0'
00010000:00000001:11.0:1773851864.947338:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851864.947339:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851864.947340:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=97 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851864.947341:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851864.947342:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e8d1da04 refcount 3 to 14035@kfi7
00000100:00000001:11.0:1773851864.947342:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106688 : -107156354444928 : ffff9e8ab78ed180)
02000000:00000001:11.0:1773851864.947343:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851864.947344:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851864.947345:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851864.947345:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14034@kfi7
00000400:00000010:11.0:1773851864.947346:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000100:00000200:11.0:1773851864.947347:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040956565632, offset 224
00000400:00000200:11.0:1773851864.947348:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14034@kfi7
00000400:00000200:11.0:1773851864.947349:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14034@kfi7 to cpt 2
00000400:00000200:11.0:1773851864.947350:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aee430be nid 14034@kfi7 refs 1
00000400:00000200:11.0:1773851864.947351:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aee430be nid 14034@kfi7 refs 2
00000400:00000200:11.0:1773851864.947352:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aee430be nid 14034@kfi7 refs 3
00000400:00000200:11.0:1773851864.947353:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14034@kfi7 local destination
00000400:00000200:11.0:1773851864.947354:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769133:8769133:1024:4294967295] 14034@kfi7 LPNI seq info [9074395:9074395:16:4294967295]
00000400:00000200:11.0:1773851864.947356:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aee430be nid 14034@kfi7 refs 2
00000400:00000200:11.0:1773851864.947357:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14034@kfi7 to cpt 2
00000400:00000200:11.0:1773851864.947359:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14034@kfi7(14034@kfi7:14034@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851864.947360:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aee430be nid 14034@kfi7 refs 3
00000800:00000200:11.0:1773851864.947361:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851864.947362:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851864.947364:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851864.947367:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea Using peer 14034@kfi7(0x1000000000008ea)
00000800:00000200:11.0:1773851864.947369:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x1000000000008ea: rc=0
00000800:00000200:11.0:1773851864.947371:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851864.947373:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851864.947374:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e8d1da04 refcount 2 to 14035@kfi7
00010000:00000001:11.0:1773851864.947374:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851864.947375:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851864.947376:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851864.947376:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000887c70bf x1858040956565632/t0(0) o400->8ba1d058-c553-4348-991a-4ae5ee2fe901@14035@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1365-0'
00000100:00100000:11.0:1773851864.947379:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000887c70bf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8ba1d058-c553-4348-991a-4ae5ee2fe901+6:39693:x1858040956565632:12345-14035@kfi7:400:default-tuolumne1365-0 Request processed in 59us (109us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851864.947381:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14035@kfi7, seq: 2130778
00000100:00000040:11.0:1773851864.947382:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000b7d1370 : new rpc_count 0
00000100:00000001:11.0:1773851864.947383:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851864.947383:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851864.947384:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000800:00000200:10.0:1773851864.947384:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851864.947385:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000198be600.
00000020:00000010:11.0:1773851864.947386:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000275fbc19.
00000400:00000200:10.0:1773851864.947386:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:11.0:1773851864.947387:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000000b7d1370 : new refcount 5
00000100:00000001:11.0:1773851864.947387:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851864.947387:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14034@kfi7: PUT: OK
00000400:00000200:10.0:1773851864.947388:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000400:00000010:10.0:1773851864.947388:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000100:00000001:10.0:1773851864.947389:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851864.947389:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851864.947390:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aee430be nid 14034@kfi7 refs 2
00000800:00000200:10.0:1773851864.947392:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 14034@kfi7(00000000a2eece40):0x0 lsk 2283 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008ea Transaction freed
00000800:00000200:5.0:1773851864.960463:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.960464:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851864.960466:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851864.960468:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851864.960469:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11264@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.960470:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11264@kfi7 : PUT - for me
00000400:00000200:5.0:1773851864.960471:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11264@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.960472:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000774583ae nid 11264@kfi7 refs 1
00000400:00000200:5.0:1773851864.960473:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11264@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.960474:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000774583ae nid 11264@kfi7 refs 2
00000400:00000200:5.0:1773851864.960474:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000774583ae nid 11264@kfi7 refs 3
00000400:00000200:5.0:1773851864.960475:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11264@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.960476:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11264@kfi7 of length 224 into portal 12 MB=0x69b0a3abbe580
00000400:00000200:5.0:1773851864.960477:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11264@kfi7 of length 224/224 into md 0x793926dc5 [64] + 133208
00000800:00000200:5.0:1773851864.960479:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851864.960481:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851864.960482:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11264@kfi7: PUT: OK
00000100:00000001:5.0:1773851864.960483:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851864.960483:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851864.960484:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007574b8c7.
00000100:00000040:5.0:1773851864.960485:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000007574b8c7 x1859318097634688 msgsize 224
00000100:00100000:5.0:1773851864.960486:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-11264@kfi7 (source: 12345-11264@kfi7)
00000100:00000001:5.0:1773851864.960488:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851864.960488:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000774583ae nid 11264@kfi7 refs 2
00000800:00000200:5.0:1773851864.960490:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851864.960492:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851864.960493:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851864.960493:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851864.960494:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851864.960495:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851864.960496:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318097634688
00000020:00000001:5.0:1773851864.960496:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851864.960497:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9143d
00000020:00000001:5.0:1773851864.960497:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851864.960499:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef5f5ab7 refcount=6
00000020:00000001:5.0:1773851864.960500:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240784896 : -107152468766720 : ffff9e8b9f299000)
00000020:00000001:5.0:1773851864.960501:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240784896 : -107152468766720 : ffff9e8b9f299000)
00000100:00000001:5.0:1773851864.960502:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.960503:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851864.960503:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9b9985c.
00000020:00000010:5.0:1773851864.960504:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851864.960505:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851864.960506:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851864.960506:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851864.960507:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851864.960508:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851864.960508:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851864.960509:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.960510:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851864.960511:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851864.960511:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851864.960511:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851864.960511:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851864.960512:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11264@kfi7, seq: 2001908
00000100:00000001:7.0:1773851864.960513:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851864.960513:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.960513:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef5f5ab7 : new rpc_count 1
00000100:00000001:5.0:1773851864.960514:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886784256 : -106955822767360 : ffff9eb9682d6300)
00000100:00000040:5.0:1773851864.960515:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007574b8c7 x1859318097634688/t0(0) o400->1d468ba7-50d6-4dc2-9980-6af359bc0a91@11264@kfi7:591/0 lens 224/0 e 0 to 0 dl 1773851951 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1203-0'
00000100:00000001:5.0:1773851864.960517:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851864.960518:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851864.960519:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007574b8c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1d468ba7-50d6-4dc2-9980-6af359bc0a91+6:39642:x1859318097634688:12345-11264@kfi7:400:default-tuolumne1203-0
00000100:00000200:5.0:1773851864.960520:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318097634688
00000020:00000001:5.0:1773851864.960520:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851864.960521:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851864.960522:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.960523:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851864.960523:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851864.960524:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851864.960525:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318097634688, found 0 last_xid 1859318097634687
00000020:00000001:5.0:1773851864.960526:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851864.960526:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851864.960527:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851864.960527:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.960528:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851864.960528:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851864.960529:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851864.960530:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002862846c.
02000000:00000001:5.0:1773851864.960530:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.960531:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.960532:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851864.960532:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691471, transno 0, xid 1859318097634688
00010000:00000001:5.0:1773851864.960533:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851864.960534:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007574b8c7 x1859318097634688/t0(0) o400->1d468ba7-50d6-4dc2-9980-6af359bc0a91@11264@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1203-0'
00010000:00000001:5.0:1773851864.960536:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851864.960537:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851864.960537:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=96 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851864.960538:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851864.960539:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000028d640e2 refcount 3 to 11264@kfi7
00000100:00000001:5.0:1773851864.960540:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701536 : -107156155850080 : ffff9e8ac36522a0)
02000000:00000001:5.0:1773851864.960541:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851864.960541:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851864.960542:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851864.960542:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11264@kfi7
00000400:00000010:5.0:1773851864.960543:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d24f1d0e.
00000100:00000200:5.0:1773851864.960544:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318097634688, offset 224
00000400:00000200:5.0:1773851864.960545:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11264@kfi7
00000400:00000200:5.0:1773851864.960546:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11264@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.960547:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000774583ae nid 11264@kfi7 refs 1
00000400:00000200:5.0:1773851864.960548:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000774583ae nid 11264@kfi7 refs 2
00000400:00000200:5.0:1773851864.960549:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000774583ae nid 11264@kfi7 refs 3
00000400:00000200:5.0:1773851864.960550:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11264@kfi7 local destination
00000400:00000200:5.0:1773851864.960551:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769134:8769134:1024:4294967295] 11264@kfi7 LPNI seq info [173345:173345:16:4294967295]
00000400:00000200:5.0:1773851864.960553:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000774583ae nid 11264@kfi7 refs 2
00000400:00000200:5.0:1773851864.960553:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11264@kfi7 to cpt 1
00000400:00000200:5.0:1773851864.960555:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11264@kfi7(11264@kfi7:11264@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851864.960556:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000774583ae nid 11264@kfi7 refs 3
00000800:00000200:5.0:1773851864.960557:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851864.960558:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851864.960560:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851864.960563:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x49a Using peer 11264@kfi7(0x49a)
00000800:00000200:5.0:1773851864.960565:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 324 bytes to peer 0x49a: rc=0
00000800:00000200:5.0:1773851864.960567:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x49a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851864.960569:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851864.960570:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000028d640e2 refcount 2 to 11264@kfi7
00010000:00000001:5.0:1773851864.960570:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851864.960571:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851864.960571:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851864.960572:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007574b8c7 x1859318097634688/t0(0) o400->1d468ba7-50d6-4dc2-9980-6af359bc0a91@11264@kfi7:591/0 lens 224/224 e 0 to 0 dl 1773851951 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1203-0'
00000100:00100000:5.0:1773851864.960575:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007574b8c7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1d468ba7-50d6-4dc2-9980-6af359bc0a91+6:39642:x1859318097634688:12345-11264@kfi7:400:default-tuolumne1203-0 Request processed in 57us (90us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851864.960577:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11264@kfi7, seq: 2001908
00000100:00000040:5.0:1773851864.960578:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef5f5ab7 : new rpc_count 0
00000800:00000200:6.0:1773851864.960579:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x49a TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851864.960579:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851864.960579:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851864.960580:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851864.960581:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851864.960581:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000400:00000200:6.0:1773851864.960582:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11264@kfi7: PUT: OK
00000400:00000200:6.0:1773851864.960582:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d24f1d0e
00000020:00000010:5.0:1773851864.960582:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9b9985c.
00000020:00000040:5.0:1773851864.960582:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000ef5f5ab7 : new refcount 5
00000400:00000010:6.0:1773851864.960583:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d24f1d0e.
00000100:00000001:5.0:1773851864.960583:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851864.960584:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851864.960584:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851864.960585:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000774583ae nid 11264@kfi7 refs 2
00000800:00000200:6.0:1773851864.960586:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2069@kfi7:1 -> 11264@kfi7(00000000adcba34b):0x0 lsk 1179 rsk 43 tsk 0 trmk 0 tmk 0 trr 1 tta 0x49a Transaction freed
00000400:00000200:29.0:1773851864.969734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851864.969735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:29.0:1773851865.096593:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851865.096594:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851865.096596:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851865.096598:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851865.096600:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11771@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.096601:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11771@kfi7 : PUT - for me
00000400:00000200:29.0:1773851865.096602:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11771@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.096603:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cf58589 nid 11771@kfi7 refs 1
00000400:00000200:29.0:1773851865.096604:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11771@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.096605:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cf58589 nid 11771@kfi7 refs 2
00000400:00000200:29.0:1773851865.096606:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006cf58589 nid 11771@kfi7 refs 3
00000400:00000200:29.0:1773851865.096607:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11770@kfi7 to cpt 4
00000400:00000200:29.0:1773851865.096608:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11770@kfi7 of length 224 into portal 12 MB=0x699de8cea74c0
00000400:00000200:29.0:1773851865.096609:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11770@kfi7 of length 224/224 into md 0x77fe139dd [64] + 173064
00000800:00000200:29.0:1773851865.096611:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851865.096613:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851865.096614:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11771@kfi7: PUT: OK
00000100:00000001:29.0:1773851865.096615:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851865.096616:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851865.096617:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000211d2bff.
00000100:00000040:29.0:1773851865.096618:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000211d2bff x1858030986228928 msgsize 224
00000100:00100000:29.0:1773851865.096619:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11770@kfi7 (source: 12345-11771@kfi7)
00000100:00000001:29.0:1773851865.096620:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851865.096621:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006cf58589 nid 11771@kfi7 refs 2
00000100:00000001:28.0:1773851865.096622:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851865.096623:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851865.096623:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851865.096624:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851865.096624:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851865.096625:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851865.096626:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030986228928
00000020:00000001:28.0:1773851865.096627:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851865.096627:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f19
00000020:00000001:28.0:1773851865.096628:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851865.096632:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d54ce321 refcount=6
00000020:00000001:28.0:1773851865.096633:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239895040 : -107152469656576 : ffff9e8b9f1bfc00)
00000020:00000001:28.0:1773851865.096634:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239895040 : -107152469656576 : ffff9e8b9f1bfc00)
00000100:00000001:28.0:1773851865.096635:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851865.096636:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851865.096637:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9820241.
00000020:00000010:28.0:1773851865.096638:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851865.096639:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f776f930.
00000100:00000001:28.0:1773851865.096640:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851865.096640:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851865.096641:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851865.096642:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851865.096643:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851865.096643:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851865.096644:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.096646:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851865.096646:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851865.096647:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851865.096647:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851865.096648:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11770@kfi7, seq: 2055509
00000100:00000040:31.0:1773851865.096649:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d54ce321 : new rpc_count 1
00000100:00000001:31.0:1773851865.096649:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343715712 : -106994365835904 : ffff9eb06ed4d580)
00000100:00000001:28.0:1773851865.096649:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851865.096650:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.096651:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000211d2bff x1858030986228928/t0(0) o400->3fb471d0-e068-4e01-bf5c-0116996fc5ed@11770@kfi7:653/0 lens 224/0 e 0 to 0 dl 1773852013 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne214-0'
00000100:00000001:31.0:1773851865.096654:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.096654:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851865.096655:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000211d2bff pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:3fb471d0-e068-4e01-bf5c-0116996fc5ed+6:47939:x1858030986228928:12345-11770@kfi7:400:default-tuolumne214-0
00000100:00000200:31.0:1773851865.096657:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030986228928
00000020:00000001:31.0:1773851865.096658:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851865.096658:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851865.096659:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.096660:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851865.096661:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851865.096662:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851865.096662:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030986228928, found 0 last_xid 1858030986228927
00000020:00000001:31.0:1773851865.096663:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851865.096664:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851865.096664:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851865.096665:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.096666:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851865.096666:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851865.096667:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851865.096668:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000259b265.
02000000:00000001:31.0:1773851865.096668:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.096669:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.096670:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851865.096670:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030986228928
00010000:00000001:31.0:1773851865.096671:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851865.096672:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000211d2bff x1858030986228928/t0(0) o400->3fb471d0-e068-4e01-bf5c-0116996fc5ed@11770@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne214-0'
00010000:00000001:31.0:1773851865.096674:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851865.096675:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851865.096676:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=98 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851865.096677:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851865.096677:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005cfbebc1 refcount 5 to 11770@kfi7
00000100:00000001:31.0:1773851865.096678:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992224 : -107142345559392 : ffff9e8dfa8d72a0)
02000000:00000001:31.0:1773851865.096679:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851865.096680:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.096680:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851865.096681:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11771@kfi7
00000400:00000010:31.0:1773851865.096682:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d81a04c.
00000100:00000200:31.0:1773851865.096683:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030986228928, offset 224
00000400:00000200:31.0:1773851865.096684:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11771@kfi7
00000400:00000200:31.0:1773851865.096686:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11771@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.096686:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cf58589 nid 11771@kfi7 refs 1
00000400:00000200:31.0:1773851865.096687:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006cf58589 nid 11771@kfi7 refs 2
00000400:00000200:31.0:1773851865.096688:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006cf58589 nid 11771@kfi7 refs 3
00000400:00000200:31.0:1773851865.096690:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11771@kfi7 local destination
00000400:00000200:31.0:1773851865.096691:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769135:8769135:1024:4294967295] 11771@kfi7 LPNI seq info [28046:28046:16:4294967295]
00000400:00000200:31.0:1773851865.096693:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006cf58589 nid 11771@kfi7 refs 2
00000400:00000200:31.0:1773851865.096693:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11771@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.096695:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11771@kfi7(11771@kfi7:11771@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851865.096697:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006cf58589 nid 11771@kfi7 refs 3
00000800:00000200:31.0:1773851865.096698:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851865.096699:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851865.096701:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851865.096704:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3fa Using peer 11771@kfi7(0x3fa)
00000800:00000200:31.0:1773851865.096707:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x3fa: rc=0
00000800:00000200:31.0:1773851865.096709:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3fa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851865.096711:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.096712:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005cfbebc1 refcount 4 to 11770@kfi7
00010000:00000001:31.0:1773851865.096712:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851865.096713:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.096714:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851865.096714:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000211d2bff x1858030986228928/t0(0) o400->3fb471d0-e068-4e01-bf5c-0116996fc5ed@11770@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne214-0'
00000100:00100000:31.0:1773851865.096718:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000211d2bff pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:3fb471d0-e068-4e01-bf5c-0116996fc5ed+6:47939:x1858030986228928:12345-11770@kfi7:400:default-tuolumne214-0 Request processed in 63us (99us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851865.096720:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11770@kfi7, seq: 2055509
00000100:00000040:31.0:1773851865.096721:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d54ce321 : new rpc_count 0
00000100:00000001:31.0:1773851865.096722:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851865.096722:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3fa TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851865.096723:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851865.096723:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000400:00000200:29.0:1773851865.096723:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851865.096724:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f776f930.
00000400:00000200:29.0:1773851865.096725:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11771@kfi7: PUT: OK
00000020:00000010:31.0:1773851865.096729:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9820241.
00000400:00000200:29.0:1773851865.096729:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d81a04c
00000400:00000010:29.0:1773851865.096729:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d81a04c.
00000020:00000040:31.0:1773851865.096730:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000d54ce321 : new refcount 5
00000100:00000001:31.0:1773851865.096730:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851865.096730:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851865.096730:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851865.096731:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006cf58589 nid 11771@kfi7 refs 2
00000800:00000200:29.0:1773851865.096733:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 11771@kfi7(000000001e8e84d5):0x0 lsk 1019 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3fa Transaction freed
00000800:00000200:21.0:1773851865.141655:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851865.141656:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851865.141657:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851865.141659:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851865.141661:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15297@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.141662:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15297@kfi7 : PUT - for me
00000400:00000200:21.0:1773851865.141663:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15297@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.141665:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003668a4ea nid 15297@kfi7 refs 1
00000400:00000200:21.0:1773851865.141666:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15297@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.141667:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003668a4ea nid 15297@kfi7 refs 2
00000400:00000200:21.0:1773851865.141668:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003668a4ea nid 15297@kfi7 refs 3
00000400:00000200:21.0:1773851865.141669:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15297@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.141669:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15297@kfi7 of length 224 into portal 12 MB=0x69a7228f794c0
00000400:00000200:21.0:1773851865.141671:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15297@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 34376
00000800:00000200:21.0:1773851865.141672:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851865.141674:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851865.141675:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15297@kfi7: PUT: OK
00000100:00000001:21.0:1773851865.141676:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851865.141676:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851865.141677:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000068b06ee3.
00000100:00000040:21.0:1773851865.141678:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000068b06ee3 x1858664964527296 msgsize 224
00000100:00100000:21.0:1773851865.141679:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15297@kfi7 (source: 12345-15297@kfi7)
00000100:00000001:21.0:1773851865.141680:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:22.0:1773851865.141682:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851865.141682:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:21.0:1773851865.141682:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003668a4ea nid 15297@kfi7 refs 2
00000100:00000001:22.0:1773851865.141683:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851865.141683:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851865.141683:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851865.141684:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851865.141685:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858664964527296
00000020:00000001:22.0:1773851865.141685:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851865.141686:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92515
00000020:00000001:22.0:1773851865.141687:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851865.141689:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de5c6279 refcount=8
00000020:00000001:22.0:1773851865.141690:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630785024 : -107123078766592 : ffff9e9276f16000)
00000020:00000001:22.0:1773851865.141691:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630785024 : -107123078766592 : ffff9e9276f16000)
00000100:00000001:22.0:1773851865.141692:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.141693:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851865.141694:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000048742a.
00000020:00000010:22.0:1773851865.141695:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.141696:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851865.141697:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851865.141697:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851865.141697:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.141698:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851865.141699:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851865.141699:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.141700:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.141701:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851865.141702:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851865.141702:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851865.141702:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851865.141703:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15297@kfi7, seq: 1997969
00000100:00000001:23.0:1773851865.141704:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851865.141704:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.141704:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de5c6279 : new rpc_count 1
00000100:00000001:22.0:1773851865.141704:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840041984 : -106961869509632 : ffff9eb7ffc36c00)
00000100:00000040:22.0:1773851865.141706:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000068b06ee3 x1858664964527296/t0(0) o400->ee1baba7-3b90-44ee-ba3c-8d0df670e1b4@15297@kfi7:653/0 lens 224/0 e 0 to 0 dl 1773852013 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1443-0'
00000100:00000001:22.0:1773851865.141708:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.141709:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851865.141710:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068b06ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:ee1baba7-3b90-44ee-ba3c-8d0df670e1b4+8:40290:x1858664964527296:12345-15297@kfi7:400:default-tuolumne1443-0
00000100:00000200:22.0:1773851865.141711:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858664964527296
00000020:00000001:22.0:1773851865.141712:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851865.141712:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851865.141713:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.141714:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851865.141714:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851865.141715:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851865.141716:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858664964527296, found 0 last_xid 1858664964527295
00000020:00000001:22.0:1773851865.141717:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851865.141717:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851865.141718:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851865.141718:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.141719:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851865.141719:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851865.141720:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851865.141720:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000da424327.
02000000:00000001:22.0:1773851865.141721:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.141722:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.141722:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851865.141723:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044168709, transno 0, xid 1858664964527296
00010000:00000001:22.0:1773851865.141723:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851865.141724:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000068b06ee3 x1858664964527296/t0(0) o400->ee1baba7-3b90-44ee-ba3c-8d0df670e1b4@15297@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1443-0'
00010000:00000001:22.0:1773851865.141729:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851865.141729:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851865.141730:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=98 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851865.141731:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851865.141731:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000efb46d3f refcount 3 to 15297@kfi7
00000100:00000001:22.0:1773851865.141732:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025568 : -107156745526048 : ffff9e8aa03f64e0)
02000000:00000001:22.0:1773851865.141733:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851865.141733:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.141734:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851865.141735:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15297@kfi7
00000400:00000010:22.0:1773851865.141735:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000899ea1e5.
00000100:00000200:22.0:1773851865.141736:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858664964527296, offset 224
00000400:00000200:22.0:1773851865.141738:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15297@kfi7
00000400:00000200:22.0:1773851865.141738:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15297@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.141739:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003668a4ea nid 15297@kfi7 refs 1
00000400:00000200:22.0:1773851865.141740:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003668a4ea nid 15297@kfi7 refs 2
00000400:00000200:22.0:1773851865.141741:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003668a4ea nid 15297@kfi7 refs 3
00000400:00000200:22.0:1773851865.141743:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15297@kfi7 local destination
00000400:00000200:22.0:1773851865.141744:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769136:8769136:1024:4294967295] 15297@kfi7 LPNI seq info [169834:169834:16:4294967295]
00000400:00000200:22.0:1773851865.141746:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003668a4ea nid 15297@kfi7 refs 2
00000400:00000200:22.0:1773851865.141746:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15297@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.141748:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15297@kfi7(15297@kfi7:15297@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851865.141750:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003668a4ea nid 15297@kfi7 refs 3
00000800:00000200:22.0:1773851865.141751:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851865.141752:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851865.141754:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851865.141757:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000454 Using peer 15297@kfi7(0x100000000000454)
00000800:00000200:22.0:1773851865.141760:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000068d775d8: Posted send of 324 bytes to peer 0x100000000000454: rc=0
00000800:00000200:22.0:1773851865.141761:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000454 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851865.141763:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.141764:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000efb46d3f refcount 2 to 15297@kfi7
00010000:00000001:22.0:1773851865.141765:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851865.141765:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.141766:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851865.141766:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000068b06ee3 x1858664964527296/t0(0) o400->ee1baba7-3b90-44ee-ba3c-8d0df670e1b4@15297@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1443-0'
00000100:00100000:22.0:1773851865.141769:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068b06ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:ee1baba7-3b90-44ee-ba3c-8d0df670e1b4+8:40290:x1858664964527296:12345-15297@kfi7:400:default-tuolumne1443-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851865.141771:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000454 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851865.141772:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15297@kfi7, seq: 1997969
00000100:00000040:22.0:1773851865.141772:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de5c6279 : new rpc_count 0
00000100:00000001:22.0:1773851865.141773:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851865.141773:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851865.141774:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851865.141774:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15297@kfi7: PUT: OK
00000020:00000010:22.0:1773851865.141775:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851865.141775:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000899ea1e5
00000400:00000010:21.0:1773851865.141775:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000899ea1e5.
00000020:00000010:22.0:1773851865.141776:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851865.141776:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000048742a.
00000100:00000001:21.0:1773851865.141776:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851865.141776:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:22.0:1773851865.141777:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000de5c6279 : new refcount 7
00000400:00000200:21.0:1773851865.141777:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003668a4ea nid 15297@kfi7 refs 2
00000100:00000001:22.0:1773851865.141778:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851865.141778:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 15297@kfi7(0000000066333596):0x0 lsk 1109 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000454 Transaction freed
00000800:00000200:21.0:1773851865.222319:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851865.222320:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851865.222321:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851865.222323:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851865.222325:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13857@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.222326:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13857@kfi7 : PUT - for me
00000400:00000200:21.0:1773851865.222327:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13857@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.222327:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000232f73d9 nid 13857@kfi7 refs 1
00000400:00000200:21.0:1773851865.222328:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13857@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.222329:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000232f73d9 nid 13857@kfi7 refs 2
00000400:00000200:21.0:1773851865.222330:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000232f73d9 nid 13857@kfi7 refs 3
00000400:00000200:21.0:1773851865.222331:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14048@kfi7 to cpt 4
00000400:00000200:21.0:1773851865.222332:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14048@kfi7 of length 224 into portal 12 MB=0x699e11b4c9200
00000400:00000200:21.0:1773851865.222333:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14048@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 34600
00000800:00000200:21.0:1773851865.222334:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851865.222337:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851865.222338:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13857@kfi7: PUT: OK
00000100:00000001:21.0:1773851865.222339:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851865.222339:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851865.222340:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000001e4928c.
00000100:00000040:21.0:1773851865.222340:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000001e4928c x1858041964958208 msgsize 224
00000100:00100000:21.0:1773851865.222342:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14048@kfi7 (source: 12345-13857@kfi7)
00000100:00000001:21.0:1773851865.222343:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851865.222343:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000232f73d9 nid 13857@kfi7 refs 2
00000100:00000001:22.0:1773851865.222344:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851865.222345:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851865.222345:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851865.222345:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851865.222345:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851865.222346:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851865.222347:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041964958208
00000020:00000001:22.0:1773851865.222347:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851865.222348:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c40
00000020:00000001:22.0:1773851865.222348:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851865.222350:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f30cf8f8 refcount=162
00000020:00000001:22.0:1773851865.222351:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628293632 : -107123081257984 : ffff9e9276cb5c00)
00000020:00000001:22.0:1773851865.222351:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628293632 : -107123081257984 : ffff9e9276cb5c00)
00000100:00000001:22.0:1773851865.222352:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.222353:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851865.222353:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000048742a.
00000020:00000010:22.0:1773851865.222354:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.222355:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851865.222356:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851865.222356:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851865.222356:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.222357:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851865.222358:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851865.222358:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.222359:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851865.222360:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851865.222360:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851865.222360:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851865.222361:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851865.222361:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14048@kfi7, seq: 1997970
00000100:00000001:23.0:1773851865.222362:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851865.222362:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.222362:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f30cf8f8 : new rpc_count 1
00000100:00000001:22.0:1773851865.222362:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840040832 : -106961869510784 : ffff9eb7ffc36780)
00000100:00000040:22.0:1773851865.222363:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000001e4928c x1858041964958208/t0(0) o400->b9120b51-905e-43f5-ad42-6391095c2ce2@14048@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1359-0'
00000100:00000001:22.0:1773851865.222370:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.222370:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851865.222371:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001e4928c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b9120b51-905e-43f5-ad42-6391095c2ce2+162:39662:x1858041964958208:12345-14048@kfi7:400:default-tuolumne1359-0
00000100:00000200:22.0:1773851865.222372:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041964958208
00000020:00000001:22.0:1773851865.222372:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851865.222373:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851865.222373:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.222374:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851865.222374:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851865.222375:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851865.222375:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041964958208, found 0 last_xid 1858041964542847
00000020:00000001:22.0:1773851865.222376:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851865.222377:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851865.222377:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851865.222377:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.222378:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851865.222378:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851865.222379:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851865.222380:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000044739d01.
02000000:00000001:22.0:1773851865.222380:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.222381:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.222381:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851865.222382:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062060, transno 0, xid 1858041964958208
00010000:00000001:22.0:1773851865.222383:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851865.222383:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000001e4928c x1858041964958208/t0(0) o400->b9120b51-905e-43f5-ad42-6391095c2ce2@14048@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1359-0'
00010000:00000001:22.0:1773851865.222386:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851865.222386:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851865.222387:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=98 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851865.222387:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851865.222388:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d20d7ed refcount 3 to 14048@kfi7
00000100:00000001:22.0:1773851865.222389:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095776512 : -107152613775104 : ffff9e8b9684e900)
02000000:00000001:22.0:1773851865.222390:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851865.222390:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.222391:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851865.222392:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13857@kfi7
00000400:00000010:22.0:1773851865.222392:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047ae365a.
00000100:00000200:22.0:1773851865.222393:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041964958208, offset 224
00000400:00000200:22.0:1773851865.222394:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13857@kfi7
00000400:00000200:22.0:1773851865.222395:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13857@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.222396:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000232f73d9 nid 13857@kfi7 refs 1
00000400:00000200:22.0:1773851865.222397:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000232f73d9 nid 13857@kfi7 refs 2
00000400:00000200:22.0:1773851865.222398:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000232f73d9 nid 13857@kfi7 refs 3
00000400:00000200:22.0:1773851865.222399:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13857@kfi7 local destination
00000400:00000200:22.0:1773851865.222400:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769137:8769137:1024:4294967295] 13857@kfi7 LPNI seq info [9653599:9653599:16:4294967295]
00000400:00000200:22.0:1773851865.222402:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000232f73d9 nid 13857@kfi7 refs 2
00000400:00000200:22.0:1773851865.222402:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13857@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.222404:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13857@kfi7(13857@kfi7:13857@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851865.222405:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000232f73d9 nid 13857@kfi7 refs 3
00000800:00000200:22.0:1773851865.222407:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851865.222408:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851865.222410:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851865.222412:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000031b Using peer 13857@kfi7(0x10000000000031b)
00000800:00000200:22.0:1773851865.222415:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000003e4ddf4f: Posted send of 324 bytes to peer 0x10000000000031b: rc=0
00000800:00000200:22.0:1773851865.222416:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000031b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851865.222418:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.222419:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d20d7ed refcount 2 to 14048@kfi7
00010000:00000001:22.0:1773851865.222419:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851865.222420:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.222420:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851865.222421:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000001e4928c x1858041964958208/t0(0) o400->b9120b51-905e-43f5-ad42-6391095c2ce2@14048@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1359-0'
00000100:00100000:22.0:1773851865.222424:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001e4928c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b9120b51-905e-43f5-ad42-6391095c2ce2+162:39662:x1858041964958208:12345-14048@kfi7:400:default-tuolumne1359-0 Request processed in 54us (83us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851865.222426:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14048@kfi7, seq: 1997970
00000800:00000200:21.0:1773851865.222426:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000031b TN_EVENT_TX_OK event status 0
00000100:00000040:22.0:1773851865.222427:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f30cf8f8 : new rpc_count 0
00000100:00000001:22.0:1773851865.222428:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851865.222428:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851865.222428:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851865.222429:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.222429:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851865.222429:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13857@kfi7: PUT: OK
00000400:00000200:21.0:1773851865.222429:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047ae365a
00000020:00000010:22.0:1773851865.222430:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000048742a.
00000400:00000010:21.0:1773851865.222430:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047ae365a.
00000100:00000001:21.0:1773851865.222430:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:22.0:1773851865.222431:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000f30cf8f8 : new refcount 161
00000100:00000001:22.0:1773851865.222431:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851865.222431:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851865.222431:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000232f73d9 nid 13857@kfi7 refs 2
00000800:00000200:21.0:1773851865.222433:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 13857@kfi7(0000000013e7c829):0x0 lsk 796 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000031b Transaction freed
00010000:00000001:2.0:1773851865.225734:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225734:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851865.225736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851865.225738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851865.225741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851865.225743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851865.225745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851865.225747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851865.225749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851865.225749:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.225754:0:937838:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851865.225754:0:937838:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851865.225755:0:937838:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:18.0:1773851865.280631:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851865.280631:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851865.280632:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851865.280632:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851865.280633:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851865.280633:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851865.280635:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21504@kfi7(0000000097d3b651):0x180 version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851865.280636:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851865.280636:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 Using peer 21504@kfi7(0x100000000000180)
00000400:00000200:18.0:1773851865.280638:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21504@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.280638:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21504@kfi7 to cpt 4
00000400:00000200:18.0:1773851865.280639:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21504@kfi7 : PUT - for me
00000400:00000200:18.0:1773851865.280640:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21504@kfi7 to cpt 4
00000400:00000200:18.0:1773851865.280640:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000141269fb nid 21504@kfi7 refs 1
00000800:00000200:17.0:1773851865.280641:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 38 bytes to peer 0x100000000000180: rc=0
00000400:00000200:18.0:1773851865.280642:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21504@kfi7 to cpt 4
00000400:00000200:18.0:1773851865.280642:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000141269fb nid 21504@kfi7 refs 2
00000800:00000200:17.0:1773851865.280642:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851865.280643:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000141269fb nid 21504@kfi7 refs 3
00000400:00000200:18.0:1773851865.280644:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21505@kfi7 to cpt 7
00000400:00000200:18.0:1773851865.280645:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21505@kfi7 of length 224 into portal 12 MB=0x69a7272659b40
00000400:00000200:18.0:1773851865.280646:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21505@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 7416
00000800:00000200:18.0:1773851865.280648:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851865.280649:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851865.280650:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21504@kfi7: PUT: OK
00000100:00000001:18.0:1773851865.280651:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851865.280651:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851865.280652:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036ef6fb6.
00000100:00000040:18.0:1773851865.280653:0:2507147:0:(events.c:358:request_in_callback()) incoming req@0000000036ef6fb6 x1858666196474688 msgsize 224
00000100:00100000:18.0:1773851865.280654:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-21505@kfi7 (source: 12345-21504@kfi7)
00000100:00000001:18.0:1773851865.280656:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851865.280656:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851865.280657:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000141269fb nid 21504@kfi7 refs 2
00000800:00000200:18.0:1773851865.280658:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000800:00000200:17.0:1773851865.280658:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 Transaction freed
00000100:00000001:16.0:1773851865.280658:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851865.280659:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851865.280660:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851865.280661:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851865.280662:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851865.280664:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858666196474688
00000020:00000001:16.0:1773851865.280665:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851865.280665:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9203e
00000020:00000001:16.0:1773851865.280666:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851865.280671:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000793c89db refcount=6
00000020:00000001:16.0:1773851865.280672:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629265408 : -107123080286208 : ffff9e9276da3000)
00000020:00000001:16.0:1773851865.280674:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629265408 : -107123080286208 : ffff9e9276da3000)
00000100:00000001:16.0:1773851865.280675:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851865.280677:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851865.280678:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d3b15942.
00000020:00000010:16.0:1773851865.280679:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851865.280681:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000082cc22fe.
00000100:00000001:16.0:1773851865.280682:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851865.280683:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851865.280684:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851865.280686:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851865.280687:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851865.280687:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851865.280689:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851865.280690:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851865.280691:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851865.280691:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851865.280692:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21505@kfi7, seq: 2156310
00000100:00000001:16.0:1773851865.280692:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851865.280693:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000793c89db : new rpc_count 1
00000100:00000001:17.0:1773851865.280693:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534665344 : -106946174886272 : ffff9ebba73c5e80)
00000100:00000001:16.0:1773851865.280693:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851865.280694:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036ef6fb6 x1858666196474688/t0(0) o400->a506cdb2-ca9b-497c-826b-56ee9fea61e8@21505@kfi7:653/0 lens 224/0 e 0 to 0 dl 1773852013 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1843-0'
00000100:00000001:16.0:1773851865.280694:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.280697:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851865.280697:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851865.280698:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036ef6fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:a506cdb2-ca9b-497c-826b-56ee9fea61e8+6:39655:x1858666196474688:12345-21505@kfi7:400:default-tuolumne1843-0
00000100:00000200:17.0:1773851865.280699:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858666196474688
00000020:00000001:17.0:1773851865.280700:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851865.280700:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851865.280701:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.280702:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851865.280702:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851865.280703:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851865.280703:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858666196474688, found 0 last_xid 1858666196474687
00000020:00000001:17.0:1773851865.280704:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851865.280705:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851865.280705:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851865.280706:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.280706:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851865.280707:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851865.280708:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851865.280708:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005aa634fd.
02000000:00000001:17.0:1773851865.280709:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.280710:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.280710:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851865.280711:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044145237, transno 0, xid 1858666196474688
00010000:00000001:17.0:1773851865.280712:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851865.280713:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036ef6fb6 x1858666196474688/t0(0) o400->a506cdb2-ca9b-497c-826b-56ee9fea61e8@21505@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1843-0'
00010000:00000001:17.0:1773851865.280715:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851865.280715:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851865.280716:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=98 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851865.280717:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851865.280718:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000074d88be1 refcount 3 to 21505@kfi7
00000100:00000001:17.0:1773851865.280719:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065568 : -107155994486048 : ffff9e8acd035ae0)
02000000:00000001:17.0:1773851865.280720:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851865.280720:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.280721:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851865.280721:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21504@kfi7
00000400:00000010:17.0:1773851865.280722:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012f08013.
00000100:00000200:17.0:1773851865.280723:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858666196474688, offset 224
00000400:00000200:17.0:1773851865.280724:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21504@kfi7
00000400:00000200:17.0:1773851865.280730:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21504@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.280731:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000141269fb nid 21504@kfi7 refs 1
00000400:00000200:17.0:1773851865.280732:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000141269fb nid 21504@kfi7 refs 2
00000400:00000200:17.0:1773851865.280733:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000141269fb nid 21504@kfi7 refs 3
00000400:00000200:17.0:1773851865.280734:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21504@kfi7 local destination
00000400:00000200:17.0:1773851865.280736:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769138:8769138:1024:4294967295] 21504@kfi7 LPNI seq info [229084:229084:16:4294967295]
00000400:00000200:17.0:1773851865.280737:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000141269fb nid 21504@kfi7 refs 2
00000400:00000200:17.0:1773851865.280738:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21504@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.280740:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21504@kfi7(21504@kfi7:21504@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851865.280741:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000141269fb nid 21504@kfi7 refs 3
00000800:00000200:17.0:1773851865.280749:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851865.280750:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851865.280752:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851865.280754:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 Using peer 21504@kfi7(0x100000000000180)
00000800:00000200:17.0:1773851865.280757:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x100000000000180: rc=0
00000800:00000200:17.0:1773851865.280758:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851865.280760:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851865.280761:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000074d88be1 refcount 2 to 21505@kfi7
00010000:00000001:17.0:1773851865.280762:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851865.280762:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.280763:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851865.280764:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036ef6fb6 x1858666196474688/t0(0) o400->a506cdb2-ca9b-497c-826b-56ee9fea61e8@21505@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1843-0'
00000100:00100000:17.0:1773851865.280766:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036ef6fb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:a506cdb2-ca9b-497c-826b-56ee9fea61e8+6:39655:x1858666196474688:12345-21505@kfi7:400:default-tuolumne1843-0 Request processed in 69us (113us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851865.280769:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21505@kfi7, seq: 2156310
00000100:00000040:17.0:1773851865.280769:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000793c89db : new rpc_count 0
00000100:00000001:17.0:1773851865.280771:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851865.280771:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:18.0:1773851865.280772:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851865.280772:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:17.0:1773851865.280772:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000082cc22fe.
00000020:00000010:17.0:1773851865.280773:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d3b15942.
00000400:00000200:18.0:1773851865.280774:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851865.280774:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000793c89db : new refcount 5
00000400:00000200:18.0:1773851865.280775:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21504@kfi7: PUT: OK
00000100:00000001:17.0:1773851865.280775:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851865.280776:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012f08013
00000400:00000010:18.0:1773851865.280777:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012f08013.
00000100:00000001:18.0:1773851865.280778:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851865.280778:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851865.280779:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000141269fb nid 21504@kfi7 refs 2
00000800:00000200:18.0:1773851865.280781:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 21504@kfi7(0000000097d3b651):0x0 lsk 385 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000180 Transaction freed
00000800:00000200:29.0:1773851865.294298:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851865.294299:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851865.294300:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851865.294302:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851865.294304:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15282@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.294305:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15282@kfi7 : PUT - for me
00000400:00000200:29.0:1773851865.294306:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15282@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.294307:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 1
00000400:00000200:29.0:1773851865.294309:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15282@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.294309:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 2
00000400:00000200:29.0:1773851865.294310:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 3
00000400:00000200:29.0:1773851865.294311:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15283@kfi7 to cpt 2
00000400:00000200:29.0:1773851865.294313:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15283@kfi7 of length 224 into portal 12 MB=0x69b4b5e2c65c0
00000400:00000200:29.0:1773851865.294314:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15283@kfi7 of length 224/224 into md 0x77fe139dd [64] + 173288
00000800:00000200:29.0:1773851865.294316:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851865.294317:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851865.294318:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15282@kfi7: PUT: OK
00000100:00000001:29.0:1773851865.294319:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851865.294320:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851865.294321:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009f5dab2c.
00000100:00000040:29.0:1773851865.294321:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000009f5dab2c x1859597865084352 msgsize 224
00000100:00100000:29.0:1773851865.294323:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15283@kfi7 (source: 12345-15282@kfi7)
00000100:00000001:29.0:1773851865.294324:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851865.294324:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 2
00000100:00000001:31.0:1773851865.294325:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851865.294325:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851865.294326:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851865.294326:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851865.294327:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851865.294328:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851865.294329:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597865084352
00000020:00000001:31.0:1773851865.294329:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851865.294330:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f1e6
00000020:00000001:31.0:1773851865.294331:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851865.294335:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004142c47f refcount=169
00000020:00000001:31.0:1773851865.294335:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637099541425152 : -106974168126464 : ffff9eb522b56c00)
00000020:00000001:31.0:1773851865.294336:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637099541425152 : -106974168126464 : ffff9eb522b56c00)
00000100:00000001:31.0:1773851865.294337:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.294338:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851865.294339:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b4f0eb.
00000020:00000010:31.0:1773851865.294340:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851865.294341:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851865.294342:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851865.294342:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851865.294343:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.294344:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851865.294344:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851865.294345:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.294346:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.294347:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851865.294347:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851865.294347:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851865.294348:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15283@kfi7, seq: 2055510
00000100:00000001:28.0:1773851865.294348:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851865.294349:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004142c47f : new rpc_count 1
00000100:00000001:28.0:1773851865.294349:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.294350:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343722624 : -106994365828992 : ffff9eb06ed4f080)
00000100:00000001:28.0:1773851865.294350:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.294351:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009f5dab2c x1859597865084352/t0(0) o400->5919f571-2547-417a-bee8-fa9bf29bc07c@15283@kfi7:653/0 lens 224/0 e 0 to 0 dl 1773852013 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1434-0'
00000100:00000001:31.0:1773851865.294354:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.294354:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851865.294355:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f5dab2c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5919f571-2547-417a-bee8-fa9bf29bc07c+169:39539:x1859597865084352:12345-15283@kfi7:400:default-tuolumne1434-0
00000100:00000200:31.0:1773851865.294356:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597865084352
00000020:00000001:31.0:1773851865.294357:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851865.294358:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851865.294358:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.294359:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851865.294359:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851865.294360:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851865.294361:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597865084352, found 0 last_xid 1859597864661567
00000020:00000001:31.0:1773851865.294361:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851865.294362:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851865.294363:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851865.294363:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.294364:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851865.294364:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851865.294365:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851865.294366:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e51428c9.
02000000:00000001:31.0:1773851865.294366:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.294367:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.294368:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851865.294368:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062936, transno 0, xid 1859597865084352
00010000:00000001:31.0:1773851865.294369:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851865.294370:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009f5dab2c x1859597865084352/t0(0) o400->5919f571-2547-417a-bee8-fa9bf29bc07c@15283@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1434-0'
00010000:00000001:31.0:1773851865.294372:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851865.294373:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851865.294374:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=98 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851865.294375:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851865.294375:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f5500ec9 refcount 3 to 15283@kfi7
00000100:00000001:31.0:1773851865.294376:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551674208 : -107156157877408 : ffff9e8ac3463360)
02000000:00000001:31.0:1773851865.294377:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851865.294377:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.294378:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851865.294379:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15282@kfi7
00000400:00000010:31.0:1773851865.294379:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c73e55.
00000100:00000200:31.0:1773851865.294380:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597865084352, offset 224
00000400:00000200:31.0:1773851865.294381:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15282@kfi7
00000400:00000200:31.0:1773851865.294382:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15282@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.294383:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 1
00000400:00000200:31.0:1773851865.294384:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 2
00000400:00000200:31.0:1773851865.294385:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 3
00000400:00000200:31.0:1773851865.294386:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15282@kfi7 local destination
00000400:00000200:31.0:1773851865.294387:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769139:8769139:1024:4294967295] 15282@kfi7 LPNI seq info [387782:387782:16:4294967295]
00000400:00000200:31.0:1773851865.294389:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 2
00000400:00000200:31.0:1773851865.294389:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15282@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.294391:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15282@kfi7(15282@kfi7:15282@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851865.294392:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 3
00000800:00000200:31.0:1773851865.294394:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851865.294395:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851865.294397:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851865.294399:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2b9 Using peer 15282@kfi7(0x2b9)
00000800:00000200:31.0:1773851865.294402:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x2b9: rc=0
00000800:00000200:31.0:1773851865.294403:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851865.294409:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.294410:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f5500ec9 refcount 2 to 15283@kfi7
00010000:00000001:31.0:1773851865.294410:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851865.294411:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.294412:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851865.294413:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009f5dab2c x1859597865084352/t0(0) o400->5919f571-2547-417a-bee8-fa9bf29bc07c@15283@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1434-0'
00000800:00000200:29.0:1773851865.294414:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2b9 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851865.294416:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f5dab2c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5919f571-2547-417a-bee8-fa9bf29bc07c+169:39539:x1859597865084352:12345-15283@kfi7:400:default-tuolumne1434-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851865.294416:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851865.294417:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15282@kfi7: PUT: OK
00000400:00000200:29.0:1773851865.294417:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c73e55
00000400:00000010:29.0:1773851865.294418:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c73e55.
00000100:00000001:29.0:1773851865.294418:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:31.0:1773851865.294419:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15283@kfi7, seq: 2055510
00000100:00000001:29.0:1773851865.294419:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:31.0:1773851865.294420:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004142c47f : new rpc_count 0
00000100:00000001:31.0:1773851865.294420:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851865.294420:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6f1ed4e nid 15282@kfi7 refs 2
00000100:00000001:31.0:1773851865.294421:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851865.294421:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000800:00000200:29.0:1773851865.294421:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 15282@kfi7(000000009056282d):0x0 lsk 698 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2b9 Transaction freed
00000020:00000010:31.0:1773851865.294422:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000020:00000010:31.0:1773851865.294423:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b4f0eb.
00000020:00000040:31.0:1773851865.294424:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000004142c47f : new refcount 168
00000100:00000001:31.0:1773851865.294424:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851865.315778:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851865.315778:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851865.315779:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851865.315781:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851865.315783:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17203@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.315784:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17203@kfi7 : PUT - for me
00000400:00000200:21.0:1773851865.315785:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17203@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.315786:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e4f43ae nid 17203@kfi7 refs 1
00000400:00000200:21.0:1773851865.315788:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17203@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.315788:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e4f43ae nid 17203@kfi7 refs 2
00000400:00000200:21.0:1773851865.315789:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009e4f43ae nid 17203@kfi7 refs 3
00000400:00000200:21.0:1773851865.315790:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17395@kfi7 to cpt 0
00000400:00000200:21.0:1773851865.315791:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17395@kfi7 of length 224 into portal 12 MB=0x69b4b5cb7e6c0
00000400:00000200:21.0:1773851865.315792:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17395@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 34824
00000800:00000200:21.0:1773851865.315794:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851865.315796:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851865.315797:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17203@kfi7: PUT: OK
00000100:00000001:21.0:1773851865.315799:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851865.315799:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851865.315800:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009391b34.
00000100:00000040:21.0:1773851865.315800:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000009391b34 x1859597840672448 msgsize 224
00000100:00100000:21.0:1773851865.315802:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17395@kfi7 (source: 12345-17203@kfi7)
00000100:00000001:21.0:1773851865.315803:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851865.315803:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009e4f43ae nid 17203@kfi7 refs 2
00000100:00000001:22.0:1773851865.315804:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851865.315805:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851865.315805:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851865.315805:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851865.315806:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851865.315807:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851865.315807:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597840672448
00000020:00000001:22.0:1773851865.315808:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851865.315808:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82fd5
00000020:00000001:22.0:1773851865.315809:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851865.315813:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000057b3457a refcount=799
00000020:00000001:22.0:1773851865.315813:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132016925696 : -106941692625920 : ffff9ebcb2663c00)
00000020:00000001:22.0:1773851865.315814:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132016925696 : -106941692625920 : ffff9ebcb2663c00)
00000100:00000001:22.0:1773851865.315815:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.315816:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851865.315817:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064c8bac5.
00000020:00000010:22.0:1773851865.315817:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.315818:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851865.315819:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851865.315820:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851865.315821:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.315822:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851865.315822:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851865.315823:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.315824:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851865.315825:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851865.315825:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851865.315825:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851865.315825:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851865.315826:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17395@kfi7, seq: 1997971
00000100:00000001:23.0:1773851865.315827:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851865.315827:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.315827:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000057b3457a : new rpc_count 10
00000100:00000001:22.0:1773851865.315827:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840037376 : -106961869514240 : ffff9eb7ffc35a00)
00000100:00000040:22.0:1773851865.315829:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009391b34 x1859597840672448/t0(0) o400->d802bead-707f-4cdb-a5ed-40dd8b083bfb@17395@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1561-0'
00000100:00000001:22.0:1773851865.315831:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.315832:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851865.315833:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009391b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:d802bead-707f-4cdb-a5ed-40dd8b083bfb+799:39511:x1859597840672448:12345-17395@kfi7:400:default-tuolumne1561-0
00000100:00000200:22.0:1773851865.315834:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597840672448
00000020:00000001:22.0:1773851865.315835:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851865.315835:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851865.315836:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.315837:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851865.315837:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851865.315838:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851865.315839:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597840672448, found 0 last_xid 1859597832861695
00000020:00000001:22.0:1773851865.315839:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851865.315840:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851865.315840:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851865.315841:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.315842:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851865.315842:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851865.315843:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851865.315844:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000deed0aba.
02000000:00000001:22.0:1773851865.315844:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.315845:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.315846:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851865.315847:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264585587, transno 0, xid 1859597840672448
00010000:00000001:22.0:1773851865.315847:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851865.315848:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009391b34 x1859597840672448/t0(0) o400->d802bead-707f-4cdb-a5ed-40dd8b083bfb@17395@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1561-0'
00010000:00000001:22.0:1773851865.315850:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851865.315851:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851865.315851:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=98 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851865.315852:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851865.315853:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dabadc42 refcount 3 to 17395@kfi7
00000100:00000001:22.0:1773851865.315854:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002944 : -107146751548672 : ffff9e8cf3ef6300)
02000000:00000001:22.0:1773851865.315854:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851865.315855:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.315856:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851865.315856:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17203@kfi7
00000400:00000010:22.0:1773851865.315857:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047ae365a.
00000100:00000200:22.0:1773851865.315858:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597840672448, offset 224
00000400:00000200:22.0:1773851865.315859:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17203@kfi7
00000400:00000200:22.0:1773851865.315860:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17203@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.315861:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e4f43ae nid 17203@kfi7 refs 1
00000400:00000200:22.0:1773851865.315862:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009e4f43ae nid 17203@kfi7 refs 2
00000400:00000200:22.0:1773851865.315863:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009e4f43ae nid 17203@kfi7 refs 3
00000400:00000200:22.0:1773851865.315864:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17203@kfi7 local destination
00000400:00000200:22.0:1773851865.315865:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769140:8769140:1024:4294967295] 17203@kfi7 LPNI seq info [503092:503092:16:4294967295]
00000400:00000200:22.0:1773851865.315866:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009e4f43ae nid 17203@kfi7 refs 2
00000400:00000200:22.0:1773851865.315867:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17203@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.315869:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17203@kfi7(17203@kfi7:17203@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851865.315870:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009e4f43ae nid 17203@kfi7 refs 3
00000800:00000200:22.0:1773851865.315871:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851865.315872:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851865.315876:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851865.315879:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x754 Using peer 17203@kfi7(0x754)
00000800:00000200:22.0:1773851865.315882:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003e4ddf4f: Posted send of 324 bytes to peer 0x754: rc=0
00000800:00000200:22.0:1773851865.315883:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x754 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851865.315885:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.315886:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dabadc42 refcount 2 to 17395@kfi7
00010000:00000001:22.0:1773851865.315887:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851865.315887:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.315888:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851865.315889:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009391b34 x1859597840672448/t0(0) o400->d802bead-707f-4cdb-a5ed-40dd8b083bfb@17395@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1561-0'
00000100:00100000:22.0:1773851865.315892:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009391b34 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:d802bead-707f-4cdb-a5ed-40dd8b083bfb+799:39511:x1859597840672448:12345-17395@kfi7:400:default-tuolumne1561-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851865.315894:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17395@kfi7, seq: 1997971
00000100:00000040:22.0:1773851865.315895:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000057b3457a : new rpc_count 9
00000800:00000200:21.0:1773851865.315895:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x754 TN_EVENT_TX_OK event status 0
00000100:00000001:22.0:1773851865.315896:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851865.315896:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851865.315896:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851865.315897:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.315897:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851865.315897:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17203@kfi7: PUT: OK
00000020:00000010:22.0:1773851865.315898:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064c8bac5.
00000400:00000200:21.0:1773851865.315898:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047ae365a
00000400:00000010:21.0:1773851865.315898:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047ae365a.
00000020:00000040:22.0:1773851865.315899:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000057b3457a : new refcount 798
00000100:00000001:21.0:1773851865.315899:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851865.315899:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:22.0:1773851865.315900:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851865.315900:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009e4f43ae nid 17203@kfi7 refs 2
00000800:00000200:21.0:1773851865.315901:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 17203@kfi7(0000000079934a51):0x0 lsk 1877 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x754 Transaction freed
00000800:00000200:1.0:1773851865.407036:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851865.407037:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851865.407038:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851865.407041:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851865.407043:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24401@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.407044:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24401@kfi7 : PUT - for me
00000400:00000200:1.0:1773851865.407045:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24401@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.407046:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008aa086c5 nid 24401@kfi7 refs 1
00000400:00000200:1.0:1773851865.407048:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24401@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.407048:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008aa086c5 nid 24401@kfi7 refs 2
00000400:00000200:1.0:1773851865.407049:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008aa086c5 nid 24401@kfi7 refs 3
00000400:00000200:1.0:1773851865.407051:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24401@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.407052:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24401@kfi7 of length 224 into portal 12 MB=0x69b4c00eb0f40
00000400:00000200:1.0:1773851865.407054:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24401@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 25816
00000800:00000200:1.0:1773851865.407055:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851865.407057:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.407059:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24401@kfi7: PUT: OK
00000100:00000001:1.0:1773851865.407060:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851865.407061:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851865.407062:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f38f015c.
00000100:00000040:1.0:1773851865.407063:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000f38f015c x1859600595488576 msgsize 224
00000100:00100000:1.0:1773851865.407066:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24401@kfi7 (source: 12345-24401@kfi7)
00000100:00000001:1.0:1773851865.407067:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851865.407068:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008aa086c5 nid 24401@kfi7 refs 2
00000100:00000001:0.0:1773851865.407070:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851865.407071:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851865.407071:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851865.407071:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851865.407072:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851865.407074:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851865.407075:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600595488576
00000020:00000001:0.0:1773851865.407076:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851865.407077:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7ff1d
00000020:00000001:0.0:1773851865.407078:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851865.407082:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000056297a8b refcount=10
00000020:00000001:0.0:1773851865.407083:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144867859456 : -106928841692160 : ffff9ebfb05fec00)
00000020:00000001:0.0:1773851865.407084:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144867859456 : -106928841692160 : ffff9ebfb05fec00)
00000100:00000001:0.0:1773851865.407086:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.407087:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851865.407088:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d0934e84.
00000020:00000010:0.0:1773851865.407090:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.407091:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851865.407093:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851865.407094:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851865.407095:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.407098:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851865.407099:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851865.407100:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.407101:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.407104:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851865.407105:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851865.407105:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851865.407106:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851865.407107:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24401@kfi7, seq: 1997546
00000100:00000001:1.0:1773851865.407108:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.407108:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000056297a8b : new rpc_count 3
00000100:00000001:1.0:1773851865.407109:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.407109:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637157856599680 : -106915852951936 : ffff9ec2b6905e80)
00000100:00000040:0.0:1773851865.407111:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f38f015c x1859600595488576/t0(0) o400->0972e34a-e2b8-47bd-91d5-7bfd2b16c95e@24401@kfi7:505/0 lens 224/0 e 0 to 0 dl 1773852620 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2018-0'
00000100:00000001:0.0:1773851865.407116:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.407117:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851865.407119:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f38f015c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0972e34a-e2b8-47bd-91d5-7bfd2b16c95e+10:39494:x1859600595488576:12345-24401@kfi7:400:default-tuolumne2018-0
00000100:00000200:0.0:1773851865.407122:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600595488576
00000020:00000001:0.0:1773851865.407123:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851865.407124:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851865.407125:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.407126:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851865.407127:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851865.407128:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851865.407129:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600595488576, found 0 last_xid 1859600594931903
00000020:00000001:0.0:1773851865.407131:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851865.407132:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851865.407133:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851865.407134:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.407135:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851865.407136:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851865.407137:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851865.407139:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f395f79d.
02000000:00000001:0.0:1773851865.407140:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.407141:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.407142:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851865.407145:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264505295, transno 0, xid 1859600595488576
00010000:00000001:0.0:1773851865.407146:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851865.407147:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f38f015c x1859600595488576/t0(0) o400->0972e34a-e2b8-47bd-91d5-7bfd2b16c95e@24401@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2018-0'
00010000:00000001:0.0:1773851865.407152:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851865.407153:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851865.407154:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=98 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851865.407157:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851865.407158:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e7cfa456 refcount 3 to 24401@kfi7
00000100:00000001:0.0:1773851865.407159:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636940431111776 : -107133278439840 : ffff9e9016feb660)
02000000:00000001:0.0:1773851865.407161:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851865.407162:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.407163:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851865.407164:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24401@kfi7
00000400:00000010:0.0:1773851865.407165:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007a35718f.
00000100:00000200:0.0:1773851865.407167:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600595488576, offset 224
00000400:00000200:0.0:1773851865.407170:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24401@kfi7
00000400:00000200:0.0:1773851865.407171:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24401@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.407173:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008aa086c5 nid 24401@kfi7 refs 1
00000400:00000200:0.0:1773851865.407175:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008aa086c5 nid 24401@kfi7 refs 2
00000400:00000200:0.0:1773851865.407177:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008aa086c5 nid 24401@kfi7 refs 3
00000400:00000200:0.0:1773851865.407179:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24401@kfi7 local destination
00000400:00000200:0.0:1773851865.407182:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769141:8769141:1024:4294967295] 24401@kfi7 LPNI seq info [264721:264721:16:4294967295]
00000400:00000200:0.0:1773851865.407184:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008aa086c5 nid 24401@kfi7 refs 2
00000400:00000200:0.0:1773851865.407186:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24401@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.407189:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24401@kfi7(24401@kfi7:24401@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851865.407192:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008aa086c5 nid 24401@kfi7 refs 3
00000800:00000200:0.0:1773851865.407194:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851865.407196:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851865.407200:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851865.407206:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x8ca Using peer 24401@kfi7(0x8ca)
00000800:00000200:0.0:1773851865.407211:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x8ca: rc=0
00000800:00000200:0.0:1773851865.407214:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x8ca TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851865.407217:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.407219:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e7cfa456 refcount 2 to 24401@kfi7
00010000:00000001:0.0:1773851865.407223:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851865.407223:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.407225:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851865.407226:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f38f015c x1859600595488576/t0(0) o400->0972e34a-e2b8-47bd-91d5-7bfd2b16c95e@24401@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2018-0'
00000100:00100000:0.0:1773851865.407232:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f38f015c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0972e34a-e2b8-47bd-91d5-7bfd2b16c95e+10:39494:x1859600595488576:12345-24401@kfi7:400:default-tuolumne2018-0 Request processed in 114us (167us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851865.407236:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24401@kfi7, seq: 1997546
00000100:00000040:0.0:1773851865.407238:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000056297a8b : new rpc_count 2
00000100:00000001:0.0:1773851865.407239:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851865.407240:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851865.407241:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.407242:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851865.407244:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d0934e84.
00000020:00000040:0.0:1773851865.407246:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000056297a8b : new refcount 9
00000100:00000001:0.0:1773851865.407247:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851865.407255:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x8ca TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851865.407259:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.407261:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24401@kfi7: PUT: OK
00000400:00000200:1.0:1773851865.407262:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007a35718f
00000400:00000010:1.0:1773851865.407263:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007a35718f.
00000100:00000001:1.0:1773851865.407264:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851865.407265:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851865.407267:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008aa086c5 nid 24401@kfi7 refs 2
00000800:00000200:1.0:1773851865.407269:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 24401@kfi7(0000000075f870b8):0x0 lsk 2251 rsk 15 tsk 0 trmk 0 tmk 0 trr 0 tta 0x8ca Transaction freed
00000800:00000200:29.0:1773851865.411125:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851865.411126:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851865.411128:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851865.411132:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851865.411136:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17091@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.411139:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17091@kfi7 : PUT - for me
00000400:00000200:29.0:1773851865.411140:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17091@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.411142:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ca1fecc nid 17091@kfi7 refs 1
00000400:00000200:29.0:1773851865.411144:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17091@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.411145:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ca1fecc nid 17091@kfi7 refs 2
00000400:00000200:29.0:1773851865.411147:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009ca1fecc nid 17091@kfi7 refs 3
00000400:00000200:29.0:1773851865.411149:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17091@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.411150:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17091@kfi7 of length 224 into portal 12 MB=0x69b4b692375c0
00000400:00000200:29.0:1773851865.411153:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17091@kfi7 of length 224/224 into md 0x77fe139dd [64] + 173512
00000800:00000200:29.0:1773851865.411156:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851865.411159:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851865.411161:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17091@kfi7: PUT: OK
00000100:00000001:29.0:1773851865.411162:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851865.411163:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851865.411164:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004db24b81.
00000100:00000040:29.0:1773851865.411166:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000004db24b81 x1859598049048000 msgsize 224
00000100:00100000:29.0:1773851865.411169:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17091@kfi7 (source: 12345-17091@kfi7)
00000100:00000001:29.0:1773851865.411170:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851865.411172:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009ca1fecc nid 17091@kfi7 refs 2
00000100:00000001:31.0:1773851865.411173:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851865.411174:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851865.411174:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851865.411175:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851865.411176:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851865.411177:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851865.411178:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598049048000
00000020:00000001:31.0:1773851865.411180:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851865.411180:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e737d6
00000020:00000001:31.0:1773851865.411181:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851865.411187:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006914e016 refcount=169
00000020:00000001:31.0:1773851865.411189:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131289269248 : -106942420282368 : ffff9ebc87071400)
00000020:00000001:31.0:1773851865.411190:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131289269248 : -106942420282368 : ffff9ebc87071400)
00000100:00000001:31.0:1773851865.411192:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.411194:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851865.411195:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b4f0eb.
00000020:00000010:31.0:1773851865.411197:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851865.411199:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851865.411201:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851865.411201:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851865.411202:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.411204:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851865.411205:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851865.411205:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.411207:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.411209:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851865.411209:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851865.411210:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851865.411210:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851865.411212:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17091@kfi7, seq: 2055511
00000100:00000040:31.0:1773851865.411213:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006914e016 : new rpc_count 1
00000100:00000001:28.0:1773851865.411213:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.411214:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343708800 : -106994365842816 : ffff9eb06ed4ba80)
00000100:00000001:28.0:1773851865.411214:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.411216:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004db24b81 x1859598049048000/t0(0) o400->ce913412-1d1d-4164-9ba6-c1c77f66752e@17091@kfi7:653/0 lens 224/0 e 0 to 0 dl 1773852013 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1559-0'
00000100:00000001:31.0:1773851865.411220:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.411220:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851865.411221:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004db24b81 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ce913412-1d1d-4164-9ba6-c1c77f66752e+169:39461:x1859598049048000:12345-17091@kfi7:400:default-tuolumne1559-0
00000100:00000200:31.0:1773851865.411223:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598049048000
00000020:00000001:31.0:1773851865.411223:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851865.411224:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851865.411225:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.411226:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851865.411226:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851865.411227:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851865.411228:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598049048000, found 0 last_xid 1859598048624511
00000020:00000001:31.0:1773851865.411229:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851865.411230:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851865.411230:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851865.411231:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.411232:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851865.411233:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851865.411233:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851865.411234:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000016bd66c2.
02000000:00000001:31.0:1773851865.411235:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.411236:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.411237:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851865.411237:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264060951, transno 0, xid 1859598049048000
00010000:00000001:31.0:1773851865.411238:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851865.411239:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004db24b81 x1859598049048000/t0(0) o400->ce913412-1d1d-4164-9ba6-c1c77f66752e@17091@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1559-0'
00010000:00000001:31.0:1773851865.411242:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851865.411243:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851865.411244:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=98 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851865.411245:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851865.411245:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b1134d7c refcount 3 to 17091@kfi7
00000100:00000001:31.0:1773851865.411246:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806752 : -107130477744864 : ffff9e90bdeded20)
02000000:00000001:31.0:1773851865.411247:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851865.411248:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.411248:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851865.411250:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17091@kfi7
00000400:00000010:31.0:1773851865.411250:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000819b29f0.
00000100:00000200:31.0:1773851865.411251:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598049048000, offset 224
00000400:00000200:31.0:1773851865.411253:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17091@kfi7
00000400:00000200:31.0:1773851865.411254:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17091@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.411255:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ca1fecc nid 17091@kfi7 refs 1
00000400:00000200:31.0:1773851865.411256:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009ca1fecc nid 17091@kfi7 refs 2
00000400:00000200:31.0:1773851865.411257:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009ca1fecc nid 17091@kfi7 refs 3
00000400:00000200:31.0:1773851865.411259:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17091@kfi7 local destination
00000400:00000200:31.0:1773851865.411260:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769142:8769142:1024:4294967295] 17091@kfi7 LPNI seq info [1186070:1186070:16:4294967295]
00000400:00000200:31.0:1773851865.411262:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009ca1fecc nid 17091@kfi7 refs 2
00000400:00000200:31.0:1773851865.411263:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17091@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.411265:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17091@kfi7(17091@kfi7:17091@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851865.411267:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009ca1fecc nid 17091@kfi7 refs 3
00000800:00000200:31.0:1773851865.411268:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851865.411269:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851865.411271:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851865.411274:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000527 Using peer 17091@kfi7(0x100000000000527)
00000800:00000200:31.0:1773851865.411277:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x100000000000527: rc=0
00000800:00000200:31.0:1773851865.411279:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000527 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851865.411281:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.411281:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b1134d7c refcount 2 to 17091@kfi7
00010000:00000001:31.0:1773851865.411283:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851865.411283:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.411284:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851865.411284:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004db24b81 x1859598049048000/t0(0) o400->ce913412-1d1d-4164-9ba6-c1c77f66752e@17091@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1559-0'
00000100:00100000:31.0:1773851865.411287:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004db24b81 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ce913412-1d1d-4164-9ba6-c1c77f66752e+169:39461:x1859598049048000:12345-17091@kfi7:400:default-tuolumne1559-0 Request processed in 67us (121us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851865.411290:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17091@kfi7, seq: 2055511
00000100:00000040:31.0:1773851865.411291:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006914e016 : new rpc_count 0
00000100:00000001:31.0:1773851865.411291:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851865.411291:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000527 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851865.411292:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851865.411292:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851865.411293:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851865.411293:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000400:00000200:29.0:1773851865.411293:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17091@kfi7: PUT: OK
00000020:00000010:31.0:1773851865.411294:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b4f0eb.
00000020:00000040:31.0:1773851865.411295:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000006914e016 : new refcount 168
00000400:00000200:29.0:1773851865.411295:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000819b29f0
00000400:00000010:29.0:1773851865.411295:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000819b29f0.
00000100:00000001:31.0:1773851865.411296:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851865.411296:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851865.411296:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851865.411297:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009ca1fecc nid 17091@kfi7 refs 2
00000800:00000200:29.0:1773851865.411299:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17091@kfi7(00000000a94a2875):0x0 lsk 1320 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000527 Transaction freed
00000004:00000001:6.0:1773851865.417731:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851865.417731:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851865.417732:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000039f98caa.
00000100:00000001:16.0:1773851865.417733:0:61342:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000020:00000040:6.0:1773851865.417733:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851865.417734:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851865.417734:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851865.417735:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851865.417736:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569142ac.
00000100:00000001:6.0:1773851865.417737:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851865.417738:0:61342:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +381s
00000100:00000001:6.0:1773851865.417738:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00001000:16.0:1773851865.417739:0:61342:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000100:00000001:6.0:1773851865.417739:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851865.417740:0:61342:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000040:6.0:1773851865.417740:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000039f98caa] to pc [ptlrpcd_01_00+0]  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:16.0:1773851865.417741:0:61342:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -133s) for 138+30  req@000000006cd58f25 x1859602589898304/t0(0) o49->2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7@22579@kfi7:510/0 lens 480/0 e 2 to 0 dl 1773851870 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111561828695040'
00000100:00001000:16.0:1773851865.417744:0:61342:0:(import.c:1951:at_measured()) add 163 to 00000000e41c26a6 time=119 v=138 (138 0 0 0)
00080000:00000001:6.0:1773851865.417744:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00001000:16.0:1773851865.417745:0:61342:0:(import.c:2016:at_measured()) AT 00000000e41c26a6 change: old=138 new=163 delta=25 (val=163) hist 163 0 0 0
00000100:00000001:7.0:1773851865.417745:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851865.417746:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851865.417746:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:6.0:1773851865.417746:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e0ec663f.
00080000:00000001:6.0:1773851865.417746:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637023834689536 : -107049874862080 : ffff9ea3823c5000)
00000100:00000001:4.0:1773851865.417746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000010:16.0:1773851865.417747:0:61342:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000caa5ad98.
00000100:00000040:7.0:1773851865.417747:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851865.417747:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851865.417747:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:16.0:1773851865.417748:0:61342:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 480 at 00000000d3b15942.
00080000:00000001:6.0:1773851865.417748:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851865.417749:0:61342:0:(genops.c:802:class_conn2export()) Process entered
00000004:00001000:6.0:1773851865.417749:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000004:00000010:6.0:1773851865.417749:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f5907d3b.
00000020:00000040:16.0:1773851865.417750:0:61342:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7abc5
00000020:00000001:16.0:1773851865.417750:0:61342:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:7.0:1773851865.417750:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851865.417750:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851865.417750:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614139871025908ns, next at 614140871024916ns, rc = 0
02000000:00000001:7.0:1773851865.417751:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851865.417751:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851865.417751:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000020:00000040:16.0:1773851865.417752:0:61342:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ce28a53c refcount=407
00080000:00000001:6.0:1773851865.417752:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851865.417753:0:61342:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119298217984 : -106954411333632 : ffff9eb9bc4e2800)
00000100:00100000:7.0:1773851865.417753:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000039f98caa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051927744:16@kfi7:13:default-yuba2-0
00000004:00000001:6.0:1773851865.417753:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851865.417754:0:61342:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119298217984 : -106954411333632 : ffff9eb9bc4e2800)
00000100:00000001:7.0:1773851865.417754:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851865.417754:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:16.0:1773851865.417755:0:61342:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 00000000ce28a53c : new rpc_count 9
00000100:00000001:16.0:1773851865.417755:0:61342:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851865.417755:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851865.417755:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:16.0:1773851865.417756:0:61342:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851865.417756:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000077b7cdda.
02000000:00000001:7.0:1773851865.417756:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:16.0:1773851865.417757:0:61342:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e0b6ca85.
02000000:00000001:16.0:1773851865.417757:0:61342:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851865.417757:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000100:00000001:16.0:1773851865.417758:0:61342:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851865.417758:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00010000:00000001:16.0:1773851865.417759:0:61342:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000400:00000010:7.0:1773851865.417759:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00010000:00000001:16.0:1773851865.417760:0:61342:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851865.417760:0:61342:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000200:7.0:1773851865.417760:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927744, portal 4
00000100:00000040:16.0:1773851865.417761:0:61342:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ff5c9ebe refcount 3 to 22579@kfi7
00000100:00000001:7.0:1773851865.417761:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851865.417761:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139802784896 : -106933906766720 : ffff9ebe82790480)
00000100:00000001:16.0:1773851865.417762:0:61342:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703744 : -107156155847872 : ffff9e8ac3652b40)
00000100:00000040:7.0:1773851865.417762:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:16.0:1773851865.417763:0:61342:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851865.417764:0:61342:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851865.417764:0:61342:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851865.417765:0:61342:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22771@kfi7
00000100:00000001:7.0:1773851865.417765:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:16.0:1773851865.417766:0:61342:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003cf15531.
00000100:00000040:7.0:1773851865.417766:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000100:00000200:16.0:1773851865.417767:0:61342:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602589898304, offset 0
00000400:00000010:7.0:1773851865.417767:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034f580d9.
00000100:00000200:7.0:1773851865.417767:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927744, offset 0
00000400:00000200:16.0:1773851865.417769:0:61342:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22771@kfi7
00000400:00000200:7.0:1773851865.417769:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:16.0:1773851865.417770:0:61342:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:7.0:1773851865.417770:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:16.0:1773851865.417771:0:61342:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 1
00000400:00000200:7.0:1773851865.417771:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:16.0:1773851865.417772:0:61342:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:7.0:1773851865.417772:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:16.0:1773851865.417774:0:61342:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 3
00000400:00000200:7.0:1773851865.417774:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:16.0:1773851865.417775:0:61342:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22771@kfi7 local destination
00000400:00000200:7.0:1773851865.417775:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:16.0:1773851865.417777:0:61342:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769143:8769143:1024:4294967295] 22771@kfi7 LPNI seq info [3370900:3370900:16:4294967295]
00000400:00000200:7.0:1773851865.417777:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769141, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769142, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851865.417778:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:16.0:1773851865.417779:0:61342:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:7.0:1773851865.417779:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:16.0:1773851865.417780:0:61342:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:7.0:1773851865.417780:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:7.0:1773851865.417781:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769144:8769144:1024:4294967295] 16@kfi7 LPNI seq info [5403814:5403814:16:4294967295]
00000400:00000200:16.0:1773851865.417782:0:61342:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22771@kfi7(22771@kfi7:22771@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851865.417783:0:61342:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 3
00000400:00000200:7.0:1773851865.417783:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851865.417784:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000800:00000200:16.0:1773851865.417785:0:61342:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851865.417786:0:61342:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851865.417787:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851865.417788:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:16.0:1773851865.417789:0:61342:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851865.417790:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851865.417791:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851865.417792:0:61342:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 Using peer 22771@kfi7(0x100000000000e21)
00000800:00000200:7.0:1773851865.417794:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851865.417795:0:61342:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x100000000000e21: rc=0
00000800:00000200:16.0:1773851865.417796:0:61342:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851865.417796:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Using peer 16@kfi7(0x15d)
00000100:00000001:16.0:1773851865.417798:0:61342:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851865.417799:0:61342:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ff5c9ebe refcount 2 to 22579@kfi7
00000800:00000200:7.0:1773851865.417799:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x15d: rc=0
00000100:00000040:16.0:1773851865.417800:0:61342:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 00000000ce28a53c : new rpc_count 8
00000020:00000040:16.0:1773851865.417801:0:61342:0:(genops.c:882:class_export_put()) PUTting export 00000000ce28a53c : new refcount 406
00000800:00000200:7.0:1773851865.417801:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000010:16.0:1773851865.417802:0:61342:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 480 at 00000000d3b15942.
00000100:00000010:16.0:1773851865.417802:0:61342:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000caa5ad98.
00000100:00000001:7.0:1773851865.417803:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.417803:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851865.417804:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851865.417805:0:61342:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851865.417805:0:61342:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +25s
00000100:00000001:7.0:1773851865.417805:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.417805:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.417806:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:16.0:1773851865.417807:0:61342:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.417807:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851865.417807:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851865.417808:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851865.417808:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.417809:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851865.417812:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851865.417814:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851865.417814:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851865.417815:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851865.417816:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22771@kfi7: PUT: OK
00000400:00000200:17.0:1773851865.417817:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003cf15531
00000400:00000200:6.0:1773851865.417817:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000400:00000200:6.0:1773851865.417817:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034f580d9
00000400:00000010:17.0:1773851865.417818:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003cf15531.
00000400:00000010:6.0:1773851865.417818:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034f580d9.
00000100:00000001:17.0:1773851865.417819:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:17.0:1773851865.417819:0:2511435:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000100:00000001:6.0:1773851865.417819:0:2499722:0:(events.c:53:request_out_callback()) Process entered
02000000:00000010:17.0:1773851865.417820:0:2511435:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e0b6ca85.
02000000:00000001:17.0:1773851865.417820:0:2511435:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000200:6.0:1773851865.417820:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851865.417821:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851865.417822:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000800:00000200:17.0:1773851865.417823:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 Transaction freed
00000100:00000001:6.0:1773851865.417825:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851865.417826:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851865.417828:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851865.417829:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851865.417830:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:6.0:1773851865.417832:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Transaction freed
00000800:00000200:29.0:1773851865.417858:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851865.417859:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851865.417860:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851865.417862:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851865.417863:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.417865:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851865.417866:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.417866:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851865.417867:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.417868:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851865.417869:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851865.417870:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.417870:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b34c0
00000400:00000200:29.0:1773851865.417871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.417873:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x78008067d [1] + 224
00000800:00000200:29.0:1773851865.417875:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851865.417876:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851865.417877:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851865.417879:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851865.417880:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851865.417883:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851865.417886:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851865.417887:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:7.0:1773851865.417888:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851865.417889:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851865.417889:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851865.417890:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851865.417890:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851865.417891:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000400:00000200:7.0:1773851865.417892:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000400:00000010:7.0:1773851865.417892:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000100:00000001:7.0:1773851865.417893:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851865.417894:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851865.417897:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851865.417902:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851865.417902:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.417903:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851865.417903:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851865.417903:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851865.417904:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851865.417905:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851865.417906:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=98 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851865.417907:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=98 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851865.417908:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851865.417908:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851865.417909:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851865.417909:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.417910:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851865.417910:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:7.0:1773851865.417911:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851865.417911:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851865.417912:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851865.417915:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851865.417916:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851865.417916:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851865.417917:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851865.417917:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851865.417918:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482223616 avail=351481179136 avail_mb=1372973356 hwm_mb=3131103 files=372097220 ffree=343244359 state=0: rc = 0
00000004:00000020:7.0:1773851865.417920:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482223616 free, 351481179136 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097220 files, 343244359 free files
00000004:00000001:7.0:1773851865.417922:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851865.417922:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851865.417925:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000039f98caa pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051927744:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851865.417928:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.417929:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851865.417929:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000039f98caa x1859433051927744/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851865.417932:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851865.417932:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851865.417933:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000077b7cdda.
02000000:00000001:7.0:1773851865.417934:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851865.417934:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851865.417935:0:41064:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:7.0:1773851865.417936:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851865.417936:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569142ac.
02000000:00000001:7.0:1773851865.417937:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851865.417937:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851865.417938:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000039f98caa.
00000100:00000001:7.0:1773851865.417939:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851865.417939:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.417940:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.417940:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851865.417941:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.417941:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851865.417942:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851865.453318:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851865.453319:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851865.453320:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851865.453323:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851865.453325:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11699@kfi7 to cpt 3
00000400:00000200:13.0:1773851865.453326:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11699@kfi7 : PUT - for me
00000400:00000200:13.0:1773851865.453327:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11699@kfi7 to cpt 3
00000400:00000200:13.0:1773851865.453328:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a230cc4 nid 11699@kfi7 refs 1
00000400:00000200:13.0:1773851865.453330:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11699@kfi7 to cpt 3
00000400:00000200:13.0:1773851865.453331:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a230cc4 nid 11699@kfi7 refs 2
00000400:00000200:13.0:1773851865.453331:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003a230cc4 nid 11699@kfi7 refs 3
00000400:00000200:13.0:1773851865.453332:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11699@kfi7 to cpt 3
00000400:00000200:13.0:1773851865.453333:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11699@kfi7 of length 224 into portal 12 MB=0x69b09325a7f80
00000400:00000200:13.0:1773851865.453335:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11699@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 26440
00000800:00000200:13.0:1773851865.453338:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851865.453339:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851865.453340:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11699@kfi7: PUT: OK
00000100:00000001:13.0:1773851865.453341:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851865.453342:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851865.453343:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000003f92fdb.
00000100:00000040:13.0:1773851865.453343:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000003f92fdb x1859313662066560 msgsize 224
00000100:00100000:13.0:1773851865.453345:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-11699@kfi7 (source: 12345-11699@kfi7)
00000100:00000001:13.0:1773851865.453346:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851865.453347:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003a230cc4 nid 11699@kfi7 refs 2
00000100:00000001:15.0:1773851865.453348:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851865.453348:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851865.453349:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851865.453349:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851865.453350:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851865.453351:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851865.453351:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313662066560
00000020:00000001:15.0:1773851865.453352:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851865.453353:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9127d
00000020:00000001:15.0:1773851865.453353:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851865.453356:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000010fd818a refcount=6
00000020:00000001:15.0:1773851865.453357:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716215808 : -107155993335808 : ffff9e8acd14e800)
00000020:00000001:15.0:1773851865.453358:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716215808 : -107155993335808 : ffff9e8acd14e800)
00000100:00000001:15.0:1773851865.453359:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851865.453360:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851865.453360:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002b762ff1.
00000020:00000010:15.0:1773851865.453361:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851865.453362:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851865.453363:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851865.453364:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851865.453364:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851865.453365:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851865.453366:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851865.453366:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851865.453367:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851865.453369:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851865.453369:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851865.453369:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851865.453369:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851865.453370:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11699@kfi7, seq: 2289824
00000100:00000040:15.0:1773851865.453371:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000010fd818a : new rpc_count 1
00000100:00000001:15.0:1773851865.453372:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123338776960 : -106950370774656 : ffff9ebaad243180)
00000100:00000001:13.0:1773851865.453372:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851865.453372:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851865.453373:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000003f92fdb x1859313662066560/t0(0) o400->49afe636-3e88-40ea-b49a-a7570f1ecd9d@11699@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1210-0'
00000100:00000001:15.0:1773851865.453376:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851865.453377:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851865.453378:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003f92fdb pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:49afe636-3e88-40ea-b49a-a7570f1ecd9d+6:39870:x1859313662066560:12345-11699@kfi7:400:default-tuolumne1210-0
00000100:00000200:15.0:1773851865.453379:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313662066560
00000020:00000001:15.0:1773851865.453380:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851865.453380:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851865.453381:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851865.453382:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851865.453382:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851865.453383:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851865.453384:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313662066560, found 0 last_xid 1859313662066559
00000020:00000001:15.0:1773851865.453384:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851865.453385:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851865.453386:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851865.453386:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851865.453387:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851865.453387:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851865.453388:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851865.453389:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000011fb65f9.
02000000:00000001:15.0:1773851865.453390:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851865.453390:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851865.453391:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851865.453392:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035333919, transno 0, xid 1859313662066560
00010000:00000001:15.0:1773851865.453392:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851865.453393:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000003f92fdb x1859313662066560/t0(0) o400->49afe636-3e88-40ea-b49a-a7570f1ecd9d@11699@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1210-0'
00010000:00000001:15.0:1773851865.453396:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851865.453397:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851865.453398:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=98 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851865.453399:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851865.453400:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f720fd32 refcount 3 to 11699@kfi7
00000100:00000001:15.0:1773851865.453400:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902776288 : -107154806775328 : ffff9e8b13ce61e0)
02000000:00000001:15.0:1773851865.453401:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851865.453402:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851865.453403:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851865.453403:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11699@kfi7
00000400:00000010:15.0:1773851865.453404:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008af5e37b.
00000100:00000200:15.0:1773851865.453405:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859313662066560, offset 224
00000400:00000200:15.0:1773851865.453406:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11699@kfi7
00000400:00000200:15.0:1773851865.453407:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11699@kfi7 to cpt 3
00000400:00000200:15.0:1773851865.453408:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a230cc4 nid 11699@kfi7 refs 1
00000400:00000200:15.0:1773851865.453409:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003a230cc4 nid 11699@kfi7 refs 2
00000400:00000200:15.0:1773851865.453411:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003a230cc4 nid 11699@kfi7 refs 3
00000400:00000200:15.0:1773851865.453412:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11699@kfi7 local destination
00000400:00000200:15.0:1773851865.453413:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769145:8769145:1024:4294967295] 11699@kfi7 LPNI seq info [731174:731174:16:4294967295]
00000400:00000200:15.0:1773851865.453415:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003a230cc4 nid 11699@kfi7 refs 2
00000400:00000200:15.0:1773851865.453415:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11699@kfi7 to cpt 3
00000400:00000200:15.0:1773851865.453417:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11699@kfi7(11699@kfi7:11699@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851865.453418:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003a230cc4 nid 11699@kfi7 refs 3
00000800:00000200:15.0:1773851865.453420:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851865.453421:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851865.453423:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851865.453425:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006e5 Using peer 11699@kfi7(0x1000000000006e5)
00000800:00000200:15.0:1773851865.453428:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x1000000000006e5: rc=0
00000800:00000200:15.0:1773851865.453430:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006e5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851865.453434:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851865.453435:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f720fd32 refcount 2 to 11699@kfi7
00010000:00000001:15.0:1773851865.453436:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851865.453436:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851865.453437:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851865.453438:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000003f92fdb x1859313662066560/t0(0) o400->49afe636-3e88-40ea-b49a-a7570f1ecd9d@11699@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1210-0'
00000100:00100000:15.0:1773851865.453441:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003f92fdb pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:49afe636-3e88-40ea-b49a-a7570f1ecd9d+6:39870:x1859313662066560:12345-11699@kfi7:400:default-tuolumne1210-0 Request processed in 64us (96us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851865.453442:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006e5 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851865.453443:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851865.453444:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11699@kfi7, seq: 2289824
00000100:00000040:15.0:1773851865.453444:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000010fd818a : new rpc_count 0
00000400:00000200:13.0:1773851865.453444:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11699@kfi7: PUT: OK
00000100:00000001:15.0:1773851865.453445:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851865.453445:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008af5e37b
00000100:00000001:15.0:1773851865.453446:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851865.453446:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000010:13.0:1773851865.453446:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008af5e37b.
00000020:00000010:15.0:1773851865.453447:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000100:00000001:13.0:1773851865.453447:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851865.453447:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851865.453448:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002b762ff1.
00000400:00000200:13.0:1773851865.453448:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003a230cc4 nid 11699@kfi7 refs 2
00000020:00000040:15.0:1773851865.453449:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000010fd818a : new refcount 5
00000800:00000200:13.0:1773851865.453449:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 11699@kfi7(0000000018532e1f):0x0 lsk 1766 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006e5 Transaction freed
00000100:00000001:15.0:1773851865.453450:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851865.533807:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851865.533808:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851865.533810:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851865.533812:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851865.533813:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.533814:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 36@kfi7 : PUT - for me
00000400:00000200:17.0:1773851865.533815:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.533816:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:17.0:1773851865.533817:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.533817:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:17.0:1773851865.533818:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:17.0:1773851865.533819:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.533820:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 224 into portal 12 MB=0x699e277753440
00000400:00000200:17.0:1773851865.533821:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-36@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 7640
00000800:00000200:17.0:1773851865.533823:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851865.533825:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851865.533826:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->36@kfi7: PUT: OK
00000100:00000001:17.0:1773851865.533827:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851865.533827:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851865.533829:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f03edab.
00000100:00000040:17.0:1773851865.533830:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001f03edab x1858047806092352 msgsize 224
00000100:00100000:17.0:1773851865.533831:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-36@kfi7 (source: 12345-36@kfi7)
00000100:00000001:17.0:1773851865.533832:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851865.533833:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:17.0:1773851865.533834:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851865.533837:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851865.533837:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851865.533838:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851865.533838:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851865.533839:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851865.533840:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858047806092352
00000020:00000001:17.0:1773851865.533840:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851865.533841:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acd2801
00000020:00000001:17.0:1773851865.533841:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851865.533844:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006a917965 refcount=5
00000020:00000001:17.0:1773851865.533844:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937486531584 : -107136223020032 : ffff9e8f677bfc00)
00000020:00000001:17.0:1773851865.533845:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937486531584 : -107136223020032 : ffff9e8f677bfc00)
00000100:00000001:17.0:1773851865.533846:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851865.533847:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851865.533848:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851865.533849:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851865.533849:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851865.533850:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851865.533851:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851865.533851:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851865.533852:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851865.533852:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851865.533853:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.533854:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851865.533855:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851865.533855:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851865.533855:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851865.533856:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851865.533857:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-36@kfi7, seq: 2156311
00000100:00000040:17.0:1773851865.533857:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006a917965 : new rpc_count 1
00000100:00000001:16.0:1773851865.533857:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.533858:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093937152 : -107022615614464 : ffff9ea9db036c00)
00000100:00000001:16.0:1773851865.533858:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851865.533859:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001f03edab x1858047806092352/t0(0) o400->lustre5-MDT0001-lwp-OST0000_UUID@36@kfi7:86/0 lens 224/0 e 0 to 0 dl 1773852201 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba101-0'
00000100:00000001:17.0:1773851865.533862:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851865.533863:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851865.533864:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f03edab pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:lustre5-MDT0001-lwp-OST0000_UUID+5:272695:x1858047806092352:12345-36@kfi7:400:default-yuba101-0
00000100:00000200:17.0:1773851865.533865:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858047806092352
00000020:00000001:17.0:1773851865.533866:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851865.533866:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851865.533867:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.533867:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851865.533868:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851865.533869:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:17.0:1773851865.533869:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851865.533870:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851865.533870:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851865.533871:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.533872:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851865.533872:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851865.533873:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851865.533873:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f6e3535d.
02000000:00000001:17.0:1773851865.533874:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.533875:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.533875:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851865.533876:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858047806092352
00010000:00000001:17.0:1773851865.533877:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851865.533878:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001f03edab x1858047806092352/t0(0) o400->lustre5-MDT0001-lwp-OST0000_UUID@36@kfi7:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba101-0'
00010000:00000001:17.0:1773851865.533880:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851865.533880:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851865.533881:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=98 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851865.533882:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851865.533883:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c2d6e769 refcount 7 to 36@kfi7
00000100:00000001:17.0:1773851865.533884:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517856 : -107156126033760 : ffff9e8ac52c18a0)
02000000:00000001:17.0:1773851865.533885:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851865.533885:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.533886:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851865.533887:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000010:17.0:1773851865.533887:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2680273.
00000100:00000200:17.0:1773851865.533888:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858047806092352, offset 224
00000400:00000200:17.0:1773851865.533889:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:17.0:1773851865.533890:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.533890:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:17.0:1773851865.533891:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:17.0:1773851865.533892:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:17.0:1773851865.533893:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  36@kfi7 local destination
00000400:00000200:17.0:1773851865.533895:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769146:8769146:1024:4294967295] 36@kfi7 LPNI seq info [5403966:5403966:16:4294967295]
00000400:00000200:17.0:1773851865.533896:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:17.0:1773851865.533897:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.533898:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851865.533899:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:17.0:1773851865.533901:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851865.533902:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851865.533904:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851865.533906:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x21b Using peer 36@kfi7(0x21b)
00000800:00000200:17.0:1773851865.533908:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x21b: rc=0
00000800:00000200:17.0:1773851865.533910:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x21b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851865.533911:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851865.533912:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c2d6e769 refcount 6 to 36@kfi7
00010000:00000001:17.0:1773851865.533913:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851865.533914:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.533915:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851865.533915:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f03edab x1858047806092352/t0(0) o400->lustre5-MDT0001-lwp-OST0000_UUID@36@kfi7:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba101-0'
00000100:00100000:17.0:1773851865.533918:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f03edab pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:lustre5-MDT0001-lwp-OST0000_UUID+5:272695:x1858047806092352:12345-36@kfi7:400:default-yuba101-0 Request processed in 55us (88us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851865.533922:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-36@kfi7, seq: 2156311
00000100:00000040:17.0:1773851865.533922:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006a917965 : new rpc_count 0
00000800:00000200:18.0:1773851865.533923:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x21b TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851865.533923:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851865.533924:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851865.533924:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851865.533924:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851865.533925:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->36@kfi7: PUT: OK
00000020:00000010:17.0:1773851865.533925:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851865.533926:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2680273
00000020:00000010:17.0:1773851865.533926:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000020:00000040:17.0:1773851865.533926:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000006a917965 : new refcount 4
00000400:00000010:18.0:1773851865.533927:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2680273.
00000100:00000001:18.0:1773851865.533927:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851865.533927:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851865.533928:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851865.533929:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:18.0:1773851865.533930:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x21b Transaction freed
00000800:00000200:25.0:1773851865.564004:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851865.564005:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851865.564007:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851865.564009:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851865.564011:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.564012:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8307@kfi7 : PUT - for me
00000400:00000200:25.0:1773851865.564013:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.564013:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a87266f1 nid 8307@kfi7 refs 1
00000400:00000200:25.0:1773851865.564014:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.564015:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a87266f1 nid 8307@kfi7 refs 2
00000400:00000200:25.0:1773851865.564016:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a87266f1 nid 8307@kfi7 refs 3
00000400:00000200:25.0:1773851865.564017:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.564018:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8370@kfi7 of length 520 into portal 12 MB=0x699e51b7504c0
00000400:00000200:25.0:1773851865.564019:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8370@kfi7 of length 520/520 into md 0x16159c9699 [64] + 2240
00000800:00000200:25.0:1773851865.564021:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851865.564022:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851865.564023:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8307@kfi7: PUT: OK
00000100:00000001:25.0:1773851865.564024:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851865.564025:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851865.564026:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cb61583e.
00000100:00000040:25.0:1773851865.564026:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000cb61583e x1858059147478208 msgsize 520
00000100:00100000:25.0:1773851865.564028:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8370@kfi7 (source: 12345-8307@kfi7)
00000100:00000001:25.0:1773851865.564029:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851865.564030:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a87266f1 nid 8307@kfi7 refs 2
00000100:00000001:24.0:1773851865.564031:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851865.564032:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851865.564032:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851865.564033:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851865.564034:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851865.564035:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851865.564036:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059147478208
00000020:00000001:24.0:1773851865.564037:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851865.564038:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91888
00000020:00000001:24.0:1773851865.564039:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851865.564041:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076ee99f4 refcount=21
00000020:00000001:24.0:1773851865.564042:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000020:00000001:24.0:1773851865.564044:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000100:00000001:24.0:1773851865.564046:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851865.564047:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851865.564048:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000019f92fd.
00000020:00000010:24.0:1773851865.564049:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851865.564050:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005179b485.
00000100:00000001:24.0:1773851865.564052:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851865.564052:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851865.564053:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851865.564055:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:24.0:1773851865.564056:0:60973:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@00000000cb61583e x1858059147478208/t0(0) o38->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852065 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne1002-0'
00000100:00000001:24.0:1773851865.564061:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851865.564062:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851865.564063:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851865.564065:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851865.564065:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851865.564065:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:25.0:1773851865.564066:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8370@kfi7, seq: 2025091
00000100:00000001:24.0:1773851865.564066:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:25.0:1773851865.564067:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000076ee99f4 : new rpc_count 4
00000100:00000001:24.0:1773851865.564067:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851865.564068:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478762752 : -106938230788864 : ffff9ebd80bdad00)
00000100:00000001:24.0:1773851865.564068:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851865.564069:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cb61583e x1858059147478208/t0(0) o38->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852065 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne1002-0'
00000100:00000001:25.0:1773851865.564071:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851865.564072:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851865.564072:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb61583e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:8f68da36-21fb-4bf8-b064-ed0ff3e25ba4+21:40629:x1858059147478208:12345-8370@kfi7:38:login-tuolumne1002-0
00000100:00000200:25.0:1773851865.564074:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059147478208
00000020:00000001:25.0:1773851865.564075:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:25.0:1773851865.564075:0:41182:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:25.0:1773851865.564077:0:41182:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:25.0:1773851865.564078:0:41182:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:25.0:1773851865.564079:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851865.564080:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851865.564081:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 0000000029318578.
02000000:00000001:25.0:1773851865.564082:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851865.564082:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:25.0:1773851865.564083:0:41182:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:25.0:1773851865.564084:0:41182:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4 (at 8370@kfi7) reconnecting
00010000:00000001:25.0:1773851865.564085:0:41182:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:25.0:1773851865.564086:0:41182:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:25.0:1773851865.564087:0:41182:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7 t176133227543 exp 0000000076ee99f4 cur 614140 last 1773851865
00010000:00000001:25.0:1773851865.564088:0:41182:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:25.0:1773851865.564089:0:41182:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:25.0:1773851865.564089:0:41182:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:25.0:1773851865.564090:0:41182:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:25.0:1773851865.564091:0:41182:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:25.0:1773851865.564092:0:41182:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:25.0:1773851865.564093:0:41182:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:25.0:1773851865.564093:0:41182:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:25.0:1773851865.564094:0:41182:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:25.0:1773851865.564095:0:41182:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851865.564096:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:25.0:1773851865.564096:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:25.0:1773851865.564098:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851865.564099:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:25.0:1773851865.564100:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4/0000000076ee99f4 free: 126633370845184 avail: 126633368748032
00000020:00000001:25.0:1773851865.564101:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:25.0:1773851865.564101:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4/0000000076ee99f4 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:25.0:1773851865.564102:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:25.0:1773851865.564103:0:41182:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:25.0:1773851865.564104:0:41182:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:25.0:1773851865.564104:0:41182:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli 8f68da36-21fb-4bf8-b064-ed0ff3e25ba4/0000000076ee99f4 ocd_grant: 1875771391 want: 2097152 left: 112130449866752
00000020:00000001:25.0:1773851865.564105:0:41182:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:25.0:1773851865.564106:0:41182:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 8370@kfi7 supports cksum type f7, return f7
00000004:00000001:25.0:1773851865.564107:0:41182:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:25.0:1773851865.564108:0:41182:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:25.0:1773851865.564108:0:41182:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:25.0:1773851865.564109:0:41182:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851865.564110:0:41182:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:25.0:1773851865.564110:0:41182:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851865.564111:0:41182:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 0000000076ee99f4 : new rpc_count 3
00000020:00000040:25.0:1773851865.564112:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 21
00000020:00000040:25.0:1773851865.564113:0:41182:0:(genops.c:871:class_export_get()) GET export 0000000076ee99f4 refcount=22
00000100:00000040:25.0:1773851865.564114:0:41182:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 0000000076ee99f4 : new rpc_count 4
00000100:00000001:25.0:1773851865.564115:0:41182:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:25.0:1773851865.564115:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.564116:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000caae4472 nid 8370@kfi7 refs 1
00000400:00000200:25.0:1773851865.564117:0:41182:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 00000000caae4472 nid 8370@kfi7 refs 2
00000400:00000200:25.0:1773851865.564119:0:41182:0:(peer.c:1555:LNetPrimaryNID()) NID 8370@kfi7 primary NID 8370@kfi7 rc 0
00000100:00000001:25.0:1773851865.564154:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851865.564155:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000049078092 refcount 3 to 8370@kfi7
00000100:00000001:25.0:1773851865.564156:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336256 : -107152617215360 : ffff9e8b96506a80)
00000100:00000001:25.0:1773851865.564156:0:41182:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636921092336256 : -107152617215360 : 0xffff9e8b96506a80)
00000100:00000040:25.0:1773851865.564158:0:41182:0:(connection.c:133:ptlrpc_connection_get()) conn=0000000049078092 refcount 3 to 8370@kfi7
00000100:00080000:25.0:1773851865.564159:0:41182:0:(import.c:86:import_set_state_nolock()) 00000000d62dcfc0 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:25.0:1773851865.564160:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000049078092 refcount 2 to 8370@kfi7
00000100:00000001:25.0:1773851865.564160:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851865.564161:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000049078092 refcount 3 to 8370@kfi7
00000100:00000001:25.0:1773851865.564161:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336256 : -107152617215360 : ffff9e8b96506a80)
02000000:00000001:25.0:1773851865.564163:0:41182:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:25.0:1773851865.564164:0:41182:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:25.0:1773851865.564164:0:41182:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851865.564165:0:41182:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:25.0:1773851865.564166:0:41182:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:25.0:1773851865.564166:0:41182:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:25.0:1773851865.564167:0:41182:0:(import.c:86:import_set_state_nolock()) 00000000d62dcfc0 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:25.0:1773851865.564168:0:41182:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:25.0:1773851865.564168:0:41182:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:25.0:1773851865.564169:0:41182:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:25.0:1773851865.564169:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 21
00000020:00000040:25.0:1773851865.564170:0:41182:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:25.0:1773851865.564171:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000049078092 refcount 2 to 8370@kfi7
00010000:00000001:25.0:1773851865.564171:0:41182:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851865.564172:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851865.564173:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:25.0:1773851865.564174:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:25.0:1773851865.564174:0:41182:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851865.564175:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851865.564175:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851865.564176:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851865.564177:0:41182:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:25.0:1773851865.564178:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:25.0:1773851865.564178:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:25.0:1773851865.564179:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:25.0:1773851865.564179:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851865.564180:0:41182:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851865.564180:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183226748786, transno 0, xid 1858059147478208
00010000:00000001:25.0:1773851865.564181:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851865.564182:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cb61583e x1858059147478208/t0(0) o38->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852065 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1002-0'
00010000:00000001:25.0:1773851865.564184:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851865.564185:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851865.564186:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=98 v=313 (313 212 1 1)
00000100:00001000:25.0:1773851865.564187:0:41182:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:25.0:1773851865.564188:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851865.564189:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000049078092 refcount 3 to 8370@kfi7
00000100:00000001:25.0:1773851865.564189:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336256 : -107152617215360 : ffff9e8b96506a80)
02000000:00000001:25.0:1773851865.564190:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851865.564190:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851865.564191:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851865.564192:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8307@kfi7
00000400:00000010:25.0:1773851865.564192:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000019f8c817.
00000100:00000200:25.0:1773851865.564193:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858059147478208, offset 0
00000400:00000200:25.0:1773851865.564195:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8307@kfi7
00000400:00000200:25.0:1773851865.564196:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.564196:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a87266f1 nid 8307@kfi7 refs 1
00000400:00000200:25.0:1773851865.564197:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a87266f1 nid 8307@kfi7 refs 2
00000400:00000200:25.0:1773851865.564198:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a87266f1 nid 8307@kfi7 refs 3
00000400:00000200:25.0:1773851865.564199:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8307@kfi7 local destination
00000400:00000200:25.0:1773851865.564201:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769147:8769147:1024:4294967295] 8307@kfi7 LPNI seq info [34722293:34722293:16:4294967295]
00000400:00000200:25.0:1773851865.564202:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a87266f1 nid 8307@kfi7 refs 2
00000400:00000200:25.0:1773851865.564203:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.564205:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8307@kfi7(8307@kfi7:8307@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851865.564207:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a87266f1 nid 8307@kfi7 refs 3
00000800:00000200:25.0:1773851865.564208:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851865.564209:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:25.0:1773851865.564211:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851865.564214:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x300000000000d8c Using peer 8307@kfi7(0x300000000000d8c)
00000800:00000200:25.0:1773851865.564217:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000009b172e83: Posted send of 516 bytes to peer 0x300000000000d8c: rc=0
00000800:00000200:25.0:1773851865.564218:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x300000000000d8c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851865.564220:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851865.564221:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000049078092 refcount 2 to 8370@kfi7
00010000:00000001:25.0:1773851865.564222:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851865.564222:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851865.564223:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851865.564224:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cb61583e x1858059147478208/t0(0) o38->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852065 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1002-0'
00000100:00100000:25.0:1773851865.564227:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb61583e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:8f68da36-21fb-4bf8-b064-ed0ff3e25ba4+21:40629:x1858059147478208:12345-8370@kfi7:38:login-tuolumne1002-0 Request processed in 155us (199us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851865.564229:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8370@kfi7, seq: 2025091
00000100:00000040:25.0:1773851865.564230:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000076ee99f4 : new rpc_count 3
00000100:00000001:25.0:1773851865.564230:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851865.564231:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851865.564232:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:25.0:1773851865.564233:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005179b485.
00000020:00000010:25.0:1773851865.564234:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000019f92fd.
00000020:00000040:25.0:1773851865.564235:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 20
00000100:00000001:25.0:1773851865.564235:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851865.564236:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x300000000000d8c TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851865.564239:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851865.564240:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8307@kfi7: PUT: OK
00000400:00000200:26.0:1773851865.564242:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000019f8c817
00000400:00000010:26.0:1773851865.564243:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000019f8c817.
00000100:00000001:26.0:1773851865.564244:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851865.564245:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851865.564246:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a87266f1 nid 8307@kfi7 refs 2
00000800:00000200:26.0:1773851865.564249:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 8307@kfi7(00000000c8793df1):0x0 lsk 3469 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x300000000000d8c Transaction freed
00000800:00000200:26.0:1773851865.564534:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851865.564535:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851865.564536:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851865.564538:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851865.564539:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:26.0:1773851865.564540:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8370@kfi7 : PUT - for me
00000400:00000200:26.0:1773851865.564541:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:26.0:1773851865.564542:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000caae4472 nid 8370@kfi7 refs 1
00000400:00000200:26.0:1773851865.564543:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:26.0:1773851865.564543:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000caae4472 nid 8370@kfi7 refs 2
00000400:00000200:26.0:1773851865.564544:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000caae4472 nid 8370@kfi7 refs 3
00000400:00000200:26.0:1773851865.564545:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:26.0:1773851865.564546:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8370@kfi7 of length 2528 into portal 12 MB=0x699e51b74c700
00000400:00000200:26.0:1773851865.564547:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8370@kfi7 of length 2528/2528 into md 0x16159c9699 [64] + 2760
00000800:00000200:26.0:1773851865.564549:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851865.564550:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851865.564551:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8370@kfi7: PUT: OK
00000100:00000001:26.0:1773851865.564552:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851865.564552:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851865.564553:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031afaa57.
00000100:00000040:26.0:1773851865.564554:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000031afaa57 x1858059147462400 msgsize 2528
00000100:00100000:26.0:1773851865.564555:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-8370@kfi7 (source: 12345-8370@kfi7)
00000100:00000001:26.0:1773851865.564556:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851865.564557:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000caae4472 nid 8370@kfi7 refs 2
00000800:00000200:26.0:1773851865.564558:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 8370@kfi7(00000000c4ba311a):0x0 lsk 1233 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851865.564559:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851865.564560:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851865.564561:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851865.564562:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851865.564563:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851865.564564:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059147462400
00000020:00000001:25.0:1773851865.564565:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851865.564565:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91888
00000020:00000001:25.0:1773851865.564566:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851865.564568:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076ee99f4 refcount=21
00000020:00000001:25.0:1773851865.564569:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000020:00000001:25.0:1773851865.564571:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000100:00000001:25.0:1773851865.564572:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851865.564572:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:10.0:1773851865.564572:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000020:00000010:25.0:1773851865.564573:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c5bae70a.
00000800:00000200:10.0:1773851865.564573:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851865.564573:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851865.564574:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851865.564574:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:25.0:1773851865.564575:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851865.564576:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f757c630.
00000800:00000200:10.0:1773851865.564576:0:2464469:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8306@kfi7(0000000016a98fe1):0xc57 version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851865.564576:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851865.564577:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851865.564578:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:10.0:1773851865.564578:0:2464469:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x300000000000c57 Using peer 8306@kfi7(0x300000000000c57)
00000004:00000001:25.0:1773851865.564579:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000400:00000200:10.0:1773851865.564579:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000800:00000200:9.0:1773851865.564580:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:10.0:1773851865.564581:0:2464469:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000333a7eb2: Posted send of 38 bytes to peer 0x300000000000c57: rc=0
00000004:00100000:25.0:1773851865.564582:0:41182:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 000000004be2e124 cookie 0x3dc33c5908fc1dfc  req@0000000031afaa57 x1858059147462400/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:63/0 lens 2528/0 e 0 to 0 dl 1773852178 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne1002-1427325'
00000800:00000200:10.0:1773851865.564583:0:2464469:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x300000000000c57 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851865.564583:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.564585:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8306@kfi7 : PUT - for me
00010000:00000001:25.0:1773851865.564587:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:9.0:1773851865.564587:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00010000:00000001:25.0:1773851865.564588:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:25.0:1773851865.564588:0:41182:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851865.564588:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e09805 nid 8306@kfi7 refs 1
00000100:00000001:25.0:1773851865.564589:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851865.564590:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8306@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.564591:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e09805 nid 8306@kfi7 refs 2
00000100:00080000:25.1:1773851865.564592:0:41182:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000031afaa57 x1858059147462400/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:63/0 lens 2528/0 e 0 to 0 dl 1773852178 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne1002-1427325'
00000400:00000200:9.0:1773851865.564592:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000055e09805 nid 8306@kfi7 refs 3
00000800:00000200:10.0:1773851865.564593:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x300000000000c57 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851865.564594:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000800:00000200:10.0:1773851865.564595:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x300000000000c57 Transaction freed
00000400:00000200:9.0:1773851865.564595:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8370@kfi7 of length 2528 into portal 12 MB=0x699e51b748d40
00000100:00080000:25.1:1773851865.564597:0:41182:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000778639ec x1858059147462400/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:522/0 lens 2528/5304 e 9 to 0 dl 1773851882 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne1002-1427325'
00000400:00000200:9.0:1773851865.564597:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8370@kfi7 of length 2528/2528 into md 0x78146ce49 [64] + 134192
00000800:00000200:9.0:1773851865.564601:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851865.564603:0:41182:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:25.0:1773851865.564604:0:41182:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:9.0:1773851865.564604:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:25.0:1773851865.564605:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851865.564606:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851865.564606:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8306@kfi7: PUT: OK
00000020:00000010:25.0:1773851865.564607:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000100:00000001:9.0:1773851865.564607:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000020:00000010:25.0:1773851865.564608:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f757c630.
00000100:00000200:9.0:1773851865.564608:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000020:00000010:25.0:1773851865.564609:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c5bae70a.
00000100:00000010:9.0:1773851865.564609:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce10147e.
00000020:00000040:25.0:1773851865.564610:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 20
00000100:00000040:9.0:1773851865.564610:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ce10147e x1858059147447616 msgsize 2528
00000100:00000001:25.0:1773851865.564611:0:41182:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:9.0:1773851865.564614:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8370@kfi7 (source: 12345-8306@kfi7)
00000100:00000001:9.0:1773851865.564615:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851865.564617:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851865.564617:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:9.0:1773851865.564617:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000055e09805 nid 8306@kfi7 refs 2
00000100:00000001:11.0:1773851865.564618:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851865.564619:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851865.564619:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851865.564619:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 8306@kfi7(0000000016a98fe1):0x0 lsk 3160 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00100000:11.0:1773851865.564620:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059147447616
00000020:00000001:11.0:1773851865.564621:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851865.564621:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91888
00000020:00000001:11.0:1773851865.564622:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851865.564624:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076ee99f4 refcount=21
00000020:00000001:11.0:1773851865.564625:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000020:00000001:11.0:1773851865.564626:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000100:00000001:11.0:1773851865.564627:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851865.564627:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851865.564629:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fbc9e461.
00000020:00000010:11.0:1773851865.564630:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851865.564631:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000076194eba.
00000100:00000001:11.0:1773851865.564632:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851865.564632:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:11.0:1773851865.564633:0:60829:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:11.0:1773851865.564635:0:60829:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 0000000054d03e2c cookie 0x3dc33c5908fc1c12  req@00000000ce10147e x1858059147447616/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:505/0 lens 2528/0 e 0 to 0 dl 1773852620 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne1002-62339'
00010000:00000001:11.0:1773851865.564638:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:11.0:1773851865.564639:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:11.0:1773851865.564639:0:60829:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851865.564640:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:11.1:1773851865.564642:0:60829:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000ce10147e x1858059147447616/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:505/0 lens 2528/0 e 0 to 0 dl 1773852620 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne1002-62339'
00000100:00080000:11.1:1773851865.564645:0:60829:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000042962b08 x1858059147447616/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:61/0 lens 2528/5304 e 0 to 0 dl 1773852176 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne1002-62339'
00000100:00000001:11.0:1773851865.564648:0:60829:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:11.0:1773851865.564649:0:60829:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:11.0:1773851865.564650:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851865.564650:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851865.564651:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851865.564651:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000076194eba.
00000020:00000010:11.0:1773851865.564652:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fbc9e461.
00000020:00000040:11.0:1773851865.564653:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 20
00000100:00000001:11.0:1773851865.564654:0:60829:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851865.575435:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851865.575436:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851865.575437:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 8307@kfi7(0000000029566f82):0x0 lsk 1232 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851865.575440:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 8307@kfi7(0000000029566f82):0x0 lsk 1232 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851865.575442:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.575443:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8307@kfi7 : PUT - for me
00000400:00000200:25.0:1773851865.575445:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.575446:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a87266f1 nid 8307@kfi7 refs 1
00000400:00000200:25.0:1773851865.575446:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8307@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.575447:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a87266f1 nid 8307@kfi7 refs 2
00000400:00000200:25.0:1773851865.575448:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a87266f1 nid 8307@kfi7 refs 3
00000400:00000200:25.0:1773851865.575449:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8370@kfi7 to cpt 6
00000400:00000200:25.0:1773851865.575450:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8370@kfi7 of length 2528 into portal 12 MB=0x699e51b6d7100
00000400:00000200:25.0:1773851865.575452:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8370@kfi7 of length 2528/2528 into md 0x16159c9699 [64] + 5288
00000800:00000200:25.0:1773851865.575455:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 8307@kfi7(0000000029566f82):0x0 lsk 1232 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851865.575457:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851865.575458:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8307@kfi7: PUT: OK
00000100:00000001:25.0:1773851865.575459:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851865.575460:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851865.575461:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000df01f5d6.
00000100:00000040:25.0:1773851865.575462:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000df01f5d6 x1858059146981632 msgsize 2528
00000100:00100000:25.0:1773851865.575464:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8370@kfi7 (source: 12345-8307@kfi7)
00000100:00000001:25.0:1773851865.575465:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851865.575466:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a87266f1 nid 8307@kfi7 refs 2
00000800:00000200:25.0:1773851865.575468:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 8307@kfi7(0000000029566f82):0x0 lsk 1232 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851865.575471:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851865.575472:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851865.575472:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851865.575473:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851865.575474:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851865.575475:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059146981632
00000020:00000001:25.0:1773851865.575476:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851865.575476:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91888
00000020:00000001:25.0:1773851865.575477:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851865.575477:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076ee99f4 refcount=21
00000020:00000001:25.0:1773851865.575478:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000020:00000001:25.0:1773851865.575479:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241975808 : -107152467575808 : ffff9e8b9f3bbc00)
00000100:00000001:25.0:1773851865.575480:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851865.575481:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851865.575481:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c5bae70a.
00000020:00000010:25.0:1773851865.575483:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851865.575483:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f757c630.
00000100:00000001:25.0:1773851865.575484:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851865.575485:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:25.0:1773851865.575485:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:25.0:1773851865.575487:0:41182:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 0000000029d2e3ff cookie 0x3dc33c5908fc19a3  req@00000000df01f5d6 x1858059146981632/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:505/0 lens 2528/0 e 0 to 0 dl 1773852620 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne1002-28413'
00010000:00000001:25.0:1773851865.575491:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:25.0:1773851865.575491:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:25.0:1773851865.575492:0:41182:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851865.575492:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:25.1:1773851865.575494:0:41182:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000df01f5d6 x1858059146981632/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:505/0 lens 2528/0 e 0 to 0 dl 1773852620 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne1002-28413'
00000100:00080000:25.1:1773851865.575497:0:41182:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000934941ab x1858059146981632/t0(0) o101->8f68da36-21fb-4bf8-b064-ed0ff3e25ba4@8370@kfi7:598/0 lens 2528/5304 e 0 to 0 dl 1773851799 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne1002-28413'
00000100:00000001:25.0:1773851865.575500:0:41182:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:25.0:1773851865.575501:0:41182:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:25.0:1773851865.575502:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851865.575503:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851865.575503:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851865.575504:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f757c630.
00000020:00000010:25.0:1773851865.575505:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c5bae70a.
00000020:00000040:25.0:1773851865.575506:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000076ee99f4 : new refcount 20
00000100:00000001:25.0:1773851865.575507:0:41182:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851865.585345:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851865.585346:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851865.585348:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851865.585350:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851865.585351:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15120@kfi7 to cpt 0
00000400:00000200:3.0:1773851865.585352:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15120@kfi7 : PUT - for me
00000400:00000200:3.0:1773851865.585353:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15120@kfi7 to cpt 0
00000400:00000200:3.0:1773851865.585354:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf759a03 nid 15120@kfi7 refs 1
00000400:00000200:3.0:1773851865.585355:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15120@kfi7 to cpt 0
00000400:00000200:3.0:1773851865.585356:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf759a03 nid 15120@kfi7 refs 2
00000400:00000200:3.0:1773851865.585357:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cf759a03 nid 15120@kfi7 refs 3
00000400:00000200:3.0:1773851865.585357:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15313@kfi7 to cpt 6
00000400:00000200:3.0:1773851865.585358:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15313@kfi7 of length 224 into portal 12 MB=0x699e0af55b7c0
00000400:00000200:3.0:1773851865.585360:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15313@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 26040
00000800:00000200:3.0:1773851865.585362:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851865.585363:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851865.585364:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15120@kfi7: PUT: OK
00000100:00000001:3.0:1773851865.585365:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851865.585366:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851865.585367:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf103f47.
00000100:00000040:3.0:1773851865.585367:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000cf103f47 x1858040153618368 msgsize 224
00000100:00100000:3.0:1773851865.585369:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-15313@kfi7 (source: 12345-15120@kfi7)
00000100:00000001:3.0:1773851865.585370:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851865.585371:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf759a03 nid 15120@kfi7 refs 2
00000100:00000001:0.0:1773851865.585372:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851865.585372:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851865.585373:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851865.585373:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851865.585374:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851865.585374:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851865.585375:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040153618368
00000020:00000001:0.0:1773851865.585376:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851865.585376:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ea8
00000020:00000001:0.0:1773851865.585378:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851865.585379:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000992cf867 refcount=167
00000020:00000001:0.0:1773851865.585380:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629004288 : -107123080547328 : ffff9e9276d63400)
00000020:00000001:0.0:1773851865.585381:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629004288 : -107123080547328 : ffff9e9276d63400)
00000100:00000001:0.0:1773851865.585382:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.585383:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851865.585384:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851865.585386:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.585386:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851865.585387:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851865.585388:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851865.585389:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.585390:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851865.585390:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851865.585391:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.585392:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.585393:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851865.585394:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851865.585395:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851865.585395:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15313@kfi7, seq: 1997547
00000100:00000001:1.0:1773851865.585396:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851865.585396:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.585396:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000992cf867 : new rpc_count 1
00000100:00000001:0.0:1773851865.585397:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288711680 : -106964420839936 : ffff9eb767b13600)
00000100:00000001:1.0:1773851865.585398:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.585398:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cf103f47 x1858040153618368/t0(0) o400->3c1dcbfd-c698-44c4-b316-ced7b860f7c8@15313@kfi7:505/0 lens 224/0 e 0 to 0 dl 1773852620 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1441-0'
00000100:00000001:0.0:1773851865.585401:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.585402:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851865.585403:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf103f47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3c1dcbfd-c698-44c4-b316-ced7b860f7c8+167:39692:x1858040153618368:12345-15313@kfi7:400:default-tuolumne1441-0
00000100:00000200:0.0:1773851865.585404:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040153618368
00000020:00000001:0.0:1773851865.585405:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851865.585406:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851865.585406:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.585407:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851865.585408:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851865.585409:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851865.585410:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040153618368, found 0 last_xid 1858040153196863
00000020:00000001:0.0:1773851865.585411:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851865.585412:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851865.585412:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851865.585413:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.585414:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851865.585414:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851865.585415:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851865.585416:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d0934e84.
02000000:00000001:0.0:1773851865.585416:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.585417:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.585418:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851865.585419:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063403, transno 0, xid 1858040153618368
00010000:00000001:0.0:1773851865.585420:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851865.585421:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cf103f47 x1858040153618368/t0(0) o400->3c1dcbfd-c698-44c4-b316-ced7b860f7c8@15313@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1441-0'
00010000:00000001:0.0:1773851865.585424:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851865.585424:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851865.585425:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=98 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851865.585427:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851865.585427:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000dcdcf4 refcount 3 to 15313@kfi7
00000100:00000001:0.0:1773851865.585428:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420992 : -107156724130624 : ffff9e8aa185dcc0)
02000000:00000001:0.0:1773851865.585429:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851865.585430:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.585431:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851865.585432:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15120@kfi7
00000400:00000010:0.0:1773851865.585433:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ccec3e81.
00000100:00000200:0.0:1773851865.585434:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040153618368, offset 224
00000400:00000200:0.0:1773851865.585436:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15120@kfi7
00000400:00000200:0.0:1773851865.585437:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15120@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.585438:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf759a03 nid 15120@kfi7 refs 1
00000400:00000200:0.0:1773851865.585439:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cf759a03 nid 15120@kfi7 refs 2
00000400:00000200:0.0:1773851865.585441:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cf759a03 nid 15120@kfi7 refs 3
00000400:00000200:0.0:1773851865.585443:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15120@kfi7 local destination
00000400:00000200:0.0:1773851865.585445:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769148:8769148:1024:4294967295] 15120@kfi7 LPNI seq info [130705:130705:16:4294967295]
00000400:00000200:0.0:1773851865.585446:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cf759a03 nid 15120@kfi7 refs 2
00000400:00000200:0.0:1773851865.585447:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15120@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.585450:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15120@kfi7(15120@kfi7:15120@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851865.585451:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cf759a03 nid 15120@kfi7 refs 3
00000800:00000200:0.0:1773851865.585453:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851865.585454:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851865.585456:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851865.585459:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x115e Using peer 15120@kfi7(0x115e)
00000800:00000200:0.0:1773851865.585463:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x115e: rc=0
00000800:00000200:0.0:1773851865.585465:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x115e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851865.585467:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.585468:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000dcdcf4 refcount 2 to 15313@kfi7
00010000:00000001:0.0:1773851865.585469:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851865.585470:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.585471:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851865.585471:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cf103f47 x1858040153618368/t0(0) o400->3c1dcbfd-c698-44c4-b316-ced7b860f7c8@15313@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1441-0'
00000100:00100000:0.0:1773851865.585477:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf103f47 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3c1dcbfd-c698-44c4-b316-ced7b860f7c8+167:39692:x1858040153618368:12345-15313@kfi7:400:default-tuolumne1441-0 Request processed in 74us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851865.585480:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15313@kfi7, seq: 1997547
00000100:00000040:0.0:1773851865.585480:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000992cf867 : new rpc_count 0
00000100:00000001:0.0:1773851865.585481:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851865.585482:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851865.585483:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.585484:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851865.585486:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851865.585486:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000992cf867 : new refcount 166
00000100:00000001:0.0:1773851865.585487:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851865.585494:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x115e TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851865.585497:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.585499:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15120@kfi7: PUT: OK
00000400:00000200:1.0:1773851865.585501:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ccec3e81
00000400:00000010:1.0:1773851865.585502:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ccec3e81.
00000100:00000001:1.0:1773851865.585503:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851865.585503:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851865.585505:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf759a03 nid 15120@kfi7 refs 2
00000800:00000200:1.0:1773851865.585508:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15120@kfi7(0000000004c8084c):0x0 lsk 4447 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x115e Transaction freed
00000800:00000200:9.0:1773851865.630596:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851865.630597:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851865.630598:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851865.630601:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851865.630604:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.630606:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.46@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851865.630607:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.630607:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851865.630609:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.46@o2ib60 to cpt 7
00000400:00000200:9.0:1773851865.630612:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b9762f5 nid 192.168.128.46@o2ib60 refs 2
00000400:00000200:9.0:1773851865.630613:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000b9762f5 nid 192.168.128.46@o2ib60 refs 3
00000400:00000200:9.0:1773851865.630614:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.46@o2ib60 to cpt 7
00000400:00000200:9.0:1773851865.630616:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.46@o2ib60 of length 224 into portal 12 MB=0x69b173bd5b800
00000400:00000200:9.0:1773851865.630618:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.46@o2ib60 of length 224/224 into md 0x77fe139dd [64] + 173736
00000800:00000200:9.0:1773851865.630620:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851865.630622:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851865.630623:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851865.630624:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851865.630625:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851865.630626:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000003e3966f.
00000100:00000040:9.0:1773851865.630627:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000003e3966f x1859373950679040 msgsize 224
00000100:00100000:9.0:1773851865.630629:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.46@o2ib60 (source: 12345-192.168.128.46@o2ib60)
00000100:00000001:9.0:1773851865.630631:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851865.630633:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851865.630634:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851865.630635:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851865.630637:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851865.630638:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851865.630638:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851865.630639:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851865.630640:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373950679040
00000020:00000001:31.0:1773851865.630641:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851865.630642:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793afc81ed
00000020:00000001:31.0:1773851865.630643:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851865.630646:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001d844709 refcount=6
00000020:00000001:31.0:1773851865.630647:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928630205440 : -107145079346176 : ffff9e8d579b2c00)
00000020:00000001:31.0:1773851865.630648:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928630205440 : -107145079346176 : ffff9e8d579b2c00)
00000100:00000001:31.0:1773851865.630649:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.630650:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851865.630651:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b4f0eb.
00000020:00000010:31.0:1773851865.630652:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851865.630653:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851865.630654:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851865.630655:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851865.630656:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.630657:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851865.630658:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851865.630658:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.630659:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.630661:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851865.630662:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851865.630663:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.46@o2ib60, seq: 2055512
00000100:00000040:31.0:1773851865.630664:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001d844709 : new rpc_count 2
00000100:00000001:28.0:1773851865.630664:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851865.630665:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637056510592128 : -107017198959488 : ffff9eab1ddf0480)
00000100:00000001:28.0:1773851865.630665:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851865.630666:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.630667:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000003e3966f x1859373950679040/t0(0) o400->157b7e3f-cd1b-4152-bf1e-3e658092ab9b@192.168.128.46@o2ib60:653/0 lens 224/0 e 0 to 0 dl 1773852013 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix46-0'
00000100:00000001:28.0:1773851865.630667:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.630670:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.630671:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851865.630672:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003e3966f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:157b7e3f-cd1b-4152-bf1e-3e658092ab9b+6:39707:x1859373950679040:12345-192.168.128.46@o2ib60:400:default-matrix46-0
00000100:00000200:31.0:1773851865.630676:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373950679040
00000020:00000001:31.0:1773851865.630676:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851865.630677:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851865.630678:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.630679:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851865.630680:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851865.630681:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851865.630681:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373950679040, found 0 last_xid 1859373949508479
00000020:00000001:31.0:1773851865.630682:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851865.630683:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851865.630684:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851865.630684:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.630685:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851865.630685:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851865.630686:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851865.630687:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005a34f240.
02000000:00000001:31.0:1773851865.630687:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.630688:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.630689:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851865.630689:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183116509601, transno 0, xid 1859373950679040
00010000:00000001:31.0:1773851865.630690:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851865.630691:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000003e3966f x1859373950679040/t0(0) o400->157b7e3f-cd1b-4152-bf1e-3e658092ab9b@192.168.128.46@o2ib60:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix46-0'
00010000:00000001:31.0:1773851865.630694:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851865.630695:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851865.630695:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=98 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851865.630696:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851865.630698:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bb44df6a refcount 3 to 192.168.128.46@o2ib60
00000100:00000001:31.0:1773851865.630698:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805504 : -107130477746112 : ffff9e90bdede840)
02000000:00000001:31.0:1773851865.630699:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851865.630700:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.630701:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851865.630702:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.46@o2ib60
00000400:00000010:31.0:1773851865.630703:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb75a26a.
00000100:00000200:31.0:1773851865.630704:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373950679040, offset 224
00000400:00000200:31.0:1773851865.630706:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.46@o2ib60
00000400:00000200:31.0:1773851865.630707:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.46@o2ib60 to cpt 7
00000400:00000200:31.0:1773851865.630709:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b9762f5 nid 192.168.128.46@o2ib60 refs 2
00000400:00000200:31.0:1773851865.630711:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000b9762f5 nid 192.168.128.46@o2ib60 refs 3
00000400:00000200:31.0:1773851865.630712:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000b9762f5 nid 192.168.128.46@o2ib60 refs 4
00000400:00000200:31.0:1773851865.630713:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.46@o2ib60 routed destination
00000400:00000200:31.0:1773851865.630715:0:42267:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:31.0:1773851865.630716:0:42267:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:31.0:1773851865.630717:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.46@o2ib60: rtr pref emtpy: 1
00000400:00000200:31.0:1773851865.630718:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:31.0:1773851865.630719:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.46@o2ib60: rtr pref emtpy: 1
00000400:00000200:31.0:1773851865.630720:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:31.0:1773851865.630721:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769149:8769149:1024:4294967295] 17@kfi7 LPNI seq info [1250891889:1250891889:16:4294967295]
00000400:00000200:31.0:1773851865.630723:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:31.0:1773851865.630724:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:31.0:1773851865.630732:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.46@o2ib60(192.168.128.46@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851865.630733:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000b9762f5 nid 192.168.128.46@o2ib60 refs 3
00000800:00000200:31.0:1773851865.630735:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851865.630736:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851865.630739:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851865.630741:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:31.0:1773851865.630744:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:31.0:1773851865.630746:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851865.630748:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.630749:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bb44df6a refcount 2 to 192.168.128.46@o2ib60
00010000:00000001:31.0:1773851865.630750:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851865.630751:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.630751:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851865.630752:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000003e3966f x1859373950679040/t0(0) o400->157b7e3f-cd1b-4152-bf1e-3e658092ab9b@192.168.128.46@o2ib60:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix46-0'
00000100:00100000:31.0:1773851865.630756:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003e3966f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:157b7e3f-cd1b-4152-bf1e-3e658092ab9b+6:39707:x1859373950679040:12345-192.168.128.46@o2ib60:400:default-matrix46-0 Request processed in 84us (128us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851865.630758:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.46@o2ib60, seq: 2055512
00000100:00000040:31.0:1773851865.630759:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001d844709 : new rpc_count 1
00000100:00000001:31.0:1773851865.630760:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851865.630761:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851865.630761:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000800:00000200:29.0:1773851865.630761:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851865.630762:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000400:00000200:29.0:1773851865.630762:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851865.630763:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b4f0eb.
00000400:00000200:29.0:1773851865.630763:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000040:31.0:1773851865.630764:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000001d844709 : new refcount 5
00000400:00000200:29.0:1773851865.630764:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb75a26a
00000100:00000001:31.0:1773851865.630765:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851865.630765:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb75a26a.
00000100:00000001:29.0:1773851865.630765:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851865.630766:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851865.630767:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:29.0:1773851865.630768:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Transaction freed
00000800:00000200:1.0:1773851865.686890:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851865.686891:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851865.686892:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851865.686894:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851865.686897:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23728@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.686898:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23728@kfi7 : PUT - for me
00000400:00000200:1.0:1773851865.686899:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23728@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.686900:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052bc1948 nid 23728@kfi7 refs 1
00000400:00000200:1.0:1773851865.686901:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23728@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.686902:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052bc1948 nid 23728@kfi7 refs 2
00000400:00000200:1.0:1773851865.686903:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000052bc1948 nid 23728@kfi7 refs 3
00000400:00000200:1.0:1773851865.686904:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23728@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.686904:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23728@kfi7 of length 224 into portal 12 MB=0x699e750d29400
00000400:00000200:1.0:1773851865.686906:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23728@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 26264
00000800:00000200:1.0:1773851865.686907:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851865.686909:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.686910:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23728@kfi7: PUT: OK
00000100:00000001:1.0:1773851865.686911:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851865.686911:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851865.686913:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ffac48cf.
00000100:00000040:1.0:1773851865.686914:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000ffac48cf x1858068632736768 msgsize 224
00000100:00100000:1.0:1773851865.686915:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-23728@kfi7 (source: 12345-23728@kfi7)
00000100:00000001:1.0:1773851865.686916:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851865.686917:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000052bc1948 nid 23728@kfi7 refs 2
00000100:00000001:0.0:1773851865.686917:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851865.686918:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851865.686918:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851865.686918:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851865.686919:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851865.686919:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851865.686920:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858068632736768
00000020:00000001:0.0:1773851865.686921:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851865.686921:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92076
00000020:00000001:0.0:1773851865.686922:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851865.686924:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005ea23d2d refcount=6
00000020:00000001:0.0:1773851865.686924:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629493760 : -107123080057856 : ffff9e9276ddac00)
00000020:00000001:0.0:1773851865.686925:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629493760 : -107123080057856 : ffff9e9276ddac00)
00000100:00000001:0.0:1773851865.686926:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.686927:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851865.686928:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851865.686929:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.686929:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851865.686930:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851865.686930:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851865.686931:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.686932:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851865.686932:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851865.686933:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.686934:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851865.686935:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851865.686935:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851865.686935:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851865.686935:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851865.686936:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23728@kfi7, seq: 1997548
00000100:00000001:1.0:1773851865.686937:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.686937:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005ea23d2d : new rpc_count 1
00000100:00000001:1.0:1773851865.686938:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.686938:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599707648 : -107004109843968 : ffff9eae2a0b1200)
00000100:00000040:0.0:1773851865.686939:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ffac48cf x1858068632736768/t0(0) o400->dc0b2e99-ba6a-41d9-953c-a97b61f16f10@23728@kfi7:505/0 lens 224/0 e 0 to 0 dl 1773852620 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1966-0'
00000100:00000001:0.0:1773851865.686942:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.686942:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851865.686943:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffac48cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:dc0b2e99-ba6a-41d9-953c-a97b61f16f10+6:39678:x1858068632736768:12345-23728@kfi7:400:default-tuolumne1966-0
00000100:00000200:0.0:1773851865.686944:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858068632736768
00000020:00000001:0.0:1773851865.686945:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851865.686946:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851865.686946:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.686947:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851865.686947:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851865.686948:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851865.686949:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858068632736768, found 0 last_xid 1858068632736767
00000020:00000001:0.0:1773851865.686950:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851865.686951:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851865.686951:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851865.686952:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.686952:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851865.686953:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851865.686954:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851865.686954:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008767160d.
02000000:00000001:0.0:1773851865.686955:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.686956:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.686956:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851865.686957:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824052, transno 0, xid 1858068632736768
00010000:00000001:0.0:1773851865.686958:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851865.686959:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ffac48cf x1858068632736768/t0(0) o400->dc0b2e99-ba6a-41d9-953c-a97b61f16f10@23728@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1966-0'
00010000:00000001:0.0:1773851865.686961:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851865.686961:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851865.686962:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=98 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851865.686963:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851865.686964:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fdce8ff2 refcount 3 to 23728@kfi7
00000100:00000001:0.0:1773851865.686965:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572224 : -107154178979392 : ffff9e8b3939c9c0)
02000000:00000001:0.0:1773851865.686966:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851865.686967:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.686967:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851865.686968:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23728@kfi7
00000400:00000010:0.0:1773851865.686969:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c05e23f.
00000100:00000200:0.0:1773851865.686969:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858068632736768, offset 224
00000400:00000200:0.0:1773851865.686971:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23728@kfi7
00000400:00000200:0.0:1773851865.686972:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23728@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.686972:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052bc1948 nid 23728@kfi7 refs 1
00000400:00000200:0.0:1773851865.686973:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000052bc1948 nid 23728@kfi7 refs 2
00000400:00000200:0.0:1773851865.686974:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000052bc1948 nid 23728@kfi7 refs 3
00000400:00000200:0.0:1773851865.686976:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23728@kfi7 local destination
00000400:00000200:0.0:1773851865.686977:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769150:8769150:1024:4294967295] 23728@kfi7 LPNI seq info [11702227:11702227:16:4294967295]
00000400:00000200:0.0:1773851865.686978:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000052bc1948 nid 23728@kfi7 refs 2
00000400:00000200:0.0:1773851865.686979:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23728@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.686981:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23728@kfi7(23728@kfi7:23728@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851865.686982:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000052bc1948 nid 23728@kfi7 refs 3
00000800:00000200:0.0:1773851865.686983:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851865.686984:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851865.686986:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851865.686988:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9d6 Using peer 23728@kfi7(0x9d6)
00000800:00000200:0.0:1773851865.686991:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x9d6: rc=0
00000800:00000200:0.0:1773851865.686992:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851865.686994:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.686995:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fdce8ff2 refcount 2 to 23728@kfi7
00010000:00000001:0.0:1773851865.686995:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851865.686996:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.686997:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851865.686997:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ffac48cf x1858068632736768/t0(0) o400->dc0b2e99-ba6a-41d9-953c-a97b61f16f10@23728@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1966-0'
00000100:00100000:0.0:1773851865.687002:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffac48cf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:dc0b2e99-ba6a-41d9-953c-a97b61f16f10+6:39678:x1858068632736768:12345-23728@kfi7:400:default-tuolumne1966-0 Request processed in 59us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851865.687004:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23728@kfi7, seq: 1997548
00000100:00000040:0.0:1773851865.687005:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005ea23d2d : new rpc_count 0
00000100:00000001:0.0:1773851865.687006:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851865.687007:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851865.687007:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.687008:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851865.687009:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851865.687009:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005ea23d2d : new refcount 5
00000100:00000001:0.0:1773851865.687010:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851865.687015:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9d6 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851865.687016:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.687017:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23728@kfi7: PUT: OK
00000400:00000200:1.0:1773851865.687019:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c05e23f
00000400:00000010:1.0:1773851865.687019:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c05e23f.
00000100:00000001:1.0:1773851865.687020:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851865.687020:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851865.687021:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000052bc1948 nid 23728@kfi7 refs 2
00000800:00000200:1.0:1773851865.687022:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 23728@kfi7(00000000f8429b07):0x0 lsk 2519 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9d6 Transaction freed
00000800:00000200:6.0:1773851865.700756:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851865.700757:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851865.700759:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851865.700761:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851865.700763:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20304@kfi7 to cpt 1
00000400:00000200:6.0:1773851865.700764:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20304@kfi7 : PUT - for me
00000400:00000200:6.0:1773851865.700765:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20304@kfi7 to cpt 1
00000400:00000200:6.0:1773851865.700766:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080f23154 nid 20304@kfi7 refs 1
00000400:00000200:6.0:1773851865.700767:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20304@kfi7 to cpt 1
00000400:00000200:6.0:1773851865.700767:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080f23154 nid 20304@kfi7 refs 2
00000400:00000200:6.0:1773851865.700768:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000080f23154 nid 20304@kfi7 refs 3
00000400:00000200:6.0:1773851865.700769:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20304@kfi7 to cpt 1
00000400:00000200:6.0:1773851865.700770:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20304@kfi7 of length 224 into portal 12 MB=0x69b465cde5700
00000400:00000200:6.0:1773851865.700772:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20304@kfi7 of length 224/224 into md 0x793926dc5 [64] + 133432
00000800:00000200:6.0:1773851865.700773:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851865.700775:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851865.700777:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20304@kfi7: PUT: OK
00000100:00000001:6.0:1773851865.700778:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851865.700778:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851865.700779:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000039f98caa.
00000100:00000040:6.0:1773851865.700780:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000039f98caa x1859576368355072 msgsize 224
00000100:00100000:6.0:1773851865.700782:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-20304@kfi7 (source: 12345-20304@kfi7)
00000100:00000001:6.0:1773851865.700783:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851865.700784:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000080f23154 nid 20304@kfi7 refs 2
00000800:00000200:6.0:1773851865.700785:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851865.700787:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851865.700788:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851865.700789:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851865.700790:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851865.700792:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851865.700794:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576368355072
00000020:00000001:5.0:1773851865.700795:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851865.700796:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc41956bf
00000020:00000001:5.0:1773851865.700797:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851865.700802:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000335902e6 refcount=5
00000020:00000001:5.0:1773851865.700803:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136786661376 : -106936922890240 : ffff9ebdceb2a000)
00000020:00000001:5.0:1773851865.700805:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136786661376 : -106936922890240 : ffff9ebdceb2a000)
00000100:00000001:5.0:1773851865.700807:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851865.700808:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851865.700809:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9b9985c.
00000020:00000010:5.0:1773851865.700811:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851865.700812:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000023452dac.
00000100:00000001:5.0:1773851865.700814:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851865.700815:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851865.700816:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851865.700818:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851865.700819:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851865.700819:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851865.700821:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.700823:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851865.700823:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851865.700824:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851865.700824:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851865.700825:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20304@kfi7, seq: 2001909
00000100:00000040:7.0:1773851865.700826:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000335902e6 : new rpc_count 1
00000100:00000001:5.0:1773851865.700826:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.700827:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139802784896 : -106933906766720 : ffff9ebe82790480)
00000100:00000040:7.0:1773851865.700828:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000039f98caa x1859576368355072/t0(0) o400->2c5edae1-c8de-404a-a583-6894b48e3c9f@20304@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1762-0'
00000100:00000001:5.0:1773851865.700829:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.700831:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851865.700832:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851865.700833:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039f98caa pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:2c5edae1-c8de-404a-a583-6894b48e3c9f+5:39686:x1859576368355072:12345-20304@kfi7:400:default-tuolumne1762-0
00000100:00000200:7.0:1773851865.700834:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576368355072
00000020:00000001:7.0:1773851865.700836:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851865.700836:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851865.700837:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.700838:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851865.700839:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851865.700839:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851865.700840:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576368355072, found 0 last_xid 1859576368355071
00000020:00000001:7.0:1773851865.700841:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851865.700842:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851865.700842:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851865.700843:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.700843:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851865.700844:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851865.700844:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851865.700845:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008f72fd39.
02000000:00000001:7.0:1773851865.700846:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.700846:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.700847:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851865.700848:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181510830248, transno 0, xid 1859576368355072
00010000:00000001:7.0:1773851865.700849:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851865.700850:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000039f98caa x1859576368355072/t0(0) o400->2c5edae1-c8de-404a-a583-6894b48e3c9f@20304@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1762-0'
00010000:00000001:7.0:1773851865.700852:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851865.700853:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851865.700853:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=97 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851865.700855:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851865.700855:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005f87cfac refcount 3 to 20304@kfi7
00000100:00000001:7.0:1773851865.700856:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701248 : -107156155850368 : ffff9e8ac3652180)
02000000:00000001:7.0:1773851865.700857:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851865.700857:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.700858:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851865.700859:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20304@kfi7
00000400:00000010:7.0:1773851865.700860:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000100:00000200:7.0:1773851865.700861:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576368355072, offset 224
00000400:00000200:7.0:1773851865.700862:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20304@kfi7
00000400:00000200:7.0:1773851865.700863:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20304@kfi7 to cpt 1
00000400:00000200:7.0:1773851865.700864:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080f23154 nid 20304@kfi7 refs 1
00000400:00000200:7.0:1773851865.700866:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000080f23154 nid 20304@kfi7 refs 2
00000400:00000200:7.0:1773851865.700867:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000080f23154 nid 20304@kfi7 refs 3
00000400:00000200:7.0:1773851865.700868:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20304@kfi7 local destination
00000400:00000200:7.0:1773851865.700869:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769151:8769151:1024:4294967295] 20304@kfi7 LPNI seq info [6668950:6668950:16:4294967295]
00000400:00000200:7.0:1773851865.700871:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000080f23154 nid 20304@kfi7 refs 2
00000400:00000200:7.0:1773851865.700872:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20304@kfi7 to cpt 1
00000400:00000200:7.0:1773851865.700874:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20304@kfi7(20304@kfi7:20304@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851865.700875:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000080f23154 nid 20304@kfi7 refs 3
00000800:00000200:7.0:1773851865.700876:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851865.700878:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851865.700880:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851865.700882:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4af Using peer 20304@kfi7(0x4af)
00000800:00000200:7.0:1773851865.700885:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x4af: rc=0
00000800:00000200:7.0:1773851865.700886:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4af TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851865.700889:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851865.700889:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005f87cfac refcount 2 to 20304@kfi7
00010000:00000001:7.0:1773851865.700890:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851865.700891:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.700891:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851865.700892:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000039f98caa x1859576368355072/t0(0) o400->2c5edae1-c8de-404a-a583-6894b48e3c9f@20304@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1762-0'
00000100:00100000:7.0:1773851865.700895:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039f98caa pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:2c5edae1-c8de-404a-a583-6894b48e3c9f+5:39686:x1859576368355072:12345-20304@kfi7:400:default-tuolumne1762-0 Request processed in 63us (114us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851865.700898:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20304@kfi7, seq: 2001909
00000100:00000040:7.0:1773851865.700899:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000335902e6 : new rpc_count 0
00000100:00000001:7.0:1773851865.700900:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851865.700901:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:6.0:1773851865.700901:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4af TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851865.700902:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:7.0:1773851865.700902:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000023452dac.
00000400:00000200:6.0:1773851865.700902:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851865.700903:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9b9985c.
00000400:00000200:6.0:1773851865.700903:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20304@kfi7: PUT: OK
00000020:00000040:7.0:1773851865.700904:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000335902e6 : new refcount 4
00000400:00000200:6.0:1773851865.700904:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000100:00000001:7.0:1773851865.700905:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851865.700905:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000100:00000001:6.0:1773851865.700905:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851865.700906:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851865.700907:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000080f23154 nid 20304@kfi7 refs 2
00000800:00000200:6.0:1773851865.700908:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20304@kfi7(0000000074576546):0x0 lsk 1200 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4af Transaction freed
00000800:00000200:29.0:1773851865.704739:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851865.704740:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851865.704742:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851865.704744:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851865.704746:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24547@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.704748:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24547@kfi7 : PUT - for me
00000400:00000200:29.0:1773851865.704749:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24547@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.704750:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000360a9c36 nid 24547@kfi7 refs 1
00000400:00000200:29.0:1773851865.704751:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24547@kfi7 to cpt 7
00000400:00000200:29.0:1773851865.704752:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000360a9c36 nid 24547@kfi7 refs 2
00000400:00000200:29.0:1773851865.704753:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000360a9c36 nid 24547@kfi7 refs 3
00000400:00000200:29.0:1773851865.704754:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24546@kfi7 to cpt 4
00000400:00000200:29.0:1773851865.704755:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24546@kfi7 of length 224 into portal 12 MB=0x69b4651a764c0
00000400:00000200:29.0:1773851865.704756:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24546@kfi7 of length 224/224 into md 0x77fe139dd [64] + 173960
00000800:00000200:29.0:1773851865.704758:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851865.704760:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851865.704762:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24547@kfi7: PUT: OK
00000100:00000001:29.0:1773851865.704763:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851865.704764:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851865.704765:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005a583396.
00000100:00000040:29.0:1773851865.704766:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000005a583396 x1859576180204736 msgsize 224
00000100:00100000:29.0:1773851865.704768:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-24546@kfi7 (source: 12345-24547@kfi7)
00000100:00000001:29.0:1773851865.704769:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851865.704770:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851865.704770:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000360a9c36 nid 24547@kfi7 refs 2
02000000:00000001:31.0:1773851865.704771:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851865.704771:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851865.704772:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851865.704772:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851865.704773:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851865.704774:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576180204736
00000020:00000001:31.0:1773851865.704775:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851865.704775:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc3bde878
00000020:00000001:31.0:1773851865.704776:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851865.704779:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000082f3bc4e refcount=27
00000020:00000001:31.0:1773851865.704779:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134918145024 : -106938791406592 : ffff9ebd5f535400)
00000020:00000001:31.0:1773851865.704780:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134918145024 : -106938791406592 : ffff9ebd5f535400)
00000100:00000001:31.0:1773851865.704782:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.704782:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851865.704783:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b4f0eb.
00000020:00000010:31.0:1773851865.704784:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851865.704785:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851865.704786:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851865.704787:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851865.704787:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.704788:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851865.704788:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851865.704789:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.704790:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851865.704791:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851865.704791:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851865.704791:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851865.704792:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24546@kfi7, seq: 2055513
00000100:00000001:28.0:1773851865.704792:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851865.704793:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000082f3bc4e : new rpc_count 3
00000100:00000001:28.0:1773851865.704793:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.704794:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343706496 : -106994365845120 : ffff9eb06ed4b180)
00000100:00000001:28.0:1773851865.704794:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.704795:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005a583396 x1859576180204736/t0(0) o400->74336d25-d7db-4c25-99aa-e7e34da89239@24546@kfi7:653/0 lens 224/0 e 0 to 0 dl 1773852013 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2011-0'
00000100:00000001:31.0:1773851865.704798:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851865.704798:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851865.704799:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a583396 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:74336d25-d7db-4c25-99aa-e7e34da89239+27:39673:x1859576180204736:12345-24546@kfi7:400:default-tuolumne2011-0
00000100:00000200:31.0:1773851865.704801:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576180204736
00000020:00000001:31.0:1773851865.704801:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851865.704802:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851865.704803:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.704803:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851865.704804:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851865.704805:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851865.704805:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576180204736, found 0 last_xid 1859576179641919
00000020:00000001:31.0:1773851865.704806:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851865.704807:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851865.704807:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851865.704808:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.704808:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851865.704809:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851865.704809:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851865.704811:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f6d7394b.
02000000:00000001:31.0:1773851865.704811:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.704812:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.704813:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851865.704813:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264505379, transno 0, xid 1859576180204736
00010000:00000001:31.0:1773851865.704814:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851865.704815:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005a583396 x1859576180204736/t0(0) o400->74336d25-d7db-4c25-99aa-e7e34da89239@24546@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2011-0'
00010000:00000001:31.0:1773851865.704817:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851865.704818:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851865.704819:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=98 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851865.704820:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851865.704820:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004a71f32a refcount 3 to 24546@kfi7
00000100:00000001:31.0:1773851865.704821:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993952 : -107142345557664 : ffff9e8dfa8d7960)
02000000:00000001:31.0:1773851865.704822:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851865.704823:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851865.704823:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851865.704824:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24547@kfi7
00000400:00000010:31.0:1773851865.704825:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000535cda91.
00000100:00000200:31.0:1773851865.704825:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576180204736, offset 224
00000400:00000200:31.0:1773851865.704827:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24547@kfi7
00000400:00000200:31.0:1773851865.704828:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24547@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.704828:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000360a9c36 nid 24547@kfi7 refs 1
00000400:00000200:31.0:1773851865.704830:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000360a9c36 nid 24547@kfi7 refs 2
00000400:00000200:31.0:1773851865.704831:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000360a9c36 nid 24547@kfi7 refs 3
00000400:00000200:31.0:1773851865.704832:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24547@kfi7 local destination
00000400:00000200:31.0:1773851865.704834:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769152:8769152:1024:4294967295] 24547@kfi7 LPNI seq info [15928704:15928704:16:4294967295]
00000400:00000200:31.0:1773851865.704835:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000360a9c36 nid 24547@kfi7 refs 2
00000400:00000200:31.0:1773851865.704836:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24547@kfi7 to cpt 7
00000400:00000200:31.0:1773851865.704838:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24547@kfi7(24547@kfi7:24547@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851865.704839:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000360a9c36 nid 24547@kfi7 refs 3
00000800:00000200:31.0:1773851865.704841:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851865.704842:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851865.704845:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851865.704847:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x834 Using peer 24547@kfi7(0x834)
00000800:00000200:31.0:1773851865.704850:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x834: rc=0
00000800:00000200:31.0:1773851865.704851:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x834 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851865.704853:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851865.704854:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004a71f32a refcount 2 to 24546@kfi7
00010000:00000001:31.0:1773851865.704855:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851865.704855:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851865.704856:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851865.704856:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005a583396 x1859576180204736/t0(0) o400->74336d25-d7db-4c25-99aa-e7e34da89239@24546@kfi7:653/0 lens 224/224 e 0 to 0 dl 1773852013 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2011-0'
00000100:00100000:31.0:1773851865.704859:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a583396 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:74336d25-d7db-4c25-99aa-e7e34da89239+27:39673:x1859576180204736:12345-24546@kfi7:400:default-tuolumne2011-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851865.704862:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24546@kfi7, seq: 2055513
00000100:00000040:31.0:1773851865.704863:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000082f3bc4e : new rpc_count 2
00000800:00000200:29.0:1773851865.704863:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x834 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851865.704864:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851865.704864:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851865.704865:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851865.704865:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851865.704866:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000020:00000010:31.0:1773851865.704866:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b4f0eb.
00000400:00000200:29.0:1773851865.704866:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24547@kfi7: PUT: OK
00000020:00000040:31.0:1773851865.704867:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000082f3bc4e : new refcount 26
00000400:00000200:29.0:1773851865.704867:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000535cda91
00000400:00000010:29.0:1773851865.704867:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000535cda91.
00000100:00000001:31.0:1773851865.704868:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851865.704868:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851865.704869:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851865.704869:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000360a9c36 nid 24547@kfi7 refs 2
00000800:00000200:29.0:1773851865.704871:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 24547@kfi7(000000000d286488):0x0 lsk 2101 rsk 13 tsk 0 trmk 0 tmk 0 trr 7 tta 0x834 Transaction freed
00000800:00000200:6.0:1773851865.715458:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851865.715458:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851865.715459:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851865.715459:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851865.715460:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851865.715460:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851865.715462:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851865.715463:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26163@kfi7(00000000e4d74437):0x1018 version: 2; local version 2; negotiated version: 2
00000400:00000200:6.0:1773851865.715464:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26163@kfi7 to cpt 1
00000800:00000200:5.0:1773851865.715465:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 Using peer 26163@kfi7(0x1018)
00000400:00000200:6.0:1773851865.715466:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26163@kfi7 : PUT - for me
00000400:00000200:6.0:1773851865.715467:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26163@kfi7 to cpt 1
00000400:00000200:6.0:1773851865.715468:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000085a8c846 nid 26163@kfi7 refs 1
00000400:00000200:6.0:1773851865.715469:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26163@kfi7 to cpt 1
00000400:00000200:6.0:1773851865.715469:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000085a8c846 nid 26163@kfi7 refs 2
00000400:00000200:6.0:1773851865.715470:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000085a8c846 nid 26163@kfi7 refs 3
00000400:00000200:5.0:1773851865.715471:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26163@kfi7 to cpt 1
00000400:00000200:6.0:1773851865.715472:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26162@kfi7 to cpt 6
00000400:00000200:6.0:1773851865.715473:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26162@kfi7 of length 224 into portal 12 MB=0x69b17abc0da00
00000800:00000200:5.0:1773851865.715473:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 38 bytes to peer 0x1018: rc=0
00000400:00000200:6.0:1773851865.715474:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26162@kfi7 of length 224/224 into md 0x793926dc5 [64] + 133656
00000800:00000200:5.0:1773851865.715474:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851865.715476:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851865.715477:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851865.715478:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26163@kfi7: PUT: OK
00000100:00000001:6.0:1773851865.715479:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851865.715480:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851865.715480:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000067340e10.
00000100:00000040:6.0:1773851865.715481:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000067340e10 x1859375828359680 msgsize 224
00000100:00100000:6.0:1773851865.715483:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-26162@kfi7 (source: 12345-26163@kfi7)
00000100:00000001:6.0:1773851865.715484:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851865.715484:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000085a8c846 nid 26163@kfi7 refs 2
00000100:00000001:7.0:1773851865.715485:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851865.715486:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851865.715486:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851865.715487:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851865.715487:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851865.715487:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 TN_EVENT_TX_OK event status 0
02000000:00000001:7.0:1773851865.715488:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851865.715489:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859375828359680
00000020:00000001:7.0:1773851865.715489:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:5.0:1773851865.715489:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2069@kfi7:1 <- 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 Transaction freed
00000020:00000040:7.0:1773851865.715490:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910c4
00000020:00000001:7.0:1773851865.715491:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851865.715495:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac2571ff refcount=6
00000020:00000001:7.0:1773851865.715496:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240338432 : -107152469213184 : ffff9e8b9f22c000)
00000020:00000001:7.0:1773851865.715496:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240338432 : -107152469213184 : ffff9e8b9f22c000)
00000100:00000001:7.0:1773851865.715497:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851865.715498:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851865.715500:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d2a17bef.
00000020:00000010:7.0:1773851865.715501:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851865.715502:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d926879.
00000100:00000001:7.0:1773851865.715503:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851865.715504:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851865.715504:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.715505:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851865.715506:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851865.715506:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.715507:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851865.715508:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851865.715509:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851865.715509:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851865.715509:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851865.715510:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26162@kfi7, seq: 2001910
00000100:00000040:7.0:1773851865.715511:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac2571ff : new rpc_count 1
00000100:00000001:5.0:1773851865.715511:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.715512:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139802804480 : -106933906747136 : ffff9ebe82795100)
00000100:00000001:5.0:1773851865.715512:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851865.715514:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000067340e10 x1859375828359680/t0(0) o400->520e04fc-b059-4d66-88d8-5cac9f649933@26162@kfi7:505/0 lens 224/0 e 0 to 0 dl 1773852620 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2121-0'
00000100:00000001:7.0:1773851865.715516:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851865.715516:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851865.715517:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067340e10 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:520e04fc-b059-4d66-88d8-5cac9f649933+6:39711:x1859375828359680:12345-26162@kfi7:400:default-tuolumne2121-0
00000100:00000200:7.0:1773851865.715518:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859375828359680
00000020:00000001:7.0:1773851865.715519:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851865.715520:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851865.715520:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.715521:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851865.715522:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851865.715522:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851865.715523:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859375828359680, found 0 last_xid 1859375828359679
00000020:00000001:7.0:1773851865.715524:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851865.715524:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851865.715525:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851865.715525:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.715526:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851865.715527:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851865.715527:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851865.715529:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005d7da334.
02000000:00000001:7.0:1773851865.715530:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.715530:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.715531:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851865.715532:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013982729, transno 0, xid 1859375828359680
00010000:00000001:7.0:1773851865.715532:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851865.715533:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000067340e10 x1859375828359680/t0(0) o400->520e04fc-b059-4d66-88d8-5cac9f649933@26162@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2121-0'
00010000:00000001:7.0:1773851865.715536:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851865.715536:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851865.715538:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=97 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851865.715539:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851865.715540:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ad138655 refcount 3 to 26162@kfi7
00000100:00000001:7.0:1773851865.715540:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923993436160 : -107149716115456 : ffff9e8c433bb000)
02000000:00000001:7.0:1773851865.715541:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851865.715542:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851865.715542:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851865.715543:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26163@kfi7
00000400:00000010:7.0:1773851865.715544:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df522108.
00000100:00000200:7.0:1773851865.715545:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859375828359680, offset 224
00000400:00000200:7.0:1773851865.715546:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26163@kfi7
00000400:00000200:7.0:1773851865.715547:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26163@kfi7 to cpt 1
00000400:00000200:7.0:1773851865.715548:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000085a8c846 nid 26163@kfi7 refs 1
00000400:00000200:7.0:1773851865.715549:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000085a8c846 nid 26163@kfi7 refs 2
00000400:00000200:7.0:1773851865.715550:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000085a8c846 nid 26163@kfi7 refs 3
00000400:00000200:7.0:1773851865.715551:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26163@kfi7 local destination
00000400:00000200:7.0:1773851865.715552:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769153:8769153:1024:4294967295] 26163@kfi7 LPNI seq info [12755722:12755722:16:4294967295]
00000400:00000200:7.0:1773851865.715553:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000085a8c846 nid 26163@kfi7 refs 2
00000400:00000200:7.0:1773851865.715554:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26163@kfi7 to cpt 1
00000400:00000200:7.0:1773851865.715556:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26163@kfi7(26163@kfi7:26163@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851865.715557:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000085a8c846 nid 26163@kfi7 refs 3
00000800:00000200:7.0:1773851865.715558:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851865.715559:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851865.715562:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851865.715564:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 Using peer 26163@kfi7(0x1018)
00000800:00000200:7.0:1773851865.715566:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x1018: rc=0
00000800:00000200:7.0:1773851865.715568:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851865.715572:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851865.715573:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ad138655 refcount 2 to 26162@kfi7
00010000:00000001:7.0:1773851865.715574:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851865.715574:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851865.715575:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851865.715575:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000067340e10 x1859375828359680/t0(0) o400->520e04fc-b059-4d66-88d8-5cac9f649933@26162@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2121-0'
00000100:00100000:7.0:1773851865.715579:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067340e10 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:520e04fc-b059-4d66-88d8-5cac9f649933+6:39711:x1859375828359680:12345-26162@kfi7:400:default-tuolumne2121-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851865.715579:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851865.715581:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851865.715582:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26162@kfi7, seq: 2001910
00000100:00000040:7.0:1773851865.715582:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac2571ff : new rpc_count 0
00000400:00000200:5.0:1773851865.715582:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26163@kfi7: PUT: OK
00000100:00000001:7.0:1773851865.715583:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851865.715583:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df522108
00000100:00000001:7.0:1773851865.715584:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851865.715584:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000010:5.0:1773851865.715584:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df522108.
00000020:00000010:7.0:1773851865.715585:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d926879.
00000100:00000001:5.0:1773851865.715585:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851865.715585:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851865.715586:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d2a17bef.
00000400:00000200:5.0:1773851865.715586:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000085a8c846 nid 26163@kfi7 refs 2
00000020:00000040:7.0:1773851865.715587:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000ac2571ff : new refcount 5
00000100:00000001:7.0:1773851865.715587:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851865.715587:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 26163@kfi7(00000000e4d74437):0x0 lsk 4121 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1018 Transaction freed
00000800:00000200:1.0:1773851865.722308:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851865.722310:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851865.722312:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851865.722315:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851865.722318:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12049@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.722320:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12049@kfi7 : PUT - for me
00000400:00000200:1.0:1773851865.722321:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12049@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.722322:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed2572a6 nid 12049@kfi7 refs 1
00000400:00000200:1.0:1773851865.722324:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12049@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.722325:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed2572a6 nid 12049@kfi7 refs 2
00000400:00000200:1.0:1773851865.722326:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed2572a6 nid 12049@kfi7 refs 3
00000400:00000200:1.0:1773851865.722328:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12241@kfi7 to cpt 3
00000400:00000200:1.0:1773851865.722329:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12241@kfi7 of length 224 into portal 12 MB=0x69b4b80095c00
00000400:00000200:1.0:1773851865.722331:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12241@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 26488
00000800:00000200:1.0:1773851865.722334:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851865.722336:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.722338:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12049@kfi7: PUT: OK
00000100:00000001:1.0:1773851865.722339:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851865.722340:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851865.722341:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a46216ab.
00000100:00000040:1.0:1773851865.722342:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a46216ab x1859598433213440 msgsize 224
00000100:00100000:1.0:1773851865.722344:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-12241@kfi7 (source: 12345-12049@kfi7)
00000100:00000001:1.0:1773851865.722347:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851865.722348:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed2572a6 nid 12049@kfi7 refs 2
00000100:00000001:0.0:1773851865.722349:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851865.722350:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851865.722350:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851865.722350:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851865.722351:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851865.722352:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851865.722353:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598433213440
00000020:00000001:0.0:1773851865.722354:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851865.722355:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7c642
00000020:00000001:0.0:1773851865.722356:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851865.722358:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000487a5d65 refcount=5
00000020:00000001:0.0:1773851865.722360:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148207227904 : -106925502323712 : ffff9ec0776aa400)
00000020:00000001:0.0:1773851865.722361:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148207227904 : -106925502323712 : ffff9ec0776aa400)
00000100:00000001:0.0:1773851865.722362:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.722363:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851865.722364:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851865.722366:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.722367:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851865.722368:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851865.722369:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851865.722370:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.722372:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851865.722372:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851865.722373:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.722375:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851865.722377:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851865.722377:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851865.722377:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851865.722378:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851865.722379:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12241@kfi7, seq: 1997549
00000100:00000001:1.0:1773851865.722380:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.722380:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000487a5d65 : new rpc_count 1
00000100:00000001:1.0:1773851865.722381:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.722381:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599714560 : -107004109837056 : ffff9eae2a0b2d00)
00000100:00000040:0.0:1773851865.722383:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a46216ab x1859598433213440/t0(0) o400->ea1233bf-5c5a-4a26-bfa3-2f194ad07680@12241@kfi7:505/0 lens 224/0 e 0 to 0 dl 1773852620 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1249-0'
00000100:00000001:0.0:1773851865.722388:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.722388:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851865.722390:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a46216ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ea1233bf-5c5a-4a26-bfa3-2f194ad07680+5:39555:x1859598433213440:12345-12241@kfi7:400:default-tuolumne1249-0
00000100:00000200:0.0:1773851865.722392:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598433213440
00000020:00000001:0.0:1773851865.722393:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851865.722394:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851865.722395:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.722396:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851865.722396:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851865.722398:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851865.722399:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598433213440, found 0 last_xid 1859598433213439
00000020:00000001:0.0:1773851865.722400:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851865.722401:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851865.722402:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851865.722402:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.722403:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851865.722404:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851865.722405:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851865.722407:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a09340af.
02000000:00000001:0.0:1773851865.722408:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.722409:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.722411:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851865.722412:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686745, transno 0, xid 1859598433213440
00010000:00000001:0.0:1773851865.722413:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851865.722414:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a46216ab x1859598433213440/t0(0) o400->ea1233bf-5c5a-4a26-bfa3-2f194ad07680@12241@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1249-0'
00010000:00000001:0.0:1773851865.722418:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851865.722419:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851865.722420:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=98 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851865.722421:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851865.722422:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b79d18ec refcount 3 to 12241@kfi7
00000100:00000001:0.0:1773851865.722424:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620640 : -107151221930976 : ffff9e8be97ac420)
02000000:00000001:0.0:1773851865.722425:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851865.722425:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.722426:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851865.722428:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12049@kfi7
00000400:00000010:0.0:1773851865.722429:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008edf1d49.
00000100:00000200:0.0:1773851865.722430:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598433213440, offset 224
00000400:00000200:0.0:1773851865.722432:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12049@kfi7
00000400:00000200:0.0:1773851865.722433:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12049@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.722435:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed2572a6 nid 12049@kfi7 refs 1
00000400:00000200:0.0:1773851865.722436:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed2572a6 nid 12049@kfi7 refs 2
00000400:00000200:0.0:1773851865.722438:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed2572a6 nid 12049@kfi7 refs 3
00000400:00000200:0.0:1773851865.722440:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12049@kfi7 local destination
00000400:00000200:0.0:1773851865.722442:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769154:8769154:1024:4294967295] 12049@kfi7 LPNI seq info [8199929:8199929:16:4294967295]
00000400:00000200:0.0:1773851865.722445:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed2572a6 nid 12049@kfi7 refs 2
00000400:00000200:0.0:1773851865.722446:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12049@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.722449:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12049@kfi7(12049@kfi7:12049@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851865.722451:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed2572a6 nid 12049@kfi7 refs 3
00000800:00000200:0.0:1773851865.722454:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851865.722455:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851865.722459:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851865.722463:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000026e Using peer 12049@kfi7(0x10000000000026e)
00000800:00000200:0.0:1773851865.722468:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x10000000000026e: rc=0
00000800:00000200:0.0:1773851865.722471:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000026e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851865.722474:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.722476:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b79d18ec refcount 2 to 12241@kfi7
00010000:00000001:0.0:1773851865.722477:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851865.722478:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.722481:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851865.722482:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a46216ab x1859598433213440/t0(0) o400->ea1233bf-5c5a-4a26-bfa3-2f194ad07680@12241@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1249-0'
00000100:00100000:0.0:1773851865.722487:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a46216ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ea1233bf-5c5a-4a26-bfa3-2f194ad07680+5:39555:x1859598433213440:12345-12241@kfi7:400:default-tuolumne1249-0 Request processed in 98us (144us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851865.722491:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12241@kfi7, seq: 1997549
00000100:00000040:0.0:1773851865.722492:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000487a5d65 : new rpc_count 0
00000100:00000001:0.0:1773851865.722493:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851865.722494:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851865.722495:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.722496:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851865.722497:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851865.722498:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000487a5d65 : new refcount 4
00000100:00000001:0.0:1773851865.722499:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851865.722507:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000026e TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851865.722510:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.722512:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12049@kfi7: PUT: OK
00000400:00000200:1.0:1773851865.722513:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008edf1d49
00000400:00000010:1.0:1773851865.722514:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008edf1d49.
00000100:00000001:1.0:1773851865.722515:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851865.722516:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851865.722517:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed2572a6 nid 12049@kfi7 refs 2
00000800:00000200:1.0:1773851865.722520:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 12049@kfi7(0000000031cabfae):0x0 lsk 623 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000026e Transaction freed
00000800:00000200:21.0:1773851865.745741:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851865.745742:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851865.745744:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851865.745746:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20897@kfi7(00000000170da7a0):0xd98 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851865.745747:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851865.745748:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851865.745748:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 Using peer 20897@kfi7(0x100000000000d98)
00000800:00000200:22.0:1773851865.745749:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851865.745750:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20897@kfi7 to cpt 5
00000800:00000200:22.0:1773851865.745751:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851865.745752:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0x100000000000d98: rc=0
00000400:00000200:22.0:1773851865.745753:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20897@kfi7 to cpt 5
00000800:00000200:21.0:1773851865.745753:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851865.745755:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20897@kfi7 : PUT - for me
00000400:00000200:22.0:1773851865.745756:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20897@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.745757:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 1
00000400:00000200:22.0:1773851865.745759:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20897@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.745759:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 2
00000400:00000200:22.0:1773851865.745760:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 3
00000400:00000200:22.0:1773851865.745761:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20833@kfi7 to cpt 2
00000400:00000200:22.0:1773851865.745762:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20833@kfi7 of length 224 into portal 12 MB=0x69b1706df0540
00000800:00000200:21.0:1773851865.745763:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851865.745764:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20833@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 35048
00000800:00000200:22.0:1773851865.745765:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851865.745765:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 Transaction freed
00000400:00000200:22.0:1773851865.745767:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851865.745769:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20897@kfi7: PUT: OK
00000100:00000001:22.0:1773851865.745770:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851865.745770:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851865.745771:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c13e453f.
00000100:00000040:22.0:1773851865.745772:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000c13e453f x1859373062096192 msgsize 224
00000100:00100000:22.0:1773851865.745773:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-20833@kfi7 (source: 12345-20897@kfi7)
00000100:00000001:22.0:1773851865.745775:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851865.745776:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 2
00000800:00000200:22.0:1773851865.745777:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851865.745780:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851865.745780:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851865.745781:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851865.745781:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851865.745782:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851865.745783:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373062096192
00000020:00000001:22.0:1773851865.745783:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851865.745784:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae1e30b
00000020:00000001:22.0:1773851865.745785:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851865.745789:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000063209415 refcount=5
00000020:00000001:22.0:1773851865.745789:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636955121736704 : -107118587814912 : ffff9e93829fdc00)
00000020:00000001:22.0:1773851865.745790:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636955121736704 : -107118587814912 : ffff9e93829fdc00)
00000100:00000001:22.0:1773851865.745791:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.745792:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851865.745793:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064c8bac5.
00000020:00000010:22.0:1773851865.745794:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.745795:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851865.745795:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851865.745796:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851865.745796:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.745797:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851865.745798:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851865.745798:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.745799:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.745800:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851865.745801:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851865.745801:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851865.745801:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851865.745802:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20833@kfi7, seq: 1997972
00000100:00000001:23.0:1773851865.745803:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.745803:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000063209415 : new rpc_count 1
00000100:00000001:22.0:1773851865.745803:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619626624 : -107003089924992 : ffff9eae66d5cc80)
00000100:00000001:23.0:1773851865.745804:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.745805:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c13e453f x1859373062096192/t0(0) o400->41bc7bfa-8a05-4296-8cf3-c8cc0cf731b9@20833@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1792-0'
00000100:00000001:22.0:1773851865.745808:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.745808:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851865.745809:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c13e453f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:41bc7bfa-8a05-4296-8cf3-c8cc0cf731b9+5:39845:x1859373062096192:12345-20833@kfi7:400:default-tuolumne1792-0
00000100:00000200:22.0:1773851865.745811:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373062096192
00000020:00000001:22.0:1773851865.745811:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851865.745812:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851865.745812:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.745813:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851865.745814:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851865.745814:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851865.745815:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373062096192, found 0 last_xid 1859373062096191
00000020:00000001:22.0:1773851865.745816:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851865.745817:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851865.745817:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851865.745818:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.745819:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851865.745819:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851865.745820:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851865.745820:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000094123a97.
02000000:00000001:22.0:1773851865.745821:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.745822:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.745822:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851865.745823:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182985822225, transno 0, xid 1859373062096192
00010000:00000001:22.0:1773851865.745824:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851865.745825:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c13e453f x1859373062096192/t0(0) o400->41bc7bfa-8a05-4296-8cf3-c8cc0cf731b9@20833@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1792-0'
00010000:00000001:22.0:1773851865.745827:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851865.745827:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851865.745828:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=98 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851865.745829:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851865.745830:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b562e50b refcount 3 to 20833@kfi7
00000100:00000001:22.0:1773851865.745830:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134848 : -107146658416768 : ffff9e8cf97c7780)
02000000:00000001:22.0:1773851865.745831:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851865.745832:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.745832:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851865.745833:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20897@kfi7
00000400:00000010:22.0:1773851865.745834:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000899ea1e5.
00000100:00000200:22.0:1773851865.745835:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373062096192, offset 224
00000400:00000200:22.0:1773851865.745836:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20897@kfi7
00000400:00000200:22.0:1773851865.745837:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20897@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.745837:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 1
00000400:00000200:22.0:1773851865.745838:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 2
00000400:00000200:22.0:1773851865.745839:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 3
00000400:00000200:22.0:1773851865.745841:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20897@kfi7 local destination
00000400:00000200:22.0:1773851865.745843:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769155:8769155:1024:4294967295] 20897@kfi7 LPNI seq info [162645:162645:16:4294967295]
00000400:00000200:22.0:1773851865.745844:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 2
00000400:00000200:22.0:1773851865.745845:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20897@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.745847:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20897@kfi7(20897@kfi7:20897@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851865.745848:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 3
00000800:00000200:22.0:1773851865.745849:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851865.745850:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851865.745852:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851865.745854:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 Using peer 20897@kfi7(0x100000000000d98)
00000800:00000200:22.0:1773851865.745857:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000068d775d8: Posted send of 324 bytes to peer 0x100000000000d98: rc=0
00000800:00000200:22.0:1773851865.745859:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851865.745861:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.745862:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b562e50b refcount 2 to 20833@kfi7
00010000:00000001:22.0:1773851865.745862:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851865.745863:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.745863:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851865.745864:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c13e453f x1859373062096192/t0(0) o400->41bc7bfa-8a05-4296-8cf3-c8cc0cf731b9@20833@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1792-0'
00000100:00100000:22.0:1773851865.745867:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c13e453f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:41bc7bfa-8a05-4296-8cf3-c8cc0cf731b9+5:39845:x1859373062096192:12345-20833@kfi7:400:default-tuolumne1792-0 Request processed in 58us (94us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851865.745868:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851865.745869:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20833@kfi7, seq: 1997972
00000100:00000040:22.0:1773851865.745870:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000063209415 : new rpc_count 0
00000400:00000200:21.0:1773851865.745870:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851865.745871:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851865.745871:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851865.745871:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851865.745871:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20897@kfi7: PUT: OK
00000400:00000200:21.0:1773851865.745872:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000899ea1e5
00000400:00000010:21.0:1773851865.745872:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000899ea1e5.
00000020:00000010:22.0:1773851865.745873:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851865.745873:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064c8bac5.
00000100:00000001:21.0:1773851865.745873:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851865.745873:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:22.0:1773851865.745874:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000063209415 : new refcount 4
00000400:00000200:21.0:1773851865.745874:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000085e0b6f3 nid 20897@kfi7 refs 2
00000100:00000001:22.0:1773851865.745875:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851865.745875:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 20897@kfi7(00000000170da7a0):0x0 lsk 3481 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d98 Transaction freed
00000800:00000200:2.0:1773851865.822471:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851865.822472:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851865.822474:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851865.822476:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851865.822478:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26210@kfi7 to cpt 0
00000400:00000200:2.0:1773851865.822479:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26210@kfi7 : PUT - for me
00000400:00000200:2.0:1773851865.822480:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26210@kfi7 to cpt 0
00000400:00000200:2.0:1773851865.822481:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000802fbefc nid 26210@kfi7 refs 1
00000400:00000200:2.0:1773851865.822482:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26210@kfi7 to cpt 0
00000400:00000200:2.0:1773851865.822483:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000802fbefc nid 26210@kfi7 refs 2
00000400:00000200:2.0:1773851865.822484:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000802fbefc nid 26210@kfi7 refs 3
00000400:00000200:2.0:1773851865.822484:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26210@kfi7 to cpt 0
00000400:00000200:2.0:1773851865.822485:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26210@kfi7 of length 224 into portal 12 MB=0x69b4b761f2d80
00000400:00000200:2.0:1773851865.822487:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26210@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 26712
00000800:00000200:2.0:1773851865.822489:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851865.822491:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851865.822491:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26210@kfi7: PUT: OK
00000100:00000001:2.0:1773851865.822492:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851865.822493:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851865.822494:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004f4555d9.
00000100:00000040:2.0:1773851865.822495:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000004f4555d9 x1859598266871168 msgsize 224
00000100:00100000:2.0:1773851865.822497:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-26210@kfi7 (source: 12345-26210@kfi7)
00000100:00000001:2.0:1773851865.822498:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851865.822499:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000802fbefc nid 26210@kfi7 refs 2
00000100:00000001:0.0:1773851865.822499:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851865.822500:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851865.822500:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:2.0:1773851865.822501:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851865.822501:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851865.822502:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851865.822502:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598266871168
00000020:00000001:0.0:1773851865.822503:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851865.822503:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e75d0d
00000020:00000001:0.0:1773851865.822504:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851865.822506:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e32e8cab refcount=23
00000020:00000001:0.0:1773851865.822507:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112827622400 : -106960881929216 : ffff9eb83aa0b400)
00000020:00000001:0.0:1773851865.822508:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637112827622400 : -106960881929216 : ffff9eb83aa0b400)
00000100:00000001:0.0:1773851865.822509:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.822509:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851865.822510:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851865.822511:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.822512:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851865.822513:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851865.822513:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851865.822514:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.822514:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851865.822515:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851865.822515:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.822516:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.822517:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851865.822518:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851865.822518:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851865.822518:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851865.822519:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26210@kfi7, seq: 1997550
00000100:00000001:1.0:1773851865.822520:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.822520:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e32e8cab : new rpc_count 1
00000100:00000001:0.0:1773851865.822520:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706777600 : -106953002774016 : ffff9eba10431200)
00000100:00000001:1.0:1773851865.822521:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.822522:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004f4555d9 x1859598266871168/t0(0) o400->c51edf73-0e96-4dd6-a341-0dcf83280983@26210@kfi7:505/0 lens 224/0 e 0 to 0 dl 1773852620 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2124-0'
00000100:00000001:0.0:1773851865.822524:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.822525:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851865.822526:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f4555d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c51edf73-0e96-4dd6-a341-0dcf83280983+23:39518:x1859598266871168:12345-26210@kfi7:400:default-tuolumne2124-0
00000100:00000200:0.0:1773851865.822528:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598266871168
00000020:00000001:0.0:1773851865.822528:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851865.822529:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851865.822529:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.822530:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851865.822530:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851865.822535:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851865.822535:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598266871168, found 0 last_xid 1859598266511103
00000020:00000001:0.0:1773851865.822536:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851865.822537:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851865.822537:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851865.822538:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.822538:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851865.822539:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851865.822539:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851865.822541:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000066afd13b.
02000000:00000001:0.0:1773851865.822542:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.822542:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.822543:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851865.822544:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260603379, transno 0, xid 1859598266871168
00010000:00000001:0.0:1773851865.822544:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851865.822545:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004f4555d9 x1859598266871168/t0(0) o400->c51edf73-0e96-4dd6-a341-0dcf83280983@26210@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2124-0'
00010000:00000001:0.0:1773851865.822548:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851865.822548:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851865.822549:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=98 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851865.822550:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851865.822551:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d5622aa7 refcount 3 to 26210@kfi7
00000100:00000001:0.0:1773851865.822552:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451424 : -107149715100192 : ffff9e8c434b2de0)
02000000:00000001:0.0:1773851865.822552:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851865.822553:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.822554:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851865.822555:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26210@kfi7
00000400:00000010:0.0:1773851865.822555:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071d311d2.
00000100:00000200:0.0:1773851865.822556:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598266871168, offset 224
00000400:00000200:0.0:1773851865.822557:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26210@kfi7
00000400:00000200:0.0:1773851865.822558:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26210@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.822559:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000802fbefc nid 26210@kfi7 refs 1
00000400:00000200:0.0:1773851865.822560:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000802fbefc nid 26210@kfi7 refs 2
00000400:00000200:0.0:1773851865.822561:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000802fbefc nid 26210@kfi7 refs 3
00000400:00000200:0.0:1773851865.822563:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26210@kfi7 local destination
00000400:00000200:0.0:1773851865.822564:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769156:8769156:1024:4294967295] 26210@kfi7 LPNI seq info [10298472:10298472:16:4294967295]
00000400:00000200:0.0:1773851865.822566:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000802fbefc nid 26210@kfi7 refs 2
00000400:00000200:0.0:1773851865.822566:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26210@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.822568:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26210@kfi7(26210@kfi7:26210@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851865.822570:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000802fbefc nid 26210@kfi7 refs 3
00000800:00000200:0.0:1773851865.822571:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851865.822572:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851865.822574:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851865.822576:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x922 Using peer 26210@kfi7(0x922)
00000800:00000200:0.0:1773851865.822579:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x922: rc=0
00000800:00000200:0.0:1773851865.822580:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x922 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851865.822582:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.822583:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d5622aa7 refcount 2 to 26210@kfi7
00010000:00000001:0.0:1773851865.822584:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851865.822584:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.822585:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851865.822586:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004f4555d9 x1859598266871168/t0(0) o400->c51edf73-0e96-4dd6-a341-0dcf83280983@26210@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2124-0'
00000100:00100000:0.0:1773851865.822590:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f4555d9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:c51edf73-0e96-4dd6-a341-0dcf83280983+23:39518:x1859598266871168:12345-26210@kfi7:400:default-tuolumne2124-0 Request processed in 65us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851865.822592:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26210@kfi7, seq: 1997550
00000100:00000040:0.0:1773851865.822593:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e32e8cab : new rpc_count 0
00000100:00000001:0.0:1773851865.822594:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851865.822594:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851865.822596:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.822596:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851865.822597:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851865.822598:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000e32e8cab : new refcount 22
00000100:00000001:0.0:1773851865.822599:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851865.822604:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x922 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851865.822605:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.822606:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26210@kfi7: PUT: OK
00000400:00000200:1.0:1773851865.822607:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071d311d2
00000400:00000010:1.0:1773851865.822608:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071d311d2.
00000100:00000001:1.0:1773851865.822609:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851865.822609:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851865.822610:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000802fbefc nid 26210@kfi7 refs 2
00000800:00000200:1.0:1773851865.822611:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26210@kfi7(00000000d571735b):0x0 lsk 2339 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x922 Transaction freed
00000800:00000200:5.0:1773851865.834827:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851865.834838:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851865.834840:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851865.834842:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851865.834844:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851865.834846:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:5.0:1773851865.834847:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851865.834848:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:5.0:1773851865.834849:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851865.834850:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851865.834851:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:5.0:1773851865.834852:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851865.834853:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed41f600
00000400:00000200:5.0:1773851865.834854:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x793844545 [256] + 6064
00000800:00000200:5.0:1773851865.834857:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851865.834859:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851865.834860:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000100:00000001:5.0:1773851865.834861:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851865.834861:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851865.834862:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f9505d3.
00000100:00000040:5.0:1773851865.834863:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000007f9505d3 x1858062667347456 msgsize 224
00000100:00100000:5.0:1773851865.834865:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2098@kfi7)
00000100:00000001:5.0:1773851865.834866:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851865.834867:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:6.0:1773851865.834868:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851865.834869:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851865.834869:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851865.834869:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851865.834870:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851865.834871:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851865.834872:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667347456
00000020:00000001:6.0:1773851865.834873:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851865.834873:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:6.0:1773851865.834874:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851865.834876:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:6.0:1773851865.834877:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:6.0:1773851865.834878:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:6.0:1773851865.834879:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851865.834880:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851865.834881:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851865.834882:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851865.834883:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f897dd3e.
00000100:00000040:6.0:1773851865.834885:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851865.834885:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851865.834886:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851865.834886:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851865.834888:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851865.834889:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851865.834891:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851865.834891:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851865.834892:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851865.834892:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851865.834893:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 18314078
00000100:00000001:6.0:1773851865.834894:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851865.834894:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:6.0:1773851865.834895:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851865.834898:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886783104 : -106955822768512 : ffff9eb9682d5e80)
00000100:00000040:5.0:1773851865.834899:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007f9505d3 x1858062667347456/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:5.0:1773851865.834903:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851865.834903:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851865.834904:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9505d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0005-mdtlov_UUID+5:52191:x1858062667347456:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:5.0:1773851865.834906:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667347456
00000020:00000001:5.0:1773851865.834907:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851865.834907:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851865.834908:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851865.834909:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851865.834910:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851865.834910:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851865.834911:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851865.834912:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851865.834912:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851865.834913:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851865.834914:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851865.834915:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851865.834916:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000b2e1fcea.
02000000:00000001:5.0:1773851865.834917:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851865.834918:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851865.834919:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851865.834920:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851865.834920:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851865.834921:0:1203214:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:5.0:1773851865.834923:0:1203214:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851865.834924:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851865.834925:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851865.834927:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851865.834928:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667347456
00010000:00000001:5.0:1773851865.834929:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851865.834930:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007f9505d3 x1858062667347456/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:592/0 lens 224/368 e 0 to 0 dl 1773851952 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:5.0:1773851865.834933:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851865.834934:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851865.834935:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=94 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851865.834936:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851865.834937:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:5.0:1773851865.834938:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:5.0:1773851865.834939:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851865.834940:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851865.834940:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851865.834941:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:5.0:1773851865.834942:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013dbcf4f.
00000100:00000200:5.0:1773851865.834943:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667347456, offset 224
00000400:00000200:5.0:1773851865.834944:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:5.0:1773851865.834946:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851865.834946:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:5.0:1773851865.834948:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851865.834949:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:5.0:1773851865.834950:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2098@kfi7 local destination
00000400:00000200:5.0:1773851865.834952:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769157:8769157:1024:4294967295] 2098@kfi7 LPNI seq info [20346202:20346202:16:4294967295]
00000400:00000200:5.0:1773851865.834954:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851865.834954:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851865.834957:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851865.834958:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:5.0:1773851865.834960:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851865.834962:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851865.834966:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851865.834970:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Using peer 2098@kfi7(0x2000000000004bc)
00000800:00000200:5.0:1773851865.834980:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 468 bytes to peer 0x2000000000004bc: rc=0
00000800:00000200:5.0:1773851865.834983:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851865.834987:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851865.834988:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:5.0:1773851865.834989:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851865.834990:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851865.834992:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851865.834993:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f9505d3 x1858062667347456/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:592/0 lens 224/368 e 0 to 0 dl 1773851952 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000800:00000200:6.0:1773851865.834995:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851865.834997:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851865.834998:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000400:00000200:6.0:1773851865.834999:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013dbcf4f
00000100:00100000:5.0:1773851865.834999:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9505d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0005-mdtlov_UUID+5:52191:x1858062667347456:12345-2098@kfi7:41:default-yuba6-0 Request processed in 95us (134us total) trans 0 rc 0/0
00000400:00000010:6.0:1773851865.835000:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013dbcf4f.
00000100:00000001:6.0:1773851865.835001:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851865.835001:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851865.835002:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:6.0:1773851865.835004:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Transaction freed
00000100:00100000:5.0:1773851865.835004:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 18314078
00000100:00000040:5.0:1773851865.835005:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:5.0:1773851865.835007:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851865.835008:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851865.835009:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:5.0:1773851865.835010:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f897dd3e.
00000020:00000010:5.0:1773851865.835012:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000020:00000040:5.0:1773851865.835014:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:5.0:1773851865.835015:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851865.905204:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851865.905205:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851865.905207:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851865.905211:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851865.905216:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851865.905219:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.43@o2ib60 : PUT - for me
00000400:00000200:10.0:1773851865.905221:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851865.905223:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:10.0:1773851865.905226:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.43@o2ib60 to cpt 4
00000400:00000200:10.0:1773851865.905228:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9583229 nid 192.168.128.43@o2ib60 refs 2
00000400:00000200:10.0:1773851865.905230:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a9583229 nid 192.168.128.43@o2ib60 refs 3
00000400:00000200:10.0:1773851865.905232:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.43@o2ib60 to cpt 4
00000400:00000200:10.0:1773851865.905234:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.43@o2ib60 of length 224 into portal 12 MB=0x69a5a92941340
00000400:00000200:10.0:1773851865.905238:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.43@o2ib60 of length 224/224 into md 0x6ab01b5d1 [64] + 7864
00000800:00000200:10.0:1773851865.905241:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851865.905244:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851865.905245:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:10.0:1773851865.905247:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851865.905248:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851865.905249:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000033dfd40a.
00000100:00000040:10.0:1773851865.905251:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000033dfd40a x1858563657175872 msgsize 224
00000100:00100000:10.0:1773851865.905254:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.43@o2ib60 (source: 12345-192.168.128.43@o2ib60)
00000100:00000001:10.0:1773851865.905256:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851865.905258:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:17.0:1773851865.905260:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851865.905260:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:17.0:1773851865.905261:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851865.905261:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851865.905261:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851865.905262:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851865.905263:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858563657175872
00000020:00000001:17.0:1773851865.905263:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851865.905264:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ecc
00000020:00000001:17.0:1773851865.905265:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851865.905269:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000084241ec9 refcount=6
00000020:00000001:17.0:1773851865.905270:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239653376 : -107152469898240 : ffff9e8b9f184c00)
00000020:00000001:17.0:1773851865.905271:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239653376 : -107152469898240 : ffff9e8b9f184c00)
00000100:00000001:17.0:1773851865.905272:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851865.905273:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851865.905274:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851865.905275:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851865.905276:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851865.905277:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851865.905278:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851865.905278:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851865.905279:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851865.905280:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851865.905281:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.905282:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851865.905283:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851865.905284:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851865.905285:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.43@o2ib60, seq: 2156312
00000100:00000040:17.0:1773851865.905286:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000084241ec9 : new rpc_count 1
00000100:00000001:17.0:1773851865.905286:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610184704 : -107030099366912 : ffff9ea81cf26c00)
00000100:00000040:17.0:1773851865.905288:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000033dfd40a x1858563657175872/t0(0) o400->8f6c20ae-b5aa-47aa-8b90-e625e735ced7@192.168.128.43@o2ib60:86/0 lens 224/0 e 0 to 0 dl 1773852201 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix43-0'
00000100:00000001:17.0:1773851865.905291:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851865.905291:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851865.905293:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033dfd40a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8f6c20ae-b5aa-47aa-8b90-e625e735ced7+6:39963:x1858563657175872:12345-192.168.128.43@o2ib60:400:default-matrix43-0
00000100:00000200:17.0:1773851865.905294:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858563657175872
00000020:00000001:17.0:1773851865.905295:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851865.905295:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851865.905296:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.905297:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851865.905297:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851865.905298:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851865.905299:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858563657175872, found 0 last_xid 1858563657175871
00000020:00000001:17.0:1773851865.905300:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851865.905301:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851865.905301:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851865.905301:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.905302:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851865.905303:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851865.905303:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851865.905304:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003784c1cc.
02000000:00000001:17.0:1773851865.905305:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.905306:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.905306:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851865.905307:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261110295, transno 0, xid 1858563657175872
00010000:00000001:17.0:1773851865.905308:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851865.905309:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000033dfd40a x1858563657175872/t0(0) o400->8f6c20ae-b5aa-47aa-8b90-e625e735ced7@192.168.128.43@o2ib60:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix43-0'
00010000:00000001:17.0:1773851865.905312:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851865.905312:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851865.905313:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=98 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851865.905314:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851865.905315:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000048e1b260 refcount 3 to 192.168.128.43@o2ib60
00000100:00000001:17.0:1773851865.905315:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924290914752 : -107149418636864 : ffff9e8c54f6d9c0)
02000000:00000001:17.0:1773851865.905316:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851865.905316:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851865.905317:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851865.905318:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.43@o2ib60
00000400:00000010:17.0:1773851865.905319:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c4dc638.
00000100:00000200:17.0:1773851865.905320:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858563657175872, offset 224
00000400:00000200:17.0:1773851865.905321:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.43@o2ib60
00000400:00000200:17.0:1773851865.905322:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.43@o2ib60 to cpt 4
00000400:00000200:17.0:1773851865.905324:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9583229 nid 192.168.128.43@o2ib60 refs 2
00000400:00000200:17.0:1773851865.905325:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a9583229 nid 192.168.128.43@o2ib60 refs 3
00000400:00000200:17.0:1773851865.905327:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a9583229 nid 192.168.128.43@o2ib60 refs 4
00000400:00000200:17.0:1773851865.905328:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.43@o2ib60 routed destination
00000400:00000200:17.0:1773851865.905329:0:60961:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:17.0:1773851865.905330:0:60961:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:17.0:1773851865.905331:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.43@o2ib60: rtr pref emtpy: 1
00000400:00000200:17.0:1773851865.905333:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:17.0:1773851865.905334:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.43@o2ib60: rtr pref emtpy: 1
00000400:00000200:17.0:1773851865.905335:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:17.0:1773851865.905336:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769158:8769158:1024:4294967295] 2094@kfi7 LPNI seq info [1258746988:1258746988:16:4294967295]
00000400:00000200:17.0:1773851865.905337:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851865.905339:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851865.905341:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.43@o2ib60(192.168.128.43@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851865.905343:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a9583229 nid 192.168.128.43@o2ib60 refs 3
00000800:00000200:17.0:1773851865.905344:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851865.905346:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851865.905348:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851865.905351:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:17.0:1773851865.905354:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:17.0:1773851865.905356:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851865.905357:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851865.905359:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000048e1b260 refcount 2 to 192.168.128.43@o2ib60
00010000:00000001:17.0:1773851865.905359:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851865.905360:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851865.905360:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851865.905362:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000033dfd40a x1858563657175872/t0(0) o400->8f6c20ae-b5aa-47aa-8b90-e625e735ced7@192.168.128.43@o2ib60:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix43-0'
00000100:00100000:17.0:1773851865.905365:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033dfd40a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8f6c20ae-b5aa-47aa-8b90-e625e735ced7+6:39963:x1858563657175872:12345-192.168.128.43@o2ib60:400:default-matrix43-0 Request processed in 73us (113us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851865.905368:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.43@o2ib60, seq: 2156312
00000100:00000040:17.0:1773851865.905369:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000084241ec9 : new rpc_count 0
00000100:00000001:17.0:1773851865.905370:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851865.905370:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851865.905371:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851865.905372:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000800:00000200:18.0:1773851865.905373:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851865.905373:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000020:00000040:17.0:1773851865.905373:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000084241ec9 : new refcount 5
00000100:00000001:17.0:1773851865.905374:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851865.905376:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851865.905378:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:18.0:1773851865.905380:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c4dc638
00000400:00000010:18.0:1773851865.905380:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c4dc638.
00000100:00000001:18.0:1773851865.905382:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851865.905382:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851865.905384:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:18.0:1773851865.905386:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000800:00000200:1.0:1773851865.909858:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851865.909860:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851865.909861:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851865.909863:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851865.909865:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17442@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.909866:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17442@kfi7 : PUT - for me
00000400:00000200:1.0:1773851865.909867:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17442@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.909868:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1b0d829 nid 17442@kfi7 refs 1
00000400:00000200:1.0:1773851865.909869:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17442@kfi7 to cpt 0
00000400:00000200:1.0:1773851865.909869:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1b0d829 nid 17442@kfi7 refs 2
00000400:00000200:1.0:1773851865.909870:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b1b0d829 nid 17442@kfi7 refs 3
00000400:00000200:1.0:1773851865.909871:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17634@kfi7 to cpt 2
00000400:00000200:1.0:1773851865.909872:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17634@kfi7 of length 224 into portal 12 MB=0x69b6214532a00
00000400:00000200:1.0:1773851865.909873:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17634@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 26936
00000800:00000200:1.0:1773851865.909875:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851865.909877:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.909877:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17442@kfi7: PUT: OK
00000100:00000001:1.0:1773851865.909879:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851865.909879:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851865.909880:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000d71be51.
00000100:00000040:1.0:1773851865.909881:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000000d71be51 x1859695410358784 msgsize 224
00000100:00100000:1.0:1773851865.909882:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-17634@kfi7 (source: 12345-17442@kfi7)
00000100:00000001:1.0:1773851865.909883:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851865.909884:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1b0d829 nid 17442@kfi7 refs 2
00000100:00000001:0.0:1773851865.909884:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851865.909885:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851865.909885:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851865.909885:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851865.909886:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851865.909886:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851865.909887:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859695410358784
00000020:00000001:0.0:1773851865.909888:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851865.909888:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f081566e45b7
00000020:00000001:0.0:1773851865.909889:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851865.909891:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008215f488 refcount=5
00000020:00000001:0.0:1773851865.909892:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637141185245184 : -106932524306432 : ffff9ebed4dfb000)
00000020:00000001:0.0:1773851865.909892:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637141185245184 : -106932524306432 : ffff9ebed4dfb000)
00000100:00000001:0.0:1773851865.909893:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.909894:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851865.909895:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851865.909896:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.909897:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851865.909897:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851865.909898:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851865.909898:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851865.909899:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851865.909900:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851865.909900:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.909901:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851865.909902:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851865.909902:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851865.909902:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851865.909903:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851865.909903:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17634@kfi7, seq: 1997551
00000100:00000001:1.0:1773851865.909904:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.909904:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008215f488 : new rpc_count 1
00000100:00000001:1.0:1773851865.909905:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.909905:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599713408 : -107004109838208 : ffff9eae2a0b2880)
00000100:00000040:0.0:1773851865.909906:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000d71be51 x1859695410358784/t0(0) o400->3c7b73b5-7028-4e66-9d36-82e74ada29fd@17634@kfi7:505/0 lens 224/0 e 0 to 0 dl 1773852620 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1579-0'
00000100:00000001:0.0:1773851865.909909:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851865.909909:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851865.909910:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d71be51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3c7b73b5-7028-4e66-9d36-82e74ada29fd+5:39618:x1859695410358784:12345-17634@kfi7:400:default-tuolumne1579-0
00000100:00000200:0.0:1773851865.909911:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859695410358784
00000020:00000001:0.0:1773851865.909912:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851865.909913:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851865.909913:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.909914:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851865.909914:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851865.909915:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851865.909916:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859695410358784, found 0 last_xid 1859695410358783
00000020:00000001:0.0:1773851865.909916:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851865.909917:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851865.909918:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851865.909918:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.909919:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851865.909919:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851865.909920:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851865.909921:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a384e64e.
02000000:00000001:0.0:1773851865.909922:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.909922:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.909923:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851865.909924:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105042002, transno 0, xid 1859695410358784
00010000:00000001:0.0:1773851865.909924:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851865.909925:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000d71be51 x1859695410358784/t0(0) o400->3c7b73b5-7028-4e66-9d36-82e74ada29fd@17634@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1579-0'
00010000:00000001:0.0:1773851865.909927:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851865.909928:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851865.909929:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=98 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851865.909930:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851865.909931:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008c19a86f refcount 3 to 17634@kfi7
00000100:00000001:0.0:1773851865.909932:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133792 : -107146658417824 : ffff9e8cf97c7360)
02000000:00000001:0.0:1773851865.909933:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851865.909934:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851865.909934:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851865.909935:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17442@kfi7
00000400:00000010:0.0:1773851865.909936:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073d1c143.
00000100:00000200:0.0:1773851865.909936:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859695410358784, offset 224
00000400:00000200:0.0:1773851865.909938:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17442@kfi7
00000400:00000200:0.0:1773851865.909938:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17442@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.909939:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1b0d829 nid 17442@kfi7 refs 1
00000400:00000200:0.0:1773851865.909940:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b1b0d829 nid 17442@kfi7 refs 2
00000400:00000200:0.0:1773851865.909941:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b1b0d829 nid 17442@kfi7 refs 3
00000400:00000200:0.0:1773851865.909943:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17442@kfi7 local destination
00000400:00000200:0.0:1773851865.909944:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769159:8769159:1024:4294967295] 17442@kfi7 LPNI seq info [11611951:11611951:16:4294967295]
00000400:00000200:0.0:1773851865.909945:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b1b0d829 nid 17442@kfi7 refs 2
00000400:00000200:0.0:1773851865.909946:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17442@kfi7 to cpt 0
00000400:00000200:0.0:1773851865.909948:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17442@kfi7(17442@kfi7:17442@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851865.909949:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b1b0d829 nid 17442@kfi7 refs 3
00000800:00000200:0.0:1773851865.909950:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851865.909951:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851865.909953:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851865.909955:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b60 Using peer 17442@kfi7(0x100000000000b60)
00000800:00000200:0.0:1773851865.909958:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x100000000000b60: rc=0
00000800:00000200:0.0:1773851865.909960:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b60 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851865.909962:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851865.909962:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008c19a86f refcount 2 to 17634@kfi7
00010000:00000001:0.0:1773851865.909963:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851865.909964:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851865.909965:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851865.909965:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000d71be51 x1859695410358784/t0(0) o400->3c7b73b5-7028-4e66-9d36-82e74ada29fd@17634@kfi7:505/0 lens 224/224 e 0 to 0 dl 1773852620 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1579-0'
00000100:00100000:0.0:1773851865.909970:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d71be51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3c7b73b5-7028-4e66-9d36-82e74ada29fd+5:39618:x1859695410358784:12345-17634@kfi7:400:default-tuolumne1579-0 Request processed in 60us (88us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851865.909972:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17634@kfi7, seq: 1997551
00000100:00000040:0.0:1773851865.909973:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008215f488 : new rpc_count 0
00000100:00000001:0.0:1773851865.909973:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851865.909974:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851865.909975:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851865.909975:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851865.909976:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851865.909977:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000008215f488 : new refcount 4
00000100:00000001:0.0:1773851865.909977:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851865.909982:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b60 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851865.909984:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851865.909985:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17442@kfi7: PUT: OK
00000400:00000200:1.0:1773851865.909986:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073d1c143
00000400:00000010:1.0:1773851865.909986:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073d1c143.
00000100:00000001:1.0:1773851865.909987:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851865.909987:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851865.909988:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1b0d829 nid 17442@kfi7 refs 2
00000800:00000200:1.0:1773851865.909990:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17442@kfi7(00000000df9ec00a):0x0 lsk 2913 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b60 Transaction freed
00000800:00000200:21.0:1773851865.913435:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851865.913435:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851865.913436:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851865.913438:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851865.913440:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19232@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.913442:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19232@kfi7 : PUT - for me
00000400:00000200:21.0:1773851865.913443:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19232@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.913444:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac43fe62 nid 19232@kfi7 refs 1
00000400:00000200:21.0:1773851865.913445:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19232@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.913446:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac43fe62 nid 19232@kfi7 refs 2
00000400:00000200:21.0:1773851865.913447:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ac43fe62 nid 19232@kfi7 refs 3
00000400:00000200:21.0:1773851865.913448:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19425@kfi7 to cpt 3
00000400:00000200:21.0:1773851865.913449:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19425@kfi7 of length 224 into portal 12 MB=0x69b4bb9ac4000
00000400:00000200:21.0:1773851865.913450:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19425@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 35272
00000800:00000200:21.0:1773851865.913452:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851865.913453:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851865.913455:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19232@kfi7: PUT: OK
00000100:00000001:21.0:1773851865.913456:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851865.913456:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851865.913457:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007fd64fb3.
00000100:00000040:21.0:1773851865.913458:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000007fd64fb3 x1859599400189952 msgsize 224
00000100:00100000:21.0:1773851865.913459:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-19425@kfi7 (source: 12345-19232@kfi7)
00000100:00000001:21.0:1773851865.913460:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851865.913461:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac43fe62 nid 19232@kfi7 refs 2
00000100:00000001:22.0:1773851865.913462:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851865.913462:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851865.913463:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851865.913463:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851865.913463:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851865.913464:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851865.913465:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599400189952
00000020:00000001:22.0:1773851865.913465:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851865.913466:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d824bb
00000020:00000001:22.0:1773851865.913466:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851865.913469:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000e917d70 refcount=5
00000020:00000001:22.0:1773851865.913469:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131280840704 : -106942428710912 : ffff9ebc86867800)
00000020:00000001:22.0:1773851865.913470:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131280840704 : -106942428710912 : ffff9ebc86867800)
00000100:00000001:22.0:1773851865.913471:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.913472:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851865.913472:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064c8bac5.
00000020:00000010:22.0:1773851865.913474:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.913474:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851865.913475:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851865.913476:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851865.913476:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.913477:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851865.913477:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851865.913478:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.913479:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851865.913480:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851865.913480:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851865.913480:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851865.913481:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851865.913481:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19425@kfi7, seq: 1997973
00000100:00000001:23.0:1773851865.913482:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.913482:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000e917d70 : new rpc_count 1
00000100:00000001:23.0:1773851865.913483:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.913483:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840025856 : -106961869525760 : ffff9eb7ffc32d00)
00000100:00000040:22.0:1773851865.913484:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007fd64fb3 x1859599400189952/t0(0) o400->230ceda3-1bc1-4bf8-838c-c846e51e6f71@19425@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1695-0'
00000100:00000001:22.0:1773851865.913488:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.913488:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851865.913489:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007fd64fb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:230ceda3-1bc1-4bf8-838c-c846e51e6f71+5:39564:x1859599400189952:12345-19425@kfi7:400:default-tuolumne1695-0
00000100:00000200:22.0:1773851865.913490:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599400189952
00000020:00000001:22.0:1773851865.913491:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851865.913491:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851865.913492:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.913493:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851865.913493:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851865.913494:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851865.913494:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599400189952, found 0 last_xid 1859599400189951
00000020:00000001:22.0:1773851865.913495:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851865.913496:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851865.913496:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851865.913497:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.913497:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851865.913498:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851865.913499:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851865.913499:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b004f3d5.
02000000:00000001:22.0:1773851865.913500:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.913501:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.913501:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851865.913502:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262829767, transno 0, xid 1859599400189952
00010000:00000001:22.0:1773851865.913503:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851865.913503:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007fd64fb3 x1859599400189952/t0(0) o400->230ceda3-1bc1-4bf8-838c-c846e51e6f71@19425@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1695-0'
00010000:00000001:22.0:1773851865.913505:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851865.913506:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851865.913507:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=98 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851865.913508:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851865.913509:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002ec2605b refcount 3 to 19425@kfi7
00000100:00000001:22.0:1773851865.913510:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487619584 : -107151221932032 : ffff9e8be97ac000)
02000000:00000001:22.0:1773851865.913511:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851865.913511:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.913512:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851865.913513:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19232@kfi7
00000400:00000010:22.0:1773851865.913513:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032962c0f.
00000100:00000200:22.0:1773851865.913514:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599400189952, offset 224
00000400:00000200:22.0:1773851865.913515:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19232@kfi7
00000400:00000200:22.0:1773851865.913516:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19232@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.913517:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac43fe62 nid 19232@kfi7 refs 1
00000400:00000200:22.0:1773851865.913518:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ac43fe62 nid 19232@kfi7 refs 2
00000400:00000200:22.0:1773851865.913519:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ac43fe62 nid 19232@kfi7 refs 3
00000400:00000200:22.0:1773851865.913520:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19232@kfi7 local destination
00000400:00000200:22.0:1773851865.913522:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769160:8769160:1024:4294967295] 19232@kfi7 LPNI seq info [19049734:19049734:16:4294967295]
00000400:00000200:22.0:1773851865.913523:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ac43fe62 nid 19232@kfi7 refs 2
00000400:00000200:22.0:1773851865.913524:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19232@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.913526:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19232@kfi7(19232@kfi7:19232@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851865.913527:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ac43fe62 nid 19232@kfi7 refs 3
00000800:00000200:22.0:1773851865.913528:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851865.913529:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851865.913531:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851865.913534:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b3b Using peer 19232@kfi7(0x100000000000b3b)
00000800:00000200:22.0:1773851865.913537:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000389ce1b3: Posted send of 324 bytes to peer 0x100000000000b3b: rc=0
00000800:00000200:22.0:1773851865.913538:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b3b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851865.913540:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.913541:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002ec2605b refcount 2 to 19425@kfi7
00010000:00000001:22.0:1773851865.913542:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851865.913543:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.913543:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851865.913544:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007fd64fb3 x1859599400189952/t0(0) o400->230ceda3-1bc1-4bf8-838c-c846e51e6f71@19425@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1695-0'
00000100:00100000:22.0:1773851865.913547:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007fd64fb3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:230ceda3-1bc1-4bf8-838c-c846e51e6f71+5:39564:x1859599400189952:12345-19425@kfi7:400:default-tuolumne1695-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851865.913549:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19425@kfi7, seq: 1997973
00000100:00000040:22.0:1773851865.913550:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000e917d70 : new rpc_count 0
00000100:00000001:22.0:1773851865.913550:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851865.913550:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b3b TN_EVENT_TX_OK event status 0
00000100:00000001:22.0:1773851865.913551:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851865.913551:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851865.913552:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.913552:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851865.913552:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19232@kfi7: PUT: OK
00000020:00000010:22.0:1773851865.913553:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064c8bac5.
00000400:00000200:21.0:1773851865.913553:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032962c0f
00000400:00000010:21.0:1773851865.913553:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032962c0f.
00000020:00000040:22.0:1773851865.913554:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000000e917d70 : new refcount 4
00000100:00000001:21.0:1773851865.913554:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851865.913554:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:22.0:1773851865.913555:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851865.913555:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac43fe62 nid 19232@kfi7 refs 2
00000800:00000200:21.0:1773851865.913557:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2054@kfi7:5 -> 19232@kfi7(000000002b4cf7e8):0x0 lsk 2876 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b3b Transaction freed
00000800:00000200:26.0:1773851865.922742:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851865.922743:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851865.922745:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851865.922747:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851865.922748:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15266@kfi7 to cpt 6
00000400:00000200:26.0:1773851865.922750:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15266@kfi7 : PUT - for me
00000400:00000200:26.0:1773851865.922750:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15266@kfi7 to cpt 6
00000400:00000200:26.0:1773851865.922751:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7a89abb nid 15266@kfi7 refs 1
00000400:00000200:26.0:1773851865.922752:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15266@kfi7 to cpt 6
00000400:00000200:26.0:1773851865.922753:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7a89abb nid 15266@kfi7 refs 2
00000400:00000200:26.0:1773851865.922753:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b7a89abb nid 15266@kfi7 refs 3
00000400:00000200:26.0:1773851865.922754:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15267@kfi7 to cpt 1
00000400:00000200:26.0:1773851865.922755:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15267@kfi7 of length 224 into portal 12 MB=0x699e13b72c900
00000400:00000200:26.0:1773851865.922756:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15267@kfi7 of length 224/224 into md 0x16159c9699 [64] + 7816
00000800:00000200:26.0:1773851865.922758:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851865.922760:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851865.922760:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15266@kfi7: PUT: OK
00000100:00000001:26.0:1773851865.922762:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851865.922762:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851865.922763:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1d60491.
00000100:00000040:26.0:1773851865.922764:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000e1d60491 x1858042504333568 msgsize 224
00000100:00100000:26.0:1773851865.922766:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-15267@kfi7 (source: 12345-15266@kfi7)
00000100:00000001:26.0:1773851865.922766:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851865.922767:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7a89abb nid 15266@kfi7 refs 2
00000800:00000200:26.0:1773851865.922769:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851865.922769:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851865.922771:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851865.922771:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851865.922772:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851865.922773:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851865.922774:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042504333568
00000020:00000001:25.0:1773851865.922775:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851865.922776:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e7e
00000020:00000001:25.0:1773851865.922777:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851865.922779:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ecb6793e refcount=8
00000020:00000001:25.0:1773851865.922781:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628782080 : -107123080769536 : ffff9e9276d2d000)
00000020:00000001:25.0:1773851865.922782:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628782080 : -107123080769536 : ffff9e9276d2d000)
00000100:00000001:25.0:1773851865.922783:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851865.922784:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851865.922785:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c5bae70a.
00000020:00000010:25.0:1773851865.922786:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851865.922788:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f757c630.
00000100:00000001:25.0:1773851865.922789:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851865.922790:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851865.922791:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851865.922792:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851865.922793:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851865.922794:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851865.922795:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851865.922797:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851865.922797:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851865.922797:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851865.922798:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851865.922798:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15267@kfi7, seq: 2025092
00000100:00000001:25.0:1773851865.922799:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851865.922799:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ecb6793e : new rpc_count 3
00000100:00000001:25.0:1773851865.922800:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851865.922800:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150697600 : -106980558854016 : ffff9eb3a5caa880)
00000100:00000040:24.0:1773851865.922801:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e1d60491 x1858042504333568/t0(0) o400->16e4bc99-7b07-4eae-afe1-78fffa476cef@15267@kfi7:82/0 lens 224/0 e 0 to 0 dl 1773852197 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1436-0'
00000100:00000001:24.0:1773851865.922803:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851865.922804:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851865.922804:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1d60491 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:16e4bc99-7b07-4eae-afe1-78fffa476cef+8:39646:x1858042504333568:12345-15267@kfi7:400:default-tuolumne1436-0
00000100:00000200:24.0:1773851865.922806:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042504333568
00000020:00000001:24.0:1773851865.922806:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851865.922807:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851865.922807:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851865.922809:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851865.922810:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851865.922810:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851865.922811:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042504333568, found 0 last_xid 1858042502561535
00000020:00000001:24.0:1773851865.922812:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851865.922812:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851865.922813:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851865.922813:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851865.922814:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851865.922814:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851865.922815:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851865.922816:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000019f92fd.
02000000:00000001:24.0:1773851865.922816:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851865.922817:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851865.922817:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851865.922818:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183258746405, transno 0, xid 1858042504333568
00010000:00000001:24.0:1773851865.922819:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851865.922820:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e1d60491 x1858042504333568/t0(0) o400->16e4bc99-7b07-4eae-afe1-78fffa476cef@15267@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1436-0'
00010000:00000001:24.0:1773851865.922822:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851865.922823:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851865.922823:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=98 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851865.922824:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851865.922825:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c442b1c9 refcount 3 to 15267@kfi7
00000100:00000001:24.0:1773851865.922826:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704704 : -107156155846912 : ffff9e8ac3652f00)
02000000:00000001:24.0:1773851865.922827:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851865.922827:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851865.922828:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851865.922828:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15266@kfi7
00000400:00000010:24.0:1773851865.922829:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3d31da8.
00000100:00000200:24.0:1773851865.922830:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042504333568, offset 224
00000400:00000200:24.0:1773851865.922831:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15266@kfi7
00000400:00000200:24.0:1773851865.922832:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15266@kfi7 to cpt 6
00000400:00000200:24.0:1773851865.922833:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7a89abb nid 15266@kfi7 refs 1
00000400:00000200:24.0:1773851865.922834:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b7a89abb nid 15266@kfi7 refs 2
00000400:00000200:24.0:1773851865.922835:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b7a89abb nid 15266@kfi7 refs 3
00000400:00000200:24.0:1773851865.922836:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15266@kfi7 local destination
00000400:00000200:24.0:1773851865.922838:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769161:8769161:1024:4294967295] 15266@kfi7 LPNI seq info [12435165:12435165:16:4294967295]
00000400:00000200:24.0:1773851865.922839:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b7a89abb nid 15266@kfi7 refs 2
00000400:00000200:24.0:1773851865.922840:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15266@kfi7 to cpt 6
00000400:00000200:24.0:1773851865.922842:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15266@kfi7(15266@kfi7:15266@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851865.922843:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b7a89abb nid 15266@kfi7 refs 3
00000800:00000200:24.0:1773851865.922844:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851865.922845:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851865.922847:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851865.922850:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000db6 Using peer 15266@kfi7(0x100000000000db6)
00000800:00000200:24.0:1773851865.922852:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x100000000000db6: rc=0
00000800:00000200:24.0:1773851865.922854:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000db6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851865.922856:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851865.922856:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c442b1c9 refcount 2 to 15267@kfi7
00010000:00000001:24.0:1773851865.922857:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851865.922858:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851865.922858:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851865.922859:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1d60491 x1858042504333568/t0(0) o400->16e4bc99-7b07-4eae-afe1-78fffa476cef@15267@kfi7:82/0 lens 224/224 e 0 to 0 dl 1773852197 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1436-0'
00000100:00100000:24.0:1773851865.922863:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1d60491 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:16e4bc99-7b07-4eae-afe1-78fffa476cef+8:39646:x1858042504333568:12345-15267@kfi7:400:default-tuolumne1436-0 Request processed in 59us (98us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851865.922865:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15267@kfi7, seq: 2025092
00000100:00000040:24.0:1773851865.922865:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ecb6793e : new rpc_count 2
00000100:00000001:24.0:1773851865.922867:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851865.922867:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851865.922868:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851865.922868:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f757c630.
00000020:00000010:24.0:1773851865.922869:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c5bae70a.
00000020:00000040:24.0:1773851865.922870:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ecb6793e : new refcount 7
00000100:00000001:24.0:1773851865.922871:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851865.922876:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000db6 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851865.922877:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851865.922878:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15266@kfi7: PUT: OK
00000400:00000200:26.0:1773851865.922879:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3d31da8
00000400:00000010:26.0:1773851865.922879:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3d31da8.
00000100:00000001:26.0:1773851865.922880:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851865.922880:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851865.922881:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7a89abb nid 15266@kfi7 refs 2
00000800:00000200:26.0:1773851865.922882:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 15266@kfi7(000000000f637a19):0x0 lsk 3511 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000db6 Transaction freed
00000004:00000001:11.0:1773851865.929732:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851865.929732:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851865.929733:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000158ac04d.
00000020:00000040:11.0:1773851865.929734:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851865.929735:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851865.929736:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851865.929737:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851865.929738:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d7506b21.
00000100:00000001:11.0:1773851865.929739:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851865.929740:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851865.929741:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851865.929742:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000158ac04d] to pc [ptlrpcd_02_02+2]  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851865.929746:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:11.0:1773851865.929748:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000005226698b.
00000100:00000001:9.0:1773851865.929748:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851865.929748:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851865.929749:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929749:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851865.929749:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:8.0:1773851865.929750:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851865.929751:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637087101658112 : -106986607893504 : ffff9eb23d3da400)
00080000:00000001:11.0:1773851865.929752:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:11.0:1773851865.929753:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929753:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:11.0:1773851865.929754:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000100:00000001:8.0:1773851865.929754:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:11.0:1773851865.929755:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000032aca06e.
00000004:00080000:11.0:1773851865.929755:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614140383030865ns, next at 614141383029823ns, rc = 0
02000000:00000001:8.0:1773851865.929755:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:11.0:1773851865.929756:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851865.929756:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851865.929757:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851865.929757:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051927808:2075@kfi7:13:default-yuba2-0
00000004:00000001:11.0:1773851865.929758:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929758:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851865.929759:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851865.929759:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851865.929760:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851865.929761:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000fe2482c5.
02000000:00000001:8.0:1773851865.929761:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851865.929763:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:8.0:1773851865.929764:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000400:00000010:8.0:1773851865.929765:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000100:00000200:8.0:1773851865.929766:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927808, portal 4
00000100:00000001:8.0:1773851865.929766:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851865.929767:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889197696 : -106993820353920 : ffff9eb08f583a80)
00000100:00000040:8.0:1773851865.929768:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851865.929770:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851865.929771:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:8.0:1773851865.929772:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b95ec19a.
00000100:00000200:8.0:1773851865.929772:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927808, offset 0
00000400:00000200:8.0:1773851865.929774:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:8.0:1773851865.929775:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:8.0:1773851865.929776:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:8.0:1773851865.929777:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:8.0:1773851865.929778:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:8.0:1773851865.929779:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:8.0:1773851865.929780:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769156, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769161, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851865.929782:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851865.929783:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851865.929784:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:8.0:1773851865.929785:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769162:8769162:1024:4294967295] 2075@kfi7 LPNI seq info [5403910:5403910:16:4294967295]
00000400:00000200:8.0:1773851865.929786:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:8.0:1773851865.929787:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:8.0:1773851865.929789:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851865.929790:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:8.0:1773851865.929792:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851865.929793:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851865.929795:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851865.929797:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Using peer 2075@kfi7(0x4e8)
00000800:00000200:8.0:1773851865.929800:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x4e8: rc=0
00000800:00000200:8.0:1773851865.929802:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851865.929804:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929804:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851865.929805:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929806:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929807:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851865.929808:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851865.929808:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851865.929809:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851865.929809:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851865.929813:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929813:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851865.929814:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851865.929816:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851865.929817:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000400:00000200:9.0:1773851865.929818:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b95ec19a
00000400:00000010:9.0:1773851865.929819:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b95ec19a.
00000100:00000001:9.0:1773851865.929820:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851865.929821:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851865.929824:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851865.929824:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851865.929826:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851865.929827:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851865.929828:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851865.929830:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Transaction freed
00000800:00000200:9.0:1773851865.929858:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851865.929859:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851865.929860:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851865.929862:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851865.929864:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.929865:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851865.929866:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.929867:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851865.929867:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.929869:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851865.929870:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851865.929871:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.929872:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3500
00000400:00000200:9.0:1773851865.929873:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851865.929874:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781697849 [1] + 224
00000800:00000200:9.0:1773851865.929875:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851865.929877:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851865.929878:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851865.929879:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851865.929880:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851865.929882:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851865.929885:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851865.929886:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000100:00000001:8.0:1773851865.929886:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851865.929887:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851865.929887:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:8.0:1773851865.929887:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851865.929888:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851865.929888:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00000400:00000200:8.0:1773851865.929889:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000010:8.0:1773851865.929889:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000100:00000001:8.0:1773851865.929890:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851865.929891:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851865.929893:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851865.929896:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851865.929897:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851865.929897:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851865.929898:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851865.929898:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851865.929899:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851865.929900:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851865.929901:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=98 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851865.929902:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=98 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851865.929903:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851865.929903:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851865.929904:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851865.929904:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929905:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851865.929905:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:8.0:1773851865.929906:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851865.929906:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851865.929907:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851865.929910:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851865.929910:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851865.929911:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851865.929911:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851865.929912:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851865.929913:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470736384 avail=351461654528 avail_mb=1372897088 hwm_mb=3131103 files=372064608 ffree=343233141 state=0: rc = 0
00000004:00000020:8.0:1773851865.929914:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470736384 free, 351461654528 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064608 files, 343233141 free files
00000004:00000001:8.0:1773851865.929916:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851865.929917:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:8.0:1773851865.929919:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051927808:2075@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851865.929922:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851865.929923:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851865.929923:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000158ac04d x1859433051927808/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852018 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851865.929926:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851865.929926:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851865.929927:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000fe2482c5.
02000000:00000001:8.0:1773851865.929928:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851865.929928:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851865.929928:0:41070:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:8.0:1773851865.929929:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851865.929929:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d7506b21.
02000000:00000001:8.0:1773851865.929930:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851865.929930:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851865.929931:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000158ac04d.
00000100:00000001:8.0:1773851865.929932:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851865.929932:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851865.929933:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851865.929933:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851865.929934:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851865.929934:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851865.929935:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851865.972351:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851865.972353:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851865.972354:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851865.972358:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851865.972360:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21952@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.972362:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21952@kfi7 : PUT - for me
00000400:00000200:21.0:1773851865.972364:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21952@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.972365:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002795f963 nid 21952@kfi7 refs 1
00000400:00000200:21.0:1773851865.972367:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21952@kfi7 to cpt 5
00000400:00000200:21.0:1773851865.972368:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002795f963 nid 21952@kfi7 refs 2
00000400:00000200:21.0:1773851865.972370:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002795f963 nid 21952@kfi7 refs 3
00000400:00000200:21.0:1773851865.972371:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21760@kfi7 to cpt 2
00000400:00000200:21.0:1773851865.972373:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21760@kfi7 of length 224 into portal 12 MB=0x69b4c38db4240
00000400:00000200:21.0:1773851865.972375:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21760@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 35496
00000800:00000200:21.0:1773851865.972377:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851865.972380:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851865.972382:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21952@kfi7: PUT: OK
00000100:00000001:21.0:1773851865.972383:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851865.972384:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851865.972385:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ef1ac31.
00000100:00000040:21.0:1773851865.972386:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002ef1ac31 x1859601533977152 msgsize 224
00000100:00100000:21.0:1773851865.972389:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21760@kfi7 (source: 12345-21952@kfi7)
00000100:00000001:21.0:1773851865.972390:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851865.972391:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002795f963 nid 21952@kfi7 refs 2
00000100:00000001:22.0:1773851865.972393:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851865.972394:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851865.972394:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851865.972394:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851865.972395:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851865.972397:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851865.972398:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601533977152
00000020:00000001:22.0:1773851865.972399:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851865.972399:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7e12c
00000020:00000001:22.0:1773851865.972400:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851865.972405:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de5593c3 refcount=5
00000020:00000001:22.0:1773851865.972406:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637090461926400 : -106983247625216 : ffff9eb305874400)
00000020:00000001:22.0:1773851865.972407:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637090461926400 : -106983247625216 : ffff9eb305874400)
00000100:00000001:22.0:1773851865.972409:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.972410:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851865.972411:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064c8bac5.
00000020:00000010:22.0:1773851865.972412:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851865.972414:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851865.972415:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851865.972417:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851865.972418:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851865.972419:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851865.972419:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851865.972420:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.972422:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851865.972424:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851865.972424:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851865.972424:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851865.972425:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851865.972426:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21760@kfi7, seq: 1997974
00000100:00000001:23.0:1773851865.972427:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.972427:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de5593c3 : new rpc_count 1
00000100:00000001:23.0:1773851865.972428:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.972428:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840036224 : -106961869515392 : ffff9eb7ffc35580)
00000100:00000040:22.0:1773851865.972430:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002ef1ac31 x1859601533977152/t0(0) o400->34a4d77f-ae9a-4a37-b71c-2c205c51314e@21760@kfi7:592/0 lens 224/0 e 0 to 0 dl 1773851952 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1859-0'
00000100:00000001:22.0:1773851865.972435:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851865.972435:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851865.972437:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ef1ac31 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:34a4d77f-ae9a-4a37-b71c-2c205c51314e+5:39526:x1859601533977152:12345-21760@kfi7:400:default-tuolumne1859-0
00000100:00000200:22.0:1773851865.972439:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601533977152
00000020:00000001:22.0:1773851865.972440:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851865.972441:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851865.972442:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.972443:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851865.972444:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851865.972445:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851865.972446:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601533977152, found 0 last_xid 1859601533977151
00000020:00000001:22.0:1773851865.972447:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851865.972448:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851865.972449:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851865.972450:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.972451:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851865.972452:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851865.972452:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851865.972453:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000091e64680.
02000000:00000001:22.0:1773851865.972454:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.972456:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.972457:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851865.972458:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693683, transno 0, xid 1859601533977152
00010000:00000001:22.0:1773851865.972459:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851865.972461:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002ef1ac31 x1859601533977152/t0(0) o400->34a4d77f-ae9a-4a37-b71c-2c205c51314e@21760@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1859-0'
00010000:00000001:22.0:1773851865.972465:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851865.972465:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851865.972466:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=98 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851865.972468:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851865.972469:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091fd5990 refcount 3 to 21760@kfi7
00000100:00000001:22.0:1773851865.972470:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551676320 : -107156157875296 : ffff9e8ac3463ba0)
02000000:00000001:22.0:1773851865.972472:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851865.972472:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851865.972473:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851865.972475:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21952@kfi7
00000400:00000010:22.0:1773851865.972476:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024da156c.
00000100:00000200:22.0:1773851865.972477:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601533977152, offset 224
00000400:00000200:22.0:1773851865.972479:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21952@kfi7
00000400:00000200:22.0:1773851865.972480:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21952@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.972482:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002795f963 nid 21952@kfi7 refs 1
00000400:00000200:22.0:1773851865.972483:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002795f963 nid 21952@kfi7 refs 2
00000400:00000200:22.0:1773851865.972485:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002795f963 nid 21952@kfi7 refs 3
00000400:00000200:22.0:1773851865.972487:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21952@kfi7 local destination
00000400:00000200:22.0:1773851865.972489:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769163:8769163:1024:4294967295] 21952@kfi7 LPNI seq info [408144:408144:16:4294967295]
00000400:00000200:22.0:1773851865.972491:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002795f963 nid 21952@kfi7 refs 2
00000400:00000200:22.0:1773851865.972492:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21952@kfi7 to cpt 5
00000400:00000200:22.0:1773851865.972496:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21952@kfi7(21952@kfi7:21952@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851865.972497:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002795f963 nid 21952@kfi7 refs 3
00000800:00000200:22.0:1773851865.972500:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851865.972501:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851865.972512:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851865.972515:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x273 Using peer 21952@kfi7(0x273)
00000800:00000200:22.0:1773851865.972520:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000008ad6e841: Posted send of 324 bytes to peer 0x273: rc=0
00000800:00000200:22.0:1773851865.972523:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x273 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851865.972526:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851865.972527:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091fd5990 refcount 2 to 21760@kfi7
00010000:00000001:22.0:1773851865.972528:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851865.972529:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851865.972530:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851865.972531:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002ef1ac31 x1859601533977152/t0(0) o400->34a4d77f-ae9a-4a37-b71c-2c205c51314e@21760@kfi7:592/0 lens 224/224 e 0 to 0 dl 1773851952 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1859-0'
00000100:00100000:22.0:1773851865.972536:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ef1ac31 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:34a4d77f-ae9a-4a37-b71c-2c205c51314e+5:39526:x1859601533977152:12345-21760@kfi7:400:default-tuolumne1859-0 Request processed in 100us (148us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851865.972537:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x273 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851865.972540:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21760@kfi7, seq: 1997974
00000100:00000040:22.0:1773851865.972541:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de5593c3 : new rpc_count 0
00000100:00000001:22.0:1773851865.972542:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851865.972542:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851865.972543:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851865.972544:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851865.972544:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21952@kfi7: PUT: OK
00000020:00000010:22.0:1773851865.972545:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851865.972545:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024da156c
00000020:00000010:22.0:1773851865.972546:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064c8bac5.
00000400:00000010:21.0:1773851865.972546:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024da156c.
00000100:00000001:21.0:1773851865.972547:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:22.0:1773851865.972548:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000de5593c3 : new refcount 4
00000100:00000001:21.0:1773851865.972548:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:22.0:1773851865.972549:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851865.972549:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002795f963 nid 21952@kfi7 refs 2
00000800:00000200:21.0:1773851865.972552:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2069@kfi7:5 -> 21952@kfi7(0000000072f2e5ff):0x0 lsk 628 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x273 Transaction freed
00000400:00000200:29.0:1773851865.993732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851865.993733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:5.0:1773851866.004625:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.004626:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851866.004627:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851866.004630:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851866.004632:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14691@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.004633:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14691@kfi7 : PUT - for me
00000400:00000200:5.0:1773851866.004634:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14691@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.004636:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c93a28c8 nid 14691@kfi7 refs 1
00000400:00000200:5.0:1773851866.004636:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14691@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.004637:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c93a28c8 nid 14691@kfi7 refs 2
00000400:00000200:5.0:1773851866.004638:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c93a28c8 nid 14691@kfi7 refs 3
00000400:00000200:5.0:1773851866.004639:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14755@kfi7 to cpt 5
00000400:00000200:5.0:1773851866.004640:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14755@kfi7 of length 224 into portal 12 MB=0x69b4b57eebec0
00000400:00000200:5.0:1773851866.004641:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14755@kfi7 of length 224/224 into md 0x793926dc5 [64] + 133880
00000800:00000200:5.0:1773851866.004643:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851866.004645:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851866.004646:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14691@kfi7: PUT: OK
00000100:00000001:5.0:1773851866.004647:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851866.004647:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851866.004648:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cd4dbf90.
00000100:00000040:5.0:1773851866.004649:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000cd4dbf90 x1859597760380608 msgsize 224
00000100:00100000:5.0:1773851866.004650:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14755@kfi7 (source: 12345-14691@kfi7)
00000100:00000001:5.0:1773851866.004651:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851866.004652:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c93a28c8 nid 14691@kfi7 refs 2
00000100:00000001:7.0:1773851866.004654:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851866.004654:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851866.004655:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851866.004656:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851866.004656:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851866.004658:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851866.004659:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597760380608
00000020:00000001:7.0:1773851866.004660:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851866.004661:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d83aa2
00000020:00000001:7.0:1773851866.004662:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851866.004664:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000095b3f8f3 refcount=5
00000020:00000001:7.0:1773851866.004665:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636964303992832 : -107109405558784 : ffff9e95a5edf800)
00000020:00000001:7.0:1773851866.004666:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636964303992832 : -107109405558784 : ffff9e95a5edf800)
00000100:00000001:7.0:1773851866.004668:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851866.004670:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851866.004671:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d2a17bef.
00000020:00000010:7.0:1773851866.004672:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851866.004674:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d926879.
00000100:00000001:7.0:1773851866.004675:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851866.004676:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851866.004677:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851866.004678:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851866.004679:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851866.004680:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851866.004681:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851866.004683:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851866.004683:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851866.004683:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851866.004684:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851866.004684:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14755@kfi7, seq: 2001911
00000100:00000001:7.0:1773851866.004685:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.004685:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000095b3f8f3 : new rpc_count 1
00000100:00000001:5.0:1773851866.004685:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886773888 : -106955822777728 : ffff9eb9682d3a80)
00000100:00000001:7.0:1773851866.004686:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.004687:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cd4dbf90 x1859597760380608/t0(0) o400->8c58be60-720c-4f21-a3e9-034c5c34366e@14755@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1404-0'
00000100:00000001:5.0:1773851866.004689:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.004689:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851866.004690:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd4dbf90 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:8c58be60-720c-4f21-a3e9-034c5c34366e+5:39584:x1859597760380608:12345-14755@kfi7:400:default-tuolumne1404-0
00000100:00000200:5.0:1773851866.004693:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597760380608
00000020:00000001:5.0:1773851866.004693:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851866.004694:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851866.004695:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.004695:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851866.004696:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851866.004697:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851866.004697:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597760380608, found 0 last_xid 1859597760380607
00000020:00000001:5.0:1773851866.004698:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851866.004699:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851866.004699:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851866.004699:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.004700:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851866.004701:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851866.004701:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851866.004702:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c9b9985c.
02000000:00000001:5.0:1773851866.004702:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.004703:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.004704:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851866.004704:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694795, transno 0, xid 1859597760380608
00010000:00000001:5.0:1773851866.004705:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851866.004706:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cd4dbf90 x1859597760380608/t0(0) o400->8c58be60-720c-4f21-a3e9-034c5c34366e@14755@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1404-0'
00010000:00000001:5.0:1773851866.004708:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851866.004709:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851866.004710:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=98 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851866.004711:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851866.004711:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cfe3034d refcount 3 to 14755@kfi7
00000100:00000001:5.0:1773851866.004712:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095072 : -107139307456544 : ffff9e8eafa337e0)
02000000:00000001:5.0:1773851866.004713:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851866.004713:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.004714:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851866.004714:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14691@kfi7
00000400:00000010:5.0:1773851866.004715:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c6d08d7.
00000100:00000200:5.0:1773851866.004716:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597760380608, offset 224
00000400:00000200:5.0:1773851866.004718:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14691@kfi7
00000400:00000200:5.0:1773851866.004718:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14691@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.004719:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c93a28c8 nid 14691@kfi7 refs 1
00000400:00000200:5.0:1773851866.004720:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c93a28c8 nid 14691@kfi7 refs 2
00000400:00000200:5.0:1773851866.004721:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c93a28c8 nid 14691@kfi7 refs 3
00000400:00000200:5.0:1773851866.004722:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14691@kfi7 local destination
00000400:00000200:5.0:1773851866.004723:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769164:8769164:1024:4294967295] 14691@kfi7 LPNI seq info [192952:192952:16:4294967295]
00000400:00000200:5.0:1773851866.004729:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c93a28c8 nid 14691@kfi7 refs 2
00000400:00000200:5.0:1773851866.004729:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14691@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.004731:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14691@kfi7(14691@kfi7:14691@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851866.004732:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c93a28c8 nid 14691@kfi7 refs 3
00000800:00000200:5.0:1773851866.004733:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.004734:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851866.004736:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851866.004739:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe7 Using peer 14691@kfi7(0xe7)
00000800:00000200:5.0:1773851866.004741:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0xe7: rc=0
00000800:00000200:5.0:1773851866.004743:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851866.004745:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.004745:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cfe3034d refcount 2 to 14755@kfi7
00010000:00000001:5.0:1773851866.004746:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851866.004747:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.004747:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851866.004748:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cd4dbf90 x1859597760380608/t0(0) o400->8c58be60-720c-4f21-a3e9-034c5c34366e@14755@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1404-0'
00000100:00100000:5.0:1773851866.004751:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd4dbf90 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:8c58be60-720c-4f21-a3e9-034c5c34366e+5:39584:x1859597760380608:12345-14755@kfi7:400:default-tuolumne1404-0 Request processed in 61us (101us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851866.004753:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14755@kfi7, seq: 2001911
00000100:00000040:5.0:1773851866.004754:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000095b3f8f3 : new rpc_count 0
00000100:00000001:5.0:1773851866.004755:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851866.004755:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851866.004755:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:5.0:1773851866.004756:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d926879.
00000800:00000200:6.0:1773851866.004757:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe7 TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851866.004757:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d2a17bef.
00000020:00000040:5.0:1773851866.004758:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000095b3f8f3 : new refcount 4
00000100:00000001:5.0:1773851866.004759:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851866.004760:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851866.004762:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14691@kfi7: PUT: OK
00000400:00000200:6.0:1773851866.004763:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c6d08d7
00000400:00000010:6.0:1773851866.004764:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c6d08d7.
00000100:00000001:6.0:1773851866.004765:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851866.004765:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851866.004767:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c93a28c8 nid 14691@kfi7 refs 2
00000800:00000200:6.0:1773851866.004769:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 14691@kfi7(0000000078707abd):0x0 lsk 232 rsk 7 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe7 Transaction freed
00000800:00000200:25.0:1773851866.056192:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851866.056193:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851866.056195:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851866.056199:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851866.056202:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.056204:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851866.056207:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.056208:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851866.056210:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.056211:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851866.056213:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851866.056214:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851866.056216:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a86099d00
00000400:00000200:25.0:1773851866.056218:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 13392
00000800:00000200:25.0:1773851866.056221:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851866.056224:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851866.056226:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851866.056227:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851866.056228:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851866.056229:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c2fa4f21.
00000100:00000040:25.0:1773851866.056230:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c2fa4f21 x1859388080495872 msgsize 224
00000100:00100000:25.0:1773851866.056233:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851866.056234:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851866.056235:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00000001:24.0:1773851866.056236:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851866.056236:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851866.056237:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851866.056237:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851866.056238:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851866.056238:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851866.056239:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080495872
00000020:00000001:24.0:1773851866.056239:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851866.056240:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:24.0:1773851866.056241:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851866.056241:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:24.0:1773851866.056242:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:24.0:1773851866.056243:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:24.0:1773851866.056244:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851866.056244:0:1537164:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851866.056245:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851866.056246:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851866.056247:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000100:00000040:24.0:1773851866.056248:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851866.056249:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851866.056249:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851866.056249:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.056250:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.056251:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851866.056252:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851866.056253:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851866.056254:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:24.0:1773851866.056254:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799982
00000100:00000001:25.0:1773851866.056255:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851866.056255:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851866.056255:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:24.0:1773851866.056255:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478782336 : -106938230769280 : ffff9ebd80bdf980)
00000100:00000001:25.0:1773851866.056257:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851866.056257:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c2fa4f21 x1859388080495872/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:24.0:1773851866.056259:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851866.056260:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851866.056261:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2fa4f21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080495872:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:24.0:1773851866.056262:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080495872
00000020:00000001:24.0:1773851866.056263:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851866.056263:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851866.056264:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.056264:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851866.056265:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851866.056265:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851866.056266:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851866.056267:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851866.056267:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851866.056268:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.056268:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851866.056269:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851866.056270:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000fe5cc90a.
02000000:00000001:24.0:1773851866.056270:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.056271:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851866.056272:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851866.056273:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851866.056273:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851866.056274:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851866.056275:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851866.056277:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851866.056277:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080495872
00010000:00000001:24.0:1773851866.056278:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851866.056279:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c2fa4f21 x1859388080495872/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:24.0:1773851866.056281:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851866.056281:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851866.056284:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=143 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851866.056286:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851866.056286:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:24.0:1773851866.056287:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:24.0:1773851866.056288:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851866.056288:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.056289:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851866.056290:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:24.0:1773851866.056290:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ae854d9.
00000100:00000200:24.0:1773851866.056291:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080495872, offset 224
00000400:00000200:24.0:1773851866.056292:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:24.0:1773851866.056293:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851866.056294:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:24.0:1773851866.056295:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851866.056296:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:24.0:1773851866.056297:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:24.0:1773851866.056298:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769165:8769165:1024:4294967295] 8@kfi7 LPNI seq info [17340062:17340062:16:4294967295]
00000400:00000200:24.0:1773851866.056300:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851866.056300:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851866.056302:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851866.056303:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:24.0:1773851866.056305:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851866.056306:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851866.056309:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851866.056311:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x11a4 Using peer 8@kfi7(0x11a4)
00000800:00000200:24.0:1773851866.056315:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 468 bytes to peer 0x11a4: rc=0
00000800:00000200:24.0:1773851866.056316:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x11a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851866.056318:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851866.056319:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:24.0:1773851866.056320:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851866.056320:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.056321:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851866.056322:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c2fa4f21 x1859388080495872/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:24.0:1773851866.056326:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2fa4f21 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080495872:12345-7@kfi7:41:default-yuba5-0 Request processed in 66us (95us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851866.056329:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799982
00000100:00000040:24.0:1773851866.056330:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:24.0:1773851866.056330:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851866.056331:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851866.056332:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851866.056332:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000020:00000010:24.0:1773851866.056333:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851866.056334:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:24.0:1773851866.056335:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851866.056340:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x11a4 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851866.056341:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851866.056342:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00000400:00000200:25.0:1773851866.056343:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ae854d9
00000400:00000010:25.0:1773851866.056343:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ae854d9.
00000100:00000001:25.0:1773851866.056344:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851866.056344:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851866.056348:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851866.056349:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x11a4 Transaction freed
00000800:00000200:21.0:1773851866.072418:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851866.072419:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851866.072421:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851866.072424:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851866.072426:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24960@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.072428:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24960@kfi7 : PUT - for me
00000400:00000200:21.0:1773851866.072429:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24960@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.072430:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 1
00000400:00000200:21.0:1773851866.072432:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24960@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.072432:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 2
00000400:00000200:21.0:1773851866.072433:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 3
00000400:00000200:21.0:1773851866.072434:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24896@kfi7 to cpt 1
00000400:00000200:21.0:1773851866.072435:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24896@kfi7 of length 224 into portal 12 MB=0x699e183848a00
00000400:00000200:21.0:1773851866.072437:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24896@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 35720
00000800:00000200:21.0:1773851866.072439:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851866.072440:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851866.072442:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24960@kfi7: PUT: OK
00000100:00000001:21.0:1773851866.072443:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851866.072443:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851866.072444:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ab53e63.
00000100:00000040:21.0:1773851866.072445:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006ab53e63 x1858043713456640 msgsize 224
00000100:00100000:21.0:1773851866.072447:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24896@kfi7 (source: 12345-24960@kfi7)
00000100:00000001:21.0:1773851866.072448:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:22.0:1773851866.072449:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851866.072449:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 2
02000000:00000001:22.0:1773851866.072450:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851866.072450:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851866.072451:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851866.072451:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851866.072452:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851866.072453:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043713456640
00000020:00000001:22.0:1773851866.072454:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851866.072455:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92dff
00000020:00000001:22.0:1773851866.072455:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851866.072458:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000043cf254 refcount=23
00000020:00000001:22.0:1773851866.072459:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744421376 : -107128965130240 : ffff9e9118169800)
00000020:00000001:22.0:1773851866.072460:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744421376 : -107128965130240 : ffff9e9118169800)
00000100:00000001:22.0:1773851866.072462:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851866.072463:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851866.072464:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064c8bac5.
00000020:00000010:22.0:1773851866.072465:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851866.072465:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851866.072466:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851866.072467:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851866.072467:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851866.072469:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851866.072469:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851866.072470:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.072470:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851866.072472:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851866.072472:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851866.072472:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851866.072472:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851866.072473:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24896@kfi7, seq: 1997975
00000100:00000001:23.0:1773851866.072474:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851866.072474:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851866.072474:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000043cf254 : new rpc_count 1
00000100:00000001:22.0:1773851866.072474:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840032768 : -106961869518848 : ffff9eb7ffc34800)
00000100:00000040:22.0:1773851866.072476:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ab53e63 x1858043713456640/t0(0) o400->175d5e2d-3f56-4ee8-b3c9-5168d834caab@24896@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2052-0'
00000100:00000001:22.0:1773851866.072479:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851866.072479:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851866.072480:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ab53e63 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:175d5e2d-3f56-4ee8-b3c9-5168d834caab+23:39676:x1858043713456640:12345-24896@kfi7:400:default-tuolumne2052-0
00000100:00000200:22.0:1773851866.072481:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043713456640
00000020:00000001:22.0:1773851866.072482:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851866.072482:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851866.072483:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851866.072484:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851866.072485:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851866.072485:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851866.072486:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043713456640, found 0 last_xid 1858043713097279
00000020:00000001:22.0:1773851866.072487:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851866.072487:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851866.072488:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851866.072489:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851866.072489:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851866.072490:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851866.072490:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851866.072491:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000070b1c4ef.
02000000:00000001:22.0:1773851866.072491:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.072492:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851866.072493:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851866.072493:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260376522, transno 0, xid 1858043713456640
00010000:00000001:22.0:1773851866.072494:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851866.072495:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ab53e63 x1858043713456640/t0(0) o400->175d5e2d-3f56-4ee8-b3c9-5168d834caab@24896@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2052-0'
00010000:00000001:22.0:1773851866.072497:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851866.072498:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851866.072499:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=99 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851866.072499:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851866.072500:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cb15c48a refcount 3 to 24896@kfi7
00000100:00000001:22.0:1773851866.072501:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411136 : -107145304140480 : ffff9e8d4a351540)
02000000:00000001:22.0:1773851866.072502:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851866.072502:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.072503:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851866.072504:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24960@kfi7
00000400:00000010:22.0:1773851866.072504:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fda32665.
00000100:00000200:22.0:1773851866.072505:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043713456640, offset 224
00000400:00000200:22.0:1773851866.072507:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24960@kfi7
00000400:00000200:22.0:1773851866.072507:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24960@kfi7 to cpt 5
00000400:00000200:22.0:1773851866.072508:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 1
00000400:00000200:22.0:1773851866.072509:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 2
00000400:00000200:22.0:1773851866.072511:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 3
00000400:00000200:22.0:1773851866.072512:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24960@kfi7 local destination
00000400:00000200:22.0:1773851866.072514:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769166:8769166:1024:4294967295] 24960@kfi7 LPNI seq info [7715407:7715407:16:4294967295]
00000400:00000200:22.0:1773851866.072515:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 2
00000400:00000200:22.0:1773851866.072516:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24960@kfi7 to cpt 5
00000400:00000200:22.0:1773851866.072518:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24960@kfi7(24960@kfi7:24960@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851866.072519:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 3
00000800:00000200:22.0:1773851866.072520:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851866.072521:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851866.072523:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851866.072525:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1217 Using peer 24960@kfi7(0x1217)
00000800:00000200:22.0:1773851866.072528:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000bfc5a5ad: Posted send of 324 bytes to peer 0x1217: rc=0
00000800:00000200:22.0:1773851866.072530:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1217 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851866.072532:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851866.072533:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cb15c48a refcount 2 to 24896@kfi7
00010000:00000001:22.0:1773851866.072533:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851866.072534:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851866.072534:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851866.072535:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ab53e63 x1858043713456640/t0(0) o400->175d5e2d-3f56-4ee8-b3c9-5168d834caab@24896@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2052-0'
00000100:00100000:22.0:1773851866.072538:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ab53e63 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:175d5e2d-3f56-4ee8-b3c9-5168d834caab+23:39676:x1858043713456640:12345-24896@kfi7:400:default-tuolumne2052-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851866.072540:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24896@kfi7, seq: 1997975
00000100:00000040:22.0:1773851866.072540:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000043cf254 : new rpc_count 0
00000100:00000001:22.0:1773851866.072541:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851866.072542:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851866.072542:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1217 TN_EVENT_TX_OK event status 0
00000020:00000010:22.0:1773851866.072543:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851866.072543:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851866.072544:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064c8bac5.
00000400:00000200:21.0:1773851866.072544:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:22.0:1773851866.072545:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000043cf254 : new refcount 22
00000400:00000200:21.0:1773851866.072545:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24960@kfi7: PUT: OK
00000400:00000200:21.0:1773851866.072545:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fda32665
00000100:00000001:22.0:1773851866.072546:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:21.0:1773851866.072546:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fda32665.
00000100:00000001:21.0:1773851866.072547:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851866.072547:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851866.072548:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e80bfcb1 nid 24960@kfi7 refs 2
00000800:00000200:21.0:1773851866.072549:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 24960@kfi7(00000000f97a775f):0x0 lsk 4632 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1217 Transaction freed
00000800:00000200:25.0:1773851866.082659:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851866.082660:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851866.082661:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851866.082664:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851866.082665:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8561@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.082667:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8561@kfi7 : PUT - for me
00000400:00000200:25.0:1773851866.082668:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8561@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.082668:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 1
00000400:00000200:25.0:1773851866.082669:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8561@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.082670:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 2
00000400:00000200:25.0:1773851866.082671:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 3
00000400:00000200:25.0:1773851866.082671:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8624@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.082672:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8624@kfi7 of length 224 into portal 12 MB=0x69b9545c1f780
00000400:00000200:25.0:1773851866.082673:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8624@kfi7 of length 224/224 into md 0x16159c9699 [64] + 8040
00000800:00000200:25.0:1773851866.082675:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851866.082677:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851866.082678:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8561@kfi7: PUT: OK
00000100:00000001:25.0:1773851866.082679:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851866.082679:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851866.082680:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066856540.
00000100:00000040:25.0:1773851866.082680:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000066856540 x1859915283036032 msgsize 224
00000100:00100000:25.0:1773851866.082681:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8624@kfi7 (source: 12345-8561@kfi7)
00000100:00000001:25.0:1773851866.082682:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851866.082683:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 2
00000100:00000001:24.0:1773851866.082684:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851866.082684:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851866.082685:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851866.082685:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851866.082685:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851866.082686:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851866.082686:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859915283036032
00000020:00000001:24.0:1773851866.082687:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851866.082687:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b5b3ad37a
00000020:00000001:24.0:1773851866.082688:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851866.082689:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d346e1f7 refcount=7
00000020:00000001:24.0:1773851866.082690:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636974409238528 : -107099300313088 : ffff9e98003fc800)
00000020:00000001:24.0:1773851866.082691:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636974409238528 : -107099300313088 : ffff9e98003fc800)
00000100:00000001:24.0:1773851866.082692:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851866.082692:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851866.082693:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851866.082694:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851866.082695:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000100:00000001:24.0:1773851866.082696:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851866.082696:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851866.082697:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851866.082697:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851866.082698:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851866.082698:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.082699:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851866.082700:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851866.082701:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851866.082701:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851866.082701:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851866.082702:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8624@kfi7, seq: 2025093
00000100:00000040:24.0:1773851866.082702:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d346e1f7 : new rpc_count 2
00000100:00000001:25.0:1773851866.082703:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851866.082703:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.082703:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478766208 : -106938230785408 : ffff9ebd80bdba80)
00000100:00000040:24.0:1773851866.082704:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066856540 x1859915283036032/t0(0) o400->06c88805-0b41-4885-93b6-1fd4fb1c099c@8624@kfi7:83/0 lens 224/0 e 0 to 0 dl 1773852198 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1022-0'
00000100:00000001:24.0:1773851866.082707:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851866.082707:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851866.082708:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066856540 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:06c88805-0b41-4885-93b6-1fd4fb1c099c+7:39575:x1859915283036032:12345-8624@kfi7:400:default-tuolumne1022-0
00000100:00000200:24.0:1773851866.082709:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859915283036032
00000020:00000001:24.0:1773851866.082710:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851866.082710:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851866.082711:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.082711:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851866.082712:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851866.082712:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851866.082713:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859915283036032, found 0 last_xid 1859915282657855
00000020:00000001:24.0:1773851866.082714:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851866.082714:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851866.082715:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851866.082715:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.082716:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851866.082716:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851866.082717:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851866.082718:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f5e82406.
02000000:00000001:24.0:1773851866.082719:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.082719:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.082720:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851866.082721:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183143572130, transno 0, xid 1859915283036032
00010000:00000001:24.0:1773851866.082721:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851866.082722:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066856540 x1859915283036032/t0(0) o400->06c88805-0b41-4885-93b6-1fd4fb1c099c@8624@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1022-0'
00010000:00000001:24.0:1773851866.082727:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851866.082728:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851866.082728:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=99 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851866.082729:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851866.082730:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e4943ebb refcount 3 to 8624@kfi7
00000100:00000001:24.0:1773851866.082731:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366321248 : -107142343230368 : ffff9e8dfab0fc60)
02000000:00000001:24.0:1773851866.082732:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851866.082732:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.082733:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851866.082734:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8561@kfi7
00000400:00000010:24.0:1773851866.082734:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bbeeaf9c.
00000100:00000200:24.0:1773851866.082735:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859915283036032, offset 224
00000400:00000200:24.0:1773851866.082736:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8561@kfi7
00000400:00000200:24.0:1773851866.082737:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8561@kfi7 to cpt 6
00000400:00000200:24.0:1773851866.082738:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 1
00000400:00000200:24.0:1773851866.082739:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 2
00000400:00000200:24.0:1773851866.082740:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 3
00000400:00000200:24.0:1773851866.082741:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8561@kfi7 local destination
00000400:00000200:24.0:1773851866.082742:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769167:8769167:1024:4294967295] 8561@kfi7 LPNI seq info [3026436:3026436:16:4294967295]
00000400:00000200:24.0:1773851866.082744:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 2
00000400:00000200:24.0:1773851866.082744:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8561@kfi7 to cpt 6
00000400:00000200:24.0:1773851866.082746:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8561@kfi7(8561@kfi7:8561@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851866.082747:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 3
00000800:00000200:24.0:1773851866.082748:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851866.082750:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851866.082752:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851866.082755:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x520 Using peer 8561@kfi7(0x520)
00000800:00000200:24.0:1773851866.082758:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000358ab717: Posted send of 324 bytes to peer 0x520: rc=0
00000800:00000200:24.0:1773851866.082759:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x520 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851866.082761:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851866.082762:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e4943ebb refcount 2 to 8624@kfi7
00010000:00000001:24.0:1773851866.082763:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851866.082763:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.082764:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851866.082764:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066856540 x1859915283036032/t0(0) o400->06c88805-0b41-4885-93b6-1fd4fb1c099c@8624@kfi7:83/0 lens 224/224 e 0 to 0 dl 1773852198 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1022-0'
00000100:00100000:24.0:1773851866.082769:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066856540 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:06c88805-0b41-4885-93b6-1fd4fb1c099c+7:39575:x1859915283036032:12345-8624@kfi7:400:default-tuolumne1022-0 Request processed in 61us (87us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851866.082770:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8624@kfi7, seq: 2025093
00000100:00000040:24.0:1773851866.082771:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d346e1f7 : new rpc_count 1
00000100:00000001:24.0:1773851866.082772:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851866.082772:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851866.082773:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851866.082773:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000020:00000010:24.0:1773851866.082774:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851866.082775:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000d346e1f7 : new refcount 6
00000100:00000001:24.0:1773851866.082776:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851866.082780:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x520 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851866.082782:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851866.082783:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8561@kfi7: PUT: OK
00000400:00000200:25.0:1773851866.082784:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bbeeaf9c
00000400:00000010:25.0:1773851866.082784:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bbeeaf9c.
00000100:00000001:25.0:1773851866.082785:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851866.082785:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851866.082786:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7ce6e20 nid 8561@kfi7 refs 2
00000800:00000200:25.0:1773851866.082787:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 8561@kfi7(00000000d989574d):0x0 lsk 1313 rsk 24 tsk 0 trmk 0 tmk 0 trr 6 tta 0x520 Transaction freed
00000800:00000200:17.0:1773851866.092735:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.092736:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.092738:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.092740:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.092742:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19810@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.092743:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19810@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.092744:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19810@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.092745:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078640399 nid 19810@kfi7 refs 1
00000400:00000200:17.0:1773851866.092746:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19810@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.092747:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078640399 nid 19810@kfi7 refs 2
00000400:00000200:17.0:1773851866.092748:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000078640399 nid 19810@kfi7 refs 3
00000400:00000200:17.0:1773851866.092749:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19810@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.092750:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19810@kfi7 of length 224 into portal 12 MB=0x69b81ab8b0a00
00000400:00000200:17.0:1773851866.092751:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19810@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 8088
00000800:00000200:17.0:1773851866.092753:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.092755:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.092757:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19810@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.092758:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.092758:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.092759:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009972e054.
00000100:00000040:17.0:1773851866.092760:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009972e054 x1859831091366400 msgsize 224
00000100:00100000:17.0:1773851866.092762:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19810@kfi7 (source: 12345-19810@kfi7)
00000100:00000001:17.0:1773851866.092764:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.092765:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000078640399 nid 19810@kfi7 refs 2
00000800:00000200:17.0:1773851866.092766:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.092769:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.092770:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.092774:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.092775:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.092776:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.092776:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831091366400
00000020:00000001:17.0:1773851866.092777:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.092777:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce713c0
00000020:00000001:17.0:1773851866.092778:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.092781:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ee960923 refcount=5
00000020:00000001:17.0:1773851866.092782:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637051926966272 : -107021782585344 : ffff9eaa0caa7000)
00000020:00000001:17.0:1773851866.092783:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637051926966272 : -107021782585344 : ffff9eaa0caa7000)
00000100:00000001:17.0:1773851866.092784:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.092785:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.092785:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.092786:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.092787:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.092788:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.092789:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.092789:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.092790:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.092791:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.092791:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.092792:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.092793:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.092794:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.092795:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19810@kfi7, seq: 2156313
00000100:00000040:17.0:1773851866.092795:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ee960923 : new rpc_count 1
00000100:00000001:16.0:1773851866.092795:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.092796:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093927936 : -107022615623680 : ffff9ea9db034800)
00000100:00000001:16.0:1773851866.092796:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851866.092797:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009972e054 x1859831091366400/t0(0) o400->46c18952-d5f8-4958-b88f-580f436f0d46@19810@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1724-0'
00000100:00000001:16.0:1773851866.092797:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851866.092798:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.092800:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.092800:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.092801:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009972e054 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:46c18952-d5f8-4958-b88f-580f436f0d46+5:39485:x1859831091366400:12345-19810@kfi7:400:default-tuolumne1724-0
00000100:00000200:17.0:1773851866.092802:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831091366400
00000020:00000001:17.0:1773851866.092804:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.092804:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.092805:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.092806:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.092806:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.092807:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.092807:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831091366400, found 0 last_xid 1859831091366399
00000020:00000001:17.0:1773851866.092809:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.092809:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.092810:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.092810:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.092811:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.092811:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.092812:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.092812:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c9edf3e8.
02000000:00000001:17.0:1773851866.092813:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.092814:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.092814:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.092815:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154592325, transno 0, xid 1859831091366400
00010000:00000001:17.0:1773851866.092816:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.092817:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009972e054 x1859831091366400/t0(0) o400->46c18952-d5f8-4958-b88f-580f436f0d46@19810@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1724-0'
00010000:00000001:17.0:1773851866.092819:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.092820:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.092820:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.092821:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.092822:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ad598237 refcount 3 to 19810@kfi7
00000100:00000001:17.0:1773851866.092823:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519200 : -107156126032416 : ffff9e8ac52c1de0)
02000000:00000001:17.0:1773851866.092824:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.092824:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.092825:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.092826:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19810@kfi7
00000400:00000010:17.0:1773851866.092827:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c441fca1.
00000100:00000200:17.0:1773851866.092827:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831091366400, offset 224
00000400:00000200:17.0:1773851866.092829:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19810@kfi7
00000400:00000200:17.0:1773851866.092830:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19810@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.092831:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078640399 nid 19810@kfi7 refs 1
00000400:00000200:17.0:1773851866.092832:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000078640399 nid 19810@kfi7 refs 2
00000400:00000200:17.0:1773851866.092833:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000078640399 nid 19810@kfi7 refs 3
00000400:00000200:17.0:1773851866.092835:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19810@kfi7 local destination
00000400:00000200:17.0:1773851866.092836:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769168:8769168:1024:4294967295] 19810@kfi7 LPNI seq info [11280046:11280046:16:4294967295]
00000400:00000200:17.0:1773851866.092837:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000078640399 nid 19810@kfi7 refs 2
00000400:00000200:17.0:1773851866.092838:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19810@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.092840:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19810@kfi7(19810@kfi7:19810@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.092841:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000078640399 nid 19810@kfi7 refs 3
00000800:00000200:17.0:1773851866.092842:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.092843:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.092845:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.092847:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x133 Using peer 19810@kfi7(0x133)
00000800:00000200:17.0:1773851866.092850:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x133: rc=0
00000800:00000200:17.0:1773851866.092852:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x133 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.092854:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.092855:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ad598237 refcount 2 to 19810@kfi7
00010000:00000001:17.0:1773851866.092855:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.092856:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.092856:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.092857:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009972e054 x1859831091366400/t0(0) o400->46c18952-d5f8-4958-b88f-580f436f0d46@19810@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1724-0'
00000100:00100000:17.0:1773851866.092860:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009972e054 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:46c18952-d5f8-4958-b88f-580f436f0d46+5:39485:x1859831091366400:12345-19810@kfi7:400:default-tuolumne1724-0 Request processed in 59us (99us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.092862:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19810@kfi7, seq: 2156313
00000100:00000040:17.0:1773851866.092863:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ee960923 : new rpc_count 0
00000100:00000001:17.0:1773851866.092863:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851866.092864:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851866.092865:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.092866:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000020:00000010:17.0:1773851866.092867:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000020:00000040:17.0:1773851866.092867:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000ee960923 : new refcount 4
00000800:00000200:18.0:1773851866.092868:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x133 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851866.092868:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851866.092870:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851866.092872:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19810@kfi7: PUT: OK
00000400:00000200:18.0:1773851866.092873:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c441fca1
00000400:00000010:18.0:1773851866.092874:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c441fca1.
00000100:00000001:18.0:1773851866.092876:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.092877:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.092878:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000078640399 nid 19810@kfi7 refs 2
00000800:00000200:18.0:1773851866.092881:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19810@kfi7(0000000051c249b7):0x0 lsk 308 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x133 Transaction freed
00000800:00000200:5.0:1773851866.104097:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.104098:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851866.104100:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851866.104104:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851866.104107:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18144@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.104109:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18144@kfi7 : PUT - for me
00000400:00000200:5.0:1773851866.104111:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18144@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.104112:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae061641 nid 18144@kfi7 refs 1
00000400:00000200:5.0:1773851866.104114:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18144@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.104115:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae061641 nid 18144@kfi7 refs 2
00000400:00000200:5.0:1773851866.104116:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ae061641 nid 18144@kfi7 refs 3
00000400:00000200:5.0:1773851866.104118:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18145@kfi7 to cpt 4
00000400:00000200:5.0:1773851866.104119:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18145@kfi7 of length 224 into portal 12 MB=0x69b4b663a9200
00000400:00000200:5.0:1773851866.104122:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18145@kfi7 of length 224/224 into md 0x793926dc5 [64] + 134104
00000800:00000200:5.0:1773851866.104125:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851866.104127:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851866.104129:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18144@kfi7: PUT: OK
00000100:00000001:5.0:1773851866.104131:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851866.104132:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851866.104133:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e04e439e.
00000100:00000040:5.0:1773851866.104135:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e04e439e x1859598000230912 msgsize 224
00000100:00100000:5.0:1773851866.104137:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-18145@kfi7 (source: 12345-18144@kfi7)
00000100:00000001:5.0:1773851866.104139:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851866.104140:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ae061641 nid 18144@kfi7 refs 2
00000800:00000200:5.0:1773851866.104143:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851866.104147:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851866.104148:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851866.104149:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851866.104150:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851866.104151:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851866.104152:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598000230912
00000020:00000001:5.0:1773851866.104153:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851866.104154:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82309
00000020:00000001:5.0:1773851866.104155:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851866.104159:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e9f9a9be refcount=521
00000020:00000001:5.0:1773851866.104160:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107603091456 : -106966106460160 : ffff9eb70338b000)
00000020:00000001:5.0:1773851866.104161:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107603091456 : -106966106460160 : ffff9eb70338b000)
00000100:00000001:5.0:1773851866.104163:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.104164:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851866.104167:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d851baa9.
00000020:00000010:5.0:1773851866.104169:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.104170:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008260bf32.
00000100:00000001:5.0:1773851866.104171:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851866.104172:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851866.104173:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.104175:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.104177:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851866.104179:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851866.104179:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851866.104179:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851866.104180:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851866.104181:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18145@kfi7, seq: 371100842
00000100:00000040:5.0:1773851866.104182:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e9f9a9be : new rpc_count 11
00000100:00000001:7.0:1773851866.104183:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851866.104183:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.104184:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886785408 : -106955822766208 : ffff9eb9682d6780)
00000100:00000040:5.0:1773851866.104186:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e04e439e x1859598000230912/t0(0) o41->0a4169e8-768e-4452-8480-75487a8f3028@18145@kfi7:116/0 lens 224/0 e 0 to 0 dl 1773852231 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111590534511616'
00000100:00000001:5.0:1773851866.104191:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.104191:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851866.104192:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e04e439e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:0a4169e8-768e-4452-8480-75487a8f3028+521:39579:x1859598000230912:12345-18145@kfi7:41:tuolumne-833111590534511616
00000100:00000200:5.0:1773851866.104195:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598000230912
00000020:00000001:5.0:1773851866.104196:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851866.104197:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851866.104198:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.104199:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851866.104200:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851866.104201:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851866.104202:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598000230912, found 0 last_xid 1859597993043199
00000020:00000001:5.0:1773851866.104203:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851866.104204:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851866.104205:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851866.104206:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.104207:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851866.104208:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851866.104209:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000070f71a21.
02000000:00000001:5.0:1773851866.104210:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.104211:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851866.104213:0:61015:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851866.104214:0:61015:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851866.104215:0:61015:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851866.104216:0:61015:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851866.104218:0:61015:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000020:00000001:5.0:1773851866.104220:0:61015:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:5.0:1773851866.104224:0:61015:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851866.104225:0:61015:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851866.104226:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592023, transno 0, xid 1859598000230912
00010000:00000001:5.0:1773851866.104229:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851866.104230:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e04e439e x1859598000230912/t0(0) o41->0a4169e8-768e-4452-8480-75487a8f3028@18145@kfi7:116/0 lens 224/368 e 0 to 0 dl 1773852231 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111590534511616'
00010000:00000001:5.0:1773851866.104234:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851866.104235:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851866.104236:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=98 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851866.104238:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851866.104239:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000061e0a497 refcount 3 to 18145@kfi7
00000100:00000001:5.0:1773851866.104241:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993568 : -107142345558048 : ffff9e8dfa8d77e0)
02000000:00000001:5.0:1773851866.104242:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851866.104243:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.104244:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851866.104245:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18144@kfi7
00000400:00000010:5.0:1773851866.104246:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f7632a0.
00000100:00000200:5.0:1773851866.104248:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1859598000230912, offset 224
00000400:00000200:5.0:1773851866.104250:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18144@kfi7
00000400:00000200:5.0:1773851866.104251:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18144@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.104252:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae061641 nid 18144@kfi7 refs 1
00000400:00000200:5.0:1773851866.104254:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ae061641 nid 18144@kfi7 refs 2
00000400:00000200:5.0:1773851866.104255:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ae061641 nid 18144@kfi7 refs 3
00000400:00000200:5.0:1773851866.104257:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18144@kfi7 local destination
00000400:00000200:5.0:1773851866.104259:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769169:8769169:1024:4294967295] 18144@kfi7 LPNI seq info [476112:476112:16:4294967295]
00000400:00000200:5.0:1773851866.104261:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ae061641 nid 18144@kfi7 refs 2
00000400:00000200:5.0:1773851866.104263:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18144@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.104266:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18144@kfi7(18144@kfi7:18144@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851866.104268:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ae061641 nid 18144@kfi7 refs 3
00000800:00000200:5.0:1773851866.104270:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.104272:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851866.104275:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851866.104282:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000091d Using peer 18144@kfi7(0x10000000000091d)
00000800:00000200:5.0:1773851866.104287:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 468 bytes to peer 0x10000000000091d: rc=0
00000800:00000200:5.0:1773851866.104289:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000091d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851866.104292:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.104294:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000061e0a497 refcount 2 to 18145@kfi7
00010000:00000001:5.0:1773851866.104295:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851866.104296:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.104297:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851866.104298:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e04e439e x1859598000230912/t0(0) o41->0a4169e8-768e-4452-8480-75487a8f3028@18145@kfi7:116/0 lens 224/368 e 0 to 0 dl 1773852231 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111590534511616'
00000800:00000200:6.0:1773851866.104302:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000091d TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851866.104303:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e04e439e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:0a4169e8-768e-4452-8480-75487a8f3028+521:39579:x1859598000230912:12345-18145@kfi7:41:tuolumne-833111590534511616 Request processed in 111us (167us total) trans 0 rc 0/0
00000400:00000200:6.0:1773851866.104305:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851866.104307:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18144@kfi7: PUT: OK
00000100:00100000:5.0:1773851866.104307:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18145@kfi7, seq: 371100842
00000400:00000200:6.0:1773851866.104308:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f7632a0
00000100:00000040:5.0:1773851866.104308:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e9f9a9be : new rpc_count 10
00000400:00000010:6.0:1773851866.104309:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f7632a0.
00000100:00000001:6.0:1773851866.104310:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851866.104310:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851866.104311:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:5.0:1773851866.104311:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851866.104311:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851866.104312:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ae061641 nid 18144@kfi7 refs 2
00000020:00000010:5.0:1773851866.104313:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008260bf32.
00000020:00000010:5.0:1773851866.104314:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d851baa9.
00000800:00000200:6.0:1773851866.104315:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 18144@kfi7(00000000d5bca725):0x0 lsk 2334 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000091d Transaction freed
00000020:00000040:5.0:1773851866.104315:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e9f9a9be : new refcount 520
00000100:00000001:5.0:1773851866.104317:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851866.129622:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851866.129622:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851866.129624:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851866.129625:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851866.129627:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.129629:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:21.0:1773851866.129630:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.129630:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:21.0:1773851866.129631:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.129631:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:21.0:1773851866.129632:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851866.129633:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.129634:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c953000
00000400:00000200:21.0:1773851866.129636:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 6760
00000800:00000200:21.0:1773851866.129638:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851866.129640:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851866.129641:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000100:00000001:21.0:1773851866.129642:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851866.129643:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851866.129644:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e757d7e5.
00000100:00000040:21.0:1773851866.129644:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e757d7e5 x1858065608814592 msgsize 224
00000100:00100000:21.0:1773851866.129646:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-13@kfi7)
00000100:00000001:21.0:1773851866.129647:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851866.129648:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:22.0:1773851866.129650:0:1537183:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851866.129650:0:1537183:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851866.129650:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851866.129651:0:1537183:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851866.129651:0:1537183:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851866.129652:0:1537183:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851866.129653:0:1537183:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608814592
00000020:00000001:22.0:1773851866.129653:0:1537183:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851866.129654:0:1537183:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:22.0:1773851866.129654:0:1537183:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851866.129656:0:1537183:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:22.0:1773851866.129657:0:1537183:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:22.0:1773851866.129658:0:1537183:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:22.0:1773851866.129659:0:1537183:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851866.129660:0:1537183:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851866.129661:0:1537183:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064c8bac5.
00000020:00000010:22.0:1773851866.129662:0:1537183:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851866.129662:0:1537183:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000040:22.0:1773851866.129664:0:1537183:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:22.0:1773851866.129664:0:1537183:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851866.129665:0:1537183:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851866.129665:0:1537183:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.129666:0:1537183:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.129668:0:1537183:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851866.129669:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851866.129670:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851866.129671:0:1537183:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 3084758
00000100:00000001:20.0:1773851866.129671:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851866.129671:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:22.0:1773851866.129672:0:1537183:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:20.0:1773851866.129672:0:1537152:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.129673:0:1537183:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840016640 : -106961869534976 : ffff9eb7ffc30900)
00000100:00000001:20.0:1773851866.129673:0:1537152:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851866.129674:0:1537183:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e757d7e5 x1858065608814592/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:22.0:1773851866.129677:0:1537183:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851866.129678:0:1537183:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851866.129678:0:1537183:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e757d7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_028:lustre5-MDT0002-mdtlov_UUID+5:52334:x1858065608814592:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:22.0:1773851866.129680:0:1537183:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608814592
00000020:00000001:22.0:1773851866.129680:0:1537183:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851866.129681:0:1537183:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851866.129682:0:1537183:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851866.129682:0:1537183:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851866.129683:0:1537183:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:22.0:1773851866.129684:0:1537183:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:22.0:1773851866.129684:0:1537183:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851866.129685:0:1537183:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851866.129686:0:1537183:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851866.129686:0:1537183:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.129687:0:1537183:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851866.129687:0:1537183:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851866.129688:0:1537183:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000948aa8af.
02000000:00000001:22.0:1773851866.129689:0:1537183:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.129690:0:1537183:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:22.0:1773851866.129692:0:1537183:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:22.0:1773851866.129693:0:1537183:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:22.0:1773851866.129694:0:1537183:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:22.0:1773851866.129695:0:1537183:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:22.0:1773851866.129696:0:1537183:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:22.0:1773851866.129698:0:1537183:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851866.129699:0:1537183:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608814592
00010000:00000001:22.0:1773851866.129700:0:1537183:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851866.129700:0:1537183:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e757d7e5 x1858065608814592/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:22.0:1773851866.129703:0:1537183:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851866.129703:0:1537183:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851866.129704:0:1537183:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=90 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851866.129706:0:1537183:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851866.129706:0:1537183:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:22.0:1773851866.129707:0:1537183:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:22.0:1773851866.129708:0:1537183:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851866.129709:0:1537183:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851866.129709:0:1537183:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851866.129710:0:1537183:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:22.0:1773851866.129711:0:1537183:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000642a3145.
00000100:00000200:22.0:1773851866.129711:0:1537183:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608814592, offset 224
00000400:00000200:22.0:1773851866.129713:0:1537183:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:22.0:1773851866.129714:0:1537183:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:22.0:1773851866.129714:0:1537183:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:22.0:1773851866.129715:0:1537183:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:22.0:1773851866.129716:0:1537183:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:22.0:1773851866.129718:0:1537183:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13@kfi7 local destination
00000400:00000200:22.0:1773851866.129719:0:1537183:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769170:8769170:1024:4294967295] 13@kfi7 LPNI seq info [23133315:23133315:16:4294967295]
00000400:00000200:22.0:1773851866.129720:0:1537183:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:22.0:1773851866.129721:0:1537183:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:22.0:1773851866.129723:0:1537183:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851866.129724:0:1537183:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:22.0:1773851866.129728:0:1537183:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851866.129729:0:1537183:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:22.0:1773851866.129731:0:1537183:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851866.129734:0:1537183:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c Using peer 13@kfi7(0x20000000000095c)
00000800:00000200:22.0:1773851866.129737:0:1537183:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000007ee9d6e: Posted send of 468 bytes to peer 0x20000000000095c: rc=0
00000800:00000200:22.0:1773851866.129738:0:1537183:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851866.129740:0:1537183:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851866.129742:0:1537183:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:22.0:1773851866.129743:0:1537183:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851866.129743:0:1537183:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851866.129744:0:1537183:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851866.129744:0:1537183:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e757d7e5 x1858065608814592/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:22.0:1773851866.129747:0:1537183:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e757d7e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_028:lustre5-MDT0002-mdtlov_UUID+5:52334:x1858065608814592:12345-13@kfi7:41:default-yuba3-0 Request processed in 69us (102us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851866.129749:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851866.129750:0:1537183:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 3084758
00000100:00000040:22.0:1773851866.129750:0:1537183:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000400:00000200:21.0:1773851866.129750:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851866.129751:0:1537183:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851866.129751:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000100:00000001:22.0:1773851866.129752:0:1537183:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851866.129752:0:1537183:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851866.129752:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000642a3145
00000400:00000010:21.0:1773851866.129752:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000642a3145.
00000020:00000010:22.0:1773851866.129753:0:1537183:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000100:00000001:21.0:1773851866.129753:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:22.0:1773851866.129754:0:1537183:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064c8bac5.
00000100:00000001:21.0:1773851866.129754:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851866.129754:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000020:00000040:22.0:1773851866.129755:0:1537183:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:22.0:1773851866.129756:0:1537183:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851866.129756:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c Transaction freed
00000800:00000200:5.0:1773851866.190803:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.190804:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851866.190805:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851866.190807:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851866.190809:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14560@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.190811:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14560@kfi7 : PUT - for me
00000400:00000200:5.0:1773851866.190812:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14560@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.190813:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000034ede2b nid 14560@kfi7 refs 1
00000400:00000200:5.0:1773851866.190814:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14560@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.190814:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000034ede2b nid 14560@kfi7 refs 2
00000400:00000200:5.0:1773851866.190815:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000034ede2b nid 14560@kfi7 refs 3
00000400:00000200:5.0:1773851866.190816:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14368@kfi7 to cpt 6
00000400:00000200:5.0:1773851866.190817:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14368@kfi7 of length 224 into portal 12 MB=0x69b4b569dea00
00000400:00000200:5.0:1773851866.190818:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14368@kfi7 of length 224/224 into md 0x793926dc5 [64] + 134328
00000800:00000200:5.0:1773851866.190820:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851866.190822:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851866.190823:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14560@kfi7: PUT: OK
00000100:00000001:5.0:1773851866.190824:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851866.190824:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851866.190824:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f2740eb.
00000100:00000040:5.0:1773851866.190825:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000002f2740eb x1859597738306048 msgsize 224
00000100:00100000:5.0:1773851866.190826:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14368@kfi7 (source: 12345-14560@kfi7)
00000100:00000001:5.0:1773851866.190828:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851866.190828:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000034ede2b nid 14560@kfi7 refs 2
00000800:00000200:5.0:1773851866.190830:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851866.190833:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851866.190833:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851866.190834:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851866.190834:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851866.190835:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851866.190835:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597738306048
00000020:00000001:5.0:1773851866.190836:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851866.190836:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f54a
00000020:00000001:5.0:1773851866.190837:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851866.190839:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005a83a822 refcount=5
00000020:00000001:5.0:1773851866.190840:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637026775585792 : -107046933965824 : ffff9ea43186d400)
00000020:00000001:5.0:1773851866.190841:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637026775585792 : -107046933965824 : ffff9ea43186d400)
00000100:00000001:5.0:1773851866.190842:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.190842:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851866.190843:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d851baa9.
00000020:00000010:5.0:1773851866.190844:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.190845:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008260bf32.
00000100:00000001:5.0:1773851866.190846:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851866.190846:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851866.190847:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851866.190848:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851866.190848:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851866.190849:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.190849:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851866.190851:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851866.190851:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851866.190851:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851866.190851:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851866.190852:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14368@kfi7, seq: 2001912
00000100:00000040:5.0:1773851866.190852:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005a83a822 : new rpc_count 1
00000100:00000001:7.0:1773851866.190853:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851866.190853:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.190853:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886768128 : -106955822783488 : ffff9eb9682d2400)
00000100:00000040:5.0:1773851866.190854:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f2740eb x1859597738306048/t0(0) o400->b4a6a217-796d-438b-bc3e-8fa0368e74ab@14368@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1391-0'
00000100:00000001:5.0:1773851866.190856:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.190857:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851866.190857:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f2740eb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b4a6a217-796d-438b-bc3e-8fa0368e74ab+5:39665:x1859597738306048:12345-14368@kfi7:400:default-tuolumne1391-0
00000100:00000200:5.0:1773851866.190859:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597738306048
00000020:00000001:5.0:1773851866.190859:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851866.190860:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851866.190860:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.190861:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851866.190862:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851866.190862:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851866.190863:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597738306048, found 0 last_xid 1859597738306047
00000020:00000001:5.0:1773851866.190863:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851866.190865:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851866.190865:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851866.190865:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.190866:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851866.190867:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851866.190867:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851866.190868:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e82413dc.
02000000:00000001:5.0:1773851866.190868:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.190869:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.190870:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851866.190870:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181457954204, transno 0, xid 1859597738306048
00010000:00000001:5.0:1773851866.190871:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851866.190872:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f2740eb x1859597738306048/t0(0) o400->b4a6a217-796d-438b-bc3e-8fa0368e74ab@14368@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1391-0'
00010000:00000001:5.0:1773851866.190874:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851866.190875:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851866.190876:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=98 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851866.190876:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851866.190877:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009afeb592 refcount 3 to 14368@kfi7
00000100:00000001:5.0:1773851866.190878:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335872 : -107152617215744 : ffff9e8b96506900)
02000000:00000001:5.0:1773851866.190879:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851866.190879:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.190880:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851866.190881:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14560@kfi7
00000400:00000010:5.0:1773851866.190881:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e688c1e.
00000100:00000200:5.0:1773851866.190882:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597738306048, offset 224
00000400:00000200:5.0:1773851866.190883:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14560@kfi7
00000400:00000200:5.0:1773851866.190884:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14560@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.190884:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000034ede2b nid 14560@kfi7 refs 1
00000400:00000200:5.0:1773851866.190885:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000034ede2b nid 14560@kfi7 refs 2
00000400:00000200:5.0:1773851866.190886:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000034ede2b nid 14560@kfi7 refs 3
00000400:00000200:5.0:1773851866.190887:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14560@kfi7 local destination
00000400:00000200:5.0:1773851866.190888:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769171:8769171:1024:4294967295] 14560@kfi7 LPNI seq info [144890:144890:16:4294967295]
00000400:00000200:5.0:1773851866.190890:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000034ede2b nid 14560@kfi7 refs 2
00000400:00000200:5.0:1773851866.190891:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14560@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.190893:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14560@kfi7(14560@kfi7:14560@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851866.190894:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000034ede2b nid 14560@kfi7 refs 3
00000800:00000200:5.0:1773851866.190895:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.190896:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851866.190897:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851866.190899:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e56 Using peer 14560@kfi7(0x100000000000e56)
00000800:00000200:5.0:1773851866.190902:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 324 bytes to peer 0x100000000000e56: rc=0
00000800:00000200:5.0:1773851866.190903:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e56 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851866.190905:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.190906:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009afeb592 refcount 2 to 14368@kfi7
00010000:00000001:5.0:1773851866.190907:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851866.190907:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.190908:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851866.190908:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f2740eb x1859597738306048/t0(0) o400->b4a6a217-796d-438b-bc3e-8fa0368e74ab@14368@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1391-0'
00000100:00100000:5.0:1773851866.190911:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f2740eb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b4a6a217-796d-438b-bc3e-8fa0368e74ab+5:39665:x1859597738306048:12345-14368@kfi7:400:default-tuolumne1391-0 Request processed in 54us (85us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851866.190913:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14368@kfi7, seq: 2001912
00000100:00000040:5.0:1773851866.190914:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005a83a822 : new rpc_count 0
00000100:00000001:5.0:1773851866.190915:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851866.190915:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:6.0:1773851866.190916:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e56 TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851866.190916:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.190916:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008260bf32.
00000400:00000200:6.0:1773851866.190917:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851866.190917:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d851baa9.
00000400:00000200:6.0:1773851866.190918:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14560@kfi7: PUT: OK
00000020:00000040:5.0:1773851866.190918:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000005a83a822 : new refcount 4
00000400:00000200:6.0:1773851866.190919:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e688c1e
00000400:00000010:6.0:1773851866.190919:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e688c1e.
00000100:00000001:5.0:1773851866.190919:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851866.190920:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851866.190920:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851866.190921:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000034ede2b nid 14560@kfi7 refs 2
00000800:00000200:6.0:1773851866.190922:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 14560@kfi7(0000000000d17279):0x0 lsk 3671 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000e56 Transaction freed
00010000:00000001:2.0:1773851866.249738:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249739:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851866.249739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851866.249740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851866.249741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851866.249743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851866.249743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851866.249744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851866.249745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851866.249746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851866.249750:0:41153:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:4.0:1773851866.249751:0:41153:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:4.0:1773851866.249751:0:41153:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:13.0:1773851866.254473:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851866.254474:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851866.254475:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851866.254477:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851866.254480:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15867@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.254482:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15867@kfi7 : PUT - for me
00000400:00000200:13.0:1773851866.254483:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15867@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.254484:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b7662b3 nid 15867@kfi7 refs 1
00000400:00000200:13.0:1773851866.254485:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15867@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.254485:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b7662b3 nid 15867@kfi7 refs 2
00000400:00000200:13.0:1773851866.254486:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000b7662b3 nid 15867@kfi7 refs 3
00000400:00000200:13.0:1773851866.254487:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15867@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.254488:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15867@kfi7 of length 224 into portal 12 MB=0x699de8bdfbe40
00000400:00000200:13.0:1773851866.254490:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15867@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 26664
00000800:00000200:13.0:1773851866.254491:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851866.254493:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851866.254494:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15867@kfi7: PUT: OK
00000100:00000001:13.0:1773851866.254495:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851866.254495:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851866.254496:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c35eed52.
00000100:00000040:13.0:1773851866.254497:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c35eed52 x1858030968749632 msgsize 224
00000100:00100000:13.0:1773851866.254498:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-15867@kfi7 (source: 12345-15867@kfi7)
00000100:00000001:13.0:1773851866.254499:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851866.254500:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000b7662b3 nid 15867@kfi7 refs 2
00000100:00000001:15.0:1773851866.254501:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851866.254502:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851866.254502:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851866.254502:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851866.254503:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851866.254503:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851866.254504:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968749632
00000020:00000001:15.0:1773851866.254505:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851866.254506:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f82
00000020:00000001:15.0:1773851866.254506:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851866.254509:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003e6c2702 refcount=6
00000020:00000001:15.0:1773851866.254510:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239889920 : -107152469661696 : ffff9e8b9f1be800)
00000020:00000001:15.0:1773851866.254510:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239889920 : -107152469661696 : ffff9e8b9f1be800)
00000100:00000001:15.0:1773851866.254511:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851866.254513:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851866.254513:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000015c4406c.
00000020:00000010:15.0:1773851866.254515:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851866.254516:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851866.254516:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851866.254517:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851866.254517:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851866.254518:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851866.254519:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851866.254519:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.254520:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851866.254522:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851866.254522:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851866.254522:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851866.254522:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851866.254523:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15867@kfi7, seq: 2289825
00000100:00000040:15.0:1773851866.254524:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003e6c2702 : new rpc_count 1
00000100:00000001:13.0:1773851866.254524:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.254525:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123338794240 : -106950370757376 : ffff9ebaad247500)
00000100:00000001:13.0:1773851866.254525:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851866.254526:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c35eed52 x1858030968749632/t0(0) o400->b5e5d7f0-bbd8-457e-98e2-5ee38648e02a@15867@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne230-0'
00000100:00000001:15.0:1773851866.254529:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851866.254529:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851866.254530:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c35eed52 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b5e5d7f0-bbd8-457e-98e2-5ee38648e02a+6:47662:x1858030968749632:12345-15867@kfi7:400:default-tuolumne230-0
00000100:00000200:15.0:1773851866.254532:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968749632
00000020:00000001:15.0:1773851866.254532:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851866.254533:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851866.254533:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.254534:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851866.254535:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851866.254536:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851866.254536:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968749632, found 0 last_xid 1858030968749631
00000020:00000001:15.0:1773851866.254537:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851866.254538:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851866.254538:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851866.254539:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.254540:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851866.254540:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851866.254541:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851866.254542:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e460023.
02000000:00000001:15.0:1773851866.254542:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.254543:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.254543:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851866.254544:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030968749632
00010000:00000001:15.0:1773851866.254545:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851866.254546:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c35eed52 x1858030968749632/t0(0) o400->b5e5d7f0-bbd8-457e-98e2-5ee38648e02a@15867@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne230-0'
00010000:00000001:15.0:1773851866.254548:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851866.254549:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851866.254549:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=99 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851866.254550:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851866.254551:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053b178bb refcount 5 to 15867@kfi7
00000100:00000001:15.0:1773851866.254552:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299168 : -107155980252448 : ffff9e8acddc8ae0)
02000000:00000001:15.0:1773851866.254553:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851866.254553:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.254554:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851866.254555:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15867@kfi7
00000400:00000010:15.0:1773851866.254555:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5868b8.
00000100:00000200:15.0:1773851866.254556:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968749632, offset 224
00000400:00000200:15.0:1773851866.254557:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15867@kfi7
00000400:00000200:15.0:1773851866.254558:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15867@kfi7 to cpt 3
00000400:00000200:15.0:1773851866.254559:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b7662b3 nid 15867@kfi7 refs 1
00000400:00000200:15.0:1773851866.254560:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000b7662b3 nid 15867@kfi7 refs 2
00000400:00000200:15.0:1773851866.254562:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000b7662b3 nid 15867@kfi7 refs 3
00000400:00000200:15.0:1773851866.254563:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15867@kfi7 local destination
00000400:00000200:15.0:1773851866.254564:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769172:8769172:1024:4294967295] 15867@kfi7 LPNI seq info [24424:24424:16:4294967295]
00000400:00000200:15.0:1773851866.254566:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000b7662b3 nid 15867@kfi7 refs 2
00000400:00000200:15.0:1773851866.254567:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15867@kfi7 to cpt 3
00000400:00000200:15.0:1773851866.254569:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15867@kfi7(15867@kfi7:15867@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851866.254573:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000b7662b3 nid 15867@kfi7 refs 3
00000800:00000200:15.0:1773851866.254574:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851866.254576:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851866.254578:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851866.254580:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11a Using peer 15867@kfi7(0x11a)
00000800:00000200:15.0:1773851866.254583:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x11a: rc=0
00000800:00000200:15.0:1773851866.254585:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851866.254587:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851866.254588:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053b178bb refcount 4 to 15867@kfi7
00010000:00000001:15.0:1773851866.254588:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851866.254589:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.254590:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851866.254590:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c35eed52 x1858030968749632/t0(0) o400->b5e5d7f0-bbd8-457e-98e2-5ee38648e02a@15867@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne230-0'
00000100:00100000:15.0:1773851866.254594:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c35eed52 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b5e5d7f0-bbd8-457e-98e2-5ee38648e02a+6:47662:x1858030968749632:12345-15867@kfi7:400:default-tuolumne230-0 Request processed in 64us (95us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851866.254596:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15867@kfi7, seq: 2289825
00000100:00000040:15.0:1773851866.254597:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003e6c2702 : new rpc_count 0
00000800:00000200:13.0:1773851866.254597:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11a TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851866.254598:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851866.254598:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851866.254599:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851866.254599:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851866.254599:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15867@kfi7: PUT: OK
00000020:00000010:15.0:1773851866.254600:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000020:00000010:15.0:1773851866.254601:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000015c4406c.
00000400:00000200:13.0:1773851866.254601:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5868b8
00000020:00000040:15.0:1773851866.254602:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000003e6c2702 : new refcount 5
00000100:00000001:15.0:1773851866.254602:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851866.254602:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5868b8.
00000100:00000001:13.0:1773851866.254602:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851866.254603:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851866.254604:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000b7662b3 nid 15867@kfi7 refs 2
00000800:00000200:13.0:1773851866.254606:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 15867@kfi7(000000002cb556d7):0x0 lsk 283 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11a Transaction freed
00000800:00000200:1.0:1773851866.254770:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.254772:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851866.254774:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851866.254778:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851866.254782:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15866@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.254784:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15866@kfi7 : PUT - for me
00000400:00000200:1.0:1773851866.254786:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15866@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.254788:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3663e62 nid 15866@kfi7 refs 1
00000400:00000200:1.0:1773851866.254790:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15866@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.254791:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3663e62 nid 15866@kfi7 refs 2
00000400:00000200:1.0:1773851866.254793:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e3663e62 nid 15866@kfi7 refs 3
00000400:00000200:1.0:1773851866.254795:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15867@kfi7 to cpt 3
00000400:00000200:1.0:1773851866.254796:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15867@kfi7 of length 224 into portal 12 MB=0x699de8bdfc680
00000400:00000200:1.0:1773851866.254799:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15867@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 27160
00000800:00000200:1.0:1773851866.254803:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851866.254806:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.254808:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15866@kfi7: PUT: OK
00000100:00000001:1.0:1773851866.254809:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851866.254812:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851866.254813:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f00c0fc3.
00000100:00000040:1.0:1773851866.254815:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000f00c0fc3 x1858030968751744 msgsize 224
00000100:00100000:1.0:1773851866.254818:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-15867@kfi7 (source: 12345-15866@kfi7)
00000100:00000001:1.0:1773851866.254820:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851866.254822:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e3663e62 nid 15866@kfi7 refs 2
00000100:00000001:0.0:1773851866.254823:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851866.254824:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851866.254825:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851866.254825:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851866.254825:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851866.254827:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851866.254828:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968751744
00000020:00000001:0.0:1773851866.254829:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851866.254830:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91348
00000020:00000001:0.0:1773851866.254831:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851866.254836:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000098f74ad0 refcount=6
00000020:00000001:0.0:1773851866.254838:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169321472 : -107127540230144 : ffff9e916d04d800)
00000020:00000001:0.0:1773851866.254839:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169321472 : -107127540230144 : ffff9e916d04d800)
00000100:00000001:0.0:1773851866.254841:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.254842:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851866.254843:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851866.254845:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.254846:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851866.254848:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851866.254849:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851866.254850:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.254852:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851866.254853:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851866.254854:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.254855:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.254858:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.254859:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851866.254859:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851866.254860:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851866.254860:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15867@kfi7, seq: 1997552
00000100:00000001:1.0:1773851866.254862:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.254862:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000098f74ad0 : new rpc_count 1
00000100:00000001:1.0:1773851866.254863:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.254863:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599720320 : -107004109831296 : ffff9eae2a0b4380)
00000100:00000040:0.0:1773851866.254865:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f00c0fc3 x1858030968751744/t0(0) o400->9460cf00-8122-435b-b0c0-1a9f9ad016b5@15867@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne230-0'
00000100:00000001:0.0:1773851866.254870:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.254871:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851866.254873:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f00c0fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9460cf00-8122-435b-b0c0-1a9f9ad016b5+6:47663:x1858030968751744:12345-15867@kfi7:400:default-tuolumne230-0
00000100:00000200:0.0:1773851866.254875:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968751744
00000020:00000001:0.0:1773851866.254876:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851866.254878:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851866.254879:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.254880:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851866.254881:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851866.254882:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851866.254883:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968751744, found 0 last_xid 1858030968751743
00000020:00000001:0.0:1773851866.254885:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851866.254886:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851866.254887:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851866.254888:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.254889:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851866.254890:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851866.254890:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851866.254892:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2f13df2.
02000000:00000001:0.0:1773851866.254893:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.254896:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.254897:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851866.254898:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768059, transno 0, xid 1858030968751744
00010000:00000001:0.0:1773851866.254899:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851866.254901:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f00c0fc3 x1858030968751744/t0(0) o400->9460cf00-8122-435b-b0c0-1a9f9ad016b5@15867@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne230-0'
00010000:00000001:0.0:1773851866.254906:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851866.254907:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851866.254908:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=99 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851866.254910:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851866.254911:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053b178bb refcount 5 to 15867@kfi7
00000100:00000001:0.0:1773851866.254912:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299168 : -107155980252448 : ffff9e8acddc8ae0)
02000000:00000001:0.0:1773851866.254913:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851866.254914:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.254916:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851866.254917:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15866@kfi7
00000400:00000010:0.0:1773851866.254918:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b505966b.
00000100:00000200:0.0:1773851866.254919:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968751744, offset 224
00000400:00000200:0.0:1773851866.254922:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15866@kfi7
00000400:00000200:0.0:1773851866.254923:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15866@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.254925:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3663e62 nid 15866@kfi7 refs 1
00000400:00000200:0.0:1773851866.254927:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e3663e62 nid 15866@kfi7 refs 2
00000400:00000200:0.0:1773851866.254929:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e3663e62 nid 15866@kfi7 refs 3
00000400:00000200:0.0:1773851866.254931:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15866@kfi7 local destination
00000400:00000200:0.0:1773851866.254933:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769173:8769173:1024:4294967295] 15866@kfi7 LPNI seq info [24425:24425:16:4294967295]
00000400:00000200:0.0:1773851866.254936:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e3663e62 nid 15866@kfi7 refs 2
00000400:00000200:0.0:1773851866.254937:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15866@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.254941:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15866@kfi7(15866@kfi7:15866@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851866.254943:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e3663e62 nid 15866@kfi7 refs 3
00000800:00000200:0.0:1773851866.254946:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851866.254948:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851866.254956:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851866.254960:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bd4 Using peer 15866@kfi7(0x100000000000bd4)
00000800:00000200:0.0:1773851866.254966:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x100000000000bd4: rc=0
00000800:00000200:0.0:1773851866.254968:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bd4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851866.254972:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.254973:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053b178bb refcount 4 to 15867@kfi7
00010000:00000001:0.0:1773851866.254974:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851866.254977:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.254978:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851866.254979:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f00c0fc3 x1858030968751744/t0(0) o400->9460cf00-8122-435b-b0c0-1a9f9ad016b5@15867@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne230-0'
00000100:00100000:0.0:1773851866.254985:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f00c0fc3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:9460cf00-8122-435b-b0c0-1a9f9ad016b5+6:47663:x1858030968751744:12345-15867@kfi7:400:default-tuolumne230-0 Request processed in 113us (169us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851866.254988:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15867@kfi7, seq: 1997552
00000100:00000040:0.0:1773851866.254990:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000098f74ad0 : new rpc_count 0
00000100:00000001:0.0:1773851866.254991:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851866.254992:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851866.254992:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.254994:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851866.254995:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851866.254996:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000098f74ad0 : new refcount 5
00000100:00000001:0.0:1773851866.254997:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851866.255005:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bd4 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851866.255008:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.255009:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15866@kfi7: PUT: OK
00000400:00000200:1.0:1773851866.255011:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b505966b
00000400:00000010:1.0:1773851866.255012:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b505966b.
00000100:00000001:1.0:1773851866.255013:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851866.255013:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851866.255015:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e3663e62 nid 15866@kfi7 refs 2
00000800:00000200:1.0:1773851866.255017:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15866@kfi7(00000000893d784e):0x0 lsk 3029 rsk 91 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bd4 Transaction freed
00000800:00000200:5.0:1773851866.262976:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.262977:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851866.262979:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851866.262981:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851866.262982:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.262984:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17856@kfi7 : PUT - for me
00000400:00000200:5.0:1773851866.262985:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.262985:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 1
00000400:00000200:5.0:1773851866.262986:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.262987:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000400:00000200:5.0:1773851866.262988:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 3
00000400:00000200:5.0:1773851866.262988:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17857@kfi7 to cpt 4
00000400:00000200:5.0:1773851866.262989:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17857@kfi7 of length 224 into portal 12 MB=0x69b4b6df254c0
00000400:00000200:5.0:1773851866.262990:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17857@kfi7 of length 224/224 into md 0x793926dc5 [64] + 134552
00000800:00000200:5.0:1773851866.262992:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851866.262994:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851866.262994:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17856@kfi7: PUT: OK
00000100:00000001:5.0:1773851866.262995:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851866.262996:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851866.262996:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f690f3d.
00000100:00000040:5.0:1773851866.262997:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000007f690f3d x1859598129714368 msgsize 224
00000100:00100000:5.0:1773851866.262998:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-17857@kfi7 (source: 12345-17856@kfi7)
00000100:00000001:5.0:1773851866.263000:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851866.263001:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000800:00000200:5.0:1773851866.263002:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851866.263004:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851866.263005:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851866.263008:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851866.263008:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851866.263009:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851866.263010:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598129714368
00000020:00000001:5.0:1773851866.263010:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851866.263010:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d823f0
00000020:00000001:5.0:1773851866.263011:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851866.263015:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000efeb0282 refcount=5
00000020:00000001:5.0:1773851866.263015:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113519895552 : -106960189656064 : ffff9eb863e3f400)
00000020:00000001:5.0:1773851866.263016:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113519895552 : -106960189656064 : ffff9eb863e3f400)
00000100:00000001:5.0:1773851866.263017:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.263018:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851866.263018:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e0af6c38.
00000020:00000010:5.0:1773851866.263019:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.263020:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008260bf32.
00000100:00000001:5.0:1773851866.263021:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851866.263021:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851866.263022:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851866.263023:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851866.263023:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851866.263023:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.263024:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851866.263025:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851866.263026:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851866.263026:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851866.263026:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851866.263027:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851866.263027:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17857@kfi7, seq: 2001913
00000100:00000040:5.0:1773851866.263027:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000efeb0282 : new rpc_count 1
00000100:00000001:7.0:1773851866.263028:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.263028:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886763520 : -106955822788096 : ffff9eb9682d1200)
00000100:00000040:5.0:1773851866.263029:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007f690f3d x1859598129714368/t0(0) o400->3ad08b5b-2689-45cc-a13e-39e9ab54de14@17857@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1603-0'
00000100:00000001:5.0:1773851866.263031:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.263032:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851866.263032:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f690f3d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3ad08b5b-2689-45cc-a13e-39e9ab54de14+5:39744:x1859598129714368:12345-17857@kfi7:400:default-tuolumne1603-0
00000100:00000200:5.0:1773851866.263034:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598129714368
00000020:00000001:5.0:1773851866.263035:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851866.263035:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851866.263036:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.263036:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851866.263037:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851866.263037:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851866.263038:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598129714368, found 0 last_xid 1859598129714367
00000020:00000001:5.0:1773851866.263039:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851866.263039:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851866.263040:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851866.263040:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.263041:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851866.263042:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851866.263042:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851866.263043:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d851baa9.
02000000:00000001:5.0:1773851866.263043:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.263044:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.263045:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851866.263045:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596409, transno 0, xid 1859598129714368
00010000:00000001:5.0:1773851866.263046:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851866.263047:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007f690f3d x1859598129714368/t0(0) o400->3ad08b5b-2689-45cc-a13e-39e9ab54de14@17857@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1603-0'
00010000:00000001:5.0:1773851866.263049:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851866.263049:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851866.263050:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=98 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851866.263051:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851866.263052:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000f995cbf refcount 3 to 17857@kfi7
00000100:00000001:5.0:1773851866.263052:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583864192 : -107156125687424 : ffff9e8ac5316180)
02000000:00000001:5.0:1773851866.263053:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851866.263054:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.263054:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851866.263055:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17856@kfi7
00000400:00000010:5.0:1773851866.263055:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000014972f8a.
00000100:00000200:5.0:1773851866.263056:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598129714368, offset 224
00000400:00000200:5.0:1773851866.263057:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17856@kfi7
00000400:00000200:5.0:1773851866.263059:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.263059:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 1
00000400:00000200:5.0:1773851866.263061:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000400:00000200:5.0:1773851866.263061:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 3
00000400:00000200:5.0:1773851866.263063:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17856@kfi7 local destination
00000400:00000200:5.0:1773851866.263064:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769174:8769174:1024:4294967295] 17856@kfi7 LPNI seq info [3445351:3445351:16:4294967295]
00000400:00000200:5.0:1773851866.263065:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000400:00000200:5.0:1773851866.263066:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.263068:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17856@kfi7(17856@kfi7:17856@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851866.263069:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 3
00000800:00000200:5.0:1773851866.263070:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.263071:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851866.263072:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851866.263075:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa86 Using peer 17856@kfi7(0xa86)
00000800:00000200:5.0:1773851866.263077:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0xa86: rc=0
00000800:00000200:5.0:1773851866.263079:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa86 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851866.263081:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.263081:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000f995cbf refcount 2 to 17857@kfi7
00010000:00000001:5.0:1773851866.263082:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851866.263083:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.263083:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851866.263084:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f690f3d x1859598129714368/t0(0) o400->3ad08b5b-2689-45cc-a13e-39e9ab54de14@17857@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1603-0'
00000100:00100000:5.0:1773851866.263086:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f690f3d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3ad08b5b-2689-45cc-a13e-39e9ab54de14+5:39744:x1859598129714368:12345-17857@kfi7:400:default-tuolumne1603-0 Request processed in 54us (89us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851866.263089:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17857@kfi7, seq: 2001913
00000100:00000040:5.0:1773851866.263090:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000efeb0282 : new rpc_count 0
00000800:00000200:6.0:1773851866.263091:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa86 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851866.263091:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851866.263091:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851866.263092:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.263092:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008260bf32.
00000400:00000200:6.0:1773851866.263093:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851866.263093:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e0af6c38.
00000400:00000200:6.0:1773851866.263094:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17856@kfi7: PUT: OK
00000400:00000200:6.0:1773851866.263094:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000014972f8a
00000020:00000040:5.0:1773851866.263094:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000efeb0282 : new refcount 4
00000400:00000010:6.0:1773851866.263095:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000014972f8a.
00000100:00000001:6.0:1773851866.263095:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851866.263095:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851866.263096:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851866.263096:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000800:00000200:6.0:1773851866.263098:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 17856@kfi7(0000000047f14582):0x0 lsk 2695 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa86 Transaction freed
00000800:00000200:13.0:1773851866.279513:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851866.279514:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851866.279515:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851866.279517:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851866.279519:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22323@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.279520:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22323@kfi7 : PUT - for me
00000400:00000200:13.0:1773851866.279521:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22323@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.279523:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f54c10f nid 22323@kfi7 refs 1
00000400:00000200:13.0:1773851866.279524:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22323@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.279525:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f54c10f nid 22323@kfi7 refs 2
00000400:00000200:13.0:1773851866.279526:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005f54c10f nid 22323@kfi7 refs 3
00000400:00000200:13.0:1773851866.279527:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22514@kfi7 to cpt 2
00000400:00000200:13.0:1773851866.279528:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22514@kfi7 of length 224 into portal 12 MB=0x69aef8f4c38c0
00000400:00000200:13.0:1773851866.279529:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22514@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 26888
00000800:00000200:13.0:1773851866.279531:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851866.279532:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851866.279533:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22323@kfi7: PUT: OK
00000100:00000001:13.0:1773851866.279534:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851866.279535:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851866.279536:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f6765a2e.
00000100:00000040:13.0:1773851866.279536:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000f6765a2e x1859203552262336 msgsize 224
00000100:00100000:13.0:1773851866.279538:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22514@kfi7 (source: 12345-22323@kfi7)
00000100:00000001:13.0:1773851866.279539:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851866.279540:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005f54c10f nid 22323@kfi7 refs 2
00000100:00000001:15.0:1773851866.279541:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851866.279541:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851866.279542:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851866.279542:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2054@kfi7:3 <- 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851866.279543:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851866.279543:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851866.279544:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859203552262336
00000020:00000001:15.0:1773851866.279545:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851866.279545:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ea1
00000020:00000001:15.0:1773851866.279546:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851866.279550:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e1c8effe refcount=6
00000020:00000001:15.0:1773851866.279551:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629018624 : -107123080532992 : ffff9e9276d66c00)
00000020:00000001:15.0:1773851866.279552:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629018624 : -107123080532992 : ffff9e9276d66c00)
00000100:00000001:15.0:1773851866.279552:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851866.279553:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851866.279554:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000015c4406c.
00000020:00000010:15.0:1773851866.279555:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851866.279556:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851866.279556:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851866.279557:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851866.279557:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851866.279558:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851866.279559:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851866.279559:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.279560:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851866.279561:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851866.279561:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851866.279562:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851866.279562:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851866.279563:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22514@kfi7, seq: 2289826
00000100:00000040:15.0:1773851866.279563:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e1c8effe : new rpc_count 1
00000100:00000001:13.0:1773851866.279563:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.279564:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123338775808 : -106950370775808 : ffff9ebaad242d00)
00000100:00000001:13.0:1773851866.279564:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851866.279565:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f6765a2e x1859203552262336/t0(0) o400->5e2b9d3f-4949-45a9-952b-76188e1d8cac@22514@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1881-0'
00000100:00000001:15.0:1773851866.279568:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851866.279569:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851866.279569:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6765a2e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:5e2b9d3f-4949-45a9-952b-76188e1d8cac+6:39708:x1859203552262336:12345-22514@kfi7:400:default-tuolumne1881-0
00000100:00000200:15.0:1773851866.279571:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859203552262336
00000020:00000001:15.0:1773851866.279572:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851866.279573:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851866.279573:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.279574:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851866.279574:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851866.279575:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851866.279576:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859203552262336, found 0 last_xid 1859203552262335
00000020:00000001:15.0:1773851866.279577:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851866.279577:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851866.279578:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851866.279578:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.279579:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851866.279579:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851866.279580:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851866.279580:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002b762ff1.
02000000:00000001:15.0:1773851866.279581:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.279581:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.279582:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851866.279583:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252857852, transno 0, xid 1859203552262336
00010000:00000001:15.0:1773851866.279583:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851866.279584:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f6765a2e x1859203552262336/t0(0) o400->5e2b9d3f-4949-45a9-952b-76188e1d8cac@22514@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1881-0'
00010000:00000001:15.0:1773851866.279586:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851866.279587:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851866.279588:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=99 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851866.279589:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851866.279589:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f44337d2 refcount 3 to 22514@kfi7
00000100:00000001:15.0:1773851866.279590:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074983264 : -107155634568352 : ffff9e8ae2774360)
02000000:00000001:15.0:1773851866.279591:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851866.279591:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.279592:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851866.279593:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22323@kfi7
00000400:00000010:15.0:1773851866.279594:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5868b8.
00000100:00000200:15.0:1773851866.279594:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859203552262336, offset 224
00000400:00000200:15.0:1773851866.279596:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22323@kfi7
00000400:00000200:15.0:1773851866.279597:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22323@kfi7 to cpt 3
00000400:00000200:15.0:1773851866.279598:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f54c10f nid 22323@kfi7 refs 1
00000400:00000200:15.0:1773851866.279599:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005f54c10f nid 22323@kfi7 refs 2
00000400:00000200:15.0:1773851866.279600:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005f54c10f nid 22323@kfi7 refs 3
00000400:00000200:15.0:1773851866.279601:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22323@kfi7 local destination
00000400:00000200:15.0:1773851866.279603:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769175:8769175:1024:4294967295] 22323@kfi7 LPNI seq info [9519156:9519156:16:4294967295]
00000400:00000200:15.0:1773851866.279604:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005f54c10f nid 22323@kfi7 refs 2
00000400:00000200:15.0:1773851866.279605:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22323@kfi7 to cpt 3
00000400:00000200:15.0:1773851866.279607:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22323@kfi7(22323@kfi7:22323@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851866.279608:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005f54c10f nid 22323@kfi7 refs 3
00000800:00000200:15.0:1773851866.279609:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851866.279610:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851866.279612:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851866.279615:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004f3 Using peer 22323@kfi7(0x1000000000004f3)
00000800:00000200:15.0:1773851866.279617:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x1000000000004f3: rc=0
00000800:00000200:15.0:1773851866.279619:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851866.279621:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851866.279622:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f44337d2 refcount 2 to 22514@kfi7
00010000:00000001:15.0:1773851866.279622:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851866.279623:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851866.279624:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851866.279624:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f6765a2e x1859203552262336/t0(0) o400->5e2b9d3f-4949-45a9-952b-76188e1d8cac@22514@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1881-0'
00000100:00100000:15.0:1773851866.279627:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6765a2e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:5e2b9d3f-4949-45a9-952b-76188e1d8cac+6:39708:x1859203552262336:12345-22514@kfi7:400:default-tuolumne1881-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851866.279631:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004f3 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851866.279632:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22514@kfi7, seq: 2289826
00000400:00000200:13.0:1773851866.279632:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:15.0:1773851866.279633:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e1c8effe : new rpc_count 0
00000400:00000200:13.0:1773851866.279633:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22323@kfi7: PUT: OK
00000100:00000001:15.0:1773851866.279634:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851866.279634:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851866.279634:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5868b8
00000020:00000010:15.0:1773851866.279635:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851866.279635:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000400:00000010:13.0:1773851866.279635:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5868b8.
00000020:00000010:15.0:1773851866.279636:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000015c4406c.
00000100:00000001:13.0:1773851866.279636:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851866.279636:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:15.0:1773851866.279637:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000e1c8effe : new refcount 5
00000400:00000200:13.0:1773851866.279637:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005f54c10f nid 22323@kfi7 refs 2
00000100:00000001:15.0:1773851866.279638:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851866.279638:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22323@kfi7(00000000ac436306):0x0 lsk 1268 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004f3 Transaction freed
00000800:00000200:17.0:1773851866.354299:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.354300:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.354301:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.354303:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.354305:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26193@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.354307:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26193@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.354308:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26193@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.354309:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025aee892 nid 26193@kfi7 refs 1
00000400:00000200:17.0:1773851866.354310:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26193@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.354311:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025aee892 nid 26193@kfi7 refs 2
00000400:00000200:17.0:1773851866.354312:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000025aee892 nid 26193@kfi7 refs 3
00000400:00000200:17.0:1773851866.354313:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000400:00000200:17.0:1773851866.354314:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26256@kfi7 of length 224 into portal 12 MB=0x699e114da3740
00000400:00000200:17.0:1773851866.354315:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26256@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 8312
00000800:00000200:17.0:1773851866.354317:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.354319:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.354320:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26193@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.354321:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.354321:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.354322:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c6bca9d.
00000100:00000040:17.0:1773851866.354323:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009c6bca9d x1858041856800576 msgsize 224
00000100:00100000:17.0:1773851866.354325:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26256@kfi7 (source: 12345-26193@kfi7)
00000100:00000001:17.0:1773851866.354326:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.354327:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000025aee892 nid 26193@kfi7 refs 2
00000800:00000200:17.0:1773851866.354329:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.354331:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.354332:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.354332:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.354333:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.354334:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.354334:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041856800576
00000020:00000001:17.0:1773851866.354335:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.354335:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92fd4
00000020:00000001:17.0:1773851866.354336:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.354338:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009f141c83 refcount=6
00000020:00000001:17.0:1773851866.354339:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744908800 : -107128964642816 : ffff9e91181e0800)
00000020:00000001:17.0:1773851866.354340:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744908800 : -107128964642816 : ffff9e91181e0800)
00000100:00000001:17.0:1773851866.354341:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.354341:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.354342:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.354343:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.354344:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.354345:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.354345:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.354346:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.354346:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.354347:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.354347:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.354348:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.354349:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.354350:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.354350:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.354350:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.354351:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26256@kfi7, seq: 2156314
00000100:00000040:17.0:1773851866.354351:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009f141c83 : new rpc_count 1
00000100:00000001:17.0:1773851866.354352:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093912960 : -107022615638656 : ffff9ea9db030d80)
00000100:00000001:16.0:1773851866.354352:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851866.354352:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.354353:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c6bca9d x1858041856800576/t0(0) o400->9d9ccb51-2ba2-4817-a4eb-36a0862f9213@26256@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2130-0'
00000100:00000001:17.0:1773851866.354356:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.354357:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.354358:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c6bca9d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:9d9ccb51-2ba2-4817-a4eb-36a0862f9213+6:39680:x1858041856800576:12345-26256@kfi7:400:default-tuolumne2130-0
00000100:00000200:17.0:1773851866.354359:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041856800576
00000020:00000001:17.0:1773851866.354360:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.354360:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.354361:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.354361:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.354362:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.354362:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.354363:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041856800576, found 0 last_xid 1858041856800575
00000020:00000001:17.0:1773851866.354363:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.354364:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.354364:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.354365:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.354366:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.354366:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.354366:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.354367:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fd6ddf99.
02000000:00000001:17.0:1773851866.354368:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.354368:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.354369:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.354369:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014000167, transno 0, xid 1858041856800576
00010000:00000001:17.0:1773851866.354370:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.354371:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c6bca9d x1858041856800576/t0(0) o400->9d9ccb51-2ba2-4817-a4eb-36a0862f9213@26256@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2130-0'
00010000:00000001:17.0:1773851866.354373:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.354373:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.354374:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.354375:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.354376:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004aebef4d refcount 3 to 26256@kfi7
00000100:00000001:17.0:1773851866.354376:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424334080 : -107145285217536 : ffff9e8d4b55d300)
02000000:00000001:17.0:1773851866.354378:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.354378:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.354379:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.354380:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26193@kfi7
00000400:00000010:17.0:1773851866.354380:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df4ad511.
00000100:00000200:17.0:1773851866.354381:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041856800576, offset 224
00000400:00000200:17.0:1773851866.354382:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26193@kfi7
00000400:00000200:17.0:1773851866.354383:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26193@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.354384:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025aee892 nid 26193@kfi7 refs 1
00000400:00000200:17.0:1773851866.354385:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000025aee892 nid 26193@kfi7 refs 2
00000400:00000200:17.0:1773851866.354386:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000025aee892 nid 26193@kfi7 refs 3
00000400:00000200:17.0:1773851866.354387:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26193@kfi7 local destination
00000400:00000200:17.0:1773851866.354388:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769176:8769176:1024:4294967295] 26193@kfi7 LPNI seq info [11404110:11404110:16:4294967295]
00000400:00000200:17.0:1773851866.354389:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000025aee892 nid 26193@kfi7 refs 2
00000400:00000200:17.0:1773851866.354390:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26193@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.354392:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26193@kfi7(26193@kfi7:26193@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.354393:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000025aee892 nid 26193@kfi7 refs 3
00000800:00000200:17.0:1773851866.354394:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.354395:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.354397:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.354399:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf31 Using peer 26193@kfi7(0xf31)
00000800:00000200:17.0:1773851866.354403:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0xf31: rc=0
00000800:00000200:17.0:1773851866.354404:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf31 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.354406:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.354407:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004aebef4d refcount 2 to 26256@kfi7
00010000:00000001:17.0:1773851866.354408:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.354408:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.354409:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.354410:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c6bca9d x1858041856800576/t0(0) o400->9d9ccb51-2ba2-4817-a4eb-36a0862f9213@26256@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2130-0'
00000100:00100000:17.0:1773851866.354413:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c6bca9d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:9d9ccb51-2ba2-4817-a4eb-36a0862f9213+6:39680:x1858041856800576:12345-26256@kfi7:400:default-tuolumne2130-0 Request processed in 56us (89us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.354416:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26256@kfi7, seq: 2156314
00000100:00000040:17.0:1773851866.354417:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009f141c83 : new rpc_count 0
00000100:00000001:17.0:1773851866.354417:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851866.354418:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf31 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851866.354418:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:18.0:1773851866.354419:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851866.354419:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.354419:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851866.354420:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26193@kfi7: PUT: OK
00000020:00000010:17.0:1773851866.354420:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000400:00000200:18.0:1773851866.354421:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df4ad511
00000400:00000010:18.0:1773851866.354421:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df4ad511.
00000020:00000040:17.0:1773851866.354421:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000009f141c83 : new refcount 5
00000100:00000001:18.0:1773851866.354422:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851866.354422:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851866.354423:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.354423:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000025aee892 nid 26193@kfi7 refs 2
00000800:00000200:18.0:1773851866.354425:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26193@kfi7(000000003b024b76):0x0 lsk 3890 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf31 Transaction freed
00000800:00000200:29.0:1773851866.382882:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851866.382883:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851866.382884:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851866.382886:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851866.382888:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.382890:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2074@kfi7 : PUT - for me
00000400:00000200:29.0:1773851866.382891:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.382891:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851866.382892:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.382894:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851866.382895:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851866.382896:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.382897:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee12680
00000400:00000200:29.0:1773851866.382899:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x77ec58b3d [256] + 21000
00000800:00000200:29.0:1773851866.382900:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851866.382902:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.382903:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2074@kfi7: PUT: OK
00000100:00000001:29.0:1773851866.382904:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851866.382905:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:29.0:1773851866.382906:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000242f3500.
00000100:00000040:29.0:1773851866.382907:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000242f3500 x1858059204896384 msgsize 224
00000100:00100000:29.0:1773851866.382910:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2074@kfi7)
00000100:00000001:29.0:1773851866.382912:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851866.382913:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851866.382915:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851866.382915:0:41218:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851866.382916:0:41218:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851866.382916:0:41218:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851866.382917:0:41218:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851866.382918:0:41218:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851866.382920:0:41218:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204896384
00000020:00000001:28.0:1773851866.382921:0:41218:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851866.382923:0:41218:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:28.0:1773851866.382924:0:41218:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851866.382925:0:41218:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:28.0:1773851866.382927:0:41218:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:28.0:1773851866.382928:0:41218:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:28.0:1773851866.382930:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851866.382931:0:41218:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851866.382932:0:41218:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000062db5345.
00000020:00000010:28.0:1773851866.382934:0:41218:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851866.382935:0:41218:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000040:28.0:1773851866.382937:0:41218:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:28.0:1773851866.382938:0:41218:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851866.382939:0:41218:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851866.382940:0:41218:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.382941:0:41218:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.382943:0:41218:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.382945:0:41218:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851866.382946:0:41218:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851866.382947:0:157090:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851866.382948:0:157090:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851866.382948:0:41218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 6571511
00000100:00000001:30.0:1773851866.382949:0:157090:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851866.382949:0:41218:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:28.0:1773851866.382950:0:41218:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343711104 : -106994365840512 : ffff9eb06ed4c380)
00000100:00000001:30.0:1773851866.382951:0:157090:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851866.382952:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000242f3500 x1858059204896384/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:28.0:1773851866.382958:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851866.382959:0:41218:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851866.382960:0:41218:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000242f3500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204896384:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:28.0:1773851866.382963:0:41218:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204896384
00000020:00000001:28.0:1773851866.382965:0:41218:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851866.382966:0:41218:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851866.382967:0:41218:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.382968:0:41218:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851866.382969:0:41218:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:28.0:1773851866.382971:0:41218:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:28.0:1773851866.382972:0:41218:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851866.382973:0:41218:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851866.382974:0:41218:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851866.382975:0:41218:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.382977:0:41218:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851866.382978:0:41218:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851866.382980:0:41218:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000053ab826b.
02000000:00000001:28.0:1773851866.382981:0:41218:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.382982:0:41218:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851866.382984:0:41218:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:28.0:1773851866.382985:0:41218:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:28.0:1773851866.382986:0:41218:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:28.0:1773851866.382988:0:41218:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:28.0:1773851866.382990:0:41218:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:28.0:1773851866.382992:0:41218:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851866.382993:0:41218:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204896384
00010000:00000001:28.0:1773851866.382994:0:41218:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851866.382996:0:41218:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000242f3500 x1858059204896384/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:28.0:1773851866.383000:0:41218:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851866.383001:0:41218:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851866.383002:0:41218:0:(import.c:1951:at_measured()) add 1 to 00000000f04ba3b2 time=120 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851866.383004:0:41218:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851866.383005:0:41218:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:28.0:1773851866.383007:0:41218:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:28.0:1773851866.383008:0:41218:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851866.383009:0:41218:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.383010:0:41218:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851866.383011:0:41218:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:28.0:1773851866.383012:0:41218:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000074a7a0bc.
00000100:00000200:28.0:1773851866.383014:0:41218:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204896384, offset 224
00000400:00000200:28.0:1773851866.383016:0:41218:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:28.0:1773851866.383018:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851866.383020:0:41218:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:28.0:1773851866.383021:0:41218:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851866.383024:0:41218:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851866.383026:0:41218:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851866.383029:0:41218:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769177:8769177:1024:4294967295] 2074@kfi7 LPNI seq info [23425166:23425166:16:4294967295]
00000400:00000200:28.0:1773851866.383031:0:41218:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851866.383032:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851866.383036:0:41218:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851866.383038:0:41218:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:28.0:1773851866.383040:0:41218:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851866.383042:0:41218:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:28.0:1773851866.383046:0:41218:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851866.383050:0:41218:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 Using peer 2074@kfi7(0x7a8)
00000800:00000200:28.0:1773851866.383055:0:41218:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015d39231: Posted send of 468 bytes to peer 0x7a8: rc=0
00000800:00000200:28.0:1773851866.383058:0:41218:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851866.383061:0:41218:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851866.383065:0:41218:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:28.0:1773851866.383066:0:41218:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851866.383066:0:41218:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.383067:0:41218:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851866.383069:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000242f3500 x1858059204896384/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:28.0:1773851866.383074:0:41218:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000242f3500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204896384:12345-2074@kfi7:41:default-yuba4-0 Request processed in 115us (165us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851866.383078:0:41218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 6571511
00000100:00000040:28.0:1773851866.383079:0:41218:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:28.0:1773851866.383080:0:41218:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851866.383093:0:41218:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851866.383094:0:41218:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851866.383095:0:41218:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851866.383097:0:41218:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000062db5345.
00000020:00000040:28.0:1773851866.383098:0:41218:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:28.0:1773851866.383099:0:41218:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851866.383107:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851866.383110:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.383111:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2074@kfi7: PUT: OK
00000400:00000200:29.0:1773851866.383112:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000074a7a0bc
00000400:00000010:29.0:1773851866.383113:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000074a7a0bc.
00000100:00000001:29.0:1773851866.383114:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851866.383115:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851866.383116:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851866.383119:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7a8 Transaction freed
00000800:00000200:17.0:1773851866.405426:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.405426:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.405428:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.405430:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.405432:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25808@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.405433:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25808@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.405434:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25808@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.405435:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055d84093 nid 25808@kfi7 refs 1
00000400:00000200:17.0:1773851866.405436:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25808@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.405436:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055d84093 nid 25808@kfi7 refs 2
00000400:00000200:17.0:1773851866.405438:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000055d84093 nid 25808@kfi7 refs 3
00000400:00000200:17.0:1773851866.405438:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25617@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.405439:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25617@kfi7 of length 224 into portal 12 MB=0x69b4b94274d40
00000400:00000200:17.0:1773851866.405441:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25617@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 8536
00000800:00000200:17.0:1773851866.405442:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.405444:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.405445:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25808@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.405446:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.405447:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.405447:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009b53f50a.
00000100:00000040:17.0:1773851866.405448:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009b53f50a x1859598770720064 msgsize 224
00000100:00100000:17.0:1773851866.405450:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25617@kfi7 (source: 12345-25808@kfi7)
00000100:00000001:17.0:1773851866.405451:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.405452:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000055d84093 nid 25808@kfi7 refs 2
00000800:00000200:17.0:1773851866.405453:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.405456:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.405456:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.405457:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.405457:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.405458:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.405459:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598770720064
00000020:00000001:17.0:1773851866.405459:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.405460:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3892271c
00000020:00000001:17.0:1773851866.405460:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.405463:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b158cde4 refcount=5
00000020:00000001:17.0:1773851866.405464:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097423014912 : -106976286536704 : ffff9eb4a4710c00)
00000020:00000001:17.0:1773851866.405464:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097423014912 : -106976286536704 : ffff9eb4a4710c00)
00000100:00000001:17.0:1773851866.405465:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.405466:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.405467:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.405468:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.405469:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.405470:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.405470:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.405471:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.405471:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.405472:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.405473:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.405473:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.405475:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.405475:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.405475:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.405475:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.405476:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25617@kfi7, seq: 2156315
00000100:00000040:17.0:1773851866.405477:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b158cde4 : new rpc_count 1
00000100:00000001:16.0:1773851866.405477:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.405478:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093922176 : -107022615629440 : ffff9ea9db033180)
00000100:00000001:16.0:1773851866.405478:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.405479:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009b53f50a x1859598770720064/t0(0) o400->167e6ab7-61a7-4ba7-a674-2913969de597@25617@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2097-0'
00000100:00000001:17.0:1773851866.405481:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.405482:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.405483:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b53f50a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:167e6ab7-61a7-4ba7-a674-2913969de597+5:39682:x1859598770720064:12345-25617@kfi7:400:default-tuolumne2097-0
00000100:00000200:17.0:1773851866.405484:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598770720064
00000020:00000001:17.0:1773851866.405485:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.405485:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.405486:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.405487:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.405487:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.405488:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.405488:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598770720064, found 0 last_xid 1859598770720063
00000020:00000001:17.0:1773851866.405489:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.405490:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.405491:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.405491:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.405492:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.405492:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.405493:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.405493:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008283bb59.
02000000:00000001:17.0:1773851866.405494:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.405495:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.405495:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.405496:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106669138, transno 0, xid 1859598770720064
00010000:00000001:17.0:1773851866.405497:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.405498:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009b53f50a x1859598770720064/t0(0) o400->167e6ab7-61a7-4ba7-a674-2913969de597@25617@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2097-0'
00010000:00000001:17.0:1773851866.405500:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.405501:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.405502:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.405503:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.405503:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001f9b7595 refcount 3 to 25617@kfi7
00000100:00000001:17.0:1773851866.405504:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583515648 : -107156126035968 : ffff9e8ac52c1000)
02000000:00000001:17.0:1773851866.405505:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.405506:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.405506:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.405507:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25808@kfi7
00000400:00000010:17.0:1773851866.405508:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d429eef8.
00000100:00000200:17.0:1773851866.405509:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598770720064, offset 224
00000400:00000200:17.0:1773851866.405510:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25808@kfi7
00000400:00000200:17.0:1773851866.405511:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25808@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.405511:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055d84093 nid 25808@kfi7 refs 1
00000400:00000200:17.0:1773851866.405512:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000055d84093 nid 25808@kfi7 refs 2
00000400:00000200:17.0:1773851866.405513:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000055d84093 nid 25808@kfi7 refs 3
00000400:00000200:17.0:1773851866.405515:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25808@kfi7 local destination
00000400:00000200:17.0:1773851866.405516:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769178:8769178:1024:4294967295] 25808@kfi7 LPNI seq info [85701:85701:16:4294967295]
00000400:00000200:17.0:1773851866.405517:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000055d84093 nid 25808@kfi7 refs 2
00000400:00000200:17.0:1773851866.405518:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25808@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.405520:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25808@kfi7(25808@kfi7:25808@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.405521:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000055d84093 nid 25808@kfi7 refs 3
00000800:00000200:17.0:1773851866.405522:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.405523:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.405525:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.405527:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae8 Using peer 25808@kfi7(0x100000000000ae8)
00000800:00000200:17.0:1773851866.405531:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x100000000000ae8: rc=0
00000800:00000200:17.0:1773851866.405532:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.405534:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.405535:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001f9b7595 refcount 2 to 25617@kfi7
00010000:00000001:17.0:1773851866.405536:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.405536:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.405537:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.405537:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009b53f50a x1859598770720064/t0(0) o400->167e6ab7-61a7-4ba7-a674-2913969de597@25617@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2097-0'
00000100:00100000:17.0:1773851866.405540:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b53f50a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:167e6ab7-61a7-4ba7-a674-2913969de597+5:39682:x1859598770720064:12345-25617@kfi7:400:default-tuolumne2097-0 Request processed in 58us (91us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.405543:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25617@kfi7, seq: 2156315
00000100:00000040:17.0:1773851866.405544:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b158cde4 : new rpc_count 0
00000800:00000200:18.0:1773851866.405545:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae8 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851866.405545:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851866.405545:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:18.0:1773851866.405546:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851866.405546:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.405546:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851866.405547:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25808@kfi7: PUT: OK
00000020:00000010:17.0:1773851866.405547:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000400:00000200:18.0:1773851866.405548:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d429eef8
00000400:00000010:18.0:1773851866.405548:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d429eef8.
00000020:00000040:17.0:1773851866.405548:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000b158cde4 : new refcount 4
00000100:00000001:18.0:1773851866.405549:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.405549:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851866.405549:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851866.405550:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000055d84093 nid 25808@kfi7 refs 2
00000800:00000200:18.0:1773851866.405551:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25808@kfi7(000000002f241506):0x0 lsk 2793 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ae8 Transaction freed
00000800:00000200:1.0:1773851866.410712:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.410713:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851866.410715:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851866.410719:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851866.410722:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.410724:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8698@kfi7 : PUT - for me
00000400:00000200:1.0:1773851866.410730:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.410731:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 1
00000400:00000200:1.0:1773851866.410733:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.410735:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000400:00000200:1.0:1773851866.410737:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 3
00000400:00000200:1.0:1773851866.410738:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.410740:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8698@kfi7 of length 224 into portal 12 MB=0x699df02cfaf80
00000400:00000200:1.0:1773851866.410742:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8698@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 27384
00000800:00000200:1.0:1773851866.410745:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851866.410748:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.410749:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8698@kfi7: PUT: OK
00000100:00000001:1.0:1773851866.410751:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851866.410752:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851866.410753:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000062d7e265.
00000100:00000040:1.0:1773851866.410754:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000062d7e265 x1858032964185984 msgsize 224
00000100:00100000:1.0:1773851866.410756:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8698@kfi7 (source: 12345-8698@kfi7)
00000100:00000001:1.0:1773851866.410758:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851866.410759:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000100:00000001:0.0:1773851866.410761:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851866.410761:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851866.410762:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851866.410762:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851866.410763:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851866.410764:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851866.410766:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858032964185984
00000020:00000001:0.0:1773851866.410767:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851866.410767:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91150
00000020:00000001:0.0:1773851866.410768:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851866.410770:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de46831c refcount=6
00000020:00000001:0.0:1773851866.410771:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240334336 : -107152469217280 : ffff9e8b9f22b000)
00000020:00000001:0.0:1773851866.410773:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240334336 : -107152469217280 : ffff9e8b9f22b000)
00000100:00000001:0.0:1773851866.410774:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.410775:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851866.410776:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851866.410778:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.410779:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851866.410780:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851866.410781:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851866.410782:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.410783:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851866.410784:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851866.410785:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.410786:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.410788:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.410789:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.410789:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851866.410789:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851866.410790:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8698@kfi7, seq: 1997553
00000100:00000001:1.0:1773851866.410792:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.410792:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de46831c : new rpc_count 1
00000100:00000001:1.0:1773851866.410793:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.410793:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599708800 : -107004109842816 : ffff9eae2a0b1680)
00000100:00000040:0.0:1773851866.410795:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000062d7e265 x1858032964185984/t0(0) o400->35cfa77e-79ff-484e-b35e-113984beb068@8698@kfi7:506/0 lens 224/0 e 0 to 0 dl 1773852621 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne202-0'
00000100:00000001:0.0:1773851866.410799:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.410800:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851866.410801:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062d7e265 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:35cfa77e-79ff-484e-b35e-113984beb068+6:49878:x1858032964185984:12345-8698@kfi7:400:default-tuolumne202-0
00000100:00000200:0.0:1773851866.410804:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858032964185984
00000020:00000001:0.0:1773851866.410805:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851866.410806:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851866.410807:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.410808:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851866.410809:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851866.410810:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851866.410811:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858032964185984, found 0 last_xid 1858032964185983
00000020:00000001:0.0:1773851866.410812:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851866.410813:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851866.410814:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851866.410815:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.410816:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851866.410817:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851866.410817:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851866.410819:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000410157a7.
02000000:00000001:0.0:1773851866.410820:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.410821:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.410822:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851866.410823:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 172263803199, transno 0, xid 1858032964185984
00010000:00000001:0.0:1773851866.410824:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851866.410825:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000062d7e265 x1858032964185984/t0(0) o400->35cfa77e-79ff-484e-b35e-113984beb068@8698@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne202-0'
00010000:00000001:0.0:1773851866.410830:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851866.410830:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851866.410831:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=99 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851866.410833:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851866.410834:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dc59ba28 refcount 5 to 8698@kfi7
00000100:00000001:0.0:1773851866.410835:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049760 : -107154804501856 : ffff9e8b13f112a0)
02000000:00000001:0.0:1773851866.410837:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851866.410838:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.410839:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851866.410840:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8698@kfi7
00000400:00000010:0.0:1773851866.410841:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b505966b.
00000100:00000200:0.0:1773851866.410842:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858032964185984, offset 224
00000400:00000200:0.0:1773851866.410845:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8698@kfi7
00000400:00000200:0.0:1773851866.410846:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.410847:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 1
00000400:00000200:0.0:1773851866.410850:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000400:00000200:0.0:1773851866.410852:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 3
00000400:00000200:0.0:1773851866.410854:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8698@kfi7 local destination
00000400:00000200:0.0:1773851866.410856:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769179:8769179:1024:4294967295] 8698@kfi7 LPNI seq info [27977:27977:16:4294967295]
00000400:00000200:0.0:1773851866.410859:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000400:00000200:0.0:1773851866.410860:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.410863:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8698@kfi7(8698@kfi7:8698@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851866.410865:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 3
00000800:00000200:0.0:1773851866.410867:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851866.410869:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851866.410873:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851866.410877:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000001c8 Using peer 8698@kfi7(0x1000000000001c8)
00000800:00000200:0.0:1773851866.410881:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x1000000000001c8: rc=0
00000800:00000200:0.0:1773851866.410884:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000001c8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851866.410887:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.410888:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dc59ba28 refcount 4 to 8698@kfi7
00010000:00000001:0.0:1773851866.410889:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851866.410890:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.410893:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851866.410894:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000062d7e265 x1858032964185984/t0(0) o400->35cfa77e-79ff-484e-b35e-113984beb068@8698@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne202-0'
00000100:00100000:0.0:1773851866.410900:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062d7e265 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:35cfa77e-79ff-484e-b35e-113984beb068+6:49878:x1858032964185984:12345-8698@kfi7:400:default-tuolumne202-0 Request processed in 99us (145us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851866.410904:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8698@kfi7, seq: 1997553
00000100:00000040:0.0:1773851866.410905:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de46831c : new rpc_count 0
00000100:00000001:0.0:1773851866.410907:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851866.410908:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851866.410909:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.410910:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851866.410912:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851866.410913:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000de46831c : new refcount 5
00000100:00000001:0.0:1773851866.410914:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851866.410923:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000001c8 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851866.410926:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.410928:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8698@kfi7: PUT: OK
00000400:00000200:1.0:1773851866.410930:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b505966b
00000400:00000010:1.0:1773851866.410931:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b505966b.
00000100:00000001:1.0:1773851866.410932:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851866.410933:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851866.410934:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000800:00000200:1.0:1773851866.410937:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8698@kfi7(0000000057c39c7e):0x0 lsk 457 rsk 242 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000001c8 Transaction freed
00000004:00000001:7.0:1773851866.441730:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851866.441730:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851866.441731:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a2bedac.
00000020:00000040:7.0:1773851866.441732:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851866.441733:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851866.441733:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851866.441734:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851866.441735:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006acbc7d7.
00000100:00000001:7.0:1773851866.441736:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851866.441739:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851866.441740:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851866.441741:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007a2bedac] to pc [ptlrpcd_01_01+1]  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851866.441746:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851866.441746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851866.441747:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851866.441747:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851866.441747:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:7.0:1773851866.441748:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000077b7cdda.
00080000:00000001:7.0:1773851866.441748:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637096524370944 : -106977185180672 : ffff9eb46ee0d400)
00000100:00000001:5.0:1773851866.441748:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851866.441748:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851866.441749:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:7.0:1773851866.441750:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:7.0:1773851866.441751:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000004:00000010:7.0:1773851866.441752:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004233db33.
00000004:00080000:7.0:1773851866.441753:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614140895028121ns, next at 614141895027029ns, rc = 0
00080000:00000001:7.0:1773851866.441754:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:7.0:1773851866.441754:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851866.441755:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851866.441762:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851866.441762:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851866.441763:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851866.441763:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851866.441764:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a2bedac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051927872:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851866.441765:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851866.441766:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851866.441767:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851866.441767:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851866.441768:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000655a9ee6.
02000000:00000001:4.0:1773851866.441769:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851866.441770:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:4.0:1773851866.441770:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000400:00000010:4.0:1773851866.441771:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:4.0:1773851866.441772:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927872, portal 4
00000100:00000001:4.0:1773851866.441773:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851866.441774:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309125888 : -106994400425728 : ffff9eb06cc50900)
00000100:00000040:4.0:1773851866.441775:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851866.441777:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851866.441778:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851866.441778:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da924145.
00000100:00000200:4.0:1773851866.441779:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927872, offset 0
00000400:00000200:4.0:1773851866.441780:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851866.441781:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851866.441782:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851866.441783:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851866.441784:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851866.441785:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851866.441787:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769177, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769179, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851866.441788:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851866.441789:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851866.441790:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851866.441791:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769180:8769180:1024:4294967295] 2099@kfi7 LPNI seq info [5403430:5403430:16:4294967295]
00000400:00000200:4.0:1773851866.441793:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851866.441793:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851866.441795:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851866.441796:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851866.441798:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851866.441799:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851866.441801:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851866.441804:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Using peer 2099@kfi7(0x2c1)
00000800:00000200:4.0:1773851866.441807:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x2c1: rc=0
00000800:00000200:4.0:1773851866.441808:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851866.441811:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851866.441811:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851866.441812:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851866.441812:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851866.441815:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851866.441816:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851866.441816:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851866.441817:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851866.441817:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851866.441820:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851866.441821:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851866.441821:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851866.441823:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851866.441824:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851866.441825:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da924145
00000400:00000010:5.0:1773851866.441825:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da924145.
00000100:00000001:5.0:1773851866.441826:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851866.441827:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851866.441830:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851866.441830:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851866.441833:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.441833:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851866.441834:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851866.441836:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Transaction freed
00000800:00000200:17.0:1773851866.441854:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.441855:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.441857:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.441859:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.441861:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.441862:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.441863:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.441865:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851866.441866:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.441866:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851866.441867:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851866.441868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.441869:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3540
00000400:00000200:17.0:1773851866.441870:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.441871:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f0fb1 [1] + 224
00000800:00000200:17.0:1773851866.441873:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.441875:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.441876:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.441877:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851866.441878:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851866.441881:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851866.441885:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.441886:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851866.441887:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851866.441887:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851866.441888:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851866.441888:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851866.441889:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851866.441890:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
00000400:00000200:4.0:1773851866.441890:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:4.0:1773851866.441891:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:4.0:1773851866.441892:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851866.441893:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851866.441896:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851866.441898:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851866.441899:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851866.441899:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851866.441900:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851866.441900:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851866.441901:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851866.441901:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851866.441902:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=99 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851866.441903:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=99 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851866.441904:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851866.441904:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851866.441905:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851866.441906:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851866.441907:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851866.441907:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851866.441908:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851866.441908:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851866.441909:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851866.441911:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851866.441912:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851866.441912:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851866.441913:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851866.441914:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851866.441914:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409140736 avail=351407087616 avail_mb=1372683936 hwm_mb=3131101 files=372011338 ffree=343172989 state=0: rc = 0
00000004:00000020:4.0:1773851866.441916:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409140736 free, 351407087616 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011338 files, 343172989 free files
00000004:00000001:4.0:1773851866.441917:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851866.441919:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851866.441921:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a2bedac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051927872:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851866.441923:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851866.441923:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851866.441924:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007a2bedac x1859433051927872/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851866.441926:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851866.441926:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851866.441927:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000655a9ee6.
02000000:00000001:4.0:1773851866.441928:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851866.441928:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851866.441929:0:41065:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851866.441929:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851866.441930:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006acbc7d7.
02000000:00000001:4.0:1773851866.441931:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851866.441931:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851866.441931:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a2bedac.
00000100:00000001:4.0:1773851866.441932:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851866.441933:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851866.441933:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851866.441934:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851866.441934:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851866.441934:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851866.441935:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851866.445109:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.445110:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.445112:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.445114:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.445116:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17234@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.445117:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17234@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.445118:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17234@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.445119:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097ae39f8 nid 17234@kfi7 refs 1
00000400:00000200:17.0:1773851866.445121:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17234@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.445122:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097ae39f8 nid 17234@kfi7 refs 2
00000400:00000200:17.0:1773851866.445123:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000097ae39f8 nid 17234@kfi7 refs 3
00000400:00000200:17.0:1773851866.445124:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17298@kfi7 to cpt 0
00000400:00000200:17.0:1773851866.445124:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17298@kfi7 of length 224 into portal 12 MB=0x69b4b5b807300
00000400:00000200:17.0:1773851866.445126:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17298@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 8760
00000800:00000200:17.0:1773851866.445128:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.445129:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.445130:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17234@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.445131:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.445132:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.445133:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b337f3ac.
00000100:00000040:17.0:1773851866.445133:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b337f3ac x1859597820261120 msgsize 224
00000100:00100000:17.0:1773851866.445135:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-17298@kfi7 (source: 12345-17234@kfi7)
00000100:00000001:17.0:1773851866.445136:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.445137:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000097ae39f8 nid 17234@kfi7 refs 2
00000800:00000200:17.0:1773851866.445138:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.445141:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.445142:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.445142:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.445143:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.445144:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.445145:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597820261120
00000020:00000001:17.0:1773851866.445146:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.445146:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8135e
00000020:00000001:17.0:1773851866.445147:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.445150:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000df2d39ca refcount=5
00000020:00000001:17.0:1773851866.445151:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110101421056 : -106963608130560 : ffff9eb798222c00)
00000020:00000001:17.0:1773851866.445152:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110101421056 : -106963608130560 : ffff9eb798222c00)
00000100:00000001:17.0:1773851866.445153:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.445154:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.445155:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.445156:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.445158:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.445159:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.445159:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.445160:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.445161:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.445161:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.445162:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.445163:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.445164:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.445165:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.445165:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.445165:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.445166:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17298@kfi7, seq: 2156316
00000100:00000040:17.0:1773851866.445167:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000df2d39ca : new rpc_count 1
00000100:00000001:17.0:1773851866.445167:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093923328 : -107022615628288 : ffff9ea9db033600)
00000100:00000001:16.0:1773851866.445167:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851866.445168:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.445169:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b337f3ac x1859597820261120/t0(0) o400->bcc5e081-e0b7-46db-bd1d-7451a77fbd05@17298@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1574-0'
00000100:00000001:17.0:1773851866.445171:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.445172:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.445173:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b337f3ac pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:bcc5e081-e0b7-46db-bd1d-7451a77fbd05+5:39562:x1859597820261120:12345-17298@kfi7:400:default-tuolumne1574-0
00000100:00000200:17.0:1773851866.445174:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597820261120
00000020:00000001:17.0:1773851866.445175:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.445176:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.445177:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.445177:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.445178:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.445179:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.445179:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597820261120, found 0 last_xid 1859597820261119
00000020:00000001:17.0:1773851866.445180:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.445181:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.445182:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.445182:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.445184:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.445184:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.445185:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.445186:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007673a8ee.
02000000:00000001:17.0:1773851866.445187:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.445187:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.445188:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.445189:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183019646769, transno 0, xid 1859597820261120
00010000:00000001:17.0:1773851866.445190:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.445191:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b337f3ac x1859597820261120/t0(0) o400->bcc5e081-e0b7-46db-bd1d-7451a77fbd05@17298@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1574-0'
00010000:00000001:17.0:1773851866.445194:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.445195:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.445196:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.445197:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.445198:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000068f193bd refcount 3 to 17298@kfi7
00000100:00000001:17.0:1773851866.445198:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002560 : -107146751549056 : ffff9e8cf3ef6180)
02000000:00000001:17.0:1773851866.445199:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.445200:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.445201:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.445201:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17234@kfi7
00000400:00000010:17.0:1773851866.445202:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000079b3bb7.
00000100:00000200:17.0:1773851866.445203:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597820261120, offset 224
00000400:00000200:17.0:1773851866.445205:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17234@kfi7
00000400:00000200:17.0:1773851866.445205:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17234@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.445206:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097ae39f8 nid 17234@kfi7 refs 1
00000400:00000200:17.0:1773851866.445207:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000097ae39f8 nid 17234@kfi7 refs 2
00000400:00000200:17.0:1773851866.445208:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000097ae39f8 nid 17234@kfi7 refs 3
00000400:00000200:17.0:1773851866.445209:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17234@kfi7 local destination
00000400:00000200:17.0:1773851866.445211:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769181:8769181:1024:4294967295] 17234@kfi7 LPNI seq info [443420:443420:16:4294967295]
00000400:00000200:17.0:1773851866.445212:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000097ae39f8 nid 17234@kfi7 refs 2
00000400:00000200:17.0:1773851866.445213:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17234@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.445215:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17234@kfi7(17234@kfi7:17234@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.445218:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000097ae39f8 nid 17234@kfi7 refs 3
00000800:00000200:17.0:1773851866.445220:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.445221:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.445222:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.445225:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa0a Using peer 17234@kfi7(0xa0a)
00000800:00000200:17.0:1773851866.445227:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0xa0a: rc=0
00000800:00000200:17.0:1773851866.445229:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa0a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.445231:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.445232:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000068f193bd refcount 2 to 17298@kfi7
00010000:00000001:17.0:1773851866.445232:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.445233:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.445234:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.445234:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b337f3ac x1859597820261120/t0(0) o400->bcc5e081-e0b7-46db-bd1d-7451a77fbd05@17298@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1574-0'
00000100:00100000:17.0:1773851866.445237:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b337f3ac pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:bcc5e081-e0b7-46db-bd1d-7451a77fbd05+5:39562:x1859597820261120:12345-17298@kfi7:400:default-tuolumne1574-0 Request processed in 65us (103us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.445239:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17298@kfi7, seq: 2156316
00000100:00000040:17.0:1773851866.445240:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000df2d39ca : new rpc_count 0
00000100:00000001:17.0:1773851866.445241:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851866.445242:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa0a TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851866.445242:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851866.445242:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.445243:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851866.445244:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851866.445244:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000400:00000200:18.0:1773851866.445245:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17234@kfi7: PUT: OK
00000020:00000040:17.0:1773851866.445245:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000df2d39ca : new refcount 4
00000100:00000001:17.0:1773851866.445245:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851866.445246:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000079b3bb7
00000400:00000010:18.0:1773851866.445246:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000079b3bb7.
00000100:00000001:18.0:1773851866.445247:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.445248:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.445249:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000097ae39f8 nid 17234@kfi7 refs 2
00000800:00000200:18.0:1773851866.445250:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 17234@kfi7(000000003ff88d65):0x0 lsk 2571 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa0a Transaction freed
00000800:00000200:1.0:1773851866.446041:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.446042:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851866.446043:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851866.446045:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851866.446047:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22466@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.446048:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22466@kfi7 : PUT - for me
00000400:00000200:1.0:1773851866.446049:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22466@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.446050:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000651d72e3 nid 22466@kfi7 refs 1
00000400:00000200:1.0:1773851866.446051:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22466@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.446052:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000651d72e3 nid 22466@kfi7 refs 2
00000400:00000200:1.0:1773851866.446053:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000651d72e3 nid 22466@kfi7 refs 3
00000400:00000200:1.0:1773851866.446053:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22275@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.446054:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22275@kfi7 of length 224 into portal 12 MB=0x69b4c41538880
00000400:00000200:1.0:1773851866.446056:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22275@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 27608
00000800:00000200:1.0:1773851866.446057:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851866.446059:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.446060:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22466@kfi7: PUT: OK
00000100:00000001:1.0:1773851866.446061:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851866.446062:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851866.446063:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006673466b.
00000100:00000040:1.0:1773851866.446063:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000006673466b x1859601676077184 msgsize 224
00000100:00100000:1.0:1773851866.446065:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22275@kfi7 (source: 12345-22466@kfi7)
00000100:00000001:1.0:1773851866.446066:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851866.446067:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000651d72e3 nid 22466@kfi7 refs 2
00000100:00000001:0.0:1773851866.446067:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851866.446068:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851866.446068:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851866.446068:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851866.446069:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851866.446070:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851866.446070:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601676077184
00000020:00000001:0.0:1773851866.446071:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851866.446071:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e61e25259
00000020:00000001:0.0:1773851866.446072:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851866.446074:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007695ce55 refcount=5
00000020:00000001:0.0:1773851866.446075:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111444187136 : -106962265364480 : ffff9eb7e82b2800)
00000020:00000001:0.0:1773851866.446076:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111444187136 : -106962265364480 : ffff9eb7e82b2800)
00000100:00000001:0.0:1773851866.446077:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.446077:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851866.446078:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851866.446079:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.446080:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851866.446080:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851866.446081:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851866.446081:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.446082:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851866.446083:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851866.446083:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.446084:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851866.446085:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851866.446085:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.446086:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851866.446086:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851866.446087:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22275@kfi7, seq: 1997554
00000100:00000040:0.0:1773851866.446088:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007695ce55 : new rpc_count 1
00000100:00000001:0.0:1773851866.446089:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599719168 : -107004109832448 : ffff9eae2a0b3f00)
00000100:00000001:1.0:1773851866.446090:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851866.446090:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.446090:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006673466b x1859601676077184/t0(0) o400->ee54ec4c-ace3-4bd7-bdcd-a156eafe12f5@22275@kfi7:506/0 lens 224/0 e 0 to 0 dl 1773852621 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1895-0'
00000100:00000001:0.0:1773851866.446093:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.446093:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851866.446094:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006673466b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ee54ec4c-ace3-4bd7-bdcd-a156eafe12f5+5:39498:x1859601676077184:12345-22275@kfi7:400:default-tuolumne1895-0
00000100:00000200:0.0:1773851866.446096:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601676077184
00000020:00000001:0.0:1773851866.446096:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851866.446097:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851866.446097:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.446098:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851866.446098:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851866.446099:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851866.446100:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601676077184, found 0 last_xid 1859601676077183
00000020:00000001:0.0:1773851866.446101:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851866.446101:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851866.446102:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851866.446102:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.446103:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851866.446103:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851866.446104:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851866.446105:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000136ed0e6.
02000000:00000001:0.0:1773851866.446106:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.446106:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.446107:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851866.446108:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182684910042, transno 0, xid 1859601676077184
00010000:00000001:0.0:1773851866.446108:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851866.446109:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006673466b x1859601676077184/t0(0) o400->ee54ec4c-ace3-4bd7-bdcd-a156eafe12f5@22275@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1895-0'
00010000:00000001:0.0:1773851866.446111:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851866.446112:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851866.446113:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=99 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851866.446115:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851866.446115:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000073e270d2 refcount 3 to 22275@kfi7
00000100:00000001:0.0:1773851866.446116:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958440640 : -107146751110976 : ffff9e8cf3f610c0)
02000000:00000001:0.0:1773851866.446117:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851866.446117:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.446118:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851866.446119:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22466@kfi7
00000400:00000010:0.0:1773851866.446120:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073d1c143.
00000100:00000200:0.0:1773851866.446120:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601676077184, offset 224
00000400:00000200:0.0:1773851866.446122:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22466@kfi7
00000400:00000200:0.0:1773851866.446123:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22466@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.446123:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000651d72e3 nid 22466@kfi7 refs 1
00000400:00000200:0.0:1773851866.446124:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000651d72e3 nid 22466@kfi7 refs 2
00000400:00000200:0.0:1773851866.446126:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000651d72e3 nid 22466@kfi7 refs 3
00000400:00000200:0.0:1773851866.446127:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22466@kfi7 local destination
00000400:00000200:0.0:1773851866.446128:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769182:8769182:1024:4294967295] 22466@kfi7 LPNI seq info [1228876:1228876:16:4294967295]
00000400:00000200:0.0:1773851866.446129:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000651d72e3 nid 22466@kfi7 refs 2
00000400:00000200:0.0:1773851866.446130:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22466@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.446132:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22466@kfi7(22466@kfi7:22466@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851866.446133:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000651d72e3 nid 22466@kfi7 refs 3
00000800:00000200:0.0:1773851866.446135:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851866.446136:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851866.446138:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851866.446140:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd4c Using peer 22466@kfi7(0xd4c)
00000800:00000200:0.0:1773851866.446142:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0xd4c: rc=0
00000800:00000200:0.0:1773851866.446144:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd4c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851866.446146:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.446147:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000073e270d2 refcount 2 to 22275@kfi7
00010000:00000001:0.0:1773851866.446148:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851866.446148:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.446149:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851866.446149:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006673466b x1859601676077184/t0(0) o400->ee54ec4c-ace3-4bd7-bdcd-a156eafe12f5@22275@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1895-0'
00000100:00100000:0.0:1773851866.446154:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006673466b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ee54ec4c-ace3-4bd7-bdcd-a156eafe12f5+5:39498:x1859601676077184:12345-22275@kfi7:400:default-tuolumne1895-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851866.446156:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22275@kfi7, seq: 1997554
00000100:00000040:0.0:1773851866.446157:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007695ce55 : new rpc_count 0
00000100:00000001:0.0:1773851866.446157:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851866.446158:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851866.446158:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.446159:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851866.446160:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851866.446161:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000007695ce55 : new refcount 4
00000100:00000001:0.0:1773851866.446161:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851866.446167:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd4c TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851866.446168:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.446169:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22466@kfi7: PUT: OK
00000400:00000200:1.0:1773851866.446170:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073d1c143
00000400:00000010:1.0:1773851866.446171:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073d1c143.
00000100:00000001:1.0:1773851866.446171:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851866.446172:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851866.446173:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000651d72e3 nid 22466@kfi7 refs 2
00000800:00000200:1.0:1773851866.446174:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 22466@kfi7(000000007ed17966):0x0 lsk 3405 rsk 11 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd4c Transaction freed
00000800:00000200:13.0:1773851866.452664:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851866.452664:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851866.452666:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851866.452668:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851866.452670:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24784@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.452671:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24784@kfi7 : PUT - for me
00000400:00000200:13.0:1773851866.452672:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24784@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.452673:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c97397c3 nid 24784@kfi7 refs 1
00000400:00000200:13.0:1773851866.452675:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24784@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.452675:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c97397c3 nid 24784@kfi7 refs 2
00000400:00000200:13.0:1773851866.452676:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c97397c3 nid 24784@kfi7 refs 3
00000400:00000200:13.0:1773851866.452677:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24593@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.452679:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24593@kfi7 of length 224 into portal 12 MB=0x699e0cc3bd940
00000400:00000200:13.0:1773851866.452681:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24593@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 27112
00000800:00000200:13.0:1773851866.452683:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851866.452684:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851866.452685:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24784@kfi7: PUT: OK
00000100:00000001:13.0:1773851866.452686:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851866.452687:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851866.452688:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc793554.
00000100:00000040:13.0:1773851866.452689:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000dc793554 x1858040638462272 msgsize 224
00000100:00100000:13.0:1773851866.452691:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24593@kfi7 (source: 12345-24784@kfi7)
00000100:00000001:13.0:1773851866.452692:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851866.452693:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851866.452693:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c97397c3 nid 24784@kfi7 refs 2
02000000:00000001:15.0:1773851866.452694:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851866.452694:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851866.452694:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851866.452695:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851866.452696:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851866.452697:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040638462272
00000020:00000001:15.0:1773851866.452697:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851866.452698:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d88
00000020:00000001:15.0:1773851866.452698:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851866.452703:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d95e4051 refcount=6
00000020:00000001:15.0:1773851866.452704:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744432640 : -107128965118976 : ffff9e911816c400)
00000020:00000001:15.0:1773851866.452705:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744432640 : -107128965118976 : ffff9e911816c400)
00000100:00000001:15.0:1773851866.452706:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851866.452707:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851866.452707:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000015c4406c.
00000020:00000010:15.0:1773851866.452708:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851866.452709:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851866.452710:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851866.452711:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851866.452711:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851866.452712:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851866.452712:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851866.452713:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851866.452714:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851866.452716:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851866.452716:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851866.452716:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851866.452716:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851866.452717:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24593@kfi7, seq: 2289827
00000100:00000001:15.0:1773851866.452718:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851866.452718:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d95e4051 : new rpc_count 1
00000100:00000001:15.0:1773851866.452719:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851866.452719:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970975488 : -107043738576128 : ffff9ea4effc9b00)
00000100:00000040:13.0:1773851866.452720:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dc793554 x1858040638462272/t0(0) o400->90bb9d69-9473-417d-8b0d-673ef84d0943@24593@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2033-0'
00000100:00000001:13.0:1773851866.452723:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851866.452723:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851866.452727:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc793554 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:90bb9d69-9473-417d-8b0d-673ef84d0943+6:39914:x1858040638462272:12345-24593@kfi7:400:default-tuolumne2033-0
00000100:00000200:13.0:1773851866.452728:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040638462272
00000020:00000001:13.0:1773851866.452729:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851866.452730:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851866.452731:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851866.452731:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851866.452732:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851866.452733:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851866.452734:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040638462272, found 0 last_xid 1858040638462271
00000020:00000001:13.0:1773851866.452735:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851866.452736:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851866.452736:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851866.452737:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851866.452737:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851866.452738:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851866.452739:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851866.452739:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006f314cb6.
02000000:00000001:13.0:1773851866.452740:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851866.452741:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851866.452742:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851866.452742:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044115928, transno 0, xid 1858040638462272
00010000:00000001:13.0:1773851866.452743:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851866.452744:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dc793554 x1858040638462272/t0(0) o400->90bb9d69-9473-417d-8b0d-673ef84d0943@24593@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2033-0'
00010000:00000001:13.0:1773851866.452746:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851866.452747:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851866.452748:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=99 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851866.452749:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851866.452750:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a1a89d52 refcount 3 to 24593@kfi7
00000100:00000001:13.0:1773851866.452750:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729300224 : -107155980251392 : ffff9e8acddc8f00)
02000000:00000001:13.0:1773851866.452751:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851866.452752:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851866.452752:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851866.452753:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24784@kfi7
00000400:00000010:13.0:1773851866.452754:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f88fa208.
00000100:00000200:13.0:1773851866.452755:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040638462272, offset 224
00000400:00000200:13.0:1773851866.452756:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24784@kfi7
00000400:00000200:13.0:1773851866.452757:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24784@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.452758:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c97397c3 nid 24784@kfi7 refs 1
00000400:00000200:13.0:1773851866.452759:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c97397c3 nid 24784@kfi7 refs 2
00000400:00000200:13.0:1773851866.452760:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c97397c3 nid 24784@kfi7 refs 3
00000400:00000200:13.0:1773851866.452762:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24784@kfi7 local destination
00000400:00000200:13.0:1773851866.452764:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769183:8769183:1024:4294967295] 24784@kfi7 LPNI seq info [10244613:10244613:16:4294967295]
00000400:00000200:13.0:1773851866.452765:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c97397c3 nid 24784@kfi7 refs 2
00000400:00000200:13.0:1773851866.452766:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24784@kfi7 to cpt 3
00000400:00000200:13.0:1773851866.452768:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24784@kfi7(24784@kfi7:24784@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851866.452769:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c97397c3 nid 24784@kfi7 refs 3
00000800:00000200:13.0:1773851866.452770:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851866.452772:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851866.452774:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851866.452776:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x62d Using peer 24784@kfi7(0x62d)
00000800:00000200:13.0:1773851866.452779:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 324 bytes to peer 0x62d: rc=0
00000800:00000200:13.0:1773851866.452781:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x62d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851866.452783:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851866.452784:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a1a89d52 refcount 2 to 24593@kfi7
00010000:00000001:13.0:1773851866.452784:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851866.452785:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851866.452785:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851866.452786:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dc793554 x1858040638462272/t0(0) o400->90bb9d69-9473-417d-8b0d-673ef84d0943@24593@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2033-0'
00000100:00100000:13.0:1773851866.452789:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc793554 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:90bb9d69-9473-417d-8b0d-673ef84d0943+6:39914:x1858040638462272:12345-24593@kfi7:400:default-tuolumne2033-0 Request processed in 65us (99us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851866.452792:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24593@kfi7, seq: 2289827
00000100:00000040:13.0:1773851866.452792:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d95e4051 : new rpc_count 0
00000100:00000001:13.0:1773851866.452793:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851866.452794:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:14.0:1773851866.452795:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x62d TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851866.452795:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:13.0:1773851866.452796:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000400:00000200:14.0:1773851866.452797:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851866.452797:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000015c4406c.
00000400:00000200:14.0:1773851866.452798:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24784@kfi7: PUT: OK
00000020:00000040:13.0:1773851866.452798:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000d95e4051 : new refcount 5
00000400:00000200:14.0:1773851866.452799:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f88fa208
00000100:00000001:13.0:1773851866.452799:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:14.0:1773851866.452800:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f88fa208.
00000100:00000001:14.0:1773851866.452800:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851866.452801:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851866.452802:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c97397c3 nid 24784@kfi7 refs 2
00000800:00000200:14.0:1773851866.452804:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 24784@kfi7(000000008e5b44b4):0x0 lsk 1582 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x62d Transaction freed
00000800:00000200:1.0:1773851866.571209:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.571210:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851866.571212:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851866.571214:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851866.571216:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13570@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.571217:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13570@kfi7 : PUT - for me
00000400:00000200:1.0:1773851866.571218:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13570@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.571219:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee7a4810 nid 13570@kfi7 refs 1
00000400:00000200:1.0:1773851866.571220:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13570@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.571221:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee7a4810 nid 13570@kfi7 refs 2
00000400:00000200:1.0:1773851866.571221:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee7a4810 nid 13570@kfi7 refs 3
00000400:00000200:1.0:1773851866.571222:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13570@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.571223:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13570@kfi7 of length 224 into portal 12 MB=0x69b4ba8d02640
00000400:00000200:1.0:1773851866.571225:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13570@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 27832
00000800:00000200:1.0:1773851866.571226:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851866.571228:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.571230:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13570@kfi7: PUT: OK
00000100:00000001:1.0:1773851866.571231:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851866.571231:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851866.571232:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000732aa145.
00000100:00000040:1.0:1773851866.571233:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000732aa145 x1859599117329984 msgsize 224
00000100:00100000:1.0:1773851866.571234:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-13570@kfi7 (source: 12345-13570@kfi7)
00000100:00000001:1.0:1773851866.571235:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851866.571236:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee7a4810 nid 13570@kfi7 refs 2
00000100:00000001:0.0:1773851866.571236:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851866.571237:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851866.571237:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851866.571237:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851866.571238:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851866.571239:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851866.571240:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599117329984
00000020:00000001:0.0:1773851866.571240:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851866.571240:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ec83
00000020:00000001:0.0:1773851866.571241:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851866.571245:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a170f9a4 refcount=5
00000020:00000001:0.0:1773851866.571246:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138480602112 : -106935228949504 : ffff9ebe33aa1c00)
00000020:00000001:0.0:1773851866.571246:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138480602112 : -106935228949504 : ffff9ebe33aa1c00)
00000100:00000001:0.0:1773851866.571247:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.571248:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851866.571249:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851866.571250:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.571254:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851866.571254:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851866.571255:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851866.571255:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.571256:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851866.571257:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851866.571257:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.571258:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.571259:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.571260:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.571260:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851866.571260:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851866.571260:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13570@kfi7, seq: 1997555
00000100:00000001:1.0:1773851866.571261:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.571261:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a170f9a4 : new rpc_count 1
00000100:00000001:1.0:1773851866.571262:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.571262:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599703040 : -107004109848576 : ffff9eae2a0b0000)
00000100:00000040:0.0:1773851866.571263:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000732aa145 x1859599117329984/t0(0) o400->a72623d6-ad5a-40af-b761-fcb0e4b3abf7@13570@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1351-0'
00000100:00000001:0.0:1773851866.571266:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.571266:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851866.571267:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000732aa145 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a72623d6-ad5a-40af-b761-fcb0e4b3abf7+5:39550:x1859599117329984:12345-13570@kfi7:400:default-tuolumne1351-0
00000100:00000200:0.0:1773851866.571268:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599117329984
00000020:00000001:0.0:1773851866.571269:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851866.571270:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851866.571270:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.571271:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851866.571272:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851866.571272:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851866.571273:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599117329984, found 0 last_xid 1859599117329983
00000020:00000001:0.0:1773851866.571274:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851866.571274:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851866.571275:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851866.571275:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.571276:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851866.571276:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851866.571277:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851866.571279:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000db31de72.
02000000:00000001:0.0:1773851866.571279:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.571280:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.571281:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851866.571281:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182260541471, transno 0, xid 1859599117329984
00010000:00000001:0.0:1773851866.571282:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851866.571283:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000732aa145 x1859599117329984/t0(0) o400->a72623d6-ad5a-40af-b761-fcb0e4b3abf7@13570@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1351-0'
00010000:00000001:0.0:1773851866.571285:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851866.571286:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851866.571286:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=99 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851866.571287:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851866.571288:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000084abc47e refcount 3 to 13570@kfi7
00000100:00000001:0.0:1773851866.571289:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441120 : -107146751110496 : ffff9e8cf3f612a0)
02000000:00000001:0.0:1773851866.571290:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851866.571290:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.571291:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851866.571292:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13570@kfi7
00000400:00000010:0.0:1773851866.571292:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071d311d2.
00000100:00000200:0.0:1773851866.571293:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599117329984, offset 224
00000400:00000200:0.0:1773851866.571294:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13570@kfi7
00000400:00000200:0.0:1773851866.571295:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13570@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.571296:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee7a4810 nid 13570@kfi7 refs 1
00000400:00000200:0.0:1773851866.571297:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee7a4810 nid 13570@kfi7 refs 2
00000400:00000200:0.0:1773851866.571298:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee7a4810 nid 13570@kfi7 refs 3
00000400:00000200:0.0:1773851866.571299:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13570@kfi7 local destination
00000400:00000200:0.0:1773851866.571300:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769184:8769184:1024:4294967295] 13570@kfi7 LPNI seq info [1086591:1086591:16:4294967295]
00000400:00000200:0.0:1773851866.571301:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee7a4810 nid 13570@kfi7 refs 2
00000400:00000200:0.0:1773851866.571302:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13570@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.571304:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13570@kfi7(13570@kfi7:13570@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851866.571305:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee7a4810 nid 13570@kfi7 refs 3
00000800:00000200:0.0:1773851866.571306:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851866.571308:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851866.571310:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851866.571312:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x817 Using peer 13570@kfi7(0x817)
00000800:00000200:0.0:1773851866.571315:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x817: rc=0
00000800:00000200:0.0:1773851866.571316:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x817 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851866.571318:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.571319:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000084abc47e refcount 2 to 13570@kfi7
00010000:00000001:0.0:1773851866.571320:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851866.571320:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.571321:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851866.571321:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000732aa145 x1859599117329984/t0(0) o400->a72623d6-ad5a-40af-b761-fcb0e4b3abf7@13570@kfi7:593/0 lens 224/224 e 0 to 0 dl 1773851953 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1351-0'
00000100:00100000:0.0:1773851866.571325:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000732aa145 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a72623d6-ad5a-40af-b761-fcb0e4b3abf7+5:39550:x1859599117329984:12345-13570@kfi7:400:default-tuolumne1351-0 Request processed in 57us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851866.571327:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13570@kfi7, seq: 1997555
00000100:00000040:0.0:1773851866.571328:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a170f9a4 : new rpc_count 0
00000100:00000001:0.0:1773851866.571329:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851866.571329:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851866.571330:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.571330:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851866.571331:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851866.571332:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000a170f9a4 : new refcount 4
00000100:00000001:0.0:1773851866.571332:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851866.571337:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x817 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851866.571338:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.571340:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13570@kfi7: PUT: OK
00000400:00000200:1.0:1773851866.571341:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071d311d2
00000400:00000010:1.0:1773851866.571341:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071d311d2.
00000100:00000001:1.0:1773851866.571342:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851866.571342:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851866.571343:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee7a4810 nid 13570@kfi7 refs 2
00000800:00000200:1.0:1773851866.571344:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 13570@kfi7(00000000b9ac50b0):0x0 lsk 2072 rsk 19 tsk 0 trmk 0 tmk 0 trr 0 tta 0x817 Transaction freed
00000800:00000200:5.0:1773851866.581178:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.581178:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851866.581180:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851866.581182:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851866.581185:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.581186:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851866.581187:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.581188:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851866.581189:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.581190:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851866.581191:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851866.581191:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851866.581192:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a879e3bc0
00000400:00000200:5.0:1773851866.581193:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 6288
00000800:00000200:5.0:1773851866.581195:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851866.581197:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851866.581198:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851866.581199:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851866.581199:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851866.581200:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000048a7bbde.
00000100:00000040:5.0:1773851866.581201:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000048a7bbde x1859388107013056 msgsize 224
00000100:00100000:5.0:1773851866.581202:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851866.581203:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851866.581204:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851866.581206:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851866.581208:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851866.581209:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851866.581209:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851866.581210:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851866.581211:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851866.581211:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107013056
00000020:00000001:5.0:1773851866.581212:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851866.581212:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:5.0:1773851866.581213:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851866.581215:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:5.0:1773851866.581215:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:5.0:1773851866.581216:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:5.0:1773851866.581217:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.581217:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851866.581218:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e0af6c38.
00000020:00000010:5.0:1773851866.581219:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.581220:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008260bf32.
00000100:00000040:5.0:1773851866.581221:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851866.581221:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851866.581222:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851866.581222:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.581223:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.581224:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851866.581225:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851866.581225:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851866.581226:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314079
00000100:00000001:6.0:1773851866.581227:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:5.0:1773851866.581227:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:6.0:1773851866.581228:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851866.581228:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.581228:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886770432 : -106955822781184 : ffff9eb9682d2d00)
00000100:00000001:6.0:1773851866.581229:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.581229:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000048a7bbde x1859388107013056/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:593/0 lens 224/0 e 0 to 0 dl 1773851953 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:5.0:1773851866.581231:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.581231:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851866.581232:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048a7bbde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0000-mdtlov_UUID+5:40157:x1859388107013056:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:5.0:1773851866.581233:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107013056
00000020:00000001:5.0:1773851866.581234:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851866.581234:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851866.581235:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.581236:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851866.581236:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851866.581237:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851866.581237:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851866.581239:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851866.581239:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851866.581240:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.581240:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851866.581241:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851866.581242:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000763a7de5.
02000000:00000001:5.0:1773851866.581242:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.581243:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851866.581244:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851866.581244:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851866.581245:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851866.581245:0:1203214:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:5.0:1773851866.581246:0:1203214:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851866.581247:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851866.581248:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132541 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851866.581249:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851866.581250:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107013056
00010000:00000001:5.0:1773851866.581251:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851866.581252:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000048a7bbde x1859388107013056/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:5.0:1773851866.581254:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851866.581254:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851866.581255:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=95 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851866.581256:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851866.581257:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:5.0:1773851866.581258:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:5.0:1773851866.581258:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851866.581259:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.581259:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851866.581260:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:5.0:1773851866.581261:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032855b1f.
00000100:00000200:5.0:1773851866.581261:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107013056, offset 224
00000400:00000200:5.0:1773851866.581263:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:5.0:1773851866.581263:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.581264:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851866.581265:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851866.581266:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851866.581267:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:5.0:1773851866.581269:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769185:8769185:1024:4294967295] 43@kfi7 LPNI seq info [37492101:37492101:16:4294967295]
00000400:00000200:5.0:1773851866.581270:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851866.581271:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.581272:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851866.581273:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:5.0:1773851866.581274:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.581275:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851866.581277:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851866.581279:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Using peer 43@kfi7(0xa02)
00000800:00000200:5.0:1773851866.581282:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046518b99: Posted send of 468 bytes to peer 0xa02: rc=0
00000800:00000200:5.0:1773851866.581283:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851866.581285:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.581286:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:5.0:1773851866.581287:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851866.581287:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.581288:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851866.581288:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000048a7bbde x1859388107013056/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:593/0 lens 224/368 e 0 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:5.0:1773851866.581291:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048a7bbde pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0000-mdtlov_UUID+5:40157:x1859388107013056:12345-61@kfi7:41:default-yuba1-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851866.581293:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314079
00000100:00000040:5.0:1773851866.581294:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:5.0:1773851866.581295:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:6.0:1773851866.581296:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851866.581296:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851866.581296:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.581297:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008260bf32.
00000400:00000200:6.0:1773851866.581298:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851866.581298:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e0af6c38.
00000020:00000040:5.0:1773851866.581299:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000400:00000200:6.0:1773851866.581300:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000400:00000200:6.0:1773851866.581300:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032855b1f
00000100:00000001:5.0:1773851866.581300:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851866.581301:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032855b1f.
00000100:00000001:6.0:1773851866.581302:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851866.581302:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851866.581303:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:6.0:1773851866.581305:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Transaction freed
00000800:00000200:1.0:1773851866.586830:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.586831:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851866.586832:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851866.586833:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851866.586835:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20000@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.586836:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20000@kfi7 : PUT - for me
00000400:00000200:1.0:1773851866.586837:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20000@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.586839:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004cd3c408 nid 20000@kfi7 refs 1
00000400:00000200:1.0:1773851866.586840:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20000@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.586840:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004cd3c408 nid 20000@kfi7 refs 2
00000400:00000200:1.0:1773851866.586841:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004cd3c408 nid 20000@kfi7 refs 3
00000400:00000200:1.0:1773851866.586842:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20000@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.586843:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20000@kfi7 of length 224 into portal 12 MB=0x69b464f517840
00000400:00000200:1.0:1773851866.586845:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20000@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 28056
00000800:00000200:1.0:1773851866.586846:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851866.586848:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.586849:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20000@kfi7: PUT: OK
00000100:00000001:1.0:1773851866.586850:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851866.586850:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851866.586851:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bf38525d.
00000100:00000040:1.0:1773851866.586852:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000bf38525d x1859576141019200 msgsize 224
00000100:00100000:1.0:1773851866.586853:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-20000@kfi7 (source: 12345-20000@kfi7)
00000100:00000001:1.0:1773851866.586854:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851866.586855:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004cd3c408 nid 20000@kfi7 refs 2
00000100:00000001:0.0:1773851866.586855:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851866.586856:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851866.586856:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851866.586856:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851866.586857:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851866.586857:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851866.586859:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576141019200
00000020:00000001:0.0:1773851866.586859:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851866.586860:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc30734fc
00000020:00000001:0.0:1773851866.586860:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851866.586862:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000000d96002 refcount=5
00000020:00000001:0.0:1773851866.586862:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637124581512192 : -106949128039424 : ffff9ebaf736d400)
00000020:00000001:0.0:1773851866.586863:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637124581512192 : -106949128039424 : ffff9ebaf736d400)
00000100:00000001:0.0:1773851866.586864:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.586865:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851866.586865:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851866.586866:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.586867:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851866.586868:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851866.586868:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851866.586869:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.586870:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851866.586870:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851866.586870:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.586871:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.586872:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.586873:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.586873:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851866.586873:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851866.586874:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20000@kfi7, seq: 1997556
00000100:00000001:1.0:1773851866.586875:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851866.586875:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.586875:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000000d96002 : new rpc_count 1
00000100:00000001:0.0:1773851866.586875:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599732992 : -107004109818624 : ffff9eae2a0b7500)
00000100:00000040:0.0:1773851866.586876:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bf38525d x1859576141019200/t0(0) o400->eff20200-d695-44b3-9161-ee2e51ac7287@20000@kfi7:506/0 lens 224/0 e 0 to 0 dl 1773852621 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1743-0'
00000100:00000001:0.0:1773851866.586879:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.586879:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851866.586880:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf38525d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:eff20200-d695-44b3-9161-ee2e51ac7287+5:39708:x1859576141019200:12345-20000@kfi7:400:default-tuolumne1743-0
00000100:00000200:0.0:1773851866.586881:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576141019200
00000020:00000001:0.0:1773851866.586882:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851866.586883:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851866.586884:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.586884:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851866.586885:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851866.586886:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851866.586887:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576141019200, found 0 last_xid 1859576141019199
00000020:00000001:0.0:1773851866.586887:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851866.586888:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851866.586888:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851866.586889:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.586889:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851866.586890:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851866.586890:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851866.586891:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000075ed12b6.
02000000:00000001:0.0:1773851866.586892:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.586892:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.586893:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851866.586894:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096673870, transno 0, xid 1859576141019200
00010000:00000001:0.0:1773851866.586894:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851866.586895:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bf38525d x1859576141019200/t0(0) o400->eff20200-d695-44b3-9161-ee2e51ac7287@20000@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1743-0'
00010000:00000001:0.0:1773851866.586897:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851866.586898:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851866.586898:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=99 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851866.586899:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851866.586900:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b63f7d84 refcount 3 to 20000@kfi7
00000100:00000001:0.0:1773851866.586901:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958004864 : -107146751546752 : ffff9e8cf3ef6a80)
02000000:00000001:0.0:1773851866.586902:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851866.586902:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.586903:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851866.586903:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20000@kfi7
00000400:00000010:0.0:1773851866.586904:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008edf1d49.
00000100:00000200:0.0:1773851866.586905:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576141019200, offset 224
00000400:00000200:0.0:1773851866.586906:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20000@kfi7
00000400:00000200:0.0:1773851866.586907:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20000@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.586908:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004cd3c408 nid 20000@kfi7 refs 1
00000400:00000200:0.0:1773851866.586909:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004cd3c408 nid 20000@kfi7 refs 2
00000400:00000200:0.0:1773851866.586910:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004cd3c408 nid 20000@kfi7 refs 3
00000400:00000200:0.0:1773851866.586912:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20000@kfi7 local destination
00000400:00000200:0.0:1773851866.586913:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769186:8769186:1024:4294967295] 20000@kfi7 LPNI seq info [9065897:9065897:16:4294967295]
00000400:00000200:0.0:1773851866.586914:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004cd3c408 nid 20000@kfi7 refs 2
00000400:00000200:0.0:1773851866.586915:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20000@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.586916:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20000@kfi7(20000@kfi7:20000@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851866.586918:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004cd3c408 nid 20000@kfi7 refs 3
00000800:00000200:0.0:1773851866.586919:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851866.586920:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851866.586922:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851866.586924:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000095 Using peer 20000@kfi7(0x100000000000095)
00000800:00000200:0.0:1773851866.586926:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x100000000000095: rc=0
00000800:00000200:0.0:1773851866.586928:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000095 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851866.586929:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.586930:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b63f7d84 refcount 2 to 20000@kfi7
00010000:00000001:0.0:1773851866.586931:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851866.586931:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.586932:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851866.586933:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bf38525d x1859576141019200/t0(0) o400->eff20200-d695-44b3-9161-ee2e51ac7287@20000@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1743-0'
00000100:00100000:0.0:1773851866.586937:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf38525d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:eff20200-d695-44b3-9161-ee2e51ac7287+5:39708:x1859576141019200:12345-20000@kfi7:400:default-tuolumne1743-0 Request processed in 57us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851866.586939:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20000@kfi7, seq: 1997556
00000100:00000040:0.0:1773851866.586940:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000000d96002 : new rpc_count 0
00000100:00000001:0.0:1773851866.586941:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851866.586941:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851866.586942:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.586943:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851866.586944:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851866.586944:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000000d96002 : new refcount 4
00000100:00000001:0.0:1773851866.586945:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851866.586950:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000095 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851866.586951:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.586952:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20000@kfi7: PUT: OK
00000400:00000200:1.0:1773851866.586953:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008edf1d49
00000400:00000010:1.0:1773851866.586954:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008edf1d49.
00000100:00000001:1.0:1773851866.586955:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851866.586955:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851866.586956:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004cd3c408 nid 20000@kfi7 refs 2
00000800:00000200:1.0:1773851866.586958:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 20000@kfi7(0000000021e2fa4a):0x0 lsk 150 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000095 Transaction freed
00000800:00000200:30.0:1773851866.655879:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851866.655881:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851866.655882:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851866.655886:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851866.655888:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17921@kfi7 to cpt 7
00000400:00000200:30.0:1773851866.655890:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17921@kfi7 : PUT - for me
00000400:00000200:30.0:1773851866.655891:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17921@kfi7 to cpt 7
00000400:00000200:30.0:1773851866.655893:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1809e03 nid 17921@kfi7 refs 1
00000400:00000200:30.0:1773851866.655894:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17921@kfi7 to cpt 7
00000400:00000200:30.0:1773851866.655895:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1809e03 nid 17921@kfi7 refs 2
00000400:00000200:30.0:1773851866.655896:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b1809e03 nid 17921@kfi7 refs 3
00000400:00000200:30.0:1773851866.655897:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17920@kfi7 to cpt 4
00000400:00000200:30.0:1773851866.655898:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17920@kfi7 of length 224 into portal 12 MB=0x69b0a276cf940
00000400:00000200:30.0:1773851866.655900:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17920@kfi7 of length 224/224 into md 0x77fe139dd [64] + 174184
00000800:00000200:30.0:1773851866.655903:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851866.655905:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851866.655906:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17921@kfi7: PUT: OK
00000100:00000001:30.0:1773851866.655907:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851866.655907:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851866.655908:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004d5a724c.
00000100:00000040:30.0:1773851866.655909:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000004d5a724c x1859317773695296 msgsize 224
00000100:00100000:30.0:1773851866.655911:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-17920@kfi7 (source: 12345-17921@kfi7)
00000100:00000001:30.0:1773851866.655912:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851866.655913:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1809e03 nid 17921@kfi7 refs 2
00000100:00000001:31.0:1773851866.655914:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851866.655914:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:30.0:1773851866.655914:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851866.655915:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851866.655915:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851866.655916:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851866.655917:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317773695296
00000020:00000001:31.0:1773851866.655918:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851866.655918:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f42
00000020:00000001:31.0:1773851866.655919:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851866.655921:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f9eeec4 refcount=8
00000020:00000001:31.0:1773851866.655922:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629001216 : -107123080550400 : ffff9e9276d62800)
00000020:00000001:31.0:1773851866.655923:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629001216 : -107123080550400 : ffff9e9276d62800)
00000100:00000001:31.0:1773851866.655924:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851866.655925:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851866.655925:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b4f0eb.
00000020:00000010:31.0:1773851866.655927:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851866.655927:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851866.655928:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851866.655929:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851866.655929:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.655930:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851866.655931:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851866.655931:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.655932:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.655933:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851866.655934:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851866.655934:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851866.655934:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851866.655935:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17920@kfi7, seq: 2055514
00000100:00000040:31.0:1773851866.655936:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f9eeec4 : new rpc_count 3
00000100:00000001:31.0:1773851866.655936:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832800384 : -106933876751232 : ffff9ebe84430480)
00000100:00000001:28.0:1773851866.655936:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.655936:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851866.655937:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004d5a724c x1859317773695296/t0(0) o400->57ba1c50-b58a-4faf-8125-4196896551b4@17920@kfi7:654/0 lens 224/0 e 0 to 0 dl 1773852014 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1619-0'
00000100:00000001:31.0:1773851866.655940:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851866.655941:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851866.655942:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d5a724c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:57ba1c50-b58a-4faf-8125-4196896551b4+8:39583:x1859317773695296:12345-17920@kfi7:400:default-tuolumne1619-0
00000100:00000200:31.0:1773851866.655943:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317773695296
00000020:00000001:31.0:1773851866.655944:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851866.655945:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851866.655946:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.655946:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851866.655947:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851866.655948:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851866.655948:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317773695296, found 0 last_xid 1859317773137215
00000020:00000001:31.0:1773851866.655949:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851866.655950:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851866.655950:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851866.655951:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.655951:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851866.655952:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851866.655952:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851866.655953:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c23c12a5.
02000000:00000001:31.0:1773851866.655954:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.655955:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.655955:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851866.655956:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578425, transno 0, xid 1859317773695296
00010000:00000001:31.0:1773851866.655957:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851866.655958:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004d5a724c x1859317773695296/t0(0) o400->57ba1c50-b58a-4faf-8125-4196896551b4@17920@kfi7:654/0 lens 224/224 e 0 to 0 dl 1773852014 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1619-0'
00010000:00000001:31.0:1773851866.655960:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851866.655961:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851866.655961:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=99 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851866.655963:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851866.655963:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001ee0ad4a refcount 3 to 17920@kfi7
00000100:00000001:31.0:1773851866.655964:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516128 : -107156126035488 : ffff9e8ac52c11e0)
02000000:00000001:31.0:1773851866.655965:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851866.655965:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.655966:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851866.655967:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17921@kfi7
00000400:00000010:31.0:1773851866.655967:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f33d0462.
00000100:00000200:31.0:1773851866.655968:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317773695296, offset 224
00000400:00000200:31.0:1773851866.655970:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17921@kfi7
00000400:00000200:31.0:1773851866.655970:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17921@kfi7 to cpt 7
00000400:00000200:31.0:1773851866.655971:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1809e03 nid 17921@kfi7 refs 1
00000400:00000200:31.0:1773851866.655973:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b1809e03 nid 17921@kfi7 refs 2
00000400:00000200:31.0:1773851866.655974:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b1809e03 nid 17921@kfi7 refs 3
00000400:00000200:31.0:1773851866.655975:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17921@kfi7 local destination
00000400:00000200:31.0:1773851866.655976:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769187:8769187:1024:4294967295] 17921@kfi7 LPNI seq info [202986:202986:16:4294967295]
00000400:00000200:31.0:1773851866.655978:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b1809e03 nid 17921@kfi7 refs 2
00000400:00000200:31.0:1773851866.655978:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17921@kfi7 to cpt 7
00000400:00000200:31.0:1773851866.655980:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17921@kfi7(17921@kfi7:17921@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851866.655981:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b1809e03 nid 17921@kfi7 refs 3
00000800:00000200:31.0:1773851866.655983:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851866.655984:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851866.655986:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851866.655988:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000220 Using peer 17921@kfi7(0x100000000000220)
00000800:00000200:31.0:1773851866.655991:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x100000000000220: rc=0
00000800:00000200:31.0:1773851866.655993:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000220 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851866.655995:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851866.655996:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001ee0ad4a refcount 2 to 17920@kfi7
00010000:00000001:31.0:1773851866.655996:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851866.655997:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.655998:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851866.655998:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004d5a724c x1859317773695296/t0(0) o400->57ba1c50-b58a-4faf-8125-4196896551b4@17920@kfi7:654/0 lens 224/224 e 0 to 0 dl 1773852014 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1619-0'
00000100:00100000:31.0:1773851866.656001:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d5a724c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:57ba1c50-b58a-4faf-8125-4196896551b4+8:39583:x1859317773695296:12345-17920@kfi7:400:default-tuolumne1619-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851866.656003:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17920@kfi7, seq: 2055514
00000100:00000040:31.0:1773851866.656005:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f9eeec4 : new rpc_count 2
00000100:00000001:31.0:1773851866.656006:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851866.656006:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851866.656006:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000220 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851866.656007:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851866.656008:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000400:00000200:29.0:1773851866.656008:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851866.656009:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b4f0eb.
00000020:00000040:31.0:1773851866.656010:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000004f9eeec4 : new refcount 7
00000100:00000001:31.0:1773851866.656010:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851866.656010:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17921@kfi7: PUT: OK
00000400:00000200:29.0:1773851866.656011:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f33d0462
00000400:00000010:29.0:1773851866.656011:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f33d0462.
00000100:00000001:29.0:1773851866.656012:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851866.656013:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851866.656014:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1809e03 nid 17921@kfi7 refs 2
00000800:00000200:29.0:1773851866.656016:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 17921@kfi7(0000000067923746):0x0 lsk 545 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000220 Transaction freed
00000800:00000200:29.0:1773851866.762770:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851866.762771:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851866.762772:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851866.762775:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851866.762777:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.762779:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:29.0:1773851866.762780:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.762781:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:29.0:1773851866.762782:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.762782:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:29.0:1773851866.762783:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:29.0:1773851866.762784:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.762785:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 224 into portal 12 MB=0x699e0e457edc0
00000400:00000200:29.0:1773851866.762787:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-3@kfi7 of length 224/224 into md 0x77fe139dd [64] + 174408
00000800:00000200:29.0:1773851866.762789:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851866.762790:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.762791:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000100:00000001:29.0:1773851866.762792:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851866.762793:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851866.762793:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059df2607.
00000100:00000040:29.0:1773851866.762794:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000059df2607 x1858041042955712 msgsize 224
00000100:00100000:29.0:1773851866.762796:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-3@kfi7 (source: 12345-3@kfi7)
00000100:00000001:29.0:1773851866.762797:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851866.762798:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:31.0:1773851866.762799:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851866.762800:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851866.762800:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851866.762800:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851866.762800:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851866.762801:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851866.762802:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041042955712
00000020:00000001:31.0:1773851866.762802:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851866.762803:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac939dd
00000020:00000001:31.0:1773851866.762803:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851866.762806:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003dd4bdcb refcount=5
00000020:00000001:31.0:1773851866.762807:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636947697415168 : -107126012136448 : ffff9e91c819b400)
00000020:00000001:31.0:1773851866.762807:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636947697415168 : -107126012136448 : ffff9e91c819b400)
00000100:00000001:31.0:1773851866.762808:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851866.762809:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851866.762809:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b4f0eb.
00000020:00000010:31.0:1773851866.762810:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851866.762810:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851866.762811:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851866.762811:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851866.762812:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.762813:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851866.762813:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851866.762813:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.762814:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.762815:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851866.762815:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851866.762816:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-3@kfi7, seq: 2055515
00000100:00000001:28.0:1773851866.762816:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851866.762816:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851866.762817:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003dd4bdcb : new rpc_count 1
00000100:00000001:28.0:1773851866.762817:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.762818:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079343700736 : -106994365850880 : ffff9eb06ed49b00)
00000100:00000001:28.0:1773851866.762818:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851866.762819:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000059df2607 x1858041042955712/t0(0) o400->lustre5-MDT0001-lwp-OST0008_UUID@3@kfi7:654/0 lens 224/0 e 0 to 0 dl 1773852014 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba109-0'
00000100:00000001:31.0:1773851866.762822:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851866.762822:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851866.762823:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059df2607 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0008_UUID+5:272611:x1858041042955712:12345-3@kfi7:400:default-yuba109-0
00000100:00000200:31.0:1773851866.762824:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041042955712
00000020:00000001:31.0:1773851866.762824:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851866.762825:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851866.762825:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.762826:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851866.762826:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851866.762827:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:31.0:1773851866.762827:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851866.762828:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851866.762828:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851866.762829:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.762829:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851866.762830:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851866.762830:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851866.762831:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000088ac99d7.
02000000:00000001:31.0:1773851866.762831:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.762832:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.762832:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851866.762833:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041042955712
00010000:00000001:31.0:1773851866.762833:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851866.762834:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000059df2607 x1858041042955712/t0(0) o400->lustre5-MDT0001-lwp-OST0008_UUID@3@kfi7:654/0 lens 224/224 e 0 to 0 dl 1773852014 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba109-0'
00010000:00000001:31.0:1773851866.762836:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851866.762837:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851866.762837:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=99 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851866.762838:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851866.762839:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b6fe8b7 refcount 7 to 3@kfi7
00000100:00000001:31.0:1773851866.762851:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270912 : -107152618280704 : ffff9e8b96402900)
02000000:00000001:31.0:1773851866.762852:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851866.762852:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.762853:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851866.762854:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000010:31.0:1773851866.762854:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d658250.
00000100:00000200:31.0:1773851866.762855:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041042955712, offset 224
00000400:00000200:31.0:1773851866.762856:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000200:31.0:1773851866.762857:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:31.0:1773851866.762857:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:31.0:1773851866.762858:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:31.0:1773851866.762859:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:31.0:1773851866.762860:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  3@kfi7 local destination
00000400:00000200:31.0:1773851866.762861:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769188:8769188:1024:4294967295] 3@kfi7 LPNI seq info [5406220:5406220:16:4294967295]
00000400:00000200:31.0:1773851866.762863:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:31.0:1773851866.762863:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:31.0:1773851866.762865:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851866.762866:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:31.0:1773851866.762867:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851866.762868:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851866.762870:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851866.762872:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000003b5 Using peer 3@kfi7(0x2000000000003b5)
00000800:00000200:31.0:1773851866.762875:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x2000000000003b5: rc=0
00000800:00000200:31.0:1773851866.762876:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000003b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851866.762878:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851866.762878:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b6fe8b7 refcount 6 to 3@kfi7
00010000:00000001:31.0:1773851866.762879:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851866.762880:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851866.762881:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851866.762881:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059df2607 x1858041042955712/t0(0) o400->lustre5-MDT0001-lwp-OST0008_UUID@3@kfi7:654/0 lens 224/224 e 0 to 0 dl 1773852014 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba109-0'
00000100:00100000:31.0:1773851866.762884:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059df2607 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0008_UUID+5:272611:x1858041042955712:12345-3@kfi7:400:default-yuba109-0 Request processed in 62us (89us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851866.762886:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-3@kfi7, seq: 2055515
00000100:00000040:31.0:1773851866.762887:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003dd4bdcb : new rpc_count 0
00000100:00000001:31.0:1773851866.762888:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851866.762888:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851866.762888:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000003b5 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851866.762889:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851866.762889:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000400:00000200:29.0:1773851866.762889:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851866.762890:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b4f0eb.
00000020:00000040:31.0:1773851866.762890:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000003dd4bdcb : new refcount 4
00000100:00000001:31.0:1773851866.762891:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851866.762891:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000400:00000200:29.0:1773851866.762891:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d658250
00000400:00000010:29.0:1773851866.762892:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d658250.
00000100:00000001:29.0:1773851866.762892:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851866.762893:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851866.762893:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:29.0:1773851866.762894:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000003b5 Transaction freed
00000800:00000200:17.0:1773851866.772064:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.772065:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.772067:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.772069:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.772071:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16755@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.772072:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16755@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.772073:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16755@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.772074:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040eef574 nid 16755@kfi7 refs 1
00000400:00000200:17.0:1773851866.772075:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16755@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.772075:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040eef574 nid 16755@kfi7 refs 2
00000400:00000200:17.0:1773851866.772076:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000040eef574 nid 16755@kfi7 refs 3
00000400:00000200:17.0:1773851866.772077:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16755@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.772078:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16755@kfi7 of length 224 into portal 12 MB=0x69b4b5a0d2140
00000400:00000200:17.0:1773851866.772079:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16755@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 8984
00000800:00000200:17.0:1773851866.772081:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.772083:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.772084:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16755@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.772085:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.772085:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.772086:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000030507f6.
00000100:00000040:17.0:1773851866.772087:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000030507f6 x1859597795926336 msgsize 224
00000100:00100000:17.0:1773851866.772088:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16755@kfi7 (source: 12345-16755@kfi7)
00000100:00000001:17.0:1773851866.772089:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.772090:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000040eef574 nid 16755@kfi7 refs 2
00000800:00000200:17.0:1773851866.772091:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.772094:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.772094:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.772095:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.772095:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.772096:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.772106:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597795926336
00000020:00000001:17.0:1773851866.772107:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.772107:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e245381a4
00000020:00000001:17.0:1773851866.772108:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.772110:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000020117f3c refcount=5
00000020:00000001:17.0:1773851866.772111:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637101372394496 : -106972337157120 : ffff9eb58fd7cc00)
00000020:00000001:17.0:1773851866.772112:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637101372394496 : -106972337157120 : ffff9eb58fd7cc00)
00000100:00000001:17.0:1773851866.772113:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.772113:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.772114:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.772115:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.772116:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.772117:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.772117:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.772118:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.772118:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.772119:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.772119:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.772120:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.772121:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.772122:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.772122:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.772122:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.772123:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16755@kfi7, seq: 2156317
00000100:00000040:17.0:1773851866.772123:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000020117f3c : new rpc_count 1
00000100:00000001:16.0:1773851866.772123:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.772124:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093940608 : -107022615611008 : ffff9ea9db037980)
00000100:00000001:16.0:1773851866.772124:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.772125:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000030507f6 x1859597795926336/t0(0) o400->347de710-45cb-499b-b1a2-4a340efc60a2@16755@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1530-0'
00000100:00000001:17.0:1773851866.772128:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.772128:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.772129:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000030507f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:347de710-45cb-499b-b1a2-4a340efc60a2+5:39545:x1859597795926336:12345-16755@kfi7:400:default-tuolumne1530-0
00000100:00000200:17.0:1773851866.772130:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597795926336
00000020:00000001:17.0:1773851866.772131:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.772131:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.772132:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.772133:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.772133:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.772134:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.772135:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597795926336, found 0 last_xid 1859597795926335
00000020:00000001:17.0:1773851866.772135:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.772136:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.772137:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.772137:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.772138:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.772138:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.772139:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.772139:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002e9128b3.
02000000:00000001:17.0:1773851866.772140:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.772140:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.772141:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.772142:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256053370, transno 0, xid 1859597795926336
00010000:00000001:17.0:1773851866.772143:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.772143:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000030507f6 x1859597795926336/t0(0) o400->347de710-45cb-499b-b1a2-4a340efc60a2@16755@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1530-0'
00010000:00000001:17.0:1773851866.772146:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.772146:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.772147:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.772148:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.772149:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000901bfcc1 refcount 3 to 16755@kfi7
00000100:00000001:17.0:1773851866.772149:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095776416 : -107152613775200 : ffff9e8b9684e8a0)
02000000:00000001:17.0:1773851866.772150:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.772151:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.772152:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.772152:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16755@kfi7
00000400:00000010:17.0:1773851866.772153:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000043bc2cef.
00000100:00000200:17.0:1773851866.772154:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597795926336, offset 224
00000400:00000200:17.0:1773851866.772155:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16755@kfi7
00000400:00000200:17.0:1773851866.772155:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16755@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.772156:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040eef574 nid 16755@kfi7 refs 1
00000400:00000200:17.0:1773851866.772157:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000040eef574 nid 16755@kfi7 refs 2
00000400:00000200:17.0:1773851866.772158:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000040eef574 nid 16755@kfi7 refs 3
00000400:00000200:17.0:1773851866.772160:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16755@kfi7 local destination
00000400:00000200:17.0:1773851866.772161:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769189:8769189:1024:4294967295] 16755@kfi7 LPNI seq info [440626:440626:16:4294967295]
00000400:00000200:17.0:1773851866.772163:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000040eef574 nid 16755@kfi7 refs 2
00000400:00000200:17.0:1773851866.772163:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16755@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.772165:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16755@kfi7(16755@kfi7:16755@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.772166:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000040eef574 nid 16755@kfi7 refs 3
00000800:00000200:17.0:1773851866.772167:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.772168:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.772170:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.772172:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000372 Using peer 16755@kfi7(0x100000000000372)
00000800:00000200:17.0:1773851866.772175:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x100000000000372: rc=0
00000800:00000200:17.0:1773851866.772177:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000372 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.772179:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.772180:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000901bfcc1 refcount 2 to 16755@kfi7
00010000:00000001:17.0:1773851866.772180:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.772181:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.772181:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.772182:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000030507f6 x1859597795926336/t0(0) o400->347de710-45cb-499b-b1a2-4a340efc60a2@16755@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1530-0'
00000100:00100000:17.0:1773851866.772185:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000030507f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:347de710-45cb-499b-b1a2-4a340efc60a2+5:39545:x1859597795926336:12345-16755@kfi7:400:default-tuolumne1530-0 Request processed in 56us (97us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.772187:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16755@kfi7, seq: 2156317
00000100:00000040:17.0:1773851866.772188:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000020117f3c : new rpc_count 0
00000100:00000001:17.0:1773851866.772189:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851866.772190:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000372 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851866.772190:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851866.772190:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.772191:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851866.772192:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851866.772192:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000020:00000040:17.0:1773851866.772192:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000020117f3c : new refcount 4
00000400:00000200:18.0:1773851866.772193:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16755@kfi7: PUT: OK
00000400:00000200:18.0:1773851866.772193:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000043bc2cef
00000100:00000001:17.0:1773851866.772193:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:18.0:1773851866.772194:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000043bc2cef.
00000100:00000001:18.0:1773851866.772195:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.772195:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.772196:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000040eef574 nid 16755@kfi7 refs 2
00000800:00000200:18.0:1773851866.772197:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 16755@kfi7(00000000216bbffe):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000372 Transaction freed
00000800:00000200:1.0:1773851866.772377:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.772378:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851866.772379:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851866.772381:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851866.772383:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20898@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.772384:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20898@kfi7 : PUT - for me
00000400:00000200:1.0:1773851866.772385:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20898@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.772386:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f40d19ae nid 20898@kfi7 refs 1
00000400:00000200:1.0:1773851866.772387:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20898@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.772387:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f40d19ae nid 20898@kfi7 refs 2
00000400:00000200:1.0:1773851866.772388:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f40d19ae nid 20898@kfi7 refs 3
00000400:00000200:1.0:1773851866.772389:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20835@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.772390:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20835@kfi7 of length 224 into portal 12 MB=0x69b4c8eb6d840
00000400:00000200:1.0:1773851866.772391:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20835@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 28280
00000800:00000200:1.0:1773851866.772393:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851866.772394:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.772395:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20898@kfi7: PUT: OK
00000100:00000001:1.0:1773851866.772396:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851866.772397:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851866.772397:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a9123e11.
00000100:00000040:1.0:1773851866.772398:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a9123e11 x1859602974431296 msgsize 224
00000100:00100000:1.0:1773851866.772400:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-20835@kfi7 (source: 12345-20898@kfi7)
00000100:00000001:1.0:1773851866.772400:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851866.772401:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f40d19ae nid 20898@kfi7 refs 2
00000100:00000001:0.0:1773851866.772402:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851866.772402:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851866.772403:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851866.772403:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851866.772403:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851866.772404:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851866.772405:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602974431296
00000020:00000001:0.0:1773851866.772406:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851866.772406:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8281a
00000020:00000001:0.0:1773851866.772407:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851866.772409:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000199256f refcount=5
00000020:00000001:0.0:1773851866.772409:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111503904768 : -106962205646848 : ffff9eb7ebba6000)
00000020:00000001:0.0:1773851866.772410:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111503904768 : -106962205646848 : ffff9eb7ebba6000)
00000100:00000001:0.0:1773851866.772411:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.772412:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851866.772412:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851866.772413:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.772414:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851866.772415:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851866.772415:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851866.772416:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.772417:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851866.772417:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851866.772418:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.772419:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851866.772420:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851866.772420:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851866.772420:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851866.772421:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851866.772421:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20835@kfi7, seq: 1997557
00000100:00000001:1.0:1773851866.772422:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.772422:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000199256f : new rpc_count 1
00000100:00000001:1.0:1773851866.772423:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.772423:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599711104 : -107004109840512 : ffff9eae2a0b1f80)
00000100:00000040:0.0:1773851866.772424:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a9123e11 x1859602974431296/t0(0) o400->7e92d77e-916e-4fc8-9126-9149f2af218f@20835@kfi7:506/0 lens 224/0 e 0 to 0 dl 1773852621 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1788-0'
00000100:00000001:0.0:1773851866.772427:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.772427:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851866.772428:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a9123e11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7e92d77e-916e-4fc8-9126-9149f2af218f+5:39564:x1859602974431296:12345-20835@kfi7:400:default-tuolumne1788-0
00000100:00000200:0.0:1773851866.772429:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602974431296
00000020:00000001:0.0:1773851866.772430:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851866.772431:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851866.772431:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.772432:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851866.772432:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851866.772433:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851866.772434:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602974431296, found 0 last_xid 1859602974431295
00000020:00000001:0.0:1773851866.772434:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851866.772435:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851866.772436:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851866.772436:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.772437:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851866.772437:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851866.772438:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851866.772440:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000079ea964b.
02000000:00000001:0.0:1773851866.772440:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.772441:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.772441:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851866.772442:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260570462, transno 0, xid 1859602974431296
00010000:00000001:0.0:1773851866.772443:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851866.772443:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a9123e11 x1859602974431296/t0(0) o400->7e92d77e-916e-4fc8-9126-9149f2af218f@20835@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1788-0'
00010000:00000001:0.0:1773851866.772446:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851866.772446:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851866.772447:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=99 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851866.772449:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851866.772450:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f261ad45 refcount 3 to 20835@kfi7
00000100:00000001:0.0:1773851866.772450:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715817888 : -107155993733728 : ffff9e8acd0ed5a0)
02000000:00000001:0.0:1773851866.772451:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851866.772451:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.772452:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851866.772453:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20898@kfi7
00000400:00000010:0.0:1773851866.772454:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c05e23f.
00000100:00000200:0.0:1773851866.772454:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602974431296, offset 224
00000400:00000200:0.0:1773851866.772456:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20898@kfi7
00000400:00000200:0.0:1773851866.772456:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20898@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.772457:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f40d19ae nid 20898@kfi7 refs 1
00000400:00000200:0.0:1773851866.772458:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f40d19ae nid 20898@kfi7 refs 2
00000400:00000200:0.0:1773851866.772459:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f40d19ae nid 20898@kfi7 refs 3
00000400:00000200:0.0:1773851866.772460:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20898@kfi7 local destination
00000400:00000200:0.0:1773851866.772462:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769190:8769190:1024:4294967295] 20898@kfi7 LPNI seq info [1062166:1062166:16:4294967295]
00000400:00000200:0.0:1773851866.772463:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f40d19ae nid 20898@kfi7 refs 2
00000400:00000200:0.0:1773851866.772463:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20898@kfi7 to cpt 0
00000400:00000200:0.0:1773851866.772465:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20898@kfi7(20898@kfi7:20898@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851866.772466:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f40d19ae nid 20898@kfi7 refs 3
00000800:00000200:0.0:1773851866.772468:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851866.772469:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851866.772471:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851866.772473:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x708 Using peer 20898@kfi7(0x708)
00000800:00000200:0.0:1773851866.772476:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x708: rc=0
00000800:00000200:0.0:1773851866.772477:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x708 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851866.772479:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851866.772481:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f261ad45 refcount 2 to 20835@kfi7
00010000:00000001:0.0:1773851866.772482:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851866.772482:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851866.772483:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851866.772483:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a9123e11 x1859602974431296/t0(0) o400->7e92d77e-916e-4fc8-9126-9149f2af218f@20835@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1788-0'
00000100:00100000:0.0:1773851866.772488:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a9123e11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7e92d77e-916e-4fc8-9126-9149f2af218f+5:39564:x1859602974431296:12345-20835@kfi7:400:default-tuolumne1788-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851866.772490:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20835@kfi7, seq: 1997557
00000100:00000040:0.0:1773851866.772491:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000199256f : new rpc_count 0
00000100:00000001:0.0:1773851866.772491:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851866.772492:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851866.772492:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.772493:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851866.772494:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:0.0:1773851866.772494:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000000199256f : new refcount 4
00000100:00000001:0.0:1773851866.772495:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851866.772500:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x708 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851866.772502:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.772503:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20898@kfi7: PUT: OK
00000400:00000200:1.0:1773851866.772503:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c05e23f
00000400:00000010:1.0:1773851866.772504:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c05e23f.
00000100:00000001:1.0:1773851866.772505:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851866.772505:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851866.772506:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f40d19ae nid 20898@kfi7 refs 2
00000800:00000200:1.0:1773851866.772508:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 20898@kfi7(00000000bc6787aa):0x0 lsk 1801 rsk 31 tsk 0 trmk 0 tmk 0 trr 0 tta 0x708 Transaction freed
00000800:00000200:17.0:1773851866.774022:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.774022:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.774024:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.774026:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.774027:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23491@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.774028:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23491@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.774029:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23491@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.774030:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000807a9845 nid 23491@kfi7 refs 1
00000400:00000200:17.0:1773851866.774031:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23491@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.774032:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000807a9845 nid 23491@kfi7 refs 2
00000400:00000200:17.0:1773851866.774033:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000807a9845 nid 23491@kfi7 refs 3
00000400:00000200:17.0:1773851866.774034:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23298@kfi7 to cpt 6
00000400:00000200:17.0:1773851866.774035:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23298@kfi7 of length 224 into portal 12 MB=0x699e106146040
00000400:00000200:17.0:1773851866.774036:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23298@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 9208
00000800:00000200:17.0:1773851866.774038:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.774039:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.774041:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23491@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.774041:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.774042:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.774043:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000047c0f6d.
00000100:00000040:17.0:1773851866.774044:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000047c0f6d x1858041608953920 msgsize 224
00000100:00100000:17.0:1773851866.774045:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23298@kfi7 (source: 12345-23491@kfi7)
00000100:00000001:17.0:1773851866.774047:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.774048:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000807a9845 nid 23491@kfi7 refs 2
00000800:00000200:17.0:1773851866.774049:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.774052:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.774053:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.774053:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.774054:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.774054:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.774055:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041608953920
00000020:00000001:17.0:1773851866.774056:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.774056:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ba5
00000020:00000001:17.0:1773851866.774057:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.774058:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dbcbfb79 refcount=6
00000020:00000001:17.0:1773851866.774059:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743663616 : -107128965888000 : ffff9e91180b0800)
00000020:00000001:17.0:1773851866.774060:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743663616 : -107128965888000 : ffff9e91180b0800)
00000100:00000001:17.0:1773851866.774061:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.774061:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.774062:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.774063:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.774064:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.774065:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.774065:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.774066:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.774067:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.774067:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.774067:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.774068:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.774069:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.774070:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.774070:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.774070:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.774071:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23298@kfi7, seq: 2156318
00000100:00000040:17.0:1773851866.774072:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dbcbfb79 : new rpc_count 1
00000100:00000001:16.0:1773851866.774072:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851866.774072:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.774073:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093910656 : -107022615640960 : ffff9ea9db030480)
00000100:00000040:17.0:1773851866.774073:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000047c0f6d x1858041608953920/t0(0) o400->eaabc753-af25-4ea9-a329-ef29405270df@23298@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1959-0'
00000100:00000001:17.0:1773851866.774076:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.774077:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.774078:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000047c0f6d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:eaabc753-af25-4ea9-a329-ef29405270df+6:39710:x1858041608953920:12345-23298@kfi7:400:default-tuolumne1959-0
00000100:00000200:17.0:1773851866.774079:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041608953920
00000020:00000001:17.0:1773851866.774079:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.774080:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.774080:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.774081:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.774082:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.774082:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.774083:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041608953920, found 0 last_xid 1858041608953919
00000020:00000001:17.0:1773851866.774084:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.774084:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.774085:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.774085:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.774086:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.774087:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.774087:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.774088:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef1450ec.
02000000:00000001:17.0:1773851866.774088:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.774089:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.774090:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.774090:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915823550, transno 0, xid 1858041608953920
00010000:00000001:17.0:1773851866.774091:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.774092:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000047c0f6d x1858041608953920/t0(0) o400->eaabc753-af25-4ea9-a329-ef29405270df@23298@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1959-0'
00010000:00000001:17.0:1773851866.774094:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.774094:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.774095:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.774096:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.774097:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002a54bcf3 refcount 3 to 23298@kfi7
00000100:00000001:17.0:1773851866.774097:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985418880 : -107156724132736 : ffff9e8aa185d480)
02000000:00000001:17.0:1773851866.774098:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.774099:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.774099:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.774100:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23491@kfi7
00000400:00000010:17.0:1773851866.774101:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af69d68e.
00000100:00000200:17.0:1773851866.774102:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041608953920, offset 224
00000400:00000200:17.0:1773851866.774103:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23491@kfi7
00000400:00000200:17.0:1773851866.774104:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23491@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.774105:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000807a9845 nid 23491@kfi7 refs 1
00000400:00000200:17.0:1773851866.774106:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000807a9845 nid 23491@kfi7 refs 2
00000400:00000200:17.0:1773851866.774107:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000807a9845 nid 23491@kfi7 refs 3
00000400:00000200:17.0:1773851866.774108:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23491@kfi7 local destination
00000400:00000200:17.0:1773851866.774109:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769191:8769191:1024:4294967295] 23491@kfi7 LPNI seq info [422667:422667:16:4294967295]
00000400:00000200:17.0:1773851866.774110:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000807a9845 nid 23491@kfi7 refs 2
00000400:00000200:17.0:1773851866.774111:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23491@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.774113:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23491@kfi7(23491@kfi7:23491@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.774114:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000807a9845 nid 23491@kfi7 refs 3
00000800:00000200:17.0:1773851866.774115:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.774116:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.774118:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.774120:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0xbb Using peer 23491@kfi7(0xbb)
00000800:00000200:17.0:1773851866.774123:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0xbb: rc=0
00000800:00000200:17.0:1773851866.774124:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0xbb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.774126:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.774127:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002a54bcf3 refcount 2 to 23298@kfi7
00010000:00000001:17.0:1773851866.774128:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.774128:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.774130:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.774130:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000047c0f6d x1858041608953920/t0(0) o400->eaabc753-af25-4ea9-a329-ef29405270df@23298@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1959-0'
00000100:00100000:17.0:1773851866.774133:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000047c0f6d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:eaabc753-af25-4ea9-a329-ef29405270df+6:39710:x1858041608953920:12345-23298@kfi7:400:default-tuolumne1959-0 Request processed in 56us (88us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.774135:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23298@kfi7, seq: 2156318
00000100:00000040:17.0:1773851866.774136:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dbcbfb79 : new rpc_count 0
00000100:00000001:17.0:1773851866.774137:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851866.774138:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0xbb TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851866.774138:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851866.774138:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.774139:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851866.774140:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851866.774140:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000020:00000040:17.0:1773851866.774140:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000dbcbfb79 : new refcount 5
00000400:00000200:18.0:1773851866.774141:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23491@kfi7: PUT: OK
00000400:00000200:18.0:1773851866.774141:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af69d68e
00000100:00000001:17.0:1773851866.774141:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:18.0:1773851866.774142:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af69d68e.
00000100:00000001:18.0:1773851866.774142:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.774143:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.774144:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000807a9845 nid 23491@kfi7 refs 2
00000800:00000200:18.0:1773851866.774145:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 23491@kfi7(00000000f2fdccb9):0x0 lsk 188 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0xbb Transaction freed
00000800:00000200:17.0:1773851866.800897:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.800898:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.800899:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.800901:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.800903:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13328@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.800904:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13328@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.800905:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13328@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.800906:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000004f7154c nid 13328@kfi7 refs 1
00000400:00000200:17.0:1773851866.800907:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13328@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.800908:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000004f7154c nid 13328@kfi7 refs 2
00000400:00000200:17.0:1773851866.800909:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000004f7154c nid 13328@kfi7 refs 3
00000400:00000200:17.0:1773851866.800910:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13329@kfi7 to cpt 7
00000400:00000200:17.0:1773851866.800910:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13329@kfi7 of length 224 into portal 12 MB=0x699e0d8274b80
00000400:00000200:17.0:1773851866.800911:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13329@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 9432
00000800:00000200:17.0:1773851866.800913:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.800915:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.800916:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13328@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.800917:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.800917:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.800918:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bacab09f.
00000100:00000040:17.0:1773851866.800918:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bacab09f x1858040838441856 msgsize 224
00000100:00100000:17.0:1773851866.800920:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13329@kfi7 (source: 12345-13328@kfi7)
00000100:00000001:17.0:1773851866.800921:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.800922:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000004f7154c nid 13328@kfi7 refs 2
00000800:00000200:17.0:1773851866.800923:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.800925:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.800925:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.800926:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.800926:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.800927:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.800927:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040838441856
00000020:00000001:17.0:1773851866.800928:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.800928:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b9f
00000020:00000001:17.0:1773851866.800929:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.800932:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c7cc45f9 refcount=6
00000020:00000001:17.0:1773851866.800933:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628015104 : -107123081536512 : ffff9e9276c71c00)
00000020:00000001:17.0:1773851866.800934:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628015104 : -107123081536512 : ffff9e9276c71c00)
00000100:00000001:17.0:1773851866.800935:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.800935:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.800936:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.800936:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.800937:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.800937:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.800938:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.800938:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.800939:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.800939:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.800940:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.800941:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.800942:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.800942:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.800943:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13329@kfi7, seq: 2156319
00000100:00000001:16.0:1773851866.800943:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.800943:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851866.800944:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c7cc45f9 : new rpc_count 1
00000100:00000001:16.0:1773851866.800944:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.800945:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093918720 : -107022615632896 : ffff9ea9db032400)
00000100:00000001:16.0:1773851866.800945:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.800946:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bacab09f x1858040838441856/t0(0) o400->d1eef9f7-d055-4e70-a601-3a17bfdecd1d@13329@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1329-0'
00000100:00000001:17.0:1773851866.800948:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.800949:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.800949:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bacab09f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:d1eef9f7-d055-4e70-a601-3a17bfdecd1d+6:39646:x1858040838441856:12345-13329@kfi7:400:default-tuolumne1329-0
00000100:00000200:17.0:1773851866.800950:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040838441856
00000020:00000001:17.0:1773851866.800951:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.800951:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.800952:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.800953:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.800953:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.800954:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.800954:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040838441856, found 0 last_xid 1858040838441855
00000020:00000001:17.0:1773851866.800955:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.800955:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.800955:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.800956:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.800956:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.800957:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.800957:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.800958:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000035bf9d08.
02000000:00000001:17.0:1773851866.800958:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.800959:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.800959:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.800960:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692218, transno 0, xid 1858040838441856
00010000:00000001:17.0:1773851866.800960:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.800962:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bacab09f x1858040838441856/t0(0) o400->d1eef9f7-d055-4e70-a601-3a17bfdecd1d@13329@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1329-0'
00010000:00000001:17.0:1773851866.800964:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.800965:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.800965:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.800966:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.800967:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004fcb5df2 refcount 3 to 13329@kfi7
00000100:00000001:17.0:1773851866.800967:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269952 : -107152618281664 : ffff9e8b96402540)
02000000:00000001:17.0:1773851866.800968:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.800968:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.800969:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.800970:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13328@kfi7
00000400:00000010:17.0:1773851866.800970:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000427a4ed2.
00000100:00000200:17.0:1773851866.800971:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040838441856, offset 224
00000400:00000200:17.0:1773851866.800972:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13328@kfi7
00000400:00000200:17.0:1773851866.800973:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13328@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.800974:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000004f7154c nid 13328@kfi7 refs 1
00000400:00000200:17.0:1773851866.800974:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000004f7154c nid 13328@kfi7 refs 2
00000400:00000200:17.0:1773851866.800975:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000004f7154c nid 13328@kfi7 refs 3
00000400:00000200:17.0:1773851866.800977:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13328@kfi7 local destination
00000400:00000200:17.0:1773851866.800978:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769192:8769192:1024:4294967295] 13328@kfi7 LPNI seq info [588841:588841:16:4294967295]
00000400:00000200:17.0:1773851866.800979:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000004f7154c nid 13328@kfi7 refs 2
00000400:00000200:17.0:1773851866.800979:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13328@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.800981:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13328@kfi7(13328@kfi7:13328@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.800982:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000004f7154c nid 13328@kfi7 refs 3
00000800:00000200:17.0:1773851866.800983:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.800984:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.800986:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.800988:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11c5 Using peer 13328@kfi7(0x11c5)
00000800:00000200:17.0:1773851866.800991:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x11c5: rc=0
00000800:00000200:17.0:1773851866.800993:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11c5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.800994:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.800995:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004fcb5df2 refcount 2 to 13329@kfi7
00010000:00000001:17.0:1773851866.800995:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.800996:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.800996:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.800997:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bacab09f x1858040838441856/t0(0) o400->d1eef9f7-d055-4e70-a601-3a17bfdecd1d@13329@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1329-0'
00000100:00100000:17.0:1773851866.800999:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bacab09f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:d1eef9f7-d055-4e70-a601-3a17bfdecd1d+6:39646:x1858040838441856:12345-13329@kfi7:400:default-tuolumne1329-0 Request processed in 50us (80us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.801001:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13329@kfi7, seq: 2156319
00000100:00000040:17.0:1773851866.801002:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c7cc45f9 : new rpc_count 0
00000100:00000001:17.0:1773851866.801002:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851866.801003:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851866.801003:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.801004:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000020:00000010:17.0:1773851866.801005:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000020:00000040:17.0:1773851866.801005:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000c7cc45f9 : new refcount 5
00000800:00000200:18.0:1773851866.801006:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11c5 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851866.801006:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851866.801008:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851866.801009:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13328@kfi7: PUT: OK
00000400:00000200:18.0:1773851866.801010:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000427a4ed2
00000400:00000010:18.0:1773851866.801010:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000427a4ed2.
00000100:00000001:18.0:1773851866.801010:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.801011:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.801012:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000004f7154c nid 13328@kfi7 refs 2
00000800:00000200:18.0:1773851866.801013:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13328@kfi7(00000000c65df56d):0x0 lsk 4550 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x11c5 Transaction freed
00000800:00000200:29.0:1773851866.851719:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851866.851719:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851866.851720:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851866.851723:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851866.851729:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26194@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.851730:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26194@kfi7 : PUT - for me
00000400:00000200:29.0:1773851866.851731:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26194@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.851732:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009285141e nid 26194@kfi7 refs 1
00000400:00000200:29.0:1773851866.851733:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26194@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.851734:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009285141e nid 26194@kfi7 refs 2
00000400:00000200:29.0:1773851866.851735:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009285141e nid 26194@kfi7 refs 3
00000400:00000200:29.0:1773851866.851736:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26195@kfi7 to cpt 2
00000400:00000200:29.0:1773851866.851736:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26195@kfi7 of length 224 into portal 12 MB=0x69b4b9432f0c0
00000400:00000200:29.0:1773851866.851738:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26195@kfi7 of length 224/224 into md 0x77fe139dd [64] + 174632
00000800:00000200:29.0:1773851866.851739:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851866.851742:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.851742:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26194@kfi7: PUT: OK
00000100:00000001:29.0:1773851866.851743:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851866.851744:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851866.851745:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3705785.
00000100:00000040:29.0:1773851866.851746:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000e3705785 x1859598771482816 msgsize 224
00000100:00100000:29.0:1773851866.851747:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26195@kfi7 (source: 12345-26194@kfi7)
00000100:00000001:29.0:1773851866.851748:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851866.851749:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009285141e nid 26194@kfi7 refs 2
00000800:00000200:29.0:1773851866.851750:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851866.851751:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851866.851752:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851866.851753:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851866.851754:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851866.851755:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851866.851756:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598771482816
00000020:00000001:31.0:1773851866.851757:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851866.851757:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38940fcc
00000020:00000001:31.0:1773851866.851758:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851866.851762:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000035883774 refcount=23
00000020:00000001:31.0:1773851866.851763:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637002198723584 : -107071510828032 : ffff9e9e78a1ac00)
00000020:00000001:31.0:1773851866.851764:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637002198723584 : -107071510828032 : ffff9e9e78a1ac00)
00000100:00000001:31.0:1773851866.851765:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851866.851767:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851866.851767:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b4f0eb.
00000020:00000010:31.0:1773851866.851769:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851866.851770:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d6f9657e.
00000100:00000001:31.0:1773851866.851771:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851866.851773:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851866.851774:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.851775:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851866.851776:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851866.851777:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.851778:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.851780:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851866.851780:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851866.851780:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851866.851781:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851866.851781:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26195@kfi7, seq: 2055516
00000100:00000040:28.0:1773851866.851782:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000035883774 : new rpc_count 1
00000100:00000001:31.0:1773851866.851783:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.851783:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309674496 : -106988399877120 : ffff9eb1d26e2400)
00000100:00000001:31.0:1773851866.851784:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851866.851784:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3705785 x1859598771482816/t0(0) o400->dc66b26a-f828-4fce-ae61-fc752be8ece0@26195@kfi7:654/0 lens 224/0 e 0 to 0 dl 1773852014 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2134-0'
00000100:00000001:28.0:1773851866.851787:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851866.851787:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851866.851788:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3705785 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:dc66b26a-f828-4fce-ae61-fc752be8ece0+23:39644:x1859598771482816:12345-26195@kfi7:400:default-tuolumne2134-0
00000100:00000200:28.0:1773851866.851790:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598771482816
00000020:00000001:28.0:1773851866.851791:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851866.851791:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851866.851792:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.851793:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851866.851793:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851866.851794:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851866.851795:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598771482816, found 0 last_xid 1859598771127423
00000020:00000001:28.0:1773851866.851795:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851866.851797:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851866.851798:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851866.851798:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.851799:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851866.851800:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851866.851800:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851866.851801:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000062db5345.
02000000:00000001:28.0:1773851866.851802:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.851803:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.851803:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851866.851804:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260603351, transno 0, xid 1859598771482816
00010000:00000001:28.0:1773851866.851805:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851866.851806:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3705785 x1859598771482816/t0(0) o400->dc66b26a-f828-4fce-ae61-fc752be8ece0@26195@kfi7:654/0 lens 224/224 e 0 to 0 dl 1773852014 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2134-0'
00010000:00000001:28.0:1773851866.851809:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851866.851810:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851866.851810:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=99 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851866.851811:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851866.851812:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004eba6cf2 refcount 3 to 26195@kfi7
00000100:00000001:28.0:1773851866.851813:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526774048 : -107156182777568 : ffff9e8ac1ca4120)
02000000:00000001:28.0:1773851866.851814:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851866.851814:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.851815:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851866.851816:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26194@kfi7
00000400:00000010:28.0:1773851866.851817:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000015fd77cc.
00000100:00000200:28.0:1773851866.851818:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598771482816, offset 224
00000400:00000200:28.0:1773851866.851819:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26194@kfi7
00000400:00000200:28.0:1773851866.851821:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26194@kfi7 to cpt 7
00000400:00000200:28.0:1773851866.851822:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009285141e nid 26194@kfi7 refs 1
00000400:00000200:28.0:1773851866.851823:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009285141e nid 26194@kfi7 refs 2
00000400:00000200:28.0:1773851866.851824:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009285141e nid 26194@kfi7 refs 3
00000400:00000200:28.0:1773851866.851825:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26194@kfi7 local destination
00000400:00000200:28.0:1773851866.851827:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769193:8769193:1024:4294967295] 26194@kfi7 LPNI seq info [761252:761252:16:4294967295]
00000400:00000200:28.0:1773851866.851828:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009285141e nid 26194@kfi7 refs 2
00000400:00000200:28.0:1773851866.851829:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26194@kfi7 to cpt 7
00000400:00000200:28.0:1773851866.851831:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26194@kfi7(26194@kfi7:26194@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851866.851832:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009285141e nid 26194@kfi7 refs 3
00000800:00000200:28.0:1773851866.851834:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851866.851835:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851866.851837:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851866.851839:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c8a Using peer 26194@kfi7(0x100000000000c8a)
00000800:00000200:28.0:1773851866.851843:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x100000000000c8a: rc=0
00000800:00000200:28.0:1773851866.851844:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c8a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851866.851846:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851866.851847:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004eba6cf2 refcount 2 to 26195@kfi7
00010000:00000001:28.0:1773851866.851848:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851866.851848:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.851849:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851866.851850:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3705785 x1859598771482816/t0(0) o400->dc66b26a-f828-4fce-ae61-fc752be8ece0@26195@kfi7:654/0 lens 224/224 e 0 to 0 dl 1773852014 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2134-0'
00000100:00100000:28.0:1773851866.851854:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3705785 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:dc66b26a-f828-4fce-ae61-fc752be8ece0+23:39644:x1859598771482816:12345-26195@kfi7:400:default-tuolumne2134-0 Request processed in 66us (107us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851866.851857:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26195@kfi7, seq: 2055516
00000100:00000040:28.0:1773851866.851858:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000035883774 : new rpc_count 0
00000100:00000001:28.0:1773851866.851858:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851866.851859:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851866.851859:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:28.0:1773851866.851860:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d6f9657e.
00000020:00000010:28.0:1773851866.851861:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b4f0eb.
00000020:00000040:28.0:1773851866.851862:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000035883774 : new refcount 22
00000100:00000001:28.0:1773851866.851864:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851866.851868:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c8a TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851866.851870:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.851871:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26194@kfi7: PUT: OK
00000400:00000200:29.0:1773851866.851872:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000015fd77cc
00000400:00000010:29.0:1773851866.851872:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000015fd77cc.
00000100:00000001:29.0:1773851866.851873:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851866.851873:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851866.851874:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009285141e nid 26194@kfi7 refs 2
00000800:00000200:29.0:1773851866.851875:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 26194@kfi7(00000000937607e6):0x0 lsk 3211 rsk 1 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c8a Transaction freed
00000800:00000200:5.0:1773851866.889386:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.889387:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851866.889388:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851866.889390:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851866.889392:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24210@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.889393:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24210@kfi7 : PUT - for me
00000400:00000200:5.0:1773851866.889394:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24210@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.889395:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062761ee6 nid 24210@kfi7 refs 1
00000400:00000200:5.0:1773851866.889395:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24210@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.889396:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062761ee6 nid 24210@kfi7 refs 2
00000400:00000200:5.0:1773851866.889397:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062761ee6 nid 24210@kfi7 refs 3
00000400:00000200:5.0:1773851866.889398:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24211@kfi7 to cpt 4
00000400:00000200:5.0:1773851866.889399:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24211@kfi7 of length 224 into portal 12 MB=0x699e15ee29500
00000400:00000200:5.0:1773851866.889400:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24211@kfi7 of length 224/224 into md 0x793926dc5 [64] + 134776
00000800:00000200:5.0:1773851866.889402:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851866.889403:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851866.889404:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24210@kfi7: PUT: OK
00000100:00000001:5.0:1773851866.889405:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851866.889406:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851866.889407:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c03adc63.
00000100:00000040:5.0:1773851866.889407:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000c03adc63 x1858043098862848 msgsize 224
00000100:00100000:5.0:1773851866.889409:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-24211@kfi7 (source: 12345-24210@kfi7)
00000100:00000001:5.0:1773851866.889411:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851866.889411:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000062761ee6 nid 24210@kfi7 refs 2
00000800:00000200:5.0:1773851866.889413:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851866.889415:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851866.889416:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851866.889416:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851866.889417:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851866.889418:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851866.889418:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043098862848
00000020:00000001:5.0:1773851866.889419:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851866.889419:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ccb
00000020:00000001:5.0:1773851866.889420:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851866.889422:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000688c4060 refcount=6
00000020:00000001:5.0:1773851866.889422:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744172544 : -107128965379072 : ffff9e911812cc00)
00000020:00000001:5.0:1773851866.889423:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744172544 : -107128965379072 : ffff9e911812cc00)
00000100:00000001:5.0:1773851866.889424:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.889425:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851866.889426:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e0af6c38.
00000020:00000010:5.0:1773851866.889427:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.889428:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008260bf32.
00000100:00000001:5.0:1773851866.889428:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851866.889429:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851866.889429:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851866.889430:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851866.889431:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851866.889431:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.889432:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851866.889433:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851866.889434:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851866.889434:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851866.889434:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851866.889434:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24211@kfi7, seq: 2001914
00000100:00000001:7.0:1773851866.889435:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.889435:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000688c4060 : new rpc_count 1
00000100:00000001:7.0:1773851866.889436:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.889436:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886781952 : -106955822769664 : ffff9eb9682d5a00)
00000100:00000040:5.0:1773851866.889437:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c03adc63 x1858043098862848/t0(0) o400->dcd09183-4e66-4141-a37c-6e6abfefc4f9@24211@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2006-0'
00000100:00000001:5.0:1773851866.889440:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851866.889441:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851866.889441:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c03adc63 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:dcd09183-4e66-4141-a37c-6e6abfefc4f9+6:39717:x1858043098862848:12345-24211@kfi7:400:default-tuolumne2006-0
00000100:00000200:5.0:1773851866.889442:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043098862848
00000020:00000001:5.0:1773851866.889443:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851866.889444:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851866.889444:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.889445:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851866.889445:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851866.889446:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851866.889447:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043098862848, found 0 last_xid 1858043098862847
00000020:00000001:5.0:1773851866.889447:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851866.889448:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851866.889449:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851866.889449:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.889450:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851866.889451:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851866.889451:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851866.889452:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008a5197c3.
02000000:00000001:5.0:1773851866.889452:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.889453:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.889454:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851866.889454:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044132755, transno 0, xid 1858043098862848
00010000:00000001:5.0:1773851866.889455:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851866.889456:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c03adc63 x1858043098862848/t0(0) o400->dcd09183-4e66-4141-a37c-6e6abfefc4f9@24211@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2006-0'
00010000:00000001:5.0:1773851866.889458:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851866.889459:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851866.889460:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=98 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851866.889460:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851866.889461:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000066df97c refcount 3 to 24211@kfi7
00000100:00000001:5.0:1773851866.889462:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916961338688 : -107156748212928 : ffff9e8aa0166540)
02000000:00000001:5.0:1773851866.889464:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851866.889464:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851866.889465:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851866.889465:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24210@kfi7
00000400:00000010:5.0:1773851866.889466:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e34c40c.
00000100:00000200:5.0:1773851866.889467:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043098862848, offset 224
00000400:00000200:5.0:1773851866.889468:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24210@kfi7
00000400:00000200:5.0:1773851866.889469:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24210@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.889469:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062761ee6 nid 24210@kfi7 refs 1
00000400:00000200:5.0:1773851866.889470:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062761ee6 nid 24210@kfi7 refs 2
00000400:00000200:5.0:1773851866.889471:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062761ee6 nid 24210@kfi7 refs 3
00000400:00000200:5.0:1773851866.889472:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24210@kfi7 local destination
00000400:00000200:5.0:1773851866.889474:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769194:8769194:1024:4294967295] 24210@kfi7 LPNI seq info [2086539:2086539:16:4294967295]
00000400:00000200:5.0:1773851866.889475:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000062761ee6 nid 24210@kfi7 refs 2
00000400:00000200:5.0:1773851866.889476:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24210@kfi7 to cpt 1
00000400:00000200:5.0:1773851866.889478:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24210@kfi7(24210@kfi7:24210@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851866.889479:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062761ee6 nid 24210@kfi7 refs 3
00000800:00000200:5.0:1773851866.889480:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851866.889481:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851866.889483:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851866.889485:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb45 Using peer 24210@kfi7(0xb45)
00000800:00000200:5.0:1773851866.889488:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0xb45: rc=0
00000800:00000200:5.0:1773851866.889489:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb45 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851866.889491:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851866.889492:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000066df97c refcount 2 to 24211@kfi7
00010000:00000001:5.0:1773851866.889492:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851866.889493:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851866.889494:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851866.889495:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c03adc63 x1858043098862848/t0(0) o400->dcd09183-4e66-4141-a37c-6e6abfefc4f9@24211@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2006-0'
00000100:00100000:5.0:1773851866.889498:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c03adc63 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:dcd09183-4e66-4141-a37c-6e6abfefc4f9+6:39717:x1858043098862848:12345-24211@kfi7:400:default-tuolumne2006-0 Request processed in 57us (90us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851866.889500:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24211@kfi7, seq: 2001914
00000800:00000200:6.0:1773851866.889501:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb45 TN_EVENT_TX_OK event status 0
00000100:00000040:5.0:1773851866.889501:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000688c4060 : new rpc_count 0
00000100:00000001:5.0:1773851866.889501:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851866.889502:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851866.889503:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851866.889503:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851866.889503:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008260bf32.
00000400:00000200:6.0:1773851866.889504:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24210@kfi7: PUT: OK
00000400:00000200:6.0:1773851866.889504:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e34c40c
00000020:00000010:5.0:1773851866.889504:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e0af6c38.
00000400:00000010:6.0:1773851866.889505:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e34c40c.
00000100:00000001:6.0:1773851866.889505:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:5.0:1773851866.889505:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000688c4060 : new refcount 5
00000100:00000001:5.0:1773851866.889505:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851866.889506:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851866.889507:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000062761ee6 nid 24210@kfi7 refs 2
00000800:00000200:6.0:1773851866.889508:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 24210@kfi7(00000000b33ca307):0x0 lsk 2886 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb45 Transaction freed
00000800:00000200:17.0:1773851866.893075:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.893076:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.893077:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.893080:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.893082:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14370@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.893083:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14370@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.893084:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14370@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.893086:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa644d83 nid 14370@kfi7 refs 1
00000400:00000200:17.0:1773851866.893086:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14370@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.893087:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa644d83 nid 14370@kfi7 refs 2
00000400:00000200:17.0:1773851866.893088:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fa644d83 nid 14370@kfi7 refs 3
00000400:00000200:17.0:1773851866.893089:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14562@kfi7 to cpt 7
00000400:00000200:17.0:1773851866.893090:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14562@kfi7 of length 224 into portal 12 MB=0x69b4b61f7ea00
00000400:00000200:17.0:1773851866.893091:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14562@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 9656
00000800:00000200:17.0:1773851866.893092:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.893094:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.893095:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14370@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.893096:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.893096:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.893097:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042b81953.
00000100:00000040:17.0:1773851866.893098:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000042b81953 x1859597928753664 msgsize 224
00000100:00100000:17.0:1773851866.893099:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14562@kfi7 (source: 12345-14370@kfi7)
00000100:00000001:17.0:1773851866.893101:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.893102:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa644d83 nid 14370@kfi7 refs 2
00000800:00000200:17.0:1773851866.893103:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.893105:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.893106:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.893106:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.893107:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.893108:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.893108:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597928753664
00000020:00000001:17.0:1773851866.893109:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.893110:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f233
00000020:00000001:17.0:1773851866.893110:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.893112:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fb153da9 refcount=5
00000020:00000001:17.0:1773851866.893113:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132127493120 : -106941582058496 : ffff9ebcb8fd5c00)
00000020:00000001:17.0:1773851866.893114:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132127493120 : -106941582058496 : ffff9ebcb8fd5c00)
00000100:00000001:17.0:1773851866.893115:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.893116:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.893116:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.893117:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.893118:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.893119:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.893119:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.893120:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.893121:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.893121:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.893121:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.893122:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.893123:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.893124:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.893124:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.893124:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.893125:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14562@kfi7, seq: 2156320
00000100:00000040:17.0:1773851866.893125:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fb153da9 : new rpc_count 1
00000100:00000001:16.0:1773851866.893125:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.893126:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093909504 : -107022615642112 : ffff9ea9db030000)
00000100:00000001:16.0:1773851866.893126:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.893127:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042b81953 x1859597928753664/t0(0) o400->2e3a862b-6810-403e-b896-a84641244131@14562@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1387-0'
00000100:00000001:17.0:1773851866.893130:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.893130:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.893131:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042b81953 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e3a862b-6810-403e-b896-a84641244131+5:39585:x1859597928753664:12345-14562@kfi7:400:default-tuolumne1387-0
00000100:00000200:17.0:1773851866.893133:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597928753664
00000020:00000001:17.0:1773851866.893133:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.893134:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.893134:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.893135:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.893136:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.893136:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.893137:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597928753664, found 0 last_xid 1859597928753663
00000020:00000001:17.0:1773851866.893138:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.893138:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.893139:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.893139:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.893140:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.893141:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.893141:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.893142:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e287b3bd.
02000000:00000001:17.0:1773851866.893143:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.893143:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.893144:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.893145:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676018493, transno 0, xid 1859597928753664
00010000:00000001:17.0:1773851866.893145:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.893146:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042b81953 x1859597928753664/t0(0) o400->2e3a862b-6810-403e-b896-a84641244131@14562@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1387-0'
00010000:00000001:17.0:1773851866.893148:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.893149:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.893150:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.893151:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.893151:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000483bbef6 refcount 3 to 14562@kfi7
00000100:00000001:17.0:1773851866.893152:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271776 : -107152618279840 : ffff9e8b96402c60)
02000000:00000001:17.0:1773851866.893153:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.893153:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.893154:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.893155:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14370@kfi7
00000400:00000010:17.0:1773851866.893155:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fff506eb.
00000100:00000200:17.0:1773851866.893156:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597928753664, offset 224
00000400:00000200:17.0:1773851866.893157:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14370@kfi7
00000400:00000200:17.0:1773851866.893158:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14370@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.893158:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa644d83 nid 14370@kfi7 refs 1
00000400:00000200:17.0:1773851866.893160:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fa644d83 nid 14370@kfi7 refs 2
00000400:00000200:17.0:1773851866.893161:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fa644d83 nid 14370@kfi7 refs 3
00000400:00000200:17.0:1773851866.893162:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14370@kfi7 local destination
00000400:00000200:17.0:1773851866.893163:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769195:8769195:1024:4294967295] 14370@kfi7 LPNI seq info [554391:554391:16:4294967295]
00000400:00000200:17.0:1773851866.893164:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fa644d83 nid 14370@kfi7 refs 2
00000400:00000200:17.0:1773851866.893165:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14370@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.893167:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14370@kfi7(14370@kfi7:14370@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.893170:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fa644d83 nid 14370@kfi7 refs 3
00000800:00000200:17.0:1773851866.893171:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.893172:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.893174:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.893176:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c02 Using peer 14370@kfi7(0x100000000000c02)
00000800:00000200:17.0:1773851866.893179:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x100000000000c02: rc=0
00000800:00000200:17.0:1773851866.893180:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c02 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.893182:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.893183:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000483bbef6 refcount 2 to 14562@kfi7
00010000:00000001:17.0:1773851866.893184:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.893185:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.893185:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.893186:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042b81953 x1859597928753664/t0(0) o400->2e3a862b-6810-403e-b896-a84641244131@14562@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1387-0'
00000100:00100000:17.0:1773851866.893189:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042b81953 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e3a862b-6810-403e-b896-a84641244131+5:39585:x1859597928753664:12345-14562@kfi7:400:default-tuolumne1387-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.893192:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14562@kfi7, seq: 2156320
00000800:00000200:18.0:1773851866.893193:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c02 TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851866.893193:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fb153da9 : new rpc_count 0
00000100:00000001:17.0:1773851866.893193:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851866.893194:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851866.893194:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851866.893195:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851866.893195:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851866.893196:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14370@kfi7: PUT: OK
00000020:00000010:17.0:1773851866.893196:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000400:00000200:18.0:1773851866.893197:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fff506eb
00000400:00000010:18.0:1773851866.893197:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fff506eb.
00000020:00000040:17.0:1773851866.893197:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000fb153da9 : new refcount 4
00000100:00000001:17.0:1773851866.893197:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851866.893198:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.893198:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.893199:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa644d83 nid 14370@kfi7 refs 2
00000800:00000200:18.0:1773851866.893200:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 14370@kfi7(00000000d84dcb1f):0x0 lsk 3075 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c02 Transaction freed
00000800:00000200:17.0:1773851866.909589:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.909589:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.909591:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.909593:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.909595:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11393@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.909596:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11393@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.909597:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11393@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.909598:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ca6dba8 nid 11393@kfi7 refs 1
00000400:00000200:17.0:1773851866.909599:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11393@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.909599:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ca6dba8 nid 11393@kfi7 refs 2
00000400:00000200:17.0:1773851866.909600:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006ca6dba8 nid 11393@kfi7 refs 3
00000400:00000200:17.0:1773851866.909601:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11328@kfi7 to cpt 5
00000400:00000200:17.0:1773851866.909602:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11328@kfi7 of length 224 into portal 12 MB=0x69b4c3dd6d9c0
00000400:00000200:17.0:1773851866.909603:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11328@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 9880
00000800:00000200:17.0:1773851866.909604:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.909606:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.909607:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11393@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.909608:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.909608:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.909609:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000289dd977.
00000100:00000040:17.0:1773851866.909609:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000289dd977 x1859601617574336 msgsize 224
00000100:00100000:17.0:1773851866.909610:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-11328@kfi7 (source: 12345-11393@kfi7)
00000100:00000001:17.0:1773851866.909611:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.909612:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006ca6dba8 nid 11393@kfi7 refs 2
00000800:00000200:17.0:1773851866.909613:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.909616:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.909616:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.909616:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.909617:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.909618:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.909618:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617574336
00000020:00000001:17.0:1773851866.909619:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.909619:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e622599b6
00000020:00000001:17.0:1773851866.909620:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.909623:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c222e4b6 refcount=5
00000020:00000001:17.0:1773851866.909623:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637087592268800 : -106986117282816 : ffff9eb25a7bc400)
00000020:00000001:17.0:1773851866.909624:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637087592268800 : -106986117282816 : ffff9eb25a7bc400)
00000100:00000001:17.0:1773851866.909625:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.909625:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.909626:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.909627:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.909627:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.909628:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.909628:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.909629:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.909629:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.909630:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.909630:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.909631:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.909632:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.909632:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.909632:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851866.909633:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11328@kfi7, seq: 2156321
00000100:00000001:16.0:1773851866.909633:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851866.909634:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c222e4b6 : new rpc_count 1
00000100:00000001:17.0:1773851866.909634:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093932544 : -107022615619072 : ffff9ea9db035a00)
00000100:00000001:16.0:1773851866.909634:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851866.909634:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.909635:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000289dd977 x1859601617574336/t0(0) o400->c42f589f-1b61-4e83-9257-1f42277abe72@11328@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1204-0'
00000100:00000001:17.0:1773851866.909637:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.909638:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.909639:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000289dd977 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c42f589f-1b61-4e83-9257-1f42277abe72+5:39649:x1859601617574336:12345-11328@kfi7:400:default-tuolumne1204-0
00000100:00000200:17.0:1773851866.909640:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601617574336
00000020:00000001:17.0:1773851866.909640:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.909641:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.909642:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.909642:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.909642:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.909643:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.909644:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601617574336, found 0 last_xid 1859601617574335
00000020:00000001:17.0:1773851866.909644:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.909645:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.909645:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.909646:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.909646:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.909646:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.909647:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.909647:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ba77d68e.
02000000:00000001:17.0:1773851866.909648:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.909648:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.909649:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.909649:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035356298, transno 0, xid 1859601617574336
00010000:00000001:17.0:1773851866.909650:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.909651:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000289dd977 x1859601617574336/t0(0) o400->c42f589f-1b61-4e83-9257-1f42277abe72@11328@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1204-0'
00010000:00000001:17.0:1773851866.909653:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.909653:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.909654:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.909655:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.909655:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a5a674a4 refcount 3 to 11328@kfi7
00000100:00000001:17.0:1773851866.909656:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096992 : -107139307454624 : ffff9e8eafa33f60)
02000000:00000001:17.0:1773851866.909657:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.909657:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.909657:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.909658:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11393@kfi7
00000400:00000010:17.0:1773851866.909659:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089702b40.
00000100:00000200:17.0:1773851866.909659:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601617574336, offset 224
00000400:00000200:17.0:1773851866.909661:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11393@kfi7
00000400:00000200:17.0:1773851866.909661:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11393@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.909662:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ca6dba8 nid 11393@kfi7 refs 1
00000400:00000200:17.0:1773851866.909663:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006ca6dba8 nid 11393@kfi7 refs 2
00000400:00000200:17.0:1773851866.909664:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006ca6dba8 nid 11393@kfi7 refs 3
00000400:00000200:17.0:1773851866.909665:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11393@kfi7 local destination
00000400:00000200:17.0:1773851866.909666:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769196:8769196:1024:4294967295] 11393@kfi7 LPNI seq info [1316167:1316167:16:4294967295]
00000400:00000200:17.0:1773851866.909668:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006ca6dba8 nid 11393@kfi7 refs 2
00000400:00000200:17.0:1773851866.909669:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11393@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.909670:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11393@kfi7(11393@kfi7:11393@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.909671:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006ca6dba8 nid 11393@kfi7 refs 3
00000800:00000200:17.0:1773851866.909672:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.909673:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.909675:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.909677:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf61 Using peer 11393@kfi7(0xf61)
00000800:00000200:17.0:1773851866.909680:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0xf61: rc=0
00000800:00000200:17.0:1773851866.909681:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf61 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.909683:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.909683:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a5a674a4 refcount 2 to 11328@kfi7
00010000:00000001:17.0:1773851866.909684:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.909684:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.909685:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.909686:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000289dd977 x1859601617574336/t0(0) o400->c42f589f-1b61-4e83-9257-1f42277abe72@11328@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1204-0'
00000100:00100000:17.0:1773851866.909688:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000289dd977 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c42f589f-1b61-4e83-9257-1f42277abe72+5:39649:x1859601617574336:12345-11328@kfi7:400:default-tuolumne1204-0 Request processed in 50us (78us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.909690:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11328@kfi7, seq: 2156321
00000100:00000040:17.0:1773851866.909691:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c222e4b6 : new rpc_count 0
00000100:00000001:17.0:1773851866.909691:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851866.909692:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851866.909693:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.909693:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000800:00000200:18.0:1773851866.909694:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf61 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851866.909694:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000020:00000040:17.0:1773851866.909694:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000c222e4b6 : new refcount 4
00000400:00000200:18.0:1773851866.909695:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851866.909695:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851866.909696:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11393@kfi7: PUT: OK
00000400:00000200:18.0:1773851866.909697:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089702b40
00000400:00000010:18.0:1773851866.909698:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089702b40.
00000100:00000001:18.0:1773851866.909698:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851866.909698:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851866.909699:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006ca6dba8 nid 11393@kfi7 refs 2
00000800:00000200:18.0:1773851866.909700:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 11393@kfi7(00000000657e2ccf):0x0 lsk 3938 rsk 37 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf61 Transaction freed
00000800:00000200:29.0:1773851866.911336:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851866.911337:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851866.911338:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851866.911341:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851866.911342:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12211@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.911344:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12211@kfi7 : PUT - for me
00000400:00000200:29.0:1773851866.911344:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12211@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.911345:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c50a10e2 nid 12211@kfi7 refs 1
00000400:00000200:29.0:1773851866.911347:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12211@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.911348:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c50a10e2 nid 12211@kfi7 refs 2
00000400:00000200:29.0:1773851866.911349:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c50a10e2 nid 12211@kfi7 refs 3
00000400:00000200:29.0:1773851866.911350:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12211@kfi7 to cpt 7
00000400:00000200:29.0:1773851866.911351:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12211@kfi7 of length 224 into portal 12 MB=0x69b4bb06c32c0
00000400:00000200:29.0:1773851866.911352:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12211@kfi7 of length 224/224 into md 0x77fe139dd [64] + 174856
00000800:00000200:29.0:1773851866.911354:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851866.911355:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.911356:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12211@kfi7: PUT: OK
00000100:00000001:29.0:1773851866.911357:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851866.911357:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851866.911358:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000053710b31.
00000100:00000040:29.0:1773851866.911359:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000053710b31 x1859599244997312 msgsize 224
00000100:00100000:29.0:1773851866.911361:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12211@kfi7 (source: 12345-12211@kfi7)
00000100:00000001:29.0:1773851866.911362:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851866.911362:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c50a10e2 nid 12211@kfi7 refs 2
00000100:00000001:28.0:1773851866.911363:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851866.911364:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851866.911364:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851866.911364:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851866.911365:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851866.911365:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851866.911366:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599244997312
00000020:00000001:28.0:1773851866.911367:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851866.911367:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f7a4
00000020:00000001:28.0:1773851866.911368:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851866.911372:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000095b15cf1 refcount=5
00000020:00000001:28.0:1773851866.911372:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144155581440 : -106929553970176 : ffff9ebf85eb6c00)
00000020:00000001:28.0:1773851866.911373:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144155581440 : -106929553970176 : ffff9ebf85eb6c00)
00000100:00000001:28.0:1773851866.911374:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851866.911375:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851866.911376:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9820241.
00000020:00000010:28.0:1773851866.911377:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851866.911378:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851866.911379:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851866.911379:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851866.911380:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.911381:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851866.911382:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851866.911382:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.911383:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.911384:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851866.911385:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851866.911386:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851866.911386:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851866.911386:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12211@kfi7, seq: 2055517
00000100:00000001:31.0:1773851866.911387:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851866.911387:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000095b15cf1 : new rpc_count 1
00000100:00000001:31.0:1773851866.911388:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.911388:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309688320 : -106988399863296 : ffff9eb1d26e5a00)
00000100:00000040:28.0:1773851866.911389:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000053710b31 x1859599244997312/t0(0) o400->9fec3948-a77e-4478-8e29-b065e1abe441@12211@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1242-0'
00000100:00000001:28.0:1773851866.911392:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851866.911392:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851866.911394:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053710b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:9fec3948-a77e-4478-8e29-b065e1abe441+5:39605:x1859599244997312:12345-12211@kfi7:400:default-tuolumne1242-0
00000100:00000200:28.0:1773851866.911396:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599244997312
00000020:00000001:28.0:1773851866.911396:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851866.911397:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851866.911398:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.911398:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851866.911399:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851866.911400:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851866.911400:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599244997312, found 0 last_xid 1859599244997311
00000020:00000001:28.0:1773851866.911401:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851866.911402:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851866.911402:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851866.911403:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.911403:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851866.911404:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851866.911404:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851866.911405:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000792e21df.
02000000:00000001:28.0:1773851866.911406:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.911407:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.911407:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851866.911408:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098826655, transno 0, xid 1859599244997312
00010000:00000001:28.0:1773851866.911409:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851866.911409:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000053710b31 x1859599244997312/t0(0) o400->9fec3948-a77e-4478-8e29-b065e1abe441@12211@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1242-0'
00010000:00000001:28.0:1773851866.911412:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851866.911412:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851866.911413:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=99 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851866.911414:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851866.911415:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a87e4d82 refcount 3 to 12211@kfi7
00000100:00000001:28.0:1773851866.911415:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063072 : -107155994488544 : ffff9e8acd035120)
02000000:00000001:28.0:1773851866.911416:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851866.911417:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.911417:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851866.911419:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12211@kfi7
00000400:00000010:28.0:1773851866.911419:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000069139332.
00000100:00000200:28.0:1773851866.911420:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599244997312, offset 224
00000400:00000200:28.0:1773851866.911421:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12211@kfi7
00000400:00000200:28.0:1773851866.911422:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12211@kfi7 to cpt 7
00000400:00000200:28.0:1773851866.911423:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c50a10e2 nid 12211@kfi7 refs 1
00000400:00000200:28.0:1773851866.911423:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c50a10e2 nid 12211@kfi7 refs 2
00000400:00000200:28.0:1773851866.911425:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c50a10e2 nid 12211@kfi7 refs 3
00000400:00000200:28.0:1773851866.911426:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12211@kfi7 local destination
00000400:00000200:28.0:1773851866.911427:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769197:8769197:1024:4294967295] 12211@kfi7 LPNI seq info [7239889:7239889:16:4294967295]
00000400:00000200:28.0:1773851866.911428:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c50a10e2 nid 12211@kfi7 refs 2
00000400:00000200:28.0:1773851866.911429:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12211@kfi7 to cpt 7
00000400:00000200:28.0:1773851866.911431:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12211@kfi7(12211@kfi7:12211@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851866.911432:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c50a10e2 nid 12211@kfi7 refs 3
00000800:00000200:28.0:1773851866.911433:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851866.911434:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851866.911436:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851866.911439:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd8 Using peer 12211@kfi7(0xd8)
00000800:00000200:28.0:1773851866.911442:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0xd8: rc=0
00000800:00000200:28.0:1773851866.911443:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851866.911445:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851866.911446:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a87e4d82 refcount 2 to 12211@kfi7
00010000:00000001:28.0:1773851866.911446:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851866.911447:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851866.911447:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851866.911448:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000053710b31 x1859599244997312/t0(0) o400->9fec3948-a77e-4478-8e29-b065e1abe441@12211@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1242-0'
00000100:00100000:28.0:1773851866.911457:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053710b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:9fec3948-a77e-4478-8e29-b065e1abe441+5:39605:x1859599244997312:12345-12211@kfi7:400:default-tuolumne1242-0 Request processed in 64us (97us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851866.911460:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12211@kfi7, seq: 2055517
00000100:00000040:28.0:1773851866.911460:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000095b15cf1 : new rpc_count 0
00000100:00000001:28.0:1773851866.911461:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851866.911462:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851866.911462:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851866.911463:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851866.911464:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9820241.
00000020:00000040:28.0:1773851866.911465:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000095b15cf1 : new refcount 4
00000100:00000001:28.0:1773851866.911465:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851866.911470:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd8 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851866.911472:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.911473:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12211@kfi7: PUT: OK
00000400:00000200:29.0:1773851866.911473:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000069139332
00000400:00000010:29.0:1773851866.911474:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000069139332.
00000100:00000001:29.0:1773851866.911475:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851866.911475:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851866.911476:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c50a10e2 nid 12211@kfi7 refs 2
00000800:00000200:29.0:1773851866.911477:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 12211@kfi7(00000000da965e3a):0x0 lsk 217 rsk 37 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd8 Transaction freed
00000800:00000200:1.0:1773851866.920779:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.920780:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851866.920782:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851866.920784:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851866.920786:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23571@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.920787:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23571@kfi7 : PUT - for me
00000400:00000200:1.0:1773851866.920788:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23571@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.920789:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008554ce43 nid 23571@kfi7 refs 1
00000400:00000200:1.0:1773851866.920790:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23571@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.920791:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008554ce43 nid 23571@kfi7 refs 2
00000400:00000200:1.0:1773851866.920792:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008554ce43 nid 23571@kfi7 refs 3
00000400:00000200:1.0:1773851866.920793:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23763@kfi7 to cpt 3
00000400:00000200:1.0:1773851866.920794:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23763@kfi7 of length 224 into portal 12 MB=0x699e1b65b0440
00000400:00000200:1.0:1773851866.920795:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23763@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 28504
00000800:00000200:1.0:1773851866.920796:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851866.920798:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851866.920800:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23571@kfi7: PUT: OK
00000100:00000001:1.0:1773851866.920801:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851866.920802:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851866.920803:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006bc77438.
00000100:00000040:1.0:1773851866.920803:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000006bc77438 x1858044566373440 msgsize 224
00000100:00100000:1.0:1773851866.920805:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-23763@kfi7 (source: 12345-23571@kfi7)
00000100:00000001:1.0:1773851866.920806:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851866.920806:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008554ce43 nid 23571@kfi7 refs 2
00000800:00000200:1.0:1773851866.920808:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851866.920808:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851866.920809:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851866.920810:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851866.920811:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851866.920812:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851866.920813:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044566373440
00000020:00000001:0.0:1773851866.920814:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851866.920815:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c0e
00000020:00000001:0.0:1773851866.920816:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851866.920819:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000da6c67c9 refcount=6
00000020:00000001:0.0:1773851866.920820:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743924736 : -107128965626880 : ffff9e91180f0400)
00000020:00000001:0.0:1773851866.920821:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743924736 : -107128965626880 : ffff9e91180f0400)
00000100:00000001:0.0:1773851866.920823:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851866.920824:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851866.920825:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000513fa2ef.
00000020:00000010:0.0:1773851866.920827:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851866.920829:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851866.920830:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851866.920830:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851866.920831:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851866.920833:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851866.920834:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851866.920835:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851866.920836:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851866.920837:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851866.920838:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851866.920838:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:1.0:1773851866.920839:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23763@kfi7, seq: 1997558
00000100:00000001:0.0:1773851866.920839:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:1.0:1773851866.920840:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000da6c67c9 : new rpc_count 1
00000100:00000001:0.0:1773851866.920840:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851866.920841:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599704192 : -107004109847424 : ffff9eae2a0b0480)
00000100:00000001:0.0:1773851866.920841:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851866.920842:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006bc77438 x1858044566373440/t0(0) o400->133f3314-a98e-4b20-908f-ba16ad4b7264@23763@kfi7:506/0 lens 224/0 e 0 to 0 dl 1773852621 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1973-0'
00000100:00000001:1.0:1773851866.920845:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851866.920845:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851866.920846:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006bc77438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:133f3314-a98e-4b20-908f-ba16ad4b7264+6:39650:x1858044566373440:12345-23763@kfi7:400:default-tuolumne1973-0
00000100:00000200:1.0:1773851866.920848:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044566373440
00000020:00000001:1.0:1773851866.920848:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851866.920849:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851866.920850:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851866.920851:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851866.920851:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851866.920852:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851866.920853:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044566373440, found 0 last_xid 1858044566373439
00000020:00000001:1.0:1773851866.920854:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851866.920854:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851866.920855:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851866.920856:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851866.920858:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851866.920858:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851866.920859:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851866.920860:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab5a0507.
02000000:00000001:1.0:1773851866.920861:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851866.920861:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851866.920862:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851866.920863:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044153028, transno 0, xid 1858044566373440
00010000:00000001:1.0:1773851866.920864:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851866.920865:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006bc77438 x1858044566373440/t0(0) o400->133f3314-a98e-4b20-908f-ba16ad4b7264@23763@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1973-0'
00010000:00000001:1.0:1773851866.920868:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851866.920868:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851866.920869:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=99 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851866.920870:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851866.920871:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000084eb6e1b refcount 3 to 23763@kfi7
00000100:00000001:1.0:1773851866.920872:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150400 : -107154898401216 : ffff9e8b0e584840)
02000000:00000001:1.0:1773851866.920873:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851866.920874:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851866.920874:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851866.920875:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23571@kfi7
00000400:00000010:1.0:1773851866.920876:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f672ead.
00000100:00000200:1.0:1773851866.920877:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044566373440, offset 224
00000400:00000200:1.0:1773851866.920879:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23571@kfi7
00000400:00000200:1.0:1773851866.920880:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23571@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.920881:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008554ce43 nid 23571@kfi7 refs 1
00000400:00000200:1.0:1773851866.920882:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008554ce43 nid 23571@kfi7 refs 2
00000400:00000200:1.0:1773851866.920883:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008554ce43 nid 23571@kfi7 refs 3
00000400:00000200:1.0:1773851866.920884:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23571@kfi7 local destination
00000400:00000200:1.0:1773851866.920886:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769198:8769198:1024:4294967295] 23571@kfi7 LPNI seq info [2590711:2590711:16:4294967295]
00000400:00000200:1.0:1773851866.920888:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008554ce43 nid 23571@kfi7 refs 2
00000400:00000200:1.0:1773851866.920888:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23571@kfi7 to cpt 0
00000400:00000200:1.0:1773851866.920891:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23571@kfi7(23571@kfi7:23571@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851866.920893:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008554ce43 nid 23571@kfi7 refs 3
00000800:00000200:1.0:1773851866.920894:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851866.920896:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851866.920898:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851866.920901:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d95 Using peer 23571@kfi7(0x100000000000d95)
00000800:00000200:1.0:1773851866.920905:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 324 bytes to peer 0x100000000000d95: rc=0
00000800:00000200:1.0:1773851866.920907:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d95 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851866.920910:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851866.920911:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000084eb6e1b refcount 2 to 23763@kfi7
00010000:00000001:1.0:1773851866.920912:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851866.920912:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851866.920913:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851866.920914:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006bc77438 x1858044566373440/t0(0) o400->133f3314-a98e-4b20-908f-ba16ad4b7264@23763@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1973-0'
00000100:00100000:1.0:1773851866.920918:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006bc77438 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:133f3314-a98e-4b20-908f-ba16ad4b7264+6:39650:x1858044566373440:12345-23763@kfi7:400:default-tuolumne1973-0 Request processed in 72us (114us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851866.920921:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23763@kfi7, seq: 1997558
00000100:00000040:1.0:1773851866.920922:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000da6c67c9 : new rpc_count 0
00000100:00000001:1.0:1773851866.920923:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851866.920924:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851866.920925:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000800:00000200:3.0:1773851866.920926:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d95 TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851866.920926:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:1.0:1773851866.920927:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000513fa2ef.
00000020:00000040:1.0:1773851866.920928:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000da6c67c9 : new refcount 5
00000100:00000001:1.0:1773851866.920929:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851866.920934:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851866.920936:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23571@kfi7: PUT: OK
00000400:00000200:3.0:1773851866.920938:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f672ead
00000400:00000010:3.0:1773851866.920939:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f672ead.
00000100:00000001:3.0:1773851866.920940:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851866.920941:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851866.920943:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008554ce43 nid 23571@kfi7 refs 2
00000800:00000200:3.0:1773851866.920946:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 23571@kfi7(000000005b594576):0x0 lsk 3478 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d95 Transaction freed
00000800:00000200:25.0:1773851866.935717:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851866.935718:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851866.935719:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851866.935722:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851866.935724:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11907@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.935728:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11907@kfi7 : PUT - for me
00000400:00000200:25.0:1773851866.935729:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11907@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.935730:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0360395 nid 11907@kfi7 refs 1
00000400:00000200:25.0:1773851866.935731:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11907@kfi7 to cpt 6
00000400:00000200:25.0:1773851866.935732:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0360395 nid 11907@kfi7 refs 2
00000400:00000200:25.0:1773851866.935733:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0360395 nid 11907@kfi7 refs 3
00000400:00000200:25.0:1773851866.935734:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11906@kfi7 to cpt 3
00000400:00000200:25.0:1773851866.935735:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11906@kfi7 of length 224 into portal 12 MB=0x69b4bc8862000
00000400:00000200:25.0:1773851866.935736:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11906@kfi7 of length 224/224 into md 0x16159c9699 [64] + 8264
00000800:00000200:25.0:1773851866.935738:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851866.935741:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851866.935742:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11907@kfi7: PUT: OK
00000100:00000001:25.0:1773851866.935743:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851866.935743:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851866.935744:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000831a608b.
00000100:00000040:25.0:1773851866.935745:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000831a608b x1859599649349632 msgsize 224
00000100:00100000:25.0:1773851866.935746:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-11906@kfi7 (source: 12345-11907@kfi7)
00000100:00000001:25.0:1773851866.935747:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851866.935748:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0360395 nid 11907@kfi7 refs 2
00000100:00000001:24.0:1773851866.935749:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851866.935749:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851866.935750:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851866.935750:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851866.935750:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851866.935751:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851866.935752:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599649349632
00000020:00000001:24.0:1773851866.935753:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851866.935753:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f8c3
00000020:00000001:24.0:1773851866.935753:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851866.935757:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002628539d refcount=2985
00000020:00000001:24.0:1773851866.935758:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077500888064 : -106996208663552 : ffff9eb000fd8400)
00000020:00000001:24.0:1773851866.935759:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637077500888064 : -106996208663552 : ffff9eb000fd8400)
00000100:00000001:24.0:1773851866.935760:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851866.935760:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851866.935761:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851866.935762:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851866.935763:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000100:00000001:24.0:1773851866.935764:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851866.935764:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851866.935764:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851866.935765:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851866.935766:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851866.935766:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.935767:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851866.935768:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851866.935769:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851866.935769:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851866.935770:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851866.935770:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851866.935770:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11906@kfi7, seq: 2025094
00000100:00000040:24.0:1773851866.935770:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002628539d : new rpc_count 9
00000100:00000001:25.0:1773851866.935771:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.935771:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478773120 : -106938230778496 : ffff9ebd80bdd580)
00000100:00000040:24.0:1773851866.935772:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000831a608b x1859599649349632/t0(0) o400->fce576b6-ae1c-41f5-9897-dae5a1cd5129@11906@kfi7:506/0 lens 224/0 e 0 to 0 dl 1773852621 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1240-0'
00000100:00000001:24.0:1773851866.935774:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851866.935775:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851866.935775:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000831a608b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:fce576b6-ae1c-41f5-9897-dae5a1cd5129+2985:39727:x1859599649349632:12345-11906@kfi7:400:default-tuolumne1240-0
00000100:00000200:24.0:1773851866.935777:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599649349632
00000020:00000001:24.0:1773851866.935777:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851866.935778:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851866.935779:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.935779:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851866.935780:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851866.935780:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851866.935781:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599649349632, found 0 last_xid 1859599647964607
00000020:00000001:24.0:1773851866.935782:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851866.935782:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851866.935783:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851866.935783:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.935784:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851866.935784:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851866.935785:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851866.935786:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005ede3974.
02000000:00000001:24.0:1773851866.935786:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.935787:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.935788:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851866.935788:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592690, transno 0, xid 1859599649349632
00010000:00000001:24.0:1773851866.935789:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851866.935790:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000831a608b x1859599649349632/t0(0) o400->fce576b6-ae1c-41f5-9897-dae5a1cd5129@11906@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1240-0'
00010000:00000001:24.0:1773851866.935792:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851866.935793:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851866.935793:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=99 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851866.935794:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851866.935795:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000056194da refcount 3 to 11906@kfi7
00000100:00000001:24.0:1773851866.935796:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902779168 : -107154806772448 : ffff9e8b13ce6d20)
02000000:00000001:24.0:1773851866.935796:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851866.935797:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851866.935798:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851866.935798:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11907@kfi7
00000400:00000010:24.0:1773851866.935799:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000486ca983.
00000100:00000200:24.0:1773851866.935800:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599649349632, offset 224
00000400:00000200:24.0:1773851866.935801:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11907@kfi7
00000400:00000200:24.0:1773851866.935802:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11907@kfi7 to cpt 6
00000400:00000200:24.0:1773851866.935802:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0360395 nid 11907@kfi7 refs 1
00000400:00000200:24.0:1773851866.935804:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d0360395 nid 11907@kfi7 refs 2
00000400:00000200:24.0:1773851866.935805:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d0360395 nid 11907@kfi7 refs 3
00000400:00000200:24.0:1773851866.935806:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11907@kfi7 local destination
00000400:00000200:24.0:1773851866.935807:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769199:8769199:1024:4294967295] 11907@kfi7 LPNI seq info [25043645:25043645:16:4294967295]
00000400:00000200:24.0:1773851866.935809:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0360395 nid 11907@kfi7 refs 2
00000400:00000200:24.0:1773851866.935809:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11907@kfi7 to cpt 6
00000400:00000200:24.0:1773851866.935811:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11907@kfi7(11907@kfi7:11907@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851866.935812:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d0360395 nid 11907@kfi7 refs 3
00000800:00000200:24.0:1773851866.935814:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851866.935815:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851866.935817:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851866.935819:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdc7 Using peer 11907@kfi7(0xdc7)
00000800:00000200:24.0:1773851866.935821:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0xdc7: rc=0
00000800:00000200:24.0:1773851866.935823:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdc7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851866.935825:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851866.935826:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000056194da refcount 2 to 11906@kfi7
00010000:00000001:24.0:1773851866.935826:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851866.935827:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851866.935827:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851866.935828:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000831a608b x1859599649349632/t0(0) o400->fce576b6-ae1c-41f5-9897-dae5a1cd5129@11906@kfi7:506/0 lens 224/224 e 0 to 0 dl 1773852621 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1240-0'
00000100:00100000:24.0:1773851866.935832:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000831a608b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:fce576b6-ae1c-41f5-9897-dae5a1cd5129+2985:39727:x1859599649349632:12345-11906@kfi7:400:default-tuolumne1240-0 Request processed in 57us (87us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851866.935834:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11906@kfi7, seq: 2025094
00000100:00000040:24.0:1773851866.935835:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002628539d : new rpc_count 8
00000100:00000001:24.0:1773851866.935836:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851866.935837:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851866.935837:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851866.935838:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000020:00000010:24.0:1773851866.935838:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851866.935839:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000002628539d : new refcount 2984
00000100:00000001:24.0:1773851866.935840:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851866.935846:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdc7 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851866.935847:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851866.935848:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11907@kfi7: PUT: OK
00000400:00000200:25.0:1773851866.935849:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000486ca983
00000400:00000010:25.0:1773851866.935850:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000486ca983.
00000100:00000001:25.0:1773851866.935850:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851866.935851:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851866.935852:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0360395 nid 11907@kfi7 refs 2
00000800:00000200:25.0:1773851866.935853:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 11907@kfi7(0000000014a9972d):0x0 lsk 3528 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdc7 Transaction freed
00000800:00000200:17.0:1773851866.937531:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.937532:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851866.937533:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851866.937535:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851866.937537:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15040@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.937539:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15040@kfi7 : PUT - for me
00000400:00000200:17.0:1773851866.937540:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15040@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.937541:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060fb3a8d nid 15040@kfi7 refs 1
00000400:00000200:17.0:1773851866.937542:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15040@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.937542:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060fb3a8d nid 15040@kfi7 refs 2
00000400:00000200:17.0:1773851866.937543:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000060fb3a8d nid 15040@kfi7 refs 3
00000400:00000200:17.0:1773851866.937544:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14848@kfi7 to cpt 1
00000400:00000200:17.0:1773851866.937545:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14848@kfi7 of length 224 into portal 12 MB=0x699e12086e500
00000400:00000200:17.0:1773851866.937546:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14848@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 10104
00000800:00000200:17.0:1773851866.937548:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851866.937549:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851866.937551:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15040@kfi7: PUT: OK
00000100:00000001:17.0:1773851866.937551:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851866.937552:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851866.937553:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000adec4533.
00000100:00000040:17.0:1773851866.937553:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000adec4533 x1858042052666624 msgsize 224
00000100:00100000:17.0:1773851866.937555:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14848@kfi7 (source: 12345-15040@kfi7)
00000100:00000001:17.0:1773851866.937557:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851866.937557:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000060fb3a8d nid 15040@kfi7 refs 2
00000800:00000200:17.0:1773851866.937559:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851866.937561:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851866.937562:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851866.937562:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851866.937563:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851866.937564:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851866.937564:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042052666624
00000020:00000001:17.0:1773851866.937565:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851866.937565:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e2a
00000020:00000001:17.0:1773851866.937566:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851866.937568:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000dd1f70c refcount=169
00000020:00000001:17.0:1773851866.937568:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628775936 : -107123080775680 : ffff9e9276d2b800)
00000020:00000001:17.0:1773851866.937569:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628775936 : -107123080775680 : ffff9e9276d2b800)
00000100:00000001:17.0:1773851866.937570:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.937571:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851866.937571:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000003dbd7be.
00000020:00000010:17.0:1773851866.937572:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.937573:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851866.937574:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851866.937574:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851866.937575:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.937576:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851866.937576:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851866.937577:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.937577:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851866.937579:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851866.937579:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851866.937579:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851866.937579:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851866.937580:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14848@kfi7, seq: 2156322
00000100:00000040:17.0:1773851866.937581:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000dd1f70c : new rpc_count 1
00000100:00000001:17.0:1773851866.937581:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093934848 : -107022615616768 : ffff9ea9db036300)
00000100:00000001:16.0:1773851866.937581:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851866.937581:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.937583:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000adec4533 x1858042052666624/t0(0) o400->cd21aa94-9f33-4364-af72-18771b7316a3@14848@kfi7:87/0 lens 224/0 e 0 to 0 dl 1773852202 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1427-0'
00000100:00000001:17.0:1773851866.937585:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851866.937586:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851866.937587:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000adec4533 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cd21aa94-9f33-4364-af72-18771b7316a3+169:39806:x1858042052666624:12345-14848@kfi7:400:default-tuolumne1427-0
00000100:00000200:17.0:1773851866.937588:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042052666624
00000020:00000001:17.0:1773851866.937589:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851866.937589:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851866.937590:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.937590:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851866.937591:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851866.937592:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851866.937593:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042052666624, found 0 last_xid 1858042052244927
00000020:00000001:17.0:1773851866.937593:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851866.937594:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851866.937595:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851866.937595:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.937596:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851866.937596:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851866.937597:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851866.937597:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e47f245.
02000000:00000001:17.0:1773851866.937598:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.937599:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.937599:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851866.937600:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061845, transno 0, xid 1858042052666624
00010000:00000001:17.0:1773851866.937601:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851866.937601:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000adec4533 x1858042052666624/t0(0) o400->cd21aa94-9f33-4364-af72-18771b7316a3@14848@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1427-0'
00010000:00000001:17.0:1773851866.937604:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851866.937604:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851866.937605:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=99 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851866.937606:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851866.937607:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004290c0bc refcount 3 to 14848@kfi7
00000100:00000001:17.0:1773851866.937608:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740761600 : -107153968790016 : ffff9e8b45c10600)
02000000:00000001:17.0:1773851866.937608:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851866.937609:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851866.937609:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851866.937610:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15040@kfi7
00000400:00000010:17.0:1773851866.937611:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e57d848.
00000100:00000200:17.0:1773851866.937612:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042052666624, offset 224
00000400:00000200:17.0:1773851866.937613:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15040@kfi7
00000400:00000200:17.0:1773851866.937613:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15040@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.937614:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060fb3a8d nid 15040@kfi7 refs 1
00000400:00000200:17.0:1773851866.937615:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000060fb3a8d nid 15040@kfi7 refs 2
00000400:00000200:17.0:1773851866.937616:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000060fb3a8d nid 15040@kfi7 refs 3
00000400:00000200:17.0:1773851866.937617:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15040@kfi7 local destination
00000400:00000200:17.0:1773851866.937618:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769200:8769200:1024:4294967295] 15040@kfi7 LPNI seq info [9594247:9594247:16:4294967295]
00000400:00000200:17.0:1773851866.937619:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000060fb3a8d nid 15040@kfi7 refs 2
00000400:00000200:17.0:1773851866.937620:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15040@kfi7 to cpt 4
00000400:00000200:17.0:1773851866.937622:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15040@kfi7(15040@kfi7:15040@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851866.937623:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000060fb3a8d nid 15040@kfi7 refs 3
00000800:00000200:17.0:1773851866.937624:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851866.937625:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851866.937627:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851866.937629:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x432 Using peer 15040@kfi7(0x432)
00000800:00000200:17.0:1773851866.937632:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x432: rc=0
00000800:00000200:17.0:1773851866.937633:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x432 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851866.937635:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851866.937636:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004290c0bc refcount 2 to 14848@kfi7
00010000:00000001:17.0:1773851866.937637:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851866.937637:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851866.937638:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851866.937638:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000adec4533 x1858042052666624/t0(0) o400->cd21aa94-9f33-4364-af72-18771b7316a3@14848@kfi7:87/0 lens 224/224 e 0 to 0 dl 1773852202 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1427-0'
00000100:00100000:17.0:1773851866.937641:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000adec4533 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cd21aa94-9f33-4364-af72-18771b7316a3+169:39806:x1858042052666624:12345-14848@kfi7:400:default-tuolumne1427-0 Request processed in 55us (87us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851866.937644:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14848@kfi7, seq: 2156322
00000100:00000040:17.0:1773851866.937645:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000dd1f70c : new rpc_count 0
00000100:00000001:17.0:1773851866.937646:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851866.937646:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:19.0:1773851866.937647:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x432 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851866.937647:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851866.937647:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000020:00000010:17.0:1773851866.937648:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000003dbd7be.
00000400:00000200:19.0:1773851866.937649:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851866.937649:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000000dd1f70c : new refcount 168
00000100:00000001:17.0:1773851866.937649:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851866.937650:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15040@kfi7: PUT: OK
00000400:00000200:19.0:1773851866.937651:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e57d848
00000400:00000010:19.0:1773851866.937651:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e57d848.
00000100:00000001:19.0:1773851866.937652:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851866.937653:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851866.937654:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000060fb3a8d nid 15040@kfi7 refs 2
00000800:00000200:19.0:1773851866.937655:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 15040@kfi7(00000000eb8f531a):0x0 lsk 1075 rsk 57 tsk 0 trmk 0 tmk 0 trr 4 tta 0x432 Transaction freed
00000004:00000001:28.0:1773851866.953732:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:8.0:1773851866.953732:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851866.953733:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851866.953733:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:28.0:1773851866.953733:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:28.0:1773851866.953733:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b1cb0f82.
00000004:00000020:8.0:1773851866.953733:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851866.953734:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061cdc96b.
00000004:00000001:29.0:1773851866.953734:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851866.953734:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:28.0:1773851866.953734:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000020:00000040:30.0:1773851866.953735:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000100:00000010:29.0:1773851866.953735:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031e17c5f.
00000100:00000001:28.0:1773851866.953735:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:8.0:1773851866.953735:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003c9ed900.
00000100:00000001:30.0:1773851866.953736:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:29.0:1773851866.953736:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
02000000:00000001:28.0:1773851866.953736:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851866.953737:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851866.953737:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953737:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851866.953737:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:28.0:1773851866.953737:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851866.953738:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a8444578.
02000000:00000001:29.0:1773851866.953738:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851866.953738:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000070ed3d2c.
00000020:00000040:8.0:1773851866.953738:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
02000000:00000010:29.0:1773851866.953739:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
00000100:00000001:28.0:1773851866.953739:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851866.953739:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851866.953740:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851866.953740:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851866.953740:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953740:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851866.953740:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851866.953740:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851866.953740:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851866.953741:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953741:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851866.953742:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000061cdc96b] to pc [ptlrpcd_07_00+0]  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851866.953742:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000031e17c5f] to pc [ptlrpcd_07_03+3]  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851866.953742:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b1cb0f82] to pc [ptlrpcd_07_02+2]  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851866.953742:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851866.953744:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:8.0:1773851866.953746:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851866.953747:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851866.953747:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851866.953747:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:31.0:1773851866.953748:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:30.0:1773851866.953748:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:29.0:1773851866.953748:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000009b2e7ba4.
00080000:00000010:28.0:1773851866.953748:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b6d9f20e.
00000100:00000001:31.0:1773851866.953749:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851866.953749:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851866.953749:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637155588361216 : -106918121190400 : ffff9ec22f5dcc00)
00080000:00000001:29.0:1773851866.953749:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851866.953749:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637091101290496 : -106982608261120 : ffff9eb32ba33000)
00000100:00000001:8.0:1773851866.953749:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851866.953750:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:30.0:1773851866.953750:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008f05475e.
00080000:00000001:30.0:1773851866.953750:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637108705229824 : -106965004321792 : ffff9eb744e9fc00)
00080000:00000001:29.0:1773851866.953750:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851866.953750:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:30.0:1773851866.953751:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00001000:29.0:1773851866.953751:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00080000:00000001:28.0:1773851866.953751:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851866.953751:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000100:00000040:8.0:1773851866.953751:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003c9ed900] to pc [ptlrpcd_02_03+3]  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851866.953752:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:29.0:1773851866.953752:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003e6b4b53.
00000004:00000010:28.0:1773851866.953752:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000082224cff.
00000100:00000001:31.0:1773851866.953753:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:30.0:1773851866.953753:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000004:00000010:30.0:1773851866.953753:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000994dba74.
00000004:00080000:29.0:1773851866.953753:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614141407028210ns, next at 614142407027248ns, rc = 0
00000004:00080000:28.0:1773851866.953753:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614141407028871ns, next at 614142407027539ns, rc = 0
00000100:00000001:31.0:1773851866.953754:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851866.953754:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:29.0:1773851866.953754:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851866.953754:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851866.953755:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851866.953755:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851866.953755:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614141407030254ns, next at 614142407028831ns, rc = 0
00000004:00000001:29.0:1773851866.953755:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851866.953755:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851866.953756:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031e17c5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051928064:47@kfi7:13:default-yuba2-0
00080000:00000001:30.0:1773851866.953756:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:30.0:1773851866.953756:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851866.953756:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851866.953757:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953757:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851866.953758:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851866.953758:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:28.0:1773851866.953758:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851866.953758:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:31.0:1773851866.953759:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953759:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:29.0:1773851866.953759:0:41089:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000040:28.0:1773851866.953759:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851866.953760:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:31.0:1773851866.953760:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f353b924.
00000100:00000001:30.0:1773851866.953760:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851866.953760:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851866.953760:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:8.0:1773851866.953760:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:31.0:1773851866.953761:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851866.953761:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953761:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851866.953761:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.953761:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851866.953761:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851866.953761:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851866.953761:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:31.0:1773851866.953762:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:29.0:1773851866.953762:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851866.953762:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851866.953762:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:11.0:1773851866.953762:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:8.0:1773851866.953762:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003a10b29d.
00000400:00000010:31.0:1773851866.953763:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000010:31.0:1773851866.953763:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d658250.
00000100:00000001:29.0:1773851866.953763:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851866.953763:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:28.0:1773851866.953763:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851866.953763:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851866.953763:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637139900967936 : -106933808583680 : ffff9ebe88532c00)
00000100:00000040:29.0:1773851866.953764:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:28.0:1773851866.953764:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1cb0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051927936:9@kfi7:13:default-yuba2-0
00000100:00000200:31.0:1773851866.953765:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928064, portal 4
00000100:00000001:31.0:1773851866.953765:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851866.953765:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851866.953765:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:8.0:1773851866.953765:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851866.953766:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637085309681408 : -106988399870208 : ffff9eb1d26e3f00)
00000100:00000001:29.0:1773851866.953766:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851866.953766:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851866.953766:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851866.953767:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851866.953767:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:28.0:1773851866.953767:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e4aa9665.
00000100:00000001:9.0:1773851866.953767:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851866.953767:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851866.953767:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851866.953768:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851866.953768:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851866.953768:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851866.953768:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:8.0:1773851866.953768:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00000100:00100000:29.0:1773851866.953769:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051928000:2104@kfi7:13:default-yuba2-0
00000400:00000200:28.0:1773851866.953769:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:28.0:1773851866.953769:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
02000000:00000001:9.0:1773851866.953769:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851866.953769:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ce69924e.
00000100:00000001:31.0:1773851866.953770:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:29.0:1773851866.953770:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:28.0:1773851866.953770:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c31df675.
00000100:00100000:9.0:1773851866.953770:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c9ed900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051928128:2084@kfi7:13:default-yuba2-0
00000100:00000040:31.0:1773851866.953771:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
02000000:00000001:29.0:1773851866.953771:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851866.953771:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851866.953771:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:28.0:1773851866.953771:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051927936, portal 4
00000004:00080000:8.0:1773851866.953771:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614141407046104ns, next at 614142407044390ns, rc = 0
00000400:00000010:31.0:1773851866.953772:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f33d0462.
00000100:00000200:31.0:1773851866.953772:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928064, offset 0
02000000:00000010:29.0:1773851866.953772:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000018d78667.
00000100:00000001:28.0:1773851866.953772:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851866.953772:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324231296 : -106976385320320 : ffff9eb49e8dba80)
00000100:00000001:9.0:1773851866.953772:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851866.953772:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:8.0:1773851866.953772:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:29.0:1773851866.953773:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851866.953773:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851866.953774:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000200:31.0:1773851866.953774:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:29.0:1773851866.953774:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000010:29.0:1773851866.953774:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000060a59eec.
00000100:00000040:28.0:1773851866.953774:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851866.953774:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:8.0:1773851866.953774:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851866.953775:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000004015b2d.
02000000:00000010:9.0:1773851866.953775:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bcc4b05c.
00000004:00000001:8.0:1773851866.953775:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851866.953776:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000200:29.0:1773851866.953776:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928000, portal 4
00000100:00000001:28.0:1773851866.953776:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:9.0:1773851866.953776:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851866.953777:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:29.0:1773851866.953777:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851866.953777:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832828032 : -106933876723584 : ffff9ebe84437080)
00000100:00000040:28.0:1773851866.953777:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000200:9.0:1773851866.953777:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851866.953778:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000040:29.0:1773851866.953778:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851866.953778:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b417b847.
00000100:00000200:28.0:1773851866.953778:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051927936, offset 0
00000400:00000010:9.0:1773851866.953778:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000200:31.0:1773851866.953779:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000400:00000010:9.0:1773851866.953779:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e30a1d2d.
00000400:00000200:28.0:1773851866.953780:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000100:00000200:9.0:1773851866.953780:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928128, portal 4
00000400:00000200:31.0:1773851866.953781:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769200, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769198, p:4294967295, g:4294967295, h:1000]
00000100:00000001:29.0:1773851866.953781:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851866.953781:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000100:00000001:9.0:1773851866.953781:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851866.953781:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491282816 : -107117218268800 : ffff9e93d4417980)
00000400:00000010:29.0:1773851866.953782:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000038c1b0d0.
00000100:00000200:29.0:1773851866.953782:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928000, offset 0
00000400:00000200:31.0:1773851866.953783:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000040:9.0:1773851866.953783:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851866.953784:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851866.953784:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:31.0:1773851866.953785:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000100:00000001:9.0:1773851866.953785:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851866.953786:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769201:8769201:1024:4294967295] 47@kfi7 LPNI seq info [5403019:5403019:16:4294967295]
00000100:00000040:9.0:1773851866.953786:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000010:9.0:1773851866.953787:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e7ade224.
00000100:00000200:9.0:1773851866.953787:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928128, offset 0
00000400:00000200:31.0:1773851866.953788:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:31.0:1773851866.953788:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:28.0:1773851866.953789:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:9.0:1773851866.953789:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:9.0:1773851866.953790:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851866.953791:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851866.953791:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000200:9.0:1773851866.953791:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:28.0:1773851866.953792:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:31.0:1773851866.953793:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:28.0:1773851866.953793:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:9.0:1773851866.953793:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:31.0:1773851866.953795:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851866.953795:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000400:00000200:9.0:1773851866.953795:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:31.0:1773851866.953796:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851866.953796:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769200, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769201, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851866.953796:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000200:9.0:1773851866.953797:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769200, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769201, p:4294967295, g:4294967295, h:1000]
00000800:00000200:31.0:1773851866.953798:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851866.953798:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851866.953799:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851866.953800:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000400:00000200:9.0:1773851866.953800:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851866.953800:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:31.0:1773851866.953801:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000400:00000200:28.0:1773851866.953801:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769202:8769202:1024:4294967295] 9@kfi7 LPNI seq info [5403008:5403008:16:4294967295]
00000400:00000200:9.0:1773851866.953801:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:9.0:1773851866.953802:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769203:8769203:1024:4294967295] 2084@kfi7 LPNI seq info [5402744:5402744:16:4294967295]
00000400:00000200:28.0:1773851866.953803:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:31.0:1773851866.953804:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000400:00000200:28.0:1773851866.953804:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:9.0:1773851866.953804:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:31.0:1773851866.953805:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851866.953805:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:29.0:1773851866.953806:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:29.0:1773851866.953807:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000100:00000001:31.0:1773851866.953808:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.953808:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851866.953808:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:28.0:1773851866.953808:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000100:00000001:31.0:1773851866.953809:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851866.953809:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:28.0:1773851866.953809:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:9.0:1773851866.953809:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000100:00000001:31.0:1773851866.953810:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.953810:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851866.953810:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000400:00000200:9.0:1773851866.953810:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000001:31.0:1773851866.953811:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:28.0:1773851866.953811:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:31.0:1773851866.953812:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851866.953812:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769203, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769201, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851866.953812:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:31.0:1773851866.953813:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851866.953813:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851866.953814:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.953814:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851866.953814:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:28.0:1773851866.953814:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851866.953814:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851866.953815:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851866.953815:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000400:00000200:29.0:1773851866.953817:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769204:8769204:1023:4294967295] 2104@kfi7 LPNI seq info [5403376:5403376:16:4294967295]
00000800:00000200:9.0:1773851866.953817:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851866.953818:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:9.0:1773851866.953819:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Using peer 2084@kfi7(0x103)
00000400:00000200:29.0:1773851866.953820:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:28.0:1773851866.953820:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851866.953822:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851866.953822:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851866.953823:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.953823:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000800:00000200:28.0:1773851866.953823:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000800:00000200:9.0:1773851866.953823:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x103: rc=0
00000400:00000200:30.0:1773851866.953825:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000800:00000200:29.0:1773851866.953825:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:9.0:1773851866.953825:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851866.953826:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f33d0462
00000800:00000200:29.0:1773851866.953826:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851866.953826:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x31e: rc=0
00000400:00000010:30.0:1773851866.953827:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f33d0462.
00000100:00000001:30.0:1773851866.953827:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851866.953827:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851866.953828:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851866.953828:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851866.953828:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851866.953828:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851866.953829:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851866.953829:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953830:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953830:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851866.953830:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851866.953831:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:29.0:1773851866.953831:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000100:00000001:28.0:1773851866.953831:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851866.953831:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:30.0:1773851866.953832:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851866.953832:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953832:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851866.953832:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851866.953832:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851866.953833:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851866.953833:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851866.953833:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851866.953834:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851866.953834:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
00000100:00000001:28.0:1773851866.953834:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851866.953834:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851866.953835:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851866.953835:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851866.953836:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:28.0:1773851866.953836:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851866.953836:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851866.953837:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953837:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851866.953837:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:30.0:1773851866.953838:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000100:00000001:29.0:1773851866.953838:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851866.953838:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851866.953839:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953839:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851866.953839:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000400:00000200:9.0:1773851866.953840:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e7ade224
00000800:00000200:30.0:1773851866.953841:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000400:00000010:9.0:1773851866.953841:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e7ade224.
00000100:00000001:9.0:1773851866.953841:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851866.953842:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000100:00000200:9.0:1773851866.953842:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851866.953843:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851866.953843:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851866.953843:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851866.953844:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00000001:28.0:1773851866.953844:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851866.953845:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000038c1b0d0
00000100:00000001:9.0:1773851866.953845:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:29.0:1773851866.953846:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000038c1b0d0.
00000100:00000001:29.0:1773851866.953846:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000040:9.0:1773851866.953846:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851866.953847:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851866.953848:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851866.953848:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851866.953849:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000400:00000200:30.0:1773851866.953849:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b417b847
00000400:00000010:30.0:1773851866.953850:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b417b847.
00000100:00000001:30.0:1773851866.953850:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851866.953850:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851866.953850:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851866.953850:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000200:30.0:1773851866.953851:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851866.953852:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:9.0:1773851866.953852:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Transaction freed
00000100:00000001:29.0:1773851866.953853:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953853:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:21.0:1773851866.953853:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851866.953854:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851866.953854:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:21.0:1773851866.953854:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:30.0:1773851866.953855:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851866.953856:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Transaction freed
00000800:00000200:21.0:1773851866.953856:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:30.0:1773851866.953857:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851866.953858:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851866.953858:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:30.0:1773851866.953859:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:30.0:1773851866.953861:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000400:00000200:21.0:1773851866.953861:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000400:00000200:21.0:1773851866.953862:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.953862:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:21.0:1773851866.953864:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.953864:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:21.0:1773851866.953865:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:21.0:1773851866.953866:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.953867:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3600
00000400:00000200:21.0:1773851866.953868:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851866.953870:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d0c95 [1] + 224
00000800:00000200:21.0:1773851866.953872:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851866.953874:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851866.953875:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000100:00000001:21.0:1773851866.953876:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851866.953877:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851866.953880:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851866.953884:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:21.0:1773851866.953884:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:25.0:1773851866.953885:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851866.953885:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:31.0:1773851866.953886:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851866.953886:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:25.0:1773851866.953886:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:31.0:1773851866.953887:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:21.0:1773851866.953887:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851866.953888:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851866.953888:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000800:00000200:25.0:1773851866.953888:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851866.953889:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d658250
00000400:00000010:31.0:1773851866.953889:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d658250.
00000100:00000001:31.0:1773851866.953890:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851866.953890:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000200:31.0:1773851866.953891:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851866.953891:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2084@kfi7 : PUT - for me
00000800:00000200:13.0:1773851866.953891:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:25.0:1773851866.953892:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:13.0:1773851866.953892:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851866.953892:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:25.0:1773851866.953893:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000800:00000200:13.0:1773851866.953893:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851866.953893:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:31.0:1773851866.953894:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851866.953894:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:5.0:1773851866.953894:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851866.953895:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:13.0:1773851866.953895:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851866.953896:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:5.0:1773851866.953896:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851866.953897:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851866.953897:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851866.953897:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:31.0:1773851866.953898:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851866.953898:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:25.0:1773851866.953898:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3640
00000400:00000200:13.0:1773851866.953898:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:5.0:1773851866.953898:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:31.0:1773851866.953899:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851866.953899:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851866.953899:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
02000000:00000001:31.0:1773851866.953900:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851866.953900:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000400:00000200:5.0:1773851866.953900:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000100:00001000:31.0:1773851866.953901:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=99 v=66 (66 66 66 66)
00000400:00000200:25.0:1773851866.953901:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b82219 [1] + 224
00000400:00000200:13.0:1773851866.953901:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:5.0:1773851866.953901:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00001000:31.0:1773851866.953902:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=99 v=66 (1 1 1 1)
00000400:00000200:13.0:1773851866.953902:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:5.0:1773851866.953902:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000001:31.0:1773851866.953903:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000800:00000200:25.0:1773851866.953903:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851866.953903:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:31.0:1773851866.953904:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851866.953904:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:25.0:1773851866.953904:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851866.953904:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:5.0:1773851866.953904:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00010000:00000001:31.0:1773851866.953905:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851866.953905:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:5.0:1773851866.953905:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:31.0:1773851866.953906:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851866.953906:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000400:00000200:25.0:1773851866.953906:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000400:00000200:13.0:1773851866.953906:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:31.0:1773851866.953907:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:25.0:1773851866.953907:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851866.953907:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:5.0:1773851866.953907:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:31.0:1773851866.953908:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:25.0:1773851866.953908:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851866.953908:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b35c0
00000400:00000200:5.0:1773851866.953908:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3580
00000100:00000040:31.0:1773851866.953909:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851866.953909:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:13.0:1773851866.953910:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:31.0:1773851866.953911:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:25.0:1773851866.953911:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851866.953911:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b30d25 [1] + 224
00000100:00000001:31.0:1773851866.953912:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:13.0:1773851866.953912:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f5f8d [1] + 224
00000100:00000001:31.0:1773851866.953913:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851866.953913:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000800:00000200:5.0:1773851866.953913:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000040:31.0:1773851866.953914:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000800:00000200:13.0:1773851866.953914:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000040:31.0:1773851866.953915:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603986432 avail=351601695744 avail_mb=1373444124 hwm_mb=3131103 files=372190508 ffree=343363268 state=0: rc = 0
00000100:00000001:25.0:1773851866.953915:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851866.953915:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851866.953916:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:13.0:1773851866.953916:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000020:31.0:1773851866.953917:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603986432 free, 351601695744 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190508 files, 343363268 free files
00000800:00000200:25.0:1773851866.953917:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851866.953917:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851866.953917:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851866.953917:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000004:00000001:31.0:1773851866.953918:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851866.953918:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000400:00000001:9.0:1773851866.953918:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:5.0:1773851866.953918:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:31.0:1773851866.953919:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:13.0:1773851866.953919:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:9.0:1773851866.953919:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:5.0:1773851866.953919:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:13.0:1773851866.953920:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851866.953920:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000400:00000200:9.0:1773851866.953920:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e30a1d2d
00000400:00000010:9.0:1773851866.953921:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e30a1d2d.
00000100:00000001:9.0:1773851866.953921:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00100000:31.0:1773851866.953922:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031e17c5f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051928064:47@kfi7:13:default-yuba2-0
00000100:00000040:5.0:1773851866.953922:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851866.953923:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851866.953924:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.953924:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:13.0:1773851866.953924:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851866.953925:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000031e17c5f x1859433051928064/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:9.0:1773851866.953926:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851866.953926:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851866.953927:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000200:5.0:1773851866.953927:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
02000000:00000001:31.0:1773851866.953928:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:28.0:1773851866.953928:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:13.0:1773851866.953928:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851866.953928:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851866.953928:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:31.0:1773851866.953929:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f353b924.
02000000:00000001:31.0:1773851866.953929:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:28.0:1773851866.953929:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851866.953929:0:41071:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:5.0:1773851866.953929:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000020:00000001:31.0:1773851866.953930:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851866.953930:0:41091:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000100:00000001:29.0:1773851866.953930:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851866.953930:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:28.0:1773851866.953930:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:13.0:1773851866.953930:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
02000000:00000001:9.0:1773851866.953930:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851866.953930:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:31.0:1773851866.953931:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000001:29.0:1773851866.953931:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851866.953931:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:28.0:1773851866.953931:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:13.0:1773851866.953931:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851866.953931:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851866.953931:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851866.953932:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
00000400:00000010:29.0:1773851866.953932:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000060a59eec.
00000400:00000010:28.0:1773851866.953932:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000200:28.0:1773851866.953932:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c31df675
00000100:00001000:9.0:1773851866.953932:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=99 v=66 (66 66 66 66)
02000000:00000001:31.0:1773851866.953933:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000200:29.0:1773851866.953933:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000004015b2d
00000400:00000010:29.0:1773851866.953933:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000004015b2d.
00000400:00000010:28.0:1773851866.953933:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c31df675.
00000100:00001000:9.0:1773851866.953933:0:41071:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=99 v=66 (1 1 1 1)
02000000:00000001:31.0:1773851866.953934:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851866.953934:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031e17c5f.
00000100:00000001:29.0:1773851866.953934:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851866.953934:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851866.953934:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851866.953935:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851866.953935:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:29.0:1773851866.953935:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:28.0:1773851866.953935:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851866.953935:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851866.953935:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:31.0:1773851866.953936:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851866.953936:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00010000:00000001:9.0:1773851866.953936:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.953937:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851866.953937:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:29.0:1773851866.953937:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851866.953937:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851866.953937:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000100:00000001:31.0:1773851866.953938:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851866.953938:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851866.953938:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851866.953938:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851866.953939:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851866.953940:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851866.953940:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.953940:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851866.953940:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851866.953941:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851866.953941:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851866.953941:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851866.953941:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851866.953941:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851866.953942:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851866.953942:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953942:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851866.953942:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851866.953942:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:29.0:1773851866.953943:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851866.953943:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851866.953943:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:29.0:1773851866.953944:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=99 v=66 (66 66 66 66)
00000100:00001000:28.0:1773851866.953944:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=99 v=66 (66 66 66 66)
00000004:00000001:9.0:1773851866.953944:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851866.953944:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000100:00001000:29.0:1773851866.953945:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=99 v=66 (1 1 1 1)
00000004:00000040:9.0:1773851866.953945:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593681920 avail=351576841216 avail_mb=1373347036 hwm_mb=3131103 files=372190031 ffree=343353205 state=0: rc = 0
00000100:00000001:29.0:1773851866.953946:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851866.953946:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851866.953946:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=20 v=66 (1 1 1 1)
00010000:00000001:29.0:1773851866.953947:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851866.953947:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851866.953947:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:9.0:1773851866.953947:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593681920 free, 351576841216 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190031 files, 343353205 free files
00010000:00000001:29.0:1773851866.953948:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953948:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00010000:00000001:28.0:1773851866.953948:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:28.0:1773851866.953948:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851866.953948:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851866.953949:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000001:28.0:1773851866.953949:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851866.953949:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000100:00000040:9.0:1773851866.953949:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851866.953950:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851866.953950:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953950:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851866.953950:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851866.953951:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851866.953951:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851866.953952:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c9ed900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051928128:2084@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851866.953953:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851866.953954:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851866.953954:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851866.953954:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851866.953954:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851866.953954:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851866.953955:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.953955:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:9.0:1773851866.953955:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003c9ed900 x1859433051928128/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:29.0:1773851866.953956:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851866.953956:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000004:00000001:28.0:1773851866.953956:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:28.0:1773851866.953956:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000004:00000040:29.0:1773851866.953957:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615858688 avail=351613239296 avail_mb=1373489216 hwm_mb=3131103 files=372043460 ffree=343374862 state=0: rc = 0
00000004:00000040:28.0:1773851866.953957:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480064000 avail=351478686720 avail_mb=1372963620 hwm_mb=3131101 files=372073181 ffree=343242250 state=0: rc = 0
00000100:00000001:9.0:1773851866.953957:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851866.953958:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851866.953958:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bcc4b05c.
00000004:00000020:29.0:1773851866.953959:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615858688 free, 351613239296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043460 files, 343374862 free files
00000004:00000020:28.0:1773851866.953959:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480064000 free, 351478686720 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073181 files, 343242250 free files
02000000:00000001:9.0:1773851866.953959:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000001:29.0:1773851866.953960:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851866.953960:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851866.953960:0:41071:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000100:00000040:29.0:1773851866.953961:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:9.0:1773851866.953961:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851866.953961:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000004:00000001:28.0:1773851866.953962:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851866.953962:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851866.953963:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851866.953963:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c9ed900.
00000100:00100000:29.0:1773851866.953964:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051928000:2104@kfi7:13:default-yuba2-0
00000100:00000040:28.0:1773851866.953964:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851866.953964:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851866.953964:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851866.953965:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851866.953965:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851866.953966:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851866.953966:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851866.953966:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851866.953967:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000061cdc96b x1859433051928000/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851866.953967:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851866.953967:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953969:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851866.953969:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:28.0:1773851866.953969:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1cb0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051927936:9@kfi7:13:default-yuba2-0
02000000:00000010:29.0:1773851866.953970:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000018d78667.
02000000:00000001:29.0:1773851866.953971:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851866.953971:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851866.953971:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:29.0:1773851866.953972:0:41089:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000020:00000001:29.0:1773851866.953972:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:28.0:1773851866.953972:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:29.0:1773851866.953973:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a8444578.
00000100:00000040:28.0:1773851866.953973:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b1cb0f82 x1859433051927936/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852019 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:29.0:1773851866.953974:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851866.953974:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851866.953975:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061cdc96b.
00000100:00000001:29.0:1773851866.953975:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851866.953976:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851866.953976:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851866.953977:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851866.953977:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851866.953978:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851866.953978:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953978:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851866.953978:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851866.953979:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e4aa9665.
02000000:00000001:28.0:1773851866.953981:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851866.953981:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851866.953982:0:41090:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000020:00000001:28.0:1773851866.953983:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851866.953984:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000070ed3d2c.
02000000:00000001:28.0:1773851866.953985:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851866.953986:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851866.953986:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b1cb0f82.
00000100:00000001:28.0:1773851866.953988:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851866.953988:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.953989:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851866.953991:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851866.953991:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851866.953992:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851866.953993:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851867.002713:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851867.002714:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851867.002715:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851867.002717:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851867.002719:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9680@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.002720:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9680@kfi7 : PUT - for me
00000400:00000200:5.0:1773851867.002721:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9680@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.002722:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 1
00000400:00000200:5.0:1773851867.002723:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9680@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.002723:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 2
00000400:00000200:5.0:1773851867.002724:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 3
00000400:00000200:5.0:1773851867.002730:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9488@kfi7 to cpt 6
00000400:00000200:5.0:1773851867.002731:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9488@kfi7 of length 224 into portal 12 MB=0x69a8a0fdd1bc0
00000400:00000200:5.0:1773851867.002732:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9488@kfi7 of length 224/224 into md 0x793926dc5 [64] + 135000
00000800:00000200:5.0:1773851867.002733:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851867.002735:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851867.002736:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9680@kfi7: PUT: OK
00000100:00000001:5.0:1773851867.002737:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851867.002738:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851867.002739:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cdd22ebc.
00000100:00000040:5.0:1773851867.002740:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000cdd22ebc x1858767622577088 msgsize 224
00000100:00100000:5.0:1773851867.002741:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-9488@kfi7 (source: 12345-9680@kfi7)
00000100:00000001:5.0:1773851867.002742:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851867.002743:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 2
00000800:00000200:5.0:1773851867.002744:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851867.002746:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851867.002747:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851867.002747:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851867.002748:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851867.002749:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851867.002749:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858767622577088
00000020:00000001:5.0:1773851867.002750:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851867.002750:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d21
00000020:00000001:5.0:1773851867.002751:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851867.002753:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000f50756d refcount=6
00000020:00000001:5.0:1773851867.002754:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395730432 : -107136313821184 : ffff9e8f62127800)
00000020:00000001:5.0:1773851867.002755:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395730432 : -107136313821184 : ffff9e8f62127800)
00000100:00000001:5.0:1773851867.002756:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851867.002756:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851867.002757:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e0af6c38.
00000020:00000010:5.0:1773851867.002758:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851867.002759:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008260bf32.
00000100:00000001:5.0:1773851867.002760:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851867.002761:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851867.002761:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851867.002762:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851867.002763:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851867.002763:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851867.002764:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851867.002765:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851867.002766:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851867.002766:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851867.002766:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851867.002767:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9488@kfi7, seq: 2001915
00000100:00000040:7.0:1773851867.002768:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000f50756d : new rpc_count 1
00000100:00000001:7.0:1773851867.002768:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886762368 : -106955822789248 : ffff9eb9682d0d80)
00000100:00000001:5.0:1773851867.002768:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851867.002768:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.002770:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cdd22ebc x1858767622577088/t0(0) o400->d90500fe-881a-4068-83da-4704bf10f812@9488@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1089-0'
00000100:00000001:7.0:1773851867.002772:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.002773:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851867.002774:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cdd22ebc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d90500fe-881a-4068-83da-4704bf10f812+6:39578:x1858767622577088:12345-9488@kfi7:400:default-tuolumne1089-0
00000100:00000200:7.0:1773851867.002775:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858767622577088
00000020:00000001:7.0:1773851867.002776:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851867.002777:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851867.002777:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.002778:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851867.002779:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851867.002779:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851867.002780:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858767622577088, found 0 last_xid 1858767622577087
00000020:00000001:7.0:1773851867.002781:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851867.002781:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851867.002782:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851867.002782:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.002783:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851867.002783:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851867.002784:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851867.002785:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d2a17bef.
02000000:00000001:7.0:1773851867.002785:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.002786:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.002787:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851867.002787:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530842, transno 0, xid 1858767622577088
00010000:00000001:7.0:1773851867.002788:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851867.002789:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cdd22ebc x1858767622577088/t0(0) o400->d90500fe-881a-4068-83da-4704bf10f812@9488@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1089-0'
00010000:00000001:7.0:1773851867.002791:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851867.002792:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851867.002792:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=99 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851867.002794:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851867.002794:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b3e75ab refcount 3 to 9488@kfi7
00000100:00000001:7.0:1773851867.002795:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299328800 : -107155410222816 : ffff9e8aefd68120)
02000000:00000001:7.0:1773851867.002796:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851867.002796:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.002797:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851867.002798:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9680@kfi7
00000400:00000010:7.0:1773851867.002798:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c448bd40.
00000100:00000200:7.0:1773851867.002800:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858767622577088, offset 224
00000400:00000200:7.0:1773851867.002801:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9680@kfi7
00000400:00000200:7.0:1773851867.002802:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9680@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.002803:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 1
00000400:00000200:7.0:1773851867.002804:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 2
00000400:00000200:7.0:1773851867.002805:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 3
00000400:00000200:7.0:1773851867.002807:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9680@kfi7 local destination
00000400:00000200:7.0:1773851867.002808:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769205:8769205:1024:4294967295] 9680@kfi7 LPNI seq info [17515:17515:16:4294967295]
00000400:00000200:7.0:1773851867.002809:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 2
00000400:00000200:7.0:1773851867.002810:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9680@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.002812:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9680@kfi7(9680@kfi7:9680@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851867.002813:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 3
00000800:00000200:7.0:1773851867.002814:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851867.002815:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851867.002818:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851867.002820:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x449 Using peer 9680@kfi7(0x449)
00000800:00000200:7.0:1773851867.002823:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x449: rc=0
00000800:00000200:7.0:1773851867.002824:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x449 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851867.002826:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.002827:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b3e75ab refcount 2 to 9488@kfi7
00010000:00000001:7.0:1773851867.002828:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851867.002828:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.002829:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851867.002830:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cdd22ebc x1858767622577088/t0(0) o400->d90500fe-881a-4068-83da-4704bf10f812@9488@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1089-0'
00000100:00100000:7.0:1773851867.002833:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cdd22ebc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d90500fe-881a-4068-83da-4704bf10f812+6:39578:x1858767622577088:12345-9488@kfi7:400:default-tuolumne1089-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851867.002835:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9488@kfi7, seq: 2001915
00000100:00000040:7.0:1773851867.002836:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000f50756d : new rpc_count 0
00000100:00000001:7.0:1773851867.002837:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851867.002837:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x449 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851867.002838:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851867.002838:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:7.0:1773851867.002839:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008260bf32.
00000400:00000200:5.0:1773851867.002839:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851867.002840:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e0af6c38.
00000020:00000040:7.0:1773851867.002840:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000000f50756d : new refcount 5
00000400:00000200:5.0:1773851867.002840:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9680@kfi7: PUT: OK
00000400:00000200:5.0:1773851867.002840:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c448bd40
00000100:00000001:7.0:1773851867.002841:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:5.0:1773851867.002841:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c448bd40.
00000100:00000001:5.0:1773851867.002842:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851867.002842:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851867.002843:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f3d3d5fd nid 9680@kfi7 refs 2
00000800:00000200:5.0:1773851867.002845:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 9680@kfi7(0000000078081326):0x0 lsk 1098 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x449 Transaction freed
00000800:00000200:29.0:1773851867.003975:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851867.003977:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851867.003978:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851867.003980:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851867.003982:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18290@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.003983:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18290@kfi7 : PUT - for me
00000400:00000200:29.0:1773851867.003984:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18290@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.003985:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093ba2d3f nid 18290@kfi7 refs 1
00000400:00000200:29.0:1773851867.003986:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18290@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.003986:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093ba2d3f nid 18290@kfi7 refs 2
00000400:00000200:29.0:1773851867.003987:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000093ba2d3f nid 18290@kfi7 refs 3
00000400:00000200:29.0:1773851867.003988:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18291@kfi7 to cpt 2
00000400:00000200:29.0:1773851867.003989:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18291@kfi7 of length 224 into portal 12 MB=0x69b0979211100
00000400:00000200:29.0:1773851867.003990:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18291@kfi7 of length 224/224 into md 0x77fe139dd [64] + 175080
00000800:00000200:29.0:1773851867.003992:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851867.003993:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.003994:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18290@kfi7: PUT: OK
00000100:00000001:29.0:1773851867.003995:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851867.003995:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851867.003996:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000e1f81b2.
00000100:00000040:29.0:1773851867.003997:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000000e1f81b2 x1859314849485056 msgsize 224
00000100:00100000:29.0:1773851867.003998:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-18291@kfi7 (source: 12345-18290@kfi7)
00000100:00000001:29.0:1773851867.003999:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851867.004000:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000093ba2d3f nid 18290@kfi7 refs 2
00000800:00000200:29.0:1773851867.004001:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851867.004001:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851867.004002:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851867.004003:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851867.004003:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851867.004004:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851867.004005:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314849485056
00000020:00000001:28.0:1773851867.004005:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851867.004006:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bf2
00000020:00000001:28.0:1773851867.004006:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851867.004010:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef8deab9 refcount=6
00000020:00000001:28.0:1773851867.004011:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743955456 : -107128965596160 : ffff9e91180f7c00)
00000020:00000001:28.0:1773851867.004011:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743955456 : -107128965596160 : ffff9e91180f7c00)
00000100:00000001:28.0:1773851867.004012:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.004013:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851867.004014:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d9820241.
00000020:00000010:28.0:1773851867.004015:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.004016:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851867.004017:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851867.004018:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851867.004018:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851867.004020:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851867.004020:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851867.004021:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.004022:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851867.004023:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851867.004023:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851867.004023:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851867.004023:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851867.004024:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18291@kfi7, seq: 2055518
00000100:00000001:31.0:1773851867.004026:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851867.004026:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.004026:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef8deab9 : new rpc_count 1
00000100:00000001:28.0:1773851867.004026:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309695232 : -106988399856384 : ffff9eb1d26e7500)
00000100:00000040:28.0:1773851867.004028:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000e1f81b2 x1859314849485056/t0(0) o400->13ad8ac0-c65f-404e-a99c-e611e589b00f@18291@kfi7:655/0 lens 224/0 e 0 to 0 dl 1773852015 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1626-0'
00000100:00000001:28.0:1773851867.004030:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.004031:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851867.004032:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e1f81b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:13ad8ac0-c65f-404e-a99c-e611e589b00f+6:39624:x1859314849485056:12345-18291@kfi7:400:default-tuolumne1626-0
00000100:00000200:28.0:1773851867.004035:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314849485056
00000020:00000001:28.0:1773851867.004036:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851867.004037:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851867.004038:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.004039:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851867.004039:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851867.004040:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851867.004041:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314849485056, found 0 last_xid 1859314849485055
00000020:00000001:28.0:1773851867.004042:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851867.004042:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851867.004043:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851867.004044:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.004044:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851867.004045:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851867.004045:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851867.004046:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e41aca0.
02000000:00000001:28.0:1773851867.004047:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.004047:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.004048:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851867.004049:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262833879, transno 0, xid 1859314849485056
00010000:00000001:28.0:1773851867.004050:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851867.004051:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000e1f81b2 x1859314849485056/t0(0) o400->13ad8ac0-c65f-404e-a99c-e611e589b00f@18291@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1626-0'
00010000:00000001:28.0:1773851867.004053:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851867.004054:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851867.004054:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=100 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851867.004056:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851867.004056:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f8cc00cd refcount 3 to 18291@kfi7
00000100:00000001:28.0:1773851867.004057:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582656 : -107154806968960 : ffff9e8b13cb6d80)
02000000:00000001:28.0:1773851867.004058:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851867.004059:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.004059:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851867.004060:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18290@kfi7
00000400:00000010:28.0:1773851867.004061:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c31df675.
00000100:00000200:28.0:1773851867.004062:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314849485056, offset 224
00000400:00000200:28.0:1773851867.004064:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18290@kfi7
00000400:00000200:28.0:1773851867.004064:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18290@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.004065:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093ba2d3f nid 18290@kfi7 refs 1
00000400:00000200:28.0:1773851867.004066:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000093ba2d3f nid 18290@kfi7 refs 2
00000400:00000200:28.0:1773851867.004068:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000093ba2d3f nid 18290@kfi7 refs 3
00000400:00000200:28.0:1773851867.004069:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18290@kfi7 local destination
00000400:00000200:28.0:1773851867.004071:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769206:8769206:1024:4294967295] 18290@kfi7 LPNI seq info [214156:214156:16:4294967295]
00000400:00000200:28.0:1773851867.004072:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000093ba2d3f nid 18290@kfi7 refs 2
00000400:00000200:28.0:1773851867.004073:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18290@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.004075:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18290@kfi7(18290@kfi7:18290@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851867.004076:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000093ba2d3f nid 18290@kfi7 refs 3
00000800:00000200:28.0:1773851867.004077:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851867.004078:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851867.004081:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851867.004083:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001097 Using peer 18290@kfi7(0x100000000001097)
00000800:00000200:28.0:1773851867.004086:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x100000000001097: rc=0
00000800:00000200:28.0:1773851867.004087:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001097 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851867.004089:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.004090:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f8cc00cd refcount 2 to 18291@kfi7
00010000:00000001:28.0:1773851867.004090:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851867.004091:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.004092:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851867.004092:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000e1f81b2 x1859314849485056/t0(0) o400->13ad8ac0-c65f-404e-a99c-e611e589b00f@18291@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1626-0'
00000100:00100000:28.0:1773851867.004097:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e1f81b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:13ad8ac0-c65f-404e-a99c-e611e589b00f+6:39624:x1859314849485056:12345-18291@kfi7:400:default-tuolumne1626-0 Request processed in 65us (99us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851867.004099:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18291@kfi7, seq: 2055518
00000100:00000040:28.0:1773851867.004100:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef8deab9 : new rpc_count 0
00000100:00000001:28.0:1773851867.004101:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851867.004102:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851867.004102:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.004103:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851867.004104:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d9820241.
00000020:00000040:28.0:1773851867.004105:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000ef8deab9 : new refcount 5
00000100:00000001:28.0:1773851867.004105:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851867.004110:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001097 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851867.004112:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.004113:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18290@kfi7: PUT: OK
00000400:00000200:29.0:1773851867.004114:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c31df675
00000400:00000010:29.0:1773851867.004114:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c31df675.
00000100:00000001:29.0:1773851867.004115:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851867.004115:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851867.004116:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000093ba2d3f nid 18290@kfi7 refs 2
00000800:00000200:29.0:1773851867.004117:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 18290@kfi7(00000000595a1d7e):0x0 lsk 4248 rsk 43 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001097 Transaction freed
00000400:00000200:29.0:1773851867.017731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851867.017732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000800:00000200:1.0:1773851867.023169:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.023171:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851867.023173:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851867.023175:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851867.023178:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10850@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.023179:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10850@kfi7 : PUT - for me
00000400:00000200:1.0:1773851867.023180:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10850@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.023181:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029923d55 nid 10850@kfi7 refs 1
00000400:00000200:1.0:1773851867.023182:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10850@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.023183:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029923d55 nid 10850@kfi7 refs 2
00000400:00000200:1.0:1773851867.023184:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000029923d55 nid 10850@kfi7 refs 3
00000400:00000200:1.0:1773851867.023185:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10914@kfi7 to cpt 4
00000400:00000200:1.0:1773851867.023186:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10914@kfi7 of length 224 into portal 12 MB=0x69b1721670c80
00000400:00000200:1.0:1773851867.023188:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10914@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 28728
00000800:00000200:1.0:1773851867.023190:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851867.023192:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851867.023193:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10850@kfi7: PUT: OK
00000100:00000001:1.0:1773851867.023194:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851867.023195:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851867.023196:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000017d4dfb8.
00000100:00000040:1.0:1773851867.023197:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000017d4dfb8 x1859373507218560 msgsize 224
00000100:00100000:1.0:1773851867.023199:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-10914@kfi7 (source: 12345-10850@kfi7)
00000100:00000001:1.0:1773851867.023201:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851867.023202:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000029923d55 nid 10850@kfi7 refs 2
00000800:00000200:1.0:1773851867.023203:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851867.023207:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851867.023207:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851867.023208:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851867.023209:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851867.023210:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851867.023211:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373507218560
00000020:00000001:1.0:1773851867.023212:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851867.023212:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d44
00000020:00000001:1.0:1773851867.023213:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851867.023215:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f62f959 refcount=6
00000020:00000001:1.0:1773851867.023216:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239473152 : -107152470078464 : ffff9e8b9f158c00)
00000020:00000001:1.0:1773851867.023217:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239473152 : -107152470078464 : ffff9e8b9f158c00)
00000100:00000001:1.0:1773851867.023218:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.023219:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851867.023220:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5405d62.
00000020:00000010:1.0:1773851867.023221:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.023222:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee53e016.
00000100:00000001:1.0:1773851867.023223:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851867.023224:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851867.023225:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.023226:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851867.023227:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851867.023227:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.023228:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.023230:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851867.023230:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851867.023230:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.023231:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851867.023232:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10914@kfi7, seq: 1997559
00000100:00000040:1.0:1773851867.023233:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f62f959 : new rpc_count 1
00000100:00000001:0.0:1773851867.023233:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.023234:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599722624 : -107004109828992 : ffff9eae2a0b4c80)
00000100:00000001:0.0:1773851867.023234:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.023235:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000017d4dfb8 x1859373507218560/t0(0) o400->50c7ac39-ad9f-4c7e-8bf1-1564b1877cf1@10914@kfi7:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1164-0'
00000100:00000001:1.0:1773851867.023238:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.023238:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851867.023240:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017d4dfb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:50c7ac39-ad9f-4c7e-8bf1-1564b1877cf1+6:39699:x1859373507218560:12345-10914@kfi7:400:default-tuolumne1164-0
00000100:00000200:1.0:1773851867.023241:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373507218560
00000020:00000001:1.0:1773851867.023242:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851867.023244:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851867.023244:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.023245:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851867.023246:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851867.023247:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851867.023247:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373507218560, found 0 last_xid 1859373507218559
00000020:00000001:1.0:1773851867.023248:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851867.023249:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851867.023250:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851867.023250:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.023251:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851867.023252:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851867.023252:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851867.023254:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000017685ed.
02000000:00000001:1.0:1773851867.023254:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.023255:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.023256:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851867.023257:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695324, transno 0, xid 1859373507218560
00010000:00000001:1.0:1773851867.023258:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851867.023259:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000017d4dfb8 x1859373507218560/t0(0) o400->50c7ac39-ad9f-4c7e-8bf1-1564b1877cf1@10914@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1164-0'
00010000:00000001:1.0:1773851867.023261:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851867.023262:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851867.023263:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851867.023264:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851867.023265:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000086b7912d refcount 3 to 10914@kfi7
00000100:00000001:1.0:1773851867.023266:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517280 : -107156126034336 : ffff9e8ac52c1660)
02000000:00000001:1.0:1773851867.023267:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851867.023268:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.023268:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851867.023269:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10850@kfi7
00000400:00000010:1.0:1773851867.023270:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c31a0ef.
00000100:00000200:1.0:1773851867.023271:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373507218560, offset 224
00000400:00000200:1.0:1773851867.023272:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10850@kfi7
00000400:00000200:1.0:1773851867.023273:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10850@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.023275:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029923d55 nid 10850@kfi7 refs 1
00000400:00000200:1.0:1773851867.023276:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000029923d55 nid 10850@kfi7 refs 2
00000400:00000200:1.0:1773851867.023277:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000029923d55 nid 10850@kfi7 refs 3
00000400:00000200:1.0:1773851867.023279:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10850@kfi7 local destination
00000400:00000200:1.0:1773851867.023280:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769207:8769207:1024:4294967295] 10850@kfi7 LPNI seq info [9954598:9954598:16:4294967295]
00000400:00000200:1.0:1773851867.023282:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000029923d55 nid 10850@kfi7 refs 2
00000400:00000200:1.0:1773851867.023282:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10850@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.023284:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10850@kfi7(10850@kfi7:10850@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851867.023286:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000029923d55 nid 10850@kfi7 refs 3
00000800:00000200:1.0:1773851867.023287:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.023289:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851867.023291:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851867.023294:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afd Using peer 10850@kfi7(0x100000000000afd)
00000800:00000200:1.0:1773851867.023297:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x100000000000afd: rc=0
00000800:00000200:1.0:1773851867.023298:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851867.023300:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.023301:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000086b7912d refcount 2 to 10914@kfi7
00010000:00000001:1.0:1773851867.023302:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851867.023302:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.023303:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851867.023304:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000017d4dfb8 x1859373507218560/t0(0) o400->50c7ac39-ad9f-4c7e-8bf1-1564b1877cf1@10914@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1164-0'
00000100:00100000:1.0:1773851867.023307:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017d4dfb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:50c7ac39-ad9f-4c7e-8bf1-1564b1877cf1+6:39699:x1859373507218560:12345-10914@kfi7:400:default-tuolumne1164-0 Request processed in 68us (109us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851867.023309:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10914@kfi7, seq: 1997559
00000100:00000040:1.0:1773851867.023310:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f62f959 : new rpc_count 0
00000800:00000200:3.0:1773851867.023311:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afd TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851867.023311:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851867.023311:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:3.0:1773851867.023312:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851867.023312:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:3.0:1773851867.023313:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10850@kfi7: PUT: OK
00000020:00000010:1.0:1773851867.023313:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee53e016.
00000400:00000200:3.0:1773851867.023314:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c31a0ef
00000400:00000010:3.0:1773851867.023314:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c31a0ef.
00000020:00000010:1.0:1773851867.023314:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5405d62.
00000020:00000040:1.0:1773851867.023314:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003f62f959 : new refcount 5
00000100:00000001:3.0:1773851867.023315:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851867.023315:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:1.0:1773851867.023315:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851867.023316:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000029923d55 nid 10850@kfi7 refs 2
00000800:00000200:3.0:1773851867.023317:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 10850@kfi7(0000000030a737d5):0x0 lsk 2814 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000afd Transaction freed
00000800:00000200:13.0:1773851867.256979:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.256981:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851867.256983:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851867.256987:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851867.256990:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8416@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.256992:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8416@kfi7 : PUT - for me
00000400:00000200:13.0:1773851867.256994:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8416@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.256995:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e39cd9fb nid 8416@kfi7 refs 1
00000400:00000200:13.0:1773851867.256997:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8416@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.256998:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e39cd9fb nid 8416@kfi7 refs 2
00000400:00000200:13.0:1773851867.256999:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e39cd9fb nid 8416@kfi7 refs 3
00000400:00000200:13.0:1773851867.257000:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8417@kfi7 to cpt 6
00000400:00000200:13.0:1773851867.257002:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8417@kfi7 of length 224 into portal 12 MB=0x69b95d6fd3300
00000400:00000200:13.0:1773851867.257004:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8417@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 27336
00000800:00000200:13.0:1773851867.257007:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851867.257010:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851867.257012:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8416@kfi7: PUT: OK
00000100:00000001:13.0:1773851867.257013:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851867.257014:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851867.257015:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000074be16db.
00000100:00000040:13.0:1773851867.257016:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000074be16db x1859917719614208 msgsize 224
00000100:00100000:13.0:1773851867.257019:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8417@kfi7 (source: 12345-8416@kfi7)
00000100:00000001:13.0:1773851867.257021:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851867.257023:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e39cd9fb nid 8416@kfi7 refs 2
00000800:00000200:13.0:1773851867.257025:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851867.257032:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851867.257033:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851867.257034:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851867.257035:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851867.257037:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851867.257038:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859917719614208
00000020:00000001:13.0:1773851867.257039:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851867.257039:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b649873ef
00000020:00000001:13.0:1773851867.257040:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851867.257045:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055373b01 refcount=449
00000020:00000001:13.0:1773851867.257046:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636945480787968 : -107128228763648 : ffff9e9143faa800)
00000020:00000001:13.0:1773851867.257047:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636945480787968 : -107128228763648 : ffff9e9143faa800)
00000100:00000001:13.0:1773851867.257049:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.257050:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851867.257051:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092eb84b1.
00000020:00000010:13.0:1773851867.257053:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.257054:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e27c9b87.
00000100:00000001:13.0:1773851867.257056:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851867.257057:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851867.257058:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.257059:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851867.257060:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851867.257061:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.257062:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.257065:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.257066:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851867.257066:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851867.257067:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851867.257067:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8417@kfi7, seq: 2289828
00000100:00000001:15.0:1773851867.257069:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.257069:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055373b01 : new rpc_count 8
00000100:00000001:13.0:1773851867.257070:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970980096 : -107043738571520 : ffff9ea4effcad00)
00000100:00000001:15.0:1773851867.257071:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.257072:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000074be16db x1859917719614208/t0(0) o400->6fb296c2-104d-44c6-bb96-922277c04635@8417@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1007-0'
00000100:00000001:13.0:1773851867.257077:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.257077:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851867.257082:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074be16db pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:6fb296c2-104d-44c6-bb96-922277c04635+449:39848:x1859917719614208:12345-8417@kfi7:400:default-tuolumne1007-0
00000100:00000200:13.0:1773851867.257084:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859917719614208
00000020:00000001:13.0:1773851867.257085:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851867.257086:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851867.257087:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.257089:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851867.257089:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851867.257091:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851867.257092:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859917719614208, found 0 last_xid 1859917719042879
00000020:00000001:13.0:1773851867.257093:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851867.257094:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851867.257095:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851867.257096:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.257097:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851867.257098:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851867.257099:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851867.257099:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea486345.
02000000:00000001:13.0:1773851867.257101:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.257102:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.257103:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851867.257104:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255336130, transno 0, xid 1859917719614208
00010000:00000001:13.0:1773851867.257105:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851867.257107:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000074be16db x1859917719614208/t0(0) o400->6fb296c2-104d-44c6-bb96-922277c04635@8417@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1007-0'
00010000:00000001:13.0:1773851867.257111:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851867.257112:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851867.257113:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851867.257115:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851867.257116:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b37a9832 refcount 3 to 8417@kfi7
00000100:00000001:13.0:1773851867.257117:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860512 : -107149578691104 : ffff9e8c4b6c9de0)
02000000:00000001:13.0:1773851867.257118:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851867.257119:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.257120:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851867.257123:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8416@kfi7
00000400:00000010:13.0:1773851867.257124:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000235c42fd.
00000100:00000200:13.0:1773851867.257126:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859917719614208, offset 224
00000400:00000200:13.0:1773851867.257128:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8416@kfi7
00000400:00000200:13.0:1773851867.257130:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8416@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.257131:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e39cd9fb nid 8416@kfi7 refs 1
00000400:00000200:13.0:1773851867.257133:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e39cd9fb nid 8416@kfi7 refs 2
00000400:00000200:13.0:1773851867.257135:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e39cd9fb nid 8416@kfi7 refs 3
00000400:00000200:13.0:1773851867.257137:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8416@kfi7 local destination
00000400:00000200:13.0:1773851867.257139:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769208:8769208:1024:4294967295] 8416@kfi7 LPNI seq info [4250498:4250498:16:4294967295]
00000400:00000200:13.0:1773851867.257142:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e39cd9fb nid 8416@kfi7 refs 2
00000400:00000200:13.0:1773851867.257143:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8416@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.257147:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8416@kfi7(8416@kfi7:8416@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851867.257149:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e39cd9fb nid 8416@kfi7 refs 3
00000800:00000200:13.0:1773851867.257151:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.257153:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851867.257156:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851867.257160:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000075f Using peer 8416@kfi7(0x10000000000075f)
00000800:00000200:13.0:1773851867.257165:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008e3f5456: Posted send of 324 bytes to peer 0x10000000000075f: rc=0
00000800:00000200:13.0:1773851867.257167:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000075f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851867.257171:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.257172:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b37a9832 refcount 2 to 8417@kfi7
00010000:00000001:13.0:1773851867.257173:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851867.257174:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.257175:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851867.257176:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000074be16db x1859917719614208/t0(0) o400->6fb296c2-104d-44c6-bb96-922277c04635@8417@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1007-0'
00000800:00000200:14.0:1773851867.257184:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000075f TN_EVENT_TX_OK event status 0
00000100:00100000:13.0:1773851867.257188:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074be16db pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:6fb296c2-104d-44c6-bb96-922277c04635+449:39848:x1859917719614208:12345-8417@kfi7:400:default-tuolumne1007-0 Request processed in 110us (170us total) trans 0 rc 0/0
00000400:00000200:14.0:1773851867.257189:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851867.257191:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8416@kfi7: PUT: OK
00000100:00100000:13.0:1773851867.257192:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8417@kfi7, seq: 2289828
00000400:00000200:14.0:1773851867.257193:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000235c42fd
00000100:00000040:13.0:1773851867.257193:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055373b01 : new rpc_count 7
00000400:00000010:14.0:1773851867.257194:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000235c42fd.
00000100:00000001:14.0:1773851867.257195:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851867.257195:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851867.257195:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:14.0:1773851867.257196:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:13.0:1773851867.257196:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851867.257198:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e39cd9fb nid 8416@kfi7 refs 2
00000020:00000010:13.0:1773851867.257198:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e27c9b87.
00000020:00000010:13.0:1773851867.257199:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092eb84b1.
00000020:00000040:13.0:1773851867.257200:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000055373b01 : new refcount 448
00000800:00000200:14.0:1773851867.257201:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 8416@kfi7(0000000075996e97):0x0 lsk 1888 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000075f Transaction freed
00000100:00000001:13.0:1773851867.257202:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851867.269745:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851867.269746:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851867.269747:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851867.269749:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851867.269751:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10305@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.269752:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10305@kfi7 : PUT - for me
00000400:00000200:29.0:1773851867.269753:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10305@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.269755:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ac16291 nid 10305@kfi7 refs 1
00000400:00000200:29.0:1773851867.269756:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10305@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.269757:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ac16291 nid 10305@kfi7 refs 2
00000400:00000200:29.0:1773851867.269758:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ac16291 nid 10305@kfi7 refs 3
00000400:00000200:29.0:1773851867.269758:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10305@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.269759:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10305@kfi7 of length 224 into portal 12 MB=0x69b4b9a924040
00000400:00000200:29.0:1773851867.269761:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10305@kfi7 of length 224/224 into md 0x77fe139dd [64] + 175304
00000800:00000200:29.0:1773851867.269762:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851867.269764:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.269764:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10305@kfi7: PUT: OK
00000100:00000001:29.0:1773851867.269765:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851867.269766:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851867.269766:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c8760cc.
00000100:00000040:29.0:1773851867.269768:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000001c8760cc x1859598878392384 msgsize 224
00000100:00100000:29.0:1773851867.269769:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-10305@kfi7 (source: 12345-10305@kfi7)
00000100:00000001:29.0:1773851867.269770:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851867.269770:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ac16291 nid 10305@kfi7 refs 2
00000100:00000001:28.0:1773851867.269771:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851867.269772:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851867.269772:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851867.269772:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851867.269773:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851867.269774:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851867.269774:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598878392384
00000020:00000001:28.0:1773851867.269775:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851867.269775:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38927fd0
00000020:00000001:28.0:1773851867.269776:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851867.269778:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bcb0d1b6 refcount=162
00000020:00000001:28.0:1773851867.269779:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114969804800 : -106958739746816 : ffff9eb8ba4fd000)
00000020:00000001:28.0:1773851867.269780:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637114969804800 : -106958739746816 : ffff9eb8ba4fd000)
00000100:00000001:28.0:1773851867.269781:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.269782:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851867.269783:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000adb0a5b7.
00000020:00000010:28.0:1773851867.269784:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.269785:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851867.269785:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851867.269786:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851867.269786:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851867.269787:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851867.269788:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851867.269788:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.269789:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851867.269791:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851867.269791:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851867.269792:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851867.269792:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851867.269792:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10305@kfi7, seq: 2055519
00000100:00000001:31.0:1773851867.269793:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.269793:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bcb0d1b6 : new rpc_count 1
00000100:00000001:31.0:1773851867.269794:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.269794:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309689472 : -106988399862144 : ffff9eb1d26e5e80)
00000100:00000040:28.0:1773851867.269795:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c8760cc x1859598878392384/t0(0) o400->e6b486cb-e18b-48da-bd19-52418dcaa911@10305@kfi7:655/0 lens 224/0 e 0 to 0 dl 1773852015 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1140-0'
00000100:00000001:28.0:1773851867.269798:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.269799:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851867.269800:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c8760cc pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e6b486cb-e18b-48da-bd19-52418dcaa911+162:39608:x1859598878392384:12345-10305@kfi7:400:default-tuolumne1140-0
00000100:00000200:28.0:1773851867.269801:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598878392384
00000020:00000001:28.0:1773851867.269802:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851867.269803:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851867.269803:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.269804:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851867.269804:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851867.269805:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851867.269806:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598878392384, found 0 last_xid 1859598877996351
00000020:00000001:28.0:1773851867.269807:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851867.269808:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851867.269808:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851867.269809:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.269809:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851867.269810:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851867.269811:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851867.269811:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007019ce07.
02000000:00000001:28.0:1773851867.269812:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.269812:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.269813:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851867.269814:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062648, transno 0, xid 1859598878392384
00010000:00000001:28.0:1773851867.269815:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851867.269815:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c8760cc x1859598878392384/t0(0) o400->e6b486cb-e18b-48da-bd19-52418dcaa911@10305@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1140-0'
00010000:00000001:28.0:1773851867.269820:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851867.269821:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851867.269822:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=100 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851867.269823:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851867.269823:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001777de8d refcount 3 to 10305@kfi7
00000100:00000001:28.0:1773851867.269824:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269664 : -107152618281952 : ffff9e8b96402420)
02000000:00000001:28.0:1773851867.269825:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851867.269826:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.269826:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851867.269827:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10305@kfi7
00000400:00000010:28.0:1773851867.269828:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081660f45.
00000100:00000200:28.0:1773851867.269828:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598878392384, offset 224
00000400:00000200:28.0:1773851867.269830:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10305@kfi7
00000400:00000200:28.0:1773851867.269830:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10305@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.269831:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ac16291 nid 10305@kfi7 refs 1
00000400:00000200:28.0:1773851867.269832:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ac16291 nid 10305@kfi7 refs 2
00000400:00000200:28.0:1773851867.269833:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ac16291 nid 10305@kfi7 refs 3
00000400:00000200:28.0:1773851867.269835:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10305@kfi7 local destination
00000400:00000200:28.0:1773851867.269836:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769209:8769209:1024:4294967295] 10305@kfi7 LPNI seq info [693438:693438:16:4294967295]
00000400:00000200:28.0:1773851867.269837:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ac16291 nid 10305@kfi7 refs 2
00000400:00000200:28.0:1773851867.269838:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10305@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.269840:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10305@kfi7(10305@kfi7:10305@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851867.269841:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ac16291 nid 10305@kfi7 refs 3
00000800:00000200:28.0:1773851867.269842:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851867.269844:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851867.269846:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851867.269848:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006c8 Using peer 10305@kfi7(0x1000000000006c8)
00000800:00000200:28.0:1773851867.269853:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x1000000000006c8: rc=0
00000800:00000200:28.0:1773851867.269854:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006c8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851867.269857:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.269857:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001777de8d refcount 2 to 10305@kfi7
00010000:00000001:28.0:1773851867.269858:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851867.269859:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.269859:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851867.269860:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c8760cc x1859598878392384/t0(0) o400->e6b486cb-e18b-48da-bd19-52418dcaa911@10305@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1140-0'
00000100:00100000:28.0:1773851867.269864:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c8760cc pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e6b486cb-e18b-48da-bd19-52418dcaa911+162:39608:x1859598878392384:12345-10305@kfi7:400:default-tuolumne1140-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851867.269867:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10305@kfi7, seq: 2055519
00000100:00000040:28.0:1773851867.269867:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bcb0d1b6 : new rpc_count 0
00000100:00000001:28.0:1773851867.269868:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851867.269869:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851867.269869:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.269870:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851867.269871:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000adb0a5b7.
00000020:00000040:28.0:1773851867.269871:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000bcb0d1b6 : new refcount 161
00000100:00000001:28.0:1773851867.269872:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851867.269877:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006c8 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851867.269878:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.269879:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10305@kfi7: PUT: OK
00000400:00000200:29.0:1773851867.269879:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081660f45
00000400:00000010:29.0:1773851867.269880:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081660f45.
00000100:00000001:29.0:1773851867.269880:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851867.269881:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851867.269882:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ac16291 nid 10305@kfi7 refs 2
00000800:00000200:29.0:1773851867.269883:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 10305@kfi7(000000006cdcdcef):0x0 lsk 1737 rsk 31 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006c8 Transaction freed
00010000:00000001:2.0:1773851867.273731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273733:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851867.273733:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851867.273734:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273734:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851867.273734:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273735:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273736:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273737:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851867.273737:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851867.273738:0:2506505:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851867.273738:0:2506505:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851867.273739:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273740:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851867.273740:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273741:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273741:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273742:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851867.273743:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851867.273743:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273744:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851867.273744:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273745:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273745:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851867.273749:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851867.273749:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851867.273750:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273750:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851867.273751:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273751:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851867.273752:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851867.273757:0:937837:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:30.0:1773851867.273757:0:937837:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:30.0:1773851867.273758:0:937837:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:18.0:1773851867.346547:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851867.346547:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851867.346549:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851867.346551:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851867.346553:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:18.0:1773851867.346554:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.109@tcp : PUT - for me
00000400:00000200:18.0:1773851867.346556:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:18.0:1773851867.346557:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:18.0:1773851867.346558:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.109@tcp to cpt 1
00000400:00000200:18.0:1773851867.346559:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000939bdfce nid 172.16.70.109@tcp refs 2
00000400:00000200:18.0:1773851867.346561:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000939bdfce nid 172.16.70.109@tcp refs 3
00000400:00000200:18.0:1773851867.346562:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.109@tcp to cpt 1
00000400:00000200:18.0:1773851867.346563:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.109@tcp of length 224 into portal 12 MB=0x69a0fda6acdc0
00000400:00000200:18.0:1773851867.346565:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.109@tcp of length 224/224 into md 0x793926dc5 [64] + 135224
00000800:00000200:18.0:1773851867.346567:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851867.346568:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851867.346570:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:18.0:1773851867.346571:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851867.346572:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851867.346573:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ab9852a.
00000100:00000040:18.0:1773851867.346573:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000002ab9852a x1858242739883456 msgsize 224
00000100:00100000:18.0:1773851867.346575:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.109@tcp (source: 12345-172.16.70.109@tcp)
00000100:00000001:18.0:1773851867.346577:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851867.346579:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:18.0:1773851867.346580:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851867.346581:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851867.346581:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851867.346582:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851867.346582:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851867.346583:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851867.346584:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858242739883456
00000020:00000001:7.0:1773851867.346584:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851867.346585:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93060
00000020:00000001:7.0:1773851867.346585:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851867.346588:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003be9e399 refcount=8
00000020:00000001:7.0:1773851867.346589:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745152512 : -107128964399104 : ffff9e911821c000)
00000020:00000001:7.0:1773851867.346590:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745152512 : -107128964399104 : ffff9e911821c000)
00000100:00000001:7.0:1773851867.346591:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.346591:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851867.346593:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c4d9c27.
00000020:00000010:7.0:1773851867.346594:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851867.346595:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008745c425.
00000100:00000001:7.0:1773851867.346596:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851867.346596:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851867.346597:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.346598:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851867.346598:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851867.346599:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.346600:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.346601:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851867.346602:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851867.346603:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.109@tcp, seq: 2001916
00000100:00000001:5.0:1773851867.346603:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:7.0:1773851867.346604:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003be9e399 : new rpc_count 2
00000100:00000001:5.0:1773851867.346604:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851867.346605:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534643456 : -106946174908160 : ffff9ebba73c0900)
00000100:00000001:5.0:1773851867.346605:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.346606:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002ab9852a x1858242739883456/t0(0) o400->f9063395-7f96-402c-8331-79b2f059fc7b@172.16.70.109@tcp:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic9-0'
00000100:00000001:5.0:1773851867.346606:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.346609:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.346609:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851867.346610:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ab9852a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f9063395-7f96-402c-8331-79b2f059fc7b+8:53248:x1858242739883456:12345-172.16.70.109@tcp:400:login-rzslic9-0
00000100:00000200:7.0:1773851867.346611:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858242739883456
00000020:00000001:7.0:1773851867.346612:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851867.346613:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851867.346613:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.346614:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851867.346614:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851867.346615:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851867.346615:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858242739883456, found 0 last_xid 1858242162549503
00000020:00000001:7.0:1773851867.346616:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851867.346617:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851867.346618:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851867.346618:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.346619:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851867.346619:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851867.346620:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851867.346621:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007a36a58f.
02000000:00000001:7.0:1773851867.346621:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.346622:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.346623:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851867.346623:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183111082006, transno 0, xid 1858242739883456
00010000:00000001:7.0:1773851867.346624:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851867.346625:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002ab9852a x1858242739883456/t0(0) o400->f9063395-7f96-402c-8331-79b2f059fc7b@172.16.70.109@tcp:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic9-0'
00010000:00000001:7.0:1773851867.346627:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851867.346627:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851867.346629:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=99 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851867.346630:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851867.346630:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000056a117eb refcount 3 to 172.16.70.109@tcp
00000100:00000001:7.0:1773851867.346631:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934277152416 : -107139432399200 : ffff9e8ea830bea0)
02000000:00000001:7.0:1773851867.346632:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851867.346632:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.346634:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851867.346635:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.109@tcp
00000400:00000010:7.0:1773851867.346635:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
00000100:00000200:7.0:1773851867.346636:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858242739883456, offset 224
00000400:00000200:7.0:1773851867.346637:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.109@tcp
00000400:00000200:7.0:1773851867.346638:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.109@tcp to cpt 1
00000400:00000200:7.0:1773851867.346639:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000939bdfce nid 172.16.70.109@tcp refs 2
00000400:00000200:7.0:1773851867.346640:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000939bdfce nid 172.16.70.109@tcp refs 3
00000400:00000200:7.0:1773851867.346642:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000939bdfce nid 172.16.70.109@tcp refs 4
00000400:00000200:7.0:1773851867.346643:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.109@tcp routed destination
00000400:00000200:7.0:1773851867.346644:0:60963:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851867.346645:0:60963:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:7.0:1773851867.346647:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.109@tcp: rtr pref emtpy: 1
00000400:00000200:7.0:1773851867.346648:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851867.346649:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.109@tcp: rtr pref emtpy: 1
00000400:00000200:7.0:1773851867.346650:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851867.346651:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769210:8769210:1024:4294967295] 2094@kfi7 LPNI seq info [1258746989:1258746989:16:4294967295]
00000400:00000200:7.0:1773851867.346652:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:7.0:1773851867.346653:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:7.0:1773851867.346656:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.109@tcp(172.16.70.109@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851867.346657:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000939bdfce nid 172.16.70.109@tcp refs 3
00000800:00000200:7.0:1773851867.346659:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851867.346660:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851867.346662:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851867.346665:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:7.0:1773851867.346668:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:7.0:1773851867.346670:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851867.346672:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.346673:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000056a117eb refcount 2 to 172.16.70.109@tcp
00010000:00000001:7.0:1773851867.346673:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851867.346674:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.346675:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851867.346676:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002ab9852a x1858242739883456/t0(0) o400->f9063395-7f96-402c-8331-79b2f059fc7b@172.16.70.109@tcp:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic9-0'
00000100:00100000:7.0:1773851867.346679:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ab9852a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f9063395-7f96-402c-8331-79b2f059fc7b+8:53248:x1858242739883456:12345-172.16.70.109@tcp:400:login-rzslic9-0 Request processed in 69us (104us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851867.346682:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.109@tcp, seq: 2001916
00000100:00000040:7.0:1773851867.346683:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003be9e399 : new rpc_count 1
00000800:00000200:5.0:1773851867.346683:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851867.346684:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851867.346684:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851867.346685:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851867.346686:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008745c425.
00000400:00000200:5.0:1773851867.346686:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851867.346687:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c4d9c27.
00000020:00000040:7.0:1773851867.346687:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000003be9e399 : new refcount 7
00000100:00000001:7.0:1773851867.346688:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851867.346688:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:5.0:1773851867.346689:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
00000400:00000010:5.0:1773851867.346690:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000100:00000001:5.0:1773851867.346691:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851867.346692:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851867.346693:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:5.0:1773851867.346696:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Transaction freed
00000800:00000200:14.0:1773851867.355763:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.355763:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851867.355765:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851867.355765:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851867.355767:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851867.355769:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851867.355771:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10178@kfi7(0000000041189dfc):0x54d version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851867.355773:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851867.355775:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d Using peer 10178@kfi7(0x10000000000054d)
00000400:00000200:14.0:1773851867.355777:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10178@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.355779:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10178@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.355780:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10178@kfi7 : PUT - for me
00000800:00000200:13.0:1773851867.355782:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008e3f5456: Posted send of 38 bytes to peer 0x10000000000054d: rc=0
00000400:00000200:14.0:1773851867.355783:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10178@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.355785:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbfffe4e nid 10178@kfi7 refs 1
00000800:00000200:13.0:1773851867.355785:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851867.355787:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10178@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.355788:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbfffe4e nid 10178@kfi7 refs 2
00000400:00000200:14.0:1773851867.355790:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cbfffe4e nid 10178@kfi7 refs 3
00000400:00000200:14.0:1773851867.355792:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9987@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.355794:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9987@kfi7 of length 224 into portal 12 MB=0x69b9d7836f980
00000400:00000200:14.0:1773851867.355797:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9987@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 27560
00000800:00000200:13.0:1773851867.355800:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d TN_EVENT_TX_OK event status 0
00000800:00000200:14.0:1773851867.355802:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851867.355804:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008e3f5456: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d Transaction freed
00000400:00000200:14.0:1773851867.355805:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851867.355807:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10178@kfi7: PUT: OK
00000100:00000001:14.0:1773851867.355809:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851867.355810:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851867.355812:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003886ed17.
00000100:00000040:14.0:1773851867.355813:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000003886ed17 x1859950489303424 msgsize 224
00000100:00100000:14.0:1773851867.355816:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-9987@kfi7 (source: 12345-10178@kfi7)
00000100:00000001:14.0:1773851867.355819:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851867.355820:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cbfffe4e nid 10178@kfi7 refs 2
00000100:00000001:13.0:1773851867.355822:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851867.355823:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:13.0:1773851867.355823:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851867.355824:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851867.355826:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851867.355827:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851867.355828:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859950489303424
00000020:00000001:13.0:1773851867.355830:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851867.355830:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08c7a8c6370
00000020:00000001:13.0:1773851867.355831:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851867.355835:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c77fa5c4 refcount=167
00000020:00000001:13.0:1773851867.355836:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637145256287232 : -106928453264384 : ffff9ebfc786dc00)
00000020:00000001:13.0:1773851867.355837:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637145256287232 : -106928453264384 : ffff9ebfc786dc00)
00000100:00000001:13.0:1773851867.355839:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.355840:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851867.355842:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092eb84b1.
00000020:00000010:13.0:1773851867.355844:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.355845:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e27c9b87.
00000100:00000001:13.0:1773851867.355847:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851867.355848:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851867.355849:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.355850:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851867.355851:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851867.355852:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.355853:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.355856:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.355857:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.355857:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851867.355857:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851867.355859:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9987@kfi7, seq: 2289829
00000100:00000001:15.0:1773851867.355860:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.355860:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c77fa5c4 : new rpc_count 1
00000100:00000001:15.0:1773851867.355861:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.355861:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341823360 : -106946367728256 : ffff9ebb9bbdd580)
00000100:00000040:13.0:1773851867.355863:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003886ed17 x1859950489303424/t0(0) o400->610145ec-e350-4557-aa8f-8cef08cab8b6@9987@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1127-0'
00000100:00000001:13.0:1773851867.355869:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.355870:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851867.355871:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003886ed17 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:610145ec-e350-4557-aa8f-8cef08cab8b6+167:39913:x1859950489303424:12345-9987@kfi7:400:default-tuolumne1127-0
00000100:00000200:13.0:1773851867.355874:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859950489303424
00000020:00000001:13.0:1773851867.355876:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851867.355877:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851867.355878:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.355879:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851867.355880:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851867.355881:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851867.355882:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859950489303424, found 0 last_xid 1859950488881407
00000020:00000001:13.0:1773851867.355884:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851867.355885:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851867.355886:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851867.355887:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.355888:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851867.355889:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851867.355890:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851867.355891:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c6d32409.
02000000:00000001:13.0:1773851867.355892:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.355893:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.355895:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851867.355896:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063432, transno 0, xid 1859950489303424
00010000:00000001:13.0:1773851867.355897:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851867.355899:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003886ed17 x1859950489303424/t0(0) o400->610145ec-e350-4557-aa8f-8cef08cab8b6@9987@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1127-0'
00010000:00000001:13.0:1773851867.355903:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851867.355904:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851867.355906:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851867.355908:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851867.355909:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004089d749 refcount 3 to 9987@kfi7
00000100:00000001:13.0:1773851867.355910:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521907008 : -107145187644608 : ffff9e8d5126ab40)
02000000:00000001:13.0:1773851867.355912:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851867.355912:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.355914:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851867.355915:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10178@kfi7
00000400:00000010:13.0:1773851867.355916:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003edd11ab.
00000100:00000200:13.0:1773851867.355918:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859950489303424, offset 224
00000400:00000200:13.0:1773851867.355920:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10178@kfi7
00000400:00000200:13.0:1773851867.355923:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10178@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.355925:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbfffe4e nid 10178@kfi7 refs 1
00000400:00000200:13.0:1773851867.355926:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cbfffe4e nid 10178@kfi7 refs 2
00000400:00000200:13.0:1773851867.355929:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cbfffe4e nid 10178@kfi7 refs 3
00000400:00000200:13.0:1773851867.355931:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10178@kfi7 local destination
00000400:00000200:13.0:1773851867.355933:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769211:8769211:1024:4294967295] 10178@kfi7 LPNI seq info [960490:960490:16:4294967295]
00000400:00000200:13.0:1773851867.355936:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cbfffe4e nid 10178@kfi7 refs 2
00000400:00000200:13.0:1773851867.355938:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10178@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.355941:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10178@kfi7(10178@kfi7:10178@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851867.355944:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cbfffe4e nid 10178@kfi7 refs 3
00000800:00000200:13.0:1773851867.355946:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.355948:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851867.355952:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851867.355956:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d Using peer 10178@kfi7(0x10000000000054d)
00000800:00000200:13.0:1773851867.355961:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008e3f5456: Posted send of 324 bytes to peer 0x10000000000054d: rc=0
00000800:00000200:13.0:1773851867.355964:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851867.355967:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.355969:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004089d749 refcount 2 to 9987@kfi7
00010000:00000001:13.0:1773851867.355970:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851867.355971:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.355972:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851867.355973:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003886ed17 x1859950489303424/t0(0) o400->610145ec-e350-4557-aa8f-8cef08cab8b6@9987@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1127-0'
00000100:00100000:13.0:1773851867.355979:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003886ed17 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:610145ec-e350-4557-aa8f-8cef08cab8b6+167:39913:x1859950489303424:12345-9987@kfi7:400:default-tuolumne1127-0 Request processed in 110us (165us total) trans 0 rc 0/0
00000800:00000200:14.0:1773851867.355980:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851867.355983:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851867.355985:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10178@kfi7: PUT: OK
00000400:00000200:14.0:1773851867.355986:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003edd11ab
00000400:00000010:14.0:1773851867.355988:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003edd11ab.
00000100:00100000:13.0:1773851867.355988:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9987@kfi7, seq: 2289829
00000100:00000040:13.0:1773851867.355989:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c77fa5c4 : new rpc_count 0
00000100:00000001:14.0:1773851867.355990:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851867.355991:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:13.0:1773851867.355991:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851867.355992:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cbfffe4e nid 10178@kfi7 refs 2
00000100:00000001:13.0:1773851867.355992:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851867.355993:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.355994:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e27c9b87.
00000800:00000200:14.0:1773851867.355995:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008e3f5456: 2054@kfi7:3 -> 10178@kfi7(0000000041189dfc):0x0 lsk 1358 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000054d Transaction freed
00000020:00000010:13.0:1773851867.355996:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092eb84b1.
00000020:00000040:13.0:1773851867.355997:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c77fa5c4 : new refcount 166
00000100:00000001:13.0:1773851867.355999:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851867.366165:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851867.366166:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851867.366167:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851867.366169:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851867.366171:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11297@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.366172:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11297@kfi7 : PUT - for me
00000400:00000200:25.0:1773851867.366173:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11297@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.366174:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003508e856 nid 11297@kfi7 refs 1
00000400:00000200:25.0:1773851867.366175:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11297@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.366175:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003508e856 nid 11297@kfi7 refs 2
00000400:00000200:25.0:1773851867.366176:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003508e856 nid 11297@kfi7 refs 3
00000400:00000200:25.0:1773851867.366177:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11488@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.366178:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11488@kfi7 of length 224 into portal 12 MB=0x69b095ff61300
00000400:00000200:25.0:1773851867.366179:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11488@kfi7 of length 224/224 into md 0x16159c9699 [64] + 8488
00000800:00000200:25.0:1773851867.366180:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851867.366182:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851867.366183:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11297@kfi7: PUT: OK
00000100:00000001:25.0:1773851867.366183:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851867.366184:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851867.366185:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b5160d1c.
00000100:00000040:25.0:1773851867.366185:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b5160d1c x1859314427237120 msgsize 224
00000100:00100000:25.0:1773851867.366187:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-11488@kfi7 (source: 12345-11297@kfi7)
00000100:00000001:25.0:1773851867.366188:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851867.366188:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003508e856 nid 11297@kfi7 refs 2
00000100:00000001:24.0:1773851867.366189:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851867.366190:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851867.366190:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851867.366190:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851867.366190:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851867.366191:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851867.366192:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314427237120
00000020:00000001:24.0:1773851867.366192:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851867.366193:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e22
00000020:00000001:24.0:1773851867.366193:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851867.366194:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000008362da4 refcount=6
00000020:00000001:24.0:1773851867.366195:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744437760 : -107128965113856 : ffff9e911816d800)
00000020:00000001:24.0:1773851867.366196:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744437760 : -107128965113856 : ffff9e911816d800)
00000100:00000001:24.0:1773851867.366197:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851867.366198:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851867.366198:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089b8a910.
00000020:00000010:24.0:1773851867.366199:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851867.366200:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000100:00000001:24.0:1773851867.366201:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851867.366201:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851867.366202:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851867.366202:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851867.366203:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851867.366203:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.366204:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851867.366205:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851867.366205:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851867.366206:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851867.366206:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851867.366207:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851867.366207:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11488@kfi7, seq: 2025095
00000100:00000040:24.0:1773851867.366207:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000008362da4 : new rpc_count 1
00000100:00000001:25.0:1773851867.366208:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.366208:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478754688 : -106938230796928 : ffff9ebd80bd8d80)
00000100:00000040:24.0:1773851867.366209:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b5160d1c x1859314427237120/t0(0) o400->b64ed8e4-01bc-41e4-868c-2a5c5ad5267d@11488@kfi7:84/0 lens 224/0 e 0 to 0 dl 1773852199 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1199-0'
00000100:00000001:24.0:1773851867.366212:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851867.366212:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851867.366213:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5160d1c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b64ed8e4-01bc-41e4-868c-2a5c5ad5267d+6:39661:x1859314427237120:12345-11488@kfi7:400:default-tuolumne1199-0
00000100:00000200:24.0:1773851867.366214:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314427237120
00000020:00000001:24.0:1773851867.366215:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851867.366215:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851867.366216:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.366217:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851867.366217:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851867.366218:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851867.366218:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314427237120, found 0 last_xid 1859314427237119
00000020:00000001:24.0:1773851867.366219:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851867.366220:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851867.366220:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851867.366221:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.366221:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851867.366222:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851867.366222:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851867.366223:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000081a66045.
02000000:00000001:24.0:1773851867.366224:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.366224:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.366225:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851867.366226:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154617596, transno 0, xid 1859314427237120
00010000:00000001:24.0:1773851867.366226:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851867.366227:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b5160d1c x1859314427237120/t0(0) o400->b64ed8e4-01bc-41e4-868c-2a5c5ad5267d@11488@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1199-0'
00010000:00000001:24.0:1773851867.366230:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851867.366230:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851867.366231:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=100 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851867.366232:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851867.366233:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a96c1f90 refcount 3 to 11488@kfi7
00000100:00000001:24.0:1773851867.366234:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313741696 : -107139395809920 : ffff9e8eaa5f0d80)
02000000:00000001:24.0:1773851867.366235:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851867.366235:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.366236:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851867.366237:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11297@kfi7
00000400:00000010:24.0:1773851867.366237:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b29eb607.
00000100:00000200:24.0:1773851867.366238:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314427237120, offset 224
00000400:00000200:24.0:1773851867.366239:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11297@kfi7
00000400:00000200:24.0:1773851867.366240:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11297@kfi7 to cpt 6
00000400:00000200:24.0:1773851867.366241:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003508e856 nid 11297@kfi7 refs 1
00000400:00000200:24.0:1773851867.366242:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003508e856 nid 11297@kfi7 refs 2
00000400:00000200:24.0:1773851867.366243:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003508e856 nid 11297@kfi7 refs 3
00000400:00000200:24.0:1773851867.366244:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11297@kfi7 local destination
00000400:00000200:24.0:1773851867.366245:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769212:8769212:1024:4294967295] 11297@kfi7 LPNI seq info [467354:467354:16:4294967295]
00000400:00000200:24.0:1773851867.366247:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003508e856 nid 11297@kfi7 refs 2
00000400:00000200:24.0:1773851867.366247:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11297@kfi7 to cpt 6
00000400:00000200:24.0:1773851867.366250:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11297@kfi7(11297@kfi7:11297@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851867.366251:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003508e856 nid 11297@kfi7 refs 3
00000800:00000200:24.0:1773851867.366252:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851867.366253:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851867.366255:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851867.366257:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000006bb Using peer 11297@kfi7(0x1000000000006bb)
00000800:00000200:24.0:1773851867.366260:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x1000000000006bb: rc=0
00000800:00000200:24.0:1773851867.366261:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000006bb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851867.366263:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851867.366265:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a96c1f90 refcount 2 to 11488@kfi7
00010000:00000001:24.0:1773851867.366265:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851867.366266:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.366267:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851867.366268:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b5160d1c x1859314427237120/t0(0) o400->b64ed8e4-01bc-41e4-868c-2a5c5ad5267d@11488@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1199-0'
00000100:00100000:24.0:1773851867.366272:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5160d1c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b64ed8e4-01bc-41e4-868c-2a5c5ad5267d+6:39661:x1859314427237120:12345-11488@kfi7:400:default-tuolumne1199-0 Request processed in 59us (85us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851867.366274:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11488@kfi7, seq: 2025095
00000100:00000040:24.0:1773851867.366275:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000008362da4 : new rpc_count 0
00000100:00000001:24.0:1773851867.366275:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851867.366276:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851867.366276:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851867.366277:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000020:00000010:24.0:1773851867.366278:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089b8a910.
00000020:00000040:24.0:1773851867.366279:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000008362da4 : new refcount 5
00000100:00000001:24.0:1773851867.366279:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851867.366284:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000006bb TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851867.366285:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851867.366286:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11297@kfi7: PUT: OK
00000400:00000200:25.0:1773851867.366287:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b29eb607
00000400:00000010:25.0:1773851867.366287:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b29eb607.
00000100:00000001:25.0:1773851867.366288:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851867.366288:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851867.366289:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003508e856 nid 11297@kfi7 refs 2
00000800:00000200:25.0:1773851867.366290:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11297@kfi7(0000000066eeb918):0x0 lsk 1724 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000006bb Transaction freed
00000800:00000200:17.0:1773851867.411959:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851867.411960:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851867.411961:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851867.411963:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851867.411965:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26363@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.411966:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26363@kfi7 : PUT - for me
00000400:00000200:17.0:1773851867.411967:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26363@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.411968:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000aa14cbd nid 26363@kfi7 refs 1
00000400:00000200:17.0:1773851867.411970:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26363@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.411970:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000aa14cbd nid 26363@kfi7 refs 2
00000400:00000200:17.0:1773851867.411971:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000aa14cbd nid 26363@kfi7 refs 3
00000400:00000200:17.0:1773851867.411972:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:17.0:1773851867.411973:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26362@kfi7 of length 224 into portal 12 MB=0x699de5a338a00
00000400:00000200:17.0:1773851867.411975:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26362@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 10328
00000800:00000200:17.0:1773851867.411977:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851867.411979:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851867.411980:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26363@kfi7: PUT: OK
00000100:00000001:17.0:1773851867.411981:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851867.411981:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851867.411982:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fcf3b4f9.
00000100:00000040:17.0:1773851867.411982:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000fcf3b4f9 x1858030135380480 msgsize 224
00000100:00100000:17.0:1773851867.411984:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26362@kfi7 (source: 12345-26363@kfi7)
00000100:00000001:17.0:1773851867.411985:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851867.411986:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000aa14cbd nid 26363@kfi7 refs 2
00000800:00000200:17.0:1773851867.411988:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851867.411990:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851867.411991:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851867.411991:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851867.411991:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851867.411992:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851867.411993:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030135380480
00000020:00000001:17.0:1773851867.411994:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851867.411994:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f5f
00000020:00000001:17.0:1773851867.411995:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851867.411999:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002c8480c9 refcount=6
00000020:00000001:17.0:1773851867.411999:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239891968 : -107152469659648 : ffff9e8b9f1bf000)
00000020:00000001:17.0:1773851867.412000:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239891968 : -107152469659648 : ffff9e8b9f1bf000)
00000100:00000001:17.0:1773851867.412001:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851867.412002:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851867.412002:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9fa9763.
00000020:00000010:17.0:1773851867.412003:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851867.412004:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851867.412005:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851867.412005:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851867.412006:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851867.412007:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851867.412007:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851867.412008:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.412009:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851867.412010:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851867.412010:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851867.412010:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851867.412011:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26362@kfi7, seq: 2156323
00000100:00000001:16.0:1773851867.412011:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851867.412012:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002c8480c9 : new rpc_count 1
00000100:00000001:16.0:1773851867.412012:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.412013:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093939456 : -107022615612160 : ffff9ea9db037500)
00000100:00000001:16.0:1773851867.412013:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851867.412014:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fcf3b4f9 x1858030135380480/t0(0) o400->1af02212-34b9-43db-9b16-1cd537b72a30@26362@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne271-0'
00000100:00000001:17.0:1773851867.412016:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851867.412017:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851867.412018:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcf3b4f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1af02212-34b9-43db-9b16-1cd537b72a30+6:47822:x1858030135380480:12345-26362@kfi7:400:default-tuolumne271-0
00000100:00000200:17.0:1773851867.412019:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030135380480
00000020:00000001:17.0:1773851867.412020:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851867.412020:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851867.412021:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.412022:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851867.412023:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851867.412023:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851867.412024:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030135380480, found 0 last_xid 1858030135380479
00000020:00000001:17.0:1773851867.412025:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851867.412026:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851867.412026:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851867.412027:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.412027:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851867.412028:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851867.412028:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851867.412029:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000025d0ec13.
02000000:00000001:17.0:1773851867.412030:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.412030:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.412032:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851867.412032:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030135380480
00010000:00000001:17.0:1773851867.412033:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851867.412034:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fcf3b4f9 x1858030135380480/t0(0) o400->1af02212-34b9-43db-9b16-1cd537b72a30@26362@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne271-0'
00010000:00000001:17.0:1773851867.412036:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851867.412037:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851867.412037:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=100 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851867.412038:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851867.412039:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a7df6c44 refcount 5 to 26362@kfi7
00000100:00000001:17.0:1773851867.412040:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231608032 : -107130477943584 : ffff9e90bdeae4e0)
02000000:00000001:17.0:1773851867.412041:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851867.412041:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.412042:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851867.412042:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26363@kfi7
00000400:00000010:17.0:1773851867.412043:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d50c8a85.
00000100:00000200:17.0:1773851867.412044:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030135380480, offset 224
00000400:00000200:17.0:1773851867.412045:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26363@kfi7
00000400:00000200:17.0:1773851867.412046:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26363@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.412046:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000aa14cbd nid 26363@kfi7 refs 1
00000400:00000200:17.0:1773851867.412047:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000aa14cbd nid 26363@kfi7 refs 2
00000400:00000200:17.0:1773851867.412048:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000aa14cbd nid 26363@kfi7 refs 3
00000400:00000200:17.0:1773851867.412049:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26363@kfi7 local destination
00000400:00000200:17.0:1773851867.412050:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769213:8769213:1024:4294967295] 26363@kfi7 LPNI seq info [28178:28178:16:4294967295]
00000400:00000200:17.0:1773851867.412052:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000aa14cbd nid 26363@kfi7 refs 2
00000400:00000200:17.0:1773851867.412052:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26363@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.412054:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26363@kfi7(26363@kfi7:26363@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851867.412055:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000aa14cbd nid 26363@kfi7 refs 3
00000800:00000200:17.0:1773851867.412056:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851867.412057:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851867.412059:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851867.412061:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20c Using peer 26363@kfi7(0x20c)
00000800:00000200:17.0:1773851867.412064:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x20c: rc=0
00000800:00000200:17.0:1773851867.412066:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851867.412068:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851867.412069:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a7df6c44 refcount 4 to 26362@kfi7
00010000:00000001:17.0:1773851867.412069:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851867.412070:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.412071:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851867.412071:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fcf3b4f9 x1858030135380480/t0(0) o400->1af02212-34b9-43db-9b16-1cd537b72a30@26362@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne271-0'
00000100:00100000:17.0:1773851867.412074:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcf3b4f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1af02212-34b9-43db-9b16-1cd537b72a30+6:47822:x1858030135380480:12345-26362@kfi7:400:default-tuolumne271-0 Request processed in 57us (91us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851867.412077:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26362@kfi7, seq: 2156323
00000800:00000200:18.0:1773851867.412078:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20c TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851867.412078:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002c8480c9 : new rpc_count 0
00000100:00000001:17.0:1773851867.412078:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851867.412079:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851867.412079:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851867.412079:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851867.412080:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26363@kfi7: PUT: OK
00000020:00000010:17.0:1773851867.412080:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851867.412081:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d50c8a85
00000020:00000010:17.0:1773851867.412081:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9fa9763.
00000020:00000040:17.0:1773851867.412081:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000002c8480c9 : new refcount 5
00000400:00000010:18.0:1773851867.412082:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d50c8a85.
00000100:00000001:18.0:1773851867.412082:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851867.412082:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851867.412083:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851867.412084:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000aa14cbd nid 26363@kfi7 refs 2
00000800:00000200:18.0:1773851867.412085:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 26363@kfi7(000000006987b3c5):0x0 lsk 525 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20c Transaction freed
00000800:00000200:5.0:1773851867.444840:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851867.444842:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851867.444843:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851867.444847:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851867.444852:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.444854:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20474@kfi7 : PUT - for me
00000400:00000200:5.0:1773851867.444856:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.444857:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 1
00000400:00000200:5.0:1773851867.444859:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.444860:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000400:00000200:5.0:1773851867.444862:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 3
00000400:00000200:5.0:1773851867.444864:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20475@kfi7 to cpt 4
00000400:00000200:5.0:1773851867.444865:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20475@kfi7 of length 224 into portal 12 MB=0x699de8bc14dc0
00000400:00000200:5.0:1773851867.444868:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20475@kfi7 of length 224/224 into md 0x793926dc5 [64] + 135448
00000800:00000200:5.0:1773851867.444871:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851867.444874:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851867.444876:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20474@kfi7: PUT: OK
00000100:00000001:5.0:1773851867.444878:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851867.444878:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851867.444880:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009ae50ab6.
00000100:00000040:5.0:1773851867.444881:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000009ae50ab6 x1858030966754752 msgsize 224
00000100:00100000:5.0:1773851867.444884:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20475@kfi7 (source: 12345-20474@kfi7)
00000100:00000001:5.0:1773851867.444885:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851867.444887:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000100:00000001:7.0:1773851867.444888:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851867.444889:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851867.444889:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851867.444890:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851867.444891:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851867.444892:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851867.444894:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966754752
00000020:00000001:7.0:1773851867.444895:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851867.444895:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9103f
00000020:00000001:7.0:1773851867.444897:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851867.444901:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bde4f8a refcount=6
00000020:00000001:7.0:1773851867.444903:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240113152 : -107152469438464 : ffff9e8b9f1f5000)
00000020:00000001:7.0:1773851867.444904:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240113152 : -107152469438464 : ffff9e8b9f1f5000)
00000100:00000001:7.0:1773851867.444906:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.444907:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851867.444908:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c4d9c27.
00000020:00000010:7.0:1773851867.444910:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851867.444911:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008745c425.
00000100:00000001:7.0:1773851867.444913:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851867.444913:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851867.444914:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.444916:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851867.444917:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851867.444918:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.444919:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.444922:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851867.444922:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851867.444923:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851867.444923:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851867.444925:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20475@kfi7, seq: 2001917
00000100:00000040:7.0:1773851867.444926:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bde4f8a : new rpc_count 1
00000100:00000001:5.0:1773851867.444926:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.444927:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886776192 : -106955822775424 : ffff9eb9682d4380)
00000100:00000001:5.0:1773851867.444927:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.444929:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009ae50ab6 x1858030966754752/t0(0) o400->4d3cbc0a-5dc6-4b37-a52a-0372846a4c44@20475@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne248-0'
00000100:00000001:7.0:1773851867.444934:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.444935:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851867.444936:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ae50ab6 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4d3cbc0a-5dc6-4b37-a52a-0372846a4c44+6:47982:x1858030966754752:12345-20475@kfi7:400:default-tuolumne248-0
00000100:00000200:7.0:1773851867.444939:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966754752
00000020:00000001:7.0:1773851867.444940:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851867.444941:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851867.444942:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.444944:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851867.444944:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851867.444947:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851867.444948:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966754752, found 0 last_xid 1858030966754751
00000020:00000001:7.0:1773851867.444949:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851867.444950:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851867.444951:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851867.444952:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.444953:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851867.444954:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851867.444955:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851867.444957:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a151f808.
02000000:00000001:7.0:1773851867.444958:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.444959:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.444960:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851867.444962:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030966754752
00010000:00000001:7.0:1773851867.444963:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851867.444965:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009ae50ab6 x1858030966754752/t0(0) o400->4d3cbc0a-5dc6-4b37-a52a-0372846a4c44@20475@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne248-0'
00010000:00000001:7.0:1773851867.444969:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851867.444970:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851867.444971:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=99 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851867.444974:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851867.444975:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8824ea3 refcount 5 to 20475@kfi7
00000100:00000001:7.0:1773851867.444976:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519584 : -107156126032032 : ffff9e8ac52c1f60)
02000000:00000001:7.0:1773851867.444978:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851867.444979:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.444980:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851867.444981:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20474@kfi7
00000400:00000010:7.0:1773851867.444982:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d794ea.
00000100:00000200:7.0:1773851867.444984:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966754752, offset 224
00000400:00000200:7.0:1773851867.444987:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20474@kfi7
00000400:00000200:7.0:1773851867.444988:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.444990:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 1
00000400:00000200:7.0:1773851867.444991:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000400:00000200:7.0:1773851867.444993:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 3
00000400:00000200:7.0:1773851867.444996:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20474@kfi7 local destination
00000400:00000200:7.0:1773851867.444999:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769214:8769214:1024:4294967295] 20474@kfi7 LPNI seq info [24413:24413:16:4294967295]
00000400:00000200:7.0:1773851867.445002:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000400:00000200:7.0:1773851867.445003:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.445007:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20474@kfi7(20474@kfi7:20474@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851867.445009:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 3
00000800:00000200:7.0:1773851867.445011:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851867.445013:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851867.445017:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851867.445022:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x13b Using peer 20474@kfi7(0x13b)
00000800:00000200:7.0:1773851867.445027:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x13b: rc=0
00000800:00000200:7.0:1773851867.445029:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x13b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851867.445033:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.445035:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8824ea3 refcount 4 to 20475@kfi7
00010000:00000001:7.0:1773851867.445036:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851867.445037:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.445038:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851867.445039:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009ae50ab6 x1858030966754752/t0(0) o400->4d3cbc0a-5dc6-4b37-a52a-0372846a4c44@20475@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne248-0'
00000800:00000200:5.0:1773851867.445044:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x13b TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851867.445046:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ae50ab6 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4d3cbc0a-5dc6-4b37-a52a-0372846a4c44+6:47982:x1858030966754752:12345-20475@kfi7:400:default-tuolumne248-0 Request processed in 110us (163us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851867.445047:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851867.445049:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20474@kfi7: PUT: OK
00000100:00100000:7.0:1773851867.445050:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20475@kfi7, seq: 2001917
00000100:00000040:7.0:1773851867.445051:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bde4f8a : new rpc_count 0
00000400:00000200:5.0:1773851867.445051:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d794ea
00000100:00000001:7.0:1773851867.445052:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:5.0:1773851867.445052:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d794ea.
00000100:00000001:7.0:1773851867.445053:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851867.445053:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851867.445054:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851867.445055:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851867.445056:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008745c425.
00000400:00000200:5.0:1773851867.445056:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000020:00000010:7.0:1773851867.445058:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c4d9c27.
00000800:00000200:5.0:1773851867.445058:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20474@kfi7(00000000531bd503):0x0 lsk 316 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x13b Transaction freed
00000020:00000040:7.0:1773851867.445060:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000005bde4f8a : new refcount 5
00000100:00000001:7.0:1773851867.445061:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851867.445358:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851867.445359:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851867.445361:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851867.445365:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851867.445368:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.445371:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20474@kfi7 : PUT - for me
00000400:00000200:5.0:1773851867.445372:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.445374:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 1
00000400:00000200:5.0:1773851867.445375:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:5.0:1773851867.445376:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000400:00000200:5.0:1773851867.445377:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 3
00000400:00000200:5.0:1773851867.445379:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20475@kfi7 to cpt 4
00000400:00000200:5.0:1773851867.445380:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20475@kfi7 of length 224 into portal 12 MB=0x699de8bc15600
00000400:00000200:5.0:1773851867.445382:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20475@kfi7 of length 224/224 into md 0x793926dc5 [64] + 135672
00000800:00000200:5.0:1773851867.445384:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851867.445386:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851867.445387:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20474@kfi7: PUT: OK
00000100:00000001:5.0:1773851867.445388:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851867.445389:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851867.445389:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008dfd5237.
00000100:00000040:5.0:1773851867.445390:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008dfd5237 x1858030966756864 msgsize 224
00000100:00100000:5.0:1773851867.445391:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20475@kfi7 (source: 12345-20474@kfi7)
00000100:00000001:5.0:1773851867.445393:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851867.445394:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000100:00000001:7.0:1773851867.445395:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851867.445395:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851867.445396:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851867.445396:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851867.445396:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851867.445397:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851867.445397:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966756864
00000020:00000001:7.0:1773851867.445398:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851867.445398:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91372
00000020:00000001:7.0:1773851867.445399:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851867.445401:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c194a921 refcount=6
00000020:00000001:7.0:1773851867.445402:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169299968 : -107127540251648 : ffff9e916d048400)
00000020:00000001:7.0:1773851867.445402:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169299968 : -107127540251648 : ffff9e916d048400)
00000100:00000001:7.0:1773851867.445403:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.445404:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851867.445404:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b984b53b.
00000020:00000010:7.0:1773851867.445405:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851867.445406:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008745c425.
00000100:00000001:7.0:1773851867.445407:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851867.445407:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851867.445408:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.445409:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851867.445409:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851867.445409:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.445410:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.445411:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851867.445412:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851867.445412:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851867.445412:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851867.445413:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20475@kfi7, seq: 2001918
00000100:00000040:7.0:1773851867.445413:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c194a921 : new rpc_count 1
00000100:00000001:7.0:1773851867.445414:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886764672 : -106955822786944 : ffff9eb9682d1680)
00000100:00000001:5.0:1773851867.445414:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851867.445414:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.445415:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008dfd5237 x1858030966756864/t0(0) o400->bad7b485-9cf8-4c37-ad66-00b7d762a41d@20475@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne248-0'
00000100:00000001:7.0:1773851867.445428:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.445428:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851867.445429:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008dfd5237 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bad7b485-9cf8-4c37-ad66-00b7d762a41d+6:47982:x1858030966756864:12345-20475@kfi7:400:default-tuolumne248-0
00000100:00000200:7.0:1773851867.445430:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966756864
00000020:00000001:7.0:1773851867.445431:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851867.445432:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851867.445432:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.445433:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851867.445433:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851867.445434:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851867.445434:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966756864, found 0 last_xid 1858030966756863
00000020:00000001:7.0:1773851867.445435:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851867.445435:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851867.445436:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851867.445436:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.445436:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851867.445437:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851867.445437:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851867.445438:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000054ac81e8.
02000000:00000001:7.0:1773851867.445438:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.445439:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.445439:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851867.445440:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767791, transno 0, xid 1858030966756864
00010000:00000001:7.0:1773851867.445440:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851867.445441:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008dfd5237 x1858030966756864/t0(0) o400->bad7b485-9cf8-4c37-ad66-00b7d762a41d@20475@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne248-0'
00010000:00000001:7.0:1773851867.445443:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851867.445443:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851867.445444:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=99 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851867.445445:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851867.445446:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8824ea3 refcount 5 to 20475@kfi7
00000100:00000001:7.0:1773851867.445446:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519584 : -107156126032032 : ffff9e8ac52c1f60)
02000000:00000001:7.0:1773851867.445447:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851867.445447:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.445448:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851867.445449:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20474@kfi7
00000400:00000010:7.0:1773851867.445449:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000100:00000200:7.0:1773851867.445450:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966756864, offset 224
00000400:00000200:7.0:1773851867.445451:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20474@kfi7
00000400:00000200:7.0:1773851867.445452:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.445452:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 1
00000400:00000200:7.0:1773851867.445453:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000400:00000200:7.0:1773851867.445454:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 3
00000400:00000200:7.0:1773851867.445455:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20474@kfi7 local destination
00000400:00000200:7.0:1773851867.445456:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769215:8769215:1024:4294967295] 20474@kfi7 LPNI seq info [24414:24414:16:4294967295]
00000400:00000200:7.0:1773851867.445458:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000400:00000200:7.0:1773851867.445459:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20474@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.445461:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20474@kfi7(20474@kfi7:20474@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851867.445461:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 3
00000800:00000200:7.0:1773851867.445463:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851867.445464:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851867.445465:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851867.445467:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000013f Using peer 20474@kfi7(0x10000000000013f)
00000800:00000200:7.0:1773851867.445470:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x10000000000013f: rc=0
00000800:00000200:7.0:1773851867.445471:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000013f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851867.445473:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.445474:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8824ea3 refcount 4 to 20475@kfi7
00010000:00000001:7.0:1773851867.445474:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851867.445475:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.445475:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851867.445476:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008dfd5237 x1858030966756864/t0(0) o400->bad7b485-9cf8-4c37-ad66-00b7d762a41d@20475@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne248-0'
00000100:00100000:7.0:1773851867.445479:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008dfd5237 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bad7b485-9cf8-4c37-ad66-00b7d762a41d+6:47982:x1858030966756864:12345-20475@kfi7:400:default-tuolumne248-0 Request processed in 50us (88us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851867.445480:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20475@kfi7, seq: 2001918
00000100:00000040:7.0:1773851867.445481:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c194a921 : new rpc_count 0
00000100:00000001:7.0:1773851867.445481:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851867.445482:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851867.445482:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851867.445483:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008745c425.
00000020:00000010:7.0:1773851867.445484:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b984b53b.
00000020:00000040:7.0:1773851867.445484:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000c194a921 : new refcount 5
00000800:00000200:5.0:1773851867.445484:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000013f TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851867.445485:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851867.445485:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851867.445486:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20474@kfi7: PUT: OK
00000400:00000200:5.0:1773851867.445487:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:5.0:1773851867.445487:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:5.0:1773851867.445488:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851867.445488:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851867.445489:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000583ca356 nid 20474@kfi7 refs 2
00000800:00000200:5.0:1773851867.445490:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 20474@kfi7(0000000041c8c1fb):0x0 lsk 320 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000013f Transaction freed
00000004:00000001:11.0:1773851867.465733:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851867.465734:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:10.0:1773851867.465734:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:11.0:1773851867.465735:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000158ac04d.
00000004:00000020:10.0:1773851867.465735:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851867.465736:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eba50e83.
00000020:00000040:11.0:1773851867.465737:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000100:00000001:11.0:1773851867.465738:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:10.0:1773851867.465738:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
02000000:00000001:11.0:1773851867.465739:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851867.465740:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.465740:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851867.465741:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:11.0:1773851867.465742:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d7506b21.
02000000:00000001:10.0:1773851867.465742:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.465743:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851867.465743:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000da635257.
00000100:00000001:11.0:1773851867.465744:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851867.465746:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.465746:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851867.465747:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000158ac04d] to pc [ptlrpcd_02_00+0]  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851867.465747:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851867.465748:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851867.465751:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000eba50e83] to pc [ptlrpcd_02_01+1]  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:11.0:1773851867.465754:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465755:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:10.0:1773851867.465757:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465757:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851867.465757:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851867.465758:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851867.465758:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851867.465758:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:9.0:1773851867.465759:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851867.465760:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851867.465764:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851867.465765:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.465765:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851867.465765:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851867.465766:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851867.465766:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851867.465767:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851867.465767:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851867.465768:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051928192:42@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851867.465769:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051928256:12@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851867.465770:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851867.465771:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:8.0:1773851867.465771:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851867.465772:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851867.465772:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851867.465772:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:9.0:1773851867.465773:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bcc4b05c.
02000000:00000001:8.0:1773851867.465773:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851867.465773:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:9.0:1773851867.465775:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851867.465775:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000fe2482c5.
00000400:00000200:9.0:1773851867.465776:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
02000000:00000001:8.0:1773851867.465776:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851867.465777:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000015dd959a.
00000400:00000200:8.0:1773851867.465778:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:9.0:1773851867.465779:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e30a1d2d.
00000400:00000010:8.0:1773851867.465779:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf22ec86.
00000400:00000010:8.0:1773851867.465780:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000100:00000200:9.0:1773851867.465781:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928192, portal 4
00000100:00000001:9.0:1773851867.465781:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851867.465782:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889197696 : -106993820353920 : ffff9eb08f583a80)
00000100:00000200:8.0:1773851867.465782:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928256, portal 4
00000100:00000001:8.0:1773851867.465783:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:9.0:1773851867.465784:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.465784:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637043610181248 : -107030099370368 : ffff9ea81cf25e80)
00000100:00000040:8.0:1773851867.465786:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851867.465788:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851867.465789:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:9.0:1773851867.465790:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e7ade224.
00000100:00000200:9.0:1773851867.465791:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928192, offset 0
00000400:00000200:9.0:1773851867.465793:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000100:00000001:8.0:1773851867.465794:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851867.465795:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851867.465796:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000100:00000040:8.0:1773851867.465796:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:8.0:1773851867.465797:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bae78c35.
00000400:00000200:9.0:1773851867.465798:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000200:8.0:1773851867.465798:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928256, offset 0
00000400:00000200:9.0:1773851867.465800:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:8.0:1773851867.465800:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:9.0:1773851867.465802:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:9.0:1773851867.465804:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769214, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769215, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851867.465808:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851867.465809:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851867.465811:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:9.0:1773851867.465812:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769216:8769216:1024:4294967295] 42@kfi7 LPNI seq info [5404897:5404897:16:4294967295]
00000400:00000200:9.0:1773851867.465814:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851867.465816:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851867.465817:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851867.465818:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851867.465819:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851867.465820:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851867.465821:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:8.0:1773851867.465822:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:9.0:1773851867.465823:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:8.0:1773851867.465823:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000800:00000200:9.0:1773851867.465825:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:8.0:1773851867.465826:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769216, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769215, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851867.465829:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:8.0:1773851867.465829:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851867.465830:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851867.465831:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000800:00000200:9.0:1773851867.465833:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000400:00000200:8.0:1773851867.465833:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769217:8769217:1024:4294967295] 12@kfi7 LPNI seq info [5403456:5403456:16:4294967295]
00000400:00000200:8.0:1773851867.465835:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851867.465836:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:9.0:1773851867.465837:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x17b: rc=0
00000800:00000200:9.0:1773851867.465840:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:8.0:1773851867.465840:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851867.465842:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000100:00000001:9.0:1773851867.465843:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465843:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:8.0:1773851867.465844:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:9.0:1773851867.465845:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465846:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465846:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:8.0:1773851867.465847:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851867.465848:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851867.465849:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851867.465850:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851867.465850:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851867.465851:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465852:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851867.465857:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851867.465859:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000800:00000200:8.0:1773851867.465861:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Using peer 12@kfi7(0x200000000000473)
00000400:00000200:10.0:1773851867.465862:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851867.465864:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:10.0:1773851867.465865:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e7ade224
00000400:00000010:10.0:1773851867.465866:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e7ade224.
00000800:00000200:8.0:1773851867.465867:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x200000000000473: rc=0
00000100:00000001:10.0:1773851867.465868:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851867.465869:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851867.465869:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851867.465874:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851867.465875:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.465875:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.465878:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851867.465879:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.465879:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.465880:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:8.0:1773851867.465880:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.465881:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851867.465882:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:8.0:1773851867.465883:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851867.465884:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:10.0:1773851867.465885:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000100:00000001:8.0:1773851867.465885:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.465886:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851867.465891:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851867.465892:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851867.465892:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851867.465895:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851867.465898:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000400:00000200:9.0:1773851867.465900:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bae78c35
00000400:00000010:9.0:1773851867.465901:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bae78c35.
00000100:00000001:9.0:1773851867.465902:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851867.465903:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851867.465908:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:9.0:1773851867.465908:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851867.465909:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851867.465910:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851867.465912:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851867.465914:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465915:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:25.0:1773851867.465916:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851867.465916:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:9.0:1773851867.465919:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Transaction freed
00000400:00000200:25.0:1773851867.465920:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.465922:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851867.465924:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.465925:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851867.465927:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.465928:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:25.0:1773851867.465930:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851867.465932:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.465933:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3680
00000400:00000200:25.0:1773851867.465935:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.465937:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b82259 [1] + 224
00000800:00000200:25.0:1773851867.465940:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851867.465940:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851867.465941:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851867.465943:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851867.465944:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851867.465945:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851867.465947:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:9.0:1773851867.465948:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:25.0:1773851867.465949:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851867.465952:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.465954:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12@kfi7 : PUT - for me
00000100:00000040:25.0:1773851867.465955:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851867.465956:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.465958:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851867.465959:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.465960:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:25.0:1773851867.465962:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851867.465962:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:25.0:1773851867.465964:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851867.465964:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.465966:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b36c0
00000100:00000001:8.0:1773851867.465966:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:25.0:1773851867.465967:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851867.465967:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851867.465968:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000001:8.0:1773851867.465969:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:9.0:1773851867.465970:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x7816978a9 [1] + 224
00000400:00000001:8.0:1773851867.465970:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851867.465971:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000015dd959a.
00000400:00000200:8.0:1773851867.465972:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e30a1d2d
00000400:00000010:8.0:1773851867.465973:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e30a1d2d.
00000800:00000200:9.0:1773851867.465974:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851867.465975:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851867.465977:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851867.465979:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851867.465981:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851867.465983:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851867.465983:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851867.465984:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.465988:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851867.465989:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:9.0:1773851867.465990:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.465990:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851867.465991:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851867.465992:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851867.465993:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851867.465995:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.465997:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:8.0:1773851867.465997:0:41068:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=100 v=66 (66 66 66 66)
00000400:00000200:9.0:1773851867.465999:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00001000:8.0:1773851867.465999:0:41068:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=100 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851867.466000:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851867.466001:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851867.466001:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000001:10.0:1773851867.466002:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:9.0:1773851867.466002:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851867.466002:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:10.0:1773851867.466003:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:8.0:1773851867.466003:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:10.0:1773851867.466004:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf22ec86.
00010000:00000001:8.0:1773851867.466004:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851867.466005:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000010:10.0:1773851867.466006:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000100:00000001:8.0:1773851867.466006:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:10.0:1773851867.466007:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:8.0:1773851867.466007:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000200:10.0:1773851867.466009:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.466009:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851867.466009:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851867.466011:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:10.0:1773851867.466014:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.466016:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851867.466017:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851867.466018:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851867.466020:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851867.466020:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851867.466020:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:10.0:1773851867.466021:0:41069:0:(client.c:1428:after_reply()) Process entered
00000004:00000040:8.0:1773851867.466021:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
02000000:00000001:10.0:1773851867.466022:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000040:8.0:1773851867.466022:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351378938880 avail=351375971328 avail_mb=1372562388 hwm_mb=3131103 files=372019024 ffree=343143495 state=0: rc = 0
00000100:00000001:10.0:1773851867.466023:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851867.466024:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851867.466025:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:8.0:1773851867.466026:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351378938880 free, 351375971328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019024 files, 343143495 free files
00000100:00001000:10.0:1773851867.466027:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=100 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851867.466029:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=100 v=66 (1 1 1 1)
00000004:00000001:8.0:1773851867.466029:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.466031:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:8.0:1773851867.466031:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851867.466032:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851867.466033:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851867.466034:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.466035:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851867.466036:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00100000:8.0:1773851867.466036:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051928192:42@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851867.466037:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851867.466038:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.466038:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:10.0:1773851867.466039:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.466039:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851867.466040:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000158ac04d x1859433051928192/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851867.466044:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851867.466044:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:10.0:1773851867.466045:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851867.466045:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851867.466045:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851867.466045:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bcc4b05c.
00000004:00000001:10.0:1773851867.466046:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851867.466047:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851867.466047:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541584896 avail=351539512320 avail_mb=1373201220 hwm_mb=3131101 files=372136717 ffree=343302329 state=0: rc = 0
02000000:00000001:8.0:1773851867.466047:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851867.466047:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851867.466048:0:41068:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:8.0:1773851867.466049:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851867.466049:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d7506b21.
00000004:00000020:10.0:1773851867.466050:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541584896 free, 351539512320 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136717 files, 343302329 free files
02000000:00000001:8.0:1773851867.466050:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851867.466051:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000004:00000001:10.0:1773851867.466052:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:8.0:1773851867.466052:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000158ac04d.
00000100:00000001:8.0:1773851867.466052:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:10.0:1773851867.466053:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.466053:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851867.466053:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851867.466054:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851867.466055:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.466055:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:10.0:1773851867.466056:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051928256:12@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851867.466056:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.466062:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851867.466063:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851867.466064:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000eba50e83 x1859433051928256/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851867.466066:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851867.466067:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851867.466068:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000fe2482c5.
02000000:00000001:10.0:1773851867.466069:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851867.466069:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851867.466069:0:41069:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:10.0:1773851867.466070:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851867.466071:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000da635257.
02000000:00000001:10.0:1773851867.466071:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851867.466072:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851867.466072:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eba50e83.
00000100:00000001:10.0:1773851867.466073:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851867.466074:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851867.466074:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851867.466076:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851867.466076:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.466077:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851867.466077:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851867.475244:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851867.475245:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851867.475246:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851867.475248:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851867.475249:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19921@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.475250:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19921@kfi7 : PUT - for me
00000400:00000200:29.0:1773851867.475251:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19921@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.475252:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4d1d972 nid 19921@kfi7 refs 1
00000400:00000200:29.0:1773851867.475253:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19921@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.475253:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4d1d972 nid 19921@kfi7 refs 2
00000400:00000200:29.0:1773851867.475254:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f4d1d972 nid 19921@kfi7 refs 3
00000400:00000200:29.0:1773851867.475255:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19729@kfi7 to cpt 4
00000400:00000200:29.0:1773851867.475256:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19729@kfi7 of length 224 into portal 12 MB=0x69b0a4ae37dc0
00000400:00000200:29.0:1773851867.475257:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19729@kfi7 of length 224/224 into md 0x77fe139dd [64] + 175528
00000800:00000200:29.0:1773851867.475259:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851867.475260:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.475261:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19921@kfi7: PUT: OK
00000100:00000001:29.0:1773851867.475262:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851867.475262:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851867.475263:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007813b1d8.
00000100:00000040:29.0:1773851867.475264:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000007813b1d8 x1859318368665024 msgsize 224
00000100:00100000:29.0:1773851867.475265:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19729@kfi7 (source: 12345-19921@kfi7)
00000100:00000001:29.0:1773851867.475266:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851867.475267:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f4d1d972 nid 19921@kfi7 refs 2
00000100:00000001:28.0:1773851867.475267:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851867.475268:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851867.475268:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851867.475269:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851867.475269:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851867.475270:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851867.475271:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318368665024
00000020:00000001:28.0:1773851867.475271:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851867.475272:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925b6
00000020:00000001:28.0:1773851867.475272:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851867.475276:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000057f9a757 refcount=9
00000020:00000001:28.0:1773851867.475277:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630992896 : -107123078558720 : ffff9e9276f48c00)
00000020:00000001:28.0:1773851867.475278:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630992896 : -107123078558720 : ffff9e9276f48c00)
00000100:00000001:28.0:1773851867.475279:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.475280:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851867.475281:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000adb0a5b7.
00000020:00000010:28.0:1773851867.475282:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.475283:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851867.475284:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851867.475284:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851867.475284:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851867.475286:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851867.475286:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851867.475286:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.475287:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851867.475288:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851867.475289:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851867.475289:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851867.475289:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851867.475290:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851867.475290:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19729@kfi7, seq: 2055520
00000100:00000040:28.0:1773851867.475290:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000057f9a757 : new rpc_count 1
00000100:00000001:31.0:1773851867.475291:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.475291:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309690624 : -106988399860992 : ffff9eb1d26e6300)
00000100:00000040:28.0:1773851867.475292:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007813b1d8 x1859318368665024/t0(0) o400->abaa31e7-25be-4c2a-8df3-602157271517@19729@kfi7:655/0 lens 224/0 e 0 to 0 dl 1773852015 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1729-0'
00000100:00000001:28.0:1773851867.475295:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.475295:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851867.475296:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007813b1d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:abaa31e7-25be-4c2a-8df3-602157271517+9:39618:x1859318368665024:12345-19729@kfi7:400:default-tuolumne1729-0
00000100:00000200:28.0:1773851867.475298:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318368665024
00000020:00000001:28.0:1773851867.475298:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851867.475299:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851867.475299:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.475300:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851867.475301:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851867.475301:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851867.475302:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318368665024, found 0 last_xid 1859318368665023
00000020:00000001:28.0:1773851867.475304:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851867.475305:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851867.475305:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851867.475306:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.475306:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851867.475307:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851867.475307:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851867.475308:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000590ddc6f.
02000000:00000001:28.0:1773851867.475309:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.475309:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.475310:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851867.475310:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182850702988, transno 0, xid 1859318368665024
00010000:00000001:28.0:1773851867.475311:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851867.475312:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007813b1d8 x1859318368665024/t0(0) o400->abaa31e7-25be-4c2a-8df3-602157271517@19729@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1729-0'
00010000:00000001:28.0:1773851867.475314:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851867.475315:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851867.475315:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=100 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851867.475317:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851867.475317:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce5d466c refcount 3 to 19729@kfi7
00000100:00000001:28.0:1773851867.475318:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583546624 : -107156126004992 : ffff9e8ac52c8900)
02000000:00000001:28.0:1773851867.475319:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851867.475319:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.475320:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851867.475320:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19921@kfi7
00000400:00000010:28.0:1773851867.475321:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d36e974.
00000100:00000200:28.0:1773851867.475322:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318368665024, offset 224
00000400:00000200:28.0:1773851867.475323:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19921@kfi7
00000400:00000200:28.0:1773851867.475324:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19921@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.475324:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4d1d972 nid 19921@kfi7 refs 1
00000400:00000200:28.0:1773851867.475325:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f4d1d972 nid 19921@kfi7 refs 2
00000400:00000200:28.0:1773851867.475326:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f4d1d972 nid 19921@kfi7 refs 3
00000400:00000200:28.0:1773851867.475327:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19921@kfi7 local destination
00000400:00000200:28.0:1773851867.475329:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769218:8769218:1024:4294967295] 19921@kfi7 LPNI seq info [3468700:3468700:16:4294967295]
00000400:00000200:28.0:1773851867.475331:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f4d1d972 nid 19921@kfi7 refs 2
00000400:00000200:28.0:1773851867.475332:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19921@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.475334:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19921@kfi7(19921@kfi7:19921@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851867.475335:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f4d1d972 nid 19921@kfi7 refs 3
00000800:00000200:28.0:1773851867.475336:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851867.475337:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851867.475339:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851867.475341:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c14 Using peer 19921@kfi7(0x100000000000c14)
00000800:00000200:28.0:1773851867.475344:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x100000000000c14: rc=0
00000800:00000200:28.0:1773851867.475345:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c14 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851867.475347:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.475348:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce5d466c refcount 2 to 19729@kfi7
00010000:00000001:28.0:1773851867.475349:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851867.475349:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.475350:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851867.475351:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007813b1d8 x1859318368665024/t0(0) o400->abaa31e7-25be-4c2a-8df3-602157271517@19729@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1729-0'
00000100:00100000:28.0:1773851867.475355:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007813b1d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:abaa31e7-25be-4c2a-8df3-602157271517+9:39618:x1859318368665024:12345-19729@kfi7:400:default-tuolumne1729-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851867.475357:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19729@kfi7, seq: 2055520
00000100:00000040:28.0:1773851867.475358:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000057f9a757 : new rpc_count 0
00000100:00000001:28.0:1773851867.475359:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851867.475359:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851867.475360:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.475361:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851867.475361:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000adb0a5b7.
00000020:00000040:28.0:1773851867.475365:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000057f9a757 : new refcount 8
00000100:00000001:28.0:1773851867.475365:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851867.475370:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c14 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851867.475371:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.475372:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19921@kfi7: PUT: OK
00000400:00000200:29.0:1773851867.475373:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d36e974
00000400:00000010:29.0:1773851867.475374:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d36e974.
00000100:00000001:29.0:1773851867.475374:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851867.475375:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851867.475375:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f4d1d972 nid 19921@kfi7 refs 2
00000800:00000200:29.0:1773851867.475377:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 19921@kfi7(00000000a6fdc939):0x0 lsk 3093 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c14 Transaction freed
00000800:00000200:1.0:1773851867.572661:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.572662:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851867.572663:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851867.572665:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851867.572667:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8499@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.572668:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8499@kfi7 : PUT - for me
00000400:00000200:1.0:1773851867.572669:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8499@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.572670:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3906dbc nid 8499@kfi7 refs 1
00000400:00000200:1.0:1773851867.572671:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8499@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.572672:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3906dbc nid 8499@kfi7 refs 2
00000400:00000200:1.0:1773851867.572673:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b3906dbc nid 8499@kfi7 refs 3
00000400:00000200:1.0:1773851867.572673:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:1.0:1773851867.572674:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 224 into portal 12 MB=0x69b3003488900
00000400:00000200:1.0:1773851867.572676:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8691@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 28952
00000800:00000200:1.0:1773851867.572677:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851867.572679:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851867.572680:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8499@kfi7: PUT: OK
00000100:00000001:1.0:1773851867.572681:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851867.572682:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851867.572683:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000043f34f37.
00000100:00000040:1.0:1773851867.572684:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000043f34f37 x1859480376084736 msgsize 224
00000100:00100000:1.0:1773851867.572686:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8499@kfi7)
00000100:00000001:1.0:1773851867.572687:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851867.572688:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b3906dbc nid 8499@kfi7 refs 2
00000800:00000200:1.0:1773851867.572689:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851867.572692:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851867.572692:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851867.572693:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851867.572693:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851867.572694:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851867.572695:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376084736
00000020:00000001:1.0:1773851867.572695:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851867.572696:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000020:00000001:1.0:1773851867.572697:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851867.572698:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=7
00000020:00000001:1.0:1773851867.572699:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000020:00000001:1.0:1773851867.572700:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000100:00000001:1.0:1773851867.572701:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.572702:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851867.572702:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5405d62.
00000020:00000010:1.0:1773851867.572704:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.572704:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee53e016.
00000100:00000001:1.0:1773851867.572706:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851867.572706:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851867.572707:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.572708:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851867.572708:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851867.572709:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.572710:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.572711:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851867.572711:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851867.572711:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:1.0:1773851867.572712:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 1997560
00000100:00000001:0.0:1773851867.572712:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:1.0:1773851867.572713:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 1
00000100:00000001:1.0:1773851867.572714:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599706496 : -107004109845120 : ffff9eae2a0b0d80)
00000100:00000001:0.0:1773851867.572714:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.572714:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.572715:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000043f34f37 x1859480376084736/t0(0) o400->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1017-0'
00000100:00000001:1.0:1773851867.572718:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.572719:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851867.572720:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043f34f37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+7:40140:x1859480376084736:12345-8691@kfi7:400:default-tuolumne1017-0
00000100:00000200:1.0:1773851867.572721:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376084736
00000020:00000001:1.0:1773851867.572721:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851867.572722:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851867.572723:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.572724:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851867.572724:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851867.572727:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851867.572728:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859480376084736, found 0 last_xid 1859480376084735
00000020:00000001:1.0:1773851867.572729:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851867.572729:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851867.572730:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851867.572731:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.572731:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851867.572732:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851867.572732:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851867.572734:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005776c119.
02000000:00000001:1.0:1773851867.572735:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.572735:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.572736:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851867.572737:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252788990, transno 0, xid 1859480376084736
00010000:00000001:1.0:1773851867.572738:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851867.572739:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000043f34f37 x1859480376084736/t0(0) o400->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1017-0'
00010000:00000001:1.0:1773851867.572741:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851867.572741:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851867.572742:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851867.572743:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851867.572744:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:1.0:1773851867.572745:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
02000000:00000001:1.0:1773851867.572746:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851867.572746:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.572747:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851867.572748:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8499@kfi7
00000400:00000010:1.0:1773851867.572748:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f34118dd.
00000100:00000200:1.0:1773851867.572749:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859480376084736, offset 224
00000400:00000200:1.0:1773851867.572750:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8499@kfi7
00000400:00000200:1.0:1773851867.572751:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8499@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.572751:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3906dbc nid 8499@kfi7 refs 1
00000400:00000200:1.0:1773851867.572752:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b3906dbc nid 8499@kfi7 refs 2
00000400:00000200:1.0:1773851867.572753:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b3906dbc nid 8499@kfi7 refs 3
00000400:00000200:1.0:1773851867.572754:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8499@kfi7 local destination
00000400:00000200:1.0:1773851867.572756:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769219:8769219:1024:4294967295] 8499@kfi7 LPNI seq info [2577511:2577511:16:4294967295]
00000400:00000200:1.0:1773851867.572757:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b3906dbc nid 8499@kfi7 refs 2
00000400:00000200:1.0:1773851867.572758:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8499@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.572760:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8499@kfi7(8499@kfi7:8499@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851867.572761:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b3906dbc nid 8499@kfi7 refs 3
00000800:00000200:1.0:1773851867.572762:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.572763:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851867.572765:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851867.572767:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x127b Using peer 8499@kfi7(0x127b)
00000800:00000200:1.0:1773851867.572770:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0x127b: rc=0
00000800:00000200:1.0:1773851867.572771:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x127b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851867.572773:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.572774:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00010000:00000001:1.0:1773851867.572775:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851867.572775:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.572779:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851867.572779:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000043f34f37 x1859480376084736/t0(0) o400->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1017-0'
00000100:00100000:1.0:1773851867.572782:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043f34f37 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+7:40140:x1859480376084736:12345-8691@kfi7:400:default-tuolumne1017-0 Request processed in 63us (98us total) trans 0 rc 0/0
00000800:00000200:3.0:1773851867.572784:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x127b TN_EVENT_TX_OK event status 0
00000400:00000200:3.0:1773851867.572785:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851867.572785:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 1997560
00000400:00000200:3.0:1773851867.572786:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8499@kfi7: PUT: OK
00000100:00000040:1.0:1773851867.572786:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 0
00000400:00000200:3.0:1773851867.572787:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f34118dd
00000400:00000010:3.0:1773851867.572787:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f34118dd.
00000100:00000001:1.0:1773851867.572787:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851867.572787:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:3.0:1773851867.572788:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851867.572788:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851867.572788:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.572788:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee53e016.
00000400:00000200:3.0:1773851867.572789:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b3906dbc nid 8499@kfi7 refs 2
00000020:00000010:1.0:1773851867.572789:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5405d62.
00000800:00000200:3.0:1773851867.572790:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 8499@kfi7(00000000622dfbb4):0x0 lsk 4732 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x127b Transaction freed
00000020:00000040:1.0:1773851867.572790:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 6
00000100:00000001:1.0:1773851867.572791:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851867.581953:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851867.581954:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851867.581957:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851867.581960:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851867.581963:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21243@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.581965:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21243@kfi7 : PUT - for me
00000400:00000200:25.0:1773851867.581966:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21243@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.581968:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4f3521b nid 21243@kfi7 refs 1
00000400:00000200:25.0:1773851867.581969:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21243@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.581970:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4f3521b nid 21243@kfi7 refs 2
00000400:00000200:25.0:1773851867.581972:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a4f3521b nid 21243@kfi7 refs 3
00000400:00000200:25.0:1773851867.581973:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21242@kfi7 to cpt 3
00000400:00000200:25.0:1773851867.581975:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21242@kfi7 of length 224 into portal 12 MB=0x699de8bbbd1c0
00000400:00000200:25.0:1773851867.581977:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21242@kfi7 of length 224/224 into md 0x16159c9699 [64] + 8712
00000800:00000200:25.0:1773851867.581980:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851867.581983:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851867.581984:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21243@kfi7: PUT: OK
00000100:00000001:25.0:1773851867.581986:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851867.581987:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851867.581988:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000584cc322.
00000100:00000040:25.0:1773851867.581989:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000584cc322 x1858030966395328 msgsize 224
00000100:00100000:25.0:1773851867.581991:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-21242@kfi7 (source: 12345-21243@kfi7)
00000100:00000001:25.0:1773851867.581993:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851867.581994:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4f3521b nid 21243@kfi7 refs 2
00000100:00000001:24.0:1773851867.581995:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851867.581996:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851867.581997:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851867.581997:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851867.581998:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851867.581999:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851867.582000:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966395328
00000020:00000001:24.0:1773851867.582002:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851867.582002:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f2e
00000020:00000001:24.0:1773851867.582003:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851867.582006:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000854d6802 refcount=6
00000020:00000001:24.0:1773851867.582007:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239864320 : -107152469687296 : ffff9e8b9f1b8400)
00000020:00000001:24.0:1773851867.582008:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239864320 : -107152469687296 : ffff9e8b9f1b8400)
00000100:00000001:24.0:1773851867.582010:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851867.582011:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851867.582012:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049dcf77c.
00000020:00000010:24.0:1773851867.582013:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851867.582015:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000100:00000001:24.0:1773851867.582016:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851867.582017:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851867.582018:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851867.582019:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851867.582020:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851867.582021:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.582022:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851867.582024:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851867.582025:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851867.582025:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851867.582025:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851867.582027:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21242@kfi7, seq: 2025096
00000100:00000001:25.0:1773851867.582028:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851867.582028:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000854d6802 : new rpc_count 1
00000100:00000001:25.0:1773851867.582029:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.582029:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478777728 : -106938230773888 : ffff9ebd80bde780)
00000100:00000040:24.0:1773851867.582031:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000584cc322 x1858030966395328/t0(0) o400->83cbaaad-41ec-4411-88cd-6ef3c0e7a154@21242@kfi7:84/0 lens 224/0 e 0 to 0 dl 1773852199 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne251-0'
00000100:00000001:24.0:1773851867.582036:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851867.582036:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851867.582038:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000584cc322 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:83cbaaad-41ec-4411-88cd-6ef3c0e7a154+6:47953:x1858030966395328:12345-21242@kfi7:400:default-tuolumne251-0
00000100:00000200:24.0:1773851867.582040:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966395328
00000020:00000001:24.0:1773851867.582041:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851867.582042:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851867.582043:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.582044:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851867.582044:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851867.582046:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851867.582047:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966395328, found 0 last_xid 1858030966395327
00000020:00000001:24.0:1773851867.582048:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851867.582049:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851867.582050:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851867.582051:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.582052:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851867.582053:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851867.582054:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851867.582055:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000089b8a910.
02000000:00000001:24.0:1773851867.582056:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.582057:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.582059:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851867.582060:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030966395328
00010000:00000001:24.0:1773851867.582061:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851867.582062:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000584cc322 x1858030966395328/t0(0) o400->83cbaaad-41ec-4411-88cd-6ef3c0e7a154@21242@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne251-0'
00010000:00000001:24.0:1773851867.582066:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851867.582067:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851867.582068:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=100 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851867.582070:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851867.582071:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000095606ea0 refcount 5 to 21242@kfi7
00000100:00000001:24.0:1773851867.582072:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521907392 : -107145187644224 : ffff9e8d5126acc0)
02000000:00000001:24.0:1773851867.582074:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851867.582075:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.582076:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851867.582077:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21243@kfi7
00000400:00000010:24.0:1773851867.582078:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009af8923e.
00000100:00000200:24.0:1773851867.582080:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966395328, offset 224
00000400:00000200:24.0:1773851867.582082:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21243@kfi7
00000400:00000200:24.0:1773851867.582083:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21243@kfi7 to cpt 6
00000400:00000200:24.0:1773851867.582084:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4f3521b nid 21243@kfi7 refs 1
00000400:00000200:24.0:1773851867.582086:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a4f3521b nid 21243@kfi7 refs 2
00000400:00000200:24.0:1773851867.582088:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a4f3521b nid 21243@kfi7 refs 3
00000400:00000200:24.0:1773851867.582090:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21243@kfi7 local destination
00000400:00000200:24.0:1773851867.582092:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769220:8769220:1024:4294967295] 21243@kfi7 LPNI seq info [24567:24567:16:4294967295]
00000400:00000200:24.0:1773851867.582094:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a4f3521b nid 21243@kfi7 refs 2
00000400:00000200:24.0:1773851867.582095:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21243@kfi7 to cpt 6
00000400:00000200:24.0:1773851867.582099:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21243@kfi7(21243@kfi7:21243@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851867.582101:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a4f3521b nid 21243@kfi7 refs 3
00000800:00000200:24.0:1773851867.582103:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851867.582105:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851867.582109:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851867.582113:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c4 Using peer 21243@kfi7(0x1000000000009c4)
00000800:00000200:24.0:1773851867.582117:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000358ab717: Posted send of 324 bytes to peer 0x1000000000009c4: rc=0
00000800:00000200:24.0:1773851867.582120:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851867.582123:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851867.582125:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000095606ea0 refcount 4 to 21242@kfi7
00010000:00000001:24.0:1773851867.582126:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851867.582129:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.582130:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851867.582131:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000584cc322 x1858030966395328/t0(0) o400->83cbaaad-41ec-4411-88cd-6ef3c0e7a154@21242@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne251-0'
00000100:00100000:24.0:1773851867.582137:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000584cc322 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:83cbaaad-41ec-4411-88cd-6ef3c0e7a154+6:47953:x1858030966395328:12345-21242@kfi7:400:default-tuolumne251-0 Request processed in 100us (147us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851867.582141:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21242@kfi7, seq: 2025096
00000100:00000040:24.0:1773851867.582143:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000854d6802 : new rpc_count 0
00000100:00000001:24.0:1773851867.582144:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851867.582145:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851867.582146:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851867.582147:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000020:00000010:24.0:1773851867.582149:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049dcf77c.
00000020:00000040:24.0:1773851867.582150:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000854d6802 : new refcount 5
00000100:00000001:24.0:1773851867.582151:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:27.0:1773851867.582159:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c4 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851867.582161:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851867.582162:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21243@kfi7: PUT: OK
00000400:00000200:27.0:1773851867.582163:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009af8923e
00000400:00000010:27.0:1773851867.582164:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009af8923e.
00000100:00000001:27.0:1773851867.582165:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851867.582165:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851867.582166:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4f3521b nid 21243@kfi7 refs 2
00000800:00000200:27.0:1773851867.582168:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 21243@kfi7(000000008660ff0a):0x0 lsk 2501 rsk 87 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009c4 Transaction freed
00000800:00000200:13.0:1773851867.582561:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.582562:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851867.582563:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851867.582566:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851867.582568:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21242@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.582569:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21242@kfi7 : PUT - for me
00000400:00000200:13.0:1773851867.582570:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21242@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.582571:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020f359c8 nid 21242@kfi7 refs 1
00000400:00000200:13.0:1773851867.582572:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21242@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.582573:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020f359c8 nid 21242@kfi7 refs 2
00000400:00000200:13.0:1773851867.582574:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000020f359c8 nid 21242@kfi7 refs 3
00000400:00000200:13.0:1773851867.582575:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21242@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.582575:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21242@kfi7 of length 224 into portal 12 MB=0x699de8bbbda40
00000400:00000200:13.0:1773851867.582577:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21242@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 27784
00000800:00000200:13.0:1773851867.582579:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851867.582580:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851867.582581:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21242@kfi7: PUT: OK
00000100:00000001:13.0:1773851867.582583:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851867.582584:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851867.582585:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003be6ca9a.
00000100:00000040:13.0:1773851867.582586:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003be6ca9a x1858030966397504 msgsize 224
00000100:00100000:13.0:1773851867.582587:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21242@kfi7 (source: 12345-21242@kfi7)
00000100:00000001:13.0:1773851867.582588:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851867.582589:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000020f359c8 nid 21242@kfi7 refs 2
00000800:00000200:13.0:1773851867.582591:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b0db8066: 2069@kfi7:3 <- 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851867.582593:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851867.582594:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851867.582594:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851867.582595:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851867.582596:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851867.582596:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966397504
00000020:00000001:13.0:1773851867.582597:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851867.582597:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9125a
00000020:00000001:13.0:1773851867.582598:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851867.582600:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d1b77df refcount=6
00000020:00000001:13.0:1773851867.582601:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716209664 : -107155993341952 : ffff9e8acd14d000)
00000020:00000001:13.0:1773851867.582602:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716209664 : -107155993341952 : ffff9e8acd14d000)
00000100:00000001:13.0:1773851867.582603:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.582604:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851867.582604:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092eb84b1.
00000020:00000010:13.0:1773851867.582605:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.582606:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e27c9b87.
00000100:00000001:13.0:1773851867.582607:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851867.582608:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851867.582608:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.582609:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851867.582610:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851867.582610:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.582611:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.582612:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.582613:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.582613:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851867.582613:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851867.582614:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21242@kfi7, seq: 2289830
00000100:00000001:15.0:1773851867.582615:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.582615:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d1b77df : new rpc_count 1
00000100:00000001:15.0:1773851867.582616:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.582616:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970996224 : -107043738555392 : ffff9ea4effcec00)
00000100:00000040:13.0:1773851867.582617:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003be6ca9a x1858030966397504/t0(0) o400->c4364612-b909-4c4b-8ad7-5326c7d67056@21242@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne251-0'
00000100:00000001:13.0:1773851867.582620:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.582620:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851867.582621:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003be6ca9a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:c4364612-b909-4c4b-8ad7-5326c7d67056+6:47955:x1858030966397504:12345-21242@kfi7:400:default-tuolumne251-0
00000100:00000200:13.0:1773851867.582623:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966397504
00000020:00000001:13.0:1773851867.582623:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851867.582624:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851867.582624:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.582625:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851867.582626:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851867.582627:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851867.582627:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966397504, found 0 last_xid 1858030966397503
00000020:00000001:13.0:1773851867.582628:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851867.582629:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851867.582629:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851867.582630:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.582630:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851867.582631:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851867.582632:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851867.582632:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c7bf6dc1.
02000000:00000001:13.0:1773851867.582633:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.582633:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.582634:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851867.582635:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767953, transno 0, xid 1858030966397504
00010000:00000001:13.0:1773851867.582636:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851867.582637:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003be6ca9a x1858030966397504/t0(0) o400->c4364612-b909-4c4b-8ad7-5326c7d67056@21242@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne251-0'
00010000:00000001:13.0:1773851867.582639:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851867.582640:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851867.582641:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851867.582642:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851867.582643:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000095606ea0 refcount 5 to 21242@kfi7
00000100:00000001:13.0:1773851867.582644:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521907392 : -107145187644224 : ffff9e8d5126acc0)
02000000:00000001:13.0:1773851867.582645:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851867.582645:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.582646:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851867.582647:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21242@kfi7
00000400:00000010:13.0:1773851867.582648:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003edd11ab.
00000100:00000200:13.0:1773851867.582649:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966397504, offset 224
00000400:00000200:13.0:1773851867.582650:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21242@kfi7
00000400:00000200:13.0:1773851867.582651:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21242@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.582652:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020f359c8 nid 21242@kfi7 refs 1
00000400:00000200:13.0:1773851867.582653:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000020f359c8 nid 21242@kfi7 refs 2
00000400:00000200:13.0:1773851867.582654:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000020f359c8 nid 21242@kfi7 refs 3
00000400:00000200:13.0:1773851867.582655:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21242@kfi7 local destination
00000400:00000200:13.0:1773851867.582656:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769221:8769221:1024:4294967295] 21242@kfi7 LPNI seq info [24568:24568:16:4294967295]
00000400:00000200:13.0:1773851867.582657:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000020f359c8 nid 21242@kfi7 refs 2
00000400:00000200:13.0:1773851867.582658:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21242@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.582660:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21242@kfi7(21242@kfi7:21242@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851867.582661:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000020f359c8 nid 21242@kfi7 refs 3
00000800:00000200:13.0:1773851867.582662:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.582663:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851867.582665:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851867.582667:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x57f Using peer 21242@kfi7(0x57f)
00000800:00000200:13.0:1773851867.582670:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000b0db8066: Posted send of 324 bytes to peer 0x57f: rc=0
00000800:00000200:13.0:1773851867.582672:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x57f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851867.582676:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.582676:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000095606ea0 refcount 4 to 21242@kfi7
00010000:00000001:13.0:1773851867.582677:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851867.582678:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.582678:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851867.582679:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003be6ca9a x1858030966397504/t0(0) o400->c4364612-b909-4c4b-8ad7-5326c7d67056@21242@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne251-0'
00000100:00100000:13.0:1773851867.582682:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003be6ca9a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:c4364612-b909-4c4b-8ad7-5326c7d67056+6:47955:x1858030966397504:12345-21242@kfi7:400:default-tuolumne251-0 Request processed in 61us (96us total) trans 0 rc 0/0
00000800:00000200:14.0:1773851867.582684:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x57f TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851867.582685:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:13.0:1773851867.582685:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21242@kfi7, seq: 2289830
00000400:00000200:14.0:1773851867.582686:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21242@kfi7: PUT: OK
00000100:00000040:13.0:1773851867.582686:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d1b77df : new rpc_count 0
00000400:00000200:14.0:1773851867.582687:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003edd11ab
00000100:00000001:13.0:1773851867.582687:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851867.582687:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:14.0:1773851867.582688:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003edd11ab.
00000020:00000010:13.0:1773851867.582688:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.582688:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e27c9b87.
00000100:00000001:14.0:1773851867.582689:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851867.582689:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:13.0:1773851867.582689:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092eb84b1.
00000400:00000200:14.0:1773851867.582690:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000020f359c8 nid 21242@kfi7 refs 2
00000020:00000040:13.0:1773851867.582690:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000002d1b77df : new refcount 5
00000800:00000200:14.0:1773851867.582691:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b0db8066: 2069@kfi7:3 -> 21242@kfi7(00000000be4fd182):0x0 lsk 1408 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x57f Transaction freed
00000100:00000001:13.0:1773851867.582691:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851867.615617:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851867.615618:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851867.615620:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851867.615622:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851867.615624:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15715@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.615625:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15715@kfi7 : PUT - for me
00000400:00000200:9.0:1773851867.615626:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15715@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.615627:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f32430a4 nid 15715@kfi7 refs 1
00000400:00000200:9.0:1773851867.615628:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15715@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.615629:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f32430a4 nid 15715@kfi7 refs 2
00000400:00000200:9.0:1773851867.615629:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f32430a4 nid 15715@kfi7 refs 3
00000400:00000200:9.0:1773851867.615630:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15714@kfi7 to cpt 7
00000400:00000200:9.0:1773851867.615631:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15714@kfi7 of length 224 into portal 12 MB=0x69b4b5b4d3840
00000400:00000200:9.0:1773851867.615632:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15714@kfi7 of length 224/224 into md 0x78146ce49 [64] + 136720
00000800:00000200:9.0:1773851867.615634:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851867.615635:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851867.615636:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15715@kfi7: PUT: OK
00000100:00000001:9.0:1773851867.615637:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851867.615638:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851867.615639:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000098bd43d4.
00000100:00000040:9.0:1773851867.615640:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000098bd43d4 x1859597816903744 msgsize 224
00000100:00100000:9.0:1773851867.615641:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-15714@kfi7 (source: 12345-15715@kfi7)
00000100:00000001:9.0:1773851867.615642:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851867.615643:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f32430a4 nid 15715@kfi7 refs 2
00000100:00000001:11.0:1773851867.615644:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851867.615644:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851867.615644:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851867.615645:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851867.615645:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851867.615646:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851867.615647:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597816903744
00000020:00000001:11.0:1773851867.615647:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851867.615648:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f79d
00000020:00000001:11.0:1773851867.615649:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851867.615652:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c5887161 refcount=5
00000020:00000001:11.0:1773851867.615654:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113575191552 : -106960134360064 : ffff9eb8672fb400)
00000020:00000001:11.0:1773851867.615655:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113575191552 : -106960134360064 : ffff9eb8672fb400)
00000100:00000001:11.0:1773851867.615656:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851867.615656:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851867.615657:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fbc9e461.
00000020:00000010:11.0:1773851867.615658:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851867.615659:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000076194eba.
00000100:00000001:11.0:1773851867.615660:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851867.615660:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851867.615661:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851867.615662:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851867.615663:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851867.615663:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.615664:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851867.615666:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851867.615666:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851867.615666:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851867.615667:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15714@kfi7, seq: 2130779
00000100:00000001:9.0:1773851867.615667:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851867.615668:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c5887161 : new rpc_count 1
00000100:00000001:9.0:1773851867.615668:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.615669:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749188736 : -106947960362880 : ffff9ebb3cd02880)
00000100:00000001:9.0:1773851867.615669:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851867.615670:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000098bd43d4 x1859597816903744/t0(0) o400->d0cb77a7-d5ed-47b4-bf07-54d5be51b7f8@15714@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1468-0'
00000100:00000001:11.0:1773851867.615673:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851867.615673:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851867.615675:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098bd43d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d0cb77a7-d5ed-47b4-bf07-54d5be51b7f8+5:39588:x1859597816903744:12345-15714@kfi7:400:default-tuolumne1468-0
00000100:00000200:11.0:1773851867.615676:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597816903744
00000020:00000001:11.0:1773851867.615677:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851867.615677:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851867.615678:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.615679:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851867.615679:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851867.615680:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851867.615681:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597816903744, found 0 last_xid 1859597816903743
00000020:00000001:11.0:1773851867.615682:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851867.615683:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851867.615684:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851867.615684:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.615685:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851867.615686:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851867.615686:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851867.615687:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000427fd2c2.
02000000:00000001:11.0:1773851867.615688:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.615688:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.615689:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851867.615689:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183250624125, transno 0, xid 1859597816903744
00010000:00000001:11.0:1773851867.615690:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851867.615691:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000098bd43d4 x1859597816903744/t0(0) o400->d0cb77a7-d5ed-47b4-bf07-54d5be51b7f8@15714@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1468-0'
00010000:00000001:11.0:1773851867.615693:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851867.615694:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851867.615695:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=100 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851867.615696:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851867.615696:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001ddad465 refcount 3 to 15714@kfi7
00000100:00000001:11.0:1773851867.615697:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932288 : -107137839619328 : ffff9e8f0720a300)
02000000:00000001:11.0:1773851867.615698:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851867.615698:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.615699:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851867.615700:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15715@kfi7
00000400:00000010:11.0:1773851867.615700:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1f8095d.
00000100:00000200:11.0:1773851867.615701:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597816903744, offset 224
00000400:00000200:11.0:1773851867.615703:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15715@kfi7
00000400:00000200:11.0:1773851867.615704:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15715@kfi7 to cpt 2
00000400:00000200:11.0:1773851867.615705:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f32430a4 nid 15715@kfi7 refs 1
00000400:00000200:11.0:1773851867.615706:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f32430a4 nid 15715@kfi7 refs 2
00000400:00000200:11.0:1773851867.615707:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f32430a4 nid 15715@kfi7 refs 3
00000400:00000200:11.0:1773851867.615708:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15715@kfi7 local destination
00000400:00000200:11.0:1773851867.615710:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769222:8769222:1024:4294967295] 15715@kfi7 LPNI seq info [797153:797153:16:4294967295]
00000400:00000200:11.0:1773851867.615711:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f32430a4 nid 15715@kfi7 refs 2
00000400:00000200:11.0:1773851867.615712:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15715@kfi7 to cpt 2
00000400:00000200:11.0:1773851867.615714:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15715@kfi7(15715@kfi7:15715@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851867.615715:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f32430a4 nid 15715@kfi7 refs 3
00000800:00000200:11.0:1773851867.615717:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851867.615718:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851867.615720:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851867.615722:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a45 Using peer 15715@kfi7(0x100000000000a45)
00000800:00000200:11.0:1773851867.615729:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x100000000000a45: rc=0
00000800:00000200:11.0:1773851867.615731:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a45 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851867.615733:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851867.615734:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001ddad465 refcount 2 to 15714@kfi7
00010000:00000001:11.0:1773851867.615734:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851867.615735:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.615736:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851867.615737:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098bd43d4 x1859597816903744/t0(0) o400->d0cb77a7-d5ed-47b4-bf07-54d5be51b7f8@15714@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1468-0'
00000100:00100000:11.0:1773851867.615739:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098bd43d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d0cb77a7-d5ed-47b4-bf07-54d5be51b7f8+5:39588:x1859597816903744:12345-15714@kfi7:400:default-tuolumne1468-0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851867.615742:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15714@kfi7, seq: 2130779
00000100:00000040:11.0:1773851867.615743:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c5887161 : new rpc_count 0
00000800:00000200:9.0:1773851867.615743:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a45 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851867.615744:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851867.615744:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851867.615745:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000400:00000200:9.0:1773851867.615745:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851867.615746:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000076194eba.
00000020:00000010:11.0:1773851867.615746:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fbc9e461.
00000400:00000200:9.0:1773851867.615746:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15715@kfi7: PUT: OK
00000400:00000200:9.0:1773851867.615747:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1f8095d
00000400:00000010:9.0:1773851867.615747:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1f8095d.
00000020:00000040:11.0:1773851867.615748:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c5887161 : new refcount 4
00000100:00000001:11.0:1773851867.615748:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851867.615748:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851867.615749:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851867.615750:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f32430a4 nid 15715@kfi7 refs 2
00000800:00000200:9.0:1773851867.615751:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 15715@kfi7(00000000e96862ce):0x0 lsk 2630 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a45 Transaction freed
00000800:00000200:9.0:1773851867.645875:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851867.645877:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851867.645878:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851867.645882:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851867.645884:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16419@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.645886:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16419@kfi7 : PUT - for me
00000400:00000200:9.0:1773851867.645888:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16419@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.645893:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6fd36fd nid 16419@kfi7 refs 1
00000400:00000200:9.0:1773851867.645895:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16419@kfi7 to cpt 2
00000400:00000200:9.0:1773851867.645896:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6fd36fd nid 16419@kfi7 refs 2
00000400:00000200:9.0:1773851867.645897:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f6fd36fd nid 16419@kfi7 refs 3
00000400:00000200:9.0:1773851867.645899:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16418@kfi7 to cpt 7
00000400:00000200:9.0:1773851867.645900:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16418@kfi7 of length 224 into portal 12 MB=0x69b4b5c3fd400
00000400:00000200:9.0:1773851867.645902:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16418@kfi7 of length 224/224 into md 0x78146ce49 [64] + 136944
00000800:00000200:9.0:1773851867.645904:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851867.645906:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851867.645908:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16419@kfi7: PUT: OK
00000100:00000001:9.0:1773851867.645909:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851867.645909:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851867.645911:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d64d535e.
00000100:00000040:9.0:1773851867.645912:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d64d535e x1859597832803328 msgsize 224
00000100:00100000:9.0:1773851867.645914:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-16418@kfi7 (source: 12345-16419@kfi7)
00000100:00000001:9.0:1773851867.645915:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851867.645916:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6fd36fd nid 16419@kfi7 refs 2
00000100:00000001:11.0:1773851867.645917:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851867.645918:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851867.645918:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851867.645919:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851867.645920:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851867.645921:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851867.645922:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597832803328
00000020:00000001:11.0:1773851867.645923:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851867.645923:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81388
00000020:00000001:11.0:1773851867.645924:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851867.645927:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e981267c refcount=167
00000020:00000001:11.0:1773851867.645928:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097955874816 : -106975753676800 : ffff9eb4c433d800)
00000020:00000001:11.0:1773851867.645929:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097955874816 : -106975753676800 : ffff9eb4c433d800)
00000100:00000001:11.0:1773851867.645930:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851867.645931:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851867.645932:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fbc9e461.
00000020:00000010:11.0:1773851867.645933:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851867.645934:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000076194eba.
00000100:00000001:11.0:1773851867.645936:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851867.645936:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851867.645937:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851867.645938:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851867.645939:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851867.645940:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.645941:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851867.645943:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851867.645943:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851867.645944:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851867.645944:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851867.645945:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16418@kfi7, seq: 2130780
00000100:00000040:11.0:1773851867.645946:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e981267c : new rpc_count 1
00000100:00000001:9.0:1773851867.645946:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.645947:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749186432 : -106947960365184 : ffff9ebb3cd01f80)
00000100:00000001:9.0:1773851867.645947:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851867.645948:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d64d535e x1859597832803328/t0(0) o400->9fc16aa3-2121-4855-92ae-328c5df5b3dd@16418@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1515-0'
00000100:00000001:11.0:1773851867.645953:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851867.645954:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851867.645956:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d64d535e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9fc16aa3-2121-4855-92ae-328c5df5b3dd+167:39659:x1859597832803328:12345-16418@kfi7:400:default-tuolumne1515-0
00000100:00000200:11.0:1773851867.645958:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597832803328
00000020:00000001:11.0:1773851867.645959:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851867.645959:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851867.645960:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.645961:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851867.645962:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851867.645963:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851867.645964:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597832803328, found 0 last_xid 1859597832380671
00000020:00000001:11.0:1773851867.645965:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851867.645966:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851867.645967:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851867.645967:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.645968:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851867.645969:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851867.645970:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851867.645971:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b4605f33.
02000000:00000001:11.0:1773851867.645972:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.645973:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.645974:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851867.645975:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063011, transno 0, xid 1859597832803328
00010000:00000001:11.0:1773851867.645976:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851867.645977:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d64d535e x1859597832803328/t0(0) o400->9fc16aa3-2121-4855-92ae-328c5df5b3dd@16418@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1515-0'
00010000:00000001:11.0:1773851867.645981:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851867.645982:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851867.645983:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=100 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851867.645984:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851867.645985:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032d29e7f refcount 3 to 16418@kfi7
00000100:00000001:11.0:1773851867.645987:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270336 : -107152618281280 : ffff9e8b964026c0)
02000000:00000001:11.0:1773851867.645988:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851867.645988:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.645990:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851867.645991:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16419@kfi7
00000400:00000010:11.0:1773851867.645992:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000841fb28d.
00000100:00000200:11.0:1773851867.645993:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597832803328, offset 224
00000400:00000200:11.0:1773851867.645995:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16419@kfi7
00000400:00000200:11.0:1773851867.645997:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16419@kfi7 to cpt 2
00000400:00000200:11.0:1773851867.645998:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6fd36fd nid 16419@kfi7 refs 1
00000400:00000200:11.0:1773851867.646000:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f6fd36fd nid 16419@kfi7 refs 2
00000400:00000200:11.0:1773851867.646001:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f6fd36fd nid 16419@kfi7 refs 3
00000400:00000200:11.0:1773851867.646003:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16419@kfi7 local destination
00000400:00000200:11.0:1773851867.646005:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769223:8769223:1024:4294967295] 16419@kfi7 LPNI seq info [165178:165178:16:4294967295]
00000400:00000200:11.0:1773851867.646007:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f6fd36fd nid 16419@kfi7 refs 2
00000400:00000200:11.0:1773851867.646009:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16419@kfi7 to cpt 2
00000400:00000200:11.0:1773851867.646012:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16419@kfi7(16419@kfi7:16419@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851867.646014:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f6fd36fd nid 16419@kfi7 refs 3
00000800:00000200:11.0:1773851867.646016:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851867.646017:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851867.646021:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851867.646024:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc1a Using peer 16419@kfi7(0xc1a)
00000800:00000200:11.0:1773851867.646029:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0xc1a: rc=0
00000800:00000200:11.0:1773851867.646031:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc1a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851867.646034:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851867.646038:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032d29e7f refcount 2 to 16418@kfi7
00010000:00000001:11.0:1773851867.646039:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851867.646039:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851867.646040:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851867.646041:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d64d535e x1859597832803328/t0(0) o400->9fc16aa3-2121-4855-92ae-328c5df5b3dd@16418@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1515-0'
00000800:00000200:9.0:1773851867.646043:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc1a TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851867.646046:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851867.646048:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d64d535e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9fc16aa3-2121-4855-92ae-328c5df5b3dd+167:39659:x1859597832803328:12345-16418@kfi7:400:default-tuolumne1515-0 Request processed in 94us (135us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851867.646048:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16419@kfi7: PUT: OK
00000400:00000200:9.0:1773851867.646049:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000841fb28d
00000400:00000010:9.0:1773851867.646049:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000841fb28d.
00000100:00000001:9.0:1773851867.646050:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:11.0:1773851867.646051:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16418@kfi7, seq: 2130780
00000100:00000001:9.0:1773851867.646051:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:11.0:1773851867.646052:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e981267c : new rpc_count 0
00000400:00000200:9.0:1773851867.646052:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6fd36fd nid 16419@kfi7 refs 2
00000100:00000001:11.0:1773851867.646053:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851867.646054:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851867.646055:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000800:00000200:9.0:1773851867.646055:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 16419@kfi7(00000000f7af3f92):0x0 lsk 3099 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0xc1a Transaction freed
00000020:00000010:11.0:1773851867.646056:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000076194eba.
00000020:00000010:11.0:1773851867.646057:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fbc9e461.
00000020:00000040:11.0:1773851867.646058:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e981267c : new refcount 166
00000100:00000001:11.0:1773851867.646058:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851867.653825:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851867.653826:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851867.653827:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851867.653829:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851867.653831:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.653833:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19962@kfi7 : PUT - for me
00000400:00000200:17.0:1773851867.653834:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.653835:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 1
00000400:00000200:17.0:1773851867.653836:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.653837:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000400:00000200:17.0:1773851867.653838:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 3
00000400:00000200:17.0:1773851867.653838:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19963@kfi7 to cpt 7
00000400:00000200:17.0:1773851867.653839:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19963@kfi7 of length 224 into portal 12 MB=0x699de8ca94700
00000400:00000200:17.0:1773851867.653841:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19963@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 10552
00000800:00000200:17.0:1773851867.653843:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851867.653845:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851867.653846:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19962@kfi7: PUT: OK
00000100:00000001:17.0:1773851867.653847:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851867.653847:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851867.653848:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004b4519b.
00000100:00000040:17.0:1773851867.653849:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000004b4519b x1858030981957376 msgsize 224
00000100:00100000:17.0:1773851867.653850:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19963@kfi7 (source: 12345-19962@kfi7)
00000100:00000001:17.0:1773851867.653852:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851867.653853:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000800:00000200:17.0:1773851867.653854:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851867.653857:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851867.653857:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851867.653858:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851867.653858:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851867.653859:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851867.653860:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030981957376
00000020:00000001:17.0:1773851867.653861:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851867.653861:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fd6
00000020:00000001:17.0:1773851867.653862:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851867.653864:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009347a2b3 refcount=6
00000020:00000001:17.0:1773851867.653865:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240105984 : -107152469445632 : ffff9e8b9f1f3400)
00000020:00000001:17.0:1773851867.653867:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240105984 : -107152469445632 : ffff9e8b9f1f3400)
00000100:00000001:17.0:1773851867.653868:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851867.653868:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851867.653869:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9fa9763.
00000020:00000010:17.0:1773851867.653870:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851867.653871:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851867.653872:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851867.653872:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851867.653873:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851867.653874:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851867.653874:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851867.653874:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.653875:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851867.653876:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851867.653877:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851867.653877:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851867.653877:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851867.653878:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19963@kfi7, seq: 2156324
00000100:00000040:17.0:1773851867.653879:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009347a2b3 : new rpc_count 1
00000100:00000001:17.0:1773851867.653879:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093936000 : -107022615615616 : ffff9ea9db036780)
00000100:00000001:16.0:1773851867.653879:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851867.653879:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851867.653880:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000004b4519b x1858030981957376/t0(0) o400->6be2f39e-d144-42ca-b6f0-5e078a537fca@19963@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne246-0'
00000100:00000001:17.0:1773851867.653883:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851867.653883:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851867.653884:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004b4519b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:6be2f39e-d144-42ca-b6f0-5e078a537fca+6:47818:x1858030981957376:12345-19963@kfi7:400:default-tuolumne246-0
00000100:00000200:17.0:1773851867.653886:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030981957376
00000020:00000001:17.0:1773851867.653886:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851867.653887:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851867.653887:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.653888:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851867.653889:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851867.653889:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851867.653890:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030981957376, found 0 last_xid 1858030981957375
00000020:00000001:17.0:1773851867.653890:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851867.653892:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851867.653892:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851867.653893:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.653893:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851867.653894:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851867.653894:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851867.653895:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000003dbd7be.
02000000:00000001:17.0:1773851867.653896:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.653896:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.653897:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851867.653898:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030981957376
00010000:00000001:17.0:1773851867.653898:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851867.653899:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000004b4519b x1858030981957376/t0(0) o400->6be2f39e-d144-42ca-b6f0-5e078a537fca@19963@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne246-0'
00010000:00000001:17.0:1773851867.653902:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851867.653902:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851867.653903:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=100 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851867.653904:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851867.653904:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f62c0d0c refcount 5 to 19963@kfi7
00000100:00000001:17.0:1773851867.653905:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803488 : -107130477748128 : ffff9e90bdede060)
02000000:00000001:17.0:1773851867.653906:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851867.653906:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.653907:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851867.653908:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19962@kfi7
00000400:00000010:17.0:1773851867.653909:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000031ca15d6.
00000100:00000200:17.0:1773851867.653909:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030981957376, offset 224
00000400:00000200:17.0:1773851867.653911:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19962@kfi7
00000400:00000200:17.0:1773851867.653911:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.653912:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 1
00000400:00000200:17.0:1773851867.653913:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000400:00000200:17.0:1773851867.653914:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 3
00000400:00000200:17.0:1773851867.653915:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19962@kfi7 local destination
00000400:00000200:17.0:1773851867.653916:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769224:8769224:1024:4294967295] 19962@kfi7 LPNI seq info [24445:24445:16:4294967295]
00000400:00000200:17.0:1773851867.653918:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000400:00000200:17.0:1773851867.653919:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.653921:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19962@kfi7(19962@kfi7:19962@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851867.653922:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 3
00000800:00000200:17.0:1773851867.653923:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851867.653924:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851867.653926:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851867.653928:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004dc Using peer 19962@kfi7(0x1000000000004dc)
00000800:00000200:17.0:1773851867.653931:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x1000000000004dc: rc=0
00000800:00000200:17.0:1773851867.653933:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851867.653935:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851867.653936:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f62c0d0c refcount 4 to 19963@kfi7
00010000:00000001:17.0:1773851867.653936:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851867.653937:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.653938:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851867.653938:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000004b4519b x1858030981957376/t0(0) o400->6be2f39e-d144-42ca-b6f0-5e078a537fca@19963@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne246-0'
00000100:00100000:17.0:1773851867.653941:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004b4519b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:6be2f39e-d144-42ca-b6f0-5e078a537fca+6:47818:x1858030981957376:12345-19963@kfi7:400:default-tuolumne246-0 Request processed in 57us (91us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851867.653944:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19963@kfi7, seq: 2156324
00000800:00000200:18.0:1773851867.653945:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004dc TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851867.653945:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009347a2b3 : new rpc_count 0
00000100:00000001:17.0:1773851867.653945:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851867.653946:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851867.653946:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851867.653947:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851867.653947:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851867.653948:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19962@kfi7: PUT: OK
00000020:00000010:17.0:1773851867.653948:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9fa9763.
00000400:00000200:18.0:1773851867.653949:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000031ca15d6
00000400:00000010:18.0:1773851867.653949:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000031ca15d6.
00000020:00000040:17.0:1773851867.653949:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000009347a2b3 : new refcount 5
00000100:00000001:18.0:1773851867.653950:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851867.653950:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851867.653950:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851867.653951:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000800:00000200:18.0:1773851867.653952:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19962@kfi7(000000000f22799e):0x0 lsk 1245 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000004dc Transaction freed
00000800:00000200:17.0:1773851867.654042:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851867.654043:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851867.654044:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851867.654047:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851867.654049:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.654050:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19962@kfi7 : PUT - for me
00000400:00000200:17.0:1773851867.654051:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.654051:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 1
00000400:00000200:17.0:1773851867.654052:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.654053:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000400:00000200:17.0:1773851867.654054:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 3
00000400:00000200:17.0:1773851867.654054:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19963@kfi7 to cpt 7
00000400:00000200:17.0:1773851867.654055:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19963@kfi7 of length 224 into portal 12 MB=0x699de8ca94e80
00000400:00000200:17.0:1773851867.654057:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19963@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 10776
00000800:00000200:17.0:1773851867.654058:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851867.654060:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851867.654060:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19962@kfi7: PUT: OK
00000100:00000001:17.0:1773851867.654061:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851867.654061:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851867.654062:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f35a69d4.
00000100:00000040:17.0:1773851867.654063:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f35a69d4 x1858030981959296 msgsize 224
00000100:00100000:17.0:1773851867.654064:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19963@kfi7 (source: 12345-19962@kfi7)
00000100:00000001:17.0:1773851867.654065:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851867.654065:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000800:00000200:17.0:1773851867.654066:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851867.654069:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851867.654069:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851867.654070:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851867.654070:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851867.654071:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851867.654071:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030981959296
00000020:00000001:17.0:1773851867.654072:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851867.654072:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91142
00000020:00000001:17.0:1773851867.654073:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851867.654076:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d5ce8d4 refcount=6
00000020:00000001:17.0:1773851867.654076:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240331264 : -107152469220352 : ffff9e8b9f22a400)
00000020:00000001:17.0:1773851867.654077:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240331264 : -107152469220352 : ffff9e8b9f22a400)
00000100:00000001:17.0:1773851867.654078:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851867.654079:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851867.654079:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9fa9763.
00000020:00000010:17.0:1773851867.654080:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851867.654080:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851867.654081:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851867.654082:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851867.654082:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851867.654083:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851867.654083:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851867.654083:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.654084:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851867.654085:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851867.654085:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851867.654086:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19963@kfi7, seq: 2156325
00000100:00000001:16.0:1773851867.654086:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851867.654086:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851867.654087:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009d5ce8d4 : new rpc_count 1
00000100:00000001:17.0:1773851867.654087:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093931392 : -107022615620224 : ffff9ea9db035580)
00000100:00000001:16.0:1773851867.654087:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851867.654087:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851867.654088:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f35a69d4 x1858030981959296/t0(0) o400->4225af9f-9512-47d7-bec9-1851853aa15d@19963@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne246-0'
00000100:00000001:17.0:1773851867.654091:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851867.654091:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851867.654092:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f35a69d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4225af9f-9512-47d7-bec9-1851853aa15d+6:47816:x1858030981959296:12345-19963@kfi7:400:default-tuolumne246-0
00000100:00000200:17.0:1773851867.654093:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030981959296
00000020:00000001:17.0:1773851867.654096:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851867.654096:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851867.654097:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.654097:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851867.654097:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851867.654098:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851867.654098:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030981959296, found 0 last_xid 1858030981959295
00000020:00000001:17.0:1773851867.654099:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851867.654100:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851867.654100:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851867.654101:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.654101:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851867.654102:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851867.654102:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851867.654104:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c2e17dfa.
02000000:00000001:17.0:1773851867.654104:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.654105:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.654105:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851867.654106:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768324, transno 0, xid 1858030981959296
00010000:00000001:17.0:1773851867.654106:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851867.654107:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f35a69d4 x1858030981959296/t0(0) o400->4225af9f-9512-47d7-bec9-1851853aa15d@19963@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne246-0'
00010000:00000001:17.0:1773851867.654109:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851867.654110:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851867.654110:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=100 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851867.654111:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851867.654111:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f62c0d0c refcount 5 to 19963@kfi7
00000100:00000001:17.0:1773851867.654112:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803488 : -107130477748128 : ffff9e90bdede060)
02000000:00000001:17.0:1773851867.654113:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851867.654113:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851867.654114:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851867.654114:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19962@kfi7
00000400:00000010:17.0:1773851867.654115:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cfc002a6.
00000100:00000200:17.0:1773851867.654115:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030981959296, offset 224
00000400:00000200:17.0:1773851867.654116:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19962@kfi7
00000400:00000200:17.0:1773851867.654118:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.654118:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 1
00000400:00000200:17.0:1773851867.654119:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000400:00000200:17.0:1773851867.654120:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 3
00000400:00000200:17.0:1773851867.654121:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19962@kfi7 local destination
00000400:00000200:17.0:1773851867.654122:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769225:8769225:1024:4294967295] 19962@kfi7 LPNI seq info [24446:24446:16:4294967295]
00000400:00000200:17.0:1773851867.654123:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000400:00000200:17.0:1773851867.654124:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19962@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.654125:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19962@kfi7(19962@kfi7:19962@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851867.654127:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 3
00000800:00000200:17.0:1773851867.654128:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851867.654129:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851867.654130:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851867.654132:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x4e5 Using peer 19962@kfi7(0x4e5)
00000800:00000200:17.0:1773851867.654135:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x4e5: rc=0
00000800:00000200:17.0:1773851867.654136:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x4e5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851867.654138:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851867.654139:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f62c0d0c refcount 4 to 19963@kfi7
00010000:00000001:17.0:1773851867.654139:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851867.654140:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851867.654140:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851867.654141:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f35a69d4 x1858030981959296/t0(0) o400->4225af9f-9512-47d7-bec9-1851853aa15d@19963@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne246-0'
00000100:00100000:17.0:1773851867.654143:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f35a69d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4225af9f-9512-47d7-bec9-1851853aa15d+6:47816:x1858030981959296:12345-19963@kfi7:400:default-tuolumne246-0 Request processed in 52us (80us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851867.654145:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19963@kfi7, seq: 2156325
00000100:00000040:17.0:1773851867.654147:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009d5ce8d4 : new rpc_count 0
00000100:00000001:17.0:1773851867.654148:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851867.654148:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:18.0:1773851867.654149:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x4e5 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851867.654149:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851867.654149:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000400:00000200:18.0:1773851867.654150:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851867.654150:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9fa9763.
00000400:00000200:18.0:1773851867.654151:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19962@kfi7: PUT: OK
00000020:00000040:17.0:1773851867.654151:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000009d5ce8d4 : new refcount 5
00000400:00000200:18.0:1773851867.654152:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cfc002a6
00000400:00000010:18.0:1773851867.654152:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cfc002a6.
00000100:00000001:17.0:1773851867.654152:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851867.654153:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851867.654153:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851867.654154:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005fb20b0c nid 19962@kfi7 refs 2
00000800:00000200:18.0:1773851867.654155:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19962@kfi7(0000000001d24e7c):0x0 lsk 1254 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x4e5 Transaction freed
00000800:00000200:25.0:1773851867.657583:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851867.657583:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851867.657585:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851867.657586:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851867.657588:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13051@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.657589:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13051@kfi7 : PUT - for me
00000400:00000200:25.0:1773851867.657590:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13051@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.657591:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8a44214 nid 13051@kfi7 refs 1
00000400:00000200:25.0:1773851867.657592:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13051@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.657592:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8a44214 nid 13051@kfi7 refs 2
00000400:00000200:25.0:1773851867.657593:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e8a44214 nid 13051@kfi7 refs 3
00000400:00000200:25.0:1773851867.657594:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13051@kfi7 to cpt 6
00000400:00000200:25.0:1773851867.657595:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13051@kfi7 of length 224 into portal 12 MB=0x699de8958b140
00000400:00000200:25.0:1773851867.657596:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13051@kfi7 of length 224/224 into md 0x16159c9699 [64] + 8936
00000800:00000200:25.0:1773851867.657598:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851867.657599:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851867.657600:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13051@kfi7: PUT: OK
00000100:00000001:25.0:1773851867.657601:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851867.657601:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851867.657602:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005fd47fd9.
00000800:00000200:13.0:1773851867.657602:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000040:25.0:1773851867.657603:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000005fd47fd9 x1858030926344512 msgsize 224
00000800:00000200:13.0:1773851867.657603:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00100000:25.0:1773851867.657604:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-13051@kfi7 (source: 12345-13051@kfi7)
00000100:00000001:25.0:1773851867.657605:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:13.0:1773851867.657605:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851867.657606:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8a44214 nid 13051@kfi7 refs 2
00000100:00000001:24.0:1773851867.657606:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851867.657607:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851867.657607:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851867.657607:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851867.657607:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:24.0:1773851867.657608:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851867.657609:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851867.657609:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13050@kfi7 to cpt 3
00000100:00100000:24.0:1773851867.657610:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030926344512
00000020:00000001:24.0:1773851867.657610:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000400:00000200:13.0:1773851867.657610:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13050@kfi7 : PUT - for me
00000020:00000040:24.0:1773851867.657611:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90feb
00000020:00000001:24.0:1773851867.657611:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:13.0:1773851867.657611:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13050@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.657612:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e68dcfeb nid 13050@kfi7 refs 1
00000400:00000200:13.0:1773851867.657613:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13050@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.657614:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e68dcfeb nid 13050@kfi7 refs 2
00000020:00000040:24.0:1773851867.657615:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b83c5a33 refcount=6
00000400:00000200:13.0:1773851867.657615:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e68dcfeb nid 13050@kfi7 refs 3
00000020:00000001:24.0:1773851867.657616:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240111104 : -107152469440512 : ffff9e8b9f1f4800)
00000400:00000200:13.0:1773851867.657616:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13051@kfi7 to cpt 6
00000020:00000001:24.0:1773851867.657617:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240111104 : -107152469440512 : ffff9e8b9f1f4800)
00000100:00000001:24.0:1773851867.657618:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851867.657618:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:13.0:1773851867.657618:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13051@kfi7 of length 224 into portal 12 MB=0x699de8958b180
00000020:00000010:24.0:1773851867.657619:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049dcf77c.
00000400:00000200:13.0:1773851867.657619:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13051@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 28008
00000020:00000010:24.0:1773851867.657620:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851867.657621:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000800:00000200:13.0:1773851867.657621:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851867.657622:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851867.657622:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851867.657623:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851867.657623:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:24.0:1773851867.657624:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851867.657624:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000400:00000200:13.0:1773851867.657624:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13050@kfi7: PUT: OK
00000100:00000001:24.0:1773851867.657625:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.657625:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.657625:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:24.0:1773851867.657626:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000200:13.0:1773851867.657626:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851867.657626:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c3813960.
00000100:00000001:25.0:1773851867.657627:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851867.657627:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:13.0:1773851867.657627:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c3813960 x1858030926344576 msgsize 224
00000100:00000001:25.0:1773851867.657628:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851867.657628:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13051@kfi7, seq: 2025097
00000100:00000001:25.0:1773851867.657629:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851867.657629:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851867.657629:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b83c5a33 : new rpc_count 1
00000100:00000001:24.0:1773851867.657629:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478761600 : -106938230790016 : ffff9ebd80bda880)
00000100:00100000:13.0:1773851867.657629:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13051@kfi7 (source: 12345-13050@kfi7)
00000100:00000001:13.0:1773851867.657630:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000040:24.0:1773851867.657631:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005fd47fd9 x1858030926344512/t0(0) o400->e07a8ef6-87d9-4ccf-9e0d-f3570ab85032@13051@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne219-0'
00000400:00000200:13.0:1773851867.657631:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e68dcfeb nid 13050@kfi7 refs 2
00000100:00000001:24.0:1773851867.657633:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851867.657633:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:13.0:1773851867.657633:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000070fc7098: 2054@kfi7:3 <- 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00100000:24.0:1773851867.657634:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fd47fd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:e07a8ef6-87d9-4ccf-9e0d-f3570ab85032+6:47736:x1858030926344512:12345-13051@kfi7:400:default-tuolumne219-0
00000100:00000001:13.0:1773851867.657635:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000200:24.0:1773851867.657636:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030926344512
00000020:00000001:24.0:1773851867.657636:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
02000000:00000001:13.0:1773851867.657636:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851867.657637:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851867.657637:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851867.657638:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.657639:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00100000:13.0:1773851867.657639:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030926344576
00000020:00000001:13.0:1773851867.657639:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:24.0:1773851867.657640:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851867.657640:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91149
00000020:00000001:13.0:1773851867.657640:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:24.0:1773851867.657641:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851867.657641:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851867.657642:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851867.657643:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030926344512, found 0 last_xid 1858030926344511
00000020:00000001:24.0:1773851867.657643:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:13.0:1773851867.657643:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e2d908b1 refcount=6
00000020:00000001:24.0:1773851867.657644:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851867.657644:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240351744 : -107152469199872 : ffff9e8b9f22f400)
00000020:00000001:24.0:1773851867.657645:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851867.657645:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.657645:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240351744 : -107152469199872 : ffff9e8b9f22f400)
00000020:00000001:24.0:1773851867.657646:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851867.657646:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000100:00000001:13.0:1773851867.657646:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
02000000:00000001:24.0:1773851867.657647:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000001:13.0:1773851867.657647:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851867.657647:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000092eb84b1.
02000000:00000010:24.0:1773851867.657648:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000ada6ad3.
02000000:00000001:24.0:1773851867.657648:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851867.657648:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000100:00000001:24.0:1773851867.657649:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851867.657649:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e27c9b87.
00000020:00000001:24.0:1773851867.657650:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851867.657651:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030926344512
00010000:00000001:24.0:1773851867.657651:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000100:00000001:13.0:1773851867.657651:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00010000:00000200:24.0:1773851867.657652:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005fd47fd9 x1858030926344512/t0(0) o400->e07a8ef6-87d9-4ccf-9e0d-f3570ab85032@13051@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne219-0'
00000100:00000001:13.0:1773851867.657652:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851867.657652:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.657653:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851867.657653:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00010000:00000001:24.0:1773851867.657654:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:13.0:1773851867.657654:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851867.657655:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851867.657655:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=100 v=313 (313 212 1 1)
00000100:00000001:13.0:1773851867.657655:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.657656:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851867.657656:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851867.657657:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000001:15.0:1773851867.657657:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.657657:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:24.0:1773851867.657658:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000895d824f refcount 5 to 13051@kfi7
00000100:00000001:24.0:1773851867.657658:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331488 : -107155410220128 : ffff9e8aefd68ba0)
00000100:00000001:15.0:1773851867.657658:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851867.657658:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13051@kfi7, seq: 2289831
00000100:00000040:13.0:1773851867.657658:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e2d908b1 : new rpc_count 1
02000000:00000001:24.0:1773851867.657659:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000001:15.0:1773851867.657659:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.657659:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970989312 : -107043738562304 : ffff9ea4effcd100)
02000000:00000001:24.0:1773851867.657660:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851867.657660:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851867.657660:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c3813960 x1858030926344576/t0(0) o400->f04334aa-5334-4bf2-829e-a1a6e560e68a@13051@kfi7:84/0 lens 224/0 e 0 to 0 dl 1773852199 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne219-0'
00000100:00000040:24.0:1773851867.657661:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13051@kfi7
00000400:00000010:24.0:1773851867.657662:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b785b029.
00000100:00000200:24.0:1773851867.657662:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030926344512, offset 224
00000100:00000001:13.0:1773851867.657663:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:24.0:1773851867.657664:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13051@kfi7
00000100:00000001:13.0:1773851867.657664:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:24.0:1773851867.657665:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13051@kfi7 to cpt 6
00000100:00100000:13.0:1773851867.657665:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3813960 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f04334aa-5334-4bf2-829e-a1a6e560e68a+6:47737:x1858030926344576:12345-13051@kfi7:400:default-tuolumne219-0
00000400:00000200:24.0:1773851867.657666:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8a44214 nid 13051@kfi7 refs 1
00000100:00000200:13.0:1773851867.657666:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030926344576
00000020:00000001:13.0:1773851867.657666:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000400:00000200:24.0:1773851867.657667:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e8a44214 nid 13051@kfi7 refs 2
00000020:00000001:13.0:1773851867.657667:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:24.0:1773851867.657668:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e8a44214 nid 13051@kfi7 refs 3
00000020:00000001:13.0:1773851867.657668:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.657668:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:24.0:1773851867.657669:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13051@kfi7 local destination
00000020:00000001:13.0:1773851867.657669:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851867.657670:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851867.657670:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030926344576, found 0 last_xid 1858030926344575
00000400:00000200:24.0:1773851867.657671:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769226:8769226:1024:4294967295] 13051@kfi7 LPNI seq info [28015:28015:16:4294967295]
00000020:00000001:13.0:1773851867.657671:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:24.0:1773851867.657672:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e8a44214 nid 13051@kfi7 refs 2
00000020:00000001:13.0:1773851867.657672:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851867.657672:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:24.0:1773851867.657673:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13051@kfi7 to cpt 6
00000020:00000001:13.0:1773851867.657673:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:24.0:1773851867.657674:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13051@kfi7(13051@kfi7:13051@kfi7) <?> : PUT try# 0
00000020:00000001:13.0:1773851867.657674:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851867.657674:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851867.657674:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:24.0:1773851867.657675:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e8a44214 nid 13051@kfi7 refs 3
00000800:00000200:24.0:1773851867.657677:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
02000000:00000010:13.0:1773851867.657677:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000489e8e04.
00000800:00000200:24.0:1773851867.657678:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
02000000:00000001:13.0:1773851867.657678:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.657679:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:24.0:1773851867.657680:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000020:00000001:13.0:1773851867.657680:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851867.657680:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767897, transno 0, xid 1858030926344576
00010000:00000001:13.0:1773851867.657681:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000800:00000200:24.0:1773851867.657682:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7f7 Using peer 13051@kfi7(0x7f7)
00010000:00000200:13.0:1773851867.657682:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c3813960 x1858030926344576/t0(0) o400->f04334aa-5334-4bf2-829e-a1a6e560e68a@13051@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne219-0'
00000800:00000200:24.0:1773851867.657684:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0x7f7: rc=0
00010000:00000001:13.0:1773851867.657684:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851867.657685:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:24.0:1773851867.657686:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7f7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00001000:13.0:1773851867.657686:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851867.657687:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851867.657687:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000895d824f refcount 6 to 13051@kfi7
00000100:00000001:24.0:1773851867.657688:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851867.657688:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000895d824f refcount 5 to 13051@kfi7
00000100:00000001:13.0:1773851867.657688:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331488 : -107155410220128 : ffff9e8aefd68ba0)
00010000:00000001:24.0:1773851867.657689:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
02000000:00000001:13.0:1773851867.657689:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851867.657689:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.657690:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851867.657690:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000001:13.0:1773851867.657690:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851867.657691:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005fd47fd9 x1858030926344512/t0(0) o400->e07a8ef6-87d9-4ccf-9e0d-f3570ab85032@13051@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne219-0'
00000100:00000040:13.0:1773851867.657691:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13050@kfi7
00000400:00000010:13.0:1773851867.657691:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000235c42fd.
00000100:00000200:13.0:1773851867.657692:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030926344576, offset 224
00000400:00000200:13.0:1773851867.657693:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13050@kfi7
00000400:00000200:13.0:1773851867.657694:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13050@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.657695:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e68dcfeb nid 13050@kfi7 refs 1
00000100:00100000:24.0:1773851867.657696:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fd47fd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:e07a8ef6-87d9-4ccf-9e0d-f3570ab85032+6:47736:x1858030926344512:12345-13051@kfi7:400:default-tuolumne219-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851867.657696:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e68dcfeb nid 13050@kfi7 refs 2
00000400:00000200:13.0:1773851867.657697:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e68dcfeb nid 13050@kfi7 refs 3
00000100:00100000:24.0:1773851867.657698:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13051@kfi7, seq: 2025097
00000400:00000200:13.0:1773851867.657698:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13050@kfi7 local destination
00000100:00000040:24.0:1773851867.657699:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b83c5a33 : new rpc_count 0
00000100:00000001:24.0:1773851867.657700:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851867.657700:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851867.657700:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769227:8769227:1024:4294967295] 13050@kfi7 LPNI seq info [28016:28016:16:4294967295]
00000020:00000010:24.0:1773851867.657701:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:13.0:1773851867.657701:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e68dcfeb nid 13050@kfi7 refs 2
00000020:00000010:24.0:1773851867.657702:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000400:00000200:13.0:1773851867.657702:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13050@kfi7 to cpt 3
00000020:00000010:24.0:1773851867.657703:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049dcf77c.
00000020:00000040:24.0:1773851867.657703:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000b83c5a33 : new refcount 5
00000100:00000001:24.0:1773851867.657704:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851867.657704:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13050@kfi7(13050@kfi7:13050@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851867.657705:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e68dcfeb nid 13050@kfi7 refs 3
00000800:00000200:13.0:1773851867.657706:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.657707:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851867.657709:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7f7 TN_EVENT_TX_OK event status 0
00000800:00000200:13.0:1773851867.657710:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:25.0:1773851867.657711:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851867.657712:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13051@kfi7: PUT: OK
00000400:00000200:25.0:1773851867.657713:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b785b029
00000400:00000010:25.0:1773851867.657713:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b785b029.
00000800:00000200:13.0:1773851867.657713:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003a4 Using peer 13050@kfi7(0x1000000000003a4)
00000100:00000001:25.0:1773851867.657714:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851867.657714:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851867.657715:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8a44214 nid 13051@kfi7 refs 2
00000800:00000200:13.0:1773851867.657716:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000070fc7098: Posted send of 324 bytes to peer 0x1000000000003a4: rc=0
00000800:00000200:25.0:1773851867.657717:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 13051@kfi7(0000000048b16af7):0x0 lsk 2040 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7f7 Transaction freed
00000800:00000200:13.0:1773851867.657718:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851867.657720:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.657720:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000895d824f refcount 4 to 13051@kfi7
00010000:00000001:13.0:1773851867.657721:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851867.657722:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.657722:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851867.657723:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c3813960 x1858030926344576/t0(0) o400->f04334aa-5334-4bf2-829e-a1a6e560e68a@13051@kfi7:84/0 lens 224/224 e 0 to 0 dl 1773852199 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne219-0'
00000100:00100000:13.0:1773851867.657729:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3813960 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f04334aa-5334-4bf2-829e-a1a6e560e68a+6:47737:x1858030926344576:12345-13051@kfi7:400:default-tuolumne219-0 Request processed in 65us (101us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851867.657731:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13051@kfi7, seq: 2289831
00000100:00000040:13.0:1773851867.657732:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e2d908b1 : new rpc_count 0
00000100:00000001:13.0:1773851867.657733:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851867.657733:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851867.657734:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:14.0:1773851867.657735:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003a4 TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851867.657735:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e27c9b87.
00000400:00000200:14.0:1773851867.657736:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851867.657736:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000092eb84b1.
00000020:00000040:13.0:1773851867.657737:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000e2d908b1 : new refcount 5
00000100:00000001:13.0:1773851867.657737:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851867.657738:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13050@kfi7: PUT: OK
00000400:00000200:14.0:1773851867.657738:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000235c42fd
00000400:00000010:14.0:1773851867.657739:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000235c42fd.
00000100:00000001:14.0:1773851867.657740:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851867.657740:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851867.657741:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e68dcfeb nid 13050@kfi7 refs 2
00000800:00000200:14.0:1773851867.657743:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000070fc7098: 2054@kfi7:3 -> 13050@kfi7(00000000f2fdb2ed):0x0 lsk 933 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003a4 Transaction freed
00000800:00000200:17.0:1773851867.696296:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851867.696298:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851867.696300:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851867.696303:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851867.696306:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.696309:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.40@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851867.696311:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851867.696312:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851867.696314:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.40@o2ib60 to cpt 1
00000400:00000200:17.0:1773851867.696317:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ce13578 nid 192.168.128.40@o2ib60 refs 2
00000400:00000200:17.0:1773851867.696319:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007ce13578 nid 192.168.128.40@o2ib60 refs 3
00000400:00000200:17.0:1773851867.696320:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.40@o2ib60 to cpt 1
00000400:00000200:17.0:1773851867.696322:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.40@o2ib60 of length 224 into portal 12 MB=0x69b2331174580
00000400:00000200:17.0:1773851867.696325:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.40@o2ib60 of length 224/224 into md 0x793926dc5 [64] + 135896
00000800:00000200:17.0:1773851867.696328:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851867.696331:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851867.696333:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851867.696335:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851867.696336:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851867.696337:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007ed941c1.
00000100:00000040:17.0:1773851867.696339:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000007ed941c1 x1859425310033280 msgsize 224
00000100:00100000:17.0:1773851867.696343:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.40@o2ib60 (source: 12345-192.168.128.40@o2ib60)
00000100:00000001:17.0:1773851867.696346:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851867.696347:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851867.696350:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851867.696350:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851867.696351:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851867.696352:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851867.696353:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851867.696354:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851867.696355:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859425310033280
00000020:00000001:7.0:1773851867.696356:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851867.696357:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2cecee
00000020:00000001:7.0:1773851867.696358:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851867.696360:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000051afafed refcount=6
00000020:00000001:7.0:1773851867.696361:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105445499904 : -106968264051712 : ffff9eb6829e7400)
00000020:00000001:7.0:1773851867.696362:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105445499904 : -106968264051712 : ffff9eb6829e7400)
00000100:00000001:7.0:1773851867.696364:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.696365:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851867.696366:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b984b53b.
00000020:00000010:7.0:1773851867.696368:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851867.696369:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008745c425.
00000100:00000001:7.0:1773851867.696371:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851867.696372:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851867.696373:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.696375:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851867.696376:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851867.696376:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.696378:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.696380:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851867.696381:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851867.696382:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851867.696382:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851867.696384:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.40@o2ib60, seq: 2001919
00000100:00000040:7.0:1773851867.696385:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000051afafed : new rpc_count 2
00000100:00000001:5.0:1773851867.696385:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.696386:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093925632 : -107022615625984 : ffff9ea9db033f00)
00000100:00000001:5.0:1773851867.696386:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.696389:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007ed941c1 x1859425310033280/t0(0) o400->97797308-f6b2-478a-a601-eb5246cb9488@192.168.128.40@o2ib60:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix40-0'
00000100:00000001:7.0:1773851867.696395:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851867.696395:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851867.696397:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ed941c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:97797308-f6b2-478a-a601-eb5246cb9488+6:40001:x1859425310033280:12345-192.168.128.40@o2ib60:400:default-matrix40-0
00000100:00000200:7.0:1773851867.696400:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859425310033280
00000020:00000001:7.0:1773851867.696401:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851867.696402:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851867.696403:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.696404:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851867.696405:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851867.696406:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851867.696407:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859425310033280, found 0 last_xid 1859425308857599
00000020:00000001:7.0:1773851867.696408:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851867.696410:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851867.696410:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851867.696411:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.696412:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851867.696413:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851867.696414:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851867.696416:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009b388549.
02000000:00000001:7.0:1773851867.696417:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.696422:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.696424:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851867.696425:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260842330, transno 0, xid 1859425310033280
00010000:00000001:7.0:1773851867.696426:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851867.696428:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007ed941c1 x1859425310033280/t0(0) o400->97797308-f6b2-478a-a601-eb5246cb9488@192.168.128.40@o2ib60:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix40-0'
00010000:00000001:7.0:1773851867.696432:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851867.696433:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851867.696435:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=99 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851867.696436:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851867.696438:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d96aee12 refcount 3 to 192.168.128.40@o2ib60
00000100:00000001:7.0:1773851867.696439:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231613856 : -107130477937760 : ffff9e90bdeafba0)
02000000:00000001:7.0:1773851867.696441:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851867.696442:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.696443:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851867.696444:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.40@o2ib60
00000400:00000010:7.0:1773851867.696446:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
00000100:00000200:7.0:1773851867.696447:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859425310033280, offset 224
00000400:00000200:7.0:1773851867.696450:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.40@o2ib60
00000400:00000200:7.0:1773851867.696452:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.40@o2ib60 to cpt 1
00000400:00000200:7.0:1773851867.696454:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ce13578 nid 192.168.128.40@o2ib60 refs 2
00000400:00000200:7.0:1773851867.696456:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007ce13578 nid 192.168.128.40@o2ib60 refs 3
00000400:00000200:7.0:1773851867.696459:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007ce13578 nid 192.168.128.40@o2ib60 refs 4
00000400:00000200:7.0:1773851867.696461:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.40@o2ib60 routed destination
00000400:00000200:7.0:1773851867.696463:0:60963:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851867.696465:0:60963:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:7.0:1773851867.696468:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.40@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851867.696469:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851867.696471:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.40@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851867.696472:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851867.696474:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769228:8769228:1024:4294967295] 17@kfi7 LPNI seq info [1250891890:1250891890:16:4294967295]
00000400:00000200:7.0:1773851867.696477:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:7.0:1773851867.696479:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:7.0:1773851867.696484:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.40@o2ib60(192.168.128.40@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851867.696487:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007ce13578 nid 192.168.128.40@o2ib60 refs 3
00000800:00000200:7.0:1773851867.696489:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851867.696491:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851867.696494:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851867.696497:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:7.0:1773851867.696500:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:7.0:1773851867.696502:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851867.696504:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.696505:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d96aee12 refcount 2 to 192.168.128.40@o2ib60
00010000:00000001:7.0:1773851867.696506:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851867.696507:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851867.696508:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851867.696509:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007ed941c1 x1859425310033280/t0(0) o400->97797308-f6b2-478a-a601-eb5246cb9488@192.168.128.40@o2ib60:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix40-0'
00000100:00100000:7.0:1773851867.696512:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ed941c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:97797308-f6b2-478a-a601-eb5246cb9488+6:40001:x1859425310033280:12345-192.168.128.40@o2ib60:400:default-matrix40-0 Request processed in 117us (172us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851867.696514:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851867.696516:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.40@o2ib60, seq: 2001919
00000400:00000200:5.0:1773851867.696516:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:7.0:1773851867.696517:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000051afafed : new rpc_count 1
00000400:00000200:5.0:1773851867.696517:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:7.0:1773851867.696518:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851867.696518:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851867.696518:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000020:00000010:7.0:1773851867.696519:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000010:5.0:1773851867.696519:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000020:00000010:7.0:1773851867.696520:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008745c425.
00000100:00000001:5.0:1773851867.696520:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851867.696520:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851867.696521:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b984b53b.
00000400:00000200:5.0:1773851867.696521:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000040:7.0:1773851867.696522:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000051afafed : new refcount 5
00000100:00000001:7.0:1773851867.696523:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851867.696523:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Transaction freed
00000800:00000200:13.0:1773851867.700656:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.700657:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851867.700658:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851867.700661:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851867.700664:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.700665:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9979@kfi7 : PUT - for me
00000400:00000200:13.0:1773851867.700666:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.700667:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 1
00000400:00000200:13.0:1773851867.700668:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.700668:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000400:00000200:13.0:1773851867.700669:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 3
00000400:00000200:13.0:1773851867.700670:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.700671:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9979@kfi7 of length 224 into portal 12 MB=0x699de8d688540
00000400:00000200:13.0:1773851867.700673:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9979@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 28232
00000800:00000200:13.0:1773851867.700674:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851867.700676:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851867.700677:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9979@kfi7: PUT: OK
00000100:00000001:13.0:1773851867.700678:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851867.700678:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851867.700679:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ecded8b8.
00000100:00000040:13.0:1773851867.700680:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ecded8b8 x1858030994490688 msgsize 224
00000100:00100000:13.0:1773851867.700681:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9979@kfi7 (source: 12345-9979@kfi7)
00000100:00000001:13.0:1773851867.700683:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851867.700684:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000800:00000200:13.0:1773851867.700685:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6bd4140: 2069@kfi7:3 <- 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851867.700687:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851867.700688:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851867.700689:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851867.700689:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851867.700690:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851867.700691:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030994490688
00000020:00000001:13.0:1773851867.700691:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851867.700692:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91085
00000020:00000001:13.0:1773851867.700692:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851867.700699:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac94c9ae refcount=6
00000020:00000001:13.0:1773851867.700700:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240112128 : -107152469439488 : ffff9e8b9f1f4c00)
00000020:00000001:13.0:1773851867.700701:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240112128 : -107152469439488 : ffff9e8b9f1f4c00)
00000100:00000001:13.0:1773851867.700702:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.700702:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851867.700703:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008364742b.
00000020:00000010:13.0:1773851867.700704:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.700705:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e27c9b87.
00000100:00000001:13.0:1773851867.700706:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851867.700706:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851867.700707:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.700708:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851867.700708:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851867.700709:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.700710:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851867.700711:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.700711:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851867.700711:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851867.700711:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851867.700712:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9979@kfi7, seq: 2289832
00000100:00000001:15.0:1773851867.700713:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.700713:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac94c9ae : new rpc_count 1
00000100:00000001:15.0:1773851867.700714:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.700714:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970991616 : -107043738560000 : ffff9ea4effcda00)
00000100:00000040:13.0:1773851867.700715:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ecded8b8 x1858030994490688/t0(0) o400->e383f65e-774f-475d-b042-bd8eaa8d44bc@9979@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne207-0'
00000100:00000001:13.0:1773851867.700718:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.700718:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851867.700719:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecded8b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e383f65e-774f-475d-b042-bd8eaa8d44bc+6:47396:x1858030994490688:12345-9979@kfi7:400:default-tuolumne207-0
00000100:00000200:13.0:1773851867.700720:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030994490688
00000020:00000001:13.0:1773851867.700721:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851867.700721:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851867.700722:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.700723:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851867.700723:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851867.700724:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851867.700728:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030994490688, found 0 last_xid 1858030994490687
00000020:00000001:13.0:1773851867.700729:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851867.700729:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851867.700730:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851867.700730:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.700731:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851867.700732:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851867.700732:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851867.700733:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000092eb84b1.
02000000:00000001:13.0:1773851867.700733:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.700734:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.700735:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851867.700735:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030994490688
00010000:00000001:13.0:1773851867.700736:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851867.700737:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ecded8b8 x1858030994490688/t0(0) o400->e383f65e-774f-475d-b042-bd8eaa8d44bc@9979@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne207-0'
00010000:00000001:13.0:1773851867.700739:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851867.700740:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851867.700741:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851867.700742:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851867.700742:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fa36d529 refcount 5 to 9979@kfi7
00000100:00000001:13.0:1773851867.700743:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153472 : -107139310398144 : ffff9e8eaf765540)
02000000:00000001:13.0:1773851867.700744:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851867.700745:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.700745:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851867.700746:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9979@kfi7
00000400:00000010:13.0:1773851867.700747:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f88fa208.
00000100:00000200:13.0:1773851867.700747:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030994490688, offset 224
00000400:00000200:13.0:1773851867.700749:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9979@kfi7
00000400:00000200:13.0:1773851867.700750:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.700750:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 1
00000400:00000200:13.0:1773851867.700751:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000400:00000200:13.0:1773851867.700752:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 3
00000400:00000200:13.0:1773851867.700754:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9979@kfi7 local destination
00000400:00000200:13.0:1773851867.700756:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769229:8769229:1024:4294967295] 9979@kfi7 LPNI seq info [24621:24621:16:4294967295]
00000400:00000200:13.0:1773851867.700757:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000400:00000200:13.0:1773851867.700758:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.700760:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9979@kfi7(9979@kfi7:9979@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851867.700761:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 3
00000800:00000200:13.0:1773851867.700762:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.700763:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851867.700765:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851867.700768:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x48 Using peer 9979@kfi7(0x48)
00000800:00000200:13.0:1773851867.700771:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000f6bd4140: Posted send of 324 bytes to peer 0x48: rc=0
00000800:00000200:13.0:1773851867.700772:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x48 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851867.700774:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.700775:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fa36d529 refcount 4 to 9979@kfi7
00010000:00000001:13.0:1773851867.700776:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851867.700777:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.700777:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851867.700778:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ecded8b8 x1858030994490688/t0(0) o400->e383f65e-774f-475d-b042-bd8eaa8d44bc@9979@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne207-0'
00000100:00100000:13.0:1773851867.700781:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecded8b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e383f65e-774f-475d-b042-bd8eaa8d44bc+6:47396:x1858030994490688:12345-9979@kfi7:400:default-tuolumne207-0 Request processed in 62us (100us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851867.700784:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9979@kfi7, seq: 2289832
00000100:00000040:13.0:1773851867.700784:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac94c9ae : new rpc_count 0
00000800:00000200:14.0:1773851867.700785:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x48 TN_EVENT_TX_OK event status 0
00000100:00000001:13.0:1773851867.700785:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851867.700785:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851867.700786:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851867.700787:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851867.700787:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e27c9b87.
00000400:00000200:14.0:1773851867.700788:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9979@kfi7: PUT: OK
00000020:00000010:13.0:1773851867.700788:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008364742b.
00000400:00000200:14.0:1773851867.700789:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f88fa208
00000400:00000010:14.0:1773851867.700789:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f88fa208.
00000020:00000040:13.0:1773851867.700789:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000ac94c9ae : new refcount 5
00000100:00000001:14.0:1773851867.700790:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851867.700790:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851867.700791:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851867.700791:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000800:00000200:14.0:1773851867.700793:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6bd4140: 2069@kfi7:3 -> 9979@kfi7(0000000001cdee84):0x0 lsk 73 rsk 128 tsk 0 trmk 0 tmk 0 trr 3 tta 0x48 Transaction freed
00000800:00000200:14.0:1773851867.701226:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851867.701227:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851867.701228:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851867.701230:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851867.701232:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.701233:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9979@kfi7 : PUT - for me
00000400:00000200:14.0:1773851867.701234:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.701234:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 1
00000400:00000200:14.0:1773851867.701235:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.701236:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000400:00000200:14.0:1773851867.701237:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 3
00000400:00000200:14.0:1773851867.701237:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.701238:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9979@kfi7 of length 224 into portal 12 MB=0x699de8d688dc0
00000400:00000200:14.0:1773851867.701239:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9979@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 28456
00000800:00000200:14.0:1773851867.701241:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851867.701243:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851867.701244:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9979@kfi7: PUT: OK
00000100:00000001:14.0:1773851867.701244:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851867.701245:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851867.701246:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000efaae84c.
00000100:00000040:14.0:1773851867.701246:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000efaae84c x1858030994492864 msgsize 224
00000100:00100000:14.0:1773851867.701247:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-9979@kfi7 (source: 12345-9979@kfi7)
00000100:00000001:14.0:1773851867.701248:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851867.701249:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000100:00000001:13.0:1773851867.701250:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851867.701250:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851867.701251:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851867.701251:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851867.701251:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851867.701252:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851867.701252:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030994492864
00000020:00000001:13.0:1773851867.701253:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851867.701253:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91379
00000020:00000001:13.0:1773851867.701254:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851867.701257:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004ec90ff9 refcount=6
00000020:00000001:13.0:1773851867.701257:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169329664 : -107127540221952 : ffff9e916d04f800)
00000020:00000001:13.0:1773851867.701258:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169329664 : -107127540221952 : ffff9e916d04f800)
00000100:00000001:13.0:1773851867.701259:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.701259:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851867.701260:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008364742b.
00000020:00000010:13.0:1773851867.701260:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.701261:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e27c9b87.
00000100:00000001:13.0:1773851867.701262:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851867.701262:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851867.701263:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.701263:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851867.701263:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851867.701264:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.701265:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.701265:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.701266:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.701266:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851867.701266:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:13.0:1773851867.701266:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9979@kfi7, seq: 2289833
00000100:00000001:15.0:1773851867.701267:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.701267:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004ec90ff9 : new rpc_count 1
00000100:00000001:15.0:1773851867.701268:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.701268:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341830272 : -106946367721344 : ffff9ebb9bbdf080)
00000100:00000040:13.0:1773851867.701268:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000efaae84c x1858030994492864/t0(0) o400->14c2bb25-e872-4abb-bdb1-e86deaa1f24d@9979@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne207-0'
00000100:00000001:13.0:1773851867.701274:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.701274:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:13.0:1773851867.701275:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000efaae84c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:14c2bb25-e872-4abb-bdb1-e86deaa1f24d+6:47398:x1858030994492864:12345-9979@kfi7:400:default-tuolumne207-0
00000100:00000200:13.0:1773851867.701277:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030994492864
00000020:00000001:13.0:1773851867.701277:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:13.0:1773851867.701278:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:13.0:1773851867.701278:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.701279:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851867.701279:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:13.0:1773851867.701280:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:13.0:1773851867.701280:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030994492864, found 0 last_xid 1858030994492863
00000020:00000001:13.0:1773851867.701281:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851867.701282:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:13.0:1773851867.701282:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851867.701282:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.701283:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:13.0:1773851867.701283:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:13.0:1773851867.701284:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:13.0:1773851867.701285:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ff09e1ae.
02000000:00000001:13.0:1773851867.701285:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.701286:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.701286:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:13.0:1773851867.701287:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767761, transno 0, xid 1858030994492864
00010000:00000001:13.0:1773851867.701288:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:13.0:1773851867.701288:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000efaae84c x1858030994492864/t0(0) o400->14c2bb25-e872-4abb-bdb1-e86deaa1f24d@9979@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne207-0'
00010000:00000001:13.0:1773851867.701291:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:13.0:1773851867.701291:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851867.701292:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:13.0:1773851867.701293:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:13.0:1773851867.701293:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fa36d529 refcount 5 to 9979@kfi7
00000100:00000001:13.0:1773851867.701294:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153472 : -107139310398144 : ffff9e8eaf765540)
02000000:00000001:13.0:1773851867.701295:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:13.0:1773851867.701295:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.701296:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:13.0:1773851867.701296:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9979@kfi7
00000400:00000010:13.0:1773851867.701297:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000a09a418.
00000100:00000200:13.0:1773851867.701298:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030994492864, offset 224
00000400:00000200:13.0:1773851867.701299:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9979@kfi7
00000400:00000200:13.0:1773851867.701300:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.701300:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 1
00000400:00000200:13.0:1773851867.701301:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000400:00000200:13.0:1773851867.701302:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 3
00000400:00000200:13.0:1773851867.701303:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9979@kfi7 local destination
00000400:00000200:13.0:1773851867.701304:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769230:8769230:1024:4294967295] 9979@kfi7 LPNI seq info [24622:24622:16:4294967295]
00000400:00000200:13.0:1773851867.701306:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000400:00000200:13.0:1773851867.701307:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9979@kfi7 to cpt 3
00000400:00000200:13.0:1773851867.701308:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9979@kfi7(9979@kfi7:9979@kfi7) <?> : PUT try# 0
00000400:00000200:13.0:1773851867.701310:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 3
00000800:00000200:13.0:1773851867.701311:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851867.701312:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:13.0:1773851867.701314:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:13.0:1773851867.701316:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000005e Using peer 9979@kfi7(0x10000000000005e)
00000800:00000200:13.0:1773851867.701319:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000006c12e940: Posted send of 324 bytes to peer 0x10000000000005e: rc=0
00000800:00000200:13.0:1773851867.701320:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000005e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:13.0:1773851867.701322:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851867.701322:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fa36d529 refcount 4 to 9979@kfi7
00010000:00000001:13.0:1773851867.701323:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:13.0:1773851867.701324:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851867.701325:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:13.0:1773851867.701325:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000efaae84c x1858030994492864/t0(0) o400->14c2bb25-e872-4abb-bdb1-e86deaa1f24d@9979@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne207-0'
00000100:00100000:13.0:1773851867.701328:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000efaae84c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:14c2bb25-e872-4abb-bdb1-e86deaa1f24d+6:47398:x1858030994492864:12345-9979@kfi7:400:default-tuolumne207-0 Request processed in 53us (81us total) trans 0 rc 0/0
00000100:00100000:13.0:1773851867.701331:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9979@kfi7, seq: 2289833
00000100:00000040:13.0:1773851867.701331:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004ec90ff9 : new rpc_count 0
00000100:00000001:13.0:1773851867.701332:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851867.701332:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851867.701332:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000800:00000200:14.0:1773851867.701333:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000005e TN_EVENT_TX_OK event status 0
00000020:00000010:13.0:1773851867.701333:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e27c9b87.
00000400:00000200:14.0:1773851867.701334:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:13.0:1773851867.701334:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008364742b.
00000020:00000040:13.0:1773851867.701334:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000004ec90ff9 : new refcount 5
00000400:00000200:14.0:1773851867.701335:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9979@kfi7: PUT: OK
00000100:00000001:13.0:1773851867.701335:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851867.701336:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000a09a418
00000400:00000010:14.0:1773851867.701336:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000a09a418.
00000100:00000001:14.0:1773851867.701337:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851867.701337:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851867.701338:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d16af685 nid 9979@kfi7 refs 2
00000800:00000200:14.0:1773851867.701339:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006c12e940: 2054@kfi7:3 -> 9979@kfi7(000000007336a4a5):0x0 lsk 95 rsk 127 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000005e Transaction freed
00000800:00000200:2.0:1773851867.714587:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851867.714588:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851867.714590:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851867.714592:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851867.714594:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.714595:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24571@kfi7 : PUT - for me
00000400:00000200:2.0:1773851867.714596:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.714607:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 1
00000400:00000200:2.0:1773851867.714608:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.714608:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000400:00000200:2.0:1773851867.714609:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 3
00000400:00000200:2.0:1773851867.714610:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.714611:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24571@kfi7 of length 440 into portal 12 MB=0x699de8c699040
00000400:00000200:2.0:1773851867.714612:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24571@kfi7 of length 440/440 into md 0x7fb56e801 [64] + 29176
00000800:00000200:2.0:1773851867.714614:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851867.714616:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851867.714617:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24571@kfi7: PUT: OK
00000100:00000001:2.0:1773851867.714618:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851867.714619:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851867.714620:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f2ec15a.
00000100:00000040:2.0:1773851867.714621:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000001f2ec15a x1858030977781824 msgsize 440
00000100:00100000:2.0:1773851867.714622:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-24571@kfi7 (source: 12345-24571@kfi7)
00000100:00000001:2.0:1773851867.714623:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851867.714624:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000800:00000200:2.0:1773851867.714625:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851867.714625:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851867.714625:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851867.714626:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851867.714626:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851867.714627:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851867.714628:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030977781824
00000020:00000001:1.0:1773851867.714628:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851867.714629:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91214
00000020:00000001:1.0:1773851867.714629:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851867.714631:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a263e624 refcount=6
00000020:00000001:1.0:1773851867.714632:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240549376 : -107152469002240 : ffff9e8b9f25f800)
00000020:00000001:1.0:1773851867.714633:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240549376 : -107152469002240 : ffff9e8b9f25f800)
00000100:00000001:1.0:1773851867.714634:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.714635:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851867.714635:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5405d62.
00000020:00000010:1.0:1773851867.714636:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.714637:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee53e016.
00000100:00000001:1.0:1773851867.714638:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851867.714638:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851867.714640:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.714640:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.714642:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.714643:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851867.714643:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851867.714643:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:1.0:1773851867.714644:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24571@kfi7, seq: 408701478
00000100:00000001:0.0:1773851867.714644:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:1.0:1773851867.714645:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a263e624 : new rpc_count 1
00000100:00000001:0.0:1773851867.714645:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.714646:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706784512 : -106953002767104 : ffff9eba10432d00)
00000100:00000001:0.0:1773851867.714646:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.714647:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001f2ec15a x1858030977781824/t0(0) o41->a73f91a0-2f91-485b-93f6-c195aabf5153@24571@kfi7:594/0 lens 440/0 e 0 to 0 dl 1773851954 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne264-0'
00000100:00000001:1.0:1773851867.714649:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.714650:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851867.714650:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f2ec15a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a73f91a0-2f91-485b-93f6-c195aabf5153+6:107572:x1858030977781824:12345-24571@kfi7:41:default-tuolumne264-0
00000100:00000200:1.0:1773851867.714652:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030977781824
00000020:00000001:1.0:1773851867.714652:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851867.714653:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851867.714654:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.714654:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851867.714655:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:1.0:1773851867.714656:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851867.714656:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030977781824, found 0 last_xid 1858030977781823
00000020:00000001:1.0:1773851867.714657:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851867.714658:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851867.714658:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851867.714659:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.714659:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851867.714660:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851867.714661:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000003ef8b576.
02000000:00000001:1.0:1773851867.714662:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.714662:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714663:0:42868:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:1.0:1773851867.714664:0:42868:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:1.0:1773851867.714664:0:42868:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714666:0:42868:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:1.0:1773851867.714667:0:42868:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:1.0:1773851867.714668:0:42868:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714670:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:1.0:1773851867.714670:0:42868:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714671:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:1.0:1773851867.714672:0:42868:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714672:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:1.0:1773851867.714673:0:42868:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714674:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:1.0:1773851867.714674:0:42868:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714675:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:1.0:1773851867.714675:0:42868:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714676:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714676:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500123136 free, 351498040320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097760 files, 343261839 free files
00000004:00000001:1.0:1773851867.714678:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714679:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714679:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504356352 free, 351502185472 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056274 files, 343265973 free files
00000004:00000001:1.0:1773851867.714681:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714681:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714682:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690114048 free, 351687681024 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231248 files, 343447377 free files
00000004:00000001:1.0:1773851867.714683:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714684:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714684:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382762496 free, 351380691968 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978746 files, 343147229 free files
00000004:00000001:1.0:1773851867.714685:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714686:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714687:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350959011840 free, 350956919808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371564058 files, 342733410 free files
00000004:00000001:1.0:1773851867.714688:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714688:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714689:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351236608 free, 351348468736 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084109 files, 343116442 free files
00000004:00000001:1.0:1773851867.714690:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714691:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714692:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482223616 free, 351481179136 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097220 files, 343244359 free files
00000004:00000001:1.0:1773851867.714693:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714693:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714694:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449338880 free, 351446756352 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372161028 files, 343212245 free files
00000004:00000001:1.0:1773851867.714695:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714695:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714696:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353623552 free, 351351217152 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083323 files, 343118773 free files
00000004:00000001:1.0:1773851867.714697:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714698:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714698:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351389039616 free, 351386320896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019202 files, 343153359 free files
00000004:00000001:1.0:1773851867.714699:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714700:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714700:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406570496 free, 351404219392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127307 files, 343170479 free files
00000004:00000001:1.0:1773851867.714701:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714701:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714702:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378938880 free, 351375971328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019024 files, 343143495 free files
00000004:00000001:1.0:1773851867.714703:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714704:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714704:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466000384 free, 351462857728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062875 files, 343228516 free files
00000004:00000001:1.0:1773851867.714705:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714706:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714706:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489089536 free, 351486044160 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066870 files, 343251064 free files
00000004:00000001:1.0:1773851867.714708:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714708:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714709:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399726592 blocks, 351492777984 free, 351490345984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078129 files, 343254666 free files
00000004:00000001:1.0:1773851867.714710:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714710:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714711:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399719424 blocks, 351524100096 free, 351521339392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113947 files, 343285254 free files
00000004:00000001:1.0:1773851867.714713:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714713:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714714:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510687744 free, 351508057088 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095858 files, 343272156 free files
00000004:00000001:1.0:1773851867.714715:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714716:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714716:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541584896 free, 351539512320 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136717 files, 343302329 free files
00000004:00000001:1.0:1773851867.714717:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714718:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714718:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470736384 free, 351461654528 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064608 files, 343233141 free files
00000004:00000001:1.0:1773851867.714719:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714720:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714720:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666708480 free, 351645480960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237950 files, 343424520 free files
00000004:00000001:1.0:1773851867.714722:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714722:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714723:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545871360 free, 351536201728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116519 files, 343306515 free files
00000004:00000001:1.0:1773851867.714724:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714727:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714728:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603986432 free, 351601695744 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190508 files, 343363268 free files
00000004:00000001:1.0:1773851867.714729:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714730:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714730:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615858688 free, 351613239296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043460 files, 343374862 free files
00000004:00000001:1.0:1773851867.714732:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714732:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714733:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420288000 free, 351417816064 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372009047 files, 343183875 free files
00000004:00000001:1.0:1773851867.714734:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714734:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714735:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409140736 free, 351407087616 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011338 files, 343172989 free files
00000004:00000001:1.0:1773851867.714737:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714737:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714738:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480064000 free, 351478686720 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073181 files, 343242250 free files
00000004:00000001:1.0:1773851867.714739:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714740:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714740:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593681920 free, 351576841216 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190031 files, 343353205 free files
00000004:00000001:1.0:1773851867.714741:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714742:0:42868:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:1.0:1773851867.714742:0:42868:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464092672 free, 351458266112 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372060756 files, 343226653 free files
00000004:00000001:1.0:1773851867.714744:0:42868:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714744:0:42868:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714745:0:42868:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:1.0:1773851867.714746:0:42868:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 40309317668175872 avail 40308838179536896
00000004:00000020:1.0:1773851867.714747:0:42868:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841142008832 free, 9841024837696 avail; 10969026039 objects: 9610490243 free; state 100
00000020:00000001:1.0:1773851867.714749:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:1.0:1773851867.714751:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851867.714752:0:42868:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851867.714753:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768273, transno 0, xid 1858030977781824
00010000:00000001:1.0:1773851867.714754:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851867.714754:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001f2ec15a x1858030977781824/t0(0) o41->a73f91a0-2f91-485b-93f6-c195aabf5153@24571@kfi7:594/0 lens 440/368 e 0 to 0 dl 1773851954 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne264-0'
00010000:00000001:1.0:1773851867.714757:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851867.714757:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851867.714758:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851867.714759:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851867.714760:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000792a543a refcount 5 to 24571@kfi7
00000100:00000001:1.0:1773851867.714761:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729380416 : -107155980171200 : ffff9e8acdddc840)
02000000:00000001:1.0:1773851867.714762:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851867.714762:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.714763:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851867.714764:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24571@kfi7
00000400:00000010:1.0:1773851867.714764:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ffbd9402.
00000100:00000200:1.0:1773851867.714765:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030977781824, offset 224
00000400:00000200:1.0:1773851867.714766:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24571@kfi7
00000400:00000200:1.0:1773851867.714767:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.714768:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 1
00000400:00000200:1.0:1773851867.714769:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000400:00000200:1.0:1773851867.714770:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 3
00000400:00000200:1.0:1773851867.714771:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24571@kfi7 local destination
00000400:00000200:1.0:1773851867.714772:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769231:8769231:1024:4294967295] 24571@kfi7 LPNI seq info [28030:28030:16:4294967295]
00000400:00000200:1.0:1773851867.714773:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000400:00000200:1.0:1773851867.714774:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.714776:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24571@kfi7(24571@kfi7:24571@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851867.714777:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 3
00000800:00000200:1.0:1773851867.714778:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.714779:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:1.0:1773851867.714782:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851867.714784:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000589 Using peer 24571@kfi7(0x100000000000589)
00000800:00000200:1.0:1773851867.714787:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 468 bytes to peer 0x100000000000589: rc=0
00000800:00000200:1.0:1773851867.714788:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000589 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851867.714790:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.714791:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000792a543a refcount 4 to 24571@kfi7
00010000:00000001:1.0:1773851867.714791:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851867.714792:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.714793:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851867.714794:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f2ec15a x1858030977781824/t0(0) o41->a73f91a0-2f91-485b-93f6-c195aabf5153@24571@kfi7:594/0 lens 440/368 e 0 to 0 dl 1773851954 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne264-0'
00000100:00100000:1.0:1773851867.714797:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f2ec15a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a73f91a0-2f91-485b-93f6-c195aabf5153+6:107572:x1858030977781824:12345-24571@kfi7:41:default-tuolumne264-0 Request processed in 147us (175us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851867.714799:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24571@kfi7, seq: 408701478
00000100:00000040:1.0:1773851867.714800:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a263e624 : new rpc_count 0
00000100:00000001:1.0:1773851867.714800:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:3.0:1773851867.714801:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000589 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851867.714801:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851867.714801:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.714802:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee53e016.
00000020:00000010:1.0:1773851867.714803:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5405d62.
00000400:00000200:3.0:1773851867.714804:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:1.0:1773851867.714804:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000a263e624 : new refcount 5
00000100:00000001:1.0:1773851867.714804:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851867.714805:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24571@kfi7: PUT: OK
00000400:00000200:3.0:1773851867.714806:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ffbd9402
00000400:00000010:3.0:1773851867.714806:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ffbd9402.
00000100:00000001:3.0:1773851867.714807:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851867.714807:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851867.714808:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000800:00000200:3.0:1773851867.714809:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 24571@kfi7(00000000a76f03d9):0x0 lsk 1418 rsk 87 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000589 Transaction freed
00000800:00000200:18.0:1773851867.717247:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851867.717248:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851867.717249:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851867.717251:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851867.717253:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:18.0:1773851867.717255:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.39@o2ib60 : PUT - for me
00000400:00000200:18.0:1773851867.717256:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:18.0:1773851867.717257:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:18.0:1773851867.717259:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:18.0:1773851867.717260:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:18.0:1773851867.717261:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:18.0:1773851867.717263:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:18.0:1773851867.717264:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.39@o2ib60 of length 224 into portal 12 MB=0x69b220e966680
00000400:00000200:18.0:1773851867.717266:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.39@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 29616
00000800:00000200:18.0:1773851867.717269:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851867.717270:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851867.717272:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:18.0:1773851867.717273:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851867.717274:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851867.717275:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000013e379e.
00000100:00000040:18.0:1773851867.717276:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000013e379e x1859420436194944 msgsize 224
00000100:00100000:18.0:1773851867.717278:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.39@o2ib60 (source: 12345-192.168.128.39@o2ib60)
00000100:00000001:18.0:1773851867.717280:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851867.717281:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:18.0:1773851867.717283:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851867.717284:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851867.717285:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851867.717285:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851867.717286:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851867.717287:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851867.717288:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859420436194944
00000020:00000001:1.0:1773851867.717289:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851867.717290:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ab51
00000020:00000001:1.0:1773851867.717290:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851867.717292:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000187322e6 refcount=125617
00000020:00000001:1.0:1773851867.717293:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000020:00000001:1.0:1773851867.717294:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000100:00000001:1.0:1773851867.717296:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.717297:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851867.717298:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5405d62.
00000020:00000010:1.0:1773851867.717299:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.717300:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee53e016.
00000100:00000001:1.0:1773851867.717301:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851867.717302:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851867.717302:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.717305:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851867.717305:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851867.717306:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.717307:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.717309:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851867.717310:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851867.717310:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.717311:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851867.717312:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.39@o2ib60, seq: 1997561
00000100:00000040:1.0:1773851867.717313:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000187322e6 : new rpc_count 9
00000100:00000001:0.0:1773851867.717313:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.717314:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534656128 : -106946174895488 : ffff9ebba73c3a80)
00000100:00000001:0.0:1773851867.717314:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.717316:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000013e379e x1859420436194944/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix39-0'
00000100:00000001:1.0:1773851867.717321:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.717322:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851867.717323:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000013e379e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40569:x1859420436194944:12345-192.168.128.39@o2ib60:400:default-matrix39-0
00000100:00000200:1.0:1773851867.717326:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859420436194944
00000020:00000001:1.0:1773851867.717327:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851867.717328:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851867.717334:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.717335:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851867.717335:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851867.717336:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851867.717337:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859420436194944, found 0 last_xid 1859420408095423
00000020:00000001:1.0:1773851867.717338:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851867.717339:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851867.717340:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851867.717340:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.717342:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851867.717342:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851867.717343:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851867.717345:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009ac6cfe6.
02000000:00000001:1.0:1773851867.717346:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.717347:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.717348:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851867.717350:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593807, transno 0, xid 1859420436194944
00010000:00000001:1.0:1773851867.717351:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851867.717352:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000013e379e x1859420436194944/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00010000:00000001:1.0:1773851867.717357:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851867.717357:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851867.717358:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851867.717360:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851867.717361:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b587bdf refcount 3 to 192.168.128.39@o2ib60
00000100:00000001:1.0:1773851867.717362:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441792 : -107146751109824 : ffff9e8cf3f61540)
02000000:00000001:1.0:1773851867.717364:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851867.717364:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.717365:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851867.717367:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.39@o2ib60
00000400:00000010:1.0:1773851867.717368:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c993eaa.
00000100:00000200:1.0:1773851867.717369:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859420436194944, offset 224
00000400:00000200:1.0:1773851867.717372:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.39@o2ib60
00000400:00000200:1.0:1773851867.717374:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:1.0:1773851867.717376:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:1.0:1773851867.717378:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:1.0:1773851867.717380:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 4
00000400:00000200:1.0:1773851867.717382:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.39@o2ib60 routed destination
00000400:00000200:1.0:1773851867.717384:0:42868:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:1.0:1773851867.717386:0:42868:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:1.0:1773851867.717388:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851867.717390:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:1.0:1773851867.717392:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851867.717394:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:1.0:1773851867.717396:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769232:8769232:1024:4294967295] 2094@kfi7 LPNI seq info [1258746990:1258746990:16:4294967295]
00000400:00000200:1.0:1773851867.717398:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:1.0:1773851867.717400:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:1.0:1773851867.717405:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.39@o2ib60(192.168.128.39@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851867.717407:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000800:00000200:1.0:1773851867.717409:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.717411:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851867.717415:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851867.717419:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:1.0:1773851867.717423:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:1.0:1773851867.717425:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851867.717428:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851867.717430:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b587bdf refcount 2 to 192.168.128.39@o2ib60
00010000:00000001:1.0:1773851867.717431:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851867.717432:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851867.717433:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851867.717434:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000013e379e x1859420436194944/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00000100:00100000:1.0:1773851867.717440:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000013e379e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40569:x1859420436194944:12345-192.168.128.39@o2ib60:400:default-matrix39-0 Request processed in 118us (163us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851867.717441:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851867.717444:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851867.717444:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.39@o2ib60, seq: 1997561
00000400:00000200:2.0:1773851867.717446:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000040:1.0:1773851867.717446:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000187322e6 : new rpc_count 8
00000400:00000200:2.0:1773851867.717447:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c993eaa
00000100:00000001:1.0:1773851867.717447:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851867.717447:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:2.0:1773851867.717448:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c993eaa.
00000020:00000010:1.0:1773851867.717448:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.717449:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee53e016.
00000100:00000001:2.0:1773851867.717450:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851867.717451:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851867.717451:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5405d62.
00000400:00000200:2.0:1773851867.717452:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000040:1.0:1773851867.717452:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000187322e6 : new refcount 125616
00000100:00000001:1.0:1773851867.717453:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851867.717455:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Transaction freed
00000800:00000200:21.0:1773851867.741487:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851867.741488:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851867.741490:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851867.741492:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851867.741494:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9155@kfi7 to cpt 5
00000400:00000200:21.0:1773851867.741495:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9155@kfi7 : PUT - for me
00000400:00000200:21.0:1773851867.741496:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9155@kfi7 to cpt 5
00000400:00000200:21.0:1773851867.741498:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 1
00000400:00000200:21.0:1773851867.741499:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9155@kfi7 to cpt 5
00000400:00000200:21.0:1773851867.741500:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 2
00000400:00000200:21.0:1773851867.741501:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 3
00000400:00000200:21.0:1773851867.741502:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8963@kfi7 to cpt 2
00000400:00000200:21.0:1773851867.741503:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8963@kfi7 of length 224 into portal 12 MB=0x699e14de93c40
00000400:00000200:21.0:1773851867.741504:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8963@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 35944
00000800:00000200:21.0:1773851867.741506:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851867.741507:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851867.741508:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9155@kfi7: PUT: OK
00000100:00000001:21.0:1773851867.741509:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851867.741510:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851867.741511:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d75e205f.
00000100:00000040:21.0:1773851867.741512:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000d75e205f x1858042814086208 msgsize 224
00000100:00100000:21.0:1773851867.741513:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-8963@kfi7 (source: 12345-9155@kfi7)
00000100:00000001:21.0:1773851867.741514:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851867.741515:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 2
00000100:00000001:22.0:1773851867.741516:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851867.741516:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851867.741518:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851867.741518:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851867.741519:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851867.741520:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851867.741521:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042814086208
00000020:00000001:22.0:1773851867.741522:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851867.741522:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914c2
00000020:00000001:22.0:1773851867.741523:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851867.741526:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000005da16b refcount=12
00000020:00000001:22.0:1773851867.741527:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240786944 : -107152468764672 : ffff9e8b9f299800)
00000020:00000001:22.0:1773851867.741528:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240786944 : -107152468764672 : ffff9e8b9f299800)
00000100:00000001:22.0:1773851867.741529:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851867.741530:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851867.741531:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000020:00000010:22.0:1773851867.741532:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851867.741534:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851867.741534:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851867.741535:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851867.741536:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851867.741537:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851867.741537:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851867.741538:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.741539:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851867.741541:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851867.741541:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851867.741541:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851867.741541:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851867.741542:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8963@kfi7, seq: 1997976
00000100:00000001:23.0:1773851867.741543:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851867.741543:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000005da16b : new rpc_count 1
00000100:00000001:23.0:1773851867.741544:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.741544:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637111840022400 : -106961869529216 : ffff9eb7ffc31f80)
00000100:00000040:22.0:1773851867.741545:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d75e205f x1858042814086208/t0(0) o400->32507075-ff67-4e13-9114-c60254a00727@8963@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1063-0'
00000100:00000001:22.0:1773851867.741548:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851867.741549:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851867.741550:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d75e205f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:32507075-ff67-4e13-9114-c60254a00727+12:39856:x1858042814086208:12345-8963@kfi7:400:default-tuolumne1063-0
00000100:00000200:22.0:1773851867.741551:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042814086208
00000020:00000001:22.0:1773851867.741552:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851867.741553:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851867.741554:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.741554:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851867.741555:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851867.741556:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851867.741557:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042814086208, found 0 last_xid 1858042814086207
00000020:00000001:22.0:1773851867.741558:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851867.741559:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851867.741559:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851867.741560:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.741561:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851867.741561:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851867.741562:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851867.741563:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000064c8bac5.
02000000:00000001:22.0:1773851867.741563:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.741564:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.741565:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851867.741565:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183084855564, transno 0, xid 1858042814086208
00010000:00000001:22.0:1773851867.741566:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851867.741567:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d75e205f x1858042814086208/t0(0) o400->32507075-ff67-4e13-9114-c60254a00727@8963@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1063-0'
00010000:00000001:22.0:1773851867.741570:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851867.741570:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851867.741571:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=100 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851867.741572:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851867.741573:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ea0deb4 refcount 3 to 8963@kfi7
00000100:00000001:22.0:1773851867.741573:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579296 : -107154806972320 : ffff9e8b13cb6060)
02000000:00000001:22.0:1773851867.741574:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851867.741575:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.741575:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851867.741576:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9155@kfi7
00000400:00000010:22.0:1773851867.741577:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a20de60f.
00000100:00000200:22.0:1773851867.741578:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042814086208, offset 224
00000400:00000200:22.0:1773851867.741580:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9155@kfi7
00000400:00000200:22.0:1773851867.741581:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9155@kfi7 to cpt 5
00000400:00000200:22.0:1773851867.741582:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 1
00000400:00000200:22.0:1773851867.741583:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 2
00000400:00000200:22.0:1773851867.741584:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 3
00000400:00000200:22.0:1773851867.741586:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9155@kfi7 local destination
00000400:00000200:22.0:1773851867.741587:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769233:8769233:1024:4294967295] 9155@kfi7 LPNI seq info [1976286:1976286:16:4294967295]
00000400:00000200:22.0:1773851867.741589:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 2
00000400:00000200:22.0:1773851867.741589:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9155@kfi7 to cpt 5
00000400:00000200:22.0:1773851867.741591:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9155@kfi7(9155@kfi7:9155@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851867.741592:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 3
00000800:00000200:22.0:1773851867.741594:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851867.741595:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851867.741598:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851867.741600:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2d6 Using peer 9155@kfi7(0x2d6)
00000800:00000200:22.0:1773851867.741603:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 324 bytes to peer 0x2d6: rc=0
00000800:00000200:22.0:1773851867.741605:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851867.741607:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851867.741608:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ea0deb4 refcount 2 to 8963@kfi7
00010000:00000001:22.0:1773851867.741608:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851867.741609:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.741609:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851867.741610:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d75e205f x1858042814086208/t0(0) o400->32507075-ff67-4e13-9114-c60254a00727@8963@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1063-0'
00000100:00100000:22.0:1773851867.741613:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d75e205f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:32507075-ff67-4e13-9114-c60254a00727+12:39856:x1858042814086208:12345-8963@kfi7:400:default-tuolumne1063-0 Request processed in 64us (100us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851867.741615:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8963@kfi7, seq: 1997976
00000100:00000040:22.0:1773851867.741616:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000005da16b : new rpc_count 0
00000100:00000001:22.0:1773851867.741617:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851867.741617:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851867.741617:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2d6 TN_EVENT_TX_OK event status 0
00000020:00000010:22.0:1773851867.741618:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851867.741618:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851867.741619:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851867.741619:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000400:00000200:21.0:1773851867.741619:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9155@kfi7: PUT: OK
00000020:00000040:22.0:1773851867.741620:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000005da16b : new refcount 11
00000400:00000200:21.0:1773851867.741620:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a20de60f
00000100:00000001:22.0:1773851867.741621:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:21.0:1773851867.741621:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a20de60f.
00000100:00000001:21.0:1773851867.741621:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851867.741622:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851867.741623:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7dc08e4 nid 9155@kfi7 refs 2
00000800:00000200:21.0:1773851867.741624:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 9155@kfi7(0000000087478859):0x0 lsk 727 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2d6 Transaction freed
00000800:00000200:1.0:1773851867.749585:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.749586:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851867.749588:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851867.749592:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851867.749595:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23008@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.749597:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23008@kfi7 : PUT - for me
00000400:00000200:1.0:1773851867.749599:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23008@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.749600:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002861dc20 nid 23008@kfi7 refs 1
00000400:00000200:1.0:1773851867.749602:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23008@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.749603:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002861dc20 nid 23008@kfi7 refs 2
00000400:00000200:1.0:1773851867.749605:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002861dc20 nid 23008@kfi7 refs 3
00000400:00000200:1.0:1773851867.749606:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22816@kfi7 to cpt 5
00000400:00000200:1.0:1773851867.749608:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22816@kfi7 of length 224 into portal 12 MB=0x69b0a456e60c0
00000400:00000200:1.0:1773851867.749610:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22816@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 29840
00000800:00000200:1.0:1773851867.749614:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851867.749617:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851867.749619:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23008@kfi7: PUT: OK
00000100:00000001:1.0:1773851867.749621:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851867.749621:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851867.749623:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000beacdd39.
00000100:00000040:1.0:1773851867.749624:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000beacdd39 x1859318277103808 msgsize 224
00000100:00100000:1.0:1773851867.749627:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22816@kfi7 (source: 12345-23008@kfi7)
00000100:00000001:1.0:1773851867.749629:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851867.749631:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002861dc20 nid 23008@kfi7 refs 2
00000800:00000200:1.0:1773851867.749633:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851867.749638:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851867.749639:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851867.749640:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851867.749641:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851867.749642:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851867.749643:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318277103808
00000020:00000001:1.0:1773851867.749644:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851867.749645:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac928aa
00000020:00000001:1.0:1773851867.749646:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851867.749649:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000db304e25 refcount=6
00000020:00000001:1.0:1773851867.749650:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742946816 : -107128966604800 : ffff9e9118001800)
00000020:00000001:1.0:1773851867.749651:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742946816 : -107128966604800 : ffff9e9118001800)
00000100:00000001:1.0:1773851867.749653:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851867.749654:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851867.749655:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000969e5849.
00000020:00000010:1.0:1773851867.749657:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851867.749658:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee53e016.
00000100:00000001:1.0:1773851867.749659:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851867.749660:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851867.749661:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.749662:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851867.749663:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851867.749664:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851867.749665:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.749667:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.749667:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.749667:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851867.749668:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851867.749669:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22816@kfi7, seq: 1997562
00000100:00000040:0.0:1773851867.749669:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000db304e25 : new rpc_count 1
00000100:00000001:1.0:1773851867.749670:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.749670:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599716864 : -107004109834752 : ffff9eae2a0b3600)
00000100:00000001:1.0:1773851867.749671:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.749671:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000beacdd39 x1859318277103808/t0(0) o400->08c87af9-0926-4e9e-9419-b425e885de0f@22816@kfi7:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1919-0'
00000100:00000001:0.0:1773851867.749677:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851867.749677:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851867.749678:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000beacdd39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:08c87af9-0926-4e9e-9419-b425e885de0f+6:39497:x1859318277103808:12345-22816@kfi7:400:default-tuolumne1919-0
00000100:00000200:0.0:1773851867.749680:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318277103808
00000020:00000001:0.0:1773851867.749681:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851867.749681:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851867.749682:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.749683:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851867.749683:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851867.749684:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851867.749685:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318277103808, found 0 last_xid 1859318277103807
00000020:00000001:0.0:1773851867.749686:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851867.749687:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851867.749687:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851867.749688:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.749689:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851867.749689:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851867.749690:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851867.749690:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000513fa2ef.
02000000:00000001:0.0:1773851867.749691:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.749692:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.749693:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851867.749693:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181510849123, transno 0, xid 1859318277103808
00010000:00000001:0.0:1773851867.749694:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851867.749695:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000beacdd39 x1859318277103808/t0(0) o400->08c87af9-0926-4e9e-9419-b425e885de0f@22816@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1919-0'
00010000:00000001:0.0:1773851867.749697:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851867.749698:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851867.749699:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851867.749700:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851867.749701:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a7045781 refcount 3 to 22816@kfi7
00000100:00000001:0.0:1773851867.749702:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107360 : -107156354444256 : ffff9e8ab78ed420)
02000000:00000001:0.0:1773851867.749703:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851867.749704:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.749704:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851867.749705:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23008@kfi7
00000400:00000010:0.0:1773851867.749706:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ccec3e81.
00000100:00000200:0.0:1773851867.749706:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318277103808, offset 224
00000400:00000200:0.0:1773851867.749708:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23008@kfi7
00000400:00000200:0.0:1773851867.749709:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23008@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.749710:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002861dc20 nid 23008@kfi7 refs 1
00000400:00000200:0.0:1773851867.749711:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002861dc20 nid 23008@kfi7 refs 2
00000400:00000200:0.0:1773851867.749712:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002861dc20 nid 23008@kfi7 refs 3
00000400:00000200:0.0:1773851867.749713:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23008@kfi7 local destination
00000400:00000200:0.0:1773851867.749714:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769234:8769234:1024:4294967295] 23008@kfi7 LPNI seq info [9064737:9064737:16:4294967295]
00000400:00000200:0.0:1773851867.749716:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002861dc20 nid 23008@kfi7 refs 2
00000400:00000200:0.0:1773851867.749716:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23008@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.749718:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23008@kfi7(23008@kfi7:23008@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851867.749720:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002861dc20 nid 23008@kfi7 refs 3
00000800:00000200:0.0:1773851867.749721:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851867.749722:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851867.749727:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851867.749730:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f8b Using peer 23008@kfi7(0x100000000000f8b)
00000800:00000200:0.0:1773851867.749733:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x100000000000f8b: rc=0
00000800:00000200:0.0:1773851867.749734:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f8b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851867.749736:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.749737:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a7045781 refcount 2 to 22816@kfi7
00010000:00000001:0.0:1773851867.749738:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851867.749750:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.749751:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851867.749752:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000beacdd39 x1859318277103808/t0(0) o400->08c87af9-0926-4e9e-9419-b425e885de0f@22816@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1919-0'
00000100:00100000:0.0:1773851867.749755:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000beacdd39 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:08c87af9-0926-4e9e-9419-b425e885de0f+6:39497:x1859318277103808:12345-22816@kfi7:400:default-tuolumne1919-0 Request processed in 77us (130us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851867.749758:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22816@kfi7, seq: 1997562
00000100:00000040:0.0:1773851867.749758:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000db304e25 : new rpc_count 0
00000100:00000001:0.0:1773851867.749759:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851867.749760:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851867.749760:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:0.0:1773851867.749761:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee53e016.
00000020:00000010:0.0:1773851867.749762:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000969e5849.
00000020:00000040:0.0:1773851867.749763:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000db304e25 : new refcount 5
00000100:00000001:0.0:1773851867.749764:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851867.749771:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f8b TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851867.749776:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851867.749777:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23008@kfi7: PUT: OK
00000400:00000200:2.0:1773851867.749779:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ccec3e81
00000400:00000010:2.0:1773851867.749779:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ccec3e81.
00000100:00000001:2.0:1773851867.749781:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851867.749781:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851867.749783:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002861dc20 nid 23008@kfi7 refs 2
00000800:00000200:2.0:1773851867.749785:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 23008@kfi7(000000000123bdab):0x0 lsk 3980 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f8b Transaction freed
00000800:00000200:14.0:1773851867.752963:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851867.752964:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851867.752965:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851867.752967:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851867.752969:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12736@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.752971:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12736@kfi7 : PUT - for me
00000400:00000200:14.0:1773851867.752972:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12736@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.752972:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0f6d901 nid 12736@kfi7 refs 1
00000400:00000200:14.0:1773851867.752973:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12736@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.752974:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0f6d901 nid 12736@kfi7 refs 2
00000400:00000200:14.0:1773851867.752975:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b0f6d901 nid 12736@kfi7 refs 3
00000400:00000200:14.0:1773851867.752975:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12736@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.752976:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12736@kfi7 of length 224 into portal 12 MB=0x69b0a1f764140
00000400:00000200:14.0:1773851867.752978:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12736@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 28680
00000800:00000200:14.0:1773851867.752979:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851867.752981:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851867.752982:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12736@kfi7: PUT: OK
00000100:00000001:14.0:1773851867.752983:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851867.752984:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851867.752985:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b52938ed.
00000100:00000040:14.0:1773851867.752985:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000b52938ed x1859317640085824 msgsize 224
00000100:00100000:14.0:1773851867.752987:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-12736@kfi7 (source: 12345-12736@kfi7)
00000100:00000001:14.0:1773851867.752988:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851867.752989:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0f6d901 nid 12736@kfi7 refs 2
00000800:00000200:14.0:1773851867.752990:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851867.752991:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851867.752992:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851867.752993:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851867.752993:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851867.752995:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851867.752996:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317640085824
00000020:00000001:13.0:1773851867.752997:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851867.752998:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917c4
00000020:00000001:13.0:1773851867.752999:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851867.753001:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8688a53 refcount=6
00000020:00000001:13.0:1773851867.753002:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241754624 : -107152467796992 : ffff9e8b9f385c00)
00000020:00000001:13.0:1773851867.753004:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241754624 : -107152467796992 : ffff9e8b9f385c00)
00000100:00000001:13.0:1773851867.753005:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851867.753006:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851867.753007:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000010:13.0:1773851867.753009:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851867.753010:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e27c9b87.
00000100:00000001:13.0:1773851867.753012:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851867.753013:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851867.753014:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851867.753015:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:13.0:1773851867.753016:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:13.0:1773851867.753017:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851867.753018:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851867.753019:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.753020:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851867.753020:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851867.753021:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12736@kfi7, seq: 2289834
00000100:00000001:13.0:1773851867.753021:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851867.753022:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8688a53 : new rpc_count 1
00000100:00000001:13.0:1773851867.753022:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.753023:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341826816 : -106946367724800 : ffff9ebb9bbde300)
00000100:00000001:13.0:1773851867.753023:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851867.753025:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b52938ed x1859317640085824/t0(0) o400->dd2600fb-5551-43be-824d-f69f62b73489@12736@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1283-0'
00000100:00000001:15.0:1773851867.753031:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851867.753031:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851867.753032:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b52938ed pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:dd2600fb-5551-43be-824d-f69f62b73489+6:39563:x1859317640085824:12345-12736@kfi7:400:default-tuolumne1283-0
00000100:00000200:15.0:1773851867.753034:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317640085824
00000020:00000001:15.0:1773851867.753034:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851867.753035:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851867.753036:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851867.753036:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851867.753037:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851867.753038:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851867.753038:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317640085824, found 0 last_xid 1859317640085823
00000020:00000001:15.0:1773851867.753039:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851867.753040:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851867.753040:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851867.753041:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851867.753042:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851867.753042:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851867.753043:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851867.753044:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000015c4406c.
02000000:00000001:15.0:1773851867.753045:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.753045:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851867.753046:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851867.753047:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695243, transno 0, xid 1859317640085824
00010000:00000001:15.0:1773851867.753048:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851867.753049:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b52938ed x1859317640085824/t0(0) o400->dd2600fb-5551-43be-824d-f69f62b73489@12736@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1283-0'
00010000:00000001:15.0:1773851867.753051:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851867.753052:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851867.753053:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851867.753054:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851867.753055:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000005bcdea2 refcount 3 to 12736@kfi7
00000100:00000001:15.0:1773851867.753055:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902777440 : -107154806774176 : ffff9e8b13ce6660)
02000000:00000001:15.0:1773851867.753057:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851867.753058:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.753058:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851867.753059:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12736@kfi7
00000400:00000010:15.0:1773851867.753060:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008af5e37b.
00000800:00000200:1.0:1773851867.753060:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000200:15.0:1773851867.753061:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317640085824, offset 224
00000800:00000200:1.0:1773851867.753061:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:15.0:1773851867.753062:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12736@kfi7
00000400:00000200:15.0:1773851867.753063:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12736@kfi7 to cpt 3
00000800:00000200:1.0:1773851867.753063:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851867.753064:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0f6d901 nid 12736@kfi7 refs 1
00000400:00000200:15.0:1773851867.753065:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b0f6d901 nid 12736@kfi7 refs 2
00000400:00000200:15.0:1773851867.753067:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b0f6d901 nid 12736@kfi7 refs 3
00000800:00000200:1.0:1773851867.753067:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851867.753068:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12736@kfi7 local destination
00000400:00000200:15.0:1773851867.753070:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769235:8769235:1024:4294967295] 12736@kfi7 LPNI seq info [7712766:7712766:16:4294967295]
00000400:00000200:1.0:1773851867.753070:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20979@kfi7 to cpt 0
00000400:00000200:15.0:1773851867.753071:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b0f6d901 nid 12736@kfi7 refs 2
00000400:00000200:15.0:1773851867.753072:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12736@kfi7 to cpt 3
00000400:00000200:1.0:1773851867.753072:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20979@kfi7 : PUT - for me
00000400:00000200:1.0:1773851867.753074:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20979@kfi7 to cpt 0
00000400:00000200:15.0:1773851867.753075:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12736@kfi7(12736@kfi7:12736@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851867.753076:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b0f6d901 nid 12736@kfi7 refs 3
00000400:00000200:1.0:1773851867.753076:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cf7c0ce nid 20979@kfi7 refs 1
00000800:00000200:15.0:1773851867.753077:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:1.0:1773851867.753078:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20979@kfi7 to cpt 0
00000800:00000200:15.0:1773851867.753079:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:1.0:1773851867.753079:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cf7c0ce nid 20979@kfi7 refs 2
00000800:00000200:15.0:1773851867.753081:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:1.0:1773851867.753081:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006cf7c0ce nid 20979@kfi7 refs 3
00000400:00000200:1.0:1773851867.753082:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20978@kfi7 to cpt 5
00000800:00000200:15.0:1773851867.753084:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000601 Using peer 12736@kfi7(0x100000000000601)
00000400:00000200:1.0:1773851867.753084:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20978@kfi7 of length 224 into portal 12 MB=0x699e10f17c240
00000400:00000200:1.0:1773851867.753086:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20978@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 30064
00000800:00000200:15.0:1773851867.753087:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x100000000000601: rc=0
00000800:00000200:15.0:1773851867.753089:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000601 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:1.0:1773851867.753089:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:15.0:1773851867.753091:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851867.753092:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000005bcdea2 refcount 2 to 12736@kfi7
00000400:00000200:1.0:1773851867.753092:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:15.0:1773851867.753093:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851867.753094:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851867.753094:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20979@kfi7: PUT: OK
00000020:00000001:15.0:1773851867.753095:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851867.753096:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b52938ed x1859317640085824/t0(0) o400->dd2600fb-5551-43be-824d-f69f62b73489@12736@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1283-0'
00000100:00000001:1.0:1773851867.753096:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851867.753096:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851867.753097:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bd26249a.
00000100:00100000:15.0:1773851867.753099:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b52938ed pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:dd2600fb-5551-43be-824d-f69f62b73489+6:39563:x1859317640085824:12345-12736@kfi7:400:default-tuolumne1283-0 Request processed in 67us (112us total) trans 0 rc 0/0
00000100:00000040:1.0:1773851867.753099:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000bd26249a x1858041760170560 msgsize 224
00000800:00000200:14.0:1773851867.753101:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000601 TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851867.753101:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-20978@kfi7 (source: 12345-20979@kfi7)
00000100:00100000:15.0:1773851867.753102:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12736@kfi7, seq: 2289834
00000100:00000040:15.0:1773851867.753103:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8688a53 : new rpc_count 0
00000400:00000200:14.0:1773851867.753103:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851867.753103:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851867.753104:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851867.753104:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851867.753104:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12736@kfi7: PUT: OK
00000400:00000200:1.0:1773851867.753104:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006cf7c0ce nid 20979@kfi7 refs 2
00000020:00000010:15.0:1773851867.753105:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:14.0:1773851867.753105:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008af5e37b
00000400:00000010:14.0:1773851867.753105:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008af5e37b.
00000100:00000001:0.0:1773851867.753105:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851867.753105:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:15.0:1773851867.753106:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e27c9b87.
00000100:00000001:14.0:1773851867.753106:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000800:00000200:1.0:1773851867.753106:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851867.753106:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851867.753106:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:15.0:1773851867.753107:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000040:15.0:1773851867.753107:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000c8688a53 : new refcount 5
00000100:00000001:14.0:1773851867.753107:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
02000000:00000001:0.0:1773851867.753107:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.753108:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851867.753108:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0f6d901 nid 12736@kfi7 refs 2
00000100:00100000:0.0:1773851867.753108:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041760170560
00000020:00000001:0.0:1773851867.753108:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:14.0:1773851867.753109:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 12736@kfi7(0000000005c68bea):0x0 lsk 1538 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000601 Transaction freed
00000020:00000040:0.0:1773851867.753109:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92729
00000020:00000001:0.0:1773851867.753109:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851867.753110:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000017bee51d refcount=6
00000020:00000001:0.0:1773851867.753111:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631282688 : -107123078268928 : ffff9e9276f8f800)
00000020:00000001:0.0:1773851867.753112:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631282688 : -107123078268928 : ffff9e9276f8f800)
00000100:00000001:0.0:1773851867.753113:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851867.753113:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851867.753114:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eccd9a8a.
00000020:00000010:0.0:1773851867.753115:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851867.753116:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851867.753117:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851867.753118:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851867.753119:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851867.753120:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851867.753120:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851867.753121:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.753121:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851867.753123:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.753123:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851867.753124:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851867.753124:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20978@kfi7, seq: 1997563
00000100:00000001:1.0:1773851867.753125:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851867.753125:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.753125:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000017bee51d : new rpc_count 1
00000100:00000001:1.0:1773851867.753126:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.753126:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599721472 : -107004109830144 : ffff9eae2a0b4800)
00000100:00000040:0.0:1773851867.753127:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bd26249a x1858041760170560/t0(0) o400->3efd093d-3fd3-4445-b5ac-c75c3356ad90@20978@kfi7:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1785-0'
00000100:00000001:0.0:1773851867.753129:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851867.753130:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851867.753131:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd26249a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3efd093d-3fd3-4445-b5ac-c75c3356ad90+6:39685:x1858041760170560:12345-20978@kfi7:400:default-tuolumne1785-0
00000100:00000200:0.0:1773851867.753132:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041760170560
00000020:00000001:0.0:1773851867.753133:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851867.753133:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851867.753134:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.753134:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851867.753135:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851867.753136:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851867.753136:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041760170560, found 0 last_xid 1858041760170559
00000020:00000001:0.0:1773851867.753137:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851867.753138:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851867.753138:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851867.753138:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.753139:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851867.753140:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851867.753140:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851867.753141:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000059f68ed8.
02000000:00000001:0.0:1773851867.753141:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.753142:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.753143:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851867.753144:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181926779213, transno 0, xid 1858041760170560
00010000:00000001:0.0:1773851867.753144:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851867.753145:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bd26249a x1858041760170560/t0(0) o400->3efd093d-3fd3-4445-b5ac-c75c3356ad90@20978@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1785-0'
00010000:00000001:0.0:1773851867.753148:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851867.753148:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851867.753149:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851867.753150:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851867.753150:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004df6ad60 refcount 3 to 20978@kfi7
00000100:00000001:0.0:1773851867.753151:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027872 : -107156745523744 : ffff9e8aa03f6de0)
02000000:00000001:0.0:1773851867.753152:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851867.753152:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.753153:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851867.753154:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20979@kfi7
00000400:00000010:0.0:1773851867.753155:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007a35718f.
00000100:00000200:0.0:1773851867.753155:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041760170560, offset 224
00000400:00000200:0.0:1773851867.753157:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20979@kfi7
00000400:00000200:0.0:1773851867.753158:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20979@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.753159:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cf7c0ce nid 20979@kfi7 refs 1
00000400:00000200:0.0:1773851867.753160:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006cf7c0ce nid 20979@kfi7 refs 2
00000400:00000200:0.0:1773851867.753161:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006cf7c0ce nid 20979@kfi7 refs 3
00000400:00000200:0.0:1773851867.753162:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20979@kfi7 local destination
00000400:00000200:0.0:1773851867.753163:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769236:8769236:1024:4294967295] 20979@kfi7 LPNI seq info [469438:469438:16:4294967295]
00000400:00000200:0.0:1773851867.753165:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006cf7c0ce nid 20979@kfi7 refs 2
00000400:00000200:0.0:1773851867.753165:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20979@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.753167:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20979@kfi7(20979@kfi7:20979@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851867.753168:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006cf7c0ce nid 20979@kfi7 refs 3
00000800:00000200:0.0:1773851867.753170:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851867.753171:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851867.753177:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851867.753179:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001130 Using peer 20979@kfi7(0x100000000001130)
00000800:00000200:0.0:1773851867.753182:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x100000000001130: rc=0
00000800:00000200:0.0:1773851867.753183:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001130 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851867.753185:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.753186:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004df6ad60 refcount 2 to 20978@kfi7
00010000:00000001:0.0:1773851867.753187:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851867.753187:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.753188:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851867.753189:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bd26249a x1858041760170560/t0(0) o400->3efd093d-3fd3-4445-b5ac-c75c3356ad90@20978@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1785-0'
00000100:00100000:0.0:1773851867.753194:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd26249a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3efd093d-3fd3-4445-b5ac-c75c3356ad90+6:39685:x1858041760170560:12345-20978@kfi7:400:default-tuolumne1785-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851867.753196:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20978@kfi7, seq: 1997563
00000100:00000040:0.0:1773851867.753197:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000017bee51d : new rpc_count 0
00000100:00000001:0.0:1773851867.753197:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851867.753198:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851867.753199:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851867.753199:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851867.753200:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eccd9a8a.
00000020:00000040:0.0:1773851867.753201:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000017bee51d : new refcount 5
00000100:00000001:0.0:1773851867.753201:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851867.753208:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001130 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851867.753211:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851867.753212:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20979@kfi7: PUT: OK
00000400:00000200:1.0:1773851867.753214:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007a35718f
00000400:00000010:1.0:1773851867.753215:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007a35718f.
00000100:00000001:1.0:1773851867.753216:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851867.753217:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851867.753219:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006cf7c0ce nid 20979@kfi7 refs 2
00000800:00000200:1.0:1773851867.753222:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 20979@kfi7(000000003f7c1b18):0x0 lsk 4401 rsk 56 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001130 Transaction freed
00000800:00000200:21.0:1773851867.758275:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851867.758276:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851867.758278:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851867.758280:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851867.758282:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14480@kfi7 to cpt 5
00000400:00000200:21.0:1773851867.758283:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14480@kfi7 : PUT - for me
00000400:00000200:21.0:1773851867.758284:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14480@kfi7 to cpt 5
00000400:00000200:21.0:1773851867.758285:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d9a144c2 nid 14480@kfi7 refs 1
00000400:00000200:21.0:1773851867.758286:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14480@kfi7 to cpt 5
00000400:00000200:21.0:1773851867.758287:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d9a144c2 nid 14480@kfi7 refs 2
00000400:00000200:21.0:1773851867.758288:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d9a144c2 nid 14480@kfi7 refs 3
00000400:00000200:21.0:1773851867.758289:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14416@kfi7 to cpt 1
00000400:00000200:21.0:1773851867.758290:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14416@kfi7 of length 224 into portal 12 MB=0x69b4b99017040
00000400:00000200:21.0:1773851867.758291:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14416@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 36168
00000800:00000200:21.0:1773851867.758292:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851867.758294:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851867.758295:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14480@kfi7: PUT: OK
00000100:00000001:21.0:1773851867.758296:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851867.758296:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851867.758299:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e4c7ab09.
00000100:00000040:21.0:1773851867.758300:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e4c7ab09 x1859598852124736 msgsize 224
00000100:00100000:21.0:1773851867.758301:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14416@kfi7 (source: 12345-14480@kfi7)
00000100:00000001:21.0:1773851867.758302:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851867.758303:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d9a144c2 nid 14480@kfi7 refs 2
00000100:00000001:22.0:1773851867.758304:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851867.758304:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851867.758304:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851867.758305:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851867.758305:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851867.758306:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851867.758307:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598852124736
00000020:00000001:22.0:1773851867.758307:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851867.758308:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389274d9
00000020:00000001:22.0:1773851867.758308:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851867.758311:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000af15ad0 refcount=5
00000020:00000001:22.0:1773851867.758312:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130178666496 : -106943530885120 : ffff9ebc44d4a000)
00000020:00000001:22.0:1773851867.758312:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130178666496 : -106943530885120 : ffff9ebc44d4a000)
00000100:00000001:22.0:1773851867.758313:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851867.758314:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851867.758314:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000020:00000010:22.0:1773851867.758316:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851867.758316:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851867.758317:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851867.758318:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851867.758318:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851867.758319:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851867.758319:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851867.758320:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.758321:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851867.758322:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851867.758322:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851867.758322:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851867.758323:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851867.758323:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14416@kfi7, seq: 1997977
00000100:00000001:23.0:1773851867.758324:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851867.758324:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000af15ad0 : new rpc_count 1
00000100:00000001:23.0:1773851867.758325:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.758325:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082732517888 : -106990977033728 : ffff9eb138d1da00)
00000100:00000040:22.0:1773851867.758326:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e4c7ab09 x1859598852124736/t0(0) o400->7ffff185-dc24-4f2d-b76d-cc468e1cb97b@14416@kfi7:594/0 lens 224/0 e 0 to 0 dl 1773851954 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1394-0'
00000100:00000001:22.0:1773851867.758328:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851867.758328:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851867.758329:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e4c7ab09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:7ffff185-dc24-4f2d-b76d-cc468e1cb97b+5:39550:x1859598852124736:12345-14416@kfi7:400:default-tuolumne1394-0
00000100:00000200:22.0:1773851867.758331:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598852124736
00000020:00000001:22.0:1773851867.758331:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851867.758332:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851867.758333:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.758333:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851867.758334:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851867.758335:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851867.758336:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598852124736, found 0 last_xid 1859598852124735
00000020:00000001:22.0:1773851867.758336:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851867.758337:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851867.758337:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851867.758338:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.758338:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851867.758339:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851867.758339:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851867.758340:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000048742a.
02000000:00000001:22.0:1773851867.758340:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.758341:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.758342:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851867.758342:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691410, transno 0, xid 1859598852124736
00010000:00000001:22.0:1773851867.758343:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851867.758344:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e4c7ab09 x1859598852124736/t0(0) o400->7ffff185-dc24-4f2d-b76d-cc468e1cb97b@14416@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1394-0'
00010000:00000001:22.0:1773851867.758346:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851867.758346:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851867.758347:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=100 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851867.758348:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851867.758349:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ceb9ff84 refcount 3 to 14416@kfi7
00000100:00000001:22.0:1773851867.758349:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410272 : -107145304141344 : ffff9e8d4a3511e0)
02000000:00000001:22.0:1773851867.758350:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851867.758350:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851867.758351:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851867.758352:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14480@kfi7
00000400:00000010:22.0:1773851867.758352:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034621184.
00000100:00000200:22.0:1773851867.758353:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598852124736, offset 224
00000400:00000200:22.0:1773851867.758354:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14480@kfi7
00000400:00000200:22.0:1773851867.758355:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14480@kfi7 to cpt 5
00000400:00000200:22.0:1773851867.758356:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d9a144c2 nid 14480@kfi7 refs 1
00000400:00000200:22.0:1773851867.758357:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d9a144c2 nid 14480@kfi7 refs 2
00000400:00000200:22.0:1773851867.758358:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d9a144c2 nid 14480@kfi7 refs 3
00000400:00000200:22.0:1773851867.758360:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14480@kfi7 local destination
00000400:00000200:22.0:1773851867.758361:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769237:8769237:1024:4294967295] 14480@kfi7 LPNI seq info [732239:732239:16:4294967295]
00000400:00000200:22.0:1773851867.758363:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d9a144c2 nid 14480@kfi7 refs 2
00000400:00000200:22.0:1773851867.758363:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14480@kfi7 to cpt 5
00000400:00000200:22.0:1773851867.758365:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14480@kfi7(14480@kfi7:14480@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851867.758367:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d9a144c2 nid 14480@kfi7 refs 3
00000800:00000200:22.0:1773851867.758368:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851867.758369:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851867.758371:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851867.758374:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa9 Using peer 14480@kfi7(0xa9)
00000800:00000200:22.0:1773851867.758377:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 324 bytes to peer 0xa9: rc=0
00000800:00000200:22.0:1773851867.758378:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851867.758380:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851867.758381:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ceb9ff84 refcount 2 to 14416@kfi7
00010000:00000001:22.0:1773851867.758382:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851867.758382:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851867.758383:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851867.758384:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e4c7ab09 x1859598852124736/t0(0) o400->7ffff185-dc24-4f2d-b76d-cc468e1cb97b@14416@kfi7:594/0 lens 224/224 e 0 to 0 dl 1773851954 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1394-0'
00000100:00100000:22.0:1773851867.758387:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e4c7ab09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:7ffff185-dc24-4f2d-b76d-cc468e1cb97b+5:39550:x1859598852124736:12345-14416@kfi7:400:default-tuolumne1394-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851867.758389:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14416@kfi7, seq: 1997977
00000100:00000040:22.0:1773851867.758390:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000af15ad0 : new rpc_count 0
00000800:00000200:21.0:1773851867.758390:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa9 TN_EVENT_TX_OK event status 0
00000100:00000001:22.0:1773851867.758391:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851867.758391:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851867.758392:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851867.758392:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851867.758393:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851867.758393:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14480@kfi7: PUT: OK
00000400:00000200:21.0:1773851867.758393:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034621184
00000020:00000010:22.0:1773851867.758394:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000020:00000040:22.0:1773851867.758395:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000000af15ad0 : new refcount 4
00000400:00000010:21.0:1773851867.758395:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034621184.
00000100:00000001:21.0:1773851867.758395:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851867.758396:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851867.758396:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851867.758397:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d9a144c2 nid 14480@kfi7 refs 2
00000800:00000200:21.0:1773851867.758398:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ea85a7d6: 2069@kfi7:5 -> 14480@kfi7(00000000bbaca4f3):0x0 lsk 170 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa9 Transaction freed
00000800:00000200:1.0:1773851867.846197:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851867.846198:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851867.846200:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851867.846202:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851867.846203:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21665@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.846205:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21665@kfi7 : PUT - for me
00000400:00000200:1.0:1773851867.846206:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21665@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.846206:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b653f225 nid 21665@kfi7 refs 1
00000400:00000200:1.0:1773851867.846207:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21665@kfi7 to cpt 0
00000400:00000200:1.0:1773851867.846208:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b653f225 nid 21665@kfi7 refs 2
00000400:00000200:1.0:1773851867.846209:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b653f225 nid 21665@kfi7 refs 3
00000400:00000200:1.0:1773851867.846209:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21664@kfi7 to cpt 5
00000400:00000200:1.0:1773851867.846210:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21664@kfi7 of length 224 into portal 12 MB=0x699e1873c4840
00000400:00000200:1.0:1773851867.846212:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21664@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 30288
00000800:00000200:1.0:1773851867.846213:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851867.846215:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851867.846216:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21665@kfi7: PUT: OK
00000100:00000001:1.0:1773851867.846216:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851867.846217:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851867.846218:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf8841d1.
00000100:00000040:1.0:1773851867.846218:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000cf8841d1 x1858043775830080 msgsize 224
00000100:00100000:1.0:1773851867.846220:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-21664@kfi7 (source: 12345-21665@kfi7)
00000100:00000001:1.0:1773851867.846221:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851867.846222:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b653f225 nid 21665@kfi7 refs 2
00000100:00000001:0.0:1773851867.846222:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851867.846223:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851867.846223:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851867.846223:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851867.846224:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851867.846224:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851867.846226:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043775830080
00000020:00000001:0.0:1773851867.846226:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851867.846227:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92880
00000020:00000001:0.0:1773851867.846227:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851867.846230:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008846d67f refcount=6
00000020:00000001:0.0:1773851867.846230:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742967296 : -107128966584320 : ffff9e9118006800)
00000020:00000001:0.0:1773851867.846231:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742967296 : -107128966584320 : ffff9e9118006800)
00000100:00000001:0.0:1773851867.846232:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851867.846233:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851867.846234:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eccd9a8a.
00000020:00000010:0.0:1773851867.846235:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851867.846236:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851867.846236:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851867.846237:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851867.846237:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851867.846238:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851867.846238:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851867.846239:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.846240:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.846241:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.846241:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.846241:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851867.846242:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851867.846242:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21664@kfi7, seq: 1997564
00000100:00000001:1.0:1773851867.846243:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.846243:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008846d67f : new rpc_count 1
00000100:00000001:1.0:1773851867.846244:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.846244:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599730688 : -107004109820928 : ffff9eae2a0b6c00)
00000100:00000040:0.0:1773851867.846245:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cf8841d1 x1858043775830080/t0(0) o400->2695499e-0e60-49c8-8f23-87d3e47a31e1@21664@kfi7:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1840-0'
00000100:00000001:0.0:1773851867.846248:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851867.846248:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851867.846249:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf8841d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2695499e-0e60-49c8-8f23-87d3e47a31e1+6:39855:x1858043775830080:12345-21664@kfi7:400:default-tuolumne1840-0
00000100:00000200:0.0:1773851867.846250:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043775830080
00000020:00000001:0.0:1773851867.846251:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851867.846252:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851867.846253:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.846254:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851867.846254:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851867.846255:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851867.846256:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043775830080, found 0 last_xid 1858043775830079
00000020:00000001:0.0:1773851867.846257:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851867.846258:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851867.846258:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851867.846259:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.846259:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851867.846260:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851867.846260:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851867.846261:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000010270708.
02000000:00000001:0.0:1773851867.846262:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.846262:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.846263:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851867.846264:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596633, transno 0, xid 1858043775830080
00010000:00000001:0.0:1773851867.846264:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851867.846265:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cf8841d1 x1858043775830080/t0(0) o400->2695499e-0e60-49c8-8f23-87d3e47a31e1@21664@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1840-0'
00010000:00000001:0.0:1773851867.846268:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851867.846268:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851867.846269:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851867.846270:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851867.846271:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000515b54a8 refcount 3 to 21664@kfi7
00000100:00000001:0.0:1773851867.846271:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424334752 : -107145285216864 : ffff9e8d4b55d5a0)
02000000:00000001:0.0:1773851867.846272:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851867.846273:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.846273:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851867.846274:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21665@kfi7
00000400:00000010:0.0:1773851867.846275:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028349810.
00000100:00000200:0.0:1773851867.846276:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043775830080, offset 224
00000400:00000200:0.0:1773851867.846277:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21665@kfi7
00000400:00000200:0.0:1773851867.846278:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21665@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.846278:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b653f225 nid 21665@kfi7 refs 1
00000400:00000200:0.0:1773851867.846280:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b653f225 nid 21665@kfi7 refs 2
00000400:00000200:0.0:1773851867.846281:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b653f225 nid 21665@kfi7 refs 3
00000400:00000200:0.0:1773851867.846282:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21665@kfi7 local destination
00000400:00000200:0.0:1773851867.846283:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769238:8769238:1024:4294967295] 21665@kfi7 LPNI seq info [2958682:2958682:16:4294967295]
00000400:00000200:0.0:1773851867.846285:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b653f225 nid 21665@kfi7 refs 2
00000400:00000200:0.0:1773851867.846285:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21665@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.846287:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21665@kfi7(21665@kfi7:21665@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851867.846288:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b653f225 nid 21665@kfi7 refs 3
00000800:00000200:0.0:1773851867.846290:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851867.846291:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851867.846293:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851867.846296:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6b Using peer 21665@kfi7(0xa6b)
00000800:00000200:0.0:1773851867.846299:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0xa6b: rc=0
00000800:00000200:0.0:1773851867.846300:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851867.846302:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.846303:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000515b54a8 refcount 2 to 21664@kfi7
00010000:00000001:0.0:1773851867.846304:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851867.846304:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.846305:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851867.846306:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cf8841d1 x1858043775830080/t0(0) o400->2695499e-0e60-49c8-8f23-87d3e47a31e1@21664@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1840-0'
00000100:00100000:0.0:1773851867.846310:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf8841d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2695499e-0e60-49c8-8f23-87d3e47a31e1+6:39855:x1858043775830080:12345-21664@kfi7:400:default-tuolumne1840-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851867.846312:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21664@kfi7, seq: 1997564
00000100:00000040:0.0:1773851867.846313:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008846d67f : new rpc_count 0
00000100:00000001:0.0:1773851867.846314:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851867.846315:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851867.846315:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851867.846316:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851867.846317:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eccd9a8a.
00000020:00000040:0.0:1773851867.846318:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000008846d67f : new refcount 5
00000100:00000001:0.0:1773851867.846318:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851867.846323:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6b TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851867.846325:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851867.846326:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21665@kfi7: PUT: OK
00000400:00000200:1.0:1773851867.846327:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028349810
00000400:00000010:1.0:1773851867.846327:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028349810.
00000100:00000001:1.0:1773851867.846328:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851867.846329:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851867.846329:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b653f225 nid 21665@kfi7 refs 2
00000800:00000200:1.0:1773851867.846331:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 21665@kfi7(00000000cd0e9daf):0x0 lsk 2668 rsk 54 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa6b Transaction freed
00000800:00000200:2.0:1773851867.921772:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851867.921772:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851867.921773:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851867.921775:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851867.921777:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.921778:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14586@kfi7 : PUT - for me
00000400:00000200:2.0:1773851867.921779:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.921780:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 1
00000400:00000200:2.0:1773851867.921781:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.921781:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:2.0:1773851867.921782:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000400:00000200:2.0:1773851867.921783:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:2.0:1773851867.921784:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14586@kfi7 of length 224 into portal 12 MB=0x699de8d2b3100
00000400:00000200:2.0:1773851867.921785:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14586@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 30512
00000800:00000200:2.0:1773851867.921787:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851867.921788:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851867.921789:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14586@kfi7: PUT: OK
00000100:00000001:2.0:1773851867.921790:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851867.921791:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851867.921792:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000002b9e613.
00000100:00000040:2.0:1773851867.921792:0:2506505:0:(events.c:358:request_in_callback()) incoming req@0000000002b9e613 x1858030990471424 msgsize 224
00000100:00100000:2.0:1773851867.921794:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-14586@kfi7 (source: 12345-14586@kfi7)
00000100:00000001:2.0:1773851867.921795:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851867.921796:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000100:00000001:0.0:1773851867.921797:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851867.921798:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851867.921798:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851867.921798:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851867.921799:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851867.921800:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851867.921801:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030990471424
00000020:00000001:0.0:1773851867.921802:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851867.921802:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91181
00000020:00000001:0.0:1773851867.921803:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851867.921806:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007f62dd78 refcount=6
00000020:00000001:0.0:1773851867.921806:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240523776 : -107152469027840 : ffff9e8b9f259400)
00000020:00000001:0.0:1773851867.921807:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240523776 : -107152469027840 : ffff9e8b9f259400)
00000100:00000001:0.0:1773851867.921809:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851867.921809:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851867.921810:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eccd9a8a.
00000020:00000010:0.0:1773851867.921811:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851867.921812:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851867.921813:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851867.921814:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851867.921815:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851867.921816:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851867.921817:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851867.921817:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.921819:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851867.921821:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.921821:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851867.921821:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851867.921822:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851867.921823:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14586@kfi7, seq: 1997565
00000100:00000001:1.0:1773851867.921824:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.921824:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007f62dd78 : new rpc_count 1
00000100:00000001:1.0:1773851867.921825:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.921825:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706783360 : -106953002768256 : ffff9eba10432880)
00000100:00000040:0.0:1773851867.921827:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000002b9e613 x1858030990471424/t0(0) o400->2a372835-3a7a-4042-8f32-29812aeb50a5@14586@kfi7:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne225-0'
00000100:00000001:0.0:1773851867.921831:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851867.921832:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851867.921833:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002b9e613 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2a372835-3a7a-4042-8f32-29812aeb50a5+6:47874:x1858030990471424:12345-14586@kfi7:400:default-tuolumne225-0
00000100:00000200:0.0:1773851867.921835:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030990471424
00000020:00000001:0.0:1773851867.921836:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851867.921837:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851867.921838:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.921839:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851867.921839:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851867.921840:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851867.921841:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030990471424, found 0 last_xid 1858030990471423
00000020:00000001:0.0:1773851867.921842:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851867.921843:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851867.921844:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851867.921844:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.921845:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851867.921846:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851867.921847:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851867.921847:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000088a0bb3d.
02000000:00000001:0.0:1773851867.921848:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.921849:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.921850:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851867.921851:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768264, transno 0, xid 1858030990471424
00010000:00000001:0.0:1773851867.921853:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851867.921854:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000002b9e613 x1858030990471424/t0(0) o400->2a372835-3a7a-4042-8f32-29812aeb50a5@14586@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne225-0'
00010000:00000001:0.0:1773851867.921859:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851867.921859:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851867.921861:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=100 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851867.921863:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851867.921864:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce33b24b refcount 5 to 14586@kfi7
00000100:00000001:0.0:1773851867.921865:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545859072 : -107154163692544 : ffff9e8b3a230c00)
02000000:00000001:0.0:1773851867.921866:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851867.921866:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851867.921867:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851867.921869:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14586@kfi7
00000400:00000010:0.0:1773851867.921869:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000487f5112.
00000100:00000200:0.0:1773851867.921871:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030990471424, offset 224
00000400:00000200:0.0:1773851867.921873:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14586@kfi7
00000400:00000200:0.0:1773851867.921874:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.921876:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 1
00000400:00000200:0.0:1773851867.921877:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:0.0:1773851867.921879:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000400:00000200:0.0:1773851867.921881:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14586@kfi7 local destination
00000400:00000200:0.0:1773851867.921883:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769239:8769239:1024:4294967295] 14586@kfi7 LPNI seq info [28005:28005:16:4294967295]
00000400:00000200:0.0:1773851867.921885:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:0.0:1773851867.921887:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:0.0:1773851867.921890:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14586@kfi7(14586@kfi7:14586@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851867.921892:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000800:00000200:0.0:1773851867.921894:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851867.921896:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851867.921899:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851867.921902:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd Using peer 14586@kfi7(0x1000000000003cd)
00000800:00000200:0.0:1773851867.921906:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x1000000000003cd: rc=0
00000800:00000200:0.0:1773851867.921909:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851867.921911:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851867.921913:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce33b24b refcount 4 to 14586@kfi7
00010000:00000001:0.0:1773851867.921914:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851867.921914:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851867.921917:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851867.921918:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000002b9e613 x1858030990471424/t0(0) o400->2a372835-3a7a-4042-8f32-29812aeb50a5@14586@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne225-0'
00000100:00100000:0.0:1773851867.921923:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002b9e613 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2a372835-3a7a-4042-8f32-29812aeb50a5+6:47874:x1858030990471424:12345-14586@kfi7:400:default-tuolumne225-0 Request processed in 91us (130us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851867.921926:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14586@kfi7, seq: 1997565
00000100:00000040:0.0:1773851867.921927:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007f62dd78 : new rpc_count 0
00000100:00000001:0.0:1773851867.921929:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851867.921929:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851867.921930:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851867.921931:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851867.921932:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eccd9a8a.
00000020:00000040:0.0:1773851867.921933:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000007f62dd78 : new refcount 5
00000100:00000001:0.0:1773851867.921934:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851867.921942:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851867.921944:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851867.921946:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14586@kfi7: PUT: OK
00000400:00000200:1.0:1773851867.921947:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000487f5112
00000400:00000010:1.0:1773851867.921948:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000487f5112.
00000100:00000001:1.0:1773851867.921949:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851867.921949:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851867.921950:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000800:00000200:1.0:1773851867.921952:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd Transaction freed
00000800:00000200:14.0:1773851867.941632:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851867.941633:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851867.941634:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851867.941636:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851867.941638:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26499@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.941639:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26499@kfi7 : PUT - for me
00000400:00000200:14.0:1773851867.941640:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26499@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.941641:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aafff723 nid 26499@kfi7 refs 1
00000400:00000200:14.0:1773851867.941642:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26499@kfi7 to cpt 3
00000400:00000200:14.0:1773851867.941643:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aafff723 nid 26499@kfi7 refs 2
00000400:00000200:14.0:1773851867.941644:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aafff723 nid 26499@kfi7 refs 3
00000400:00000200:14.0:1773851867.941645:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26434@kfi7 to cpt 5
00000400:00000200:14.0:1773851867.941646:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26434@kfi7 of length 224 into portal 12 MB=0x69b4d2ac36580
00000400:00000200:14.0:1773851867.941648:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26434@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 28904
00000800:00000200:14.0:1773851867.941649:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851867.941651:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851867.941652:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26499@kfi7: PUT: OK
00000100:00000001:14.0:1773851867.941653:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851867.941653:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851867.941654:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000197b1017.
00000100:00000040:14.0:1773851867.941654:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000197b1017 x1859605592499584 msgsize 224
00000100:00100000:14.0:1773851867.941656:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-26434@kfi7 (source: 12345-26499@kfi7)
00000100:00000001:14.0:1773851867.941657:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851867.941658:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:14.0:1773851867.941658:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aafff723 nid 26499@kfi7 refs 2
02000000:00000001:15.0:1773851867.941659:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851867.941659:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:14.0:1773851867.941659:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bbed2221: 2069@kfi7:3 <- 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851867.941660:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851867.941661:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851867.941662:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859605592499584
00000020:00000001:15.0:1773851867.941662:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851867.941663:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e1b102f60
00000020:00000001:15.0:1773851867.941664:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851867.941667:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000afb90972 refcount=52
00000020:00000001:15.0:1773851867.941668:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637057940812800 : -107015768738816 : ffff9eab731e7400)
00000020:00000001:15.0:1773851867.941668:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637057940812800 : -107015768738816 : ffff9eab731e7400)
00000100:00000001:15.0:1773851867.941670:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851867.941671:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851867.941672:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cc81a8a8.
00000020:00000010:15.0:1773851867.941673:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851867.941673:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851867.941675:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851867.941675:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851867.941676:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851867.941677:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851867.941678:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851867.941678:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.941679:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851867.941680:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851867.941681:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851867.941682:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26434@kfi7, seq: 2289835
00000100:00000040:15.0:1773851867.941682:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000afb90972 : new rpc_count 6
00000100:00000001:13.0:1773851867.941682:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851867.941682:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851867.941683:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341825664 : -106946367725952 : ffff9ebb9bbdde80)
00000100:00000001:13.0:1773851867.941683:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851867.941684:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000197b1017 x1859605592499584/t0(0) o400->aecb154a-466d-4168-b3e8-2f34b9b03b0f@26434@kfi7:507/0 lens 224/0 e 0 to 0 dl 1773852622 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne2152-0'
00000100:00000001:13.0:1773851867.941685:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.941687:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851867.941687:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851867.941689:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000197b1017 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:aecb154a-466d-4168-b3e8-2f34b9b03b0f+52:39243:x1859605592499584:12345-26434@kfi7:400:login-tuolumne2152-0
00000100:00000200:15.0:1773851867.941690:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859605592499584
00000020:00000001:15.0:1773851867.941691:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851867.941691:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851867.941692:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851867.941693:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851867.941694:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851867.941694:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851867.941695:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859605592499584, found 0 last_xid 1859605591284351
00000020:00000001:15.0:1773851867.941696:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851867.941696:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851867.941697:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851867.941698:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851867.941698:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851867.941699:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851867.941699:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851867.941700:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000312e86d9.
02000000:00000001:15.0:1773851867.941701:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.941703:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851867.941703:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851867.941704:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262270332, transno 0, xid 1859605592499584
00010000:00000001:15.0:1773851867.941705:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851867.941706:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000197b1017 x1859605592499584/t0(0) o400->aecb154a-466d-4168-b3e8-2f34b9b03b0f@26434@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2152-0'
00010000:00000001:15.0:1773851867.941708:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851867.941709:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851867.941709:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=100 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851867.941710:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851867.941711:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000002816d5f refcount 3 to 26434@kfi7
00000100:00000001:15.0:1773851867.941712:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999946720 : -107156709604896 : ffff9e8aa26381e0)
02000000:00000001:15.0:1773851867.941712:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851867.941713:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851867.941714:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851867.941715:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26499@kfi7
00000400:00000010:15.0:1773851867.941715:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dbadbd2e.
00000100:00000200:15.0:1773851867.941716:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859605592499584, offset 224
00000400:00000200:15.0:1773851867.941717:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26499@kfi7
00000400:00000200:15.0:1773851867.941718:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26499@kfi7 to cpt 3
00000400:00000200:15.0:1773851867.941719:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aafff723 nid 26499@kfi7 refs 1
00000400:00000200:15.0:1773851867.941720:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aafff723 nid 26499@kfi7 refs 2
00000400:00000200:15.0:1773851867.941722:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aafff723 nid 26499@kfi7 refs 3
00000400:00000200:15.0:1773851867.941723:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26499@kfi7 local destination
00000400:00000200:15.0:1773851867.941724:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769240:8769240:1024:4294967295] 26499@kfi7 LPNI seq info [130320808:130320808:16:4294967295]
00000400:00000200:15.0:1773851867.941728:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aafff723 nid 26499@kfi7 refs 2
00000400:00000200:15.0:1773851867.941729:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26499@kfi7 to cpt 3
00000400:00000200:15.0:1773851867.941731:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26499@kfi7(26499@kfi7:26499@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851867.941732:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aafff723 nid 26499@kfi7 refs 3
00000800:00000200:15.0:1773851867.941734:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851867.941735:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851867.941739:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851867.941741:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x300000000000dde Using peer 26499@kfi7(0x300000000000dde)
00000800:00000200:15.0:1773851867.941744:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x300000000000dde: rc=0
00000800:00000200:15.0:1773851867.941746:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x300000000000dde TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851867.941748:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851867.941749:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000002816d5f refcount 2 to 26434@kfi7
00010000:00000001:15.0:1773851867.941749:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851867.941750:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851867.941751:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851867.941752:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000197b1017 x1859605592499584/t0(0) o400->aecb154a-466d-4168-b3e8-2f34b9b03b0f@26434@kfi7:507/0 lens 224/224 e 0 to 0 dl 1773852622 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2152-0'
00000100:00100000:15.0:1773851867.941755:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000197b1017 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:aecb154a-466d-4168-b3e8-2f34b9b03b0f+52:39243:x1859605592499584:12345-26434@kfi7:400:login-tuolumne2152-0 Request processed in 67us (99us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851867.941758:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26434@kfi7, seq: 2289835
00000100:00000040:15.0:1773851867.941758:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000afb90972 : new rpc_count 5
00000800:00000200:14.0:1773851867.941758:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x300000000000dde TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851867.941759:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851867.941759:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851867.941760:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851867.941760:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:14.0:1773851867.941760:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26499@kfi7: PUT: OK
00000020:00000010:15.0:1773851867.941761:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000400:00000200:14.0:1773851867.941761:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dbadbd2e
00000400:00000010:14.0:1773851867.941761:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dbadbd2e.
00000020:00000010:15.0:1773851867.941762:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cc81a8a8.
00000100:00000001:14.0:1773851867.941762:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851867.941762:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:15.0:1773851867.941763:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000afb90972 : new refcount 51
00000400:00000200:14.0:1773851867.941763:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aafff723 nid 26499@kfi7 refs 2
00000100:00000001:15.0:1773851867.941764:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851867.941764:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 26499@kfi7(00000000818c62d1):0x0 lsk 3551 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x300000000000dde Transaction freed
00000004:00000001:31.0:1773851867.977731:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851867.977731:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:9.0:1773851867.977731:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851867.977732:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851867.977732:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:10.0:1773851867.977732:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:31.0:1773851867.977733:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fede61b9.
00000100:00000010:30.0:1773851867.977733:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061cdc96b.
00000004:00000020:10.0:1773851867.977733:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:9.0:1773851867.977733:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:9.0:1773851867.977733:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000953e77b6.
00000004:00000001:7.0:1773851867.977733:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851867.977733:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851867.977733:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:31.0:1773851867.977734:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000020:00000040:30.0:1773851867.977734:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000010:10.0:1773851867.977734:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eba50e83.
00000020:00000040:9.0:1773851867.977734:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000004:00000020:7.0:1773851867.977734:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851867.977734:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000181c7d4f.
00000004:00000020:6.0:1773851867.977734:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:5.0:1773851867.977734:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:31.0:1773851867.977735:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:31.0:1773851867.977735:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851867.977735:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851867.977735:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:10.0:1773851867.977735:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000100:00000010:6.0:1773851867.977735:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000075b1d810.
00000100:00000010:5.0:1773851867.977735:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008ac3fb97.
02000000:00000001:31.0:1773851867.977736:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851867.977736:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.977736:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:9.0:1773851867.977736:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:7.0:1773851867.977736:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851867.977736:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
02000000:00000010:31.0:1773851867.977737:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000005772c3d.
02000000:00000010:30.0:1773851867.977737:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000078bc3602.
00000100:00000001:10.0:1773851867.977737:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:9.0:1773851867.977737:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977737:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851867.977737:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851867.977737:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851867.977737:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:5.0:1773851867.977737:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
02000000:00000001:10.0:1773851867.977738:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851867.977738:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851867.977738:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851867.977738:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:31.0:1773851867.977739:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851867.977739:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851867.977739:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851867.977739:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851867.977739:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000001:5.0:1773851867.977739:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:31.0:1773851867.977740:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977740:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851867.977740:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.977740:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851867.977740:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000005a2e8a27.
00000100:00000001:7.0:1773851867.977740:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851867.977740:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000433e2d1e.
00000100:00000040:31.0:1773851867.977741:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fede61b9] to pc [ptlrpcd_07_02+2]  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851867.977741:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000061cdc96b] to pc [ptlrpcd_07_01+1]  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:10.0:1773851867.977741:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000da635257.
00000100:00000001:9.0:1773851867.977741:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851867.977741:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977741:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851867.977741:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851867.977741:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:5.0:1773851867.977741:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.977742:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977742:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851867.977742:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851867.977742:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e7717c48.
00000100:00000040:9.0:1773851867.977743:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000953e77b6] to pc [ptlrpcd_02_02+2]  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851867.977743:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000181c7d4f] to pc [ptlrpcd_01_02+2]  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851867.977743:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000075b1d810] to pc [ptlrpcd_01_03+3]  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851867.977744:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851867.977744:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851867.977745:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.977746:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851867.977746:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:31.0:1773851867.977747:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:30.0:1773851867.977747:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.977747:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:10.0:1773851867.977747:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000eba50e83] to pc [ptlrpcd_02_03+3]  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851867.977747:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851867.977747:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851867.977747:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:31.0:1773851867.977748:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f353b924.
00080000:00000001:31.0:1773851867.977748:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636925751495680 : -107147958055936 : ffff9e8cac058c00)
00000100:00000001:30.0:1773851867.977748:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:30.0:1773851867.977748:0:41088:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00000001:29.0:1773851867.977748:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851867.977748:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:9.0:1773851867.977748:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851867.977749:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851867.977749:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.977749:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851867.977749:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:9.0:1773851867.977749:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bcc4b05c.
00000100:00000001:8.0:1773851867.977749:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:5.0:1773851867.977749:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000008ac3fb97] to pc [ptlrpcd_01_00+0]  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851867.977750:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851867.977750:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851867.977750:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851867.977750:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637031430618112 : -107042278933504 : ffff9ea546fcfc00)
00000100:00100000:8.0:1773851867.977750:0:41071:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:4.0:1773851867.977750:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:31.0:1773851867.977751:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977751:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:9.0:1773851867.977751:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:8.0:1773851867.977751:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851867.977751:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851867.977751:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851867.977751:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:31.0:1773851867.977752:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:30.0:1773851867.977752:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851867.977752:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851867.977752:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851867.977752:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.977752:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851867.977752:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851867.977752:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000010:31.0:1773851867.977753:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003bbc4687.
00000004:00080000:31.0:1773851867.977753:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614142431028918ns, next at 614143431027776ns, rc = 0
00000100:00000001:30.0:1773851867.977753:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:28.0:1773851867.977753:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:9.0:1773851867.977753:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:9.0:1773851867.977753:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:8.0:1773851867.977753:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.977753:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851867.977753:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:4.0:1773851867.977753:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851867.977754:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:30.0:1773851867.977754:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:28.0:1773851867.977754:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:9.0:1773851867.977754:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008fa7b259.
00000100:00000001:8.0:1773851867.977754:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:6.0:1773851867.977754:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851867.977755:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851867.977755:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:28.0:1773851867.977755:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fede61b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051928320:60@kfi7:13:default-yuba2-0
00000004:00080000:9.0:1773851867.977755:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614142431030672ns, next at 614143431029429ns, rc = 0
00000100:00000040:8.0:1773851867.977755:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:31.0:1773851867.977756:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851867.977756:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.977756:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:9.0:1773851867.977756:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:30.0:1773851867.977757:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:28.0:1773851867.977757:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:10.0:1773851867.977757:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:9.0:1773851867.977757:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.977757:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851867.977757:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851867.977757:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977758:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851867.977758:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851867.977758:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000001:9.0:1773851867.977758:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.977758:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977758:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:6.0:1773851867.977758:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:5.0:1773851867.977758:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851867.977758:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:30.0:1773851867.977759:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000010:28.0:1773851867.977759:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e4aa9665.
02000000:00000001:28.0:1773851867.977759:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851867.977759:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851867.977759:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977759:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851867.977759:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:6.0:1773851867.977759:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851867.977759:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851867.977760:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851867.977760:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:10.0:1773851867.977760:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bef83544.
00000100:00100000:8.0:1773851867.977760:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051928640:37@kfi7:13:default-yuba2-0
00000100:00000040:7.0:1773851867.977760:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:6.0:1773851867.977760:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000075b1d810 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051928576:36@kfi7:13:default-yuba2-0
02000000:00000001:4.0:1773851867.977760:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:30.0:1773851867.977761:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051928384:13@kfi7:41:default-yuba2-0
00000400:00000200:28.0:1773851867.977761:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000010:28.0:1773851867.977761:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000100:00000001:11.0:1773851867.977761:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851867.977761:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637159710187520 : -106913999364096 : ffff9ec3250be000)
00080000:00000010:5.0:1773851867.977761:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000007ec3e8c0.
02000000:00000001:4.0:1773851867.977761:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:28.0:1773851867.977762:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e5971693.
00000100:00000001:8.0:1773851867.977762:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851867.977762:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:6.0:1773851867.977762:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851867.977762:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:30.0:1773851867.977763:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851867.977763:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:28.0:1773851867.977763:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928320, portal 4
00080000:00000001:10.0:1773851867.977763:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:8.0:1773851867.977763:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977763:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851867.977763:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851867.977763:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851867.977763:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636942362733568 : -107131346818048 : ffff9e908a20ec00)
00000100:00100000:4.0:1773851867.977763:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000181c7d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051928512:2074@kfi7:41:default-yuba2-0
02000000:00000001:30.0:1773851867.977764:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.977764:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:8.0:1773851867.977764:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851867.977764:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000fe2482c5.
02000000:00000001:7.0:1773851867.977764:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851867.977764:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:5.0:1773851867.977764:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:30.0:1773851867.977765:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:28.0:1773851867.977765:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999080832 : -107038710470784 : ffff9ea61baf6780)
00080000:00000001:10.0:1773851867.977765:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851867.977765:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851867.977765:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851867.977765:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000c5c78456.
02000000:00000001:6.0:1773851867.977765:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851867.977766:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000674d1ddd.
00000004:00001000:10.0:1773851867.977766:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00000400:00000200:8.0:1773851867.977766:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00100000:7.0:1773851867.977766:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008ac3fb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051928704:2061@kfi7:13:default-yuba2-0
00080000:00000001:5.0:1773851867.977766:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851867.977766:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851867.977766:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851867.977767:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.977767:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:10.0:1773851867.977767:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000072424610.
00000400:00000010:8.0:1773851867.977767:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000001:7.0:1773851867.977767:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851867.977767:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:6.0:1773851867.977767:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:6.0:1773851867.977767:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000004:00001000:5.0:1773851867.977767:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
02000000:00000001:4.0:1773851867.977767:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851867.977768:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:30.0:1773851867.977768:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000010:8.0:1773851867.977768:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000369ff48e.
02000000:00000001:7.0:1773851867.977768:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851867.977768:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:6.0:1773851867.977768:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5d4425b.
00000004:00000010:5.0:1773851867.977768:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003c8ec068.
02000000:00000001:4.0:1773851867.977768:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:30.0:1773851867.977769:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00000001:28.0:1773851867.977769:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000004:00080000:10.0:1773851867.977769:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614142431044488ns, next at 614143431042534ns, rc = 0
00000100:00000200:8.0:1773851867.977769:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928640, portal 4
02000000:00000010:7.0:1773851867.977769:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002b002509.
02000000:00000010:4.0:1773851867.977769:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000655a9ee6.
00000100:00000040:28.0:1773851867.977770:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000100:00000001:8.0:1773851867.977770:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851867.977770:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637043610181248 : -107030099370368 : ffff9ea81cf25e80)
02000000:00000001:7.0:1773851867.977770:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851867.977770:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928576, portal 4
00000004:00080000:5.0:1773851867.977770:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614142431045289ns, next at 614143431043446ns, rc = 0
02000000:00000001:4.0:1773851867.977770:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851867.977771:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928384, portal 4
00000400:00000010:28.0:1773851867.977771:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df8dec7a.
00080000:00000001:10.0:1773851867.977771:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:7.0:1773851867.977771:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:6.0:1773851867.977771:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851867.977771:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814081920 : -107101895469696 : ffff9e976590d580)
00000100:00000001:30.0:1773851867.977772:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:28.0:1773851867.977772:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928320, offset 0
00000100:00000040:8.0:1773851867.977772:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:7.0:1773851867.977772:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ebbae77d.
00080000:00000001:5.0:1773851867.977772:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:4.0:1773851867.977772:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:30.0:1773851867.977773:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832828032 : -106933876723584 : ffff9ebe84437080)
00000400:00000200:28.0:1773851867.977773:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00080000:00000001:10.0:1773851867.977773:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851867.977773:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
00000100:00000040:6.0:1773851867.977773:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851867.977773:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851867.977773:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fada8f61.
00000100:00000040:30.0:1773851867.977774:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851867.977774:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000004:00000001:10.0:1773851867.977774:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851867.977774:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928704, portal 4
00000004:00000001:5.0:1773851867.977774:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851867.977775:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000100:00000001:8.0:1773851867.977775:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851867.977775:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:4.0:1773851867.977775:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000400:00000200:28.0:1773851867.977776:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000040:8.0:1773851867.977776:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000400:00000010:8.0:1773851867.977776:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc809cf6.
00000100:00000001:7.0:1773851867.977776:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851867.977776:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637117886779648 : -106955822771968 : ffff9eb9682d5100)
00000100:00000040:6.0:1773851867.977776:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000100:00000200:4.0:1773851867.977776:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928512, portal 4
00000100:00000001:30.0:1773851867.977777:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:8.0:1773851867.977777:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928640, offset 0
00000100:00000040:7.0:1773851867.977777:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851867.977777:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c307aa46.
00000100:00000001:4.0:1773851867.977777:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:30.0:1773851867.977778:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000200:28.0:1773851867.977778:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000200:6.0:1773851867.977778:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928576, offset 0
00000100:00000001:4.0:1773851867.977778:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309150080 : -106994400401536 : ffff9eb06cc56780)
00000400:00000010:30.0:1773851867.977779:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fff2943a.
00000400:00000200:28.0:1773851867.977779:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:8.0:1773851867.977779:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000400:00000200:6.0:1773851867.977779:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000100:00000200:30.0:1773851867.977780:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051928384, offset 0
00000400:00000200:8.0:1773851867.977780:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:7.0:1773851867.977780:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:6.0:1773851867.977780:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000040:4.0:1773851867.977780:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851867.977781:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769240, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769239, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851867.977781:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000040:7.0:1773851867.977781:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:7.0:1773851867.977781:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000400:00000200:6.0:1773851867.977781:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:30.0:1773851867.977782:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:8.0:1773851867.977782:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000200:7.0:1773851867.977782:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928704, offset 0
00000400:00000200:6.0:1773851867.977782:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:28.0:1773851867.977783:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851867.977784:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851867.977784:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:7.0:1773851867.977784:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:6.0:1773851867.977784:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:4.0:1773851867.977784:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:28.0:1773851867.977785:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:8.0:1773851867.977785:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000100:00000040:4.0:1773851867.977785:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000200:6.0:1773851867.977786:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000400:00000010:4.0:1773851867.977786:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000058aef11.
00000400:00000200:28.0:1773851867.977787:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769241:8769241:1024:4294967295] 60@kfi7 LPNI seq info [5404308:5404308:16:4294967295]
00000400:00000200:8.0:1773851867.977787:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769240, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769241, p:4294967295, g:4294967295, h:1000]
00000100:00000200:4.0:1773851867.977787:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051928512, offset 0
00000400:00000200:28.0:1773851867.977788:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:6.0:1773851867.977788:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769240, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769241, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851867.977789:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:8.0:1773851867.977789:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851867.977790:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851867.977790:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:30.0:1773851867.977791:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:8.0:1773851867.977791:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000200:30.0:1773851867.977792:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:8.0:1773851867.977792:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769242:8769242:1024:4294967295] 37@kfi7 LPNI seq info [5403393:5403393:16:4294967295]
00000400:00000200:30.0:1773851867.977793:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:28.0:1773851867.977793:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851867.977793:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:6.0:1773851867.977793:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851867.977793:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851867.977794:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:28.0:1773851867.977794:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:8.0:1773851867.977794:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:6.0:1773851867.977794:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000400:00000200:30.0:1773851867.977796:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000800:00000200:28.0:1773851867.977796:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:6.0:1773851867.977796:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769243:8769243:1023:4294967295] 36@kfi7 LPNI seq info [5403967:5403967:16:4294967295]
00000800:00000200:28.0:1773851867.977797:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851867.977797:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:30.0:1773851867.977798:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769242, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769243, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851867.977798:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:7.0:1773851867.977799:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:30.0:1773851867.977800:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:28.0:1773851867.977800:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851867.977800:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:30.0:1773851867.977801:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851867.977801:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:6.0:1773851867.977801:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851867.977802:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851867.977802:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:6.0:1773851867.977802:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:30.0:1773851867.977803:0:41088:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133313, 23133315]
00000800:00000200:28.0:1773851867.977803:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Using peer 60@kfi7(0x2000000000001dc)
00000400:00000200:7.0:1773851867.977803:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000800:00000200:6.0:1773851867.977804:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:30.0:1773851867.977805:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 30@kfi7
00000400:00000200:7.0:1773851867.977805:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769242, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769243, p:4294967295, g:4294967295, h:1000]
00000800:00000200:6.0:1773851867.977805:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851867.977806:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769244:8769244:1024:4294967295] 30@kfi7 LPNI seq info [23133316:23133316:16:4294967295]
00000800:00000200:28.0:1773851867.977806:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x2000000000001dc: rc=0
00000400:00000200:7.0:1773851867.977807:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:6.0:1773851867.977807:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851867.977808:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000800:00000200:28.0:1773851867.977808:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:7.0:1773851867.977808:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851867.977809:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.977809:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000400:00000200:7.0:1773851867.977809:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769245:8769245:1024:4294967295] 2061@kfi7 LPNI seq info [5403460:5403460:16:4294967295]
00000800:00000200:6.0:1773851867.977809:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000100:00000001:28.0:1773851867.977810:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.977811:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851867.977811:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851867.977811:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:28.0:1773851867.977812:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851867.977812:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851867.977812:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:28.0:1773851867.977813:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851867.977813:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000618b435b: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000400:00000200:4.0:1773851867.977813:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:8.0:1773851867.977814:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000800:00000200:6.0:1773851867.977814:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851867.977815:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000100:00000001:28.0:1773851867.977816:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851867.977816:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:8.0:1773851867.977816:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:6.0:1773851867.977816:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851867.977816:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:28.0:1773851867.977817:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851867.977817:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:8.0:1773851867.977817:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851867.977817:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000100:00000001:6.0:1773851867.977817:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851867.977817:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851867.977818:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:6.0:1773851867.977818:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851867.977818:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:8.0:1773851867.977819:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851867.977819:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:6.0:1773851867.977819:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:7.0:1773851867.977820:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:6.0:1773851867.977820:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:8.0:1773851867.977821:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000100:00000001:6.0:1773851867.977821:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:6.0:1773851867.977821:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851867.977822:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851867.977822:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:6.0:1773851867.977822:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851867.977822:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851867.977822:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000100:00000001:6.0:1773851867.977823:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851867.977824:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851867.977824:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851867.977824:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1a3: rc=0
00000800:00000200:7.0:1773851867.977825:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000400:00000200:4.0:1773851867.977825:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769245, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769243, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851867.977826:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851867.977827:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:7.0:1773851867.977827:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x19b: rc=0
00000100:00000001:6.0:1773851867.977827:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.977828:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851867.977828:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851867.977828:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851867.977829:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000100:00000001:8.0:1773851867.977829:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851867.977829:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851867.977829:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851867.977829:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851867.977830:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df8dec7a
00000100:00000001:8.0:1773851867.977830:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:4.0:1773851867.977830:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000010:29.0:1773851867.977831:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df8dec7a.
00000100:00000040:8.0:1773851867.977831:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851867.977831:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851867.977832:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:7.0:1773851867.977832:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851867.977832:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851867.977832:0:41066:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425166, 23425165]
00000100:00000001:8.0:1773851867.977833:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851867.977833:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:29.0:1773851867.977834:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.977834:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977834:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851867.977835:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851867.977835:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977835:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851867.977835:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:4.0:1773851867.977835:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000100:00100000:8.0:1773851867.977836:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000953e77b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051928448:2060@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851867.977836:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851867.977836:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851867.977836:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851867.977836:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769246:8769246:1022:4294967295] 2081@kfi7 LPNI seq info [23425167:23425167:16:4294967295]
00000100:00000001:8.0:1773851867.977837:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851867.977837:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:7.0:1773851867.977837:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851867.977838:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:8.0:1773851867.977838:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851867.977838:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:29.0:1773851867.977840:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851867.977842:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
02000000:00000010:8.0:1773851867.977843:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006f63178d.
00000400:00000200:4.0:1773851867.977843:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:29.0:1773851867.977844:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851867.977844:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
02000000:00000001:8.0:1773851867.977844:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851867.977845:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851867.977845:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:8.0:1773851867.977845:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000010:8.0:1773851867.977846:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000007d88ff4.
00000400:00000200:9.0:1773851867.977847:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000010:8.0:1773851867.977847:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
00000400:00000200:30.0:1773851867.977848:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 30@kfi7(13@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851867.977848:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc809cf6
00000100:00000200:8.0:1773851867.977848:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928448, portal 4
00000400:00000200:4.0:1773851867.977848:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851867.977849:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000010:9.0:1773851867.977849:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc809cf6.
00000100:00000001:9.0:1773851867.977849:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:8.0:1773851867.977849:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851867.977849:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637125749193344 : -106947960358272 : ffff9ebb3cd03a80)
00000100:00000040:8.0:1773851867.977850:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851867.977851:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851867.977851:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:8.0:1773851867.977852:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:29.0:1773851867.977853:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:9.0:1773851867.977853:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851867.977853:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000100:00000040:9.0:1773851867.977854:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:8.0:1773851867.977854:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c20ed36.
00000100:00000200:8.0:1773851867.977854:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928448, offset 0
00000800:00000200:30.0:1773851867.977856:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851867.977856:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Transaction freed
00000400:00000200:8.0:1773851867.977856:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000100:00000001:9.0:1773851867.977857:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851867.977857:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:8.0:1773851867.977857:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:30.0:1773851867.977858:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:8.0:1773851867.977858:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:9.0:1773851867.977859:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:8.0:1773851867.977859:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:6.0:1773851867.977859:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000400:00000200:8.0:1773851867.977860:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:30.0:1773851867.977861:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851867.977861:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000400:00000200:8.0:1773851867.977861:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000200:6.0:1773851867.977861:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851867.977862:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:18.0:1773851867.977862:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:6.0:1773851867.977862:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000800:00000200:21.0:1773851867.977863:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851867.977863:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:8.0:1773851867.977863:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769245, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769246, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851867.977863:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c307aa46
00000400:00000010:6.0:1773851867.977863:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c307aa46.
00000800:00000200:30.0:1773851867.977864:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 Using peer 30@kfi7(0xa16)
00000800:00000200:18.0:1773851867.977864:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851867.977864:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:21.0:1773851867.977865:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:8.0:1773851867.977865:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851867.977865:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000200:6.0:1773851867.977865:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:18.0:1773851867.977866:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:8.0:1773851867.977866:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000800:00000200:30.0:1773851867.977868:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000030498a96: Posted send of 324 bytes to peer 0xa16: rc=0
00000400:00000200:18.0:1773851867.977868:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:8.0:1773851867.977868:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769247:8769247:1022:4294967295] 2060@kfi7 LPNI seq info [5404993:5404993:16:4294967295]
00000100:00000001:6.0:1773851867.977868:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851867.977868:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851867.977869:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:8.0:1773851867.977869:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:18.0:1773851867.977870:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000400:00000200:8.0:1773851867.977870:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:7.0:1773851867.977870:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000400:00000200:7.0:1773851867.977871:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851867.977871:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851867.977871:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:30.0:1773851867.977872:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977872:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:21.0:1773851867.977872:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:30.0:1773851867.977873:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851867.977873:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851867.977873:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000800:00000200:31.0:1773851867.977874:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:30.0:1773851867.977874:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851867.977874:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:7.0:1773851867.977874:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:7.0:1773851867.977874:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:7.0:1773851867.977874:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:4.0:1773851867.977874:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:31.0:1773851867.977875:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851867.977875:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851867.977875:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851867.977876:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:8.0:1773851867.977876:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:4.0:1773851867.977876:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851867.977877:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851867.977877:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:8.0:1773851867.977877:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:18.0:1773851867.977878:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:7.0:1773851867.977878:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851867.977878:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851867.977879:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851867.977879:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:31.0:1773851867.977880:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:8.0:1773851867.977880:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:18.0:1773851867.977881:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 4
00000100:00000001:7.0:1773851867.977881:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.977881:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:4.0:1773851867.977881:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:31.0:1773851867.977882:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:21.0:1773851867.977882:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 60@kfi7 : PUT - for me
00000800:00000200:8.0:1773851867.977882:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Using peer 2060@kfi7(0x1c0)
00000400:00000200:6.0:1773851867.977883:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:31.0:1773851867.977884:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000800:00000200:30.0:1773851867.977884:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:21.0:1773851867.977884:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:7.0:1773851867.977884:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:30.0:1773851867.977885:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851867.977885:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851867.977885:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:18.0:1773851867.977885:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:8.0:1773851867.977885:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1c0: rc=0
00000400:00000200:31.0:1773851867.977886:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:30.0:1773851867.977886:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:7.0:1773851867.977886:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000800:00000200:6.0:1773851867.977886:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000618b435b: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:4.0:1773851867.977886:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 Using peer 2081@kfi7(0x200000000000275)
00000400:00000200:31.0:1773851867.977887:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:21.0:1773851867.977887:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851867.977887:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3800
00000800:00000200:8.0:1773851867.977887:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851867.977888:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851867.977888:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:18.0:1773851867.977888:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:8.0:1773851867.977888:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851867.977889:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:30.0:1773851867.977889:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:8.0:1773851867.977889:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:31.0:1773851867.977890:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:29.0:1773851867.977890:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000400:00000200:21.0:1773851867.977890:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:18.0:1773851867.977890:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f1111 [1] + 224
00000100:00000001:8.0:1773851867.977890:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.977890:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851867.977890:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x200000000000275: rc=0
00000400:00000200:31.0:1773851867.977891:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:29.0:1773851867.977891:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fff2943a
00000100:00000001:8.0:1773851867.977891:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851867.977892:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000010:29.0:1773851867.977892:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fff2943a.
00000400:00000200:21.0:1773851867.977892:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:18.0:1773851867.977892:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851867.977892:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851867.977892:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:31.0:1773851867.977893:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:29.0:1773851867.977893:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:8.0:1773851867.977893:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.977893:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:4.0:1773851867.977893:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851867.977894:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3880
00000400:00000200:30.0:1773851867.977894:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000100:00000200:29.0:1773851867.977894:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851867.977894:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3700
00000400:00000200:18.0:1773851867.977894:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851867.977895:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:18.0:1773851867.977895:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:30.0:1773851867.977896:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:30.0:1773851867.977897:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:18.0:1773851867.977897:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851867.977897:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.977897:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851867.977898:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:29.0:1773851867.977898:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:21.0:1773851867.977898:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000200:18.0:1773851867.977898:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851867.977898:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851867.977899:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851867.977899:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851867.977900:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000040:29.0:1773851867.977900:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851867.977900:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d0cf5 [1] + 224
00000100:00000001:4.0:1773851867.977900:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:31.0:1773851867.977901:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:30.0:1773851867.977901:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000040:18.0:1773851867.977901:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851867.977901:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000400:00000200:9.0:1773851867.977901:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c20ed36
00000100:00000001:4.0:1773851867.977901:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851867.977902:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851867.977903:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x78008087d [1] + 224
00000400:00000200:30.0:1773851867.977903:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3840
00000800:00000200:21.0:1773851867.977903:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:9.0:1773851867.977903:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c20ed36.
00000400:00000200:30.0:1773851867.977904:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:29.0:1773851867.977904:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851867.977904:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851867.977904:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:4.0:1773851867.977904:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851867.977905:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:29.0:1773851867.977905:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:18.0:1773851867.977905:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000200:9.0:1773851867.977905:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851867.977905:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:30.0:1773851867.977906:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x78008083d [1] + 224
00000400:00000200:29.0:1773851867.977906:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:21.0:1773851867.977906:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851867.977906:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851867.977906:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:31.0:1773851867.977907:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:18.0:1773851867.977907:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851867.977907:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851867.977907:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851867.977908:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000800:00000200:30.0:1773851867.977908:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851867.977908:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000100:00000001:9.0:1773851867.977908:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000001:6.0:1773851867.977908:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851867.977908:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:4.0:1773851867.977908:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851867.977909:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 Transaction freed
00000100:00000040:9.0:1773851867.977909:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851867.977909:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000100:00000001:31.0:1773851867.977910:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851867.977910:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:21.0:1773851867.977910:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:6.0:1773851867.977910:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5d4425b
00000400:00000010:6.0:1773851867.977910:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5d4425b.
00000100:00000200:31.0:1773851867.977911:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851867.977911:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000100:00000200:21.0:1773851867.977911:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851867.977911:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851867.977911:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851867.977912:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:6.0:1773851867.977912:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851867.977913:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851867.977913:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000200:30.0:1773851867.977914:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851867.977915:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Transaction freed
00000100:00000200:6.0:1773851867.977915:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851867.977915:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 TN_EVENT_TX_OK event status 0
00000800:00000200:7.0:1773851867.977916:0:2507579:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:4.0:1773851867.977916:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851867.977917:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851867.977917:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851867.977917:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:7.0:1773851867.977917:0:2507579:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:6.0:1773851867.977917:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851867.977917:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851867.977918:0:2507579:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f47c5f93: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851867.977918:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851867.977918:0:41067:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:5.0:1773851867.977918:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:6.0:1773851867.977919:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:5.0:1773851867.977919:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000100:00000001:6.0:1773851867.977920:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851867.977920:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851867.977921:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851867.977921:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:6.0:1773851867.977921:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851867.977921:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000058aef11
00000400:00000010:5.0:1773851867.977921:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000058aef11.
00000400:00000200:30.0:1773851867.977922:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000800:00000200:7.0:1773851867.977922:0:2507579:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f47c5f93: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00001000:6.0:1773851867.977922:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=100 v=66 (66 66 66 66)
00000100:00000001:5.0:1773851867.977922:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:31.0:1773851867.977923:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00001000:6.0:1773851867.977923:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=100 v=66 (1 1 1 1)
00000800:00000200:30.0:1773851867.977924:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851867.977924:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:7.0:1773851867.977924:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000100:00000001:6.0:1773851867.977924:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:5.0:1773851867.977924:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851867.977925:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851867.977925:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:7.0:1773851867.977925:0:2507579:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 30@kfi7 : PUT - for me
00000100:00000001:6.0:1773851867.977925:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851867.977925:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:7.0:1773851867.977926:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00010000:00000001:6.0:1773851867.977926:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851867.977926:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851867.977926:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:7.0:1773851867.977927:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000100:00000001:6.0:1773851867.977927:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851867.977927:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:6.0:1773851867.977927:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851867.977928:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:4.0:1773851867.977928:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:7.0:1773851867.977929:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:7.0:1773851867.977929:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000040:6.0:1773851867.977929:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851867.977929:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000001:4.0:1773851867.977929:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:7.0:1773851867.977930:0:2507579:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000010:4.0:1773851867.977930:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ebbae77d.
00000100:00000001:21.0:1773851867.977931:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:7.0:1773851867.977931:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:6.0:1773851867.977931:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:5.0:1773851867.977931:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851867.977931:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000400:00000200:21.0:1773851867.977932:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:7.0:1773851867.977932:0:2507579:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3740
00000100:00000001:6.0:1773851867.977932:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851867.977932:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:4.0:1773851867.977932:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000400:00000200:7.0:1773851867.977933:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000004:00000001:6.0:1773851867.977933:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851867.977933:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851867.977934:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000001:8.0:1773851867.977934:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851867.977934:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000040:6.0:1773851867.977934:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000004:00000040:6.0:1773851867.977934:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500135424 avail=351498046464 avail_mb=1373039244 hwm_mb=3131103 files=372097753 ffree=343261851 state=0: rc = 0
00000100:00000001:28.0:1773851867.977935:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851867.977935:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000010:8.0:1773851867.977935:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:7.0:1773851867.977935:0:2507579:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d0d15 [1] + 224
00000100:00000001:5.0:1773851867.977935:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851867.977935:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:6.0:1773851867.977936:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500135424 free, 351498046464 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097753 files, 343261851 free files
00000100:00000001:5.0:1773851867.977936:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000001:28.0:1773851867.977937:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:8.0:1773851867.977937:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000369ff48e
00000400:00000001:28.0:1773851867.977938:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851867.977938:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000369ff48e.
00000800:00000200:7.0:1773851867.977938:0:2507579:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f47c5f93: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000001:6.0:1773851867.977938:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851867.977938:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000010:28.0:1773851867.977939:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000001:8.0:1773851867.977939:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:7.0:1773851867.977939:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:6.0:1773851867.977939:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:28.0:1773851867.977940:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e5971693
00000400:00000200:7.0:1773851867.977940:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000800:00000200:5.0:1773851867.977940:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000275 Transaction freed
00000400:00000010:28.0:1773851867.977941:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e5971693.
00000800:00000200:17.0:1773851867.977941:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000200:8.0:1773851867.977941:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:6.0:1773851867.977941:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000075b1d810 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051928576:36@kfi7:13:default-yuba2-0
00000100:00000200:4.0:1773851867.977941:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851867.977942:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:28.0:1773851867.977943:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851867.977943:0:2507579:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851867.977943:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851867.977944:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:7.0:1773851867.977944:0:2507579:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851867.977944:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851867.977944:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000075b1d810 x1859433051928576/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:28.0:1773851867.977945:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851867.977946:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:4.0:1773851867.977946:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851867.977946:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:8.0:1773851867.977947:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851867.977947:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851867.977947:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:4.0:1773851867.977947:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:7.0:1773851867.977948:0:2507579:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:6.0:1773851867.977948:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000c5c78456.
02000000:00000001:4.0:1773851867.977948:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851867.977948:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:17.0:1773851867.977949:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
02000000:00000001:6.0:1773851867.977949:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:4.0:1773851867.977949:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851867.977950:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:6.0:1773851867.977950:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851867.977950:0:41067:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
02000000:00000001:4.0:1773851867.977950:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851867.977951:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2060@kfi7 : PUT - for me
00000100:00000001:8.0:1773851867.977951:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000020:00000001:6.0:1773851867.977951:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:4.0:1773851867.977951:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=100 v=66 (66 66 66 66)
00000400:00000200:17.0:1773851867.977952:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:8.0:1773851867.977952:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.977952:0:2507579:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000010:6.0:1773851867.977952:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000433e2d1e.
02000000:00000001:6.0:1773851867.977952:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000200:17.0:1773851867.977953:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000100:00000001:8.0:1773851867.977953:0:41071:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:7.0:1773851867.977953:0:2507579:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
02000000:00000001:6.0:1773851867.977953:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851867.977953:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000075b1d810.
00000100:00001000:4.0:1773851867.977953:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=100 v=66 (1 1 1 1)
00000400:00000200:17.0:1773851867.977954:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
02000000:00000001:8.0:1773851867.977954:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851867.977954:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851867.977954:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851867.977955:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851867.977955:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851867.977955:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851867.977955:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:17.0:1773851867.977955:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:8.0:1773851867.977955:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:7.0:1773851867.977955:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f47c5f93: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851867.977955:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851867.977955:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851867.977955:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977956:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:22.0:1773851867.977956:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851867.977956:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000100:00000001:8.0:1773851867.977956:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851867.977956:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851867.977956:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851867.977956:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000001:30.0:1773851867.977957:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:28.0:1773851867.977957:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851867.977957:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000800:00000200:22.0:1773851867.977957:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851867.977957:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
02000000:00000001:8.0:1773851867.977957:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851867.977957:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851867.977957:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851867.977957:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:30.0:1773851867.977958:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851867.977958:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:17.0:1773851867.977958:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3780
00000100:00001000:8.0:1773851867.977958:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=100 v=66 (66 66 66 66)
00000100:00000001:4.0:1773851867.977958:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000010:30.0:1773851867.977959:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:28.0:1773851867.977959:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851867.977959:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000040:4.0:1773851867.977959:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000400:00000200:30.0:1773851867.977960:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
02000000:00000001:28.0:1773851867.977960:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851867.977960:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00001000:8.0:1773851867.977960:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=100 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851867.977960:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851867.977960:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851867.977961:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000400:00000200:17.0:1773851867.977961:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f1131 [1] + 224
00000100:00000001:30.0:1773851867.977962:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:28.0:1773851867.977962:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=100 v=66 (66 66 66 66)
00000400:00000200:22.0:1773851867.977962:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:8.0:1773851867.977962:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:4.0:1773851867.977962:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:17.0:1773851867.977963:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851867.977963:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851867.977964:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:28.0:1773851867.977964:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=100 v=66 (1 1 1 1)
00000400:00000200:22.0:1773851867.977964:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2081@kfi7 : PUT - for me
00010000:00000001:8.0:1773851867.977964:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:22.0:1773851867.977965:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00010000:00000001:8.0:1773851867.977965:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.977966:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851867.977966:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851867.977966:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:17.0:1773851867.977966:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851867.977966:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:4.0:1773851867.977966:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:22.0:1773851867.977967:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:17.0:1773851867.977967:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000100:00000040:8.0:1773851867.977967:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000001:4.0:1773851867.977967:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00010000:00000001:28.0:1773851867.977968:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:22.0:1773851867.977968:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:17.0:1773851867.977968:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851867.977968:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851867.977968:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:30.0:1773851867.977969:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:28.0:1773851867.977969:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851867.977969:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000100:00000001:8.0:1773851867.977969:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851867.977969:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851867.977970:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:17.0:1773851867.977970:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:4.0:1773851867.977970:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000100:00000040:28.0:1773851867.977971:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000400:00000200:22.0:1773851867.977971:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000040:8.0:1773851867.977971:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:4.0:1773851867.977971:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399726592 free=351492762624 avail=351490353152 avail_mb=1373009192 hwm_mb=3131103 files=372078092 ffree=343254651 state=0: rc = 0
00000100:00000001:28.0:1773851867.977972:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851867.977972:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851867.977972:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b37c0
00000100:00000001:30.0:1773851867.977973:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:22.0:1773851867.977973:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000040:17.0:1773851867.977973:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851867.977974:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:28.0:1773851867.977974:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:4.0:1773851867.977974:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399726592 blocks, 351492762624 free, 351490353152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372078092 files, 343254651 free files
00000100:00000001:30.0:1773851867.977975:0:41088:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:22.0:1773851867.977975:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78008089d [1] + 224
00000100:00000001:8.0:1773851867.977975:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:30.0:1773851867.977976:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:17.0:1773851867.977976:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851867.977976:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000001:4.0:1773851867.977976:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977977:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:22.0:1773851867.977977:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851867.977977:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:8.0:1773851867.977977:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851867.977978:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851867.977978:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:4.0:1773851867.977978:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:30.0:1773851867.977979:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.977979:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:17.0:1773851867.977979:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000004:00000040:8.0:1773851867.977979:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000100:00001000:30.0:1773851867.977980:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=100 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851867.977980:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:22.0:1773851867.977980:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000040:8.0:1773851867.977980:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690163200 avail=351687736320 avail_mb=1373780220 hwm_mb=3131103 files=372231278 ffree=343447425 state=0: rc = 0
00000100:00000001:28.0:1773851867.977981:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851867.977982:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:22.0:1773851867.977982:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000100:00001000:30.0:1773851867.977983:0:41088:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=100 v=66 (1 1 1 1)
00000004:00000040:28.0:1773851867.977984:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000100:00000001:22.0:1773851867.977984:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000100:00100000:4.0:1773851867.977984:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008ac3fb97 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051928704:2061@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851867.977985:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851867.977985:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:28.0:1773851867.977985:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351236608 avail=351348385792 avail_mb=1372454632 hwm_mb=3131103 files=372084109 ffree=343116442 state=0: rc = 0
00010000:00000001:30.0:1773851867.977986:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:22.0:1773851867.977986:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:8.0:1773851867.977986:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690163200 free, 351687736320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231278 files, 343447425 free files
00000100:00000001:4.0:1773851867.977986:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851867.977986:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00010000:00000001:30.0:1773851867.977987:0:41088:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851867.977987:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000008ac3fb97 x1859433051928704/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851867.977988:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000020:28.0:1773851867.977988:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351236608 free, 351348385792 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372084109 files, 343116442 free files
00000100:00000040:30.0:1773851867.977989:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000004:00000001:8.0:1773851867.977989:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977990:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:8.0:1773851867.977990:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851867.977990:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851867.977990:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851867.977990:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002b002509.
00000100:00000001:30.0:1773851867.977991:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851867.977991:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851867.977992:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851867.977992:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851867.977992:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851867.977992:0:41064:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000100:00000040:30.0:1773851867.977993:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851867.977993:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:4.0:1773851867.977993:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851867.977993:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e7717c48.
02000000:00000001:4.0:1773851867.977994:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851867.977995:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851867.977995:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ac3fb97.
00000100:00100000:8.0:1773851867.977996:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051928640:37@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851867.977996:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851867.977997:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851867.977997:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851867.977997:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:28.0:1773851867.977998:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fede61b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051928320:60@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851867.977998:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851867.977998:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.977999:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851867.977999:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:8.0:1773851867.977999:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:4.0:1773851867.977999:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851867.977999:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851867.978000:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851867.978000:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851867.978000:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:8.0:1773851867.978000:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851867.978001:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:8.0:1773851867.978001:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000007d88ff4.
00000004:00000020:30.0:1773851867.978002:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097312 blocks, 31192443584 free, 31192383168 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238739 files, 2962368299 free files
00000400:00000200:22.0:1773851867.978002:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:8.0:1773851867.978002:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000100:00000040:28.0:1773851867.978003:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fede61b9 x1859433051928320/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:8.0:1773851867.978003:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000100:00000001:8.0:1773851867.978004:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851867.978004:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851867.978004:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000001:30.0:1773851867.978005:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851867.978005:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:8.0:1773851867.978005:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:7.0:1773851867.978006:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:30.0:1773851867.978007:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851867.978007:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000001:7.0:1773851867.978007:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:28.0:1773851867.978008:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000010:7.0:1773851867.978008:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fada8f61.
02000000:00000010:28.0:1773851867.978009:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e4aa9665.
00000400:00000200:7.0:1773851867.978009:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000100:00000200:8.0:1773851867.978010:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:28.0:1773851867.978011:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000400:00000010:7.0:1773851867.978011:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00100000:30.0:1773851867.978012:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000061cdc96b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051928384:13@kfi7:41:default-yuba2-0
00000020:00000001:28.0:1773851867.978012:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:7.0:1773851867.978012:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000020:00000040:28.0:1773851867.978013:0:41090:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000020:00000001:28.0:1773851867.978014:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000200:7.0:1773851867.978014:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851867.978015:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:28.0:1773851867.978015:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000005772c3d.
00000100:00000001:8.0:1773851867.978015:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851867.978015:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851867.978016:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:28.0:1773851867.978016:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851867.978016:0:41071:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:30.0:1773851867.978017:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000061cdc96b x1859433051928384/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:28.0:1773851867.978017:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:8.0:1773851867.978017:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000010:28.0:1773851867.978018:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fede61b9.
00000100:00000001:8.0:1773851867.978018:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851867.978018:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.978019:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:8.0:1773851867.978019:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851867.978019:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851867.978020:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851867.978021:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:28.0:1773851867.978021:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:8.0:1773851867.978021:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=100 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851867.978022:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00001000:8.0:1773851867.978022:0:41071:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=100 v=66 (1 1 1 1)
02000000:00000001:30.0:1773851867.978023:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851867.978023:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000674d1ddd.
00000100:00000001:28.0:1773851867.978023:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.978024:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.978024:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851867.978024:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:30.0:1773851867.978025:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:28.0:1773851867.978025:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.978025:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.978025:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851867.978026:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851867.978026:0:41088:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00010000:00000001:8.0:1773851867.978026:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851867.978026:0:41066:0:(client.c:1428:after_reply()) Process entered
00000020:00000001:30.0:1773851867.978027:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00010000:00000001:8.0:1773851867.978027:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851867.978027:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851867.978027:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000010:30.0:1773851867.978028:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000078bc3602.
00000100:00000001:8.0:1773851867.978028:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851867.978028:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
02000000:00000001:30.0:1773851867.978029:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851867.978029:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851867.978029:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851867.978030:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:7.0:1773851867.978030:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:30.0:1773851867.978031:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061cdc96b.
00000100:00000001:8.0:1773851867.978031:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851867.978032:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:7.0:1773851867.978032:0:41066:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=100 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851867.978033:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851867.978033:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851867.978034:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:7.0:1773851867.978034:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=100 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851867.978035:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851867.978036:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851867.978036:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.978036:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851867.978037:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.978037:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851867.978037:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851867.978038:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.978038:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851867.978038:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851867.978038:0:41066:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851867.978039:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:7.0:1773851867.978039:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000040:8.0:1773851867.978040:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000100:00000040:7.0:1773851867.978040:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000004:00000040:8.0:1773851867.978041:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504355328 avail=351502189568 avail_mb=1373055428 hwm_mb=3131103 files=372056253 ffree=343265972 state=0: rc = 0
00000100:00000001:7.0:1773851867.978041:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851867.978042:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851867.978043:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:8.0:1773851867.978044:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504355328 free, 351502189568 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056253 files, 343265972 free files
00000004:00000001:8.0:1773851867.978046:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851867.978048:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851867.978048:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851867.978049:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851867.978050:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851867.978051:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00100000:8.0:1773851867.978053:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000953e77b6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051928448:2060@kfi7:13:default-yuba2-0
00000004:00000020:7.0:1773851867.978053:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223680 blocks, 31250857696 free, 31250818592 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121441 files, 2868731077 free files
00000100:00000001:8.0:1773851867.978055:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851867.978056:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:7.0:1773851867.978056:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851867.978057:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000eba50e83 x1859433051928640/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:7.0:1773851867.978058:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.978062:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851867.978062:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851867.978064:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000fe2482c5.
02000000:00000001:8.0:1773851867.978065:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851867.978066:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851867.978066:0:41071:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000100:00100000:7.0:1773851867.978067:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000181c7d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051928512:2074@kfi7:41:default-yuba2-0
00000020:00000001:8.0:1773851867.978068:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851867.978068:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000da635257.
02000000:00000001:8.0:1773851867.978070:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851867.978070:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:7.0:1773851867.978070:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:8.0:1773851867.978071:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eba50e83.
00000100:00000001:7.0:1773851867.978071:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851867.978072:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:7.0:1773851867.978072:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000181c7d4f x1859433051928512/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851867.978073:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851867.978075:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851867.978076:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000953e77b6 x1859433051928448/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852020 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851867.978077:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851867.978077:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851867.978079:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000655a9ee6.
00000100:00000001:8.0:1773851867.978080:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851867.978080:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:8.0:1773851867.978081:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:7.0:1773851867.978081:0:41066:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:8.0:1773851867.978082:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006f63178d.
00000020:00000040:7.0:1773851867.978082:0:41066:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
02000000:00000001:8.0:1773851867.978083:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851867.978083:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:8.0:1773851867.978084:0:41071:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:7.0:1773851867.978084:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000005a2e8a27.
00000020:00000040:8.0:1773851867.978085:0:41071:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
02000000:00000001:7.0:1773851867.978085:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:8.0:1773851867.978086:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:7.0:1773851867.978086:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:8.0:1773851867.978087:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000100:00000010:7.0:1773851867.978087:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000181c7d4f.
02000000:00000001:8.0:1773851867.978088:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:7.0:1773851867.978088:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:8.0:1773851867.978089:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851867.978089:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000953e77b6.
00000100:00000001:7.0:1773851867.978089:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.978090:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851867.978091:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851867.978091:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.978091:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851867.978092:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851867.978092:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.978093:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851867.978093:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.978094:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851867.978094:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851867.978095:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851867.978096:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851867.995436:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851867.995437:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851867.995438:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851867.995440:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851867.995442:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24259@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.995443:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24259@kfi7 : PUT - for me
00000400:00000200:29.0:1773851867.995444:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24259@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.995445:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c541901c nid 24259@kfi7 refs 1
00000400:00000200:29.0:1773851867.995446:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24259@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.995446:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c541901c nid 24259@kfi7 refs 2
00000400:00000200:29.0:1773851867.995447:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c541901c nid 24259@kfi7 refs 3
00000400:00000200:29.0:1773851867.995448:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24259@kfi7 to cpt 7
00000400:00000200:29.0:1773851867.995449:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24259@kfi7 of length 224 into portal 12 MB=0x699e1831b2b40
00000400:00000200:29.0:1773851867.995450:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24259@kfi7 of length 224/224 into md 0x77fe139dd [64] + 175752
00000800:00000200:29.0:1773851867.995451:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851867.995453:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.995454:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24259@kfi7: PUT: OK
00000100:00000001:29.0:1773851867.995455:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851867.995455:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851867.995456:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003923c340.
00000100:00000040:29.0:1773851867.995457:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000003923c340 x1858043706551104 msgsize 224
00000100:00100000:29.0:1773851867.995458:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-24259@kfi7 (source: 12345-24259@kfi7)
00000100:00000001:29.0:1773851867.995459:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851867.995460:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c541901c nid 24259@kfi7 refs 2
00000800:00000200:29.0:1773851867.995461:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851867.995461:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851867.995461:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851867.995462:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851867.995463:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851867.995464:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851867.995465:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043706551104
00000020:00000001:28.0:1773851867.995465:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851867.995466:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9183b
00000020:00000001:28.0:1773851867.995466:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851867.995469:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dffa0abe refcount=6
00000020:00000001:28.0:1773851867.995470:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241739264 : -107152467812352 : ffff9e8b9f382000)
00000020:00000001:28.0:1773851867.995471:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241739264 : -107152467812352 : ffff9e8b9f382000)
00000100:00000001:28.0:1773851867.995472:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.995473:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851867.995474:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000adb0a5b7.
00000020:00000010:28.0:1773851867.995475:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.995476:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851867.995477:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851867.995477:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851867.995478:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851867.995479:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851867.995480:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851867.995480:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.995481:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851867.995482:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851867.995482:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851867.995483:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851867.995483:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851867.995484:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851867.995484:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24259@kfi7, seq: 2055521
00000100:00000040:28.0:1773851867.995484:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dffa0abe : new rpc_count 1
00000100:00000001:31.0:1773851867.995485:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.995485:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309668736 : -106988399882880 : ffff9eb1d26e0d80)
00000100:00000040:28.0:1773851867.995486:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003923c340 x1858043706551104/t0(0) o400->38870a3d-05d5-4454-b36c-18193ed6d65c@24259@kfi7:655/0 lens 224/0 e 0 to 0 dl 1773852015 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2007-0'
00000100:00000001:28.0:1773851867.995489:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851867.995489:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851867.995490:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003923c340 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:38870a3d-05d5-4454-b36c-18193ed6d65c+6:39606:x1858043706551104:12345-24259@kfi7:400:default-tuolumne2007-0
00000100:00000200:28.0:1773851867.995492:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043706551104
00000020:00000001:28.0:1773851867.995493:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851867.995493:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851867.995494:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.995495:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851867.995495:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851867.995496:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851867.995497:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043706551104, found 0 last_xid 1858043706551103
00000020:00000001:28.0:1773851867.995497:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851867.995498:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851867.995499:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851867.995499:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.995500:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851867.995500:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851867.995501:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851867.995502:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008a057a76.
02000000:00000001:28.0:1773851867.995502:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.995503:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.995503:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851867.995504:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182427421270, transno 0, xid 1858043706551104
00010000:00000001:28.0:1773851867.995505:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851867.995506:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003923c340 x1858043706551104/t0(0) o400->38870a3d-05d5-4454-b36c-18193ed6d65c@24259@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2007-0'
00010000:00000001:28.0:1773851867.995508:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851867.995508:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851867.995509:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=100 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851867.995510:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851867.995511:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a63a3446 refcount 3 to 24259@kfi7
00000100:00000001:28.0:1773851867.995512:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715062784 : -107155994488832 : ffff9e8acd035000)
02000000:00000001:28.0:1773851867.995513:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851867.995513:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851867.995514:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851867.995515:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24259@kfi7
00000400:00000010:28.0:1773851867.995515:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e5971693.
00000100:00000200:28.0:1773851867.995516:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043706551104, offset 224
00000400:00000200:28.0:1773851867.995518:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24259@kfi7
00000400:00000200:28.0:1773851867.995519:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24259@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.995520:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c541901c nid 24259@kfi7 refs 1
00000400:00000200:28.0:1773851867.995522:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c541901c nid 24259@kfi7 refs 2
00000400:00000200:28.0:1773851867.995523:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c541901c nid 24259@kfi7 refs 3
00000400:00000200:28.0:1773851867.995524:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24259@kfi7 local destination
00000400:00000200:28.0:1773851867.995525:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769248:8769248:1024:4294967295] 24259@kfi7 LPNI seq info [7574172:7574172:16:4294967295]
00000400:00000200:28.0:1773851867.995526:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c541901c nid 24259@kfi7 refs 2
00000400:00000200:28.0:1773851867.995527:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24259@kfi7 to cpt 7
00000400:00000200:28.0:1773851867.995529:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24259@kfi7(24259@kfi7:24259@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851867.995530:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c541901c nid 24259@kfi7 refs 3
00000800:00000200:28.0:1773851867.995532:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851867.995533:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851867.995535:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851867.995537:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000191 Using peer 24259@kfi7(0x100000000000191)
00000800:00000200:28.0:1773851867.995540:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x100000000000191: rc=0
00000800:00000200:28.0:1773851867.995542:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851867.995544:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851867.995544:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a63a3446 refcount 2 to 24259@kfi7
00010000:00000001:28.0:1773851867.995545:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851867.995546:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851867.995546:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851867.995547:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003923c340 x1858043706551104/t0(0) o400->38870a3d-05d5-4454-b36c-18193ed6d65c@24259@kfi7:655/0 lens 224/224 e 0 to 0 dl 1773852015 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2007-0'
00000100:00100000:28.0:1773851867.995552:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003923c340 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:38870a3d-05d5-4454-b36c-18193ed6d65c+6:39606:x1858043706551104:12345-24259@kfi7:400:default-tuolumne2007-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851867.995556:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24259@kfi7, seq: 2055521
00000100:00000040:28.0:1773851867.995557:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dffa0abe : new rpc_count 0
00000100:00000001:28.0:1773851867.995558:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851867.995558:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851867.995559:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851867.995560:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851867.995561:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000adb0a5b7.
00000020:00000040:28.0:1773851867.995562:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000dffa0abe : new refcount 5
00000100:00000001:28.0:1773851867.995562:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851867.995567:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000191 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851867.995569:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851867.995570:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24259@kfi7: PUT: OK
00000400:00000200:29.0:1773851867.995570:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e5971693
00000400:00000010:29.0:1773851867.995571:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e5971693.
00000100:00000001:29.0:1773851867.995572:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851867.995572:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851867.995573:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c541901c nid 24259@kfi7 refs 2
00000800:00000200:29.0:1773851867.995575:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 24259@kfi7(0000000010942a54):0x0 lsk 402 rsk 57 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000191 Transaction freed
00000800:00000200:29.0:1773851868.013369:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851868.013370:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851868.013371:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851868.013374:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851868.013377:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8352@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.013379:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8352@kfi7 : PUT - for me
00000400:00000200:29.0:1773851868.013380:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8352@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.013382:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004124edbf nid 8352@kfi7 refs 1
00000400:00000200:29.0:1773851868.013384:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8352@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.013384:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004124edbf nid 8352@kfi7 refs 2
00000400:00000200:29.0:1773851868.013386:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004124edbf nid 8352@kfi7 refs 3
00000400:00000200:29.0:1773851868.013387:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8289@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.013388:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8289@kfi7 of length 224 into portal 12 MB=0x69b95a76cb580
00000400:00000200:29.0:1773851868.013390:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8289@kfi7 of length 224/224 into md 0x77fe139dd [64] + 175976
00000800:00000200:29.0:1773851868.013393:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851868.013395:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851868.013397:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8352@kfi7: PUT: OK
00000100:00000001:29.0:1773851868.013398:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851868.013398:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851868.013399:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bbaecf5d.
00000100:00000040:29.0:1773851868.013400:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000bbaecf5d x1859916921615744 msgsize 224
00000100:00100000:29.0:1773851868.013402:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-8289@kfi7 (source: 12345-8352@kfi7)
00000100:00000001:29.0:1773851868.013404:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851868.013405:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004124edbf nid 8352@kfi7 refs 2
00000100:00000001:28.0:1773851868.013406:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851868.013407:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851868.013408:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851868.013408:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851868.013408:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851868.013409:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851868.013410:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859916921615744
00000020:00000001:28.0:1773851868.013411:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851868.013412:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b649872a6
00000020:00000001:28.0:1773851868.013413:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851868.013417:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000543b955f refcount=486
00000020:00000001:28.0:1773851868.013418:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637082699441152 : -106991010110464 : ffff9eb136d92400)
00000020:00000001:28.0:1773851868.013419:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637082699441152 : -106991010110464 : ffff9eb136d92400)
00000100:00000001:28.0:1773851868.013421:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851868.013422:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851868.013423:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000adb0a5b7.
00000020:00000010:28.0:1773851868.013424:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851868.013425:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851868.013427:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851868.013427:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851868.013428:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851868.013429:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851868.013430:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851868.013430:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.013432:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.013434:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851868.013434:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851868.013435:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851868.013435:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851868.013436:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8289@kfi7, seq: 2055522
00000100:00000001:31.0:1773851868.013437:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851868.013437:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000543b955f : new rpc_count 7
00000100:00000001:31.0:1773851868.013438:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.013438:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309687168 : -106988399864448 : ffff9eb1d26e5580)
00000100:00000040:28.0:1773851868.013440:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bbaecf5d x1859916921615744/t0(0) o400->fd635769-9a1e-45d0-873e-30224a90594b@8289@kfi7:656/0 lens 224/0 e 0 to 0 dl 1773852016 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1008-0'
00000100:00000001:28.0:1773851868.013445:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851868.013446:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851868.013447:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bbaecf5d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:fd635769-9a1e-45d0-873e-30224a90594b+486:39798:x1859916921615744:12345-8289@kfi7:400:default-tuolumne1008-0
00000100:00000200:28.0:1773851868.013449:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859916921615744
00000020:00000001:28.0:1773851868.013450:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851868.013451:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851868.013452:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.013453:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851868.013453:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851868.013455:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851868.013455:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859916921615744, found 0 last_xid 1859916921048639
00000020:00000001:28.0:1773851868.013457:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851868.013458:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851868.013458:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851868.013459:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.013460:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851868.013461:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851868.013461:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851868.013462:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000e469be4.
02000000:00000001:28.0:1773851868.013463:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.013464:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.013465:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851868.013466:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255357806, transno 0, xid 1859916921615744
00010000:00000001:28.0:1773851868.013467:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851868.013468:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bbaecf5d x1859916921615744/t0(0) o400->fd635769-9a1e-45d0-873e-30224a90594b@8289@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1008-0'
00010000:00000001:28.0:1773851868.013477:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851868.013478:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851868.013479:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=101 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851868.013481:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851868.013482:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008903d3fe refcount 3 to 8289@kfi7
00000100:00000001:28.0:1773851868.013483:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091268896 : -107152618282720 : ffff9e8b96402120)
02000000:00000001:28.0:1773851868.013484:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851868.013484:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.013485:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851868.013487:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8352@kfi7
00000400:00000010:28.0:1773851868.013487:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032756c42.
00000100:00000200:28.0:1773851868.013488:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859916921615744, offset 224
00000400:00000200:28.0:1773851868.013491:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8352@kfi7
00000400:00000200:28.0:1773851868.013492:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8352@kfi7 to cpt 7
00000400:00000200:28.0:1773851868.013494:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004124edbf nid 8352@kfi7 refs 1
00000400:00000200:28.0:1773851868.013495:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004124edbf nid 8352@kfi7 refs 2
00000400:00000200:28.0:1773851868.013497:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004124edbf nid 8352@kfi7 refs 3
00000400:00000200:28.0:1773851868.013499:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8352@kfi7 local destination
00000400:00000200:28.0:1773851868.013501:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769249:8769249:1024:4294967295] 8352@kfi7 LPNI seq info [3665765:3665765:16:4294967295]
00000400:00000200:28.0:1773851868.013503:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004124edbf nid 8352@kfi7 refs 2
00000400:00000200:28.0:1773851868.013504:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8352@kfi7 to cpt 7
00000400:00000200:28.0:1773851868.013508:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8352@kfi7(8352@kfi7:8352@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851868.013510:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004124edbf nid 8352@kfi7 refs 3
00000800:00000200:28.0:1773851868.013512:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851868.013513:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851868.013517:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851868.013520:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7f5 Using peer 8352@kfi7(0x7f5)
00000800:00000200:28.0:1773851868.013527:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x7f5: rc=0
00000800:00000200:28.0:1773851868.013530:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7f5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851868.013533:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851868.013534:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008903d3fe refcount 2 to 8289@kfi7
00010000:00000001:28.0:1773851868.013535:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851868.013535:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.013536:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851868.013539:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bbaecf5d x1859916921615744/t0(0) o400->fd635769-9a1e-45d0-873e-30224a90594b@8289@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1008-0'
00000100:00100000:28.0:1773851868.013544:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bbaecf5d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:fd635769-9a1e-45d0-873e-30224a90594b+486:39798:x1859916921615744:12345-8289@kfi7:400:default-tuolumne1008-0 Request processed in 98us (143us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851868.013548:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8289@kfi7, seq: 2055522
00000100:00000040:28.0:1773851868.013550:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000543b955f : new rpc_count 6
00000100:00000001:28.0:1773851868.013551:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851868.013551:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851868.013552:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851868.013553:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851868.013554:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000adb0a5b7.
00000020:00000040:28.0:1773851868.013555:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000543b955f : new refcount 485
00000100:00000001:28.0:1773851868.013556:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851868.013564:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7f5 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851868.013566:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851868.013568:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8352@kfi7: PUT: OK
00000400:00000200:29.0:1773851868.013569:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032756c42
00000400:00000010:29.0:1773851868.013570:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032756c42.
00000100:00000001:29.0:1773851868.013571:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851868.013571:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851868.013572:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004124edbf nid 8352@kfi7 refs 2
00000800:00000200:29.0:1773851868.013575:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 8352@kfi7(00000000b19041c9):0x0 lsk 2038 rsk 24 tsk 0 trmk 0 tmk 0 trr 7 tta 0x7f5 Transaction freed
00000800:00000200:9.0:1773851868.015885:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851868.015886:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851868.015887:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851868.015889:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851868.015893:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23137@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.015894:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23137@kfi7 : PUT - for me
00000400:00000200:9.0:1773851868.015895:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23137@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.015896:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 1
00000400:00000200:9.0:1773851868.015897:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23137@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.015898:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 2
00000400:00000200:9.0:1773851868.015899:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 3
00000400:00000200:9.0:1773851868.015899:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23200@kfi7 to cpt 3
00000400:00000200:9.0:1773851868.015900:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23200@kfi7 of length 224 into portal 12 MB=0x69b0a269d1c80
00000400:00000200:9.0:1773851868.015902:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23200@kfi7 of length 224/224 into md 0x78146ce49 [64] + 137168
00000800:00000200:9.0:1773851868.015903:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851868.015905:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851868.015906:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23137@kfi7: PUT: OK
00000100:00000001:9.0:1773851868.015907:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851868.015908:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851868.015909:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000007ffd10a.
00000100:00000040:9.0:1773851868.015910:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000007ffd10a x1859317760072832 msgsize 224
00000100:00100000:9.0:1773851868.015911:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-23200@kfi7 (source: 12345-23137@kfi7)
00000100:00000001:9.0:1773851868.015912:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851868.015913:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 2
00000100:00000001:11.0:1773851868.015914:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851868.015914:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851868.015914:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851868.015915:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851868.015915:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851868.015916:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851868.015917:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317760072832
00000020:00000001:11.0:1773851868.015918:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851868.015918:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a55
00000020:00000001:11.0:1773851868.015918:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851868.015921:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d87b2961 refcount=6
00000020:00000001:11.0:1773851868.015922:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743445504 : -107128966106112 : ffff9e911807b400)
00000020:00000001:11.0:1773851868.015923:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743445504 : -107128966106112 : ffff9e911807b400)
00000100:00000001:11.0:1773851868.015924:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851868.015925:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851868.015925:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fbc9e461.
00000020:00000010:11.0:1773851868.015926:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851868.015927:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000076194eba.
00000100:00000001:11.0:1773851868.015928:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851868.015929:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851868.015929:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851868.015930:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851868.015931:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851868.015931:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.015932:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851868.015933:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851868.015934:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851868.015934:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851868.015934:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851868.015935:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23200@kfi7, seq: 2130781
00000100:00000040:11.0:1773851868.015936:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d87b2961 : new rpc_count 1
00000100:00000001:9.0:1773851868.015936:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.015937:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749182976 : -106947960368640 : ffff9ebb3cd01200)
00000100:00000001:9.0:1773851868.015937:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851868.015938:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000007ffd10a x1859317760072832/t0(0) o400->000c6df1-ae7e-4ff7-b07d-fb1beeb2bdc7@23200@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1936-0'
00000100:00000001:11.0:1773851868.015941:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851868.015941:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851868.015942:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007ffd10a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:000c6df1-ae7e-4ff7-b07d-fb1beeb2bdc7+6:39528:x1859317760072832:12345-23200@kfi7:400:default-tuolumne1936-0
00000100:00000200:11.0:1773851868.015943:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317760072832
00000020:00000001:11.0:1773851868.015944:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851868.015945:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851868.015945:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851868.015946:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851868.015946:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851868.015947:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851868.015948:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317760072832, found 0 last_xid 1859317760072831
00000020:00000001:11.0:1773851868.015949:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851868.015949:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851868.015950:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851868.015951:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851868.015951:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851868.015952:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851868.015952:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851868.015953:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000855afa8f.
02000000:00000001:11.0:1773851868.015955:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.015955:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851868.015956:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851868.015956:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183250008363, transno 0, xid 1859317760072832
00010000:00000001:11.0:1773851868.015957:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851868.015958:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000007ffd10a x1859317760072832/t0(0) o400->000c6df1-ae7e-4ff7-b07d-fb1beeb2bdc7@23200@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1936-0'
00010000:00000001:11.0:1773851868.015961:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851868.015961:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851868.015962:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=101 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851868.015963:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851868.015964:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fb6565dc refcount 3 to 23200@kfi7
00000100:00000001:11.0:1773851868.015965:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642471392 : -107157067080224 : ffff9e8a8d14dde0)
02000000:00000001:11.0:1773851868.015966:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851868.015966:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.015967:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851868.015968:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23137@kfi7
00000400:00000010:11.0:1773851868.015969:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000557250e8.
00000100:00000200:11.0:1773851868.015970:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317760072832, offset 224
00000400:00000200:11.0:1773851868.015971:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23137@kfi7
00000400:00000200:11.0:1773851868.015972:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23137@kfi7 to cpt 2
00000400:00000200:11.0:1773851868.015973:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 1
00000400:00000200:11.0:1773851868.015975:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 2
00000400:00000200:11.0:1773851868.015976:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 3
00000400:00000200:11.0:1773851868.015978:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23137@kfi7 local destination
00000400:00000200:11.0:1773851868.015979:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769250:8769250:1024:4294967295] 23137@kfi7 LPNI seq info [2369426:2369426:16:4294967295]
00000400:00000200:11.0:1773851868.015981:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 2
00000400:00000200:11.0:1773851868.015982:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23137@kfi7 to cpt 2
00000400:00000200:11.0:1773851868.015985:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23137@kfi7(23137@kfi7:23137@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851868.015987:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 3
00000800:00000200:11.0:1773851868.015989:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851868.015991:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851868.015996:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851868.015999:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf65 Using peer 23137@kfi7(0xf65)
00000800:00000200:11.0:1773851868.016004:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0xf65: rc=0
00000800:00000200:11.0:1773851868.016007:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf65 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851868.016013:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851868.016015:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fb6565dc refcount 2 to 23200@kfi7
00010000:00000001:11.0:1773851868.016017:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851868.016017:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851868.016019:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000800:00000200:9.0:1773851868.016020:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf65 TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851868.016021:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000007ffd10a x1859317760072832/t0(0) o400->000c6df1-ae7e-4ff7-b07d-fb1beeb2bdc7@23200@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1936-0'
00000400:00000200:9.0:1773851868.016023:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851868.016025:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23137@kfi7: PUT: OK
00000100:00100000:11.0:1773851868.016027:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007ffd10a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:000c6df1-ae7e-4ff7-b07d-fb1beeb2bdc7+6:39528:x1859317760072832:12345-23200@kfi7:400:default-tuolumne1936-0 Request processed in 85us (116us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851868.016027:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000557250e8
00000400:00000010:9.0:1773851868.016028:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000557250e8.
00000100:00000001:9.0:1773851868.016029:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851868.016030:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:11.0:1773851868.016031:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23200@kfi7, seq: 2130781
00000400:00000200:9.0:1773851868.016031:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b5a1aaa8 nid 23137@kfi7 refs 2
00000100:00000040:11.0:1773851868.016032:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d87b2961 : new rpc_count 0
00000100:00000001:11.0:1773851868.016034:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851868.016034:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 23137@kfi7(00000000eb73a2e6):0x0 lsk 3942 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf65 Transaction freed
00000100:00000001:11.0:1773851868.016035:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851868.016036:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851868.016037:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000076194eba.
00000020:00000010:11.0:1773851868.016039:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fbc9e461.
00000020:00000040:11.0:1773851868.016040:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000d87b2961 : new refcount 5
00000100:00000001:11.0:1773851868.016041:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851868.041731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851868.041732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
Debug log: 159860 lines, 159860 kept, 0 dropped, 0 bad.
00000800:00000200:21.0F:1773851868.047457:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851868.047459:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851868.047461:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851868.047463:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851868.047465:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.047466:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17915@kfi7 : PUT - for me
00000400:00000200:21.0:1773851868.047467:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.047468:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 1
00000400:00000200:21.0:1773851868.047469:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.047469:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000400:00000200:21.0:1773851868.047470:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 3
00000400:00000200:21.0:1773851868.047471:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.047472:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17915@kfi7 of length 224 into portal 12 MB=0x699de8729dc40
00000400:00000200:21.0:1773851868.047473:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17915@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 36392
00000800:00000200:21.0:1773851868.047475:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851868.047476:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851868.047477:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17915@kfi7: PUT: OK
00000100:00000001:21.0:1773851868.047478:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851868.047479:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851868.047480:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007b0ad404.
00000100:00000040:21.0:1773851868.047480:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000007b0ad404 x1858030889720896 msgsize 224
00000100:00100000:21.0:1773851868.047482:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17915@kfi7 (source: 12345-17915@kfi7)
00000100:00000001:21.0:1773851868.047482:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851868.047483:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000100:00000001:22.0F:1773851868.047484:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851868.047485:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851868.047485:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851868.047486:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851868.047486:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851868.047487:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851868.047487:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030889720896
00000020:00000001:22.0:1773851868.047488:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851868.047488:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9105b
00000020:00000001:22.0:1773851868.047489:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851868.047491:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000096507e34 refcount=6
00000020:00000001:22.0:1773851868.047492:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240119296 : -107152469432320 : ffff9e8b9f1f6800)
00000020:00000001:22.0:1773851868.047493:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240119296 : -107152469432320 : ffff9e8b9f1f6800)
00000100:00000001:22.0:1773851868.047493:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.047494:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851868.047495:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000020:00000010:22.0:1773851868.047496:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.047496:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851868.047497:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851868.047498:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851868.047498:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851868.047499:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851868.047499:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851868.047500:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.047501:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0F:1773851868.047502:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.047502:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.047502:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851868.047503:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851868.047503:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17915@kfi7, seq: 1997978
00000100:00000001:23.0:1773851868.047504:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.047504:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000096507e34 : new rpc_count 1
00000100:00000001:23.0:1773851868.047505:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.047505:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788267008 : -106974921284608 : ffff9eb4f5d12400)
00000100:00000040:22.0:1773851868.047506:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007b0ad404 x1858030889720896/t0(0) o400->7f3e780e-1db0-40e3-a496-df5dad5bac1b@17915@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne238-0'
00000100:00000001:22.0:1773851868.047508:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.047509:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851868.047510:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007b0ad404 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:7f3e780e-1db0-40e3-a496-df5dad5bac1b+6:47755:x1858030889720896:12345-17915@kfi7:400:default-tuolumne238-0
00000100:00000200:22.0:1773851868.047512:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030889720896
00000020:00000001:22.0:1773851868.047513:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851868.047513:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851868.047514:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.047515:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851868.047515:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851868.047516:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851868.047516:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030889720896, found 0 last_xid 1858030889720895
00000020:00000001:22.0:1773851868.047517:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851868.047518:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851868.047518:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851868.047519:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.047519:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851868.047520:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851868.047520:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851868.047521:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000020ec0854.
02000000:00000001:22.0:1773851868.047522:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.047522:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.047523:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851868.047523:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030889720896
00010000:00000001:22.0:1773851868.047524:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851868.047525:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007b0ad404 x1858030889720896/t0(0) o400->7f3e780e-1db0-40e3-a496-df5dad5bac1b@17915@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne238-0'
00010000:00000001:22.0:1773851868.047527:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851868.047528:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851868.047528:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=101 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851868.047529:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851868.047530:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e6e7b546 refcount 5 to 17915@kfi7
00000100:00000001:22.0:1773851868.047531:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024416 : -107156745527200 : ffff9e8aa03f6060)
02000000:00000001:22.0:1773851868.047531:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851868.047532:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.047532:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851868.047533:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17915@kfi7
00000400:00000010:22.0:1773851868.047534:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001a3c4634.
00000100:00000200:22.0:1773851868.047535:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030889720896, offset 224
00000400:00000200:22.0:1773851868.047536:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17915@kfi7
00000400:00000200:22.0:1773851868.047537:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.047538:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 1
00000400:00000200:22.0:1773851868.047539:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000400:00000200:22.0:1773851868.047540:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 3
00000400:00000200:22.0:1773851868.047541:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17915@kfi7 local destination
00000400:00000200:22.0:1773851868.047542:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769251:8769251:1024:4294967295] 17915@kfi7 LPNI seq info [28028:28028:16:4294967295]
00000400:00000200:22.0:1773851868.047544:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000400:00000200:22.0:1773851868.047544:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.047546:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17915@kfi7(17915@kfi7:17915@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851868.047547:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 3
00000800:00000200:22.0:1773851868.047548:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.047549:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851868.047551:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851868.047553:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x349 Using peer 17915@kfi7(0x349)
00000800:00000200:22.0:1773851868.047556:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000007ee9d6e: Posted send of 324 bytes to peer 0x349: rc=0
00000800:00000200:22.0:1773851868.047557:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x349 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851868.047559:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.047559:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e6e7b546 refcount 4 to 17915@kfi7
00010000:00000001:22.0:1773851868.047560:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851868.047561:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.047561:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851868.047562:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007b0ad404 x1858030889720896/t0(0) o400->7f3e780e-1db0-40e3-a496-df5dad5bac1b@17915@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne238-0'
00000100:00100000:22.0:1773851868.047565:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007b0ad404 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:7f3e780e-1db0-40e3-a496-df5dad5bac1b+6:47755:x1858030889720896:12345-17915@kfi7:400:default-tuolumne238-0 Request processed in 55us (83us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851868.047567:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17915@kfi7, seq: 1997978
00000100:00000040:22.0:1773851868.047568:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000096507e34 : new rpc_count 0
00000100:00000001:22.0:1773851868.047569:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851868.047569:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851868.047569:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x349 TN_EVENT_TX_OK event status 0
00000020:00000010:22.0:1773851868.047570:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.047570:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851868.047570:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851868.047571:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000400:00000200:21.0:1773851868.047571:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17915@kfi7: PUT: OK
00000020:00000040:22.0:1773851868.047572:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000096507e34 : new refcount 5
00000100:00000001:22.0:1773851868.047572:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851868.047573:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001a3c4634
00000400:00000010:21.0:1773851868.047573:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001a3c4634.
00000100:00000001:21.0:1773851868.047574:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851868.047574:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851868.047575:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009fcf6416 nid 17915@kfi7 refs 2
00000800:00000200:21.0:1773851868.047577:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 17915@kfi7(000000008c88ac18):0x0 lsk 842 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x349 Transaction freed
00000800:00000200:17.0F:1773851868.074493:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.074495:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.074497:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.074501:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.074504:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.074507:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10490@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.074508:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.074510:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 1
00000400:00000200:17.0:1773851868.074511:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.074512:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000400:00000200:17.0:1773851868.074514:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 3
00000400:00000200:17.0:1773851868.074515:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.074517:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10490@kfi7 of length 224 into portal 12 MB=0x699de8d52b080
00000400:00000200:17.0:1773851868.074519:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10490@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 11000
00000800:00000200:17.0:1773851868.074522:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.074525:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.074526:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10490@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.074528:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.074528:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.074530:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002cf2036b.
00000100:00000040:17.0:1773851868.074531:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002cf2036b x1858030993059968 msgsize 224
00000100:00100000:17.0:1773851868.074533:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-10490@kfi7 (source: 12345-10490@kfi7)
00000100:00000001:17.0:1773851868.074535:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.074536:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000800:00000200:17.0:1773851868.074539:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851868.074543:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851868.074544:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851868.074545:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851868.074545:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851868.074547:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851868.074548:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030993059968
00000020:00000001:17.0:1773851868.074549:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851868.074550:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f04
00000020:00000001:17.0:1773851868.074551:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851868.074553:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000016489b4f refcount=6
00000020:00000001:17.0:1773851868.074555:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239876608 : -107152469675008 : ffff9e8b9f1bb400)
00000020:00000001:17.0:1773851868.074556:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239876608 : -107152469675008 : ffff9e8b9f1bb400)
00000100:00000001:17.0:1773851868.074557:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.074558:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851868.074560:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069587fa7.
00000020:00000010:17.0:1773851868.074561:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851868.074562:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dae37e2f.
00000100:00000001:17.0:1773851868.074564:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851868.074564:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851868.074565:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.074567:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851868.074568:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851868.074568:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.074570:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0F:1773851868.074571:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.074572:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.074572:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851868.074573:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851868.074574:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10490@kfi7, seq: 2156326
00000100:00000001:17.0:1773851868.074575:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.074575:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000016489b4f : new rpc_count 1
00000100:00000001:17.0:1773851868.074576:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.074576:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051093914112 : -107022615637504 : ffff9ea9db031200)
00000100:00000040:16.0:1773851868.074577:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002cf2036b x1858030993059968/t0(0) o400->460256a6-9afd-4dc2-b973-13548ed9db93@10490@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne209-0'
00000100:00000001:16.0:1773851868.074580:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.074581:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851868.074582:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cf2036b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:460256a6-9afd-4dc2-b973-13548ed9db93+6:47985:x1858030993059968:12345-10490@kfi7:400:default-tuolumne209-0
00000100:00000200:16.0:1773851868.074583:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030993059968
00000020:00000001:16.0:1773851868.074584:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851868.074585:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851868.074586:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074586:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851868.074587:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851868.074588:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851868.074588:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030993059968, found 0 last_xid 1858030993059967
00000020:00000001:16.0:1773851868.074589:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851868.074590:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851868.074591:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851868.074592:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074592:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851868.074593:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851868.074594:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851868.074594:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e0b6ca85.
02000000:00000001:16.0:1773851868.074595:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.074596:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074597:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851868.074597:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030993059968
00010000:00000001:16.0:1773851868.074598:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851868.074599:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002cf2036b x1858030993059968/t0(0) o400->460256a6-9afd-4dc2-b973-13548ed9db93@10490@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne209-0'
00010000:00000001:16.0:1773851868.074602:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851868.074603:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851868.074604:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851868.074605:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851868.074606:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003f6e4f67 refcount 5 to 10490@kfi7
00000100:00000001:16.0:1773851868.074606:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370153536 : -107145339398080 : ffff9e8d481b1840)
02000000:00000001:16.0:1773851868.074607:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851868.074608:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.074608:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851868.074609:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10490@kfi7
00000400:00000010:16.0:1773851868.074610:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018de6a4d.
00000100:00000200:16.0:1773851868.074611:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030993059968, offset 224
00000400:00000200:16.0:1773851868.074613:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10490@kfi7
00000400:00000200:16.0:1773851868.074614:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.074615:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 1
00000400:00000200:16.0:1773851868.074616:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000400:00000200:16.0:1773851868.074618:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 3
00000400:00000200:16.0:1773851868.074619:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10490@kfi7 local destination
00000400:00000200:16.0:1773851868.074620:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769252:8769252:1024:4294967295] 10490@kfi7 LPNI seq info [24434:24434:16:4294967295]
00000400:00000200:16.0:1773851868.074622:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000400:00000200:16.0:1773851868.074623:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.074625:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10490@kfi7(10490@kfi7:10490@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851868.074626:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 3
00000800:00000200:16.0:1773851868.074628:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851868.074629:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851868.074631:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851868.074633:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x816 Using peer 10490@kfi7(0x816)
00000800:00000200:16.0:1773851868.074637:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x816: rc=0
00000800:00000200:16.0:1773851868.074638:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x816 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851868.074642:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.074643:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003f6e4f67 refcount 4 to 10490@kfi7
00010000:00000001:16.0:1773851868.074644:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851868.074645:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074645:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851868.074646:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002cf2036b x1858030993059968/t0(0) o400->460256a6-9afd-4dc2-b973-13548ed9db93@10490@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne209-0'
00000100:00100000:16.0:1773851868.074649:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cf2036b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:460256a6-9afd-4dc2-b973-13548ed9db93+6:47985:x1858030993059968:12345-10490@kfi7:400:default-tuolumne209-0 Request processed in 68us (118us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851868.074652:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10490@kfi7, seq: 2156326
00000100:00000040:16.0:1773851868.074653:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000016489b4f : new rpc_count 0
00000100:00000001:16.0:1773851868.074653:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851868.074654:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851868.074655:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:16.0:1773851868.074656:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dae37e2f.
00000020:00000010:16.0:1773851868.074657:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069587fa7.
00000020:00000040:16.0:1773851868.074657:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000016489b4f : new refcount 5
00000100:00000001:16.0:1773851868.074658:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851868.074666:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0F:1773851868.074667:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x816 TN_EVENT_TX_OK event status 0
00000800:00000200:17.0:1773851868.074667:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.074669:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851868.074670:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851868.074672:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10490@kfi7: PUT: OK
00000400:00000200:18.0:1773851868.074673:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018de6a4d
00000800:00000200:17.0:1773851868.074673:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000010:18.0:1773851868.074674:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018de6a4d.
00000100:00000001:18.0:1773851868.074675:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851868.074676:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851868.074676:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:18.0:1773851868.074677:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000400:00000200:17.0:1773851868.074678:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10490@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.074679:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000800:00000200:18.0:1773851868.074680:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 10490@kfi7(00000000b5b05b3f):0x0 lsk 2071 rsk 133 tsk 0 trmk 0 tmk 0 trr 4 tta 0x816 Transaction freed
00000400:00000200:17.0:1773851868.074680:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 1
00000400:00000200:17.0:1773851868.074682:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.074683:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000400:00000200:17.0:1773851868.074685:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 3
00000400:00000200:17.0:1773851868.074686:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.074688:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10490@kfi7 of length 224 into portal 12 MB=0x699de8d52b840
00000400:00000200:17.0:1773851868.074690:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10490@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 11224
00000800:00000200:17.0:1773851868.074693:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.074696:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.074697:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10490@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.074699:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.074699:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.074701:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a88031af.
00000100:00000040:17.0:1773851868.074702:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a88031af x1858030993061952 msgsize 224
00000100:00100000:17.0:1773851868.074705:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-10490@kfi7 (source: 12345-10490@kfi7)
00000100:00000001:17.0:1773851868.074706:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.074707:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000100:00000001:16.0:1773851868.074708:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851868.074708:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851868.074708:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851868.074709:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851868.074710:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851868.074710:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851868.074710:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030993061952
00000020:00000001:16.0:1773851868.074711:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851868.074711:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911ce
00000020:00000001:16.0:1773851868.074712:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851868.074715:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004adb1a15 refcount=6
00000020:00000001:16.0:1773851868.074716:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240535040 : -107152469016576 : ffff9e8b9f25c000)
00000020:00000001:16.0:1773851868.074716:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240535040 : -107152469016576 : ffff9e8b9f25c000)
00000100:00000001:16.0:1773851868.074717:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.074719:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851868.074719:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d3b15942.
00000020:00000010:16.0:1773851868.074720:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851868.074721:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000041c4c030.
00000100:00000001:16.0:1773851868.074722:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851868.074722:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851868.074723:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.074724:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851868.074724:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851868.074729:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.074729:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.074730:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.074731:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851868.074732:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:16.0:1773851868.074732:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10490@kfi7, seq: 2156327
00000100:00000040:16.0:1773851868.074732:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004adb1a15 : new rpc_count 1
00000100:00000001:17.0:1773851868.074733:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851868.074733:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636980530388864 : -107093179162752 : ffff9e996d191f80)
00000100:00000001:17.0:1773851868.074734:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.074734:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.074734:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a88031af x1858030993061952/t0(0) o400->c1139646-0c2f-424f-81a3-6cd99333b4fd@10490@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne209-0'
00000100:00000001:16.0:1773851868.074737:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.074737:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851868.074738:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a88031af pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:c1139646-0c2f-424f-81a3-6cd99333b4fd+6:47984:x1858030993061952:12345-10490@kfi7:400:default-tuolumne209-0
00000100:00000200:16.0:1773851868.074739:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030993061952
00000020:00000001:16.0:1773851868.074740:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851868.074741:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851868.074741:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074742:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851868.074742:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851868.074743:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851868.074743:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030993061952, found 0 last_xid 1858030993061951
00000020:00000001:16.0:1773851868.074744:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851868.074744:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851868.074745:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851868.074745:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074746:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851868.074747:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851868.074747:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851868.074748:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002b4a5579.
02000000:00000001:16.0:1773851868.074748:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.074749:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074749:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851868.074750:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768105, transno 0, xid 1858030993061952
00010000:00000001:16.0:1773851868.074751:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851868.074752:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a88031af x1858030993061952/t0(0) o400->c1139646-0c2f-424f-81a3-6cd99333b4fd@10490@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne209-0'
00010000:00000001:16.0:1773851868.074754:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851868.074754:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851868.074755:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851868.074756:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851868.074757:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003f6e4f67 refcount 5 to 10490@kfi7
00000100:00000001:16.0:1773851868.074757:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370153536 : -107145339398080 : ffff9e8d481b1840)
02000000:00000001:16.0:1773851868.074758:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851868.074758:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.074759:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851868.074760:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10490@kfi7
00000400:00000010:16.0:1773851868.074761:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f39207ae.
00000100:00000200:16.0:1773851868.074762:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030993061952, offset 224
00000400:00000200:16.0:1773851868.074763:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10490@kfi7
00000400:00000200:16.0:1773851868.074764:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.074764:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 1
00000400:00000200:16.0:1773851868.074765:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000400:00000200:16.0:1773851868.074766:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 3
00000400:00000200:16.0:1773851868.074767:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10490@kfi7 local destination
00000400:00000200:16.0:1773851868.074769:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769253:8769253:1024:4294967295] 10490@kfi7 LPNI seq info [24435:24435:16:4294967295]
00000400:00000200:16.0:1773851868.074770:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000400:00000200:16.0:1773851868.074770:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10490@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.074773:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10490@kfi7(10490@kfi7:10490@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851868.074774:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 3
00000800:00000200:16.0:1773851868.074776:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851868.074777:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851868.074779:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851868.074781:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000810 Using peer 10490@kfi7(0x100000000000810)
00000800:00000200:16.0:1773851868.074784:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0x100000000000810: rc=0
00000800:00000200:16.0:1773851868.074785:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000810 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851868.074787:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.074788:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003f6e4f67 refcount 4 to 10490@kfi7
00010000:00000001:16.0:1773851868.074788:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851868.074789:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.074789:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851868.074790:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a88031af x1858030993061952/t0(0) o400->c1139646-0c2f-424f-81a3-6cd99333b4fd@10490@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne209-0'
00000100:00100000:16.0:1773851868.074794:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a88031af pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:c1139646-0c2f-424f-81a3-6cd99333b4fd+6:47984:x1858030993061952:12345-10490@kfi7:400:default-tuolumne209-0 Request processed in 55us (89us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851868.074796:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10490@kfi7, seq: 2156327
00000100:00000040:16.0:1773851868.074797:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004adb1a15 : new rpc_count 0
00000100:00000001:16.0:1773851868.074797:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851868.074798:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851868.074798:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851868.074799:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000041c4c030.
00000020:00000010:16.0:1773851868.074799:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d3b15942.
00000020:00000040:16.0:1773851868.074800:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000004adb1a15 : new refcount 5
00000100:00000001:16.0:1773851868.074801:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851868.074807:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000810 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851868.074810:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.074812:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10490@kfi7: PUT: OK
00000400:00000200:17.0:1773851868.074813:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f39207ae
00000400:00000010:17.0:1773851868.074814:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f39207ae.
00000100:00000001:17.0:1773851868.074815:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851868.074815:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851868.074817:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a76b5627 nid 10490@kfi7 refs 2
00000800:00000200:17.0:1773851868.074819:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 10490@kfi7(000000005f0c3e83):0x0 lsk 2065 rsk 134 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000810 Transaction freed
00000800:00000200:2.0F:1773851868.096895:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851868.096898:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851868.096900:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851868.096904:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851868.096907:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9041@kfi7 to cpt 0
00000400:00000200:2.0:1773851868.096909:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9041@kfi7 : PUT - for me
00000400:00000200:2.0:1773851868.096910:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9041@kfi7 to cpt 0
00000400:00000200:2.0:1773851868.096912:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef45c19b nid 9041@kfi7 refs 1
00000400:00000200:2.0:1773851868.096914:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9041@kfi7 to cpt 0
00000400:00000200:2.0:1773851868.096915:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef45c19b nid 9041@kfi7 refs 2
00000400:00000200:2.0:1773851868.096916:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ef45c19b nid 9041@kfi7 refs 3
00000400:00000200:2.0:1773851868.096918:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9041@kfi7 to cpt 0
00000400:00000200:2.0:1773851868.096919:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9041@kfi7 of length 224 into portal 12 MB=0x69b4cb7ea4e80
00000400:00000200:2.0:1773851868.096922:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9041@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 30736
00000800:00000200:2.0:1773851868.096925:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851868.096927:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851868.096929:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9041@kfi7: PUT: OK
00000100:00000001:2.0:1773851868.096931:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851868.096931:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851868.096933:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009ac57882.
00000100:00000040:2.0:1773851868.096934:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000009ac57882 x1859603665669760 msgsize 224
00000100:00100000:2.0:1773851868.096936:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-9041@kfi7 (source: 12345-9041@kfi7)
00000100:00000001:2.0:1773851868.096938:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851868.096940:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef45c19b nid 9041@kfi7 refs 2
00000100:00000001:0.0F:1773851868.096941:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851868.096942:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851868.096942:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851868.096943:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851868.096944:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851868.096945:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851868.096946:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603665669760
00000020:00000001:0.0:1773851868.096947:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851868.096948:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3892660e
00000020:00000001:0.0:1773851868.096949:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851868.096952:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000735de572 refcount=5
00000020:00000001:0.0:1773851868.096953:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077414859776 : -106996294691840 : ffff9eaffbdcd400)
00000020:00000001:0.0:1773851868.096954:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637077414859776 : -106996294691840 : ffff9eaffbdcd400)
00000100:00000001:0.0:1773851868.096956:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851868.096957:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851868.096958:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eccd9a8a.
00000020:00000010:0.0:1773851868.096959:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851868.096960:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851868.096961:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851868.096962:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851868.096963:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851868.096965:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851868.096965:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851868.096966:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851868.096968:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851868.096969:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851868.096970:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0F:1773851868.096971:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851868.096972:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851868.096972:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9041@kfi7, seq: 1997566
00000100:00000001:1.0:1773851868.096973:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851868.096973:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000735de572 : new rpc_count 1
00000100:00000001:1.0:1773851868.096974:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851868.096974:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706790272 : -106953002761344 : ffff9eba10434380)
00000100:00000040:0.0:1773851868.096976:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009ac57882 x1859603665669760/t0(0) o400->3029700b-353e-489e-aad3-75e1a104b46c@9041@kfi7:508/0 lens 224/0 e 0 to 0 dl 1773852623 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1058-0'
00000100:00000001:0.0:1773851868.096980:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851868.096981:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851868.096983:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ac57882 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3029700b-353e-489e-aad3-75e1a104b46c+5:39526:x1859603665669760:12345-9041@kfi7:400:default-tuolumne1058-0
00000100:00000200:0.0:1773851868.096987:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603665669760
00000020:00000001:0.0:1773851868.096989:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851868.096990:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851868.096991:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851868.096992:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851868.096992:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851868.096994:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851868.096995:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603665669760, found 0 last_xid 1859603665669759
00000020:00000001:0.0:1773851868.096996:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851868.096997:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851868.096998:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851868.096999:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851868.097000:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851868.097001:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851868.097002:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851868.097003:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000075af0d7e.
02000000:00000001:0.0:1773851868.097004:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851868.097005:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851868.097006:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851868.097007:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183258172995, transno 0, xid 1859603665669760
00010000:00000001:0.0:1773851868.097008:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851868.097010:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009ac57882 x1859603665669760/t0(0) o400->3029700b-353e-489e-aad3-75e1a104b46c@9041@kfi7:508/0 lens 224/224 e 0 to 0 dl 1773852623 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1058-0'
00010000:00000001:0.0:1773851868.097014:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851868.097015:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851868.097016:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=101 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851868.097018:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851868.097019:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000252d035a refcount 3 to 9041@kfi7
00000100:00000001:0.0:1773851868.097020:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003040 : -107146751548576 : ffff9e8cf3ef6360)
02000000:00000001:0.0:1773851868.097022:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851868.097023:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851868.097024:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851868.097025:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9041@kfi7
00000400:00000010:0.0:1773851868.097026:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004dfb4d66.
00000100:00000200:0.0:1773851868.097028:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859603665669760, offset 224
00000400:00000200:0.0:1773851868.097030:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9041@kfi7
00000400:00000200:0.0:1773851868.097032:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9041@kfi7 to cpt 0
00000400:00000200:0.0:1773851868.097033:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef45c19b nid 9041@kfi7 refs 1
00000400:00000200:0.0:1773851868.097035:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ef45c19b nid 9041@kfi7 refs 2
00000400:00000200:0.0:1773851868.097037:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ef45c19b nid 9041@kfi7 refs 3
00000400:00000200:0.0:1773851868.097039:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9041@kfi7 local destination
00000400:00000200:0.0:1773851868.097041:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769254:8769254:1024:4294967295] 9041@kfi7 LPNI seq info [18943992:18943992:16:4294967295]
00000400:00000200:0.0:1773851868.097043:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ef45c19b nid 9041@kfi7 refs 2
00000400:00000200:0.0:1773851868.097045:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9041@kfi7 to cpt 0
00000400:00000200:0.0:1773851868.097048:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9041@kfi7(9041@kfi7:9041@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851868.097050:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ef45c19b nid 9041@kfi7 refs 3
00000800:00000200:0.0:1773851868.097052:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851868.097054:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851868.097058:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851868.097061:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x716 Using peer 9041@kfi7(0x716)
00000800:00000200:21.0:1773851868.097066:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:0.0:1773851868.097066:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x716: rc=0
00000800:00000200:21.0:1773851868.097067:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851868.097068:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:0.0:1773851868.097069:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x716 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:21.0:1773851868.097071:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:0.0:1773851868.097072:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851868.097073:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20418@kfi7 to cpt 5
00000100:00000040:0.0:1773851868.097073:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000252d035a refcount 2 to 9041@kfi7
00000400:00000200:21.0:1773851868.097074:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20418@kfi7 : PUT - for me
00010000:00000001:0.0:1773851868.097074:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000400:00000200:21.0:1773851868.097075:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20418@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.097076:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0516747 nid 20418@kfi7 refs 1
00000400:00000200:21.0:1773851868.097077:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20418@kfi7 to cpt 5
00000020:00000001:0.0:1773851868.097077:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851868.097078:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0516747 nid 20418@kfi7 refs 2
00000020:00000001:0.0:1773851868.097078:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000400:00000200:21.0:1773851868.097079:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f0516747 nid 20418@kfi7 refs 3
00000400:00000200:21.0:1773851868.097080:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20418@kfi7 to cpt 5
00000100:00000040:0.0:1773851868.097080:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009ac57882 x1859603665669760/t0(0) o400->3029700b-353e-489e-aad3-75e1a104b46c@9041@kfi7:508/0 lens 224/224 e 0 to 0 dl 1773852623 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1058-0'
00000400:00000200:21.0:1773851868.097081:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20418@kfi7 of length 224 into portal 12 MB=0x69b0a7d49db00
00000400:00000200:21.0:1773851868.097082:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20418@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 36616
00000800:00000200:21.0:1773851868.097084:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851868.097086:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:0.0:1773851868.097086:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ac57882 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3029700b-353e-489e-aad3-75e1a104b46c+5:39526:x1859603665669760:12345-9041@kfi7:400:default-tuolumne1058-0 Request processed in 104us (150us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851868.097087:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20418@kfi7: PUT: OK
00000100:00000001:21.0:1773851868.097088:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851868.097088:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851868.097089:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009665f9cc.
00000100:00000040:21.0:1773851868.097090:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009665f9cc x1859319214234368 msgsize 224
00000100:00100000:0.0:1773851868.097090:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9041@kfi7, seq: 1997566
00000100:00100000:21.0:1773851868.097091:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20418@kfi7 (source: 12345-20418@kfi7)
00000100:00000040:0.0:1773851868.097091:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000735de572 : new rpc_count 0
00000100:00000001:21.0:1773851868.097093:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:0.0:1773851868.097093:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851868.097094:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0516747 nid 20418@kfi7 refs 2
00000100:00000001:0.0:1773851868.097094:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851868.097095:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000100:00000001:22.0:1773851868.097096:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851868.097096:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000020:00000010:0.0:1773851868.097096:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
02000000:00000001:22.0:1773851868.097097:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:0.0:1773851868.097097:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eccd9a8a.
00000100:00000001:22.0:1773851868.097098:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851868.097099:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851868.097099:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000735de572 : new refcount 4
02000000:00000001:22.0:1773851868.097100:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851868.097100:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:22.0:1773851868.097102:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319214234368
00000020:00000001:22.0:1773851868.097103:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851868.097103:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9236a
00000020:00000001:22.0:1773851868.097105:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851868.097109:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006ee10ab7 refcount=6
00000800:00000200:1.0:1773851868.097109:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x716 TN_EVENT_TX_OK event status 0
00000020:00000001:22.0:1773851868.097110:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630277120 : -107123079274496 : ffff9e9276e9a000)
00000020:00000001:22.0:1773851868.097112:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630277120 : -107123079274496 : ffff9e9276e9a000)
00000100:00000001:22.0:1773851868.097113:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:1.0:1773851868.097113:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851868.097114:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851868.097115:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000400:00000200:1.0:1773851868.097115:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9041@kfi7: PUT: OK
00000020:00000010:22.0:1773851868.097117:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000400:00000200:1.0:1773851868.097117:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004dfb4d66
00000400:00000010:1.0:1773851868.097118:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004dfb4d66.
00000020:00000010:22.0:1773851868.097119:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851868.097120:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851868.097120:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851868.097120:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:22.0:1773851868.097121:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851868.097122:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851868.097122:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef45c19b nid 9041@kfi7 refs 2
00000100:00000001:22.0:1773851868.097123:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851868.097124:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851868.097125:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851868.097125:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 9041@kfi7(00000000961e53b7):0x0 lsk 1815 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x716 Transaction freed
00000100:00000001:22.0:1773851868.097127:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851868.097130:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.097130:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.097130:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851868.097131:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851868.097132:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20418@kfi7, seq: 1997979
00000100:00000001:23.0:1773851868.097134:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.097134:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006ee10ab7 : new rpc_count 1
00000100:00000001:23.0:1773851868.097135:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.097135:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788265856 : -106974921285760 : ffff9eb4f5d11f80)
00000100:00000040:22.0:1773851868.097137:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009665f9cc x1859319214234368/t0(0) o400->e971814f-be3b-499e-935f-4e1e2a17a104@20418@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1767-0'
00000100:00000001:22.0:1773851868.097142:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.097143:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851868.097145:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009665f9cc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e971814f-be3b-499e-935f-4e1e2a17a104+6:39511:x1859319214234368:12345-20418@kfi7:400:default-tuolumne1767-0
00000100:00000200:22.0:1773851868.097147:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319214234368
00000020:00000001:22.0:1773851868.097148:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851868.097149:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851868.097150:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.097152:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851868.097152:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851868.097154:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851868.097155:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319214234368, found 0 last_xid 1859319214234367
00000020:00000001:22.0:1773851868.097156:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851868.097157:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851868.097158:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851868.097159:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.097160:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851868.097161:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851868.097162:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851868.097163:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cf43c5aa.
02000000:00000001:22.0:1773851868.097164:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.097166:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.097167:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851868.097168:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154594309, transno 0, xid 1859319214234368
00010000:00000001:22.0:1773851868.097169:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851868.097171:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009665f9cc x1859319214234368/t0(0) o400->e971814f-be3b-499e-935f-4e1e2a17a104@20418@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1767-0'
00010000:00000001:22.0:1773851868.097181:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851868.097182:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851868.097183:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=101 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851868.097185:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851868.097186:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cde03a18 refcount 3 to 20418@kfi7
00000100:00000001:22.0:1773851868.097188:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452288 : -107146752099328 : ffff9e8cf3e6fc00)
02000000:00000001:22.0:1773851868.097189:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851868.097190:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.097191:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851868.097193:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20418@kfi7
00000400:00000010:22.0:1773851868.097194:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004529803e.
00000100:00000200:22.0:1773851868.097195:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859319214234368, offset 224
00000400:00000200:22.0:1773851868.097198:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20418@kfi7
00000400:00000200:22.0:1773851868.097199:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20418@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.097201:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0516747 nid 20418@kfi7 refs 1
00000400:00000200:22.0:1773851868.097203:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f0516747 nid 20418@kfi7 refs 2
00000400:00000200:22.0:1773851868.097205:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f0516747 nid 20418@kfi7 refs 3
00000400:00000200:22.0:1773851868.097207:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20418@kfi7 local destination
00000400:00000200:22.0:1773851868.097209:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769255:8769255:1024:4294967295] 20418@kfi7 LPNI seq info [13647394:13647394:16:4294967295]
00000400:00000200:22.0:1773851868.097212:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f0516747 nid 20418@kfi7 refs 2
00000400:00000200:22.0:1773851868.097214:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20418@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.097217:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20418@kfi7(20418@kfi7:20418@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851868.097219:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f0516747 nid 20418@kfi7 refs 3
00000800:00000200:22.0:1773851868.097222:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.097224:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851868.097228:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851868.097232:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x996 Using peer 20418@kfi7(0x996)
00000800:00000200:22.0:1773851868.097240:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000bfc5a5ad: Posted send of 324 bytes to peer 0x996: rc=0
00000800:00000200:22.0:1773851868.097243:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x996 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851868.097246:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.097248:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cde03a18 refcount 2 to 20418@kfi7
00010000:00000001:22.0:1773851868.097249:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851868.097250:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.097251:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851868.097252:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009665f9cc x1859319214234368/t0(0) o400->e971814f-be3b-499e-935f-4e1e2a17a104@20418@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1767-0'
00000800:00000200:21.0:1773851868.097256:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x996 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851868.097258:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009665f9cc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e971814f-be3b-499e-935f-4e1e2a17a104+6:39511:x1859319214234368:12345-20418@kfi7:400:default-tuolumne1767-0 Request processed in 114us (167us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851868.097258:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851868.097259:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20418@kfi7: PUT: OK
00000400:00000200:21.0:1773851868.097260:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004529803e
00000400:00000010:21.0:1773851868.097261:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004529803e.
00000100:00100000:22.0:1773851868.097262:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20418@kfi7, seq: 1997979
00000100:00000001:21.0:1773851868.097262:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851868.097262:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851868.097263:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0516747 nid 20418@kfi7 refs 2
00000100:00000040:22.0:1773851868.097264:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006ee10ab7 : new rpc_count 0
00000100:00000001:22.0:1773851868.097265:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851868.097265:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2069@kfi7:5 -> 20418@kfi7(000000005da2ce18):0x0 lsk 2455 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x996 Transaction freed
00000100:00000001:22.0:1773851868.097266:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851868.097267:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.097268:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851868.097270:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000020:00000040:22.0:1773851868.097271:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000006ee10ab7 : new refcount 5
00000100:00000001:22.0:1773851868.097272:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0F:1773851868.134842:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851868.134844:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851868.134846:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851868.134849:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851868.134853:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25217@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.134854:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25217@kfi7 : PUT - for me
00000400:00000200:25.0:1773851868.134856:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25217@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.134857:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eb2b804 nid 25217@kfi7 refs 1
00000400:00000200:25.0:1773851868.134859:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25217@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.134860:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eb2b804 nid 25217@kfi7 refs 2
00000400:00000200:25.0:1773851868.134861:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004eb2b804 nid 25217@kfi7 refs 3
00000400:00000200:25.0:1773851868.134862:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25152@kfi7 to cpt 7
00000400:00000200:25.0:1773851868.134864:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25152@kfi7 of length 224 into portal 12 MB=0x69b4c39ad6e80
00000400:00000200:25.0:1773851868.134866:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25152@kfi7 of length 224/224 into md 0x16159c9699 [64] + 9160
00000800:00000200:25.0:1773851868.134868:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851868.134871:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851868.134872:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25217@kfi7: PUT: OK
00000100:00000001:25.0:1773851868.134874:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851868.134874:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851868.134876:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070cb4aff.
00000100:00000040:25.0:1773851868.134877:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000070cb4aff x1859601547751040 msgsize 224
00000100:00100000:25.0:1773851868.134879:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-25152@kfi7 (source: 12345-25217@kfi7)
00000100:00000001:25.0:1773851868.134880:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851868.134882:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004eb2b804 nid 25217@kfi7 refs 2
00000100:00000001:24.0F:1773851868.134883:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851868.134884:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851868.134884:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851868.134885:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851868.134886:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851868.134887:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851868.134888:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601547751040
00000020:00000001:24.0:1773851868.134889:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851868.134890:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff881c3
00000020:00000001:24.0:1773851868.134891:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851868.134893:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c2b4fe2e refcount=5
00000020:00000001:24.0:1773851868.134894:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637058612593664 : -107015096957952 : ffff9eab9b290400)
00000020:00000001:24.0:1773851868.134895:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637058612593664 : -107015096957952 : ffff9eab9b290400)
00000100:00000001:24.0:1773851868.134897:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851868.134898:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851868.134899:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049dcf77c.
00000020:00000010:24.0:1773851868.134900:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851868.134901:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000100:00000001:24.0:1773851868.134902:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851868.134903:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851868.134904:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851868.134905:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851868.134906:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851868.134907:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.134908:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851868.134910:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851868.134910:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851868.134911:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851868.134911:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851868.134913:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25152@kfi7, seq: 2025098
00000100:00000001:25.0:1773851868.134914:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851868.134914:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c2b4fe2e : new rpc_count 1
00000100:00000001:25.0:1773851868.134915:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.134915:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478776576 : -106938230775040 : ffff9ebd80bde300)
00000100:00000040:24.0:1773851868.134917:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000070cb4aff x1859601547751040/t0(0) o400->41529975-591b-4081-ba23-7b051d484cae@25152@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2068-0'
00000100:00000001:24.0:1773851868.134921:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851868.134922:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851868.134923:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070cb4aff pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:41529975-591b-4081-ba23-7b051d484cae+5:39688:x1859601547751040:12345-25152@kfi7:400:default-tuolumne2068-0
00000100:00000200:24.0:1773851868.134928:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601547751040
00000020:00000001:24.0:1773851868.134929:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851868.134930:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851868.134931:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.134932:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851868.134933:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851868.134935:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851868.134936:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601547751040, found 0 last_xid 1859601547751039
00000020:00000001:24.0:1773851868.134937:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851868.134938:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851868.134939:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851868.134940:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.134941:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851868.134942:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851868.134942:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851868.134945:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000289dfd74.
02000000:00000001:24.0:1773851868.134946:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.134947:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.134948:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851868.134949:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182842856980, transno 0, xid 1859601547751040
00010000:00000001:24.0:1773851868.134951:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851868.134952:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000070cb4aff x1859601547751040/t0(0) o400->41529975-591b-4081-ba23-7b051d484cae@25152@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2068-0'
00010000:00000001:24.0:1773851868.134956:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851868.134957:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851868.134958:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=101 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851868.134960:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851868.134961:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000079e2fdab refcount 3 to 25152@kfi7
00000100:00000001:24.0:1773851868.134963:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957481248 : -107146752070368 : ffff9e8cf3e76d20)
02000000:00000001:24.0:1773851868.134964:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851868.134965:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.134966:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851868.134967:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25217@kfi7
00000400:00000010:24.0:1773851868.134968:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fc06c4c8.
00000100:00000200:24.0:1773851868.134971:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601547751040, offset 224
00000400:00000200:24.0:1773851868.134973:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25217@kfi7
00000400:00000200:24.0:1773851868.134974:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25217@kfi7 to cpt 6
00000400:00000200:24.0:1773851868.134976:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eb2b804 nid 25217@kfi7 refs 1
00000400:00000200:24.0:1773851868.134977:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004eb2b804 nid 25217@kfi7 refs 2
00000400:00000200:24.0:1773851868.134979:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004eb2b804 nid 25217@kfi7 refs 3
00000400:00000200:24.0:1773851868.134981:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25217@kfi7 local destination
00000400:00000200:24.0:1773851868.134983:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769256:8769256:1024:4294967295] 25217@kfi7 LPNI seq info [391886:391886:16:4294967295]
00000400:00000200:24.0:1773851868.134985:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004eb2b804 nid 25217@kfi7 refs 2
00000400:00000200:24.0:1773851868.134987:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25217@kfi7 to cpt 6
00000400:00000200:24.0:1773851868.134991:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25217@kfi7(25217@kfi7:25217@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851868.134993:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004eb2b804 nid 25217@kfi7 refs 3
00000800:00000200:24.0:1773851868.134995:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851868.134997:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851868.135001:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851868.135004:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ebb Using peer 25217@kfi7(0x100000000000ebb)
00000800:00000200:24.0:1773851868.135009:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x100000000000ebb: rc=0
00000800:00000200:24.0:1773851868.135011:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ebb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851868.135014:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851868.135016:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000079e2fdab refcount 2 to 25152@kfi7
00010000:00000001:24.0:1773851868.135017:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851868.135018:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.135021:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851868.135022:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000070cb4aff x1859601547751040/t0(0) o400->41529975-591b-4081-ba23-7b051d484cae@25152@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2068-0'
00000100:00100000:24.0:1773851868.135027:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070cb4aff pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:41529975-591b-4081-ba23-7b051d484cae+5:39688:x1859601547751040:12345-25152@kfi7:400:default-tuolumne2068-0 Request processed in 105us (149us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851868.135032:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25152@kfi7, seq: 2025098
00000100:00000040:24.0:1773851868.135033:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c2b4fe2e : new rpc_count 0
00000100:00000001:24.0:1773851868.135034:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851868.135035:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851868.135036:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851868.135037:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000020:00000010:24.0:1773851868.135038:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049dcf77c.
00000020:00000040:24.0:1773851868.135039:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000c2b4fe2e : new refcount 4
00000100:00000001:24.0:1773851868.135041:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851868.135048:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ebb TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851868.135051:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851868.135052:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25217@kfi7: PUT: OK
00000400:00000200:25.0:1773851868.135054:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fc06c4c8
00000400:00000010:25.0:1773851868.135054:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fc06c4c8.
00000100:00000001:25.0:1773851868.135055:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851868.135056:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851868.135057:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004eb2b804 nid 25217@kfi7 refs 2
00000800:00000200:25.0:1773851868.135060:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 25217@kfi7(00000000abf28ba6):0x0 lsk 3772 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ebb Transaction freed
00000800:00000200:17.0:1773851868.201129:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.201130:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.201133:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.201136:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.201139:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13443@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.201141:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13443@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.201142:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13443@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.201144:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b9a8a56 nid 13443@kfi7 refs 1
00000400:00000200:17.0:1773851868.201145:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13443@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.201146:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b9a8a56 nid 13443@kfi7 refs 2
00000400:00000200:17.0:1773851868.201148:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b9a8a56 nid 13443@kfi7 refs 3
00000400:00000200:17.0:1773851868.201149:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13443@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.201151:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13443@kfi7 of length 224 into portal 12 MB=0x699e167ddaa00
00000400:00000200:17.0:1773851868.201153:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13443@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 11448
00000800:00000200:17.0:1773851868.201155:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.201158:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.201160:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13443@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.201161:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.201162:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.201163:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa5e7edf.
00000100:00000040:17.0:1773851868.201164:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000aa5e7edf x1858043249535488 msgsize 224
00000100:00100000:17.0:1773851868.201167:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13443@kfi7 (source: 12345-13443@kfi7)
00000100:00000001:17.0:1773851868.201168:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.201170:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b9a8a56 nid 13443@kfi7 refs 2
00000100:00000001:16.0:1773851868.201171:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851868.201172:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851868.201173:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851868.201173:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851868.201174:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851868.201175:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851868.201177:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043249535488
00000020:00000001:16.0:1773851868.201178:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851868.201178:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92500
00000020:00000001:16.0:1773851868.201179:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851868.201183:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000aec4eef6 refcount=6
00000020:00000001:16.0:1773851868.201184:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630772736 : -107123078778880 : ffff9e9276f13000)
00000020:00000001:16.0:1773851868.201185:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630772736 : -107123078778880 : ffff9e9276f13000)
00000100:00000001:16.0:1773851868.201187:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.201188:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851868.201189:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d3b15942.
00000020:00000010:16.0:1773851868.201191:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851868.201192:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000041c4c030.
00000100:00000001:16.0:1773851868.201194:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851868.201194:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851868.201195:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.201196:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851868.201197:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851868.201198:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.201200:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.201201:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.201202:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.201202:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851868.201203:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851868.201204:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13443@kfi7, seq: 2156328
00000100:00000040:16.0:1773851868.201205:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000aec4eef6 : new rpc_count 1
00000100:00000001:17.0:1773851868.201206:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.201206:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636980530401536 : -107093179150080 : ffff9e996d195100)
00000100:00000001:17.0:1773851868.201207:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.201208:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa5e7edf x1858043249535488/t0(0) o400->f34e4250-9b62-4d06-a811-1b1f8219e4c6@13443@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1336-0'
00000100:00000001:16.0:1773851868.201213:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.201213:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851868.201215:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa5e7edf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f34e4250-9b62-4d06-a811-1b1f8219e4c6+6:39829:x1858043249535488:12345-13443@kfi7:400:default-tuolumne1336-0
00000100:00000200:16.0:1773851868.201220:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043249535488
00000020:00000001:16.0:1773851868.201221:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851868.201222:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851868.201223:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.201225:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851868.201225:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851868.201227:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851868.201228:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043249535488, found 0 last_xid 1858043249535487
00000020:00000001:16.0:1773851868.201229:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851868.201230:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851868.201231:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851868.201232:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.201233:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851868.201234:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851868.201234:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851868.201237:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004be1397d.
02000000:00000001:16.0:1773851868.201238:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.201239:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.201240:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851868.201241:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096687853, transno 0, xid 1858043249535488
00010000:00000001:16.0:1773851868.201242:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851868.201244:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa5e7edf x1858043249535488/t0(0) o400->f34e4250-9b62-4d06-a811-1b1f8219e4c6@13443@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1336-0'
00010000:00000001:16.0:1773851868.201248:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851868.201249:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851868.201250:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851868.201252:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851868.201253:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007eea71b5 refcount 3 to 13443@kfi7
00000100:00000001:16.0:1773851868.201254:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332608 : -107155408219008 : ffff9e8aeff51480)
02000000:00000001:16.0:1773851868.201255:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851868.201256:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.201257:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851868.201258:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13443@kfi7
00000400:00000010:16.0:1773851868.201259:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025c7e96e.
00000100:00000200:16.0:1773851868.201262:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043249535488, offset 224
00000400:00000200:16.0:1773851868.201264:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13443@kfi7
00000400:00000200:16.0:1773851868.201266:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13443@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.201267:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b9a8a56 nid 13443@kfi7 refs 1
00000400:00000200:16.0:1773851868.201268:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b9a8a56 nid 13443@kfi7 refs 2
00000400:00000200:16.0:1773851868.201270:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b9a8a56 nid 13443@kfi7 refs 3
00000400:00000200:16.0:1773851868.201272:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13443@kfi7 local destination
00000400:00000200:16.0:1773851868.201274:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769257:8769257:1024:4294967295] 13443@kfi7 LPNI seq info [6828849:6828849:16:4294967295]
00000400:00000200:16.0:1773851868.201277:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b9a8a56 nid 13443@kfi7 refs 2
00000400:00000200:16.0:1773851868.201278:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13443@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.201281:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13443@kfi7(13443@kfi7:13443@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851868.201283:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b9a8a56 nid 13443@kfi7 refs 3
00000800:00000200:16.0:1773851868.201286:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851868.201288:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851868.201291:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851868.201295:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008c2 Using peer 13443@kfi7(0x1000000000008c2)
00000800:00000200:16.0:1773851868.201300:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x1000000000008c2: rc=0
00000800:00000200:16.0:1773851868.201303:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008c2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851868.201306:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.201308:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007eea71b5 refcount 2 to 13443@kfi7
00010000:00000001:16.0:1773851868.201312:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851868.201312:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.201314:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851868.201315:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa5e7edf x1858043249535488/t0(0) o400->f34e4250-9b62-4d06-a811-1b1f8219e4c6@13443@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1336-0'
00000100:00100000:16.0:1773851868.201321:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa5e7edf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f34e4250-9b62-4d06-a811-1b1f8219e4c6+6:39829:x1858043249535488:12345-13443@kfi7:400:default-tuolumne1336-0 Request processed in 107us (155us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851868.201326:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13443@kfi7, seq: 2156328
00000100:00000040:16.0:1773851868.201328:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000aec4eef6 : new rpc_count 0
00000100:00000001:16.0:1773851868.201329:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851868.201330:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851868.201331:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851868.201332:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000041c4c030.
00000020:00000010:16.0:1773851868.201334:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d3b15942.
00000020:00000040:16.0:1773851868.201335:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000aec4eef6 : new refcount 5
00000100:00000001:16.0:1773851868.201336:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851868.201345:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008c2 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851868.201348:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.201350:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13443@kfi7: PUT: OK
00000400:00000200:17.0:1773851868.201352:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025c7e96e
00000400:00000010:17.0:1773851868.201353:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025c7e96e.
00000100:00000001:17.0:1773851868.201354:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851868.201355:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851868.201356:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b9a8a56 nid 13443@kfi7 refs 2
00000800:00000200:17.0:1773851868.201359:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 13443@kfi7(0000000057061f9f):0x0 lsk 2243 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008c2 Transaction freed
00000800:00000200:29.0F:1773851868.210539:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851868.210540:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851868.210541:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851868.210543:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851868.210545:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.210546:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22560@kfi7 : PUT - for me
00000400:00000200:29.0:1773851868.210547:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.210547:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 1
00000400:00000200:29.0:1773851868.210549:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.210549:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000400:00000200:29.0:1773851868.210550:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 3
00000400:00000200:29.0:1773851868.210551:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22753@kfi7 to cpt 5
00000400:00000200:29.0:1773851868.210551:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22753@kfi7 of length 224 into portal 12 MB=0x69b0a2a284800
00000400:00000200:29.0:1773851868.210552:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22753@kfi7 of length 224/224 into md 0x77fe139dd [64] + 176200
00000800:00000200:29.0:1773851868.210554:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851868.210555:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851868.210556:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22560@kfi7: PUT: OK
00000100:00000001:29.0:1773851868.210557:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851868.210557:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851868.210558:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ceb28833.
00000100:00000040:29.0:1773851868.210558:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ceb28833 x1859317819525120 msgsize 224
00000100:00100000:29.0:1773851868.210560:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22753@kfi7 (source: 12345-22560@kfi7)
00000100:00000001:29.0:1773851868.210561:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851868.210561:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000100:00000001:28.0F:1773851868.210562:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851868.210563:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851868.210563:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851868.210564:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851868.210564:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851868.210565:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851868.210566:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317819525120
00000020:00000001:28.0:1773851868.210567:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851868.210567:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92848
00000020:00000001:28.0:1773851868.210568:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851868.210571:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d7a06a7b refcount=6
00000020:00000001:28.0:1773851868.210572:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742947840 : -107128966603776 : ffff9e9118001c00)
00000020:00000001:28.0:1773851868.210573:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742947840 : -107128966603776 : ffff9e9118001c00)
00000100:00000001:28.0:1773851868.210574:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851868.210575:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851868.210575:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000adb0a5b7.
00000020:00000010:28.0:1773851868.210576:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851868.210577:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851868.210578:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851868.210578:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851868.210579:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851868.210580:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851868.210580:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851868.210581:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.210582:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851868.210583:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851868.210583:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0F:1773851868.210584:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:28.0:1773851868.210584:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22753@kfi7, seq: 2055523
00000100:00000040:28.0:1773851868.210585:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d7a06a7b : new rpc_count 1
00000100:00000001:31.0:1773851868.210586:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851868.210586:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309683712 : -106988399867904 : ffff9eb1d26e4800)
00000100:00000001:31.0:1773851868.210587:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851868.210587:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ceb28833 x1859317819525120/t0(0) o400->ed6aeb53-106c-467c-84f9-c5136b665918@22753@kfi7:656/0 lens 224/0 e 0 to 0 dl 1773852016 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1903-0'
00000100:00000001:31.0:1773851868.210588:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.210590:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851868.210590:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851868.210591:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ceb28833 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ed6aeb53-106c-467c-84f9-c5136b665918+6:39878:x1859317819525120:12345-22753@kfi7:400:default-tuolumne1903-0
00000100:00000200:28.0:1773851868.210594:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317819525120
00000020:00000001:28.0:1773851868.210594:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851868.210595:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851868.210596:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.210596:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851868.210597:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851868.210598:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851868.210598:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317819525120, found 0 last_xid 1859317819525119
00000020:00000001:28.0:1773851868.210599:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851868.210600:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851868.210600:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851868.210601:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.210602:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851868.210602:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851868.210603:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851868.210603:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006eaed4a4.
02000000:00000001:28.0:1773851868.210604:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.210604:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.210605:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851868.210606:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915823625, transno 0, xid 1859317819525120
00010000:00000001:28.0:1773851868.210607:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851868.210608:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ceb28833 x1859317819525120/t0(0) o400->ed6aeb53-106c-467c-84f9-c5136b665918@22753@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1903-0'
00010000:00000001:28.0:1773851868.210610:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851868.210611:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851868.210611:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=101 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851868.210612:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851868.210613:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000919ef92e refcount 5 to 22753@kfi7
00000100:00000001:28.0:1773851868.210614:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107456 : -107156354444160 : ffff9e8ab78ed480)
02000000:00000001:28.0:1773851868.210615:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851868.210616:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.210616:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851868.210617:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22560@kfi7
00000400:00000010:28.0:1773851868.210618:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f11aa4e7.
00000100:00000200:28.0:1773851868.210619:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317819525120, offset 224
00000400:00000200:28.0:1773851868.210620:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22560@kfi7
00000400:00000200:28.0:1773851868.210621:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:28.0:1773851868.210621:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 1
00000400:00000200:28.0:1773851868.210623:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000400:00000200:28.0:1773851868.210624:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 3
00000400:00000200:28.0:1773851868.210625:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22560@kfi7 local destination
00000400:00000200:28.0:1773851868.210626:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769258:8769258:1024:4294967295] 22560@kfi7 LPNI seq info [666494:666494:16:4294967295]
00000400:00000200:28.0:1773851868.210627:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000400:00000200:28.0:1773851868.210628:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:28.0:1773851868.210630:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22560@kfi7(22560@kfi7:22560@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851868.210631:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 3
00000800:00000200:28.0:1773851868.210633:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851868.210634:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851868.210636:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851868.210638:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd5f Using peer 22560@kfi7(0xd5f)
00000800:00000200:28.0:1773851868.210641:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0xd5f: rc=0
00000800:00000200:28.0:1773851868.210642:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd5f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851868.210644:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851868.210645:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000919ef92e refcount 4 to 22753@kfi7
00010000:00000001:28.0:1773851868.210646:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851868.210646:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851868.210647:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851868.210647:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ceb28833 x1859317819525120/t0(0) o400->ed6aeb53-106c-467c-84f9-c5136b665918@22753@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1903-0'
00000100:00100000:28.0:1773851868.210652:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ceb28833 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ed6aeb53-106c-467c-84f9-c5136b665918+6:39878:x1859317819525120:12345-22753@kfi7:400:default-tuolumne1903-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851868.210654:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22753@kfi7, seq: 2055523
00000100:00000040:28.0:1773851868.210655:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d7a06a7b : new rpc_count 0
00000100:00000001:28.0:1773851868.210656:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851868.210656:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851868.210657:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851868.210657:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000020:00000010:28.0:1773851868.210658:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000adb0a5b7.
00000020:00000040:28.0:1773851868.210659:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000d7a06a7b : new refcount 5
00000100:00000001:28.0:1773851868.210660:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851868.210665:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd5f TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851868.210666:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851868.210667:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22560@kfi7: PUT: OK
00000400:00000200:29.0:1773851868.210670:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f11aa4e7
00000400:00000010:29.0:1773851868.210671:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f11aa4e7.
00000100:00000001:29.0:1773851868.210671:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851868.210672:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851868.210673:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000800:00000200:29.0:1773851868.210674:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 22560@kfi7(000000005751c803):0x0 lsk 3424 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd5f Transaction freed
00000800:00000200:9.0F:1773851868.253595:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851868.253597:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851868.253598:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851868.253600:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851868.253602:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24899@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.253603:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24899@kfi7 : PUT - for me
00000400:00000200:9.0:1773851868.253604:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24899@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.253605:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050818e6d nid 24899@kfi7 refs 1
00000400:00000200:9.0:1773851868.253606:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24899@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.253606:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050818e6d nid 24899@kfi7 refs 2
00000400:00000200:9.0:1773851868.253607:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000050818e6d nid 24899@kfi7 refs 3
00000400:00000200:9.0:1773851868.253608:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24899@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.253609:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24899@kfi7 of length 224 into portal 12 MB=0x69b4c3d0640c0
00000400:00000200:9.0:1773851868.253610:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24899@kfi7 of length 224/224 into md 0x78146ce49 [64] + 137392
00000800:00000200:9.0:1773851868.253611:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851868.253613:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851868.253614:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24899@kfi7: PUT: OK
00000100:00000001:9.0:1773851868.253614:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851868.253615:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851868.253616:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac6b4222.
00000100:00000040:9.0:1773851868.253616:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ac6b4222 x1859601603903680 msgsize 224
00000100:00100000:9.0:1773851868.253617:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24899@kfi7 (source: 12345-24899@kfi7)
00000100:00000001:9.0:1773851868.253618:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851868.253619:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000050818e6d nid 24899@kfi7 refs 2
00000100:00000001:11.0F:1773851868.253620:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851868.253620:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851868.253621:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851868.253622:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851868.253623:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851868.253624:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851868.253624:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601603903680
00000020:00000001:11.0:1773851868.253625:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851868.253626:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8125d
00000020:00000001:11.0:1773851868.253626:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851868.253629:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dc9e79f8 refcount=9
00000020:00000001:11.0:1773851868.253630:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061308911616 : -107012400640000 : ffff9eac3bdf9000)
00000020:00000001:11.0:1773851868.253631:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637061308911616 : -107012400640000 : ffff9eac3bdf9000)
00000100:00000001:11.0:1773851868.253632:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851868.253633:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851868.253634:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006c0219a7.
00000020:00000010:11.0:1773851868.253635:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851868.253636:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000076194eba.
00000100:00000001:11.0:1773851868.253637:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851868.253637:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851868.253638:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851868.253639:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851868.253640:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851868.253640:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.253641:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851868.253643:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851868.253643:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851868.253643:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851868.253643:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851868.253644:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24899@kfi7, seq: 2130782
00000100:00000001:11.0:1773851868.253645:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851868.253645:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dc9e79f8 : new rpc_count 3
00000100:00000001:11.0:1773851868.253646:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851868.253646:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749195648 : -106947960355968 : ffff9ebb3cd04380)
00000100:00000040:9.0:1773851868.253647:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ac6b4222 x1859601603903680/t0(0) o400->ecbd1db4-b008-4e21-a987-5be2d7eeac87@24899@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2056-0'
00000100:00000001:9.0:1773851868.253650:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851868.253650:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851868.253651:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6b4222 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:ecbd1db4-b008-4e21-a987-5be2d7eeac87+9:39482:x1859601603903680:12345-24899@kfi7:400:default-tuolumne2056-0
00000100:00000200:9.0:1773851868.253653:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601603903680
00000020:00000001:9.0:1773851868.253653:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851868.253654:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851868.253655:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851868.253655:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851868.253656:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851868.253657:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851868.253657:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601603903680, found 0 last_xid 1859601603051711
00000020:00000001:9.0:1773851868.253658:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851868.253659:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851868.253659:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851868.253660:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851868.253660:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851868.253661:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851868.253661:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851868.253662:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000275fbc19.
02000000:00000001:9.0:1773851868.253663:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851868.253663:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851868.253664:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851868.253665:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264198637, transno 0, xid 1859601603903680
00010000:00000001:9.0:1773851868.253665:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851868.253666:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ac6b4222 x1859601603903680/t0(0) o400->ecbd1db4-b008-4e21-a987-5be2d7eeac87@24899@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2056-0'
00010000:00000001:9.0:1773851868.253668:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851868.253669:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851868.253670:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=101 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851868.253671:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851868.253672:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000026edc84d refcount 3 to 24899@kfi7
00000100:00000001:9.0:1773851868.253673:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810486656 : -107154899064960 : ffff9e8b0e4e2780)
02000000:00000001:9.0:1773851868.253673:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851868.253674:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851868.253675:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851868.253675:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24899@kfi7
00000400:00000010:9.0:1773851868.253676:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000100:00000200:9.0:1773851868.253676:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601603903680, offset 224
00000400:00000200:9.0:1773851868.253678:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24899@kfi7
00000400:00000200:9.0:1773851868.253679:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24899@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.253679:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050818e6d nid 24899@kfi7 refs 1
00000400:00000200:9.0:1773851868.253680:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000050818e6d nid 24899@kfi7 refs 2
00000400:00000200:9.0:1773851868.253681:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000050818e6d nid 24899@kfi7 refs 3
00000400:00000200:9.0:1773851868.253682:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24899@kfi7 local destination
00000400:00000200:9.0:1773851868.253683:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769259:8769259:1024:4294967295] 24899@kfi7 LPNI seq info [149948:149948:16:4294967295]
00000400:00000200:9.0:1773851868.253685:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000050818e6d nid 24899@kfi7 refs 2
00000400:00000200:9.0:1773851868.253685:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24899@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.253687:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24899@kfi7(24899@kfi7:24899@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851868.253688:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000050818e6d nid 24899@kfi7 refs 3
00000800:00000200:9.0:1773851868.253689:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851868.253690:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851868.253692:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851868.253694:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3c2 Using peer 24899@kfi7(0x3c2)
00000800:00000200:9.0:1773851868.253697:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x3c2: rc=0
00000800:00000200:9.0:1773851868.253698:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3c2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851868.253700:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851868.253701:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000026edc84d refcount 2 to 24899@kfi7
00010000:00000001:9.0:1773851868.253702:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851868.253702:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851868.253703:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851868.253703:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac6b4222 x1859601603903680/t0(0) o400->ecbd1db4-b008-4e21-a987-5be2d7eeac87@24899@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2056-0'
00000100:00100000:9.0:1773851868.253706:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6b4222 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:ecbd1db4-b008-4e21-a987-5be2d7eeac87+9:39482:x1859601603903680:12345-24899@kfi7:400:default-tuolumne2056-0 Request processed in 55us (89us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851868.253708:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24899@kfi7, seq: 2130782
00000100:00000040:9.0:1773851868.253709:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dc9e79f8 : new rpc_count 2
00000800:00000200:10.0F:1773851868.253710:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3c2 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851868.253710:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851868.253710:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851868.253711:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000400:00000200:10.0:1773851868.253712:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851868.253712:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000076194eba.
00000400:00000200:10.0:1773851868.253713:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24899@kfi7: PUT: OK
00000020:00000010:9.0:1773851868.253713:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006c0219a7.
00000400:00000200:10.0:1773851868.253714:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000020:00000040:9.0:1773851868.253714:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000dc9e79f8 : new refcount 8
00000100:00000001:9.0:1773851868.253714:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:10.0:1773851868.253715:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:10.0:1773851868.253716:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851868.253716:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851868.253717:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000050818e6d nid 24899@kfi7 refs 2
00000800:00000200:10.0:1773851868.253719:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 24899@kfi7(00000000972cf8e0):0x0 lsk 963 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3c2 Transaction freed
00000800:00000200:14.0F:1773851868.257015:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851868.257016:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851868.257018:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851868.257020:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851868.257022:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11872@kfi7 to cpt 3
00000400:00000200:14.0:1773851868.257023:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11872@kfi7 : PUT - for me
00000400:00000200:14.0:1773851868.257024:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11872@kfi7 to cpt 3
00000400:00000200:14.0:1773851868.257026:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001724afc7 nid 11872@kfi7 refs 1
00000400:00000200:14.0:1773851868.257028:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11872@kfi7 to cpt 3
00000400:00000200:14.0:1773851868.257028:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001724afc7 nid 11872@kfi7 refs 2
00000400:00000200:14.0:1773851868.257029:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001724afc7 nid 11872@kfi7 refs 3
00000400:00000200:14.0:1773851868.257030:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11872@kfi7 to cpt 3
00000400:00000200:14.0:1773851868.257031:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11872@kfi7 of length 224 into portal 12 MB=0x69b4c3aee7100
00000400:00000200:14.0:1773851868.257032:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11872@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 29128
00000800:00000200:14.0:1773851868.257034:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851868.257036:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851868.257037:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11872@kfi7: PUT: OK
00000100:00000001:14.0:1773851868.257038:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851868.257039:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851868.257040:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec89a980.
00000100:00000040:14.0:1773851868.257040:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000ec89a980 x1859601568788736 msgsize 224
00000100:00100000:14.0:1773851868.257042:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-11872@kfi7 (source: 12345-11872@kfi7)
00000100:00000001:14.0:1773851868.257043:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851868.257044:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001724afc7 nid 11872@kfi7 refs 2
00000100:00000001:15.0F:1773851868.257045:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851868.257045:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851868.257046:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851868.257047:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851868.257048:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851868.257049:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851868.257050:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601568788736
00000020:00000001:15.0:1773851868.257051:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851868.257051:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff85fa3
00000020:00000001:15.0:1773851868.257052:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851868.257058:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a9d3d7d4 refcount=5
00000020:00000001:15.0:1773851868.257059:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098506322944 : -106975203228672 : ffff9eb4e5030400)
00000020:00000001:15.0:1773851868.257060:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098506322944 : -106975203228672 : ffff9eb4e5030400)
00000100:00000001:15.0:1773851868.257061:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.257062:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851868.257063:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cc81a8a8.
00000020:00000010:15.0:1773851868.257064:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851868.257065:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851868.257067:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851868.257067:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851868.257068:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.257069:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851868.257070:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851868.257070:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.257072:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.257073:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851868.257074:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851868.257075:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11872@kfi7, seq: 2289836
00000100:00000001:12.0F:1773851868.257075:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:15.0:1773851868.257076:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a9d3d7d4 : new rpc_count 1
00000100:00000001:15.0:1773851868.257077:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341803776 : -106946367747840 : ffff9ebb9bbd8900)
00000100:00000001:12.0:1773851868.257077:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851868.257077:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.257078:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.257079:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ec89a980 x1859601568788736/t0(0) o400->98c1b2c4-f309-4770-a055-5e10e248118a@11872@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1232-0'
00000100:00000001:15.0:1773851868.257082:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.257082:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851868.257084:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec89a980 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:98c1b2c4-f309-4770-a055-5e10e248118a+5:39747:x1859601568788736:12345-11872@kfi7:400:default-tuolumne1232-0
00000100:00000200:15.0:1773851868.257087:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601568788736
00000020:00000001:15.0:1773851868.257087:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851868.257088:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851868.257089:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.257090:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851868.257091:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851868.257092:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851868.257093:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601568788736, found 0 last_xid 1859601568788735
00000020:00000001:15.0:1773851868.257094:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851868.257094:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851868.257095:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851868.257096:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.257096:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851868.257098:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851868.257098:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851868.257100:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fa832465.
02000000:00000001:15.0:1773851868.257100:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.257101:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.257102:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851868.257102:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690944945, transno 0, xid 1859601568788736
00010000:00000001:15.0:1773851868.257103:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851868.257105:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ec89a980 x1859601568788736/t0(0) o400->98c1b2c4-f309-4770-a055-5e10e248118a@11872@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1232-0'
00010000:00000001:15.0:1773851868.257108:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851868.257108:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851868.257109:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=101 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851868.257111:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851868.257112:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c0ed86cb refcount 3 to 11872@kfi7
00000100:00000001:15.0:1773851868.257112:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298880 : -107155980252736 : ffff9e8acddc89c0)
02000000:00000001:15.0:1773851868.257113:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851868.257114:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.257114:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851868.257115:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11872@kfi7
00000400:00000010:15.0:1773851868.257116:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022f323c7.
00000100:00000200:15.0:1773851868.257118:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601568788736, offset 224
00000400:00000200:15.0:1773851868.257120:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11872@kfi7
00000400:00000200:15.0:1773851868.257121:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11872@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.257122:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001724afc7 nid 11872@kfi7 refs 1
00000400:00000200:15.0:1773851868.257123:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001724afc7 nid 11872@kfi7 refs 2
00000400:00000200:15.0:1773851868.257125:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001724afc7 nid 11872@kfi7 refs 3
00000400:00000200:15.0:1773851868.257126:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11872@kfi7 local destination
00000400:00000200:15.0:1773851868.257127:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769260:8769260:1024:4294967295] 11872@kfi7 LPNI seq info [221257:221257:16:4294967295]
00000400:00000200:15.0:1773851868.257129:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001724afc7 nid 11872@kfi7 refs 2
00000400:00000200:15.0:1773851868.257129:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11872@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.257131:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11872@kfi7(11872@kfi7:11872@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851868.257133:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001724afc7 nid 11872@kfi7 refs 3
00000800:00000200:15.0:1773851868.257134:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851868.257135:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851868.257138:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851868.257140:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000068b Using peer 11872@kfi7(0x10000000000068b)
00000800:00000200:15.0:1773851868.257145:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x10000000000068b: rc=0
00000800:00000200:15.0:1773851868.257147:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000068b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851868.257149:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.257149:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c0ed86cb refcount 2 to 11872@kfi7
00010000:00000001:15.0:1773851868.257150:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851868.257151:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.257151:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851868.257152:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec89a980 x1859601568788736/t0(0) o400->98c1b2c4-f309-4770-a055-5e10e248118a@11872@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1232-0'
00000100:00100000:15.0:1773851868.257155:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec89a980 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:98c1b2c4-f309-4770-a055-5e10e248118a+5:39747:x1859601568788736:12345-11872@kfi7:400:default-tuolumne1232-0 Request processed in 72us (114us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851868.257159:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11872@kfi7, seq: 2289836
00000800:00000200:14.0:1773851868.257159:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000068b TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851868.257160:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a9d3d7d4 : new rpc_count 0
00000100:00000001:15.0:1773851868.257161:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851868.257161:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851868.257161:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851868.257162:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:14.0:1773851868.257162:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11872@kfi7: PUT: OK
00000020:00000010:15.0:1773851868.257163:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000400:00000200:14.0:1773851868.257163:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022f323c7
00000020:00000010:15.0:1773851868.257164:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cc81a8a8.
00000400:00000010:14.0:1773851868.257164:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022f323c7.
00000100:00000001:14.0:1773851868.257164:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:15.0:1773851868.257165:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000a9d3d7d4 : new refcount 4
00000100:00000001:14.0:1773851868.257165:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851868.257166:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851868.257166:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001724afc7 nid 11872@kfi7 refs 2
00000800:00000200:14.0:1773851868.257167:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 11872@kfi7(00000000092cdcfd):0x0 lsk 1676 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000068b Transaction freed
00000800:00000200:25.0:1773851868.272205:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851868.272206:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851868.272207:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851868.272209:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851868.272211:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.272212:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19706@kfi7 : PUT - for me
00000400:00000200:25.0:1773851868.272213:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.272214:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 1
00000400:00000200:25.0:1773851868.272214:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.272215:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000400:00000200:25.0:1773851868.272216:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 3
00000400:00000200:25.0:1773851868.272216:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.272217:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19706@kfi7 of length 224 into portal 12 MB=0x699de8a895000
00000400:00000200:25.0:1773851868.272218:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19706@kfi7 of length 224/224 into md 0x16159c9699 [64] + 9384
00000800:00000200:25.0:1773851868.272220:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851868.272221:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851868.272222:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19706@kfi7: PUT: OK
00000100:00000001:25.0:1773851868.272223:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851868.272224:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851868.272225:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000027617718.
00000100:00000040:25.0:1773851868.272225:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000027617718 x1858030946308096 msgsize 224
00000100:00100000:25.0:1773851868.272227:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19706@kfi7 (source: 12345-19706@kfi7)
00000100:00000001:25.0:1773851868.272228:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851868.272229:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000800:00000200:25.0:1773851868.272230:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851868.272230:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851868.272231:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851868.272232:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851868.272233:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851868.272234:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851868.272235:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030946308096
00000020:00000001:24.0:1773851868.272236:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851868.272236:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910d2
00000020:00000001:24.0:1773851868.272238:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851868.272240:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008bcf10ab refcount=6
00000020:00000001:24.0:1773851868.272241:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240349696 : -107152469201920 : ffff9e8b9f22ec00)
00000020:00000001:24.0:1773851868.272242:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240349696 : -107152469201920 : ffff9e8b9f22ec00)
00000100:00000001:24.0:1773851868.272244:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851868.272245:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851868.272246:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049dcf77c.
00000020:00000010:24.0:1773851868.272247:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851868.272249:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000aad4d71e.
00000100:00000001:24.0:1773851868.272250:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851868.272251:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851868.272251:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851868.272253:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851868.272254:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851868.272254:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.272256:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851868.272257:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851868.272258:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851868.272258:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:25.0:1773851868.272259:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19706@kfi7, seq: 2025099
00000100:00000001:24.0:1773851868.272259:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:25.0:1773851868.272260:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008bcf10ab : new rpc_count 1
00000100:00000001:25.0:1773851868.272260:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478752384 : -106938230799232 : ffff9ebd80bd8480)
00000100:00000001:24.0:1773851868.272260:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851868.272261:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000027617718 x1858030946308096/t0(0) o400->929acc84-be1c-435f-8812-cbddf6d0e3e6@19706@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne245-0'
00000100:00000001:24.0:1773851868.272261:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.272264:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851868.272264:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851868.272265:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027617718 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:929acc84-be1c-435f-8812-cbddf6d0e3e6+6:48030:x1858030946308096:12345-19706@kfi7:400:default-tuolumne245-0
00000100:00000200:25.0:1773851868.272266:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030946308096
00000020:00000001:25.0:1773851868.272267:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851868.272268:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851868.272268:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.272269:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851868.272269:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851868.272270:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851868.272271:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030946308096, found 0 last_xid 1858030946308095
00000020:00000001:25.0:1773851868.272272:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851868.272272:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851868.272273:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851868.272273:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.272274:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851868.272275:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851868.272276:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851868.272276:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000085feb88.
02000000:00000001:25.0:1773851868.272277:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.272278:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.272278:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851868.272279:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030946308096
00010000:00000001:25.0:1773851868.272280:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851868.272281:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000027617718 x1858030946308096/t0(0) o400->929acc84-be1c-435f-8812-cbddf6d0e3e6@19706@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne245-0'
00010000:00000001:25.0:1773851868.272283:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851868.272283:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851868.272284:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=101 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851868.272285:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851868.272286:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005d6e1d9c refcount 5 to 19706@kfi7
00000100:00000001:25.0:1773851868.272286:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335296 : -107152617216320 : ffff9e8b965066c0)
02000000:00000001:25.0:1773851868.272287:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851868.272288:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.272288:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851868.272289:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19706@kfi7
00000400:00000010:25.0:1773851868.272290:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000971be53b.
00000100:00000200:25.0:1773851868.272290:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030946308096, offset 224
00000400:00000200:25.0:1773851868.272292:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19706@kfi7
00000400:00000200:25.0:1773851868.272293:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.272293:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 1
00000400:00000200:25.0:1773851868.272294:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000400:00000200:25.0:1773851868.272295:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 3
00000400:00000200:25.0:1773851868.272297:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19706@kfi7 local destination
00000400:00000200:25.0:1773851868.272298:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769261:8769261:1024:4294967295] 19706@kfi7 LPNI seq info [24385:24385:16:4294967295]
00000400:00000200:25.0:1773851868.272299:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000400:00000200:25.0:1773851868.272300:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.272302:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19706@kfi7(19706@kfi7:19706@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851868.272303:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 3
00000800:00000200:25.0:1773851868.272305:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851868.272306:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851868.272308:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851868.272310:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001b5 Using peer 19706@kfi7(0x1000000000001b5)
00000800:00000200:25.0:1773851868.272313:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000016005f0: Posted send of 324 bytes to peer 0x1000000000001b5: rc=0
00000800:00000200:25.0:1773851868.272314:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851868.272316:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851868.272317:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005d6e1d9c refcount 4 to 19706@kfi7
00010000:00000001:25.0:1773851868.272318:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851868.272318:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.272319:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851868.272319:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000027617718 x1858030946308096/t0(0) o400->929acc84-be1c-435f-8812-cbddf6d0e3e6@19706@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne245-0'
00000100:00100000:25.0:1773851868.272322:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027617718 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:929acc84-be1c-435f-8812-cbddf6d0e3e6+6:48030:x1858030946308096:12345-19706@kfi7:400:default-tuolumne245-0 Request processed in 57us (96us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851868.272324:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19706@kfi7, seq: 2025099
00000100:00000040:25.0:1773851868.272325:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008bcf10ab : new rpc_count 0
00000100:00000001:25.0:1773851868.272326:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851868.272326:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851868.272327:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:25.0:1773851868.272328:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000aad4d71e.
00000020:00000010:25.0:1773851868.272329:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049dcf77c.
00000020:00000040:25.0:1773851868.272329:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000008bcf10ab : new refcount 5
00000800:00000200:27.0F:1773851868.272330:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001b5 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851868.272330:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851868.272332:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851868.272333:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19706@kfi7: PUT: OK
00000400:00000200:27.0:1773851868.272333:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000971be53b
00000400:00000010:27.0:1773851868.272334:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000971be53b.
00000100:00000001:27.0:1773851868.272334:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851868.272335:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851868.272336:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000800:00000200:27.0:1773851868.272337:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19706@kfi7(000000000dd8a7fb):0x0 lsk 438 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001b5 Transaction freed
00000800:00000200:27.0:1773851868.272786:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851868.272786:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851868.272787:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:27.0:1773851868.272789:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851868.272791:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:27.0:1773851868.272792:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19706@kfi7 : PUT - for me
00000400:00000200:27.0:1773851868.272792:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:27.0:1773851868.272793:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 1
00000400:00000200:27.0:1773851868.272794:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:27.0:1773851868.272794:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000400:00000200:27.0:1773851868.272795:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 3
00000400:00000200:27.0:1773851868.272796:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:27.0:1773851868.272796:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19706@kfi7 of length 224 into portal 12 MB=0x699de8a895880
00000400:00000200:27.0:1773851868.272798:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19706@kfi7 of length 224/224 into md 0x16159c9699 [64] + 9608
00000800:00000200:27.0:1773851868.272799:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851868.272801:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851868.272802:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19706@kfi7: PUT: OK
00000100:00000001:27.0:1773851868.272802:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851868.272803:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851868.272804:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001072e527.
00000100:00000040:27.0:1773851868.272804:0:2464256:0:(events.c:358:request_in_callback()) incoming req@000000001072e527 x1858030946310272 msgsize 224
00000100:00100000:27.0:1773851868.272806:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-19706@kfi7 (source: 12345-19706@kfi7)
00000100:00000001:27.0:1773851868.272807:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851868.272807:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000800:00000200:27.0:1773851868.272809:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851868.272809:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851868.272810:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851868.272811:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851868.272812:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851868.272813:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851868.272814:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030946310272
00000020:00000001:25.0:1773851868.272815:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851868.272816:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911c0
00000020:00000001:25.0:1773851868.272817:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851868.272820:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000082460520 refcount=6
00000020:00000001:25.0:1773851868.272821:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240550400 : -107152469001216 : ffff9e8b9f25fc00)
00000020:00000001:25.0:1773851868.272822:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240550400 : -107152469001216 : ffff9e8b9f25fc00)
00000100:00000001:25.0:1773851868.272823:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851868.272824:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851868.272825:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000034fe4ec0.
00000020:00000010:25.0:1773851868.272827:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851868.272828:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000403a6df5.
00000100:00000001:25.0:1773851868.272830:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851868.272830:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851868.272831:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851868.272833:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851868.272834:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851868.272834:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.272836:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851868.272837:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851868.272838:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851868.272838:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851868.272838:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851868.272839:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851868.272839:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19706@kfi7, seq: 2025100
00000100:00000040:24.0:1773851868.272839:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000082460520 : new rpc_count 1
00000100:00000001:25.0:1773851868.272840:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.272840:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998415872 : -107053711135744 : ffff9ea29d936c00)
00000100:00000040:24.0:1773851868.272841:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001072e527 x1858030946310272/t0(0) o400->d5733a17-f050-49bf-92e3-900259338cf5@19706@kfi7:85/0 lens 224/0 e 0 to 0 dl 1773852200 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne245-0'
00000100:00000001:24.0:1773851868.272843:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851868.272844:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851868.272844:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001072e527 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d5733a17-f050-49bf-92e3-900259338cf5+6:48032:x1858030946310272:12345-19706@kfi7:400:default-tuolumne245-0
00000100:00000200:24.0:1773851868.272846:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030946310272
00000020:00000001:24.0:1773851868.272846:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851868.272847:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851868.272847:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.272848:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851868.272848:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851868.272849:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851868.272849:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030946310272, found 0 last_xid 1858030946310271
00000020:00000001:24.0:1773851868.272850:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851868.272850:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851868.272851:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851868.272851:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.272852:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851868.272852:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851868.272852:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851868.272853:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000049dcf77c.
02000000:00000001:24.0:1773851868.272853:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.272854:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.272854:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851868.272856:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767927, transno 0, xid 1858030946310272
00010000:00000001:24.0:1773851868.272856:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851868.272857:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001072e527 x1858030946310272/t0(0) o400->d5733a17-f050-49bf-92e3-900259338cf5@19706@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne245-0'
00010000:00000001:24.0:1773851868.272860:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851868.272860:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851868.272861:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=101 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851868.272862:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851868.272862:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005d6e1d9c refcount 5 to 19706@kfi7
00000100:00000001:24.0:1773851868.272863:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335296 : -107152617216320 : ffff9e8b965066c0)
02000000:00000001:24.0:1773851868.272863:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851868.272864:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851868.272864:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851868.272865:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19706@kfi7
00000400:00000010:24.0:1773851868.272866:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b572ac3.
00000100:00000200:24.0:1773851868.272866:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030946310272, offset 224
00000400:00000200:24.0:1773851868.272868:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19706@kfi7
00000400:00000200:24.0:1773851868.272868:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:24.0:1773851868.272869:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 1
00000400:00000200:24.0:1773851868.272870:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000400:00000200:24.0:1773851868.272871:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 3
00000400:00000200:24.0:1773851868.272872:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19706@kfi7 local destination
00000400:00000200:24.0:1773851868.272874:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769262:8769262:1024:4294967295] 19706@kfi7 LPNI seq info [24386:24386:16:4294967295]
00000400:00000200:24.0:1773851868.272875:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000400:00000200:24.0:1773851868.272875:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19706@kfi7 to cpt 6
00000400:00000200:24.0:1773851868.272877:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19706@kfi7(19706@kfi7:19706@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851868.272878:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 3
00000800:00000200:24.0:1773851868.272879:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851868.272880:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851868.272882:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851868.272885:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1b3 Using peer 19706@kfi7(0x1b3)
00000800:00000200:24.0:1773851868.272888:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x1b3: rc=0
00000800:00000200:24.0:1773851868.272889:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851868.272891:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851868.272892:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005d6e1d9c refcount 4 to 19706@kfi7
00010000:00000001:24.0:1773851868.272892:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851868.272893:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851868.272893:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851868.272894:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001072e527 x1858030946310272/t0(0) o400->d5733a17-f050-49bf-92e3-900259338cf5@19706@kfi7:85/0 lens 224/224 e 0 to 0 dl 1773852200 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne245-0'
00000100:00100000:24.0:1773851868.272898:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001072e527 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d5733a17-f050-49bf-92e3-900259338cf5+6:48032:x1858030946310272:12345-19706@kfi7:400:default-tuolumne245-0 Request processed in 54us (93us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851868.272900:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19706@kfi7, seq: 2025100
00000100:00000040:24.0:1773851868.272901:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000082460520 : new rpc_count 0
00000100:00000001:24.0:1773851868.272902:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851868.272902:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851868.272903:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851868.272903:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000403a6df5.
00000020:00000010:24.0:1773851868.272904:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000034fe4ec0.
00000020:00000040:24.0:1773851868.272905:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000082460520 : new refcount 5
00000100:00000001:24.0:1773851868.272905:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0F:1773851868.272910:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1b3 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851868.272913:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851868.272914:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19706@kfi7: PUT: OK
00000400:00000200:26.0:1773851868.272915:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b572ac3
00000400:00000010:26.0:1773851868.272915:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b572ac3.
00000100:00000001:26.0:1773851868.272916:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851868.272916:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851868.272917:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000049ebb19 nid 19706@kfi7 refs 2
00000800:00000200:26.0:1773851868.272919:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 19706@kfi7(00000000588e5188):0x0 lsk 436 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1b3 Transaction freed
00000800:00000200:13.0F:1773851868.283085:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851868.283088:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851868.283090:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851868.283093:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851868.283096:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18705@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.283097:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18705@kfi7 : PUT - for me
00000400:00000200:13.0:1773851868.283099:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18705@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.283101:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062c3949f nid 18705@kfi7 refs 1
00000400:00000200:13.0:1773851868.283103:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18705@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.283103:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062c3949f nid 18705@kfi7 refs 2
00000400:00000200:13.0:1773851868.283105:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062c3949f nid 18705@kfi7 refs 3
00000400:00000200:13.0:1773851868.283106:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18896@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.283107:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18896@kfi7 of length 224 into portal 12 MB=0x69b4b5fa292c0
00000400:00000200:13.0:1773851868.283110:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18896@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 29352
00000800:00000200:13.0:1773851868.283112:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851868.283115:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851868.283116:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18705@kfi7: PUT: OK
00000100:00000001:13.0:1773851868.283117:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851868.283118:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851868.283120:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000bb337ae.
00000100:00000040:13.0:1773851868.283121:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000000bb337ae x1859597889606336 msgsize 224
00000100:00100000:13.0:1773851868.283123:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18896@kfi7 (source: 12345-18705@kfi7)
00000100:00000001:13.0:1773851868.283125:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851868.283126:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851868.283127:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851868.283127:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:13.0:1773851868.283127:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000062c3949f nid 18705@kfi7 refs 2
00000100:00000001:15.0:1773851868.283128:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851868.283129:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851868.283129:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597889606336
00000800:00000200:13.0:1773851868.283129:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000020:00000001:15.0:1773851868.283130:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851868.283130:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82731
00000020:00000001:15.0:1773851868.283131:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851868.283136:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c4647026 refcount=5
00000020:00000001:15.0:1773851868.283137:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636951452535808 : -107122257015808 : ffff9e92a7ec4c00)
00000020:00000001:15.0:1773851868.283138:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636951452535808 : -107122257015808 : ffff9e92a7ec4c00)
00000100:00000001:15.0:1773851868.283139:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.283140:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851868.283141:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cc81a8a8.
00000020:00000010:15.0:1773851868.283142:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851868.283142:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cf10f4b4.
00000100:00000001:15.0:1773851868.283143:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851868.283143:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851868.283144:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.283145:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851868.283145:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851868.283146:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.283147:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851868.283148:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851868.283149:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851868.283150:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18896@kfi7, seq: 2289837
00000100:00000001:15.0:1773851868.283151:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851868.283151:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:12.0:1773851868.283151:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c4647026 : new rpc_count 1
00000100:00000001:15.0:1773851868.283152:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.283152:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.283152:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970984704 : -107043738566912 : ffff9ea4effcbf00)
00000100:00000040:12.0:1773851868.283154:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000bb337ae x1859597889606336/t0(0) o400->46c53a81-5177-4ec9-8613-4ef5660351f4@18896@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1665-0'
00000100:00000001:12.0:1773851868.283157:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851868.283157:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851868.283158:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000bb337ae pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:46c53a81-5177-4ec9-8613-4ef5660351f4+5:39561:x1859597889606336:12345-18896@kfi7:400:default-tuolumne1665-0
00000100:00000200:12.0:1773851868.283160:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597889606336
00000020:00000001:12.0:1773851868.283161:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851868.283162:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851868.283163:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.283164:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851868.283164:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851868.283165:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851868.283166:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597889606336, found 0 last_xid 1859597889606335
00000020:00000001:12.0:1773851868.283167:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851868.283168:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851868.283168:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851868.283169:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.283170:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851868.283170:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851868.283171:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851868.283172:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008761aa61.
02000000:00000001:12.0:1773851868.283173:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.283173:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.283174:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851868.283175:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044131280, transno 0, xid 1859597889606336
00010000:00000001:12.0:1773851868.283176:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851868.283177:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000bb337ae x1859597889606336/t0(0) o400->46c53a81-5177-4ec9-8613-4ef5660351f4@18896@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1665-0'
00010000:00000001:12.0:1773851868.283180:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851868.283180:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851868.283181:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=101 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851868.283182:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851868.283183:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c1eb1c2 refcount 3 to 18896@kfi7
00000100:00000001:12.0:1773851868.283184:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152896 : -107139310398720 : ffff9e8eaf765300)
02000000:00000001:12.0:1773851868.283185:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851868.283185:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.283186:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851868.283187:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18705@kfi7
00000400:00000010:12.0:1773851868.283188:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018d1ad92.
00000100:00000200:12.0:1773851868.283189:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597889606336, offset 224
00000400:00000200:12.0:1773851868.283191:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18705@kfi7
00000400:00000200:12.0:1773851868.283192:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18705@kfi7 to cpt 3
00000400:00000200:12.0:1773851868.283193:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062c3949f nid 18705@kfi7 refs 1
00000400:00000200:12.0:1773851868.283195:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062c3949f nid 18705@kfi7 refs 2
00000400:00000200:12.0:1773851868.283196:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062c3949f nid 18705@kfi7 refs 3
00000400:00000200:12.0:1773851868.283197:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18705@kfi7 local destination
00000400:00000200:12.0:1773851868.283199:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769263:8769263:1024:4294967295] 18705@kfi7 LPNI seq info [1595032:1595032:16:4294967295]
00000400:00000200:12.0:1773851868.283200:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000062c3949f nid 18705@kfi7 refs 2
00000400:00000200:12.0:1773851868.283201:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18705@kfi7 to cpt 3
00000400:00000200:12.0:1773851868.283203:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18705@kfi7(18705@kfi7:18705@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851868.283204:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062c3949f nid 18705@kfi7 refs 3
00000800:00000200:12.0:1773851868.283206:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851868.283208:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851868.283210:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851868.283214:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa68 Using peer 18705@kfi7(0xa68)
00000800:00000200:12.0:1773851868.283218:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0xa68: rc=0
00000800:00000200:12.0:1773851868.283220:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa68 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851868.283222:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851868.283223:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c1eb1c2 refcount 2 to 18896@kfi7
00010000:00000001:12.0:1773851868.283223:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851868.283224:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.283225:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851868.283225:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000bb337ae x1859597889606336/t0(0) o400->46c53a81-5177-4ec9-8613-4ef5660351f4@18896@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1665-0'
00000100:00100000:12.0:1773851868.283230:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000bb337ae pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:46c53a81-5177-4ec9-8613-4ef5660351f4+5:39561:x1859597889606336:12345-18896@kfi7:400:default-tuolumne1665-0 Request processed in 72us (108us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851868.283232:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18896@kfi7, seq: 2289837
00000100:00000040:12.0:1773851868.283233:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c4647026 : new rpc_count 0
00000100:00000001:12.0:1773851868.283234:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851868.283235:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851868.283236:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851868.283237:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cf10f4b4.
00000020:00000010:12.0:1773851868.283238:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cc81a8a8.
00000020:00000040:12.0:1773851868.283238:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c4647026 : new refcount 4
00000100:00000001:12.0:1773851868.283239:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851868.283245:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa68 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851868.283247:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851868.283248:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18705@kfi7: PUT: OK
00000400:00000200:14.0:1773851868.283249:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018d1ad92
00000400:00000010:14.0:1773851868.283249:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018d1ad92.
00000100:00000001:14.0:1773851868.283250:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851868.283251:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851868.283252:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000062c3949f nid 18705@kfi7 refs 2
00000800:00000200:14.0:1773851868.283254:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 18705@kfi7(00000000243cbb56):0x0 lsk 2665 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa68 Transaction freed
00000800:00000200:27.0:1773851868.288269:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851868.288269:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851868.288270:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851868.288270:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851868.288271:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851868.288271:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851868.288273:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851868.288273:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14114@kfi7(00000000dd09c8bf):0x1fc version: 2; local version 2; negotiated version: 2
00000400:00000200:27.0:1773851868.288275:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14114@kfi7 to cpt 6
00000800:00000200:25.0:1773851868.288275:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc Using peer 14114@kfi7(0x1fc)
00000400:00000200:27.0:1773851868.288276:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14114@kfi7 : PUT - for me
00000400:00000200:25.0:1773851868.288276:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14114@kfi7 to cpt 6
00000400:00000200:27.0:1773851868.288277:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14114@kfi7 to cpt 6
00000400:00000200:27.0:1773851868.288278:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050c25387 nid 14114@kfi7 refs 1
00000800:00000200:25.0:1773851868.288278:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x1fc: rc=0
00000400:00000200:27.0:1773851868.288279:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14114@kfi7 to cpt 6
00000400:00000200:27.0:1773851868.288279:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050c25387 nid 14114@kfi7 refs 2
00000400:00000200:27.0:1773851868.288280:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000050c25387 nid 14114@kfi7 refs 3
00000800:00000200:25.0:1773851868.288280:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851868.288281:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14115@kfi7 to cpt 1
00000400:00000200:27.0:1773851868.288282:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14115@kfi7 of length 224 into portal 12 MB=0x69b4c399b7400
00000400:00000200:27.0:1773851868.288283:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14115@kfi7 of length 224/224 into md 0x16159c9699 [64] + 9832
00000800:00000200:27.0:1773851868.288284:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851868.288286:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851868.288287:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14114@kfi7: PUT: OK
00000100:00000001:27.0:1773851868.288288:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851868.288288:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851868.288289:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000091d41892.
00000100:00000040:27.0:1773851868.288289:0:2464256:0:(events.c:358:request_in_callback()) incoming req@0000000091d41892 x1859601546572800 msgsize 224
00000100:00100000:27.0:1773851868.288291:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-14115@kfi7 (source: 12345-14114@kfi7)
00000800:00000200:25.0:1773851868.288293:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851868.288294:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851868.288295:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000050c25387 nid 14114@kfi7 refs 2
00000800:00000200:25.0:1773851868.288295:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc Transaction freed
00000800:00000200:27.0:1773851868.288296:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851868.288300:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851868.288301:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851868.288302:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851868.288303:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851868.288304:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851868.288306:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601546572800
00000020:00000001:26.0:1773851868.288307:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851868.288307:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78052
00000020:00000001:26.0:1773851868.288309:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851868.288316:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b813c595 refcount=5
00000020:00000001:26.0:1773851868.288317:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118797032448 : -106954912519168 : ffff9eb99e6eac00)
00000020:00000001:26.0:1773851868.288318:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118797032448 : -106954912519168 : ffff9eb99e6eac00)
00000100:00000001:26.0:1773851868.288320:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851868.288321:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851868.288322:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cf433d41.
00000020:00000010:26.0:1773851868.288324:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851868.288325:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007b482246.
00000100:00000001:26.0:1773851868.288327:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851868.288328:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851868.288329:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851868.288331:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851868.288332:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851868.288332:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.288334:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851868.288336:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851868.288336:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851868.288337:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:25.0:1773851868.288337:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14115@kfi7, seq: 2025101
00000100:00000001:26.0:1773851868.288338:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:25.0:1773851868.288338:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b813c595 : new rpc_count 1
00000100:00000001:25.0:1773851868.288338:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998402048 : -107053711149568 : ffff9ea29d933600)
00000100:00000001:26.0:1773851868.288339:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851868.288339:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000091d41892 x1859601546572800/t0(0) o400->01a9f7b2-29a7-4281-a380-8101e888f866@14115@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1371-0'
00000100:00000001:26.0:1773851868.288340:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.288342:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851868.288342:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851868.288343:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091d41892 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:01a9f7b2-29a7-4281-a380-8101e888f866+5:39539:x1859601546572800:12345-14115@kfi7:400:default-tuolumne1371-0
00000100:00000200:25.0:1773851868.288344:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601546572800
00000020:00000001:25.0:1773851868.288344:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851868.288345:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851868.288346:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.288346:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851868.288347:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851868.288347:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851868.288348:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601546572800, found 0 last_xid 1859601546572799
00000020:00000001:25.0:1773851868.288348:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851868.288349:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851868.288350:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851868.288350:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.288351:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851868.288351:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851868.288351:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851868.288352:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000005b1d8b1.
02000000:00000001:25.0:1773851868.288353:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.288354:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.288354:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851868.288355:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096670457, transno 0, xid 1859601546572800
00010000:00000001:25.0:1773851868.288356:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851868.288356:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000091d41892 x1859601546572800/t0(0) o400->01a9f7b2-29a7-4281-a380-8101e888f866@14115@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1371-0'
00010000:00000001:25.0:1773851868.288359:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851868.288359:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851868.288360:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=101 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851868.288361:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851868.288361:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cc3131b0 refcount 3 to 14115@kfi7
00000100:00000001:25.0:1773851868.288362:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074953280 : -107155634598336 : ffff9e8ae276ce40)
02000000:00000001:25.0:1773851868.288363:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851868.288363:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.288364:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851868.288364:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14114@kfi7
00000400:00000010:25.0:1773851868.288365:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000003902c6b.
00000100:00000200:25.0:1773851868.288366:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601546572800, offset 224
00000400:00000200:25.0:1773851868.288367:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14114@kfi7
00000400:00000200:25.0:1773851868.288368:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14114@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.288368:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050c25387 nid 14114@kfi7 refs 1
00000400:00000200:25.0:1773851868.288369:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000050c25387 nid 14114@kfi7 refs 2
00000400:00000200:25.0:1773851868.288371:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000050c25387 nid 14114@kfi7 refs 3
00000400:00000200:25.0:1773851868.288371:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14114@kfi7 local destination
00000400:00000200:25.0:1773851868.288373:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769264:8769264:1024:4294967295] 14114@kfi7 LPNI seq info [167025:167025:16:4294967295]
00000400:00000200:25.0:1773851868.288374:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000050c25387 nid 14114@kfi7 refs 2
00000400:00000200:25.0:1773851868.288375:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14114@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.288376:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14114@kfi7(14114@kfi7:14114@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851868.288378:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000050c25387 nid 14114@kfi7 refs 3
00000800:00000200:25.0:1773851868.288379:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851868.288380:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851868.288385:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851868.288387:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc Using peer 14114@kfi7(0x1fc)
00000800:00000200:25.0:1773851868.288390:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 324 bytes to peer 0x1fc: rc=0
00000800:00000200:25.0:1773851868.288391:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851868.288393:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851868.288394:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cc3131b0 refcount 2 to 14115@kfi7
00010000:00000001:25.0:1773851868.288395:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851868.288395:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.288396:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851868.288397:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000091d41892 x1859601546572800/t0(0) o400->01a9f7b2-29a7-4281-a380-8101e888f866@14115@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1371-0'
00000100:00100000:25.0:1773851868.288400:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091d41892 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:01a9f7b2-29a7-4281-a380-8101e888f866+5:39539:x1859601546572800:12345-14115@kfi7:400:default-tuolumne1371-0 Request processed in 57us (109us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851868.288402:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14115@kfi7, seq: 2025101
00000100:00000040:25.0:1773851868.288403:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b813c595 : new rpc_count 0
00000100:00000001:25.0:1773851868.288403:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851868.288404:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851868.288404:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000800:00000200:27.0:1773851868.288405:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc TN_EVENT_TX_OK event status 0
00000020:00000010:25.0:1773851868.288405:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007b482246.
00000020:00000010:25.0:1773851868.288406:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cf433d41.
00000400:00000200:27.0:1773851868.288407:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:25.0:1773851868.288407:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000b813c595 : new refcount 4
00000100:00000001:25.0:1773851868.288407:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851868.288408:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14114@kfi7: PUT: OK
00000400:00000200:27.0:1773851868.288409:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000003902c6b
00000400:00000010:27.0:1773851868.288409:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000003902c6b.
00000100:00000001:27.0:1773851868.288410:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851868.288410:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851868.288411:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000050c25387 nid 14114@kfi7 refs 2
00000800:00000200:27.0:1773851868.288412:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 14114@kfi7(00000000dd09c8bf):0x0 lsk 509 rsk 7 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1fc Transaction freed
00000800:00000200:17.0:1773851868.292972:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.292973:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.292974:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.292976:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.292978:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8304@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.292979:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8304@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.292980:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8304@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.292981:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083c681f6 nid 8304@kfi7 refs 1
00000400:00000200:17.0:1773851868.292982:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8304@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.292982:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083c681f6 nid 8304@kfi7 refs 2
00000400:00000200:17.0:1773851868.292983:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083c681f6 nid 8304@kfi7 refs 3
00000400:00000200:17.0:1773851868.292984:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8305@kfi7 to cpt 7
00000400:00000200:17.0:1773851868.292985:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8305@kfi7 of length 224 into portal 12 MB=0x69bad05914b40
00000400:00000200:17.0:1773851868.292986:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8305@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 11672
00000800:00000200:17.0:1773851868.292988:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.292990:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.292992:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8304@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.292992:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.292993:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.292994:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000090d837db.
00000100:00000040:17.0:1773851868.292994:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000090d837db x1860017285319488 msgsize 224
00000100:00100000:17.0:1773851868.292996:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8305@kfi7 (source: 12345-8304@kfi7)
00000100:00000001:17.0:1773851868.292997:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.292997:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083c681f6 nid 8304@kfi7 refs 2
00000800:00000200:17.0:1773851868.292998:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851868.292998:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851868.292999:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851868.292999:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851868.293000:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851868.293000:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851868.293001:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860017285319488
00000020:00000001:16.0:1773851868.293002:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851868.293002:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a66cef
00000020:00000001:16.0:1773851868.293003:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851868.293003:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e7e1939e refcount=6
00000020:00000001:16.0:1773851868.293004:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148546242560 : -106925163309056 : ffff9ec08b9f9800)
00000020:00000001:16.0:1773851868.293005:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148546242560 : -106925163309056 : ffff9ec08b9f9800)
00000100:00000001:16.0:1773851868.293006:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.293007:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851868.293008:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d3b15942.
00000020:00000010:16.0:1773851868.293008:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851868.293009:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000041c4c030.
00000100:00000001:16.0:1773851868.293010:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851868.293010:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851868.293011:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.293012:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851868.293012:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851868.293013:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.293014:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.293015:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.293015:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.293016:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851868.293016:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851868.293017:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8305@kfi7, seq: 2156329
00000100:00000040:17.0:1773851868.293017:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e7e1939e : new rpc_count 1
00000100:00000001:16.0:1773851868.293017:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.293018:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636980530409600 : -107093179142016 : ffff9e996d197080)
00000100:00000001:16.0:1773851868.293018:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.293019:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000090d837db x1860017285319488/t0(0) o400->aeacc339-4722-4ebe-a90e-a6bee1965784@8305@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1006-0'
00000100:00000001:17.0:1773851868.293022:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.293022:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851868.293023:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090d837db pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:aeacc339-4722-4ebe-a90e-a6bee1965784+6:39535:x1860017285319488:12345-8305@kfi7:400:default-tuolumne1006-0
00000100:00000200:17.0:1773851868.293025:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860017285319488
00000020:00000001:17.0:1773851868.293025:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851868.293026:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851868.293027:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.293027:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851868.293028:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851868.293029:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851868.293029:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860017285319488, found 0 last_xid 1860017285319487
00000020:00000001:17.0:1773851868.293030:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851868.293030:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851868.293031:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851868.293031:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.293033:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851868.293033:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851868.293034:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851868.293035:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000069587fa7.
02000000:00000001:17.0:1773851868.293035:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.293036:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.293037:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851868.293037:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860017285319488
00010000:00000001:17.0:1773851868.293038:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851868.293039:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000090d837db x1860017285319488/t0(0) o400->aeacc339-4722-4ebe-a90e-a6bee1965784@8305@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1006-0'
00010000:00000001:17.0:1773851868.293041:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851868.293042:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851868.293043:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851868.293044:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851868.293044:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ca9c630 refcount 5 to 8305@kfi7
00000100:00000001:17.0:1773851868.293045:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637016773134400 : -107056936417216 : ffff9ea1dd558840)
02000000:00000001:17.0:1773851868.293046:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851868.293046:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.293047:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851868.293048:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8304@kfi7
00000400:00000010:17.0:1773851868.293049:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000992a4632.
00000100:00000200:17.0:1773851868.293049:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860017285319488, offset 224
00000400:00000200:17.0:1773851868.293051:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8304@kfi7
00000400:00000200:17.0:1773851868.293051:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8304@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.293052:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083c681f6 nid 8304@kfi7 refs 1
00000400:00000200:17.0:1773851868.293053:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083c681f6 nid 8304@kfi7 refs 2
00000400:00000200:17.0:1773851868.293054:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083c681f6 nid 8304@kfi7 refs 3
00000400:00000200:17.0:1773851868.293055:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8304@kfi7 local destination
00000400:00000200:17.0:1773851868.293056:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769265:8769265:1024:4294967295] 8304@kfi7 LPNI seq info [6320942:6320942:16:4294967295]
00000400:00000200:17.0:1773851868.293058:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083c681f6 nid 8304@kfi7 refs 2
00000400:00000200:17.0:1773851868.293058:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8304@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.293060:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8304@kfi7(8304@kfi7:8304@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851868.293062:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083c681f6 nid 8304@kfi7 refs 3
00000800:00000200:17.0:1773851868.293063:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.293064:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851868.293066:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851868.293068:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1257 Using peer 8304@kfi7(0x1257)
00000800:00000200:17.0:1773851868.293071:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x1257: rc=0
00000800:00000200:17.0:1773851868.293073:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1257 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851868.293075:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.293076:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ca9c630 refcount 4 to 8305@kfi7
00010000:00000001:17.0:1773851868.293076:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851868.293077:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.293077:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851868.293078:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000090d837db x1860017285319488/t0(0) o400->aeacc339-4722-4ebe-a90e-a6bee1965784@8305@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1006-0'
00000100:00100000:17.0:1773851868.293081:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090d837db pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:aeacc339-4722-4ebe-a90e-a6bee1965784+6:39535:x1860017285319488:12345-8305@kfi7:400:default-tuolumne1006-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851868.293083:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8305@kfi7, seq: 2156329
00000100:00000040:17.0:1773851868.293084:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e7e1939e : new rpc_count 0
00000100:00000001:17.0:1773851868.293085:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851868.293085:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:18.0:1773851868.293086:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1257 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851868.293086:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000400:00000200:18.0:1773851868.293087:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851868.293087:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000041c4c030.
00000400:00000200:18.0:1773851868.293088:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8304@kfi7: PUT: OK
00000020:00000010:17.0:1773851868.293088:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d3b15942.
00000020:00000040:17.0:1773851868.293088:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000e7e1939e : new refcount 5
00000400:00000200:18.0:1773851868.293089:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000992a4632
00000400:00000010:18.0:1773851868.293089:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000992a4632.
00000100:00000001:17.0:1773851868.293089:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851868.293090:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851868.293090:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851868.293091:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083c681f6 nid 8304@kfi7 refs 2
00000800:00000200:18.0:1773851868.293092:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 8304@kfi7(00000000f62a5e5a):0x0 lsk 4696 rsk 15 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1257 Transaction freed
00010000:00000001:2.0:1773851868.297731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851868.297732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851868.297734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851868.297735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851868.297736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851868.297737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851868.297738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851868.297739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851868.297739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0F:1773851868.297744:0:849256:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:8.0:1773851868.297745:0:849256:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:8.0:1773851868.297746:0:849256:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:29.0:1773851868.329923:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851868.329924:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851868.329925:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851868.329927:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851868.329929:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23649@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.329931:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23649@kfi7 : PUT - for me
00000400:00000200:29.0:1773851868.329932:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23649@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.329932:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068905d09 nid 23649@kfi7 refs 1
00000400:00000200:29.0:1773851868.329934:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23649@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.329934:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068905d09 nid 23649@kfi7 refs 2
00000400:00000200:29.0:1773851868.329935:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000068905d09 nid 23649@kfi7 refs 3
00000400:00000200:29.0:1773851868.329936:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23713@kfi7 to cpt 2
00000400:00000200:29.0:1773851868.329937:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23713@kfi7 of length 224 into portal 12 MB=0x699e0cbcfaf40
00000400:00000200:29.0:1773851868.329938:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23713@kfi7 of length 224/224 into md 0x77fe139dd [64] + 176424
00000800:00000200:29.0:1773851868.329940:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851868.329942:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851868.329943:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23649@kfi7: PUT: OK
00000100:00000001:29.0:1773851868.329944:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851868.329944:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851868.329945:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000910ae6c1.
00000100:00000040:29.0:1773851868.329945:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000910ae6c1 x1858040631373632 msgsize 224
00000100:00100000:29.0:1773851868.329947:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23713@kfi7 (source: 12345-23649@kfi7)
00000100:00000001:29.0:1773851868.329948:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851868.329949:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000068905d09 nid 23649@kfi7 refs 2
00000800:00000200:29.0:1773851868.329951:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851868.329951:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851868.329952:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851868.329953:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851868.329954:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851868.329955:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851868.329956:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040631373632
00000020:00000001:28.0:1773851868.329957:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851868.329958:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92be4
00000020:00000001:28.0:1773851868.329959:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851868.329963:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ee7f0d40 refcount=6
00000020:00000001:28.0:1773851868.329965:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743946240 : -107128965605376 : ffff9e91180f5800)
00000020:00000001:28.0:1773851868.329966:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743946240 : -107128965605376 : ffff9e91180f5800)
00000100:00000001:28.0:1773851868.329968:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851868.329969:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851868.329970:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000adb0a5b7.
00000020:00000010:28.0:1773851868.329972:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851868.329973:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d22b788a.
00000100:00000001:28.0:1773851868.329974:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851868.329975:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851868.329976:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851868.329978:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851868.329978:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851868.329979:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.329981:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.329982:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851868.329983:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851868.329983:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851868.329984:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23713@kfi7, seq: 2055524
00000100:00000001:28.0:1773851868.329984:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851868.329985:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ee7f0d40 : new rpc_count 1
00000100:00000001:28.0:1773851868.329985:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.329986:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309675648 : -106988399875968 : ffff9eb1d26e2880)
00000100:00000001:28.0:1773851868.329986:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851868.329987:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000910ae6c1 x1858040631373632/t0(0) o400->044ca6b7-201c-440f-b257-4cd9af394bfc@23713@kfi7:656/0 lens 224/0 e 0 to 0 dl 1773852016 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1968-0'
00000100:00000001:31.0:1773851868.329990:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851868.329991:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851868.329992:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000910ae6c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:044ca6b7-201c-440f-b257-4cd9af394bfc+6:39690:x1858040631373632:12345-23713@kfi7:400:default-tuolumne1968-0
00000100:00000200:31.0:1773851868.329994:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040631373632
00000020:00000001:31.0:1773851868.329994:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851868.329995:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851868.329996:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.329997:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851868.329997:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851868.329998:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851868.329998:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040631373632, found 0 last_xid 1858040631373631
00000020:00000001:31.0:1773851868.329999:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851868.330000:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851868.330001:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851868.330001:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.330002:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851868.330003:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851868.330003:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851868.330004:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000089b4f0eb.
02000000:00000001:31.0:1773851868.330005:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.330005:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.330006:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851868.330007:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182426466758, transno 0, xid 1858040631373632
00010000:00000001:31.0:1773851868.330008:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851868.330009:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000910ae6c1 x1858040631373632/t0(0) o400->044ca6b7-201c-440f-b257-4cd9af394bfc@23713@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1968-0'
00010000:00000001:31.0:1773851868.330011:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851868.330012:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851868.330013:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=101 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851868.330014:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851868.330015:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbfa2280 refcount 3 to 23713@kfi7
00000100:00000001:31.0:1773851868.330016:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810487232 : -107154899064384 : ffff9e8b0e4e29c0)
02000000:00000001:31.0:1773851868.330016:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851868.330017:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.330018:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851868.330019:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23649@kfi7
00000400:00000010:31.0:1773851868.330019:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d658250.
00000100:00000200:31.0:1773851868.330020:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040631373632, offset 224
00000400:00000200:31.0:1773851868.330022:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23649@kfi7
00000400:00000200:31.0:1773851868.330023:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23649@kfi7 to cpt 7
00000400:00000200:31.0:1773851868.330023:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068905d09 nid 23649@kfi7 refs 1
00000400:00000200:31.0:1773851868.330025:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000068905d09 nid 23649@kfi7 refs 2
00000400:00000200:31.0:1773851868.330026:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000068905d09 nid 23649@kfi7 refs 3
00000400:00000200:31.0:1773851868.330027:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23649@kfi7 local destination
00000400:00000200:31.0:1773851868.330028:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769266:8769266:1024:4294967295] 23649@kfi7 LPNI seq info [9750964:9750964:16:4294967295]
00000400:00000200:31.0:1773851868.330030:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000068905d09 nid 23649@kfi7 refs 2
00000400:00000200:31.0:1773851868.330030:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23649@kfi7 to cpt 7
00000400:00000200:31.0:1773851868.330032:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23649@kfi7(23649@kfi7:23649@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851868.330033:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000068905d09 nid 23649@kfi7 refs 3
00000800:00000200:31.0:1773851868.330035:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851868.330036:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851868.330038:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851868.330042:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa69 Using peer 23649@kfi7(0xa69)
00000800:00000200:31.0:1773851868.330046:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0xa69: rc=0
00000800:00000200:31.0:1773851868.330047:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa69 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851868.330049:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851868.330050:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbfa2280 refcount 2 to 23713@kfi7
00010000:00000001:31.0:1773851868.330051:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851868.330051:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.330052:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851868.330053:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000910ae6c1 x1858040631373632/t0(0) o400->044ca6b7-201c-440f-b257-4cd9af394bfc@23713@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1968-0'
00000100:00100000:31.0:1773851868.330056:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000910ae6c1 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:044ca6b7-201c-440f-b257-4cd9af394bfc+6:39690:x1858040631373632:12345-23713@kfi7:400:default-tuolumne1968-0 Request processed in 65us (110us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851868.330058:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23713@kfi7, seq: 2055524
00000100:00000040:31.0:1773851868.330059:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ee7f0d40 : new rpc_count 0
00000100:00000001:31.0:1773851868.330060:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851868.330061:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851868.330061:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa69 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851868.330062:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851868.330062:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d22b788a.
00000400:00000200:29.0:1773851868.330062:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851868.330063:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000adb0a5b7.
00000400:00000200:29.0:1773851868.330063:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23649@kfi7: PUT: OK
00000020:00000040:31.0:1773851868.330064:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000ee7f0d40 : new refcount 5
00000400:00000200:29.0:1773851868.330064:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d658250
00000100:00000001:31.0:1773851868.330065:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851868.330065:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d658250.
00000100:00000001:29.0:1773851868.330066:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851868.330066:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851868.330067:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000068905d09 nid 23649@kfi7 refs 2
00000800:00000200:29.0:1773851868.330068:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23649@kfi7(000000000a2e89a8):0x0 lsk 2666 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa69 Transaction freed
00000800:00000200:21.0:1773851868.362863:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851868.362864:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851868.362866:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851868.362868:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851868.362870:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24672@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.362871:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24672@kfi7 : PUT - for me
00000400:00000200:21.0:1773851868.362872:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24672@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.362872:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000985c1dff nid 24672@kfi7 refs 1
00000400:00000200:21.0:1773851868.362874:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24672@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.362874:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000985c1dff nid 24672@kfi7 refs 2
00000400:00000200:21.0:1773851868.362875:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000985c1dff nid 24672@kfi7 refs 3
00000400:00000200:21.0:1773851868.362876:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24673@kfi7 to cpt 0
00000400:00000200:21.0:1773851868.362877:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24673@kfi7 of length 224 into portal 12 MB=0x699e0daad4e00
00000400:00000200:21.0:1773851868.362878:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24673@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 36840
00000800:00000200:21.0:1773851868.362880:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851868.362882:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851868.362883:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24672@kfi7: PUT: OK
00000100:00000001:21.0:1773851868.362884:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851868.362884:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851868.362885:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000079ee772a.
00000100:00000040:21.0:1773851868.362886:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000079ee772a x1858040880778752 msgsize 224
00000100:00100000:21.0:1773851868.362887:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24673@kfi7 (source: 12345-24672@kfi7)
00000100:00000001:21.0:1773851868.362888:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851868.362889:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000985c1dff nid 24672@kfi7 refs 2
00000100:00000001:22.0:1773851868.362890:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851868.362890:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851868.362890:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851868.362891:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851868.362891:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851868.362892:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851868.362893:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040880778752
00000020:00000001:22.0:1773851868.362893:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851868.362894:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922b4
00000020:00000001:22.0:1773851868.362894:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851868.362897:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a9cf626 refcount=6
00000020:00000001:22.0:1773851868.362898:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630033408 : -107123079518208 : ffff9e9276e5e800)
00000020:00000001:22.0:1773851868.362899:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630033408 : -107123079518208 : ffff9e9276e5e800)
00000100:00000001:22.0:1773851868.362901:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.362901:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851868.362902:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000020:00000010:22.0:1773851868.362903:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.362904:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851868.362905:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851868.362905:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851868.362906:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851868.362907:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851868.362908:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851868.362908:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.362909:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851868.362910:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.362910:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851868.362911:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851868.362911:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851868.362912:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851868.362912:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24673@kfi7, seq: 1997980
00000100:00000040:22.0:1773851868.362912:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a9cf626 : new rpc_count 1
00000100:00000001:23.0:1773851868.362913:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.362913:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788261248 : -106974921290368 : ffff9eb4f5d10d80)
00000100:00000040:22.0:1773851868.362914:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000079ee772a x1858040880778752/t0(0) o400->b900d5c3-87f6-43cd-a922-97d5ba4ae55e@24673@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2032-0'
00000100:00000001:22.0:1773851868.362917:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.362918:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851868.362919:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079ee772a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b900d5c3-87f6-43cd-a922-97d5ba4ae55e+6:39653:x1858040880778752:12345-24673@kfi7:400:default-tuolumne2032-0
00000100:00000200:22.0:1773851868.362920:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040880778752
00000020:00000001:22.0:1773851868.362921:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851868.362922:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851868.362922:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.362923:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851868.362923:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851868.362924:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851868.362925:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040880778752, found 0 last_xid 1858040880778751
00000020:00000001:22.0:1773851868.362926:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851868.362926:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851868.362927:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851868.362928:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.362928:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851868.362929:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851868.362929:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851868.362930:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000c0d5128.
02000000:00000001:22.0:1773851868.362931:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.362931:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.362932:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851868.362933:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044156307, transno 0, xid 1858040880778752
00010000:00000001:22.0:1773851868.362934:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851868.362934:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000079ee772a x1858040880778752/t0(0) o400->b900d5c3-87f6-43cd-a922-97d5ba4ae55e@24673@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2032-0'
00010000:00000001:22.0:1773851868.362937:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851868.362937:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851868.362938:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=101 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851868.362939:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851868.362940:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006253f767 refcount 3 to 24673@kfi7
00000100:00000001:22.0:1773851868.362940:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958443424 : -107146751108192 : ffff9e8cf3f61ba0)
02000000:00000001:22.0:1773851868.362941:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851868.362941:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.362942:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851868.362943:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24672@kfi7
00000400:00000010:22.0:1773851868.362943:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a596cda7.
00000100:00000200:22.0:1773851868.362944:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040880778752, offset 224
00000400:00000200:22.0:1773851868.362946:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24672@kfi7
00000400:00000200:22.0:1773851868.362947:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24672@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.362947:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000985c1dff nid 24672@kfi7 refs 1
00000400:00000200:22.0:1773851868.362948:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000985c1dff nid 24672@kfi7 refs 2
00000400:00000200:22.0:1773851868.362949:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000985c1dff nid 24672@kfi7 refs 3
00000400:00000200:22.0:1773851868.362950:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24672@kfi7 local destination
00000400:00000200:22.0:1773851868.362952:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769267:8769267:1024:4294967295] 24672@kfi7 LPNI seq info [11403089:11403089:16:4294967295]
00000400:00000200:22.0:1773851868.362954:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000985c1dff nid 24672@kfi7 refs 2
00000400:00000200:22.0:1773851868.362954:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24672@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.362956:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24672@kfi7(24672@kfi7:24672@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851868.362957:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000985c1dff nid 24672@kfi7 refs 3
00000800:00000200:22.0:1773851868.362958:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.362959:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851868.362962:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851868.362964:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f9c Using peer 24672@kfi7(0x100000000000f9c)
00000800:00000200:22.0:1773851868.362967:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000008ad6e841: Posted send of 324 bytes to peer 0x100000000000f9c: rc=0
00000800:00000200:22.0:1773851868.362968:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f9c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851868.362970:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.362971:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006253f767 refcount 2 to 24673@kfi7
00010000:00000001:22.0:1773851868.362972:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851868.362972:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.362973:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851868.362974:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000079ee772a x1858040880778752/t0(0) o400->b900d5c3-87f6-43cd-a922-97d5ba4ae55e@24673@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2032-0'
00000100:00100000:22.0:1773851868.362976:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079ee772a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b900d5c3-87f6-43cd-a922-97d5ba4ae55e+6:39653:x1858040880778752:12345-24673@kfi7:400:default-tuolumne2032-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851868.362978:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24673@kfi7, seq: 1997980
00000100:00000040:22.0:1773851868.362979:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a9cf626 : new rpc_count 0
00000100:00000001:22.0:1773851868.362979:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851868.362979:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f9c TN_EVENT_TX_OK event status 0
00000100:00000001:22.0:1773851868.362980:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851868.362980:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851868.362980:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851868.362981:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851868.362981:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000400:00000200:21.0:1773851868.362981:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24672@kfi7: PUT: OK
00000020:00000040:22.0:1773851868.362982:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009a9cf626 : new refcount 5
00000400:00000200:21.0:1773851868.362982:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a596cda7
00000400:00000010:21.0:1773851868.362982:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a596cda7.
00000100:00000001:22.0:1773851868.362983:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851868.362983:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851868.362983:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851868.362984:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000985c1dff nid 24672@kfi7 refs 2
00000800:00000200:21.0:1773851868.362985:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 24672@kfi7(0000000075b1dd29):0x0 lsk 3997 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f9c Transaction freed
00000800:00000200:14.0:1773851868.394440:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851868.394440:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851868.394441:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851868.394444:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851868.394445:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14626@kfi7 to cpt 3
00000400:00000200:14.0:1773851868.394447:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14626@kfi7 : PUT - for me
00000400:00000200:14.0:1773851868.394448:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14626@kfi7 to cpt 3
00000400:00000200:14.0:1773851868.394449:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e577bbe1 nid 14626@kfi7 refs 1
00000400:00000200:14.0:1773851868.394450:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14626@kfi7 to cpt 3
00000400:00000200:14.0:1773851868.394451:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e577bbe1 nid 14626@kfi7 refs 2
00000400:00000200:14.0:1773851868.394452:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e577bbe1 nid 14626@kfi7 refs 3
00000400:00000200:14.0:1773851868.394452:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14627@kfi7 to cpt 6
00000400:00000200:14.0:1773851868.394453:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14627@kfi7 of length 224 into portal 12 MB=0x69b4b56ab7b00
00000400:00000200:14.0:1773851868.394456:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14627@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 29576
00000800:00000200:14.0:1773851868.394457:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851868.394459:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851868.394460:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14626@kfi7: PUT: OK
00000100:00000001:14.0:1773851868.394461:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851868.394461:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851868.394463:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e693730a.
00000100:00000040:14.0:1773851868.394463:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000e693730a x1859597739195136 msgsize 224
00000100:00100000:14.0:1773851868.394465:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-14627@kfi7 (source: 12345-14626@kfi7)
00000100:00000001:14.0:1773851868.394466:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851868.394467:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e577bbe1 nid 14626@kfi7 refs 2
00000100:00000001:12.0:1773851868.394467:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851868.394468:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bbed2221: 2054@kfi7:3 <- 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851868.394468:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851868.394468:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851868.394469:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851868.394470:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851868.394471:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597739195136
00000020:00000001:12.0:1773851868.394472:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851868.394472:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fabb
00000020:00000001:12.0:1773851868.394474:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851868.394479:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000caea691e refcount=5
00000020:00000001:12.0:1773851868.394479:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139853345792 : -106933856205824 : ffff9ebe857c8400)
00000020:00000001:12.0:1773851868.394480:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139853345792 : -106933856205824 : ffff9ebe857c8400)
00000100:00000001:12.0:1773851868.394482:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851868.394483:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851868.394484:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003bdc2b77.
00000020:00000010:12.0:1773851868.394485:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851868.394486:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000422619af.
00000100:00000001:12.0:1773851868.394487:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851868.394488:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851868.394488:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851868.394490:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851868.394491:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851868.394491:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.394492:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.394494:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851868.394494:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851868.394494:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851868.394494:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851868.394496:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14627@kfi7, seq: 2289838
00000100:00000040:15.0:1773851868.394496:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000caea691e : new rpc_count 1
00000100:00000001:12.0:1773851868.394496:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.394497:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127341807232 : -106946367744384 : ffff9ebb9bbd9680)
00000100:00000001:12.0:1773851868.394497:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.394499:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e693730a x1859597739195136/t0(0) o400->f98ef0e0-9531-4806-bef2-00110d71c58e@14627@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1403-0'
00000100:00000001:15.0:1773851868.394502:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.394503:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851868.394504:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e693730a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f98ef0e0-9531-4806-bef2-00110d71c58e+5:39622:x1859597739195136:12345-14627@kfi7:400:default-tuolumne1403-0
00000100:00000200:15.0:1773851868.394505:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597739195136
00000020:00000001:15.0:1773851868.394506:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851868.394507:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851868.394507:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.394508:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851868.394509:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851868.394509:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851868.394510:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597739195136, found 0 last_xid 1859597739195135
00000020:00000001:15.0:1773851868.394511:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851868.394512:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851868.394512:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851868.394513:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.394514:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851868.394514:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851868.394515:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851868.394516:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cc81a8a8.
02000000:00000001:15.0:1773851868.394516:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.394517:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.394518:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851868.394519:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692852, transno 0, xid 1859597739195136
00010000:00000001:15.0:1773851868.394520:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851868.394521:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e693730a x1859597739195136/t0(0) o400->f98ef0e0-9531-4806-bef2-00110d71c58e@14627@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1403-0'
00010000:00000001:15.0:1773851868.394523:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851868.394524:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851868.394524:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=101 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851868.394526:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851868.394526:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6a36d92 refcount 3 to 14627@kfi7
00000100:00000001:15.0:1773851868.394527:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092333760 : -107152617217856 : ffff9e8b965060c0)
02000000:00000001:15.0:1773851868.394528:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851868.394529:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.394529:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851868.394530:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14626@kfi7
00000400:00000010:15.0:1773851868.394531:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fd79a325.
00000100:00000200:15.0:1773851868.394532:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597739195136, offset 224
00000400:00000200:15.0:1773851868.394533:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14626@kfi7
00000400:00000200:15.0:1773851868.394534:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14626@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.394535:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e577bbe1 nid 14626@kfi7 refs 1
00000400:00000200:15.0:1773851868.394536:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e577bbe1 nid 14626@kfi7 refs 2
00000400:00000200:15.0:1773851868.394537:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e577bbe1 nid 14626@kfi7 refs 3
00000400:00000200:15.0:1773851868.394538:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14626@kfi7 local destination
00000400:00000200:15.0:1773851868.394540:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769268:8769268:1024:4294967295] 14626@kfi7 LPNI seq info [179951:179951:16:4294967295]
00000400:00000200:15.0:1773851868.394541:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e577bbe1 nid 14626@kfi7 refs 2
00000400:00000200:15.0:1773851868.394542:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14626@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.394544:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14626@kfi7(14626@kfi7:14626@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851868.394545:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e577bbe1 nid 14626@kfi7 refs 3
00000800:00000200:15.0:1773851868.394547:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851868.394548:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851868.394550:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851868.394553:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000edf Using peer 14626@kfi7(0x100000000000edf)
00000800:00000200:15.0:1773851868.394556:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x100000000000edf: rc=0
00000800:00000200:15.0:1773851868.394558:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000edf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851868.394560:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.394561:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6a36d92 refcount 2 to 14627@kfi7
00010000:00000001:15.0:1773851868.394561:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851868.394562:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.394562:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851868.394563:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e693730a x1859597739195136/t0(0) o400->f98ef0e0-9531-4806-bef2-00110d71c58e@14627@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1403-0'
00000100:00100000:15.0:1773851868.394566:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e693730a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f98ef0e0-9531-4806-bef2-00110d71c58e+5:39622:x1859597739195136:12345-14627@kfi7:400:default-tuolumne1403-0 Request processed in 63us (102us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851868.394568:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14627@kfi7, seq: 2289838
00000100:00000040:15.0:1773851868.394569:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000caea691e : new rpc_count 0
00000100:00000001:15.0:1773851868.394570:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851868.394571:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851868.394571:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:15.0:1773851868.394572:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000422619af.
00000800:00000200:13.0:1773851868.394572:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000edf TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851868.394573:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003bdc2b77.
00000020:00000040:15.0:1773851868.394574:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000caea691e : new refcount 4
00000100:00000001:15.0:1773851868.394575:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851868.394575:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851868.394576:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14626@kfi7: PUT: OK
00000400:00000200:13.0:1773851868.394580:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fd79a325
00000400:00000010:13.0:1773851868.394580:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fd79a325.
00000100:00000001:13.0:1773851868.394581:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851868.394582:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851868.394584:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e577bbe1 nid 14626@kfi7 refs 2
00000800:00000200:13.0:1773851868.394586:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14626@kfi7(0000000091e567ac):0x0 lsk 3808 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000edf Transaction freed
00000800:00000200:21.0:1773851868.425309:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851868.425309:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851868.425311:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851868.425312:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851868.425315:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.425316:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18682@kfi7 : PUT - for me
00000400:00000200:21.0:1773851868.425317:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.425317:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076d50151 nid 18682@kfi7 refs 1
00000400:00000200:21.0:1773851868.425319:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.425320:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076d50151 nid 18682@kfi7 refs 2
00000400:00000200:21.0:1773851868.425320:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076d50151 nid 18682@kfi7 refs 3
00000400:00000200:21.0:1773851868.425321:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.425322:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18682@kfi7 of length 440 into portal 12 MB=0x699dedbdb6d80
00000400:00000200:21.0:1773851868.425323:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18682@kfi7 of length 440/440 into md 0x6a32cacf5 [64] + 37064
00000800:00000200:21.0:1773851868.425325:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851868.425327:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851868.425328:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18682@kfi7: PUT: OK
00000100:00000001:21.0:1773851868.425329:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851868.425329:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851868.425330:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c3bec198.
00000100:00000040:21.0:1773851868.425330:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c3bec198 x1858032310644096 msgsize 440
00000100:00100000:21.0:1773851868.425332:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18682@kfi7 (source: 12345-18682@kfi7)
00000100:00000001:21.0:1773851868.425333:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:22.0:1773851868.425334:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851868.425334:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076d50151 nid 18682@kfi7 refs 2
02000000:00000001:22.0:1773851868.425335:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851868.425335:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851868.425336:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851868.425336:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851868.425337:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851868.425338:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858032310644096
00000020:00000001:22.0:1773851868.425339:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851868.425339:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9135d
00000020:00000001:22.0:1773851868.425340:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851868.425343:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008431f1f5 refcount=6
00000020:00000001:22.0:1773851868.425343:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169298944 : -107127540252672 : ffff9e916d048000)
00000020:00000001:22.0:1773851868.425344:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169298944 : -107127540252672 : ffff9e916d048000)
00000100:00000001:22.0:1773851868.425345:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.425346:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851868.425347:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000020:00000010:22.0:1773851868.425348:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.425349:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851868.425349:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851868.425350:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851868.425351:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.425351:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.425352:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851868.425354:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851868.425354:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851868.425354:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.425354:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851868.425355:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18682@kfi7, seq: 335333145
00000100:00000001:23.0:1773851868.425356:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.425356:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008431f1f5 : new rpc_count 1
00000100:00000001:23.0:1773851868.425357:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.425357:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788288896 : -106974921262720 : ffff9eb4f5d17980)
00000100:00000040:22.0:1773851868.425358:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c3bec198 x1858032310644096/t0(0) o41->1317ece7-4cca-46d1-b6d7-d640d587a0c4@18682@kfi7:508/0 lens 440/0 e 0 to 0 dl 1773852623 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne241-0'
00000100:00000001:22.0:1773851868.425361:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.425361:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851868.425363:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3bec198 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:1317ece7-4cca-46d1-b6d7-d640d587a0c4+6:97996:x1858032310644096:12345-18682@kfi7:41:default-tuolumne241-0
00000100:00000200:22.0:1773851868.425364:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858032310644096
00000020:00000001:22.0:1773851868.425365:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851868.425365:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851868.425366:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.425367:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851868.425367:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:22.0:1773851868.425368:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851868.425369:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858032310644096, found 0 last_xid 1858032310644095
00000020:00000001:22.0:1773851868.425370:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851868.425371:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851868.425371:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851868.425371:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.425372:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851868.425373:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851868.425374:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000d43aba1d.
02000000:00000001:22.0:1773851868.425374:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.425375:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:22.0:1773851868.425377:0:60934:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:22.0:1773851868.425377:0:60934:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:22.0:1773851868.425378:0:60934:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:22.0:1773851868.425379:0:60934:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 40309317668175872 avail 40308838179536896
00000004:00000020:22.0:1773851868.425380:0:60934:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841142008832 free, 9841024837696 avail; 10969026039 objects: 9610490243 free; state 100
00000020:00000001:22.0:1773851868.425382:0:60934:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:22.0:1773851868.425386:0:60934:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:22.0:1773851868.425387:0:60934:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851868.425388:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768011, transno 0, xid 1858032310644096
00010000:00000001:22.0:1773851868.425388:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851868.425389:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c3bec198 x1858032310644096/t0(0) o41->1317ece7-4cca-46d1-b6d7-d640d587a0c4@18682@kfi7:508/0 lens 440/368 e 0 to 0 dl 1773852623 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne241-0'
00010000:00000001:22.0:1773851868.425391:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851868.425391:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851868.425392:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=101 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851868.425394:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851868.425394:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b964497e refcount 5 to 18682@kfi7
00000100:00000001:22.0:1773851868.425395:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109952 : -107156354441664 : ffff9e8ab78ede40)
02000000:00000001:22.0:1773851868.425396:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851868.425397:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.425397:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851868.425398:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18682@kfi7
00000400:00000010:22.0:1773851868.425399:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b3a5ce20.
00000100:00000200:22.0:1773851868.425400:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858032310644096, offset 224
00000400:00000200:22.0:1773851868.425401:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18682@kfi7
00000400:00000200:22.0:1773851868.425402:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.425403:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076d50151 nid 18682@kfi7 refs 1
00000400:00000200:22.0:1773851868.425404:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076d50151 nid 18682@kfi7 refs 2
00000400:00000200:22.0:1773851868.425405:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076d50151 nid 18682@kfi7 refs 3
00000400:00000200:22.0:1773851868.425406:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18682@kfi7 local destination
00000400:00000200:22.0:1773851868.425408:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769269:8769269:1024:4294967295] 18682@kfi7 LPNI seq info [28006:28006:16:4294967295]
00000400:00000200:22.0:1773851868.425409:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076d50151 nid 18682@kfi7 refs 2
00000400:00000200:22.0:1773851868.425410:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.425412:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18682@kfi7(18682@kfi7:18682@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851868.425413:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076d50151 nid 18682@kfi7 refs 3
00000800:00000200:22.0:1773851868.425414:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.425415:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:22.0:1773851868.425418:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851868.425420:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x860 Using peer 18682@kfi7(0x860)
00000800:00000200:22.0:1773851868.425423:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000389ce1b3: Posted send of 468 bytes to peer 0x860: rc=0
00000800:00000200:22.0:1773851868.425424:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x860 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851868.425426:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.425430:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b964497e refcount 4 to 18682@kfi7
00010000:00000001:22.0:1773851868.425431:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851868.425431:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.425432:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851868.425433:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c3bec198 x1858032310644096/t0(0) o41->1317ece7-4cca-46d1-b6d7-d640d587a0c4@18682@kfi7:508/0 lens 440/368 e 0 to 0 dl 1773852623 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne241-0'
00000100:00100000:22.0:1773851868.425435:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3bec198 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:1317ece7-4cca-46d1-b6d7-d640d587a0c4+6:97996:x1858032310644096:12345-18682@kfi7:41:default-tuolumne241-0 Request processed in 74us (104us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851868.425436:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x860 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851868.425438:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18682@kfi7, seq: 335333145
00000100:00000040:22.0:1773851868.425438:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008431f1f5 : new rpc_count 0
00000400:00000200:21.0:1773851868.425438:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851868.425439:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851868.425439:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18682@kfi7: PUT: OK
00000100:00000001:22.0:1773851868.425440:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851868.425440:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851868.425440:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b3a5ce20
00000400:00000010:21.0:1773851868.425440:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b3a5ce20.
00000020:00000010:22.0:1773851868.425441:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000100:00000001:21.0:1773851868.425441:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851868.425441:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851868.425442:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000400:00000200:21.0:1773851868.425442:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076d50151 nid 18682@kfi7 refs 2
00000020:00000040:22.0:1773851868.425443:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000008431f1f5 : new refcount 5
00000100:00000001:22.0:1773851868.425443:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851868.425443:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 18682@kfi7(0000000040ec93a8):0x0 lsk 2145 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x860 Transaction freed
00000800:00000200:13.0:1773851868.459939:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851868.459940:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851868.459942:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851868.459945:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851868.459947:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14736@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.459949:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14736@kfi7 : PUT - for me
00000400:00000200:13.0:1773851868.459950:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14736@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.459952:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fcc1de6 nid 14736@kfi7 refs 1
00000400:00000200:13.0:1773851868.459954:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14736@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.459954:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fcc1de6 nid 14736@kfi7 refs 2
00000400:00000200:13.0:1773851868.459955:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006fcc1de6 nid 14736@kfi7 refs 3
00000400:00000200:13.0:1773851868.459957:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14736@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.459958:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14736@kfi7 of length 224 into portal 12 MB=0x699e12286ae00
00000400:00000200:13.0:1773851868.459960:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14736@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 29800
00000800:00000200:13.0:1773851868.459962:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851868.459964:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851868.459965:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14736@kfi7: PUT: OK
00000100:00000001:13.0:1773851868.459966:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851868.459967:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851868.459969:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000040618c88.
00000100:00000040:13.0:1773851868.459969:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000040618c88 x1858042086206976 msgsize 224
00000100:00100000:13.0:1773851868.459971:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14736@kfi7 (source: 12345-14736@kfi7)
00000100:00000001:13.0:1773851868.459975:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851868.459976:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006fcc1de6 nid 14736@kfi7 refs 2
00000100:00000001:15.0:1773851868.459977:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851868.459978:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851868.459978:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851868.459979:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851868.459980:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851868.459981:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851868.459983:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042086206976
00000020:00000001:15.0:1773851868.459984:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851868.459985:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91dc1
00000020:00000001:15.0:1773851868.459987:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851868.459990:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000075d80ea3 refcount=6
00000020:00000001:15.0:1773851868.459991:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628788224 : -107123080763392 : ffff9e9276d2e800)
00000020:00000001:15.0:1773851868.459992:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628788224 : -107123080763392 : ffff9e9276d2e800)
00000100:00000001:15.0:1773851868.459994:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.459995:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851868.459996:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000706ab772.
00000020:00000010:15.0:1773851868.459998:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851868.459999:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002bafee4d.
00000100:00000001:15.0:1773851868.460001:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851868.460001:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851868.460003:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.460004:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851868.460005:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851868.460005:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.460007:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.460009:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851868.460009:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851868.460010:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851868.460010:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851868.460012:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14736@kfi7, seq: 2289839
00000100:00000040:15.0:1773851868.460013:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000075d80ea3 : new rpc_count 1
00000100:00000001:12.0:1773851868.460013:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.460014:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970987008 : -107043738564608 : ffff9ea4effcc800)
00000100:00000001:12.0:1773851868.460014:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.460016:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000040618c88 x1858042086206976/t0(0) o400->4836fdbb-14d3-4419-81d9-5ad0b1dd6a50@14736@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1410-0'
00000100:00000001:15.0:1773851868.460021:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.460021:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851868.460023:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000040618c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4836fdbb-14d3-4419-81d9-5ad0b1dd6a50+6:39838:x1858042086206976:12345-14736@kfi7:400:default-tuolumne1410-0
00000100:00000200:15.0:1773851868.460025:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042086206976
00000020:00000001:15.0:1773851868.460026:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851868.460027:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851868.460028:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.460029:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851868.460030:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851868.460033:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851868.460034:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042086206976, found 0 last_xid 1858042086206975
00000020:00000001:15.0:1773851868.460035:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851868.460036:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851868.460037:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851868.460038:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.460039:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851868.460040:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851868.460041:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851868.460044:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003b61d018.
02000000:00000001:15.0:1773851868.460045:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.460046:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.460047:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851868.460048:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255057186, transno 0, xid 1858042086206976
00010000:00000001:15.0:1773851868.460049:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851868.460051:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000040618c88 x1858042086206976/t0(0) o400->4836fdbb-14d3-4419-81d9-5ad0b1dd6a50@14736@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1410-0'
00010000:00000001:15.0:1773851868.460055:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851868.460056:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851868.460057:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=101 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851868.460059:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851868.460060:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ca3405dd refcount 3 to 14736@kfi7
00000100:00000001:15.0:1773851868.460061:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620256 : -107151221931360 : ffff9e8be97ac2a0)
02000000:00000001:15.0:1773851868.460063:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851868.460063:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.460064:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851868.460066:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14736@kfi7
00000400:00000010:15.0:1773851868.460067:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039cd6bfe.
00000100:00000200:15.0:1773851868.460068:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042086206976, offset 224
00000400:00000200:15.0:1773851868.460071:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14736@kfi7
00000400:00000200:15.0:1773851868.460072:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14736@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.460073:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fcc1de6 nid 14736@kfi7 refs 1
00000400:00000200:15.0:1773851868.460075:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006fcc1de6 nid 14736@kfi7 refs 2
00000400:00000200:15.0:1773851868.460077:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006fcc1de6 nid 14736@kfi7 refs 3
00000400:00000200:15.0:1773851868.460080:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14736@kfi7 local destination
00000400:00000200:15.0:1773851868.460082:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769270:8769270:1024:4294967295] 14736@kfi7 LPNI seq info [8316739:8316739:16:4294967295]
00000400:00000200:15.0:1773851868.460085:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006fcc1de6 nid 14736@kfi7 refs 2
00000400:00000200:15.0:1773851868.460086:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14736@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.460089:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14736@kfi7(14736@kfi7:14736@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851868.460091:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006fcc1de6 nid 14736@kfi7 refs 3
00000800:00000200:15.0:1773851868.460094:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851868.460096:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851868.460099:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851868.460103:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000866 Using peer 14736@kfi7(0x100000000000866)
00000800:00000200:15.0:1773851868.460108:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x100000000000866: rc=0
00000800:00000200:15.0:1773851868.460111:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000866 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851868.460114:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.460116:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ca3405dd refcount 2 to 14736@kfi7
00010000:00000001:15.0:1773851868.460117:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851868.460118:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.460119:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851868.460120:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000040618c88 x1858042086206976/t0(0) o400->4836fdbb-14d3-4419-81d9-5ad0b1dd6a50@14736@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1410-0'
00000800:00000200:13.0:1773851868.460123:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000866 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851868.460125:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851868.460126:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000040618c88 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4836fdbb-14d3-4419-81d9-5ad0b1dd6a50+6:39838:x1858042086206976:12345-14736@kfi7:400:default-tuolumne1410-0 Request processed in 105us (155us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851868.460126:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14736@kfi7: PUT: OK
00000400:00000200:13.0:1773851868.460127:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039cd6bfe
00000400:00000010:13.0:1773851868.460127:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039cd6bfe.
00000100:00000001:13.0:1773851868.460128:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851868.460129:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851868.460130:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006fcc1de6 nid 14736@kfi7 refs 2
00000100:00100000:15.0:1773851868.460131:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14736@kfi7, seq: 2289839
00000800:00000200:13.0:1773851868.460131:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 14736@kfi7(000000000732a530):0x0 lsk 2151 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000866 Transaction freed
00000100:00000040:15.0:1773851868.460132:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000075d80ea3 : new rpc_count 0
00000100:00000001:15.0:1773851868.460133:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851868.460134:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851868.460136:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851868.460137:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002bafee4d.
00000020:00000010:15.0:1773851868.460139:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000706ab772.
00000020:00000040:15.0:1773851868.460140:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000075d80ea3 : new refcount 5
00000100:00000001:15.0:1773851868.460141:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851868.489733:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851868.489733:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:25.0:1773851868.489733:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:25.0:1773851868.489733:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851868.489734:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d3c4c877.
00000100:00000010:25.0:1773851868.489734:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009938e3ad.
00000020:00000040:29.0:1773851868.489735:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000020:00000040:25.0:1773851868.489735:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000100:00000001:29.0:1773851868.489736:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:25.0:1773851868.489736:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851868.489737:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:25.0:1773851868.489737:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851868.489738:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851868.489738:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851868.489739:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
02000000:00000010:25.0:1773851868.489739:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000fc341f21.
00000100:00000001:29.0:1773851868.489741:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.489741:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851868.489742:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851868.489742:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851868.489743:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.489743:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851868.489744:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d3c4c877] to pc [ptlrpcd_07_03+3]  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851868.489744:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000009938e3ad] to pc [ptlrpcd_06_00+0]  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851868.489748:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:25.0:1773851868.489748:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851868.489749:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:29.0:1773851868.489749:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000018d78667.
00000100:00000001:26.0:1773851868.489749:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851868.489750:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851868.489750:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851868.489750:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637131418234880 : -106942291316736 : ffff9ebc8eb6f000)
00000100:00000001:26.0:1773851868.489750:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851868.489750:0:41084:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:25.0:1773851868.489750:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000001f7f75a.
00080000:00000001:29.0:1773851868.489751:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:28.0:1773851868.489751:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851868.489751:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:26.0:1773851868.489751:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:25.0:1773851868.489751:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637057121364992 : -107016588186624 : ffff9eab4246ac00)
00000100:00000040:31.0:1773851868.489752:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851868.489752:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851868.489752:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851868.489752:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851868.489752:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00001000:29.0:1773851868.489753:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00080000:00000001:25.0:1773851868.489753:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489754:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:29.0:1773851868.489754:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000252e20f5.
00000100:00000001:26.0:1773851868.489754:0:41084:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:25.0:1773851868.489754:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000100:00000001:31.0:1773851868.489755:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.489755:0:41084:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:25.0:1773851868.489755:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001a09162b.
02000000:00000001:31.0:1773851868.489756:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:29.0:1773851868.489756:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614142943030902ns, next at 614143943029690ns, rc = 0
02000000:00000001:26.0:1773851868.489756:0:41084:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:25.0:1773851868.489756:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614142943031273ns, next at 614143943029930ns, rc = 0
02000000:00000001:31.0:1773851868.489757:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851868.489757:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:26.0:1773851868.489757:0:41084:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851868.489757:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:31.0:1773851868.489758:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d3c4c877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051928768:2090@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851868.489758:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851868.489758:0:41084:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009938e3ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051928832:2068@kfi7:13:default-yuba2-0
00080000:00000001:25.0:1773851868.489758:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851868.489759:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.489759:0:41084:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:25.0:1773851868.489759:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489760:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851868.489760:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:26.0:1773851868.489760:0:41084:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851868.489761:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851868.489761:0:41084:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851868.489762:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:26.0:1773851868.489762:0:41084:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:26.0:1773851868.489762:0:41084:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e7700903.
02000000:00000010:31.0:1773851868.489763:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000660c7356.
02000000:00000001:26.0:1773851868.489763:0:41084:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851868.489764:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851868.489764:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851868.489765:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:26.0:1773851868.489765:0:41084:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f00e36c9.
00000400:00000010:31.0:1773851868.489766:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000010:31.0:1773851868.489766:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000535cda91.
00000400:00000010:26.0:1773851868.489766:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000445da448.
00000100:00000200:26.0:1773851868.489767:0:41084:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928832, portal 4
00000100:00000200:31.0:1773851868.489768:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928768, portal 4
00000100:00000001:31.0:1773851868.489768:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:26.0:1773851868.489768:0:41084:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851868.489769:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637085309671040 : -106988399880576 : ffff9eb1d26e1680)
00000100:00000001:26.0:1773851868.489769:0:41084:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637135478755840 : -106938230795776 : ffff9ebd80bd9200)
00000100:00000040:26.0:1773851868.489770:0:41084:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851868.489771:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851868.489773:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:26.0:1773851868.489773:0:41084:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851868.489774:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000100:00000040:26.0:1773851868.489774:0:41084:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:26.0:1773851868.489774:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000a1253fa.
00000400:00000010:31.0:1773851868.489775:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb75a26a.
00000100:00000200:26.0:1773851868.489775:0:41084:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928832, offset 0
00000100:00000200:31.0:1773851868.489776:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928768, offset 0
00000400:00000200:31.0:1773851868.489777:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000400:00000200:26.0:1773851868.489777:0:41084:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:31.0:1773851868.489778:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:26.0:1773851868.489778:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851868.489779:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:26.0:1773851868.489779:0:41084:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:26.0:1773851868.489780:0:41084:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:31.0:1773851868.489781:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:31.0:1773851868.489782:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:31.0:1773851868.489783:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000200:26.0:1773851868.489783:0:41084:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:26.0:1773851868.489784:0:41084:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:26.0:1773851868.489785:0:41084:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769269, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769270, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851868.489786:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769269, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769270, p:4294967295, g:4294967295, h:1000]
00000400:00000200:26.0:1773851868.489787:0:41084:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851868.489788:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:26.0:1773851868.489788:0:41084:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851868.489789:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851868.489789:0:41084:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:31.0:1773851868.489790:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:26.0:1773851868.489790:0:41084:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769271:8769271:1024:4294967295] 2068@kfi7 LPNI seq info [5403698:5403698:16:4294967295]
00000400:00000200:31.0:1773851868.489791:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769272:8769272:1024:4294967295] 2090@kfi7 LPNI seq info [5404250:5404250:16:4294967295]
00000400:00000200:26.0:1773851868.489792:0:41084:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:31.0:1773851868.489793:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:26.0:1773851868.489793:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851868.489794:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:26.0:1773851868.489796:0:41084:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851868.489797:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851868.489797:0:41084:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:31.0:1773851868.489798:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:26.0:1773851868.489799:0:41084:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:31.0:1773851868.489800:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:26.0:1773851868.489800:0:41084:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851868.489801:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851868.489803:0:41084:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851868.489804:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851868.489805:0:41084:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Using peer 2068@kfi7(0x62f)
00000800:00000200:31.0:1773851868.489806:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000800:00000200:31.0:1773851868.489809:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:26.0:1773851868.489809:0:41084:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 324 bytes to peer 0x62f: rc=0
00000800:00000200:31.0:1773851868.489811:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:26.0:1773851868.489811:0:41084:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851868.489812:0:41084:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489813:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489813:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851868.489813:0:41084:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851868.489814:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.489814:0:41084:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489815:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.489815:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489816:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851868.489816:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.489818:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851868.489818:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:26.0:1773851868.489818:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851868.489818:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851868.489819:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851868.489819:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851868.489820:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851868.489820:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.489820:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851868.489820:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489821:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851868.489821:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851868.489822:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851868.489822:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851868.489823:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851868.489824:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851868.489825:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:29.0:1773851868.489825:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb75a26a
00000400:00000200:25.0:1773851868.489825:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000400:00000010:29.0:1773851868.489826:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb75a26a.
00000400:00000200:25.0:1773851868.489826:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000a1253fa
00000100:00000001:29.0:1773851868.489827:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000010:25.0:1773851868.489827:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000a1253fa.
00000100:00000001:25.0:1773851868.489827:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851868.489828:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:25.0:1773851868.489828:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851868.489830:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851868.489831:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851868.489831:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:25.0:1773851868.489832:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851868.489834:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851868.489835:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:25.0:1773851868.489835:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.489835:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851868.489836:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:25.0:1773851868.489837:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:29.0:1773851868.489838:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000800:00000200:25.0:1773851868.489839:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Transaction freed
00000800:00000200:1.0:1773851868.489851:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851868.489852:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851868.489853:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851868.489855:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851868.489857:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851868.489859:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:1.0:1773851868.489860:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851868.489861:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:1.0:1773851868.489862:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851868.489862:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851868.489863:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:1.0:1773851868.489864:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851868.489865:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b38c0
00000400:00000200:1.0:1773851868.489866:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851868.489868:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71d7c1 [1] + 224
00000800:00000200:1.0:1773851868.489870:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851868.489877:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851868.489878:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000100:00000001:1.0:1773851868.489879:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:1.0:1773851868.489881:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851868.489883:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851868.489884:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:1.0:1773851868.489885:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851868.489886:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851868.489888:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851868.489890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000001:1.0:1773851868.489890:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851868.489891:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:21.0:1773851868.489891:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:1.0:1773851868.489891:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:31.0:1773851868.489892:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851868.489892:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000001:31.0:1773851868.489893:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851868.489893:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:21.0:1773851868.489893:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000800:00000200:1.0:1773851868.489893:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000010:31.0:1773851868.489894:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000200:21.0:1773851868.489894:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851868.489895:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000535cda91
00000400:00000010:31.0:1773851868.489895:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000535cda91.
00000400:00000200:21.0:1773851868.489895:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:31.0:1773851868.489896:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851868.489896:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000100:00000200:31.0:1773851868.489897:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851868.489897:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.489898:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3900
00000400:00000200:21.0:1773851868.489899:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000200:31.0:1773851868.489900:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851868.489900:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d0db5 [1] + 224
00000800:00000200:21.0:1773851868.489902:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851868.489903:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851868.489903:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.489904:0:41091:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:21.0:1773851868.489904:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:31.0:1773851868.489905:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851868.489905:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:21.0:1773851868.489905:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000100:00000001:31.0:1773851868.489906:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851868.489906:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:31.0:1773851868.489907:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:21.0:1773851868.489907:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851868.489908:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=101 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851868.489909:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=101 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851868.489910:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851868.489910:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851868.489910:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:31.0:1773851868.489911:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851868.489912:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489912:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851868.489913:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:31.0:1773851868.489914:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851868.489914:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851868.489914:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:31.0:1773851868.489915:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:21.0:1773851868.489915:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:26.0:1773851868.489917:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:21.0:1773851868.489917:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851868.489918:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851868.489918:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851868.489919:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851868.489919:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:26.0:1773851868.489919:0:41084:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000004:00000001:31.0:1773851868.489920:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851868.489920:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000400:00000001:26.0:1773851868.489920:0:41084:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000040:31.0:1773851868.489921:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351389037568 avail=351386347520 avail_mb=1372602920 hwm_mb=3131103 files=372019175 ffree=343153357 state=0: rc = 0
00000400:00000010:26.0:1773851868.489921:0:41084:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f00e36c9.
00000400:00000200:26.0:1773851868.489922:0:41084:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000445da448
00000004:00000020:31.0:1773851868.489923:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351389037568 free, 351386347520 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019175 files, 343153357 free files
00000400:00000010:26.0:1773851868.489923:0:41084:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000445da448.
00000100:00000001:26.0:1773851868.489924:0:41084:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:31.0:1773851868.489925:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851868.489926:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:26.0:1773851868.489926:0:41084:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:31.0:1773851868.489928:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d3c4c877 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051928768:2090@kfi7:13:default-yuba2-0
00000100:00000200:26.0:1773851868.489931:0:41084:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851868.489932:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.489932:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851868.489933:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d3c4c877 x1859433051928768/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851868.489935:0:41084:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851868.489936:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851868.489936:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:26.0:1773851868.489936:0:41084:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:31.0:1773851868.489937:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000660c7356.
00000100:00000001:26.0:1773851868.489937:0:41084:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851868.489938:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:26.0:1773851868.489938:0:41084:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000020:00000001:31.0:1773851868.489939:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851868.489939:0:41091:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000100:00000001:26.0:1773851868.489939:0:41084:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851868.489939:0:41084:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.489940:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851868.489940:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
02000000:00000001:31.0:1773851868.489941:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851868.489941:0:41084:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851868.489942:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851868.489942:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d3c4c877.
00000100:00001000:26.0:1773851868.489942:0:41084:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=101 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851868.489943:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851868.489944:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.489944:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:26.0:1773851868.489944:0:41084:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=101 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851868.489945:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851868.489946:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.489946:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851868.489946:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.489946:0:41084:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:26.0:1773851868.489947:0:41084:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851868.489948:0:41084:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:26.0:1773851868.489949:0:41084:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.489950:0:41084:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:26.0:1773851868.489951:0:41084:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:26.0:1773851868.489952:0:41084:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851868.489952:0:41084:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851868.489954:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851868.489958:0:41084:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851868.489960:0:41084:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:26.0:1773851868.489961:0:41084:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851868.489962:0:41084:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:26.0:1773851868.489963:0:41084:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:26.0:1773851868.489965:0:41084:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350958989312 avail=350956882944 avail_mb=1370925324 hwm_mb=3131103 files=371564016 ffree=342733388 state=0: rc = 0
00000004:00000020:26.0:1773851868.489968:0:41084:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350958989312 free, 350956882944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371564016 files, 342733388 free files
00000004:00000001:26.0:1773851868.489970:0:41084:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851868.489972:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:26.0:1773851868.489977:0:41084:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009938e3ad pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051928832:2068@kfi7:13:default-yuba2-0
00000100:00000001:26.0:1773851868.489979:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851868.489980:0:41084:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851868.489981:0:41084:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000009938e3ad x1859433051928832/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852021 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851868.489986:0:41084:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:26.0:1773851868.489987:0:41084:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:26.0:1773851868.489988:0:41084:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e7700903.
02000000:00000001:26.0:1773851868.489989:0:41084:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851868.489990:0:41084:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851868.489990:0:41084:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:26.0:1773851868.489992:0:41084:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:26.0:1773851868.489992:0:41084:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000fc341f21.
02000000:00000001:26.0:1773851868.489994:0:41084:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851868.489994:0:41084:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851868.489995:0:41084:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009938e3ad.
00000100:00000001:26.0:1773851868.489996:0:41084:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851868.489997:0:41084:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851868.489998:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851868.489999:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851868.490000:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851868.490001:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851868.490002:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851868.494165:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.494166:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.494168:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.494170:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.494172:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8194@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.494173:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8194@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.494174:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8194@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.494175:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2d51374 nid 8194@kfi7 refs 1
00000400:00000200:17.0:1773851868.494176:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8194@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.494176:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2d51374 nid 8194@kfi7 refs 2
00000400:00000200:17.0:1773851868.494177:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e2d51374 nid 8194@kfi7 refs 3
00000400:00000200:17.0:1773851868.494178:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8387@kfi7 to cpt 2
00000400:00000200:17.0:1773851868.494179:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8387@kfi7 of length 224 into portal 12 MB=0x69b869de9dfc0
00000400:00000200:17.0:1773851868.494181:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8387@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 11896
00000800:00000200:17.0:1773851868.494182:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.494184:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.494185:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8194@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.494186:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.494186:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.494187:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d30d023b.
00000100:00000040:17.0:1773851868.494188:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000d30d023b x1859852337536960 msgsize 224
00000100:00100000:17.0:1773851868.494190:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8387@kfi7 (source: 12345-8194@kfi7)
00000100:00000001:17.0:1773851868.494191:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.494192:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2d51374 nid 8194@kfi7 refs 2
00000800:00000200:17.0:1773851868.494193:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851868.494196:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851868.494196:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851868.494197:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851868.494197:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851868.494199:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851868.494199:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859852337536960
00000020:00000001:17.0:1773851868.494200:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851868.494201:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f088703bb94b
00000020:00000001:17.0:1773851868.494201:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851868.494203:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007624e588 refcount=8
00000020:00000001:17.0:1773851868.494204:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637082472132608 : -106991237419008 : ffff9eb1294cb000)
00000020:00000001:17.0:1773851868.494205:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637082472132608 : -106991237419008 : ffff9eb1294cb000)
00000100:00000001:17.0:1773851868.494206:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.494207:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851868.494207:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9fa9763.
00000020:00000010:17.0:1773851868.494209:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.494210:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b5739007.
00000100:00000001:17.0:1773851868.494210:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851868.494211:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851868.494211:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.494212:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851868.494213:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851868.494213:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.494214:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.494215:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.494216:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851868.494217:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8387@kfi7, seq: 2156330
00000100:00000040:17.0:1773851868.494217:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007624e588 : new rpc_count 1
00000100:00000001:16.0:1773851868.494217:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.494217:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851868.494218:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636980530381952 : -107093179169664 : ffff9e996d190480)
00000100:00000001:16.0:1773851868.494218:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.494219:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.494220:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d30d023b x1859852337536960/t0(0) o400->ea158544-ce1e-4e62-992c-0607fd1095e9@8387@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1015-0'
00000100:00000001:17.0:1773851868.494222:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.494223:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851868.494224:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d30d023b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ea158544-ce1e-4e62-992c-0607fd1095e9+8:40312:x1859852337536960:12345-8387@kfi7:400:default-tuolumne1015-0
00000100:00000200:17.0:1773851868.494225:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859852337536960
00000020:00000001:17.0:1773851868.494225:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851868.494226:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851868.494227:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.494228:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851868.494228:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851868.494229:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851868.494230:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859852337536960, found 0 last_xid 1859852337536959
00000020:00000001:17.0:1773851868.494231:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851868.494231:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851868.494232:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851868.494232:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.494233:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851868.494233:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851868.494234:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851868.494236:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e532f9e1.
02000000:00000001:17.0:1773851868.494237:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.494237:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.494238:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851868.494239:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252788864, transno 0, xid 1859852337536960
00010000:00000001:17.0:1773851868.494239:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851868.494240:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d30d023b x1859852337536960/t0(0) o400->ea158544-ce1e-4e62-992c-0607fd1095e9@8387@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1015-0'
00010000:00000001:17.0:1773851868.494243:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851868.494243:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851868.494244:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851868.494245:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851868.494246:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dd1404df refcount 3 to 8387@kfi7
00000100:00000001:17.0:1773851868.494247:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134176 : -107146658417440 : ffff9e8cf97c74e0)
02000000:00000001:17.0:1773851868.494247:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851868.494248:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.494249:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851868.494250:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8194@kfi7
00000400:00000010:17.0:1773851868.494250:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fba04bc2.
00000100:00000200:17.0:1773851868.494251:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859852337536960, offset 224
00000400:00000200:17.0:1773851868.494252:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8194@kfi7
00000400:00000200:17.0:1773851868.494253:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8194@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.494254:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e2d51374 nid 8194@kfi7 refs 1
00000400:00000200:17.0:1773851868.494255:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e2d51374 nid 8194@kfi7 refs 2
00000400:00000200:17.0:1773851868.494256:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e2d51374 nid 8194@kfi7 refs 3
00000400:00000200:17.0:1773851868.494258:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8194@kfi7 local destination
00000400:00000200:17.0:1773851868.494259:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769273:8769273:1024:4294967295] 8194@kfi7 LPNI seq info [4913444:4913444:16:4294967295]
00000400:00000200:17.0:1773851868.494261:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e2d51374 nid 8194@kfi7 refs 2
00000400:00000200:17.0:1773851868.494262:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8194@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.494263:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8194@kfi7(8194@kfi7:8194@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851868.494264:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e2d51374 nid 8194@kfi7 refs 3
00000800:00000200:17.0:1773851868.494265:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.494267:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851868.494269:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851868.494271:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000199 Using peer 8194@kfi7(0x100000000000199)
00000800:00000200:17.0:1773851868.494274:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x100000000000199: rc=0
00000800:00000200:17.0:1773851868.494276:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000199 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851868.494278:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.494278:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dd1404df refcount 2 to 8387@kfi7
00010000:00000001:17.0:1773851868.494279:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851868.494280:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.494280:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851868.494281:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d30d023b x1859852337536960/t0(0) o400->ea158544-ce1e-4e62-992c-0607fd1095e9@8387@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1015-0'
00000100:00100000:17.0:1773851868.494284:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d30d023b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ea158544-ce1e-4e62-992c-0607fd1095e9+8:40312:x1859852337536960:12345-8387@kfi7:400:default-tuolumne1015-0 Request processed in 60us (95us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851868.494286:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8387@kfi7, seq: 2156330
00000100:00000040:17.0:1773851868.494287:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007624e588 : new rpc_count 0
00000100:00000001:17.0:1773851868.494288:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851868.494289:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851868.494289:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.494290:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b5739007.
00000800:00000200:18.0:1773851868.494291:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000199 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851868.494291:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9fa9763.
00000020:00000040:17.0:1773851868.494292:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007624e588 : new refcount 7
00000100:00000001:17.0:1773851868.494292:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851868.494293:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851868.494294:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8194@kfi7: PUT: OK
00000400:00000200:18.0:1773851868.494295:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fba04bc2
00000400:00000010:18.0:1773851868.494295:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fba04bc2.
00000100:00000001:18.0:1773851868.494296:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851868.494296:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851868.494297:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e2d51374 nid 8194@kfi7 refs 2
00000800:00000200:18.0:1773851868.494299:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 8194@kfi7(000000001dc5e942):0x0 lsk 410 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000199 Transaction freed
00000800:00000200:9.0:1773851868.505159:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851868.505160:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851868.505161:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851868.505163:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851868.505165:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.505166:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.104@tcp : PUT - for me
00000400:00000200:9.0:1773851868.505167:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.505168:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851868.505169:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.104@tcp to cpt 4
00000400:00000200:9.0:1773851868.505171:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3c4d5f5 nid 172.16.70.104@tcp refs 2
00000400:00000200:9.0:1773851868.505172:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e3c4d5f5 nid 172.16.70.104@tcp refs 3
00000400:00000200:9.0:1773851868.505173:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.104@tcp to cpt 4
00000400:00000200:9.0:1773851868.505174:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.104@tcp of length 224 into portal 12 MB=0x69a101d220d40
00000400:00000200:9.0:1773851868.505176:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.104@tcp of length 224/224 into md 0x6ab01b5d1 [64] + 12120
00000800:00000200:9.0:1773851868.505178:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851868.505179:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851868.505181:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851868.505182:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851868.505182:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851868.505183:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f3215aeb.
00000100:00000040:9.0:1773851868.505184:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f3215aeb x1858243859189056 msgsize 224
00000100:00100000:9.0:1773851868.505186:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.104@tcp (source: 12345-172.16.70.104@tcp)
00000100:00000001:9.0:1773851868.505188:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851868.505189:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851868.505190:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851868.505191:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851868.505191:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851868.505192:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851868.505192:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851868.505193:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851868.505193:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858243859189056
00000020:00000001:17.0:1773851868.505194:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851868.505194:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93059
00000020:00000001:17.0:1773851868.505195:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851868.505197:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000063b36551 refcount=6
00000020:00000001:17.0:1773851868.505198:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745161728 : -107128964389888 : ffff9e911821e400)
00000020:00000001:17.0:1773851868.505198:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745161728 : -107128964389888 : ffff9e911821e400)
00000100:00000001:17.0:1773851868.505199:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.505200:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851868.505201:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9fa9763.
00000020:00000010:17.0:1773851868.505201:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.505202:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b5739007.
00000100:00000001:17.0:1773851868.505203:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851868.505203:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851868.505204:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.505205:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851868.505205:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851868.505206:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.505207:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.505208:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.505208:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851868.505208:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.505208:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851868.505209:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.104@tcp, seq: 2156331
00000100:00000040:17.0:1773851868.505210:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000063b36551 : new rpc_count 1
00000100:00000001:16.0:1773851868.505210:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.505211:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749206016 : -106947960345600 : ffff9ebb3cd06c00)
00000100:00000001:16.0:1773851868.505211:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.505212:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f3215aeb x1858243859189056/t0(0) o400->fe27e63c-c323-4291-ae07-896b5151b6c7@172.16.70.104@tcp:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic4-0'
00000100:00000001:17.0:1773851868.505216:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.505216:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851868.505217:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3215aeb pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:fe27e63c-c323-4291-ae07-896b5151b6c7+6:53556:x1858243859189056:12345-172.16.70.104@tcp:400:login-rzslic4-0
00000100:00000200:17.0:1773851868.505218:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858243859189056
00000020:00000001:17.0:1773851868.505219:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851868.505219:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851868.505220:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.505220:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851868.505221:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851868.505221:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851868.505222:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858243859189056, found 0 last_xid 1858243859189055
00000020:00000001:17.0:1773851868.505223:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851868.505223:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851868.505223:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851868.505224:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.505224:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851868.505225:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851868.505225:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851868.505226:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000009fcccdf.
02000000:00000001:17.0:1773851868.505226:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.505227:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.505227:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851868.505228:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180958182836, transno 0, xid 1858243859189056
00010000:00000001:17.0:1773851868.505228:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851868.505229:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f3215aeb x1858243859189056/t0(0) o400->fe27e63c-c323-4291-ae07-896b5151b6c7@172.16.70.104@tcp:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic4-0'
00010000:00000001:17.0:1773851868.505231:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851868.505232:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851868.505232:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851868.505233:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851868.505237:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000da3367fc refcount 3 to 172.16.70.104@tcp
00000100:00000001:17.0:1773851868.505237:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333760 : -107155408217856 : ffff9e8aeff51900)
02000000:00000001:17.0:1773851868.505238:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851868.505238:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.505239:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851868.505240:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.104@tcp
00000400:00000010:17.0:1773851868.505240:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091c3e15f.
00000100:00000200:17.0:1773851868.505241:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858243859189056, offset 224
00000400:00000200:17.0:1773851868.505243:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.104@tcp
00000400:00000200:17.0:1773851868.505244:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.104@tcp to cpt 4
00000400:00000200:17.0:1773851868.505245:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3c4d5f5 nid 172.16.70.104@tcp refs 2
00000400:00000200:17.0:1773851868.505246:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e3c4d5f5 nid 172.16.70.104@tcp refs 3
00000400:00000200:17.0:1773851868.505247:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e3c4d5f5 nid 172.16.70.104@tcp refs 4
00000400:00000200:17.0:1773851868.505248:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.104@tcp routed destination
00000400:00000200:17.0:1773851868.505250:0:60961:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:17.0:1773851868.505251:0:60961:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:17.0:1773851868.505252:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.104@tcp: rtr pref emtpy: 1
00000400:00000200:17.0:1773851868.505253:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:17.0:1773851868.505254:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.104@tcp: rtr pref emtpy: 1
00000400:00000200:17.0:1773851868.505255:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:17.0:1773851868.505256:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769274:8769274:1024:4294967295] 17@kfi7 LPNI seq info [1250891891:1250891891:16:4294967295]
00000400:00000200:17.0:1773851868.505257:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:17.0:1773851868.505258:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:17.0:1773851868.505261:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.104@tcp(172.16.70.104@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851868.505262:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e3c4d5f5 nid 172.16.70.104@tcp refs 3
00000800:00000200:17.0:1773851868.505264:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.505265:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851868.505267:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851868.505270:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:17.0:1773851868.505273:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:17.0:1773851868.505274:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851868.505276:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.505276:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000da3367fc refcount 2 to 172.16.70.104@tcp
00010000:00000001:17.0:1773851868.505277:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851868.505277:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.505278:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851868.505279:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f3215aeb x1858243859189056/t0(0) o400->fe27e63c-c323-4291-ae07-896b5151b6c7@172.16.70.104@tcp:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic4-0'
00000100:00100000:17.0:1773851868.505282:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3215aeb pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:fe27e63c-c323-4291-ae07-896b5151b6c7+6:53556:x1858243859189056:12345-172.16.70.104@tcp:400:login-rzslic4-0 Request processed in 65us (97us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851868.505285:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.104@tcp, seq: 2156331
00000100:00000040:17.0:1773851868.505285:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000063b36551 : new rpc_count 0
00000800:00000200:18.0:1773851868.505286:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851868.505286:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851868.505286:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851868.505287:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.505287:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b5739007.
00000020:00000010:17.0:1773851868.505288:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9fa9763.
00000020:00000040:17.0:1773851868.505288:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000063b36551 : new refcount 5
00000100:00000001:17.0:1773851868.505289:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851868.505290:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851868.505291:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:18.0:1773851868.505291:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091c3e15f
00000400:00000010:18.0:1773851868.505292:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091c3e15f.
00000100:00000001:18.0:1773851868.505292:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851868.505293:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851868.505293:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:18.0:1773851868.505295:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a Transaction freed
00000800:00000200:15.0:1773851868.519107:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851868.519107:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851868.519109:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851868.519112:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851868.519114:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18464@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.519116:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18464@kfi7 : PUT - for me
00000400:00000200:15.0:1773851868.519117:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18464@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.519118:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d746a654 nid 18464@kfi7 refs 1
00000400:00000200:15.0:1773851868.519120:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18464@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.519121:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d746a654 nid 18464@kfi7 refs 2
00000400:00000200:15.0:1773851868.519122:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d746a654 nid 18464@kfi7 refs 3
00000400:00000200:15.0:1773851868.519123:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18657@kfi7 to cpt 0
00000400:00000200:15.0:1773851868.519124:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18657@kfi7 of length 224 into portal 12 MB=0x69b4c387474c0
00000400:00000200:15.0:1773851868.519127:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18657@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 30024
00000800:00000200:15.0:1773851868.519129:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851868.519132:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851868.519133:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18464@kfi7: PUT: OK
00000100:00000001:15.0:1773851868.519135:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851868.519135:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851868.519136:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c312cb35.
00000100:00000040:15.0:1773851868.519137:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000c312cb35 x1859601527239872 msgsize 224
00000100:00100000:15.0:1773851868.519139:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-18657@kfi7 (source: 12345-18464@kfi7)
00000100:00000001:15.0:1773851868.519140:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851868.519142:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d746a654 nid 18464@kfi7 refs 2
00000800:00000200:15.0:1773851868.519144:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851868.519148:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851868.519148:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851868.519149:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851868.519149:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851868.519150:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851868.519151:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601527239872
00000020:00000001:15.0:1773851868.519151:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851868.519152:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7f55a
00000020:00000001:15.0:1773851868.519152:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851868.519156:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d45d6ad8 refcount=8
00000020:00000001:15.0:1773851868.519157:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098804637696 : -106974904913920 : ffff9eb4f6caf000)
00000020:00000001:15.0:1773851868.519158:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098804637696 : -106974904913920 : ffff9eb4f6caf000)
00000100:00000001:15.0:1773851868.519159:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.519160:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851868.519161:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047ae5d51.
00000020:00000010:15.0:1773851868.519162:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851868.519163:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002bafee4d.
00000100:00000001:15.0:1773851868.519164:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851868.519164:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851868.519165:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.519166:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851868.519166:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851868.519167:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.519168:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.519169:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851868.519169:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851868.519170:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851868.519170:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851868.519171:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18657@kfi7, seq: 2289840
00000100:00000040:15.0:1773851868.519171:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d45d6ad8 : new rpc_count 1
00000100:00000001:15.0:1773851868.519172:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860197632 : -107049849353984 : ffff9ea383c18900)
00000100:00000001:12.0:1773851868.519172:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.519172:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.519173:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c312cb35 x1859601527239872/t0(0) o400->f7398e4e-f172-420c-af61-13e2a77b18d1@18657@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1647-0'
00000100:00000001:15.0:1773851868.519176:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.519178:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851868.519178:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c312cb35 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f7398e4e-f172-420c-af61-13e2a77b18d1+8:39548:x1859601527239872:12345-18657@kfi7:400:default-tuolumne1647-0
00000100:00000200:15.0:1773851868.519180:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601527239872
00000020:00000001:15.0:1773851868.519180:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851868.519181:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851868.519182:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.519182:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851868.519183:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851868.519184:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851868.519184:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601527239872, found 0 last_xid 1859601527239871
00000020:00000001:15.0:1773851868.519185:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851868.519186:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851868.519187:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851868.519187:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.519188:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851868.519189:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851868.519190:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851868.519190:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000706ab772.
02000000:00000001:15.0:1773851868.519191:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.519192:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.519192:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851868.519193:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181931397514, transno 0, xid 1859601527239872
00010000:00000001:15.0:1773851868.519194:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851868.519195:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c312cb35 x1859601527239872/t0(0) o400->f7398e4e-f172-420c-af61-13e2a77b18d1@18657@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1647-0'
00010000:00000001:15.0:1773851868.519197:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851868.519198:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851868.519199:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=101 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851868.519200:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851868.519200:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fb1bd251 refcount 3 to 18657@kfi7
00000100:00000001:15.0:1773851868.519201:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958004192 : -107146751547424 : ffff9e8cf3ef67e0)
02000000:00000001:15.0:1773851868.519202:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851868.519202:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.519204:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851868.519205:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18464@kfi7
00000400:00000010:15.0:1773851868.519205:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001650250b.
00000100:00000200:15.0:1773851868.519206:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601527239872, offset 224
00000400:00000200:15.0:1773851868.519208:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18464@kfi7
00000400:00000200:15.0:1773851868.519209:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18464@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.519210:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d746a654 nid 18464@kfi7 refs 1
00000400:00000200:15.0:1773851868.519211:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d746a654 nid 18464@kfi7 refs 2
00000400:00000200:15.0:1773851868.519212:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d746a654 nid 18464@kfi7 refs 3
00000400:00000200:15.0:1773851868.519213:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18464@kfi7 local destination
00000400:00000200:15.0:1773851868.519214:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769275:8769275:1024:4294967295] 18464@kfi7 LPNI seq info [138268:138268:16:4294967295]
00000400:00000200:15.0:1773851868.519216:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d746a654 nid 18464@kfi7 refs 2
00000400:00000200:15.0:1773851868.519216:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18464@kfi7 to cpt 3
00000400:00000200:15.0:1773851868.519218:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18464@kfi7(18464@kfi7:18464@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851868.519219:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d746a654 nid 18464@kfi7 refs 3
00000800:00000200:15.0:1773851868.519221:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851868.519222:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851868.519224:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851868.519226:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf9 Using peer 18464@kfi7(0xf9)
00000800:00000200:15.0:1773851868.519231:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0xf9: rc=0
00000800:00000200:15.0:1773851868.519233:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851868.519235:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851868.519236:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fb1bd251 refcount 2 to 18657@kfi7
00010000:00000001:15.0:1773851868.519236:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851868.519237:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851868.519238:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851868.519238:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c312cb35 x1859601527239872/t0(0) o400->f7398e4e-f172-420c-af61-13e2a77b18d1@18657@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1647-0'
00000800:00000200:13.0:1773851868.519247:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf9 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851868.519248:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c312cb35 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f7398e4e-f172-420c-af61-13e2a77b18d1+8:39548:x1859601527239872:12345-18657@kfi7:400:default-tuolumne1647-0 Request processed in 71us (110us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851868.519250:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18657@kfi7, seq: 2289840
00000400:00000200:13.0:1773851868.519250:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:15.0:1773851868.519251:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d45d6ad8 : new rpc_count 0
00000100:00000001:15.0:1773851868.519252:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851868.519252:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851868.519252:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18464@kfi7: PUT: OK
00000020:00000010:15.0:1773851868.519253:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851868.519253:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001650250b
00000020:00000010:15.0:1773851868.519254:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002bafee4d.
00000400:00000010:13.0:1773851868.519254:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001650250b.
00000020:00000010:15.0:1773851868.519255:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047ae5d51.
00000020:00000040:15.0:1773851868.519256:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000d45d6ad8 : new refcount 7
00000100:00000001:15.0:1773851868.519256:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851868.519256:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851868.519256:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851868.519258:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d746a654 nid 18464@kfi7 refs 2
00000800:00000200:13.0:1773851868.519261:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18464@kfi7(000000005d3be37c):0x0 lsk 250 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf9 Transaction freed
00000800:00000200:5.0F:1773851868.528156:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851868.528158:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851868.528159:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851868.528161:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851868.528164:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12434@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.528165:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12434@kfi7 : PUT - for me
00000400:00000200:5.0:1773851868.528166:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12434@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.528167:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021e87207 nid 12434@kfi7 refs 1
00000400:00000200:5.0:1773851868.528168:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12434@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.528168:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021e87207 nid 12434@kfi7 refs 2
00000400:00000200:5.0:1773851868.528169:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021e87207 nid 12434@kfi7 refs 3
00000400:00000200:5.0:1773851868.528170:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12370@kfi7 to cpt 5
00000400:00000200:5.0:1773851868.528171:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12370@kfi7 of length 224 into portal 12 MB=0x69b7bc41da880
00000400:00000200:5.0:1773851868.528172:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12370@kfi7 of length 224/224 into md 0x793926dc5 [64] + 136120
00000800:00000200:5.0:1773851868.528174:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851868.528176:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851868.528177:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12434@kfi7: PUT: OK
00000100:00000001:5.0:1773851868.528178:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851868.528178:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851868.528179:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000092950123.
00000100:00000040:5.0:1773851868.528180:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000092950123 x1859805733824640 msgsize 224
00000100:00100000:5.0:1773851868.528181:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12370@kfi7 (source: 12345-12434@kfi7)
00000100:00000001:5.0:1773851868.528182:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851868.528183:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021e87207 nid 12434@kfi7 refs 2
00000100:00000001:7.0F:1773851868.528184:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851868.528184:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851868.528185:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851868.528185:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851868.528186:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851868.528187:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851868.528188:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859805733824640
00000020:00000001:7.0:1773851868.528188:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851868.528189:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08591a39ad0
00000020:00000001:7.0:1773851868.528189:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851868.528191:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fac23021 refcount=5
00000020:00000001:7.0:1773851868.528192:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165257367552 : -106908452184064 : ffff9ec46faf2000)
00000020:00000001:7.0:1773851868.528192:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165257367552 : -106908452184064 : ffff9ec46faf2000)
00000100:00000001:7.0:1773851868.528193:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851868.528194:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851868.528195:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b984b53b.
00000020:00000010:7.0:1773851868.528196:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851868.528197:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008745c425.
00000100:00000001:7.0:1773851868.528198:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851868.528198:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851868.528198:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851868.528199:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851868.528200:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851868.528200:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851868.528201:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851868.528203:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851868.528203:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851868.528203:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851868.528203:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851868.528204:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12370@kfi7, seq: 2001920
00000100:00000040:7.0:1773851868.528205:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fac23021 : new rpc_count 1
00000100:00000001:7.0:1773851868.528205:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886790016 : -106955822761600 : ffff9eb9682d7980)
00000100:00000001:5.0:1773851868.528205:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851868.528206:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000092950123 x1859805733824640/t0(0) o400->540611c5-9ed5-4cb2-8916-8412797ec46e@12370@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1270-0'
00000100:00000001:5.0:1773851868.528206:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851868.528209:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851868.528209:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851868.528210:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000092950123 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:540611c5-9ed5-4cb2-8916-8412797ec46e+5:39653:x1859805733824640:12345-12370@kfi7:400:default-tuolumne1270-0
00000100:00000200:7.0:1773851868.528213:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859805733824640
00000020:00000001:7.0:1773851868.528213:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851868.528214:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851868.528215:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851868.528216:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851868.528216:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851868.528217:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851868.528217:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859805733824640, found 0 last_xid 1859805733824639
00000020:00000001:7.0:1773851868.528218:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851868.528219:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851868.528220:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851868.528220:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851868.528221:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851868.528221:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851868.528222:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851868.528223:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c1d93e9c.
02000000:00000001:7.0:1773851868.528223:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851868.528224:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851868.528224:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851868.528225:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182589769352, transno 0, xid 1859805733824640
00010000:00000001:7.0:1773851868.528226:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851868.528227:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000092950123 x1859805733824640/t0(0) o400->540611c5-9ed5-4cb2-8916-8412797ec46e@12370@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1270-0'
00010000:00000001:7.0:1773851868.528229:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851868.528230:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851868.528231:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=100 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851868.528232:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851868.528233:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd646111 refcount 3 to 12370@kfi7
00000100:00000001:7.0:1773851868.528234:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450176 : -107146752101440 : ffff9e8cf3e6f3c0)
02000000:00000001:7.0:1773851868.528235:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851868.528235:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851868.528236:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851868.528236:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12434@kfi7
00000400:00000010:7.0:1773851868.528237:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000100:00000200:7.0:1773851868.528239:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859805733824640, offset 224
00000400:00000200:7.0:1773851868.528240:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12434@kfi7
00000400:00000200:7.0:1773851868.528241:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12434@kfi7 to cpt 1
00000400:00000200:7.0:1773851868.528241:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021e87207 nid 12434@kfi7 refs 1
00000400:00000200:7.0:1773851868.528243:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021e87207 nid 12434@kfi7 refs 2
00000400:00000200:7.0:1773851868.528244:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021e87207 nid 12434@kfi7 refs 3
00000400:00000200:7.0:1773851868.528245:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12434@kfi7 local destination
00000400:00000200:7.0:1773851868.528246:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769276:8769276:1024:4294967295] 12434@kfi7 LPNI seq info [212354:212354:16:4294967295]
00000400:00000200:7.0:1773851868.528248:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021e87207 nid 12434@kfi7 refs 2
00000400:00000200:7.0:1773851868.528248:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12434@kfi7 to cpt 1
00000400:00000200:7.0:1773851868.528250:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12434@kfi7(12434@kfi7:12434@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851868.528252:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021e87207 nid 12434@kfi7 refs 3
00000800:00000200:7.0:1773851868.528253:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851868.528254:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851868.528256:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851868.528258:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb49 Using peer 12434@kfi7(0xb49)
00000800:00000200:7.0:1773851868.528261:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0xb49: rc=0
00000800:00000200:7.0:1773851868.528263:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb49 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851868.528265:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851868.528265:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd646111 refcount 2 to 12370@kfi7
00010000:00000001:7.0:1773851868.528266:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851868.528267:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851868.528267:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851868.528268:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000092950123 x1859805733824640/t0(0) o400->540611c5-9ed5-4cb2-8916-8412797ec46e@12370@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1270-0'
00000100:00100000:7.0:1773851868.528271:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000092950123 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:540611c5-9ed5-4cb2-8916-8412797ec46e+5:39653:x1859805733824640:12345-12370@kfi7:400:default-tuolumne1270-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851868.528273:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12370@kfi7, seq: 2001920
00000100:00000040:7.0:1773851868.528274:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fac23021 : new rpc_count 0
00000100:00000001:7.0:1773851868.528275:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851868.528276:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:5.0:1773851868.528276:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb49 TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851868.528277:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851868.528277:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008745c425.
00000400:00000200:5.0:1773851868.528277:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851868.528278:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b984b53b.
00000400:00000200:5.0:1773851868.528278:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12434@kfi7: PUT: OK
00000020:00000040:7.0:1773851868.528279:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000fac23021 : new refcount 4
00000100:00000001:7.0:1773851868.528279:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851868.528279:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:5.0:1773851868.528279:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:5.0:1773851868.528280:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851868.528280:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851868.528281:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021e87207 nid 12434@kfi7 refs 2
00000800:00000200:5.0:1773851868.528282:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 12434@kfi7(00000000f13f8f05):0x0 lsk 2890 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb49 Transaction freed
00000800:00000200:17.0:1773851868.547604:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.547605:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.547606:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.547608:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.547610:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547612:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25083@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.547613:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547614:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 1
00000400:00000200:17.0:1773851868.547615:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547616:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000400:00000200:17.0:1773851868.547617:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 3
00000400:00000200:17.0:1773851868.547617:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547618:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25083@kfi7 of length 224 into portal 12 MB=0x699de82ca1400
00000400:00000200:17.0:1773851868.547620:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25083@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 12344
00000800:00000200:17.0:1773851868.547622:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.547623:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.547624:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25083@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.547625:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.547626:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.547627:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f724b1ce.
00000100:00000040:17.0:1773851868.547627:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f724b1ce x1858030816334848 msgsize 224
00000100:00100000:17.0:1773851868.547629:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25083@kfi7 (source: 12345-25083@kfi7)
00000100:00000001:17.0:1773851868.547630:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.547631:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000800:00000200:17.0:1773851868.547632:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851868.547634:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851868.547635:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851868.547635:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851868.547636:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851868.547637:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851868.547637:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030816334848
00000020:00000001:17.0:1773851868.547638:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851868.547638:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9107e
00000020:00000001:17.0:1773851868.547639:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851868.547641:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000052691f27 refcount=6
00000020:00000001:17.0:1773851868.547642:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240101888 : -107152469449728 : ffff9e8b9f1f2400)
00000020:00000001:17.0:1773851868.547642:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240101888 : -107152469449728 : ffff9e8b9f1f2400)
00000100:00000001:17.0:1773851868.547643:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.547644:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851868.547645:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9fa9763.
00000020:00000010:17.0:1773851868.547646:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.547647:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b5739007.
00000100:00000001:17.0:1773851868.547648:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851868.547648:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851868.547649:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.547650:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851868.547650:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851868.547650:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.547651:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.547652:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.547653:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851868.547653:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.547653:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851868.547654:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25083@kfi7, seq: 2156332
00000100:00000040:17.0:1773851868.547654:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000052691f27 : new rpc_count 1
00000100:00000001:17.0:1773851868.547655:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636980530410752 : -107093179140864 : ffff9e996d197500)
00000100:00000001:16.0:1773851868.547655:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.547655:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.547656:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f724b1ce x1858030816334848/t0(0) o400->ab9afd03-fb96-4507-ae1e-ada092cf499d@25083@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne266-0'
00000100:00000001:17.0:1773851868.547659:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.547659:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851868.547660:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f724b1ce pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ab9afd03-fb96-4507-ae1e-ada092cf499d+6:47960:x1858030816334848:12345-25083@kfi7:400:default-tuolumne266-0
00000100:00000200:17.0:1773851868.547661:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030816334848
00000020:00000001:17.0:1773851868.547662:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851868.547663:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851868.547663:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.547664:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851868.547665:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851868.547665:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851868.547666:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030816334848, found 0 last_xid 1858030816334847
00000020:00000001:17.0:1773851868.547666:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851868.547667:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851868.547668:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851868.547668:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.547669:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851868.547670:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851868.547670:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851868.547671:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000070719206.
02000000:00000001:17.0:1773851868.547672:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.547672:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.547673:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851868.547674:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030816334848
00010000:00000001:17.0:1773851868.547675:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851868.547675:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f724b1ce x1858030816334848/t0(0) o400->ab9afd03-fb96-4507-ae1e-ada092cf499d@25083@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne266-0'
00010000:00000001:17.0:1773851868.547678:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851868.547678:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851868.547679:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851868.547680:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851868.547681:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fb0bb4f8 refcount 5 to 25083@kfi7
00000100:00000001:17.0:1773851868.547681:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370151616 : -107145339400000 : ffff9e8d481b10c0)
02000000:00000001:17.0:1773851868.547682:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851868.547683:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.547683:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851868.547684:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25083@kfi7
00000400:00000010:17.0:1773851868.547685:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091c3e15f.
00000100:00000200:17.0:1773851868.547686:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030816334848, offset 224
00000400:00000200:17.0:1773851868.547687:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25083@kfi7
00000400:00000200:17.0:1773851868.547688:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547688:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 1
00000400:00000200:17.0:1773851868.547689:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000400:00000200:17.0:1773851868.547690:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 3
00000400:00000200:17.0:1773851868.547692:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25083@kfi7 local destination
00000400:00000200:17.0:1773851868.547693:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769277:8769277:1024:4294967295] 25083@kfi7 LPNI seq info [24429:24429:16:4294967295]
00000400:00000200:17.0:1773851868.547694:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000400:00000200:17.0:1773851868.547695:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547696:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25083@kfi7(25083@kfi7:25083@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851868.547698:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 3
00000800:00000200:17.0:1773851868.547699:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.547701:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851868.547703:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851868.547705:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c6 Using peer 25083@kfi7(0x1000000000005c6)
00000800:00000200:17.0:1773851868.547707:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x1000000000005c6: rc=0
00000800:00000200:17.0:1773851868.547709:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851868.547710:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.547711:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fb0bb4f8 refcount 4 to 25083@kfi7
00010000:00000001:17.0:1773851868.547712:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851868.547712:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.547713:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851868.547714:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f724b1ce x1858030816334848/t0(0) o400->ab9afd03-fb96-4507-ae1e-ada092cf499d@25083@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne266-0'
00000100:00100000:17.0:1773851868.547716:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f724b1ce pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ab9afd03-fb96-4507-ae1e-ada092cf499d+6:47960:x1858030816334848:12345-25083@kfi7:400:default-tuolumne266-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851868.547718:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25083@kfi7, seq: 2156332
00000100:00000040:17.0:1773851868.547720:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000052691f27 : new rpc_count 0
00000100:00000001:17.0:1773851868.547720:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851868.547721:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c6 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851868.547721:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851868.547721:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.547722:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b5739007.
00000400:00000200:18.0:1773851868.547723:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851868.547723:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9fa9763.
00000400:00000200:18.0:1773851868.547724:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25083@kfi7: PUT: OK
00000020:00000040:17.0:1773851868.547724:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000052691f27 : new refcount 5
00000100:00000001:17.0:1773851868.547724:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851868.547729:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091c3e15f
00000400:00000010:18.0:1773851868.547729:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091c3e15f.
00000100:00000001:18.0:1773851868.547730:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851868.547730:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851868.547731:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000800:00000200:18.0:1773851868.547732:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 25083@kfi7(00000000e992e7ef):0x0 lsk 1479 rsk 85 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005c6 Transaction freed
00000800:00000200:17.0:1773851868.547923:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.547924:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.547926:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.547928:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.547930:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547931:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25083@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.547932:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547933:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 1
00000400:00000200:17.0:1773851868.547934:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547934:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000400:00000200:17.0:1773851868.547935:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 3
00000400:00000200:17.0:1773851868.547936:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.547937:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25083@kfi7 of length 224 into portal 12 MB=0x699de82ca1c40
00000400:00000200:17.0:1773851868.547938:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25083@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 12568
00000800:00000200:17.0:1773851868.547939:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.547941:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.547942:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25083@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.547942:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.547943:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.547944:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000025019bf8.
00000100:00000040:17.0:1773851868.547944:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000025019bf8 x1858030816336960 msgsize 224
00000100:00100000:17.0:1773851868.547945:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25083@kfi7 (source: 12345-25083@kfi7)
00000100:00000001:17.0:1773851868.547946:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.547947:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000800:00000200:17.0:1773851868.547949:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851868.547951:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851868.547951:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851868.547952:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851868.547952:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851868.547953:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851868.547954:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030816336960
00000020:00000001:17.0:1773851868.547954:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851868.547955:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911ff
00000020:00000001:17.0:1773851868.547955:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851868.547958:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000040da29f4 refcount=6
00000020:00000001:17.0:1773851868.547959:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240518656 : -107152469032960 : ffff9e8b9f258000)
00000020:00000001:17.0:1773851868.547959:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240518656 : -107152469032960 : ffff9e8b9f258000)
00000100:00000001:17.0:1773851868.547960:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.547961:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851868.547961:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001bc015a1.
00000020:00000010:17.0:1773851868.547962:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.547963:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b5739007.
00000100:00000001:17.0:1773851868.547963:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851868.547964:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851868.547964:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.547965:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851868.547965:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851868.547965:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.547966:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.547967:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.547968:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851868.547968:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25083@kfi7, seq: 2156333
00000100:00000001:16.0:1773851868.547968:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.547968:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851868.547969:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000040da29f4 : new rpc_count 1
00000100:00000001:17.0:1773851868.547969:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156639486336 : -106917070065280 : ffff9ec26e04b180)
00000100:00000001:16.0:1773851868.547969:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.547970:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000025019bf8 x1858030816336960/t0(0) o400->e24e4b76-0b8c-4a12-ba44-92bea0f23ec5@25083@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne266-0'
00000100:00000001:16.0:1773851868.547970:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.547973:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.547973:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851868.547974:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025019bf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e24e4b76-0b8c-4a12-ba44-92bea0f23ec5+6:47961:x1858030816336960:12345-25083@kfi7:400:default-tuolumne266-0
00000100:00000200:17.0:1773851868.547975:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030816336960
00000020:00000001:17.0:1773851868.547976:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851868.547977:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851868.547977:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.547978:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851868.547978:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851868.547979:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851868.547979:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030816336960, found 0 last_xid 1858030816336959
00000020:00000001:17.0:1773851868.547980:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851868.547980:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851868.547981:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851868.547981:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.547981:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851868.547982:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851868.547982:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851868.547983:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a9fa9763.
02000000:00000001:17.0:1773851868.547983:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.547984:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.547984:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851868.547985:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767984, transno 0, xid 1858030816336960
00010000:00000001:17.0:1773851868.547985:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851868.547986:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000025019bf8 x1858030816336960/t0(0) o400->e24e4b76-0b8c-4a12-ba44-92bea0f23ec5@25083@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne266-0'
00010000:00000001:17.0:1773851868.547988:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851868.547989:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851868.547989:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851868.547990:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851868.547991:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fb0bb4f8 refcount 5 to 25083@kfi7
00000100:00000001:17.0:1773851868.547991:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370151616 : -107145339400000 : ffff9e8d481b10c0)
02000000:00000001:17.0:1773851868.547992:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851868.547992:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.547993:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851868.547994:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25083@kfi7
00000400:00000010:17.0:1773851868.547994:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fba04bc2.
00000100:00000200:17.0:1773851868.547995:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030816336960, offset 224
00000400:00000200:17.0:1773851868.547996:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25083@kfi7
00000400:00000200:17.0:1773851868.547996:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.548009:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 1
00000400:00000200:17.0:1773851868.548009:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000400:00000200:17.0:1773851868.548010:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 3
00000400:00000200:17.0:1773851868.548011:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25083@kfi7 local destination
00000400:00000200:17.0:1773851868.548012:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769278:8769278:1024:4294967295] 25083@kfi7 LPNI seq info [24430:24430:16:4294967295]
00000400:00000200:17.0:1773851868.548014:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000400:00000200:17.0:1773851868.548014:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25083@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.548016:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25083@kfi7(25083@kfi7:25083@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851868.548017:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 3
00000800:00000200:17.0:1773851868.548018:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.548019:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851868.548021:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851868.548023:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5dd Using peer 25083@kfi7(0x5dd)
00000800:00000200:17.0:1773851868.548026:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x5dd: rc=0
00000800:00000200:17.0:1773851868.548027:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5dd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851868.548029:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851868.548030:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fb0bb4f8 refcount 4 to 25083@kfi7
00010000:00000001:17.0:1773851868.548030:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851868.548031:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851868.548031:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851868.548032:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000025019bf8 x1858030816336960/t0(0) o400->e24e4b76-0b8c-4a12-ba44-92bea0f23ec5@25083@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne266-0'
00000100:00100000:17.0:1773851868.548035:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025019bf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e24e4b76-0b8c-4a12-ba44-92bea0f23ec5+6:47961:x1858030816336960:12345-25083@kfi7:400:default-tuolumne266-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851868.548037:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25083@kfi7, seq: 2156333
00000100:00000040:17.0:1773851868.548038:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000040da29f4 : new rpc_count 0
00000100:00000001:17.0:1773851868.548039:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851868.548039:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:18.0:1773851868.548040:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5dd TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851868.548040:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.548040:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b5739007.
00000020:00000010:17.0:1773851868.548041:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001bc015a1.
00000400:00000200:18.0:1773851868.548042:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851868.548042:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000040da29f4 : new refcount 5
00000100:00000001:17.0:1773851868.548042:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851868.548043:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25083@kfi7: PUT: OK
00000400:00000200:18.0:1773851868.548043:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fba04bc2
00000400:00000010:18.0:1773851868.548044:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fba04bc2.
00000100:00000001:18.0:1773851868.548044:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851868.548044:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851868.548045:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a14e0c73 nid 25083@kfi7 refs 2
00000800:00000200:18.0:1773851868.548047:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25083@kfi7(0000000021ef1e7b):0x0 lsk 1502 rsk 86 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5dd Transaction freed
00000800:00000200:13.0:1773851868.601986:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851868.601987:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851868.601989:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851868.601991:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851868.601993:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.602009:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22865@kfi7 : PUT - for me
00000400:00000200:13.0:1773851868.602010:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.602012:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 1
00000400:00000200:13.0:1773851868.602014:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.602014:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000400:00000200:13.0:1773851868.602015:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 3
00000400:00000200:13.0:1773851868.602016:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22928@kfi7 to cpt 3
00000400:00000200:13.0:1773851868.602017:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22928@kfi7 of length 224 into portal 12 MB=0x69b0a457be9c0
00000400:00000200:13.0:1773851868.602019:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22928@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 30248
00000800:00000200:13.0:1773851868.602022:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851868.602024:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851868.602025:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22865@kfi7: PUT: OK
00000100:00000001:13.0:1773851868.602026:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851868.602027:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851868.602029:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000106324c9.
00000100:00000040:13.0:1773851868.602029:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000106324c9 x1859318277990848 msgsize 224
00000100:00100000:13.0:1773851868.602031:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22928@kfi7 (source: 12345-22865@kfi7)
00000100:00000001:13.0:1773851868.602032:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851868.602033:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000100:00000001:15.0:1773851868.602035:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851868.602035:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851868.602036:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851868.602037:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851868.602038:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851868.602039:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851868.602040:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318277990848
00000020:00000001:15.0:1773851868.602041:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851868.602042:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92959
00000020:00000001:15.0:1773851868.602043:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851868.602048:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dad3dfb4 refcount=6
00000020:00000001:15.0:1773851868.602050:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743185408 : -107128966366208 : ffff9e911803bc00)
00000020:00000001:15.0:1773851868.602051:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743185408 : -107128966366208 : ffff9e911803bc00)
00000100:00000001:15.0:1773851868.602052:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851868.602054:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851868.602055:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047ae5d51.
00000020:00000010:15.0:1773851868.602056:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851868.602058:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002bafee4d.
00000100:00000001:15.0:1773851868.602059:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851868.602060:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851868.602061:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.602062:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851868.602063:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851868.602064:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851868.602065:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.602067:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851868.602067:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851868.602068:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851868.602068:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851868.602069:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22928@kfi7, seq: 2289841
00000100:00000001:15.0:1773851868.602070:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851868.602070:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dad3dfb4 : new rpc_count 1
00000100:00000001:15.0:1773851868.602071:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.602071:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970972032 : -107043738579584 : ffff9ea4effc8d80)
00000100:00000040:12.0:1773851868.602072:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000106324c9 x1859318277990848/t0(0) o400->f43a6c4d-66f1-4b10-9029-481f4c40eda8@22928@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1922-0'
00000100:00000001:12.0:1773851868.602079:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851868.602079:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851868.602080:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000106324c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f43a6c4d-66f1-4b10-9029-481f4c40eda8+6:39931:x1859318277990848:12345-22928@kfi7:400:default-tuolumne1922-0
00000100:00000200:12.0:1773851868.602082:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318277990848
00000020:00000001:12.0:1773851868.602082:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851868.602083:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851868.602084:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.602084:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851868.602085:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851868.602086:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851868.602087:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318277990848, found 0 last_xid 1859318277990847
00000020:00000001:12.0:1773851868.602087:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851868.602088:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851868.602089:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851868.602089:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.602090:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851868.602091:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851868.602091:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851868.602092:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003bdc2b77.
02000000:00000001:12.0:1773851868.602093:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.602094:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.602094:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851868.602095:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859318277990848
00010000:00000001:12.0:1773851868.602096:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851868.602097:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000106324c9 x1859318277990848/t0(0) o400->f43a6c4d-66f1-4b10-9029-481f4c40eda8@22928@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1922-0'
00010000:00000001:12.0:1773851868.602099:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851868.602100:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851868.602101:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=101 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851868.602103:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851868.602104:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000af4f7cac refcount 5 to 22928@kfi7
00000100:00000001:12.0:1773851868.602105:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521904800 : -107145187646816 : ffff9e8d5126a2a0)
02000000:00000001:12.0:1773851868.602110:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851868.602110:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.602111:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851868.602113:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22865@kfi7
00000400:00000010:12.0:1773851868.602114:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009fd0199.
00000100:00000200:12.0:1773851868.602116:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318277990848, offset 224
00000400:00000200:12.0:1773851868.602119:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22865@kfi7
00000400:00000200:12.0:1773851868.602120:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:12.0:1773851868.602122:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 1
00000400:00000200:12.0:1773851868.602124:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000400:00000200:12.0:1773851868.602126:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 3
00000400:00000200:12.0:1773851868.602128:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22865@kfi7 local destination
00000400:00000200:12.0:1773851868.602131:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769279:8769279:1024:4294967295] 22865@kfi7 LPNI seq info [7351418:7351418:16:4294967295]
00000400:00000200:12.0:1773851868.602134:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000400:00000200:12.0:1773851868.602135:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22865@kfi7 to cpt 3
00000400:00000200:12.0:1773851868.602139:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22865@kfi7(22865@kfi7:22865@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851868.602141:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 3
00000800:00000200:12.0:1773851868.602145:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851868.602147:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851868.602152:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851868.602156:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a15 Using peer 22865@kfi7(0x100000000000a15)
00000800:00000200:12.0:1773851868.602162:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x100000000000a15: rc=0
00000800:00000200:12.0:1773851868.602164:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a15 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851868.602168:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851868.602169:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000af4f7cac refcount 4 to 22928@kfi7
00010000:00000001:12.0:1773851868.602173:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851868.602174:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.602175:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851868.602177:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000106324c9 x1859318277990848/t0(0) o400->f43a6c4d-66f1-4b10-9029-481f4c40eda8@22928@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1922-0'
00000100:00100000:12.0:1773851868.602182:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000106324c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f43a6c4d-66f1-4b10-9029-481f4c40eda8+6:39931:x1859318277990848:12345-22928@kfi7:400:default-tuolumne1922-0 Request processed in 102us (151us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851868.602186:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22928@kfi7, seq: 2289841
00000100:00000040:12.0:1773851868.602188:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dad3dfb4 : new rpc_count 0
00000100:00000001:12.0:1773851868.602189:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851868.602190:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851868.602191:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851868.602192:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002bafee4d.
00000020:00000010:12.0:1773851868.602194:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047ae5d51.
00000020:00000040:12.0:1773851868.602195:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000dad3dfb4 : new refcount 5
00000100:00000001:12.0:1773851868.602196:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851868.602204:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a15 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851868.602206:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851868.602207:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22865@kfi7: PUT: OK
00000400:00000200:14.0:1773851868.602207:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009fd0199
00000400:00000010:14.0:1773851868.602208:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009fd0199.
00000100:00000001:14.0:1773851868.602208:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851868.602209:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851868.602210:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa7baa94 nid 22865@kfi7 refs 2
00000800:00000200:14.0:1773851868.602212:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 22865@kfi7(000000005d9b0789):0x0 lsk 2582 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a15 Transaction freed
00000800:00000200:22.0:1773851868.619957:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.619957:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851868.619959:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851868.619961:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851868.619963:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12849@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.619965:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12849@kfi7 : PUT - for me
00000400:00000200:22.0:1773851868.619966:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12849@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.619967:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000582d9f3d nid 12849@kfi7 refs 1
00000400:00000200:22.0:1773851868.619968:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12849@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.619969:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000582d9f3d nid 12849@kfi7 refs 2
00000400:00000200:22.0:1773851868.619970:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000582d9f3d nid 12849@kfi7 refs 3
00000400:00000200:22.0:1773851868.619971:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12848@kfi7 to cpt 2
00000400:00000200:22.0:1773851868.619972:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12848@kfi7 of length 224 into portal 12 MB=0x69b4b56624700
00000400:00000200:22.0:1773851868.619974:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12848@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 37504
00000800:00000200:22.0:1773851868.619976:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851868.619978:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851868.619979:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12849@kfi7: PUT: OK
00000100:00000001:22.0:1773851868.619980:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851868.619980:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851868.619982:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ee556ae8.
00000100:00000040:22.0:1773851868.619982:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000ee556ae8 x1859597734397696 msgsize 224
00000100:00100000:22.0:1773851868.619984:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-12848@kfi7 (source: 12345-12849@kfi7)
00000100:00000001:22.0:1773851868.619985:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851868.619986:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000582d9f3d nid 12849@kfi7 refs 2
00000800:00000200:22.0:1773851868.619988:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000068d775d8: 2054@kfi7:5 <- 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851868.619990:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851868.619991:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851868.619991:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851868.619992:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851868.619993:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851868.619994:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597734397696
00000020:00000001:22.0:1773851868.619994:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851868.619995:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ab3e
00000020:00000001:22.0:1773851868.619995:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851868.619997:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a22991bd refcount=5
00000020:00000001:22.0:1773851868.619998:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125744043008 : -106947965508608 : ffff9ebb3c81a400)
00000020:00000001:22.0:1773851868.619999:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125744043008 : -106947965508608 : ffff9ebb3c81a400)
00000100:00000001:22.0:1773851868.620000:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.620000:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851868.620001:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000020:00000010:22.0:1773851868.620002:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.620003:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851868.620004:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851868.620005:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851868.620006:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851868.620007:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851868.620007:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851868.620008:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.620009:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851868.620010:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.620010:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851868.620012:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851868.620012:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851868.620012:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12848@kfi7, seq: 1997981
00000100:00000040:22.0:1773851868.620012:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a22991bd : new rpc_count 1
00000100:00000001:23.0:1773851868.620013:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.620013:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619610496 : -107003089941120 : ffff9eae66d58d80)
00000100:00000001:23.0:1773851868.620014:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.620014:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ee556ae8 x1859597734397696/t0(0) o400->bd9055ec-ae8a-48e4-a820-7ab948ae5341@12848@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1293-0'
00000100:00000001:22.0:1773851868.620017:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.620017:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851868.620018:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee556ae8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:bd9055ec-ae8a-48e4-a820-7ab948ae5341+5:39555:x1859597734397696:12345-12848@kfi7:400:default-tuolumne1293-0
00000100:00000200:22.0:1773851868.620020:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597734397696
00000020:00000001:22.0:1773851868.620021:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851868.620021:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851868.620022:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.620022:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851868.620023:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851868.620024:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851868.620024:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597734397696, found 0 last_xid 1859597734397695
00000020:00000001:22.0:1773851868.620025:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851868.620026:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851868.620026:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851868.620027:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.620027:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851868.620028:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851868.620029:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851868.620029:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000612ba3d.
02000000:00000001:22.0:1773851868.620030:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.620031:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.620032:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851868.620032:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695223, transno 0, xid 1859597734397696
00010000:00000001:22.0:1773851868.620033:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851868.620034:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ee556ae8 x1859597734397696/t0(0) o400->bd9055ec-ae8a-48e4-a820-7ab948ae5341@12848@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1293-0'
00010000:00000001:22.0:1773851868.620036:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851868.620037:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851868.620038:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=101 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851868.620039:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851868.620039:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ade2599b refcount 3 to 12848@kfi7
00000100:00000001:22.0:1773851868.620040:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551675840 : -107156157875776 : ffff9e8ac34639c0)
02000000:00000001:22.0:1773851868.620041:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851868.620041:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.620042:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851868.620043:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12849@kfi7
00000400:00000010:22.0:1773851868.620044:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000255a4f76.
00000100:00000200:22.0:1773851868.620045:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597734397696, offset 224
00000400:00000200:22.0:1773851868.620046:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12849@kfi7
00000400:00000200:22.0:1773851868.620047:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12849@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.620048:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000582d9f3d nid 12849@kfi7 refs 1
00000400:00000200:22.0:1773851868.620049:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000582d9f3d nid 12849@kfi7 refs 2
00000400:00000200:22.0:1773851868.620050:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000582d9f3d nid 12849@kfi7 refs 3
00000400:00000200:22.0:1773851868.620051:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12849@kfi7 local destination
00000400:00000200:22.0:1773851868.620052:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769280:8769280:1024:4294967295] 12849@kfi7 LPNI seq info [4259778:4259778:16:4294967295]
00000400:00000200:22.0:1773851868.620053:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000582d9f3d nid 12849@kfi7 refs 2
00000400:00000200:22.0:1773851868.620054:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12849@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.620056:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12849@kfi7(12849@kfi7:12849@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851868.620057:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000582d9f3d nid 12849@kfi7 refs 3
00000800:00000200:22.0:1773851868.620058:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.620059:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851868.620063:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851868.620066:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a11 Using peer 12849@kfi7(0x100000000000a11)
00000800:00000200:22.0:1773851868.620069:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000068d775d8: Posted send of 324 bytes to peer 0x100000000000a11: rc=0
00000800:00000200:22.0:1773851868.620071:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a11 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851868.620073:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.620074:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ade2599b refcount 2 to 12848@kfi7
00010000:00000001:22.0:1773851868.620075:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851868.620075:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.620076:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851868.620077:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ee556ae8 x1859597734397696/t0(0) o400->bd9055ec-ae8a-48e4-a820-7ab948ae5341@12848@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1293-0'
00000100:00100000:22.0:1773851868.620080:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee556ae8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:bd9055ec-ae8a-48e4-a820-7ab948ae5341+5:39555:x1859597734397696:12345-12848@kfi7:400:default-tuolumne1293-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851868.620082:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12848@kfi7, seq: 1997981
00000100:00000040:22.0:1773851868.620083:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a22991bd : new rpc_count 0
00000100:00000001:22.0:1773851868.620084:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851868.620084:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851868.620085:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.620086:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851868.620086:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000020:00000040:22.0:1773851868.620087:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000a22991bd : new refcount 4
00000800:00000200:21.0:1773851868.620087:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a11 TN_EVENT_TX_OK event status 0
00000100:00000001:22.0:1773851868.620088:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851868.620091:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851868.620095:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12849@kfi7: PUT: OK
00000400:00000200:21.0:1773851868.620096:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000255a4f76
00000400:00000010:21.0:1773851868.620097:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000255a4f76.
00000100:00000001:21.0:1773851868.620099:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851868.620100:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851868.620102:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000582d9f3d nid 12849@kfi7 refs 2
00000800:00000200:21.0:1773851868.620105:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2054@kfi7:5 -> 12849@kfi7(00000000ac79ce72):0x0 lsk 2578 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a11 Transaction freed
00000800:00000200:10.0:1773851868.632592:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851868.632593:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851868.632595:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851868.632597:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851868.632599:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23802@kfi7 to cpt 2
00000400:00000200:10.0:1773851868.632600:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23802@kfi7 : PUT - for me
00000400:00000200:10.0:1773851868.632601:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23802@kfi7 to cpt 2
00000400:00000200:10.0:1773851868.632603:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eb63ab9 nid 23802@kfi7 refs 1
00000400:00000200:10.0:1773851868.632604:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23802@kfi7 to cpt 2
00000400:00000200:10.0:1773851868.632605:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eb63ab9 nid 23802@kfi7 refs 2
00000400:00000200:10.0:1773851868.632606:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004eb63ab9 nid 23802@kfi7 refs 3
00000400:00000200:10.0:1773851868.632607:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:10.0:1773851868.632608:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23803@kfi7 of length 440 into portal 12 MB=0x699de8d4e67c0
00000400:00000200:10.0:1773851868.632609:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23803@kfi7 of length 440/440 into md 0x78146ce49 [64] + 137616
00000800:00000200:10.0:1773851868.632611:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851868.632613:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851868.632614:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23802@kfi7: PUT: OK
00000100:00000001:10.0:1773851868.632615:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851868.632616:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851868.632617:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000024de9a79.
00000100:00000040:10.0:1773851868.632618:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000024de9a79 x1858030992779200 msgsize 440
00000100:00100000:10.0:1773851868.632619:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-23803@kfi7 (source: 12345-23802@kfi7)
00000100:00000001:10.0:1773851868.632621:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851868.632622:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004eb63ab9 nid 23802@kfi7 refs 2
00000800:00000200:10.0:1773851868.632623:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851868.632623:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851868.632624:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851868.632625:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851868.632626:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851868.632627:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851868.632629:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030992779200
00000020:00000001:9.0:1773851868.632630:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851868.632631:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911ab
00000020:00000001:9.0:1773851868.632632:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851868.632634:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e0d1207e refcount=6
00000020:00000001:9.0:1773851868.632635:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240539136 : -107152469012480 : ffff9e8b9f25d000)
00000020:00000001:9.0:1773851868.632637:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240539136 : -107152469012480 : ffff9e8b9f25d000)
00000100:00000001:9.0:1773851868.632638:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851868.632640:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851868.632642:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004258e725.
00000020:00000010:9.0:1773851868.632643:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c8fc5a75.
00000020:00000010:9.0:1773851868.632645:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f6510efa.
00000100:00000001:9.0:1773851868.632647:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851868.632648:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851868.632649:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851868.632651:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851868.632652:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851868.632654:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851868.632654:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851868.632655:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851868.632655:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851868.632656:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23803@kfi7, seq: 406391008
00000100:00000040:11.0:1773851868.632657:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e0d1207e : new rpc_count 1
00000100:00000001:11.0:1773851868.632658:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610174336 : -107030099377280 : ffff9ea81cf24380)
00000100:00000001:9.0:1773851868.632658:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851868.632659:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851868.632660:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000024de9a79 x1858030992779200/t0(0) o41->b59130e4-d5f5-48bd-bfea-ba0ff3043f6c@23803@kfi7:595/0 lens 440/0 e 0 to 0 dl 1773851955 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne261-0'
00000100:00000001:11.0:1773851868.632666:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851868.632666:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851868.632668:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024de9a79 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:b59130e4-d5f5-48bd-bfea-ba0ff3043f6c+6:111784:x1858030992779200:12345-23803@kfi7:41:default-tuolumne261-0
00000100:00000200:11.0:1773851868.632669:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030992779200
00000020:00000001:11.0:1773851868.632670:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851868.632671:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851868.632671:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851868.632672:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851868.632673:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:11.0:1773851868.632674:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851868.632674:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030992779200, found 0 last_xid 1858030992779199
00000020:00000001:11.0:1773851868.632675:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851868.632676:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851868.632677:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851868.632678:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.632678:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851868.632679:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851868.632680:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000007ca9df0c.
02000000:00000001:11.0:1773851868.632681:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.632682:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632683:0:60829:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:11.0:1773851868.632684:0:60829:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:11.0:1773851868.632684:0:60829:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632686:0:60829:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:11.0:1773851868.632688:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851868.632689:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632692:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851868.632692:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632694:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851868.632694:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632695:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851868.632695:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632696:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851868.632697:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632698:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851868.632699:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632700:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632701:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500135424 free, 351498046464 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097753 files, 343261851 free files
00000004:00000001:11.0:1773851868.632703:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632703:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632704:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504355328 free, 351502189568 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056253 files, 343265972 free files
00000004:00000001:11.0:1773851868.632705:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632706:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632706:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690163200 free, 351687736320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231278 files, 343447425 free files
00000004:00000001:11.0:1773851868.632707:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632709:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632709:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382762496 free, 351380691968 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978746 files, 343147229 free files
00000004:00000001:11.0:1773851868.632710:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632711:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632712:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958989312 free, 350956882944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371564016 files, 342733388 free files
00000004:00000001:11.0:1773851868.632713:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632714:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632715:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351236608 free, 351348385792 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084109 files, 343116442 free files
00000004:00000001:11.0:1773851868.632716:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632717:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632717:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482223616 free, 351481179136 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097220 files, 343244359 free files
00000004:00000001:11.0:1773851868.632718:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632719:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632720:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449338880 free, 351446756352 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372161028 files, 343212245 free files
00000004:00000001:11.0:1773851868.632721:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632722:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632722:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353623552 free, 351351217152 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083323 files, 343118773 free files
00000004:00000001:11.0:1773851868.632723:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632727:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632728:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351389037568 free, 351386347520 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019175 files, 343153357 free files
00000004:00000001:11.0:1773851868.632729:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632730:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632731:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406570496 free, 351404219392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127307 files, 343170479 free files
00000004:00000001:11.0:1773851868.632732:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632733:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632733:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378938880 free, 351375971328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019024 files, 343143495 free files
00000004:00000001:11.0:1773851868.632734:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632735:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632736:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466000384 free, 351462857728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062875 files, 343228516 free files
00000004:00000001:11.0:1773851868.632737:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632738:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632738:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489089536 free, 351486044160 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066870 files, 343251064 free files
00000004:00000001:11.0:1773851868.632739:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632740:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632741:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399726592 blocks, 351492762624 free, 351490353152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078092 files, 343254651 free files
00000004:00000001:11.0:1773851868.632742:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632743:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632743:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399719424 blocks, 351524100096 free, 351521339392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113947 files, 343285254 free files
00000004:00000001:11.0:1773851868.632745:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632746:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632746:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510687744 free, 351508057088 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095858 files, 343272156 free files
00000004:00000001:11.0:1773851868.632748:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632748:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632749:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541584896 free, 351539512320 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136717 files, 343302329 free files
00000004:00000001:11.0:1773851868.632750:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632751:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632752:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470736384 free, 351461654528 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064608 files, 343233141 free files
00000004:00000001:11.0:1773851868.632753:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632754:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632754:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666708480 free, 351645480960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237950 files, 343424520 free files
00000004:00000001:11.0:1773851868.632755:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632756:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632756:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545871360 free, 351536201728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116519 files, 343306515 free files
00000004:00000001:11.0:1773851868.632758:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632758:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632759:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603986432 free, 351601695744 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190508 files, 343363268 free files
00000004:00000001:11.0:1773851868.632760:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632761:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632761:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615858688 free, 351613239296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043460 files, 343374862 free files
00000004:00000001:11.0:1773851868.632763:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632764:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632764:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420288000 free, 351417816064 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372009047 files, 343183875 free files
00000004:00000001:11.0:1773851868.632765:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632766:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632766:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409140736 free, 351407087616 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011338 files, 343172989 free files
00000004:00000001:11.0:1773851868.632768:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632769:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632769:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480064000 free, 351478686720 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073181 files, 343242250 free files
00000004:00000001:11.0:1773851868.632771:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632772:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632772:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593681920 free, 351576841216 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190031 files, 343353205 free files
00000004:00000001:11.0:1773851868.632773:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632775:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851868.632775:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464092672 free, 351458266112 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372060756 files, 343226653 free files
00000004:00000001:11.0:1773851868.632776:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632777:0:60829:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632778:0:60829:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:11.0:1773851868.632779:0:60829:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 47972352 granted 1839581985855 pending 396361728 free 40309317752061952 avail 40308838095650816
00000004:00000020:11.0:1773851868.632780:0:60829:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841142029312 free, 9841024817216 avail; 10969026060 objects: 9610490263 free; state 100
00000020:00000001:11.0:1773851868.632782:0:60829:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:11.0:1773851868.632784:0:60829:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851868.632785:0:60829:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851868.632786:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768227, transno 0, xid 1858030992779200
00010000:00000001:11.0:1773851868.632787:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851868.632788:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000024de9a79 x1858030992779200/t0(0) o41->b59130e4-d5f5-48bd-bfea-ba0ff3043f6c@23803@kfi7:595/0 lens 440/368 e 0 to 0 dl 1773851955 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne261-0'
00010000:00000001:11.0:1773851868.632790:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851868.632791:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851868.632792:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=101 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851868.632793:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851868.632794:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a39a93a refcount 5 to 23803@kfi7
00000100:00000001:11.0:1773851868.632794:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424334176 : -107145285217440 : ffff9e8d4b55d360)
02000000:00000001:11.0:1773851868.632795:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851868.632796:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851868.632797:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851868.632798:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23802@kfi7
00000400:00000010:11.0:1773851868.632798:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b8ad34c8.
00000100:00000200:11.0:1773851868.632799:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030992779200, offset 224
00000400:00000200:11.0:1773851868.632801:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23802@kfi7
00000400:00000200:11.0:1773851868.632802:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23802@kfi7 to cpt 2
00000400:00000200:11.0:1773851868.632803:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eb63ab9 nid 23802@kfi7 refs 1
00000400:00000200:11.0:1773851868.632805:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004eb63ab9 nid 23802@kfi7 refs 2
00000400:00000200:11.0:1773851868.632806:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004eb63ab9 nid 23802@kfi7 refs 3
00000400:00000200:11.0:1773851868.632807:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23802@kfi7 local destination
00000400:00000200:11.0:1773851868.632809:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769281:8769281:1024:4294967295] 23802@kfi7 LPNI seq info [28035:28035:16:4294967295]
00000400:00000200:11.0:1773851868.632811:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004eb63ab9 nid 23802@kfi7 refs 2
00000400:00000200:11.0:1773851868.632812:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23802@kfi7 to cpt 2
00000400:00000200:11.0:1773851868.632814:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23802@kfi7(23802@kfi7:23802@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851868.632815:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004eb63ab9 nid 23802@kfi7 refs 3
00000800:00000200:11.0:1773851868.632817:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851868.632819:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:11.0:1773851868.632821:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851868.632824:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b4c Using peer 23802@kfi7(0x100000000000b4c)
00000800:00000200:11.0:1773851868.632827:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 468 bytes to peer 0x100000000000b4c: rc=0
00000800:00000200:11.0:1773851868.632829:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b4c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851868.632831:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851868.632832:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a39a93a refcount 4 to 23803@kfi7
00010000:00000001:11.0:1773851868.632833:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851868.632834:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851868.632835:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851868.632836:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000024de9a79 x1858030992779200/t0(0) o41->b59130e4-d5f5-48bd-bfea-ba0ff3043f6c@23803@kfi7:595/0 lens 440/368 e 0 to 0 dl 1773851955 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne261-0'
00000100:00100000:11.0:1773851868.632839:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024de9a79 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:b59130e4-d5f5-48bd-bfea-ba0ff3043f6c+6:111784:x1858030992779200:12345-23803@kfi7:41:default-tuolumne261-0 Request processed in 172us (220us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851868.632842:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23803@kfi7, seq: 406391008
00000800:00000200:10.0:1773851868.632842:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b4c TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851868.632843:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e0d1207e : new rpc_count 0
00000400:00000200:10.0:1773851868.632843:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851868.632844:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851868.632844:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23802@kfi7: PUT: OK
00000100:00000001:11.0:1773851868.632845:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851868.632845:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b8ad34c8
00000400:00000010:10.0:1773851868.632845:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b8ad34c8.
00000020:00000010:11.0:1773851868.632846:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c8fc5a75.
00000100:00000001:10.0:1773851868.632846:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851868.632847:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f6510efa.
00000100:00000001:10.0:1773851868.632847:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851868.632848:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004258e725.
00000400:00000200:10.0:1773851868.632848:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004eb63ab9 nid 23802@kfi7 refs 2
00000020:00000040:11.0:1773851868.632849:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e0d1207e : new refcount 5
00000800:00000200:10.0:1773851868.632849:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 23802@kfi7(000000002d2ac944):0x0 lsk 2893 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000b4c Transaction freed
00000100:00000001:11.0:1773851868.632850:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851868.655339:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.655339:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851868.655340:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:17.0:1773851868.655341:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851868.655342:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851868.655343:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851868.655344:0:2507147:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13553@kfi7(00000000243bf4e2):0xaec version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851868.655346:0:2507147:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec Using peer 13553@kfi7(0xaec)
00000800:00000200:17.0:1773851868.655346:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851868.655348:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13553@kfi7 to cpt 4
00000800:00000200:18.0:1773851868.655349:0:2507147:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000022b02854: Posted send of 38 bytes to peer 0xaec: rc=0
00000400:00000200:17.0:1773851868.655349:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13553@kfi7 to cpt 4
00000800:00000200:18.0:1773851868.655351:0:2507147:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:17.0:1773851868.655351:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13553@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.655353:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13553@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.655354:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028e8362e nid 13553@kfi7 refs 1
00000400:00000200:17.0:1773851868.655356:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13553@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.655358:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028e8362e nid 13553@kfi7 refs 2
00000400:00000200:17.0:1773851868.655359:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000028e8362e nid 13553@kfi7 refs 3
00000400:00000200:17.0:1773851868.655361:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13361@kfi7 to cpt 1
00000400:00000200:17.0:1773851868.655362:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13361@kfi7 of length 224 into portal 12 MB=0x699e0d121b600
00000800:00000200:18.0:1773851868.655363:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec TN_EVENT_TX_OK event status 0
00000800:00000200:18.0:1773851868.655365:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec Transaction freed
00000400:00000200:17.0:1773851868.655365:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13361@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 12792
00000800:00000200:17.0:1773851868.655368:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.655370:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.655372:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13553@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.655374:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.655374:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.655376:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000ba86cd7.
00000100:00000040:17.0:1773851868.655377:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000000ba86cd7 x1858040720635392 msgsize 224
00000100:00100000:17.0:1773851868.655380:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13361@kfi7 (source: 12345-13553@kfi7)
00000100:00000001:17.0:1773851868.655382:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.655384:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000028e8362e nid 13553@kfi7 refs 2
00000800:00000200:17.0:1773851868.655386:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851868.655391:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851868.655391:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851868.655392:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851868.655393:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851868.655395:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851868.655396:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040720635392
00000020:00000001:17.0:1773851868.655397:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851868.655397:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a86
00000020:00000001:17.0:1773851868.655398:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851868.655404:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000781807a2 refcount=6
00000020:00000001:17.0:1773851868.655405:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743447552 : -107128966104064 : ffff9e911807bc00)
00000020:00000001:17.0:1773851868.655406:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743447552 : -107128966104064 : ffff9e911807bc00)
00000100:00000001:17.0:1773851868.655408:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851868.655409:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851868.655410:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001bc015a1.
00000020:00000010:17.0:1773851868.655412:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851868.655413:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b5739007.
00000100:00000001:17.0:1773851868.655415:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851868.655416:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851868.655417:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.655418:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851868.655419:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851868.655420:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.655421:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.655423:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.655423:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.655423:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851868.655424:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851868.655424:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13361@kfi7, seq: 2156334
00000100:00000001:17.0:1773851868.655425:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.655425:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000781807a2 : new rpc_count 1
00000100:00000001:17.0:1773851868.655426:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.655426:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156639496704 : -106917070054912 : ffff9ec26e04da00)
00000100:00000040:16.0:1773851868.655428:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000ba86cd7 x1858040720635392/t0(0) o400->11722235-99ae-4595-8642-94479e4b69a4@13361@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1325-0'
00000100:00000001:16.0:1773851868.655431:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.655431:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851868.655432:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ba86cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:11722235-99ae-4595-8642-94479e4b69a4+6:39635:x1858040720635392:12345-13361@kfi7:400:default-tuolumne1325-0
00000100:00000200:16.0:1773851868.655433:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040720635392
00000020:00000001:16.0:1773851868.655434:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851868.655435:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851868.655436:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.655437:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851868.655437:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851868.655438:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851868.655439:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040720635392, found 0 last_xid 1858040720635391
00000020:00000001:16.0:1773851868.655440:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851868.655440:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851868.655441:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851868.655442:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.655442:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851868.655443:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851868.655443:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851868.655444:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d3b15942.
02000000:00000001:16.0:1773851868.655445:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.655445:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.655446:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851868.655447:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183127989370, transno 0, xid 1858040720635392
00010000:00000001:16.0:1773851868.655448:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851868.655449:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000ba86cd7 x1858040720635392/t0(0) o400->11722235-99ae-4595-8642-94479e4b69a4@13361@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1325-0'
00010000:00000001:16.0:1773851868.655451:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851868.655452:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851868.655452:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851868.655453:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851868.655454:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d0a1b7dc refcount 3 to 13361@kfi7
00000100:00000001:16.0:1773851868.655455:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702592 : -107156155849024 : ffff9e8ac36526c0)
02000000:00000001:16.0:1773851868.655456:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851868.655457:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.655457:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851868.655458:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13553@kfi7
00000400:00000010:16.0:1773851868.655459:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000053015df3.
00000100:00000200:16.0:1773851868.655459:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040720635392, offset 224
00000400:00000200:16.0:1773851868.655461:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13553@kfi7
00000400:00000200:16.0:1773851868.655462:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13553@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.655463:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028e8362e nid 13553@kfi7 refs 1
00000400:00000200:16.0:1773851868.655464:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000028e8362e nid 13553@kfi7 refs 2
00000400:00000200:16.0:1773851868.655465:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000028e8362e nid 13553@kfi7 refs 3
00000400:00000200:16.0:1773851868.655467:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13553@kfi7 local destination
00000400:00000200:16.0:1773851868.655468:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769282:8769282:1024:4294967295] 13553@kfi7 LPNI seq info [964268:964268:16:4294967295]
00000400:00000200:16.0:1773851868.655469:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000028e8362e nid 13553@kfi7 refs 2
00000400:00000200:16.0:1773851868.655470:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13553@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.655472:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13553@kfi7(13553@kfi7:13553@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851868.655473:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000028e8362e nid 13553@kfi7 refs 3
00000800:00000200:16.0:1773851868.655475:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851868.655476:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851868.655478:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851868.655480:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec Using peer 13553@kfi7(0xaec)
00000800:00000200:16.0:1773851868.655484:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009aebe925: Posted send of 324 bytes to peer 0xaec: rc=0
00000800:00000200:16.0:1773851868.655485:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851868.655487:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.655488:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d0a1b7dc refcount 2 to 13361@kfi7
00010000:00000001:16.0:1773851868.655489:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851868.655490:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.655490:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851868.655491:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000ba86cd7 x1858040720635392/t0(0) o400->11722235-99ae-4595-8642-94479e4b69a4@13361@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1325-0'
00000100:00100000:16.0:1773851868.655495:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ba86cd7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:11722235-99ae-4595-8642-94479e4b69a4+6:39635:x1858040720635392:12345-13361@kfi7:400:default-tuolumne1325-0 Request processed in 64us (118us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851868.655498:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13361@kfi7, seq: 2156334
00000100:00000040:16.0:1773851868.655499:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000781807a2 : new rpc_count 0
00000100:00000001:16.0:1773851868.655502:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851868.655503:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851868.655503:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:16.0:1773851868.655504:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b5739007.
00000020:00000010:16.0:1773851868.655505:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001bc015a1.
00000020:00000040:16.0:1773851868.655506:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000781807a2 : new refcount 5
00000100:00000001:16.0:1773851868.655507:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851868.655512:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851868.655513:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851868.655514:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13553@kfi7: PUT: OK
00000400:00000200:18.0:1773851868.655515:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000053015df3
00000400:00000010:18.0:1773851868.655515:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000053015df3.
00000100:00000001:18.0:1773851868.655516:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851868.655516:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851868.655517:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000028e8362e nid 13553@kfi7 refs 2
00000800:00000200:18.0:1773851868.655518:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13553@kfi7(00000000243bf4e2):0x0 lsk 2797 rsk 55 tsk 0 trmk 0 tmk 0 trr 4 tta 0xaec Transaction freed
00000800:00000200:29.0:1773851868.721905:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851868.721905:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851868.721906:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851868.721908:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851868.721910:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25872@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.721911:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25872@kfi7 : PUT - for me
00000400:00000200:29.0:1773851868.721912:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25872@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.721912:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000070e20aa nid 25872@kfi7 refs 1
00000400:00000200:29.0:1773851868.721914:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25872@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.721915:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000070e20aa nid 25872@kfi7 refs 2
00000400:00000200:29.0:1773851868.721916:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000070e20aa nid 25872@kfi7 refs 3
00000400:00000200:29.0:1773851868.721917:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25872@kfi7 to cpt 7
00000400:00000200:29.0:1773851868.721918:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25872@kfi7 of length 224 into portal 12 MB=0x699e107773b40
00000400:00000200:29.0:1773851868.721919:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25872@kfi7 of length 224/224 into md 0x77fe139dd [64] + 176648
00000800:00000200:29.0:1773851868.721921:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851868.721922:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851868.721923:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25872@kfi7: PUT: OK
00000100:00000001:29.0:1773851868.721924:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851868.721925:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851868.721926:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a078b22.
00000100:00000040:29.0:1773851868.721926:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000001a078b22 x1858041632209728 msgsize 224
00000100:00100000:29.0:1773851868.721928:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25872@kfi7 (source: 12345-25872@kfi7)
00000100:00000001:29.0:1773851868.721929:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851868.721930:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000070e20aa nid 25872@kfi7 refs 2
00000100:00000001:31.0:1773851868.721931:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851868.721931:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851868.721931:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851868.721932:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851868.721932:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851868.721933:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851868.721934:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041632209728
00000020:00000001:31.0:1773851868.721934:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851868.721935:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917af
00000020:00000001:31.0:1773851868.721935:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851868.721940:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bcdecf64 refcount=6
00000020:00000001:31.0:1773851868.721941:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241735168 : -107152467816448 : ffff9e8b9f381000)
00000020:00000001:31.0:1773851868.721942:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241735168 : -107152467816448 : ffff9e8b9f381000)
00000100:00000001:31.0:1773851868.721943:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851868.721947:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851868.721949:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009fd8e64.
00000020:00000010:31.0:1773851868.721950:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851868.721951:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bcd0c99c.
00000100:00000001:31.0:1773851868.721952:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851868.721952:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851868.721953:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.721954:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851868.721954:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851868.721955:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.721956:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.721957:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851868.721957:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851868.721958:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851868.721958:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851868.721959:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25872@kfi7, seq: 2055525
00000100:00000040:31.0:1773851868.721959:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bcdecf64 : new rpc_count 1
00000100:00000001:28.0:1773851868.721959:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.721960:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309696384 : -106988399855232 : ffff9eb1d26e7980)
00000100:00000001:28.0:1773851868.721960:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851868.721961:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a078b22 x1858041632209728/t0(0) o400->8193d9ee-0a9b-4a47-8469-72557e5b8f41@25872@kfi7:656/0 lens 224/0 e 0 to 0 dl 1773852016 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2113-0'
00000100:00000001:31.0:1773851868.721964:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851868.721964:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851868.721965:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a078b22 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:8193d9ee-0a9b-4a47-8469-72557e5b8f41+6:39694:x1858041632209728:12345-25872@kfi7:400:default-tuolumne2113-0
00000100:00000200:31.0:1773851868.721967:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041632209728
00000020:00000001:31.0:1773851868.721968:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851868.721968:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851868.721969:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.721970:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851868.721970:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851868.721971:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851868.721971:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041632209728, found 0 last_xid 1858041632209727
00000020:00000001:31.0:1773851868.721972:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851868.721973:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851868.721973:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851868.721974:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.721975:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851868.721976:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851868.721976:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851868.721977:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000044b93b22.
02000000:00000001:31.0:1773851868.721978:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.721978:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.721979:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851868.721980:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255728282, transno 0, xid 1858041632209728
00010000:00000001:31.0:1773851868.721980:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851868.721981:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a078b22 x1858041632209728/t0(0) o400->8193d9ee-0a9b-4a47-8469-72557e5b8f41@25872@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2113-0'
00010000:00000001:31.0:1773851868.721984:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851868.721984:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851868.721985:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=101 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851868.721986:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851868.721987:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b951b8c9 refcount 3 to 25872@kfi7
00000100:00000001:31.0:1773851868.721987:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091268608 : -107152618283008 : ffff9e8b96402000)
02000000:00000001:31.0:1773851868.721988:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851868.721989:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.721990:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851868.721990:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25872@kfi7
00000400:00000010:31.0:1773851868.721991:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000535cda91.
00000100:00000200:31.0:1773851868.721992:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041632209728, offset 224
00000400:00000200:31.0:1773851868.721993:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25872@kfi7
00000400:00000200:31.0:1773851868.721994:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25872@kfi7 to cpt 7
00000400:00000200:31.0:1773851868.721995:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000070e20aa nid 25872@kfi7 refs 1
00000400:00000200:31.0:1773851868.721996:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000070e20aa nid 25872@kfi7 refs 2
00000400:00000200:31.0:1773851868.721997:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000070e20aa nid 25872@kfi7 refs 3
00000400:00000200:31.0:1773851868.721998:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25872@kfi7 local destination
00000400:00000200:31.0:1773851868.721999:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769283:8769283:1024:4294967295] 25872@kfi7 LPNI seq info [6163688:6163688:16:4294967295]
00000400:00000200:31.0:1773851868.722000:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000070e20aa nid 25872@kfi7 refs 2
00000400:00000200:31.0:1773851868.722001:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25872@kfi7 to cpt 7
00000400:00000200:31.0:1773851868.722003:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25872@kfi7(25872@kfi7:25872@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851868.722004:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000070e20aa nid 25872@kfi7 refs 3
00000800:00000200:31.0:1773851868.722006:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851868.722007:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851868.722009:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851868.722011:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000917 Using peer 25872@kfi7(0x100000000000917)
00000800:00000200:31.0:1773851868.722014:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x100000000000917: rc=0
00000800:00000200:31.0:1773851868.722016:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000917 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851868.722018:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851868.722019:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b951b8c9 refcount 2 to 25872@kfi7
00010000:00000001:31.0:1773851868.722019:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851868.722020:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.722021:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851868.722021:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a078b22 x1858041632209728/t0(0) o400->8193d9ee-0a9b-4a47-8469-72557e5b8f41@25872@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2113-0'
00000100:00100000:31.0:1773851868.722024:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a078b22 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:8193d9ee-0a9b-4a47-8469-72557e5b8f41+6:39694:x1858041632209728:12345-25872@kfi7:400:default-tuolumne2113-0 Request processed in 60us (97us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851868.722027:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25872@kfi7, seq: 2055525
00000100:00000040:31.0:1773851868.722027:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bcdecf64 : new rpc_count 0
00000100:00000001:31.0:1773851868.722029:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851868.722029:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851868.722029:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000917 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851868.722030:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851868.722030:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bcd0c99c.
00000020:00000010:31.0:1773851868.722031:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009fd8e64.
00000400:00000200:29.0:1773851868.722031:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851868.722032:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000bcdecf64 : new refcount 5
00000400:00000200:29.0:1773851868.722032:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25872@kfi7: PUT: OK
00000100:00000001:31.0:1773851868.722033:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851868.722033:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000535cda91
00000400:00000010:29.0:1773851868.722033:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000535cda91.
00000100:00000001:29.0:1773851868.722034:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851868.722034:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851868.722035:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000070e20aa nid 25872@kfi7 refs 2
00000800:00000200:29.0:1773851868.722037:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 25872@kfi7(00000000d13c5736):0x0 lsk 2328 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000917 Transaction freed
00000800:00000200:17.0:1773851868.766252:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.766253:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.766255:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.766257:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.766259:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.766261:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.2@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851868.766262:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.766263:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851868.766264:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:17.0:1773851868.766265:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:17.0:1773851868.766266:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000400:00000200:17.0:1773851868.766268:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:17.0:1773851868.766269:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.2@o2ib60 of length 224 into portal 12 MB=0x69a0f946a1540
00000400:00000200:17.0:1773851868.766270:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.2@o2ib60 of length 224/224 into md 0x82a36e8ed [64] + 30472
00000800:00000200:17.0:1773851868.766272:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.766274:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.766275:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.766276:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.766276:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.766277:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006f1f6da3.
00000100:00000040:17.0:1773851868.766278:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000006f1f6da3 x1858241565431104 msgsize 224
00000100:00100000:17.0:1773851868.766279:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.2@o2ib60 (source: 12345-192.168.128.2@o2ib60)
00000100:00000001:17.0:1773851868.766281:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.766282:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851868.766284:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851868.766284:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851868.766285:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851868.766285:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851868.766286:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851868.766287:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851868.766288:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858241565431104
00000020:00000001:12.0:1773851868.766288:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851868.766289:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9303d
00000020:00000001:12.0:1773851868.766289:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851868.766293:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000394656e8 refcount=167
00000020:00000001:12.0:1773851868.766294:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000020:00000001:12.0:1773851868.766295:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000100:00000001:12.0:1773851868.766296:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851868.766297:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851868.766298:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000290d0842.
00000020:00000010:12.0:1773851868.766299:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851868.766299:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000001:12.0:1773851868.766301:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851868.766302:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851868.766302:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851868.766304:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851868.766304:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851868.766305:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.766306:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851868.766307:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851868.766307:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851868.766308:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851868.766308:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851868.766309:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.2@o2ib60, seq: 2289842
00000100:00000001:15.0:1773851868.766310:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851868.766310:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000394656e8 : new rpc_count 1
00000100:00000001:15.0:1773851868.766311:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.766311:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156639504768 : -106917070046848 : ffff9ec26e04f980)
00000100:00000040:12.0:1773851868.766312:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006f1f6da3 x1858241565431104/t0(0) o400->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-matrix2-0'
00000100:00000001:12.0:1773851868.766315:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851868.766316:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851868.766317:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f1f6da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3f210437-b2af-4977-93b4-45f1c345c3ce+167:59083:x1858241565431104:12345-192.168.128.2@o2ib60:400:login-matrix2-0
00000100:00000200:12.0:1773851868.766319:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858241565431104
00000020:00000001:12.0:1773851868.766319:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851868.766320:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851868.766321:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.766321:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851868.766322:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851868.766323:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851868.766324:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858241565431104, found 0 last_xid 1858241564428287
00000020:00000001:12.0:1773851868.766325:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851868.766325:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851868.766326:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851868.766326:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.766327:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851868.766328:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851868.766328:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851868.766329:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a6e3c8d0.
02000000:00000001:12.0:1773851868.766330:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.766331:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.766332:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851868.766332:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183116358565, transno 0, xid 1858241565431104
00010000:00000001:12.0:1773851868.766333:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851868.766334:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006f1f6da3 x1858241565431104/t0(0) o400->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-matrix2-0'
00010000:00000001:12.0:1773851868.766337:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851868.766337:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851868.766338:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=101 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851868.766339:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851868.766340:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000593bde95 refcount 3 to 192.168.128.2@o2ib60
00000100:00000001:12.0:1773851868.766341:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642471488 : -107157067080128 : ffff9e8a8d14de40)
02000000:00000001:12.0:1773851868.766341:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851868.766342:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851868.766342:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851868.766344:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.2@o2ib60
00000400:00000010:12.0:1773851868.766344:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f25aa5d2.
00000100:00000200:12.0:1773851868.766345:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858241565431104, offset 224
00000400:00000200:12.0:1773851868.766347:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.2@o2ib60
00000400:00000200:12.0:1773851868.766349:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:12.0:1773851868.766350:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:12.0:1773851868.766352:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000400:00000200:12.0:1773851868.766353:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 4
00000400:00000200:12.0:1773851868.766355:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.2@o2ib60 routed destination
00000400:00000200:12.0:1773851868.766357:0:60487:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:12.0:1773851868.766359:0:60487:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:12.0:1773851868.766361:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000400:00000200:12.0:1773851868.766363:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:12.0:1773851868.766364:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000400:00000200:12.0:1773851868.766365:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:12.0:1773851868.766366:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769284:8769284:1024:4294967295] 17@kfi7 LPNI seq info [1250891892:1250891892:16:4294967295]
00000400:00000200:12.0:1773851868.766368:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:12.0:1773851868.766369:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:12.0:1773851868.766371:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.2@o2ib60(192.168.128.2@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851868.766373:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000800:00000200:12.0:1773851868.766375:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851868.766376:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851868.766379:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851868.766381:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:12.0:1773851868.766385:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:12.0:1773851868.766386:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851868.766388:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851868.766389:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000593bde95 refcount 2 to 192.168.128.2@o2ib60
00010000:00000001:12.0:1773851868.766390:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851868.766390:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851868.766391:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851868.766392:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006f1f6da3 x1858241565431104/t0(0) o400->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-matrix2-0'
00000100:00100000:12.0:1773851868.766398:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f1f6da3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3f210437-b2af-4977-93b4-45f1c345c3ce+167:59083:x1858241565431104:12345-192.168.128.2@o2ib60:400:login-matrix2-0 Request processed in 81us (118us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851868.766400:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.2@o2ib60, seq: 2289842
00000100:00000040:12.0:1773851868.766401:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000394656e8 : new rpc_count 0
00000100:00000001:12.0:1773851868.766401:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851868.766402:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851868.766403:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851868.766404:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:12.0:1773851868.766405:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000290d0842.
00000020:00000040:12.0:1773851868.766406:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 166
00000100:00000001:12.0:1773851868.766407:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851868.766413:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851868.766415:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851868.766417:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:13.0:1773851868.766418:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f25aa5d2
00000400:00000010:13.0:1773851868.766418:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f25aa5d2.
00000100:00000001:13.0:1773851868.766419:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851868.766420:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851868.766421:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:13.0:1773851868.766422:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000800:00000200:10.0:1773851868.800144:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851868.800145:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851868.800146:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851868.800148:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851868.800150:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851868.800151:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.11@o2ib60 : PUT - for me
00000400:00000200:10.0:1773851868.800152:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851868.800153:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:10.0:1773851868.800155:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.11@o2ib60 to cpt 4
00000400:00000200:10.0:1773851868.800156:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dea8832e nid 192.168.128.11@o2ib60 refs 2
00000400:00000200:10.0:1773851868.800157:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dea8832e nid 192.168.128.11@o2ib60 refs 3
00000400:00000200:10.0:1773851868.800158:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.11@o2ib60 to cpt 4
00000400:00000200:10.0:1773851868.800160:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.11@o2ib60 of length 224 into portal 12 MB=0x69b2329895e00
00000400:00000200:10.0:1773851868.800162:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.11@o2ib60 of length 224/224 into md 0x6ab01b5d1 [64] + 13016
00000800:00000200:10.0:1773851868.800164:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851868.800166:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851868.800167:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:10.0:1773851868.800168:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851868.800169:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851868.800170:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c778dfc2.
00000100:00000040:10.0:1773851868.800170:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000c778dfc2 x1859425183292928 msgsize 224
00000100:00100000:10.0:1773851868.800172:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.11@o2ib60 (source: 12345-192.168.128.11@o2ib60)
00000100:00000001:10.0:1773851868.800174:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851868.800175:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:10.0:1773851868.800176:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851868.800177:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851868.800178:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851868.800178:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851868.800179:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851868.800180:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851868.800180:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859425183292928
00000020:00000001:16.0:1773851868.800181:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851868.800182:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ae4c
00000020:00000001:16.0:1773851868.800182:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851868.800185:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a462c540 refcount=43954
00000020:00000001:16.0:1773851868.800186:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096416705536 : -106977292846080 : ffff9eb46875fc00)
00000020:00000001:16.0:1773851868.800186:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637096416705536 : -106977292846080 : ffff9eb46875fc00)
00000100:00000001:16.0:1773851868.800188:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.800188:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851868.800189:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddc278b8.
00000020:00000010:16.0:1773851868.800190:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851868.800191:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b2bbb793.
00000100:00000001:16.0:1773851868.800192:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851868.800193:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851868.800193:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.800194:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851868.800194:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851868.800195:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.800196:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.800197:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.800198:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851868.800199:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:16.0:1773851868.800199:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.11@o2ib60, seq: 2156335
00000100:00000001:17.0:1773851868.800200:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:16.0:1773851868.800200:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a462c540 : new rpc_count 2
00000100:00000001:17.0:1773851868.800201:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.800201:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610180096 : -107030099371520 : ffff9ea81cf25a00)
00000100:00000001:17.0:1773851868.800202:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.800202:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c778dfc2 x1859425183292928/t0(0) o400->d68c5fbe-4986-4f1e-bcf1-75da1ece0b18@192.168.128.11@o2ib60:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix11-0'
00000100:00000001:16.0:1773851868.800205:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.800205:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851868.800206:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c778dfc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d68c5fbe-4986-4f1e-bcf1-75da1ece0b18+43954:40129:x1859425183292928:12345-192.168.128.11@o2ib60:400:default-matrix11-0
00000100:00000200:16.0:1773851868.800208:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859425183292928
00000020:00000001:16.0:1773851868.800208:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851868.800209:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851868.800210:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.800211:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851868.800211:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851868.800212:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851868.800212:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859425183292928, found 0 last_xid 1859425179346431
00000020:00000001:16.0:1773851868.800213:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851868.800214:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851868.800214:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851868.800215:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.800215:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851868.800216:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851868.800216:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851868.800217:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009c29665f.
02000000:00000001:16.0:1773851868.800218:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.800218:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.800219:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851868.800220:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264550519, transno 0, xid 1859425183292928
00010000:00000001:16.0:1773851868.800220:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851868.800221:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c778dfc2 x1859425183292928/t0(0) o400->d68c5fbe-4986-4f1e-bcf1-75da1ece0b18@192.168.128.11@o2ib60:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix11-0'
00010000:00000001:16.0:1773851868.800224:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851868.800224:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851868.800225:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851868.800227:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851868.800228:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aca7ae31 refcount 3 to 192.168.128.11@o2ib60
00000100:00000001:16.0:1773851868.800228:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518912 : -107156126032704 : ffff9e8ac52c1cc0)
02000000:00000001:16.0:1773851868.800229:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851868.800230:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.800230:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851868.800231:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.11@o2ib60
00000400:00000010:16.0:1773851868.800232:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d67f7133.
00000100:00000200:16.0:1773851868.800233:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859425183292928, offset 224
00000400:00000200:16.0:1773851868.800234:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.11@o2ib60
00000400:00000200:16.0:1773851868.800235:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.11@o2ib60 to cpt 4
00000400:00000200:16.0:1773851868.800236:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dea8832e nid 192.168.128.11@o2ib60 refs 2
00000400:00000200:16.0:1773851868.800237:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dea8832e nid 192.168.128.11@o2ib60 refs 3
00000400:00000200:16.0:1773851868.800239:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dea8832e nid 192.168.128.11@o2ib60 refs 4
00000400:00000200:16.0:1773851868.800240:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.11@o2ib60 routed destination
00000400:00000200:16.0:1773851868.800241:0:61039:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:16.0:1773851868.800242:0:61039:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:16.0:1773851868.800244:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.11@o2ib60: rtr pref emtpy: 1
00000400:00000200:16.0:1773851868.800245:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:16.0:1773851868.800246:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.11@o2ib60: rtr pref emtpy: 1
00000400:00000200:16.0:1773851868.800247:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:16.0:1773851868.800248:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769285:8769285:1024:4294967295] 2094@kfi7 LPNI seq info [1258746991:1258746991:16:4294967295]
00000400:00000200:16.0:1773851868.800249:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:16.0:1773851868.800250:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.800252:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.11@o2ib60(192.168.128.11@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851868.800254:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dea8832e nid 192.168.128.11@o2ib60 refs 3
00000800:00000200:16.0:1773851868.800256:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851868.800257:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851868.800259:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851868.800262:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:16.0:1773851868.800265:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:16.0:1773851868.800266:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851868.800268:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.800269:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aca7ae31 refcount 2 to 192.168.128.11@o2ib60
00010000:00000001:16.0:1773851868.800270:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851868.800270:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.800271:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851868.800273:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c778dfc2 x1859425183292928/t0(0) o400->d68c5fbe-4986-4f1e-bcf1-75da1ece0b18@192.168.128.11@o2ib60:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix11-0'
00000100:00100000:16.0:1773851868.800276:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c778dfc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d68c5fbe-4986-4f1e-bcf1-75da1ece0b18+43954:40129:x1859425183292928:12345-192.168.128.11@o2ib60:400:default-matrix11-0 Request processed in 70us (105us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851868.800278:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.11@o2ib60, seq: 2156335
00000100:00000040:16.0:1773851868.800279:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a462c540 : new rpc_count 1
00000100:00000001:16.0:1773851868.800280:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851868.800280:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851868.800281:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851868.800282:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b2bbb793.
00000020:00000010:16.0:1773851868.800283:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddc278b8.
00000020:00000040:16.0:1773851868.800283:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000a462c540 : new refcount 43953
00000100:00000001:16.0:1773851868.800284:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0F:1773851868.800293:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851868.800296:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851868.800297:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:19.0:1773851868.800298:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d67f7133
00000400:00000010:19.0:1773851868.800298:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d67f7133.
00000100:00000001:19.0:1773851868.800299:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851868.800300:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851868.800300:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:19.0:1773851868.800302:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000800:00000200:5.0:1773851868.883539:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851868.883540:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851868.883541:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851868.883543:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851868.883544:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10544@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.883546:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10544@kfi7 : PUT - for me
00000400:00000200:5.0:1773851868.883546:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10544@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.883547:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d61f7d7 nid 10544@kfi7 refs 1
00000400:00000200:5.0:1773851868.883548:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10544@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.883549:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d61f7d7 nid 10544@kfi7 refs 2
00000400:00000200:5.0:1773851868.883550:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009d61f7d7 nid 10544@kfi7 refs 3
00000400:00000200:5.0:1773851868.883551:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10737@kfi7 to cpt 7
00000400:00000200:5.0:1773851868.883551:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10737@kfi7 of length 224 into portal 12 MB=0x69b4b559ea080
00000400:00000200:5.0:1773851868.883553:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10737@kfi7 of length 224/224 into md 0x793926dc5 [64] + 136344
00000800:00000200:5.0:1773851868.883555:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851868.883556:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851868.883557:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10544@kfi7: PUT: OK
00000100:00000001:5.0:1773851868.883558:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851868.883559:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851868.883560:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009ad810ba.
00000100:00000040:5.0:1773851868.883561:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000009ad810ba x1859597721575552 msgsize 224
00000100:00100000:5.0:1773851868.883562:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10737@kfi7 (source: 12345-10544@kfi7)
00000100:00000001:5.0:1773851868.883563:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851868.883564:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851868.883564:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009d61f7d7 nid 10544@kfi7 refs 2
02000000:00000001:7.0:1773851868.883565:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851868.883565:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851868.883565:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851868.883566:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851868.883567:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851868.883567:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597721575552
00000020:00000001:7.0:1773851868.883568:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851868.883568:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d77790
00000020:00000001:7.0:1773851868.883569:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851868.883570:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000195c423c refcount=5
00000020:00000001:7.0:1773851868.883571:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105494677504 : -106968214874112 : ffff9eb6858cd800)
00000020:00000001:7.0:1773851868.883572:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105494677504 : -106968214874112 : ffff9eb6858cd800)
00000100:00000001:7.0:1773851868.883573:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851868.883573:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851868.883574:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b984b53b.
00000020:00000010:7.0:1773851868.883575:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851868.883576:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008745c425.
00000100:00000001:7.0:1773851868.883577:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851868.883577:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851868.883577:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851868.883578:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851868.883579:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851868.883579:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851868.883580:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851868.883582:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851868.883582:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851868.883582:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851868.883582:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851868.883583:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10737@kfi7, seq: 2001921
00000100:00000001:7.0:1773851868.883584:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851868.883584:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851868.883584:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000195c423c : new rpc_count 1
00000100:00000001:5.0:1773851868.883585:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886771584 : -106955822780032 : ffff9eb9682d3180)
00000100:00000040:5.0:1773851868.883586:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009ad810ba x1859597721575552/t0(0) o400->02784ba3-25e3-414e-ad00-796c6e83817b@10737@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1149-0'
00000100:00000001:5.0:1773851868.883588:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851868.883589:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851868.883589:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ad810ba pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:02784ba3-25e3-414e-ad00-796c6e83817b+5:39536:x1859597721575552:12345-10737@kfi7:400:default-tuolumne1149-0
00000100:00000200:5.0:1773851868.883591:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597721575552
00000020:00000001:5.0:1773851868.883591:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851868.883592:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851868.883593:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.883594:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851868.883594:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851868.883595:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851868.883595:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597721575552, found 0 last_xid 1859597721575551
00000020:00000001:5.0:1773851868.883596:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851868.883597:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851868.883597:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851868.883598:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.883598:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851868.883599:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851868.883600:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851868.883601:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e0af6c38.
02000000:00000001:5.0:1773851868.883602:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851868.883602:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.883603:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851868.883604:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690253, transno 0, xid 1859597721575552
00010000:00000001:5.0:1773851868.883604:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851868.883605:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009ad810ba x1859597721575552/t0(0) o400->02784ba3-25e3-414e-ad00-796c6e83817b@10737@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1149-0'
00010000:00000001:5.0:1773851868.883607:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851868.883608:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851868.883609:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=100 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851868.883610:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851868.883610:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005239b215 refcount 3 to 10737@kfi7
00000100:00000001:5.0:1773851868.883611:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806272 : -107130477745344 : ffff9e90bdedeb40)
02000000:00000001:5.0:1773851868.883612:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851868.883612:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851868.883613:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851868.883614:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10544@kfi7
00000400:00000010:5.0:1773851868.883615:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000011aff20.
00000100:00000200:5.0:1773851868.883615:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597721575552, offset 224
00000400:00000200:5.0:1773851868.883617:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10544@kfi7
00000400:00000200:5.0:1773851868.883617:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10544@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.883618:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d61f7d7 nid 10544@kfi7 refs 1
00000400:00000200:5.0:1773851868.883619:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009d61f7d7 nid 10544@kfi7 refs 2
00000400:00000200:5.0:1773851868.883620:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009d61f7d7 nid 10544@kfi7 refs 3
00000400:00000200:5.0:1773851868.883621:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10544@kfi7 local destination
00000400:00000200:5.0:1773851868.883623:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769286:8769286:1024:4294967295] 10544@kfi7 LPNI seq info [4114672:4114672:16:4294967295]
00000400:00000200:5.0:1773851868.883624:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009d61f7d7 nid 10544@kfi7 refs 2
00000400:00000200:5.0:1773851868.883625:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10544@kfi7 to cpt 1
00000400:00000200:5.0:1773851868.883627:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10544@kfi7(10544@kfi7:10544@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851868.883628:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009d61f7d7 nid 10544@kfi7 refs 3
00000800:00000200:5.0:1773851868.883629:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851868.883630:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851868.883632:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851868.883634:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0xaef Using peer 10544@kfi7(0xaef)
00000800:00000200:5.0:1773851868.883637:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0xaef: rc=0
00000800:00000200:5.0:1773851868.883638:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0xaef TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851868.883640:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851868.883641:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005239b215 refcount 2 to 10737@kfi7
00010000:00000001:5.0:1773851868.883642:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851868.883643:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.883643:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851868.883644:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009ad810ba x1859597721575552/t0(0) o400->02784ba3-25e3-414e-ad00-796c6e83817b@10737@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1149-0'
00000100:00100000:5.0:1773851868.883647:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ad810ba pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:02784ba3-25e3-414e-ad00-796c6e83817b+5:39536:x1859597721575552:12345-10737@kfi7:400:default-tuolumne1149-0 Request processed in 58us (85us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851868.883649:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10737@kfi7, seq: 2001921
00000100:00000040:5.0:1773851868.883650:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000195c423c : new rpc_count 0
00000100:00000001:5.0:1773851868.883650:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:6.0F:1773851868.883651:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0xaef TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851868.883651:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851868.883651:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:5.0:1773851868.883652:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008745c425.
00000400:00000200:6.0:1773851868.883653:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851868.883653:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b984b53b.
00000020:00000040:5.0:1773851868.883654:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000195c423c : new refcount 4
00000100:00000001:5.0:1773851868.883654:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851868.883655:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10544@kfi7: PUT: OK
00000400:00000200:6.0:1773851868.883655:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000011aff20
00000400:00000010:6.0:1773851868.883656:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000011aff20.
00000100:00000001:6.0:1773851868.883657:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851868.883657:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851868.883658:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009d61f7d7 nid 10544@kfi7 refs 2
00000800:00000200:6.0:1773851868.883659:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 10544@kfi7(00000000e591e384):0x0 lsk 2800 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0xaef Transaction freed
00000800:00000200:9.0:1773851868.893557:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851868.893558:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851868.893560:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851868.893562:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851868.893564:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.893566:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.32@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851868.893567:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851868.893567:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851868.893569:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.32@o2ib60 to cpt 1
00000400:00000200:9.0:1773851868.893570:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005dcc1213 nid 192.168.128.32@o2ib60 refs 2
00000400:00000200:9.0:1773851868.893571:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005dcc1213 nid 192.168.128.32@o2ib60 refs 3
00000400:00000200:9.0:1773851868.893572:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.32@o2ib60 to cpt 1
00000400:00000200:9.0:1773851868.893573:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.32@o2ib60 of length 224 into portal 12 MB=0x69b2bc1fb6080
00000400:00000200:9.0:1773851868.893575:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.32@o2ib60 of length 224/224 into md 0x793926dc5 [64] + 136568
00000800:00000200:9.0:1773851868.893577:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851868.893579:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851868.893580:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851868.893581:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851868.893581:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851868.893582:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000035c61d66.
00000100:00000040:9.0:1773851868.893583:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000035c61d66 x1859462100639872 msgsize 224
00000100:00100000:9.0:1773851868.893586:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.32@o2ib60 (source: 12345-192.168.128.32@o2ib60)
00000100:00000001:9.0:1773851868.893588:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851868.893589:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851868.893590:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851868.893590:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851868.893591:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851868.893591:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851868.893593:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851868.893593:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851868.893594:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859462100639872
00000020:00000001:5.0:1773851868.893595:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851868.893595:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c5f4c8cb5
00000020:00000001:5.0:1773851868.893595:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851868.893597:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a9de6a22 refcount=5
00000020:00000001:5.0:1773851868.893598:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095875226624 : -106977834324992 : ffff9eb4482fac00)
00000020:00000001:5.0:1773851868.893598:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637095875226624 : -106977834324992 : ffff9eb4482fac00)
00000100:00000001:5.0:1773851868.893599:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851868.893600:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851868.893600:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000020:00000010:5.0:1773851868.893601:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851868.893602:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000057b1c766.
00000100:00000001:5.0:1773851868.893603:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851868.893603:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851868.893604:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851868.893604:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851868.893605:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851868.893605:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851868.893606:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851868.893607:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851868.893607:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851868.893608:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851868.893609:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851868.893609:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.32@o2ib60, seq: 2001922
00000100:00000040:5.0:1773851868.893609:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a9de6a22 : new rpc_count 1
00000100:00000001:7.0:1773851868.893610:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851868.893610:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851868.893610:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749203712 : -106947960347904 : ffff9ebb3cd06300)
00000100:00000040:5.0:1773851868.893611:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000035c61d66 x1859462100639872/t0(0) o400->1d038a2d-d4d0-4985-92ad-36c290740c84@192.168.128.32@o2ib60:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix32-0'
00000100:00000001:5.0:1773851868.893614:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851868.893614:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851868.893615:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035c61d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1d038a2d-d4d0-4985-92ad-36c290740c84+5:39911:x1859462100639872:12345-192.168.128.32@o2ib60:400:default-matrix32-0
00000100:00000200:5.0:1773851868.893616:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859462100639872
00000020:00000001:5.0:1773851868.893617:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851868.893618:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851868.893618:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.893619:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851868.893619:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851868.893620:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851868.893620:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859462100639872, found 0 last_xid 1859462100639871
00000020:00000001:5.0:1773851868.893621:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851868.893621:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851868.893622:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851868.893622:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.893622:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851868.893623:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851868.893624:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851868.893624:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a17358ca.
02000000:00000001:5.0:1773851868.893625:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851868.893625:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.893626:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851868.893626:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182286393398, transno 0, xid 1859462100639872
00010000:00000001:5.0:1773851868.893627:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851868.893628:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000035c61d66 x1859462100639872/t0(0) o400->1d038a2d-d4d0-4985-92ad-36c290740c84@192.168.128.32@o2ib60:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix32-0'
00010000:00000001:5.0:1773851868.893630:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851868.893630:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851868.893631:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=100 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851868.893632:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851868.893632:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000043bf9704 refcount 3 to 192.168.128.32@o2ib60
00000100:00000001:5.0:1773851868.893633:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918265465184 : -107155444086432 : ffff9e8aedd1c960)
02000000:00000001:5.0:1773851868.893634:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851868.893634:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851868.893635:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851868.893635:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.32@o2ib60
00000400:00000010:5.0:1773851868.893636:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000007a84371.
00000100:00000200:5.0:1773851868.893637:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859462100639872, offset 224
00000400:00000200:5.0:1773851868.893638:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.32@o2ib60
00000400:00000200:5.0:1773851868.893640:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.32@o2ib60 to cpt 1
00000400:00000200:5.0:1773851868.893641:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005dcc1213 nid 192.168.128.32@o2ib60 refs 2
00000400:00000200:5.0:1773851868.893642:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005dcc1213 nid 192.168.128.32@o2ib60 refs 3
00000400:00000200:5.0:1773851868.893643:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005dcc1213 nid 192.168.128.32@o2ib60 refs 4
00000400:00000200:5.0:1773851868.893645:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.32@o2ib60 routed destination
00000400:00000200:5.0:1773851868.893646:0:61015:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:5.0:1773851868.893647:0:61015:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:5.0:1773851868.893648:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.32@o2ib60: rtr pref emtpy: 1
00000400:00000200:5.0:1773851868.893649:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:5.0:1773851868.893650:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.32@o2ib60: rtr pref emtpy: 1
00000400:00000200:5.0:1773851868.893651:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:5.0:1773851868.893652:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769287:8769287:1024:4294967295] 17@kfi7 LPNI seq info [1250891893:1250891893:16:4294967295]
00000400:00000200:5.0:1773851868.893654:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:5.0:1773851868.893654:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:5.0:1773851868.893657:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.32@o2ib60(192.168.128.32@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851868.893658:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005dcc1213 nid 192.168.128.32@o2ib60 refs 3
00000800:00000200:5.0:1773851868.893660:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851868.893660:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851868.893663:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851868.893665:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:5.0:1773851868.893668:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:5.0:1773851868.893669:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851868.893671:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851868.893672:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000043bf9704 refcount 2 to 192.168.128.32@o2ib60
00010000:00000001:5.0:1773851868.893672:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851868.893673:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851868.893673:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851868.893674:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000035c61d66 x1859462100639872/t0(0) o400->1d038a2d-d4d0-4985-92ad-36c290740c84@192.168.128.32@o2ib60:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix32-0'
00000100:00100000:5.0:1773851868.893677:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035c61d66 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1d038a2d-d4d0-4985-92ad-36c290740c84+5:39911:x1859462100639872:12345-192.168.128.32@o2ib60:400:default-matrix32-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851868.893679:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.32@o2ib60, seq: 2001922
00000100:00000040:5.0:1773851868.893680:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a9de6a22 : new rpc_count 0
00000100:00000001:5.0:1773851868.893680:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851868.893681:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851868.893681:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851868.893682:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851868.893682:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000057b1c766.
00000020:00000010:5.0:1773851868.893682:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000400:00000200:6.0:1773851868.893683:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:5.0:1773851868.893683:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000a9de6a22 : new refcount 4
00000400:00000200:6.0:1773851868.893684:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:5.0:1773851868.893684:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851868.893685:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000007a84371
00000400:00000010:6.0:1773851868.893685:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000007a84371.
00000100:00000001:6.0:1773851868.893686:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851868.893686:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851868.893687:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:6.0:1773851868.893688:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Transaction freed
00000800:00000200:25.0:1773851868.909852:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851868.909854:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851868.909857:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851868.909861:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851868.909865:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19185@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.909867:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19185@kfi7 : PUT - for me
00000400:00000200:25.0:1773851868.909869:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19185@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.909871:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f6608dc nid 19185@kfi7 refs 1
00000400:00000200:25.0:1773851868.909873:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19185@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.909874:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f6608dc nid 19185@kfi7 refs 2
00000400:00000200:25.0:1773851868.909876:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006f6608dc nid 19185@kfi7 refs 3
00000400:00000200:25.0:1773851868.909878:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19184@kfi7 to cpt 3
00000400:00000200:25.0:1773851868.909880:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19184@kfi7 of length 224 into portal 12 MB=0x69b82e1543600
00000400:00000200:25.0:1773851868.909883:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19184@kfi7 of length 224/224 into md 0x16159c9699 [64] + 10056
00000800:00000200:25.0:1773851868.909886:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851868.909889:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851868.909891:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19185@kfi7: PUT: OK
00000100:00000001:25.0:1773851868.909893:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851868.909894:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851868.909895:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003cd882aa.
00000100:00000040:25.0:1773851868.909896:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000003cd882aa x1859836288710144 msgsize 224
00000100:00100000:25.0:1773851868.909899:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19184@kfi7 (source: 12345-19185@kfi7)
00000100:00000001:25.0:1773851868.909902:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851868.909904:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006f6608dc nid 19185@kfi7 refs 2
00000800:00000200:25.0:1773851868.909907:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851868.909916:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851868.909917:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851868.909918:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851868.909919:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851868.909920:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851868.909922:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836288710144
00000020:00000001:25.0:1773851868.909923:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851868.909924:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0878400bfbc
00000020:00000001:25.0:1773851868.909925:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851868.909931:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077c751e0 refcount=5
00000020:00000001:25.0:1773851868.909933:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121571022848 : -106952138528768 : ffff9eba43c66800)
00000020:00000001:25.0:1773851868.909934:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121571022848 : -106952138528768 : ffff9eba43c66800)
00000100:00000001:25.0:1773851868.909936:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851868.909937:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851868.909939:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000034fe4ec0.
00000020:00000010:25.0:1773851868.909941:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851868.909943:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851868.909944:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851868.909945:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851868.909946:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851868.909949:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851868.909950:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851868.909950:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.909953:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851868.909955:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851868.909956:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851868.909956:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851868.909957:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851868.909958:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19184@kfi7, seq: 2025102
00000100:00000001:26.0:1773851868.909960:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851868.909960:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077c751e0 : new rpc_count 1
00000100:00000001:25.0:1773851868.909961:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478778880 : -106938230772736 : ffff9ebd80bdec00)
00000100:00000040:25.0:1773851868.909963:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003cd882aa x1859836288710144/t0(0) o400->e0792948-708e-4281-be36-2cae7370f5ba@19184@kfi7:508/0 lens 224/0 e 0 to 0 dl 1773852623 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1677-0'
00000100:00000001:26.0:1773851868.909965:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.909968:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851868.909969:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851868.909972:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cd882aa pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e0792948-708e-4281-be36-2cae7370f5ba+5:39873:x1859836288710144:12345-19184@kfi7:400:default-tuolumne1677-0
00000100:00000200:25.0:1773851868.909974:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836288710144
00000020:00000001:25.0:1773851868.909975:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851868.909976:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851868.909977:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.909979:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851868.909980:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851868.909981:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851868.909982:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836288710144, found 0 last_xid 1859836288710143
00000020:00000001:25.0:1773851868.909984:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851868.909985:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851868.909986:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851868.909987:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.909988:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851868.909989:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851868.909990:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851868.909991:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c5bae70a.
02000000:00000001:25.0:1773851868.909992:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.909994:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.909995:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851868.909996:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260598216, transno 0, xid 1859836288710144
00010000:00000001:25.0:1773851868.909998:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851868.909999:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003cd882aa x1859836288710144/t0(0) o400->e0792948-708e-4281-be36-2cae7370f5ba@19184@kfi7:508/0 lens 224/224 e 0 to 0 dl 1773852623 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1677-0'
00010000:00000001:25.0:1773851868.910004:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851868.910005:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851868.910006:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=101 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851868.910008:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851868.910010:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005ea311ea refcount 3 to 19184@kfi7
00000100:00000001:25.0:1773851868.910011:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729296672 : -107155980254944 : ffff9e8acddc8120)
02000000:00000001:25.0:1773851868.910012:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851868.910013:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851868.910015:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851868.910017:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19185@kfi7
00000400:00000010:25.0:1773851868.910018:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005dc5d812.
00000100:00000200:25.0:1773851868.910020:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836288710144, offset 224
00000400:00000200:25.0:1773851868.910023:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19185@kfi7
00000400:00000200:25.0:1773851868.910024:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19185@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.910025:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f6608dc nid 19185@kfi7 refs 1
00000400:00000200:25.0:1773851868.910027:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006f6608dc nid 19185@kfi7 refs 2
00000400:00000200:25.0:1773851868.910029:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006f6608dc nid 19185@kfi7 refs 3
00000400:00000200:25.0:1773851868.910032:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19185@kfi7 local destination
00000400:00000200:25.0:1773851868.910034:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769288:8769288:1024:4294967295] 19185@kfi7 LPNI seq info [7092296:7092296:16:4294967295]
00000400:00000200:25.0:1773851868.910037:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006f6608dc nid 19185@kfi7 refs 2
00000400:00000200:25.0:1773851868.910038:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19185@kfi7 to cpt 6
00000400:00000200:25.0:1773851868.910042:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19185@kfi7(19185@kfi7:19185@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851868.910044:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006f6608dc nid 19185@kfi7 refs 3
00000800:00000200:25.0:1773851868.910047:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851868.910049:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851868.910053:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851868.910057:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf4d Using peer 19185@kfi7(0xf4d)
00000800:00000200:25.0:1773851868.910063:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 324 bytes to peer 0xf4d: rc=0
00000800:00000200:25.0:1773851868.910065:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf4d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851868.910069:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851868.910071:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005ea311ea refcount 2 to 19184@kfi7
00010000:00000001:25.0:1773851868.910072:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851868.910073:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851868.910074:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851868.910076:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003cd882aa x1859836288710144/t0(0) o400->e0792948-708e-4281-be36-2cae7370f5ba@19184@kfi7:508/0 lens 224/224 e 0 to 0 dl 1773852623 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1677-0'
00000800:00000200:27.0:1773851868.910082:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf4d TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851868.910085:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851868.910087:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19185@kfi7: PUT: OK
00000400:00000200:27.0:1773851868.910088:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005dc5d812
00000100:00100000:25.0:1773851868.910088:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cd882aa pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e0792948-708e-4281-be36-2cae7370f5ba+5:39873:x1859836288710144:12345-19184@kfi7:400:default-tuolumne1677-0 Request processed in 119us (191us total) trans 0 rc 0/0
00000400:00000010:27.0:1773851868.910089:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005dc5d812.
00000100:00000001:27.0:1773851868.910090:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851868.910091:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851868.910093:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006f6608dc nid 19185@kfi7 refs 2
00000100:00100000:25.0:1773851868.910093:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19184@kfi7, seq: 2025102
00000100:00000040:25.0:1773851868.910094:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077c751e0 : new rpc_count 0
00000800:00000200:27.0:1773851868.910095:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 19185@kfi7(00000000c8fd495e):0x0 lsk 3918 rsk 42 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf4d Transaction freed
00000100:00000001:25.0:1773851868.910095:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851868.910096:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851868.910097:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851868.910098:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000020:00000010:25.0:1773851868.910099:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000034fe4ec0.
00000020:00000040:25.0:1773851868.910100:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000077c751e0 : new refcount 4
00000100:00000001:25.0:1773851868.910101:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851868.916278:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.916278:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851868.916279:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.916279:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851868.916280:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.916280:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851868.916282:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851868.916282:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16048@kfi7(00000000c328fdc0):0x817 version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851868.916283:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000800:00000200:17.0:1773851868.916283:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 Using peer 16048@kfi7(0x100000000000817)
00000400:00000200:18.0:1773851868.916285:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16048@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.916285:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000400:00000200:18.0:1773851868.916286:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000800:00000200:17.0:1773851868.916286:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x100000000000817: rc=0
00000400:00000200:18.0:1773851868.916287:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040e03c3e nid 16048@kfi7 refs 1
00000400:00000200:18.0:1773851868.916288:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000400:00000200:18.0:1773851868.916288:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040e03c3e nid 16048@kfi7 refs 2
00000800:00000200:17.0:1773851868.916288:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851868.916289:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000040e03c3e nid 16048@kfi7 refs 3
00000400:00000200:18.0:1773851868.916290:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000400:00000200:18.0:1773851868.916291:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16048@kfi7 of length 456 into portal 12 MB=0x69b4b67d99180
00000400:00000200:18.0:1773851868.916292:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16048@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 13240
00000800:00000200:18.0:1773851868.916294:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851868.916296:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851868.916297:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16048@kfi7: PUT: OK
00000100:00000001:18.0:1773851868.916298:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851868.916298:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851868.916299:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073406e35.
00000800:00000200:17.0:1773851868.916299:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851868.916300:0:2507147:0:(events.c:358:request_in_callback()) incoming req@0000000073406e35 x1859598027428224 msgsize 456
00000100:00100000:18.0:1773851868.916301:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-16048@kfi7 (source: 12345-16048@kfi7)
00000100:00000001:18.0:1773851868.916302:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851868.916302:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 Transaction freed
00000400:00000200:18.0:1773851868.916303:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000040e03c3e nid 16048@kfi7 refs 2
00000100:00000001:16.0:1773851868.916303:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851868.916304:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851868.916304:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851868.916304:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851868.916305:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851868.916306:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851868.916307:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598027428224
00000020:00000001:16.0:1773851868.916307:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851868.916308:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8160c
00000020:00000001:16.0:1773851868.916309:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851868.916313:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b273a1db refcount=5
00000020:00000001:16.0:1773851868.916314:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119306433536 : -106954403118080 : ffff9eb9bccb8400)
00000020:00000001:16.0:1773851868.916314:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119306433536 : -106954403118080 : ffff9eb9bccb8400)
00000100:00000001:16.0:1773851868.916315:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.916316:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851868.916316:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddc278b8.
00000020:00000010:16.0:1773851868.916317:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851868.916318:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b2bbb793.
00000100:00000001:16.0:1773851868.916319:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851868.916319:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851868.916320:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.916321:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.916322:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.916323:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851868.916323:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851868.916323:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.916323:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851868.916324:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16048@kfi7, seq: 323103287
00000100:00000001:17.0:1773851868.916325:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.916325:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b273a1db : new rpc_count 1
00000100:00000001:17.0:1773851868.916326:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.916326:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534667648 : -106946174883968 : ffff9ebba73c6780)
00000100:00000040:16.0:1773851868.916327:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000073406e35 x1859598027428224/t0(0) o17->737cf554-1aa4-4cb0-ac32-575bd351219d@16048@kfi7:508/0 lens 456/0 e 0 to 0 dl 1773852623 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1486-0'
00000100:00000001:16.0:1773851868.916329:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.916330:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851868.916330:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073406e35 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:737cf554-1aa4-4cb0-ac32-575bd351219d+5:39516:x1859598027428224:12345-16048@kfi7:17:default-tuolumne1486-0
00000100:00000200:16.0:1773851868.916332:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598027428224
00000020:00000001:16.0:1773851868.916332:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851868.916333:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851868.916334:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.916334:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851868.916335:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:16.0:1773851868.916336:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851868.916337:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598027428224, found 0 last_xid 1859598027428223
00000020:00000001:16.0:1773851868.916337:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851868.916338:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851868.916339:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851868.916339:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:16.0:1773851868.916340:0:61039:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:16.0:1773851868.916341:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851868.916342:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851868.916343:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000083b69f71.
02000000:00000001:16.0:1773851868.916344:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.916344:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.916345:0:61039:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:16.0:1773851868.916346:0:61039:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:16.0:1773851868.916347:0:61039:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:16.0:1773851868.916348:0:61039:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.916349:0:61039:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:16.0:1773851868.916350:0:61039:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 737cf554-1aa4-4cb0-ac32-575bd351219d/00000000b273a1db free: 126633370845184 avail: 126633368748032
00000020:00000001:16.0:1773851868.916351:0:61039:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:16.0:1773851868.916352:0:61039:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 737cf554-1aa4-4cb0-ac32-575bd351219d/00000000b273a1db avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:16.0:1773851868.916353:0:61039:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:16.0:1773851868.916354:0:61039:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:16.0:1773851868.916354:0:61039:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 737cf554-1aa4-4cb0-ac32-575bd351219d/00000000b273a1db reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:16.0:1773851868.916356:0:61039:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:16.0:1773851868.916356:0:61039:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:16.0:1773851868.916357:0:61039:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851868.916357:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596422, transno 0, xid 1859598027428224
00010000:00000001:16.0:1773851868.916358:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851868.916359:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000073406e35 x1859598027428224/t0(0) o17->737cf554-1aa4-4cb0-ac32-575bd351219d@16048@kfi7:508/0 lens 456/432 e 0 to 0 dl 1773852623 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1486-0'
00010000:00000001:16.0:1773851868.916361:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851868.916362:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851868.916362:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851868.916363:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851868.916365:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000982743af refcount 3 to 16048@kfi7
00000100:00000001:16.0:1773851868.916365:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993664 : -107142345557952 : ffff9e8dfa8d7840)
02000000:00000001:16.0:1773851868.916366:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851868.916367:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.916367:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851868.916368:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16048@kfi7
00000400:00000010:16.0:1773851868.916369:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001fe92b14.
00000100:00000200:16.0:1773851868.916369:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598027428224, offset 224
00000400:00000200:16.0:1773851868.916370:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16048@kfi7
00000400:00000200:16.0:1773851868.916371:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.916372:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040e03c3e nid 16048@kfi7 refs 1
00000400:00000200:16.0:1773851868.916373:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000040e03c3e nid 16048@kfi7 refs 2
00000400:00000200:16.0:1773851868.916374:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000040e03c3e nid 16048@kfi7 refs 3
00000400:00000200:16.0:1773851868.916375:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16048@kfi7 local destination
00000400:00000200:16.0:1773851868.916376:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769289:8769289:1024:4294967295] 16048@kfi7 LPNI seq info [3606860:3606860:16:4294967295]
00000400:00000200:16.0:1773851868.916377:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000040e03c3e nid 16048@kfi7 refs 2
00000400:00000200:16.0:1773851868.916378:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16048@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.916380:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16048@kfi7(16048@kfi7:16048@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851868.916381:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000040e03c3e nid 16048@kfi7 refs 3
00000800:00000200:16.0:1773851868.916382:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851868.916383:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:16.0:1773851868.916386:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851868.916388:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 Using peer 16048@kfi7(0x100000000000817)
00000800:00000200:16.0:1773851868.916390:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 532 bytes to peer 0x100000000000817: rc=0
00000800:00000200:16.0:1773851868.916391:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851868.916393:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.916395:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000982743af refcount 2 to 16048@kfi7
00010000:00000001:16.0:1773851868.916396:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851868.916396:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.916397:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851868.916397:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073406e35 x1859598027428224/t0(0) o17->737cf554-1aa4-4cb0-ac32-575bd351219d@16048@kfi7:508/0 lens 456/432 e 0 to 0 dl 1773852623 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1486-0'
00000100:00100000:16.0:1773851868.916401:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073406e35 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:737cf554-1aa4-4cb0-ac32-575bd351219d+5:39516:x1859598027428224:12345-16048@kfi7:17:default-tuolumne1486-0 Request processed in 71us (101us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851868.916403:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16048@kfi7, seq: 323103287
00000100:00000040:16.0:1773851868.916404:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b273a1db : new rpc_count 0
00000100:00000001:16.0:1773851868.916405:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851868.916405:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851868.916406:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851868.916406:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b2bbb793.
00000020:00000010:16.0:1773851868.916407:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddc278b8.
00000020:00000040:16.0:1773851868.916408:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b273a1db : new refcount 4
00000100:00000001:16.0:1773851868.916409:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851868.916413:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851868.916414:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.916415:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16048@kfi7: PUT: OK
00000400:00000200:17.0:1773851868.916416:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001fe92b14
00000400:00000010:17.0:1773851868.916417:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001fe92b14.
00000100:00000001:17.0:1773851868.916417:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851868.916418:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851868.916419:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000040e03c3e nid 16048@kfi7 refs 2
00000800:00000200:17.0:1773851868.916420:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 16048@kfi7(00000000c328fdc0):0x0 lsk 2072 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000817 Transaction freed
00000800:00000200:21.0:1773851868.923559:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851868.923560:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851868.923561:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851868.923564:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851868.923566:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923567:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14331@kfi7 : PUT - for me
00000400:00000200:21.0:1773851868.923568:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923569:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 1
00000400:00000200:21.0:1773851868.923570:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923571:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000400:00000200:21.0:1773851868.923572:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 3
00000400:00000200:21.0:1773851868.923572:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923573:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14331@kfi7 of length 224 into portal 12 MB=0x699de8c32f100
00000400:00000200:21.0:1773851868.923575:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14331@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 37728
00000800:00000200:21.0:1773851868.923577:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851868.923578:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851868.923579:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14331@kfi7: PUT: OK
00000100:00000001:21.0:1773851868.923580:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851868.923580:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851868.923581:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008136e4bd.
00000100:00000040:21.0:1773851868.923582:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008136e4bd x1858030974202112 msgsize 224
00000100:00100000:21.0:1773851868.923584:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14331@kfi7 (source: 12345-14331@kfi7)
00000100:00000001:21.0:1773851868.923585:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851868.923586:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000100:00000001:22.0:1773851868.923587:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851868.923588:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851868.923588:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851868.923588:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851868.923589:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851868.923589:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851868.923591:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974202112
00000020:00000001:22.0:1773851868.923591:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851868.923592:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f0b
00000020:00000001:22.0:1773851868.923592:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851868.923597:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b844a514 refcount=6
00000020:00000001:22.0:1773851868.923598:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239868416 : -107152469683200 : ffff9e8b9f1b9400)
00000020:00000001:22.0:1773851868.923599:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239868416 : -107152469683200 : ffff9e8b9f1b9400)
00000100:00000001:22.0:1773851868.923600:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.923600:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851868.923601:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007ba23cf7.
00000020:00000010:22.0:1773851868.923602:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.923603:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851868.923604:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851868.923604:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851868.923604:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851868.923606:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851868.923606:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851868.923607:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923607:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851868.923609:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851868.923609:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851868.923609:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851868.923609:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851868.923610:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14331@kfi7, seq: 1997982
00000100:00000001:23.0:1773851868.923611:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.923611:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b844a514 : new rpc_count 1
00000100:00000001:23.0:1773851868.923612:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923612:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788280832 : -106974921270784 : ffff9eb4f5d15a00)
00000100:00000040:22.0:1773851868.923613:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008136e4bd x1858030974202112/t0(0) o400->c1d23703-2ff5-409a-a5aa-322060a4eafa@14331@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne224-0'
00000100:00000001:22.0:1773851868.923616:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.923616:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851868.923617:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008136e4bd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c1d23703-2ff5-409a-a5aa-322060a4eafa+6:47934:x1858030974202112:12345-14331@kfi7:400:default-tuolumne224-0
00000100:00000200:22.0:1773851868.923618:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974202112
00000020:00000001:22.0:1773851868.923619:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851868.923620:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851868.923621:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923622:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851868.923622:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851868.923623:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851868.923623:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974202112, found 0 last_xid 1858030974202111
00000020:00000001:22.0:1773851868.923624:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851868.923625:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851868.923625:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851868.923626:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923627:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851868.923627:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851868.923628:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851868.923630:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000fa9b9b9.
02000000:00000001:22.0:1773851868.923630:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923631:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923632:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851868.923633:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030974202112
00010000:00000001:22.0:1773851868.923633:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851868.923634:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008136e4bd x1858030974202112/t0(0) o400->c1d23703-2ff5-409a-a5aa-322060a4eafa@14331@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne224-0'
00010000:00000001:22.0:1773851868.923637:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851868.923637:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851868.923638:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=101 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851868.923639:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851868.923640:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e4f7984 refcount 5 to 14331@kfi7
00000100:00000001:22.0:1773851868.923640:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025760 : -107156745525856 : ffff9e8aa03f65a0)
02000000:00000001:22.0:1773851868.923641:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851868.923642:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923642:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851868.923643:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14331@kfi7
00000400:00000010:22.0:1773851868.923644:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ba66170e.
00000100:00000200:22.0:1773851868.923645:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974202112, offset 224
00000400:00000200:22.0:1773851868.923646:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14331@kfi7
00000400:00000200:22.0:1773851868.923647:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.923648:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 1
00000400:00000200:22.0:1773851868.923650:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000400:00000200:22.0:1773851868.923651:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 3
00000400:00000200:22.0:1773851868.923652:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14331@kfi7 local destination
00000400:00000200:22.0:1773851868.923653:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769290:8769290:1024:4294967295] 14331@kfi7 LPNI seq info [24420:24420:16:4294967295]
00000400:00000200:22.0:1773851868.923654:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000400:00000200:22.0:1773851868.923655:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.923657:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14331@kfi7(14331@kfi7:14331@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851868.923658:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 3
00000800:00000200:22.0:1773851868.923659:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.923660:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851868.923663:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851868.923666:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000003c4 Using peer 14331@kfi7(0x1000000000003c4)
00000800:00000200:22.0:1773851868.923669:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000003e4ddf4f: Posted send of 324 bytes to peer 0x1000000000003c4: rc=0
00000800:00000200:22.0:1773851868.923671:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000003c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851868.923673:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.923674:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e4f7984 refcount 4 to 14331@kfi7
00010000:00000001:22.0:1773851868.923675:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851868.923676:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923676:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851868.923677:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008136e4bd x1858030974202112/t0(0) o400->c1d23703-2ff5-409a-a5aa-322060a4eafa@14331@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne224-0'
00000100:00100000:22.0:1773851868.923681:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008136e4bd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c1d23703-2ff5-409a-a5aa-322060a4eafa+6:47934:x1858030974202112:12345-14331@kfi7:400:default-tuolumne224-0 Request processed in 64us (98us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851868.923681:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000003c4 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851868.923683:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:22.0:1773851868.923684:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14331@kfi7, seq: 1997982
00000100:00000040:22.0:1773851868.923684:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b844a514 : new rpc_count 0
00000400:00000200:21.0:1773851868.923685:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14331@kfi7: PUT: OK
00000100:00000001:22.0:1773851868.923686:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851868.923686:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851868.923686:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ba66170e
00000400:00000010:21.0:1773851868.923686:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ba66170e.
00000020:00000010:22.0:1773851868.923687:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000100:00000001:21.0:1773851868.923687:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:22.0:1773851868.923688:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000100:00000001:21.0:1773851868.923688:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851868.923689:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007ba23cf7.
00000400:00000200:21.0:1773851868.923689:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000020:00000040:22.0:1773851868.923690:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000b844a514 : new refcount 5
00000100:00000001:22.0:1773851868.923690:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851868.923691:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2054@kfi7:5 -> 14331@kfi7(00000000969e3f65):0x0 lsk 965 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000003c4 Transaction freed
00000800:00000200:21.0:1773851868.923883:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851868.923884:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851868.923885:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851868.923887:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851868.923889:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923890:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14331@kfi7 : PUT - for me
00000400:00000200:21.0:1773851868.923891:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923892:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 1
00000400:00000200:21.0:1773851868.923893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923893:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000400:00000200:21.0:1773851868.923894:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 3
00000400:00000200:21.0:1773851868.923895:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:21.0:1773851868.923896:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14331@kfi7 of length 224 into portal 12 MB=0x699de8c32f940
00000400:00000200:21.0:1773851868.923897:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14331@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 37952
00000800:00000200:21.0:1773851868.923899:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851868.923901:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851868.923902:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14331@kfi7: PUT: OK
00000100:00000001:21.0:1773851868.923902:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851868.923903:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851868.923904:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c134d4cb.
00000100:00000040:21.0:1773851868.923904:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c134d4cb x1858030974204224 msgsize 224
00000100:00100000:21.0:1773851868.923906:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14331@kfi7 (source: 12345-14331@kfi7)
00000100:00000001:21.0:1773851868.923907:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:22.0:1773851868.923908:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851868.923908:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:21.0:1773851868.923908:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000100:00000001:22.0:1773851868.923909:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851868.923909:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851868.923909:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851868.923910:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851868.923910:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974204224
00000020:00000001:22.0:1773851868.923911:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851868.923911:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9128b
00000020:00000001:22.0:1773851868.923912:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851868.923915:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c51614f9 refcount=6
00000020:00000001:22.0:1773851868.923915:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716192256 : -107155993359360 : ffff9e8acd148c00)
00000020:00000001:22.0:1773851868.923916:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716192256 : -107155993359360 : ffff9e8acd148c00)
00000100:00000001:22.0:1773851868.923917:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.923918:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851868.923918:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002bfc08b2.
00000020:00000010:22.0:1773851868.923919:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.923919:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851868.923920:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851868.923921:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851868.923921:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851868.923922:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851868.923922:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851868.923922:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923923:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851868.923924:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851868.923925:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851868.923925:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851868.923925:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851868.923925:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14331@kfi7, seq: 1997983
00000100:00000001:23.0:1773851868.923926:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.923926:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c51614f9 : new rpc_count 1
00000100:00000001:23.0:1773851868.923927:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923927:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788263552 : -106974921288064 : ffff9eb4f5d11680)
00000100:00000040:22.0:1773851868.923928:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c134d4cb x1858030974204224/t0(0) o400->6566a0ef-71c4-4900-8784-72beb4951fa5@14331@kfi7:595/0 lens 224/0 e 0 to 0 dl 1773851955 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne224-0'
00000100:00000001:22.0:1773851868.923931:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851868.923931:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851868.923932:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c134d4cb pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:6566a0ef-71c4-4900-8784-72beb4951fa5+6:47935:x1858030974204224:12345-14331@kfi7:400:default-tuolumne224-0
00000100:00000200:22.0:1773851868.923933:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974204224
00000020:00000001:22.0:1773851868.923933:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851868.923934:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851868.923935:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923935:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851868.923935:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851868.923936:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851868.923936:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974204224, found 0 last_xid 1858030974204223
00000020:00000001:22.0:1773851868.923937:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851868.923938:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851868.923938:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851868.923938:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923939:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851868.923939:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851868.923940:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851868.923940:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004246b5b6.
02000000:00000001:22.0:1773851868.923941:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923941:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923942:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851868.923943:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768279, transno 0, xid 1858030974204224
00010000:00000001:22.0:1773851868.923943:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851868.923944:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c134d4cb x1858030974204224/t0(0) o400->6566a0ef-71c4-4900-8784-72beb4951fa5@14331@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne224-0'
00010000:00000001:22.0:1773851868.923946:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851868.923947:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851868.923947:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=101 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851868.923949:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851868.923949:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e4f7984 refcount 5 to 14331@kfi7
00000100:00000001:22.0:1773851868.923950:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025760 : -107156745525856 : ffff9e8aa03f65a0)
02000000:00000001:22.0:1773851868.923951:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851868.923951:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851868.923952:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851868.923952:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14331@kfi7
00000400:00000010:22.0:1773851868.923953:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005155ebc6.
00000100:00000200:22.0:1773851868.923954:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030974204224, offset 224
00000400:00000200:22.0:1773851868.923955:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14331@kfi7
00000400:00000200:22.0:1773851868.923956:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.923957:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 1
00000400:00000200:22.0:1773851868.923958:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000400:00000200:22.0:1773851868.923959:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 3
00000400:00000200:22.0:1773851868.923959:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14331@kfi7 local destination
00000400:00000200:22.0:1773851868.923961:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769291:8769291:1024:4294967295] 14331@kfi7 LPNI seq info [24421:24421:16:4294967295]
00000400:00000200:22.0:1773851868.923962:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000400:00000200:22.0:1773851868.923963:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14331@kfi7 to cpt 5
00000400:00000200:22.0:1773851868.923964:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14331@kfi7(14331@kfi7:14331@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851868.923965:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 3
00000800:00000200:22.0:1773851868.923967:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851868.923968:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851868.923970:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851868.923971:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3c8 Using peer 14331@kfi7(0x3c8)
00000800:00000200:22.0:1773851868.923974:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003e4ddf4f: Posted send of 324 bytes to peer 0x3c8: rc=0
00000800:00000200:22.0:1773851868.923975:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3c8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851868.923977:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851868.923978:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e4f7984 refcount 4 to 14331@kfi7
00010000:00000001:22.0:1773851868.923979:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851868.923979:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851868.923980:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851868.923980:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c134d4cb x1858030974204224/t0(0) o400->6566a0ef-71c4-4900-8784-72beb4951fa5@14331@kfi7:595/0 lens 224/224 e 0 to 0 dl 1773851955 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne224-0'
00000100:00100000:22.0:1773851868.923983:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c134d4cb pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:6566a0ef-71c4-4900-8784-72beb4951fa5+6:47935:x1858030974204224:12345-14331@kfi7:400:default-tuolumne224-0 Request processed in 52us (78us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851868.923985:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14331@kfi7, seq: 1997983
00000100:00000040:22.0:1773851868.923985:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c51614f9 : new rpc_count 0
00000100:00000001:22.0:1773851868.923986:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851868.923986:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851868.923987:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851868.923987:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000800:00000200:21.0:1773851868.923987:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3c8 TN_EVENT_TX_OK event status 0
00000020:00000010:22.0:1773851868.923988:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002bfc08b2.
00000020:00000040:22.0:1773851868.923989:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000c51614f9 : new refcount 5
00000400:00000200:21.0:1773851868.923989:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851868.923990:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851868.923990:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14331@kfi7: PUT: OK
00000400:00000200:21.0:1773851868.923990:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005155ebc6
00000400:00000010:21.0:1773851868.923991:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005155ebc6.
00000100:00000001:21.0:1773851868.923991:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851868.923992:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851868.923992:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003da7ce3a nid 14331@kfi7 refs 2
00000800:00000200:21.0:1773851868.923994:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003e4ddf4f: 2069@kfi7:5 -> 14331@kfi7(0000000053333e3d):0x0 lsk 969 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x3c8 Transaction freed
00000800:00000200:17.0:1773851868.951798:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851868.951799:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851868.951801:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851868.951803:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851868.951805:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21216@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.951806:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21216@kfi7 : PUT - for me
00000400:00000200:17.0:1773851868.951807:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21216@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.951808:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000051ecce2 nid 21216@kfi7 refs 1
00000400:00000200:17.0:1773851868.951809:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21216@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.951810:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000051ecce2 nid 21216@kfi7 refs 2
00000400:00000200:17.0:1773851868.951811:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000051ecce2 nid 21216@kfi7 refs 3
00000400:00000200:17.0:1773851868.951811:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21216@kfi7 to cpt 4
00000400:00000200:17.0:1773851868.951812:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21216@kfi7 of length 224 into portal 12 MB=0x69b096842cc80
00000400:00000200:17.0:1773851868.951814:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21216@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 13696
00000800:00000200:17.0:1773851868.951815:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851868.951817:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.951818:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21216@kfi7: PUT: OK
00000100:00000001:17.0:1773851868.951818:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851868.951819:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851868.951820:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f21bbe3.
00000100:00000040:17.0:1773851868.951820:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002f21bbe3 x1859314566483072 msgsize 224
00000100:00100000:17.0:1773851868.951822:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21216@kfi7 (source: 12345-21216@kfi7)
00000100:00000001:17.0:1773851868.951823:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851868.951823:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000051ecce2 nid 21216@kfi7 refs 2
00000100:00000001:16.0:1773851868.951824:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851868.951824:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851868.951825:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851868.951825:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851868.951825:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851868.951826:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851868.951827:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314566483072
00000020:00000001:16.0:1773851868.951827:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851868.951828:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a16
00000020:00000001:16.0:1773851868.951828:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851868.951830:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003db1cb50 refcount=8
00000020:00000001:16.0:1773851868.951831:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743458816 : -107128966092800 : ffff9e911807e800)
00000020:00000001:16.0:1773851868.951831:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743458816 : -107128966092800 : ffff9e911807e800)
00000100:00000001:16.0:1773851868.951832:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.951833:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851868.951833:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddc278b8.
00000020:00000010:16.0:1773851868.951834:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851868.951836:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b2bbb793.
00000100:00000001:16.0:1773851868.951836:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851868.951837:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851868.951837:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851868.951838:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851868.951839:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851868.951839:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.951840:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851868.951841:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.951841:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851868.951841:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851868.951842:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851868.951842:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21216@kfi7, seq: 2156336
00000100:00000001:17.0:1773851868.951843:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851868.951843:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.951843:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003db1cb50 : new rpc_count 1
00000100:00000001:16.0:1773851868.951843:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156639499008 : -106917070052608 : ffff9ec26e04e300)
00000100:00000040:16.0:1773851868.951845:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f21bbe3 x1859314566483072/t0(0) o400->d037be5a-877a-41fc-84d5-3d75f5e745b8@21216@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1807-0'
00000100:00000001:16.0:1773851868.951847:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851868.951847:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851868.951848:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f21bbe3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d037be5a-877a-41fc-84d5-3d75f5e745b8+8:39563:x1859314566483072:12345-21216@kfi7:400:default-tuolumne1807-0
00000100:00000200:16.0:1773851868.951849:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314566483072
00000020:00000001:16.0:1773851868.951850:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851868.951850:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851868.951851:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.951852:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851868.951852:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851868.951853:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851868.951853:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314566483072, found 0 last_xid 1859314566483071
00000020:00000001:16.0:1773851868.951854:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851868.951855:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851868.951855:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851868.951855:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.951856:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851868.951857:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851868.951857:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851868.951859:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009a720bfd.
02000000:00000001:16.0:1773851868.951860:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.951860:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.951861:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851868.951861:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044154113, transno 0, xid 1859314566483072
00010000:00000001:16.0:1773851868.951862:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851868.951863:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f21bbe3 x1859314566483072/t0(0) o400->d037be5a-877a-41fc-84d5-3d75f5e745b8@21216@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1807-0'
00010000:00000001:16.0:1773851868.951865:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851868.951866:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851868.951866:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=101 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851868.951868:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851868.951868:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bfe023ec refcount 3 to 21216@kfi7
00000100:00000001:16.0:1773851868.951869:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583545952 : -107156126005664 : ffff9e8ac52c8660)
02000000:00000001:16.0:1773851868.951870:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851868.951870:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851868.951871:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851868.951871:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21216@kfi7
00000400:00000010:16.0:1773851868.951872:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da0f7c1f.
00000100:00000200:16.0:1773851868.951872:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314566483072, offset 224
00000400:00000200:16.0:1773851868.951874:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21216@kfi7
00000400:00000200:16.0:1773851868.951874:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21216@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.951875:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000051ecce2 nid 21216@kfi7 refs 1
00000400:00000200:16.0:1773851868.951876:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000051ecce2 nid 21216@kfi7 refs 2
00000400:00000200:16.0:1773851868.951877:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000051ecce2 nid 21216@kfi7 refs 3
00000400:00000200:16.0:1773851868.951878:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21216@kfi7 local destination
00000400:00000200:16.0:1773851868.951880:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769292:8769292:1024:4294967295] 21216@kfi7 LPNI seq info [1010339:1010339:16:4294967295]
00000400:00000200:16.0:1773851868.951881:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000051ecce2 nid 21216@kfi7 refs 2
00000400:00000200:16.0:1773851868.951882:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21216@kfi7 to cpt 4
00000400:00000200:16.0:1773851868.951884:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21216@kfi7(21216@kfi7:21216@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851868.951885:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000051ecce2 nid 21216@kfi7 refs 3
00000800:00000200:16.0:1773851868.951886:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851868.951888:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851868.951890:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851868.951892:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9d9 Using peer 21216@kfi7(0x9d9)
00000800:00000200:16.0:1773851868.951895:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009aebe925: Posted send of 324 bytes to peer 0x9d9: rc=0
00000800:00000200:16.0:1773851868.951896:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9d9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851868.951898:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851868.951898:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bfe023ec refcount 2 to 21216@kfi7
00010000:00000001:16.0:1773851868.951899:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851868.951899:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851868.951900:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851868.951901:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f21bbe3 x1859314566483072/t0(0) o400->d037be5a-877a-41fc-84d5-3d75f5e745b8@21216@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1807-0'
00000100:00100000:16.0:1773851868.951905:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f21bbe3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d037be5a-877a-41fc-84d5-3d75f5e745b8+8:39563:x1859314566483072:12345-21216@kfi7:400:default-tuolumne1807-0 Request processed in 57us (84us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851868.951907:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21216@kfi7, seq: 2156336
00000100:00000040:16.0:1773851868.951908:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003db1cb50 : new rpc_count 0
00000100:00000001:16.0:1773851868.951908:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851868.951909:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851868.951909:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851868.951910:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b2bbb793.
00000020:00000010:16.0:1773851868.951911:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddc278b8.
00000020:00000040:16.0:1773851868.951912:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000003db1cb50 : new refcount 7
00000100:00000001:16.0:1773851868.951912:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851868.951917:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9d9 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851868.951919:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851868.951920:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21216@kfi7: PUT: OK
00000400:00000200:17.0:1773851868.951920:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da0f7c1f
00000400:00000010:17.0:1773851868.951921:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da0f7c1f.
00000100:00000001:17.0:1773851868.951921:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851868.951922:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851868.951923:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000051ecce2 nid 21216@kfi7 refs 2
00000800:00000200:17.0:1773851868.951924:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 21216@kfi7(00000000a1beceea):0x0 lsk 2522 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9d9 Transaction freed
00000800:00000200:30.0F:1773851868.990022:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851868.990024:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851868.990025:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851868.990028:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851868.990030:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22259@kfi7 to cpt 7
00000400:00000200:30.0:1773851868.990032:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22259@kfi7 : PUT - for me
00000400:00000200:30.0:1773851868.990033:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22259@kfi7 to cpt 7
00000400:00000200:30.0:1773851868.990034:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000407bd16c nid 22259@kfi7 refs 1
00000400:00000200:30.0:1773851868.990035:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22259@kfi7 to cpt 7
00000400:00000200:30.0:1773851868.990036:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000407bd16c nid 22259@kfi7 refs 2
00000400:00000200:30.0:1773851868.990037:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000407bd16c nid 22259@kfi7 refs 3
00000400:00000200:30.0:1773851868.990037:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22066@kfi7 to cpt 1
00000400:00000200:30.0:1773851868.990038:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22066@kfi7 of length 224 into portal 12 MB=0x699e18d20d140
00000400:00000200:30.0:1773851868.990040:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22066@kfi7 of length 224/224 into md 0x77fe139dd [64] + 176872
00000800:00000200:30.0:1773851868.990042:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851868.990044:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851868.990045:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22259@kfi7: PUT: OK
00000100:00000001:30.0:1773851868.990046:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851868.990046:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851868.990047:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061cdc96b.
00000100:00000040:30.0:1773851868.990048:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000061cdc96b x1858043874693440 msgsize 224
00000100:00100000:30.0:1773851868.990049:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-22066@kfi7 (source: 12345-22259@kfi7)
00000100:00000001:30.0:1773851868.990050:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851868.990051:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000407bd16c nid 22259@kfi7 refs 2
00000100:00000001:31.0:1773851868.990052:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851868.990053:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851868.990053:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851868.990053:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851868.990054:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851868.990054:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851868.990055:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043874693440
00000020:00000001:31.0:1773851868.990056:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851868.990056:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e18c0df9c
00000020:00000001:31.0:1773851868.990057:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851868.990060:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002201cff3 refcount=5
00000020:00000001:31.0:1773851868.990061:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126075566080 : -106947633985536 : ffff9ebb50444800)
00000020:00000001:31.0:1773851868.990062:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126075566080 : -106947633985536 : ffff9ebb50444800)
00000100:00000001:31.0:1773851868.990063:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851868.990064:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851868.990064:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009fd8e64.
00000020:00000010:31.0:1773851868.990065:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851868.990066:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bcd0c99c.
00000100:00000001:31.0:1773851868.990067:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851868.990067:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851868.990068:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.990069:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851868.990069:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851868.990070:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.990071:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851868.990072:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851868.990072:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851868.990072:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851868.990073:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22066@kfi7, seq: 2055526
00000100:00000001:28.0:1773851868.990073:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851868.990074:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002201cff3 : new rpc_count 1
00000100:00000001:28.0:1773851868.990074:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.990075:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637139832828032 : -106933876723584 : ffff9ebe84437080)
00000100:00000001:28.0:1773851868.990075:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851868.990076:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000061cdc96b x1858043874693440/t0(0) o400->6fb47d26-2d9a-4c98-bfc4-3a64d1565a1e@22066@kfi7:656/0 lens 224/0 e 0 to 0 dl 1773852016 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1865-0'
00000100:00000001:31.0:1773851868.990079:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851868.990079:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851868.990080:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061cdc96b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6fb47d26-2d9a-4c98-bfc4-3a64d1565a1e+5:39681:x1858043874693440:12345-22066@kfi7:400:default-tuolumne1865-0
00000100:00000200:31.0:1773851868.990083:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043874693440
00000020:00000001:31.0:1773851868.990084:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851868.990085:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851868.990085:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.990086:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851868.990087:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851868.990087:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851868.990088:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043874693440, found 0 last_xid 1858043874693439
00000020:00000001:31.0:1773851868.990089:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851868.990089:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851868.990090:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851868.990090:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.990091:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851868.990092:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851868.990092:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851868.990093:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000013c4fc80.
02000000:00000001:31.0:1773851868.990094:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.990094:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.990095:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851868.990095:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183083472807, transno 0, xid 1858043874693440
00010000:00000001:31.0:1773851868.990096:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851868.990097:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000061cdc96b x1858043874693440/t0(0) o400->6fb47d26-2d9a-4c98-bfc4-3a64d1565a1e@22066@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1865-0'
00010000:00000001:31.0:1773851868.990100:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851868.990100:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851868.990101:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=101 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851868.990102:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851868.990103:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004e0ad591 refcount 3 to 22066@kfi7
00000100:00000001:31.0:1773851868.990103:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232978944 : -107130476572672 : ffff9e90bdffd000)
02000000:00000001:31.0:1773851868.990104:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851868.990105:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851868.990105:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851868.990106:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22259@kfi7
00000400:00000010:31.0:1773851868.990107:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000819b29f0.
00000100:00000200:31.0:1773851868.990108:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043874693440, offset 224
00000400:00000200:31.0:1773851868.990109:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22259@kfi7
00000400:00000200:31.0:1773851868.990110:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22259@kfi7 to cpt 7
00000400:00000200:31.0:1773851868.990111:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000407bd16c nid 22259@kfi7 refs 1
00000400:00000200:31.0:1773851868.990112:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000407bd16c nid 22259@kfi7 refs 2
00000400:00000200:31.0:1773851868.990113:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000407bd16c nid 22259@kfi7 refs 3
00000400:00000200:31.0:1773851868.990114:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22259@kfi7 local destination
00000400:00000200:31.0:1773851868.990116:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769293:8769293:1024:4294967295] 22259@kfi7 LPNI seq info [1504880:1504880:16:4294967295]
00000400:00000200:31.0:1773851868.990117:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000407bd16c nid 22259@kfi7 refs 2
00000400:00000200:31.0:1773851868.990118:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22259@kfi7 to cpt 7
00000400:00000200:31.0:1773851868.990119:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22259@kfi7(22259@kfi7:22259@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851868.990121:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000407bd16c nid 22259@kfi7 refs 3
00000800:00000200:31.0:1773851868.990122:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851868.990123:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851868.990125:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851868.990127:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa3b Using peer 22259@kfi7(0xa3b)
00000800:00000200:31.0:1773851868.990130:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0xa3b: rc=0
00000800:00000200:31.0:1773851868.990131:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa3b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851868.990133:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851868.990134:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004e0ad591 refcount 2 to 22066@kfi7
00010000:00000001:31.0:1773851868.990135:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851868.990135:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851868.990136:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851868.990137:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061cdc96b x1858043874693440/t0(0) o400->6fb47d26-2d9a-4c98-bfc4-3a64d1565a1e@22066@kfi7:656/0 lens 224/224 e 0 to 0 dl 1773852016 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1865-0'
00000100:00100000:31.0:1773851868.990140:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061cdc96b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6fb47d26-2d9a-4c98-bfc4-3a64d1565a1e+5:39681:x1858043874693440:12345-22066@kfi7:400:default-tuolumne1865-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851868.990143:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22066@kfi7, seq: 2055526
00000100:00000040:31.0:1773851868.990144:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002201cff3 : new rpc_count 0
00000100:00000001:31.0:1773851868.990144:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851868.990144:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa3b TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851868.990145:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851868.990145:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851868.990145:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851868.990146:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bcd0c99c.
00000400:00000200:29.0:1773851868.990146:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22259@kfi7: PUT: OK
00000020:00000010:31.0:1773851868.990147:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009fd8e64.
00000400:00000200:29.0:1773851868.990147:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000819b29f0
00000020:00000040:31.0:1773851868.990148:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000002201cff3 : new refcount 4
00000100:00000001:31.0:1773851868.990148:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851868.990148:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000819b29f0.
00000100:00000001:29.0:1773851868.990148:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851868.990149:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851868.990150:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000407bd16c nid 22259@kfi7 refs 2
00000800:00000200:29.0:1773851868.990151:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 22259@kfi7(000000005e983cdd):0x0 lsk 2620 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa3b Transaction freed
00000004:00000001:10.0:1773851869.001729:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851869.001730:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851869.001730:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851869.001730:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:3.0F:1773851869.001730:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:11.0:1773851869.001731:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cd342c1.
00000100:00000010:10.0:1773851869.001731:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eba50e83.
00000020:00000040:10.0:1773851869.001731:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000004:00000020:3.0:1773851869.001731:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:11.0:1773851869.001732:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000100:00000001:10.0:1773851869.001732:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:3.0:1773851869.001732:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000086b1f0ba.
00000100:00000001:11.0:1773851869.001733:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851869.001733:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851869.001733:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:3.0:1773851869.001733:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000004:00000001:15.0:1773851869.001734:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
02000000:00000001:11.0:1773851869.001734:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851869.001734:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851869.001734:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:3.0:1773851869.001734:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:15.0:1773851869.001735:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000010:11.0:1773851869.001735:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000019672f28.
02000000:00000010:10.0:1773851869.001735:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000da635257.
02000000:00000001:3.0:1773851869.001735:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:15.0:1773851869.001736:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000059918df.
00000100:00000001:11.0:1773851869.001736:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851869.001736:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851869.001736:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000de9a932d.
00000020:00000040:15.0:1773851869.001737:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:11.0:1773851869.001737:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851869.001737:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851869.001737:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851869.001737:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851869.001738:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851869.001738:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:15.0:1773851869.001739:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000040:11.0:1773851869.001739:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007cd342c1] to pc [ptlrpcd_02_01+1]  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851869.001739:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000eba50e83] to pc [ptlrpcd_02_00+0]  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851869.001739:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851869.001740:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:3.0:1773851869.001740:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000086b1f0ba] to pc [ptlrpcd_00_01+1]  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:15.0:1773851869.001741:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:15.0:1773851869.001743:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d4dd8393.
00080000:00000001:11.0:1773851869.001743:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851869.001743:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851869.001743:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851869.001744:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851869.001744:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851869.001744:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:3.0:1773851869.001744:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:15.0:1773851869.001745:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:11.0:1773851869.001745:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004668d09d.
00080000:00000010:10.0:1773851869.001745:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000da8f4922.
00000100:00000001:9.0:1773851869.001745:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:8.0:1773851869.001745:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:3.0:1773851869.001745:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000001093bef2.
00000100:00000001:2.0:1773851869.001745:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:15.0:1773851869.001746:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:11.0:1773851869.001746:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637046722491392 : -107026987060224 : ffff9ea8d6747400)
00080000:00000001:10.0:1773851869.001746:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636953080662016 : -107120628889600 : ffff9e9308f78800)
00000100:00000001:9.0:1773851869.001746:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:3.0:1773851869.001746:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637166814475264 : -106906895076352 : ffff9ec4cc7eb400)
00000100:00000001:2.0:1773851869.001746:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851869.001746:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851869.001746:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851869.001747:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851869.001747:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:9.0:1773851869.001747:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:3.0:1773851869.001747:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:2.0:1773851869.001747:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851869.001747:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.001748:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851869.001748:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851869.001748:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001748:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:3.0:1773851869.001748:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851869.001749:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00001000:10.0:1773851869.001749:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00000100:00000001:9.0:1773851869.001749:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851869.001749:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851869.001749:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:3.0:1773851869.001749:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000100:00000040:15.0:1773851869.001750:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000059918df] to pc [ptlrpcd_03_01+1]  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:11.0:1773851869.001750:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009a03043b.
00000004:00000010:10.0:1773851869.001750:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002a7affa1.
00000100:00000001:9.0:1773851869.001750:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851869.001750:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:3.0:1773851869.001750:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ef1db379.
00000100:00000001:2.0:1773851869.001750:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:9.0:1773851869.001751:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851869.001751:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851869.001751:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051928896:31@kfi7:13:default-yuba2-0
00000004:00080000:3.0:1773851869.001751:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614143455026844ns, next at 614144455025341ns, rc = 0
00000100:00000001:2.0:1773851869.001751:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:11.0:1773851869.001752:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614143455027164ns, next at 614144455025742ns, rc = 0
00000004:00080000:10.0:1773851869.001752:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614143455027134ns, next at 614144455025722ns, rc = 0
00000100:00100000:9.0:1773851869.001752:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051928960:6@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851869.001752:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:3.0:1773851869.001752:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:2.0:1773851869.001752:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:2.0:1773851869.001752:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851869.001753:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851869.001753:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851869.001753:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851869.001753:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851869.001753:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851869.001753:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000086b1f0ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051929024:2095@kfi7:13:default-yuba2-0
00080000:00000001:11.0:1773851869.001754:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851869.001754:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851869.001754:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.001754:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851869.001754:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851869.001754:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851869.001754:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006f63178d.
00000004:00000001:3.0:1773851869.001754:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851869.001755:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851869.001755:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851869.001755:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851869.001755:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851869.001755:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:2.0:1773851869.001755:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:9.0:1773851869.001756:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000082699907.
00000400:00000200:8.0:1773851869.001756:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
02000000:00000001:2.0:1773851869.001756:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851869.001757:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851869.001757:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000007d88ff4.
00000400:00000010:8.0:1773851869.001757:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
02000000:00000001:2.0:1773851869.001757:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:2.0:1773851869.001757:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d3421c59.
00080000:00000001:15.0:1773851869.001758:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:14.0:1773851869.001758:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851869.001758:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
02000000:00000001:2.0:1773851869.001758:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851869.001759:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851869.001759:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:9.0:1773851869.001759:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fd3d2370.
00000400:00000010:9.0:1773851869.001759:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f232fba1.
00000100:00000200:8.0:1773851869.001759:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928896, portal 4
00000100:00000001:8.0:1773851869.001759:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:2.0:1773851869.001759:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:14.0:1773851869.001760:0:41073:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:12.0:1773851869.001760:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001760:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637043610181248 : -107030099370368 : ffff9ea81cf25e80)
00000400:00000010:2.0:1773851869.001760:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00080000:00000010:15.0:1773851869.001761:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000babb6948.
00000100:00000040:14.0:1773851869.001761:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851869.001761:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051928960, portal 4
00000100:00000001:9.0:1773851869.001761:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:8.0:1773851869.001761:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:2.0:1773851869.001761:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000182753b4.
00080000:00000001:15.0:1773851869.001762:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637128598685696 : -106945110865920 : ffff9ebbe6a80800)
00000100:00000001:9.0:1773851869.001762:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889187328 : -106993820364288 : ffff9eb08f581200)
00000100:00000200:2.0:1773851869.001762:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929024, portal 4
00080000:00000001:15.0:1773851869.001763:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:9.0:1773851869.001763:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851869.001763:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:2.0:1773851869.001763:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851869.001763:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288716288 : -106964420835328 : ffff9eb767b14800)
00000100:00000040:8.0:1773851869.001764:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000100:00000001:14.0:1773851869.001765:0:41073:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000010:8.0:1773851869.001765:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000369ff48e.
00000100:00000200:8.0:1773851869.001765:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928896, offset 0
00000100:00000040:2.0:1773851869.001765:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:15.0:1773851869.001766:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851869.001766:0:41073:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.001766:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000004:00001000:15.0:1773851869.001767:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
02000000:00000001:14.0:1773851869.001767:0:41073:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:9.0:1773851869.001767:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:9.0:1773851869.001767:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000016999e1e.
00000400:00000200:8.0:1773851869.001767:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000004:00000010:15.0:1773851869.001768:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000983312aa.
00000100:00000200:9.0:1773851869.001768:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051928960, offset 0
00000400:00000200:8.0:1773851869.001768:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:8.0:1773851869.001768:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000004:00080000:15.0:1773851869.001769:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614143455045058ns, next at 614144455043185ns, rc = 0
02000000:00000001:14.0:1773851869.001769:0:41073:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851869.001769:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000400:00000200:8.0:1773851869.001769:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00100000:14.0:1773851869.001770:0:41073:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000059918df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051929088:54@kfi7:13:default-yuba2-0
00000100:00000001:2.0:1773851869.001770:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00080000:00000001:15.0:1773851869.001771:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:8.0:1773851869.001771:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000100:00000040:2.0:1773851869.001771:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000100:00000001:14.0:1773851869.001772:0:41073:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:8.0:1773851869.001772:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000010:2.0:1773851869.001772:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ce94699.
00080000:00000001:15.0:1773851869.001773:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851869.001773:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851869.001773:0:41073:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:2.0:1773851869.001773:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929024, offset 0
02000000:00000001:14.0:1773851869.001774:0:41073:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851869.001774:0:41073:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:8.0:1773851869.001774:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769293, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769290, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851869.001774:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
02000000:00000010:14.0:1773851869.001776:0:41073:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
00000400:00000200:8.0:1773851869.001776:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851869.001776:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851869.001776:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
02000000:00000001:14.0:1773851869.001777:0:41073:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851869.001777:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000200:2.0:1773851869.001777:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:14.0:1773851869.001778:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851869.001778:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769294:8769294:1024:4294967295] 31@kfi7 LPNI seq info [5403618:5403618:16:4294967295]
00000400:00000200:2.0:1773851869.001778:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000010:14.0:1773851869.001779:0:41073:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000400:00000200:2.0:1773851869.001779:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000010:14.0:1773851869.001780:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000400:00000200:8.0:1773851869.001780:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851869.001780:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:9.0:1773851869.001781:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:8.0:1773851869.001781:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000200:14.0:1773851869.001782:0:41073:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929088, portal 4
00000400:00000200:9.0:1773851869.001782:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:2.0:1773851869.001782:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769293, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769294, p:4294967295, g:4294967295, h:1000]
00000100:00000001:14.0:1773851869.001783:0:41073:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:14.0:1773851869.001783:0:41073:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860195328 : -107049849356288 : ffff9ea383c18000)
00000400:00000200:9.0:1773851869.001783:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:8.0:1773851869.001784:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851869.001784:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851869.001785:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:8.0:1773851869.001785:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:2.0:1773851869.001785:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:14.0:1773851869.001786:0:41073:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851869.001786:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000200:2.0:1773851869.001786:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000800:00000200:8.0:1773851869.001787:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851869.001788:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769295, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769294, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851869.001788:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:2.0:1773851869.001788:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769295:8769295:1024:4294967295] 2095@kfi7 LPNI seq info [5406042:5406042:16:4294967295]
00000100:00000001:14.0:1773851869.001789:0:41073:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:2.0:1773851869.001789:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000040:14.0:1773851869.001790:0:41073:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000010:14.0:1773851869.001790:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000629bef0.
00000400:00000200:9.0:1773851869.001790:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000200:14.0:1773851869.001791:0:41073:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929088, offset 0
00000400:00000200:9.0:1773851869.001791:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851869.001791:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:2.0:1773851869.001791:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851869.001792:0:41073:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:9.0:1773851869.001792:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:9.0:1773851869.001793:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769296:8769296:1023:4294967295] 6@kfi7 LPNI seq info [5405031:5405031:16:4294967295]
00000800:00000200:8.0:1773851869.001793:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Using peer 31@kfi7(0x200000000000560)
00000400:00000200:14.0:1773851869.001794:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:2.0:1773851869.001794:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851869.001795:0:41073:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:9.0:1773851869.001795:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:14.0:1773851869.001796:0:41073:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851869.001796:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:8.0:1773851869.001796:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x200000000000560: rc=0
00000400:00000200:2.0:1773851869.001796:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:14.0:1773851869.001797:0:41073:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:14.0:1773851869.001798:0:41073:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000800:00000200:8.0:1773851869.001798:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851869.001798:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:9.0:1773851869.001799:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851869.001800:0:41073:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769296, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769294, p:4294967295, g:4294967295, h:1000]
00000100:00000001:8.0:1773851869.001800:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001800:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:2.0:1773851869.001800:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851869.001801:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:8.0:1773851869.001801:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001802:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001802:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851869.001803:0:41073:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:9.0:1773851869.001803:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851869.001803:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:2.0:1773851869.001803:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:14.0:1773851869.001804:0:41073:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:9.0:1773851869.001804:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851869.001804:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:14.0:1773851869.001805:0:41073:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:14.0:1773851869.001806:0:41073:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769297:8769297:1023:4294967295] 54@kfi7 LPNI seq info [5403922:5403922:16:4294967295]
00000100:00000001:8.0:1773851869.001806:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851869.001806:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:2.0:1773851869.001806:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000800:00000200:9.0:1773851869.001807:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:14.0:1773851869.001808:0:41073:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:14.0:1773851869.001810:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:9.0:1773851869.001810:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Using peer 6@kfi7(0x54b)
00000100:00000001:8.0:1773851869.001810:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851869.001810:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000004991649e: Posted send of 324 bytes to peer 0x5c0: rc=0
00000100:00000001:8.0:1773851869.001811:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851869.001812:0:41073:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000800:00000200:11.0:1773851869.001812:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_EVENT_TX_OK event status 0
00000800:00000200:2.0:1773851869.001812:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851869.001814:0:41073:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000800:00000200:9.0:1773851869.001814:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x54b: rc=0
00000400:00000200:11.0:1773851869.001815:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:14.0:1773851869.001816:0:41073:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:9.0:1773851869.001816:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851869.001817:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000100:00000001:2.0:1773851869.001817:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851869.001818:0:41073:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851869.001818:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000369ff48e
00000100:00000001:2.0:1773851869.001818:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000010:11.0:1773851869.001819:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000369ff48e.
00000100:00000001:9.0:1773851869.001819:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851869.001819:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851869.001820:0:41073:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851869.001820:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851869.001820:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851869.001821:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851869.001821:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.001821:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851869.001821:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:11.0:1773851869.001822:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851869.001822:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851869.001822:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:14.0:1773851869.001823:0:41073:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000100:00000001:2.0:1773851869.001823:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:1.0:1773851869.001823:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851869.001824:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851869.001824:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851869.001824:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851869.001824:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851869.001825:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:2.0:1773851869.001825:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851869.001825:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851869.001826:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:10.0:1773851869.001826:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851869.001826:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851869.001826:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851869.001826:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851869.001826:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000100:00000001:9.0:1773851869.001827:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851869.001827:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ce94699
00000800:00000200:14.0:1773851869.001828:0:41073:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000bbed2221: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000400:00000200:10.0:1773851869.001828:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851869.001828:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:1.0:1773851869.001828:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ce94699.
00000100:00000001:11.0:1773851869.001829:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851869.001829:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:1.0:1773851869.001829:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:14.0:1773851869.001830:0:41073:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851869.001830:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:10.0:1773851869.001830:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000400:00000200:10.0:1773851869.001831:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000016999e1e
00000100:00000200:1.0:1773851869.001831:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851869.001832:0:41073:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851869.001832:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000016999e1e.
00000100:00000001:10.0:1773851869.001832:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:14.0:1773851869.001833:0:41073:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:11.0:1773851869.001833:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Transaction freed
00000100:00000001:14.0:1773851869.001834:0:41073:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851869.001834:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851869.001836:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851869.001837:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851869.001837:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:14.0:1773851869.001838:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:1.0:1773851869.001838:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851869.001839:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851869.001839:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:14.0:1773851869.001840:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:10.0:1773851869.001840:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851869.001841:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:14.0:1773851869.001841:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851869.001842:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851869.001842:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851869.001843:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851869.001843:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:1.0:1773851869.001843:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851869.001844:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:13.0:1773851869.001845:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851869.001845:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:13.0:1773851869.001846:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000800:00000200:10.0:1773851869.001846:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Transaction freed
00000400:00000200:1.0:1773851869.001846:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:13.0:1773851869.001847:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000629bef0
00000400:00000010:13.0:1773851869.001848:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000629bef0.
00000100:00000001:13.0:1773851869.001849:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:1.0:1773851869.001849:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000100:00000200:13.0:1773851869.001851:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851869.001855:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:13.0:1773851869.001856:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:2.0:1773851869.001859:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00000001:13.0:1773851869.001860:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851869.001860:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851869.001861:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:13.0:1773851869.001861:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:31.0:1773851869.001862:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851869.001862:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:13.0:1773851869.001862:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000800:00000200:2.0:1773851869.001862:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851869.001863:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851869.001864:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851869.001864:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000800:00000200:18.0:1773851869.001865:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851869.001865:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:31.0:1773851869.001867:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:18.0:1773851869.001867:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851869.001867:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:31.0:1773851869.001869:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:2.0:1773851869.001869:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:18.0:1773851869.001870:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:18.0:1773851869.001871:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:2.0:1773851869.001871:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:31.0:1773851869.001872:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:2.0:1773851869.001872:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:31.0:1773851869.001873:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:18.0:1773851869.001873:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:2.0:1773851869.001873:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:18.0:1773851869.001874:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:2.0:1773851869.001874:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:31.0:1773851869.001875:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:31.0:1773851869.001876:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:18.0:1773851869.001876:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:2.0:1773851869.001876:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:31.0:1773851869.001877:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:2.0:1773851869.001877:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:18.0:1773851869.001878:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851869.001878:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3980
00000400:00000200:31.0:1773851869.001879:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:18.0:1773851869.001879:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:31.0:1773851869.001880:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:2.0:1773851869.001880:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:18.0:1773851869.001881:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:31.0:1773851869.001882:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b39c0
00000400:00000200:18.0:1773851869.001882:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3940
00000400:00000200:2.0:1773851869.001882:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71d7e1 [1] + 224
00000400:00000200:31.0:1773851869.001883:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:18.0:1773851869.001884:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:2.0:1773851869.001884:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851869.001885:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x7800809bd [1] + 224
00000400:00000200:18.0:1773851869.001886:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f12d1 [1] + 224
00000800:00000200:13.0:1773851869.001886:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:2.0:1773851869.001886:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:31.0:1773851869.001888:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851869.001888:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851869.001888:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:2.0:1773851869.001888:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000800:00000200:13.0:1773851869.001889:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:2.0:1773851869.001889:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:31.0:1773851869.001890:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851869.001890:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:2.0:1773851869.001891:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851869.001892:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:18.0:1773851869.001892:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000800:00000200:13.0:1773851869.001892:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:18.0:1773851869.001893:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851869.001894:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:18.0:1773851869.001894:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851869.001894:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000040:2.0:1773851869.001895:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851869.001896:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851869.001896:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000200:13.0:1773851869.001897:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000040:18.0:1773851869.001898:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851869.001898:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000100:00000040:31.0:1773851869.001899:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851869.001899:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.001900:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:2.0:1773851869.001900:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851869.001901:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:2.0:1773851869.001901:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000001:18.0:1773851869.001902:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851869.001902:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:18.0:1773851869.001903:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:9.0:1773851869.001903:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:2.0:1773851869.001903:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851869.001904:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3a00
00000100:00000001:9.0:1773851869.001904:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851869.001905:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:18.0:1773851869.001905:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000001:9.0:1773851869.001905:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851869.001905:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851869.001906:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:13.0:1773851869.001906:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000001:9.0:1773851869.001906:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851869.001906:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:8.0:1773851869.001907:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:31.0:1773851869.001908:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002809a79a: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851869.001908:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f618d [1] + 224
00000400:00000010:9.0:1773851869.001908:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fd3d2370.
00000400:00000001:8.0:1773851869.001908:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:9.0:1773851869.001909:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f232fba1
00000400:00000010:8.0:1773851869.001909:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000007d88ff4.
00000100:00000001:0.0:1773851869.001909:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:13.0:1773851869.001910:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:9.0:1773851869.001910:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f232fba1.
00000400:00000200:8.0:1773851869.001910:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000100:00000001:0.0:1773851869.001910:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851869.001911:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:8.0:1773851869.001911:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000400:00000200:13.0:1773851869.001912:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851869.001912:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:0.0:1773851869.001912:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:13.0:1773851869.001913:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000100:00000200:9.0:1773851869.001913:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851869.001913:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:0.0:1773851869.001913:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:0.0:1773851869.001914:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000100:00000001:13.0:1773851869.001915:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:0.0:1773851869.001915:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000182753b4
00000100:00000200:13.0:1773851869.001916:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:0.0:1773851869.001917:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000182753b4.
00000100:00000001:0.0:1773851869.001918:0:41061:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851869.001919:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851869.001919:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:13.0:1773851869.001920:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:0.0:1773851869.001920:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851869.001924:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851869.001924:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851869.001924:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851869.001925:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851869.001925:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:9.0:1773851869.001925:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851869.001925:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851869.001926:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851869.001926:0:41069:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:8.0:1773851869.001926:0:41068:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:13.0:1773851869.001927:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:9.0:1773851869.001927:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:8.0:1773851869.001927:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:0.0:1773851869.001927:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:14.0:1773851869.001928:0:41073:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:9.0:1773851869.001928:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851869.001928:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000001:14.0:1773851869.001929:0:41073:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:14.0:1773851869.001929:0:41073:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000100:00000001:9.0:1773851869.001929:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001929:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851869.001930:0:41073:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
02000000:00000001:9.0:1773851869.001930:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851869.001930:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:14.0:1773851869.001931:0:41073:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000100:00001000:8.0:1773851869.001931:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=102 v=66 (66 66 66 66)
00000100:00000001:14.0:1773851869.001932:0:41073:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:9.0:1773851869.001932:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=102 v=66 (66 66 66 66)
00000100:00000001:0.0:1773851869.001932:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:0.0:1773851869.001932:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:14.0:1773851869.001933:0:41073:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851869.001933:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=102 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851869.001934:0:41061:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:8.0:1773851869.001935:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:0.0:1773851869.001935:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851869.001936:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851869.001936:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:9.0:1773851869.001937:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=17 v=66 (1 1 1 1)
00010000:00000001:8.0:1773851869.001937:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:0.0:1773851869.001937:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851869.001938:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851869.001938:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.001939:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851869.001939:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:14.0:1773851869.001940:0:41073:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851869.001940:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851869.001940:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00001000:0.0:1773851869.001940:0:41061:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=102 v=66 (66 66 66 66)
00010000:00000001:9.0:1773851869.001941:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851869.001941:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:14.0:1773851869.001942:0:41073:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:9.0:1773851869.001942:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001942:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851869.001942:0:41061:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=102 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851869.001943:0:41073:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851869.001943:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:14.0:1773851869.001944:0:41073:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:9.0:1773851869.001944:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000040:8.0:1773851869.001944:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:0.0:1773851869.001944:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:14.0:1773851869.001945:0:41073:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851869.001945:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:0.0:1773851869.001945:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851869.001946:0:41073:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851869.001946:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851869.001946:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00010000:00000001:0.0:1773851869.001946:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:14.0:1773851869.001947:0:41073:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851869.001947:0:41073:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851869.001948:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:5.0:1773851869.001948:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00010000:00000001:0.0:1773851869.001948:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851869.001949:0:41073:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=102 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851869.001949:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:5.0:1773851869.001949:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:14.0:1773851869.001950:0:41073:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=102 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851869.001950:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851869.001950:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:8.0:1773851869.001951:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:0.0:1773851869.001951:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000001:14.0:1773851869.001952:0:41073:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:14.0:1773851869.001952:0:41073:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851869.001952:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:0.0:1773851869.001952:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00010000:00000001:14.0:1773851869.001953:0:41073:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:9.0:1773851869.001953:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:5.0:1773851869.001953:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:0.0:1773851869.001953:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:14.0:1773851869.001954:0:41073:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:8.0:1773851869.001954:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000100:00000001:14.0:1773851869.001955:0:41073:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851869.001955:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000040:8.0:1773851869.001955:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666717696 avail=351645476864 avail_mb=1373615144 hwm_mb=3131103 files=372237932 ffree=343424529 state=0: rc = 0
00000100:00000040:0.0:1773851869.001955:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:14.0:1773851869.001956:0:41073:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:9.0:1773851869.001956:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851869.001956:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12497@kfi7 to cpt 1
00000100:00000001:14.0:1773851869.001957:0:41073:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:9.0:1773851869.001957:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:14.0:1773851869.001958:0:41073:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:9.0:1773851869.001958:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000004:00000020:8.0:1773851869.001958:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666717696 free, 351645476864 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237932 files, 343424529 free files
00000400:00000200:5.0:1773851869.001958:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12497@kfi7 : PUT - for me
00000100:00000040:14.0:1773851869.001959:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:9.0:1773851869.001960:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420290048 avail=351417816064 avail_mb=1372725844 hwm_mb=3131103 files=372009027 ffree=343183877 state=0: rc = 0
00000400:00000200:5.0:1773851869.001960:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12497@kfi7 to cpt 1
00000100:00000001:0.0:1773851869.001960:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:8.0:1773851869.001961:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851869.001961:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000023fdc83b nid 12497@kfi7 refs 1
00000100:00000001:14.0:1773851869.001962:0:41073:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:0.0:1773851869.001962:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000020:9.0:1773851869.001963:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420290048 free, 351417816064 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372009027 files, 343183877 free files
00000100:00000040:8.0:1773851869.001963:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851869.001963:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12497@kfi7 to cpt 1
00000100:00000001:0.0:1773851869.001963:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851869.001964:0:41073:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:5.0:1773851869.001964:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000023fdc83b nid 12497@kfi7 refs 2
00000004:00000001:0.0:1773851869.001964:0:41061:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:14.0:1773851869.001965:0:41073:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851869.001965:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000023fdc83b nid 12497@kfi7 refs 3
00000004:00000001:14.0:1773851869.001966:0:41073:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:9.0:1773851869.001966:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:0.0:1773851869.001966:0:41061:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000004:00000040:14.0:1773851869.001967:0:41073:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000400:00000200:5.0:1773851869.001967:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12497@kfi7 to cpt 1
00000004:00000040:0.0:1773851869.001967:0:41061:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449320448 avail=351446755328 avail_mb=1372838888 hwm_mb=3131103 files=372160992 ffree=343212227 state=0: rc = 0
00000004:00000040:14.0:1773851869.001968:0:41073:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524105216 avail=351521356800 avail_mb=1373130300 hwm_mb=3131103 files=372113924 ffree=343285259 state=0: rc = 0
00000100:00000040:9.0:1773851869.001968:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851869.001968:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12497@kfi7 of length 224 into portal 12 MB=0x69b4b8d20e680
00000100:00100000:8.0:1773851869.001969:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eba50e83 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051928896:31@kfi7:13:default-yuba2-0
00000400:00000200:5.0:1773851869.001970:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12497@kfi7 of length 224/224 into md 0x793926dc5 [64] + 136792
00000004:00000020:14.0:1773851869.001971:0:41073:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524105216 free, 351521356800 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113924 files, 343285259 free files
00000004:00000020:0.0:1773851869.001971:0:41061:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449320448 free, 351446755328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160992 files, 343212227 free files
00000100:00000001:8.0:1773851869.001972:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:14.0:1773851869.001973:0:41073:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001973:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:14.0:1773851869.001974:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851869.001974:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051928960:6@kfi7:13:default-yuba2-0
00000100:00000040:8.0:1773851869.001974:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000eba50e83 x1859433051928896/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:5.0:1773851869.001974:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000001:0.0:1773851869.001975:0:41061:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.001977:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851869.001977:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:0.0:1773851869.001977:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851869.001978:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851869.001979:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007cd342c1 x1859433051928960/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851869.001979:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000200:5.0:1773851869.001979:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12497@kfi7: PUT: OK
02000000:00000001:8.0:1773851869.001980:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:5.0:1773851869.001980:0:2507993:0:(events.c:307:request_in_callback()) Process entered
02000000:00000010:8.0:1773851869.001981:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006f63178d.
00000100:00000200:5.0:1773851869.001981:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00100000:14.0:1773851869.001982:0:41073:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000059918df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051929088:54@kfi7:13:default-yuba2-0
00000100:00000010:5.0:1773851869.001982:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0b1085e.
00000100:00100000:0.0:1773851869.001982:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000086b1f0ba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051929024:2095@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851869.001983:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:9.0:1773851869.001984:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:8.0:1773851869.001984:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:5.0:1773851869.001984:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a0b1085e x1859598652860032 msgsize 224
00000100:00000001:14.0:1773851869.001985:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:9.0:1773851869.001985:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000040:8.0:1773851869.001985:0:41068:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:0.0:1773851869.001985:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851869.001986:0:41073:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:14.0:1773851869.001986:0:41073:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000059918df x1859433051929088/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:9.0:1773851869.001986:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000082699907.
00000020:00000001:8.0:1773851869.001986:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00100000:5.0:1773851869.001986:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12497@kfi7 (source: 12345-12497@kfi7)
02000000:00000010:8.0:1773851869.001987:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000da635257.
00000100:00000001:0.0:1773851869.001987:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:9.0:1773851869.001988:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851869.001988:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:5.0:1773851869.001988:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000040:0.0:1773851869.001988:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000086b1f0ba x1859433051929024/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:9.0:1773851869.001989:0:41069:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
02000000:00000001:8.0:1773851869.001989:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:14.0:1773851869.001990:0:41073:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:14.0:1773851869.001990:0:41073:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:9.0:1773851869.001990:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:8.0:1773851869.001990:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000400:00000200:5.0:1773851869.001990:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000023fdc83b nid 12497@kfi7 refs 2
02000000:00000010:14.0:1773851869.001991:0:41073:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
02000000:00000010:9.0:1773851869.001991:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000019672f28.
00000100:00000010:8.0:1773851869.001991:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eba50e83.
02000000:00000001:9.0:1773851869.001992:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851869.001992:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000800:00000200:5.0:1773851869.001992:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851869.001993:0:41073:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:14.0:1773851869.001993:0:41073:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:9.0:1773851869.001993:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:8.0:1773851869.001993:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851869.001993:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000040:14.0:1773851869.001994:0:41073:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000100:00000010:9.0:1773851869.001994:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cd342c1.
00000100:00000001:8.0:1773851869.001994:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:0.0:1773851869.001994:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:14.0:1773851869.001995:0:41073:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:14.0:1773851869.001995:0:41073:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d4dd8393.
00000100:00000001:9.0:1773851869.001995:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851869.001995:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:0.0:1773851869.001995:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d3421c59.
02000000:00000001:14.0:1773851869.001996:0:41073:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:9.0:1773851869.001996:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851869.001996:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.001996:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851869.001997:0:41073:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:9.0:1773851869.001997:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851869.001997:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:5.0:1773851869.001997:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
02000000:00000001:0.0:1773851869.001997:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:0.0:1773851869.001997:0:41061:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000010:14.0:1773851869.001998:0:41073:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000059918df.
00000100:00000001:9.0:1773851869.001998:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851869.001998:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851869.001998:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.001998:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000040:0.0:1773851869.001998:0:41061:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000100:00000001:14.0:1773851869.001999:0:41073:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851869.001999:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851869.001999:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851869.001999:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:14.0:1773851869.002000:0:41073:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851869.002000:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851869.002000:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851869.002000:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851869.002000:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000de9a932d.
00000100:00000001:14.0:1773851869.002001:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00100000:5.0:1773851869.002001:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598652860032
00000100:00000001:14.0:1773851869.002002:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851869.002002:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000001:5.0:1773851869.002002:0:61015:0:(genops.c:802:class_conn2export()) Process entered
02000000:00000001:0.0:1773851869.002002:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:14.0:1773851869.002003:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:5.0:1773851869.002003:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ede8
00000020:00000001:5.0:1773851869.002003:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
02000000:00000001:0.0:1773851869.002003:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:0.0:1773851869.002004:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086b1f0ba.
00000020:00000040:5.0:1773851869.002005:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000baa0f9ea refcount=5
00000100:00000001:0.0:1773851869.002005:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000020:00000001:5.0:1773851869.002006:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106844125184 : -106966865426432 : ffff9eb6d5fbc800)
00000100:00000001:0.0:1773851869.002006:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851869.002007:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106844125184 : -106966865426432 : ffff9eb6d5fbc800)
00000100:00000001:0.0:1773851869.002007:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851869.002008:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851869.002009:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851869.002010:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:0.0:1773851869.002010:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:5.0:1773851869.002011:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000100:00000001:0.0:1773851869.002011:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000010:5.0:1773851869.002012:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000100:00000001:0.0:1773851869.002012:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:5.0:1773851869.002014:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000057b1c766.
00000100:00000001:5.0:1773851869.002015:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851869.002016:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851869.002017:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851869.002018:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851869.002019:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851869.002020:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.002022:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851869.002024:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851869.002024:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851869.002025:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851869.002025:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851869.002026:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12497@kfi7, seq: 2001923
00000100:00000001:7.0:1773851869.002027:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851869.002027:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000baa0f9ea : new rpc_count 1
00000100:00000001:7.0:1773851869.002028:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.002028:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886765824 : -106955822785792 : ffff9eb9682d1b00)
00000100:00000040:5.0:1773851869.002030:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a0b1085e x1859598652860032/t0(0) o400->99524c6a-14bf-49b0-a299-a6d1c1609d5f@12497@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1265-0'
00000100:00000001:5.0:1773851869.002034:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851869.002035:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851869.002036:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0b1085e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:99524c6a-14bf-49b0-a299-a6d1c1609d5f+5:39603:x1859598652860032:12345-12497@kfi7:400:default-tuolumne1265-0
00000100:00000200:5.0:1773851869.002038:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598652860032
00000020:00000001:5.0:1773851869.002039:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851869.002040:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851869.002041:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851869.002042:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851869.002043:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851869.002044:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851869.002044:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598652860032, found 0 last_xid 1859598652860031
00000020:00000001:5.0:1773851869.002046:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851869.002046:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851869.002047:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851869.002048:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851869.002049:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851869.002050:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851869.002051:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851869.002052:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2c1b78f.
02000000:00000001:5.0:1773851869.002053:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.002054:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851869.002055:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851869.002056:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596693, transno 0, xid 1859598652860032
00010000:00000001:5.0:1773851869.002058:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851869.002059:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a0b1085e x1859598652860032/t0(0) o400->99524c6a-14bf-49b0-a299-a6d1c1609d5f@12497@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1265-0'
00010000:00000001:5.0:1773851869.002063:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851869.002064:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851869.002065:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=101 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851869.002066:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851869.002067:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000984c4e55 refcount 3 to 12497@kfi7
00000100:00000001:5.0:1773851869.002069:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740761888 : -107153968789728 : ffff9e8b45c10720)
02000000:00000001:5.0:1773851869.002070:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851869.002071:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.002072:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851869.002073:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12497@kfi7
00000400:00000010:5.0:1773851869.002074:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002d33c725.
00000100:00000200:5.0:1773851869.002075:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598652860032, offset 224
00000400:00000200:5.0:1773851869.002077:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12497@kfi7
00000400:00000200:5.0:1773851869.002078:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12497@kfi7 to cpt 1
00000400:00000200:5.0:1773851869.002079:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000023fdc83b nid 12497@kfi7 refs 1
00000400:00000200:5.0:1773851869.002081:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000023fdc83b nid 12497@kfi7 refs 2
00000400:00000200:5.0:1773851869.002082:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000023fdc83b nid 12497@kfi7 refs 3
00000400:00000200:5.0:1773851869.002084:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12497@kfi7 local destination
00000400:00000200:5.0:1773851869.002086:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769298:8769298:1024:4294967295] 12497@kfi7 LPNI seq info [760814:760814:16:4294967295]
00000400:00000200:5.0:1773851869.002088:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000023fdc83b nid 12497@kfi7 refs 2
00000400:00000200:5.0:1773851869.002089:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12497@kfi7 to cpt 1
00000400:00000200:5.0:1773851869.002092:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12497@kfi7(12497@kfi7:12497@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851869.002094:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000023fdc83b nid 12497@kfi7 refs 3
00000800:00000200:5.0:1773851869.002096:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851869.002098:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851869.002101:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851869.002107:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4cc Using peer 12497@kfi7(0x4cc)
00000800:00000200:5.0:1773851869.002112:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x4cc: rc=0
00000800:00000200:5.0:1773851869.002114:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4cc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851869.002117:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851869.002118:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000984c4e55 refcount 2 to 12497@kfi7
00010000:00000001:5.0:1773851869.002119:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851869.002120:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851869.002121:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851869.002122:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0b1085e x1859598652860032/t0(0) o400->99524c6a-14bf-49b0-a299-a6d1c1609d5f@12497@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1265-0'
00000100:00100000:5.0:1773851869.002127:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0b1085e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:99524c6a-14bf-49b0-a299-a6d1c1609d5f+5:39603:x1859598652860032:12345-12497@kfi7:400:default-tuolumne1265-0 Request processed in 92us (142us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851869.002130:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4cc TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851869.002130:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12497@kfi7, seq: 2001923
00000100:00000040:5.0:1773851869.002131:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000baa0f9ea : new rpc_count 0
00000100:00000001:5.0:1773851869.002132:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851869.002133:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851869.002133:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851869.002134:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12497@kfi7: PUT: OK
00000020:00000010:5.0:1773851869.002134:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851869.002135:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002d33c725
00000020:00000010:5.0:1773851869.002135:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000057b1c766.
00000400:00000010:6.0:1773851869.002136:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002d33c725.
00000020:00000010:5.0:1773851869.002136:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000100:00000001:6.0:1773851869.002137:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851869.002138:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:5.0:1773851869.002138:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000baa0f9ea : new refcount 4
00000400:00000200:6.0:1773851869.002139:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000023fdc83b nid 12497@kfi7 refs 2
00000100:00000001:5.0:1773851869.002139:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851869.002141:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 12497@kfi7(00000000a96f1f17):0x0 lsk 1229 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4cc Transaction freed
00000800:00000200:6.0:1773851869.043498:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851869.043498:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851869.043500:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851869.043502:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851869.043504:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20448@kfi7 to cpt 1
00000400:00000200:6.0:1773851869.043505:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20448@kfi7 : PUT - for me
00000400:00000200:6.0:1773851869.043506:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20448@kfi7 to cpt 1
00000400:00000200:6.0:1773851869.043506:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae8ab68 nid 20448@kfi7 refs 1
00000400:00000200:6.0:1773851869.043507:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20448@kfi7 to cpt 1
00000400:00000200:6.0:1773851869.043508:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae8ab68 nid 20448@kfi7 refs 2
00000400:00000200:6.0:1773851869.043509:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dae8ab68 nid 20448@kfi7 refs 3
00000400:00000200:6.0:1773851869.043510:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20449@kfi7 to cpt 4
00000400:00000200:6.0:1773851869.043510:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20449@kfi7 of length 224 into portal 12 MB=0x699e14918a500
00000400:00000200:6.0:1773851869.043512:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20449@kfi7 of length 224/224 into md 0x793926dc5 [64] + 137016
00000800:00000200:6.0:1773851869.043513:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851869.043515:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851869.043516:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20448@kfi7: PUT: OK
00000100:00000001:6.0:1773851869.043517:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851869.043517:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851869.043518:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000075b1d810.
00000100:00000040:6.0:1773851869.043518:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000075b1d810 x1858042733307136 msgsize 224
00000100:00100000:6.0:1773851869.043520:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-20449@kfi7 (source: 12345-20448@kfi7)
00000100:00000001:6.0:1773851869.043521:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851869.043522:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae8ab68 nid 20448@kfi7 refs 2
00000800:00000200:6.0:1773851869.043523:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851869.043523:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851869.043524:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851869.043525:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851869.043526:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851869.043527:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851869.043528:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042733307136
00000020:00000001:5.0:1773851869.043528:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851869.043529:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92681
00000020:00000001:5.0:1773851869.043532:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851869.043536:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000708efbd5 refcount=6
00000020:00000001:5.0:1773851869.043537:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631273472 : -107123078278144 : ffff9e9276f8d400)
00000020:00000001:5.0:1773851869.043538:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631273472 : -107123078278144 : ffff9e9276f8d400)
00000100:00000001:5.0:1773851869.043539:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851869.043540:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851869.043541:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000020:00000010:5.0:1773851869.043542:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851869.043543:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000057b1c766.
00000100:00000001:5.0:1773851869.043544:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851869.043545:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851869.043545:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851869.043547:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851869.043547:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851869.043548:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.043549:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851869.043551:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851869.043551:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851869.043552:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851869.043552:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851869.043553:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20449@kfi7, seq: 2001924
00000100:00000040:7.0:1773851869.043553:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000708efbd5 : new rpc_count 1
00000100:00000001:5.0:1773851869.043553:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.043554:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814081920 : -107101895469696 : ffff9e976590d580)
00000100:00000001:5.0:1773851869.043554:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851869.043555:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000075b1d810 x1858042733307136/t0(0) o400->5474a155-cba9-43ee-ab9f-99575f44b958@20449@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1759-0'
00000100:00000001:7.0:1773851869.043557:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851869.043558:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851869.043558:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075b1d810 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5474a155-cba9-43ee-ab9f-99575f44b958+6:39819:x1858042733307136:12345-20449@kfi7:400:default-tuolumne1759-0
00000100:00000200:7.0:1773851869.043560:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042733307136
00000020:00000001:7.0:1773851869.043560:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851869.043561:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851869.043561:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.043562:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851869.043562:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851869.043563:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851869.043563:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042733307136, found 0 last_xid 1858042733307135
00000020:00000001:7.0:1773851869.043564:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851869.043565:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851869.043565:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851869.043566:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.043566:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851869.043567:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851869.043567:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851869.043568:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000061854b98.
02000000:00000001:7.0:1773851869.043568:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.043569:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.043569:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851869.043570:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183235289791, transno 0, xid 1858042733307136
00010000:00000001:7.0:1773851869.043570:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851869.043571:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000075b1d810 x1858042733307136/t0(0) o400->5474a155-cba9-43ee-ab9f-99575f44b958@20449@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1759-0'
00010000:00000001:7.0:1773851869.043573:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851869.043574:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851869.043574:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=101 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851869.043575:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851869.043576:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee113a8d refcount 3 to 20449@kfi7
00000100:00000001:7.0:1773851869.043576:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095774592 : -107152613777024 : ffff9e8b9684e180)
02000000:00000001:7.0:1773851869.043577:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851869.043578:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.043578:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851869.043579:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20448@kfi7
00000400:00000010:7.0:1773851869.043580:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d794ea.
00000100:00000200:7.0:1773851869.043580:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042733307136, offset 224
00000400:00000200:7.0:1773851869.043581:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20448@kfi7
00000400:00000200:7.0:1773851869.043582:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20448@kfi7 to cpt 1
00000400:00000200:7.0:1773851869.043583:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae8ab68 nid 20448@kfi7 refs 1
00000400:00000200:7.0:1773851869.043584:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dae8ab68 nid 20448@kfi7 refs 2
00000400:00000200:7.0:1773851869.043584:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dae8ab68 nid 20448@kfi7 refs 3
00000400:00000200:7.0:1773851869.043585:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20448@kfi7 local destination
00000400:00000200:7.0:1773851869.043587:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769299:8769299:1024:4294967295] 20448@kfi7 LPNI seq info [11940597:11940597:16:4294967295]
00000400:00000200:7.0:1773851869.043588:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dae8ab68 nid 20448@kfi7 refs 2
00000400:00000200:7.0:1773851869.043590:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20448@kfi7 to cpt 1
00000400:00000200:7.0:1773851869.043592:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20448@kfi7(20448@kfi7:20448@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851869.043593:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dae8ab68 nid 20448@kfi7 refs 3
00000800:00000200:7.0:1773851869.043594:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851869.043595:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851869.043597:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851869.043599:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b3c Using peer 20448@kfi7(0x100000000000b3c)
00000800:00000200:7.0:1773851869.043602:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x100000000000b3c: rc=0
00000800:00000200:7.0:1773851869.043603:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b3c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851869.043605:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851869.043606:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee113a8d refcount 2 to 20449@kfi7
00010000:00000001:7.0:1773851869.043606:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851869.043607:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.043607:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851869.043608:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000075b1d810 x1858042733307136/t0(0) o400->5474a155-cba9-43ee-ab9f-99575f44b958@20449@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1759-0'
00000100:00100000:7.0:1773851869.043611:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075b1d810 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5474a155-cba9-43ee-ab9f-99575f44b958+6:39819:x1858042733307136:12345-20449@kfi7:400:default-tuolumne1759-0 Request processed in 53us (91us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851869.043613:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20449@kfi7, seq: 2001924
00000100:00000040:7.0:1773851869.043613:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000708efbd5 : new rpc_count 0
00000100:00000001:7.0:1773851869.043614:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851869.043614:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851869.043615:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:7.0:1773851869.043616:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000057b1c766.
00000020:00000010:7.0:1773851869.043617:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000020:00000040:7.0:1773851869.043617:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000708efbd5 : new refcount 5
00000800:00000200:6.0:1773851869.043617:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b3c TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851869.043618:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851869.043619:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851869.043620:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20448@kfi7: PUT: OK
00000400:00000200:6.0:1773851869.043621:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d794ea
00000400:00000010:6.0:1773851869.043622:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d794ea.
00000100:00000001:6.0:1773851869.043622:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851869.043622:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851869.043623:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae8ab68 nid 20448@kfi7 refs 2
00000800:00000200:6.0:1773851869.043625:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 20448@kfi7(00000000a9c1c169):0x0 lsk 2877 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b3c Transaction freed
00000400:00000200:29.0:1773851869.065733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851869
00000400:00000200:29.0:1773851869.065734:0:34579:0:(router.c:1247:lnet_check_routers()) lnet_peer_ni_addref_locked 0000000099182043 nid 172.16.94.20@tcp refs 2
00000400:00000200:29.0:1773851869.065735:0:34579:0:(router.c:1254:lnet_check_routers()) discover 172.16.94.20@tcp, cpt = 7
00000400:00000200:29.0:1773851869.065738:0:34579:0:(peer.c:2475:lnet_peer_queue_for_discovery()) Queue peer 172.16.94.20@tcp: 0
00000400:00000200:29.0:1773851869.065739:0:34579:0:(peer.c:2799:lnet_discover_peer_locked()) Discovery attempt # 1
00000400:00000200:29.0:1773851869.065739:0:34579:0:(peer.c:2839:lnet_discover_peer_locked()) non-blocking discovery
00000400:00000200:29.0:1773851869.065740:0:34579:0:(peer.c:2848:lnet_discover_peer_locked()) peer 172.16.94.20@tcp NID 172.16.94.20@tcp: 0. pending discovery
00000400:00000200:29.0:1773851869.065741:0:34579:0:(router.c:1258:lnet_check_routers()) lnet_peer_ni_decref_locked 0000000099182043 nid 172.16.94.20@tcp refs 3
00000400:00000200:29.0:1773851869.065742:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851869
00000400:00000200:29.0:1773851869.065743:0:34579:0:(router.c:1247:lnet_check_routers()) lnet_peer_ni_addref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 2
00000400:00000200:29.0:1773851869.065744:0:34579:0:(router.c:1254:lnet_check_routers()) discover 172.16.94.21@tcp, cpt = 7
00000400:00000200:31.0:1773851869.065745:0:34578:0:(peer.c:3919:lnet_peer_discovery_wait_for_work()) woken: 0
00000400:00000200:29.0:1773851869.065745:0:34579:0:(peer.c:2475:lnet_peer_queue_for_discovery()) Queue peer 172.16.94.21@tcp: 0
00000400:00000200:29.0:1773851869.065746:0:34579:0:(peer.c:2799:lnet_discover_peer_locked()) Discovery attempt # 1
00000400:00000200:29.0:1773851869.065746:0:34579:0:(peer.c:2839:lnet_discover_peer_locked()) non-blocking discovery
00000400:00000200:29.0:1773851869.065747:0:34579:0:(peer.c:2848:lnet_discover_peer_locked()) peer 172.16.94.21@tcp NID 172.16.94.21@tcp: 0. pending discovery
00000400:00000200:29.0:1773851869.065748:0:34579:0:(router.c:1258:lnet_check_routers()) lnet_peer_ni_decref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 3
00000400:00000200:31.0:1773851869.065750:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x36055
00000400:00000010:31.0:1773851869.065753:0:34578:0:(api-ni.c:1772:lnet_ping_buffer_alloc()) alloc '(pbuf)': 281 at 0000000009fd8e64 (tot 253201052).
00000400:00000010:31.0:1773851869.065755:0:34578:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c73e55.
00000400:00000010:31.0:1773851869.065757:0:34578:0:(lib-lnet.h:487:lnet_rspt_alloc()) rspt alloc 00000000d7a72a8d
00000400:00000200:31.0:1773851869.065759:0:34578:0:(lib-move.c:5301:LNetGet()) LNetGet -> 12345-172.16.94.20@tcp
00000400:00000200:31.0:1773851869.065762:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.94.20@tcp to cpt 0
00000400:00000200:31.0:1773851869.065763:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099182043 nid 172.16.94.20@tcp refs 2
00000400:00000200:31.0:1773851869.065765:0:34578:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000099182043 nid 172.16.94.20@tcp refs 3
00000400:00000200:31.0:1773851869.065767:0:34578:0:(lib-move.c:2096:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000099182043 nid 172.16.94.20@tcp refs 4
00000400:00000200:31.0:1773851869.065769:0:34578:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  172.16.94.20@tcp routed destination
00000400:00000200:31.0:1773851869.065772:0:34578:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769298, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769299, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851869.065775:0:34578:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851869.065776:0:34578:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851869.065778:0:34578:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:31.0:1773851869.065780:0:34578:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769300:8769300:1024:4294967295] 17@kfi7 LPNI seq info [1250891894:1250891894:16:4294967295]
00000400:00000200:31.0:1773851869.065782:0:34578:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:31.0:1773851869.065784:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:31.0:1773851869.065785:0:34578:0:(lib-move.c:1960:lnet_handle_send()) rspt_next_hop_nid = 17@kfi7
00000400:00000200:31.0:1773851869.065789:0:34578:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 17@kfi7(172.16.94.20@tcp:17@kfi7) <?> : GET try# 0
00000400:00000200:31.0:1773851869.065791:0:34578:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000099182043 nid 172.16.94.20@tcp refs 3
00000800:00000200:31.0:1773851869.065794:0:34578:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851869.065796:0:34578:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 0 bytes in 0 frags
00000800:00000200:31.0:1773851869.065800:0:34578:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851869.065804:0:34578:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a Using peer 17@kfi7(0x67a)
00000800:00000200:31.0:1773851869.065809:0:34578:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002809a79a: Posted send of 100 bytes to peer 0x67a: rc=0
00000800:00000200:31.0:1773851869.065811:0:34578:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851869.065815:0:34578:0:(peer.c:3717:lnet_peer_send_ping()) peer 172.16.94.20@tcp
00000400:00000200:31.0:1773851869.065817:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x34255 rc 0
00000400:00000200:31.0:1773851869.065819:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x36055
00000400:00000010:31.0:1773851869.065820:0:34578:0:(api-ni.c:1772:lnet_ping_buffer_alloc()) alloc '(pbuf)': 281 at 0000000055961172 (tot 253201333).
00000400:00000010:31.0:1773851869.065822:0:34578:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d81a04c.
00000800:00000200:29.0:1773851869.065822:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a TN_EVENT_TX_OK event status 0
00000400:00000010:31.0:1773851869.065823:0:34578:0:(lib-lnet.h:487:lnet_rspt_alloc()) rspt alloc 0000000071a3de04
00000400:00000200:29.0:1773851869.065824:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851869.065825:0:34578:0:(lib-move.c:5301:LNetGet()) LNetGet -> 12345-172.16.94.21@tcp
00000400:00000200:29.0:1773851869.065825:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17@kfi7: GET: OK
00000400:00000200:31.0:1773851869.065826:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.94.21@tcp to cpt 1
00000400:00000200:29.0:1773851869.065826:0:2467684:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 5
00000400:00000200:29.0:1773851869.065827:0:2467684:0:(peer.c:3083:lnet_discovery_event_send()) Ping Send to 172.16.94.20@tcp: 0
00000400:00000200:31.0:1773851869.065828:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 2
00000400:00000200:31.0:1773851869.065829:0:34578:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 3
00000400:00000200:31.0:1773851869.065831:0:34578:0:(lib-move.c:2096:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 4
00000400:00000200:31.0:1773851869.065832:0:34578:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  172.16.94.21@tcp routed destination
00000400:00000200:31.0:1773851869.065834:0:34578:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769300, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769299, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851869.065837:0:34578:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851869.065839:0:34578:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851869.065840:0:34578:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:31.0:1773851869.065842:0:34578:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769301:8769301:1024:4294967295] 2094@kfi7 LPNI seq info [1258746992:1258746992:16:4294967295]
00000400:00000200:31.0:1773851869.065844:0:34578:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:31.0:1773851869.065846:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:31.0:1773851869.065847:0:34578:0:(lib-move.c:1960:lnet_handle_send()) rspt_next_hop_nid = 2094@kfi7
00000400:00000200:29.0:1773851869.065847:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:29.0:1773851869.065849:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a Transaction freed
00000400:00000200:31.0:1773851869.065851:0:34578:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2094@kfi7(172.16.94.21@tcp:2094@kfi7) <?> : GET try# 0
00000400:00000200:31.0:1773851869.065853:0:34578:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 3
00000800:00000200:31.0:1773851869.065856:0:34578:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851869.065858:0:34578:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 0 bytes in 0 frags
00000800:00000200:31.0:1773851869.065861:0:34578:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851869.065862:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851869.065863:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851869.065865:0:34578:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:10.0:1773851869.065865:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851869.065867:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851869.065869:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000800:00000200:31.0:1773851869.065870:0:34578:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 100 bytes to peer 0x20000000000000c: rc=0
00000400:00000200:10.0:1773851869.065871:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17@kfi7 : REPLY - for me
00000800:00000200:31.0:1773851869.065872:0:34578:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851869.065872:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851869.065873:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:10.0:1773851869.065875:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:31.0:1773851869.065876:0:34578:0:(peer.c:3717:lnet_peer_send_ping()) peer 172.16.94.21@tcp
00000400:00000200:10.0:1773851869.065876:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 2
00000400:00000200:31.0:1773851869.065877:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x34255 rc 0
00000400:00000200:10.0:1773851869.065877:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 3
00000400:00000200:10.0:1773851869.065879:0:2464469:0:(lib-move.c:4382:lnet_parse_reply()) 2069@kfi7: Reply from 12345-17@kfi7 of length 64/64 into md 0x7800809dd
00000800:00000200:29.0:1773851869.065881:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000800:00000200:10.0:1773851869.065882:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851869.065883:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851869.065883:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.065884:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: GET: OK
00000400:00000200:29.0:1773851869.065885:0:2467684:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 5
00000400:00000200:10.0:1773851869.065885:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17@kfi7: REPLY: OK
00000400:00000200:29.0:1773851869.065886:0:2467684:0:(peer.c:3083:lnet_discovery_event_send()) Ping Send to 172.16.94.21@tcp: 0
00000400:00000200:10.0:1773851869.065886:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c73e55
00000400:00000010:10.0:1773851869.065887:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c73e55.
00000400:00000200:29.0:1773851869.065888:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000200:10.0:1773851869.065888:0:2464469:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 3
00000400:00000200:10.0:1773851869.065889:0:2464469:0:(peer.c:2950:lnet_discovery_event_reply()) Peer 172.16.94.20@tcp has discovery enabled
00000800:00000200:29.0:1773851869.065890:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Transaction freed
00000400:00000200:10.0:1773851869.065891:0:2464469:0:(peer.c:2962:lnet_discovery_event_reply()) peer 172.16.94.20@tcp(000000001e7ab870) is MR
00000400:00000200:10.0:1773851869.065892:0:2464469:0:(peer.c:3033:lnet_discovery_event_reply()) peer 172.16.94.20@tcp data present 1. state = 0x34255
00000400:00000200:10.0:1773851869.065894:0:2464469:0:(peer.c:2475:lnet_peer_queue_for_discovery()) Queue peer 172.16.94.20@tcp: -114
00000400:00000200:10.0:1773851869.065896:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:10.0:1773851869.065898:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:31.0:1773851869.065899:0:34578:0:(peer.c:3919:lnet_peer_discovery_wait_for_work()) woken: 0
00000400:00000200:31.0:1773851869.065901:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x340d5
00000400:00000010:31.0:1773851869.065903:0:34578:0:(peer.c:3220:lnet_peer_merge_data()) alloc '(curnis)': 24 at 0000000090cb35bc (tot 253201357).
00000400:00000010:31.0:1773851869.065905:0:34578:0:(peer.c:3221:lnet_peer_merge_data()) alloc '(addnis)': 48 at 000000003a7e2bcd (tot 253201405).
00000400:00000010:31.0:1773851869.065906:0:34578:0:(peer.c:3222:lnet_peer_merge_data()) alloc '(delnis)': 24 at 00000000c5e92c1d (tot 253201429).
00000400:00000200:31.0:1773851869.065908:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.94.20@tcp to cpt 0
00000400:00000200:31.0:1773851869.065910:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099182043 nid 172.16.94.20@tcp refs 2
00000400:00000200:31.0:1773851869.065911:0:34578:0:(peer.c:3267:lnet_peer_merge_data()) lnet_peer_ni_decref_locked 0000000099182043 nid 172.16.94.20@tcp refs 3
00000400:00000200:31.0:1773851869.065913:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:31.0:1773851869.065914:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:31.0:1773851869.065916:0:34578:0:(peer.c:3267:lnet_peer_merge_data()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:17.0:1773851869.065916:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:31.0:1773851869.065917:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.94.20@tcp to cpt 0
00000800:00000200:17.0:1773851869.065917:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851869.065918:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851869.065919:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099182043 nid 172.16.94.20@tcp refs 2
00000400:00000200:31.0:1773851869.065920:0:34578:0:(peer.c:3339:lnet_peer_merge_data()) lnet_peer_ni_decref_locked 0000000099182043 nid 172.16.94.20@tcp refs 3
00000800:00000200:17.0:1773851869.065920:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000010:31.0:1773851869.065921:0:34578:0:(peer.c:3347:lnet_peer_merge_data()) kfreed 'curnis': 24 at 0000000090cb35bc (tot 253201405).
00000400:00000200:17.0:1773851869.065922:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000010:31.0:1773851869.065923:0:34578:0:(peer.c:3348:lnet_peer_merge_data()) kfreed 'addnis': 48 at 000000003a7e2bcd (tot 253201357).
00000400:00000200:17.0:1773851869.065923:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2094@kfi7 : REPLY - for me
00000400:00000200:17.0:1773851869.065924:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000010:31.0:1773851869.065925:0:34578:0:(peer.c:3349:lnet_peer_merge_data()) kfreed 'delnis': 24 at 00000000c5e92c1d (tot 253201333).
00000400:00000200:17.0:1773851869.065925:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851869.065926:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.065926:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000010:31.0:1773851869.065927:0:34578:0:(api-ni.c:1786:lnet_ping_buffer_free()) kfreed 'pbuf': 281 at 0000000009fd8e64 (tot 253201052).
00000400:00000200:31.0:1773851869.065928:0:34578:0:(peer.c:3352:lnet_peer_merge_data()) peer 172.16.94.20@tcp (000000001e7ab870): 0
00000400:00000200:17.0:1773851869.065928:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 3
00000400:00000200:17.0:1773851869.065929:0:2511435:0:(lib-move.c:4382:lnet_parse_reply()) 2054@kfi7: Reply from 12345-2094@kfi7 of length 64/64 into md 0x7800809fd
00000400:00000200:31.0:1773851869.065930:0:34578:0:(peer.c:3641:lnet_peer_data_present()) peer 172.16.94.20@tcp(000000001e7ab870): 0. state = 0x34155
00000800:00000200:17.0:1773851869.065931:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851869.065932:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x34155 rc 1
00000400:00000200:17.0:1773851869.065933:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851869.065934:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x34155
00000400:00000200:17.0:1773851869.065934:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: REPLY: OK
00000400:00000200:17.0:1773851869.065935:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d81a04c
00000400:00000010:31.0:1773851869.065936:0:34578:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c70e405.
00000400:00000010:17.0:1773851869.065936:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d81a04c.
00000400:00000200:17.0:1773851869.065937:0:2511435:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 3
00000400:00000010:31.0:1773851869.065938:0:34578:0:(lib-lnet.h:487:lnet_rspt_alloc()) rspt alloc 00000000b7e76d68
00000400:00000200:17.0:1773851869.065938:0:2511435:0:(peer.c:2950:lnet_discovery_event_reply()) Peer 172.16.94.21@tcp has discovery enabled
00000400:00000200:17.0:1773851869.065939:0:2511435:0:(peer.c:2962:lnet_discovery_event_reply()) peer 172.16.94.21@tcp(000000007a7ee94a) is MR
00000400:00000200:31.0:1773851869.065940:0:34578:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17@kfi7
00000400:00000200:31.0:1773851869.065941:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:17.0:1773851869.065941:0:2511435:0:(peer.c:3033:lnet_discovery_event_reply()) peer 172.16.94.21@tcp data present 1. state = 0x34255
00000400:00000200:31.0:1773851869.065943:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:31.0:1773851869.065944:0:34578:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 2
00000400:00000200:31.0:1773851869.065946:0:34578:0:(lib-move.c:2096:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 3
00000400:00000200:31.0:1773851869.065948:0:34578:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17@kfi7 local destination
00000400:00000200:31.0:1773851869.065950:0:34578:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769302:8769302:1024:4294967295] 17@kfi7 LPNI seq info [1250891895:1250891895:16:4294967295]
00000400:00000200:31.0:1773851869.065952:0:34578:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 2
00000400:00000200:31.0:1773851869.065953:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:17.0:1773851869.065955:0:2511435:0:(peer.c:2475:lnet_peer_queue_for_discovery()) Queue peer 172.16.94.21@tcp: -114
00000400:00000200:31.0:1773851869.065957:0:34578:0:(lib-move.c:1960:lnet_handle_send()) rspt_next_hop_nid = 17@kfi7
00000400:00000200:17.0:1773851869.065957:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851869.065959:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:31.0:1773851869.065961:0:34578:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17@kfi7(17@kfi7:17@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851869.065963:0:34578:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 3
00000800:00000200:31.0:1773851869.065965:0:34578:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851869.065967:0:34578:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 64 bytes in 1 frags
00000800:00000200:31.0:1773851869.065970:0:34578:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851869.065974:0:34578:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a Using peer 17@kfi7(0x67a)
00000800:00000200:31.0:1773851869.065978:0:34578:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 164 bytes to peer 0x67a: rc=0
00000800:00000200:31.0:1773851869.065979:0:34578:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851869.065981:0:34578:0:(peer.c:3854:lnet_peer_send_push()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x30555
00000400:00000200:31.0:1773851869.065983:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x30555 rc 0
00000400:00000200:31.0:1773851869.065984:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x340d5
00000400:00000010:31.0:1773851869.065985:0:34578:0:(peer.c:3220:lnet_peer_merge_data()) alloc '(curnis)': 24 at 00000000835e04d8 (tot 253201076).
00000400:00000010:31.0:1773851869.065986:0:34578:0:(peer.c:3221:lnet_peer_merge_data()) alloc '(addnis)': 48 at 000000003a7e2bcd (tot 253201124).
00000400:00000010:31.0:1773851869.065987:0:34578:0:(peer.c:3222:lnet_peer_merge_data()) alloc '(delnis)': 24 at 000000007b4fb196 (tot 253201148).
00000400:00000200:31.0:1773851869.065988:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.94.21@tcp to cpt 1
00000400:00000200:31.0:1773851869.065989:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 2
00000400:00000200:31.0:1773851869.065990:0:34578:0:(peer.c:3267:lnet_peer_merge_data()) lnet_peer_ni_decref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 3
00000400:00000200:31.0:1773851869.065991:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:31.0:1773851869.065992:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000800:00000200:29.0:1773851869.065992:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851869.065993:0:34578:0:(peer.c:3267:lnet_peer_merge_data()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000200:31.0:1773851869.065994:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.94.21@tcp to cpt 1
00000400:00000200:29.0:1773851869.065994:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851869.065995:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 2
00000400:00000200:29.0:1773851869.065995:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17@kfi7: PUT: OK
00000400:00000200:31.0:1773851869.065996:0:34578:0:(peer.c:3339:lnet_peer_merge_data()) lnet_peer_ni_decref_locked 0000000079d0504b nid 172.16.94.21@tcp refs 3
00000400:00000010:31.0:1773851869.065996:0:34578:0:(peer.c:3347:lnet_peer_merge_data()) kfreed 'curnis': 24 at 00000000835e04d8 (tot 253201124).
00000400:00000200:29.0:1773851869.065996:0:2467684:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 5
00000400:00000010:31.0:1773851869.065997:0:34578:0:(peer.c:3348:lnet_peer_merge_data()) kfreed 'addnis': 48 at 000000003a7e2bcd (tot 253201076).
00000400:00000200:29.0:1773851869.065997:0:2467684:0:(peer.c:3083:lnet_discovery_event_send()) Push Send to 17@kfi7: 0
00000400:00000010:31.0:1773851869.065998:0:34578:0:(peer.c:3349:lnet_peer_merge_data()) kfreed 'delnis': 24 at 000000007b4fb196 (tot 253201052).
00000400:00000200:29.0:1773851869.065998:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000400:00000010:31.0:1773851869.065999:0:34578:0:(api-ni.c:1786:lnet_ping_buffer_free()) kfreed 'pbuf': 281 at 0000000055961172 (tot 253200771).
00000400:00000200:31.0:1773851869.066000:0:34578:0:(peer.c:3352:lnet_peer_merge_data()) peer 172.16.94.21@tcp (000000007a7ee94a): 0
00000800:00000200:29.0:1773851869.066000:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 7 tta 0x67a Transaction freed
00000400:00000200:31.0:1773851869.066001:0:34578:0:(peer.c:3641:lnet_peer_data_present()) peer 172.16.94.21@tcp(000000007a7ee94a): 0. state = 0x34155
00000400:00000200:31.0:1773851869.066002:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x34155 rc 1
00000400:00000200:31.0:1773851869.066003:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x34155
00000400:00000010:31.0:1773851869.066003:0:34578:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
00000400:00000010:31.0:1773851869.066004:0:34578:0:(lib-lnet.h:487:lnet_rspt_alloc()) rspt alloc 000000009d4ad477
00000400:00000200:31.0:1773851869.066005:0:34578:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2094@kfi7
00000400:00000200:31.0:1773851869.066006:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:31.0:1773851869.066007:0:34578:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:31.0:1773851869.066008:0:34578:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000200:31.0:1773851869.066008:0:34578:0:(lib-move.c:2096:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 3
00000400:00000200:31.0:1773851869.066009:0:34578:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2094@kfi7 local destination
00000400:00000200:31.0:1773851869.066011:0:34578:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769303:8769303:1024:4294967295] 2094@kfi7 LPNI seq info [1258746993:1258746993:16:4294967295]
00000400:00000200:31.0:1773851869.066012:0:34578:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000200:31.0:1773851869.066013:0:34578:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:31.0:1773851869.066015:0:34578:0:(lib-move.c:1960:lnet_handle_send()) rspt_next_hop_nid = 2094@kfi7
00000400:00000200:31.0:1773851869.066016:0:34578:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2094@kfi7(2094@kfi7:2094@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851869.066018:0:34578:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 3
00000800:00000200:31.0:1773851869.066019:0:34578:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851869.066020:0:34578:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 64 bytes in 1 frags
00000800:00000200:31.0:1773851869.066022:0:34578:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851869.066023:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851869.066024:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851869.066025:0:34578:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:9.0:1773851869.066026:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851869.066027:0:34578:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 164 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:9.0:1773851869.066028:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:31.0:1773851869.066029:0:34578:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851869.066031:0:34578:0:(peer.c:3854:lnet_peer_send_push()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x30555
00000400:00000200:9.0:1773851869.066031:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:31.0:1773851869.066032:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x30555 rc 0
00000400:00000200:9.0:1773851869.066032:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17@kfi7 : ACK - for me
00000400:00000200:9.0:1773851869.066034:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.066035:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851869.066036:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.066037:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 2
00000400:00000200:9.0:1773851869.066038:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 3
00000800:00000200:29.0:1773851869.066039:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851869.066040:0:2458095:0:(lib-move.c:4435:lnet_parse_ack()) 2069@kfi7: ACK from 12345-17@kfi7 into md 0x780080a1d
00000400:00000200:29.0:1773851869.066041:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.066042:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000800:00000200:9.0:1773851869.066042:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851869.066043:0:2467684:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 5
00000400:00000200:29.0:1773851869.066043:0:2467684:0:(peer.c:3083:lnet_discovery_event_send()) Push Send to 2094@kfi7: 0
00000400:00000200:9.0:1773851869.066044:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.066045:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000200:9.0:1773851869.066045:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17@kfi7: ACK: OK
00000800:00000200:29.0:1773851869.066046:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Transaction freed
00000400:00000200:9.0:1773851869.066046:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c70e405
00000400:00000010:9.0:1773851869.066047:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c70e405.
00000400:00000200:9.0:1773851869.066048:0:2458095:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 4
00000400:00000200:9.0:1773851869.066049:0:2458095:0:(peer.c:2871:lnet_discovery_event_ack()) peer 172.16.94.20@tcp ev->status 0
00000400:00000200:9.0:1773851869.066050:0:2458095:0:(peer.c:2475:lnet_peer_queue_for_discovery()) Queue peer 172.16.94.20@tcp: -114
00000400:00000200:9.0:1773851869.066053:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000400:00000200:31.0:1773851869.066054:0:34578:0:(peer.c:3919:lnet_peer_discovery_wait_for_work()) woken: 0
00000400:00000200:31.0:1773851869.066055:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x30155
00000800:00000200:9.0:1773851869.066055:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 17@kfi7(00000000262f7386):0x0 lsk 1659 rsk 4849 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:31.0:1773851869.066056:0:34578:0:(peer.c:3773:lnet_peer_discovered()) peer 172.16.94.20@tcp
00000400:00000200:31.0:1773851869.066057:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.20@tcp(000000001e7ab870) state 0x30115 rc 0
00000400:00000200:31.0:1773851869.066058:0:34578:0:(peer.c:2491:lnet_peer_discovery_complete()) Discovery complete. Dequeue peer 172.16.94.20@tcp
00000800:00000200:17.0:1773851869.066069:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851869.066070:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851869.066071:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851869.066073:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851869.066075:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.066076:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2094@kfi7 : ACK - for me
00000400:00000200:17.0:1773851869.066078:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.066079:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851869.066079:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.066080:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000200:17.0:1773851869.066081:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 3
00000400:00000200:17.0:1773851869.066083:0:2511435:0:(lib-move.c:4435:lnet_parse_ack()) 2054@kfi7: ACK from 12345-2094@kfi7 into md 0x780080a3d
00000800:00000200:17.0:1773851869.066084:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851869.066086:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851869.066087:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: ACK: OK
00000400:00000200:17.0:1773851869.066088:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000400:00000010:17.0:1773851869.066088:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000400:00000200:17.0:1773851869.066089:0:2511435:0:(peer.c:3131:lnet_discovery_event_handler()) Received event: 4
00000400:00000200:17.0:1773851869.066090:0:2511435:0:(peer.c:2871:lnet_discovery_event_ack()) peer 172.16.94.21@tcp ev->status 0
00000400:00000200:17.0:1773851869.066091:0:2511435:0:(peer.c:2475:lnet_peer_queue_for_discovery()) Queue peer 172.16.94.21@tcp: -114
00000400:00000200:17.0:1773851869.066093:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000400:00000200:31.0:1773851869.066095:0:34578:0:(peer.c:3919:lnet_peer_discovery_wait_for_work()) woken: 0
00000800:00000200:17.0:1773851869.066095:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:31.0:1773851869.066096:0:34578:0:(peer.c:4031:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x30155
00000400:00000200:31.0:1773851869.066097:0:34578:0:(peer.c:3773:lnet_peer_discovered()) peer 172.16.94.21@tcp
00000400:00000200:31.0:1773851869.066097:0:34578:0:(peer.c:4053:lnet_peer_discovery()) peer 172.16.94.21@tcp(000000007a7ee94a) state 0x30115 rc 0
00000400:00000200:31.0:1773851869.066098:0:34578:0:(peer.c:2491:lnet_peer_discovery_complete()) Discovery complete. Dequeue peer 172.16.94.21@tcp
00000800:00000200:10.0:1773851869.123163:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851869.123163:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851869.123164:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851869.123165:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851869.123165:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851869.123167:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851869.123168:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14097@kfi7(0000000000ae059f):0x49 version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851869.123170:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 Using peer 14097@kfi7(0x49)
00000800:00000200:10.0:1773851869.123171:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851869.123175:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14097@kfi7 to cpt 2
00000400:00000200:10.0:1773851869.123177:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14097@kfi7 : PUT - for me
00000400:00000200:10.0:1773851869.123179:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14097@kfi7 to cpt 2
00000400:00000200:10.0:1773851869.123181:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6419937 nid 14097@kfi7 refs 1
00000400:00000200:10.0:1773851869.123183:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14097@kfi7 to cpt 2
00000400:00000200:10.0:1773851869.123184:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6419937 nid 14097@kfi7 refs 2
00000400:00000200:10.0:1773851869.123186:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e6419937 nid 14097@kfi7 refs 3
00000400:00000200:10.0:1773851869.123187:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14288@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.123189:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14097@kfi7 to cpt 2
00000400:00000200:10.0:1773851869.123190:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14288@kfi7 of length 224 into portal 12 MB=0x69b4b5b673c40
00000800:00000200:9.0:1773851869.123192:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 38 bytes to peer 0x49: rc=0
00000400:00000200:10.0:1773851869.123193:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14288@kfi7 of length 224/224 into md 0x78146ce49 [64] + 138056
00000800:00000200:9.0:1773851869.123193:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:10.0:1773851869.123196:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851869.123199:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851869.123201:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14097@kfi7: PUT: OK
00000100:00000001:10.0:1773851869.123203:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851869.123204:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851869.123205:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eba50e83.
00000800:00000200:9.0:1773851869.123205:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851869.123207:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000eba50e83 x1859597818608704 msgsize 224
00000800:00000200:9.0:1773851869.123208:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 Transaction freed
00000100:00100000:10.0:1773851869.123209:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-14288@kfi7 (source: 12345-14097@kfi7)
00000100:00000001:10.0:1773851869.123211:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851869.123213:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6419937 nid 14097@kfi7 refs 2
00000100:00000001:11.0:1773851869.123214:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851869.123215:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851869.123215:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851869.123216:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851869.123217:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851869.123219:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851869.123221:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597818608704
00000020:00000001:11.0:1773851869.123222:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851869.123223:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f02d
00000020:00000001:11.0:1773851869.123224:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851869.123227:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ade474fb refcount=5
00000020:00000001:11.0:1773851869.123228:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061535969280 : -107012173582336 : ffff9eac49683000)
00000020:00000001:11.0:1773851869.123230:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637061535969280 : -107012173582336 : ffff9eac49683000)
00000100:00000001:11.0:1773851869.123232:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851869.123233:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851869.123235:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020699928.
00000020:00000010:11.0:1773851869.123237:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851869.123238:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000732ad997.
00000100:00000001:11.0:1773851869.123240:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851869.123241:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851869.123242:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851869.123244:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851869.123245:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851869.123247:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851869.123249:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851869.123252:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851869.123252:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851869.123252:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851869.123252:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851869.123254:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14288@kfi7, seq: 2130783
00000100:00000001:11.0:1773851869.123255:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851869.123255:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ade474fb : new rpc_count 1
00000100:00000001:11.0:1773851869.123256:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.123256:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043610181248 : -107030099370368 : ffff9ea81cf25e80)
00000100:00000040:9.0:1773851869.123257:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eba50e83 x1859597818608704/t0(0) o400->876f415a-0470-4984-9955-2e0ca0e83f1e@14288@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1377-0'
00000100:00000001:9.0:1773851869.123261:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851869.123262:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851869.123263:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eba50e83 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:876f415a-0470-4984-9955-2e0ca0e83f1e+5:39743:x1859597818608704:12345-14288@kfi7:400:default-tuolumne1377-0
00000100:00000200:9.0:1773851869.123265:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597818608704
00000020:00000001:9.0:1773851869.123265:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851869.123266:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851869.123267:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851869.123268:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851869.123269:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851869.123270:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851869.123270:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597818608704, found 0 last_xid 1859597818608703
00000020:00000001:9.0:1773851869.123272:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851869.123272:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851869.123273:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851869.123274:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851869.123275:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851869.123276:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851869.123277:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851869.123278:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004258e725.
02000000:00000001:9.0:1773851869.123279:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.123280:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851869.123281:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851869.123282:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035355668, transno 0, xid 1859597818608704
00010000:00000001:9.0:1773851869.123283:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851869.123284:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eba50e83 x1859597818608704/t0(0) o400->876f415a-0470-4984-9955-2e0ca0e83f1e@14288@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1377-0'
00010000:00000001:9.0:1773851869.123287:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851869.123288:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851869.123289:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=102 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851869.123290:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851869.123291:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b450fe76 refcount 3 to 14288@kfi7
00000100:00000001:9.0:1773851869.123292:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580928 : -107154806970688 : ffff9e8b13cb66c0)
02000000:00000001:9.0:1773851869.123293:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851869.123294:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851869.123295:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851869.123296:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14097@kfi7
00000400:00000010:9.0:1773851869.123297:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f232fba1.
00000100:00000200:9.0:1773851869.123298:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597818608704, offset 224
00000400:00000200:9.0:1773851869.123299:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14097@kfi7
00000400:00000200:9.0:1773851869.123301:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14097@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.123302:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6419937 nid 14097@kfi7 refs 1
00000400:00000200:9.0:1773851869.123303:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e6419937 nid 14097@kfi7 refs 2
00000400:00000200:9.0:1773851869.123304:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e6419937 nid 14097@kfi7 refs 3
00000400:00000200:9.0:1773851869.123306:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14097@kfi7 local destination
00000400:00000200:9.0:1773851869.123307:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769304:8769304:1024:4294967295] 14097@kfi7 LPNI seq info [802848:802848:16:4294967295]
00000400:00000200:9.0:1773851869.123309:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e6419937 nid 14097@kfi7 refs 2
00000400:00000200:9.0:1773851869.123310:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14097@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.123312:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14097@kfi7(14097@kfi7:14097@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851869.123313:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e6419937 nid 14097@kfi7 refs 3
00000800:00000200:9.0:1773851869.123315:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851869.123316:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851869.123318:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851869.123321:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 Using peer 14097@kfi7(0x49)
00000800:00000200:9.0:1773851869.123323:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x49: rc=0
00000800:00000200:9.0:1773851869.123325:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851869.123327:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851869.123328:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b450fe76 refcount 2 to 14288@kfi7
00010000:00000001:9.0:1773851869.123329:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851869.123329:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851869.123330:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851869.123331:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eba50e83 x1859597818608704/t0(0) o400->876f415a-0470-4984-9955-2e0ca0e83f1e@14288@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1377-0'
00000100:00100000:9.0:1773851869.123334:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eba50e83 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:876f415a-0470-4984-9955-2e0ca0e83f1e+5:39743:x1859597818608704:12345-14288@kfi7:400:default-tuolumne1377-0 Request processed in 72us (126us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851869.123337:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14288@kfi7, seq: 2130783
00000800:00000200:10.0:1773851869.123338:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851869.123338:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ade474fb : new rpc_count 0
00000100:00000001:9.0:1773851869.123339:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851869.123339:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851869.123340:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:10.0:1773851869.123341:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851869.123341:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000732ad997.
00000020:00000010:9.0:1773851869.123342:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020699928.
00000020:00000040:9.0:1773851869.123342:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000ade474fb : new refcount 4
00000400:00000200:10.0:1773851869.123343:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14097@kfi7: PUT: OK
00000100:00000001:9.0:1773851869.123343:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851869.123344:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f232fba1
00000400:00000010:10.0:1773851869.123345:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f232fba1.
00000100:00000001:10.0:1773851869.123346:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851869.123347:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851869.123348:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6419937 nid 14097@kfi7 refs 2
00000800:00000200:10.0:1773851869.123351:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 14097@kfi7(0000000000ae059f):0x0 lsk 74 rsk 30 tsk 0 trmk 0 tmk 0 trr 2 tta 0x49 Transaction freed
00000800:00000200:29.0:1773851869.160212:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851869.160213:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851869.160214:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851869.160216:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851869.160220:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13795@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.160221:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13795@kfi7 : PUT - for me
00000400:00000200:29.0:1773851869.160222:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13795@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.160223:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010e0a345 nid 13795@kfi7 refs 1
00000400:00000200:29.0:1773851869.160224:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13795@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.160225:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010e0a345 nid 13795@kfi7 refs 2
00000400:00000200:29.0:1773851869.160226:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010e0a345 nid 13795@kfi7 refs 3
00000400:00000200:29.0:1773851869.160227:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13795@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.160228:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13795@kfi7 of length 224 into portal 12 MB=0x699e1016b0b00
00000400:00000200:29.0:1773851869.160230:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13795@kfi7 of length 224/224 into md 0x77fe139dd [64] + 177096
00000800:00000200:29.0:1773851869.160232:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851869.160234:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.160235:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13795@kfi7: PUT: OK
00000100:00000001:29.0:1773851869.160236:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851869.160237:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851869.160238:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000768d3f8c.
00000100:00000040:29.0:1773851869.160239:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000768d3f8c x1858041530747648 msgsize 224
00000100:00100000:29.0:1773851869.160240:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13795@kfi7 (source: 12345-13795@kfi7)
00000100:00000001:29.0:1773851869.160241:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851869.160242:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010e0a345 nid 13795@kfi7 refs 2
00000800:00000200:29.0:1773851869.160244:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851869.160245:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851869.160246:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851869.160247:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851869.160248:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851869.160250:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851869.160251:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041530747648
00000020:00000001:31.0:1773851869.160252:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851869.160253:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92371
00000020:00000001:31.0:1773851869.160254:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851869.160257:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000092f5b94e refcount=6
00000020:00000001:31.0:1773851869.160259:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630296576 : -107123079255040 : ffff9e9276e9ec00)
00000020:00000001:31.0:1773851869.160261:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630296576 : -107123079255040 : ffff9e9276e9ec00)
00000100:00000001:31.0:1773851869.160262:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851869.160264:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851869.160265:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000055961172.
00000020:00000010:31.0:1773851869.160267:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851869.160269:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bcd0c99c.
00000100:00000001:31.0:1773851869.160271:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851869.160271:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851869.160272:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851869.160274:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851869.160275:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851869.160276:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.160278:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851869.160280:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851869.160280:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851869.160280:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851869.160281:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851869.160282:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13795@kfi7, seq: 2055527
00000100:00000001:31.0:1773851869.160283:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851869.160283:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000092f5b94e : new rpc_count 1
00000100:00000001:28.0:1773851869.160283:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309686016 : -106988399865600 : ffff9eb1d26e5100)
00000100:00000001:31.0:1773851869.160284:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851869.160285:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000768d3f8c x1858041530747648/t0(0) o400->b4142c6d-db8e-421a-893a-c2cee83a7847@13795@kfi7:657/0 lens 224/0 e 0 to 0 dl 1773852017 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1339-0'
00000100:00000001:28.0:1773851869.160288:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851869.160288:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851869.160289:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000768d3f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:b4142c6d-db8e-421a-893a-c2cee83a7847+6:39717:x1858041530747648:12345-13795@kfi7:400:default-tuolumne1339-0
00000100:00000200:28.0:1773851869.160291:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041530747648
00000020:00000001:28.0:1773851869.160292:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851869.160293:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851869.160294:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.160295:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851869.160295:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851869.160296:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851869.160297:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041530747648, found 0 last_xid 1858041530747647
00000020:00000001:28.0:1773851869.160298:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851869.160299:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851869.160300:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851869.160301:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.160302:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851869.160302:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851869.160303:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851869.160304:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000439bdbce.
02000000:00000001:28.0:1773851869.160304:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851869.160305:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.160306:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851869.160307:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096697163, transno 0, xid 1858041530747648
00010000:00000001:28.0:1773851869.160308:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851869.160309:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000768d3f8c x1858041530747648/t0(0) o400->b4142c6d-db8e-421a-893a-c2cee83a7847@13795@kfi7:657/0 lens 224/224 e 0 to 0 dl 1773852017 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1339-0'
00010000:00000001:28.0:1773851869.160312:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851869.160312:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851869.160313:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=102 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851869.160314:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851869.160315:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e7d60a1 refcount 3 to 13795@kfi7
00000100:00000001:28.0:1773851869.160316:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603213824 : -107155106337792 : ffff9e8b01f36c00)
02000000:00000001:28.0:1773851869.160318:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851869.160318:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851869.160319:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851869.160320:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13795@kfi7
00000400:00000010:28.0:1773851869.160320:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc38e5ee.
00000100:00000200:28.0:1773851869.160321:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041530747648, offset 224
00000400:00000200:28.0:1773851869.160323:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13795@kfi7
00000400:00000200:28.0:1773851869.160323:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13795@kfi7 to cpt 7
00000400:00000200:28.0:1773851869.160325:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010e0a345 nid 13795@kfi7 refs 1
00000400:00000200:28.0:1773851869.160326:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000010e0a345 nid 13795@kfi7 refs 2
00000400:00000200:28.0:1773851869.160327:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000010e0a345 nid 13795@kfi7 refs 3
00000400:00000200:28.0:1773851869.160328:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13795@kfi7 local destination
00000400:00000200:28.0:1773851869.160329:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769305:8769305:1024:4294967295] 13795@kfi7 LPNI seq info [6933903:6933903:16:4294967295]
00000400:00000200:28.0:1773851869.160331:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000010e0a345 nid 13795@kfi7 refs 2
00000400:00000200:28.0:1773851869.160333:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13795@kfi7 to cpt 7
00000400:00000200:28.0:1773851869.160335:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13795@kfi7(13795@kfi7:13795@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851869.160337:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000010e0a345 nid 13795@kfi7 refs 3
00000800:00000200:28.0:1773851869.160338:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851869.160339:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851869.160341:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851869.160343:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000977 Using peer 13795@kfi7(0x100000000000977)
00000800:00000200:28.0:1773851869.160346:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x100000000000977: rc=0
00000800:00000200:28.0:1773851869.160347:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000977 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851869.160350:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851869.160350:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e7d60a1 refcount 2 to 13795@kfi7
00010000:00000001:28.0:1773851869.160351:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851869.160352:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.160352:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851869.160353:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000768d3f8c x1858041530747648/t0(0) o400->b4142c6d-db8e-421a-893a-c2cee83a7847@13795@kfi7:657/0 lens 224/224 e 0 to 0 dl 1773852017 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1339-0'
00000100:00100000:28.0:1773851869.160358:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000768d3f8c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:b4142c6d-db8e-421a-893a-c2cee83a7847+6:39717:x1858041530747648:12345-13795@kfi7:400:default-tuolumne1339-0 Request processed in 68us (118us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851869.160360:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13795@kfi7, seq: 2055527
00000100:00000040:28.0:1773851869.160360:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000092f5b94e : new rpc_count 0
00000100:00000001:28.0:1773851869.160361:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851869.160362:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851869.160362:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:28.0:1773851869.160363:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bcd0c99c.
00000020:00000010:28.0:1773851869.160364:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000055961172.
00000020:00000040:28.0:1773851869.160365:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000092f5b94e : new refcount 5
00000100:00000001:28.0:1773851869.160366:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851869.160371:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000977 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851869.160372:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.160373:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13795@kfi7: PUT: OK
00000400:00000200:29.0:1773851869.160374:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc38e5ee
00000400:00000010:29.0:1773851869.160375:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc38e5ee.
00000100:00000001:29.0:1773851869.160375:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851869.160376:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851869.160377:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000010e0a345 nid 13795@kfi7 refs 2
00000800:00000200:29.0:1773851869.160378:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 13795@kfi7(00000000929e4ddc):0x0 lsk 2424 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000977 Transaction freed
00080000:00000001:30.0:1773851869.170687:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851869.170688:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851869.170714:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851869.170715:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851869.170746:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851869.170747:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851869.170772:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851869.170773:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851869.170932:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 0000000078bc3602 (tot 253201027).
00000400:00000010:30.0:1773851869.170933:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 0000000078bc3602 (tot 253200771).
00000800:00000200:25.0:1773851869.191231:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851869.191233:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851869.191235:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851869.191239:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851869.191243:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19905@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.191245:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19905@kfi7 : PUT - for me
00000400:00000200:25.0:1773851869.191247:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19905@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.191248:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000807f4e44 nid 19905@kfi7 refs 1
00000400:00000200:25.0:1773851869.191250:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19905@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.191252:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000807f4e44 nid 19905@kfi7 refs 2
00000400:00000200:25.0:1773851869.191253:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000807f4e44 nid 19905@kfi7 refs 3
00000400:00000200:25.0:1773851869.191255:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19712@kfi7 to cpt 0
00000400:00000200:25.0:1773851869.191257:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19712@kfi7 of length 224 into portal 12 MB=0x69b4b775f7b40
00000400:00000200:25.0:1773851869.191259:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19712@kfi7 of length 224/224 into md 0x16159c9699 [64] + 10280
00000800:00000200:25.0:1773851869.191262:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851869.191266:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851869.191269:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19905@kfi7: PUT: OK
00000100:00000001:25.0:1773851869.191270:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851869.191271:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851869.191273:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000281e9554.
00000100:00000040:25.0:1773851869.191274:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000281e9554 x1859598287862592 msgsize 224
00000100:00100000:25.0:1773851869.191277:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19712@kfi7 (source: 12345-19905@kfi7)
00000100:00000001:25.0:1773851869.191280:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851869.191281:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000807f4e44 nid 19905@kfi7 refs 2
00000800:00000200:25.0:1773851869.191284:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851869.191289:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851869.191290:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851869.191291:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851869.191292:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851869.191293:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851869.191294:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598287862592
00000020:00000001:25.0:1773851869.191295:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851869.191296:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2438a5eb
00000020:00000001:25.0:1773851869.191297:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851869.191301:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004a549073 refcount=5
00000020:00000001:25.0:1773851869.191302:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068536932352 : -107005172619264 : ffff9eadeab26800)
00000020:00000001:25.0:1773851869.191303:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068536932352 : -107005172619264 : ffff9eadeab26800)
00000100:00000001:25.0:1773851869.191305:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851869.191306:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851869.191307:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000034fe4ec0.
00000020:00000010:25.0:1773851869.191309:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851869.191311:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851869.191312:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851869.191313:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851869.191314:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851869.191316:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851869.191317:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851869.191317:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851869.191319:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851869.191321:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851869.191322:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851869.191323:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851869.191323:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851869.191325:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19712@kfi7, seq: 2025103
00000100:00000001:26.0:1773851869.191326:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851869.191326:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004a549073 : new rpc_count 1
00000100:00000001:25.0:1773851869.191327:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478780032 : -106938230771584 : ffff9ebd80bdf080)
00000100:00000001:26.0:1773851869.191328:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851869.191329:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000281e9554 x1859598287862592/t0(0) o400->c93892f7-9913-446c-aa20-09fd3274b31f@19712@kfi7:86/0 lens 224/0 e 0 to 0 dl 1773852201 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1731-0'
00000100:00000001:25.0:1773851869.191335:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851869.191335:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851869.191337:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000281e9554 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c93892f7-9913-446c-aa20-09fd3274b31f+5:39554:x1859598287862592:12345-19712@kfi7:400:default-tuolumne1731-0
00000100:00000200:25.0:1773851869.191339:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598287862592
00000020:00000001:25.0:1773851869.191340:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851869.191341:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851869.191342:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.191344:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851869.191344:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851869.191346:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851869.191347:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598287862592, found 0 last_xid 1859598287862591
00000020:00000001:25.0:1773851869.191348:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851869.191350:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851869.191350:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851869.191351:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.191352:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851869.191353:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851869.191354:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851869.191355:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000212fefaf.
02000000:00000001:25.0:1773851869.191356:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851869.191357:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.191359:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851869.191360:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154594481, transno 0, xid 1859598287862592
00010000:00000001:25.0:1773851869.191361:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851869.191363:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000281e9554 x1859598287862592/t0(0) o400->c93892f7-9913-446c-aa20-09fd3274b31f@19712@kfi7:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1731-0'
00010000:00000001:25.0:1773851869.191367:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851869.191369:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851869.191370:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=102 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851869.191372:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851869.191374:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000199b39a2 refcount 3 to 19712@kfi7
00000100:00000001:25.0:1773851869.191375:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715819904 : -107155993731712 : ffff9e8acd0edd80)
02000000:00000001:25.0:1773851869.191376:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851869.191377:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851869.191378:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851869.191379:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19905@kfi7
00000400:00000010:25.0:1773851869.191380:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bde8fa7d.
00000100:00000200:25.0:1773851869.191382:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598287862592, offset 224
00000400:00000200:25.0:1773851869.191384:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19905@kfi7
00000400:00000200:25.0:1773851869.191386:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19905@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.191387:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000807f4e44 nid 19905@kfi7 refs 1
00000400:00000200:25.0:1773851869.191389:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000807f4e44 nid 19905@kfi7 refs 2
00000400:00000200:25.0:1773851869.191391:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000807f4e44 nid 19905@kfi7 refs 3
00000400:00000200:25.0:1773851869.191393:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19905@kfi7 local destination
00000400:00000200:25.0:1773851869.191396:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769306:8769306:1024:4294967295] 19905@kfi7 LPNI seq info [5324418:5324418:16:4294967295]
00000400:00000200:25.0:1773851869.191398:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000807f4e44 nid 19905@kfi7 refs 2
00000400:00000200:25.0:1773851869.191400:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19905@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.191404:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19905@kfi7(19905@kfi7:19905@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851869.191406:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000807f4e44 nid 19905@kfi7 refs 3
00000800:00000200:25.0:1773851869.191408:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851869.191410:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851869.191414:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851869.191418:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000104 Using peer 19905@kfi7(0x100000000000104)
00000800:00000200:25.0:1773851869.191423:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000016005f0: Posted send of 324 bytes to peer 0x100000000000104: rc=0
00000800:00000200:25.0:1773851869.191426:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000104 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851869.191431:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851869.191432:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000199b39a2 refcount 2 to 19712@kfi7
00010000:00000001:25.0:1773851869.191434:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851869.191435:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.191436:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851869.191437:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000281e9554 x1859598287862592/t0(0) o400->c93892f7-9913-446c-aa20-09fd3274b31f@19712@kfi7:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1731-0'
00000800:00000200:27.0:1773851869.191442:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000104 TN_EVENT_TX_OK event status 0
00000100:00100000:25.0:1773851869.191442:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000281e9554 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c93892f7-9913-446c-aa20-09fd3274b31f+5:39554:x1859598287862592:12345-19712@kfi7:400:default-tuolumne1731-0 Request processed in 106us (167us total) trans 0 rc 0/0
00000400:00000200:27.0:1773851869.191445:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:25.0:1773851869.191446:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19712@kfi7, seq: 2025103
00000400:00000200:27.0:1773851869.191447:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19905@kfi7: PUT: OK
00000100:00000040:25.0:1773851869.191447:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004a549073 : new rpc_count 0
00000400:00000200:27.0:1773851869.191448:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bde8fa7d
00000100:00000001:25.0:1773851869.191448:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:27.0:1773851869.191449:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bde8fa7d.
00000100:00000001:25.0:1773851869.191449:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:27.0:1773851869.191450:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:25.0:1773851869.191450:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000100:00000001:27.0:1773851869.191451:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:25.0:1773851869.191451:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000400:00000200:27.0:1773851869.191452:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000807f4e44 nid 19905@kfi7 refs 2
00000020:00000010:25.0:1773851869.191452:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000034fe4ec0.
00000020:00000040:25.0:1773851869.191453:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000004a549073 : new refcount 4
00000100:00000001:25.0:1773851869.191454:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:27.0:1773851869.191455:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 19905@kfi7(000000000d5cedb5):0x0 lsk 261 rsk 14 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000104 Transaction freed
00000800:00000200:21.0:1773851869.197991:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851869.197992:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851869.197993:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851869.197995:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851869.197998:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14784@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.197999:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14784@kfi7 : PUT - for me
00000400:00000200:21.0:1773851869.198000:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14784@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.198001:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074b49cbe nid 14784@kfi7 refs 1
00000400:00000200:21.0:1773851869.198002:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14784@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.198003:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074b49cbe nid 14784@kfi7 refs 2
00000400:00000200:21.0:1773851869.198004:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000074b49cbe nid 14784@kfi7 refs 3
00000400:00000200:21.0:1773851869.198005:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14785@kfi7 to cpt 1
00000400:00000200:21.0:1773851869.198006:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14785@kfi7 of length 224 into portal 12 MB=0x69b4bc6a942c0
00000400:00000200:21.0:1773851869.198007:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14785@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 38176
00000800:00000200:21.0:1773851869.198009:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851869.198011:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851869.198012:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14784@kfi7: PUT: OK
00000100:00000001:21.0:1773851869.198013:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851869.198013:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851869.198014:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000006763f.
00000100:00000040:21.0:1773851869.198015:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000006763f x1859599618097856 msgsize 224
00000100:00100000:21.0:1773851869.198017:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14785@kfi7 (source: 12345-14784@kfi7)
00000100:00000001:21.0:1773851869.198017:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851869.198018:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000074b49cbe nid 14784@kfi7 refs 2
00000100:00000001:22.0:1773851869.198019:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851869.198019:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851869.198020:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851869.198020:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851869.198021:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851869.198022:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851869.198022:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599618097856
00000020:00000001:22.0:1773851869.198023:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851869.198023:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8011a
00000020:00000001:22.0:1773851869.198024:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851869.198028:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ae6e802d refcount=5
00000020:00000001:22.0:1773851869.198029:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072919491584 : -107000790060032 : ffff9eaeefeaf400)
00000020:00000001:22.0:1773851869.198030:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072919491584 : -107000790060032 : ffff9eaeefeaf400)
00000100:00000001:22.0:1773851869.198031:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.198031:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851869.198032:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002bfc08b2.
00000020:00000010:22.0:1773851869.198033:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851869.198034:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851869.198035:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851869.198035:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851869.198036:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851869.198037:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851869.198037:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851869.198038:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.198039:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851869.198040:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851869.198040:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851869.198040:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851869.198041:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851869.198041:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14785@kfi7, seq: 1997984
00000100:00000001:23.0:1773851869.198042:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.198042:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ae6e802d : new rpc_count 1
00000100:00000001:23.0:1773851869.198043:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.198043:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788262400 : -106974921289216 : ffff9eb4f5d11200)
00000100:00000040:22.0:1773851869.198044:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000006763f x1859599618097856/t0(0) o400->5b1b99f0-0907-4e34-9cd9-85708ac99756@14785@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1411-0'
00000100:00000001:22.0:1773851869.198046:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.198047:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851869.198048:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000006763f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:5b1b99f0-0907-4e34-9cd9-85708ac99756+5:39645:x1859599618097856:12345-14785@kfi7:400:default-tuolumne1411-0
00000100:00000200:22.0:1773851869.198049:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599618097856
00000020:00000001:22.0:1773851869.198050:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851869.198050:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851869.198051:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.198052:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851869.198052:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851869.198053:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851869.198054:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599618097856, found 0 last_xid 1859599618097855
00000020:00000001:22.0:1773851869.198054:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851869.198055:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851869.198056:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851869.198056:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.198057:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851869.198057:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851869.198058:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851869.198059:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d77a308a.
02000000:00000001:22.0:1773851869.198059:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.198060:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.198060:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851869.198061:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154594518, transno 0, xid 1859599618097856
00010000:00000001:22.0:1773851869.198062:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851869.198063:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000006763f x1859599618097856/t0(0) o400->5b1b99f0-0907-4e34-9cd9-85708ac99756@14785@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1411-0'
00010000:00000001:22.0:1773851869.198065:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851869.198066:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851869.198067:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=102 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851869.198068:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851869.198068:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000035334f9f refcount 3 to 14785@kfi7
00000100:00000001:22.0:1773851869.198069:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411904 : -107145304139712 : ffff9e8d4a351840)
02000000:00000001:22.0:1773851869.198070:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851869.198070:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.198071:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851869.198072:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14784@kfi7
00000400:00000010:22.0:1773851869.198072:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b1c91353.
00000100:00000200:22.0:1773851869.198073:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599618097856, offset 224
00000400:00000200:22.0:1773851869.198074:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14784@kfi7
00000400:00000200:22.0:1773851869.198075:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14784@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.198076:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074b49cbe nid 14784@kfi7 refs 1
00000400:00000200:22.0:1773851869.198077:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000074b49cbe nid 14784@kfi7 refs 2
00000400:00000200:22.0:1773851869.198078:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000074b49cbe nid 14784@kfi7 refs 3
00000400:00000200:22.0:1773851869.198079:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14784@kfi7 local destination
00000400:00000200:22.0:1773851869.198081:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769307:8769307:1024:4294967295] 14784@kfi7 LPNI seq info [20385867:20385867:16:4294967295]
00000400:00000200:22.0:1773851869.198082:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000074b49cbe nid 14784@kfi7 refs 2
00000400:00000200:22.0:1773851869.198083:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14784@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.198085:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14784@kfi7(14784@kfi7:14784@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851869.198086:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000074b49cbe nid 14784@kfi7 refs 3
00000800:00000200:22.0:1773851869.198087:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851869.198089:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2069@kfi7:5 -> 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851869.198091:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2069@kfi7:5 -> 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851869.198093:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2069@kfi7:5 -> 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x113f Using peer 14784@kfi7(0x113f)
00000800:00000200:22.0:1773851869.198096:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000068d775d8: Posted send of 324 bytes to peer 0x113f: rc=0
00000800:00000200:22.0:1773851869.198097:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2069@kfi7:5 -> 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x113f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851869.198099:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.198100:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000035334f9f refcount 2 to 14785@kfi7
00010000:00000001:22.0:1773851869.198101:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851869.198101:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.198102:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851869.198102:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000006763f x1859599618097856/t0(0) o400->5b1b99f0-0907-4e34-9cd9-85708ac99756@14785@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1411-0'
00000100:00100000:22.0:1773851869.198105:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000006763f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:5b1b99f0-0907-4e34-9cd9-85708ac99756+5:39645:x1859599618097856:12345-14785@kfi7:400:default-tuolumne1411-0 Request processed in 58us (90us total) trans 0 rc 0/0
00000100:00100000:22.0:1773851869.198108:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14785@kfi7, seq: 1997984
00000100:00000040:22.0:1773851869.198108:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ae6e802d : new rpc_count 0
00000100:00000001:22.0:1773851869.198109:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:22.0:1773851869.198109:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851869.198109:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2069@kfi7:5 -> 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x113f TN_EVENT_TX_OK event status 0
00000020:00000010:22.0:1773851869.198110:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851869.198110:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:22.0:1773851869.198111:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851869.198111:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002bfc08b2.
00000020:00000040:22.0:1773851869.198112:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000ae6e802d : new refcount 4
00000400:00000200:21.0:1773851869.198112:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14784@kfi7: PUT: OK
00000400:00000200:21.0:1773851869.198112:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b1c91353
00000100:00000001:22.0:1773851869.198113:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:21.0:1773851869.198113:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b1c91353.
00000100:00000001:21.0:1773851869.198114:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851869.198114:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851869.198115:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000074b49cbe nid 14784@kfi7 refs 2
00000800:00000200:21.0:1773851869.198117:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000068d775d8: 2069@kfi7:5 -> 14784@kfi7(00000000f9591180):0x0 lsk 4416 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x113f Transaction freed
00000800:00000200:29.0:1773851869.205936:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851869.205938:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851869.205939:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851869.205941:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851869.205943:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.205944:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851869.205945:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.205946:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851869.205947:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.205947:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851869.205948:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851869.205949:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.205950:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 224 into portal 12 MB=0x69a4ead6e4940
00000400:00000200:29.0:1773851869.205951:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16@kfi7 of length 224/224 into md 0x77fe139dd [64] + 177320
00000800:00000200:29.0:1773851869.205952:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851869.205954:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.205955:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851869.205956:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851869.205956:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851869.205957:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cbf4de82.
00000100:00000040:29.0:1773851869.205958:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000cbf4de82 x1858512568076608 msgsize 224
00000100:00100000:29.0:1773851869.205959:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16@kfi7 (source: 12345-16@kfi7)
00000100:00000001:29.0:1773851869.205960:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851869.205961:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:28.0:1773851869.205962:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851869.205962:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851869.205963:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851869.205963:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851869.205963:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851869.205964:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851869.205965:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858512568076608
00000020:00000001:28.0:1773851869.205965:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851869.205966:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb87d5
00000020:00000001:28.0:1773851869.205967:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851869.205970:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cb642a60 refcount=5
00000020:00000001:28.0:1773851869.205970:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636943346290688 : -107130363260928 : ffff9e90c4c0d000)
00000020:00000001:28.0:1773851869.205971:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636943346290688 : -107130363260928 : ffff9e90c4c0d000)
00000100:00000001:28.0:1773851869.205972:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851869.205973:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851869.205974:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f45ca2b5.
00000020:00000010:28.0:1773851869.205975:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851869.205975:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000096ac59f6.
00000100:00000001:28.0:1773851869.205976:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851869.205977:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851869.205977:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851869.205978:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851869.205979:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851869.205979:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851869.205980:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851869.205981:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851869.205982:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851869.205982:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851869.205982:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851869.205983:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16@kfi7, seq: 2055528
00000100:00000040:31.0:1773851869.205984:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cb642a60 : new rpc_count 1
00000100:00000001:28.0:1773851869.205984:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.205985:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309684864 : -106988399866752 : ffff9eb1d26e4c80)
00000100:00000001:28.0:1773851869.205985:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851869.205986:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cbf4de82 x1858512568076608/t0(0) o400->lustre5-MDT0001-lwp-OST0006_UUID@16@kfi7:657/0 lens 224/0 e 0 to 0 dl 1773852017 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba107-0'
00000100:00000001:31.0:1773851869.205989:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851869.205989:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851869.205991:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cbf4de82 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0006_UUID+5:261826:x1858512568076608:12345-16@kfi7:400:default-yuba107-0
00000100:00000200:31.0:1773851869.205992:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858512568076608
00000020:00000001:31.0:1773851869.205993:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851869.205994:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851869.205994:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851869.205995:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851869.205995:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851869.205996:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:31.0:1773851869.205997:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851869.205998:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851869.205998:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851869.205999:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851869.205999:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851869.206000:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851869.206000:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851869.206001:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0bf80b5.
02000000:00000001:31.0:1773851869.206002:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.206003:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851869.206003:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851869.206004:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858512568076608
00010000:00000001:31.0:1773851869.206005:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851869.206006:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cbf4de82 x1858512568076608/t0(0) o400->lustre5-MDT0001-lwp-OST0006_UUID@16@kfi7:657/0 lens 224/224 e 0 to 0 dl 1773852017 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba107-0'
00010000:00000001:31.0:1773851869.206008:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851869.206009:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851869.206009:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=102 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851869.206010:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851869.206011:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0f73380 refcount 7 to 16@kfi7
00000100:00000001:31.0:1773851869.206012:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066336 : -107155994485280 : ffff9e8acd035de0)
02000000:00000001:31.0:1773851869.206013:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851869.206013:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.206014:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851869.206014:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:31.0:1773851869.206015:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000761d5a45.
00000100:00000200:31.0:1773851869.206016:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858512568076608, offset 224
00000400:00000200:31.0:1773851869.206018:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:31.0:1773851869.206018:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:31.0:1773851869.206019:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:31.0:1773851869.206020:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:31.0:1773851869.206021:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:31.0:1773851869.206023:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16@kfi7 local destination
00000400:00000200:31.0:1773851869.206024:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769308:8769308:1024:4294967295] 16@kfi7 LPNI seq info [5403815:5403815:16:4294967295]
00000400:00000200:31.0:1773851869.206025:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:31.0:1773851869.206026:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:31.0:1773851869.206028:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851869.206029:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:31.0:1773851869.206031:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851869.206032:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851869.206034:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851869.206036:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000169 Using peer 16@kfi7(0x200000000000169)
00000800:00000200:31.0:1773851869.206039:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x200000000000169: rc=0
00000800:00000200:31.0:1773851869.206041:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000169 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851869.206043:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851869.206044:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0f73380 refcount 6 to 16@kfi7
00010000:00000001:31.0:1773851869.206045:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851869.206045:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851869.206046:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851869.206047:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cbf4de82 x1858512568076608/t0(0) o400->lustre5-MDT0001-lwp-OST0006_UUID@16@kfi7:657/0 lens 224/224 e 0 to 0 dl 1773852017 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba107-0'
00000100:00100000:31.0:1773851869.206050:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cbf4de82 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0006_UUID+5:261826:x1858512568076608:12345-16@kfi7:400:default-yuba107-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851869.206052:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000169 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851869.206053:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.206054:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000400:00000200:29.0:1773851869.206055:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000761d5a45
00000400:00000010:29.0:1773851869.206056:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000761d5a45.
00000100:00000001:29.0:1773851869.206056:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:31.0:1773851869.206057:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16@kfi7, seq: 2055528
00000100:00000001:29.0:1773851869.206057:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:31.0:1773851869.206058:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cb642a60 : new rpc_count 0
00000400:00000200:29.0:1773851869.206058:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:31.0:1773851869.206059:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851869.206059:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851869.206059:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000169 Transaction freed
00000020:00000010:31.0:1773851869.206060:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851869.206060:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000096ac59f6.
00000020:00000010:31.0:1773851869.206061:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f45ca2b5.
00000020:00000040:31.0:1773851869.206062:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000cb642a60 : new refcount 4
00000100:00000001:31.0:1773851869.206063:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851869.321734:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321734:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321742:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851869.321742:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851869.321743:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321744:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851869.321745:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321745:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321746:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321748:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851869.321749:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851869.321749:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321750:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851869.321751:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321752:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321753:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321754:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321755:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851869.321755:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851869.321756:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321757:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851869.321758:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321759:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321760:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851869.321762:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851869.321762:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851869.321767:0:937833:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:1.0:1773851869.321768:0:937833:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851869.321770:0:937833:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:21.0:1773851869.336790:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851869.336792:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851869.336794:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851869.336797:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851869.336800:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14242@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.336802:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14242@kfi7 : PUT - for me
00000400:00000200:21.0:1773851869.336804:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14242@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.336805:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cfd8c8b nid 14242@kfi7 refs 1
00000400:00000200:21.0:1773851869.336807:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14242@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.336808:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cfd8c8b nid 14242@kfi7 refs 2
00000400:00000200:21.0:1773851869.336809:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006cfd8c8b nid 14242@kfi7 refs 3
00000400:00000200:21.0:1773851869.336811:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14179@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.336812:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14179@kfi7 of length 224 into portal 12 MB=0x69b4b56154a80
00000400:00000200:21.0:1773851869.336814:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14179@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 38400
00000800:00000200:21.0:1773851869.336816:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851869.336819:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851869.336820:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14242@kfi7: PUT: OK
00000100:00000001:21.0:1773851869.336822:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851869.336823:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851869.336824:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eea8da4d.
00000100:00000040:21.0:1773851869.336825:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000eea8da4d x1859597729352320 msgsize 224
00000100:00100000:21.0:1773851869.336827:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14179@kfi7 (source: 12345-14242@kfi7)
00000100:00000001:21.0:1773851869.336829:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851869.336830:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006cfd8c8b nid 14242@kfi7 refs 2
00000100:00000001:22.0:1773851869.336831:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851869.336832:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851869.336833:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851869.336833:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851869.336834:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851869.336835:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851869.336837:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597729352320
00000020:00000001:22.0:1773851869.336838:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851869.336838:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f558
00000020:00000001:22.0:1773851869.336839:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851869.336844:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ce72ce4f refcount=5
00000020:00000001:22.0:1773851869.336845:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636998369979392 : -107075339572224 : ffff9e9d946bac00)
00000020:00000001:22.0:1773851869.336847:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636998369979392 : -107075339572224 : ffff9e9d946bac00)
00000100:00000001:22.0:1773851869.336848:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.336849:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851869.336851:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002bfc08b2.
00000020:00000010:22.0:1773851869.336852:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851869.336853:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851869.336855:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851869.336855:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851869.336856:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851869.336858:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851869.336858:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851869.336859:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.336861:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851869.336862:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851869.336863:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851869.336863:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851869.336864:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851869.336865:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14179@kfi7, seq: 1997985
00000100:00000001:23.0:1773851869.336866:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.336866:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ce72ce4f : new rpc_count 1
00000100:00000001:23.0:1773851869.336867:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.336867:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788281984 : -106974921269632 : ffff9eb4f5d15e80)
00000100:00000040:22.0:1773851869.336869:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eea8da4d x1859597729352320/t0(0) o400->8f79f6cb-f851-4d95-a80b-418e0a164fd9@14179@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1372-0'
00000100:00000001:22.0:1773851869.336874:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.336875:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851869.336876:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eea8da4d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:8f79f6cb-f851-4d95-a80b-418e0a164fd9+5:39544:x1859597729352320:12345-14179@kfi7:400:default-tuolumne1372-0
00000100:00000200:22.0:1773851869.336878:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597729352320
00000020:00000001:22.0:1773851869.336879:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851869.336880:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851869.336882:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.336883:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851869.336884:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851869.336885:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851869.336886:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597729352320, found 0 last_xid 1859597729352319
00000020:00000001:22.0:1773851869.336887:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851869.336888:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851869.336889:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851869.336890:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.336890:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851869.336891:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851869.336892:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851869.336893:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007ba23cf7.
02000000:00000001:22.0:1773851869.336894:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.336895:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.336896:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851869.336897:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096704483, transno 0, xid 1859597729352320
00010000:00000001:22.0:1773851869.336899:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851869.336900:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eea8da4d x1859597729352320/t0(0) o400->8f79f6cb-f851-4d95-a80b-418e0a164fd9@14179@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1372-0'
00010000:00000001:22.0:1773851869.336904:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851869.336905:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851869.336906:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=102 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851869.336908:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851869.336909:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f283a2eb refcount 3 to 14179@kfi7
00000100:00000001:22.0:1773851869.336910:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355110144 : -107156354441472 : ffff9e8ab78edf00)
02000000:00000001:22.0:1773851869.336911:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851869.336912:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.336913:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851869.336914:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14242@kfi7
00000400:00000010:22.0:1773851869.336915:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b975f2ee.
00000100:00000200:22.0:1773851869.336916:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597729352320, offset 224
00000400:00000200:22.0:1773851869.336918:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14242@kfi7
00000400:00000200:22.0:1773851869.336920:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14242@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.336921:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006cfd8c8b nid 14242@kfi7 refs 1
00000400:00000200:22.0:1773851869.336923:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006cfd8c8b nid 14242@kfi7 refs 2
00000400:00000200:22.0:1773851869.336925:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006cfd8c8b nid 14242@kfi7 refs 3
00000400:00000200:22.0:1773851869.336927:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14242@kfi7 local destination
00000400:00000200:22.0:1773851869.336929:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769309:8769309:1024:4294967295] 14242@kfi7 LPNI seq info [195247:195247:16:4294967295]
00000400:00000200:22.0:1773851869.336932:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006cfd8c8b nid 14242@kfi7 refs 2
00000400:00000200:22.0:1773851869.336933:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14242@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.336936:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14242@kfi7(14242@kfi7:14242@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851869.336938:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006cfd8c8b nid 14242@kfi7 refs 3
00000800:00000200:22.0:1773851869.336940:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851869.336942:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851869.336946:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851869.336949:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb9e Using peer 14242@kfi7(0xb9e)
00000800:00000200:22.0:1773851869.336954:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000389ce1b3: Posted send of 324 bytes to peer 0xb9e: rc=0
00000800:00000200:22.0:1773851869.336956:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb9e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851869.336959:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.336960:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f283a2eb refcount 2 to 14179@kfi7
00010000:00000001:22.0:1773851869.336961:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851869.336962:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.336963:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851869.336964:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eea8da4d x1859597729352320/t0(0) o400->8f79f6cb-f851-4d95-a80b-418e0a164fd9@14179@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1372-0'
00000100:00100000:22.0:1773851869.336969:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eea8da4d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:8f79f6cb-f851-4d95-a80b-418e0a164fd9+5:39544:x1859597729352320:12345-14179@kfi7:400:default-tuolumne1372-0 Request processed in 94us (143us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851869.336970:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb9e TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851869.336973:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14179@kfi7, seq: 1997985
00000400:00000200:21.0:1773851869.336973:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:22.0:1773851869.336974:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ce72ce4f : new rpc_count 0
00000400:00000200:21.0:1773851869.336974:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14242@kfi7: PUT: OK
00000400:00000200:21.0:1773851869.336976:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b975f2ee
00000400:00000010:21.0:1773851869.336977:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b975f2ee.
00000100:00000001:22.0:1773851869.336978:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851869.336978:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851869.336979:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:21.0:1773851869.336979:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851869.336980:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851869.336980:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006cfd8c8b nid 14242@kfi7 refs 2
00000020:00000010:22.0:1773851869.336981:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:22.0:1773851869.336982:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002bfc08b2.
00000800:00000200:21.0:1773851869.336982:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000389ce1b3: 2069@kfi7:5 -> 14242@kfi7(0000000050108157):0x0 lsk 2975 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb9e Transaction freed
00000020:00000040:22.0:1773851869.336984:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000ce72ce4f : new refcount 4
00000100:00000001:22.0:1773851869.336985:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851869.368688:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851869.368689:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851869.368690:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851869.368692:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851869.368694:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25457@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.368696:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25457@kfi7 : PUT - for me
00000400:00000200:13.0:1773851869.368697:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25457@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.368698:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000022135d79 nid 25457@kfi7 refs 1
00000400:00000200:13.0:1773851869.368699:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25457@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.368700:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000022135d79 nid 25457@kfi7 refs 2
00000400:00000200:13.0:1773851869.368701:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000022135d79 nid 25457@kfi7 refs 3
00000400:00000200:13.0:1773851869.368702:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25457@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.368703:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25457@kfi7 of length 456 into portal 12 MB=0x69b4bcf072ac0
00000400:00000200:13.0:1773851869.368704:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25457@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 30696
00000800:00000200:13.0:1773851869.368707:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851869.368709:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.368710:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25457@kfi7: PUT: OK
00000100:00000001:13.0:1773851869.368711:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851869.368711:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851869.368712:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ee97d023.
00000100:00000040:13.0:1773851869.368713:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ee97d023 x1859599758469824 msgsize 456
00000100:00100000:13.0:1773851869.368715:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25457@kfi7 (source: 12345-25457@kfi7)
00000100:00000001:13.0:1773851869.368716:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851869.368717:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000022135d79 nid 25457@kfi7 refs 2
00000800:00000200:13.0:1773851869.368718:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851869.368718:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851869.368718:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851869.368719:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851869.368719:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851869.368720:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851869.368721:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599758469824
00000020:00000001:12.0:1773851869.368722:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851869.368722:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3891d88d
00000020:00000001:12.0:1773851869.368723:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.368731:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fe8b4902 refcount=9
00000020:00000001:12.0:1773851869.368732:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112641817600 : -106961067734016 : ffff9eb82f8d8c00)
00000020:00000001:12.0:1773851869.368733:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637112641817600 : -106961067734016 : ffff9eb82f8d8c00)
00000100:00000001:12.0:1773851869.368734:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851869.368735:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851869.368736:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000048bd73e6.
00000020:00000010:12.0:1773851869.368737:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851869.368738:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000001:12.0:1773851869.368739:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851869.368739:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851869.368740:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.368741:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.368742:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851869.368744:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851869.368744:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851869.368745:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851869.368745:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851869.368746:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25457@kfi7, seq: 411190547
00000100:00000001:15.0:1773851869.368747:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.368747:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851869.368747:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fe8b4902 : new rpc_count 1
00000100:00000001:12.0:1773851869.368747:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970969728 : -107043738581888 : ffff9ea4effc8480)
00000100:00000040:12.0:1773851869.368749:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ee97d023 x1859599758469824/t0(0) o17->7ba93853-10aa-4f45-abd2-62b3383f3985@25457@kfi7:596/0 lens 456/0 e 0 to 0 dl 1773851956 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2078-0'
00000100:00000001:12.0:1773851869.368751:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851869.368751:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851869.368753:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee97d023 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7ba93853-10aa-4f45-abd2-62b3383f3985+9:39520:x1859599758469824:12345-25457@kfi7:17:default-tuolumne2078-0
00000100:00000200:12.0:1773851869.368755:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599758469824
00000020:00000001:12.0:1773851869.368755:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851869.368756:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851869.368757:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.368757:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851869.368758:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:12.0:1773851869.368759:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851869.368759:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599758469824, found 0 last_xid 1859599758469823
00000020:00000001:12.0:1773851869.368760:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851869.368761:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851869.368762:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851869.368762:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.368764:0:60487:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:12.0:1773851869.368766:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851869.368766:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851869.368767:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000525c3984.
02000000:00000001:12.0:1773851869.368768:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.368769:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.368770:0:60487:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:12.0:1773851869.368772:0:60487:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:12.0:1773851869.368773:0:60487:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:12.0:1773851869.368777:0:60487:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.368778:0:60487:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:12.0:1773851869.368779:0:60487:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7ba93853-10aa-4f45-abd2-62b3383f3985/00000000fe8b4902 free: 126633370845184 avail: 126633368748032
00000020:00000001:12.0:1773851869.368781:0:60487:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:12.0:1773851869.368781:0:60487:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7ba93853-10aa-4f45-abd2-62b3383f3985/00000000fe8b4902 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:12.0:1773851869.368783:0:60487:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:12.0:1773851869.368784:0:60487:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:12.0:1773851869.368785:0:60487:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 7ba93853-10aa-4f45-abd2-62b3383f3985/00000000fe8b4902 reports grant 1811939327 dropped 0, local 1880096767
00000020:00000001:12.0:1773851869.368786:0:60487:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:12.0:1773851869.368787:0:60487:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:12.0:1773851869.368788:0:60487:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851869.368789:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260551860, transno 0, xid 1859599758469824
00010000:00000001:12.0:1773851869.368790:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851869.368791:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ee97d023 x1859599758469824/t0(0) o17->7ba93853-10aa-4f45-abd2-62b3383f3985@25457@kfi7:596/0 lens 456/432 e 0 to 0 dl 1773851956 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2078-0'
00010000:00000001:12.0:1773851869.368793:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851869.368794:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851869.368795:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=102 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851869.368796:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851869.368796:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a8a1aba8 refcount 3 to 25457@kfi7
00000100:00000001:12.0:1773851869.368797:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729300032 : -107155980251584 : ffff9e8acddc8e40)
02000000:00000001:12.0:1773851869.368798:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851869.368799:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.368799:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851869.368800:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25457@kfi7
00000400:00000010:12.0:1773851869.368801:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a2534e29.
00000100:00000200:12.0:1773851869.368802:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859599758469824, offset 224
00000400:00000200:12.0:1773851869.368803:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25457@kfi7
00000400:00000200:12.0:1773851869.368804:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25457@kfi7 to cpt 3
00000400:00000200:12.0:1773851869.368805:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000022135d79 nid 25457@kfi7 refs 1
00000400:00000200:12.0:1773851869.368806:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000022135d79 nid 25457@kfi7 refs 2
00000400:00000200:12.0:1773851869.368807:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000022135d79 nid 25457@kfi7 refs 3
00000400:00000200:12.0:1773851869.368808:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25457@kfi7 local destination
00000400:00000200:12.0:1773851869.368810:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769310:8769310:1024:4294967295] 25457@kfi7 LPNI seq info [3254691:3254691:16:4294967295]
00000400:00000200:12.0:1773851869.368811:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000022135d79 nid 25457@kfi7 refs 2
00000400:00000200:12.0:1773851869.368812:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25457@kfi7 to cpt 3
00000400:00000200:12.0:1773851869.368814:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25457@kfi7(25457@kfi7:25457@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851869.368815:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000022135d79 nid 25457@kfi7 refs 3
00000800:00000200:12.0:1773851869.368817:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851869.368818:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:12.0:1773851869.368820:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851869.368824:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x156 Using peer 25457@kfi7(0x156)
00000800:00000200:12.0:1773851869.368827:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000025990170: Posted send of 532 bytes to peer 0x156: rc=0
00000800:00000200:12.0:1773851869.368829:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x156 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851869.368831:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851869.368832:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a8a1aba8 refcount 2 to 25457@kfi7
00010000:00000001:12.0:1773851869.368833:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851869.368833:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.368834:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851869.368835:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ee97d023 x1859599758469824/t0(0) o17->7ba93853-10aa-4f45-abd2-62b3383f3985@25457@kfi7:596/0 lens 456/432 e 0 to 0 dl 1773851956 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2078-0'
00000100:00100000:12.0:1773851869.368839:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee97d023 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7ba93853-10aa-4f45-abd2-62b3383f3985+9:39520:x1859599758469824:12345-25457@kfi7:17:default-tuolumne2078-0 Request processed in 87us (125us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851869.368842:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25457@kfi7, seq: 411190547
00000100:00000040:12.0:1773851869.368842:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fe8b4902 : new rpc_count 0
00000100:00000001:12.0:1773851869.368843:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851869.368844:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851869.368844:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851869.368845:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:12.0:1773851869.368846:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000048bd73e6.
00000020:00000040:12.0:1773851869.368847:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000fe8b4902 : new refcount 8
00000100:00000001:12.0:1773851869.368848:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851869.368853:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x156 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851869.368854:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.368856:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25457@kfi7: PUT: OK
00000400:00000200:13.0:1773851869.368856:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a2534e29
00000400:00000010:13.0:1773851869.368857:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a2534e29.
00000100:00000001:13.0:1773851869.368858:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851869.368858:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851869.368859:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000022135d79 nid 25457@kfi7 refs 2
00000800:00000200:13.0:1773851869.368860:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 25457@kfi7(00000000c43c15d7):0x0 lsk 343 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x156 Transaction freed
00000800:00000200:21.0:1773851869.401019:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851869.401019:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851869.401020:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851869.401022:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851869.401024:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21507@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.401025:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21507@kfi7 : PUT - for me
00000400:00000200:21.0:1773851869.401026:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21507@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.401027:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000acb39b2 nid 21507@kfi7 refs 1
00000400:00000200:21.0:1773851869.401027:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21507@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.401028:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000acb39b2 nid 21507@kfi7 refs 2
00000400:00000200:21.0:1773851869.401029:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000acb39b2 nid 21507@kfi7 refs 3
00000400:00000200:21.0:1773851869.401029:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21698@kfi7 to cpt 5
00000400:00000200:21.0:1773851869.401030:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21698@kfi7 of length 224 into portal 12 MB=0x69b095dade040
00000400:00000200:21.0:1773851869.401031:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21698@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 38624
00000800:00000200:21.0:1773851869.401033:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851869.401034:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851869.401035:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21507@kfi7: PUT: OK
00000100:00000001:21.0:1773851869.401036:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851869.401036:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851869.401037:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5a8d378.
00000100:00000040:21.0:1773851869.401038:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c5a8d378 x1859314388951104 msgsize 224
00000100:00100000:21.0:1773851869.401039:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21698@kfi7 (source: 12345-21507@kfi7)
00000100:00000001:21.0:1773851869.401040:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851869.401041:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000acb39b2 nid 21507@kfi7 refs 2
00000100:00000001:22.0:1773851869.401042:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851869.401042:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851869.401043:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851869.401043:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851869.401043:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851869.401044:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851869.401045:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314388951104
00000020:00000001:22.0:1773851869.401046:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851869.401046:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e14
00000020:00000001:22.0:1773851869.401047:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851869.401049:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004117ef55 refcount=6
00000020:00000001:22.0:1773851869.401050:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744428544 : -107128965123072 : ffff9e911816b400)
00000020:00000001:22.0:1773851869.401051:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744428544 : -107128965123072 : ffff9e911816b400)
00000100:00000001:22.0:1773851869.401052:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.401052:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851869.401053:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002bfc08b2.
00000020:00000010:22.0:1773851869.401054:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851869.401055:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851869.401056:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851869.401056:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851869.401057:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851869.401058:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851869.401058:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851869.401058:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.401059:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851869.401061:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851869.401061:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851869.401061:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851869.401062:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851869.401062:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21698@kfi7, seq: 1997986
00000100:00000001:23.0:1773851869.401063:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.401063:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004117ef55 : new rpc_count 1
00000100:00000001:23.0:1773851869.401064:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.401064:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788258944 : -106974921292672 : ffff9eb4f5d10480)
00000100:00000040:22.0:1773851869.401065:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c5a8d378 x1859314388951104/t0(0) o400->c09f0d06-a092-4b0d-b17f-9217129fc642@21698@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1847-0'
00000100:00000001:22.0:1773851869.401068:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.401069:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851869.401070:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5a8d378 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c09f0d06-a092-4b0d-b17f-9217129fc642+6:39591:x1859314388951104:12345-21698@kfi7:400:default-tuolumne1847-0
00000100:00000200:22.0:1773851869.401071:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314388951104
00000020:00000001:22.0:1773851869.401072:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851869.401072:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851869.401073:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.401073:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851869.401074:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851869.401075:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851869.401075:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314388951104, found 0 last_xid 1859314388951103
00000020:00000001:22.0:1773851869.401076:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851869.401077:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851869.401077:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851869.401078:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.401078:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851869.401079:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851869.401079:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851869.401080:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e5b1b3b8.
02000000:00000001:22.0:1773851869.401081:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.401081:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.401082:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851869.401082:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691041, transno 0, xid 1859314388951104
00010000:00000001:22.0:1773851869.401083:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851869.401084:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c5a8d378 x1859314388951104/t0(0) o400->c09f0d06-a092-4b0d-b17f-9217129fc642@21698@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1847-0'
00010000:00000001:22.0:1773851869.401086:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851869.401087:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851869.401088:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=102 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851869.401089:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851869.401090:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000309ebd86 refcount 3 to 21698@kfi7
00000100:00000001:22.0:1773851869.401090:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450752 : -107146752100864 : ffff9e8cf3e6f600)
02000000:00000001:22.0:1773851869.401091:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851869.401092:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.401092:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851869.401093:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21507@kfi7
00000400:00000010:22.0:1773851869.401094:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d078057.
00000100:00000200:22.0:1773851869.401095:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314388951104, offset 224
00000400:00000200:22.0:1773851869.401096:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21507@kfi7
00000400:00000200:22.0:1773851869.401097:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21507@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.401097:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000acb39b2 nid 21507@kfi7 refs 1
00000400:00000200:22.0:1773851869.401099:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000acb39b2 nid 21507@kfi7 refs 2
00000400:00000200:22.0:1773851869.401100:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000acb39b2 nid 21507@kfi7 refs 3
00000400:00000200:22.0:1773851869.401101:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21507@kfi7 local destination
00000400:00000200:22.0:1773851869.401102:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769311:8769311:1024:4294967295] 21507@kfi7 LPNI seq info [806892:806892:16:4294967295]
00000400:00000200:22.0:1773851869.401104:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000acb39b2 nid 21507@kfi7 refs 2
00000400:00000200:22.0:1773851869.401105:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21507@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.401107:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21507@kfi7(21507@kfi7:21507@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851869.401108:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000acb39b2 nid 21507@kfi7 refs 3
00000800:00000200:22.0:1773851869.401109:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851869.401110:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851869.401112:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851869.401114:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ec6 Using peer 21507@kfi7(0x100000000000ec6)
00000800:00000200:22.0:1773851869.401118:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000008ad6e841: Posted send of 324 bytes to peer 0x100000000000ec6: rc=0
00000800:00000200:22.0:1773851869.401119:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ec6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851869.401121:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.401122:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000309ebd86 refcount 2 to 21698@kfi7
00010000:00000001:22.0:1773851869.401123:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851869.401123:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.401124:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851869.401125:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5a8d378 x1859314388951104/t0(0) o400->c09f0d06-a092-4b0d-b17f-9217129fc642@21698@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1847-0'
00000100:00100000:22.0:1773851869.401128:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5a8d378 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c09f0d06-a092-4b0d-b17f-9217129fc642+6:39591:x1859314388951104:12345-21698@kfi7:400:default-tuolumne1847-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851869.401129:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ec6 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851869.401130:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21698@kfi7, seq: 1997986
00000100:00000040:22.0:1773851869.401130:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004117ef55 : new rpc_count 0
00000400:00000200:21.0:1773851869.401130:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851869.401131:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851869.401131:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21507@kfi7: PUT: OK
00000100:00000001:22.0:1773851869.401132:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851869.401132:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000400:00000200:21.0:1773851869.401132:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d078057
00000020:00000010:22.0:1773851869.401133:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000010:21.0:1773851869.401133:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d078057.
00000100:00000001:21.0:1773851869.401133:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:22.0:1773851869.401134:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002bfc08b2.
00000020:00000040:22.0:1773851869.401134:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000004117ef55 : new refcount 5
00000100:00000001:21.0:1773851869.401134:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851869.401134:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000acb39b2 nid 21507@kfi7 refs 2
00000100:00000001:22.0:1773851869.401135:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851869.401136:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008ad6e841: 2054@kfi7:5 -> 21507@kfi7(000000003c8d3adf):0x0 lsk 3783 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ec6 Transaction freed
00000800:00000200:17.0:1773851869.463938:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851869.463940:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851869.463942:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851869.463945:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851869.463949:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.463951:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.2@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851869.463952:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.463954:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851869.463955:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:17.0:1773851869.463957:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:17.0:1773851869.463959:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000400:00000200:17.0:1773851869.463961:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:17.0:1773851869.463963:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.2@o2ib60 of length 440 into portal 17 MB=0x69a0f946a1600
00000400:00000200:17.0:1773851869.463966:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-192.168.128.2@o2ib60 of length 440/440 into md 0x82a56312d [2] + 328
00000800:00000200:17.0:1773851869.463969:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851869.463972:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851869.463974:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851869.463975:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851869.463976:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:17.0:1773851869.463977:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000504c565c.
00000100:00000040:17.0:1773851869.463979:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000504c565c x1858241565431296 msgsize 440
00000100:00100000:17.0:1773851869.463982:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.2@o2ib60 (source: 12345-192.168.128.2@o2ib60)
00000100:00000001:17.0:1773851869.463984:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851869.463985:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851869.463988:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851869.463989:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851869.463990:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851869.463990:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851869.463991:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851869.463992:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851869.463992:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858241565431296
00000020:00000001:12.0:1773851869.463993:0:609420:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851869.463994:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9303d
00000020:00000001:12.0:1773851869.463995:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.463996:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000394656e8 refcount=167
00000020:00000001:12.0:1773851869.463997:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000020:00000001:12.0:1773851869.463997:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000100:00000001:12.0:1773851869.463998:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851869.463999:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851869.464000:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000048bd73e6.
00000020:00000010:12.0:1773851869.464001:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851869.464002:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000040:12.0:1773851869.464003:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:12.0:1773851869.464004:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851869.464004:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:12.0:1773851869.464005:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:12.0:1773851869.464006:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464007:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:12.0:1773851869.464008:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464009:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464010:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000086ac820b refcount=3
00000020:00000001:12.0:1773851869.464010:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956339224576 : -107117370327040 : ffff9e93cb314000)
00010000:00000001:12.0:1773851869.464011:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636956339224576 : -107117370327040 : ffff9e93cb314000)
00010000:00000001:12.0:1773851869.464012:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464013:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464013:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464014:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464015:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c167bd8f refcount=3
00000020:00000001:12.0:1773851869.464015:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956339228032 : -107117370323584 : ffff9e93cb314d80)
00010000:00000001:12.0:1773851869.464016:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636956339228032 : -107117370323584 : ffff9e93cb314d80)
00010000:00000001:12.0:1773851869.464017:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464017:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464017:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464018:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464018:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000605f5d3a refcount=3
00000020:00000001:12.0:1773851869.464019:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873504256 : -107009836047360 : ffff9eacd4bc2400)
00010000:00000001:12.0:1773851869.464019:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873504256 : -107009836047360 : ffff9eacd4bc2400)
00010000:00000001:12.0:1773851869.464020:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464021:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464021:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464021:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464022:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000015f25373 refcount=3
00000020:00000001:12.0:1773851869.464023:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873505408 : -107009836046208 : ffff9eacd4bc2880)
00010000:00000001:12.0:1773851869.464023:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873505408 : -107009836046208 : ffff9eacd4bc2880)
00010000:00000001:12.0:1773851869.464024:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464024:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464025:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464025:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464026:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006f666af1 refcount=3
00000020:00000001:12.0:1773851869.464026:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873497344 : -107009836054272 : ffff9eacd4bc0900)
00010000:00000001:12.0:1773851869.464027:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873497344 : -107009836054272 : ffff9eacd4bc0900)
00010000:00000001:12.0:1773851869.464027:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464028:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464028:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464028:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464029:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006b1d438e refcount=3
00000020:00000001:12.0:1773851869.464030:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873508288 : -107009836043328 : ffff9eacd4bc33c0)
00010000:00000001:12.0:1773851869.464031:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873508288 : -107009836043328 : ffff9eacd4bc33c0)
00010000:00000001:12.0:1773851869.464031:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464032:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464032:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464032:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464033:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f9f3f80a refcount=3
00000020:00000001:12.0:1773851869.464033:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873502528 : -107009836049088 : ffff9eacd4bc1d40)
00010000:00000001:12.0:1773851869.464034:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873502528 : -107009836049088 : ffff9eacd4bc1d40)
00010000:00000001:12.0:1773851869.464035:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464035:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464035:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464036:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464036:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c826cbf9 refcount=3
00000020:00000001:12.0:1773851869.464037:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944997564992 : -107128711986624 : ffff9e91272d4240)
00010000:00000001:12.0:1773851869.464038:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636944997564992 : -107128711986624 : ffff9e91272d4240)
00010000:00000001:12.0:1773851869.464039:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464039:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464040:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464040:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464041:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f3a5791d refcount=3
00000020:00000001:12.0:1773851869.464041:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873500800 : -107009836050816 : ffff9eacd4bc1680)
00010000:00000001:12.0:1773851869.464042:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873500800 : -107009836050816 : ffff9eacd4bc1680)
00010000:00000001:12.0:1773851869.464042:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464043:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464043:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464043:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464044:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000916a8e80 refcount=3
00000020:00000001:12.0:1773851869.464045:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942679552 : -106911766872064 : ffff9ec3aa1d0000)
00010000:00000001:12.0:1773851869.464045:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942679552 : -106911766872064 : ffff9ec3aa1d0000)
00010000:00000001:12.0:1773851869.464046:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464046:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464047:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464047:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464048:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000dde27669 refcount=3
00000020:00000001:12.0:1773851869.464048:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942681280 : -106911766870336 : ffff9ec3aa1d06c0)
00010000:00000001:12.0:1773851869.464049:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942681280 : -106911766870336 : ffff9ec3aa1d06c0)
00010000:00000001:12.0:1773851869.464049:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464050:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464050:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464050:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464051:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000dc4b6603 refcount=3
00000020:00000001:12.0:1773851869.464052:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942687616 : -106911766864000 : ffff9ec3aa1d1f80)
00010000:00000001:12.0:1773851869.464052:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942687616 : -106911766864000 : ffff9ec3aa1d1f80)
00010000:00000001:12.0:1773851869.464053:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464053:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464054:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464054:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464055:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009c5cbfef refcount=3
00000020:00000001:12.0:1773851869.464056:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637050599997440 : -107023109554176 : ffff9ea9bd928000)
00010000:00000001:12.0:1773851869.464057:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637050599997440 : -107023109554176 : ffff9ea9bd928000)
00010000:00000001:12.0:1773851869.464057:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464058:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464058:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464058:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464059:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000de48726b refcount=3
00000020:00000001:12.0:1773851869.464059:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637050600004352 : -107023109547264 : ffff9ea9bd929b00)
00010000:00000001:12.0:1773851869.464060:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637050600004352 : -107023109547264 : ffff9ea9bd929b00)
00010000:00000001:12.0:1773851869.464060:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464061:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464061:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464061:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464062:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002d17a39b refcount=3
00000020:00000001:12.0:1773851869.464063:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637050600011264 : -107023109540352 : ffff9ea9bd92b600)
00010000:00000001:12.0:1773851869.464063:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637050600011264 : -107023109540352 : ffff9ea9bd92b600)
00010000:00000001:12.0:1773851869.464064:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464064:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464065:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464065:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464066:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ae4e588a refcount=3
00000020:00000001:12.0:1773851869.464066:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942695104 : -106911766856512 : ffff9ec3aa1d3cc0)
00010000:00000001:12.0:1773851869.464067:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942695104 : -106911766856512 : ffff9ec3aa1d3cc0)
00010000:00000001:12.0:1773851869.464067:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464068:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464068:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.464069:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.464071:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.464073:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851869.464075:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851869.464075:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851869.464077:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851869.464077:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851869.464077:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.2@o2ib60, seq: 50273007
00000100:00000040:12.0:1773851869.464077:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000394656e8 : new rpc_count 1
00000100:00000001:13.0:1773851869.464078:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.464078:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128161655168 : -106945547896448 : ffff9ebbcc9b7980)
00000100:00000001:13.0:1773851869.464079:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851869.464080:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000504c565c x1858241565431296/t0(0) o103->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 440/0 e 0 to 0 dl 1773851956 ref 1 fl New:/0/ffffffff rc 0/-1 job:'login-matrix2-0'
00000100:00000001:12.0:1773851869.464083:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851869.464084:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851869.464085:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000504c565c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:3f210437-b2af-4977-93b4-45f1c345c3ce+167:59071:x1858241565431296:12345-192.168.128.2@o2ib60:103:login-matrix2-0
00000100:00000200:12.0:1773851869.464087:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858241565431296
00010000:00000001:12.0:1773851869.464088:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:12.0:1773851869.464088:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:12.0:1773851869.464089:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:12.0:1773851869.464091:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851869.464092:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851869.464092:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000290d0842.
02000000:00000001:12.0:1773851869.464093:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.464094:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464095:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:12.0:1773851869.464095:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0
00010000:00000001:12.0:1773851869.464096:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464096:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464097:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000086ac820b refcount=3
00000020:00000001:12.0:1773851869.464097:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956339224576 : -107117370327040 : ffff9e93cb314000)
00010000:00000001:12.0:1773851869.464098:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636956339224576 : -107117370327040 : ffff9e93cb314000)
00010000:00000040:12.0:1773851869.464100:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000166ab8a5 count: 8
00000004:00000001:12.0:1773851869.464102:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000004:00000001:12.0:1773851869.464104:0:609420:0:(mdt_lvb.c:155:mdt_dom_lvbo_update()) Process entered
00000004:00000001:12.0:1773851869.464105:0:609420:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851869.464106:0:609420:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002878f:0x8223:0x0]
00000020:00000001:12.0:1773851869.464107:0:609420:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851869.464110:0:609420:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637140084488392 : -106933625063224 : ffff9ebe934378c8)
00000004:00000001:12.0:1773851869.464111:0:609420:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637140084488304 : -106933625063312 : ffff9ebe93437870)
00000004:00000001:12.0:1773851869.464111:0:609420:0:(mdt_lvb.c:91:mdt_dom_disk_lvbo_update()) Process entered
00000004:00000001:12.0:1773851869.464114:0:609420:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:12.0:1773851869.464117:0:609420:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.464119:0:609420:0:(mdt_lvb.c:140:mdt_dom_disk_lvbo_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.464120:0:609420:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:12.0:1773851869.464120:0:609420:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00010000:00000001:12.0:1773851869.464121:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464122:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464123:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464124:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464124:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464126:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464127:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464129:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464129:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464130:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464131:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464132:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000086ac820b with handle 0x21b6f08f07a58bde from hash
00010000:00000001:12.0:1773851869.464132:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464133:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464133:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464134:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464135:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464136:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464137:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464137:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464138:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000086ac820b/0x21b6f08f07a58bde lrc: 0/0,0 mode: --/PR res: [0x24002878f:0x8223:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940ca4 expref: 167 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464142:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 8
00010000:00000040:12.0:1773851869.464144:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 159
00000020:00000040:12.0:1773851869.464145:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 166
00010000:00000010:12.0:1773851869.464145:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000090aa0404.
00010000:00000040:12.0:1773851869.464147:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 7
00010000:00000001:12.0:1773851869.464147:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464148:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464148:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464148:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c167bd8f refcount=3
00000020:00000001:12.0:1773851869.464149:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956339228032 : -107117370323584 : ffff9e93cb314d80)
00010000:00000001:12.0:1773851869.464149:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636956339228032 : -107117370323584 : ffff9e93cb314d80)
00010000:00000001:12.0:1773851869.464151:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464153:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464153:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002878f:0x8223:0x0].0x0 (00000000166ab8a5)
00010000:00000001:12.0:1773851869.464155:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464156:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464157:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464157:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000040:12.0:1773851869.464158:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000da4a3f8d count: 8
00000004:00000001:12.0:1773851869.464159:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000004:00000001:12.0:1773851869.464159:0:609420:0:(mdt_lvb.c:155:mdt_dom_lvbo_update()) Process entered
00000004:00000001:12.0:1773851869.464159:0:609420:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851869.464160:0:609420:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400288cb:0xe:0x0]
00000020:00000001:12.0:1773851869.464160:0:609420:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851869.464161:0:609420:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637112528790472 : -106961180761144 : ffff9eb828d0e3c8)
00000004:00000001:12.0:1773851869.464162:0:609420:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637112528790384 : -106961180761232 : ffff9eb828d0e370)
00000004:00000001:12.0:1773851869.464163:0:609420:0:(mdt_lvb.c:91:mdt_dom_disk_lvbo_update()) Process entered
00000004:00000001:12.0:1773851869.464163:0:609420:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:12.0:1773851869.464166:0:609420:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.464167:0:609420:0:(mdt_lvb.c:140:mdt_dom_disk_lvbo_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.464168:0:609420:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:12.0:1773851869.464168:0:609420:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00010000:00000001:12.0:1773851869.464168:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464169:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464169:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464170:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464170:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464172:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464172:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464173:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464173:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464173:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464174:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464174:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c167bd8f with handle 0x21b6f08f07a58bd0 from hash
00010000:00000001:12.0:1773851869.464175:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464176:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464176:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464177:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464177:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464178:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464178:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464179:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464180:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c167bd8f/0x21b6f08f07a58bd0 lrc: 0/0,0 mode: --/PR res: [0x2400288cb:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 9 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940c81 expref: 166 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464182:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 8
00010000:00000040:12.0:1773851869.464183:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 158
00000020:00000040:12.0:1773851869.464183:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 165
00010000:00000010:12.0:1773851869.464184:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000006b46fa8b.
00010000:00000040:12.0:1773851869.464184:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 7
00010000:00000001:12.0:1773851869.464185:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464185:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464186:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464186:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000605f5d3a refcount=3
00000020:00000001:12.0:1773851869.464187:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873504256 : -107009836047360 : ffff9eacd4bc2400)
00010000:00000001:12.0:1773851869.464187:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873504256 : -107009836047360 : ffff9eacd4bc2400)
00010000:00000001:12.0:1773851869.464188:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464188:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464189:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400288cb:0xe:0x0].0x0 (00000000da4a3f8d)
00010000:00000001:12.0:1773851869.464190:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464191:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464191:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464191:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000040:12.0:1773851869.464192:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000772a4411 count: 8
00000004:00000001:12.0:1773851869.464193:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464193:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464194:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464194:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464194:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464195:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464197:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464197:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464199:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464199:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464199:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464200:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464200:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000605f5d3a with handle 0x21b6f08f07a4d8e0 from hash
00010000:00000001:12.0:1773851869.464201:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464201:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464202:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464202:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464203:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464203:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464203:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464204:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464205:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000605f5d3a/0x21b6f08f07a4d8e0 lrc: 0/0,0 mode: --/CR res: [0x24002617c:0xb:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940c11 expref: 165 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464207:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000772a4411 count: 8
00010000:00000040:12.0:1773851869.464208:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 157
00000020:00000040:12.0:1773851869.464208:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 164
00010000:00000010:12.0:1773851869.464209:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003f3ee5fc.
00010000:00000040:12.0:1773851869.464210:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000772a4411 count: 7
00010000:00000001:12.0:1773851869.464210:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464210:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464211:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464211:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000015f25373 refcount=3
00000020:00000001:12.0:1773851869.464212:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873505408 : -107009836046208 : ffff9eacd4bc2880)
00010000:00000001:12.0:1773851869.464212:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873505408 : -107009836046208 : ffff9eacd4bc2880)
00010000:00000001:12.0:1773851869.464213:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464213:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464214:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002617c:0xb:0x0].0x0 (00000000772a4411)
00010000:00000001:12.0:1773851869.464215:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464216:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464216:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464217:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000772a4411 count: 6
00010000:00000040:12.0:1773851869.464219:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000b1f6a1c8 count: 8
00000004:00000001:12.0:1773851869.464219:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464220:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464220:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464221:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464221:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464221:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464223:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464223:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464224:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464224:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464225:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464225:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464226:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000015f25373 with handle 0x21b6f08f07a4d8d9 from hash
00010000:00000001:12.0:1773851869.464227:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464227:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464227:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464228:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464228:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464228:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464229:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464229:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464230:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f25373/0x21b6f08f07a4d8d9 lrc: 0/0,0 mode: --/CR res: [0x240020fb9:0xd79:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940c0a expref: 164 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464232:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000b1f6a1c8 count: 8
00010000:00000040:12.0:1773851869.464233:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 156
00000020:00000040:12.0:1773851869.464233:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 163
00010000:00000010:12.0:1773851869.464234:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000092112771.
00010000:00000040:12.0:1773851869.464235:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000b1f6a1c8 count: 7
00010000:00000001:12.0:1773851869.464235:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464236:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464236:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464236:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006f666af1 refcount=3
00000020:00000001:12.0:1773851869.464237:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873497344 : -107009836054272 : ffff9eacd4bc0900)
00010000:00000001:12.0:1773851869.464237:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873497344 : -107009836054272 : ffff9eacd4bc0900)
00010000:00000001:12.0:1773851869.464241:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464242:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464242:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240020fb9:0xd79:0x0].0x0 (00000000b1f6a1c8)
00010000:00000001:12.0:1773851869.464243:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464244:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464244:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464245:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000b1f6a1c8 count: 6
00010000:00000040:12.0:1773851869.464246:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fc5d3318 count: 8
00000004:00000001:12.0:1773851869.464246:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464247:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464247:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464248:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464248:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464249:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464250:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464250:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464251:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464251:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464252:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464252:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464253:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006f666af1 with handle 0x21b6f08f07a4d8d2 from hash
00010000:00000001:12.0:1773851869.464254:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464254:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464254:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464255:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464255:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464255:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464256:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464256:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464257:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006f666af1/0x21b6f08f07a4d8d2 lrc: 0/0,0 mode: --/CR res: [0x240025030:0x15cf6:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940c03 expref: 163 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464260:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc5d3318 count: 8
00010000:00000040:12.0:1773851869.464260:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 155
00000020:00000040:12.0:1773851869.464261:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 162
00010000:00000010:12.0:1773851869.464262:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000514c1fe0.
00010000:00000040:12.0:1773851869.464263:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc5d3318 count: 7
00010000:00000001:12.0:1773851869.464263:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464263:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464264:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464264:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006b1d438e refcount=3
00000020:00000001:12.0:1773851869.464265:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873508288 : -107009836043328 : ffff9eacd4bc33c0)
00010000:00000001:12.0:1773851869.464265:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873508288 : -107009836043328 : ffff9eacd4bc33c0)
00010000:00000001:12.0:1773851869.464266:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464266:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464267:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240025030:0x15cf6:0x0].0x0 (00000000fc5d3318)
00010000:00000001:12.0:1773851869.464268:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464269:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464269:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464269:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc5d3318 count: 6
00010000:00000040:12.0:1773851869.464270:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000004c3d6da4 count: 8
00000004:00000001:12.0:1773851869.464271:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464271:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464272:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464272:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464273:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464273:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464275:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464276:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464276:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464277:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464277:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464277:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464278:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006b1d438e with handle 0x21b6f08f07a4d8cb from hash
00010000:00000001:12.0:1773851869.464279:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464279:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464279:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464280:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464280:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464280:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464282:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464282:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464283:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006b1d438e/0x21b6f08f07a4d8cb lrc: 0/0,0 mode: --/CR res: [0x240028ba2:0xa920:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bf5 expref: 162 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464285:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004c3d6da4 count: 8
00010000:00000040:12.0:1773851869.464286:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 154
00000020:00000040:12.0:1773851869.464286:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 161
00010000:00000010:12.0:1773851869.464287:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000004923a4b6.
00010000:00000040:12.0:1773851869.464288:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004c3d6da4 count: 7
00010000:00000001:12.0:1773851869.464288:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464288:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464289:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464289:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f9f3f80a refcount=3
00000020:00000001:12.0:1773851869.464290:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873502528 : -107009836049088 : ffff9eacd4bc1d40)
00010000:00000001:12.0:1773851869.464291:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873502528 : -107009836049088 : ffff9eacd4bc1d40)
00010000:00000001:12.0:1773851869.464291:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464292:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464292:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028ba2:0xa920:0x0].0x0 (000000004c3d6da4)
00010000:00000001:12.0:1773851869.464293:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464294:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464294:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464295:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004c3d6da4 count: 6
00010000:00000040:12.0:1773851869.464295:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000000218c860 count: 8
00000004:00000001:12.0:1773851869.464296:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464297:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464297:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464297:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464298:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464298:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464299:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464300:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464300:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464301:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464301:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464302:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464302:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f9f3f80a with handle 0x21b6f08f07a4d8c4 from hash
00010000:00000001:12.0:1773851869.464303:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464304:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464304:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464304:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464305:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464305:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464306:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464306:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464307:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9f3f80a/0x21b6f08f07a4d8c4 lrc: 0/0,0 mode: --/CR res: [0x240023596:0x2922:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bfc expref: 161 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464309:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000218c860 count: 8
00010000:00000040:12.0:1773851869.464309:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 153
00000020:00000040:12.0:1773851869.464310:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 160
00010000:00000010:12.0:1773851869.464310:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002178e07c.
00010000:00000040:12.0:1773851869.464311:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000218c860 count: 7
00010000:00000001:12.0:1773851869.464311:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464312:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464312:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464312:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c826cbf9 refcount=3
00000020:00000001:12.0:1773851869.464313:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944997564992 : -107128711986624 : ffff9e91272d4240)
00010000:00000001:12.0:1773851869.464314:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636944997564992 : -107128711986624 : ffff9e91272d4240)
00010000:00000001:12.0:1773851869.464314:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464315:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464315:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240023596:0x2922:0x0].0x0 (000000000218c860)
00010000:00000001:12.0:1773851869.464316:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464317:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464317:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464318:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000000218c860 count: 6
00010000:00000040:12.0:1773851869.464318:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000ff7ae08c count: 8
00000004:00000001:12.0:1773851869.464319:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464319:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464321:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464321:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464321:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464322:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464323:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464324:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464324:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464325:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464325:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464326:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464326:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c826cbf9 with handle 0x21b6f08f07a4d8b6 from hash
00010000:00000001:12.0:1773851869.464327:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464327:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464328:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464328:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464328:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464329:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464329:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464329:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464330:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c826cbf9/0x21b6f08f07a4d8b6 lrc: 0/0,0 mode: --/CR res: [0x240028aff:0xf835:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bd2 expref: 160 pid: 41173 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464332:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ff7ae08c count: 8
00010000:00000040:12.0:1773851869.464333:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 152
00000020:00000040:12.0:1773851869.464333:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 159
00010000:00000010:12.0:1773851869.464334:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000aa36b8c3.
00010000:00000040:12.0:1773851869.464335:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ff7ae08c count: 7
00010000:00000001:12.0:1773851869.464335:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464336:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464336:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464336:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f3a5791d refcount=3
00000020:00000001:12.0:1773851869.464337:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063873500800 : -107009836050816 : ffff9eacd4bc1680)
00010000:00000001:12.0:1773851869.464337:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637063873500800 : -107009836050816 : ffff9eacd4bc1680)
00010000:00000001:12.0:1773851869.464338:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464338:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464340:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028aff:0xf835:0x0].0x0 (00000000ff7ae08c)
00010000:00000001:12.0:1773851869.464341:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464341:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464342:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464342:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ff7ae08c count: 6
00010000:00000040:12.0:1773851869.464343:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000f395337a count: 8
00000004:00000001:12.0:1773851869.464344:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464344:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464345:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464345:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464345:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464346:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464347:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464347:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464348:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464348:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464348:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464349:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464349:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000f3a5791d with handle 0x21b6f08f07a4d8bd from hash
00010000:00000001:12.0:1773851869.464350:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464351:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464351:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464351:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464352:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464352:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464352:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464353:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464354:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000f3a5791d/0x21b6f08f07a4d8bd lrc: 0/0,0 mode: --/CR res: [0x240028bb8:0x8b0:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940be0 expref: 159 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464356:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f395337a count: 8
00010000:00000040:12.0:1773851869.464356:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 151
00000020:00000040:12.0:1773851869.464357:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 158
00010000:00000010:12.0:1773851869.464358:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000e179987d.
00010000:00000040:12.0:1773851869.464358:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f395337a count: 7
00010000:00000001:12.0:1773851869.464359:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464359:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464360:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464360:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000916a8e80 refcount=3
00000020:00000001:12.0:1773851869.464361:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942679552 : -106911766872064 : ffff9ec3aa1d0000)
00010000:00000001:12.0:1773851869.464361:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942679552 : -106911766872064 : ffff9ec3aa1d0000)
00010000:00000001:12.0:1773851869.464362:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464362:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464363:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028bb8:0x8b0:0x0].0x0 (00000000f395337a)
00010000:00000001:12.0:1773851869.464364:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464364:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464365:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464365:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000f395337a count: 6
00010000:00000040:12.0:1773851869.464366:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000166ab8a5 count: 7
00000004:00000001:12.0:1773851869.464366:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464366:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464367:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464367:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464367:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464368:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464370:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464370:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464370:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464371:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464371:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464371:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464372:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000916a8e80 with handle 0x21b6f08f07a4d8a1 from hash
00010000:00000001:12.0:1773851869.464373:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464373:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464373:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464374:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464374:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464375:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464375:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464375:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464376:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000916a8e80/0x21b6f08f07a4d8a1 lrc: 0/0,0 mode: --/CR res: [0x24002878f:0x8223:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940be7 expref: 158 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464379:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 7
00010000:00000040:12.0:1773851869.464379:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 150
00000020:00000040:12.0:1773851869.464380:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 157
00010000:00000010:12.0:1773851869.464381:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000bc49f321.
00010000:00000040:12.0:1773851869.464381:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000001:12.0:1773851869.464382:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464382:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464382:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464383:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000dde27669 refcount=3
00000020:00000001:12.0:1773851869.464383:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942681280 : -106911766870336 : ffff9ec3aa1d06c0)
00010000:00000001:12.0:1773851869.464384:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942681280 : -106911766870336 : ffff9ec3aa1d06c0)
00010000:00000001:12.0:1773851869.464385:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464385:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464385:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002878f:0x8223:0x0].0x0 (00000000166ab8a5)
00010000:00000001:12.0:1773851869.464386:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464387:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464387:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464387:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 5
00010000:00000040:12.0:1773851869.464388:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000d92f6b4a count: 8
00000004:00000001:12.0:1773851869.464389:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464390:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464390:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464390:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464391:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464391:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464392:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464393:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464393:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464394:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464394:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464395:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464395:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000dde27669 with handle 0x21b6f08f07a4d893 from hash
00010000:00000001:12.0:1773851869.464396:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464397:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464397:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464397:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464398:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464398:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464399:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464399:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464400:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000dde27669/0x21b6f08f07a4d893 lrc: 0/0,0 mode: --/CR res: [0x2400236d5:0x4cda:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bee expref: 157 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464402:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000d92f6b4a count: 8
00010000:00000040:12.0:1773851869.464403:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 149
00000020:00000040:12.0:1773851869.464403:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 156
00010000:00000010:12.0:1773851869.464404:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000059213aa3.
00010000:00000040:12.0:1773851869.464404:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000d92f6b4a count: 7
00010000:00000001:12.0:1773851869.464405:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464405:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464406:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464406:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000dc4b6603 refcount=3
00000020:00000001:12.0:1773851869.464407:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942687616 : -106911766864000 : ffff9ec3aa1d1f80)
00010000:00000001:12.0:1773851869.464407:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942687616 : -106911766864000 : ffff9ec3aa1d1f80)
00010000:00000001:12.0:1773851869.464408:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464408:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464409:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400236d5:0x4cda:0x0].0x0 (00000000d92f6b4a)
00010000:00000001:12.0:1773851869.464409:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464410:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464410:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464411:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000d92f6b4a count: 6
00010000:00000040:12.0:1773851869.464412:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000975a2250 count: 8
00000004:00000001:12.0:1773851869.464412:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464412:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464413:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464413:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464415:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464415:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464416:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464417:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464418:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464418:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464418:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464419:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464419:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000dc4b6603 with handle 0x21b6f08f07a4d8af from hash
00010000:00000001:12.0:1773851869.464420:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464420:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464421:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464421:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464421:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464422:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464422:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464423:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464423:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000dc4b6603/0x21b6f08f07a4d8af lrc: 0/0,0 mode: --/CR res: [0x2400236ba:0x7270:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bbd expref: 156 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464425:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000975a2250 count: 8
00010000:00000040:12.0:1773851869.464426:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 148
00000020:00000040:12.0:1773851869.464426:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 155
00010000:00000010:12.0:1773851869.464427:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000001beeff82.
00010000:00000040:12.0:1773851869.464428:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000975a2250 count: 7
00010000:00000001:12.0:1773851869.464428:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464428:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464429:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464429:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009c5cbfef refcount=3
00000020:00000001:12.0:1773851869.464430:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637050599997440 : -107023109554176 : ffff9ea9bd928000)
00010000:00000001:12.0:1773851869.464430:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637050599997440 : -107023109554176 : ffff9ea9bd928000)
00010000:00000001:12.0:1773851869.464431:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464431:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464432:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400236ba:0x7270:0x0].0x0 (00000000975a2250)
00010000:00000001:12.0:1773851869.464433:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464434:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464435:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464435:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000975a2250 count: 6
00010000:00000040:12.0:1773851869.464435:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000da4a3f8d count: 7
00000004:00000001:12.0:1773851869.464436:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464436:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464437:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464437:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464437:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464438:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464439:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464439:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464440:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464440:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464441:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464441:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464442:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000009c5cbfef with handle 0x21b6f08f07a4d8a8 from hash
00010000:00000001:12.0:1773851869.464442:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464443:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464443:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464443:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464444:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464444:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464444:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464445:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464446:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000009c5cbfef/0x21b6f08f07a4d8a8 lrc: 0/0,0 mode: --/CR res: [0x2400288cb:0xe:0x0].0x0 bits 0x8/0x0 rrc: 8 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bc4 expref: 155 pid: 41173 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464448:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 7
00010000:00000040:12.0:1773851869.464449:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 147
00000020:00000040:12.0:1773851869.464449:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 154
00010000:00000010:12.0:1773851869.464449:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a7d0ccc8.
00010000:00000040:12.0:1773851869.464450:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000001:12.0:1773851869.464451:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464451:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464452:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464453:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000de48726b refcount=3
00000020:00000001:12.0:1773851869.464453:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637050600004352 : -107023109547264 : ffff9ea9bd929b00)
00010000:00000001:12.0:1773851869.464454:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637050600004352 : -107023109547264 : ffff9ea9bd929b00)
00010000:00000001:12.0:1773851869.464455:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464455:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464456:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400288cb:0xe:0x0].0x0 (00000000da4a3f8d)
00010000:00000001:12.0:1773851869.464456:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464457:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464457:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464458:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 5
00010000:00000040:12.0:1773851869.464459:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000bba939d3 count: 8
00000004:00000001:12.0:1773851869.464459:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464460:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464460:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464461:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464461:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464461:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464462:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464463:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464464:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464464:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464464:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464465:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464465:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000de48726b with handle 0x21b6f08f07a4d89a from hash
00010000:00000001:12.0:1773851869.464466:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464466:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464467:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464467:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464467:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464468:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464468:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464469:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464470:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000de48726b/0x21b6f08f07a4d89a lrc: 0/0,0 mode: --/CR res: [0x240028ab6:0x1a5d4:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bd9 expref: 154 pid: 41173 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464472:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000bba939d3 count: 8
00010000:00000040:12.0:1773851869.464473:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 146
00000020:00000040:12.0:1773851869.464474:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 153
00010000:00000010:12.0:1773851869.464474:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000089100e3d.
00010000:00000040:12.0:1773851869.464475:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000bba939d3 count: 7
00010000:00000001:12.0:1773851869.464475:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464476:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464476:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464476:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002d17a39b refcount=3
00000020:00000001:12.0:1773851869.464477:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637050600011264 : -107023109540352 : ffff9ea9bd92b600)
00010000:00000001:12.0:1773851869.464477:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637050600011264 : -107023109540352 : ffff9ea9bd92b600)
00010000:00000001:12.0:1773851869.464478:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464478:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464479:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028ab6:0x1a5d4:0x0].0x0 (00000000bba939d3)
00010000:00000001:12.0:1773851869.464480:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464481:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464481:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464481:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000bba939d3 count: 6
00010000:00000040:12.0:1773851869.464482:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000492e918a count: 8
00000004:00000001:12.0:1773851869.464483:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464483:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464484:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464484:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464484:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464485:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464486:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464486:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464487:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464487:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464488:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464488:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464489:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000002d17a39b with handle 0x21b6f08f07a4d885 from hash
00010000:00000001:12.0:1773851869.464490:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464490:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464490:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464491:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464492:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464492:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464493:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464493:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464494:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000002d17a39b/0x21b6f08f07a4d885 lrc: 0/0,0 mode: --/CR res: [0x240020ec9:0x172e:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bb6 expref: 153 pid: 41173 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464496:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000492e918a count: 8
00010000:00000040:12.0:1773851869.464497:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 145
00000020:00000040:12.0:1773851869.464497:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 152
00010000:00000010:12.0:1773851869.464498:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000f9e59638.
00010000:00000040:12.0:1773851869.464499:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000492e918a count: 7
00010000:00000001:12.0:1773851869.464499:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464500:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851869.464500:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.464501:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ae4e588a refcount=3
00000020:00000001:12.0:1773851869.464501:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161942695104 : -106911766856512 : ffff9ec3aa1d3cc0)
00010000:00000001:12.0:1773851869.464502:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161942695104 : -106911766856512 : ffff9ec3aa1d3cc0)
00010000:00000001:12.0:1773851869.464502:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464503:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464503:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240020ec9:0x172e:0x0].0x0 (00000000492e918a)
00010000:00000001:12.0:1773851869.464504:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464505:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464505:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464506:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000492e918a count: 6
00010000:00000040:12.0:1773851869.464506:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000c49e92cb count: 8
00000004:00000001:12.0:1773851869.464507:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851869.464507:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851869.464508:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464508:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851869.464509:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.464509:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464510:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851869.464511:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851869.464512:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464512:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464512:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851869.464513:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.464514:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000ae4e588a with handle 0x21b6f08f07a4d88c from hash
00010000:00000001:12.0:1773851869.464514:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851869.464515:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.464515:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464515:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851869.464516:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.464516:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464517:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851869.464517:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851869.464518:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000ae4e588a/0x21b6f08f07a4d88c lrc: 0/0,0 mode: --/CR res: [0x240024fc0:0x1c997:0x0].0x0 bits 0x8/0x0 rrc: 9 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940bcb expref: 152 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.464520:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c49e92cb count: 8
00010000:00000040:12.0:1773851869.464521:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000394656e8 : new locks_count 144
00000020:00000040:12.0:1773851869.464521:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 151
00010000:00000010:12.0:1773851869.464522:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003ab617ff.
00010000:00000040:12.0:1773851869.464522:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c49e92cb count: 7
00010000:00000001:12.0:1773851869.464523:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851869.464523:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.464524:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.464524:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024fc0:0x1c997:0x0].0x0 (00000000c49e92cb)
00010000:00000001:12.0:1773851869.464525:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.464525:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464526:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851869.464526:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c49e92cb count: 6
00010000:00010000:12.0:1773851869.464527:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:12.0:1773851869.464528:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=16 : 16 : 10)
00010000:00000001:12.0:1773851869.464529:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851869.464529:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851869.464530:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=123 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851869.464531:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851869.464533:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000593bde95 refcount 3 to 192.168.128.2@o2ib60
00000100:00000001:12.0:1773851869.464534:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642471488 : -107157067080128 : ffff9e8a8d14de40)
02000000:00000001:12.0:1773851869.464535:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851869.464535:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.464536:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851869.464537:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.2@o2ib60
00000400:00000010:12.0:1773851869.464537:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003df794fb.
00000100:00000200:12.0:1773851869.464538:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1858241565431296, offset 224
00000400:00000200:12.0:1773851869.464540:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.2@o2ib60
00000400:00000200:12.0:1773851869.464542:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:12.0:1773851869.464543:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:12.0:1773851869.464544:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000400:00000200:12.0:1773851869.464546:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 4
00000400:00000200:12.0:1773851869.464547:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.2@o2ib60 routed destination
00000400:00000200:12.0:1773851869.464548:0:609420:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:12.0:1773851869.464549:0:609420:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:12.0:1773851869.464551:0:609420:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000400:00000200:12.0:1773851869.464552:0:609420:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:12.0:1773851869.464554:0:609420:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000400:00000200:12.0:1773851869.464554:0:609420:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:12.0:1773851869.464555:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769312:8769312:1024:4294967295] 2094@kfi7 LPNI seq info [1258746994:1258746994:16:4294967295]
00000400:00000200:12.0:1773851869.464557:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:12.0:1773851869.464557:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:12.0:1773851869.464560:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.2@o2ib60(192.168.128.2@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851869.464562:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000800:00000200:12.0:1773851869.464564:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851869.464565:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851869.464568:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851869.464570:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:12.0:1773851869.464576:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:12.0:1773851869.464577:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851869.464579:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851869.464580:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000593bde95 refcount 2 to 192.168.128.2@o2ib60
00010000:00000001:12.0:1773851869.464581:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.464581:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851869.464583:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000504c565c x1858241565431296/t0(0) o103->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 440/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-matrix2-0'
00000100:00100000:12.0:1773851869.464588:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000504c565c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:3f210437-b2af-4977-93b4-45f1c345c3ce+151:59071:x1858241565431296:12345-192.168.128.2@o2ib60:103:login-matrix2-0 Request processed in 503us (608us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851869.464590:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.2@o2ib60, seq: 50273007
00000100:00000040:12.0:1773851869.464591:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000394656e8 : new rpc_count 0
00000100:00000001:12.0:1773851869.464592:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851869.464593:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851869.464593:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851869.464594:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:12.0:1773851869.464595:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000048bd73e6.
00000020:00000040:12.0:1773851869.464595:0:609420:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 150
00000100:00000001:12.0:1773851869.464596:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851869.464603:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851869.464605:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.464606:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:13.0:1773851869.464606:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003df794fb
00000400:00000010:13.0:1773851869.464607:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003df794fb.
00000100:00000001:13.0:1773851869.464608:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851869.464609:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851869.464610:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:13.0:1773851869.464611:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00010000:00000010:12.1F:1773851869.469728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000086ac820b.
00010000:00000010:12.1:1773851869.469730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c167bd8f.
00010000:00000010:12.1:1773851869.469731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000605f5d3a.
00010000:00000010:12.1:1773851869.469732:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000015f25373.
00010000:00000010:12.1:1773851869.469733:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006f666af1.
00010000:00000010:12.1:1773851869.469733:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006b1d438e.
00010000:00000010:12.1:1773851869.469734:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f9f3f80a.
00010000:00000010:12.1:1773851869.469735:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c826cbf9.
00010000:00000010:12.1:1773851869.469735:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000f3a5791d.
00010000:00000010:12.1:1773851869.469736:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000916a8e80.
00010000:00000010:12.1:1773851869.469737:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000dde27669.
00010000:00000010:12.1:1773851869.469737:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000dc4b6603.
00010000:00000010:12.1:1773851869.469738:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000009c5cbfef.
00010000:00000010:12.1:1773851869.469739:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000de48726b.
00010000:00000010:12.1:1773851869.469739:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000002d17a39b.
00010000:00000010:12.1:1773851869.469740:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000ae4e588a.
00000800:00000200:9.0:1773851869.484462:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851869.484463:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851869.484465:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851869.484468:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851869.484470:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.484471:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.2@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851869.484472:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.484473:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851869.484474:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:9.0:1773851869.484475:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:9.0:1773851869.484476:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000400:00000200:9.0:1773851869.484477:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:9.0:1773851869.484478:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.2@o2ib60 of length 376 into portal 12 MB=0x69a0f946a1640
00000400:00000200:9.0:1773851869.484480:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.2@o2ib60 of length 376/376 into md 0x82a36e8ed [64] + 31152
00000800:00000200:9.0:1773851869.484482:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851869.484484:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851869.484485:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851869.484486:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851869.484487:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851869.484488:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000355888a3.
00000100:00000040:9.0:1773851869.484488:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000355888a3 x1858241565431360 msgsize 376
00000100:00100000:9.0:1773851869.484490:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.2@o2ib60 (source: 12345-192.168.128.2@o2ib60)
00000100:00000001:9.0:1773851869.484492:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851869.484493:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851869.484494:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851869.484496:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851869.484497:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851869.484497:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851869.484498:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851869.484500:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851869.484501:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858241565431360
00000020:00000001:12.0:1773851869.484502:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851869.484502:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9303d
00000020:00000001:12.0:1773851869.484503:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851869.484504:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000394656e8 refcount=151
00000020:00000001:12.0:1773851869.484505:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000020:00000001:12.0:1773851869.484507:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000100:00000001:12.0:1773851869.484508:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851869.484509:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851869.484510:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000048bd73e6.
00000020:00000010:12.0:1773851869.484511:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851869.484512:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000001:12.0:1773851869.484514:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851869.484515:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:12.0:1773851869.484516:0:60487:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:12.0:1773851869.484517:0:60487:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.484518:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.484519:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.484521:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851869.484523:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851869.484524:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851869.484524:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851869.484525:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851869.484526:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.2@o2ib60, seq: 411190548
00000100:00000001:15.0:1773851869.484527:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851869.484527:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000394656e8 : new rpc_count 1
00000100:00000001:15.0:1773851869.484528:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.484528:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749204864 : -106947960346752 : ffff9ebb3cd06780)
00000100:00000040:12.0:1773851869.484530:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000355888a3 x1858241565431360/t0(0) o101->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 376/0 e 0 to 0 dl 1773851956 ref 1 fl New:/0/ffffffff rc 0/-1 job:'login-matrix2-53703'
00000100:00000001:12.0:1773851869.484535:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851869.484536:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851869.484538:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000355888a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3f210437-b2af-4977-93b4-45f1c345c3ce+151:2463958:x1858241565431360:12345-192.168.128.2@o2ib60:101:login-matrix2-53703
00000100:00000200:12.0:1773851869.484540:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858241565431360
00000020:00000001:12.0:1773851869.484541:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851869.484542:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851869.484544:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.484545:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851869.484546:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:12.0:1773851869.484547:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851869.484548:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858241565431360, found 0 last_xid 1858241564428287
00000020:00000001:12.0:1773851869.484549:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851869.484551:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851869.484552:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851869.484553:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851869.484555:0:60487:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:12.0:1773851869.484556:0:60487:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:12.0:1773851869.484557:0:60487:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:12.0:1773851869.484558:0:60487:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:12.0:1773851869.484559:0:60487:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.484564:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851869.484566:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000da4a3f8d count: 6
00010000:00000001:12.0:1773851869.484567:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851869.484569:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851869.484570:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000000a0e0152.
00000020:00000001:12.0:1773851869.484572:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851869.484573:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 000000000a0e0152 with handle 0x21b6f08f07a6ad7e to hash
00000020:00000001:12.0:1773851869.484574:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851869.484575:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538925120 : -107107170626496 : ffff9e962b245440)
00010000:00000010:12.0:1773851869.484577:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000008818499b.
00010000:00000001:12.0:1773851869.484578:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538925120 : -107107170626496 : ffff9e962b245440)
00010000:00010000:12.0:1773851869.484580:0:60487:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000000a0e0152/0x21b6f08f07a6ad7e lrc: 2/0,0 mode: --/CR res: [0x2400288cb:0xe:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b1c65ccfe940fde expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484585:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000040:12.0:1773851869.484586:0:60487:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000394656e8 : new locks_count 145
00000020:00000040:12.0:1773851869.484587:0:60487:0:(genops.c:871:class_export_get()) GET export 00000000394656e8 refcount=152
00010000:00000001:12.0:1773851869.484590:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:12.0:1773851869.484591:0:60487:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:12.0:1773851869.484594:0:60487:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:12.0:1773851869.484596:0:60487:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:12.0:1773851869.484597:0:60487:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.484598:0:60487:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:12.0:1773851869.484599:0:60487:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x2400288cb:0xe:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:12.0:1773851869.484601:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851869.484602:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400288cb:0xe:0x0]
00000020:00000001:12.0:1773851869.484604:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851869.484604:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637112528790472 : -106961180761144 : ffff9eb828d0e3c8)
00000004:00000001:12.0:1773851869.484605:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637112528790384 : -106961180761232 : ffff9eb828d0e370)
00000004:00000001:12.0:1773851869.484607:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851869.484610:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851869.484612:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851869.484615:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484616:0:60487:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484618:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:12.0:1773851869.484619:0:60487:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:12.0:1773851869.484621:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851869.484621:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851869.484623:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 00000000e3cefe36.
02000000:00000001:12.0:1773851869.484624:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.484625:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.484627:0:60487:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:12.0:1773851869.484629:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:12.0:1773851869.484630:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:12.0:1773851869.484630:0:60487:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851869.484632:0:60487:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.484633:0:60487:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:12.0:1773851869.484635:0:60487:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:12.0:1773851869.484636:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851869.484637:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.484638:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851869.484639:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.484640:0:60487:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:12.0:1773851869.484641:0:60487:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:12.0:1773851869.484642:0:60487:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:12.0:1773851869.484643:0:60487:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:12.0:1773851869.484644:0:60487:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400288cb:0xe:0x0].0x0 (00000000da4a3f8d) refcount = 6
00010000:00000040:12.0:1773851869.484646:0:60487:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:12.0:1773851869.484648:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000699d5832/0x21b6f08f030473d9 lrc: 2/0,0 mode: PR/PR res: [0x2400288cb:0xe:0x0].0x0 bits 0x49/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.128.1@o2ib60 remote: 0x46e6d43eb611e7a3 expref: 276 pid: 60510 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484652:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000040:12.0:1773851869.484655:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fa5d976/0x21b6f08f07a28da4 lrc: 2/0,0 mode: PR/PR res: [0x2400288cb:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.128.1@o2ib60 remote: 0x46e6d43eb614fc0a expref: 276 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484659:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000040:12.0:1773851869.484661:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b55fcd4/0x21b6f08e13d1c3e0 lrc: 2/0,0 mode: PR/PR res: [0x2400288cb:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 26563@kfi7 remote: 0x581d8fb695e4a6a3 expref: 5917 pid: 60907 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484665:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000040:12.0:1773851869.484667:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c47299f5/0x21b6f08c98d32f16 lrc: 2/0,0 mode: PR/PR res: [0x2400288cb:0xe:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 26563@kfi7 remote: 0x581d8fb68da78be9 expref: 5917 pid: 60846 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484671:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000040:12.0:1773851869.484672:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f8cca8/0x21b6f0897d3e6aac lrc: 2/0,0 mode: PR/PR res: [0x2400288cb:0xe:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfb69d8cf expref: 152 pid: 60759 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484676:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00010000:12.0:1773851869.484678:0:60487:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000000a0e0152/0x21b6f08f07a6ad7e lrc: 3/0,0 mode: CR/CR res: [0x2400288cb:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940fde expref: 152 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484682:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00010000:00000001:12.0:1773851869.484683:0:60487:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:12.0:1773851869.484685:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851869.484686:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.484687:0:60487:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:12.0:1773851869.484688:0:60487:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.484689:0:60487:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.484690:0:60487:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851869.484692:0:60487:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:12.0:1773851869.484694:0:60487:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000000a0e0152/0x21b6f08f07a6ad7e lrc: 3/0,0 mode: CR/CR res: [0x2400288cb:0xe:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940fde expref: 152 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851869.484698:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000da4a3f8d count: 6
00000004:00000001:12.0:1773851869.484700:0:60487:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:12.0:1773851869.484703:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851869.484703:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400288cb:0xe:0x0]
00000020:00000001:12.0:1773851869.484704:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851869.484705:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637112528790472 : -106961180761144 : ffff9eb828d0e3c8)
00000004:00000001:12.0:1773851869.484706:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637112528790384 : -106961180761232 : ffff9eb828d0e370)
00000004:00000001:12.0:1773851869.484708:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851869.484708:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851869.484709:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851869.484710:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484711:0:60487:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484712:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484713:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851869.484714:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851869.484714:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851869.484715:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484716:0:60487:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484717:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:12.0:1773851869.484718:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:12.0:1773851869.484719:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:12.0:1773851869.484720:0:60487:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:12.0:1773851869.484721:0:60487:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851869.484722:0:60487:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851869.484723:0:60487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400288cb:0xe:0x0].0x0 (00000000da4a3f8d)
00010000:00010000:12.0:1773851869.484724:0:60487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:12.0:1773851869.484730:0:60487:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851869.484731:0:60487:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851869.484732:0:60487:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:12.0:1773851869.484732:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851869.484733:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:12.0:1773851869.484734:0:60487:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000a0e0152, rc 0)
00000020:00000001:12.0:1773851869.484735:0:60487:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851869.484737:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183116358565, transno 0, xid 1858241565431360
00010000:00000001:12.0:1773851869.484738:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851869.484740:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000355888a3 x1858241565431360/t0(0) o101->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 376/1080 e 0 to 0 dl 1773851956 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-matrix2-53703'
00010000:00000001:12.0:1773851869.484745:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851869.484747:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851869.484748:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=102 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851869.484750:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851869.484751:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000593bde95 refcount 3 to 192.168.128.2@o2ib60
00000100:00000001:12.0:1773851869.484752:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642471488 : -107157067080128 : ffff9e8a8d14de40)
00000800:00000200:9.0:1773851869.484752:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
02000000:00000001:12.0:1773851869.484753:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000800:00000200:9.0:1773851869.484753:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
02000000:00000001:12.0:1773851869.484754:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851869.484754:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:12.0:1773851869.484755:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851869.484757:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.2@o2ib60
00000400:00000010:12.0:1773851869.484758:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000464fc1d9.
00000800:00000200:9.0:1773851869.484758:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:12.0:1773851869.484759:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1858241565431360, offset 224
00000400:00000200:9.0:1773851869.484761:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:12.0:1773851869.484762:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.2@o2ib60
00000400:00000200:9.0:1773851869.484762:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.2@o2ib60 : PUT - for me
00000400:00000200:12.0:1773851869.484764:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:9.0:1773851869.484764:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.484765:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851869.484766:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:12.0:1773851869.484767:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:9.0:1773851869.484768:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:12.0:1773851869.484769:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000400:00000200:9.0:1773851869.484769:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 4
00000400:00000200:9.0:1773851869.484771:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:12.0:1773851869.484772:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 5
00000400:00000200:9.0:1773851869.484773:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.2@o2ib60 of length 376 into portal 12 MB=0x69a0f946a1680
00000400:00000200:12.0:1773851869.484774:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.2@o2ib60 routed destination
00000400:00000200:9.0:1773851869.484774:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.2@o2ib60 of length 376/376 into md 0x82a36e8ed [64] + 31528
00000400:00000200:12.0:1773851869.484776:0:60487:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000800:00000200:9.0:1773851869.484777:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:12.0:1773851869.484778:0:60487:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:9.0:1773851869.484779:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:12.0:1773851869.484780:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000400:00000200:9.0:1773851869.484780:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851869.484781:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:12.0:1773851869.484782:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000100:00000200:9.0:1773851869.484782:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000400:00000200:12.0:1773851869.484783:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000100:00000010:9.0:1773851869.484783:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3a84caa.
00000100:00000040:9.0:1773851869.484783:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e3a84caa x1858241565431424 msgsize 376
00000400:00000200:12.0:1773851869.484785:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000100:00100000:9.0:1773851869.484786:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.2@o2ib60 (source: 12345-192.168.128.2@o2ib60)
00000400:00000200:12.0:1773851869.484787:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769313:8769313:1024:4294967295] 17@kfi7 LPNI seq info [1250891896:1250891896:16:4294967295]
00000100:00000001:9.0:1773851869.484788:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851869.484789:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000400:00000200:12.0:1773851869.484790:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851869.484790:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851869.484791:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851869.484792:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:12.0:1773851869.484792:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000100:00000001:15.0:1773851869.484793:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851869.484794:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851869.484795:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851869.484797:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858241565431424
00000400:00000200:12.0:1773851869.484797:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.2@o2ib60(192.168.128.2@o2ib60:17@kfi7) <?> : PUT try# 0
00000020:00000001:15.0:1773851869.484798:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851869.484799:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9303d
00000020:00000001:15.0:1773851869.484800:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:12.0:1773851869.484800:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000020:00000040:15.0:1773851869.484801:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000394656e8 refcount=153
00000020:00000001:15.0:1773851869.484803:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000800:00000200:12.0:1773851869.484803:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000020:00000001:15.0:1773851869.484804:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745162752 : -107128964388864 : ffff9e911821e800)
00000100:00000001:15.0:1773851869.484805:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:12.0:1773851869.484805:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000100:00000001:15.0:1773851869.484806:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851869.484807:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047ae5d51.
00000020:00000010:15.0:1773851869.484808:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851869.484810:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851869.484812:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851869.484813:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:15.0:1773851869.484813:0:60824:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000800:00000200:12.0:1773851869.484813:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000004:00000001:15.0:1773851869.484814:0:60824:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.484815:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.484816:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:12.0:1773851869.484816:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000100:00000001:15.0:1773851869.484819:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:12.0:1773851869.484819:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 1180 bytes to peer 0x20000000000001a: rc=0
00000100:00000001:15.0:1773851869.484821:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851869.484821:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000800:00000200:12.0:1773851869.484821:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00100000:15.0:1773851869.484823:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.2@o2ib60, seq: 411190549
00000100:00000001:13.0:1773851869.484823:0:59132:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851869.484823:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.484824:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000394656e8 : new rpc_count 2
00000100:00000001:13.0:1773851869.484824:0:59132:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:13.0:1773851869.484824:0:59132:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.484825:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749187584 : -106947960364032 : ffff9ebb3cd02400)
00000100:00000001:13.0:1773851869.484825:0:59132:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851869.484825:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000593bde95 refcount 2 to 192.168.128.2@o2ib60
00010000:00000001:12.0:1773851869.484826:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851869.484826:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.484827:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3a84caa x1858241565431424/t0(0) o101->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 376/0 e 0 to 0 dl 1773851956 ref 1 fl New:/0/ffffffff rc 0/-1 job:'login-matrix2-53703'
00000020:00000001:12.0:1773851869.484829:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000001:15.0:1773851869.484830:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851869.484830:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000040:12.0:1773851869.484831:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000355888a3 x1858241565431360/t0(0) o101->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 376/1080 e 0 to 0 dl 1773851956 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-matrix2-53703'
00000100:00100000:15.0:1773851869.484832:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3a84caa pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:3f210437-b2af-4977-93b4-45f1c345c3ce+153:2463936:x1858241565431424:12345-192.168.128.2@o2ib60:101:login-matrix2-53703
00000100:00000200:15.0:1773851869.484833:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858241565431424
00000020:00000001:15.0:1773851869.484834:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851869.484835:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851869.484835:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851869.484835:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000355888a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3f210437-b2af-4977-93b4-45f1c345c3ce+153:2463958:x1858241565431360:12345-192.168.128.2@o2ib60:101:login-matrix2-53703 Request processed in 298us (345us total) trans 0 rc 0/0
00000020:00000001:15.0:1773851869.484836:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851869.484836:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:15.0:1773851869.484837:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851869.484838:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858241565431424, found 0 last_xid 1858241564428287
00000100:00100000:12.0:1773851869.484838:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.2@o2ib60, seq: 411190548
00000020:00000001:15.0:1773851869.484839:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851869.484839:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000100:00000040:12.0:1773851869.484839:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000394656e8 : new rpc_count 1
00000020:00000001:15.0:1773851869.484840:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:12.0:1773851869.484840:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:15.0:1773851869.484841:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851869.484841:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851869.484841:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000001:15.0:1773851869.484842:0:60824:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:15.0:1773851869.484842:0:60824:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00000020:00000010:12.0:1773851869.484842:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00010000:00010000:15.0:1773851869.484843:0:60824:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:15.0:1773851869.484843:0:60824:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00000020:00000010:12.0:1773851869.484843:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000048bd73e6.
00010000:00000001:15.0:1773851869.484844:0:60824:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851869.484844:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 152
00000100:00000001:12.0:1773851869.484845:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:15.0:1773851869.484846:0:60824:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:15.0:1773851869.484849:0:60824:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000166ab8a5 count: 6
00010000:00000001:15.0:1773851869.484849:0:60824:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:15.0:1773851869.484851:0:60824:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00000800:00000200:13.0:1773851869.484851:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851869.484853:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000010:15.0:1773851869.484854:0:60824:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000691436ac.
00000400:00000200:13.0:1773851869.484854:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000001:15.0:1773851869.484855:0:60824:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000400:00000200:13.0:1773851869.484855:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000464fc1d9
00000020:00000040:15.0:1773851869.484856:0:60824:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000691436ac with handle 0x21b6f08f07a6ad85 to hash
00000400:00000010:13.0:1773851869.484856:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000464fc1d9.
00000020:00000001:15.0:1773851869.484857:0:60824:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00000100:00000001:13.0:1773851869.484857:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851869.484857:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00010000:00000001:15.0:1773851869.484858:0:60824:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637036135458368 : -107037574093248 : ffff9ea65f6b2640)
00000400:00000200:13.0:1773851869.484858:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00010000:00000010:15.0:1773851869.484859:0:60824:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000092176be3.
00010000:00000001:15.0:1773851869.484860:0:60824:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637036135458368 : -107037574093248 : ffff9ea65f6b2640)
00000800:00000200:13.0:1773851869.484860:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00010000:00010000:15.0:1773851869.484861:0:60824:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000691436ac/0x21b6f08f07a6ad85 lrc: 2/0,0 mode: --/CR res: [0x24002878f:0x8223:0x0].0x0 bits 0x0/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x6b1c65ccfe940fe5 expref: -99 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484865:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000040:15.0:1773851869.484866:0:60824:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000394656e8 : new locks_count 146
00000020:00000040:15.0:1773851869.484866:0:60824:0:(genops.c:871:class_export_get()) GET export 00000000394656e8 refcount=153
00010000:00000001:15.0:1773851869.484868:0:60824:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:15.0:1773851869.484869:0:60824:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:15.0:1773851869.484870:0:60824:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:15.0:1773851869.484871:0:60824:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:15.0:1773851869.484871:0:60824:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851869.484872:0:60824:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:15.0:1773851869.484872:0:60824:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x24002878f:0x8223:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:15.0:1773851869.484874:0:60824:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:15.0:1773851869.484874:0:60824:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002878f:0x8223:0x0]
00000020:00000001:15.0:1773851869.484875:0:60824:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:15.0:1773851869.484876:0:60824:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637140084488392 : -106933625063224 : ffff9ebe934378c8)
00000004:00000001:15.0:1773851869.484877:0:60824:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637140084488304 : -106933625063312 : ffff9ebe93437870)
00000004:00000001:15.0:1773851869.484878:0:60824:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:15.0:1773851869.484879:0:60824:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:15.0:1773851869.484879:0:60824:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:15.0:1773851869.484881:0:60824:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484882:0:60824:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484883:0:60824:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000040:15.0:1773851869.484884:0:60824:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 2008
00000100:00000001:15.0:1773851869.484885:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851869.484885:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851869.484887:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 2608 at 000000008da567e5.
02000000:00000001:15.0:1773851869.484887:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.484888:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851869.484889:0:60824:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:15.0:1773851869.484890:0:60824:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:15.0:1773851869.484890:0:60824:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:15.0:1773851869.484894:0:60824:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851869.484894:0:60824:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851869.484895:0:60824:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:15.0:1773851869.484896:0:60824:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:15.0:1773851869.484897:0:60824:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:15.0:1773851869.484897:0:60824:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:15.0:1773851869.484898:0:60824:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:15.0:1773851869.484899:0:60824:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:15.0:1773851869.484899:0:60824:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:15.0:1773851869.484900:0:60824:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:15.0:1773851869.484900:0:60824:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:15.0:1773851869.484901:0:60824:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:15.0:1773851869.484901:0:60824:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002878f:0x8223:0x0].0x0 (00000000166ab8a5) refcount = 6
00010000:00000040:15.0:1773851869.484903:0:60824:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:15.0:1773851869.484904:0:60824:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086246304/0x21b6f08f030472a5 lrc: 2/0,0 mode: PR/PR res: [0x24002878f:0x8223:0x0].0x0 bits 0x49/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.128.1@o2ib60 remote: 0x46e6d43eb611e764 expref: 276 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484907:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000040:15.0:1773851869.484908:0:60824:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c2d589d/0x21b6f08f07a4d185 lrc: 2/0,0 mode: PR/PR res: [0x24002878f:0x8223:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.128.1@o2ib60 remote: 0x46e6d43eb621e1d3 expref: 276 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484911:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000040:15.0:1773851869.484912:0:60824:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e34d54b/0x21b6f08e13d1bed1 lrc: 2/0,0 mode: PR/PR res: [0x24002878f:0x8223:0x0].0x0 bits 0x5b/0x0 rrc: 7 type: IBT gid 0 flags: 0x40200000000000 nid: 26563@kfi7 remote: 0x581d8fb695e4a609 expref: 5917 pid: 60907 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484915:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000040:15.0:1773851869.484917:0:60824:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4bdf112/0x21b6f08c98d326fe lrc: 2/0,0 mode: PR/PR res: [0x24002878f:0x8223:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 26563@kfi7 remote: 0x581d8fb68da77d5d expref: 5917 pid: 60560 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484919:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000040:15.0:1773851869.484921:0:60824:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001b5f8b26/0x21b6f0897d3e6d45 lrc: 2/0,0 mode: PR/PR res: [0x24002878f:0x8223:0x0].0x0 bits 0x40/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfb6a33f9 expref: 153 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484923:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00010000:15.0:1773851869.484925:0:60824:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000691436ac/0x21b6f08f07a6ad85 lrc: 3/0,0 mode: CR/CR res: [0x24002878f:0x8223:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940fe5 expref: 153 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484928:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00010000:00000001:15.0:1773851869.484929:0:60824:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:15.0:1773851869.484929:0:60824:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:15.0:1773851869.484930:0:60824:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851869.484931:0:60824:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:15.0:1773851869.484931:0:60824:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:15.0:1773851869.484932:0:60824:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851869.484932:0:60824:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:15.0:1773851869.484933:0:60824:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:15.0:1773851869.484934:0:60824:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000691436ac/0x21b6f08f07a6ad85 lrc: 3/0,0 mode: CR/CR res: [0x24002878f:0x8223:0x0].0x0 bits 0x8/0x0 rrc: 7 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.128.2@o2ib60 remote: 0x6b1c65ccfe940fe5 expref: 153 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:15.0:1773851869.484937:0:60824:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000166ab8a5 count: 6
00000004:00000001:15.0:1773851869.484938:0:60824:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:15.0:1773851869.484938:0:60824:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:15.0:1773851869.484939:0:60824:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002878f:0x8223:0x0]
00000020:00000001:15.0:1773851869.484939:0:60824:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:15.0:1773851869.484940:0:60824:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637140084488392 : -106933625063224 : ffff9ebe934378c8)
00000004:00000001:15.0:1773851869.484940:0:60824:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637140084488304 : -106933625063312 : ffff9ebe93437870)
00000004:00000001:15.0:1773851869.484941:0:60824:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:15.0:1773851869.484942:0:60824:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:15.0:1773851869.484942:0:60824:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:15.0:1773851869.484943:0:60824:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484943:0:60824:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484944:0:60824:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484944:0:60824:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:15.0:1773851869.484945:0:60824:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:15.0:1773851869.484945:0:60824:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:15.0:1773851869.484946:0:60824:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484946:0:60824:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484947:0:60824:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=2008 : 2008 : 7d8)
00000004:00000001:15.0:1773851869.484947:0:60824:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:15.0:1773851869.484948:0:60824:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:15.0:1773851869.484949:0:60824:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=2008 : 2008 : 7d8)
00010000:00000001:15.0:1773851869.484949:0:60824:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:15.0:1773851869.484950:0:60824:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:15.0:1773851869.484950:0:60824:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002878f:0x8223:0x0].0x0 (00000000166ab8a5)
00010000:00010000:15.0:1773851869.484951:0:60824:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:15.0:1773851869.484952:0:60824:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:15.0:1773851869.484952:0:60824:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851869.484953:0:60824:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:15.0:1773851869.484953:0:60824:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:15.0:1773851869.484954:0:60824:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:15.0:1773851869.484954:0:60824:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000691436ac, rc 0)
00000020:00000001:15.0:1773851869.484955:0:60824:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851869.484956:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183116358565, transno 0, xid 1858241565431424
00010000:00000001:15.0:1773851869.484956:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851869.484957:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3a84caa x1858241565431424/t0(0) o101->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 376/2352 e 0 to 0 dl 1773851956 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-matrix2-53703'
00010000:00000001:15.0:1773851869.484960:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851869.484961:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851869.484961:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=102 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851869.484962:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851869.484963:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000593bde95 refcount 3 to 192.168.128.2@o2ib60
00000100:00000001:15.0:1773851869.484964:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642471488 : -107157067080128 : ffff9e8a8d14de40)
02000000:00000001:15.0:1773851869.484965:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851869.484965:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.484966:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851869.484967:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.2@o2ib60
00000400:00000010:15.0:1773851869.484968:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e35829f1.
00000100:00000200:15.0:1773851869.484969:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 2352 bytes to portal 10, xid 1858241565431424, offset 224
00000400:00000200:15.0:1773851869.484970:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.2@o2ib60
00000400:00000200:15.0:1773851869.484972:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.2@o2ib60 to cpt 3
00000400:00000200:15.0:1773851869.484973:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 2
00000400:00000200:15.0:1773851869.484974:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000400:00000200:15.0:1773851869.484975:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 4
00000400:00000200:15.0:1773851869.484977:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.2@o2ib60 routed destination
00000400:00000200:15.0:1773851869.484979:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851869.484980:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:15.0:1773851869.484981:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851869.484982:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851869.484983:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.2@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851869.484984:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851869.484985:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769314:8769314:1024:4294967295] 2094@kfi7 LPNI seq info [1258746995:1258746995:16:4294967295]
00000400:00000200:15.0:1773851869.484986:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:15.0:1773851869.484987:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:15.0:1773851869.484989:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.2@o2ib60(192.168.128.2@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851869.484990:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000066ecea89 nid 192.168.128.2@o2ib60 refs 3
00000800:00000200:15.0:1773851869.484992:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851869.484993:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 2352 bytes in 1 frags
00000800:00000200:15.0:1773851869.484996:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851869.484998:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:15.0:1773851869.485001:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 2452 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:15.0:1773851869.485003:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851869.485005:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.485006:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000593bde95 refcount 2 to 192.168.128.2@o2ib60
00010000:00000001:15.0:1773851869.485007:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851869.485007:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.485007:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851869.485009:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3a84caa x1858241565431424/t0(0) o101->3f210437-b2af-4977-93b4-45f1c345c3ce@192.168.128.2@o2ib60:596/0 lens 376/2352 e 0 to 0 dl 1773851956 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-matrix2-53703'
00000100:00100000:15.0:1773851869.485012:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3a84caa pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:3f210437-b2af-4977-93b4-45f1c345c3ce+153:2463936:x1858241565431424:12345-192.168.128.2@o2ib60:101:login-matrix2-53703 Request processed in 181us (227us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851869.485012:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851869.485014:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.485015:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00100000:15.0:1773851869.485016:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.2@o2ib60, seq: 411190549
00000100:00000040:15.0:1773851869.485016:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000394656e8 : new rpc_count 0
00000400:00000200:13.0:1773851869.485016:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e35829f1
00000400:00000010:13.0:1773851869.485016:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e35829f1.
00000100:00000001:15.0:1773851869.485017:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851869.485017:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851869.485017:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851869.485018:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851869.485018:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851869.485018:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:15.0:1773851869.485019:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000800:00000200:13.0:1773851869.485019:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00000020:00000010:15.0:1773851869.485020:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047ae5d51.
00000020:00000040:15.0:1773851869.485020:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000394656e8 : new refcount 152
00000100:00000001:15.0:1773851869.485021:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851869.492633:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851869.492634:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851869.492635:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851869.492637:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851869.492639:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12609@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.492640:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12609@kfi7 : PUT - for me
00000400:00000200:29.0:1773851869.492642:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12609@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.492642:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc5eb278 nid 12609@kfi7 refs 1
00000400:00000200:29.0:1773851869.492644:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12609@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.492644:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc5eb278 nid 12609@kfi7 refs 2
00000400:00000200:29.0:1773851869.492645:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dc5eb278 nid 12609@kfi7 refs 3
00000400:00000200:29.0:1773851869.492646:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12609@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.492647:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12609@kfi7 of length 224 into portal 12 MB=0x69b4b56587100
00000400:00000200:29.0:1773851869.492649:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12609@kfi7 of length 224/224 into md 0x77fe139dd [64] + 177544
00000800:00000200:29.0:1773851869.492650:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851869.492652:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.492653:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12609@kfi7: PUT: OK
00000100:00000001:29.0:1773851869.492655:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851869.492655:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851869.492656:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002e35df54.
00000100:00000040:29.0:1773851869.492657:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000002e35df54 x1859597733753088 msgsize 224
00000100:00100000:29.0:1773851869.492658:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12609@kfi7 (source: 12345-12609@kfi7)
00000100:00000001:29.0:1773851869.492659:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851869.492660:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc5eb278 nid 12609@kfi7 refs 2
00000100:00000001:31.0:1773851869.492661:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851869.492661:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851869.492662:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851869.492662:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851869.492662:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851869.492663:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851869.492664:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597733753088
00000020:00000001:31.0:1773851869.492665:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851869.492665:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7d0ad
00000020:00000001:31.0:1773851869.492666:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851869.492669:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005ae9ff9e refcount=5
00000020:00000001:31.0:1773851869.492669:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117645075456 : -106956064476160 : ffff9eb959c53400)
00000020:00000001:31.0:1773851869.492670:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117645075456 : -106956064476160 : ffff9eb959c53400)
00000100:00000001:31.0:1773851869.492671:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851869.492672:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851869.492673:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851869.492674:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851869.492675:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851869.492676:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851869.492676:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851869.492677:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851869.492678:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851869.492678:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851869.492678:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.492679:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851869.492681:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851869.492681:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851869.492682:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851869.492682:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851869.492683:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851869.492683:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12609@kfi7, seq: 2055529
00000100:00000040:28.0:1773851869.492683:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005ae9ff9e : new rpc_count 1
00000100:00000001:31.0:1773851869.492684:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851869.492684:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309691776 : -106988399859840 : ffff9eb1d26e6780)
00000100:00000040:28.0:1773851869.492686:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002e35df54 x1859597733753088/t0(0) o400->68dd001d-98e6-41e8-a1f7-a16ebf77fd78@12609@kfi7:657/0 lens 224/0 e 0 to 0 dl 1773852017 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1284-0'
00000100:00000001:28.0:1773851869.492689:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851869.492690:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851869.492691:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e35df54 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:68dd001d-98e6-41e8-a1f7-a16ebf77fd78+5:39707:x1859597733753088:12345-12609@kfi7:400:default-tuolumne1284-0
00000100:00000200:28.0:1773851869.492692:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597733753088
00000020:00000001:28.0:1773851869.492693:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851869.492693:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851869.492694:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.492695:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851869.492695:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851869.492696:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851869.492696:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597733753088, found 0 last_xid 1859597733753087
00000020:00000001:28.0:1773851869.492697:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851869.492698:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851869.492698:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851869.492699:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.492700:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851869.492700:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851869.492701:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851869.492702:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b56c4382.
02000000:00000001:28.0:1773851869.492702:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851869.492703:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.492704:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851869.492704:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684601, transno 0, xid 1859597733753088
00010000:00000001:28.0:1773851869.492705:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851869.492706:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002e35df54 x1859597733753088/t0(0) o400->68dd001d-98e6-41e8-a1f7-a16ebf77fd78@12609@kfi7:657/0 lens 224/224 e 0 to 0 dl 1773852017 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1284-0'
00010000:00000001:28.0:1773851869.492708:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851869.492709:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851869.492710:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=102 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851869.492711:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851869.492711:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000362b3cf4 refcount 3 to 12609@kfi7
00000100:00000001:28.0:1773851869.492712:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869934784 : -107137839616832 : ffff9e8f0720acc0)
02000000:00000001:28.0:1773851869.492713:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851869.492714:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851869.492715:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851869.492715:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12609@kfi7
00000400:00000010:28.0:1773851869.492716:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000048f1f202.
00000100:00000200:28.0:1773851869.492717:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597733753088, offset 224
00000400:00000200:28.0:1773851869.492718:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12609@kfi7
00000400:00000200:28.0:1773851869.492719:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12609@kfi7 to cpt 7
00000400:00000200:28.0:1773851869.492720:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc5eb278 nid 12609@kfi7 refs 1
00000400:00000200:28.0:1773851869.492722:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dc5eb278 nid 12609@kfi7 refs 2
00000400:00000200:28.0:1773851869.492723:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dc5eb278 nid 12609@kfi7 refs 3
00000400:00000200:28.0:1773851869.492728:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12609@kfi7 local destination
00000400:00000200:28.0:1773851869.492729:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769315:8769315:1024:4294967295] 12609@kfi7 LPNI seq info [288631:288631:16:4294967295]
00000400:00000200:28.0:1773851869.492731:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dc5eb278 nid 12609@kfi7 refs 2
00000400:00000200:28.0:1773851869.492732:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12609@kfi7 to cpt 7
00000400:00000200:28.0:1773851869.492734:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12609@kfi7(12609@kfi7:12609@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851869.492736:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dc5eb278 nid 12609@kfi7 refs 3
00000800:00000200:28.0:1773851869.492737:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851869.492738:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851869.492741:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851869.492743:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008c0 Using peer 12609@kfi7(0x1000000000008c0)
00000800:00000200:28.0:1773851869.492747:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x1000000000008c0: rc=0
00000800:00000200:28.0:1773851869.492748:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851869.492751:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851869.492751:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000362b3cf4 refcount 2 to 12609@kfi7
00010000:00000001:28.0:1773851869.492753:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851869.492753:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851869.492754:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851869.492755:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002e35df54 x1859597733753088/t0(0) o400->68dd001d-98e6-41e8-a1f7-a16ebf77fd78@12609@kfi7:657/0 lens 224/224 e 0 to 0 dl 1773852017 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1284-0'
00000100:00100000:28.0:1773851869.492760:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e35df54 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:68dd001d-98e6-41e8-a1f7-a16ebf77fd78+5:39707:x1859597733753088:12345-12609@kfi7:400:default-tuolumne1284-0 Request processed in 70us (102us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851869.492763:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12609@kfi7, seq: 2055529
00000100:00000040:28.0:1773851869.492764:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005ae9ff9e : new rpc_count 0
00000100:00000001:28.0:1773851869.492765:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851869.492765:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851869.492766:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:28.0:1773851869.492767:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000020:00000010:28.0:1773851869.492768:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:28.0:1773851869.492769:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000005ae9ff9e : new refcount 4
00000100:00000001:28.0:1773851869.492770:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851869.492775:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008c0 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851869.492777:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.492778:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12609@kfi7: PUT: OK
00000400:00000200:29.0:1773851869.492779:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000048f1f202
00000400:00000010:29.0:1773851869.492780:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000048f1f202.
00000100:00000001:29.0:1773851869.492781:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851869.492781:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851869.492782:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc5eb278 nid 12609@kfi7 refs 2
00000800:00000200:29.0:1773851869.492784:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 12609@kfi7(000000006aa129aa):0x0 lsk 2241 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008c0 Transaction freed
00000004:00000001:30.0:1773851869.513730:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851869.513731:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851869.513731:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000912e612e.
00000004:00000001:5.0:1773851869.513731:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851869.513731:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:30.0:1773851869.513732:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000100:00000010:5.0:1773851869.513732:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003540135e.
00000004:00000001:4.0F:1773851869.513732:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851869.513733:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:5.0:1773851869.513733:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000004:00000020:4.0:1773851869.513733:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:30.0:1773851869.513734:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851869.513734:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:7.0:1773851869.513734:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851869.513734:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000181c7d4f.
00000100:00000001:5.0:1773851869.513734:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:4.0:1773851869.513734:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000026a80641.
02000000:00000001:30.0:1773851869.513735:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851869.513735:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
02000000:00000001:5.0:1773851869.513735:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:4.0:1773851869.513735:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:7.0:1773851869.513736:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851869.513736:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851869.513736:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513736:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851869.513736:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:30.0:1773851869.513737:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000078bc3602.
02000000:00000001:7.0:1773851869.513737:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851869.513737:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e7717c48.
02000000:00000001:4.0:1773851869.513737:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851869.513738:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851869.513738:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000005a2e8a27.
00000100:00000001:5.0:1773851869.513738:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851869.513738:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d7ad89bf.
00000100:00000001:30.0:1773851869.513739:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851869.513739:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.513739:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851869.513739:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513740:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851869.513740:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513740:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851869.513741:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513741:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851869.513741:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003540135e] to pc [ptlrpcd_01_01+1]  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851869.513741:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851869.513742:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000912e612e] to pc [ptlrpcd_07_00+0]  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851869.513742:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000181c7d4f] to pc [ptlrpcd_01_02+2]  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851869.513742:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000026a80641] to pc [ptlrpcd_01_03+3]  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851869.513746:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851869.513746:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851869.513747:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:5.0:1773851869.513747:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851869.513748:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851869.513748:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:5.0:1773851869.513748:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008e4a8f55.
00000100:00000001:4.0:1773851869.513748:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:4.0:1773851869.513748:0:41064:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00000001:31.0:1773851869.513749:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851869.513749:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:30.0:1773851869.513749:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000674d1ddd.
00080000:00000001:30.0:1773851869.513749:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637095830200320 : -106977879351296 : ffff9eb44580a000)
00000100:00000001:29.0:1773851869.513749:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851869.513749:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513749:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:4.0:1773851869.513749:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851869.513750:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851869.513750:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:7.0:1773851869.513750:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851869.513750:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637118063392768 : -106955646158848 : ffff9eb972b43800)
00080000:00000001:5.0:1773851869.513750:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851869.513750:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:31.0:1773851869.513751:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851869.513751:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513751:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851869.513751:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:30.0:1773851869.513752:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513752:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:5.0:1773851869.513752:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000100:00000001:4.0:1773851869.513752:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851869.513752:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:30.0:1773851869.513753:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00000001:7.0:1773851869.513753:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:5.0:1773851869.513753:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000008672d51.
00000100:00000040:4.0:1773851869.513753:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851869.513754:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:30.0:1773851869.513754:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009146192b.
02000000:00000001:7.0:1773851869.513754:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851869.513754:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851869.513754:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614143967029417ns, next at 614144967028215ns, rc = 0
00000100:00000001:31.0:1773851869.513755:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851869.513755:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614143967030339ns, next at 614144967028846ns, rc = 0
00000100:00100000:7.0:1773851869.513755:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000181c7d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051929280:7@kfi7:41:default-yuba2-0
00080000:00000001:5.0:1773851869.513755:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851869.513756:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851869.513756:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:5.0:1773851869.513756:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513756:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851869.513756:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851869.513757:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851869.513757:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000912e612e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051929216:2080@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851869.513757:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851869.513757:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:5.0:1773851869.513757:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851869.513757:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851869.513758:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851869.513758:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851869.513758:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851869.513758:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:4.0:1773851869.513758:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.513759:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851869.513759:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:7.0:1773851869.513759:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002b002509.
00000100:00100000:4.0:1773851869.513759:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003540135e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051929152:3@kfi7:13:default-yuba2-0
02000000:00000001:31.0:1773851869.513760:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851869.513760:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513760:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851869.513761:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:5.0:1773851869.513761:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:4.0:1773851869.513761:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851869.513761:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851869.513762:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000660c7356.
02000000:00000001:31.0:1773851869.513762:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851869.513762:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:7.0:1773851869.513762:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000007398a75e.
00000100:00000001:5.0:1773851869.513762:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851869.513762:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:7.0:1773851869.513763:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
02000000:00000010:4.0:1773851869.513763:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000655a9ee6.
00000400:00000200:31.0:1773851869.513764:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000010:31.0:1773851869.513764:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
02000000:00000001:4.0:1773851869.513764:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851869.513765:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000100:00000200:7.0:1773851869.513765:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929280, portal 4
00000100:00000001:5.0:1773851869.513765:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:4.0:1773851869.513765:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000200:31.0:1773851869.513766:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929216, portal 4
00000100:00000001:7.0:1773851869.513766:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851869.513766:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309150080 : -106994400401536 : ffff9eb06cc56780)
00000100:00000001:5.0:1773851869.513766:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851869.513766:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000010:4.0:1773851869.513766:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000100:00000001:31.0:1773851869.513767:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:5.0:1773851869.513767:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851869.513767:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a0b1f78.
00000100:00000001:31.0:1773851869.513768:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637139832826880 : -106933876724736 : ffff9ebe84436c00)
00000100:00000040:7.0:1773851869.513768:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851869.513768:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929152, portal 4
00000100:00000040:31.0:1773851869.513769:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851869.513769:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851869.513770:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851869.513770:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513770:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637117886787712 : -106955822763904 : ffff9eb9682d7080)
00000100:00000001:7.0:1773851869.513771:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:5.0:1773851869.513771:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:5.0:1773851869.513771:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851869.513771:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851869.513772:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851869.513772:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:7.0:1773851869.513772:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c448bd40.
00000100:00100000:5.0:1773851869.513772:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000026a80641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051929344:2098@kfi7:41:default-yuba2-0
00000100:00000040:31.0:1773851869.513773:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000100:00000200:7.0:1773851869.513773:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051929280, offset 0
00000100:00000001:5.0:1773851869.513773:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:31.0:1773851869.513774:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defe7a25.
02000000:00000001:5.0:1773851869.513774:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:4.0:1773851869.513774:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:31.0:1773851869.513775:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929216, offset 0
00000400:00000200:7.0:1773851869.513775:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
02000000:00000001:5.0:1773851869.513775:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851869.513775:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:4.0:1773851869.513775:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000200:31.0:1773851869.513776:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:7.0:1773851869.513776:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
02000000:00000010:5.0:1773851869.513776:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000604533c9.
00000400:00000010:4.0:1773851869.513776:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009ae139dd.
00000400:00000200:7.0:1773851869.513777:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
02000000:00000001:5.0:1773851869.513777:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851869.513777:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929152, offset 0
00000400:00000200:31.0:1773851869.513778:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851869.513778:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:4.0:1773851869.513778:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000200:31.0:1773851869.513779:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:7.0:1773851869.513779:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:31.0:1773851869.513780:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851869.513780:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000400:00000200:31.0:1773851869.513782:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851869.513782:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769310, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769315, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851869.513783:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:31.0:1773851869.513785:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769310, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769315, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851869.513785:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851869.513786:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851869.513787:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851869.513788:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851869.513788:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851869.513788:0:41066:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340062, 17340061]
00000400:00000200:31.0:1773851869.513790:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:7.0:1773851869.513790:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000400:00000200:31.0:1773851869.513791:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769316:8769316:1024:4294967295] 2080@kfi7 LPNI seq info [5404391:5404391:16:4294967295]
00000400:00000200:7.0:1773851869.513792:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769317:8769317:1024:4294967295] 7@kfi7 LPNI seq info [17340063:17340063:16:4294967295]
00000400:00000200:31.0:1773851869.513793:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851869.513793:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:31.0:1773851869.513794:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851869.513795:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:5.0:1773851869.513796:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:5.0:1773851869.513797:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000044a0e143.
00000400:00000010:5.0:1773851869.513797:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081188a2f.
00000400:00000200:4.0:1773851869.513797:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:31.0:1773851869.513798:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851869.513798:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000100:00000200:5.0:1773851869.513798:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929344, portal 4
00000400:00000200:4.0:1773851869.513798:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000001:5.0:1773851869.513799:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:31.0:1773851869.513800:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851869.513800:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:5.0:1773851869.513800:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528714496 : -106978180837120 : ffff9eb433885100)
00000400:00000200:4.0:1773851869.513800:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:7.0:1773851869.513801:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000040:5.0:1773851869.513801:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851869.513801:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:31.0:1773851869.513802:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:4.0:1773851869.513802:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000800:00000200:31.0:1773851869.513803:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851869.513803:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:5.0:1773851869.513804:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851869.513804:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769317, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769315, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851869.513805:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000040:5.0:1773851869.513805:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000800:00000200:31.0:1773851869.513806:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000010:5.0:1773851869.513806:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005a691dda.
00000100:00000200:5.0:1773851869.513806:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051929344, offset 0
00000400:00000200:4.0:1773851869.513806:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851869.513807:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851869.513808:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Using peer 7@kfi7(0x11b1)
00000400:00000200:5.0:1773851869.513808:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:4.0:1773851869.513808:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000400:00000200:4.0:1773851869.513809:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769318:8769318:1024:4294967295] 3@kfi7 LPNI seq info [5406221:5406221:16:4294967295]
00000800:00000200:31.0:1773851869.513810:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Using peer 2080@kfi7(0x64e)
00000400:00000200:4.0:1773851869.513811:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:4.0:1773851869.513812:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:5.0:1773851869.513813:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000800:00000200:31.0:1773851869.513814:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x64e: rc=0
00000800:00000200:7.0:1773851869.513814:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x11b1: rc=0
00000400:00000200:5.0:1773851869.513814:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000800:00000200:31.0:1773851869.513815:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851869.513815:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:4.0:1773851869.513815:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000800:00000200:7.0:1773851869.513816:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851869.513816:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:4.0:1773851869.513816:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000001:31.0:1773851869.513817:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851869.513817:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000100:00000001:31.0:1773851869.513818:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851869.513818:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851869.513818:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:31.0:1773851869.513819:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513819:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851869.513819:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769317, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769318, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851869.513820:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513820:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851869.513820:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:31.0:1773851869.513821:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851869.513821:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851869.513821:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:31.0:1773851869.513822:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851869.513822:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851869.513822:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851869.513823:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851869.513823:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851869.513823:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:5.0:1773851869.513823:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851869.513824:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851869.513824:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851869.513824:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346202, 20346201]
00000800:00000200:4.0:1773851869.513824:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:31.0:1773851869.513825:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851869.513825:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851869.513825:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.513826:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851869.513826:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851869.513826:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851869.513826:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000100:00000001:31.0:1773851869.513827:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851869.513827:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851869.513827:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769319:8769319:1023:4294967295] 2105@kfi7 LPNI seq info [20346203:20346203:16:4294967295]
00000800:00000200:4.0:1773851869.513827:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Using peer 3@kfi7(0x2000000000003b5)
00000400:00000200:5.0:1773851869.513828:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:29.0:1773851869.513829:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:29.0:1773851869.513829:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defe7a25
00000400:00000200:5.0:1773851869.513829:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000010:29.0:1773851869.513830:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defe7a25.
00000100:00000001:29.0:1773851869.513830:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851869.513831:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851869.513832:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851869.513833:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:29.0:1773851869.513834:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851869.513835:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851869.513835:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851869.513836:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851869.513836:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851869.513836:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x2000000000003b5: rc=0
00000400:00000200:6.0:1773851869.513838:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851869.513838:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851869.513839:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000800:00000200:5.0:1773851869.513839:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851869.513840:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c448bd40
00000100:00000001:29.0:1773851869.513841:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851869.513841:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c448bd40.
00000100:00000001:6.0:1773851869.513841:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:5.0:1773851869.513841:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000100:00000001:4.0:1773851869.513841:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513841:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851869.513842:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851869.513842:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851869.513843:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000200:6.0:1773851869.513843:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851869.513843:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851869.513844:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Transaction freed
00000800:00000200:5.0:1773851869.513844:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 324 bytes to peer 0x20000000000085c: rc=0
00000100:00000001:4.0:1773851869.513844:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851869.513846:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:5.0:1773851869.513846:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:6.0:1773851869.513847:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851869.513848:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.513849:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851869.513850:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851869.513850:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851869.513850:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851869.513851:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:5.0:1773851869.513851:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851869.513852:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851869.513852:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851869.513853:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Transaction freed
00000100:00000001:5.0:1773851869.513853:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851869.513853:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:7.0:1773851869.513854:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851869.513854:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851869.513855:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:5.0:1773851869.513855:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851869.513855:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851869.513856:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:7.0:1773851869.513856:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000800:00000200:6.0:1773851869.513856:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851869.513856:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851869.513857:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009ae139dd
00000800:00000200:9.0:1773851869.513858:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:7.0:1773851869.513858:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009ae139dd.
00000100:00000001:7.0:1773851869.513859:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:6.0:1773851869.513859:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:7.0:1773851869.513860:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851869.513861:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000400:00000200:6.0:1773851869.513862:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005a691dda
00000800:00000200:9.0:1773851869.513863:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000010:6.0:1773851869.513863:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005a691dda.
00000100:00000001:6.0:1773851869.513864:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:7.0:1773851869.513865:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:6.0:1773851869.513865:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851869.513867:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851869.513867:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000040:7.0:1773851869.513867:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851869.513868:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851869.513869:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2080@kfi7 : PUT - for me
00000100:00000001:6.0:1773851869.513870:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:13.0:1773851869.513871:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851869.513871:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:7.0:1773851869.513872:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851869.513872:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851869.513873:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851869.513873:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000100:00000001:7.0:1773851869.513873:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:7.0:1773851869.513874:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:9.0:1773851869.513875:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:13.0:1773851869.513876:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851869.513876:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:6.0:1773851869.513877:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851869.513878:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:9.0:1773851869.513878:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:7.0:1773851869.513878:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Transaction freed
00000100:00000001:6.0:1773851869.513878:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:13.0:1773851869.513879:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:6.0:1773851869.513879:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:9.0:1773851869.513880:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:13.0:1773851869.513882:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:9.0:1773851869.513882:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3a80
00000800:00000200:6.0:1773851869.513882:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c Transaction freed
00000800:00000200:29.0:1773851869.513883:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851869.513884:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851869.513884:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851869.513884:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:29.0:1773851869.513885:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851869.513885:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:9.0:1773851869.513886:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781697a49 [1] + 224
00000800:00000200:29.0:1773851869.513887:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851869.513887:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:13.0:1773851869.513888:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:29.0:1773851869.513889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:13.0:1773851869.513889:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3ac0
00000400:00000200:29.0:1773851869.513890:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 3@kfi7 : PUT - for me
00000800:00000200:9.0:1773851869.513890:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851869.513891:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:13.0:1773851869.513891:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:29.0:1773851869.513892:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:13.0:1773851869.513893:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f624d [1] + 224
00000400:00000200:9.0:1773851869.513893:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851869.513894:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851869.513894:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:29.0:1773851869.513895:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:29.0:1773851869.513896:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:13.0:1773851869.513896:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851869.513896:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:29.0:1773851869.513897:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3a40
00000800:00000200:25.0:1773851869.513897:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:13.0:1773851869.513897:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851869.513897:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:25.0:1773851869.513898:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851869.513899:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:13.0:1773851869.513899:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000200:9.0:1773851869.513899:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851869.513900:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851869.513901:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x780080abd [1] + 224
00000100:00000001:13.0:1773851869.513901:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:25.0:1773851869.513902:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851869.513903:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:13.0:1773851869.513903:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851869.513904:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851869.513905:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:29.0:1773851869.513906:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000100:00000040:9.0:1773851869.513906:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851869.513907:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851869.513907:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2105@kfi7 : PUT - for me
00000100:00000040:13.0:1773851869.513907:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851869.513908:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851869.513908:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.513909:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000100:00000040:29.0:1773851869.513911:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851869.513911:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.513911:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851869.513912:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000100:00000001:13.0:1773851869.513912:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851869.513913:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:9.0:1773851869.513913:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:13.0:1773851869.513914:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:9.0:1773851869.513914:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:7.0:1773851869.513914:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851869.513915:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851869.513915:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:25.0:1773851869.513915:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:7.0:1773851869.513915:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:25.0:1773851869.513916:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3b00
00000400:00000001:31.0:1773851869.513917:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851869.513917:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:25.0:1773851869.513917:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000800:00000200:9.0:1773851869.513917:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000010:31.0:1773851869.513918:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000100:00000001:29.0:1773851869.513918:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:7.0:1773851869.513918:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:31.0:1773851869.513919:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000400:00000200:29.0:1773851869.513919:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:25.0:1773851869.513919:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b30f25 [1] + 224
00000400:00000001:7.0:1773851869.513919:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851869.513920:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000800:00000200:29.0:1773851869.513920:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000010:7.0:1773851869.513920:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000007398a75e.
00000100:00000001:31.0:1773851869.513921:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:7.0:1773851869.513921:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
00000100:00000001:4.0:1773851869.513921:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:31.0:1773851869.513922:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851869.513922:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:7.0:1773851869.513922:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000100:00000001:4.0:1773851869.513922:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851869.513923:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:4.0:1773851869.513923:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:25.0:1773851869.513924:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:4.0:1773851869.513924:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:31.0:1773851869.513925:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851869.513925:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000200:7.0:1773851869.513925:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851869.513925:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000100:00000001:25.0:1773851869.513926:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:4.0:1773851869.513926:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a0b1f78
00000400:00000010:4.0:1773851869.513927:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a0b1f78.
00000100:00000001:31.0:1773851869.513928:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851869.513928:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:25.0:1773851869.513928:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851869.513928:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851869.513929:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851869.513930:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851869.513930:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:7.0:1773851869.513930:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851869.513930:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851869.513931:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851869.513932:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851869.513932:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851869.513933:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=102 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851869.513935:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=102 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851869.513935:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:4.0:1773851869.513935:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851869.513936:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851869.513936:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513936:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:31.0:1773851869.513937:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:25.0:1773851869.513937:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851869.513937:0:41066:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:31.0:1773851869.513938:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851869.513938:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
02000000:00000001:7.0:1773851869.513938:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851869.513939:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851869.513939:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000800:00000200:25.0:1773851869.513939:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851869.513939:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851869.513939:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851869.513940:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851869.513940:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.513940:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851869.513940:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851869.513940:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851869.513941:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851869.513941:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:5.0:1773851869.513941:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851869.513941:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:4.0:1773851869.513941:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:31.0:1773851869.513942:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:5.0:1773851869.513942:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000044a0e143.
02000000:00000001:4.0:1773851869.513942:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:7.0:1773851869.513943:0:41066:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=128 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851869.513943:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081188a2f
00000400:00000010:5.0:1773851869.513943:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081188a2f.
00000100:00000001:4.0:1773851869.513943:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851869.513944:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:4.0:1773851869.513944:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.513945:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:7.0:1773851869.513945:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=134 v=66 (1 1 1 1)
00000100:00000200:5.0:1773851869.513945:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851869.513945:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.513946:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851869.513946:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00001000:4.0:1773851869.513946:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=102 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851869.513947:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851869.513947:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851869.513948:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:4.0:1773851869.513948:0:41064:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=102 v=66 (1 1 1 1)
00000004:00000040:31.0:1773851869.513949:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00010000:00000001:7.0:1773851869.513949:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851869.513949:0:41066:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851869.513949:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:31.0:1773851869.513950:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510652928 avail=351508048896 avail_mb=1373078316 hwm_mb=3131103 files=372095803 ffree=343272122 state=0: rc = 0
00000100:00000001:4.0:1773851869.513950:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851869.513951:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:5.0:1773851869.513951:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851869.513951:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:31.0:1773851869.513952:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510652928 free, 351508048896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095803 files, 343272122 free files
00000100:00000040:7.0:1773851869.513952:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:5.0:1773851869.513952:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851869.513952:0:41067:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:4.0:1773851869.513952:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851869.513953:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851869.513953:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851869.513953:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851869.513953:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:4.0:1773851869.513953:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851869.513954:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.513954:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513954:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851869.513955:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:5.0:1773851869.513955:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851869.513956:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:5.0:1773851869.513956:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=102 v=66 (66 66 66 66)
00000100:00001000:5.0:1773851869.513957:0:41067:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=102 v=66 (1 1 1 1)
00000100:00000040:4.0:1773851869.513957:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:5.0:1773851869.513958:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851869.513958:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00100000:31.0:1773851869.513959:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000912e612e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051929216:2080@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851869.513959:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851869.513959:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:4.0:1773851869.513959:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513960:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:5.0:1773851869.513960:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851869.513960:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851869.513961:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851869.513961:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851869.513961:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851869.513961:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:5.0:1773851869.513961:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851869.513962:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851869.513962:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851869.513962:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851869.513963:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000912e612e x1859433051929216/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:7.0:1773851869.513963:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:5.0:1773851869.513963:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851869.513965:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851869.513965:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000020:7.0:1773851869.513965:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031744 blocks, 31536852576 free, 31536831136 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425403 files, 2779493110 free files
00000100:00000001:5.0:1773851869.513965:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851869.513965:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000010:31.0:1773851869.513966:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000660c7356.
00000100:00000001:5.0:1773851869.513966:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851869.513966:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851869.513966:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851869.513966:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851869.513967:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000001:7.0:1773851869.513967:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851869.513967:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:4.0:1773851869.513967:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000001:31.0:1773851869.513968:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851869.513968:0:41088:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000004:00000020:5.0:1773851869.513968:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000032 blocks, 31354647072 free, 31354588960 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064196 files, 2870603674 free files
00000004:00000040:4.0:1773851869.513968:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000020:00000001:31.0:1773851869.513969:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000001:5.0:1773851869.513969:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851869.513969:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353650176 avail=351351228416 avail_mb=1372465736 hwm_mb=3131101 files=372083334 ffree=343118799 state=0: rc = 0
02000000:00000010:31.0:1773851869.513970:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000078bc3602.
00000100:00000040:7.0:1773851869.513970:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:5.0:1773851869.513970:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851869.513971:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851869.513971:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851869.513972:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000912e612e.
00000100:00100000:5.0:1773851869.513972:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000026a80641 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051929344:2098@kfi7:41:default-yuba2-0
00000004:00000020:4.0:1773851869.513972:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353650176 free, 351351228416 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083334 files, 343118799 free files
00000100:00000001:31.0:1773851869.513973:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851869.513973:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851869.513974:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:7.0:1773851869.513974:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000181c7d4f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051929280:7@kfi7:41:default-yuba2-0
00000100:00000001:5.0:1773851869.513974:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851869.513974:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851869.513975:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851869.513975:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851869.513975:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851869.513975:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000026a80641 x1859433051929344/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851869.513976:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851869.513976:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513976:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851869.513976:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851869.513977:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851869.513978:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000181c7d4f x1859433051929280/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851869.513978:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851869.513978:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851869.513979:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000604533c9.
02000000:00000001:5.0:1773851869.513980:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851869.513980:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000100:00100000:4.0:1773851869.513980:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003540135e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051929152:3@kfi7:13:default-yuba2-0
00000020:00000040:5.0:1773851869.513981:0:41067:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000020:00000001:5.0:1773851869.513981:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851869.513982:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000010:5.0:1773851869.513982:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d7ad89bf.
02000000:00000001:7.0:1773851869.513983:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:5.0:1773851869.513983:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851869.513983:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:4.0:1773851869.513983:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:7.0:1773851869.513984:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002b002509.
00000100:00000010:5.0:1773851869.513984:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000026a80641.
00000100:00000001:4.0:1773851869.513984:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:7.0:1773851869.513985:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:5.0:1773851869.513985:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851869.513985:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851869.513985:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003540135e x1859433051929152/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852022 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:7.0:1773851869.513986:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:5.0:1773851869.513986:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:7.0:1773851869.513987:0:41066:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:5.0:1773851869.513987:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851869.513987:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.513988:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851869.513988:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000005a2e8a27.
00000100:00000001:5.0:1773851869.513988:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851869.513988:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.513989:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851869.513989:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:7.0:1773851869.513990:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851869.513990:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:4.0:1773851869.513990:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000655a9ee6.
00000100:00000010:7.0:1773851869.513991:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000181c7d4f.
00000100:00000001:7.0:1773851869.513992:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:4.0:1773851869.513992:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:7.0:1773851869.513993:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851869.513993:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851869.513993:0:41064:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000100:00000001:7.0:1773851869.513994:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851869.513994:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851869.513995:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:4.0:1773851869.513995:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e7717c48.
00000100:00000001:7.0:1773851869.513996:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.513996:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:4.0:1773851869.513996:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:7.0:1773851869.513997:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851869.513997:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851869.513998:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003540135e.
00000100:00000001:4.0:1773851869.513999:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851869.514000:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851869.514000:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851869.514002:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851869.514002:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851869.514003:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851869.514004:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851869.537059:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851869.537060:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851869.537062:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851869.537065:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851869.537069:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17410@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.537071:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17410@kfi7 : PUT - for me
00000400:00000200:25.0:1773851869.537072:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17410@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.537073:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005ed93e25 nid 17410@kfi7 refs 1
00000400:00000200:25.0:1773851869.537075:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17410@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.537076:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005ed93e25 nid 17410@kfi7 refs 2
00000400:00000200:25.0:1773851869.537078:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005ed93e25 nid 17410@kfi7 refs 3
00000400:00000200:25.0:1773851869.537079:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17411@kfi7 to cpt 1
00000400:00000200:25.0:1773851869.537081:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17411@kfi7 of length 224 into portal 12 MB=0x69b4bb2df3ac0
00000400:00000200:25.0:1773851869.537083:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17411@kfi7 of length 224/224 into md 0x16159c9699 [64] + 10504
00000800:00000200:25.0:1773851869.537086:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851869.537089:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851869.537090:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17410@kfi7: PUT: OK
00000100:00000001:25.0:1773851869.537092:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851869.537092:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851869.537094:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a181f951.
00000100:00000040:25.0:1773851869.537095:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000a181f951 x1859599286090432 msgsize 224
00000100:00100000:25.0:1773851869.537097:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17411@kfi7 (source: 12345-17410@kfi7)
00000100:00000001:25.0:1773851869.537100:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851869.537101:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005ed93e25 nid 17410@kfi7 refs 2
00000800:00000200:25.0:1773851869.537103:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851869.537107:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851869.537108:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851869.537109:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851869.537110:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851869.537111:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851869.537112:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599286090432
00000020:00000001:25.0:1773851869.537113:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851869.537114:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8308b
00000020:00000001:25.0:1773851869.537115:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851869.537118:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005386169b refcount=5
00000020:00000001:25.0:1773851869.537119:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637094614313984 : -106979095237632 : ffff9eb3fd07ac00)
00000020:00000001:25.0:1773851869.537120:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637094614313984 : -106979095237632 : ffff9eb3fd07ac00)
00000100:00000001:25.0:1773851869.537121:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851869.537122:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851869.537123:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000034fe4ec0.
00000020:00000010:25.0:1773851869.537125:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851869.537127:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851869.537128:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851869.537129:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851869.537130:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851869.537131:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851869.537132:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851869.537133:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851869.537135:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851869.537137:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851869.537137:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851869.537137:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851869.537138:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851869.537139:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17411@kfi7, seq: 2025104
00000100:00000001:26.0:1773851869.537140:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851869.537140:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005386169b : new rpc_count 1
00000100:00000001:26.0:1773851869.537141:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851869.537141:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478767360 : -106938230784256 : ffff9ebd80bdbf00)
00000100:00000040:25.0:1773851869.537143:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a181f951 x1859599286090432/t0(0) o400->56e1bf87-85d8-400c-a78e-652cd7ae3cf1@17411@kfi7:86/0 lens 224/0 e 0 to 0 dl 1773852201 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1591-0'
00000100:00000001:25.0:1773851869.537148:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851869.537148:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851869.537150:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a181f951 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:56e1bf87-85d8-400c-a78e-652cd7ae3cf1+5:39728:x1859599286090432:12345-17411@kfi7:400:default-tuolumne1591-0
00000100:00000200:25.0:1773851869.537152:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599286090432
00000020:00000001:25.0:1773851869.537153:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851869.537154:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851869.537155:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.537156:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851869.537156:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851869.537158:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851869.537159:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599286090432, found 0 last_xid 1859599286090431
00000020:00000001:25.0:1773851869.537160:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851869.537161:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851869.537162:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851869.537163:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.537164:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851869.537164:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851869.537165:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851869.537166:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000059c91f3.
02000000:00000001:25.0:1773851869.537167:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851869.537169:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.537170:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851869.537171:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596783, transno 0, xid 1859599286090432
00010000:00000001:25.0:1773851869.537172:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851869.537173:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a181f951 x1859599286090432/t0(0) o400->56e1bf87-85d8-400c-a78e-652cd7ae3cf1@17411@kfi7:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1591-0'
00010000:00000001:25.0:1773851869.537178:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851869.537179:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851869.537180:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=102 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851869.537182:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851869.537183:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013c707cc refcount 3 to 17411@kfi7
00000100:00000001:25.0:1773851869.537184:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405409888 : -107145304141728 : ffff9e8d4a351060)
02000000:00000001:25.0:1773851869.537185:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851869.537186:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851869.537187:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851869.537188:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17410@kfi7
00000400:00000010:25.0:1773851869.537189:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028f72f4c.
00000100:00000200:25.0:1773851869.537191:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599286090432, offset 224
00000400:00000200:25.0:1773851869.537193:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17410@kfi7
00000400:00000200:25.0:1773851869.537194:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17410@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.537195:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005ed93e25 nid 17410@kfi7 refs 1
00000400:00000200:25.0:1773851869.537197:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005ed93e25 nid 17410@kfi7 refs 2
00000400:00000200:25.0:1773851869.537199:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005ed93e25 nid 17410@kfi7 refs 3
00000400:00000200:25.0:1773851869.537201:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17410@kfi7 local destination
00000400:00000200:25.0:1773851869.537203:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769320:8769320:1024:4294967295] 17410@kfi7 LPNI seq info [24659976:24659976:16:4294967295]
00000400:00000200:25.0:1773851869.537205:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005ed93e25 nid 17410@kfi7 refs 2
00000400:00000200:25.0:1773851869.537207:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17410@kfi7 to cpt 6
00000400:00000200:25.0:1773851869.537210:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17410@kfi7(17410@kfi7:17410@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851869.537212:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005ed93e25 nid 17410@kfi7 refs 3
00000800:00000200:25.0:1773851869.537214:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851869.537216:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2054@kfi7:6 -> 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851869.537225:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2054@kfi7:6 -> 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851869.537230:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2054@kfi7:6 -> 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ecc Using peer 17410@kfi7(0x100000000000ecc)
00000800:00000200:25.0:1773851869.537235:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000009b172e83: Posted send of 324 bytes to peer 0x100000000000ecc: rc=0
00000800:00000200:25.0:1773851869.537237:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2054@kfi7:6 -> 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ecc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851869.537241:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851869.537242:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013c707cc refcount 2 to 17411@kfi7
00010000:00000001:25.0:1773851869.537243:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851869.537244:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851869.537245:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851869.537246:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a181f951 x1859599286090432/t0(0) o400->56e1bf87-85d8-400c-a78e-652cd7ae3cf1@17411@kfi7:86/0 lens 224/224 e 0 to 0 dl 1773852201 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1591-0'
00000800:00000200:27.0:1773851869.537250:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2054@kfi7:6 -> 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ecc TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851869.537252:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851869.537252:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17410@kfi7: PUT: OK
00000100:00100000:25.0:1773851869.537252:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a181f951 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:56e1bf87-85d8-400c-a78e-652cd7ae3cf1+5:39728:x1859599286090432:12345-17411@kfi7:400:default-tuolumne1591-0 Request processed in 103us (156us total) trans 0 rc 0/0
00000400:00000200:27.0:1773851869.537253:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028f72f4c
00000400:00000010:27.0:1773851869.537254:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028f72f4c.
00000100:00000001:27.0:1773851869.537255:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851869.537255:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851869.537256:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005ed93e25 nid 17410@kfi7 refs 2
00000100:00100000:25.0:1773851869.537256:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17411@kfi7, seq: 2025104
00000800:00000200:27.0:1773851869.537257:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2054@kfi7:6 -> 17410@kfi7(0000000063078126):0x0 lsk 3789 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000ecc Transaction freed
00000100:00000040:25.0:1773851869.537257:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005386169b : new rpc_count 0
00000100:00000001:25.0:1773851869.537258:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851869.537259:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851869.537260:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851869.537261:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000020:00000010:25.0:1773851869.537263:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000034fe4ec0.
00000020:00000040:25.0:1773851869.537264:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000005386169b : new refcount 4
00000100:00000001:25.0:1773851869.537265:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851869.572913:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851869.572915:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851869.572916:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851869.572921:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851869.572924:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10801@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.572925:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10801@kfi7 : PUT - for me
00000400:00000200:13.0:1773851869.572926:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10801@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.572927:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e88b8e6 nid 10801@kfi7 refs 1
00000400:00000200:13.0:1773851869.572929:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10801@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.572930:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e88b8e6 nid 10801@kfi7 refs 2
00000400:00000200:13.0:1773851869.572931:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003e88b8e6 nid 10801@kfi7 refs 3
00000400:00000200:13.0:1773851869.572932:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10993@kfi7 to cpt 5
00000400:00000200:13.0:1773851869.572933:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10993@kfi7 of length 224 into portal 12 MB=0x699e0ec9bf940
00000400:00000200:13.0:1773851869.572935:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10993@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 31904
00000800:00000200:13.0:1773851869.572937:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851869.572939:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.572940:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10801@kfi7: PUT: OK
00000100:00000001:13.0:1773851869.572941:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851869.572942:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851869.572943:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ae84b5d1.
00000100:00000040:13.0:1773851869.572944:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ae84b5d1 x1858041181632832 msgsize 224
00000100:00100000:13.0:1773851869.572945:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10993@kfi7 (source: 12345-10801@kfi7)
00000100:00000001:13.0:1773851869.572947:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851869.572948:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003e88b8e6 nid 10801@kfi7 refs 2
00000100:00000001:15.0:1773851869.572949:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851869.572949:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851869.572949:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851869.572950:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851869.572950:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851869.572951:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851869.572952:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041181632832
00000020:00000001:15.0:1773851869.572953:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851869.572954:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c55
00000020:00000001:15.0:1773851869.572954:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851869.572957:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e20659df refcount=6
00000020:00000001:15.0:1773851869.572958:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628298752 : -107123081252864 : ffff9e9276cb7000)
00000020:00000001:15.0:1773851869.572959:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628298752 : -107123081252864 : ffff9e9276cb7000)
00000100:00000001:15.0:1773851869.572960:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851869.572961:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851869.572962:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047ae5d51.
00000020:00000010:15.0:1773851869.572964:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851869.572965:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851869.572966:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851869.572966:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851869.572967:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851869.572968:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851869.572968:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851869.572969:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.572970:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851869.572972:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851869.572972:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851869.572972:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851869.572973:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851869.572974:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10993@kfi7, seq: 2289843
00000100:00000040:15.0:1773851869.572975:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e20659df : new rpc_count 1
00000100:00000001:12.0:1773851869.572975:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.572976:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970973184 : -107043738578432 : ffff9ea4effc9200)
00000100:00000001:12.0:1773851869.572976:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.572977:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ae84b5d1 x1858041181632832/t0(0) o400->ceac5dbb-1201-4f79-b021-76a2c88c72b9@10993@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1165-0'
00000100:00000001:15.0:1773851869.572981:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851869.572981:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851869.572982:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae84b5d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ceac5dbb-1201-4f79-b021-76a2c88c72b9+6:39679:x1858041181632832:12345-10993@kfi7:400:default-tuolumne1165-0
00000100:00000200:15.0:1773851869.572984:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041181632832
00000020:00000001:15.0:1773851869.572985:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851869.572986:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851869.572987:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.572988:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851869.572989:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851869.572991:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851869.572992:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041181632832, found 0 last_xid 1858041181632831
00000020:00000001:15.0:1773851869.572993:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851869.572994:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851869.572995:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851869.572995:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.572997:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851869.572998:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851869.572999:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851869.573000:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007f7d68e9.
02000000:00000001:15.0:1773851869.573001:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.573002:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.573004:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851869.573005:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253967359, transno 0, xid 1858041181632832
00010000:00000001:15.0:1773851869.573006:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851869.573008:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ae84b5d1 x1858041181632832/t0(0) o400->ceac5dbb-1201-4f79-b021-76a2c88c72b9@10993@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1165-0'
00010000:00000001:15.0:1773851869.573019:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851869.573020:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851869.573021:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=102 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851869.573023:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851869.573024:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee2fab70 refcount 3 to 10993@kfi7
00000100:00000001:15.0:1773851869.573026:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027776 : -107156745523840 : ffff9e8aa03f6d80)
02000000:00000001:15.0:1773851869.573028:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851869.573029:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.573030:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851869.573032:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10801@kfi7
00000400:00000010:15.0:1773851869.573033:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034ed0079.
00000100:00000200:15.0:1773851869.573035:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041181632832, offset 224
00000400:00000200:15.0:1773851869.573037:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10801@kfi7
00000400:00000200:15.0:1773851869.573039:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10801@kfi7 to cpt 3
00000400:00000200:15.0:1773851869.573041:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e88b8e6 nid 10801@kfi7 refs 1
00000400:00000200:15.0:1773851869.573042:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003e88b8e6 nid 10801@kfi7 refs 2
00000400:00000200:15.0:1773851869.573044:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003e88b8e6 nid 10801@kfi7 refs 3
00000400:00000200:15.0:1773851869.573047:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10801@kfi7 local destination
00000400:00000200:15.0:1773851869.573050:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769321:8769321:1024:4294967295] 10801@kfi7 LPNI seq info [472912:472912:16:4294967295]
00000400:00000200:15.0:1773851869.573052:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003e88b8e6 nid 10801@kfi7 refs 2
00000400:00000200:15.0:1773851869.573054:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10801@kfi7 to cpt 3
00000400:00000200:15.0:1773851869.573058:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10801@kfi7(10801@kfi7:10801@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851869.573060:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003e88b8e6 nid 10801@kfi7 refs 3
00000800:00000200:15.0:1773851869.573063:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851869.573065:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851869.573070:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851869.573074:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ba0 Using peer 10801@kfi7(0x100000000000ba0)
00000800:00000200:15.0:1773851869.573083:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x100000000000ba0: rc=0
00000800:00000200:15.0:1773851869.573086:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ba0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851869.573089:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.573091:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee2fab70 refcount 2 to 10993@kfi7
00010000:00000001:15.0:1773851869.573092:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851869.573093:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.573094:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851869.573096:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ae84b5d1 x1858041181632832/t0(0) o400->ceac5dbb-1201-4f79-b021-76a2c88c72b9@10993@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1165-0'
00000800:00000200:13.0:1773851869.573101:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ba0 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851869.573103:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae84b5d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ceac5dbb-1201-4f79-b021-76a2c88c72b9+6:39679:x1858041181632832:12345-10993@kfi7:400:default-tuolumne1165-0 Request processed in 121us (158us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851869.573104:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.573106:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10801@kfi7: PUT: OK
00000100:00100000:15.0:1773851869.573107:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10993@kfi7, seq: 2289843
00000400:00000200:13.0:1773851869.573107:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034ed0079
00000100:00000040:15.0:1773851869.573108:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e20659df : new rpc_count 0
00000400:00000010:13.0:1773851869.573108:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034ed0079.
00000100:00000001:15.0:1773851869.573110:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851869.573111:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:13.0:1773851869.573111:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851869.573112:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000100:00000001:13.0:1773851869.573112:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851869.573113:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000400:00000200:13.0:1773851869.573113:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003e88b8e6 nid 10801@kfi7 refs 2
00000020:00000010:15.0:1773851869.573115:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047ae5d51.
00000020:00000040:15.0:1773851869.573116:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000e20659df : new refcount 5
00000800:00000200:13.0:1773851869.573116:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 10801@kfi7(000000006613f5d3):0x0 lsk 2977 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ba0 Transaction freed
00000100:00000001:15.0:1773851869.573117:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851869.654039:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851869.654040:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851869.654041:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851869.654043:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851869.654046:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.654047:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.121@tcp : PUT - for me
00000400:00000200:9.0:1773851869.654049:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851869.654049:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851869.654051:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.121@tcp to cpt 5
00000400:00000200:9.0:1773851869.654053:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096862580 nid 172.16.70.121@tcp refs 2
00000400:00000200:9.0:1773851869.654054:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096862580 nid 172.16.70.121@tcp refs 3
00000400:00000200:9.0:1773851869.654055:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.121@tcp to cpt 5
00000400:00000200:9.0:1773851869.654056:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.121@tcp of length 224 into portal 12 MB=0x69a0e9abb0b40
00000400:00000200:9.0:1773851869.654057:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.121@tcp of length 224/224 into md 0x6a32cacf5 [64] + 38848
00000800:00000200:9.0:1773851869.654059:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851869.654061:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851869.654062:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851869.654063:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851869.654063:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851869.654064:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003e1c82a6.
00000100:00000040:9.0:1773851869.654065:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003e1c82a6 x1858237376432960 msgsize 224
00000100:00100000:9.0:1773851869.654067:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.121@tcp (source: 12345-172.16.70.121@tcp)
00000100:00000001:9.0:1773851869.654069:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851869.654070:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851869.654071:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:22.0:1773851869.654072:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:22.0:1773851869.654073:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851869.654073:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851869.654074:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851869.654075:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851869.654076:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858237376432960
00000020:00000001:22.0:1773851869.654076:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851869.654077:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930a6
00000020:00000001:22.0:1773851869.654077:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851869.654080:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004554a9c3 refcount=6
00000020:00000001:22.0:1773851869.654081:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745150464 : -107128964401152 : ffff9e911821b800)
00000020:00000001:22.0:1773851869.654082:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745150464 : -107128964401152 : ffff9e911821b800)
00000100:00000001:22.0:1773851869.654083:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.654084:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851869.654085:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064865890.
00000020:00000010:22.0:1773851869.654086:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851869.654088:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000001:22.0:1773851869.654089:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851869.654089:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851869.654090:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851869.654091:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:22.0:1773851869.654092:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:22.0:1773851869.654093:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.654094:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851869.654095:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851869.654096:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851869.654096:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851869.654096:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851869.654097:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.121@tcp, seq: 1997987
00000100:00000001:23.0:1773851869.654098:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851869.654098:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.654098:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004554a9c3 : new rpc_count 1
00000100:00000001:22.0:1773851869.654099:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749189888 : -106947960361728 : ffff9ebb3cd02d00)
00000100:00000040:22.0:1773851869.654101:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003e1c82a6 x1858237376432960/t0(0) o400->fd3d6274-f39a-4d8d-bade-cc20781478d3@172.16.70.121@tcp:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic21-0'
00000100:00000001:22.0:1773851869.654104:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851869.654105:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851869.654106:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e1c82a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:fd3d6274-f39a-4d8d-bade-cc20781478d3+6:49986:x1858237376432960:12345-172.16.70.121@tcp:400:default-rzslic21-0
00000100:00000200:22.0:1773851869.654107:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858237376432960
00000020:00000001:22.0:1773851869.654108:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851869.654108:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851869.654109:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.654110:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851869.654110:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:22.0:1773851869.654111:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:22.0:1773851869.654111:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858237376432960, found 0 last_xid 1858237376432959
00000020:00000001:22.0:1773851869.654112:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851869.654113:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851869.654113:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851869.654114:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.654115:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:22.0:1773851869.654115:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851869.654116:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851869.654117:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002954c822.
02000000:00000001:22.0:1773851869.654117:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.654118:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.654119:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851869.654119:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858237376432960
00010000:00000001:22.0:1773851869.654120:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851869.654121:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003e1c82a6 x1858237376432960/t0(0) o400->fd3d6274-f39a-4d8d-bade-cc20781478d3@172.16.70.121@tcp:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic21-0'
00010000:00000001:22.0:1773851869.654123:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851869.654124:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851869.654124:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=102 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851869.654125:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851869.654126:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cc777689 refcount 3 to 172.16.70.121@tcp
00000100:00000001:22.0:1773851869.654127:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956318272 : -107146753233344 : ffff9e8cf3d5ae40)
02000000:00000001:22.0:1773851869.654127:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851869.654128:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851869.654129:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851869.654129:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.121@tcp
00000400:00000010:22.0:1773851869.654130:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088a57373.
00000100:00000200:22.0:1773851869.654131:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858237376432960, offset 224
00000400:00000200:22.0:1773851869.654132:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.121@tcp
00000400:00000200:22.0:1773851869.654133:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.121@tcp to cpt 5
00000400:00000200:22.0:1773851869.654134:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096862580 nid 172.16.70.121@tcp refs 2
00000400:00000200:22.0:1773851869.654136:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096862580 nid 172.16.70.121@tcp refs 3
00000400:00000200:22.0:1773851869.654137:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096862580 nid 172.16.70.121@tcp refs 4
00000400:00000200:22.0:1773851869.654138:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.121@tcp routed destination
00000400:00000200:22.0:1773851869.654140:0:60934:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:22.0:1773851869.654141:0:60934:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:22.0:1773851869.654143:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.121@tcp: rtr pref emtpy: 1
00000400:00000200:22.0:1773851869.654145:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:22.0:1773851869.654146:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.121@tcp: rtr pref emtpy: 1
00000400:00000200:22.0:1773851869.654147:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:22.0:1773851869.654148:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769322:8769322:1024:4294967295] 2094@kfi7 LPNI seq info [1258746996:1258746996:16:4294967295]
00000400:00000200:22.0:1773851869.654162:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:22.0:1773851869.654163:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:22.0:1773851869.654165:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.121@tcp(172.16.70.121@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851869.654166:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096862580 nid 172.16.70.121@tcp refs 3
00000800:00000200:22.0:1773851869.654168:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851869.654169:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:22.0:1773851869.654171:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851869.654173:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:22.0:1773851869.654176:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000bfc5a5ad: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:22.0:1773851869.654177:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851869.654179:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851869.654180:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cc777689 refcount 2 to 172.16.70.121@tcp
00010000:00000001:22.0:1773851869.654181:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851869.654182:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851869.654182:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851869.654183:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003e1c82a6 x1858237376432960/t0(0) o400->fd3d6274-f39a-4d8d-bade-cc20781478d3@172.16.70.121@tcp:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic21-0'
00000100:00100000:22.0:1773851869.654186:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e1c82a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:fd3d6274-f39a-4d8d-bade-cc20781478d3+6:49986:x1858237376432960:12345-172.16.70.121@tcp:400:default-rzslic21-0 Request processed in 81us (120us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851869.654187:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851869.654188:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:22.0:1773851869.654189:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.121@tcp, seq: 1997987
00000100:00000040:22.0:1773851869.654189:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004554a9c3 : new rpc_count 0
00000400:00000200:21.0:1773851869.654189:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:22.0:1773851869.654190:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851869.654190:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088a57373
00000400:00000010:21.0:1773851869.654190:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088a57373.
00000100:00000001:22.0:1773851869.654191:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:22.0:1773851869.654191:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000100:00000001:21.0:1773851869.654191:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851869.654191:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:22.0:1773851869.654192:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851869.654192:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:22.0:1773851869.654193:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064865890.
00000020:00000040:22.0:1773851869.654194:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000004554a9c3 : new refcount 5
00000800:00000200:21.0:1773851869.654194:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfc5a5ad: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Transaction freed
00000100:00000001:22.0:1773851869.654195:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851869.655867:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851869.655867:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851869.655868:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851869.655868:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851869.655869:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851869.655869:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851869.655870:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20656@kfi7(00000000e739599c):0x780 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851869.655871:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851869.655872:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 Using peer 20656@kfi7(0x780)
00000400:00000200:22.0:1773851869.655873:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20656@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.655874:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20656@kfi7 : PUT - for me
00000400:00000200:22.0:1773851869.655875:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20656@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.655876:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 1
00000400:00000200:22.0:1773851869.655877:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20656@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.655878:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 2
00000400:00000200:22.0:1773851869.655879:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 3
00000400:00000200:21.0:1773851869.655879:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20656@kfi7 to cpt 5
00000400:00000200:22.0:1773851869.655880:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20592@kfi7 to cpt 1
00000400:00000200:22.0:1773851869.655882:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20592@kfi7 of length 456 into portal 12 MB=0x69a88c45fc340
00000800:00000200:21.0:1773851869.655882:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0x780: rc=0
00000400:00000200:22.0:1773851869.655883:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20592@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 39072
00000800:00000200:21.0:1773851869.655883:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:22.0:1773851869.655885:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851869.655887:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851869.655888:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20656@kfi7: PUT: OK
00000100:00000001:22.0:1773851869.655889:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851869.655890:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851869.655891:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007d77307e.
00000100:00000040:22.0:1773851869.655892:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000007d77307e x1858762061103936 msgsize 456
00000100:00100000:22.0:1773851869.655893:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-20592@kfi7 (source: 12345-20656@kfi7)
00000100:00000001:22.0:1773851869.655895:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:21.0:1773851869.655895:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851869.655896:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 2
00000100:00000001:23.0:1773851869.655897:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851869.655897:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 Transaction freed
02000000:00000001:23.0:1773851869.655898:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851869.655898:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:22.0:1773851869.655898:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000007ee9d6e: 2069@kfi7:5 <- 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851869.655899:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851869.655899:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851869.655900:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858762061103936
00000020:00000001:23.0:1773851869.655901:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851869.655901:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92156
00000020:00000001:23.0:1773851869.655902:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851869.655904:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c114cfce refcount=4238
00000020:00000001:23.0:1773851869.655905:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629775360 : -107123079776256 : ffff9e9276e1f800)
00000020:00000001:23.0:1773851869.655906:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629775360 : -107123079776256 : ffff9e9276e1f800)
00000100:00000001:23.0:1773851869.655907:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851869.655908:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851869.655909:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b72ef93.
00000020:00000010:23.0:1773851869.655910:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851869.655911:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851869.655912:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851869.655912:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851869.655912:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851869.655914:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851869.655915:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851869.655916:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851869.655917:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0F:1773851869.655917:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851869.655918:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20592@kfi7, seq: 335333146
00000100:00000001:20.0:1773851869.655918:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851869.655919:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c114cfce : new rpc_count 17
00000100:00000001:23.0:1773851869.655919:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619620864 : -107003089930752 : ffff9eae66d5b600)
00000100:00000001:20.0:1773851869.655919:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851869.655920:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851869.655921:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007d77307e x1858762061103936/t0(0) o17->935d699f-c617-4e48-96a7-4e796eb51501@20592@kfi7:121/0 lens 456/0 e 0 to 0 dl 1773852236 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1774-0'
00000100:00000001:23.0:1773851869.655924:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851869.655924:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851869.655925:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d77307e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:935d699f-c617-4e48-96a7-4e796eb51501+4238:39615:x1858762061103936:12345-20592@kfi7:17:default-tuolumne1774-0
00000100:00000200:23.0:1773851869.655927:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858762061103936
00000020:00000001:23.0:1773851869.655927:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851869.655928:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851869.655928:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851869.655929:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851869.655930:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:23.0:1773851869.655930:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851869.655931:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858762061103936, found 0 last_xid 1858762060390015
00000020:00000001:23.0:1773851869.655932:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851869.655932:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851869.655933:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851869.655933:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851869.655934:0:60934:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:23.0:1773851869.655936:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851869.655936:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851869.655937:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000089d40fdc.
02000000:00000001:23.0:1773851869.655938:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851869.655939:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851869.655940:0:60934:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:23.0:1773851869.655941:0:60934:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:23.0:1773851869.655942:0:60934:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:23.0:1773851869.655946:0:60934:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851869.655947:0:60934:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:23.0:1773851869.655948:0:60934:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 935d699f-c617-4e48-96a7-4e796eb51501/00000000c114cfce free: 126633370845184 avail: 126633368748032
00000020:00000001:23.0:1773851869.655950:0:60934:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:23.0:1773851869.655950:0:60934:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 935d699f-c617-4e48-96a7-4e796eb51501/00000000c114cfce avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:23.0:1773851869.655951:0:60934:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:23.0:1773851869.655953:0:60934:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:23.0:1773851869.655954:0:60934:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 935d699f-c617-4e48-96a7-4e796eb51501/00000000c114cfce reports grant 1807220735 dropped 0, local 1882456063
00000020:00000001:23.0:1773851869.655955:0:60934:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:23.0:1773851869.655956:0:60934:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:23.0:1773851869.655956:0:60934:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851869.655957:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593035, transno 0, xid 1858762061103936
00010000:00000001:23.0:1773851869.655958:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851869.655959:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007d77307e x1858762061103936/t0(0) o17->935d699f-c617-4e48-96a7-4e796eb51501@20592@kfi7:121/0 lens 456/432 e 0 to 0 dl 1773852236 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1774-0'
00010000:00000001:23.0:1773851869.655961:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851869.655962:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851869.655962:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=102 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851869.655964:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851869.655964:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000469bd9a2 refcount 3 to 20592@kfi7
00000100:00000001:23.0:1773851869.655965:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410368 : -107145304141248 : ffff9e8d4a351240)
02000000:00000001:23.0:1773851869.655965:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851869.655966:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851869.655967:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851869.655967:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20656@kfi7
00000400:00000010:23.0:1773851869.655968:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d909465f.
00000100:00000200:23.0:1773851869.655969:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858762061103936, offset 224
00000400:00000200:23.0:1773851869.655970:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20656@kfi7
00000400:00000200:23.0:1773851869.655971:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20656@kfi7 to cpt 5
00000400:00000200:23.0:1773851869.655972:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 1
00000400:00000200:23.0:1773851869.655973:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 2
00000400:00000200:23.0:1773851869.655974:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 3
00000400:00000200:23.0:1773851869.655975:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20656@kfi7 local destination
00000400:00000200:23.0:1773851869.655977:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769323:8769323:1024:4294967295] 20656@kfi7 LPNI seq info [7348994:7348994:16:4294967295]
00000400:00000200:23.0:1773851869.655978:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 2
00000400:00000200:23.0:1773851869.655979:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20656@kfi7 to cpt 5
00000400:00000200:23.0:1773851869.655981:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20656@kfi7(20656@kfi7:20656@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851869.655982:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 3
00000800:00000200:23.0:1773851869.655984:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851869.655986:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:23.0:1773851869.655988:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851869.655990:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 Using peer 20656@kfi7(0x780)
00000800:00000200:23.0:1773851869.655994:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 532 bytes to peer 0x780: rc=0
00000800:00000200:23.0:1773851869.655995:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851869.655997:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851869.655998:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000469bd9a2 refcount 2 to 20592@kfi7
00010000:00000001:23.0:1773851869.655998:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851869.655999:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851869.655999:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851869.656000:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007d77307e x1858762061103936/t0(0) o17->935d699f-c617-4e48-96a7-4e796eb51501@20592@kfi7:121/0 lens 456/432 e 0 to 0 dl 1773852236 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1774-0'
00000100:00100000:23.0:1773851869.656003:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d77307e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:935d699f-c617-4e48-96a7-4e796eb51501+4238:39615:x1858762061103936:12345-20592@kfi7:17:default-tuolumne1774-0 Request processed in 78us (110us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851869.656005:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20592@kfi7, seq: 335333146
00000100:00000040:23.0:1773851869.656006:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c114cfce : new rpc_count 16
00000800:00000200:21.0:1773851869.656006:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851869.656007:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851869.656007:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851869.656008:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851869.656008:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851869.656008:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851869.656009:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b72ef93.
00000400:00000200:21.0:1773851869.656009:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20656@kfi7: PUT: OK
00000400:00000200:21.0:1773851869.656009:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d909465f
00000400:00000010:21.0:1773851869.656009:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d909465f.
00000020:00000040:23.0:1773851869.656010:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000c114cfce : new refcount 4237
00000100:00000001:21.0:1773851869.656010:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851869.656010:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851869.656011:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851869.656011:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000028c5c3a3 nid 20656@kfi7 refs 2
00000800:00000200:21.0:1773851869.656012:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 20656@kfi7(00000000e739599c):0x0 lsk 1921 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x780 Transaction freed
00000800:00000200:7.0:1773851869.800550:0:2507579:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851869.800551:0:2507579:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851869.800551:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851869.800552:0:2507579:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851869.800553:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:7.0:1773851869.800554:0:2507579:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 24354@kfi7(000000007c12108d):0xd47 version: 2; local version 2; negotiated version: 2
00000800:00000200:7.0:1773851869.800556:0:2507579:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 Using peer 24354@kfi7(0x100000000000d47)
00000800:00000200:5.0:1773851869.800556:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851869.800558:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24354@kfi7 to cpt 1
00000800:00000200:7.0:1773851869.800560:0:2507579:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 38 bytes to peer 0x100000000000d47: rc=0
00000800:00000200:5.0:1773851869.800560:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:7.0:1773851869.800562:0:2507579:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851869.800564:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24354@kfi7 to cpt 1
00000400:00000200:5.0:1773851869.800566:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24354@kfi7 : PUT - for me
00000400:00000200:5.0:1773851869.800568:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24354@kfi7 to cpt 1
00000400:00000200:5.0:1773851869.800571:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d896f418 nid 24354@kfi7 refs 1
00000400:00000200:5.0:1773851869.800573:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24354@kfi7 to cpt 1
00000400:00000200:5.0:1773851869.800574:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d896f418 nid 24354@kfi7 refs 2
00000800:00000200:6.0:1773851869.800575:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851869.800576:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d896f418 nid 24354@kfi7 refs 3
00000400:00000200:5.0:1773851869.800577:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24546@kfi7 to cpt 4
00000800:00000200:6.0:1773851869.800578:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 Transaction freed
00000400:00000200:5.0:1773851869.800579:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24546@kfi7 of length 456 into portal 12 MB=0x69b4651a76d40
00000400:00000200:5.0:1773851869.800582:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24546@kfi7 of length 456/456 into md 0x793926dc5 [64] + 137240
00000800:00000200:5.0:1773851869.800586:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851869.800589:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851869.800591:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24354@kfi7: PUT: OK
00000100:00000001:5.0:1773851869.800593:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851869.800594:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851869.800595:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e5825baf.
00000100:00000040:5.0:1773851869.800597:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e5825baf x1859576180206912 msgsize 456
00000100:00100000:5.0:1773851869.800599:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-24546@kfi7 (source: 12345-24354@kfi7)
00000100:00000001:5.0:1773851869.800601:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851869.800603:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851869.800603:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851869.800604:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851869.800604:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851869.800604:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d896f418 nid 24354@kfi7 refs 2
02000000:00000001:7.0:1773851869.800605:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851869.800606:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576180206912
00000020:00000001:7.0:1773851869.800606:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851869.800607:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc3bde878
00000800:00000200:5.0:1773851869.800607:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000020:00000001:7.0:1773851869.800608:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851869.800611:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000082f3bc4e refcount=27
00000020:00000001:7.0:1773851869.800612:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134918145024 : -106938791406592 : ffff9ebd5f535400)
00000020:00000001:7.0:1773851869.800612:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134918145024 : -106938791406592 : ffff9ebd5f535400)
00000100:00000001:7.0:1773851869.800613:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851869.800614:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851869.800615:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002faae425.
00000020:00000010:7.0:1773851869.800616:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851869.800617:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851869.800617:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851869.800618:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851869.800618:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.800619:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.800620:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851869.800622:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851869.800622:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851869.800623:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24546@kfi7, seq: 371100843
00000100:00000040:7.0:1773851869.800624:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000082f3bc4e : new rpc_count 3
00000100:00000001:7.0:1773851869.800625:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886769280 : -106955822782336 : ffff9eb9682d2880)
00000100:00000040:7.0:1773851869.800626:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e5825baf x1859576180206912/t0(0) o17->74336d25-d7db-4c25-99aa-e7e34da89239@24546@kfi7:657/0 lens 456/0 e 0 to 0 dl 1773852017 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2011-0'
00000100:00000001:7.0:1773851869.800628:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851869.800629:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851869.800630:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5825baf pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:74336d25-d7db-4c25-99aa-e7e34da89239+27:39689:x1859576180206912:12345-24546@kfi7:17:default-tuolumne2011-0
00000100:00000200:7.0:1773851869.800632:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576180206912
00000020:00000001:7.0:1773851869.800632:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851869.800633:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851869.800634:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.800634:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851869.800635:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:7.0:1773851869.800636:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851869.800636:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576180206912, found 0 last_xid 1859576179641919
00000020:00000001:7.0:1773851869.800637:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851869.800638:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851869.800638:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851869.800639:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851869.800640:0:60963:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:7.0:1773851869.800641:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851869.800641:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851869.800642:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000002b002509.
02000000:00000001:7.0:1773851869.800642:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.800643:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.800644:0:60963:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:7.0:1773851869.800644:0:60963:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:7.0:1773851869.800645:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851869.800646:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.800647:0:60963:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:7.0:1773851869.800648:0:60963:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 74336d25-d7db-4c25-99aa-e7e34da89239/0000000082f3bc4e free: 126633370845184 avail: 126633368748032
00000020:00000001:7.0:1773851869.800649:0:60963:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:7.0:1773851869.800650:0:60963:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 74336d25-d7db-4c25-99aa-e7e34da89239/0000000082f3bc4e avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:7.0:1773851869.800651:0:60963:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:7.0:1773851869.800652:0:60963:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:7.0:1773851869.800652:0:60963:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 74336d25-d7db-4c25-99aa-e7e34da89239/0000000082f3bc4e reports grant 1812463615 dropped 0, local 1880621055
00000020:00000001:7.0:1773851869.800654:0:60963:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:7.0:1773851869.800654:0:60963:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:7.0:1773851869.800655:0:60963:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851869.800655:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264505379, transno 0, xid 1859576180206912
00010000:00000001:7.0:1773851869.800656:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851869.800657:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e5825baf x1859576180206912/t0(0) o17->74336d25-d7db-4c25-99aa-e7e34da89239@24546@kfi7:657/0 lens 456/432 e 0 to 0 dl 1773852017 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2011-0'
00010000:00000001:7.0:1773851869.800659:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851869.800660:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851869.800661:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=101 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851869.800662:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851869.800662:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004a71f32a refcount 3 to 24546@kfi7
00000100:00000001:7.0:1773851869.800663:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993952 : -107142345557664 : ffff9e8dfa8d7960)
02000000:00000001:7.0:1773851869.800664:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851869.800664:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851869.800665:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851869.800666:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24354@kfi7
00000400:00000010:7.0:1773851869.800667:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
00000100:00000200:7.0:1773851869.800667:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859576180206912, offset 224
00000400:00000200:7.0:1773851869.800669:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24354@kfi7
00000400:00000200:7.0:1773851869.800670:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24354@kfi7 to cpt 1
00000400:00000200:7.0:1773851869.800671:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d896f418 nid 24354@kfi7 refs 1
00000400:00000200:7.0:1773851869.800672:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d896f418 nid 24354@kfi7 refs 2
00000400:00000200:7.0:1773851869.800673:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d896f418 nid 24354@kfi7 refs 3
00000400:00000200:7.0:1773851869.800674:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24354@kfi7 local destination
00000400:00000200:7.0:1773851869.800675:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769324:8769324:1024:4294967295] 24354@kfi7 LPNI seq info [15928705:15928705:16:4294967295]
00000400:00000200:7.0:1773851869.800677:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d896f418 nid 24354@kfi7 refs 2
00000400:00000200:7.0:1773851869.800677:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24354@kfi7 to cpt 1
00000400:00000200:7.0:1773851869.800679:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24354@kfi7(24354@kfi7:24354@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851869.800680:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d896f418 nid 24354@kfi7 refs 3
00000800:00000200:7.0:1773851869.800681:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851869.800682:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:7.0:1773851869.800686:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851869.800689:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 Using peer 24354@kfi7(0x100000000000d47)
00000800:00000200:7.0:1773851869.800691:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 532 bytes to peer 0x100000000000d47: rc=0
00000800:00000200:7.0:1773851869.800693:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851869.800695:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851869.800696:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004a71f32a refcount 2 to 24546@kfi7
00010000:00000001:7.0:1773851869.800696:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851869.800697:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851869.800697:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851869.800698:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e5825baf x1859576180206912/t0(0) o17->74336d25-d7db-4c25-99aa-e7e34da89239@24546@kfi7:657/0 lens 456/432 e 0 to 0 dl 1773852017 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2011-0'
00000100:00100000:7.0:1773851869.800701:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5825baf pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:74336d25-d7db-4c25-99aa-e7e34da89239+27:39689:x1859576180206912:12345-24546@kfi7:17:default-tuolumne2011-0 Request processed in 72us (103us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851869.800704:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24546@kfi7, seq: 371100843
00000100:00000040:7.0:1773851869.800705:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000082f3bc4e : new rpc_count 2
00000800:00000200:6.0:1773851869.800705:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851869.800706:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851869.800706:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851869.800706:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851869.800707:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:6.0:1773851869.800707:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24354@kfi7: PUT: OK
00000020:00000010:7.0:1773851869.800708:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000020:00000010:7.0:1773851869.800708:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002faae425.
00000400:00000200:6.0:1773851869.800708:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
00000400:00000010:6.0:1773851869.800708:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000020:00000040:7.0:1773851869.800709:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000082f3bc4e : new refcount 26
00000100:00000001:6.0:1773851869.800709:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851869.800709:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851869.800710:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851869.800710:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d896f418 nid 24354@kfi7 refs 2
00000800:00000200:6.0:1773851869.800711:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 24354@kfi7(000000007c12108d):0x0 lsk 3400 rsk 12 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000d47 Transaction freed
00000800:00000200:13.0:1773851869.855766:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851869.855767:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851869.855769:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851869.855771:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851869.855773:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22899@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.855775:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22899@kfi7 : PUT - for me
00000400:00000200:13.0:1773851869.855776:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22899@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.855777:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 1
00000400:00000200:13.0:1773851869.855778:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22899@kfi7 to cpt 3
00000400:00000200:13.0:1773851869.855779:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 2
00000400:00000200:13.0:1773851869.855780:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 3
00000400:00000200:13.0:1773851869.855781:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22898@kfi7 to cpt 0
00000400:00000200:13.0:1773851869.855782:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22898@kfi7 of length 224 into portal 12 MB=0x699e0bf823fc0
00000400:00000200:13.0:1773851869.855783:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22898@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 32128
00000800:00000200:13.0:1773851869.855785:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851869.855787:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.855789:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22899@kfi7: PUT: OK
00000100:00000001:13.0:1773851869.855790:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851869.855790:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851869.855791:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006f37bda4.
00000100:00000040:13.0:1773851869.855792:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000006f37bda4 x1858040424972224 msgsize 224
00000100:00100000:13.0:1773851869.855794:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22898@kfi7 (source: 12345-22899@kfi7)
00000100:00000001:13.0:1773851869.855795:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851869.855796:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 2
00000100:00000001:15.0:1773851869.855797:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851869.855797:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851869.855797:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851869.855798:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851869.855799:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851869.855799:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00100000:15.0:1773851869.855800:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040424972224
00000020:00000001:15.0:1773851869.855800:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851869.855801:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f03
00000020:00000001:15.0:1773851869.855801:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851869.855807:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000feeee97d refcount=6
00000020:00000001:15.0:1773851869.855808:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629014528 : -107123080537088 : ffff9e9276d65c00)
00000020:00000001:15.0:1773851869.855809:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629014528 : -107123080537088 : ffff9e9276d65c00)
00000100:00000001:15.0:1773851869.855810:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851869.855811:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851869.855812:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db5a5dbd.
00000020:00000010:15.0:1773851869.855813:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851869.855814:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851869.855814:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851869.855815:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851869.855815:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851869.855816:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851869.855817:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851869.855817:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.855818:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851869.855819:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851869.855820:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851869.855821:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22898@kfi7, seq: 2289844
00000100:00000001:12.0:1773851869.855821:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:15.0:1773851869.855822:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000feeee97d : new rpc_count 1
00000100:00000001:12.0:1773851869.855822:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851869.855822:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.855823:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970995072 : -107043738556544 : ffff9ea4effce780)
00000100:00000001:12.0:1773851869.855823:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.855824:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006f37bda4 x1858040424972224/t0(0) o400->b724aecc-d97c-476e-8b91-c791e5920b68@22898@kfi7:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1914-0'
00000100:00000001:15.0:1773851869.855827:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851869.855827:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851869.855828:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f37bda4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b724aecc-d97c-476e-8b91-c791e5920b68+6:39735:x1858040424972224:12345-22898@kfi7:400:default-tuolumne1914-0
00000100:00000200:15.0:1773851869.855830:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040424972224
00000020:00000001:15.0:1773851869.855830:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851869.855831:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851869.855831:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.855832:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851869.855833:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851869.855834:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851869.855834:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040424972224, found 0 last_xid 1858040424972223
00000020:00000001:15.0:1773851869.855835:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851869.855836:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851869.855837:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851869.855837:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.855838:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851869.855838:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851869.855839:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851869.855840:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000184fbb99.
02000000:00000001:15.0:1773851869.855840:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.855841:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.855842:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851869.855843:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260818878, transno 0, xid 1858040424972224
00010000:00000001:15.0:1773851869.855843:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851869.855844:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006f37bda4 x1858040424972224/t0(0) o400->b724aecc-d97c-476e-8b91-c791e5920b68@22898@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1914-0'
00010000:00000001:15.0:1773851869.855846:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851869.855847:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851869.855848:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=102 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851869.855849:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851869.855849:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000037c0195d refcount 3 to 22898@kfi7
00000100:00000001:15.0:1773851869.855850:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572608 : -107154178979008 : ffff9e8b3939cb40)
02000000:00000001:15.0:1773851869.855851:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851869.855851:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.855852:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851869.855853:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22899@kfi7
00000400:00000010:15.0:1773851869.855854:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c01d933.
00000100:00000200:15.0:1773851869.855854:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040424972224, offset 224
00000400:00000200:15.0:1773851869.855855:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22899@kfi7
00000400:00000200:15.0:1773851869.855856:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22899@kfi7 to cpt 3
00000400:00000200:15.0:1773851869.855857:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 1
00000400:00000200:15.0:1773851869.855858:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 2
00000400:00000200:15.0:1773851869.855859:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 3
00000400:00000200:15.0:1773851869.855860:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22899@kfi7 local destination
00000400:00000200:15.0:1773851869.855862:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769325:8769325:1024:4294967295] 22899@kfi7 LPNI seq info [500563:500563:16:4294967295]
00000400:00000200:15.0:1773851869.855864:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 2
00000400:00000200:15.0:1773851869.855865:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22899@kfi7 to cpt 3
00000400:00000200:15.0:1773851869.855866:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22899@kfi7(22899@kfi7:22899@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851869.855868:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 3
00000800:00000200:15.0:1773851869.855869:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851869.855870:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851869.855872:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851869.855875:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000111e Using peer 22899@kfi7(0x10000000000111e)
00000800:00000200:15.0:1773851869.855878:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x10000000000111e: rc=0
00000800:00000200:15.0:1773851869.855880:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000111e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851869.855882:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.855882:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000037c0195d refcount 2 to 22898@kfi7
00010000:00000001:15.0:1773851869.855883:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851869.855883:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.855884:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851869.855885:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006f37bda4 x1858040424972224/t0(0) o400->b724aecc-d97c-476e-8b91-c791e5920b68@22898@kfi7:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1914-0'
00000100:00100000:15.0:1773851869.855887:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f37bda4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b724aecc-d97c-476e-8b91-c791e5920b68+6:39735:x1858040424972224:12345-22898@kfi7:400:default-tuolumne1914-0 Request processed in 60us (95us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851869.855890:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22898@kfi7, seq: 2289844
00000100:00000040:15.0:1773851869.855890:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000feeee97d : new rpc_count 0
00000100:00000001:15.0:1773851869.855892:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851869.855892:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851869.855892:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000111e TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851869.855893:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851869.855893:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000020:00000010:15.0:1773851869.855894:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db5a5dbd.
00000400:00000200:13.0:1773851869.855894:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851869.855895:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22899@kfi7: PUT: OK
00000400:00000200:13.0:1773851869.855895:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c01d933
00000020:00000040:15.0:1773851869.855896:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000feeee97d : new refcount 5
00000100:00000001:15.0:1773851869.855896:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851869.855896:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c01d933.
00000100:00000001:13.0:1773851869.855897:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851869.855897:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851869.855898:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000062b6a2a1 nid 22899@kfi7 refs 2
00000800:00000200:13.0:1773851869.855899:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 22899@kfi7(00000000cbe04fc8):0x0 lsk 4383 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000111e Transaction freed
00000800:00000200:11.0:1773851869.865367:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851869.865368:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851869.865369:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851869.865372:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:11.0:1773851869.865374:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:11.0:1773851869.865375:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.34@o2ib60 : PUT - for me
00000400:00000200:11.0:1773851869.865377:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:11.0:1773851869.865377:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:11.0:1773851869.865379:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.34@o2ib60 to cpt 3
00000400:00000200:11.0:1773851869.865381:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd36570f nid 192.168.128.34@o2ib60 refs 2
00000400:00000200:11.0:1773851869.865382:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cd36570f nid 192.168.128.34@o2ib60 refs 3
00000400:00000200:11.0:1773851869.865384:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.34@o2ib60 to cpt 3
00000400:00000200:11.0:1773851869.865385:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.34@o2ib60 of length 224 into portal 12 MB=0x69b2347590dc0
00000400:00000200:11.0:1773851869.865387:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.34@o2ib60 of length 224/224 into md 0x82a36e8ed [64] + 32352
00000800:00000200:11.0:1773851869.865390:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851869.865391:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851869.865393:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:11.0:1773851869.865394:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851869.865395:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:11.0:1773851869.865396:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000432d25da.
00000100:00000040:11.0:1773851869.865396:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000432d25da x1859425683443136 msgsize 224
00000100:00100000:11.0:1773851869.865398:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.34@o2ib60 (source: 12345-192.168.128.34@o2ib60)
00000100:00000001:11.0:1773851869.865400:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:11.0:1773851869.865402:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:15.0:1773851869.865403:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851869.865403:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:11.0:1773851869.865403:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ae8f21ee: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851869.865404:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851869.865404:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851869.865405:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851869.865406:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859425683443136
00000020:00000001:15.0:1773851869.865406:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851869.865406:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ac23
00000020:00000001:15.0:1773851869.865407:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851869.865411:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007621e852 refcount=5
00000020:00000001:15.0:1773851869.865411:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098029019136 : -106975680532480 : ffff9eb4c88ff000)
00000020:00000001:15.0:1773851869.865412:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098029019136 : -106975680532480 : ffff9eb4c88ff000)
00000100:00000001:15.0:1773851869.865413:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851869.865414:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851869.865414:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db5a5dbd.
00000020:00000010:15.0:1773851869.865415:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851869.865415:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851869.865416:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851869.865417:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851869.865417:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851869.865418:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851869.865418:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851869.865419:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.865420:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851869.865421:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851869.865421:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851869.865421:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851869.865422:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.34@o2ib60, seq: 2289845
00000100:00000001:12.0:1773851869.865422:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851869.865423:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007621e852 : new rpc_count 1
00000100:00000001:12.0:1773851869.865423:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.865424:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079889205760 : -106993820345856 : ffff9eb08f585a00)
00000100:00000001:12.0:1773851869.865424:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.865425:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000432d25da x1859425683443136/t0(0) o400->553ffbf5-dc93-47eb-a170-e671816052ee@192.168.128.34@o2ib60:596/0 lens 224/0 e 0 to 0 dl 1773851956 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix34-0'
00000100:00000001:15.0:1773851869.865428:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851869.865429:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851869.865430:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000432d25da pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:553ffbf5-dc93-47eb-a170-e671816052ee+5:40098:x1859425683443136:12345-192.168.128.34@o2ib60:400:default-matrix34-0
00000100:00000200:15.0:1773851869.865432:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859425683443136
00000020:00000001:15.0:1773851869.865432:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851869.865433:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851869.865434:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.865434:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851869.865435:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851869.865435:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851869.865436:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859425683443136, found 0 last_xid 1859425683443135
00000020:00000001:15.0:1773851869.865437:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851869.865437:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851869.865437:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851869.865438:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.865438:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851869.865439:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851869.865439:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851869.865440:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000271b72bf.
02000000:00000001:15.0:1773851869.865440:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.865441:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.865441:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851869.865442:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859425683443136
00010000:00000001:15.0:1773851869.865443:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851869.865443:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000432d25da x1859425683443136/t0(0) o400->553ffbf5-dc93-47eb-a170-e671816052ee@192.168.128.34@o2ib60:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix34-0'
00010000:00000001:15.0:1773851869.865446:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851869.865446:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851869.865447:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=102 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851869.865447:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851869.865448:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002d01066c refcount 3 to 192.168.128.34@o2ib60
00000100:00000001:15.0:1773851869.865449:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902775808 : -107154806775808 : ffff9e8b13ce6000)
02000000:00000001:15.0:1773851869.865450:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851869.865450:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851869.865451:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851869.865452:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.34@o2ib60
00000400:00000010:15.0:1773851869.865453:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000019bef8e5.
00000100:00000200:15.0:1773851869.865453:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859425683443136, offset 224
00000400:00000200:15.0:1773851869.865455:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.34@o2ib60
00000400:00000200:15.0:1773851869.865456:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.34@o2ib60 to cpt 3
00000400:00000200:15.0:1773851869.865458:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd36570f nid 192.168.128.34@o2ib60 refs 2
00000400:00000200:15.0:1773851869.865459:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cd36570f nid 192.168.128.34@o2ib60 refs 3
00000400:00000200:15.0:1773851869.865461:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cd36570f nid 192.168.128.34@o2ib60 refs 4
00000400:00000200:15.0:1773851869.865462:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.34@o2ib60 routed destination
00000400:00000200:15.0:1773851869.865463:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851869.865464:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:15.0:1773851869.865465:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.34@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851869.865466:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851869.865467:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.34@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851869.865468:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851869.865469:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769326:8769326:1024:4294967295] 17@kfi7 LPNI seq info [1250891897:1250891897:16:4294967295]
00000400:00000200:15.0:1773851869.865470:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:15.0:1773851869.865471:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:15.0:1773851869.865473:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.34@o2ib60(192.168.128.34@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851869.865475:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cd36570f nid 192.168.128.34@o2ib60 refs 3
00000800:00000200:15.0:1773851869.865477:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851869.865478:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851869.865480:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851869.865482:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:15.0:1773851869.865485:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:15.0:1773851869.865486:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851869.865488:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851869.865489:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002d01066c refcount 2 to 192.168.128.34@o2ib60
00010000:00000001:15.0:1773851869.865490:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851869.865490:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851869.865491:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851869.865492:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000432d25da x1859425683443136/t0(0) o400->553ffbf5-dc93-47eb-a170-e671816052ee@192.168.128.34@o2ib60:596/0 lens 224/224 e 0 to 0 dl 1773851956 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix34-0'
00000100:00100000:15.0:1773851869.865495:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000432d25da pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:553ffbf5-dc93-47eb-a170-e671816052ee+5:40098:x1859425683443136:12345-192.168.128.34@o2ib60:400:default-matrix34-0 Request processed in 66us (97us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851869.865497:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.34@o2ib60, seq: 2289845
00000100:00000040:15.0:1773851869.865498:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007621e852 : new rpc_count 0
00000800:00000200:13.0:1773851869.865498:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851869.865499:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851869.865499:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851869.865500:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851869.865500:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000400:00000200:13.0:1773851869.865500:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851869.865501:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db5a5dbd.
00000020:00000040:15.0:1773851869.865501:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000007621e852 : new refcount 4
00000400:00000200:13.0:1773851869.865501:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:13.0:1773851869.865501:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000019bef8e5
00000100:00000001:15.0:1773851869.865502:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851869.865502:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000019bef8e5.
00000100:00000001:13.0:1773851869.865502:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851869.865503:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851869.865503:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:13.0:1773851869.865505:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000800:00000200:17.0:1773851869.941337:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851869.941338:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851869.941340:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851869.941343:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851869.941346:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24834@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.941347:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24834@kfi7 : PUT - for me
00000400:00000200:17.0:1773851869.941348:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24834@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.941349:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d1c55bb nid 24834@kfi7 refs 1
00000400:00000200:17.0:1773851869.941350:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24834@kfi7 to cpt 4
00000400:00000200:17.0:1773851869.941350:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d1c55bb nid 24834@kfi7 refs 2
00000400:00000200:17.0:1773851869.941351:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002d1c55bb nid 24834@kfi7 refs 3
00000400:00000200:17.0:1773851869.941352:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25027@kfi7 to cpt 1
00000400:00000200:17.0:1773851869.941353:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25027@kfi7 of length 224 into portal 12 MB=0x699e1205e4a40
00000400:00000200:17.0:1773851869.941355:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25027@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 13920
00000800:00000200:17.0:1773851869.941357:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851869.941359:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851869.941360:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24834@kfi7: PUT: OK
00000100:00000001:17.0:1773851869.941361:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851869.941361:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851869.941362:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ef78c42c.
00000100:00000040:17.0:1773851869.941363:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ef78c42c x1858042050005568 msgsize 224
00000100:00100000:17.0:1773851869.941364:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25027@kfi7 (source: 12345-24834@kfi7)
00000100:00000001:17.0:1773851869.941365:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851869.941366:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002d1c55bb nid 24834@kfi7 refs 2
00000100:00000001:16.0:1773851869.941367:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851869.941367:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851869.941368:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851869.941368:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851869.941368:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851869.941369:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851869.941371:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042050005568
00000020:00000001:16.0:1773851869.941371:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851869.941372:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e06
00000020:00000001:16.0:1773851869.941372:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851869.941375:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006c015595 refcount=21
00000020:00000001:16.0:1773851869.941376:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744423424 : -107128965128192 : ffff9e911816a000)
00000020:00000001:16.0:1773851869.941376:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744423424 : -107128965128192 : ffff9e911816a000)
00000100:00000001:16.0:1773851869.941377:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851869.941378:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851869.941379:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007773209b.
00000020:00000010:16.0:1773851869.941380:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851869.941381:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b2bbb793.
00000100:00000001:16.0:1773851869.941381:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851869.941382:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851869.941382:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851869.941383:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851869.941384:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851869.941384:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851869.941385:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851869.941386:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851869.941387:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851869.941387:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851869.941387:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851869.941388:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25027@kfi7, seq: 2156337
00000100:00000040:16.0:1773851869.941388:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006c015595 : new rpc_count 1
00000100:00000001:17.0:1773851869.941389:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851869.941389:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851869.941389:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128161642496 : -106945547909120 : ffff9ebbcc9b4800)
00000100:00000040:16.0:1773851869.941391:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ef78c42c x1858042050005568/t0(0) o400->8430ea0a-9031-46d9-a2b3-76c3cf5661db@25027@kfi7:90/0 lens 224/0 e 0 to 0 dl 1773852205 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2055-0'
00000100:00000001:16.0:1773851869.941393:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851869.941394:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851869.941395:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef78c42c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:8430ea0a-9031-46d9-a2b3-76c3cf5661db+21:39745:x1858042050005568:12345-25027@kfi7:400:default-tuolumne2055-0
00000100:00000200:16.0:1773851869.941396:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042050005568
00000020:00000001:16.0:1773851869.941397:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851869.941398:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851869.941399:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851869.941400:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851869.941400:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851869.941401:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851869.941402:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042050005568, found 0 last_xid 1858042049643519
00000020:00000001:16.0:1773851869.941403:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851869.941403:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851869.941404:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851869.941404:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851869.941405:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851869.941405:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851869.941406:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851869.941407:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b5cd6759.
02000000:00000001:16.0:1773851869.941407:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851869.941408:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851869.941409:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851869.941409:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260438204, transno 0, xid 1858042050005568
00010000:00000001:16.0:1773851869.941410:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851869.941411:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ef78c42c x1858042050005568/t0(0) o400->8430ea0a-9031-46d9-a2b3-76c3cf5661db@25027@kfi7:90/0 lens 224/224 e 0 to 0 dl 1773852205 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2055-0'
00010000:00000001:16.0:1773851869.941413:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851869.941414:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851869.941415:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=102 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851869.941416:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851869.941416:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a70c98f5 refcount 3 to 25027@kfi7
00000100:00000001:16.0:1773851869.941417:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327302400 : -107155382249216 : ffff9e8af1815900)
02000000:00000001:16.0:1773851869.941418:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851869.941418:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851869.941419:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851869.941420:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24834@kfi7
00000400:00000010:16.0:1773851869.941420:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006524e557.
00000100:00000200:16.0:1773851869.941421:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042050005568, offset 224
00000400:00000200:16.0:1773851869.941423:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24834@kfi7
00000400:00000200:16.0:1773851869.941424:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24834@kfi7 to cpt 4
00000400:00000200:16.0:1773851869.941424:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d1c55bb nid 24834@kfi7 refs 1
00000400:00000200:16.0:1773851869.941426:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002d1c55bb nid 24834@kfi7 refs 2
00000400:00000200:16.0:1773851869.941426:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002d1c55bb nid 24834@kfi7 refs 3
00000400:00000200:16.0:1773851869.941428:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24834@kfi7 local destination
00000400:00000200:16.0:1773851869.941430:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769327:8769327:1024:4294967295] 24834@kfi7 LPNI seq info [303681:303681:16:4294967295]
00000400:00000200:16.0:1773851869.941431:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002d1c55bb nid 24834@kfi7 refs 2
00000400:00000200:16.0:1773851869.941432:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24834@kfi7 to cpt 4
00000400:00000200:16.0:1773851869.941434:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24834@kfi7(24834@kfi7:24834@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851869.941435:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002d1c55bb nid 24834@kfi7 refs 3
00000800:00000200:16.0:1773851869.941436:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851869.941437:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851869.941439:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851869.941441:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a22 Using peer 24834@kfi7(0x100000000000a22)
00000800:00000200:16.0:1773851869.941445:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x100000000000a22: rc=0
00000800:00000200:16.0:1773851869.941446:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a22 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851869.941448:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851869.941449:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a70c98f5 refcount 2 to 25027@kfi7
00010000:00000001:16.0:1773851869.941450:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851869.941450:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851869.941451:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851869.941451:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ef78c42c x1858042050005568/t0(0) o400->8430ea0a-9031-46d9-a2b3-76c3cf5661db@25027@kfi7:90/0 lens 224/224 e 0 to 0 dl 1773852205 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2055-0'
00000100:00100000:16.0:1773851869.941456:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef78c42c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:8430ea0a-9031-46d9-a2b3-76c3cf5661db+21:39745:x1858042050005568:12345-25027@kfi7:400:default-tuolumne2055-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851869.941458:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25027@kfi7, seq: 2156337
00000100:00000040:16.0:1773851869.941459:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006c015595 : new rpc_count 0
00000100:00000001:16.0:1773851869.941460:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851869.941461:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851869.941461:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851869.941462:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b2bbb793.
00000020:00000010:16.0:1773851869.941463:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007773209b.
00000020:00000040:16.0:1773851869.941464:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000006c015595 : new refcount 20
00000100:00000001:16.0:1773851869.941464:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851869.941471:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a22 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851869.941474:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851869.941475:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24834@kfi7: PUT: OK
00000400:00000200:17.0:1773851869.941476:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006524e557
00000400:00000010:17.0:1773851869.941477:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006524e557.
00000100:00000001:17.0:1773851869.941477:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851869.941478:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851869.941479:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002d1c55bb nid 24834@kfi7 refs 2
00000800:00000200:17.0:1773851869.941480:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24834@kfi7(000000005b85ded4):0x0 lsk 2595 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a22 Transaction freed
00000004:00000001:28.0:1773851870.025730:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851870.025731:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:28.0:1773851870.025732:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b1cb0f82.
00000004:00000001:6.0:1773851870.025732:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:0.0:1773851870.025732:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:29.0:1773851870.025733:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:28.0:1773851870.025733:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000004:00000020:6.0:1773851870.025733:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:29.0:1773851870.025734:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:28.0:1773851870.025734:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:8.0:1773851870.025734:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:6.0:1773851870.025734:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000072969909.
00000004:00000001:4.0:1773851870.025734:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:0.0:1773851870.025734:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851870.025735:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000475f095e.
02000000:00000001:28.0:1773851870.025735:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:8.0:1773851870.025735:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:6.0:1773851870.025735:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000100:00000010:0.0:1773851870.025735:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000dcafdcb.
02000000:00000001:28.0:1773851870.025736:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:8.0:1773851870.025736:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa9519f1.
00000004:00000020:4.0:1773851870.025736:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:0.0:1773851870.025736:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000020:00000040:29.0:1773851870.025737:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
02000000:00000010:28.0:1773851870.025737:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000009f509882.
00000100:00000001:6.0:1773851870.025737:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:4.0:1773851870.025737:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002d4416ae.
00000100:00000001:0.0:1773851870.025737:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851870.025738:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:28.0:1773851870.025738:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851870.025738:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:0.0:1773851870.025738:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851870.025739:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:28.0:1773851870.025739:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000020:00000040:8.0:1773851870.025739:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
02000000:00000001:0.0:1773851870.025739:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851870.025740:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851870.025740:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851870.025740:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:4.0:1773851870.025740:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
02000000:00000010:29.0:1773851870.025741:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000040:28.0:1773851870.025741:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b1cb0f82] to pc [ptlrpcd_07_01+1]  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851870.025741:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:0.0:1773851870.025741:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000008f036b12.
00000100:00000001:0.0:1773851870.025741:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025742:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851870.025742:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:6.0:1773851870.025742:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000433e2d1e.
00000100:00000001:4.0:1773851870.025742:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:0.0:1773851870.025742:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851870.025743:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:4.0:1773851870.025743:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:0.0:1773851870.025743:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025744:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851870.025744:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851870.025744:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851870.025744:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851870.025744:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000dcafdcb] to pc [ptlrpcd_00_02+2]  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851870.025745:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000475f095e] to pc [ptlrpcd_07_02+2]  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851870.025745:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:28.0:1773851870.025746:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000010:8.0:1773851870.025746:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:6.0:1773851870.025746:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851870.025747:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:28.0:1773851870.025747:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e4aa9665.
02000000:00000010:4.0:1773851870.025747:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000869d922.
00000100:00000001:31.0:1773851870.025748:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851870.025748:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851870.025748:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851870.025748:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637140558862336 : -106933150689280 : ffff9ebeaf89d800)
00000100:00000001:8.0:1773851870.025748:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851870.025748:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000072969909] to pc [ptlrpcd_01_00+0]  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:0.0:1773851870.025748:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851870.025749:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851870.025749:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851870.025750:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851870.025750:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851870.025750:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851870.025750:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:2.0:1773851870.025750:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851870.025750:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:29.0:1773851870.025751:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851870.025751:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000100:00000001:4.0:1773851870.025751:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00100000:2.0:1773851870.025751:0:41063:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:1.0:1773851870.025751:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025752:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000010:28.0:1773851870.025752:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000194dcec7.
00000100:00000001:8.0:1773851870.025752:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851870.025752:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851870.025752:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851870.025753:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851870.025753:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851870.025753:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00080000:28.0:1773851870.025753:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614144479028565ns, next at 614145479027593ns, rc = 0
00000100:00000001:2.0:1773851870.025753:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851870.025753:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851870.025754:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851870.025754:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851870.025754:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:8.0:1773851870.025754:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fa9519f1] to pc [ptlrpcd_02_02+2]  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851870.025754:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851870.025754:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:28.0:1773851870.025755:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851870.025755:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851870.025755:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002d4416ae] to pc [ptlrpcd_01_01+1]  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851870.025755:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:2.0:1773851870.025756:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851870.025757:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851870.025757:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025757:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851870.025757:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851870.025757:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:30.0:1773851870.025758:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851870.025758:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851870.025758:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:30.0:1773851870.025759:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851870.025759:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851870.025759:0:41065:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00080000:00000010:6.0:1773851870.025759:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c5c78456.
00000100:00000001:5.0:1773851870.025759:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851870.025759:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851870.025759:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851870.025759:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851870.025760:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b1cb0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051929408:2065@kfi7:13:default-yuba2-0
00000100:00100000:29.0:1773851870.025760:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000475f095e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051929536:2056@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851870.025760:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.025760:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:6.0:1773851870.025760:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637128793814016 : -106944915737600 : ffff9ebbf2497400)
02000000:00000001:2.0:1773851870.025760:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851870.025761:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.025761:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:2.0:1773851870.025761:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851870.025762:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:29.0:1773851870.025762:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:8.0:1773851870.025762:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851870.025762:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:6.0:1773851870.025762:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:4.0:1773851870.025762:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00100000:2.0:1773851870.025762:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000dcafdcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051929472:2057@kfi7:13:default-yuba2-0
02000000:00000001:30.0:1773851870.025763:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851870.025763:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851870.025763:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851870.025763:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851870.025763:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851870.025763:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851870.025763:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:2.0:1773851870.025763:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851870.025764:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851870.025764:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:9.0:1773851870.025764:0:41071:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00080000:00000010:8.0:1773851870.025764:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000fe2482c5.
00000100:00000040:7.0:1773851870.025764:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851870.025764:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.025764:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:4.0:1773851870.025764:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000655a9ee6.
02000000:00000001:2.0:1773851870.025764:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:2.0:1773851870.025764:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851870.025765:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003d10c116.
02000000:00000001:30.0:1773851870.025765:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851870.025765:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ed213251.
00000100:00000001:11.0:1773851870.025765:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.025765:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00001000:6.0:1773851870.025765:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00000100:00000001:5.0:1773851870.025765:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851870.025765:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637087594163200 : -106986115388416 : ffff9eb25a98ac00)
02000000:00000001:2.0:1773851870.025765:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851870.025766:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.025766:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:8.0:1773851870.025766:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637139900959744 : -106933808591872 : ffff9ebe88530c00)
00000100:00000001:7.0:1773851870.025766:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:6.0:1773851870.025766:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f4303b93.
02000000:00000010:2.0:1773851870.025766:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f82e5278.
00000400:00000200:30.0:1773851870.025767:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:9.0:1773851870.025767:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:8.0:1773851870.025767:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851870.025767:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851870.025767:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:2.0:1773851870.025767:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851870.025768:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000200:29.0:1773851870.025768:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:9.0:1773851870.025768:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851870.025768:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:7.0:1773851870.025768:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851870.025768:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851870.025768:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614144479043042ns, next at 614145479041279ns, rc = 0
00000400:00000200:2.0:1773851870.025768:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000010:30.0:1773851870.025769:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000400:00000010:29.0:1773851870.025769:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000060a59eec.
00000100:00000001:9.0:1773851870.025769:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851870.025769:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851870.025769:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002d4416ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051929728:2085@kfi7:13:default-yuba2-0
00080000:00000001:6.0:1773851870.025769:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:4.0:1773851870.025769:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:2.0:1773851870.025769:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000100:00000200:30.0:1773851870.025770:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929408, portal 4
00000400:00000010:29.0:1773851870.025770:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000004015b2d.
00000100:00000040:9.0:1773851870.025770:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:4.0:1773851870.025770:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000400:00000010:2.0:1773851870.025770:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8c1b5d.
00000100:00000001:30.0:1773851870.025771:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:29.0:1773851870.025771:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929536, portal 4
00000004:00001000:8.0:1773851870.025771:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000100:00000001:7.0:1773851870.025771:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851870.025771:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:6.0:1773851870.025771:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851870.025772:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324231296 : -106976385320320 : ffff9eb49e8dba80)
00000100:00000001:29.0:1773851870.025772:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:7.0:1773851870.025772:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.025772:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000001:6.0:1773851870.025772:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:4.0:1773851870.025772:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003c31bdb2.
00000100:00000200:2.0:1773851870.025772:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929472, portal 4
00000100:00000040:30.0:1773851870.025773:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851870.025773:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637085309667584 : -106988399884032 : ffff9eb1d26e0900)
00000004:00080000:4.0:1773851870.025773:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614144479048302ns, next at 614145479046729ns, rc = 0
00000100:00000001:2.0:1773851870.025773:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851870.025773:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203073664 : -107102506477952 : ffff9e9741259680)
00000100:00000001:9.0:1773851870.025774:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851870.025774:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851870.025774:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f4cd24bd.
02000000:00000010:7.0:1773851870.025774:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000008b0c42b.
00000100:00000040:29.0:1773851870.025775:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851870.025775:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:8.0:1773851870.025775:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614144479050566ns, next at 614145479047260ns, rc = 0
02000000:00000001:7.0:1773851870.025775:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851870.025775:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:2.0:1773851870.025775:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851870.025776:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:9.0:1773851870.025776:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851870.025776:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00080000:00000001:4.0:1773851870.025776:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851870.025777:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000100:00000001:29.0:1773851870.025777:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00100000:9.0:1773851870.025777:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa9519f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051929664:2055@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851870.025777:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000010:7.0:1773851870.025777:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000007398a75e.
00000400:00000010:7.0:1773851870.025777:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df522108.
00000004:00000001:4.0:1773851870.025777:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851870.025778:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000147989c0.
00000100:00000040:29.0:1773851870.025778:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000100:00000001:9.0:1773851870.025778:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:8.0:1773851870.025778:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851870.025778:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929728, portal 4
00000100:00000001:2.0:1773851870.025778:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:30.0:1773851870.025779:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929408, offset 0
00000400:00000010:29.0:1773851870.025779:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000038c1b0d0.
02000000:00000001:9.0:1773851870.025779:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:8.0:1773851870.025779:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.025779:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:29.0:1773851870.025780:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929536, offset 0
02000000:00000001:9.0:1773851870.025780:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851870.025780:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:7.0:1773851870.025780:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528721408 : -106978180830208 : ffff9eb433886c00)
00000400:00000200:30.0:1773851870.025781:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
02000000:00000010:9.0:1773851870.025781:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000082699907.
00000100:00000040:7.0:1773851870.025781:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851870.025782:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:29.0:1773851870.025782:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
02000000:00000001:9.0:1773851870.025782:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851870.025782:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000010:2.0:1773851870.025782:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005884840b.
00000400:00000200:9.0:1773851870.025783:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000200:2.0:1773851870.025783:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929472, offset 0
00000400:00000200:30.0:1773851870.025784:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000010:9.0:1773851870.025784:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000fd3d2370.
00000100:00000001:7.0:1773851870.025784:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851870.025784:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000010:9.0:1773851870.025785:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000451e99c3.
00000400:00000010:7.0:1773851870.025785:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000400:00000200:2.0:1773851870.025785:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:30.0:1773851870.025786:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000200:9.0:1773851870.025786:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929664, portal 4
00000100:00000200:7.0:1773851870.025786:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929728, offset 0
00000400:00000200:2.0:1773851870.025786:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:9.0:1773851870.025787:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851870.025787:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491256320 : -107117218295296 : ffff9e93d4411200)
00000400:00000200:7.0:1773851870.025787:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000400:00000200:2.0:1773851870.025787:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:30.0:1773851870.025788:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:7.0:1773851870.025788:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:2.0:1773851870.025788:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000040:9.0:1773851870.025789:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851870.025789:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:2.0:1773851870.025789:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:30.0:1773851870.025790:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000400:00000200:7.0:1773851870.025790:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:9.0:1773851870.025791:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851870.025791:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:2.0:1773851870.025791:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:7.0:1773851870.025792:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000400:00000200:30.0:1773851870.025793:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769323, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769327, p:4294967295, g:4294967295, h:1000]
00000100:00000040:9.0:1773851870.025793:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000010:9.0:1773851870.025793:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000339f7b19.
00000400:00000200:2.0:1773851870.025793:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769323, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769327, p:4294967295, g:4294967295, h:1000]
00000100:00000200:9.0:1773851870.025794:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929664, offset 0
00000400:00000200:7.0:1773851870.025794:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769323, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769327, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851870.025795:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851870.025796:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:7.0:1773851870.025796:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851870.025797:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851870.025797:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851870.025797:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851870.025797:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851870.025798:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:7.0:1773851870.025798:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:2.0:1773851870.025798:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:30.0:1773851870.025799:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851870.025799:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:7.0:1773851870.025800:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769329:8769329:1024:4294967295] 2085@kfi7 LPNI seq info [5403240:5403240:16:4294967295]
00000400:00000200:2.0:1773851870.025800:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769329:8769329:1024:4294967295] 2057@kfi7 LPNI seq info [5404107:5404107:16:4294967295]
00000400:00000200:30.0:1773851870.025801:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000400:00000200:9.0:1773851870.025801:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:7.0:1773851870.025802:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:2.0:1773851870.025802:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:30.0:1773851870.025803:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769330:8769330:1024:4294967295] 2065@kfi7 LPNI seq info [5402829:5402829:16:4294967295]
00000400:00000200:9.0:1773851870.025803:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:7.0:1773851870.025803:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:2.0:1773851870.025803:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851870.025805:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769330, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769327, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851870.025806:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:7.0:1773851870.025807:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851870.025807:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851870.025808:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:9.0:1773851870.025808:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:2.0:1773851870.025808:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:9.0:1773851870.025809:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851870.025809:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:29.0:1773851870.025810:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:9.0:1773851870.025810:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000800:00000200:2.0:1773851870.025810:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:29.0:1773851870.025811:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:9.0:1773851870.025811:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769331:8769331:1024:4294967295] 2055@kfi7 LPNI seq info [5404670:5404670:16:4294967295]
00000800:00000200:7.0:1773851870.025811:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:29.0:1773851870.025812:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:7.0:1773851870.025812:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851870.025812:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851870.025813:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851870.025813:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:29.0:1773851870.025814:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:9.0:1773851870.025814:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:7.0:1773851870.025814:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851870.025815:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000800:00000200:2.0:1773851870.025815:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851870.025816:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:29.0:1773851870.025817:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8769330, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769331, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851870.025817:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Using peer 2085@kfi7(0x113)
00000400:00000200:9.0:1773851870.025818:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000800:00000200:2.0:1773851870.025818:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000800:00000200:30.0:1773851870.025819:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:29.0:1773851870.025819:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851870.025819:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:29.0:1773851870.025820:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851870.025821:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x113: rc=0
00000800:00000200:2.0:1773851870.025821:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000014e57432: Posted send of 324 bytes to peer 0x295: rc=0
00000800:00000200:30.0:1773851870.025822:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851870.025822:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000800:00000200:9.0:1773851870.025822:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:29.0:1773851870.025823:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769332:8769332:1023:4294967295] 2056@kfi7 LPNI seq info [5402400:5402400:16:4294967295]
00000800:00000200:7.0:1773851870.025823:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851870.025823:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851870.025824:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851870.025825:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:7.0:1773851870.025825:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851870.025826:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:7.0:1773851870.025826:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851870.025826:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851870.025826:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851870.025827:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851870.025828:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:7.0:1773851870.025828:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:2.0:1773851870.025828:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851870.025829:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000040:7.0:1773851870.025829:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851870.025829:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851870.025829:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851870.025830:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000800:00000200:9.0:1773851870.025830:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000400:00000200:29.0:1773851870.025831:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000001:7.0:1773851870.025831:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851870.025832:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.025832:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000800:00000200:30.0:1773851870.025833:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Using peer 2065@kfi7(0x5e8)
00000800:00000200:29.0:1773851870.025833:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
02000000:00000001:7.0:1773851870.025833:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851870.025833:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851870.025834:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851870.025834:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000100:00100000:7.0:1773851870.025834:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000072969909 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051929600:46@kfi7:13:default-yuba2-0
00000400:00000200:5.0:1773851870.025835:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851870.025836:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851870.025836:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851870.025836:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:5.0:1773851870.025836:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
02000000:00000001:7.0:1773851870.025837:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851870.025837:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000400:00000010:5.0:1773851870.025837:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000100:00000001:9.0:1773851870.025838:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.025838:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851870.025838:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d72416c0.
00000100:00000001:5.0:1773851870.025838:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851870.025839:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851870.025839:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851870.025839:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.025839:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851870.025839:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:2.0:1773851870.025839:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851870.025840:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000c05b04ad: Posted send of 324 bytes to peer 0x5e8: rc=0
00000100:00000001:9.0:1773851870.025840:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851870.025840:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:29.0:1773851870.025841:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000100:00000001:9.0:1773851870.025841:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851870.025841:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:7.0:1773851870.025841:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034f580d9.
00000400:00000200:2.0:1773851870.025841:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:7.0:1773851870.025842:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929600, portal 4
00000100:00000001:5.0:1773851870.025842:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:2.0:1773851870.025842:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000800:00000200:30.0:1773851870.025843:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851870.025843:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851870.025843:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814088832 : -107101895462784 : ffff9e976590f080)
00000100:00000040:5.0:1773851870.025843:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851870.025843:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005884840b
00000100:00000040:7.0:1773851870.025844:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:2.0:1773851870.025844:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005884840b.
00000800:00000200:29.0:1773851870.025845:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000100:00000001:5.0:1773851870.025845:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851870.025845:0:2506505:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851870.025846:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851870.025846:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:2.0:1773851870.025846:0:2506505:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851870.025847:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851870.025847:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851870.025847:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:5.0:1773851870.025847:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:30.0:1773851870.025848:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:7.0:1773851870.025848:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000010:7.0:1773851870.025848:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000068cc9555.
00000100:00000001:2.0:1773851870.025848:0:2506505:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851870.025849:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025849:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025849:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851870.025849:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:7.0:1773851870.025849:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929600, offset 0
00000800:00000200:5.0:1773851870.025849:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Transaction freed
00000100:00000040:2.0:1773851870.025849:0:2506505:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851870.025850:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025850:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851870.025850:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000400:00000200:7.0:1773851870.025850:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000100:00000001:30.0:1773851870.025851:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025851:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851870.025851:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000339f7b19
00000400:00000200:7.0:1773851870.025851:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:30.0:1773851870.025852:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851870.025852:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000010:9.0:1773851870.025852:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000339f7b19.
00000400:00000200:7.0:1773851870.025852:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00000001:2.0:1773851870.025852:0:2506505:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851870.025852:0:2506505:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:29.0:1773851870.025853:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851870.025853:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:7.0:1773851870.025853:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:2.0:1773851870.025853:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:30.0:1773851870.025854:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851870.025854:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851870.025854:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:9.0:1773851870.025854:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851870.025854:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000001:30.0:1773851870.025855:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851870.025855:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025855:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851870.025855:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000800:00000200:2.0:1773851870.025855:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000100:00000001:30.0:1773851870.025856:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:31.0:1773851870.025857:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851870.025857:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851870.025857:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:7.0:1773851870.025857:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769330, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769332, p:4294967295, g:4294967295, h:1000]
00000100:00000001:30.0:1773851870.025858:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851870.025858:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851870.025858:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851870.025859:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851870.025859:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851870.025859:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851870.025859:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851870.025860:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851870.025860:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851870.025860:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000400:00000200:31.0:1773851870.025861:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000400:00000200:29.0:1773851870.025861:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000100:00000001:9.0:1773851870.025861:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851870.025862:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000038c1b0d0
00000400:00000010:29.0:1773851870.025862:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000038c1b0d0.
00000400:00000200:9.0:1773851870.025862:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:7.0:1773851870.025862:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769333:8769333:1023:4294967295] 46@kfi7 LPNI seq info [5403858:5403858:16:4294967295]
00000400:00000200:31.0:1773851870.025863:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000147989c0
00000400:00000010:31.0:1773851870.025863:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000147989c0.
00000100:00000001:29.0:1773851870.025863:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:7.0:1773851870.025863:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:31.0:1773851870.025864:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851870.025864:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851870.025864:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Transaction freed
00000400:00000200:7.0:1773851870.025864:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000200:31.0:1773851870.025865:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851870.025867:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851870.025867:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851870.025867:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000100:00000001:31.0:1773851870.025868:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:7.0:1773851870.025868:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000040:31.0:1773851870.025869:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851870.025870:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851870.025870:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:31.0:1773851870.025871:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025871:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:13.0:1773851870.025871:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:7.0:1773851870.025871:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:31.0:1773851870.025872:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851870.025872:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:13.0:1773851870.025872:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:31.0:1773851870.025873:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:13.0:1773851870.025873:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851870.025874:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Transaction freed
00000800:00000200:7.0:1773851870.025874:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851870.025875:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5e8 Transaction freed
00000800:00000200:13.0:1773851870.025876:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:7.0:1773851870.025876:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000400:00000200:13.0:1773851870.025877:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.025879:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000800:00000200:7.0:1773851870.025879:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x3df: rc=0
00000400:00000200:13.0:1773851870.025880:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:7.0:1773851870.025880:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:13.0:1773851870.025882:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000100:00000001:7.0:1773851870.025882:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851870.025883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:7.0:1773851870.025883:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851870.025883:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851870.025884:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:7.0:1773851870.025884:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851870.025885:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000100:00000001:7.0:1773851870.025885:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851870.025886:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:7.0:1773851870.025886:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:13.0:1773851870.025887:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3b80
00000100:00000001:7.0:1773851870.025887:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851870.025887:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:1.0:1773851870.025887:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:13.0:1773851870.025888:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:7.0:1773851870.025888:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851870.025888:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851870.025888:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851870.025889:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.025889:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:7.0:1773851870.025889:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851870.025889:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851870.025890:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851870.025890:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851870.025890:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f62cd [1] + 224
00000800:00000200:17.0:1773851870.025891:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851870.025892:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851870.025892:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:7.0:1773851870.025892:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000800:00000200:1.0:1773851870.025892:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851870.025893:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.025894:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851870.025894:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851870.025894:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851870.025894:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:1.0:1773851870.025894:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:21.0:1773851870.025895:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851870.025895:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000800:00000200:5.0:1773851870.025895:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851870.025896:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:7.0:1773851870.025896:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000400:00000200:1.0:1773851870.025896:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:21.0:1773851870.025897:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:13.0:1773851870.025897:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:7.0:1773851870.025897:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000068cc9555
00000400:00000010:7.0:1773851870.025897:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000068cc9555.
00000800:00000200:5.0:1773851870.025897:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851870.025897:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:17.0:1773851870.025898:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2065@kfi7 : PUT - for me
00000100:00000200:13.0:1773851870.025898:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.025898:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:1.0:1773851870.025898:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:21.0:1773851870.025899:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:17.0:1773851870.025899:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000200:7.0:1773851870.025899:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851870.025899:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:17.0:1773851870.025900:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:5.0:1773851870.025900:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2085@kfi7 : PUT - for me
00000400:00000200:1.0:1773851870.025900:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:21.0:1773851870.025901:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000040:13.0:1773851870.025901:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.025901:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:1.0:1773851870.025901:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:21.0:1773851870.025902:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:17.0:1773851870.025902:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000040:7.0:1773851870.025902:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851870.025902:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851870.025902:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:21.0:1773851870.025903:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:17.0:1773851870.025903:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:5.0:1773851870.025903:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:21.0:1773851870.025904:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:17.0:1773851870.025904:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:5.0:1773851870.025904:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851870.025904:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:21.0:1773851870.025905:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:17.0:1773851870.025905:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:13.0:1773851870.025905:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851870.025905:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851870.025905:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:1.0:1773851870.025905:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3bc0
00000400:00000200:17.0:1773851870.025906:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3b40
00000100:00000001:7.0:1773851870.025906:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851870.025906:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851870.025906:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:17.0:1773851870.025907:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851870.025907:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:7.0:1773851870.025907:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:21.0:1773851870.025908:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:5.0:1773851870.025908:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:2.0:1773851870.025908:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851870.025908:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851870.025908:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71d821 [1] + 224
00000400:00000200:21.0:1773851870.025909:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3c40
00000800:00000200:13.0:1773851870.025909:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000800:00000200:7.0:1773851870.025909:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000400:00000001:2.0:1773851870.025909:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:17.0:1773851870.025910:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f1311 [1] + 224
00000400:00000200:5.0:1773851870.025910:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3c80
00000400:00000200:21.0:1773851870.025911:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:5.0:1773851870.025911:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:1.0:1773851870.025911:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851870.025912:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:2.0:1773851870.025912:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:1.0:1773851870.025912:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851870.025913:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d0ed5 [1] + 224
00000400:00000200:5.0:1773851870.025913:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b30f85 [1] + 224
00000400:00000010:2.0:1773851870.025913:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000400:00000200:2.0:1773851870.025913:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8c1b5d
00000400:00000200:17.0:1773851870.025914:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:2.0:1773851870.025914:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8c1b5d.
00000100:00000001:2.0:1773851870.025914:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851870.025914:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000400:00000200:17.0:1773851870.025915:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2065@kfi7: PUT: OK
00000800:00000200:5.0:1773851870.025915:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:2.0:1773851870.025915:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851870.025915:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851870.025916:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:17.0:1773851870.025916:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:1.0:1773851870.025916:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851870.025917:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:5.0:1773851870.025917:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851870.025918:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:17.0:1773851870.025918:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851870.025918:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851870.025918:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000100:00000200:2.0:1773851870.025918:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851870.025919:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:5.0:1773851870.025919:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851870.025919:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851870.025919:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851870.025920:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:21.0:1773851870.025921:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:2.0:1773851870.025921:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851870.025921:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:21.0:1773851870.025922:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851870.025922:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851870.025922:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:5.0:1773851870.025922:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851870.025922:0:41063:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:2.0:1773851870.025923:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:9.0:1773851870.025924:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:2.0:1773851870.025924:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851870.025924:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851870.025924:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:17.0:1773851870.025925:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851870.025925:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
02000000:00000001:2.0:1773851870.025925:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851870.025925:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:29.0:1773851870.025926:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851870.025926:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:21.0:1773851870.025926:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851870.025926:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:2.0:1773851870.025926:0:41063:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=103 v=66 (66 66 66 66)
00000800:00000200:1.0:1773851870.025926:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:29.0:1773851870.025927:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:17.0:1773851870.025927:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:9.0:1773851870.025927:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.025927:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00000001:7.0:1773851870.025927:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851870.025927:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:30.0:1773851870.025928:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000001:29.0:1773851870.025928:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:9.0:1773851870.025928:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:7.0:1773851870.025928:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:2.0:1773851870.025928:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=103 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851870.025929:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:29.0:1773851870.025929:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000060a59eec.
00000800:00000200:17.0:1773851870.025929:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2065@kfi7(00000000e3c03376):0x0 lsk 1513 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:9.0:1773851870.025929:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000001:7.0:1773851870.025929:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851870.025929:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851870.025929:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000007398a75e.
00000800:00000200:5.0:1773851870.025929:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851870.025929:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851870.025929:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851870.025930:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000004015b2d
00000400:00000010:29.0:1773851870.025930:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000004015b2d.
00000400:00000200:9.0:1773851870.025930:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:7.0:1773851870.025930:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df522108
00010000:00000001:2.0:1773851870.025930:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:2.0:1773851870.025930:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:30.0:1773851870.025931:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:29.0:1773851870.025931:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:21.0:1773851870.025931:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:7.0:1773851870.025931:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df522108.
00000100:00000001:7.0:1773851870.025931:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:2.0:1773851870.025931:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:30.0:1773851870.025932:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:29.0:1773851870.025932:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851870.025932:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:9.0:1773851870.025932:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.025932:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3c00
00000100:00000200:7.0:1773851870.025932:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:2.0:1773851870.025932:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00000001:2.0:1773851870.025932:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:2.0:1773851870.025932:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851870.025933:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:8.0:1773851870.025933:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:2.0:1773851870.025933:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:30.0:1773851870.025934:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000800:00000200:21.0:1773851870.025934:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:9.0:1773851870.025934:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:8.0:1773851870.025934:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:30.0:1773851870.025935:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000200:29.0:1773851870.025935:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851870.025935:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781697a89 [1] + 224
00000400:00000001:8.0:1773851870.025935:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851870.025936:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:7.0:1773851870.025936:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851870.025936:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851870.025937:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851870.025937:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:8.0:1773851870.025937:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000fd3d2370.
00000400:00000200:8.0:1773851870.025937:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000451e99c3
00000100:00000001:2.0:1773851870.025937:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851870.025937:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:30.0:1773851870.025938:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851870.025938:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851870.025938:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:8.0:1773851870.025938:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000451e99c3.
00000100:00000001:7.0:1773851870.025938:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851870.025938:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851870.025938:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:29.0:1773851870.025939:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851870.025939:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:9.0:1773851870.025939:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851870.025939:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851870.025939:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.025939:0:41065:0:(client.c:1428:after_reply()) Process entered
00000004:00000040:2.0:1773851870.025939:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000004:00000040:2.0:1773851870.025939:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406563328 avail=351404217344 avail_mb=1372672724 hwm_mb=3131103 files=372127276 ffree=343170472 state=0: rc = 0
00000100:00000001:29.0:1773851870.025940:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851870.025940:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
02000000:00000001:7.0:1773851870.025940:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851870.025940:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851870.025941:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.025941:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851870.025941:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:2.0:1773851870.025941:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406563328 free, 351404217344 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127276 files, 343170472 free files
02000000:00000001:29.0:1773851870.025942:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851870.025942:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851870.025942:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851870.025943:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:29.0:1773851870.025943:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=103 v=66 (66 66 66 66)
00000100:00000200:9.0:1773851870.025943:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:7.0:1773851870.025943:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=103 v=66 (66 66 66 66)
00000004:00000001:2.0:1773851870.025943:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851870.025944:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:7.0:1773851870.025944:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=103 v=66 (1 1 1 1)
00000100:00000040:2.0:1773851870.025944:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:29.0:1773851870.025945:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=103 v=66 (1 1 1 1)
00000100:00000040:9.0:1773851870.025945:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851870.025945:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.025945:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851870.025946:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851870.025946:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851870.025946:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851870.025946:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851870.025946:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851870.025946:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:29.0:1773851870.025947:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851870.025947:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851870.025947:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851870.025947:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851870.025947:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000dcafdcb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051929472:2057@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851870.025948:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:29.0:1773851870.025948:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025948:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:8.0:1773851870.025948:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.025948:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851870.025948:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000001:2.0:1773851870.025948:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851870.025949:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:29.0:1773851870.025949:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:9.0:1773851870.025949:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:8.0:1773851870.025949:0:41071:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=103 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851870.025949:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851870.025949:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851870.025949:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851870.025950:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851870.025950:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851870.025950:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851870.025950:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851870.025950:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00001000:8.0:1773851870.025950:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=103 v=66 (1 1 1 1)
00000100:00000040:7.0:1773851870.025950:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:2.0:1773851870.025950:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000dcafdcb x1859433051929472/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851870.025951:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:29.0:1773851870.025951:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:9.0:1773851870.025951:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851870.025951:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851870.025951:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851870.025952:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851870.025952:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851870.025953:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851870.025953:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851870.025953:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:30.0:1773851870.025954:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025954:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:8.0:1773851870.025954:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:8.0:1773851870.025954:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851870.025954:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851870.025954:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:30.0:1773851870.025955:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=103 v=66 (66 66 66 66)
00000100:00000001:29.0:1773851870.025955:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851870.025955:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851870.025955:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:7.0:1773851870.025955:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:2.0:1773851870.025955:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000040:7.0:1773851870.025956:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851870.025956:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351465969664 avail=351462843392 avail_mb=1372901732 hwm_mb=3131103 files=372062821 ffree=343228486 state=0: rc = 0
02000000:00000001:2.0:1773851870.025956:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:2.0:1773851870.025956:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f82e5278.
00000100:00001000:30.0:1773851870.025957:0:41089:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=103 v=66 (1 1 1 1)
00000100:00000001:29.0:1773851870.025957:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851870.025958:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851870.025958:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000100:00000001:8.0:1773851870.025958:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851870.025958:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000020:7.0:1773851870.025958:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351465969664 free, 351462843392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062821 files, 343228486 free files
02000000:00000001:2.0:1773851870.025958:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:2.0:1773851870.025958:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:30.0:1773851870.025959:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000040:29.0:1773851870.025959:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545828352 avail=351536169984 avail_mb=1373188164 hwm_mb=3131103 files=372116458 ffree=343306473 state=0: rc = 0
00000100:00000001:8.0:1773851870.025959:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:2.0:1773851870.025959:0:41063:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000100:00000001:30.0:1773851870.025960:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851870.025960:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851870.025960:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000004:00000001:7.0:1773851870.025960:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851870.025960:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:2.0:1773851870.025960:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000008f036b12.
00010000:00000001:30.0:1773851870.025961:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:29.0:1773851870.025961:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545828352 free, 351536169984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116458 files, 343306473 free files
00000004:00000040:8.0:1773851870.025961:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382722560 avail=351380663296 avail_mb=1372580716 hwm_mb=3131101 files=371978693 ffree=343147190 state=0: rc = 0
00000100:00000040:7.0:1773851870.025961:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:2.0:1773851870.025961:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:30.0:1773851870.025962:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851870.025962:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851870.025962:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000dcafdcb.
00000100:00000001:30.0:1773851870.025963:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000001:29.0:1773851870.025963:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:8.0:1773851870.025963:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382722560 free, 351380663296 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978693 files, 343147190 free files
00000100:00000001:2.0:1773851870.025963:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851870.025963:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851870.025964:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000040:29.0:1773851870.025964:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:8.0:1773851870.025964:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851870.025964:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002d4416ae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051929728:2085@kfi7:13:default-yuba2-0
00000100:00000001:2.0:1773851870.025964:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851870.025965:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:8.0:1773851870.025965:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:7.0:1773851870.025965:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:2.0:1773851870.025965:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851870.025965:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851870.025966:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:7.0:1773851870.025966:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851870.025966:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000100:00000001:2.0:1773851870.025966:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851870.025966:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851870.025967:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000475f095e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051929536:2056@kfi7:13:default-yuba2-0
00000400:00000200:7.0:1773851870.025967:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034f580d9
00000100:00000040:30.0:1773851870.025968:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851870.025968:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:8.0:1773851870.025968:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa9519f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051929664:2055@kfi7:13:default-yuba2-0
00000400:00000010:7.0:1773851870.025968:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034f580d9.
00000100:00000001:7.0:1773851870.025968:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851870.025969:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851870.025969:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:7.0:1773851870.025969:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851870.025970:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000475f095e x1859433051929536/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851870.025970:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851870.025971:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fa9519f1 x1859433051929664/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851870.025972:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851870.025972:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:7.0:1773851870.025972:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851870.025973:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:30.0:1773851870.025974:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851870.025974:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:29.0:1773851870.025974:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ed213251.
00000100:00000001:8.0:1773851870.025974:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851870.025974:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:29.0:1773851870.025975:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851870.025975:0:41090:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:8.0:1773851870.025975:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000082699907.
00000100:00000001:7.0:1773851870.025975:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851870.025975:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851870.025976:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000040:29.0:1773851870.025976:0:41090:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
02000000:00000001:8.0:1773851870.025976:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851870.025976:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:7.0:1773851870.025976:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851870.025976:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851870.025976:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000040:30.0:1773851870.025977:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000020:00000001:29.0:1773851870.025977:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851870.025977:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000020:00000040:8.0:1773851870.025977:0:41071:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000020:00000001:8.0:1773851870.025977:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851870.025977:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:30.0:1773851870.025978:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464112128 avail=351458204672 avail_mb=1372883612 hwm_mb=3131101 files=372064851 ffree=343226672 state=0: rc = 0
02000000:00000001:29.0:1773851870.025978:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000010:8.0:1773851870.025978:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:7.0:1773851870.025978:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851870.025978:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=103 v=66 (66 66 66 66)
02000000:00000001:29.0:1773851870.025979:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851870.025979:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000475f095e.
02000000:00000001:8.0:1773851870.025979:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851870.025979:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00001000:7.0:1773851870.025979:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=103 v=66 (1 1 1 1)
00000100:00000010:8.0:1773851870.025980:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa9519f1.
00000100:00000001:7.0:1773851870.025980:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851870.025981:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851870.025981:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851870.025981:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851870.025981:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.025981:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:30.0:1773851870.025982:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464112128 free, 351458204672 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064851 files, 343226672 free files
00000100:00000001:29.0:1773851870.025982:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851870.025982:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:7.0:1773851870.025982:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851870.025982:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025983:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851870.025983:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851870.025983:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851870.025983:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851870.025983:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000004:00000001:30.0:1773851870.025984:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025984:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851870.025984:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.025984:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851870.025984:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851870.025985:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851870.025985:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851870.025985:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.025985:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851870.025986:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.025988:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851870.025988:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851870.025989:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851870.025989:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851870.025990:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000100:00100000:30.0:1773851870.025991:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b1cb0f82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051929408:2065@kfi7:13:default-yuba2-0
00000004:00000040:7.0:1773851870.025991:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489071104 avail=351486076928 avail_mb=1372992488 hwm_mb=3131103 files=372066827 ffree=343251046 state=0: rc = 0
00000004:00000020:7.0:1773851870.025992:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489071104 free, 351486076928 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066827 files, 343251046 free files
00000100:00000001:30.0:1773851870.025994:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851870.025994:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851870.025995:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851870.025995:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851870.025997:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b1cb0f82 x1859433051929408/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851870.025997:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000072969909 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051929600:46@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851870.025999:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.026000:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851870.026000:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002d4416ae x1859433051929728/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851870.026001:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851870.026002:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851870.026003:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003d10c116.
00000100:00000001:7.0:1773851870.026003:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851870.026003:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851870.026004:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000008b0c42b.
02000000:00000001:30.0:1773851870.026005:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851870.026005:0:41089:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:7.0:1773851870.026005:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000040:30.0:1773851870.026006:0:41089:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000020:00000001:7.0:1773851870.026006:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000001:30.0:1773851870.026007:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000040:7.0:1773851870.026007:0:41065:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000020:00000001:7.0:1773851870.026008:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851870.026008:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000869d922.
02000000:00000010:30.0:1773851870.026009:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000009f509882.
02000000:00000001:7.0:1773851870.026009:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851870.026010:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851870.026010:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851870.026010:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002d4416ae.
02000000:00000001:30.0:1773851870.026011:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:7.0:1773851870.026011:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000010:30.0:1773851870.026012:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b1cb0f82.
00000100:00000001:7.0:1773851870.026012:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.026012:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851870.026013:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:7.0:1773851870.026013:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000072969909 x1859433051929600/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851870.026014:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851870.026015:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.026015:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851870.026016:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:7.0:1773851870.026016:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851870.026016:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d72416c0.
00000100:00000001:30.0:1773851870.026017:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851870.026018:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:7.0:1773851870.026018:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851870.026018:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:30.0:1773851870.026019:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851870.026019:0:41065:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000020:00000001:7.0:1773851870.026019:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851870.026020:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000433e2d1e.
02000000:00000001:7.0:1773851870.026021:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851870.026021:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851870.026021:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000072969909.
00000100:00000001:7.0:1773851870.026022:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851870.026023:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.026024:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.026024:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851870.026025:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.026026:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851870.026026:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851870.089734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851870.089737:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:9.0:1773851870.181262:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851870.181264:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851870.181266:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851870.181270:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851870.181273:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14419@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.181275:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14419@kfi7 : PUT - for me
00000400:00000200:9.0:1773851870.181277:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14419@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.181279:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000faea712c nid 14419@kfi7 refs 1
00000400:00000200:9.0:1773851870.181281:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14419@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.181283:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000faea712c nid 14419@kfi7 refs 2
00000400:00000200:9.0:1773851870.181284:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000faea712c nid 14419@kfi7 refs 3
00000400:00000200:9.0:1773851870.181286:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14419@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.181288:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14419@kfi7 of length 224 into portal 12 MB=0x69b4baa664f40
00000400:00000200:9.0:1773851870.181290:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14419@kfi7 of length 224/224 into md 0x78146ce49 [64] + 138280
00000800:00000200:9.0:1773851870.181293:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851870.181296:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851870.181298:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14419@kfi7: PUT: OK
00000100:00000001:9.0:1773851870.181300:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851870.181301:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851870.181302:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e68b9677.
00000100:00000040:9.0:1773851870.181304:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e68b9677 x1859599143948096 msgsize 224
00000100:00100000:9.0:1773851870.181306:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14419@kfi7 (source: 12345-14419@kfi7)
00000100:00000001:9.0:1773851870.181309:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851870.181315:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000faea712c nid 14419@kfi7 refs 2
00000800:00000200:9.0:1773851870.181317:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851870.181322:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851870.181323:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851870.181324:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851870.181324:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851870.181326:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851870.181327:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599143948096
00000020:00000001:9.0:1773851870.181328:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851870.181329:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d807aa
00000020:00000001:9.0:1773851870.181330:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851870.181333:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000502bdee3 refcount=5
00000020:00000001:9.0:1773851870.181334:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110219301888 : -106963490249728 : ffff9eb79f28e400)
00000020:00000001:9.0:1773851870.181336:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110219301888 : -106963490249728 : ffff9eb79f28e400)
00000100:00000001:9.0:1773851870.181337:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851870.181339:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851870.181340:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f14b1732.
00000020:00000010:9.0:1773851870.181342:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c8fc5a75.
00000020:00000010:9.0:1773851870.181344:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008e3d6b9d.
00000100:00000001:9.0:1773851870.181346:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851870.181346:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851870.181347:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851870.181349:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851870.181350:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851870.181351:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.181353:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851870.181355:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851870.181356:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851870.181356:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851870.181356:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851870.181358:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14419@kfi7, seq: 2130784
00000100:00000040:9.0:1773851870.181359:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000502bdee3 : new rpc_count 1
00000100:00000001:11.0:1773851870.181360:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.181360:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749178368 : -106947960373248 : ffff9ebb3cd00000)
00000100:00000001:11.0:1773851870.181361:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851870.181362:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e68b9677 x1859599143948096/t0(0) o400->0c495626-9144-4062-abdc-d996202ebed2@14419@kfi7:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1398-0'
00000100:00000001:9.0:1773851870.181372:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851870.181373:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851870.181374:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e68b9677 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:0c495626-9144-4062-abdc-d996202ebed2+5:39513:x1859599143948096:12345-14419@kfi7:400:default-tuolumne1398-0
00000100:00000200:9.0:1773851870.181377:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599143948096
00000020:00000001:9.0:1773851870.181378:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851870.181379:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851870.181380:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.181382:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851870.181383:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851870.181384:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851870.181385:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599143948096, found 0 last_xid 1859599143948095
00000020:00000001:9.0:1773851870.181387:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851870.181388:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851870.181389:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851870.181390:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.181391:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851870.181392:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851870.181393:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851870.181394:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000bf33d51.
02000000:00000001:9.0:1773851870.181396:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.181397:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.181398:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851870.181399:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692676, transno 0, xid 1859599143948096
00010000:00000001:9.0:1773851870.181401:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851870.181402:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e68b9677 x1859599143948096/t0(0) o400->0c495626-9144-4062-abdc-d996202ebed2@14419@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1398-0'
00010000:00000001:9.0:1773851870.181407:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851870.181408:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851870.181409:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=103 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851870.181411:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851870.181412:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000be22ffce refcount 3 to 14419@kfi7
00000100:00000001:9.0:1773851870.181414:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526777216 : -107156182774400 : ffff9e8ac1ca4d80)
02000000:00000001:9.0:1773851870.181416:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851870.181417:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.181418:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851870.181419:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14419@kfi7
00000400:00000010:9.0:1773851870.181420:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000339f7b19.
00000100:00000200:9.0:1773851870.181421:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599143948096, offset 224
00000400:00000200:9.0:1773851870.181424:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14419@kfi7
00000400:00000200:9.0:1773851870.181426:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14419@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.181427:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000faea712c nid 14419@kfi7 refs 1
00000400:00000200:9.0:1773851870.181428:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000faea712c nid 14419@kfi7 refs 2
00000400:00000200:9.0:1773851870.181430:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000faea712c nid 14419@kfi7 refs 3
00000400:00000200:9.0:1773851870.181432:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14419@kfi7 local destination
00000400:00000200:9.0:1773851870.181435:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769334:8769334:1024:4294967295] 14419@kfi7 LPNI seq info [9991284:9991284:16:4294967295]
00000400:00000200:9.0:1773851870.181438:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000faea712c nid 14419@kfi7 refs 2
00000400:00000200:9.0:1773851870.181439:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14419@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.181442:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14419@kfi7(14419@kfi7:14419@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851870.181444:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000faea712c nid 14419@kfi7 refs 3
00000800:00000200:9.0:1773851870.181446:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851870.181448:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851870.181452:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851870.181456:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x551 Using peer 14419@kfi7(0x551)
00000800:00000200:9.0:1773851870.181460:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x551: rc=0
00000800:00000200:9.0:1773851870.181463:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x551 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851870.181466:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851870.181467:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000be22ffce refcount 2 to 14419@kfi7
00010000:00000001:9.0:1773851870.181469:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851870.181469:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.181471:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851870.181472:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e68b9677 x1859599143948096/t0(0) o400->0c495626-9144-4062-abdc-d996202ebed2@14419@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1398-0'
00000100:00100000:9.0:1773851870.181477:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e68b9677 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:0c495626-9144-4062-abdc-d996202ebed2+5:39513:x1859599143948096:12345-14419@kfi7:400:default-tuolumne1398-0 Request processed in 104us (172us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851870.181478:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x551 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851870.181481:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14419@kfi7, seq: 2130784
00000400:00000200:10.0:1773851870.181482:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:9.0:1773851870.181483:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000502bdee3 : new rpc_count 0
00000100:00000001:9.0:1773851870.181484:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851870.181485:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14419@kfi7: PUT: OK
00000100:00000001:9.0:1773851870.181485:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851870.181486:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000339f7b19
00000020:00000010:9.0:1773851870.181486:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c8fc5a75.
00000400:00000010:10.0:1773851870.181487:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000339f7b19.
00000020:00000010:9.0:1773851870.181487:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008e3d6b9d.
00000100:00000001:10.0:1773851870.181488:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:9.0:1773851870.181489:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f14b1732.
00000100:00000001:10.0:1773851870.181490:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:9.0:1773851870.181490:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000502bdee3 : new refcount 4
00000100:00000001:9.0:1773851870.181491:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851870.181492:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000faea712c nid 14419@kfi7 refs 2
00000800:00000200:10.0:1773851870.181494:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 14419@kfi7(000000001b455516):0x0 lsk 1362 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x551 Transaction freed
00000800:00000200:9.0:1773851870.193486:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851870.193487:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851870.193489:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851870.193492:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851870.193495:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.193497:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.162@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851870.193499:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.193500:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851870.193503:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.162@o2ib600 to cpt 3
00000400:00000200:9.0:1773851870.193506:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084138ca7 nid 172.19.3.162@o2ib600 refs 2
00000400:00000200:9.0:1773851870.193508:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084138ca7 nid 172.19.3.162@o2ib600 refs 3
00000400:00000200:9.0:1773851870.193510:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.162@o2ib600 to cpt 3
00000400:00000200:9.0:1773851870.193511:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.162@o2ib600 of length 224 into portal 12 MB=0x699f2a9aebe40
00000400:00000200:9.0:1773851870.193514:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.162@o2ib600 of length 224/224 into md 0x82a36e8ed [64] + 32576
00000800:00000200:9.0:1773851870.193519:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851870.193521:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851870.193523:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851870.193525:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851870.193525:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851870.193526:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c214491b.
00000100:00000040:9.0:1773851870.193528:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c214491b x1858117368200768 msgsize 224
00000100:00100000:9.0:1773851870.193531:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.162@o2ib600 (source: 12345-172.19.3.162@o2ib600)
00000100:00000001:9.0:1773851870.193533:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851870.193535:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851870.193537:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851870.193538:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851870.193539:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851870.193539:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851870.193540:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851870.193541:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851870.193543:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858117368200768
00000020:00000001:15.0:1773851870.193544:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851870.193544:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d9f
00000020:00000001:15.0:1773851870.193546:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851870.193550:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000015869b38 refcount=350
00000020:00000001:15.0:1773851870.193552:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239500800 : -107152470050816 : ffff9e8b9f15f800)
00000020:00000001:15.0:1773851870.193553:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239500800 : -107152470050816 : ffff9e8b9f15f800)
00000100:00000001:15.0:1773851870.193555:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851870.193557:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851870.193558:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db5a5dbd.
00000020:00000010:15.0:1773851870.193559:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851870.193561:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851870.193562:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851870.193563:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851870.193564:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851870.193565:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851870.193566:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851870.193567:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851870.193568:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851870.193570:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851870.193571:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851870.193571:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851870.193572:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851870.193573:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.162@o2ib600, seq: 2289846
00000100:00000040:15.0:1773851870.193575:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000015869b38 : new rpc_count 2
00000100:00000001:12.0:1773851870.193575:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851870.193576:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749208320 : -106947960343296 : ffff9ebb3cd07500)
00000100:00000001:12.0:1773851870.193576:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851870.193578:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c214491b x1858117368200768/t0(0) o400->ccb0ba36-3367-4c71-a1af-82ee819f65d2@172.19.3.162@o2ib600:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic12-0'
00000100:00000001:15.0:1773851870.193583:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851870.193584:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851870.193586:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c214491b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ccb0ba36-3367-4c71-a1af-82ee819f65d2+350:24787:x1858117368200768:12345-172.19.3.162@o2ib600:400:default-oslic12-0
00000100:00000200:15.0:1773851870.193588:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858117368200768
00000020:00000001:15.0:1773851870.193589:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851870.193590:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851870.193591:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851870.193592:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851870.193593:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851870.193594:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851870.193595:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858117368200768, found 0 last_xid 1858117357820863
00000020:00000001:15.0:1773851870.193596:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851870.193597:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851870.193598:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851870.193600:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851870.193601:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851870.193601:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851870.193602:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851870.193603:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000047ae5d51.
02000000:00000001:15.0:1773851870.193604:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851870.193605:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851870.193606:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851870.193608:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182968978253, transno 0, xid 1858117368200768
00010000:00000001:15.0:1773851870.193609:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851870.193610:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c214491b x1858117368200768/t0(0) o400->ccb0ba36-3367-4c71-a1af-82ee819f65d2@172.19.3.162@o2ib600:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic12-0'
00010000:00000001:15.0:1773851870.193615:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851870.193615:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851870.193616:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=103 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851870.193618:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851870.193620:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f4966a94 refcount 3 to 172.19.3.162@o2ib600
00000100:00000001:15.0:1773851870.193621:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148288 : -107154898403328 : ffff9e8b0e584000)
02000000:00000001:15.0:1773851870.193622:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851870.193623:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851870.193624:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851870.193625:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.162@o2ib600
00000400:00000010:15.0:1773851870.193627:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a0412e34.
00000100:00000200:15.0:1773851870.193628:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858117368200768, offset 224
00000400:00000200:15.0:1773851870.193631:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.162@o2ib600
00000400:00000200:15.0:1773851870.193633:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.162@o2ib600 to cpt 3
00000400:00000200:15.0:1773851870.193636:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084138ca7 nid 172.19.3.162@o2ib600 refs 2
00000400:00000200:15.0:1773851870.193638:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084138ca7 nid 172.19.3.162@o2ib600 refs 3
00000400:00000200:15.0:1773851870.193640:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084138ca7 nid 172.19.3.162@o2ib600 refs 4
00000400:00000200:15.0:1773851870.193642:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.162@o2ib600 routed destination
00000400:00000200:15.0:1773851870.193644:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851870.193646:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:15.0:1773851870.193648:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.162@o2ib600: rtr pref emtpy: 1
00000400:00000200:15.0:1773851870.193652:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851870.193654:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.162@o2ib600: rtr pref emtpy: 1
00000400:00000200:15.0:1773851870.193655:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851870.193657:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769335:8769335:1024:4294967295] 2094@kfi7 LPNI seq info [1258746997:1258746997:16:4294967295]
00000400:00000200:15.0:1773851870.193659:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:15.0:1773851870.193660:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:15.0:1773851870.193665:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.162@o2ib600(172.19.3.162@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851870.193667:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084138ca7 nid 172.19.3.162@o2ib600 refs 3
00000800:00000200:15.0:1773851870.193670:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851870.193671:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851870.193675:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851870.193679:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:15.0:1773851870.193684:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:15.0:1773851870.193686:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851870.193690:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851870.193691:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f4966a94 refcount 2 to 172.19.3.162@o2ib600
00010000:00000001:15.0:1773851870.193692:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851870.193693:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851870.193694:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851870.193696:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c214491b x1858117368200768/t0(0) o400->ccb0ba36-3367-4c71-a1af-82ee819f65d2@172.19.3.162@o2ib600:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic12-0'
00000800:00000200:13.0:1773851870.193699:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851870.193702:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c214491b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ccb0ba36-3367-4c71-a1af-82ee819f65d2+350:24787:x1858117368200768:12345-172.19.3.162@o2ib600:400:default-oslic12-0 Request processed in 117us (172us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851870.193702:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851870.193704:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00100000:15.0:1773851870.193706:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.162@o2ib600, seq: 2289846
00000400:00000200:13.0:1773851870.193706:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a0412e34
00000400:00000010:13.0:1773851870.193706:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a0412e34.
00000100:00000040:15.0:1773851870.193707:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000015869b38 : new rpc_count 1
00000100:00000001:15.0:1773851870.193708:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851870.193708:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851870.193708:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851870.193709:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851870.193710:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851870.193710:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:15.0:1773851870.193711:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000020:00000010:15.0:1773851870.193712:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db5a5dbd.
00000020:00000040:15.0:1773851870.193713:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000015869b38 : new refcount 349
00000800:00000200:13.0:1773851870.193713:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00000100:00000001:15.0:1773851870.193715:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851870.250997:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851870.250997:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851870.250999:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851870.251001:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851870.251002:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20482@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.251004:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20482@kfi7 : PUT - for me
00000400:00000200:5.0:1773851870.251004:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20482@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.251005:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f48fad2d nid 20482@kfi7 refs 1
00000400:00000200:5.0:1773851870.251007:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20482@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.251008:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f48fad2d nid 20482@kfi7 refs 2
00000400:00000200:5.0:1773851870.251009:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f48fad2d nid 20482@kfi7 refs 3
00000400:00000200:5.0:1773851870.251010:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20674@kfi7 to cpt 4
00000400:00000200:5.0:1773851870.251011:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20674@kfi7 of length 224 into portal 12 MB=0x699e112d8f680
00000400:00000200:5.0:1773851870.251012:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20674@kfi7 of length 224/224 into md 0x793926dc5 [64] + 137696
00000800:00000200:5.0:1773851870.251014:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851870.251016:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851870.251017:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20482@kfi7: PUT: OK
00000100:00000001:5.0:1773851870.251018:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851870.251019:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851870.251020:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc37e059.
00000100:00000040:5.0:1773851870.251020:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000bc37e059 x1858041823164032 msgsize 224
00000100:00100000:5.0:1773851870.251022:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20674@kfi7 (source: 12345-20482@kfi7)
00000100:00000001:5.0:1773851870.251023:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851870.251024:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f48fad2d nid 20482@kfi7 refs 2
00000100:00000001:7.0:1773851870.251025:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851870.251025:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851870.251025:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851870.251026:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851870.251026:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.251027:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851870.251028:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041823164032
00000020:00000001:7.0:1773851870.251028:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851870.251029:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92722
00000020:00000001:7.0:1773851870.251030:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851870.251033:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000024012ade refcount=6
00000020:00000001:7.0:1773851870.251034:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631252992 : -107123078298624 : ffff9e9276f88400)
00000020:00000001:7.0:1773851870.251034:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631252992 : -107123078298624 : ffff9e9276f88400)
00000100:00000001:7.0:1773851870.251035:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851870.251036:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851870.251037:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002faae425.
00000020:00000010:7.0:1773851870.251038:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851870.251039:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851870.251039:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851870.251040:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851870.251040:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.251041:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851870.251042:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851870.251042:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.251043:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.251044:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851870.251045:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851870.251045:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851870.251045:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851870.251046:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20674@kfi7, seq: 2001925
00000100:00000040:7.0:1773851870.251046:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000024012ade : new rpc_count 1
00000100:00000001:5.0:1773851870.251046:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.251047:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886760064 : -106955822791552 : ffff9eb9682d0480)
00000100:00000001:5.0:1773851870.251047:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.251048:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc37e059 x1858041823164032/t0(0) o400->c8b4c93a-3e0c-43df-a527-8ab0acd0f29b@20674@kfi7:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1783-0'
00000100:00000001:7.0:1773851870.251051:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851870.251051:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851870.251052:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc37e059 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:c8b4c93a-3e0c-43df-a527-8ab0acd0f29b+6:39827:x1858041823164032:12345-20674@kfi7:400:default-tuolumne1783-0
00000100:00000200:7.0:1773851870.251053:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041823164032
00000020:00000001:7.0:1773851870.251054:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851870.251054:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851870.251055:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.251056:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851870.251057:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851870.251058:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851870.251058:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041823164032, found 0 last_xid 1858041823164031
00000020:00000001:7.0:1773851870.251059:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851870.251060:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851870.251061:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851870.251061:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.251062:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851870.251062:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851870.251063:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851870.251064:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bff0c0e1.
02000000:00000001:7.0:1773851870.251064:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.251065:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.251065:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851870.251066:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181931398915, transno 0, xid 1858041823164032
00010000:00000001:7.0:1773851870.251067:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851870.251068:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc37e059 x1858041823164032/t0(0) o400->c8b4c93a-3e0c-43df-a527-8ab0acd0f29b@20674@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1783-0'
00010000:00000001:7.0:1773851870.251070:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851870.251070:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851870.251071:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=102 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851870.251072:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851870.251073:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b4ac3667 refcount 3 to 20674@kfi7
00000100:00000001:7.0:1773851870.251074:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095775264 : -107152613776352 : ffff9e8b9684e420)
02000000:00000001:7.0:1773851870.251075:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851870.251075:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.251076:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851870.251076:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20482@kfi7
00000400:00000010:7.0:1773851870.251077:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034f580d9.
00000100:00000200:7.0:1773851870.251078:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041823164032, offset 224
00000400:00000200:7.0:1773851870.251079:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20482@kfi7
00000400:00000200:7.0:1773851870.251080:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20482@kfi7 to cpt 1
00000400:00000200:7.0:1773851870.251080:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f48fad2d nid 20482@kfi7 refs 1
00000400:00000200:7.0:1773851870.251081:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f48fad2d nid 20482@kfi7 refs 2
00000400:00000200:7.0:1773851870.251082:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f48fad2d nid 20482@kfi7 refs 3
00000400:00000200:7.0:1773851870.251087:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20482@kfi7 local destination
00000400:00000200:7.0:1773851870.251088:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769336:8769336:1024:4294967295] 20482@kfi7 LPNI seq info [635148:635148:16:4294967295]
00000400:00000200:7.0:1773851870.251089:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f48fad2d nid 20482@kfi7 refs 2
00000400:00000200:7.0:1773851870.251090:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20482@kfi7 to cpt 1
00000400:00000200:7.0:1773851870.251092:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20482@kfi7(20482@kfi7:20482@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851870.251093:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f48fad2d nid 20482@kfi7 refs 3
00000800:00000200:7.0:1773851870.251094:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851870.251095:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851870.251097:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851870.251099:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011f7 Using peer 20482@kfi7(0x1000000000011f7)
00000800:00000200:7.0:1773851870.251102:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x1000000000011f7: rc=0
00000800:00000200:7.0:1773851870.251104:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011f7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851870.251106:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.251107:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b4ac3667 refcount 2 to 20674@kfi7
00010000:00000001:7.0:1773851870.251107:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851870.251108:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.251108:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851870.251109:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc37e059 x1858041823164032/t0(0) o400->c8b4c93a-3e0c-43df-a527-8ab0acd0f29b@20674@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1783-0'
00000100:00100000:7.0:1773851870.251112:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc37e059 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:c8b4c93a-3e0c-43df-a527-8ab0acd0f29b+6:39827:x1858041823164032:12345-20674@kfi7:400:default-tuolumne1783-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851870.251114:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20674@kfi7, seq: 2001925
00000100:00000040:7.0:1773851870.251115:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000024012ade : new rpc_count 0
00000100:00000001:7.0:1773851870.251116:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851870.251116:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011f7 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851870.251117:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851870.251118:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851870.251118:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851870.251119:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000400:00000200:5.0:1773851870.251119:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20482@kfi7: PUT: OK
00000020:00000010:7.0:1773851870.251120:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002faae425.
00000020:00000040:7.0:1773851870.251120:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000024012ade : new refcount 5
00000400:00000200:5.0:1773851870.251120:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034f580d9
00000400:00000010:5.0:1773851870.251120:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034f580d9.
00000100:00000001:7.0:1773851870.251121:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851870.251121:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851870.251121:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851870.251122:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f48fad2d nid 20482@kfi7 refs 2
00000800:00000200:5.0:1773851870.251124:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 20482@kfi7(00000000e96e7d4e):0x0 lsk 4600 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011f7 Transaction freed
00010000:00000001:2.0:1773851870.345733:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345734:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851870.345735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851870.345737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851870.345739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851870.345741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851870.345742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851870.345744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851870.345746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851870.345746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851870.345750:0:937834:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851870.345751:0:937834:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851870.345752:0:937834:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:17.0:1773851870.352950:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.352951:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851870.352953:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851870.352955:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851870.352957:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.352959:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.168@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851870.352960:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.352961:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851870.352962:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.168@o2ib600 to cpt 1
00000400:00000200:17.0:1773851870.352963:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000890f8bae nid 172.19.3.168@o2ib600 refs 2
00000400:00000200:17.0:1773851870.352965:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000890f8bae nid 172.19.3.168@o2ib600 refs 3
00000400:00000200:17.0:1773851870.352966:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.168@o2ib600 to cpt 1
00000400:00000200:17.0:1773851870.352967:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.168@o2ib600 of length 224 into portal 12 MB=0x69a5cdd21c580
00000400:00000200:17.0:1773851870.352969:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.168@o2ib600 of length 224/224 into md 0x793926dc5 [64] + 137920
00000800:00000200:17.0:1773851870.352971:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851870.352973:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851870.352974:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851870.352975:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851870.352975:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851870.352976:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000048ef47c3.
00000100:00000040:17.0:1773851870.352977:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000048ef47c3 x1858573497910656 msgsize 224
00000100:00100000:17.0:1773851870.352979:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.168@o2ib600 (source: 12345-172.19.3.168@o2ib600)
00000100:00000001:17.0:1773851870.352981:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851870.352982:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851870.352984:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851870.352984:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851870.352985:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851870.352985:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851870.352986:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.352987:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851870.352987:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858573497910656
00000020:00000001:7.0:1773851870.352988:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851870.352988:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d05
00000020:00000001:7.0:1773851870.352989:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851870.352991:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000a3197e8 refcount=6
00000020:00000001:7.0:1773851870.352992:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395729408 : -107136313822208 : ffff9e8f62127400)
00000020:00000001:7.0:1773851870.352992:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395729408 : -107136313822208 : ffff9e8f62127400)
00000100:00000001:7.0:1773851870.352993:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851870.352994:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851870.352994:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002faae425.
00000020:00000010:7.0:1773851870.352995:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851870.352996:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851870.352996:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851870.352997:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851870.352997:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.352998:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851870.352998:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851870.352999:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.353000:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.353001:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851870.353001:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851870.353002:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.168@o2ib600, seq: 2001926
00000100:00000001:5.0:1773851870.353002:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851870.353002:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851870.353003:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000a3197e8 : new rpc_count 1
00000100:00000001:5.0:1773851870.353003:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.353004:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128161630976 : -106945547920640 : ffff9ebbcc9b1b00)
00000100:00000001:5.0:1773851870.353004:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.353005:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000048ef47c3 x1858573497910656/t0(0) o400->8bb3a539-0fa3-4de2-860b-c69b462bb50e@172.19.3.168@o2ib600:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic18-0'
00000100:00000001:7.0:1773851870.353009:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851870.353009:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851870.353010:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048ef47c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8bb3a539-0fa3-4de2-860b-c69b462bb50e+6:31866:x1858573497910656:12345-172.19.3.168@o2ib600:400:default-oslic18-0
00000100:00000200:7.0:1773851870.353011:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858573497910656
00000020:00000001:7.0:1773851870.353012:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851870.353012:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851870.353013:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.353013:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851870.353014:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851870.353014:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851870.353015:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858573497910656, found 0 last_xid 1858573497910655
00000020:00000001:7.0:1773851870.353015:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851870.353016:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851870.353016:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851870.353017:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.353017:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851870.353018:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851870.353018:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851870.353019:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007e7dac20.
02000000:00000001:7.0:1773851870.353019:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.353020:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.353020:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851870.353021:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182624347314, transno 0, xid 1858573497910656
00010000:00000001:7.0:1773851870.353021:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851870.353022:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000048ef47c3 x1858573497910656/t0(0) o400->8bb3a539-0fa3-4de2-860b-c69b462bb50e@172.19.3.168@o2ib600:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic18-0'
00010000:00000001:7.0:1773851870.353025:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851870.353025:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851870.353026:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=102 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851870.353026:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851870.353027:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000017446d65 refcount 3 to 172.19.3.168@o2ib600
00000100:00000001:7.0:1773851870.353028:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740760160 : -107153968791456 : ffff9e8b45c10060)
02000000:00000001:7.0:1773851870.353029:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851870.353030:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.353030:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851870.353031:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.168@o2ib600
00000400:00000010:7.0:1773851870.353032:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df522108.
00000100:00000200:7.0:1773851870.353032:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858573497910656, offset 224
00000400:00000200:7.0:1773851870.353034:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.168@o2ib600
00000400:00000200:7.0:1773851870.353035:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.168@o2ib600 to cpt 1
00000400:00000200:7.0:1773851870.353036:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000890f8bae nid 172.19.3.168@o2ib600 refs 2
00000400:00000200:7.0:1773851870.353037:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000890f8bae nid 172.19.3.168@o2ib600 refs 3
00000400:00000200:7.0:1773851870.353038:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000890f8bae nid 172.19.3.168@o2ib600 refs 4
00000400:00000200:7.0:1773851870.353039:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.168@o2ib600 routed destination
00000400:00000200:7.0:1773851870.353040:0:60963:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851870.353041:0:60963:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:7.0:1773851870.353043:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.168@o2ib600: rtr pref emtpy: 1
00000400:00000200:7.0:1773851870.353044:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851870.353045:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.168@o2ib600: rtr pref emtpy: 1
00000400:00000200:7.0:1773851870.353046:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851870.353047:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769337:8769337:1024:4294967295] 17@kfi7 LPNI seq info [1250891898:1250891898:16:4294967295]
00000400:00000200:7.0:1773851870.353048:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:7.0:1773851870.353049:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:7.0:1773851870.353051:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.168@o2ib600(172.19.3.168@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851870.353052:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000890f8bae nid 172.19.3.168@o2ib600 refs 3
00000800:00000200:7.0:1773851870.353054:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851870.353055:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851870.353058:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851870.353060:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:7.0:1773851870.353062:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:7.0:1773851870.353065:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851870.353067:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.353068:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000017446d65 refcount 2 to 172.19.3.168@o2ib600
00010000:00000001:7.0:1773851870.353068:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851870.353069:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851870.353069:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851870.353070:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000048ef47c3 x1858573497910656/t0(0) o400->8bb3a539-0fa3-4de2-860b-c69b462bb50e@172.19.3.168@o2ib600:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic18-0'
00000100:00100000:7.0:1773851870.353073:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048ef47c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8bb3a539-0fa3-4de2-860b-c69b462bb50e+6:31866:x1858573497910656:12345-172.19.3.168@o2ib600:400:default-oslic18-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851870.353075:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.168@o2ib600, seq: 2001926
00000100:00000040:7.0:1773851870.353076:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000a3197e8 : new rpc_count 0
00000800:00000200:5.0:1773851870.353076:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851870.353077:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851870.353077:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851870.353078:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851870.353078:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000400:00000200:5.0:1773851870.353078:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851870.353079:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002faae425.
00000020:00000040:7.0:1773851870.353079:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000000a3197e8 : new refcount 5
00000400:00000200:5.0:1773851870.353079:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:7.0:1773851870.353080:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851870.353080:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df522108
00000400:00000010:5.0:1773851870.353080:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df522108.
00000100:00000001:5.0:1773851870.353081:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851870.353081:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851870.353083:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:5.0:1773851870.353084:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Transaction freed
00000800:00000200:21.0:1773851870.446007:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851870.446008:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851870.446010:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851870.446012:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851870.446013:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21842@kfi7 to cpt 5
00000400:00000200:21.0:1773851870.446015:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21842@kfi7 : PUT - for me
00000400:00000200:21.0:1773851870.446016:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21842@kfi7 to cpt 5
00000400:00000200:21.0:1773851870.446017:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007e41948f nid 21842@kfi7 refs 1
00000400:00000200:21.0:1773851870.446018:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21842@kfi7 to cpt 5
00000400:00000200:21.0:1773851870.446018:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007e41948f nid 21842@kfi7 refs 2
00000400:00000200:21.0:1773851870.446019:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007e41948f nid 21842@kfi7 refs 3
00000400:00000200:21.0:1773851870.446020:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21907@kfi7 to cpt 3
00000400:00000200:21.0:1773851870.446021:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21907@kfi7 of length 224 into portal 12 MB=0x69b468603e980
00000400:00000200:21.0:1773851870.446023:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21907@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 39528
00000800:00000200:21.0:1773851870.446025:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851870.446027:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851870.446028:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21842@kfi7: PUT: OK
00000100:00000001:21.0:1773851870.446029:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851870.446029:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851870.446030:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000560f5b14.
00000100:00000040:21.0:1773851870.446031:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000560f5b14 x1859577058683264 msgsize 224
00000100:00100000:21.0:1773851870.446033:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21907@kfi7 (source: 12345-21842@kfi7)
00000100:00000001:21.0:1773851870.446034:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851870.446035:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007e41948f nid 21842@kfi7 refs 2
00000100:00000001:23.0:1773851870.446036:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851870.446036:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851870.446037:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851870.446037:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851870.446037:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851870.446038:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851870.446040:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859577058683264
00000020:00000001:23.0:1773851870.446040:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851870.446041:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc30a8f4e
00000020:00000001:23.0:1773851870.446041:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851870.446045:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b282ebf8 refcount=5
00000020:00000001:23.0:1773851870.446045:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637057930018816 : -107015779532800 : ffff9eab7279c000)
00000020:00000001:23.0:1773851870.446046:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637057930018816 : -107015779532800 : ffff9eab7279c000)
00000100:00000001:23.0:1773851870.446047:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851870.446048:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851870.446049:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b72ef93.
00000020:00000010:23.0:1773851870.446050:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851870.446051:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851870.446052:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851870.446052:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851870.446053:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851870.446054:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851870.446054:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851870.446055:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851870.446056:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851870.446057:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851870.446057:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851870.446058:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851870.446058:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851870.446059:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21907@kfi7, seq: 1997988
00000100:00000040:23.0:1773851870.446060:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b282ebf8 : new rpc_count 1
00000100:00000001:23.0:1773851870.446060:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788273920 : -106974921277696 : ffff9eb4f5d13f00)
00000100:00000001:20.0:1773851870.446060:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851870.446060:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851870.446062:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000560f5b14 x1859577058683264/t0(0) o400->73121059-af5e-4af8-9742-74c14f4d23bd@21907@kfi7:510/0 lens 224/0 e 0 to 0 dl 1773852625 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1862-0'
00000100:00000001:23.0:1773851870.446064:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851870.446065:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851870.446066:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000560f5b14 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:73121059-af5e-4af8-9742-74c14f4d23bd+5:39705:x1859577058683264:12345-21907@kfi7:400:default-tuolumne1862-0
00000100:00000200:23.0:1773851870.446067:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859577058683264
00000020:00000001:23.0:1773851870.446068:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851870.446068:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851870.446070:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851870.446070:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851870.446071:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851870.446072:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851870.446072:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859577058683264, found 0 last_xid 1859577058683263
00000020:00000001:23.0:1773851870.446073:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851870.446074:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851870.446074:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851870.446075:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851870.446076:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851870.446076:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851870.446077:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851870.446077:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000093cb41b2.
02000000:00000001:23.0:1773851870.446078:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851870.446079:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851870.446080:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851870.446081:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691274, transno 0, xid 1859577058683264
00010000:00000001:23.0:1773851870.446081:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851870.446082:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000560f5b14 x1859577058683264/t0(0) o400->73121059-af5e-4af8-9742-74c14f4d23bd@21907@kfi7:510/0 lens 224/224 e 0 to 0 dl 1773852625 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1862-0'
00010000:00000001:23.0:1773851870.446085:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851870.446085:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851870.446086:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=103 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851870.446087:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851870.446088:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f74043d8 refcount 3 to 21907@kfi7
00000100:00000001:23.0:1773851870.446089:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153952 : -107139310397664 : ffff9e8eaf765720)
02000000:00000001:23.0:1773851870.446089:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851870.446090:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851870.446091:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851870.446091:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21842@kfi7
00000400:00000010:23.0:1773851870.446092:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7e037cd.
00000100:00000200:23.0:1773851870.446093:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859577058683264, offset 224
00000400:00000200:23.0:1773851870.446095:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21842@kfi7
00000400:00000200:23.0:1773851870.446095:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21842@kfi7 to cpt 5
00000400:00000200:23.0:1773851870.446096:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007e41948f nid 21842@kfi7 refs 1
00000400:00000200:23.0:1773851870.446098:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007e41948f nid 21842@kfi7 refs 2
00000400:00000200:23.0:1773851870.446099:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007e41948f nid 21842@kfi7 refs 3
00000400:00000200:23.0:1773851870.446100:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21842@kfi7 local destination
00000400:00000200:23.0:1773851870.446101:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769338:8769338:1024:4294967295] 21842@kfi7 LPNI seq info [18565845:18565845:16:4294967295]
00000400:00000200:23.0:1773851870.446103:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007e41948f nid 21842@kfi7 refs 2
00000400:00000200:23.0:1773851870.446103:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21842@kfi7 to cpt 5
00000400:00000200:23.0:1773851870.446105:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21842@kfi7(21842@kfi7:21842@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851870.446107:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007e41948f nid 21842@kfi7 refs 3
00000800:00000200:23.0:1773851870.446108:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851870.446109:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851870.446111:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851870.446114:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000003f Using peer 21842@kfi7(0x10000000000003f)
00000800:00000200:23.0:1773851870.446117:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x10000000000003f: rc=0
00000800:00000200:23.0:1773851870.446119:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000003f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851870.446121:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851870.446122:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f74043d8 refcount 2 to 21907@kfi7
00010000:00000001:23.0:1773851870.446123:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851870.446123:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851870.446124:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851870.446125:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000560f5b14 x1859577058683264/t0(0) o400->73121059-af5e-4af8-9742-74c14f4d23bd@21907@kfi7:510/0 lens 224/224 e 0 to 0 dl 1773852625 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1862-0'
00000100:00100000:23.0:1773851870.446128:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000560f5b14 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:73121059-af5e-4af8-9742-74c14f4d23bd+5:39705:x1859577058683264:12345-21907@kfi7:400:default-tuolumne1862-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851870.446129:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000003f TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851870.446130:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21907@kfi7, seq: 1997988
00000100:00000040:23.0:1773851870.446131:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b282ebf8 : new rpc_count 0
00000400:00000200:21.0:1773851870.446131:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851870.446132:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851870.446132:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21842@kfi7: PUT: OK
00000100:00000001:23.0:1773851870.446133:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851870.446133:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851870.446133:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7e037cd
00000020:00000010:23.0:1773851870.446134:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000010:21.0:1773851870.446134:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7e037cd.
00000020:00000010:23.0:1773851870.446135:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b72ef93.
00000100:00000001:21.0:1773851870.446135:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851870.446135:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:23.0:1773851870.446136:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000b282ebf8 : new refcount 4
00000100:00000001:23.0:1773851870.446136:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851870.446136:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007e41948f nid 21842@kfi7 refs 2
00000800:00000200:21.0:1773851870.446138:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 21842@kfi7(00000000b5c587b2):0x0 lsk 64 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000003f Transaction freed
00000800:00000200:3.0:1773851870.491418:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851870.491420:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851870.491422:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851870.491426:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851870.491429:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18403@kfi7 to cpt 0
00000400:00000200:3.0:1773851870.491432:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18403@kfi7 : PUT - for me
00000400:00000200:3.0:1773851870.491434:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18403@kfi7 to cpt 0
00000400:00000200:3.0:1773851870.491435:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eee58f38 nid 18403@kfi7 refs 1
00000400:00000200:3.0:1773851870.491437:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18403@kfi7 to cpt 0
00000400:00000200:3.0:1773851870.491438:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eee58f38 nid 18403@kfi7 refs 2
00000400:00000200:3.0:1773851870.491439:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eee58f38 nid 18403@kfi7 refs 3
00000400:00000200:3.0:1773851870.491441:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18211@kfi7 to cpt 5
00000400:00000200:3.0:1773851870.491442:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18211@kfi7 of length 224 into portal 12 MB=0x69b0a1c58a900
00000400:00000200:3.0:1773851870.491445:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18211@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 30960
00000800:00000200:3.0:1773851870.491448:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851870.491451:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851870.491453:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18403@kfi7: PUT: OK
00000100:00000001:3.0:1773851870.491454:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851870.491455:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851870.491456:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070e053cc.
00000100:00000040:3.0:1773851870.491457:0:2506738:0:(events.c:358:request_in_callback()) incoming req@0000000070e053cc x1859317587814656 msgsize 224
00000100:00100000:3.0:1773851870.491460:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-18211@kfi7 (source: 12345-18403@kfi7)
00000100:00000001:3.0:1773851870.491461:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851870.491463:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eee58f38 nid 18403@kfi7 refs 2
00000100:00000001:0.0:1773851870.491464:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851870.491465:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851870.491466:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851870.491466:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851870.491467:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851870.491468:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851870.491469:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317587814656
00000020:00000001:0.0:1773851870.491470:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851870.491471:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9262d
00000020:00000001:0.0:1773851870.491472:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851870.491476:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000017efc7ea refcount=8
00000020:00000001:0.0:1773851870.491477:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630993920 : -107123078557696 : ffff9e9276f49000)
00000020:00000001:0.0:1773851870.491478:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630993920 : -107123078557696 : ffff9e9276f49000)
00000100:00000001:0.0:1773851870.491479:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851870.491481:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851870.491482:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eccd9a8a.
00000020:00000010:0.0:1773851870.491484:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851870.491485:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851870.491487:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851870.491487:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851870.491488:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851870.491490:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851870.491491:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851870.491492:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851870.491493:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851870.491495:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851870.491496:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851870.491497:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851870.491498:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851870.491498:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18211@kfi7, seq: 1997567
00000100:00000001:1.0:1773851870.491499:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851870.491499:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000017efc7ea : new rpc_count 2
00000100:00000001:0.0:1773851870.491500:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288718592 : -106964420833024 : ffff9eb767b15100)
00000100:00000001:1.0:1773851870.491501:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851870.491502:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000070e053cc x1859317587814656/t0(0) o400->bd148476-a492-4f25-82a5-5f03597fd90f@18211@kfi7:510/0 lens 224/0 e 0 to 0 dl 1773852625 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1627-0'
00000100:00000001:0.0:1773851870.491507:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851870.491507:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851870.491509:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070e053cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bd148476-a492-4f25-82a5-5f03597fd90f+8:39542:x1859317587814656:12345-18211@kfi7:400:default-tuolumne1627-0
00000100:00000200:0.0:1773851870.491511:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317587814656
00000020:00000001:0.0:1773851870.491512:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851870.491513:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851870.491514:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.491515:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851870.491516:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851870.491517:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851870.491518:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317587814656, found 0 last_xid 1859317585704191
00000020:00000001:0.0:1773851870.491519:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851870.491520:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851870.491521:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851870.491522:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.491524:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851870.491525:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851870.491525:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851870.491527:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005acca8af.
02000000:00000001:0.0:1773851870.491528:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851870.491528:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.491529:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851870.491531:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183243872085, transno 0, xid 1859317587814656
00010000:00000001:0.0:1773851870.491532:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851870.491533:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000070e053cc x1859317587814656/t0(0) o400->bd148476-a492-4f25-82a5-5f03597fd90f@18211@kfi7:510/0 lens 224/224 e 0 to 0 dl 1773852625 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1627-0'
00010000:00000001:0.0:1773851870.491538:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851870.491539:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851870.491540:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=103 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851870.491542:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851870.491543:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009c686149 refcount 3 to 18211@kfi7
00000100:00000001:0.0:1773851870.491544:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109568 : -107156354442048 : ffff9e8ab78edcc0)
02000000:00000001:0.0:1773851870.491545:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851870.491546:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851870.491547:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851870.491548:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18403@kfi7
00000400:00000010:0.0:1773851870.491549:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a494ee40.
00000100:00000200:0.0:1773851870.491551:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317587814656, offset 224
00000400:00000200:0.0:1773851870.491553:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18403@kfi7
00000400:00000200:0.0:1773851870.491555:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18403@kfi7 to cpt 0
00000400:00000200:0.0:1773851870.491556:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eee58f38 nid 18403@kfi7 refs 1
00000400:00000200:0.0:1773851870.491558:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eee58f38 nid 18403@kfi7 refs 2
00000400:00000200:0.0:1773851870.491560:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eee58f38 nid 18403@kfi7 refs 3
00000400:00000200:0.0:1773851870.491562:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18403@kfi7 local destination
00000400:00000200:0.0:1773851870.491564:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769339:8769339:1024:4294967295] 18403@kfi7 LPNI seq info [146380:146380:16:4294967295]
00000400:00000200:0.0:1773851870.491566:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eee58f38 nid 18403@kfi7 refs 2
00000400:00000200:0.0:1773851870.491568:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18403@kfi7 to cpt 0
00000400:00000200:0.0:1773851870.491571:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18403@kfi7(18403@kfi7:18403@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851870.491573:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eee58f38 nid 18403@kfi7 refs 3
00000800:00000200:0.0:1773851870.491576:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851870.491578:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851870.491581:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851870.491585:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x428 Using peer 18403@kfi7(0x428)
00000800:00000200:0.0:1773851870.491590:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x428: rc=0
00000800:00000200:0.0:1773851870.491592:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x428 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851870.491596:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851870.491597:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009c686149 refcount 2 to 18211@kfi7
00010000:00000001:0.0:1773851870.491598:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851870.491601:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.491602:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851870.491603:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000070e053cc x1859317587814656/t0(0) o400->bd148476-a492-4f25-82a5-5f03597fd90f@18211@kfi7:510/0 lens 224/224 e 0 to 0 dl 1773852625 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1627-0'
00000100:00100000:0.0:1773851870.491609:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070e053cc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bd148476-a492-4f25-82a5-5f03597fd90f+8:39542:x1859317587814656:12345-18211@kfi7:400:default-tuolumne1627-0 Request processed in 101us (150us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851870.491613:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18211@kfi7, seq: 1997567
00000100:00000040:0.0:1773851870.491614:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000017efc7ea : new rpc_count 1
00000100:00000001:0.0:1773851870.491616:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851870.491617:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851870.491618:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851870.491619:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851870.491621:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eccd9a8a.
00000020:00000040:0.0:1773851870.491623:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000017efc7ea : new refcount 7
00000100:00000001:0.0:1773851870.491624:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851870.491634:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x428 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851870.491637:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851870.491639:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18403@kfi7: PUT: OK
00000400:00000200:1.0:1773851870.491641:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a494ee40
00000400:00000010:1.0:1773851870.491642:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a494ee40.
00000100:00000001:1.0:1773851870.491643:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851870.491644:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851870.491646:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eee58f38 nid 18403@kfi7 refs 2
00000800:00000200:1.0:1773851870.491649:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 18403@kfi7(0000000051246afd):0x0 lsk 1065 rsk 45 tsk 0 trmk 0 tmk 0 trr 0 tta 0x428 Transaction freed
00000004:00000001:6.0:1773851870.537731:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851870.537731:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851870.537732:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070b5fd45.
00000020:00000040:6.0:1773851870.537733:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851870.537734:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851870.537734:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851870.537735:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851870.537736:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000008df2c937.
00000100:00000001:6.0:1773851870.537737:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851870.537737:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851870.537738:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851870.537739:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000070b5fd45] to pc [ptlrpcd_01_02+2]  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851870.537743:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851870.537745:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:6.0:1773851870.537745:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000034c1d9a0.
00080000:00000001:6.0:1773851870.537745:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637075466113024 : -106998243438592 : ffff9eaf87b55000)
00000100:00000001:5.0:1773851870.537745:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851870.537746:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851870.537746:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851870.537746:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851870.537746:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.537747:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851870.537747:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851870.537748:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000004:00000010:6.0:1773851870.537749:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000e6986f33.
00000004:00080000:6.0:1773851870.537749:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614144991025069ns, next at 614145991023956ns, rc = 0
00000100:00000001:7.0:1773851870.537750:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851870.537750:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.537751:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:6.0:1773851870.537751:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851870.537752:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851870.537752:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851870.537752:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851870.537753:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000070b5fd45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051929792:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851870.537754:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851870.537755:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851870.537755:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.537756:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851870.537757:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d72416c0.
02000000:00000001:7.0:1773851870.537757:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851870.537758:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:7.0:1773851870.537759:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:7.0:1773851870.537760:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000068cc9555.
00000100:00000200:7.0:1773851870.537761:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929792, portal 4
00000100:00000001:7.0:1773851870.537762:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851870.537762:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814063488 : -107101895488128 : ffff9e9765908d80)
00000100:00000040:7.0:1773851870.537763:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.537766:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851870.537767:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:7.0:1773851870.537768:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000100:00000200:7.0:1773851870.537769:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929792, offset 0
00000400:00000200:7.0:1773851870.537770:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:7.0:1773851870.537771:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851870.537772:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:7.0:1773851870.537773:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851870.537774:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:7.0:1773851870.537775:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:7.0:1773851870.537777:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769339, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769338, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851870.537778:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:7.0:1773851870.537779:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851870.537780:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:7.0:1773851870.537781:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769340:8769340:1024:4294967295] 16@kfi7 LPNI seq info [5403816:5403816:16:4294967295]
00000400:00000200:7.0:1773851870.537782:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851870.537783:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851870.537785:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851870.537786:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:7.0:1773851870.537788:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851870.537789:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851870.537791:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851870.537793:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Using peer 16@kfi7(0x200000000000169)
00000800:00000200:7.0:1773851870.537796:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x200000000000169: rc=0
00000800:00000200:7.0:1773851870.537797:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851870.537799:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.537800:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851870.537800:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.537801:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.537801:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.537802:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851870.537803:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851870.537803:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851870.537804:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851870.537804:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.537805:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851870.537810:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851870.537812:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851870.537813:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000400:00000200:5.0:1773851870.537814:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000010:5.0:1773851870.537815:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000100:00000001:5.0:1773851870.537816:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851870.537816:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851870.537819:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851870.537820:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851870.537822:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.537823:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851870.537824:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:5.0:1773851870.537826:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Transaction freed
00000800:00000200:29.0:1773851870.537852:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851870.537853:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851870.537854:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851870.537857:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851870.537859:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.537860:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851870.537861:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.537862:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851870.537863:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.537863:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851870.537864:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851870.537865:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.537866:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3cc0
00000400:00000200:29.0:1773851870.537867:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.537869:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x780080b3d [1] + 224
00000800:00000200:29.0:1773851870.537871:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851870.537873:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851870.537874:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851870.537875:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851870.537877:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851870.537879:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851870.537883:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851870.537884:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:7.0:1773851870.537885:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851870.537885:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851870.537886:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000001:7.0:1773851870.537886:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851870.537886:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851870.537887:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851870.537888:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000068cc9555
00000400:00000010:7.0:1773851870.537888:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000068cc9555.
00000100:00000001:7.0:1773851870.537889:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851870.537890:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851870.537893:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.537895:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851870.537896:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.537897:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851870.537897:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851870.537898:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851870.537898:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.537899:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851870.537900:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=103 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851870.537901:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=103 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851870.537902:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851870.537902:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851870.537903:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851870.537903:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.537904:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851870.537905:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:7.0:1773851870.537905:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851870.537906:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.537907:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.537909:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851870.537909:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851870.537910:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851870.537910:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851870.537911:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851870.537912:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482209280 avail=351481147392 avail_mb=1372973232 hwm_mb=3131103 files=372097185 ffree=343244345 state=0: rc = 0
00000004:00000020:7.0:1773851870.537913:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482209280 free, 351481147392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097185 files, 343244345 free files
00000004:00000001:7.0:1773851870.537915:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851870.537916:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851870.537918:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000070b5fd45 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051929792:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851870.537920:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.537920:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851870.537921:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000070b5fd45 x1859433051929792/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852023 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851870.537923:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851870.537924:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851870.537924:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d72416c0.
02000000:00000001:7.0:1773851870.537925:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851870.537926:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851870.537926:0:41066:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:7.0:1773851870.537927:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851870.537928:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000008df2c937.
02000000:00000001:7.0:1773851870.537928:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851870.537929:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851870.537929:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000070b5fd45.
00000100:00000001:7.0:1773851870.537930:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851870.537930:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.537931:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.537932:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851870.537932:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.537933:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851870.537933:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851870.539672:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851870.539673:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851870.539674:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851870.539677:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851870.539679:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20467@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.539680:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20467@kfi7 : PUT - for me
00000400:00000200:13.0:1773851870.539681:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20467@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.539682:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 1
00000400:00000200:13.0:1773851870.539683:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20467@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.539684:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 2
00000400:00000200:13.0:1773851870.539685:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 3
00000400:00000200:13.0:1773851870.539686:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20467@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.539687:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20467@kfi7 of length 224 into portal 12 MB=0x69b0a6fb41700
00000400:00000200:13.0:1773851870.539689:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20467@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 32800
00000800:00000200:13.0:1773851870.539691:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851870.539693:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851870.539694:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20467@kfi7: PUT: OK
00000100:00000001:13.0:1773851870.539695:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851870.539696:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851870.539697:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aef58415.
00000100:00000040:13.0:1773851870.539698:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000aef58415 x1859318986315520 msgsize 224
00000100:00100000:13.0:1773851870.539700:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20467@kfi7 (source: 12345-20467@kfi7)
00000100:00000001:13.0:1773851870.539701:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851870.539702:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851870.539702:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 2
02000000:00000001:15.0:1773851870.539703:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851870.539703:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851870.539703:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851870.539704:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851870.539704:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851870.539705:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318986315520
00000020:00000001:15.0:1773851870.539706:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851870.539706:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92340
00000020:00000001:15.0:1773851870.539707:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851870.539713:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055c2749e refcount=6
00000020:00000001:15.0:1773851870.539713:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630293504 : -107123079258112 : ffff9e9276e9e000)
00000020:00000001:15.0:1773851870.539714:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630293504 : -107123079258112 : ffff9e9276e9e000)
00000100:00000001:15.0:1773851870.539715:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851870.539716:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851870.539717:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000db5a5dbd.
00000020:00000010:15.0:1773851870.539718:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851870.539719:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006ab6a1e7.
00000100:00000001:15.0:1773851870.539720:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851870.539720:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851870.539721:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851870.539722:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851870.539723:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851870.539723:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851870.539724:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851870.539726:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851870.539727:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851870.539728:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851870.539729:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851870.539733:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20467@kfi7, seq: 2289847
00000100:00000001:15.0:1773851870.539734:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851870.539734:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055c2749e : new rpc_count 1
00000100:00000001:15.0:1773851870.539735:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851870.539735:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970974336 : -107043738577280 : ffff9ea4effc9680)
00000100:00000040:12.0:1773851870.539737:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aef58415 x1859318986315520/t0(0) o400->83cc873e-c289-4126-b720-10bd8c92dd02@20467@kfi7:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1753-0'
00000100:00000001:12.0:1773851870.539741:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851870.539742:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851870.539743:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aef58415 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:83cc873e-c289-4126-b720-10bd8c92dd02+6:39493:x1859318986315520:12345-20467@kfi7:400:default-tuolumne1753-0
00000100:00000200:12.0:1773851870.539745:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318986315520
00000020:00000001:12.0:1773851870.539745:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851870.539747:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851870.539748:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.539749:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851870.539749:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851870.539750:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851870.539751:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318986315520, found 0 last_xid 1859318986315519
00000020:00000001:12.0:1773851870.539752:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851870.539753:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851870.539753:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851870.539754:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.539755:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851870.539756:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851870.539757:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851870.539758:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d6d418dc.
02000000:00000001:12.0:1773851870.539759:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851870.539759:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.539760:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851870.539761:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596698, transno 0, xid 1859318986315520
00010000:00000001:12.0:1773851870.539762:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851870.539763:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aef58415 x1859318986315520/t0(0) o400->83cc873e-c289-4126-b720-10bd8c92dd02@20467@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1753-0'
00010000:00000001:12.0:1773851870.539766:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851870.539767:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851870.539768:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=103 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851870.539769:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851870.539770:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009f58a50a refcount 3 to 20467@kfi7
00000100:00000001:12.0:1773851870.539771:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152128 : -107139310399488 : ffff9e8eaf765000)
02000000:00000001:12.0:1773851870.539772:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851870.539773:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851870.539773:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851870.539774:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20467@kfi7
00000400:00000010:12.0:1773851870.539775:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009bd347e2.
00000100:00000200:12.0:1773851870.539777:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318986315520, offset 224
00000400:00000200:12.0:1773851870.539779:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20467@kfi7
00000400:00000200:12.0:1773851870.539780:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20467@kfi7 to cpt 3
00000400:00000200:12.0:1773851870.539781:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 1
00000400:00000200:12.0:1773851870.539782:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 2
00000400:00000200:12.0:1773851870.539784:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 3
00000400:00000200:12.0:1773851870.539785:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20467@kfi7 local destination
00000400:00000200:12.0:1773851870.539787:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769341:8769341:1024:4294967295] 20467@kfi7 LPNI seq info [19818910:19818910:16:4294967295]
00000400:00000200:12.0:1773851870.539789:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 2
00000400:00000200:12.0:1773851870.539790:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20467@kfi7 to cpt 3
00000400:00000200:12.0:1773851870.539792:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20467@kfi7(20467@kfi7:20467@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851870.539794:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 3
00000800:00000200:12.0:1773851870.539796:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851870.539797:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851870.539800:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851870.539803:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000dc Using peer 20467@kfi7(0x1000000000000dc)
00000800:00000200:12.0:1773851870.539807:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0x1000000000000dc: rc=0
00000800:00000200:12.0:1773851870.539808:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851870.539811:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851870.539812:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009f58a50a refcount 2 to 20467@kfi7
00010000:00000001:12.0:1773851870.539813:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851870.539813:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.539814:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851870.539815:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aef58415 x1859318986315520/t0(0) o400->83cc873e-c289-4126-b720-10bd8c92dd02@20467@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1753-0'
00000100:00100000:12.0:1773851870.539821:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aef58415 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:83cc873e-c289-4126-b720-10bd8c92dd02+6:39493:x1859318986315520:12345-20467@kfi7:400:default-tuolumne1753-0 Request processed in 78us (122us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851870.539823:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20467@kfi7, seq: 2289847
00000100:00000040:12.0:1773851870.539824:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055c2749e : new rpc_count 0
00000100:00000001:12.0:1773851870.539825:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851870.539826:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851870.539827:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851870.539828:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006ab6a1e7.
00000020:00000010:12.0:1773851870.539829:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000db5a5dbd.
00000020:00000040:12.0:1773851870.539830:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000055c2749e : new refcount 5
00000100:00000001:12.0:1773851870.539831:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851870.539839:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000dc TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851870.539843:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851870.539845:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20467@kfi7: PUT: OK
00000400:00000200:13.0:1773851870.539846:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009bd347e2
00000400:00000010:13.0:1773851870.539846:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009bd347e2.
00000100:00000001:13.0:1773851870.539847:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851870.539848:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851870.539849:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef2d1d26 nid 20467@kfi7 refs 2
00000800:00000200:13.0:1773851870.539852:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 20467@kfi7(000000008acd2170):0x0 lsk 221 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000dc Transaction freed
00000800:00000200:17.0:1773851870.563610:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.563611:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851870.563613:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851870.563615:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851870.563617:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.563618:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:17.0:1773851870.563619:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.563620:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851870.563621:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.563622:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851870.563623:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851870.563624:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:17.0:1773851870.563625:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e35540
00000400:00000200:17.0:1773851870.563626:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 14144
00000800:00000200:17.0:1773851870.563628:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851870.563629:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851870.563631:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000100:00000001:17.0:1773851870.563631:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851870.563632:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851870.563633:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000930b4528.
00000100:00000040:17.0:1773851870.563633:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000930b4528 x1859316187616576 msgsize 224
00000100:00100000:17.0:1773851870.563635:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:17.0:1773851870.563636:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851870.563637:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:17.0:1773851870.563638:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851870.563638:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851870.563639:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851870.563639:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851870.563639:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851870.563640:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851870.563641:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187616576
00000020:00000001:16.0:1773851870.563642:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851870.563643:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:16.0:1773851870.563643:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851870.563644:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:16.0:1773851870.563645:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:16.0:1773851870.563646:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:16.0:1773851870.563647:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851870.563648:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851870.563648:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007773209b.
00000020:00000010:16.0:1773851870.563650:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851870.563650:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b2bbb793.
00000100:00000001:16.0:1773851870.563651:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851870.563652:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851870.563652:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851870.563653:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851870.563654:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851870.563654:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851870.563655:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851870.563657:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851870.563657:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851870.563657:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851870.563657:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851870.563658:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156338
00000100:00000040:17.0:1773851870.563659:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:16.0:1773851870.563659:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.563660:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637128161648256 : -106945547903360 : ffff9ebbcc9b5e80)
00000100:00000001:16.0:1773851870.563660:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851870.563661:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000930b4528 x1859316187616576/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:153/0 lens 224/0 e 0 to 0 dl 1773852268 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:17.0:1773851870.563664:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851870.563664:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851870.563665:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000930b4528 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39685:x1859316187616576:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:17.0:1773851870.563666:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187616576
00000020:00000001:17.0:1773851870.563667:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851870.563667:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851870.563668:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.563669:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851870.563669:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851870.563670:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851870.563671:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187616576, found 0 last_xid 1859316186815935
00000020:00000001:17.0:1773851870.563671:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851870.563672:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851870.563672:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851870.563673:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.563674:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851870.563674:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851870.563675:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851870.563676:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001bc015a1.
02000000:00000001:17.0:1773851870.563676:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.563677:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.563678:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851870.563678:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187616576
00010000:00000001:17.0:1773851870.563679:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851870.563680:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000930b4528 x1859316187616576/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:17.0:1773851870.563682:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851870.563683:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851870.563683:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=103 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851870.563684:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851870.563685:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:17.0:1773851870.563686:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:17.0:1773851870.563686:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851870.563687:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.563687:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851870.563688:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:17.0:1773851870.563689:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000992a4632.
00000100:00000200:17.0:1773851870.563690:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187616576, offset 224
00000400:00000200:17.0:1773851870.563691:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:17.0:1773851870.563692:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.563693:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851870.563694:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851870.563695:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851870.563696:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:17.0:1773851870.563697:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769342:8769342:1024:4294967295] 20881@kfi7 LPNI seq info [16890553:16890553:16:4294967295]
00000400:00000200:17.0:1773851870.563698:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851870.563699:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.563701:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851870.563702:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:17.0:1773851870.563703:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.563704:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851870.563706:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851870.563708:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Using peer 20881@kfi7(0x6b5)
00000800:00000200:17.0:1773851870.563711:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x6b5: rc=0
00000800:00000200:17.0:1773851870.563712:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851870.563714:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851870.563715:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:17.0:1773851870.563716:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851870.563716:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.563717:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851870.563718:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000930b4528 x1859316187616576/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000100:00100000:17.0:1773851870.563720:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000930b4528 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39685:x1859316187616576:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 56us (86us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851870.563723:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156338
00000100:00000040:17.0:1773851870.563723:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000100:00000001:17.0:1773851870.563724:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851870.563726:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851870.563729:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851870.563730:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000400:00000200:18.0:1773851870.563731:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851870.563731:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b2bbb793.
00000020:00000010:17.0:1773851870.563731:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007773209b.
00000400:00000200:18.0:1773851870.563732:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000020:00000040:17.0:1773851870.563732:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000400:00000200:18.0:1773851870.563733:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000992a4632
00000400:00000010:18.0:1773851870.563733:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000992a4632.
00000100:00000001:17.0:1773851870.563733:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851870.563734:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851870.563734:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851870.563735:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:18.0:1773851870.563737:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Transaction freed
00000800:00000200:13.0:1773851870.575934:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851870.575935:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851870.575936:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851870.575938:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851870.575939:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21043@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.575941:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21043@kfi7 : PUT - for me
00000400:00000200:13.0:1773851870.575941:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21043@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.575943:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000428769ca nid 21043@kfi7 refs 1
00000400:00000200:13.0:1773851870.575945:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21043@kfi7 to cpt 3
00000400:00000200:13.0:1773851870.575945:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000428769ca nid 21043@kfi7 refs 2
00000400:00000200:13.0:1773851870.575946:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000428769ca nid 21043@kfi7 refs 3
00000400:00000200:13.0:1773851870.575947:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21235@kfi7 to cpt 6
00000400:00000200:13.0:1773851870.575948:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21235@kfi7 of length 224 into portal 12 MB=0x699e0bd38ff40
00000400:00000200:13.0:1773851870.575949:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21235@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 33024
00000800:00000200:13.0:1773851870.575951:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851870.575952:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851870.575953:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21043@kfi7: PUT: OK
00000100:00000001:13.0:1773851870.575954:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851870.575955:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851870.575956:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000077e5cf8c.
00000100:00000040:13.0:1773851870.575957:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000077e5cf8c x1858040386617152 msgsize 224
00000100:00100000:13.0:1773851870.575958:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21235@kfi7 (source: 12345-21043@kfi7)
00000100:00000001:13.0:1773851870.575959:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851870.575960:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000428769ca nid 21043@kfi7 refs 2
00000800:00000200:13.0:1773851870.575961:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851870.575961:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851870.575961:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851870.575962:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851870.575963:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851870.575963:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851870.575964:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040386617152
00000020:00000001:12.0:1773851870.575965:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851870.575965:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9278b
00000020:00000001:12.0:1773851870.575966:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851870.575969:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003d1f6d2c refcount=6
00000020:00000001:12.0:1773851870.575970:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631491584 : -107123078060032 : ffff9e9276fc2800)
00000020:00000001:12.0:1773851870.575971:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631491584 : -107123078060032 : ffff9e9276fc2800)
00000100:00000001:12.0:1773851870.575972:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851870.575973:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851870.575973:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851870.575975:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851870.575975:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000001:12.0:1773851870.575976:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851870.575977:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851870.575977:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851870.575978:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851870.575979:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851870.575979:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851870.575980:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851870.575981:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851870.575981:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851870.575982:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851870.575982:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851870.575983:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21235@kfi7, seq: 2289848
00000100:00000040:12.0:1773851870.575983:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003d1f6d2c : new rpc_count 1
00000100:00000001:15.0:1773851870.575984:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851870.575984:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851870.575984:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970999680 : -107043738551936 : ffff9ea4effcf980)
00000100:00000040:12.0:1773851870.575985:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000077e5cf8c x1858040386617152/t0(0) o400->cd9b5b39-39a2-4871-94ea-a30f88254f77@21235@kfi7:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1801-0'
00000100:00000001:12.0:1773851870.575988:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851870.575988:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851870.575989:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077e5cf8c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:cd9b5b39-39a2-4871-94ea-a30f88254f77+6:39654:x1858040386617152:12345-21235@kfi7:400:default-tuolumne1801-0
00000100:00000200:12.0:1773851870.575991:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040386617152
00000020:00000001:12.0:1773851870.575992:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851870.575993:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851870.575993:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.575994:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851870.575994:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851870.575995:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851870.575996:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040386617152, found 0 last_xid 1858040386617151
00000020:00000001:12.0:1773851870.575996:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851870.575997:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851870.575998:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851870.575998:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.575999:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851870.575999:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851870.576000:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851870.576000:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000181e8cff.
02000000:00000001:12.0:1773851870.576001:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851870.576001:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.576002:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851870.576003:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105112788, transno 0, xid 1858040386617152
00010000:00000001:12.0:1773851870.576003:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851870.576004:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000077e5cf8c x1858040386617152/t0(0) o400->cd9b5b39-39a2-4871-94ea-a30f88254f77@21235@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1801-0'
00010000:00000001:12.0:1773851870.576006:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851870.576007:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851870.576007:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=103 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851870.576008:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851870.576009:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001f2e72e3 refcount 3 to 21235@kfi7
00000100:00000001:12.0:1773851870.576010:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366318656 : -107142343232960 : ffff9e8dfab0f240)
02000000:00000001:12.0:1773851870.576010:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851870.576011:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851870.576012:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851870.576012:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21043@kfi7
00000400:00000010:12.0:1773851870.576013:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f51b28f0.
00000100:00000200:12.0:1773851870.576014:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040386617152, offset 224
00000400:00000200:12.0:1773851870.576015:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21043@kfi7
00000400:00000200:12.0:1773851870.576016:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21043@kfi7 to cpt 3
00000400:00000200:12.0:1773851870.576017:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000428769ca nid 21043@kfi7 refs 1
00000400:00000200:12.0:1773851870.576018:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000428769ca nid 21043@kfi7 refs 2
00000400:00000200:12.0:1773851870.576019:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000428769ca nid 21043@kfi7 refs 3
00000400:00000200:12.0:1773851870.576020:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21043@kfi7 local destination
00000400:00000200:12.0:1773851870.576021:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769343:8769343:1024:4294967295] 21043@kfi7 LPNI seq info [3442051:3442051:16:4294967295]
00000400:00000200:12.0:1773851870.576022:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000428769ca nid 21043@kfi7 refs 2
00000400:00000200:12.0:1773851870.576023:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21043@kfi7 to cpt 3
00000400:00000200:12.0:1773851870.576025:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21043@kfi7(21043@kfi7:21043@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851870.576026:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000428769ca nid 21043@kfi7 refs 3
00000800:00000200:12.0:1773851870.576027:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851870.576028:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851870.576030:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851870.576032:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4d4 Using peer 21043@kfi7(0x4d4)
00000800:00000200:12.0:1773851870.576035:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x4d4: rc=0
00000800:00000200:12.0:1773851870.576036:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4d4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851870.576038:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851870.576039:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001f2e72e3 refcount 2 to 21235@kfi7
00010000:00000001:12.0:1773851870.576040:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851870.576040:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851870.576041:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851870.576041:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000077e5cf8c x1858040386617152/t0(0) o400->cd9b5b39-39a2-4871-94ea-a30f88254f77@21235@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1801-0'
00000100:00100000:12.0:1773851870.576045:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077e5cf8c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:cd9b5b39-39a2-4871-94ea-a30f88254f77+6:39654:x1858040386617152:12345-21235@kfi7:400:default-tuolumne1801-0 Request processed in 55us (86us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851870.576048:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21235@kfi7, seq: 2289848
00000100:00000040:12.0:1773851870.576048:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003d1f6d2c : new rpc_count 0
00000100:00000001:12.0:1773851870.576049:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851870.576050:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851870.576050:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851870.576051:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:12.0:1773851870.576052:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000020:00000040:12.0:1773851870.576052:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000003d1f6d2c : new refcount 5
00000100:00000001:12.0:1773851870.576053:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851870.576058:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4d4 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851870.576059:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851870.576061:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21043@kfi7: PUT: OK
00000400:00000200:13.0:1773851870.576062:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f51b28f0
00000400:00000010:13.0:1773851870.576062:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f51b28f0.
00000100:00000001:13.0:1773851870.576063:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851870.576063:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851870.576064:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000428769ca nid 21043@kfi7 refs 2
00000800:00000200:13.0:1773851870.576066:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 21043@kfi7(00000000379e3873):0x0 lsk 1237 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4d4 Transaction freed
00000800:00000200:17.0:1773851870.596130:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.596130:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851870.596131:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851870.596133:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851870.596135:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13121@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.596136:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13121@kfi7 : PUT - for me
00000400:00000200:17.0:1773851870.596137:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13121@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.596138:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 1
00000400:00000200:17.0:1773851870.596139:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13121@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.596139:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 2
00000400:00000200:17.0:1773851870.596140:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 3
00000400:00000200:17.0:1773851870.596141:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13121@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.596142:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13121@kfi7 of length 224 into portal 12 MB=0x699e17a3ec380
00000400:00000200:17.0:1773851870.596143:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13121@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 14368
00000800:00000200:17.0:1773851870.596144:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851870.596146:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851870.596147:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13121@kfi7: PUT: OK
00000100:00000001:17.0:1773851870.596147:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851870.596148:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851870.596149:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007aa1fe04.
00000100:00000040:17.0:1773851870.596150:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000007aa1fe04 x1858043557888896 msgsize 224
00000100:00100000:17.0:1773851870.596151:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13121@kfi7 (source: 12345-13121@kfi7)
00000100:00000001:17.0:1773851870.596153:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851870.596153:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 2
00000800:00000200:17.0:1773851870.596155:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851870.596157:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851870.596158:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851870.596158:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851870.596159:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851870.596159:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851870.596160:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043557888896
00000020:00000001:17.0:1773851870.596161:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851870.596161:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92921
00000020:00000001:17.0:1773851870.596162:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851870.596164:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b7689d54 refcount=6
00000020:00000001:17.0:1773851870.596165:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743197696 : -107128966353920 : ffff9e911803ec00)
00000020:00000001:17.0:1773851870.596166:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743197696 : -107128966353920 : ffff9e911803ec00)
00000100:00000001:17.0:1773851870.596167:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851870.596168:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851870.596170:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008e7330c6.
00000020:00000010:17.0:1773851870.596171:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851870.596171:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e7170e43.
00000100:00000001:17.0:1773851870.596172:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851870.596173:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851870.596173:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851870.596174:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851870.596175:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851870.596175:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.596176:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851870.596177:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851870.596178:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851870.596178:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851870.596178:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851870.596179:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13121@kfi7, seq: 2156339
00000100:00000040:17.0:1773851870.596179:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b7689d54 : new rpc_count 1
00000100:00000001:16.0:1773851870.596179:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.596180:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129822812800 : -106943886738816 : ffff9ebc2f9eba80)
00000100:00000001:16.0:1773851870.596180:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851870.596181:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007aa1fe04 x1858043557888896/t0(0) o400->473af6ed-6df0-4198-af5a-595bace76183@13121@kfi7:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1316-0'
00000100:00000001:17.0:1773851870.596183:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851870.596184:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851870.596184:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007aa1fe04 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:473af6ed-6df0-4198-af5a-595bace76183+6:39671:x1858043557888896:12345-13121@kfi7:400:default-tuolumne1316-0
00000100:00000200:17.0:1773851870.596185:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043557888896
00000020:00000001:17.0:1773851870.596186:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851870.596187:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851870.596187:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.596188:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851870.596188:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851870.596189:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851870.596190:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043557888896, found 0 last_xid 1858043557888895
00000020:00000001:17.0:1773851870.596191:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851870.596191:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851870.596192:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851870.596192:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.596193:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851870.596194:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851870.596194:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851870.596195:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007aceef1c.
02000000:00000001:17.0:1773851870.596196:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.596196:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.596197:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851870.596198:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688496, transno 0, xid 1858043557888896
00010000:00000001:17.0:1773851870.596199:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851870.596200:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007aa1fe04 x1858043557888896/t0(0) o400->473af6ed-6df0-4198-af5a-595bace76183@13121@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1316-0'
00010000:00000001:17.0:1773851870.596202:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851870.596203:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851870.596204:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=103 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851870.596205:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851870.596205:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006874a5e7 refcount 3 to 13121@kfi7
00000100:00000001:17.0:1773851870.596206:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095776032 : -107152613775584 : ffff9e8b9684e720)
02000000:00000001:17.0:1773851870.596207:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851870.596208:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.596208:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851870.596209:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13121@kfi7
00000400:00000010:17.0:1773851870.596210:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cfc002a6.
00000100:00000200:17.0:1773851870.596211:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043557888896, offset 224
00000400:00000200:17.0:1773851870.596212:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13121@kfi7
00000400:00000200:17.0:1773851870.596213:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13121@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.596213:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 1
00000400:00000200:17.0:1773851870.596214:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 2
00000400:00000200:17.0:1773851870.596215:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 3
00000400:00000200:17.0:1773851870.596216:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13121@kfi7 local destination
00000400:00000200:17.0:1773851870.596218:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769344:8769344:1024:4294967295] 13121@kfi7 LPNI seq info [8579869:8579869:16:4294967295]
00000400:00000200:17.0:1773851870.596219:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 2
00000400:00000200:17.0:1773851870.596220:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13121@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.596222:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13121@kfi7(13121@kfi7:13121@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851870.596223:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 3
00000800:00000200:17.0:1773851870.596224:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.596225:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851870.596228:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851870.596230:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x804 Using peer 13121@kfi7(0x804)
00000800:00000200:17.0:1773851870.596233:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x804: rc=0
00000800:00000200:17.0:1773851870.596234:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x804 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851870.596236:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851870.596237:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006874a5e7 refcount 2 to 13121@kfi7
00010000:00000001:17.0:1773851870.596238:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851870.596238:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.596239:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851870.596240:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007aa1fe04 x1858043557888896/t0(0) o400->473af6ed-6df0-4198-af5a-595bace76183@13121@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1316-0'
00000100:00100000:17.0:1773851870.596243:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007aa1fe04 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:473af6ed-6df0-4198-af5a-595bace76183+6:39671:x1858043557888896:12345-13121@kfi7:400:default-tuolumne1316-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851870.596245:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13121@kfi7, seq: 2156339
00000100:00000040:17.0:1773851870.596246:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b7689d54 : new rpc_count 0
00000100:00000001:17.0:1773851870.596246:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851870.596247:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x804 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851870.596247:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851870.596248:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851870.596248:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e7170e43.
00000400:00000200:18.0:1773851870.596249:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851870.596250:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008e7330c6.
00000020:00000040:17.0:1773851870.596250:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000b7689d54 : new refcount 5
00000100:00000001:17.0:1773851870.596251:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851870.596252:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13121@kfi7: PUT: OK
00000400:00000200:18.0:1773851870.596253:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cfc002a6
00000400:00000010:18.0:1773851870.596254:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cfc002a6.
00000100:00000001:18.0:1773851870.596254:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851870.596255:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851870.596255:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc4b9d2c nid 13121@kfi7 refs 2
00000800:00000200:18.0:1773851870.596257:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 13121@kfi7(00000000448fa197):0x0 lsk 2053 rsk 72 tsk 0 trmk 0 tmk 0 trr 4 tta 0x804 Transaction freed
00000800:00000200:17.0:1773851870.607636:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.607637:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851870.607639:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851870.607642:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851870.607645:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8736@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.607647:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8736@kfi7 : PUT - for me
00000400:00000200:17.0:1773851870.607648:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8736@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.607649:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f98febb3 nid 8736@kfi7 refs 1
00000400:00000200:17.0:1773851870.607651:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8736@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.607652:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f98febb3 nid 8736@kfi7 refs 2
00000400:00000200:17.0:1773851870.607653:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f98febb3 nid 8736@kfi7 refs 3
00000400:00000200:17.0:1773851870.607655:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8736@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.607656:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8736@kfi7 of length 224 into portal 12 MB=0x69b0a395fde40
00000400:00000200:17.0:1773851870.607658:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8736@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 14592
00000800:00000200:17.0:1773851870.607660:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851870.607663:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851870.607664:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8736@kfi7: PUT: OK
00000100:00000001:17.0:1773851870.607666:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851870.607666:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851870.607668:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ba0ea8af.
00000100:00000040:17.0:1773851870.607669:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ba0ea8af x1859318074826304 msgsize 224
00000100:00100000:17.0:1773851870.607671:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8736@kfi7 (source: 12345-8736@kfi7)
00000100:00000001:17.0:1773851870.607673:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851870.607674:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f98febb3 nid 8736@kfi7 refs 2
00000800:00000200:17.0:1773851870.607676:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851870.607680:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851870.607681:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851870.607681:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851870.607682:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851870.607683:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851870.607684:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318074826304
00000020:00000001:17.0:1773851870.607685:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851870.607685:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d65
00000020:00000001:17.0:1773851870.607686:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851870.607688:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8814a46 refcount=11
00000020:00000001:17.0:1773851870.607689:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744184832 : -107128965366784 : ffff9e911812fc00)
00000020:00000001:17.0:1773851870.607690:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744184832 : -107128965366784 : ffff9e911812fc00)
00000100:00000001:17.0:1773851870.607692:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851870.607692:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851870.607693:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008e7330c6.
00000020:00000010:17.0:1773851870.607694:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851870.607695:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e7170e43.
00000100:00000001:17.0:1773851870.607697:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851870.607697:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851870.607698:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851870.607699:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851870.607700:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851870.607700:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.607702:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851870.607703:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851870.607704:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851870.607704:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851870.607705:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8736@kfi7, seq: 2156340
00000100:00000001:16.0:1773851870.607705:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851870.607706:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8814a46 : new rpc_count 2
00000100:00000001:16.0:1773851870.607706:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.607707:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637119505311872 : -106954204239744 : ffff9eb9c8a62880)
00000100:00000001:16.0:1773851870.607707:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851870.607709:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ba0ea8af x1859318074826304/t0(0) o400->474ba743-2457-4a0f-b800-0c7a07b7ce43@8736@kfi7:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1039-0'
00000100:00000001:17.0:1773851870.607713:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851870.607713:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851870.607715:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba0ea8af pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:474ba743-2457-4a0f-b800-0c7a07b7ce43+11:39507:x1859318074826304:12345-8736@kfi7:400:default-tuolumne1039-0
00000100:00000200:17.0:1773851870.607717:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318074826304
00000020:00000001:17.0:1773851870.607718:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851870.607718:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851870.607719:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.607720:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851870.607721:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851870.607722:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851870.607722:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318074826304, found 0 last_xid 1859318074734527
00000020:00000001:17.0:1773851870.607723:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851870.607724:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851870.607730:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851870.607731:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.607732:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851870.607732:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851870.607733:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851870.607734:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dc8faa77.
02000000:00000001:17.0:1773851870.607735:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.607736:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.607737:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851870.607738:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183003585915, transno 0, xid 1859318074826304
00010000:00000001:17.0:1773851870.607739:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851870.607740:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ba0ea8af x1859318074826304/t0(0) o400->474ba743-2457-4a0f-b800-0c7a07b7ce43@8736@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1039-0'
00010000:00000001:17.0:1773851870.607744:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851870.607745:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851870.607745:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=103 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851870.607747:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851870.607748:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f555323c refcount 3 to 8736@kfi7
00000100:00000001:17.0:1773851870.607749:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960608 : -107156125591008 : ffff9e8ac532da20)
02000000:00000001:17.0:1773851870.607750:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851870.607750:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.607751:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851870.607752:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8736@kfi7
00000400:00000010:17.0:1773851870.607753:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000031ca15d6.
00000100:00000200:17.0:1773851870.607754:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318074826304, offset 224
00000400:00000200:17.0:1773851870.607756:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8736@kfi7
00000400:00000200:17.0:1773851870.607758:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8736@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.607759:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f98febb3 nid 8736@kfi7 refs 1
00000400:00000200:17.0:1773851870.607760:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f98febb3 nid 8736@kfi7 refs 2
00000400:00000200:17.0:1773851870.607762:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f98febb3 nid 8736@kfi7 refs 3
00000400:00000200:17.0:1773851870.607763:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8736@kfi7 local destination
00000400:00000200:17.0:1773851870.607765:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769345:8769345:1024:4294967295] 8736@kfi7 LPNI seq info [3226825:3226825:16:4294967295]
00000400:00000200:17.0:1773851870.607767:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f98febb3 nid 8736@kfi7 refs 2
00000400:00000200:17.0:1773851870.607768:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8736@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.607771:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8736@kfi7(8736@kfi7:8736@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851870.607773:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f98febb3 nid 8736@kfi7 refs 3
00000800:00000200:17.0:1773851870.607775:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.607776:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851870.607779:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851870.607783:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x877 Using peer 8736@kfi7(0x877)
00000800:00000200:17.0:1773851870.607787:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x877: rc=0
00000800:00000200:17.0:1773851870.607789:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x877 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851870.607791:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851870.607793:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f555323c refcount 2 to 8736@kfi7
00010000:00000001:17.0:1773851870.607794:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851870.607794:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851870.607795:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851870.607796:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ba0ea8af x1859318074826304/t0(0) o400->474ba743-2457-4a0f-b800-0c7a07b7ce43@8736@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1039-0'
00000100:00100000:17.0:1773851870.607801:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba0ea8af pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:474ba743-2457-4a0f-b800-0c7a07b7ce43+11:39507:x1859318074826304:12345-8736@kfi7:400:default-tuolumne1039-0 Request processed in 87us (131us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851870.607804:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8736@kfi7, seq: 2156340
00000800:00000200:18.0:1773851870.607805:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x877 TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851870.607805:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8814a46 : new rpc_count 1
00000100:00000001:17.0:1773851870.607806:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851870.607807:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851870.607807:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851870.607808:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000400:00000200:18.0:1773851870.607809:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8736@kfi7: PUT: OK
00000020:00000010:17.0:1773851870.607809:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e7170e43.
00000400:00000200:18.0:1773851870.607810:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000031ca15d6
00000020:00000010:17.0:1773851870.607810:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008e7330c6.
00000400:00000010:18.0:1773851870.607811:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000031ca15d6.
00000020:00000040:17.0:1773851870.607811:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000a8814a46 : new refcount 10
00000100:00000001:18.0:1773851870.607812:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851870.607812:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851870.607812:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851870.607813:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f98febb3 nid 8736@kfi7 refs 2
00000800:00000200:18.0:1773851870.607815:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 8736@kfi7(0000000008db2b92):0x0 lsk 2168 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x877 Transaction freed
00000800:00000200:1.0:1773851870.608008:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851870.608009:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851870.608011:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851870.608013:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851870.608015:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26113@kfi7 to cpt 0
00000400:00000200:1.0:1773851870.608017:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26113@kfi7 : PUT - for me
00000400:00000200:1.0:1773851870.608018:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26113@kfi7 to cpt 0
00000400:00000200:1.0:1773851870.608019:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a07f588 nid 26113@kfi7 refs 1
00000400:00000200:1.0:1773851870.608020:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26113@kfi7 to cpt 0
00000400:00000200:1.0:1773851870.608021:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a07f588 nid 26113@kfi7 refs 2
00000400:00000200:1.0:1773851870.608022:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003a07f588 nid 26113@kfi7 refs 3
00000400:00000200:1.0:1773851870.608023:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26113@kfi7 to cpt 0
00000400:00000200:1.0:1773851870.608024:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26113@kfi7 of length 224 into portal 12 MB=0x69b4c3bbc2f40
00000400:00000200:1.0:1773851870.608025:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26113@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 31184
00000800:00000200:1.0:1773851870.608027:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851870.608030:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851870.608031:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26113@kfi7: PUT: OK
00000100:00000001:1.0:1773851870.608032:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851870.608033:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851870.608034:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000073cb91a9.
00000100:00000040:1.0:1773851870.608035:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000073cb91a9 x1859601582272320 msgsize 224
00000100:00100000:1.0:1773851870.608037:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-26113@kfi7 (source: 12345-26113@kfi7)
00000100:00000001:1.0:1773851870.608038:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851870.608039:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003a07f588 nid 26113@kfi7 refs 2
00000100:00000001:0.0:1773851870.608039:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851870.608040:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851870.608041:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851870.608041:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851870.608041:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851870.608042:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851870.608043:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601582272320
00000020:00000001:0.0:1773851870.608043:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851870.608044:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff89dd8
00000020:00000001:0.0:1773851870.608044:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851870.608047:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000059abfdd5 refcount=5
00000020:00000001:0.0:1773851870.608048:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061226047488 : -107012483504128 : ffff9eac36ef2800)
00000020:00000001:0.0:1773851870.608048:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637061226047488 : -107012483504128 : ffff9eac36ef2800)
00000100:00000001:0.0:1773851870.608049:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851870.608050:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851870.608051:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eccd9a8a.
00000020:00000010:0.0:1773851870.608052:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851870.608053:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851870.608053:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851870.608054:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851870.608054:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851870.608055:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851870.608056:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851870.608056:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851870.608057:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851870.608058:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851870.608058:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851870.608058:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851870.608059:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851870.608059:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26113@kfi7, seq: 1997568
00000100:00000001:1.0:1773851870.608060:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851870.608060:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000059abfdd5 : new rpc_count 1
00000100:00000001:1.0:1773851870.608061:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851870.608061:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599709952 : -107004109841664 : ffff9eae2a0b1b00)
00000100:00000040:0.0:1773851870.608062:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000073cb91a9 x1859601582272320/t0(0) o400->0d5fab3d-03ad-4233-b52d-0afe17672156@26113@kfi7:510/0 lens 224/0 e 0 to 0 dl 1773852625 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2131-0'
00000100:00000001:0.0:1773851870.608064:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851870.608065:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851870.608065:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000073cb91a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0d5fab3d-03ad-4233-b52d-0afe17672156+5:39519:x1859601582272320:12345-26113@kfi7:400:default-tuolumne2131-0
00000100:00000200:0.0:1773851870.608069:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601582272320
00000020:00000001:0.0:1773851870.608070:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851870.608070:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851870.608071:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.608072:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851870.608072:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851870.608073:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851870.608073:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601582272320, found 0 last_xid 1859601582272319
00000020:00000001:0.0:1773851870.608074:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851870.608075:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851870.608075:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851870.608076:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.608077:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851870.608077:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851870.608078:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851870.608079:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000080c23c07.
02000000:00000001:0.0:1773851870.608080:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851870.608081:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.608081:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851870.608082:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014006979, transno 0, xid 1859601582272320
00010000:00000001:0.0:1773851870.608083:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851870.608083:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000073cb91a9 x1859601582272320/t0(0) o400->0d5fab3d-03ad-4233-b52d-0afe17672156@26113@kfi7:510/0 lens 224/224 e 0 to 0 dl 1773852625 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2131-0'
00010000:00000001:0.0:1773851870.608086:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851870.608086:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851870.608087:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=103 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851870.608088:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851870.608089:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fc5f5813 refcount 3 to 26113@kfi7
00000100:00000001:0.0:1773851870.608089:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050912 : -107154804500704 : ffff9e8b13f11720)
02000000:00000001:0.0:1773851870.608090:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851870.608091:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851870.608092:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851870.608092:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26113@kfi7
00000400:00000010:0.0:1773851870.608093:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f597ead9.
00000100:00000200:0.0:1773851870.608094:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601582272320, offset 224
00000400:00000200:0.0:1773851870.608096:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26113@kfi7
00000400:00000200:0.0:1773851870.608096:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26113@kfi7 to cpt 0
00000400:00000200:0.0:1773851870.608097:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a07f588 nid 26113@kfi7 refs 1
00000400:00000200:0.0:1773851870.608098:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003a07f588 nid 26113@kfi7 refs 2
00000400:00000200:0.0:1773851870.608099:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003a07f588 nid 26113@kfi7 refs 3
00000400:00000200:0.0:1773851870.608100:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26113@kfi7 local destination
00000400:00000200:0.0:1773851870.608101:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769346:8769346:1024:4294967295] 26113@kfi7 LPNI seq info [2662046:2662046:16:4294967295]
00000400:00000200:0.0:1773851870.608103:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003a07f588 nid 26113@kfi7 refs 2
00000400:00000200:0.0:1773851870.608104:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26113@kfi7 to cpt 0
00000400:00000200:0.0:1773851870.608105:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26113@kfi7(26113@kfi7:26113@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851870.608107:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003a07f588 nid 26113@kfi7 refs 3
00000800:00000200:0.0:1773851870.608108:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851870.608109:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851870.608111:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851870.608113:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2c6 Using peer 26113@kfi7(0x2c6)
00000800:00000200:0.0:1773851870.608116:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x2c6: rc=0
00000800:00000200:0.0:1773851870.608117:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851870.608119:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851870.608120:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fc5f5813 refcount 2 to 26113@kfi7
00010000:00000001:0.0:1773851870.608121:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851870.608121:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851870.608122:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851870.608123:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000073cb91a9 x1859601582272320/t0(0) o400->0d5fab3d-03ad-4233-b52d-0afe17672156@26113@kfi7:510/0 lens 224/224 e 0 to 0 dl 1773852625 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2131-0'
00000100:00100000:0.0:1773851870.608127:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000073cb91a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0d5fab3d-03ad-4233-b52d-0afe17672156+5:39519:x1859601582272320:12345-26113@kfi7:400:default-tuolumne2131-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851870.608129:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26113@kfi7, seq: 1997568
00000100:00000040:0.0:1773851870.608130:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000059abfdd5 : new rpc_count 0
00000100:00000001:0.0:1773851870.608131:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851870.608131:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851870.608132:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851870.608133:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851870.608134:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eccd9a8a.
00000020:00000040:0.0:1773851870.608134:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000059abfdd5 : new refcount 4
00000100:00000001:0.0:1773851870.608135:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851870.608140:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2c6 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851870.608141:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851870.608143:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26113@kfi7: PUT: OK
00000400:00000200:1.0:1773851870.608143:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f597ead9
00000400:00000010:1.0:1773851870.608144:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f597ead9.
00000100:00000001:1.0:1773851870.608144:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851870.608145:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851870.608146:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003a07f588 nid 26113@kfi7 refs 2
00000800:00000200:1.0:1773851870.608147:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 26113@kfi7(00000000d284f3a2):0x0 lsk 711 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2c6 Transaction freed
00000800:00000200:9.0:1773851870.645826:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851870.645827:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851870.645829:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851870.645831:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851870.645833:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12898@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.645834:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12898@kfi7 : PUT - for me
00000400:00000200:9.0:1773851870.645835:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12898@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.645836:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e871c76 nid 12898@kfi7 refs 1
00000400:00000200:9.0:1773851870.645838:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12898@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.645838:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e871c76 nid 12898@kfi7 refs 2
00000400:00000200:9.0:1773851870.645839:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003e871c76 nid 12898@kfi7 refs 3
00000400:00000200:9.0:1773851870.645840:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12963@kfi7 to cpt 1
00000400:00000200:9.0:1773851870.645841:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12963@kfi7 of length 224 into portal 12 MB=0x69a7631f3f100
00000400:00000200:9.0:1773851870.645842:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12963@kfi7 of length 224/224 into md 0x78146ce49 [64] + 138504
00000800:00000200:9.0:1773851870.645844:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851870.645847:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851870.645849:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12898@kfi7: PUT: OK
00000100:00000001:9.0:1773851870.645850:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851870.645850:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851870.645851:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003f1c186d.
00000100:00000040:9.0:1773851870.645852:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003f1c186d x1858682295152896 msgsize 224
00000100:00100000:9.0:1773851870.645853:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-12963@kfi7 (source: 12345-12898@kfi7)
00000100:00000001:9.0:1773851870.645854:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851870.645855:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003e871c76 nid 12898@kfi7 refs 2
00000800:00000200:9.0:1773851870.645857:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851870.645859:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851870.645860:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851870.645860:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851870.645861:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851870.645862:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851870.645863:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858682295152896
00000020:00000001:9.0:1773851870.645863:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851870.645864:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9147c
00000020:00000001:9.0:1773851870.645864:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851870.645868:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a50631d4 refcount=6
00000020:00000001:9.0:1773851870.645868:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240790016 : -107152468761600 : ffff9e8b9f29a400)
00000020:00000001:9.0:1773851870.645869:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240790016 : -107152468761600 : ffff9e8b9f29a400)
00000100:00000001:9.0:1773851870.645870:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851870.645871:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851870.645872:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ede84d6e.
00000020:00000010:9.0:1773851870.645873:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c8fc5a75.
00000020:00000010:9.0:1773851870.645874:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008e3d6b9d.
00000100:00000001:9.0:1773851870.645875:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851870.645875:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851870.645876:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851870.645877:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851870.645877:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851870.645880:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.645880:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851870.645882:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851870.645882:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851870.645882:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851870.645883:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851870.645883:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12963@kfi7, seq: 2130785
00000100:00000001:11.0:1773851870.645884:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851870.645884:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a50631d4 : new rpc_count 1
00000100:00000001:11.0:1773851870.645885:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.645885:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749179520 : -106947960372096 : ffff9ebb3cd00480)
00000100:00000040:9.0:1773851870.645886:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003f1c186d x1858682295152896/t0(0) o400->0ffb06d1-7f4d-42a6-8566-deaf88781216@12963@kfi7:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1292-0'
00000100:00000001:9.0:1773851870.645888:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851870.645889:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851870.645890:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003f1c186d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:0ffb06d1-7f4d-42a6-8566-deaf88781216+6:39757:x1858682295152896:12345-12963@kfi7:400:default-tuolumne1292-0
00000100:00000200:9.0:1773851870.645891:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858682295152896
00000020:00000001:9.0:1773851870.645892:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851870.645893:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851870.645893:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.645894:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851870.645894:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851870.645895:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851870.645896:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858682295152896, found 0 last_xid 1858682295152895
00000020:00000001:9.0:1773851870.645897:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851870.645897:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851870.645898:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851870.645898:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.645899:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851870.645900:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851870.645900:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851870.645901:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001372a781.
02000000:00000001:9.0:1773851870.645902:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.645902:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.645903:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851870.645903:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096703737, transno 0, xid 1858682295152896
00010000:00000001:9.0:1773851870.645904:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851870.645906:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003f1c186d x1858682295152896/t0(0) o400->0ffb06d1-7f4d-42a6-8566-deaf88781216@12963@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1292-0'
00010000:00000001:9.0:1773851870.645908:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851870.645909:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851870.645910:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=103 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851870.645911:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851870.645912:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000055347981 refcount 3 to 12963@kfi7
00000100:00000001:9.0:1773851870.645912:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405409792 : -107145304141824 : ffff9e8d4a351000)
02000000:00000001:9.0:1773851870.645913:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851870.645914:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851870.645915:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851870.645915:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12898@kfi7
00000400:00000010:9.0:1773851870.645916:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000087a60580.
00000100:00000200:9.0:1773851870.645917:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858682295152896, offset 224
00000400:00000200:9.0:1773851870.645918:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12898@kfi7
00000400:00000200:9.0:1773851870.645919:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12898@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.645920:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e871c76 nid 12898@kfi7 refs 1
00000400:00000200:9.0:1773851870.645921:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003e871c76 nid 12898@kfi7 refs 2
00000400:00000200:9.0:1773851870.645922:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003e871c76 nid 12898@kfi7 refs 3
00000400:00000200:9.0:1773851870.645923:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12898@kfi7 local destination
00000400:00000200:9.0:1773851870.645924:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769347:8769347:1024:4294967295] 12898@kfi7 LPNI seq info [11114622:11114622:16:4294967295]
00000400:00000200:9.0:1773851870.645926:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003e871c76 nid 12898@kfi7 refs 2
00000400:00000200:9.0:1773851870.645926:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12898@kfi7 to cpt 2
00000400:00000200:9.0:1773851870.645928:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12898@kfi7(12898@kfi7:12898@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851870.645930:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003e871c76 nid 12898@kfi7 refs 3
00000800:00000200:9.0:1773851870.645931:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851870.645932:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851870.645934:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851870.645936:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f6c Using peer 12898@kfi7(0x100000000000f6c)
00000800:00000200:9.0:1773851870.645939:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x100000000000f6c: rc=0
00000800:00000200:9.0:1773851870.645941:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f6c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851870.645943:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851870.645944:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000055347981 refcount 2 to 12963@kfi7
00010000:00000001:9.0:1773851870.645945:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851870.645945:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851870.645946:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851870.645947:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003f1c186d x1858682295152896/t0(0) o400->0ffb06d1-7f4d-42a6-8566-deaf88781216@12963@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1292-0'
00000100:00100000:9.0:1773851870.645950:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003f1c186d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:0ffb06d1-7f4d-42a6-8566-deaf88781216+6:39757:x1858682295152896:12345-12963@kfi7:400:default-tuolumne1292-0 Request processed in 60us (97us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851870.645952:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12963@kfi7, seq: 2130785
00000100:00000040:9.0:1773851870.645953:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a50631d4 : new rpc_count 0
00000100:00000001:9.0:1773851870.645954:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851870.645955:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851870.645955:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c8fc5a75.
00000800:00000200:11.0:1773851870.645956:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f6c TN_EVENT_TX_OK event status 0
00000020:00000010:9.0:1773851870.645956:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008e3d6b9d.
00000020:00000010:9.0:1773851870.645957:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ede84d6e.
00000400:00000200:11.0:1773851870.645958:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:9.0:1773851870.645958:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000a50631d4 : new refcount 5
00000100:00000001:9.0:1773851870.645959:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:11.0:1773851870.645960:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12898@kfi7: PUT: OK
00000400:00000200:11.0:1773851870.645961:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000087a60580
00000400:00000010:11.0:1773851870.645962:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000087a60580.
00000100:00000001:11.0:1773851870.645963:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851870.645963:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851870.645964:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003e871c76 nid 12898@kfi7 refs 2
00000800:00000200:11.0:1773851870.645966:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12898@kfi7(0000000018bdbacd):0x0 lsk 3949 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f6c Transaction freed
00000800:00000200:29.0:1773851870.771681:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851870.771682:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851870.771684:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851870.771688:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851870.771691:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15651@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.771693:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15651@kfi7 : PUT - for me
00000400:00000200:29.0:1773851870.771695:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15651@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.771696:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025531ffa nid 15651@kfi7 refs 1
00000400:00000200:29.0:1773851870.771699:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15651@kfi7 to cpt 7
00000400:00000200:29.0:1773851870.771700:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025531ffa nid 15651@kfi7 refs 2
00000400:00000200:29.0:1773851870.771701:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000025531ffa nid 15651@kfi7 refs 3
00000400:00000200:29.0:1773851870.771703:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15843@kfi7 to cpt 2
00000400:00000200:29.0:1773851870.771704:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15843@kfi7 of length 224 into portal 12 MB=0x69b4b57af8a00
00000400:00000200:29.0:1773851870.771707:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15843@kfi7 of length 224/224 into md 0x77fe139dd [64] + 177768
00000800:00000200:29.0:1773851870.771710:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851870.771712:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851870.771714:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15651@kfi7: PUT: OK
00000100:00000001:29.0:1773851870.771716:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851870.771716:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851870.771718:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000475f095e.
00000100:00000040:29.0:1773851870.771719:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000475f095e x1859597756238336 msgsize 224
00000100:00100000:29.0:1773851870.771721:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15843@kfi7 (source: 12345-15651@kfi7)
00000100:00000001:29.0:1773851870.771723:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851870.771730:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000025531ffa nid 15651@kfi7 refs 2
00000100:00000001:28.0:1773851870.771730:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851870.771731:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851870.771732:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851870.771732:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851870.771733:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851870.771734:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851870.771736:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597756238336
00000020:00000001:28.0:1773851870.771737:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851870.771738:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81bed
00000020:00000001:28.0:1773851870.771739:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851870.771742:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003a964e3a refcount=7
00000020:00000001:28.0:1773851870.771743:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127342097408 : -106946367454208 : ffff9ebb9bc20400)
00000020:00000001:28.0:1773851870.771744:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127342097408 : -106946367454208 : ffff9ebb9bc20400)
00000100:00000001:28.0:1773851870.771746:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851870.771747:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851870.771748:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000027a2a550.
00000020:00000010:28.0:1773851870.771750:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851870.771752:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bbecb31a.
00000100:00000001:28.0:1773851870.771754:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851870.771754:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851870.771755:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851870.771757:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851870.771758:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851870.771759:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851870.771761:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851870.771763:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851870.771763:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851870.771764:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851870.771764:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851870.771765:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15843@kfi7, seq: 2055530
00000100:00000040:31.0:1773851870.771766:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003a964e3a : new rpc_count 1
00000100:00000001:31.0:1773851870.771766:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309667584 : -106988399884032 : ffff9eb1d26e0900)
00000100:00000001:28.0:1773851870.771766:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851870.771767:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851870.771768:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000475f095e x1859597756238336/t0(0) o400->463f1138-5013-4bdc-85c4-9db5cba3e1f5@15843@kfi7:658/0 lens 224/0 e 0 to 0 dl 1773852018 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1467-0'
00000100:00000001:31.0:1773851870.771771:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851870.771771:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851870.771772:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000475f095e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:463f1138-5013-4bdc-85c4-9db5cba3e1f5+7:39740:x1859597756238336:12345-15843@kfi7:400:default-tuolumne1467-0
00000100:00000200:31.0:1773851870.771773:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597756238336
00000020:00000001:31.0:1773851870.771774:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851870.771776:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851870.771776:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851870.771777:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851870.771778:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851870.771778:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851870.771779:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597756238336, found 0 last_xid 1859597756238335
00000020:00000001:31.0:1773851870.771780:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851870.771781:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851870.771781:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851870.771782:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851870.771782:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851870.771783:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851870.771784:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851870.771785:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000047470845.
02000000:00000001:31.0:1773851870.771785:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851870.771786:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851870.771787:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851870.771787:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181926758905, transno 0, xid 1859597756238336
00010000:00000001:31.0:1773851870.771788:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851870.771789:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000475f095e x1859597756238336/t0(0) o400->463f1138-5013-4bdc-85c4-9db5cba3e1f5@15843@kfi7:658/0 lens 224/224 e 0 to 0 dl 1773852018 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1467-0'
00010000:00000001:31.0:1773851870.771791:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851870.771792:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851870.771793:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=103 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851870.771794:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851870.771795:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a12952c0 refcount 3 to 15843@kfi7
00000100:00000001:31.0:1773851870.771796:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274738240 : -107155434813376 : ffff9e8aee5f4840)
02000000:00000001:31.0:1773851870.771796:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851870.771797:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851870.771798:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851870.771798:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15651@kfi7
00000400:00000010:31.0:1773851870.771799:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000100:00000200:31.0:1773851870.771800:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597756238336, offset 224
00000400:00000200:31.0:1773851870.771802:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15651@kfi7
00000400:00000200:31.0:1773851870.771803:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15651@kfi7 to cpt 7
00000400:00000200:31.0:1773851870.771805:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000025531ffa nid 15651@kfi7 refs 1
00000400:00000200:31.0:1773851870.771806:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000025531ffa nid 15651@kfi7 refs 2
00000400:00000200:31.0:1773851870.771807:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000025531ffa nid 15651@kfi7 refs 3
00000400:00000200:31.0:1773851870.771809:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15651@kfi7 local destination
00000400:00000200:31.0:1773851870.771810:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769348:8769348:1024:4294967295] 15651@kfi7 LPNI seq info [70649:70649:16:4294967295]
00000400:00000200:31.0:1773851870.771812:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000025531ffa nid 15651@kfi7 refs 2
00000400:00000200:31.0:1773851870.771812:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15651@kfi7 to cpt 7
00000400:00000200:31.0:1773851870.771815:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15651@kfi7(15651@kfi7:15651@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851870.771816:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000025531ffa nid 15651@kfi7 refs 3
00000800:00000200:31.0:1773851870.771817:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851870.771818:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851870.771821:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851870.771823:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x519 Using peer 15651@kfi7(0x519)
00000800:00000200:31.0:1773851870.771826:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x519: rc=0
00000800:00000200:31.0:1773851870.771828:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x519 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851870.771830:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851870.771831:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a12952c0 refcount 2 to 15843@kfi7
00010000:00000001:31.0:1773851870.771832:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851870.771832:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851870.771833:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851870.771834:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000475f095e x1859597756238336/t0(0) o400->463f1138-5013-4bdc-85c4-9db5cba3e1f5@15843@kfi7:658/0 lens 224/224 e 0 to 0 dl 1773852018 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1467-0'
00000100:00100000:31.0:1773851870.771837:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000475f095e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:463f1138-5013-4bdc-85c4-9db5cba3e1f5+7:39740:x1859597756238336:12345-15843@kfi7:400:default-tuolumne1467-0 Request processed in 65us (117us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851870.771840:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15843@kfi7, seq: 2055530
00000100:00000040:31.0:1773851870.771841:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003a964e3a : new rpc_count 0
00000100:00000001:31.0:1773851870.771841:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851870.771842:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851870.771843:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851870.771844:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bbecb31a.
00000800:00000200:29.0:1773851870.771844:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x519 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851870.771845:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000027a2a550.
00000020:00000040:31.0:1773851870.771846:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000003a964e3a : new refcount 6
00000100:00000001:31.0:1773851870.771847:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851870.771849:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851870.771851:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15651@kfi7: PUT: OK
00000400:00000200:29.0:1773851870.771852:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000400:00000010:29.0:1773851870.771853:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000100:00000001:29.0:1773851870.771855:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851870.771855:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851870.771857:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000025531ffa nid 15651@kfi7 refs 2
00000800:00000200:29.0:1773851870.771859:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 15651@kfi7(00000000d845dd01):0x0 lsk 1306 rsk 38 tsk 0 trmk 0 tmk 0 trr 7 tta 0x519 Transaction freed
00000800:00000200:6.0:1773851870.871369:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851870.871370:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851870.871371:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851870.871374:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851870.871378:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:6.0:1773851870.871380:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17856@kfi7 : PUT - for me
00000400:00000200:6.0:1773851870.871382:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:6.0:1773851870.871384:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 1
00000400:00000200:6.0:1773851870.871386:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:6.0:1773851870.871387:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000400:00000200:6.0:1773851870.871389:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 3
00000400:00000200:6.0:1773851870.871390:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17857@kfi7 to cpt 4
00000400:00000200:6.0:1773851870.871392:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17857@kfi7 of length 456 into portal 12 MB=0x69b4b6df25700
00000400:00000200:6.0:1773851870.871395:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17857@kfi7 of length 456/456 into md 0x793926dc5 [64] + 138144
00000800:00000200:6.0:1773851870.871399:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851870.871402:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851870.871404:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17856@kfi7: PUT: OK
00000100:00000001:6.0:1773851870.871406:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851870.871407:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851870.871408:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009336a1a7.
00000100:00000040:6.0:1773851870.871410:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000009336a1a7 x1859598129714944 msgsize 456
00000100:00100000:6.0:1773851870.871412:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-17857@kfi7 (source: 12345-17856@kfi7)
00000100:00000001:6.0:1773851870.871414:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851870.871416:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000100:00000001:7.0:1773851870.871417:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851870.871418:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851870.871419:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851870.871419:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851870.871420:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851870.871421:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851870.871423:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598129714944
00000020:00000001:7.0:1773851870.871424:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851870.871425:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d823f0
00000020:00000001:7.0:1773851870.871426:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851870.871429:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000efeb0282 refcount=5
00000020:00000001:7.0:1773851870.871430:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113519895552 : -106960189656064 : ffff9eb863e3f400)
00000020:00000001:7.0:1773851870.871432:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113519895552 : -106960189656064 : ffff9eb863e3f400)
00000100:00000001:7.0:1773851870.871434:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851870.871435:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851870.871436:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002faae425.
00000020:00000010:7.0:1773851870.871438:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851870.871441:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851870.871442:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851870.871443:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851870.871444:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.871445:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851870.871447:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.871449:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851870.871449:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851870.871449:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851870.871450:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851870.871451:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17857@kfi7, seq: 371100844
00000100:00000001:7.0:1773851870.871452:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851870.871452:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000efeb0282 : new rpc_count 1
00000100:00000001:7.0:1773851870.871453:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.871453:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814079616 : -107101895472000 : ffff9e976590cc80)
00000100:00000040:5.0:1773851870.871455:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009336a1a7 x1859598129714944/t0(0) o17->3ad08b5b-2689-45cc-a13e-39e9ab54de14@17857@kfi7:597/0 lens 456/0 e 0 to 0 dl 1773851957 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1603-0'
00000100:00000001:5.0:1773851870.871458:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851870.871459:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851870.871460:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009336a1a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3ad08b5b-2689-45cc-a13e-39e9ab54de14+5:39754:x1859598129714944:12345-17857@kfi7:17:default-tuolumne1603-0
00000100:00000200:5.0:1773851870.871462:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598129714944
00000020:00000001:5.0:1773851870.871463:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851870.871464:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851870.871465:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.871465:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851870.871466:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:5.0:1773851870.871467:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851870.871468:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598129714944, found 0 last_xid 1859598129714943
00000020:00000001:5.0:1773851870.871469:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851870.871470:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851870.871471:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851870.871471:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851870.871472:0:61015:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:5.0:1773851870.871473:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851870.871474:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851870.871475:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000c7b1178f.
02000000:00000001:5.0:1773851870.871476:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.871477:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.871478:0:61015:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:5.0:1773851870.871479:0:61015:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:5.0:1773851870.871479:0:61015:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:5.0:1773851870.871481:0:61015:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.871482:0:61015:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:5.0:1773851870.871483:0:61015:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 3ad08b5b-2689-45cc-a13e-39e9ab54de14/00000000efeb0282 free: 126633370845184 avail: 126633368748032
00000020:00000001:5.0:1773851870.871484:0:61015:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:5.0:1773851870.871484:0:61015:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 3ad08b5b-2689-45cc-a13e-39e9ab54de14/00000000efeb0282 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:5.0:1773851870.871486:0:61015:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:5.0:1773851870.871487:0:61015:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:5.0:1773851870.871487:0:61015:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 3ad08b5b-2689-45cc-a13e-39e9ab54de14/00000000efeb0282 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:5.0:1773851870.871488:0:61015:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:5.0:1773851870.871488:0:61015:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:5.0:1773851870.871489:0:61015:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851870.871490:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596409, transno 0, xid 1859598129714944
00010000:00000001:5.0:1773851870.871491:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851870.871492:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009336a1a7 x1859598129714944/t0(0) o17->3ad08b5b-2689-45cc-a13e-39e9ab54de14@17857@kfi7:597/0 lens 456/432 e 0 to 0 dl 1773851957 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1603-0'
00010000:00000001:5.0:1773851870.871495:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851870.871495:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851870.871496:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=102 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851870.871497:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851870.871498:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000f995cbf refcount 3 to 17857@kfi7
00000100:00000001:5.0:1773851870.871499:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583864192 : -107156125687424 : ffff9e8ac5316180)
02000000:00000001:5.0:1773851870.871500:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851870.871501:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.871501:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851870.871502:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17856@kfi7
00000400:00000010:5.0:1773851870.871503:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081188a2f.
00000100:00000200:5.0:1773851870.871504:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598129714944, offset 224
00000400:00000200:5.0:1773851870.871505:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17856@kfi7
00000400:00000200:5.0:1773851870.871507:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.871507:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 1
00000400:00000200:5.0:1773851870.871509:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000400:00000200:5.0:1773851870.871510:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 3
00000400:00000200:5.0:1773851870.871512:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17856@kfi7 local destination
00000400:00000200:5.0:1773851870.871513:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769349:8769349:1024:4294967295] 17856@kfi7 LPNI seq info [3445352:3445352:16:4294967295]
00000400:00000200:5.0:1773851870.871515:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000400:00000200:5.0:1773851870.871516:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17856@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.871518:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17856@kfi7(17856@kfi7:17856@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851870.871520:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 3
00000800:00000200:5.0:1773851870.871521:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851870.871522:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:5.0:1773851870.871524:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851870.871526:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000113e Using peer 17856@kfi7(0x10000000000113e)
00000800:00000200:5.0:1773851870.871529:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 532 bytes to peer 0x10000000000113e: rc=0
00000800:00000200:5.0:1773851870.871531:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000113e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851870.871533:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851870.871534:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000f995cbf refcount 2 to 17857@kfi7
00010000:00000001:5.0:1773851870.871534:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851870.871535:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.871535:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851870.871536:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009336a1a7 x1859598129714944/t0(0) o17->3ad08b5b-2689-45cc-a13e-39e9ab54de14@17857@kfi7:597/0 lens 456/432 e 0 to 0 dl 1773851957 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1603-0'
00000100:00100000:5.0:1773851870.871539:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009336a1a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3ad08b5b-2689-45cc-a13e-39e9ab54de14+5:39754:x1859598129714944:12345-17857@kfi7:17:default-tuolumne1603-0 Request processed in 80us (129us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851870.871541:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17857@kfi7, seq: 371100844
00000100:00000040:5.0:1773851870.871542:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000efeb0282 : new rpc_count 0
00000100:00000001:5.0:1773851870.871543:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851870.871543:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851870.871544:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:5.0:1773851870.871545:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000020:00000010:5.0:1773851870.871546:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002faae425.
00000800:00000200:6.0:1773851870.871547:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000113e TN_EVENT_TX_OK event status 0
00000020:00000040:5.0:1773851870.871547:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000efeb0282 : new refcount 4
00000100:00000001:5.0:1773851870.871548:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851870.871549:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851870.871551:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17856@kfi7: PUT: OK
00000400:00000200:6.0:1773851870.871552:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081188a2f
00000400:00000010:6.0:1773851870.871553:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081188a2f.
00000100:00000001:6.0:1773851870.871554:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851870.871555:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851870.871556:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000de83d48 nid 17856@kfi7 refs 2
00000800:00000200:6.0:1773851870.871559:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2054@kfi7:1 -> 17856@kfi7(00000000194b3972):0x0 lsk 4415 rsk 3 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000113e Transaction freed
00000800:00000200:17.0:1773851870.924438:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851870.924439:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851870.924441:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851870.924443:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851870.924445:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8880@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.924446:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8880@kfi7 : PUT - for me
00000400:00000200:17.0:1773851870.924447:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8880@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.924448:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005eb5704 nid 8880@kfi7 refs 1
00000400:00000200:17.0:1773851870.924449:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8880@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.924450:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005eb5704 nid 8880@kfi7 refs 2
00000400:00000200:17.0:1773851870.924451:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000005eb5704 nid 8880@kfi7 refs 3
00000400:00000200:17.0:1773851870.924452:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8817@kfi7 to cpt 4
00000400:00000200:17.0:1773851870.924453:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8817@kfi7 of length 224 into portal 12 MB=0x69b08bb422dc0
00000400:00000200:17.0:1773851870.924454:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8817@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 14816
00000800:00000200:17.0:1773851870.924457:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851870.924458:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851870.924459:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8880@kfi7: PUT: OK
00000100:00000001:17.0:1773851870.924460:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851870.924461:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851870.924462:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000480408e4.
00000100:00000040:17.0:1773851870.924463:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000480408e4 x1859311663984064 msgsize 224
00000100:00100000:17.0:1773851870.924465:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8817@kfi7 (source: 12345-8880@kfi7)
00000100:00000001:17.0:1773851870.924467:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851870.924468:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000005eb5704 nid 8880@kfi7 refs 2
00000800:00000200:17.0:1773851870.924469:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851870.924472:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851870.924472:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851870.924473:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851870.924474:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851870.924475:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851870.924476:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859311663984064
00000020:00000001:17.0:1773851870.924477:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851870.924478:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92737
00000020:00000001:17.0:1773851870.924479:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851870.924482:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000959b50e0 refcount=11
00000020:00000001:17.0:1773851870.924484:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631254016 : -107123078297600 : ffff9e9276f88800)
00000020:00000001:17.0:1773851870.924485:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631254016 : -107123078297600 : ffff9e9276f88800)
00000100:00000001:17.0:1773851870.924486:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851870.924488:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851870.924489:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008e7330c6.
00000020:00000010:17.0:1773851870.924490:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851870.924492:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e7170e43.
00000100:00000001:17.0:1773851870.924493:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851870.924494:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851870.924495:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851870.924497:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851870.924497:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851870.924498:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851870.924500:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851870.924502:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851870.924502:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851870.924503:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851870.924503:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851870.924505:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8817@kfi7, seq: 2156341
00000100:00000001:17.0:1773851870.924506:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851870.924506:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000959b50e0 : new rpc_count 2
00000100:00000001:17.0:1773851870.924507:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851870.924507:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637092128962048 : -106981580589568 : ffff9eb368e43600)
00000100:00000040:16.0:1773851870.924508:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000480408e4 x1859311663984064/t0(0) o400->1b454b22-87b3-43e4-af26-776c4b50e7a5@8817@kfi7:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1038-0'
00000100:00000001:16.0:1773851870.924512:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851870.924513:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851870.924514:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000480408e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1b454b22-87b3-43e4-af26-776c4b50e7a5+11:39765:x1859311663984064:12345-8817@kfi7:400:default-tuolumne1038-0
00000100:00000200:16.0:1773851870.924515:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859311663984064
00000020:00000001:16.0:1773851870.924516:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851870.924517:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851870.924518:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851870.924519:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851870.924519:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851870.924520:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851870.924521:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859311663984064, found 0 last_xid 1859311663892223
00000020:00000001:16.0:1773851870.924522:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851870.924523:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851870.924523:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851870.924524:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851870.924525:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851870.924526:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851870.924527:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851870.924531:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007773209b.
02000000:00000001:16.0:1773851870.924532:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851870.924533:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851870.924533:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851870.924534:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183003241086, transno 0, xid 1859311663984064
00010000:00000001:16.0:1773851870.924535:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851870.924536:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000480408e4 x1859311663984064/t0(0) o400->1b454b22-87b3-43e4-af26-776c4b50e7a5@8817@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1038-0'
00010000:00000001:16.0:1773851870.924540:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851870.924540:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851870.924541:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=103 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851870.924543:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851870.924543:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000007bda405 refcount 3 to 8817@kfi7
00000100:00000001:16.0:1773851870.924544:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583953280 : -107156125598336 : ffff9e8ac532bd80)
02000000:00000001:16.0:1773851870.924545:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851870.924546:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851870.924547:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851870.924548:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8880@kfi7
00000400:00000010:16.0:1773851870.924549:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cbd52aa0.
00000100:00000200:16.0:1773851870.924550:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859311663984064, offset 224
00000400:00000200:16.0:1773851870.924552:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8880@kfi7
00000400:00000200:16.0:1773851870.924553:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8880@kfi7 to cpt 4
00000400:00000200:16.0:1773851870.924554:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005eb5704 nid 8880@kfi7 refs 1
00000400:00000200:16.0:1773851870.924556:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000005eb5704 nid 8880@kfi7 refs 2
00000400:00000200:16.0:1773851870.924557:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000005eb5704 nid 8880@kfi7 refs 3
00000400:00000200:16.0:1773851870.924559:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8880@kfi7 local destination
00000400:00000200:16.0:1773851870.924560:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769350:8769350:1024:4294967295] 8880@kfi7 LPNI seq info [2223483:2223483:16:4294967295]
00000400:00000200:16.0:1773851870.924562:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000005eb5704 nid 8880@kfi7 refs 2
00000400:00000200:16.0:1773851870.924563:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8880@kfi7 to cpt 4
00000400:00000200:16.0:1773851870.924565:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8880@kfi7(8880@kfi7:8880@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851870.924567:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000005eb5704 nid 8880@kfi7 refs 3
00000800:00000200:16.0:1773851870.924569:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851870.924570:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851870.924573:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851870.924576:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x129 Using peer 8880@kfi7(0x129)
00000800:00000200:16.0:1773851870.924580:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0x129: rc=0
00000800:00000200:16.0:1773851870.924582:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x129 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851870.924584:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851870.924585:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000007bda405 refcount 2 to 8817@kfi7
00010000:00000001:16.0:1773851870.924586:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851870.924587:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851870.924588:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851870.924589:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000480408e4 x1859311663984064/t0(0) o400->1b454b22-87b3-43e4-af26-776c4b50e7a5@8817@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1038-0'
00000100:00100000:16.0:1773851870.924594:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000480408e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1b454b22-87b3-43e4-af26-776c4b50e7a5+11:39765:x1859311663984064:12345-8817@kfi7:400:default-tuolumne1038-0 Request processed in 81us (130us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851870.924598:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8817@kfi7, seq: 2156341
00000100:00000040:16.0:1773851870.924598:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000959b50e0 : new rpc_count 1
00000100:00000001:16.0:1773851870.924599:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851870.924600:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851870.924601:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:16.0:1773851870.924602:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e7170e43.
00000020:00000010:16.0:1773851870.924603:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008e7330c6.
00000020:00000040:16.0:1773851870.924604:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000959b50e0 : new refcount 10
00000100:00000001:16.0:1773851870.924605:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851870.924611:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x129 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851870.924613:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851870.924614:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8880@kfi7: PUT: OK
00000400:00000200:18.0:1773851870.924615:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cbd52aa0
00000400:00000010:18.0:1773851870.924616:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cbd52aa0.
00000100:00000001:18.0:1773851870.924617:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851870.924617:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851870.924618:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000005eb5704 nid 8880@kfi7 refs 2
00000800:00000200:18.0:1773851870.924620:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8880@kfi7(00000000a695c98e):0x0 lsk 298 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x129 Transaction freed
00000800:00000200:5.0:1773851870.949124:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851870.949126:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851870.949128:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851870.949131:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851870.949135:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11730@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.949137:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11730@kfi7 : PUT - for me
00000400:00000200:5.0:1773851870.949138:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11730@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.949140:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065190a05 nid 11730@kfi7 refs 1
00000400:00000200:5.0:1773851870.949141:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11730@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.949142:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065190a05 nid 11730@kfi7 refs 2
00000400:00000200:5.0:1773851870.949144:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000065190a05 nid 11730@kfi7 refs 3
00000400:00000200:5.0:1773851870.949145:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11538@kfi7 to cpt 7
00000400:00000200:5.0:1773851870.949147:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11538@kfi7 of length 224 into portal 12 MB=0x69b09eee8fa00
00000400:00000200:5.0:1773851870.949149:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11538@kfi7 of length 224/224 into md 0x793926dc5 [64] + 138600
00000800:00000200:5.0:1773851870.949152:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851870.949155:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851870.949157:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11730@kfi7: PUT: OK
00000100:00000001:5.0:1773851870.949158:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851870.949159:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851870.949160:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003540135e.
00000100:00000040:5.0:1773851870.949161:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000003540135e x1859316825520640 msgsize 224
00000100:00100000:5.0:1773851870.949164:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-11538@kfi7 (source: 12345-11730@kfi7)
00000100:00000001:5.0:1773851870.949166:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851870.949168:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000065190a05 nid 11730@kfi7 refs 2
00000800:00000200:5.0:1773851870.949171:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851870.949176:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851870.949177:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851870.949177:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851870.949178:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851870.949180:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851870.949181:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316825520640
00000020:00000001:5.0:1773851870.949182:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851870.949183:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916ba
00000020:00000001:5.0:1773851870.949184:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851870.949187:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000af5d9f56 refcount=6
00000020:00000001:5.0:1773851870.949189:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241497600 : -107152468054016 : ffff9e8b9f347000)
00000020:00000001:5.0:1773851870.949190:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241497600 : -107152468054016 : ffff9e8b9f347000)
00000100:00000001:5.0:1773851870.949191:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851870.949193:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851870.949194:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000020:00000010:5.0:1773851870.949196:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851870.949197:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000699dfc15.
00000100:00000001:5.0:1773851870.949199:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851870.949199:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851870.949200:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851870.949202:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:5.0:1773851870.949203:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851870.949204:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.949206:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851870.949208:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851870.949208:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851870.949209:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851870.949209:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851870.949211:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11538@kfi7, seq: 2001927
00000100:00000001:7.0:1773851870.949212:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851870.949212:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000af5d9f56 : new rpc_count 1
00000100:00000001:7.0:1773851870.949213:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.949213:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886787712 : -106955822763904 : ffff9eb9682d7080)
00000100:00000040:5.0:1773851870.949214:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003540135e x1859316825520640/t0(0) o400->3c69df87-bcc0-424a-93ce-50a75b9f21f0@11538@kfi7:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1221-0'
00000100:00000001:5.0:1773851870.949219:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851870.949222:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851870.949223:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003540135e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3c69df87-bcc0-424a-93ce-50a75b9f21f0+6:39548:x1859316825520640:12345-11538@kfi7:400:default-tuolumne1221-0
00000100:00000200:5.0:1773851870.949226:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316825520640
00000020:00000001:5.0:1773851870.949227:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851870.949228:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851870.949229:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.949230:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851870.949231:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:5.0:1773851870.949232:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:5.0:1773851870.949233:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316825520640, found 0 last_xid 1859316825520639
00000020:00000001:5.0:1773851870.949234:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851870.949235:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851870.949236:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851870.949236:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.949237:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:5.0:1773851870.949239:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851870.949239:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851870.949242:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0852167.
02000000:00000001:5.0:1773851870.949244:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.949245:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.949246:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851870.949247:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096675450, transno 0, xid 1859316825520640
00010000:00000001:5.0:1773851870.949248:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851870.949250:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003540135e x1859316825520640/t0(0) o400->3c69df87-bcc0-424a-93ce-50a75b9f21f0@11538@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1221-0'
00010000:00000001:5.0:1773851870.949254:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851870.949255:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851870.949256:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=102 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851870.949258:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851870.949260:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6b4aa4 refcount 3 to 11538@kfi7
00000100:00000001:5.0:1773851870.949261:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066432 : -107155994485184 : ffff9e8acd035e40)
02000000:00000001:5.0:1773851870.949262:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851870.949263:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851870.949265:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851870.949266:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11730@kfi7
00000400:00000010:5.0:1773851870.949267:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d4e64133.
00000100:00000200:5.0:1773851870.949268:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316825520640, offset 224
00000400:00000200:5.0:1773851870.949270:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11730@kfi7
00000400:00000200:5.0:1773851870.949272:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11730@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.949273:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065190a05 nid 11730@kfi7 refs 1
00000400:00000200:5.0:1773851870.949274:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000065190a05 nid 11730@kfi7 refs 2
00000400:00000200:5.0:1773851870.949276:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000065190a05 nid 11730@kfi7 refs 3
00000400:00000200:5.0:1773851870.949278:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11730@kfi7 local destination
00000400:00000200:5.0:1773851870.949280:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769351:8769351:1024:4294967295] 11730@kfi7 LPNI seq info [369456:369456:16:4294967295]
00000400:00000200:5.0:1773851870.949283:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000065190a05 nid 11730@kfi7 refs 2
00000400:00000200:5.0:1773851870.949284:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11730@kfi7 to cpt 1
00000400:00000200:5.0:1773851870.949287:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11730@kfi7(11730@kfi7:11730@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851870.949289:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000065190a05 nid 11730@kfi7 refs 3
00000800:00000200:5.0:1773851870.949290:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851870.949292:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851870.949296:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851870.949299:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb43 Using peer 11730@kfi7(0xb43)
00000800:00000200:5.0:1773851870.949304:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0xb43: rc=0
00000800:00000200:5.0:1773851870.949306:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb43 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851870.949309:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851870.949311:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6b4aa4 refcount 2 to 11538@kfi7
00010000:00000001:5.0:1773851870.949312:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851870.949313:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851870.949314:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851870.949315:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003540135e x1859316825520640/t0(0) o400->3c69df87-bcc0-424a-93ce-50a75b9f21f0@11538@kfi7:597/0 lens 224/224 e 0 to 0 dl 1773851957 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1221-0'
00000100:00100000:5.0:1773851870.949321:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003540135e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3c69df87-bcc0-424a-93ce-50a75b9f21f0+6:39548:x1859316825520640:12345-11538@kfi7:400:default-tuolumne1221-0 Request processed in 100us (158us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851870.949322:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb43 TN_EVENT_TX_OK event status 0
00000100:00100000:5.0:1773851870.949324:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11538@kfi7, seq: 2001927
00000400:00000200:6.0:1773851870.949325:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851870.949326:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11730@kfi7: PUT: OK
00000100:00000040:5.0:1773851870.949326:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000af5d9f56 : new rpc_count 0
00000400:00000200:6.0:1773851870.949327:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d4e64133
00000100:00000001:5.0:1773851870.949327:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:6.0:1773851870.949328:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d4e64133.
00000100:00000001:5.0:1773851870.949328:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851870.949328:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00000001:6.0:1773851870.949330:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851870.949330:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:5.0:1773851870.949330:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000699dfc15.
00000020:00000010:5.0:1773851870.949331:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000400:00000200:6.0:1773851870.949332:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000065190a05 nid 11730@kfi7 refs 2
00000020:00000040:5.0:1773851870.949333:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000af5d9f56 : new refcount 5
00000800:00000200:6.0:1773851870.949334:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 11730@kfi7(00000000a7e87903):0x0 lsk 2884 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb43 Transaction freed
00000100:00000001:5.0:1773851870.949334:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851870.954845:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851870.954847:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851870.954849:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851870.954854:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851870.954859:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851870.954861:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:25.0:1773851870.954863:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851870.954864:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:25.0:1773851870.954866:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851870.954867:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851870.954869:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:25.0:1773851870.954870:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851870.954872:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed42c980
00000400:00000200:25.0:1773851870.954875:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x160dfce379 [256] + 13616
00000800:00000200:25.0:1773851870.954879:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851870.954882:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851870.954884:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851870.954886:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851870.954887:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851870.954888:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009938e3ad.
00000100:00000040:25.0:1773851870.954890:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000009938e3ad x1858062667401600 msgsize 224
00000100:00100000:25.0:1773851870.954892:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000100:00000001:25.0:1773851870.954894:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851870.954896:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:24.0:1773851870.954897:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851870.954898:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851870.954898:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851870.954899:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851870.954899:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851870.954900:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851870.954902:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667401600
00000020:00000001:24.0:1773851870.954903:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851870.954903:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:24.0:1773851870.954905:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851870.954907:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:24.0:1773851870.954908:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:24.0:1773851870.954910:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:24.0:1773851870.954912:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851870.954913:0:1537164:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851870.954914:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000157f1406.
00000020:00000010:24.0:1773851870.954916:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851870.954918:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005ba32091.
00000100:00000040:24.0:1773851870.954919:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851870.954920:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851870.954921:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851870.954922:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851870.954923:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851870.954925:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851870.954927:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851870.954928:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851870.954929:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851870.954930:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851870.954930:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799983
00000100:00000001:25.0:1773851870.954931:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851870.954931:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:25.0:1773851870.954932:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851870.954932:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478755840 : -106938230795776 : ffff9ebd80bd9200)
00000100:00000040:24.0:1773851870.954934:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009938e3ad x1858062667401600/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:597/0 lens 224/0 e 0 to 0 dl 1773851957 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:24.0:1773851870.954939:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851870.954940:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851870.954942:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009938e3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667401600:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:24.0:1773851870.954944:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667401600
00000020:00000001:24.0:1773851870.954945:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851870.954946:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851870.954947:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851870.954948:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851870.954949:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851870.954950:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851870.954952:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851870.954953:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851870.954954:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851870.954954:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851870.954956:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851870.954956:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851870.954958:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000032a32886.
02000000:00000001:24.0:1773851870.954959:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851870.954960:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851870.954961:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851870.954962:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851870.954963:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851870.954964:0:1537164:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851870.954967:0:1537164:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851870.954968:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851870.954969:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851870.954972:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851870.954973:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667401600
00010000:00000001:24.0:1773851870.954974:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851870.954975:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009938e3ad x1858062667401600/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:597/0 lens 224/368 e 0 to 0 dl 1773851957 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:24.0:1773851870.954980:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851870.954981:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851870.954982:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=147 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851870.954984:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851870.954985:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:24.0:1773851870.954986:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:24.0:1773851870.954987:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851870.954988:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851870.954989:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851870.954990:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:24.0:1773851870.954991:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f93df7a.
00000100:00000200:24.0:1773851870.954993:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667401600, offset 224
00000400:00000200:24.0:1773851870.954995:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:24.0:1773851870.954996:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851870.954998:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:24.0:1773851870.955000:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851870.955002:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:24.0:1773851870.955004:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2105@kfi7 local destination
00000400:00000200:24.0:1773851870.955006:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769352:8769352:1024:4294967295] 2105@kfi7 LPNI seq info [20346204:20346204:16:4294967295]
00000400:00000200:24.0:1773851870.955008:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851870.955010:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851870.955013:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851870.955015:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:24.0:1773851870.955018:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851870.955019:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851870.955023:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851870.955027:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000800:00000200:24.0:1773851870.955032:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007491e18f: Posted send of 468 bytes to peer 0x4c6: rc=0
00000800:00000200:24.0:1773851870.955034:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851870.955037:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851870.955041:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:24.0:1773851870.955042:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851870.955043:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851870.955044:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851870.955045:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009938e3ad x1858062667401600/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:597/0 lens 224/368 e 0 to 0 dl 1773851957 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:24.0:1773851870.955051:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009938e3ad pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667401600:12345-2098@kfi7:41:default-yuba6-0 Request processed in 110us (160us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851870.955054:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799983
00000100:00000040:24.0:1773851870.955056:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:24.0:1773851870.955058:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851870.955058:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851870.955059:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851870.955060:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005ba32091.
00000020:00000010:24.0:1773851870.955062:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000157f1406.
00000020:00000040:24.0:1773851870.955063:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:24.0:1773851870.955065:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851870.955072:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851870.955075:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851870.955077:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:26.0:1773851870.955078:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f93df7a
00000400:00000010:26.0:1773851870.955078:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f93df7a.
00000100:00000001:26.0:1773851870.955079:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851870.955080:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851870.955081:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:26.0:1773851870.955083:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Transaction freed
00000800:00000200:17.0:1773851871.044286:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.044287:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.044289:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.044291:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.044292:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22449@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.044294:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22449@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.044294:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22449@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.044295:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e9a51ef nid 22449@kfi7 refs 1
00000400:00000200:17.0:1773851871.044296:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22449@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.044297:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e9a51ef nid 22449@kfi7 refs 2
00000400:00000200:17.0:1773851871.044297:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000e9a51ef nid 22449@kfi7 refs 3
00000400:00000200:17.0:1773851871.044298:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22384@kfi7 to cpt 5
00000400:00000200:17.0:1773851871.044299:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22384@kfi7 of length 224 into portal 12 MB=0x699e0d402ec00
00000400:00000200:17.0:1773851871.044300:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22384@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 15040
00000800:00000200:17.0:1773851871.044301:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.044303:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.044304:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22449@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.044304:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.044305:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.044306:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e6620640.
00000100:00000040:17.0:1773851871.044306:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000e6620640 x1858040768949248 msgsize 224
00000100:00100000:17.0:1773851871.044308:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22384@kfi7 (source: 12345-22449@kfi7)
00000100:00000001:17.0:1773851871.044309:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.044309:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000e9a51ef nid 22449@kfi7 refs 2
00000100:00000001:16.0:1773851871.044310:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851871.044311:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.044311:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.044311:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.044312:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.044313:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.044314:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040768949248
00000020:00000001:16.0:1773851871.044315:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.044315:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929ad
00000020:00000001:16.0:1773851871.044316:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.044319:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000078024ca1 refcount=6
00000020:00000001:16.0:1773851871.044320:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743179264 : -107128966372352 : ffff9e911803a400)
00000020:00000001:16.0:1773851871.044321:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743179264 : -107128966372352 : ffff9e911803a400)
00000100:00000001:16.0:1773851871.044322:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.044322:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.044323:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddc278b8.
00000020:00000010:16.0:1773851871.044324:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.044325:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.044326:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.044326:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851871.044327:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.044328:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851871.044329:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851871.044329:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.044330:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851871.044332:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851871.044332:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851871.044332:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.044332:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851871.044333:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22384@kfi7, seq: 2156342
00000100:00000001:17.0:1773851871.044334:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.044334:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000078024ca1 : new rpc_count 1
00000100:00000001:17.0:1773851871.044335:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.044335:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637092128967808 : -106981580583808 : ffff9eb368e44c80)
00000100:00000040:16.0:1773851871.044336:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e6620640 x1858040768949248/t0(0) o400->3824c2c9-8045-4588-9e4d-56799aeb9f70@22384@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1886-0'
00000100:00000001:16.0:1773851871.044338:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.044339:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851871.044340:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6620640 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:3824c2c9-8045-4588-9e4d-56799aeb9f70+6:39710:x1858040768949248:12345-22384@kfi7:400:default-tuolumne1886-0
00000100:00000200:16.0:1773851871.044341:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040768949248
00000020:00000001:16.0:1773851871.044342:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851871.044342:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851871.044343:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.044344:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851871.044345:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851871.044345:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851871.044346:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040768949248, found 0 last_xid 1858040768949247
00000020:00000001:16.0:1773851871.044347:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851871.044347:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851871.044348:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851871.044348:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.044349:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851871.044350:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851871.044350:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851871.044351:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c7693de5.
02000000:00000001:16.0:1773851871.044352:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.044353:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.044353:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851871.044354:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252857851, transno 0, xid 1858040768949248
00010000:00000001:16.0:1773851871.044355:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851871.044356:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e6620640 x1858040768949248/t0(0) o400->3824c2c9-8045-4588-9e4d-56799aeb9f70@22384@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1886-0'
00010000:00000001:16.0:1773851871.044358:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851871.044358:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851871.044359:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=104 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851871.044360:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.044361:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000caa84985 refcount 3 to 22384@kfi7
00000100:00000001:16.0:1773851871.044362:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956271680 : -107146753279936 : ffff9e8cf3d4f840)
02000000:00000001:16.0:1773851871.044362:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851871.044363:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.044363:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851871.044364:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22449@kfi7
00000400:00000010:16.0:1773851871.044365:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c89dd537.
00000100:00000200:16.0:1773851871.044366:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040768949248, offset 224
00000400:00000200:16.0:1773851871.044367:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22449@kfi7
00000400:00000200:16.0:1773851871.044368:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22449@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.044369:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e9a51ef nid 22449@kfi7 refs 1
00000400:00000200:16.0:1773851871.044371:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000e9a51ef nid 22449@kfi7 refs 2
00000400:00000200:16.0:1773851871.044372:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000e9a51ef nid 22449@kfi7 refs 3
00000400:00000200:16.0:1773851871.044373:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22449@kfi7 local destination
00000400:00000200:16.0:1773851871.044374:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769353:8769353:1024:4294967295] 22449@kfi7 LPNI seq info [438765:438765:16:4294967295]
00000400:00000200:16.0:1773851871.044376:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000e9a51ef nid 22449@kfi7 refs 2
00000400:00000200:16.0:1773851871.044377:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22449@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.044378:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22449@kfi7(22449@kfi7:22449@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851871.044380:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000e9a51ef nid 22449@kfi7 refs 3
00000800:00000200:16.0:1773851871.044381:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851871.044382:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851871.044384:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851871.044387:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf3e Using peer 22449@kfi7(0xf3e)
00000800:00000200:16.0:1773851871.044390:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0xf3e: rc=0
00000800:00000200:16.0:1773851871.044391:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf3e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851871.044393:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.044394:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000caa84985 refcount 2 to 22384@kfi7
00010000:00000001:16.0:1773851871.044394:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851871.044395:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.044395:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851871.044396:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e6620640 x1858040768949248/t0(0) o400->3824c2c9-8045-4588-9e4d-56799aeb9f70@22384@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1886-0'
00000100:00100000:16.0:1773851871.044400:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6620640 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:3824c2c9-8045-4588-9e4d-56799aeb9f70+6:39710:x1858040768949248:12345-22384@kfi7:400:default-tuolumne1886-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851871.044403:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22384@kfi7, seq: 2156342
00000100:00000040:16.0:1773851871.044403:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000078024ca1 : new rpc_count 0
00000100:00000001:16.0:1773851871.044405:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.044405:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.044406:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.044407:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.044407:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddc278b8.
00000020:00000040:16.0:1773851871.044408:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000078024ca1 : new refcount 5
00000100:00000001:16.0:1773851871.044409:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851871.044413:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf3e TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851871.044415:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.044416:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22449@kfi7: PUT: OK
00000400:00000200:17.0:1773851871.044417:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c89dd537
00000400:00000010:17.0:1773851871.044417:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c89dd537.
00000100:00000001:17.0:1773851871.044418:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851871.044418:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851871.044419:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000e9a51ef nid 22449@kfi7 refs 2
00000800:00000200:17.0:1773851871.044420:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 22449@kfi7(000000001238e1a2):0x0 lsk 3903 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf3e Transaction freed
00000004:00000001:11.0:1773851871.049735:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851871.049736:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851871.049737:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cd342c1.
00000020:00000040:11.0:1773851871.049739:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851871.049741:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851871.049742:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851871.049744:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851871.049746:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004f719342.
00000100:00000001:11.0:1773851871.049748:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.049750:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851871.049751:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851871.049755:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007cd342c1] to pc [ptlrpcd_02_03+3]  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851871.049764:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851871.049765:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851871.049766:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:11.0:1773851871.049767:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000002f96d777.
00000100:00000001:8.0:1773851871.049767:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:11.0:1773851871.049768:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637093772294144 : -106979937257472 : ffff9eb3cad77800)
00000100:00000001:9.0:1773851871.049768:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851871.049770:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851871.049770:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851871.049770:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851871.049772:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851871.049774:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000004:00000010:11.0:1773851871.049775:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b092897e.
00000100:00000001:8.0:1773851871.049776:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:11.0:1773851871.049777:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614145503052366ns, next at 614146503050202ns, rc = 0
00000100:00000001:8.0:1773851871.049777:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851871.049779:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851871.049779:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851871.049780:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851871.049781:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851871.049781:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051929856:2075@kfi7:13:default-yuba2-0
00000004:00000001:11.0:1773851871.049782:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851871.049784:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851871.049785:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851871.049786:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851871.049787:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851871.049789:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bafb3ec8.
02000000:00000001:8.0:1773851871.049790:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851871.049793:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:8.0:1773851871.049795:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000007d88ff4.
00000400:00000010:8.0:1773851871.049797:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
00000100:00000200:8.0:1773851871.049799:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929856, portal 4
00000100:00000001:8.0:1773851871.049800:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851871.049801:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889187328 : -106993820364288 : ffff9eb08f581200)
00000100:00000040:8.0:1773851871.049803:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851871.049808:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851871.049810:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:8.0:1773851871.049811:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a9fe4d78.
00000100:00000200:8.0:1773851871.049812:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929856, offset 0
00000400:00000200:8.0:1773851871.049815:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:8.0:1773851871.049817:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:8.0:1773851871.049819:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:8.0:1773851871.049821:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:8.0:1773851871.049824:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:8.0:1773851871.049826:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:8.0:1773851871.049829:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769353, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769349, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851871.049832:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851871.049834:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851871.049836:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:8.0:1773851871.049838:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769354:8769354:1024:4294967295] 2075@kfi7 LPNI seq info [5403911:5403911:16:4294967295]
00000400:00000200:8.0:1773851871.049840:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:8.0:1773851871.049842:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:8.0:1773851871.049846:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851871.049848:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:8.0:1773851871.049852:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851871.049854:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851871.049859:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851871.049865:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Using peer 2075@kfi7(0x2000000000004de)
00000800:00000200:8.0:1773851871.049871:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x2000000000004de: rc=0
00000800:00000200:8.0:1773851871.049874:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851871.049878:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851871.049882:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851871.049884:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851871.049885:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851871.049886:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851871.049889:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851871.049889:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851871.049891:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851871.049892:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851871.049899:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851871.049900:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851871.049901:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851871.049904:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851871.049907:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000400:00000200:10.0:1773851871.049908:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a9fe4d78
00000400:00000010:10.0:1773851871.049909:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a9fe4d78.
00000100:00000001:10.0:1773851871.049910:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851871.049911:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851871.049917:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851871.049918:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851871.049923:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851871.049924:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851871.049925:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:10.0:1773851871.049928:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Transaction freed
00000800:00000200:10.0:1773851871.049933:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851871.049934:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851871.049937:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851871.049940:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851871.049943:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.049946:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:10.0:1773851871.049948:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.049949:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:10.0:1773851871.049950:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.049951:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851871.049953:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:10.0:1773851871.049955:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.049956:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3d00
00000400:00000200:10.0:1773851871.049958:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.049960:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781697ae9 [1] + 224
00000800:00000200:10.0:1773851871.049964:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851871.049966:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851871.049968:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000100:00000001:10.0:1773851871.049970:0:2464469:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851871.049971:0:2464469:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851871.049976:0:2464469:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851871.049982:0:2464469:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851871.049983:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000100:00000001:8.0:1773851871.049984:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851871.049985:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:10.0:1773851871.049986:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:8.0:1773851871.049986:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851871.049987:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851871.049988:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000007d88ff4.
00000400:00000200:8.0:1773851871.049989:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000400:00000010:8.0:1773851871.049989:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000100:00000001:8.0:1773851871.049990:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851871.049991:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851871.049996:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851871.050000:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851871.050001:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851871.050002:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851871.050002:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851871.050003:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851871.050004:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851871.050006:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851871.050007:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=104 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851871.050009:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=104 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851871.050011:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851871.050012:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851871.050013:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851871.050013:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851871.050015:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851871.050015:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:8.0:1773851871.050016:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851871.050017:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851871.050018:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851871.050022:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851871.050024:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851871.050024:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851871.050025:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851871.050026:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851871.050028:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470729216 avail=351461570560 avail_mb=1372896760 hwm_mb=3131103 files=372064556 ffree=343233134 state=0: rc = 0
00000004:00000020:8.0:1773851871.050030:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470729216 free, 351461570560 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064556 files, 343233134 free files
00000004:00000001:8.0:1773851871.050033:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851871.050034:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:8.0:1773851871.050039:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051929856:2075@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851871.050041:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851871.050041:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851871.050043:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007cd342c1 x1859433051929856/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851871.050046:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851871.050047:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851871.050048:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bafb3ec8.
02000000:00000001:8.0:1773851871.050050:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851871.050050:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851871.050051:0:41071:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:8.0:1773851871.050052:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851871.050053:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004f719342.
02000000:00000001:8.0:1773851871.050054:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851871.050055:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851871.050055:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cd342c1.
00000100:00000001:8.0:1773851871.050057:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851871.050057:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851871.050058:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851871.050059:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851871.050060:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851871.050060:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851871.050061:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851871.113734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851871.113736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:17.0:1773851871.127283:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.127283:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.127284:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.127286:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.127288:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23410@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.127289:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23410@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.127290:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23410@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.127291:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edb2ae9b nid 23410@kfi7 refs 1
00000400:00000200:17.0:1773851871.127292:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23410@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.127292:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edb2ae9b nid 23410@kfi7 refs 2
00000400:00000200:17.0:1773851871.127293:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000edb2ae9b nid 23410@kfi7 refs 3
00000400:00000200:17.0:1773851871.127294:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23475@kfi7 to cpt 3
00000400:00000200:17.0:1773851871.127295:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23475@kfi7 of length 224 into portal 12 MB=0x699e0f53cc200
00000400:00000200:17.0:1773851871.127296:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23475@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 15264
00000800:00000200:17.0:1773851871.127298:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.127299:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.127300:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23410@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.127301:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.127301:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.127303:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed96046f.
00000100:00000040:17.0:1773851871.127304:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ed96046f x1858041326387712 msgsize 224
00000100:00100000:17.0:1773851871.127305:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23475@kfi7 (source: 12345-23410@kfi7)
00000100:00000001:17.0:1773851871.127306:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.127307:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000edb2ae9b nid 23410@kfi7 refs 2
00000100:00000001:16.0:1773851871.127307:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851871.127308:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.127308:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.127308:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.127309:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.127310:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.127310:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041326387712
00000020:00000001:16.0:1773851871.127311:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.127311:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b5f
00000020:00000001:16.0:1773851871.127312:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.127314:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005f7fc487 refcount=6
00000020:00000001:16.0:1773851871.127314:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743666688 : -107128965884928 : ffff9e91180b1400)
00000020:00000001:16.0:1773851871.127315:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743666688 : -107128965884928 : ffff9e91180b1400)
00000100:00000001:16.0:1773851871.127316:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.127316:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.127317:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddc278b8.
00000020:00000010:16.0:1773851871.127318:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.127318:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.127319:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.127319:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851871.127320:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.127321:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851871.127321:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851871.127321:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.127322:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851871.127323:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.127323:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.127323:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851871.127324:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851871.127324:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23475@kfi7, seq: 2156343
00000100:00000001:17.0:1773851871.127325:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.127325:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005f7fc487 : new rpc_count 1
00000100:00000001:17.0:1773851871.127326:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.127327:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064129540224 : -107009580011392 : ffff9eace3fef080)
00000100:00000040:16.0:1773851871.127328:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed96046f x1858041326387712/t0(0) o400->fd2f2f9b-b9d6-4afe-81fa-58c26e5a18da@23475@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1946-0'
00000100:00000001:16.0:1773851871.127330:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.127331:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851871.127331:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed96046f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:fd2f2f9b-b9d6-4afe-81fa-58c26e5a18da+6:39686:x1858041326387712:12345-23475@kfi7:400:default-tuolumne1946-0
00000100:00000200:16.0:1773851871.127333:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041326387712
00000020:00000001:16.0:1773851871.127333:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851871.127334:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851871.127334:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.127335:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851871.127335:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851871.127335:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851871.127336:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041326387712, found 0 last_xid 1858041326387711
00000020:00000001:16.0:1773851871.127337:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851871.127337:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851871.127337:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851871.127338:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.127338:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851871.127339:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851871.127339:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851871.127341:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000454c395f.
02000000:00000001:16.0:1773851871.127342:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.127342:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.127343:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851871.127343:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260394111, transno 0, xid 1858041326387712
00010000:00000001:16.0:1773851871.127344:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851871.127344:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed96046f x1858041326387712/t0(0) o400->fd2f2f9b-b9d6-4afe-81fa-58c26e5a18da@23475@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1946-0'
00010000:00000001:16.0:1773851871.127347:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851871.127347:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851871.127348:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=104 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851871.127350:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.127351:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000304a2e53 refcount 3 to 23475@kfi7
00000100:00000001:16.0:1773851871.127352:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729296960 : -107155980254656 : ffff9e8acddc8240)
02000000:00000001:16.0:1773851871.127353:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851871.127353:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.127354:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851871.127354:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23410@kfi7
00000400:00000010:16.0:1773851871.127355:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b181d0b9.
00000100:00000200:16.0:1773851871.127356:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041326387712, offset 224
00000400:00000200:16.0:1773851871.127357:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23410@kfi7
00000400:00000200:16.0:1773851871.127358:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23410@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.127359:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edb2ae9b nid 23410@kfi7 refs 1
00000400:00000200:16.0:1773851871.127360:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000edb2ae9b nid 23410@kfi7 refs 2
00000400:00000200:16.0:1773851871.127361:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000edb2ae9b nid 23410@kfi7 refs 3
00000400:00000200:16.0:1773851871.127362:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23410@kfi7 local destination
00000400:00000200:16.0:1773851871.127364:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769355:8769355:1024:4294967295] 23410@kfi7 LPNI seq info [241788:241788:16:4294967295]
00000400:00000200:16.0:1773851871.127365:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000edb2ae9b nid 23410@kfi7 refs 2
00000400:00000200:16.0:1773851871.127366:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23410@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.127368:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23410@kfi7(23410@kfi7:23410@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851871.127369:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000edb2ae9b nid 23410@kfi7 refs 3
00000800:00000200:16.0:1773851871.127370:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851871.127371:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851871.127373:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851871.127375:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fd5 Using peer 23410@kfi7(0x100000000000fd5)
00000800:00000200:16.0:1773851871.127378:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x100000000000fd5: rc=0
00000800:00000200:16.0:1773851871.127380:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fd5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851871.127381:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.127383:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000304a2e53 refcount 2 to 23475@kfi7
00010000:00000001:16.0:1773851871.127384:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851871.127384:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.127384:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851871.127385:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed96046f x1858041326387712/t0(0) o400->fd2f2f9b-b9d6-4afe-81fa-58c26e5a18da@23475@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1946-0'
00000100:00100000:16.0:1773851871.127389:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed96046f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:fd2f2f9b-b9d6-4afe-81fa-58c26e5a18da+6:39686:x1858041326387712:12345-23475@kfi7:400:default-tuolumne1946-0 Request processed in 58us (85us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851871.127392:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23475@kfi7, seq: 2156343
00000100:00000040:16.0:1773851871.127392:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005f7fc487 : new rpc_count 0
00000100:00000001:16.0:1773851871.127393:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.127393:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.127393:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.127394:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.127395:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddc278b8.
00000020:00000040:16.0:1773851871.127395:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000005f7fc487 : new refcount 5
00000100:00000001:16.0:1773851871.127396:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851871.127403:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fd5 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851871.127405:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.127406:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23410@kfi7: PUT: OK
00000400:00000200:17.0:1773851871.127407:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b181d0b9
00000400:00000010:17.0:1773851871.127408:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b181d0b9.
00000100:00000001:17.0:1773851871.127408:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851871.127409:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851871.127409:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000edb2ae9b nid 23410@kfi7 refs 2
00000800:00000200:17.0:1773851871.127411:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 23410@kfi7(000000000bf3e946):0x0 lsk 4054 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fd5 Transaction freed
00000800:00000200:1.0:1773851871.135169:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851871.135170:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851871.135172:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851871.135176:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851871.135179:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851871.135183:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14586@kfi7 : PUT - for me
00000400:00000200:1.0:1773851871.135184:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851871.135185:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 1
00000400:00000200:1.0:1773851871.135187:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851871.135188:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:1.0:1773851871.135189:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000400:00000200:1.0:1773851871.135191:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851871.135192:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14586@kfi7 of length 440 into portal 12 MB=0x699de8d2b3140
00000400:00000200:1.0:1773851871.135195:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14586@kfi7 of length 440/440 into md 0x7fb56e801 [64] + 31408
00000800:00000200:1.0:1773851871.135198:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851871.135201:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851871.135203:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14586@kfi7: PUT: OK
00000100:00000001:1.0:1773851871.135204:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851871.135205:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851871.135206:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003cc8c241.
00000100:00000040:1.0:1773851871.135207:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000003cc8c241 x1858030990471488 msgsize 440
00000100:00100000:1.0:1773851871.135210:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14586@kfi7 (source: 12345-14586@kfi7)
00000100:00000001:1.0:1773851871.135212:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851871.135213:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000800:00000200:1.0:1773851871.135215:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851871.135215:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851871.135215:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851871.135216:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851871.135217:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851871.135218:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851871.135219:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030990471488
00000020:00000001:0.0:1773851871.135220:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851871.135221:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91181
00000020:00000001:0.0:1773851871.135222:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851871.135223:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007f62dd78 refcount=6
00000020:00000001:0.0:1773851871.135224:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240523776 : -107152469027840 : ffff9e8b9f259400)
00000020:00000001:0.0:1773851871.135225:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240523776 : -107152469027840 : ffff9e8b9f259400)
00000100:00000001:0.0:1773851871.135226:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851871.135227:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851871.135228:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000210fcb46.
00000020:00000010:0.0:1773851871.135230:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851871.135231:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851871.135233:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851871.135234:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851871.135235:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851871.135236:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851871.135237:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851871.135239:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851871.135240:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851871.135241:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851871.135241:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851871.135242:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14586@kfi7, seq: 408701479
00000100:00000001:1.0:1773851871.135244:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851871.135244:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007f62dd78 : new rpc_count 1
00000100:00000001:1.0:1773851871.135245:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851871.135245:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599724928 : -107004109826688 : ffff9eae2a0b5580)
00000100:00000040:0.0:1773851871.135247:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003cc8c241 x1858030990471488/t0(0) o41->2a372835-3a7a-4042-8f32-29812aeb50a5@14586@kfi7:511/0 lens 440/0 e 0 to 0 dl 1773852626 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne225-0'
00000100:00000001:0.0:1773851871.135251:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851871.135252:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851871.135253:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cc8c241 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2a372835-3a7a-4042-8f32-29812aeb50a5+6:113201:x1858030990471488:12345-14586@kfi7:41:default-tuolumne225-0
00000100:00000200:0.0:1773851871.135255:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030990471488
00000020:00000001:0.0:1773851871.135256:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851871.135257:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851871.135258:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851871.135259:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851871.135260:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:0.0:1773851871.135261:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851871.135262:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030990471488, found 0 last_xid 1858030990471487
00000020:00000001:0.0:1773851871.135263:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851871.135264:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851871.135265:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851871.135266:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851871.135267:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851871.135268:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851871.135269:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000001f67a4aa.
02000000:00000001:0.0:1773851871.135270:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851871.135271:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135273:0:60951:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:0.0:1773851871.135274:0:60951:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:0.0:1773851871.135274:0:60951:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135276:0:60951:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:0.0:1773851871.135278:0:60951:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:0.0:1773851871.135280:0:60951:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135282:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:0.0:1773851871.135283:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135284:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:0.0:1773851871.135285:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135286:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:0.0:1773851871.135287:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135288:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:0.0:1773851871.135288:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135289:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:0.0:1773851871.135290:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135291:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135291:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500135424 free, 351498046464 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097753 files, 343261851 free files
00000004:00000001:0.0:1773851871.135294:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135295:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135296:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504355328 free, 351502189568 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056253 files, 343265972 free files
00000004:00000001:0.0:1773851871.135298:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135299:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135299:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690163200 free, 351687736320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231278 files, 343447425 free files
00000004:00000001:0.0:1773851871.135301:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135302:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135303:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382722560 free, 351380663296 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978693 files, 343147190 free files
00000004:00000001:0.0:1773851871.135305:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135306:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135306:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958989312 free, 350956882944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371564016 files, 342733388 free files
00000004:00000001:0.0:1773851871.135308:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135309:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135310:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351236608 free, 351348385792 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084109 files, 343116442 free files
00000004:00000001:0.0:1773851871.135312:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135313:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135313:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482209280 free, 351481147392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097185 files, 343244345 free files
00000004:00000001:0.0:1773851871.135315:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135316:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135317:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449320448 free, 351446755328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160992 files, 343212227 free files
00000004:00000001:0.0:1773851871.135321:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135322:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135322:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353650176 free, 351351228416 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083334 files, 343118799 free files
00000004:00000001:0.0:1773851871.135324:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135325:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135326:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351389037568 free, 351386347520 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019175 files, 343153357 free files
00000004:00000001:0.0:1773851871.135328:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135329:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135329:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406563328 free, 351404217344 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127276 files, 343170472 free files
00000004:00000001:0.0:1773851871.135331:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135332:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135332:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378938880 free, 351375971328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019024 files, 343143495 free files
00000004:00000001:0.0:1773851871.135334:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135335:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135335:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351465969664 free, 351462843392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062821 files, 343228486 free files
00000004:00000001:0.0:1773851871.135337:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135338:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135339:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489071104 free, 351486076928 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066827 files, 343251046 free files
00000004:00000001:0.0:1773851871.135341:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135342:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135342:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399726592 blocks, 351492762624 free, 351490353152 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078092 files, 343254651 free files
00000004:00000001:0.0:1773851871.135344:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135345:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135346:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524105216 free, 351521356800 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113924 files, 343285259 free files
00000004:00000001:0.0:1773851871.135347:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135348:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135349:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510652928 free, 351508048896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095803 files, 343272122 free files
00000004:00000001:0.0:1773851871.135351:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135352:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135352:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541584896 free, 351539512320 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136717 files, 343302329 free files
00000004:00000001:0.0:1773851871.135354:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135355:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135356:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470729216 free, 351461570560 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064556 files, 343233134 free files
00000004:00000001:0.0:1773851871.135358:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135359:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135359:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666717696 free, 351645476864 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237932 files, 343424529 free files
00000004:00000001:0.0:1773851871.135361:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135362:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135362:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545828352 free, 351536169984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116458 files, 343306473 free files
00000004:00000001:0.0:1773851871.135364:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135365:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135366:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603986432 free, 351601695744 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190508 files, 343363268 free files
00000004:00000001:0.0:1773851871.135367:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135368:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135369:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615858688 free, 351613239296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043460 files, 343374862 free files
00000004:00000001:0.0:1773851871.135370:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135371:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135372:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420290048 free, 351417816064 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372009027 files, 343183877 free files
00000004:00000001:0.0:1773851871.135374:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135374:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135375:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409140736 free, 351407087616 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011338 files, 343172989 free files
00000004:00000001:0.0:1773851871.135376:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135377:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135378:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480064000 free, 351478686720 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073181 files, 343242250 free files
00000004:00000001:0.0:1773851871.135380:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135381:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135381:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593681920 free, 351576841216 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190031 files, 343353205 free files
00000004:00000001:0.0:1773851871.135383:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135384:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:0.0:1773851871.135385:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464112128 free, 351458204672 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064851 files, 343226672 free files
00000004:00000001:0.0:1773851871.135387:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135388:0:60951:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135389:0:60951:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:0.0:1773851871.135390:0:60951:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 40309317131304960 avail 40308837252595712
00000004:00000020:0.0:1773851871.135392:0:60951:0:(mdt_handler.c:558:mdt_statfs()) 11491192134656 blocks: 9841141877760 free, 9841024609664 avail; 10969025913 objects: 9610490115 free; state 100
00000020:00000001:0.0:1773851871.135395:0:60951:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:0.0:1773851871.135398:0:60951:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851871.135400:0:60951:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851871.135401:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768264, transno 0, xid 1858030990471488
00010000:00000001:0.0:1773851871.135402:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851871.135404:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003cc8c241 x1858030990471488/t0(0) o41->2a372835-3a7a-4042-8f32-29812aeb50a5@14586@kfi7:511/0 lens 440/368 e 0 to 0 dl 1773852626 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne225-0'
00010000:00000001:0.0:1773851871.135408:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851871.135409:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851871.135410:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=104 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851871.135412:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851871.135413:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce33b24b refcount 5 to 14586@kfi7
00000100:00000001:0.0:1773851871.135414:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545859072 : -107154163692544 : ffff9e8b3a230c00)
02000000:00000001:0.0:1773851871.135416:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851871.135417:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851871.135418:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851871.135419:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14586@kfi7
00000400:00000010:0.0:1773851871.135420:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d94499d6.
00000100:00000200:0.0:1773851871.135421:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030990471488, offset 224
00000400:00000200:0.0:1773851871.135423:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14586@kfi7
00000400:00000200:0.0:1773851871.135425:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:0.0:1773851871.135426:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 1
00000400:00000200:0.0:1773851871.135428:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:0.0:1773851871.135429:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000400:00000200:0.0:1773851871.135431:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14586@kfi7 local destination
00000400:00000200:0.0:1773851871.135433:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769356:8769356:1024:4294967295] 14586@kfi7 LPNI seq info [28006:28006:16:4294967295]
00000400:00000200:0.0:1773851871.135435:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:0.0:1773851871.135437:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:0.0:1773851871.135440:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14586@kfi7(14586@kfi7:14586@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851871.135442:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000800:00000200:0.0:1773851871.135444:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851871.135446:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:0.0:1773851871.135449:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851871.135453:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ce Using peer 14586@kfi7(0x3ce)
00000800:00000200:0.0:1773851871.135458:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 468 bytes to peer 0x3ce: rc=0
00000800:00000200:0.0:1773851871.135460:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851871.135463:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851871.135464:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce33b24b refcount 4 to 14586@kfi7
00010000:00000001:0.0:1773851871.135466:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851871.135466:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851871.135470:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851871.135471:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003cc8c241 x1858030990471488/t0(0) o41->2a372835-3a7a-4042-8f32-29812aeb50a5@14586@kfi7:511/0 lens 440/368 e 0 to 0 dl 1773852626 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne225-0'
00000100:00100000:0.0:1773851871.135476:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cc8c241 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2a372835-3a7a-4042-8f32-29812aeb50a5+6:113201:x1858030990471488:12345-14586@kfi7:41:default-tuolumne225-0 Request processed in 224us (267us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851871.135480:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14586@kfi7, seq: 408701479
00000100:00000040:0.0:1773851871.135482:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007f62dd78 : new rpc_count 0
00000100:00000001:0.0:1773851871.135483:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851871.135484:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851871.135484:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851871.135486:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851871.135487:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000210fcb46.
00000020:00000040:0.0:1773851871.135489:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000007f62dd78 : new refcount 5
00000100:00000001:0.0:1773851871.135490:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851871.135498:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ce TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851871.135500:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851871.135502:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14586@kfi7: PUT: OK
00000400:00000200:1.0:1773851871.135503:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d94499d6
00000400:00000010:1.0:1773851871.135504:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d94499d6.
00000100:00000001:1.0:1773851871.135505:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851871.135506:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851871.135507:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000800:00000200:1.0:1773851871.135510:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 14586@kfi7(0000000028c85210):0x0 lsk 975 rsk 90 tsk 0 trmk 0 tmk 0 trr 0 tta 0x3ce Transaction freed
00000800:00000200:13.0:1773851871.176183:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851871.176184:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851871.176186:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851871.176190:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851871.176194:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.176196:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:13.0:1773851871.176198:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.176199:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:13.0:1773851871.176200:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.176202:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:13.0:1773851871.176203:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:13.0:1773851871.176205:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.176207:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a860a2bc0
00000400:00000200:13.0:1773851871.176212:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x8242bd2ed [256] + 3016
00000800:00000200:13.0:1773851871.176215:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851871.176218:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851871.176220:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000100:00000001:13.0:1773851871.176222:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851871.176223:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:13.0:1773851871.176225:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000303d91d0.
00000100:00000040:13.0:1773851871.176226:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000303d91d0 x1859388080532416 msgsize 224
00000100:00100000:13.0:1773851871.176228:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-7@kfi7)
00000100:00000001:13.0:1773851871.176231:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851871.176232:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:12.0:1773851871.176234:0:1537104:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851871.176235:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851871.176235:0:1537104:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851871.176235:0:1537104:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851871.176236:0:1537104:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851871.176237:0:1537104:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851871.176238:0:1537104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080532416
00000020:00000001:12.0:1773851871.176238:0:1537104:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851871.176239:0:1537104:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:12.0:1773851871.176239:0:1537104:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851871.176243:0:1537104:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:12.0:1773851871.176243:0:1537104:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:12.0:1773851871.176244:0:1537104:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:12.0:1773851871.176245:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851871.176246:0:1537104:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851871.176246:0:1537104:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851871.176248:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851871.176248:0:1537104:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000040:12.0:1773851871.176250:0:1537104:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:12.0:1773851871.176250:0:1537104:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851871.176251:0:1537104:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851871.176251:0:1537104:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.176252:0:1537104:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.176254:0:1537104:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851871.176256:0:1537104:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851871.176258:0:1537109:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851871.176259:0:1537104:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851871.176260:0:1537109:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851871.176260:0:1537104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 1164651
00000100:00000040:12.0:1773851871.176260:0:1537104:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:14.0:1773851871.176261:0:1537109:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.176261:0:1537104:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970985856 : -107043738565760 : ffff9ea4effcc380)
00000100:00000001:14.0:1773851871.176262:0:1537109:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851871.176262:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000303d91d0 x1859388080532416/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:12.0:1773851871.176265:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851871.176265:0:1537104:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851871.176266:0:1537104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000303d91d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080532416:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:12.0:1773851871.176268:0:1537104:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080532416
00000020:00000001:12.0:1773851871.176268:0:1537104:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851871.176269:0:1537104:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851871.176270:0:1537104:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.176270:0:1537104:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851871.176271:0:1537104:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:12.0:1773851871.176271:0:1537104:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:12.0:1773851871.176272:0:1537104:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851871.176273:0:1537104:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851871.176273:0:1537104:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851871.176274:0:1537104:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.176275:0:1537104:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851871.176275:0:1537104:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851871.176276:0:1537104:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000057f9a7f8.
02000000:00000001:12.0:1773851871.176276:0:1537104:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.176277:0:1537104:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851871.176278:0:1537104:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:12.0:1773851871.176280:0:1537104:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:12.0:1773851871.176280:0:1537104:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:12.0:1773851871.176281:0:1537104:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:12.0:1773851871.176283:0:1537104:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:12.0:1773851871.176285:0:1537104:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851871.176285:0:1537104:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080532416
00010000:00000001:12.0:1773851871.176286:0:1537104:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851871.176287:0:1537104:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000303d91d0 x1859388080532416/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:12.0:1773851871.176289:0:1537104:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851871.176290:0:1537104:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851871.176291:0:1537104:0:(import.c:1951:at_measured()) add 1 to 00000000a8c7027b time=31 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851871.176292:0:1537104:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851871.176292:0:1537104:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:12.0:1773851871.176293:0:1537104:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:12.0:1773851871.176294:0:1537104:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851871.176294:0:1537104:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.176295:0:1537104:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851871.176296:0:1537104:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:12.0:1773851871.176296:0:1537104:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006af2a73b.
00000100:00000200:12.0:1773851871.176297:0:1537104:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080532416, offset 224
00000400:00000200:12.0:1773851871.176298:0:1537104:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:12.0:1773851871.176299:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:12.0:1773851871.176301:0:1537104:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:12.0:1773851871.176302:0:1537104:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:12.0:1773851871.176303:0:1537104:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:12.0:1773851871.176304:0:1537104:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  7@kfi7 local destination
00000400:00000200:12.0:1773851871.176305:0:1537104:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769357:8769357:1024:4294967295] 7@kfi7 LPNI seq info [17340064:17340064:16:4294967295]
00000400:00000200:12.0:1773851871.176306:0:1537104:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:12.0:1773851871.176307:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:12.0:1773851871.176309:0:1537104:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851871.176310:0:1537104:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000800:00000200:12.0:1773851871.176312:0:1537104:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851871.176313:0:1537104:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:12.0:1773851871.176315:0:1537104:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851871.176317:0:1537104:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a Using peer 7@kfi7(0x20000000000119a)
00000800:00000200:12.0:1773851871.176322:0:1537104:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000025990170: Posted send of 468 bytes to peer 0x20000000000119a: rc=0
00000800:00000200:12.0:1773851871.176323:0:1537104:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851871.176325:0:1537104:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851871.176326:0:1537104:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:12.0:1773851871.176327:0:1537104:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851871.176327:0:1537104:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.176328:0:1537104:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851871.176329:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000303d91d0 x1859388080532416/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:12.0:1773851871.176334:0:1537104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000303d91d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080532416:12345-7@kfi7:41:default-yuba5-0 Request processed in 68us (107us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851871.176336:0:1537104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 1164651
00000100:00000040:12.0:1773851871.176337:0:1537104:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:12.0:1773851871.176337:0:1537104:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851871.176338:0:1537104:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851871.176338:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851871.176339:0:1537104:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:12.0:1773851871.176340:0:1537104:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000020:00000040:12.0:1773851871.176340:0:1537104:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:12.0:1773851871.176341:0:1537104:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851871.176348:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851871.176351:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851871.176353:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000400:00000200:13.0:1773851871.176355:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006af2a73b
00000400:00000010:13.0:1773851871.176356:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006af2a73b.
00000100:00000001:13.0:1773851871.176357:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851871.176357:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851871.176359:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:13.0:1773851871.176361:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a Transaction freed
00000800:00000200:18.0:1773851871.188814:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.188814:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851871.188816:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.188816:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851871.188818:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.188818:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851871.188821:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851871.188821:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8529@kfi7(00000000c4a3915c):0x1013 version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851871.188824:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 Using peer 8529@kfi7(0x1013)
00000400:00000200:18.0:1773851871.188825:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8529@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.188827:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8529@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.188827:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8529@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.188829:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8529@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.188830:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000477b0000 nid 8529@kfi7 refs 1
00000800:00000200:17.0:1773851871.188830:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x1013: rc=0
00000400:00000200:18.0:1773851871.188832:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8529@kfi7 to cpt 4
00000800:00000200:17.0:1773851871.188832:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851871.188833:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000477b0000 nid 8529@kfi7 refs 2
00000400:00000200:18.0:1773851871.188835:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000477b0000 nid 8529@kfi7 refs 3
00000400:00000200:18.0:1773851871.188836:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8592@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.188838:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8592@kfi7 of length 520 into portal 12 MB=0x699e12fb810c0
00000400:00000200:18.0:1773851871.188840:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8592@kfi7 of length 520/520 into md 0x6ab01b5d1 [64] + 15488
00000800:00000200:18.0:1773851871.188843:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851871.188846:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851871.188847:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851871.188848:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8529@kfi7: PUT: OK
00000100:00000001:18.0:1773851871.188849:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851871.188850:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851871.188851:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d2d833e6.
00000800:00000200:17.0:1773851871.188851:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 Transaction freed
00000100:00000040:18.0:1773851871.188853:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000d2d833e6 x1858042307547328 msgsize 520
00000100:00100000:18.0:1773851871.188855:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-8592@kfi7 (source: 12345-8529@kfi7)
00000100:00000001:18.0:1773851871.188857:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851871.188858:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000477b0000 nid 8529@kfi7 refs 2
00000100:00000001:16.0:1773851871.188859:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851871.188860:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.188860:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:18.0:1773851871.188861:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851871.188861:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.188863:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.188864:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042307547328
00000020:00000001:16.0:1773851871.188865:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.188865:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91413
00000020:00000001:16.0:1773851871.188866:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.188869:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005dd2f4f7 refcount=18
00000020:00000001:16.0:1773851871.188870:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000020:00000001:16.0:1773851871.188872:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000100:00000001:16.0:1773851871.188873:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.188875:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.188876:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddc278b8.
00000020:00000010:16.0:1773851871.188877:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.188880:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.188881:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.188882:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851871.188883:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.188884:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:16.0:1773851871.188885:0:61039:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@00000000d2d833e6 x1858042307547328/t0(0) o38->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852071 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1026-0'
00000100:00000001:16.0:1773851871.188889:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851871.188890:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.188892:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851871.188894:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.188894:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.188894:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851871.188895:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851871.188896:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8592@kfi7, seq: 2156344
00000100:00000001:17.0:1773851871.188897:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.188897:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005dd2f4f7 : new rpc_count 3
00000100:00000001:17.0:1773851871.188898:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.188898:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534664192 : -106946174887424 : ffff9ebba73c5a00)
00000100:00000040:16.0:1773851871.188900:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d2d833e6 x1858042307547328/t0(0) o38->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852071 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1026-0'
00000100:00000001:16.0:1773851871.188904:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.188905:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851871.188907:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2d833e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:7bede783-62a8-4786-99a3-9badf953921d+18:39686:x1858042307547328:12345-8592@kfi7:38:default-tuolumne1026-0
00000100:00000200:16.0:1773851871.188909:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042307547328
00000020:00000001:16.0:1773851871.188910:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:16.0:1773851871.188911:0:61039:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:16.0:1773851871.188914:0:61039:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:16.0:1773851871.188915:0:61039:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:16.0:1773851871.188917:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851871.188918:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851871.188919:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 00000000e5d4e0bf.
02000000:00000001:16.0:1773851871.188920:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.188922:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:16.0:1773851871.188923:0:61039:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:16.0:1773851871.188925:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 7bede783-62a8-4786-99a3-9badf953921d (at 8592@kfi7) reconnecting
00010000:00000001:16.0:1773851871.188927:0:61039:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:16.0:1773851871.188929:0:61039:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:16.0:1773851871.188930:0:61039:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from 7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7 t0 exp 000000005dd2f4f7 cur 614145 last 1773851871
00010000:00000001:16.0:1773851871.188933:0:61039:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:16.0:1773851871.188934:0:61039:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:16.0:1773851871.188935:0:61039:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:16.0:1773851871.188936:0:61039:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:16.0:1773851871.188937:0:61039:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:16.0:1773851871.188939:0:61039:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:16.0:1773851871.188941:0:61039:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:16.0:1773851871.188942:0:61039:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:16.0:1773851871.188943:0:61039:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:16.0:1773851871.188944:0:61039:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.188945:0:61039:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:16.0:1773851871.188947:0:61039:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:16.0:1773851871.188948:0:61039:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7bede783-62a8-4786-99a3-9badf953921d/000000005dd2f4f7 free: 126633370845184 avail: 126633368748032
00000020:00000001:16.0:1773851871.188950:0:61039:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:16.0:1773851871.188951:0:61039:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7bede783-62a8-4786-99a3-9badf953921d/000000005dd2f4f7 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:16.0:1773851871.188953:0:61039:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:16.0:1773851871.188955:0:61039:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:16.0:1773851871.188956:0:61039:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:16.0:1773851871.188957:0:61039:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli 7bede783-62a8-4786-99a3-9badf953921d/000000005dd2f4f7 ocd_grant: 1882456063 want: 2097152 left: 112130449866752
00000020:00000001:16.0:1773851871.188959:0:61039:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:16.0:1773851871.188960:0:61039:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 8592@kfi7 supports cksum type f7, return f7
00000004:00000001:16.0:1773851871.188962:0:61039:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:16.0:1773851871.188963:0:61039:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:16.0:1773851871.188965:0:61039:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:16.0:1773851871.188966:0:61039:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:16.0:1773851871.188968:0:61039:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:16.0:1773851871.188969:0:61039:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.188971:0:61039:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 000000005dd2f4f7 : new rpc_count 2
00000020:00000040:16.0:1773851871.188973:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000005dd2f4f7 : new refcount 18
00000020:00000040:16.0:1773851871.188974:0:61039:0:(genops.c:871:class_export_get()) GET export 000000005dd2f4f7 refcount=19
00000100:00000040:16.0:1773851871.188975:0:61039:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 000000005dd2f4f7 : new rpc_count 3
00000100:00000001:16.0:1773851871.188977:0:61039:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:16.0:1773851871.188978:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8592@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.188980:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2aa90d8 nid 8592@kfi7 refs 1
00000400:00000200:16.0:1773851871.188982:0:61039:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 00000000a2aa90d8 nid 8592@kfi7 refs 2
00000400:00000200:16.0:1773851871.188985:0:61039:0:(peer.c:1555:LNetPrimaryNID()) NID 8592@kfi7 primary NID 8592@kfi7 rc 0
00000100:00000001:16.0:1773851871.189001:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.189003:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000615435d3 refcount 3 to 8592@kfi7
00000100:00000001:16.0:1773851871.189004:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517664 : -107156126033952 : ffff9e8ac52c17e0)
00000100:00000001:16.0:1773851871.189005:0:61039:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636917583517664 : -107156126033952 : 0xffff9e8ac52c17e0)
00000100:00000040:16.0:1773851871.189008:0:61039:0:(connection.c:133:ptlrpc_connection_get()) conn=00000000615435d3 refcount 3 to 8592@kfi7
00000100:00080000:16.0:1773851871.189010:0:61039:0:(import.c:86:import_set_state_nolock()) 00000000c3835bb3 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:16.0:1773851871.189011:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000615435d3 refcount 2 to 8592@kfi7
00000100:00000001:16.0:1773851871.189013:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.189014:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000615435d3 refcount 3 to 8592@kfi7
00000100:00000001:16.0:1773851871.189015:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517664 : -107156126033952 : ffff9e8ac52c17e0)
02000000:00000001:16.0:1773851871.189017:0:61039:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:16.0:1773851871.189018:0:61039:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:16.0:1773851871.189020:0:61039:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.189021:0:61039:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:16.0:1773851871.189022:0:61039:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:16.0:1773851871.189023:0:61039:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.0:1773851871.189025:0:61039:0:(import.c:86:import_set_state_nolock()) 00000000c3835bb3 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:16.0:1773851871.189026:0:61039:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:16.0:1773851871.189027:0:61039:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:16.0:1773851871.189028:0:61039:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:16.0:1773851871.189029:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000005dd2f4f7 : new refcount 18
00000020:00000040:16.0:1773851871.189031:0:61039:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:16.0:1773851871.189032:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000615435d3 refcount 2 to 8592@kfi7
00010000:00000001:16.0:1773851871.189035:0:61039:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.189036:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851871.189037:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:16.0:1773851871.189039:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:16.0:1773851871.189040:0:61039:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851871.189041:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851871.189042:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851871.189043:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.189044:0:61039:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:16.0:1773851871.189045:0:61039:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:16.0:1773851871.189046:0:61039:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:16.0:1773851871.189047:0:61039:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:16.0:1773851871.189048:0:61039:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.189048:0:61039:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851871.189050:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106304180, transno 0, xid 1858042307547328
00010000:00000001:16.0:1773851871.189051:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851871.189052:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d2d833e6 x1858042307547328/t0(0) o38->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852071 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1026-0'
00010000:00000001:16.0:1773851871.189054:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851871.189055:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851871.189056:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=104 v=315 (315 214 1 1)
00000100:00001000:16.0:1773851871.189057:0:61039:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:16.0:1773851871.189059:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.189060:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000615435d3 refcount 3 to 8592@kfi7
00000100:00000001:16.0:1773851871.189060:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517664 : -107156126033952 : ffff9e8ac52c17e0)
02000000:00000001:16.0:1773851871.189061:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851871.189062:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.189063:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851871.189064:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8529@kfi7
00000400:00000010:16.0:1773851871.189064:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e45fdf1d.
00000100:00000200:16.0:1773851871.189065:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858042307547328, offset 0
00000400:00000200:16.0:1773851871.189067:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8529@kfi7
00000400:00000200:16.0:1773851871.189068:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8529@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.189069:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000477b0000 nid 8529@kfi7 refs 1
00000400:00000200:16.0:1773851871.189070:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000477b0000 nid 8529@kfi7 refs 2
00000400:00000200:16.0:1773851871.189072:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000477b0000 nid 8529@kfi7 refs 3
00000400:00000200:16.0:1773851871.189074:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8529@kfi7 local destination
00000400:00000200:16.0:1773851871.189075:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769358:8769358:1024:4294967295] 8529@kfi7 LPNI seq info [4508239:4508239:16:4294967295]
00000400:00000200:16.0:1773851871.189077:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000477b0000 nid 8529@kfi7 refs 2
00000400:00000200:16.0:1773851871.189078:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8529@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.189080:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8529@kfi7(8529@kfi7:8529@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851871.189082:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000477b0000 nid 8529@kfi7 refs 3
00000800:00000200:16.0:1773851871.189083:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851871.189084:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:16.0:1773851871.189087:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851871.189090:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 Using peer 8529@kfi7(0x1013)
00000800:00000200:16.0:1773851871.189093:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000279c411a: Posted send of 516 bytes to peer 0x1013: rc=0
00000800:00000200:16.0:1773851871.189095:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851871.189097:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.189099:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000615435d3 refcount 2 to 8592@kfi7
00010000:00000001:16.0:1773851871.189100:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851871.189100:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.189103:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851871.189103:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d2d833e6 x1858042307547328/t0(0) o38->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852071 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1026-0'
00000100:00100000:16.0:1773851871.189107:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2d833e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:7bede783-62a8-4786-99a3-9badf953921d+18:39686:x1858042307547328:12345-8592@kfi7:38:default-tuolumne1026-0 Request processed in 202us (254us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851871.189110:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8592@kfi7, seq: 2156344
00000100:00000040:16.0:1773851871.189111:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005dd2f4f7 : new rpc_count 2
00000100:00000001:16.0:1773851871.189112:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.189113:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.189114:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.189115:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.189116:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddc278b8.
00000020:00000040:16.0:1773851871.189116:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000005dd2f4f7 : new refcount 17
00000100:00000001:16.0:1773851871.189117:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851871.189123:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851871.189125:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.189126:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8529@kfi7: PUT: OK
00000400:00000200:17.0:1773851871.189127:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e45fdf1d
00000400:00000010:17.0:1773851871.189128:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e45fdf1d.
00000100:00000001:17.0:1773851871.189129:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851871.189129:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851871.189130:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000477b0000 nid 8529@kfi7 refs 2
00000800:00000200:17.0:1773851871.189132:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 8529@kfi7(00000000c4a3915c):0x0 lsk 4116 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1013 Transaction freed
00000800:00000200:30.0:1773851871.189254:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851871.189254:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851871.189254:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851871.189255:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851871.189256:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851871.189256:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851871.189258:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851871.189258:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8593@kfi7(000000001b23ed9e):0xe79 version: 2; local version 2; negotiated version: 2
00000800:00000200:29.0:1773851871.189259:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e79 Using peer 8593@kfi7(0x100000000000e79)
00000400:00000200:30.0:1773851871.189260:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000400:00000200:30.0:1773851871.189261:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8593@kfi7 : PUT - for me
00000400:00000200:29.0:1773851871.189261:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000400:00000200:30.0:1773851871.189263:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000800:00000200:29.0:1773851871.189263:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 38 bytes to peer 0x100000000000e79: rc=0
00000400:00000200:30.0:1773851871.189264:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bb8f385 nid 8593@kfi7 refs 1
00000800:00000200:29.0:1773851871.189265:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851871.189266:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000400:00000200:30.0:1773851871.189266:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bb8f385 nid 8593@kfi7 refs 2
00000400:00000200:30.0:1773851871.189267:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004bb8f385 nid 8593@kfi7 refs 3
00000400:00000200:30.0:1773851871.189268:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8592@kfi7 to cpt 4
00000400:00000200:30.0:1773851871.189269:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8592@kfi7 of length 512 into portal 12 MB=0x699e12fb798c0
00000400:00000200:30.0:1773851871.189271:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8592@kfi7 of length 512/512 into md 0x77fe139dd [64] + 177992
00000800:00000200:30.0:1773851871.189273:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851871.189275:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851871.189276:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8593@kfi7: PUT: OK
00000100:00000001:30.0:1773851871.189277:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851871.189277:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:29.0:1773851871.189277:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e79 TN_EVENT_TX_OK event status 0
00000100:00000010:30.0:1773851871.189278:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000912e612e.
00000100:00000040:30.0:1773851871.189279:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000912e612e x1858042307516608 msgsize 512
00000800:00000200:29.0:1773851871.189279:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e79 Transaction freed
00000100:00100000:30.0:1773851871.189281:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-8592@kfi7 (source: 12345-8593@kfi7)
00000100:00000001:30.0:1773851871.189282:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851871.189283:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004bb8f385 nid 8593@kfi7 refs 2
00000100:00000001:31.0:1773851871.189285:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851871.189285:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 8593@kfi7(000000001b23ed9e):0x0 lsk 3706 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851871.189286:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851871.189286:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851871.189287:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851871.189289:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851871.189290:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042307516608
00000020:00000001:31.0:1773851871.189291:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851871.189292:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91413
00000020:00000001:31.0:1773851871.189293:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851871.189296:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005dd2f4f7 refcount=18
00000020:00000001:31.0:1773851871.189297:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000020:00000001:31.0:1773851871.189298:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000100:00000001:31.0:1773851871.189300:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851871.189300:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851871.189302:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851871.189303:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851871.189304:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851871.189306:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851871.189307:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851871.189308:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:31.1F:1773851871.189311:0:42267:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000912e612e x1858042307516608/t0(0) o36->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:356/0 lens 512/0 e 0 to 0 dl 1773852471 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-834483147555077120'
00000100:00080000:31.1:1773851871.189318:0:42267:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000005c7d071a x1858042307516608/t0(0) o36->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:593/0 lens 512/448 e 1 to 0 dl 1773851953 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-834483147555077120'
00000100:00000001:31.0:1773851871.189323:0:42267:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:31.0:1773851871.189325:0:42267:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:31.0:1773851871.189326:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851871.189327:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851871.189328:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851871.189329:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851871.189332:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851871.189333:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000005dd2f4f7 : new refcount 17
00000100:00000001:31.0:1773851871.189334:0:42267:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851871.199257:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851871.199258:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851871.199259:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851871.199261:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851871.199263:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13459@kfi7 to cpt 5
00000400:00000200:21.0:1773851871.199265:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13459@kfi7 : PUT - for me
00000400:00000200:21.0:1773851871.199266:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13459@kfi7 to cpt 5
00000400:00000200:21.0:1773851871.199267:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c0f241cd nid 13459@kfi7 refs 1
00000400:00000200:21.0:1773851871.199268:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13459@kfi7 to cpt 5
00000400:00000200:21.0:1773851871.199269:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c0f241cd nid 13459@kfi7 refs 2
00000400:00000200:21.0:1773851871.199270:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c0f241cd nid 13459@kfi7 refs 3
00000400:00000200:21.0:1773851871.199271:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13395@kfi7 to cpt 1
00000400:00000200:21.0:1773851871.199272:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13395@kfi7 of length 224 into portal 12 MB=0x69b4cd1f1ad40
00000400:00000200:21.0:1773851871.199273:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13395@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 39752
00000800:00000200:21.0:1773851871.199275:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851871.199276:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851871.199277:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13459@kfi7: PUT: OK
00000100:00000001:21.0:1773851871.199278:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851871.199279:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851871.199280:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000648a21d8.
00000100:00000040:21.0:1773851871.199281:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000648a21d8 x1859604102360384 msgsize 224
00000100:00100000:21.0:1773851871.199282:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13395@kfi7 (source: 12345-13459@kfi7)
00000100:00000001:21.0:1773851871.199283:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851871.199284:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c0f241cd nid 13459@kfi7 refs 2
00000100:00000001:23.0:1773851871.199285:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851871.199285:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851871.199286:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851871.199286:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851871.199286:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851871.199287:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851871.199288:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859604102360384
00000020:00000001:23.0:1773851871.199288:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851871.199289:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7ab94
00000020:00000001:23.0:1773851871.199289:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851871.199295:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001481ae20 refcount=115
00000020:00000001:23.0:1773851871.199296:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105525064704 : -106968184486912 : ffff9eb6875c8400)
00000020:00000001:23.0:1773851871.199297:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105525064704 : -106968184486912 : ffff9eb6875c8400)
00000100:00000001:23.0:1773851871.199298:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851871.199298:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851871.199299:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b72ef93.
00000020:00000010:23.0:1773851871.199300:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851871.199301:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851871.199302:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851871.199302:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851871.199303:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851871.199304:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851871.199304:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851871.199305:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.199306:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851871.199307:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851871.199307:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851871.199307:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851871.199308:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13395@kfi7, seq: 1997989
00000100:00000001:20.0:1773851871.199308:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851871.199309:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001481ae20 : new rpc_count 2
00000100:00000001:20.0:1773851871.199309:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851871.199310:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.199311:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788286592 : -106974921265024 : ffff9eb4f5d17080)
00000100:00000040:23.0:1773851871.199312:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000648a21d8 x1859604102360384/t0(0) o400->76eaa1ef-5ee4-426c-80cc-0867211b0760@13395@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1334-0'
00000100:00000001:23.0:1773851871.199315:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851871.199315:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851871.199316:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000648a21d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:76eaa1ef-5ee4-426c-80cc-0867211b0760+115:39717:x1859604102360384:12345-13395@kfi7:400:default-tuolumne1334-0
00000100:00000200:23.0:1773851871.199318:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859604102360384
00000020:00000001:23.0:1773851871.199318:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851871.199319:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851871.199320:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.199320:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851871.199321:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851871.199321:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851871.199322:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859604102360384, found 0 last_xid 1859603968649727
00000020:00000001:23.0:1773851871.199323:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851871.199324:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851871.199324:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851871.199325:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.199325:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851871.199326:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851871.199326:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851871.199327:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a8639055.
02000000:00000001:23.0:1773851871.199328:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.199328:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.199329:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851871.199330:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264029026, transno 0, xid 1859604102360384
00010000:00000001:23.0:1773851871.199330:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851871.199331:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000648a21d8 x1859604102360384/t0(0) o400->76eaa1ef-5ee4-426c-80cc-0867211b0760@13395@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1334-0'
00010000:00000001:23.0:1773851871.199333:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851871.199334:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851871.199335:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=104 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851871.199336:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851871.199337:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e93c258b refcount 3 to 13395@kfi7
00000100:00000001:23.0:1773851871.199338:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636949266836384 : -107124442715232 : ffff9e9225a52ba0)
02000000:00000001:23.0:1773851871.199339:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851871.199339:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.199340:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851871.199341:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13459@kfi7
00000400:00000010:23.0:1773851871.199341:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009b97a0f1.
00000100:00000200:23.0:1773851871.199342:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859604102360384, offset 224
00000400:00000200:23.0:1773851871.199343:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13459@kfi7
00000400:00000200:23.0:1773851871.199344:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13459@kfi7 to cpt 5
00000400:00000200:23.0:1773851871.199345:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c0f241cd nid 13459@kfi7 refs 1
00000400:00000200:23.0:1773851871.199346:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c0f241cd nid 13459@kfi7 refs 2
00000400:00000200:23.0:1773851871.199347:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c0f241cd nid 13459@kfi7 refs 3
00000400:00000200:23.0:1773851871.199348:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13459@kfi7 local destination
00000400:00000200:23.0:1773851871.199350:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769359:8769359:1024:4294967295] 13459@kfi7 LPNI seq info [17255154:17255154:16:4294967295]
00000400:00000200:23.0:1773851871.199351:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c0f241cd nid 13459@kfi7 refs 2
00000400:00000200:23.0:1773851871.199352:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13459@kfi7 to cpt 5
00000400:00000200:23.0:1773851871.199354:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13459@kfi7(13459@kfi7:13459@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851871.199355:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c0f241cd nid 13459@kfi7 refs 3
00000800:00000200:23.0:1773851871.199356:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851871.199357:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851871.199359:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851871.199362:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd68 Using peer 13459@kfi7(0xd68)
00000800:00000200:23.0:1773851871.199365:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0xd68: rc=0
00000800:00000200:23.0:1773851871.199366:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd68 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851871.199368:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851871.199370:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e93c258b refcount 2 to 13395@kfi7
00010000:00000001:23.0:1773851871.199370:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851871.199371:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.199371:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851871.199372:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000648a21d8 x1859604102360384/t0(0) o400->76eaa1ef-5ee4-426c-80cc-0867211b0760@13395@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1334-0'
00000100:00100000:23.0:1773851871.199375:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000648a21d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:76eaa1ef-5ee4-426c-80cc-0867211b0760+115:39717:x1859604102360384:12345-13395@kfi7:400:default-tuolumne1334-0 Request processed in 59us (93us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851871.199377:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13395@kfi7, seq: 1997989
00000100:00000040:23.0:1773851871.199378:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001481ae20 : new rpc_count 1
00000800:00000200:21.0:1773851871.199378:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd68 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851871.199379:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851871.199379:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851871.199379:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851871.199380:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000400:00000200:21.0:1773851871.199380:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851871.199381:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b72ef93.
00000400:00000200:21.0:1773851871.199381:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13459@kfi7: PUT: OK
00000020:00000040:23.0:1773851871.199382:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000001481ae20 : new refcount 114
00000100:00000001:23.0:1773851871.199382:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851871.199382:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009b97a0f1
00000400:00000010:21.0:1773851871.199382:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009b97a0f1.
00000100:00000001:21.0:1773851871.199383:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851871.199383:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851871.199384:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c0f241cd nid 13459@kfi7 refs 2
00000800:00000200:21.0:1773851871.199386:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 13459@kfi7(0000000093fe4355):0x0 lsk 3433 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd68 Transaction freed
00000800:00000200:30.0:1773851871.200126:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851871.200126:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851871.200127:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851871.200127:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851871.200128:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851871.200128:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851871.200130:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851871.200132:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000800:00000200:29.0:1773851871.200132:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8593@kfi7(00000000bac2c250):0xec1 version: 2; local version 2; negotiated version: 2
00000400:00000200:30.0:1773851871.200133:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8593@kfi7 : PUT - for me
00000400:00000200:30.0:1773851871.200134:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000400:00000200:30.0:1773851871.200134:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bb8f385 nid 8593@kfi7 refs 1
00000800:00000200:29.0:1773851871.200134:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xec1 Using peer 8593@kfi7(0xec1)
00000400:00000200:30.0:1773851871.200135:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000400:00000200:30.0:1773851871.200136:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bb8f385 nid 8593@kfi7 refs 2
00000400:00000200:30.0:1773851871.200137:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004bb8f385 nid 8593@kfi7 refs 3
00000400:00000200:30.0:1773851871.200138:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8592@kfi7 to cpt 4
00000400:00000200:29.0:1773851871.200138:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8593@kfi7 to cpt 7
00000400:00000200:30.0:1773851871.200139:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8592@kfi7 of length 2528 into portal 12 MB=0x699e12fb6dac0
00000800:00000200:29.0:1773851871.200139:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 38 bytes to peer 0xec1: rc=0
00000400:00000200:30.0:1773851871.200140:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8592@kfi7 of length 2528/2528 into md 0x77fe139dd [64] + 178504
00000800:00000200:29.0:1773851871.200141:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xec1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851871.200142:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851871.200144:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851871.200145:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8593@kfi7: PUT: OK
00000100:00000001:30.0:1773851871.200146:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851871.200146:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851871.200147:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000002e49b11.
00000100:00000040:30.0:1773851871.200148:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000002e49b11 x1858042307467968 msgsize 2528
00000100:00100000:30.0:1773851871.200150:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-8592@kfi7 (source: 12345-8593@kfi7)
00000100:00000001:30.0:1773851871.200150:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851871.200151:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004bb8f385 nid 8593@kfi7 refs 2
00000100:00000001:31.0:1773851871.200153:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851871.200153:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:29.0:1773851871.200153:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xec1 TN_EVENT_TX_OK event status 0
02000000:00000001:31.0:1773851871.200154:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851871.200154:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851871.200155:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851871.200155:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 8593@kfi7(00000000bac2c250):0x0 lsk 3778 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0xec1 Transaction freed
02000000:00000001:31.0:1773851871.200156:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851871.200156:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042307467968
00000020:00000001:31.0:1773851871.200157:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851871.200157:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91413
00000020:00000001:31.0:1773851871.200158:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851871.200158:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005dd2f4f7 refcount=18
00000020:00000001:31.0:1773851871.200159:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000020:00000001:31.0:1773851871.200160:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169326592 : -107127540225024 : ffff9e916d04ec00)
00000100:00000001:31.0:1773851871.200161:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851871.200162:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851871.200162:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851871.200163:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851871.200164:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851871.200165:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851871.200165:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:31.0:1773851871.200166:0:42267:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:31.0:1773851871.200169:0:42267:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000f172b5e2 cookie 0x9d69fc283ef4cec5  req@0000000002e49b11 x1858042307467968/t0(0) o101->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:356/0 lens 2528/0 e 0 to 0 dl 1773852471 ref 1 fl New:/2/ffffffff rc 0/-1 job:'default-tuolumne1026-33580'
00010000:00000001:31.0:1773851871.200172:0:42267:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:31.0:1773851871.200172:0:42267:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:31.0:1773851871.200172:0:42267:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851871.200173:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:31.1:1773851871.200174:0:42267:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000002e49b11 x1858042307467968/t0(0) o101->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:356/0 lens 2528/0 e 0 to 0 dl 1773852471 ref 1 fl New:/2/ffffffff rc 0/-1 job:'default-tuolumne1026-33580'
00000100:00080000:31.1:1773851871.200177:0:42267:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000d009731d x1858042307467968/t0(0) o101->7bede783-62a8-4786-99a3-9badf953921d@8592@kfi7:534/0 lens 2528/5304 e 2 to 0 dl 1773851805 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1026-33580'
00000100:00000001:31.0:1773851871.200180:0:42267:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:31.0:1773851871.200181:0:42267:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:31.0:1773851871.200182:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851871.200182:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851871.200183:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851871.200184:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851871.200184:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851871.200185:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000005dd2f4f7 : new refcount 17
00000100:00000001:31.0:1773851871.200186:0:42267:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851871.249623:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.249624:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.249625:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.249628:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.249629:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.249631:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.249632:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.249632:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851871.249633:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.249634:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851871.249635:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851871.249636:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851871.249637:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c958f80
00000400:00000200:5.0:1773851871.249638:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x793844545 [256] + 6512
00000800:00000200:5.0:1773851871.249640:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.249641:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.249643:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851871.249644:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.249644:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851871.249645:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008ac3fb97.
00000100:00000040:5.0:1773851871.249646:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008ac3fb97 x1858065608839040 msgsize 224
00000100:00100000:5.0:1773851871.249647:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00000100:00000001:5.0:1773851871.249649:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851871.249650:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851871.249651:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851871.249654:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851871.249655:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851871.249655:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851871.249656:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851871.249656:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851871.249657:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608839040
00000020:00000001:5.0:1773851871.249658:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851871.249658:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:5.0:1773851871.249659:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851871.249659:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:5.0:1773851871.249660:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:5.0:1773851871.249661:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:5.0:1773851871.249662:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851871.249663:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851871.249664:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000020:00000010:5.0:1773851871.249665:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851871.249666:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000699dfc15.
00000100:00000040:5.0:1773851871.249667:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851871.249668:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851871.249668:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851871.249669:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.249669:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.249670:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851871.249672:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851871.249672:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851871.249672:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:6.0:1773851871.249673:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851871.249673:0:1203214:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314080
00000100:00000001:6.0:1773851871.249674:0:1537125:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851871.249674:0:1537125:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851871.249674:0:1203214:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:5.0:1773851871.249674:0:1203214:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886779648 : -106955822771968 : ffff9eb9682d5100)
00000100:00000040:5.0:1773851871.249675:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008ac3fb97 x1858065608839040/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:5.0:1773851871.249678:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851871.249678:0:1203214:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851871.249679:0:1203214:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ac3fb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065608839040:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:5.0:1773851871.249680:0:1203214:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608839040
00000020:00000001:5.0:1773851871.249680:0:1203214:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:5.0:1773851871.249681:0:1203214:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:5.0:1773851871.249681:0:1203214:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851871.249682:0:1203214:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851871.249682:0:1203214:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:5.0:1773851871.249683:0:1203214:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851871.249684:0:1203214:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851871.249684:0:1203214:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851871.249685:0:1203214:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851871.249685:0:1203214:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.249686:0:1203214:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851871.249686:0:1203214:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851871.249688:0:1203214:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000779dce74.
02000000:00000001:5.0:1773851871.249688:0:1203214:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.249689:0:1203214:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851871.249690:0:1203214:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:5.0:1773851871.249690:0:1203214:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:5.0:1773851871.249691:0:1203214:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:5.0:1773851871.249692:0:1203214:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:5.0:1773851871.249693:0:1203214:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:5.0:1773851871.249694:0:1203214:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851871.249695:0:1203214:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608839040
00010000:00000001:5.0:1773851871.249695:0:1203214:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851871.249696:0:1203214:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008ac3fb97 x1858065608839040/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:5.0:1773851871.249699:0:1203214:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851871.249699:0:1203214:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851871.249700:0:1203214:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=100 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851871.249701:0:1203214:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851871.249701:0:1203214:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:5.0:1773851871.249702:0:1203214:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:5.0:1773851871.249703:0:1203214:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851871.249703:0:1203214:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.249704:0:1203214:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851871.249704:0:1203214:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000400:00000010:5.0:1773851871.249705:0:1203214:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070e61bd6.
00000100:00000200:5.0:1773851871.249706:0:1203214:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608839040, offset 224
00000400:00000200:5.0:1773851871.249707:0:1203214:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000400:00000200:5.0:1773851871.249708:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.249708:0:1203214:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851871.249709:0:1203214:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851871.249710:0:1203214:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851871.249711:0:1203214:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  30@kfi7 local destination
00000400:00000200:5.0:1773851871.249712:0:1203214:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769360:8769360:1024:4294967295] 30@kfi7 LPNI seq info [23133317:23133317:16:4294967295]
00000400:00000200:5.0:1773851871.249713:0:1203214:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851871.249714:0:1203214:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.249716:0:1203214:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851871.249717:0:1203214:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000800:00000200:5.0:1773851871.249718:0:1203214:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.249719:0:1203214:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:5.0:1773851871.249721:0:1203214:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851871.249722:0:1203214:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000800:00000200:5.0:1773851871.249730:0:1203214:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 468 bytes to peer 0x2000000000000fe: rc=0
00000800:00000200:5.0:1773851871.249732:0:1203214:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851871.249734:0:1203214:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851871.249735:0:1203214:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:5.0:1773851871.249735:0:1203214:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851871.249736:0:1203214:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851871.249736:0:1203214:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851871.249737:0:1203214:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008ac3fb97 x1858065608839040/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:5.0:1773851871.249740:0:1203214:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ac3fb97 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_019:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065608839040:12345-13@kfi7:41:default-yuba3-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851871.249742:0:1203214:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314080
00000100:00000040:5.0:1773851871.249742:0:1203214:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000100:00000001:5.0:1773851871.249743:0:1203214:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851871.249744:0:1203214:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851871.249744:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000800:00000200:6.0:1773851871.249745:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851871.249745:0:1203214:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000699dfc15.
00000020:00000010:5.0:1773851871.249745:0:1203214:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000400:00000200:6.0:1773851871.249746:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:5.0:1773851871.249746:0:1203214:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:5.0:1773851871.249747:0:1203214:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851871.249748:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000400:00000200:6.0:1773851871.249748:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070e61bd6
00000400:00000010:6.0:1773851871.249749:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070e61bd6.
00000100:00000001:6.0:1773851871.249749:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851871.249750:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851871.249751:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:6.0:1773851871.249753:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000000fe Transaction freed
00000800:00000200:17.0:1773851871.307874:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.307875:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.307876:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.307879:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.307881:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13731@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.307882:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13731@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.307883:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13731@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.307883:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000448ace47 nid 13731@kfi7 refs 1
00000400:00000200:17.0:1773851871.307885:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13731@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.307885:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000448ace47 nid 13731@kfi7 refs 2
00000400:00000200:17.0:1773851871.307886:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000448ace47 nid 13731@kfi7 refs 3
00000400:00000200:17.0:1773851871.307887:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13731@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.307888:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13731@kfi7 of length 224 into portal 12 MB=0x699e0db364ec0
00000400:00000200:17.0:1773851871.307889:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13731@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 16008
00000800:00000200:17.0:1773851871.307891:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.307893:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.307894:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13731@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.307895:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.307896:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.307897:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ddee6adf.
00000100:00000040:17.0:1773851871.307897:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ddee6adf x1858040889757376 msgsize 224
00000100:00100000:17.0:1773851871.307899:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13731@kfi7 (source: 12345-13731@kfi7)
00000100:00000001:17.0:1773851871.307900:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.307900:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000448ace47 nid 13731@kfi7 refs 2
00000100:00000001:16.0:1773851871.307901:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851871.307902:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.307902:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.307902:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.307903:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.307903:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.307904:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040889757376
00000020:00000001:16.0:1773851871.307905:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.307905:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9198b
00000020:00000001:16.0:1773851871.307906:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.307907:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f33df0ff refcount=6
00000020:00000001:16.0:1773851871.307908:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242244096 : -107152467307520 : ffff9e8b9f3fd400)
00000020:00000001:16.0:1773851871.307909:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242244096 : -107152467307520 : ffff9e8b9f3fd400)
00000100:00000001:16.0:1773851871.307910:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.307910:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.307911:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ddc278b8.
00000020:00000010:16.0:1773851871.307912:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.307913:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.307914:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.307914:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851871.307915:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.307916:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851871.307917:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851871.307917:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.307918:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851871.307919:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.307919:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851871.307920:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851871.307920:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851871.307921:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.307921:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13731@kfi7, seq: 2156345
00000100:00000040:16.0:1773851871.307921:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f33df0ff : new rpc_count 1
00000100:00000001:17.0:1773851871.307922:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.307922:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636970971038848 : -107102738512768 : ffff9e9733510480)
00000100:00000040:16.0:1773851871.307924:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ddee6adf x1858040889757376/t0(0) o400->d221f94b-e6d1-4f8e-bdb7-1393485c27fc@13731@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1340-0'
00000100:00000001:16.0:1773851871.307926:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.307927:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851871.307928:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ddee6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d221f94b-e6d1-4f8e-bdb7-1393485c27fc+6:39651:x1858040889757376:12345-13731@kfi7:400:default-tuolumne1340-0
00000100:00000200:16.0:1773851871.307929:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040889757376
00000020:00000001:16.0:1773851871.307930:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851871.307930:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851871.307931:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.307932:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851871.307932:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851871.307933:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851871.307934:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040889757376, found 0 last_xid 1858040889757375
00000020:00000001:16.0:1773851871.307934:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851871.307935:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851871.307936:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851871.307936:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.307937:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851871.307938:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851871.307938:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851871.307939:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003a004f4e.
02000000:00000001:16.0:1773851871.307940:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.307941:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.307942:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851871.307942:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182675796344, transno 0, xid 1858040889757376
00010000:00000001:16.0:1773851871.307943:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851871.307944:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ddee6adf x1858040889757376/t0(0) o400->d221f94b-e6d1-4f8e-bdb7-1393485c27fc@13731@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1340-0'
00010000:00000001:16.0:1773851871.307946:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851871.307947:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851871.307947:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=104 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851871.307948:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.307953:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000313cd16b refcount 3 to 13731@kfi7
00000100:00000001:16.0:1773851871.307953:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313507168 : -107139396044448 : ffff9e8eaa5b7960)
02000000:00000001:16.0:1773851871.307955:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851871.307955:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.307956:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851871.307957:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13731@kfi7
00000400:00000010:16.0:1773851871.307957:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000080265a65.
00000100:00000200:16.0:1773851871.307958:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040889757376, offset 224
00000400:00000200:16.0:1773851871.307959:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13731@kfi7
00000400:00000200:16.0:1773851871.307960:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13731@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.307961:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000448ace47 nid 13731@kfi7 refs 1
00000400:00000200:16.0:1773851871.307962:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000448ace47 nid 13731@kfi7 refs 2
00000400:00000200:16.0:1773851871.307963:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000448ace47 nid 13731@kfi7 refs 3
00000400:00000200:16.0:1773851871.307964:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13731@kfi7 local destination
00000400:00000200:16.0:1773851871.307965:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769361:8769361:1024:4294967295] 13731@kfi7 LPNI seq info [1628869:1628869:16:4294967295]
00000400:00000200:16.0:1773851871.307967:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000448ace47 nid 13731@kfi7 refs 2
00000400:00000200:16.0:1773851871.307968:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13731@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.307970:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13731@kfi7(13731@kfi7:13731@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851871.307971:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000448ace47 nid 13731@kfi7 refs 3
00000800:00000200:16.0:1773851871.307973:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851871.307974:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851871.307976:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851871.307978:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000753 Using peer 13731@kfi7(0x100000000000753)
00000800:00000200:16.0:1773851871.307981:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x100000000000753: rc=0
00000800:00000200:16.0:1773851871.307982:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000753 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851871.307985:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.307986:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000313cd16b refcount 2 to 13731@kfi7
00010000:00000001:16.0:1773851871.307986:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851871.307987:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.307988:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851871.307988:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ddee6adf x1858040889757376/t0(0) o400->d221f94b-e6d1-4f8e-bdb7-1393485c27fc@13731@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1340-0'
00000100:00100000:16.0:1773851871.307993:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ddee6adf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d221f94b-e6d1-4f8e-bdb7-1393485c27fc+6:39651:x1858040889757376:12345-13731@kfi7:400:default-tuolumne1340-0 Request processed in 65us (94us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851871.307995:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13731@kfi7, seq: 2156345
00000100:00000040:16.0:1773851871.307995:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f33df0ff : new rpc_count 0
00000100:00000001:16.0:1773851871.307996:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.307997:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.307997:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.307998:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.307999:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ddc278b8.
00000020:00000040:16.0:1773851871.308000:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000f33df0ff : new refcount 5
00000100:00000001:16.0:1773851871.308000:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851871.308005:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000753 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851871.308007:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.308008:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13731@kfi7: PUT: OK
00000400:00000200:17.0:1773851871.308008:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000080265a65
00000400:00000010:17.0:1773851871.308009:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000080265a65.
00000100:00000001:17.0:1773851871.308010:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851871.308010:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851871.308011:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000448ace47 nid 13731@kfi7 refs 2
00000800:00000200:17.0:1773851871.308012:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 13731@kfi7(00000000580fd30d):0x0 lsk 1876 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000753 Transaction freed
00000800:00000200:14.0:1773851871.327128:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851871.327129:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851871.327130:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851871.327132:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851871.327137:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18752@kfi7 to cpt 3
00000400:00000200:14.0:1773851871.327138:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18752@kfi7 : PUT - for me
00000400:00000200:14.0:1773851871.327139:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18752@kfi7 to cpt 3
00000400:00000200:14.0:1773851871.327140:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5b5b69d nid 18752@kfi7 refs 1
00000400:00000200:14.0:1773851871.327142:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18752@kfi7 to cpt 3
00000400:00000200:14.0:1773851871.327142:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5b5b69d nid 18752@kfi7 refs 2
00000400:00000200:14.0:1773851871.327143:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f5b5b69d nid 18752@kfi7 refs 3
00000400:00000200:14.0:1773851871.327144:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18753@kfi7 to cpt 6
00000400:00000200:14.0:1773851871.327145:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18753@kfi7 of length 224 into portal 12 MB=0x69b4c455d3700
00000400:00000200:14.0:1773851871.327147:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18753@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 33248
00000800:00000200:14.0:1773851871.327149:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851871.327150:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851871.327151:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18752@kfi7: PUT: OK
00000100:00000001:14.0:1773851871.327153:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851871.327153:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851871.327155:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c8f8b14.
00000100:00000040:14.0:1773851871.327155:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000009c8f8b14 x1859601743820544 msgsize 224
00000100:00100000:14.0:1773851871.327157:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-18753@kfi7 (source: 12345-18752@kfi7)
00000100:00000001:14.0:1773851871.327158:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851871.327159:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f5b5b69d nid 18752@kfi7 refs 2
00000100:00000001:12.0:1773851871.327160:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851871.327160:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851871.327161:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851871.327161:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851871.327161:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851871.327162:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851871.327162:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601743820544
00000020:00000001:12.0:1773851871.327163:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851871.327163:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e62d31250
00000020:00000001:12.0:1773851871.327164:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851871.327168:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000019f898a8 refcount=5
00000020:00000001:12.0:1773851871.327169:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097998212096 : -106975711339520 : ffff9eb4c6b9dc00)
00000020:00000001:12.0:1773851871.327170:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097998212096 : -106975711339520 : ffff9eb4c6b9dc00)
00000100:00000001:12.0:1773851871.327171:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851871.327172:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851871.327173:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851871.327174:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851871.327175:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000001:12.0:1773851871.327175:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851871.327176:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851871.327176:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851871.327177:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851871.327178:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851871.327178:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.327179:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851871.327181:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851871.327181:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851871.327182:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18753@kfi7, seq: 2289849
00000100:00000001:15.0:1773851871.327183:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851871.327183:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:12.0:1773851871.327183:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000019f898a8 : new rpc_count 1
00000100:00000001:15.0:1773851871.327184:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.327184:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562694912 : -106978146856704 : ffff9eb4358ed100)
00000100:00000040:12.0:1773851871.327185:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c8f8b14 x1859601743820544/t0(0) o400->efe0e077-9445-4831-a03a-f714e22e6dc6@18753@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1668-0'
00000100:00000001:15.0:1773851871.327186:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.327188:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851871.327189:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851871.327190:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c8f8b14 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:efe0e077-9445-4831-a03a-f714e22e6dc6+5:39723:x1859601743820544:12345-18753@kfi7:400:default-tuolumne1668-0
00000100:00000200:12.0:1773851871.327191:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601743820544
00000020:00000001:12.0:1773851871.327192:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851871.327193:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851871.327193:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.327194:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851871.327195:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851871.327196:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851871.327196:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601743820544, found 0 last_xid 1859601743820543
00000020:00000001:12.0:1773851871.327197:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851871.327198:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851871.327199:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851871.327199:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.327200:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851871.327201:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851871.327201:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851871.327202:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003308cf00.
02000000:00000001:12.0:1773851871.327202:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.327203:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.327204:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851871.327205:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260594592, transno 0, xid 1859601743820544
00010000:00000001:12.0:1773851871.327205:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851871.327206:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c8f8b14 x1859601743820544/t0(0) o400->efe0e077-9445-4831-a03a-f714e22e6dc6@18753@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1668-0'
00010000:00000001:12.0:1773851871.327209:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851871.327210:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851871.327210:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=104 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851871.327212:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851871.327212:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001c76ae28 refcount 3 to 18753@kfi7
00000100:00000001:12.0:1773851871.327213:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299332448 : -107155410219168 : ffff9e8aefd68f60)
02000000:00000001:12.0:1773851871.327214:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851871.327214:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.327215:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851871.327216:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18752@kfi7
00000400:00000010:12.0:1773851871.327217:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3dfef6f.
00000100:00000200:12.0:1773851871.327218:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601743820544, offset 224
00000400:00000200:12.0:1773851871.327219:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18752@kfi7
00000400:00000200:12.0:1773851871.327220:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18752@kfi7 to cpt 3
00000400:00000200:12.0:1773851871.327221:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5b5b69d nid 18752@kfi7 refs 1
00000400:00000200:12.0:1773851871.327222:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f5b5b69d nid 18752@kfi7 refs 2
00000400:00000200:12.0:1773851871.327224:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f5b5b69d nid 18752@kfi7 refs 3
00000400:00000200:12.0:1773851871.327225:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18752@kfi7 local destination
00000400:00000200:12.0:1773851871.327226:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769362:8769362:1024:4294967295] 18752@kfi7 LPNI seq info [222200:222200:16:4294967295]
00000400:00000200:12.0:1773851871.327228:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f5b5b69d nid 18752@kfi7 refs 2
00000400:00000200:12.0:1773851871.327229:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18752@kfi7 to cpt 3
00000400:00000200:12.0:1773851871.327231:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18752@kfi7(18752@kfi7:18752@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851871.327233:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f5b5b69d nid 18752@kfi7 refs 3
00000800:00000200:12.0:1773851871.327234:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851871.327236:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851871.327238:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851871.327241:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb79 Using peer 18752@kfi7(0xb79)
00000800:00000200:12.0:1773851871.327244:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0xb79: rc=0
00000800:00000200:12.0:1773851871.327246:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851871.327248:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851871.327249:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001c76ae28 refcount 2 to 18753@kfi7
00010000:00000001:12.0:1773851871.327250:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851871.327250:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.327251:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851871.327251:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c8f8b14 x1859601743820544/t0(0) o400->efe0e077-9445-4831-a03a-f714e22e6dc6@18753@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1668-0'
00000100:00100000:12.0:1773851871.327256:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c8f8b14 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:efe0e077-9445-4831-a03a-f714e22e6dc6+5:39723:x1859601743820544:12345-18753@kfi7:400:default-tuolumne1668-0 Request processed in 67us (100us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851871.327259:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18753@kfi7, seq: 2289849
00000100:00000040:12.0:1773851871.327260:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000019f898a8 : new rpc_count 0
00000100:00000001:12.0:1773851871.327260:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851871.327261:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851871.327262:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851871.327262:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:12.0:1773851871.327263:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000020:00000040:12.0:1773851871.327264:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000019f898a8 : new refcount 4
00000100:00000001:12.0:1773851871.327265:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851871.327271:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb79 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851871.327273:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851871.327274:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18752@kfi7: PUT: OK
00000400:00000200:14.0:1773851871.327275:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3dfef6f
00000400:00000010:14.0:1773851871.327276:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3dfef6f.
00000100:00000001:14.0:1773851871.327277:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851871.327278:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851871.327279:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f5b5b69d nid 18752@kfi7 refs 2
00000800:00000200:14.0:1773851871.327281:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 18752@kfi7(0000000055af52c9):0x0 lsk 2938 rsk 42 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb79 Transaction freed
00000800:00000200:13.0:1773851871.355389:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851871.355390:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851871.355391:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851871.355393:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851871.355395:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21187@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.355396:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21187@kfi7 : PUT - for me
00000400:00000200:13.0:1773851871.355398:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21187@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.355399:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044928784 nid 21187@kfi7 refs 1
00000400:00000200:13.0:1773851871.355400:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21187@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.355401:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044928784 nid 21187@kfi7 refs 2
00000400:00000200:13.0:1773851871.355402:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000044928784 nid 21187@kfi7 refs 3
00000400:00000200:13.0:1773851871.355403:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21187@kfi7 to cpt 3
00000400:00000200:13.0:1773851871.355403:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21187@kfi7 of length 224 into portal 12 MB=0x69b0952bbbf40
00000400:00000200:13.0:1773851871.355405:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21187@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 33472
00000800:00000200:13.0:1773851871.355406:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851871.355408:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851871.355408:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21187@kfi7: PUT: OK
00000100:00000001:13.0:1773851871.355409:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851871.355410:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851871.355411:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f16793f7.
00000100:00000040:13.0:1773851871.355411:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000f16793f7 x1859314205310784 msgsize 224
00000100:00100000:13.0:1773851871.355413:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21187@kfi7 (source: 12345-21187@kfi7)
00000100:00000001:13.0:1773851871.355414:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851871.355414:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000044928784 nid 21187@kfi7 refs 2
00000800:00000200:13.0:1773851871.355415:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851871.355416:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851871.355417:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851871.355418:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851871.355419:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851871.355420:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851871.355421:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314205310784
00000020:00000001:12.0:1773851871.355422:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851871.355423:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91619
00000020:00000001:12.0:1773851871.355423:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851871.355428:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bc3e60e4 refcount=6
00000020:00000001:12.0:1773851871.355429:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241265152 : -107152468286464 : ffff9e8b9f30e400)
00000020:00000001:12.0:1773851871.355430:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241265152 : -107152468286464 : ffff9e8b9f30e400)
00000100:00000001:12.0:1773851871.355432:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851871.355433:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851871.355434:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851871.355435:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851871.355436:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000001:12.0:1773851871.355437:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851871.355438:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851871.355439:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851871.355440:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851871.355441:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851871.355441:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.355443:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851871.355445:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851871.355445:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851871.355445:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851871.355446:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851871.355447:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21187@kfi7, seq: 2289850
00000100:00000001:15.0:1773851871.355448:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851871.355448:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bc3e60e4 : new rpc_count 1
00000100:00000001:15.0:1773851871.355449:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.355449:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970992768 : -107043738558848 : ffff9ea4effcde80)
00000100:00000040:12.0:1773851871.355450:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f16793f7 x1859314205310784/t0(0) o400->1778d577-52a5-4dd4-8871-ee471ea4b821@21187@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1815-0'
00000100:00000001:12.0:1773851871.355455:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851871.355455:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851871.355457:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f16793f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:1778d577-52a5-4dd4-8871-ee471ea4b821+6:39541:x1859314205310784:12345-21187@kfi7:400:default-tuolumne1815-0
00000100:00000200:12.0:1773851871.355460:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314205310784
00000020:00000001:12.0:1773851871.355460:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851871.355461:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851871.355462:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.355463:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851871.355464:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851871.355465:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851871.355466:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314205310784, found 0 last_xid 1859314205310783
00000020:00000001:12.0:1773851871.355467:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851871.355468:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851871.355468:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851871.355469:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.355470:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851871.355471:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851871.355471:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851871.355472:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008579fe77.
02000000:00000001:12.0:1773851871.355473:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.355474:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.355475:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851871.355476:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044175350, transno 0, xid 1859314205310784
00010000:00000001:12.0:1773851871.355477:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851871.355478:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f16793f7 x1859314205310784/t0(0) o400->1778d577-52a5-4dd4-8871-ee471ea4b821@21187@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1815-0'
00010000:00000001:12.0:1773851871.355482:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851871.355483:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851871.355484:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=104 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851871.355485:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851871.355486:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007abcc4d1 refcount 3 to 21187@kfi7
00000100:00000001:12.0:1773851871.355487:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152512 : -107139310399104 : ffff9e8eaf765180)
02000000:00000001:12.0:1773851871.355488:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851871.355489:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.355490:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851871.355491:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21187@kfi7
00000400:00000010:12.0:1773851871.355492:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d0c203c4.
00000100:00000200:12.0:1773851871.355494:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314205310784, offset 224
00000400:00000200:12.0:1773851871.355496:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21187@kfi7
00000400:00000200:12.0:1773851871.355497:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21187@kfi7 to cpt 3
00000400:00000200:12.0:1773851871.355499:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044928784 nid 21187@kfi7 refs 1
00000400:00000200:12.0:1773851871.355500:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000044928784 nid 21187@kfi7 refs 2
00000400:00000200:12.0:1773851871.355502:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000044928784 nid 21187@kfi7 refs 3
00000400:00000200:12.0:1773851871.355504:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21187@kfi7 local destination
00000400:00000200:12.0:1773851871.355506:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769363:8769363:1024:4294967295] 21187@kfi7 LPNI seq info [946411:946411:16:4294967295]
00000400:00000200:12.0:1773851871.355509:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000044928784 nid 21187@kfi7 refs 2
00000400:00000200:12.0:1773851871.355510:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21187@kfi7 to cpt 3
00000400:00000200:12.0:1773851871.355513:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21187@kfi7(21187@kfi7:21187@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851871.355515:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000044928784 nid 21187@kfi7 refs 3
00000800:00000200:12.0:1773851871.355517:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851871.355519:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851871.355523:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851871.355526:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5d Using peer 21187@kfi7(0x5d)
00000800:00000200:12.0:1773851871.355531:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x5d: rc=0
00000800:00000200:12.0:1773851871.355533:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851871.355536:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851871.355537:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007abcc4d1 refcount 2 to 21187@kfi7
00010000:00000001:12.0:1773851871.355538:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851871.355541:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851871.355542:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851871.355543:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f16793f7 x1859314205310784/t0(0) o400->1778d577-52a5-4dd4-8871-ee471ea4b821@21187@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1815-0'
00000100:00100000:12.0:1773851871.355548:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f16793f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:1778d577-52a5-4dd4-8871-ee471ea4b821+6:39541:x1859314205310784:12345-21187@kfi7:400:default-tuolumne1815-0 Request processed in 92us (136us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851871.355553:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21187@kfi7, seq: 2289850
00000100:00000040:12.0:1773851871.355554:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bc3e60e4 : new rpc_count 0
00000100:00000001:12.0:1773851871.355555:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851871.355556:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851871.355556:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851871.355557:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:12.0:1773851871.355559:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000020:00000040:12.0:1773851871.355560:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000bc3e60e4 : new refcount 5
00000100:00000001:12.0:1773851871.355561:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851871.355567:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5d TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851871.355569:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851871.355570:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21187@kfi7: PUT: OK
00000400:00000200:13.0:1773851871.355570:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d0c203c4
00000400:00000010:13.0:1773851871.355571:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d0c203c4.
00000100:00000001:13.0:1773851871.355571:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851871.355572:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851871.355572:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000044928784 nid 21187@kfi7 refs 2
00000800:00000200:13.0:1773851871.355574:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 21187@kfi7(00000000e5b7c2ed):0x0 lsk 94 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5d Transaction freed
00010000:00000001:2.0:1773851871.369731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851871.369732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851871.369733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851871.369734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851871.369735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851871.369736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851871.369737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851871.369738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851871.369738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851871.369742:0:937832:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851871.369742:0:937832:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851871.369743:0:937832:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851871.401533:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851871.401534:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851871.401535:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851871.401535:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851871.401536:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851871.401536:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851871.401538:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851871.401538:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18371@kfi7(00000000f53e7dff):0xa1e version: 2; local version 2; negotiated version: 2
00000400:00000200:27.0:1773851871.401541:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18371@kfi7 to cpt 6
00000800:00000200:25.0:1773851871.401541:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e Using peer 18371@kfi7(0x100000000000a1e)
00000400:00000200:27.0:1773851871.401542:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18371@kfi7 : PUT - for me
00000400:00000200:27.0:1773851871.401543:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18371@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.401544:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000081d7a02e nid 18371@kfi7 refs 1
00000400:00000200:27.0:1773851871.401545:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18371@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.401545:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000081d7a02e nid 18371@kfi7 refs 2
00000400:00000200:27.0:1773851871.401546:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000081d7a02e nid 18371@kfi7 refs 3
00000400:00000200:27.0:1773851871.401548:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18178@kfi7 to cpt 1
00000400:00000200:25.0:1773851871.401548:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18371@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.401549:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18178@kfi7 of length 456 into portal 12 MB=0x699e110a0d340
00000800:00000200:25.0:1773851871.401550:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000f6d78ee2: Posted send of 38 bytes to peer 0x100000000000a1e: rc=0
00000400:00000200:27.0:1773851871.401551:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18178@kfi7 of length 456/456 into md 0x16159c9699 [64] + 10728
00000800:00000200:27.0:1773851871.401552:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851871.401552:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851871.401554:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851871.401555:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18371@kfi7: PUT: OK
00000100:00000001:27.0:1773851871.401556:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851871.401556:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851871.401557:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004ad6e18b.
00000100:00000040:27.0:1773851871.401558:0:2464256:0:(events.c:358:request_in_callback()) incoming req@000000004ad6e18b x1858041785930560 msgsize 456
00000100:00100000:27.0:1773851871.401560:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-18178@kfi7 (source: 12345-18371@kfi7)
00000100:00000001:27.0:1773851871.401560:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851871.401561:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000081d7a02e nid 18371@kfi7 refs 2
00000100:00000001:25.0:1773851871.401562:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:27.0:1773851871.401563:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:25.0:1773851871.401563:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851871.401564:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851871.401564:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851871.401565:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851871.401566:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041785930560
00000020:00000001:25.0:1773851871.401567:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851871.401567:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9238d
00000800:00000200:27.0:1773851871.401568:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e TN_EVENT_TX_OK event status 0
00000020:00000001:25.0:1773851871.401568:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:27.0:1773851871.401570:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e Transaction freed
00000020:00000040:25.0:1773851871.401573:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000044cced3b refcount=8
00000020:00000001:25.0:1773851871.401573:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630287360 : -107123079264256 : ffff9e9276e9c800)
00000020:00000001:25.0:1773851871.401574:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630287360 : -107123079264256 : ffff9e9276e9c800)
00000100:00000001:25.0:1773851871.401575:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.401576:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851871.401577:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089cac470.
00000020:00000010:25.0:1773851871.401578:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851871.401578:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851871.401579:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851871.401580:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851871.401580:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.401582:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.401583:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851871.401584:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851871.401584:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851871.401586:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18178@kfi7, seq: 1451911031
00000100:00000040:25.0:1773851871.401586:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000044cced3b : new rpc_count 3
00000100:00000001:25.0:1773851871.401587:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998403200 : -107053711148416 : ffff9ea29d933a80)
00000100:00000040:25.0:1773851871.401588:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004ad6e18b x1858041785930560/t0(0) o17->7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e@18178@kfi7:598/0 lens 456/0 e 0 to 0 dl 1773851958 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1639-0'
00000100:00000001:25.0:1773851871.401591:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.401591:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851871.401592:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ad6e18b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e+8:39665:x1858041785930560:12345-18178@kfi7:17:default-tuolumne1639-0
00000100:00000200:25.0:1773851871.401594:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041785930560
00000020:00000001:25.0:1773851871.401594:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851871.401595:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851871.401596:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.401596:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851871.401597:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:25.0:1773851871.401598:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851871.401598:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041785930560, found 0 last_xid 1858041785369791
00000020:00000001:25.0:1773851871.401599:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851871.401599:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851871.401600:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851871.401600:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851871.401601:0:41182:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:25.0:1773851871.401602:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851871.401603:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851871.401603:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000006799f437.
02000000:00000001:25.0:1773851871.401604:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.401605:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.401605:0:41182:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:25.0:1773851871.401606:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:25.0:1773851871.401607:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:25.0:1773851871.401608:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.401609:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:25.0:1773851871.401610:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e/0000000044cced3b free: 126633370845184 avail: 126633368748032
00000020:00000001:25.0:1773851871.401611:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:25.0:1773851871.401611:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e/0000000044cced3b avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:25.0:1773851871.401612:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:25.0:1773851871.401613:0:41182:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:25.0:1773851871.401614:0:41182:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e/0000000044cced3b reports grant 1808793599 dropped 0, local 1876951039
00000020:00000001:25.0:1773851871.401615:0:41182:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:25.0:1773851871.401615:0:41182:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:25.0:1773851871.401616:0:41182:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851871.401617:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263610764, transno 0, xid 1858041785930560
00010000:00000001:25.0:1773851871.401617:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851871.401618:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004ad6e18b x1858041785930560/t0(0) o17->7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e@18178@kfi7:598/0 lens 456/432 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1639-0'
00010000:00000001:25.0:1773851871.401621:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851871.401621:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851871.401622:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=104 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851871.401623:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851871.401624:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000096033d6b refcount 3 to 18178@kfi7
00000100:00000001:25.0:1773851871.401624:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703360 : -107156155848256 : ffff9e8ac36529c0)
02000000:00000001:25.0:1773851871.401625:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851871.401626:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.401626:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851871.401627:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18371@kfi7
00000400:00000010:25.0:1773851871.401628:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4d002ce.
00000100:00000200:25.0:1773851871.401629:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858041785930560, offset 224
00000400:00000200:25.0:1773851871.401630:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18371@kfi7
00000400:00000200:25.0:1773851871.401631:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18371@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.401632:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000081d7a02e nid 18371@kfi7 refs 1
00000400:00000200:25.0:1773851871.401633:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000081d7a02e nid 18371@kfi7 refs 2
00000400:00000200:25.0:1773851871.401634:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000081d7a02e nid 18371@kfi7 refs 3
00000400:00000200:25.0:1773851871.401635:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18371@kfi7 local destination
00000400:00000200:25.0:1773851871.401636:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769364:8769364:1024:4294967295] 18371@kfi7 LPNI seq info [420128:420128:16:4294967295]
00000400:00000200:25.0:1773851871.401638:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000081d7a02e nid 18371@kfi7 refs 2
00000400:00000200:25.0:1773851871.401639:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18371@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.401641:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18371@kfi7(18371@kfi7:18371@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851871.401642:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000081d7a02e nid 18371@kfi7 refs 3
00000800:00000200:25.0:1773851871.401644:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.401645:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:25.0:1773851871.401647:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851871.401649:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e Using peer 18371@kfi7(0x100000000000a1e)
00000800:00000200:25.0:1773851871.401651:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000055b583f: Posted send of 532 bytes to peer 0x100000000000a1e: rc=0
00000800:00000200:25.0:1773851871.401653:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851871.401655:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.401656:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000096033d6b refcount 2 to 18178@kfi7
00010000:00000001:25.0:1773851871.401656:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851871.401657:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.401657:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851871.401658:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004ad6e18b x1858041785930560/t0(0) o17->7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e@18178@kfi7:598/0 lens 456/432 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1639-0'
00000100:00100000:25.0:1773851871.401661:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ad6e18b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7a6a51ea-d9c5-4d38-8fc5-d30254b4ee6e+8:39665:x1858041785930560:12345-18178@kfi7:17:default-tuolumne1639-0 Request processed in 69us (102us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851871.401663:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18178@kfi7, seq: 1451911031
00000100:00000040:25.0:1773851871.401664:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000044cced3b : new rpc_count 2
00000100:00000001:25.0:1773851871.401665:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851871.401665:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:27.0:1773851871.401666:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e TN_EVENT_TX_OK event status 0
00000020:00000010:25.0:1773851871.401666:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851871.401666:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000020:00000010:25.0:1773851871.401667:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089cac470.
00000400:00000200:27.0:1773851871.401668:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:25.0:1773851871.401668:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000044cced3b : new refcount 7
00000100:00000001:25.0:1773851871.401668:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851871.401669:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18371@kfi7: PUT: OK
00000400:00000200:27.0:1773851871.401669:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4d002ce
00000400:00000010:27.0:1773851871.401670:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4d002ce.
00000100:00000001:27.0:1773851871.401670:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851871.401671:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851871.401672:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000081d7a02e nid 18371@kfi7 refs 2
00000800:00000200:27.0:1773851871.401673:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 18371@kfi7(00000000f53e7dff):0x0 lsk 2591 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a1e Transaction freed
00000800:00000200:5.0:1773851871.467130:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.467131:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.467132:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.467134:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.467136:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.467137:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26514@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.467138:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.467139:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 1
00000400:00000200:5.0:1773851871.467139:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.467140:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000400:00000200:5.0:1773851871.467141:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 3
00000400:00000200:5.0:1773851871.467142:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:5.0:1773851871.467143:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 520 into portal 12 MB=0x699e78c5df080
00000400:00000200:5.0:1773851871.467144:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 520/520 into md 0x793926dc5 [64] + 138824
00000800:00000200:5.0:1773851871.467146:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.467148:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.467149:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26514@kfi7: PUT: OK
00000100:00000001:5.0:1773851871.467150:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.467150:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851871.467151:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076eb54fb.
00000100:00000040:5.0:1773851871.467151:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000076eb54fb x1858069631725696 msgsize 520
00000100:00100000:5.0:1773851871.467153:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26514@kfi7)
00000100:00000001:5.0:1773851871.467154:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851871.467155:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000800:00000200:5.0:1773851871.467157:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000127bdbe5: 2054@kfi7:1 <- 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851871.467159:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851871.467159:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851871.467160:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851871.467160:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851871.467161:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851871.467162:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069631725696
00000020:00000001:5.0:1773851871.467162:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851871.467163:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000020:00000001:5.0:1773851871.467163:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851871.467164:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=23
00000020:00000001:5.0:1773851871.467165:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000020:00000001:5.0:1773851871.467165:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000001:5.0:1773851871.467166:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851871.467167:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851871.467167:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000020:00000010:5.0:1773851871.467169:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851871.467169:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000699dfc15.
00000100:00000001:5.0:1773851871.467170:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851871.467171:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851871.467171:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851871.467172:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:5.0:1773851871.467173:0:61015:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@0000000076eb54fb x1858069631725696/t0(0) o38->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852071 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne2150-0'
00000100:00000001:5.0:1773851871.467175:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:5.0:1773851871.467176:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.467177:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851871.467178:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851871.467178:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851871.467178:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851871.467178:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851871.467179:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26450@kfi7, seq: 2001928
00000100:00000001:7.0:1773851871.467180:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.467180:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851871.467180:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004c7f489e : new rpc_count 8
00000100:00000001:5.0:1773851871.467180:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117886775040 : -106955822776576 : ffff9eb9682d3f00)
00000100:00000040:5.0:1773851871.467181:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000076eb54fb x1858069631725696/t0(0) o38->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852071 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne2150-0'
00000100:00000001:5.0:1773851871.467184:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851871.467184:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851871.467185:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076eb54fb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:fd24374c-b27d-48f0-a139-ff2894eae03b+23:40571:x1858069631725696:12345-26450@kfi7:38:login-tuolumne2150-0
00000100:00000200:5.0:1773851871.467186:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858069631725696
00000020:00000001:5.0:1773851871.467187:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:5.0:1773851871.467187:0:61015:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:5.0:1773851871.467189:0:61015:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:5.0:1773851871.467190:0:61015:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:5.0:1773851871.467191:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851871.467192:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851871.467193:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 000000001e1c9696.
02000000:00000001:5.0:1773851871.467193:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.467194:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851871.467196:0:61015:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:5.0:1773851871.467196:0:61015:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client fd24374c-b27d-48f0-a139-ff2894eae03b (at 26450@kfi7) reconnecting
00010000:00000001:5.0:1773851871.467197:0:61015:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:5.0:1773851871.467198:0:61015:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:5.0:1773851871.467199:0:61015:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7 t175697824433 exp 000000004c7f489e cur 614145 last 1773851871
00010000:00000001:5.0:1773851871.467201:0:61015:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:5.0:1773851871.467201:0:61015:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:5.0:1773851871.467202:0:61015:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:5.0:1773851871.467203:0:61015:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:5.0:1773851871.467203:0:61015:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:5.0:1773851871.467205:0:61015:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:5.0:1773851871.467205:0:61015:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:5.0:1773851871.467206:0:61015:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:5.0:1773851871.467207:0:61015:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:5.0:1773851871.467208:0:61015:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851871.467208:0:61015:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:5.0:1773851871.467209:0:61015:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:5.0:1773851871.467210:0:61015:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli fd24374c-b27d-48f0-a139-ff2894eae03b/000000004c7f489e free: 126633370845184 avail: 126633368748032
00000020:00000001:5.0:1773851871.467211:0:61015:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:5.0:1773851871.467211:0:61015:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli fd24374c-b27d-48f0-a139-ff2894eae03b/000000004c7f489e avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:5.0:1773851871.467212:0:61015:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:5.0:1773851871.467213:0:61015:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:5.0:1773851871.467214:0:61015:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:5.0:1773851871.467214:0:61015:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli fd24374c-b27d-48f0-a139-ff2894eae03b/000000004c7f489e ocd_grant: 1879310335 want: 2097152 left: 112130449866752
00000020:00000001:5.0:1773851871.467215:0:61015:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:5.0:1773851871.467216:0:61015:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 26450@kfi7 supports cksum type f7, return f7
00000004:00000001:5.0:1773851871.467218:0:61015:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:5.0:1773851871.467218:0:61015:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:5.0:1773851871.467219:0:61015:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:5.0:1773851871.467220:0:61015:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851871.467221:0:61015:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851871.467222:0:61015:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851871.467222:0:61015:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 000000004c7f489e : new rpc_count 7
00000020:00000040:5.0:1773851871.467223:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 23
00000020:00000040:5.0:1773851871.467224:0:61015:0:(genops.c:871:class_export_get()) GET export 000000004c7f489e refcount=24
00000100:00000040:5.0:1773851871.467224:0:61015:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 000000004c7f489e : new rpc_count 8
00000100:00000001:5.0:1773851871.467225:0:61015:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:5.0:1773851871.467226:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:5.0:1773851871.467227:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc5cedd nid 26450@kfi7 refs 1
00000400:00000200:5.0:1773851871.467228:0:61015:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 000000004bc5cedd nid 26450@kfi7 refs 2
00000400:00000200:5.0:1773851871.467229:0:61015:0:(peer.c:1555:LNetPrimaryNID()) NID 26450@kfi7 primary NID 26450@kfi7 rc 0
00000100:00000001:5.0:1773851871.467240:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851871.467240:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091d18785 refcount 3 to 26450@kfi7
00000100:00000001:5.0:1773851871.467241:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419456 : -107156724132160 : ffff9e8aa185d6c0)
00000100:00000001:5.0:1773851871.467241:0:61015:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636916985419456 : -107156724132160 : 0xffff9e8aa185d6c0)
00000100:00000040:5.0:1773851871.467242:0:61015:0:(connection.c:133:ptlrpc_connection_get()) conn=0000000091d18785 refcount 3 to 26450@kfi7
00000100:00080000:5.0:1773851871.467244:0:61015:0:(import.c:86:import_set_state_nolock()) 000000009bcf9fd6 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:5.0:1773851871.467245:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091d18785 refcount 2 to 26450@kfi7
00000100:00000001:5.0:1773851871.467245:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851871.467246:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091d18785 refcount 3 to 26450@kfi7
00000100:00000001:5.0:1773851871.467246:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419456 : -107156724132160 : ffff9e8aa185d6c0)
02000000:00000001:5.0:1773851871.467247:0:61015:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:5.0:1773851871.467248:0:61015:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:5.0:1773851871.467249:0:61015:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.467250:0:61015:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:5.0:1773851871.467251:0:61015:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:5.0:1773851871.467251:0:61015:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:5.0:1773851871.467252:0:61015:0:(import.c:86:import_set_state_nolock()) 000000009bcf9fd6 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:5.0:1773851871.467253:0:61015:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:5.0:1773851871.467254:0:61015:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:5.0:1773851871.467254:0:61015:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:5.0:1773851871.467255:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 23
00000020:00000040:5.0:1773851871.467255:0:61015:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:5.0:1773851871.467257:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091d18785 refcount 2 to 26450@kfi7
00010000:00000001:5.0:1773851871.467257:0:61015:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851871.467258:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:5.0:1773851871.467258:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:5.0:1773851871.467259:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:5.0:1773851871.467260:0:61015:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851871.467261:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:5.0:1773851871.467261:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:5.0:1773851871.467262:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851871.467263:0:61015:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:5.0:1773851871.467264:0:61015:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:5.0:1773851871.467264:0:61015:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:5.0:1773851871.467265:0:61015:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:5.0:1773851871.467265:0:61015:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851871.467266:0:61015:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:5.0:1773851871.467266:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183257563043, transno 0, xid 1858069631725696
00010000:00000001:5.0:1773851871.467267:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:5.0:1773851871.467268:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000076eb54fb x1858069631725696/t0(0) o38->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852071 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2150-0'
00010000:00000001:5.0:1773851871.467270:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851871.467271:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851871.467272:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=103 v=66 (1 1 1 1)
00000100:00001000:5.0:1773851871.467273:0:61015:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:5.0:1773851871.467274:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851871.467275:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091d18785 refcount 3 to 26450@kfi7
00000100:00000001:5.0:1773851871.467276:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419456 : -107156724132160 : ffff9e8aa185d6c0)
02000000:00000001:5.0:1773851871.467276:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851871.467277:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.467278:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851871.467279:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26514@kfi7
00000400:00000010:5.0:1773851871.467279:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c5557a40.
00000100:00000200:5.0:1773851871.467280:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858069631725696, offset 0
00000400:00000200:5.0:1773851871.467281:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26514@kfi7
00000400:00000200:5.0:1773851871.467282:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.467283:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 1
00000400:00000200:5.0:1773851871.467284:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000400:00000200:5.0:1773851871.467285:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 3
00000400:00000200:5.0:1773851871.467286:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26514@kfi7 local destination
00000400:00000200:5.0:1773851871.467287:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769365:8769365:1024:4294967295] 26514@kfi7 LPNI seq info [35577976:35577976:16:4294967295]
00000400:00000200:5.0:1773851871.467289:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000400:00000200:5.0:1773851871.467289:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.467291:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26514@kfi7(26514@kfi7:26514@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851871.467292:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 3
00000800:00000200:5.0:1773851871.467294:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.467295:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:5.0:1773851871.467297:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851871.467299:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x14000000000000c4 Using peer 26514@kfi7(0x14000000000000c4)
00000800:00000200:5.0:1773851871.467302:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000127bdbe5: Posted send of 516 bytes to peer 0x14000000000000c4: rc=0
00000800:00000200:5.0:1773851871.467303:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x14000000000000c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851871.467305:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851871.467306:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091d18785 refcount 2 to 26450@kfi7
00010000:00000001:5.0:1773851871.467307:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:5.0:1773851871.467307:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851871.467308:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:5.0:1773851871.467309:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000076eb54fb x1858069631725696/t0(0) o38->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852071 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2150-0'
00000100:00100000:5.0:1773851871.467312:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076eb54fb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:fd24374c-b27d-48f0-a139-ff2894eae03b+23:40571:x1858069631725696:12345-26450@kfi7:38:login-tuolumne2150-0 Request processed in 127us (159us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851871.467314:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26450@kfi7, seq: 2001928
00000100:00000040:5.0:1773851871.467315:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004c7f489e : new rpc_count 7
00000800:00000200:6.0:1773851871.467316:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x14000000000000c4 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851871.467316:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851871.467316:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851871.467317:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851871.467317:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000400:00000200:6.0:1773851871.467318:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26514@kfi7: PUT: OK
00000020:00000010:5.0:1773851871.467318:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000699dfc15.
00000400:00000200:6.0:1773851871.467319:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c5557a40
00000400:00000010:6.0:1773851871.467319:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c5557a40.
00000020:00000010:5.0:1773851871.467319:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000020:00000040:5.0:1773851871.467319:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 22
00000100:00000001:6.0:1773851871.467320:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851871.467320:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851871.467321:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851871.467321:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000800:00000200:6.0:1773851871.467323:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000127bdbe5: 2054@kfi7:1 -> 26514@kfi7(00000000149d15b4):0x0 lsk 197 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x14000000000000c4 Transaction freed
00000800:00000200:18.0:1773851871.467519:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.467519:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.467519:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851871.467520:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851871.467521:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.467521:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851871.467523:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851871.467523:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26515@kfi7(00000000b4a8db06):0x102e version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851871.467524:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26515@kfi7 to cpt 4
00000800:00000200:17.0:1773851871.467524:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30000000000102e Using peer 26515@kfi7(0x30000000000102e)
00000400:00000200:18.0:1773851871.467526:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26515@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.467526:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26515@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.467527:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26515@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.467528:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a16c26 nid 26515@kfi7 refs 1
00000800:00000200:17.0:1773851871.467528:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x30000000000102e: rc=0
00000400:00000200:18.0:1773851871.467529:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26515@kfi7 to cpt 4
00000800:00000200:17.0:1773851871.467529:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30000000000102e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851871.467530:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a16c26 nid 26515@kfi7 refs 2
00000400:00000200:18.0:1773851871.467531:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a16c26 nid 26515@kfi7 refs 3
00000400:00000200:18.0:1773851871.467531:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:18.0:1773851871.467532:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 2528 into portal 12 MB=0x699e78c4add40
00000400:00000200:18.0:1773851871.467534:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 2528/2528 into md 0x6ab01b5d1 [64] + 16232
00000800:00000200:18.0:1773851871.467536:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851871.467538:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851871.467539:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26515@kfi7: PUT: OK
00000100:00000001:18.0:1773851871.467539:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851871.467540:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851871.467541:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa17ff8d.
00000100:00000040:18.0:1773851871.467541:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000aa17ff8d x1858069630475584 msgsize 2528
00000800:00000200:17.0:1773851871.467542:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30000000000102e TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851871.467543:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26515@kfi7)
00000100:00000001:18.0:1773851871.467544:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851871.467544:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x30000000000102e Transaction freed
00000400:00000200:18.0:1773851871.467545:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a16c26 nid 26515@kfi7 refs 2
00000100:00000001:16.0:1773851871.467545:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851871.467546:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.467546:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.467546:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.467547:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.467548:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.467548:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069630475584
00000020:00000001:16.0:1773851871.467549:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.467549:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000020:00000001:16.0:1773851871.467550:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.467554:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=23
00000020:00000001:16.0:1773851871.467554:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000020:00000001:16.0:1773851871.467555:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000001:16.0:1773851871.467556:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.467557:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.467558:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851871.467559:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.467560:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.467561:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.467561:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:16.0:1773851871.467562:0:61039:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:16.0:1773851871.467564:0:61039:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 000000001c471f23 cookie 0x14e3fcafcdcfc9a9  req@00000000aa17ff8d x1858069630475584/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:511/0 lens 2528/0 e 0 to 0 dl 1773852626 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00010000:00000001:16.0:1773851871.467567:0:61039:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:16.0:1773851871.467568:0:61039:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:16.0:1773851871.467568:0:61039:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.467569:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.1F:1773851871.467572:0:61039:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000aa17ff8d x1858069630475584/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:511/0 lens 2528/0 e 0 to 0 dl 1773852626 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000100:00080000:16.1:1773851871.467576:0:61039:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000dae305b0 x1858069630475584/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:522/0 lens 2528/5304 e 0 to 0 dl 1773851882 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne2150-65314'
00000100:00000001:16.0:1773851871.467578:0:61039:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:16.0:1773851871.467579:0:61039:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:16.0:1773851871.467580:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.467581:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.467581:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.467582:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.467583:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851871.467583:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 22
00000100:00000001:16.0:1773851871.467584:0:61039:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851871.473498:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.473499:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851871.473502:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851871.473506:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851871.473510:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18033@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.473512:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18033@kfi7 : PUT - for me
00000400:00000200:25.0:1773851871.473514:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18033@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.473515:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 1
00000400:00000200:25.0:1773851871.473517:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18033@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.473518:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 2
00000400:00000200:25.0:1773851871.473520:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 3
00000400:00000200:25.0:1773851871.473522:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18032@kfi7 to cpt 3
00000400:00000200:25.0:1773851871.473523:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18032@kfi7 of length 224 into portal 12 MB=0x69b4b8a434b40
00000400:00000200:25.0:1773851871.473526:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18032@kfi7 of length 224/224 into md 0x16159c9699 [64] + 11184
00000800:00000200:25.0:1773851871.473530:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851871.473533:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851871.473535:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18033@kfi7: PUT: OK
00000100:00000001:25.0:1773851871.473537:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851871.473537:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851871.473539:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bd36394d.
00000100:00000040:25.0:1773851871.473541:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bd36394d x1859598604782400 msgsize 224
00000100:00100000:25.0:1773851871.473543:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-18032@kfi7 (source: 12345-18033@kfi7)
00000100:00000001:25.0:1773851871.473546:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851871.473547:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 2
00000800:00000200:25.0:1773851871.473550:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851871.473555:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851871.473556:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851871.473557:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851871.473558:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851871.473559:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851871.473561:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598604782400
00000020:00000001:25.0:1773851871.473562:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851871.473563:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8141b
00000020:00000001:25.0:1773851871.473564:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851871.473568:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dcd31323 refcount=5
00000020:00000001:25.0:1773851871.473569:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107984096256 : -106965725455360 : ffff9eb719ee5c00)
00000020:00000001:25.0:1773851871.473571:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107984096256 : -106965725455360 : ffff9eb719ee5c00)
00000100:00000001:25.0:1773851871.473572:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.473574:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851871.473575:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089cac470.
00000020:00000010:25.0:1773851871.473576:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851871.473578:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851871.473579:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851871.473580:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851871.473581:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851871.473582:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851871.473583:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851871.473584:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.473585:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851871.473587:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851871.473587:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851871.473587:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851871.473588:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851871.473589:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851871.473589:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18032@kfi7, seq: 2025105
00000100:00000040:25.0:1773851871.473589:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dcd31323 : new rpc_count 1
00000100:00000001:25.0:1773851871.473590:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135478760448 : -106938230791168 : ffff9ebd80bda400)
00000100:00000001:26.0:1773851871.473591:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.473591:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bd36394d x1859598604782400/t0(0) o400->b55e38bd-68df-45ba-b19f-033fe8b3a54e@18032@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1614-0'
00000100:00000001:25.0:1773851871.473594:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.473595:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851871.473596:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bd36394d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b55e38bd-68df-45ba-b19f-033fe8b3a54e+5:39633:x1859598604782400:12345-18032@kfi7:400:default-tuolumne1614-0
00000100:00000200:25.0:1773851871.473597:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598604782400
00000020:00000001:25.0:1773851871.473598:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851871.473599:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851871.473600:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.473601:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851871.473601:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851871.473602:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851871.473603:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598604782400, found 0 last_xid 1859598604782399
00000020:00000001:25.0:1773851871.473603:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851871.473604:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851871.473604:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851871.473605:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.473606:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851871.473607:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851871.473607:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851871.473608:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000336ac53.
02000000:00000001:25.0:1773851871.473609:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.473609:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.473610:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851871.473611:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260614200, transno 0, xid 1859598604782400
00010000:00000001:25.0:1773851871.473612:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851871.473613:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bd36394d x1859598604782400/t0(0) o400->b55e38bd-68df-45ba-b19f-033fe8b3a54e@18032@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1614-0'
00010000:00000001:25.0:1773851871.473615:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851871.473616:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851871.473617:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=104 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851871.473618:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851871.473619:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000098ef64be refcount 3 to 18032@kfi7
00000100:00000001:25.0:1773851871.473620:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642470720 : -107157067080896 : ffff9e8a8d14db40)
02000000:00000001:25.0:1773851871.473620:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851871.473621:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.473622:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851871.473623:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18033@kfi7
00000400:00000010:25.0:1773851871.473623:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000065eaabeb.
00000100:00000200:25.0:1773851871.473624:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598604782400, offset 224
00000400:00000200:25.0:1773851871.473626:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18033@kfi7
00000400:00000200:25.0:1773851871.473626:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18033@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.473627:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 1
00000400:00000200:25.0:1773851871.473629:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 2
00000400:00000200:25.0:1773851871.473630:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 3
00000400:00000200:25.0:1773851871.473631:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18033@kfi7 local destination
00000400:00000200:25.0:1773851871.473632:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769366:8769366:1024:4294967295] 18033@kfi7 LPNI seq info [7988066:7988066:16:4294967295]
00000400:00000200:25.0:1773851871.473634:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 2
00000400:00000200:25.0:1773851871.473635:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18033@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.473637:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18033@kfi7(18033@kfi7:18033@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851871.473638:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 3
00000800:00000200:25.0:1773851871.473639:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.473641:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851871.473643:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851871.473645:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000045d Using peer 18033@kfi7(0x10000000000045d)
00000800:00000200:25.0:1773851871.473648:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 324 bytes to peer 0x10000000000045d: rc=0
00000800:00000200:25.0:1773851871.473650:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000045d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851871.473652:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.473653:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000098ef64be refcount 2 to 18032@kfi7
00010000:00000001:25.0:1773851871.473653:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851871.473654:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.473655:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851871.473655:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bd36394d x1859598604782400/t0(0) o400->b55e38bd-68df-45ba-b19f-033fe8b3a54e@18032@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1614-0'
00000100:00100000:25.0:1773851871.473659:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bd36394d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b55e38bd-68df-45ba-b19f-033fe8b3a54e+5:39633:x1859598604782400:12345-18032@kfi7:400:default-tuolumne1614-0 Request processed in 63us (117us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851871.473661:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18032@kfi7, seq: 2025105
00000100:00000040:25.0:1773851871.473662:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dcd31323 : new rpc_count 0
00000800:00000200:26.0:1773851871.473663:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000045d TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851871.473663:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851871.473663:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851871.473664:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000400:00000200:26.0:1773851871.473665:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851871.473665:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000020:00000010:25.0:1773851871.473665:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089cac470.
00000020:00000040:25.0:1773851871.473666:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000dcd31323 : new refcount 4
00000400:00000200:26.0:1773851871.473667:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18033@kfi7: PUT: OK
00000100:00000001:25.0:1773851871.473667:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851871.473668:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000065eaabeb
00000400:00000010:26.0:1773851871.473668:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000065eaabeb.
00000100:00000001:26.0:1773851871.473669:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851871.473670:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851871.473671:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8a6cce9 nid 18033@kfi7 refs 2
00000800:00000200:26.0:1773851871.473673:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 18033@kfi7(0000000059cfdee8):0x0 lsk 1118 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000045d Transaction freed
00000800:00000200:5.0:1773851871.478290:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.478291:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.478292:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 26451@kfi7(000000009f719f16):0x0 lsk 3630 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.478295:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 26451@kfi7(000000009f719f16):0x0 lsk 3630 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.478297:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26451@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.478298:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26451@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.478299:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26451@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.478300:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000054e0bbfd nid 26451@kfi7 refs 1
00000400:00000200:5.0:1773851871.478301:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26451@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.478301:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000054e0bbfd nid 26451@kfi7 refs 2
00000400:00000200:5.0:1773851871.478302:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000054e0bbfd nid 26451@kfi7 refs 3
00000400:00000200:5.0:1773851871.478303:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:5.0:1773851871.478305:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 2528 into portal 12 MB=0x699e78c4c6b00
00000400:00000200:5.0:1773851871.478306:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 2528/2528 into md 0x793926dc5 [64] + 139344
00000800:00000200:5.0:1773851871.478309:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 26451@kfi7(000000009f719f16):0x0 lsk 3630 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.478311:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.478312:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26451@kfi7: PUT: OK
00000100:00000001:5.0:1773851871.478313:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.478314:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851871.478315:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009f9f54e3.
00000100:00000040:5.0:1773851871.478315:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000009f9f54e3 x1858069630577408 msgsize 2528
00000100:00100000:5.0:1773851871.478317:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26451@kfi7)
00000100:00000001:5.0:1773851871.478319:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851871.478319:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000054e0bbfd nid 26451@kfi7 refs 2
00000800:00000200:5.0:1773851871.478321:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 26451@kfi7(000000009f719f16):0x0 lsk 3630 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851871.478323:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851871.478324:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851871.478324:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851871.478325:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851871.478326:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851871.478327:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069630577408
00000020:00000001:5.0:1773851871.478327:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851871.478328:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000020:00000001:5.0:1773851871.478328:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851871.478329:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=23
00000020:00000001:5.0:1773851871.478330:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000020:00000001:5.0:1773851871.478331:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000001:5.0:1773851871.478332:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851871.478332:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851871.478333:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000020:00000010:5.0:1773851871.478334:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851871.478335:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000699dfc15.
00000100:00000001:5.0:1773851871.478336:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851871.478336:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:5.0:1773851871.478337:0:61015:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:5.0:1773851871.478339:0:61015:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000fcb6d10e cookie 0x14e3fcafcdcfe914  req@000000009f9f54e3 x1858069630577408/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00010000:00000001:5.0:1773851871.478342:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851871.478342:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:5.0:1773851871.478343:0:61015:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.478344:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:5.1F:1773851871.478346:0:61015:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000009f9f54e3 x1858069630577408/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000100:00080000:5.1:1773851871.478350:0:61015:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000054e22dc1 x1858069630577408/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:500/0 lens 2528/3296 e 0 to 0 dl 1773851805 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne2150-65314'
00000100:00000001:5.0:1773851871.478353:0:61015:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:5.0:1773851871.478354:0:61015:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:5.0:1773851871.478355:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851871.478365:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851871.478366:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851871.478366:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000699dfc15.
00000020:00000010:5.0:1773851871.478367:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000020:00000040:5.0:1773851871.478368:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 22
00000100:00000001:5.0:1773851871.478368:0:61015:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851871.489188:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.489189:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.489190:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.489192:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.489193:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.489194:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26514@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.489195:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000800:00000200:7.0:1773851871.489196:0:2507579:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851871.489196:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851871.489196:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 1
00000800:00000200:7.0:1773851871.489197:0:2507579:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851871.489197:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:5.0:1773851871.489197:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26514@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.489197:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000800:00000200:6.0:1773851871.489198:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000400:00000200:5.0:1773851871.489198:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 3
00000800:00000200:27.0:1773851871.489199:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851871.489199:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:7.0:1773851871.489199:0:2507579:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004b1f88de: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.489199:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000800:00000200:27.0:1773851871.489200:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851871.489200:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:6.0:1773851871.489200:0:2499722:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26451@kfi7(0000000035fabe0b):0xc3 version: 2; local version 2; negotiated version: 2
00000400:00000200:5.0:1773851871.489200:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 2528 into portal 12 MB=0x699e78c4c7280
00000800:00000200:27.0:1773851871.489201:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851871.489201:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851871.489201:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:7.0:1773851871.489201:0:2507579:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004b1f88de: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:26.0:1773851871.489202:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851871.489202:0:2499722:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c3 Using peer 26451@kfi7(0x3000000000000c3)
00000400:00000200:5.0:1773851871.489202:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 2528/2528 into md 0x793926dc5 [64] + 141872
00000800:00000200:27.0:1773851871.489203:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851871.489203:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851871.489204:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26450@kfi7(0000000062402fb8):0x673 version: 2; local version 2; negotiated version: 2
00000400:00000200:7.0:1773851871.489204:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26451@kfi7 to cpt 1
00000400:00000200:6.0:1773851871.489204:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26451@kfi7 to cpt 1
00000800:00000200:5.0:1773851871.489204:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851871.489205:0:2507579:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26451@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.489205:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851871.489206:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26451@kfi7 to cpt 1
00000800:00000200:26.0:1773851871.489207:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1400000000000673 Using peer 26450@kfi7(0x1400000000000673)
00000800:00000200:25.0:1773851871.489207:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:7.0:1773851871.489207:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000054e0bbfd nid 26451@kfi7 refs 1
00000800:00000200:6.0:1773851871.489207:0:2499722:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000618b435b: Posted send of 38 bytes to peer 0x3000000000000c3: rc=0
00000400:00000200:5.0:1773851871.489207:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26514@kfi7: PUT: OK
00000400:00000200:27.0:1773851871.489208:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000800:00000200:6.0:1773851871.489208:0:2499722:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851871.489208:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.489208:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000400:00000200:27.0:1773851871.489209:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26450@kfi7 : PUT - for me
00000400:00000200:26.0:1773851871.489209:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:7.0:1773851871.489209:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26451@kfi7 to cpt 1
00000100:00000010:5.0:1773851871.489209:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cec945bc.
00000400:00000200:25.0:1773851871.489210:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:7.0:1773851871.489210:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000054e0bbfd nid 26451@kfi7 refs 2
00000100:00000040:5.0:1773851871.489210:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000cec945bc x1858069630579328 msgsize 2528
00000400:00000200:27.0:1773851871.489211:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000800:00000200:26.0:1773851871.489211:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 38 bytes to peer 0x1400000000000673: rc=0
00000400:00000200:7.0:1773851871.489211:0:2507579:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000054e0bbfd nid 26451@kfi7 refs 3
00000400:00000200:27.0:1773851871.489212:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc5cedd nid 26450@kfi7 refs 1
00000400:00000200:25.0:1773851871.489212:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26450@kfi7 : PUT - for me
00000400:00000200:7.0:1773851871.489212:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000100:00100000:5.0:1773851871.489212:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26514@kfi7)
00000800:00000200:26.0:1773851871.489213:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1400000000000673 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851871.489213:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851871.489214:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.489214:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc5cedd nid 26450@kfi7 refs 2
00000400:00000200:7.0:1773851871.489214:0:2507579:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 2528 into portal 12 MB=0x699e78c4c6e00
00000400:00000200:5.0:1773851871.489214:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000079ddfe9d nid 26514@kfi7 refs 2
00000400:00000200:27.0:1773851871.489215:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004bc5cedd nid 26450@kfi7 refs 3
00000400:00000200:7.0:1773851871.489215:0:2507579:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 2528/2528 into md 0x793926dc5 [64] + 144400
00000400:00000200:25.0:1773851871.489216:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000800:00000200:5.0:1773851871.489216:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26514@kfi7(00000000f3da17d8):0x0 lsk 195 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851871.489218:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc5cedd nid 26450@kfi7 refs 2
00000400:00000200:25.0:1773851871.489219:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000800:00000200:7.0:1773851871.489219:0:2507579:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004b1f88de: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.489219:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c3 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851871.489220:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc5cedd nid 26450@kfi7 refs 3
00000400:00000200:7.0:1773851871.489221:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851871.489221:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3000000000000c3 Transaction freed
00000400:00000200:25.0:1773851871.489222:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004bc5cedd nid 26450@kfi7 refs 4
00000400:00000200:7.0:1773851871.489222:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26451@kfi7: PUT: OK
00000400:00000200:27.0:1773851871.489223:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000100:00000001:7.0:1773851871.489223:0:2507579:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:4.0:1773851871.489223:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:27.0:1773851871.489224:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 2528 into portal 12 MB=0x699e78c4bbf00
00000800:00000200:26.0:1773851871.489224:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1400000000000673 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851871.489224:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000100:00000200:7.0:1773851871.489224:0:2507579:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:7.0:1773851871.489224:0:2507579:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000181c7d4f.
02000000:00000001:4.0:1773851871.489224:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851871.489224:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:7.0:1773851871.489225:0:2507579:0:(events.c:358:request_in_callback()) incoming req@00000000181c7d4f x1858069630578176 msgsize 2528
00000400:00000200:27.0:1773851871.489226:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 2528/2528 into md 0x16159c9699 [64] + 11408
00000400:00000200:25.0:1773851871.489226:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 2528 into portal 12 MB=0x699e78c4c6cc0
00000100:00000001:4.0:1773851871.489226:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851871.489226:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851871.489227:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1400000000000673 Transaction freed
00000100:00100000:7.0:1773851871.489227:0:2507579:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26451@kfi7)
00000100:00100000:4.0:1773851871.489227:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069630579328
00000800:00000200:27.0:1773851871.489228:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851871.489228:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 2528/2528 into md 0x16159c9699 [64] + 13936
00000100:00000001:7.0:1773851871.489228:0:2507579:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:4.0:1773851871.489228:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851871.489228:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000400:00000200:27.0:1773851871.489229:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:4.0:1773851871.489229:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:27.0:1773851871.489230:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26450@kfi7: PUT: OK
00000400:00000200:7.0:1773851871.489230:0:2507579:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000054e0bbfd nid 26451@kfi7 refs 2
00000020:00000040:4.0:1773851871.489230:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=23
00000100:00000001:27.0:1773851871.489231:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:7.0:1773851871.489231:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004b1f88de: 2069@kfi7:1 <- 26451@kfi7(0000000035fabe0b):0x0 lsk 196 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000020:00000001:4.0:1773851871.489231:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000020:00000001:4.0:1773851871.489231:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000200:27.0:1773851871.489232:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851871.489232:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a9287305.
00000800:00000200:25.0:1773851871.489232:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:4.0:1773851871.489232:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000040:27.0:1773851871.489233:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000a9287305 x1858069630533376 msgsize 2528
00000100:00000001:4.0:1773851871.489233:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851871.489233:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f694577a.
00000100:00100000:27.0:1773851871.489234:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26450@kfi7)
00000400:00000200:25.0:1773851871.489234:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851871.489234:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000010:4.0:1773851871.489234:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
02000000:00000001:7.0:1773851871.489235:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851871.489235:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000010:4.0:1773851871.489235:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000025e99aed.
00000100:00000001:27.0:1773851871.489236:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851871.489236:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004bc5cedd nid 26450@kfi7 refs 3
00000400:00000200:25.0:1773851871.489236:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26450@kfi7: PUT: OK
00000100:00000001:7.0:1773851871.489236:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851871.489236:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851871.489236:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851871.489236:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851871.489237:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00100000:7.0:1773851871.489237:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069630578176
00000020:00000001:7.0:1773851871.489237:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000004:00000001:4.0:1773851871.489237:0:61015:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000800:00000200:27.0:1773851871.489238:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851871.489238:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000200:25.0:1773851871.489238:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000020:00000040:7.0:1773851871.489238:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000020:00000001:7.0:1773851871.489238:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
02000000:00000001:26.0:1773851871.489239:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851871.489239:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000010:25.0:1773851871.489239:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001581485e.
00000800:00000200:17.0:1773851871.489239:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000020:00000040:7.0:1773851871.489239:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=24
00000004:00100000:4.0:1773851871.489239:0:61015:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000a67a7ec7 cookie 0x14e3fcafcdcfe9a0  req@00000000cec945bc x1858069630579328/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000100:00000001:26.0:1773851871.489240:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.489240:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000001581485e x1858069630577856 msgsize 2528
00000800:00000200:17.0:1773851871.489240:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:7.0:1773851871.489240:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000020:00000001:7.0:1773851871.489240:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
02000000:00000001:26.0:1773851871.489241:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851871.489241:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069630533376
00000800:00000200:17.0:1773851871.489241:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851871.489241:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:26.0:1773851871.489242:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000100:00100000:25.0:1773851871.489242:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26450@kfi7)
00000100:00000001:7.0:1773851871.489242:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851871.489242:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000040:26.0:1773851871.489243:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000020:00000001:26.0:1773851871.489243:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:17.0:1773851871.489243:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:7.0:1773851871.489243:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00010000:00000001:4.0:1773851871.489243:0:61015:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:4.0:1773851871.489243:0:61015:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:4.0:1773851871.489243:0:61015:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:7.0:1773851871.489244:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:4.0:1773851871.489244:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.489245:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.489245:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26515@kfi7 to cpt 4
00000100:00000001:7.0:1773851871.489245:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851871.489245:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:7.0:1773851871.489245:0:60963:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000020:00000040:26.0:1773851871.489246:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=25
00000100:00080000:4.1F:1773851871.489246:0:61015:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000cec945bc x1858069630579328/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000020:00000001:26.0:1773851871.489247:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000400:00000200:25.0:1773851871.489247:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004bc5cedd nid 26450@kfi7 refs 2
00000100:00000001:24.0:1773851871.489247:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851871.489247:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:17.0:1773851871.489247:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26515@kfi7 : PUT - for me
00000004:00100000:7.0:1773851871.489247:0:60963:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 0000000006ab962a cookie 0x14e3fcafcdcfe953  req@00000000181c7d4f x1858069630578176/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000020:00000001:26.0:1773851871.489248:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000001:24.0:1773851871.489248:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851871.489248:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851871.489248:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26515@kfi7 to cpt 4
00000100:00000001:26.0:1773851871.489249:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:25.0:1773851871.489249:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 26450@kfi7(0000000062402fb8):0x0 lsk 1652 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851871.489249:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851871.489249:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069630577856
00000400:00000200:17.0:1773851871.489249:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a16c26 nid 26515@kfi7 refs 1
00000100:00080000:4.1:1773851871.489249:0:61015:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000078f306b5 x1858069630579328/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:500/0 lens 2528/3296 e 0 to 0 dl 1773851805 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne2150-65314'
00000100:00000001:26.0:1773851871.489250:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:24.0:1773851871.489250:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851871.489250:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000400:00000200:17.0:1773851871.489250:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26515@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.489250:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a16c26 nid 26515@kfi7 refs 2
00000020:00000010:26.0:1773851871.489251:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000066e61092.
00000020:00000001:24.0:1773851871.489251:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:17.0:1773851871.489251:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a16c26 nid 26515@kfi7 refs 3
00010000:00000001:7.0:1773851871.489251:0:60963:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:7.0:1773851871.489251:0:60963:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000010:26.0:1773851871.489252:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000040:24.0:1773851871.489252:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=26
00000020:00000001:24.0:1773851871.489252:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000400:00000200:17.0:1773851871.489252:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26450@kfi7 to cpt 6
00000004:00000001:7.0:1773851871.489252:0:60963:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.489252:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851871.489252:0:61015:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000010:26.0:1773851871.489253:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042b93dea.
00000020:00000001:24.0:1773851871.489253:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000400:00000200:17.0:1773851871.489253:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26450@kfi7 of length 2528 into portal 12 MB=0x699e78c4c7000
00000100:00000001:4.0:1773851871.489253:0:61015:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:26.0:1773851871.489254:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851871.489254:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00080000:7.1F:1773851871.489254:0:60963:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000181c7d4f x1858069630578176/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000100:00000001:4.0:1773851871.489254:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851871.489255:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:26.0:1773851871.489255:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000100:00000001:24.0:1773851871.489255:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851871.489255:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000157f1406.
00000400:00000200:17.0:1773851871.489255:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26450@kfi7 of length 2528/2528 into md 0x6ab01b5d1 [64] + 18760
00000020:00000010:24.0:1773851871.489256:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851871.489256:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005ba32091.
00000100:00000001:24.0:1773851871.489257:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851871.489257:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:17.0:1773851871.489257:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00100000:26.0:1773851871.489258:0:41182:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 0000000092fc5af2 cookie 0x14e3fcafcdcfdd98  req@00000000a9287305 x1858069630533376/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000004:00000001:24.0:1773851871.489258:0:60973:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000100:00080000:7.1:1773851871.489258:0:60963:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000d99a9be6 x1858069630578176/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:500/0 lens 2528/3296 e 0 to 0 dl 1773851805 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne2150-65314'
00000400:00000200:17.0:1773851871.489259:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00100000:24.0:1773851871.489260:0:60973:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 000000004ba60a14 cookie 0x14e3fcafcdcfe937  req@000000001581485e x1858069630577856/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000400:00000200:17.0:1773851871.489260:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26515@kfi7: PUT: OK
00000100:00000001:7.0:1773851871.489260:0:60963:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:4.0:1773851871.489260:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00000001:26.0:1773851871.489261:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:17.0:1773851871.489261:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.489261:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000001:7.0:1773851871.489261:0:60963:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:4.0:1773851871.489261:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00010000:00000001:26.0:1773851871.489262:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851871.489262:0:41182:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851871.489262:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000010:17.0:1773851871.489262:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001755686c.
00000100:00000040:17.0:1773851871.489262:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001755686c x1858069630578688 msgsize 2528
00000100:00000001:7.0:1773851871.489262:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851871.489262:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851871.489262:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000025e99aed.
00000100:00000001:26.0:1773851871.489263:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851871.489263:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851871.489263:0:60973:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851871.489263:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:7.0:1773851871.489263:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851871.489263:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000020:00000010:4.0:1773851871.489263:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f694577a.
00000020:00000040:4.0:1773851871.489263:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 25
00000100:00100000:17.0:1773851871.489264:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26450@kfi7 (source: 12345-26515@kfi7)
00000020:00000010:7.0:1773851871.489264:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000100:00000001:4.0:1773851871.489264:0:61015:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851871.489265:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.489265:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a16c26 nid 26515@kfi7 refs 2
00000020:00000040:7.0:1773851871.489265:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 24
00000100:00000001:7.0:1773851871.489265:0:60963:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00080000:26.1F:1773851871.489266:0:41182:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000a9287305 x1858069630533376/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000100:00000001:16.0:1773851871.489266:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851871.489267:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 26515@kfi7(00000000b4a8db06):0x0 lsk 4143 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.489267:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.489267:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.489268:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.489268:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.489269:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858069630578688
00000100:00080000:26.1:1773851871.489270:0:41182:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000002761579e x1858069630533376/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:499/0 lens 2528/5304 e 0 to 0 dl 1773851805 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne2150-65314'
00000020:00000001:16.0:1773851871.489270:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.489270:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9301a
00000020:00000001:16.0:1773851871.489270:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.489271:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c7f489e refcount=25
00000020:00000001:16.0:1773851871.489272:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000001:26.0:1773851871.489273:0:41182:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000001:16.0:1773851871.489273:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745156608 : -107128964395008 : ffff9e911821d000)
00000100:00000001:16.0:1773851871.489273:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851871.489274:0:41182:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00080000:24.1F:1773851871.489274:0:60973:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000001581485e x1858069630577856/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000100:00000001:16.0:1773851871.489274:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.489274:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000100:00000001:26.0:1773851871.489275:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:16.0:1773851871.489276:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000100:00080000:24.1:1773851871.489277:0:60973:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000009bda4197 x1858069630577856/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:500/0 lens 2528/3296 e 0 to 0 dl 1773851805 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne2150-65314'
00000020:00000010:16.0:1773851871.489277:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.489278:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.489279:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:16.0:1773851871.489279:0:61039:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000100:00000001:26.0:1773851871.489280:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:24.0:1773851871.489280:0:60973:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000010:26.0:1773851871.489281:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851871.489281:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042b93dea.
00000100:00000001:24.0:1773851871.489281:0:60973:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851871.489281:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000004:00100000:16.0:1773851871.489281:0:61039:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 0000000085c94dd2 cookie 0x14e3fcafcdcfe984  req@000000001755686c x1858069630578688/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000020:00000010:26.0:1773851871.489282:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000066e61092.
00000100:00000001:24.0:1773851871.489282:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851871.489282:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000040:26.0:1773851871.489283:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 24
00000020:00000010:24.0:1773851871.489283:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005ba32091.
00000100:00000001:26.0:1773851871.489284:0:41182:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:24.0:1773851871.489284:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000157f1406.
00000020:00000040:24.0:1773851871.489284:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 23
00010000:00000001:16.0:1773851871.489284:0:61039:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:16.0:1773851871.489284:0:61039:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:16.0:1773851871.489284:0:61039:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851871.489285:0:60973:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.489285:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.1:1773851871.489287:0:61039:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000001755686c x1858069630578688/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:434/0 lens 2528/0 e 0 to 0 dl 1773852549 ref 1 fl New:/2/ffffffff rc 0/-1 job:'login-tuolumne2150-65314'
00000100:00080000:16.1:1773851871.489289:0:61039:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000019d5178c x1858069630578688/t0(0) o101->fd24374c-b27d-48f0-a139-ff2894eae03b@26450@kfi7:500/0 lens 2528/3296 e 0 to 0 dl 1773851805 ref 1 fl Interpret:/0/0 rc 0/0 job:'login-tuolumne2150-65314'
00000100:00000001:16.0:1773851871.489292:0:61039:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:16.0:1773851871.489293:0:61039:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:16.0:1773851871.489294:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.489294:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.489295:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.489296:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.489297:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851871.489297:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000004c7f489e : new refcount 22
00000100:00000001:16.0:1773851871.489298:0:61039:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851871.502881:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851871.502882:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851871.502883:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851871.502885:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851871.502887:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851871.502888:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:21.0:1773851871.502889:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851871.502890:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:21.0:1773851871.502890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851871.502891:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:21.0:1773851871.502892:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:21.0:1773851871.502893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851871.502894:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee18c80
00000400:00000200:21.0:1773851871.502896:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 6984
00000800:00000200:21.0:1773851871.502897:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851871.502899:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851871.502900:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000001:21.0:1773851871.502901:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851871.502901:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851871.502902:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000362086c6.
00000100:00000040:21.0:1773851871.502903:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000362086c6 x1858059204922496 msgsize 224
00000100:00100000:21.0:1773851871.502904:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2081@kfi7)
00000100:00000001:21.0:1773851871.502905:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851871.502906:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:22.0:1773851871.502908:0:1537183:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851871.502908:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851871.502909:0:1537183:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851871.502909:0:1537183:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851871.502910:0:1537183:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851871.502911:0:1537183:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851871.502912:0:1537183:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204922496
00000020:00000001:22.0:1773851871.502912:0:1537183:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851871.502913:0:1537183:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:22.0:1773851871.502913:0:1537183:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851871.502917:0:1537183:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:22.0:1773851871.502917:0:1537183:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:22.0:1773851871.502918:0:1537183:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:22.0:1773851871.502919:0:1537183:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851871.502920:0:1537183:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851871.502921:0:1537183:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000157025df.
00000020:00000010:22.0:1773851871.502922:0:1537183:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851871.502923:0:1537183:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000040:22.0:1773851871.502925:0:1537183:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:22.0:1773851871.502925:0:1537183:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851871.502926:0:1537183:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851871.502926:0:1537183:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851871.502927:0:1537183:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851871.502928:0:1537183:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851871.502930:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851871.502930:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851871.502930:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851871.502930:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:22.0:1773851871.502931:0:1537183:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 3084759
00000100:00000040:22.0:1773851871.502932:0:1537183:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:20.0:1773851871.502932:0:1537152:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851871.502933:0:1537183:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788283136 : -106974921268480 : ffff9eb4f5d16300)
00000100:00000001:20.0:1773851871.502933:0:1537152:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851871.502934:0:1537183:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000362086c6 x1858059204922496/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:22.0:1773851871.502937:0:1537183:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851871.502937:0:1537183:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:22.0:1773851871.502938:0:1537183:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000362086c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_028:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204922496:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:22.0:1773851871.502940:0:1537183:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204922496
00000020:00000001:22.0:1773851871.502941:0:1537183:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:22.0:1773851871.502941:0:1537183:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:22.0:1773851871.502942:0:1537183:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851871.502943:0:1537183:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:22.0:1773851871.502943:0:1537183:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:22.0:1773851871.502944:0:1537183:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:22.0:1773851871.502945:0:1537183:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:22.0:1773851871.502945:0:1537183:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:22.0:1773851871.502946:0:1537183:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:22.0:1773851871.502946:0:1537183:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851871.502947:0:1537183:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:22.0:1773851871.502948:0:1537183:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:22.0:1773851871.502949:0:1537183:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000002d8c56ce.
02000000:00000001:22.0:1773851871.502950:0:1537183:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851871.502950:0:1537183:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:22.0:1773851871.502951:0:1537183:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:22.0:1773851871.502952:0:1537183:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:22.0:1773851871.502952:0:1537183:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:22.0:1773851871.502953:0:1537183:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:22.0:1773851871.502954:0:1537183:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:22.0:1773851871.502956:0:1537183:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:22.0:1773851871.502957:0:1537183:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204922496
00010000:00000001:22.0:1773851871.502958:0:1537183:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:22.0:1773851871.502959:0:1537183:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000362086c6 x1858059204922496/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:22.0:1773851871.502961:0:1537183:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:22.0:1773851871.502962:0:1537183:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:22.0:1773851871.502963:0:1537183:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=95 v=66 (1 1 1 1)
00000100:00000001:22.0:1773851871.502964:0:1537183:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:22.0:1773851871.502964:0:1537183:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:22.0:1773851871.502965:0:1537183:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:22.0:1773851871.502966:0:1537183:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:22.0:1773851871.502967:0:1537183:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851871.502967:0:1537183:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:22.0:1773851871.502968:0:1537183:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2081@kfi7
00000400:00000010:22.0:1773851871.502969:0:1537183:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c97ba3c.
00000100:00000200:22.0:1773851871.502970:0:1537183:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204922496, offset 224
00000400:00000200:22.0:1773851871.502971:0:1537183:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2081@kfi7
00000400:00000200:22.0:1773851871.502972:0:1537183:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851871.502973:0:1537183:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:22.0:1773851871.502974:0:1537183:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:22.0:1773851871.502975:0:1537183:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:22.0:1773851871.502976:0:1537183:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2081@kfi7 local destination
00000400:00000200:22.0:1773851871.502977:0:1537183:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769367:8769367:1024:4294967295] 2081@kfi7 LPNI seq info [23425168:23425168:16:4294967295]
00000400:00000200:22.0:1773851871.502979:0:1537183:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:22.0:1773851871.502979:0:1537183:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851871.502981:0:1537183:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2081@kfi7(2081@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:22.0:1773851871.502982:0:1537183:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000800:00000200:22.0:1773851871.502984:0:1537183:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851871.502985:0:1537183:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:22.0:1773851871.502987:0:1537183:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851871.502990:0:1537183:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 Using peer 2081@kfi7(0x270)
00000800:00000200:22.0:1773851871.502993:0:1537183:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000007ee9d6e: Posted send of 468 bytes to peer 0x270: rc=0
00000800:00000200:22.0:1773851871.502994:0:1537183:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:22.0:1773851871.502997:0:1537183:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:22.0:1773851871.502997:0:1537183:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:22.0:1773851871.502998:0:1537183:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:22.0:1773851871.502998:0:1537183:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:22.0:1773851871.502999:0:1537183:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:22.0:1773851871.503001:0:1537183:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000362086c6 x1858059204922496/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:22.0:1773851871.503004:0:1537183:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000362086c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_028:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204922496:12345-2074@kfi7:41:default-yuba4-0 Request processed in 66us (100us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851871.503004:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 TN_EVENT_TX_OK event status 0
00000100:00100000:22.0:1773851871.503006:0:1537183:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 3084759
00000100:00000040:22.0:1773851871.503007:0:1537183:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:22.0:1773851871.503007:0:1537183:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851871.503007:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851871.503008:0:1537183:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851871.503008:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000020:00000010:22.0:1773851871.503009:0:1537183:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851871.503009:0:1537183:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000400:00000200:21.0:1773851871.503009:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c97ba3c
00000400:00000010:21.0:1773851871.503009:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c97ba3c.
00000020:00000010:22.0:1773851871.503010:0:1537183:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000157025df.
00000100:00000001:21.0:1773851871.503010:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:22.0:1773851871.503011:0:1537183:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:21.0:1773851871.503011:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:22.0:1773851871.503012:0:1537183:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851871.503012:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:21.0:1773851871.503013:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000007ee9d6e: 2069@kfi7:5 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x270 Transaction freed
00000800:00000200:17.0:1773851871.508804:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.508806:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.508808:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.508812:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.508815:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.508817:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.1@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851871.508819:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.508820:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851871.508822:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.1@o2ib60 to cpt 2
00000400:00000200:17.0:1773851871.508824:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a999e67 nid 192.168.128.1@o2ib60 refs 2
00000400:00000200:17.0:1773851871.508826:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008a999e67 nid 192.168.128.1@o2ib60 refs 3
00000400:00000200:17.0:1773851871.508828:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.1@o2ib60 to cpt 2
00000400:00000200:17.0:1773851871.508830:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.1@o2ib60 of length 224 into portal 12 MB=0x69a172c7bc0c0
00000400:00000200:17.0:1773851871.508832:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.1@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 138728
00000800:00000200:17.0:1773851871.508835:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.508838:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.508840:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.508841:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.508842:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.508843:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008ba795b2.
00000100:00000040:17.0:1773851871.508844:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000008ba795b2 x1858274181497024 msgsize 224
00000100:00100000:17.0:1773851871.508847:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.1@o2ib60 (source: 12345-192.168.128.1@o2ib60)
00000100:00000001:17.0:1773851871.508849:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.508851:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851871.508853:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851871.508854:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851871.508855:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851871.508857:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851871.508857:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851871.508859:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851871.508860:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858274181497024
00000020:00000001:9.0:1773851871.508861:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851871.508862:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93036
00000020:00000001:9.0:1773851871.508864:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851871.508868:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009270e633 refcount=277
00000020:00000001:9.0:1773851871.508869:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745146368 : -107128964405248 : ffff9e911821a800)
00000020:00000001:9.0:1773851871.508871:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745146368 : -107128964405248 : ffff9e911821a800)
00000100:00000001:9.0:1773851871.508873:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851871.508874:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851871.508876:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ede84d6e.
00000020:00000010:9.0:1773851871.508877:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c8fc5a75.
00000020:00000010:9.0:1773851871.508879:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008e3d6b9d.
00000100:00000001:9.0:1773851871.508881:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851871.508881:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851871.508882:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851871.508884:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851871.508885:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851871.508886:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851871.508888:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851871.508891:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851871.508892:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851871.508892:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851871.508892:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851871.508894:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.1@o2ib60, seq: 2130786
00000100:00000001:11.0:1773851871.508896:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851871.508896:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009270e633 : new rpc_count 3
00000100:00000001:11.0:1773851871.508897:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851871.508897:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636970971063040 : -107102738488576 : ffff9e9733516300)
00000100:00000040:9.0:1773851871.508900:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008ba795b2 x1858274181497024/t0(0) o400->bdf32223-29b0-492f-bf72-5e247d6ea511@192.168.128.1@o2ib60:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-matrix1-0'
00000100:00000001:9.0:1773851871.508906:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851871.508907:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851871.508909:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ba795b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:bdf32223-29b0-492f-bf72-5e247d6ea511+277:47981:x1858274181497024:12345-192.168.128.1@o2ib60:400:login-matrix1-0
00000100:00000200:9.0:1773851871.508911:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858274181497024
00000020:00000001:9.0:1773851871.508913:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851871.508914:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851871.508915:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851871.508916:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851871.508917:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851871.508920:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851871.508921:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858274181497024, found 0 last_xid 1858274171142399
00000020:00000001:9.0:1773851871.508922:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851871.508924:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851871.508924:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851871.508925:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851871.508926:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851871.508928:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851871.508929:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851871.508930:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f14b1732.
02000000:00000001:9.0:1773851871.508931:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851871.508932:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851871.508933:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851871.508934:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260961525, transno 0, xid 1858274181497024
00010000:00000001:9.0:1773851871.508936:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851871.508938:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008ba795b2 x1858274181497024/t0(0) o400->bdf32223-29b0-492f-bf72-5e247d6ea511@192.168.128.1@o2ib60:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-matrix1-0'
00010000:00000001:9.0:1773851871.508942:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851871.508943:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851871.508945:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=104 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851871.508947:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851871.508948:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000008efa052 refcount 3 to 192.168.128.1@o2ib60
00000100:00000001:9.0:1773851871.508950:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366285888 : -107142343265728 : ffff9e8dfab07240)
02000000:00000001:9.0:1773851871.508951:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851871.508952:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851871.508953:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851871.508955:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.1@o2ib60
00000400:00000010:9.0:1773851871.508956:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d17d55e6.
00000100:00000200:9.0:1773851871.508958:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858274181497024, offset 224
00000400:00000200:9.0:1773851871.508960:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.1@o2ib60
00000400:00000200:9.0:1773851871.508963:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.1@o2ib60 to cpt 2
00000400:00000200:9.0:1773851871.508966:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a999e67 nid 192.168.128.1@o2ib60 refs 2
00000400:00000200:9.0:1773851871.508968:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008a999e67 nid 192.168.128.1@o2ib60 refs 3
00000400:00000200:9.0:1773851871.508970:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008a999e67 nid 192.168.128.1@o2ib60 refs 4
00000400:00000200:9.0:1773851871.508973:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.1@o2ib60 routed destination
00000400:00000200:9.0:1773851871.508976:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:9.0:1773851871.508978:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:9.0:1773851871.508980:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.1@o2ib60: rtr pref emtpy: 1
00000400:00000200:9.0:1773851871.508982:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:9.0:1773851871.508984:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.1@o2ib60: rtr pref emtpy: 1
00000400:00000200:9.0:1773851871.508986:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:9.0:1773851871.508987:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769368:8769368:1024:4294967295] 2094@kfi7 LPNI seq info [1258746998:1258746998:16:4294967295]
00000400:00000200:9.0:1773851871.508990:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:9.0:1773851871.508992:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:9.0:1773851871.508996:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.1@o2ib60(192.168.128.1@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851871.508999:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008a999e67 nid 192.168.128.1@o2ib60 refs 3
00000800:00000200:9.0:1773851871.509002:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851871.509004:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851871.509008:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851871.509013:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:9.0:1773851871.509018:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000438708cd: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:9.0:1773851871.509021:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851871.509024:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851871.509026:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000008efa052 refcount 2 to 192.168.128.1@o2ib60
00010000:00000001:9.0:1773851871.509027:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851871.509028:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851871.509029:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851871.509031:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008ba795b2 x1858274181497024/t0(0) o400->bdf32223-29b0-492f-bf72-5e247d6ea511@192.168.128.1@o2ib60:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-matrix1-0'
00000800:00000200:11.0:1773851871.509034:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851871.509037:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ba795b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:bdf32223-29b0-492f-bf72-5e247d6ea511+277:47981:x1858274181497024:12345-192.168.128.1@o2ib60:400:login-matrix1-0 Request processed in 129us (191us total) trans 0 rc 0/0
00000400:00000200:11.0:1773851871.509038:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851871.509040:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:11.0:1773851871.509041:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d17d55e6
00000400:00000010:11.0:1773851871.509042:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d17d55e6.
00000100:00100000:9.0:1773851871.509042:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.1@o2ib60, seq: 2130786
00000100:00000001:11.0:1773851871.509043:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851871.509044:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:9.0:1773851871.509044:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009270e633 : new rpc_count 2
00000100:00000001:9.0:1773851871.509045:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:11.0:1773851871.509046:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:9.0:1773851871.509046:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851871.509047:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c8fc5a75.
00000800:00000200:11.0:1773851871.509048:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Transaction freed
00000020:00000010:9.0:1773851871.509048:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008e3d6b9d.
00000020:00000010:9.0:1773851871.509050:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ede84d6e.
00000020:00000040:9.0:1773851871.509051:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000009270e633 : new refcount 276
00000100:00000001:9.0:1773851871.509053:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851871.561733:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851871.561733:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851871.561734:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db244de4.
00000020:00000040:7.0:1773851871.561734:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851871.561735:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851871.561736:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851871.561737:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851871.561738:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000005a2e8a27.
00000100:00000001:7.0:1773851871.561739:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.561740:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851871.561740:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851871.561741:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000db244de4] to pc [ptlrpcd_01_03+3]  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851871.561746:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:5.0:1773851871.561746:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:7.0:1773851871.561747:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d72416c0.
00080000:00000001:7.0:1773851871.561747:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637159859158016 : -106913850393600 : ffff9ec32decfc00)
00000100:00000001:5.0:1773851871.561747:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851871.561747:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:7.0:1773851871.561748:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:5.0:1773851871.561748:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851871.561748:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:7.0:1773851871.561749:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851871.561749:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:7.0:1773851871.561750:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000100:00000001:5.0:1773851871.561751:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:7.0:1773851871.561752:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004df7e858.
00000004:00080000:7.0:1773851871.561752:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614146015028023ns, next at 614147015027011ns, rc = 0
00000100:00000001:5.0:1773851871.561752:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851871.561752:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:7.0:1773851871.561753:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851871.561753:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851871.561754:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851871.561754:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db244de4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051929920:2099@kfi7:13:default-yuba2-0
00000004:00000001:7.0:1773851871.561755:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561755:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:5.0:1773851871.561756:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851871.561756:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851871.561757:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:5.0:1773851871.561758:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a58f956d.
02000000:00000001:5.0:1773851871.561759:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851871.561760:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:5.0:1773851871.561760:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000044a0e143.
00000400:00000010:5.0:1773851871.561761:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
00000100:00000200:5.0:1773851871.561762:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929920, portal 4
00000100:00000001:5.0:1773851871.561763:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851871.561764:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309140864 : -106994400410752 : ffff9eb06cc54380)
00000100:00000040:5.0:1773851871.561765:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851871.561768:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851871.561768:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:5.0:1773851871.561769:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000200:5.0:1773851871.561773:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929920, offset 0
00000400:00000200:5.0:1773851871.561774:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:5.0:1773851871.561775:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:5.0:1773851871.561776:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:5.0:1773851871.561777:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:5.0:1773851871.561778:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:5.0:1773851871.561779:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:5.0:1773851871.561781:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769367, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769368, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851871.561783:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:5.0:1773851871.561784:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851871.561784:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:5.0:1773851871.561785:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769369:8769369:1024:4294967295] 2099@kfi7 LPNI seq info [5403431:5403431:16:4294967295]
00000400:00000200:5.0:1773851871.561787:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:5.0:1773851871.561788:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:5.0:1773851871.561790:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851871.561791:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:5.0:1773851871.561792:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.561794:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851871.561796:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851871.561798:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Using peer 2099@kfi7(0x2c1)
00000800:00000200:5.0:1773851871.561801:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x2c1: rc=0
00000800:00000200:5.0:1773851871.561803:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851871.561805:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561806:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851871.561806:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561807:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561808:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851871.561810:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851871.561810:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851871.561811:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851871.561811:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851871.561811:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561812:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851871.561814:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851871.561816:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.561817:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851871.561818:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:5.0:1773851871.561819:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00000001:5.0:1773851871.561819:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851871.561820:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851871.561823:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851871.561824:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851871.561826:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561827:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851871.561827:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851871.561829:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Transaction freed
00000800:00000200:17.0:1773851871.561860:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.561860:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.561861:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.561863:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.561864:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.561865:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.561866:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.561867:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851871.561868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.561868:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851871.561869:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851871.561870:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.561870:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3d40
00000400:00000200:17.0:1773851871.561871:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.561872:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f1431 [1] + 224
00000800:00000200:17.0:1773851871.561874:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.561876:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.561876:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.561878:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851871.561879:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851871.561881:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851871.561885:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.561886:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851871.561887:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851871.561887:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851871.561887:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:5.0:1773851871.561888:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851871.561889:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:5.0:1773851871.561890:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000044a0e143.
00000400:00000200:5.0:1773851871.561890:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00000400:00000010:5.0:1773851871.561891:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
00000100:00000001:5.0:1773851871.561892:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851871.561893:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851871.561896:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851871.561902:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851871.561902:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851871.561903:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851871.561903:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851871.561904:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851871.561905:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851871.561905:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851871.561907:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=104 v=66 (66 66 66 66)
00000100:00001000:5.0:1773851871.561908:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=104 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851871.561909:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851871.561909:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851871.561910:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851871.561911:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561911:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851871.561912:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:5.0:1773851871.561912:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851871.561913:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851871.561914:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851871.561916:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851871.561917:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851871.561918:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851871.561918:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851871.561919:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:5.0:1773851871.561920:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409127424 avail=351407133696 avail_mb=1372684116 hwm_mb=3131101 files=372011300 ffree=343172976 state=0: rc = 0
00000004:00000020:5.0:1773851871.561922:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409127424 free, 351407133696 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011300 files, 343172976 free files
00000004:00000001:5.0:1773851871.561924:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851871.561925:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:5.0:1773851871.561927:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db244de4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051929920:2099@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851871.561930:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851871.561931:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851871.561931:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000db244de4 x1859433051929920/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852024 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851871.561934:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851871.561934:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851871.561935:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a58f956d.
02000000:00000001:5.0:1773851871.561936:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851871.561937:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851871.561937:0:41067:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:5.0:1773851871.561938:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851871.561939:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000005a2e8a27.
02000000:00000001:5.0:1773851871.561939:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851871.561940:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851871.561940:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db244de4.
00000100:00000001:5.0:1773851871.561941:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851871.561942:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851871.561942:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851871.561943:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851871.561943:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.561944:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851871.561944:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851871.591910:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.591910:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851871.591911:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851871.591912:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851871.591912:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851871.591914:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851871.591915:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851871.591917:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17698@kfi7 to cpt 6
00000800:00000200:25.0:1773851871.591917:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17698@kfi7(000000003a6f0fb0):0xd48 version: 2; local version 2; negotiated version: 2
00000400:00000200:27.0:1773851871.591918:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17698@kfi7 : PUT - for me
00000800:00000200:25.0:1773851871.591919:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 Using peer 17698@kfi7(0xd48)
00000400:00000200:27.0:1773851871.591920:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17698@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.591922:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000092c03618 nid 17698@kfi7 refs 1
00000400:00000200:27.0:1773851871.591924:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17698@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.591925:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000092c03618 nid 17698@kfi7 refs 2
00000400:00000200:27.0:1773851871.591925:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000092c03618 nid 17698@kfi7 refs 3
00000400:00000200:25.0:1773851871.591927:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17698@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.591928:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17699@kfi7 to cpt 1
00000400:00000200:27.0:1773851871.591929:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17699@kfi7 of length 224 into portal 12 MB=0x69baba6e65f80
00000800:00000200:25.0:1773851871.591929:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000878f9def: Posted send of 38 bytes to peer 0xd48: rc=0
00000400:00000200:27.0:1773851871.591930:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17699@kfi7 of length 224/224 into md 0x16159c9699 [64] + 16464
00000800:00000200:27.0:1773851871.591932:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851871.591932:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851871.591934:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851871.591935:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17698@kfi7: PUT: OK
00000100:00000001:27.0:1773851871.591936:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851871.591936:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851871.591937:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8901521.
00000100:00000040:27.0:1773851871.591938:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000a8901521 x1860011402092416 msgsize 224
00000100:00100000:27.0:1773851871.591940:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-17699@kfi7 (source: 12345-17698@kfi7)
00000100:00000001:27.0:1773851871.591942:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851871.591943:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000092c03618 nid 17698@kfi7 refs 2
00000800:00000200:27.0:1773851871.591944:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851871.591946:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851871.591947:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851871.591947:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851871.591948:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851871.591949:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851871.591951:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851871.591951:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 Transaction freed
00000100:00100000:26.0:1773851871.591952:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860011402092416
00000020:00000001:26.0:1773851871.591953:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851871.591953:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a441e2
00000020:00000001:26.0:1773851871.591955:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851871.591956:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a790bf9a refcount=11
00000020:00000001:26.0:1773851871.591957:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637069934403584 : -107003775148032 : ffff9eae3dfe2000)
00000020:00000001:26.0:1773851871.591959:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637069934403584 : -107003775148032 : ffff9eae3dfe2000)
00000100:00000001:26.0:1773851871.591961:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851871.591962:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851871.591963:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000066e61092.
00000020:00000010:26.0:1773851871.591965:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851871.591967:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042b93dea.
00000100:00000001:26.0:1773851871.591969:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851871.591970:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851871.591971:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851871.591972:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851871.591973:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851871.591974:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851871.591977:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851871.591979:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851871.591980:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851871.591980:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851871.591980:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851871.591982:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17699@kfi7, seq: 2025106
00000100:00000040:26.0:1773851871.591983:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a790bf9a : new rpc_count 2
00000100:00000001:25.0:1773851871.591983:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851871.591984:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998399744 : -107053711151872 : ffff9ea29d932d00)
00000100:00000001:25.0:1773851871.591984:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851871.591987:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a8901521 x1860011402092416/t0(0) o400->fdfc817c-ae14-4f4d-8573-04f048aa9138@17699@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1595-0'
00000100:00000001:26.0:1773851871.591992:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851871.591992:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851871.591994:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8901521 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:fdfc817c-ae14-4f4d-8573-04f048aa9138+11:39547:x1860011402092416:12345-17699@kfi7:400:default-tuolumne1595-0
00000100:00000200:26.0:1773851871.591997:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860011402092416
00000020:00000001:26.0:1773851871.591998:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851871.591999:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851871.592000:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851871.592001:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851871.592002:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851871.592004:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851871.592005:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860011402092416, found 0 last_xid 1860011401756287
00000020:00000001:26.0:1773851871.592007:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851871.592008:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851871.592009:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851871.592010:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851871.592011:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851871.592012:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851871.592014:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851871.592015:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000180b2aa7.
02000000:00000001:26.0:1773851871.592016:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851871.592017:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851871.592019:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851871.592020:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860011402092416
00010000:00000001:26.0:1773851871.592021:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851871.592023:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a8901521 x1860011402092416/t0(0) o400->fdfc817c-ae14-4f4d-8573-04f048aa9138@17699@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1595-0'
00010000:00000001:26.0:1773851871.592028:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851871.592029:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851871.592030:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=104 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851871.592032:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851871.592033:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002a199704 refcount 3 to 17699@kfi7
00000100:00000001:26.0:1773851871.592035:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702880 : -107156155848736 : ffff9e8ac36527e0)
02000000:00000001:26.0:1773851871.592036:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851871.592037:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851871.592039:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851871.592040:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17698@kfi7
00000400:00000010:26.0:1773851871.592041:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000445da448.
00000100:00000200:26.0:1773851871.592043:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860011402092416, offset 224
00000400:00000200:26.0:1773851871.592046:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17698@kfi7
00000400:00000200:26.0:1773851871.592048:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17698@kfi7 to cpt 6
00000400:00000200:26.0:1773851871.592050:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000092c03618 nid 17698@kfi7 refs 1
00000400:00000200:26.0:1773851871.592052:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000092c03618 nid 17698@kfi7 refs 2
00000400:00000200:26.0:1773851871.592054:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000092c03618 nid 17698@kfi7 refs 3
00000400:00000200:26.0:1773851871.592056:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17698@kfi7 local destination
00000400:00000200:26.0:1773851871.592059:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769370:8769370:1024:4294967295] 17698@kfi7 LPNI seq info [4211919:4211919:16:4294967295]
00000400:00000200:26.0:1773851871.592062:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000092c03618 nid 17698@kfi7 refs 2
00000400:00000200:26.0:1773851871.592063:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17698@kfi7 to cpt 6
00000400:00000200:26.0:1773851871.592067:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17698@kfi7(17698@kfi7:17698@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851871.592069:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000092c03618 nid 17698@kfi7 refs 3
00000800:00000200:26.0:1773851871.592073:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851871.592075:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851871.592079:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851871.592083:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 Using peer 17698@kfi7(0xd48)
00000800:00000200:26.0:1773851871.592088:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0xd48: rc=0
00000800:00000200:26.0:1773851871.592091:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851871.592094:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851871.592096:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002a199704 refcount 2 to 17699@kfi7
00010000:00000001:26.0:1773851871.592097:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851871.592098:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851871.592099:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851871.592100:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a8901521 x1860011402092416/t0(0) o400->fdfc817c-ae14-4f4d-8573-04f048aa9138@17699@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1595-0'
00000800:00000200:27.0:1773851871.592103:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851871.592104:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851871.592105:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17698@kfi7: PUT: OK
00000400:00000200:27.0:1773851871.592106:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000445da448
00000400:00000010:27.0:1773851871.592106:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000445da448.
00000100:00100000:26.0:1773851871.592106:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8901521 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:fdfc817c-ae14-4f4d-8573-04f048aa9138+11:39547:x1860011402092416:12345-17699@kfi7:400:default-tuolumne1595-0 Request processed in 113us (166us total) trans 0 rc 0/0
00000100:00000001:27.0:1773851871.592107:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851871.592107:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851871.592108:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000092c03618 nid 17698@kfi7 refs 2
00000800:00000200:27.0:1773851871.592109:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 17698@kfi7(000000003a6f0fb0):0x0 lsk 3401 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd48 Transaction freed
00000100:00100000:26.0:1773851871.592110:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17699@kfi7, seq: 2025106
00000100:00000040:26.0:1773851871.592112:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a790bf9a : new rpc_count 1
00000100:00000001:26.0:1773851871.592113:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851871.592114:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851871.592115:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851871.592116:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042b93dea.
00000020:00000010:26.0:1773851871.592118:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000066e61092.
00000020:00000040:26.0:1773851871.592119:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000a790bf9a : new refcount 10
00000100:00000001:26.0:1773851871.592120:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851871.604788:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.604790:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.604792:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.604797:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.604801:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20016@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.604804:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20016@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.604805:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20016@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.604807:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be8cc655 nid 20016@kfi7 refs 1
00000400:00000200:5.0:1773851871.604809:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20016@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.604810:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be8cc655 nid 20016@kfi7 refs 2
00000400:00000200:5.0:1773851871.604813:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be8cc655 nid 20016@kfi7 refs 3
00000400:00000200:5.0:1773851871.604814:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20209@kfi7 to cpt 7
00000400:00000200:5.0:1773851871.604816:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20209@kfi7 of length 224 into portal 12 MB=0x69b81a263bb40
00000400:00000200:5.0:1773851871.604819:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20209@kfi7 of length 224/224 into md 0x793926dc5 [64] + 146928
00000800:00000200:5.0:1773851871.604823:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.604826:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.604828:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20016@kfi7: PUT: OK
00000100:00000001:5.0:1773851871.604830:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.604831:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851871.604833:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d974d1bc.
00000100:00000040:5.0:1773851871.604834:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d974d1bc x1859830937795392 msgsize 224
00000100:00100000:5.0:1773851871.604837:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20209@kfi7 (source: 12345-20016@kfi7)
00000100:00000001:5.0:1773851871.604839:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851871.604841:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be8cc655 nid 20016@kfi7 refs 2
00000100:00000001:7.0:1773851871.604842:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851871.604843:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851871.604844:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851871.604844:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851871.604845:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851871.604846:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851871.604847:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830937795392
00000020:00000001:7.0:1773851871.604849:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851871.604849:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce739de
00000020:00000001:7.0:1773851871.604851:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851871.604853:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000db89442e refcount=5
00000020:00000001:7.0:1773851871.604854:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134902764544 : -106938806787072 : ffff9ebd5e68a400)
00000020:00000001:7.0:1773851871.604856:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134902764544 : -106938806787072 : ffff9ebd5e68a400)
00000100:00000001:7.0:1773851871.604857:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851871.604859:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851871.604860:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851871.604862:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851871.604863:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851871.604864:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851871.604865:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851871.604866:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851871.604868:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851871.604869:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851871.604870:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.604871:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851871.604874:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851871.604875:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851871.604875:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851871.604876:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851871.604877:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20209@kfi7, seq: 2001929
00000100:00000040:7.0:1773851871.604878:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000db89442e : new rpc_count 1
00000100:00000001:4.0:1773851871.604878:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.604880:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636952192394240 : -107121517157376 : ffff9e92d405a400)
00000100:00000001:4.0:1773851871.604880:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851871.604883:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d974d1bc x1859830937795392/t0(0) o400->5df35975-f349-4480-93cd-e38fb471d5be@20209@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1741-0'
00000100:00000001:7.0:1773851871.604888:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851871.604889:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851871.604890:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d974d1bc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5df35975-f349-4480-93cd-e38fb471d5be+5:39525:x1859830937795392:12345-20209@kfi7:400:default-tuolumne1741-0
00000100:00000200:7.0:1773851871.604893:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830937795392
00000020:00000001:7.0:1773851871.604894:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851871.604895:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851871.604897:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.604898:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851871.604899:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851871.604900:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851871.604902:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830937795392, found 0 last_xid 1859830937795391
00000020:00000001:7.0:1773851871.604903:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851871.604905:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851871.604905:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851871.604907:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.604908:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851871.604909:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851871.604910:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851871.604911:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e2853f17.
02000000:00000001:7.0:1773851871.604912:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.604913:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.604914:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851871.604916:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688720, transno 0, xid 1859830937795392
00010000:00000001:7.0:1773851871.604917:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851871.604919:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d974d1bc x1859830937795392/t0(0) o400->5df35975-f349-4480-93cd-e38fb471d5be@20209@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1741-0'
00010000:00000001:7.0:1773851871.604923:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851871.604924:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851871.604925:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=103 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851871.604926:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851871.604929:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000085406b30 refcount 3 to 20209@kfi7
00000100:00000001:7.0:1773851871.604930:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806848 : -107130477744768 : ffff9e90bdeded80)
02000000:00000001:7.0:1773851871.604931:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851871.604932:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.604933:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851871.604934:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20016@kfi7
00000400:00000010:7.0:1773851871.604934:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000068cc9555.
00000100:00000200:7.0:1773851871.604935:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830937795392, offset 224
00000400:00000200:7.0:1773851871.604937:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20016@kfi7
00000400:00000200:7.0:1773851871.604938:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20016@kfi7 to cpt 1
00000400:00000200:7.0:1773851871.604939:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be8cc655 nid 20016@kfi7 refs 1
00000400:00000200:7.0:1773851871.604941:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be8cc655 nid 20016@kfi7 refs 2
00000400:00000200:7.0:1773851871.604942:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be8cc655 nid 20016@kfi7 refs 3
00000400:00000200:7.0:1773851871.604943:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20016@kfi7 local destination
00000400:00000200:7.0:1773851871.604945:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769371:8769371:1024:4294967295] 20016@kfi7 LPNI seq info [864737:864737:16:4294967295]
00000400:00000200:7.0:1773851871.604946:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be8cc655 nid 20016@kfi7 refs 2
00000400:00000200:7.0:1773851871.604947:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20016@kfi7 to cpt 1
00000400:00000200:7.0:1773851871.604950:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20016@kfi7(20016@kfi7:20016@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851871.604951:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be8cc655 nid 20016@kfi7 refs 3
00000800:00000200:7.0:1773851871.604953:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851871.604954:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851871.604957:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851871.604960:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b37 Using peer 20016@kfi7(0x100000000000b37)
00000800:00000200:7.0:1773851871.604963:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x100000000000b37: rc=0
00000800:00000200:7.0:1773851871.604965:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b37 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851871.604967:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851871.604969:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000085406b30 refcount 2 to 20209@kfi7
00010000:00000001:7.0:1773851871.604970:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851871.604970:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.604971:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851871.604972:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d974d1bc x1859830937795392/t0(0) o400->5df35975-f349-4480-93cd-e38fb471d5be@20209@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1741-0'
00000100:00100000:7.0:1773851871.604975:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d974d1bc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5df35975-f349-4480-93cd-e38fb471d5be+5:39525:x1859830937795392:12345-20209@kfi7:400:default-tuolumne1741-0 Request processed in 86us (140us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851871.604976:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b37 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851871.604978:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20209@kfi7, seq: 2001929
00000100:00000040:7.0:1773851871.604978:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000db89442e : new rpc_count 0
00000400:00000200:5.0:1773851871.604978:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851871.604979:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851871.604979:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851871.604979:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20016@kfi7: PUT: OK
00000020:00000010:7.0:1773851871.604980:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851871.604980:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000068cc9555
00000020:00000010:7.0:1773851871.604981:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000400:00000010:5.0:1773851871.604981:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000068cc9555.
00000100:00000001:5.0:1773851871.604981:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851871.604982:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000020:00000040:7.0:1773851871.604982:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000db89442e : new refcount 4
00000100:00000001:5.0:1773851871.604982:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851871.604983:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851871.604983:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be8cc655 nid 20016@kfi7 refs 2
00000800:00000200:5.0:1773851871.604984:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20016@kfi7(0000000026fdc32c):0x0 lsk 2872 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000b37 Transaction freed
00000800:00000200:17.0:1773851871.626866:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.626866:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.626867:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.626869:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.626871:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19043@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.626872:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19043@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.626873:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19043@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.626873:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093ad879c nid 19043@kfi7 refs 1
00000400:00000200:17.0:1773851871.626874:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19043@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.626875:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093ad879c nid 19043@kfi7 refs 2
00000400:00000200:17.0:1773851871.626876:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000093ad879c nid 19043@kfi7 refs 3
00000400:00000200:17.0:1773851871.626876:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19107@kfi7 to cpt 7
00000400:00000200:17.0:1773851871.626877:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19107@kfi7 of length 224 into portal 12 MB=0x69b4b898e2800
00000400:00000200:17.0:1773851871.626878:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19107@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 21288
00000800:00000200:17.0:1773851871.626880:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.626881:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.626882:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19043@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.626883:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.626883:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.626884:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004f56b6ed.
00000100:00000040:17.0:1773851871.626885:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000004f56b6ed x1859598592911360 msgsize 224
00000100:00100000:17.0:1773851871.626886:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19107@kfi7 (source: 12345-19043@kfi7)
00000100:00000001:17.0:1773851871.626887:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.626888:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000093ad879c nid 19043@kfi7 refs 2
00000100:00000001:16.0:1773851871.626888:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851871.626889:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.626889:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.626890:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.626890:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.626891:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.626892:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598592911360
00000020:00000001:16.0:1773851871.626892:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.626893:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81c5d
00000020:00000001:16.0:1773851871.626893:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.626896:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ca4520fe refcount=5
00000020:00000001:16.0:1773851871.626896:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127342115840 : -106946367435776 : ffff9ebb9bc24c00)
00000020:00000001:16.0:1773851871.626897:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127342115840 : -106946367435776 : ffff9ebb9bc24c00)
00000100:00000001:16.0:1773851871.626898:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.626900:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.626900:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851871.626901:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.626902:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.626903:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.626903:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851871.626904:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.626905:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851871.626905:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851871.626906:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.626907:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851871.626908:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851871.626908:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851871.626908:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.626908:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851871.626909:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19107@kfi7, seq: 2156346
00000100:00000001:17.0:1773851871.626910:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.626910:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ca4520fe : new rpc_count 1
00000100:00000001:17.0:1773851871.626911:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.626911:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636970971067648 : -107102738483968 : ffff9e9733517500)
00000100:00000040:16.0:1773851871.626912:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004f56b6ed x1859598592911360/t0(0) o400->a7c4a1db-68ae-47cb-a0e2-2b57658d2230@19107@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1676-0'
00000100:00000001:16.0:1773851871.626915:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.626915:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851871.626916:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f56b6ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:a7c4a1db-68ae-47cb-a0e2-2b57658d2230+5:39546:x1859598592911360:12345-19107@kfi7:400:default-tuolumne1676-0
00000100:00000200:16.0:1773851871.626917:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598592911360
00000020:00000001:16.0:1773851871.626918:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851871.626919:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851871.626919:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.626920:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851871.626921:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851871.626922:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851871.626922:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598592911360, found 0 last_xid 1859598592911359
00000020:00000001:16.0:1773851871.626923:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851871.626924:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851871.626924:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851871.626925:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.626926:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851871.626927:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851871.626927:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851871.626928:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000035f4efd0.
02000000:00000001:16.0:1773851871.626929:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.626929:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.626930:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851871.626931:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260753232, transno 0, xid 1859598592911360
00010000:00000001:16.0:1773851871.626932:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851871.626932:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004f56b6ed x1859598592911360/t0(0) o400->a7c4a1db-68ae-47cb-a0e2-2b57658d2230@19107@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1676-0'
00010000:00000001:16.0:1773851871.626935:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851871.626935:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851871.626936:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=104 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851871.626937:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.626938:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d452a93 refcount 3 to 19107@kfi7
00000100:00000001:16.0:1773851871.626939:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270816 : -107152618280800 : ffff9e8b964028a0)
02000000:00000001:16.0:1773851871.626940:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851871.626940:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.626941:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851871.626942:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19043@kfi7
00000400:00000010:16.0:1773851871.626942:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c3bdcee3.
00000100:00000200:16.0:1773851871.626943:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598592911360, offset 224
00000400:00000200:16.0:1773851871.626945:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19043@kfi7
00000400:00000200:16.0:1773851871.626946:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19043@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.626946:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093ad879c nid 19043@kfi7 refs 1
00000400:00000200:16.0:1773851871.626947:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000093ad879c nid 19043@kfi7 refs 2
00000400:00000200:16.0:1773851871.626949:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000093ad879c nid 19043@kfi7 refs 3
00000400:00000200:16.0:1773851871.626950:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19043@kfi7 local destination
00000400:00000200:16.0:1773851871.626951:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769372:8769372:1024:4294967295] 19043@kfi7 LPNI seq info [18087064:18087064:16:4294967295]
00000400:00000200:16.0:1773851871.626952:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000093ad879c nid 19043@kfi7 refs 2
00000400:00000200:16.0:1773851871.626953:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19043@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.626955:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19043@kfi7(19043@kfi7:19043@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851871.626957:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000093ad879c nid 19043@kfi7 refs 3
00000800:00000200:16.0:1773851871.626958:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851871.626959:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851871.626961:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851871.626963:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2fb Using peer 19043@kfi7(0x2fb)
00000800:00000200:16.0:1773851871.626966:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x2fb: rc=0
00000800:00000200:16.0:1773851871.626968:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2fb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851871.626970:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.626970:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d452a93 refcount 2 to 19107@kfi7
00010000:00000001:16.0:1773851871.626971:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851871.626972:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.626972:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851871.626973:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004f56b6ed x1859598592911360/t0(0) o400->a7c4a1db-68ae-47cb-a0e2-2b57658d2230@19107@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1676-0'
00000100:00100000:16.0:1773851871.626977:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f56b6ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:a7c4a1db-68ae-47cb-a0e2-2b57658d2230+5:39546:x1859598592911360:12345-19107@kfi7:400:default-tuolumne1676-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851871.626980:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19107@kfi7, seq: 2156346
00000100:00000040:16.0:1773851871.626980:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ca4520fe : new rpc_count 0
00000100:00000001:16.0:1773851871.626981:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.626982:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.626982:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.626983:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.626983:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851871.626984:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000ca4520fe : new refcount 4
00000100:00000001:16.0:1773851871.626985:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851871.626991:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2fb TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851871.626992:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.626993:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19043@kfi7: PUT: OK
00000400:00000200:17.0:1773851871.626994:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c3bdcee3
00000400:00000010:17.0:1773851871.626995:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c3bdcee3.
00000100:00000001:17.0:1773851871.626995:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851871.626996:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851871.626996:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000093ad879c nid 19043@kfi7 refs 2
00000800:00000200:17.0:1773851871.626998:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 19043@kfi7(000000000c074af7):0x0 lsk 764 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2fb Transaction freed
00000800:00000200:10.0:1773851871.678786:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851871.678786:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851871.678787:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851871.678787:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851871.678788:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851871.678788:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851871.678790:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851871.678790:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8785@kfi7(00000000d6e2cf8b):0x5d2 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851871.678792:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000800:00000200:9.0:1773851871.678792:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 Using peer 8785@kfi7(0x1000000000005d2)
00000400:00000200:10.0:1773851871.678794:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8785@kfi7 : PUT - for me
00000400:00000200:9.0:1773851871.678794:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.678795:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.678796:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 1
00000800:00000200:9.0:1773851871.678796:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000022757302: Posted send of 38 bytes to peer 0x1000000000005d2: rc=0
00000400:00000200:10.0:1773851871.678797:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:10.0:1773851871.678798:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000800:00000200:9.0:1773851871.678798:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851871.678799:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 3
00000400:00000200:10.0:1773851871.678800:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8784@kfi7 to cpt 7
00000400:00000200:10.0:1773851871.678801:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8784@kfi7 of length 224 into portal 12 MB=0x69b09dadddc40
00000400:00000200:10.0:1773851871.678803:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8784@kfi7 of length 224/224 into md 0x78146ce49 [64] + 138952
00000800:00000200:10.0:1773851871.678805:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851871.678807:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851871.678808:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8785@kfi7: PUT: OK
00000100:00000001:10.0:1773851871.678809:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851871.678809:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851871.678810:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c424742.
00000800:00000200:9.0:1773851871.678810:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851871.678811:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000004c424742 x1859316489247808 msgsize 224
00000800:00000200:9.0:1773851871.678812:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 Transaction freed
00000100:00100000:10.0:1773851871.678813:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-8784@kfi7 (source: 12345-8785@kfi7)
00000100:00000001:10.0:1773851871.678814:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851871.678815:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000100:00000001:11.0:1773851871.678816:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851871.678817:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851871.678817:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851871.678817:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851871.678818:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851871.678819:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851871.678820:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316489247808
00000020:00000001:11.0:1773851871.678821:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851871.678821:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9139c
00000020:00000001:11.0:1773851871.678822:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851871.678827:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008281f514 refcount=6
00000020:00000001:11.0:1773851871.678827:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169318400 : -107127540233216 : ffff9e916d04cc00)
00000020:00000001:11.0:1773851871.678828:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169318400 : -107127540233216 : ffff9e916d04cc00)
00000100:00000001:11.0:1773851871.678829:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851871.678830:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851871.678831:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020699928.
00000020:00000010:11.0:1773851871.678832:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851871.678833:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851871.678834:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851871.678834:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851871.678835:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851871.678836:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851871.678837:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851871.678837:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.678838:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851871.678840:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851871.678840:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851871.678841:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8784@kfi7, seq: 2130787
00000100:00000001:8.0:1773851871.678841:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851871.678841:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851871.678842:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008281f514 : new rpc_count 1
00000100:00000001:8.0:1773851871.678842:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.678843:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105077425792 : -106968632125824 : ffff9eb66cae1680)
00000100:00000001:8.0:1773851871.678843:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851871.678844:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004c424742 x1859316489247808/t0(0) o400->29d42724-7f65-4f1f-bf2b-36c553cdb83c@8784@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1042-0'
00000100:00000001:11.0:1773851871.678847:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851871.678848:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851871.678849:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c424742 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:29d42724-7f65-4f1f-bf2b-36c553cdb83c+6:39888:x1859316489247808:12345-8784@kfi7:400:default-tuolumne1042-0
00000100:00000200:11.0:1773851871.678850:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316489247808
00000020:00000001:11.0:1773851871.678851:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851871.678852:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851871.678853:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.678854:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851871.678855:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851871.678855:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851871.678856:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316489247808, found 0 last_xid 1859316489247807
00000020:00000001:11.0:1773851871.678857:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851871.678858:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851871.678858:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851871.678859:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.678860:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851871.678860:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851871.678861:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851871.678862:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006c0219a7.
02000000:00000001:11.0:1773851871.678862:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.678863:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.678864:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851871.678864:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859316489247808
00010000:00000001:11.0:1773851871.678865:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851871.678866:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004c424742 x1859316489247808/t0(0) o400->29d42724-7f65-4f1f-bf2b-36c553cdb83c@8784@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1042-0'
00010000:00000001:11.0:1773851871.678869:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851871.678870:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851871.678870:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=104 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851871.678872:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851871.678873:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b36472f refcount 5 to 8784@kfi7
00000100:00000001:11.0:1773851871.678873:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271392 : -107152618280224 : ffff9e8b96402ae0)
02000000:00000001:11.0:1773851871.678874:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851871.678875:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.678876:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851871.678877:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8785@kfi7
00000400:00000010:11.0:1773851871.678877:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000040309670.
00000100:00000200:11.0:1773851871.678878:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316489247808, offset 224
00000400:00000200:11.0:1773851871.678880:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8785@kfi7
00000400:00000200:11.0:1773851871.678881:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:11.0:1773851871.678882:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 1
00000400:00000200:11.0:1773851871.678883:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000400:00000200:11.0:1773851871.678885:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 3
00000400:00000200:11.0:1773851871.678886:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8785@kfi7 local destination
00000400:00000200:11.0:1773851871.678888:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769373:8769373:1024:4294967295] 8785@kfi7 LPNI seq info [721293:721293:16:4294967295]
00000400:00000200:11.0:1773851871.678889:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000400:00000200:11.0:1773851871.678890:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:11.0:1773851871.678892:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8785@kfi7(8785@kfi7:8785@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851871.678894:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 3
00000800:00000200:11.0:1773851871.678895:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851871.678896:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851871.678899:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851871.678901:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 Using peer 8785@kfi7(0x1000000000005d2)
00000800:00000200:11.0:1773851871.678904:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x1000000000005d2: rc=0
00000800:00000200:11.0:1773851871.678906:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851871.678908:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851871.678909:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b36472f refcount 4 to 8784@kfi7
00010000:00000001:11.0:1773851871.678910:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851871.678911:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.678911:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851871.678912:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c424742 x1859316489247808/t0(0) o400->29d42724-7f65-4f1f-bf2b-36c553cdb83c@8784@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1042-0'
00000100:00100000:11.0:1773851871.678915:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c424742 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:29d42724-7f65-4f1f-bf2b-36c553cdb83c+6:39888:x1859316489247808:12345-8784@kfi7:400:default-tuolumne1042-0 Request processed in 67us (103us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851871.678918:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8784@kfi7, seq: 2130787
00000800:00000200:9.0:1773851871.678918:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851871.678919:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008281f514 : new rpc_count 0
00000400:00000200:9.0:1773851871.678919:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851871.678920:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851871.678921:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8785@kfi7: PUT: OK
00000400:00000200:9.0:1773851871.678922:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000040309670
00000100:00000001:11.0:1773851871.678923:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:9.0:1773851871.678923:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000040309670.
00000100:00000001:9.0:1773851871.678923:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851871.678924:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851871.678924:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000100:00000001:9.0:1773851871.678924:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851871.678925:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020699928.
00000400:00000200:9.0:1773851871.678925:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000020:00000040:11.0:1773851871.678926:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000008281f514 : new refcount 5
00000800:00000200:9.0:1773851871.678926:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 8785@kfi7(00000000d6e2cf8b):0x0 lsk 1491 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000005d2 Transaction freed
00000100:00000001:11.0:1773851871.678927:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851871.685534:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.685535:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.685536:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.685541:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.685543:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.685544:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20050@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.685544:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.685545:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 1
00000400:00000200:5.0:1773851871.685547:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.685547:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000400:00000200:5.0:1773851871.685548:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 3
00000400:00000200:5.0:1773851871.685549:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20051@kfi7 to cpt 4
00000400:00000200:5.0:1773851871.685550:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20051@kfi7 of length 224 into portal 12 MB=0x69b0962b443c0
00000400:00000200:5.0:1773851871.685551:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20051@kfi7 of length 224/224 into md 0x793926dc5 [64] + 147152
00000800:00000200:5.0:1773851871.685553:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.685554:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.685555:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20050@kfi7: PUT: OK
00000100:00000001:5.0:1773851871.685556:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.685557:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851871.685558:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007ce9ea27.
00000100:00000040:5.0:1773851871.685558:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000007ce9ea27 x1859314473255872 msgsize 224
00000100:00100000:5.0:1773851871.685560:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20051@kfi7 (source: 12345-20050@kfi7)
00000100:00000001:5.0:1773851871.685561:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851871.685561:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000100:00000001:7.0:1773851871.685562:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851871.685563:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851871.685563:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851871.685563:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851871.685564:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851871.685564:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851871.685565:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314473255872
00000020:00000001:7.0:1773851871.685566:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851871.685566:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9245f
00000020:00000001:7.0:1773851871.685566:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851871.685568:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b573411 refcount=6
00000020:00000001:7.0:1773851871.685569:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630530048 : -107123079021568 : ffff9e9276ed7c00)
00000020:00000001:7.0:1773851871.685570:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630530048 : -107123079021568 : ffff9e9276ed7c00)
00000100:00000001:7.0:1773851871.685571:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851871.685571:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851871.685572:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851871.685573:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851871.685574:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851871.685575:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851871.685575:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851871.685576:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851871.685576:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851871.685577:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851871.685578:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.685578:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851871.685579:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851871.685580:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851871.685580:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851871.685580:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851871.685581:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20051@kfi7, seq: 2001930
00000100:00000040:7.0:1773851871.685582:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b573411 : new rpc_count 1
00000100:00000001:7.0:1773851871.685582:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121034339200 : -106952675212416 : ffff9eba23c94380)
00000100:00000001:4.0:1773851871.685582:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851871.685582:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851871.685584:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007ce9ea27 x1859314473255872/t0(0) o400->4aef6dfa-17f5-4f69-babe-22c1507cf887@20051@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1750-0'
00000100:00000001:7.0:1773851871.685586:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851871.685587:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851871.685588:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ce9ea27 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4aef6dfa-17f5-4f69-babe-22c1507cf887+6:39852:x1859314473255872:12345-20051@kfi7:400:default-tuolumne1750-0
00000100:00000200:7.0:1773851871.685589:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314473255872
00000020:00000001:7.0:1773851871.685590:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851871.685590:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851871.685591:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685591:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851871.685592:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851871.685593:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851871.685593:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314473255872, found 0 last_xid 1859314473255871
00000020:00000001:7.0:1773851871.685594:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851871.685595:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851871.685595:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851871.685596:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685597:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851871.685597:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851871.685598:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851871.685599:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002ab8af00.
02000000:00000001:7.0:1773851871.685599:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.685600:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685601:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851871.685602:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314473255872
00010000:00000001:7.0:1773851871.685602:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851871.685603:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007ce9ea27 x1859314473255872/t0(0) o400->4aef6dfa-17f5-4f69-babe-22c1507cf887@20051@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1750-0'
00010000:00000001:7.0:1773851871.685606:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851871.685606:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851871.685607:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=103 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851871.685608:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851871.685609:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036bcc48f refcount 5 to 20051@kfi7
00000100:00000001:7.0:1773851871.685609:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959744 : -107156125591872 : ffff9e8ac532d6c0)
02000000:00000001:7.0:1773851871.685610:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851871.685611:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.685611:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851871.685612:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20050@kfi7
00000400:00000010:7.0:1773851871.685613:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036a990bc.
00000100:00000200:7.0:1773851871.685614:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314473255872, offset 224
00000400:00000200:7.0:1773851871.685615:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20050@kfi7
00000400:00000200:7.0:1773851871.685616:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:7.0:1773851871.685617:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 1
00000400:00000200:7.0:1773851871.685618:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000400:00000200:7.0:1773851871.685619:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 3
00000400:00000200:7.0:1773851871.685620:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20050@kfi7 local destination
00000400:00000200:7.0:1773851871.685621:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769374:8769374:1024:4294967295] 20050@kfi7 LPNI seq info [735350:735350:16:4294967295]
00000400:00000200:7.0:1773851871.685623:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000400:00000200:7.0:1773851871.685623:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:7.0:1773851871.685625:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20050@kfi7(20050@kfi7:20050@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851871.685626:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 3
00000800:00000200:7.0:1773851871.685628:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851871.685629:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851871.685631:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851871.685633:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000217 Using peer 20050@kfi7(0x100000000000217)
00000800:00000200:7.0:1773851871.685636:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x100000000000217: rc=0
00000800:00000200:7.0:1773851871.685638:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000217 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851871.685640:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851871.685640:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036bcc48f refcount 4 to 20051@kfi7
00010000:00000001:7.0:1773851871.685641:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851871.685642:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685642:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851871.685643:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007ce9ea27 x1859314473255872/t0(0) o400->4aef6dfa-17f5-4f69-babe-22c1507cf887@20051@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1750-0'
00000100:00100000:7.0:1773851871.685646:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ce9ea27 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4aef6dfa-17f5-4f69-babe-22c1507cf887+6:39852:x1859314473255872:12345-20051@kfi7:400:default-tuolumne1750-0 Request processed in 59us (87us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851871.685649:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20051@kfi7, seq: 2001930
00000800:00000200:5.0:1773851871.685649:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000217 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851871.685650:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b573411 : new rpc_count 0
00000100:00000001:7.0:1773851871.685650:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851871.685651:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851871.685651:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851871.685651:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851871.685652:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000400:00000200:5.0:1773851871.685652:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20050@kfi7: PUT: OK
00000020:00000010:7.0:1773851871.685653:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000400:00000200:5.0:1773851871.685653:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036a990bc
00000020:00000040:7.0:1773851871.685654:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000002b573411 : new refcount 5
00000400:00000010:5.0:1773851871.685654:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036a990bc.
00000100:00000001:7.0:1773851871.685655:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851871.685655:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851871.685656:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851871.685656:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000800:00000200:5.0:1773851871.685658:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 20050@kfi7(00000000eeeb9824):0x0 lsk 536 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000217 Transaction freed
00000800:00000200:5.0:1773851871.685666:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.685667:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.685668:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.685670:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.685672:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.685673:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20050@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.685674:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.685675:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 1
00000400:00000200:5.0:1773851871.685676:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.685677:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000400:00000200:5.0:1773851871.685677:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 3
00000400:00000200:5.0:1773851871.685678:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20051@kfi7 to cpt 4
00000400:00000200:5.0:1773851871.685679:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20051@kfi7 of length 224 into portal 12 MB=0x69b0962b44540
00000400:00000200:5.0:1773851871.685680:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20051@kfi7 of length 224/224 into md 0x793926dc5 [64] + 147376
00000800:00000200:5.0:1773851871.685682:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.685683:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.685684:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20050@kfi7: PUT: OK
00000100:00000001:5.0:1773851871.685685:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.685686:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851871.685686:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000975ec356.
00000100:00000040:5.0:1773851871.685687:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000975ec356 x1859314473256256 msgsize 224
00000100:00100000:5.0:1773851871.685688:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20051@kfi7 (source: 12345-20050@kfi7)
00000100:00000001:5.0:1773851871.685689:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851871.685690:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000100:00000001:7.0:1773851871.685691:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851871.685691:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851871.685691:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851871.685692:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851871.685692:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851871.685693:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851871.685693:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314473256256
00000020:00000001:7.0:1773851871.685694:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851871.685694:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92466
00000020:00000001:7.0:1773851871.685694:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851871.685698:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000005d7be2d refcount=6
00000020:00000001:7.0:1773851871.685699:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630498304 : -107123079053312 : ffff9e9276ed0000)
00000020:00000001:7.0:1773851871.685700:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630498304 : -107123079053312 : ffff9e9276ed0000)
00000100:00000001:7.0:1773851871.685700:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851871.685701:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851871.685702:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851871.685702:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851871.685703:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851871.685704:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851871.685704:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851871.685704:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851871.685705:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851871.685705:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851871.685706:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.685706:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851871.685707:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851871.685708:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851871.685708:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851871.685708:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851871.685709:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20051@kfi7, seq: 2001931
00000100:00000040:7.0:1773851871.685709:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000005d7be2d : new rpc_count 1
00000100:00000001:4.0:1773851871.685709:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.685710:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121034331136 : -106952675220480 : ffff9eba23c92400)
00000100:00000001:4.0:1773851871.685710:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851871.685711:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000975ec356 x1859314473256256/t0(0) o400->04895465-e12a-457a-82bb-fa0eeb1ab450@20051@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1750-0'
00000100:00000001:7.0:1773851871.685713:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851871.685713:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851871.685714:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000975ec356 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:04895465-e12a-457a-82bb-fa0eeb1ab450+6:39852:x1859314473256256:12345-20051@kfi7:400:default-tuolumne1750-0
00000100:00000200:7.0:1773851871.685715:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314473256256
00000020:00000001:7.0:1773851871.685716:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851871.685717:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851871.685717:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685718:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851871.685718:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851871.685719:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851871.685719:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314473256256, found 0 last_xid 1859314473256255
00000020:00000001:7.0:1773851871.685720:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851871.685721:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851871.685721:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851871.685721:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685722:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851871.685722:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851871.685723:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851871.685723:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002c3d3ce0.
02000000:00000001:7.0:1773851871.685724:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.685724:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685729:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851871.685729:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260551912, transno 0, xid 1859314473256256
00010000:00000001:7.0:1773851871.685730:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851871.685731:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000975ec356 x1859314473256256/t0(0) o400->04895465-e12a-457a-82bb-fa0eeb1ab450@20051@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1750-0'
00010000:00000001:7.0:1773851871.685733:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851871.685733:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851871.685734:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=103 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851871.685735:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851871.685736:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036bcc48f refcount 5 to 20051@kfi7
00000100:00000001:7.0:1773851871.685736:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959744 : -107156125591872 : ffff9e8ac532d6c0)
02000000:00000001:7.0:1773851871.685737:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851871.685737:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851871.685738:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851871.685738:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20050@kfi7
00000400:00000010:7.0:1773851871.685739:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000232fbe3.
00000100:00000200:7.0:1773851871.685740:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314473256256, offset 224
00000400:00000200:7.0:1773851871.685741:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20050@kfi7
00000400:00000200:7.0:1773851871.685741:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:7.0:1773851871.685742:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 1
00000400:00000200:7.0:1773851871.685743:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000400:00000200:7.0:1773851871.685744:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 3
00000400:00000200:7.0:1773851871.685745:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20050@kfi7 local destination
00000400:00000200:7.0:1773851871.685747:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769375:8769375:1024:4294967295] 20050@kfi7 LPNI seq info [735351:735351:16:4294967295]
00000400:00000200:7.0:1773851871.685748:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000400:00000200:7.0:1773851871.685749:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20050@kfi7 to cpt 1
00000400:00000200:7.0:1773851871.685750:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20050@kfi7(20050@kfi7:20050@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851871.685751:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 3
00000800:00000200:7.0:1773851871.685752:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851871.685753:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851871.685755:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851871.685757:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21d Using peer 20050@kfi7(0x21d)
00000800:00000200:7.0:1773851871.685760:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x21d: rc=0
00000800:00000200:7.0:1773851871.685761:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851871.685763:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851871.685763:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036bcc48f refcount 4 to 20051@kfi7
00010000:00000001:7.0:1773851871.685764:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851871.685764:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851871.685765:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851871.685765:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000975ec356 x1859314473256256/t0(0) o400->04895465-e12a-457a-82bb-fa0eeb1ab450@20051@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1750-0'
00000100:00100000:7.0:1773851871.685768:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000975ec356 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:04895465-e12a-457a-82bb-fa0eeb1ab450+6:39852:x1859314473256256:12345-20051@kfi7:400:default-tuolumne1750-0 Request processed in 54us (80us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851871.685770:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20051@kfi7, seq: 2001931
00000100:00000040:7.0:1773851871.685771:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000005d7be2d : new rpc_count 0
00000100:00000001:7.0:1773851871.685772:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851871.685773:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851871.685773:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000800:00000200:5.0:1773851871.685773:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21d TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851871.685774:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000020:00000010:7.0:1773851871.685774:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000400:00000200:5.0:1773851871.685774:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851871.685775:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000005d7be2d : new refcount 5
00000400:00000200:5.0:1773851871.685775:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20050@kfi7: PUT: OK
00000100:00000001:7.0:1773851871.685776:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851871.685776:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000232fbe3
00000400:00000010:5.0:1773851871.685776:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000232fbe3.
00000100:00000001:5.0:1773851871.685777:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851871.685777:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851871.685778:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000101088e7 nid 20050@kfi7 refs 2
00000800:00000200:5.0:1773851871.685779:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 20050@kfi7(0000000030ec26a9):0x0 lsk 542 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21d Transaction freed
00000800:00000200:29.0:1773851871.691275:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851871.691276:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851871.691278:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851871.691281:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851871.691285:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18256@kfi7 to cpt 7
00000400:00000200:29.0:1773851871.691287:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18256@kfi7 : PUT - for me
00000400:00000200:29.0:1773851871.691288:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18256@kfi7 to cpt 7
00000400:00000200:29.0:1773851871.691289:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d2ea442 nid 18256@kfi7 refs 1
00000400:00000200:29.0:1773851871.691291:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18256@kfi7 to cpt 7
00000400:00000200:29.0:1773851871.691292:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d2ea442 nid 18256@kfi7 refs 2
00000400:00000200:29.0:1773851871.691293:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007d2ea442 nid 18256@kfi7 refs 3
00000400:00000200:29.0:1773851871.691295:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18321@kfi7 to cpt 6
00000400:00000200:29.0:1773851871.691296:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18321@kfi7 of length 224 into portal 12 MB=0x69b16fae70d80
00000400:00000200:29.0:1773851871.691299:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18321@kfi7 of length 224/224 into md 0x77fe139dd [64] + 181032
00000800:00000200:29.0:1773851871.691302:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851871.691305:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851871.691307:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18256@kfi7: PUT: OK
00000100:00000001:29.0:1773851871.691309:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851871.691309:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851871.691311:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fc459a46.
00000100:00000040:29.0:1773851871.691312:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000fc459a46 x1859372861296000 msgsize 224
00000100:00100000:29.0:1773851871.691315:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-18321@kfi7 (source: 12345-18256@kfi7)
00000100:00000001:29.0:1773851871.691316:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851871.691318:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007d2ea442 nid 18256@kfi7 refs 2
00000100:00000001:31.0:1773851871.691319:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851871.691320:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851871.691320:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851871.691320:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851871.691321:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851871.691322:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851871.691324:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372861296000
00000020:00000001:31.0:1773851871.691324:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851871.691325:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793af82964
00000020:00000001:31.0:1773851871.691326:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851871.691329:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000018c039c refcount=5
00000020:00000001:31.0:1773851871.691331:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956580375552 : -107117129176064 : ffff9e93d990ec00)
00000020:00000001:31.0:1773851871.691332:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636956580375552 : -107117129176064 : ffff9e93d990ec00)
00000100:00000001:31.0:1773851871.691333:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851871.691334:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851871.691335:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851871.691337:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851871.691338:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851871.691339:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851871.691340:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851871.691341:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851871.691343:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851871.691344:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851871.691344:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851871.691346:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851871.691348:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851871.691348:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851871.691348:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851871.691349:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851871.691350:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18321@kfi7, seq: 2055531
00000100:00000001:31.0:1773851871.691351:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851871.691351:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000018c039c : new rpc_count 1
00000100:00000001:31.0:1773851871.691352:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.691352:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309682560 : -106988399869056 : ffff9eb1d26e4380)
00000100:00000040:28.0:1773851871.691353:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fc459a46 x1859372861296000/t0(0) o400->d0b6ebb4-f855-4e4a-b704-ba6276462e5e@18321@kfi7:659/0 lens 224/0 e 0 to 0 dl 1773852019 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1634-0'
00000100:00000001:28.0:1773851871.691356:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851871.691356:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851871.691358:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fc459a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d0b6ebb4-f855-4e4a-b704-ba6276462e5e+5:39859:x1859372861296000:12345-18321@kfi7:400:default-tuolumne1634-0
00000100:00000200:28.0:1773851871.691359:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372861296000
00000020:00000001:28.0:1773851871.691360:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851871.691361:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851871.691361:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.691362:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851871.691363:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851871.691364:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851871.691364:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372861296000, found 0 last_xid 1859372861295999
00000020:00000001:28.0:1773851871.691365:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851871.691366:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851871.691366:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851871.691367:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.691368:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851871.691368:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851871.691369:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851871.691370:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005251a13b.
02000000:00000001:28.0:1773851871.691371:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.691371:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.691372:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851871.691373:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262832520, transno 0, xid 1859372861296000
00010000:00000001:28.0:1773851871.691374:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851871.691375:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fc459a46 x1859372861296000/t0(0) o400->d0b6ebb4-f855-4e4a-b704-ba6276462e5e@18321@kfi7:659/0 lens 224/224 e 0 to 0 dl 1773852019 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1634-0'
00010000:00000001:28.0:1773851871.691380:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851871.691380:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851871.691381:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=104 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851871.691382:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851871.691383:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a70b1eac refcount 3 to 18321@kfi7
00000100:00000001:28.0:1773851871.691384:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313741504 : -107139395810112 : ffff9e8eaa5f0cc0)
02000000:00000001:28.0:1773851871.691385:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851871.691385:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.691386:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851871.691387:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18256@kfi7
00000400:00000010:28.0:1773851871.691388:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f52a267c.
00000100:00000200:28.0:1773851871.691388:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372861296000, offset 224
00000400:00000200:28.0:1773851871.691390:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18256@kfi7
00000400:00000200:28.0:1773851871.691391:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18256@kfi7 to cpt 7
00000400:00000200:28.0:1773851871.691392:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d2ea442 nid 18256@kfi7 refs 1
00000400:00000200:28.0:1773851871.691393:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007d2ea442 nid 18256@kfi7 refs 2
00000400:00000200:28.0:1773851871.691395:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007d2ea442 nid 18256@kfi7 refs 3
00000400:00000200:28.0:1773851871.691396:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18256@kfi7 local destination
00000400:00000200:28.0:1773851871.691397:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769376:8769376:1024:4294967295] 18256@kfi7 LPNI seq info [1158994:1158994:16:4294967295]
00000400:00000200:28.0:1773851871.691399:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007d2ea442 nid 18256@kfi7 refs 2
00000400:00000200:28.0:1773851871.691400:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18256@kfi7 to cpt 7
00000400:00000200:28.0:1773851871.691402:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18256@kfi7(18256@kfi7:18256@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851871.691403:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007d2ea442 nid 18256@kfi7 refs 3
00000800:00000200:28.0:1773851871.691405:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851871.691406:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851871.691408:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851871.691411:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000302 Using peer 18256@kfi7(0x100000000000302)
00000800:00000200:28.0:1773851871.691416:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x100000000000302: rc=0
00000800:00000200:28.0:1773851871.691418:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000302 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851871.691420:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851871.691420:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a70b1eac refcount 2 to 18321@kfi7
00010000:00000001:28.0:1773851871.691421:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851871.691422:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.691422:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851871.691423:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fc459a46 x1859372861296000/t0(0) o400->d0b6ebb4-f855-4e4a-b704-ba6276462e5e@18321@kfi7:659/0 lens 224/224 e 0 to 0 dl 1773852019 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1634-0'
00000100:00100000:28.0:1773851871.691428:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fc459a46 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d0b6ebb4-f855-4e4a-b704-ba6276462e5e+5:39859:x1859372861296000:12345-18321@kfi7:400:default-tuolumne1634-0 Request processed in 71us (115us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851871.691431:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18321@kfi7, seq: 2055531
00000100:00000040:28.0:1773851871.691431:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000018c039c : new rpc_count 0
00000100:00000001:28.0:1773851871.691432:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851871.691433:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851871.691434:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:28.0:1773851871.691434:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:28.0:1773851871.691435:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:28.0:1773851871.691436:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000018c039c : new refcount 4
00000100:00000001:28.0:1773851871.691437:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851871.691443:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000302 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851871.691446:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851871.691448:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18256@kfi7: PUT: OK
00000400:00000200:29.0:1773851871.691449:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f52a267c
00000400:00000010:29.0:1773851871.691450:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f52a267c.
00000100:00000001:29.0:1773851871.691451:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851871.691452:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851871.691453:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007d2ea442 nid 18256@kfi7 refs 2
00000800:00000200:29.0:1773851871.691456:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 18256@kfi7(00000000c381a95e):0x0 lsk 771 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000302 Transaction freed
00000800:00000200:5.0:1773851871.701178:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851871.701179:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851871.701180:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851871.701182:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851871.701184:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.701185:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851871.701186:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.701187:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851871.701188:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851871.701189:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851871.701190:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851871.701191:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851871.701192:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a879ee500
00000400:00000200:5.0:1773851871.701193:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 6736
00000800:00000200:5.0:1773851871.701195:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851871.701196:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851871.701198:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851871.701199:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851871.701199:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851871.701200:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e7c877fa.
00000100:00000040:5.0:1773851871.701201:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e7c877fa x1859388107056384 msgsize 224
00000100:00100000:5.0:1773851871.701202:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851871.701204:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851871.701204:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851871.701206:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851871.701208:0:1203214:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851871.701209:0:1203214:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851871.701209:0:1203214:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851871.701210:0:1203214:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851871.701211:0:1203214:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851871.701212:0:1203214:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107056384
00000020:00000001:5.0:1773851871.701212:0:1203214:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851871.701213:0:1203214:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:5.0:1773851871.701213:0:1203214:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851871.701215:0:1203214:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:5.0:1773851871.701215:0:1203214:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:5.0:1773851871.701216:0:1203214:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:5.0:1773851871.701217:0:1203214:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851871.701218:0:1203214:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851871.701219:0:1203214:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000020:00000010:5.0:1773851871.701220:0:1203214:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851871.701221:0:1203214:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000699dfc15.
00000100:00000040:5.0:1773851871.701222:0:1203214:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:5.0:1773851871.701223:0:1203214:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851871.701224:0:1203214:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851871.701224:0:1203214:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.701225:0:1203214:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851871.701226:0:1203214:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851871.701227:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851871.701227:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851871.701228:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851871.701228:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851871.701229:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314081
00000100:00000040:6.0:1773851871.701230:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:5.0:1773851871.701230:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851871.701231:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273407744 : -107034436143872 : ffff9ea71a747500)
00000100:00000001:5.0:1773851871.701231:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851871.701232:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e7c877fa x1859388107056384/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:6.0:1773851871.701235:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851871.701235:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851871.701236:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7c877fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40156:x1859388107056384:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:6.0:1773851871.701238:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107056384
00000020:00000001:6.0:1773851871.701239:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851871.701239:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851871.701240:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851871.701241:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851871.701241:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851871.701242:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851871.701243:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851871.701243:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851871.701244:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851871.701245:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851871.701245:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851871.701246:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851871.701247:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000aba31c8f.
02000000:00000001:6.0:1773851871.701248:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851871.701249:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851871.701250:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851871.701250:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851871.701251:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851871.701252:0:1537125:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:6.0:1773851871.701253:0:1537125:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851871.701254:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851871.701255:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851871.701256:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851871.701257:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107056384
00010000:00000001:6.0:1773851871.701258:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851871.701259:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e7c877fa x1859388107056384/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:6.0:1773851871.701261:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851871.701263:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851871.701263:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=100 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851871.701265:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851871.701265:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:6.0:1773851871.701266:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:6.0:1773851871.701267:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851871.701267:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851871.701268:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851871.701269:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:6.0:1773851871.701270:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5d4425b.
00000100:00000200:6.0:1773851871.701270:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107056384, offset 224
00000400:00000200:6.0:1773851871.701272:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:6.0:1773851871.701273:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851871.701274:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:6.0:1773851871.701274:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851871.701276:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:6.0:1773851871.701277:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:6.0:1773851871.701278:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769377:8769377:1024:4294967295] 43@kfi7 LPNI seq info [37492102:37492102:16:4294967295]
00000400:00000200:6.0:1773851871.701280:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851871.701280:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851871.701282:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851871.701283:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:6.0:1773851871.701285:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851871.701286:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851871.701288:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851871.701290:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Using peer 43@kfi7(0x20000000000070b)
00000800:00000200:6.0:1773851871.701293:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000235b3e16: Posted send of 468 bytes to peer 0x20000000000070b: rc=0
00000800:00000200:6.0:1773851871.701294:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851871.701297:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851871.701298:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:6.0:1773851871.701299:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851871.701299:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851871.701300:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851871.701300:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e7c877fa x1859388107056384/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:598/0 lens 224/368 e 0 to 0 dl 1773851958 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:6.0:1773851871.701303:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7c877fa pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40156:x1859388107056384:12345-61@kfi7:41:default-yuba1-0 Request processed in 67us (102us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851871.701305:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851871.701306:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314081
00000100:00000040:6.0:1773851871.701307:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:6.0:1773851871.701307:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851871.701307:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851871.701308:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851871.701308:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000020:00000010:6.0:1773851871.701309:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:6.0:1773851871.701309:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000699dfc15.
00000400:00000200:5.0:1773851871.701309:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5d4425b
00000020:00000010:6.0:1773851871.701310:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000400:00000010:5.0:1773851871.701310:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5d4425b.
00000020:00000040:6.0:1773851871.701311:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000100:00000001:5.0:1773851871.701311:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851871.701311:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:6.0:1773851871.701312:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851871.701312:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851871.701314:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Transaction freed
00000800:00000200:27.0:1773851871.703208:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851871.703212:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851871.703213:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:27.0:1773851871.703215:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851871.703217:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14224@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.703218:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14224@kfi7 : PUT - for me
00000400:00000200:27.0:1773851871.703219:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14224@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.703219:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe661ddc nid 14224@kfi7 refs 1
00000400:00000200:27.0:1773851871.703220:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14224@kfi7 to cpt 6
00000400:00000200:27.0:1773851871.703221:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe661ddc nid 14224@kfi7 refs 2
00000400:00000200:27.0:1773851871.703221:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fe661ddc nid 14224@kfi7 refs 3
00000400:00000200:27.0:1773851871.703222:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14225@kfi7 to cpt 1
00000400:00000200:27.0:1773851871.703223:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14225@kfi7 of length 224 into portal 12 MB=0x69b4b9d4c3c80
00000400:00000200:27.0:1773851871.703224:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14225@kfi7 of length 224/224 into md 0x16159c9699 [64] + 16688
00000800:00000200:27.0:1773851871.703226:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851871.703227:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851871.703228:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14224@kfi7: PUT: OK
00000100:00000001:27.0:1773851871.703229:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851871.703229:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851871.703230:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eacca4a9.
00000100:00000040:27.0:1773851871.703231:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000eacca4a9 x1859598924135552 msgsize 224
00000100:00100000:27.0:1773851871.703232:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-14225@kfi7 (source: 12345-14224@kfi7)
00000100:00000001:27.0:1773851871.703233:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851871.703234:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fe661ddc nid 14224@kfi7 refs 2
00000800:00000200:27.0:1773851871.703235:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851871.703236:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851871.703237:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851871.703237:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851871.703239:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851871.703241:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851871.703242:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598924135552
00000020:00000001:26.0:1773851871.703243:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851871.703244:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38956fcb
00000020:00000001:26.0:1773851871.703245:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851871.703247:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000082426a6c refcount=5
00000020:00000001:26.0:1773851871.703249:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637116038436864 : -106957671114752 : ffff9eb8fa01d800)
00000020:00000001:26.0:1773851871.703250:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637116038436864 : -106957671114752 : ffff9eb8fa01d800)
00000100:00000001:26.0:1773851871.703251:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851871.703253:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851871.703254:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000066e61092.
00000020:00000010:26.0:1773851871.703256:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851871.703257:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042b93dea.
00000100:00000001:26.0:1773851871.703259:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851871.703259:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851871.703260:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851871.703262:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851871.703263:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851871.703263:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851871.703265:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851871.703268:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851871.703268:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851871.703268:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851871.703268:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851871.703270:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14225@kfi7, seq: 2025107
00000100:00000040:25.0:1773851871.703271:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000082426a6c : new rpc_count 1
00000100:00000001:26.0:1773851871.703272:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851871.703273:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.703273:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998398592 : -107053711153024 : ffff9ea29d932880)
00000100:00000040:25.0:1773851871.703275:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eacca4a9 x1859598924135552/t0(0) o400->05952371-9622-4779-a3e4-f7fcf7785bf9@14225@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1378-0'
00000100:00000001:25.0:1773851871.703279:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.703281:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851871.703282:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eacca4a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:05952371-9622-4779-a3e4-f7fcf7785bf9+5:39535:x1859598924135552:12345-14225@kfi7:400:default-tuolumne1378-0
00000100:00000200:25.0:1773851871.703284:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598924135552
00000020:00000001:25.0:1773851871.703285:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851871.703286:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851871.703287:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.703288:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851871.703289:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851871.703290:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851871.703291:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598924135552, found 0 last_xid 1859598924135551
00000020:00000001:25.0:1773851871.703293:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851871.703294:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851871.703294:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851871.703295:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.703296:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851871.703297:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851871.703298:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851871.703299:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000089cac470.
02000000:00000001:25.0:1773851871.703300:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.703301:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.703302:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851871.703303:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035335532, transno 0, xid 1859598924135552
00010000:00000001:25.0:1773851871.703305:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851871.703306:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eacca4a9 x1859598924135552/t0(0) o400->05952371-9622-4779-a3e4-f7fcf7785bf9@14225@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1378-0'
00010000:00000001:25.0:1773851871.703310:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851871.703311:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851871.703312:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=104 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851871.703314:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851871.703315:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3313a11 refcount 3 to 14225@kfi7
00000100:00000001:25.0:1773851871.703316:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413536 : -107145304138080 : ffff9e8d4a351ea0)
02000000:00000001:25.0:1773851871.703317:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851871.703318:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.703320:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851871.703321:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14224@kfi7
00000400:00000010:25.0:1773851871.703322:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054dcb4ba.
00000100:00000200:25.0:1773851871.703323:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598924135552, offset 224
00000400:00000200:25.0:1773851871.703326:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14224@kfi7
00000400:00000200:25.0:1773851871.703327:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14224@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.703328:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe661ddc nid 14224@kfi7 refs 1
00000400:00000200:25.0:1773851871.703330:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fe661ddc nid 14224@kfi7 refs 2
00000400:00000200:25.0:1773851871.703332:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fe661ddc nid 14224@kfi7 refs 3
00000400:00000200:25.0:1773851871.703333:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14224@kfi7 local destination
00000400:00000200:25.0:1773851871.703335:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769378:8769378:1024:4294967295] 14224@kfi7 LPNI seq info [896943:896943:16:4294967295]
00000400:00000200:25.0:1773851871.703338:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fe661ddc nid 14224@kfi7 refs 2
00000400:00000200:25.0:1773851871.703339:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14224@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.703342:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14224@kfi7(14224@kfi7:14224@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851871.703345:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fe661ddc nid 14224@kfi7 refs 3
00000800:00000200:25.0:1773851871.703347:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.703348:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851871.703352:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851871.703356:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a40 Using peer 14224@kfi7(0x100000000000a40)
00000800:00000200:25.0:1773851871.703360:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000878f9def: Posted send of 324 bytes to peer 0x100000000000a40: rc=0
00000800:00000200:25.0:1773851871.703363:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a40 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851871.703366:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.703367:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3313a11 refcount 2 to 14225@kfi7
00010000:00000001:25.0:1773851871.703368:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851871.703369:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.703370:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851871.703371:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eacca4a9 x1859598924135552/t0(0) o400->05952371-9622-4779-a3e4-f7fcf7785bf9@14225@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1378-0'
00000800:00000200:27.0:1773851871.703377:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a40 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851871.703378:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851871.703379:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14224@kfi7: PUT: OK
00000100:00100000:25.0:1773851871.703379:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eacca4a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:05952371-9622-4779-a3e4-f7fcf7785bf9+5:39535:x1859598924135552:12345-14225@kfi7:400:default-tuolumne1378-0 Request processed in 98us (147us total) trans 0 rc 0/0
00000400:00000200:27.0:1773851871.703380:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054dcb4ba
00000400:00000010:27.0:1773851871.703381:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054dcb4ba.
00000100:00000001:27.0:1773851871.703381:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851871.703382:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:25.0:1773851871.703382:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14225@kfi7, seq: 2025107
00000400:00000200:27.0:1773851871.703383:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fe661ddc nid 14224@kfi7 refs 2
00000100:00000040:25.0:1773851871.703383:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000082426a6c : new rpc_count 0
00000800:00000200:27.0:1773851871.703384:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 14224@kfi7(00000000409bee6e):0x0 lsk 2625 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000a40 Transaction freed
00000100:00000001:25.0:1773851871.703385:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851871.703386:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851871.703386:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:25.0:1773851871.703388:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042b93dea.
00000020:00000010:25.0:1773851871.703389:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000066e61092.
00000020:00000040:25.0:1773851871.703390:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000082426a6c : new refcount 4
00000100:00000001:25.0:1773851871.703391:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851871.745335:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851871.745336:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851871.745338:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851871.745342:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851871.745345:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9827@kfi7 to cpt 2
00000400:00000200:9.0:1773851871.745347:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9827@kfi7 : PUT - for me
00000400:00000200:9.0:1773851871.745349:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9827@kfi7 to cpt 2
00000400:00000200:9.0:1773851871.745350:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ff5c35e nid 9827@kfi7 refs 1
00000400:00000200:9.0:1773851871.745352:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9827@kfi7 to cpt 2
00000400:00000200:9.0:1773851871.745353:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ff5c35e nid 9827@kfi7 refs 2
00000400:00000200:9.0:1773851871.745355:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ff5c35e nid 9827@kfi7 refs 3
00000400:00000200:9.0:1773851871.745356:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000400:00000200:9.0:1773851871.745358:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9891@kfi7 of length 224 into portal 12 MB=0x699e1ade3a680
00000400:00000200:9.0:1773851871.745360:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9891@kfi7 of length 224/224 into md 0x78146ce49 [64] + 139176
00000800:00000200:9.0:1773851871.745363:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851871.745366:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851871.745368:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9827@kfi7: PUT: OK
00000100:00000001:9.0:1773851871.745370:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851871.745370:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851871.745372:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001e351691.
00000100:00000040:9.0:1773851871.745373:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000001e351691 x1858044424332928 msgsize 224
00000100:00100000:9.0:1773851871.745375:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-9891@kfi7 (source: 12345-9827@kfi7)
00000100:00000001:9.0:1773851871.745377:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851871.745379:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851871.745379:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ff5c35e nid 9827@kfi7 refs 2
02000000:00000001:11.0:1773851871.745380:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851871.745381:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851871.745381:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851871.745382:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851871.745383:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851871.745384:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044424332928
00000020:00000001:11.0:1773851871.745385:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851871.745386:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9152b
00000020:00000001:11.0:1773851871.745387:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851871.745393:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a13b008 refcount=108
00000020:00000001:11.0:1773851871.745394:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241034752 : -107152468516864 : ffff9e8b9f2d6000)
00000020:00000001:11.0:1773851871.745395:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241034752 : -107152468516864 : ffff9e8b9f2d6000)
00000100:00000001:11.0:1773851871.745397:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851871.745398:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851871.745399:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020699928.
00000020:00000010:11.0:1773851871.745401:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851871.745402:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851871.745404:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851871.745405:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851871.745406:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851871.745407:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851871.745408:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851871.745409:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.745411:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851871.745413:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851871.745413:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851871.745414:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851871.745414:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851871.745416:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9891@kfi7, seq: 2130788
00000100:00000040:11.0:1773851871.745417:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a13b008 : new rpc_count 2
00000100:00000001:8.0:1773851871.745417:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.745418:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749191040 : -106947960360576 : ffff9ebb3cd03180)
00000100:00000001:8.0:1773851871.745418:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851871.745421:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001e351691 x1858044424332928/t0(0) o400->b9059a34-2344-4c58-b046-9ffd24d46dbe@9891@kfi7:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1100-0'
00000100:00000001:11.0:1773851871.745426:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851871.745426:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851871.745428:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e351691 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b9059a34-2344-4c58-b046-9ffd24d46dbe+108:39700:x1858044424332928:12345-9891@kfi7:400:default-tuolumne1100-0
00000100:00000200:11.0:1773851871.745430:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044424332928
00000020:00000001:11.0:1773851871.745431:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851871.745432:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851871.745433:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.745435:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851871.745435:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851871.745437:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851871.745438:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044424332928, found 0 last_xid 1858044331299327
00000020:00000001:11.0:1773851871.745439:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851871.745440:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851871.745441:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851871.745442:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.745443:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851871.745444:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851871.745444:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851871.745446:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fbc9e461.
02000000:00000001:11.0:1773851871.745447:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.745448:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.745449:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851871.745450:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263957080, transno 0, xid 1858044424332928
00010000:00000001:11.0:1773851871.745452:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851871.745453:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001e351691 x1858044424332928/t0(0) o400->b9059a34-2344-4c58-b046-9ffd24d46dbe@9891@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1100-0'
00010000:00000001:11.0:1773851871.745457:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851871.745458:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851871.745459:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=104 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851871.745461:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851871.745463:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e5c3e3df refcount 3 to 9891@kfi7
00000100:00000001:11.0:1773851871.745464:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420896 : -107156724130720 : ffff9e8aa185dc60)
02000000:00000001:11.0:1773851871.745465:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851871.745466:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851871.745467:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851871.745469:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9827@kfi7
00000400:00000010:11.0:1773851871.745470:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006b3931a1.
00000100:00000200:11.0:1773851871.745471:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044424332928, offset 224
00000400:00000200:11.0:1773851871.745473:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9827@kfi7
00000400:00000200:11.0:1773851871.745474:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9827@kfi7 to cpt 2
00000400:00000200:11.0:1773851871.745476:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ff5c35e nid 9827@kfi7 refs 1
00000400:00000200:11.0:1773851871.745478:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ff5c35e nid 9827@kfi7 refs 2
00000400:00000200:11.0:1773851871.745480:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ff5c35e nid 9827@kfi7 refs 3
00000400:00000200:11.0:1773851871.745482:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9827@kfi7 local destination
00000400:00000200:11.0:1773851871.745484:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769379:8769379:1024:4294967295] 9827@kfi7 LPNI seq info [1186163:1186163:16:4294967295]
00000400:00000200:11.0:1773851871.745486:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ff5c35e nid 9827@kfi7 refs 2
00000400:00000200:11.0:1773851871.745488:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9827@kfi7 to cpt 2
00000400:00000200:11.0:1773851871.745491:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9827@kfi7(9827@kfi7:9827@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851871.745493:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ff5c35e nid 9827@kfi7 refs 3
00000800:00000200:11.0:1773851871.745496:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851871.745497:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851871.745501:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851871.745505:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001126 Using peer 9827@kfi7(0x100000000001126)
00000800:00000200:11.0:1773851871.745509:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x100000000001126: rc=0
00000800:00000200:11.0:1773851871.745512:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001126 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851871.745515:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851871.745517:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e5c3e3df refcount 2 to 9891@kfi7
00010000:00000001:11.0:1773851871.745518:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851871.745519:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851871.745520:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851871.745521:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001e351691 x1858044424332928/t0(0) o400->b9059a34-2344-4c58-b046-9ffd24d46dbe@9891@kfi7:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1100-0'
00000100:00100000:11.0:1773851871.745526:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e351691 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b9059a34-2344-4c58-b046-9ffd24d46dbe+108:39700:x1858044424332928:12345-9891@kfi7:400:default-tuolumne1100-0 Request processed in 99us (152us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851871.745526:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001126 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851871.745529:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851871.745530:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9891@kfi7, seq: 2130788
00000100:00000040:11.0:1773851871.745531:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a13b008 : new rpc_count 1
00000400:00000200:9.0:1773851871.745531:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9827@kfi7: PUT: OK
00000100:00000001:11.0:1773851871.745532:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851871.745532:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006b3931a1
00000100:00000001:11.0:1773851871.745533:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:9.0:1773851871.745533:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006b3931a1.
00000020:00000010:11.0:1773851871.745534:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000100:00000001:9.0:1773851871.745534:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851871.745535:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000100:00000001:9.0:1773851871.745535:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851871.745536:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ff5c35e nid 9827@kfi7 refs 2
00000020:00000010:11.0:1773851871.745537:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020699928.
00000020:00000040:11.0:1773851871.745538:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000009a13b008 : new refcount 107
00000100:00000001:11.0:1773851871.745539:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851871.745539:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 9827@kfi7(00000000795d3392):0x0 lsk 4391 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001126 Transaction freed
00000800:00000200:31.0:1773851871.748291:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851871.748292:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851871.748293:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851871.748293:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:31.0:1773851871.748294:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851871.748295:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:31.0:1773851871.748297:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851871.748298:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15617@kfi7(000000002a81a76a):0x24 version: 2; local version 2; negotiated version: 2
00000400:00000200:31.0:1773851871.748299:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15617@kfi7 to cpt 7
00000400:00000200:31.0:1773851871.748300:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15617@kfi7 : PUT - for me
00000400:00000200:31.0:1773851871.748301:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15617@kfi7 to cpt 7
00000800:00000200:29.0:1773851871.748301:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 Using peer 15617@kfi7(0x24)
00000400:00000200:31.0:1773851871.748303:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000821420bb nid 15617@kfi7 refs 1
00000400:00000200:31.0:1773851871.748304:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15617@kfi7 to cpt 7
00000400:00000200:31.0:1773851871.748305:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000821420bb nid 15617@kfi7 refs 2
00000400:00000200:31.0:1773851871.748306:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000821420bb nid 15617@kfi7 refs 3
00000400:00000200:29.0:1773851871.748307:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15617@kfi7 to cpt 7
00000400:00000200:31.0:1773851871.748308:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15808@kfi7 to cpt 7
00000400:00000200:31.0:1773851871.748309:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15808@kfi7 of length 456 into portal 12 MB=0x69b4b6fbe6700
00000800:00000200:29.0:1773851871.748310:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 38 bytes to peer 0x24: rc=0
00000400:00000200:31.0:1773851871.748311:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15808@kfi7 of length 456/456 into md 0x77fe139dd [64] + 181256
00000800:00000200:29.0:1773851871.748312:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:31.0:1773851871.748313:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851871.748315:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851871.748317:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15617@kfi7: PUT: OK
00000100:00000001:31.0:1773851871.748318:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851871.748318:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851871.748319:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d6a92c0.
00000100:00000040:31.0:1773851871.748320:0:2465875:0:(events.c:358:request_in_callback()) incoming req@000000009d6a92c0 x1859598159865600 msgsize 456
00000100:00100000:31.0:1773851871.748322:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-15808@kfi7 (source: 12345-15617@kfi7)
00000100:00000001:31.0:1773851871.748323:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851871.748324:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000821420bb nid 15617@kfi7 refs 2
00000800:00000200:31.0:1773851871.748325:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:29.0:1773851871.748325:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851871.748325:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851871.748325:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851871.748326:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851871.748326:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851871.748327:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851871.748328:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598159865600
00000020:00000001:28.0:1773851871.748328:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:29.0:1773851871.748329:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 Transaction freed
00000020:00000040:28.0:1773851871.748329:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fc35
00000020:00000001:28.0:1773851871.748330:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851871.748331:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000058bbc423 refcount=5
00000020:00000001:28.0:1773851871.748332:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937489380352 : -107136220171264 : ffff9e8f67a77400)
00000020:00000001:28.0:1773851871.748333:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937489380352 : -107136220171264 : ffff9e8f67a77400)
00000100:00000001:28.0:1773851871.748334:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851871.748335:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851871.748335:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6bd80eb.
00000020:00000010:28.0:1773851871.748337:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851871.748338:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e7920c9c.
00000100:00000001:28.0:1773851871.748338:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851871.748339:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851871.748340:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.748341:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.748342:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851871.748343:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851871.748343:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851871.748343:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851871.748344:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851871.748345:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851871.748345:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15808@kfi7, seq: 364304982
00000100:00000040:28.0:1773851871.748345:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000058bbc423 : new rpc_count 1
00000100:00000001:31.0:1773851871.748346:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.748346:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637034999063552 : -107038710488064 : ffff9ea61baf2400)
00000100:00000040:28.0:1773851871.748347:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009d6a92c0 x1859598159865600/t0(0) o17->702a7185-2795-4c50-9035-469a7d2129e6@15808@kfi7:659/0 lens 456/0 e 0 to 0 dl 1773852019 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1475-0'
00000100:00000001:28.0:1773851871.748350:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851871.748350:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851871.748352:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d6a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:702a7185-2795-4c50-9035-469a7d2129e6+5:39578:x1859598159865600:12345-15808@kfi7:17:default-tuolumne1475-0
00000100:00000200:28.0:1773851871.748353:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598159865600
00000020:00000001:28.0:1773851871.748354:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851871.748354:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851871.748355:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.748356:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851871.748356:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:28.0:1773851871.748357:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851871.748358:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598159865600, found 0 last_xid 1859598159865599
00000020:00000001:28.0:1773851871.748359:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851871.748360:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851871.748361:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851871.748361:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851871.748362:0:60533:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:28.0:1773851871.748363:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851871.748364:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851871.748365:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000036c31916.
02000000:00000001:28.0:1773851871.748365:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.748366:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.748367:0:60533:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:28.0:1773851871.748367:0:60533:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:28.0:1773851871.748368:0:60533:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:28.0:1773851871.748370:0:60533:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.748371:0:60533:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:28.0:1773851871.748371:0:60533:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 702a7185-2795-4c50-9035-469a7d2129e6/0000000058bbc423 free: 126633370845184 avail: 126633368748032
00000020:00000001:28.0:1773851871.748373:0:60533:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:28.0:1773851871.748373:0:60533:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 702a7185-2795-4c50-9035-469a7d2129e6/0000000058bbc423 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:28.0:1773851871.748374:0:60533:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:28.0:1773851871.748375:0:60533:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:28.0:1773851871.748376:0:60533:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 702a7185-2795-4c50-9035-469a7d2129e6/0000000058bbc423 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:28.0:1773851871.748377:0:60533:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:28.0:1773851871.748378:0:60533:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:28.0:1773851871.748378:0:60533:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851871.748379:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154593208, transno 0, xid 1859598159865600
00010000:00000001:28.0:1773851871.748380:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851871.748381:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009d6a92c0 x1859598159865600/t0(0) o17->702a7185-2795-4c50-9035-469a7d2129e6@15808@kfi7:659/0 lens 456/432 e 0 to 0 dl 1773852019 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1475-0'
00010000:00000001:28.0:1773851871.748384:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851871.748384:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851871.748385:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=104 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851871.748386:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851871.748387:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000076a0c3b0 refcount 3 to 15808@kfi7
00000100:00000001:28.0:1773851871.748388:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918079254720 : -107155630296896 : ffff9e8ae2b870c0)
02000000:00000001:28.0:1773851871.748389:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851871.748389:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851871.748390:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851871.748391:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15617@kfi7
00000400:00000010:28.0:1773851871.748392:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d3aa665.
00000100:00000200:28.0:1773851871.748392:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598159865600, offset 224
00000400:00000200:28.0:1773851871.748394:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15617@kfi7
00000400:00000200:28.0:1773851871.748395:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15617@kfi7 to cpt 7
00000400:00000200:28.0:1773851871.748396:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000821420bb nid 15617@kfi7 refs 1
00000400:00000200:28.0:1773851871.748397:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000821420bb nid 15617@kfi7 refs 2
00000400:00000200:28.0:1773851871.748398:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000821420bb nid 15617@kfi7 refs 3
00000400:00000200:28.0:1773851871.748399:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15617@kfi7 local destination
00000400:00000200:28.0:1773851871.748400:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769380:8769380:1024:4294967295] 15617@kfi7 LPNI seq info [5125861:5125861:16:4294967295]
00000400:00000200:28.0:1773851871.748402:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000821420bb nid 15617@kfi7 refs 2
00000400:00000200:28.0:1773851871.748403:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15617@kfi7 to cpt 7
00000400:00000200:28.0:1773851871.748405:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15617@kfi7(15617@kfi7:15617@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851871.748406:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000821420bb nid 15617@kfi7 refs 3
00000800:00000200:28.0:1773851871.748407:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851871.748409:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:28.0:1773851871.748411:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851871.748413:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 Using peer 15617@kfi7(0x24)
00000800:00000200:28.0:1773851871.748416:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015d39231: Posted send of 532 bytes to peer 0x24: rc=0
00000800:00000200:28.0:1773851871.748417:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851871.748420:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851871.748421:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000076a0c3b0 refcount 2 to 15808@kfi7
00010000:00000001:28.0:1773851871.748421:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851871.748422:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851871.748424:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851871.748426:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d6a92c0 x1859598159865600/t0(0) o17->702a7185-2795-4c50-9035-469a7d2129e6@15808@kfi7:659/0 lens 456/432 e 0 to 0 dl 1773852019 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1475-0'
00000100:00100000:28.0:1773851871.748429:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d6a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:702a7185-2795-4c50-9035-469a7d2129e6+5:39578:x1859598159865600:12345-15808@kfi7:17:default-tuolumne1475-0 Request processed in 78us (108us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851871.748431:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15808@kfi7, seq: 364304982
00000100:00000040:28.0:1773851871.748432:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000058bbc423 : new rpc_count 0
00000100:00000001:28.0:1773851871.748433:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851871.748434:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851871.748435:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851871.748435:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e7920c9c.
00000020:00000010:28.0:1773851871.748436:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6bd80eb.
00000020:00000040:28.0:1773851871.748437:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000058bbc423 : new refcount 4
00000100:00000001:28.0:1773851871.748437:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851871.748443:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851871.748445:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851871.748446:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15617@kfi7: PUT: OK
00000400:00000200:31.0:1773851871.748447:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d3aa665
00000400:00000010:31.0:1773851871.748448:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d3aa665.
00000100:00000001:31.0:1773851871.748449:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851871.748449:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851871.748450:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000821420bb nid 15617@kfi7 refs 2
00000800:00000200:31.0:1773851871.748452:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 15617@kfi7(000000002a81a76a):0x0 lsk 37 rsk 18 tsk 0 trmk 0 tmk 0 trr 7 tta 0x24 Transaction freed
00000800:00000200:17.0:1773851871.801250:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.801251:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.801254:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.801257:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.801260:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.801263:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.105@tcp : PUT - for me
00000400:00000200:17.0:1773851871.801265:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.801266:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851871.801269:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.105@tcp to cpt 5
00000400:00000200:17.0:1773851871.801271:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003832f6f4 nid 172.16.70.105@tcp refs 2
00000400:00000200:17.0:1773851871.801274:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003832f6f4 nid 172.16.70.105@tcp refs 3
00000400:00000200:17.0:1773851871.801276:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.105@tcp to cpt 5
00000400:00000200:17.0:1773851871.801278:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.105@tcp of length 224 into portal 12 MB=0x69a2203026fc0
00000400:00000200:17.0:1773851871.801281:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.105@tcp of length 224/224 into md 0x6a32cacf5 [64] + 39976
00000800:00000200:17.0:1773851871.801284:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.801287:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.801289:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.801290:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.801291:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.801292:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008bf8b448.
00000100:00000040:17.0:1773851871.801294:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000008bf8b448 x1858320730320832 msgsize 224
00000100:00100000:17.0:1773851871.801297:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.105@tcp (source: 12345-172.16.70.105@tcp)
00000100:00000001:17.0:1773851871.801299:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.801301:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851871.801303:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851871.801304:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851871.801305:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851871.801306:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851871.801307:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851871.801308:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851871.801310:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858320730320832
00000020:00000001:23.0:1773851871.801311:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851871.801311:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93067
00000020:00000001:23.0:1773851871.801312:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851871.801317:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000030cbc070 refcount=6
00000020:00000001:23.0:1773851871.801319:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745142272 : -107128964409344 : ffff9e9118219800)
00000020:00000001:23.0:1773851871.801320:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745142272 : -107128964409344 : ffff9e9118219800)
00000100:00000001:23.0:1773851871.801322:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851871.801323:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851871.801324:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b72ef93.
00000020:00000010:23.0:1773851871.801326:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851871.801329:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851871.801331:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851871.801332:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851871.801333:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851871.801334:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851871.801335:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851871.801336:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.801338:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851871.801340:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851871.801341:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851871.801342:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851871.801343:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851871.801344:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.105@tcp, seq: 1997990
00000100:00000040:23.0:1773851871.801345:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000030cbc070 : new rpc_count 1
00000100:00000001:20.0:1773851871.801345:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.801347:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636970971059584 : -107102738492032 : ffff9e9733515580)
00000100:00000001:20.0:1773851871.801347:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851871.801350:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008bf8b448 x1858320730320832/t0(0) o400->eca800f2-a724-40a9-82e1-58cb0c1f0140@172.16.70.105@tcp:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic5-0'
00000100:00000001:23.0:1773851871.801355:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851871.801356:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851871.801358:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008bf8b448 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:eca800f2-a724-40a9-82e1-58cb0c1f0140+6:52994:x1858320730320832:12345-172.16.70.105@tcp:400:login-rzslic5-0
00000100:00000200:23.0:1773851871.801361:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858320730320832
00000020:00000001:23.0:1773851871.801362:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851871.801363:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851871.801364:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.801365:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851871.801366:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851871.801367:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851871.801368:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858320730320832, found 0 last_xid 1858320730320831
00000020:00000001:23.0:1773851871.801370:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851871.801371:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851871.801372:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851871.801373:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.801374:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851871.801375:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851871.801375:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851871.801377:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd5abb9c.
02000000:00000001:23.0:1773851871.801378:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.801379:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.801380:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851871.801381:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182273430557, transno 0, xid 1858320730320832
00010000:00000001:23.0:1773851871.801383:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851871.801384:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008bf8b448 x1858320730320832/t0(0) o400->eca800f2-a724-40a9-82e1-58cb0c1f0140@172.16.70.105@tcp:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic5-0'
00010000:00000001:23.0:1773851871.801388:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851871.801389:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851871.801390:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=104 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851871.801392:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851871.801393:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bec555af refcount 3 to 172.16.70.105@tcp
00000100:00000001:23.0:1773851871.801394:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095744 : -107139307455872 : ffff9e8eafa33a80)
02000000:00000001:23.0:1773851871.801396:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851871.801397:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851871.801398:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851871.801399:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.105@tcp
00000400:00000010:23.0:1773851871.801400:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000188fee2b.
00000100:00000200:23.0:1773851871.801401:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858320730320832, offset 224
00000400:00000200:23.0:1773851871.801404:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.105@tcp
00000400:00000200:23.0:1773851871.801406:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.105@tcp to cpt 5
00000400:00000200:23.0:1773851871.801408:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003832f6f4 nid 172.16.70.105@tcp refs 2
00000400:00000200:23.0:1773851871.801410:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003832f6f4 nid 172.16.70.105@tcp refs 3
00000400:00000200:23.0:1773851871.801412:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003832f6f4 nid 172.16.70.105@tcp refs 4
00000400:00000200:23.0:1773851871.801414:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.105@tcp routed destination
00000400:00000200:23.0:1773851871.801416:0:60934:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851871.801418:0:60934:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:23.0:1773851871.801420:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.105@tcp: rtr pref emtpy: 1
00000400:00000200:23.0:1773851871.801422:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851871.801423:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.105@tcp: rtr pref emtpy: 1
00000400:00000200:23.0:1773851871.801425:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851871.801426:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769381:8769381:1024:4294967295] 17@kfi7 LPNI seq info [1250891899:1250891899:16:4294967295]
00000400:00000200:23.0:1773851871.801432:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:23.0:1773851871.801434:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:23.0:1773851871.801439:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.105@tcp(172.16.70.105@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851871.801441:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003832f6f4 nid 172.16.70.105@tcp refs 3
00000800:00000200:23.0:1773851871.801444:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851871.801446:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851871.801450:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851871.801454:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:23.0:1773851871.801459:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:23.0:1773851871.801461:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851871.801464:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851871.801466:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bec555af refcount 2 to 172.16.70.105@tcp
00010000:00000001:23.0:1773851871.801467:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851871.801468:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851871.801469:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851871.801470:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008bf8b448 x1858320730320832/t0(0) o400->eca800f2-a724-40a9-82e1-58cb0c1f0140@172.16.70.105@tcp:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic5-0'
00000800:00000200:21.0:1773851871.801474:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851871.801475:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008bf8b448 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:eca800f2-a724-40a9-82e1-58cb0c1f0140+6:52994:x1858320730320832:12345-172.16.70.105@tcp:400:login-rzslic5-0 Request processed in 119us (180us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851871.801477:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851871.801479:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.105@tcp, seq: 1997990
00000400:00000200:21.0:1773851871.801479:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000040:23.0:1773851871.801480:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000030cbc070 : new rpc_count 0
00000400:00000200:21.0:1773851871.801480:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000188fee2b
00000400:00000010:21.0:1773851871.801481:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000188fee2b.
00000100:00000001:23.0:1773851871.801482:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851871.801482:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851871.801483:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851871.801483:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851871.801483:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851871.801484:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000010:23.0:1773851871.801485:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851871.801487:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b72ef93.
00000800:00000200:21.0:1773851871.801487:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Transaction freed
00000020:00000040:23.0:1773851871.801488:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000030cbc070 : new refcount 5
00000100:00000001:23.0:1773851871.801489:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851871.801497:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.801498:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.801500:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.801503:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.801506:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.801508:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.10@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851871.801509:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.801511:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851871.801512:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.10@o2ib60 to cpt 3
00000400:00000200:17.0:1773851871.801514:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c2c9682 nid 192.168.128.10@o2ib60 refs 2
00000400:00000200:17.0:1773851871.801516:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006c2c9682 nid 192.168.128.10@o2ib60 refs 3
00000400:00000200:17.0:1773851871.801518:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.10@o2ib60 to cpt 3
00000400:00000200:17.0:1773851871.801520:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.10@o2ib60 of length 224 into portal 12 MB=0x69b2126e8dc80
00000400:00000200:17.0:1773851871.801522:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.10@o2ib60 of length 224/224 into md 0x82a36e8ed [64] + 33696
00000800:00000200:17.0:1773851871.801525:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.801528:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.801529:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.801531:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.801531:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.801533:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000356cd1b0.
00000100:00000040:17.0:1773851871.801534:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000356cd1b0 x1859416549284992 msgsize 224
00000100:00100000:17.0:1773851871.801537:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.10@o2ib60 (source: 12345-192.168.128.10@o2ib60)
00000100:00000001:17.0:1773851871.801539:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.801540:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851871.801542:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851871.801544:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851871.801545:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851871.801546:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851871.801547:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851871.801548:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851871.801549:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859416549284992
00000020:00000001:12.0:1773851871.801550:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851871.801551:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344abc1
00000020:00000001:12.0:1773851871.801552:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851871.801556:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000040ebc089 refcount=5
00000020:00000001:12.0:1773851871.801558:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637075941498880 : -106997768052736 : ffff9eafa40b2000)
00000020:00000001:12.0:1773851871.801559:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637075941498880 : -106997768052736 : ffff9eafa40b2000)
00000100:00000001:12.0:1773851871.801561:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851871.801562:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851871.801563:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851871.801565:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851871.801566:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a7db3d45.
00000100:00000001:12.0:1773851871.801568:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851871.801569:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851871.801570:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851871.801572:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851871.801573:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851871.801573:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851871.801576:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851871.801579:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851871.801579:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851871.801579:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851871.801580:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851871.801581:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.10@o2ib60, seq: 2289851
00000100:00000040:15.0:1773851871.801582:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000040ebc089 : new rpc_count 1
00000100:00000001:12.0:1773851871.801582:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851871.801583:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637160188466560 : -106913521085056 : ffff9ec3418dd580)
00000100:00000001:12.0:1773851871.801583:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851871.801585:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000356cd1b0 x1859416549284992/t0(0) o400->02d030de-95f8-4833-8e75-722729493529@192.168.128.10@o2ib60:598/0 lens 224/0 e 0 to 0 dl 1773851958 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix10-0'
00000100:00000001:15.0:1773851871.801588:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851871.801588:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851871.801589:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000356cd1b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:02d030de-95f8-4833-8e75-722729493529+5:40053:x1859416549284992:12345-192.168.128.10@o2ib60:400:default-matrix10-0
00000100:00000200:15.0:1773851871.801591:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859416549284992
00000020:00000001:15.0:1773851871.801591:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851871.801592:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851871.801593:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851871.801594:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851871.801594:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851871.801595:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851871.801595:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859416549284992, found 0 last_xid 1859416549284991
00000020:00000001:15.0:1773851871.801596:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851871.801597:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851871.801598:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851871.801599:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851871.801599:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851871.801600:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851871.801601:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851871.801601:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000db5a5dbd.
02000000:00000001:15.0:1773851871.801602:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851871.801603:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851871.801603:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851871.801604:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183151967876, transno 0, xid 1859416549284992
00010000:00000001:15.0:1773851871.801605:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851871.801606:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000356cd1b0 x1859416549284992/t0(0) o400->02d030de-95f8-4833-8e75-722729493529@192.168.128.10@o2ib60:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix10-0'
00010000:00000001:15.0:1773851871.801609:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851871.801609:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851871.801610:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=104 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851871.801611:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851871.801612:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032b2b8d3 refcount 3 to 192.168.128.10@o2ib60
00000100:00000001:15.0:1773851871.801613:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717421248 : -107155992130368 : ffff9e8acd274cc0)
02000000:00000001:15.0:1773851871.801614:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851871.801615:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851871.801615:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851871.801616:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.10@o2ib60
00000400:00000010:15.0:1773851871.801617:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f009b6f1.
00000100:00000200:15.0:1773851871.801618:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859416549284992, offset 224
00000400:00000200:15.0:1773851871.801620:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.10@o2ib60
00000400:00000200:15.0:1773851871.801622:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.10@o2ib60 to cpt 3
00000400:00000200:15.0:1773851871.801624:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c2c9682 nid 192.168.128.10@o2ib60 refs 2
00000400:00000200:15.0:1773851871.801625:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006c2c9682 nid 192.168.128.10@o2ib60 refs 3
00000400:00000200:15.0:1773851871.801627:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006c2c9682 nid 192.168.128.10@o2ib60 refs 4
00000400:00000200:15.0:1773851871.801629:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.10@o2ib60 routed destination
00000400:00000200:15.0:1773851871.801630:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851871.801631:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:15.0:1773851871.801634:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.10@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851871.801635:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851871.801636:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.10@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851871.801637:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851871.801638:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769382:8769382:1024:4294967295] 17@kfi7 LPNI seq info [1250891900:1250891900:16:4294967295]
00000400:00000200:15.0:1773851871.801639:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:15.0:1773851871.801640:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:15.0:1773851871.801642:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.10@o2ib60(192.168.128.10@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851871.801644:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006c2c9682 nid 192.168.128.10@o2ib60 refs 3
00000800:00000200:15.0:1773851871.801646:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851871.801647:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851871.801650:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851871.801652:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:15.0:1773851871.801655:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:15.0:1773851871.801657:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851871.801659:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851871.801660:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032b2b8d3 refcount 2 to 192.168.128.10@o2ib60
00010000:00000001:15.0:1773851871.801661:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851871.801661:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851871.801662:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851871.801663:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000356cd1b0 x1859416549284992/t0(0) o400->02d030de-95f8-4833-8e75-722729493529@192.168.128.10@o2ib60:598/0 lens 224/224 e 0 to 0 dl 1773851958 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix10-0'
00000100:00100000:15.0:1773851871.801667:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000356cd1b0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:02d030de-95f8-4833-8e75-722729493529+5:40053:x1859416549284992:12345-192.168.128.10@o2ib60:400:default-matrix10-0 Request processed in 78us (132us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851871.801669:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.10@o2ib60, seq: 2289851
00000100:00000040:15.0:1773851871.801670:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000040ebc089 : new rpc_count 0
00000100:00000001:15.0:1773851871.801672:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851871.801672:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851871.801673:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000800:00000200:13.0:1773851871.801673:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851871.801674:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a7db3d45.
00000020:00000010:15.0:1773851871.801675:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000020:00000040:15.0:1773851871.801676:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000040ebc089 : new refcount 4
00000100:00000001:15.0:1773851871.801677:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851871.801677:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851871.801679:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:13.0:1773851871.801681:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f009b6f1
00000400:00000010:13.0:1773851871.801682:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f009b6f1.
00000100:00000001:13.0:1773851871.801683:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851871.801683:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851871.801685:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:13.0:1773851871.801687:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000800:00000200:18.0:1773851871.838720:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851871.838721:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851871.838722:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851871.838728:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851871.838730:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.838731:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19585@kfi7 : PUT - for me
00000400:00000200:18.0:1773851871.838732:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.838733:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 1
00000400:00000200:18.0:1773851871.838734:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.838736:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000400:00000200:18.0:1773851871.838736:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 3
00000400:00000200:18.0:1773851871.838737:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:18.0:1773851871.838738:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19585@kfi7 of length 224 into portal 12 MB=0x69b09646bcb00
00000400:00000200:18.0:1773851871.838739:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19585@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 21512
00000800:00000200:18.0:1773851871.838741:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851871.838743:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851871.838744:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19585@kfi7: PUT: OK
00000100:00000001:18.0:1773851871.838745:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851871.838745:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851871.838746:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc287a72.
00000100:00000040:18.0:1773851871.838746:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000dc287a72 x1859314502060800 msgsize 224
00000100:00100000:18.0:1773851871.838748:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-19585@kfi7 (source: 12345-19585@kfi7)
00000100:00000001:18.0:1773851871.838749:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851871.838750:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000100:00000001:16.0:1773851871.838750:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851871.838751:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.838751:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.838752:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.838752:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.838753:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.838754:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314502060800
00000020:00000001:16.0:1773851871.838755:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.838755:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ddc
00000020:00000001:16.0:1773851871.838755:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.838757:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009c5febaf refcount=6
00000020:00000001:16.0:1773851871.838758:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744439808 : -107128965111808 : ffff9e911816e000)
00000020:00000001:16.0:1773851871.838759:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744439808 : -107128965111808 : ffff9e911816e000)
00000100:00000001:16.0:1773851871.838760:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.838761:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.838761:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851871.838762:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.838763:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.838764:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.838764:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851871.838765:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.838766:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851871.838766:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851871.838767:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.838768:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.838769:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.838769:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851871.838770:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:16.0:1773851871.838770:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19585@kfi7, seq: 2156347
00000100:00000001:17.0:1773851871.838771:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:16.0:1773851871.838771:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009c5febaf : new rpc_count 1
00000100:00000001:17.0:1773851871.838772:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.838772:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534645760 : -106946174905856 : ffff9ebba73c1200)
00000100:00000001:17.0:1773851871.838773:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.838773:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dc287a72 x1859314502060800/t0(0) o400->8b8e5d76-57d2-45be-80dd-bafb0d304b41@19585@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1716-0'
00000100:00000001:16.0:1773851871.838776:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.838776:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851871.838777:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc287a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:8b8e5d76-57d2-45be-80dd-bafb0d304b41+6:39766:x1859314502060800:12345-19585@kfi7:400:default-tuolumne1716-0
00000100:00000200:16.0:1773851871.838778:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314502060800
00000020:00000001:16.0:1773851871.838779:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851871.838780:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851871.838781:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.838782:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851871.838782:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851871.838783:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851871.838783:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314502060800, found 0 last_xid 1859314502060799
00000020:00000001:16.0:1773851871.838784:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851871.838785:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851871.838785:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851871.838786:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.838787:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851871.838787:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851871.838788:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851871.838788:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aa699d48.
02000000:00000001:16.0:1773851871.838789:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.838790:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.838790:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851871.838791:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314502060800
00010000:00000001:16.0:1773851871.838792:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851871.838793:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dc287a72 x1859314502060800/t0(0) o400->8b8e5d76-57d2-45be-80dd-bafb0d304b41@19585@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1716-0'
00010000:00000001:16.0:1773851871.838795:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851871.838796:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851871.838796:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=104 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851871.838798:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.838798:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004ce31d55 refcount 5 to 19585@kfi7
00000100:00000001:16.0:1773851871.838799:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992416 : -107142345559200 : ffff9e8dfa8d7360)
02000000:00000001:16.0:1773851871.838800:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851871.838800:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.838801:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851871.838802:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19585@kfi7
00000400:00000010:16.0:1773851871.838802:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007675fa37.
00000100:00000200:16.0:1773851871.838803:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314502060800, offset 224
00000400:00000200:16.0:1773851871.838805:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19585@kfi7
00000400:00000200:16.0:1773851871.838806:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.838807:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 1
00000400:00000200:16.0:1773851871.838808:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000400:00000200:16.0:1773851871.838809:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 3
00000400:00000200:16.0:1773851871.838811:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19585@kfi7 local destination
00000400:00000200:16.0:1773851871.838812:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769383:8769383:1024:4294967295] 19585@kfi7 LPNI seq info [625697:625697:16:4294967295]
00000400:00000200:16.0:1773851871.838813:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000400:00000200:16.0:1773851871.838814:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.838815:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19585@kfi7(19585@kfi7:19585@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851871.838817:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 3
00000800:00000200:16.0:1773851871.838818:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851871.838819:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851871.838821:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851871.838823:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x701 Using peer 19585@kfi7(0x701)
00000800:00000200:16.0:1773851871.838826:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x701: rc=0
00000800:00000200:16.0:1773851871.838827:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x701 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851871.838829:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.838830:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004ce31d55 refcount 4 to 19585@kfi7
00010000:00000001:16.0:1773851871.838831:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851871.838831:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.838832:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851871.838833:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dc287a72 x1859314502060800/t0(0) o400->8b8e5d76-57d2-45be-80dd-bafb0d304b41@19585@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1716-0'
00000100:00100000:16.0:1773851871.838837:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc287a72 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:8b8e5d76-57d2-45be-80dd-bafb0d304b41+6:39766:x1859314502060800:12345-19585@kfi7:400:default-tuolumne1716-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851871.838839:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19585@kfi7, seq: 2156347
00000100:00000040:16.0:1773851871.838840:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009c5febaf : new rpc_count 0
00000100:00000001:16.0:1773851871.838841:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.838842:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.838842:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.838843:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.838844:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851871.838845:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000009c5febaf : new refcount 5
00000100:00000001:16.0:1773851871.838846:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851871.838850:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x701 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851871.838852:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851871.838853:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19585@kfi7: PUT: OK
00000400:00000200:18.0:1773851871.838854:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007675fa37
00000400:00000010:18.0:1773851871.838854:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007675fa37.
00000100:00000001:18.0:1773851871.838855:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851871.838856:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851871.838856:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000800:00000200:18.0:1773851871.838858:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 19585@kfi7(0000000025215b63):0x0 lsk 1794 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x701 Transaction freed
00000800:00000200:17.0:1773851871.839244:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851871.839245:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851871.839246:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851871.839248:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851871.839250:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.839251:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19585@kfi7 : PUT - for me
00000400:00000200:17.0:1773851871.839252:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.839253:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 1
00000400:00000200:17.0:1773851871.839254:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.839255:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000400:00000200:17.0:1773851871.839255:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 3
00000400:00000200:17.0:1773851871.839257:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:17.0:1773851871.839257:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19585@kfi7 of length 224 into portal 12 MB=0x69b09646bd340
00000400:00000200:17.0:1773851871.839259:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19585@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 21736
00000800:00000200:17.0:1773851871.839261:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851871.839263:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.839264:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19585@kfi7: PUT: OK
00000100:00000001:17.0:1773851871.839265:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851871.839265:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851871.839266:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000030cdcca3.
00000100:00000040:17.0:1773851871.839267:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000030cdcca3 x1859314502062912 msgsize 224
00000100:00100000:17.0:1773851871.839269:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19585@kfi7 (source: 12345-19585@kfi7)
00000100:00000001:17.0:1773851871.839270:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851871.839270:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000100:00000001:16.0:1773851871.839271:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851871.839272:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851871.839272:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851871.839272:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851871.839273:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851871.839273:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851871.839274:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314502062912
00000020:00000001:16.0:1773851871.839275:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851871.839275:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92de3
00000020:00000001:16.0:1773851871.839276:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851871.839278:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000062da2227 refcount=429
00000020:00000001:16.0:1773851871.839279:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744418304 : -107128965133312 : ffff9e9118168c00)
00000020:00000001:16.0:1773851871.839279:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744418304 : -107128965133312 : ffff9e9118168c00)
00000100:00000001:16.0:1773851871.839280:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.839281:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851871.839281:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851871.839282:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.839283:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851871.839284:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851871.839284:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851871.839285:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.839286:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851871.839286:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851871.839286:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.839287:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851871.839288:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851871.839289:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851871.839289:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851871.839290:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851871.839290:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19585@kfi7, seq: 2156348
00000100:00000001:17.0:1773851871.839291:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.839291:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000062da2227 : new rpc_count 11
00000100:00000001:17.0:1773851871.839292:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.839292:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637160188465408 : -106913521086208 : ffff9ec3418dd100)
00000100:00000040:16.0:1773851871.839293:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000030cdcca3 x1859314502062912/t0(0) o400->9425ee17-c664-4410-9c77-8bb2fce56ce3@19585@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1716-0'
00000100:00000001:16.0:1773851871.839296:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851871.839296:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851871.839297:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030cdcca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:9425ee17-c664-4410-9c77-8bb2fce56ce3+429:39769:x1859314502062912:12345-19585@kfi7:400:default-tuolumne1716-0
00000100:00000200:16.0:1773851871.839298:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314502062912
00000020:00000001:16.0:1773851871.839299:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851871.839300:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851871.839300:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.839301:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851871.839301:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851871.839302:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851871.839303:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314502062912, found 0 last_xid 1859314494234559
00000020:00000001:16.0:1773851871.839303:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851871.839304:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851871.839305:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851871.839305:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.839306:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851871.839306:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851871.839307:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851871.839307:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ddc278b8.
02000000:00000001:16.0:1773851871.839308:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.839309:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.839309:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851871.839310:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264591037, transno 0, xid 1859314502062912
00010000:00000001:16.0:1773851871.839311:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851871.839311:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000030cdcca3 x1859314502062912/t0(0) o400->9425ee17-c664-4410-9c77-8bb2fce56ce3@19585@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1716-0'
00010000:00000001:16.0:1773851871.839314:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851871.839315:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851871.839315:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=104 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851871.839317:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851871.839317:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004ce31d55 refcount 5 to 19585@kfi7
00000100:00000001:16.0:1773851871.839318:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992416 : -107142345559200 : ffff9e8dfa8d7360)
02000000:00000001:16.0:1773851871.839319:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851871.839319:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851871.839320:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851871.839320:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19585@kfi7
00000400:00000010:16.0:1773851871.839321:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fcf0fdcf.
00000100:00000200:16.0:1773851871.839322:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314502062912, offset 224
00000400:00000200:16.0:1773851871.839323:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19585@kfi7
00000400:00000200:16.0:1773851871.839324:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.839325:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 1
00000400:00000200:16.0:1773851871.839326:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000400:00000200:16.0:1773851871.839327:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 3
00000400:00000200:16.0:1773851871.839328:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19585@kfi7 local destination
00000400:00000200:16.0:1773851871.839329:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769384:8769384:1024:4294967295] 19585@kfi7 LPNI seq info [625698:625698:16:4294967295]
00000400:00000200:16.0:1773851871.839330:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000400:00000200:16.0:1773851871.839331:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19585@kfi7 to cpt 4
00000400:00000200:16.0:1773851871.839334:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19585@kfi7(19585@kfi7:19585@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851871.839335:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 3
00000800:00000200:16.0:1773851871.839336:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851871.839337:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851871.839340:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851871.839342:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005fe Using peer 19585@kfi7(0x1000000000005fe)
00000800:00000200:16.0:1773851871.839345:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0x1000000000005fe: rc=0
00000800:00000200:16.0:1773851871.839346:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851871.839350:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851871.839351:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004ce31d55 refcount 4 to 19585@kfi7
00010000:00000001:16.0:1773851871.839352:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851871.839352:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851871.839353:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851871.839355:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000030cdcca3 x1859314502062912/t0(0) o400->9425ee17-c664-4410-9c77-8bb2fce56ce3@19585@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1716-0'
00000100:00100000:16.0:1773851871.839358:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030cdcca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:9425ee17-c664-4410-9c77-8bb2fce56ce3+429:39769:x1859314502062912:12345-19585@kfi7:400:default-tuolumne1716-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851871.839360:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19585@kfi7, seq: 2156348
00000100:00000040:16.0:1773851871.839361:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000062da2227 : new rpc_count 10
00000100:00000001:16.0:1773851871.839362:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851871.839362:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851871.839363:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851871.839363:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851871.839364:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851871.839364:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000062da2227 : new refcount 428
00000100:00000001:16.0:1773851871.839365:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851871.839370:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005fe TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851871.839371:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851871.839373:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19585@kfi7: PUT: OK
00000400:00000200:17.0:1773851871.839373:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fcf0fdcf
00000400:00000010:17.0:1773851871.839374:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fcf0fdcf.
00000100:00000001:17.0:1773851871.839374:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851871.839375:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851871.839376:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfbbec30 nid 19585@kfi7 refs 2
00000800:00000200:17.0:1773851871.839377:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 19585@kfi7(00000000663f8dcb):0x0 lsk 1535 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005fe Transaction freed
00000800:00000200:26.0:1773851871.918326:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851871.918327:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851871.918328:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851871.918331:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851871.918334:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16753@kfi7 to cpt 6
00000400:00000200:26.0:1773851871.918335:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16753@kfi7 : PUT - for me
00000400:00000200:26.0:1773851871.918336:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16753@kfi7 to cpt 6
00000400:00000200:26.0:1773851871.918338:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6f8de0e nid 16753@kfi7 refs 1
00000400:00000200:26.0:1773851871.918339:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16753@kfi7 to cpt 6
00000400:00000200:26.0:1773851871.918340:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6f8de0e nid 16753@kfi7 refs 2
00000400:00000200:26.0:1773851871.918341:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6f8de0e nid 16753@kfi7 refs 3
00000400:00000200:26.0:1773851871.918342:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16816@kfi7 to cpt 7
00000400:00000200:26.0:1773851871.918343:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16816@kfi7 of length 224 into portal 12 MB=0x69b4b54d52340
00000400:00000200:26.0:1773851871.918345:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16816@kfi7 of length 224/224 into md 0x16159c9699 [64] + 16912
00000800:00000200:26.0:1773851871.918348:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851871.918350:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851871.918351:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16753@kfi7: PUT: OK
00000100:00000001:26.0:1773851871.918353:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851871.918354:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851871.918355:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009a2f06a.
00000100:00000040:26.0:1773851871.918357:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000009a2f06a x1859597708370752 msgsize 224
00000100:00100000:26.0:1773851871.918360:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-16816@kfi7 (source: 12345-16753@kfi7)
00000100:00000001:26.0:1773851871.918362:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:25.0:1773851871.918363:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:26.0:1773851871.918364:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6f8de0e nid 16753@kfi7 refs 2
02000000:00000001:25.0:1773851871.918364:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851871.918365:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851871.918365:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851871.918366:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851871.918367:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00100000:25.0:1773851871.918367:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597708370752
00000020:00000001:25.0:1773851871.918367:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851871.918368:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a8e
00000020:00000001:25.0:1773851871.918369:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851871.918370:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d9295891 refcount=5
00000020:00000001:25.0:1773851871.918371:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064125240320 : -107009584311296 : ffff9eace3bd5400)
00000020:00000001:25.0:1773851871.918372:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637064125240320 : -107009584311296 : ffff9eace3bd5400)
00000100:00000001:25.0:1773851871.918373:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.918373:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851871.918374:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:25.0:1773851871.918375:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851871.918376:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851871.918377:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851871.918378:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851871.918378:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851871.918379:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851871.918381:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851871.918381:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.918382:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851871.918384:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851871.918384:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851871.918386:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851871.918386:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851871.918386:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16816@kfi7, seq: 2025108
00000100:00000001:26.0:1773851871.918387:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.918387:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d9295891 : new rpc_count 1
00000100:00000001:25.0:1773851871.918388:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150692992 : -106980558858624 : ffff9eb3a5ca9680)
00000100:00000001:26.0:1773851871.918389:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.918389:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009a2f06a x1859597708370752/t0(0) o400->b332697a-980f-4375-aa8d-4f4fe4bd9fa7@16816@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1534-0'
00000100:00000001:25.0:1773851871.918392:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.918393:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851871.918394:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009a2f06a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b332697a-980f-4375-aa8d-4f4fe4bd9fa7+5:39596:x1859597708370752:12345-16816@kfi7:400:default-tuolumne1534-0
00000100:00000200:25.0:1773851871.918396:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597708370752
00000020:00000001:25.0:1773851871.918397:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851871.918397:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851871.918398:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.918399:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851871.918400:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851871.918400:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851871.918401:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597708370752, found 0 last_xid 1859597708370751
00000020:00000001:25.0:1773851871.918402:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851871.918403:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851871.918404:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851871.918404:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.918405:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851871.918406:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851871.918406:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851871.918407:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008960026e.
02000000:00000001:25.0:1773851871.918408:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.918409:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.918409:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851871.918410:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044168183, transno 0, xid 1859597708370752
00010000:00000001:25.0:1773851871.918411:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851871.918412:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009a2f06a x1859597708370752/t0(0) o400->b332697a-980f-4375-aa8d-4f4fe4bd9fa7@16816@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1534-0'
00010000:00000001:25.0:1773851871.918415:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851871.918416:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851871.918417:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=104 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851871.918418:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851871.918419:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003122ab2b refcount 3 to 16816@kfi7
00000100:00000001:25.0:1773851871.918420:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269088 : -107152618282528 : ffff9e8b964021e0)
02000000:00000001:25.0:1773851871.918421:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851871.918421:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.918422:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851871.918423:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16753@kfi7
00000400:00000010:25.0:1773851871.918424:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cbe15403.
00000100:00000200:25.0:1773851871.918425:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597708370752, offset 224
00000400:00000200:25.0:1773851871.918427:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16753@kfi7
00000400:00000200:25.0:1773851871.918427:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16753@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.918429:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6f8de0e nid 16753@kfi7 refs 1
00000400:00000200:25.0:1773851871.918430:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6f8de0e nid 16753@kfi7 refs 2
00000400:00000200:25.0:1773851871.918432:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6f8de0e nid 16753@kfi7 refs 3
00000400:00000200:25.0:1773851871.918433:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16753@kfi7 local destination
00000400:00000200:25.0:1773851871.918434:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769385:8769385:1024:4294967295] 16753@kfi7 LPNI seq info [672044:672044:16:4294967295]
00000400:00000200:25.0:1773851871.918436:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6f8de0e nid 16753@kfi7 refs 2
00000400:00000200:25.0:1773851871.918437:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16753@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.918439:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16753@kfi7(16753@kfi7:16753@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851871.918440:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6f8de0e nid 16753@kfi7 refs 3
00000800:00000200:25.0:1773851871.918442:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.918444:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851871.918446:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851871.918451:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf07 Using peer 16753@kfi7(0xf07)
00000800:00000200:25.0:1773851871.918454:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000878f9def: Posted send of 324 bytes to peer 0xf07: rc=0
00000800:00000200:25.0:1773851871.918456:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf07 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851871.918459:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.918460:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003122ab2b refcount 2 to 16816@kfi7
00010000:00000001:25.0:1773851871.918460:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851871.918461:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.918462:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851871.918463:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009a2f06a x1859597708370752/t0(0) o400->b332697a-980f-4375-aa8d-4f4fe4bd9fa7@16816@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1534-0'
00000100:00100000:25.0:1773851871.918466:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009a2f06a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b332697a-980f-4375-aa8d-4f4fe4bd9fa7+5:39596:x1859597708370752:12345-16816@kfi7:400:default-tuolumne1534-0 Request processed in 73us (108us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851871.918469:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16816@kfi7, seq: 2025108
00000100:00000040:25.0:1773851871.918470:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d9295891 : new rpc_count 0
00000800:00000200:27.0:1773851871.918471:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf07 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851871.918471:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851871.918471:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:27.0:1773851871.918472:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851871.918472:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000400:00000200:27.0:1773851871.918473:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16753@kfi7: PUT: OK
00000020:00000010:25.0:1773851871.918473:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000400:00000200:27.0:1773851871.918474:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cbe15403
00000020:00000010:25.0:1773851871.918474:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:25.0:1773851871.918474:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000d9295891 : new refcount 4
00000400:00000010:27.0:1773851871.918475:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cbe15403.
00000100:00000001:27.0:1773851871.918475:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851871.918475:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851871.918476:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851871.918477:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6f8de0e nid 16753@kfi7 refs 2
00000800:00000200:27.0:1773851871.918478:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2069@kfi7:6 -> 16753@kfi7(00000000aea45834):0x0 lsk 3848 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf07 Transaction freed
00000800:00000200:25.0:1773851871.951925:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.951926:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851871.951927:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851871.951929:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851871.951930:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.951932:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9467@kfi7 : PUT - for me
00000400:00000200:25.0:1773851871.951933:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.951933:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 1
00000400:00000200:25.0:1773851871.951934:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.951935:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 2
00000400:00000200:25.0:1773851871.951936:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 3
00000400:00000200:25.0:1773851871.951937:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.951937:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9467@kfi7 of length 224 into portal 12 MB=0x699de8d13b900
00000400:00000200:25.0:1773851871.951939:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9467@kfi7 of length 224/224 into md 0x16159c9699 [64] + 17136
00000800:00000200:25.0:1773851871.951940:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851871.951942:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851871.951943:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9467@kfi7: PUT: OK
00000100:00000001:25.0:1773851871.951944:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851871.951945:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851871.951945:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000023a79b97.
00000100:00000040:25.0:1773851871.951946:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000023a79b97 x1858030988933376 msgsize 224
00000100:00100000:25.0:1773851871.951948:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9467@kfi7 (source: 12345-9467@kfi7)
00000100:00000001:25.0:1773851871.951949:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851871.951950:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 2
00000800:00000200:25.0:1773851871.951951:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851871.951954:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851871.951954:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851871.951955:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851871.951955:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851871.951955:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851871.951956:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030988933376
00000020:00000001:25.0:1773851871.951957:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851871.951957:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91000
00000020:00000001:25.0:1773851871.951958:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851871.951959:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c4d6a528 refcount=6
00000020:00000001:25.0:1773851871.951959:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240108032 : -107152469443584 : ffff9e8b9f1f3c00)
00000020:00000001:25.0:1773851871.951971:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240108032 : -107152469443584 : ffff9e8b9f1f3c00)
00000100:00000001:25.0:1773851871.951972:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.951973:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851871.951974:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:25.0:1773851871.951974:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851871.951975:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851871.951975:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851871.951976:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851871.951976:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851871.951977:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851871.951977:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851871.951977:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.951978:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851871.951979:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851871.951980:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851871.951980:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9467@kfi7, seq: 2025109
00000100:00000040:25.0:1773851871.951981:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c4d6a528 : new rpc_count 1
00000100:00000001:25.0:1773851871.951981:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165942128384 : -106907767423232 : ffff9ec4987fbf00)
00000100:00000040:25.0:1773851871.951982:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000023a79b97 x1858030988933376/t0(0) o400->1f05a61d-c9b7-4b87-a736-5de8061c607f@9467@kfi7:88/0 lens 224/0 e 0 to 0 dl 1773852203 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne205-0'
00000100:00000001:25.0:1773851871.951985:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851871.951985:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851871.951986:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023a79b97 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1f05a61d-c9b7-4b87-a736-5de8061c607f+6:47868:x1858030988933376:12345-9467@kfi7:400:default-tuolumne205-0
00000100:00000200:25.0:1773851871.951987:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030988933376
00000020:00000001:25.0:1773851871.951988:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851871.951988:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851871.951989:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.951989:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851871.951990:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851871.951990:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851871.951991:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030988933376, found 0 last_xid 1858030988933375
00000020:00000001:25.0:1773851871.951991:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851871.951992:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851871.951992:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851871.951993:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.951994:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851871.951994:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851871.951994:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851871.951995:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000031371c34.
02000000:00000001:25.0:1773851871.951995:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.951996:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.951997:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851871.951997:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030988933376
00010000:00000001:25.0:1773851871.951998:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851871.951999:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000023a79b97 x1858030988933376/t0(0) o400->1f05a61d-c9b7-4b87-a736-5de8061c607f@9467@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne205-0'
00010000:00000001:25.0:1773851871.952001:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851871.952001:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851871.952002:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=104 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851871.952003:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851871.952004:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f29464b0 refcount 5 to 9467@kfi7
00000100:00000001:25.0:1773851871.952004:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329568 : -107155410222048 : ffff9e8aefd68420)
02000000:00000001:25.0:1773851871.952005:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851871.952005:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851871.952006:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851871.952007:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9467@kfi7
00000400:00000010:25.0:1773851871.952007:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cbe15403.
00000100:00000200:25.0:1773851871.952008:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030988933376, offset 224
00000400:00000200:25.0:1773851871.952009:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9467@kfi7
00000400:00000200:25.0:1773851871.952010:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.952011:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 1
00000400:00000200:25.0:1773851871.952011:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 2
00000400:00000200:25.0:1773851871.952013:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 3
00000400:00000200:25.0:1773851871.952014:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9467@kfi7 local destination
00000400:00000200:25.0:1773851871.952015:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769386:8769386:1024:4294967295] 9467@kfi7 LPNI seq info [28173:28173:16:4294967295]
00000400:00000200:25.0:1773851871.952016:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001833001d nid 9467@kfi7 refs 2
00000400:00000200:25.0:1773851871.952017:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9467@kfi7 to cpt 6
00000400:00000200:25.0:1773851871.952019:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9467@kfi7(9467@kfi7:9467@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851871.952021:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 3
00000800:00000200:25.0:1773851871.952022:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851871.952023:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851871.952024:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851871.952026:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000046c Using peer 9467@kfi7(0x10000000000046c)
00000800:00000200:25.0:1773851871.952029:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 324 bytes to peer 0x10000000000046c: rc=0
00000800:00000200:25.0:1773851871.952031:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000046c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851871.952032:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851871.952033:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f29464b0 refcount 4 to 9467@kfi7
00010000:00000001:25.0:1773851871.952034:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851871.952034:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851871.952035:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851871.952035:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000023a79b97 x1858030988933376/t0(0) o400->1f05a61d-c9b7-4b87-a736-5de8061c607f@9467@kfi7:88/0 lens 224/224 e 0 to 0 dl 1773852203 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne205-0'
00000100:00100000:25.0:1773851871.952038:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023a79b97 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1f05a61d-c9b7-4b87-a736-5de8061c607f+6:47868:x1858030988933376:12345-9467@kfi7:400:default-tuolumne205-0 Request processed in 52us (91us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851871.952040:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9467@kfi7, seq: 2025109
00000100:00000040:25.0:1773851871.952041:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c4d6a528 : new rpc_count 0
00000100:00000001:25.0:1773851871.952041:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851871.952042:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851871.952042:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851871.952043:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000020:00000010:25.0:1773851871.952043:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:25.0:1773851871.952044:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000c4d6a528 : new refcount 5
00000800:00000200:27.0:1773851871.952045:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000046c TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851871.952045:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851871.952047:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851871.952048:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9467@kfi7: PUT: OK
00000400:00000200:27.0:1773851871.952048:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cbe15403
00000400:00000010:27.0:1773851871.952049:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cbe15403.
00000100:00000001:27.0:1773851871.952049:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851871.952049:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851871.952050:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001833001d nid 9467@kfi7 refs 2
00000800:00000200:27.0:1773851871.952051:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2054@kfi7:6 -> 9467@kfi7(0000000075109b7c):0x0 lsk 1133 rsk 86 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000046c Transaction freed
00000800:00000200:25.0:1773851872.018287:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.018287:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.018289:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.018291:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851872.018293:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10064@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.018294:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10064@kfi7 : PUT - for me
00000400:00000200:25.0:1773851872.018295:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10064@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.018296:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7d9829a nid 10064@kfi7 refs 1
00000400:00000200:25.0:1773851872.018297:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10064@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.018297:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7d9829a nid 10064@kfi7 refs 2
00000400:00000200:25.0:1773851872.018298:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e7d9829a nid 10064@kfi7 refs 3
00000400:00000200:25.0:1773851872.018299:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10128@kfi7 to cpt 2
00000400:00000200:25.0:1773851872.018300:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10128@kfi7 of length 224 into portal 12 MB=0x69b4b904aadc0
00000400:00000200:25.0:1773851872.018301:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10128@kfi7 of length 224/224 into md 0x16159c9699 [64] + 17360
00000800:00000200:25.0:1773851872.018303:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851872.018305:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.018306:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10064@kfi7: PUT: OK
00000100:00000001:25.0:1773851872.018307:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851872.018307:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851872.018308:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009beee574.
00000100:00000040:25.0:1773851872.018308:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000009beee574 x1859598705929664 msgsize 224
00000100:00100000:25.0:1773851872.018310:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10128@kfi7 (source: 12345-10064@kfi7)
00000100:00000001:25.0:1773851872.018311:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851872.018312:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7d9829a nid 10064@kfi7 refs 2
00000800:00000200:25.0:1773851872.018313:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2069@kfi7:6 <- 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851872.018316:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851872.018316:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851872.018317:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851872.018318:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851872.018318:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851872.018319:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598705929664
00000020:00000001:25.0:1773851872.018319:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851872.018320:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7a0be
00000020:00000001:25.0:1773851872.018320:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851872.018322:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000009faafcd refcount=5
00000020:00000001:25.0:1773851872.018323:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125744039936 : -106947965511680 : ffff9ebb3c819800)
00000020:00000001:25.0:1773851872.018323:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125744039936 : -106947965511680 : ffff9ebb3c819800)
00000100:00000001:25.0:1773851872.018324:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851872.018325:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851872.018325:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:25.0:1773851872.018326:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851872.018327:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851872.018327:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851872.018328:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851872.018328:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851872.018329:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851872.018329:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851872.018330:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.018330:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851872.018331:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851872.018332:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851872.018332:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851872.018332:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851872.018333:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851872.018333:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10128@kfi7, seq: 2025110
00000100:00000040:25.0:1773851872.018333:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000009faafcd : new rpc_count 1
00000100:00000001:26.0:1773851872.018334:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.018334:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165942137600 : -106907767414016 : ffff9ec4987fe300)
00000100:00000040:25.0:1773851872.018335:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009beee574 x1859598705929664/t0(0) o400->54051456-8bff-4448-9f99-d01796fccbf1@10128@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1122-0'
00000100:00000001:25.0:1773851872.018337:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851872.018338:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851872.018338:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009beee574 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:54051456-8bff-4448-9f99-d01796fccbf1+5:39723:x1859598705929664:12345-10128@kfi7:400:default-tuolumne1122-0
00000100:00000200:25.0:1773851872.018339:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598705929664
00000020:00000001:25.0:1773851872.018341:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851872.018341:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851872.018341:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851872.018342:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851872.018342:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851872.018343:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851872.018343:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598705929664, found 0 last_xid 1859598705929663
00000020:00000001:25.0:1773851872.018344:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851872.018345:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851872.018345:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851872.018345:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851872.018346:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851872.018346:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851872.018347:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851872.018347:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000001686e81.
02000000:00000001:25.0:1773851872.018348:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.018348:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851872.018349:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851872.018349:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698793, transno 0, xid 1859598705929664
00010000:00000001:25.0:1773851872.018350:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851872.018351:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009beee574 x1859598705929664/t0(0) o400->54051456-8bff-4448-9f99-d01796fccbf1@10128@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1122-0'
00010000:00000001:25.0:1773851872.018353:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851872.018354:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851872.018354:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=105 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851872.018355:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851872.018356:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000005210aad refcount 3 to 10128@kfi7
00000100:00000001:25.0:1773851872.018356:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810487712 : -107154899063904 : ffff9e8b0e4e2ba0)
02000000:00000001:25.0:1773851872.018357:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851872.018357:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.018358:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851872.018359:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10064@kfi7
00000400:00000010:25.0:1773851872.018359:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054dcb4ba.
00000100:00000200:25.0:1773851872.018360:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598705929664, offset 224
00000400:00000200:25.0:1773851872.018361:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10064@kfi7
00000400:00000200:25.0:1773851872.018362:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10064@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.018363:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7d9829a nid 10064@kfi7 refs 1
00000400:00000200:25.0:1773851872.018364:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e7d9829a nid 10064@kfi7 refs 2
00000400:00000200:25.0:1773851872.018364:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e7d9829a nid 10064@kfi7 refs 3
00000400:00000200:25.0:1773851872.018365:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10064@kfi7 local destination
00000400:00000200:25.0:1773851872.018367:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769387:8769387:1024:4294967295] 10064@kfi7 LPNI seq info [11205947:11205947:16:4294967295]
00000400:00000200:25.0:1773851872.018368:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e7d9829a nid 10064@kfi7 refs 2
00000400:00000200:25.0:1773851872.018369:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10064@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.018370:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10064@kfi7(10064@kfi7:10064@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851872.018372:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e7d9829a nid 10064@kfi7 refs 3
00000800:00000200:25.0:1773851872.018373:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.018374:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851872.018376:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851872.018378:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x203 Using peer 10064@kfi7(0x203)
00000800:00000200:25.0:1773851872.018381:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000055b583f: Posted send of 324 bytes to peer 0x203: rc=0
00000800:00000200:25.0:1773851872.018382:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x203 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851872.018383:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851872.018384:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000005210aad refcount 2 to 10128@kfi7
00010000:00000001:25.0:1773851872.018385:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851872.018385:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851872.018386:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851872.018386:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009beee574 x1859598705929664/t0(0) o400->54051456-8bff-4448-9f99-d01796fccbf1@10128@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1122-0'
00000100:00100000:25.0:1773851872.018389:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009beee574 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:54051456-8bff-4448-9f99-d01796fccbf1+5:39723:x1859598705929664:12345-10128@kfi7:400:default-tuolumne1122-0 Request processed in 51us (80us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851872.018391:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10128@kfi7, seq: 2025110
00000100:00000040:25.0:1773851872.018392:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000009faafcd : new rpc_count 0
00000100:00000001:25.0:1773851872.018392:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851872.018393:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851872.018393:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851872.018394:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000800:00000200:27.0:1773851872.018395:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x203 TN_EVENT_TX_OK event status 0
00000020:00000010:25.0:1773851872.018395:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:25.0:1773851872.018395:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000009faafcd : new refcount 4
00000400:00000200:27.0:1773851872.018396:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:25.0:1773851872.018396:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851872.018397:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10064@kfi7: PUT: OK
00000400:00000200:27.0:1773851872.018397:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054dcb4ba
00000400:00000010:27.0:1773851872.018398:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054dcb4ba.
00000100:00000001:27.0:1773851872.018399:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851872.018399:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851872.018400:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7d9829a nid 10064@kfi7 refs 2
00000800:00000200:27.0:1773851872.018401:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2069@kfi7:6 -> 10064@kfi7(000000009265dd92):0x0 lsk 516 rsk 65 tsk 0 trmk 0 tmk 0 trr 6 tta 0x203 Transaction freed
00000800:00000200:9.0:1773851872.028896:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.028897:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.028899:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.028901:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.028903:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.028905:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.154@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851872.028906:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.028907:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851872.028908:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.154@o2ib600 to cpt 3
00000400:00000200:9.0:1773851872.028910:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008802b280 nid 172.19.3.154@o2ib600 refs 2
00000400:00000200:9.0:1773851872.028911:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008802b280 nid 172.19.3.154@o2ib600 refs 3
00000400:00000200:9.0:1773851872.028912:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.154@o2ib600 to cpt 3
00000400:00000200:9.0:1773851872.028914:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.154@o2ib600 of length 224 into portal 12 MB=0x699f3379d2840
00000400:00000200:9.0:1773851872.028915:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.154@o2ib600 of length 224/224 into md 0x82a36e8ed [64] + 33920
00000800:00000200:9.0:1773851872.028918:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.028922:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.028924:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.028925:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.028925:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.028926:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001163c390.
00000100:00000040:9.0:1773851872.028927:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000001163c390 x1858119749412928 msgsize 224
00000100:00100000:9.0:1773851872.028929:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.154@o2ib600 (source: 12345-172.19.3.154@o2ib600)
00000100:00000001:9.0:1773851872.028931:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.028932:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:15.0:1773851872.028934:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851872.028934:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851872.028934:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851872.028935:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851872.028936:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851872.028936:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851872.028937:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858119749412928
00000020:00000001:15.0:1773851872.028938:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851872.028938:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e40
00000020:00000001:15.0:1773851872.028939:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851872.028944:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b24fbfab refcount=11
00000020:00000001:15.0:1773851872.028944:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239656448 : -107152469895168 : ffff9e8b9f185800)
00000020:00000001:15.0:1773851872.028945:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239656448 : -107152469895168 : ffff9e8b9f185800)
00000100:00000001:15.0:1773851872.028946:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.028947:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851872.028948:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000570d845.
00000020:00000010:15.0:1773851872.028949:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851872.028950:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851872.028951:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851872.028951:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851872.028952:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851872.028953:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851872.028953:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851872.028954:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.028955:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851872.028956:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851872.028957:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851872.028957:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851872.028957:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851872.028958:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.154@o2ib600, seq: 2289852
00000100:00000040:15.0:1773851872.028959:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b24fbfab : new rpc_count 3
00000100:00000001:12.0:1773851872.028959:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.028960:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749197952 : -106947960353664 : ffff9ebb3cd04c80)
00000100:00000001:12.0:1773851872.028960:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.028962:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001163c390 x1858119749412928/t0(0) o400->b5b246d9-bca1-4006-a17b-0232148da656@172.19.3.154@o2ib600:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic4-0'
00000100:00000001:15.0:1773851872.028964:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.028965:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851872.028966:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001163c390 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b5b246d9-bca1-4006-a17b-0232148da656+11:26439:x1858119749412928:12345-172.19.3.154@o2ib600:400:login-oslic4-0
00000100:00000200:15.0:1773851872.028967:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858119749412928
00000020:00000001:15.0:1773851872.028968:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851872.028968:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851872.028969:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.028970:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851872.028970:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851872.028971:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851872.028972:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858119749412928, found 0 last_xid 1858119749021951
00000020:00000001:15.0:1773851872.028972:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851872.028973:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851872.028974:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851872.028974:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.028975:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851872.028976:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851872.028976:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851872.028978:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009dcbabfc.
02000000:00000001:15.0:1773851872.028978:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.028979:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.028980:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851872.028981:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183059645889, transno 0, xid 1858119749412928
00010000:00000001:15.0:1773851872.028981:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851872.028982:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001163c390 x1858119749412928/t0(0) o400->b5b246d9-bca1-4006-a17b-0232148da656@172.19.3.154@o2ib600:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic4-0'
00010000:00000001:15.0:1773851872.028985:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851872.028985:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851872.028986:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=105 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851872.028987:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851872.028988:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ddb3fae refcount 3 to 172.19.3.154@o2ib600
00000100:00000001:15.0:1773851872.028989:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729296864 : -107155980254752 : ffff9e8acddc81e0)
02000000:00000001:15.0:1773851872.028990:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851872.028991:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.028992:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851872.028993:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.154@o2ib600
00000400:00000010:15.0:1773851872.028993:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000077952c7.
00000100:00000200:15.0:1773851872.028994:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858119749412928, offset 224
00000400:00000200:15.0:1773851872.028996:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.154@o2ib600
00000400:00000200:15.0:1773851872.028997:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.154@o2ib600 to cpt 3
00000400:00000200:15.0:1773851872.028999:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008802b280 nid 172.19.3.154@o2ib600 refs 2
00000400:00000200:15.0:1773851872.029000:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008802b280 nid 172.19.3.154@o2ib600 refs 3
00000400:00000200:15.0:1773851872.029001:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008802b280 nid 172.19.3.154@o2ib600 refs 4
00000400:00000200:15.0:1773851872.029003:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.154@o2ib600 routed destination
00000400:00000200:15.0:1773851872.029004:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851872.029005:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:15.0:1773851872.029006:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.154@o2ib600: rtr pref emtpy: 1
00000400:00000200:15.0:1773851872.029007:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851872.029008:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.154@o2ib600: rtr pref emtpy: 1
00000400:00000200:15.0:1773851872.029008:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851872.029009:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769388:8769388:1024:4294967295] 2094@kfi7 LPNI seq info [1258746999:1258746999:16:4294967295]
00000400:00000200:15.0:1773851872.029011:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:15.0:1773851872.029012:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:15.0:1773851872.029014:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.154@o2ib600(172.19.3.154@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851872.029016:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008802b280 nid 172.19.3.154@o2ib600 refs 3
00000800:00000200:15.0:1773851872.029017:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851872.029019:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851872.029021:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851872.029024:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:15.0:1773851872.029027:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:15.0:1773851872.029029:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851872.029031:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.029032:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ddb3fae refcount 2 to 172.19.3.154@o2ib600
00010000:00000001:15.0:1773851872.029033:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851872.029033:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.029034:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851872.029035:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001163c390 x1858119749412928/t0(0) o400->b5b246d9-bca1-4006-a17b-0232148da656@172.19.3.154@o2ib600:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic4-0'
00000100:00100000:15.0:1773851872.029038:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001163c390 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:b5b246d9-bca1-4006-a17b-0232148da656+11:26439:x1858119749412928:12345-172.19.3.154@o2ib600:400:login-oslic4-0 Request processed in 73us (111us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851872.029040:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851872.029041:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.154@o2ib600, seq: 2289852
00000100:00000040:15.0:1773851872.029042:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b24fbfab : new rpc_count 2
00000400:00000200:13.0:1773851872.029042:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851872.029043:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851872.029043:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851872.029043:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:15.0:1773851872.029044:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851872.029044:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000077952c7
00000020:00000010:15.0:1773851872.029045:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000010:13.0:1773851872.029045:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000077952c7.
00000100:00000001:13.0:1773851872.029045:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851872.029046:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000570d845.
00000020:00000040:15.0:1773851872.029046:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000b24fbfab : new refcount 10
00000100:00000001:13.0:1773851872.029046:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851872.029047:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851872.029047:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:13.0:1773851872.029048:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00000004:00000001:30.0:1773851872.073731:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851872.073732:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:28.0:1773851872.073732:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851872.073732:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851872.073733:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003e6f3f13.
00000004:00000001:29.0:1773851872.073733:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:28.0:1773851872.073733:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000143cdc19.
00000004:00000001:8.0:1773851872.073733:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:30.0:1773851872.073734:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000004:00000020:29.0:1773851872.073734:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:28.0:1773851872.073734:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000004:00000020:8.0:1773851872.073734:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:30.0:1773851872.073735:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851872.073735:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:29.0:1773851872.073735:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db2f56d6.
00000100:00000001:28.0:1773851872.073735:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:8.0:1773851872.073735:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa9519f1.
00000020:00000040:29.0:1773851872.073736:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
02000000:00000001:28.0:1773851872.073736:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851872.073737:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851872.073737:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851872.073737:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:8.0:1773851872.073737:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
02000000:00000001:29.0:1773851872.073738:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:30.0:1773851872.073739:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000040d06717.
02000000:00000001:29.0:1773851872.073739:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851872.073739:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000516f9559.
00000100:00000001:8.0:1773851872.073739:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851872.073740:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851872.073741:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851872.073741:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:28.0:1773851872.073741:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851872.073741:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851872.073742:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851872.073742:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.073742:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:8.0:1773851872.073743:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:30.0:1773851872.073744:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851872.073744:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851872.073744:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851872.073745:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.073745:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851872.073746:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003e6f3f13] to pc [ptlrpcd_07_00+0]  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851872.073746:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000143cdc19] to pc [ptlrpcd_07_03+3]  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851872.073747:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000db2f56d6] to pc [ptlrpcd_07_01+1]  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851872.073747:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:8.0:1773851872.073748:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.073750:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fa9519f1] to pc [ptlrpcd_02_00+0]  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851872.073754:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851872.073755:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851872.073756:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851872.073756:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:29.0:1773851872.073756:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851872.073756:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:31.0:1773851872.073757:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:30.0:1773851872.073758:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003d10c116.
00080000:00000010:29.0:1773851872.073758:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ed213251.
00080000:00000001:30.0:1773851872.073759:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637140800126976 : -106932909424640 : ffff9ebebdeb4000)
00080000:00000001:29.0:1773851872.073759:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637131418225664 : -106942291325952 : ffff9ebc8eb6cc00)
00080000:00000010:28.0:1773851872.073759:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000aa576786.
00000100:00000001:31.0:1773851872.073760:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851872.073760:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851872.073760:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637079152420864 : -106994557130752 : ffff9eb0636de800)
02000000:00000001:31.0:1773851872.073761:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:29.0:1773851872.073761:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851872.073761:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:31.0:1773851872.073762:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851872.073762:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:31.0:1773851872.073763:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000143cdc19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051930048:9@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851872.073763:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851872.073763:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.073764:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:30.0:1773851872.073764:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851872.073764:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
02000000:00000001:31.0:1773851872.073765:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00001000:30.0:1773851872.073765:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000004:00001000:28.0:1773851872.073765:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
02000000:00000001:31.0:1773851872.073766:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851872.073766:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000010:29.0:1773851872.073766:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000bf685daa.
00000004:00000010:28.0:1773851872.073766:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005bead82f.
00000004:00000010:30.0:1773851872.073767:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002247e18f.
00000004:00080000:29.0:1773851872.073767:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614146527042837ns, next at 614147527040813ns, rc = 0
00080000:00000001:8.0:1773851872.073767:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000010:31.0:1773851872.073768:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000660c7356.
02000000:00000001:31.0:1773851872.073768:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851872.073768:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614146527043759ns, next at 614147527041965ns, rc = 0
00000004:00080000:28.0:1773851872.073768:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614146527043108ns, next at 614147527041475ns, rc = 0
00080000:00000001:29.0:1773851872.073769:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851872.073769:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:9.0:1773851872.073769:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851872.073770:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:31.0:1773851872.073770:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00080000:00000001:30.0:1773851872.073770:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:10.0:1773851872.073770:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851872.073770:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:8.0:1773851872.073770:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bafb3ec8.
00000400:00000010:31.0:1773851872.073771:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000030edd6e9.
00080000:00000001:29.0:1773851872.073771:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851872.073771:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.073771:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.073771:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851872.073771:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637099572720640 : -106974136830976 : ffff9eb52492f400)
00080000:00000001:30.0:1773851872.073772:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851872.073772:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851872.073772:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851872.073773:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930048, portal 4
00000004:00000001:30.0:1773851872.073773:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851872.073773:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851872.073773:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851872.073774:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851872.073774:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324246272 : -106976385305344 : ffff9eb49e8df500)
00080000:00000001:8.0:1773851872.073775:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851872.073776:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851872.073776:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851872.073776:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:8.0:1773851872.073776:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00000100:00000001:30.0:1773851872.073777:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851872.073777:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.073778:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:30.0:1773851872.073778:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:8.0:1773851872.073778:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005ccc685e.
00000100:00000040:31.0:1773851872.073779:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:31.0:1773851872.073779:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e37bb3ee.
00000100:00000001:9.0:1773851872.073779:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:30.0:1773851872.073780:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851872.073780:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851872.073780:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:8.0:1773851872.073780:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614146527055180ns, next at 614147527052916ns, rc = 0
00000100:00000200:31.0:1773851872.073781:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930048, offset 0
00000100:00000001:28.0:1773851872.073781:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:9.0:1773851872.073781:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:31.0:1773851872.073782:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000100:00000001:28.0:1773851872.073782:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851872.073782:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:31.0:1773851872.073783:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
02000000:00000001:9.0:1773851872.073783:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851872.073783:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851872.073784:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000040:28.0:1773851872.073784:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:8.0:1773851872.073784:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851872.073785:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:30.0:1773851872.073785:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00100000:9.0:1773851872.073785:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa9519f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051930176:2084@kfi7:13:default-yuba2-0
00000400:00000200:31.0:1773851872.073786:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:30.0:1773851872.073786:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851872.073787:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
02000000:00000001:30.0:1773851872.073787:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:9.0:1773851872.073787:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851872.073788:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851872.073789:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769387, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769388, p:4294967295, g:4294967295, h:1000]
00000100:00000001:28.0:1773851872.073789:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:9.0:1773851872.073789:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00100000:30.0:1773851872.073790:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db2f56d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051930112:47@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851872.073790:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851872.073790:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851872.073791:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
02000000:00000001:28.0:1773851872.073791:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851872.073791:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:31.0:1773851872.073792:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:30.0:1773851872.073792:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:9.0:1773851872.073792:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000082699907.
00000400:00000200:31.0:1773851872.073793:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
02000000:00000001:30.0:1773851872.073793:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851872.073793:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851872.073794:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769389:8769389:1024:4294967295] 9@kfi7 LPNI seq info [5403009:5403009:16:4294967295]
02000000:00000001:30.0:1773851872.073794:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851872.073794:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003e6f3f13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051929984:2104@kfi7:13:default-yuba2-0
02000000:00000001:9.0:1773851872.073794:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851872.073795:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
02000000:00000001:30.0:1773851872.073795:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:31.0:1773851872.073796:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:9.0:1773851872.073796:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
02000000:00000010:30.0:1773851872.073797:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000c3be53b8.
00000100:00000001:28.0:1773851872.073797:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:9.0:1773851872.073797:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bb91a712.
02000000:00000001:30.0:1773851872.073798:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851872.073798:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:31.0:1773851872.073799:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
02000000:00000001:28.0:1773851872.073799:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851872.073799:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a665d1ec.
00000400:00000200:31.0:1773851872.073800:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:30.0:1773851872.073800:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
02000000:00000001:28.0:1773851872.073800:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:30.0:1773851872.073801:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
02000000:00000010:28.0:1773851872.073801:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000711cbf99.
00000100:00000200:9.0:1773851872.073801:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930176, portal 4
00000800:00000200:31.0:1773851872.073802:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
02000000:00000001:28.0:1773851872.073802:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.073802:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:31.0:1773851872.073803:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:30.0:1773851872.073803:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00000001:9.0:1773851872.073803:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491256320 : -107117218295296 : ffff9e93d4411200)
00000400:00000200:28.0:1773851872.073804:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:31.0:1773851872.073805:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:30.0:1773851872.073805:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930112, portal 4
00000400:00000010:28.0:1773851872.073805:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000100:00000001:30.0:1773851872.073806:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851872.073807:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637085309679104 : -106988399872512 : ffff9eb1d26e3600)
00000400:00000010:28.0:1773851872.073807:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fbb7163e.
00000100:00000040:9.0:1773851872.073807:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851872.073808:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000100:00000040:30.0:1773851872.073809:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:28.0:1773851872.073809:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051929984, portal 4
00000100:00000001:28.0:1773851872.073810:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:31.0:1773851872.073811:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x31e: rc=0
00000100:00000001:28.0:1773851872.073811:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637127372020480 : -106946337531136 : ffff9ebb9d8a9b00)
00000100:00000001:9.0:1773851872.073812:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:31.0:1773851872.073813:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851872.073814:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851872.073814:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851872.073814:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000100:00000001:31.0:1773851872.073815:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.073815:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000010:9.0:1773851872.073815:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007ae4cb00.
00000100:00000001:31.0:1773851872.073816:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851872.073816:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000100:00000200:9.0:1773851872.073816:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930176, offset 0
00000100:00000001:31.0:1773851872.073817:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.073817:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:30.0:1773851872.073817:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000086dda7f0.
00000100:00000200:30.0:1773851872.073818:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930112, offset 0
00000100:00000001:31.0:1773851872.073819:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851872.073819:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851872.073819:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000100:00000001:31.0:1773851872.073820:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851872.073820:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851872.073821:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851872.073821:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851872.073821:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000200:9.0:1773851872.073821:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:31.0:1773851872.073822:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851872.073823:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000040:28.0:1773851872.073823:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000200:9.0:1773851872.073823:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:30.0:1773851872.073825:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:9.0:1773851872.073825:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:30.0:1773851872.073826:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:9.0:1773851872.073827:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:30.0:1773851872.073829:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:9.0:1773851872.073829:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000010:28.0:1773851872.073830:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091f735e9.
00000400:00000200:30.0:1773851872.073831:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000800:00000200:29.0:1773851872.073831:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000100:00000200:28.0:1773851872.073831:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051929984, offset 0
00000400:00000200:9.0:1773851872.073832:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769389, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769388, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851872.073834:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769389, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769388, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851872.073835:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:28.0:1773851872.073836:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:9.0:1773851872.073836:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851872.073837:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000400:00000200:30.0:1773851872.073838:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851872.073838:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e37bb3ee
00000400:00000200:9.0:1773851872.073838:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851872.073839:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000010:29.0:1773851872.073840:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e37bb3ee.
00000400:00000200:9.0:1773851872.073840:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:30.0:1773851872.073841:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000100:00000001:29.0:1773851872.073841:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:9.0:1773851872.073842:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769390:8769390:1024:4294967295] 2084@kfi7 LPNI seq info [5402745:5402745:16:4294967295]
00000400:00000200:30.0:1773851872.073843:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769391:8769391:1024:4294967295] 47@kfi7 LPNI seq info [5403020:5403020:16:4294967295]
00000100:00000200:29.0:1773851872.073843:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851872.073845:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:30.0:1773851872.073846:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:9.0:1773851872.073847:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:30.0:1773851872.073848:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:29.0:1773851872.073848:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:28.0:1773851872.073849:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000040:29.0:1773851872.073850:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851872.073851:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:28.0:1773851872.073852:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:30.0:1773851872.073853:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851872.073853:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000100:00000001:29.0:1773851872.073854:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851872.073855:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:28.0:1773851872.073855:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:30.0:1773851872.073856:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:29.0:1773851872.073857:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:28.0:1773851872.073857:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000800:00000200:30.0:1773851872.073858:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851872.073860:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851872.073860:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000400:00000200:28.0:1773851872.073860:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769389, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769391, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851872.073860:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:9.0:1773851872.073863:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:28.0:1773851872.073864:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:30.0:1773851872.073865:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851872.073865:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851872.073866:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851872.073867:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000800:00000200:5.0:1773851872.073868:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:30.0:1773851872.073869:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000400:00000200:28.0:1773851872.073869:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769392:8769392:1024:4294967295] 2104@kfi7 LPNI seq info [5403377:5403377:16:4294967295]
00000800:00000200:9.0:1773851872.073870:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851872.073870:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:28.0:1773851872.073872:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:5.0:1773851872.073872:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:28.0:1773851872.073874:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:30.0:1773851872.073875:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000b68a0a1e: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000800:00000200:9.0:1773851872.073875:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Using peer 2084@kfi7(0x2000000000000ff)
00000800:00000200:5.0:1773851872.073877:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:30.0:1773851872.073878:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851872.073878:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000800:00000200:9.0:1773851872.073880:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x2000000000000ff: rc=0
00000400:00000200:5.0:1773851872.073880:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:28.0:1773851872.073881:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:30.0:1773851872.073882:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851872.073882:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000100:00000001:30.0:1773851872.073883:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:9.0:1773851872.073883:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851872.073884:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851872.073884:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:5.0:1773851872.073884:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:30.0:1773851872.073885:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851872.073885:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000001:30.0:1773851872.073886:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851872.073887:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851872.073887:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:30.0:1773851872.073888:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851872.073888:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:28.0:1773851872.073888:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851872.073888:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851872.073889:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851872.073889:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:30.0:1773851872.073890:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851872.073890:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851872.073890:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:30.0:1773851872.073891:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.073891:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851872.073892:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.073892:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851872.073892:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851872.073893:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3dc0
00000100:00000001:9.0:1773851872.073894:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851872.073895:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:5.0:1773851872.073895:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000800:00000200:28.0:1773851872.073896:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851872.073896:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:30.0:1773851872.073897:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851872.073897:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:10.0:1773851872.073898:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851872.073898:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851872.073898:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b31165 [1] + 224
00000100:00000001:9.0:1773851872.073899:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851872.073900:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:28.0:1773851872.073901:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Using peer 2104@kfi7(0x19d)
00000800:00000200:5.0:1773851872.073901:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851872.073902:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000400:00000200:10.0:1773851872.073902:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851872.073903:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000086dda7f0
00000400:00000010:30.0:1773851872.073904:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000086dda7f0.
00000400:00000200:10.0:1773851872.073904:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000400:00000200:5.0:1773851872.073904:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851872.073905:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:28.0:1773851872.073905:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x19d: rc=0
00000100:00000200:30.0:1773851872.073906:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851872.073906:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007ae4cb00
00000400:00000010:10.0:1773851872.073907:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007ae4cb00.
00000400:00000200:5.0:1773851872.073907:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000800:00000200:28.0:1773851872.073908:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851872.073908:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:5.0:1773851872.073908:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851872.073910:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851872.073910:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851872.073911:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851872.073912:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851872.073913:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.073914:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851872.073915:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851872.073915:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851872.073916:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.073916:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851872.073916:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851872.073917:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:28.0:1773851872.073917:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.073918:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851872.073919:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:10.0:1773851872.073920:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851872.073921:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000100:00000001:28.0:1773851872.073921:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851872.073921:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:28.0:1773851872.073922:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851872.073922:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851872.073923:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851872.073923:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:10.0:1773851872.073923:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:5.0:1773851872.073923:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:31.0:1773851872.073924:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851872.073924:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:31.0:1773851872.073925:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851872.073925:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:10.0:1773851872.073926:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Transaction freed
00000800:00000200:5.0:1773851872.073926:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000010:31.0:1773851872.073927:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000200:31.0:1773851872.073927:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000030edd6e9
00000400:00000010:31.0:1773851872.073928:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000030edd6e9.
00000100:00000001:31.0:1773851872.073928:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:31.0:1773851872.073930:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851872.073930:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851872.073931:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851872.073931:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851872.073932:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851872.073934:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851872.073935:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851872.073935:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851872.073935:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000800:00000200:25.0:1773851872.073935:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00000001:31.0:1773851872.073936:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851872.073936:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851872.073937:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:29.0:1773851872.073937:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091f735e9
00000800:00000200:25.0:1773851872.073937:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851872.073938:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851872.073938:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851872.073938:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091f735e9.
00000100:00001000:31.0:1773851872.073939:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=105 v=66 (66 66 66 66)
00000100:00000001:29.0:1773851872.073939:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:25.0:1773851872.073939:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:29.0:1773851872.073940:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851872.073941:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=26 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851872.073942:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851872.073942:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851872.073942:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00010000:00000001:31.0:1773851872.073943:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851872.073943:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851872.073943:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000001:31.0:1773851872.073944:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851872.073945:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000100:00000001:31.0:1773851872.073945:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851872.073945:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:25.0:1773851872.073945:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:21.0:1773851872.073945:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851872.073946:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851872.073946:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851872.073947:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:25.0:1773851872.073947:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2084@kfi7 : PUT - for me
00000800:00000200:21.0:1773851872.073947:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851872.073949:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:29.0:1773851872.073950:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851872.073950:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:29.0:1773851872.073951:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851872.073951:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:25.0:1773851872.073952:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:31.0:1773851872.073953:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851872.073953:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:21.0:1773851872.073953:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:31.0:1773851872.073954:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:25.0:1773851872.073954:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:31.0:1773851872.073955:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851872.073955:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000004:00000001:31.0:1773851872.073956:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851872.073956:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000800:00000200:29.0:1773851872.073956:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Transaction freed
00000400:00000200:21.0:1773851872.073956:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000800:00000200:13.0:1773851872.073956:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000004:00000040:31.0:1773851872.073957:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480018944 avail=351478743040 avail_mb=1372963840 hwm_mb=3131101 files=372073116 ffree=343242206 state=0: rc = 0
00000400:00000200:25.0:1773851872.073957:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851872.073957:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:13.0:1773851872.073958:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000004:00000020:31.0:1773851872.073959:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480018944 free, 351478743040 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073116 files, 343242206 free files
00000400:00000200:25.0:1773851872.073959:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3e40
00000400:00000200:21.0:1773851872.073959:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000004:00000001:31.0:1773851872.073960:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851872.073960:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:31.0:1773851872.073961:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:25.0:1773851872.073961:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851872.073961:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851872.073962:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000800:00000200:13.0:1773851872.073963:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00100000:31.0:1773851872.073964:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000143cdc19 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051930048:9@kfi7:13:default-yuba2-0
00000400:00000200:25.0:1773851872.073964:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b824b9 [1] + 224
00000400:00000200:21.0:1773851872.073964:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000001:31.0:1773851872.073966:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851872.073966:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:21.0:1773851872.073966:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000040:31.0:1773851872.073967:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000143cdc19 x1859433051930048/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:25.0:1773851872.073967:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851872.073967:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:21.0:1773851872.073968:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3e00
00000400:00000200:13.0:1773851872.073969:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2104@kfi7 : PUT - for me
00000100:00000001:31.0:1773851872.073970:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851872.073970:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:25.0:1773851872.073970:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851872.073970:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
02000000:00000010:31.0:1773851872.073971:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000660c7356.
00000400:00000200:13.0:1773851872.073971:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
02000000:00000001:31.0:1773851872.073972:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000400:00000200:25.0:1773851872.073972:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000400:00000200:21.0:1773851872.073972:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d0f75 [1] + 224
00000400:00000200:13.0:1773851872.073972:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000020:00000001:31.0:1773851872.073973:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851872.073973:0:41091:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000020:00000001:31.0:1773851872.073974:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851872.073974:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000516f9559.
00000100:00000001:25.0:1773851872.073974:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851872.073974:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:21.0:1773851872.073975:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:31.0:1773851872.073976:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851872.073976:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000200:25.0:1773851872.073976:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851872.073976:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000010:31.0:1773851872.073977:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000143cdc19.
00000100:00000001:31.0:1773851872.073978:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851872.073978:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851872.073978:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851872.073978:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851872.073979:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:13.0:1773851872.073979:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:31.0:1773851872.073980:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.073980:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:21.0:1773851872.073980:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000400:00000200:13.0:1773851872.073980:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:31.0:1773851872.073981:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851872.073981:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851872.073982:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3d80
00000100:00000200:21.0:1773851872.073983:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851872.073984:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000040:25.0:1773851872.073986:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851872.073987:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f63ed [1] + 224
00000100:00000040:21.0:1773851872.073988:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851872.073990:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851872.073993:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851872.073993:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.073994:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:21.0:1773851872.073995:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851872.073995:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000400:00000200:21.0:1773851872.073996:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:13.0:1773851872.073996:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851872.073996:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:25.0:1773851872.073997:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851872.073997:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851872.073998:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000001:9.0:1773851872.073998:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:30.0:1773851872.073999:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851872.073999:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:13.0:1773851872.073999:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:9.0:1773851872.073999:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:30.0:1773851872.074000:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000010:9.0:1773851872.074000:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bb91a712.
00000400:00000001:30.0:1773851872.074001:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:9.0:1773851872.074001:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a665d1ec
00000400:00000010:30.0:1773851872.074002:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000010:9.0:1773851872.074002:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a665d1ec.
00000400:00000200:30.0:1773851872.074003:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:30.0:1773851872.074004:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000040:13.0:1773851872.074004:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851872.074004:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851872.074005:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851872.074005:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851872.074007:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851872.074010:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851872.074011:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851872.074013:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:9.0:1773851872.074014:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851872.074015:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851872.074015:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:13.0:1773851872.074015:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851872.074015:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851872.074016:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:30.0:1773851872.074017:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:28.0:1773851872.074017:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851872.074017:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:9.0:1773851872.074017:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851872.074018:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:28.0:1773851872.074019:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000001:9.0:1773851872.074019:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851872.074020:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fbb7163e
00000400:00000010:28.0:1773851872.074020:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fbb7163e.
02000000:00000001:9.0:1773851872.074020:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851872.074022:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851872.074022:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851872.074022:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:9.0:1773851872.074022:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=105 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851872.074023:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:28.0:1773851872.074023:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851872.074024:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:9.0:1773851872.074024:0:41068:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=105 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851872.074025:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851872.074026:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.074026:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:30.0:1773851872.074027:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.074027:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851872.074028:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:9.0:1773851872.074028:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00001000:30.0:1773851872.074029:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=105 v=66 (66 66 66 66)
00010000:00000001:9.0:1773851872.074029:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851872.074031:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=105 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851872.074031:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851872.074032:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000100:00000001:30.0:1773851872.074033:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851872.074033:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.074033:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851872.074033:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851872.074033:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851872.074033:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.074034:0:41088:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:30.0:1773851872.074035:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:28.0:1773851872.074035:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:9.0:1773851872.074035:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:30.0:1773851872.074036:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.074036:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851872.074037:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:28.0:1773851872.074037:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851872.074038:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
02000000:00000001:28.0:1773851872.074038:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851872.074039:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851872.074039:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851872.074039:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=105 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851872.074039:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:30.0:1773851872.074041:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:28.0:1773851872.074041:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=105 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851872.074041:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851872.074042:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851872.074043:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:9.0:1773851872.074043:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851872.074044:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:9.0:1773851872.074044:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00010000:00000001:28.0:1773851872.074045:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000040:9.0:1773851872.074045:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593670656 avail=351576785920 avail_mb=1373346820 hwm_mb=3131103 files=372190001 ffree=343353194 state=0: rc = 0
00000100:00000001:30.0:1773851872.074046:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:28.0:1773851872.074046:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851872.074047:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851872.074047:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851872.074048:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:28.0:1773851872.074048:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000004:00000020:9.0:1773851872.074048:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593670656 free, 351576785920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190001 files, 343353194 free files
00000004:00000001:30.0:1773851872.074049:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851872.074049:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000040:30.0:1773851872.074050:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000100:00000001:28.0:1773851872.074050:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:30.0:1773851872.074051:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603951616 avail=351601702912 avail_mb=1373444152 hwm_mb=3131103 files=372190454 ffree=343363234 state=0: rc = 0
00000100:00000040:28.0:1773851872.074051:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851872.074051:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851872.074053:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:30.0:1773851872.074054:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603951616 free, 351601702912 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190454 files, 343363234 free files
00000004:00000001:30.0:1773851872.074057:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851872.074058:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851872.074058:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa9519f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051930176:2084@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851872.074060:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851872.074061:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851872.074062:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851872.074062:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851872.074063:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:9.0:1773851872.074063:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fa9519f1 x1859433051930176/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:28.0:1773851872.074064:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:28.0:1773851872.074064:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000004:00000040:28.0:1773851872.074066:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615886336 avail=351613268992 avail_mb=1373489332 hwm_mb=3131103 files=372043465 ffree=343374889 state=0: rc = 0
00000100:00000001:9.0:1773851872.074067:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851872.074068:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:30.0:1773851872.074069:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db2f56d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051930112:47@kfi7:13:default-yuba2-0
00000004:00000020:28.0:1773851872.074069:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615886336 free, 351613268992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043465 files, 343374889 free files
02000000:00000010:9.0:1773851872.074069:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000082699907.
02000000:00000001:9.0:1773851872.074071:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851872.074071:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:30.0:1773851872.074072:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851872.074072:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:9.0:1773851872.074072:0:41068:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000100:00000001:30.0:1773851872.074073:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:9.0:1773851872.074073:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:30.0:1773851872.074074:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000db2f56d6 x1859433051930112/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851872.074074:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:9.0:1773851872.074074:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:9.0:1773851872.074076:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851872.074077:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:30.0:1773851872.074078:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000010:9.0:1773851872.074078:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa9519f1.
02000000:00000001:30.0:1773851872.074079:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:28.0:1773851872.074079:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003e6f3f13 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051929984:2104@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851872.074079:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000010:30.0:1773851872.074080:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000c3be53b8.
00000100:00000001:9.0:1773851872.074080:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851872.074081:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851872.074081:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851872.074082:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851872.074082:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851872.074082:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000040:30.0:1773851872.074083:0:41089:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000100:00000040:28.0:1773851872.074083:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003e6f3f13 x1859433051929984/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851872.074083:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851872.074083:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851872.074084:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:9.0:1773851872.074084:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:30.0:1773851872.074085:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000100:00000001:9.0:1773851872.074085:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851872.074086:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851872.074087:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851872.074088:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db2f56d6.
00000100:00000001:28.0:1773851872.074088:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851872.074089:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:28.0:1773851872.074089:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851872.074089:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000711cbf99.
00000100:00000001:30.0:1773851872.074090:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851872.074091:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:28.0:1773851872.074091:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851872.074092:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:28.0:1773851872.074092:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851872.074092:0:41088:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000100:00000001:30.0:1773851872.074093:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851872.074093:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:30.0:1773851872.074094:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851872.074094:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851872.074094:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000040d06717.
02000000:00000001:28.0:1773851872.074095:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851872.074096:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851872.074097:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003e6f3f13.
00000100:00000001:28.0:1773851872.074098:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851872.074099:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851872.074100:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851872.074101:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851872.074102:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.074103:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851872.074104:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851872.118315:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.118315:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851872.118316:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.118316:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851872.118318:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.118318:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851872.118320:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851872.118320:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 24768@kfi7(00000000b8d63339):0x514 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851872.118322:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24768@kfi7 to cpt 2
00000800:00000200:9.0:1773851872.118322:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 Using peer 24768@kfi7(0x514)
00000400:00000200:10.0:1773851872.118323:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24768@kfi7 : PUT - for me
00000400:00000200:10.0:1773851872.118324:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24768@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.118324:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24768@kfi7 to cpt 2
00000400:00000200:10.0:1773851872.118325:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027caf9da nid 24768@kfi7 refs 1
00000800:00000200:9.0:1773851872.118325:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x514: rc=0
00000400:00000200:10.0:1773851872.118326:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24768@kfi7 to cpt 2
00000400:00000200:10.0:1773851872.118327:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027caf9da nid 24768@kfi7 refs 2
00000800:00000200:9.0:1773851872.118327:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851872.118328:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000027caf9da nid 24768@kfi7 refs 3
00000400:00000200:10.0:1773851872.118329:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24768@kfi7 to cpt 2
00000400:00000200:10.0:1773851872.118330:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24768@kfi7 of length 224 into portal 12 MB=0x69b441a339d00
00000400:00000200:10.0:1773851872.118331:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24768@kfi7 of length 224/224 into md 0x78146ce49 [64] + 139400
00000800:00000200:10.0:1773851872.118333:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851872.118335:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851872.118336:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24768@kfi7: PUT: OK
00000100:00000001:10.0:1773851872.118337:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851872.118337:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851872.118338:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000abde729d.
00000100:00000040:10.0:1773851872.118339:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000abde729d x1859566659935488 msgsize 224
00000100:00100000:10.0:1773851872.118340:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-24768@kfi7 (source: 12345-24768@kfi7)
00000800:00000200:9.0:1773851872.118341:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851872.118343:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851872.118343:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 Transaction freed
00000400:00000200:10.0:1773851872.118344:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000027caf9da nid 24768@kfi7 refs 2
00000800:00000200:10.0:1773851872.118345:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851872.118346:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851872.118347:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851872.118348:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851872.118349:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851872.118350:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.118352:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859566659935488
00000020:00000001:8.0:1773851872.118353:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851872.118353:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07d911df5f2
00000020:00000001:8.0:1773851872.118355:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851872.118359:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002314f249 refcount=5
00000020:00000001:8.0:1773851872.118360:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139762224128 : -106933947327488 : ffff9ebe800e1c00)
00000020:00000001:8.0:1773851872.118362:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139762224128 : -106933947327488 : ffff9ebe800e1c00)
00000100:00000001:8.0:1773851872.118364:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.118364:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851872.118366:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000020:00000010:8.0:1773851872.118368:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.118369:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851872.118371:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851872.118372:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.118373:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851872.118375:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851872.118376:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851872.118377:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.118379:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.118381:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851872.118381:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.118382:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851872.118382:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851872.118384:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24768@kfi7, seq: 2130789
00000100:00000001:11.0:1773851872.118385:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.118385:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002314f249 : new rpc_count 1
00000100:00000001:11.0:1773851872.118386:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.118386:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637075820486528 : -106997889065088 : ffff9eaf9cd49f80)
00000100:00000040:8.0:1773851872.118388:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000abde729d x1859566659935488/t0(0) o400->72ea3554-892d-4c52-9c43-77e0bbc4af69@24768@kfi7:660/0 lens 224/0 e 0 to 0 dl 1773852020 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2035-0'
00000100:00000001:8.0:1773851872.118394:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.118394:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851872.118396:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abde729d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:72ea3554-892d-4c52-9c43-77e0bbc4af69+5:39741:x1859566659935488:12345-24768@kfi7:400:default-tuolumne2035-0
00000100:00000200:8.0:1773851872.118398:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859566659935488
00000020:00000001:8.0:1773851872.118400:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851872.118401:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851872.118402:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.118403:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851872.118404:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851872.118406:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851872.118407:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859566659935488, found 0 last_xid 1859566659935487
00000020:00000001:8.0:1773851872.118408:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851872.118409:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851872.118410:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851872.118411:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.118412:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851872.118413:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851872.118414:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851872.118415:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000041a4febb.
02000000:00000001:8.0:1773851872.118416:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.118417:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.118418:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851872.118419:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260566091, transno 0, xid 1859566659935488
00010000:00000001:8.0:1773851872.118421:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851872.118423:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000abde729d x1859566659935488/t0(0) o400->72ea3554-892d-4c52-9c43-77e0bbc4af69@24768@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2035-0'
00010000:00000001:8.0:1773851872.118427:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851872.118428:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851872.118429:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851872.118431:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851872.118432:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006559b262 refcount 3 to 24768@kfi7
00000100:00000001:8.0:1773851872.118434:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526776160 : -107156182775456 : ffff9e8ac1ca4960)
02000000:00000001:8.0:1773851872.118435:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851872.118436:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.118437:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851872.118438:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24768@kfi7
00000400:00000010:8.0:1773851872.118439:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
00000100:00000200:8.0:1773851872.118440:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859566659935488, offset 224
00000400:00000200:8.0:1773851872.118443:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24768@kfi7
00000400:00000200:8.0:1773851872.118445:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24768@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.118446:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027caf9da nid 24768@kfi7 refs 1
00000400:00000200:8.0:1773851872.118448:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000027caf9da nid 24768@kfi7 refs 2
00000400:00000200:8.0:1773851872.118450:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000027caf9da nid 24768@kfi7 refs 3
00000400:00000200:8.0:1773851872.118452:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24768@kfi7 local destination
00000400:00000200:8.0:1773851872.118455:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769393:8769393:1024:4294967295] 24768@kfi7 LPNI seq info [1128454:1128454:16:4294967295]
00000400:00000200:8.0:1773851872.118457:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000027caf9da nid 24768@kfi7 refs 2
00000400:00000200:8.0:1773851872.118459:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24768@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.118462:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24768@kfi7(24768@kfi7:24768@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851872.118465:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000027caf9da nid 24768@kfi7 refs 3
00000800:00000200:8.0:1773851872.118467:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851872.118469:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851872.118473:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851872.118477:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 Using peer 24768@kfi7(0x514)
00000800:00000200:8.0:1773851872.118483:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x514: rc=0
00000800:00000200:8.0:1773851872.118485:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851872.118489:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.118490:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006559b262 refcount 2 to 24768@kfi7
00010000:00000001:8.0:1773851872.118491:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851872.118493:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.118494:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851872.118495:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000abde729d x1859566659935488/t0(0) o400->72ea3554-892d-4c52-9c43-77e0bbc4af69@24768@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2035-0'
00000100:00100000:8.0:1773851872.118501:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abde729d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:72ea3554-892d-4c52-9c43-77e0bbc4af69+5:39741:x1859566659935488:12345-24768@kfi7:400:default-tuolumne2035-0 Request processed in 106us (161us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851872.118505:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24768@kfi7, seq: 2130789
00000100:00000040:8.0:1773851872.118507:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002314f249 : new rpc_count 0
00000100:00000001:8.0:1773851872.118508:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851872.118509:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851872.118510:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.118511:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851872.118512:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000020:00000040:8.0:1773851872.118514:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000002314f249 : new refcount 4
00000100:00000001:8.0:1773851872.118515:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851872.118521:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851872.118522:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.118524:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24768@kfi7: PUT: OK
00000400:00000200:9.0:1773851872.118525:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000400:00000010:9.0:1773851872.118525:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000100:00000001:9.0:1773851872.118526:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851872.118527:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851872.118528:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000027caf9da nid 24768@kfi7 refs 2
00000800:00000200:9.0:1773851872.118529:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 24768@kfi7(00000000b8d63339):0x0 lsk 1301 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x514 Transaction freed
00000400:00000200:29.0:1773851872.137731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851872.137733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:9.0:1773851872.139861:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.139862:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.139864:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.139867:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.139870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24179@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.139872:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24179@kfi7 : PUT - for me
00000400:00000200:9.0:1773851872.139874:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24179@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.139876:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aeb26263 nid 24179@kfi7 refs 1
00000400:00000200:9.0:1773851872.139877:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24179@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.139878:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aeb26263 nid 24179@kfi7 refs 2
00000400:00000200:9.0:1773851872.139880:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aeb26263 nid 24179@kfi7 refs 3
00000400:00000200:9.0:1773851872.139881:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24178@kfi7 to cpt 7
00000400:00000200:9.0:1773851872.139883:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24178@kfi7 of length 224 into portal 12 MB=0x699e14118dc40
00000400:00000200:9.0:1773851872.139885:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24178@kfi7 of length 224/224 into md 0x78146ce49 [64] + 139624
00000800:00000200:9.0:1773851872.139888:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.139891:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.139892:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24179@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.139894:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.139894:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.139895:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5093b5f.
00000100:00000040:9.0:1773851872.139896:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c5093b5f x1858042599103552 msgsize 224
00000100:00100000:9.0:1773851872.139899:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24178@kfi7 (source: 12345-24179@kfi7)
00000100:00000001:9.0:1773851872.139901:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.139902:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aeb26263 nid 24179@kfi7 refs 2
00000100:00000001:8.0:1773851872.139903:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851872.139904:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851872.139904:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851872.139904:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851872.139905:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851872.139906:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.139907:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042599103552
00000020:00000001:8.0:1773851872.139908:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851872.139908:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ca1
00000020:00000001:8.0:1773851872.139909:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851872.139913:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000199848eb refcount=6
00000020:00000001:8.0:1773851872.139914:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744154112 : -107128965397504 : ffff9e9118128400)
00000020:00000001:8.0:1773851872.139915:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744154112 : -107128965397504 : ffff9e9118128400)
00000100:00000001:8.0:1773851872.139916:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.139917:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851872.139918:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000020:00000010:8.0:1773851872.139919:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.139920:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851872.139922:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851872.139922:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.139923:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851872.139924:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851872.139925:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851872.139925:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.139927:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851872.139928:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.139929:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851872.139929:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851872.139930:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851872.139931:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24178@kfi7, seq: 2130790
00000100:00000001:11.0:1773851872.139932:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.139932:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000199848eb : new rpc_count 1
00000100:00000001:8.0:1773851872.139932:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749181824 : -106947960369792 : ffff9ebb3cd00d80)
00000100:00000001:11.0:1773851872.139933:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.139934:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c5093b5f x1858042599103552/t0(0) o400->265f5980-9cd6-4129-aeeb-d386d2b6f7e5@24178@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1994-0'
00000100:00000001:8.0:1773851872.139939:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.139939:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851872.139940:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5093b5f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:265f5980-9cd6-4129-aeeb-d386d2b6f7e5+6:39662:x1858042599103552:12345-24178@kfi7:400:default-tuolumne1994-0
00000100:00000200:8.0:1773851872.139942:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042599103552
00000020:00000001:8.0:1773851872.139943:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851872.139944:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851872.139945:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.139946:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851872.139946:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851872.139947:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851872.139948:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042599103552, found 0 last_xid 1858042599103551
00000020:00000001:8.0:1773851872.139949:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851872.139950:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851872.139951:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851872.139951:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.139952:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851872.139953:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851872.139954:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851872.139955:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000025dffd82.
02000000:00000001:8.0:1773851872.139955:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.139956:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.139957:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851872.139958:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263921470, transno 0, xid 1858042599103552
00010000:00000001:8.0:1773851872.139959:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851872.139960:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c5093b5f x1858042599103552/t0(0) o400->265f5980-9cd6-4129-aeeb-d386d2b6f7e5@24178@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1994-0'
00010000:00000001:8.0:1773851872.139964:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851872.139965:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851872.139965:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851872.139967:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851872.139968:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b41cac0 refcount 3 to 24178@kfi7
00000100:00000001:8.0:1773851872.139969:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064224 : -107155994487392 : ffff9e8acd0355a0)
02000000:00000001:8.0:1773851872.139970:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851872.139971:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.139971:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851872.139972:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24179@kfi7
00000400:00000010:8.0:1773851872.139973:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042ed2e1b.
00000100:00000200:8.0:1773851872.139974:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042599103552, offset 224
00000400:00000200:8.0:1773851872.139976:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24179@kfi7
00000400:00000200:8.0:1773851872.139977:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24179@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.139979:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aeb26263 nid 24179@kfi7 refs 1
00000400:00000200:8.0:1773851872.139980:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aeb26263 nid 24179@kfi7 refs 2
00000400:00000200:8.0:1773851872.139982:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aeb26263 nid 24179@kfi7 refs 3
00000400:00000200:8.0:1773851872.139983:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24179@kfi7 local destination
00000400:00000200:8.0:1773851872.139985:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769394:8769394:1024:4294967295] 24179@kfi7 LPNI seq info [7449344:7449344:16:4294967295]
00000400:00000200:8.0:1773851872.139987:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aeb26263 nid 24179@kfi7 refs 2
00000400:00000200:8.0:1773851872.139989:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24179@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.139992:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24179@kfi7(24179@kfi7:24179@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851872.139994:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aeb26263 nid 24179@kfi7 refs 3
00000800:00000200:8.0:1773851872.139996:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851872.139997:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851872.140001:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851872.140004:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa97 Using peer 24179@kfi7(0xa97)
00000800:00000200:8.0:1773851872.140008:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0xa97: rc=0
00000800:00000200:8.0:1773851872.140010:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa97 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851872.140013:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.140014:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b41cac0 refcount 2 to 24178@kfi7
00010000:00000001:8.0:1773851872.140015:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851872.140015:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.140016:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851872.140018:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5093b5f x1858042599103552/t0(0) o400->265f5980-9cd6-4129-aeeb-d386d2b6f7e5@24178@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1994-0'
00000100:00100000:8.0:1773851872.140022:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5093b5f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:265f5980-9cd6-4129-aeeb-d386d2b6f7e5+6:39662:x1858042599103552:12345-24178@kfi7:400:default-tuolumne1994-0 Request processed in 83us (125us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851872.140026:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24178@kfi7, seq: 2130790
00000100:00000040:8.0:1773851872.140027:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000199848eb : new rpc_count 0
00000100:00000001:8.0:1773851872.140028:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851872.140028:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851872.140029:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.140030:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851872.140031:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000020:00000040:8.0:1773851872.140032:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000199848eb : new refcount 5
00000100:00000001:8.0:1773851872.140033:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851872.140040:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa97 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851872.140046:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.140048:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24179@kfi7: PUT: OK
00000400:00000200:9.0:1773851872.140049:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042ed2e1b
00000400:00000010:9.0:1773851872.140049:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042ed2e1b.
00000100:00000001:9.0:1773851872.140050:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851872.140051:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851872.140052:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aeb26263 nid 24179@kfi7 refs 2
00000800:00000200:9.0:1773851872.140054:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 24179@kfi7(000000002afc1206):0x0 lsk 2712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xa97 Transaction freed
00000800:00000200:25.0:1773851872.154767:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.154768:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.154769:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.154771:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851872.154773:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.154775:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20544@kfi7 : PUT - for me
00000400:00000200:25.0:1773851872.154776:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.154777:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c9964ab nid 20544@kfi7 refs 1
00000400:00000200:25.0:1773851872.154778:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.154779:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c9964ab nid 20544@kfi7 refs 2
00000400:00000200:25.0:1773851872.154780:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007c9964ab nid 20544@kfi7 refs 3
00000400:00000200:25.0:1773851872.154781:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.154782:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20544@kfi7 of length 224 into portal 12 MB=0x69b095c15e040
00000400:00000200:25.0:1773851872.154783:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20544@kfi7 of length 224/224 into md 0x16159c9699 [64] + 17584
00000800:00000200:25.0:1773851872.154785:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851872.154787:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.154788:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20544@kfi7: PUT: OK
00000100:00000001:25.0:1773851872.154789:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851872.154789:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851872.154790:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000097ec637e.
00000100:00000040:25.0:1773851872.154791:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000097ec637e x1859314362212416 msgsize 224
00000100:00100000:25.0:1773851872.154793:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20544@kfi7 (source: 12345-20544@kfi7)
00000100:00000001:25.0:1773851872.154794:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851872.154795:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007c9964ab nid 20544@kfi7 refs 2
00000800:00000200:25.0:1773851872.154798:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2069@kfi7:6 <- 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851872.154802:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851872.154803:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851872.154804:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851872.154805:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851872.154806:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851872.154807:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314362212416
00000020:00000001:25.0:1773851872.154808:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851872.154809:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913b1
00000020:00000001:25.0:1773851872.154810:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851872.154815:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000726627f5 refcount=6
00000020:00000001:25.0:1773851872.154816:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169320448 : -107127540231168 : ffff9e916d04d400)
00000020:00000001:25.0:1773851872.154817:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169320448 : -107127540231168 : ffff9e916d04d400)
00000100:00000001:25.0:1773851872.154819:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851872.154820:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851872.154822:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:25.0:1773851872.154824:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851872.154825:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000034009ab4.
00000100:00000001:25.0:1773851872.154827:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851872.154828:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851872.154829:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851872.154831:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851872.154831:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851872.154832:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.154834:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851872.154835:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851872.154836:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851872.154836:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851872.154836:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851872.154837:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20544@kfi7, seq: 2025111
00000100:00000040:26.0:1773851872.154838:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000726627f5 : new rpc_count 1
00000100:00000001:25.0:1773851872.154838:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.154839:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165942130688 : -106907767420928 : ffff9ec4987fc800)
00000100:00000001:25.0:1773851872.154839:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851872.154841:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000097ec637e x1859314362212416/t0(0) o400->23c2ed9c-7f36-452d-a2f3-c7de6cd96062@20544@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1780-0'
00000100:00000001:26.0:1773851872.154845:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851872.154845:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851872.154846:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000097ec637e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:23c2ed9c-7f36-452d-a2f3-c7de6cd96062+6:39890:x1859314362212416:12345-20544@kfi7:400:default-tuolumne1780-0
00000100:00000200:26.0:1773851872.154848:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314362212416
00000020:00000001:26.0:1773851872.154849:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851872.154850:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851872.154850:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.154851:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851872.154852:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851872.154852:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851872.154853:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314362212416, found 0 last_xid 1859314362212415
00000020:00000001:26.0:1773851872.154854:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851872.154854:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851872.154855:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851872.154855:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.154856:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851872.154857:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851872.154857:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851872.154858:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cf433d41.
02000000:00000001:26.0:1773851872.154859:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.154859:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.154860:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851872.154861:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314362212416
00010000:00000001:26.0:1773851872.154862:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851872.154862:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000097ec637e x1859314362212416/t0(0) o400->23c2ed9c-7f36-452d-a2f3-c7de6cd96062@20544@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1780-0'
00010000:00000001:26.0:1773851872.154865:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851872.154865:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851872.154866:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=105 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851872.154867:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851872.154868:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d02b961 refcount 5 to 20544@kfi7
00000100:00000001:26.0:1773851872.154869:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923993437888 : -107149716113728 : ffff9e8c433bb6c0)
02000000:00000001:26.0:1773851872.154870:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851872.154870:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.154871:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851872.154872:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20544@kfi7
00000400:00000010:26.0:1773851872.154873:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000909b9a2b.
00000100:00000200:26.0:1773851872.154874:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314362212416, offset 224
00000400:00000200:26.0:1773851872.154875:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20544@kfi7
00000400:00000200:26.0:1773851872.154876:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:26.0:1773851872.154877:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c9964ab nid 20544@kfi7 refs 1
00000400:00000200:26.0:1773851872.154878:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007c9964ab nid 20544@kfi7 refs 2
00000400:00000200:26.0:1773851872.154879:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007c9964ab nid 20544@kfi7 refs 3
00000400:00000200:26.0:1773851872.154880:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20544@kfi7 local destination
00000400:00000200:26.0:1773851872.154881:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769395:8769395:1024:4294967295] 20544@kfi7 LPNI seq info [1323080:1323080:16:4294967295]
00000400:00000200:26.0:1773851872.154883:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007c9964ab nid 20544@kfi7 refs 2
00000400:00000200:26.0:1773851872.154884:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:26.0:1773851872.154886:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20544@kfi7(20544@kfi7:20544@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851872.154887:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007c9964ab nid 20544@kfi7 refs 3
00000800:00000200:26.0:1773851872.154889:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851872.154890:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851872.154892:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851872.154894:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x49e Using peer 20544@kfi7(0x49e)
00000800:00000200:26.0:1773851872.154897:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x49e: rc=0
00000800:00000200:26.0:1773851872.154899:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x49e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851872.154901:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851872.154902:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d02b961 refcount 4 to 20544@kfi7
00010000:00000001:26.0:1773851872.154903:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851872.154904:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.154904:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851872.154905:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000097ec637e x1859314362212416/t0(0) o400->23c2ed9c-7f36-452d-a2f3-c7de6cd96062@20544@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1780-0'
00000100:00100000:26.0:1773851872.154908:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000097ec637e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:23c2ed9c-7f36-452d-a2f3-c7de6cd96062+6:39890:x1859314362212416:12345-20544@kfi7:400:default-tuolumne1780-0 Request processed in 62us (116us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851872.154911:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20544@kfi7, seq: 2025111
00000100:00000040:26.0:1773851872.154911:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000726627f5 : new rpc_count 0
00000100:00000001:26.0:1773851872.154912:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851872.154912:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x49e TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851872.154913:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851872.154913:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:26.0:1773851872.154914:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000034009ab4.
00000020:00000010:26.0:1773851872.154915:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:26.0:1773851872.154916:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000726627f5 : new refcount 5
00000100:00000001:26.0:1773851872.154917:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851872.154918:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.154920:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20544@kfi7: PUT: OK
00000400:00000200:25.0:1773851872.154922:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000909b9a2b
00000400:00000010:25.0:1773851872.154923:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000909b9a2b.
00000100:00000001:25.0:1773851872.154924:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851872.154925:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851872.154926:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007c9964ab nid 20544@kfi7 refs 2
00000800:00000200:25.0:1773851872.154929:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 20544@kfi7(00000000d532f3bc):0x0 lsk 1183 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x49e Transaction freed
00000800:00000200:9.0:1773851872.214427:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.214428:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.214429:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.214431:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.214433:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13474@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.214435:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13474@kfi7 : PUT - for me
00000400:00000200:9.0:1773851872.214436:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13474@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.214437:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e9e5c97 nid 13474@kfi7 refs 1
00000400:00000200:9.0:1773851872.214438:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13474@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.214439:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e9e5c97 nid 13474@kfi7 refs 2
00000400:00000200:9.0:1773851872.214440:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009e9e5c97 nid 13474@kfi7 refs 3
00000400:00000200:9.0:1773851872.214440:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13410@kfi7 to cpt 7
00000400:00000200:9.0:1773851872.214441:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13410@kfi7 of length 224 into portal 12 MB=0x699e15fab89c0
00000400:00000200:9.0:1773851872.214443:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13410@kfi7 of length 224/224 into md 0x78146ce49 [64] + 139848
00000800:00000200:9.0:1773851872.214445:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.214446:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.214447:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13474@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.214448:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.214449:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.214452:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000f8fcabb.
00000100:00000040:9.0:1773851872.214452:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000000f8fcabb x1858043112032704 msgsize 224
00000100:00100000:9.0:1773851872.214454:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13410@kfi7 (source: 12345-13474@kfi7)
00000100:00000001:9.0:1773851872.214455:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.214455:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009e9e5c97 nid 13474@kfi7 refs 2
00000100:00000001:8.0:1773851872.214456:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851872.214457:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851872.214457:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851872.214457:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851872.214457:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851872.214458:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.214459:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043112032704
00000020:00000001:8.0:1773851872.214459:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851872.214460:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b91
00000020:00000001:8.0:1773851872.214460:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851872.214462:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000007c7bb7c refcount=6
00000020:00000001:8.0:1773851872.214463:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628031488 : -107123081520128 : ffff9e9276c75c00)
00000020:00000001:8.0:1773851872.214463:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628031488 : -107123081520128 : ffff9e9276c75c00)
00000100:00000001:8.0:1773851872.214464:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.214465:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851872.214465:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000020:00000010:8.0:1773851872.214466:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.214467:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851872.214468:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851872.214468:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.214469:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851872.214469:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851872.214470:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851872.214470:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.214471:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.214472:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851872.214472:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.214473:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851872.214473:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851872.214474:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.214474:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13410@kfi7, seq: 2130791
00000100:00000040:8.0:1773851872.214474:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000007c7bb7c : new rpc_count 1
00000100:00000001:11.0:1773851872.214475:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.214475:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749201408 : -106947960350208 : ffff9ebb3cd05a00)
00000100:00000040:8.0:1773851872.214476:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000f8fcabb x1858043112032704/t0(0) o400->fab45fd5-fd5b-4cc5-be8c-1ece74e753e1@13410@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1324-0'
00000100:00000001:8.0:1773851872.214478:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.214479:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851872.214480:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f8fcabb pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:fab45fd5-fd5b-4cc5-be8c-1ece74e753e1+6:39810:x1858043112032704:12345-13410@kfi7:400:default-tuolumne1324-0
00000100:00000200:8.0:1773851872.214481:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043112032704
00000020:00000001:8.0:1773851872.214482:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851872.214482:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851872.214483:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.214484:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851872.214484:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851872.214485:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851872.214486:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043112032704, found 0 last_xid 1858043112032703
00000020:00000001:8.0:1773851872.214486:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851872.214487:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851872.214488:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851872.214488:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.214489:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851872.214489:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851872.214490:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851872.214491:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000044236763.
02000000:00000001:8.0:1773851872.214491:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.214492:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.214492:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851872.214493:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690946284, transno 0, xid 1858043112032704
00010000:00000001:8.0:1773851872.214494:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851872.214495:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000f8fcabb x1858043112032704/t0(0) o400->fab45fd5-fd5b-4cc5-be8c-1ece74e753e1@13410@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1324-0'
00010000:00000001:8.0:1773851872.214497:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851872.214498:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851872.214498:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851872.214499:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851872.214500:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009fdf4e30 refcount 3 to 13410@kfi7
00000100:00000001:8.0:1773851872.214501:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805216 : -107130477746400 : ffff9e90bdede720)
02000000:00000001:8.0:1773851872.214502:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851872.214502:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.214503:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851872.214503:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13474@kfi7
00000400:00000010:8.0:1773851872.214504:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3e9aeb1.
00000100:00000200:8.0:1773851872.214505:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043112032704, offset 224
00000400:00000200:8.0:1773851872.214506:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13474@kfi7
00000400:00000200:8.0:1773851872.214507:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13474@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.214508:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e9e5c97 nid 13474@kfi7 refs 1
00000400:00000200:8.0:1773851872.214509:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009e9e5c97 nid 13474@kfi7 refs 2
00000400:00000200:8.0:1773851872.214510:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009e9e5c97 nid 13474@kfi7 refs 3
00000400:00000200:8.0:1773851872.214511:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13474@kfi7 local destination
00000400:00000200:8.0:1773851872.214513:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769396:8769396:1024:4294967295] 13474@kfi7 LPNI seq info [478793:478793:16:4294967295]
00000400:00000200:8.0:1773851872.214514:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009e9e5c97 nid 13474@kfi7 refs 2
00000400:00000200:8.0:1773851872.214515:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13474@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.214517:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13474@kfi7(13474@kfi7:13474@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851872.214518:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009e9e5c97 nid 13474@kfi7 refs 3
00000800:00000200:8.0:1773851872.214519:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851872.214520:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851872.214522:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851872.214524:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11db Using peer 13474@kfi7(0x11db)
00000800:00000200:8.0:1773851872.214527:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x11db: rc=0
00000800:00000200:8.0:1773851872.214528:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11db TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851872.214530:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.214531:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009fdf4e30 refcount 2 to 13410@kfi7
00010000:00000001:8.0:1773851872.214532:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851872.214532:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.214533:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851872.214534:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000f8fcabb x1858043112032704/t0(0) o400->fab45fd5-fd5b-4cc5-be8c-1ece74e753e1@13410@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1324-0'
00000100:00100000:8.0:1773851872.214537:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f8fcabb pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:fab45fd5-fd5b-4cc5-be8c-1ece74e753e1+6:39810:x1858043112032704:12345-13410@kfi7:400:default-tuolumne1324-0 Request processed in 58us (84us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851872.214539:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13410@kfi7, seq: 2130791
00000100:00000040:8.0:1773851872.214540:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000007c7bb7c : new rpc_count 0
00000100:00000001:8.0:1773851872.214541:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851872.214541:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851872.214542:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.214543:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851872.214544:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000020:00000040:8.0:1773851872.214544:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000007c7bb7c : new refcount 5
00000100:00000001:8.0:1773851872.214545:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851872.214549:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11db TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851872.214551:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.214553:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13474@kfi7: PUT: OK
00000400:00000200:9.0:1773851872.214554:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3e9aeb1
00000400:00000010:9.0:1773851872.214554:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3e9aeb1.
00000100:00000001:9.0:1773851872.214555:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851872.214555:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851872.214556:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009e9e5c97 nid 13474@kfi7 refs 2
00000800:00000200:9.0:1773851872.214558:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13474@kfi7(0000000054f06de7):0x0 lsk 4572 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x11db Transaction freed
00000800:00000200:29.0:1773851872.258864:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851872.258866:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851872.258879:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851872.258883:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851872.258886:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851872.258889:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 37@kfi7 : PUT - for me
00000400:00000200:29.0:1773851872.258890:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851872.258892:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:29.0:1773851872.258893:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851872.258894:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:29.0:1773851872.258896:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:29.0:1773851872.258897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851872.258899:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 224 into portal 12 MB=0x699e0e5189940
00000400:00000200:29.0:1773851872.258901:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-37@kfi7 of length 224/224 into md 0x77fe139dd [64] + 181712
00000800:00000200:29.0:1773851872.258904:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851872.258907:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851872.258909:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000100:00000001:29.0:1773851872.258910:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851872.258911:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851872.258912:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d0626453.
00000100:00000040:29.0:1773851872.258914:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000d0626453 x1858041055582528 msgsize 224
00000100:00100000:29.0:1773851872.258916:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-37@kfi7 (source: 12345-37@kfi7)
00000100:00000001:29.0:1773851872.258918:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851872.258919:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:28.0:1773851872.258921:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851872.258922:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851872.258922:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851872.258922:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851872.258923:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851872.258925:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851872.258926:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041055582528
00000020:00000001:28.0:1773851872.258927:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851872.258928:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acf87db
00000020:00000001:28.0:1773851872.258929:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851872.258932:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bfda5de5 refcount=5
00000020:00000001:28.0:1773851872.258933:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636925751487488 : -107147958064128 : ffff9e8cac056c00)
00000020:00000001:28.0:1773851872.258935:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636925751487488 : -107147958064128 : ffff9e8cac056c00)
00000100:00000001:28.0:1773851872.258936:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851872.258937:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851872.258938:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6bd80eb.
00000020:00000010:28.0:1773851872.258940:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851872.258941:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e7920c9c.
00000100:00000001:28.0:1773851872.258943:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851872.258944:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851872.258945:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851872.258947:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851872.258948:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851872.258949:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.258950:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851872.258952:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851872.258953:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851872.258953:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851872.258953:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851872.258954:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-37@kfi7, seq: 2055532
00000100:00000040:31.0:1773851872.258955:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bfda5de5 : new rpc_count 1
00000100:00000001:28.0:1773851872.258955:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.258956:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309669888 : -106988399881728 : ffff9eb1d26e1200)
00000100:00000001:28.0:1773851872.258956:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851872.258957:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d0626453 x1858041055582528/t0(0) o400->lustre5-MDT0001-lwp-OST0002_UUID@37@kfi7:660/0 lens 224/0 e 0 to 0 dl 1773852020 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba103-0'
00000100:00000001:31.0:1773851872.258960:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851872.258960:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851872.258961:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d0626453 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0002_UUID+5:272678:x1858041055582528:12345-37@kfi7:400:default-yuba103-0
00000100:00000200:31.0:1773851872.258963:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041055582528
00000020:00000001:31.0:1773851872.258964:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851872.258964:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851872.258965:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.258966:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851872.258967:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851872.258967:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:31.0:1773851872.258968:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851872.258969:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851872.258970:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851872.258970:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.258971:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851872.258972:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851872.258972:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851872.258973:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000055961172.
02000000:00000001:31.0:1773851872.258974:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.258975:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.258976:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851872.258977:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041055582528
00010000:00000001:31.0:1773851872.258978:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851872.258979:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d0626453 x1858041055582528/t0(0) o400->lustre5-MDT0001-lwp-OST0002_UUID@37@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba103-0'
00010000:00000001:31.0:1773851872.258982:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851872.258983:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851872.258984:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=105 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851872.258985:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851872.258986:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000f806a02 refcount 7 to 37@kfi7
00000100:00000001:31.0:1773851872.258987:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065856 : -107155994485760 : ffff9e8acd035c00)
02000000:00000001:31.0:1773851872.258988:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851872.258989:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.258989:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851872.258990:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000400:00000010:31.0:1773851872.258991:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000030edd6e9.
00000100:00000200:31.0:1773851872.258992:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041055582528, offset 224
00000400:00000200:31.0:1773851872.258994:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000400:00000200:31.0:1773851872.258995:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:31.0:1773851872.258996:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:31.0:1773851872.258997:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:31.0:1773851872.258998:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:31.0:1773851872.258999:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  37@kfi7 local destination
00000400:00000200:31.0:1773851872.259001:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769397:8769397:1024:4294967295] 37@kfi7 LPNI seq info [5403394:5403394:16:4294967295]
00000400:00000200:31.0:1773851872.259003:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:31.0:1773851872.259003:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:31.0:1773851872.259006:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851872.259007:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000800:00000200:31.0:1773851872.259009:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851872.259010:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851872.259013:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851872.259016:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001a4 Using peer 37@kfi7(0x2000000000001a4)
00000800:00000200:31.0:1773851872.259019:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x2000000000001a4: rc=0
00000800:00000200:31.0:1773851872.259021:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851872.259024:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851872.259025:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000f806a02 refcount 6 to 37@kfi7
00010000:00000001:31.0:1773851872.259026:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851872.259026:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.259027:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851872.259028:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d0626453 x1858041055582528/t0(0) o400->lustre5-MDT0001-lwp-OST0002_UUID@37@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba103-0'
00000100:00100000:31.0:1773851872.259031:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d0626453 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0002_UUID+5:272678:x1858041055582528:12345-37@kfi7:400:default-yuba103-0 Request processed in 71us (117us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851872.259035:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-37@kfi7, seq: 2055532
00000100:00000040:31.0:1773851872.259035:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bfda5de5 : new rpc_count 0
00000100:00000001:31.0:1773851872.259036:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851872.259037:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851872.259037:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001a4 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851872.259038:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851872.259039:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e7920c9c.
00000020:00000010:31.0:1773851872.259040:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6bd80eb.
00000020:00000040:31.0:1773851872.259040:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000bfda5de5 : new refcount 4
00000400:00000200:29.0:1773851872.259040:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851872.259041:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851872.259042:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000400:00000200:29.0:1773851872.259043:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000030edd6e9
00000400:00000010:29.0:1773851872.259045:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000030edd6e9.
00000100:00000001:29.0:1773851872.259046:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851872.259047:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851872.259048:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000800:00000200:29.0:1773851872.259051:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001a4 Transaction freed
00000800:00000200:2.0:1773851872.270541:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851872.270541:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851872.270542:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:1.0:1773851872.270542:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851872.270543:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:1.0:1773851872.270543:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851872.270546:0:2506505:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25744@kfi7(000000001419d740):0x305 version: 2; local version 2; negotiated version: 2
00000800:00000200:1.0:1773851872.270546:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:2.0:1773851872.270548:0:2506505:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 Using peer 25744@kfi7(0x305)
00000400:00000200:1.0:1773851872.270548:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25744@kfi7 to cpt 0
00000400:00000200:2.0:1773851872.270549:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25744@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.270549:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25744@kfi7 : PUT - for me
00000400:00000200:1.0:1773851872.270550:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25744@kfi7 to cpt 0
00000800:00000200:2.0:1773851872.270551:0:2506505:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000014e57432: Posted send of 38 bytes to peer 0x305: rc=0
00000400:00000200:1.0:1773851872.270551:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 1
00000400:00000200:1.0:1773851872.270552:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25744@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.270552:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 2
00000800:00000200:2.0:1773851872.270553:0:2506505:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:1.0:1773851872.270553:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 3
00000400:00000200:1.0:1773851872.270554:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25744@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.270555:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25744@kfi7 of length 224 into portal 12 MB=0x69a9cbc59ad00
00000400:00000200:1.0:1773851872.270556:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25744@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 31848
00000800:00000200:1.0:1773851872.270558:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851872.270559:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851872.270561:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25744@kfi7: PUT: OK
00000100:00000001:1.0:1773851872.270562:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851872.270562:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851872.270563:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc021c61.
00000100:00000040:1.0:1773851872.270564:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000cc021c61 x1858847825833216 msgsize 224
00000800:00000200:2.0:1773851872.270565:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851872.270565:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25744@kfi7 (source: 12345-25744@kfi7)
00000100:00000001:1.0:1773851872.270566:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:2.0:1773851872.270567:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000014e57432: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 Transaction freed
00000400:00000200:1.0:1773851872.270567:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 2
00000800:00000200:1.0:1773851872.270568:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851872.270568:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851872.270568:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851872.270569:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851872.270569:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851872.270570:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851872.270571:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858847825833216
00000020:00000001:0.0:1773851872.270571:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851872.270572:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92967
00000020:00000001:0.0:1773851872.270572:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851872.270574:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fe0afe51 refcount=6
00000020:00000001:0.0:1773851872.270575:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743200768 : -107128966350848 : ffff9e911803f800)
00000020:00000001:0.0:1773851872.270576:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743200768 : -107128966350848 : ffff9e911803f800)
00000100:00000001:0.0:1773851872.270577:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851872.270577:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851872.270578:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000210fcb46.
00000020:00000010:0.0:1773851872.270579:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851872.270580:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851872.270581:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851872.270581:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851872.270582:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851872.270583:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851872.270583:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851872.270584:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.270584:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851872.270586:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851872.270586:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851872.270586:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851872.270586:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851872.270587:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25744@kfi7, seq: 1997569
00000100:00000001:1.0:1773851872.270588:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851872.270588:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fe0afe51 : new rpc_count 1
00000100:00000001:1.0:1773851872.270589:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.270589:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599731840 : -107004109819776 : ffff9eae2a0b7080)
00000100:00000040:0.0:1773851872.270590:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cc021c61 x1858847825833216/t0(0) o400->ef6beeb3-005f-4a9b-b145-e9fcb55178b9@25744@kfi7:512/0 lens 224/0 e 0 to 0 dl 1773852627 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2098-0'
00000100:00000001:0.0:1773851872.270593:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851872.270593:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851872.270594:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc021c61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ef6beeb3-005f-4a9b-b145-e9fcb55178b9+6:39780:x1858847825833216:12345-25744@kfi7:400:default-tuolumne2098-0
00000100:00000200:0.0:1773851872.270595:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858847825833216
00000020:00000001:0.0:1773851872.270596:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851872.270596:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851872.270597:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.270597:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851872.270598:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851872.270599:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851872.270599:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858847825833216, found 0 last_xid 1858847825833215
00000020:00000001:0.0:1773851872.270600:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851872.270601:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851872.270601:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851872.270602:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.270602:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851872.270603:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851872.270603:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851872.270604:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eccd9a8a.
02000000:00000001:0.0:1773851872.270605:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.270605:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.270606:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851872.270607:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106588447, transno 0, xid 1858847825833216
00010000:00000001:0.0:1773851872.270608:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851872.270608:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cc021c61 x1858847825833216/t0(0) o400->ef6beeb3-005f-4a9b-b145-e9fcb55178b9@25744@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2098-0'
00010000:00000001:0.0:1773851872.270611:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851872.270611:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851872.270612:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=105 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851872.270613:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851872.270614:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c608f4c4 refcount 3 to 25744@kfi7
00000100:00000001:0.0:1773851872.270615:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052448 : -107154804499168 : ffff9e8b13f11d20)
02000000:00000001:0.0:1773851872.270615:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851872.270616:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.270617:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851872.270617:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25744@kfi7
00000400:00000010:0.0:1773851872.270618:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c2d69e3.
00000100:00000200:0.0:1773851872.270619:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858847825833216, offset 224
00000400:00000200:0.0:1773851872.270620:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25744@kfi7
00000400:00000200:0.0:1773851872.270621:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25744@kfi7 to cpt 0
00000400:00000200:0.0:1773851872.270621:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 1
00000400:00000200:0.0:1773851872.270622:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 2
00000400:00000200:0.0:1773851872.270623:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 3
00000400:00000200:0.0:1773851872.270624:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25744@kfi7 local destination
00000400:00000200:0.0:1773851872.270626:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769398:8769398:1024:4294967295] 25744@kfi7 LPNI seq info [110939:110939:16:4294967295]
00000400:00000200:0.0:1773851872.270627:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 2
00000400:00000200:0.0:1773851872.270628:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25744@kfi7 to cpt 0
00000400:00000200:0.0:1773851872.270630:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25744@kfi7(25744@kfi7:25744@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851872.270631:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 3
00000800:00000200:0.0:1773851872.270632:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851872.270633:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851872.270635:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851872.270637:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 Using peer 25744@kfi7(0x305)
00000800:00000200:0.0:1773851872.270640:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x305: rc=0
00000800:00000200:0.0:1773851872.270641:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851872.270644:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851872.270645:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c608f4c4 refcount 2 to 25744@kfi7
00010000:00000001:0.0:1773851872.270646:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851872.270646:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.270647:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851872.270648:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc021c61 x1858847825833216/t0(0) o400->ef6beeb3-005f-4a9b-b145-e9fcb55178b9@25744@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2098-0'
00000100:00100000:0.0:1773851872.270652:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc021c61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:ef6beeb3-005f-4a9b-b145-e9fcb55178b9+6:39780:x1858847825833216:12345-25744@kfi7:400:default-tuolumne2098-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851872.270654:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25744@kfi7, seq: 1997569
00000100:00000040:0.0:1773851872.270655:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fe0afe51 : new rpc_count 0
00000100:00000001:0.0:1773851872.270656:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851872.270656:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851872.270657:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851872.270657:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851872.270658:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000210fcb46.
00000020:00000040:0.0:1773851872.270659:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000fe0afe51 : new refcount 5
00000100:00000001:0.0:1773851872.270660:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851872.270664:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851872.270666:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851872.270667:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25744@kfi7: PUT: OK
00000400:00000200:1.0:1773851872.270668:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c2d69e3
00000400:00000010:1.0:1773851872.270668:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c2d69e3.
00000100:00000001:1.0:1773851872.270669:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851872.270669:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851872.270670:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aba1e8d0 nid 25744@kfi7 refs 2
00000800:00000200:1.0:1773851872.270671:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 25744@kfi7(000000001419d740):0x0 lsk 774 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x305 Transaction freed
00000800:00000200:3.0:1773851872.345667:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851872.345668:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851872.345669:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851872.345671:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851872.345673:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9169@kfi7 to cpt 0
00000400:00000200:3.0:1773851872.345675:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9169@kfi7 : PUT - for me
00000400:00000200:3.0:1773851872.345675:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9169@kfi7 to cpt 0
00000400:00000200:3.0:1773851872.345676:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc939f84 nid 9169@kfi7 refs 1
00000400:00000200:3.0:1773851872.345677:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9169@kfi7 to cpt 0
00000400:00000200:3.0:1773851872.345677:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc939f84 nid 9169@kfi7 refs 2
00000400:00000200:3.0:1773851872.345678:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dc939f84 nid 9169@kfi7 refs 3
00000400:00000200:3.0:1773851872.345679:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8976@kfi7 to cpt 2
00000400:00000200:3.0:1773851872.345680:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8976@kfi7 of length 224 into portal 12 MB=0x69b4646714d80
00000400:00000200:3.0:1773851872.345681:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8976@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 32072
00000800:00000200:3.0:1773851872.345682:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851872.345684:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851872.345685:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9169@kfi7: PUT: OK
00000100:00000001:3.0:1773851872.345686:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851872.345686:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851872.345687:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000098d65e5.
00000100:00000040:3.0:1773851872.345687:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000098d65e5 x1859575992110464 msgsize 224
00000100:00100000:3.0:1773851872.345688:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-8976@kfi7 (source: 12345-9169@kfi7)
00000100:00000001:3.0:1773851872.345689:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851872.345690:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc939f84 nid 9169@kfi7 refs 2
00000800:00000200:3.0:1773851872.345691:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851872.345691:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851872.345691:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851872.345691:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851872.345692:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851872.345692:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851872.345693:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575992110464
00000020:00000001:0.0:1773851872.345693:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851872.345694:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc1622e9f
00000020:00000001:0.0:1773851872.345694:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851872.345696:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000086279217 refcount=317
00000020:00000001:0.0:1773851872.345696:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083209987072 : -106990499564544 : ffff9eb155477400)
00000020:00000001:0.0:1773851872.345697:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637083209987072 : -106990499564544 : ffff9eb155477400)
00000100:00000001:0.0:1773851872.345698:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851872.345699:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851872.345699:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000210fcb46.
00000020:00000010:0.0:1773851872.345700:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851872.345700:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851872.345701:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851872.345701:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851872.345702:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851872.345703:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851872.345703:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851872.345703:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.345704:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851872.345705:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851872.345705:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851872.345706:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851872.345706:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851872.345706:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8976@kfi7, seq: 1997570
00000100:00000001:1.0:1773851872.345707:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851872.345707:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000086279217 : new rpc_count 2
00000100:00000001:1.0:1773851872.345708:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.345708:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288704768 : -106964420846848 : ffff9eb767b11b00)
00000100:00000040:0.0:1773851872.345709:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000098d65e5 x1859575992110464/t0(0) o400->b1cfec29-22ea-447f-8b0c-24c7af98fa16@8976@kfi7:512/0 lens 224/0 e 0 to 0 dl 1773852627 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1057-0'
00000100:00000001:0.0:1773851872.345711:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851872.345711:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851872.345712:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000098d65e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:b1cfec29-22ea-447f-8b0c-24c7af98fa16+317:40004:x1859575992110464:12345-8976@kfi7:400:default-tuolumne1057-0
00000100:00000200:0.0:1773851872.345713:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575992110464
00000020:00000001:0.0:1773851872.345714:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851872.345714:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851872.345715:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.345715:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851872.345716:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851872.345716:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851872.345717:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575992110464, found 0 last_xid 1859575986593535
00000020:00000001:0.0:1773851872.345717:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851872.345718:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851872.345718:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851872.345718:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.345719:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851872.345720:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851872.345720:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851872.345721:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d67bc411.
02000000:00000001:0.0:1773851872.345722:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.345722:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.345722:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851872.345723:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260756302, transno 0, xid 1859575992110464
00010000:00000001:0.0:1773851872.345724:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851872.345727:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000098d65e5 x1859575992110464/t0(0) o400->b1cfec29-22ea-447f-8b0c-24c7af98fa16@8976@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1057-0'
00010000:00000001:0.0:1773851872.345730:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851872.345730:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851872.345731:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=105 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851872.345731:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851872.345732:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d9e7d142 refcount 3 to 8976@kfi7
00000100:00000001:0.0:1773851872.345733:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551676128 : -107156157875488 : ffff9e8ac3463ae0)
02000000:00000001:0.0:1773851872.345733:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851872.345733:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.345734:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851872.345735:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9169@kfi7
00000400:00000010:0.0:1773851872.345735:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000485e1abd.
00000100:00000200:0.0:1773851872.345736:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575992110464, offset 224
00000400:00000200:0.0:1773851872.345737:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9169@kfi7
00000400:00000200:0.0:1773851872.345738:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9169@kfi7 to cpt 0
00000400:00000200:0.0:1773851872.345738:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc939f84 nid 9169@kfi7 refs 1
00000400:00000200:0.0:1773851872.345739:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dc939f84 nid 9169@kfi7 refs 2
00000400:00000200:0.0:1773851872.345740:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dc939f84 nid 9169@kfi7 refs 3
00000400:00000200:0.0:1773851872.345741:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9169@kfi7 local destination
00000400:00000200:0.0:1773851872.345742:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769399:8769399:1024:4294967295] 9169@kfi7 LPNI seq info [2165997:2165997:16:4294967295]
00000400:00000200:0.0:1773851872.345744:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dc939f84 nid 9169@kfi7 refs 2
00000400:00000200:0.0:1773851872.345744:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9169@kfi7 to cpt 0
00000400:00000200:0.0:1773851872.345746:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9169@kfi7(9169@kfi7:9169@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851872.345747:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dc939f84 nid 9169@kfi7 refs 3
00000800:00000200:0.0:1773851872.345749:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851872.345750:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851872.345751:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851872.345753:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fde Using peer 9169@kfi7(0x100000000000fde)
00000800:00000200:0.0:1773851872.345756:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x100000000000fde: rc=0
00000800:00000200:0.0:1773851872.345758:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fde TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851872.345759:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851872.345760:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d9e7d142 refcount 2 to 8976@kfi7
00010000:00000001:0.0:1773851872.345761:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851872.345761:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.345762:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851872.345762:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000098d65e5 x1859575992110464/t0(0) o400->b1cfec29-22ea-447f-8b0c-24c7af98fa16@8976@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1057-0'
00000100:00100000:0.0:1773851872.345765:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000098d65e5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:b1cfec29-22ea-447f-8b0c-24c7af98fa16+317:40004:x1859575992110464:12345-8976@kfi7:400:default-tuolumne1057-0 Request processed in 53us (77us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851872.345769:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8976@kfi7, seq: 1997570
00000100:00000040:0.0:1773851872.345769:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000086279217 : new rpc_count 1
00000100:00000001:0.0:1773851872.345770:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851872.345770:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851872.345770:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851872.345771:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851872.345772:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000210fcb46.
00000020:00000040:0.0:1773851872.345772:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000086279217 : new refcount 316
00000100:00000001:0.0:1773851872.345773:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851872.345778:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fde TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851872.345779:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851872.345780:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9169@kfi7: PUT: OK
00000400:00000200:1.0:1773851872.345781:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000485e1abd
00000400:00000010:1.0:1773851872.345781:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000485e1abd.
00000100:00000001:1.0:1773851872.345782:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851872.345782:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851872.345783:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc939f84 nid 9169@kfi7 refs 2
00000800:00000200:1.0:1773851872.345785:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9169@kfi7(000000000e904076):0x0 lsk 4063 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fde Transaction freed
00000800:00000200:9.0:1773851872.346946:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.346947:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.346948:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.346950:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.346952:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13809@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.346954:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13809@kfi7 : PUT - for me
00000400:00000200:9.0:1773851872.346955:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13809@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.346955:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008afc5f1b nid 13809@kfi7 refs 1
00000400:00000200:9.0:1773851872.346957:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13809@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.346957:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008afc5f1b nid 13809@kfi7 refs 2
00000400:00000200:9.0:1773851872.346958:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008afc5f1b nid 13809@kfi7 refs 3
00000400:00000200:9.0:1773851872.346959:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13616@kfi7 to cpt 4
00000400:00000200:9.0:1773851872.346960:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13616@kfi7 of length 224 into portal 12 MB=0x699e0bf867700
00000400:00000200:9.0:1773851872.346961:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13616@kfi7 of length 224/224 into md 0x78146ce49 [64] + 140072
00000800:00000200:9.0:1773851872.346963:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.346965:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.346965:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13809@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.346966:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.346967:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.346968:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000098742ab1.
00000100:00000040:9.0:1773851872.346968:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000098742ab1 x1858040425248512 msgsize 224
00000100:00100000:9.0:1773851872.346970:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13616@kfi7 (source: 12345-13809@kfi7)
00000100:00000001:9.0:1773851872.346971:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.346971:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008afc5f1b nid 13809@kfi7 refs 2
00000100:00000001:8.0:1773851872.346972:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851872.346972:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851872.346973:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851872.346973:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851872.346973:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851872.346974:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.346975:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040425248512
00000020:00000001:8.0:1773851872.346975:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851872.346976:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91bc2
00000020:00000001:8.0:1773851872.346977:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851872.346979:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000a263208 refcount=6
00000020:00000001:8.0:1773851872.346980:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628037632 : -107123081513984 : ffff9e9276c77400)
00000020:00000001:8.0:1773851872.346981:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628037632 : -107123081513984 : ffff9e9276c77400)
00000100:00000001:8.0:1773851872.346982:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.346983:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851872.346983:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000020:00000010:8.0:1773851872.346984:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.346985:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851872.346986:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851872.346986:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.346986:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851872.346987:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851872.346988:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851872.346988:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.346989:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.346990:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851872.346990:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.346991:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851872.346991:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851872.346992:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.346992:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13616@kfi7, seq: 2130792
00000100:00000040:8.0:1773851872.346992:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000a263208 : new rpc_count 1
00000100:00000001:11.0:1773851872.346993:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.346993:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749185280 : -106947960366336 : ffff9ebb3cd01b00)
00000100:00000040:8.0:1773851872.346994:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000098742ab1 x1858040425248512/t0(0) o400->6fd62a08-92f8-4ff7-8abd-1d589d211f74@13616@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1341-0'
00000100:00000001:8.0:1773851872.346997:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.346997:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851872.346998:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098742ab1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:6fd62a08-92f8-4ff7-8abd-1d589d211f74+6:39668:x1858040425248512:12345-13616@kfi7:400:default-tuolumne1341-0
00000100:00000200:8.0:1773851872.347000:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040425248512
00000020:00000001:8.0:1773851872.347000:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851872.347001:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851872.347002:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.347002:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851872.347003:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851872.347003:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851872.347004:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040425248512, found 0 last_xid 1858040425248511
00000020:00000001:8.0:1773851872.347005:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851872.347005:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851872.347006:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851872.347007:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.347007:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851872.347008:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851872.347008:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851872.347009:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005de312e6.
02000000:00000001:8.0:1773851872.347009:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.347010:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.347011:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851872.347011:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182614122613, transno 0, xid 1858040425248512
00010000:00000001:8.0:1773851872.347012:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851872.347013:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000098742ab1 x1858040425248512/t0(0) o400->6fd62a08-92f8-4ff7-8abd-1d589d211f74@13616@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1341-0'
00010000:00000001:8.0:1773851872.347018:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851872.347018:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851872.347019:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851872.347020:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851872.347020:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c50c256a refcount 3 to 13616@kfi7
00000100:00000001:8.0:1773851872.347021:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960512 : -107156125591104 : ffff9e8ac532d9c0)
02000000:00000001:8.0:1773851872.347022:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851872.347022:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.347023:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851872.347024:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13809@kfi7
00000400:00000010:8.0:1773851872.347024:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6b06622.
00000100:00000200:8.0:1773851872.347025:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040425248512, offset 224
00000400:00000200:8.0:1773851872.347026:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13809@kfi7
00000400:00000200:8.0:1773851872.347027:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13809@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.347028:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008afc5f1b nid 13809@kfi7 refs 1
00000400:00000200:8.0:1773851872.347029:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008afc5f1b nid 13809@kfi7 refs 2
00000400:00000200:8.0:1773851872.347030:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008afc5f1b nid 13809@kfi7 refs 3
00000400:00000200:8.0:1773851872.347031:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13809@kfi7 local destination
00000400:00000200:8.0:1773851872.347032:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769400:8769400:1024:4294967295] 13809@kfi7 LPNI seq info [314711:314711:16:4294967295]
00000400:00000200:8.0:1773851872.347033:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008afc5f1b nid 13809@kfi7 refs 2
00000400:00000200:8.0:1773851872.347034:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13809@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.347035:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13809@kfi7(13809@kfi7:13809@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851872.347036:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008afc5f1b nid 13809@kfi7 refs 3
00000800:00000200:8.0:1773851872.347038:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851872.347039:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851872.347040:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851872.347042:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001158 Using peer 13809@kfi7(0x100000000001158)
00000800:00000200:8.0:1773851872.347046:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x100000000001158: rc=0
00000800:00000200:8.0:1773851872.347048:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001158 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851872.347049:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.347050:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c50c256a refcount 2 to 13616@kfi7
00010000:00000001:8.0:1773851872.347051:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851872.347051:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.347052:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851872.347052:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098742ab1 x1858040425248512/t0(0) o400->6fd62a08-92f8-4ff7-8abd-1d589d211f74@13616@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1341-0'
00000100:00100000:8.0:1773851872.347055:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098742ab1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:6fd62a08-92f8-4ff7-8abd-1d589d211f74+6:39668:x1858040425248512:12345-13616@kfi7:400:default-tuolumne1341-0 Request processed in 57us (86us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851872.347059:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13616@kfi7, seq: 2130792
00000100:00000040:8.0:1773851872.347059:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000a263208 : new rpc_count 0
00000100:00000001:8.0:1773851872.347060:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851872.347061:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851872.347061:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.347062:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851872.347062:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000020:00000040:8.0:1773851872.347063:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000000a263208 : new refcount 5
00000100:00000001:8.0:1773851872.347064:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851872.347068:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001158 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851872.347070:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.347071:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13809@kfi7: PUT: OK
00000400:00000200:9.0:1773851872.347071:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6b06622
00000400:00000010:9.0:1773851872.347072:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6b06622.
00000100:00000001:9.0:1773851872.347072:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851872.347073:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851872.347074:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008afc5f1b nid 13809@kfi7 refs 2
00000800:00000200:9.0:1773851872.347075:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 13809@kfi7(00000000d727ae4f):0x0 lsk 4441 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000001158 Transaction freed
00000800:00000200:9.0:1773851872.381385:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.381387:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.381389:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.381392:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.381396:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.381399:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.170@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851872.381401:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.381402:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851872.381405:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.170@o2ib600 to cpt 3
00000400:00000200:9.0:1773851872.381407:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52044e0 nid 172.19.3.170@o2ib600 refs 2
00000400:00000200:9.0:1773851872.381410:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b52044e0 nid 172.19.3.170@o2ib600 refs 3
00000400:00000200:9.0:1773851872.381412:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.170@o2ib600 to cpt 3
00000400:00000200:9.0:1773851872.381414:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.170@o2ib600 of length 224 into portal 12 MB=0x699f38f1c1280
00000400:00000200:9.0:1773851872.381417:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.170@o2ib600 of length 224/224 into md 0x82a36e8ed [64] + 34144
00000800:00000200:9.0:1773851872.381420:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.381423:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.381425:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.381427:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.381427:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.381429:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000047cb363.
00000100:00000040:9.0:1773851872.381430:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000047cb363 x1858121217348224 msgsize 224
00000100:00100000:9.0:1773851872.381434:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.170@o2ib600 (source: 12345-172.19.3.170@o2ib600)
00000100:00000001:9.0:1773851872.381436:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.381437:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:15.0:1773851872.381440:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851872.381440:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851872.381441:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851872.381442:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851872.381443:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851872.381444:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851872.381446:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858121217348224
00000020:00000001:15.0:1773851872.381447:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851872.381449:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e94
00000020:00000001:15.0:1773851872.381450:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851872.381456:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d2722ac5 refcount=905
00000020:00000001:15.0:1773851872.381457:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239655424 : -107152469896192 : ffff9e8b9f185400)
00000020:00000001:15.0:1773851872.381459:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239655424 : -107152469896192 : ffff9e8b9f185400)
00000100:00000001:15.0:1773851872.381460:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.381462:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851872.381463:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000570d845.
00000020:00000010:15.0:1773851872.381464:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851872.381466:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851872.381467:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851872.381468:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851872.381469:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851872.381470:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851872.381471:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851872.381472:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.381474:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851872.381476:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851872.381477:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851872.381477:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851872.381478:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851872.381479:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.170@o2ib600, seq: 2289853
00000100:00000040:15.0:1773851872.381480:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d2722ac5 : new rpc_count 2
00000100:00000001:12.0:1773851872.381480:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.381481:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749196800 : -106947960354816 : ffff9ebb3cd04800)
00000100:00000001:12.0:1773851872.381481:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.381483:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000047cb363 x1858121217348224/t0(0) o400->6d3ede50-8541-438d-b110-bc6ded07025b@172.19.3.170@o2ib600:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic20-0'
00000100:00000001:15.0:1773851872.381488:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.381489:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851872.381491:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000047cb363 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6d3ede50-8541-438d-b110-bc6ded07025b+905:24794:x1858121217348224:12345-172.19.3.170@o2ib600:400:default-oslic20-0
00000100:00000200:15.0:1773851872.381493:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858121217348224
00000020:00000001:15.0:1773851872.381494:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851872.381495:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851872.381496:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.381497:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851872.381499:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851872.381500:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851872.381501:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858121217348224, found 0 last_xid 1858121207825535
00000020:00000001:15.0:1773851872.381502:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851872.381503:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851872.381504:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851872.381505:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.381506:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851872.381507:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851872.381508:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851872.381509:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad3cf907.
02000000:00000001:15.0:1773851872.381510:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.381511:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.381512:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851872.381513:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181311639929, transno 0, xid 1858121217348224
00010000:00000001:15.0:1773851872.381514:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851872.381516:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000047cb363 x1858121217348224/t0(0) o400->6d3ede50-8541-438d-b110-bc6ded07025b@172.19.3.170@o2ib600:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic20-0'
00010000:00000001:15.0:1773851872.381520:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851872.381521:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851872.381522:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=105 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851872.381524:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851872.381525:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a9a7a8f3 refcount 3 to 172.19.3.170@o2ib600
00000100:00000001:15.0:1773851872.381527:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299072 : -107155980252544 : ffff9e8acddc8a80)
02000000:00000001:15.0:1773851872.381528:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851872.381529:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.381530:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851872.381531:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.170@o2ib600
00000400:00000010:15.0:1773851872.381533:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000616bd872.
00000100:00000200:15.0:1773851872.381534:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858121217348224, offset 224
00000400:00000200:15.0:1773851872.381537:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.170@o2ib600
00000400:00000200:15.0:1773851872.381539:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.170@o2ib600 to cpt 3
00000400:00000200:15.0:1773851872.381542:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52044e0 nid 172.19.3.170@o2ib600 refs 2
00000400:00000200:15.0:1773851872.381544:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b52044e0 nid 172.19.3.170@o2ib600 refs 3
00000400:00000200:15.0:1773851872.381547:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b52044e0 nid 172.19.3.170@o2ib600 refs 4
00000400:00000200:15.0:1773851872.381550:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.170@o2ib600 routed destination
00000400:00000200:15.0:1773851872.381552:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851872.381553:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:15.0:1773851872.381555:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.170@o2ib600: rtr pref emtpy: 1
00000400:00000200:15.0:1773851872.381557:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851872.381558:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.170@o2ib600: rtr pref emtpy: 1
00000400:00000200:15.0:1773851872.381560:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851872.381561:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769401:8769401:1024:4294967295] 17@kfi7 LPNI seq info [1250891901:1250891901:16:4294967295]
00000400:00000200:15.0:1773851872.381564:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:15.0:1773851872.381565:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:15.0:1773851872.381569:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.170@o2ib600(172.19.3.170@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851872.381571:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b52044e0 nid 172.19.3.170@o2ib600 refs 3
00000800:00000200:15.0:1773851872.381574:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851872.381576:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851872.381580:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851872.381583:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:15.0:1773851872.381588:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:15.0:1773851872.381590:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851872.381593:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.381595:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a9a7a8f3 refcount 2 to 172.19.3.170@o2ib600
00010000:00000001:15.0:1773851872.381596:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851872.381597:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.381598:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851872.381600:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000047cb363 x1858121217348224/t0(0) o400->6d3ede50-8541-438d-b110-bc6ded07025b@172.19.3.170@o2ib600:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic20-0'
00000800:00000200:13.0:1773851872.381606:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851872.381609:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851872.381611:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000047cb363 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6d3ede50-8541-438d-b110-bc6ded07025b+905:24794:x1858121217348224:12345-172.19.3.170@o2ib600:400:default-oslic20-0 Request processed in 121us (179us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851872.381611:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:13.0:1773851872.381612:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000616bd872
00000400:00000010:13.0:1773851872.381613:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000616bd872.
00000100:00000001:13.0:1773851872.381614:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:15.0:1773851872.381615:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.170@o2ib600, seq: 2289853
00000100:00000001:13.0:1773851872.381615:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851872.381616:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000040:15.0:1773851872.381617:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d2722ac5 : new rpc_count 1
00000100:00000001:15.0:1773851872.381618:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851872.381619:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851872.381619:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:13.0:1773851872.381619:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000020:00000010:15.0:1773851872.381621:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000020:00000010:15.0:1773851872.381622:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000570d845.
00000020:00000040:15.0:1773851872.381623:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000d2722ac5 : new refcount 904
00000100:00000001:15.0:1773851872.381625:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851872.393734:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393734:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851872.393735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851872.393736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851872.393738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851872.393739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851872.393740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851872.393740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851872.393741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851872.393742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.393747:0:238018:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:11.0:1773851872.393749:0:238018:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851872.393750:0:238018:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:17.0:1773851872.410860:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851872.410861:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:17.0:1773851872.410863:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851872.410864:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12401@kfi7(00000000c7aaf9be):0x407 version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851872.410866:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 Using peer 12401@kfi7(0x100000000000407)
00000400:00000200:17.0:1773851872.410868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12401@kfi7 to cpt 4
00000800:00000200:17.0:1773851872.410870:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x100000000000407: rc=0
00000800:00000200:17.0:1773851872.410872:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:17.0:1773851872.410883:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 TN_EVENT_TX_OK event status 0
00000800:00000200:17.0:1773851872.410886:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 Transaction freed
00000800:00000200:19.0:1773851872.410887:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851872.410887:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:19.0:1773851872.410889:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:19.0:1773851872.410891:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:19.0:1773851872.410892:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12401@kfi7 to cpt 4
00000400:00000200:19.0:1773851872.410894:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12401@kfi7 : PUT - for me
00000400:00000200:19.0:1773851872.410895:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12401@kfi7 to cpt 4
00000400:00000200:19.0:1773851872.410896:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c4d74e2 nid 12401@kfi7 refs 1
00000400:00000200:19.0:1773851872.410897:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12401@kfi7 to cpt 4
00000400:00000200:19.0:1773851872.410897:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c4d74e2 nid 12401@kfi7 refs 2
00000400:00000200:19.0:1773851872.410898:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007c4d74e2 nid 12401@kfi7 refs 3
00000400:00000200:19.0:1773851872.410899:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12464@kfi7 to cpt 4
00000400:00000200:19.0:1773851872.410900:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12464@kfi7 of length 224 into portal 12 MB=0x69b4b5c609140
00000400:00000200:19.0:1773851872.410901:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12464@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 21960
00000800:00000200:19.0:1773851872.410903:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851872.410905:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851872.410906:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12401@kfi7: PUT: OK
00000100:00000001:19.0:1773851872.410907:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851872.410907:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851872.410909:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006fcc29bf.
00000100:00000040:19.0:1773851872.410910:0:2464491:0:(events.c:358:request_in_callback()) incoming req@000000006fcc29bf x1859597834948928 msgsize 224
00000100:00100000:19.0:1773851872.410911:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-12464@kfi7 (source: 12345-12401@kfi7)
00000100:00000001:19.0:1773851872.410912:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851872.410913:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007c4d74e2 nid 12401@kfi7 refs 2
00000800:00000200:19.0:1773851872.410914:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851872.410914:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851872.410914:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851872.410915:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851872.410915:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851872.410916:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851872.410917:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597834948928
00000020:00000001:16.0:1773851872.410917:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851872.410918:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79f36
00000020:00000001:16.0:1773851872.410918:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851872.410920:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003934feff refcount=5
00000020:00000001:16.0:1773851872.410921:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108661984256 : -106965047567360 : ffff9eb742561c00)
00000020:00000001:16.0:1773851872.410922:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108661984256 : -106965047567360 : ffff9eb742561c00)
00000100:00000001:16.0:1773851872.410923:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851872.410925:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851872.410926:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851872.410927:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851872.410928:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851872.410928:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851872.410929:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851872.410929:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851872.410930:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851872.410931:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851872.410931:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.410932:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851872.410933:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851872.410933:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851872.410934:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851872.410934:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851872.410935:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851872.410935:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12464@kfi7, seq: 2156349
00000100:00000040:16.0:1773851872.410935:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003934feff : new rpc_count 1
00000100:00000001:17.0:1773851872.410936:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.410936:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339152512 : -106987370399104 : ffff9eb20fcaba80)
00000100:00000040:16.0:1773851872.410937:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006fcc29bf x1859597834948928/t0(0) o400->1d7647c5-bfcb-41ff-b9bb-9fa81b235499@12464@kfi7:93/0 lens 224/0 e 0 to 0 dl 1773852208 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1262-0'
00000100:00000001:16.0:1773851872.410940:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851872.410940:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851872.410941:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006fcc29bf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1d7647c5-bfcb-41ff-b9bb-9fa81b235499+5:39548:x1859597834948928:12345-12464@kfi7:400:default-tuolumne1262-0
00000100:00000200:16.0:1773851872.410942:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597834948928
00000020:00000001:16.0:1773851872.410943:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851872.410944:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851872.410944:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.410945:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851872.410945:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851872.410946:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851872.410947:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597834948928, found 0 last_xid 1859597834948927
00000020:00000001:16.0:1773851872.410948:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851872.410948:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851872.410949:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851872.410949:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.410960:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851872.410961:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851872.410961:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851872.410963:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aa45d3ca.
02000000:00000001:16.0:1773851872.410963:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.410964:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.410964:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851872.410965:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256841451, transno 0, xid 1859597834948928
00010000:00000001:16.0:1773851872.410966:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851872.410967:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006fcc29bf x1859597834948928/t0(0) o400->1d7647c5-bfcb-41ff-b9bb-9fa81b235499@12464@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1262-0'
00010000:00000001:16.0:1773851872.410969:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851872.410970:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851872.410970:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=105 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851872.410971:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851872.410972:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000082e31ff3 refcount 3 to 12464@kfi7
00000100:00000001:16.0:1773851872.410973:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960896 : -107156125590720 : ffff9e8ac532db40)
02000000:00000001:16.0:1773851872.410973:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851872.410974:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.410975:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851872.410975:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12401@kfi7
00000400:00000010:16.0:1773851872.410976:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a27f9aab.
00000100:00000200:16.0:1773851872.410977:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597834948928, offset 224
00000400:00000200:16.0:1773851872.410978:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12401@kfi7
00000400:00000200:16.0:1773851872.410979:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12401@kfi7 to cpt 4
00000400:00000200:16.0:1773851872.410980:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007c4d74e2 nid 12401@kfi7 refs 1
00000400:00000200:16.0:1773851872.410981:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007c4d74e2 nid 12401@kfi7 refs 2
00000400:00000200:16.0:1773851872.410982:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007c4d74e2 nid 12401@kfi7 refs 3
00000400:00000200:16.0:1773851872.410983:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12401@kfi7 local destination
00000400:00000200:16.0:1773851872.410984:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769402:8769402:1024:4294967295] 12401@kfi7 LPNI seq info [10313019:10313019:16:4294967295]
00000400:00000200:16.0:1773851872.410986:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007c4d74e2 nid 12401@kfi7 refs 2
00000400:00000200:16.0:1773851872.410986:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12401@kfi7 to cpt 4
00000400:00000200:16.0:1773851872.410988:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12401@kfi7(12401@kfi7:12401@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851872.410993:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007c4d74e2 nid 12401@kfi7 refs 3
00000800:00000200:16.0:1773851872.410994:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851872.410995:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851872.410997:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851872.410999:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 Using peer 12401@kfi7(0x100000000000407)
00000800:00000200:16.0:1773851872.411002:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x100000000000407: rc=0
00000800:00000200:16.0:1773851872.411003:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851872.411005:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851872.411006:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000082e31ff3 refcount 2 to 12464@kfi7
00010000:00000001:16.0:1773851872.411007:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851872.411007:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.411008:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851872.411008:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006fcc29bf x1859597834948928/t0(0) o400->1d7647c5-bfcb-41ff-b9bb-9fa81b235499@12464@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1262-0'
00000100:00100000:16.0:1773851872.411013:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006fcc29bf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1d7647c5-bfcb-41ff-b9bb-9fa81b235499+5:39548:x1859597834948928:12345-12464@kfi7:400:default-tuolumne1262-0 Request processed in 72us (102us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851872.411016:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12464@kfi7, seq: 2156349
00000100:00000040:16.0:1773851872.411016:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003934feff : new rpc_count 0
00000100:00000001:16.0:1773851872.411017:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851872.411018:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851872.411018:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851872.411019:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851872.411020:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851872.411020:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000003934feff : new refcount 4
00000100:00000001:16.0:1773851872.411021:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851872.411025:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851872.411027:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851872.411028:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12401@kfi7: PUT: OK
00000400:00000200:17.0:1773851872.411029:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a27f9aab
00000400:00000010:17.0:1773851872.411030:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a27f9aab.
00000100:00000001:17.0:1773851872.411031:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851872.411031:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851872.411032:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007c4d74e2 nid 12401@kfi7 refs 2
00000800:00000200:17.0:1773851872.411033:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 12401@kfi7(00000000c7aaf9be):0x0 lsk 1032 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000407 Transaction freed
00000800:00000200:17.0:1773851872.419340:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851872.419341:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851872.419343:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851872.419351:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851872.419354:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14451@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.419356:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14451@kfi7 : PUT - for me
00000400:00000200:17.0:1773851872.419358:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14451@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.419360:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083a9034c nid 14451@kfi7 refs 1
00000400:00000200:17.0:1773851872.419362:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14451@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.419363:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083a9034c nid 14451@kfi7 refs 2
00000400:00000200:17.0:1773851872.419364:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083a9034c nid 14451@kfi7 refs 3
00000400:00000200:17.0:1773851872.419366:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14514@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.419368:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14514@kfi7 of length 224 into portal 12 MB=0x69b7c9ee6b780
00000400:00000200:17.0:1773851872.419370:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14514@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 22184
00000800:00000200:17.0:1773851872.419373:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851872.419376:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851872.419378:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14451@kfi7: PUT: OK
00000100:00000001:17.0:1773851872.419380:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851872.419381:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851872.419383:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008b2a4e62.
00000100:00000040:17.0:1773851872.419384:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000008b2a4e62 x1859809404434304 msgsize 224
00000100:00100000:17.0:1773851872.419387:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14514@kfi7 (source: 12345-14451@kfi7)
00000100:00000001:17.0:1773851872.419388:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851872.419390:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083a9034c nid 14451@kfi7 refs 2
00000100:00000001:16.0:1773851872.419391:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851872.419392:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851872.419392:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851872.419393:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851872.419394:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851872.419395:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851872.419396:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859809404434304
00000020:00000001:16.0:1773851872.419397:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851872.419398:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f085d7ddd622
00000020:00000001:16.0:1773851872.419399:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851872.419401:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004aec3fe5 refcount=5
00000020:00000001:16.0:1773851872.419403:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637153768229888 : -106919941321728 : ffff9ec1c2e0cc00)
00000020:00000001:16.0:1773851872.419404:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637153768229888 : -106919941321728 : ffff9ec1c2e0cc00)
00000100:00000001:16.0:1773851872.419405:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851872.419406:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851872.419407:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851872.419409:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851872.419410:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851872.419411:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851872.419412:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851872.419413:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851872.419414:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851872.419415:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851872.419415:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.419417:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851872.419419:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851872.419419:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851872.419420:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851872.419420:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851872.419421:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14514@kfi7, seq: 2156350
00000100:00000040:16.0:1773851872.419422:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004aec3fe5 : new rpc_count 1
00000100:00000001:17.0:1773851872.419423:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851872.419424:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.419424:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372329088 : -107078337222528 : ffff9e9ce1bf2880)
00000100:00000040:16.0:1773851872.419425:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008b2a4e62 x1859809404434304/t0(0) o400->59232c95-ee90-4ed9-8078-0fdcdd1e9a05@14514@kfi7:93/0 lens 224/0 e 0 to 0 dl 1773852208 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1386-0'
00000100:00000001:16.0:1773851872.419431:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851872.419431:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851872.419433:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008b2a4e62 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:59232c95-ee90-4ed9-8078-0fdcdd1e9a05+5:39442:x1859809404434304:12345-14514@kfi7:400:default-tuolumne1386-0
00000100:00000200:16.0:1773851872.419438:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859809404434304
00000020:00000001:16.0:1773851872.419440:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851872.419441:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851872.419442:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.419443:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851872.419443:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851872.419445:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851872.419446:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859809404434304, found 0 last_xid 1859809404434303
00000020:00000001:16.0:1773851872.419447:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851872.419448:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851872.419449:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851872.419450:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.419451:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851872.419452:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851872.419453:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851872.419454:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002c7d059e.
02000000:00000001:16.0:1773851872.419456:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.419456:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.419458:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851872.419459:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676018250, transno 0, xid 1859809404434304
00010000:00000001:16.0:1773851872.419460:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851872.419462:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008b2a4e62 x1859809404434304/t0(0) o400->59232c95-ee90-4ed9-8078-0fdcdd1e9a05@14514@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1386-0'
00010000:00000001:16.0:1773851872.419467:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851872.419467:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851872.419469:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=105 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851872.419471:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851872.419472:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b7a82c86 refcount 3 to 14514@kfi7
00000100:00000001:16.0:1773851872.419473:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095777856 : -107152613773760 : ffff9e8b9684ee40)
02000000:00000001:16.0:1773851872.419475:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851872.419475:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.419476:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851872.419478:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14451@kfi7
00000400:00000010:16.0:1773851872.419479:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000253254b8.
00000100:00000200:16.0:1773851872.419481:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859809404434304, offset 224
00000400:00000200:16.0:1773851872.419483:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14451@kfi7
00000400:00000200:16.0:1773851872.419485:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14451@kfi7 to cpt 4
00000400:00000200:16.0:1773851872.419487:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083a9034c nid 14451@kfi7 refs 1
00000400:00000200:16.0:1773851872.419488:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083a9034c nid 14451@kfi7 refs 2
00000400:00000200:16.0:1773851872.419490:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083a9034c nid 14451@kfi7 refs 3
00000400:00000200:16.0:1773851872.419493:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14451@kfi7 local destination
00000400:00000200:16.0:1773851872.419495:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769403:8769403:1024:4294967295] 14451@kfi7 LPNI seq info [129549:129549:16:4294967295]
00000400:00000200:16.0:1773851872.419498:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083a9034c nid 14451@kfi7 refs 2
00000400:00000200:16.0:1773851872.419499:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14451@kfi7 to cpt 4
00000400:00000200:16.0:1773851872.419503:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14451@kfi7(14451@kfi7:14451@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851872.419505:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083a9034c nid 14451@kfi7 refs 3
00000800:00000200:16.0:1773851872.419508:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851872.419510:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851872.419514:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851872.419519:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf21 Using peer 14451@kfi7(0xf21)
00000800:00000200:16.0:1773851872.419524:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009aebe925: Posted send of 324 bytes to peer 0xf21: rc=0
00000800:00000200:16.0:1773851872.419526:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf21 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851872.419530:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851872.419531:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b7a82c86 refcount 2 to 14514@kfi7
00010000:00000001:16.0:1773851872.419532:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851872.419533:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.419536:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851872.419537:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008b2a4e62 x1859809404434304/t0(0) o400->59232c95-ee90-4ed9-8078-0fdcdd1e9a05@14514@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1386-0'
00000100:00100000:16.0:1773851872.419542:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008b2a4e62 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:59232c95-ee90-4ed9-8078-0fdcdd1e9a05+5:39442:x1859809404434304:12345-14514@kfi7:400:default-tuolumne1386-0 Request processed in 110us (157us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851872.419546:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14514@kfi7, seq: 2156350
00000100:00000040:16.0:1773851872.419547:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004aec3fe5 : new rpc_count 0
00000100:00000001:16.0:1773851872.419548:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851872.419549:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851872.419550:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851872.419551:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851872.419552:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851872.419553:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000004aec3fe5 : new refcount 4
00000100:00000001:16.0:1773851872.419554:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851872.419562:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf21 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851872.419564:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851872.419566:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14451@kfi7: PUT: OK
00000400:00000200:17.0:1773851872.419567:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000253254b8
00000400:00000010:17.0:1773851872.419568:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000253254b8.
00000100:00000001:17.0:1773851872.419569:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851872.419570:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851872.419571:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083a9034c nid 14451@kfi7 refs 2
00000800:00000200:17.0:1773851872.419574:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 14451@kfi7(000000001ed4555e):0x0 lsk 3874 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf21 Transaction freed
00000800:00000200:17.0:1773851872.429166:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851872.429167:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851872.429168:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851872.429170:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851872.429172:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24224@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.429173:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24224@kfi7 : PUT - for me
00000400:00000200:17.0:1773851872.429174:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24224@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.429174:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b387cdee nid 24224@kfi7 refs 1
00000400:00000200:17.0:1773851872.429175:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24224@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.429176:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b387cdee nid 24224@kfi7 refs 2
00000400:00000200:17.0:1773851872.429177:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b387cdee nid 24224@kfi7 refs 3
00000400:00000200:17.0:1773851872.429177:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24224@kfi7 to cpt 4
00000400:00000200:17.0:1773851872.429178:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24224@kfi7 of length 224 into portal 12 MB=0x699e0ad57cd80
00000400:00000200:17.0:1773851872.429180:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24224@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 22408
00000800:00000200:17.0:1773851872.429181:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851872.429183:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851872.429184:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24224@kfi7: PUT: OK
00000100:00000001:17.0:1773851872.429185:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851872.429185:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851872.429186:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001bace5be.
00000100:00000040:17.0:1773851872.429186:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001bace5be x1858040120200576 msgsize 224
00000100:00100000:17.0:1773851872.429190:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-24224@kfi7 (source: 12345-24224@kfi7)
00000100:00000001:17.0:1773851872.429191:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851872.429192:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b387cdee nid 24224@kfi7 refs 2
00000100:00000001:16.0:1773851872.429192:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851872.429193:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851872.429193:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851872.429193:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851872.429193:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851872.429194:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851872.429195:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040120200576
00000020:00000001:16.0:1773851872.429195:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851872.429195:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac921cd
00000020:00000001:16.0:1773851872.429196:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851872.429199:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef3e173e refcount=6
00000020:00000001:16.0:1773851872.429199:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629755904 : -107123079795712 : ffff9e9276e1ac00)
00000020:00000001:16.0:1773851872.429200:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629755904 : -107123079795712 : ffff9e9276e1ac00)
00000100:00000001:16.0:1773851872.429201:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851872.429202:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851872.429202:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851872.429203:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851872.429203:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851872.429204:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851872.429204:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851872.429205:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851872.429205:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851872.429206:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851872.429206:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.429207:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851872.429208:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851872.429208:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851872.429208:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851872.429209:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851872.429210:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851872.429210:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24224@kfi7, seq: 2156351
00000100:00000040:16.0:1773851872.429210:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef3e173e : new rpc_count 1
00000100:00000001:17.0:1773851872.429211:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.429211:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372331392 : -107078337220224 : ffff9e9ce1bf3180)
00000100:00000040:16.0:1773851872.429212:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001bace5be x1858040120200576/t0(0) o400->d825e0c8-8fcd-4505-a59d-77610bdf43bc@24224@kfi7:93/0 lens 224/0 e 0 to 0 dl 1773852208 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2000-0'
00000100:00000001:16.0:1773851872.429215:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851872.429215:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851872.429216:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001bace5be pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d825e0c8-8fcd-4505-a59d-77610bdf43bc+6:39664:x1858040120200576:12345-24224@kfi7:400:default-tuolumne2000-0
00000100:00000200:16.0:1773851872.429217:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040120200576
00000020:00000001:16.0:1773851872.429218:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851872.429218:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851872.429219:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.429219:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851872.429219:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851872.429220:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851872.429221:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040120200576, found 0 last_xid 1858040120200575
00000020:00000001:16.0:1773851872.429221:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851872.429222:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851872.429222:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851872.429223:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.429223:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851872.429223:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851872.429224:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851872.429225:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003a1f3294.
02000000:00000001:16.0:1773851872.429225:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.429226:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.429226:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851872.429227:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182426467172, transno 0, xid 1858040120200576
00010000:00000001:16.0:1773851872.429228:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851872.429228:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001bace5be x1858040120200576/t0(0) o400->d825e0c8-8fcd-4505-a59d-77610bdf43bc@24224@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2000-0'
00010000:00000001:16.0:1773851872.429234:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851872.429234:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851872.429235:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=105 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851872.429236:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851872.429237:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000077616335 refcount 3 to 24224@kfi7
00000100:00000001:16.0:1773851872.429237:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583951072 : -107156125600544 : ffff9e8ac532b4e0)
02000000:00000001:16.0:1773851872.429238:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851872.429238:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851872.429239:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851872.429240:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24224@kfi7
00000400:00000010:16.0:1773851872.429241:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cba1b548.
00000100:00000200:16.0:1773851872.429241:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040120200576, offset 224
00000400:00000200:16.0:1773851872.429243:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24224@kfi7
00000400:00000200:16.0:1773851872.429244:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24224@kfi7 to cpt 4
00000400:00000200:16.0:1773851872.429244:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b387cdee nid 24224@kfi7 refs 1
00000400:00000200:16.0:1773851872.429245:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b387cdee nid 24224@kfi7 refs 2
00000400:00000200:16.0:1773851872.429246:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b387cdee nid 24224@kfi7 refs 3
00000400:00000200:16.0:1773851872.429247:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24224@kfi7 local destination
00000400:00000200:16.0:1773851872.429249:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769404:8769404:1024:4294967295] 24224@kfi7 LPNI seq info [5551955:5551955:16:4294967295]
00000400:00000200:16.0:1773851872.429250:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b387cdee nid 24224@kfi7 refs 2
00000400:00000200:16.0:1773851872.429251:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24224@kfi7 to cpt 4
00000400:00000200:16.0:1773851872.429253:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24224@kfi7(24224@kfi7:24224@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851872.429254:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b387cdee nid 24224@kfi7 refs 3
00000800:00000200:16.0:1773851872.429255:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851872.429256:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851872.429258:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851872.429260:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000616 Using peer 24224@kfi7(0x100000000000616)
00000800:00000200:16.0:1773851872.429265:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 324 bytes to peer 0x100000000000616: rc=0
00000800:00000200:16.0:1773851872.429267:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000616 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851872.429269:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851872.429270:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000077616335 refcount 2 to 24224@kfi7
00010000:00000001:16.0:1773851872.429270:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851872.429271:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851872.429271:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851872.429272:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001bace5be x1858040120200576/t0(0) o400->d825e0c8-8fcd-4505-a59d-77610bdf43bc@24224@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2000-0'
00000100:00100000:16.0:1773851872.429277:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001bace5be pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d825e0c8-8fcd-4505-a59d-77610bdf43bc+6:39664:x1858040120200576:12345-24224@kfi7:400:default-tuolumne2000-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851872.429279:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24224@kfi7, seq: 2156351
00000100:00000040:16.0:1773851872.429280:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef3e173e : new rpc_count 0
00000100:00000001:16.0:1773851872.429280:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851872.429281:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851872.429281:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851872.429282:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851872.429282:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851872.429283:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000ef3e173e : new refcount 5
00000100:00000001:16.0:1773851872.429284:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851872.429289:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000616 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851872.429291:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851872.429292:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24224@kfi7: PUT: OK
00000400:00000200:17.0:1773851872.429293:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cba1b548
00000400:00000010:17.0:1773851872.429293:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cba1b548.
00000100:00000001:17.0:1773851872.429294:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851872.429294:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851872.429295:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b387cdee nid 24224@kfi7 refs 2
00000800:00000200:17.0:1773851872.429297:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 24224@kfi7(00000000c3d24103):0x0 lsk 1559 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000616 Transaction freed
00000800:00000200:9.0:1773851872.503066:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.503068:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.503070:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.503073:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.503076:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.503078:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:9.0:1773851872.503080:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.503082:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851872.503083:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.503084:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851872.503085:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851872.503087:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.503088:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 224 into portal 12 MB=0x699e0de42a180
00000400:00000200:9.0:1773851872.503090:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12@kfi7 of length 224/224 into md 0x78146ce49 [64] + 140296
00000800:00000200:9.0:1773851872.503093:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.503095:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.503097:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.503098:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.503099:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.503100:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008ffbb8dc.
00000100:00000040:9.0:1773851872.503102:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000008ffbb8dc x1858040940896640 msgsize 224
00000100:00100000:9.0:1773851872.503104:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-12@kfi7 (source: 12345-12@kfi7)
00000100:00000001:9.0:1773851872.503105:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.503107:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:8.0:1773851872.503108:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851872.503109:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851872.503109:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851872.503109:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851872.503110:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851872.503111:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.503112:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040940896640
00000020:00000001:8.0:1773851872.503113:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851872.503114:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793aca537a
00000020:00000001:8.0:1773851872.503115:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851872.503119:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dde187be refcount=5
00000020:00000001:8.0:1773851872.503121:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636927144484864 : -107146565066752 : ffff9e8cff0ce000)
00000020:00000001:8.0:1773851872.503122:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636927144484864 : -107146565066752 : ffff9e8cff0ce000)
00000100:00000001:8.0:1773851872.503123:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.503124:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851872.503125:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000020:00000010:8.0:1773851872.503127:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.503128:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851872.503129:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851872.503130:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.503131:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851872.503132:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851872.503133:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851872.503134:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.503135:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.503137:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851872.503137:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.503138:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851872.503138:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851872.503139:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12@kfi7, seq: 2130793
00000100:00000040:8.0:1773851872.503140:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dde187be : new rpc_count 1
00000100:00000001:11.0:1773851872.503141:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.503142:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.503142:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749199104 : -106947960352512 : ffff9ebb3cd05100)
00000100:00000040:8.0:1773851872.503143:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008ffbb8dc x1858040940896640/t0(0) o400->lustre5-MDT0001-lwp-OST0011_UUID@12@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba118-0'
00000100:00000001:8.0:1773851872.503148:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.503148:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851872.503150:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ffbb8dc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:lustre5-MDT0001-lwp-OST0011_UUID+5:272597:x1858040940896640:12345-12@kfi7:400:default-yuba118-0
00000100:00000200:8.0:1773851872.503152:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040940896640
00000020:00000001:8.0:1773851872.503153:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851872.503154:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851872.503155:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.503156:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851872.503156:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851872.503157:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:8.0:1773851872.503158:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851872.503162:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851872.503163:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851872.503164:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.503165:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851872.503166:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851872.503166:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851872.503169:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bbee0b4d.
02000000:00000001:8.0:1773851872.503170:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.503171:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.503172:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851872.503173:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858040940896640
00010000:00000001:8.0:1773851872.503175:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851872.503176:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008ffbb8dc x1858040940896640/t0(0) o400->lustre5-MDT0001-lwp-OST0011_UUID@12@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba118-0'
00010000:00000001:8.0:1773851872.503180:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851872.503180:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851872.503181:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851872.503183:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851872.503184:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000044ea8a8e refcount 7 to 12@kfi7
00000100:00000001:8.0:1773851872.503185:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274736320 : -107155434815296 : ffff9e8aee5f40c0)
02000000:00000001:8.0:1773851872.503187:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851872.503187:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.503188:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851872.503189:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:8.0:1773851872.503190:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2abdf16.
00000100:00000200:8.0:1773851872.503191:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040940896640, offset 224
00000400:00000200:8.0:1773851872.503194:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:8.0:1773851872.503195:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.503196:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:8.0:1773851872.503198:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851872.503199:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:8.0:1773851872.503201:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12@kfi7 local destination
00000400:00000200:8.0:1773851872.503203:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769405:8769405:1024:4294967295] 12@kfi7 LPNI seq info [5403457:5403457:16:4294967295]
00000400:00000200:8.0:1773851872.503205:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851872.503207:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851872.503210:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851872.503212:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:8.0:1773851872.503214:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851872.503216:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851872.503220:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851872.503223:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Using peer 12@kfi7(0x47e)
00000800:00000200:8.0:1773851872.503228:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x47e: rc=0
00000800:00000200:8.0:1773851872.503230:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851872.503233:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851872.503234:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000044ea8a8e refcount 6 to 12@kfi7
00010000:00000001:8.0:1773851872.503236:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851872.503236:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.503238:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851872.503239:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008ffbb8dc x1858040940896640/t0(0) o400->lustre5-MDT0001-lwp-OST0011_UUID@12@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba118-0'
00000100:00100000:8.0:1773851872.503244:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ffbb8dc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:lustre5-MDT0001-lwp-OST0011_UUID+5:272597:x1858040940896640:12345-12@kfi7:400:default-yuba118-0 Request processed in 95us (141us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851872.503247:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12@kfi7, seq: 2130793
00000100:00000040:8.0:1773851872.503249:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dde187be : new rpc_count 0
00000100:00000001:8.0:1773851872.503250:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851872.503250:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851872.503251:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.503252:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000020:00000010:8.0:1773851872.503254:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000020:00000040:8.0:1773851872.503255:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000dde187be : new refcount 4
00000100:00000001:8.0:1773851872.503256:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851872.503263:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851872.503265:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.503267:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000400:00000200:9.0:1773851872.503268:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2abdf16
00000400:00000010:9.0:1773851872.503269:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2abdf16.
00000100:00000001:9.0:1773851872.503270:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851872.503271:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851872.503272:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:9.0:1773851872.503274:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Transaction freed
00000800:00000200:9.0:1773851872.525273:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.525273:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.525276:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.525278:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.525279:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.525280:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20320@kfi7 : PUT - for me
00000400:00000200:9.0:1773851872.525281:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.525282:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 1
00000400:00000200:9.0:1773851872.525283:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.525283:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000400:00000200:9.0:1773851872.525284:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 3
00000400:00000200:9.0:1773851872.525285:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000400:00000200:9.0:1773851872.525285:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 520 into portal 12 MB=0x699e2eb477000
00000400:00000200:9.0:1773851872.525287:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20321@kfi7 of length 520/520 into md 0x78146ce49 [64] + 140520
00000800:00000200:9.0:1773851872.525288:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.525289:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.525290:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20320@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.525291:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.525291:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.525292:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ef36a831.
00000100:00000040:9.0:1773851872.525292:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ef36a831 x1858049749250048 msgsize 520
00000100:00100000:9.0:1773851872.525294:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20320@kfi7)
00000100:00000001:9.0:1773851872.525294:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.525295:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000800:00000200:9.0:1773851872.525296:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851872.525297:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851872.525298:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851872.525298:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851872.525299:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851872.525300:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851872.525301:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049749250048
00000020:00000001:8.0:1773851872.525302:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851872.525302:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000020:00000001:8.0:1773851872.525303:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851872.525305:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=312
00000020:00000001:8.0:1773851872.525307:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000001:8.0:1773851872.525308:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00000001:8.0:1773851872.525309:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851872.525310:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851872.525311:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000020:00000010:8.0:1773851872.525312:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.525313:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851872.525314:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851872.525315:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.525315:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851872.525317:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:8.0:1773851872.525318:0:60898:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@00000000ef36a831 x1858049749250048/t0(0) o38->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852072 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1760-0'
00000100:00000001:8.0:1773851872.525322:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851872.525323:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.525324:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.525326:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.525326:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851872.525326:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851872.525327:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20321@kfi7, seq: 2130794
00000100:00000001:8.0:1773851872.525327:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851872.525328:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001c891228 : new rpc_count 3
00000100:00000001:11.0:1773851872.525329:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749202560 : -106947960349056 : ffff9ebb3cd05e80)
00000100:00000001:8.0:1773851872.525329:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.525330:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.525331:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ef36a831 x1858049749250048/t0(0) o38->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852072 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1760-0'
00000100:00000001:11.0:1773851872.525333:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851872.525334:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851872.525335:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef36a831 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:22d610ea-bd49-4aa8-a9ca-314c404a25ba+312:39773:x1858049749250048:12345-20321@kfi7:38:default-tuolumne1760-0
00000100:00000200:11.0:1773851872.525336:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858049749250048
00000020:00000001:11.0:1773851872.525337:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:11.0:1773851872.525338:0:60829:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:11.0:1773851872.525340:0:60829:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:11.0:1773851872.525341:0:60829:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:11.0:1773851872.525343:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851872.525344:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851872.525346:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 00000000d931364d.
02000000:00000001:11.0:1773851872.525347:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.525347:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851872.525349:0:60829:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:11.0:1773851872.525350:0:60829:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 22d610ea-bd49-4aa8-a9ca-314c404a25ba (at 20321@kfi7) reconnecting
00010000:00000001:11.0:1773851872.525351:0:60829:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:11.0:1773851872.525352:0:60829:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:11.0:1773851872.525353:0:60829:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from 22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7 t183183219910 exp 000000001c891228 cur 614146 last 1773851872
00010000:00000001:11.0:1773851872.525354:0:60829:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:11.0:1773851872.525355:0:60829:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:11.0:1773851872.525356:0:60829:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:11.0:1773851872.525357:0:60829:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:11.0:1773851872.525358:0:60829:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:11.0:1773851872.525358:0:60829:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:11.0:1773851872.525359:0:60829:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:11.0:1773851872.525360:0:60829:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:11.0:1773851872.525361:0:60829:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:11.0:1773851872.525362:0:60829:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.525363:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:11.0:1773851872.525363:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851872.525364:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 22d610ea-bd49-4aa8-a9ca-314c404a25ba/000000001c891228 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851872.525365:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851872.525366:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 22d610ea-bd49-4aa8-a9ca-314c404a25ba/000000001c891228 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851872.525367:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851872.525368:0:60829:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:11.0:1773851872.525369:0:60829:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:11.0:1773851872.525369:0:60829:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli 22d610ea-bd49-4aa8-a9ca-314c404a25ba/000000001c891228 ocd_grant: 1878786047 want: 2097152 left: 112130449866752
00000020:00000001:11.0:1773851872.525370:0:60829:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:11.0:1773851872.525371:0:60829:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 20321@kfi7 supports cksum type f7, return f7
00000004:00000001:11.0:1773851872.525372:0:60829:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:11.0:1773851872.525373:0:60829:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:11.0:1773851872.525374:0:60829:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:11.0:1773851872.525375:0:60829:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851872.525376:0:60829:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851872.525377:0:60829:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.525378:0:60829:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 000000001c891228 : new rpc_count 2
00000020:00000040:11.0:1773851872.525378:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 312
00000020:00000040:11.0:1773851872.525379:0:60829:0:(genops.c:871:class_export_get()) GET export 000000001c891228 refcount=313
00000100:00000040:11.0:1773851872.525380:0:60829:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 000000001c891228 : new rpc_count 3
00000100:00000001:11.0:1773851872.525381:0:60829:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:11.0:1773851872.525382:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000400:00000200:11.0:1773851872.525383:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050944c38 nid 20321@kfi7 refs 1
00000400:00000200:11.0:1773851872.525384:0:60829:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 0000000050944c38 nid 20321@kfi7 refs 2
00000400:00000200:11.0:1773851872.525386:0:60829:0:(peer.c:1555:LNetPrimaryNID()) NID 20321@kfi7 primary NID 20321@kfi7 rc 0
00000100:00000001:11.0:1773851872.525412:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851872.525412:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fbb9e656 refcount 3 to 20321@kfi7
00000100:00000001:11.0:1773851872.525413:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094496 : -107139307457120 : ffff9e8eafa335a0)
00000100:00000001:11.0:1773851872.525414:0:60829:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636934402094496 : -107139307457120 : 0xffff9e8eafa335a0)
00000100:00000040:11.0:1773851872.525415:0:60829:0:(connection.c:133:ptlrpc_connection_get()) conn=00000000fbb9e656 refcount 3 to 20321@kfi7
00000100:00080000:11.0:1773851872.525416:0:60829:0:(import.c:86:import_set_state_nolock()) 0000000000257bbb nCÞ: changing import state from FULL to RECOVER
00010000:00000040:11.0:1773851872.525417:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fbb9e656 refcount 2 to 20321@kfi7
00000100:00000001:11.0:1773851872.525418:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851872.525418:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fbb9e656 refcount 3 to 20321@kfi7
00000100:00000001:11.0:1773851872.525419:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094496 : -107139307457120 : ffff9e8eafa335a0)
02000000:00000001:11.0:1773851872.525420:0:60829:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:11.0:1773851872.525420:0:60829:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:11.0:1773851872.525421:0:60829:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.525422:0:60829:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:11.0:1773851872.525423:0:60829:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:11.0:1773851872.525424:0:60829:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:11.0:1773851872.525424:0:60829:0:(import.c:86:import_set_state_nolock()) 0000000000257bbb nCÞ: changing import state from RECOVER to FULL
00000100:00000001:11.0:1773851872.525425:0:60829:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:11.0:1773851872.525426:0:60829:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:11.0:1773851872.525427:0:60829:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851872.525427:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 312
00000020:00000040:11.0:1773851872.525428:0:60829:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:11.0:1773851872.525429:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fbb9e656 refcount 2 to 20321@kfi7
00010000:00000001:11.0:1773851872.525430:0:60829:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.525430:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851872.525431:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:11.0:1773851872.525431:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:11.0:1773851872.525432:0:60829:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851872.525433:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851872.525434:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851872.525434:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.525435:0:60829:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:11.0:1773851872.525436:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851872.525437:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:11.0:1773851872.525437:0:60829:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:11.0:1773851872.525438:0:60829:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.525438:0:60829:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851872.525439:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578129, transno 0, xid 1858049749250048
00010000:00000001:11.0:1773851872.525440:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851872.525440:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ef36a831 x1858049749250048/t0(0) o38->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852072 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1760-0'
00010000:00000001:11.0:1773851872.525443:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851872.525443:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851872.525444:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00001000:11.0:1773851872.525445:0:60829:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:11.0:1773851872.525446:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851872.525447:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fbb9e656 refcount 3 to 20321@kfi7
00000100:00000001:11.0:1773851872.525447:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094496 : -107139307457120 : ffff9e8eafa335a0)
02000000:00000001:11.0:1773851872.525448:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851872.525448:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.525449:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851872.525450:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20320@kfi7
00000400:00000010:11.0:1773851872.525450:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000151638b3.
00000100:00000200:11.0:1773851872.525451:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858049749250048, offset 0
00000400:00000200:11.0:1773851872.525452:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20320@kfi7
00000400:00000200:11.0:1773851872.525453:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:11.0:1773851872.525454:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 1
00000400:00000200:11.0:1773851872.525455:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000400:00000200:11.0:1773851872.525456:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 3
00000400:00000200:11.0:1773851872.525457:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20320@kfi7 local destination
00000400:00000200:11.0:1773851872.525458:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769406:8769406:1024:4294967295] 20320@kfi7 LPNI seq info [18599945:18599945:16:4294967295]
00000400:00000200:11.0:1773851872.525462:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000400:00000200:11.0:1773851872.525463:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:11.0:1773851872.525465:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20320@kfi7(20320@kfi7:20320@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851872.525466:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 3
00000800:00000200:11.0:1773851872.525467:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851872.525468:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:11.0:1773851872.525471:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851872.525473:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x183 Using peer 20320@kfi7(0x183)
00000800:00000200:11.0:1773851872.525476:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 516 bytes to peer 0x183: rc=0
00000800:00000200:11.0:1773851872.525478:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x183 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851872.525480:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.525480:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fbb9e656 refcount 2 to 20321@kfi7
00010000:00000001:11.0:1773851872.525481:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851872.525482:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.525482:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851872.525484:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ef36a831 x1858049749250048/t0(0) o38->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852072 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1760-0'
00000100:00100000:11.0:1773851872.525488:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef36a831 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:22d610ea-bd49-4aa8-a9ca-314c404a25ba+312:39773:x1858049749250048:12345-20321@kfi7:38:default-tuolumne1760-0 Request processed in 153us (194us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851872.525488:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x183 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851872.525490:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851872.525491:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20321@kfi7, seq: 2130794
00000100:00000040:11.0:1773851872.525491:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001c891228 : new rpc_count 2
00000100:00000001:11.0:1773851872.525492:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851872.525492:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851872.525492:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20320@kfi7: PUT: OK
00000020:00000010:11.0:1773851872.525493:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000400:00000200:10.0:1773851872.525493:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000151638b3
00000400:00000010:10.0:1773851872.525493:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000151638b3.
00000020:00000010:11.0:1773851872.525494:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000100:00000001:10.0:1773851872.525494:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851872.525494:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851872.525495:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000400:00000200:10.0:1773851872.525495:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000020:00000040:11.0:1773851872.525496:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 311
00000100:00000001:11.0:1773851872.525496:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851872.525497:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 20320@kfi7(000000000f2cdd5c):0x0 lsk 388 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x183 Transaction freed
00000800:00000200:21.0:1773851872.525847:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851872.525848:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.525850:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:21.0:1773851872.525850:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20321@kfi7(00000000c6f4648c):0x0 lsk 387 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.525851:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851872.525852:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.525852:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851872.525852:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20321@kfi7(00000000c6f4648c):0x0 lsk 387 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:27.0:1773851872.525854:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851872.525854:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000800:00000200:27.0:1773851872.525855:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.525855:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20384@kfi7(00000000830a8d36):0xc9a version: 2; local version 2; negotiated version: 2
00000400:00000200:21.0:1773851872.525855:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20321@kfi7 : PUT - for me
00000800:00000200:25.0:1773851872.525857:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c9a Using peer 20384@kfi7(0x100000000000c9a)
00000400:00000200:21.0:1773851872.525857:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000800:00000200:10.0:1773851872.525857:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:21.0:1773851872.525858:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050944c38 nid 20321@kfi7 refs 1
00000800:00000200:10.0:1773851872.525858:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851872.525859:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851872.525859:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000400:00000200:21.0:1773851872.525859:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000800:00000200:10.0:1773851872.525859:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851872.525860:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050944c38 nid 20321@kfi7 refs 2
00000800:00000200:25.0:1773851872.525861:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000f6d78ee2: Posted send of 38 bytes to peer 0x100000000000c9a: rc=0
00000400:00000200:21.0:1773851872.525861:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000050944c38 nid 20321@kfi7 refs 3
00000400:00000200:27.0:1773851872.525862:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000800:00000200:25.0:1773851872.525862:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c9a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:21.0:1773851872.525862:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000800:00000200:10.0:1773851872.525862:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851872.525864:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20384@kfi7 : PUT - for me
00000800:00000200:26.0:1773851872.525864:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:21.0:1773851872.525864:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 2528 into portal 12 MB=0x699e2e9012140
00000400:00000200:10.0:1773851872.525864:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000400:00000200:21.0:1773851872.525865:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20321@kfi7 of length 2528/2528 into md 0x6a32cacf5 [64] + 40200
00000400:00000200:27.0:1773851872.525866:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000800:00000200:26.0:1773851872.525866:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.525866:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.525866:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:10.0:1773851872.525866:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20320@kfi7 : PUT - for me
00000400:00000200:27.0:1773851872.525867:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001342cb93 nid 20384@kfi7 refs 1
00000400:00000200:10.0:1773851872.525867:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000800:00000200:6.0:1773851872.525867:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851872.525867:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:26.0:1773851872.525868:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.525868:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000400:00000200:10.0:1773851872.525868:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 1
00000800:00000200:6.0:1773851872.525868:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851872.525868:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:27.0:1773851872.525869:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000400:00000200:10.0:1773851872.525869:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20320@kfi7 to cpt 2
00000800:00000200:6.0:1773851872.525869:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851872.525869:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851872.525870:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20384@kfi7(000000004d75f983):0xda8 version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851872.525870:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20321@kfi7(00000000c6f4648c):0x0 lsk 387 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851872.525871:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001342cb93 nid 20384@kfi7 refs 2
00000400:00000200:21.0:1773851872.525871:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851872.525871:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000800:00000200:26.0:1773851872.525872:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851872.525872:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xda8 Using peer 20384@kfi7(0xda8)
00000400:00000200:10.0:1773851872.525872:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 3
00000800:00000200:6.0:1773851872.525872:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851872.525872:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20385@kfi7(000000002aba91c8):0x188 version: 2; local version 2; negotiated version: 2
00000400:00000200:27.0:1773851872.525873:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001342cb93 nid 20384@kfi7 refs 3
00000400:00000200:21.0:1773851872.525873:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20321@kfi7: PUT: OK
00000400:00000200:10.0:1773851872.525873:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000100:00000001:21.0:1773851872.525874:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851872.525874:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000400:00000200:10.0:1773851872.525874:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 392 into portal 23 MB=0x699e2ea258e00
00000400:00000200:6.0:1773851872.525874:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000800:00000200:5.0:1773851872.525874:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000188 Using peer 20385@kfi7(0x100000000000188)
00000400:00000200:27.0:1773851872.525875:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000100:00000010:21.0:1773851872.525875:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002d9e6c0f.
00000400:00000200:10.0:1773851872.525875:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-20321@kfi7 of length 392/392 into md 0x78166cd09 [2] + 1960
00000100:00000040:21.0:1773851872.525876:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002d9e6c0f x1858049711087936 msgsize 2528
00000400:00000010:10.0:1773851872.525876:0:2464469:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000019371521.
00000400:00000200:6.0:1773851872.525876:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20385@kfi7 : PUT - for me
00000400:00000200:27.0:1773851872.525877:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 392 into portal 23 MB=0x699e2ea23c3c0
00000400:00000200:25.0:1773851872.525877:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000400:00000200:10.0:1773851872.525877:0:2464469:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 0000000000c07010
00000400:00000200:5.0:1773851872.525877:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000100:00100000:21.0:1773851872.525878:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20321@kfi7)
00000400:00000200:6.0:1773851872.525878:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000400:00000200:26.0:1773851872.525879:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000100:00000001:21.0:1773851872.525879:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:5.0:1773851872.525880:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 38 bytes to peer 0x100000000000188: rc=0
00000400:00000200:27.0:1773851872.525881:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-20321@kfi7 of length 392/392 into md 0x1615b62ff9 [2] + 0
00000800:00000200:25.0:1773851872.525881:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000009b172e83: Posted send of 38 bytes to peer 0xda8: rc=0
00000100:00000001:23.0:1773851872.525881:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851872.525881:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:21.0:1773851872.525881:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000050944c38 nid 20321@kfi7 refs 2
00000400:00000200:6.0:1773851872.525881:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba283b2f nid 20385@kfi7 refs 1
00000100:00000001:23.0:1773851872.525882:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851872.525882:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851872.525883:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20384@kfi7 : PUT - for me
00000800:00000200:25.0:1773851872.525883:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xda8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851872.525883:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851872.525883:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851872.525883:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20321@kfi7(00000000c6f4648c):0x0 lsk 387 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:6.0:1773851872.525883:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000800:00000200:5.0:1773851872.525883:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000188 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:27.0:1773851872.525884:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:23.0:1773851872.525884:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049711087936
00000400:00000200:10.0:1773851872.525884:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851872.525884:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba283b2f nid 20385@kfi7 refs 2
00000400:00000200:26.0:1773851872.525885:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000020:00000001:23.0:1773851872.525885:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851872.525885:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000400:00000200:10.0:1773851872.525885:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20320@kfi7: PUT: OK
00000400:00000200:6.0:1773851872.525885:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ba283b2f nid 20385@kfi7 refs 3
00000020:00000001:23.0:1773851872.525886:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:27.0:1773851872.525887:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851872.525887:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001342cb93 nid 20384@kfi7 refs 2
00000400:00000200:10.0:1773851872.525887:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000000c07010
00000400:00000010:10.0:1773851872.525887:0:2464469:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 0000000000c07010 (tot 253200619).
00000400:00000200:6.0:1773851872.525887:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000400:00000200:26.0:1773851872.525888:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000800:00000200:25.0:1773851872.525888:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000020:00000040:23.0:1773851872.525888:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=312
00000100:00000001:10.0:1773851872.525888:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:6.0:1773851872.525888:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 392 into portal 23 MB=0x699e2ea275740
00000400:00000200:27.0:1773851872.525889:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20384@kfi7: PUT: OK
00000400:00000200:26.0:1773851872.525889:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001342cb93 nid 20384@kfi7 refs 3
00000800:00000200:25.0:1773851872.525889:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:23.0:1773851872.525889:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00000200:10.0:1773851872.525889:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000040:10.0:1773851872.525889:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000069b74ec7 x1858049730252288 msgsize 392
00000100:00000001:27.0:1773851872.525890:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:25.0:1773851872.525890:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:23.0:1773851872.525890:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000400:00000200:6.0:1773851872.525890:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-20321@kfi7 of length 392/392 into md 0x793aea445 [2] + 1568
00000100:00000200:27.0:1773851872.525891:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:26.0:1773851872.525891:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001342cb93 nid 20384@kfi7 refs 4
00000100:00000001:23.0:1773851872.525891:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851872.525891:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000010:27.0:1773851872.525892:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e17b717c.
00000020:00000010:23.0:1773851872.525892:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b72ef93.
00000100:00100000:10.0:1773851872.525892:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20320@kfi7)
00000100:00000040:10.0:1773851872.525892:0:2464469:0:(events.c:370:request_in_callback()) Buffer complete: 52 buffers still posted
00000800:00000200:6.0:1773851872.525892:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851872.525892:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000188 TN_EVENT_TX_OK event status 0
00000100:00000040:27.0:1773851872.525893:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000e17b717c x1858049730134976 msgsize 392
00000400:00000200:26.0:1773851872.525893:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000800:00000200:25.0:1773851872.525893:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:23.0:1773851872.525893:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000100:00000001:10.0:1773851872.525893:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851872.525894:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 392 into portal 23 MB=0x699e2ea24c800
00000020:00000010:23.0:1773851872.525894:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000400:00000200:10.0:1773851872.525894:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000385d0253 nid 20320@kfi7 refs 2
00000400:00000200:6.0:1773851872.525894:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.525895:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000100:00000001:23.0:1773851872.525895:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851872.525895:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.525895:0:60519:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851872.525895:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20385@kfi7: PUT: OK
00000800:00000200:5.0:1773851872.525895:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000188 Transaction freed
00000100:00100000:27.0:1773851872.525896:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20384@kfi7)
00000400:00000200:25.0:1773851872.525896:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20384@kfi7 : PUT - for me
00000004:00000001:23.0:1773851872.525896:0:60934:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000800:00000200:10.0:1773851872.525896:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20320@kfi7(00000000d78e8af8):0x0 lsk 2699 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851872.525896:0:60519:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851872.525896:0:60519:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851872.525896:0:60519:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851872.525896:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:26.0:1773851872.525897:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-20321@kfi7 of length 392/392 into md 0x1615b62ff9 [2] + 392
00000400:00000200:25.0:1773851872.525897:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
02000000:00000001:8.0:1773851872.525897:0:60519:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851872.525897:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000001:27.0:1773851872.525898:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851872.525898:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001342cb93 nid 20384@kfi7 refs 3
00000004:00100000:23.0:1773851872.525898:0:60934:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 000000002f22f241 cookie 0x20792502a3aec58b  req@000000002d9e6c0f x1858049711087936/t0(0) o101->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:357/0 lens 2528/0 e 0 to 0 dl 1773852472 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833576629058010112'
00000100:00100000:8.0:1773851872.525898:0:60519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049730252288
00000100:00000010:6.0:1773851872.525898:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c8d445a8.
00000400:00000200:25.0:1773851872.525899:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20384@kfi7 to cpt 6
00000020:00000001:8.0:1773851872.525899:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851872.525899:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000100:00000040:6.0:1773851872.525899:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000c8d445a8 x1858049730369344 msgsize 392
00000400:00000200:25.0:1773851872.525900:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001342cb93 nid 20384@kfi7 refs 4
00000020:00000001:8.0:1773851872.525900:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:26.0:1773851872.525901:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851872.525901:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001342cb93 nid 20384@kfi7 refs 5
00010000:00000001:23.0:1773851872.525901:0:60934:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000040:8.0:1773851872.525901:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=313
00000020:00000001:8.0:1773851872.525901:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00100000:6.0:1773851872.525901:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20385@kfi7)
00000400:00000200:27.0:1773851872.525902:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001342cb93 nid 20384@kfi7 refs 4
00010000:00000001:23.0:1773851872.525902:0:60934:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:23.0:1773851872.525902:0:60934:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851872.525902:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00000001:6.0:1773851872.525902:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851872.525903:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851872.525903:0:60519:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:6.0:1773851872.525903:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba283b2f nid 20385@kfi7 refs 2
00000400:00000200:26.0:1773851872.525904:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.525904:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000100:00000001:8.0:1773851872.525904:0:60519:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851872.525904:0:60519:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000800:00000200:27.0:1773851872.525905:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851872.525905:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 392 into portal 23 MB=0x699e2ea153d80
00000020:00000010:8.0:1773851872.525905:0:60519:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000800:00000200:6.0:1773851872.525905:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 20385@kfi7(000000002aba91c8):0x0 lsk 393 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851872.525905:0:61697:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851872.525905:0:61697:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:26.0:1773851872.525906:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20384@kfi7: PUT: OK
00000100:00080000:23.1F:1773851872.525906:0:60934:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000002d9e6c0f x1858049711087936/t0(0) o101->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:357/0 lens 2528/0 e 0 to 0 dl 1773852472 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833576629058010112'
00000020:00000010:8.0:1773851872.525906:0:60519:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:5.0:1773851872.525906:0:61697:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851872.525906:0:61697:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851872.525907:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-20321@kfi7 of length 392/392 into md 0x1615b62ff9 [2] + 784
00000100:00000001:8.0:1773851872.525907:0:60519:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
02000000:00000001:5.0:1773851872.525907:0:61697:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.525908:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:8.0:1773851872.525908:0:60519:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851872.525908:0:60519:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851872.525908:0:61697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049730369344
00000800:00000200:27.0:1773851872.525909:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c9a TN_EVENT_TX_OK event status 0
00000100:00000200:26.0:1773851872.525909:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000800:00000200:25.0:1773851872.525909:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:5.0:1773851872.525909:0:61697:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851872.525909:0:61697:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000100:00000010:26.0:1773851872.525910:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000028637c2.
00000400:00000200:25.0:1773851872.525910:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00080000:23.1:1773851872.525910:0:60934:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000eeaa9018 x1858049711087936/t0(0) o101->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:593/0 lens 2528/5304 e 21 to 0 dl 1773851915 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833576629058010112'
00000020:00000001:5.0:1773851872.525910:0:61697:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000040:26.0:1773851872.525912:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000028637c2 x1858049730201600 msgsize 392
00000400:00000200:25.0:1773851872.525912:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20384@kfi7: PUT: OK
00000020:00000040:5.0:1773851872.525912:0:61697:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=314
00000800:00000200:27.0:1773851872.525913:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 20384@kfi7(00000000830a8d36):0x0 lsk 3227 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c9a Transaction freed
00000800:00000200:6.0:1773851872.525913:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000020:00000001:5.0:1773851872.525913:0:61697:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00000001:23.0:1773851872.525914:0:60934:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:23.0:1773851872.525914:0:60934:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:7.0:1773851872.525914:0:2507579:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851872.525914:0:2507579:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851872.525914:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000020:00000001:5.0:1773851872.525914:0:61697:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00100000:26.0:1773851872.525915:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20384@kfi7)
00000100:00000001:23.0:1773851872.525915:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851872.525915:0:61697:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851872.525916:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00080000:8.1F:1773851872.525916:0:60519:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000069b74ec7 x1858049730252288/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:357/0 lens 392/0 e 0 to 0 dl 1773852472 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000800:00000200:7.0:1773851872.525916:0:2507579:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e7e04499: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851872.525916:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000100:00000001:5.0:1773851872.525916:0:61697:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851872.525916:0:61697:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000800:00000200:27.0:1773851872.525917:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xda8 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851872.525917:0:61229:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000010:5.0:1773851872.525917:0:61697:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
02000000:00000001:25.0:1773851872.525918:0:61229:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:7.0:1773851872.525918:0:2507579:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e7e04499: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:6.0:1773851872.525918:0:2499722:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20385@kfi7(00000000c9c9ae13):0x11b2 version: 2; local version 2; negotiated version: 2
00000020:00000010:5.0:1773851872.525918:0:61697:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a694bc33.
00000400:00000200:26.0:1773851872.525919:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001342cb93 nid 20384@kfi7 refs 3
00000100:00000001:25.0:1773851872.525919:0:61229:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851872.525919:0:61229:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851872.525919:0:2499722:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b2 Using peer 20385@kfi7(0x11b2)
00000100:00000001:5.0:1773851872.525919:0:61697:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
02000000:00000001:25.0:1773851872.525920:0:61229:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851872.525920:0:61229:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049730134976
00000100:00080000:8.1:1773851872.525920:0:60519:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000055732e1f x1858049730252288/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:555/0 lens 392/0 e 1 to 0 dl 1773851915 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000400:00000200:7.0:1773851872.525920:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000100:00000001:5.0:1773851872.525920:0:61697:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851872.525920:0:61697:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851872.525921:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xda8 Transaction freed
00000020:00000001:25.0:1773851872.525921:0:61229:0:(genops.c:802:class_conn2export()) Process entered
00000400:00000200:6.0:1773851872.525921:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000800:00000200:26.0:1773851872.525922:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000040:25.0:1773851872.525922:0:61229:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000020:00000001:25.0:1773851872.525922:0:61229:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:7.0:1773851872.525922:0:2507579:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20385@kfi7 : PUT - for me
00000100:00000001:23.0:1773851872.525923:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851872.525923:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:8.0:1773851872.525923:0:60519:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:7.0:1773851872.525923:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000400:00000200:7.0:1773851872.525923:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba283b2f nid 20385@kfi7 refs 1
00000800:00000200:6.0:1773851872.525923:0:2499722:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 38 bytes to peer 0x11b2: rc=0
00000100:00000001:8.0:1773851872.525924:0:60519:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:7.0:1773851872.525924:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20385@kfi7 to cpt 1
00000020:00000040:25.0:1773851872.525925:0:61229:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=315
00000020:00000001:25.0:1773851872.525925:0:61229:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000010:23.0:1773851872.525925:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:23.0:1773851872.525925:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b72ef93.
00000100:00000001:8.0:1773851872.525925:0:60519:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:7.0:1773851872.525925:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba283b2f nid 20385@kfi7 refs 2
00000800:00000200:6.0:1773851872.525925:0:2499722:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00080000:5.1:1773851872.525925:0:61697:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000c8d445a8 x1858049730369344/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:357/0 lens 392/0 e 0 to 0 dl 1773852472 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000020:00000001:25.0:1773851872.525926:0:61229:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000040:23.0:1773851872.525926:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 314
00000400:00000200:7.0:1773851872.525926:0:2507579:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ba283b2f nid 20385@kfi7 refs 3
00000100:00000001:23.0:1773851872.525927:0:60934:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851872.525927:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20321@kfi7 to cpt 5
00000100:00000001:25.0:1773851872.525928:0:61229:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851872.525928:0:61229:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:7.0:1773851872.525928:0:2507579:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20321@kfi7 of length 392 into portal 23 MB=0x699e2e92da280
00000100:00080000:5.1:1773851872.525928:0:61697:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000088d1c8e4 x1858049730369344/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:555/0 lens 392/0 e 1 to 0 dl 1773851915 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000020:00000010:25.0:1773851872.525929:0:61229:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:25.0:1773851872.525930:0:61229:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000400:00000200:7.0:1773851872.525930:0:2507579:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-20321@kfi7 of length 392/392 into md 0x793aea445 [2] + 1960
00000020:00000010:25.0:1773851872.525931:0:61229:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055dcba11.
00000100:00000001:8.0:1773851872.525931:0:60519:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:7.0:1773851872.525931:0:2507579:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000067caeb8c.
00000100:00000001:5.0:1773851872.525931:0:61697:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:25.0:1773851872.525932:0:61229:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851872.525932:0:61229:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851872.525932:0:61229:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:8.0:1773851872.525932:0:60519:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851872.525932:0:60519:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000400:00000200:7.0:1773851872.525932:0:2507579:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000d72b3ccb
00000100:00000001:5.0:1773851872.525932:0:61697:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:8.0:1773851872.525933:0:60519:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000800:00000200:7.0:1773851872.525933:0:2507579:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e7e04499: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851872.525933:0:61697:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000040:8.0:1773851872.525934:0:60519:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 313
00000100:00000010:8.0:1773851872.525935:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f54b12bf.
00000400:00000200:7.0:1773851872.525935:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00080000:25.1F:1773851872.525936:0:61229:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000e17b717c x1858049730134976/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:357/0 lens 392/0 e 0 to 0 dl 1773852472 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00000010:8.0:1773851872.525936:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f2d41e54.
00000400:00000200:7.0:1773851872.525936:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20385@kfi7: PUT: OK
00000100:00000010:8.0:1773851872.525937:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000094637c7a.
00000400:00000200:7.0:1773851872.525937:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d72b3ccb
00000100:00000010:8.0:1773851872.525938:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ab60c446.
00000400:00000010:7.0:1773851872.525938:0:2507579:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000d72b3ccb (tot 253200467).
00000800:00000200:6.0:1773851872.525938:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b2 TN_EVENT_TX_OK event status 0
00000100:00000010:8.0:1773851872.525939:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bfff00de.
00000100:00080000:25.1:1773851872.525940:0:61229:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000003d850e90 x1858049730134976/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:555/0 lens 392/0 e 1 to 0 dl 1773851915 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:8.0:1773851872.525940:0:60519:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851872.525940:0:2507579:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:7.0:1773851872.525940:0:2507579:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000040:7.0:1773851872.525941:0:2507579:0:(events.c:358:request_in_callback()) incoming req@00000000f1fb440c x1858049714004608 msgsize 392
00000800:00000200:6.0:1773851872.525941:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b2 Transaction freed
00000100:00000200:8.0:1773851872.525942:0:60519:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt_readpage: registering portal 23
00000400:00000010:8.0:1773851872.525942:0:60519:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000007d88ff4.
00000100:00000001:25.0:1773851872.525943:0:61229:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000010:8.0:1773851872.525943:0:60519:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000e65e99ba (tot 253200619).
00000100:00100000:7.0:1773851872.525943:0:2507579:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20385@kfi7)
00000100:00000001:5.0:1773851872.525943:0:61697:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851872.525944:0:61229:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000040:7.0:1773851872.525944:0:2507579:0:(events.c:370:request_in_callback()) Buffer complete: 61 buffers still posted
00000020:00000010:5.0:1773851872.525944:0:61697:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00000001:25.0:1773851872.525945:0:61229:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851872.525945:0:2507579:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:7.0:1773851872.525945:0:2507579:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba283b2f nid 20385@kfi7 refs 2
00000020:00000010:5.0:1773851872.525945:0:61697:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a694bc33.
00000100:00000001:25.0:1773851872.525946:0:61229:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851872.525946:0:61229:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:5.0:1773851872.525946:0:61697:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000020:00000040:5.0:1773851872.525946:0:61697:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 312
00000020:00000010:25.0:1773851872.525947:0:61229:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055dcba11.
00000800:00000200:7.0:1773851872.525947:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e7e04499: 2069@kfi7:1 <- 20385@kfi7(00000000c9c9ae13):0x0 lsk 4531 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851872.525947:0:61697:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:25.0:1773851872.525948:0:61229:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:25.0:1773851872.525949:0:61229:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 311
00000100:00000001:5.0:1773851872.525949:0:61697:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851872.525949:0:61697:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851872.525950:0:61229:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851872.525950:0:61697:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851872.525950:0:61697:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.525951:0:61229:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851872.525951:0:61229:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
02000000:00000001:5.0:1773851872.525951:0:61697:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.525952:0:61229:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851872.525952:0:61229:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851872.525952:0:61697:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049714004608
00000020:00000001:5.0:1773851872.525952:0:61697:0:(genops.c:802:class_conn2export()) Process entered
02000000:00000001:25.0:1773851872.525953:0:61229:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:5.0:1773851872.525953:0:61697:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000020:00000001:5.0:1773851872.525953:0:61697:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:25.0:1773851872.525954:0:61229:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049730201600
00000020:00000001:25.0:1773851872.525954:0:61229:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851872.525954:0:61697:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=312
00000020:00000040:25.0:1773851872.525955:0:61229:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000020:00000001:25.0:1773851872.525955:0:61229:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:5.0:1773851872.525955:0:61697:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000040:25.0:1773851872.525956:0:61229:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=313
00000020:00000001:5.0:1773851872.525956:0:61697:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000001:25.0:1773851872.525957:0:61229:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000001:25.0:1773851872.525957:0:61229:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00000001:5.0:1773851872.525957:0:61697:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851872.525958:0:61229:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851872.525958:0:61697:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851872.525958:0:61697:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eff00cf0.
00000100:00000001:25.0:1773851872.525959:0:61229:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851872.525959:0:61229:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:5.0:1773851872.525959:0:61697:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:25.0:1773851872.525960:0:61229:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:5.0:1773851872.525960:0:61697:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a694bc33.
00000020:00000010:25.0:1773851872.525961:0:61229:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055dcba11.
00000100:00000001:5.0:1773851872.525961:0:61697:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851872.525962:0:61229:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851872.525962:0:61697:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:5.0:1773851872.525962:0:61697:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.525963:0:61229:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851872.525963:0:61229:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:5.1:1773851872.525964:0:61697:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000f1fb440c x1858049714004608/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:248/0 lens 392/0 e 0 to 0 dl 1773852363 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00080000:5.1:1773851872.525967:0:61697:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000586b7287 x1858049714004608/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:395/0 lens 392/456 e 1 to 0 dl 1773851806 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00000001:5.0:1773851872.525970:0:61697:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:5.0:1773851872.525970:0:61697:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00080000:25.1:1773851872.525971:0:61229:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000028637c2 x1858049730201600/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:357/0 lens 392/0 e 0 to 0 dl 1773852472 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00000001:5.0:1773851872.525971:0:61697:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00080000:25.1:1773851872.525974:0:61229:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000001e141be0 x1858049730201600/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:555/0 lens 392/0 e 1 to 0 dl 1773851915 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:25.0:1773851872.525976:0:61229:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:5.0:1773851872.525976:0:61697:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851872.525977:0:61229:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:5.0:1773851872.525977:0:61697:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00000001:25.0:1773851872.525978:0:61229:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851872.525978:0:61229:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851872.525978:0:61697:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a694bc33.
00000020:00000010:25.0:1773851872.525979:0:61229:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:5.0:1773851872.525979:0:61697:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eff00cf0.
00000020:00000040:5.0:1773851872.525979:0:61697:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 312
00000020:00000010:25.0:1773851872.525980:0:61229:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055dcba11.
00000020:00000010:25.0:1773851872.525980:0:61229:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:25.0:1773851872.525981:0:61229:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 311
00000100:00000010:5.0:1773851872.525981:0:61697:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c8d445a8.
00000100:00000001:25.0:1773851872.525982:0:61229:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:5.0:1773851872.525982:0:61697:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000022ae51d.
00000100:00000010:5.0:1773851872.525983:0:61697:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a4c4c29b.
00000100:00000001:25.0:1773851872.525984:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000010:5.0:1773851872.525984:0:61697:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008aa264ee.
00000100:00000010:5.0:1773851872.525984:0:61697:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e6396b73.
00000100:00000200:25.0:1773851872.525985:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000010:25.0:1773851872.525985:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008d43c5cb.
00000100:00000001:5.0:1773851872.525985:0:61697:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:25.0:1773851872.525986:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000008d43c5cb x1858049729183104 msgsize 392
00000100:00000200:5.0:1773851872.525987:0:61697:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt_readpage: registering portal 23
00000100:00100000:25.0:1773851872.525988:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20321@kfi7 (source: 12345-20384@kfi7)
00000400:00000010:5.0:1773851872.525988:0:61697:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000044a0e143.
00000100:00000001:25.0:1773851872.525989:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000010:5.0:1773851872.525989:0:61697:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 0000000081f5f8eb (tot 253200771).
00000400:00000200:25.0:1773851872.525990:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001342cb93 nid 20384@kfi7 refs 2
00000800:00000200:25.0:1773851872.525992:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 20384@kfi7(000000004d75f983):0x0 lsk 3497 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851872.525997:0:61229:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851872.525997:0:61229:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851872.525998:0:61229:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851872.525998:0:61229:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851872.525999:0:61229:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851872.525999:0:61229:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049729183104
00000020:00000001:25.0:1773851872.526000:0:61229:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851872.526000:0:61229:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a02
00000020:00000001:25.0:1773851872.526000:0:61229:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851872.526001:0:61229:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001c891228 refcount=312
00000020:00000001:25.0:1773851872.526001:0:61229:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000020:00000001:25.0:1773851872.526002:0:61229:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242245120 : -107152467306496 : ffff9e8b9f3fd800)
00000100:00000001:25.0:1773851872.526003:0:61229:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851872.526004:0:61229:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851872.526004:0:61229:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b068e8bb.
00000020:00000010:25.0:1773851872.526005:0:61229:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851872.526006:0:61229:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055dcba11.
00000100:00000001:25.0:1773851872.526006:0:61229:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851872.526007:0:61229:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851872.526007:0:61229:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:25.1:1773851872.526008:0:61229:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000008d43c5cb x1858049729183104/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:357/0 lens 392/0 e 0 to 0 dl 1773852472 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00080000:25.1:1773851872.526011:0:61229:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000005bfd469a x1858049729183104/t0(0) o35->22d610ea-bd49-4aa8-a9ca-314c404a25ba@20321@kfi7:555/0 lens 392/0 e 1 to 0 dl 1773851915 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:25.0:1773851872.526013:0:61229:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:25.0:1773851872.526014:0:61229:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:25.0:1773851872.526015:0:61229:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851872.526015:0:61229:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851872.526015:0:61229:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851872.526016:0:61229:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055dcba11.
00000020:00000010:25.0:1773851872.526016:0:61229:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b068e8bb.
00000020:00000040:25.0:1773851872.526017:0:61229:0:(genops.c:882:class_export_put()) PUTting export 000000001c891228 : new refcount 311
00000100:00000001:25.0:1773851872.526018:0:61229:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851872.527086:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851872.527086:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851872.527086:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851872.527086:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851872.527088:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851872.527088:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851872.527090:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851872.527090:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17330@kfi7(0000000044549e44):0x307 version: 2; local version 2; negotiated version: 2
00000400:00000200:6.0:1773851872.527092:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17330@kfi7 to cpt 1
00000800:00000200:5.0:1773851872.527092:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 Using peer 17330@kfi7(0x307)
00000400:00000200:6.0:1773851872.527093:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17330@kfi7 : PUT - for me
00000400:00000200:6.0:1773851872.527094:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17330@kfi7 to cpt 1
00000400:00000200:6.0:1773851872.527095:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b24ba275 nid 17330@kfi7 refs 1
00000400:00000200:6.0:1773851872.527096:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17330@kfi7 to cpt 1
00000400:00000200:6.0:1773851872.527097:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b24ba275 nid 17330@kfi7 refs 2
00000400:00000200:6.0:1773851872.527097:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b24ba275 nid 17330@kfi7 refs 3
00000400:00000200:5.0:1773851872.527098:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17330@kfi7 to cpt 1
00000400:00000200:6.0:1773851872.527099:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17267@kfi7 to cpt 1
00000400:00000200:6.0:1773851872.527100:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17267@kfi7 of length 456 into portal 12 MB=0x69b4b5b799280
00000800:00000200:5.0:1773851872.527100:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 38 bytes to peer 0x307: rc=0
00000400:00000200:6.0:1773851872.527101:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17267@kfi7 of length 456/456 into md 0x793926dc5 [64] + 147600
00000800:00000200:5.0:1773851872.527101:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851872.527103:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851872.527104:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851872.527106:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17330@kfi7: PUT: OK
00000100:00000001:6.0:1773851872.527106:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851872.527107:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851872.527108:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e658c4e2.
00000100:00000040:6.0:1773851872.527108:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000e658c4e2 x1859597819810432 msgsize 456
00000100:00100000:6.0:1773851872.527110:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-17267@kfi7 (source: 12345-17330@kfi7)
00000100:00000001:6.0:1773851872.527111:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851872.527112:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b24ba275 nid 17330@kfi7 refs 2
00000100:00000001:7.0:1773851872.527113:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851872.527113:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000800:00000200:5.0:1773851872.527113:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 TN_EVENT_TX_OK event status 0
02000000:00000001:7.0:1773851872.527114:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851872.527114:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851872.527115:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851872.527115:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 Transaction freed
02000000:00000001:7.0:1773851872.527116:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851872.527117:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597819810432
00000020:00000001:7.0:1773851872.527117:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851872.527118:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80748
00000020:00000001:7.0:1773851872.527118:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851872.527121:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000442ad82 refcount=5
00000020:00000001:7.0:1773851872.527122:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150544965632 : -106923164585984 : ffff9ec102c1b000)
00000020:00000001:7.0:1773851872.527123:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637150544965632 : -106923164585984 : ffff9ec102c1b000)
00000100:00000001:7.0:1773851872.527124:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851872.527125:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851872.527125:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851872.527126:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851872.527127:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851872.527128:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851872.527128:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851872.527129:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851872.527130:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851872.527131:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851872.527132:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851872.527133:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851872.527133:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851872.527133:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851872.527134:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17267@kfi7, seq: 371100845
00000100:00000040:7.0:1773851872.527135:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000442ad82 : new rpc_count 1
00000100:00000001:4.0:1773851872.527135:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851872.527136:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851872.527147:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814060032 : -107101895491584 : ffff9e9765908000)
00000100:00000040:7.0:1773851872.527148:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e658c4e2 x1859597819810432/t0(0) o17->59b0c1fb-f00a-4d63-b109-47359fc92610@17267@kfi7:599/0 lens 456/0 e 0 to 0 dl 1773851959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1562-0'
00000100:00000001:7.0:1773851872.527151:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851872.527151:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851872.527152:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e658c4e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:59b0c1fb-f00a-4d63-b109-47359fc92610+5:39506:x1859597819810432:12345-17267@kfi7:17:default-tuolumne1562-0
00000100:00000200:7.0:1773851872.527153:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597819810432
00000020:00000001:7.0:1773851872.527154:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851872.527155:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851872.527155:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851872.527156:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851872.527156:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:7.0:1773851872.527157:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851872.527158:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597819810432, found 0 last_xid 1859597819810431
00000020:00000001:7.0:1773851872.527159:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851872.527159:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851872.527160:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851872.527160:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851872.527161:0:60963:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:7.0:1773851872.527162:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851872.527163:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851872.527163:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000008b0c42b.
02000000:00000001:7.0:1773851872.527164:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851872.527164:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851872.527165:0:60963:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:7.0:1773851872.527166:0:60963:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:7.0:1773851872.527167:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851872.527168:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851872.527169:0:60963:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:7.0:1773851872.527169:0:60963:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 59b0c1fb-f00a-4d63-b109-47359fc92610/000000000442ad82 free: 126633370845184 avail: 126633368748032
00000020:00000001:7.0:1773851872.527170:0:60963:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:7.0:1773851872.527171:0:60963:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 59b0c1fb-f00a-4d63-b109-47359fc92610/000000000442ad82 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:7.0:1773851872.527174:0:60963:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:7.0:1773851872.527175:0:60963:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:7.0:1773851872.527176:0:60963:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 59b0c1fb-f00a-4d63-b109-47359fc92610/000000000442ad82 reports grant 23330816 dropped 0, local 24379392
00000020:00000001:7.0:1773851872.527177:0:60963:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:7.0:1773851872.527177:0:60963:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:7.0:1773851872.527178:0:60963:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851872.527178:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915825843, transno 0, xid 1859597819810432
00010000:00000001:7.0:1773851872.527179:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851872.527180:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e658c4e2 x1859597819810432/t0(0) o17->59b0c1fb-f00a-4d63-b109-47359fc92610@17267@kfi7:599/0 lens 456/432 e 0 to 0 dl 1773851959 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1562-0'
00010000:00000001:7.0:1773851872.527183:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851872.527183:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851872.527184:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=104 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851872.527185:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851872.527186:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003f7b5c0b refcount 3 to 17267@kfi7
00000100:00000001:7.0:1773851872.527186:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231614720 : -107130477936896 : ffff9e90bdeaff00)
02000000:00000001:7.0:1773851872.527188:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851872.527188:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851872.527189:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851872.527190:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17330@kfi7
00000400:00000010:7.0:1773851872.527190:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012526ad9.
00000100:00000200:7.0:1773851872.527191:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859597819810432, offset 224
00000400:00000200:7.0:1773851872.527192:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17330@kfi7
00000400:00000200:7.0:1773851872.527193:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17330@kfi7 to cpt 1
00000400:00000200:7.0:1773851872.527194:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b24ba275 nid 17330@kfi7 refs 1
00000400:00000200:7.0:1773851872.527195:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b24ba275 nid 17330@kfi7 refs 2
00000400:00000200:7.0:1773851872.527197:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b24ba275 nid 17330@kfi7 refs 3
00000400:00000200:7.0:1773851872.527198:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17330@kfi7 local destination
00000400:00000200:7.0:1773851872.527199:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769407:8769407:1024:4294967295] 17330@kfi7 LPNI seq info [424085:424085:16:4294967295]
00000400:00000200:7.0:1773851872.527201:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b24ba275 nid 17330@kfi7 refs 2
00000400:00000200:7.0:1773851872.527201:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17330@kfi7 to cpt 1
00000400:00000200:7.0:1773851872.527204:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17330@kfi7(17330@kfi7:17330@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851872.527205:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b24ba275 nid 17330@kfi7 refs 3
00000800:00000200:7.0:1773851872.527206:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851872.527207:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:7.0:1773851872.527209:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851872.527211:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 Using peer 17330@kfi7(0x307)
00000800:00000200:7.0:1773851872.527214:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 532 bytes to peer 0x307: rc=0
00000800:00000200:7.0:1773851872.527216:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851872.527217:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851872.527218:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003f7b5c0b refcount 2 to 17267@kfi7
00010000:00000001:7.0:1773851872.527219:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851872.527219:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851872.527220:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851872.527221:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e658c4e2 x1859597819810432/t0(0) o17->59b0c1fb-f00a-4d63-b109-47359fc92610@17267@kfi7:599/0 lens 456/432 e 0 to 0 dl 1773851959 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1562-0'
00000100:00100000:7.0:1773851872.527224:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e658c4e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:59b0c1fb-f00a-4d63-b109-47359fc92610+5:39506:x1859597819810432:12345-17267@kfi7:17:default-tuolumne1562-0 Request processed in 72us (114us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851872.527226:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17267@kfi7, seq: 371100845
00000100:00000040:7.0:1773851872.527227:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000442ad82 : new rpc_count 0
00000800:00000200:5.0:1773851872.527227:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851872.527228:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851872.527228:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851872.527228:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851872.527229:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851872.527230:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000400:00000200:5.0:1773851872.527230:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17330@kfi7: PUT: OK
00000400:00000200:5.0:1773851872.527230:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012526ad9
00000020:00000010:7.0:1773851872.527231:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000020:00000040:7.0:1773851872.527231:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000000442ad82 : new refcount 4
00000400:00000010:5.0:1773851872.527231:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012526ad9.
00000100:00000001:5.0:1773851872.527231:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851872.527232:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851872.527232:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851872.527233:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b24ba275 nid 17330@kfi7 refs 2
00000800:00000200:5.0:1773851872.527234:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 17330@kfi7(0000000044549e44):0x0 lsk 776 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x307 Transaction freed
00000004:00000001:10.0:1773851872.585733:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851872.585734:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851872.585734:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851872.585734:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000171a07a9.
00000004:00000020:11.0:1773851872.585735:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:10.0:1773851872.585735:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000010:11.0:1773851872.585736:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000158ac04d.
00000100:00000001:10.0:1773851872.585736:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851872.585736:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:11.0:1773851872.585737:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
02000000:00000001:10.0:1773851872.585737:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851872.585738:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a6c4d9d1.
00000100:00000001:11.0:1773851872.585739:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851872.585739:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851872.585740:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851872.585740:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:11.0:1773851872.585741:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.585741:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851872.585742:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000cadaf1a7.
00000100:00000040:10.0:1773851872.585742:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000171a07a9] to pc [ptlrpcd_02_01+1]  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851872.585744:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.585745:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851872.585746:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851872.585747:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.585748:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000158ac04d] to pc [ptlrpcd_02_02+2]  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851872.585749:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851872.585749:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851872.585750:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851872.585750:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851872.585750:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851872.585752:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:11.0:1773851872.585755:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.585756:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851872.585756:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851872.585756:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:10.0:1773851872.585757:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851872.585758:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851872.585759:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.585760:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851872.585760:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851872.585761:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:9.0:1773851872.585761:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:10.0:1773851872.585762:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.585762:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851872.585763:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051930304:42@kfi7:13:default-yuba2-0
02000000:00000001:9.0:1773851872.585763:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851872.585764:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851872.585765:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000171a07a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051930240:12@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851872.585766:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851872.585766:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851872.585767:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851872.585768:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:9.0:1773851872.585768:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851872.585768:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:10.0:1773851872.585769:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000016900527.
02000000:00000001:9.0:1773851872.585769:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851872.585770:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851872.585770:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:10.0:1773851872.585771:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:10.0:1773851872.585771:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d3517e37.
02000000:00000010:9.0:1773851872.585771:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000082699907.
00000400:00000010:10.0:1773851872.585772:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000033620fd9.
02000000:00000001:9.0:1773851872.585772:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851872.585773:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000200:10.0:1773851872.585774:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930304, portal 4
00000100:00000001:10.0:1773851872.585774:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:9.0:1773851872.585774:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bb91a712.
00000100:00000001:10.0:1773851872.585775:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889197696 : -106993820353920 : ffff9eb08f583a80)
00000400:00000010:9.0:1773851872.585775:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a665d1ec.
00000100:00000040:10.0:1773851872.585776:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851872.585777:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930240, portal 4
00000100:00000001:9.0:1773851872.585778:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851872.585778:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637090064861440 : -106983644690176 : ffff9eb2eddc8900)
00000100:00000001:10.0:1773851872.585779:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851872.585779:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:10.0:1773851872.585780:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000200:10.0:1773851872.585781:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930304, offset 0
00000100:00000040:9.0:1773851872.585781:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851872.585782:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:10.0:1773851872.585783:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:10.0:1773851872.585783:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:10.0:1773851872.585784:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:9.0:1773851872.585785:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851872.585786:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:10.0:1773851872.585786:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000100:00000040:9.0:1773851872.585786:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:9.0:1773851872.585787:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000049d02807.
00000400:00000200:10.0:1773851872.585788:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769407, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769404, p:4294967295, g:4294967295, h:1000]
00000100:00000200:9.0:1773851872.585788:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930240, offset 0
00000400:00000200:10.0:1773851872.585790:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851872.585790:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:10.0:1773851872.585791:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851872.585792:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:10.0:1773851872.585793:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769408:8769408:1024:4294967295] 42@kfi7 LPNI seq info [5404898:5404898:16:4294967295]
00000400:00000200:10.0:1773851872.585794:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:10.0:1773851872.585795:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851872.585796:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.585797:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:10.0:1773851872.585798:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851872.585799:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:9.0:1773851872.585799:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:10.0:1773851872.585800:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851872.585800:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:10.0:1773851872.585802:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851872.585802:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000800:00000200:10.0:1773851872.585804:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851872.585804:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769407, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769408, p:4294967295, g:4294967295, h:1000]
00000800:00000200:10.0:1773851872.585806:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Using peer 42@kfi7(0x200000000000183)
00000400:00000200:9.0:1773851872.585807:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851872.585809:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:10.0:1773851872.585810:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000333a7eb2: Posted send of 324 bytes to peer 0x200000000000183: rc=0
00000400:00000200:9.0:1773851872.585810:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000800:00000200:10.0:1773851872.585812:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851872.585812:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769409:8769409:1024:4294967295] 12@kfi7 LPNI seq info [5403458:5403458:16:4294967295]
00000100:00000001:10.0:1773851872.585814:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.585814:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851872.585814:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:10.0:1773851872.585815:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.585816:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851872.585816:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:10.0:1773851872.585817:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851872.585818:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851872.585818:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851872.585819:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851872.585819:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851872.585819:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000100:00000001:10.0:1773851872.585820:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.585820:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851872.585821:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:9.0:1773851872.585823:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.585825:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851872.585827:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851872.585828:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851872.585829:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851872.585830:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000400:00000200:10.0:1773851872.585831:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851872.585832:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851872.585832:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:9.0:1773851872.585832:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Using peer 12@kfi7(0x47e)
00000100:00000200:10.0:1773851872.585833:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851872.585836:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851872.585837:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851872.585837:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x47e: rc=0
00000100:00000001:10.0:1773851872.585839:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851872.585839:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851872.585840:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851872.585841:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:10.0:1773851872.585842:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Transaction freed
00000100:00000001:9.0:1773851872.585842:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.585843:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851872.585844:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.585845:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.585846:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851872.585848:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851872.585848:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851872.585849:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:10.0:1773851872.585850:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851872.585850:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851872.585851:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851872.585852:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851872.585852:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851872.585853:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000400:00000200:10.0:1773851872.585854:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000049d02807
00000400:00000010:10.0:1773851872.585854:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000049d02807.
00000100:00000001:10.0:1773851872.585855:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851872.585855:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851872.585858:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851872.585858:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851872.585861:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851872.585861:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851872.585862:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:10.0:1773851872.585863:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Transaction freed
00000800:00000200:25.0:1773851872.585868:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.585869:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.585870:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.585872:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851872.585874:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.585875:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851872.585876:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.585877:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851872.585878:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.585879:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:25.0:1773851872.585880:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851872.585881:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.585882:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3ec0
00000400:00000200:25.0:1773851872.585883:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.585884:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b824f9 [1] + 224
00000800:00000200:10.0:1773851872.585884:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851872.585885:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.585886:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851872.585887:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851872.585888:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.585889:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000800:00000200:10.0:1773851872.585889:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:25.0:1773851872.585890:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:10.0:1773851872.585891:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000200:25.0:1773851872.585892:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851872.585892:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:10.0:1773851872.585893:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000040:25.0:1773851872.585895:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851872.585895:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:10.0:1773851872.585896:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:10.0:1773851872.585896:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:10.0:1773851872.585897:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:10.0:1773851872.585898:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:25.0:1773851872.585899:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851872.585899:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3e80
00000400:00000200:25.0:1773851872.585900:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:10.0:1773851872.585900:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:10.0:1773851872.585901:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781697c89 [1] + 224
00000800:00000200:25.0:1773851872.585902:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851872.585902:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:10.0:1773851872.585903:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851872.585903:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:10.0:1773851872.585904:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:9.0:1773851872.585904:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:10.0:1773851872.585905:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000400:00000001:9.0:1773851872.585905:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:10.0:1773851872.585906:0:2464469:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:9.0:1773851872.585906:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d3517e37.
00000100:00000200:10.0:1773851872.585907:0:2464469:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851872.585907:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000033620fd9
00000400:00000010:9.0:1773851872.585909:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000033620fd9.
00000100:00000040:10.0:1773851872.585910:0:2464469:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851872.585910:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851872.585911:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851872.585913:0:2464469:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851872.585914:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:10.0:1773851872.585915:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851872.585916:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851872.585916:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:9.0:1773851872.585917:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:11.0:1773851872.585918:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851872.585919:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:11.0:1773851872.585919:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bb91a712.
00000400:00000200:11.0:1773851872.585921:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a665d1ec
00000400:00000010:11.0:1773851872.585921:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a665d1ec.
00000100:00000001:9.0:1773851872.585921:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851872.585922:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.585923:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851872.585923:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851872.585923:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:11.0:1773851872.585924:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851872.585924:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851872.585925:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851872.585926:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851872.585928:0:41070:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=105 v=66 (66 66 66 66)
00000100:00000200:11.0:1773851872.585929:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:9.0:1773851872.585930:0:41070:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=105 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851872.585931:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851872.585932:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.585933:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:9.0:1773851872.585933:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:11.0:1773851872.585934:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:9.0:1773851872.585934:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.585935:0:41069:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:9.0:1773851872.585935:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:11.0:1773851872.585936:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:9.0:1773851872.585936:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000001:11.0:1773851872.585937:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851872.585937:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.585937:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851872.585938:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851872.585939:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851872.585939:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:11.0:1773851872.585940:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=105 v=66 (66 66 66 66)
00000100:00001000:11.0:1773851872.585942:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=105 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851872.585944:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851872.585944:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851872.585945:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.585945:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00010000:00000001:11.0:1773851872.585946:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:9.0:1773851872.585946:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851872.585947:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851872.585947:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:11.0:1773851872.585948:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000040:9.0:1773851872.585948:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000100:00000040:11.0:1773851872.585949:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000004:00000040:9.0:1773851872.585949:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351378973696 avail=351376002048 avail_mb=1372562508 hwm_mb=3131103 files=372019032 ffree=343143529 state=0: rc = 0
00000100:00000001:11.0:1773851872.585950:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851872.585951:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.585952:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:9.0:1773851872.585952:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351378973696 free, 351376002048 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019032 files, 343143529 free files
00000004:00000001:9.0:1773851872.585955:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.585957:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:9.0:1773851872.585957:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851872.585958:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851872.585959:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851872.585960:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:11.0:1773851872.585961:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:11.0:1773851872.585962:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541486592 avail=351539496960 avail_mb=1373201160 hwm_mb=3131101 files=372136606 ffree=343302233 state=0: rc = 0
00000100:00100000:9.0:1773851872.585962:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051930304:42@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851872.585964:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:11.0:1773851872.585965:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541486592 free, 351539496960 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136606 files, 343302233 free files
00000100:00000001:9.0:1773851872.585965:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851872.585966:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000158ac04d x1859433051930304/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:11.0:1773851872.585968:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.585970:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851872.585971:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851872.585971:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851872.585972:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000016900527.
00000100:00100000:11.0:1773851872.585974:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000171a07a9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051930240:12@kfi7:13:default-yuba2-0
02000000:00000001:9.0:1773851872.585974:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851872.585975:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851872.585975:0:41070:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000100:00000001:11.0:1773851872.585977:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851872.585977:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851872.585977:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000cadaf1a7.
00000100:00000001:11.0:1773851872.585978:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851872.585979:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000171a07a9 x1859433051930240/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852025 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:9.0:1773851872.585979:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851872.585979:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851872.585980:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000158ac04d.
00000100:00000001:9.0:1773851872.585981:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851872.585982:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.585983:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:9.0:1773851872.585983:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:11.0:1773851872.585984:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:9.0:1773851872.585984:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:11.0:1773851872.585985:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000082699907.
00000100:00000001:9.0:1773851872.585985:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851872.585985:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:11.0:1773851872.585986:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:9.0:1773851872.585986:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.585987:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851872.585988:0:41069:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:11.0:1773851872.585989:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851872.585990:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a6c4d9d1.
02000000:00000001:11.0:1773851872.585991:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851872.585992:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851872.585992:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000171a07a9.
00000100:00000001:11.0:1773851872.585994:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851872.585994:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.585995:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.585997:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851872.585998:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.585999:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851872.585999:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851872.688311:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.688312:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.688313:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.688316:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851872.688317:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17041@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.688319:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17041@kfi7 : PUT - for me
00000400:00000200:25.0:1773851872.688319:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17041@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.688320:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a18a88 nid 17041@kfi7 refs 1
00000400:00000200:25.0:1773851872.688321:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17041@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.688322:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a18a88 nid 17041@kfi7 refs 2
00000400:00000200:25.0:1773851872.688322:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000046a18a88 nid 17041@kfi7 refs 3
00000400:00000200:25.0:1773851872.688323:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17041@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.688324:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17041@kfi7 of length 224 into portal 12 MB=0x69b0956fa0380
00000400:00000200:25.0:1773851872.688326:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17041@kfi7 of length 224/224 into md 0x16159c9699 [64] + 17808
00000800:00000200:25.0:1773851872.688328:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851872.688331:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.688332:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17041@kfi7: PUT: OK
00000100:00000001:25.0:1773851872.688333:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851872.688334:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851872.688335:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c32d6c7e.
00000100:00000040:25.0:1773851872.688335:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c32d6c7e x1859314276500352 msgsize 224
00000100:00100000:25.0:1773851872.688337:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17041@kfi7 (source: 12345-17041@kfi7)
00000100:00000001:25.0:1773851872.688338:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851872.688339:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000046a18a88 nid 17041@kfi7 refs 2
00000100:00000001:26.0:1773851872.688340:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851872.688341:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851872.688341:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851872.688341:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851872.688342:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851872.688342:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851872.688343:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314276500352
00000020:00000001:26.0:1773851872.688344:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851872.688344:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f33
00000020:00000001:26.0:1773851872.688345:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851872.688348:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c2251fa refcount=6
00000020:00000001:26.0:1773851872.688348:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744676352 : -107128964875264 : ffff9e91181a7c00)
00000020:00000001:26.0:1773851872.688349:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744676352 : -107128964875264 : ffff9e91181a7c00)
00000100:00000001:26.0:1773851872.688350:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851872.688351:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851872.688352:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f009aeee.
00000020:00000010:26.0:1773851872.688353:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851872.688354:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000f3b5d84.
00000100:00000001:26.0:1773851872.688355:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851872.688356:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851872.688357:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851872.688358:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851872.688359:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851872.688359:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.688360:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851872.688361:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851872.688362:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851872.688362:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851872.688362:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851872.688363:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17041@kfi7, seq: 2025112
00000100:00000040:26.0:1773851872.688364:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c2251fa : new rpc_count 1
00000100:00000001:26.0:1773851872.688364:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159410177664 : -106914299373952 : ffff9ec3132a1680)
00000100:00000001:25.0:1773851872.688364:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851872.688364:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851872.688365:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c32d6c7e x1859314276500352/t0(0) o400->d541b0e1-e4a0-4fab-86b4-9dc053ee9105@17041@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1554-0'
00000100:00000001:26.0:1773851872.688368:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851872.688369:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851872.688370:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c32d6c7e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d541b0e1-e4a0-4fab-86b4-9dc053ee9105+6:39661:x1859314276500352:12345-17041@kfi7:400:default-tuolumne1554-0
00000100:00000200:26.0:1773851872.688371:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314276500352
00000020:00000001:26.0:1773851872.688371:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851872.688372:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851872.688373:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.688373:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851872.688374:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851872.688375:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851872.688375:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314276500352, found 0 last_xid 1859314276500351
00000020:00000001:26.0:1773851872.688376:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851872.688377:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851872.688378:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851872.688378:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.688379:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851872.688379:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851872.688380:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851872.688381:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d5f0d58.
02000000:00000001:26.0:1773851872.688381:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.688382:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.688383:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851872.688384:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044165418, transno 0, xid 1859314276500352
00010000:00000001:26.0:1773851872.688385:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851872.688386:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c32d6c7e x1859314276500352/t0(0) o400->d541b0e1-e4a0-4fab-86b4-9dc053ee9105@17041@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1554-0'
00010000:00000001:26.0:1773851872.688388:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851872.688389:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851872.688390:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=105 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851872.688391:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851872.688392:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f086042a refcount 3 to 17041@kfi7
00000100:00000001:26.0:1773851872.688392:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092337216 : -107152617214400 : ffff9e8b96506e40)
02000000:00000001:26.0:1773851872.688393:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851872.688394:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.688394:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851872.688395:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17041@kfi7
00000400:00000010:26.0:1773851872.688396:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b92c768b.
00000100:00000200:26.0:1773851872.688397:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314276500352, offset 224
00000400:00000200:26.0:1773851872.688398:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17041@kfi7
00000400:00000200:26.0:1773851872.688399:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17041@kfi7 to cpt 6
00000400:00000200:26.0:1773851872.688400:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a18a88 nid 17041@kfi7 refs 1
00000400:00000200:26.0:1773851872.688400:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000046a18a88 nid 17041@kfi7 refs 2
00000400:00000200:26.0:1773851872.688402:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000046a18a88 nid 17041@kfi7 refs 3
00000400:00000200:26.0:1773851872.688403:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17041@kfi7 local destination
00000400:00000200:26.0:1773851872.688404:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769410:8769410:1024:4294967295] 17041@kfi7 LPNI seq info [326047:326047:16:4294967295]
00000400:00000200:26.0:1773851872.688406:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000046a18a88 nid 17041@kfi7 refs 2
00000400:00000200:26.0:1773851872.688406:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17041@kfi7 to cpt 6
00000400:00000200:26.0:1773851872.688408:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17041@kfi7(17041@kfi7:17041@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851872.688409:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000046a18a88 nid 17041@kfi7 refs 3
00000800:00000200:26.0:1773851872.688410:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851872.688411:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851872.688414:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851872.688417:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x844 Using peer 17041@kfi7(0x844)
00000800:00000200:26.0:1773851872.688420:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0x844: rc=0
00000800:00000200:26.0:1773851872.688421:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x844 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851872.688423:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851872.688424:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f086042a refcount 2 to 17041@kfi7
00010000:00000001:26.0:1773851872.688425:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851872.688425:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.688426:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851872.688427:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c32d6c7e x1859314276500352/t0(0) o400->d541b0e1-e4a0-4fab-86b4-9dc053ee9105@17041@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1554-0'
00000100:00100000:26.0:1773851872.688430:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c32d6c7e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d541b0e1-e4a0-4fab-86b4-9dc053ee9105+6:39661:x1859314276500352:12345-17041@kfi7:400:default-tuolumne1554-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851872.688432:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17041@kfi7, seq: 2025112
00000100:00000040:26.0:1773851872.688432:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c2251fa : new rpc_count 0
00000100:00000001:26.0:1773851872.688433:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851872.688433:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x844 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851872.688434:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851872.688434:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851872.688434:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851872.688435:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000f3b5d84.
00000020:00000010:26.0:1773851872.688436:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f009aeee.
00000400:00000200:25.0:1773851872.688436:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17041@kfi7: PUT: OK
00000400:00000200:25.0:1773851872.688436:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b92c768b
00000020:00000040:26.0:1773851872.688437:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000000c2251fa : new refcount 5
00000100:00000001:26.0:1773851872.688437:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851872.688437:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b92c768b.
00000100:00000001:25.0:1773851872.688438:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851872.688438:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851872.688439:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000046a18a88 nid 17041@kfi7 refs 2
00000800:00000200:25.0:1773851872.688441:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2069@kfi7:6 -> 17041@kfi7(000000004c71eafa):0x0 lsk 2117 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x844 Transaction freed
00000800:00000200:9.0:1773851872.753819:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.753820:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.753821:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.753823:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.753825:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10162@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.753827:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10162@kfi7 : PUT - for me
00000400:00000200:9.0:1773851872.753828:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10162@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.753829:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5941dac nid 10162@kfi7 refs 1
00000400:00000200:9.0:1773851872.753830:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10162@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.753830:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5941dac nid 10162@kfi7 refs 2
00000400:00000200:9.0:1773851872.753831:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a5941dac nid 10162@kfi7 refs 3
00000400:00000200:9.0:1773851872.753832:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10162@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.753833:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10162@kfi7 of length 224 into portal 12 MB=0x699e12f218280
00000400:00000200:9.0:1773851872.753834:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10162@kfi7 of length 224/224 into md 0x78146ce49 [64] + 141040
00000800:00000200:9.0:1773851872.753836:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.753838:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.753839:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10162@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.753840:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.753840:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.753841:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c0754a3.
00000100:00000040:9.0:1773851872.753842:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009c0754a3 x1858042297680512 msgsize 224
00000100:00100000:9.0:1773851872.753843:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10162@kfi7 (source: 12345-10162@kfi7)
00000100:00000001:9.0:1773851872.753844:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.753845:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5941dac nid 10162@kfi7 refs 2
00000100:00000001:11.0:1773851872.753846:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851872.753846:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851872.753847:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851872.753847:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851872.753847:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851872.753848:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851872.753849:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042297680512
00000020:00000001:11.0:1773851872.753850:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851872.753850:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91643
00000020:00000001:11.0:1773851872.753851:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851872.753854:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000012f201ce refcount=6
00000020:00000001:11.0:1773851872.753854:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241244672 : -107152468306944 : ffff9e8b9f309400)
00000020:00000001:11.0:1773851872.753855:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241244672 : -107152468306944 : ffff9e8b9f309400)
00000100:00000001:11.0:1773851872.753856:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851872.753857:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851872.753858:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020699928.
00000020:00000010:11.0:1773851872.753859:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851872.753860:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851872.753861:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851872.753861:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851872.753862:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.753863:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851872.753863:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851872.753865:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.753865:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.753867:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.753867:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851872.753867:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851872.753867:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851872.753868:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10162@kfi7, seq: 2130795
00000100:00000040:11.0:1773851872.753869:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000012f201ce : new rpc_count 1
00000100:00000001:8.0:1773851872.753869:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.753870:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749207168 : -106947960344448 : ffff9ebb3cd07080)
00000100:00000001:8.0:1773851872.753870:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.753871:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c0754a3 x1858042297680512/t0(0) o400->3b190145-644d-43e8-8932-d1703e28de99@10162@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1114-0'
00000100:00000001:11.0:1773851872.753874:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851872.753874:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851872.753875:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c0754a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:3b190145-644d-43e8-8932-d1703e28de99+6:39827:x1858042297680512:12345-10162@kfi7:400:default-tuolumne1114-0
00000100:00000200:11.0:1773851872.753877:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042297680512
00000020:00000001:11.0:1773851872.753877:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851872.753878:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851872.753879:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.753880:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851872.753880:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851872.753881:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851872.753881:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042297680512, found 0 last_xid 1858042297680511
00000020:00000001:11.0:1773851872.753883:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851872.753883:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851872.753884:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851872.753884:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.753885:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851872.753886:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851872.753886:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851872.753887:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bc4962db.
02000000:00000001:11.0:1773851872.753888:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.753889:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.753890:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851872.753890:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693218, transno 0, xid 1858042297680512
00010000:00000001:11.0:1773851872.753891:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851872.753893:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c0754a3 x1858042297680512/t0(0) o400->3b190145-644d-43e8-8932-d1703e28de99@10162@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1114-0'
00010000:00000001:11.0:1773851872.753896:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851872.753896:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851872.753897:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851872.753898:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851872.753899:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bf9b2bbd refcount 3 to 10162@kfi7
00000100:00000001:11.0:1773851872.753900:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810488480 : -107154899063136 : ffff9e8b0e4e2ea0)
02000000:00000001:11.0:1773851872.753901:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851872.753902:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.753902:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851872.753903:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10162@kfi7
00000400:00000010:11.0:1773851872.753904:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001e5494cf.
00000100:00000200:11.0:1773851872.753905:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042297680512, offset 224
00000400:00000200:11.0:1773851872.753907:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10162@kfi7
00000400:00000200:11.0:1773851872.753908:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10162@kfi7 to cpt 2
00000400:00000200:11.0:1773851872.753909:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5941dac nid 10162@kfi7 refs 1
00000400:00000200:11.0:1773851872.753910:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a5941dac nid 10162@kfi7 refs 2
00000400:00000200:11.0:1773851872.753912:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a5941dac nid 10162@kfi7 refs 3
00000400:00000200:11.0:1773851872.753913:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10162@kfi7 local destination
00000400:00000200:11.0:1773851872.753915:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769411:8769411:1024:4294967295] 10162@kfi7 LPNI seq info [165964:165964:16:4294967295]
00000400:00000200:11.0:1773851872.753917:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a5941dac nid 10162@kfi7 refs 2
00000400:00000200:11.0:1773851872.753918:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10162@kfi7 to cpt 2
00000400:00000200:11.0:1773851872.753920:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10162@kfi7(10162@kfi7:10162@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851872.753922:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a5941dac nid 10162@kfi7 refs 3
00000800:00000200:11.0:1773851872.753923:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851872.753925:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851872.753927:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851872.753931:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x868 Using peer 10162@kfi7(0x868)
00000800:00000200:11.0:1773851872.753937:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x868: rc=0
00000800:00000200:11.0:1773851872.753939:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x868 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851872.753942:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.753950:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bf9b2bbd refcount 2 to 10162@kfi7
00010000:00000001:11.0:1773851872.753952:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851872.753953:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851872.753953:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x868 TN_EVENT_TX_OK event status 0
00000020:00000001:11.0:1773851872.753954:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851872.753956:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c0754a3 x1858042297680512/t0(0) o400->3b190145-644d-43e8-8932-d1703e28de99@10162@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1114-0'
00000400:00000200:9.0:1773851872.753956:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.753958:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10162@kfi7: PUT: OK
00000400:00000200:9.0:1773851872.753959:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001e5494cf
00000400:00000010:9.0:1773851872.753960:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001e5494cf.
00000100:00100000:11.0:1773851872.753962:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c0754a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:3b190145-644d-43e8-8932-d1703e28de99+6:39827:x1858042297680512:12345-10162@kfi7:400:default-tuolumne1114-0 Request processed in 87us (119us total) trans 0 rc 0/0
00000100:00000001:9.0:1773851872.753962:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851872.753963:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851872.753964:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5941dac nid 10162@kfi7 refs 2
00000100:00100000:11.0:1773851872.753966:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10162@kfi7, seq: 2130795
00000800:00000200:9.0:1773851872.753967:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 10162@kfi7(000000004adcdee9):0x0 lsk 2153 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x868 Transaction freed
00000100:00000040:11.0:1773851872.753968:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000012f201ce : new rpc_count 0
00000100:00000001:11.0:1773851872.753969:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851872.753970:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851872.753971:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851872.753973:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000020:00000010:11.0:1773851872.753974:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020699928.
00000020:00000040:11.0:1773851872.753976:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000012f201ce : new refcount 5
00000100:00000001:11.0:1773851872.753977:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851872.786007:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851872.786008:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851872.786009:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851872.786011:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851872.786013:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18426@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.786014:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18426@kfi7 : PUT - for me
00000400:00000200:25.0:1773851872.786015:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18426@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.786016:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004834c4a8 nid 18426@kfi7 refs 1
00000400:00000200:25.0:1773851872.786017:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18426@kfi7 to cpt 6
00000400:00000200:25.0:1773851872.786017:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004834c4a8 nid 18426@kfi7 refs 2
00000400:00000200:25.0:1773851872.786018:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004834c4a8 nid 18426@kfi7 refs 3
00000400:00000200:25.0:1773851872.786019:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18427@kfi7 to cpt 2
00000400:00000200:25.0:1773851872.786020:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18427@kfi7 of length 224 into portal 12 MB=0x699de8e017880
00000400:00000200:25.0:1773851872.786022:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18427@kfi7 of length 224/224 into md 0x16159c9699 [64] + 18032
00000800:00000200:25.0:1773851872.786024:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851872.786025:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851872.786026:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18426@kfi7: PUT: OK
00000100:00000001:25.0:1773851872.786027:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851872.786028:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851872.786029:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cad949aa.
00000100:00000040:25.0:1773851872.786029:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000cad949aa x1858031004514432 msgsize 224
00000100:00100000:25.0:1773851872.786031:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-18427@kfi7 (source: 12345-18426@kfi7)
00000100:00000001:25.0:1773851872.786032:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851872.786033:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851872.786033:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004834c4a8 nid 18426@kfi7 refs 2
02000000:00000001:26.0:1773851872.786034:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851872.786034:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851872.786034:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851872.786035:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851872.786036:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851872.786036:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031004514432
00000020:00000001:26.0:1773851872.786037:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851872.786037:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910b6
00000020:00000001:26.0:1773851872.786038:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851872.786042:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c4610db1 refcount=6
00000020:00000001:26.0:1773851872.786043:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240333312 : -107152469218304 : ffff9e8b9f22ac00)
00000020:00000001:26.0:1773851872.786044:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240333312 : -107152469218304 : ffff9e8b9f22ac00)
00000100:00000001:26.0:1773851872.786045:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851872.786046:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851872.786046:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f009aeee.
00000020:00000010:26.0:1773851872.786047:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851872.786048:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000f3b5d84.
00000100:00000001:26.0:1773851872.786049:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851872.786049:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851872.786050:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851872.786051:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851872.786051:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851872.786052:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.786053:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851872.786054:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851872.786054:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851872.786054:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851872.786054:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851872.786055:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18427@kfi7, seq: 2025113
00000100:00000040:26.0:1773851872.786056:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c4610db1 : new rpc_count 1
00000100:00000001:25.0:1773851872.786056:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.786057:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159410197248 : -106914299354368 : ffff9ec3132a6300)
00000100:00000001:25.0:1773851872.786057:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851872.786058:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cad949aa x1858031004514432/t0(0) o400->ac6def40-948f-4010-b010-8f068fcb4c9b@18427@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne240-0'
00000100:00000001:26.0:1773851872.786061:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851872.786061:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851872.786062:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cad949aa pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ac6def40-948f-4010-b010-8f068fcb4c9b+6:47983:x1858031004514432:12345-18427@kfi7:400:default-tuolumne240-0
00000100:00000200:26.0:1773851872.786064:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031004514432
00000020:00000001:26.0:1773851872.786065:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851872.786065:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851872.786066:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.786067:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851872.786067:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851872.786070:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851872.786070:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031004514432, found 0 last_xid 1858031004514431
00000020:00000001:26.0:1773851872.786071:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851872.786072:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851872.786072:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851872.786073:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.786073:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851872.786074:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851872.786075:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851872.786075:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd49e8f6.
02000000:00000001:26.0:1773851872.786076:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.786076:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.786077:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851872.786078:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858031004514432
00010000:00000001:26.0:1773851872.786078:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851872.786079:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cad949aa x1858031004514432/t0(0) o400->ac6def40-948f-4010-b010-8f068fcb4c9b@18427@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne240-0'
00010000:00000001:26.0:1773851872.786082:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851872.786082:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851872.786083:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=105 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851872.786084:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851872.786084:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000011435f35 refcount 5 to 18427@kfi7
00000100:00000001:26.0:1773851872.786085:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580256 : -107154806971360 : ffff9e8b13cb6420)
02000000:00000001:26.0:1773851872.786086:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851872.786087:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851872.786087:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851872.786088:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18426@kfi7
00000400:00000010:26.0:1773851872.786089:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002a370da0.
00000100:00000200:26.0:1773851872.786090:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031004514432, offset 224
00000400:00000200:26.0:1773851872.786091:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18426@kfi7
00000400:00000200:26.0:1773851872.786092:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18426@kfi7 to cpt 6
00000400:00000200:26.0:1773851872.786092:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004834c4a8 nid 18426@kfi7 refs 1
00000400:00000200:26.0:1773851872.786094:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004834c4a8 nid 18426@kfi7 refs 2
00000400:00000200:26.0:1773851872.786095:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004834c4a8 nid 18426@kfi7 refs 3
00000400:00000200:26.0:1773851872.786097:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18426@kfi7 local destination
00000400:00000200:26.0:1773851872.786098:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769412:8769412:1024:4294967295] 18426@kfi7 LPNI seq info [24486:24486:16:4294967295]
00000400:00000200:26.0:1773851872.786099:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004834c4a8 nid 18426@kfi7 refs 2
00000400:00000200:26.0:1773851872.786100:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18426@kfi7 to cpt 6
00000400:00000200:26.0:1773851872.786102:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18426@kfi7(18426@kfi7:18426@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851872.786103:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004834c4a8 nid 18426@kfi7 refs 3
00000800:00000200:26.0:1773851872.786104:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851872.786105:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851872.786107:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851872.786109:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001ed Using peer 18426@kfi7(0x1000000000001ed)
00000800:00000200:26.0:1773851872.786112:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x1000000000001ed: rc=0
00000800:00000200:26.0:1773851872.786114:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001ed TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851872.786116:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851872.786117:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000011435f35 refcount 4 to 18427@kfi7
00010000:00000001:26.0:1773851872.786118:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851872.786118:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851872.786119:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851872.786119:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cad949aa x1858031004514432/t0(0) o400->ac6def40-948f-4010-b010-8f068fcb4c9b@18427@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne240-0'
00000100:00100000:26.0:1773851872.786123:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cad949aa pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ac6def40-948f-4010-b010-8f068fcb4c9b+6:47983:x1858031004514432:12345-18427@kfi7:400:default-tuolumne240-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851872.786125:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18427@kfi7, seq: 2025113
00000100:00000040:26.0:1773851872.786126:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c4610db1 : new rpc_count 0
00000100:00000001:26.0:1773851872.786126:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851872.786126:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001ed TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851872.786127:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851872.786127:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851872.786128:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851872.786128:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18426@kfi7: PUT: OK
00000020:00000010:26.0:1773851872.786129:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000f3b5d84.
00000400:00000200:25.0:1773851872.786129:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002a370da0
00000020:00000010:26.0:1773851872.786130:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f009aeee.
00000020:00000040:26.0:1773851872.786130:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000c4610db1 : new refcount 5
00000400:00000010:25.0:1773851872.786130:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002a370da0.
00000100:00000001:25.0:1773851872.786130:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851872.786131:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851872.786131:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851872.786132:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004834c4a8 nid 18426@kfi7 refs 2
00000800:00000200:25.0:1773851872.786134:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 18426@kfi7(00000000ee77d000):0x0 lsk 494 rsk 91 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001ed Transaction freed
00000800:00000200:9.0:1773851872.786471:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851872.786473:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851872.786474:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851872.786476:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851872.786478:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18427@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.786479:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18427@kfi7 : PUT - for me
00000400:00000200:9.0:1773851872.786480:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18427@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.786481:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004df06a86 nid 18427@kfi7 refs 1
00000400:00000200:9.0:1773851872.786481:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18427@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.786482:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004df06a86 nid 18427@kfi7 refs 2
00000400:00000200:9.0:1773851872.786483:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004df06a86 nid 18427@kfi7 refs 3
00000400:00000200:9.0:1773851872.786484:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18427@kfi7 to cpt 2
00000400:00000200:9.0:1773851872.786485:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18427@kfi7 of length 224 into portal 12 MB=0x699de8e018000
00000400:00000200:9.0:1773851872.786486:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18427@kfi7 of length 224/224 into md 0x78146ce49 [64] + 141264
00000800:00000200:9.0:1773851872.786487:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851872.786489:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851872.786490:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18427@kfi7: PUT: OK
00000100:00000001:9.0:1773851872.786491:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851872.786491:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851872.786492:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c26bd29a.
00000100:00000040:9.0:1773851872.786492:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c26bd29a x1858031004516352 msgsize 224
00000100:00100000:9.0:1773851872.786494:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18427@kfi7 (source: 12345-18427@kfi7)
00000100:00000001:9.0:1773851872.786495:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851872.786495:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004df06a86 nid 18427@kfi7 refs 2
00000100:00000001:11.0:1773851872.786496:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851872.786497:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851872.786497:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851872.786497:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851872.786498:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851872.786498:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851872.786499:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031004516352
00000020:00000001:11.0:1773851872.786500:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851872.786500:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911c7
00000020:00000001:11.0:1773851872.786501:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851872.786504:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef03a369 refcount=6
00000020:00000001:11.0:1773851872.786504:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240544256 : -107152469007360 : ffff9e8b9f25e400)
00000020:00000001:11.0:1773851872.786506:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240544256 : -107152469007360 : ffff9e8b9f25e400)
00000100:00000001:11.0:1773851872.786507:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851872.786508:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851872.786509:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020699928.
00000020:00000010:11.0:1773851872.786510:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851872.786511:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851872.786511:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851872.786512:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851872.786512:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.786513:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851872.786514:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851872.786514:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.786515:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851872.786516:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.786517:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851872.786518:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18427@kfi7, seq: 2130796
00000100:00000040:11.0:1773851872.786518:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef03a369 : new rpc_count 1
00000100:00000001:8.0:1773851872.786518:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851872.786519:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749192192 : -106947960359424 : ffff9ebb3cd03600)
00000100:00000001:8.0:1773851872.786519:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851872.786519:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.786520:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c26bd29a x1858031004516352/t0(0) o400->d479cb6b-f80f-4451-96a5-a976f74fd0f9@18427@kfi7:89/0 lens 224/0 e 0 to 0 dl 1773852204 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne240-0'
00000100:00000001:8.0:1773851872.786520:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.786523:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851872.786524:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851872.786524:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c26bd29a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d479cb6b-f80f-4451-96a5-a976f74fd0f9+6:47981:x1858031004516352:12345-18427@kfi7:400:default-tuolumne240-0
00000100:00000200:11.0:1773851872.786526:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031004516352
00000020:00000001:11.0:1773851872.786527:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851872.786527:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851872.786528:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.786529:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851872.786530:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851872.786531:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851872.786531:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031004516352, found 0 last_xid 1858031004516351
00000020:00000001:11.0:1773851872.786532:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851872.786535:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851872.786536:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851872.786536:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.786537:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851872.786538:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851872.786538:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851872.786540:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a47bb547.
02000000:00000001:11.0:1773851872.786540:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.786541:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.786542:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851872.786542:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768350, transno 0, xid 1858031004516352
00010000:00000001:11.0:1773851872.786543:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851872.786544:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c26bd29a x1858031004516352/t0(0) o400->d479cb6b-f80f-4451-96a5-a976f74fd0f9@18427@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne240-0'
00010000:00000001:11.0:1773851872.786546:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851872.786547:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851872.786547:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=105 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851872.786548:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851872.786549:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000011435f35 refcount 5 to 18427@kfi7
00000100:00000001:11.0:1773851872.786550:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580256 : -107154806971360 : ffff9e8b13cb6420)
02000000:00000001:11.0:1773851872.786550:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851872.786551:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851872.786552:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851872.786552:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18427@kfi7
00000400:00000010:11.0:1773851872.786553:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a08630ef.
00000100:00000200:11.0:1773851872.786554:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031004516352, offset 224
00000400:00000200:11.0:1773851872.786555:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18427@kfi7
00000400:00000200:11.0:1773851872.786556:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18427@kfi7 to cpt 2
00000400:00000200:11.0:1773851872.786556:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004df06a86 nid 18427@kfi7 refs 1
00000400:00000200:11.0:1773851872.786557:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004df06a86 nid 18427@kfi7 refs 2
00000400:00000200:11.0:1773851872.786558:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004df06a86 nid 18427@kfi7 refs 3
00000400:00000200:11.0:1773851872.786559:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18427@kfi7 local destination
00000400:00000200:11.0:1773851872.786560:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769413:8769413:1024:4294967295] 18427@kfi7 LPNI seq info [24487:24487:16:4294967295]
00000400:00000200:11.0:1773851872.786562:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004df06a86 nid 18427@kfi7 refs 2
00000400:00000200:11.0:1773851872.786563:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18427@kfi7 to cpt 2
00000400:00000200:11.0:1773851872.786565:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18427@kfi7(18427@kfi7:18427@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851872.786566:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004df06a86 nid 18427@kfi7 refs 3
00000800:00000200:11.0:1773851872.786567:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851872.786568:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851872.786570:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851872.786573:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6a7 Using peer 18427@kfi7(0x6a7)
00000800:00000200:11.0:1773851872.786576:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x6a7: rc=0
00000800:00000200:11.0:1773851872.786577:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6a7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851872.786579:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851872.786580:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000011435f35 refcount 4 to 18427@kfi7
00010000:00000001:11.0:1773851872.786581:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851872.786582:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851872.786583:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851872.786584:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c26bd29a x1858031004516352/t0(0) o400->d479cb6b-f80f-4451-96a5-a976f74fd0f9@18427@kfi7:89/0 lens 224/224 e 0 to 0 dl 1773852204 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne240-0'
00000100:00100000:11.0:1773851872.786587:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c26bd29a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d479cb6b-f80f-4451-96a5-a976f74fd0f9+6:47981:x1858031004516352:12345-18427@kfi7:400:default-tuolumne240-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851872.786588:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6a7 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851872.786590:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18427@kfi7, seq: 2130796
00000400:00000200:9.0:1773851872.786590:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851872.786591:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef03a369 : new rpc_count 0
00000100:00000001:11.0:1773851872.786591:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851872.786591:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18427@kfi7: PUT: OK
00000100:00000001:11.0:1773851872.786592:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851872.786592:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851872.786592:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a08630ef
00000400:00000010:9.0:1773851872.786592:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a08630ef.
00000020:00000010:11.0:1773851872.786593:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000100:00000001:9.0:1773851872.786593:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851872.786593:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851872.786594:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020699928.
00000400:00000200:9.0:1773851872.786594:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004df06a86 nid 18427@kfi7 refs 2
00000020:00000040:11.0:1773851872.786595:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000ef03a369 : new refcount 5
00000800:00000200:9.0:1773851872.786595:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 18427@kfi7(0000000044f28511):0x0 lsk 1704 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6a7 Transaction freed
00000100:00000001:11.0:1773851872.786596:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851872.791984:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851872.791985:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851872.791987:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851872.791993:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851872.791996:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.791999:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9211@kfi7 : PUT - for me
00000400:00000200:1.0:1773851872.792000:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.792002:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 1
00000400:00000200:1.0:1773851872.792003:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.792005:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000400:00000200:1.0:1773851872.792006:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 3
00000400:00000200:1.0:1773851872.792008:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9210@kfi7 to cpt 5
00000400:00000200:1.0:1773851872.792010:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9210@kfi7 of length 224 into portal 12 MB=0x699de8d861b40
00000400:00000200:1.0:1773851872.792012:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9210@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 32296
00000800:00000200:1.0:1773851872.792016:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851872.792019:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851872.792021:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9211@kfi7: PUT: OK
00000100:00000001:1.0:1773851872.792023:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851872.792023:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851872.792025:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a95cf60f.
00000100:00000040:1.0:1773851872.792026:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a95cf60f x1858030996429632 msgsize 224
00000100:00100000:1.0:1773851872.792029:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9210@kfi7 (source: 12345-9211@kfi7)
00000100:00000001:1.0:1773851872.792031:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851872.792032:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000100:00000001:0.0:1773851872.792034:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851872.792035:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851872.792035:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851872.792036:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851872.792037:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851872.792038:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851872.792040:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030996429632
00000020:00000001:0.0:1773851872.792041:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851872.792041:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91077
00000020:00000001:0.0:1773851872.792042:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851872.792045:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000050eead8b refcount=6
00000020:00000001:0.0:1773851872.792046:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240109056 : -107152469442560 : ffff9e8b9f1f4000)
00000020:00000001:0.0:1773851872.792047:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240109056 : -107152469442560 : ffff9e8b9f1f4000)
00000100:00000001:0.0:1773851872.792049:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851872.792050:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851872.792051:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000670b7cbc.
00000020:00000010:0.0:1773851872.792053:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851872.792054:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851872.792056:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851872.792056:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851872.792057:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851872.792059:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851872.792060:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851872.792061:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.792062:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851872.792065:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851872.792065:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851872.792066:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851872.792066:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851872.792067:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9210@kfi7, seq: 1997571
00000100:00000040:0.0:1773851872.792068:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000050eead8b : new rpc_count 1
00000100:00000001:1.0:1773851872.792069:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.792069:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599728384 : -107004109823232 : ffff9eae2a0b6300)
00000100:00000001:1.0:1773851872.792070:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851872.792071:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a95cf60f x1858030996429632/t0(0) o400->2cbf3616-9605-4796-bb49-ba719247f0e7@9210@kfi7:512/0 lens 224/0 e 0 to 0 dl 1773852627 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne204-0'
00000100:00000001:0.0:1773851872.792076:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851872.792076:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851872.792077:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a95cf60f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2cbf3616-9605-4796-bb49-ba719247f0e7+6:47529:x1858030996429632:12345-9210@kfi7:400:default-tuolumne204-0
00000100:00000200:0.0:1773851872.792081:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030996429632
00000020:00000001:0.0:1773851872.792082:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851872.792083:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851872.792084:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.792084:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851872.792085:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851872.792086:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851872.792087:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030996429632, found 0 last_xid 1858030996429631
00000020:00000001:0.0:1773851872.792088:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851872.792088:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851872.792089:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851872.792090:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.792090:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851872.792091:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851872.792092:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851872.792092:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000210fcb46.
02000000:00000001:0.0:1773851872.792093:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.792094:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851872.792095:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851872.792095:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030996429632
00010000:00000001:0.0:1773851872.792096:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851872.792097:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a95cf60f x1858030996429632/t0(0) o400->2cbf3616-9605-4796-bb49-ba719247f0e7@9210@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne204-0'
00010000:00000001:0.0:1773851872.792100:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851872.792101:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851872.792101:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=105 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851872.792103:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851872.792103:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a79a5b42 refcount 5 to 9210@kfi7
00000100:00000001:0.0:1773851872.792104:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026912 : -107156745524704 : ffff9e8aa03f6a20)
02000000:00000001:0.0:1773851872.792105:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851872.792106:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.792107:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851872.792107:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9211@kfi7
00000400:00000010:0.0:1773851872.792108:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024fe8e76.
00000100:00000200:0.0:1773851872.792109:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030996429632, offset 224
00000400:00000200:0.0:1773851872.792111:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9211@kfi7
00000400:00000200:0.0:1773851872.792111:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:0.0:1773851872.792112:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 1
00000400:00000200:0.0:1773851872.792115:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000400:00000200:0.0:1773851872.792116:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 3
00000400:00000200:0.0:1773851872.792117:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9211@kfi7 local destination
00000400:00000200:0.0:1773851872.792118:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769414:8769414:1024:4294967295] 9211@kfi7 LPNI seq info [24427:24427:16:4294967295]
00000400:00000200:0.0:1773851872.792120:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000400:00000200:0.0:1773851872.792121:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:0.0:1773851872.792123:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9211@kfi7(9211@kfi7:9211@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851872.792124:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 3
00000800:00000200:0.0:1773851872.792129:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851872.792130:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851872.792131:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:0.0:1773851872.792131:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851872.792133:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:0.0:1773851872.792133:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851872.792135:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:0.0:1773851872.792136:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003a6 Using peer 9211@kfi7(0x1000000000003a6)
00000400:00000200:1.0:1773851872.792137:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.792138:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9211@kfi7 : PUT - for me
00000400:00000200:1.0:1773851872.792139:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000800:00000200:0.0:1773851872.792139:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x1000000000003a6: rc=0
00000400:00000200:1.0:1773851872.792140:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000400:00000200:1.0:1773851872.792141:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000800:00000200:0.0:1773851872.792141:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003a6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:1.0:1773851872.792142:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 3
00000400:00000200:1.0:1773851872.792143:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 4
00000100:00000001:0.0:1773851872.792143:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851872.792144:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9210@kfi7 to cpt 5
00000400:00000200:1.0:1773851872.792144:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9210@kfi7 of length 224 into portal 12 MB=0x699de8d862300
00000100:00000040:0.0:1773851872.792144:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a79a5b42 refcount 4 to 9210@kfi7
00010000:00000001:0.0:1773851872.792145:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851872.792145:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851872.792146:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9210@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 32520
00000020:00000001:0.0:1773851872.792146:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000800:00000200:1.0:1773851872.792147:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:0.0:1773851872.792147:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a95cf60f x1858030996429632/t0(0) o400->2cbf3616-9605-4796-bb49-ba719247f0e7@9210@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne204-0'
00000400:00000200:1.0:1773851872.792149:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851872.792150:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9211@kfi7: PUT: OK
00000100:00000001:1.0:1773851872.792151:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851872.792151:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851872.792152:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ca531ee.
00000100:00100000:0.0:1773851872.792152:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a95cf60f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:2cbf3616-9605-4796-bb49-ba719247f0e7+6:47529:x1858030996429632:12345-9210@kfi7:400:default-tuolumne204-0 Request processed in 76us (125us total) trans 0 rc 0/0
00000100:00000040:1.0:1773851872.792153:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000002ca531ee x1858030996431616 msgsize 224
00000100:00100000:1.0:1773851872.792154:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9210@kfi7 (source: 12345-9211@kfi7)
00000100:00000001:1.0:1773851872.792155:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000100:00100000:0.0:1773851872.792155:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9210@kfi7, seq: 1997571
00000400:00000200:1.0:1773851872.792156:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 3
00000100:00000040:0.0:1773851872.792156:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000050eead8b : new rpc_count 0
00000100:00000001:0.0:1773851872.792157:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:1.0:1773851872.792158:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851872.792158:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851872.792158:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851872.792159:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851872.792160:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000670b7cbc.
00000100:00000001:1.0:1773851872.792161:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851872.792161:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000040:0.0:1773851872.792161:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000050eead8b : new refcount 5
00000100:00000001:1.0:1773851872.792162:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851872.792162:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.792162:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:1.0:1773851872.792163:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851872.792168:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003a6 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851872.792170:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851872.792171:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9211@kfi7: PUT: OK
00000400:00000200:2.0:1773851872.792172:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024fe8e76
00000400:00000010:2.0:1773851872.792172:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024fe8e76.
00000100:00000001:2.0:1773851872.792173:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851872.792174:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:1.0:1773851872.792174:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030996431616
00000400:00000200:2.0:1773851872.792175:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000020:00000001:1.0:1773851872.792175:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851872.792175:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91173
00000020:00000001:1.0:1773851872.792176:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:2.0:1773851872.792177:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 9211@kfi7(0000000050f28979):0x0 lsk 935 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003a6 Transaction freed
00000020:00000040:1.0:1773851872.792178:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003996df70 refcount=6
00000020:00000001:1.0:1773851872.792179:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240340480 : -107152469211136 : ffff9e8b9f22c800)
00000020:00000001:1.0:1773851872.792179:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240340480 : -107152469211136 : ffff9e8b9f22c800)
00000100:00000001:1.0:1773851872.792180:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851872.792181:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851872.792182:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042b9c0ff.
00000020:00000010:1.0:1773851872.792183:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851872.792184:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ef8da19.
00000100:00000001:1.0:1773851872.792185:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851872.792185:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851872.792186:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851872.792186:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851872.792187:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851872.792187:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851872.792188:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851872.792189:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851872.792189:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851872.792190:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9210@kfi7, seq: 1997572
00000100:00000001:0.0:1773851872.792190:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851872.792190:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:1.0:1773851872.792191:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003996df70 : new rpc_count 1
00000100:00000001:1.0:1773851872.792191:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599727232 : -107004109824384 : ffff9eae2a0b5e80)
00000100:00000001:0.0:1773851872.792191:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851872.792191:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851872.792192:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002ca531ee x1858030996431616/t0(0) o400->b80e1740-cf56-4966-afbe-ec7699bc22df@9210@kfi7:512/0 lens 224/0 e 0 to 0 dl 1773852627 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne204-0'
00000100:00000001:1.0:1773851872.792195:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851872.792196:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851872.792196:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ca531ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b80e1740-cf56-4966-afbe-ec7699bc22df+6:47527:x1858030996431616:12345-9210@kfi7:400:default-tuolumne204-0
00000100:00000200:1.0:1773851872.792198:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030996431616
00000020:00000001:1.0:1773851872.792198:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851872.792199:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851872.792200:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851872.792200:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851872.792201:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851872.792201:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851872.792202:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030996431616, found 0 last_xid 1858030996431615
00000020:00000001:1.0:1773851872.792203:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851872.792203:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851872.792204:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851872.792204:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851872.792205:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851872.792205:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851872.792206:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851872.792206:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ed1576e4.
02000000:00000001:1.0:1773851872.792207:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851872.792208:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851872.792208:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851872.792209:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768275, transno 0, xid 1858030996431616
00010000:00000001:1.0:1773851872.792210:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851872.792210:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002ca531ee x1858030996431616/t0(0) o400->b80e1740-cf56-4966-afbe-ec7699bc22df@9210@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne204-0'
00010000:00000001:1.0:1773851872.792213:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851872.792213:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851872.792214:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=105 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851872.792215:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851872.792216:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a79a5b42 refcount 5 to 9210@kfi7
00000100:00000001:1.0:1773851872.792216:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026912 : -107156745524704 : ffff9e8aa03f6a20)
02000000:00000001:1.0:1773851872.792217:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851872.792218:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851872.792218:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851872.792219:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9211@kfi7
00000400:00000010:1.0:1773851872.792219:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003ac07cf1.
00000100:00000200:1.0:1773851872.792220:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030996431616, offset 224
00000400:00000200:1.0:1773851872.792222:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9211@kfi7
00000400:00000200:1.0:1773851872.792222:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.792223:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 1
00000400:00000200:1.0:1773851872.792224:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000400:00000200:1.0:1773851872.792225:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 3
00000400:00000200:1.0:1773851872.792226:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9211@kfi7 local destination
00000400:00000200:1.0:1773851872.792227:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769415:8769415:1024:4294967295] 9211@kfi7 LPNI seq info [24428:24428:16:4294967295]
00000400:00000200:1.0:1773851872.792229:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000400:00000200:1.0:1773851872.792229:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9211@kfi7 to cpt 0
00000400:00000200:1.0:1773851872.792232:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9211@kfi7(9211@kfi7:9211@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851872.792233:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 3
00000800:00000200:1.0:1773851872.792234:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851872.792235:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851872.792237:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851872.792239:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x821 Using peer 9211@kfi7(0x821)
00000800:00000200:1.0:1773851872.792242:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x821: rc=0
00000800:00000200:1.0:1773851872.792244:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x821 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851872.792245:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851872.792246:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a79a5b42 refcount 4 to 9210@kfi7
00010000:00000001:1.0:1773851872.792246:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851872.792247:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851872.792247:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851872.792248:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002ca531ee x1858030996431616/t0(0) o400->b80e1740-cf56-4966-afbe-ec7699bc22df@9210@kfi7:512/0 lens 224/224 e 0 to 0 dl 1773852627 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne204-0'
00000100:00100000:1.0:1773851872.792251:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ca531ee pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b80e1740-cf56-4966-afbe-ec7699bc22df+6:47527:x1858030996431616:12345-9210@kfi7:400:default-tuolumne204-0 Request processed in 55us (97us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851872.792253:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9210@kfi7, seq: 1997572
00000100:00000040:1.0:1773851872.792254:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003996df70 : new rpc_count 0
00000100:00000001:1.0:1773851872.792255:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851872.792255:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:3.0:1773851872.792256:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x821 TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851872.792256:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:3.0:1773851872.792257:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851872.792257:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ef8da19.
00000020:00000010:1.0:1773851872.792257:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042b9c0ff.
00000400:00000200:3.0:1773851872.792258:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9211@kfi7: PUT: OK
00000020:00000040:1.0:1773851872.792258:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003996df70 : new refcount 5
00000400:00000200:3.0:1773851872.792259:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003ac07cf1
00000400:00000010:3.0:1773851872.792259:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003ac07cf1.
00000100:00000001:1.0:1773851872.792259:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851872.792260:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851872.792260:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851872.792261:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000055e7bf8d nid 9211@kfi7 refs 2
00000800:00000200:3.0:1773851872.792262:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2069@kfi7:0 -> 9211@kfi7(00000000aab781ae):0x0 lsk 2082 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x821 Transaction freed
00000800:00000200:15.0:1773851872.832086:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851872.832088:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851872.832089:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851872.832092:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851872.832095:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19315@kfi7 to cpt 3
00000400:00000200:15.0:1773851872.832096:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19315@kfi7 : PUT - for me
00000400:00000200:15.0:1773851872.832098:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19315@kfi7 to cpt 3
00000400:00000200:15.0:1773851872.832099:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de3d91f7 nid 19315@kfi7 refs 1
00000400:00000200:15.0:1773851872.832100:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19315@kfi7 to cpt 3
00000400:00000200:15.0:1773851872.832101:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de3d91f7 nid 19315@kfi7 refs 2
00000400:00000200:15.0:1773851872.832102:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de3d91f7 nid 19315@kfi7 refs 3
00000400:00000200:15.0:1773851872.832103:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19314@kfi7 to cpt 0
00000400:00000200:15.0:1773851872.832104:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19314@kfi7 of length 224 into portal 12 MB=0x69b4c3e43e580
00000400:00000200:15.0:1773851872.832106:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19314@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 34368
00000800:00000200:15.0:1773851872.832109:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851872.832114:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851872.832115:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19315@kfi7: PUT: OK
00000100:00000001:15.0:1773851872.832116:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851872.832117:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851872.832118:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008c78df86.
00000100:00000040:15.0:1773851872.832119:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000008c78df86 x1859601624720768 msgsize 224
00000100:00100000:15.0:1773851872.832121:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-19314@kfi7 (source: 12345-19315@kfi7)
00000100:00000001:15.0:1773851872.832123:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851872.832124:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de3d91f7 nid 19315@kfi7 refs 2
00000800:00000200:15.0:1773851872.832126:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ef9d2f1a: 2069@kfi7:3 <- 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851872.832129:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851872.832130:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851872.832131:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851872.832131:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851872.832132:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851872.832133:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601624720768
00000020:00000001:15.0:1773851872.832134:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851872.832134:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff87c75
00000020:00000001:15.0:1773851872.832135:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851872.832139:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cd052526 refcount=5
00000020:00000001:15.0:1773851872.832139:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097189076992 : -106976520474624 : ffff9eb4967f7000)
00000020:00000001:15.0:1773851872.832140:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097189076992 : -106976520474624 : ffff9eb4967f7000)
00000100:00000001:15.0:1773851872.832142:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.832142:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851872.832143:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebe397c.
00000020:00000010:15.0:1773851872.832145:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851872.832146:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851872.832147:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851872.832148:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851872.832148:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851872.832150:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851872.832150:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851872.832151:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.832152:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851872.832154:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851872.832154:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851872.832155:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851872.832155:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851872.832156:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19314@kfi7, seq: 2289854
00000100:00000040:15.0:1773851872.832157:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cd052526 : new rpc_count 1
00000100:00000001:12.0:1773851872.832157:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.832158:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860199936 : -107049849351680 : ffff9ea383c19200)
00000100:00000001:12.0:1773851872.832158:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.832159:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008c78df86 x1859601624720768/t0(0) o400->1a98ee0b-6d4c-4db8-a292-b2c0b9142724@19314@kfi7:93/0 lens 224/0 e 0 to 0 dl 1773852208 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1690-0'
00000100:00000001:15.0:1773851872.832163:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.832163:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851872.832164:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c78df86 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1a98ee0b-6d4c-4db8-a292-b2c0b9142724+5:39586:x1859601624720768:12345-19314@kfi7:400:default-tuolumne1690-0
00000100:00000200:15.0:1773851872.832166:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601624720768
00000020:00000001:15.0:1773851872.832167:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851872.832167:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851872.832168:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.832169:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851872.832170:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851872.832171:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851872.832171:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601624720768, found 0 last_xid 1859601624720767
00000020:00000001:15.0:1773851872.832172:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851872.832173:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851872.832174:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851872.832174:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.832175:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851872.832176:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851872.832176:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851872.832177:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000570d845.
02000000:00000001:15.0:1773851872.832178:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.832178:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.832179:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851872.832180:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183249746310, transno 0, xid 1859601624720768
00010000:00000001:15.0:1773851872.832181:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851872.832182:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008c78df86 x1859601624720768/t0(0) o400->1a98ee0b-6d4c-4db8-a292-b2c0b9142724@19314@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1690-0'
00010000:00000001:15.0:1773851872.832185:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851872.832186:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851872.832187:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=105 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851872.832188:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851872.832189:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000156a9a9d refcount 3 to 19314@kfi7
00000100:00000001:15.0:1773851872.832190:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545859264 : -107154163692352 : ffff9e8b3a230cc0)
02000000:00000001:15.0:1773851872.832191:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851872.832191:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.832192:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851872.832193:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19315@kfi7
00000400:00000010:15.0:1773851872.832194:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006486d8f3.
00000100:00000200:15.0:1773851872.832195:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601624720768, offset 224
00000400:00000200:15.0:1773851872.832196:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19315@kfi7
00000400:00000200:15.0:1773851872.832197:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19315@kfi7 to cpt 3
00000400:00000200:15.0:1773851872.832198:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de3d91f7 nid 19315@kfi7 refs 1
00000400:00000200:15.0:1773851872.832199:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de3d91f7 nid 19315@kfi7 refs 2
00000400:00000200:15.0:1773851872.832201:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de3d91f7 nid 19315@kfi7 refs 3
00000400:00000200:15.0:1773851872.832202:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19315@kfi7 local destination
00000400:00000200:15.0:1773851872.832204:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769416:8769416:1024:4294967295] 19315@kfi7 LPNI seq info [108023:108023:16:4294967295]
00000400:00000200:15.0:1773851872.832206:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000de3d91f7 nid 19315@kfi7 refs 2
00000400:00000200:15.0:1773851872.832206:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19315@kfi7 to cpt 3
00000400:00000200:15.0:1773851872.832209:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19315@kfi7(19315@kfi7:19315@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851872.832210:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de3d91f7 nid 19315@kfi7 refs 3
00000800:00000200:15.0:1773851872.832211:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851872.832213:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851872.832215:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851872.832217:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xac4 Using peer 19315@kfi7(0xac4)
00000800:00000200:15.0:1773851872.832222:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0xac4: rc=0
00000800:00000200:15.0:1773851872.832223:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xac4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851872.832226:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.832227:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000156a9a9d refcount 2 to 19314@kfi7
00010000:00000001:15.0:1773851872.832227:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851872.832228:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.832229:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851872.832230:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008c78df86 x1859601624720768/t0(0) o400->1a98ee0b-6d4c-4db8-a292-b2c0b9142724@19314@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1690-0'
00000100:00100000:15.0:1773851872.832233:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c78df86 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1a98ee0b-6d4c-4db8-a292-b2c0b9142724+5:39586:x1859601624720768:12345-19314@kfi7:400:default-tuolumne1690-0 Request processed in 70us (113us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851872.832236:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xac4 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851872.832237:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19314@kfi7, seq: 2289854
00000100:00000040:15.0:1773851872.832238:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cd052526 : new rpc_count 0
00000100:00000001:15.0:1773851872.832238:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851872.832238:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851872.832239:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851872.832240:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851872.832240:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:13.0:1773851872.832240:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19315@kfi7: PUT: OK
00000020:00000010:15.0:1773851872.832241:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebe397c.
00000400:00000200:13.0:1773851872.832241:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006486d8f3
00000020:00000040:15.0:1773851872.832242:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000cd052526 : new refcount 4
00000400:00000010:13.0:1773851872.832242:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006486d8f3.
00000100:00000001:15.0:1773851872.832243:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851872.832243:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851872.832243:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851872.832244:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000de3d91f7 nid 19315@kfi7 refs 2
00000800:00000200:13.0:1773851872.832245:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 19315@kfi7(00000000bb864198):0x0 lsk 2757 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xac4 Transaction freed
00000800:00000200:14.0:1773851872.834460:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851872.834460:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851872.834460:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851872.834461:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851872.834462:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851872.834462:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851872.834464:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851872.834464:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9458@kfi7(0000000078fdd823):0x609 version: 2; local version 2; negotiated version: 2
00000400:00000200:14.0:1773851872.834466:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:14.0:1773851872.834467:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9458@kfi7 : PUT - for me
00000800:00000200:13.0:1773851872.834467:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 Using peer 9458@kfi7(0x609)
00000400:00000200:14.0:1773851872.834468:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:14.0:1773851872.834470:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026acd916 nid 9458@kfi7 refs 1
00000400:00000200:14.0:1773851872.834471:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:14.0:1773851872.834472:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026acd916 nid 9458@kfi7 refs 2
00000400:00000200:14.0:1773851872.834472:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000026acd916 nid 9458@kfi7 refs 3
00000400:00000200:13.0:1773851872.834473:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:14.0:1773851872.834474:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:14.0:1773851872.834475:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9458@kfi7 of length 456 into portal 12 MB=0x699e1bd4b0d00
00000400:00000200:14.0:1773851872.834476:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9458@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 34592
00000800:00000200:13.0:1773851872.834476:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x609: rc=0
00000800:00000200:14.0:1773851872.834478:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851872.834478:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851872.834479:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851872.834480:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9458@kfi7: PUT: OK
00000100:00000001:14.0:1773851872.834481:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851872.834481:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851872.834482:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008c684017.
00000100:00000040:14.0:1773851872.834483:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000008c684017 x1858044682767616 msgsize 456
00000100:00100000:14.0:1773851872.834484:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-9458@kfi7 (source: 12345-9458@kfi7)
00000100:00000001:14.0:1773851872.834485:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851872.834486:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:14.0:1773851872.834486:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000026acd916 nid 9458@kfi7 refs 2
02000000:00000001:15.0:1773851872.834487:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851872.834487:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:14.0:1773851872.834487:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851872.834488:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851872.834488:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851872.834489:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044682767616
00000020:00000001:15.0:1773851872.834490:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851872.834490:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917bd
00000800:00000200:13.0:1773851872.834490:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 TN_EVENT_TX_OK event status 0
00000020:00000001:15.0:1773851872.834491:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:13.0:1773851872.834492:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 Transaction freed
00000020:00000040:15.0:1773851872.834497:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000578952df refcount=431
00000020:00000001:15.0:1773851872.834497:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241748480 : -107152467803136 : ffff9e8b9f384400)
00000020:00000001:15.0:1773851872.834501:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241748480 : -107152467803136 : ffff9e8b9f384400)
00000100:00000001:15.0:1773851872.834501:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.834502:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851872.834504:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebe397c.
00000020:00000010:15.0:1773851872.834505:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851872.834505:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851872.834506:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851872.834506:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851872.834507:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.834508:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.834509:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851872.834510:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851872.834510:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851872.834510:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851872.834511:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9458@kfi7, seq: 411190550
00000100:00000001:12.0:1773851872.834511:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851872.834512:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000578952df : new rpc_count 3
00000100:00000001:15.0:1773851872.834512:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562681088 : -106978146870528 : ffff9eb4358e9b00)
00000100:00000001:12.0:1773851872.834512:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.834513:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008c684017 x1858044682767616/t0(0) o17->e2a26e9b-6b8c-46e2-80ee-c334700fa96c@9458@kfi7:599/0 lens 456/0 e 0 to 0 dl 1773851959 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1065-0'
00000100:00000001:12.0:1773851872.834513:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.834516:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851872.834516:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851872.834517:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c684017 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e2a26e9b-6b8c-46e2-80ee-c334700fa96c+431:39824:x1858044682767616:12345-9458@kfi7:17:default-tuolumne1065-0
00000100:00000200:15.0:1773851872.834519:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044682767616
00000020:00000001:15.0:1773851872.834519:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851872.834520:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851872.834520:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.834521:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851872.834521:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:15.0:1773851872.834522:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851872.834522:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044682767616, found 0 last_xid 1858044636790463
00000020:00000001:15.0:1773851872.834523:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851872.834524:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851872.834525:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851872.834525:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851872.834526:0:60824:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:15.0:1773851872.834526:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851872.834527:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851872.834528:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000291bc2f8.
02000000:00000001:15.0:1773851872.834528:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.834529:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.834530:0:60824:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:15.0:1773851872.834530:0:60824:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:15.0:1773851872.834531:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851872.834533:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.834534:0:60824:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:15.0:1773851872.834534:0:60824:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli e2a26e9b-6b8c-46e2-80ee-c334700fa96c/00000000578952df free: 126633370845184 avail: 126633368748032
00000020:00000001:15.0:1773851872.834535:0:60824:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:15.0:1773851872.834536:0:60824:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli e2a26e9b-6b8c-46e2-80ee-c334700fa96c/00000000578952df avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:15.0:1773851872.834537:0:60824:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:15.0:1773851872.834538:0:60824:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:15.0:1773851872.834539:0:60824:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli e2a26e9b-6b8c-46e2-80ee-c334700fa96c/00000000578952df reports grant 1808793599 dropped 0, local 1876951039
00000020:00000001:15.0:1773851872.834540:0:60824:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:15.0:1773851872.834540:0:60824:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:15.0:1773851872.834541:0:60824:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851872.834541:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264556328, transno 0, xid 1858044682767616
00010000:00000001:15.0:1773851872.834542:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851872.834543:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008c684017 x1858044682767616/t0(0) o17->e2a26e9b-6b8c-46e2-80ee-c334700fa96c@9458@kfi7:599/0 lens 456/432 e 0 to 0 dl 1773851959 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1065-0'
00010000:00000001:15.0:1773851872.834545:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851872.834545:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851872.834546:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=105 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851872.834547:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851872.834548:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000022bae6c refcount 3 to 9458@kfi7
00000100:00000001:15.0:1773851872.834548:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521907968 : -107145187643648 : ffff9e8d5126af00)
02000000:00000001:15.0:1773851872.834549:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851872.834550:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851872.834550:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851872.834551:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9458@kfi7
00000400:00000010:15.0:1773851872.834552:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000db5fd08.
00000100:00000200:15.0:1773851872.834553:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858044682767616, offset 224
00000400:00000200:15.0:1773851872.834554:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9458@kfi7
00000400:00000200:15.0:1773851872.834555:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:15.0:1773851872.834555:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026acd916 nid 9458@kfi7 refs 1
00000400:00000200:15.0:1773851872.834556:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000026acd916 nid 9458@kfi7 refs 2
00000400:00000200:15.0:1773851872.834557:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000026acd916 nid 9458@kfi7 refs 3
00000400:00000200:15.0:1773851872.834558:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9458@kfi7 local destination
00000400:00000200:15.0:1773851872.834560:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769417:8769417:1024:4294967295] 9458@kfi7 LPNI seq info [10948075:10948075:16:4294967295]
00000400:00000200:15.0:1773851872.834561:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000026acd916 nid 9458@kfi7 refs 2
00000400:00000200:15.0:1773851872.834562:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9458@kfi7 to cpt 3
00000400:00000200:15.0:1773851872.834563:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9458@kfi7(9458@kfi7:9458@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851872.834564:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000026acd916 nid 9458@kfi7 refs 3
00000800:00000200:15.0:1773851872.834566:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851872.834567:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:15.0:1773851872.834569:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851872.834571:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 Using peer 9458@kfi7(0x609)
00000800:00000200:15.0:1773851872.834574:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 532 bytes to peer 0x609: rc=0
00000800:00000200:15.0:1773851872.834575:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851872.834577:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851872.834578:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000022bae6c refcount 2 to 9458@kfi7
00010000:00000001:15.0:1773851872.834578:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851872.834579:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851872.834579:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851872.834580:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008c684017 x1858044682767616/t0(0) o17->e2a26e9b-6b8c-46e2-80ee-c334700fa96c@9458@kfi7:599/0 lens 456/432 e 0 to 0 dl 1773851959 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1065-0'
00000100:00100000:15.0:1773851872.834583:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c684017 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e2a26e9b-6b8c-46e2-80ee-c334700fa96c+431:39824:x1858044682767616:12345-9458@kfi7:17:default-tuolumne1065-0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851872.834585:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9458@kfi7, seq: 411190550
00000100:00000040:15.0:1773851872.834586:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000578952df : new rpc_count 2
00000100:00000001:15.0:1773851872.834587:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851872.834587:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851872.834587:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851872.834588:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851872.834588:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:13.0:1773851872.834588:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851872.834589:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebe397c.
00000400:00000200:13.0:1773851872.834589:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9458@kfi7: PUT: OK
00000020:00000040:15.0:1773851872.834590:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000578952df : new refcount 430
00000100:00000001:15.0:1773851872.834590:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851872.834590:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000db5fd08
00000400:00000010:13.0:1773851872.834590:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000db5fd08.
00000100:00000001:13.0:1773851872.834591:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851872.834591:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851872.834592:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000026acd916 nid 9458@kfi7 refs 2
00000800:00000200:13.0:1773851872.834593:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 9458@kfi7(0000000078fdd823):0x0 lsk 1546 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x609 Transaction freed
00000800:00000200:30.0:1773851872.843134:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851872.843135:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851872.843136:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851872.843138:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851872.843140:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16146@kfi7 to cpt 7
00000400:00000200:30.0:1773851872.843142:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16146@kfi7 : PUT - for me
00000400:00000200:30.0:1773851872.843143:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16146@kfi7 to cpt 7
00000400:00000200:30.0:1773851872.843144:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000464737fd nid 16146@kfi7 refs 1
00000400:00000200:30.0:1773851872.843146:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16146@kfi7 to cpt 7
00000400:00000200:30.0:1773851872.843146:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000464737fd nid 16146@kfi7 refs 2
00000400:00000200:30.0:1773851872.843147:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000464737fd nid 16146@kfi7 refs 3
00000400:00000200:30.0:1773851872.843148:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16339@kfi7 to cpt 5
00000400:00000200:30.0:1773851872.843149:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16339@kfi7 of length 224 into portal 12 MB=0x69b4b5c9ec980
00000400:00000200:30.0:1773851872.843150:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16339@kfi7 of length 224/224 into md 0x77fe139dd [64] + 181936
00000800:00000200:30.0:1773851872.843152:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851872.843154:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851872.843155:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16146@kfi7: PUT: OK
00000100:00000001:30.0:1773851872.843156:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851872.843157:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851872.843158:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ae9e3688.
00000100:00000040:30.0:1773851872.843158:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000ae9e3688 x1859597839026560 msgsize 224
00000100:00100000:30.0:1773851872.843160:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-16339@kfi7 (source: 12345-16146@kfi7)
00000100:00000001:30.0:1773851872.843161:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851872.843162:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000464737fd nid 16146@kfi7 refs 2
00000100:00000001:31.0:1773851872.843163:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851872.843163:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851872.843164:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851872.843164:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851872.843164:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2054@kfi7:7 <- 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851872.843165:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851872.843166:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597839026560
00000020:00000001:31.0:1773851872.843166:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851872.843167:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82b3d
00000020:00000001:31.0:1773851872.843167:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851872.843170:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c42ead8c refcount=5
00000020:00000001:31.0:1773851872.843171:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119205886976 : -106954503664640 : ffff9eb9b6cd4c00)
00000020:00000001:31.0:1773851872.843172:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119205886976 : -106954503664640 : ffff9eb9b6cd4c00)
00000100:00000001:31.0:1773851872.843173:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851872.843174:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851872.843174:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851872.843176:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851872.843176:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851872.843177:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851872.843178:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851872.843178:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851872.843179:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851872.843180:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851872.843180:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.843181:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851872.843182:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851872.843183:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851872.843183:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851872.843183:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851872.843184:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16339@kfi7, seq: 2055533
00000100:00000040:31.0:1773851872.843184:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c42ead8c : new rpc_count 1
00000100:00000001:31.0:1773851872.843185:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127372021632 : -106946337529984 : ffff9ebb9d8a9f80)
00000100:00000001:28.0:1773851872.843185:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851872.843185:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851872.843186:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ae9e3688 x1859597839026560/t0(0) o400->024e16cb-5579-4cc2-bb6c-fe1dde954c5f@16339@kfi7:660/0 lens 224/0 e 0 to 0 dl 1773852020 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1509-0'
00000100:00000001:31.0:1773851872.843189:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851872.843189:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851872.843190:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae9e3688 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:024e16cb-5579-4cc2-bb6c-fe1dde954c5f+5:39613:x1859597839026560:12345-16339@kfi7:400:default-tuolumne1509-0
00000100:00000200:31.0:1773851872.843192:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597839026560
00000020:00000001:31.0:1773851872.843192:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851872.843193:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851872.843194:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.843194:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851872.843195:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851872.843196:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851872.843196:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597839026560, found 0 last_xid 1859597839026559
00000020:00000001:31.0:1773851872.843197:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851872.843198:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851872.843210:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851872.843211:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.843211:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851872.843212:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851872.843212:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851872.843213:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000009fd8e64.
02000000:00000001:31.0:1773851872.843214:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.843215:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.843215:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851872.843216:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035365045, transno 0, xid 1859597839026560
00010000:00000001:31.0:1773851872.843217:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851872.843218:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ae9e3688 x1859597839026560/t0(0) o400->024e16cb-5579-4cc2-bb6c-fe1dde954c5f@16339@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1509-0'
00010000:00000001:31.0:1773851872.843220:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851872.843221:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851872.843221:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=105 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851872.843222:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851872.843223:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008d8da7a1 refcount 3 to 16339@kfi7
00000100:00000001:31.0:1773851872.843224:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109664 : -107156354441952 : ffff9e8ab78edd20)
02000000:00000001:31.0:1773851872.843225:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851872.843225:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.843226:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851872.843227:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16146@kfi7
00000400:00000010:31.0:1773851872.843228:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa0db5be.
00000100:00000200:31.0:1773851872.843228:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597839026560, offset 224
00000400:00000200:31.0:1773851872.843230:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16146@kfi7
00000400:00000200:31.0:1773851872.843231:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16146@kfi7 to cpt 7
00000400:00000200:31.0:1773851872.843231:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000464737fd nid 16146@kfi7 refs 1
00000400:00000200:31.0:1773851872.843233:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000464737fd nid 16146@kfi7 refs 2
00000400:00000200:31.0:1773851872.843234:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000464737fd nid 16146@kfi7 refs 3
00000400:00000200:31.0:1773851872.843235:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16146@kfi7 local destination
00000400:00000200:31.0:1773851872.843236:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769418:8769418:1024:4294967295] 16146@kfi7 LPNI seq info [1064751:1064751:16:4294967295]
00000400:00000200:31.0:1773851872.843238:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000464737fd nid 16146@kfi7 refs 2
00000400:00000200:31.0:1773851872.843239:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16146@kfi7 to cpt 7
00000400:00000200:31.0:1773851872.843240:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16146@kfi7(16146@kfi7:16146@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851872.843242:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000464737fd nid 16146@kfi7 refs 3
00000800:00000200:31.0:1773851872.843243:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851872.843244:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851872.843246:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851872.843249:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000882 Using peer 16146@kfi7(0x100000000000882)
00000800:00000200:31.0:1773851872.843252:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x100000000000882: rc=0
00000800:00000200:31.0:1773851872.843253:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000882 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851872.843255:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851872.843256:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008d8da7a1 refcount 2 to 16339@kfi7
00010000:00000001:31.0:1773851872.843257:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851872.843258:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.843259:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851872.843259:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ae9e3688 x1859597839026560/t0(0) o400->024e16cb-5579-4cc2-bb6c-fe1dde954c5f@16339@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1509-0'
00000100:00100000:31.0:1773851872.843263:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae9e3688 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:024e16cb-5579-4cc2-bb6c-fe1dde954c5f+5:39613:x1859597839026560:12345-16339@kfi7:400:default-tuolumne1509-0 Request processed in 73us (103us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851872.843265:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16339@kfi7, seq: 2055533
00000100:00000040:31.0:1773851872.843266:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c42ead8c : new rpc_count 0
00000800:00000200:29.0:1773851872.843266:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000882 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851872.843267:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851872.843267:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851872.843268:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851872.843268:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851872.843268:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16146@kfi7: PUT: OK
00000020:00000010:31.0:1773851872.843269:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851872.843269:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa0db5be
00000020:00000010:31.0:1773851872.843270:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000400:00000010:29.0:1773851872.843270:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa0db5be.
00000100:00000001:29.0:1773851872.843270:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:31.0:1773851872.843271:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000c42ead8c : new refcount 4
00000100:00000001:29.0:1773851872.843271:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851872.843272:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851872.843272:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000464737fd nid 16146@kfi7 refs 2
00000800:00000200:29.0:1773851872.843273:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 16146@kfi7(00000000f49371f4):0x0 lsk 2179 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000882 Transaction freed
00000800:00000200:22.0:1773851872.849635:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851872.849637:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851872.849638:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851872.849640:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851872.849642:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16386@kfi7 to cpt 5
00000400:00000200:22.0:1773851872.849644:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16386@kfi7 : PUT - for me
00000400:00000200:22.0:1773851872.849645:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16386@kfi7 to cpt 5
00000400:00000200:22.0:1773851872.849646:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac97df41 nid 16386@kfi7 refs 1
00000400:00000200:22.0:1773851872.849648:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16386@kfi7 to cpt 5
00000400:00000200:22.0:1773851872.849649:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac97df41 nid 16386@kfi7 refs 2
00000400:00000200:22.0:1773851872.849650:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ac97df41 nid 16386@kfi7 refs 3
00000400:00000200:22.0:1773851872.849651:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16387@kfi7 to cpt 0
00000400:00000200:22.0:1773851872.849652:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16387@kfi7 of length 224 into portal 12 MB=0x69b4b59030380
00000400:00000200:22.0:1773851872.849653:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16387@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 42728
00000800:00000200:22.0:1773851872.849655:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851872.849659:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851872.849660:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16386@kfi7: PUT: OK
00000100:00000001:22.0:1773851872.849661:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851872.849662:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851872.849663:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000400ea80a.
00000100:00000040:22.0:1773851872.849664:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000400ea80a x1859597778486144 msgsize 224
00000100:00100000:22.0:1773851872.849665:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-16387@kfi7 (source: 12345-16386@kfi7)
00000100:00000001:22.0:1773851872.849666:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851872.849667:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac97df41 nid 16386@kfi7 refs 2
00000100:00000001:23.0:1773851872.849669:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851872.849669:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851872.849669:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851872.849670:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851872.849671:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851872.849672:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851872.849673:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597778486144
00000020:00000001:23.0:1773851872.849674:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851872.849675:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8095c
00000020:00000001:23.0:1773851872.849676:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851872.849679:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000041f2ffa4 refcount=5
00000020:00000001:23.0:1773851872.849680:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117170350080 : -106956539201536 : ffff9eb93d797800)
00000020:00000001:23.0:1773851872.849682:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117170350080 : -106956539201536 : ffff9eb93d797800)
00000100:00000001:23.0:1773851872.849683:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851872.849684:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851872.849685:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b72ef93.
00000020:00000010:23.0:1773851872.849687:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851872.849688:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851872.849689:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851872.849690:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851872.849691:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851872.849692:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851872.849693:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851872.849694:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851872.849696:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851872.849697:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851872.849698:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851872.849698:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851872.849698:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851872.849700:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16387@kfi7, seq: 1997991
00000100:00000040:20.0:1773851872.849700:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000041f2ffa4 : new rpc_count 1
00000100:00000001:23.0:1773851872.849701:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851872.849701:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619625472 : -107003089926144 : ffff9eae66d5c800)
00000100:00000001:23.0:1773851872.849702:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851872.849703:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000400ea80a x1859597778486144/t0(0) o400->5106fcf3-0415-45d9-aa92-39efd4449008@16387@kfi7:599/0 lens 224/0 e 0 to 0 dl 1773851959 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1527-0'
00000100:00000001:20.0:1773851872.849707:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851872.849708:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851872.849709:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000400ea80a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:5106fcf3-0415-45d9-aa92-39efd4449008+5:39573:x1859597778486144:12345-16387@kfi7:400:default-tuolumne1527-0
00000100:00000200:20.0:1773851872.849710:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597778486144
00000020:00000001:20.0:1773851872.849711:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851872.849712:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851872.849712:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851872.849714:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851872.849715:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851872.849715:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851872.849716:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597778486144, found 0 last_xid 1859597778486143
00000020:00000001:20.0:1773851872.849717:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851872.849718:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851872.849718:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851872.849719:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851872.849720:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851872.849720:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851872.849721:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851872.849722:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009f72a858.
02000000:00000001:20.0:1773851872.849723:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851872.849724:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851872.849729:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851872.849730:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824844, transno 0, xid 1859597778486144
00010000:00000001:20.0:1773851872.849731:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851872.849732:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000400ea80a x1859597778486144/t0(0) o400->5106fcf3-0415-45d9-aa92-39efd4449008@16387@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1527-0'
00010000:00000001:20.0:1773851872.849735:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851872.849735:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851872.849736:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=105 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851872.849738:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851872.849738:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a336cfe3 refcount 3 to 16387@kfi7
00000100:00000001:20.0:1773851872.849739:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051872 : -107154804499744 : ffff9e8b13f11ae0)
02000000:00000001:20.0:1773851872.849740:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851872.849741:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851872.849742:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851872.849743:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16386@kfi7
00000400:00000010:20.0:1773851872.849743:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000046fff747.
00000100:00000200:20.0:1773851872.849745:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597778486144, offset 224
00000400:00000200:20.0:1773851872.849747:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16386@kfi7
00000400:00000200:20.0:1773851872.849748:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16386@kfi7 to cpt 5
00000400:00000200:20.0:1773851872.849749:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac97df41 nid 16386@kfi7 refs 1
00000400:00000200:20.0:1773851872.849750:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ac97df41 nid 16386@kfi7 refs 2
00000400:00000200:20.0:1773851872.849753:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ac97df41 nid 16386@kfi7 refs 3
00000400:00000200:20.0:1773851872.849754:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16386@kfi7 local destination
00000400:00000200:20.0:1773851872.849755:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769419:8769419:1024:4294967295] 16386@kfi7 LPNI seq info [669316:669316:16:4294967295]
00000400:00000200:20.0:1773851872.849757:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ac97df41 nid 16386@kfi7 refs 2
00000400:00000200:20.0:1773851872.849758:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16386@kfi7 to cpt 5
00000400:00000200:20.0:1773851872.849760:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16386@kfi7(16386@kfi7:16386@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851872.849762:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ac97df41 nid 16386@kfi7 refs 3
00000800:00000200:20.0:1773851872.849764:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851872.849765:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851872.849768:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851872.849770:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1d6 Using peer 16386@kfi7(0x1d6)
00000800:00000200:20.0:1773851872.849774:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x1d6: rc=0
00000800:00000200:20.0:1773851872.849775:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1d6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851872.849778:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851872.849779:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a336cfe3 refcount 2 to 16387@kfi7
00010000:00000001:20.0:1773851872.849780:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851872.849780:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851872.849781:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851872.849782:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000400ea80a x1859597778486144/t0(0) o400->5106fcf3-0415-45d9-aa92-39efd4449008@16387@kfi7:599/0 lens 224/224 e 0 to 0 dl 1773851959 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1527-0'
00000100:00100000:20.0:1773851872.849787:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000400ea80a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:5106fcf3-0415-45d9-aa92-39efd4449008+5:39573:x1859597778486144:12345-16387@kfi7:400:default-tuolumne1527-0 Request processed in 79us (122us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851872.849789:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16387@kfi7, seq: 1997991
00000100:00000040:20.0:1773851872.849790:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000041f2ffa4 : new rpc_count 0
00000100:00000001:20.0:1773851872.849791:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851872.849792:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851872.849793:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851872.849794:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:20.0:1773851872.849795:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b72ef93.
00000020:00000040:20.0:1773851872.849796:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000041f2ffa4 : new refcount 4
00000100:00000001:20.0:1773851872.849796:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851872.849803:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1d6 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851872.849805:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851872.849806:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16386@kfi7: PUT: OK
00000400:00000200:22.0:1773851872.849807:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000046fff747
00000400:00000010:22.0:1773851872.849807:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000046fff747.
00000100:00000001:22.0:1773851872.849808:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851872.849809:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851872.849810:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac97df41 nid 16386@kfi7 refs 2
00000800:00000200:22.0:1773851872.849811:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 16386@kfi7(000000004d873d98):0x0 lsk 471 rsk 28 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1d6 Transaction freed
00000800:00000200:29.0:1773851872.892678:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851872.892680:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851872.892682:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851872.892685:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851872.892688:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:29.0:1773851872.892690:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23793@kfi7 : PUT - for me
00000400:00000200:29.0:1773851872.892691:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:29.0:1773851872.892692:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 1
00000400:00000200:29.0:1773851872.892694:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:29.0:1773851872.892695:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000400:00000200:29.0:1773851872.892697:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 3
00000400:00000200:29.0:1773851872.892698:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:29.0:1773851872.892700:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23601@kfi7 of length 224 into portal 12 MB=0x69b09d7099e00
00000400:00000200:29.0:1773851872.892702:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23601@kfi7 of length 224/224 into md 0x77fe139dd [64] + 182160
00000800:00000200:29.0:1773851872.892705:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851872.892708:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851872.892710:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23793@kfi7: PUT: OK
00000100:00000001:29.0:1773851872.892711:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851872.892712:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851872.892713:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008d27fc55.
00000100:00000040:29.0:1773851872.892714:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000008d27fc55 x1859316425006592 msgsize 224
00000100:00100000:29.0:1773851872.892717:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23601@kfi7 (source: 12345-23793@kfi7)
00000100:00000001:29.0:1773851872.892718:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851872.892719:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000100:00000001:31.0:1773851872.892721:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851872.892722:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851872.892722:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851872.892722:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851872.892723:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851872.892724:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851872.892730:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316425006592
00000020:00000001:31.0:1773851872.892731:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851872.892732:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e4e
00000020:00000001:31.0:1773851872.892733:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851872.892738:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ec768259 refcount=8
00000020:00000001:31.0:1773851872.892739:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239633920 : -107152469917696 : ffff9e8b9f180000)
00000020:00000001:31.0:1773851872.892740:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239633920 : -107152469917696 : ffff9e8b9f180000)
00000100:00000001:31.0:1773851872.892741:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851872.892743:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851872.892744:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851872.892745:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851872.892747:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851872.892748:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851872.892749:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851872.892749:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851872.892751:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851872.892751:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851872.892752:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.892754:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851872.892756:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851872.892756:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851872.892757:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851872.892758:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851872.892759:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23601@kfi7, seq: 2055534
00000100:00000040:31.0:1773851872.892760:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ec768259 : new rpc_count 1
00000100:00000001:28.0:1773851872.892760:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.892761:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309665280 : -106988399886336 : ffff9eb1d26e0000)
00000100:00000001:28.0:1773851872.892761:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851872.892763:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008d27fc55 x1859316425006592/t0(0) o400->d9f7cf94-fb7f-4f00-9fd5-1c327ef63167@23601@kfi7:660/0 lens 224/0 e 0 to 0 dl 1773852020 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1965-0'
00000100:00000001:31.0:1773851872.892767:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851872.892768:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851872.892770:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008d27fc55 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:d9f7cf94-fb7f-4f00-9fd5-1c327ef63167+8:39835:x1859316425006592:12345-23601@kfi7:400:default-tuolumne1965-0
00000100:00000200:31.0:1773851872.892772:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316425006592
00000020:00000001:31.0:1773851872.892773:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851872.892774:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851872.892775:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.892776:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851872.892776:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851872.892778:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851872.892779:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316425006592, found 0 last_xid 1859316425006591
00000020:00000001:31.0:1773851872.892780:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851872.892781:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851872.892782:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851872.892782:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.892783:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851872.892784:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851872.892785:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851872.892788:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d3ffe5a1.
02000000:00000001:31.0:1773851872.892789:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.892790:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.892791:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851872.892792:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044152637, transno 0, xid 1859316425006592
00010000:00000001:31.0:1773851872.892793:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851872.892795:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008d27fc55 x1859316425006592/t0(0) o400->d9f7cf94-fb7f-4f00-9fd5-1c327ef63167@23601@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1965-0'
00010000:00000001:31.0:1773851872.892799:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851872.892799:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851872.892801:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=105 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851872.892802:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851872.892803:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ab3415d6 refcount 5 to 23601@kfi7
00000100:00000001:31.0:1773851872.892804:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583903744 : -107156125647872 : ffff9e8ac531fc00)
02000000:00000001:31.0:1773851872.892806:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851872.892806:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851872.892807:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851872.892809:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23793@kfi7
00000400:00000010:31.0:1773851872.892810:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f9abbdbd.
00000100:00000200:31.0:1773851872.892811:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316425006592, offset 224
00000400:00000200:31.0:1773851872.892813:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23793@kfi7
00000400:00000200:31.0:1773851872.892815:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:31.0:1773851872.892816:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 1
00000400:00000200:31.0:1773851872.892818:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000400:00000200:31.0:1773851872.892819:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 3
00000400:00000200:31.0:1773851872.892821:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23793@kfi7 local destination
00000400:00000200:31.0:1773851872.892823:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769420:8769420:1024:4294967295] 23793@kfi7 LPNI seq info [169907:169907:16:4294967295]
00000400:00000200:31.0:1773851872.892825:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000400:00000200:31.0:1773851872.892827:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23793@kfi7 to cpt 7
00000400:00000200:31.0:1773851872.892830:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23793@kfi7(23793@kfi7:23793@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851872.892832:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 3
00000800:00000200:31.0:1773851872.892834:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851872.892835:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851872.892839:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851872.892843:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe7b Using peer 23793@kfi7(0xe7b)
00000800:00000200:31.0:1773851872.892847:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0xe7b: rc=0
00000800:00000200:31.0:1773851872.892849:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe7b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851872.892852:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851872.892854:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ab3415d6 refcount 4 to 23601@kfi7
00010000:00000001:31.0:1773851872.892855:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851872.892856:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851872.892857:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851872.892858:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008d27fc55 x1859316425006592/t0(0) o400->d9f7cf94-fb7f-4f00-9fd5-1c327ef63167@23601@kfi7:660/0 lens 224/224 e 0 to 0 dl 1773852020 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1965-0'
00000800:00000200:29.0:1773851872.892863:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe7b TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851872.892866:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851872.892867:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23793@kfi7: PUT: OK
00000400:00000200:29.0:1773851872.892868:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f9abbdbd
00000100:00100000:31.0:1773851872.892869:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008d27fc55 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:d9f7cf94-fb7f-4f00-9fd5-1c327ef63167+8:39835:x1859316425006592:12345-23601@kfi7:400:default-tuolumne1965-0 Request processed in 100us (153us total) trans 0 rc 0/0
00000400:00000010:29.0:1773851872.892869:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f9abbdbd.
00000100:00000001:29.0:1773851872.892870:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851872.892871:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851872.892872:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000098b98371 nid 23793@kfi7 refs 2
00000100:00100000:31.0:1773851872.892873:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23601@kfi7, seq: 2055534
00000100:00000040:31.0:1773851872.892874:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ec768259 : new rpc_count 0
00000800:00000200:29.0:1773851872.892874:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 23793@kfi7(00000000ef9c9e82):0x0 lsk 3708 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe7b Transaction freed
00000100:00000001:31.0:1773851872.892875:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851872.892876:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851872.892877:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851872.892878:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851872.892879:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851872.892881:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000ec768259 : new refcount 7
00000100:00000001:31.0:1773851872.892882:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851873.003260:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851873.003260:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851873.003261:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851873.003264:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851873.003266:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8641@kfi7 to cpt 2
00000400:00000200:9.0:1773851873.003267:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8641@kfi7 : PUT - for me
00000400:00000200:9.0:1773851873.003268:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8641@kfi7 to cpt 2
00000400:00000200:9.0:1773851873.003269:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005119b563 nid 8641@kfi7 refs 1
00000400:00000200:9.0:1773851873.003270:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8641@kfi7 to cpt 2
00000400:00000200:9.0:1773851873.003271:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005119b563 nid 8641@kfi7 refs 2
00000400:00000200:9.0:1773851873.003272:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005119b563 nid 8641@kfi7 refs 3
00000400:00000200:9.0:1773851873.003273:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8640@kfi7 to cpt 7
00000400:00000200:9.0:1773851873.003273:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8640@kfi7 of length 224 into portal 12 MB=0x69b96006f4340
00000400:00000200:9.0:1773851873.003275:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8640@kfi7 of length 224/224 into md 0x78146ce49 [64] + 141488
00000800:00000200:9.0:1773851873.003276:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851873.003278:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851873.003279:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8641@kfi7: PUT: OK
00000100:00000001:9.0:1773851873.003280:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851873.003280:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851873.003281:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000953e77b6.
00000100:00000040:9.0:1773851873.003282:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000953e77b6 x1859918414955328 msgsize 224
00000100:00100000:9.0:1773851873.003283:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8640@kfi7 (source: 12345-8641@kfi7)
00000100:00000001:9.0:1773851873.003285:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851873.003286:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851873.003286:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005119b563 nid 8641@kfi7 refs 2
02000000:00000001:11.0:1773851873.003287:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851873.003287:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851873.003288:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851873.003288:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851873.003289:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851873.003290:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859918414955328
00000020:00000001:11.0:1773851873.003290:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851873.003291:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b6e3109a6
00000020:00000001:11.0:1773851873.003291:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851873.003295:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000003104de1 refcount=10
00000020:00000001:11.0:1773851873.003295:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133871429632 : -106939838121984 : ffff9ebd20efb800)
00000020:00000001:11.0:1773851873.003296:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133871429632 : -106939838121984 : ffff9ebd20efb800)
00000100:00000001:11.0:1773851873.003297:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851873.003298:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851873.003299:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058b86f43.
00000020:00000010:11.0:1773851873.003300:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851873.003300:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851873.003301:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851873.003302:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851873.003302:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851873.003303:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851873.003304:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851873.003304:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.003305:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851873.003306:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851873.003307:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851873.003308:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8640@kfi7, seq: 2130797
00000100:00000001:8.0:1773851873.003308:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851873.003308:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851873.003309:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000003104de1 : new rpc_count 2
00000100:00000001:8.0:1773851873.003309:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.003310:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125749193344 : -106947960358272 : ffff9ebb3cd03a80)
00000100:00000001:8.0:1773851873.003310:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851873.003311:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000953e77b6 x1859918414955328/t0(0) o400->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:661/0 lens 224/0 e 0 to 0 dl 1773852021 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1027-0'
00000100:00000001:11.0:1773851873.003313:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851873.003314:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851873.003315:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000953e77b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f+10:39971:x1859918414955328:12345-8640@kfi7:400:default-tuolumne1027-0
00000100:00000200:11.0:1773851873.003317:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859918414955328
00000020:00000001:11.0:1773851873.003318:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851873.003318:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851873.003319:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851873.003320:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851873.003320:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851873.003321:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851873.003321:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859918414955328, found 0 last_xid 1859918414644927
00000020:00000001:11.0:1773851873.003322:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851873.003323:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851873.003323:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851873.003324:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851873.003325:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851873.003325:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851873.003326:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851873.003326:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e5fb3415.
02000000:00000001:11.0:1773851873.003327:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.003328:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851873.003328:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851873.003329:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183172162590, transno 0, xid 1859918414955328
00010000:00000001:11.0:1773851873.003330:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851873.003331:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000953e77b6 x1859918414955328/t0(0) o400->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:661/0 lens 224/224 e 0 to 0 dl 1773852021 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1027-0'
00010000:00000001:11.0:1773851873.003333:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851873.003334:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851873.003334:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=106 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851873.003336:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851873.003336:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3aa866a refcount 3 to 8640@kfi7
00000100:00000001:11.0:1773851873.003337:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637113204256128 : -106960505295488 : ffff9eb85113ad80)
02000000:00000001:11.0:1773851873.003338:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851873.003338:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.003339:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851873.003340:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8641@kfi7
00000400:00000010:11.0:1773851873.003340:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000fb1e983.
00000100:00000200:11.0:1773851873.003341:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859918414955328, offset 224
00000400:00000200:11.0:1773851873.003342:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8641@kfi7
00000400:00000200:11.0:1773851873.003343:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8641@kfi7 to cpt 2
00000400:00000200:11.0:1773851873.003344:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005119b563 nid 8641@kfi7 refs 1
00000400:00000200:11.0:1773851873.003345:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005119b563 nid 8641@kfi7 refs 2
00000400:00000200:11.0:1773851873.003347:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005119b563 nid 8641@kfi7 refs 3
00000400:00000200:11.0:1773851873.003348:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8641@kfi7 local destination
00000400:00000200:11.0:1773851873.003349:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769421:8769421:1024:4294967295] 8641@kfi7 LPNI seq info [2312125:2312125:16:4294967295]
00000400:00000200:11.0:1773851873.003351:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005119b563 nid 8641@kfi7 refs 2
00000400:00000200:11.0:1773851873.003352:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8641@kfi7 to cpt 2
00000400:00000200:11.0:1773851873.003354:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8641@kfi7(8641@kfi7:8641@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851873.003355:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005119b563 nid 8641@kfi7 refs 3
00000800:00000200:11.0:1773851873.003357:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851873.003358:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851873.003360:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851873.003363:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1256 Using peer 8641@kfi7(0x1256)
00000800:00000200:11.0:1773851873.003366:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x1256: rc=0
00000800:00000200:11.0:1773851873.003368:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1256 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851873.003370:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851873.003371:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3aa866a refcount 2 to 8640@kfi7
00010000:00000001:11.0:1773851873.003372:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851873.003373:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851873.003375:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851873.003375:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000953e77b6 x1859918414955328/t0(0) o400->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:661/0 lens 224/224 e 0 to 0 dl 1773852021 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1027-0'
00000100:00100000:11.0:1773851873.003379:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000953e77b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f+10:39971:x1859918414955328:12345-8640@kfi7:400:default-tuolumne1027-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851873.003380:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1256 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851873.003382:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8640@kfi7, seq: 2130797
00000400:00000200:9.0:1773851873.003382:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851873.003383:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000003104de1 : new rpc_count 1
00000400:00000200:9.0:1773851873.003383:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8641@kfi7: PUT: OK
00000100:00000001:11.0:1773851873.003384:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851873.003384:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000fb1e983
00000100:00000001:11.0:1773851873.003385:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851873.003385:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000010:9.0:1773851873.003385:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000fb1e983.
00000100:00000001:9.0:1773851873.003385:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851873.003386:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000100:00000001:9.0:1773851873.003386:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851873.003387:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058b86f43.
00000400:00000200:9.0:1773851873.003387:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005119b563 nid 8641@kfi7 refs 2
00000020:00000040:11.0:1773851873.003388:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000003104de1 : new refcount 9
00000800:00000200:9.0:1773851873.003388:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 8641@kfi7(00000000f4c014fd):0x0 lsk 4695 rsk 3 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1256 Transaction freed
00000100:00000001:11.0:1773851873.003389:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851873.014129:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851873.014130:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851873.014133:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851873.014136:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851873.014138:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17521@kfi7 to cpt 1
00000400:00000200:6.0:1773851873.014139:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17521@kfi7 : PUT - for me
00000400:00000200:6.0:1773851873.014140:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17521@kfi7 to cpt 1
00000400:00000200:6.0:1773851873.014141:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000415b9ba7 nid 17521@kfi7 refs 1
00000400:00000200:6.0:1773851873.014142:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17521@kfi7 to cpt 1
00000400:00000200:6.0:1773851873.014142:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000415b9ba7 nid 17521@kfi7 refs 2
00000400:00000200:6.0:1773851873.014143:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000415b9ba7 nid 17521@kfi7 refs 3
00000400:00000200:6.0:1773851873.014144:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17584@kfi7 to cpt 2
00000400:00000200:6.0:1773851873.014145:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17584@kfi7 of length 224 into portal 12 MB=0x69b4b694bb3c0
00000400:00000200:6.0:1773851873.014146:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17584@kfi7 of length 224/224 into md 0x793926dc5 [64] + 148056
00000800:00000200:6.0:1773851873.014148:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851873.014149:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851873.014150:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17521@kfi7: PUT: OK
00000100:00000001:6.0:1773851873.014151:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851873.014151:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851873.014152:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0ee1853.
00000100:00000040:6.0:1773851873.014153:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000a0ee1853 x1859598051685312 msgsize 224
00000100:00100000:6.0:1773851873.014155:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-17584@kfi7 (source: 12345-17521@kfi7)
00000100:00000001:6.0:1773851873.014156:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851873.014157:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851873.014157:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000415b9ba7 nid 17521@kfi7 refs 2
02000000:00000001:7.0:1773851873.014158:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851873.014158:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851873.014158:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851873.014159:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851873.014160:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851873.014160:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598051685312
00000020:00000001:7.0:1773851873.014161:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851873.014161:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d815a3
00000020:00000001:7.0:1773851873.014162:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851873.014165:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d90ebb85 refcount=167
00000020:00000001:7.0:1773851873.014166:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136006999040 : -106937702552576 : ffff9ebda039ec00)
00000020:00000001:7.0:1773851873.014167:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136006999040 : -106937702552576 : ffff9ebda039ec00)
00000100:00000001:7.0:1773851873.014168:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851873.014169:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851873.014170:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851873.014171:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851873.014172:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851873.014173:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851873.014173:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851873.014173:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.014174:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851873.014175:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851873.014175:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.014176:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.014177:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851873.014178:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851873.014178:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851873.014178:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851873.014179:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17584@kfi7, seq: 2001932
00000100:00000040:7.0:1773851873.014180:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d90ebb85 : new rpc_count 1
00000100:00000001:7.0:1773851873.014180:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814077312 : -107101895474304 : ffff9e976590c380)
00000100:00000001:4.0:1773851873.014180:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.014180:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851873.014181:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a0ee1853 x1859598051685312/t0(0) o400->0f151f31-d52e-46c1-a297-3c4503ee5407@17584@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1582-0'
00000100:00000001:7.0:1773851873.014184:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851873.014184:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851873.014185:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0ee1853 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:0f151f31-d52e-46c1-a297-3c4503ee5407+167:39674:x1859598051685312:12345-17584@kfi7:400:default-tuolumne1582-0
00000100:00000200:7.0:1773851873.014188:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598051685312
00000020:00000001:7.0:1773851873.014189:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851873.014189:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851873.014190:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851873.014191:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851873.014191:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851873.014192:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851873.014193:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598051685312, found 0 last_xid 1859598051287807
00000020:00000001:7.0:1773851873.014194:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851873.014195:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851873.014195:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851873.014196:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851873.014196:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851873.014197:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851873.014197:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851873.014198:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001c3efb66.
02000000:00000001:7.0:1773851873.014199:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.014199:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851873.014200:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851873.014201:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063045, transno 0, xid 1859598051685312
00010000:00000001:7.0:1773851873.014201:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851873.014202:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a0ee1853 x1859598051685312/t0(0) o400->0f151f31-d52e-46c1-a297-3c4503ee5407@17584@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1582-0'
00010000:00000001:7.0:1773851873.014205:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851873.014205:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851873.014206:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=105 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851873.014207:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851873.014208:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fde8cfba refcount 3 to 17584@kfi7
00000100:00000001:7.0:1773851873.014209:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580064 : -107154806971552 : ffff9e8b13cb6360)
02000000:00000001:7.0:1773851873.014210:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851873.014210:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.014211:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851873.014211:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17521@kfi7
00000400:00000010:7.0:1773851873.014212:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
00000100:00000200:7.0:1773851873.014213:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598051685312, offset 224
00000400:00000200:7.0:1773851873.014215:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17521@kfi7
00000400:00000200:7.0:1773851873.014215:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17521@kfi7 to cpt 1
00000400:00000200:7.0:1773851873.014216:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000415b9ba7 nid 17521@kfi7 refs 1
00000400:00000200:7.0:1773851873.014217:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000415b9ba7 nid 17521@kfi7 refs 2
00000400:00000200:7.0:1773851873.014218:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000415b9ba7 nid 17521@kfi7 refs 3
00000400:00000200:7.0:1773851873.014220:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17521@kfi7 local destination
00000400:00000200:7.0:1773851873.014221:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769422:8769422:1024:4294967295] 17521@kfi7 LPNI seq info [2963606:2963606:16:4294967295]
00000400:00000200:7.0:1773851873.014222:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000415b9ba7 nid 17521@kfi7 refs 2
00000400:00000200:7.0:1773851873.014223:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17521@kfi7 to cpt 1
00000400:00000200:7.0:1773851873.014225:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17521@kfi7(17521@kfi7:17521@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851873.014226:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000415b9ba7 nid 17521@kfi7 refs 3
00000800:00000200:7.0:1773851873.014227:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851873.014228:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851873.014230:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851873.014233:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000072e Using peer 17521@kfi7(0x10000000000072e)
00000800:00000200:7.0:1773851873.014236:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x10000000000072e: rc=0
00000800:00000200:7.0:1773851873.014237:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000072e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851873.014239:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851873.014240:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fde8cfba refcount 2 to 17584@kfi7
00010000:00000001:7.0:1773851873.014241:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851873.014241:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851873.014242:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851873.014243:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0ee1853 x1859598051685312/t0(0) o400->0f151f31-d52e-46c1-a297-3c4503ee5407@17584@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1582-0'
00000100:00100000:7.0:1773851873.014246:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0ee1853 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:0f151f31-d52e-46c1-a297-3c4503ee5407+167:39674:x1859598051685312:12345-17584@kfi7:400:default-tuolumne1582-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851873.014250:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17584@kfi7, seq: 2001932
00000800:00000200:6.0:1773851873.014250:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000072e TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851873.014251:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d90ebb85 : new rpc_count 0
00000100:00000001:7.0:1773851873.014251:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851873.014251:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851873.014252:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851873.014252:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:6.0:1773851873.014252:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17521@kfi7: PUT: OK
00000020:00000010:7.0:1773851873.014253:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000400:00000200:6.0:1773851873.014253:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000020:00000010:7.0:1773851873.014254:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000400:00000010:6.0:1773851873.014254:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000020:00000040:7.0:1773851873.014255:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000d90ebb85 : new refcount 166
00000100:00000001:7.0:1773851873.014255:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851873.014255:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851873.014256:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851873.014257:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000415b9ba7 nid 17521@kfi7 refs 2
00000800:00000200:6.0:1773851873.014258:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17521@kfi7(00000000b9d4b523):0x0 lsk 1839 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000072e Transaction freed
00000800:00000200:25.0:1773851873.052749:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.052750:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851873.052751:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851873.052753:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851873.052755:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23290@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.052756:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23290@kfi7 : PUT - for me
00000400:00000200:25.0:1773851873.052757:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23290@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.052758:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000295640a6 nid 23290@kfi7 refs 1
00000400:00000200:25.0:1773851873.052759:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23290@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.052760:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000295640a6 nid 23290@kfi7 refs 2
00000400:00000200:25.0:1773851873.052760:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000295640a6 nid 23290@kfi7 refs 3
00000400:00000200:25.0:1773851873.052762:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23291@kfi7 to cpt 1
00000400:00000200:25.0:1773851873.052762:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23291@kfi7 of length 224 into portal 12 MB=0x699de8c538e80
00000400:00000200:25.0:1773851873.052764:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23291@kfi7 of length 224/224 into md 0x16159c9699 [64] + 18256
00000800:00000200:25.0:1773851873.052766:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851873.052768:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851873.052768:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23290@kfi7: PUT: OK
00000100:00000001:25.0:1773851873.052769:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851873.052770:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851873.052770:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf28743f.
00000100:00000040:25.0:1773851873.052771:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000cf28743f x1858030976339584 msgsize 224
00000100:00100000:25.0:1773851873.052773:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-23291@kfi7 (source: 12345-23290@kfi7)
00000100:00000001:25.0:1773851873.052774:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851873.052775:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851873.052775:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000295640a6 nid 23290@kfi7 refs 2
02000000:00000001:26.0:1773851873.052776:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851873.052776:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851873.052776:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851873.052777:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851873.052777:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851873.052778:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976339584
00000020:00000001:26.0:1773851873.052779:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851873.052779:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fe4
00000020:00000001:26.0:1773851873.052780:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851873.052783:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d6eb8a85 refcount=6
00000020:00000001:26.0:1773851873.052784:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240115200 : -107152469436416 : ffff9e8b9f1f5800)
00000020:00000001:26.0:1773851873.052785:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240115200 : -107152469436416 : ffff9e8b9f1f5800)
00000100:00000001:26.0:1773851873.052786:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851873.052787:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851873.052788:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f009aeee.
00000020:00000010:26.0:1773851873.052789:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851873.052789:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000f3b5d84.
00000100:00000001:26.0:1773851873.052790:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851873.052791:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851873.052791:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851873.052792:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851873.052793:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851873.052793:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.052794:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851873.052795:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851873.052795:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851873.052796:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851873.052796:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851873.052797:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23291@kfi7, seq: 2025114
00000100:00000040:26.0:1773851873.052797:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d6eb8a85 : new rpc_count 1
00000100:00000001:25.0:1773851873.052797:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.052798:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159410186880 : -106914299364736 : ffff9ec3132a3a80)
00000100:00000001:25.0:1773851873.052798:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851873.052799:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cf28743f x1858030976339584/t0(0) o400->d64a0933-9485-48e1-a8c6-e38dc47717ba@23291@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne259-0'
00000100:00000001:26.0:1773851873.052802:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851873.052803:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851873.052804:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cf28743f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d64a0933-9485-48e1-a8c6-e38dc47717ba+6:47838:x1858030976339584:12345-23291@kfi7:400:default-tuolumne259-0
00000100:00000200:26.0:1773851873.052805:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976339584
00000020:00000001:26.0:1773851873.052805:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851873.052806:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851873.052807:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851873.052807:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851873.052808:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851873.052809:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851873.052809:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976339584, found 0 last_xid 1858030976339583
00000020:00000001:26.0:1773851873.052810:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851873.052811:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851873.052812:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851873.052812:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851873.052813:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851873.052814:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851873.052814:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851873.052815:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007e903d1e.
02000000:00000001:26.0:1773851873.052815:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.052816:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851873.052817:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851873.052817:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030976339584
00010000:00000001:26.0:1773851873.052818:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851873.052819:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cf28743f x1858030976339584/t0(0) o400->d64a0933-9485-48e1-a8c6-e38dc47717ba@23291@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne259-0'
00010000:00000001:26.0:1773851873.052821:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851873.052822:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851873.052822:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=106 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851873.052823:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851873.052824:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b3ed8c93 refcount 5 to 23291@kfi7
00000100:00000001:26.0:1773851873.052825:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701056 : -107156155850560 : ffff9e8ac36520c0)
02000000:00000001:26.0:1773851873.052826:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851873.052826:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.052827:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851873.052828:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23290@kfi7
00000400:00000010:26.0:1773851873.052829:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1589030.
00000100:00000200:26.0:1773851873.052829:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976339584, offset 224
00000400:00000200:26.0:1773851873.052831:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23290@kfi7
00000400:00000200:26.0:1773851873.052831:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23290@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.052832:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000295640a6 nid 23290@kfi7 refs 1
00000400:00000200:26.0:1773851873.052833:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000295640a6 nid 23290@kfi7 refs 2
00000400:00000200:26.0:1773851873.052834:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000295640a6 nid 23290@kfi7 refs 3
00000400:00000200:26.0:1773851873.052836:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23290@kfi7 local destination
00000400:00000200:26.0:1773851873.052837:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769423:8769423:1024:4294967295] 23290@kfi7 LPNI seq info [24434:24434:16:4294967295]
00000400:00000200:26.0:1773851873.052838:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000295640a6 nid 23290@kfi7 refs 2
00000400:00000200:26.0:1773851873.052839:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23290@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.052841:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23290@kfi7(23290@kfi7:23290@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851873.052842:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000295640a6 nid 23290@kfi7 refs 3
00000800:00000200:26.0:1773851873.052844:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851873.052845:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851873.052847:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851873.052849:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c9 Using peer 23290@kfi7(0x1000000000007c9)
00000800:00000200:26.0:1773851873.052852:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x1000000000007c9: rc=0
00000800:00000200:26.0:1773851873.052854:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851873.052856:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851873.052856:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b3ed8c93 refcount 4 to 23291@kfi7
00010000:00000001:26.0:1773851873.052857:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851873.052859:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851873.052859:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851873.052860:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cf28743f x1858030976339584/t0(0) o400->d64a0933-9485-48e1-a8c6-e38dc47717ba@23291@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne259-0'
00000100:00100000:26.0:1773851873.052863:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cf28743f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d64a0933-9485-48e1-a8c6-e38dc47717ba+6:47838:x1858030976339584:12345-23291@kfi7:400:default-tuolumne259-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851873.052865:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23291@kfi7, seq: 2025114
00000100:00000040:26.0:1773851873.052866:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d6eb8a85 : new rpc_count 0
00000100:00000001:26.0:1773851873.052866:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851873.052866:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c9 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851873.052867:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851873.052867:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851873.052868:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851873.052868:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000f3b5d84.
00000400:00000200:25.0:1773851873.052868:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23290@kfi7: PUT: OK
00000020:00000010:26.0:1773851873.052869:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f009aeee.
00000400:00000200:25.0:1773851873.052869:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1589030
00000400:00000010:25.0:1773851873.052869:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1589030.
00000020:00000040:26.0:1773851873.052870:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000d6eb8a85 : new refcount 5
00000100:00000001:25.0:1773851873.052870:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851873.052871:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851873.052871:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851873.052872:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000295640a6 nid 23290@kfi7 refs 2
00000800:00000200:25.0:1773851873.052873:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 23290@kfi7(00000000d69a11bc):0x0 lsk 1994 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c9 Transaction freed
00000800:00000200:5.0:1773851873.053102:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851873.053103:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851873.053104:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851873.053107:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851873.053109:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23291@kfi7 to cpt 1
00000400:00000200:5.0:1773851873.053110:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23291@kfi7 : PUT - for me
00000400:00000200:5.0:1773851873.053111:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23291@kfi7 to cpt 1
00000400:00000200:5.0:1773851873.053112:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8a35e3f nid 23291@kfi7 refs 1
00000400:00000200:5.0:1773851873.053112:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23291@kfi7 to cpt 1
00000400:00000200:5.0:1773851873.053113:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8a35e3f nid 23291@kfi7 refs 2
00000400:00000200:5.0:1773851873.053114:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b8a35e3f nid 23291@kfi7 refs 3
00000400:00000200:5.0:1773851873.053115:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23291@kfi7 to cpt 1
00000400:00000200:5.0:1773851873.053116:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23291@kfi7 of length 224 into portal 12 MB=0x699de8c5396c0
00000400:00000200:5.0:1773851873.053117:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23291@kfi7 of length 224/224 into md 0x793926dc5 [64] + 148280
00000800:00000200:5.0:1773851873.053119:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851873.053121:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851873.053122:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23291@kfi7: PUT: OK
00000100:00000001:5.0:1773851873.053123:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851873.053123:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851873.053124:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000057ccff1.
00000100:00000040:5.0:1773851873.053125:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000057ccff1 x1858030976341696 msgsize 224
00000100:00100000:5.0:1773851873.053127:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23291@kfi7 (source: 12345-23291@kfi7)
00000100:00000001:5.0:1773851873.053127:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851873.053128:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8a35e3f nid 23291@kfi7 refs 2
00000100:00000001:7.0:1773851873.053129:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851873.053129:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851873.053130:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851873.053130:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851873.053130:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851873.053131:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851873.053132:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976341696
00000020:00000001:7.0:1773851873.053132:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851873.053133:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91157
00000020:00000001:7.0:1773851873.053133:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851873.053135:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fb040ed2 refcount=6
00000020:00000001:7.0:1773851873.053136:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240332288 : -107152469219328 : ffff9e8b9f22a800)
00000020:00000001:7.0:1773851873.053137:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240332288 : -107152469219328 : ffff9e8b9f22a800)
00000100:00000001:7.0:1773851873.053138:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851873.053139:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851873.053139:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851873.053140:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851873.053141:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851873.053142:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851873.053142:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851873.053143:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.053144:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851873.053144:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851873.053144:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.053145:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.053147:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851873.053147:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851873.053147:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851873.053147:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851873.053149:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23291@kfi7, seq: 2001933
00000100:00000001:7.0:1773851873.053150:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.053150:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851873.053150:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fb040ed2 : new rpc_count 1
00000100:00000001:4.0:1773851873.053150:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273393920 : -107034436157696 : ffff9ea71a743f00)
00000100:00000040:4.0:1773851873.053152:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000057ccff1 x1858030976341696/t0(0) o400->a6c93833-c74f-48c7-a5e1-bb5813cc054b@23291@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne259-0'
00000100:00000001:4.0:1773851873.053155:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851873.053155:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851873.053156:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000057ccff1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:a6c93833-c74f-48c7-a5e1-bb5813cc054b+6:47839:x1858030976341696:12345-23291@kfi7:400:default-tuolumne259-0
00000100:00000200:4.0:1773851873.053158:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976341696
00000020:00000001:4.0:1773851873.053158:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851873.053159:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851873.053160:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851873.053161:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851873.053162:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851873.053163:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851873.053163:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976341696, found 0 last_xid 1858030976341695
00000020:00000001:4.0:1773851873.053165:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851873.053165:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851873.053166:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851873.053166:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851873.053167:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851873.053168:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851873.053168:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851873.053169:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f694577a.
02000000:00000001:4.0:1773851873.053170:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.053171:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851873.053171:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851873.053172:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768049, transno 0, xid 1858030976341696
00010000:00000001:4.0:1773851873.053173:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851873.053174:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000057ccff1 x1858030976341696/t0(0) o400->a6c93833-c74f-48c7-a5e1-bb5813cc054b@23291@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne259-0'
00010000:00000001:4.0:1773851873.053177:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851873.053177:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851873.053178:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=105 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851873.053180:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851873.053180:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b3ed8c93 refcount 5 to 23291@kfi7
00000100:00000001:4.0:1773851873.053181:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701056 : -107156155850560 : ffff9e8ac36520c0)
02000000:00000001:4.0:1773851873.053183:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851873.053183:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.053184:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851873.053185:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23291@kfi7
00000400:00000010:4.0:1773851873.053186:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a0b1f78.
00000100:00000200:4.0:1773851873.053187:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976341696, offset 224
00000400:00000200:4.0:1773851873.053189:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23291@kfi7
00000400:00000200:4.0:1773851873.053190:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23291@kfi7 to cpt 1
00000400:00000200:4.0:1773851873.053191:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8a35e3f nid 23291@kfi7 refs 1
00000400:00000200:4.0:1773851873.053192:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b8a35e3f nid 23291@kfi7 refs 2
00000400:00000200:4.0:1773851873.053193:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b8a35e3f nid 23291@kfi7 refs 3
00000400:00000200:4.0:1773851873.053194:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23291@kfi7 local destination
00000400:00000200:4.0:1773851873.053196:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769424:8769424:1024:4294967295] 23291@kfi7 LPNI seq info [24435:24435:16:4294967295]
00000400:00000200:4.0:1773851873.053197:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b8a35e3f nid 23291@kfi7 refs 2
00000400:00000200:4.0:1773851873.053198:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23291@kfi7 to cpt 1
00000400:00000200:4.0:1773851873.053200:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23291@kfi7(23291@kfi7:23291@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851873.053201:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b8a35e3f nid 23291@kfi7 refs 3
00000800:00000200:4.0:1773851873.053203:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851873.053204:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851873.053206:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851873.053209:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7ca Using peer 23291@kfi7(0x7ca)
00000800:00000200:4.0:1773851873.053212:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x7ca: rc=0
00000800:00000200:4.0:1773851873.053214:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7ca TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851873.053216:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851873.053217:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b3ed8c93 refcount 4 to 23291@kfi7
00010000:00000001:4.0:1773851873.053217:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851873.053218:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851873.053218:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851873.053219:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000057ccff1 x1858030976341696/t0(0) o400->a6c93833-c74f-48c7-a5e1-bb5813cc054b@23291@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne259-0'
00000100:00100000:4.0:1773851873.053224:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000057ccff1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:a6c93833-c74f-48c7-a5e1-bb5813cc054b+6:47839:x1858030976341696:12345-23291@kfi7:400:default-tuolumne259-0 Request processed in 68us (98us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851873.053226:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23291@kfi7, seq: 2001933
00000100:00000040:4.0:1773851873.053226:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fb040ed2 : new rpc_count 0
00000100:00000001:4.0:1773851873.053228:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851873.053228:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851873.053229:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:4.0:1773851873.053229:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000020:00000010:4.0:1773851873.053230:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000020:00000040:4.0:1773851873.053231:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000fb040ed2 : new refcount 5
00000100:00000001:4.0:1773851873.053231:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851873.053236:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7ca TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851873.053238:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851873.053239:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23291@kfi7: PUT: OK
00000400:00000200:5.0:1773851873.053240:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a0b1f78
00000400:00000010:5.0:1773851873.053240:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a0b1f78.
00000100:00000001:5.0:1773851873.053241:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851873.053242:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851873.053243:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8a35e3f nid 23291@kfi7 refs 2
00000800:00000200:5.0:1773851873.053244:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 23291@kfi7(00000000b824e0e3):0x0 lsk 1995 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7ca Transaction freed
00000800:00000200:25.0:1773851873.086451:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.086452:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851873.086453:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851873.086455:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851873.086457:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23696@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.086458:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23696@kfi7 : PUT - for me
00000400:00000200:25.0:1773851873.086459:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23696@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.086460:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c73e2fbe nid 23696@kfi7 refs 1
00000400:00000200:25.0:1773851873.086461:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23696@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.086462:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c73e2fbe nid 23696@kfi7 refs 2
00000400:00000200:25.0:1773851873.086463:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c73e2fbe nid 23696@kfi7 refs 3
00000400:00000200:25.0:1773851873.086464:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23696@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.086465:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23696@kfi7 of length 224 into portal 12 MB=0x699e0fac40e40
00000400:00000200:25.0:1773851873.086466:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23696@kfi7 of length 224/224 into md 0x16159c9699 [64] + 18480
00000800:00000200:25.0:1773851873.086468:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851873.086470:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851873.086471:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23696@kfi7: PUT: OK
00000100:00000001:25.0:1773851873.086472:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851873.086473:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851873.086474:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000006734c1e.
00000100:00000040:25.0:1773851873.086474:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000006734c1e x1858041419140672 msgsize 224
00000100:00100000:25.0:1773851873.086476:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-23696@kfi7 (source: 12345-23696@kfi7)
00000100:00000001:25.0:1773851873.086477:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851873.086478:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c73e2fbe nid 23696@kfi7 refs 2
00000800:00000200:25.0:1773851873.086479:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2069@kfi7:6 <- 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851873.086480:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851873.086481:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851873.086481:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851873.086482:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851873.086483:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851873.086484:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041419140672
00000020:00000001:26.0:1773851873.086485:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851873.086486:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920d8
00000020:00000001:26.0:1773851873.086487:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851873.086491:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f856baf refcount=6
00000020:00000001:26.0:1773851873.086492:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629483520 : -107123080068096 : ffff9e9276dd8400)
00000020:00000001:26.0:1773851873.086494:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629483520 : -107123080068096 : ffff9e9276dd8400)
00000100:00000001:26.0:1773851873.086495:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851873.086497:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851873.086498:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f009aeee.
00000020:00000010:26.0:1773851873.086499:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851873.086501:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000f3b5d84.
00000100:00000001:26.0:1773851873.086502:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851873.086504:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851873.086505:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851873.086507:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851873.086507:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851873.086508:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.086510:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851873.086511:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851873.086512:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851873.086512:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851873.086513:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851873.086513:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23696@kfi7, seq: 2025115
00000100:00000001:26.0:1773851873.086514:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851873.086514:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f856baf : new rpc_count 1
00000100:00000001:26.0:1773851873.086515:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851873.086515:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637057733479552 : -107015976072064 : ffff9eab66c2cc80)
00000100:00000040:25.0:1773851873.086516:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000006734c1e x1858041419140672/t0(0) o400->1e16b555-9ae8-4f36-a62f-4750e48422fc@23696@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1970-0'
00000100:00000001:25.0:1773851873.086520:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851873.086520:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851873.086521:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006734c1e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1e16b555-9ae8-4f36-a62f-4750e48422fc+6:39638:x1858041419140672:12345-23696@kfi7:400:default-tuolumne1970-0
00000100:00000200:25.0:1773851873.086523:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041419140672
00000020:00000001:25.0:1773851873.086524:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851873.086525:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851873.086526:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851873.086527:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851873.086527:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851873.086528:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851873.086529:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041419140672, found 0 last_xid 1858041419140671
00000020:00000001:25.0:1773851873.086530:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851873.086531:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851873.086532:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851873.086532:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851873.086533:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851873.086534:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851873.086535:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851873.086535:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b068e8bb.
02000000:00000001:25.0:1773851873.086536:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851873.086537:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851873.086538:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851873.086539:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182422287649, transno 0, xid 1858041419140672
00010000:00000001:25.0:1773851873.086540:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851873.086540:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000006734c1e x1858041419140672/t0(0) o400->1e16b555-9ae8-4f36-a62f-4750e48422fc@23696@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1970-0'
00010000:00000001:25.0:1773851873.086543:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851873.086544:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851873.086545:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=106 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851873.086546:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851873.086547:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006d19eb99 refcount 3 to 23696@kfi7
00000100:00000001:25.0:1773851873.086548:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860896 : -107149578690720 : ffff9e8c4b6c9f60)
02000000:00000001:25.0:1773851873.086549:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851873.086549:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851873.086550:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851873.086551:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23696@kfi7
00000400:00000010:25.0:1773851873.086552:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000065eaabeb.
00000100:00000200:25.0:1773851873.086553:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041419140672, offset 224
00000400:00000200:25.0:1773851873.086554:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23696@kfi7
00000400:00000200:25.0:1773851873.086555:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23696@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.086556:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c73e2fbe nid 23696@kfi7 refs 1
00000400:00000200:25.0:1773851873.086557:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c73e2fbe nid 23696@kfi7 refs 2
00000400:00000200:25.0:1773851873.086558:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c73e2fbe nid 23696@kfi7 refs 3
00000400:00000200:25.0:1773851873.086560:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23696@kfi7 local destination
00000400:00000200:25.0:1773851873.086562:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769425:8769425:1024:4294967295] 23696@kfi7 LPNI seq info [7478374:7478374:16:4294967295]
00000400:00000200:25.0:1773851873.086564:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c73e2fbe nid 23696@kfi7 refs 2
00000400:00000200:25.0:1773851873.086565:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23696@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.086567:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23696@kfi7(23696@kfi7:23696@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851873.086569:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c73e2fbe nid 23696@kfi7 refs 3
00000800:00000200:25.0:1773851873.086570:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.086572:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851873.086576:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851873.086581:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x18e Using peer 23696@kfi7(0x18e)
00000800:00000200:25.0:1773851873.086586:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000016005f0: Posted send of 324 bytes to peer 0x18e: rc=0
00000800:00000200:25.0:1773851873.086589:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x18e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851873.086592:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851873.086594:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006d19eb99 refcount 2 to 23696@kfi7
00010000:00000001:25.0:1773851873.086595:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851873.086596:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851873.086597:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851873.086599:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000006734c1e x1858041419140672/t0(0) o400->1e16b555-9ae8-4f36-a62f-4750e48422fc@23696@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1970-0'
00000800:00000200:27.0:1773851873.086601:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x18e TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851873.086603:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851873.086604:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23696@kfi7: PUT: OK
00000400:00000200:27.0:1773851873.086605:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000065eaabeb
00000400:00000010:27.0:1773851873.086605:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000065eaabeb.
00000100:00100000:25.0:1773851873.086605:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006734c1e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1e16b555-9ae8-4f36-a62f-4750e48422fc+6:39638:x1858041419140672:12345-23696@kfi7:400:default-tuolumne1970-0 Request processed in 84us (129us total) trans 0 rc 0/0
00000100:00000001:27.0:1773851873.086606:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851873.086607:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851873.086608:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c73e2fbe nid 23696@kfi7 refs 2
00000800:00000200:27.0:1773851873.086609:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2069@kfi7:6 -> 23696@kfi7(00000000540446b6):0x0 lsk 399 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x18e Transaction freed
00000100:00100000:25.0:1773851873.086609:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23696@kfi7, seq: 2025115
00000100:00000040:25.0:1773851873.086610:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f856baf : new rpc_count 0
00000100:00000001:25.0:1773851873.086612:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851873.086613:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851873.086614:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:25.0:1773851873.086615:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000f3b5d84.
00000020:00000010:25.0:1773851873.086617:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f009aeee.
00000020:00000040:25.0:1773851873.086618:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000003f856baf : new refcount 5
00000100:00000001:25.0:1773851873.086620:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851873.097731:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851873.097732:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851873.097732:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:9.0:1773851873.097732:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:31.0:1773851873.097733:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:10.0:1773851873.097733:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005684d651.
00000100:00000010:9.0:1773851873.097733:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000837d256e.
00000004:00000001:6.0:1773851873.097733:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851873.097733:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:31.0:1773851873.097734:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:10.0:1773851873.097734:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000020:00000040:9.0:1773851873.097734:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000004:00000001:7.0:1773851873.097734:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:6.0:1773851873.097734:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000078d0b7f7.
00000100:00000010:31.0:1773851873.097735:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076fddf96.
00000004:00000001:30.0:1773851873.097735:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:10.0:1773851873.097735:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851873.097735:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:9.0:1773851873.097735:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:7.0:1773851873.097735:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:6.0:1773851873.097735:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000004:00000001:5.0:1773851873.097735:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:31.0:1773851873.097736:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000004:00000020:30.0:1773851873.097736:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:10.0:1773851873.097736:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851873.097736:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:9.0:1773851873.097736:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:7.0:1773851873.097736:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000067479cf9.
00000100:00000001:6.0:1773851873.097736:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:5.0:1773851873.097736:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:31.0:1773851873.097737:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:10.0:1773851873.097737:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000469124a5.
02000000:00000010:9.0:1773851873.097737:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000001:6.0:1773851873.097737:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851873.097737:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851873.097737:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004d4a1efb.
02000000:00000001:31.0:1773851873.097738:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:30.0:1773851873.097738:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ab74edb.
00000100:00000001:10.0:1773851873.097738:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851873.097738:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851873.097738:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
02000000:00000010:6.0:1773851873.097738:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a478f995.
02000000:00000001:31.0:1773851873.097739:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:30.0:1773851873.097739:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:10.0:1773851873.097739:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851873.097739:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851873.097739:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000020:00000040:5.0:1773851873.097739:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
02000000:00000010:31.0:1773851873.097740:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000142f89ee.
00000100:00000001:9.0:1773851873.097740:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.097740:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851873.097740:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851873.097740:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:31.0:1773851873.097741:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851873.097741:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000040:10.0:1773851873.097741:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005684d651] to pc [ptlrpcd_02_03+3]  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851873.097741:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000837d256e] to pc [ptlrpcd_02_00+0]  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851873.097741:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851873.097741:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851873.097741:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851873.097741:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:31.0:1773851873.097742:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:30.0:1773851873.097742:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851873.097742:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.097743:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851873.097743:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851873.097743:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000078d0b7f7] to pc [ptlrpcd_01_00+0]  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:7.0:1773851873.097744:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000edd0ca01.
02000000:00000001:5.0:1773851873.097744:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851873.097745:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000076fddf96] to pc [ptlrpcd_07_02+2]  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:30.0:1773851873.097746:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000008a71a94e.
00080000:00000001:10.0:1773851873.097746:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851873.097746:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851873.097746:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851873.097746:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b255b11b.
00000100:00000001:30.0:1773851873.097747:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:10.0:1773851873.097747:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000016900527.
00080000:00000001:9.0:1773851873.097747:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851873.097747:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851873.097747:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851873.097748:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636942013122560 : -107131696429056 : ffff9e90754a4800)
00080000:00000010:9.0:1773851873.097748:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000082699907.
00000100:00000001:8.0:1773851873.097748:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:7.0:1773851873.097748:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851873.097749:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:10.0:1773851873.097749:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:9.0:1773851873.097749:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637151619881984 : -106922089669632 : ffff9ec142d39c00)
00000100:00000040:8.0:1773851873.097749:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:6.0:1773851873.097749:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851873.097749:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:31.0:1773851873.097750:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:11.0:1773851873.097750:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:10.0:1773851873.097750:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851873.097750:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851873.097750:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.097750:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:31.0:1773851873.097751:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000660c7356.
00000100:00000001:30.0:1773851873.097751:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.097751:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851873.097751:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00080000:00000001:9.0:1773851873.097751:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:9.0:1773851873.097751:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:5.0:1773851873.097751:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.097751:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:31.0:1773851873.097752:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637071406633984 : -107002302917632 : ffff9eae95be9400)
00000100:00000001:29.0:1773851873.097752:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851873.097752:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000010:10.0:1773851873.097752:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007d5532a8.
00000100:00000001:8.0:1773851873.097752:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:7.0:1773851873.097752:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000067479cf9] to pc [ptlrpcd_01_01+1]  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851873.097752:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:31.0:1773851873.097753:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:30.0:1773851873.097753:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006ab74edb] to pc [ptlrpcd_07_03+3]  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851873.097753:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851873.097753:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:10.0:1773851873.097753:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614147551028821ns, next at 614148551027238ns, rc = 0
00000004:00000010:9.0:1773851873.097753:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000fbe4102b.
00000100:00000001:8.0:1773851873.097753:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097753:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:5.0:1773851873.097753:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004d4a1efb] to pc [ptlrpcd_01_02+2]  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851873.097754:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851873.097754:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:10.0:1773851873.097754:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00080000:9.0:1773851873.097754:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614147551029412ns, next at 614148551028330ns, rc = 0
02000000:00000001:8.0:1773851873.097754:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851873.097754:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097754:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851873.097754:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:31.0:1773851873.097755:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:31.0:1773851873.097755:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000040:29.0:1773851873.097755:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851873.097755:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:10.0:1773851873.097755:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851873.097755:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00000010:31.0:1773851873.097756:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002ffed136.
00000100:00000001:11.0:1773851873.097756:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000001:10.0:1773851873.097756:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851873.097756:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851873.097756:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005684d651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051930368:37@kfi7:13:default-yuba2-0
00000100:00000040:11.0:1773851873.097757:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:9.0:1773851873.097757:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851873.097757:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851873.097757:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00080000:31.0:1773851873.097758:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614147551033570ns, next at 614148551031676ns, rc = 0
02000000:00000001:8.0:1773851873.097758:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851873.097759:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851873.097759:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851873.097759:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000000aafebd6.
00000004:00000001:7.0:1773851873.097759:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.097759:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:31.0:1773851873.097760:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851873.097760:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851873.097760:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.097760:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851873.097761:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851873.097761:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851873.097761:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851873.097761:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:6.0:1773851873.097761:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851873.097761:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851873.097762:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851873.097762:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851873.097762:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000001:6.0:1773851873.097762:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:4.0:1773851873.097762:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851873.097763:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:28.0:1773851873.097763:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851873.097763:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851873.097763:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000010:8.0:1773851873.097763:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000516de938.
00000100:00000040:6.0:1773851873.097763:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851873.097763:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851873.097764:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.097764:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851873.097764:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851873.097764:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930368, portal 4
00000100:00000001:8.0:1773851873.097764:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:11.0:1773851873.097765:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:8.0:1773851873.097765:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637090064872960 : -106983644678656 : ffff9eb2eddcb600)
00080000:00000001:5.0:1773851873.097765:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00100000:4.0:1773851873.097765:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078d0b7f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051930496:36@kfi7:13:default-yuba2-0
00000100:00100000:29.0:1773851873.097766:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000076fddf96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051930560:60@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851873.097766:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851873.097766:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:28.0:1773851873.097767:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:11.0:1773851873.097767:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851873.097767:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851873.097767:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851873.097767:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:5.0:1773851873.097767:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a58f956d.
00000100:00000001:4.0:1773851873.097767:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00100000:11.0:1773851873.097768:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000837d256e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051930432:2060@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851873.097768:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:6.0:1773851873.097768:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851873.097768:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:29.0:1773851873.097769:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851873.097769:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851873.097769:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637101151974400 : -106972557577216 : ffff9eb582b47400)
02000000:00000001:4.0:1773851873.097769:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851873.097770:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:8.0:1773851873.097770:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851873.097770:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:6.0:1773851873.097770:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067479cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051930624:2074@kfi7:41:default-yuba2-0
00080000:00000001:5.0:1773851873.097770:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:4.0:1773851873.097770:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851873.097771:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.097771:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:8.0:1773851873.097771:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000400:00000010:8.0:1773851873.097771:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000b6b4cce.
02000000:00000001:29.0:1773851873.097772:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:28.0:1773851873.097772:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000200:8.0:1773851873.097772:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930368, offset 0
00000100:00000001:6.0:1773851873.097772:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851873.097772:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:4.0:1773851873.097772:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000156f202f.
00000100:00000001:28.0:1773851873.097773:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851873.097773:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851873.097773:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851873.097773:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851873.097773:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.097774:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:11.0:1773851873.097774:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851873.097774:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
02000000:00000010:29.0:1773851873.097775:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bd527d7e.
02000000:00000001:11.0:1773851873.097775:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:8.0:1773851873.097775:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:7.0:1773851873.097775:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:6.0:1773851873.097775:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00001000:5.0:1773851873.097775:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000400:00000200:4.0:1773851873.097775:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
02000000:00000001:29.0:1773851873.097776:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.097776:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851873.097776:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000001:7.0:1773851873.097776:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:5.0:1773851873.097776:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d15f0b21.
00000400:00000010:4.0:1773851873.097776:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000100:00100000:28.0:1773851873.097777:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ab74edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051930752:13@kfi7:41:default-yuba2-0
02000000:00000010:11.0:1773851873.097777:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a085f23e.
02000000:00000010:6.0:1773851873.097777:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e88ad709.
00000400:00000200:29.0:1773851873.097778:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
02000000:00000001:11.0:1773851873.097778:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851873.097778:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
02000000:00000001:7.0:1773851873.097778:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851873.097778:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851873.097778:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614147551053307ns, next at 614148551051193ns, rc = 0
00000400:00000010:4.0:1773851873.097778:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000645e16b0.
00000400:00000010:29.0:1773851873.097779:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000060a59eec.
00000400:00000200:8.0:1773851873.097779:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
02000000:00000001:7.0:1773851873.097779:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.097780:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:8.0:1773851873.097780:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000400:00000200:6.0:1773851873.097780:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000010:6.0:1773851873.097780:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00080000:00000001:5.0:1773851873.097780:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000200:4.0:1773851873.097780:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930496, portal 4
00000400:00000010:29.0:1773851873.097781:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000004015b2d.
02000000:00000001:28.0:1773851873.097781:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00100000:7.0:1773851873.097781:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004d4a1efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051930688:2061@kfi7:13:default-yuba2-0
00000400:00000010:6.0:1773851873.097781:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c307aa46.
00080000:00000001:5.0:1773851873.097781:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.097781:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:28.0:1773851873.097782:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851873.097782:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769425, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769423, p:4294967295, g:4294967295, h:1000]
00000004:00000001:5.0:1773851873.097782:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.097782:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814091136 : -107101895460480 : ffff9e976590f980)
00000100:00000200:29.0:1773851873.097783:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930560, portal 4
02000000:00000001:28.0:1773851873.097783:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:7.0:1773851873.097783:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000200:6.0:1773851873.097783:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930624, portal 4
02000000:00000010:28.0:1773851873.097784:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000711cbf99.
00000400:00000200:8.0:1773851873.097784:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
02000000:00000001:7.0:1773851873.097784:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:6.0:1773851873.097784:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851873.097784:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309148928 : -106994400402688 : ffff9eb06cc56300)
00000100:00000040:4.0:1773851873.097784:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851873.097785:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851873.097785:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999060096 : -107038710491520 : ffff9ea61baf1680)
02000000:00000001:28.0:1773851873.097785:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851873.097785:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
02000000:00000001:7.0:1773851873.097785:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851873.097785:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851873.097786:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:8.0:1773851873.097786:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
02000000:00000001:7.0:1773851873.097786:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:5.0:1773851873.097786:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:7.0:1773851873.097787:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007ec590c0.
00000100:00000001:5.0:1773851873.097787:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851873.097788:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851873.097788:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000200:8.0:1773851873.097788:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769426:8769426:1024:4294967295] 37@kfi7 LPNI seq info [5403395:5403395:16:4294967295]
02000000:00000001:7.0:1773851873.097788:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097788:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:4.0:1773851873.097788:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:28.0:1773851873.097789:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fbb7163e.
00000400:00000200:8.0:1773851873.097789:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000040:6.0:1773851873.097789:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000100:00000200:28.0:1773851873.097790:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930752, portal 4
00000400:00000200:8.0:1773851873.097790:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851873.097790:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000010:6.0:1773851873.097790:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5d4425b.
00000100:00000040:4.0:1773851873.097790:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000010:4.0:1773851873.097790:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000062ec508f.
00000100:00000001:28.0:1773851873.097791:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:6.0:1773851873.097791:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051930624, offset 0
00000100:00000001:29.0:1773851873.097792:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851873.097792:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637127372033152 : -106946337518464 : ffff9ebb9d8acc80)
00000400:00000200:11.0:1773851873.097792:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000010:7.0:1773851873.097792:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000200:6.0:1773851873.097792:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000100:00000200:4.0:1773851873.097792:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930496, offset 0
00000100:00000040:29.0:1773851873.097793:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000400:00000010:11.0:1773851873.097793:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000400:00000010:7.0:1773851873.097793:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000400:00000200:6.0:1773851873.097793:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000010:29.0:1773851873.097794:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000038c1b0d0.
00000100:00000040:28.0:1773851873.097794:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:11.0:1773851873.097794:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000641ade85.
00000400:00000200:8.0:1773851873.097794:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851873.097794:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:8.0:1773851873.097795:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000200:7.0:1773851873.097795:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930688, portal 4
00000400:00000200:6.0:1773851873.097795:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000100:00000200:29.0:1773851873.097796:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930560, offset 0
00000100:00000200:11.0:1773851873.097796:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930432, portal 4
00000100:00000001:7.0:1773851873.097796:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:6.0:1773851873.097796:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:11.0:1773851873.097797:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:8.0:1773851873.097797:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:7.0:1773851873.097797:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637039273397376 : -107034436154240 : ffff9ea71a744c80)
00000400:00000200:6.0:1773851873.097797:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851873.097798:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000100:00000001:11.0:1773851873.097798:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637067096255488 : -107006613296128 : ffff9ead94d36c00)
00000400:00000200:6.0:1773851873.097798:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000100:00000001:28.0:1773851873.097799:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:8.0:1773851873.097799:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:7.0:1773851873.097799:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851873.097800:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000040:28.0:1773851873.097800:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000200:6.0:1773851873.097800:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769425, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769426, p:4294967295, g:4294967295, h:1000]
00000400:00000010:28.0:1773851873.097801:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ca2a170b.
00000100:00000040:11.0:1773851873.097801:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851873.097801:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851873.097802:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000100:00000200:28.0:1773851873.097802:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051930752, offset 0
00000400:00000200:6.0:1773851873.097802:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851873.097803:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:6.0:1773851873.097803:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000400:00000200:28.0:1773851873.097804:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000800:00000200:8.0:1773851873.097804:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Using peer 37@kfi7(0x2000000000001a4)
00000100:00000001:7.0:1773851873.097804:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:6.0:1773851873.097804:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851873.097805:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000001:11.0:1773851873.097805:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:6.0:1773851873.097805:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425166, 23425168]
00000100:00000040:7.0:1773851873.097806:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:7.0:1773851873.097806:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c74d75.
00000400:00000200:6.0:1773851873.097806:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000400:00000200:29.0:1773851873.097807:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000100:00000040:11.0:1773851873.097807:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:11.0:1773851873.097808:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009d07bcea.
00000800:00000200:8.0:1773851873.097808:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x2000000000001a4: rc=0
00000100:00000200:7.0:1773851873.097808:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930688, offset 0
00000400:00000200:6.0:1773851873.097808:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769427:8769427:1024:4294967295] 2081@kfi7 LPNI seq info [23425169:23425169:16:4294967295]
00000100:00000200:11.0:1773851873.097809:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930432, offset 0
00000800:00000200:8.0:1773851873.097809:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851873.097809:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:29.0:1773851873.097810:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769427, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769426, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851873.097810:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:11.0:1773851873.097811:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000200:6.0:1773851873.097811:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:8.0:1773851873.097812:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851873.097812:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:29.0:1773851873.097813:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:11.0:1773851873.097813:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:8.0:1773851873.097813:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851873.097813:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851873.097813:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:11.0:1773851873.097814:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000100:00000001:8.0:1773851873.097814:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851873.097814:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851873.097815:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:8.0:1773851873.097815:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851873.097815:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:29.0:1773851873.097816:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:11.0:1773851873.097816:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:8.0:1773851873.097816:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:6.0:1773851873.097816:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851873.097818:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769428:8769428:1023:4294967295] 60@kfi7 LPNI seq info [5404309:5404309:16:4294967295]
00000100:00000001:8.0:1773851873.097818:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:6.0:1773851873.097818:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851873.097818:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:11.0:1773851873.097819:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000100:00000001:8.0:1773851873.097819:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851873.097819:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:6.0:1773851873.097819:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851873.097819:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000400:00000200:29.0:1773851873.097821:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851873.097821:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000800:00000200:6.0:1773851873.097821:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851873.097822:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:4.0:1773851873.097823:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769428, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769426, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851873.097824:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:11.0:1773851873.097824:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769428, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769426, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851873.097824:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851873.097824:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851873.097824:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851873.097824:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Using peer 2081@kfi7(0x270)
00000400:00000200:9.0:1773851873.097826:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:4.0:1773851873.097826:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851873.097827:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851873.097827:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:9.0:1773851873.097827:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000800:00000200:6.0:1773851873.097827:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 324 bytes to peer 0x270: rc=0
00000400:00000200:28.0:1773851873.097828:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:11.0:1773851873.097828:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851873.097828:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000b6b4cce
00000400:00000200:4.0:1773851873.097828:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851873.097829:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000010:9.0:1773851873.097829:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000b6b4cce.
00000100:00000001:9.0:1773851873.097829:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:6.0:1773851873.097829:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851873.097830:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:28.0:1773851873.097830:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000100:00000200:9.0:1773851873.097830:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851873.097830:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000400:00000200:11.0:1773851873.097831:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000100:00000001:6.0:1773851873.097831:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097831:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851873.097831:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769429:8769429:1023:4294967295] 36@kfi7 LPNI seq info [5403968:5403968:16:4294967295]
00000800:00000200:29.0:1773851873.097832:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851873.097832:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000100:00000001:9.0:1773851873.097832:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851873.097832:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851873.097833:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851873.097833:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097834:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851873.097835:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851873.097835:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769428, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769429, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851873.097835:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769430:8769430:1023:4294967295] 2060@kfi7 LPNI seq info [5404994:5404994:16:4294967295]
00000100:00000001:6.0:1773851873.097835:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851873.097835:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851873.097836:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851873.097836:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:6.0:1773851873.097836:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:4.0:1773851873.097836:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:6.0:1773851873.097837:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851873.097837:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097837:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851873.097837:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:29.0:1773851873.097838:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851873.097838:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:28.0:1773851873.097839:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:11.0:1773851873.097839:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:7.0:1773851873.097839:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:28.0:1773851873.097840:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851873.097841:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851873.097841:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:4.0:1773851873.097841:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851873.097842:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:29.0:1773851873.097843:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Using peer 60@kfi7(0x1e2)
00000400:00000200:28.0:1773851873.097843:0:41091:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133317, 23133315]
00000400:00000200:7.0:1773851873.097844:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:4.0:1773851873.097844:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:28.0:1773851873.097846:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000400:00000200:7.0:1773851873.097846:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000800:00000200:29.0:1773851873.097848:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0x1e2: rc=0
00000400:00000200:28.0:1773851873.097849:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769431:8769431:1021:4294967295] 13@kfi7 LPNI seq info [23133318:23133318:16:4294967295]
00000400:00000200:11.0:1773851873.097849:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851873.097849:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769428, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8769431, p:4294967295, g:4294967295, h:1000]
00000800:00000200:29.0:1773851873.097850:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851873.097851:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:6.0:1773851873.097851:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_EVENT_TX_OK event status 0
00000400:00000200:28.0:1773851873.097852:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:4.0:1773851873.097852:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:28.0:1773851873.097853:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:7.0:1773851873.097853:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:6.0:1773851873.097853:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851873.097854:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851873.097854:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:7.0:1773851873.097854:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851873.097854:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000800:00000200:4.0:1773851873.097854:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:29.0:1773851873.097855:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851873.097855:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:6.0:1773851873.097855:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5d4425b
00000100:00000001:29.0:1773851873.097856:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851873.097856:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851873.097856:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000400:00000010:6.0:1773851873.097856:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5d4425b.
00000100:00000001:6.0:1773851873.097856:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851873.097857:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851873.097857:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Transaction freed
00000100:00000200:6.0:1773851873.097857:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851873.097858:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851873.097858:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769432:8769432:1022:4294967295] 2061@kfi7 LPNI seq info [5403461:5403461:16:4294967295]
00000800:00000200:4.0:1773851873.097858:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851873.097859:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000100:00000001:29.0:1773851873.097860:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:11.0:1773851873.097860:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851873.097860:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:6.0:1773851873.097860:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851873.097860:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851873.097861:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851873.097862:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:28.0:1773851873.097862:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:7.0:1773851873.097862:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:4.0:1773851873.097862:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000100:00000001:29.0:1773851873.097863:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851873.097863:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851873.097864:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851873.097864:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Using peer 2060@kfi7(0x2000000000001c1)
00000100:00000001:6.0:1773851873.097864:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:29.0:1773851873.097865:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851873.097865:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:7.0:1773851873.097866:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000800:00000200:6.0:1773851873.097867:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Transaction freed
00000800:00000200:4.0:1773851873.097867:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000400:00000200:7.0:1773851873.097868:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000800:00000200:11.0:1773851873.097869:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x2000000000001c1: rc=0
00000800:00000200:4.0:1773851873.097870:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:31.0:1773851873.097871:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_EVENT_TX_OK event status 0
00000800:00000200:28.0:1773851873.097871:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:7.0:1773851873.097871:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:11.0:1773851873.097872:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851873.097873:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:7.0:1773851873.097873:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:4.0:1773851873.097873:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851873.097874:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000100:00000001:4.0:1773851873.097874:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:31.0:1773851873.097875:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000038c1b0d0
00000800:00000200:28.0:1773851873.097875:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:4.0:1773851873.097875:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851873.097876:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000038c1b0d0.
00000100:00000001:11.0:1773851873.097876:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.097877:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:11.0:1773851873.097877:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:7.0:1773851873.097877:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:4.0:1773851873.097877:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851873.097878:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851873.097878:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.097879:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.097880:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851873.097881:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851873.097881:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851873.097881:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851873.097882:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851873.097882:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000100:00000001:11.0:1773851873.097882:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:9.0:1773851873.097882:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851873.097882:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851873.097883:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851873.097883:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851873.097884:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851873.097884:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851873.097884:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000400:00000200:9.0:1773851873.097884:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009d07bcea
00000800:00000200:7.0:1773851873.097884:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000100:00000001:31.0:1773851873.097885:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:28.0:1773851873.097885:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:11.0:1773851873.097885:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:9.0:1773851873.097885:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009d07bcea.
00000100:00000001:4.0:1773851873.097885:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851873.097885:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:31.0:1773851873.097886:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:29.0:1773851873.097886:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:21.0:1773851873.097886:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:11.0:1773851873.097886:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851873.097886:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851873.097886:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851873.097886:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851873.097887:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851873.097888:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Transaction freed
00000800:00000200:29.0:1773851873.097888:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:28.0:1773851873.097889:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c Using peer 13@kfi7(0x20000000000095c)
00000100:00000001:9.0:1773851873.097889:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:29.0:1773851873.097890:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.097890:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:9.0:1773851873.097890:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:7.0:1773851873.097890:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x19b: rc=0
00000100:00000001:4.0:1773851873.097891:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851873.097892:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851873.097892:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851873.097892:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851873.097893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:9.0:1773851873.097893:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851873.097893:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851873.097894:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:28.0:1773851873.097894:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x20000000000095c: rc=0
00000800:00000200:22.0:1773851873.097894:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:6.0:1773851873.097894:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:22.0:1773851873.097895:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851873.097895:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:9.0:1773851873.097895:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:6.0:1773851873.097895:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000800:00000200:9.0:1773851873.097896:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Transaction freed
00000100:00000001:7.0:1773851873.097896:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851873.097896:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000062ec508f
00000400:00000010:6.0:1773851873.097896:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000062ec508f.
00000400:00000200:29.0:1773851873.097897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:28.0:1773851873.097897:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:22.0:1773851873.097897:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851873.097897:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:7.0:1773851873.097897:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851873.097897:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:21.0:1773851873.097898:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000100:00000001:7.0:1773851873.097898:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851873.097898:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:22.0:1773851873.097899:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851873.097899:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851873.097900:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 37@kfi7 : PUT - for me
00000100:00000001:28.0:1773851873.097900:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851873.097900:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:7.0:1773851873.097900:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851873.097900:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851873.097901:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:28.0:1773851873.097901:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:21.0:1773851873.097901:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000040:6.0:1773851873.097901:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851873.097902:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:21.0:1773851873.097902:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000100:00000001:7.0:1773851873.097902:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851873.097903:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.097903:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:6.0:1773851873.097903:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.097904:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851873.097904:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851873.097905:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851873.097905:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:7.0:1773851873.097905:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:6.0:1773851873.097905:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:29.0:1773851873.097906:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:28.0:1773851873.097906:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851873.097906:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 60@kfi7 : PUT - for me
00000400:00000200:21.0:1773851873.097906:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:7.0:1773851873.097906:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.097907:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:22.0:1773851873.097907:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.097907:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4000
00000100:00000001:7.0:1773851873.097907:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851873.097907:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000400:00000200:29.0:1773851873.097908:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:22.0:1773851873.097908:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000800:00000200:5.0:1773851873.097908:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851873.097909:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:28.0:1773851873.097909:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851873.097910:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:22.0:1773851873.097910:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:29.0:1773851873.097911:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3f00
00000100:00000001:28.0:1773851873.097911:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:22.0:1773851873.097911:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:5.0:1773851873.097911:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851873.097912:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:22.0:1773851873.097912:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:29.0:1773851873.097913:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:5.0:1773851873.097913:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000400:00000200:21.0:1773851873.097914:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:5.0:1773851873.097914:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c74d75
00000400:00000200:22.0:1773851873.097915:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000010:5.0:1773851873.097915:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c74d75.
00000400:00000200:29.0:1773851873.097916:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x780080c7d [1] + 224
00000400:00000200:22.0:1773851873.097916:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3fc0
00000100:00000001:5.0:1773851873.097916:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:22.0:1773851873.097917:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:28.0:1773851873.097918:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851873.097918:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000100:00000200:5.0:1773851873.097918:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851873.097919:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851873.097919:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:28.0:1773851873.097919:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851873.097919:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x780080c9d [1] + 224
00000400:00000200:22.0:1773851873.097920:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d0fb5 [1] + 224
00000800:00000200:17.0:1773851873.097920:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:31.0:1773851873.097921:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851873.097922:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000400:00000200:29.0:1773851873.097922:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851873.097922:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851873.097922:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:31.0:1773851873.097923:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ca2a170b
00000800:00000200:22.0:1773851873.097923:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.097923:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:5.0:1773851873.097923:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851873.097924:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ca2a170b.
00000100:00000001:31.0:1773851873.097924:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851873.097924:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000400:00000200:22.0:1773851873.097924:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:31.0:1773851873.097925:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851873.097925:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851873.097926:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:22.0:1773851873.097926:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000800:00000200:17.0:1773851873.097926:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:22.0:1773851873.097927:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851873.097927:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000001:5.0:1773851873.097927:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.097928:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:29.0:1773851873.097928:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:22.0:1773851873.097928:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851873.097928:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:31.0:1773851873.097929:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851873.097929:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:5.0:1773851873.097929:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:21.0:1773851873.097930:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:22.0:1773851873.097931:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:18.0:1773851873.097931:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:17.0:1773851873.097931:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000400:00000200:5.0:1773851873.097931:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:18.0:1773851873.097932:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:29.0:1773851873.097933:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851873.097933:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:31.0:1773851873.097934:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851873.097934:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851873.097934:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000100:00000001:31.0:1773851873.097935:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:17.0:1773851873.097935:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:31.0:1773851873.097936:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:22.0:1773851873.097936:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851873.097936:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:31.0:1773851873.097938:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000095c Transaction freed
00000400:00000200:22.0:1773851873.097938:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000040:21.0:1773851873.097938:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851873.097938:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:29.0:1773851873.097939:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:22.0:1773851873.097939:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000800:00000200:18.0:1773851873.097939:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851873.097939:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:31.0:1773851873.097941:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:29.0:1773851873.097941:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:8.0:1773851873.097941:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:31.0:1773851873.097942:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851873.097942:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:8.0:1773851873.097942:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:21.0:1773851873.097943:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:18.0:1773851873.097943:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.097943:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3f80
00000400:00000001:8.0:1773851873.097943:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851873.097943:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:31.0:1773851873.097944:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851873.097944:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000010:8.0:1773851873.097944:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:8.0:1773851873.097944:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000516de938
00000400:00000200:18.0:1773851873.097945:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2060@kfi7 : PUT - for me
00000400:00000200:17.0:1773851873.097945:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:8.0:1773851873.097945:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000516de938.
00000100:00000001:6.0:1773851873.097945:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:31.0:1773851873.097946:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:22.0:1773851873.097946:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000001:8.0:1773851873.097946:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851873.097946:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851873.097947:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:22.0:1773851873.097947:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851873.097947:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:18.0:1773851873.097947:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.097947:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f1511 [1] + 224
00000100:00000200:8.0:1773851873.097947:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:6.0:1773851873.097947:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:31.0:1773851873.097948:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:30.0:1773851873.097948:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:22.0:1773851873.097948:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851873.097948:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000001:6.0:1773851873.097948:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:30.0:1773851873.097949:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:21.0:1773851873.097949:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000010:6.0:1773851873.097949:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851873.097949:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c307aa46
00000400:00000200:31.0:1773851873.097950:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000400:00000001:30.0:1773851873.097950:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:22.0:1773851873.097950:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851873.097950:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000200:8.0:1773851873.097950:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851873.097950:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c307aa46.
00000400:00000200:31.0:1773851873.097951:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000010:30.0:1773851873.097951:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000060a59eec.
00000400:00000200:18.0:1773851873.097951:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:17.0:1773851873.097951:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851873.097951:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851873.097952:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000004015b2d
00000400:00000200:22.0:1773851873.097952:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000200:6.0:1773851873.097952:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851873.097953:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000010:30.0:1773851873.097953:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000004015b2d.
00000400:00000200:18.0:1773851873.097953:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:17.0:1773851873.097953:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851873.097953:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851873.097953:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851873.097954:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:30.0:1773851873.097954:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:22.0:1773851873.097954:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:18.0:1773851873.097954:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:8.0:1773851873.097954:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851873.097954:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:31.0:1773851873.097955:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:22.0:1773851873.097955:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:17.0:1773851873.097955:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000100:00000001:8.0:1773851873.097955:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851873.097955:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851873.097955:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851873.097956:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000200:30.0:1773851873.097956:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:22.0:1773851873.097956:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:18.0:1773851873.097956:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b3f40
02000000:00000001:8.0:1773851873.097956:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851873.097957:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:17.0:1773851873.097957:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:8.0:1773851873.097957:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=106 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851873.097957:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:31.0:1773851873.097958:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:18.0:1773851873.097958:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000200:17.0:1773851873.097958:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851873.097958:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=106 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851873.097958:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851873.097958:0:41065:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:31.0:1773851873.097959:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4040
00000400:00000200:22.0:1773851873.097959:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:8.0:1773851873.097959:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851873.097959:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851873.097959:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851873.097959:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:31.0:1773851873.097960:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851873.097960:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:18.0:1773851873.097960:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f1531 [1] + 224
00010000:00000001:8.0:1773851873.097960:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851873.097960:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097960:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851873.097961:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x780080cbd [1] + 224
00000100:00000200:30.0:1773851873.097961:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:22.0:1773851873.097961:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
02000000:00000001:6.0:1773851873.097961:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851873.097962:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4080
00000100:00000001:8.0:1773851873.097962:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851873.097962:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00001000:6.0:1773851873.097962:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=106 v=66 (66 66 66 66)
00000400:00000200:22.0:1773851873.097963:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:8.0:1773851873.097963:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851873.097963:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851873.097963:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=106 v=66 (1 1 1 1)
00000800:00000200:31.0:1773851873.097964:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851873.097964:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:17.0:1773851873.097964:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851873.097964:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851873.097964:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851873.097964:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851873.097965:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:22.0:1773851873.097965:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d0fd5 [1] + 224
00010000:00000001:6.0:1773851873.097965:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:31.0:1773851873.097966:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851873.097966:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:6.0:1773851873.097966:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097966:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:31.0:1773851873.097967:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000100:00000001:30.0:1773851873.097967:0:41090:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:22.0:1773851873.097967:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851873.097967:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851873.097967:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851873.097967:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:6.0:1773851873.097967:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00000001:6.0:1773851873.097967:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000001:30.0:1773851873.097968:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851873.097968:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:22.0:1773851873.097968:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851873.097968:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851873.097968:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:6.0:1773851873.097968:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.097969:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:18.0:1773851873.097969:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000100:00000001:17.0:1773851873.097969:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:8.0:1773851873.097969:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000100:00000040:6.0:1773851873.097969:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:31.0:1773851873.097970:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851873.097970:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851873.097970:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000004:00000040:8.0:1773851873.097970:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690159104 avail=351687711744 avail_mb=1373780124 hwm_mb=3131103 files=372231248 ffree=343447421 state=0: rc = 0
02000000:00000001:30.0:1773851873.097971:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851873.097971:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:18.0:1773851873.097971:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851873.097971:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000004:00000020:8.0:1773851873.097971:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690159104 free, 351687711744 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231248 files, 343447421 free files
00000100:00001000:30.0:1773851873.097972:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=106 v=66 (66 66 66 66)
00000100:00000200:22.0:1773851873.097972:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851873.097972:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851873.097972:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851873.097972:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:31.0:1773851873.097973:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:18.0:1773851873.097973:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851873.097973:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000004:00000001:8.0:1773851873.097973:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097973:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851873.097973:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:30.0:1773851873.097974:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=106 v=66 (1 1 1 1)
00000100:00000040:8.0:1773851873.097974:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:6.0:1773851873.097974:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:22.0:1773851873.097975:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:6.0:1773851873.097975:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223680 blocks, 31250857088 free, 31250824128 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121397 files, 2868731021 free files
00000400:00000001:4.0:1773851873.097975:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:30.0:1773851873.097976:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851873.097976:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:4.0:1773851873.097976:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:30.0:1773851873.097977:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00100000:8.0:1773851873.097977:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005684d651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051930368:37@kfi7:13:default-yuba2-0
00000004:00000001:6.0:1773851873.097977:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851873.097977:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00010000:00000001:30.0:1773851873.097978:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851873.097978:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851873.097978:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:4.0:1773851873.097978:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000645e16b0
00000100:00000001:22.0:1773851873.097979:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:22.0:1773851873.097979:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:8.0:1773851873.097979:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851873.097979:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:4.0:1773851873.097979:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000645e16b0.
00000100:00000001:31.0:1773851873.097980:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851873.097980:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851873.097980:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000100:00000040:8.0:1773851873.097980:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005684d651 x1859433051930368/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851873.097980:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:31.0:1773851873.097981:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:30.0:1773851873.097981:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000800:00000200:22.0:1773851873.097981:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00100000:6.0:1773851873.097981:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067479cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051930624:2074@kfi7:41:default-yuba2-0
00000800:00000200:31.0:1773851873.097982:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851873.097982:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.097982:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851873.097982:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851873.097982:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:6.0:1773851873.097982:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:4.0:1773851873.097982:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851873.097983:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:8.0:1773851873.097983:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851873.097983:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851873.097983:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000001:28.0:1773851873.097984:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:18.0:1773851873.097984:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000010:8.0:1773851873.097984:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000000aafebd6.
00000100:00000001:7.0:1773851873.097984:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:6.0:1773851873.097984:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000067479cf9 x1859433051930624/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:28.0:1773851873.097985:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:8.0:1773851873.097985:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851873.097985:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851873.097985:0:41071:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000400:00000001:7.0:1773851873.097985:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000010:28.0:1773851873.097986:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000200:18.0:1773851873.097986:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000020:00000001:8.0:1773851873.097986:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000001:7.0:1773851873.097986:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:6.0:1773851873.097986:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000200:28.0:1773851873.097987:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fbb7163e
02000000:00000010:8.0:1773851873.097987:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000469124a5.
00000400:00000010:7.0:1773851873.097987:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
02000000:00000001:6.0:1773851873.097987:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851873.097987:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e88ad709.
00000100:00000200:4.0:1773851873.097987:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851873.097988:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:28.0:1773851873.097988:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fbb7163e.
00000800:00000200:18.0:1773851873.097988:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851873.097988:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:8.0:1773851873.097988:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000200:7.0:1773851873.097988:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
02000000:00000001:6.0:1773851873.097988:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851873.097989:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851873.097989:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851873.097989:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:8.0:1773851873.097989:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851873.097989:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005684d651.
00000400:00000010:7.0:1773851873.097989:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000020:00000001:6.0:1773851873.097989:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851873.097989:0:41065:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000001:30.0:1773851873.097990:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:11.0:1773851873.097990:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851873.097990:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851873.097990:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000020:00000001:6.0:1773851873.097990:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851873.097990:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000edd0ca01.
00000004:00000001:30.0:1773851873.097991:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:28.0:1773851873.097991:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:11.0:1773851873.097991:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851873.097991:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851873.097991:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:6.0:1773851873.097991:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:4.0:1773851873.097991:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:30.0:1773851873.097992:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000100:00000001:8.0:1773851873.097992:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851873.097992:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851873.097992:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851873.097992:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851873.097992:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000067479cf9.
00000100:00000001:4.0:1773851873.097992:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:30.0:1773851873.097993:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351228416 avail=351348439040 avail_mb=1372454840 hwm_mb=3131103 files=372084058 ffree=343116434 state=0: rc = 0
00000400:00000010:11.0:1773851873.097993:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000100:00000001:8.0:1773851873.097993:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851873.097993:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097993:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851873.097993:0:41064:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:11.0:1773851873.097994:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000641ade85
00000100:00000001:6.0:1773851873.097994:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851873.097994:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851873.097994:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851873.097994:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:11.0:1773851873.097995:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000641ade85.
00000100:00000001:6.0:1773851873.097995:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851873.097995:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851873.097996:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851873.097996:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851873.097996:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851873.097996:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000020:30.0:1773851873.097997:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351228416 free, 351348439040 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372084058 files, 343116434 free files
00000100:00000200:7.0:1773851873.097997:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851873.097997:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851873.097997:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851873.097998:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:4.0:1773851873.097998:0:41064:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=106 v=66 (66 66 66 66)
00000004:00000001:30.0:1773851873.097999:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.098000:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:4.0:1773851873.098000:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=106 v=66 (1 1 1 1)
00000100:00000040:30.0:1773851873.098001:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851873.098001:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851873.098002:0:41091:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:7.0:1773851873.098002:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851873.098002:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:28.0:1773851873.098003:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:11.0:1773851873.098003:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851873.098003:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851873.098003:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.098004:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851873.098004:0:41066:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:4.0:1773851873.098004:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00100000:30.0:1773851873.098005:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000076fddf96 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051930560:60@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851873.098005:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851873.098005:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00010000:00000001:4.0:1773851873.098005:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.098006:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.098006:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851873.098006:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:11.0:1773851873.098007:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851873.098007:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851873.098007:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:30.0:1773851873.098008:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:28.0:1773851873.098008:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=106 v=66 (66 66 66 66)
00000100:00000001:11.0:1773851873.098008:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851873.098008:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.098008:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851873.098009:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851873.098009:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:4.0:1773851873.098009:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851873.098010:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000076fddf96 x1859433051930560/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:28.0:1773851873.098010:0:41091:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=106 v=66 (1 1 1 1)
02000000:00000001:11.0:1773851873.098010:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:7.0:1773851873.098010:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=106 v=66 (66 66 66 66)
00000100:00000040:4.0:1773851873.098010:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851873.098011:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851873.098011:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851873.098012:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.098012:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851873.098012:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=106 v=66 (1 1 1 1)
00010000:00000001:28.0:1773851873.098013:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:11.0:1773851873.098013:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851873.098014:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00010000:00000001:28.0:1773851873.098014:0:41091:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.098014:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851873.098014:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851873.098015:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:28.0:1773851873.098015:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00001000:11.0:1773851873.098015:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=106 v=66 (66 66 66 66)
00000100:00000001:4.0:1773851873.098015:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000010:30.0:1773851873.098016:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bd527d7e.
00000100:00000040:28.0:1773851873.098016:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00010000:00000001:7.0:1773851873.098016:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851873.098016:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851873.098016:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851873.098017:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:11.0:1773851873.098017:0:41068:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=106 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851873.098017:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851873.098018:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851873.098018:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851873.098018:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.098018:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851873.098018:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851873.098018:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000004:00000001:4.0:1773851873.098018:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000040:30.0:1773851873.098019:0:41090:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00000040:28.0:1773851873.098019:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851873.098019:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.098019:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000020:00000001:30.0:1773851873.098020:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00010000:00000001:11.0:1773851873.098020:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851873.098020:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851873.098020:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
02000000:00000010:30.0:1773851873.098021:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000142f89ee.
00010000:00000001:11.0:1773851873.098021:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851873.098021:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500140544 avail=351497985024 avail_mb=1373039004 hwm_mb=3131103 files=372097737 ffree=343261856 state=0: rc = 0
02000000:00000001:30.0:1773851873.098022:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:7.0:1773851873.098022:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:30.0:1773851873.098023:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:11.0:1773851873.098023:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000010:30.0:1773851873.098024:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000076fddf96.
00000100:00000040:11.0:1773851873.098024:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000004:00000020:4.0:1773851873.098024:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500140544 free, 351497985024 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097737 files, 343261856 free files
00000100:00000001:30.0:1773851873.098025:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851873.098025:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851873.098025:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851873.098025:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851873.098026:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.098026:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:11.0:1773851873.098027:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851873.098027:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000001:4.0:1773851873.098027:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851873.098028:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851873.098028:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851873.098028:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851873.098028:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851873.098029:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851873.098029:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:30.0:1773851873.098030:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851873.098030:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851873.098030:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:7.0:1773851873.098030:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000100:00000001:30.0:1773851873.098031:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:7.0:1773851873.098031:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399725568 free=351492748288 avail=351490318336 avail_mb=1373009056 hwm_mb=3131103 files=372078060 ffree=343254637 state=0: rc = 0
00000004:00000001:28.0:1773851873.098032:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:11.0:1773851873.098032:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:28.0:1773851873.098033:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097344 blocks, 31192444096 free, 31192400192 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238781 files, 2962368347 free files
00000100:00000001:11.0:1773851873.098033:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00100000:4.0:1773851873.098033:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078d0b7f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051930496:36@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851873.098034:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851873.098035:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:7.0:1773851873.098035:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399725568 blocks, 351492748288 free, 351490318336 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372078060 files, 343254637 free files
00000004:00000001:28.0:1773851873.098036:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:11.0:1773851873.098036:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000100:00000001:4.0:1773851873.098036:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:11.0:1773851873.098037:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504352256 avail=351502179328 avail_mb=1373055388 hwm_mb=3131103 files=372056228 ffree=343265969 state=0: rc = 0
00000100:00000001:4.0:1773851873.098037:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851873.098038:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:7.0:1773851873.098038:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851873.098038:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000078d0b7f7 x1859433051930496/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:7.0:1773851873.098039:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:11.0:1773851873.098040:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504352256 free, 351502179328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056228 files, 343265969 free files
00000100:00000001:4.0:1773851873.098042:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00100000:28.0:1773851873.098043:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ab74edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051930752:13@kfi7:41:default-yuba2-0
00000004:00000001:11.0:1773851873.098043:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851873.098043:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851873.098044:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000156f202f.
00000100:00000001:28.0:1773851873.098045:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:11.0:1773851873.098045:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851873.098045:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004d4a1efb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051930688:2061@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851873.098046:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:4.0:1773851873.098046:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:28.0:1773851873.098047:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006ab74edb x1859433051930752/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851873.098047:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851873.098047:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851873.098047:0:41064:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000100:00000001:7.0:1773851873.098048:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:4.0:1773851873.098048:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00100000:11.0:1773851873.098049:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000837d256e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051930432:2060@kfi7:13:default-yuba2-0
02000000:00000010:4.0:1773851873.098049:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a478f995.
00000100:00000040:7.0:1773851873.098050:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004d4a1efb x1859433051930688/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:4.0:1773851873.098051:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:28.0:1773851873.098052:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:11.0:1773851873.098052:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851873.098052:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851873.098052:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000078d0b7f7.
02000000:00000001:28.0:1773851873.098053:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851873.098053:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:28.0:1773851873.098054:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000711cbf99.
00000100:00000001:7.0:1773851873.098054:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:4.0:1773851873.098054:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851873.098054:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:28.0:1773851873.098055:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:11.0:1773851873.098055:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000837d256e x1859433051930432/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851873.098055:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:4.0:1773851873.098055:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851873.098056:0:41091:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:7.0:1773851873.098056:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007ec590c0.
00000020:00000040:28.0:1773851873.098057:0:41091:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:4.0:1773851873.098057:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:28.0:1773851873.098058:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:4.0:1773851873.098058:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851873.098059:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000008a71a94e.
00000100:00000001:11.0:1773851873.098059:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851873.098059:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:4.0:1773851873.098059:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851873.098059:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.098060:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851873.098060:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:7.0:1773851873.098060:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851873.098060:0:41066:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
02000000:00000001:28.0:1773851873.098061:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:11.0:1773851873.098061:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a085f23e.
00000100:00000010:28.0:1773851873.098062:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ab74edb.
00000020:00000001:7.0:1773851873.098062:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851873.098062:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b255b11b.
00000100:00000001:28.0:1773851873.098063:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:11.0:1773851873.098063:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851873.098063:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851873.098064:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:11.0:1773851873.098064:0:41068:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
02000000:00000001:7.0:1773851873.098064:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:28.0:1773851873.098065:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851873.098065:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:7.0:1773851873.098065:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:11.0:1773851873.098066:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000100:00000010:7.0:1773851873.098066:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d4a1efb.
00000100:00000001:28.0:1773851873.098067:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851873.098067:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851873.098067:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851873.098068:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:11.0:1773851873.098068:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:7.0:1773851873.098068:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851873.098069:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851873.098069:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851873.098069:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000837d256e.
00000100:00000001:7.0:1773851873.098069:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.098070:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851873.098071:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851873.098071:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.098072:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.098072:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851873.098073:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851873.098073:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.098074:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851873.098075:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851873.098076:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851873.098077:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851873.127395:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851873.127396:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851873.127397:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.127399:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851873.127400:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20499@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.127402:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20499@kfi7 : PUT - for me
00000400:00000200:21.0:1773851873.127402:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20499@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.127404:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7236b1e nid 20499@kfi7 refs 1
00000400:00000200:21.0:1773851873.127405:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20499@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.127405:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7236b1e nid 20499@kfi7 refs 2
00000400:00000200:21.0:1773851873.127406:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c7236b1e nid 20499@kfi7 refs 3
00000400:00000200:21.0:1773851873.127407:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20690@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.127408:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20690@kfi7 of length 224 into portal 12 MB=0x69b0a12838380
00000400:00000200:21.0:1773851873.127409:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20690@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 42952
00000800:00000200:21.0:1773851873.127410:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851873.127413:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.127414:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20499@kfi7: PUT: OK
00000100:00000001:21.0:1773851873.127415:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851873.127415:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851873.127416:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8c99f67.
00000100:00000040:21.0:1773851873.127417:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000d8c99f67 x1859317422850944 msgsize 224
00000100:00100000:21.0:1773851873.127419:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20690@kfi7 (source: 12345-20499@kfi7)
00000100:00000001:21.0:1773851873.127420:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851873.127421:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7236b1e nid 20499@kfi7 refs 2
00000100:00000001:20.0:1773851873.127421:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851873.127422:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851873.127422:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851873.127422:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851873.127423:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851873.127424:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851873.127425:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317422850944
00000020:00000001:20.0:1773851873.127426:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851873.127426:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9285d
00000020:00000001:20.0:1773851873.127427:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851873.127429:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008931a29a refcount=6
00000020:00000001:20.0:1773851873.127429:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742961152 : -107128966590464 : ffff9e9118005000)
00000020:00000001:20.0:1773851873.127430:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742961152 : -107128966590464 : ffff9e9118005000)
00000100:00000001:20.0:1773851873.127431:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.127432:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851873.127433:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040bbe88b.
00000020:00000010:20.0:1773851873.127434:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.127436:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851873.127437:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851873.127437:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851873.127438:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.127439:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851873.127440:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851873.127440:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.127441:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851873.127443:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.127443:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851873.127443:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851873.127443:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851873.127444:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20690@kfi7, seq: 1997992
00000100:00000001:23.0:1773851873.127445:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.127445:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008931a29a : new rpc_count 1
00000100:00000001:23.0:1773851873.127446:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.127446:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788285440 : -106974921266176 : ffff9eb4f5d16c00)
00000100:00000040:20.0:1773851873.127448:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d8c99f67 x1859317422850944/t0(0) o400->005d0019-627d-4bd8-b252-198c9b88d80b@20690@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1781-0'
00000100:00000001:20.0:1773851873.127450:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.127451:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851873.127452:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8c99f67 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:005d0019-627d-4bd8-b252-198c9b88d80b+6:39518:x1859317422850944:12345-20690@kfi7:400:default-tuolumne1781-0
00000100:00000200:20.0:1773851873.127453:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317422850944
00000020:00000001:20.0:1773851873.127454:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851873.127454:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851873.127455:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.127456:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851873.127456:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851873.127457:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851873.127458:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317422850944, found 0 last_xid 1859317422850943
00000020:00000001:20.0:1773851873.127459:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851873.127459:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851873.127460:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851873.127460:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.127461:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851873.127462:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851873.127462:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851873.127463:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000073051ef0.
02000000:00000001:20.0:1773851873.127463:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.127464:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.127465:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851873.127465:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044158384, transno 0, xid 1859317422850944
00010000:00000001:20.0:1773851873.127466:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851873.127467:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d8c99f67 x1859317422850944/t0(0) o400->005d0019-627d-4bd8-b252-198c9b88d80b@20690@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1781-0'
00010000:00000001:20.0:1773851873.127469:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851873.127470:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851873.127471:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=106 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851873.127472:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851873.127473:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006904b993 refcount 3 to 20690@kfi7
00000100:00000001:20.0:1773851873.127473:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956269856 : -107146753281760 : ffff9e8cf3d4f120)
02000000:00000001:20.0:1773851873.127474:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851873.127475:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.127475:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851873.127476:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20499@kfi7
00000400:00000010:20.0:1773851873.127477:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000056b73a04.
00000100:00000200:20.0:1773851873.127478:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317422850944, offset 224
00000400:00000200:20.0:1773851873.127479:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20499@kfi7
00000400:00000200:20.0:1773851873.127480:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20499@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.127481:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7236b1e nid 20499@kfi7 refs 1
00000400:00000200:20.0:1773851873.127482:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c7236b1e nid 20499@kfi7 refs 2
00000400:00000200:20.0:1773851873.127484:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c7236b1e nid 20499@kfi7 refs 3
00000400:00000200:20.0:1773851873.127485:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20499@kfi7 local destination
00000400:00000200:20.0:1773851873.127486:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769433:8769433:1024:4294967295] 20499@kfi7 LPNI seq info [773283:773283:16:4294967295]
00000400:00000200:20.0:1773851873.127488:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c7236b1e nid 20499@kfi7 refs 2
00000400:00000200:20.0:1773851873.127489:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20499@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.127491:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20499@kfi7(20499@kfi7:20499@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851873.127492:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c7236b1e nid 20499@kfi7 refs 3
00000800:00000200:20.0:1773851873.127493:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851873.127494:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851873.127497:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851873.127499:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd9f Using peer 20499@kfi7(0xd9f)
00000800:00000200:20.0:1773851873.127502:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0xd9f: rc=0
00000800:00000200:20.0:1773851873.127504:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd9f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851873.127506:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.127506:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006904b993 refcount 2 to 20690@kfi7
00010000:00000001:20.0:1773851873.127507:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851873.127508:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.127508:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851873.127509:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8c99f67 x1859317422850944/t0(0) o400->005d0019-627d-4bd8-b252-198c9b88d80b@20690@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1781-0'
00000100:00100000:20.0:1773851873.127513:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8c99f67 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:005d0019-627d-4bd8-b252-198c9b88d80b+6:39518:x1859317422850944:12345-20690@kfi7:400:default-tuolumne1781-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851873.127516:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20690@kfi7, seq: 1997992
00000100:00000040:20.0:1773851873.127516:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008931a29a : new rpc_count 0
00000100:00000001:20.0:1773851873.127517:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851873.127518:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851873.127518:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.127519:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851873.127520:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040bbe88b.
00000020:00000040:20.0:1773851873.127521:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000008931a29a : new refcount 5
00000100:00000001:20.0:1773851873.127522:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851873.127527:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd9f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851873.127528:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.127529:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20499@kfi7: PUT: OK
00000400:00000200:21.0:1773851873.127530:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000056b73a04
00000400:00000010:21.0:1773851873.127531:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000056b73a04.
00000100:00000001:21.0:1773851873.127531:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851873.127532:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851873.127532:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7236b1e nid 20499@kfi7 refs 2
00000800:00000200:21.0:1773851873.127534:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 20499@kfi7(0000000086ddd80d):0x0 lsk 3488 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd9f Transaction freed
00000800:00000200:17.0:1773851873.155125:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851873.155126:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851873.155127:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851873.155129:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851873.155131:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25329@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.155132:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25329@kfi7 : PUT - for me
00000400:00000200:17.0:1773851873.155133:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25329@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.155134:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a90f6502 nid 25329@kfi7 refs 1
00000400:00000200:17.0:1773851873.155135:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25329@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.155136:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a90f6502 nid 25329@kfi7 refs 2
00000400:00000200:17.0:1773851873.155137:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a90f6502 nid 25329@kfi7 refs 3
00000400:00000200:17.0:1773851873.155137:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25329@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.155139:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25329@kfi7 of length 224 into portal 12 MB=0x69b4c44cb5e40
00000400:00000200:17.0:1773851873.155140:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25329@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 22632
00000800:00000200:17.0:1773851873.155142:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851873.155144:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851873.155144:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25329@kfi7: PUT: OK
00000100:00000001:17.0:1773851873.155145:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851873.155146:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851873.155146:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000078465d2.
00000100:00000040:17.0:1773851873.155147:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000078465d2 x1859601734262336 msgsize 224
00000100:00100000:17.0:1773851873.155149:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25329@kfi7 (source: 12345-25329@kfi7)
00000100:00000001:17.0:1773851873.155150:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851873.155151:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a90f6502 nid 25329@kfi7 refs 2
00000100:00000001:16.0:1773851873.155151:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851873.155152:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851873.155152:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851873.155153:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851873.155153:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851873.155154:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851873.155155:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601734262336
00000020:00000001:16.0:1773851873.155155:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851873.155156:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7d6eb
00000020:00000001:16.0:1773851873.155156:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851873.155160:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009eb271e7 refcount=22
00000020:00000001:16.0:1773851873.155161:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120918281216 : -106952791270400 : ffff9eba1cde5c00)
00000020:00000001:16.0:1773851873.155162:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637120918281216 : -106952791270400 : ffff9eba1cde5c00)
00000100:00000001:16.0:1773851873.155163:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851873.155164:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851873.155165:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ff5597ac.
00000020:00000010:16.0:1773851873.155166:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851873.155167:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851873.155168:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851873.155168:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851873.155169:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851873.155170:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851873.155170:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851873.155171:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851873.155171:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851873.155173:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851873.155173:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851873.155173:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851873.155173:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851873.155174:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25329@kfi7, seq: 2156352
00000100:00000001:17.0:1773851873.155175:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851873.155175:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009eb271e7 : new rpc_count 1
00000100:00000001:16.0:1773851873.155175:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372324480 : -107078337227136 : ffff9e9ce1bf1680)
00000100:00000001:17.0:1773851873.155176:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851873.155177:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000078465d2 x1859601734262336/t0(0) o400->e92405a9-77b7-4a55-89fa-dd9318c4153d@25329@kfi7:94/0 lens 224/0 e 0 to 0 dl 1773852209 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2061-0'
00000100:00000001:16.0:1773851873.155179:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851873.155180:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851873.155181:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000078465d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e92405a9-77b7-4a55-89fa-dd9318c4153d+22:39663:x1859601734262336:12345-25329@kfi7:400:default-tuolumne2061-0
00000100:00000200:16.0:1773851873.155182:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601734262336
00000020:00000001:16.0:1773851873.155183:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851873.155184:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851873.155184:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.155185:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851873.155185:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851873.155186:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851873.155187:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601734262336, found 0 last_xid 1859601733899903
00000020:00000001:16.0:1773851873.155188:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851873.155189:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851873.155190:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851873.155190:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.155191:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851873.155191:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851873.155192:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851873.155193:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000006a21d5b.
02000000:00000001:16.0:1773851873.155194:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851873.155194:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.155195:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851873.155196:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260447866, transno 0, xid 1859601734262336
00010000:00000001:16.0:1773851873.155196:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851873.155197:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000078465d2 x1859601734262336/t0(0) o400->e92405a9-77b7-4a55-89fa-dd9318c4153d@25329@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2061-0'
00010000:00000001:16.0:1773851873.155200:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851873.155200:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851873.155201:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=106 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851873.155202:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851873.155203:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004f3843d7 refcount 3 to 25329@kfi7
00000100:00000001:16.0:1773851873.155203:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518720 : -107156126032896 : ffff9e8ac52c1c00)
02000000:00000001:16.0:1773851873.155204:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851873.155205:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851873.155205:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851873.155206:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25329@kfi7
00000400:00000010:16.0:1773851873.155206:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cb7f95f1.
00000100:00000200:16.0:1773851873.155208:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601734262336, offset 224
00000400:00000200:16.0:1773851873.155209:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25329@kfi7
00000400:00000200:16.0:1773851873.155210:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25329@kfi7 to cpt 4
00000400:00000200:16.0:1773851873.155211:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a90f6502 nid 25329@kfi7 refs 1
00000400:00000200:16.0:1773851873.155212:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a90f6502 nid 25329@kfi7 refs 2
00000400:00000200:16.0:1773851873.155213:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a90f6502 nid 25329@kfi7 refs 3
00000400:00000200:16.0:1773851873.155214:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25329@kfi7 local destination
00000400:00000200:16.0:1773851873.155215:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769434:8769434:1024:4294967295] 25329@kfi7 LPNI seq info [137878:137878:16:4294967295]
00000400:00000200:16.0:1773851873.155217:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a90f6502 nid 25329@kfi7 refs 2
00000400:00000200:16.0:1773851873.155217:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25329@kfi7 to cpt 4
00000400:00000200:16.0:1773851873.155219:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25329@kfi7(25329@kfi7:25329@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851873.155220:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a90f6502 nid 25329@kfi7 refs 3
00000800:00000200:16.0:1773851873.155222:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851873.155223:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851873.155225:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851873.155227:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x97e Using peer 25329@kfi7(0x97e)
00000800:00000200:16.0:1773851873.155230:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 324 bytes to peer 0x97e: rc=0
00000800:00000200:16.0:1773851873.155231:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x97e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851873.155233:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851873.155234:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004f3843d7 refcount 2 to 25329@kfi7
00010000:00000001:16.0:1773851873.155235:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851873.155235:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.155236:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851873.155236:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000078465d2 x1859601734262336/t0(0) o400->e92405a9-77b7-4a55-89fa-dd9318c4153d@25329@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2061-0'
00000100:00100000:16.0:1773851873.155241:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000078465d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e92405a9-77b7-4a55-89fa-dd9318c4153d+22:39663:x1859601734262336:12345-25329@kfi7:400:default-tuolumne2061-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851873.155243:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25329@kfi7, seq: 2156352
00000100:00000040:16.0:1773851873.155244:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009eb271e7 : new rpc_count 0
00000100:00000001:16.0:1773851873.155244:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851873.155245:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851873.155245:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851873.155246:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851873.155247:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ff5597ac.
00000020:00000040:16.0:1773851873.155248:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000009eb271e7 : new refcount 21
00000100:00000001:16.0:1773851873.155248:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851873.155254:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x97e TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851873.155256:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851873.155257:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25329@kfi7: PUT: OK
00000400:00000200:17.0:1773851873.155257:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cb7f95f1
00000400:00000010:17.0:1773851873.155258:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cb7f95f1.
00000100:00000001:17.0:1773851873.155259:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851873.155259:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851873.155260:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a90f6502 nid 25329@kfi7 refs 2
00000800:00000200:17.0:1773851873.155261:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 25329@kfi7(00000000e3676884):0x0 lsk 2431 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x97e Transaction freed
00000400:00000200:29.0:1773851873.161732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851873.161733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:17.0:1773851873.246557:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851873.246557:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851873.246558:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851873.246561:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851873.246562:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25410@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.246564:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25410@kfi7 : PUT - for me
00000400:00000200:17.0:1773851873.246565:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25410@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.246565:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b13e69f nid 25410@kfi7 refs 1
00000400:00000200:17.0:1773851873.246566:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25410@kfi7 to cpt 4
00000400:00000200:17.0:1773851873.246567:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b13e69f nid 25410@kfi7 refs 2
00000400:00000200:17.0:1773851873.246567:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b13e69f nid 25410@kfi7 refs 3
00000400:00000200:17.0:1773851873.246568:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25475@kfi7 to cpt 2
00000400:00000200:17.0:1773851873.246569:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25475@kfi7 of length 224 into portal 12 MB=0x69b4b80cae780
00000400:00000200:17.0:1773851873.246570:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25475@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 22856
00000800:00000200:17.0:1773851873.246571:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851873.246573:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851873.246574:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25410@kfi7: PUT: OK
00000100:00000001:17.0:1773851873.246574:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851873.246575:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851873.246575:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004233e9bb.
00000100:00000040:17.0:1773851873.246576:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000004233e9bb x1859598445897600 msgsize 224
00000100:00100000:17.0:1773851873.246577:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25475@kfi7 (source: 12345-25410@kfi7)
00000100:00000001:17.0:1773851873.246578:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851873.246578:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b13e69f nid 25410@kfi7 refs 2
00000800:00000200:17.0:1773851873.246579:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851873.246579:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851873.246580:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851873.246580:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851873.246580:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851873.246581:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851873.246581:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598445897600
00000020:00000001:16.0:1773851873.246582:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851873.246582:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e743d7
00000020:00000001:16.0:1773851873.246583:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851873.246585:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000756ab477 refcount=5
00000020:00000001:16.0:1773851873.246585:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636986492469248 : -107087217082368 : ffff9e9ad0774000)
00000020:00000001:16.0:1773851873.246586:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636986492469248 : -107087217082368 : ffff9e9ad0774000)
00000100:00000001:16.0:1773851873.246587:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851873.246587:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851873.246588:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091929c7c.
00000020:00000010:16.0:1773851873.246588:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851873.246589:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851873.246590:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851873.246590:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851873.246591:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851873.246591:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851873.246592:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851873.246592:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851873.246593:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851873.246594:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851873.246594:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851873.246594:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851873.246595:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851873.246595:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25475@kfi7, seq: 2156353
00000100:00000001:17.0:1773851873.246596:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851873.246596:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851873.246596:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000756ab477 : new rpc_count 1
00000100:00000001:16.0:1773851873.246596:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372349824 : -107078337201792 : ffff9e9ce1bf7980)
00000100:00000040:16.0:1773851873.246597:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004233e9bb x1859598445897600/t0(0) o400->99ac208a-d75f-419e-af6d-d9a6fd60178a@25475@kfi7:94/0 lens 224/0 e 0 to 0 dl 1773852209 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2088-0'
00000100:00000001:16.0:1773851873.246599:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851873.246600:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851873.246601:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004233e9bb pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:99ac208a-d75f-419e-af6d-d9a6fd60178a+5:39640:x1859598445897600:12345-25475@kfi7:400:default-tuolumne2088-0
00000100:00000200:16.0:1773851873.246603:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598445897600
00000020:00000001:16.0:1773851873.246603:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851873.246604:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851873.246604:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.246605:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851873.246605:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851873.246606:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851873.246606:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598445897600, found 0 last_xid 1859598445897599
00000020:00000001:16.0:1773851873.246607:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851873.246608:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851873.246608:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851873.246609:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.246609:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851873.246610:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851873.246610:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851873.246611:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c27c6413.
02000000:00000001:16.0:1773851873.246611:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851873.246612:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.246612:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851873.246613:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253097823, transno 0, xid 1859598445897600
00010000:00000001:16.0:1773851873.246613:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851873.246614:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004233e9bb x1859598445897600/t0(0) o400->99ac208a-d75f-419e-af6d-d9a6fd60178a@25475@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2088-0'
00010000:00000001:16.0:1773851873.246616:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851873.246617:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851873.246617:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=106 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851873.246618:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851873.246619:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cde03755 refcount 3 to 25475@kfi7
00000100:00000001:16.0:1773851873.246619:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051135232 : -107146658416384 : ffff9e8cf97c7900)
02000000:00000001:16.0:1773851873.246620:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851873.246620:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851873.246621:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851873.246622:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25410@kfi7
00000400:00000010:16.0:1773851873.246622:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009703cb8c.
00000100:00000200:16.0:1773851873.246623:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598445897600, offset 224
00000400:00000200:16.0:1773851873.246624:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25410@kfi7
00000400:00000200:16.0:1773851873.246625:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25410@kfi7 to cpt 4
00000400:00000200:16.0:1773851873.246626:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b13e69f nid 25410@kfi7 refs 1
00000400:00000200:16.0:1773851873.246627:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b13e69f nid 25410@kfi7 refs 2
00000400:00000200:16.0:1773851873.246628:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b13e69f nid 25410@kfi7 refs 3
00000400:00000200:16.0:1773851873.246629:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25410@kfi7 local destination
00000400:00000200:16.0:1773851873.246630:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769435:8769435:1024:4294967295] 25410@kfi7 LPNI seq info [10641446:10641446:16:4294967295]
00000400:00000200:16.0:1773851873.246631:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b13e69f nid 25410@kfi7 refs 2
00000400:00000200:16.0:1773851873.246632:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25410@kfi7 to cpt 4
00000400:00000200:16.0:1773851873.246634:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25410@kfi7(25410@kfi7:25410@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851873.246635:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b13e69f nid 25410@kfi7 refs 3
00000800:00000200:16.0:1773851873.246636:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851873.246637:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851873.246639:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851873.246641:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb5 Using peer 25410@kfi7(0xdb5)
00000800:00000200:16.0:1773851873.246643:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009aebe925: Posted send of 324 bytes to peer 0xdb5: rc=0
00000800:00000200:16.0:1773851873.246644:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851873.246646:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851873.246647:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cde03755 refcount 2 to 25475@kfi7
00010000:00000001:16.0:1773851873.246647:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851873.246647:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851873.246648:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851873.246649:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004233e9bb x1859598445897600/t0(0) o400->99ac208a-d75f-419e-af6d-d9a6fd60178a@25475@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2088-0'
00000100:00100000:16.0:1773851873.246651:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004233e9bb pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:99ac208a-d75f-419e-af6d-d9a6fd60178a+5:39640:x1859598445897600:12345-25475@kfi7:400:default-tuolumne2088-0 Request processed in 51us (75us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851873.246655:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25475@kfi7, seq: 2156353
00000100:00000040:16.0:1773851873.246656:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000756ab477 : new rpc_count 0
00000100:00000001:16.0:1773851873.246656:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851873.246657:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851873.246657:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851873.246657:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851873.246658:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091929c7c.
00000020:00000040:16.0:1773851873.246659:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000756ab477 : new refcount 4
00000100:00000001:16.0:1773851873.246659:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851873.246664:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb5 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851873.246665:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851873.246666:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25410@kfi7: PUT: OK
00000400:00000200:17.0:1773851873.246667:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009703cb8c
00000400:00000010:17.0:1773851873.246667:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009703cb8c.
00000100:00000001:17.0:1773851873.246668:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851873.246668:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851873.246669:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b13e69f nid 25410@kfi7 refs 2
00000800:00000200:17.0:1773851873.246670:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 25410@kfi7(000000007bc3213e):0x0 lsk 3510 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb5 Transaction freed
00000800:00000200:21.0:1773851873.250789:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851873.250790:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851873.250792:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.250795:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851873.250798:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19313@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.250800:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19313@kfi7 : PUT - for me
00000400:00000200:21.0:1773851873.250801:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19313@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.250803:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000552aa6d1 nid 19313@kfi7 refs 1
00000400:00000200:21.0:1773851873.250805:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19313@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.250806:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000552aa6d1 nid 19313@kfi7 refs 2
00000400:00000200:21.0:1773851873.250807:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000552aa6d1 nid 19313@kfi7 refs 3
00000400:00000200:21.0:1773851873.250808:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19312@kfi7 to cpt 2
00000400:00000200:21.0:1773851873.250810:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19312@kfi7 of length 224 into portal 12 MB=0x69b4bb7fde600
00000400:00000200:21.0:1773851873.250811:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19312@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 43176
00000800:00000200:21.0:1773851873.250814:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851873.250817:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.250819:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19313@kfi7: PUT: OK
00000100:00000001:21.0:1773851873.250821:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851873.250821:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851873.250822:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a71ab814.
00000100:00000040:21.0:1773851873.250824:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000a71ab814 x1859599371986432 msgsize 224
00000100:00100000:21.0:1773851873.250826:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-19312@kfi7 (source: 12345-19313@kfi7)
00000100:00000001:21.0:1773851873.250828:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851873.250829:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000552aa6d1 nid 19313@kfi7 refs 2
00000100:00000001:20.0:1773851873.250830:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851873.250831:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851873.250832:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851873.250832:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851873.250833:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851873.250834:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851873.250835:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599371986432
00000020:00000001:20.0:1773851873.250836:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851873.250837:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e244dfd09
00000020:00000001:20.0:1773851873.250838:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851873.250840:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081804539 refcount=5
00000020:00000001:20.0:1773851873.250841:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637141338114048 : -106932371437568 : ffff9ebeddfc4800)
00000020:00000001:20.0:1773851873.250842:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637141338114048 : -106932371437568 : ffff9ebeddfc4800)
00000100:00000001:20.0:1773851873.250844:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.250845:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851873.250846:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040bbe88b.
00000020:00000010:20.0:1773851873.250847:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.250849:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851873.250851:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851873.250852:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851873.250853:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.250855:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851873.250855:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851873.250856:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.250858:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.250860:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.250861:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.250861:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851873.250861:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851873.250863:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19312@kfi7, seq: 1997993
00000100:00000001:23.0:1773851873.250864:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.250864:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081804539 : new rpc_count 1
00000100:00000001:23.0:1773851873.250865:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.250865:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788277376 : -106974921274240 : ffff9eb4f5d14c80)
00000100:00000040:20.0:1773851873.250867:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a71ab814 x1859599371986432/t0(0) o400->4b858bf3-5751-4341-a984-90e6abba5fd5@19312@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1694-0'
00000100:00000001:20.0:1773851873.250872:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.250873:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851873.250874:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a71ab814 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:4b858bf3-5751-4341-a984-90e6abba5fd5+5:39703:x1859599371986432:12345-19312@kfi7:400:default-tuolumne1694-0
00000100:00000200:20.0:1773851873.250876:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599371986432
00000020:00000001:20.0:1773851873.250877:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851873.250878:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851873.250879:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.250880:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851873.250881:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851873.250883:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851873.250883:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599371986432, found 0 last_xid 1859599371986431
00000020:00000001:20.0:1773851873.250885:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851873.250886:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851873.250887:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851873.250888:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.250889:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851873.250890:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851873.250891:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851873.250892:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001edfa523.
02000000:00000001:20.0:1773851873.250893:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.250894:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.250895:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851873.250896:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096701856, transno 0, xid 1859599371986432
00010000:00000001:20.0:1773851873.250898:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851873.250899:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a71ab814 x1859599371986432/t0(0) o400->4b858bf3-5751-4341-a984-90e6abba5fd5@19312@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1694-0'
00010000:00000001:20.0:1773851873.250904:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851873.250905:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851873.250906:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=106 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851873.250908:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851873.250909:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000071ba4292 refcount 3 to 19312@kfi7
00000100:00000001:20.0:1773851873.250910:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526775872 : -107156182775744 : ffff9e8ac1ca4840)
02000000:00000001:20.0:1773851873.250911:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851873.250912:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.250913:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851873.250915:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19313@kfi7
00000400:00000010:20.0:1773851873.250916:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c06062.
00000100:00000200:20.0:1773851873.250917:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599371986432, offset 224
00000400:00000200:20.0:1773851873.250920:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19313@kfi7
00000400:00000200:20.0:1773851873.250921:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19313@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.250922:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000552aa6d1 nid 19313@kfi7 refs 1
00000400:00000200:20.0:1773851873.250924:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000552aa6d1 nid 19313@kfi7 refs 2
00000400:00000200:20.0:1773851873.250926:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000552aa6d1 nid 19313@kfi7 refs 3
00000400:00000200:20.0:1773851873.250928:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19313@kfi7 local destination
00000400:00000200:20.0:1773851873.250930:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769436:8769436:1024:4294967295] 19313@kfi7 LPNI seq info [10363841:10363841:16:4294967295]
00000400:00000200:20.0:1773851873.250933:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000552aa6d1 nid 19313@kfi7 refs 2
00000400:00000200:20.0:1773851873.250935:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19313@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.250938:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19313@kfi7(19313@kfi7:19313@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851873.250940:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000552aa6d1 nid 19313@kfi7 refs 3
00000800:00000200:20.0:1773851873.250943:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851873.250945:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851873.250949:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851873.250953:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5ab Using peer 19313@kfi7(0x5ab)
00000800:00000200:20.0:1773851873.250957:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x5ab: rc=0
00000800:00000200:20.0:1773851873.250959:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5ab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851873.250962:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.250964:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000071ba4292 refcount 2 to 19312@kfi7
00010000:00000001:20.0:1773851873.250965:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851873.250968:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.250969:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851873.250970:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a71ab814 x1859599371986432/t0(0) o400->4b858bf3-5751-4341-a984-90e6abba5fd5@19312@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1694-0'
00000100:00100000:20.0:1773851873.250975:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a71ab814 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:4b858bf3-5751-4341-a984-90e6abba5fd5+5:39703:x1859599371986432:12345-19312@kfi7:400:default-tuolumne1694-0 Request processed in 102us (150us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851873.250978:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19312@kfi7, seq: 1997993
00000100:00000040:20.0:1773851873.250979:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081804539 : new rpc_count 0
00000100:00000001:20.0:1773851873.250980:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851873.250981:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851873.250982:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.250983:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851873.250984:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040bbe88b.
00000020:00000040:20.0:1773851873.250985:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000081804539 : new refcount 4
00000100:00000001:20.0:1773851873.250986:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851873.250992:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5ab TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851873.250993:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.250995:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19313@kfi7: PUT: OK
00000400:00000200:21.0:1773851873.250995:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c06062
00000400:00000010:21.0:1773851873.250996:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c06062.
00000100:00000001:21.0:1773851873.250996:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851873.250997:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851873.250998:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000552aa6d1 nid 19313@kfi7 refs 2
00000800:00000200:21.0:1773851873.250999:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 19313@kfi7(000000007b673774):0x0 lsk 1452 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5ab Transaction freed
00000800:00000200:13.0:1773851873.297985:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851873.297986:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851873.297987:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851873.297990:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851873.297993:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21763@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.297994:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21763@kfi7 : PUT - for me
00000400:00000200:13.0:1773851873.297995:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21763@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.297997:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060c5bf63 nid 21763@kfi7 refs 1
00000400:00000200:13.0:1773851873.297999:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21763@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.298000:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060c5bf63 nid 21763@kfi7 refs 2
00000400:00000200:13.0:1773851873.298001:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000060c5bf63 nid 21763@kfi7 refs 3
00000400:00000200:13.0:1773851873.298002:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21762@kfi7 to cpt 0
00000400:00000200:13.0:1773851873.298003:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21762@kfi7 of length 224 into portal 12 MB=0x69b823df698c0
00000400:00000200:13.0:1773851873.298005:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21762@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 35048
00000800:00000200:13.0:1773851873.298007:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851873.298009:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851873.298010:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21763@kfi7: PUT: OK
00000100:00000001:13.0:1773851873.298011:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851873.298012:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851873.298013:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000322f4f98.
00000100:00000040:13.0:1773851873.298014:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000322f4f98 x1859833547888832 msgsize 224
00000100:00100000:13.0:1773851873.298015:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21762@kfi7 (source: 12345-21763@kfi7)
00000100:00000001:13.0:1773851873.298017:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851873.298018:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000060c5bf63 nid 21763@kfi7 refs 2
00000100:00000001:15.0:1773851873.298019:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851873.298019:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851873.298020:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851873.298020:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851873.298021:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851873.298022:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851873.298023:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833547888832
00000020:00000001:15.0:1773851873.298023:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851873.298024:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087ff7ca8bd
00000020:00000001:15.0:1773851873.298025:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851873.298029:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eeca0f3a refcount=5
00000020:00000001:15.0:1773851873.298030:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121760498688 : -106951949052928 : ffff9eba4f119400)
00000020:00000001:15.0:1773851873.298031:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121760498688 : -106951949052928 : ffff9eba4f119400)
00000100:00000001:15.0:1773851873.298032:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851873.298033:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851873.298034:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebe397c.
00000020:00000010:15.0:1773851873.298035:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851873.298036:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851873.298037:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851873.298037:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851873.298038:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851873.298040:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851873.298041:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851873.298041:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.298043:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851873.298045:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851873.298045:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851873.298045:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851873.298045:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851873.298047:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21762@kfi7, seq: 2289855
00000100:00000040:15.0:1773851873.298048:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eeca0f3a : new rpc_count 1
00000100:00000001:15.0:1773851873.298048:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970968576 : -107043738583040 : ffff9ea4effc8000)
00000100:00000001:12.0:1773851873.298048:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851873.298049:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851873.298050:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000322f4f98 x1859833547888832/t0(0) o400->f72d14cd-0b0e-4dd5-ad60-f32f18e7a4ce@21762@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1863-0'
00000100:00000001:15.0:1773851873.298054:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851873.298054:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851873.298056:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000322f4f98 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f72d14cd-0b0e-4dd5-ad60-f32f18e7a4ce+5:39700:x1859833547888832:12345-21762@kfi7:400:default-tuolumne1863-0
00000100:00000200:15.0:1773851873.298058:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833547888832
00000020:00000001:15.0:1773851873.298059:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851873.298060:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851873.298061:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.298063:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851873.298063:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851873.298065:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851873.298066:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833547888832, found 0 last_xid 1859833547888831
00000020:00000001:15.0:1773851873.298068:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851873.298069:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851873.298070:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851873.298071:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.298072:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851873.298073:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851873.298074:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851873.298077:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000455deab5.
02000000:00000001:15.0:1773851873.298079:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.298080:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.298081:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851873.298083:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044170333, transno 0, xid 1859833547888832
00010000:00000001:15.0:1773851873.298084:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851873.298086:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000322f4f98 x1859833547888832/t0(0) o400->f72d14cd-0b0e-4dd5-ad60-f32f18e7a4ce@21762@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1863-0'
00010000:00000001:15.0:1773851873.298091:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851873.298092:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851873.298093:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=106 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851873.298095:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851873.298096:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000306f3550 refcount 3 to 21762@kfi7
00000100:00000001:15.0:1773851873.298098:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729382048 : -107155980169568 : ffff9e8acdddcea0)
02000000:00000001:15.0:1773851873.298099:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851873.298100:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.298101:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851873.298103:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21763@kfi7
00000400:00000010:15.0:1773851873.298104:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000067df834c.
00000100:00000200:15.0:1773851873.298106:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833547888832, offset 224
00000400:00000200:15.0:1773851873.298109:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21763@kfi7
00000400:00000200:15.0:1773851873.298111:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21763@kfi7 to cpt 3
00000400:00000200:15.0:1773851873.298113:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000060c5bf63 nid 21763@kfi7 refs 1
00000400:00000200:15.0:1773851873.298115:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000060c5bf63 nid 21763@kfi7 refs 2
00000400:00000200:15.0:1773851873.298117:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000060c5bf63 nid 21763@kfi7 refs 3
00000400:00000200:15.0:1773851873.298119:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21763@kfi7 local destination
00000400:00000200:15.0:1773851873.298122:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769437:8769437:1024:4294967295] 21763@kfi7 LPNI seq info [8469081:8469081:16:4294967295]
00000400:00000200:15.0:1773851873.298125:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000060c5bf63 nid 21763@kfi7 refs 2
00000400:00000200:15.0:1773851873.298126:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21763@kfi7 to cpt 3
00000400:00000200:15.0:1773851873.298130:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21763@kfi7(21763@kfi7:21763@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851873.298132:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000060c5bf63 nid 21763@kfi7 refs 3
00000800:00000200:15.0:1773851873.298136:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851873.298138:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851873.298142:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851873.298147:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x123b Using peer 21763@kfi7(0x123b)
00000800:00000200:15.0:1773851873.298153:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x123b: rc=0
00000800:00000200:15.0:1773851873.298156:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x123b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851873.298160:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851873.298161:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000306f3550 refcount 2 to 21762@kfi7
00010000:00000001:15.0:1773851873.298163:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851873.298164:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.298165:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851873.298166:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000322f4f98 x1859833547888832/t0(0) o400->f72d14cd-0b0e-4dd5-ad60-f32f18e7a4ce@21762@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1863-0'
00000800:00000200:13.0:1773851873.298171:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x123b TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851873.298173:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000322f4f98 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f72d14cd-0b0e-4dd5-ad60-f32f18e7a4ce+5:39700:x1859833547888832:12345-21762@kfi7:400:default-tuolumne1863-0 Request processed in 118us (158us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851873.298177:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21762@kfi7, seq: 2289855
00000100:00000040:15.0:1773851873.298179:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eeca0f3a : new rpc_count 0
00000400:00000200:13.0:1773851873.298179:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851873.298180:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851873.298181:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851873.298181:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21763@kfi7: PUT: OK
00000020:00000010:15.0:1773851873.298182:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851873.298182:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000067df834c
00000400:00000010:13.0:1773851873.298183:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000067df834c.
00000020:00000010:15.0:1773851873.298184:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000100:00000001:13.0:1773851873.298184:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851873.298185:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebe397c.
00000100:00000001:13.0:1773851873.298185:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851873.298186:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000060c5bf63 nid 21763@kfi7 refs 2
00000020:00000040:15.0:1773851873.298187:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000eeca0f3a : new refcount 4
00000100:00000001:15.0:1773851873.298188:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851873.298189:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 21763@kfi7(00000000618bbd79):0x0 lsk 4668 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x123b Transaction freed
00000800:00000200:26.0:1773851873.330389:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.330389:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851873.330390:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851873.330390:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851873.330391:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851873.330391:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851873.330393:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851873.330393:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22819@kfi7(0000000096afd609):0x11c5 version: 2; local version 2; negotiated version: 2
00000400:00000200:26.0:1773851873.330395:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000800:00000200:25.0:1773851873.330395:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 Using peer 22819@kfi7(0x1000000000011c5)
00000400:00000200:26.0:1773851873.330397:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22819@kfi7 : PUT - for me
00000400:00000200:25.0:1773851873.330397:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.330398:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000800:00000200:25.0:1773851873.330398:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x1000000000011c5: rc=0
00000400:00000200:26.0:1773851873.330399:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 1
00000400:00000200:26.0:1773851873.330400:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.330400:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000800:00000200:25.0:1773851873.330400:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851873.330401:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 3
00000400:00000200:26.0:1773851873.330402:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:26.0:1773851873.330403:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22818@kfi7 of length 576 into portal 12 MB=0x69b4caf631b00
00000400:00000200:26.0:1773851873.330405:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22818@kfi7 of length 576/576 into md 0x16159c9699 [64] + 18704
00000800:00000200:26.0:1773851873.330407:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851873.330409:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851873.330410:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22819@kfi7: PUT: OK
00000100:00000001:26.0:1773851873.330411:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851873.330411:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851873.330411:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 TN_EVENT_TX_OK event status 0
00000100:00000010:26.0:1773851873.330412:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000183c91d2.
00000100:00000040:26.0:1773851873.330413:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000183c91d2 x1859603522591488 msgsize 576
00000800:00000200:25.0:1773851873.330414:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 Transaction freed
00000100:00100000:26.0:1773851873.330415:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22818@kfi7 (source: 12345-22819@kfi7)
00000100:00000001:26.0:1773851873.330416:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851873.330418:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000100:00000001:27.0:1773851873.330419:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851873.330419:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851873.330419:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851873.330420:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851873.330420:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851873.330421:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851873.330422:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603522591488
00000020:00000001:27.0:1773851873.330422:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851873.330423:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff80cc2
00000020:00000001:27.0:1773851873.330423:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.330426:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d49eaeb refcount=5
00000020:00000001:27.0:1773851873.330427:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142647366656 : -106931062184960 : ffff9ebf2c05e400)
00000020:00000001:27.0:1773851873.330427:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142647366656 : -106931062184960 : ffff9ebf2c05e400)
00000100:00000001:27.0:1773851873.330429:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.330430:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851873.330430:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851873.330431:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000022b22b54.
00000020:00000010:27.0:1773851873.330432:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851873.330433:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851873.330433:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:27.0:1773851873.330434:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:27.0:1773851873.330434:0:41182:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330435:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330436:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330437:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.330439:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851873.330439:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851873.330439:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851873.330439:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851873.330440:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22818@kfi7, seq: 1451911032
00000100:00000040:27.0:1773851873.330441:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d49eaeb : new rpc_count 1
00000100:00000001:26.0:1773851873.330441:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330442:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150701056 : -106980558850560 : ffff9eb3a5cab600)
00000100:00000001:26.0:1773851873.330442:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.330443:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000183c91d2 x1859603522591488/t0(0) o101->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:600/0 lens 576/0 e 0 to 0 dl 1773851960 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-832053561511644160'
00000100:00000001:27.0:1773851873.330446:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.330446:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851873.330447:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000183c91d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1e88b751-b4e7-4eda-b881-bf76c8d02e53+5:609371:x1859603522591488:12345-22818@kfi7:101:tuolumne-832053561511644160
00000100:00000200:27.0:1773851873.330449:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603522591488
00000020:00000001:27.0:1773851873.330450:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851873.330450:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851873.330451:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.330452:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851873.330452:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:27.0:1773851873.330453:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851873.330453:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603522591488, found 0 last_xid 1859603522591487
00000020:00000001:27.0:1773851873.330454:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851873.330455:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851873.330456:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851873.330457:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.330458:0:41182:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:27.0:1773851873.330458:0:41182:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:27.0:1773851873.330459:0:41182:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:27.0:1773851873.330459:0:41182:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:27.0:1773851873.330460:0:41182:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.330463:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:27.0:1773851873.330464:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 19
00010000:00000001:27.0:1773851873.330465:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.330466:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:27.0:1773851873.330467:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000007ba724bb.
00000020:00000001:27.0:1773851873.330467:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:27.0:1773851873.330468:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 000000007ba724bb with handle 0x21b6f08f07a6ad8c to hash
00000020:00000001:27.0:1773851873.330469:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:27.0:1773851873.330470:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637100981301632 : -106972728249984 : ffff9eb578883180)
00010000:00000010:27.0:1773851873.330471:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000babd1210.
00010000:00000001:27.0:1773851873.330472:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637100981301632 : -106972728249984 : ffff9eb578883180)
00010000:00010000:27.0:1773851873.330472:0:41182:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000007ba724bb/0x21b6f08f07a6ad8c lrc: 2/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd739ae8d05ee0022 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330476:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000040:27.0:1773851873.330477:0:41182:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000002d49eaeb : new locks_count 1
00000020:00000040:27.0:1773851873.330477:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002d49eaeb refcount=6
00010000:00000001:27.0:1773851873.330479:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:27.0:1773851873.330480:0:41182:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:27.0:1773851873.330481:0:41182:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:27.0:1773851873.330482:0:41182:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:27.0:1773851873.330483:0:41182:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:27.0:1773851873.330483:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:27.0:1773851873.330484:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400276f1:0x9609:0x0]
00000020:00000001:27.0:1773851873.330485:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:27.0:1773851873.330486:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637105610757464 : -106968098794152 : ffff9eb68c781558)
00000004:00000001:27.0:1773851873.330486:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637105610757376 : -106968098794240 : ffff9eb68c781500)
00000004:00000001:27.0:1773851873.330487:0:41182:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330488:0:41182:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:27.0:1773851873.330489:0:41182:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:27.0:1773851873.330489:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851873.330490:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851873.330492:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000ecd4bf99.
02000000:00000001:27.0:1773851873.330492:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330493:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330494:0:41182:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330495:0:41182:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:27.0:1773851873.330496:0:41182:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:27.0:1773851873.330496:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.330497:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.330498:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330498:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330499:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330499:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330500:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330500:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330501:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330501:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
02000000:00000001:27.0:1773851873.330503:0:41182:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:27.0:1773851873.330503:0:41182:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637071493641344 : -107002215910272 : ffff9eae9aee3480)
00000004:00000001:27.0:1773851873.330505:0:41182:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:27.0:1773851873.330505:0:41182:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.330506:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.330506:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330507:0:41182:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:27.0:1773851873.330508:0:41182:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330508:0:41182:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:27.0:1773851873.330509:0:41182:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x2400276f1:0x9609:0x0], ldlm_rep = 000000005117bfc8
00000004:00000001:27.0:1773851873.330510:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:27.0:1773851873.330511:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:27.0:1773851873.330511:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:27.0:1773851873.330512:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:27.0:1773851873.330512:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 20
00010000:00000001:27.0:1773851873.330513:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.330513:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:27.0:1773851873.330515:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000bfdc423e.
00000020:00000001:27.0:1773851873.330515:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:27.0:1773851873.330516:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000bfdc423e with handle 0x21b6f08f07a6ad93 to hash
00000020:00000001:27.0:1773851873.330517:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:27.0:1773851873.330517:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637100981294144 : -106972728257472 : ffff9eb578881440)
00010000:00000010:27.0:1773851873.330518:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000009b104b70.
00010000:00000001:27.0:1773851873.330519:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637100981294144 : -106972728257472 : ffff9eb578881440)
00010000:00000001:27.0:1773851873.330520:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.330520:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.330521:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfdc423e/0x21b6f08f07a6ad93 lrc: 3/1,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330524:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:27.0:1773851873.330525:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:27.0:1773851873.330525:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:27.0:1773851873.330526:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:27.0:1773851873.330527:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.330527:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.330528:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.330528:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.330529:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:27.0:1773851873.330529:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:27.0:1773851873.330530:0:41182:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:27.0:1773851873.330530:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:27.0:1773851873.330531:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb) refcount = 20
00010000:00000040:27.0:1773851873.330532:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:27.0:1773851873.330533:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000142763aa/0x21b6f08f07a6acc8 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21393@kfi7 remote: 0x21b9c71b2096562b expref: 7 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330535:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330536:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd6a9637/0x21b6f08f07a6ab0f lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 15297@kfi7 remote: 0x2a385bf44de18475 expref: 7 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330538:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330540:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c415d6e/0x21b6f08f07a6a54a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 20785@kfi7 remote: 0x99860d9ed9853cd4 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330542:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330543:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000832de5a3/0x21b6f08f07a6a26b lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 23601@kfi7 remote: 0xce07d8f4f3aa40e1 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330545:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330546:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000059acec9a/0x21b6f08f07a67ffe lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21826@kfi7 remote: 0x177c482190197e35 expref: 7 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330548:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330549:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf485bd3/0x21b6f08f07a67dce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 16017@kfi7 remote: 0x6f0957fcc2016c01 expref: 6 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330551:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330552:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5320073/0x21b6f08f07a67998 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21298@kfi7 remote: 0x5a56a05cb8a8b31d expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330555:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330556:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016423bf5/0x21b6f08f07a6782c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21936@kfi7 remote: 0xb4fb780a561291c3 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330558:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330559:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b934f1e/0x21b6f08f07a66f6c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 23634@kfi7 remote: 0x7c0da7673655e6bb expref: 7 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330561:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330562:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fecbf600/0x21b6f08f07a66f26 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 16257@kfi7 remote: 0x757acea6a351db8a expref: 6 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330564:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330575:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7dcf18c/0x21b6f08f07a66ed9 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 13714@kfi7 remote: 0xe6fc6ed572595da9 expref: 6 pid: 61083 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330578:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330579:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010fa0ac0/0x21b6f08f07a6315a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 22450@kfi7 remote: 0x5c0bf53c716f4467 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330581:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330581:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008f335fab/0x21b6f08f07a5d4bd lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 20706@kfi7 remote: 0xee4f431a41d43936 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330583:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330585:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e2ad57/0x21b6f08f07a5d477 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 18867@kfi7 remote: 0x6f0fd12f6ddf8254 expref: 6 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330587:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330588:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a82f52ea/0x21b6f08f07a58b7c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 21216@kfi7 remote: 0xce2ef96babfa3e25 expref: 7 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330590:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330591:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bbc818af/0x21b6f08ef3d9b2ce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 23153@kfi7 remote: 0xc70354b40450ada2 expref: 56 pid: 61192 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330593:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330594:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c3684a3/0x21b6f08ef35f0f50 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 18962@kfi7 remote: 0xc8dab5ae9bddf110 expref: 60 pid: 60739 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330596:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330596:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9d1f20f/0x21b6f08eeeedea42 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40200000000000 nid: 9792@kfi7 remote: 0x7f4e1c592d72496c expref: 59 pid: 61066 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330598:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00010000:27.0:1773851873.330599:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfdc423e/0x21b6f08f07a6ad93 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330602:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:27.0:1773851873.330602:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:27.0:1773851873.330603:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:27.0:1773851873.330604:0:41182:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.330604:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:27.0:1773851873.330605:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.330606:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.330606:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.330607:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:27.0:1773851873.330608:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.330608:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfdc423e/0x21b6f08f07a6ad93 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 21 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330611:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:27.0:1773851873.330611:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:27.0:1773851873.330612:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.330612:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.330613:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.330613:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.330613:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000bfdc423e refcount=3
00000020:00000001:27.0:1773851873.330614:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981294144 : -106972728257472 : ffff9eb578881440)
00010000:00000001:27.0:1773851873.330615:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981294144 : -106972728257472 : ffff9eb578881440)
00010000:00000001:27.0:1773851873.330616:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.330616:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.330616:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330617:0:41182:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330618:0:41182:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:27.0:1773851873.330619:0:41182:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:27.0:1773851873.330620:0:41182:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:27.0:1773851873.330625:0:41182:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330625:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:27.0:1773851873.330626:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.330628:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.330629:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330629:0:41182:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330630:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330631:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:27.0:1773851873.330631:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.330632:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.330632:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330633:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330633:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:27.0:1773851873.330634:0:41182:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:27.0:1773851873.330635:0:41182:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.330636:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.330636:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.330637:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330637:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330637:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330638:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330638:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330639:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:27.0:1773851873.330639:0:41182:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x2400276f1:0x9609:0x0]: nlink=4, mode=40755, valid=0x1100000000002f8f
00000004:00200000:27.0:1773851873.330640:0:41182:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400276f1:0x9609:0x0]: returning size 37888
00000004:00200000:27.0:1773851873.330641:0:41182:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 10 stripe count 1 MDT count 6
00000004:00000002:27.0:1773851873.330642:0:41182:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:27.0:1773851873.330643:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.330643:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330644:0:41182:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:27.0:1773851873.330644:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:27.0:1773851873.330644:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.330645:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.330645:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330646:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330647:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.330647:0:41182:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.330649:0:41182:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:27.0:1773851873.330651:0:41182:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330652:0:41182:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330654:0:41182:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.330654:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.330654:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.330655:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000bfdc423e refcount=3
00000020:00000001:27.0:1773851873.330655:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981294144 : -106972728257472 : ffff9eb578881440)
00010000:00000001:27.0:1773851873.330656:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981294144 : -106972728257472 : ffff9eb578881440)
00000004:00000040:27.0:1773851873.330657:0:41182:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000002d49eaeb : new locks_count 2
00000020:00000040:27.0:1773851873.330657:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002d49eaeb refcount=7
00010000:00000001:27.0:1773851873.330658:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.330659:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.330659:0:41182:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:27.0:1773851873.330660:0:41182:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:27.0:1773851873.330660:0:41182:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:27.0:1773851873.330661:0:41182:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:27.0:1773851873.330661:0:41182:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:27.0:1773851873.330662:0:41182:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:27.0:1773851873.330662:0:41182:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:27.0:1773851873.330663:0:41182:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:27.0:1773851873.330664:0:41182:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330664:0:41182:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:27.0:1773851873.330665:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:27.0:1773851873.330666:0:41182:0:(lu_object.c:224:lu_object_put()) Add 000000007e72d379/000000009c9aae14 to site lru. bkt: 000000005a7eb874
00000004:00000001:27.0:1773851873.330667:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:27.0:1773851873.330667:0:41182:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:27.0:1773851873.330668:0:41182:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:27.0:1773851873.330668:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:27.0:1773851873.330669:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.330669:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.330670:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.330670:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:27.0:1773851873.330671:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000007ba724bb with handle 0x21b6f08f07a6ad8c from hash
00010000:00000001:27.0:1773851873.330672:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:27.0:1773851873.330672:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.330673:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.330673:0:41182:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:27.0:1773851873.330674:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:27.0:1773851873.330674:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000007ba724bb/0x21b6f08f07a6ad8c lrc: 0/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x1/0x0 rrc: 21 type: IBT gid 0 flags: 0x44000000000000 nid: 22818@kfi7 remote: 0xd739ae8d05ee0022 expref: 7 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330677:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330677:0:41182:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002d49eaeb : new locks_count 1
00000020:00000040:27.0:1773851873.330678:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002d49eaeb : new refcount 6
00010000:00000010:27.0:1773851873.330679:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000babd1210.
00010000:00000040:27.0:1773851873.330680:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000001:27.0:1773851873.330680:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.330681:0:41182:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.330682:0:41182:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:27.0:1773851873.330682:0:41182:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfdc423e/0x21b6f08f07a6ad93 lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 22818@kfi7 remote: 0xd739ae8d05ee0022 expref: 6 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330685:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000001:27.0:1773851873.330686:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:27.0:1773851873.330687:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:27.0:1773851873.330687:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb)
00010000:00010000:27.0:1773851873.330688:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 10
00010000:00000001:27.0:1773851873.330689:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.330690:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.330690:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:27.0:1773851873.330691:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.330691:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:27.0:1773851873.330691:0:41182:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000bfdc423e, rc 0)
00000020:00000001:27.0:1773851873.330692:0:41182:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851873.330693:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044159471, transno 0, xid 1859603522591488
00010000:00000001:27.0:1773851873.330694:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851873.330695:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000183c91d2 x1859603522591488/t0(0) o101->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:600/0 lens 576/640 e 0 to 0 dl 1773851960 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832053561511644160'
00010000:00000001:27.0:1773851873.330697:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851873.330699:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851873.330699:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=106 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851873.330701:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851873.330701:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000033d23b05 refcount 3 to 22818@kfi7
00000100:00000001:27.0:1773851873.330702:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154720 : -107139310396896 : ffff9e8eaf765a20)
02000000:00000001:27.0:1773851873.330703:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851873.330704:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330705:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851873.330705:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22819@kfi7
00000400:00000010:27.0:1773851873.330706:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e26c5908.
00000100:00000200:27.0:1773851873.330707:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859603522591488, offset 224
00000400:00000200:27.0:1773851873.330709:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22819@kfi7
00000400:00000200:27.0:1773851873.330710:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.330711:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 1
00000400:00000200:27.0:1773851873.330712:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000400:00000200:27.0:1773851873.330713:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 3
00000400:00000200:27.0:1773851873.330714:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22819@kfi7 local destination
00000400:00000200:27.0:1773851873.330716:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769438:8769438:1024:4294967295] 22819@kfi7 LPNI seq info [368541:368541:16:4294967295]
00000400:00000200:27.0:1773851873.330718:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000400:00000200:27.0:1773851873.330718:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.330721:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22819@kfi7(22819@kfi7:22819@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851873.330722:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 3
00000800:00000200:27.0:1773851873.330724:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851873.330731:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:27.0:1773851873.330733:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851873.330736:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 Using peer 22819@kfi7(0x1000000000011c5)
00000800:00000200:27.0:1773851873.330740:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 740 bytes to peer 0x1000000000011c5: rc=0
00000800:00000200:27.0:1773851873.330741:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851873.330744:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.330745:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000033d23b05 refcount 2 to 22818@kfi7
00010000:00000001:27.0:1773851873.330746:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851873.330746:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.330747:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851873.330748:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000183c91d2 x1859603522591488/t0(0) o101->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:600/0 lens 576/640 e 0 to 0 dl 1773851960 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832053561511644160'
00000100:00100000:27.0:1773851873.330751:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000183c91d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1e88b751-b4e7-4eda-b881-bf76c8d02e53+6:609371:x1859603522591488:12345-22818@kfi7:101:tuolumne-832053561511644160 Request processed in 304us (337us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851873.330753:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851873.330754:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22818@kfi7, seq: 1451911032
00000100:00000040:27.0:1773851873.330755:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d49eaeb : new rpc_count 0
00000100:00000001:27.0:1773851873.330755:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851873.330755:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851873.330756:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851873.330756:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22819@kfi7: PUT: OK
00000020:00000010:27.0:1773851873.330757:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000022b22b54.
00000020:00000010:27.0:1773851873.330757:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000400:00000200:25.0:1773851873.330757:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e26c5908
00000400:00000010:25.0:1773851873.330757:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e26c5908.
00000020:00000010:27.0:1773851873.330758:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000100:00000001:25.0:1773851873.330758:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851873.330758:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:27.0:1773851873.330759:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002d49eaeb : new refcount 5
00000100:00000001:27.0:1773851873.330759:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851873.330759:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000800:00000200:25.0:1773851873.330761:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 22819@kfi7(0000000096afd609):0x0 lsk 4550 rsk 43 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011c5 Transaction freed
00000800:00000200:26.0:1773851873.330889:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.330889:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.330889:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851873.330890:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851873.330891:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851873.330891:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851873.330892:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22819@kfi7(0000000035c56b4f):0x456 version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851873.330893:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851873.330894:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 Using peer 22819@kfi7(0x456)
00000400:00000200:26.0:1773851873.330895:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.330896:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22819@kfi7 : PUT - for me
00000400:00000200:25.0:1773851873.330896:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.330897:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.330898:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 1
00000400:00000200:26.0:1773851873.330898:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000800:00000200:25.0:1773851873.330898:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x456: rc=0
00000400:00000200:26.0:1773851873.330899:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000800:00000200:25.0:1773851873.330899:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851873.330900:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 3
00000400:00000200:26.0:1773851873.330900:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22818@kfi7 to cpt 3
00000400:00000200:26.0:1773851873.330901:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22818@kfi7 of length 584 into portal 12 MB=0x69b4caf631b40
00000400:00000200:26.0:1773851873.330902:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22818@kfi7 of length 584/584 into md 0x16159c9699 [64] + 19280
00000800:00000200:26.0:1773851873.330904:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851873.330905:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851873.330906:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22819@kfi7: PUT: OK
00000100:00000001:26.0:1773851873.330907:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851873.330907:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851873.330909:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059547c5c.
00000100:00000040:26.0:1773851873.330909:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000059547c5c x1859603522591552 msgsize 584
00000100:00100000:26.0:1773851873.330910:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22818@kfi7 (source: 12345-22819@kfi7)
00000100:00000001:26.0:1773851873.330911:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:25.0:1773851873.330911:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851873.330912:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:26.0:1773851873.330912:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
02000000:00000001:27.0:1773851873.330913:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851873.330913:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851873.330913:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851873.330913:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 Transaction freed
02000000:00000001:27.0:1773851873.330914:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851873.330914:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00100000:27.0:1773851873.330915:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603522591552
00000020:00000001:27.0:1773851873.330915:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851873.330915:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff80cc2
00000020:00000001:27.0:1773851873.330916:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.330916:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d49eaeb refcount=6
00000020:00000001:27.0:1773851873.330917:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142647366656 : -106931062184960 : ffff9ebf2c05e400)
00000020:00000001:27.0:1773851873.330918:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142647366656 : -106931062184960 : ffff9ebf2c05e400)
00000100:00000001:27.0:1773851873.330918:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.330922:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851873.330922:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851873.330923:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000022b22b54.
00000020:00000010:27.0:1773851873.330924:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851873.330924:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851873.330925:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:27.0:1773851873.330925:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:27.0:1773851873.330926:0:41182:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330926:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330927:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330928:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.330929:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851873.330929:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851873.330929:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851873.330930:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22818@kfi7, seq: 1451911033
00000100:00000001:26.0:1773851873.330930:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851873.330931:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d49eaeb : new rpc_count 1
00000100:00000001:26.0:1773851873.330931:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.330931:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330932:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150705664 : -106980558845952 : ffff9eb3a5cac800)
00000100:00000040:27.0:1773851873.330933:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000059547c5c x1859603522591552/t0(0) o101->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:154/0 lens 584/0 e 0 to 0 dl 1773852269 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-832053561511644160'
00000100:00000001:27.0:1773851873.330935:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.330936:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851873.330937:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059547c5c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1e88b751-b4e7-4eda-b881-bf76c8d02e53+6:609371:x1859603522591552:12345-22818@kfi7:101:tuolumne-832053561511644160
00000100:00000200:27.0:1773851873.330938:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603522591552
00000020:00000001:27.0:1773851873.330939:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851873.330939:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851873.330940:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.330941:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851873.330941:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:27.0:1773851873.330942:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851873.330942:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603522591552, found 0 last_xid 1859603522591551
00000020:00000001:27.0:1773851873.330943:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851873.330944:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851873.330944:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851873.330945:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.330946:0:41182:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:27.0:1773851873.330946:0:41182:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:27.0:1773851873.330946:0:41182:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:27.0:1773851873.330947:0:41182:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:27.0:1773851873.330947:0:41182:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.330948:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:27.0:1773851873.330949:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 20
00010000:00000001:27.0:1773851873.330950:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.330950:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:27.0:1773851873.330951:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000006671799d.
00000020:00000001:27.0:1773851873.330952:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:27.0:1773851873.330953:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 000000006671799d with handle 0x21b6f08f07a6ad9a to hash
00000020:00000001:27.0:1773851873.330953:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:27.0:1773851873.330954:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637100981298176 : -106972728253440 : ffff9eb578882400)
00010000:00000010:27.0:1773851873.330954:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000babd1210.
00010000:00000001:27.0:1773851873.330955:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637100981298176 : -106972728253440 : ffff9eb578882400)
00010000:00010000:27.0:1773851873.330956:0:41182:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000006671799d/0x21b6f08f07a6ad9a lrc: 2/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 21 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd739ae8d05ee0029 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330958:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.330959:0:41182:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000002d49eaeb : new locks_count 2
00000020:00000040:27.0:1773851873.330960:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002d49eaeb refcount=7
00010000:00000001:27.0:1773851873.330961:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:27.0:1773851873.330961:0:41182:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:27.0:1773851873.330962:0:41182:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:27.0:1773851873.330962:0:41182:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:27.0:1773851873.330963:0:41182:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:27.0:1773851873.330963:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:27.0:1773851873.330964:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400276f1:0x9609:0x0]
00000020:00000001:27.0:1773851873.330964:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:27.0:1773851873.330965:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637105610757464 : -106968098794152 : ffff9eb68c781558)
00000004:00000001:27.0:1773851873.330965:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637105610757376 : -106968098794240 : ffff9eb68c781500)
00000004:00000001:27.0:1773851873.330966:0:41182:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330967:0:41182:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:27.0:1773851873.330967:0:41182:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:27.0:1773851873.330968:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851873.330968:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851873.330970:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000e45f6d7e.
02000000:00000001:27.0:1773851873.330971:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.330971:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330972:0:41182:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330972:0:41182:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:27.0:1773851873.330973:0:41182:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:27.0:1773851873.330973:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.330974:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.330974:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330975:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330975:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330976:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330976:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330976:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.330977:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.330977:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
02000000:00000001:27.0:1773851873.330978:0:41182:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:27.0:1773851873.330979:0:41182:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637071493641344 : -107002215910272 : ffff9eae9aee3480)
00000004:00000001:27.0:1773851873.330979:0:41182:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:27.0:1773851873.330980:0:41182:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.330980:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.330981:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330981:0:41182:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:27.0:1773851873.330981:0:41182:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.330982:0:41182:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:27.0:1773851873.330983:0:41182:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x2400276f1:0x9609:0x0]/template_files, ldlm_rep = 000000008f1c52c2
00000004:00000001:27.0:1773851873.330984:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:27.0:1773851873.330985:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:27.0:1773851873.330985:0:41182:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:27.0:1773851873.330986:0:41182:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:27.0:1773851873.330986:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:27.0:1773851873.330986:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:27.0:1773851873.330987:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.330988:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.330989:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:27.0:1773851873.330989:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000033430096.
00000020:00000001:27.0:1773851873.330990:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:27.0:1773851873.330991:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000033430096 with handle 0x21b6f08f07a6ada1 to hash
00000020:00000001:27.0:1773851873.330991:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:27.0:1773851873.330992:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637100981303360 : -106972728248256 : ffff9eb578883840)
00010000:00000010:27.0:1773851873.330992:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c88b1beb.
00010000:00000001:27.0:1773851873.330993:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637100981303360 : -106972728248256 : ffff9eb578883840)
00010000:00000001:27.0:1773851873.330994:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.330994:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.330995:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 3/1,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x0/0x0 rrc: 22 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.330997:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.330998:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:27.0:1773851873.330998:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:27.0:1773851873.330999:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:27.0:1773851873.330999:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.331000:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331000:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.331001:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331001:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:27.0:1773851873.331002:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:27.0:1773851873.331002:0:41182:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:27.0:1773851873.331002:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:27.0:1773851873.331003:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb) refcount = 21
00010000:00000040:27.0:1773851873.331004:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:27.0:1773851873.331004:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfdc423e/0x21b6f08f07a6ad93 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 22818@kfi7 remote: 0xd739ae8d05ee0022 expref: 7 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331007:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331007:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000142763aa/0x21b6f08f07a6acc8 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 21393@kfi7 remote: 0x21b9c71b2096562b expref: 7 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331013:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331014:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd6a9637/0x21b6f08f07a6ab0f lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 15297@kfi7 remote: 0x2a385bf44de18475 expref: 7 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331016:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331016:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c415d6e/0x21b6f08f07a6a54a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 20785@kfi7 remote: 0x99860d9ed9853cd4 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331018:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331019:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000832de5a3/0x21b6f08f07a6a26b lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 23601@kfi7 remote: 0xce07d8f4f3aa40e1 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331021:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331021:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000059acec9a/0x21b6f08f07a67ffe lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 21826@kfi7 remote: 0x177c482190197e35 expref: 7 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331024:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331024:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf485bd3/0x21b6f08f07a67dce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 16017@kfi7 remote: 0x6f0957fcc2016c01 expref: 6 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331026:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331027:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5320073/0x21b6f08f07a67998 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 21298@kfi7 remote: 0x5a56a05cb8a8b31d expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331029:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331030:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016423bf5/0x21b6f08f07a6782c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 21936@kfi7 remote: 0xb4fb780a561291c3 expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331032:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331033:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b934f1e/0x21b6f08f07a66f6c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 23634@kfi7 remote: 0x7c0da7673655e6bb expref: 7 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331035:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331036:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fecbf600/0x21b6f08f07a66f26 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 16257@kfi7 remote: 0x757acea6a351db8a expref: 6 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331038:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331039:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7dcf18c/0x21b6f08f07a66ed9 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 13714@kfi7 remote: 0xe6fc6ed572595da9 expref: 6 pid: 61083 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331041:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331041:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010fa0ac0/0x21b6f08f07a6315a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 22450@kfi7 remote: 0x5c0bf53c716f4467 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331043:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331044:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008f335fab/0x21b6f08f07a5d4bd lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 20706@kfi7 remote: 0xee4f431a41d43936 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331046:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331047:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e2ad57/0x21b6f08f07a5d477 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 18867@kfi7 remote: 0x6f0fd12f6ddf8254 expref: 6 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331049:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331050:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a82f52ea/0x21b6f08f07a58b7c lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 21216@kfi7 remote: 0xce2ef96babfa3e25 expref: 7 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331052:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331053:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bbc818af/0x21b6f08ef3d9b2ce lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 23153@kfi7 remote: 0xc70354b40450ada2 expref: 56 pid: 61192 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331055:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331055:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c3684a3/0x21b6f08ef35f0f50 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 18962@kfi7 remote: 0xc8dab5ae9bddf110 expref: 60 pid: 60739 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331058:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000040:27.0:1773851873.331059:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9d1f20f/0x21b6f08eeeedea42 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x10/0x0 rrc: 22 type: IBT gid 0 flags: 0x40200000000000 nid: 9792@kfi7 remote: 0x7f4e1c592d72496c expref: 59 pid: 61066 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331061:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00010000:27.0:1773851873.331061:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 3/1,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331063:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.331064:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:27.0:1773851873.331064:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:27.0:1773851873.331065:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331066:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:27.0:1773851873.331066:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331067:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331067:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.331068:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:27.0:1773851873.331068:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.331069:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 3/1,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331071:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.331072:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:27.0:1773851873.331072:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331072:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331073:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:27.0:1773851873.331073:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:27.0:1773851873.331074:0:41182:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000655c2400.
00010000:00000010:27.0:1773851873.331075:0:41182:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000d3c9a084.
00010000:00000001:27.0:1773851873.331076:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:27.0:1773851873.331077:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000d6646364.
00000020:00000001:27.0:1773851873.331078:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:27.0:1773851873.331079:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000d6646364 with handle 0x21b6f08f07a6ada8 to hash
00000020:00000001:27.0:1773851873.331079:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:27.0:1773851873.331080:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000010:27.0:1773851873.331081:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000ea36528e.
00010000:00000001:27.0:1773851873.331081:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000001:27.0:1773851873.331082:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.331082:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.331083:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 3/1,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331085:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331086:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:27.0:1773851873.331086:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:27.0:1773851873.331087:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:27.0:1773851873.331087:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.331088:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331088:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.331089:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331089:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:27.0:1773851873.331089:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:27.0:1773851873.331090:0:41182:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:27.0:1773851873.331090:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:27.0:1773851873.331091:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x9609:0x0].0x537abb93 (00000000655c2400) refcount = 1
00010000:00010000:27.0:1773851873.331092:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331094:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331094:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:27.0:1773851873.331095:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:27.0:1773851873.331095:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331095:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:27.0:1773851873.331096:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331096:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331097:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.331098:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:27.0:1773851873.331099:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.331099:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331102:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331102:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:27.0:1773851873.331103:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331103:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331103:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331104:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331104:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d6646364 refcount=3
00000020:00000001:27.0:1773851873.331105:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000001:27.0:1773851873.331105:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000001:27.0:1773851873.331106:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331106:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.331107:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331107:0:41182:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331108:0:41182:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:27.0:1773851873.331110:0:41182:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:27.0:1773851873.331111:0:41182:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:27.0:1773851873.331111:0:41182:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:27.0:1773851873.331112:0:41182:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:27.0:1773851873.331116:0:41182:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:27.0:1773851873.331117:0:41182:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:27.0:1773851873.331117:0:41182:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:27.0:1773851873.331118:0:41182:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:27.0:1773851873.331118:0:41182:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:27.0:1773851873.331119:0:41182:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:27.0:1773851873.331120:0:41182:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:27.0:1773851873.331120:0:41182:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:27.0:1773851873.331121:0:41182:0:(osd_index.c:979:osd_remote_fid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:27.0:1773851873.331121:0:41182:0:(osd_index.c:554:osd_zfs_consistency_check()) Process entered
00080000:00000001:27.0:1773851873.331122:0:41182:0:(osd_oi.c:669:osd_fid_lookup()) Process entered
00080000:00000001:27.0:1773851873.331122:0:41182:0:(osd_oi.c:360:fid_is_on_ost()) Process entered
80000000:00000001:27.0:1773851873.331123:0:41182:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:27.0:1773851873.331123:0:41182:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:27.0:1773851873.331124:0:41182:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:27.0:1773851873.331124:0:41182:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:27.0:1773851873.331125:0:41182:0:(osd_oi.c:389:fid_is_on_ost()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:27.0:1773851873.331130:0:41182:0:(osd_oi.c:706:osd_fid_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:27.0:1773851873.331130:0:41182:0:(osd_index.c:582:osd_zfs_consistency_check()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:27.0:1773851873.331131:0:41182:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331132:0:41182:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331132:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:27.0:1773851873.331133:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2400276f1:0x961f:0x0]
00000020:00000001:27.0:1773851873.331133:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:27.0:1773851873.331134:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637137110913048 : -106936598638568 : ffff9ebde2065018)
00000004:00000001:27.0:1773851873.331134:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637137110912960 : -106936598638656 : ffff9ebde2064fc0)
00000004:00000001:27.0:1773851873.331135:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:27.0:1773851873.331136:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:27.0:1773851873.331136:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:27.0:1773851873.331136:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:27.0:1773851873.331137:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000009d5e76b5 count: 19
00010000:00000001:27.0:1773851873.331138:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.331138:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:27.0:1773851873.331139:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000000dcd0ca0.
00000020:00000001:27.0:1773851873.331139:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:27.0:1773851873.331140:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 000000000dcd0ca0 with handle 0x21b6f08f07a6adaf to hash
00000020:00000001:27.0:1773851873.331141:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:27.0:1773851873.331141:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00010000:00000010:27.0:1773851873.331142:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000ddf1e77f.
00010000:00000001:27.0:1773851873.331142:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00010000:00000001:27.0:1773851873.331143:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.331143:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.331144:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000000dcd0ca0/0x21b6f08f07a6adaf lrc: 3/1,0 mode: --/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x0/0x0 rrc: 20 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331146:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000001:27.0:1773851873.331147:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:27.0:1773851873.331147:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:27.0:1773851873.331148:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:27.0:1773851873.331149:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.331149:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331150:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:27.0:1773851873.331150:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331151:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:27.0:1773851873.331151:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:27.0:1773851873.331152:0:41182:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:27.0:1773851873.331152:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:27.0:1773851873.331152:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2400276f1:0x961f:0x0].0x0 (000000009d5e76b5) refcount = 19
00010000:00000040:27.0:1773851873.331153:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:27.0:1773851873.331154:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ee31cffb/0x21b6f08f07a6ace4 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21393@kfi7 remote: 0x21b9c71b20965632 expref: 7 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331156:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331157:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c015d2b/0x21b6f08f07a6ab2b lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 15297@kfi7 remote: 0x2a385bf44de1847c expref: 7 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331159:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331160:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000021cb55fc/0x21b6f08f07a6a566 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 20785@kfi7 remote: 0x99860d9ed9853cdb expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331162:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331162:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b3509970/0x21b6f08f07a6a287 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 23601@kfi7 remote: 0xce07d8f4f3aa40e8 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331165:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331166:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec6b566/0x21b6f08f07a6801a lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21826@kfi7 remote: 0x177c482190197e3c expref: 7 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331168:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331168:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1257b77/0x21b6f08f07a67dea lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 16017@kfi7 remote: 0x6f0957fcc2016c08 expref: 6 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331173:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331174:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002263aa90/0x21b6f08f07a679b4 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21298@kfi7 remote: 0x5a56a05cb8a8b324 expref: 7 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331176:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331176:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ad0a3f8/0x21b6f08f07a67848 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21936@kfi7 remote: 0xb4fb780a561291ca expref: 6 pid: 42267 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331178:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331179:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f8f827e/0x21b6f08f07a66f88 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 23634@kfi7 remote: 0x7c0da7673655e6c2 expref: 7 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331181:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331181:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056ddf98a/0x21b6f08f07a66f42 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 16257@kfi7 remote: 0x757acea6a351db91 expref: 6 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331183:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331184:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001b236374/0x21b6f08f07a66ef5 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 13714@kfi7 remote: 0xe6fc6ed572595db0 expref: 6 pid: 61083 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331186:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331187:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e231235/0x21b6f08f07a63176 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 22450@kfi7 remote: 0x5c0bf53c716f446e expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331189:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331190:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ae20e37/0x21b6f08f07a5d4f5 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 20706@kfi7 remote: 0xee4f431a41d4393d expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331192:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331193:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000935c16cd/0x21b6f08f07a5d4a1 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 18867@kfi7 remote: 0x6f0fd12f6ddf825b expref: 6 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331195:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331196:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa7a21f7/0x21b6f08f07a58b98 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 21216@kfi7 remote: 0xce2ef96babfa3e2c expref: 7 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331198:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331199:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000930e9ef/0x21b6f08ef3d9b2ea lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 23153@kfi7 remote: 0xc70354b40450ada9 expref: 56 pid: 61192 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331201:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331202:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003daf75b9/0x21b6f08ef35f0fb2 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 18962@kfi7 remote: 0xc8dab5ae9bddf117 expref: 60 pid: 60739 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331204:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000040:27.0:1773851873.331205:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000967bf993/0x21b6f08eeeedeaf1 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 9792@kfi7 remote: 0x7f4e1c592d724973 expref: 59 pid: 61066 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331207:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00010000:27.0:1773851873.331207:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000000dcd0ca0/0x21b6f08f07a6adaf lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331210:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000001:27.0:1773851873.331210:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:27.0:1773851873.331211:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:27.0:1773851873.331211:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331212:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:27.0:1773851873.331212:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331213:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331213:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:27.0:1773851873.331214:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:27.0:1773851873.331214:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.331215:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000000dcd0ca0/0x21b6f08f07a6adaf lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331218:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000001:27.0:1773851873.331219:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:27.0:1773851873.331219:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331219:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331220:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331220:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331220:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000dcd0ca0 refcount=3
00000020:00000001:27.0:1773851873.331221:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00010000:00000001:27.0:1773851873.331222:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00010000:00000001:27.0:1773851873.331222:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331223:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.331223:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331223:0:41182:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331224:0:41182:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:27.0:1773851873.331225:0:41182:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:27.0:1773851873.331225:0:41182:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:27.0:1773851873.331228:0:41182:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331229:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:27.0:1773851873.331229:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.331230:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.331230:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331231:0:41182:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331232:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331232:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:27.0:1773851873.331233:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.331233:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.331233:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331234:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331235:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:27.0:1773851873.331235:0:41182:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:27.0:1773851873.331236:0:41182:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.331237:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.331237:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:27.0:1773851873.331238:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.331239:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.331239:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.331240:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=66705 : 66705 : 10491)
00000001:00000001:27.0:1773851873.331240:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:27.0:1773851873.331240:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:27.0:1773851873.331241:0:41182:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x2400276f1:0x961f:0x0]: nlink=2, mode=40755, valid=0x1100000000002f8f
00000004:00200000:27.0:1773851873.331242:0:41182:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x2400276f1:0x961f:0x0]: returning size 37888
00000004:00200000:27.0:1773851873.331243:0:41182:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:27.0:1773851873.331243:0:41182:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:27.0:1773851873.331244:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:27.0:1773851873.331244:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331245:0:41182:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:27.0:1773851873.331245:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:27.0:1773851873.331246:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.331246:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:27.0:1773851873.331247:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331247:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331248:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:27.0:1773851873.331248:0:41182:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.331249:0:41182:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:27.0:1773851873.331250:0:41182:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331251:0:41182:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331252:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331253:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331253:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000dcd0ca0 refcount=3
00000020:00000001:27.0:1773851873.331254:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00010000:00000001:27.0:1773851873.331255:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00000004:00010000:27.0:1773851873.331255:0:41182:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 000000000dcd0ca0/0x21b6f08f07a6adaf lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331258:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000001:27.0:1773851873.331258:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331259:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.331260:0:41182:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:27.0:1773851873.331260:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:27.0:1773851873.331261:0:41182:0:(lu_object.c:224:lu_object_put()) Add 00000000d578ae85/0000000056fac4eb to site lru. bkt: 000000001c01ab3e
00000004:00000001:27.0:1773851873.331262:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:27.0:1773851873.331262:0:41182:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:27.0:1773851873.331263:0:41182:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:27.0:1773851873.331263:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331263:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331264:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000033430096 refcount=3
00000020:00000001:27.0:1773851873.331264:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981303360 : -106972728248256 : ffff9eb578883840)
00010000:00000001:27.0:1773851873.331265:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981303360 : -106972728248256 : ffff9eb578883840)
00010000:00000001:27.0:1773851873.331266:0:41182:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:27.0:1773851873.331266:0:41182:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 3/1,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331269:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.331269:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331270:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:27.0:1773851873.331270:0:41182:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 2/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331272:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.331273:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.331274:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331274:0:41182:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:27.0:1773851873.331275:0:41182:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 3/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331277:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00010000:27.0:1773851873.331278:0:41182:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000033430096 already unused, calling callback (000000001690cbe4)
00000004:00000001:27.0:1773851873.331279:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:27.0:1773851873.331279:0:41182:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:27.0:1773851873.331280:0:41182:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 3/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331286:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.331287:0:41182:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:27.0:1773851873.331287:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331287:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331288:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000033430096 refcount=4
00000020:00000001:27.0:1773851873.331288:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981303360 : -106972728248256 : ffff9eb578883840)
00010000:00000001:27.0:1773851873.331289:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981303360 : -106972728248256 : ffff9eb578883840)
00010000:00000001:27.0:1773851873.331290:0:41182:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:27.0:1773851873.331290:0:41182:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 4/0,0 mode: CR/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331292:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.331293:0:41182:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:27.0:1773851873.331293:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:27.0:1773851873.331294:0:41182:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331294:0:41182:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:27.0:1773851873.331295:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:27.0:1773851873.331295:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.331296:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:27.0:1773851873.331296:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000033430096 with handle 0x21b6f08f07a6ada1 from hash
00010000:00000001:27.0:1773851873.331297:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:27.0:1773851873.331297:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331298:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331298:0:41182:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:27.0:1773851873.331298:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:27.0:1773851873.331299:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331300:0:41182:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:27.0:1773851873.331300:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:27.0:1773851873.331300:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:27.0:1773851873.331301:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x9609:0x0].0x0 (00000000e9131bbb)
00010000:00010000:27.0:1773851873.331302:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:27.0:1773851873.331303:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331303:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331304:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:27.0:1773851873.331305:0:41182:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:27.0:1773851873.331306:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331306:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331306:0:41182:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331307:0:41182:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331308:0:41182:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.331308:0:41182:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 2/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331310:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000001:27.0:1773851873.331311:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331311:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331312:0:41182:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:27.0:1773851873.331312:0:41182:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:27.0:1773851873.331313:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:27.0:1773851873.331313:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000033430096/0x21b6f08f07a6ada1 lrc: 0/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 22 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331315:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 21
00010000:00000010:27.0:1773851873.331316:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c88b1beb.
00010000:00000040:27.0:1773851873.331316:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000001:27.0:1773851873.331317:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.331317:0:41182:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:27.0:1773851873.331318:0:41182:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:27.0:1773851873.331318:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331318:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331319:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d6646364 refcount=3
00000020:00000001:27.0:1773851873.331319:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000001:27.0:1773851873.331320:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000001:27.0:1773851873.331320:0:41182:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:27.0:1773851873.331321:0:41182:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 3/1,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331323:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331325:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331325:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:27.0:1773851873.331325:0:41182:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 2/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331328:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331328:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.331329:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331330:0:41182:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:27.0:1773851873.331330:0:41182:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331332:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00010000:27.0:1773851873.331333:0:41182:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000d6646364 already unused, calling callback (000000001690cbe4)
00000004:00000001:27.0:1773851873.331333:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:27.0:1773851873.331334:0:41182:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:27.0:1773851873.331334:0:41182:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331336:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331337:0:41182:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:27.0:1773851873.331337:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331338:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331338:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d6646364 refcount=4
00000020:00000001:27.0:1773851873.331339:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000001:27.0:1773851873.331339:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981288960 : -106972728262656 : ffff9eb578880000)
00010000:00000001:27.0:1773851873.331340:0:41182:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:27.0:1773851873.331340:0:41182:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 4/0,0 mode: PR/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331342:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331343:0:41182:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:27.0:1773851873.331343:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:27.0:1773851873.331344:0:41182:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331345:0:41182:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:27.0:1773851873.331345:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:27.0:1773851873.331346:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.331346:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:27.0:1773851873.331346:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d6646364 with handle 0x21b6f08f07a6ada8 from hash
00010000:00000001:27.0:1773851873.331347:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:27.0:1773851873.331348:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331348:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331348:0:41182:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:27.0:1773851873.331349:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:27.0:1773851873.331349:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331350:0:41182:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:27.0:1773851873.331350:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:27.0:1773851873.331350:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:27.0:1773851873.331351:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x9609:0x0].0x537abb93 (00000000655c2400)
00010000:00010000:27.0:1773851873.331352:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:27.0:1773851873.331352:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331353:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331353:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:27.0:1773851873.331353:0:41182:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:27.0:1773851873.331354:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331354:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331355:0:41182:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331355:0:41182:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331356:0:41182:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:27.0:1773851873.331356:0:41182:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 2/0,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331358:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000001:27.0:1773851873.331359:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331359:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331359:0:41182:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:27.0:1773851873.331360:0:41182:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:27.0:1773851873.331360:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:27.0:1773851873.331361:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6646364/0x21b6f08f07a6ada8 lrc: 0/0,0 mode: --/PR res: [0x2400276f1:0x9609:0x0].0x537abb93 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331363:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 1
00010000:00000010:27.0:1773851873.331363:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000ea36528e.
00010000:00000040:27.0:1773851873.331364:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000655c2400 count: 0
00010000:00000010:27.0:1773851873.331365:0:41182:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000d3c9a084.
00010000:00000001:27.0:1773851873.331366:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.331366:0:41182:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:27.0:1773851873.331367:0:41182:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:27.0:1773851873.331367:0:41182:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:27.0:1773851873.331367:0:41182:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:27.0:1773851873.331368:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:27.0:1773851873.331368:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.331368:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000dcd0ca0 refcount=3
00000020:00000001:27.0:1773851873.331369:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00010000:00000001:27.0:1773851873.331370:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637100981302208 : -106972728249408 : ffff9eb5788833c0)
00000004:00000040:27.0:1773851873.331370:0:41182:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000002d49eaeb : new locks_count 3
00000020:00000040:27.0:1773851873.331371:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002d49eaeb refcount=8
00010000:00000001:27.0:1773851873.331372:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331372:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:27.0:1773851873.331372:0:41182:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:27.0:1773851873.331373:0:41182:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:27.0:1773851873.331373:0:41182:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:27.0:1773851873.331374:0:41182:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:27.0:1773851873.331374:0:41182:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:27.0:1773851873.331374:0:41182:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:27.0:1773851873.331375:0:41182:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:27.0:1773851873.331375:0:41182:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:27.0:1773851873.331376:0:41182:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851873.331377:0:41182:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:27.0:1773851873.331377:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:27.0:1773851873.331378:0:41182:0:(lu_object.c:224:lu_object_put()) Add 000000007e72d379/000000009c9aae14 to site lru. bkt: 000000005a7eb874
00000004:00000001:27.0:1773851873.331378:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:27.0:1773851873.331379:0:41182:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:27.0:1773851873.331379:0:41182:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:27.0:1773851873.331380:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:27.0:1773851873.331380:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331381:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331381:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:27.0:1773851873.331381:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:27.0:1773851873.331382:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006671799d with handle 0x21b6f08f07a6ad9a from hash
00010000:00000001:27.0:1773851873.331383:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:27.0:1773851873.331383:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331383:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331384:0:41182:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:27.0:1773851873.331384:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:27.0:1773851873.331385:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006671799d/0x21b6f08f07a6ad9a lrc: 0/0,0 mode: --/CR res: [0x2400276f1:0x9609:0x0].0x0 bits 0x2/0x0 rrc: 21 type: IBT gid 0 flags: 0x44000000000000 nid: 22818@kfi7 remote: 0xd739ae8d05ee0029 expref: 8 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331387:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 20
00010000:00000040:27.0:1773851873.331387:0:41182:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002d49eaeb : new locks_count 2
00000020:00000040:27.0:1773851873.331388:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002d49eaeb : new refcount 7
00010000:00000010:27.0:1773851873.331388:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000babd1210.
00010000:00000040:27.0:1773851873.331389:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e9131bbb count: 19
00010000:00000001:27.0:1773851873.331389:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:27.0:1773851873.331390:0:41182:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331391:0:41182:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:27.0:1773851873.331391:0:41182:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000000dcd0ca0/0x21b6f08f07a6adaf lrc: 3/0,0 mode: PR/PR res: [0x2400276f1:0x961f:0x0].0x0 bits 0x13/0x0 rrc: 20 type: IBT gid 0 flags: 0x40200000000000 nid: 22818@kfi7 remote: 0xd739ae8d05ee0029 expref: 7 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:27.0:1773851873.331394:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009d5e76b5 count: 19
00010000:00000001:27.0:1773851873.331394:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:27.0:1773851873.331394:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:27.0:1773851873.331395:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276f1:0x961f:0x0].0x0 (000000009d5e76b5)
00010000:00010000:27.0:1773851873.331396:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 13
00010000:00000001:27.0:1773851873.331396:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:27.0:1773851873.331397:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.331397:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:27.0:1773851873.331398:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:27.0:1773851873.331398:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:27.0:1773851873.331399:0:41182:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000dcd0ca0, rc 0)
00000020:00000001:27.0:1773851873.331400:0:41182:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851873.331400:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044159471, transno 0, xid 1859603522591552
00010000:00000001:27.0:1773851873.331401:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851873.331402:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000059547c5c x1859603522591552/t0(0) o101->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:154/0 lens 584/640 e 0 to 0 dl 1773852269 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832053561511644160'
00010000:00000001:27.0:1773851873.331405:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851873.331405:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851873.331406:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=106 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851873.331407:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851873.331407:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000033d23b05 refcount 3 to 22818@kfi7
00000100:00000001:27.0:1773851873.331408:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154720 : -107139310396896 : ffff9e8eaf765a20)
02000000:00000001:27.0:1773851873.331409:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851873.331409:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.331410:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851873.331410:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22819@kfi7
00000400:00000010:27.0:1773851873.331411:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f075750.
00000100:00000200:27.0:1773851873.331412:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859603522591552, offset 224
00000400:00000200:27.0:1773851873.331413:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22819@kfi7
00000400:00000200:27.0:1773851873.331414:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.331415:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 1
00000400:00000200:27.0:1773851873.331416:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000400:00000200:27.0:1773851873.331417:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 3
00000400:00000200:27.0:1773851873.331418:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22819@kfi7 local destination
00000400:00000200:27.0:1773851873.331419:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769439:8769439:1024:4294967295] 22819@kfi7 LPNI seq info [368542:368542:16:4294967295]
00000400:00000200:27.0:1773851873.331421:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000400:00000200:27.0:1773851873.331421:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22819@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.331423:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22819@kfi7(22819@kfi7:22819@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851873.331424:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 3
00000800:00000200:27.0:1773851873.331426:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851873.331427:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:27.0:1773851873.331431:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851873.331434:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 Using peer 22819@kfi7(0x456)
00000800:00000200:27.0:1773851873.331437:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000005690846: Posted send of 740 bytes to peer 0x456: rc=0
00000800:00000200:27.0:1773851873.331438:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851873.331440:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.331441:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000033d23b05 refcount 2 to 22818@kfi7
00010000:00000001:27.0:1773851873.331441:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851873.331442:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.331442:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851873.331443:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059547c5c x1859603522591552/t0(0) o101->1e88b751-b4e7-4eda-b881-bf76c8d02e53@22818@kfi7:154/0 lens 584/640 e 0 to 0 dl 1773852269 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-832053561511644160'
00000100:00100000:27.0:1773851873.331446:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059547c5c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:1e88b751-b4e7-4eda-b881-bf76c8d02e53+7:609371:x1859603522591552:12345-22818@kfi7:101:tuolumne-832053561511644160 Request processed in 510us (536us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851873.331448:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22818@kfi7, seq: 1451911033
00000100:00000040:27.0:1773851873.331449:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d49eaeb : new rpc_count 0
00000100:00000001:27.0:1773851873.331449:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851873.331449:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851873.331450:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851873.331450:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000022b22b54.
00000020:00000010:27.0:1773851873.331451:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000400:00000200:25.0:1773851873.331451:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851873.331452:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000400:00000200:25.0:1773851873.331452:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22819@kfi7: PUT: OK
00000400:00000200:25.0:1773851873.331452:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f075750
00000020:00000040:27.0:1773851873.331453:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002d49eaeb : new refcount 6
00000100:00000001:27.0:1773851873.331453:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851873.331453:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f075750.
00000100:00000001:25.0:1773851873.331453:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851873.331454:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851873.331454:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d69f6f30 nid 22819@kfi7 refs 2
00000800:00000200:25.0:1773851873.331456:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 22819@kfi7(0000000035c56b4f):0x0 lsk 1111 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x456 Transaction freed
00010000:00000010:27.1F:1773851873.335727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000007ba724bb.
00010000:00000010:27.1:1773851873.339727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000033430096.
00010000:00000010:27.1:1773851873.339728:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000655c2400.
00010000:00000010:27.1:1773851873.339729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d6646364.
00010000:00000010:27.1:1773851873.339729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006671799d.
00000800:00000200:22.0:1773851873.362088:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851873.362089:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851873.362090:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851873.362092:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851873.362094:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24002@kfi7 to cpt 5
00000400:00000200:22.0:1773851873.362096:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24002@kfi7 : PUT - for me
00000400:00000200:22.0:1773851873.362097:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24002@kfi7 to cpt 5
00000400:00000200:22.0:1773851873.362098:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 1
00000400:00000200:22.0:1773851873.362099:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24002@kfi7 to cpt 5
00000400:00000200:22.0:1773851873.362100:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 2
00000400:00000200:22.0:1773851873.362101:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 3
00000400:00000200:22.0:1773851873.362103:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23811@kfi7 to cpt 6
00000400:00000200:22.0:1773851873.362104:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23811@kfi7 of length 224 into portal 12 MB=0x69b4c00c41280
00000400:00000200:22.0:1773851873.362105:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23811@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 43400
00000800:00000200:22.0:1773851873.362107:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851873.362108:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851873.362109:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24002@kfi7: PUT: OK
00000100:00000001:22.0:1773851873.362110:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851873.362111:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851873.362111:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002585ab34.
00000100:00000040:22.0:1773851873.362112:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000002585ab34 x1859600592933504 msgsize 224
00000100:00100000:22.0:1773851873.362114:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-23811@kfi7 (source: 12345-24002@kfi7)
00000100:00000001:22.0:1773851873.362115:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851873.362115:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 2
00000100:00000001:20.0:1773851873.362116:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851873.362116:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851873.362117:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851873.362117:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851873.362117:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851873.362118:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851873.362119:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600592933504
00000020:00000001:20.0:1773851873.362120:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851873.362121:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d87663
00000020:00000001:20.0:1773851873.362121:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851873.362123:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b0f6fbaa refcount=5
00000020:00000001:20.0:1773851873.362124:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637154630024192 : -106919079527424 : ffff9ec1f63ebc00)
00000020:00000001:20.0:1773851873.362125:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637154630024192 : -106919079527424 : ffff9ec1f63ebc00)
00000100:00000001:20.0:1773851873.362126:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.362127:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851873.362128:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040bbe88b.
00000020:00000010:20.0:1773851873.362129:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.362129:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851873.362131:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851873.362131:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851873.362132:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.362134:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851873.362135:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851873.362136:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.362137:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.362139:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.362140:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.362140:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851873.362140:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851873.362142:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23811@kfi7, seq: 1997994
00000100:00000001:23.0:1773851873.362143:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.362143:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b0f6fbaa : new rpc_count 1
00000100:00000001:23.0:1773851873.362144:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.362144:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637070619634688 : -107003089916928 : ffff9eae66d5ec00)
00000100:00000040:20.0:1773851873.362146:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002585ab34 x1859600592933504/t0(0) o400->efdf0933-a9cb-46b4-9c24-ae6112e25c20@23811@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1991-0'
00000100:00000001:20.0:1773851873.362151:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.362152:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851873.362153:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002585ab34 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:efdf0933-a9cb-46b4-9c24-ae6112e25c20+5:39605:x1859600592933504:12345-23811@kfi7:400:default-tuolumne1991-0
00000100:00000200:20.0:1773851873.362156:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600592933504
00000020:00000001:20.0:1773851873.362157:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851873.362158:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851873.362159:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.362161:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851873.362162:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851873.362163:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851873.362164:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600592933504, found 0 last_xid 1859600592933503
00000020:00000001:20.0:1773851873.362165:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851873.362166:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851873.362167:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851873.362168:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.362169:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851873.362170:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851873.362171:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851873.362172:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e823e9ba.
02000000:00000001:20.0:1773851873.362173:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.362174:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.362175:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851873.362177:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014042118, transno 0, xid 1859600592933504
00010000:00000001:20.0:1773851873.362178:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851873.362179:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002585ab34 x1859600592933504/t0(0) o400->efdf0933-a9cb-46b4-9c24-ae6112e25c20@23811@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1991-0'
00010000:00000001:20.0:1773851873.362184:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851873.362185:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851873.362186:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=106 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851873.362188:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851873.362189:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd5e2d92 refcount 3 to 23811@kfi7
00000100:00000001:20.0:1773851873.362190:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299332352 : -107155410219264 : ffff9e8aefd68f00)
02000000:00000001:20.0:1773851873.362192:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851873.362192:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.362193:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851873.362195:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24002@kfi7
00000400:00000010:20.0:1773851873.362196:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e2f6c1a.
00000100:00000200:20.0:1773851873.362197:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600592933504, offset 224
00000400:00000200:20.0:1773851873.362199:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24002@kfi7
00000400:00000200:20.0:1773851873.362200:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24002@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.362202:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 1
00000400:00000200:20.0:1773851873.362204:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 2
00000400:00000200:20.0:1773851873.362206:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 3
00000400:00000200:20.0:1773851873.362208:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24002@kfi7 local destination
00000400:00000200:20.0:1773851873.362210:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769440:8769440:1024:4294967295] 24002@kfi7 LPNI seq info [276705:276705:16:4294967295]
00000400:00000200:20.0:1773851873.362213:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 2
00000400:00000200:20.0:1773851873.362214:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24002@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.362217:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24002@kfi7(24002@kfi7:24002@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851873.362220:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 3
00000800:00000200:20.0:1773851873.362222:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851873.362224:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851873.362228:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851873.362232:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000652 Using peer 24002@kfi7(0x100000000000652)
00000800:00000200:20.0:1773851873.362237:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0x100000000000652: rc=0
00000800:00000200:20.0:1773851873.362239:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000652 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851873.362242:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.362244:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd5e2d92 refcount 2 to 23811@kfi7
00010000:00000001:20.0:1773851873.362246:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851873.362246:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.362247:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851873.362249:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002585ab34 x1859600592933504/t0(0) o400->efdf0933-a9cb-46b4-9c24-ae6112e25c20@23811@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1991-0'
00000100:00100000:20.0:1773851873.362254:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002585ab34 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:efdf0933-a9cb-46b4-9c24-ae6112e25c20+5:39605:x1859600592933504:12345-23811@kfi7:400:default-tuolumne1991-0 Request processed in 101us (140us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851873.362257:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23811@kfi7, seq: 1997994
00000100:00000040:20.0:1773851873.362258:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b0f6fbaa : new rpc_count 0
00000100:00000001:20.0:1773851873.362260:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851873.362261:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851873.362262:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.362263:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851873.362265:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040bbe88b.
00000020:00000040:20.0:1773851873.362266:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b0f6fbaa : new refcount 4
00000100:00000001:20.0:1773851873.362267:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851873.362273:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000652 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851873.362274:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.362275:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24002@kfi7: PUT: OK
00000400:00000200:21.0:1773851873.362276:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e2f6c1a
00000400:00000010:21.0:1773851873.362276:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e2f6c1a.
00000100:00000001:21.0:1773851873.362277:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851873.362277:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851873.362278:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fd3dfce6 nid 24002@kfi7 refs 2
00000800:00000200:21.0:1773851873.362280:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 24002@kfi7(00000000df00ab43):0x0 lsk 1619 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000652 Transaction freed
00010000:00000001:2.0:1773851873.417730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417731:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851873.417731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851873.417732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851873.417733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851873.417734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851873.417735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851873.417736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851873.417737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851873.417738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851873.417742:0:937840:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851873.417742:0:937840:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851873.417743:0:937840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:26.0:1773851873.424985:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.424985:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851873.424986:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851873.424986:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851873.424987:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851873.424987:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851873.424988:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21138@kfi7(000000005261007c):0xc94 version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851873.424989:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851873.424990:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 Using peer 21138@kfi7(0xc94)
00000400:00000200:26.0:1773851873.424991:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21138@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.424992:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21138@kfi7 : PUT - for me
00000400:00000200:25.0:1773851873.424992:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21138@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.424993:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21138@kfi7 to cpt 6
00000800:00000200:25.0:1773851873.424993:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0xc94: rc=0
00000400:00000200:26.0:1773851873.424994:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004596af96 nid 21138@kfi7 refs 1
00000800:00000200:25.0:1773851873.424994:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851873.424995:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21138@kfi7 to cpt 6
00000400:00000200:26.0:1773851873.424996:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004596af96 nid 21138@kfi7 refs 2
00000400:00000200:26.0:1773851873.424997:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004596af96 nid 21138@kfi7 refs 3
00000400:00000200:26.0:1773851873.424998:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21139@kfi7 to cpt 1
00000400:00000200:26.0:1773851873.424998:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21139@kfi7 of length 224 into portal 12 MB=0x69b0a4e58d0c0
00000400:00000200:26.0:1773851873.424999:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21139@kfi7 of length 224/224 into md 0x16159c9699 [64] + 19864
00000800:00000200:26.0:1773851873.425001:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851873.425003:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851873.425004:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21138@kfi7: PUT: OK
00000100:00000001:26.0:1773851873.425005:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851873.425005:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851873.425006:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a66fb627.
00000100:00000040:26.0:1773851873.425007:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000a66fb627 x1859318426685632 msgsize 224
00000800:00000200:25.0:1773851873.425007:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851873.425008:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-21139@kfi7 (source: 12345-21138@kfi7)
00000100:00000001:26.0:1773851873.425009:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:25.0:1773851873.425009:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 Transaction freed
00000400:00000200:26.0:1773851873.425010:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004596af96 nid 21138@kfi7 refs 2
00000100:00000001:27.0:1773851873.425011:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851873.425011:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851873.425011:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851873.425012:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851873.425012:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851873.425013:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851873.425014:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318426685632
00000020:00000001:27.0:1773851873.425015:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851873.425015:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92706
00000020:00000001:27.0:1773851873.425016:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.425020:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047796293 refcount=6
00000020:00000001:27.0:1773851873.425020:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631283712 : -107123078267904 : ffff9e9276f8fc00)
00000020:00000001:27.0:1773851873.425021:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631283712 : -107123078267904 : ffff9e9276f8fc00)
00000100:00000001:27.0:1773851873.425022:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.425023:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851873.425024:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851873.425025:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851873.425026:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851873.425027:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851873.425027:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851873.425028:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.425029:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851873.425029:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851873.425030:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.425031:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.425032:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851873.425032:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851873.425033:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851873.425033:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851873.425034:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21139@kfi7, seq: 2025116
00000100:00000040:27.0:1773851873.425035:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047796293 : new rpc_count 1
00000100:00000001:26.0:1773851873.425035:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.425035:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.425036:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150714880 : -106980558836736 : ffff9eb3a5caec00)
00000100:00000040:27.0:1773851873.425037:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a66fb627 x1859318426685632/t0(0) o400->6b5abc2d-44a3-46f5-b859-f9ebd0f5ee39@21139@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1814-0'
00000100:00000001:27.0:1773851873.425040:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.425040:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851873.425041:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a66fb627 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6b5abc2d-44a3-46f5-b859-f9ebd0f5ee39+6:39630:x1859318426685632:12345-21139@kfi7:400:default-tuolumne1814-0
00000100:00000200:27.0:1773851873.425043:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318426685632
00000020:00000001:27.0:1773851873.425043:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851873.425044:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851873.425045:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.425046:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851873.425046:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851873.425047:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851873.425048:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318426685632, found 0 last_xid 1859318426685631
00000020:00000001:27.0:1773851873.425048:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851873.425049:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851873.425050:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851873.425050:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.425051:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851873.425052:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851873.425052:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851873.425053:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ccbcf69f.
02000000:00000001:27.0:1773851873.425054:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.425054:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.425055:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851873.425056:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183009885899, transno 0, xid 1859318426685632
00010000:00000001:27.0:1773851873.425056:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851873.425057:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a66fb627 x1859318426685632/t0(0) o400->6b5abc2d-44a3-46f5-b859-f9ebd0f5ee39@21139@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1814-0'
00010000:00000001:27.0:1773851873.425060:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851873.425060:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851873.425061:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=106 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851873.425062:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851873.425063:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000372cfabe refcount 3 to 21139@kfi7
00000100:00000001:27.0:1773851873.425063:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231611168 : -107130477940448 : ffff9e90bdeaf120)
02000000:00000001:27.0:1773851873.425064:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851873.425065:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.425066:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851873.425067:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21138@kfi7
00000400:00000010:27.0:1773851873.425067:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009801fd0c.
00000100:00000200:27.0:1773851873.425068:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318426685632, offset 224
00000400:00000200:27.0:1773851873.425069:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21138@kfi7
00000400:00000200:27.0:1773851873.425070:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21138@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.425071:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004596af96 nid 21138@kfi7 refs 1
00000400:00000200:27.0:1773851873.425072:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004596af96 nid 21138@kfi7 refs 2
00000400:00000200:27.0:1773851873.425074:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004596af96 nid 21138@kfi7 refs 3
00000400:00000200:27.0:1773851873.425075:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21138@kfi7 local destination
00000400:00000200:27.0:1773851873.425076:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769441:8769441:1024:4294967295] 21138@kfi7 LPNI seq info [316431:316431:16:4294967295]
00000400:00000200:27.0:1773851873.425078:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004596af96 nid 21138@kfi7 refs 2
00000400:00000200:27.0:1773851873.425078:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21138@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.425080:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21138@kfi7(21138@kfi7:21138@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851873.425082:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004596af96 nid 21138@kfi7 refs 3
00000800:00000200:27.0:1773851873.425083:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851873.425084:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851873.425086:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851873.425088:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 Using peer 21138@kfi7(0xc94)
00000800:00000200:27.0:1773851873.425091:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000005690846: Posted send of 324 bytes to peer 0xc94: rc=0
00000800:00000200:27.0:1773851873.425093:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851873.425095:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.425095:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000372cfabe refcount 2 to 21139@kfi7
00010000:00000001:27.0:1773851873.425096:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851873.425097:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.425097:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851873.425098:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a66fb627 x1859318426685632/t0(0) o400->6b5abc2d-44a3-46f5-b859-f9ebd0f5ee39@21139@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1814-0'
00000100:00100000:27.0:1773851873.425101:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a66fb627 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6b5abc2d-44a3-46f5-b859-f9ebd0f5ee39+6:39630:x1859318426685632:12345-21139@kfi7:400:default-tuolumne1814-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851873.425104:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21139@kfi7, seq: 2025116
00000800:00000200:25.0:1773851873.425104:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 TN_EVENT_TX_OK event status 0
00000100:00000040:27.0:1773851873.425105:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047796293 : new rpc_count 0
00000100:00000001:27.0:1773851873.425106:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851873.425106:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851873.425107:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851873.425107:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851873.425107:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21138@kfi7: PUT: OK
00000020:00000010:27.0:1773851873.425108:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000400:00000200:25.0:1773851873.425108:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009801fd0c
00000400:00000010:25.0:1773851873.425108:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009801fd0c.
00000020:00000010:27.0:1773851873.425109:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000100:00000001:25.0:1773851873.425109:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851873.425109:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:27.0:1773851873.425110:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000047796293 : new refcount 5
00000100:00000001:27.0:1773851873.425110:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851873.425110:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004596af96 nid 21138@kfi7 refs 2
00000800:00000200:25.0:1773851873.425112:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 21138@kfi7(000000005261007c):0x0 lsk 3221 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc94 Transaction freed
00000800:00000200:3.0:1773851873.467927:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851873.467928:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851873.467930:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851873.467931:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851873.467933:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19568@kfi7 to cpt 0
00000400:00000200:3.0:1773851873.467935:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19568@kfi7 : PUT - for me
00000400:00000200:3.0:1773851873.467936:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19568@kfi7 to cpt 0
00000400:00000200:3.0:1773851873.467936:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d34c0c68 nid 19568@kfi7 refs 1
00000400:00000200:3.0:1773851873.467937:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19568@kfi7 to cpt 0
00000400:00000200:3.0:1773851873.467938:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d34c0c68 nid 19568@kfi7 refs 2
00000400:00000200:3.0:1773851873.467938:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d34c0c68 nid 19568@kfi7 refs 3
00000400:00000200:3.0:1773851873.467939:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19568@kfi7 to cpt 0
00000400:00000200:3.0:1773851873.467940:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19568@kfi7 of length 224 into portal 12 MB=0x69b4b9085f0c0
00000400:00000200:3.0:1773851873.467941:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19568@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 32744
00000800:00000200:3.0:1773851873.467943:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851873.467944:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851873.467945:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19568@kfi7: PUT: OK
00000100:00000001:3.0:1773851873.467946:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851873.467946:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851873.467947:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f0303136.
00000100:00000040:3.0:1773851873.467948:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000f0303136 x1859598709813440 msgsize 224
00000100:00100000:3.0:1773851873.467949:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-19568@kfi7 (source: 12345-19568@kfi7)
00000100:00000001:3.0:1773851873.467950:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851873.467951:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d34c0c68 nid 19568@kfi7 refs 2
00000800:00000200:3.0:1773851873.467952:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851873.467952:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851873.467952:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851873.467953:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851873.467953:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851873.467954:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851873.467955:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598709813440
00000020:00000001:1.0:1773851873.467955:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851873.467956:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24d01805
00000020:00000001:1.0:1773851873.467957:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851873.467958:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f7d11cd1 refcount=5
00000020:00000001:1.0:1773851873.467959:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127642995712 : -106946066555904 : ffff9ebbadb15c00)
00000020:00000001:1.0:1773851873.467960:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127642995712 : -106946066555904 : ffff9ebbadb15c00)
00000100:00000001:1.0:1773851873.467961:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851873.467962:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851873.467963:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042b9c0ff.
00000020:00000010:1.0:1773851873.467964:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851873.467964:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ef8da19.
00000100:00000001:1.0:1773851873.467965:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851873.467966:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851873.467966:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851873.467967:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851873.467968:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851873.467968:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.467969:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851873.467971:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851873.467971:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851873.467971:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851873.467971:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851873.467972:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19568@kfi7, seq: 1997573
00000100:00000040:1.0:1773851873.467973:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f7d11cd1 : new rpc_count 1
00000100:00000001:0.0:1773851873.467973:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851873.467973:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.467974:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288726656 : -106964420824960 : ffff9eb767b17080)
00000100:00000040:1.0:1773851873.467975:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f0303136 x1859598709813440/t0(0) o400->18d57939-4e82-48b1-ac2b-5650acfdc673@19568@kfi7:513/0 lens 224/0 e 0 to 0 dl 1773852628 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1710-0'
00000100:00000001:1.0:1773851873.467978:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851873.467978:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851873.467979:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0303136 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:18d57939-4e82-48b1-ac2b-5650acfdc673+5:39590:x1859598709813440:12345-19568@kfi7:400:default-tuolumne1710-0
00000100:00000200:1.0:1773851873.467980:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598709813440
00000020:00000001:1.0:1773851873.467981:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851873.467981:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851873.467982:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.467983:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851873.467983:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851873.467984:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851873.467985:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598709813440, found 0 last_xid 1859598709813439
00000020:00000001:1.0:1773851873.467985:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851873.467986:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851873.467986:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851873.467987:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.467988:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851873.467988:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851873.467989:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851873.467989:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006845cb2c.
02000000:00000001:1.0:1773851873.467990:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.467990:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.467991:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851873.467992:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096687367, transno 0, xid 1859598709813440
00010000:00000001:1.0:1773851873.467993:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851873.467993:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f0303136 x1859598709813440/t0(0) o400->18d57939-4e82-48b1-ac2b-5650acfdc673@19568@kfi7:513/0 lens 224/224 e 0 to 0 dl 1773852628 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1710-0'
00010000:00000001:1.0:1773851873.467996:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851873.467996:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851873.467997:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=106 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851873.467999:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851873.468000:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000075709b9c refcount 3 to 19568@kfi7
00000100:00000001:1.0:1773851873.468000:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051200 : -107154804500416 : ffff9e8b13f11840)
02000000:00000001:1.0:1773851873.468001:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851873.468002:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.468002:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851873.468003:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19568@kfi7
00000400:00000010:1.0:1773851873.468004:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003ac07cf1.
00000100:00000200:1.0:1773851873.468005:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598709813440, offset 224
00000400:00000200:1.0:1773851873.468006:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19568@kfi7
00000400:00000200:1.0:1773851873.468007:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19568@kfi7 to cpt 0
00000400:00000200:1.0:1773851873.468007:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d34c0c68 nid 19568@kfi7 refs 1
00000400:00000200:1.0:1773851873.468008:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d34c0c68 nid 19568@kfi7 refs 2
00000400:00000200:1.0:1773851873.468009:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d34c0c68 nid 19568@kfi7 refs 3
00000400:00000200:1.0:1773851873.468010:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19568@kfi7 local destination
00000400:00000200:1.0:1773851873.468012:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769442:8769442:1024:4294967295] 19568@kfi7 LPNI seq info [10606817:10606817:16:4294967295]
00000400:00000200:1.0:1773851873.468013:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d34c0c68 nid 19568@kfi7 refs 2
00000400:00000200:1.0:1773851873.468014:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19568@kfi7 to cpt 0
00000400:00000200:1.0:1773851873.468016:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19568@kfi7(19568@kfi7:19568@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851873.468017:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d34c0c68 nid 19568@kfi7 refs 3
00000800:00000200:1.0:1773851873.468019:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851873.468020:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851873.468022:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851873.468024:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e8 Using peer 19568@kfi7(0x7e8)
00000800:00000200:1.0:1773851873.468027:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 324 bytes to peer 0x7e8: rc=0
00000800:00000200:1.0:1773851873.468028:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851873.468030:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851873.468032:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000075709b9c refcount 2 to 19568@kfi7
00010000:00000001:1.0:1773851873.468032:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851873.468033:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.468033:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851873.468034:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f0303136 x1859598709813440/t0(0) o400->18d57939-4e82-48b1-ac2b-5650acfdc673@19568@kfi7:513/0 lens 224/224 e 0 to 0 dl 1773852628 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1710-0'
00000100:00100000:1.0:1773851873.468037:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0303136 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:18d57939-4e82-48b1-ac2b-5650acfdc673+5:39590:x1859598709813440:12345-19568@kfi7:400:default-tuolumne1710-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851873.468039:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19568@kfi7, seq: 1997573
00000100:00000040:1.0:1773851873.468040:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f7d11cd1 : new rpc_count 0
00000800:00000200:2.0:1773851873.468041:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e8 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851873.468041:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851873.468041:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851873.468042:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851873.468042:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851873.468042:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ef8da19.
00000020:00000010:1.0:1773851873.468043:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042b9c0ff.
00000400:00000200:2.0:1773851873.468044:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19568@kfi7: PUT: OK
00000400:00000200:2.0:1773851873.468044:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003ac07cf1
00000020:00000040:1.0:1773851873.468044:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000f7d11cd1 : new refcount 4
00000100:00000001:1.0:1773851873.468044:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:2.0:1773851873.468045:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003ac07cf1.
00000100:00000001:2.0:1773851873.468046:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851873.468046:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851873.468047:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d34c0c68 nid 19568@kfi7 refs 2
00000800:00000200:2.0:1773851873.468049:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 19568@kfi7(00000000cfd75330):0x0 lsk 2025 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x7e8 Transaction freed
00000800:00000200:25.0:1773851873.469181:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.469182:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851873.469184:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851873.469186:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851873.469188:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9632@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.469189:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9632@kfi7 : PUT - for me
00000400:00000200:25.0:1773851873.469190:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9632@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.469191:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097afc91b nid 9632@kfi7 refs 1
00000400:00000200:25.0:1773851873.469192:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9632@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.469193:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097afc91b nid 9632@kfi7 refs 2
00000400:00000200:25.0:1773851873.469194:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000097afc91b nid 9632@kfi7 refs 3
00000400:00000200:25.0:1773851873.469194:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9568@kfi7 to cpt 3
00000400:00000200:25.0:1773851873.469196:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9568@kfi7 of length 224 into portal 12 MB=0x69aa079dab200
00000400:00000200:25.0:1773851873.469197:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9568@kfi7 of length 224/224 into md 0x16159c9699 [64] + 20088
00000800:00000200:25.0:1773851873.469201:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851873.469203:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851873.469204:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9632@kfi7: PUT: OK
00000100:00000001:25.0:1773851873.469206:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851873.469206:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851873.469208:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed150f3b.
00000100:00000040:25.0:1773851873.469209:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ed150f3b x1858863890084352 msgsize 224
00000100:00100000:25.0:1773851873.469210:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9568@kfi7 (source: 12345-9632@kfi7)
00000100:00000001:25.0:1773851873.469211:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851873.469212:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000097afc91b nid 9632@kfi7 refs 2
00000100:00000001:27.0:1773851873.469213:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851873.469213:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851873.469214:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851873.469214:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851873.469214:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851873.469215:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851873.469216:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890084352
00000020:00000001:27.0:1773851873.469216:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851873.469217:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917ee
00000020:00000001:27.0:1773851873.469217:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.469220:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a3050dd3 refcount=6
00000020:00000001:27.0:1773851873.469221:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241740288 : -107152467811328 : ffff9e8b9f382400)
00000020:00000001:27.0:1773851873.469222:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241740288 : -107152467811328 : ffff9e8b9f382400)
00000100:00000001:27.0:1773851873.469223:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.469224:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851873.469224:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851873.469226:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851873.469226:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851873.469227:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851873.469228:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851873.469228:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.469229:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851873.469230:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851873.469230:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.469231:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.469232:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851873.469233:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851873.469233:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851873.469234:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9568@kfi7, seq: 2025117
00000100:00000040:27.0:1773851873.469234:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a3050dd3 : new rpc_count 1
00000100:00000001:26.0:1773851873.469234:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851873.469235:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124127583232 : -106949581968384 : ffff9ebadc286c00)
00000100:00000001:26.0:1773851873.469235:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851873.469236:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.469237:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed150f3b x1858863890084352/t0(0) o400->6d8791f4-d70e-4569-9f13-14d2c8fb0b08@9568@kfi7:90/0 lens 224/0 e 0 to 0 dl 1773852205 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1088-0'
00000100:00000001:27.0:1773851873.469240:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.469240:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851873.469241:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed150f3b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6d8791f4-d70e-4569-9f13-14d2c8fb0b08+6:38975:x1858863890084352:12345-9568@kfi7:400:default-tuolumne1088-0
00000100:00000200:27.0:1773851873.469242:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890084352
00000020:00000001:27.0:1773851873.469243:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851873.469244:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851873.469244:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.469245:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851873.469245:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851873.469246:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851873.469247:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890084352, found 0 last_xid 1858863890084351
00000020:00000001:27.0:1773851873.469248:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851873.469248:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851873.469249:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851873.469249:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.469250:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851873.469251:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851873.469251:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851873.469252:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000984b61e7.
02000000:00000001:27.0:1773851873.469252:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.469253:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.469254:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851873.469254:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475273097, transno 0, xid 1858863890084352
00010000:00000001:27.0:1773851873.469255:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851873.469256:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed150f3b x1858863890084352/t0(0) o400->6d8791f4-d70e-4569-9f13-14d2c8fb0b08@9568@kfi7:90/0 lens 224/224 e 0 to 0 dl 1773852205 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1088-0'
00010000:00000001:27.0:1773851873.469258:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851873.469259:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851873.469260:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=106 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851873.469261:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851873.469262:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000655d5960 refcount 3 to 9568@kfi7
00000100:00000001:27.0:1773851873.469263:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153664 : -107139310397952 : ffff9e8eaf765600)
02000000:00000001:27.0:1773851873.469263:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851873.469264:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.469265:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851873.469266:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9632@kfi7
00000400:00000010:27.0:1773851873.469266:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003ce2d312.
00000100:00000200:27.0:1773851873.469267:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890084352, offset 224
00000400:00000200:27.0:1773851873.469268:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9632@kfi7
00000400:00000200:27.0:1773851873.469269:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9632@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.469270:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097afc91b nid 9632@kfi7 refs 1
00000400:00000200:27.0:1773851873.469271:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000097afc91b nid 9632@kfi7 refs 2
00000400:00000200:27.0:1773851873.469272:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000097afc91b nid 9632@kfi7 refs 3
00000400:00000200:27.0:1773851873.469273:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9632@kfi7 local destination
00000400:00000200:27.0:1773851873.469275:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769443:8769443:1024:4294967295] 9632@kfi7 LPNI seq info [17532:17532:16:4294967295]
00000400:00000200:27.0:1773851873.469276:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000097afc91b nid 9632@kfi7 refs 2
00000400:00000200:27.0:1773851873.469277:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9632@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.469279:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9632@kfi7(9632@kfi7:9632@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851873.469280:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000097afc91b nid 9632@kfi7 refs 3
00000800:00000200:27.0:1773851873.469282:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851873.469283:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851873.469285:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851873.469287:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000122 Using peer 9632@kfi7(0x100000000000122)
00000800:00000200:27.0:1773851873.469290:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x100000000000122: rc=0
00000800:00000200:27.0:1773851873.469292:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000122 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851873.469294:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.469295:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000655d5960 refcount 2 to 9568@kfi7
00010000:00000001:27.0:1773851873.469296:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851873.469297:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.469297:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851873.469298:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed150f3b x1858863890084352/t0(0) o400->6d8791f4-d70e-4569-9f13-14d2c8fb0b08@9568@kfi7:90/0 lens 224/224 e 0 to 0 dl 1773852205 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1088-0'
00000100:00100000:27.0:1773851873.469301:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed150f3b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6d8791f4-d70e-4569-9f13-14d2c8fb0b08+6:38975:x1858863890084352:12345-9568@kfi7:400:default-tuolumne1088-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851873.469303:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9568@kfi7, seq: 2025117
00000100:00000040:27.0:1773851873.469304:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a3050dd3 : new rpc_count 0
00000800:00000200:25.0:1773851873.469304:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000122 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851873.469305:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851873.469305:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851873.469305:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851873.469306:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851873.469306:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9632@kfi7: PUT: OK
00000020:00000010:27.0:1773851873.469307:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000020:00000010:27.0:1773851873.469307:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000400:00000200:25.0:1773851873.469307:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003ce2d312
00000400:00000010:25.0:1773851873.469307:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003ce2d312.
00000020:00000040:27.0:1773851873.469308:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000a3050dd3 : new refcount 5
00000100:00000001:25.0:1773851873.469308:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851873.469309:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851873.469309:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851873.469309:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000097afc91b nid 9632@kfi7 refs 2
00000800:00000200:25.0:1773851873.469311:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 9632@kfi7(000000001232fb72):0x0 lsk 291 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000122 Transaction freed
00000800:00000200:3.0:1773851873.512136:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851873.512138:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851873.512141:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851873.512144:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851873.512147:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20178@kfi7 to cpt 0
00000400:00000200:3.0:1773851873.512149:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20178@kfi7 : PUT - for me
00000400:00000200:3.0:1773851873.512151:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20178@kfi7 to cpt 0
00000400:00000200:3.0:1773851873.512152:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4d47b16 nid 20178@kfi7 refs 1
00000400:00000200:3.0:1773851873.512153:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20178@kfi7 to cpt 0
00000400:00000200:3.0:1773851873.512154:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4d47b16 nid 20178@kfi7 refs 2
00000400:00000200:3.0:1773851873.512156:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c4d47b16 nid 20178@kfi7 refs 3
00000400:00000200:3.0:1773851873.512157:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19986@kfi7 to cpt 5
00000400:00000200:3.0:1773851873.512158:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19986@kfi7 of length 224 into portal 12 MB=0x699e14ebe5740
00000400:00000200:3.0:1773851873.512160:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19986@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 32968
00000800:00000200:3.0:1773851873.512163:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851873.512166:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851873.512167:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20178@kfi7: PUT: OK
00000100:00000001:3.0:1773851873.512168:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851873.512169:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851873.512170:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa297cb8.
00000100:00000040:3.0:1773851873.512171:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000aa297cb8 x1858042828052288 msgsize 224
00000100:00100000:3.0:1773851873.512173:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-19986@kfi7 (source: 12345-20178@kfi7)
00000100:00000001:3.0:1773851873.512175:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851873.512176:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4d47b16 nid 20178@kfi7 refs 2
00000800:00000200:3.0:1773851873.512178:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851873.512178:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851873.512178:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851873.512179:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851873.512180:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851873.512181:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851873.512182:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042828052288
00000020:00000001:1.0:1773851873.512183:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851873.512184:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91126
00000020:00000001:1.0:1773851873.512185:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851873.512187:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8307db3 refcount=6
00000020:00000001:1.0:1773851873.512189:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240341504 : -107152469210112 : ffff9e8b9f22cc00)
00000020:00000001:1.0:1773851873.512190:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240341504 : -107152469210112 : ffff9e8b9f22cc00)
00000100:00000001:1.0:1773851873.512191:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851873.512192:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851873.512193:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042b9c0ff.
00000020:00000010:1.0:1773851873.512195:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851873.512197:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ef8da19.
00000100:00000001:1.0:1773851873.512198:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851873.512199:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851873.512200:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851873.512201:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851873.512202:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851873.512203:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.512205:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851873.512207:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851873.512207:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851873.512207:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851873.512208:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851873.512209:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19986@kfi7, seq: 1997574
00000100:00000040:1.0:1773851873.512210:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8307db3 : new rpc_count 1
00000100:00000001:0.0:1773851873.512210:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.512211:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288723200 : -106964420828416 : ffff9eb767b16300)
00000100:00000001:0.0:1773851873.512211:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851873.512213:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa297cb8 x1858042828052288/t0(0) o400->4129c660-281c-4efe-b45f-2bc3faacb9e9@19986@kfi7:513/0 lens 224/0 e 0 to 0 dl 1773852628 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1749-0'
00000100:00000001:1.0:1773851873.512218:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851873.512218:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851873.512220:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa297cb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4129c660-281c-4efe-b45f-2bc3faacb9e9+6:39645:x1858042828052288:12345-19986@kfi7:400:default-tuolumne1749-0
00000100:00000200:1.0:1773851873.512222:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042828052288
00000020:00000001:1.0:1773851873.512223:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851873.512224:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851873.512225:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.512226:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851873.512227:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851873.512228:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851873.512229:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042828052288, found 0 last_xid 1858042828052287
00000020:00000001:1.0:1773851873.512230:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851873.512232:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851873.512232:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851873.512233:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.512234:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851873.512235:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851873.512236:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851873.512238:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001a2c18f4.
02000000:00000001:1.0:1773851873.512239:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.512240:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.512241:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851873.512242:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695039, transno 0, xid 1858042828052288
00010000:00000001:1.0:1773851873.512243:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851873.512244:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa297cb8 x1858042828052288/t0(0) o400->4129c660-281c-4efe-b45f-2bc3faacb9e9@19986@kfi7:513/0 lens 224/224 e 0 to 0 dl 1773852628 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1749-0'
00010000:00000001:1.0:1773851873.512249:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851873.512250:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851873.512251:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=106 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851873.512253:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851873.512254:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000afd74c07 refcount 3 to 19986@kfi7
00000100:00000001:1.0:1773851873.512255:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999949120 : -107156709602496 : ffff9e8aa2638b40)
02000000:00000001:1.0:1773851873.512256:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851873.512257:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851873.512258:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851873.512259:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20178@kfi7
00000400:00000010:1.0:1773851873.512260:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c993eaa.
00000100:00000200:1.0:1773851873.512261:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042828052288, offset 224
00000400:00000200:1.0:1773851873.512264:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20178@kfi7
00000400:00000200:1.0:1773851873.512265:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20178@kfi7 to cpt 0
00000400:00000200:1.0:1773851873.512266:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4d47b16 nid 20178@kfi7 refs 1
00000400:00000200:1.0:1773851873.512268:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c4d47b16 nid 20178@kfi7 refs 2
00000400:00000200:1.0:1773851873.512270:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c4d47b16 nid 20178@kfi7 refs 3
00000400:00000200:1.0:1773851873.512272:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20178@kfi7 local destination
00000400:00000200:1.0:1773851873.512274:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769444:8769444:1024:4294967295] 20178@kfi7 LPNI seq info [19983264:19983264:16:4294967295]
00000400:00000200:1.0:1773851873.512276:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c4d47b16 nid 20178@kfi7 refs 2
00000400:00000200:1.0:1773851873.512278:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20178@kfi7 to cpt 0
00000400:00000200:1.0:1773851873.512281:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20178@kfi7(20178@kfi7:20178@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851873.512283:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c4d47b16 nid 20178@kfi7 refs 3
00000800:00000200:1.0:1773851873.512285:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851873.512290:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851873.512293:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851873.512297:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000adb Using peer 20178@kfi7(0x100000000000adb)
00000800:00000200:1.0:1773851873.512302:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0x100000000000adb: rc=0
00000800:00000200:1.0:1773851873.512305:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000adb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851873.512308:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851873.512309:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000afd74c07 refcount 2 to 19986@kfi7
00010000:00000001:1.0:1773851873.512311:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851873.512311:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851873.512313:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851873.512314:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa297cb8 x1858042828052288/t0(0) o400->4129c660-281c-4efe-b45f-2bc3faacb9e9@19986@kfi7:513/0 lens 224/224 e 0 to 0 dl 1773852628 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1749-0'
00000100:00100000:1.0:1773851873.512320:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa297cb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4129c660-281c-4efe-b45f-2bc3faacb9e9+6:39645:x1858042828052288:12345-19986@kfi7:400:default-tuolumne1749-0 Request processed in 101us (147us total) trans 0 rc 0/0
00000800:00000200:3.0:1773851873.512322:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000adb TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851873.512324:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19986@kfi7, seq: 1997574
00000400:00000200:3.0:1773851873.512325:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:1.0:1773851873.512326:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8307db3 : new rpc_count 0
00000400:00000200:3.0:1773851873.512327:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20178@kfi7: PUT: OK
00000100:00000001:1.0:1773851873.512327:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:3.0:1773851873.512328:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c993eaa
00000100:00000001:1.0:1773851873.512328:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851873.512329:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000010:3.0:1773851873.512330:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c993eaa.
00000020:00000010:1.0:1773851873.512330:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ef8da19.
00000100:00000001:3.0:1773851873.512331:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851873.512332:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851873.512332:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042b9c0ff.
00000400:00000200:3.0:1773851873.512333:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4d47b16 nid 20178@kfi7 refs 2
00000020:00000040:1.0:1773851873.512333:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000c8307db3 : new refcount 5
00000100:00000001:1.0:1773851873.512334:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851873.512336:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 20178@kfi7(00000000779df48c):0x0 lsk 2780 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000adb Transaction freed
00000800:00000200:13.0:1773851873.592115:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851873.592116:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851873.592118:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851873.592122:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851873.592125:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23043@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.592127:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23043@kfi7 : PUT - for me
00000400:00000200:13.0:1773851873.592129:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23043@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.592130:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3ec7892 nid 23043@kfi7 refs 1
00000400:00000200:13.0:1773851873.592132:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23043@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.592133:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3ec7892 nid 23043@kfi7 refs 2
00000400:00000200:13.0:1773851873.592135:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c3ec7892 nid 23043@kfi7 refs 3
00000400:00000200:13.0:1773851873.592136:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23043@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.592138:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23043@kfi7 of length 224 into portal 12 MB=0x69b0a33675100
00000400:00000200:13.0:1773851873.592141:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23043@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 35272
00000800:00000200:13.0:1773851873.592144:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851873.592146:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851873.592148:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23043@kfi7: PUT: OK
00000100:00000001:13.0:1773851873.592149:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851873.592150:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851873.592153:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c9282f1.
00000100:00000040:13.0:1773851873.592154:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000004c9282f1 x1859317974651136 msgsize 224
00000100:00100000:13.0:1773851873.592156:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-23043@kfi7 (source: 12345-23043@kfi7)
00000100:00000001:13.0:1773851873.592158:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851873.592159:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3ec7892 nid 23043@kfi7 refs 2
00000100:00000001:15.0:1773851873.592160:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851873.592161:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851873.592161:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851873.592162:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851873.592163:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851873.592164:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851873.592165:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317974651136
00000020:00000001:15.0:1773851873.592166:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851873.592167:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ae8
00000020:00000001:15.0:1773851873.592169:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851873.592173:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000dc30f7e refcount=6
00000020:00000001:15.0:1773851873.592174:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743690240 : -107128965861376 : ffff9e91180b7000)
00000020:00000001:15.0:1773851873.592175:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743690240 : -107128965861376 : ffff9e91180b7000)
00000100:00000001:15.0:1773851873.592177:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851873.592178:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851873.592179:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebe397c.
00000020:00000010:15.0:1773851873.592181:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851873.592182:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851873.592183:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851873.592184:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851873.592185:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851873.592186:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851873.592187:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851873.592188:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.592189:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851873.592191:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851873.592192:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851873.592192:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851873.592192:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851873.592194:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23043@kfi7, seq: 2289856
00000100:00000040:15.0:1773851873.592195:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000dc30f7e : new rpc_count 1
00000100:00000001:12.0:1773851873.592195:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.592196:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970990464 : -107043738561152 : ffff9ea4effcd580)
00000100:00000001:12.0:1773851873.592196:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851873.592198:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004c9282f1 x1859317974651136/t0(0) o400->8c95f6ac-ce73-472a-a401-cc7e0e26c927@23043@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1943-0'
00000100:00000001:15.0:1773851873.592203:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851873.592203:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851873.592205:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c9282f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8c95f6ac-ce73-472a-a401-cc7e0e26c927+6:39477:x1859317974651136:12345-23043@kfi7:400:default-tuolumne1943-0
00000100:00000200:15.0:1773851873.592207:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317974651136
00000020:00000001:15.0:1773851873.592208:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851873.592209:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851873.592210:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.592211:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851873.592212:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851873.592214:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851873.592215:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317974651136, found 0 last_xid 1859317974651135
00000020:00000001:15.0:1773851873.592216:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851873.592217:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851873.592218:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851873.592218:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.592220:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851873.592221:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851873.592221:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851873.592223:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008517c699.
02000000:00000001:15.0:1773851873.592224:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.592225:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.592226:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851873.592227:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182426470833, transno 0, xid 1859317974651136
00010000:00000001:15.0:1773851873.592228:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851873.592230:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004c9282f1 x1859317974651136/t0(0) o400->8c95f6ac-ce73-472a-a401-cc7e0e26c927@23043@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1943-0'
00010000:00000001:15.0:1773851873.592234:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851873.592235:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851873.592236:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=106 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851873.592238:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851873.592239:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000092645b78 refcount 3 to 23043@kfi7
00000100:00000001:15.0:1773851873.592240:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149152 : -107154898402464 : ffff9e8b0e584360)
02000000:00000001:15.0:1773851873.592242:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851873.592242:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.592244:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851873.592245:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23043@kfi7
00000400:00000010:15.0:1773851873.592246:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000db81fd34.
00000100:00000200:15.0:1773851873.592247:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317974651136, offset 224
00000400:00000200:15.0:1773851873.592250:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23043@kfi7
00000400:00000200:15.0:1773851873.592251:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23043@kfi7 to cpt 3
00000400:00000200:15.0:1773851873.592253:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3ec7892 nid 23043@kfi7 refs 1
00000400:00000200:15.0:1773851873.592254:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c3ec7892 nid 23043@kfi7 refs 2
00000400:00000200:15.0:1773851873.592256:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c3ec7892 nid 23043@kfi7 refs 3
00000400:00000200:15.0:1773851873.592259:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23043@kfi7 local destination
00000400:00000200:15.0:1773851873.592262:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769445:8769445:1024:4294967295] 23043@kfi7 LPNI seq info [3977853:3977853:16:4294967295]
00000400:00000200:15.0:1773851873.592264:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c3ec7892 nid 23043@kfi7 refs 2
00000400:00000200:15.0:1773851873.592265:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23043@kfi7 to cpt 3
00000400:00000200:15.0:1773851873.592269:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23043@kfi7(23043@kfi7:23043@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851873.592271:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c3ec7892 nid 23043@kfi7 refs 3
00000800:00000200:15.0:1773851873.592273:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851873.592275:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851873.592278:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851873.592282:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006c6 Using peer 23043@kfi7(0x1000000000006c6)
00000800:00000200:15.0:1773851873.592287:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x1000000000006c6: rc=0
00000800:00000200:15.0:1773851873.592289:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851873.592292:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851873.592294:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000092645b78 refcount 2 to 23043@kfi7
00010000:00000001:15.0:1773851873.592295:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851873.592296:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.592297:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851873.592298:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c9282f1 x1859317974651136/t0(0) o400->8c95f6ac-ce73-472a-a401-cc7e0e26c927@23043@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1943-0'
00000100:00100000:15.0:1773851873.592303:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c9282f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8c95f6ac-ce73-472a-a401-cc7e0e26c927+6:39477:x1859317974651136:12345-23043@kfi7:400:default-tuolumne1943-0 Request processed in 99us (148us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851873.592304:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006c6 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851873.592307:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23043@kfi7, seq: 2289856
00000400:00000200:13.0:1773851873.592307:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:15.0:1773851873.592308:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000dc30f7e : new rpc_count 0
00000100:00000001:15.0:1773851873.592309:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851873.592309:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23043@kfi7: PUT: OK
00000100:00000001:15.0:1773851873.592310:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851873.592310:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000db81fd34
00000400:00000010:13.0:1773851873.592311:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000db81fd34.
00000020:00000010:15.0:1773851873.592312:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000100:00000001:13.0:1773851873.592312:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851873.592313:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000100:00000001:13.0:1773851873.592313:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851873.592314:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3ec7892 nid 23043@kfi7 refs 2
00000020:00000010:15.0:1773851873.592315:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebe397c.
00000020:00000040:15.0:1773851873.592316:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000000dc30f7e : new refcount 5
00000800:00000200:13.0:1773851873.592316:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 23043@kfi7(00000000f8c82763):0x0 lsk 1735 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000006c6 Transaction freed
00000100:00000001:15.0:1773851873.592317:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851873.609734:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851873.609735:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:25.0:1773851873.609735:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:25.0:1773851873.609736:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851873.609737:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db2f56d6.
00000100:00000010:25.0:1773851873.609737:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000493d4652.
00000020:00000040:29.0:1773851873.609739:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000020:00000040:25.0:1773851873.609739:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000100:00000001:29.0:1773851873.609741:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:25.0:1773851873.609741:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851873.609742:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:25.0:1773851873.609742:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851873.609743:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851873.609744:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851873.609746:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
02000000:00000010:25.0:1773851873.609746:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000027c5b29c.
00000100:00000001:29.0:1773851873.609748:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851873.609748:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851873.609749:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851873.609751:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851873.609752:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851873.609752:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851873.609754:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000db2f56d6] to pc [ptlrpcd_07_00+0]  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851873.609755:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000493d4652] to pc [ptlrpcd_06_01+1]  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851873.609762:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:29.0:1773851873.609763:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bd527d7e.
00080000:00000001:25.0:1773851873.609763:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851873.609764:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851873.609764:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:29.0:1773851873.609765:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637116724224000 : -106956985327616 : ffff9eb922e22000)
00000100:00000001:28.0:1773851873.609765:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851873.609765:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851873.609765:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:25.0:1773851873.609765:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004a748a1f.
00000100:00000001:30.0:1773851873.609766:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851873.609766:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:27.0:1773851873.609766:0:41085:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851873.609766:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851873.609766:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637058019561472 : -107015689990144 : ffff9eab77d01000)
00000100:00000001:28.0:1773851873.609767:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:27.0:1773851873.609767:0:41085:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851873.609768:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851873.609768:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:25.0:1773851873.609768:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:27.0:1773851873.609769:0:41085:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:29.0:1773851873.609770:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00080000:00000001:25.0:1773851873.609770:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:29.0:1773851873.609771:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000bbb063db.
00000004:00001000:25.0:1773851873.609771:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000004:00080000:29.0:1773851873.609773:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614148063048278ns, next at 614149063046225ns, rc = 0
00000004:00000010:25.0:1773851873.609773:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f79ac8ce.
00000100:00000001:28.0:1773851873.609774:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:29.0:1773851873.609775:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:28.0:1773851873.609775:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.609775:0:41085:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:25.0:1773851873.609775:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614148063050052ns, next at 614149063048008ns, rc = 0
00080000:00000001:29.0:1773851873.609776:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.609776:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:27.0:1773851873.609776:0:41085:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851873.609777:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.609777:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851873.609777:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:27.0:1773851873.609778:0:41085:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:25.0:1773851873.609778:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851873.609779:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db2f56d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051930816:2090@kfi7:13:default-yuba2-0
02000000:00000001:27.0:1773851873.609779:0:41085:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851873.609780:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851873.609781:0:41085:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000493d4652 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_01:lustre5-MDT0001-mdtlov_UUID:41085:1859433051930880:2068@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851873.609782:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851873.609783:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:27.0:1773851873.609783:0:41085:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851873.609784:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.609785:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:27.0:1773851873.609785:0:41085:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:28.0:1773851873.609786:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000711cbf99.
02000000:00000001:27.0:1773851873.609786:0:41085:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.609787:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851873.609787:0:41085:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:27.0:1773851873.609788:0:41085:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f99dfdf6.
00000400:00000200:28.0:1773851873.609789:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
02000000:00000001:27.0:1773851873.609790:0:41085:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:28.0:1773851873.609791:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000010:28.0:1773851873.609792:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fbb7163e.
00000400:00000200:27.0:1773851873.609792:0:41085:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000010:27.0:1773851873.609794:0:41085:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000052625ffc.
00000100:00000200:28.0:1773851873.609795:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930816, portal 4
00000400:00000010:27.0:1773851873.609795:0:41085:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001c61fb44.
00000100:00000001:28.0:1773851873.609796:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851873.609797:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637085309679104 : -106988399872512 : ffff9eb1d26e3600)
00000100:00000200:27.0:1773851873.609797:0:41085:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930880, portal 4
00000100:00000040:28.0:1773851873.609799:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851873.609799:0:41085:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:27.0:1773851873.609800:0:41085:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637124127570560 : -106949581981056 : ffff9ebadc283a80)
00000100:00000040:27.0:1773851873.609802:0:41085:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851873.609804:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851873.609806:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:28.0:1773851873.609807:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000063d86a5d.
00000100:00000001:27.0:1773851873.609807:0:41085:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:28.0:1773851873.609808:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930816, offset 0
00000100:00000040:27.0:1773851873.609809:0:41085:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:27.0:1773851873.609810:0:41085:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da133026.
00000400:00000200:28.0:1773851873.609811:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000100:00000200:27.0:1773851873.609811:0:41085:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930880, offset 0
00000400:00000200:28.0:1773851873.609813:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851873.609814:0:41085:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:28.0:1773851873.609815:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:28.0:1773851873.609816:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851873.609816:0:41085:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:27.0:1773851873.609817:0:41085:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:28.0:1773851873.609819:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:27.0:1773851873.609819:0:41085:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:28.0:1773851873.609821:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000200:27.0:1773851873.609821:0:41085:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:27.0:1773851873.609823:0:41085:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:28.0:1773851873.609824:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769442, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769445, p:4294967295, g:4294967295, h:1000]
00000400:00000200:27.0:1773851873.609827:0:41085:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769442, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769445, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851873.609828:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851873.609829:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851873.609831:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:27.0:1773851873.609831:0:41085:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851873.609833:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769446:8769446:1024:4294967295] 2090@kfi7 LPNI seq info [5404251:5404251:16:4294967295]
00000400:00000200:27.0:1773851873.609833:0:41085:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:27.0:1773851873.609835:0:41085:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:28.0:1773851873.609836:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851873.609837:0:41085:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769447:8769447:1024:4294967295] 2068@kfi7 LPNI seq info [5403699:5403699:16:4294967295]
00000400:00000200:28.0:1773851873.609838:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851873.609840:0:41085:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:27.0:1773851873.609841:0:41085:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:28.0:1773851873.609843:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851873.609845:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:27.0:1773851873.609846:0:41085:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851873.609848:0:41085:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:28.0:1773851873.609849:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851873.609851:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851873.609851:0:41085:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851873.609853:0:41085:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851873.609856:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851873.609858:0:41085:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851873.609860:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000800:00000200:28.0:1773851873.609865:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:27.0:1773851873.609865:0:41085:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Using peer 2068@kfi7(0x62f)
00000800:00000200:28.0:1773851873.609868:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:27.0:1773851873.609870:0:41085:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0x62f: rc=0
00000100:00000001:28.0:1773851873.609871:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851873.609872:0:41085:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851873.609874:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851873.609875:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.609876:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.609876:0:41085:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.609877:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.609877:0:41085:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:27.0:1773851873.609878:0:41085:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.609879:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851873.609879:0:41085:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.609880:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:27.0:1773851873.609880:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851873.609881:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851873.609882:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851873.609882:0:41085:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851873.609883:0:41085:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:27.0:1773851873.609884:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851873.609885:0:41085:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851873.609885:0:41085:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851873.609885:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851873.609887:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851873.609887:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851873.609889:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851873.609889:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000800:00000200:29.0:1773851873.609890:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851873.609890:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851873.609891:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da133026
00000400:00000010:25.0:1773851873.609891:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da133026.
00000400:00000200:29.0:1773851873.609893:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:25.0:1773851873.609893:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:25.0:1773851873.609894:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851873.609895:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:29.0:1773851873.609896:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000063d86a5d
00000400:00000010:29.0:1773851873.609897:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000063d86a5d.
00000100:00000001:29.0:1773851873.609898:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851873.609899:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851873.609899:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:25.0:1773851873.609900:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851873.609903:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851873.609905:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851873.609905:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851873.609906:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851873.609908:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:29.0:1773851873.609909:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851873.609910:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:25.0:1773851873.609910:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Transaction freed
00000400:00000200:29.0:1773851873.609911:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000800:00000200:29.0:1773851873.609914:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000800:00000200:1.0:1773851873.609915:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851873.609916:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851873.609918:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.609921:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851873.609922:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851873.609924:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851873.609925:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851873.609928:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851873.609929:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851873.609931:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851873.609931:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:21.0:1773851873.609933:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:1.0:1773851873.609933:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851873.609935:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851873.609935:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:21.0:1773851873.609936:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:1.0:1773851873.609937:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851873.609938:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851873.609938:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:21.0:1773851873.609939:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:1.0:1773851873.609940:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:21.0:1773851873.609941:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:1.0:1773851873.609942:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851873.609943:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.609944:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4100
00000400:00000200:1.0:1773851873.609944:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b40c0
00000400:00000200:1.0:1773851873.609946:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851873.609947:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.609949:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d1055 [1] + 224
00000400:00000200:1.0:1773851873.609949:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71d981 [1] + 224
00000800:00000200:21.0:1773851873.609952:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851873.609953:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851873.609955:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.609956:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000400:00000200:1.0:1773851873.609956:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:21.0:1773851873.609959:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851873.609959:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000100:00000001:1.0:1773851873.609960:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851873.609961:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:1.0:1773851873.609962:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851873.609966:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851873.609968:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851873.609973:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:1.0:1773851873.609974:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851873.609975:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:27.0:1773851873.609976:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851873.609976:0:41085:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851873.609976:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:28.0:1773851873.609977:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:21.0:1773851873.609977:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851873.609978:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:27.0:1773851873.609978:0:41085:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:27.0:1773851873.609979:0:41085:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:1.0:1773851873.609979:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:28.0:1773851873.609980:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000010:27.0:1773851873.609980:0:41085:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000052625ffc.
00000400:00000001:28.0:1773851873.609981:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:27.0:1773851873.609981:0:41085:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001c61fb44
00000400:00000010:28.0:1773851873.609982:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000010:27.0:1773851873.609982:0:41085:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001c61fb44.
00000400:00000200:28.0:1773851873.609983:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fbb7163e
00000100:00000001:27.0:1773851873.609983:0:41085:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:28.0:1773851873.609984:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fbb7163e.
00000100:00000001:28.0:1773851873.609985:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:27.0:1773851873.609985:0:41085:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:28.0:1773851873.609986:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:27.0:1773851873.609990:0:41085:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:28.0:1773851873.609991:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851873.609995:0:41085:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851873.609996:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851873.609996:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.609996:0:41085:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851873.609997:0:41088:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:27.0:1773851873.609997:0:41085:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851873.609998:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:27.0:1773851873.609998:0:41085:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851873.609999:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851873.609999:0:41085:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851873.610000:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.610000:0:41085:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851873.610002:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851873.610002:0:41085:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851873.610004:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=106 v=66 (66 66 66 66)
00000100:00001000:27.0:1773851873.610004:0:41085:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=106 v=66 (66 66 66 66)
00000100:00001000:28.0:1773851873.610006:0:41088:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=106 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851873.610007:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00001000:27.0:1773851873.610007:0:41085:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=106 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851873.610008:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.610008:0:41085:0:(client.c:1349:ptlrpc_check_status()) Process entered
00010000:00000001:28.0:1773851873.610009:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:27.0:1773851873.610009:0:41085:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851873.610010:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851873.610010:0:41085:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851873.610011:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00010000:00000001:27.0:1773851873.610011:0:41085:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851873.610012:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:27.0:1773851873.610012:0:41085:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:28.0:1773851873.610013:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:27.0:1773851873.610013:0:41085:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:28.0:1773851873.610014:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.610015:0:41085:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:27.0:1773851873.610015:0:41085:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851873.610016:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:27.0:1773851873.610017:0:41085:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851873.610020:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851873.610021:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:27.0:1773851873.610021:0:41085:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851873.610022:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851873.610023:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:27.0:1773851873.610023:0:41085:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000040:28.0:1773851873.610024:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000100:00000001:27.0:1773851873.610024:0:41085:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:28.0:1773851873.610025:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351389047808 avail=351386310656 avail_mb=1372602776 hwm_mb=3131103 files=372019166 ffree=343153367 state=0: rc = 0
00000004:00000001:27.0:1773851873.610025:0:41085:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:27.0:1773851873.610026:0:41085:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:27.0:1773851873.610027:0:41085:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350959015936 avail=350956904448 avail_mb=1370925408 hwm_mb=3131103 files=371564017 ffree=342733414 state=0: rc = 0
00000004:00000020:27.0:1773851873.610031:0:41085:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350959015936 free, 350956904448 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371564017 files, 342733414 free files
00000004:00000001:27.0:1773851873.610034:0:41085:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.610035:0:41085:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:27.0:1773851873.610040:0:41085:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000493d4652 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_01:lustre5-MDT0001-mdtlov_UUID:41085:1859433051930880:2068@kfi7:13:default-yuba2-0
00000100:00000001:27.0:1773851873.610042:0:41085:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:28.0:1773851873.610044:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351389047808 free, 351386310656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019166 files, 343153367 free files
00000100:00000001:27.0:1773851873.610044:0:41085:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:27.0:1773851873.610045:0:41085:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000493d4652 x1859433051930880/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:28.0:1773851873.610046:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851873.610048:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:27.0:1773851873.610049:0:41085:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:27.0:1773851873.610050:0:41085:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:27.0:1773851873.610051:0:41085:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f99dfdf6.
00000100:00100000:28.0:1773851873.610053:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db2f56d6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051930816:2090@kfi7:13:default-yuba2-0
02000000:00000001:27.0:1773851873.610054:0:41085:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:27.0:1773851873.610055:0:41085:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851873.610056:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:27.0:1773851873.610056:0:41085:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000100:00000001:28.0:1773851873.610057:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:27.0:1773851873.610057:0:41085:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:28.0:1773851873.610058:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000db2f56d6 x1859433051930816/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852026 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:27.0:1773851873.610058:0:41085:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000027c5b29c.
02000000:00000001:27.0:1773851873.610059:0:41085:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:27.0:1773851873.610060:0:41085:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:27.0:1773851873.610061:0:41085:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000493d4652.
00000100:00000001:28.0:1773851873.610062:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851873.610063:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:27.0:1773851873.610063:0:41085:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:27.0:1773851873.610063:0:41085:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:28.0:1773851873.610064:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000711cbf99.
00000100:00000001:27.0:1773851873.610064:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.610065:0:41085:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:28.0:1773851873.610066:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851873.610066:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:27.0:1773851873.610066:0:41085:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:28.0:1773851873.610067:0:41088:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000100:00000001:27.0:1773851873.610067:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000001:28.0:1773851873.610068:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:27.0:1773851873.610068:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851873.610069:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
02000000:00000001:28.0:1773851873.610070:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851873.610071:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851873.610072:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db2f56d6.
00000100:00000001:28.0:1773851873.610073:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851873.610074:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851873.610075:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851873.610076:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851873.610077:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.610078:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851873.610079:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851873.616542:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851873.616543:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851873.616546:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.616549:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851873.616553:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24659@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.616555:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24659@kfi7 : PUT - for me
00000400:00000200:21.0:1773851873.616557:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24659@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.616558:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e221adc6 nid 24659@kfi7 refs 1
00000400:00000200:21.0:1773851873.616560:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24659@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.616562:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e221adc6 nid 24659@kfi7 refs 2
00000400:00000200:21.0:1773851873.616563:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e221adc6 nid 24659@kfi7 refs 3
00000400:00000200:21.0:1773851873.616565:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24659@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.616566:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24659@kfi7 of length 224 into portal 12 MB=0x69b4c3be36c00
00000400:00000200:21.0:1773851873.616569:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24659@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 43624
00000800:00000200:21.0:1773851873.616572:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851873.616575:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.616577:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24659@kfi7: PUT: OK
00000100:00000001:21.0:1773851873.616578:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851873.616579:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851873.616581:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005c77c674.
00000100:00000040:21.0:1773851873.616582:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005c77c674 x1859601584843776 msgsize 224
00000100:00100000:21.0:1773851873.616584:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24659@kfi7 (source: 12345-24659@kfi7)
00000100:00000001:21.0:1773851873.616586:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851873.616589:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e221adc6 nid 24659@kfi7 refs 2
00000100:00000001:20.0:1773851873.616589:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851873.616590:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851873.616591:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851873.616591:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851873.616592:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851873.616593:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851873.616595:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601584843776
00000020:00000001:20.0:1773851873.616596:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851873.616597:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff82779
00000020:00000001:20.0:1773851873.616598:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851873.616601:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007d4212c0 refcount=425
00000020:00000001:20.0:1773851873.616602:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142710523904 : -106930999027712 : ffff9ebf2fc99800)
00000020:00000001:20.0:1773851873.616604:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142710523904 : -106930999027712 : ffff9ebf2fc99800)
00000100:00000001:20.0:1773851873.616606:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.616607:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851873.616608:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040bbe88b.
00000020:00000010:20.0:1773851873.616610:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.616612:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851873.616614:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851873.616614:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851873.616616:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.616617:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851873.616618:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851873.616619:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.616621:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.616623:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.616624:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.616624:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851873.616624:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851873.616626:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24659@kfi7, seq: 1997995
00000100:00000040:20.0:1773851873.616627:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007d4212c0 : new rpc_count 3
00000100:00000001:23.0:1773851873.616628:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851873.616629:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.616629:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788268160 : -106974921283456 : ffff9eb4f5d12880)
00000100:00000040:20.0:1773851873.616631:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005c77c674 x1859601584843776/t0(0) o400->f75e706e-6e84-485a-9d3b-790c4af9d28f@24659@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2038-0'
00000100:00000001:20.0:1773851873.616637:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.616637:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851873.616639:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c77c674 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f75e706e-6e84-485a-9d3b-790c4af9d28f+425:39581:x1859601584843776:12345-24659@kfi7:400:default-tuolumne2038-0
00000100:00000200:20.0:1773851873.616642:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601584843776
00000020:00000001:20.0:1773851873.616643:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851873.616644:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851873.616645:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.616646:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851873.616647:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851873.616649:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851873.616650:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601584843776, found 0 last_xid 1859601584134527
00000020:00000001:20.0:1773851873.616652:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851873.616653:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851873.616654:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851873.616655:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.616656:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851873.616657:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851873.616658:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851873.616659:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d98ce85e.
02000000:00000001:20.0:1773851873.616660:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.616661:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.616663:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851873.616664:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183257623847, transno 0, xid 1859601584843776
00010000:00000001:20.0:1773851873.616665:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851873.616667:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005c77c674 x1859601584843776/t0(0) o400->f75e706e-6e84-485a-9d3b-790c4af9d28f@24659@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2038-0'
00010000:00000001:20.0:1773851873.616671:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851873.616673:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851873.616674:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=106 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851873.616677:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851873.616678:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd58978e refcount 3 to 24659@kfi7
00000100:00000001:20.0:1773851873.616680:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999947392 : -107156709604224 : ffff9e8aa2638480)
02000000:00000001:20.0:1773851873.616681:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851873.616682:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.616683:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851873.616685:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24659@kfi7
00000400:00000010:20.0:1773851873.616686:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f2b7e97.
00000100:00000200:20.0:1773851873.616688:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601584843776, offset 224
00000400:00000200:20.0:1773851873.616690:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24659@kfi7
00000400:00000200:20.0:1773851873.616692:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24659@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.616693:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e221adc6 nid 24659@kfi7 refs 1
00000400:00000200:20.0:1773851873.616695:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e221adc6 nid 24659@kfi7 refs 2
00000400:00000200:20.0:1773851873.616697:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e221adc6 nid 24659@kfi7 refs 3
00000400:00000200:20.0:1773851873.616700:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24659@kfi7 local destination
00000400:00000200:20.0:1773851873.616702:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769448:8769448:1024:4294967295] 24659@kfi7 LPNI seq info [174844:174844:16:4294967295]
00000400:00000200:20.0:1773851873.616705:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e221adc6 nid 24659@kfi7 refs 2
00000400:00000200:20.0:1773851873.616706:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24659@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.616710:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24659@kfi7(24659@kfi7:24659@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851873.616712:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e221adc6 nid 24659@kfi7 refs 3
00000800:00000200:20.0:1773851873.616715:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851873.616717:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851873.616721:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851873.616733:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007df Using peer 24659@kfi7(0x1000000000007df)
00000800:00000200:20.0:1773851873.616738:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x1000000000007df: rc=0
00000800:00000200:20.0:1773851873.616741:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851873.616745:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.616747:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd58978e refcount 2 to 24659@kfi7
00010000:00000001:20.0:1773851873.616749:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851873.616750:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.616752:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851873.616753:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005c77c674 x1859601584843776/t0(0) o400->f75e706e-6e84-485a-9d3b-790c4af9d28f@24659@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2038-0'
00000100:00100000:20.0:1773851873.616759:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c77c674 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f75e706e-6e84-485a-9d3b-790c4af9d28f+425:39581:x1859601584843776:12345-24659@kfi7:400:default-tuolumne2038-0 Request processed in 121us (175us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851873.616763:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24659@kfi7, seq: 1997995
00000100:00000040:20.0:1773851873.616764:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007d4212c0 : new rpc_count 2
00000100:00000001:20.0:1773851873.616766:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851873.616767:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851873.616768:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.616769:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851873.616771:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040bbe88b.
00000020:00000040:20.0:1773851873.616772:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000007d4212c0 : new refcount 424
00000100:00000001:20.0:1773851873.616773:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851873.616781:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007df TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851873.616784:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.616786:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24659@kfi7: PUT: OK
00000400:00000200:21.0:1773851873.616787:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f2b7e97
00000400:00000010:21.0:1773851873.616788:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f2b7e97.
00000100:00000001:21.0:1773851873.616790:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851873.616790:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851873.616792:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e221adc6 nid 24659@kfi7 refs 2
00000800:00000200:21.0:1773851873.616794:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 24659@kfi7(0000000066d597c4):0x0 lsk 2016 rsk 25 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007df Transaction freed
00000800:00000200:13.0:1773851873.634663:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851873.634664:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851873.634667:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851873.634671:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851873.634674:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20912@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.634677:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20912@kfi7 : PUT - for me
00000400:00000200:13.0:1773851873.634678:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20912@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.634680:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006669380 nid 20912@kfi7 refs 1
00000400:00000200:13.0:1773851873.634683:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20912@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.634684:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006669380 nid 20912@kfi7 refs 2
00000400:00000200:13.0:1773851873.634686:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000006669380 nid 20912@kfi7 refs 3
00000400:00000200:13.0:1773851873.634687:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20912@kfi7 to cpt 3
00000400:00000200:13.0:1773851873.634690:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20912@kfi7 of length 224 into portal 12 MB=0x69b4c76e09200
00000400:00000200:13.0:1773851873.634693:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20912@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 35496
00000800:00000200:13.0:1773851873.634696:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851873.634699:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851873.634701:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20912@kfi7: PUT: OK
00000100:00000001:13.0:1773851873.634702:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851873.634703:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851873.634705:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f649577b.
00000100:00000040:13.0:1773851873.634706:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000f649577b x1859602574512640 msgsize 224
00000100:00100000:13.0:1773851873.634709:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20912@kfi7 (source: 12345-20912@kfi7)
00000100:00000001:13.0:1773851873.634711:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851873.634713:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000006669380 nid 20912@kfi7 refs 2
00000100:00000001:15.0:1773851873.634714:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851873.634715:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851873.634715:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851873.634716:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851873.634717:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851873.634718:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851873.634719:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602574512640
00000020:00000001:15.0:1773851873.634720:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851873.634721:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff82ae4
00000020:00000001:15.0:1773851873.634722:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851873.634730:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000099171ac6 refcount=5
00000020:00000001:15.0:1773851873.634731:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125523453952 : -106948186097664 : ffff9ebb2f5bb800)
00000020:00000001:15.0:1773851873.634732:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125523453952 : -106948186097664 : ffff9ebb2f5bb800)
00000100:00000001:15.0:1773851873.634733:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851873.634734:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851873.634735:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000055324ba3.
00000020:00000010:15.0:1773851873.634736:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851873.634737:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851873.634738:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851873.634738:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851873.634739:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851873.634740:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851873.634741:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851873.634741:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.634742:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851873.634743:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851873.634744:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851873.634744:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851873.634744:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851873.634745:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20912@kfi7, seq: 2289857
00000100:00000040:15.0:1773851873.634746:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000099171ac6 : new rpc_count 1
00000100:00000001:12.0:1773851873.634746:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.634747:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970982400 : -107043738569216 : ffff9ea4effcb600)
00000100:00000001:12.0:1773851873.634747:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851873.634748:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f649577b x1859602574512640/t0(0) o400->ec4d6245-e0f4-440a-8d78-a7930aac10a8@20912@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1790-0'
00000100:00000001:15.0:1773851873.634752:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851873.634753:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851873.634754:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f649577b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ec4d6245-e0f4-440a-8d78-a7930aac10a8+5:39554:x1859602574512640:12345-20912@kfi7:400:default-tuolumne1790-0
00000100:00000200:15.0:1773851873.634755:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602574512640
00000020:00000001:15.0:1773851873.634756:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851873.634756:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851873.634757:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.634758:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851873.634759:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851873.634760:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851873.634760:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602574512640, found 0 last_xid 1859602574512639
00000020:00000001:15.0:1773851873.634761:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851873.634762:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851873.634763:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851873.634764:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.634764:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851873.634765:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851873.634766:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851873.634766:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009bf8753d.
02000000:00000001:15.0:1773851873.634767:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.634768:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.634769:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851873.634769:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252714232, transno 0, xid 1859602574512640
00010000:00000001:15.0:1773851873.634770:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851873.634771:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f649577b x1859602574512640/t0(0) o400->ec4d6245-e0f4-440a-8d78-a7930aac10a8@20912@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1790-0'
00010000:00000001:15.0:1773851873.634773:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851873.634774:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851873.634774:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=106 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851873.634775:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851873.634776:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e6c9e41d refcount 3 to 20912@kfi7
00000100:00000001:15.0:1773851873.634777:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153376 : -107139310398240 : ffff9e8eaf7654e0)
02000000:00000001:15.0:1773851873.634778:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851873.634779:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851873.634779:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851873.634780:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20912@kfi7
00000400:00000010:15.0:1773851873.634781:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a10312a3.
00000100:00000200:15.0:1773851873.634781:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602574512640, offset 224
00000400:00000200:15.0:1773851873.634783:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20912@kfi7
00000400:00000200:15.0:1773851873.634784:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20912@kfi7 to cpt 3
00000400:00000200:15.0:1773851873.634784:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006669380 nid 20912@kfi7 refs 1
00000400:00000200:15.0:1773851873.634785:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000006669380 nid 20912@kfi7 refs 2
00000400:00000200:15.0:1773851873.634786:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000006669380 nid 20912@kfi7 refs 3
00000400:00000200:15.0:1773851873.634788:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20912@kfi7 local destination
00000400:00000200:15.0:1773851873.634789:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769449:8769449:1024:4294967295] 20912@kfi7 LPNI seq info [6641216:6641216:16:4294967295]
00000400:00000200:15.0:1773851873.634790:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000006669380 nid 20912@kfi7 refs 2
00000400:00000200:15.0:1773851873.634791:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20912@kfi7 to cpt 3
00000400:00000200:15.0:1773851873.634793:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20912@kfi7(20912@kfi7:20912@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851873.634794:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000006669380 nid 20912@kfi7 refs 3
00000800:00000200:15.0:1773851873.634795:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851873.634796:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851873.634798:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851873.634801:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x40 Using peer 20912@kfi7(0x40)
00000800:00000200:15.0:1773851873.634804:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x40: rc=0
00000800:00000200:15.0:1773851873.634805:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x40 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851873.634808:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851873.634808:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e6c9e41d refcount 2 to 20912@kfi7
00010000:00000001:15.0:1773851873.634809:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851873.634810:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851873.634811:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851873.634811:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f649577b x1859602574512640/t0(0) o400->ec4d6245-e0f4-440a-8d78-a7930aac10a8@20912@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1790-0'
00000100:00100000:15.0:1773851873.634814:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f649577b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ec4d6245-e0f4-440a-8d78-a7930aac10a8+5:39554:x1859602574512640:12345-20912@kfi7:400:default-tuolumne1790-0 Request processed in 61us (107us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851873.634817:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20912@kfi7, seq: 2289857
00000100:00000040:15.0:1773851873.634817:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000099171ac6 : new rpc_count 0
00000800:00000200:13.0:1773851873.634817:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x40 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851873.634818:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851873.634819:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851873.634819:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851873.634819:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851873.634820:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:13.0:1773851873.634820:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20912@kfi7: PUT: OK
00000400:00000200:13.0:1773851873.634820:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a10312a3
00000020:00000010:15.0:1773851873.634821:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000055324ba3.
00000400:00000010:13.0:1773851873.634821:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a10312a3.
00000100:00000001:13.0:1773851873.634821:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:15.0:1773851873.634822:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000099171ac6 : new refcount 4
00000100:00000001:15.0:1773851873.634822:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851873.634822:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851873.634823:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000006669380 nid 20912@kfi7 refs 2
00000800:00000200:13.0:1773851873.634824:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 20912@kfi7(00000000449a7a6f):0x0 lsk 65 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x40 Transaction freed
00000800:00000200:29.0:1773851873.639204:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851873.639205:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851873.639207:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851873.639209:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851873.639211:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25377@kfi7 to cpt 7
00000400:00000200:29.0:1773851873.639212:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25377@kfi7 : PUT - for me
00000400:00000200:29.0:1773851873.639213:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25377@kfi7 to cpt 7
00000400:00000200:29.0:1773851873.639214:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bae2cfbe nid 25377@kfi7 refs 1
00000400:00000200:29.0:1773851873.639215:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25377@kfi7 to cpt 7
00000400:00000200:29.0:1773851873.639216:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bae2cfbe nid 25377@kfi7 refs 2
00000400:00000200:29.0:1773851873.639216:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bae2cfbe nid 25377@kfi7 refs 3
00000400:00000200:29.0:1773851873.639217:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25569@kfi7 to cpt 2
00000400:00000200:29.0:1773851873.639218:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25569@kfi7 of length 224 into portal 12 MB=0x69b80a70f2c40
00000400:00000200:29.0:1773851873.639220:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25569@kfi7 of length 224/224 into md 0x77fe139dd [64] + 182384
00000800:00000200:29.0:1773851873.639221:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851873.639223:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851873.639224:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25377@kfi7: PUT: OK
00000100:00000001:29.0:1773851873.639225:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851873.639226:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851873.639227:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d3c4c877.
00000100:00000040:29.0:1773851873.639227:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000d3c4c877 x1859826721172544 msgsize 224
00000100:00100000:29.0:1773851873.639229:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25569@kfi7 (source: 12345-25377@kfi7)
00000100:00000001:29.0:1773851873.639229:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851873.639231:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851873.639231:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bae2cfbe nid 25377@kfi7 refs 2
02000000:00000001:31.0:1773851873.639232:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851873.639232:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851873.639232:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851873.639233:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851873.639234:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851873.639234:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859826721172544
00000020:00000001:31.0:1773851873.639235:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851873.639235:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f086fcb74b41
00000020:00000001:31.0:1773851873.639236:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851873.639238:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000442eea15 refcount=23
00000020:00000001:31.0:1773851873.639239:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158608715776 : -106915100835840 : ffff9ec2e364c000)
00000020:00000001:31.0:1773851873.639240:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637158608715776 : -106915100835840 : ffff9ec2e364c000)
00000100:00000001:31.0:1773851873.639241:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851873.639242:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851873.639242:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851873.639244:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851873.639244:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851873.639245:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851873.639246:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851873.639246:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851873.639247:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851873.639248:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851873.639248:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.639249:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851873.639250:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851873.639251:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851873.639251:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851873.639251:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851873.639252:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25569@kfi7, seq: 2055535
00000100:00000040:31.0:1773851873.639253:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000442eea15 : new rpc_count 1
00000100:00000001:28.0:1773851873.639253:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.639254:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309671040 : -106988399880576 : ffff9eb1d26e1680)
00000100:00000001:28.0:1773851873.639254:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851873.639255:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d3c4c877 x1859826721172544/t0(0) o400->8d097ed6-c19b-4604-82d2-088a3de4b6c7@25569@kfi7:661/0 lens 224/0 e 0 to 0 dl 1773852021 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2079-0'
00000100:00000001:31.0:1773851873.639258:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851873.639258:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851873.639259:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d3c4c877 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:8d097ed6-c19b-4604-82d2-088a3de4b6c7+23:39738:x1859826721172544:12345-25569@kfi7:400:default-tuolumne2079-0
00000100:00000200:31.0:1773851873.639260:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859826721172544
00000020:00000001:31.0:1773851873.639261:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851873.639262:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851873.639262:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.639263:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851873.639264:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851873.639265:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851873.639265:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859826721172544, found 0 last_xid 1859826720811455
00000020:00000001:31.0:1773851873.639266:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851873.639267:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851873.639267:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851873.639268:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.639269:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851873.639269:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851873.639270:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851873.639271:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e8ebf5fc.
02000000:00000001:31.0:1773851873.639271:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.639272:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.639273:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851873.639273:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260624014, transno 0, xid 1859826721172544
00010000:00000001:31.0:1773851873.639274:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851873.639275:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d3c4c877 x1859826721172544/t0(0) o400->8d097ed6-c19b-4604-82d2-088a3de4b6c7@25569@kfi7:661/0 lens 224/224 e 0 to 0 dl 1773852021 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2079-0'
00010000:00000001:31.0:1773851873.639277:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851873.639278:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851873.639279:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=106 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851873.639280:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851873.639283:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f2da71dc refcount 3 to 25569@kfi7
00000100:00000001:31.0:1773851873.639284:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902580352 : -107154806971264 : ffff9e8b13cb6480)
02000000:00000001:31.0:1773851873.639285:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851873.639285:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.639286:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851873.639287:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25377@kfi7
00000400:00000010:31.0:1773851873.639287:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fab8ac69.
00000100:00000200:31.0:1773851873.639288:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859826721172544, offset 224
00000400:00000200:31.0:1773851873.639290:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25377@kfi7
00000400:00000200:31.0:1773851873.639291:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25377@kfi7 to cpt 7
00000400:00000200:31.0:1773851873.639292:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bae2cfbe nid 25377@kfi7 refs 1
00000400:00000200:31.0:1773851873.639293:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bae2cfbe nid 25377@kfi7 refs 2
00000400:00000200:31.0:1773851873.639294:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bae2cfbe nid 25377@kfi7 refs 3
00000400:00000200:31.0:1773851873.639295:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25377@kfi7 local destination
00000400:00000200:31.0:1773851873.639296:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769450:8769450:1024:4294967295] 25377@kfi7 LPNI seq info [1563499:1563499:16:4294967295]
00000400:00000200:31.0:1773851873.639298:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bae2cfbe nid 25377@kfi7 refs 2
00000400:00000200:31.0:1773851873.639299:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25377@kfi7 to cpt 7
00000400:00000200:31.0:1773851873.639301:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25377@kfi7(25377@kfi7:25377@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851873.639302:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bae2cfbe nid 25377@kfi7 refs 3
00000800:00000200:31.0:1773851873.639303:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851873.639304:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851873.639307:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851873.639309:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd33 Using peer 25377@kfi7(0xd33)
00000800:00000200:31.0:1773851873.639312:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0xd33: rc=0
00000800:00000200:31.0:1773851873.639314:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd33 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851873.639316:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851873.639317:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f2da71dc refcount 2 to 25569@kfi7
00010000:00000001:31.0:1773851873.639318:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851873.639318:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.639319:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851873.639319:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d3c4c877 x1859826721172544/t0(0) o400->8d097ed6-c19b-4604-82d2-088a3de4b6c7@25569@kfi7:661/0 lens 224/224 e 0 to 0 dl 1773852021 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2079-0'
00000100:00100000:31.0:1773851873.639322:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d3c4c877 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:8d097ed6-c19b-4604-82d2-088a3de4b6c7+23:39738:x1859826721172544:12345-25569@kfi7:400:default-tuolumne2079-0 Request processed in 64us (94us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851873.639325:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25569@kfi7, seq: 2055535
00000100:00000040:31.0:1773851873.639326:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000442eea15 : new rpc_count 0
00000800:00000200:29.0:1773851873.639326:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd33 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851873.639327:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851873.639327:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851873.639328:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851873.639328:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851873.639329:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851873.639329:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25377@kfi7: PUT: OK
00000400:00000200:29.0:1773851873.639329:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fab8ac69
00000020:00000010:31.0:1773851873.639330:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851873.639330:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000442eea15 : new refcount 22
00000100:00000001:31.0:1773851873.639331:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851873.639331:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fab8ac69.
00000100:00000001:29.0:1773851873.639332:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851873.639332:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851873.639333:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bae2cfbe nid 25377@kfi7 refs 2
00000800:00000200:29.0:1773851873.639334:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 25377@kfi7(00000000f0770b7e):0x0 lsk 3380 rsk 20 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd33 Transaction freed
00000800:00000200:25.0:1773851873.676921:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851873.676923:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851873.676924:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851873.676926:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851873.676928:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9027@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.676929:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9027@kfi7 : PUT - for me
00000400:00000200:25.0:1773851873.676930:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9027@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.676930:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000744d5889 nid 9027@kfi7 refs 1
00000400:00000200:25.0:1773851873.676931:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9027@kfi7 to cpt 6
00000400:00000200:25.0:1773851873.676932:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000744d5889 nid 9027@kfi7 refs 2
00000400:00000200:25.0:1773851873.676933:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000744d5889 nid 9027@kfi7 refs 3
00000400:00000200:25.0:1773851873.676934:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9026@kfi7 to cpt 3
00000400:00000200:25.0:1773851873.676935:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9026@kfi7 of length 224 into portal 12 MB=0x69b4bca964980
00000400:00000200:25.0:1773851873.676936:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9026@kfi7 of length 224/224 into md 0x16159c9699 [64] + 20312
00000800:00000200:25.0:1773851873.676938:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851873.676939:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851873.676940:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9027@kfi7: PUT: OK
00000100:00000001:25.0:1773851873.676941:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851873.676941:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851873.676942:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cb2cc615.
00000100:00000040:25.0:1773851873.676943:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000cb2cc615 x1859599683963264 msgsize 224
00000100:00100000:25.0:1773851873.676944:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9026@kfi7 (source: 12345-9027@kfi7)
00000100:00000001:25.0:1773851873.676945:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851873.676946:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000744d5889 nid 9027@kfi7 refs 2
00000100:00000001:27.0:1773851873.676947:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851873.676947:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851873.676947:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851873.676948:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851873.676948:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851873.676949:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851873.676950:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599683963264
00000020:00000001:27.0:1773851873.676950:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851873.676951:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38943390
00000020:00000001:27.0:1773851873.676951:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851873.676955:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f2020042 refcount=5
00000020:00000001:27.0:1773851873.676956:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083138692096 : -106990570859520 : ffff9eb151079400)
00000020:00000001:27.0:1773851873.676957:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637083138692096 : -106990570859520 : ffff9eb151079400)
00000100:00000001:27.0:1773851873.676958:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.676959:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851873.676959:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851873.676960:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851873.676961:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851873.676962:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851873.676962:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851873.676963:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.676964:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851873.676965:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851873.676966:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.676967:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851873.676968:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851873.676968:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851873.676969:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851873.676969:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851873.676970:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9026@kfi7, seq: 2025118
00000100:00000040:27.0:1773851873.676970:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f2020042 : new rpc_count 1
00000100:00000001:26.0:1773851873.676970:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.676971:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124127564800 : -106949581986816 : ffff9ebadc282400)
00000100:00000001:26.0:1773851873.676971:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.676972:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cb2cc615 x1859599683963264/t0(0) o400->afa6ffdc-2c20-4157-a965-672c686c770f@9026@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1064-0'
00000100:00000001:27.0:1773851873.676975:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851873.676975:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851873.676976:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cb2cc615 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:afa6ffdc-2c20-4157-a965-672c686c770f+5:39504:x1859599683963264:12345-9026@kfi7:400:default-tuolumne1064-0
00000100:00000200:27.0:1773851873.676977:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599683963264
00000020:00000001:27.0:1773851873.676978:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851873.676979:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851873.676979:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.676980:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851873.676981:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851873.676981:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851873.676982:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599683963264, found 0 last_xid 1859599683963263
00000020:00000001:27.0:1773851873.676983:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851873.676983:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851873.676984:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851873.676984:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.676985:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851873.676986:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851873.676986:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851873.676987:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009f678f13.
02000000:00000001:27.0:1773851873.676988:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.676988:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.676989:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851873.676989:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183025660301, transno 0, xid 1859599683963264
00010000:00000001:27.0:1773851873.676991:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851873.676991:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cb2cc615 x1859599683963264/t0(0) o400->afa6ffdc-2c20-4157-a965-672c686c770f@9026@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1064-0'
00010000:00000001:27.0:1773851873.676994:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851873.676994:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851873.676995:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=106 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851873.676996:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851873.676997:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a606231e refcount 3 to 9026@kfi7
00000100:00000001:27.0:1773851873.676997:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729297248 : -107155980254368 : ffff9e8acddc8360)
02000000:00000001:27.0:1773851873.676998:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851873.676999:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851873.676999:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851873.677000:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9027@kfi7
00000400:00000010:27.0:1773851873.677001:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001c61fb44.
00000100:00000200:27.0:1773851873.677001:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599683963264, offset 224
00000400:00000200:27.0:1773851873.677003:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9027@kfi7
00000400:00000200:27.0:1773851873.677003:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9027@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.677004:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000744d5889 nid 9027@kfi7 refs 1
00000400:00000200:27.0:1773851873.677005:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000744d5889 nid 9027@kfi7 refs 2
00000400:00000200:27.0:1773851873.677006:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000744d5889 nid 9027@kfi7 refs 3
00000400:00000200:27.0:1773851873.677007:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9027@kfi7 local destination
00000400:00000200:27.0:1773851873.677008:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769451:8769451:1024:4294967295] 9027@kfi7 LPNI seq info [8103426:8103426:16:4294967295]
00000400:00000200:27.0:1773851873.677009:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000744d5889 nid 9027@kfi7 refs 2
00000400:00000200:27.0:1773851873.677010:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9027@kfi7 to cpt 6
00000400:00000200:27.0:1773851873.677012:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9027@kfi7(9027@kfi7:9027@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851873.677013:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000744d5889 nid 9027@kfi7 refs 3
00000800:00000200:27.0:1773851873.677014:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851873.677015:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851873.677017:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851873.677020:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x781 Using peer 9027@kfi7(0x781)
00000800:00000200:27.0:1773851873.677023:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x781: rc=0
00000800:00000200:27.0:1773851873.677025:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x781 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851873.677027:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851873.677027:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a606231e refcount 2 to 9026@kfi7
00010000:00000001:27.0:1773851873.677028:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851873.677029:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851873.677029:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851873.677030:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cb2cc615 x1859599683963264/t0(0) o400->afa6ffdc-2c20-4157-a965-672c686c770f@9026@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1064-0'
00000100:00100000:27.0:1773851873.677033:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cb2cc615 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:afa6ffdc-2c20-4157-a965-672c686c770f+5:39504:x1859599683963264:12345-9026@kfi7:400:default-tuolumne1064-0 Request processed in 57us (89us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851873.677035:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9026@kfi7, seq: 2025118
00000100:00000040:27.0:1773851873.677036:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f2020042 : new rpc_count 0
00000800:00000200:25.0:1773851873.677036:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x781 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851873.677037:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851873.677037:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851873.677037:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851873.677038:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000400:00000200:25.0:1773851873.677038:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851873.677039:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000400:00000200:25.0:1773851873.677039:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9027@kfi7: PUT: OK
00000020:00000040:27.0:1773851873.677040:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000f2020042 : new refcount 4
00000100:00000001:27.0:1773851873.677040:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851873.677040:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001c61fb44
00000400:00000010:25.0:1773851873.677041:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001c61fb44.
00000100:00000001:25.0:1773851873.677041:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851873.677042:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851873.677043:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000744d5889 nid 9027@kfi7 refs 2
00000800:00000200:25.0:1773851873.677044:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 9027@kfi7(00000000762ecfb8):0x0 lsk 1922 rsk 21 tsk 0 trmk 0 tmk 0 trr 6 tta 0x781 Transaction freed
00000800:00000200:22.0:1773851873.744963:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851873.744964:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851873.744965:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851873.744967:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851873.744969:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12145@kfi7 to cpt 5
00000400:00000200:22.0:1773851873.744970:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12145@kfi7 : PUT - for me
00000400:00000200:22.0:1773851873.744970:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12145@kfi7 to cpt 5
00000400:00000200:22.0:1773851873.744971:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d422b580 nid 12145@kfi7 refs 1
00000400:00000200:22.0:1773851873.744973:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12145@kfi7 to cpt 5
00000400:00000200:22.0:1773851873.744973:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d422b580 nid 12145@kfi7 refs 2
00000400:00000200:22.0:1773851873.744974:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d422b580 nid 12145@kfi7 refs 3
00000400:00000200:22.0:1773851873.744975:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12209@kfi7 to cpt 1
00000400:00000200:22.0:1773851873.744976:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12209@kfi7 of length 224 into portal 12 MB=0x69b4b57a753c0
00000400:00000200:22.0:1773851873.744977:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12209@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 43848
00000800:00000200:22.0:1773851873.744981:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851873.744983:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851873.744984:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12145@kfi7: PUT: OK
00000100:00000001:22.0:1773851873.744985:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851873.744985:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851873.744987:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001db26dfd.
00000100:00000040:22.0:1773851873.744987:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000001db26dfd x1859597755700160 msgsize 224
00000100:00100000:22.0:1773851873.744989:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-12209@kfi7 (source: 12345-12145@kfi7)
00000100:00000001:22.0:1773851873.744990:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851873.744990:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d422b580 nid 12145@kfi7 refs 2
00000100:00000001:20.0:1773851873.744991:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:22.0:1773851873.744992:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851873.744992:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851873.744992:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851873.744992:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851873.744993:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851873.744994:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597755700160
00000020:00000001:20.0:1773851873.744994:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851873.744995:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7d894
00000020:00000001:20.0:1773851873.744995:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851873.744999:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006a13238 refcount=5
00000020:00000001:20.0:1773851873.745000:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119100634112 : -106954608917504 : ffff9eb9b0874400)
00000020:00000001:20.0:1773851873.745000:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119100634112 : -106954608917504 : ffff9eb9b0874400)
00000100:00000001:20.0:1773851873.745001:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.745002:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851873.745003:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040bbe88b.
00000020:00000010:20.0:1773851873.745004:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.745005:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851873.745005:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851873.745006:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851873.745006:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.745007:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851873.745008:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851873.745008:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.745009:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851873.745010:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851873.745010:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851873.745011:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851873.745011:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851873.745011:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12209@kfi7, seq: 1997996
00000100:00000001:23.0:1773851873.745012:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.745012:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006a13238 : new rpc_count 1
00000100:00000001:23.0:1773851873.745013:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.745013:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382185472 : -106946327366144 : ffff9ebb9e25b600)
00000100:00000040:20.0:1773851873.745014:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001db26dfd x1859597755700160/t0(0) o400->a412d794-ff49-4855-b08c-b46455c63b67@12209@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1246-0'
00000100:00000001:20.0:1773851873.745017:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.745017:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851873.745018:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001db26dfd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:a412d794-ff49-4855-b08c-b46455c63b67+5:39589:x1859597755700160:12345-12209@kfi7:400:default-tuolumne1246-0
00000100:00000200:20.0:1773851873.745019:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597755700160
00000020:00000001:20.0:1773851873.745020:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851873.745020:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851873.745021:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.745021:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851873.745022:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851873.745023:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851873.745023:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597755700160, found 0 last_xid 1859597755700159
00000020:00000001:20.0:1773851873.745024:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851873.745025:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851873.745025:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851873.745026:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.745027:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851873.745027:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851873.745028:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851873.745029:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b345fdc6.
02000000:00000001:20.0:1773851873.745030:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.745030:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.745031:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851873.745032:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684376, transno 0, xid 1859597755700160
00010000:00000001:20.0:1773851873.745032:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851873.745033:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001db26dfd x1859597755700160/t0(0) o400->a412d794-ff49-4855-b08c-b46455c63b67@12209@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1246-0'
00010000:00000001:20.0:1773851873.745036:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851873.745036:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851873.745037:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=106 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851873.745038:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851873.745039:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c0b15793 refcount 3 to 12209@kfi7
00000100:00000001:20.0:1773851873.745039:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740763616 : -107153968788000 : ffff9e8b45c10de0)
02000000:00000001:20.0:1773851873.745040:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851873.745041:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.745041:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851873.745042:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12145@kfi7
00000400:00000010:20.0:1773851873.745043:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c6b46a6.
00000100:00000200:20.0:1773851873.745043:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597755700160, offset 224
00000400:00000200:20.0:1773851873.745045:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12145@kfi7
00000400:00000200:20.0:1773851873.745045:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12145@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.745046:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d422b580 nid 12145@kfi7 refs 1
00000400:00000200:20.0:1773851873.745047:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d422b580 nid 12145@kfi7 refs 2
00000400:00000200:20.0:1773851873.745048:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d422b580 nid 12145@kfi7 refs 3
00000400:00000200:20.0:1773851873.745049:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12145@kfi7 local destination
00000400:00000200:20.0:1773851873.745050:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769452:8769452:1024:4294967295] 12145@kfi7 LPNI seq info [148348:148348:16:4294967295]
00000400:00000200:20.0:1773851873.745052:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d422b580 nid 12145@kfi7 refs 2
00000400:00000200:20.0:1773851873.745052:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12145@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.745054:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12145@kfi7(12145@kfi7:12145@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851873.745055:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d422b580 nid 12145@kfi7 refs 3
00000800:00000200:20.0:1773851873.745058:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851873.745061:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851873.745063:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851873.745065:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a5a Using peer 12145@kfi7(0x100000000000a5a)
00000800:00000200:20.0:1773851873.745068:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x100000000000a5a: rc=0
00000800:00000200:20.0:1773851873.745069:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a5a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851873.745071:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.745072:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c0b15793 refcount 2 to 12209@kfi7
00010000:00000001:20.0:1773851873.745073:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851873.745073:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.745074:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851873.745075:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001db26dfd x1859597755700160/t0(0) o400->a412d794-ff49-4855-b08c-b46455c63b67@12209@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1246-0'
00000100:00100000:20.0:1773851873.745078:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001db26dfd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:a412d794-ff49-4855-b08c-b46455c63b67+5:39589:x1859597755700160:12345-12209@kfi7:400:default-tuolumne1246-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851873.745080:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12209@kfi7, seq: 1997996
00000100:00000040:20.0:1773851873.745081:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006a13238 : new rpc_count 0
00000100:00000001:20.0:1773851873.745082:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851873.745082:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851873.745083:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.745083:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851873.745084:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040bbe88b.
00000020:00000040:20.0:1773851873.745085:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000006a13238 : new refcount 4
00000100:00000001:20.0:1773851873.745086:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851873.745090:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a5a TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851873.745092:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851873.745093:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12145@kfi7: PUT: OK
00000400:00000200:22.0:1773851873.745094:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c6b46a6
00000400:00000010:22.0:1773851873.745095:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c6b46a6.
00000100:00000001:22.0:1773851873.745096:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851873.745096:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851873.745097:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d422b580 nid 12145@kfi7 refs 2
00000800:00000200:22.0:1773851873.745098:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 12145@kfi7(000000005a6fe1a6):0x0 lsk 2651 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a5a Transaction freed
00000800:00000200:29.0:1773851873.803023:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851873.803024:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851873.803025:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851873.803028:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851873.803029:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23555@kfi7 to cpt 7
00000400:00000200:29.0:1773851873.803030:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23555@kfi7 : PUT - for me
00000400:00000200:29.0:1773851873.803031:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23555@kfi7 to cpt 7
00000400:00000200:29.0:1773851873.803032:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf5ba449 nid 23555@kfi7 refs 1
00000400:00000200:29.0:1773851873.803033:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23555@kfi7 to cpt 7
00000400:00000200:29.0:1773851873.803034:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf5ba449 nid 23555@kfi7 refs 2
00000400:00000200:29.0:1773851873.803035:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf5ba449 nid 23555@kfi7 refs 3
00000400:00000200:29.0:1773851873.803036:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23746@kfi7 to cpt 7
00000400:00000200:29.0:1773851873.803036:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23746@kfi7 of length 224 into portal 12 MB=0x69b83b5343bc0
00000400:00000200:29.0:1773851873.803038:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23746@kfi7 of length 224/224 into md 0x77fe139dd [64] + 182608
00000800:00000200:29.0:1773851873.803039:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851873.803041:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851873.803042:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23555@kfi7: PUT: OK
00000100:00000001:29.0:1773851873.803043:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851873.803043:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851873.803044:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031e17c5f.
00000100:00000040:29.0:1773851873.803045:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000031e17c5f x1859839843384256 msgsize 224
00000100:00100000:29.0:1773851873.803046:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23746@kfi7 (source: 12345-23555@kfi7)
00000100:00000001:29.0:1773851873.803047:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851873.803048:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851873.803048:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf5ba449 nid 23555@kfi7 refs 2
02000000:00000001:31.0:1773851873.803049:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851873.803049:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851873.803050:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851873.803050:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851873.803051:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851873.803051:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859839843384256
00000020:00000001:31.0:1773851873.803052:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851873.803052:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087a76dd930
00000020:00000001:31.0:1773851873.803053:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851873.803056:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002f8e1dfd refcount=5
00000020:00000001:31.0:1773851873.803057:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637094063856640 : -106979645694976 : ffff9eb3dc385c00)
00000020:00000001:31.0:1773851873.803058:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637094063856640 : -106979645694976 : ffff9eb3dc385c00)
00000100:00000001:31.0:1773851873.803059:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851873.803059:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851873.803060:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851873.803061:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851873.803062:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851873.803063:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851873.803064:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851873.803064:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851873.803065:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851873.803066:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851873.803066:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.803067:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851873.803068:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851873.803069:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851873.803069:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851873.803070:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23746@kfi7, seq: 2055536
00000100:00000001:28.0:1773851873.803070:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851873.803071:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002f8e1dfd : new rpc_count 1
00000100:00000001:31.0:1773851873.803071:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309681408 : -106988399870208 : ffff9eb1d26e3f00)
00000100:00000001:28.0:1773851873.803071:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851873.803071:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851873.803072:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000031e17c5f x1859839843384256/t0(0) o400->ad5d0bec-152f-471c-b574-5b4736f1e4bc@23746@kfi7:661/0 lens 224/0 e 0 to 0 dl 1773852021 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1975-0'
00000100:00000001:31.0:1773851873.803075:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851873.803075:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851873.803076:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031e17c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ad5d0bec-152f-471c-b574-5b4736f1e4bc+5:39488:x1859839843384256:12345-23746@kfi7:400:default-tuolumne1975-0
00000100:00000200:31.0:1773851873.803078:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859839843384256
00000020:00000001:31.0:1773851873.803078:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851873.803079:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851873.803080:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.803080:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851873.803081:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851873.803082:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851873.803082:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859839843384256, found 0 last_xid 1859839843384255
00000020:00000001:31.0:1773851873.803083:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851873.803084:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851873.803084:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851873.803085:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.803085:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851873.803086:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851873.803086:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851873.803087:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bbe8a27c.
02000000:00000001:31.0:1773851873.803088:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.803089:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.803090:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851873.803090:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182404282736, transno 0, xid 1859839843384256
00010000:00000001:31.0:1773851873.803091:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851873.803092:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000031e17c5f x1859839843384256/t0(0) o400->ad5d0bec-152f-471c-b574-5b4736f1e4bc@23746@kfi7:661/0 lens 224/224 e 0 to 0 dl 1773852021 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1975-0'
00010000:00000001:31.0:1773851873.803094:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851873.803095:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851873.803095:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=106 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851873.803096:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851873.803097:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007955903b refcount 3 to 23746@kfi7
00000100:00000001:31.0:1773851873.803098:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270432 : -107152618281184 : ffff9e8b96402720)
02000000:00000001:31.0:1773851873.803099:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851873.803099:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851873.803100:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851873.803101:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23555@kfi7
00000400:00000010:31.0:1773851873.803101:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007bba7902.
00000100:00000200:31.0:1773851873.803102:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859839843384256, offset 224
00000400:00000200:31.0:1773851873.803103:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23555@kfi7
00000400:00000200:31.0:1773851873.803104:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23555@kfi7 to cpt 7
00000400:00000200:31.0:1773851873.803105:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf5ba449 nid 23555@kfi7 refs 1
00000400:00000200:31.0:1773851873.803106:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf5ba449 nid 23555@kfi7 refs 2
00000400:00000200:31.0:1773851873.803107:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf5ba449 nid 23555@kfi7 refs 3
00000400:00000200:31.0:1773851873.803108:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23555@kfi7 local destination
00000400:00000200:31.0:1773851873.803109:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769453:8769453:1024:4294967295] 23555@kfi7 LPNI seq info [221093:221093:16:4294967295]
00000400:00000200:31.0:1773851873.803111:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf5ba449 nid 23555@kfi7 refs 2
00000400:00000200:31.0:1773851873.803111:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23555@kfi7 to cpt 7
00000400:00000200:31.0:1773851873.803113:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23555@kfi7(23555@kfi7:23555@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851873.803114:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf5ba449 nid 23555@kfi7 refs 3
00000800:00000200:31.0:1773851873.803116:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851873.803117:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851873.803120:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851873.803122:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb9a Using peer 23555@kfi7(0xb9a)
00000800:00000200:31.0:1773851873.803125:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0xb9a: rc=0
00000800:00000200:31.0:1773851873.803126:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb9a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851873.803128:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851873.803129:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007955903b refcount 2 to 23746@kfi7
00010000:00000001:31.0:1773851873.803130:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851873.803130:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851873.803131:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851873.803132:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031e17c5f x1859839843384256/t0(0) o400->ad5d0bec-152f-471c-b574-5b4736f1e4bc@23746@kfi7:661/0 lens 224/224 e 0 to 0 dl 1773852021 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1975-0'
00000100:00100000:31.0:1773851873.803134:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031e17c5f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ad5d0bec-152f-471c-b574-5b4736f1e4bc+5:39488:x1859839843384256:12345-23746@kfi7:400:default-tuolumne1975-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851873.803137:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23746@kfi7, seq: 2055536
00000100:00000040:31.0:1773851873.803138:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002f8e1dfd : new rpc_count 0
00000800:00000200:29.0:1773851873.803138:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb9a TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851873.803139:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851873.803139:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851873.803140:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851873.803140:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851873.803141:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851873.803141:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000400:00000200:29.0:1773851873.803141:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23555@kfi7: PUT: OK
00000020:00000040:31.0:1773851873.803142:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000002f8e1dfd : new refcount 4
00000400:00000200:29.0:1773851873.803142:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007bba7902
00000400:00000010:29.0:1773851873.803142:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007bba7902.
00000100:00000001:31.0:1773851873.803143:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851873.803143:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851873.803143:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851873.803144:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf5ba449 nid 23555@kfi7 refs 2
00000800:00000200:29.0:1773851873.803146:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 23555@kfi7(0000000006ca693d):0x0 lsk 2971 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb9a Transaction freed
00000800:00000200:21.0:1773851873.967672:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851873.967673:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851873.967675:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.967678:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851873.967681:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22672@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.967683:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22672@kfi7 : PUT - for me
00000400:00000200:21.0:1773851873.967685:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22672@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.967687:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005eaa5201 nid 22672@kfi7 refs 1
00000400:00000200:21.0:1773851873.967688:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22672@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.967689:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005eaa5201 nid 22672@kfi7 refs 2
00000400:00000200:21.0:1773851873.967691:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005eaa5201 nid 22672@kfi7 refs 3
00000400:00000200:21.0:1773851873.967692:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22672@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.967694:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22672@kfi7 of length 224 into portal 12 MB=0x69b4b622be1c0
00000400:00000200:21.0:1773851873.967696:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22672@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 44072
00000800:00000200:21.0:1773851873.967699:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851873.967704:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.967705:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22672@kfi7: PUT: OK
00000100:00000001:21.0:1773851873.967707:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851873.967707:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851873.967709:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001d4e0a68.
00000100:00000040:21.0:1773851873.967710:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000001d4e0a68 x1859597932159424 msgsize 224
00000100:00100000:21.0:1773851873.967712:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-22672@kfi7 (source: 12345-22672@kfi7)
00000100:00000001:21.0:1773851873.967714:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851873.967715:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005eaa5201 nid 22672@kfi7 refs 2
00000100:00000001:20.0:1773851873.967715:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851873.967716:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851873.967716:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851873.967717:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851873.967717:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851873.967718:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851873.967719:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597932159424
00000020:00000001:20.0:1773851873.967719:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851873.967720:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24376477
00000020:00000001:20.0:1773851873.967720:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851873.967723:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000894ea166 refcount=5
00000020:00000001:20.0:1773851873.967723:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157763189760 : -106915946361856 : ffff9ec2b0ff0c00)
00000020:00000001:20.0:1773851873.967724:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157763189760 : -106915946361856 : ffff9ec2b0ff0c00)
00000100:00000001:20.0:1773851873.967728:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.967729:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851873.967729:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040bbe88b.
00000020:00000010:20.0:1773851873.967730:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.967731:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851873.967732:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851873.967732:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851873.967733:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.967734:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851873.967734:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851873.967735:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.967735:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.967737:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851873.967737:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851873.967738:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:20.0:1773851873.967738:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22672@kfi7, seq: 1997997
00000100:00000001:23.0:1773851873.967739:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:20.0:1773851873.967739:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000894ea166 : new rpc_count 1
00000100:00000001:20.0:1773851873.967739:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098788279680 : -106974921271936 : ffff9eb4f5d15580)
00000100:00000001:23.0:1773851873.967740:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851873.967741:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.967741:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001d4e0a68 x1859597932159424/t0(0) o400->1079588d-d921-4302-8821-6592fd6df456@22672@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1906-0'
00000100:00000001:20.0:1773851873.967743:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.967744:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851873.967745:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d4e0a68 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1079588d-d921-4302-8821-6592fd6df456+5:39710:x1859597932159424:12345-22672@kfi7:400:default-tuolumne1906-0
00000100:00000200:20.0:1773851873.967746:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597932159424
00000020:00000001:20.0:1773851873.967747:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851873.967747:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851873.967748:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.967749:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851873.967749:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851873.967750:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851873.967751:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597932159424, found 0 last_xid 1859597932159423
00000020:00000001:20.0:1773851873.967752:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851873.967752:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851873.967753:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851873.967753:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.967754:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851873.967754:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851873.967755:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851873.967756:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef87ff3f.
02000000:00000001:20.0:1773851873.967756:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.967757:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.967758:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851873.967758:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260404081, transno 0, xid 1859597932159424
00010000:00000001:20.0:1773851873.967759:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851873.967760:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001d4e0a68 x1859597932159424/t0(0) o400->1079588d-d921-4302-8821-6592fd6df456@22672@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1906-0'
00010000:00000001:20.0:1773851873.967762:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851873.967763:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851873.967763:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=106 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851873.967764:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851873.967765:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001be2fdeb refcount 3 to 22672@kfi7
00000100:00000001:20.0:1773851873.967766:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355110240 : -107156354441376 : ffff9e8ab78edf60)
02000000:00000001:20.0:1773851873.967767:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851873.967767:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.967768:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851873.967769:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22672@kfi7
00000400:00000010:20.0:1773851873.967769:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000408d3b17.
00000100:00000200:20.0:1773851873.967770:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597932159424, offset 224
00000400:00000200:20.0:1773851873.967771:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22672@kfi7
00000400:00000200:20.0:1773851873.967772:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22672@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.967773:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005eaa5201 nid 22672@kfi7 refs 1
00000400:00000200:20.0:1773851873.967774:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005eaa5201 nid 22672@kfi7 refs 2
00000400:00000200:20.0:1773851873.967775:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005eaa5201 nid 22672@kfi7 refs 3
00000400:00000200:20.0:1773851873.967777:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22672@kfi7 local destination
00000400:00000200:20.0:1773851873.967778:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769454:8769454:1024:4294967295] 22672@kfi7 LPNI seq info [304766:304766:16:4294967295]
00000400:00000200:20.0:1773851873.967779:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005eaa5201 nid 22672@kfi7 refs 2
00000400:00000200:20.0:1773851873.967780:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22672@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.967782:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22672@kfi7(22672@kfi7:22672@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851873.967783:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005eaa5201 nid 22672@kfi7 refs 3
00000800:00000200:20.0:1773851873.967785:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851873.967786:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851873.967788:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851873.967791:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x55a Using peer 22672@kfi7(0x55a)
00000800:00000200:20.0:1773851873.967793:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x55a: rc=0
00000800:00000200:20.0:1773851873.967795:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x55a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851873.967797:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.967798:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001be2fdeb refcount 2 to 22672@kfi7
00010000:00000001:20.0:1773851873.967798:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851873.967799:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.967800:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851873.967800:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001d4e0a68 x1859597932159424/t0(0) o400->1079588d-d921-4302-8821-6592fd6df456@22672@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1906-0'
00000100:00100000:20.0:1773851873.967804:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d4e0a68 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1079588d-d921-4302-8821-6592fd6df456+5:39710:x1859597932159424:12345-22672@kfi7:400:default-tuolumne1906-0 Request processed in 60us (94us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851873.967806:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22672@kfi7, seq: 1997997
00000100:00000040:20.0:1773851873.967807:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000894ea166 : new rpc_count 0
00000100:00000001:20.0:1773851873.967808:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851873.967809:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851873.967809:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.967810:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851873.967811:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040bbe88b.
00000020:00000040:20.0:1773851873.967812:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000894ea166 : new refcount 4
00000100:00000001:20.0:1773851873.967812:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851873.967819:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x55a TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851873.967822:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.967823:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22672@kfi7: PUT: OK
00000400:00000200:21.0:1773851873.967825:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000408d3b17
00000400:00000010:21.0:1773851873.967825:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000408d3b17.
00000100:00000001:21.0:1773851873.967827:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851873.967827:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851873.967828:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005eaa5201 nid 22672@kfi7 refs 2
00000800:00000200:21.0:1773851873.967831:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 22672@kfi7(00000000024e37a3):0x0 lsk 1371 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x55a Transaction freed
00000800:00000200:21.0:1773851873.985026:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851873.985026:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851873.985027:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851873.985029:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851873.985030:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18881@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.985031:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18881@kfi7 : PUT - for me
00000400:00000200:21.0:1773851873.985032:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18881@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.985033:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000608bcc30 nid 18881@kfi7 refs 1
00000400:00000200:21.0:1773851873.985034:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18881@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.985035:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000608bcc30 nid 18881@kfi7 refs 2
00000400:00000200:21.0:1773851873.985035:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000608bcc30 nid 18881@kfi7 refs 3
00000400:00000200:21.0:1773851873.985036:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18881@kfi7 to cpt 5
00000400:00000200:21.0:1773851873.985037:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18881@kfi7 of length 224 into portal 12 MB=0x69b4c3eeb2b40
00000400:00000200:21.0:1773851873.985038:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18881@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 44296
00000800:00000200:21.0:1773851873.985040:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851873.985041:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.985042:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18881@kfi7: PUT: OK
00000100:00000001:21.0:1773851873.985042:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851873.985043:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851873.985043:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009fede94f.
00000100:00000040:21.0:1773851873.985044:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009fede94f x1859601635683136 msgsize 224
00000100:00100000:21.0:1773851873.985045:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18881@kfi7 (source: 12345-18881@kfi7)
00000100:00000001:21.0:1773851873.985046:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851873.985047:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000608bcc30 nid 18881@kfi7 refs 2
00000800:00000200:21.0:1773851873.985048:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851873.985048:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851873.985048:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851873.985048:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851873.985049:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851873.985049:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851873.985050:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601635683136
00000020:00000001:20.0:1773851873.985050:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851873.985051:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78656
00000020:00000001:20.0:1773851873.985051:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851873.985056:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000037ae80fe refcount=5
00000020:00000001:20.0:1773851873.985057:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102637422592 : -106971072129024 : ffff9eb5db3e9800)
00000020:00000001:20.0:1773851873.985057:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637102637422592 : -106971072129024 : ffff9eb5db3e9800)
00000100:00000001:20.0:1773851873.985058:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.985059:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851873.985060:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000539a19d6.
00000020:00000010:20.0:1773851873.985060:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.985061:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851873.985062:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851873.985062:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851873.985062:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851873.985063:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851873.985064:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851873.985064:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.985065:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851873.985066:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851873.985066:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851873.985066:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851873.985067:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851873.985067:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18881@kfi7, seq: 1997998
00000100:00000001:23.0:1773851873.985068:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.985068:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000037ae80fe : new rpc_count 1
00000100:00000001:23.0:1773851873.985069:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.985069:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637072253757568 : -107001455794048 : ffff9eaec83ca880)
00000100:00000040:20.0:1773851873.985070:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009fede94f x1859601635683136/t0(0) o400->a4d5a6d7-6e0b-4940-be98-24d63012393d@18881@kfi7:600/0 lens 224/0 e 0 to 0 dl 1773851960 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1667-0'
00000100:00000001:20.0:1773851873.985072:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851873.985073:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851873.985073:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009fede94f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:a4d5a6d7-6e0b-4940-be98-24d63012393d+5:39547:x1859601635683136:12345-18881@kfi7:400:default-tuolumne1667-0
00000100:00000200:20.0:1773851873.985074:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601635683136
00000020:00000001:20.0:1773851873.985075:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851873.985076:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851873.985076:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.985077:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851873.985077:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851873.985078:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851873.985078:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601635683136, found 0 last_xid 1859601635683135
00000020:00000001:20.0:1773851873.985079:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851873.985079:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851873.985080:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851873.985080:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.985080:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851873.985081:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851873.985081:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851873.985082:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001a268645.
02000000:00000001:20.0:1773851873.985082:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.985083:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.985083:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851873.985084:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262836235, transno 0, xid 1859601635683136
00010000:00000001:20.0:1773851873.985085:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851873.985085:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009fede94f x1859601635683136/t0(0) o400->a4d5a6d7-6e0b-4940-be98-24d63012393d@18881@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1667-0'
00010000:00000001:20.0:1773851873.985088:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851873.985088:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851873.985089:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=106 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851873.985090:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851873.985091:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000341c334b refcount 3 to 18881@kfi7
00000100:00000001:20.0:1773851873.985092:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094208 : -107139307457408 : ffff9e8eafa33480)
02000000:00000001:20.0:1773851873.985092:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851873.985093:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851873.985093:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851873.985094:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18881@kfi7
00000400:00000010:20.0:1773851873.985095:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a48173f.
00000100:00000200:20.0:1773851873.985095:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601635683136, offset 224
00000400:00000200:20.0:1773851873.985097:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18881@kfi7
00000400:00000200:20.0:1773851873.985097:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18881@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.985098:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000608bcc30 nid 18881@kfi7 refs 1
00000400:00000200:20.0:1773851873.985099:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000608bcc30 nid 18881@kfi7 refs 2
00000400:00000200:20.0:1773851873.985100:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000608bcc30 nid 18881@kfi7 refs 3
00000400:00000200:20.0:1773851873.985101:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18881@kfi7 local destination
00000400:00000200:20.0:1773851873.985102:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769455:8769455:1024:4294967295] 18881@kfi7 LPNI seq info [490081:490081:16:4294967295]
00000400:00000200:20.0:1773851873.985104:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000608bcc30 nid 18881@kfi7 refs 2
00000400:00000200:20.0:1773851873.985104:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18881@kfi7 to cpt 5
00000400:00000200:20.0:1773851873.985106:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18881@kfi7(18881@kfi7:18881@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851873.985107:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000608bcc30 nid 18881@kfi7 refs 3
00000800:00000200:20.0:1773851873.985109:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851873.985110:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851873.985112:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851873.985114:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001cb Using peer 18881@kfi7(0x1000000000001cb)
00000800:00000200:20.0:1773851873.985117:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x1000000000001cb: rc=0
00000800:00000200:20.0:1773851873.985118:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851873.985122:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851873.985123:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000341c334b refcount 2 to 18881@kfi7
00010000:00000001:20.0:1773851873.985124:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851873.985124:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851873.985125:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851873.985126:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009fede94f x1859601635683136/t0(0) o400->a4d5a6d7-6e0b-4940-be98-24d63012393d@18881@kfi7:600/0 lens 224/224 e 0 to 0 dl 1773851960 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1667-0'
00000100:00100000:20.0:1773851873.985129:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009fede94f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:a4d5a6d7-6e0b-4940-be98-24d63012393d+5:39547:x1859601635683136:12345-18881@kfi7:400:default-tuolumne1667-0 Request processed in 56us (84us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851873.985131:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18881@kfi7, seq: 1997998
00000100:00000040:20.0:1773851873.985132:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000037ae80fe : new rpc_count 0
00000100:00000001:20.0:1773851873.985132:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851873.985133:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851873.985133:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851873.985134:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000020:00000010:20.0:1773851873.985134:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000539a19d6.
00000020:00000040:20.0:1773851873.985135:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000037ae80fe : new refcount 4
00000100:00000001:20.0:1773851873.985136:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851873.985140:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001cb TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851873.985142:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851873.985143:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18881@kfi7: PUT: OK
00000400:00000200:21.0:1773851873.985143:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a48173f
00000400:00000010:21.0:1773851873.985143:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a48173f.
00000100:00000001:21.0:1773851873.985144:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851873.985144:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851873.985145:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000608bcc30 nid 18881@kfi7 refs 2
00000800:00000200:21.0:1773851873.985146:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 18881@kfi7(0000000040fd0546):0x0 lsk 460 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000001cb Transaction freed
00000800:00000200:13.0:1773851874.017824:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851874.017825:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851874.017826:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851874.017828:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851874.017830:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18417@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.017832:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18417@kfi7 : PUT - for me
00000400:00000200:13.0:1773851874.017833:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18417@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.017834:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f28ad24 nid 18417@kfi7 refs 1
00000400:00000200:13.0:1773851874.017835:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18417@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.017836:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f28ad24 nid 18417@kfi7 refs 2
00000400:00000200:13.0:1773851874.017837:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009f28ad24 nid 18417@kfi7 refs 3
00000400:00000200:13.0:1773851874.017838:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18417@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.017839:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18417@kfi7 of length 224 into portal 12 MB=0x69b82e345b880
00000400:00000200:13.0:1773851874.017840:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18417@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 35720
00000800:00000200:13.0:1773851874.017842:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851874.017843:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851874.017844:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18417@kfi7: PUT: OK
00000100:00000001:13.0:1773851874.017845:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851874.017846:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851874.017847:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f511326d.
00000100:00000040:13.0:1773851874.017847:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000f511326d x1859836321314944 msgsize 224
00000100:00100000:13.0:1773851874.017849:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18417@kfi7 (source: 12345-18417@kfi7)
00000100:00000001:13.0:1773851874.017850:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851874.017851:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851874.017851:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009f28ad24 nid 18417@kfi7 refs 2
02000000:00000001:15.0:1773851874.017852:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851874.017852:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851874.017853:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851874.017853:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851874.017854:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851874.017855:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836321314944
00000020:00000001:15.0:1773851874.017855:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851874.017856:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d5fd31
00000020:00000001:15.0:1773851874.017857:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851874.017862:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000468a8c14 refcount=5
00000020:00000001:15.0:1773851874.017862:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637162716091392 : -106910993460224 : ffff9ec3d8365400)
00000020:00000001:15.0:1773851874.017863:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637162716091392 : -106910993460224 : ffff9ec3d8365400)
00000100:00000001:15.0:1773851874.017864:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.017865:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851874.017866:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000055324ba3.
00000020:00000010:15.0:1773851874.017867:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851874.017868:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851874.017869:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851874.017869:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851874.017870:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851874.017871:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851874.017871:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851874.017872:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.017873:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851874.017874:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851874.017874:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851874.017875:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851874.017875:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851874.017876:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18417@kfi7, seq: 2289858
00000100:00000040:15.0:1773851874.017877:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000468a8c14 : new rpc_count 1
00000100:00000001:12.0:1773851874.017877:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851874.017877:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.017878:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970977792 : -107043738573824 : ffff9ea4effca400)
00000100:00000040:15.0:1773851874.017879:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f511326d x1859836321314944/t0(0) o400->ebfe10f6-67bb-42cd-aa9e-77bf101e1217@18417@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1629-0'
00000100:00000001:15.0:1773851874.017882:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.017882:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851874.017883:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f511326d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ebfe10f6-67bb-42cd-aa9e-77bf101e1217+5:40067:x1859836321314944:12345-18417@kfi7:400:default-tuolumne1629-0
00000100:00000200:15.0:1773851874.017885:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836321314944
00000020:00000001:15.0:1773851874.017885:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851874.017886:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851874.017886:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.017887:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851874.017888:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851874.017888:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851874.017889:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836321314944, found 0 last_xid 1859836321314943
00000020:00000001:15.0:1773851874.017890:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851874.017891:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851874.017891:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851874.017892:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.017892:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851874.017893:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851874.017893:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851874.017894:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000087ba5545.
02000000:00000001:15.0:1773851874.017895:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.017896:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.017897:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851874.017897:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183190070692, transno 0, xid 1859836321314944
00010000:00000001:15.0:1773851874.017898:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851874.017899:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f511326d x1859836321314944/t0(0) o400->ebfe10f6-67bb-42cd-aa9e-77bf101e1217@18417@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1629-0'
00010000:00000001:15.0:1773851874.017901:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851874.017902:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851874.017902:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=107 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851874.017904:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851874.017904:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000975bc665 refcount 3 to 18417@kfi7
00000100:00000001:15.0:1773851874.017905:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155584 : -107139310396032 : ffff9e8eaf765d80)
02000000:00000001:15.0:1773851874.017906:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851874.017906:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.017907:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851874.017908:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18417@kfi7
00000400:00000010:15.0:1773851874.017909:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006efdb9c7.
00000100:00000200:15.0:1773851874.017909:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836321314944, offset 224
00000400:00000200:15.0:1773851874.017911:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18417@kfi7
00000400:00000200:15.0:1773851874.017911:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18417@kfi7 to cpt 3
00000400:00000200:15.0:1773851874.017912:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f28ad24 nid 18417@kfi7 refs 1
00000400:00000200:15.0:1773851874.017913:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009f28ad24 nid 18417@kfi7 refs 2
00000400:00000200:15.0:1773851874.017915:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009f28ad24 nid 18417@kfi7 refs 3
00000400:00000200:15.0:1773851874.017916:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18417@kfi7 local destination
00000400:00000200:15.0:1773851874.017917:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769456:8769456:1024:4294967295] 18417@kfi7 LPNI seq info [167231:167231:16:4294967295]
00000400:00000200:15.0:1773851874.017918:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009f28ad24 nid 18417@kfi7 refs 2
00000400:00000200:15.0:1773851874.017919:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18417@kfi7 to cpt 3
00000400:00000200:15.0:1773851874.017921:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18417@kfi7(18417@kfi7:18417@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851874.017922:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009f28ad24 nid 18417@kfi7 refs 3
00000800:00000200:15.0:1773851874.017924:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851874.017925:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851874.017927:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851874.017930:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000074 Using peer 18417@kfi7(0x100000000000074)
00000800:00000200:15.0:1773851874.017933:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x100000000000074: rc=0
00000800:00000200:15.0:1773851874.017934:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000074 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851874.017936:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.017937:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000975bc665 refcount 2 to 18417@kfi7
00010000:00000001:15.0:1773851874.017938:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851874.017938:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.017939:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851874.017940:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f511326d x1859836321314944/t0(0) o400->ebfe10f6-67bb-42cd-aa9e-77bf101e1217@18417@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1629-0'
00000100:00100000:15.0:1773851874.017943:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f511326d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ebfe10f6-67bb-42cd-aa9e-77bf101e1217+5:40067:x1859836321314944:12345-18417@kfi7:400:default-tuolumne1629-0 Request processed in 60us (94us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851874.017945:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18417@kfi7, seq: 2289858
00000100:00000040:15.0:1773851874.017946:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000468a8c14 : new rpc_count 0
00000100:00000001:15.0:1773851874.017947:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851874.017947:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851874.017947:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000074 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851874.017948:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851874.017948:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:13.0:1773851874.017948:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851874.017949:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000055324ba3.
00000400:00000200:13.0:1773851874.017949:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18417@kfi7: PUT: OK
00000020:00000040:15.0:1773851874.017950:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000468a8c14 : new refcount 4
00000100:00000001:15.0:1773851874.017950:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851874.017950:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006efdb9c7
00000400:00000010:13.0:1773851874.017951:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006efdb9c7.
00000100:00000001:13.0:1773851874.017951:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851874.017952:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851874.017953:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009f28ad24 nid 18417@kfi7 refs 2
00000800:00000200:13.0:1773851874.017954:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 18417@kfi7(00000000450617e3):0x0 lsk 117 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000074 Transaction freed
00000800:00000200:17.0:1773851874.059406:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851874.059407:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851874.059409:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851874.059414:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.059417:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.059420:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.45@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851874.059422:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.059423:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851874.059426:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.45@o2ib60 to cpt 6
00000400:00000200:17.0:1773851874.059428:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb50a9ca nid 192.168.128.45@o2ib60 refs 2
00000400:00000200:17.0:1773851874.059431:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bb50a9ca nid 192.168.128.45@o2ib60 refs 3
00000400:00000200:17.0:1773851874.059433:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.45@o2ib60 to cpt 6
00000400:00000200:17.0:1773851874.059435:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.45@o2ib60 of length 224 into portal 12 MB=0x69b19ca65c8c0
00000400:00000200:17.0:1773851874.059438:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.45@o2ib60 of length 224/224 into md 0x16159c9699 [64] + 20536
00000800:00000200:17.0:1773851874.059442:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851874.059446:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.059448:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851874.059449:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851874.059450:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851874.059452:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031d7d84c.
00000100:00000040:17.0:1773851874.059453:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000031d7d84c x1859384932419776 msgsize 224
00000100:00100000:17.0:1773851874.059457:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.45@o2ib60 (source: 12345-192.168.128.45@o2ib60)
00000100:00000001:17.0:1773851874.059461:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851874.059463:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851874.059465:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851874.059466:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851874.059467:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851874.059468:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851874.059469:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851874.059470:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851874.059471:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859384932419776
00000020:00000001:27.0:1773851874.059472:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851874.059473:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793b009b8b
00000020:00000001:27.0:1773851874.059474:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851874.059477:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000369c630a refcount=12
00000020:00000001:27.0:1773851874.059478:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917849395200 : -107155860156416 : ffff9e8ad5051000)
00000020:00000001:27.0:1773851874.059480:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917849395200 : -107155860156416 : ffff9e8ad5051000)
00000100:00000001:27.0:1773851874.059482:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.059484:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851874.059485:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851874.059487:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.059488:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851874.059490:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851874.059491:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851874.059492:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.059494:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851874.059494:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851874.059495:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.059497:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.059499:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.059500:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851874.059501:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851874.059502:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851874.059503:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.45@o2ib60, seq: 2025119
00000100:00000040:27.0:1773851874.059505:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000369c630a : new rpc_count 8
00000100:00000001:26.0:1773851874.059505:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.059506:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372334848 : -107078337216768 : ffff9e9ce1bf3f00)
00000100:00000001:26.0:1773851874.059506:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.059509:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000031d7d84c x1859384932419776/t0(0) o400->087d6d67-1f17-4c7d-a1ce-16981fcbca19@192.168.128.45@o2ib60:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix45-0'
00000100:00000001:27.0:1773851874.059515:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.059515:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851874.059517:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031d7d84c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:087d6d67-1f17-4c7d-a1ce-16981fcbca19+12:39854:x1859384932419776:12345-192.168.128.45@o2ib60:400:default-matrix45-0
00000100:00000200:27.0:1773851874.059520:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859384932419776
00000020:00000001:27.0:1773851874.059521:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851874.059523:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851874.059524:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.059525:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851874.059526:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851874.059528:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851874.059529:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859384932419776, found 0 last_xid 1859384869076415
00000020:00000001:27.0:1773851874.059530:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851874.059532:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851874.059533:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851874.059534:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.059535:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851874.059536:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851874.059537:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851874.059538:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b64658a.
02000000:00000001:27.0:1773851874.059540:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.059541:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.059542:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851874.059543:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183233994615, transno 0, xid 1859384932419776
00010000:00000001:27.0:1773851874.059545:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851874.059547:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000031d7d84c x1859384932419776/t0(0) o400->087d6d67-1f17-4c7d-a1ce-16981fcbca19@192.168.128.45@o2ib60:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix45-0'
00010000:00000001:27.0:1773851874.059552:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851874.059553:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851874.059554:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851874.059556:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851874.059557:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000020491bd7 refcount 3 to 192.168.128.45@o2ib60
00000100:00000001:27.0:1773851874.059559:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857248 : -107149578694368 : ffff9e8c4b6c9120)
02000000:00000001:27.0:1773851874.059560:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851874.059561:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.059562:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851874.059565:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.45@o2ib60
00000400:00000010:27.0:1773851874.059566:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098be1f67.
00000100:00000200:27.0:1773851874.059568:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859384932419776, offset 224
00000400:00000200:27.0:1773851874.059571:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.45@o2ib60
00000400:00000200:27.0:1773851874.059573:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.45@o2ib60 to cpt 6
00000400:00000200:27.0:1773851874.059575:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb50a9ca nid 192.168.128.45@o2ib60 refs 2
00000400:00000200:27.0:1773851874.059577:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bb50a9ca nid 192.168.128.45@o2ib60 refs 3
00000400:00000200:27.0:1773851874.059580:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bb50a9ca nid 192.168.128.45@o2ib60 refs 4
00000400:00000200:27.0:1773851874.059582:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.45@o2ib60 routed destination
00000400:00000200:27.0:1773851874.059584:0:41182:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:27.0:1773851874.059587:0:41182:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:27.0:1773851874.059590:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.45@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851874.059592:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:27.0:1773851874.059594:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.45@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851874.059596:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:27.0:1773851874.059598:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769457:8769457:1024:4294967295] 2094@kfi7 LPNI seq info [1258747000:1258747000:16:4294967295]
00000400:00000200:27.0:1773851874.059601:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:27.0:1773851874.059602:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:27.0:1773851874.059607:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.45@o2ib60(192.168.128.45@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851874.059610:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bb50a9ca nid 192.168.128.45@o2ib60 refs 3
00000800:00000200:27.0:1773851874.059613:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851874.059615:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851874.059619:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851874.059623:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:27.0:1773851874.059629:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:27.0:1773851874.059632:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851874.059636:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.059638:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000020491bd7 refcount 2 to 192.168.128.45@o2ib60
00010000:00000001:27.0:1773851874.059639:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851874.059640:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.059641:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851874.059643:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031d7d84c x1859384932419776/t0(0) o400->087d6d67-1f17-4c7d-a1ce-16981fcbca19@192.168.128.45@o2ib60:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix45-0'
00000800:00000200:26.0:1773851874.059647:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851874.059649:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031d7d84c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:087d6d67-1f17-4c7d-a1ce-16981fcbca19+12:39854:x1859384932419776:12345-192.168.128.45@o2ib60:400:default-matrix45-0 Request processed in 133us (195us total) trans 0 rc 0/0
00000400:00000200:26.0:1773851874.059651:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851874.059653:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00100000:27.0:1773851874.059654:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.45@o2ib60, seq: 2025119
00000400:00000200:26.0:1773851874.059654:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098be1f67
00000400:00000010:26.0:1773851874.059655:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098be1f67.
00000100:00000040:27.0:1773851874.059656:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000369c630a : new rpc_count 7
00000100:00000001:27.0:1773851874.059657:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851874.059657:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851874.059658:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:26.0:1773851874.059658:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851874.059659:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:26.0:1773851874.059660:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:27.0:1773851874.059661:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000020:00000010:27.0:1773851874.059662:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000800:00000200:26.0:1773851874.059663:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Transaction freed
00000020:00000040:27.0:1773851874.059664:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000369c630a : new refcount 11
00000100:00000001:27.0:1773851874.059665:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851874.079783:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.079784:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.079786:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.079788:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851874.079789:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.079791:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.114@tcp : PUT - for me
00000400:00000200:9.0:1773851874.079792:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.079793:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851874.079794:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.114@tcp to cpt 6
00000400:00000200:9.0:1773851874.079795:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a60b7f8c nid 172.16.70.114@tcp refs 2
00000400:00000200:9.0:1773851874.079796:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a60b7f8c nid 172.16.70.114@tcp refs 3
00000400:00000200:9.0:1773851874.079797:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.114@tcp to cpt 6
00000400:00000200:9.0:1773851874.079798:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.114@tcp of length 224 into portal 12 MB=0x69a0f6bbcafc0
00000400:00000200:9.0:1773851874.079801:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.114@tcp of length 224/224 into md 0x16159c9699 [64] + 20760
00000800:00000200:9.0:1773851874.079803:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851874.079805:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851874.079806:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851874.079807:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851874.079808:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851874.079809:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b6048351.
00000100:00000040:9.0:1773851874.079809:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000b6048351 x1858240882978752 msgsize 224
00000100:00100000:9.0:1773851874.079811:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.114@tcp (source: 12345-172.16.70.114@tcp)
00000100:00000001:9.0:1773851874.079815:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851874.079816:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851874.079817:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851874.079818:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851874.079818:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851874.079819:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851874.079819:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851874.079820:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851874.079820:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858240882978752
00000020:00000001:27.0:1773851874.079821:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851874.079821:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9308a
00000020:00000001:27.0:1773851874.079822:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851874.079824:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006ddc2721 refcount=905
00000020:00000001:27.0:1773851874.079825:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745158656 : -107128964392960 : ffff9e911821d800)
00000020:00000001:27.0:1773851874.079825:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745158656 : -107128964392960 : ffff9e911821d800)
00000100:00000001:27.0:1773851874.079826:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.079827:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851874.079827:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851874.079828:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.079828:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851874.079829:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851874.079829:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851874.079830:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.079831:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851874.079831:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851874.079831:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.079832:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.079833:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.079834:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851874.079834:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851874.079834:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851874.079835:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.114@tcp, seq: 2025120
00000100:00000040:27.0:1773851874.079836:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006ddc2721 : new rpc_count 2
00000100:00000001:27.0:1773851874.079836:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096230144 : -107006613321472 : ffff9ead94d30900)
00000100:00000001:26.0:1773851874.079836:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.079836:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.079838:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b6048351 x1858240882978752/t0(0) o400->79de3b68-ec74-4af8-b97f-dafca97ebc51@172.16.70.114@tcp:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic14-0'
00000100:00000001:27.0:1773851874.079841:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.079841:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851874.079842:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6048351 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:79de3b68-ec74-4af8-b97f-dafca97ebc51+905:50172:x1858240882978752:12345-172.16.70.114@tcp:400:default-rzslic14-0
00000100:00000200:27.0:1773851874.079843:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858240882978752
00000020:00000001:27.0:1773851874.079844:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851874.079844:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851874.079845:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.079845:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851874.079846:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851874.079846:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851874.079847:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858240882978752, found 0 last_xid 1858240876700479
00000020:00000001:27.0:1773851874.079847:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851874.079848:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851874.079848:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851874.079849:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.079850:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851874.079850:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851874.079850:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851874.079851:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000039f5b622.
02000000:00000001:27.0:1773851874.079851:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.079852:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.079853:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851874.079853:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858240882978752
00010000:00000001:27.0:1773851874.079854:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851874.079854:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b6048351 x1858240882978752/t0(0) o400->79de3b68-ec74-4af8-b97f-dafca97ebc51@172.16.70.114@tcp:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic14-0'
00010000:00000001:27.0:1773851874.079857:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851874.079857:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851874.079859:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851874.079859:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851874.079860:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bfbf713a refcount 3 to 172.16.70.114@tcp
00000100:00000001:27.0:1773851874.079861:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313738528 : -107139395813088 : ffff9e8eaa5f0120)
02000000:00000001:27.0:1773851874.079862:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851874.079862:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.079863:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851874.079864:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.114@tcp
00000400:00000010:27.0:1773851874.079864:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eacefcf8.
00000100:00000200:27.0:1773851874.079865:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858240882978752, offset 224
00000400:00000200:27.0:1773851874.079866:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.114@tcp
00000400:00000200:27.0:1773851874.079867:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.114@tcp to cpt 6
00000400:00000200:27.0:1773851874.079868:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a60b7f8c nid 172.16.70.114@tcp refs 2
00000400:00000200:27.0:1773851874.079869:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a60b7f8c nid 172.16.70.114@tcp refs 3
00000400:00000200:27.0:1773851874.079870:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a60b7f8c nid 172.16.70.114@tcp refs 4
00000400:00000200:27.0:1773851874.079871:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.114@tcp routed destination
00000400:00000200:27.0:1773851874.079872:0:41182:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:27.0:1773851874.079873:0:41182:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:27.0:1773851874.079874:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.114@tcp: rtr pref emtpy: 1
00000400:00000200:27.0:1773851874.079875:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:27.0:1773851874.079876:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.114@tcp: rtr pref emtpy: 1
00000400:00000200:27.0:1773851874.079877:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:27.0:1773851874.079878:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769458:8769458:1024:4294967295] 2094@kfi7 LPNI seq info [1258747001:1258747001:16:4294967295]
00000400:00000200:27.0:1773851874.079879:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:27.0:1773851874.079880:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:27.0:1773851874.079882:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.114@tcp(172.16.70.114@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851874.079883:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a60b7f8c nid 172.16.70.114@tcp refs 3
00000800:00000200:27.0:1773851874.079885:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851874.079885:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851874.079888:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851874.079890:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:27.0:1773851874.079893:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:27.0:1773851874.079894:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851874.079896:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.079897:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bfbf713a refcount 2 to 172.16.70.114@tcp
00010000:00000001:27.0:1773851874.079897:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851874.079898:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.079898:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851874.079899:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b6048351 x1858240882978752/t0(0) o400->79de3b68-ec74-4af8-b97f-dafca97ebc51@172.16.70.114@tcp:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic14-0'
00000100:00100000:27.0:1773851874.079902:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6048351 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:79de3b68-ec74-4af8-b97f-dafca97ebc51+905:50172:x1858240882978752:12345-172.16.70.114@tcp:400:default-rzslic14-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851874.079904:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.114@tcp, seq: 2025120
00000800:00000200:25.0:1773851874.079904:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00000040:27.0:1773851874.079905:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006ddc2721 : new rpc_count 1
00000100:00000001:27.0:1773851874.079905:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851874.079906:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851874.079906:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851874.079906:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851874.079907:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000020:00000010:27.0:1773851874.079907:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000400:00000200:25.0:1773851874.079907:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000040:27.0:1773851874.079908:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000006ddc2721 : new refcount 904
00000100:00000001:27.0:1773851874.079908:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851874.079908:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eacefcf8
00000400:00000010:25.0:1773851874.079908:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eacefcf8.
00000100:00000001:25.0:1773851874.079909:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851874.079910:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851874.079910:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:25.0:1773851874.079911:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Transaction freed
00000004:00000001:15.0:1773851874.121730:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:3.0:1773851874.121730:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:15.0:1773851874.121731:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:11.0:1773851874.121731:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851874.121731:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:3.0:1773851874.121731:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:3.0:1773851874.121731:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8f0219f.
00000100:00000010:15.0:1773851874.121732:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002cc2fb00.
00000004:00000020:11.0:1773851874.121732:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851874.121732:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000158ac04d.
00000004:00000020:10.0:1773851874.121732:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:3.0:1773851874.121732:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000020:00000040:15.0:1773851874.121733:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000020:00000040:11.0:1773851874.121733:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000100:00000010:10.0:1773851874.121733:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005684d651.
00000020:00000040:10.0:1773851874.121733:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:3.0:1773851874.121733:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:15.0:1773851874.121734:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:11.0:1773851874.121734:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851874.121734:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:3.0:1773851874.121734:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:15.0:1773851874.121735:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851874.121735:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851874.121735:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:3.0:1773851874.121735:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851874.121735:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000656b9a03.
02000000:00000001:15.0:1773851874.121736:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851874.121736:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851874.121736:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851874.121736:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851874.121737:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000011f33f0e.
02000000:00000010:10.0:1773851874.121737:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000f701454e.
00000100:00000001:3.0:1773851874.121737:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:15.0:1773851874.121738:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a6ca1bb0.
00000100:00000001:11.0:1773851874.121738:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851874.121738:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851874.121738:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851874.121738:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851874.121738:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.121739:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851874.121739:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851874.121739:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851874.121739:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d8f0219f] to pc [ptlrpcd_00_03+3]  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:15.0:1773851874.121740:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:11.0:1773851874.121740:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000158ac04d] to pc [ptlrpcd_02_02+2]  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851874.121740:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005684d651] to pc [ptlrpcd_02_01+1]  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:15.0:1773851874.121741:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.121742:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002cc2fb00] to pc [ptlrpcd_03_02+2]  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:3.0:1773851874.121743:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:3.0:1773851874.121744:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b8617cf3.
00000100:00000001:2.0:1773851874.121744:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851874.121744:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851874.121744:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:10.0:1773851874.121745:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851874.121745:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851874.121745:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:3.0:1773851874.121745:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637087030528000 : -106986679023616 : ffff9eb239004800)
00000100:00000001:2.0:1773851874.121745:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851874.121745:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851874.121746:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:10.0:1773851874.121746:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000fca76179.
00000100:00000001:9.0:1773851874.121746:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851874.121746:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851874.121746:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851874.121746:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:3.0:1773851874.121746:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:2.0:1773851874.121746:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:11.0:1773851874.121747:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a085f23e.
00080000:00000001:11.0:1773851874.121747:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121742879744 : -106951966671872 : ffff9eba4e04bc00)
00080000:00000001:10.0:1773851874.121747:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121319967744 : -106952389583872 : ffff9eba34cf9c00)
00000100:00000040:9.0:1773851874.121747:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851874.121747:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:3.0:1773851874.121747:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:3.0:1773851874.121747:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00080000:00000001:15.0:1773851874.121748:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851874.121748:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851874.121748:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:11.0:1773851874.121749:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851874.121749:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:3.0:1773851874.121749:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b5cd6995.
00000004:00080000:3.0:1773851874.121749:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614148575024791ns, next at 614149575023549ns, rc = 0
00000100:00000001:2.0:1773851874.121749:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000010:15.0:1773851874.121750:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e118bce3.
00000100:00000001:14.0:1773851874.121750:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851874.121750:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:11.0:1773851874.121750:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00001000:10.0:1773851874.121750:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00000100:00000001:9.0:1773851874.121750:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851874.121750:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.121750:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851874.121750:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851874.121750:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:2.0:1773851874.121750:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851874.121750:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:15.0:1773851874.121751:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636951693207552 : -107122016344064 : ffff9e92b644a800)
00000100:00100000:14.0:1773851874.121751:0:41075:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:12.0:1773851874.121751:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:11.0:1773851874.121751:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000017547e2d.
00000004:00080000:11.0:1773851874.121751:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614148575027086ns, next at 614149575026124ns, rc = 0
00000004:00000010:10.0:1773851874.121751:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004505a24d.
02000000:00000001:9.0:1773851874.121751:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851874.121751:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:3.0:1773851874.121751:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851874.121751:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851874.121751:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851874.121752:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:14.0:1773851874.121752:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00080000:10.0:1773851874.121752:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614148575027456ns, next at 614149575026104ns, rc = 0
02000000:00000001:9.0:1773851874.121752:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851874.121752:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851874.121753:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851874.121753:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:11.0:1773851874.121753:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851874.121753:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851874.121753:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851874.121753:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051931072:6@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851874.121753:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005684d651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051931008:31@kfi7:13:default-yuba2-0
00000100:00100000:2.0:1773851874.121753:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051930944:2095@kfi7:13:default-yuba2-0
00000004:00001000:15.0:1773851874.121754:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00000100:00000001:14.0:1773851874.121754:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:11.0:1773851874.121754:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851874.121754:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851874.121754:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121754:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851874.121754:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:2.0:1773851874.121754:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000010:15.0:1773851874.121755:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000032b2f073.
00000004:00080000:15.0:1773851874.121755:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614148575031003ns, next at 614149575029781ns, rc = 0
00000100:00000001:14.0:1773851874.121755:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851874.121755:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:9.0:1773851874.121755:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851874.121755:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851874.121755:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851874.121755:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851874.121755:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:15.0:1773851874.121756:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:14.0:1773851874.121756:0:41075:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851874.121756:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:9.0:1773851874.121756:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851874.121756:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:2.0:1773851874.121756:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851874.121756:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:15.0:1773851874.121757:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851874.121757:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851874.121757:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851874.121757:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b5df4ab7.
02000000:00000010:8.0:1773851874.121757:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000000aafebd6.
02000000:00000001:8.0:1773851874.121757:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:2.0:1773851874.121757:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f82e5278.
00000004:00000001:15.0:1773851874.121758:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851874.121758:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:9.0:1773851874.121758:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851874.121758:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
02000000:00000001:2.0:1773851874.121758:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851874.121759:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851874.121759:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000010:8.0:1773851874.121759:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000001:14.0:1773851874.121760:0:41075:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:14.0:1773851874.121760:0:41075:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851874.121760:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb5b7920.
00000400:00000010:8.0:1773851874.121760:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000516de938.
00000400:00000200:2.0:1773851874.121760:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000010:2.0:1773851874.121760:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
02000000:00000001:14.0:1773851874.121761:0:41075:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:9.0:1773851874.121761:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c6a04e2b.
00000100:00000200:8.0:1773851874.121761:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931008, portal 4
00000400:00000010:2.0:1773851874.121761:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8c1b5d.
02000000:00000001:14.0:1773851874.121762:0:41075:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851874.121762:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931072, portal 4
00000100:00000001:8.0:1773851874.121762:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851874.121762:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637090064872960 : -106983644678656 : ffff9eb2eddcb600)
00000100:00100000:14.0:1773851874.121763:0:41075:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002cc2fb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051931136:54@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851874.121763:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851874.121763:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889197696 : -106993820353920 : ffff9eb08f583a80)
00000100:00000200:2.0:1773851874.121763:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051930944, portal 4
00000100:00000001:2.0:1773851874.121763:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:14.0:1773851874.121764:0:41075:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:8.0:1773851874.121764:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851874.121764:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288722048 : -106964420829568 : ffff9eb767b15e80)
02000000:00000001:14.0:1773851874.121765:0:41075:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:9.0:1773851874.121765:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:2.0:1773851874.121765:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:14.0:1773851874.121766:0:41075:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851874.121766:0:41075:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:8.0:1773851874.121766:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000010:14.0:1773851874.121767:0:41075:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
00000100:00000001:9.0:1773851874.121767:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851874.121767:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:8.0:1773851874.121767:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc2dfd46.
02000000:00000001:14.0:1773851874.121768:0:41075:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851874.121768:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:9.0:1773851874.121768:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027709c97.
00000400:00000200:14.0:1773851874.121769:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000200:9.0:1773851874.121769:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931072, offset 0
00000100:00000200:8.0:1773851874.121769:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931008, offset 0
00000100:00000001:2.0:1773851874.121769:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:14.0:1773851874.121770:0:41075:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000400:00000010:14.0:1773851874.121770:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000400:00000200:8.0:1773851874.121770:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000100:00000040:2.0:1773851874.121770:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000010:2.0:1773851874.121770:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005884840b.
00000400:00000200:9.0:1773851874.121771:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000400:00000200:8.0:1773851874.121771:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000200:2.0:1773851874.121771:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051930944, offset 0
00000100:00000200:14.0:1773851874.121772:0:41075:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931136, portal 4
00000400:00000200:8.0:1773851874.121772:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000100:00000001:14.0:1773851874.121773:0:41075:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:14.0:1773851874.121773:0:41075:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860222976 : -107049849328640 : ffff9ea383c1ec00)
00000400:00000200:8.0:1773851874.121773:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851874.121773:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:2.0:1773851874.121774:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000040:14.0:1773851874.121775:0:41075:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851874.121775:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:2.0:1773851874.121775:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:8.0:1773851874.121776:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000200:2.0:1773851874.121776:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:14.0:1773851874.121777:0:41075:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:2.0:1773851874.121777:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000100:00000040:14.0:1773851874.121778:0:41075:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000200:8.0:1773851874.121778:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769454, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769458, p:4294967295, g:4294967295, h:1000]
00000400:00000010:14.0:1773851874.121779:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005fd47ac8.
00000400:00000200:2.0:1773851874.121779:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000100:00000200:14.0:1773851874.121780:0:41075:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931136, offset 0
00000400:00000200:8.0:1773851874.121780:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:14.0:1773851874.121781:0:41075:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:8.0:1773851874.121781:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851874.121781:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769454, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769458, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851874.121782:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000200:14.0:1773851874.121783:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851874.121783:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769459:8769459:1024:4294967295] 31@kfi7 LPNI seq info [5403619:5403619:16:4294967295]
00000400:00000200:2.0:1773851874.121783:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:14.0:1773851874.121784:0:41075:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:2.0:1773851874.121784:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851874.121784:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:14.0:1773851874.121785:0:41075:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:8.0:1773851874.121785:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851874.121785:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769460:8769460:1024:4294967295] 2095@kfi7 LPNI seq info [5406043:5406043:16:4294967295]
00000400:00000200:14.0:1773851874.121786:0:41075:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851874.121786:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:14.0:1773851874.121787:0:41075:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:9.0:1773851874.121787:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851874.121787:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:2.0:1773851874.121788:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851874.121789:0:41075:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769460, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769458, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851874.121789:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851874.121790:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:8.0:1773851874.121790:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:14.0:1773851874.121791:0:41075:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851874.121791:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:2.0:1773851874.121791:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851874.121792:0:41075:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851874.121792:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:2.0:1773851874.121792:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:14.0:1773851874.121793:0:41075:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:9.0:1773851874.121793:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:9.0:1773851874.121794:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000800:00000200:2.0:1773851874.121795:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:14.0:1773851874.121796:0:41075:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769461:8769461:1024:4294967295] 54@kfi7 LPNI seq info [5403923:5403923:16:4294967295]
00000400:00000200:9.0:1773851874.121796:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769460, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769461, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851874.121796:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851874.121796:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:14.0:1773851874.121797:0:41075:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:14.0:1773851874.121798:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851874.121798:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:8.0:1773851874.121798:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851874.121799:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:2.0:1773851874.121799:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851874.121800:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:14.0:1773851874.121801:0:41075:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851874.121801:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Using peer 31@kfi7(0x56e)
00000400:00000200:14.0:1773851874.121802:0:41075:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851874.121802:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769462:8769462:1023:4294967295] 6@kfi7 LPNI seq info [5405032:5405032:16:4294967295]
00000800:00000200:2.0:1773851874.121802:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000400:00000200:9.0:1773851874.121803:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:14.0:1773851874.121804:0:41075:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851874.121804:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:8.0:1773851874.121804:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x56e: rc=0
00000800:00000200:14.0:1773851874.121805:0:41075:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851874.121805:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851874.121805:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000014e57432: Posted send of 324 bytes to peer 0x5c0: rc=0
00000400:00000200:9.0:1773851874.121807:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000800:00000200:2.0:1773851874.121807:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:14.0:1773851874.121808:0:41075:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851874.121808:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.121808:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851874.121809:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:8.0:1773851874.121809:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.121809:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851874.121810:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851874.121810:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851874.121811:0:41075:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000800:00000200:9.0:1773851874.121811:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851874.121811:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851874.121811:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851874.121811:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851874.121812:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851874.121812:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.121813:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851874.121813:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851874.121813:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851874.121814:0:41075:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000c8e2b965: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000800:00000200:9.0:1773851874.121814:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851874.121814:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.121814:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851874.121814:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851874.121815:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851874.121815:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:14.0:1773851874.121816:0:41075:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851874.121816:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000100:00000001:2.0:1773851874.121816:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851874.121816:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851874.121817:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851874.121818:0:41075:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851874.121818:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851874.121819:0:41075:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:9.0:1773851874.121819:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000800:00000200:3.0:1773851874.121819:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851874.121820:0:41075:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851874.121820:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:3.0:1773851874.121820:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851874.121821:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851874.121821:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:3.0:1773851874.121821:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:3.0:1773851874.121822:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005884840b
00000100:00000001:9.0:1773851874.121823:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:3.0:1773851874.121823:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005884840b.
00000100:00000001:9.0:1773851874.121824:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:3.0:1773851874.121824:0:2506738:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:10.0:1773851874.121825:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851874.121825:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121825:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:3.0:1773851874.121825:0:2506738:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851874.121826:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851874.121827:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851874.121827:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:3.0:1773851874.121827:0:2506738:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:13.0:1773851874.121828:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851874.121828:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:9.0:1773851874.121828:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000040:3.0:1773851874.121828:0:2506738:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851874.121829:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851874.121829:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc2dfd46
00000100:00000001:9.0:1773851874.121829:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851874.121829:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:13.0:1773851874.121830:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000010:10.0:1773851874.121830:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc2dfd46.
00000100:00000001:10.0:1773851874.121830:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851874.121830:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121830:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851874.121830:0:2506738:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851874.121831:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005fd47ac8
00000400:00000010:13.0:1773851874.121831:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005fd47ac8.
00000100:00000200:10.0:1773851874.121831:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851874.121831:0:2506738:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:13.0:1773851874.121832:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:3.0:1773851874.121832:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000200:13.0:1773851874.121833:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851874.121834:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:9.0:1773851874.121834:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000800:00000200:3.0:1773851874.121834:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000100:00000040:10.0:1773851874.121835:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851874.121836:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:9.0:1773851874.121836:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:13.0:1773851874.121837:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851874.121837:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851874.121837:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:10.0:1773851874.121838:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851874.121838:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027709c97
00000400:00000010:9.0:1773851874.121838:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027709c97.
00000400:00000200:10.0:1773851874.121839:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:9.0:1773851874.121839:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:13.0:1773851874.121840:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851874.121840:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851874.121841:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:10.0:1773851874.121841:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Transaction freed
00000400:00000200:13.0:1773851874.121842:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:9.0:1773851874.121842:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:13.0:1773851874.121843:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000100:00000040:9.0:1773851874.121843:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851874.121845:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121846:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851874.121847:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:9.0:1773851874.121849:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Transaction freed
00000800:00000200:17.0:1773851874.121852:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851874.121853:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851874.121854:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851874.121856:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.121858:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.121859:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:17.0:1773851874.121860:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.121861:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000800:00000200:29.0:1773851874.121862:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851874.121862:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851874.121862:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.121863:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:29.0:1773851874.121864:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851874.121864:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:17.0:1773851874.121865:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:29.0:1773851874.121866:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.121866:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4180
00000400:00000200:17.0:1773851874.121867:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:13.0:1773851874.121867:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:29.0:1773851874.121868:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:13.0:1773851874.121868:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851874.121869:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f1591 [1] + 224
00000800:00000200:13.0:1773851874.121869:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851874.121870:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:29.0:1773851874.121871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:17.0:1773851874.121871:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851874.121872:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:17.0:1773851874.121872:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851874.121872:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851874.121872:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:29.0:1773851874.121873:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851874.121873:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000800:00000200:1.0:1773851874.121873:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851874.121874:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:17.0:1773851874.121874:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851874.121874:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:1.0:1773851874.121874:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851874.121875:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:13.0:1773851874.121875:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000200:29.0:1773851874.121876:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000200:17.0:1773851874.121876:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851874.121877:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4140
00000400:00000200:13.0:1773851874.121877:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.121877:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000800:00000200:1.0:1773851874.121877:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851874.121878:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000040:17.0:1773851874.121879:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851874.121879:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851874.121879:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851874.121880:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x780080d7d [1] + 224
00000400:00000200:13.0:1773851874.121880:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:13.0:1773851874.121880:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:1.0:1773851874.121881:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000800:00000200:29.0:1773851874.121882:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851874.121882:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851874.121882:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000001:17.0:1773851874.121883:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851874.121883:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:29.0:1773851874.121884:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851874.121884:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4200
00000400:00000200:1.0:1773851874.121884:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851874.121885:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:17.0:1773851874.121885:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:13.0:1773851874.121885:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:8.0:1773851874.121885:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851874.121885:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851874.121885:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:17.0:1773851874.121886:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851874.121886:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f64ed [1] + 224
00000400:00000001:8.0:1773851874.121886:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:1.0:1773851874.121886:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000001:8.0:1773851874.121887:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851874.121888:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851874.121888:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:8.0:1773851874.121888:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:8.0:1773851874.121888:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000516de938
00000400:00000200:1.0:1773851874.121888:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000200:29.0:1773851874.121889:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:8.0:1773851874.121889:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000516de938.
00000100:00000001:8.0:1773851874.121889:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851874.121889:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b41c0
00000400:00000200:13.0:1773851874.121890:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:8.0:1773851874.121890:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851874.121890:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851874.121891:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000100:00000040:29.0:1773851874.121892:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851874.121892:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851874.121892:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71d9a1 [1] + 224
00000100:00000200:13.0:1773851874.121893:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851874.121893:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851874.121894:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:29.0:1773851874.121895:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:13.0:1773851874.121896:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851874.121896:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851874.121896:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851874.121896:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851874.121897:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:8.0:1773851874.121897:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851874.121897:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:2.0:1773851874.121897:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:1.0:1773851874.121897:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000800:00000200:29.0:1773851874.121898:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851874.121898:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851874.121898:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851874.121898:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851874.121898:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:13.0:1773851874.121899:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:8.0:1773851874.121899:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:2.0:1773851874.121899:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:2.0:1773851874.121899:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:13.0:1773851874.121900:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00001000:8.0:1773851874.121900:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=107 v=66 (66 66 66 66)
00000400:00000010:2.0:1773851874.121900:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000100:00000200:1.0:1773851874.121900:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851874.121901:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:8.0:1773851874.121901:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=107 v=66 (1 1 1 1)
00000400:00000200:2.0:1773851874.121901:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8c1b5d
00000400:00000010:2.0:1773851874.121901:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8c1b5d.
00000100:00000001:14.0:1773851874.121902:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:14.0:1773851874.121902:0:41075:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:13.0:1773851874.121902:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851874.121902:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851874.121902:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:1.0:1773851874.121902:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:14.0:1773851874.121903:0:41075:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:14.0:1773851874.121903:0:41075:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000100:00000001:8.0:1773851874.121903:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851874.121903:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:2.0:1773851874.121903:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:14.0:1773851874.121904:0:41075:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
00010000:00000001:8.0:1773851874.121904:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:14.0:1773851874.121905:0:41075:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000100:00000001:14.0:1773851874.121905:0:41075:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851874.121905:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851874.121905:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000200:14.0:1773851874.121906:0:41075:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851874.121906:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851874.121906:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:2.0:1773851874.121906:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851874.121906:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851874.121907:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000001:9.0:1773851874.121908:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851874.121908:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:8.0:1773851874.121908:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851874.121908:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851874.121908:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:14.0:1773851874.121909:0:41075:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851874.121909:0:41063:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:2.0:1773851874.121909:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000800:00000200:1.0:1773851874.121909:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:9.0:1773851874.121910:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851874.121910:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851874.121910:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851874.121910:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:9.0:1773851874.121911:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb5b7920.
00000100:00000001:8.0:1773851874.121911:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851874.121911:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851874.121911:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851874.121912:0:41075:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851874.121912:0:41075:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851874.121912:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c6a04e2b
00000400:00000010:9.0:1773851874.121912:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c6a04e2b.
00000100:00000001:8.0:1773851874.121912:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851874.121912:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:2.0:1773851874.121912:0:41063:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=107 v=66 (66 66 66 66)
00000100:00000001:14.0:1773851874.121913:0:41075:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:14.0:1773851874.121913:0:41075:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851874.121913:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000040:8.0:1773851874.121913:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000100:00001000:2.0:1773851874.121913:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=107 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851874.121914:0:41075:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:9.0:1773851874.121914:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:8.0:1773851874.121914:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666655232 avail=351645447168 avail_mb=1373615028 hwm_mb=3131103 files=372237851 ffree=343424468 state=0: rc = 0
00000100:00000001:14.0:1773851874.121915:0:41075:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851874.121915:0:41075:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:8.0:1773851874.121915:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666655232 free, 351645447168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237851 files, 343424468 free files
00000100:00000001:2.0:1773851874.121915:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851874.121915:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851874.121916:0:41075:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=107 v=66 (66 66 66 66)
00010000:00000001:2.0:1773851874.121916:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:2.0:1773851874.121916:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851874.121917:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:8.0:1773851874.121917:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851874.121918:0:41075:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=107 v=66 (1 1 1 1)
00000100:00000040:8.0:1773851874.121918:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851874.121918:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:2.0:1773851874.121918:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000001:2.0:1773851874.121918:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:14.0:1773851874.121919:0:41075:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:14.0:1773851874.121919:0:41075:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121919:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851874.121919:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:14.0:1773851874.121920:0:41075:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:14.0:1773851874.121920:0:41075:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121920:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:8.0:1773851874.121920:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005684d651 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051931008:31@kfi7:13:default-yuba2-0
00000100:00000040:2.0:1773851874.121920:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:14.0:1773851874.121921:0:41075:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851874.121921:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851874.121921:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:14.0:1773851874.121922:0:41075:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:14.0:1773851874.121922:0:41075:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851874.121922:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851874.121922:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851874.121922:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:2.0:1773851874.121922:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851874.121923:0:41075:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121923:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851874.121923:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851874.121923:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005684d651 x1859433051931008/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851874.121923:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:14.0:1773851874.121924:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:9.0:1773851874.121924:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=107 v=66 (66 66 66 66)
00000100:00000001:2.0:1773851874.121924:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851874.121924:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:9.0:1773851874.121925:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=22 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851874.121925:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000040:2.0:1773851874.121925:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000100:00000001:14.0:1773851874.121926:0:41075:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851874.121926:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:8.0:1773851874.121926:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000040:2.0:1773851874.121926:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449341952 avail=351446766592 avail_mb=1372838932 hwm_mb=3131103 files=372160989 ffree=343212248 state=0: rc = 0
00000100:00000001:14.0:1773851874.121927:0:41075:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851874.121927:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851874.121927:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000010:8.0:1773851874.121927:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000000aafebd6.
00000004:00000020:2.0:1773851874.121927:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449341952 free, 351446766592 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160989 files, 343212248 free files
00000100:00000001:14.0:1773851874.121928:0:41075:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:14.0:1773851874.121928:0:41075:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00010000:00000001:9.0:1773851874.121928:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851874.121928:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851874.121928:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851874.121928:0:41069:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000004:00000040:14.0:1773851874.121929:0:41075:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851874.121929:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851874.121929:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000020:00000001:8.0:1773851874.121929:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000001:2.0:1773851874.121929:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:14.0:1773851874.121930:0:41075:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524087808 avail=351521312768 avail_mb=1373130128 hwm_mb=3131103 files=372113888 ffree=343285242 state=0: rc = 0
00000100:00000001:9.0:1773851874.121930:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851874.121930:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851874.121930:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000f701454e.
02000000:00000001:8.0:1773851874.121930:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:2.0:1773851874.121930:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:9.0:1773851874.121931:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:8.0:1773851874.121931:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851874.121931:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005684d651.
00000100:00000001:8.0:1773851874.121932:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000020:14.0:1773851874.121933:0:41075:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524087808 free, 351521312768 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113888 files, 343285242 free files
00000100:00000001:8.0:1773851874.121933:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851874.121933:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:2.0:1773851874.121933:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051930944:2095@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851874.121934:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851874.121934:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851874.121934:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851874.121934:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:14.0:1773851874.121935:0:41075:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121935:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851874.121935:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.121935:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851874.121935:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851874.121935:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:14.0:1773851874.121936:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851874.121936:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851874.121936:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000100:00000040:2.0:1773851874.121936:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d8f0219f x1859433051930944/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:9.0:1773851874.121937:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420277760 avail=351417809920 avail_mb=1372725820 hwm_mb=3131103 files=372008994 ffree=343183865 state=0: rc = 0
00000100:00000001:2.0:1773851874.121938:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00100000:14.0:1773851874.121939:0:41075:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002cc2fb00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051931136:54@kfi7:13:default-yuba2-0
00000004:00000020:9.0:1773851874.121939:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420277760 free, 351417809920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372008994 files, 343183865 free files
02000000:00000001:2.0:1773851874.121939:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:14.0:1773851874.121940:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851874.121940:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:2.0:1773851874.121940:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f82e5278.
00000100:00000001:14.0:1773851874.121941:0:41075:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851874.121941:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:2.0:1773851874.121941:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:2.0:1773851874.121941:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851874.121941:0:41063:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000100:00000040:14.0:1773851874.121942:0:41075:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002cc2fb00 x1859433051931136/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:2.0:1773851874.121942:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:2.0:1773851874.121943:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000656b9a03.
02000000:00000001:2.0:1773851874.121943:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:14.0:1773851874.121944:0:41075:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:14.0:1773851874.121944:0:41075:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:9.0:1773851874.121944:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000158ac04d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051931072:6@kfi7:13:default-yuba2-0
02000000:00000001:2.0:1773851874.121944:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:14.0:1773851874.121945:0:41075:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
00000100:00000001:9.0:1773851874.121945:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:2.0:1773851874.121945:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8f0219f.
00000100:00000001:2.0:1773851874.121945:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:14.0:1773851874.121946:0:41075:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:14.0:1773851874.121946:0:41075:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:9.0:1773851874.121946:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:2.0:1773851874.121946:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851874.121946:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:14.0:1773851874.121947:0:41075:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000100:00000040:9.0:1773851874.121947:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000158ac04d x1859433051931072/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851874.121947:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:14.0:1773851874.121948:0:41075:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:14.0:1773851874.121948:0:41075:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a6ca1bb0.
00000100:00000001:2.0:1773851874.121948:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851874.121948:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:14.0:1773851874.121949:0:41075:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:14.0:1773851874.121949:0:41075:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:9.0:1773851874.121949:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:2.0:1773851874.121949:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:14.0:1773851874.121950:0:41075:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cc2fb00.
02000000:00000001:9.0:1773851874.121950:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851874.121950:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b5df4ab7.
00000100:00000001:14.0:1773851874.121951:0:41075:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:14.0:1773851874.121951:0:41075:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:9.0:1773851874.121951:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:14.0:1773851874.121952:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851874.121952:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851874.121952:0:41070:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000100:00000001:14.0:1773851874.121953:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:14.0:1773851874.121953:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851874.121953:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:14.0:1773851874.121954:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851874.121954:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851874.121954:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000011f33f0e.
02000000:00000001:9.0:1773851874.121954:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851874.121955:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851874.121955:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000158ac04d.
00000100:00000001:9.0:1773851874.121956:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851874.121957:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851874.121957:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851874.121958:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851874.121958:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851874.121959:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851874.121959:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851874.132166:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851874.132167:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851874.132168:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851874.132170:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.132173:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18242@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.132174:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18242@kfi7 : PUT - for me
00000400:00000200:17.0:1773851874.132175:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18242@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.132176:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eee12133 nid 18242@kfi7 refs 1
00000400:00000200:17.0:1773851874.132177:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18242@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.132178:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eee12133 nid 18242@kfi7 refs 2
00000400:00000200:17.0:1773851874.132178:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eee12133 nid 18242@kfi7 refs 3
00000400:00000200:17.0:1773851874.132179:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18307@kfi7 to cpt 3
00000400:00000200:17.0:1773851874.132180:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18307@kfi7 of length 224 into portal 12 MB=0x69b4623ce1840
00000400:00000200:17.0:1773851874.132181:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18307@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 23080
00000800:00000200:17.0:1773851874.132183:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851874.132185:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.132186:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18242@kfi7: PUT: OK
00000100:00000001:17.0:1773851874.132187:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851874.132187:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851874.132188:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad36da86.
00000100:00000040:17.0:1773851874.132189:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ad36da86 x1859575410989120 msgsize 224
00000100:00100000:17.0:1773851874.132190:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18307@kfi7 (source: 12345-18242@kfi7)
00000100:00000001:17.0:1773851874.132191:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851874.132192:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eee12133 nid 18242@kfi7 refs 2
00000800:00000200:17.0:1773851874.132193:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851874.132193:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851874.132193:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851874.132194:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851874.132194:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851874.132195:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851874.132196:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575410989120
00000020:00000001:16.0:1773851874.132196:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851874.132197:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc25ff464
00000020:00000001:16.0:1773851874.132197:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851874.132201:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000092780925 refcount=5
00000020:00000001:16.0:1773851874.132201:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126699851776 : -106947009699840 : ffff9ebb757a2000)
00000020:00000001:16.0:1773851874.132202:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126699851776 : -106947009699840 : ffff9ebb757a2000)
00000100:00000001:16.0:1773851874.132203:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851874.132204:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851874.132205:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091929c7c.
00000020:00000010:16.0:1773851874.132206:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851874.132206:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851874.132207:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851874.132208:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851874.132208:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851874.132209:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851874.132210:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851874.132211:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.132212:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851874.132213:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851874.132213:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851874.132213:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851874.132214:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851874.132214:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18307@kfi7, seq: 2156354
00000100:00000001:17.0:1773851874.132215:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851874.132215:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000092780925 : new rpc_count 1
00000100:00000001:17.0:1773851874.132216:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.132216:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372318720 : -107078337232896 : ffff9e9ce1bf0000)
00000100:00000040:16.0:1773851874.132217:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad36da86 x1859575410989120/t0(0) o400->98f2f277-817f-440d-b225-67f6a5df266a@18307@kfi7:95/0 lens 224/0 e 0 to 0 dl 1773852210 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1640-0'
00000100:00000001:16.0:1773851874.132220:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851874.132220:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851874.132221:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad36da86 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:98f2f277-817f-440d-b225-67f6a5df266a+5:39870:x1859575410989120:12345-18307@kfi7:400:default-tuolumne1640-0
00000100:00000200:16.0:1773851874.132222:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575410989120
00000020:00000001:16.0:1773851874.132223:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851874.132224:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851874.132224:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.132225:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851874.132225:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851874.132226:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851874.132227:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575410989120, found 0 last_xid 1859575410989119
00000020:00000001:16.0:1773851874.132228:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851874.132228:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851874.132229:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851874.132229:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.132230:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851874.132231:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851874.132231:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851874.132232:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006878bf28.
02000000:00000001:16.0:1773851874.132232:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.132233:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.132234:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851874.132234:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254106988, transno 0, xid 1859575410989120
00010000:00000001:16.0:1773851874.132237:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851874.132238:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad36da86 x1859575410989120/t0(0) o400->98f2f277-817f-440d-b225-67f6a5df266a@18307@kfi7:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1640-0'
00010000:00000001:16.0:1773851874.132240:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851874.132241:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851874.132242:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=107 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851874.132243:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851874.132243:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053fca6fb refcount 3 to 18307@kfi7
00000100:00000001:16.0:1773851874.132244:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154240 : -107139310397376 : ffff9e8eaf765840)
02000000:00000001:16.0:1773851874.132245:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851874.132245:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.132246:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851874.132247:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18242@kfi7
00000400:00000010:16.0:1773851874.132247:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037f3647a.
00000100:00000200:16.0:1773851874.132249:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575410989120, offset 224
00000400:00000200:16.0:1773851874.132250:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18242@kfi7
00000400:00000200:16.0:1773851874.132251:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18242@kfi7 to cpt 4
00000400:00000200:16.0:1773851874.132252:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eee12133 nid 18242@kfi7 refs 1
00000400:00000200:16.0:1773851874.132253:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eee12133 nid 18242@kfi7 refs 2
00000400:00000200:16.0:1773851874.132254:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eee12133 nid 18242@kfi7 refs 3
00000400:00000200:16.0:1773851874.132255:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18242@kfi7 local destination
00000400:00000200:16.0:1773851874.132256:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769463:8769463:1024:4294967295] 18242@kfi7 LPNI seq info [1475891:1475891:16:4294967295]
00000400:00000200:16.0:1773851874.132257:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eee12133 nid 18242@kfi7 refs 2
00000400:00000200:16.0:1773851874.132258:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18242@kfi7 to cpt 4
00000400:00000200:16.0:1773851874.132260:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18242@kfi7(18242@kfi7:18242@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851874.132261:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eee12133 nid 18242@kfi7 refs 3
00000800:00000200:16.0:1773851874.132262:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851874.132263:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851874.132265:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851874.132270:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x414 Using peer 18242@kfi7(0x414)
00000800:00000200:16.0:1773851874.132272:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x414: rc=0
00000800:00000200:16.0:1773851874.132274:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x414 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851874.132276:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851874.132277:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053fca6fb refcount 2 to 18307@kfi7
00010000:00000001:16.0:1773851874.132278:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851874.132278:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.132279:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851874.132279:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad36da86 x1859575410989120/t0(0) o400->98f2f277-817f-440d-b225-67f6a5df266a@18307@kfi7:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1640-0'
00000100:00100000:16.0:1773851874.132284:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad36da86 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:98f2f277-817f-440d-b225-67f6a5df266a+5:39870:x1859575410989120:12345-18307@kfi7:400:default-tuolumne1640-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851874.132286:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18307@kfi7, seq: 2156354
00000100:00000040:16.0:1773851874.132287:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000092780925 : new rpc_count 0
00000100:00000001:16.0:1773851874.132288:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851874.132288:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851874.132289:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851874.132289:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851874.132290:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091929c7c.
00000020:00000040:16.0:1773851874.132291:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000092780925 : new refcount 4
00000100:00000001:16.0:1773851874.132292:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851874.132297:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x414 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851874.132298:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.132299:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18242@kfi7: PUT: OK
00000400:00000200:17.0:1773851874.132300:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037f3647a
00000400:00000010:17.0:1773851874.132301:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037f3647a.
00000100:00000001:17.0:1773851874.132302:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851874.132302:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851874.132303:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eee12133 nid 18242@kfi7 refs 2
00000800:00000200:17.0:1773851874.132304:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 18242@kfi7(000000008bf047db):0x0 lsk 1045 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x414 Transaction freed
00000800:00000200:29.0:1773851874.145499:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851874.145500:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851874.145501:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851874.145503:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851874.145504:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17146@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.145506:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17146@kfi7 : PUT - for me
00000400:00000200:29.0:1773851874.145506:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17146@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.145507:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b65446e0 nid 17146@kfi7 refs 1
00000400:00000200:29.0:1773851874.145508:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17146@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.145509:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b65446e0 nid 17146@kfi7 refs 2
00000400:00000200:29.0:1773851874.145510:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b65446e0 nid 17146@kfi7 refs 3
00000400:00000200:29.0:1773851874.145511:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17146@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.145512:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17146@kfi7 of length 224 into portal 12 MB=0x699de89e6c7c0
00000400:00000200:29.0:1773851874.145513:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17146@kfi7 of length 224/224 into md 0x77fe139dd [64] + 182832
00000800:00000200:29.0:1773851874.145515:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851874.145516:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851874.145518:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17146@kfi7: PUT: OK
00000100:00000001:29.0:1773851874.145519:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851874.145520:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851874.145520:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db2f56d6.
00000100:00000040:29.0:1773851874.145521:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000db2f56d6 x1858030935656384 msgsize 224
00000100:00100000:29.0:1773851874.145523:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17146@kfi7 (source: 12345-17146@kfi7)
00000100:00000001:29.0:1773851874.145524:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851874.145524:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b65446e0 nid 17146@kfi7 refs 2
00000100:00000001:31.0:1773851874.145525:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851874.145526:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851874.145526:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851874.145526:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851874.145527:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851874.145528:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851874.145528:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030935656384
00000020:00000001:31.0:1773851874.145529:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851874.145530:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91341
00000020:00000001:31.0:1773851874.145530:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851874.145534:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a2778629 refcount=6
00000020:00000001:31.0:1773851874.145535:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169304064 : -107127540247552 : ffff9e916d049400)
00000020:00000001:31.0:1773851874.145536:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169304064 : -107127540247552 : ffff9e916d049400)
00000100:00000001:31.0:1773851874.145537:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851874.145537:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851874.145538:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851874.145539:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851874.145540:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851874.145541:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851874.145541:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851874.145542:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.145543:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851874.145543:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851874.145543:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.145544:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.145546:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851874.145546:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851874.145546:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851874.145546:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851874.145547:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17146@kfi7, seq: 2055537
00000100:00000040:31.0:1773851874.145548:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a2778629 : new rpc_count 1
00000100:00000001:31.0:1773851874.145548:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085309679104 : -106988399872512 : ffff9eb1d26e3600)
00000100:00000001:28.0:1773851874.145548:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.145549:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000db2f56d6 x1858030935656384/t0(0) o400->0632e372-be0c-48a5-824e-356b80ec021e@17146@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne235-0'
00000100:00000001:28.0:1773851874.145549:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.145552:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851874.145552:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851874.145553:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db2f56d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0632e372-be0c-48a5-824e-356b80ec021e+6:47804:x1858030935656384:12345-17146@kfi7:400:default-tuolumne235-0
00000100:00000200:31.0:1773851874.145555:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030935656384
00000020:00000001:31.0:1773851874.145555:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851874.145556:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851874.145557:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.145558:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851874.145558:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851874.145559:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851874.145560:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030935656384, found 0 last_xid 1858030935656383
00000020:00000001:31.0:1773851874.145560:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851874.145561:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851874.145562:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851874.145562:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.145563:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851874.145563:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851874.145564:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851874.145565:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e821577.
02000000:00000001:31.0:1773851874.145566:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.145566:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.145567:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851874.145568:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767842, transno 0, xid 1858030935656384
00010000:00000001:31.0:1773851874.145569:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851874.145569:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000db2f56d6 x1858030935656384/t0(0) o400->0632e372-be0c-48a5-824e-356b80ec021e@17146@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne235-0'
00010000:00000001:31.0:1773851874.145572:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851874.145572:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851874.145573:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=107 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851874.145574:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851874.145575:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000028d9966a refcount 5 to 17146@kfi7
00000100:00000001:31.0:1773851874.145576:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918079257312 : -107155630294304 : ffff9e8ae2b87ae0)
02000000:00000001:31.0:1773851874.145576:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851874.145577:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.145578:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851874.145578:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17146@kfi7
00000400:00000010:31.0:1773851874.145579:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000811703b3.
00000100:00000200:31.0:1773851874.145580:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030935656384, offset 224
00000400:00000200:31.0:1773851874.145581:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17146@kfi7
00000400:00000200:31.0:1773851874.145582:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17146@kfi7 to cpt 7
00000400:00000200:31.0:1773851874.145583:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b65446e0 nid 17146@kfi7 refs 1
00000400:00000200:31.0:1773851874.145584:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b65446e0 nid 17146@kfi7 refs 2
00000400:00000200:31.0:1773851874.145585:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b65446e0 nid 17146@kfi7 refs 3
00000400:00000200:31.0:1773851874.145586:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17146@kfi7 local destination
00000400:00000200:31.0:1773851874.145587:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769464:8769464:1024:4294967295] 17146@kfi7 LPNI seq info [28012:28012:16:4294967295]
00000400:00000200:31.0:1773851874.145589:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b65446e0 nid 17146@kfi7 refs 2
00000400:00000200:31.0:1773851874.145590:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17146@kfi7 to cpt 7
00000400:00000200:31.0:1773851874.145592:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17146@kfi7(17146@kfi7:17146@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851874.145593:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b65446e0 nid 17146@kfi7 refs 3
00000800:00000200:31.0:1773851874.145594:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851874.145595:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851874.145597:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851874.145599:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0xea Using peer 17146@kfi7(0xea)
00000800:00000200:31.0:1773851874.145602:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0xea: rc=0
00000800:00000200:31.0:1773851874.145604:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0xea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851874.145606:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.145607:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000028d9966a refcount 4 to 17146@kfi7
00010000:00000001:31.0:1773851874.145607:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851874.145608:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.145608:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851874.145609:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db2f56d6 x1858030935656384/t0(0) o400->0632e372-be0c-48a5-824e-356b80ec021e@17146@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne235-0'
00000100:00100000:31.0:1773851874.145612:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db2f56d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0632e372-be0c-48a5-824e-356b80ec021e+6:47804:x1858030935656384:12345-17146@kfi7:400:default-tuolumne235-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851874.145614:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17146@kfi7, seq: 2055537
00000100:00000040:31.0:1773851874.145614:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a2778629 : new rpc_count 0
00000100:00000001:31.0:1773851874.145616:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851874.145616:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0xea TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851874.145617:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851874.145617:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851874.145618:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851874.145618:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000400:00000200:29.0:1773851874.145618:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851874.145618:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17146@kfi7: PUT: OK
00000020:00000040:31.0:1773851874.145619:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000a2778629 : new refcount 5
00000400:00000200:29.0:1773851874.145619:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000811703b3
00000100:00000001:31.0:1773851874.145620:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851874.145620:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000811703b3.
00000100:00000001:29.0:1773851874.145621:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851874.145621:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851874.145622:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b65446e0 nid 17146@kfi7 refs 2
00000800:00000200:29.0:1773851874.145623:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 17146@kfi7(0000000018396c1b):0x0 lsk 235 rsk 89 tsk 0 trmk 0 tmk 0 trr 7 tta 0xea Transaction freed
00000800:00000200:9.0:1773851874.167033:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.167035:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.167037:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.167040:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851874.167043:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.167046:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.163@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851874.167048:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.167049:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851874.167051:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.163@o2ib600 to cpt 4
00000400:00000200:9.0:1773851874.167053:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b5e221f nid 172.19.3.163@o2ib600 refs 2
00000400:00000200:9.0:1773851874.167055:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b5e221f nid 172.19.3.163@o2ib600 refs 3
00000400:00000200:9.0:1773851874.167056:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.163@o2ib600 to cpt 4
00000400:00000200:9.0:1773851874.167058:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.163@o2ib600 of length 224 into portal 12 MB=0x699f24c257440
00000400:00000200:9.0:1773851874.167062:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.163@o2ib600 of length 224/224 into md 0x6ab01b5d1 [64] + 23304
00000800:00000200:9.0:1773851874.167065:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851874.167068:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851874.167069:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851874.167071:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851874.167072:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851874.167073:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003a7add4c.
00000100:00000040:9.0:1773851874.167075:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003a7add4c x1858115798922304 msgsize 224
00000100:00100000:9.0:1773851874.167078:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.163@o2ib600 (source: 12345-172.19.3.163@o2ib600)
00000100:00000001:9.0:1773851874.167080:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851874.167081:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:16.0:1773851874.167084:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851874.167084:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851874.167085:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851874.167085:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851874.167086:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851874.167087:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851874.167088:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858115798922304
00000020:00000001:16.0:1773851874.167089:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851874.167090:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dd0
00000020:00000001:16.0:1773851874.167092:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851874.167094:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffca7236 refcount=6
00000020:00000001:16.0:1773851874.167095:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239490560 : -107152470061056 : ffff9e8b9f15d000)
00000020:00000001:16.0:1773851874.167096:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239490560 : -107152470061056 : ffff9e8b9f15d000)
00000100:00000001:16.0:1773851874.167098:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851874.167099:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851874.167100:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091929c7c.
00000020:00000010:16.0:1773851874.167101:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851874.167102:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851874.167104:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851874.167105:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851874.167106:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851874.167107:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851874.167108:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851874.167108:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.167111:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851874.167112:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851874.167113:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851874.167114:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851874.167114:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851874.167115:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.163@o2ib600, seq: 2156355
00000100:00000001:17.0:1773851874.167117:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851874.167117:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffca7236 : new rpc_count 1
00000100:00000001:17.0:1773851874.167118:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.167118:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096242816 : -107006613308800 : ffff9ead94d33a80)
00000100:00000040:16.0:1773851874.167120:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003a7add4c x1858115798922304/t0(0) o400->45782b6e-ef6b-4a60-a8f4-af8bc0526124@172.19.3.163@o2ib600:95/0 lens 224/0 e 0 to 0 dl 1773852210 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic13-0'
00000100:00000001:16.0:1773851874.167125:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851874.167125:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851874.167127:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a7add4c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:45782b6e-ef6b-4a60-a8f4-af8bc0526124+6:24738:x1858115798922304:12345-172.19.3.163@o2ib600:400:default-oslic13-0
00000100:00000200:16.0:1773851874.167130:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858115798922304
00000020:00000001:16.0:1773851874.167131:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851874.167132:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851874.167133:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.167134:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851874.167134:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851874.167136:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851874.167137:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858115798922304, found 0 last_xid 1858115798922303
00000020:00000001:16.0:1773851874.167138:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851874.167139:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851874.167140:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851874.167141:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.167142:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851874.167143:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851874.167144:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851874.167145:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008f474d70.
02000000:00000001:16.0:1773851874.167146:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.167147:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.167148:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851874.167149:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 172488961580, transno 0, xid 1858115798922304
00010000:00000001:16.0:1773851874.167150:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851874.167151:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003a7add4c x1858115798922304/t0(0) o400->45782b6e-ef6b-4a60-a8f4-af8bc0526124@172.19.3.163@o2ib600:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic13-0'
00010000:00000001:16.0:1773851874.167156:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851874.167157:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851874.167158:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=107 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851874.167160:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851874.167161:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f64a0153 refcount 3 to 172.19.3.163@o2ib600
00000100:00000001:16.0:1773851874.167162:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518624 : -107156126032992 : ffff9e8ac52c1ba0)
02000000:00000001:16.0:1773851874.167164:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851874.167164:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.167165:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851874.167167:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.163@o2ib600
00000400:00000010:16.0:1773851874.167168:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002def1aea.
00000100:00000200:16.0:1773851874.167169:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858115798922304, offset 224
00000400:00000200:16.0:1773851874.167172:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.163@o2ib600
00000400:00000200:16.0:1773851874.167173:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.163@o2ib600 to cpt 4
00000400:00000200:16.0:1773851874.167175:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b5e221f nid 172.19.3.163@o2ib600 refs 2
00000400:00000200:16.0:1773851874.167177:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b5e221f nid 172.19.3.163@o2ib600 refs 3
00000400:00000200:16.0:1773851874.167180:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b5e221f nid 172.19.3.163@o2ib600 refs 4
00000400:00000200:16.0:1773851874.167182:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.163@o2ib600 routed destination
00000400:00000200:16.0:1773851874.167185:0:61039:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:16.0:1773851874.167186:0:61039:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:16.0:1773851874.167189:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.163@o2ib600: rtr pref emtpy: 1
00000400:00000200:16.0:1773851874.167191:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:16.0:1773851874.167192:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.163@o2ib600: rtr pref emtpy: 1
00000400:00000200:16.0:1773851874.167193:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:16.0:1773851874.167195:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769465:8769465:1024:4294967295] 2094@kfi7 LPNI seq info [1258747002:1258747002:16:4294967295]
00000400:00000200:16.0:1773851874.167197:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:16.0:1773851874.167199:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:16.0:1773851874.167203:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.163@o2ib600(172.19.3.163@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851874.167205:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b5e221f nid 172.19.3.163@o2ib600 refs 3
00000800:00000200:16.0:1773851874.167207:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851874.167209:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851874.167213:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851874.167217:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:16.0:1773851874.167221:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:16.0:1773851874.167224:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851874.167227:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851874.167230:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f64a0153 refcount 2 to 172.19.3.163@o2ib600
00010000:00000001:16.0:1773851874.167232:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851874.167232:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.167233:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851874.167235:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003a7add4c x1858115798922304/t0(0) o400->45782b6e-ef6b-4a60-a8f4-af8bc0526124@172.19.3.163@o2ib600:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic13-0'
00000100:00100000:16.0:1773851874.167240:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a7add4c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:45782b6e-ef6b-4a60-a8f4-af8bc0526124+6:24738:x1858115798922304:12345-172.19.3.163@o2ib600:400:default-oslic13-0 Request processed in 114us (164us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851874.167245:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.163@o2ib600, seq: 2156355
00000100:00000040:16.0:1773851874.167246:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffca7236 : new rpc_count 0
00000100:00000001:16.0:1773851874.167247:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851874.167248:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851874.167249:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851874.167250:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851874.167251:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091929c7c.
00000020:00000040:16.0:1773851874.167253:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000ffca7236 : new refcount 5
00000100:00000001:16.0:1773851874.167254:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851874.167262:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851874.167265:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.167267:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:17.0:1773851874.167269:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002def1aea
00000400:00000010:17.0:1773851874.167269:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002def1aea.
00000100:00000001:17.0:1773851874.167271:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851874.167271:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851874.167273:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851874.167275:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00080000:00000001:30.0:1773851874.171351:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851874.171353:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851874.171380:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851874.171380:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851874.171406:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851874.171406:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851874.171432:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851874.171432:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851874.171592:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000daa395b6 (tot 253201027).
00000400:00000010:30.0:1773851874.171594:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000daa395b6 (tot 253200771).
00000400:00000200:29.0:1773851874.185733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851874.185734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:6.0:1773851874.207977:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851874.207979:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851874.207981:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851874.207984:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851874.207988:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10112@kfi7 to cpt 1
00000400:00000200:6.0:1773851874.207990:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10112@kfi7 : PUT - for me
00000400:00000200:6.0:1773851874.207991:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10112@kfi7 to cpt 1
00000400:00000200:6.0:1773851874.207994:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094d62d4d nid 10112@kfi7 refs 1
00000400:00000200:6.0:1773851874.207996:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10112@kfi7 to cpt 1
00000400:00000200:6.0:1773851874.207997:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094d62d4d nid 10112@kfi7 refs 2
00000400:00000200:6.0:1773851874.207998:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094d62d4d nid 10112@kfi7 refs 3
00000400:00000200:6.0:1773851874.208000:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10113@kfi7 to cpt 4
00000400:00000200:6.0:1773851874.208001:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10113@kfi7 of length 224 into portal 12 MB=0x69b467a6c7140
00000400:00000200:6.0:1773851874.208004:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10113@kfi7 of length 224/224 into md 0x793926dc5 [64] + 148504
00000800:00000200:6.0:1773851874.208008:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851874.208011:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851874.208012:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10112@kfi7: PUT: OK
00000100:00000001:6.0:1773851874.208014:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851874.208014:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851874.208016:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000010bf7c75.
00000100:00000040:6.0:1773851874.208017:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000010bf7c75 x1859576864207168 msgsize 224
00000100:00100000:6.0:1773851874.208019:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-10113@kfi7 (source: 12345-10112@kfi7)
00000100:00000001:6.0:1773851874.208021:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851874.208022:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094d62d4d nid 10112@kfi7 refs 2
00000100:00000001:4.0:1773851874.208024:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851874.208025:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851874.208025:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851874.208026:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851874.208026:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851874.208028:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851874.208029:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576864207168
00000020:00000001:4.0:1773851874.208030:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851874.208031:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc161ec88
00000020:00000001:4.0:1773851874.208032:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851874.208034:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005076ca08 refcount=5
00000020:00000001:4.0:1773851874.208035:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135036353536 : -106938673198080 : ffff9ebd665f0c00)
00000020:00000001:4.0:1773851874.208037:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637135036353536 : -106938673198080 : ffff9ebd665f0c00)
00000100:00000001:4.0:1773851874.208038:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851874.208039:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851874.208040:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000004817707.
00000020:00000010:4.0:1773851874.208042:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851874.208043:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000025e99aed.
00000100:00000001:4.0:1773851874.208045:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851874.208045:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851874.208046:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851874.208048:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851874.208049:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851874.208050:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.208051:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851874.208053:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851874.208054:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851874.208054:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851874.208055:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851874.208056:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10113@kfi7, seq: 2001934
00000100:00000001:7.0:1773851874.208057:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851874.208057:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005076ca08 : new rpc_count 1
00000100:00000001:4.0:1773851874.208058:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814085376 : -107101895466240 : ffff9e976590e300)
00000100:00000001:7.0:1773851874.208059:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851874.208060:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000010bf7c75 x1859576864207168/t0(0) o400->4fb14e6c-93e2-4db9-bcda-48787eee900c@10113@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1124-0'
00000100:00000001:4.0:1773851874.208065:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851874.208065:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851874.208067:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010bf7c75 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4fb14e6c-93e2-4db9-bcda-48787eee900c+5:39776:x1859576864207168:12345-10113@kfi7:400:default-tuolumne1124-0
00000100:00000200:4.0:1773851874.208069:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576864207168
00000020:00000001:4.0:1773851874.208070:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851874.208071:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851874.208072:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.208073:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851874.208074:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851874.208075:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851874.208076:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576864207168, found 0 last_xid 1859576864207167
00000020:00000001:4.0:1773851874.208077:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851874.208078:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851874.208079:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851874.208080:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.208081:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851874.208082:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851874.208083:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851874.208084:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009b593e07.
02000000:00000001:4.0:1773851874.208085:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.208086:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.208087:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851874.208088:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154616622, transno 0, xid 1859576864207168
00010000:00000001:4.0:1773851874.208089:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851874.208091:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000010bf7c75 x1859576864207168/t0(0) o400->4fb14e6c-93e2-4db9-bcda-48787eee900c@10113@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1124-0'
00010000:00000001:4.0:1773851874.208095:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851874.208095:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851874.208097:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=106 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851874.208098:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851874.208099:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ed0b5391 refcount 3 to 10113@kfi7
00000100:00000001:4.0:1773851874.208100:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959264 : -107156125592352 : ffff9e8ac532d4e0)
02000000:00000001:4.0:1773851874.208102:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851874.208102:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.208104:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851874.208105:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10112@kfi7
00000400:00000010:4.0:1773851874.208106:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000645e16b0.
00000100:00000200:4.0:1773851874.208108:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576864207168, offset 224
00000400:00000200:4.0:1773851874.208110:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10112@kfi7
00000400:00000200:4.0:1773851874.208111:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10112@kfi7 to cpt 1
00000400:00000200:4.0:1773851874.208113:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094d62d4d nid 10112@kfi7 refs 1
00000400:00000200:4.0:1773851874.208115:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094d62d4d nid 10112@kfi7 refs 2
00000400:00000200:4.0:1773851874.208117:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094d62d4d nid 10112@kfi7 refs 3
00000400:00000200:4.0:1773851874.208119:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10112@kfi7 local destination
00000400:00000200:4.0:1773851874.208121:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769466:8769466:1024:4294967295] 10112@kfi7 LPNI seq info [18895537:18895537:16:4294967295]
00000400:00000200:4.0:1773851874.208123:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094d62d4d nid 10112@kfi7 refs 2
00000400:00000200:4.0:1773851874.208124:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10112@kfi7 to cpt 1
00000400:00000200:4.0:1773851874.208127:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10112@kfi7(10112@kfi7:10112@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851874.208129:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094d62d4d nid 10112@kfi7 refs 3
00000800:00000200:4.0:1773851874.208132:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851874.208134:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851874.208137:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851874.208141:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ee3 Using peer 10112@kfi7(0x100000000000ee3)
00000800:00000200:4.0:1773851874.208145:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x100000000000ee3: rc=0
00000800:00000200:4.0:1773851874.208147:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ee3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851874.208150:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851874.208152:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ed0b5391 refcount 2 to 10113@kfi7
00010000:00000001:4.0:1773851874.208153:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851874.208153:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.208157:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851874.208158:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000010bf7c75 x1859576864207168/t0(0) o400->4fb14e6c-93e2-4db9-bcda-48787eee900c@10113@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1124-0'
00000100:00100000:4.0:1773851874.208163:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010bf7c75 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4fb14e6c-93e2-4db9-bcda-48787eee900c+5:39776:x1859576864207168:12345-10113@kfi7:400:default-tuolumne1124-0 Request processed in 97us (145us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851874.208167:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10113@kfi7, seq: 2001934
00000100:00000040:4.0:1773851874.208168:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005076ca08 : new rpc_count 0
00000100:00000001:4.0:1773851874.208169:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851874.208170:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851874.208171:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851874.208172:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000025e99aed.
00000020:00000010:4.0:1773851874.208173:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000004817707.
00000020:00000040:4.0:1773851874.208174:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000005076ca08 : new refcount 4
00000100:00000001:4.0:1773851874.208175:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851874.208183:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ee3 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851874.208186:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851874.208188:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10112@kfi7: PUT: OK
00000400:00000200:5.0:1773851874.208189:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000645e16b0
00000400:00000010:5.0:1773851874.208190:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000645e16b0.
00000100:00000001:5.0:1773851874.208191:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851874.208192:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851874.208193:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094d62d4d nid 10112@kfi7 refs 2
00000800:00000200:5.0:1773851874.208196:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 10112@kfi7(00000000cc23948e):0x0 lsk 3812 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000ee3 Transaction freed
00000800:00000200:15.0:1773851874.227262:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851874.227262:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851874.227263:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851874.227264:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851874.227265:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851874.227265:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851874.227267:0:2513974:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17794@kfi7(0000000058485e42):0x2f3 version: 2; local version 2; negotiated version: 2
00000800:00000200:15.0:1773851874.227269:0:2513974:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 Using peer 17794@kfi7(0x1000000000002f3)
00000800:00000200:13.0:1773851874.227269:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851874.227271:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17794@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.227272:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17794@kfi7 to cpt 3
00000800:00000200:15.0:1773851874.227273:0:2513974:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 38 bytes to peer 0x1000000000002f3: rc=0
00000800:00000200:15.0:1773851874.227275:0:2513974:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:13.0:1773851874.227275:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17794@kfi7 : PUT - for me
00000400:00000200:13.0:1773851874.227276:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17794@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.227278:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004c6a2233 nid 17794@kfi7 refs 1
00000400:00000200:13.0:1773851874.227281:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17794@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.227282:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004c6a2233 nid 17794@kfi7 refs 2
00000400:00000200:13.0:1773851874.227284:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004c6a2233 nid 17794@kfi7 refs 3
00000400:00000200:13.0:1773851874.227285:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17731@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.227287:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17731@kfi7 of length 224 into portal 12 MB=0x69b4bcd0302c0
00000800:00000200:15.0:1773851874.227288:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851874.227289:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17731@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 35944
00000800:00000200:15.0:1773851874.227290:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 Transaction freed
00000800:00000200:13.0:1773851874.227294:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851874.227297:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851874.227298:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17794@kfi7: PUT: OK
00000100:00000001:13.0:1773851874.227300:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851874.227301:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851874.227302:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed8ca966.
00000100:00000040:13.0:1773851874.227303:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ed8ca966 x1859599724643008 msgsize 224
00000100:00100000:13.0:1773851874.227306:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-17731@kfi7 (source: 12345-17794@kfi7)
00000100:00000001:13.0:1773851874.227307:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851874.227309:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851874.227309:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:13.0:1773851874.227309:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004c6a2233 nid 17794@kfi7 refs 2
00000100:00000001:15.0:1773851874.227310:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851874.227310:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851874.227311:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851874.227311:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00100000:15.0:1773851874.227312:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599724643008
00000020:00000001:15.0:1773851874.227312:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851874.227313:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80d29
00000020:00000001:15.0:1773851874.227314:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851874.227317:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004ddeb2bc refcount=5
00000020:00000001:15.0:1773851874.227317:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107984082944 : -106965725468672 : ffff9eb719ee2800)
00000020:00000001:15.0:1773851874.227318:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107984082944 : -106965725468672 : ffff9eb719ee2800)
00000100:00000001:15.0:1773851874.227320:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.227321:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851874.227322:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000055324ba3.
00000020:00000010:15.0:1773851874.227323:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851874.227323:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851874.227325:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851874.227325:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851874.227326:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851874.227327:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851874.227327:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851874.227328:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.227329:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851874.227330:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851874.227330:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851874.227330:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851874.227331:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851874.227332:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17731@kfi7, seq: 2289859
00000100:00000040:15.0:1773851874.227332:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004ddeb2bc : new rpc_count 1
00000100:00000001:12.0:1773851874.227332:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.227333:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970993920 : -107043738557696 : ffff9ea4effce300)
00000100:00000001:12.0:1773851874.227333:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.227334:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed8ca966 x1859599724643008/t0(0) o400->e6e6179f-ce6d-4b95-8258-e2e189a7fef9@17731@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1608-0'
00000100:00000001:15.0:1773851874.227337:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.227338:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851874.227339:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed8ca966 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e6e6179f-ce6d-4b95-8258-e2e189a7fef9+5:39721:x1859599724643008:12345-17731@kfi7:400:default-tuolumne1608-0
00000100:00000200:15.0:1773851874.227341:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599724643008
00000020:00000001:15.0:1773851874.227341:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851874.227342:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851874.227343:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.227343:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851874.227344:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851874.227345:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851874.227345:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599724643008, found 0 last_xid 1859599724643007
00000020:00000001:15.0:1773851874.227346:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851874.227347:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851874.227347:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851874.227348:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.227349:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851874.227349:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851874.227350:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851874.227350:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000021e03015.
02000000:00000001:15.0:1773851874.227351:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.227352:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.227353:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851874.227353:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104889320, transno 0, xid 1859599724643008
00010000:00000001:15.0:1773851874.227354:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851874.227355:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed8ca966 x1859599724643008/t0(0) o400->e6e6179f-ce6d-4b95-8258-e2e189a7fef9@17731@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1608-0'
00010000:00000001:15.0:1773851874.227357:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851874.227358:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851874.227359:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=107 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851874.227360:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851874.227360:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ff529cc5 refcount 3 to 17731@kfi7
00000100:00000001:15.0:1773851874.227361:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642469568 : -107157067082048 : ffff9e8a8d14d6c0)
02000000:00000001:15.0:1773851874.227362:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851874.227362:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.227363:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851874.227365:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17794@kfi7
00000400:00000010:15.0:1773851874.227365:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c8b6bf6d.
00000100:00000200:15.0:1773851874.227366:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599724643008, offset 224
00000400:00000200:15.0:1773851874.227368:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17794@kfi7
00000400:00000200:15.0:1773851874.227369:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17794@kfi7 to cpt 3
00000400:00000200:15.0:1773851874.227369:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004c6a2233 nid 17794@kfi7 refs 1
00000400:00000200:15.0:1773851874.227371:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004c6a2233 nid 17794@kfi7 refs 2
00000400:00000200:15.0:1773851874.227372:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004c6a2233 nid 17794@kfi7 refs 3
00000400:00000200:15.0:1773851874.227373:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17794@kfi7 local destination
00000400:00000200:15.0:1773851874.227374:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769467:8769467:1024:4294967295] 17794@kfi7 LPNI seq info [16132446:16132446:16:4294967295]
00000400:00000200:15.0:1773851874.227376:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004c6a2233 nid 17794@kfi7 refs 2
00000400:00000200:15.0:1773851874.227376:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17794@kfi7 to cpt 3
00000400:00000200:15.0:1773851874.227378:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17794@kfi7(17794@kfi7:17794@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851874.227380:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004c6a2233 nid 17794@kfi7 refs 3
00000800:00000200:15.0:1773851874.227381:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851874.227382:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851874.227384:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851874.227386:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 Using peer 17794@kfi7(0x1000000000002f3)
00000800:00000200:15.0:1773851874.227389:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x1000000000002f3: rc=0
00000800:00000200:15.0:1773851874.227391:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851874.227393:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.227394:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ff529cc5 refcount 2 to 17731@kfi7
00010000:00000001:15.0:1773851874.227395:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851874.227395:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.227396:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851874.227397:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed8ca966 x1859599724643008/t0(0) o400->e6e6179f-ce6d-4b95-8258-e2e189a7fef9@17731@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1608-0'
00000100:00100000:15.0:1773851874.227403:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed8ca966 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e6e6179f-ce6d-4b95-8258-e2e189a7fef9+5:39721:x1859599724643008:12345-17731@kfi7:400:default-tuolumne1608-0 Request processed in 64us (98us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851874.227404:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851874.227405:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17731@kfi7, seq: 2289859
00000100:00000040:15.0:1773851874.227406:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004ddeb2bc : new rpc_count 0
00000100:00000001:15.0:1773851874.227407:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851874.227407:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851874.227407:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851874.227408:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851874.227409:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000020:00000010:15.0:1773851874.227409:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000055324ba3.
00000400:00000200:13.0:1773851874.227409:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17794@kfi7: PUT: OK
00000020:00000040:15.0:1773851874.227410:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000004ddeb2bc : new refcount 4
00000400:00000200:13.0:1773851874.227410:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c8b6bf6d
00000100:00000001:15.0:1773851874.227411:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851874.227411:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c8b6bf6d.
00000100:00000001:13.0:1773851874.227412:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851874.227413:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851874.227414:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004c6a2233 nid 17794@kfi7 refs 2
00000800:00000200:13.0:1773851874.227416:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 17794@kfi7(0000000058485e42):0x0 lsk 756 rsk 9 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002f3 Transaction freed
00000800:00000200:25.0:1773851874.238382:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851874.238383:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851874.238384:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851874.238386:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851874.238388:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25793@kfi7 to cpt 6
00000400:00000200:25.0:1773851874.238389:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25793@kfi7 : PUT - for me
00000400:00000200:25.0:1773851874.238390:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25793@kfi7 to cpt 6
00000400:00000200:25.0:1773851874.238391:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001bd90575 nid 25793@kfi7 refs 1
00000400:00000200:25.0:1773851874.238392:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25793@kfi7 to cpt 6
00000400:00000200:25.0:1773851874.238393:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001bd90575 nid 25793@kfi7 refs 2
00000400:00000200:25.0:1773851874.238394:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001bd90575 nid 25793@kfi7 refs 3
00000400:00000200:25.0:1773851874.238395:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25792@kfi7 to cpt 3
00000400:00000200:25.0:1773851874.238396:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25792@kfi7 of length 224 into portal 12 MB=0x699e108c85e00
00000400:00000200:25.0:1773851874.238398:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25792@kfi7 of length 224/224 into md 0x16159c9699 [64] + 20984
00000800:00000200:25.0:1773851874.238400:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851874.238402:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851874.238403:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25793@kfi7: PUT: OK
00000100:00000001:25.0:1773851874.238404:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851874.238404:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851874.238405:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd681c4d.
00000100:00000040:25.0:1773851874.238406:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000dd681c4d x1858041654304256 msgsize 224
00000100:00100000:25.0:1773851874.238407:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-25792@kfi7 (source: 12345-25793@kfi7)
00000100:00000001:25.0:1773851874.238409:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851874.238410:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851874.238410:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001bd90575 nid 25793@kfi7 refs 2
02000000:00000001:27.0:1773851874.238411:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851874.238411:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851874.238411:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851874.238412:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851874.238412:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851874.238413:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041654304256
00000020:00000001:27.0:1773851874.238414:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851874.238415:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f1e
00000020:00000001:27.0:1773851874.238415:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851874.238419:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000480dead6 refcount=6
00000020:00000001:27.0:1773851874.238420:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744649728 : -107128964901888 : ffff9e91181a1400)
00000020:00000001:27.0:1773851874.238420:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744649728 : -107128964901888 : ffff9e91181a1400)
00000100:00000001:27.0:1773851874.238421:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.238422:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851874.238423:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851874.238424:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.238425:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851874.238426:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851874.238426:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851874.238426:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.238427:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851874.238428:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851874.238428:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.238429:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.238430:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.238431:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851874.238431:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851874.238431:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851874.238432:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25792@kfi7, seq: 2025121
00000100:00000040:27.0:1773851874.238433:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000480dead6 : new rpc_count 1
00000100:00000001:26.0:1773851874.238433:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.238433:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.238434:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124127569408 : -106949581982208 : ffff9ebadc283600)
00000100:00000040:27.0:1773851874.238435:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dd681c4d x1858041654304256/t0(0) o400->15a57aa8-e44a-4ba8-b6a3-0d90effb169f@25792@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2099-0'
00000100:00000001:27.0:1773851874.238438:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.238438:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851874.238439:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd681c4d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:15a57aa8-e44a-4ba8-b6a3-0d90effb169f+6:39836:x1858041654304256:12345-25792@kfi7:400:default-tuolumne2099-0
00000100:00000200:27.0:1773851874.238440:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041654304256
00000020:00000001:27.0:1773851874.238441:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851874.238441:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851874.238442:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.238443:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851874.238444:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851874.238445:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851874.238445:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041654304256, found 0 last_xid 1858041654304255
00000020:00000001:27.0:1773851874.238446:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851874.238447:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851874.238447:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851874.238448:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.238449:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851874.238449:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851874.238450:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851874.238450:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c15f1c34.
02000000:00000001:27.0:1773851874.238451:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.238452:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.238452:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851874.238453:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106929202, transno 0, xid 1858041654304256
00010000:00000001:27.0:1773851874.238454:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851874.238455:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dd681c4d x1858041654304256/t0(0) o400->15a57aa8-e44a-4ba8-b6a3-0d90effb169f@25792@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2099-0'
00010000:00000001:27.0:1773851874.238457:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851874.238458:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851874.238458:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851874.238459:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851874.238460:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001af18cb1 refcount 3 to 25792@kfi7
00000100:00000001:27.0:1773851874.238461:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642470336 : -107157067081280 : ffff9e8a8d14d9c0)
02000000:00000001:27.0:1773851874.238462:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851874.238462:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.238463:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851874.238464:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25793@kfi7
00000400:00000010:27.0:1773851874.238464:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003e821a0f.
00000100:00000200:27.0:1773851874.238465:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041654304256, offset 224
00000400:00000200:27.0:1773851874.238466:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25793@kfi7
00000400:00000200:27.0:1773851874.238467:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25793@kfi7 to cpt 6
00000400:00000200:27.0:1773851874.238468:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001bd90575 nid 25793@kfi7 refs 1
00000400:00000200:27.0:1773851874.238469:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001bd90575 nid 25793@kfi7 refs 2
00000400:00000200:27.0:1773851874.238471:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001bd90575 nid 25793@kfi7 refs 3
00000400:00000200:27.0:1773851874.238472:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25793@kfi7 local destination
00000400:00000200:27.0:1773851874.238473:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769468:8769468:1024:4294967295] 25793@kfi7 LPNI seq info [224886:224886:16:4294967295]
00000400:00000200:27.0:1773851874.238475:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001bd90575 nid 25793@kfi7 refs 2
00000400:00000200:27.0:1773851874.238476:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25793@kfi7 to cpt 6
00000400:00000200:27.0:1773851874.238478:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25793@kfi7(25793@kfi7:25793@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851874.238479:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001bd90575 nid 25793@kfi7 refs 3
00000800:00000200:27.0:1773851874.238481:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851874.238482:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851874.238484:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851874.238486:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1069 Using peer 25793@kfi7(0x1069)
00000800:00000200:27.0:1773851874.238489:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0x1069: rc=0
00000800:00000200:27.0:1773851874.238491:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1069 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851874.238493:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.238493:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001af18cb1 refcount 2 to 25792@kfi7
00010000:00000001:27.0:1773851874.238494:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851874.238495:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.238495:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851874.238496:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd681c4d x1858041654304256/t0(0) o400->15a57aa8-e44a-4ba8-b6a3-0d90effb169f@25792@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2099-0'
00000100:00100000:27.0:1773851874.238499:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd681c4d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:15a57aa8-e44a-4ba8-b6a3-0d90effb169f+6:39836:x1858041654304256:12345-25792@kfi7:400:default-tuolumne2099-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851874.238501:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25792@kfi7, seq: 2025121
00000100:00000040:27.0:1773851874.238502:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000480dead6 : new rpc_count 0
00000800:00000200:25.0:1773851874.238502:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1069 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851874.238503:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851874.238504:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851874.238505:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851874.238505:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25793@kfi7: PUT: OK
00000400:00000200:25.0:1773851874.238505:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003e821a0f
00000020:00000010:27.0:1773851874.238506:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.238506:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000400:00000010:25.0:1773851874.238506:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003e821a0f.
00000100:00000001:25.0:1773851874.238506:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851874.238507:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851874.238508:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000020:00000040:27.0:1773851874.238508:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000480dead6 : new refcount 5
00000400:00000200:25.0:1773851874.238508:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001bd90575 nid 25793@kfi7 refs 2
00000100:00000001:27.0:1773851874.238509:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851874.238509:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 25793@kfi7(00000000e9daea6c):0x0 lsk 4202 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1069 Transaction freed
00000800:00000200:17.0:1773851874.244227:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851874.244227:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851874.244229:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851874.244231:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.244233:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.244234:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.165@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851874.244235:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.244236:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851874.244237:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.165@o2ib600 to cpt 6
00000400:00000200:17.0:1773851874.244239:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fad5fc7f nid 172.19.3.165@o2ib600 refs 2
00000400:00000200:17.0:1773851874.244240:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fad5fc7f nid 172.19.3.165@o2ib600 refs 3
00000400:00000200:17.0:1773851874.244241:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.165@o2ib600 to cpt 6
00000400:00000200:17.0:1773851874.244242:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.165@o2ib600 of length 224 into portal 12 MB=0x699f2b1704f00
00000400:00000200:17.0:1773851874.244244:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.165@o2ib600 of length 224/224 into md 0x16159c9699 [64] + 21208
00000800:00000200:17.0:1773851874.244246:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851874.244248:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.244249:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851874.244250:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851874.244250:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851874.244251:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b99113d6.
00000100:00000040:17.0:1773851874.244252:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b99113d6 x1858117498326784 msgsize 224
00000100:00100000:17.0:1773851874.244253:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.165@o2ib600 (source: 12345-172.19.3.165@o2ib600)
00000100:00000001:17.0:1773851874.244255:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851874.244256:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851874.244257:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851874.244258:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851874.244259:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851874.244260:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851874.244261:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851874.244262:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851874.244263:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858117498326784
00000020:00000001:27.0:1773851874.244264:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851874.244264:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e71
00000020:00000001:27.0:1773851874.244265:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851874.244267:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000013ce5956 refcount=6
00000020:00000001:27.0:1773851874.244268:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239635968 : -107152469915648 : ffff9e8b9f180800)
00000020:00000001:27.0:1773851874.244269:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239635968 : -107152469915648 : ffff9e8b9f180800)
00000100:00000001:27.0:1773851874.244270:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.244271:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851874.244272:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000094a73686.
00000020:00000010:27.0:1773851874.244273:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.244275:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000071d90ae0.
00000100:00000001:27.0:1773851874.244276:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851874.244277:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851874.244277:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.244279:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851874.244280:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851874.244280:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.244282:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.244283:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851874.244283:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.244284:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851874.244284:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851874.244285:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.165@o2ib600, seq: 2025122
00000100:00000001:27.0:1773851874.244286:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851874.244286:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000013ce5956 : new rpc_count 1
00000100:00000001:27.0:1773851874.244287:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.244287:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372336000 : -107078337215616 : ffff9e9ce1bf4380)
00000100:00000040:26.0:1773851874.244288:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b99113d6 x1858117498326784/t0(0) o400->194ed299-bb95-4cfb-a04f-766b1b82e66d@172.19.3.165@o2ib600:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic15-0'
00000100:00000001:26.0:1773851874.244291:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851874.244291:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851874.244292:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b99113d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:194ed299-bb95-4cfb-a04f-766b1b82e66d+6:24790:x1858117498326784:12345-172.19.3.165@o2ib600:400:default-oslic15-0
00000100:00000200:26.0:1773851874.244294:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858117498326784
00000020:00000001:26.0:1773851874.244295:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851874.244295:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851874.244296:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.244297:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851874.244297:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851874.244298:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851874.244298:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858117498326784, found 0 last_xid 1858117498326783
00000020:00000001:26.0:1773851874.244299:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851874.244300:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851874.244300:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851874.244301:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.244301:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851874.244303:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851874.244303:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851874.244303:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e6a23b2.
02000000:00000001:26.0:1773851874.244304:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.244305:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.244305:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851874.244306:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858117498326784
00010000:00000001:26.0:1773851874.244307:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851874.244308:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b99113d6 x1858117498326784/t0(0) o400->194ed299-bb95-4cfb-a04f-766b1b82e66d@172.19.3.165@o2ib600:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic15-0'
00010000:00000001:26.0:1773851874.244310:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851874.244310:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851874.244311:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851874.244312:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851874.244313:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003be05eb6 refcount 3 to 172.19.3.165@o2ib600
00000100:00000001:26.0:1773851874.244313:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331968 : -107155410219648 : ffff9e8aefd68d80)
02000000:00000001:26.0:1773851874.244314:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851874.244315:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.244315:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851874.244316:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.165@o2ib600
00000400:00000010:26.0:1773851874.244317:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a08fe443.
00000100:00000200:26.0:1773851874.244317:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858117498326784, offset 224
00000400:00000200:26.0:1773851874.244319:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.165@o2ib600
00000400:00000200:26.0:1773851874.244320:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.165@o2ib600 to cpt 6
00000400:00000200:26.0:1773851874.244321:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fad5fc7f nid 172.19.3.165@o2ib600 refs 2
00000400:00000200:26.0:1773851874.244323:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fad5fc7f nid 172.19.3.165@o2ib600 refs 3
00000400:00000200:26.0:1773851874.244324:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fad5fc7f nid 172.19.3.165@o2ib600 refs 4
00000400:00000200:26.0:1773851874.244325:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.165@o2ib600 routed destination
00000400:00000200:26.0:1773851874.244326:0:60973:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:26.0:1773851874.244327:0:60973:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:26.0:1773851874.244328:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.165@o2ib600: rtr pref emtpy: 1
00000400:00000200:26.0:1773851874.244330:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:26.0:1773851874.244330:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.165@o2ib600: rtr pref emtpy: 1
00000400:00000200:26.0:1773851874.244331:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:26.0:1773851874.244332:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769469:8769469:1024:4294967295] 17@kfi7 LPNI seq info [1250891902:1250891902:16:4294967295]
00000400:00000200:26.0:1773851874.244334:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:26.0:1773851874.244334:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:26.0:1773851874.244337:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.165@o2ib600(172.19.3.165@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851874.244338:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fad5fc7f nid 172.19.3.165@o2ib600 refs 3
00000800:00000200:26.0:1773851874.244340:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851874.244341:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851874.244343:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851874.244346:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:26.0:1773851874.244349:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:26.0:1773851874.244350:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851874.244352:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851874.244353:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003be05eb6 refcount 2 to 172.19.3.165@o2ib600
00010000:00000001:26.0:1773851874.244354:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851874.244354:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.244354:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851874.244355:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b99113d6 x1858117498326784/t0(0) o400->194ed299-bb95-4cfb-a04f-766b1b82e66d@172.19.3.165@o2ib600:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic15-0'
00000100:00100000:26.0:1773851874.244358:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b99113d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:194ed299-bb95-4cfb-a04f-766b1b82e66d+6:24790:x1858117498326784:12345-172.19.3.165@o2ib600:400:default-oslic15-0 Request processed in 66us (106us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851874.244361:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.165@o2ib600, seq: 2025122
00000100:00000040:26.0:1773851874.244361:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000013ce5956 : new rpc_count 0
00000100:00000001:26.0:1773851874.244362:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851874.244362:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851874.244362:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851874.244363:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:26.0:1773851874.244364:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000071d90ae0.
00000400:00000200:25.0:1773851874.244364:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851874.244364:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000010:26.0:1773851874.244365:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000094a73686.
00000400:00000200:25.0:1773851874.244365:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a08fe443
00000400:00000010:25.0:1773851874.244365:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a08fe443.
00000020:00000040:26.0:1773851874.244366:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000013ce5956 : new refcount 5
00000100:00000001:26.0:1773851874.244366:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851874.244366:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851874.244366:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851874.244368:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:25.0:1773851874.244369:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Transaction freed
00000800:00000200:25.0:1773851874.286941:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851874.286942:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851874.286945:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851874.286948:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851874.286952:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10946@kfi7 to cpt 6
00000400:00000200:25.0:1773851874.286954:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10946@kfi7 : PUT - for me
00000400:00000200:25.0:1773851874.286956:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10946@kfi7 to cpt 6
00000400:00000200:25.0:1773851874.286957:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d25f4c nid 10946@kfi7 refs 1
00000400:00000200:25.0:1773851874.286959:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10946@kfi7 to cpt 6
00000400:00000200:25.0:1773851874.286960:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d25f4c nid 10946@kfi7 refs 2
00000400:00000200:25.0:1773851874.286962:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000038d25f4c nid 10946@kfi7 refs 3
00000400:00000200:25.0:1773851874.286963:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10754@kfi7 to cpt 3
00000400:00000200:25.0:1773851874.286965:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10754@kfi7 of length 224 into portal 12 MB=0x69b0935fc5d00
00000400:00000200:25.0:1773851874.286968:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10754@kfi7 of length 224/224 into md 0x16159c9699 [64] + 21432
00000800:00000200:25.0:1773851874.286971:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851874.286974:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851874.286975:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10946@kfi7: PUT: OK
00000100:00000001:25.0:1773851874.286977:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851874.286978:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851874.286979:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066629628.
00000100:00000040:25.0:1773851874.286980:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000066629628 x1859313723006208 msgsize 224
00000100:00100000:25.0:1773851874.286983:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10754@kfi7 (source: 12345-10946@kfi7)
00000100:00000001:25.0:1773851874.286985:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851874.286986:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000038d25f4c nid 10946@kfi7 refs 2
00000100:00000001:26.0:1773851874.286988:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851874.286989:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851874.286989:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851874.286990:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851874.286991:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851874.286992:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851874.286993:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313723006208
00000020:00000001:26.0:1773851874.286994:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851874.286995:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c23
00000020:00000001:26.0:1773851874.286996:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851874.286999:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000051e0e0b1 refcount=6
00000020:00000001:26.0:1773851874.287000:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743925760 : -107128965625856 : ffff9e91180f0800)
00000020:00000001:26.0:1773851874.287001:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743925760 : -107128965625856 : ffff9e91180f0800)
00000100:00000001:26.0:1773851874.287003:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851874.287004:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851874.287005:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd5c6346.
00000020:00000010:26.0:1773851874.287006:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851874.287008:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b167360e.
00000100:00000001:26.0:1773851874.287010:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851874.287010:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851874.287011:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851874.287013:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851874.287014:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851874.287015:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.287016:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851874.287018:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.287019:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851874.287019:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851874.287021:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851874.287021:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10754@kfi7, seq: 2025123
00000100:00000001:27.0:1773851874.287022:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851874.287022:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000051e0e0b1 : new rpc_count 1
00000100:00000001:27.0:1773851874.287023:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.287023:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124127571712 : -106949581979904 : ffff9ebadc283f00)
00000100:00000040:26.0:1773851874.287025:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066629628 x1859313723006208/t0(0) o400->404c069d-40c0-48db-8aaf-cb1f5500bd6c@10754@kfi7:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1175-0'
00000100:00000001:26.0:1773851874.287031:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851874.287032:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851874.287033:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066629628 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:404c069d-40c0-48db-8aaf-cb1f5500bd6c+6:39713:x1859313723006208:12345-10754@kfi7:400:default-tuolumne1175-0
00000100:00000200:26.0:1773851874.287035:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313723006208
00000020:00000001:26.0:1773851874.287036:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851874.287037:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851874.287038:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.287039:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851874.287040:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851874.287041:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851874.287042:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313723006208, found 0 last_xid 1859313723006207
00000020:00000001:26.0:1773851874.287044:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851874.287045:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851874.287045:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851874.287046:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.287047:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851874.287048:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851874.287049:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851874.287050:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea84f226.
02000000:00000001:26.0:1773851874.287051:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.287052:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.287053:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851874.287054:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691917, transno 0, xid 1859313723006208
00010000:00000001:26.0:1773851874.287056:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851874.287057:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066629628 x1859313723006208/t0(0) o400->404c069d-40c0-48db-8aaf-cb1f5500bd6c@10754@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1175-0'
00010000:00000001:26.0:1773851874.287062:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851874.287062:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851874.287064:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851874.287066:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851874.287067:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006c7ee3ee refcount 3 to 10754@kfi7
00000100:00000001:26.0:1773851874.287068:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298208 : -107155980253408 : ffff9e8acddc8720)
02000000:00000001:26.0:1773851874.287070:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851874.287071:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.287072:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851874.287073:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10946@kfi7
00000400:00000010:26.0:1773851874.287074:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027bbb058.
00000100:00000200:26.0:1773851874.287076:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859313723006208, offset 224
00000400:00000200:26.0:1773851874.287078:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10946@kfi7
00000400:00000200:26.0:1773851874.287079:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10946@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.287081:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d25f4c nid 10946@kfi7 refs 1
00000400:00000200:26.0:1773851874.287082:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000038d25f4c nid 10946@kfi7 refs 2
00000400:00000200:26.0:1773851874.287084:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000038d25f4c nid 10946@kfi7 refs 3
00000400:00000200:26.0:1773851874.287086:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10946@kfi7 local destination
00000400:00000200:26.0:1773851874.287089:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769470:8769470:1024:4294967295] 10946@kfi7 LPNI seq info [662289:662289:16:4294967295]
00000400:00000200:26.0:1773851874.287091:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000038d25f4c nid 10946@kfi7 refs 2
00000400:00000200:26.0:1773851874.287093:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10946@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.287096:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10946@kfi7(10946@kfi7:10946@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851874.287099:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000038d25f4c nid 10946@kfi7 refs 3
00000800:00000200:26.0:1773851874.287101:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851874.287103:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851874.287107:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851874.287111:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e6 Using peer 10946@kfi7(0x1000000000001e6)
00000800:00000200:26.0:1773851874.287116:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x1000000000001e6: rc=0
00000800:00000200:26.0:1773851874.287119:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851874.287122:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851874.287123:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006c7ee3ee refcount 2 to 10754@kfi7
00010000:00000001:26.0:1773851874.287124:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851874.287127:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851874.287128:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851874.287130:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066629628 x1859313723006208/t0(0) o400->404c069d-40c0-48db-8aaf-cb1f5500bd6c@10754@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1175-0'
00000800:00000200:25.0:1773851874.287133:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e6 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851874.287135:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066629628 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:404c069d-40c0-48db-8aaf-cb1f5500bd6c+6:39713:x1859313723006208:12345-10754@kfi7:400:default-tuolumne1175-0 Request processed in 103us (153us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851874.287135:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851874.287137:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10946@kfi7: PUT: OK
00000100:00100000:26.0:1773851874.287138:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10754@kfi7, seq: 2025123
00000400:00000200:25.0:1773851874.287138:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027bbb058
00000100:00000040:26.0:1773851874.287139:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000051e0e0b1 : new rpc_count 0
00000400:00000010:25.0:1773851874.287139:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027bbb058.
00000100:00000001:26.0:1773851874.287140:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851874.287140:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851874.287141:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851874.287141:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:26.0:1773851874.287142:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851874.287142:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000038d25f4c nid 10946@kfi7 refs 2
00000020:00000010:26.0:1773851874.287143:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b167360e.
00000020:00000010:26.0:1773851874.287144:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd5c6346.
00000800:00000200:25.0:1773851874.287144:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 10946@kfi7(00000000513e198c):0x0 lsk 487 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e6 Transaction freed
00000020:00000040:26.0:1773851874.287145:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000051e0e0b1 : new refcount 5
00000100:00000001:26.0:1773851874.287146:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851874.323939:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851874.323940:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851874.323942:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851874.323946:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.323950:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22177@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.323953:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22177@kfi7 : PUT - for me
00000400:00000200:17.0:1773851874.323955:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22177@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.323956:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009290796 nid 22177@kfi7 refs 1
00000400:00000200:17.0:1773851874.323958:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22177@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.323959:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009290796 nid 22177@kfi7 refs 2
00000400:00000200:17.0:1773851874.323961:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000009290796 nid 22177@kfi7 refs 3
00000400:00000200:17.0:1773851874.323963:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22176@kfi7 to cpt 1
00000400:00000200:17.0:1773851874.323964:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22176@kfi7 of length 224 into portal 12 MB=0x69b4b957ebbc0
00000400:00000200:17.0:1773851874.323967:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22176@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 23528
00000800:00000200:17.0:1773851874.323969:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851874.323972:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.323974:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22177@kfi7: PUT: OK
00000100:00000001:17.0:1773851874.323975:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851874.323975:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851874.323976:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009fd8dadf.
00000100:00000040:17.0:1773851874.323977:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009fd8dadf x1859598793227200 msgsize 224
00000100:00100000:17.0:1773851874.323979:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22176@kfi7 (source: 12345-22177@kfi7)
00000100:00000001:17.0:1773851874.323980:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851874.323981:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000009290796 nid 22177@kfi7 refs 2
00000100:00000001:16.0:1773851874.323982:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851874.323982:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851874.323983:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851874.323983:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851874.323983:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851874.323984:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851874.323985:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598793227200
00000020:00000001:16.0:1773851874.323986:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851874.323986:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2431a65b
00000020:00000001:16.0:1773851874.323987:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851874.323990:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007c68953e refcount=5
00000020:00000001:16.0:1773851874.323991:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105775092736 : -106967934458880 : ffff9eb69643a400)
00000020:00000001:16.0:1773851874.323992:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105775092736 : -106967934458880 : ffff9eb69643a400)
00000100:00000001:16.0:1773851874.323993:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851874.323994:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851874.323995:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091929c7c.
00000020:00000010:16.0:1773851874.323996:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851874.323997:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851874.323998:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851874.323998:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851874.323999:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851874.324000:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851874.324000:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851874.324001:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.324002:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851874.324004:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851874.324004:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851874.324004:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851874.324004:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851874.324005:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22176@kfi7, seq: 2156356
00000100:00000001:17.0:1773851874.324006:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851874.324006:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007c68953e : new rpc_count 1
00000100:00000001:17.0:1773851874.324007:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.324007:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372332544 : -107078337219072 : ffff9e9ce1bf3600)
00000100:00000040:16.0:1773851874.324009:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009fd8dadf x1859598793227200/t0(0) o400->70bc40ec-9c1d-44a9-97fd-60291383e30c@22176@kfi7:95/0 lens 224/0 e 0 to 0 dl 1773852210 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1872-0'
00000100:00000001:16.0:1773851874.324012:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851874.324012:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851874.324013:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009fd8dadf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:70bc40ec-9c1d-44a9-97fd-60291383e30c+5:39559:x1859598793227200:12345-22176@kfi7:400:default-tuolumne1872-0
00000100:00000200:16.0:1773851874.324015:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598793227200
00000020:00000001:16.0:1773851874.324016:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851874.324017:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851874.324017:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.324018:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851874.324019:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851874.324020:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851874.324021:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598793227200, found 0 last_xid 1859598793227199
00000020:00000001:16.0:1773851874.324022:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851874.324022:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851874.324023:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851874.324023:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.324024:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851874.324025:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851874.324026:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851874.324026:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000013fe0e9f.
02000000:00000001:16.0:1773851874.324027:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.324028:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.324029:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851874.324029:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183147025917, transno 0, xid 1859598793227200
00010000:00000001:16.0:1773851874.324030:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851874.324031:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009fd8dadf x1859598793227200/t0(0) o400->70bc40ec-9c1d-44a9-97fd-60291383e30c@22176@kfi7:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1872-0'
00010000:00000001:16.0:1773851874.324037:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851874.324038:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851874.324039:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=107 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851874.324040:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851874.324041:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000635a0046 refcount 3 to 22176@kfi7
00000100:00000001:16.0:1773851874.324042:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231613568 : -107130477938048 : ffff9e90bdeafa80)
02000000:00000001:16.0:1773851874.324043:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851874.324044:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851874.324044:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851874.324045:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22177@kfi7
00000400:00000010:16.0:1773851874.324046:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e46202c7.
00000100:00000200:16.0:1773851874.324047:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598793227200, offset 224
00000400:00000200:16.0:1773851874.324049:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22177@kfi7
00000400:00000200:16.0:1773851874.324050:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22177@kfi7 to cpt 4
00000400:00000200:16.0:1773851874.324051:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009290796 nid 22177@kfi7 refs 1
00000400:00000200:16.0:1773851874.324052:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000009290796 nid 22177@kfi7 refs 2
00000400:00000200:16.0:1773851874.324053:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000009290796 nid 22177@kfi7 refs 3
00000400:00000200:16.0:1773851874.324055:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22177@kfi7 local destination
00000400:00000200:16.0:1773851874.324056:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769471:8769471:1024:4294967295] 22177@kfi7 LPNI seq info [1089771:1089771:16:4294967295]
00000400:00000200:16.0:1773851874.324058:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000009290796 nid 22177@kfi7 refs 2
00000400:00000200:16.0:1773851874.324059:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22177@kfi7 to cpt 4
00000400:00000200:16.0:1773851874.324061:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22177@kfi7(22177@kfi7:22177@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851874.324063:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000009290796 nid 22177@kfi7 refs 3
00000800:00000200:16.0:1773851874.324064:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851874.324066:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851874.324068:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851874.324071:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b1d Using peer 22177@kfi7(0x100000000000b1d)
00000800:00000200:16.0:1773851874.324076:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x100000000000b1d: rc=0
00000800:00000200:16.0:1773851874.324078:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b1d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851874.324080:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851874.324081:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000635a0046 refcount 2 to 22176@kfi7
00010000:00000001:16.0:1773851874.324081:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851874.324082:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851874.324083:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851874.324083:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009fd8dadf x1859598793227200/t0(0) o400->70bc40ec-9c1d-44a9-97fd-60291383e30c@22176@kfi7:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1872-0'
00000100:00100000:16.0:1773851874.324087:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009fd8dadf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:70bc40ec-9c1d-44a9-97fd-60291383e30c+5:39559:x1859598793227200:12345-22176@kfi7:400:default-tuolumne1872-0 Request processed in 75us (109us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851874.324090:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22176@kfi7, seq: 2156356
00000100:00000040:16.0:1773851874.324091:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007c68953e : new rpc_count 0
00000100:00000001:16.0:1773851874.324091:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851874.324092:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851874.324092:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851874.324093:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851874.324094:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091929c7c.
00000020:00000040:16.0:1773851874.324095:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000007c68953e : new refcount 4
00000100:00000001:16.0:1773851874.324095:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851874.324100:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b1d TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851874.324102:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.324103:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22177@kfi7: PUT: OK
00000400:00000200:17.0:1773851874.324104:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e46202c7
00000400:00000010:17.0:1773851874.324105:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e46202c7.
00000100:00000001:17.0:1773851874.324106:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851874.324106:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851874.324107:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000009290796 nid 22177@kfi7 refs 2
00000800:00000200:17.0:1773851874.324108:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22177@kfi7(00000000dceaa365):0x0 lsk 2846 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b1d Transaction freed
00000800:00000200:10.0:1773851874.372302:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851874.372304:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851874.372306:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851874.372310:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851874.372313:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20066@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.372315:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20066@kfi7 : PUT - for me
00000400:00000200:10.0:1773851874.372317:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20066@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.372319:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a32f18d nid 20066@kfi7 refs 1
00000400:00000200:10.0:1773851874.372321:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20066@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.372322:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a32f18d nid 20066@kfi7 refs 2
00000400:00000200:10.0:1773851874.372324:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a32f18d nid 20066@kfi7 refs 3
00000400:00000200:10.0:1773851874.372326:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20131@kfi7 to cpt 0
00000400:00000200:10.0:1773851874.372327:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20131@kfi7 of length 224 into portal 12 MB=0x699e133ea3f00
00000400:00000200:10.0:1773851874.372330:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20131@kfi7 of length 224/224 into md 0x78146ce49 [64] + 141712
00000800:00000200:10.0:1773851874.372333:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851874.372336:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851874.372338:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20066@kfi7: PUT: OK
00000100:00000001:10.0:1773851874.372340:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851874.372340:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851874.372342:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000171a07a9.
00000100:00000040:10.0:1773851874.372343:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000171a07a9 x1858042377944832 msgsize 224
00000100:00100000:10.0:1773851874.372345:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20131@kfi7 (source: 12345-20066@kfi7)
00000100:00000001:10.0:1773851874.372347:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851874.372348:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a32f18d nid 20066@kfi7 refs 2
00000100:00000001:11.0:1773851874.372350:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851874.372351:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851874.372351:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851874.372351:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851874.372352:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851874.372354:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851874.372355:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042377944832
00000020:00000001:11.0:1773851874.372356:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851874.372356:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91961
00000020:00000001:11.0:1773851874.372358:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851874.372361:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000068b4dc84 refcount=6
00000020:00000001:11.0:1773851874.372362:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242224640 : -107152467326976 : ffff9e8b9f3f8800)
00000020:00000001:11.0:1773851874.372363:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242224640 : -107152467326976 : ffff9e8b9f3f8800)
00000100:00000001:11.0:1773851874.372365:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851874.372366:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851874.372367:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058b86f43.
00000020:00000010:11.0:1773851874.372369:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851874.372370:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851874.372372:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851874.372372:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851874.372373:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851874.372375:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851874.372376:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851874.372377:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851874.372378:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851874.372380:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851874.372381:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851874.372381:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851874.372382:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851874.372383:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20131@kfi7, seq: 2130798
00000100:00000040:11.0:1773851874.372384:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000068b4dc84 : new rpc_count 1
00000100:00000001:8.0:1773851874.372384:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851874.372385:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064861440 : -106983644690176 : ffff9eb2eddc8900)
00000100:00000001:8.0:1773851874.372386:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851874.372387:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000171a07a9 x1858042377944832/t0(0) o400->bad8bb53-d470-41d5-b97b-22d01f797922@20131@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1740-0'
00000100:00000001:11.0:1773851874.372391:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851874.372392:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851874.372394:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000171a07a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:bad8bb53-d470-41d5-b97b-22d01f797922+6:39595:x1858042377944832:12345-20131@kfi7:400:default-tuolumne1740-0
00000100:00000200:11.0:1773851874.372397:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042377944832
00000020:00000001:11.0:1773851874.372398:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851874.372399:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851874.372401:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851874.372402:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851874.372403:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851874.372404:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851874.372405:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042377944832, found 0 last_xid 1858042377944831
00000020:00000001:11.0:1773851874.372406:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851874.372407:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851874.372408:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851874.372409:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851874.372410:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851874.372411:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851874.372412:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851874.372413:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d4e47751.
02000000:00000001:11.0:1773851874.372414:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851874.372415:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851874.372416:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851874.372417:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693375, transno 0, xid 1858042377944832
00010000:00000001:11.0:1773851874.372419:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851874.372420:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000171a07a9 x1858042377944832/t0(0) o400->bad8bb53-d470-41d5-b97b-22d01f797922@20131@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1740-0'
00010000:00000001:11.0:1773851874.372424:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851874.372425:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851874.372426:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=107 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851874.372428:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851874.372429:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cf0a103a refcount 3 to 20131@kfi7
00000100:00000001:11.0:1773851874.372430:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729381856 : -107155980169760 : ffff9e8acdddcde0)
02000000:00000001:11.0:1773851874.372432:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851874.372432:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851874.372434:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851874.372435:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20066@kfi7
00000400:00000010:11.0:1773851874.372436:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000641ade85.
00000100:00000200:11.0:1773851874.372438:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042377944832, offset 224
00000400:00000200:11.0:1773851874.372440:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20066@kfi7
00000400:00000200:11.0:1773851874.372442:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20066@kfi7 to cpt 2
00000400:00000200:11.0:1773851874.372443:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a32f18d nid 20066@kfi7 refs 1
00000400:00000200:11.0:1773851874.372445:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a32f18d nid 20066@kfi7 refs 2
00000400:00000200:11.0:1773851874.372447:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a32f18d nid 20066@kfi7 refs 3
00000400:00000200:11.0:1773851874.372449:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20066@kfi7 local destination
00000400:00000200:11.0:1773851874.372451:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769472:8769472:1024:4294967295] 20066@kfi7 LPNI seq info [13797217:13797217:16:4294967295]
00000400:00000200:11.0:1773851874.372454:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a32f18d nid 20066@kfi7 refs 2
00000400:00000200:11.0:1773851874.372455:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20066@kfi7 to cpt 2
00000400:00000200:11.0:1773851874.372458:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20066@kfi7(20066@kfi7:20066@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851874.372460:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a32f18d nid 20066@kfi7 refs 3
00000800:00000200:11.0:1773851874.372463:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851874.372464:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851874.372468:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851874.372472:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x856 Using peer 20066@kfi7(0x856)
00000800:00000200:11.0:1773851874.372477:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x856: rc=0
00000800:00000200:11.0:1773851874.372479:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x856 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851874.372485:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851874.372486:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cf0a103a refcount 2 to 20131@kfi7
00010000:00000001:11.0:1773851874.372487:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851874.372488:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851874.372489:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851874.372491:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000171a07a9 x1858042377944832/t0(0) o400->bad8bb53-d470-41d5-b97b-22d01f797922@20131@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1740-0'
00000800:00000200:9.0:1773851874.372492:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x856 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851874.372494:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851874.372496:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000171a07a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:bad8bb53-d470-41d5-b97b-22d01f797922+6:39595:x1858042377944832:12345-20131@kfi7:400:default-tuolumne1740-0 Request processed in 104us (152us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851874.372496:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20066@kfi7: PUT: OK
00000400:00000200:9.0:1773851874.372497:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000641ade85
00000400:00000010:9.0:1773851874.372498:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000641ade85.
00000100:00000001:9.0:1773851874.372499:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851874.372500:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:11.0:1773851874.372501:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20131@kfi7, seq: 2130798
00000400:00000200:9.0:1773851874.372501:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a32f18d nid 20066@kfi7 refs 2
00000100:00000040:11.0:1773851874.372502:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000068b4dc84 : new rpc_count 0
00000100:00000001:11.0:1773851874.372503:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851874.372504:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851874.372504:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20066@kfi7(0000000051555a6a):0x0 lsk 2135 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x856 Transaction freed
00000020:00000010:11.0:1773851874.372505:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851874.372506:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000020:00000010:11.0:1773851874.372508:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058b86f43.
00000020:00000040:11.0:1773851874.372509:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000068b4dc84 : new refcount 5
00000100:00000001:11.0:1773851874.372510:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851874.417452:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851874.417452:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.417452:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.417452:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851874.417454:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.417454:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851874.417455:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851874.417456:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19409@kfi7(00000000fbe8f89e):0x838 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851874.417457:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19409@kfi7 to cpt 2
00000800:00000200:9.0:1773851874.417457:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 Using peer 19409@kfi7(0x838)
00000400:00000200:10.0:1773851874.417458:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19409@kfi7 : PUT - for me
00000400:00000200:10.0:1773851874.417460:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19409@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.417460:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8166335 nid 19409@kfi7 refs 1
00000400:00000200:10.0:1773851874.417462:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19409@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.417462:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8166335 nid 19409@kfi7 refs 2
00000400:00000200:10.0:1773851874.417463:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f8166335 nid 19409@kfi7 refs 3
00000400:00000200:9.0:1773851874.417464:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19409@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.417465:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19217@kfi7 to cpt 0
00000400:00000200:10.0:1773851874.417466:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19217@kfi7 of length 224 into portal 12 MB=0x69b4b7d98b800
00000800:00000200:9.0:1773851874.417466:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x838: rc=0
00000400:00000200:10.0:1773851874.417468:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19217@kfi7 of length 224/224 into md 0x78146ce49 [64] + 141936
00000800:00000200:9.0:1773851874.417468:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:10.0:1773851874.417469:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851874.417471:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851874.417472:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19409@kfi7: PUT: OK
00000100:00000001:10.0:1773851874.417473:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851874.417473:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851874.417473:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005684d651.
00000100:00000040:10.0:1773851874.417474:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000005684d651 x1859598392276992 msgsize 224
00000100:00100000:10.0:1773851874.417475:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-19217@kfi7 (source: 12345-19409@kfi7)
00000100:00000001:10.0:1773851874.417476:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851874.417477:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8166335 nid 19409@kfi7 refs 2
00000800:00000200:9.0:1773851874.417477:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 TN_EVENT_TX_OK event status 0
00000800:00000200:10.0:1773851874.417478:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851874.417478:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851874.417479:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851874.417479:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851874.417480:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 Transaction freed
00000100:00000001:8.0:1773851874.417480:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851874.417480:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851874.417481:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598392276992
00000020:00000001:8.0:1773851874.417481:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851874.417482:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d86979
00000020:00000001:8.0:1773851874.417482:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851874.417485:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d68512dd refcount=5
00000020:00000001:8.0:1773851874.417485:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637084838991872 : -106988870559744 : ffff9eb1b6601800)
00000020:00000001:8.0:1773851874.417486:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637084838991872 : -106988870559744 : ffff9eb1b6601800)
00000100:00000001:8.0:1773851874.417487:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851874.417488:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851874.417488:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091123ffd.
00000020:00000010:8.0:1773851874.417489:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851874.417490:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851874.417491:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851874.417491:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851874.417491:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851874.417492:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851874.417493:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851874.417493:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.417494:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851874.417495:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851874.417496:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851874.417496:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851874.417496:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851874.417497:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851874.417497:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19217@kfi7, seq: 2130799
00000100:00000040:8.0:1773851874.417497:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d68512dd : new rpc_count 1
00000100:00000001:11.0:1773851874.417498:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.417498:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637090064872960 : -106983644678656 : ffff9eb2eddcb600)
00000100:00000040:8.0:1773851874.417500:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005684d651 x1859598392276992/t0(0) o400->56799e87-a26b-44a1-8371-de77b5560583@19217@kfi7:514/0 lens 224/0 e 0 to 0 dl 1773852629 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1697-0'
00000100:00000001:8.0:1773851874.417503:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851874.417503:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851874.417504:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005684d651 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:56799e87-a26b-44a1-8371-de77b5560583+5:39533:x1859598392276992:12345-19217@kfi7:400:default-tuolumne1697-0
00000100:00000200:8.0:1773851874.417506:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598392276992
00000020:00000001:8.0:1773851874.417506:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851874.417507:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851874.417507:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.417508:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851874.417508:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851874.417509:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851874.417510:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598392276992, found 0 last_xid 1859598392276991
00000020:00000001:8.0:1773851874.417510:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851874.417511:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851874.417511:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851874.417512:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.417512:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851874.417513:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851874.417513:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851874.417514:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aea15b63.
02000000:00000001:8.0:1773851874.417515:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.417515:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.417516:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851874.417516:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260404798, transno 0, xid 1859598392276992
00010000:00000001:8.0:1773851874.417517:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851874.417518:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005684d651 x1859598392276992/t0(0) o400->56799e87-a26b-44a1-8371-de77b5560583@19217@kfi7:514/0 lens 224/224 e 0 to 0 dl 1773852629 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1697-0'
00010000:00000001:8.0:1773851874.417520:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851874.417521:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851874.417522:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=107 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851874.417523:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851874.417534:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004a8518ed refcount 3 to 19217@kfi7
00000100:00000001:8.0:1773851874.417534:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850077664 : -107143859473952 : ffff9e8da050f1e0)
02000000:00000001:8.0:1773851874.417535:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851874.417536:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.417536:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851874.417537:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19409@kfi7
00000400:00000010:8.0:1773851874.417538:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000516de938.
00000100:00000200:8.0:1773851874.417539:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598392276992, offset 224
00000400:00000200:8.0:1773851874.417540:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19409@kfi7
00000400:00000200:8.0:1773851874.417541:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19409@kfi7 to cpt 2
00000400:00000200:8.0:1773851874.417542:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8166335 nid 19409@kfi7 refs 1
00000400:00000200:8.0:1773851874.417543:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f8166335 nid 19409@kfi7 refs 2
00000400:00000200:8.0:1773851874.417544:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f8166335 nid 19409@kfi7 refs 3
00000400:00000200:8.0:1773851874.417545:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19409@kfi7 local destination
00000400:00000200:8.0:1773851874.417547:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769473:8769473:1024:4294967295] 19409@kfi7 LPNI seq info [7587342:7587342:16:4294967295]
00000400:00000200:8.0:1773851874.417548:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f8166335 nid 19409@kfi7 refs 2
00000400:00000200:8.0:1773851874.417549:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19409@kfi7 to cpt 2
00000400:00000200:8.0:1773851874.417551:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19409@kfi7(19409@kfi7:19409@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851874.417552:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f8166335 nid 19409@kfi7 refs 3
00000800:00000200:8.0:1773851874.417553:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851874.417554:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851874.417557:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851874.417559:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 Using peer 19409@kfi7(0x838)
00000800:00000200:8.0:1773851874.417562:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x838: rc=0
00000800:00000200:8.0:1773851874.417563:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851874.417565:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851874.417565:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004a8518ed refcount 2 to 19217@kfi7
00010000:00000001:8.0:1773851874.417568:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851874.417569:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.417570:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851874.417570:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005684d651 x1859598392276992/t0(0) o400->56799e87-a26b-44a1-8371-de77b5560583@19217@kfi7:514/0 lens 224/224 e 0 to 0 dl 1773852629 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1697-0'
00000100:00100000:8.0:1773851874.417573:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005684d651 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:56799e87-a26b-44a1-8371-de77b5560583+5:39533:x1859598392276992:12345-19217@kfi7:400:default-tuolumne1697-0 Request processed in 70us (98us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851874.417576:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19217@kfi7, seq: 2130799
00000100:00000040:8.0:1773851874.417577:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d68512dd : new rpc_count 0
00000100:00000001:8.0:1773851874.417578:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851874.417578:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851874.417579:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851874.417579:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851874.417580:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091123ffd.
00000020:00000040:8.0:1773851874.417581:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000d68512dd : new refcount 4
00000100:00000001:8.0:1773851874.417581:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851874.417586:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851874.417588:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851874.417589:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19409@kfi7: PUT: OK
00000400:00000200:9.0:1773851874.417589:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000516de938
00000400:00000010:9.0:1773851874.417590:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000516de938.
00000100:00000001:9.0:1773851874.417590:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851874.417591:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851874.417591:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8166335 nid 19409@kfi7 refs 2
00000800:00000200:9.0:1773851874.417593:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19409@kfi7(00000000fbe8f89e):0x0 lsk 2105 rsk 17 tsk 0 trmk 0 tmk 0 trr 2 tta 0x838 Transaction freed
00000800:00000200:10.0:1773851874.439523:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.439523:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851874.439524:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.439524:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851874.439525:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.439525:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851874.439527:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851874.439527:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20739@kfi7(00000000dde263e2):0xe2 version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851874.439528:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 Using peer 20739@kfi7(0x1000000000000e2)
00000400:00000200:10.0:1773851874.439529:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20739@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.439530:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20739@kfi7 : PUT - for me
00000400:00000200:9.0:1773851874.439530:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20739@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.439531:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20739@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.439532:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 1
00000800:00000200:9.0:1773851874.439532:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x1000000000000e2: rc=0
00000800:00000200:9.0:1773851874.439533:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851874.439534:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20739@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.439534:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 2
00000400:00000200:10.0:1773851874.439535:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 3
00000400:00000200:10.0:1773851874.439536:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20738@kfi7 to cpt 7
00000400:00000200:10.0:1773851874.439537:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20738@kfi7 of length 456 into portal 12 MB=0x69b2e3fb63d40
00000400:00000200:10.0:1773851874.439538:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20738@kfi7 of length 456/456 into md 0x78146ce49 [64] + 142160
00000800:00000200:10.0:1773851874.439540:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851874.439542:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851874.439543:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20739@kfi7: PUT: OK
00000100:00000001:10.0:1773851874.439543:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851874.439544:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851874.439545:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005d410507.
00000100:00000040:10.0:1773851874.439545:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000005d410507 x1859472799972672 msgsize 456
00000800:00000200:9.0:1773851874.439545:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851874.439547:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20738@kfi7 (source: 12345-20739@kfi7)
00000100:00000001:10.0:1773851874.439547:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851874.439547:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 Transaction freed
00000400:00000200:10.0:1773851874.439548:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 2
00000100:00000001:8.0:1773851874.439549:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851874.439549:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851874.439550:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851874.439550:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851874.439550:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851874.439551:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851874.439551:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859472799972672
00000020:00000001:8.0:1773851874.439552:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851874.439552:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c9b8f49ab
00000020:00000001:8.0:1773851874.439553:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851874.439556:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000028f43fb refcount=5
00000020:00000001:8.0:1773851874.439556:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637116198247424 : -106957511304192 : ffff9eb903885c00)
00000020:00000001:8.0:1773851874.439557:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637116198247424 : -106957511304192 : ffff9eb903885c00)
00000100:00000001:8.0:1773851874.439558:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851874.439559:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851874.439559:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebf0718.
00000020:00000010:8.0:1773851874.439560:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851874.439560:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851874.439562:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851874.439562:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851874.439562:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.439563:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.439564:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851874.439565:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851874.439565:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851874.439566:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851874.439566:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851874.439566:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20738@kfi7, seq: 406391009
00000100:00000001:11.0:1773851874.439567:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851874.439567:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000028f43fb : new rpc_count 1
00000100:00000001:11.0:1773851874.439568:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.439568:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637143345351808 : -106930364199808 : ffff9ebf55a04c80)
00000100:00000040:8.0:1773851874.439569:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005d410507 x1859472799972672/t0(0) o17->bd648956-a67d-45cc-8d0f-faaaafb89a03@20738@kfi7:601/0 lens 456/0 e 0 to 0 dl 1773851961 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1799-0'
00000100:00000001:8.0:1773851874.439571:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851874.439572:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851874.439573:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d410507 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:bd648956-a67d-45cc-8d0f-faaaafb89a03+5:39705:x1859472799972672:12345-20738@kfi7:17:default-tuolumne1799-0
00000100:00000200:8.0:1773851874.439574:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859472799972672
00000020:00000001:8.0:1773851874.439574:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851874.439575:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851874.439575:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.439576:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851874.439576:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:8.0:1773851874.439577:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851874.439578:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859472799972672, found 0 last_xid 1859472799972671
00000020:00000001:8.0:1773851874.439578:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851874.439579:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851874.439579:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851874.439580:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851874.439581:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:8.0:1773851874.439582:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851874.439582:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851874.439582:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000000aafebd6.
02000000:00000001:8.0:1773851874.439583:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.439584:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.439585:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:8.0:1773851874.439585:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:8.0:1773851874.439586:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:8.0:1773851874.439588:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.439589:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:8.0:1773851874.439589:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli bd648956-a67d-45cc-8d0f-faaaafb89a03/00000000028f43fb free: 126633370845184 avail: 126633368748032
00000020:00000001:8.0:1773851874.439590:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:8.0:1773851874.439591:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli bd648956-a67d-45cc-8d0f-faaaafb89a03/00000000028f43fb avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:8.0:1773851874.439592:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:8.0:1773851874.439593:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:8.0:1773851874.439593:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli bd648956-a67d-45cc-8d0f-faaaafb89a03/00000000028f43fb reports grant 1811939327 dropped 0, local 1880096767
00000020:00000001:8.0:1773851874.439594:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:8.0:1773851874.439595:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:8.0:1773851874.439595:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851874.439596:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260405693, transno 0, xid 1859472799972672
00010000:00000001:8.0:1773851874.439597:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851874.439597:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005d410507 x1859472799972672/t0(0) o17->bd648956-a67d-45cc-8d0f-faaaafb89a03@20738@kfi7:601/0 lens 456/432 e 0 to 0 dl 1773851961 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1799-0'
00010000:00000001:8.0:1773851874.439600:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851874.439600:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851874.439601:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=107 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851874.439602:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851874.439602:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007a6ad182 refcount 3 to 20738@kfi7
00000100:00000001:8.0:1773851874.439603:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882016 : -107156296669600 : ffff9e8abb006660)
02000000:00000001:8.0:1773851874.439604:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851874.439604:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.439605:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851874.439606:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20739@kfi7
00000400:00000010:8.0:1773851874.439606:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000017f9c5c1.
00000100:00000200:8.0:1773851874.439607:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859472799972672, offset 224
00000400:00000200:8.0:1773851874.439608:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20739@kfi7
00000400:00000200:8.0:1773851874.439609:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20739@kfi7 to cpt 2
00000400:00000200:8.0:1773851874.439610:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 1
00000400:00000200:8.0:1773851874.439610:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 2
00000400:00000200:8.0:1773851874.439612:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 3
00000400:00000200:8.0:1773851874.439613:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20739@kfi7 local destination
00000400:00000200:8.0:1773851874.439614:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769474:8769474:1024:4294967295] 20739@kfi7 LPNI seq info [378211:378211:16:4294967295]
00000400:00000200:8.0:1773851874.439615:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 2
00000400:00000200:8.0:1773851874.439616:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20739@kfi7 to cpt 2
00000400:00000200:8.0:1773851874.439618:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20739@kfi7(20739@kfi7:20739@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851874.439619:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 3
00000800:00000200:8.0:1773851874.439620:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851874.439621:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:8.0:1773851874.439623:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851874.439625:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 Using peer 20739@kfi7(0x1000000000000e2)
00000800:00000200:8.0:1773851874.439628:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 532 bytes to peer 0x1000000000000e2: rc=0
00000800:00000200:8.0:1773851874.439629:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851874.439631:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851874.439632:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007a6ad182 refcount 2 to 20738@kfi7
00010000:00000001:8.0:1773851874.439632:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851874.439633:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.439633:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851874.439634:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005d410507 x1859472799972672/t0(0) o17->bd648956-a67d-45cc-8d0f-faaaafb89a03@20738@kfi7:601/0 lens 456/432 e 0 to 0 dl 1773851961 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1799-0'
00000100:00100000:8.0:1773851874.439638:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d410507 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:bd648956-a67d-45cc-8d0f-faaaafb89a03+5:39705:x1859472799972672:12345-20738@kfi7:17:default-tuolumne1799-0 Request processed in 66us (92us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851874.439640:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20738@kfi7, seq: 406391009
00000100:00000040:8.0:1773851874.439642:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000028f43fb : new rpc_count 0
00000100:00000001:8.0:1773851874.439642:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851874.439643:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851874.439643:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851874.439644:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851874.439644:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebf0718.
00000020:00000040:8.0:1773851874.439645:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000028f43fb : new refcount 4
00000100:00000001:8.0:1773851874.439646:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851874.439650:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851874.439652:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851874.439653:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20739@kfi7: PUT: OK
00000400:00000200:9.0:1773851874.439653:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000017f9c5c1
00000400:00000010:9.0:1773851874.439654:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000017f9c5c1.
00000100:00000001:9.0:1773851874.439654:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851874.439655:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851874.439655:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2cfc4d9 nid 20739@kfi7 refs 2
00000800:00000200:9.0:1773851874.439657:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 20739@kfi7(00000000dde263e2):0x0 lsk 227 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000e2 Transaction freed
00010000:00000001:2.0:1773851874.441734:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441735:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851874.441737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851874.441738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851874.441740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851874.441742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851874.441743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851874.441745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851874.441747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851874.441747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851874.441755:0:937828:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:30.0:1773851874.441757:0:937828:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:30.0:1773851874.441758:0:937828:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:29.0:1773851874.529702:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851874.529703:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851874.529704:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851874.529706:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851874.529708:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26432@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.529709:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26432@kfi7 : PUT - for me
00000400:00000200:29.0:1773851874.529710:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26432@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.529710:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000062736a nid 26432@kfi7 refs 1
00000400:00000200:29.0:1773851874.529713:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26432@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.529713:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000062736a nid 26432@kfi7 refs 2
00000400:00000200:29.0:1773851874.529714:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000062736a nid 26432@kfi7 refs 3
00000400:00000200:29.0:1773851874.529715:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26432@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.529716:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26432@kfi7 of length 224 into portal 12 MB=0x69b4b585cf640
00000400:00000200:29.0:1773851874.529717:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26432@kfi7 of length 224/224 into md 0x77fe139dd [64] + 183056
00000800:00000200:29.0:1773851874.529719:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851874.529721:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851874.529722:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26432@kfi7: PUT: OK
00000100:00000001:29.0:1773851874.529723:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851874.529723:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851874.529728:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dfb36aad.
00000100:00000040:29.0:1773851874.529729:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000dfb36aad x1859597767603776 msgsize 224
00000100:00100000:29.0:1773851874.529730:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26432@kfi7 (source: 12345-26432@kfi7)
00000100:00000001:29.0:1773851874.529731:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851874.529732:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000062736a nid 26432@kfi7 refs 2
00000100:00000001:31.0:1773851874.529733:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851874.529734:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851874.529734:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851874.529734:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851874.529734:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851874.529735:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851874.529736:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597767603776
00000020:00000001:31.0:1773851874.529736:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851874.529737:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74a13
00000020:00000001:31.0:1773851874.529738:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851874.529740:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bab2d1fe refcount=5
00000020:00000001:31.0:1773851874.529741:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118315328512 : -106955394223104 : ffff9eb981b87400)
00000020:00000001:31.0:1773851874.529742:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118315328512 : -106955394223104 : ffff9eb981b87400)
00000100:00000001:31.0:1773851874.529743:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851874.529744:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851874.529744:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851874.529745:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851874.529746:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851874.529747:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851874.529747:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851874.529748:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.529749:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851874.529749:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851874.529750:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.529751:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.529752:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851874.529752:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851874.529752:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851874.529753:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26432@kfi7, seq: 2055538
00000100:00000001:28.0:1773851874.529753:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851874.529754:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bab2d1fe : new rpc_count 1
00000100:00000001:31.0:1773851874.529754:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091507215104 : -106982202336512 : ffff9eb343d51b00)
00000100:00000001:28.0:1773851874.529754:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851874.529755:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.529756:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dfb36aad x1859597767603776/t0(0) o400->79b3382c-c76d-4cf8-bd53-f6867af98d14@26432@kfi7:662/0 lens 224/0 e 0 to 0 dl 1773852022 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2148-0'
00000100:00000001:31.0:1773851874.529759:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851874.529759:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851874.529760:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dfb36aad pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:79b3382c-c76d-4cf8-bd53-f6867af98d14+5:39436:x1859597767603776:12345-26432@kfi7:400:default-tuolumne2148-0
00000100:00000200:31.0:1773851874.529761:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597767603776
00000020:00000001:31.0:1773851874.529762:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851874.529762:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851874.529763:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.529764:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851874.529764:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851874.529765:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851874.529765:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597767603776, found 0 last_xid 1859597767603775
00000020:00000001:31.0:1773851874.529766:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851874.529767:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851874.529768:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851874.529768:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.529769:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851874.529769:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851874.529770:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851874.529771:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000081f5e7b6.
02000000:00000001:31.0:1773851874.529771:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.529772:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.529773:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851874.529773:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014372177, transno 0, xid 1859597767603776
00010000:00000001:31.0:1773851874.529774:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851874.529775:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dfb36aad x1859597767603776/t0(0) o400->79b3382c-c76d-4cf8-bd53-f6867af98d14@26432@kfi7:662/0 lens 224/224 e 0 to 0 dl 1773852022 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2148-0'
00010000:00000001:31.0:1773851874.529777:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851874.529777:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851874.529778:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=107 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851874.529779:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851874.529781:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007df46277 refcount 3 to 26432@kfi7
00000100:00000001:31.0:1773851874.529781:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603213344 : -107155106338272 : ffff9e8b01f36a20)
02000000:00000001:31.0:1773851874.529782:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851874.529783:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.529783:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851874.529784:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26432@kfi7
00000400:00000010:31.0:1773851874.529785:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defdea60.
00000100:00000200:31.0:1773851874.529786:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597767603776, offset 224
00000400:00000200:31.0:1773851874.529787:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26432@kfi7
00000400:00000200:31.0:1773851874.529787:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26432@kfi7 to cpt 7
00000400:00000200:31.0:1773851874.529788:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000062736a nid 26432@kfi7 refs 1
00000400:00000200:31.0:1773851874.529789:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000062736a nid 26432@kfi7 refs 2
00000400:00000200:31.0:1773851874.529790:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000062736a nid 26432@kfi7 refs 3
00000400:00000200:31.0:1773851874.529791:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26432@kfi7 local destination
00000400:00000200:31.0:1773851874.529792:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769475:8769475:1024:4294967295] 26432@kfi7 LPNI seq info [72224:72224:16:4294967295]
00000400:00000200:31.0:1773851874.529794:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000062736a nid 26432@kfi7 refs 2
00000400:00000200:31.0:1773851874.529794:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26432@kfi7 to cpt 7
00000400:00000200:31.0:1773851874.529796:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26432@kfi7(26432@kfi7:26432@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851874.529797:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000062736a nid 26432@kfi7 refs 3
00000800:00000200:31.0:1773851874.529799:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851874.529800:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851874.529802:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851874.529804:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001da Using peer 26432@kfi7(0x1000000000001da)
00000800:00000200:31.0:1773851874.529807:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x1000000000001da: rc=0
00000800:00000200:31.0:1773851874.529808:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001da TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851874.529810:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.529812:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007df46277 refcount 2 to 26432@kfi7
00010000:00000001:31.0:1773851874.529812:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851874.529813:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.529814:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851874.529814:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dfb36aad x1859597767603776/t0(0) o400->79b3382c-c76d-4cf8-bd53-f6867af98d14@26432@kfi7:662/0 lens 224/224 e 0 to 0 dl 1773852022 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2148-0'
00000100:00100000:31.0:1773851874.529817:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dfb36aad pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:79b3382c-c76d-4cf8-bd53-f6867af98d14+5:39436:x1859597767603776:12345-26432@kfi7:400:default-tuolumne2148-0 Request processed in 57us (87us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851874.529819:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26432@kfi7, seq: 2055538
00000100:00000040:31.0:1773851874.529820:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bab2d1fe : new rpc_count 0
00000100:00000001:31.0:1773851874.529821:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851874.529821:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001da TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851874.529822:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851874.529822:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851874.529822:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851874.529823:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851874.529823:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26432@kfi7: PUT: OK
00000020:00000010:31.0:1773851874.529824:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851874.529824:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000bab2d1fe : new refcount 4
00000400:00000200:29.0:1773851874.529824:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defdea60
00000400:00000010:29.0:1773851874.529824:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defdea60.
00000100:00000001:31.0:1773851874.529825:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851874.529825:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851874.529825:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851874.529826:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000062736a nid 26432@kfi7 refs 2
00000800:00000200:29.0:1773851874.529827:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 26432@kfi7(0000000096023196):0x0 lsk 475 rsk 40 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001da Transaction freed
00000800:00000200:21.0:1773851874.546144:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851874.546145:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851874.546146:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851874.546148:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26256@kfi7(00000000bfcb61aa):0x7f3 version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851874.546150:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 Using peer 26256@kfi7(0x1000000000007f3)
00000800:00000200:22.0:1773851874.546152:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:21.0:1773851874.546152:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000800:00000200:22.0:1773851874.546153:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851874.546154:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851874.546154:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0x1000000000007f3: rc=0
00000800:00000200:21.0:1773851874.546155:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:22.0:1773851874.546156:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851874.546158:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000400:00000200:22.0:1773851874.546159:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26256@kfi7 : PUT - for me
00000400:00000200:22.0:1773851874.546160:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000400:00000200:22.0:1773851874.546161:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb4f86df nid 26256@kfi7 refs 1
00000400:00000200:22.0:1773851874.546162:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000400:00000200:22.0:1773851874.546163:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb4f86df nid 26256@kfi7 refs 2
00000400:00000200:22.0:1773851874.546164:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb4f86df nid 26256@kfi7 refs 3
00000400:00000200:22.0:1773851874.546165:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000400:00000200:22.0:1773851874.546166:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26256@kfi7 of length 456 into portal 12 MB=0x699e114da4040
00000400:00000200:22.0:1773851874.546167:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26256@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 44520
00000800:00000200:21.0:1773851874.546167:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 TN_EVENT_TX_OK event status 0
00000800:00000200:22.0:1773851874.546169:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851874.546169:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 Transaction freed
00000400:00000200:22.0:1773851874.546171:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851874.546172:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26256@kfi7: PUT: OK
00000100:00000001:22.0:1773851874.546173:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851874.546173:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851874.546174:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006b0ac05e.
00000100:00000040:22.0:1773851874.546175:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000006b0ac05e x1858041856802880 msgsize 456
00000100:00100000:22.0:1773851874.546176:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-26256@kfi7 (source: 12345-26256@kfi7)
00000100:00000001:22.0:1773851874.546177:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851874.546178:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb4f86df nid 26256@kfi7 refs 2
00000800:00000200:22.0:1773851874.546180:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851874.546180:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851874.546181:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851874.546182:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851874.546182:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851874.546184:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851874.546185:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041856802880
00000020:00000001:20.0:1773851874.546186:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851874.546187:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92fd4
00000020:00000001:20.0:1773851874.546188:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851874.546191:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009f141c83 refcount=6
00000020:00000001:20.0:1773851874.546193:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744908800 : -107128964642816 : ffff9e91181e0800)
00000020:00000001:20.0:1773851874.546194:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744908800 : -107128964642816 : ffff9e91181e0800)
00000100:00000001:20.0:1773851874.546195:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851874.546197:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851874.546198:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000539a19d6.
00000020:00000010:20.0:1773851874.546199:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851874.546201:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000030599e3c.
00000100:00000001:20.0:1773851874.546202:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851874.546202:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851874.546203:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851874.546205:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851874.546206:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851874.546208:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851874.546208:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851874.546208:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851874.546209:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26256@kfi7, seq: 335333147
00000100:00000001:20.0:1773851874.546209:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851874.546210:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009f141c83 : new rpc_count 1
00000100:00000001:23.0:1773851874.546211:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382200448 : -106946327351168 : ffff9ebb9e25f080)
00000100:00000001:20.0:1773851874.546211:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851874.546211:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851874.546212:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006b0ac05e x1858041856802880/t0(0) o17->9d9ccb51-2ba2-4817-a4eb-36a0862f9213@26256@kfi7:157/0 lens 456/0 e 0 to 0 dl 1773852272 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2130-0'
00000100:00000001:23.0:1773851874.546215:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851874.546216:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851874.546217:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b0ac05e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9d9ccb51-2ba2-4817-a4eb-36a0862f9213+6:39686:x1858041856802880:12345-26256@kfi7:17:default-tuolumne2130-0
00000100:00000200:23.0:1773851874.546219:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041856802880
00000020:00000001:23.0:1773851874.546220:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851874.546220:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851874.546221:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.546222:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851874.546222:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:23.0:1773851874.546223:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851874.546224:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041856802880, found 0 last_xid 1858041856802879
00000020:00000001:23.0:1773851874.546224:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851874.546225:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851874.546226:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851874.546226:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851874.546227:0:60934:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:23.0:1773851874.546228:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851874.546228:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851874.546229:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000f5c3be6d.
02000000:00000001:23.0:1773851874.546230:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.546231:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.546232:0:60934:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:23.0:1773851874.546232:0:60934:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:23.0:1773851874.546233:0:60934:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:23.0:1773851874.546234:0:60934:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.546235:0:60934:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:23.0:1773851874.546236:0:60934:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 9d9ccb51-2ba2-4817-a4eb-36a0862f9213/000000009f141c83 free: 126633370845184 avail: 126633368748032
00000020:00000001:23.0:1773851874.546237:0:60934:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:23.0:1773851874.546237:0:60934:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 9d9ccb51-2ba2-4817-a4eb-36a0862f9213/000000009f141c83 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:23.0:1773851874.546239:0:60934:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:23.0:1773851874.546240:0:60934:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:23.0:1773851874.546240:0:60934:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 9d9ccb51-2ba2-4817-a4eb-36a0862f9213/000000009f141c83 reports grant 1814298623 dropped 0, local 1882456063
00000020:00000001:23.0:1773851874.546241:0:60934:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:23.0:1773851874.546242:0:60934:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:23.0:1773851874.546242:0:60934:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851874.546244:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014000167, transno 0, xid 1858041856802880
00010000:00000001:23.0:1773851874.546244:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851874.546245:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006b0ac05e x1858041856802880/t0(0) o17->9d9ccb51-2ba2-4817-a4eb-36a0862f9213@26256@kfi7:157/0 lens 456/432 e 0 to 0 dl 1773852272 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2130-0'
00010000:00000001:23.0:1773851874.546248:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851874.546248:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851874.546249:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=107 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851874.546250:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851874.546251:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004aebef4d refcount 3 to 26256@kfi7
00000100:00000001:23.0:1773851874.546251:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424334080 : -107145285217536 : ffff9e8d4b55d300)
02000000:00000001:23.0:1773851874.546252:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851874.546253:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.546253:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851874.546254:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26256@kfi7
00000400:00000010:23.0:1773851874.546255:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4d95905.
00000100:00000200:23.0:1773851874.546256:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858041856802880, offset 224
00000400:00000200:23.0:1773851874.546257:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26256@kfi7
00000400:00000200:23.0:1773851874.546258:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000400:00000200:23.0:1773851874.546259:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb4f86df nid 26256@kfi7 refs 1
00000400:00000200:23.0:1773851874.546260:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb4f86df nid 26256@kfi7 refs 2
00000400:00000200:23.0:1773851874.546262:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb4f86df nid 26256@kfi7 refs 3
00000400:00000200:23.0:1773851874.546263:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26256@kfi7 local destination
00000400:00000200:23.0:1773851874.546264:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769476:8769476:1024:4294967295] 26256@kfi7 LPNI seq info [11404111:11404111:16:4294967295]
00000400:00000200:23.0:1773851874.546266:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb4f86df nid 26256@kfi7 refs 2
00000400:00000200:23.0:1773851874.546267:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26256@kfi7 to cpt 5
00000400:00000200:23.0:1773851874.546269:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26256@kfi7(26256@kfi7:26256@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851874.546270:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb4f86df nid 26256@kfi7 refs 3
00000800:00000200:23.0:1773851874.546272:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851874.546273:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:23.0:1773851874.546276:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851874.546279:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 Using peer 26256@kfi7(0x1000000000007f3)
00000800:00000200:23.0:1773851874.546283:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 532 bytes to peer 0x1000000000007f3: rc=0
00000800:00000200:23.0:1773851874.546285:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851874.546287:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851874.546288:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004aebef4d refcount 2 to 26256@kfi7
00010000:00000001:23.0:1773851874.546289:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851874.546290:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.546290:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851874.546291:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006b0ac05e x1858041856802880/t0(0) o17->9d9ccb51-2ba2-4817-a4eb-36a0862f9213@26256@kfi7:157/0 lens 456/432 e 0 to 0 dl 1773852272 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2130-0'
00000100:00100000:23.0:1773851874.546295:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b0ac05e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9d9ccb51-2ba2-4817-a4eb-36a0862f9213+6:39686:x1858041856802880:12345-26256@kfi7:17:default-tuolumne2130-0 Request processed in 78us (119us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851874.546296:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851874.546297:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26256@kfi7, seq: 335333147
00000100:00000040:23.0:1773851874.546298:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009f141c83 : new rpc_count 0
00000400:00000200:21.0:1773851874.546298:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851874.546299:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851874.546299:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26256@kfi7: PUT: OK
00000100:00000001:23.0:1773851874.546300:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851874.546300:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4d95905
00000400:00000010:21.0:1773851874.546300:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4d95905.
00000020:00000010:23.0:1773851874.546301:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000100:00000001:21.0:1773851874.546301:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851874.546301:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851874.546302:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000030599e3c.
00000400:00000200:21.0:1773851874.546302:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb4f86df nid 26256@kfi7 refs 2
00000020:00000010:23.0:1773851874.546303:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000539a19d6.
00000020:00000040:23.0:1773851874.546304:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009f141c83 : new refcount 5
00000100:00000001:23.0:1773851874.546304:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851874.546304:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 26256@kfi7(00000000bfcb61aa):0x0 lsk 2036 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000007f3 Transaction freed
00000800:00000200:10.0:1773851874.575040:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.575040:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851874.575041:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.575041:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851874.575043:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.575043:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851874.575045:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851874.575045:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21587@kfi7(0000000017f8c270):0xcf version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851874.575046:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf Using peer 21587@kfi7(0x1000000000000cf)
00000400:00000200:10.0:1773851874.575047:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21587@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.575048:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21587@kfi7 : PUT - for me
00000400:00000200:9.0:1773851874.575048:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21587@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.575049:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21587@kfi7 to cpt 2
00000400:00000200:10.0:1773851874.575050:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006294916 nid 21587@kfi7 refs 1
00000800:00000200:9.0:1773851874.575050:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x1000000000000cf: rc=0
00000400:00000200:10.0:1773851874.575051:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21587@kfi7 to cpt 2
00000800:00000200:9.0:1773851874.575051:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851874.575052:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006294916 nid 21587@kfi7 refs 2
00000400:00000200:10.0:1773851874.575053:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000006294916 nid 21587@kfi7 refs 3
00000400:00000200:10.0:1773851874.575054:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21586@kfi7 to cpt 7
00000400:00000200:10.0:1773851874.575055:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21586@kfi7 of length 224 into portal 12 MB=0x69b174e873dc0
00000400:00000200:10.0:1773851874.575057:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21586@kfi7 of length 224/224 into md 0x78146ce49 [64] + 142616
00000800:00000200:10.0:1773851874.575058:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851874.575060:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851874.575061:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21587@kfi7: PUT: OK
00000100:00000001:10.0:1773851874.575062:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851874.575063:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851874.575063:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf TN_EVENT_TX_OK event status 0
00000100:00000010:10.0:1773851874.575064:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008ded8871.
00000100:00000040:10.0:1773851874.575064:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000008ded8871 x1859374264303040 msgsize 224
00000800:00000200:9.0:1773851874.575065:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf Transaction freed
00000100:00100000:10.0:1773851874.575066:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-21586@kfi7 (source: 12345-21587@kfi7)
00000100:00000001:10.0:1773851874.575067:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851874.575068:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000006294916 nid 21587@kfi7 refs 2
00000800:00000200:10.0:1773851874.575069:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2054@kfi7:2 <- 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851874.575069:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851874.575069:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851874.575070:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851874.575070:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851874.575071:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851874.575072:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374264303040
00000020:00000001:8.0:1773851874.575072:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851874.575073:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae11985
00000020:00000001:8.0:1773851874.575073:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851874.575075:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b2b25a5 refcount=5
00000020:00000001:8.0:1773851874.575076:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917805077504 : -107155904474112 : ffff9e8ad260d400)
00000020:00000001:8.0:1773851874.575077:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917805077504 : -107155904474112 : ffff9e8ad260d400)
00000100:00000001:8.0:1773851874.575078:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851874.575079:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851874.575080:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebf0718.
00000020:00000010:8.0:1773851874.575081:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851874.575081:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851874.575082:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851874.575082:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851874.575083:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851874.575084:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851874.575085:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851874.575085:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.575086:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851874.575087:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851874.575087:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851874.575088:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851874.575088:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851874.575089:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21586@kfi7, seq: 2130800
00000100:00000001:11.0:1773851874.575090:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851874.575090:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851874.575090:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b2b25a5 : new rpc_count 1
00000100:00000001:8.0:1773851874.575090:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637143345339136 : -106930364212480 : ffff9ebf55a01b00)
00000100:00000040:8.0:1773851874.575091:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008ded8871 x1859374264303040/t0(0) o400->2393968c-3ac8-4a5a-9e12-c3c1e848796a@21586@kfi7:662/0 lens 224/0 e 0 to 0 dl 1773852022 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1846-0'
00000100:00000001:8.0:1773851874.575094:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851874.575094:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851874.575095:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ded8871 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2393968c-3ac8-4a5a-9e12-c3c1e848796a+5:39743:x1859374264303040:12345-21586@kfi7:400:default-tuolumne1846-0
00000100:00000200:8.0:1773851874.575096:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374264303040
00000020:00000001:8.0:1773851874.575097:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851874.575098:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851874.575098:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.575099:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851874.575100:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851874.575100:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851874.575101:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374264303040, found 0 last_xid 1859374264303039
00000020:00000001:8.0:1773851874.575102:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851874.575102:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851874.575103:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851874.575103:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.575104:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851874.575105:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851874.575105:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851874.575106:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000091123ffd.
02000000:00000001:8.0:1773851874.575106:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.575107:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.575108:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851874.575108:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096700371, transno 0, xid 1859374264303040
00010000:00000001:8.0:1773851874.575109:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851874.575110:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008ded8871 x1859374264303040/t0(0) o400->2393968c-3ac8-4a5a-9e12-c3c1e848796a@21586@kfi7:662/0 lens 224/224 e 0 to 0 dl 1773852022 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1846-0'
00010000:00000001:8.0:1773851874.575112:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851874.575113:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851874.575114:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=107 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851874.575115:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851874.575116:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e1c4ca2c refcount 3 to 21586@kfi7
00000100:00000001:8.0:1773851874.575117:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412881824 : -107156296669792 : ffff9e8abb0065a0)
02000000:00000001:8.0:1773851874.575117:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851874.575118:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851874.575119:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851874.575120:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21587@kfi7
00000400:00000010:8.0:1773851874.575120:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4057092.
00000100:00000200:8.0:1773851874.575121:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374264303040, offset 224
00000400:00000200:8.0:1773851874.575122:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21587@kfi7
00000400:00000200:8.0:1773851874.575123:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21587@kfi7 to cpt 2
00000400:00000200:8.0:1773851874.575124:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006294916 nid 21587@kfi7 refs 1
00000400:00000200:8.0:1773851874.575125:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000006294916 nid 21587@kfi7 refs 2
00000400:00000200:8.0:1773851874.575126:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000006294916 nid 21587@kfi7 refs 3
00000400:00000200:8.0:1773851874.575127:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21587@kfi7 local destination
00000400:00000200:8.0:1773851874.575128:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769477:8769477:1024:4294967295] 21587@kfi7 LPNI seq info [10144882:10144882:16:4294967295]
00000400:00000200:8.0:1773851874.575129:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000006294916 nid 21587@kfi7 refs 2
00000400:00000200:8.0:1773851874.575130:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21587@kfi7 to cpt 2
00000400:00000200:8.0:1773851874.575132:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21587@kfi7(21587@kfi7:21587@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851874.575133:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000006294916 nid 21587@kfi7 refs 3
00000800:00000200:8.0:1773851874.575134:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851874.575135:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851874.575137:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851874.575140:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf Using peer 21587@kfi7(0x1000000000000cf)
00000800:00000200:8.0:1773851874.575142:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x1000000000000cf: rc=0
00000800:00000200:8.0:1773851874.575143:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851874.575148:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851874.575148:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e1c4ca2c refcount 2 to 21586@kfi7
00010000:00000001:8.0:1773851874.575149:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851874.575150:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851874.575152:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851874.575153:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008ded8871 x1859374264303040/t0(0) o400->2393968c-3ac8-4a5a-9e12-c3c1e848796a@21586@kfi7:662/0 lens 224/224 e 0 to 0 dl 1773852022 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1846-0'
00000100:00100000:8.0:1773851874.575156:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ded8871 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2393968c-3ac8-4a5a-9e12-c3c1e848796a+5:39743:x1859374264303040:12345-21586@kfi7:400:default-tuolumne1846-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851874.575158:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21586@kfi7, seq: 2130800
00000100:00000040:8.0:1773851874.575159:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b2b25a5 : new rpc_count 0
00000100:00000001:8.0:1773851874.575160:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851874.575160:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851874.575161:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851874.575162:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851874.575162:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebf0718.
00000020:00000040:8.0:1773851874.575163:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000002b2b25a5 : new refcount 4
00000100:00000001:8.0:1773851874.575164:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851874.575169:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851874.575171:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851874.575173:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21587@kfi7: PUT: OK
00000400:00000200:9.0:1773851874.575173:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4057092
00000400:00000010:9.0:1773851874.575174:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4057092.
00000100:00000001:9.0:1773851874.575174:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851874.575175:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851874.575176:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000006294916 nid 21587@kfi7 refs 2
00000800:00000200:9.0:1773851874.575177:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 21587@kfi7(0000000017f8c270):0x0 lsk 208 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000cf Transaction freed
00000800:00000200:14.0:1773851874.580987:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851874.580988:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851874.580989:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851874.580991:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851874.580994:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17506@kfi7 to cpt 3
00000400:00000200:14.0:1773851874.580995:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17506@kfi7 : PUT - for me
00000400:00000200:14.0:1773851874.580996:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17506@kfi7 to cpt 3
00000400:00000200:14.0:1773851874.580997:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c0a750d8 nid 17506@kfi7 refs 1
00000400:00000200:14.0:1773851874.580999:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17506@kfi7 to cpt 3
00000400:00000200:14.0:1773851874.580999:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c0a750d8 nid 17506@kfi7 refs 2
00000400:00000200:14.0:1773851874.581000:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c0a750d8 nid 17506@kfi7 refs 3
00000400:00000200:14.0:1773851874.581001:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17570@kfi7 to cpt 7
00000400:00000200:14.0:1773851874.581002:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17570@kfi7 of length 224 into portal 12 MB=0x69b4b6e11b740
00000400:00000200:14.0:1773851874.581003:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17570@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 36168
00000800:00000200:14.0:1773851874.581005:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851874.581007:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851874.581008:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17506@kfi7: PUT: OK
00000100:00000001:14.0:1773851874.581009:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851874.581010:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851874.581010:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000feb7a9ea.
00000100:00000040:14.0:1773851874.581011:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000feb7a9ea x1859598131771200 msgsize 224
00000100:00100000:14.0:1773851874.581012:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-17570@kfi7 (source: 12345-17506@kfi7)
00000100:00000001:14.0:1773851874.581013:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851874.581014:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c0a750d8 nid 17506@kfi7 refs 2
00000100:00000001:15.0:1773851874.581015:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851874.581015:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851874.581016:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851874.581016:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851874.581016:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851874.581017:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851874.581018:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598131771200
00000020:00000001:15.0:1773851874.581018:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851874.581019:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d811cf
00000020:00000001:15.0:1773851874.581020:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851874.581024:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008123bd0a refcount=8
00000020:00000001:15.0:1773851874.581024:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114138096640 : -106959571454976 : ffff9eb888bcf400)
00000020:00000001:15.0:1773851874.581025:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637114138096640 : -106959571454976 : ffff9eb888bcf400)
00000100:00000001:15.0:1773851874.581026:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.581027:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851874.581028:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000055324ba3.
00000020:00000010:15.0:1773851874.581029:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851874.581030:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851874.581030:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851874.581031:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851874.581031:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851874.581032:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851874.581033:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851874.581034:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.581034:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851874.581036:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851874.581036:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851874.581037:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851874.581037:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851874.581038:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17570@kfi7, seq: 2289860
00000100:00000040:15.0:1773851874.581038:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008123bd0a : new rpc_count 1
00000100:00000001:12.0:1773851874.581038:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.581039:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562696064 : -106978146855552 : ffff9eb4358ed580)
00000100:00000001:12.0:1773851874.581039:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.581040:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000feb7a9ea x1859598131771200/t0(0) o400->ed58003d-a572-44ae-9275-4c7dec960c5c@17570@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1580-0'
00000100:00000001:15.0:1773851874.581043:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.581043:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851874.581044:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000feb7a9ea pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ed58003d-a572-44ae-9275-4c7dec960c5c+8:39517:x1859598131771200:12345-17570@kfi7:400:default-tuolumne1580-0
00000100:00000200:15.0:1773851874.581046:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598131771200
00000020:00000001:15.0:1773851874.581046:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851874.581047:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851874.581047:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.581048:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851874.581049:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851874.581049:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851874.581050:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598131771200, found 0 last_xid 1859598131771199
00000020:00000001:15.0:1773851874.581051:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851874.581051:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851874.581052:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851874.581052:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.581053:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851874.581054:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851874.581054:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851874.581055:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000078ded45d.
02000000:00000001:15.0:1773851874.581055:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.581056:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.581057:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851874.581057:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182337385516, transno 0, xid 1859598131771200
00010000:00000001:15.0:1773851874.581059:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851874.581060:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000feb7a9ea x1859598131771200/t0(0) o400->ed58003d-a572-44ae-9275-4c7dec960c5c@17570@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1580-0'
00010000:00000001:15.0:1773851874.581062:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851874.581062:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851874.581063:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=107 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851874.581064:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851874.581065:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a9433410 refcount 3 to 17570@kfi7
00000100:00000001:15.0:1773851874.581066:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065376 : -107155994486240 : ffff9e8acd035a20)
02000000:00000001:15.0:1773851874.581066:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851874.581067:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.581068:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851874.581068:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17506@kfi7
00000400:00000010:15.0:1773851874.581069:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edce5c74.
00000100:00000200:15.0:1773851874.581070:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598131771200, offset 224
00000400:00000200:15.0:1773851874.581071:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17506@kfi7
00000400:00000200:15.0:1773851874.581072:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17506@kfi7 to cpt 3
00000400:00000200:15.0:1773851874.581072:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c0a750d8 nid 17506@kfi7 refs 1
00000400:00000200:15.0:1773851874.581073:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c0a750d8 nid 17506@kfi7 refs 2
00000400:00000200:15.0:1773851874.581074:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c0a750d8 nid 17506@kfi7 refs 3
00000400:00000200:15.0:1773851874.581076:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17506@kfi7 local destination
00000400:00000200:15.0:1773851874.581077:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769478:8769478:1024:4294967295] 17506@kfi7 LPNI seq info [4272110:4272110:16:4294967295]
00000400:00000200:15.0:1773851874.581078:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c0a750d8 nid 17506@kfi7 refs 2
00000400:00000200:15.0:1773851874.581079:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17506@kfi7 to cpt 3
00000400:00000200:15.0:1773851874.581081:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17506@kfi7(17506@kfi7:17506@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851874.581082:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c0a750d8 nid 17506@kfi7 refs 3
00000800:00000200:15.0:1773851874.581084:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851874.581085:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851874.581087:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851874.581102:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000760 Using peer 17506@kfi7(0x100000000000760)
00000800:00000200:15.0:1773851874.581105:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x100000000000760: rc=0
00000800:00000200:15.0:1773851874.581106:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000760 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851874.581109:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.581109:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a9433410 refcount 2 to 17570@kfi7
00010000:00000001:15.0:1773851874.581110:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851874.581111:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.581111:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851874.581112:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000feb7a9ea x1859598131771200/t0(0) o400->ed58003d-a572-44ae-9275-4c7dec960c5c@17570@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1580-0'
00000100:00100000:15.0:1773851874.581115:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000feb7a9ea pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ed58003d-a572-44ae-9275-4c7dec960c5c+8:39517:x1859598131771200:12345-17570@kfi7:400:default-tuolumne1580-0 Request processed in 71us (103us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851874.581117:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17570@kfi7, seq: 2289860
00000100:00000040:15.0:1773851874.581118:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008123bd0a : new rpc_count 0
00000100:00000001:15.0:1773851874.581119:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851874.581120:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851874.581120:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:14.0:1773851874.581120:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000760 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851874.581121:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000400:00000200:14.0:1773851874.581121:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851874.581122:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000055324ba3.
00000020:00000040:15.0:1773851874.581122:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000008123bd0a : new refcount 7
00000400:00000200:14.0:1773851874.581122:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17506@kfi7: PUT: OK
00000100:00000001:15.0:1773851874.581123:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851874.581123:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edce5c74
00000400:00000010:14.0:1773851874.581124:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edce5c74.
00000100:00000001:14.0:1773851874.581125:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851874.581125:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851874.581126:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c0a750d8 nid 17506@kfi7 refs 2
00000800:00000200:14.0:1773851874.581127:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17506@kfi7(00000000fa8bc204):0x0 lsk 1889 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000760 Transaction freed
00000800:00000200:29.0:1773851874.614093:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851874.614094:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851874.614096:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851874.614098:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851874.614100:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.614101:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:29.0:1773851874.614102:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.614102:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:29.0:1773851874.614103:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.614104:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:29.0:1773851874.614105:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:29.0:1773851874.614106:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.614107:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 224 into portal 12 MB=0x699e0eb568a80
00000400:00000200:29.0:1773851874.614108:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2095@kfi7 of length 224/224 into md 0x77fe139dd [64] + 183280
00000800:00000200:29.0:1773851874.614110:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851874.614111:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851874.614112:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000100:00000001:29.0:1773851874.614113:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851874.614114:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851874.614114:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042fb68a8.
00000100:00000040:29.0:1773851874.614115:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000042fb68a8 x1858041160305280 msgsize 224
00000100:00100000:29.0:1773851874.614116:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2095@kfi7 (source: 12345-2095@kfi7)
00000100:00000001:29.0:1773851874.614117:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851874.614118:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:31.0:1773851874.614119:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851874.614119:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851874.614120:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851874.614120:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851874.614120:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851874.614121:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851874.614122:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041160305280
00000020:00000001:31.0:1773851874.614122:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851874.614123:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acba071
00000020:00000001:31.0:1773851874.614123:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851874.614126:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006dd054ab refcount=5
00000020:00000001:31.0:1773851874.614127:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636943350904832 : -107130358646784 : ffff9e90c5073800)
00000020:00000001:31.0:1773851874.614127:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636943350904832 : -107130358646784 : ffff9e90c5073800)
00000100:00000001:31.0:1773851874.614129:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851874.614129:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851874.614130:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851874.614131:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851874.614132:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851874.614133:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851874.614133:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851874.614134:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.614134:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851874.614135:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851874.614135:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.614136:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.614137:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851874.614138:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851874.614138:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851874.614138:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851874.614139:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2095@kfi7, seq: 2055539
00000100:00000040:31.0:1773851874.614140:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006dd054ab : new rpc_count 1
00000100:00000001:31.0:1773851874.614140:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091507223168 : -106982202328448 : ffff9eb343d53a80)
00000100:00000001:28.0:1773851874.614140:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851874.614140:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.614141:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042fb68a8 x1858041160305280/t0(0) o400->lustre5-MDT0001-lwp-OST0007_UUID@2095@kfi7:662/0 lens 224/0 e 0 to 0 dl 1773852022 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba108-0'
00000100:00000001:31.0:1773851874.614144:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851874.614144:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851874.614145:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042fb68a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0007_UUID+5:272575:x1858041160305280:12345-2095@kfi7:400:default-yuba108-0
00000100:00000200:31.0:1773851874.614147:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041160305280
00000020:00000001:31.0:1773851874.614147:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851874.614148:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851874.614148:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.614149:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851874.614150:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851874.614150:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:31.0:1773851874.614151:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851874.614152:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851874.614152:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851874.614153:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.614153:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851874.614154:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851874.614155:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851874.614156:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000961be362.
02000000:00000001:31.0:1773851874.614156:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.614157:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.614158:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851874.614159:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041160305280
00010000:00000001:31.0:1773851874.614160:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851874.614160:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042fb68a8 x1858041160305280/t0(0) o400->lustre5-MDT0001-lwp-OST0007_UUID@2095@kfi7:662/0 lens 224/224 e 0 to 0 dl 1773852022 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba108-0'
00010000:00000001:31.0:1773851874.614163:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851874.614163:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851874.614164:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=107 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851874.614165:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851874.614165:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000843b706b refcount 7 to 2095@kfi7
00000100:00000001:31.0:1773851874.614166:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932576 : -107137839619040 : ffff9e8f0720a420)
02000000:00000001:31.0:1773851874.614167:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851874.614167:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.614168:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851874.614169:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000010:31.0:1773851874.614170:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000eb85f77.
00000100:00000200:31.0:1773851874.614170:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041160305280, offset 224
00000400:00000200:31.0:1773851874.614171:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:31.0:1773851874.614172:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:31.0:1773851874.614173:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:31.0:1773851874.614174:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:31.0:1773851874.614175:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:31.0:1773851874.614176:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2095@kfi7 local destination
00000400:00000200:31.0:1773851874.614177:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769479:8769479:1024:4294967295] 2095@kfi7 LPNI seq info [5406044:5406044:16:4294967295]
00000400:00000200:31.0:1773851874.614179:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:31.0:1773851874.614179:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:31.0:1773851874.614181:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851874.614182:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000800:00000200:31.0:1773851874.614183:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851874.614184:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851874.614189:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851874.614191:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005b3 Using peer 2095@kfi7(0x2000000000005b3)
00000800:00000200:31.0:1773851874.614194:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x2000000000005b3: rc=0
00000800:00000200:31.0:1773851874.614196:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851874.614198:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.614199:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000843b706b refcount 6 to 2095@kfi7
00010000:00000001:31.0:1773851874.614199:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851874.614200:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851874.614200:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851874.614201:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042fb68a8 x1858041160305280/t0(0) o400->lustre5-MDT0001-lwp-OST0007_UUID@2095@kfi7:662/0 lens 224/224 e 0 to 0 dl 1773852022 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba108-0'
00000100:00100000:31.0:1773851874.614204:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042fb68a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:lustre5-MDT0001-lwp-OST0007_UUID+5:272575:x1858041160305280:12345-2095@kfi7:400:default-yuba108-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851874.614206:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005b3 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851874.614207:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2095@kfi7, seq: 2055539
00000100:00000040:31.0:1773851874.614207:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006dd054ab : new rpc_count 0
00000400:00000200:29.0:1773851874.614207:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851874.614208:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851874.614208:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000100:00000001:31.0:1773851874.614209:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851874.614209:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851874.614209:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000eb85f77
00000020:00000010:31.0:1773851874.614210:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000010:29.0:1773851874.614210:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000eb85f77.
00000100:00000001:29.0:1773851874.614210:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:31.0:1773851874.614211:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851874.614211:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000006dd054ab : new refcount 4
00000100:00000001:29.0:1773851874.614211:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851874.614212:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851874.614212:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000800:00000200:29.0:1773851874.614213:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005b3 Transaction freed
00000800:00000200:9.0:1773851874.622703:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.622704:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.622705:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.622707:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851874.622709:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.622711:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.164@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851874.622712:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.622713:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851874.622714:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.164@o2ib600 to cpt 5
00000400:00000200:9.0:1773851874.622716:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c241edd nid 172.19.3.164@o2ib600 refs 2
00000400:00000200:9.0:1773851874.622717:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c241edd nid 172.19.3.164@o2ib600 refs 3
00000400:00000200:9.0:1773851874.622718:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.164@o2ib600 to cpt 5
00000400:00000200:9.0:1773851874.622719:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.164@o2ib600 of length 224 into portal 12 MB=0x699f2c5bb13c0
00000400:00000200:9.0:1773851874.622721:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.164@o2ib600 of length 224/224 into md 0x6a32cacf5 [64] + 44976
00000800:00000200:9.0:1773851874.622723:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851874.622727:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851874.622728:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851874.622729:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851874.622731:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851874.622732:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000093a608b7.
00000100:00000040:9.0:1773851874.622732:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000093a608b7 x1858117838771136 msgsize 224
00000100:00100000:9.0:1773851874.622734:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.164@o2ib600 (source: 12345-172.19.3.164@o2ib600)
00000100:00000001:9.0:1773851874.622736:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851874.622738:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851874.622739:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851874.622743:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851874.622744:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851874.622745:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851874.622746:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851874.622748:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851874.622749:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858117838771136
00000020:00000001:23.0:1773851874.622750:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851874.622751:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dbb
00000020:00000001:23.0:1773851874.622753:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851874.622758:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a9f9b82 refcount=6
00000020:00000001:23.0:1773851874.622759:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239489536 : -107152470062080 : ffff9e8b9f15cc00)
00000020:00000001:23.0:1773851874.622761:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239489536 : -107152470062080 : ffff9e8b9f15cc00)
00000100:00000001:23.0:1773851874.622762:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851874.622764:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851874.622765:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b5b545a6.
00000020:00000010:23.0:1773851874.622767:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851874.622768:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851874.622771:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851874.622772:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851874.622773:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851874.622775:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851874.622776:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851874.622777:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.622779:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851874.622782:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851874.622782:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851874.622782:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851874.622783:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851874.622785:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.164@o2ib600, seq: 1997999
00000100:00000040:20.0:1773851874.622786:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a9f9b82 : new rpc_count 1
00000100:00000001:23.0:1773851874.622787:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.622788:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851874.622788:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096254336 : -107006613297280 : ffff9ead94d36780)
00000100:00000040:20.0:1773851874.622790:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000093a608b7 x1858117838771136/t0(0) o400->0e1c9c74-59e6-4465-926d-fcd11a5f127c@172.19.3.164@o2ib600:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic14-0'
00000100:00000001:20.0:1773851874.622795:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851874.622796:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851874.622798:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093a608b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0e1c9c74-59e6-4465-926d-fcd11a5f127c+6:24707:x1858117838771136:12345-172.19.3.164@o2ib600:400:default-oslic14-0
00000100:00000200:20.0:1773851874.622800:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858117838771136
00000020:00000001:20.0:1773851874.622801:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851874.622802:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851874.622803:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851874.622804:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851874.622805:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851874.622806:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851874.622807:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858117838771136, found 0 last_xid 1858117838771135
00000020:00000001:20.0:1773851874.622809:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851874.622810:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851874.622811:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851874.622812:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851874.622813:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851874.622814:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851874.622815:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851874.622816:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4b29c3e.
02000000:00000001:20.0:1773851874.622817:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851874.622818:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851874.622819:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851874.622820:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183211428482, transno 0, xid 1858117838771136
00010000:00000001:20.0:1773851874.622821:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851874.622823:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000093a608b7 x1858117838771136/t0(0) o400->0e1c9c74-59e6-4465-926d-fcd11a5f127c@172.19.3.164@o2ib600:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic14-0'
00010000:00000001:20.0:1773851874.622827:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851874.622828:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851874.622829:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=107 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851874.622831:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851874.622832:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3139d8a refcount 3 to 172.19.3.164@o2ib600
00000100:00000001:20.0:1773851874.622833:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027488 : -107156745524128 : ffff9e8aa03f6c60)
02000000:00000001:20.0:1773851874.622835:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851874.622836:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851874.622837:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851874.622838:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.164@o2ib600
00000400:00000010:20.0:1773851874.622839:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b1efbb09.
00000100:00000200:20.0:1773851874.622840:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858117838771136, offset 224
00000400:00000200:20.0:1773851874.622843:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.164@o2ib600
00000400:00000200:20.0:1773851874.622845:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.164@o2ib600 to cpt 5
00000400:00000200:20.0:1773851874.622848:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c241edd nid 172.19.3.164@o2ib600 refs 2
00000400:00000200:20.0:1773851874.622850:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c241edd nid 172.19.3.164@o2ib600 refs 3
00000400:00000200:20.0:1773851874.622853:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c241edd nid 172.19.3.164@o2ib600 refs 4
00000400:00000200:20.0:1773851874.622855:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.164@o2ib600 routed destination
00000400:00000200:20.0:1773851874.622857:0:61145:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:20.0:1773851874.622860:0:61145:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:20.0:1773851874.622862:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.164@o2ib600: rtr pref emtpy: 1
00000400:00000200:20.0:1773851874.622864:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:20.0:1773851874.622866:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.164@o2ib600: rtr pref emtpy: 1
00000400:00000200:20.0:1773851874.622867:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:20.0:1773851874.622869:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769480:8769480:1024:4294967295] 2094@kfi7 LPNI seq info [1258747003:1258747003:16:4294967295]
00000400:00000200:20.0:1773851874.622872:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:20.0:1773851874.622873:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:20.0:1773851874.622877:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.164@o2ib600(172.19.3.164@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851874.622880:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c241edd nid 172.19.3.164@o2ib600 refs 3
00000800:00000200:20.0:1773851874.622883:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851874.622885:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851874.622889:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851874.622893:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:20.0:1773851874.622897:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:20.0:1773851874.622900:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851874.622903:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851874.622906:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3139d8a refcount 2 to 172.19.3.164@o2ib600
00010000:00000001:20.0:1773851874.622907:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851874.622908:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851874.622909:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851874.622910:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000093a608b7 x1858117838771136/t0(0) o400->0e1c9c74-59e6-4465-926d-fcd11a5f127c@172.19.3.164@o2ib600:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic14-0'
00000100:00100000:20.0:1773851874.622915:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093a608b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0e1c9c74-59e6-4465-926d-fcd11a5f127c+6:24707:x1858117838771136:12345-172.19.3.164@o2ib600:400:default-oslic14-0 Request processed in 119us (181us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851874.622920:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.164@o2ib600, seq: 1997999
00000100:00000040:20.0:1773851874.622921:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a9f9b82 : new rpc_count 0
00000100:00000001:20.0:1773851874.622923:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851874.622923:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851874.622924:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851874.622926:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:20.0:1773851874.622927:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b5b545a6.
00000020:00000040:20.0:1773851874.622928:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000001a9f9b82 : new refcount 5
00000100:00000001:20.0:1773851874.622930:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851874.622937:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851874.622940:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851874.622942:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:21.0:1773851874.622943:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b1efbb09
00000400:00000010:21.0:1773851874.622943:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b1efbb09.
00000100:00000001:21.0:1773851874.622944:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851874.622946:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851874.622947:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:21.0:1773851874.622950:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Transaction freed
00000800:00000200:26.0:1773851874.627804:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851874.627805:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851874.627807:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851874.627809:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851874.627811:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20112@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.627812:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20112@kfi7 : PUT - for me
00000400:00000200:26.0:1773851874.627813:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20112@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.627813:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 1
00000400:00000200:26.0:1773851874.627814:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20112@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.627815:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 2
00000400:00000200:26.0:1773851874.627816:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 3
00000400:00000200:26.0:1773851874.627817:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20049@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.627818:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20049@kfi7 of length 224 into portal 12 MB=0x69b8199d20580
00000400:00000200:26.0:1773851874.627819:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20049@kfi7 of length 224/224 into md 0x16159c9699 [64] + 21656
00000800:00000200:26.0:1773851874.627821:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851874.627823:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851874.627824:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20112@kfi7: PUT: OK
00000100:00000001:26.0:1773851874.627825:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851874.627826:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851874.627827:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bb16047f.
00000100:00000040:26.0:1773851874.627827:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000bb16047f x1859830794028416 msgsize 224
00000100:00100000:26.0:1773851874.627829:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-20049@kfi7 (source: 12345-20112@kfi7)
00000100:00000001:26.0:1773851874.627830:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851874.627831:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 2
00000800:00000200:26.0:1773851874.627833:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851874.627835:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851874.627836:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851874.627836:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851874.627837:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851874.627837:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851874.627838:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830794028416
00000020:00000001:26.0:1773851874.627839:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851874.627839:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce671d9
00000020:00000001:26.0:1773851874.627840:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851874.627841:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001e259bc3 refcount=5
00000020:00000001:26.0:1773851874.627842:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123811863552 : -106949897688064 : ffff9ebac956ec00)
00000020:00000001:26.0:1773851874.627843:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123811863552 : -106949897688064 : ffff9ebac956ec00)
00000100:00000001:26.0:1773851874.627844:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851874.627845:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851874.627846:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd5c6346.
00000020:00000010:26.0:1773851874.627847:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851874.627848:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b167360e.
00000100:00000001:26.0:1773851874.627848:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851874.627849:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851874.627849:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851874.627850:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851874.627852:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851874.627852:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.627853:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.627855:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.627855:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851874.627855:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851874.627855:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851874.627856:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20049@kfi7, seq: 2025124
00000100:00000040:27.0:1773851874.627857:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001e259bc3 : new rpc_count 1
00000100:00000001:26.0:1773851874.627857:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.627858:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150707968 : -106980558843648 : ffff9eb3a5cad100)
00000100:00000001:26.0:1773851874.627858:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.627859:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bb16047f x1859830794028416/t0(0) o400->7e143d6e-eb23-47ea-9943-959268f60ba0@20049@kfi7:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1746-0'
00000100:00000001:27.0:1773851874.627862:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.627862:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851874.627863:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb16047f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7e143d6e-eb23-47ea-9943-959268f60ba0+5:39463:x1859830794028416:12345-20049@kfi7:400:default-tuolumne1746-0
00000100:00000200:27.0:1773851874.627864:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830794028416
00000020:00000001:27.0:1773851874.627865:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851874.627865:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851874.627866:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.627867:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851874.627867:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851874.627868:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851874.627868:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830794028416, found 0 last_xid 1859830794028415
00000020:00000001:27.0:1773851874.627869:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851874.627870:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851874.627870:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851874.627871:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.627872:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851874.627872:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851874.627873:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851874.627873:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000583e7888.
02000000:00000001:27.0:1773851874.627874:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.627875:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.627875:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851874.627876:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694291, transno 0, xid 1859830794028416
00010000:00000001:27.0:1773851874.627877:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851874.627878:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bb16047f x1859830794028416/t0(0) o400->7e143d6e-eb23-47ea-9943-959268f60ba0@20049@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1746-0'
00010000:00000001:27.0:1773851874.627880:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851874.627881:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851874.627881:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851874.627883:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851874.627883:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c845667 refcount 3 to 20049@kfi7
00000100:00000001:27.0:1773851874.627884:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130859840 : -107149578691776 : ffff9e8c4b6c9b40)
02000000:00000001:27.0:1773851874.627885:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851874.627885:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.627886:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851874.627887:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20112@kfi7
00000400:00000010:27.0:1773851874.627887:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000033455368.
00000100:00000200:27.0:1773851874.627888:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830794028416, offset 224
00000400:00000200:27.0:1773851874.627889:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20112@kfi7
00000400:00000200:27.0:1773851874.627890:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20112@kfi7 to cpt 6
00000400:00000200:27.0:1773851874.627891:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 1
00000400:00000200:27.0:1773851874.627892:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 2
00000400:00000200:27.0:1773851874.627893:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 3
00000400:00000200:27.0:1773851874.627894:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20112@kfi7 local destination
00000400:00000200:27.0:1773851874.627895:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769481:8769481:1024:4294967295] 20112@kfi7 LPNI seq info [368177:368177:16:4294967295]
00000400:00000200:27.0:1773851874.627896:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 2
00000400:00000200:27.0:1773851874.627897:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20112@kfi7 to cpt 6
00000400:00000200:27.0:1773851874.627899:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20112@kfi7(20112@kfi7:20112@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851874.627900:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 3
00000800:00000200:27.0:1773851874.627902:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851874.627903:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851874.627905:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851874.627909:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0xab6 Using peer 20112@kfi7(0xab6)
00000800:00000200:27.0:1773851874.627912:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0xab6: rc=0
00000800:00000200:27.0:1773851874.627913:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0xab6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851874.627915:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.627916:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c845667 refcount 2 to 20049@kfi7
00010000:00000001:27.0:1773851874.627917:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851874.627917:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.627918:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851874.627919:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bb16047f x1859830794028416/t0(0) o400->7e143d6e-eb23-47ea-9943-959268f60ba0@20049@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1746-0'
00000100:00100000:27.0:1773851874.627921:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb16047f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7e143d6e-eb23-47ea-9943-959268f60ba0+5:39463:x1859830794028416:12345-20049@kfi7:400:default-tuolumne1746-0 Request processed in 59us (93us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851874.627923:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20049@kfi7, seq: 2025124
00000100:00000040:27.0:1773851874.627924:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001e259bc3 : new rpc_count 0
00000100:00000001:27.0:1773851874.627925:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851874.627925:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:26.0:1773851874.627925:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0xab6 TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851874.627926:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:27.0:1773851874.627927:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b167360e.
00000020:00000010:27.0:1773851874.627927:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd5c6346.
00000400:00000200:26.0:1773851874.627927:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:27.0:1773851874.627928:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000001e259bc3 : new refcount 4
00000400:00000200:26.0:1773851874.627928:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20112@kfi7: PUT: OK
00000100:00000001:27.0:1773851874.627929:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851874.627929:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000033455368
00000400:00000010:26.0:1773851874.627929:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000033455368.
00000100:00000001:26.0:1773851874.627930:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851874.627931:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851874.627931:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cc5d0f33 nid 20112@kfi7 refs 2
00000800:00000200:26.0:1773851874.627933:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 20112@kfi7(000000004cdae05b):0x0 lsk 2743 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0xab6 Transaction freed
00000004:00000001:30.0:1773851874.633730:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851874.633730:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851874.633731:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ab74edb.
00000004:00000001:7.0:1773851874.633731:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:30.0:1773851874.633732:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000004:00000020:7.0:1773851874.633732:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851874.633732:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed033681.
00000004:00000001:5.0:1773851874.633732:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851874.633732:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:4.0:1773851874.633732:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:4.0:1773851874.633732:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:30.0:1773851874.633733:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851874.633733:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:7.0:1773851874.633733:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000010:5.0:1773851874.633733:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004bf1225.
00000020:00000040:5.0:1773851874.633733:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000100:00000010:4.0:1773851874.633733:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0a0e7bb.
00000020:00000040:4.0:1773851874.633733:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
02000000:00000001:30.0:1773851874.633734:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851874.633734:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851874.633734:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:4.0:1773851874.633734:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:30.0:1773851874.633735:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000daa395b6.
02000000:00000001:7.0:1773851874.633735:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851874.633735:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851874.633735:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851874.633735:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851874.633736:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851874.633736:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851874.633736:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d958c963.
02000000:00000001:5.0:1773851874.633736:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851874.633736:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ef164abb.
02000000:00000010:4.0:1773851874.633736:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000022c33118.
00000100:00000001:30.0:1773851874.633737:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851874.633737:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633737:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.633737:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851874.633738:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851874.633738:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851874.633738:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851874.633738:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:30.0:1773851874.633739:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006ab74edb] to pc [ptlrpcd_07_01+1]  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851874.633739:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633739:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.633739:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851874.633740:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ed033681] to pc [ptlrpcd_01_01+1]  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851874.633740:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000004bf1225] to pc [ptlrpcd_01_03+3]  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851874.633740:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a0a0e7bb] to pc [ptlrpcd_01_00+0]  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851874.633743:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851874.633743:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851874.633744:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851874.633745:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:30.0:1773851874.633745:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c3be53b8.
00000100:00000001:28.0:1773851874.633745:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851874.633745:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851874.633745:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851874.633746:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:30.0:1773851874.633746:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637140800140288 : -106932909411328 : ffff9ebebdeb7400)
00000100:00000001:28.0:1773851874.633746:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851874.633746:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:5.0:1773851874.633746:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c8f9d35e.
00000100:00000001:31.0:1773851874.633747:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851874.633747:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851874.633747:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851874.633747:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851874.633747:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636932601183232 : -107141108368384 : ffff9e8e444b7c00)
00000100:00000040:31.0:1773851874.633748:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851874.633748:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851874.633748:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00000001:7.0:1773851874.633748:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851874.633748:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:6.0:1773851874.633748:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851874.633748:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000010:30.0:1773851874.633749:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000023e885ff.
00000100:00000040:7.0:1773851874.633749:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851874.633749:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851874.633749:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000004:00080000:30.0:1773851874.633750:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614149087025343ns, next at 614150087024451ns, rc = 0
00000004:00000010:5.0:1773851874.633750:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b622d42e.
00000100:00000001:31.0:1773851874.633751:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:30.0:1773851874.633751:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:6.0:1773851874.633751:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851874.633751:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633752:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851874.633752:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851874.633752:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851874.633752:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:5.0:1773851874.633752:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614149087027126ns, next at 614150087025413ns, rc = 0
00080000:00000001:5.0:1773851874.633752:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851874.633753:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851874.633753:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851874.633753:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851874.633753:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851874.633753:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851874.633754:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851874.633754:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:6.0:1773851874.633754:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0a0e7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051931264:2098@kfi7:41:default-yuba2-0
00000004:00000001:5.0:1773851874.633754:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851874.633755:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ab74edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051931200:2080@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851874.633755:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851874.633755:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000004bf1225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051931328:3@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851874.633755:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851874.633756:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851874.633756:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851874.633756:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851874.633757:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:7.0:1773851874.633757:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851874.633757:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851874.633757:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:6.0:1773851874.633757:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e88ad709.
02000000:00000001:31.0:1773851874.633758:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851874.633758:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:7.0:1773851874.633758:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851874.633758:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851874.633759:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851874.633759:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007ec590c0.
00000400:00000200:6.0:1773851874.633759:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:5.0:1773851874.633759:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851874.633759:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000010:31.0:1773851874.633760:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000064503462.
02000000:00000001:7.0:1773851874.633760:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851874.633760:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:5.0:1773851874.633760:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:31.0:1773851874.633761:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851874.633761:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000010:7.0:1773851874.633761:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:6.0:1773851874.633761:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c307aa46.
00000100:00000040:5.0:1773851874.633761:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851874.633762:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000010:31.0:1773851874.633762:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000010:7.0:1773851874.633762:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000100:00000200:6.0:1773851874.633762:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931264, portal 4
00000100:00000001:6.0:1773851874.633762:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:31.0:1773851874.633763:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025a37126.
00000100:00000001:6.0:1773851874.633763:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528712192 : -106978180839424 : ffff9eb433884800)
00000100:00000001:5.0:1773851874.633763:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851874.633763:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851874.633764:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931328, portal 4
00000100:00000001:7.0:1773851874.633764:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851874.633764:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637039273406592 : -107034436145024 : ffff9ea71a747080)
00000100:00000040:6.0:1773851874.633764:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:5.0:1773851874.633764:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000200:31.0:1773851874.633765:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931200, portal 4
02000000:00000001:5.0:1773851874.633765:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633766:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851874.633766:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637127372033152 : -106946337518464 : ffff9ebb9d8acc80)
00000100:00000040:7.0:1773851874.633766:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:5.0:1773851874.633766:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051931392:7@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851874.633767:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:5.0:1773851874.633767:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:5.0:1773851874.633767:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:31.0:1773851874.633768:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851874.633768:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851874.633768:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:6.0:1773851874.633768:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5d4425b.
02000000:00000001:5.0:1773851874.633768:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851874.633769:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000100:00000200:6.0:1773851874.633769:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051931264, offset 0
02000000:00000001:5.0:1773851874.633769:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851874.633770:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:7.0:1773851874.633770:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c46149c8.
02000000:00000010:5.0:1773851874.633770:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e74fa322.
02000000:00000001:5.0:1773851874.633770:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.633771:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000100:00000200:7.0:1773851874.633771:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931328, offset 0
00000400:00000200:6.0:1773851874.633771:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:5.0:1773851874.633771:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:31.0:1773851874.633772:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002000cf5e.
00000400:00000200:6.0:1773851874.633772:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:5.0:1773851874.633772:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000984a9f71.
00000100:00000200:31.0:1773851874.633773:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931200, offset 0
00000400:00000200:7.0:1773851874.633773:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000200:6.0:1773851874.633773:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000010:5.0:1773851874.633773:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
00000400:00000200:31.0:1773851874.633774:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:6.0:1773851874.633774:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000200:5.0:1773851874.633774:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931392, portal 4
00000400:00000200:31.0:1773851874.633775:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:5.0:1773851874.633775:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851874.633775:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309139712 : -106994400411904 : ffff9eb06cc53f00)
00000400:00000200:31.0:1773851874.633776:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:6.0:1773851874.633776:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:31.0:1773851874.633777:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:6.0:1773851874.633777:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000100:00000040:5.0:1773851874.633777:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851874.633778:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769481, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769480, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851874.633779:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000100:00000001:5.0:1773851874.633779:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851874.633780:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:6.0:1773851874.633780:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000040:5.0:1773851874.633780:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:5.0:1773851874.633780:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000400:00000200:6.0:1773851874.633781:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000200:5.0:1773851874.633781:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051931392, offset 0
00000400:00000200:31.0:1773851874.633782:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769481, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769480, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851874.633782:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851874.633783:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346202, 20346204]
00000400:00000200:5.0:1773851874.633783:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:31.0:1773851874.633784:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851874.633785:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851874.633785:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2098@kfi7
00000400:00000200:31.0:1773851874.633786:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:6.0:1773851874.633786:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769482:8769482:1024:4294967295] 2098@kfi7 LPNI seq info [20346205:20346205:16:4294967295]
00000400:00000200:6.0:1773851874.633787:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:31.0:1773851874.633789:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769483:8769483:1024:4294967295] 2080@kfi7 LPNI seq info [5404392:5404392:16:4294967295]
00000400:00000200:6.0:1773851874.633789:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:31.0:1773851874.633791:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:6.0:1773851874.633791:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851874.633792:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851874.633793:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:7.0:1773851874.633794:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:6.0:1773851874.633794:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:31.0:1773851874.633795:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851874.633795:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000800:00000200:6.0:1773851874.633795:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851874.633796:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851874.633796:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:7.0:1773851874.633797:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:31.0:1773851874.633798:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:6.0:1773851874.633798:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851874.633799:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851874.633799:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000400:00000200:7.0:1773851874.633800:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769481, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769483, p:4294967295, g:4294967295, h:1000]
00000800:00000200:6.0:1773851874.633800:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Using peer 2098@kfi7(0x2000000000004bc)
00000800:00000200:31.0:1773851874.633801:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851874.633802:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851874.633803:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:31.0:1773851874.633804:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000400:00000200:7.0:1773851874.633804:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000800:00000200:6.0:1773851874.633804:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 324 bytes to peer 0x2000000000004bc: rc=0
00000400:00000200:7.0:1773851874.633805:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769484:8769484:1024:4294967295] 3@kfi7 LPNI seq info [5406222:5406222:16:4294967295]
00000800:00000200:6.0:1773851874.633806:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:31.0:1773851874.633807:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000400:00000200:7.0:1773851874.633807:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:7.0:1773851874.633808:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:6.0:1773851874.633808:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851874.633808:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:31.0:1773851874.633809:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851874.633809:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851874.633809:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851874.633810:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000100:00000001:6.0:1773851874.633810:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851874.633810:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000100:00000001:31.0:1773851874.633811:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633811:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851874.633811:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851874.633811:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:31.0:1773851874.633812:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851874.633812:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000001:6.0:1773851874.633812:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851874.633812:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:5.0:1773851874.633812:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:31.0:1773851874.633813:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633813:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:7.0:1773851874.633813:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:6.0:1773851874.633813:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851874.633813:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851874.633813:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000800:00000200:7.0:1773851874.633814:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:6.0:1773851874.633814:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851874.633814:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633815:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851874.633815:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:5.0:1773851874.633815:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769484, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769483, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851874.633816:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851874.633816:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851874.633817:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633817:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851874.633817:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851874.633817:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851874.633817:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:5.0:1773851874.633818:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851874.633818:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:4.0:1773851874.633818:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851874.633818:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851874.633819:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000800:00000200:7.0:1773851874.633819:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Using peer 3@kfi7(0x3b9)
00000400:00000200:6.0:1773851874.633819:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851874.633819:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340062, 17340064]
00000400:00000200:6.0:1773851874.633820:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000400:00000200:29.0:1773851874.633821:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851874.633821:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5d4425b
00000400:00000010:6.0:1773851874.633821:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5d4425b.
00000400:00000200:5.0:1773851874.633821:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 8@kfi7
00000400:00000200:29.0:1773851874.633822:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000800:00000200:7.0:1773851874.633822:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x3b9: rc=0
00000100:00000001:6.0:1773851874.633822:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851874.633823:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002000cf5e
00000400:00000010:29.0:1773851874.633823:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002000cf5e.
00000100:00000200:6.0:1773851874.633823:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851874.633823:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769485:8769485:1023:4294967295] 8@kfi7 LPNI seq info [17340065:17340065:16:4294967295]
00000100:00000001:29.0:1773851874.633824:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:7.0:1773851874.633824:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851874.633824:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000100:00000200:29.0:1773851874.633825:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851874.633825:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851874.633825:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000100:00000001:7.0:1773851874.633826:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851874.633826:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851874.633827:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851874.633828:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851874.633828:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851874.633828:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851874.633828:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 8@kfi7(7@kfi7:8@kfi7) <?> : PUT try# 0
00000100:00000040:29.0:1773851874.633829:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851874.633829:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851874.633829:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851874.633829:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851874.633829:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:7.0:1773851874.633830:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851874.633830:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:6.0:1773851874.633830:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:5.0:1773851874.633830:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:29.0:1773851874.633831:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851874.633831:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851874.633831:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851874.633832:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:7.0:1773851874.633832:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851874.633832:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851874.633832:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Transaction freed
00000800:00000200:5.0:1773851874.633832:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851874.633833:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:5.0:1773851874.633834:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851874.633835:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Transaction freed
00000800:00000200:5.0:1773851874.633837:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 Using peer 8@kfi7(0x11a4)
00000800:00000200:6.0:1773851874.633840:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851874.633840:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x11a4: rc=0
00000400:00000200:6.0:1773851874.633841:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851874.633841:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851874.633843:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000400:00000200:6.0:1773851874.633843:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c46149c8
00000100:00000001:5.0:1773851874.633843:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851874.633844:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c46149c8.
00000100:00000001:5.0:1773851874.633844:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851874.633845:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851874.633845:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851874.633845:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633845:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633846:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851874.633847:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851874.633847:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:6.0:1773851874.633848:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851874.633848:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851874.633848:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:6.0:1773851874.633849:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851874.633849:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633849:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851874.633851:0:2507579:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:6.0:1773851874.633851:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851874.633851:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:7.0:1773851874.633852:0:2507579:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:6.0:1773851874.633852:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:5.0:1773851874.633852:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 TN_EVENT_TX_OK event status 0
00000800:00000200:7.0:1773851874.633853:0:2507579:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851874.633854:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Transaction freed
00000400:00000200:5.0:1773851874.633854:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851874.633855:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00000800:00000200:7.0:1773851874.633856:0:2507579:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851874.633856:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:5.0:1773851874.633856:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00000001:5.0:1773851874.633857:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851874.633857:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851874.633858:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:7.0:1773851874.633859:0:2507579:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:7.0:1773851874.633860:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:5.0:1773851874.633860:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:7.0:1773851874.633861:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000100:00000040:5.0:1773851874.633861:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851874.633862:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:7.0:1773851874.633862:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:7.0:1773851874.633863:0:2507579:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000100:00000001:5.0:1773851874.633863:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851874.633864:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:5.0:1773851874.633864:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851874.633864:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:7.0:1773851874.633865:0:2507579:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4280
00000800:00000200:5.0:1773851874.633865:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 Transaction freed
00000400:00000200:7.0:1773851874.633866:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:7.0:1773851874.633867:0:2507579:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b31285 [1] + 224
00000800:00000200:7.0:1773851874.633870:0:2507579:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851874.633871:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851874.633872:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000100:00000001:7.0:1773851874.633873:0:2507579:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:9.0:1773851874.633874:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000200:7.0:1773851874.633874:0:2507579:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851874.633875:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851874.633876:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.633876:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851874.633877:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:7.0:1773851874.633877:0:2507579:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851874.633878:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.633878:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851874.633880:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851874.633880:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:7.0:1773851874.633880:0:2507579:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851874.633881:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:7.0:1773851874.633881:0:2507579:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:29.0:1773851874.633882:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851874.633882:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:6.0:1773851874.633882:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851874.633882:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851874.633883:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000800:00000200:7.0:1773851874.633883:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000736a2e34: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:6.0:1773851874.633883:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851874.633883:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851874.633884:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:9.0:1773851874.633884:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000010:6.0:1773851874.633884:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851874.633884:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c307aa46
00000400:00000200:29.0:1773851874.633885:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851874.633885:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:9.0:1773851874.633885:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000010:6.0:1773851874.633885:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c307aa46.
00000100:00000001:6.0:1773851874.633885:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851874.633886:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000200:6.0:1773851874.633886:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851874.633887:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.633887:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4240
00000400:00000200:29.0:1773851874.633888:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851874.633888:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:9.0:1773851874.633888:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:29.0:1773851874.633889:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000200:6.0:1773851874.633889:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851874.633890:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781697e49 [1] + 224
00000400:00000200:29.0:1773851874.633891:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:26.0:1773851874.633891:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:6.0:1773851874.633891:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851874.633891:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851874.633892:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b42c0
00000800:00000200:26.0:1773851874.633892:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.633892:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851874.633892:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851874.633892:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:29.0:1773851874.633893:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:26.0:1773851874.633893:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851874.633893:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851874.633893:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851874.633894:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x780080dfd [1] + 224
00000400:00000200:9.0:1773851874.633894:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:6.0:1773851874.633894:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851874.633895:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851874.633895:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000100:00001000:6.0:1773851874.633895:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=107 v=66 (66 66 66 66)
00000800:00000200:29.0:1773851874.633896:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851874.633896:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:6.0:1773851874.633896:0:41064:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=107 v=66 (1 1 1 1)
00000100:00000200:9.0:1773851874.633897:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851874.633897:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:29.0:1773851874.633898:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851874.633898:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000100:00000001:6.0:1773851874.633898:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851874.633899:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000400:00000200:26.0:1773851874.633899:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8@kfi7 : PUT - for me
00010000:00000001:6.0:1773851874.633899:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851874.633899:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851874.633900:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:26.0:1773851874.633900:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000100:00000001:6.0:1773851874.633900:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851874.633900:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000200:29.0:1773851874.633901:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851874.633901:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851874.633901:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851874.633902:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000100:00000040:6.0:1773851874.633902:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:26.0:1773851874.633903:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000100:00000040:9.0:1773851874.633903:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851874.633904:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:26.0:1773851874.633904:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:26.0:1773851874.633905:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000100:00000001:6.0:1773851874.633905:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851874.633905:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:26.0:1773851874.633906:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:6.0:1773851874.633906:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851874.633906:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:26.0:1773851874.633907:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4300
00000100:00000001:9.0:1773851874.633907:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000020:6.0:1773851874.633907:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000032 blocks, 31354646400 free, 31354595392 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064156 files, 2870603613 free files
00000100:00000001:29.0:1773851874.633908:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:26.0:1773851874.633908:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851874.633908:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:31.0:1773851874.633909:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851874.633909:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851874.633909:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:9.0:1773851874.633909:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000004:00000001:6.0:1773851874.633909:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:31.0:1773851874.633910:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:26.0:1773851874.633910:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f656d [1] + 224
00000100:00000001:7.0:1773851874.633910:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851874.633910:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:6.0:1773851874.633910:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:31.0:1773851874.633911:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:29.0:1773851874.633911:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000001:7.0:1773851874.633911:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000010:31.0:1773851874.633912:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000001:7.0:1773851874.633912:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00100000:6.0:1773851874.633912:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0a0e7bb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051931264:2098@kfi7:41:default-yuba2-0
00000400:00000200:31.0:1773851874.633913:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025a37126
00000400:00000010:31.0:1773851874.633913:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025a37126.
00000800:00000200:26.0:1773851874.633913:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:7.0:1773851874.633913:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851874.633913:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000100:00000001:31.0:1773851874.633914:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:26.0:1773851874.633914:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:7.0:1773851874.633914:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000100:00000001:6.0:1773851874.633914:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851874.633914:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851874.633915:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:6.0:1773851874.633915:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a0a0e7bb x1859433051931264/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:31.0:1773851874.633916:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:26.0:1773851874.633916:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00000100:00000200:7.0:1773851874.633916:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851874.633917:0:2507427:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851874.633917:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:26.0:1773851874.633918:0:2507427:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851874.633918:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851874.633918:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e88ad709.
00000100:00000200:31.0:1773851874.633919:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851874.633919:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851874.633919:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851874.633920:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851874.633920:0:41064:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:31.0:1773851874.633921:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:26.0:1773851874.633921:0:2507427:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:6.0:1773851874.633921:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851874.633921:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000022c33118.
00000100:00000001:31.0:1773851874.633922:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851874.633922:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851874.633922:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:6.0:1773851874.633922:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851874.633922:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:31.0:1773851874.633923:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:7.0:1773851874.633923:0:41067:0:(client.c:1428:after_reply()) Process entered
00000100:00000010:6.0:1773851874.633923:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a0a0e7bb.
02000000:00000001:31.0:1773851874.633924:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851874.633924:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000001:7.0:1773851874.633924:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851874.633924:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851874.633924:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.633925:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.633925:0:2507427:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851874.633925:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851874.633925:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851874.633925:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851874.633925:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:31.0:1773851874.633926:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851874.633926:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
02000000:00000001:7.0:1773851874.633926:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851874.633926:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851874.633926:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:31.0:1773851874.633927:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=107 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851874.633927:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=107 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851874.633927:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633927:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:31.0:1773851874.633928:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=107 v=66 (1 1 1 1)
00000800:00000200:26.0:1773851874.633928:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851874.633928:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:5.0:1773851874.633928:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:31.0:1773851874.633929:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00001000:7.0:1773851874.633929:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=107 v=66 (1 1 1 1)
00000400:00000001:5.0:1773851874.633929:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851874.633930:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851874.633930:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851874.633930:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851874.633930:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851874.633930:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000984a9f71.
00000400:00000200:5.0:1773851874.633930:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00010000:00000001:31.0:1773851874.633931:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851874.633931:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:5.0:1773851874.633931:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
00000100:00000001:5.0:1773851874.633931:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851874.633932:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851874.633932:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00010000:00000001:7.0:1773851874.633932:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851874.633932:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:5.0:1773851874.633932:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851874.633933:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:7.0:1773851874.633933:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:31.0:1773851874.633934:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851874.633934:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851874.633934:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.633935:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:7.0:1773851874.633935:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:5.0:1773851874.633935:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851874.633937:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851874.633938:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851874.633938:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851874.633938:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851874.633939:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851874.633939:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851874.633939:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851874.633939:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:5.0:1773851874.633939:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851874.633939:0:41065:0:(client.c:1428:after_reply()) Process entered
00000004:00000001:31.0:1773851874.633940:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851874.633940:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
02000000:00000001:5.0:1773851874.633940:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851874.633940:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000040:31.0:1773851874.633941:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851874.633941:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353651200 avail=351351214080 avail_mb=1372465680 hwm_mb=3131101 files=372083311 ffree=343118800 state=0: rc = 0
00000100:00000001:5.0:1773851874.633941:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:31.0:1773851874.633942:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510610944 avail=351507976192 avail_mb=1373078032 hwm_mb=3131103 files=372095741 ffree=343272081 state=0: rc = 0
02000000:00000001:5.0:1773851874.633942:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:7.0:1773851874.633943:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353651200 free, 351351214080 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083311 files, 343118800 free files
00000100:00001000:5.0:1773851874.633943:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=133 v=66 (66 66 66 66)
00000004:00000020:31.0:1773851874.633944:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510610944 free, 351507976192 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095741 files, 343272081 free files
00000004:00000001:7.0:1773851874.633944:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851874.633944:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=139 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851874.633945:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851874.633945:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851874.633946:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851874.633946:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:5.0:1773851874.633946:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851874.633946:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851874.633947:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851874.633947:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851874.633947:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:5.0:1773851874.633948:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851874.633948:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851874.633949:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000004bf1225 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051931328:3@kfi7:13:default-yuba2-0
00000100:00000040:5.0:1773851874.633949:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851874.633951:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ab74edb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051931200:2080@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851874.633951:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851874.633951:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851874.633952:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851874.633952:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000004bf1225 x1859433051931328/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851874.633952:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851874.633953:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851874.633953:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851874.633953:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851874.633954:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006ab74edb x1859433051931200/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:5.0:1773851874.633954:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:7.0:1773851874.633955:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851874.633955:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000020:5.0:1773851874.633955:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031744 blocks, 31536851680 free, 31536802784 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425336 files, 2779493031 free files
00000100:00000001:31.0:1773851874.633956:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000010:7.0:1773851874.633956:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007ec590c0.
00000004:00000001:5.0:1773851874.633956:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851874.633957:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:7.0:1773851874.633957:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851874.633957:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:5.0:1773851874.633957:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:31.0:1773851874.633958:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000064503462.
00000020:00000040:7.0:1773851874.633958:0:41067:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000020:00000001:7.0:1773851874.633958:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:31.0:1773851874.633959:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000010:7.0:1773851874.633959:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ef164abb.
00000020:00000001:31.0:1773851874.633960:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851874.633960:0:41089:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
02000000:00000001:7.0:1773851874.633960:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851874.633960:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00100000:5.0:1773851874.633960:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051931392:7@kfi7:41:default-yuba2-0
00000020:00000001:31.0:1773851874.633961:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851874.633961:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000daa395b6.
00000100:00000010:7.0:1773851874.633961:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004bf1225.
02000000:00000001:31.0:1773851874.633962:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:7.0:1773851874.633962:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851874.633962:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851874.633962:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851874.633962:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:31.0:1773851874.633963:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851874.633963:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ab74edb.
00000100:00000001:7.0:1773851874.633963:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:5.0:1773851874.633963:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ed033681 x1859433051931392/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852027 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851874.633964:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851874.633964:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851874.633964:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633965:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851874.633965:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851874.633965:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851874.633965:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633965:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:31.0:1773851874.633966:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851874.633967:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851874.633967:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:5.0:1773851874.633967:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851874.633967:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e74fa322.
00000100:00000001:31.0:1773851874.633968:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851874.633968:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851874.633969:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851874.633969:0:41065:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000001:5.0:1773851874.633970:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851874.633970:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d958c963.
02000000:00000001:5.0:1773851874.633971:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851874.633972:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851874.633972:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed033681.
00000100:00000001:5.0:1773851874.633973:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851874.633974:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851874.633974:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851874.633975:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851874.633976:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851874.633976:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851874.633977:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851874.647557:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851874.647557:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851874.647559:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851874.647560:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851874.647562:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8435@kfi7 to cpt 5
00000400:00000200:21.0:1773851874.647563:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8435@kfi7 : PUT - for me
00000400:00000200:21.0:1773851874.647564:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8435@kfi7 to cpt 5
00000400:00000200:21.0:1773851874.647565:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000750339fc nid 8435@kfi7 refs 1
00000400:00000200:21.0:1773851874.647566:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8435@kfi7 to cpt 5
00000400:00000200:21.0:1773851874.647567:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000750339fc nid 8435@kfi7 refs 2
00000400:00000200:21.0:1773851874.647568:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000750339fc nid 8435@kfi7 refs 3
00000400:00000200:21.0:1773851874.647568:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8435@kfi7 to cpt 5
00000400:00000200:21.0:1773851874.647569:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8435@kfi7 of length 224 into portal 12 MB=0x69b1dccebc2c0
00000400:00000200:21.0:1773851874.647570:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8435@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 45200
00000800:00000200:21.0:1773851874.647572:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851874.647573:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851874.647574:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8435@kfi7: PUT: OK
00000100:00000001:21.0:1773851874.647575:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851874.647575:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851874.647577:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000053194b31.
00000100:00000040:21.0:1773851874.647577:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000053194b31 x1859402154623680 msgsize 224
00000100:00100000:21.0:1773851874.647579:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-8435@kfi7 (source: 12345-8435@kfi7)
00000100:00000001:21.0:1773851874.647580:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851874.647581:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000750339fc nid 8435@kfi7 refs 2
00000100:00000001:20.0:1773851874.647581:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851874.647581:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851874.647582:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851874.647582:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851874.647583:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851874.647583:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851874.647584:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859402154623680
00000020:00000001:20.0:1773851874.647585:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851874.647585:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07a20a2b030
00000020:00000001:20.0:1773851874.647586:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851874.647589:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000013f17c5b refcount=562
00000020:00000001:20.0:1773851874.647590:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132838979584 : -106940870572032 : ffff9ebce365c800)
00000020:00000001:20.0:1773851874.647591:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132838979584 : -106940870572032 : ffff9ebce365c800)
00000100:00000001:20.0:1773851874.647593:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851874.647594:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851874.647595:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007247ac18.
00000020:00000010:20.0:1773851874.647597:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851874.647598:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000016889709.
00000100:00000001:20.0:1773851874.647600:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851874.647600:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851874.647601:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851874.647603:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851874.647604:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851874.647604:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851874.647606:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851874.647607:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851874.647608:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851874.647608:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851874.647608:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851874.647609:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8435@kfi7, seq: 1998000
00000100:00000040:23.0:1773851874.647610:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000013f17c5b : new rpc_count 4
00000100:00000001:20.0:1773851874.647610:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.647611:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637143494409984 : -106930215141632 : ffff9ebf5e82bf00)
00000100:00000001:20.0:1773851874.647612:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851874.647613:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000053194b31 x1859402154623680/t0(0) o400->c5143df4-323f-476a-9006-770dfa131b81@8435@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne1001-0'
00000100:00000001:23.0:1773851874.647617:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851874.647617:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851874.647619:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053194b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c5143df4-323f-476a-9006-770dfa131b81+562:40465:x1859402154623680:12345-8435@kfi7:400:login-tuolumne1001-0
00000100:00000200:23.0:1773851874.647620:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859402154623680
00000020:00000001:23.0:1773851874.647621:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851874.647622:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851874.647623:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.647624:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851874.647624:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851874.647625:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851874.647626:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859402154623680, found 0 last_xid 1859402153232959
00000020:00000001:23.0:1773851874.647627:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851874.647628:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851874.647628:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851874.647629:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.647630:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851874.647631:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851874.647632:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851874.647633:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000014725a2b.
02000000:00000001:23.0:1773851874.647634:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.647634:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.647635:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851874.647636:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263615823, transno 0, xid 1859402154623680
00010000:00000001:23.0:1773851874.647637:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851874.647638:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000053194b31 x1859402154623680/t0(0) o400->c5143df4-323f-476a-9006-770dfa131b81@8435@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1001-0'
00010000:00000001:23.0:1773851874.647642:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851874.647642:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851874.647643:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=107 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851874.647644:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851874.647645:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002ea593e8 refcount 3 to 8435@kfi7
00000100:00000001:23.0:1773851874.647646:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637091485762976 : -106982223788640 : ffff9eb3428dc5a0)
02000000:00000001:23.0:1773851874.647647:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851874.647647:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.647648:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851874.647649:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8435@kfi7
00000400:00000010:23.0:1773851874.647650:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f219ead6.
00000100:00000200:23.0:1773851874.647650:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859402154623680, offset 224
00000400:00000200:23.0:1773851874.647652:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8435@kfi7
00000400:00000200:23.0:1773851874.647653:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8435@kfi7 to cpt 5
00000400:00000200:23.0:1773851874.647666:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000750339fc nid 8435@kfi7 refs 1
00000400:00000200:23.0:1773851874.647667:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000750339fc nid 8435@kfi7 refs 2
00000400:00000200:23.0:1773851874.647668:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000750339fc nid 8435@kfi7 refs 3
00000400:00000200:23.0:1773851874.647669:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8435@kfi7 local destination
00000400:00000200:23.0:1773851874.647671:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769486:8769486:1024:4294967295] 8435@kfi7 LPNI seq info [29134483:29134483:16:4294967295]
00000400:00000200:23.0:1773851874.647673:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000750339fc nid 8435@kfi7 refs 2
00000400:00000200:23.0:1773851874.647673:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8435@kfi7 to cpt 5
00000400:00000200:23.0:1773851874.647676:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8435@kfi7(8435@kfi7:8435@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851874.647677:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000750339fc nid 8435@kfi7 refs 3
00000800:00000200:23.0:1773851874.647679:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851874.647680:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851874.647682:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851874.647684:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1400000000001248 Using peer 8435@kfi7(0x1400000000001248)
00000800:00000200:23.0:1773851874.647688:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x1400000000001248: rc=0
00000800:00000200:23.0:1773851874.647689:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1400000000001248 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851874.647691:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851874.647692:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002ea593e8 refcount 2 to 8435@kfi7
00010000:00000001:23.0:1773851874.647693:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851874.647693:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.647694:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851874.647695:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000053194b31 x1859402154623680/t0(0) o400->c5143df4-323f-476a-9006-770dfa131b81@8435@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1001-0'
00000100:00100000:23.0:1773851874.647698:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053194b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c5143df4-323f-476a-9006-770dfa131b81+562:40465:x1859402154623680:12345-8435@kfi7:400:login-tuolumne1001-0 Request processed in 80us (120us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851874.647700:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8435@kfi7, seq: 1998000
00000100:00000040:23.0:1773851874.647702:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000013f17c5b : new rpc_count 3
00000100:00000001:23.0:1773851874.647702:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851874.647703:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851874.647703:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1400000000001248 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851874.647704:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:23.0:1773851874.647704:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000016889709.
00000020:00000010:23.0:1773851874.647705:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007247ac18.
00000020:00000040:23.0:1773851874.647706:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000013f17c5b : new refcount 561
00000400:00000200:21.0:1773851874.647706:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851874.647707:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851874.647708:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8435@kfi7: PUT: OK
00000400:00000200:21.0:1773851874.647709:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f219ead6
00000400:00000010:21.0:1773851874.647710:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f219ead6.
00000100:00000001:21.0:1773851874.647710:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851874.647711:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851874.647712:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000750339fc nid 8435@kfi7 refs 2
00000800:00000200:21.0:1773851874.647715:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 8435@kfi7(00000000e7a58a46):0x0 lsk 4681 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1400000000001248 Transaction freed
00000800:00000200:5.0:1773851874.649147:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851874.649148:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851874.649149:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851874.649151:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851874.649153:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23985@kfi7 to cpt 1
00000400:00000200:5.0:1773851874.649155:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23985@kfi7 : PUT - for me
00000400:00000200:5.0:1773851874.649156:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23985@kfi7 to cpt 1
00000400:00000200:5.0:1773851874.649156:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027586714 nid 23985@kfi7 refs 1
00000400:00000200:5.0:1773851874.649158:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23985@kfi7 to cpt 1
00000400:00000200:5.0:1773851874.649158:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027586714 nid 23985@kfi7 refs 2
00000400:00000200:5.0:1773851874.649159:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000027586714 nid 23985@kfi7 refs 3
00000400:00000200:5.0:1773851874.649160:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23985@kfi7 to cpt 1
00000400:00000200:5.0:1773851874.649161:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23985@kfi7 of length 224 into portal 12 MB=0x699e0e6687580
00000400:00000200:5.0:1773851874.649162:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23985@kfi7 of length 224/224 into md 0x793926dc5 [64] + 148728
00000800:00000200:5.0:1773851874.649164:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851874.649167:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851874.649168:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23985@kfi7: PUT: OK
00000100:00000001:5.0:1773851874.649169:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851874.649169:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851874.649170:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ad2b3d0.
00000100:00000040:5.0:1773851874.649171:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000006ad2b3d0 x1858041077593472 msgsize 224
00000100:00100000:5.0:1773851874.649172:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23985@kfi7 (source: 12345-23985@kfi7)
00000100:00000001:5.0:1773851874.649173:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851874.649174:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000027586714 nid 23985@kfi7 refs 2
00000100:00000001:4.0:1773851874.649175:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851874.649175:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851874.649176:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851874.649176:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851874.649176:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851874.649177:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851874.649178:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041077593472
00000020:00000001:4.0:1773851874.649178:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851874.649179:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91af0
00000020:00000001:4.0:1773851874.649179:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851874.649182:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e408b602 refcount=6
00000020:00000001:4.0:1773851874.649182:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627774464 : -107123081777152 : ffff9e9276c37000)
00000020:00000001:4.0:1773851874.649183:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627774464 : -107123081777152 : ffff9e9276c37000)
00000100:00000001:4.0:1773851874.649184:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851874.649185:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851874.649186:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000004817707.
00000020:00000010:4.0:1773851874.649187:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851874.649187:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000025e99aed.
00000100:00000001:4.0:1773851874.649188:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851874.649188:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851874.649189:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851874.649190:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851874.649190:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851874.649191:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.649192:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851874.649193:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851874.649193:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851874.649193:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851874.649194:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851874.649194:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23985@kfi7, seq: 2001935
00000100:00000001:7.0:1773851874.649195:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851874.649195:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e408b602 : new rpc_count 1
00000100:00000001:7.0:1773851874.649196:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.649196:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273391616 : -107034436160000 : ffff9ea71a743600)
00000100:00000040:4.0:1773851874.649197:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ad2b3d0 x1858041077593472/t0(0) o400->4eeef3dc-2ec4-4136-8548-9c3483ce3df1@23985@kfi7:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1982-0'
00000100:00000001:4.0:1773851874.649199:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851874.649199:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851874.649200:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ad2b3d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4eeef3dc-2ec4-4136-8548-9c3483ce3df1+6:39754:x1858041077593472:12345-23985@kfi7:400:default-tuolumne1982-0
00000100:00000200:4.0:1773851874.649201:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041077593472
00000020:00000001:4.0:1773851874.649202:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851874.649202:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851874.649203:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.649204:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851874.649204:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851874.649205:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851874.649206:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041077593472, found 0 last_xid 1858041077593471
00000020:00000001:4.0:1773851874.649206:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851874.649207:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851874.649207:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851874.649208:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.649208:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851874.649209:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851874.649209:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851874.649210:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d5c32b51.
02000000:00000001:4.0:1773851874.649211:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.649211:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.649212:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851874.649213:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824296, transno 0, xid 1858041077593472
00010000:00000001:4.0:1773851874.649213:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851874.649214:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ad2b3d0 x1858041077593472/t0(0) o400->4eeef3dc-2ec4-4136-8548-9c3483ce3df1@23985@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1982-0'
00010000:00000001:4.0:1773851874.649216:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851874.649217:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851874.649217:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=106 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851874.649218:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851874.649219:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000715c5121 refcount 3 to 23985@kfi7
00000100:00000001:4.0:1773851874.649220:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231610976 : -107130477940640 : ffff9e90bdeaf060)
02000000:00000001:4.0:1773851874.649220:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851874.649221:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851874.649221:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851874.649222:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23985@kfi7
00000400:00000010:4.0:1773851874.649223:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5f4f73.
00000100:00000200:4.0:1773851874.649223:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041077593472, offset 224
00000400:00000200:4.0:1773851874.649225:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23985@kfi7
00000400:00000200:4.0:1773851874.649226:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23985@kfi7 to cpt 1
00000400:00000200:4.0:1773851874.649226:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027586714 nid 23985@kfi7 refs 1
00000400:00000200:4.0:1773851874.649228:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000027586714 nid 23985@kfi7 refs 2
00000400:00000200:4.0:1773851874.649229:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000027586714 nid 23985@kfi7 refs 3
00000400:00000200:4.0:1773851874.649230:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23985@kfi7 local destination
00000400:00000200:4.0:1773851874.649231:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769487:8769487:1024:4294967295] 23985@kfi7 LPNI seq info [776434:776434:16:4294967295]
00000400:00000200:4.0:1773851874.649232:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000027586714 nid 23985@kfi7 refs 2
00000400:00000200:4.0:1773851874.649233:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23985@kfi7 to cpt 1
00000400:00000200:4.0:1773851874.649235:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23985@kfi7(23985@kfi7:23985@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851874.649236:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000027586714 nid 23985@kfi7 refs 3
00000800:00000200:4.0:1773851874.649237:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851874.649238:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851874.649240:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851874.649242:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b1 Using peer 23985@kfi7(0x10b1)
00000800:00000200:4.0:1773851874.649244:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x10b1: rc=0
00000800:00000200:4.0:1773851874.649246:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851874.649248:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851874.649248:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000715c5121 refcount 2 to 23985@kfi7
00010000:00000001:4.0:1773851874.649249:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851874.649249:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851874.649250:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851874.649251:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ad2b3d0 x1858041077593472/t0(0) o400->4eeef3dc-2ec4-4136-8548-9c3483ce3df1@23985@kfi7:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1982-0'
00000100:00100000:4.0:1773851874.649255:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ad2b3d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4eeef3dc-2ec4-4136-8548-9c3483ce3df1+6:39754:x1858041077593472:12345-23985@kfi7:400:default-tuolumne1982-0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851874.649257:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23985@kfi7, seq: 2001935
00000100:00000040:4.0:1773851874.649258:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e408b602 : new rpc_count 0
00000100:00000001:4.0:1773851874.649260:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851874.649261:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851874.649261:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851874.649262:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000025e99aed.
00000020:00000010:4.0:1773851874.649263:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000004817707.
00000020:00000040:4.0:1773851874.649263:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e408b602 : new refcount 5
00000100:00000001:4.0:1773851874.649264:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851874.649269:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b1 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851874.649270:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851874.649271:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23985@kfi7: PUT: OK
00000400:00000200:5.0:1773851874.649272:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5f4f73
00000400:00000010:5.0:1773851874.649273:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5f4f73.
00000100:00000001:5.0:1773851874.649273:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851874.649274:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851874.649275:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000027586714 nid 23985@kfi7 refs 2
00000800:00000200:5.0:1773851874.649276:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 23985@kfi7(00000000d8bfeed7):0x0 lsk 4274 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b1 Transaction freed
00000800:00000200:26.0:1773851874.688663:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851874.688663:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851874.688663:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851874.688664:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851874.688665:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851874.688665:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851874.688667:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851874.688667:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20866@kfi7(00000000622932ed):0x6c6 version: 2; local version 2; negotiated version: 2
00000400:00000200:26.0:1773851874.688669:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000800:00000200:25.0:1773851874.688669:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 Using peer 20866@kfi7(0x6c6)
00000400:00000200:26.0:1773851874.688670:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20866@kfi7 : PUT - for me
00000400:00000200:25.0:1773851874.688670:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.688671:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.688672:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 1
00000800:00000200:25.0:1773851874.688672:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x6c6: rc=0
00000400:00000200:26.0:1773851874.688673:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.688673:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000800:00000200:25.0:1773851874.688673:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851874.688674:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 3
00000400:00000200:26.0:1773851874.688675:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:26.0:1773851874.688676:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20866@kfi7 of length 224 into portal 12 MB=0x69b0a43fc5e40
00000400:00000200:26.0:1773851874.688677:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20866@kfi7 of length 224/224 into md 0x16159c9699 [64] + 21880
00000800:00000200:26.0:1773851874.688679:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851874.688681:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851874.688682:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20866@kfi7: PUT: OK
00000100:00000001:26.0:1773851874.688683:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851874.688684:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851874.688684:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8e67710.
00000100:00000040:26.0:1773851874.688685:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000b8e67710 x1859318252854848 msgsize 224
00000800:00000200:25.0:1773851874.688685:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851874.688687:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-20866@kfi7 (source: 12345-20866@kfi7)
00000800:00000200:25.0:1773851874.688687:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 Transaction freed
00000100:00000001:26.0:1773851874.688688:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851874.688689:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:26.0:1773851874.688689:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
02000000:00000001:27.0:1773851874.688690:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851874.688690:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2069@kfi7:6 <- 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851874.688691:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851874.688691:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851874.688692:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851874.688693:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318252854848
00000020:00000001:27.0:1773851874.688693:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851874.688693:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92fa3
00000020:00000001:27.0:1773851874.688695:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851874.688696:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000063b032f5 refcount=6
00000020:00000001:27.0:1773851874.688697:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744938496 : -107128964613120 : ffff9e91181e7c00)
00000020:00000001:27.0:1773851874.688698:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744938496 : -107128964613120 : ffff9e91181e7c00)
00000100:00000001:27.0:1773851874.688699:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.688699:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851874.688700:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004133ac17.
00000020:00000010:27.0:1773851874.688701:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.688702:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008f193acf.
00000100:00000001:27.0:1773851874.688703:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851874.688703:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851874.688704:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.688705:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851874.688705:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851874.688706:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.688706:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.688708:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.688708:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851874.688708:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851874.688709:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20866@kfi7, seq: 2025125
00000100:00000001:26.0:1773851874.688709:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851874.688710:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000063b032f5 : new rpc_count 1
00000100:00000001:26.0:1773851874.688710:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.688710:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.688711:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150694144 : -106980558857472 : ffff9eb3a5ca9b00)
00000100:00000040:27.0:1773851874.688712:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b8e67710 x1859318252854848/t0(0) o400->acceaf82-609f-4488-876a-4d6eb7defa58@20866@kfi7:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1800-0'
00000100:00000001:27.0:1773851874.688714:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.688715:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851874.688716:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8e67710 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:acceaf82-609f-4488-876a-4d6eb7defa58+6:39630:x1859318252854848:12345-20866@kfi7:400:default-tuolumne1800-0
00000100:00000200:27.0:1773851874.688717:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318252854848
00000020:00000001:27.0:1773851874.688717:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851874.688718:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851874.688719:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.688719:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851874.688720:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851874.688721:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851874.688721:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318252854848, found 0 last_xid 1859318252854847
00000020:00000001:27.0:1773851874.688722:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851874.688723:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851874.688724:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851874.688724:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.688729:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851874.688729:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851874.688730:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851874.688730:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005e5dc985.
02000000:00000001:27.0:1773851874.688731:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.688732:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.688733:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851874.688733:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182137422334, transno 0, xid 1859318252854848
00010000:00000001:27.0:1773851874.688734:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851874.688735:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b8e67710 x1859318252854848/t0(0) o400->acceaf82-609f-4488-876a-4d6eb7defa58@20866@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1800-0'
00010000:00000001:27.0:1773851874.688737:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851874.688738:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851874.688739:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851874.688740:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851874.688740:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d36ced6 refcount 5 to 20866@kfi7
00000100:00000001:27.0:1773851874.688741:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739104 : -107139395812512 : ffff9e8eaa5f0360)
02000000:00000001:27.0:1773851874.688742:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851874.688742:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.688743:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851874.688744:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20866@kfi7
00000400:00000010:27.0:1773851874.688745:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000872a87a5.
00000100:00000200:27.0:1773851874.688745:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318252854848, offset 224
00000400:00000200:27.0:1773851874.688747:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20866@kfi7
00000400:00000200:27.0:1773851874.688748:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:27.0:1773851874.688749:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 1
00000400:00000200:27.0:1773851874.688750:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000400:00000200:27.0:1773851874.688751:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 3
00000400:00000200:27.0:1773851874.688753:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20866@kfi7 local destination
00000400:00000200:27.0:1773851874.688754:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769488:8769488:1024:4294967295] 20866@kfi7 LPNI seq info [6979596:6979596:16:4294967295]
00000400:00000200:27.0:1773851874.688755:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000400:00000200:27.0:1773851874.688756:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:27.0:1773851874.688758:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20866@kfi7(20866@kfi7:20866@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851874.688759:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 3
00000800:00000200:27.0:1773851874.688761:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851874.688762:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851874.688764:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851874.688766:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 Using peer 20866@kfi7(0x6c6)
00000800:00000200:27.0:1773851874.688769:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x6c6: rc=0
00000800:00000200:27.0:1773851874.688771:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851874.688773:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.688773:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d36ced6 refcount 4 to 20866@kfi7
00010000:00000001:27.0:1773851874.688774:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851874.688775:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.688775:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851874.688776:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8e67710 x1859318252854848/t0(0) o400->acceaf82-609f-4488-876a-4d6eb7defa58@20866@kfi7:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1800-0'
00000100:00100000:27.0:1773851874.688779:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8e67710 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:acceaf82-609f-4488-876a-4d6eb7defa58+6:39630:x1859318252854848:12345-20866@kfi7:400:default-tuolumne1800-0 Request processed in 64us (93us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851874.688781:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20866@kfi7, seq: 2025125
00000100:00000040:27.0:1773851874.688782:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000063b032f5 : new rpc_count 0
00000100:00000001:27.0:1773851874.688783:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851874.688783:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851874.688783:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851874.688784:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851874.688785:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20866@kfi7: PUT: OK
00000400:00000200:25.0:1773851874.688786:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000872a87a5
00000400:00000010:25.0:1773851874.688787:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000872a87a5.
00000100:00000001:25.0:1773851874.688788:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851874.688788:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851874.688789:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000800:00000200:25.0:1773851874.688791:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 20866@kfi7(00000000622932ed):0x0 lsk 1735 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6c6 Transaction freed
00000020:00000010:27.0:1773851874.688795:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.688796:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008f193acf.
00000020:00000010:27.0:1773851874.688797:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004133ac17.
00000020:00000040:27.0:1773851874.688797:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000063b032f5 : new refcount 5
00000100:00000001:27.0:1773851874.688798:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851874.712299:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851874.712300:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851874.712302:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851874.712304:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851874.712306:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25283@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.712308:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25283@kfi7 : PUT - for me
00000400:00000200:1.0:1773851874.712309:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25283@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.712309:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e2e80c7 nid 25283@kfi7 refs 1
00000400:00000200:1.0:1773851874.712310:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25283@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.712311:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e2e80c7 nid 25283@kfi7 refs 2
00000400:00000200:1.0:1773851874.712312:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000e2e80c7 nid 25283@kfi7 refs 3
00000400:00000200:1.0:1773851874.712313:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25091@kfi7 to cpt 5
00000400:00000200:1.0:1773851874.712314:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25091@kfi7 of length 224 into portal 12 MB=0x699e0d7121800
00000400:00000200:1.0:1773851874.712315:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25091@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 33192
00000800:00000200:1.0:1773851874.712317:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851874.712319:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851874.712320:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25283@kfi7: PUT: OK
00000100:00000001:1.0:1773851874.712321:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851874.712321:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851874.712322:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000831ebf83.
00000100:00000040:1.0:1773851874.712323:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000831ebf83 x1858040820275200 msgsize 224
00000100:00100000:1.0:1773851874.712324:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25091@kfi7 (source: 12345-25283@kfi7)
00000100:00000001:1.0:1773851874.712326:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851874.712327:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000e2e80c7 nid 25283@kfi7 refs 2
00000800:00000200:1.0:1773851874.712328:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851874.712331:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851874.712332:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851874.712332:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851874.712333:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851874.712334:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851874.712334:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040820275200
00000020:00000001:1.0:1773851874.712335:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851874.712336:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e6f
00000020:00000001:1.0:1773851874.712336:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851874.712339:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009862af88 refcount=6
00000020:00000001:1.0:1773851874.712339:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744645632 : -107128964905984 : ffff9e91181a0400)
00000020:00000001:1.0:1773851874.712340:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744645632 : -107128964905984 : ffff9e91181a0400)
00000100:00000001:1.0:1773851874.712341:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851874.712342:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851874.712343:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042b9c0ff.
00000020:00000010:1.0:1773851874.712344:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851874.712345:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003ef8da19.
00000100:00000001:1.0:1773851874.712346:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851874.712346:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851874.712347:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851874.712348:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851874.712348:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851874.712349:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851874.712350:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851874.712351:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851874.712351:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851874.712351:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851874.712352:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851874.712353:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25091@kfi7, seq: 1997575
00000100:00000001:1.0:1773851874.712354:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851874.712354:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009862af88 : new rpc_count 1
00000100:00000001:0.0:1773851874.712354:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599705344 : -107004109846272 : ffff9eae2a0b0900)
00000100:00000001:1.0:1773851874.712355:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851874.712356:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000831ebf83 x1858040820275200/t0(0) o400->be0886a3-c433-4bf6-90ba-1c13bf82e216@25091@kfi7:514/0 lens 224/0 e 0 to 0 dl 1773852629 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2071-0'
00000100:00000001:0.0:1773851874.712358:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851874.712359:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851874.712360:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000831ebf83 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:be0886a3-c433-4bf6-90ba-1c13bf82e216+6:39643:x1858040820275200:12345-25091@kfi7:400:default-tuolumne2071-0
00000100:00000200:0.0:1773851874.712362:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040820275200
00000020:00000001:0.0:1773851874.712362:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851874.712363:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851874.712364:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.712364:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851874.712365:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851874.712366:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851874.712366:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040820275200, found 0 last_xid 1858040820275199
00000020:00000001:0.0:1773851874.712367:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851874.712368:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851874.712369:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851874.712369:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.712370:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851874.712370:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851874.712371:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851874.712372:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000670b7cbc.
02000000:00000001:0.0:1773851874.712372:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.712373:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.712374:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851874.712374:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044165664, transno 0, xid 1858040820275200
00010000:00000001:0.0:1773851874.712375:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851874.712376:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000831ebf83 x1858040820275200/t0(0) o400->be0886a3-c433-4bf6-90ba-1c13bf82e216@25091@kfi7:514/0 lens 224/224 e 0 to 0 dl 1773852629 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2071-0'
00010000:00000001:0.0:1773851874.712378:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851874.712379:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851874.712379:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=107 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851874.712380:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851874.712381:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f4dc2f9c refcount 3 to 25091@kfi7
00000100:00000001:0.0:1773851874.712382:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449984 : -107146752101632 : ffff9e8cf3e6f300)
02000000:00000001:0.0:1773851874.712383:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851874.712383:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.712384:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851874.712384:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25283@kfi7
00000400:00000010:0.0:1773851874.712385:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005abdc8a1.
00000100:00000200:0.0:1773851874.712386:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040820275200, offset 224
00000400:00000200:0.0:1773851874.712388:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25283@kfi7
00000400:00000200:0.0:1773851874.712388:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25283@kfi7 to cpt 0
00000400:00000200:0.0:1773851874.712389:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e2e80c7 nid 25283@kfi7 refs 1
00000400:00000200:0.0:1773851874.712390:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000e2e80c7 nid 25283@kfi7 refs 2
00000400:00000200:0.0:1773851874.712391:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000e2e80c7 nid 25283@kfi7 refs 3
00000400:00000200:0.0:1773851874.712393:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25283@kfi7 local destination
00000400:00000200:0.0:1773851874.712394:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769489:8769489:1024:4294967295] 25283@kfi7 LPNI seq info [169251:169251:16:4294967295]
00000400:00000200:0.0:1773851874.712395:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000e2e80c7 nid 25283@kfi7 refs 2
00000400:00000200:0.0:1773851874.712396:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25283@kfi7 to cpt 0
00000400:00000200:0.0:1773851874.712398:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25283@kfi7(25283@kfi7:25283@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851874.712399:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000e2e80c7 nid 25283@kfi7 refs 3
00000800:00000200:0.0:1773851874.712400:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851874.712401:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851874.712403:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851874.712405:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10b6 Using peer 25283@kfi7(0x10b6)
00000800:00000200:0.0:1773851874.712408:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x10b6: rc=0
00000800:00000200:0.0:1773851874.712410:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851874.712412:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851874.712413:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f4dc2f9c refcount 2 to 25091@kfi7
00010000:00000001:0.0:1773851874.712413:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851874.712414:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.712415:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851874.712415:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000831ebf83 x1858040820275200/t0(0) o400->be0886a3-c433-4bf6-90ba-1c13bf82e216@25091@kfi7:514/0 lens 224/224 e 0 to 0 dl 1773852629 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2071-0'
00000100:00100000:0.0:1773851874.712419:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000831ebf83 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:be0886a3-c433-4bf6-90ba-1c13bf82e216+6:39643:x1858040820275200:12345-25091@kfi7:400:default-tuolumne2071-0 Request processed in 59us (95us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851874.712422:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25091@kfi7, seq: 1997575
00000100:00000040:0.0:1773851874.712423:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009862af88 : new rpc_count 0
00000100:00000001:0.0:1773851874.712424:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851874.712424:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851874.712425:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:0.0:1773851874.712425:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003ef8da19.
00000020:00000010:0.0:1773851874.712426:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042b9c0ff.
00000020:00000040:0.0:1773851874.712427:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000009862af88 : new refcount 5
00000100:00000001:0.0:1773851874.712428:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851874.712433:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10b6 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851874.712435:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851874.712436:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25283@kfi7: PUT: OK
00000400:00000200:1.0:1773851874.712437:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005abdc8a1
00000400:00000010:1.0:1773851874.712437:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005abdc8a1.
00000100:00000001:1.0:1773851874.712438:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851874.712439:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851874.712439:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000e2e80c7 nid 25283@kfi7 refs 2
00000800:00000200:1.0:1773851874.712441:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 25283@kfi7(00000000a607bdb4):0x0 lsk 4279 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10b6 Transaction freed
00000800:00000200:14.0:1773851874.762844:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851874.762844:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851874.762845:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851874.762845:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851874.762847:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851874.762847:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851874.762849:0:2514739:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11618@kfi7(00000000e913b27d):0x82e version: 2; local version 2; negotiated version: 2
00000800:00000200:13.0:1773851874.762849:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851874.762851:0:2514739:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e Using peer 11618@kfi7(0x10000000000082e)
00000400:00000200:13.0:1773851874.762852:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11618@kfi7 to cpt 3
00000400:00000200:14.0:1773851874.762853:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11618@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.762853:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11618@kfi7 : PUT - for me
00000400:00000200:13.0:1773851874.762854:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11618@kfi7 to cpt 3
00000800:00000200:14.0:1773851874.762855:0:2514739:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ba933e94: Posted send of 38 bytes to peer 0x10000000000082e: rc=0
00000800:00000200:14.0:1773851874.762857:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:13.0:1773851874.762857:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091bf180c nid 11618@kfi7 refs 1
00000400:00000200:13.0:1773851874.762859:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11618@kfi7 to cpt 3
00000400:00000200:13.0:1773851874.762860:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091bf180c nid 11618@kfi7 refs 2
00000400:00000200:13.0:1773851874.762861:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000091bf180c nid 11618@kfi7 refs 3
00000400:00000200:13.0:1773851874.762862:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11682@kfi7 to cpt 7
00000400:00000200:13.0:1773851874.762863:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11682@kfi7 of length 456 into portal 12 MB=0x69b4750232840
00000400:00000200:13.0:1773851874.762865:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11682@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 36392
00000800:00000200:13.0:1773851874.762867:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851874.762869:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:14.0:1773851874.762870:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851874.762871:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11618@kfi7: PUT: OK
00000800:00000200:14.0:1773851874.762872:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e Transaction freed
00000100:00000001:13.0:1773851874.762872:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851874.762872:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851874.762874:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ea3ade65.
00000100:00000040:13.0:1773851874.762875:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ea3ade65 x1859580449728576 msgsize 456
00000100:00100000:13.0:1773851874.762877:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-11682@kfi7 (source: 12345-11618@kfi7)
00000100:00000001:13.0:1773851874.762878:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851874.762879:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000091bf180c nid 11618@kfi7 refs 2
00000100:00000001:15.0:1773851874.762881:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851874.762881:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851874.762882:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851874.762883:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851874.762884:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851874.762885:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851874.762887:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580449728576
00000020:00000001:15.0:1773851874.762888:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851874.762889:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dde08e18c
00000020:00000001:15.0:1773851874.762890:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851874.762895:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000557cf050 refcount=5
00000020:00000001:15.0:1773851874.762897:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142395274240 : -106931314277376 : ffff9ebf1cff4400)
00000020:00000001:15.0:1773851874.762898:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142395274240 : -106931314277376 : ffff9ebf1cff4400)
00000100:00000001:15.0:1773851874.762900:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.762901:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851874.762902:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000055324ba3.
00000020:00000010:15.0:1773851874.762904:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851874.762906:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e6755665.
00000100:00000001:15.0:1773851874.762907:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851874.762908:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851874.762909:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.762911:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.762912:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851874.762914:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851874.762915:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851874.762915:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851874.762916:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851874.762917:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11682@kfi7, seq: 411190551
00000100:00000001:15.0:1773851874.762918:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851874.762918:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000557cf050 : new rpc_count 1
00000100:00000001:15.0:1773851874.762919:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851874.762919:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970981248 : -107043738570368 : ffff9ea4effcb180)
00000100:00000040:12.0:1773851874.762921:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ea3ade65 x1859580449728576/t0(0) o17->ed061acb-abf0-437e-9305-1010498b1cf6@11682@kfi7:662/0 lens 456/0 e 0 to 0 dl 1773852022 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1212-0'
00000100:00000001:12.0:1773851874.762925:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851874.762925:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851874.762926:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea3ade65 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ed061acb-abf0-437e-9305-1010498b1cf6+5:39662:x1859580449728576:12345-11682@kfi7:17:default-tuolumne1212-0
00000100:00000200:12.0:1773851874.762928:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580449728576
00000020:00000001:12.0:1773851874.762929:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851874.762930:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851874.762931:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851874.762932:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851874.762932:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:12.0:1773851874.762933:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851874.762934:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580449728576, found 0 last_xid 1859580449728575
00000020:00000001:12.0:1773851874.762935:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851874.762936:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851874.762937:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851874.762937:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851874.762938:0:60487:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:12.0:1773851874.762939:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851874.762941:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851874.762942:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000054addc0f.
02000000:00000001:12.0:1773851874.762943:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851874.762944:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851874.762945:0:60487:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:12.0:1773851874.762946:0:60487:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:12.0:1773851874.762946:0:60487:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:12.0:1773851874.762948:0:60487:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851874.762949:0:60487:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:12.0:1773851874.762950:0:60487:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli ed061acb-abf0-437e-9305-1010498b1cf6/00000000557cf050 free: 126633370845184 avail: 126633368748032
00000020:00000001:12.0:1773851874.762951:0:60487:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:12.0:1773851874.762952:0:60487:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli ed061acb-abf0-437e-9305-1010498b1cf6/00000000557cf050 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:12.0:1773851874.762953:0:60487:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:12.0:1773851874.762954:0:60487:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:12.0:1773851874.762954:0:60487:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli ed061acb-abf0-437e-9305-1010498b1cf6/00000000557cf050 reports grant 1811939327 dropped 0, local 1880096767
00000020:00000001:12.0:1773851874.762955:0:60487:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:12.0:1773851874.762956:0:60487:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:12.0:1773851874.762956:0:60487:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851874.762957:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035349985, transno 0, xid 1859580449728576
00010000:00000001:12.0:1773851874.762958:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851874.762958:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ea3ade65 x1859580449728576/t0(0) o17->ed061acb-abf0-437e-9305-1010498b1cf6@11682@kfi7:662/0 lens 456/432 e 0 to 0 dl 1773852022 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1212-0'
00010000:00000001:12.0:1773851874.762961:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851874.762961:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851874.762962:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=107 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851874.762963:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851874.762964:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002ede237b refcount 3 to 11682@kfi7
00000100:00000001:12.0:1773851874.762964:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803968 : -107130477747648 : ffff9e90bdede240)
02000000:00000001:12.0:1773851874.762965:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851874.762966:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851874.762966:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851874.762967:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11618@kfi7
00000400:00000010:12.0:1773851874.762967:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d61c8fc4.
00000100:00000200:12.0:1773851874.762969:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859580449728576, offset 224
00000400:00000200:12.0:1773851874.762970:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11618@kfi7
00000400:00000200:12.0:1773851874.762971:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11618@kfi7 to cpt 3
00000400:00000200:12.0:1773851874.762972:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091bf180c nid 11618@kfi7 refs 1
00000400:00000200:12.0:1773851874.762973:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000091bf180c nid 11618@kfi7 refs 2
00000400:00000200:12.0:1773851874.762974:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000091bf180c nid 11618@kfi7 refs 3
00000400:00000200:12.0:1773851874.762975:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11618@kfi7 local destination
00000400:00000200:12.0:1773851874.762977:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769490:8769490:1024:4294967295] 11618@kfi7 LPNI seq info [1456829:1456829:16:4294967295]
00000400:00000200:12.0:1773851874.762978:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000091bf180c nid 11618@kfi7 refs 2
00000400:00000200:12.0:1773851874.762979:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11618@kfi7 to cpt 3
00000400:00000200:12.0:1773851874.762980:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11618@kfi7(11618@kfi7:11618@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851874.762982:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000091bf180c nid 11618@kfi7 refs 3
00000800:00000200:12.0:1773851874.762983:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851874.762984:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:12.0:1773851874.762986:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851874.762988:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e Using peer 11618@kfi7(0x10000000000082e)
00000800:00000200:12.0:1773851874.762992:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 532 bytes to peer 0x10000000000082e: rc=0
00000800:00000200:12.0:1773851874.762993:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851874.762995:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851874.762996:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002ede237b refcount 2 to 11682@kfi7
00010000:00000001:12.0:1773851874.762996:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851874.762997:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851874.762997:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851874.762998:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ea3ade65 x1859580449728576/t0(0) o17->ed061acb-abf0-437e-9305-1010498b1cf6@11682@kfi7:662/0 lens 456/432 e 0 to 0 dl 1773852022 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1212-0'
00000100:00100000:12.0:1773851874.763003:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea3ade65 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ed061acb-abf0-437e-9305-1010498b1cf6+5:39662:x1859580449728576:12345-11682@kfi7:17:default-tuolumne1212-0 Request processed in 77us (127us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851874.763005:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11682@kfi7, seq: 411190551
00000100:00000040:12.0:1773851874.763006:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000557cf050 : new rpc_count 0
00000100:00000001:12.0:1773851874.763007:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851874.763007:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851874.763008:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851874.763009:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e6755665.
00000020:00000010:12.0:1773851874.763009:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000055324ba3.
00000020:00000040:12.0:1773851874.763010:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000557cf050 : new refcount 4
00000100:00000001:12.0:1773851874.763011:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851874.763016:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851874.763017:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851874.763019:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11618@kfi7: PUT: OK
00000400:00000200:13.0:1773851874.763019:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d61c8fc4
00000400:00000010:13.0:1773851874.763020:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d61c8fc4.
00000100:00000001:13.0:1773851874.763021:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851874.763021:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851874.763022:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000091bf180c nid 11618@kfi7 refs 2
00000800:00000200:13.0:1773851874.763024:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 11618@kfi7(00000000e913b27d):0x0 lsk 2095 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000082e Transaction freed
00000800:00000200:1.0:1773851874.790662:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851874.790663:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851874.790664:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851874.790666:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851874.790669:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.790670:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8800@kfi7 : PUT - for me
00000400:00000200:1.0:1773851874.790671:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.790672:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 1
00000400:00000200:1.0:1773851874.790672:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.790673:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000400:00000200:1.0:1773851874.790674:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 3
00000400:00000200:1.0:1773851874.790675:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8865@kfi7 to cpt 7
00000400:00000200:1.0:1773851874.790676:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8865@kfi7 of length 520 into portal 12 MB=0x69b1907162c80
00000400:00000200:1.0:1773851874.790677:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8865@kfi7 of length 520/520 into md 0x7fb56e801 [64] + 33416
00000800:00000200:1.0:1773851874.790679:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851874.790680:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851874.790681:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8800@kfi7: PUT: OK
00000100:00000001:1.0:1773851874.790682:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851874.790683:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851874.790683:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007272f633.
00000100:00000040:1.0:1773851874.790684:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007272f633 x1859381655645312 msgsize 520
00000100:00100000:1.0:1773851874.790686:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8865@kfi7 (source: 12345-8800@kfi7)
00000100:00000001:1.0:1773851874.790687:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851874.790688:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000100:00000001:0.0:1773851874.790688:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851874.790689:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851874.790689:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851874.790689:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851874.790690:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851874.790691:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851874.790692:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381655645312
00000020:00000001:0.0:1773851874.790692:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851874.790693:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07966881ad6
00000020:00000001:0.0:1773851874.790693:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851874.790695:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002e697baa refcount=10
00000020:00000001:0.0:1773851874.790695:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000020:00000001:0.0:1773851874.790696:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000100:00000001:0.0:1773851874.790697:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851874.790698:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851874.790699:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006fc2a86b.
00000020:00000010:0.0:1773851874.790700:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851874.790701:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851874.790702:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851874.790702:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851874.790703:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851874.790704:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:0.0:1773851874.790707:0:60951:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@000000007272f633 x1859381655645312/t0(0) o38->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852074 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1040-0'
00000100:00000001:0.0:1773851874.790709:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851874.790710:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.790710:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851874.790711:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851874.790712:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851874.790712:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851874.790712:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851874.790713:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8865@kfi7, seq: 1997576
00000100:00000001:1.0:1773851874.790714:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851874.790714:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851874.790714:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002e697baa : new rpc_count 2
00000100:00000001:0.0:1773851874.790714:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599718016 : -107004109833600 : ffff9eae2a0b3a80)
00000100:00000040:0.0:1773851874.790716:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007272f633 x1859381655645312/t0(0) o38->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852074 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1040-0'
00000100:00000001:0.0:1773851874.790718:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851874.790718:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851874.790720:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007272f633 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f4813154-7699-4896-9522-14f850a6fb2e+10:40012:x1859381655645312:12345-8865@kfi7:38:default-tuolumne1040-0
00000100:00000200:0.0:1773851874.790721:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381655645312
00000020:00000001:0.0:1773851874.790722:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:0.0:1773851874.790722:0:60951:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:0.0:1773851874.790727:0:60951:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:0.0:1773851874.790728:0:60951:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:0.0:1773851874.790730:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851874.790731:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851874.790732:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 0000000000ed6ae4.
02000000:00000001:0.0:1773851874.790732:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.790733:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851874.790735:0:60951:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:0.0:1773851874.790736:0:60951:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f4813154-7699-4896-9522-14f850a6fb2e (at 8865@kfi7) reconnecting
00010000:00000001:0.0:1773851874.790737:0:60951:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851874.790738:0:60951:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:0.0:1773851874.790739:0:60951:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7 t0 exp 000000002e697baa cur 614149 last 1773851874
00010000:00000001:0.0:1773851874.790741:0:60951:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:0.0:1773851874.790742:0:60951:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:0.0:1773851874.790743:0:60951:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:0.0:1773851874.790743:0:60951:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:0.0:1773851874.790744:0:60951:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:0.0:1773851874.790746:0:60951:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:0.0:1773851874.790747:0:60951:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:0.0:1773851874.790747:0:60951:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:0.0:1773851874.790748:0:60951:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:0.0:1773851874.790749:0:60951:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.790750:0:60951:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:0.0:1773851874.790751:0:60951:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:0.0:1773851874.790751:0:60951:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli f4813154-7699-4896-9522-14f850a6fb2e/000000002e697baa free: 126633370845184 avail: 126633368748032
00000020:00000001:0.0:1773851874.790753:0:60951:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:0.0:1773851874.790753:0:60951:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli f4813154-7699-4896-9522-14f850a6fb2e/000000002e697baa avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:0.0:1773851874.790755:0:60951:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:0.0:1773851874.790755:0:60951:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:0.0:1773851874.790756:0:60951:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:0.0:1773851874.790757:0:60951:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli f4813154-7699-4896-9522-14f850a6fb2e/000000002e697baa ocd_grant: 1464860672 want: 2097152 left: 112130449866752
00000020:00000001:0.0:1773851874.790758:0:60951:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:0.0:1773851874.790760:0:60951:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 8865@kfi7 supports cksum type f7, return f7
00000004:00000001:0.0:1773851874.790762:0:60951:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:0.0:1773851874.790763:0:60951:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:0.0:1773851874.790765:0:60951:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:0.0:1773851874.790766:0:60951:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851874.790767:0:60951:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851874.790769:0:60951:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851874.790770:0:60951:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 000000002e697baa : new rpc_count 1
00000020:00000040:0.0:1773851874.790771:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000002e697baa : new refcount 10
00000020:00000040:0.0:1773851874.790773:0:60951:0:(genops.c:871:class_export_get()) GET export 000000002e697baa refcount=11
00000100:00000040:0.0:1773851874.790774:0:60951:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 000000002e697baa : new rpc_count 2
00000100:00000001:0.0:1773851874.790775:0:60951:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:0.0:1773851874.790777:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8865@kfi7 to cpt 7
00000400:00000200:0.0:1773851874.790779:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000e781649 nid 8865@kfi7 refs 1
00000400:00000200:0.0:1773851874.790781:0:60951:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 000000000e781649 nid 8865@kfi7 refs 2
00000400:00000200:0.0:1773851874.790783:0:60951:0:(peer.c:1555:LNetPrimaryNID()) NID 8865@kfi7 primary NID 8865@kfi7 rc 0
00000100:00000001:0.0:1773851874.790819:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851874.790820:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053217cde refcount 3 to 8865@kfi7
00000100:00000001:0.0:1773851874.790821:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212384 : -107155106339232 : ffff9e8b01f36660)
00000100:00000001:0.0:1773851874.790822:0:60951:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636918603212384 : -107155106339232 : 0xffff9e8b01f36660)
00000100:00000040:0.0:1773851874.790824:0:60951:0:(connection.c:133:ptlrpc_connection_get()) conn=0000000053217cde refcount 3 to 8865@kfi7
00000100:00080000:0.0:1773851874.790826:0:60951:0:(import.c:86:import_set_state_nolock()) 0000000064de79f9 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:0.0:1773851874.790828:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053217cde refcount 2 to 8865@kfi7
00000100:00000001:0.0:1773851874.790829:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851874.790830:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053217cde refcount 3 to 8865@kfi7
00000100:00000001:0.0:1773851874.790831:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212384 : -107155106339232 : ffff9e8b01f36660)
02000000:00000001:0.0:1773851874.790833:0:60951:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:0.0:1773851874.790834:0:60951:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:0.0:1773851874.790836:0:60951:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.790837:0:60951:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:0.0:1773851874.790838:0:60951:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:0.0:1773851874.790839:0:60951:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:0.0:1773851874.790841:0:60951:0:(import.c:86:import_set_state_nolock()) 0000000064de79f9 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:0.0:1773851874.790842:0:60951:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:0.0:1773851874.790843:0:60951:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:0.0:1773851874.790844:0:60951:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851874.790846:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000002e697baa : new refcount 10
00000020:00000040:0.0:1773851874.790847:0:60951:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:0.0:1773851874.790849:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053217cde refcount 2 to 8865@kfi7
00010000:00000001:0.0:1773851874.790850:0:60951:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.790851:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851874.790852:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:0.0:1773851874.790854:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:0.0:1773851874.790855:0:60951:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851874.790856:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851874.790857:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851874.790858:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.790859:0:60951:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:0.0:1773851874.790861:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851874.790862:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851874.790863:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851874.790863:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.790865:0:60951:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851874.790866:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183034610706, transno 0, xid 1859381655645312
00010000:00000001:0.0:1773851874.790867:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851874.790869:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007272f633 x1859381655645312/t0(0) o38->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852074 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1040-0'
00010000:00000001:0.0:1773851874.790873:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851874.790874:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851874.790875:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=107 v=600 (1 1121 1 1)
00000100:00001000:0.0:1773851874.790877:0:60951:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:0.0:1773851874.790880:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851874.790881:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053217cde refcount 3 to 8865@kfi7
00000100:00000001:0.0:1773851874.790882:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212384 : -107155106339232 : ffff9e8b01f36660)
02000000:00000001:0.0:1773851874.790883:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851874.790884:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.790885:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851874.790886:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8800@kfi7
00000400:00000010:0.0:1773851874.790887:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000009e6d8.
00000100:00000200:0.0:1773851874.790889:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1859381655645312, offset 0
00000400:00000200:0.0:1773851874.790891:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8800@kfi7
00000400:00000200:0.0:1773851874.790893:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:0.0:1773851874.790894:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 1
00000400:00000200:0.0:1773851874.790896:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000400:00000200:0.0:1773851874.790898:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 3
00000400:00000200:0.0:1773851874.790900:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8800@kfi7 local destination
00000400:00000200:0.0:1773851874.790902:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769491:8769491:1024:4294967295] 8800@kfi7 LPNI seq info [1300263:1300263:16:4294967295]
00000400:00000200:0.0:1773851874.790905:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000400:00000200:0.0:1773851874.790907:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:0.0:1773851874.790910:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8800@kfi7(8800@kfi7:8800@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851874.790912:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 3
00000800:00000200:0.0:1773851874.790915:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851874.790917:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:0.0:1773851874.790921:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851874.790925:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11d7 Using peer 8800@kfi7(0x11d7)
00000800:00000200:0.0:1773851874.790929:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 516 bytes to peer 0x11d7: rc=0
00000800:00000200:0.0:1773851874.790932:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851874.790936:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851874.790937:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053217cde refcount 2 to 8865@kfi7
00010000:00000001:0.0:1773851874.790938:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851874.790939:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851874.790940:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851874.790944:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007272f633 x1859381655645312/t0(0) o38->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852074 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1040-0'
00000100:00100000:0.0:1773851874.790950:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007272f633 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f4813154-7699-4896-9522-14f850a6fb2e+10:40012:x1859381655645312:12345-8865@kfi7:38:default-tuolumne1040-0 Request processed in 231us (265us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851874.790954:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8865@kfi7, seq: 1997576
00000100:00000040:0.0:1773851874.790956:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002e697baa : new rpc_count 1
00000100:00000001:0.0:1773851874.790957:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851874.790958:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851874.790959:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851874.790960:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851874.790962:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006fc2a86b.
00000020:00000040:0.0:1773851874.790963:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000002e697baa : new refcount 9
00000100:00000001:0.0:1773851874.790964:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851874.790972:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11d7 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851874.790974:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851874.790975:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8800@kfi7: PUT: OK
00000400:00000200:1.0:1773851874.790976:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000009e6d8
00000400:00000010:1.0:1773851874.790976:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000009e6d8.
00000100:00000001:1.0:1773851874.790977:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851874.790978:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851874.790978:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000800:00000200:1.0:1773851874.790980:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 8800@kfi7(00000000188ca379):0x0 lsk 4568 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11d7 Transaction freed
00000800:00000200:1.0:1773851874.801858:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851874.801860:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851874.801862:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851874.801865:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851874.801869:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.801871:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8800@kfi7 : PUT - for me
00000400:00000200:1.0:1773851874.801873:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.801874:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 1
00000400:00000200:1.0:1773851874.801876:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8800@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.801877:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000400:00000200:1.0:1773851874.801878:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 3
00000400:00000200:1.0:1773851874.801880:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8865@kfi7 to cpt 7
00000400:00000200:1.0:1773851874.801882:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8865@kfi7 of length 2528 into portal 12 MB=0x69b190714c680
00000400:00000200:1.0:1773851874.801884:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8865@kfi7 of length 2528/2528 into md 0x7fb56e801 [64] + 33936
00000800:00000200:1.0:1773851874.801888:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851874.801890:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851874.801892:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8800@kfi7: PUT: OK
00000100:00000001:1.0:1773851874.801894:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851874.801894:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851874.801896:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007996fce2.
00000100:00000040:1.0:1773851874.801897:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007996fce2 x1859381655553664 msgsize 2528
00000100:00100000:1.0:1773851874.801900:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8865@kfi7 (source: 12345-8800@kfi7)
00000100:00000001:1.0:1773851874.801903:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851874.801904:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c860d9e8 nid 8800@kfi7 refs 2
00000800:00000200:1.0:1773851874.801906:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8800@kfi7(00000000d26a3b01):0x0 lsk 652 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851874.801906:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851874.801907:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851874.801907:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851874.801908:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851874.801910:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851874.801911:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381655553664
00000020:00000001:0.0:1773851874.801912:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851874.801912:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07966881ad6
00000020:00000001:0.0:1773851874.801914:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851874.801915:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002e697baa refcount=10
00000020:00000001:0.0:1773851874.801916:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000020:00000001:0.0:1773851874.801917:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000100:00000001:0.0:1773851874.801919:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851874.801919:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851874.801920:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006fc2a86b.
00000020:00000010:0.0:1773851874.801922:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851874.801923:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851874.801924:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851874.801925:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:0.0:1773851874.801926:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:0.0:1773851874.801930:0:60951:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 000000001650a486 cookie 0x999fc89951d45354  req@000000007996fce2 x1859381655553664/t0(0) o101->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:472/0 lens 2528/0 e 0 to 0 dl 1773852587 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-940832718848'
00010000:00000001:0.0:1773851874.801936:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851874.801937:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851874.801937:0:60951:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.801938:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:0.1F:1773851874.801941:0:60951:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000007996fce2 x1859381655553664/t0(0) o101->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:472/0 lens 2528/0 e 0 to 0 dl 1773852587 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-940832718848'
00000100:00080000:0.1:1773851874.801948:0:60951:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000094a6b22d x1859381655553664/t0(0) o101->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:424/0 lens 2528/3296 e 0 to 0 dl 1773851808 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-940832718848'
00000100:00000001:0.0:1773851874.801954:0:60951:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:0.0:1773851874.801956:0:60951:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:0.0:1773851874.801957:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851874.801958:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851874.801959:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851874.801960:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851874.801961:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006fc2a86b.
00000020:00000040:0.0:1773851874.801963:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000002e697baa : new refcount 9
00000100:00000001:0.0:1773851874.801965:0:60951:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851874.848791:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851874.848791:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851874.848792:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851874.848795:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.848797:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.848798:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.13@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851874.848799:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.848800:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851874.848801:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.13@o2ib60 to cpt 6
00000400:00000200:17.0:1773851874.848802:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 2
00000400:00000200:17.0:1773851874.848803:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 3
00000400:00000200:17.0:1773851874.848804:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.13@o2ib60 to cpt 6
00000400:00000200:17.0:1773851874.848806:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.13@o2ib60 of length 224 into portal 12 MB=0x69b23f5816b40
00000400:00000200:17.0:1773851874.848807:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.13@o2ib60 of length 224/224 into md 0x16159c9699 [64] + 22104
00000800:00000200:17.0:1773851874.848809:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851874.848811:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.848812:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851874.848813:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851874.848813:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851874.848814:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c8847ea.
00000100:00000040:17.0:1773851874.848815:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001c8847ea x1859428605324096 msgsize 224
00000100:00100000:17.0:1773851874.848817:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.13@o2ib60 (source: 12345-192.168.128.13@o2ib60)
00000100:00000001:17.0:1773851874.848819:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851874.848820:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851874.848821:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851874.848822:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851874.848822:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851874.848823:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851874.848823:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851874.848824:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851874.848825:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859428605324096
00000020:00000001:27.0:1773851874.848825:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851874.848826:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b94c646a1
00000020:00000001:27.0:1773851874.848827:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851874.848829:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000326b1e3c refcount=5
00000020:00000001:27.0:1773851874.848829:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637122381626368 : -106951327925248 : ffff9eba74173c00)
00000020:00000001:27.0:1773851874.848830:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637122381626368 : -106951327925248 : ffff9eba74173c00)
00000100:00000001:27.0:1773851874.848831:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.848832:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851874.848833:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004133ac17.
00000020:00000010:27.0:1773851874.848834:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.848835:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008f193acf.
00000100:00000001:27.0:1773851874.848836:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851874.848836:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851874.848837:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.848838:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851874.848838:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851874.848839:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.848840:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851874.848842:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851874.848842:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851874.848842:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851874.848843:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851874.848844:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.13@o2ib60, seq: 2025126
00000100:00000040:27.0:1773851874.848845:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000326b1e3c : new rpc_count 1
00000100:00000001:27.0:1773851874.848845:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372326784 : -107078337224832 : ffff9e9ce1bf1f80)
00000100:00000001:26.0:1773851874.848845:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851874.848845:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.848847:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c8847ea x1859428605324096/t0(0) o400->ccc82350-18ee-45d9-ab27-98645d1b8106@192.168.128.13@o2ib60:91/0 lens 224/0 e 0 to 0 dl 1773852206 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix13-0'
00000100:00000001:27.0:1773851874.848851:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851874.848851:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851874.848853:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c8847ea pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ccc82350-18ee-45d9-ab27-98645d1b8106+5:39820:x1859428605324096:12345-192.168.128.13@o2ib60:400:default-matrix13-0
00000100:00000200:27.0:1773851874.848854:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859428605324096
00000020:00000001:27.0:1773851874.848855:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851874.848856:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851874.848856:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.848857:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851874.848858:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851874.848859:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851874.848859:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859428605324096, found 0 last_xid 1859428605324095
00000020:00000001:27.0:1773851874.848860:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851874.848861:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851874.848862:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851874.848862:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.848863:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851874.848863:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851874.848864:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851874.848865:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000094a73686.
02000000:00000001:27.0:1773851874.848865:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.848866:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.848867:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851874.848868:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181753912660, transno 0, xid 1859428605324096
00010000:00000001:27.0:1773851874.848868:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851874.848870:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c8847ea x1859428605324096/t0(0) o400->ccc82350-18ee-45d9-ab27-98645d1b8106@192.168.128.13@o2ib60:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix13-0'
00010000:00000001:27.0:1773851874.848873:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851874.848874:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851874.848875:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=107 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851874.848877:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851874.848878:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004057d3fb refcount 3 to 192.168.128.13@o2ib60
00000100:00000001:27.0:1773851874.848880:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858688 : -107149578692928 : ffff9e8c4b6c96c0)
02000000:00000001:27.0:1773851874.848882:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851874.848883:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851874.848884:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851874.848886:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.13@o2ib60
00000400:00000010:27.0:1773851874.848887:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003f689320.
00000100:00000200:27.0:1773851874.848889:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859428605324096, offset 224
00000400:00000200:27.0:1773851874.848891:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.13@o2ib60
00000400:00000200:27.0:1773851874.848894:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.13@o2ib60 to cpt 6
00000400:00000200:27.0:1773851874.848896:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 2
00000400:00000200:27.0:1773851874.848898:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 3
00000400:00000200:27.0:1773851874.848900:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 4
00000400:00000200:27.0:1773851874.848903:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.13@o2ib60 routed destination
00000400:00000200:27.0:1773851874.848905:0:41182:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:27.0:1773851874.848907:0:41182:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:27.0:1773851874.848909:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.13@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851874.848910:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:27.0:1773851874.848912:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.13@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851874.848914:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:27.0:1773851874.848916:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769492:8769492:1024:4294967295] 17@kfi7 LPNI seq info [1250891903:1250891903:16:4294967295]
00000400:00000200:27.0:1773851874.848918:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:27.0:1773851874.848920:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:27.0:1773851874.848925:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.13@o2ib60(192.168.128.13@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851874.848928:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 3
00000800:00000200:27.0:1773851874.848930:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851874.848933:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851874.848937:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851874.848941:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:27.0:1773851874.848947:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:27.0:1773851874.848950:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851874.848954:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851874.848956:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004057d3fb refcount 2 to 192.168.128.13@o2ib60
00010000:00000001:27.0:1773851874.848957:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851874.848958:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851874.848959:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851874.848961:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c8847ea x1859428605324096/t0(0) o400->ccc82350-18ee-45d9-ab27-98645d1b8106@192.168.128.13@o2ib60:91/0 lens 224/224 e 0 to 0 dl 1773852206 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix13-0'
00000800:00000200:25.0:1773851874.848962:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851874.848964:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851874.848965:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:25.0:1773851874.848966:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003f689320
00000100:00100000:27.0:1773851874.848967:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c8847ea pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ccc82350-18ee-45d9-ab27-98645d1b8106+5:39820:x1859428605324096:12345-192.168.128.13@o2ib60:400:default-matrix13-0 Request processed in 115us (151us total) trans 0 rc 0/0
00000400:00000010:25.0:1773851874.848967:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003f689320.
00000100:00000001:25.0:1773851874.848968:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851874.848968:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851874.848969:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:25.0:1773851874.848971:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Transaction freed
00000100:00100000:27.0:1773851874.848972:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.13@o2ib60, seq: 2025126
00000100:00000040:27.0:1773851874.848974:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000326b1e3c : new rpc_count 0
00000100:00000001:27.0:1773851874.848975:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851874.848976:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851874.848977:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851874.848978:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008f193acf.
00000020:00000010:27.0:1773851874.848980:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004133ac17.
00000020:00000040:27.0:1773851874.848981:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000326b1e3c : new refcount 4
00000100:00000001:27.0:1773851874.848982:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851874.859983:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851874.859984:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851874.859985:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851874.859987:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851874.859989:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.859990:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24571@kfi7 : PUT - for me
00000400:00000200:1.0:1773851874.859991:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.859992:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 1
00000400:00000200:1.0:1773851874.859992:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.859993:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000400:00000200:1.0:1773851874.859994:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 3
00000400:00000200:1.0:1773851874.859995:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.859996:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24571@kfi7 of length 224 into portal 12 MB=0x699de8c699340
00000400:00000200:1.0:1773851874.859997:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24571@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 36464
00000800:00000200:1.0:1773851874.859998:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851874.860000:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851874.860001:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24571@kfi7: PUT: OK
00000100:00000001:1.0:1773851874.860002:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851874.860002:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851874.860003:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000be74f35c.
00000100:00000040:1.0:1773851874.860003:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000be74f35c x1858030977782592 msgsize 224
00000100:00100000:1.0:1773851874.860005:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24571@kfi7 (source: 12345-24571@kfi7)
00000100:00000001:1.0:1773851874.860006:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851874.860007:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000800:00000200:1.0:1773851874.860008:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851874.860008:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851874.860008:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851874.860009:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851874.860009:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851874.860010:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851874.860011:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030977782592
00000020:00000001:0.0:1773851874.860011:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851874.860012:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f74
00000020:00000001:0.0:1773851874.860012:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851874.860014:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009cb5f755 refcount=6
00000020:00000001:0.0:1773851874.860014:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239892992 : -107152469658624 : ffff9e8b9f1bf400)
00000020:00000001:0.0:1773851874.860015:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239892992 : -107152469658624 : ffff9e8b9f1bf400)
00000100:00000001:0.0:1773851874.860016:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851874.860017:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851874.860017:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006fc2a86b.
00000020:00000010:0.0:1773851874.860018:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851874.860019:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851874.860020:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851874.860021:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851874.860021:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851874.860022:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851874.860023:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851874.860023:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.860024:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851874.860025:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851874.860025:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851874.860026:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851874.860026:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851874.860027:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24571@kfi7, seq: 1997577
00000100:00000040:1.0:1773851874.860028:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009cb5f755 : new rpc_count 1
00000100:00000001:1.0:1773851874.860028:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599715712 : -107004109835904 : ffff9eae2a0b3180)
00000100:00000001:0.0:1773851874.860028:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851874.860029:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851874.860030:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000be74f35c x1858030977782592/t0(0) o400->f210ae29-d723-45b7-9a3f-b283f073319f@24571@kfi7:514/0 lens 224/0 e 0 to 0 dl 1773852629 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne264-0'
00000100:00000001:1.0:1773851874.860032:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851874.860033:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851874.860034:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be74f35c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f210ae29-d723-45b7-9a3f-b283f073319f+6:47898:x1858030977782592:12345-24571@kfi7:400:default-tuolumne264-0
00000100:00000200:1.0:1773851874.860035:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030977782592
00000020:00000001:1.0:1773851874.860036:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851874.860036:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851874.860037:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851874.860038:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851874.860038:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851874.860039:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851874.860040:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030977782592, found 0 last_xid 1858030977782591
00000020:00000001:1.0:1773851874.860041:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851874.860041:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851874.860042:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851874.860043:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851874.860043:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851874.860044:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851874.860044:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851874.860045:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000fc01e6e.
02000000:00000001:1.0:1773851874.860046:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851874.860047:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851874.860047:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851874.860048:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030977782592
00010000:00000001:1.0:1773851874.860049:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851874.860050:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000be74f35c x1858030977782592/t0(0) o400->f210ae29-d723-45b7-9a3f-b283f073319f@24571@kfi7:514/0 lens 224/224 e 0 to 0 dl 1773852629 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne264-0'
00010000:00000001:1.0:1773851874.860053:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851874.860053:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851874.860054:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=107 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851874.860055:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851874.860056:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000792a543a refcount 5 to 24571@kfi7
00000100:00000001:1.0:1773851874.860057:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729380416 : -107155980171200 : ffff9e8acdddc840)
02000000:00000001:1.0:1773851874.860058:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851874.860058:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851874.860059:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851874.860059:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24571@kfi7
00000400:00000010:1.0:1773851874.860060:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ffbd9402.
00000100:00000200:1.0:1773851874.860061:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030977782592, offset 224
00000400:00000200:1.0:1773851874.860063:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24571@kfi7
00000400:00000200:1.0:1773851874.860063:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.860064:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 1
00000400:00000200:1.0:1773851874.860065:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000400:00000200:1.0:1773851874.860066:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 3
00000400:00000200:1.0:1773851874.860068:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24571@kfi7 local destination
00000400:00000200:1.0:1773851874.860069:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769493:8769493:1024:4294967295] 24571@kfi7 LPNI seq info [28031:28031:16:4294967295]
00000400:00000200:1.0:1773851874.860070:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000400:00000200:1.0:1773851874.860071:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24571@kfi7 to cpt 0
00000400:00000200:1.0:1773851874.860073:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24571@kfi7(24571@kfi7:24571@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851874.860074:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 3
00000800:00000200:1.0:1773851874.860075:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851874.860077:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851874.860078:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851874.860081:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x899 Using peer 24571@kfi7(0x899)
00000800:00000200:1.0:1773851874.860085:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x899: rc=0
00000800:00000200:1.0:1773851874.860087:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x899 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851874.860089:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851874.860090:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000792a543a refcount 4 to 24571@kfi7
00010000:00000001:1.0:1773851874.860090:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851874.860091:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851874.860091:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851874.860092:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000be74f35c x1858030977782592/t0(0) o400->f210ae29-d723-45b7-9a3f-b283f073319f@24571@kfi7:514/0 lens 224/224 e 0 to 0 dl 1773852629 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne264-0'
00000100:00100000:1.0:1773851874.860095:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be74f35c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f210ae29-d723-45b7-9a3f-b283f073319f+6:47898:x1858030977782592:12345-24571@kfi7:400:default-tuolumne264-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851874.860098:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24571@kfi7, seq: 1997577
00000100:00000040:1.0:1773851874.860098:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009cb5f755 : new rpc_count 0
00000100:00000001:1.0:1773851874.860099:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:2.0:1773851874.860100:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x899 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851874.860100:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851874.860100:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:1.0:1773851874.860101:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000400:00000200:2.0:1773851874.860102:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851874.860102:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006fc2a86b.
00000400:00000200:2.0:1773851874.860103:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24571@kfi7: PUT: OK
00000020:00000040:1.0:1773851874.860103:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000009cb5f755 : new refcount 5
00000100:00000001:1.0:1773851874.860103:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851874.860104:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ffbd9402
00000400:00000010:2.0:1773851874.860105:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ffbd9402.
00000100:00000001:2.0:1773851874.860106:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851874.860106:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851874.860107:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007a7b9b9b nid 24571@kfi7 refs 2
00000800:00000200:2.0:1773851874.860109:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 24571@kfi7(000000008cdbc9db):0x0 lsk 2202 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x899 Transaction freed
00000800:00000200:9.0:1773851874.941249:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851874.941250:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851874.941252:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851874.941254:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851874.941257:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.941258:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.18@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851874.941259:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851874.941260:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851874.941262:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.18@o2ib60 to cpt 3
00000400:00000200:9.0:1773851874.941264:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bd8470d9 nid 192.168.128.18@o2ib60 refs 2
00000400:00000200:9.0:1773851874.941265:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bd8470d9 nid 192.168.128.18@o2ib60 refs 3
00000400:00000200:9.0:1773851874.941266:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.18@o2ib60 to cpt 3
00000400:00000200:9.0:1773851874.941268:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.18@o2ib60 of length 224 into portal 12 MB=0x69a39a4f0cbc0
00000400:00000200:9.0:1773851874.941270:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.18@o2ib60 of length 224/224 into md 0x82a36e8ed [64] + 36848
00000800:00000200:9.0:1773851874.941272:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851874.941274:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851874.941276:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851874.941277:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851874.941277:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851874.941278:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8cd0ee3.
00000100:00000040:9.0:1773851874.941279:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e8cd0ee3 x1858422231321536 msgsize 224
00000100:00100000:9.0:1773851874.941282:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.18@o2ib60 (source: 12345-192.168.128.18@o2ib60)
00000100:00000001:9.0:1773851874.941284:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851874.941285:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851874.941287:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851874.941288:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851874.941289:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851874.941290:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851874.941290:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851874.941292:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851874.941293:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858422231321536
00000020:00000001:12.0:1773851874.941294:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851874.941295:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e24
00000020:00000001:12.0:1773851874.941296:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851874.941302:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000017df4d90 refcount=7
00000020:00000001:12.0:1773851874.941303:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239642112 : -107152469909504 : ffff9e8b9f182000)
00000020:00000001:12.0:1773851874.941304:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239642112 : -107152469909504 : ffff9e8b9f182000)
00000100:00000001:12.0:1773851874.941305:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851874.941307:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851874.941308:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000133184a0.
00000020:00000010:12.0:1773851874.941309:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851874.941311:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1108fb9.
00000100:00000001:12.0:1773851874.941312:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851874.941313:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851874.941314:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851874.941316:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851874.941316:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851874.941317:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851874.941319:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851874.941321:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851874.941321:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851874.941321:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851874.941322:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851874.941323:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.18@o2ib60, seq: 2289861
00000100:00000040:15.0:1773851874.941324:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000017df4d90 : new rpc_count 2
00000100:00000001:15.0:1773851874.941324:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096232448 : -107006613319168 : ffff9ead94d31200)
00000100:00000001:12.0:1773851874.941324:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851874.941325:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.941326:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e8cd0ee3 x1858422231321536/t0(0) o400->10e60edc-0078-4688-87fa-94b97ef0ae28@192.168.128.18@o2ib60:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix18-0'
00000100:00000001:15.0:1773851874.941329:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851874.941329:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851874.941330:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8cd0ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:10e60edc-0078-4688-87fa-94b97ef0ae28+7:39885:x1858422231321536:12345-192.168.128.18@o2ib60:400:default-matrix18-0
00000100:00000200:15.0:1773851874.941332:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858422231321536
00000020:00000001:15.0:1773851874.941332:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851874.941333:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851874.941334:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.941335:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851874.941335:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851874.941336:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851874.941336:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858422231321536, found 0 last_xid 1858422230015487
00000020:00000001:15.0:1773851874.941337:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851874.941338:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851874.941338:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851874.941339:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.941340:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851874.941340:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851874.941341:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851874.941342:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000055324ba3.
02000000:00000001:15.0:1773851874.941342:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.941343:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.941343:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851874.941344:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252421027, transno 0, xid 1858422231321536
00010000:00000001:15.0:1773851874.941345:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851874.941346:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e8cd0ee3 x1858422231321536/t0(0) o400->10e60edc-0078-4688-87fa-94b97ef0ae28@192.168.128.18@o2ib60:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix18-0'
00010000:00000001:15.0:1773851874.941348:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851874.941349:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851874.941350:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=107 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851874.941351:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851874.941352:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0643822 refcount 3 to 192.168.128.18@o2ib60
00000100:00000001:15.0:1773851874.941352:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148480 : -107154898403136 : ffff9e8b0e5840c0)
02000000:00000001:15.0:1773851874.941353:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851874.941354:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851874.941355:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851874.941356:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.18@o2ib60
00000400:00000010:15.0:1773851874.941356:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000d55f9f0.
00000100:00000200:15.0:1773851874.941357:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858422231321536, offset 224
00000400:00000200:15.0:1773851874.941359:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.18@o2ib60
00000400:00000200:15.0:1773851874.941360:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.18@o2ib60 to cpt 3
00000400:00000200:15.0:1773851874.941362:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bd8470d9 nid 192.168.128.18@o2ib60 refs 2
00000400:00000200:15.0:1773851874.941364:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bd8470d9 nid 192.168.128.18@o2ib60 refs 3
00000400:00000200:15.0:1773851874.941366:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bd8470d9 nid 192.168.128.18@o2ib60 refs 4
00000400:00000200:15.0:1773851874.941368:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.18@o2ib60 routed destination
00000400:00000200:15.0:1773851874.941369:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851874.941370:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:15.0:1773851874.941372:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.18@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851874.941373:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851874.941374:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.18@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851874.941375:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851874.941376:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769494:8769494:1024:4294967295] 2094@kfi7 LPNI seq info [1258747004:1258747004:16:4294967295]
00000400:00000200:15.0:1773851874.941378:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:15.0:1773851874.941379:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:15.0:1773851874.941381:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.18@o2ib60(192.168.128.18@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851874.941383:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bd8470d9 nid 192.168.128.18@o2ib60 refs 3
00000800:00000200:15.0:1773851874.941384:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851874.941385:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851874.941388:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851874.941390:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:15.0:1773851874.941393:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:15.0:1773851874.941394:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851874.941396:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851874.941397:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0643822 refcount 2 to 192.168.128.18@o2ib60
00010000:00000001:15.0:1773851874.941398:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851874.941399:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851874.941400:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851874.941402:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8cd0ee3 x1858422231321536/t0(0) o400->10e60edc-0078-4688-87fa-94b97ef0ae28@192.168.128.18@o2ib60:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix18-0'
00000100:00100000:15.0:1773851874.941405:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8cd0ee3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:10e60edc-0078-4688-87fa-94b97ef0ae28+7:39885:x1858422231321536:12345-192.168.128.18@o2ib60:400:default-matrix18-0 Request processed in 75us (124us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851874.941406:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851874.941408:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.18@o2ib60, seq: 2289861
00000100:00000040:15.0:1773851874.941408:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000017df4d90 : new rpc_count 1
00000100:00000001:15.0:1773851874.941409:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851874.941410:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851874.941410:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000400:00000200:13.0:1773851874.941410:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851874.941411:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1108fb9.
00000400:00000200:13.0:1773851874.941411:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:15.0:1773851874.941412:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000133184a0.
00000400:00000200:13.0:1773851874.941412:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000d55f9f0
00000400:00000010:13.0:1773851874.941412:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000d55f9f0.
00000020:00000040:15.0:1773851874.941413:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000017df4d90 : new refcount 6
00000100:00000001:13.0:1773851874.941413:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851874.941414:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851874.941414:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851874.941415:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:13.0:1773851874.941417:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00000800:00000200:17.0:1773851874.994151:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851874.994152:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851874.994153:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851874.994155:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851874.994157:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.994159:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.12@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851874.994160:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851874.994160:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851874.994162:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.12@o2ib60 to cpt 5
00000400:00000200:17.0:1773851874.994163:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062d41457 nid 192.168.128.12@o2ib60 refs 2
00000400:00000200:17.0:1773851874.994164:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062d41457 nid 192.168.128.12@o2ib60 refs 3
00000400:00000200:17.0:1773851874.994165:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.12@o2ib60 to cpt 5
00000400:00000200:17.0:1773851874.994167:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.12@o2ib60 of length 224 into portal 12 MB=0x69a17bbadf300
00000400:00000200:17.0:1773851874.994168:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.12@o2ib60 of length 224/224 into md 0x6a32cacf5 [64] + 45424
00000800:00000200:17.0:1773851874.994170:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851874.994171:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851874.994172:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851874.994173:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851874.994174:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851874.994174:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d5b02377.
00000100:00000040:17.0:1773851874.994175:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000d5b02377 x1858276583928576 msgsize 224
00000100:00100000:17.0:1773851874.994177:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.12@o2ib60 (source: 12345-192.168.128.12@o2ib60)
00000100:00000001:17.0:1773851874.994179:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851874.994180:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:23.0:1773851874.994182:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851874.994182:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851874.994183:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851874.994183:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851874.994184:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851874.994185:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851874.994186:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858276583928576
00000020:00000001:23.0:1773851874.994187:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851874.994187:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cfe
00000020:00000001:23.0:1773851874.994188:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851874.994191:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bfe65ce8 refcount=7
00000020:00000001:23.0:1773851874.994191:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395708928 : -107136313842688 : ffff9e8f62122400)
00000020:00000001:23.0:1773851874.994192:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395708928 : -107136313842688 : ffff9e8f62122400)
00000100:00000001:23.0:1773851874.994194:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851874.994194:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851874.994195:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851874.994196:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851874.994197:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851874.994198:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851874.994199:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851874.994199:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851874.994200:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851874.994201:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851874.994201:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.994203:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851874.994204:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851874.994204:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851874.994204:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851874.994205:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851874.994206:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.12@o2ib60, seq: 1998001
00000100:00000040:23.0:1773851874.994207:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bfe65ce8 : new rpc_count 2
00000100:00000001:20.0:1773851874.994207:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.994208:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372319872 : -107078337231744 : ffff9e9ce1bf0480)
00000100:00000001:20.0:1773851874.994208:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851874.994210:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d5b02377 x1858276583928576/t0(0) o400->666bad06-25fe-4ceb-b834-0470661e7f06@192.168.128.12@o2ib60:601/0 lens 224/0 e 0 to 0 dl 1773851961 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix12-0'
00000100:00000001:23.0:1773851874.994212:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851874.994213:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851874.994214:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b02377 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:666bad06-25fe-4ceb-b834-0470661e7f06+7:31917:x1858276583928576:12345-192.168.128.12@o2ib60:400:default-matrix12-0
00000100:00000200:23.0:1773851874.994215:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858276583928576
00000020:00000001:23.0:1773851874.994216:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851874.994217:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851874.994217:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.994218:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851874.994219:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851874.994219:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851874.994220:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858276583928576, found 0 last_xid 1858276582618687
00000020:00000001:23.0:1773851874.994221:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851874.994221:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851874.994222:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851874.994223:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.994223:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851874.994224:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851874.994224:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851874.994225:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007612d4a7.
02000000:00000001:23.0:1773851874.994226:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.994226:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.994227:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851874.994228:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182337720792, transno 0, xid 1858276583928576
00010000:00000001:23.0:1773851874.994228:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851874.994229:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d5b02377 x1858276583928576/t0(0) o400->666bad06-25fe-4ceb-b834-0470661e7f06@192.168.128.12@o2ib60:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix12-0'
00010000:00000001:23.0:1773851874.994232:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851874.994233:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851874.994234:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=107 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851874.994235:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851874.994236:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f8d3f6c4 refcount 3 to 192.168.128.12@o2ib60
00000100:00000001:23.0:1773851874.994237:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092242528 : -107152617309088 : ffff9e8b964efc60)
02000000:00000001:23.0:1773851874.994238:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851874.994238:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851874.994239:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851874.994240:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.12@o2ib60
00000400:00000010:23.0:1773851874.994241:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d878015d.
00000100:00000200:23.0:1773851874.994242:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858276583928576, offset 224
00000400:00000200:23.0:1773851874.994244:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.12@o2ib60
00000400:00000200:23.0:1773851874.994245:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.12@o2ib60 to cpt 5
00000400:00000200:23.0:1773851874.994247:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062d41457 nid 192.168.128.12@o2ib60 refs 2
00000400:00000200:23.0:1773851874.994248:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062d41457 nid 192.168.128.12@o2ib60 refs 3
00000400:00000200:23.0:1773851874.994250:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062d41457 nid 192.168.128.12@o2ib60 refs 4
00000400:00000200:23.0:1773851874.994251:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.12@o2ib60 routed destination
00000400:00000200:23.0:1773851874.994252:0:60934:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851874.994253:0:60934:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:23.0:1773851874.994255:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.12@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851874.994256:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851874.994257:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.12@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851874.994258:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851874.994259:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769495:8769495:1024:4294967295] 17@kfi7 LPNI seq info [1250891904:1250891904:16:4294967295]
00000400:00000200:23.0:1773851874.994260:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:23.0:1773851874.994261:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:23.0:1773851874.994264:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.12@o2ib60(192.168.128.12@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851874.994265:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062d41457 nid 192.168.128.12@o2ib60 refs 3
00000800:00000200:23.0:1773851874.994267:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851874.994268:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851874.994271:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851874.994274:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:23.0:1773851874.994276:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:23.0:1773851874.994278:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851874.994280:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851874.994281:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f8d3f6c4 refcount 2 to 192.168.128.12@o2ib60
00010000:00000001:23.0:1773851874.994282:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851874.994283:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851874.994283:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851874.994284:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d5b02377 x1858276583928576/t0(0) o400->666bad06-25fe-4ceb-b834-0470661e7f06@192.168.128.12@o2ib60:601/0 lens 224/224 e 0 to 0 dl 1773851961 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix12-0'
00000100:00100000:23.0:1773851874.994288:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b02377 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:666bad06-25fe-4ceb-b834-0470661e7f06+7:31917:x1858276583928576:12345-192.168.128.12@o2ib60:400:default-matrix12-0 Request processed in 74us (111us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851874.994290:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.12@o2ib60, seq: 1998001
00000800:00000200:22.0:1773851874.994290:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851874.994291:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bfe65ce8 : new rpc_count 1
00000100:00000001:23.0:1773851874.994292:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851874.994292:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:22.0:1773851874.994292:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851874.994293:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851874.994293:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:22.0:1773851874.994293:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000010:23.0:1773851874.994294:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000400:00000200:22.0:1773851874.994294:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d878015d
00000020:00000040:23.0:1773851874.994295:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000bfe65ce8 : new refcount 6
00000400:00000010:22.0:1773851874.994295:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d878015d.
00000100:00000001:23.0:1773851874.994296:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851874.994296:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851874.994296:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851874.994297:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:22.0:1773851874.994299:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Transaction freed
00000800:00000200:13.0:1773851875.006327:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851875.006328:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851875.006329:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851875.006331:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851875.006333:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19747@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.006335:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19747@kfi7 : PUT - for me
00000400:00000200:13.0:1773851875.006336:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19747@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.006337:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd327d38 nid 19747@kfi7 refs 1
00000400:00000200:13.0:1773851875.006338:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19747@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.006339:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd327d38 nid 19747@kfi7 refs 2
00000400:00000200:13.0:1773851875.006340:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cd327d38 nid 19747@kfi7 refs 3
00000400:00000200:13.0:1773851875.006341:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19938@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.006342:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19938@kfi7 of length 224 into portal 12 MB=0x699e0dae12600
00000400:00000200:13.0:1773851875.006343:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19938@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 37072
00000800:00000200:13.0:1773851875.006345:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851875.006347:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851875.006348:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19747@kfi7: PUT: OK
00000100:00000001:13.0:1773851875.006349:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851875.006350:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851875.006351:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fff080c2.
00000100:00000040:13.0:1773851875.006352:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000fff080c2 x1858040884176384 msgsize 224
00000100:00100000:13.0:1773851875.006353:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-19938@kfi7 (source: 12345-19747@kfi7)
00000100:00000001:13.0:1773851875.006354:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851875.006355:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cd327d38 nid 19747@kfi7 refs 2
00000100:00000001:15.0:1773851875.006356:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851875.006356:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851875.006357:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851875.006357:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851875.006357:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851875.006358:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851875.006359:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040884176384
00000020:00000001:15.0:1773851875.006359:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851875.006360:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d83
00000020:00000001:15.0:1773851875.006360:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851875.006366:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fb939624 refcount=12
00000020:00000001:15.0:1773851875.006367:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239501824 : -107152470049792 : ffff9e8b9f15fc00)
00000020:00000001:15.0:1773851875.006367:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239501824 : -107152470049792 : ffff9e8b9f15fc00)
00000100:00000001:15.0:1773851875.006368:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851875.006369:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851875.006370:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebe397c.
00000020:00000010:15.0:1773851875.006371:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851875.006372:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851875.006373:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851875.006373:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851875.006374:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851875.006375:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851875.006376:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851875.006376:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.006377:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851875.006378:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851875.006379:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851875.006379:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851875.006379:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851875.006380:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19938@kfi7, seq: 2289862
00000100:00000040:15.0:1773851875.006381:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fb939624 : new rpc_count 1
00000100:00000001:15.0:1773851875.006381:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970998528 : -107043738553088 : ffff9ea4effcf500)
00000100:00000001:12.0:1773851875.006381:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851875.006381:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851875.006383:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fff080c2 x1858040884176384/t0(0) o400->c27b5593-58f4-47c0-8b51-57398d7251bd@19938@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1723-0'
00000100:00000001:15.0:1773851875.006385:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851875.006386:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851875.006387:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fff080c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c27b5593-58f4-47c0-8b51-57398d7251bd+12:39638:x1858040884176384:12345-19938@kfi7:400:default-tuolumne1723-0
00000100:00000200:15.0:1773851875.006388:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040884176384
00000020:00000001:15.0:1773851875.006389:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851875.006390:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851875.006390:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.006391:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851875.006392:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851875.006392:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851875.006393:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040884176384, found 0 last_xid 1858040884176383
00000020:00000001:15.0:1773851875.006394:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851875.006394:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851875.006395:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851875.006395:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.006396:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851875.006397:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851875.006397:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851875.006398:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002e8d9699.
02000000:00000001:15.0:1773851875.006399:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.006400:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.006401:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851875.006402:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691638, transno 0, xid 1858040884176384
00010000:00000001:15.0:1773851875.006402:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851875.006403:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fff080c2 x1858040884176384/t0(0) o400->c27b5593-58f4-47c0-8b51-57398d7251bd@19938@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1723-0'
00010000:00000001:15.0:1773851875.006405:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851875.006406:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851875.006406:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=108 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851875.006408:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851875.006408:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009c369c39 refcount 3 to 19938@kfi7
00000100:00000001:15.0:1773851875.006409:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729297728 : -107155980253888 : ffff9e8acddc8540)
02000000:00000001:15.0:1773851875.006410:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851875.006410:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.006411:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851875.006412:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19747@kfi7
00000400:00000010:15.0:1773851875.006413:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050bc9375.
00000100:00000200:15.0:1773851875.006413:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040884176384, offset 224
00000400:00000200:15.0:1773851875.006415:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19747@kfi7
00000400:00000200:15.0:1773851875.006416:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19747@kfi7 to cpt 3
00000400:00000200:15.0:1773851875.006417:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd327d38 nid 19747@kfi7 refs 1
00000400:00000200:15.0:1773851875.006418:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cd327d38 nid 19747@kfi7 refs 2
00000400:00000200:15.0:1773851875.006419:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cd327d38 nid 19747@kfi7 refs 3
00000400:00000200:15.0:1773851875.006420:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19747@kfi7 local destination
00000400:00000200:15.0:1773851875.006421:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769496:8769496:1024:4294967295] 19747@kfi7 LPNI seq info [7843534:7843534:16:4294967295]
00000400:00000200:15.0:1773851875.006422:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cd327d38 nid 19747@kfi7 refs 2
00000400:00000200:15.0:1773851875.006423:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19747@kfi7 to cpt 3
00000400:00000200:15.0:1773851875.006425:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19747@kfi7(19747@kfi7:19747@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851875.006426:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cd327d38 nid 19747@kfi7 refs 3
00000800:00000200:15.0:1773851875.006427:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851875.006428:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851875.006431:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851875.006434:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1194 Using peer 19747@kfi7(0x1194)
00000800:00000200:15.0:1773851875.006437:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x1194: rc=0
00000800:00000200:15.0:1773851875.006439:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1194 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851875.006441:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851875.006442:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009c369c39 refcount 2 to 19938@kfi7
00010000:00000001:15.0:1773851875.006442:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851875.006443:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.006444:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851875.006444:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fff080c2 x1858040884176384/t0(0) o400->c27b5593-58f4-47c0-8b51-57398d7251bd@19938@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1723-0'
00000100:00100000:15.0:1773851875.006447:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fff080c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c27b5593-58f4-47c0-8b51-57398d7251bd+12:39638:x1858040884176384:12345-19938@kfi7:400:default-tuolumne1723-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851875.006450:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19938@kfi7, seq: 2289862
00000100:00000040:15.0:1773851875.006451:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fb939624 : new rpc_count 0
00000100:00000001:15.0:1773851875.006451:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851875.006451:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1194 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851875.006452:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851875.006452:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851875.006453:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851875.006454:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000400:00000200:13.0:1773851875.006454:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19747@kfi7: PUT: OK
00000400:00000200:13.0:1773851875.006454:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050bc9375
00000020:00000010:15.0:1773851875.006455:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebe397c.
00000020:00000040:15.0:1773851875.006455:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000fb939624 : new refcount 11
00000400:00000010:13.0:1773851875.006455:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050bc9375.
00000100:00000001:13.0:1773851875.006455:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851875.006456:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851875.006456:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851875.006457:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cd327d38 nid 19747@kfi7 refs 2
00000800:00000200:13.0:1773851875.006458:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 19747@kfi7(00000000825c6047):0x0 lsk 4501 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1194 Transaction freed
00000800:00000200:10.0:1773851875.080636:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851875.080637:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851875.080638:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851875.080640:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851875.080643:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14817@kfi7 to cpt 2
00000400:00000200:10.0:1773851875.080644:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14817@kfi7 : PUT - for me
00000400:00000200:10.0:1773851875.080645:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14817@kfi7 to cpt 2
00000400:00000200:10.0:1773851875.080646:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088e5d7ad nid 14817@kfi7 refs 1
00000400:00000200:10.0:1773851875.080647:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14817@kfi7 to cpt 2
00000400:00000200:10.0:1773851875.080648:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088e5d7ad nid 14817@kfi7 refs 2
00000400:00000200:10.0:1773851875.080649:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000088e5d7ad nid 14817@kfi7 refs 3
00000400:00000200:10.0:1773851875.080650:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14816@kfi7 to cpt 7
00000400:00000200:10.0:1773851875.080651:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14816@kfi7 of length 224 into portal 12 MB=0x69b4bde60b0c0
00000400:00000200:10.0:1773851875.080652:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14816@kfi7 of length 224/224 into md 0x78146ce49 [64] + 142840
00000800:00000200:10.0:1773851875.080654:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851875.080655:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851875.080656:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14817@kfi7: PUT: OK
00000100:00000001:10.0:1773851875.080657:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851875.080658:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851875.080660:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e6dcf813.
00000100:00000040:10.0:1773851875.080661:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000e6dcf813 x1859600015995072 msgsize 224
00000100:00100000:10.0:1773851875.080662:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-14816@kfi7 (source: 12345-14817@kfi7)
00000100:00000001:10.0:1773851875.080663:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851875.080664:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000088e5d7ad nid 14817@kfi7 refs 2
00000100:00000001:8.0:1773851875.080665:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851875.080665:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851875.080666:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851875.080666:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851875.080666:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851875.080667:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851875.080668:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600015995072
00000020:00000001:8.0:1773851875.080669:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851875.080669:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eb8e
00000020:00000001:8.0:1773851875.080670:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851875.080675:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b95f86f refcount=1259
00000020:00000001:8.0:1773851875.080676:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959166629888 : -107114542921728 : ffff9e9473b80800)
00000020:00000001:8.0:1773851875.080676:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959166629888 : -107114542921728 : ffff9e9473b80800)
00000100:00000001:8.0:1773851875.080677:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851875.080679:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851875.080679:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebf0718.
00000020:00000010:8.0:1773851875.080681:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851875.080681:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851875.080682:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851875.080683:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851875.080683:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851875.080685:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851875.080685:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851875.080685:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.080686:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851875.080688:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851875.080688:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851875.080688:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851875.080688:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851875.080689:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14816@kfi7, seq: 2130801
00000100:00000001:11.0:1773851875.080690:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851875.080690:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b95f86f : new rpc_count 8
00000100:00000001:11.0:1773851875.080691:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.080691:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637143345336832 : -106930364214784 : ffff9ebf55a01200)
00000100:00000040:8.0:1773851875.080692:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e6dcf813 x1859600015995072/t0(0) o400->2e4690cb-9273-47ad-9caf-9a633dba768d@14816@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1407-0'
00000100:00000001:8.0:1773851875.080695:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851875.080695:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851875.080696:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6dcf813 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2e4690cb-9273-47ad-9caf-9a633dba768d+1259:39725:x1859600015995072:12345-14816@kfi7:400:default-tuolumne1407-0
00000100:00000200:8.0:1773851875.080697:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600015995072
00000020:00000001:8.0:1773851875.080698:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851875.080699:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851875.080699:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.080700:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851875.080701:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851875.080701:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851875.080702:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600015995072, found 0 last_xid 1859600015287103
00000020:00000001:8.0:1773851875.080703:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851875.080703:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851875.080704:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851875.080705:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.080706:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851875.080706:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851875.080707:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851875.080708:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007baf6cfa.
02000000:00000001:8.0:1773851875.080709:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.080709:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.080710:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851875.080711:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593674, transno 0, xid 1859600015995072
00010000:00000001:8.0:1773851875.080711:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851875.080712:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e6dcf813 x1859600015995072/t0(0) o400->2e4690cb-9273-47ad-9caf-9a633dba768d@14816@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1407-0'
00010000:00000001:8.0:1773851875.080715:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851875.080715:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851875.080716:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=108 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851875.080717:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851875.080718:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d828d9f5 refcount 3 to 14816@kfi7
00000100:00000001:8.0:1773851875.080718:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412881536 : -107156296670080 : ffff9e8abb006480)
02000000:00000001:8.0:1773851875.080719:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851875.080720:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.080720:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851875.080721:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14817@kfi7
00000400:00000010:8.0:1773851875.080722:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006188a4b8.
00000100:00000200:8.0:1773851875.080723:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600015995072, offset 224
00000400:00000200:8.0:1773851875.080727:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14817@kfi7
00000400:00000200:8.0:1773851875.080728:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14817@kfi7 to cpt 2
00000400:00000200:8.0:1773851875.080729:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088e5d7ad nid 14817@kfi7 refs 1
00000400:00000200:8.0:1773851875.080730:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000088e5d7ad nid 14817@kfi7 refs 2
00000400:00000200:8.0:1773851875.080731:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000088e5d7ad nid 14817@kfi7 refs 3
00000400:00000200:8.0:1773851875.080732:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14817@kfi7 local destination
00000400:00000200:8.0:1773851875.080733:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769497:8769497:1024:4294967295] 14817@kfi7 LPNI seq info [15965450:15965450:16:4294967295]
00000400:00000200:8.0:1773851875.080735:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000088e5d7ad nid 14817@kfi7 refs 2
00000400:00000200:8.0:1773851875.080735:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14817@kfi7 to cpt 2
00000400:00000200:8.0:1773851875.080737:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14817@kfi7(14817@kfi7:14817@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851875.080739:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000088e5d7ad nid 14817@kfi7 refs 3
00000800:00000200:8.0:1773851875.080740:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851875.080741:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851875.080744:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851875.080746:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0xac0 Using peer 14817@kfi7(0xac0)
00000800:00000200:8.0:1773851875.080749:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0xac0: rc=0
00000800:00000200:8.0:1773851875.080750:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0xac0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851875.080752:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851875.080753:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d828d9f5 refcount 2 to 14816@kfi7
00010000:00000001:8.0:1773851875.080754:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851875.080754:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.080755:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851875.080756:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e6dcf813 x1859600015995072/t0(0) o400->2e4690cb-9273-47ad-9caf-9a633dba768d@14816@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1407-0'
00000100:00100000:8.0:1773851875.080759:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6dcf813 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2e4690cb-9273-47ad-9caf-9a633dba768d+1259:39725:x1859600015995072:12345-14816@kfi7:400:default-tuolumne1407-0 Request processed in 63us (97us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851875.080762:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14816@kfi7, seq: 2130801
00000100:00000040:8.0:1773851875.080762:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b95f86f : new rpc_count 7
00000100:00000001:8.0:1773851875.080763:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851875.080764:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851875.080764:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851875.080765:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851875.080766:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebf0718.
00000020:00000040:8.0:1773851875.080766:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004b95f86f : new refcount 1258
00000100:00000001:8.0:1773851875.080767:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851875.080772:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0xac0 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851875.080773:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851875.080775:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14817@kfi7: PUT: OK
00000400:00000200:10.0:1773851875.080775:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006188a4b8
00000400:00000010:10.0:1773851875.080776:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006188a4b8.
00000100:00000001:10.0:1773851875.080777:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851875.080777:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851875.080778:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000088e5d7ad nid 14817@kfi7 refs 2
00000800:00000200:10.0:1773851875.080780:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 14817@kfi7(00000000f4bcbdd2):0x0 lsk 2753 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0xac0 Transaction freed
00000004:00000001:6.0:1773851875.145730:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851875.145731:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851875.145731:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000562ee10a.
00000004:00000001:8.0:1773851875.145732:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:6.0:1773851875.145732:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000004:00000001:4.0:1773851875.145732:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851875.145733:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851875.145733:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:6.0:1773851875.145733:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:4.0:1773851875.145733:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851875.145734:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851875.145734:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851875.145734:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000098ed735f.
02000000:00000001:6.0:1773851875.145734:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851875.145734:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851875.145734:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:28.0:1773851875.145735:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000060641ae9.
00000020:00000040:8.0:1773851875.145735:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
02000000:00000010:6.0:1773851875.145735:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d8277e2a.
00000100:00000010:4.0:1773851875.145735:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004ab341b7.
00000004:00000020:0.0:1773851875.145735:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:29.0:1773851875.145736:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:28.0:1773851875.145736:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000100:00000001:8.0:1773851875.145736:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851875.145736:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851875.145736:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:4.0:1773851875.145736:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000100:00000010:29.0:1773851875.145737:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ddd02f81.
02000000:00000001:8.0:1773851875.145737:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851875.145737:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851875.145737:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.145737:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:0.0:1773851875.145737:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000096b8a0b5.
00000100:00000001:28.0:1773851875.145738:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851875.145738:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:8.0:1773851875.145738:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000040:6.0:1773851875.145738:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000562ee10a] to pc [ptlrpcd_01_02+2]  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851875.145738:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:0.0:1773851875.145738:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000020:00000040:29.0:1773851875.145739:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:8.0:1773851875.145739:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851875.145739:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851875.145740:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.145740:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:0.0:1773851875.145740:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851875.145741:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:28.0:1773851875.145741:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000053e4c7dc.
00000100:00000001:8.0:1773851875.145741:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851875.145741:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851875.145742:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:8.0:1773851875.145742:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000098ed735f] to pc [ptlrpcd_02_03+3]  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:4.0:1773851875.145742:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000030ba13a7.
02000000:00000001:29.0:1773851875.145743:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851875.145743:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851875.145743:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851875.145743:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851875.145743:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851875.145744:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851875.145744:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851875.145744:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:6.0:1773851875.145744:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e88ad709.
00080000:00000001:6.0:1773851875.145744:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637098985843712 : -106974723707904 : ffff9eb50197ec00)
02000000:00000010:29.0:1773851875.145745:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
00000100:00000001:28.0:1773851875.145745:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145745:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:7.0:1773851875.145745:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851875.145745:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851875.145745:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:0.0:1773851875.145745:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a3c61f33.
00000100:00000040:28.0:1773851875.145746:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000060641ae9] to pc [ptlrpcd_07_02+2]  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851875.145746:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:6.0:1773851875.145746:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.145746:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851875.145746:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.145746:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851875.145747:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145747:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851875.145747:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851875.145747:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851875.145747:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c2e34087.
00000004:00001000:6.0:1773851875.145747:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00000004:00000010:6.0:1773851875.145747:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ad01df44.
00000100:00000040:4.0:1773851875.145747:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004ab341b7] to pc [ptlrpcd_01_03+3]  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851875.145747:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145748:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851875.145748:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851875.145748:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637149464688640 : -106924244862976 : ffff9ec0c25df800)
00000100:00000001:7.0:1773851875.145748:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851875.145748:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851875.145748:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614149599023609ns, next at 614150599022757ns, rc = 0
00000100:00000001:0.0:1773851875.145748:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851875.145749:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:10.0:1773851875.145749:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851875.145749:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:7.0:1773851875.145749:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:6.0:1773851875.145749:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:29.0:1773851875.145750:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851875.145750:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:8.0:1773851875.145750:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
02000000:00000001:7.0:1773851875.145750:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851875.145750:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851875.145750:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851875.145751:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00100000:7.0:1773851875.145751:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000562ee10a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051931456:46@kfi7:13:default-yuba2-0
00000004:00000001:6.0:1773851875.145751:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145752:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851875.145752:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:29.0:1773851875.145752:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ddd02f81] to pc [ptlrpcd_07_03+3]  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:28.0:1773851875.145752:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000711cbf99.
00000100:00000001:10.0:1773851875.145752:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851875.145752:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851875.145752:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f536672e.
00000004:00080000:8.0:1773851875.145752:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614149599028067ns, next at 614150599026595ns, rc = 0
00000100:00000001:7.0:1773851875.145752:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:0.0:1773851875.145752:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000096b8a0b5] to pc [ptlrpcd_00_00+0]  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:31.0:1773851875.145753:0:41091:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:30.0:1773851875.145753:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851875.145753:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637102070620160 : -106971638931456 : ffff9eb5b975e000)
02000000:00000001:10.0:1773851875.145753:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851875.145753:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851875.145753:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145754:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:28.0:1773851875.145754:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:10.0:1773851875.145754:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851875.145754:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851875.145754:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:4.0:1773851875.145754:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851875.145755:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851875.145755:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:28.0:1773851875.145755:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851875.145755:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000100:00100000:10.0:1773851875.145755:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098ed735f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051931520:2055@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851875.145755:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851875.145755:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851875.145755:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007ec590c0.
02000000:00000001:7.0:1773851875.145755:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:4.0:1773851875.145755:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000156f202f.
00000100:00000001:31.0:1773851875.145756:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851875.145756:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851875.145756:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:7.0:1773851875.145756:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:5.0:1773851875.145756:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:4.0:1773851875.145756:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637001105145856 : -107072604405760 : ffff9e9e37730000)
00000100:00000001:31.0:1773851875.145757:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:28.0:1773851875.145757:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000283de301.
02000000:00000001:10.0:1773851875.145757:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851875.145757:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851875.145757:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000100:00000001:5.0:1773851875.145757:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:31.0:1773851875.145758:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:28.0:1773851875.145758:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614149599033177ns, next at 614150599032185ns, rc = 0
02000000:00000001:10.0:1773851875.145758:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:7.0:1773851875.145758:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000100:00000001:5.0:1773851875.145758:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:4.0:1773851875.145758:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851875.145759:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000200:7.0:1773851875.145759:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931456, portal 4
00000100:00000001:7.0:1773851875.145759:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:5.0:1773851875.145759:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:4.0:1773851875.145759:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145760:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:28.0:1773851875.145760:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851875.145760:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851875.145760:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a5c4dee8.
02000000:00000001:10.0:1773851875.145760:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145760:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814066944 : -107101895484672 : ffff9e9765909b00)
00000004:00001000:4.0:1773851875.145760:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000004:00000001:0.0:1773851875.145760:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145761:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851875.145761:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851875.145761:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:31.0:1773851875.145762:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:10.0:1773851875.145762:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000004:00000010:4.0:1773851875.145762:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008c443911.
00000100:00000001:2.0:1773851875.145762:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851875.145762:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:31.0:1773851875.145763:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851875.145763:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000060641ae9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051931584:2065@kfi7:13:default-yuba2-0
00000400:00000010:10.0:1773851875.145763:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000100:00000001:7.0:1773851875.145763:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000004:00080000:4.0:1773851875.145763:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614149599038587ns, next at 614150599036924ns, rc = 0
00000100:00000001:1.0:1773851875.145763:0:41060:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000001:29.0:1773851875.145764:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851875.145764:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000040:7.0:1773851875.145764:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000100:00000001:5.0:1773851875.145764:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851875.145764:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851875.145764:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851875.145765:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851875.145765:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:10.0:1773851875.145765:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931520, portal 4
00000400:00000010:7.0:1773851875.145765:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a17c530.
00000100:00000200:7.0:1773851875.145765:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931456, offset 0
00000100:00000001:5.0:1773851875.145765:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851875.145765:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851875.145766:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851875.145766:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851875.145766:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851875.145766:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491274752 : -107117218276864 : ffff9e93d4415a00)
00080000:00000001:4.0:1773851875.145766:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851875.145767:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:31.0:1773851875.145767:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000064503462.
00000100:00100000:30.0:1773851875.145767:0:41090:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000400:00000200:7.0:1773851875.145767:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
02000000:00000001:5.0:1773851875.145767:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:5.0:1773851875.145767:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851875.145767:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851875.145767:0:41060:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:1.0:1773851875.145767:0:41060:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851875.145768:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851875.145768:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:10.0:1773851875.145768:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851875.145768:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
02000000:00000001:1.0:1773851875.145768:0:41060:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:31.0:1773851875.145769:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:7.0:1773851875.145769:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00100000:5.0:1773851875.145769:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004ab341b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051931648:2085@kfi7:13:default-yuba2-0
02000000:00000001:1.0:1773851875.145769:0:41060:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851875.145770:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000100:00000001:30.0:1773851875.145770:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851875.145770:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851875.145770:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00100000:1.0:1773851875.145770:0:41060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000096b8a0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051931712:2057@kfi7:13:default-yuba2-0
00000400:00000010:31.0:1773851875.145771:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025a37126.
00000100:00000001:30.0:1773851875.145771:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:10.0:1773851875.145771:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000200:7.0:1773851875.145771:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000200:31.0:1773851875.145772:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931584, portal 4
00000100:00000001:30.0:1773851875.145772:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851875.145772:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:10.0:1773851875.145772:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fc91e347.
00000100:00000200:10.0:1773851875.145772:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931520, offset 0
00000400:00000200:7.0:1773851875.145772:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000100:00000001:5.0:1773851875.145772:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:1.0:1773851875.145772:0:41060:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:1.0:1773851875.145772:0:41060:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:31.0:1773851875.145773:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851875.145773:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324227840 : -106976385323776 : ffff9eb49e8dad00)
00000100:00000001:30.0:1773851875.145773:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:7.0:1773851875.145773:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769497, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769495, p:4294967295, g:4294967295, h:1000]
02000000:00000001:5.0:1773851875.145773:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:1.0:1773851875.145773:0:41060:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851875.145773:0:41060:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:31.0:1773851875.145774:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851875.145774:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
02000000:00000001:5.0:1773851875.145774:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851875.145775:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851875.145775:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851875.145775:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
02000000:00000001:5.0:1773851875.145775:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:1.0:1773851875.145775:0:41060:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e468cca7.
02000000:00000001:1.0:1773851875.145775:0:41060:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851875.145776:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:7.0:1773851875.145776:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
02000000:00000010:5.0:1773851875.145776:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e74fa322.
00000400:00000200:1.0:1773851875.145776:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:31.0:1773851875.145777:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851875.145777:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:7.0:1773851875.145777:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
02000000:00000001:5.0:1773851875.145777:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:1.0:1773851875.145777:0:41060:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001712706d.
00000100:00000040:31.0:1773851875.145778:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000010:31.0:1773851875.145778:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001af55591.
00000400:00000200:10.0:1773851875.145778:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:7.0:1773851875.145778:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769498:8769498:1024:4294967295] 46@kfi7 LPNI seq info [5403859:5403859:16:4294967295]
00000400:00000010:1.0:1773851875.145778:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f34118dd.
00000100:00000200:31.0:1773851875.145779:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931584, offset 0
00000100:00000001:30.0:1773851875.145780:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000200:10.0:1773851875.145780:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000100:00000200:1.0:1773851875.145780:0:41060:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931712, portal 4
00000100:00000001:1.0:1773851875.145780:0:41060:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:31.0:1773851875.145781:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000100:00000001:30.0:1773851875.145781:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851875.145781:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769497, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769498, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851875.145781:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:1.0:1773851875.145781:0:41060:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203080576 : -107102506471040 : ffff9e974125b180)
00000400:00000200:31.0:1773851875.145782:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
02000000:00000001:30.0:1773851875.145782:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:7.0:1773851875.145782:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:1.0:1773851875.145782:0:41060:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851875.145783:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
02000000:00000001:30.0:1773851875.145783:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851875.145783:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:5.0:1773851875.145783:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:31.0:1773851875.145784:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:10.0:1773851875.145784:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000010:5.0:1773851875.145784:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000984a9f71.
00000400:00000200:31.0:1773851875.145785:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00100000:30.0:1773851875.145785:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ddd02f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051931776:2056@kfi7:13:default-yuba2-0
00000400:00000200:10.0:1773851875.145785:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000010:5.0:1773851875.145785:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
00000100:00000001:1.0:1773851875.145785:0:41060:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851875.145786:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769499:8769499:1024:4294967295] 2055@kfi7 LPNI seq info [5404671:5404671:16:4294967295]
00000100:00000040:1.0:1773851875.145786:0:41060:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000010:1.0:1773851875.145786:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c31a0ef.
00000400:00000200:31.0:1773851875.145787:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000100:00000001:30.0:1773851875.145787:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000200:5.0:1773851875.145787:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931648, portal 4
00000100:00000200:1.0:1773851875.145787:0:41060:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931712, offset 0
02000000:00000001:30.0:1773851875.145788:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:10.0:1773851875.145788:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:10.0:1773851875.145788:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:5.0:1773851875.145788:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:1.0:1773851875.145788:0:41060:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:31.0:1773851875.145789:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769499, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769498, p:4294967295, g:4294967295, h:1000]
02000000:00000001:30.0:1773851875.145789:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.145789:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528707584 : -106978180844032 : ffff9eb433883600)
00000400:00000200:1.0:1773851875.145789:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
02000000:00000001:30.0:1773851875.145790:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:1.0:1773851875.145790:0:41060:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:31.0:1773851875.145791:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851875.145791:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:5.0:1773851875.145791:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851875.145791:0:41060:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851875.145792:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
02000000:00000010:30.0:1773851875.145792:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004219deee.
00000400:00000200:10.0:1773851875.145792:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851875.145792:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
02000000:00000001:30.0:1773851875.145793:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851875.145793:0:41060:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:31.0:1773851875.145794:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769500:8769500:1023:4294967295] 2065@kfi7 LPNI seq info [5402830:5402830:16:4294967295]
00000400:00000200:10.0:1773851875.145794:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:7.0:1773851875.145794:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:1.0:1773851875.145794:0:41060:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:31.0:1773851875.145795:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:31.0:1773851875.145796:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:10.0:1773851875.145796:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:7.0:1773851875.145796:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:5.0:1773851875.145796:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:1.0:1773851875.145796:0:41060:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769499, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769500, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851875.145797:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:5.0:1773851875.145797:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000200:30.0:1773851875.145798:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:10.0:1773851875.145798:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:5.0:1773851875.145798:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000400:00000200:1.0:1773851875.145798:0:41060:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851875.145799:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000400:00000010:30.0:1773851875.145799:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000200:5.0:1773851875.145799:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931648, offset 0
00000400:00000200:1.0:1773851875.145799:0:41060:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:10.0:1773851875.145800:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851875.145800:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:1.0:1773851875.145800:0:41060:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:31.0:1773851875.145801:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000010:30.0:1773851875.145801:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000400:00000200:1.0:1773851875.145801:0:41060:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769501:8769501:1023:4294967295] 2057@kfi7 LPNI seq info [5404108:5404108:16:4294967295]
00000400:00000200:5.0:1773851875.145802:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000800:00000200:31.0:1773851875.145803:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000200:30.0:1773851875.145803:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931776, portal 4
00000800:00000200:10.0:1773851875.145803:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Using peer 2055@kfi7(0x2f3)
00000800:00000200:7.0:1773851875.145803:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de Using peer 46@kfi7(0x2000000000003de)
00000400:00000200:5.0:1773851875.145803:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851875.145803:0:41060:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:31.0:1773851875.145804:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:30.0:1773851875.145804:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:1.0:1773851875.145804:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:30.0:1773851875.145805:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637091507210496 : -106982202341120 : ffff9eb343d50900)
00000400:00000200:5.0:1773851875.145805:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000800:00000200:31.0:1773851875.145806:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851875.145806:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x2000000000003de: rc=0
00000100:00000040:30.0:1773851875.145807:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:10.0:1773851875.145807:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000333a7eb2: Posted send of 324 bytes to peer 0x2f3: rc=0
00000400:00000200:5.0:1773851875.145807:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:7.0:1773851875.145808:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:1.0:1773851875.145808:0:41060:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000800:00000200:31.0:1773851875.145809:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000800:00000200:10.0:1773851875.145809:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851875.145809:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851875.145809:0:41060:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000100:00000001:10.0:1773851875.145810:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145811:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851875.145811:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000800:00000200:1.0:1773851875.145811:0:41060:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:31.0:1773851875.145812:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000100:00000001:30.0:1773851875.145812:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:10.0:1773851875.145812:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145812:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851875.145812:0:41060:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:30.0:1773851875.145813:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000100:00000001:10.0:1773851875.145813:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851875.145813:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769501, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769500, p:4294967295, g:4294967295, h:1000]
00000800:00000200:31.0:1773851875.145814:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000010:30.0:1773851875.145814:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000086dda7f0.
00000800:00000200:1.0:1773851875.145814:0:41060:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:30.0:1773851875.145815:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931776, offset 0
00000100:00000001:10.0:1773851875.145815:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851875.145815:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851875.145816:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145816:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851875.145817:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851875.145817:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145817:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851875.145817:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145817:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851875.145817:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:1.0:1773851875.145817:0:41060:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000100:00000001:31.0:1773851875.145818:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851875.145818:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000100:00000001:7.0:1773851875.145818:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851875.145818:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851875.145819:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145819:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851875.145819:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:1.0:1773851875.145819:0:41060:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 324 bytes to peer 0x295: rc=0
00000100:00000001:31.0:1773851875.145820:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851875.145820:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851875.145820:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:9.0:1773851875.145820:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851875.145820:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851875.145820:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000100:00000001:31.0:1773851875.145821:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145821:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145821:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851875.145821:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769502:8769502:1022:4294967295] 2085@kfi7 LPNI seq info [5403241:5403241:16:4294967295]
00000800:00000200:1.0:1773851875.145821:0:41060:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851875.145822:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:9.0:1773851875.145822:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851875.145822:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851875.145823:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:7.0:1773851875.145823:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851875.145823:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:1.0:1773851875.145823:0:41060:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851875.145823:0:41060:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851875.145824:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:9.0:1773851875.145824:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fc91e347
00000400:00000010:9.0:1773851875.145824:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fc91e347.
00000100:00000001:7.0:1773851875.145824:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:6.0:1773851875.145824:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851875.145824:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:1.0:1773851875.145824:0:41060:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851875.145825:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:7.0:1773851875.145825:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851875.145825:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851875.145825:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000100:00000001:1.0:1773851875.145825:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851875.145826:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000200:9.0:1773851875.145826:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851875.145826:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851875.145826:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a17c530
00000400:00000010:6.0:1773851875.145826:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a17c530.
00000400:00000200:5.0:1773851875.145826:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:1.0:1773851875.145826:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851875.145827:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851875.145827:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:1.0:1773851875.145827:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851875.145827:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:30.0:1773851875.145828:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000100:00000200:6.0:1773851875.145828:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851875.145828:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851875.145829:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851875.145829:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000100:00000001:1.0:1773851875.145829:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851875.145829:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851875.145830:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851875.145830:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:1.0:1773851875.145830:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851875.145831:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769501, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8769502, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851875.145831:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:6.0:1773851875.145831:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851875.145832:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851875.145832:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:29.0:1773851875.145833:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000001:9.0:1773851875.145833:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851875.145834:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851875.145834:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001af55591
00000400:00000200:9.0:1773851875.145834:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:6.0:1773851875.145834:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851875.145834:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:5.0:1773851875.145834:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000010:29.0:1773851875.145835:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001af55591.
00000400:00000200:6.0:1773851875.145835:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:30.0:1773851875.145836:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:29.0:1773851875.145836:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:9.0:1773851875.145836:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Transaction freed
00000800:00000200:5.0:1773851875.145836:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851875.145836:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851875.145837:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000100:00000200:29.0:1773851875.145837:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851875.145837:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003de Transaction freed
00000400:00000200:1.0:1773851875.145837:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851875.145839:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769503:8769503:1023:4294967295] 2056@kfi7 LPNI seq info [5402401:5402401:16:4294967295]
00000400:00000200:1.0:1773851875.145839:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000800:00000200:5.0:1773851875.145840:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:1.0:1773851875.145840:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c31a0ef
00000400:00000010:1.0:1773851875.145840:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c31a0ef.
00000100:00000001:1.0:1773851875.145841:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:30.0:1773851875.145842:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:29.0:1773851875.145842:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:1.0:1773851875.145842:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851875.145843:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000040:29.0:1773851875.145844:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851875.145844:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Using peer 2085@kfi7(0x200000000000110)
00000100:00000001:1.0:1773851875.145845:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:1.0:1773851875.145846:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851875.145848:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000100:00000001:29.0:1773851875.145848:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851875.145849:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:5.0:1773851875.145849:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000cd4ef01e: Posted send of 324 bytes to peer 0x200000000000110: rc=0
00000100:00000001:1.0:1773851875.145849:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851875.145850:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000001:1.0:1773851875.145850:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851875.145851:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:1.0:1773851875.145851:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:5.0:1773851875.145852:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851875.145853:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:1.0:1773851875.145853:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000800:00000200:29.0:1773851875.145854:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Transaction freed
00000800:00000200:30.0:1773851875.145855:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:5.0:1773851875.145855:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.145856:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:22.0:1773851875.145857:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000100:00000001:5.0:1773851875.145857:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851875.145858:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:5.0:1773851875.145858:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.145859:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851875.145860:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:22.0:1773851875.145860:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851875.145861:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851875.145861:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:22.0:1773851875.145862:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:6.0:1773851875.145862:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851875.145863:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851875.145863:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:22.0:1773851875.145864:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:6.0:1773851875.145864:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851875.145864:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851875.145865:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Using peer 2056@kfi7(0x204)
00000400:00000200:6.0:1773851875.145865:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000001:5.0:1773851875.145865:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851875.145866:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:6.0:1773851875.145866:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:6.0:1773851875.145866:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000400:00000200:22.0:1773851875.145867:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851875.145867:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000100:00000001:6.0:1773851875.145867:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:22.0:1773851875.145868:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000200:6.0:1773851875.145868:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:22.0:1773851875.145869:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:22.0:1773851875.145870:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:30.0:1773851875.145871:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b68a0a1e: Posted send of 324 bytes to peer 0x204: rc=0
00000400:00000200:22.0:1773851875.145871:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:6.0:1773851875.145871:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:22.0:1773851875.145872:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4380
00000100:00000040:6.0:1773851875.145872:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851875.145873:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851875.145873:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851875.145874:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d1175 [1] + 224
00000100:00000001:6.0:1773851875.145874:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851875.145875:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:22.0:1773851875.145876:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851875.145876:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:30.0:1773851875.145877:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851875.145877:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cd4ef01e: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Transaction freed
00000100:00000001:30.0:1773851875.145878:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:22.0:1773851875.145878:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851875.145879:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851875.145879:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:22.0:1773851875.145880:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851875.145881:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:22.0:1773851875.145881:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851875.145882:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851875.145884:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_EVENT_TX_OK event status 0
00000100:00000040:22.0:1773851875.145884:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:14.0:1773851875.145884:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:9.0:1773851875.145884:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:14.0:1773851875.145885:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851875.145885:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:31.0:1773851875.145886:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:18.0:1773851875.145886:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:31.0:1773851875.145887:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000800:00000200:18.0:1773851875.145887:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851875.145887:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851875.145887:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851875.145888:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000086dda7f0
00000100:00000001:22.0:1773851875.145888:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:31.0:1773851875.145889:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000086dda7f0.
00000100:00000001:31.0:1773851875.145889:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:22.0:1773851875.145889:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:18.0:1773851875.145889:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851875.145889:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851875.145889:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:31.0:1773851875.145890:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851875.145890:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:22.0:1773851875.145891:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000800:00000200:18.0:1773851875.145891:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851875.145891:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:10.0:1773851875.145891:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851875.145891:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:14.0:1773851875.145892:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000001:10.0:1773851875.145892:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851875.145892:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851875.145893:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:14.0:1773851875.145893:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000010:10.0:1773851875.145893:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:9.0:1773851875.145893:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 46@kfi7 : PUT - for me
00000100:00000040:31.0:1773851875.145894:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:18.0:1773851875.145894:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:14.0:1773851875.145894:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:10.0:1773851875.145894:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851875.145895:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851875.145895:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851875.145895:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:18.0:1773851875.145896:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:14.0:1773851875.145896:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000200:10.0:1773851875.145896:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851875.145897:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145897:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:18.0:1773851875.145897:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:14.0:1773851875.145897:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:9.0:1773851875.145897:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:18.0:1773851875.145898:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:14.0:1773851875.145898:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:9.0:1773851875.145898:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:31.0:1773851875.145899:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000200:10.0:1773851875.145899:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851875.145899:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:31.0:1773851875.145900:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Transaction freed
00000400:00000200:18.0:1773851875.145900:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:14.0:1773851875.145900:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851875.145900:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:18.0:1773851875.145901:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:14.0:1773851875.145901:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4440
00000400:00000200:9.0:1773851875.145901:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:18.0:1773851875.145902:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:14.0:1773851875.145902:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:10.0:1773851875.145902:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851875.145902:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851875.145902:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4340
00000400:00000200:18.0:1773851875.145903:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:10.0:1773851875.145903:0:41071:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:18.0:1773851875.145904:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b43c0
00000400:00000200:14.0:1773851875.145904:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f65ed [1] + 224
02000000:00000001:10.0:1773851875.145904:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851875.145904:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851875.145904:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:18.0:1773851875.145905:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:10.0:1773851875.145905:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851875.145905:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851875.145905:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781697e89 [1] + 224
00000400:00000200:18.0:1773851875.145907:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f1611 [1] + 224
00000800:00000200:14.0:1773851875.145907:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:10.0:1773851875.145907:0:41071:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=108 v=66 (66 66 66 66)
00000800:00000200:9.0:1773851875.145907:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851875.145908:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00001000:10.0:1773851875.145908:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=108 v=66 (1 1 1 1)
00000800:00000200:18.0:1773851875.145909:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851875.145909:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851875.145909:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851875.145909:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851875.145910:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00010000:00000001:10.0:1773851875.145910:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:18.0:1773851875.145911:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851875.145911:0:2514739:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:10.0:1773851875.145911:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851875.145911:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000400:00000200:18.0:1773851875.145912:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000001:10.0:1773851875.145912:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851875.145912:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:9.0:1773851875.145912:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:18.0:1773851875.145913:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:14.0:1773851875.145913:0:2514739:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851875.145913:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851875.145913:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851875.145913:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851875.145914:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:18.0:1773851875.145915:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:14.0:1773851875.145916:0:2514739:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851875.145916:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851875.145917:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:1.0:1773851875.145917:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00000040:18.0:1773851875.145918:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851875.145918:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851875.145918:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851875.145918:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000004:00000001:10.0:1773851875.145919:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000800:00000200:1.0:1773851875.145919:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:14.0:1773851875.145920:0:2514739:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:10.0:1773851875.145920:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851875.145920:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382747136 avail=351380685824 avail_mb=1372580804 hwm_mb=3131101 files=371978698 ffree=343147214 state=0: rc = 0
00000100:00000001:9.0:1773851875.145920:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851875.145921:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:1.0:1773851875.145921:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:18.0:1773851875.145922:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:18.0:1773851875.145922:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:14.0:1773851875.145922:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:7.0:1773851875.145922:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851875.145922:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:14.0:1773851875.145923:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000004:00000020:10.0:1773851875.145923:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382747136 free, 351380685824 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978698 files, 343147214 free files
00000800:00000200:9.0:1773851875.145923:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:7.0:1773851875.145923:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:31.0:1773851875.145924:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851875.145924:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:18.0:1773851875.145924:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000004:00000001:10.0:1773851875.145924:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:7.0:1773851875.145924:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851875.145924:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000100:00000001:3.0:1773851875.145924:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:1.0:1773851875.145924:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000001:31.0:1773851875.145925:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851875.145925:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:10.0:1773851875.145925:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:7.0:1773851875.145925:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000100:00000001:3.0:1773851875.145925:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851875.145925:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000010:31.0:1773851875.145926:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000d4d0e69a.
00000400:00000010:7.0:1773851875.145926:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000100:00000001:7.0:1773851875.145926:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851875.145926:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:1.0:1773851875.145926:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:31.0:1773851875.145927:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025a37126
00000400:00000010:31.0:1773851875.145927:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025a37126.
00000100:00000200:7.0:1773851875.145927:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:3.0:1773851875.145927:0:41060:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:1.0:1773851875.145927:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:31.0:1773851875.145928:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00100000:10.0:1773851875.145928:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098ed735f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051931520:2055@kfi7:13:default-yuba2-0
00000400:00000001:3.0:1773851875.145928:0:41060:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:1.0:1773851875.145928:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000200:31.0:1773851875.145929:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851875.145929:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000010:3.0:1773851875.145929:0:41060:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001712706d.
00000400:00000200:1.0:1773851875.145929:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000001:10.0:1773851875.145930:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851875.145930:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:3.0:1773851875.145930:0:41060:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f34118dd
00000400:00000200:1.0:1773851875.145930:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:10.0:1773851875.145931:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851875.145931:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000098ed735f x1859433051931520/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:7.0:1773851875.145931:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851875.145931:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:3.0:1773851875.145931:0:41060:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f34118dd.
00000400:00000200:1.0:1773851875.145931:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4480
00000100:00000200:31.0:1773851875.145932:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851875.145932:0:41060:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851875.145932:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:7.0:1773851875.145933:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:6.0:1773851875.145933:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851875.145934:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851875.145934:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851875.145934:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851875.145934:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851875.145934:0:41066:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:3.0:1773851875.145934:0:41060:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851875.145934:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71da61 [1] + 224
00000100:00000001:31.0:1773851875.145935:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:10.0:1773851875.145935:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a5c4dee8.
02000000:00000001:7.0:1773851875.145935:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851875.145935:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:6.0:1773851875.145935:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851875.145936:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851875.145936:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851875.145936:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851875.145936:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851875.145936:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851875.145937:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851875.145937:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:7.0:1773851875.145937:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851875.145937:0:41066:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=108 v=66 (66 66 66 66)
00000400:00000200:6.0:1773851875.145937:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2085@kfi7 : PUT - for me
00000400:00000200:1.0:1773851875.145937:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:31.0:1773851875.145938:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851875.145938:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=108 v=66 (66 66 66 66)
00000020:00000001:10.0:1773851875.145938:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851875.145938:0:41071:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000400:00000200:6.0:1773851875.145938:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:6.0:1773851875.145938:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000020:00000001:10.0:1773851875.145939:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:7.0:1773851875.145939:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=108 v=66 (1 1 1 1)
00000400:00000200:6.0:1773851875.145939:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000200:3.0:1773851875.145939:0:41060:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851875.145939:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000100:00001000:31.0:1773851875.145940:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=108 v=66 (1 1 1 1)
02000000:00000010:10.0:1773851875.145940:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:7.0:1773851875.145940:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851875.145940:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851875.145940:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:1.0:1773851875.145940:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851875.145941:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851875.145941:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851875.145941:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851875.145941:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00010000:00000001:7.0:1773851875.145941:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:6.0:1773851875.145941:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000200:1.0:1773851875.145941:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:31.0:1773851875.145942:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000010:10.0:1773851875.145942:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098ed735f.
00010000:00000001:7.0:1773851875.145942:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851875.145942:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00010000:00000001:31.0:1773851875.145943:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145943:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:10.0:1773851875.145943:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851875.145943:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851875.145943:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000001:7.0:1773851875.145943:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:6.0:1773851875.145943:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4400
00000100:00000001:3.0:1773851875.145943:0:41060:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:31.0:1773851875.145944:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000001:10.0:1773851875.145944:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851875.145944:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851875.145944:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851875.145944:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:3.0:1773851875.145944:0:41060:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:1.0:1773851875.145944:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851875.145945:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851875.145945:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145945:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:7.0:1773851875.145945:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:6.0:1773851875.145945:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b31345 [1] + 224
00000100:00000001:3.0:1773851875.145945:0:41060:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:31.0:1773851875.145946:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851875.145946:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851875.145946:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:3.0:1773851875.145946:0:41060:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:3.0:1773851875.145946:0:41060:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851875.145947:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145947:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:6.0:1773851875.145947:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:3.0:1773851875.145947:0:41060:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145948:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851875.145948:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851875.145948:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851875.145948:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851875.145949:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:7.0:1773851875.145949:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:3.0:1773851875.145949:0:41060:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851875.145949:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:31.0:1773851875.145950:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851875.145950:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:7.0:1773851875.145950:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851875.145950:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489062912 avail=351485961216 avail_mb=1372992036 hwm_mb=3131103 files=372066805 ffree=343251038 state=0: rc = 0
00000400:00000200:6.0:1773851875.145950:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00001000:3.0:1773851875.145950:0:41060:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=108 v=66 (66 66 66 66)
00000800:00000200:1.0:1773851875.145950:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000004:00000001:31.0:1773851875.145951:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851875.145951:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000100:00000001:30.0:1773851875.145951:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851875.145951:0:2499722:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:6.0:1773851875.145951:0:2499722:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:31.0:1773851875.145952:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464067072 avail=351458185216 avail_mb=1372883536 hwm_mb=3131101 files=372064787 ffree=343226628 state=0: rc = 0
00000100:00000001:30.0:1773851875.145952:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000020:7.0:1773851875.145952:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489062912 free, 351485961216 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066805 files, 343251038 free files
00000100:00001000:3.0:1773851875.145952:0:41060:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=108 v=66 (1 1 1 1)
00000004:00000020:31.0:1773851875.145954:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464067072 free, 351458185216 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064787 files, 343226628 free files
00000400:00000001:30.0:1773851875.145954:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851875.145954:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000001:7.0:1773851875.145954:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851875.145954:0:2499722:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851875.145954:0:41060:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:31.0:1773851875.145955:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851875.145955:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:3.0:1773851875.145955:0:41060:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851875.145956:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:30.0:1773851875.145956:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851875.145956:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00010000:00000001:3.0:1773851875.145956:0:41060:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:30.0:1773851875.145957:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00010000:00000001:3.0:1773851875.145957:0:41060:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851875.145958:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851875.145958:0:2499722:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:6.0:1773851875.145958:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00100000:31.0:1773851875.145959:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000060641ae9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051931584:2065@kfi7:13:default-yuba2-0
00000100:00000001:3.0:1773851875.145959:0:41060:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:3.0:1773851875.145959:0:41060:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00000200:30.0:1773851875.145960:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:7.0:1773851875.145960:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000562ee10a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051931456:46@kfi7:13:default-yuba2-0
00000800:00000200:6.0:1773851875.145960:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851875.145960:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:3.0:1773851875.145960:0:41060:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851875.145961:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851875.145961:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:3.0:1773851875.145961:0:41060:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.145962:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851875.145962:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:5.0:1773851875.145962:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851875.145962:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:3.0:1773851875.145962:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851875.145963:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000060641ae9 x1859433051931584/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851875.145963:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:5.0:1773851875.145963:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000984a9f71.
00000100:00000040:7.0:1773851875.145964:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000562ee10a x1859433051931456/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851875.145964:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00000100:00000001:31.0:1773851875.145965:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:30.0:1773851875.145965:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:5.0:1773851875.145965:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
02000000:00000001:31.0:1773851875.145966:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851875.145966:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000064503462.
00000100:00000001:7.0:1773851875.145966:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:5.0:1773851875.145966:0:41067:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:31.0:1773851875.145967:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:7.0:1773851875.145967:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851875.145967:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007ec590c0.
00000100:00000001:3.0:1773851875.145967:0:41060:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:31.0:1773851875.145968:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851875.145968:0:41091:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000100:00000200:5.0:1773851875.145968:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851875.145968:0:41060:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000020:00000001:31.0:1773851875.145969:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851875.145969:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000053e4c7dc.
00000100:00000001:30.0:1773851875.145969:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:7.0:1773851875.145969:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851875.145969:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:3.0:1773851875.145969:0:41060:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851875.145970:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:30.0:1773851875.145970:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:7.0:1773851875.145970:0:41066:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000020:00000001:7.0:1773851875.145970:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000001:3.0:1773851875.145970:0:41060:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:31.0:1773851875.145971:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:30.0:1773851875.145971:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000010:7.0:1773851875.145971:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d8277e2a.
00000004:00000040:3.0:1773851875.145971:0:41060:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000100:00000010:31.0:1773851875.145972:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000060641ae9.
02000000:00000001:30.0:1773851875.145972:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:7.0:1773851875.145972:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851875.145972:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:31.0:1773851875.145973:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851875.145973:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851875.145973:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000010:7.0:1773851875.145973:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000562ee10a.
00000100:00000200:5.0:1773851875.145973:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:3.0:1773851875.145973:0:41060:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406563328 avail=351404190720 avail_mb=1372672620 hwm_mb=3131103 files=372127257 ffree=343170472 state=0: rc = 0
00000100:00000001:31.0:1773851875.145974:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851875.145974:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145974:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851875.145974:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851875.145975:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851875.145975:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851875.145975:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.145975:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851875.145976:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851875.145976:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851875.145976:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:3.0:1773851875.145976:0:41060:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406563328 free, 351404190720 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127257 files, 343170472 free files
00000100:00000001:31.0:1773851875.145977:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851875.145977:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=108 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851875.145977:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851875.145977:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851875.145978:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.145978:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:3.0:1773851875.145978:0:41060:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851875.145979:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=108 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851875.145979:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851875.145980:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:3.0:1773851875.145980:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851875.145981:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851875.145981:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.145981:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851875.145981:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851875.145982:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851875.145983:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851875.145983:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851875.145984:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=108 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851875.145985:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851875.145985:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00100000:3.0:1773851875.145985:0:41060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000096b8a0b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051931712:2057@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851875.145986:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:5.0:1773851875.145986:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=108 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851875.145987:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.145988:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851875.145988:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851875.145988:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851875.145989:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:3.0:1773851875.145989:0:41060:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00010000:00000001:5.0:1773851875.145990:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851875.145990:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851875.145990:0:41060:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000096b8a0b5 x1859433051931712/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851875.145992:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851875.145992:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000001:30.0:1773851875.145993:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851875.145993:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851875.145994:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851875.145994:0:41060:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851875.145995:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:3.0:1773851875.145995:0:41060:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:30.0:1773851875.145996:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:5.0:1773851875.145996:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:3.0:1773851875.145996:0:41060:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e468cca7.
00000004:00000001:30.0:1773851875.145997:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851875.145998:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
02000000:00000001:3.0:1773851875.145998:0:41060:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000040:30.0:1773851875.145999:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545811968 avail=351536147456 avail_mb=1373188076 hwm_mb=3131103 files=372116422 ffree=343306457 state=0: rc = 0
00000020:00000001:3.0:1773851875.145999:0:41060:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:3.0:1773851875.145999:0:41060:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000100:00000001:5.0:1773851875.146000:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:3.0:1773851875.146000:0:41060:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:5.0:1773851875.146002:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851875.146002:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:30.0:1773851875.146003:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545811968 free, 351536147456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116422 files, 343306457 free files
00000004:00000001:5.0:1773851875.146003:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851875.146004:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
02000000:00000010:3.0:1773851875.146004:0:41060:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a3c61f33.
00000004:00000001:30.0:1773851875.146005:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:5.0:1773851875.146006:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351466009600 avail=351462818816 avail_mb=1372901636 hwm_mb=3131103 files=372062839 ffree=343228525 state=0: rc = 0
02000000:00000001:3.0:1773851875.146006:0:41060:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:3.0:1773851875.146006:0:41060:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:30.0:1773851875.146007:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:3.0:1773851875.146007:0:41060:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000096b8a0b5.
00000100:00000001:3.0:1773851875.146008:0:41060:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000020:5.0:1773851875.146009:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351466009600 free, 351462818816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062839 files, 343228525 free files
00000100:00000001:3.0:1773851875.146009:0:41060:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851875.146010:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851875.146011:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851875.146012:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ddd02f81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051931776:2056@kfi7:13:default-yuba2-0
00000100:00000001:3.0:1773851875.146012:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:3.0:1773851875.146012:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851875.146013:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:3.0:1773851875.146014:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:3.0:1773851875.146014:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851875.146015:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851875.146016:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851875.146017:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ddd02f81 x1859433051931776/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:5.0:1773851875.146018:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004ab341b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051931648:2085@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851875.146021:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851875.146022:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851875.146023:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004219deee.
00000100:00000001:5.0:1773851875.146023:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851875.146024:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:30.0:1773851875.146025:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851875.146026:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851875.146026:0:41090:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000100:00000040:5.0:1773851875.146026:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004ab341b7 x1859433051931648/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:30.0:1773851875.146027:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851875.146028:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
02000000:00000001:30.0:1773851875.146030:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851875.146030:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:5.0:1773851875.146030:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000010:30.0:1773851875.146031:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ddd02f81.
02000000:00000001:5.0:1773851875.146031:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851875.146032:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e74fa322.
00000100:00000001:30.0:1773851875.146033:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851875.146033:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:5.0:1773851875.146033:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851875.146034:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:5.0:1773851875.146034:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851875.146035:0:41067:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000100:00000001:30.0:1773851875.146036:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:5.0:1773851875.146036:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:30.0:1773851875.146037:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851875.146037:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000030ba13a7.
00000100:00000001:30.0:1773851875.146038:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851875.146038:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851875.146038:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851875.146039:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851875.146039:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004ab341b7.
00000100:00000001:5.0:1773851875.146040:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851875.146041:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851875.146042:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851875.146044:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851875.146044:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.146045:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851875.146046:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851875.180927:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851875.180927:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851875.180928:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851875.180928:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851875.180929:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851875.180929:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851875.180931:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851875.180931:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20977@kfi7(0000000016b0ce3e):0x1be version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851875.180933:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20977@kfi7 to cpt 2
00000800:00000200:9.0:1773851875.180933:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be Using peer 20977@kfi7(0x1be)
00000400:00000200:10.0:1773851875.180934:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20977@kfi7 : PUT - for me
00000400:00000200:9.0:1773851875.180934:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20977@kfi7 to cpt 2
00000400:00000200:10.0:1773851875.180935:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20977@kfi7 to cpt 2
00000400:00000200:10.0:1773851875.180936:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a8e1cab nid 20977@kfi7 refs 1
00000400:00000200:10.0:1773851875.180937:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20977@kfi7 to cpt 2
00000800:00000200:9.0:1773851875.180937:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x1be: rc=0
00000400:00000200:10.0:1773851875.180938:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a8e1cab nid 20977@kfi7 refs 2
00000800:00000200:9.0:1773851875.180938:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851875.180939:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007a8e1cab nid 20977@kfi7 refs 3
00000400:00000200:10.0:1773851875.180940:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20785@kfi7 to cpt 7
00000400:00000200:10.0:1773851875.180941:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20785@kfi7 of length 224 into portal 12 MB=0x69b4c3a580080
00000400:00000200:10.0:1773851875.180942:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20785@kfi7 of length 224/224 into md 0x78146ce49 [64] + 143064
00000800:00000200:10.0:1773851875.180944:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851875.180945:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851875.180948:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20977@kfi7: PUT: OK
00000100:00000001:10.0:1773851875.180949:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851875.180950:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851875.180950:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000838cc8d3.
00000100:00000040:10.0:1773851875.180951:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000838cc8d3 x1859601558929536 msgsize 224
00000800:00000200:9.0:1773851875.180952:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851875.180953:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20785@kfi7 (source: 12345-20977@kfi7)
00000100:00000001:10.0:1773851875.180954:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851875.180955:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007a8e1cab nid 20977@kfi7 refs 2
00000800:00000200:9.0:1773851875.180955:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be Transaction freed
00000100:00000001:8.0:1773851875.180955:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851875.180956:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000333a7eb2: 2069@kfi7:2 <- 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851875.180956:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851875.180956:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851875.180957:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851875.180958:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851875.180958:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601558929536
00000020:00000001:8.0:1773851875.180959:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851875.180959:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff88c19
00000020:00000001:8.0:1773851875.180959:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851875.180963:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e05be20e refcount=7
00000020:00000001:8.0:1773851875.180963:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128020180992 : -106945689370624 : ffff9ebbc42cc000)
00000020:00000001:8.0:1773851875.180964:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128020180992 : -106945689370624 : ffff9ebbc42cc000)
00000100:00000001:8.0:1773851875.180966:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851875.180966:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851875.180967:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebf0718.
00000020:00000010:8.0:1773851875.180968:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851875.180968:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851875.180969:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851875.180970:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851875.180970:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851875.180971:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851875.180971:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851875.180972:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.180972:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851875.180973:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851875.180974:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851875.180974:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851875.180975:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851875.180975:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20785@kfi7, seq: 2130802
00000100:00000040:8.0:1773851875.180975:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e05be20e : new rpc_count 1
00000100:00000001:11.0:1773851875.180976:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.180976:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.180976:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637143345333376 : -106930364218240 : ffff9ebf55a00480)
00000100:00000040:8.0:1773851875.180977:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000838cc8d3 x1859601558929536/t0(0) o400->1fd728de-ad7b-4885-a786-13cfee5d6d71@20785@kfi7:96/0 lens 224/0 e 0 to 0 dl 1773852211 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1789-0'
00000100:00000001:8.0:1773851875.180979:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851875.180980:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851875.180981:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000838cc8d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1fd728de-ad7b-4885-a786-13cfee5d6d71+7:39512:x1859601558929536:12345-20785@kfi7:400:default-tuolumne1789-0
00000100:00000200:8.0:1773851875.180982:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601558929536
00000020:00000001:8.0:1773851875.180982:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851875.180983:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851875.180983:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.180984:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851875.180984:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851875.180985:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851875.180985:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601558929536, found 0 last_xid 1859601558929535
00000020:00000001:8.0:1773851875.180986:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851875.180987:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851875.180988:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851875.180988:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.180989:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851875.180989:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851875.180990:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851875.180991:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000063c01706.
02000000:00000001:8.0:1773851875.180991:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.180992:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.180992:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851875.180993:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044159025, transno 0, xid 1859601558929536
00010000:00000001:8.0:1773851875.180993:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851875.180994:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000838cc8d3 x1859601558929536/t0(0) o400->1fd728de-ad7b-4885-a786-13cfee5d6d71@20785@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1789-0'
00010000:00000001:8.0:1773851875.180996:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851875.180997:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851875.180997:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=108 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851875.180998:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851875.180999:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006618b8bf refcount 3 to 20785@kfi7
00000100:00000001:8.0:1773851875.181000:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064800 : -107155994486816 : ffff9e8acd0357e0)
02000000:00000001:8.0:1773851875.181000:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851875.181001:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.181001:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851875.181002:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20977@kfi7
00000400:00000010:8.0:1773851875.181003:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002bb674c2.
00000100:00000200:8.0:1773851875.181004:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601558929536, offset 224
00000400:00000200:8.0:1773851875.181006:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20977@kfi7
00000400:00000200:8.0:1773851875.181006:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20977@kfi7 to cpt 2
00000400:00000200:8.0:1773851875.181007:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a8e1cab nid 20977@kfi7 refs 1
00000400:00000200:8.0:1773851875.181008:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007a8e1cab nid 20977@kfi7 refs 2
00000400:00000200:8.0:1773851875.181010:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007a8e1cab nid 20977@kfi7 refs 3
00000400:00000200:8.0:1773851875.181011:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20977@kfi7 local destination
00000400:00000200:8.0:1773851875.181012:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769504:8769504:1024:4294967295] 20977@kfi7 LPNI seq info [246717:246717:16:4294967295]
00000400:00000200:8.0:1773851875.181014:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007a8e1cab nid 20977@kfi7 refs 2
00000400:00000200:8.0:1773851875.181015:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20977@kfi7 to cpt 2
00000400:00000200:8.0:1773851875.181017:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20977@kfi7(20977@kfi7:20977@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851875.181018:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007a8e1cab nid 20977@kfi7 refs 3
00000800:00000200:8.0:1773851875.181020:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851875.181021:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851875.181023:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851875.181025:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be Using peer 20977@kfi7(0x1be)
00000800:00000200:8.0:1773851875.181028:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1be: rc=0
00000800:00000200:8.0:1773851875.181029:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851875.181031:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851875.181032:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006618b8bf refcount 2 to 20785@kfi7
00010000:00000001:8.0:1773851875.181033:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851875.181033:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.181034:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851875.181035:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000838cc8d3 x1859601558929536/t0(0) o400->1fd728de-ad7b-4885-a786-13cfee5d6d71@20785@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1789-0'
00000100:00100000:8.0:1773851875.181039:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000838cc8d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1fd728de-ad7b-4885-a786-13cfee5d6d71+7:39512:x1859601558929536:12345-20785@kfi7:400:default-tuolumne1789-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851875.181041:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20785@kfi7, seq: 2130802
00000100:00000040:8.0:1773851875.181042:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e05be20e : new rpc_count 0
00000100:00000001:8.0:1773851875.181042:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851875.181043:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851875.181043:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851875.181044:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851875.181044:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebf0718.
00000020:00000040:8.0:1773851875.181045:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e05be20e : new refcount 6
00000100:00000001:8.0:1773851875.181046:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851875.181052:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851875.181054:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851875.181055:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20977@kfi7: PUT: OK
00000400:00000200:9.0:1773851875.181055:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002bb674c2
00000400:00000010:9.0:1773851875.181056:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002bb674c2.
00000100:00000001:9.0:1773851875.181057:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851875.181057:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851875.181058:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007a8e1cab nid 20977@kfi7 refs 2
00000800:00000200:9.0:1773851875.181059:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 20977@kfi7(0000000016b0ce3e):0x0 lsk 447 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1be Transaction freed
00000800:00000200:9.0:1773851875.185861:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851875.185862:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851875.185864:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851875.185867:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851875.185870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9217@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.185872:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9217@kfi7 : PUT - for me
00000400:00000200:9.0:1773851875.185874:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9217@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.185875:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000adac5150 nid 9217@kfi7 refs 1
00000400:00000200:9.0:1773851875.185876:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9217@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.185877:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000adac5150 nid 9217@kfi7 refs 2
00000400:00000200:9.0:1773851875.185879:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000adac5150 nid 9217@kfi7 refs 3
00000400:00000200:9.0:1773851875.185880:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9408@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.185882:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9408@kfi7 of length 224 into portal 12 MB=0x699e198f83dc0
00000400:00000200:9.0:1773851875.185883:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9408@kfi7 of length 224/224 into md 0x78146ce49 [64] + 143288
00000800:00000200:9.0:1773851875.185889:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851875.185891:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851875.185893:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9217@kfi7: PUT: OK
00000100:00000001:9.0:1773851875.185894:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851875.185895:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851875.185896:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007c9ac6fd.
00000100:00000040:9.0:1773851875.185897:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000007c9ac6fd x1858044073360832 msgsize 224
00000100:00100000:9.0:1773851875.185900:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-9408@kfi7 (source: 12345-9217@kfi7)
00000100:00000001:9.0:1773851875.185901:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851875.185903:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000adac5150 nid 9217@kfi7 refs 2
00000100:00000001:8.0:1773851875.185904:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851875.185904:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851875.185905:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851875.185905:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851875.185906:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851875.185907:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851875.185908:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044073360832
00000020:00000001:8.0:1773851875.185908:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851875.185909:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922e5
00000020:00000001:8.0:1773851875.185910:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851875.185914:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002123c89d refcount=719
00000020:00000001:8.0:1773851875.185915:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630014976 : -107123079536640 : ffff9e9276e5a000)
00000020:00000001:8.0:1773851875.185915:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630014976 : -107123079536640 : ffff9e9276e5a000)
00000100:00000001:8.0:1773851875.185917:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851875.185918:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851875.185919:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebf0718.
00000020:00000010:8.0:1773851875.185920:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851875.185921:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851875.185922:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851875.185923:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851875.185924:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851875.185925:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851875.185926:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851875.185926:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.185928:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851875.185929:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851875.185930:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851875.185930:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851875.185931:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851875.185932:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9408@kfi7, seq: 2130803
00000100:00000001:11.0:1773851875.185933:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851875.185933:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002123c89d : new rpc_count 18
00000100:00000001:11.0:1773851875.185934:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.185934:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096239360 : -107006613312256 : ffff9ead94d32d00)
00000100:00000040:8.0:1773851875.185935:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007c9ac6fd x1858044073360832/t0(0) o400->afaf3d47-598c-48f2-b14c-699189db912f@9408@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1075-0'
00000100:00000001:8.0:1773851875.185940:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851875.185941:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851875.185942:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c9ac6fd pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:afaf3d47-598c-48f2-b14c-699189db912f+719:39879:x1858044073360832:12345-9408@kfi7:400:default-tuolumne1075-0
00000100:00000200:8.0:1773851875.185945:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044073360832
00000020:00000001:8.0:1773851875.185946:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851875.185947:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851875.185948:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.185949:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851875.185950:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851875.185951:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851875.185952:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044073360832, found 0 last_xid 1858044067611647
00000020:00000001:8.0:1773851875.185953:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851875.185954:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851875.185954:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851875.185955:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.185956:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851875.185957:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851875.185957:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851875.185958:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009433b6c1.
02000000:00000001:8.0:1773851875.185959:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.185960:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.185961:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851875.185962:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589316, transno 0, xid 1858044073360832
00010000:00000001:8.0:1773851875.185963:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851875.185965:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007c9ac6fd x1858044073360832/t0(0) o400->afaf3d47-598c-48f2-b14c-699189db912f@9408@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1075-0'
00010000:00000001:8.0:1773851875.185969:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851875.185969:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851875.185970:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=108 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851875.185972:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851875.185973:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d333de5 refcount 3 to 9408@kfi7
00000100:00000001:8.0:1773851875.185974:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582848 : -107154806968768 : ffff9e8b13cb6e40)
02000000:00000001:8.0:1773851875.185975:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851875.185976:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.185977:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851875.185978:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9217@kfi7
00000400:00000010:8.0:1773851875.185979:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f71c7d5.
00000100:00000200:8.0:1773851875.185981:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044073360832, offset 224
00000400:00000200:8.0:1773851875.185983:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9217@kfi7
00000400:00000200:8.0:1773851875.185984:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9217@kfi7 to cpt 2
00000400:00000200:8.0:1773851875.185986:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000adac5150 nid 9217@kfi7 refs 1
00000400:00000200:8.0:1773851875.185987:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000adac5150 nid 9217@kfi7 refs 2
00000400:00000200:8.0:1773851875.185989:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000adac5150 nid 9217@kfi7 refs 3
00000400:00000200:8.0:1773851875.185991:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9217@kfi7 local destination
00000400:00000200:8.0:1773851875.185993:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769505:8769505:1024:4294967295] 9217@kfi7 LPNI seq info [11908781:11908781:16:4294967295]
00000400:00000200:8.0:1773851875.185995:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000adac5150 nid 9217@kfi7 refs 2
00000400:00000200:8.0:1773851875.185996:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9217@kfi7 to cpt 2
00000400:00000200:8.0:1773851875.185999:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9217@kfi7(9217@kfi7:9217@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851875.186001:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000adac5150 nid 9217@kfi7 refs 3
00000800:00000200:8.0:1773851875.186003:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851875.186005:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851875.186008:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851875.186012:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000002b Using peer 9217@kfi7(0x10000000000002b)
00000800:00000200:8.0:1773851875.186016:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x10000000000002b: rc=0
00000800:00000200:8.0:1773851875.186018:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000002b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851875.186021:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851875.186022:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d333de5 refcount 2 to 9408@kfi7
00010000:00000001:8.0:1773851875.186023:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851875.186024:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851875.186025:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851875.186028:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007c9ac6fd x1858044073360832/t0(0) o400->afaf3d47-598c-48f2-b14c-699189db912f@9408@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1075-0'
00000100:00100000:8.0:1773851875.186032:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c9ac6fd pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:afaf3d47-598c-48f2-b14c-699189db912f+719:39879:x1858044073360832:12345-9408@kfi7:400:default-tuolumne1075-0 Request processed in 91us (134us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851875.186037:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9408@kfi7, seq: 2130803
00000100:00000040:8.0:1773851875.186038:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002123c89d : new rpc_count 17
00000100:00000001:8.0:1773851875.186039:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851875.186040:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851875.186040:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851875.186041:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851875.186043:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebf0718.
00000020:00000040:8.0:1773851875.186044:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000002123c89d : new refcount 718
00000100:00000001:8.0:1773851875.186045:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851875.186052:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000002b TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851875.186054:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851875.186056:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9217@kfi7: PUT: OK
00000400:00000200:9.0:1773851875.186057:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f71c7d5
00000400:00000010:9.0:1773851875.186058:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f71c7d5.
00000100:00000001:9.0:1773851875.186059:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851875.186060:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851875.186061:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000adac5150 nid 9217@kfi7 refs 2
00000800:00000200:9.0:1773851875.186063:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 9217@kfi7(000000001027980e):0x0 lsk 44 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000002b Transaction freed
00000400:00000200:29.0:1773851875.209736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851875.209739:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851875.266054:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851875.266054:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851875.266056:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851875.266057:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851875.266059:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12289@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.266060:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12289@kfi7 : PUT - for me
00000400:00000200:21.0:1773851875.266061:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12289@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.266062:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051145fc3 nid 12289@kfi7 refs 1
00000400:00000200:21.0:1773851875.266063:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12289@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.266063:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051145fc3 nid 12289@kfi7 refs 2
00000400:00000200:21.0:1773851875.266064:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000051145fc3 nid 12289@kfi7 refs 3
00000400:00000200:21.0:1773851875.266065:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12480@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.266066:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12480@kfi7 of length 224 into portal 12 MB=0x69b4bcb2d1d40
00000400:00000200:21.0:1773851875.266067:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12480@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 45648
00000800:00000200:21.0:1773851875.266068:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851875.266070:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851875.266071:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12289@kfi7: PUT: OK
00000100:00000001:21.0:1773851875.266072:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851875.266073:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851875.266074:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005295f386.
00000100:00000040:21.0:1773851875.266075:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005295f386 x1859599693847872 msgsize 224
00000100:00100000:21.0:1773851875.266076:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12480@kfi7 (source: 12345-12289@kfi7)
00000100:00000001:21.0:1773851875.266077:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851875.266078:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000051145fc3 nid 12289@kfi7 refs 2
00000100:00000001:23.0:1773851875.266079:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851875.266079:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851875.266079:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851875.266080:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851875.266080:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851875.266081:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851875.266082:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599693847872
00000020:00000001:23.0:1773851875.266082:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851875.266083:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7b069
00000020:00000001:23.0:1773851875.266084:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851875.266086:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009aea3fd8 refcount=5
00000020:00000001:23.0:1773851875.266086:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142789941248 : -106930919610368 : ffff9ebf34856800)
00000020:00000001:23.0:1773851875.266087:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142789941248 : -106930919610368 : ffff9ebf34856800)
00000100:00000001:23.0:1773851875.266088:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.266089:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851875.266089:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851875.266090:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851875.266091:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851875.266092:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851875.266092:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851875.266093:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.266094:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851875.266094:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851875.266095:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.266096:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.266097:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851875.266097:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851875.266097:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851875.266097:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851875.266098:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12480@kfi7, seq: 1998002
00000100:00000040:23.0:1773851875.266099:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009aea3fd8 : new rpc_count 1
00000100:00000001:20.0:1773851875.266099:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.266100:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794366720 : -106943915184896 : ffff9ebc2decad00)
00000100:00000001:20.0:1773851875.266100:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.266101:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005295f386 x1859599693847872/t0(0) o400->4a130077-0a92-4a5d-b694-967b7a0a35e7@12480@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1267-0'
00000100:00000001:23.0:1773851875.266104:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.266104:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851875.266105:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005295f386 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4a130077-0a92-4a5d-b694-967b7a0a35e7+5:39671:x1859599693847872:12345-12480@kfi7:400:default-tuolumne1267-0
00000100:00000200:23.0:1773851875.266107:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599693847872
00000020:00000001:23.0:1773851875.266107:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851875.266108:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851875.266109:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.266109:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851875.266111:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851875.266112:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851875.266113:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599693847872, found 0 last_xid 1859599693847871
00000020:00000001:23.0:1773851875.266113:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851875.266114:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851875.266115:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851875.266115:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.266116:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851875.266116:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851875.266117:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851875.266118:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009cc6d7a5.
02000000:00000001:23.0:1773851875.266118:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.266119:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.266120:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851875.266120:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154593655, transno 0, xid 1859599693847872
00010000:00000001:23.0:1773851875.266121:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851875.266122:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005295f386 x1859599693847872/t0(0) o400->4a130077-0a92-4a5d-b694-967b7a0a35e7@12480@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1267-0'
00010000:00000001:23.0:1773851875.266124:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851875.266125:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851875.266125:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=108 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851875.266126:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851875.266127:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000858e77d4 refcount 3 to 12480@kfi7
00000100:00000001:23.0:1773851875.266128:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026432 : -107156745525184 : ffff9e8aa03f6840)
02000000:00000001:23.0:1773851875.266129:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851875.266129:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.266130:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851875.266131:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12289@kfi7
00000400:00000010:23.0:1773851875.266131:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c7cc6c.
00000100:00000200:23.0:1773851875.266132:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599693847872, offset 224
00000400:00000200:23.0:1773851875.266134:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12289@kfi7
00000400:00000200:23.0:1773851875.266134:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12289@kfi7 to cpt 5
00000400:00000200:23.0:1773851875.266135:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051145fc3 nid 12289@kfi7 refs 1
00000400:00000200:23.0:1773851875.266136:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000051145fc3 nid 12289@kfi7 refs 2
00000400:00000200:23.0:1773851875.266138:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000051145fc3 nid 12289@kfi7 refs 3
00000400:00000200:23.0:1773851875.266139:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12289@kfi7 local destination
00000400:00000200:23.0:1773851875.266141:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769506:8769506:1024:4294967295] 12289@kfi7 LPNI seq info [13702667:13702667:16:4294967295]
00000400:00000200:23.0:1773851875.266142:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000051145fc3 nid 12289@kfi7 refs 2
00000400:00000200:23.0:1773851875.266143:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12289@kfi7 to cpt 5
00000400:00000200:23.0:1773851875.266145:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12289@kfi7(12289@kfi7:12289@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851875.266146:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000051145fc3 nid 12289@kfi7 refs 3
00000800:00000200:23.0:1773851875.266148:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851875.266149:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851875.266151:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851875.266153:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0xcd7 Using peer 12289@kfi7(0xcd7)
00000800:00000200:23.0:1773851875.266156:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0xcd7: rc=0
00000800:00000200:23.0:1773851875.266157:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0xcd7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851875.266159:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.266160:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000858e77d4 refcount 2 to 12480@kfi7
00010000:00000001:23.0:1773851875.266161:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851875.266161:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.266162:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851875.266163:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005295f386 x1859599693847872/t0(0) o400->4a130077-0a92-4a5d-b694-967b7a0a35e7@12480@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1267-0'
00000100:00100000:23.0:1773851875.266166:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005295f386 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4a130077-0a92-4a5d-b694-967b7a0a35e7+5:39671:x1859599693847872:12345-12480@kfi7:400:default-tuolumne1267-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851875.266168:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12480@kfi7, seq: 1998002
00000100:00000040:23.0:1773851875.266169:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009aea3fd8 : new rpc_count 0
00000100:00000001:23.0:1773851875.266169:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851875.266170:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851875.266170:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0xcd7 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851875.266171:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851875.266171:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:23.0:1773851875.266172:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000400:00000200:21.0:1773851875.266172:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851875.266172:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12289@kfi7: PUT: OK
00000020:00000040:23.0:1773851875.266173:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009aea3fd8 : new refcount 4
00000100:00000001:23.0:1773851875.266173:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851875.266173:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c7cc6c
00000400:00000010:21.0:1773851875.266174:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c7cc6c.
00000100:00000001:21.0:1773851875.266174:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851875.266175:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851875.266175:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000051145fc3 nid 12289@kfi7 refs 2
00000800:00000200:21.0:1773851875.266177:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 12289@kfi7(000000004cef7a79):0x0 lsk 3288 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0xcd7 Transaction freed
00000800:00000200:13.0:1773851875.312293:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851875.312294:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851875.312296:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851875.312298:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851875.312300:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22784@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.312301:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22784@kfi7 : PUT - for me
00000400:00000200:13.0:1773851875.312302:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22784@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.312303:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3111e29 nid 22784@kfi7 refs 1
00000400:00000200:13.0:1773851875.312304:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22784@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.312305:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3111e29 nid 22784@kfi7 refs 2
00000400:00000200:13.0:1773851875.312306:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f3111e29 nid 22784@kfi7 refs 3
00000400:00000200:13.0:1773851875.312307:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22976@kfi7 to cpt 6
00000400:00000200:13.0:1773851875.312308:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22976@kfi7 of length 224 into portal 12 MB=0x699e0f56f99c0
00000400:00000200:13.0:1773851875.312310:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22976@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 37296
00000800:00000200:13.0:1773851875.312311:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851875.312313:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851875.312314:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22784@kfi7: PUT: OK
00000100:00000001:13.0:1773851875.312315:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851875.312315:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851875.312316:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a3a9d4f.
00000100:00000040:13.0:1773851875.312317:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000002a3a9d4f x1858041329719744 msgsize 224
00000100:00100000:13.0:1773851875.312318:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22976@kfi7 (source: 12345-22784@kfi7)
00000100:00000001:13.0:1773851875.312319:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851875.312320:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f3111e29 nid 22784@kfi7 refs 2
00000100:00000001:15.0:1773851875.312321:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851875.312322:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851875.312322:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851875.312322:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851875.312323:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851875.312324:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851875.312324:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041329719744
00000020:00000001:15.0:1773851875.312325:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851875.312325:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ac5
00000020:00000001:15.0:1773851875.312327:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851875.312329:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c0e6d350 refcount=6
00000020:00000001:15.0:1773851875.312330:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743460864 : -107128966090752 : ffff9e911807f000)
00000020:00000001:15.0:1773851875.312331:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743460864 : -107128966090752 : ffff9e911807f000)
00000100:00000001:15.0:1773851875.312331:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851875.312333:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851875.312333:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebe397c.
00000020:00000010:15.0:1773851875.312334:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851875.312335:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851875.312336:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851875.312337:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851875.312337:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851875.312338:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851875.312339:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851875.312339:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.312340:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851875.312341:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851875.312341:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851875.312342:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851875.312342:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851875.312343:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22976@kfi7, seq: 2289863
00000100:00000040:15.0:1773851875.312344:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c0e6d350 : new rpc_count 1
00000100:00000001:15.0:1773851875.312344:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637029970978944 : -107043738572672 : ffff9ea4effca880)
00000100:00000001:12.0:1773851875.312344:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851875.312344:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851875.312346:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002a3a9d4f x1858041329719744/t0(0) o400->3f17738e-5fc2-46e8-b6f1-2406150581e0@22976@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1923-0'
00000100:00000001:15.0:1773851875.312348:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851875.312349:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851875.312350:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a3a9d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:3f17738e-5fc2-46e8-b6f1-2406150581e0+6:39815:x1858041329719744:12345-22976@kfi7:400:default-tuolumne1923-0
00000100:00000200:15.0:1773851875.312351:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041329719744
00000020:00000001:15.0:1773851875.312352:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851875.312353:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851875.312353:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.312354:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851875.312355:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851875.312356:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851875.312357:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041329719744, found 0 last_xid 1858041329719743
00000020:00000001:15.0:1773851875.312358:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851875.312359:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851875.312359:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851875.312359:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.312360:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851875.312361:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851875.312361:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851875.312362:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b043471d.
02000000:00000001:15.0:1773851875.312363:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.312363:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.312364:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851875.312365:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044126999, transno 0, xid 1858041329719744
00010000:00000001:15.0:1773851875.312365:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851875.312366:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002a3a9d4f x1858041329719744/t0(0) o400->3f17738e-5fc2-46e8-b6f1-2406150581e0@22976@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1923-0'
00010000:00000001:15.0:1773851875.312368:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851875.312369:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851875.312370:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=108 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851875.312371:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851875.312371:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000af31208a refcount 3 to 22976@kfi7
00000100:00000001:15.0:1773851875.312372:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860224 : -107149578691392 : ffff9e8c4b6c9cc0)
02000000:00000001:15.0:1773851875.312373:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851875.312373:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.312374:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851875.312375:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22784@kfi7
00000400:00000010:15.0:1773851875.312375:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c2b163d5.
00000100:00000200:15.0:1773851875.312377:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041329719744, offset 224
00000400:00000200:15.0:1773851875.312378:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22784@kfi7
00000400:00000200:15.0:1773851875.312379:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22784@kfi7 to cpt 3
00000400:00000200:15.0:1773851875.312380:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f3111e29 nid 22784@kfi7 refs 1
00000400:00000200:15.0:1773851875.312381:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f3111e29 nid 22784@kfi7 refs 2
00000400:00000200:15.0:1773851875.312382:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f3111e29 nid 22784@kfi7 refs 3
00000400:00000200:15.0:1773851875.312383:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22784@kfi7 local destination
00000400:00000200:15.0:1773851875.312385:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769507:8769507:1024:4294967295] 22784@kfi7 LPNI seq info [7564344:7564344:16:4294967295]
00000400:00000200:15.0:1773851875.312386:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f3111e29 nid 22784@kfi7 refs 2
00000400:00000200:15.0:1773851875.312387:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22784@kfi7 to cpt 3
00000400:00000200:15.0:1773851875.312389:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22784@kfi7(22784@kfi7:22784@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851875.312390:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f3111e29 nid 22784@kfi7 refs 3
00000800:00000200:15.0:1773851875.312391:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851875.312392:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851875.312394:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851875.312396:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1ee Using peer 22784@kfi7(0x1ee)
00000800:00000200:15.0:1773851875.312400:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x1ee: rc=0
00000800:00000200:15.0:1773851875.312401:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1ee TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851875.312403:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851875.312404:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000af31208a refcount 2 to 22976@kfi7
00010000:00000001:15.0:1773851875.312405:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851875.312405:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.312406:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851875.312407:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a3a9d4f x1858041329719744/t0(0) o400->3f17738e-5fc2-46e8-b6f1-2406150581e0@22976@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1923-0'
00000100:00100000:15.0:1773851875.312409:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a3a9d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:3f17738e-5fc2-46e8-b6f1-2406150581e0+6:39815:x1858041329719744:12345-22976@kfi7:400:default-tuolumne1923-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851875.312411:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22976@kfi7, seq: 2289863
00000100:00000040:15.0:1773851875.312413:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c0e6d350 : new rpc_count 0
00000100:00000001:15.0:1773851875.312413:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851875.312413:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1ee TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851875.312414:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851875.312414:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851875.312415:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851875.312415:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000400:00000200:13.0:1773851875.312415:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22784@kfi7: PUT: OK
00000020:00000010:15.0:1773851875.312416:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebe397c.
00000400:00000200:13.0:1773851875.312416:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c2b163d5
00000400:00000010:13.0:1773851875.312416:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c2b163d5.
00000020:00000040:15.0:1773851875.312417:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000c0e6d350 : new refcount 5
00000100:00000001:13.0:1773851875.312417:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851875.312417:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851875.312418:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851875.312418:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f3111e29 nid 22784@kfi7 refs 2
00000800:00000200:13.0:1773851875.312420:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 22784@kfi7(00000000c23d5a05):0x0 lsk 495 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1ee Transaction freed
00000800:00000200:25.0:1773851875.321125:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851875.321126:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851875.321127:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851875.321129:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851875.321132:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24704@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.321133:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24704@kfi7 : PUT - for me
00000400:00000200:25.0:1773851875.321134:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24704@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.321135:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ea8ad05 nid 24704@kfi7 refs 1
00000400:00000200:25.0:1773851875.321136:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24704@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.321136:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ea8ad05 nid 24704@kfi7 refs 2
00000400:00000200:25.0:1773851875.321137:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006ea8ad05 nid 24704@kfi7 refs 3
00000400:00000200:25.0:1773851875.321138:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24640@kfi7 to cpt 3
00000400:00000200:25.0:1773851875.321139:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24640@kfi7 of length 224 into portal 12 MB=0x69b4c3c3a8040
00000400:00000200:25.0:1773851875.321141:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24640@kfi7 of length 224/224 into md 0x16159c9699 [64] + 22328
00000800:00000200:25.0:1773851875.321143:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851875.321144:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851875.321146:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24704@kfi7: PUT: OK
00000100:00000001:25.0:1773851875.321147:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851875.321147:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851875.321148:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000223b7599.
00000100:00000040:25.0:1773851875.321149:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000223b7599 x1859601590550592 msgsize 224
00000100:00100000:25.0:1773851875.321151:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24640@kfi7 (source: 12345-24704@kfi7)
00000100:00000001:25.0:1773851875.321152:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851875.321153:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006ea8ad05 nid 24704@kfi7 refs 2
00000100:00000001:27.0:1773851875.321154:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851875.321154:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851875.321155:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851875.321156:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851875.321157:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851875.321158:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851875.321159:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601590550592
00000020:00000001:27.0:1773851875.321160:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851875.321161:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8c57e
00000020:00000001:27.0:1773851875.321162:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851875.321165:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f8df59dc refcount=5
00000020:00000001:27.0:1773851875.321166:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637087678377984 : -106986031173632 : ffff9eb25f9db000)
00000020:00000001:27.0:1773851875.321167:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637087678377984 : -106986031173632 : ffff9eb25f9db000)
00000100:00000001:27.0:1773851875.321170:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.321171:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851875.321172:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004133ac17.
00000020:00000010:27.0:1773851875.321173:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851875.321175:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008f193acf.
00000100:00000001:27.0:1773851875.321176:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851875.321177:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851875.321178:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851875.321179:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851875.321180:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851875.321181:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.321182:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851875.321184:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851875.321185:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851875.321185:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851875.321185:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851875.321187:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24640@kfi7, seq: 2025127
00000100:00000040:27.0:1773851875.321188:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f8df59dc : new rpc_count 1
00000100:00000001:26.0:1773851875.321188:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.321189:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124127576320 : -106949581975296 : ffff9ebadc285100)
00000100:00000001:26.0:1773851875.321189:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.321191:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000223b7599 x1859601590550592/t0(0) o400->57035466-7d83-4257-807a-4ffd1289c865@24640@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2036-0'
00000100:00000001:27.0:1773851875.321196:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.321197:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851875.321199:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000223b7599 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:57035466-7d83-4257-807a-4ffd1289c865+5:39451:x1859601590550592:12345-24640@kfi7:400:default-tuolumne2036-0
00000100:00000200:27.0:1773851875.321201:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601590550592
00000020:00000001:27.0:1773851875.321202:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851875.321203:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851875.321204:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.321205:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851875.321206:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851875.321207:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851875.321208:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601590550592, found 0 last_xid 1859601590550591
00000020:00000001:27.0:1773851875.321209:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851875.321211:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851875.321212:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851875.321213:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.321214:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851875.321215:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851875.321216:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851875.321217:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b340f2af.
02000000:00000001:27.0:1773851875.321218:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.321219:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.321220:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851875.321221:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044146008, transno 0, xid 1859601590550592
00010000:00000001:27.0:1773851875.321222:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851875.321223:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000223b7599 x1859601590550592/t0(0) o400->57035466-7d83-4257-807a-4ffd1289c865@24640@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2036-0'
00010000:00000001:27.0:1773851875.321228:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851875.321229:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851875.321230:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=108 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851875.321232:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851875.321233:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009aa1fab8 refcount 3 to 24640@kfi7
00000100:00000001:27.0:1773851875.321234:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399156064 : -107139310395552 : ffff9e8eaf765f60)
02000000:00000001:27.0:1773851875.321236:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851875.321236:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.321237:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851875.321239:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24704@kfi7
00000400:00000010:27.0:1773851875.321240:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000099e1821d.
00000100:00000200:27.0:1773851875.321241:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601590550592, offset 224
00000400:00000200:27.0:1773851875.321243:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24704@kfi7
00000400:00000200:27.0:1773851875.321245:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24704@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.321246:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ea8ad05 nid 24704@kfi7 refs 1
00000400:00000200:27.0:1773851875.321248:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006ea8ad05 nid 24704@kfi7 refs 2
00000400:00000200:27.0:1773851875.321250:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006ea8ad05 nid 24704@kfi7 refs 3
00000400:00000200:27.0:1773851875.321252:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24704@kfi7 local destination
00000400:00000200:27.0:1773851875.321254:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769508:8769508:1024:4294967295] 24704@kfi7 LPNI seq info [246317:246317:16:4294967295]
00000400:00000200:27.0:1773851875.321256:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006ea8ad05 nid 24704@kfi7 refs 2
00000400:00000200:27.0:1773851875.321259:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24704@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.321262:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24704@kfi7(24704@kfi7:24704@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851875.321264:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006ea8ad05 nid 24704@kfi7 refs 3
00000800:00000200:27.0:1773851875.321266:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851875.321268:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851875.321272:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851875.321276:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf93 Using peer 24704@kfi7(0xf93)
00000800:00000200:27.0:1773851875.321280:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0xf93: rc=0
00000800:00000200:27.0:1773851875.321283:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf93 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851875.321286:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.321288:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009aa1fab8 refcount 2 to 24640@kfi7
00010000:00000001:27.0:1773851875.321289:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851875.321290:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.321291:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851875.321292:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000223b7599 x1859601590550592/t0(0) o400->57035466-7d83-4257-807a-4ffd1289c865@24640@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2036-0'
00000800:00000200:25.0:1773851875.321296:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf93 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851875.321297:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000223b7599 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:57035466-7d83-4257-807a-4ffd1289c865+5:39451:x1859601590550592:12345-24640@kfi7:400:default-tuolumne2036-0 Request processed in 100us (147us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851875.321297:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851875.321298:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24704@kfi7: PUT: OK
00000400:00000200:25.0:1773851875.321299:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000099e1821d
00000400:00000010:25.0:1773851875.321299:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000099e1821d.
00000100:00000001:25.0:1773851875.321300:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:27.0:1773851875.321301:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24640@kfi7, seq: 2025127
00000100:00000001:25.0:1773851875.321301:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851875.321301:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006ea8ad05 nid 24704@kfi7 refs 2
00000100:00000040:27.0:1773851875.321302:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f8df59dc : new rpc_count 0
00000800:00000200:25.0:1773851875.321303:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24704@kfi7(0000000058cb8622):0x0 lsk 3988 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf93 Transaction freed
00000100:00000001:27.0:1773851875.321304:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851875.321304:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851875.321305:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851875.321306:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008f193acf.
00000020:00000010:27.0:1773851875.321308:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004133ac17.
00000020:00000040:27.0:1773851875.321309:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000f8df59dc : new refcount 4
00000100:00000001:27.0:1773851875.321310:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851875.378977:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851875.378979:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851875.378981:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851875.378985:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851875.378989:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.378991:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22560@kfi7 : PUT - for me
00000400:00000200:29.0:1773851875.378993:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.378995:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 1
00000400:00000200:29.0:1773851875.378997:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.378998:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000400:00000200:29.0:1773851875.379000:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 3
00000400:00000200:29.0:1773851875.379002:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22753@kfi7 to cpt 5
00000400:00000200:29.0:1773851875.379004:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22753@kfi7 of length 224 into portal 12 MB=0x69b0a2a284ec0
00000400:00000200:29.0:1773851875.379006:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22753@kfi7 of length 224/224 into md 0x77fe139dd [64] + 183504
00000800:00000200:29.0:1773851875.379010:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851875.379014:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851875.379016:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22560@kfi7: PUT: OK
00000100:00000001:29.0:1773851875.379017:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851875.379018:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851875.379020:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000010d12885.
00000100:00000040:29.0:1773851875.379021:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000010d12885 x1859317819526848 msgsize 224
00000100:00100000:29.0:1773851875.379024:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22753@kfi7 (source: 12345-22560@kfi7)
00000100:00000001:29.0:1773851875.379025:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851875.379027:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000100:00000001:31.0:1773851875.379029:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851875.379030:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851875.379030:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851875.379031:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851875.379031:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851875.379033:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851875.379034:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317819526848
00000020:00000001:31.0:1773851875.379035:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851875.379036:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac927ed
00000020:00000001:31.0:1773851875.379037:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851875.379041:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cd2b5ed2 refcount=6
00000020:00000001:31.0:1773851875.379042:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631513088 : -107123078038528 : ffff9e9276fc7c00)
00000020:00000001:31.0:1773851875.379043:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631513088 : -107123078038528 : ffff9e9276fc7c00)
00000100:00000001:31.0:1773851875.379045:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851875.379046:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851875.379048:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851875.379049:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851875.379050:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851875.379051:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851875.379052:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851875.379052:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851875.379054:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851875.379054:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851875.379055:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.379056:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851875.379057:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851875.379058:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851875.379058:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851875.379058:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851875.379059:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22753@kfi7, seq: 2055540
00000100:00000040:31.0:1773851875.379060:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cd2b5ed2 : new rpc_count 1
00000100:00000001:28.0:1773851875.379060:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.379061:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091507222016 : -106982202329600 : ffff9eb343d53600)
00000100:00000001:28.0:1773851875.379061:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851875.379063:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000010d12885 x1859317819526848/t0(0) o400->4e5abc0f-73d0-47eb-8239-ba5dea6a7f35@22753@kfi7:663/0 lens 224/0 e 0 to 0 dl 1773852023 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1903-0'
00000100:00000001:31.0:1773851875.379066:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851875.379066:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851875.379067:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000010d12885 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:4e5abc0f-73d0-47eb-8239-ba5dea6a7f35+6:39875:x1859317819526848:12345-22753@kfi7:400:default-tuolumne1903-0
00000100:00000200:31.0:1773851875.379069:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317819526848
00000020:00000001:31.0:1773851875.379070:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851875.379071:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851875.379071:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851875.379072:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851875.379073:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851875.379073:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851875.379074:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317819526848, found 0 last_xid 1859317819526847
00000020:00000001:31.0:1773851875.379075:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851875.379076:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851875.379076:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851875.379077:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851875.379078:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851875.379079:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851875.379079:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851875.379081:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e2131fd4.
02000000:00000001:31.0:1773851875.379081:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.379082:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851875.379083:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851875.379084:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317819526848
00010000:00000001:31.0:1773851875.379085:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851875.379086:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000010d12885 x1859317819526848/t0(0) o400->4e5abc0f-73d0-47eb-8239-ba5dea6a7f35@22753@kfi7:663/0 lens 224/224 e 0 to 0 dl 1773852023 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1903-0'
00010000:00000001:31.0:1773851875.379089:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851875.379089:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851875.379090:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=108 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851875.379092:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851875.379093:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000919ef92e refcount 5 to 22753@kfi7
00000100:00000001:31.0:1773851875.379094:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107456 : -107156354444160 : ffff9e8ab78ed480)
02000000:00000001:31.0:1773851875.379095:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851875.379096:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851875.379096:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851875.379097:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22560@kfi7
00000400:00000010:31.0:1773851875.379098:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025a37126.
00000100:00000200:31.0:1773851875.379098:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317819526848, offset 224
00000400:00000200:31.0:1773851875.379100:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22560@kfi7
00000400:00000200:31.0:1773851875.379101:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:31.0:1773851875.379101:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 1
00000400:00000200:31.0:1773851875.379102:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000400:00000200:31.0:1773851875.379104:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 3
00000400:00000200:31.0:1773851875.379105:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22560@kfi7 local destination
00000400:00000200:31.0:1773851875.379106:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769509:8769509:1024:4294967295] 22560@kfi7 LPNI seq info [666495:666495:16:4294967295]
00000400:00000200:31.0:1773851875.379107:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000400:00000200:31.0:1773851875.379108:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22560@kfi7 to cpt 7
00000400:00000200:31.0:1773851875.379110:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22560@kfi7(22560@kfi7:22560@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851875.379111:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 3
00000800:00000200:31.0:1773851875.379112:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851875.379114:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851875.379116:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851875.379118:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b2f Using peer 22560@kfi7(0x100000000000b2f)
00000800:00000200:31.0:1773851875.379121:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x100000000000b2f: rc=0
00000800:00000200:31.0:1773851875.379123:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b2f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851875.379125:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851875.379126:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000919ef92e refcount 4 to 22753@kfi7
00010000:00000001:31.0:1773851875.379126:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851875.379127:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851875.379128:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851875.379128:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000010d12885 x1859317819526848/t0(0) o400->4e5abc0f-73d0-47eb-8239-ba5dea6a7f35@22753@kfi7:663/0 lens 224/224 e 0 to 0 dl 1773852023 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1903-0'
00000100:00100000:31.0:1773851875.379131:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000010d12885 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:4e5abc0f-73d0-47eb-8239-ba5dea6a7f35+6:39875:x1859317819526848:12345-22753@kfi7:400:default-tuolumne1903-0 Request processed in 64us (109us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851875.379134:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22753@kfi7, seq: 2055540
00000800:00000200:29.0:1773851875.379134:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b2f TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851875.379135:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cd2b5ed2 : new rpc_count 0
00000100:00000001:31.0:1773851875.379135:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851875.379136:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851875.379136:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851875.379136:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851875.379137:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851875.379137:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22560@kfi7: PUT: OK
00000400:00000200:29.0:1773851875.379137:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025a37126
00000020:00000010:31.0:1773851875.379138:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000400:00000010:29.0:1773851875.379138:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025a37126.
00000020:00000040:31.0:1773851875.379139:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000cd2b5ed2 : new refcount 5
00000100:00000001:29.0:1773851875.379139:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851875.379139:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851875.379140:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851875.379140:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000cb6055f nid 22560@kfi7 refs 2
00000800:00000200:29.0:1773851875.379141:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 22560@kfi7(000000008a927ce7):0x0 lsk 2864 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000b2f Transaction freed
00000800:00000200:9.0:1773851875.394375:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851875.394376:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851875.394377:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851875.394379:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851875.394381:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26577@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.394383:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26577@kfi7 : PUT - for me
00000400:00000200:9.0:1773851875.394383:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26577@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.394384:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6e3c109 nid 26577@kfi7 refs 1
00000400:00000200:9.0:1773851875.394385:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26577@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.394386:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6e3c109 nid 26577@kfi7 refs 2
00000400:00000200:9.0:1773851875.394387:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e6e3c109 nid 26577@kfi7 refs 3
00000400:00000200:9.0:1773851875.394388:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26577@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.394388:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26577@kfi7 of length 224 into portal 12 MB=0x699e19a381600
00000400:00000200:9.0:1773851875.394390:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26577@kfi7 of length 224/224 into md 0x78146ce49 [64] + 143512
00000800:00000200:9.0:1773851875.394391:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851875.394393:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851875.394394:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26577@kfi7: PUT: OK
00000100:00000001:9.0:1773851875.394395:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851875.394395:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851875.394396:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f0057291.
00000100:00000040:9.0:1773851875.394397:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f0057291 x1858044094322176 msgsize 224
00000100:00100000:9.0:1773851875.394399:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26577@kfi7 (source: 12345-26577@kfi7)
00000100:00000001:9.0:1773851875.394400:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851875.394401:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6e3c109 nid 26577@kfi7 refs 2
00000800:00000200:9.0:1773851875.394402:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851875.394402:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851875.394403:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851875.394404:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851875.394405:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851875.394406:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851875.394407:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044094322176
00000020:00000001:8.0:1773851875.394408:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851875.394408:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93005
00000020:00000001:8.0:1773851875.394409:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851875.394413:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005817d297 refcount=6
00000020:00000001:8.0:1773851875.394414:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744927232 : -107128964624384 : ffff9e91181e5000)
00000020:00000001:8.0:1773851875.394415:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744927232 : -107128964624384 : ffff9e91181e5000)
00000100:00000001:8.0:1773851875.394417:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851875.394418:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851875.394419:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002eec3ec2.
00000020:00000010:8.0:1773851875.394420:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851875.394421:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851875.394422:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851875.394423:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851875.394424:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851875.394425:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851875.394426:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851875.394427:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851875.394428:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851875.394430:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851875.394431:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851875.394431:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851875.394431:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851875.394432:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26577@kfi7, seq: 2130804
00000100:00000040:11.0:1773851875.394433:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005817d297 : new rpc_count 1
00000100:00000001:8.0:1773851875.394433:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.394434:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096238208 : -107006613313408 : ffff9ead94d32880)
00000100:00000001:8.0:1773851875.394434:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851875.394435:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f0057291 x1858044094322176/t0(0) o400->f2f09e02-209b-4560-a5aa-0be805b95531@26577@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2145-0'
00000100:00000001:11.0:1773851875.394438:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851875.394438:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851875.394440:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0057291 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f2f09e02-209b-4560-a5aa-0be805b95531+6:39659:x1858044094322176:12345-26577@kfi7:400:default-tuolumne2145-0
00000100:00000200:11.0:1773851875.394441:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044094322176
00000020:00000001:11.0:1773851875.394442:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851875.394442:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851875.394443:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.394444:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851875.394444:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851875.394445:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851875.394446:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044094322176, found 0 last_xid 1858044094322175
00000020:00000001:11.0:1773851875.394447:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851875.394448:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851875.394448:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851875.394449:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.394449:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851875.394450:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851875.394451:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851875.394451:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000058b86f43.
02000000:00000001:11.0:1773851875.394452:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.394453:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.394454:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851875.394454:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182589959584, transno 0, xid 1858044094322176
00010000:00000001:11.0:1773851875.394455:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851875.394456:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f0057291 x1858044094322176/t0(0) o400->f2f09e02-209b-4560-a5aa-0be805b95531@26577@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2145-0'
00010000:00000001:11.0:1773851875.394458:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851875.394459:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851875.394460:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=108 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851875.394461:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851875.394462:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d1aa6ef refcount 3 to 26577@kfi7
00000100:00000001:11.0:1773851875.394463:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526775968 : -107156182775648 : ffff9e8ac1ca48a0)
02000000:00000001:11.0:1773851875.394464:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851875.394465:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.394465:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851875.394466:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26577@kfi7
00000400:00000010:11.0:1773851875.394467:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000800d7738.
00000100:00000200:11.0:1773851875.394468:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044094322176, offset 224
00000400:00000200:11.0:1773851875.394469:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26577@kfi7
00000400:00000200:11.0:1773851875.394470:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26577@kfi7 to cpt 2
00000400:00000200:11.0:1773851875.394471:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6e3c109 nid 26577@kfi7 refs 1
00000400:00000200:11.0:1773851875.394472:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e6e3c109 nid 26577@kfi7 refs 2
00000400:00000200:11.0:1773851875.394473:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e6e3c109 nid 26577@kfi7 refs 3
00000400:00000200:11.0:1773851875.394475:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26577@kfi7 local destination
00000400:00000200:11.0:1773851875.394476:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769510:8769510:1024:4294967295] 26577@kfi7 LPNI seq info [12487935:12487935:16:4294967295]
00000400:00000200:11.0:1773851875.394477:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e6e3c109 nid 26577@kfi7 refs 2
00000400:00000200:11.0:1773851875.394478:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26577@kfi7 to cpt 2
00000400:00000200:11.0:1773851875.394480:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26577@kfi7(26577@kfi7:26577@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851875.394481:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e6e3c109 nid 26577@kfi7 refs 3
00000800:00000200:11.0:1773851875.394482:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851875.394484:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851875.394486:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851875.394488:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x596 Using peer 26577@kfi7(0x596)
00000800:00000200:11.0:1773851875.394491:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x596: rc=0
00000800:00000200:11.0:1773851875.394493:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x596 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851875.394496:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851875.394496:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d1aa6ef refcount 2 to 26577@kfi7
00010000:00000001:11.0:1773851875.394497:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851875.394498:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.394498:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851875.394499:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f0057291 x1858044094322176/t0(0) o400->f2f09e02-209b-4560-a5aa-0be805b95531@26577@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2145-0'
00000100:00100000:11.0:1773851875.394502:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0057291 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:f2f09e02-209b-4560-a5aa-0be805b95531+6:39659:x1858044094322176:12345-26577@kfi7:400:default-tuolumne2145-0 Request processed in 64us (105us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851875.394505:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26577@kfi7, seq: 2130804
00000100:00000040:11.0:1773851875.394505:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005817d297 : new rpc_count 0
00000100:00000001:11.0:1773851875.394506:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851875.394506:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x596 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851875.394507:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851875.394507:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:11.0:1773851875.394508:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000400:00000200:9.0:1773851875.394508:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851875.394509:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002eec3ec2.
00000400:00000200:9.0:1773851875.394509:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26577@kfi7: PUT: OK
00000400:00000200:9.0:1773851875.394509:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000800d7738
00000020:00000040:11.0:1773851875.394510:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000005817d297 : new refcount 5
00000400:00000010:9.0:1773851875.394510:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000800d7738.
00000100:00000001:11.0:1773851875.394511:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851875.394511:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851875.394511:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851875.394512:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6e3c109 nid 26577@kfi7 refs 2
00000800:00000200:9.0:1773851875.394513:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 26577@kfi7(000000002fb93420):0x0 lsk 1431 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x596 Transaction freed
00000800:00000200:13.0:1773851875.404433:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851875.404434:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851875.404435:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851875.404437:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851875.404439:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25072@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.404441:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25072@kfi7 : PUT - for me
00000400:00000200:13.0:1773851875.404442:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25072@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.404443:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9e579eb nid 25072@kfi7 refs 1
00000400:00000200:13.0:1773851875.404444:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25072@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.404445:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9e579eb nid 25072@kfi7 refs 2
00000400:00000200:13.0:1773851875.404446:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c9e579eb nid 25072@kfi7 refs 3
00000400:00000200:13.0:1773851875.404446:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25072@kfi7 to cpt 3
00000400:00000200:13.0:1773851875.404447:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25072@kfi7 of length 224 into portal 12 MB=0x699e17572f040
00000400:00000200:13.0:1773851875.404448:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25072@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 37520
00000800:00000200:13.0:1773851875.404450:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851875.404452:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851875.404453:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25072@kfi7: PUT: OK
00000100:00000001:13.0:1773851875.404454:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851875.404454:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851875.404456:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000095c871b3.
00000100:00000040:13.0:1773851875.404457:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000095c871b3 x1858043477422144 msgsize 224
00000100:00100000:13.0:1773851875.404458:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25072@kfi7 (source: 12345-25072@kfi7)
00000100:00000001:13.0:1773851875.404459:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851875.404460:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9e579eb nid 25072@kfi7 refs 2
00000100:00000001:15.0:1773851875.404461:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851875.404461:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851875.404462:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851875.404462:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851875.404462:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851875.404463:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851875.404464:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043477422144
00000020:00000001:15.0:1773851875.404465:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851875.404465:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92dd5
00000020:00000001:15.0:1773851875.404466:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851875.404469:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f122192d refcount=6
00000020:00000001:15.0:1773851875.404470:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744441856 : -107128965109760 : ffff9e911816e800)
00000020:00000001:15.0:1773851875.404470:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744441856 : -107128965109760 : ffff9e911816e800)
00000100:00000001:15.0:1773851875.404471:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851875.404472:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851875.404473:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000342ec44.
00000020:00000010:15.0:1773851875.404474:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851875.404475:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851875.404475:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851875.404476:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851875.404476:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851875.404477:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851875.404478:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851875.404478:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.404479:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851875.404480:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851875.404481:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851875.404481:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851875.404481:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851875.404482:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25072@kfi7, seq: 2289864
00000100:00000040:15.0:1773851875.404483:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f122192d : new rpc_count 1
00000100:00000001:15.0:1773851875.404483:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636977661265920 : -107096048285696 : ffff9e98c215c800)
00000100:00000001:12.0:1773851875.404483:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851875.404483:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851875.404484:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000095c871b3 x1858043477422144/t0(0) o400->7149e037-56be-4e60-875c-9669df254afa@25072@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2045-0'
00000100:00000001:15.0:1773851875.404487:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851875.404488:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851875.404489:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095c871b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7149e037-56be-4e60-875c-9669df254afa+6:39653:x1858043477422144:12345-25072@kfi7:400:default-tuolumne2045-0
00000100:00000200:15.0:1773851875.404490:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043477422144
00000020:00000001:15.0:1773851875.404491:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851875.404491:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851875.404492:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.404492:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851875.404493:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851875.404494:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851875.404494:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043477422144, found 0 last_xid 1858043477422143
00000020:00000001:15.0:1773851875.404495:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851875.404496:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851875.404496:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851875.404497:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.404497:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851875.404498:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851875.404498:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851875.404499:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cebe397c.
02000000:00000001:15.0:1773851875.404500:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.404500:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.404501:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851875.404502:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014124816, transno 0, xid 1858043477422144
00010000:00000001:15.0:1773851875.404502:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851875.404503:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000095c871b3 x1858043477422144/t0(0) o400->7149e037-56be-4e60-875c-9669df254afa@25072@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2045-0'
00010000:00000001:15.0:1773851875.404505:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851875.404506:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851875.404506:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=108 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851875.404507:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851875.404508:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000048975ba0 refcount 3 to 25072@kfi7
00000100:00000001:15.0:1773851875.404509:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729297056 : -107155980254560 : ffff9e8acddc82a0)
02000000:00000001:15.0:1773851875.404510:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851875.404511:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851875.404511:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851875.404512:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25072@kfi7
00000400:00000010:15.0:1773851875.404513:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9765a66.
00000100:00000200:15.0:1773851875.404513:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043477422144, offset 224
00000400:00000200:15.0:1773851875.404515:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25072@kfi7
00000400:00000200:15.0:1773851875.404516:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25072@kfi7 to cpt 3
00000400:00000200:15.0:1773851875.404516:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c9e579eb nid 25072@kfi7 refs 1
00000400:00000200:15.0:1773851875.404517:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c9e579eb nid 25072@kfi7 refs 2
00000400:00000200:15.0:1773851875.404519:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c9e579eb nid 25072@kfi7 refs 3
00000400:00000200:15.0:1773851875.404520:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25072@kfi7 local destination
00000400:00000200:15.0:1773851875.404521:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769511:8769511:1024:4294967295] 25072@kfi7 LPNI seq info [696161:696161:16:4294967295]
00000400:00000200:15.0:1773851875.404522:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c9e579eb nid 25072@kfi7 refs 2
00000400:00000200:15.0:1773851875.404523:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25072@kfi7 to cpt 3
00000400:00000200:15.0:1773851875.404525:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25072@kfi7(25072@kfi7:25072@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851875.404526:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c9e579eb nid 25072@kfi7 refs 3
00000800:00000200:15.0:1773851875.404527:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851875.404528:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851875.404530:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851875.404533:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x784 Using peer 25072@kfi7(0x784)
00000800:00000200:15.0:1773851875.404536:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x784: rc=0
00000800:00000200:15.0:1773851875.404537:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x784 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851875.404539:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851875.404540:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000048975ba0 refcount 2 to 25072@kfi7
00010000:00000001:15.0:1773851875.404541:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851875.404542:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851875.404543:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851875.404543:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000095c871b3 x1858043477422144/t0(0) o400->7149e037-56be-4e60-875c-9669df254afa@25072@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2045-0'
00000100:00100000:15.0:1773851875.404547:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095c871b3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7149e037-56be-4e60-875c-9669df254afa+6:39653:x1858043477422144:12345-25072@kfi7:400:default-tuolumne2045-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851875.404549:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25072@kfi7, seq: 2289864
00000100:00000040:15.0:1773851875.404550:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f122192d : new rpc_count 0
00000800:00000200:13.0:1773851875.404550:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x784 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851875.404551:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851875.404551:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851875.404551:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851875.404552:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851875.404552:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000400:00000200:13.0:1773851875.404552:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25072@kfi7: PUT: OK
00000020:00000010:15.0:1773851875.404553:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000342ec44.
00000400:00000200:13.0:1773851875.404553:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9765a66
00000020:00000040:15.0:1773851875.404554:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000f122192d : new refcount 5
00000400:00000010:13.0:1773851875.404554:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9765a66.
00000100:00000001:13.0:1773851875.404554:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851875.404555:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851875.404555:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851875.404556:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c9e579eb nid 25072@kfi7 refs 2
00000800:00000200:13.0:1773851875.404557:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 25072@kfi7(000000004f923c23):0x0 lsk 1925 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x784 Transaction freed
00000800:00000200:26.0:1773851875.416781:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851875.416781:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851875.416783:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851875.416785:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851875.416787:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:26.0:1773851875.416788:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24827@kfi7 : PUT - for me
00000400:00000200:26.0:1773851875.416788:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:26.0:1773851875.416789:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 1
00000400:00000200:26.0:1773851875.416791:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:26.0:1773851875.416791:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000400:00000200:26.0:1773851875.416792:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 3
00000400:00000200:26.0:1773851875.416793:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24826@kfi7 to cpt 3
00000400:00000200:26.0:1773851875.416794:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24826@kfi7 of length 224 into portal 12 MB=0x699de8d44be80
00000400:00000200:26.0:1773851875.416795:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24826@kfi7 of length 224/224 into md 0x16159c9699 [64] + 22552
00000800:00000200:26.0:1773851875.416798:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851875.416799:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851875.416800:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24827@kfi7: PUT: OK
00000100:00000001:26.0:1773851875.416801:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851875.416802:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851875.416803:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006d31b448.
00000100:00000040:26.0:1773851875.416803:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000006d31b448 x1858030992146048 msgsize 224
00000100:00100000:26.0:1773851875.416805:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-24826@kfi7 (source: 12345-24827@kfi7)
00000100:00000001:26.0:1773851875.416806:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851875.416807:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:26.0:1773851875.416807:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
02000000:00000001:27.0:1773851875.416808:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851875.416808:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:26.0:1773851875.416808:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851875.416809:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851875.416810:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851875.416810:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030992146048
00000020:00000001:27.0:1773851875.416811:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851875.416811:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91333
00000020:00000001:27.0:1773851875.416812:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851875.416813:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004aa8b75c refcount=6
00000020:00000001:27.0:1773851875.416814:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716210688 : -107155993340928 : ffff9e8acd14d400)
00000020:00000001:27.0:1773851875.416815:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716210688 : -107155993340928 : ffff9e8acd14d400)
00000100:00000001:27.0:1773851875.416816:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.416816:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851875.416817:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008506402b.
00000020:00000010:27.0:1773851875.416818:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851875.416819:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008f193acf.
00000100:00000001:27.0:1773851875.416820:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851875.416820:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851875.416820:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851875.416821:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851875.416822:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851875.416822:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.416823:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851875.416824:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851875.416824:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851875.416825:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851875.416825:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851875.416826:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24826@kfi7, seq: 2025128
00000100:00000040:27.0:1773851875.416826:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004aa8b75c : new rpc_count 1
00000100:00000001:26.0:1773851875.416826:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.416827:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637093150713728 : -106980558837888 : ffff9eb3a5cae780)
00000100:00000001:26.0:1773851875.416827:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.416828:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006d31b448 x1858030992146048/t0(0) o400->853e7b3f-e454-45db-962b-8fa4e1da9ce8@24826@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne265-0'
00000100:00000001:27.0:1773851875.416831:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.416831:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851875.416832:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d31b448 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:853e7b3f-e454-45db-962b-8fa4e1da9ce8+6:47865:x1858030992146048:12345-24826@kfi7:400:default-tuolumne265-0
00000100:00000200:27.0:1773851875.416834:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030992146048
00000020:00000001:27.0:1773851875.416835:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851875.416836:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851875.416836:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.416837:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851875.416837:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851875.416838:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851875.416839:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030992146048, found 0 last_xid 1858030992146047
00000020:00000001:27.0:1773851875.416840:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851875.416840:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851875.416841:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851875.416841:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.416842:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851875.416842:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851875.416843:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851875.416844:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000814db2e2.
02000000:00000001:27.0:1773851875.416844:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.416845:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.416846:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851875.416846:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768334, transno 0, xid 1858030992146048
00010000:00000001:27.0:1773851875.416847:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851875.416848:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006d31b448 x1858030992146048/t0(0) o400->853e7b3f-e454-45db-962b-8fa4e1da9ce8@24826@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne265-0'
00010000:00000001:27.0:1773851875.416850:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851875.416851:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851875.416852:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=108 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851875.416853:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851875.416853:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b3d5deb2 refcount 5 to 24826@kfi7
00000100:00000001:27.0:1773851875.416854:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015834496 : -107152693717120 : ffff9e8b91c11780)
02000000:00000001:27.0:1773851875.416855:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851875.416855:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.416856:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851875.416857:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24827@kfi7
00000400:00000010:27.0:1773851875.416857:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bb280001.
00000100:00000200:27.0:1773851875.416860:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030992146048, offset 224
00000400:00000200:27.0:1773851875.416861:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24827@kfi7
00000400:00000200:27.0:1773851875.416862:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.416863:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 1
00000400:00000200:27.0:1773851875.416864:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000400:00000200:27.0:1773851875.416865:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 3
00000400:00000200:27.0:1773851875.416866:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24827@kfi7 local destination
00000400:00000200:27.0:1773851875.416867:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769512:8769512:1024:4294967295] 24827@kfi7 LPNI seq info [28028:28028:16:4294967295]
00000400:00000200:27.0:1773851875.416869:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000400:00000200:27.0:1773851875.416869:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.416871:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24827@kfi7(24827@kfi7:24827@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851875.416873:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 3
00000800:00000200:27.0:1773851875.416874:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851875.416875:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851875.416877:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851875.416880:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000369 Using peer 24827@kfi7(0x100000000000369)
00000800:00000200:27.0:1773851875.416883:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0x100000000000369: rc=0
00000800:00000200:27.0:1773851875.416885:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000369 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851875.416887:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.416887:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b3d5deb2 refcount 4 to 24826@kfi7
00010000:00000001:27.0:1773851875.416888:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851875.416889:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.416889:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851875.416890:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006d31b448 x1858030992146048/t0(0) o400->853e7b3f-e454-45db-962b-8fa4e1da9ce8@24826@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne265-0'
00000100:00100000:27.0:1773851875.416893:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d31b448 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:853e7b3f-e454-45db-962b-8fa4e1da9ce8+6:47865:x1858030992146048:12345-24826@kfi7:400:default-tuolumne265-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851875.416896:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24826@kfi7, seq: 2025128
00000100:00000040:27.0:1773851875.416897:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004aa8b75c : new rpc_count 0
00000800:00000200:26.0:1773851875.416897:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000369 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851875.416898:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851875.416898:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851875.416899:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:26.0:1773851875.416899:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851875.416900:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008f193acf.
00000020:00000010:27.0:1773851875.416900:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008506402b.
00000400:00000200:26.0:1773851875.416900:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24827@kfi7: PUT: OK
00000400:00000200:26.0:1773851875.416900:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bb280001
00000020:00000040:27.0:1773851875.416901:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000004aa8b75c : new refcount 5
00000400:00000010:26.0:1773851875.416901:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bb280001.
00000100:00000001:27.0:1773851875.416902:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851875.416902:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851875.416902:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851875.416903:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000800:00000200:26.0:1773851875.416905:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 24827@kfi7(00000000d96ec8d7):0x0 lsk 874 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000369 Transaction freed
00000800:00000200:17.0:1773851875.431500:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851875.431501:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851875.431503:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851875.431506:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851875.431510:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18098@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.431512:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18098@kfi7 : PUT - for me
00000400:00000200:17.0:1773851875.431513:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18098@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.431515:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002bb74527 nid 18098@kfi7 refs 1
00000400:00000200:17.0:1773851875.431516:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18098@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.431517:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002bb74527 nid 18098@kfi7 refs 2
00000400:00000200:17.0:1773851875.431519:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002bb74527 nid 18098@kfi7 refs 3
00000400:00000200:17.0:1773851875.431520:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18035@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.431522:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18035@kfi7 of length 224 into portal 12 MB=0x69b4b65b0ca40
00000400:00000200:17.0:1773851875.431524:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18035@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 23752
00000800:00000200:17.0:1773851875.431526:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851875.431529:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851875.431531:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18098@kfi7: PUT: OK
00000100:00000001:17.0:1773851875.431532:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851875.431533:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851875.431534:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e00208d.
00000100:00000040:17.0:1773851875.431535:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000005e00208d x1859597991201344 msgsize 224
00000100:00100000:17.0:1773851875.431538:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18035@kfi7 (source: 12345-18098@kfi7)
00000100:00000001:17.0:1773851875.431539:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851875.431540:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002bb74527 nid 18098@kfi7 refs 2
00000100:00000001:16.0:1773851875.431542:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851875.431543:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851875.431543:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851875.431544:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851875.431545:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851875.431546:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851875.431548:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597991201344
00000020:00000001:16.0:1773851875.431549:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851875.431549:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822f4
00000020:00000001:16.0:1773851875.431551:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851875.431553:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000821d5b33 refcount=5
00000020:00000001:16.0:1773851875.431555:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637159442157568 : -106914267394048 : ffff9ec315121000)
00000020:00000001:16.0:1773851875.431556:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637159442157568 : -106914267394048 : ffff9ec315121000)
00000100:00000001:16.0:1773851875.431558:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851875.431559:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851875.431560:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091929c7c.
00000020:00000010:16.0:1773851875.431562:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851875.431563:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851875.431565:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851875.431565:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851875.431566:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851875.431568:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851875.431569:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851875.431570:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851875.431571:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851875.431574:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851875.431574:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851875.431574:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851875.431575:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851875.431576:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18035@kfi7, seq: 2156357
00000100:00000040:16.0:1773851875.431577:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000821d5b33 : new rpc_count 1
00000100:00000001:17.0:1773851875.431578:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851875.431579:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851875.431579:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372341760 : -107078337209856 : ffff9e9ce1bf5a00)
00000100:00000040:16.0:1773851875.431580:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005e00208d x1859597991201344/t0(0) o400->f18ef873-e6d9-43ab-a233-67e9c9651ed2@18035@kfi7:96/0 lens 224/0 e 0 to 0 dl 1773852211 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1610-0'
00000100:00000001:16.0:1773851875.431585:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851875.431586:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851875.431587:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e00208d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f18ef873-e6d9-43ab-a233-67e9c9651ed2+5:39616:x1859597991201344:12345-18035@kfi7:400:default-tuolumne1610-0
00000100:00000200:16.0:1773851875.431590:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597991201344
00000020:00000001:16.0:1773851875.431591:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851875.431592:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851875.431593:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851875.431594:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851875.431595:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851875.431596:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851875.431597:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597991201344, found 0 last_xid 1859597991201343
00000020:00000001:16.0:1773851875.431599:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851875.431600:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851875.431601:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851875.431602:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851875.431603:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851875.431604:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851875.431605:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851875.431606:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ff5597ac.
02000000:00000001:16.0:1773851875.431607:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851875.431608:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851875.431609:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851875.431610:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262836703, transno 0, xid 1859597991201344
00010000:00000001:16.0:1773851875.431611:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851875.431613:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005e00208d x1859597991201344/t0(0) o400->f18ef873-e6d9-43ab-a233-67e9c9651ed2@18035@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1610-0'
00010000:00000001:16.0:1773851875.431617:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851875.431617:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851875.431619:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=108 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851875.431620:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851875.431622:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000adf995a6 refcount 3 to 18035@kfi7
00000100:00000001:16.0:1773851875.431623:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519392 : -107156126032224 : ffff9e8ac52c1ea0)
02000000:00000001:16.0:1773851875.431624:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851875.431625:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851875.431626:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851875.431627:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18098@kfi7
00000400:00000010:16.0:1773851875.431628:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003fc27269.
00000100:00000200:16.0:1773851875.431630:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597991201344, offset 224
00000400:00000200:16.0:1773851875.431632:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18098@kfi7
00000400:00000200:16.0:1773851875.431634:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18098@kfi7 to cpt 4
00000400:00000200:16.0:1773851875.431635:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002bb74527 nid 18098@kfi7 refs 1
00000400:00000200:16.0:1773851875.431637:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002bb74527 nid 18098@kfi7 refs 2
00000400:00000200:16.0:1773851875.431638:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002bb74527 nid 18098@kfi7 refs 3
00000400:00000200:16.0:1773851875.431640:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18098@kfi7 local destination
00000400:00000200:16.0:1773851875.431643:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769513:8769513:1024:4294967295] 18098@kfi7 LPNI seq info [947513:947513:16:4294967295]
00000400:00000200:16.0:1773851875.431645:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002bb74527 nid 18098@kfi7 refs 2
00000400:00000200:16.0:1773851875.431647:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18098@kfi7 to cpt 4
00000400:00000200:16.0:1773851875.431650:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18098@kfi7(18098@kfi7:18098@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851875.431652:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002bb74527 nid 18098@kfi7 refs 3
00000800:00000200:16.0:1773851875.431655:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851875.431657:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851875.431661:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851875.431664:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c59 Using peer 18098@kfi7(0x100000000000c59)
00000800:00000200:16.0:1773851875.431670:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x100000000000c59: rc=0
00000800:00000200:16.0:1773851875.431672:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c59 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851875.431676:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851875.431677:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000adf995a6 refcount 2 to 18035@kfi7
00010000:00000001:16.0:1773851875.431678:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851875.431681:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851875.431682:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851875.431683:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e00208d x1859597991201344/t0(0) o400->f18ef873-e6d9-43ab-a233-67e9c9651ed2@18035@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1610-0'
00000100:00100000:16.0:1773851875.431689:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e00208d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:f18ef873-e6d9-43ab-a233-67e9c9651ed2+5:39616:x1859597991201344:12345-18035@kfi7:400:default-tuolumne1610-0 Request processed in 102us (152us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851875.431693:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18035@kfi7, seq: 2156357
00000100:00000040:16.0:1773851875.431694:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000821d5b33 : new rpc_count 0
00000100:00000001:16.0:1773851875.431695:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851875.431696:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851875.431696:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851875.431698:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:16.0:1773851875.431699:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091929c7c.
00000020:00000040:16.0:1773851875.431702:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000821d5b33 : new refcount 4
00000100:00000001:16.0:1773851875.431703:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851875.431711:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c59 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851875.431714:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851875.431716:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18098@kfi7: PUT: OK
00000400:00000200:17.0:1773851875.431717:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003fc27269
00000400:00000010:17.0:1773851875.431718:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003fc27269.
00000100:00000001:17.0:1773851875.431719:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851875.431720:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851875.431721:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002bb74527 nid 18098@kfi7 refs 2
00000800:00000200:17.0:1773851875.431724:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 18098@kfi7(00000000a2a1624e):0x0 lsk 3162 rsk 25 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c59 Transaction freed
00010000:00000001:2.0:1773851875.465729:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465729:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851875.465730:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465730:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851875.465731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851875.465732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851875.465733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851875.465734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851875.465735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851875.465736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851875.465736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851875.465739:0:849257:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851875.465739:0:849257:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851875.465740:0:849257:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:5.0:1773851875.502899:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851875.502900:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851875.502902:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851875.502904:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851875.502906:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8481@kfi7 to cpt 1
00000400:00000200:5.0:1773851875.502908:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8481@kfi7 : PUT - for me
00000400:00000200:5.0:1773851875.502909:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8481@kfi7 to cpt 1
00000400:00000200:5.0:1773851875.502909:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c6501865 nid 8481@kfi7 refs 1
00000400:00000200:5.0:1773851875.502910:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8481@kfi7 to cpt 1
00000400:00000200:5.0:1773851875.502911:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c6501865 nid 8481@kfi7 refs 2
00000400:00000200:5.0:1773851875.502912:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c6501865 nid 8481@kfi7 refs 3
00000400:00000200:5.0:1773851875.502913:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8673@kfi7 to cpt 4
00000400:00000200:5.0:1773851875.502914:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8673@kfi7 of length 224 into portal 12 MB=0x69b94de1909c0
00000400:00000200:5.0:1773851875.502915:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8673@kfi7 of length 224/224 into md 0x793926dc5 [64] + 148952
00000800:00000200:5.0:1773851875.502917:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851875.502920:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851875.502921:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8481@kfi7: PUT: OK
00000100:00000001:5.0:1773851875.502922:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851875.502922:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851875.502923:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc43218c.
00000100:00000040:5.0:1773851875.502923:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000bc43218c x1859913543911872 msgsize 224
00000100:00100000:5.0:1773851875.502925:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-8673@kfi7 (source: 12345-8481@kfi7)
00000100:00000001:5.0:1773851875.502926:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851875.502927:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c6501865 nid 8481@kfi7 refs 2
00000800:00000200:5.0:1773851875.502929:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851875.502929:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851875.502930:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851875.502931:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851875.502932:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851875.502933:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851875.502934:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859913543911872
00000020:00000001:4.0:1773851875.502935:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851875.502936:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b4fd0ec9a
00000020:00000001:4.0:1773851875.502937:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851875.502940:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b88ff20f refcount=10
00000020:00000001:4.0:1773851875.502941:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131271785472 : -106942437766144 : ffff9ebc85fc4c00)
00000020:00000001:4.0:1773851875.502942:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131271785472 : -106942437766144 : ffff9ebc85fc4c00)
00000100:00000001:4.0:1773851875.502944:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851875.502945:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851875.502946:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000004817707.
00000020:00000010:4.0:1773851875.502947:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851875.502949:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000025e99aed.
00000100:00000001:4.0:1773851875.502950:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851875.502951:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851875.502951:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851875.502953:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851875.502954:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851875.502954:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.502956:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851875.502958:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851875.502958:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851875.502958:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851875.502958:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851875.502959:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8673@kfi7, seq: 2001936
00000100:00000040:7.0:1773851875.502960:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b88ff20f : new rpc_count 2
00000100:00000001:7.0:1773851875.502961:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273383552 : -107034436168064 : ffff9ea71a741680)
00000100:00000001:4.0:1773851875.502961:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851875.502962:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc43218c x1859913543911872/t0(0) o400->28906e78-e409-4eb1-af7f-b3f7f66f1164@8673@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1023-0'
00000100:00000001:4.0:1773851875.502962:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.502965:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851875.502966:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851875.502967:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc43218c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:28906e78-e409-4eb1-af7f-b3f7f66f1164+10:39513:x1859913543911872:12345-8673@kfi7:400:default-tuolumne1023-0
00000100:00000200:7.0:1773851875.502969:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859913543911872
00000020:00000001:7.0:1773851875.502970:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851875.502970:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851875.502971:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.502972:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851875.502972:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851875.502973:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851875.502974:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859913543911872, found 0 last_xid 1859913543527999
00000020:00000001:7.0:1773851875.502974:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851875.502975:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851875.502976:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851875.502976:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.502977:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851875.502977:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851875.502978:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851875.502979:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a95a50f2.
02000000:00000001:7.0:1773851875.502979:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.502980:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.502981:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851875.502981:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183061391986, transno 0, xid 1859913543911872
00010000:00000001:7.0:1773851875.502982:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851875.502983:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc43218c x1859913543911872/t0(0) o400->28906e78-e409-4eb1-af7f-b3f7f66f1164@8673@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1023-0'
00010000:00000001:7.0:1773851875.502985:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851875.502986:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851875.502987:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=107 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851875.502988:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851875.502988:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bb1dba3f refcount 3 to 8673@kfi7
00000100:00000001:7.0:1773851875.502989:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583952608 : -107156125599008 : ffff9e8ac532bae0)
02000000:00000001:7.0:1773851875.502990:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851875.502991:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.502991:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851875.502993:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8481@kfi7
00000400:00000010:7.0:1773851875.502993:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000100:00000200:7.0:1773851875.502994:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859913543911872, offset 224
00000400:00000200:7.0:1773851875.502996:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8481@kfi7
00000400:00000200:7.0:1773851875.502997:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8481@kfi7 to cpt 1
00000400:00000200:7.0:1773851875.502998:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c6501865 nid 8481@kfi7 refs 1
00000400:00000200:7.0:1773851875.502999:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c6501865 nid 8481@kfi7 refs 2
00000400:00000200:7.0:1773851875.503000:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c6501865 nid 8481@kfi7 refs 3
00000400:00000200:7.0:1773851875.503002:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8481@kfi7 local destination
00000400:00000200:7.0:1773851875.503003:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769514:8769514:1024:4294967295] 8481@kfi7 LPNI seq info [2635530:2635530:16:4294967295]
00000400:00000200:7.0:1773851875.503004:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c6501865 nid 8481@kfi7 refs 2
00000400:00000200:7.0:1773851875.503005:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8481@kfi7 to cpt 1
00000400:00000200:7.0:1773851875.503008:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8481@kfi7(8481@kfi7:8481@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851875.503009:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c6501865 nid 8481@kfi7 refs 3
00000800:00000200:7.0:1773851875.503010:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851875.503011:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851875.503013:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851875.503015:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdb8 Using peer 8481@kfi7(0xdb8)
00000800:00000200:7.0:1773851875.503018:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0xdb8: rc=0
00000800:00000200:7.0:1773851875.503020:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdb8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851875.503022:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851875.503022:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bb1dba3f refcount 2 to 8673@kfi7
00010000:00000001:7.0:1773851875.503023:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851875.503024:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.503024:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851875.503025:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc43218c x1859913543911872/t0(0) o400->28906e78-e409-4eb1-af7f-b3f7f66f1164@8673@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1023-0'
00000800:00000200:5.0:1773851875.503033:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdb8 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851875.503034:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc43218c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:28906e78-e409-4eb1-af7f-b3f7f66f1164+10:39513:x1859913543911872:12345-8673@kfi7:400:default-tuolumne1023-0 Request processed in 68us (110us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851875.503035:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851875.503036:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8481@kfi7: PUT: OK
00000100:00100000:7.0:1773851875.503037:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8673@kfi7, seq: 2001936
00000100:00000040:7.0:1773851875.503037:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b88ff20f : new rpc_count 1
00000400:00000200:5.0:1773851875.503037:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000400:00000010:5.0:1773851875.503037:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000100:00000001:7.0:1773851875.503038:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851875.503038:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851875.503039:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851875.503039:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000100:00000001:5.0:1773851875.503039:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851875.503040:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000025e99aed.
00000400:00000200:5.0:1773851875.503040:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c6501865 nid 8481@kfi7 refs 2
00000020:00000010:7.0:1773851875.503041:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000004817707.
00000800:00000200:5.0:1773851875.503041:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 8481@kfi7(000000004aab2941):0x0 lsk 3513 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0xdb8 Transaction freed
00000020:00000040:7.0:1773851875.503042:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000b88ff20f : new refcount 9
00000100:00000001:7.0:1773851875.503043:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851875.555006:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851875.555007:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851875.555008:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851875.555009:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851875.555011:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.555012:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12794@kfi7 : PUT - for me
00000400:00000200:21.0:1773851875.555013:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.555014:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 1
00000400:00000200:21.0:1773851875.555015:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.555016:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000400:00000200:21.0:1773851875.555016:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 3
00000400:00000200:21.0:1773851875.555018:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12795@kfi7 to cpt 0
00000400:00000200:21.0:1773851875.555019:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12795@kfi7 of length 224 into portal 12 MB=0x699de896efb40
00000400:00000200:21.0:1773851875.555020:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12795@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 45872
00000800:00000200:21.0:1773851875.555021:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851875.555023:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851875.555023:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12794@kfi7: PUT: OK
00000100:00000001:21.0:1773851875.555024:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851875.555025:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851875.555025:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007840ff75.
00000100:00000040:21.0:1773851875.555026:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000007840ff75 x1858030927805248 msgsize 224
00000100:00100000:21.0:1773851875.555027:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12795@kfi7 (source: 12345-12794@kfi7)
00000100:00000001:21.0:1773851875.555028:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851875.555029:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000100:00000001:23.0:1773851875.555030:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851875.555030:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851875.555030:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851875.555031:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851875.555031:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851875.555032:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851875.555033:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030927805248
00000020:00000001:23.0:1773851875.555033:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851875.555034:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91038
00000020:00000001:23.0:1773851875.555034:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851875.555036:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000085cf932e refcount=6
00000020:00000001:23.0:1773851875.555037:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240114176 : -107152469437440 : ffff9e8b9f1f5400)
00000020:00000001:23.0:1773851875.555038:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240114176 : -107152469437440 : ffff9e8b9f1f5400)
00000100:00000001:23.0:1773851875.555039:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.555040:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851875.555041:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851875.555042:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851875.555043:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851875.555043:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851875.555044:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851875.555044:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.555046:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851875.555046:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851875.555047:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555047:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.555048:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851875.555049:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851875.555049:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851875.555049:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851875.555050:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12795@kfi7, seq: 1998003
00000100:00000040:23.0:1773851875.555051:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000085cf932e : new rpc_count 1
00000100:00000001:20.0:1773851875.555051:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555052:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794379392 : -106943915172224 : ffff9ebc2decde80)
00000100:00000001:20.0:1773851875.555052:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.555054:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007840ff75 x1858030927805248/t0(0) o400->2af1e518-d9d9-468f-8545-adb021e0832d@12795@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne218-0'
00000100:00000001:23.0:1773851875.555057:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.555057:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851875.555058:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007840ff75 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:2af1e518-d9d9-468f-8545-adb021e0832d+6:47644:x1858030927805248:12345-12795@kfi7:400:default-tuolumne218-0
00000100:00000200:23.0:1773851875.555059:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030927805248
00000020:00000001:23.0:1773851875.555060:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851875.555061:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851875.555061:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555062:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851875.555062:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851875.555063:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851875.555064:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030927805248, found 0 last_xid 1858030927805247
00000020:00000001:23.0:1773851875.555065:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851875.555065:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851875.555066:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851875.555066:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555067:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851875.555068:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851875.555068:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851875.555069:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b5b545a6.
02000000:00000001:23.0:1773851875.555069:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555070:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555071:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851875.555071:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030927805248
00010000:00000001:23.0:1773851875.555072:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851875.555073:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007840ff75 x1858030927805248/t0(0) o400->2af1e518-d9d9-468f-8545-adb021e0832d@12795@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne218-0'
00010000:00000001:23.0:1773851875.555075:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851875.555076:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851875.555076:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=108 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851875.555077:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851875.555078:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007fc93222 refcount 5 to 12795@kfi7
00000100:00000001:23.0:1773851875.555079:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545858976 : -107154163692640 : ffff9e8b3a230ba0)
02000000:00000001:23.0:1773851875.555080:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851875.555080:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555081:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851875.555082:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12794@kfi7
00000400:00000010:23.0:1773851875.555083:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036e7b619.
00000100:00000200:23.0:1773851875.555083:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030927805248, offset 224
00000400:00000200:23.0:1773851875.555085:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12794@kfi7
00000400:00000200:23.0:1773851875.555085:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:23.0:1773851875.555086:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 1
00000400:00000200:23.0:1773851875.555087:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000400:00000200:23.0:1773851875.555089:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 3
00000400:00000200:23.0:1773851875.555090:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12794@kfi7 local destination
00000400:00000200:23.0:1773851875.555091:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769515:8769515:1024:4294967295] 12794@kfi7 LPNI seq info [24441:24441:16:4294967295]
00000400:00000200:23.0:1773851875.555092:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000400:00000200:23.0:1773851875.555093:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:23.0:1773851875.555095:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12794@kfi7(12794@kfi7:12794@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851875.555096:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 3
00000800:00000200:23.0:1773851875.555098:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851875.555099:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851875.555101:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851875.555103:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c3c Using peer 12794@kfi7(0x100000000000c3c)
00000800:00000200:23.0:1773851875.555106:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x100000000000c3c: rc=0
00000800:00000200:23.0:1773851875.555107:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c3c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851875.555109:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.555110:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007fc93222 refcount 4 to 12795@kfi7
00010000:00000001:23.0:1773851875.555111:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851875.555112:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555112:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851875.555113:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007840ff75 x1858030927805248/t0(0) o400->2af1e518-d9d9-468f-8545-adb021e0832d@12795@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne218-0'
00000100:00100000:23.0:1773851875.555116:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007840ff75 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:2af1e518-d9d9-468f-8545-adb021e0832d+6:47644:x1858030927805248:12345-12795@kfi7:400:default-tuolumne218-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851875.555117:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c3c TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851875.555118:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12795@kfi7, seq: 1998003
00000100:00000040:23.0:1773851875.555119:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000085cf932e : new rpc_count 0
00000400:00000200:21.0:1773851875.555119:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851875.555120:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851875.555120:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851875.555120:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12794@kfi7: PUT: OK
00000400:00000200:21.0:1773851875.555120:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036e7b619
00000020:00000010:23.0:1773851875.555121:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851875.555121:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000010:21.0:1773851875.555121:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036e7b619.
00000100:00000001:21.0:1773851875.555121:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851875.555122:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000100:00000001:21.0:1773851875.555122:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:23.0:1773851875.555123:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000085cf932e : new refcount 5
00000400:00000200:21.0:1773851875.555123:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000100:00000001:23.0:1773851875.555124:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851875.555124:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 12794@kfi7(00000000b3d39400):0x0 lsk 3133 rsk 89 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c3c Transaction freed
00000800:00000200:21.0:1773851875.555356:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851875.555357:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851875.555359:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851875.555363:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851875.555367:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.555369:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12794@kfi7 : PUT - for me
00000400:00000200:21.0:1773851875.555370:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.555372:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 1
00000400:00000200:21.0:1773851875.555373:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:21.0:1773851875.555374:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000400:00000200:21.0:1773851875.555376:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 3
00000400:00000200:21.0:1773851875.555377:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12795@kfi7 to cpt 0
00000400:00000200:21.0:1773851875.555379:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12795@kfi7 of length 224 into portal 12 MB=0x699de896f0300
00000400:00000200:21.0:1773851875.555381:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12795@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 46096
00000800:00000200:21.0:1773851875.555383:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851875.555386:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851875.555388:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12794@kfi7: PUT: OK
00000100:00000001:21.0:1773851875.555389:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851875.555390:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851875.555391:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000feb9fd9b.
00000100:00000040:21.0:1773851875.555392:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000feb9fd9b x1858030927807232 msgsize 224
00000100:00100000:21.0:1773851875.555395:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12795@kfi7 (source: 12345-12794@kfi7)
00000100:00000001:21.0:1773851875.555396:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851875.555398:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000100:00000001:23.0:1773851875.555399:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851875.555400:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851875.555400:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851875.555401:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851875.555401:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851875.555403:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851875.555404:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030927807232
00000020:00000001:23.0:1773851875.555405:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851875.555405:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91284
00000020:00000001:23.0:1773851875.555406:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851875.555412:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ea61c51c refcount=6
00000020:00000001:23.0:1773851875.555413:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716213760 : -107155993337856 : ffff9e8acd14e000)
00000020:00000001:23.0:1773851875.555414:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716213760 : -107155993337856 : ffff9e8acd14e000)
00000100:00000001:23.0:1773851875.555416:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.555417:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851875.555418:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851875.555419:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851875.555421:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851875.555422:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851875.555423:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851875.555424:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.555425:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851875.555426:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851875.555426:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555428:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.555430:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851875.555431:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851875.555431:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851875.555432:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12795@kfi7, seq: 1998004
00000100:00000001:20.0:1773851875.555432:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851875.555434:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ea61c51c : new rpc_count 1
00000100:00000001:20.0:1773851875.555434:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555435:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794360960 : -106943915190656 : ffff9ebc2dec9680)
00000100:00000001:20.0:1773851875.555435:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.555437:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000feb9fd9b x1858030927807232/t0(0) o400->155139bb-d932-4b1b-8b15-3cd78c737c86@12795@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne218-0'
00000100:00000001:23.0:1773851875.555442:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.555443:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851875.555444:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000feb9fd9b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:155139bb-d932-4b1b-8b15-3cd78c737c86+6:47641:x1858030927807232:12345-12795@kfi7:400:default-tuolumne218-0
00000100:00000200:23.0:1773851875.555446:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030927807232
00000020:00000001:23.0:1773851875.555447:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851875.555448:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851875.555449:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555450:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851875.555451:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851875.555452:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851875.555453:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030927807232, found 0 last_xid 1858030927807231
00000020:00000001:23.0:1773851875.555454:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851875.555455:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851875.555455:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851875.555456:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555457:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851875.555458:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851875.555458:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851875.555459:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b72ef93.
02000000:00000001:23.0:1773851875.555460:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555461:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555462:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851875.555463:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768301, transno 0, xid 1858030927807232
00010000:00000001:23.0:1773851875.555464:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851875.555465:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000feb9fd9b x1858030927807232/t0(0) o400->155139bb-d932-4b1b-8b15-3cd78c737c86@12795@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne218-0'
00010000:00000001:23.0:1773851875.555469:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851875.555470:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851875.555471:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=108 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851875.555472:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851875.555473:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007fc93222 refcount 5 to 12795@kfi7
00000100:00000001:23.0:1773851875.555474:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545858976 : -107154163692640 : ffff9e8b3a230ba0)
02000000:00000001:23.0:1773851875.555475:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851875.555476:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.555477:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851875.555478:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12794@kfi7
00000400:00000010:23.0:1773851875.555479:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037bf7dea.
00000100:00000200:23.0:1773851875.555480:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030927807232, offset 224
00000400:00000200:23.0:1773851875.555482:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12794@kfi7
00000400:00000200:23.0:1773851875.555483:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:23.0:1773851875.555485:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 1
00000400:00000200:23.0:1773851875.555486:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000400:00000200:23.0:1773851875.555488:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 3
00000400:00000200:23.0:1773851875.555489:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12794@kfi7 local destination
00000400:00000200:23.0:1773851875.555491:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769516:8769516:1024:4294967295] 12794@kfi7 LPNI seq info [24442:24442:16:4294967295]
00000400:00000200:23.0:1773851875.555493:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000400:00000200:23.0:1773851875.555495:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12794@kfi7 to cpt 5
00000400:00000200:23.0:1773851875.555498:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12794@kfi7(12794@kfi7:12794@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851875.555500:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 3
00000800:00000200:23.0:1773851875.555502:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851875.555504:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851875.555507:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851875.555511:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x324 Using peer 12794@kfi7(0x324)
00000800:00000200:23.0:1773851875.555515:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x324: rc=0
00000800:00000200:23.0:1773851875.555518:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x324 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851875.555521:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.555522:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007fc93222 refcount 4 to 12795@kfi7
00010000:00000001:23.0:1773851875.555523:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851875.555524:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.555524:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851875.555526:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000feb9fd9b x1858030927807232/t0(0) o400->155139bb-d932-4b1b-8b15-3cd78c737c86@12795@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne218-0'
00000100:00100000:23.0:1773851875.555530:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000feb9fd9b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:155139bb-d932-4b1b-8b15-3cd78c737c86+6:47641:x1858030927807232:12345-12795@kfi7:400:default-tuolumne218-0 Request processed in 88us (137us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851875.555533:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x324 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851875.555534:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12795@kfi7, seq: 1998004
00000100:00000040:23.0:1773851875.555535:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ea61c51c : new rpc_count 0
00000400:00000200:21.0:1773851875.555535:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851875.555536:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851875.555537:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851875.555537:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851875.555537:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12794@kfi7: PUT: OK
00000020:00000010:23.0:1773851875.555538:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851875.555538:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037bf7dea
00000020:00000010:23.0:1773851875.555539:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000400:00000010:21.0:1773851875.555539:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037bf7dea.
00000100:00000001:21.0:1773851875.555539:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:23.0:1773851875.555540:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000ea61c51c : new refcount 5
00000100:00000001:21.0:1773851875.555540:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851875.555541:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851875.555542:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d21c41c nid 12794@kfi7 refs 2
00000800:00000200:21.0:1773851875.555544:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 12794@kfi7(00000000758d2cb0):0x0 lsk 805 rsk 88 tsk 0 trmk 0 tmk 0 trr 5 tta 0x324 Transaction freed
00000800:00000200:25.0:1773851875.567743:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851875.567744:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851875.567746:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851875.567748:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851875.567750:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14800@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.567751:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14800@kfi7 : PUT - for me
00000400:00000200:25.0:1773851875.567752:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14800@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.567753:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000036d915dd nid 14800@kfi7 refs 1
00000400:00000200:25.0:1773851875.567754:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14800@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.567755:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000036d915dd nid 14800@kfi7 refs 2
00000400:00000200:25.0:1773851875.567756:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000036d915dd nid 14800@kfi7 refs 3
00000400:00000200:25.0:1773851875.567757:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14608@kfi7 to cpt 4
00000400:00000200:25.0:1773851875.567757:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14608@kfi7 of length 224 into portal 12 MB=0x69b4b8aa217c0
00000400:00000200:25.0:1773851875.567759:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14608@kfi7 of length 224/224 into md 0x16159c9699 [64] + 22776
00000800:00000200:25.0:1773851875.567760:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851875.567762:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851875.567763:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14800@kfi7: PUT: OK
00000100:00000001:25.0:1773851875.567764:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851875.567764:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851875.567765:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000493d4652.
00000100:00000040:25.0:1773851875.567766:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000493d4652 x1859598610995136 msgsize 224
00000100:00100000:25.0:1773851875.567767:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-14608@kfi7 (source: 12345-14800@kfi7)
00000100:00000001:25.0:1773851875.567769:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851875.567770:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000036d915dd nid 14800@kfi7 refs 2
00000100:00000001:27.0:1773851875.567771:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851875.567771:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851875.567772:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851875.567773:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851875.567773:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851875.567775:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851875.567776:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598610995136
00000020:00000001:27.0:1773851875.567777:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851875.567778:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e245f7426
00000020:00000001:27.0:1773851875.567778:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851875.567781:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000073ef1c01 refcount=5
00000020:00000001:27.0:1773851875.567783:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074378893312 : -106999330658304 : ffff9eaf46e7a800)
00000020:00000001:27.0:1773851875.567784:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637074378893312 : -106999330658304 : ffff9eaf46e7a800)
00000100:00000001:27.0:1773851875.567785:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.567787:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851875.567788:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008506402b.
00000020:00000010:27.0:1773851875.567789:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851875.567790:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008f193acf.
00000100:00000001:27.0:1773851875.567792:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851875.567792:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851875.567793:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851875.567795:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851875.567795:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851875.567796:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.567798:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851875.567800:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851875.567801:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851875.567801:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851875.567801:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851875.567803:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14608@kfi7, seq: 2025129
00000100:00000040:26.0:1773851875.567804:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000073ef1c01 : new rpc_count 1
00000100:00000001:27.0:1773851875.567805:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.567806:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851875.567806:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637124127570560 : -106949581981056 : ffff9ebadc283a80)
00000100:00000040:26.0:1773851875.567808:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000493d4652 x1859598610995136/t0(0) o400->17c29000-7884-42b1-a82d-6c3b0a9e329c@14608@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1409-0'
00000100:00000001:26.0:1773851875.567813:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851875.567813:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851875.567815:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000493d4652 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:17c29000-7884-42b1-a82d-6c3b0a9e329c+5:39551:x1859598610995136:12345-14608@kfi7:400:default-tuolumne1409-0
00000100:00000200:26.0:1773851875.567817:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598610995136
00000020:00000001:26.0:1773851875.567818:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851875.567819:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851875.567821:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851875.567822:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851875.567823:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851875.567824:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851875.567825:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598610995136, found 0 last_xid 1859598610995135
00000020:00000001:26.0:1773851875.567826:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851875.567827:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851875.567828:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851875.567829:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851875.567830:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851875.567831:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851875.567832:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851875.567833:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab566ca3.
02000000:00000001:26.0:1773851875.567835:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851875.567836:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851875.567837:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851875.567838:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096696762, transno 0, xid 1859598610995136
00010000:00000001:26.0:1773851875.567840:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851875.567841:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000493d4652 x1859598610995136/t0(0) o400->17c29000-7884-42b1-a82d-6c3b0a9e329c@14608@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1409-0'
00010000:00000001:26.0:1773851875.567846:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851875.567847:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851875.567848:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=108 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851875.567850:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851875.567851:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000009ff17aa refcount 3 to 14608@kfi7
00000100:00000001:26.0:1773851875.567852:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583952032 : -107156125599584 : ffff9e8ac532b8a0)
02000000:00000001:26.0:1773851875.567854:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851875.567855:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851875.567856:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851875.567857:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14800@kfi7
00000400:00000010:26.0:1773851875.567858:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006957f781.
00000100:00000200:26.0:1773851875.567860:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598610995136, offset 224
00000400:00000200:26.0:1773851875.567862:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14800@kfi7
00000400:00000200:26.0:1773851875.567864:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14800@kfi7 to cpt 6
00000400:00000200:26.0:1773851875.567865:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000036d915dd nid 14800@kfi7 refs 1
00000400:00000200:26.0:1773851875.567867:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000036d915dd nid 14800@kfi7 refs 2
00000400:00000200:26.0:1773851875.567869:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000036d915dd nid 14800@kfi7 refs 3
00000400:00000200:26.0:1773851875.567871:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14800@kfi7 local destination
00000400:00000200:26.0:1773851875.567874:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769517:8769517:1024:4294967295] 14800@kfi7 LPNI seq info [10753314:10753314:16:4294967295]
00000400:00000200:26.0:1773851875.567876:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000036d915dd nid 14800@kfi7 refs 2
00000400:00000200:26.0:1773851875.567877:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14800@kfi7 to cpt 6
00000400:00000200:26.0:1773851875.567881:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14800@kfi7(14800@kfi7:14800@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851875.567884:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000036d915dd nid 14800@kfi7 refs 3
00000800:00000200:26.0:1773851875.567886:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851875.567888:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851875.567892:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851875.567896:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001175 Using peer 14800@kfi7(0x100000000001175)
00000800:00000200:26.0:1773851875.567901:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0x100000000001175: rc=0
00000800:00000200:26.0:1773851875.567904:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001175 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851875.567907:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851875.567909:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000009ff17aa refcount 2 to 14608@kfi7
00010000:00000001:26.0:1773851875.567910:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851875.567911:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851875.567912:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851875.567913:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000493d4652 x1859598610995136/t0(0) o400->17c29000-7884-42b1-a82d-6c3b0a9e329c@14608@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1409-0'
00000800:00000200:25.0:1773851875.567915:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001175 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851875.567917:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:26.0:1773851875.567918:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000493d4652 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:17c29000-7884-42b1-a82d-6c3b0a9e329c+5:39551:x1859598610995136:12345-14608@kfi7:400:default-tuolumne1409-0 Request processed in 105us (151us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851875.567918:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14800@kfi7: PUT: OK
00000400:00000200:25.0:1773851875.567919:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006957f781
00000400:00000010:25.0:1773851875.567919:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006957f781.
00000100:00000001:25.0:1773851875.567920:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851875.567920:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851875.567921:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000036d915dd nid 14800@kfi7 refs 2
00000100:00100000:26.0:1773851875.567922:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14608@kfi7, seq: 2025129
00000100:00000040:26.0:1773851875.567923:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000073ef1c01 : new rpc_count 0
00000800:00000200:25.0:1773851875.567923:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 14800@kfi7(000000002ba9e40a):0x0 lsk 4470 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001175 Transaction freed
00000100:00000001:26.0:1773851875.567925:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851875.567925:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851875.567926:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:26.0:1773851875.567928:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008f193acf.
00000020:00000010:26.0:1773851875.567929:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008506402b.
00000020:00000040:26.0:1773851875.567931:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000073ef1c01 : new refcount 4
00000100:00000001:26.0:1773851875.567932:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851875.619171:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851875.619172:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851875.619173:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851875.619175:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851875.619177:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.619178:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.113@tcp : PUT - for me
00000400:00000200:17.0:1773851875.619180:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.619181:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851875.619182:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.113@tcp to cpt 5
00000400:00000200:17.0:1773851875.619182:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c6f3bad nid 172.16.70.113@tcp refs 2
00000400:00000200:17.0:1773851875.619184:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005c6f3bad nid 172.16.70.113@tcp refs 3
00000400:00000200:17.0:1773851875.619185:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.113@tcp to cpt 5
00000400:00000200:17.0:1773851875.619186:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.113@tcp of length 224 into portal 12 MB=0x69a0e9e031440
00000400:00000200:17.0:1773851875.619187:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.113@tcp of length 224/224 into md 0x6a32cacf5 [64] + 46320
00000800:00000200:17.0:1773851875.619189:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851875.619192:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851875.619193:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851875.619194:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851875.619195:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851875.619195:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b5273339.
00000100:00000040:17.0:1773851875.619196:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b5273339 x1858237431485504 msgsize 224
00000100:00100000:17.0:1773851875.619198:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.113@tcp (source: 12345-172.16.70.113@tcp)
00000100:00000001:17.0:1773851875.619200:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851875.619201:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851875.619202:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851875.619203:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851875.619203:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851875.619204:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851875.619204:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851875.619205:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851875.619206:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858237431485504
00000020:00000001:23.0:1773851875.619207:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851875.619207:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93075
00000020:00000001:23.0:1773851875.619208:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851875.619210:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f2afb623 refcount=6
00000020:00000001:23.0:1773851875.619211:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745163776 : -107128964387840 : ffff9e911821ec00)
00000020:00000001:23.0:1773851875.619212:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745163776 : -107128964387840 : ffff9e911821ec00)
00000100:00000001:23.0:1773851875.619213:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.619214:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851875.619215:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851875.619215:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851875.619216:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851875.619217:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851875.619218:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851875.619218:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.619219:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851875.619219:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851875.619220:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.619221:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851875.619222:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851875.619222:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851875.619223:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851875.619223:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851875.619224:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.113@tcp, seq: 1998005
00000100:00000040:23.0:1773851875.619224:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f2afb623 : new rpc_count 1
00000100:00000001:20.0:1773851875.619224:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.619225:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372327936 : -107078337223680 : ffff9e9ce1bf2400)
00000100:00000001:20.0:1773851875.619225:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.619226:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b5273339 x1858237431485504/t0(0) o400->b752d59b-dfe2-42ff-a06e-b7ae61461cd9@172.16.70.113@tcp:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic13-0'
00000100:00000001:23.0:1773851875.619229:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851875.619229:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851875.619230:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5273339 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b752d59b-dfe2-42ff-a06e-b7ae61461cd9+6:50016:x1858237431485504:12345-172.16.70.113@tcp:400:default-rzslic13-0
00000100:00000200:23.0:1773851875.619232:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858237431485504
00000020:00000001:23.0:1773851875.619232:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851875.619233:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851875.619234:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.619234:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851875.619235:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851875.619236:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851875.619236:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858237431485504, found 0 last_xid 1858237431485503
00000020:00000001:23.0:1773851875.619237:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851875.619238:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851875.619238:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851875.619239:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.619239:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851875.619240:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851875.619240:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851875.619241:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e3f29f72.
02000000:00000001:23.0:1773851875.619242:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.619242:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.619243:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851875.619244:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858237431485504
00010000:00000001:23.0:1773851875.619244:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851875.619245:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b5273339 x1858237431485504/t0(0) o400->b752d59b-dfe2-42ff-a06e-b7ae61461cd9@172.16.70.113@tcp:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic13-0'
00010000:00000001:23.0:1773851875.619247:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851875.619248:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851875.619249:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=108 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851875.619250:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851875.619250:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c447df8f refcount 3 to 172.16.70.113@tcp
00000100:00000001:23.0:1773851875.619251:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450656 : -107146752100960 : ffff9e8cf3e6f5a0)
02000000:00000001:23.0:1773851875.619252:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851875.619252:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851875.619253:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851875.619254:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.113@tcp
00000400:00000010:23.0:1773851875.619255:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001f94b366.
00000100:00000200:23.0:1773851875.619255:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858237431485504, offset 224
00000400:00000200:23.0:1773851875.619257:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.113@tcp
00000400:00000200:23.0:1773851875.619258:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.113@tcp to cpt 5
00000400:00000200:23.0:1773851875.619258:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c6f3bad nid 172.16.70.113@tcp refs 2
00000400:00000200:23.0:1773851875.619260:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005c6f3bad nid 172.16.70.113@tcp refs 3
00000400:00000200:23.0:1773851875.619261:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005c6f3bad nid 172.16.70.113@tcp refs 4
00000400:00000200:23.0:1773851875.619262:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.113@tcp routed destination
00000400:00000200:23.0:1773851875.619263:0:60934:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851875.619264:0:60934:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:23.0:1773851875.619265:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.113@tcp: rtr pref emtpy: 1
00000400:00000200:23.0:1773851875.619266:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851875.619267:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.113@tcp: rtr pref emtpy: 1
00000400:00000200:23.0:1773851875.619268:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851875.619269:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769518:8769518:1024:4294967295] 17@kfi7 LPNI seq info [1250891905:1250891905:16:4294967295]
00000400:00000200:23.0:1773851875.619270:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:23.0:1773851875.619271:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:23.0:1773851875.619273:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.113@tcp(172.16.70.113@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851875.619275:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005c6f3bad nid 172.16.70.113@tcp refs 3
00000800:00000200:23.0:1773851875.619276:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851875.619277:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851875.619279:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851875.619281:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:23.0:1773851875.619284:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:23.0:1773851875.619285:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851875.619288:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851875.619288:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c447df8f refcount 2 to 172.16.70.113@tcp
00010000:00000001:23.0:1773851875.619289:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851875.619290:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851875.619290:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851875.619291:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b5273339 x1858237431485504/t0(0) o400->b752d59b-dfe2-42ff-a06e-b7ae61461cd9@172.16.70.113@tcp:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic13-0'
00000100:00100000:23.0:1773851875.619294:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5273339 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b752d59b-dfe2-42ff-a06e-b7ae61461cd9+6:50016:x1858237431485504:12345-172.16.70.113@tcp:400:default-rzslic13-0 Request processed in 64us (97us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851875.619296:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.113@tcp, seq: 1998005
00000800:00000200:21.0:1773851875.619296:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851875.619297:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f2afb623 : new rpc_count 0
00000100:00000001:23.0:1773851875.619298:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851875.619298:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851875.619298:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851875.619299:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851875.619299:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000010:23.0:1773851875.619300:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:23.0:1773851875.619300:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000400:00000200:21.0:1773851875.619300:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001f94b366
00000400:00000010:21.0:1773851875.619300:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001f94b366.
00000020:00000040:23.0:1773851875.619301:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000f2afb623 : new refcount 5
00000100:00000001:21.0:1773851875.619301:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851875.619301:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851875.619302:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851875.619302:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:21.0:1773851875.619303:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Transaction freed
00000800:00000200:2.0:1773851875.626768:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851875.626769:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851875.626770:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851875.626773:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851875.626775:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:2.0:1773851875.626776:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8698@kfi7 : PUT - for me
00000400:00000200:2.0:1773851875.626777:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:2.0:1773851875.626778:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 1
00000400:00000200:2.0:1773851875.626778:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:2.0:1773851875.626779:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000400:00000200:2.0:1773851875.626780:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 3
00000400:00000200:2.0:1773851875.626781:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:2.0:1773851875.626782:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8698@kfi7 of length 224 into portal 12 MB=0x699df02cfb300
00000400:00000200:2.0:1773851875.626783:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8698@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 36688
00000800:00000200:2.0:1773851875.626785:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851875.626788:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851875.626789:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8698@kfi7: PUT: OK
00000100:00000001:2.0:1773851875.626790:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851875.626790:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851875.626791:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009eb20ced.
00000100:00000040:2.0:1773851875.626792:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000009eb20ced x1858032964186880 msgsize 224
00000100:00100000:2.0:1773851875.626793:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-8698@kfi7 (source: 12345-8698@kfi7)
00000100:00000001:2.0:1773851875.626795:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851875.626795:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000800:00000200:2.0:1773851875.626797:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851875.626798:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851875.626799:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851875.626799:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851875.626800:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851875.626802:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851875.626803:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858032964186880
00000020:00000001:1.0:1773851875.626804:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851875.626805:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f4a
00000020:00000001:1.0:1773851875.626806:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851875.626809:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004afbcea7 refcount=6
00000020:00000001:1.0:1773851875.626810:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239886848 : -107152469664768 : ffff9e8b9f1bdc00)
00000020:00000001:1.0:1773851875.626812:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239886848 : -107152469664768 : ffff9e8b9f1bdc00)
00000100:00000001:1.0:1773851875.626813:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851875.626814:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851875.626815:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000199054b2.
00000020:00000010:1.0:1773851875.626817:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851875.626819:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002726eb16.
00000100:00000001:1.0:1773851875.626820:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851875.626821:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851875.626822:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851875.626824:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851875.626825:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851875.626826:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851875.626827:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851875.626829:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851875.626829:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851875.626829:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851875.626830:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851875.626830:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8698@kfi7, seq: 1997578
00000100:00000001:1.0:1773851875.626831:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851875.626831:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004afbcea7 : new rpc_count 1
00000100:00000001:0.0:1773851875.626832:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706785664 : -106953002765952 : ffff9eba10433180)
00000100:00000001:1.0:1773851875.626833:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851875.626833:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009eb20ced x1858032964186880/t0(0) o400->29cc4304-e201-4a5f-b97f-c545dbbd5109@8698@kfi7:515/0 lens 224/0 e 0 to 0 dl 1773852630 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne202-0'
00000100:00000001:0.0:1773851875.626836:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851875.626836:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851875.626837:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eb20ced pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:29cc4304-e201-4a5f-b97f-c545dbbd5109+6:49892:x1858032964186880:12345-8698@kfi7:400:default-tuolumne202-0
00000100:00000200:0.0:1773851875.626838:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858032964186880
00000020:00000001:0.0:1773851875.626839:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851875.626840:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851875.626840:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851875.626841:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851875.626841:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851875.626842:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851875.626843:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858032964186880, found 0 last_xid 1858032964186879
00000020:00000001:0.0:1773851875.626844:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851875.626844:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851875.626845:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851875.626845:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851875.626846:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851875.626846:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851875.626848:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851875.626849:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006fc2a86b.
02000000:00000001:0.0:1773851875.626849:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851875.626850:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851875.626851:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851875.626851:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858032964186880
00010000:00000001:0.0:1773851875.626852:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851875.626853:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009eb20ced x1858032964186880/t0(0) o400->29cc4304-e201-4a5f-b97f-c545dbbd5109@8698@kfi7:515/0 lens 224/224 e 0 to 0 dl 1773852630 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne202-0'
00010000:00000001:0.0:1773851875.626855:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851875.626856:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851875.626856:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=108 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851875.626857:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851875.626858:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dc59ba28 refcount 5 to 8698@kfi7
00000100:00000001:0.0:1773851875.626859:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049760 : -107154804501856 : ffff9e8b13f112a0)
02000000:00000001:0.0:1773851875.626860:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851875.626860:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851875.626861:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851875.626862:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8698@kfi7
00000400:00000010:0.0:1773851875.626863:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a3358ad2.
00000100:00000200:0.0:1773851875.626864:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858032964186880, offset 224
00000400:00000200:0.0:1773851875.626865:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8698@kfi7
00000400:00000200:0.0:1773851875.626866:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:0.0:1773851875.626867:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 1
00000400:00000200:0.0:1773851875.626868:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000400:00000200:0.0:1773851875.626869:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 3
00000400:00000200:0.0:1773851875.626870:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8698@kfi7 local destination
00000400:00000200:0.0:1773851875.626871:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769519:8769519:1024:4294967295] 8698@kfi7 LPNI seq info [27978:27978:16:4294967295]
00000400:00000200:0.0:1773851875.626873:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000400:00000200:0.0:1773851875.626873:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:0.0:1773851875.626875:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8698@kfi7(8698@kfi7:8698@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851875.626876:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 3
00000800:00000200:0.0:1773851875.626878:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851875.626879:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851875.626881:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851875.626883:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79c Using peer 8698@kfi7(0x79c)
00000800:00000200:0.0:1773851875.626886:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x79c: rc=0
00000800:00000200:0.0:1773851875.626887:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851875.626889:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851875.626890:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dc59ba28 refcount 4 to 8698@kfi7
00010000:00000001:0.0:1773851875.626891:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851875.626891:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851875.626892:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851875.626893:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009eb20ced x1858032964186880/t0(0) o400->29cc4304-e201-4a5f-b97f-c545dbbd5109@8698@kfi7:515/0 lens 224/224 e 0 to 0 dl 1773852630 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne202-0'
00000100:00100000:0.0:1773851875.626897:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eb20ced pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:29cc4304-e201-4a5f-b97f-c545dbbd5109+6:49892:x1858032964186880:12345-8698@kfi7:400:default-tuolumne202-0 Request processed in 60us (104us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851875.626900:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8698@kfi7, seq: 1997578
00000100:00000040:0.0:1773851875.626900:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004afbcea7 : new rpc_count 0
00000100:00000001:0.0:1773851875.626901:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851875.626901:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851875.626902:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:0.0:1773851875.626903:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002726eb16.
00000020:00000010:0.0:1773851875.626904:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000199054b2.
00000020:00000040:0.0:1773851875.626904:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004afbcea7 : new refcount 5
00000100:00000001:0.0:1773851875.626905:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851875.626911:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79c TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851875.626912:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851875.626913:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8698@kfi7: PUT: OK
00000400:00000200:2.0:1773851875.626914:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a3358ad2
00000400:00000010:2.0:1773851875.626915:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a3358ad2.
00000100:00000001:2.0:1773851875.626915:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851875.626916:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851875.626917:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000095b7fbf8 nid 8698@kfi7 refs 2
00000800:00000200:2.0:1773851875.626918:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8698@kfi7(000000004dce3771):0x0 lsk 1949 rsk 241 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79c Transaction freed
00000800:00000200:17.0:1773851875.631962:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851875.631963:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851875.631964:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851875.631966:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851875.631968:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.631969:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.112@tcp : PUT - for me
00000400:00000200:17.0:1773851875.631970:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.631971:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851875.631972:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.112@tcp to cpt 4
00000400:00000200:17.0:1773851875.631973:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000035cce02b nid 172.16.70.112@tcp refs 2
00000400:00000200:17.0:1773851875.631974:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000035cce02b nid 172.16.70.112@tcp refs 3
00000400:00000200:17.0:1773851875.631975:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.112@tcp to cpt 4
00000400:00000200:17.0:1773851875.631976:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.112@tcp of length 224 into portal 12 MB=0x69a0ea7a334c0
00000400:00000200:17.0:1773851875.631978:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.112@tcp of length 224/224 into md 0x6ab01b5d1 [64] + 23976
00000800:00000200:17.0:1773851875.631980:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851875.631981:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851875.631983:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851875.631984:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851875.631984:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851875.631985:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000056c4c809.
00000100:00000040:17.0:1773851875.631986:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000056c4c809 x1858237592974528 msgsize 224
00000100:00100000:17.0:1773851875.631988:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.112@tcp (source: 12345-172.16.70.112@tcp)
00000100:00000001:17.0:1773851875.631988:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851875.631989:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851875.631991:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851875.631992:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851875.631993:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851875.631994:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851875.631995:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851875.631997:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851875.631999:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858237592974528
00000020:00000001:16.0:1773851875.632000:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851875.632001:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93083
00000020:00000001:16.0:1773851875.632002:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851875.632004:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004da7932f refcount=6
00000020:00000001:16.0:1773851875.632005:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745141248 : -107128964410368 : ffff9e9118219400)
00000020:00000001:16.0:1773851875.632007:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745141248 : -107128964410368 : ffff9e9118219400)
00000100:00000001:16.0:1773851875.632008:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851875.632009:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851875.632011:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000091929c7c.
00000020:00000010:16.0:1773851875.632013:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851875.632014:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d1f94e7.
00000100:00000001:16.0:1773851875.632016:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851875.632017:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851875.632018:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851875.632020:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851875.632021:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851875.632022:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851875.632024:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851875.632025:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851875.632026:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851875.632026:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851875.632027:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.112@tcp, seq: 2156358
00000100:00000001:16.0:1773851875.632027:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851875.632028:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004da7932f : new rpc_count 1
00000100:00000001:16.0:1773851875.632028:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851875.632029:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372323328 : -107078337228288 : ffff9e9ce1bf1200)
00000100:00000001:16.0:1773851875.632029:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851875.632030:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000056c4c809 x1858237592974528/t0(0) o400->0f37f8f1-889a-45d8-bf49-8b0016848abe@172.16.70.112@tcp:96/0 lens 224/0 e 0 to 0 dl 1773852211 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic12-0'
00000100:00000001:17.0:1773851875.632033:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851875.632033:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851875.632034:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056c4c809 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0f37f8f1-889a-45d8-bf49-8b0016848abe+6:50166:x1858237592974528:12345-172.16.70.112@tcp:400:default-rzslic12-0
00000100:00000200:17.0:1773851875.632036:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858237592974528
00000020:00000001:17.0:1773851875.632037:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851875.632037:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851875.632038:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.632039:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851875.632039:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851875.632040:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851875.632041:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858237592974528, found 0 last_xid 1858237592974527
00000020:00000001:17.0:1773851875.632042:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851875.632042:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851875.632043:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851875.632047:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.632048:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851875.632048:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851875.632049:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851875.632050:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008e7330c6.
02000000:00000001:17.0:1773851875.632050:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851875.632051:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.632052:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851875.632052:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858237592974528
00010000:00000001:17.0:1773851875.632053:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851875.632054:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000056c4c809 x1858237592974528/t0(0) o400->0f37f8f1-889a-45d8-bf49-8b0016848abe@172.16.70.112@tcp:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic12-0'
00010000:00000001:17.0:1773851875.632056:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851875.632057:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851875.632058:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=108 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851875.632059:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851875.632060:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f5bf0c39 refcount 3 to 172.16.70.112@tcp
00000100:00000001:17.0:1773851875.632060:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301335392 : -107155408216224 : ffff9e8aeff51f60)
02000000:00000001:17.0:1773851875.632061:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851875.632062:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851875.632062:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851875.632064:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.112@tcp
00000400:00000010:17.0:1773851875.632064:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d50c8a85.
00000100:00000200:17.0:1773851875.632065:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858237592974528, offset 224
00000400:00000200:17.0:1773851875.632066:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.112@tcp
00000400:00000200:17.0:1773851875.632067:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.112@tcp to cpt 4
00000400:00000200:17.0:1773851875.632068:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000035cce02b nid 172.16.70.112@tcp refs 2
00000400:00000200:17.0:1773851875.632069:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000035cce02b nid 172.16.70.112@tcp refs 3
00000400:00000200:17.0:1773851875.632071:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000035cce02b nid 172.16.70.112@tcp refs 4
00000400:00000200:17.0:1773851875.632072:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.112@tcp routed destination
00000400:00000200:17.0:1773851875.632073:0:60961:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:17.0:1773851875.632074:0:60961:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:17.0:1773851875.632075:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.112@tcp: rtr pref emtpy: 1
00000400:00000200:17.0:1773851875.632077:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:17.0:1773851875.632078:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.112@tcp: rtr pref emtpy: 1
00000400:00000200:17.0:1773851875.632079:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:17.0:1773851875.632080:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769520:8769520:1024:4294967295] 2094@kfi7 LPNI seq info [1258747005:1258747005:16:4294967295]
00000400:00000200:17.0:1773851875.632082:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851875.632083:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.632085:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.112@tcp(172.16.70.112@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851875.632086:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000035cce02b nid 172.16.70.112@tcp refs 3
00000800:00000200:17.0:1773851875.632087:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851875.632088:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851875.632090:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851875.632093:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:17.0:1773851875.632096:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:17.0:1773851875.632097:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851875.632100:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851875.632101:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f5bf0c39 refcount 2 to 172.16.70.112@tcp
00010000:00000001:17.0:1773851875.632101:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851875.632102:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.632103:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851875.632103:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000056c4c809 x1858237592974528/t0(0) o400->0f37f8f1-889a-45d8-bf49-8b0016848abe@172.16.70.112@tcp:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic12-0'
00000100:00100000:17.0:1773851875.632107:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056c4c809 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0f37f8f1-889a-45d8-bf49-8b0016848abe+6:50166:x1858237592974528:12345-172.16.70.112@tcp:400:default-rzslic12-0 Request processed in 73us (120us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851875.632109:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.112@tcp, seq: 2156358
00000100:00000040:17.0:1773851875.632110:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004da7932f : new rpc_count 0
00000100:00000001:17.0:1773851875.632112:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851875.632112:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:19.0:1773851875.632113:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851875.632113:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:17.0:1773851875.632114:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d1f94e7.
00000020:00000010:17.0:1773851875.632115:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000091929c7c.
00000020:00000040:17.0:1773851875.632115:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000004da7932f : new refcount 5
00000400:00000200:19.0:1773851875.632116:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851875.632116:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851875.632118:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:19.0:1773851875.632119:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d50c8a85
00000400:00000010:19.0:1773851875.632120:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d50c8a85.
00000100:00000001:19.0:1773851875.632121:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851875.632122:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851875.632123:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:19.0:1773851875.632126:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000004:00000001:6.0:1773851875.657731:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851875.657732:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851875.657733:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000055e2cb0c.
00000020:00000040:6.0:1773851875.657734:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851875.657735:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851875.657735:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851875.657736:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851875.657737:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003004e465.
00000100:00000001:6.0:1773851875.657738:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851875.657739:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851875.657739:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851875.657741:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000055e2cb0c] to pc [ptlrpcd_01_00+0]  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851875.657744:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:6.0:1773851875.657746:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000eea58807.
00080000:00000001:6.0:1773851875.657746:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637158660425728 : -106915049125888 : ffff9ec2e679c800)
00000100:00000001:4.0:1773851875.657746:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851875.657746:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:6.0:1773851875.657747:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851875.657747:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851875.657747:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.657747:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851875.657748:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851875.657748:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000100:00000040:4.0:1773851875.657748:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:6.0:1773851875.657749:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a7cf418b.
00000004:00080000:6.0:1773851875.657749:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614150111024971ns, next at 614151111024180ns, rc = 0
00080000:00000001:6.0:1773851875.657750:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851875.657750:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851875.657750:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851875.657751:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851875.657751:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851875.657751:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851875.657752:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851875.657752:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055e2cb0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051931840:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851875.657755:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851875.657756:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851875.657756:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851875.657757:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851875.657758:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000440074eb.
02000000:00000001:4.0:1773851875.657759:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851875.657760:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:4.0:1773851875.657760:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000010:4.0:1773851875.657761:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6473a15.
00000100:00000200:4.0:1773851875.657763:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931840, portal 4
00000100:00000001:4.0:1773851875.657763:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851875.657764:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814068096 : -107101895483520 : ffff9e9765909f80)
00000100:00000040:4.0:1773851875.657765:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851875.657767:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851875.657768:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:4.0:1773851875.657769:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d6fd271.
00000100:00000200:4.0:1773851875.657769:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931840, offset 0
00000400:00000200:4.0:1773851875.657771:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:4.0:1773851875.657772:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851875.657772:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:4.0:1773851875.657773:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851875.657775:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:4.0:1773851875.657776:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:4.0:1773851875.657777:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769519, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769520, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851875.657779:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851875.657780:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851875.657780:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:4.0:1773851875.657781:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769521:8769521:1024:4294967295] 16@kfi7 LPNI seq info [5403817:5403817:16:4294967295]
00000400:00000200:4.0:1773851875.657783:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851875.657783:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851875.657786:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851875.657787:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:4.0:1773851875.657789:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851875.657790:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851875.657792:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851875.657795:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Using peer 16@kfi7(0x15d)
00000800:00000200:4.0:1773851875.657797:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x15d: rc=0
00000800:00000200:4.0:1773851875.657799:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851875.657801:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.657802:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851875.657802:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.657803:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.657804:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851875.657805:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851875.657807:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851875.657807:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851875.657808:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851875.657811:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851875.657812:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851875.657812:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851875.657814:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851875.657817:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000400:00000200:5.0:1773851875.657818:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d6fd271
00000400:00000010:5.0:1773851875.657818:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d6fd271.
00000100:00000001:5.0:1773851875.657819:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851875.657820:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851875.657823:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851875.657823:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851875.657825:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851875.657826:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851875.657827:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:5.0:1773851875.657829:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Transaction freed
00000800:00000200:29.0:1773851875.657857:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851875.657858:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851875.657859:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851875.657861:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851875.657864:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.657865:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851875.657866:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.657866:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851875.657867:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.657868:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851875.657869:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851875.657870:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.657871:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b44c0
00000400:00000200:29.0:1773851875.657872:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851875.657873:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x780080e9d [1] + 224
00000800:00000200:29.0:1773851875.657875:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851875.657877:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851875.657878:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851875.657879:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851875.657880:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851875.657882:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851875.657886:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851875.657887:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:29.0:1773851875.657888:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851875.657888:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851875.657889:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851875.657890:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851875.657890:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851875.657891:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851875.657892:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6473a15
00000400:00000010:4.0:1773851875.657892:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6473a15.
00000100:00000001:4.0:1773851875.657893:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851875.657894:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851875.657897:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851875.657901:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851875.657902:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851875.657902:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851875.657903:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851875.657903:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851875.657904:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851875.657905:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851875.657906:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=108 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851875.657907:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=108 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851875.657908:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851875.657908:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851875.657909:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851875.657909:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.657910:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851875.657910:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:4.0:1773851875.657911:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851875.657912:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851875.657913:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851875.657915:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851875.657916:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851875.657916:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851875.657917:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851875.657917:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851875.657918:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482152960 avail=351481205760 avail_mb=1372973460 hwm_mb=3131103 files=372097085 ffree=343244290 state=0: rc = 0
00000004:00000020:4.0:1773851875.657920:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482152960 free, 351481205760 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097085 files, 343244290 free files
00000004:00000001:4.0:1773851875.657922:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851875.657923:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851875.657925:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055e2cb0c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051931840:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851875.657928:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851875.657928:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851875.657929:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000055e2cb0c x1859433051931840/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852028 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851875.657931:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851875.657931:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851875.657932:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000440074eb.
02000000:00000001:4.0:1773851875.657933:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851875.657933:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851875.657934:0:41064:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:4.0:1773851875.657934:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851875.657935:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003004e465.
02000000:00000001:4.0:1773851875.657936:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851875.657936:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851875.657937:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000055e2cb0c.
00000100:00000001:4.0:1773851875.657938:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851875.657938:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851875.657939:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851875.657939:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851875.657940:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.657940:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851875.657941:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851875.658501:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851875.658502:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851875.658503:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851875.658506:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851875.658507:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19299@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.658509:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19299@kfi7 : PUT - for me
00000400:00000200:9.0:1773851875.658509:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19299@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.658510:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003770e8ec nid 19299@kfi7 refs 1
00000400:00000200:9.0:1773851875.658511:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19299@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.658512:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003770e8ec nid 19299@kfi7 refs 2
00000400:00000200:9.0:1773851875.658513:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003770e8ec nid 19299@kfi7 refs 3
00000400:00000200:9.0:1773851875.658514:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19299@kfi7 to cpt 2
00000400:00000200:9.0:1773851875.658515:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19299@kfi7 of length 224 into portal 12 MB=0x699e0c4c14900
00000400:00000200:9.0:1773851875.658516:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19299@kfi7 of length 224/224 into md 0x78146ce49 [64] + 143736
00000800:00000200:9.0:1773851875.658518:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851875.658519:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851875.658520:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19299@kfi7: PUT: OK
00000100:00000001:9.0:1773851875.658521:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851875.658521:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851875.658522:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b5d00d99.
00000100:00000040:9.0:1773851875.658523:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000b5d00d99 x1858040512989440 msgsize 224
00000100:00100000:9.0:1773851875.658524:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-19299@kfi7 (source: 12345-19299@kfi7)
00000100:00000001:9.0:1773851875.658525:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851875.658526:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003770e8ec nid 19299@kfi7 refs 2
00000100:00000001:11.0:1773851875.658527:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851875.658527:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851875.658528:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851875.658528:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851875.658529:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851875.658530:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851875.658531:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040512989440
00000020:00000001:11.0:1773851875.658531:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851875.658532:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924f2
00000020:00000001:11.0:1773851875.658532:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851875.658536:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002399b650 refcount=6
00000020:00000001:11.0:1773851875.658537:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630769664 : -107123078781952 : ffff9e9276f12400)
00000020:00000001:11.0:1773851875.658538:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630769664 : -107123078781952 : ffff9e9276f12400)
00000100:00000001:11.0:1773851875.658539:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851875.658541:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851875.658542:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008e6ffc9a.
00000020:00000010:11.0:1773851875.658543:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851875.658544:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851875.658546:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851875.658546:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851875.658547:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851875.658548:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851875.658549:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851875.658549:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.658550:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851875.658552:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851875.658552:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851875.658552:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851875.658553:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19299@kfi7, seq: 2130805
00000100:00000001:8.0:1773851875.658553:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851875.658554:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002399b650 : new rpc_count 1
00000100:00000001:8.0:1773851875.658554:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.658555:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096245120 : -107006613306496 : ffff9ead94d34380)
00000100:00000001:8.0:1773851875.658555:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851875.658556:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b5d00d99 x1858040512989440/t0(0) o400->5e907f9e-d8a7-45f0-82f1-fa4230b0f3f3@19299@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1692-0'
00000100:00000001:11.0:1773851875.658559:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851875.658559:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851875.658560:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5d00d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5e907f9e-d8a7-45f0-82f1-fa4230b0f3f3+6:39783:x1858040512989440:12345-19299@kfi7:400:default-tuolumne1692-0
00000100:00000200:11.0:1773851875.658561:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040512989440
00000020:00000001:11.0:1773851875.658562:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851875.658562:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851875.658563:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.658564:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851875.658565:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851875.658565:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851875.658566:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040512989440, found 0 last_xid 1858040512989439
00000020:00000001:11.0:1773851875.658567:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851875.658568:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851875.658568:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851875.658569:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.658570:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851875.658571:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851875.658571:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851875.658572:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000020699928.
02000000:00000001:11.0:1773851875.658573:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.658573:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.658574:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851875.658575:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254665446, transno 0, xid 1858040512989440
00010000:00000001:11.0:1773851875.658576:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851875.658577:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b5d00d99 x1858040512989440/t0(0) o400->5e907f9e-d8a7-45f0-82f1-fa4230b0f3f3@19299@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1692-0'
00010000:00000001:11.0:1773851875.658579:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851875.658580:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851875.658581:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=108 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851875.658582:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851875.658582:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000052d417c6 refcount 3 to 19299@kfi7
00000100:00000001:11.0:1773851875.658583:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551675168 : -107156157876448 : ffff9e8ac3463720)
02000000:00000001:11.0:1773851875.658584:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851875.658585:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851875.658585:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851875.658586:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19299@kfi7
00000400:00000010:11.0:1773851875.658587:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b9bacf7b.
00000100:00000200:11.0:1773851875.658587:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040512989440, offset 224
00000400:00000200:11.0:1773851875.658589:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19299@kfi7
00000400:00000200:11.0:1773851875.658590:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19299@kfi7 to cpt 2
00000400:00000200:11.0:1773851875.658590:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003770e8ec nid 19299@kfi7 refs 1
00000400:00000200:11.0:1773851875.658591:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003770e8ec nid 19299@kfi7 refs 2
00000400:00000200:11.0:1773851875.658593:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003770e8ec nid 19299@kfi7 refs 3
00000400:00000200:11.0:1773851875.658594:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19299@kfi7 local destination
00000400:00000200:11.0:1773851875.658595:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769522:8769522:1024:4294967295] 19299@kfi7 LPNI seq info [10122732:10122732:16:4294967295]
00000400:00000200:11.0:1773851875.658596:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003770e8ec nid 19299@kfi7 refs 2
00000400:00000200:11.0:1773851875.658597:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19299@kfi7 to cpt 2
00000400:00000200:11.0:1773851875.658599:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19299@kfi7(19299@kfi7:19299@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851875.658601:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003770e8ec nid 19299@kfi7 refs 3
00000800:00000200:11.0:1773851875.658603:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851875.658604:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851875.658606:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851875.658608:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000341 Using peer 19299@kfi7(0x100000000000341)
00000800:00000200:11.0:1773851875.658611:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x100000000000341: rc=0
00000800:00000200:11.0:1773851875.658612:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000341 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851875.658614:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851875.658615:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000052d417c6 refcount 2 to 19299@kfi7
00010000:00000001:11.0:1773851875.658616:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851875.658616:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851875.658617:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851875.658618:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b5d00d99 x1858040512989440/t0(0) o400->5e907f9e-d8a7-45f0-82f1-fa4230b0f3f3@19299@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1692-0'
00000100:00100000:11.0:1773851875.658621:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5d00d99 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5e907f9e-d8a7-45f0-82f1-fa4230b0f3f3+6:39783:x1858040512989440:12345-19299@kfi7:400:default-tuolumne1692-0 Request processed in 61us (97us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851875.658623:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19299@kfi7, seq: 2130805
00000100:00000040:11.0:1773851875.658624:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002399b650 : new rpc_count 0
00000800:00000200:9.0:1773851875.658624:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000341 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851875.658625:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851875.658625:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851875.658626:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851875.658626:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000400:00000200:9.0:1773851875.658626:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851875.658627:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008e6ffc9a.
00000400:00000200:9.0:1773851875.658627:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19299@kfi7: PUT: OK
00000020:00000040:11.0:1773851875.658628:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000002399b650 : new refcount 5
00000100:00000001:11.0:1773851875.658629:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851875.658630:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b9bacf7b
00000400:00000010:9.0:1773851875.658630:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b9bacf7b.
00000100:00000001:9.0:1773851875.658631:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851875.658632:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851875.658632:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003770e8ec nid 19299@kfi7 refs 2
00000800:00000200:9.0:1773851875.658634:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 19299@kfi7(0000000049496f48):0x0 lsk 834 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000341 Transaction freed
00000800:00000200:25.0:1773851875.685116:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851875.685118:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851875.685119:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851875.685121:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851875.685123:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8192@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.685124:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8192@kfi7 : PUT - for me
00000400:00000200:25.0:1773851875.685125:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8192@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.685126:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071758d87 nid 8192@kfi7 refs 1
00000400:00000200:25.0:1773851875.685127:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8192@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.685127:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071758d87 nid 8192@kfi7 refs 2
00000400:00000200:25.0:1773851875.685128:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000071758d87 nid 8192@kfi7 refs 3
00000400:00000200:25.0:1773851875.685129:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8193@kfi7 to cpt 1
00000400:00000200:25.0:1773851875.685130:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8193@kfi7 of length 224 into portal 12 MB=0x69bad05914d40
00000400:00000200:25.0:1773851875.685131:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8193@kfi7 of length 224/224 into md 0x16159c9699 [64] + 23000
00000800:00000200:25.0:1773851875.685132:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851875.685134:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851875.685135:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8192@kfi7: PUT: OK
00000100:00000001:25.0:1773851875.685136:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851875.685137:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851875.685138:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008562292d.
00000100:00000040:25.0:1773851875.685139:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000008562292d x1860017285320000 msgsize 224
00000100:00100000:25.0:1773851875.685140:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8193@kfi7 (source: 12345-8192@kfi7)
00000100:00000001:25.0:1773851875.685141:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851875.685142:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000071758d87 nid 8192@kfi7 refs 2
00000100:00000001:26.0:1773851875.685143:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851875.685143:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851875.685144:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851875.685144:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851875.685145:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851875.685145:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851875.685146:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860017285320000
00000020:00000001:26.0:1773851875.685147:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851875.685147:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a66cfd
00000020:00000001:26.0:1773851875.685148:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851875.685148:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eeb0d8da refcount=9
00000020:00000001:26.0:1773851875.685149:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132685773824 : -106941023777792 : ffff9ebcda440c00)
00000020:00000001:26.0:1773851875.685150:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132685773824 : -106941023777792 : ffff9ebcda440c00)
00000100:00000001:26.0:1773851875.685151:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851875.685152:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851875.685152:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000305b1095.
00000020:00000010:26.0:1773851875.685154:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851875.685155:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f47aaca3.
00000100:00000001:26.0:1773851875.685155:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851875.685156:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851875.685157:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851875.685157:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851875.685158:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851875.685158:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851875.685159:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851875.685160:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851875.685161:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851875.685161:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851875.685161:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851875.685162:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8193@kfi7, seq: 2025130
00000100:00000040:27.0:1773851875.685163:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eeb0d8da : new rpc_count 2
00000100:00000001:27.0:1773851875.685163:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102835071360 : -106970874480256 : ffff9eb5e7067980)
00000100:00000001:26.0:1773851875.685163:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851875.685163:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.685164:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008562292d x1860017285320000/t0(0) o400->77619cb0-8f4f-4f76-8139-796ed1eec537@8193@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1011-0'
00000100:00000001:27.0:1773851875.685167:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.685167:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851875.685168:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008562292d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:77619cb0-8f4f-4f76-8139-796ed1eec537+9:39584:x1860017285320000:12345-8193@kfi7:400:default-tuolumne1011-0
00000100:00000200:27.0:1773851875.685170:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860017285320000
00000020:00000001:27.0:1773851875.685170:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851875.685171:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851875.685172:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.685172:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851875.685173:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851875.685174:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851875.685174:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860017285320000, found 0 last_xid 1860017285302399
00000020:00000001:27.0:1773851875.685175:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851875.685176:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851875.685176:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851875.685177:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.685177:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851875.685178:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851875.685178:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851875.685179:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008506402b.
02000000:00000001:27.0:1773851875.685180:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.685180:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.685181:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851875.685182:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860017285320000
00010000:00000001:27.0:1773851875.685183:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851875.685183:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008562292d x1860017285320000/t0(0) o400->77619cb0-8f4f-4f76-8139-796ed1eec537@8193@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1011-0'
00010000:00000001:27.0:1773851875.685186:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851875.685186:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851875.685187:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=108 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851875.685188:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851875.685189:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000118b0a6e refcount 5 to 8193@kfi7
00000100:00000001:27.0:1773851875.685190:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231608608 : -107130477943008 : ffff9e90bdeae720)
02000000:00000001:27.0:1773851875.685191:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851875.685191:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.685192:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851875.685193:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8192@kfi7
00000400:00000010:27.0:1773851875.685193:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047cdbb20.
00000100:00000200:27.0:1773851875.685194:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860017285320000, offset 224
00000400:00000200:27.0:1773851875.685196:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8192@kfi7
00000400:00000200:27.0:1773851875.685196:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8192@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.685197:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071758d87 nid 8192@kfi7 refs 1
00000400:00000200:27.0:1773851875.685198:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000071758d87 nid 8192@kfi7 refs 2
00000400:00000200:27.0:1773851875.685199:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000071758d87 nid 8192@kfi7 refs 3
00000400:00000200:27.0:1773851875.685201:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8192@kfi7 local destination
00000400:00000200:27.0:1773851875.685202:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769523:8769523:1024:4294967295] 8192@kfi7 LPNI seq info [9187007:9187007:16:4294967295]
00000400:00000200:27.0:1773851875.685203:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000071758d87 nid 8192@kfi7 refs 2
00000400:00000200:27.0:1773851875.685204:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8192@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.685206:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8192@kfi7(8192@kfi7:8192@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851875.685207:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000071758d87 nid 8192@kfi7 refs 3
00000800:00000200:27.0:1773851875.685209:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851875.685210:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851875.685212:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851875.685216:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7bc Using peer 8192@kfi7(0x7bc)
00000800:00000200:27.0:1773851875.685220:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x7bc: rc=0
00000800:00000200:27.0:1773851875.685221:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851875.685223:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.685224:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000118b0a6e refcount 4 to 8193@kfi7
00010000:00000001:27.0:1773851875.685225:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851875.685225:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.685226:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851875.685227:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008562292d x1860017285320000/t0(0) o400->77619cb0-8f4f-4f76-8139-796ed1eec537@8193@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1011-0'
00000100:00100000:27.0:1773851875.685230:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008562292d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:77619cb0-8f4f-4f76-8139-796ed1eec537+9:39584:x1860017285320000:12345-8193@kfi7:400:default-tuolumne1011-0 Request processed in 62us (90us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851875.685232:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7bc TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851875.685233:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8193@kfi7, seq: 2025130
00000100:00000040:27.0:1773851875.685233:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eeb0d8da : new rpc_count 1
00000100:00000001:27.0:1773851875.685234:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851875.685234:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851875.685234:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851875.685235:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851875.685235:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8192@kfi7: PUT: OK
00000020:00000010:27.0:1773851875.685236:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f47aaca3.
00000400:00000200:25.0:1773851875.685236:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047cdbb20
00000020:00000010:27.0:1773851875.685237:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000305b1095.
00000020:00000040:27.0:1773851875.685237:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000eeb0d8da : new refcount 8
00000400:00000010:25.0:1773851875.685237:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047cdbb20.
00000100:00000001:25.0:1773851875.685237:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851875.685238:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851875.685238:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851875.685239:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000071758d87 nid 8192@kfi7 refs 2
00000800:00000200:25.0:1773851875.685240:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 8192@kfi7(00000000ae80f892):0x0 lsk 1981 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7bc Transaction freed
00000800:00000200:17.0:1773851875.704368:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851875.704369:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851875.704370:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851875.704373:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851875.704375:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11553@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.704376:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11553@kfi7 : PUT - for me
00000400:00000200:17.0:1773851875.704377:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11553@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.704378:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007920e2d1 nid 11553@kfi7 refs 1
00000400:00000200:17.0:1773851875.704378:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11553@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.704379:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007920e2d1 nid 11553@kfi7 refs 2
00000400:00000200:17.0:1773851875.704380:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007920e2d1 nid 11553@kfi7 refs 3
00000400:00000200:17.0:1773851875.704381:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11744@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.704382:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11744@kfi7 of length 224 into portal 12 MB=0x69b82347cfe40
00000400:00000200:17.0:1773851875.704383:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11744@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 24200
00000800:00000200:17.0:1773851875.704385:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851875.704387:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851875.704388:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11553@kfi7: PUT: OK
00000100:00000001:17.0:1773851875.704389:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851875.704389:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851875.704390:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f389a472.
00000100:00000040:17.0:1773851875.704391:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f389a472 x1859833388924480 msgsize 224
00000100:00100000:17.0:1773851875.704392:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-11744@kfi7 (source: 12345-11553@kfi7)
00000100:00000001:17.0:1773851875.704394:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851875.704395:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007920e2d1 nid 11553@kfi7 refs 2
00000800:00000200:17.0:1773851875.704396:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851875.704399:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851875.704400:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851875.704400:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851875.704400:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851875.704401:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851875.704402:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833388924480
00000020:00000001:17.0:1773851875.704403:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851875.704403:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875db0dec7
00000020:00000001:17.0:1773851875.704404:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851875.704406:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074e47260 refcount=5
00000020:00000001:17.0:1773851875.704406:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637149840608256 : -106923868943360 : ffff9ec0d8c60c00)
00000020:00000001:17.0:1773851875.704407:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637149840608256 : -106923868943360 : ffff9ec0d8c60c00)
00000100:00000001:17.0:1773851875.704408:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851875.704409:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851875.704410:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002a497fe.
00000020:00000010:17.0:1773851875.704411:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851875.704412:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851875.704413:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851875.704414:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851875.704414:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851875.704415:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851875.704416:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851875.704416:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851875.704417:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851875.704418:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851875.704419:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851875.704419:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851875.704419:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851875.704420:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11744@kfi7, seq: 2156359
00000100:00000040:17.0:1773851875.704421:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074e47260 : new rpc_count 1
00000100:00000001:17.0:1773851875.704421:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372330240 : -107078337221376 : ffff9e9ce1bf2d00)
00000100:00000001:16.0:1773851875.704421:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851875.704421:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851875.704422:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f389a472 x1859833388924480/t0(0) o400->dcfb5949-5494-494d-a0ba-7c03adbb0e78@11744@kfi7:96/0 lens 224/0 e 0 to 0 dl 1773852211 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1215-0'
00000100:00000001:17.0:1773851875.704425:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851875.704426:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851875.704427:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f389a472 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:dcfb5949-5494-494d-a0ba-7c03adbb0e78+5:39821:x1859833388924480:12345-11744@kfi7:400:default-tuolumne1215-0
00000100:00000200:17.0:1773851875.704428:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833388924480
00000020:00000001:17.0:1773851875.704428:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851875.704429:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851875.704430:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.704430:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851875.704431:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851875.704432:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851875.704432:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833388924480, found 0 last_xid 1859833388924479
00000020:00000001:17.0:1773851875.704433:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851875.704434:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851875.704435:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851875.704435:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.704436:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851875.704436:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851875.704437:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851875.704437:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009070cdba.
02000000:00000001:17.0:1773851875.704438:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851875.704439:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.704439:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851875.704440:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688389, transno 0, xid 1859833388924480
00010000:00000001:17.0:1773851875.704441:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851875.704442:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f389a472 x1859833388924480/t0(0) o400->dcfb5949-5494-494d-a0ba-7c03adbb0e78@11744@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1215-0'
00010000:00000001:17.0:1773851875.704444:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851875.704444:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851875.704445:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=108 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851875.704446:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851875.704447:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fcd1e862 refcount 3 to 11744@kfi7
00000100:00000001:17.0:1773851875.704447:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583952704 : -107156125598912 : ffff9e8ac532bb40)
02000000:00000001:17.0:1773851875.704449:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851875.704449:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851875.704450:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851875.704451:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11553@kfi7
00000400:00000010:17.0:1773851875.704451:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e57d848.
00000100:00000200:17.0:1773851875.704452:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833388924480, offset 224
00000400:00000200:17.0:1773851875.704453:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11553@kfi7
00000400:00000200:17.0:1773851875.704454:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11553@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.704455:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007920e2d1 nid 11553@kfi7 refs 1
00000400:00000200:17.0:1773851875.704455:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007920e2d1 nid 11553@kfi7 refs 2
00000400:00000200:17.0:1773851875.704456:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007920e2d1 nid 11553@kfi7 refs 3
00000400:00000200:17.0:1773851875.704458:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11553@kfi7 local destination
00000400:00000200:17.0:1773851875.704459:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769524:8769524:1024:4294967295] 11553@kfi7 LPNI seq info [6901964:6901964:16:4294967295]
00000400:00000200:17.0:1773851875.704460:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007920e2d1 nid 11553@kfi7 refs 2
00000400:00000200:17.0:1773851875.704461:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11553@kfi7 to cpt 4
00000400:00000200:17.0:1773851875.704463:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11553@kfi7(11553@kfi7:11553@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851875.704464:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007920e2d1 nid 11553@kfi7 refs 3
00000800:00000200:17.0:1773851875.704465:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851875.704466:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851875.704468:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851875.704471:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011cf Using peer 11553@kfi7(0x1000000000011cf)
00000800:00000200:17.0:1773851875.704473:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x1000000000011cf: rc=0
00000800:00000200:17.0:1773851875.704475:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011cf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851875.704477:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851875.704477:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fcd1e862 refcount 2 to 11744@kfi7
00010000:00000001:17.0:1773851875.704478:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851875.704479:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851875.704480:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851875.704480:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f389a472 x1859833388924480/t0(0) o400->dcfb5949-5494-494d-a0ba-7c03adbb0e78@11744@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1215-0'
00000100:00100000:17.0:1773851875.704483:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f389a472 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:dcfb5949-5494-494d-a0ba-7c03adbb0e78+5:39821:x1859833388924480:12345-11744@kfi7:400:default-tuolumne1215-0 Request processed in 57us (92us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851875.704486:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11744@kfi7, seq: 2156359
00000100:00000040:17.0:1773851875.704486:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074e47260 : new rpc_count 0
00000800:00000200:19.0:1773851875.704487:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011cf TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851875.704487:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851875.704488:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851875.704488:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:19.0:1773851875.704489:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851875.704489:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:19.0:1773851875.704490:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11553@kfi7: PUT: OK
00000020:00000010:17.0:1773851875.704490:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002a497fe.
00000400:00000200:19.0:1773851875.704491:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e57d848
00000400:00000010:19.0:1773851875.704491:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e57d848.
00000020:00000040:17.0:1773851875.704491:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000074e47260 : new refcount 4
00000100:00000001:17.0:1773851875.704491:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851875.704492:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851875.704492:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851875.704493:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007920e2d1 nid 11553@kfi7 refs 2
00000800:00000200:19.0:1773851875.704494:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 11553@kfi7(000000009ad0766c):0x0 lsk 4560 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000011cf Transaction freed
00000800:00000200:25.0:1773851875.724978:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851875.724979:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851875.724980:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851875.724982:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851875.724984:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10480@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.724985:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10480@kfi7 : PUT - for me
00000400:00000200:25.0:1773851875.724986:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10480@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.724987:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cef7747d nid 10480@kfi7 refs 1
00000400:00000200:25.0:1773851875.724988:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10480@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.724989:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cef7747d nid 10480@kfi7 refs 2
00000400:00000200:25.0:1773851875.724990:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cef7747d nid 10480@kfi7 refs 3
00000400:00000200:25.0:1773851875.724990:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10289@kfi7 to cpt 6
00000400:00000200:25.0:1773851875.724992:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10289@kfi7 of length 224 into portal 12 MB=0x69b478575f280
00000400:00000200:25.0:1773851875.724993:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10289@kfi7 of length 224/224 into md 0x16159c9699 [64] + 23224
00000800:00000200:25.0:1773851875.724994:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851875.724996:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851875.724997:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10480@kfi7: PUT: OK
00000100:00000001:25.0:1773851875.724998:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851875.724999:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851875.724999:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000c418366.
00000100:00000040:25.0:1773851875.725000:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000000c418366 x1859581344346752 msgsize 224
00000100:00100000:25.0:1773851875.725002:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10289@kfi7 (source: 12345-10480@kfi7)
00000100:00000001:25.0:1773851875.725003:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851875.725004:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cef7747d nid 10480@kfi7 refs 2
00000100:00000001:27.0:1773851875.725006:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851875.725006:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851875.725007:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851875.725007:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851875.725008:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851875.725009:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851875.725010:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859581344346752
00000020:00000001:27.0:1773851875.725011:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851875.725012:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f110a
00000020:00000001:27.0:1773851875.725014:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851875.725016:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000093f7bc7d refcount=2398
00000020:00000001:27.0:1773851875.725017:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133707048960 : -106940002502656 : ffff9ebd17237800)
00000020:00000001:27.0:1773851875.725019:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133707048960 : -106940002502656 : ffff9ebd17237800)
00000100:00000001:27.0:1773851875.725020:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.725021:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851875.725023:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004133ac17.
00000020:00000010:27.0:1773851875.725024:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851875.725026:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851875.725027:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851875.725027:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851875.725028:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851875.725030:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851875.725031:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851875.725031:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.725033:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851875.725035:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851875.725035:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851875.725036:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851875.725036:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851875.725037:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10289@kfi7, seq: 2025131
00000100:00000040:27.0:1773851875.725039:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000093f7bc7d : new rpc_count 11
00000100:00000001:26.0:1773851875.725039:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.725040:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102835048320 : -106970874503296 : ffff9eb5e7061f80)
00000100:00000001:26.0:1773851875.725040:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.725042:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000c418366 x1859581344346752/t0(0) o400->064db4fd-29a2-4998-87eb-87410af369ba@10289@kfi7:92/0 lens 224/0 e 0 to 0 dl 1773852207 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1133-0'
00000100:00000001:27.0:1773851875.725047:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851875.725048:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851875.725049:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c418366 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:064db4fd-29a2-4998-87eb-87410af369ba+2398:39908:x1859581344346752:12345-10289@kfi7:400:default-tuolumne1133-0
00000100:00000200:27.0:1773851875.725052:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859581344346752
00000020:00000001:27.0:1773851875.725053:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851875.725054:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851875.725055:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.725056:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851875.725057:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851875.725059:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851875.725060:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859581344346752, found 0 last_xid 1859581343614911
00000020:00000001:27.0:1773851875.725061:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851875.725062:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851875.725063:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851875.725064:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.725065:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851875.725065:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851875.725066:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851875.725067:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009edd1273.
02000000:00000001:27.0:1773851875.725068:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.725069:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.725070:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851875.725072:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593458, transno 0, xid 1859581344346752
00010000:00000001:27.0:1773851875.725073:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851875.725074:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000c418366 x1859581344346752/t0(0) o400->064db4fd-29a2-4998-87eb-87410af369ba@10289@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1133-0'
00010000:00000001:27.0:1773851875.725078:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851875.725079:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851875.725081:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=108 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851875.725082:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851875.725083:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d693aee3 refcount 3 to 10289@kfi7
00000100:00000001:27.0:1773851875.725085:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636956483013344 : -107117226538272 : ffff9e93d3c34ae0)
02000000:00000001:27.0:1773851875.725086:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851875.725087:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851875.725088:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851875.725089:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10480@kfi7
00000400:00000010:27.0:1773851875.725090:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000086885a67.
00000100:00000200:27.0:1773851875.725092:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859581344346752, offset 224
00000400:00000200:27.0:1773851875.725094:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10480@kfi7
00000400:00000200:27.0:1773851875.725095:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10480@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.725096:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cef7747d nid 10480@kfi7 refs 1
00000400:00000200:27.0:1773851875.725098:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cef7747d nid 10480@kfi7 refs 2
00000400:00000200:27.0:1773851875.725100:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cef7747d nid 10480@kfi7 refs 3
00000400:00000200:27.0:1773851875.725102:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10480@kfi7 local destination
00000400:00000200:27.0:1773851875.725104:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769525:8769525:1024:4294967295] 10480@kfi7 LPNI seq info [25143191:25143191:16:4294967295]
00000400:00000200:27.0:1773851875.725107:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cef7747d nid 10480@kfi7 refs 2
00000400:00000200:27.0:1773851875.725108:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10480@kfi7 to cpt 6
00000400:00000200:27.0:1773851875.725112:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10480@kfi7(10480@kfi7:10480@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851875.725113:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cef7747d nid 10480@kfi7 refs 3
00000800:00000200:27.0:1773851875.725116:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851875.725117:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851875.725121:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851875.725125:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005a4 Using peer 10480@kfi7(0x1000000000005a4)
00000800:00000200:27.0:1773851875.725130:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000005690846: Posted send of 324 bytes to peer 0x1000000000005a4: rc=0
00000800:00000200:27.0:1773851875.725132:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851875.725136:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851875.725137:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d693aee3 refcount 2 to 10289@kfi7
00010000:00000001:27.0:1773851875.725138:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851875.725139:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851875.725140:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851875.725141:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000c418366 x1859581344346752/t0(0) o400->064db4fd-29a2-4998-87eb-87410af369ba@10289@kfi7:92/0 lens 224/224 e 0 to 0 dl 1773852207 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1133-0'
00000800:00000200:25.0:1773851875.725145:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005a4 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851875.725146:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851875.725147:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c418366 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:064db4fd-29a2-4998-87eb-87410af369ba+2398:39908:x1859581344346752:12345-10289@kfi7:400:default-tuolumne1133-0 Request processed in 98us (145us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851875.725147:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10480@kfi7: PUT: OK
00000400:00000200:25.0:1773851875.725148:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000086885a67
00000400:00000010:25.0:1773851875.725149:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000086885a67.
00000100:00100000:27.0:1773851875.725150:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10289@kfi7, seq: 2025131
00000100:00000001:25.0:1773851875.725150:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851875.725150:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:27.0:1773851875.725151:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000093f7bc7d : new rpc_count 10
00000400:00000200:25.0:1773851875.725151:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cef7747d nid 10480@kfi7 refs 2
00000800:00000200:25.0:1773851875.725152:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 10480@kfi7(00000000d04dea88):0x0 lsk 1445 rsk 32 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005a4 Transaction freed
00000100:00000001:27.0:1773851875.725153:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851875.725154:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851875.725155:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851875.725156:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851875.725158:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004133ac17.
00000020:00000040:27.0:1773851875.725159:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000093f7bc7d : new refcount 2397
00000100:00000001:27.0:1773851875.725160:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851875.758700:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851875.758701:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851875.758702:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851875.758705:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851875.758707:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22401@kfi7 to cpt 1
00000400:00000200:5.0:1773851875.758708:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22401@kfi7 : PUT - for me
00000400:00000200:5.0:1773851875.758709:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22401@kfi7 to cpt 1
00000400:00000200:5.0:1773851875.758710:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 1
00000400:00000200:5.0:1773851875.758712:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22401@kfi7 to cpt 1
00000400:00000200:5.0:1773851875.758713:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 2
00000400:00000200:5.0:1773851875.758714:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 3
00000400:00000200:5.0:1773851875.758715:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22400@kfi7 to cpt 6
00000400:00000200:5.0:1773851875.758716:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22400@kfi7 of length 224 into portal 12 MB=0x69b4c4a1de080
00000400:00000200:5.0:1773851875.758718:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22400@kfi7 of length 224/224 into md 0x793926dc5 [64] + 149176
00000800:00000200:5.0:1773851875.758720:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851875.758724:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851875.758730:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22401@kfi7: PUT: OK
00000100:00000001:5.0:1773851875.758731:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851875.758732:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851875.758733:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004b6592a4.
00000100:00000040:5.0:1773851875.758734:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000004b6592a4 x1859601823555712 msgsize 224
00000100:00100000:5.0:1773851875.758735:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22400@kfi7 (source: 12345-22401@kfi7)
00000100:00000001:5.0:1773851875.758737:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851875.758738:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 2
00000100:00000001:7.0:1773851875.758739:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851875.758740:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851875.758740:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851875.758740:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851875.758741:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851875.758742:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851875.758743:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601823555712
00000020:00000001:7.0:1773851875.758743:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851875.758744:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8247e
00000020:00000001:7.0:1773851875.758745:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851875.758746:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004990ece2 refcount=5
00000020:00000001:7.0:1773851875.758747:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108589135872 : -106965120415744 : ffff9eb73dfe8800)
00000020:00000001:7.0:1773851875.758748:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108589135872 : -106965120415744 : ffff9eb73dfe8800)
00000100:00000001:7.0:1773851875.758749:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851875.758750:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851875.758751:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851875.758752:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851875.758753:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851875.758754:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851875.758755:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851875.758756:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851875.758757:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851875.758759:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851875.758759:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.758760:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851875.758762:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851875.758762:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851875.758763:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851875.758763:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851875.758764:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22400@kfi7, seq: 2001937
00000100:00000040:7.0:1773851875.758764:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004990ece2 : new rpc_count 1
00000100:00000001:7.0:1773851875.758765:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273405440 : -107034436146176 : ffff9ea71a746c00)
00000100:00000001:4.0:1773851875.758765:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851875.758765:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851875.758767:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004b6592a4 x1859601823555712/t0(0) o400->fb8459fe-57d8-4771-b1bb-76ba313cc505@22400@kfi7:602/0 lens 224/0 e 0 to 0 dl 1773851962 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1892-0'
00000100:00000001:7.0:1773851875.758770:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851875.758771:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851875.758772:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b6592a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fb8459fe-57d8-4771-b1bb-76ba313cc505+5:39472:x1859601823555712:12345-22400@kfi7:400:default-tuolumne1892-0
00000100:00000200:7.0:1773851875.758773:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601823555712
00000020:00000001:7.0:1773851875.758774:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851875.758775:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851875.758775:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.758776:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851875.758777:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851875.758777:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851875.758778:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601823555712, found 0 last_xid 1859601823555711
00000020:00000001:7.0:1773851875.758779:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851875.758779:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851875.758780:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851875.758781:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.758781:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851875.758782:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851875.758782:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851875.758783:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002faae425.
02000000:00000001:7.0:1773851875.758784:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.758784:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.758785:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851875.758785:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915823935, transno 0, xid 1859601823555712
00010000:00000001:7.0:1773851875.758787:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851875.758787:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004b6592a4 x1859601823555712/t0(0) o400->fb8459fe-57d8-4771-b1bb-76ba313cc505@22400@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1892-0'
00010000:00000001:7.0:1773851875.758790:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851875.758790:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851875.758791:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=107 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851875.758792:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851875.758793:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eb09ed56 refcount 3 to 22400@kfi7
00000100:00000001:7.0:1773851875.758794:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335968 : -107152617215648 : ffff9e8b96506960)
02000000:00000001:7.0:1773851875.758794:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851875.758795:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851875.758796:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851875.758796:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22401@kfi7
00000400:00000010:7.0:1773851875.758797:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc26fd9e.
00000100:00000200:7.0:1773851875.758798:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601823555712, offset 224
00000400:00000200:7.0:1773851875.758799:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22401@kfi7
00000400:00000200:7.0:1773851875.758800:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22401@kfi7 to cpt 1
00000400:00000200:7.0:1773851875.758801:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 1
00000400:00000200:7.0:1773851875.758801:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 2
00000400:00000200:7.0:1773851875.758802:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 3
00000400:00000200:7.0:1773851875.758803:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22401@kfi7 local destination
00000400:00000200:7.0:1773851875.758805:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769526:8769526:1024:4294967295] 22401@kfi7 LPNI seq info [1749674:1749674:16:4294967295]
00000400:00000200:7.0:1773851875.758806:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 2
00000400:00000200:7.0:1773851875.758807:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22401@kfi7 to cpt 1
00000400:00000200:7.0:1773851875.758809:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22401@kfi7(22401@kfi7:22401@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851875.758810:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 3
00000800:00000200:7.0:1773851875.758811:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851875.758812:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851875.758814:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851875.758818:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004db Using peer 22401@kfi7(0x1000000000004db)
00000800:00000200:7.0:1773851875.758821:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x1000000000004db: rc=0
00000800:00000200:7.0:1773851875.758823:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004db TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851875.758825:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851875.758826:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eb09ed56 refcount 2 to 22400@kfi7
00010000:00000001:7.0:1773851875.758826:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851875.758827:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851875.758828:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851875.758829:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004b6592a4 x1859601823555712/t0(0) o400->fb8459fe-57d8-4771-b1bb-76ba313cc505@22400@kfi7:602/0 lens 224/224 e 0 to 0 dl 1773851962 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1892-0'
00000100:00100000:7.0:1773851875.758831:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b6592a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fb8459fe-57d8-4771-b1bb-76ba313cc505+5:39472:x1859601823555712:12345-22400@kfi7:400:default-tuolumne1892-0 Request processed in 60us (97us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851875.758834:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22400@kfi7, seq: 2001937
00000800:00000200:5.0:1773851875.758834:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004db TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851875.758835:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004990ece2 : new rpc_count 0
00000400:00000200:5.0:1773851875.758835:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851875.758836:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851875.758836:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851875.758836:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22401@kfi7: PUT: OK
00000020:00000010:7.0:1773851875.758837:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851875.758837:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:5.0:1773851875.758837:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc26fd9e
00000020:00000010:7.0:1773851875.758838:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000400:00000010:5.0:1773851875.758838:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc26fd9e.
00000100:00000001:5.0:1773851875.758838:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:7.0:1773851875.758839:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000004990ece2 : new refcount 4
00000100:00000001:7.0:1773851875.758839:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851875.758839:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851875.758839:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4fb9a3c nid 22401@kfi7 refs 2
00000800:00000200:5.0:1773851875.758841:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 22401@kfi7(00000000011236e6):0x0 lsk 1244 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004db Transaction freed
00000800:00000200:13.0:1773851876.053853:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851876.053854:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851876.053855:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851876.053857:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851876.053860:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12385@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.053861:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12385@kfi7 : PUT - for me
00000400:00000200:13.0:1773851876.053862:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12385@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.053862:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc49216 nid 12385@kfi7 refs 1
00000400:00000200:13.0:1773851876.053864:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12385@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.053864:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc49216 nid 12385@kfi7 refs 2
00000400:00000200:13.0:1773851876.053865:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004bc49216 nid 12385@kfi7 refs 3
00000400:00000200:13.0:1773851876.053866:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12385@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.053867:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12385@kfi7 of length 224 into portal 12 MB=0x69b4b56bd99c0
00000400:00000200:13.0:1773851876.053869:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12385@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 37744
00000800:00000200:13.0:1773851876.053870:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851876.053872:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851876.053873:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12385@kfi7: PUT: OK
00000100:00000001:13.0:1773851876.053874:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851876.053875:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851876.053876:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009dd021c0.
00000100:00000040:13.0:1773851876.053877:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009dd021c0 x1859597740382656 msgsize 224
00000100:00100000:13.0:1773851876.053878:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12385@kfi7 (source: 12345-12385@kfi7)
00000100:00000001:13.0:1773851876.053879:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851876.053880:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004bc49216 nid 12385@kfi7 refs 2
00000100:00000001:15.0:1773851876.053881:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851876.053882:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851876.053882:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851876.053882:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851876.053883:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851876.053883:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851876.053884:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597740382656
00000020:00000001:15.0:1773851876.053885:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851876.053885:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d805b9
00000020:00000001:15.0:1773851876.053886:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851876.053891:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004a6d8c5f refcount=5
00000020:00000001:15.0:1773851876.053891:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132986787840 : -106940722763776 : ffff9ebcec352800)
00000020:00000001:15.0:1773851876.053892:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132986787840 : -106940722763776 : ffff9ebcec352800)
00000100:00000001:15.0:1773851876.053893:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851876.053894:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851876.053895:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000342ec44.
00000020:00000010:15.0:1773851876.053896:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851876.053897:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851876.053897:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851876.053898:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851876.053899:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851876.053900:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851876.053901:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851876.053901:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.053902:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851876.053903:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851876.053904:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851876.053904:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851876.053904:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851876.053905:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12385@kfi7, seq: 2289865
00000100:00000040:15.0:1773851876.053906:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004a6d8c5f : new rpc_count 1
00000100:00000001:12.0:1773851876.053906:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.053907:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902259456 : -106994807292160 : ffff9eb05484bf00)
00000100:00000001:12.0:1773851876.053907:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851876.053908:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009dd021c0 x1859597740382656/t0(0) o400->8411633f-b947-4031-8934-02708885a455@12385@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1264-0'
00000100:00000001:15.0:1773851876.053910:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851876.053911:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851876.053912:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009dd021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8411633f-b947-4031-8934-02708885a455+5:39514:x1859597740382656:12345-12385@kfi7:400:default-tuolumne1264-0
00000100:00000200:15.0:1773851876.053914:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597740382656
00000020:00000001:15.0:1773851876.053914:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851876.053915:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851876.053915:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.053916:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851876.053917:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851876.053917:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851876.053918:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597740382656, found 0 last_xid 1859597740382655
00000020:00000001:15.0:1773851876.053919:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851876.053919:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851876.053920:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851876.053921:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.053921:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851876.053922:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851876.053922:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851876.053923:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ae56949c.
02000000:00000001:15.0:1773851876.053924:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.053925:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.053926:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851876.053927:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096704344, transno 0, xid 1859597740382656
00010000:00000001:15.0:1773851876.053927:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851876.053928:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009dd021c0 x1859597740382656/t0(0) o400->8411633f-b947-4031-8934-02708885a455@12385@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1264-0'
00010000:00000001:15.0:1773851876.053931:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851876.053931:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851876.053932:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=109 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851876.053933:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851876.053934:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f291c57a refcount 3 to 12385@kfi7
00000100:00000001:15.0:1773851876.053935:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152224 : -107139310399392 : ffff9e8eaf765060)
02000000:00000001:15.0:1773851876.053935:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851876.053936:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.053936:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851876.053937:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12385@kfi7
00000400:00000010:15.0:1773851876.053938:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000085014459.
00000100:00000200:15.0:1773851876.053939:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597740382656, offset 224
00000400:00000200:15.0:1773851876.053940:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12385@kfi7
00000400:00000200:15.0:1773851876.053941:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12385@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.053942:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004bc49216 nid 12385@kfi7 refs 1
00000400:00000200:15.0:1773851876.053943:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004bc49216 nid 12385@kfi7 refs 2
00000400:00000200:15.0:1773851876.053945:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004bc49216 nid 12385@kfi7 refs 3
00000400:00000200:15.0:1773851876.053946:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12385@kfi7 local destination
00000400:00000200:15.0:1773851876.053947:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769527:8769527:1024:4294967295] 12385@kfi7 LPNI seq info [394379:394379:16:4294967295]
00000400:00000200:15.0:1773851876.053948:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004bc49216 nid 12385@kfi7 refs 2
00000400:00000200:15.0:1773851876.053949:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12385@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.053951:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12385@kfi7(12385@kfi7:12385@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851876.053952:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004bc49216 nid 12385@kfi7 refs 3
00000800:00000200:15.0:1773851876.053954:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851876.053955:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851876.053957:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851876.053960:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb8 Using peer 12385@kfi7(0xb8)
00000800:00000200:15.0:1773851876.053964:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0xb8: rc=0
00000800:00000200:15.0:1773851876.053965:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851876.053967:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851876.053968:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f291c57a refcount 2 to 12385@kfi7
00010000:00000001:15.0:1773851876.053969:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851876.053969:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.053970:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851876.053970:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009dd021c0 x1859597740382656/t0(0) o400->8411633f-b947-4031-8934-02708885a455@12385@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1264-0'
00000100:00100000:15.0:1773851876.053973:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009dd021c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8411633f-b947-4031-8934-02708885a455+5:39514:x1859597740382656:12345-12385@kfi7:400:default-tuolumne1264-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851876.053976:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12385@kfi7, seq: 2289865
00000100:00000040:15.0:1773851876.053976:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004a6d8c5f : new rpc_count 0
00000100:00000001:15.0:1773851876.053978:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851876.053978:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851876.053978:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb8 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851876.053979:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851876.053979:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000020:00000010:15.0:1773851876.053980:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000342ec44.
00000020:00000040:15.0:1773851876.053981:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000004a6d8c5f : new refcount 4
00000400:00000200:13.0:1773851876.053981:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851876.053982:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851876.053982:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12385@kfi7: PUT: OK
00000400:00000200:13.0:1773851876.053983:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000085014459
00000400:00000010:13.0:1773851876.053983:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000085014459.
00000100:00000001:13.0:1773851876.053984:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851876.053985:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851876.053985:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004bc49216 nid 12385@kfi7 refs 2
00000800:00000200:13.0:1773851876.053987:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12385@kfi7(000000000b5e72ee):0x0 lsk 185 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb8 Transaction freed
00000800:00000200:17.0:1773851876.074221:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.074222:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851876.074225:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851876.074228:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851876.074232:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.074234:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22266@kfi7 : PUT - for me
00000400:00000200:17.0:1773851876.074236:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.074238:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 1
00000400:00000200:17.0:1773851876.074239:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.074240:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000400:00000200:17.0:1773851876.074242:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 3
00000400:00000200:17.0:1773851876.074244:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.074245:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22266@kfi7 of length 224 into portal 12 MB=0x699de8d0aea40
00000400:00000200:17.0:1773851876.074248:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22266@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 24424
00000800:00000200:17.0:1773851876.074252:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851876.074255:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851876.074257:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22266@kfi7: PUT: OK
00000100:00000001:17.0:1773851876.074259:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851876.074260:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851876.074261:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eca007a4.
00000100:00000040:17.0:1773851876.074263:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000eca007a4 x1858030988356160 msgsize 224
00000100:00100000:17.0:1773851876.074265:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22266@kfi7 (source: 12345-22266@kfi7)
00000100:00000001:17.0:1773851876.074268:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851876.074269:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000800:00000200:17.0:1773851876.074272:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851876.074277:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851876.074278:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851876.074279:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851876.074280:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851876.074281:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851876.074282:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030988356160
00000020:00000001:17.0:1773851876.074284:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851876.074284:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f20
00000020:00000001:17.0:1773851876.074286:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851876.074289:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000039c81071 refcount=6
00000020:00000001:17.0:1773851876.074290:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239863296 : -107152469688320 : ffff9e8b9f1b8000)
00000020:00000001:17.0:1773851876.074292:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239863296 : -107152469688320 : ffff9e8b9f1b8000)
00000100:00000001:17.0:1773851876.074293:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.074295:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851876.074296:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002a497fe.
00000020:00000010:17.0:1773851876.074298:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.074299:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851876.074300:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851876.074301:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851876.074302:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.074303:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851876.074305:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851876.074306:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.074307:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.074309:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851876.074309:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851876.074309:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851876.074310:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851876.074311:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22266@kfi7, seq: 2156360
00000100:00000040:17.0:1773851876.074312:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000039c81071 : new rpc_count 1
00000100:00000001:16.0:1773851876.074312:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851876.074312:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.074313:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372344064 : -107078337207552 : ffff9e9ce1bf6300)
00000100:00000040:17.0:1773851876.074314:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eca007a4 x1858030988356160/t0(0) o400->cd8d54cb-f28e-4522-9760-01aace63f8f6@22266@kfi7:97/0 lens 224/0 e 0 to 0 dl 1773852212 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne255-0'
00000100:00000001:17.0:1773851876.074317:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.074317:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851876.074319:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eca007a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cd8d54cb-f28e-4522-9760-01aace63f8f6+6:47671:x1858030988356160:12345-22266@kfi7:400:default-tuolumne255-0
00000100:00000200:17.0:1773851876.074320:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030988356160
00000020:00000001:17.0:1773851876.074321:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851876.074322:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851876.074322:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.074323:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851876.074324:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851876.074325:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851876.074325:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030988356160, found 0 last_xid 1858030988356159
00000020:00000001:17.0:1773851876.074326:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851876.074327:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851876.074328:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851876.074329:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.074329:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851876.074330:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851876.074330:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851876.074331:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001b772a55.
02000000:00000001:17.0:1773851876.074332:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.074333:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.074334:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851876.074334:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030988356160
00010000:00000001:17.0:1773851876.074336:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851876.074337:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eca007a4 x1858030988356160/t0(0) o400->cd8d54cb-f28e-4522-9760-01aace63f8f6@22266@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne255-0'
00010000:00000001:17.0:1773851876.074340:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851876.074340:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851876.074341:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=109 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851876.074342:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851876.074343:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b1bb0ffd refcount 5 to 22266@kfi7
00000100:00000001:17.0:1773851876.074344:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363995008 : -107142345556608 : ffff9e8dfa8d7d80)
02000000:00000001:17.0:1773851876.074345:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851876.074346:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.074347:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851876.074348:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22266@kfi7
00000400:00000010:17.0:1773851876.074348:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089702b40.
00000100:00000200:17.0:1773851876.074349:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030988356160, offset 224
00000400:00000200:17.0:1773851876.074351:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22266@kfi7
00000400:00000200:17.0:1773851876.074352:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.074353:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 1
00000400:00000200:17.0:1773851876.074354:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000400:00000200:17.0:1773851876.074356:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 3
00000400:00000200:17.0:1773851876.074357:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22266@kfi7 local destination
00000400:00000200:17.0:1773851876.074359:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769528:8769528:1024:4294967295] 22266@kfi7 LPNI seq info [28027:28027:16:4294967295]
00000400:00000200:17.0:1773851876.074361:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000400:00000200:17.0:1773851876.074361:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.074364:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22266@kfi7(22266@kfi7:22266@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851876.074365:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 3
00000800:00000200:17.0:1773851876.074366:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.074368:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851876.074370:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851876.074373:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005a7 Using peer 22266@kfi7(0x1000000000005a7)
00000800:00000200:17.0:1773851876.074376:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x1000000000005a7: rc=0
00000800:00000200:17.0:1773851876.074378:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005a7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851876.074380:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.074381:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b1bb0ffd refcount 4 to 22266@kfi7
00010000:00000001:17.0:1773851876.074382:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851876.074383:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.074383:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851876.074384:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eca007a4 x1858030988356160/t0(0) o400->cd8d54cb-f28e-4522-9760-01aace63f8f6@22266@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne255-0'
00000100:00100000:17.0:1773851876.074388:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eca007a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cd8d54cb-f28e-4522-9760-01aace63f8f6+6:47671:x1858030988356160:12345-22266@kfi7:400:default-tuolumne255-0 Request processed in 70us (124us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851876.074390:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22266@kfi7, seq: 2156360
00000800:00000200:19.0:1773851876.074391:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005a7 TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851876.074391:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000039c81071 : new rpc_count 0
00000400:00000200:19.0:1773851876.074392:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851876.074392:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:19.0:1773851876.074393:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22266@kfi7: PUT: OK
00000100:00000001:17.0:1773851876.074393:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851876.074393:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.074394:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851876.074395:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002a497fe.
00000020:00000040:17.0:1773851876.074396:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000039c81071 : new refcount 5
00000100:00000001:17.0:1773851876.074396:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851876.074406:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089702b40
00000400:00000010:19.0:1773851876.074406:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089702b40.
00000100:00000001:19.0:1773851876.074407:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851876.074407:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851876.074408:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000800:00000200:19.0:1773851876.074410:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 22266@kfi7(00000000d8e03884):0x0 lsk 1448 rsk 89 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000005a7 Transaction freed
00000800:00000200:6.0:1773851876.074824:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851876.074825:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851876.074827:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851876.074829:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851876.074830:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.074832:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:6.0:1773851876.074833:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.074833:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:6.0:1773851876.074835:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.074836:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851876.074837:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:6.0:1773851876.074838:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.074838:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed436840
00000400:00000200:6.0:1773851876.074840:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x793844545 [256] + 6960
00000800:00000200:6.0:1773851876.074842:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851876.074844:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851876.074845:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2098@kfi7: PUT: OK
00000100:00000001:6.0:1773851876.074846:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851876.074847:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:6.0:1773851876.074847:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ef26f3a.
00000100:00000040:6.0:1773851876.074848:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000006ef26f3a x1858062667442240 msgsize 224
00000100:00100000:6.0:1773851876.074850:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2098@kfi7)
00000100:00000001:6.0:1773851876.074851:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851876.074852:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:6.0:1773851876.074854:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851876.074857:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851876.074857:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851876.074858:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851876.074858:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851876.074859:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851876.074860:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667442240
00000020:00000001:6.0:1773851876.074861:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851876.074861:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:6.0:1773851876.074862:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851876.074863:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:6.0:1773851876.074864:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:6.0:1773851876.074864:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:6.0:1773851876.074866:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851876.074867:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851876.074868:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851876.074869:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851876.074870:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851876.074871:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851876.074871:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851876.074872:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851876.074872:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.074874:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.074875:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851876.074876:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851876.074877:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851876.074877:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851876.074877:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851876.074878:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 18314082
00000100:00000040:6.0:1773851876.074879:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:6.0:1773851876.074879:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814070400 : -107101895481216 : ffff9e976590a880)
00000100:00000001:5.0:1773851876.074879:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851876.074879:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851876.074880:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ef26f3a x1858062667442240/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:6.0:1773851876.074883:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851876.074884:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851876.074885:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ef26f3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667442240:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:6.0:1773851876.074886:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667442240
00000020:00000001:6.0:1773851876.074887:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851876.074888:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851876.074888:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851876.074889:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851876.074890:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851876.074890:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851876.074891:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851876.074892:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851876.074892:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851876.074893:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.074894:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851876.074894:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851876.074896:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000001d42d590.
02000000:00000001:6.0:1773851876.074896:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.074897:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851876.074898:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851876.074898:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851876.074899:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851876.074899:0:1537125:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:6.0:1773851876.074901:0:1537125:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851876.074901:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851876.074902:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851876.074904:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851876.074904:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667442240
00010000:00000001:6.0:1773851876.074905:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851876.074906:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ef26f3a x1858062667442240/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:6.0:1773851876.074908:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851876.074909:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851876.074910:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=105 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851876.074911:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851876.074912:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:6.0:1773851876.074912:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:6.0:1773851876.074913:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851876.074914:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.074915:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851876.074915:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:6.0:1773851876.074916:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c307aa46.
00000100:00000200:6.0:1773851876.074917:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667442240, offset 224
00000400:00000200:6.0:1773851876.074918:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:6.0:1773851876.074919:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.074920:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:6.0:1773851876.074921:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851876.074922:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:6.0:1773851876.074923:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2098@kfi7 local destination
00000400:00000200:6.0:1773851876.074924:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769529:8769529:1024:4294967295] 2098@kfi7 LPNI seq info [20346206:20346206:16:4294967295]
00000400:00000200:6.0:1773851876.074927:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851876.074928:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.074930:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851876.074931:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:6.0:1773851876.074932:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851876.074934:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851876.074936:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851876.074938:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 Using peer 2098@kfi7(0x4c7)
00000800:00000200:6.0:1773851876.074941:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 468 bytes to peer 0x4c7: rc=0
00000800:00000200:6.0:1773851876.074943:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851876.074945:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851876.074946:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:6.0:1773851876.074947:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851876.074947:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851876.074948:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851876.074949:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ef26f3a x1858062667442240/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:6.0:1773851876.074952:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ef26f3a pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667442240:12345-2098@kfi7:41:default-yuba6-0 Request processed in 67us (102us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851876.074952:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851876.074954:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 18314082
00000400:00000200:5.0:1773851876.074954:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:6.0:1773851876.074955:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000400:00000200:5.0:1773851876.074955:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2098@kfi7: PUT: OK
00000100:00000001:6.0:1773851876.074956:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851876.074956:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851876.074956:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c307aa46
00000020:00000010:6.0:1773851876.074957:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000400:00000010:5.0:1773851876.074957:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c307aa46.
00000100:00000001:5.0:1773851876.074957:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:6.0:1773851876.074958:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000020:00000010:6.0:1773851876.074958:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000020:00000040:6.0:1773851876.074960:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:6.0:1773851876.074961:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851876.074961:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851876.074962:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:5.0:1773851876.074963:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 Transaction freed
00000004:00000001:11.0:1773851876.169731:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851876.169742:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851876.169743:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cd342c1.
00000020:00000040:11.0:1773851876.169743:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851876.169744:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851876.169745:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851876.169746:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851876.169746:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d420c2f5.
00000100:00000001:11.0:1773851876.169747:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851876.169748:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851876.169749:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851876.169750:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007cd342c1] to pc [ptlrpcd_02_00+0]  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851876.169755:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:11.0:1773851876.169756:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000caa6f313.
00080000:00000001:11.0:1773851876.169757:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636956249814016 : -107117459737600 : ffff9e93c5dcf400)
00000100:00000001:10.0:1773851876.169757:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:10.0:1773851876.169757:0:41069:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:8.0:1773851876.169757:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851876.169758:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:10.0:1773851876.169758:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851876.169758:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.169759:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851876.169759:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.169760:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851876.169760:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:11.0:1773851876.169761:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851876.169761:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000100:00000001:10.0:1773851876.169761:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:10.0:1773851876.169762:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851876.169764:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:11.0:1773851876.169765:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007d389c8f.
00000004:00080000:11.0:1773851876.169765:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614150623041090ns, next at 614151623037353ns, rc = 0
00000100:00000001:10.0:1773851876.169765:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851876.169766:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:10.0:1773851876.169766:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:10.0:1773851876.169766:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851876.169767:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.169767:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051931904:2075@kfi7:13:default-yuba2-0
00000004:00000001:11.0:1773851876.169768:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.169768:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851876.169769:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851876.169769:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.169770:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:10.0:1773851876.169771:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a5c4dee8.
02000000:00000001:10.0:1773851876.169771:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851876.169772:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:10.0:1773851876.169773:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000400:00000010:10.0:1773851876.169774:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000200:10.0:1773851876.169775:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931904, portal 4
00000100:00000001:10.0:1773851876.169776:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851876.169777:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079889187328 : -106993820364288 : ffff9eb08f581200)
00000100:00000040:10.0:1773851876.169778:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851876.169780:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851876.169781:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:10.0:1773851876.169782:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c0cf26cc.
00000100:00000200:10.0:1773851876.169783:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931904, offset 0
00000400:00000200:10.0:1773851876.169784:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:10.0:1773851876.169785:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851876.169786:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:10.0:1773851876.169787:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851876.169788:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:10.0:1773851876.169789:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:10.0:1773851876.169791:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769529, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769528, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851876.169793:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:10.0:1773851876.169793:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851876.169794:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:10.0:1773851876.169795:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769530:8769530:1024:4294967295] 2075@kfi7 LPNI seq info [5403912:5403912:16:4294967295]
00000400:00000200:10.0:1773851876.169796:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851876.169797:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851876.169799:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851876.169800:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:10.0:1773851876.169801:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851876.169802:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851876.169805:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851876.169807:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Using peer 2075@kfi7(0x2000000000004de)
00000800:00000200:10.0:1773851876.169810:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000333a7eb2: Posted send of 324 bytes to peer 0x2000000000004de: rc=0
00000800:00000200:10.0:1773851876.169812:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851876.169814:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.169814:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851876.169815:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.169816:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.169816:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.169824:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851876.169826:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.169827:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000400:00000200:9.0:1773851876.169828:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c0cf26cc
00000400:00000010:9.0:1773851876.169829:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c0cf26cc.
00000100:00000001:9.0:1773851876.169830:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851876.169831:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851876.169833:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851876.169834:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851876.169837:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851876.169838:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851876.169839:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851876.169841:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000333a7eb2: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Transaction freed
00000800:00000200:9.0:1773851876.169857:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851876.169858:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851876.169859:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851876.169861:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851876.169863:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.169865:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851876.169866:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.169867:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851876.169868:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.169869:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851876.169870:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851876.169870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.169871:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4500
00000400:00000200:9.0:1773851876.169872:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.169874:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781697f49 [1] + 224
00000800:00000200:9.0:1773851876.169876:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851876.169877:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.169878:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851876.169879:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851876.169880:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851876.169883:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851876.169886:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851876.169887:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851876.169887:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851876.169887:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000001:10.0:1773851876.169888:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:9.0:1773851876.169888:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:10.0:1773851876.169889:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851876.169889:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:10.0:1773851876.169890:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851876.169890:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851876.169891:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851876.169892:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851876.169894:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851876.169897:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851876.169897:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.169898:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851876.169898:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851876.169899:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.169899:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.169900:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851876.169901:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=109 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851876.169902:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=109 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851876.169904:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851876.169904:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.169905:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851876.169906:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.169906:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851876.169907:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:10.0:1773851876.169908:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851876.169908:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851876.169909:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851876.169912:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851876.169912:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851876.169913:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851876.169913:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851876.169914:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851876.169915:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470692352 avail=351461572608 avail_mb=1372896768 hwm_mb=3131103 files=372064520 ffree=343233098 state=0: rc = 0
00000004:00000020:10.0:1773851876.169917:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470692352 free, 351461572608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064520 files, 343233098 free files
00000004:00000001:10.0:1773851876.169918:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851876.169919:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851876.169922:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cd342c1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051931904:2075@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851876.169924:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.169924:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851876.169925:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007cd342c1 x1859433051931904/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851876.169927:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851876.169928:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851876.169928:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a5c4dee8.
02000000:00000001:10.0:1773851876.169929:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851876.169930:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851876.169930:0:41069:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:10.0:1773851876.169931:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851876.169931:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d420c2f5.
02000000:00000001:10.0:1773851876.169932:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851876.169932:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851876.169933:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cd342c1.
00000100:00000001:10.0:1773851876.169933:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851876.169934:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.169935:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.169935:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851876.169936:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.169936:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851876.169937:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851876.233735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851876.233738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:29.0:1773851876.237964:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.237965:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851876.237966:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851876.237969:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851876.237970:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12177@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.237972:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12177@kfi7 : PUT - for me
00000400:00000200:29.0:1773851876.237972:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12177@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.237973:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 1
00000400:00000200:29.0:1773851876.237975:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12177@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.237975:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 2
00000400:00000200:29.0:1773851876.237977:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 3
00000400:00000200:29.0:1773851876.237977:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12176@kfi7 to cpt 4
00000400:00000200:29.0:1773851876.237978:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12176@kfi7 of length 224 into portal 12 MB=0x69b4b568a9240
00000400:00000200:29.0:1773851876.237980:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12176@kfi7 of length 224/224 into md 0x77fe139dd [64] + 183728
00000800:00000200:29.0:1773851876.237981:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851876.237983:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851876.237984:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12177@kfi7: PUT: OK
00000100:00000001:29.0:1773851876.237984:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851876.237985:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851876.237986:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003680650d.
00000100:00000040:29.0:1773851876.237987:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000003680650d x1859597737038400 msgsize 224
00000100:00100000:29.0:1773851876.237988:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12176@kfi7 (source: 12345-12177@kfi7)
00000100:00000001:29.0:1773851876.237989:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851876.237990:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851876.237990:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 2
02000000:00000001:31.0:1773851876.237991:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851876.237991:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851876.237992:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851876.237992:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851876.237993:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851876.237994:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597737038400
00000020:00000001:31.0:1773851876.237994:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851876.237995:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23ec9f7c
00000020:00000001:31.0:1773851876.237995:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851876.237998:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009b2660fe refcount=5
00000020:00000001:31.0:1773851876.237998:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158637677568 : -106915071874048 : ffff9ec2e51eac00)
00000020:00000001:31.0:1773851876.237999:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637158637677568 : -106915071874048 : ffff9ec2e51eac00)
00000100:00000001:31.0:1773851876.238000:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851876.238001:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851876.238002:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851876.238003:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851876.238004:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851876.238005:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851876.238006:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851876.238006:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851876.238007:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851876.238008:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851876.238008:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.238009:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851876.238010:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851876.238011:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851876.238011:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851876.238011:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851876.238012:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12176@kfi7, seq: 2055541
00000100:00000040:31.0:1773851876.238013:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009b2660fe : new rpc_count 1
00000100:00000001:31.0:1773851876.238013:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091507236992 : -106982202314624 : ffff9eb343d57080)
00000100:00000001:28.0:1773851876.238013:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851876.238013:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851876.238014:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003680650d x1859597737038400/t0(0) o400->5acd6c0b-3dea-4ac7-a31f-1c735ff262bb@12176@kfi7:664/0 lens 224/0 e 0 to 0 dl 1773852024 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1250-0'
00000100:00000001:31.0:1773851876.238017:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851876.238017:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851876.238018:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003680650d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5acd6c0b-3dea-4ac7-a31f-1c735ff262bb+5:39518:x1859597737038400:12345-12176@kfi7:400:default-tuolumne1250-0
00000100:00000200:31.0:1773851876.238020:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597737038400
00000020:00000001:31.0:1773851876.238020:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851876.238021:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851876.238022:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.238023:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851876.238023:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851876.238024:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851876.238024:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597737038400, found 0 last_xid 1859597737038399
00000020:00000001:31.0:1773851876.238025:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851876.238026:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851876.238026:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851876.238027:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.238028:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851876.238028:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851876.238029:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851876.238031:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d4b2a38b.
02000000:00000001:31.0:1773851876.238031:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.238032:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.238033:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851876.238034:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695445, transno 0, xid 1859597737038400
00010000:00000001:31.0:1773851876.238034:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851876.238035:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003680650d x1859597737038400/t0(0) o400->5acd6c0b-3dea-4ac7-a31f-1c735ff262bb@12176@kfi7:664/0 lens 224/224 e 0 to 0 dl 1773852024 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1250-0'
00010000:00000001:31.0:1773851876.238037:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851876.238038:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851876.238039:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=109 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851876.238040:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851876.238041:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000399fd5fb refcount 3 to 12176@kfi7
00000100:00000001:31.0:1773851876.238041:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301331744 : -107155408219872 : ffff9e8aeff51120)
02000000:00000001:31.0:1773851876.238042:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851876.238043:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.238043:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851876.238044:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12177@kfi7
00000400:00000010:31.0:1773851876.238045:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004e2b8359.
00000100:00000200:31.0:1773851876.238046:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597737038400, offset 224
00000400:00000200:31.0:1773851876.238047:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12177@kfi7
00000400:00000200:31.0:1773851876.238048:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12177@kfi7 to cpt 7
00000400:00000200:31.0:1773851876.238049:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 1
00000400:00000200:31.0:1773851876.238050:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 2
00000400:00000200:31.0:1773851876.238051:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 3
00000400:00000200:31.0:1773851876.238052:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12177@kfi7 local destination
00000400:00000200:31.0:1773851876.238054:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769531:8769531:1024:4294967295] 12177@kfi7 LPNI seq info [170606:170606:16:4294967295]
00000400:00000200:31.0:1773851876.238055:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 2
00000400:00000200:31.0:1773851876.238056:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12177@kfi7 to cpt 7
00000400:00000200:31.0:1773851876.238058:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12177@kfi7(12177@kfi7:12177@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851876.238059:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 3
00000800:00000200:31.0:1773851876.238060:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851876.238063:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851876.238064:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851876.238067:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa58 Using peer 12177@kfi7(0xa58)
00000800:00000200:31.0:1773851876.238070:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0xa58: rc=0
00000800:00000200:31.0:1773851876.238071:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa58 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851876.238073:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851876.238074:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000399fd5fb refcount 2 to 12176@kfi7
00010000:00000001:31.0:1773851876.238075:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851876.238075:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.238076:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851876.238077:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003680650d x1859597737038400/t0(0) o400->5acd6c0b-3dea-4ac7-a31f-1c735ff262bb@12176@kfi7:664/0 lens 224/224 e 0 to 0 dl 1773852024 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1250-0'
00000100:00100000:31.0:1773851876.238080:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003680650d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:5acd6c0b-3dea-4ac7-a31f-1c735ff262bb+5:39518:x1859597737038400:12345-12176@kfi7:400:default-tuolumne1250-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851876.238082:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12176@kfi7, seq: 2055541
00000100:00000040:31.0:1773851876.238083:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009b2660fe : new rpc_count 0
00000800:00000200:29.0:1773851876.238083:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa58 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851876.238084:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851876.238084:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851876.238085:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851876.238085:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851876.238086:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851876.238086:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12177@kfi7: PUT: OK
00000020:00000010:31.0:1773851876.238087:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851876.238087:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000009b2660fe : new refcount 4
00000400:00000200:29.0:1773851876.238087:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004e2b8359
00000100:00000001:31.0:1773851876.238088:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851876.238088:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004e2b8359.
00000100:00000001:29.0:1773851876.238088:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851876.238089:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851876.238090:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eabc6ab3 nid 12177@kfi7 refs 2
00000800:00000200:29.0:1773851876.238091:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 12177@kfi7(00000000ecf8acbb):0x0 lsk 2649 rsk 7 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa58 Transaction freed
00000800:00000200:13.0:1773851876.247961:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851876.247961:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851876.247963:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851876.247965:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851876.247967:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13296@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.247968:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13296@kfi7 : PUT - for me
00000400:00000200:13.0:1773851876.247969:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13296@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.247970:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1eea303 nid 13296@kfi7 refs 1
00000400:00000200:13.0:1773851876.247972:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13296@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.247972:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1eea303 nid 13296@kfi7 refs 2
00000400:00000200:13.0:1773851876.247973:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b1eea303 nid 13296@kfi7 refs 3
00000400:00000200:13.0:1773851876.247974:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13105@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.247975:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13105@kfi7 of length 224 into portal 12 MB=0x699e23513eb40
00000400:00000200:13.0:1773851876.247976:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13105@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 37968
00000800:00000200:13.0:1773851876.247978:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851876.247979:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851876.247980:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13296@kfi7: PUT: OK
00000100:00000001:13.0:1773851876.247981:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851876.247982:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851876.247983:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000016fdba9c.
00000100:00000040:13.0:1773851876.247984:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000016fdba9c x1858046692420416 msgsize 224
00000100:00100000:13.0:1773851876.247985:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13105@kfi7 (source: 12345-13296@kfi7)
00000100:00000001:13.0:1773851876.247986:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851876.247987:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1eea303 nid 13296@kfi7 refs 2
00000100:00000001:15.0:1773851876.247988:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851876.247988:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851876.247989:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851876.247989:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851876.247990:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851876.247990:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851876.247991:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858046692420416
00000020:00000001:15.0:1773851876.247992:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851876.247992:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c5c
00000020:00000001:15.0:1773851876.247993:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851876.247996:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e4ac04b3 refcount=6
00000020:00000001:15.0:1773851876.247996:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628291584 : -107123081260032 : ffff9e9276cb5400)
00000020:00000001:15.0:1773851876.247997:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628291584 : -107123081260032 : ffff9e9276cb5400)
00000100:00000001:15.0:1773851876.247998:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851876.247999:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851876.248000:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000342ec44.
00000020:00000010:15.0:1773851876.248001:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851876.248002:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851876.248002:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851876.248003:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851876.248003:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851876.248004:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851876.248005:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851876.248005:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.248006:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851876.248007:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851876.248008:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851876.248008:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851876.248008:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851876.248009:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13105@kfi7, seq: 2289866
00000100:00000040:15.0:1773851876.248009:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e4ac04b3 : new rpc_count 1
00000100:00000001:15.0:1773851876.248010:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902267520 : -106994807284096 : ffff9eb05484de80)
00000100:00000001:12.0:1773851876.248010:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851876.248010:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851876.248011:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000016fdba9c x1858046692420416/t0(0) o400->1726b709-418d-47f9-96ce-2e13f271893b@13105@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1309-0'
00000100:00000001:15.0:1773851876.248014:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851876.248015:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851876.248016:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016fdba9c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1726b709-418d-47f9-96ce-2e13f271893b+6:39795:x1858046692420416:12345-13105@kfi7:400:default-tuolumne1309-0
00000100:00000200:15.0:1773851876.248017:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858046692420416
00000020:00000001:15.0:1773851876.248018:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851876.248018:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851876.248019:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.248020:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851876.248020:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851876.248022:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851876.248022:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858046692420416, found 0 last_xid 1858046692420415
00000020:00000001:15.0:1773851876.248023:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851876.248024:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851876.248025:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851876.248025:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.248026:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851876.248026:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851876.248027:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851876.248028:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad7808e4.
02000000:00000001:15.0:1773851876.248028:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.248029:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.248030:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851876.248030:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692695, transno 0, xid 1858046692420416
00010000:00000001:15.0:1773851876.248031:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851876.248032:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000016fdba9c x1858046692420416/t0(0) o400->1726b709-418d-47f9-96ce-2e13f271893b@13105@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1309-0'
00010000:00000001:15.0:1773851876.248034:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851876.248035:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851876.248036:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=109 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851876.248037:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851876.248037:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000721ea939 refcount 3 to 13105@kfi7
00000100:00000001:15.0:1773851876.248038:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642471680 : -107157067079936 : ffff9e8a8d14df00)
02000000:00000001:15.0:1773851876.248039:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851876.248040:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.248040:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851876.248041:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13296@kfi7
00000400:00000010:15.0:1773851876.248042:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000723f04f5.
00000100:00000200:15.0:1773851876.248043:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858046692420416, offset 224
00000400:00000200:15.0:1773851876.248044:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13296@kfi7
00000400:00000200:15.0:1773851876.248045:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13296@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.248046:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1eea303 nid 13296@kfi7 refs 1
00000400:00000200:15.0:1773851876.248047:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b1eea303 nid 13296@kfi7 refs 2
00000400:00000200:15.0:1773851876.248048:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b1eea303 nid 13296@kfi7 refs 3
00000400:00000200:15.0:1773851876.248050:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13296@kfi7 local destination
00000400:00000200:15.0:1773851876.248051:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769532:8769532:1024:4294967295] 13296@kfi7 LPNI seq info [6760438:6760438:16:4294967295]
00000400:00000200:15.0:1773851876.248053:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b1eea303 nid 13296@kfi7 refs 2
00000400:00000200:15.0:1773851876.248053:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13296@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.248055:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13296@kfi7(13296@kfi7:13296@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851876.248056:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b1eea303 nid 13296@kfi7 refs 3
00000800:00000200:15.0:1773851876.248058:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851876.248059:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851876.248061:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851876.248063:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000103a Using peer 13296@kfi7(0x10000000000103a)
00000800:00000200:15.0:1773851876.248066:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x10000000000103a: rc=0
00000800:00000200:15.0:1773851876.248067:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000103a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851876.248069:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851876.248070:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000721ea939 refcount 2 to 13105@kfi7
00010000:00000001:15.0:1773851876.248071:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851876.248072:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.248072:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851876.248073:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000016fdba9c x1858046692420416/t0(0) o400->1726b709-418d-47f9-96ce-2e13f271893b@13105@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1309-0'
00000100:00100000:15.0:1773851876.248076:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016fdba9c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1726b709-418d-47f9-96ce-2e13f271893b+6:39795:x1858046692420416:12345-13105@kfi7:400:default-tuolumne1309-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851876.248078:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13105@kfi7, seq: 2289866
00000100:00000040:15.0:1773851876.248079:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e4ac04b3 : new rpc_count 0
00000800:00000200:13.0:1773851876.248079:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000103a TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851876.248080:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851876.248081:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851876.248081:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851876.248082:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851876.248082:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000400:00000200:13.0:1773851876.248082:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13296@kfi7: PUT: OK
00000020:00000010:15.0:1773851876.248083:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000342ec44.
00000400:00000200:13.0:1773851876.248083:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000723f04f5
00000400:00000010:13.0:1773851876.248083:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000723f04f5.
00000020:00000040:15.0:1773851876.248084:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000e4ac04b3 : new refcount 5
00000100:00000001:13.0:1773851876.248084:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851876.248084:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851876.248085:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851876.248085:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1eea303 nid 13296@kfi7 refs 2
00000800:00000200:13.0:1773851876.248087:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 13296@kfi7(0000000045e3e9c5):0x0 lsk 4155 rsk 60 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000103a Transaction freed
00000800:00000200:17.0:1773851876.259318:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.259319:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851876.259321:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851876.259324:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851876.259327:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17954@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.259329:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17954@kfi7 : PUT - for me
00000400:00000200:17.0:1773851876.259331:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17954@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.259334:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a4635 nid 17954@kfi7 refs 1
00000400:00000200:17.0:1773851876.259336:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17954@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.259337:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a4635 nid 17954@kfi7 refs 2
00000400:00000200:17.0:1773851876.259338:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a4635 nid 17954@kfi7 refs 3
00000400:00000200:17.0:1773851876.259340:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18146@kfi7 to cpt 7
00000400:00000200:17.0:1773851876.259341:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18146@kfi7 of length 224 into portal 12 MB=0x69b0a309d7e00
00000400:00000200:17.0:1773851876.259343:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18146@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 24648
00000800:00000200:17.0:1773851876.259346:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851876.259349:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851876.259350:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17954@kfi7: PUT: OK
00000100:00000001:17.0:1773851876.259352:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851876.259353:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851876.259354:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000af4f3409.
00000100:00000040:17.0:1773851876.259355:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000af4f3409 x1859317927869952 msgsize 224
00000100:00100000:17.0:1773851876.259357:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18146@kfi7 (source: 12345-17954@kfi7)
00000100:00000001:17.0:1773851876.259359:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851876.259361:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a4635 nid 17954@kfi7 refs 2
00000800:00000200:17.0:1773851876.259363:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851876.259367:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851876.259368:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851876.259369:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851876.259370:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851876.259371:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851876.259372:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317927869952
00000020:00000001:17.0:1773851876.259373:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851876.259374:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ed9
00000020:00000001:17.0:1773851876.259374:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851876.259378:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003c442a94 refcount=6
00000020:00000001:17.0:1773851876.259379:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629006336 : -107123080545280 : ffff9e9276d63c00)
00000020:00000001:17.0:1773851876.259380:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629006336 : -107123080545280 : ffff9e9276d63c00)
00000100:00000001:17.0:1773851876.259381:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.259383:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851876.259384:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002a497fe.
00000020:00000010:17.0:1773851876.259386:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.259387:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851876.259388:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851876.259389:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851876.259390:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.259391:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851876.259392:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851876.259392:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.259394:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.259396:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851876.259396:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851876.259397:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851876.259397:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851876.259398:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18146@kfi7, seq: 2156361
00000100:00000040:17.0:1773851876.259399:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003c442a94 : new rpc_count 1
00000100:00000001:17.0:1773851876.259400:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372348672 : -107078337202944 : ffff9e9ce1bf7500)
00000100:00000001:16.0:1773851876.259400:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851876.259401:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.259402:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000af4f3409 x1859317927869952/t0(0) o400->b6536f12-baee-4ceb-b187-e9d0875be143@18146@kfi7:97/0 lens 224/0 e 0 to 0 dl 1773852212 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1611-0'
00000100:00000001:17.0:1773851876.259407:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.259407:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851876.259409:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af4f3409 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b6536f12-baee-4ceb-b187-e9d0875be143+6:39557:x1859317927869952:12345-18146@kfi7:400:default-tuolumne1611-0
00000100:00000200:17.0:1773851876.259411:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317927869952
00000020:00000001:17.0:1773851876.259412:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851876.259413:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851876.259414:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.259415:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851876.259415:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851876.259417:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851876.259418:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317927869952, found 0 last_xid 1859317927869951
00000020:00000001:17.0:1773851876.259419:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851876.259420:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851876.259421:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851876.259421:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.259423:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851876.259424:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851876.259424:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851876.259426:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c1588208.
02000000:00000001:17.0:1773851876.259427:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.259428:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.259429:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851876.259430:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260636144, transno 0, xid 1859317927869952
00010000:00000001:17.0:1773851876.259431:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851876.259432:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000af4f3409 x1859317927869952/t0(0) o400->b6536f12-baee-4ceb-b187-e9d0875be143@18146@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1611-0'
00010000:00000001:17.0:1773851876.259436:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851876.259437:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851876.259438:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=109 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851876.259440:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851876.259441:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e3efea16 refcount 3 to 18146@kfi7
00000100:00000001:17.0:1773851876.259442:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803392 : -107130477748224 : ffff9e90bdede000)
02000000:00000001:17.0:1773851876.259443:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851876.259444:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.259445:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851876.259446:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17954@kfi7
00000400:00000010:17.0:1773851876.259448:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fff506eb.
00000100:00000200:17.0:1773851876.259449:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317927869952, offset 224
00000400:00000200:17.0:1773851876.259451:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17954@kfi7
00000400:00000200:17.0:1773851876.259452:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17954@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.259453:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a4635 nid 17954@kfi7 refs 1
00000400:00000200:17.0:1773851876.259455:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a4635 nid 17954@kfi7 refs 2
00000400:00000200:17.0:1773851876.259457:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a4635 nid 17954@kfi7 refs 3
00000400:00000200:17.0:1773851876.259459:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17954@kfi7 local destination
00000400:00000200:17.0:1773851876.259461:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769533:8769533:1024:4294967295] 17954@kfi7 LPNI seq info [192987:192987:16:4294967295]
00000400:00000200:17.0:1773851876.259463:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a4635 nid 17954@kfi7 refs 2
00000400:00000200:17.0:1773851876.259464:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17954@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.259467:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17954@kfi7(17954@kfi7:17954@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851876.259469:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a4635 nid 17954@kfi7 refs 3
00000800:00000200:17.0:1773851876.259471:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.259473:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851876.259476:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851876.259480:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ec0 Using peer 17954@kfi7(0x100000000000ec0)
00000800:00000200:17.0:1773851876.259484:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x100000000000ec0: rc=0
00000800:00000200:17.0:1773851876.259487:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ec0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851876.259490:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.259491:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e3efea16 refcount 2 to 18146@kfi7
00010000:00000001:17.0:1773851876.259492:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851876.259493:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.259494:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851876.259495:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000af4f3409 x1859317927869952/t0(0) o400->b6536f12-baee-4ceb-b187-e9d0875be143@18146@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1611-0'
00000100:00100000:17.0:1773851876.259500:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af4f3409 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b6536f12-baee-4ceb-b187-e9d0875be143+6:39557:x1859317927869952:12345-18146@kfi7:400:default-tuolumne1611-0 Request processed in 92us (144us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851876.259503:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ec0 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851876.259503:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18146@kfi7, seq: 2156361
00000100:00000040:17.0:1773851876.259505:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003c442a94 : new rpc_count 0
00000400:00000200:18.0:1773851876.259506:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851876.259506:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851876.259507:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17954@kfi7: PUT: OK
00000100:00000001:17.0:1773851876.259507:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851876.259507:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.259508:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:18.0:1773851876.259509:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fff506eb
00000400:00000010:18.0:1773851876.259510:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fff506eb.
00000020:00000010:17.0:1773851876.259510:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002a497fe.
00000020:00000040:17.0:1773851876.259511:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000003c442a94 : new refcount 5
00000100:00000001:18.0:1773851876.259512:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851876.259512:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851876.259512:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851876.259514:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a4635 nid 17954@kfi7 refs 2
00000800:00000200:18.0:1773851876.259516:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 17954@kfi7(0000000016c12bb7):0x0 lsk 3777 rsk 44 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000ec0 Transaction freed
00000800:00000200:25.0:1773851876.296192:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.296194:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851876.296196:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851876.296199:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851876.296202:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.296204:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851876.296206:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.296207:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851876.296209:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.296210:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851876.296211:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851876.296213:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851876.296214:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a860a8d80
00000400:00000200:25.0:1773851876.296216:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 13840
00000800:00000200:25.0:1773851876.296219:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.296223:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851876.296224:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851876.296226:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851876.296226:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851876.296228:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e933f711.
00000100:00000040:25.0:1773851876.296229:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000e933f711 x1859388080557440 msgsize 224
00000100:00100000:25.0:1773851876.296231:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851876.296233:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851876.296234:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00000001:24.0:1773851876.296235:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851876.296236:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851876.296236:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.296237:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.296238:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851876.296239:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851876.296240:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080557440
00000020:00000001:24.0:1773851876.296241:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.296242:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:24.0:1773851876.296243:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.296244:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:24.0:1773851876.296245:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:24.0:1773851876.296246:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:24.0:1773851876.296248:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.296249:0:1537164:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851876.296250:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000157f1406.
00000020:00000010:24.0:1773851876.296251:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851876.296253:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005ba32091.
00000100:00000040:24.0:1773851876.296254:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851876.296255:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.296256:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851876.296257:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.296258:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.296260:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851876.296262:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851876.296263:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851876.296263:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851876.296264:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851876.296266:0:1691804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799984
00000100:00000040:25.0:1773851876.296267:0:1691804:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:25.0:1773851876.296268:0:1691804:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102835056384 : -106970874495232 : ffff9eb5e7063f00)
00000100:00000001:24.0:1773851876.296268:0:1537164:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.296269:0:1537164:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851876.296271:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e933f711 x1859388080557440/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:25.0:1773851876.296275:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851876.296276:0:1691804:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851876.296277:0:1691804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e933f711 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080557440:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:25.0:1773851876.296280:0:1691804:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080557440
00000020:00000001:25.0:1773851876.296281:0:1691804:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851876.296282:0:1691804:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851876.296283:0:1691804:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851876.296284:0:1691804:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851876.296285:0:1691804:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:25.0:1773851876.296286:0:1691804:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:25.0:1773851876.296287:0:1691804:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851876.296288:0:1691804:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851876.296289:0:1691804:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851876.296290:0:1691804:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851876.296292:0:1691804:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851876.296293:0:1691804:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851876.296294:0:1691804:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000031dd9f6f.
02000000:00000001:25.0:1773851876.296295:0:1691804:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851876.296296:0:1691804:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851876.296298:0:1691804:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:25.0:1773851876.296299:0:1691804:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:25.0:1773851876.296300:0:1691804:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:25.0:1773851876.296301:0:1691804:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:25.0:1773851876.296303:0:1691804:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:25.0:1773851876.296306:0:1691804:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851876.296307:0:1691804:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080557440
00010000:00000001:25.0:1773851876.296308:0:1691804:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851876.296310:0:1691804:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e933f711 x1859388080557440/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:25.0:1773851876.296314:0:1691804:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851876.296315:0:1691804:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851876.296316:0:1691804:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=153 v=66 (1 1 1 1)
00000100:00000001:25.0:1773851876.296318:0:1691804:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851876.296319:0:1691804:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:25.0:1773851876.296320:0:1691804:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:25.0:1773851876.296322:0:1691804:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851876.296322:0:1691804:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851876.296324:0:1691804:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851876.296325:0:1691804:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:25.0:1773851876.296326:0:1691804:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4d002ce.
00000100:00000200:25.0:1773851876.296327:0:1691804:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080557440, offset 224
00000400:00000200:25.0:1773851876.296330:0:1691804:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:25.0:1773851876.296331:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.296332:0:1691804:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851876.296334:0:1691804:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851876.296335:0:1691804:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851876.296337:0:1691804:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:25.0:1773851876.296340:0:1691804:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769534:8769534:1024:4294967295] 8@kfi7 LPNI seq info [17340066:17340066:16:4294967295]
00000400:00000200:25.0:1773851876.296343:0:1691804:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851876.296344:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.296348:0:1691804:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851876.296350:0:1691804:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:25.0:1773851876.296352:0:1691804:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.296354:0:1691804:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:25.0:1773851876.296357:0:1691804:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851876.296361:0:1691804:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000800:00000200:25.0:1773851876.296366:0:1691804:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 468 bytes to peer 0x200000000001191: rc=0
00000800:00000200:25.0:1773851876.296368:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851876.296371:0:1691804:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851876.296373:0:1691804:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:25.0:1773851876.296374:0:1691804:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851876.296375:0:1691804:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851876.296376:0:1691804:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851876.296377:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e933f711 x1859388080557440/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:25.0:1773851876.296382:0:1691804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e933f711 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080557440:12345-7@kfi7:41:default-yuba5-0 Request processed in 106us (152us total) trans 0 rc 0/0
00000800:00000200:27.0:1773851876.296383:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851876.296386:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:25.0:1773851876.296386:0:1691804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799984
00000100:00000040:25.0:1773851876.296388:0:1691804:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000400:00000200:27.0:1773851876.296389:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851876.296389:0:1691804:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:27.0:1773851876.296390:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4d002ce
00000100:00000001:25.0:1773851876.296390:0:1691804:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:27.0:1773851876.296391:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4d002ce.
00000020:00000010:25.0:1773851876.296391:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:25.0:1773851876.296392:0:1691804:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005ba32091.
00000100:00000001:27.0:1773851876.296393:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851876.296393:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851876.296395:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000020:00000010:25.0:1773851876.296397:0:1691804:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000157f1406.
00000800:00000200:27.0:1773851876.296398:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Transaction freed
00000020:00000040:25.0:1773851876.296399:0:1691804:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:25.0:1773851876.296400:0:1691804:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851876.315763:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851876.315764:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851876.315766:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851876.315769:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851876.315772:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15456@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.315775:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15456@kfi7 : PUT - for me
00000400:00000200:13.0:1773851876.315776:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15456@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.315778:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ee0688 nid 15456@kfi7 refs 1
00000400:00000200:13.0:1773851876.315780:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15456@kfi7 to cpt 3
00000400:00000200:13.0:1773851876.315781:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ee0688 nid 15456@kfi7 refs 2
00000400:00000200:13.0:1773851876.315783:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000066ee0688 nid 15456@kfi7 refs 3
00000400:00000200:13.0:1773851876.315784:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15457@kfi7 to cpt 6
00000400:00000200:13.0:1773851876.315786:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15457@kfi7 of length 224 into portal 12 MB=0x69b4b5c928880
00000400:00000200:13.0:1773851876.315788:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15457@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 38192
00000800:00000200:13.0:1773851876.315791:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851876.315794:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851876.315795:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15456@kfi7: PUT: OK
00000100:00000001:13.0:1773851876.315797:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851876.315797:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851876.315798:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000704425fa.
00000100:00000040:13.0:1773851876.315799:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000704425fa x1859597838223488 msgsize 224
00000100:00100000:13.0:1773851876.315801:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-15457@kfi7 (source: 12345-15456@kfi7)
00000100:00000001:13.0:1773851876.315803:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851876.315804:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000066ee0688 nid 15456@kfi7 refs 2
00000100:00000001:15.0:1773851876.315805:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851876.315805:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851876.315805:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851876.315806:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851876.315807:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851876.315807:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851876.315808:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597838223488
00000020:00000001:15.0:1773851876.315809:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851876.315810:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a95
00000020:00000001:15.0:1773851876.315810:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851876.315815:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e3e8d890 refcount=5
00000020:00000001:15.0:1773851876.315816:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063872022528 : -107009837529088 : ffff9eacd4a58800)
00000020:00000001:15.0:1773851876.315817:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637063872022528 : -107009837529088 : ffff9eacd4a58800)
00000100:00000001:15.0:1773851876.315818:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851876.315819:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851876.315820:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000342ec44.
00000020:00000010:15.0:1773851876.315821:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851876.315822:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851876.315823:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851876.315824:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851876.315824:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851876.315825:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851876.315826:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851876.315826:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.315828:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851876.315829:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851876.315829:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851876.315830:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851876.315830:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851876.315831:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15457@kfi7, seq: 2289867
00000100:00000040:15.0:1773851876.315832:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e3e8d890 : new rpc_count 1
00000100:00000001:15.0:1773851876.315832:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902245632 : -106994807305984 : ffff9eb054848900)
00000100:00000001:12.0:1773851876.315832:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851876.315833:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851876.315834:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000704425fa x1859597838223488/t0(0) o400->808804b1-4fcc-45e7-b5d9-08c579db9325@15457@kfi7:664/0 lens 224/0 e 0 to 0 dl 1773852024 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1456-0'
00000100:00000001:15.0:1773851876.315838:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851876.315838:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851876.315839:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000704425fa pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:808804b1-4fcc-45e7-b5d9-08c579db9325+5:39774:x1859597838223488:12345-15457@kfi7:400:default-tuolumne1456-0
00000100:00000200:15.0:1773851876.315840:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597838223488
00000020:00000001:15.0:1773851876.315841:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851876.315842:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851876.315843:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.315843:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851876.315844:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851876.315845:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851876.315846:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597838223488, found 0 last_xid 1859597838223487
00000020:00000001:15.0:1773851876.315846:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851876.315847:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851876.315848:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851876.315848:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.315849:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851876.315849:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851876.315850:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851876.315852:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b969bf69.
02000000:00000001:15.0:1773851876.315853:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.315853:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.315854:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851876.315855:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035361808, transno 0, xid 1859597838223488
00010000:00000001:15.0:1773851876.315855:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851876.315856:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000704425fa x1859597838223488/t0(0) o400->808804b1-4fcc-45e7-b5d9-08c579db9325@15457@kfi7:664/0 lens 224/224 e 0 to 0 dl 1773852024 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1456-0'
00010000:00000001:15.0:1773851876.315858:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851876.315859:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851876.315860:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=109 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851876.315861:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851876.315861:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000459e5561 refcount 3 to 15457@kfi7
00000100:00000001:15.0:1773851876.315862:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299332256 : -107155410219360 : ffff9e8aefd68ea0)
02000000:00000001:15.0:1773851876.315864:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851876.315864:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.315865:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851876.315865:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15456@kfi7
00000400:00000010:15.0:1773851876.315866:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000011bada2.
00000100:00000200:15.0:1773851876.315867:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597838223488, offset 224
00000400:00000200:15.0:1773851876.315868:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15456@kfi7
00000400:00000200:15.0:1773851876.315869:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15456@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.315870:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066ee0688 nid 15456@kfi7 refs 1
00000400:00000200:15.0:1773851876.315871:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000066ee0688 nid 15456@kfi7 refs 2
00000400:00000200:15.0:1773851876.315872:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000066ee0688 nid 15456@kfi7 refs 3
00000400:00000200:15.0:1773851876.315873:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15456@kfi7 local destination
00000400:00000200:15.0:1773851876.315875:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769535:8769535:1024:4294967295] 15456@kfi7 LPNI seq info [702336:702336:16:4294967295]
00000400:00000200:15.0:1773851876.315876:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000066ee0688 nid 15456@kfi7 refs 2
00000400:00000200:15.0:1773851876.315877:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15456@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.315879:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15456@kfi7(15456@kfi7:15456@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851876.315880:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000066ee0688 nid 15456@kfi7 refs 3
00000800:00000200:15.0:1773851876.315881:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851876.315882:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851876.315885:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851876.315887:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000123c Using peer 15456@kfi7(0x10000000000123c)
00000800:00000200:15.0:1773851876.315890:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x10000000000123c: rc=0
00000800:00000200:15.0:1773851876.315891:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000123c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851876.315893:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851876.315894:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000459e5561 refcount 2 to 15457@kfi7
00010000:00000001:15.0:1773851876.315895:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851876.315896:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851876.315897:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851876.315897:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000704425fa x1859597838223488/t0(0) o400->808804b1-4fcc-45e7-b5d9-08c579db9325@15457@kfi7:664/0 lens 224/224 e 0 to 0 dl 1773852024 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1456-0'
00000100:00100000:15.0:1773851876.315900:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000704425fa pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:808804b1-4fcc-45e7-b5d9-08c579db9325+5:39774:x1859597838223488:12345-15457@kfi7:400:default-tuolumne1456-0 Request processed in 62us (100us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851876.315903:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15457@kfi7, seq: 2289867
00000800:00000200:13.0:1773851876.315903:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000123c TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851876.315904:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e3e8d890 : new rpc_count 0
00000100:00000001:15.0:1773851876.315905:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851876.315905:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851876.315905:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851876.315906:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851876.315906:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15456@kfi7: PUT: OK
00000020:00000010:15.0:1773851876.315907:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000020:00000010:15.0:1773851876.315907:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000342ec44.
00000400:00000200:13.0:1773851876.315907:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000011bada2
00000400:00000010:13.0:1773851876.315907:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000011bada2.
00000020:00000040:15.0:1773851876.315908:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000e3e8d890 : new refcount 4
00000100:00000001:13.0:1773851876.315908:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851876.315909:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851876.315909:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851876.315909:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000066ee0688 nid 15456@kfi7 refs 2
00000800:00000200:13.0:1773851876.315911:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 15456@kfi7(00000000627c1a62):0x0 lsk 4669 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000123c Transaction freed
00000800:00000200:1.0:1773851876.330055:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851876.330057:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851876.330059:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851876.330063:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851876.330066:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18018@kfi7 to cpt 0
00000400:00000200:1.0:1773851876.330068:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18018@kfi7 : PUT - for me
00000400:00000200:1.0:1773851876.330070:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18018@kfi7 to cpt 0
00000400:00000200:1.0:1773851876.330071:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af9f716a nid 18018@kfi7 refs 1
00000400:00000200:1.0:1773851876.330073:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18018@kfi7 to cpt 0
00000400:00000200:1.0:1773851876.330074:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af9f716a nid 18018@kfi7 refs 2
00000400:00000200:1.0:1773851876.330075:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000af9f716a nid 18018@kfi7 refs 3
00000400:00000200:1.0:1773851876.330077:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18018@kfi7 to cpt 0
00000400:00000200:1.0:1773851876.330078:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18018@kfi7 of length 224 into portal 12 MB=0x69b4b8dd2f500
00000400:00000200:1.0:1773851876.330081:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18018@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 36912
00000800:00000200:1.0:1773851876.330084:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851876.330087:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851876.330088:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18018@kfi7: PUT: OK
00000100:00000001:1.0:1773851876.330090:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851876.330091:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851876.330092:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fdd44038.
00000100:00000040:1.0:1773851876.330094:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000fdd44038 x1859598664529152 msgsize 224
00000100:00100000:1.0:1773851876.330096:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-18018@kfi7 (source: 12345-18018@kfi7)
00000100:00000001:1.0:1773851876.330098:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851876.330099:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000af9f716a nid 18018@kfi7 refs 2
00000100:00000001:0.0:1773851876.330100:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851876.330101:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851876.330102:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851876.330102:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851876.330102:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851876.330104:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851876.330105:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598664529152
00000020:00000001:0.0:1773851876.330106:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851876.330107:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e245d72c5
00000020:00000001:0.0:1773851876.330108:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851876.330111:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003c53a883 refcount=5
00000020:00000001:0.0:1773851876.330112:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637036157982720 : -107037551568896 : ffff9ea660c2d800)
00000020:00000001:0.0:1773851876.330114:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637036157982720 : -107037551568896 : ffff9ea660c2d800)
00000100:00000001:0.0:1773851876.330115:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851876.330116:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851876.330118:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000030135ad.
00000020:00000010:0.0:1773851876.330120:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851876.330121:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851876.330122:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851876.330123:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851876.330124:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851876.330126:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851876.330126:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851876.330127:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851876.330129:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851876.330131:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851876.330131:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851876.330131:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851876.330132:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851876.330133:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18018@kfi7, seq: 1997579
00000100:00000001:1.0:1773851876.330134:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851876.330134:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003c53a883 : new rpc_count 1
00000100:00000001:1.0:1773851876.330135:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851876.330135:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599712256 : -107004109839360 : ffff9eae2a0b2400)
00000100:00000040:0.0:1773851876.330137:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fdd44038 x1859598664529152/t0(0) o400->5e3bdc6c-ee60-4d40-adbc-68c3bd818dab@18018@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1612-0'
00000100:00000001:0.0:1773851876.330142:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851876.330142:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851876.330144:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fdd44038 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5e3bdc6c-ee60-4d40-adbc-68c3bd818dab+5:39718:x1859598664529152:12345-18018@kfi7:400:default-tuolumne1612-0
00000100:00000200:0.0:1773851876.330146:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598664529152
00000020:00000001:0.0:1773851876.330147:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851876.330148:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851876.330150:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851876.330151:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851876.330152:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851876.330153:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851876.330154:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598664529152, found 0 last_xid 1859598664529151
00000020:00000001:0.0:1773851876.330156:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851876.330157:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851876.330157:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851876.330158:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851876.330159:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851876.330160:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851876.330161:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851876.330162:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000526ea46e.
02000000:00000001:0.0:1773851876.330163:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851876.330164:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851876.330165:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851876.330166:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262833637, transno 0, xid 1859598664529152
00010000:00000001:0.0:1773851876.330167:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851876.330169:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fdd44038 x1859598664529152/t0(0) o400->5e3bdc6c-ee60-4d40-adbc-68c3bd818dab@18018@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1612-0'
00010000:00000001:0.0:1773851876.330173:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851876.330174:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851876.330175:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=109 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851876.330177:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851876.330178:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006474a4b refcount 3 to 18018@kfi7
00000100:00000001:0.0:1773851876.330179:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052256 : -107154804499360 : ffff9e8b13f11c60)
02000000:00000001:0.0:1773851876.330180:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851876.330181:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851876.330182:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851876.330184:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18018@kfi7
00000400:00000010:0.0:1773851876.330185:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e89b889f.
00000100:00000200:0.0:1773851876.330186:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598664529152, offset 224
00000400:00000200:0.0:1773851876.330188:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18018@kfi7
00000400:00000200:0.0:1773851876.330189:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18018@kfi7 to cpt 0
00000400:00000200:0.0:1773851876.330191:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af9f716a nid 18018@kfi7 refs 1
00000400:00000200:0.0:1773851876.330194:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000af9f716a nid 18018@kfi7 refs 2
00000400:00000200:0.0:1773851876.330195:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000af9f716a nid 18018@kfi7 refs 3
00000400:00000200:0.0:1773851876.330197:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18018@kfi7 local destination
00000400:00000200:0.0:1773851876.330200:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769536:8769536:1024:4294967295] 18018@kfi7 LPNI seq info [8533063:8533063:16:4294967295]
00000400:00000200:0.0:1773851876.330202:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000af9f716a nid 18018@kfi7 refs 2
00000400:00000200:0.0:1773851876.330203:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18018@kfi7 to cpt 0
00000400:00000200:0.0:1773851876.330206:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18018@kfi7(18018@kfi7:18018@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851876.330208:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000af9f716a nid 18018@kfi7 refs 3
00000800:00000200:0.0:1773851876.330210:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851876.330212:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851876.330215:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851876.330219:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x63d Using peer 18018@kfi7(0x63d)
00000800:00000200:0.0:1773851876.330223:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x63d: rc=0
00000800:00000200:0.0:1773851876.330226:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x63d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851876.330229:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851876.330230:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006474a4b refcount 2 to 18018@kfi7
00010000:00000001:0.0:1773851876.330232:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851876.330232:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851876.330236:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851876.330237:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fdd44038 x1859598664529152/t0(0) o400->5e3bdc6c-ee60-4d40-adbc-68c3bd818dab@18018@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1612-0'
00000100:00100000:0.0:1773851876.330242:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fdd44038 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5e3bdc6c-ee60-4d40-adbc-68c3bd818dab+5:39718:x1859598664529152:12345-18018@kfi7:400:default-tuolumne1612-0 Request processed in 99us (147us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851876.330246:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18018@kfi7, seq: 1997579
00000100:00000040:0.0:1773851876.330247:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003c53a883 : new rpc_count 0
00000100:00000001:0.0:1773851876.330249:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851876.330250:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851876.330251:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851876.330252:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851876.330253:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000030135ad.
00000020:00000040:0.0:1773851876.330255:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003c53a883 : new refcount 4
00000100:00000001:0.0:1773851876.330256:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851876.330264:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x63d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851876.330267:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851876.330269:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18018@kfi7: PUT: OK
00000400:00000200:1.0:1773851876.330270:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e89b889f
00000400:00000010:1.0:1773851876.330271:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e89b889f.
00000100:00000001:1.0:1773851876.330272:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851876.330273:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851876.330274:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000af9f716a nid 18018@kfi7 refs 2
00000800:00000200:1.0:1773851876.330277:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18018@kfi7(00000000b4edac8e):0x0 lsk 1598 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x63d Transaction freed
00000800:00000200:5.0:1773851876.369626:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851876.369627:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851876.369628:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851876.369630:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851876.369632:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851876.369633:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851876.369634:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851876.369635:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851876.369636:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851876.369636:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851876.369637:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851876.369638:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851876.369639:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c964000
00000400:00000200:5.0:1773851876.369640:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x793844545 [256] + 7184
00000800:00000200:5.0:1773851876.369643:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851876.369644:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851876.369645:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851876.369646:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851876.369647:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851876.369647:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d7b544ce.
00000100:00000040:5.0:1773851876.369648:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d7b544ce x1858065608884224 msgsize 224
00000100:00100000:5.0:1773851876.369650:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00000100:00000001:5.0:1773851876.369651:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851876.369652:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000001:6.0:1773851876.369653:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851876.369653:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851876.369653:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851876.369654:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851876.369654:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851876.369655:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851876.369656:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608884224
00000020:00000001:6.0:1773851876.369656:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851876.369657:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:6.0:1773851876.369657:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851876.369658:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:6.0:1773851876.369659:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:6.0:1773851876.369659:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:6.0:1773851876.369660:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851876.369661:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851876.369662:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851876.369663:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851876.369663:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851876.369664:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851876.369665:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851876.369665:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851876.369666:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.369667:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.369668:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851876.369669:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851876.369669:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851876.369669:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851876.369670:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851876.369671:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314083
00000100:00000040:6.0:1773851876.369671:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:5.0:1773851876.369671:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.369672:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273387008 : -107034436164608 : ffff9ea71a742400)
00000100:00000001:5.0:1773851876.369672:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851876.369673:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d7b544ce x1858065608884224/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:6.0:1773851876.369675:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851876.369676:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851876.369678:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7b544ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065608884224:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:6.0:1773851876.369679:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608884224
00000020:00000001:6.0:1773851876.369679:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851876.369680:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851876.369681:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851876.369681:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851876.369682:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851876.369682:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851876.369683:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851876.369684:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851876.369684:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851876.369685:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.369685:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851876.369686:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851876.369687:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000089733cf.
02000000:00000001:6.0:1773851876.369688:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.369688:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851876.369689:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851876.369690:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851876.369690:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851876.369691:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851876.369692:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851876.369693:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851876.369694:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608884224
00010000:00000001:6.0:1773851876.369695:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851876.369696:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d7b544ce x1858065608884224/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:6.0:1773851876.369698:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851876.369698:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851876.369699:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=105 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851876.369700:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851876.369701:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:6.0:1773851876.369702:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:6.0:1773851876.369703:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851876.369706:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851876.369706:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851876.369707:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000400:00000010:6.0:1773851876.369708:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a5d4425b.
00000100:00000200:6.0:1773851876.369709:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608884224, offset 224
00000400:00000200:6.0:1773851876.369710:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000400:00000200:6.0:1773851876.369711:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.369712:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:6.0:1773851876.369713:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851876.369715:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:6.0:1773851876.369716:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  30@kfi7 local destination
00000400:00000200:6.0:1773851876.369718:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769537:8769537:1024:4294967295] 30@kfi7 LPNI seq info [23133319:23133319:16:4294967295]
00000400:00000200:6.0:1773851876.369719:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851876.369720:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851876.369723:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851876.369724:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000800:00000200:6.0:1773851876.369732:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851876.369733:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851876.369736:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851876.369738:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 Using peer 30@kfi7(0xa16)
00000800:00000200:6.0:1773851876.369742:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000000e8b9920: Posted send of 468 bytes to peer 0xa16: rc=0
00000800:00000200:6.0:1773851876.369743:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851876.369746:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851876.369746:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:6.0:1773851876.369747:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851876.369748:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851876.369749:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851876.369750:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d7b544ce x1858065608884224/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:6.0:1773851876.369754:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7b544ce pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065608884224:12345-13@kfi7:41:default-yuba3-0 Request processed in 77us (105us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851876.369756:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851876.369757:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314083
00000100:00000040:6.0:1773851876.369758:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000400:00000200:5.0:1773851876.369758:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851876.369759:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851876.369759:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851876.369760:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000400:00000200:5.0:1773851876.369760:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000400:00000200:5.0:1773851876.369760:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a5d4425b
00000020:00000010:6.0:1773851876.369761:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000400:00000010:5.0:1773851876.369761:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a5d4425b.
00000020:00000010:6.0:1773851876.369762:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000020:00000040:6.0:1773851876.369762:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:5.0:1773851876.369762:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851876.369763:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851876.369763:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851876.369764:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851876.369765:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 Transaction freed
00000800:00000200:17.0:1773851876.390323:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.390325:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851876.390326:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851876.390329:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851876.390331:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19907@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.390332:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19907@kfi7 : PUT - for me
00000400:00000200:17.0:1773851876.390333:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19907@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.390334:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b58312fe nid 19907@kfi7 refs 1
00000400:00000200:17.0:1773851876.390334:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19907@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.390335:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b58312fe nid 19907@kfi7 refs 2
00000400:00000200:17.0:1773851876.390336:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b58312fe nid 19907@kfi7 refs 3
00000400:00000200:17.0:1773851876.390337:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19714@kfi7 to cpt 6
00000400:00000200:17.0:1773851876.390337:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19714@kfi7 of length 224 into portal 12 MB=0x69b81c5851e00
00000400:00000200:17.0:1773851876.390339:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19714@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 24872
00000800:00000200:17.0:1773851876.390340:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851876.390342:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851876.390343:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19907@kfi7: PUT: OK
00000100:00000001:17.0:1773851876.390344:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851876.390344:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851876.390345:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f717e63c.
00000100:00000040:17.0:1773851876.390346:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f717e63c x1859831527185920 msgsize 224
00000100:00100000:17.0:1773851876.390347:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19714@kfi7 (source: 12345-19907@kfi7)
00000100:00000001:17.0:1773851876.390348:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851876.390349:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b58312fe nid 19907@kfi7 refs 2
00000800:00000200:17.0:1773851876.390351:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851876.390353:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851876.390354:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851876.390354:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851876.390355:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851876.390358:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851876.390358:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831527185920
00000020:00000001:17.0:1773851876.390359:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851876.390359:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce2f177
00000020:00000001:17.0:1773851876.390360:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851876.390362:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fd8b9747 refcount=5
00000020:00000001:17.0:1773851876.390362:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151589146624 : -106922120404992 : ffff9ec140fea000)
00000020:00000001:17.0:1773851876.390363:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637151589146624 : -106922120404992 : ffff9ec140fea000)
00000100:00000001:17.0:1773851876.390364:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.390365:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851876.390366:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c935461.
00000020:00000010:17.0:1773851876.390367:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.390367:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851876.390368:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851876.390369:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851876.390369:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.390370:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851876.390370:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851876.390371:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.390372:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.390373:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851876.390373:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851876.390373:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851876.390374:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19714@kfi7, seq: 2156362
00000100:00000001:16.0:1773851876.390374:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851876.390375:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fd8b9747 : new rpc_count 1
00000100:00000001:16.0:1773851876.390375:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.390376:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636995372345216 : -107078337206400 : ffff9e9ce1bf6780)
00000100:00000001:16.0:1773851876.390376:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.390377:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f717e63c x1859831527185920/t0(0) o400->25208939-ee9f-4193-ad14-5b60f9245abd@19714@kfi7:97/0 lens 224/0 e 0 to 0 dl 1773852212 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1735-0'
00000100:00000001:17.0:1773851876.390379:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.390380:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851876.390381:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f717e63c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:25208939-ee9f-4193-ad14-5b60f9245abd+5:39466:x1859831527185920:12345-19714@kfi7:400:default-tuolumne1735-0
00000100:00000200:17.0:1773851876.390382:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831527185920
00000020:00000001:17.0:1773851876.390383:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851876.390384:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851876.390385:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.390385:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851876.390386:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851876.390386:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851876.390387:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831527185920, found 0 last_xid 1859831527185919
00000020:00000001:17.0:1773851876.390388:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851876.390389:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851876.390389:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851876.390390:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.390390:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851876.390391:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851876.390391:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851876.390392:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000afefac00.
02000000:00000001:17.0:1773851876.390393:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.390393:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.390394:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851876.390395:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691606, transno 0, xid 1859831527185920
00010000:00000001:17.0:1773851876.390395:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851876.390396:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f717e63c x1859831527185920/t0(0) o400->25208939-ee9f-4193-ad14-5b60f9245abd@19714@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1735-0'
00010000:00000001:17.0:1773851876.390399:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851876.390399:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851876.390400:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=109 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851876.390401:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851876.390402:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d8da751 refcount 3 to 19714@kfi7
00000100:00000001:17.0:1773851876.390402:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299328992 : -107155410222624 : ffff9e8aefd681e0)
02000000:00000001:17.0:1773851876.390403:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851876.390404:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.390404:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851876.390405:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19907@kfi7
00000400:00000010:17.0:1773851876.390406:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000427a4ed2.
00000100:00000200:17.0:1773851876.390406:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831527185920, offset 224
00000400:00000200:17.0:1773851876.390408:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19907@kfi7
00000400:00000200:17.0:1773851876.390409:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19907@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.390409:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b58312fe nid 19907@kfi7 refs 1
00000400:00000200:17.0:1773851876.390410:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b58312fe nid 19907@kfi7 refs 2
00000400:00000200:17.0:1773851876.390411:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b58312fe nid 19907@kfi7 refs 3
00000400:00000200:17.0:1773851876.390413:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19907@kfi7 local destination
00000400:00000200:17.0:1773851876.390414:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769538:8769538:1024:4294967295] 19907@kfi7 LPNI seq info [8788539:8788539:16:4294967295]
00000400:00000200:17.0:1773851876.390415:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b58312fe nid 19907@kfi7 refs 2
00000400:00000200:17.0:1773851876.390416:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19907@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.390417:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19907@kfi7(19907@kfi7:19907@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851876.390418:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b58312fe nid 19907@kfi7 refs 3
00000800:00000200:17.0:1773851876.390419:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.390420:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851876.390422:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851876.390425:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c31 Using peer 19907@kfi7(0x100000000000c31)
00000800:00000200:17.0:1773851876.390427:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x100000000000c31: rc=0
00000800:00000200:17.0:1773851876.390429:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c31 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851876.390431:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.390431:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d8da751 refcount 2 to 19714@kfi7
00010000:00000001:17.0:1773851876.390432:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851876.390433:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.390433:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851876.390434:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f717e63c x1859831527185920/t0(0) o400->25208939-ee9f-4193-ad14-5b60f9245abd@19714@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1735-0'
00000100:00100000:17.0:1773851876.390437:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f717e63c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:25208939-ee9f-4193-ad14-5b60f9245abd+5:39466:x1859831527185920:12345-19714@kfi7:400:default-tuolumne1735-0 Request processed in 56us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851876.390439:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19714@kfi7, seq: 2156362
00000800:00000200:19.0:1773851876.390441:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c31 TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851876.390443:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851876.390444:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19907@kfi7: PUT: OK
00000400:00000200:19.0:1773851876.390445:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000427a4ed2
00000400:00000010:19.0:1773851876.390445:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000427a4ed2.
00000100:00000001:19.0:1773851876.390446:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851876.390446:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851876.390447:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b58312fe nid 19907@kfi7 refs 2
00000800:00000200:19.0:1773851876.390448:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19907@kfi7(0000000089091d2b):0x0 lsk 3122 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000c31 Transaction freed
00000100:00000040:17.0:1773851876.390450:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fd8b9747 : new rpc_count 0
00000100:00000001:17.0:1773851876.390451:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851876.390451:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851876.390452:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.390453:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851876.390453:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c935461.
00000020:00000040:17.0:1773851876.390454:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000fd8b9747 : new refcount 4
00000100:00000001:17.0:1773851876.390455:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851876.447109:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.447110:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851876.447111:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851876.447113:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851876.447115:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10611@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.447117:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10611@kfi7 : PUT - for me
00000400:00000200:25.0:1773851876.447117:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10611@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.447118:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a830b34 nid 10611@kfi7 refs 1
00000400:00000200:25.0:1773851876.447119:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10611@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.447120:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a830b34 nid 10611@kfi7 refs 2
00000400:00000200:25.0:1773851876.447121:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a830b34 nid 10611@kfi7 refs 3
00000400:00000200:25.0:1773851876.447122:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10674@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.447123:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10674@kfi7 of length 224 into portal 12 MB=0x699e13e599a80
00000400:00000200:25.0:1773851876.447125:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10674@kfi7 of length 224/224 into md 0x16159c9699 [64] + 23448
00000800:00000200:25.0:1773851876.447127:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.447129:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851876.447130:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10611@kfi7: PUT: OK
00000100:00000001:25.0:1773851876.447131:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851876.447132:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851876.447133:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b40dcada.
00000100:00000040:25.0:1773851876.447133:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b40dcada x1858042553014912 msgsize 224
00000100:00100000:25.0:1773851876.447135:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10674@kfi7 (source: 12345-10611@kfi7)
00000100:00000001:25.0:1773851876.447136:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851876.447137:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a830b34 nid 10611@kfi7 refs 2
00000100:00000001:27.0:1773851876.447139:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851876.447139:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851876.447140:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851876.447141:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851876.447141:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851876.447143:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851876.447144:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042553014912
00000020:00000001:27.0:1773851876.447145:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851876.447146:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926f8
00000020:00000001:27.0:1773851876.447147:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851876.447149:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000edd73f44 refcount=173
00000020:00000001:27.0:1773851876.447150:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631274496 : -107123078277120 : ffff9e9276f8d800)
00000020:00000001:27.0:1773851876.447152:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631274496 : -107123078277120 : ffff9e9276f8d800)
00000100:00000001:27.0:1773851876.447153:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851876.447154:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851876.447155:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004133ac17.
00000020:00000010:27.0:1773851876.447157:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851876.447158:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851876.447160:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851876.447161:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851876.447162:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851876.447164:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851876.447164:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851876.447165:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.447167:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851876.447169:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851876.447169:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851876.447170:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851876.447170:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851876.447171:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10674@kfi7, seq: 2025132
00000100:00000040:27.0:1773851876.447173:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000edd73f44 : new rpc_count 1
00000100:00000001:26.0:1773851876.447173:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.447174:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102835050624 : -106970874500992 : ffff9eb5e7062880)
00000100:00000001:26.0:1773851876.447174:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851876.447176:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b40dcada x1858042553014912/t0(0) o400->7c27b615-ee7e-4601-80b8-e036e384c7c0@10674@kfi7:93/0 lens 224/0 e 0 to 0 dl 1773852208 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1146-0'
00000100:00000001:27.0:1773851876.447181:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851876.447181:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851876.447183:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b40dcada pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7c27b615-ee7e-4601-80b8-e036e384c7c0+173:39750:x1858042553014912:12345-10674@kfi7:400:default-tuolumne1146-0
00000100:00000200:27.0:1773851876.447186:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042553014912
00000020:00000001:27.0:1773851876.447187:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851876.447188:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851876.447189:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.447190:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851876.447191:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851876.447192:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851876.447193:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042553014912, found 0 last_xid 1858042552588415
00000020:00000001:27.0:1773851876.447194:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851876.447195:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851876.447196:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851876.447197:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.447198:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851876.447199:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851876.447200:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851876.447201:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e1a5a01.
02000000:00000001:27.0:1773851876.447202:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.447204:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.447205:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851876.447207:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061756, transno 0, xid 1858042553014912
00010000:00000001:27.0:1773851876.447208:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851876.447209:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b40dcada x1858042553014912/t0(0) o400->7c27b615-ee7e-4601-80b8-e036e384c7c0@10674@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1146-0'
00010000:00000001:27.0:1773851876.447214:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851876.447215:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851876.447216:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=109 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851876.447218:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851876.447219:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003a99165a refcount 3 to 10674@kfi7
00000100:00000001:27.0:1773851876.447220:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857440 : -107149578694176 : ffff9e8c4b6c91e0)
02000000:00000001:27.0:1773851876.447221:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851876.447222:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.447223:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851876.447225:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10611@kfi7
00000400:00000010:27.0:1773851876.447226:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cedf447c.
00000100:00000200:27.0:1773851876.447227:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042553014912, offset 224
00000400:00000200:27.0:1773851876.447229:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10611@kfi7
00000400:00000200:27.0:1773851876.447231:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10611@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.447232:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a830b34 nid 10611@kfi7 refs 1
00000400:00000200:27.0:1773851876.447234:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a830b34 nid 10611@kfi7 refs 2
00000400:00000200:27.0:1773851876.447236:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a830b34 nid 10611@kfi7 refs 3
00000400:00000200:27.0:1773851876.447238:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10611@kfi7 local destination
00000400:00000200:27.0:1773851876.447240:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769539:8769539:1024:4294967295] 10611@kfi7 LPNI seq info [3181336:3181336:16:4294967295]
00000400:00000200:27.0:1773851876.447242:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a830b34 nid 10611@kfi7 refs 2
00000400:00000200:27.0:1773851876.447244:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10611@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.447247:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10611@kfi7(10611@kfi7:10611@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851876.447249:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a830b34 nid 10611@kfi7 refs 3
00000800:00000200:27.0:1773851876.447251:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851876.447253:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851876.447260:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851876.447264:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6ab Using peer 10611@kfi7(0x6ab)
00000800:00000200:27.0:1773851876.447269:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000005690846: Posted send of 324 bytes to peer 0x6ab: rc=0
00000800:00000200:27.0:1773851876.447271:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6ab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851876.447275:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851876.447276:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003a99165a refcount 2 to 10674@kfi7
00010000:00000001:27.0:1773851876.447277:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851876.447278:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.447279:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851876.447281:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b40dcada x1858042553014912/t0(0) o400->7c27b615-ee7e-4601-80b8-e036e384c7c0@10674@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1146-0'
00000800:00000200:25.0:1773851876.447284:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6ab TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851876.447285:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851876.447286:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b40dcada pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7c27b615-ee7e-4601-80b8-e036e384c7c0+173:39750:x1858042553014912:12345-10674@kfi7:400:default-tuolumne1146-0 Request processed in 105us (152us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851876.447286:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10611@kfi7: PUT: OK
00000400:00000200:25.0:1773851876.447287:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cedf447c
00000400:00000010:25.0:1773851876.447288:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cedf447c.
00000100:00000001:25.0:1773851876.447289:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851876.447289:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851876.447290:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a830b34 nid 10611@kfi7 refs 2
00000100:00100000:27.0:1773851876.447291:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10674@kfi7, seq: 2025132
00000100:00000040:27.0:1773851876.447292:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000edd73f44 : new rpc_count 0
00000800:00000200:25.0:1773851876.447292:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 10611@kfi7(00000000961af483):0x0 lsk 1708 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6ab Transaction freed
00000100:00000001:27.0:1773851876.447293:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851876.447294:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851876.447295:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851876.447296:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851876.447298:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004133ac17.
00000020:00000040:27.0:1773851876.447299:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000edd73f44 : new refcount 172
00000100:00000001:27.0:1773851876.447300:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851876.489731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851876.489732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851876.489733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851876.489734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851876.489736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851876.489737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851876.489739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851876.489740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851876.489740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851876.489744:0:937831:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851876.489745:0:937831:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851876.489746:0:937831:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851876.559608:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.559609:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851876.559610:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851876.559612:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 24209@kfi7(000000009f38ce4a):0x939 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851876.559613:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 Using peer 24209@kfi7(0x939)
00000400:00000200:25.0:1773851876.559615:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24209@kfi7 to cpt 6
00000800:00000200:25.0:1773851876.559617:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x939: rc=0
00000800:00000200:27.0:1773851876.559618:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.559618:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:27.0:1773851876.559619:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851876.559620:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:27.0:1773851876.559622:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851876.559625:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24209@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.559626:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24209@kfi7 : PUT - for me
00000400:00000200:27.0:1773851876.559627:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24209@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.559628:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013e0f702 nid 24209@kfi7 refs 1
00000400:00000200:27.0:1773851876.559629:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24209@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.559629:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013e0f702 nid 24209@kfi7 refs 2
00000400:00000200:27.0:1773851876.559630:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013e0f702 nid 24209@kfi7 refs 3
00000400:00000200:27.0:1773851876.559631:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24145@kfi7 to cpt 2
00000400:00000200:27.0:1773851876.559632:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24145@kfi7 of length 224 into portal 12 MB=0x699e12163bf00
00000800:00000200:25.0:1773851876.559632:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851876.559633:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24145@kfi7 of length 224/224 into md 0x16159c9699 [64] + 23672
00000800:00000200:25.0:1773851876.559634:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 Transaction freed
00000800:00000200:27.0:1773851876.559635:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851876.559637:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851876.559638:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24209@kfi7: PUT: OK
00000100:00000001:27.0:1773851876.559639:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851876.559639:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851876.559640:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f875cc80.
00000100:00000040:27.0:1773851876.559641:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000f875cc80 x1858042067140352 msgsize 224
00000100:00100000:27.0:1773851876.559643:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-24145@kfi7 (source: 12345-24209@kfi7)
00000100:00000001:27.0:1773851876.559644:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851876.559645:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000013e0f702 nid 24209@kfi7 refs 2
00000800:00000200:27.0:1773851876.559646:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851876.559649:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851876.559649:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851876.559649:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851876.559650:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851876.559650:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851876.559651:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042067140352
00000020:00000001:27.0:1773851876.559651:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851876.559652:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92caf
00000020:00000001:27.0:1773851876.559652:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851876.559656:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b92e36a refcount=6
00000020:00000001:27.0:1773851876.559656:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744157184 : -107128965394432 : ffff9e9118129000)
00000020:00000001:27.0:1773851876.559657:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744157184 : -107128965394432 : ffff9e9118129000)
00000100:00000001:27.0:1773851876.559658:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851876.559659:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851876.559660:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004120800c.
00000020:00000010:27.0:1773851876.559660:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851876.559661:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851876.559662:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851876.559662:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851876.559663:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851876.559663:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851876.559664:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851876.559664:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.559665:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851876.559666:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851876.559667:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851876.559667:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24145@kfi7, seq: 2025133
00000100:00000040:27.0:1773851876.559668:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b92e36a : new rpc_count 1
00000100:00000001:26.0:1773851876.559668:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851876.559668:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851876.559669:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998405504 : -107053711146112 : ffff9ea29d934380)
00000100:00000001:26.0:1773851876.559669:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851876.559670:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f875cc80 x1858042067140352/t0(0) o400->a44c5fbc-918c-4e9a-8676-4734d4dbed80@24145@kfi7:664/0 lens 224/0 e 0 to 0 dl 1773852024 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2002-0'
00000100:00000001:26.0:1773851876.559670:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.559672:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851876.559673:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851876.559674:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f875cc80 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a44c5fbc-918c-4e9a-8676-4734d4dbed80+6:39662:x1858042067140352:12345-24145@kfi7:400:default-tuolumne2002-0
00000100:00000200:27.0:1773851876.559675:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042067140352
00000020:00000001:27.0:1773851876.559675:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851876.559676:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851876.559676:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.559677:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851876.559677:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851876.559678:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851876.559679:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042067140352, found 0 last_xid 1858042067140351
00000020:00000001:27.0:1773851876.559679:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851876.559680:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851876.559680:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851876.559681:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.559681:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851876.559682:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851876.559682:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851876.559683:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004133ac17.
02000000:00000001:27.0:1773851876.559683:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.559684:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.559684:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851876.559685:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425807128, transno 0, xid 1858042067140352
00010000:00000001:27.0:1773851876.559686:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851876.559686:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f875cc80 x1858042067140352/t0(0) o400->a44c5fbc-918c-4e9a-8676-4734d4dbed80@24145@kfi7:664/0 lens 224/224 e 0 to 0 dl 1773852024 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2002-0'
00010000:00000001:27.0:1773851876.559689:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851876.559690:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851876.559690:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=109 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851876.559691:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851876.559692:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e00a2e3 refcount 3 to 24145@kfi7
00000100:00000001:27.0:1773851876.559692:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526775488 : -107156182776128 : ffff9e8ac1ca46c0)
02000000:00000001:27.0:1773851876.559693:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851876.559693:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.559694:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851876.559695:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24209@kfi7
00000400:00000010:27.0:1773851876.559695:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008bb3da7f.
00000100:00000200:27.0:1773851876.559696:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042067140352, offset 224
00000400:00000200:27.0:1773851876.559697:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24209@kfi7
00000400:00000200:27.0:1773851876.559698:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24209@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.559698:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013e0f702 nid 24209@kfi7 refs 1
00000400:00000200:27.0:1773851876.559699:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013e0f702 nid 24209@kfi7 refs 2
00000400:00000200:27.0:1773851876.559700:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013e0f702 nid 24209@kfi7 refs 3
00000400:00000200:27.0:1773851876.559701:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24209@kfi7 local destination
00000400:00000200:27.0:1773851876.559703:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769540:8769540:1024:4294967295] 24209@kfi7 LPNI seq info [8914565:8914565:16:4294967295]
00000400:00000200:27.0:1773851876.559704:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000013e0f702 nid 24209@kfi7 refs 2
00000400:00000200:27.0:1773851876.559705:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24209@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.559707:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24209@kfi7(24209@kfi7:24209@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851876.559708:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013e0f702 nid 24209@kfi7 refs 3
00000800:00000200:27.0:1773851876.559709:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851876.559710:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851876.559712:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851876.559714:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 Using peer 24209@kfi7(0x939)
00000800:00000200:27.0:1773851876.559717:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x939: rc=0
00000800:00000200:27.0:1773851876.559718:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851876.559720:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851876.559721:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e00a2e3 refcount 2 to 24145@kfi7
00010000:00000001:27.0:1773851876.559721:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851876.559722:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.559722:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851876.559723:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f875cc80 x1858042067140352/t0(0) o400->a44c5fbc-918c-4e9a-8676-4734d4dbed80@24145@kfi7:664/0 lens 224/224 e 0 to 0 dl 1773852024 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2002-0'
00000100:00100000:27.0:1773851876.559730:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f875cc80 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a44c5fbc-918c-4e9a-8676-4734d4dbed80+6:39662:x1858042067140352:12345-24145@kfi7:400:default-tuolumne2002-0 Request processed in 56us (88us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851876.559731:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851876.559732:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24145@kfi7, seq: 2025133
00000100:00000040:27.0:1773851876.559733:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b92e36a : new rpc_count 0
00000100:00000001:27.0:1773851876.559733:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851876.559733:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851876.559734:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851876.559734:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851876.559734:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24209@kfi7: PUT: OK
00000020:00000010:27.0:1773851876.559735:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851876.559735:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008bb3da7f
00000020:00000010:27.0:1773851876.559736:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004120800c.
00000400:00000010:25.0:1773851876.559736:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008bb3da7f.
00000100:00000001:25.0:1773851876.559736:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:27.0:1773851876.559737:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000004b92e36a : new refcount 5
00000100:00000001:27.0:1773851876.559737:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851876.559737:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851876.559737:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000013e0f702 nid 24209@kfi7 refs 2
00000800:00000200:25.0:1773851876.559739:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 24209@kfi7(000000009f38ce4a):0x0 lsk 2362 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x939 Transaction freed
00000800:00000200:18.0:1773851876.594316:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851876.594316:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851876.594318:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851876.594320:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851876.594322:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12977@kfi7 to cpt 4
00000400:00000200:18.0:1773851876.594323:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12977@kfi7 : PUT - for me
00000400:00000200:18.0:1773851876.594324:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12977@kfi7 to cpt 4
00000400:00000200:18.0:1773851876.594325:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e361027b nid 12977@kfi7 refs 1
00000400:00000200:18.0:1773851876.594326:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12977@kfi7 to cpt 4
00000400:00000200:18.0:1773851876.594327:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e361027b nid 12977@kfi7 refs 2
00000400:00000200:18.0:1773851876.594327:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e361027b nid 12977@kfi7 refs 3
00000400:00000200:18.0:1773851876.594328:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12912@kfi7 to cpt 5
00000400:00000200:18.0:1773851876.594329:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12912@kfi7 of length 224 into portal 12 MB=0x69b0932ee9340
00000400:00000200:18.0:1773851876.594331:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12912@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 25096
00000800:00000200:18.0:1773851876.594333:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851876.594334:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851876.594335:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12977@kfi7: PUT: OK
00000100:00000001:18.0:1773851876.594336:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851876.594337:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851876.594338:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000212eabd.
00000100:00000040:18.0:1773851876.594338:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000000212eabd x1859313671770944 msgsize 224
00000100:00100000:18.0:1773851876.594340:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-12912@kfi7 (source: 12345-12977@kfi7)
00000100:00000001:18.0:1773851876.594341:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851876.594342:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e361027b nid 12977@kfi7 refs 2
00000100:00000001:17.0:1773851876.594343:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851876.594344:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851876.594344:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851876.594345:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851876.594346:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851876.594346:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313671770944
00000020:00000001:17.0:1773851876.594347:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851876.594348:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91508
00000020:00000001:17.0:1773851876.594348:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851876.594350:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000b97eb12 refcount=6
00000020:00000001:17.0:1773851876.594351:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241019392 : -107152468532224 : ffff9e8b9f2d2400)
00000020:00000001:17.0:1773851876.594352:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241019392 : -107152468532224 : ffff9e8b9f2d2400)
00000100:00000001:17.0:1773851876.594353:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.594353:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:18.0:1773851876.594354:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000020:00000010:17.0:1773851876.594354:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c935461.
00000020:00000010:17.0:1773851876.594355:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.594356:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851876.594357:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851876.594358:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851876.594358:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.594359:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851876.594360:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851876.594360:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.594361:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.594363:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851876.594363:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851876.594363:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851876.594363:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851876.594365:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12912@kfi7, seq: 2156363
00000100:00000040:17.0:1773851876.594366:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000b97eb12 : new rpc_count 1
00000100:00000001:17.0:1773851876.594366:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534652672 : -106946174898944 : ffff9ebba73c2d00)
00000100:00000001:16.0:1773851876.594366:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851876.594367:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.594368:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000212eabd x1859313671770944/t0(0) o400->6638787d-ee67-4cf0-b18c-e6d9666a7846@12912@kfi7:97/0 lens 224/0 e 0 to 0 dl 1773852212 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1294-0'
00000100:00000001:17.0:1773851876.594370:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.594370:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851876.594372:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000212eabd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:6638787d-ee67-4cf0-b18c-e6d9666a7846+6:39834:x1859313671770944:12345-12912@kfi7:400:default-tuolumne1294-0
00000100:00000200:17.0:1773851876.594373:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313671770944
00000020:00000001:17.0:1773851876.594374:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851876.594374:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851876.594375:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.594376:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851876.594376:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851876.594377:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851876.594378:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313671770944, found 0 last_xid 1859313671770943
00000020:00000001:17.0:1773851876.594379:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851876.594379:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851876.594380:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851876.594380:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.594381:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851876.594382:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851876.594382:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851876.594383:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000012610ec6.
02000000:00000001:17.0:1773851876.594384:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.594384:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.594385:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851876.594386:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686059, transno 0, xid 1859313671770944
00010000:00000001:17.0:1773851876.594386:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851876.594387:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000212eabd x1859313671770944/t0(0) o400->6638787d-ee67-4cf0-b18c-e6d9666a7846@12912@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1294-0'
00010000:00000001:17.0:1773851876.594390:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851876.594390:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851876.594391:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=109 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851876.594392:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851876.594393:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004c777673 refcount 3 to 12912@kfi7
00000100:00000001:17.0:1773851876.594394:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094016 : -107139307457600 : ffff9e8eafa333c0)
02000000:00000001:17.0:1773851876.594394:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851876.594395:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.594395:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851876.594396:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12977@kfi7
00000400:00000010:17.0:1773851876.594397:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af69d68e.
00000100:00000200:17.0:1773851876.594398:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859313671770944, offset 224
00000400:00000200:17.0:1773851876.594399:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12977@kfi7
00000400:00000200:17.0:1773851876.594400:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12977@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.594401:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e361027b nid 12977@kfi7 refs 1
00000400:00000200:17.0:1773851876.594402:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e361027b nid 12977@kfi7 refs 2
00000400:00000200:17.0:1773851876.594403:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e361027b nid 12977@kfi7 refs 3
00000400:00000200:17.0:1773851876.594404:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12977@kfi7 local destination
00000400:00000200:17.0:1773851876.594405:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769541:8769541:1024:4294967295] 12977@kfi7 LPNI seq info [414570:414570:16:4294967295]
00000400:00000200:17.0:1773851876.594406:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e361027b nid 12977@kfi7 refs 2
00000400:00000200:17.0:1773851876.594407:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12977@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.594409:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12977@kfi7(12977@kfi7:12977@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851876.594410:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e361027b nid 12977@kfi7 refs 3
00000800:00000200:17.0:1773851876.594411:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.594412:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851876.594414:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851876.594416:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa52 Using peer 12977@kfi7(0xa52)
00000800:00000200:17.0:1773851876.594419:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0xa52: rc=0
00000800:00000200:17.0:1773851876.594420:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa52 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851876.594424:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.594425:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004c777673 refcount 2 to 12912@kfi7
00010000:00000001:17.0:1773851876.594425:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851876.594426:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.594426:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851876.594427:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000212eabd x1859313671770944/t0(0) o400->6638787d-ee67-4cf0-b18c-e6d9666a7846@12912@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1294-0'
00000100:00100000:17.0:1773851876.594430:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000212eabd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:6638787d-ee67-4cf0-b18c-e6d9666a7846+6:39834:x1859313671770944:12345-12912@kfi7:400:default-tuolumne1294-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851876.594432:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12912@kfi7, seq: 2156363
00000100:00000040:17.0:1773851876.594433:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000b97eb12 : new rpc_count 0
00000100:00000001:17.0:1773851876.594433:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851876.594434:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851876.594434:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.594435:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851876.594436:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c935461.
00000020:00000040:17.0:1773851876.594437:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000000b97eb12 : new refcount 5
00000100:00000001:17.0:1773851876.594437:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0:1773851876.594438:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa52 TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851876.594439:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851876.594440:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12977@kfi7: PUT: OK
00000400:00000200:19.0:1773851876.594441:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af69d68e
00000400:00000010:19.0:1773851876.594441:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af69d68e.
00000100:00000001:19.0:1773851876.594442:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851876.594442:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851876.594443:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e361027b nid 12977@kfi7 refs 2
00000800:00000200:19.0:1773851876.594444:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 12977@kfi7(00000000b01d3060):0x0 lsk 2643 rsk 62 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa52 Transaction freed
00000800:00000200:29.0:1773851876.615314:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.615316:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851876.615318:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851876.615322:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851876.615326:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.615328:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22416@kfi7 : PUT - for me
00000400:00000200:29.0:1773851876.615330:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.615331:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000400:00000200:29.0:1773851876.615333:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.615334:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000400:00000200:29.0:1773851876.615336:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000400:00000200:29.0:1773851876.615338:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:29.0:1773851876.615339:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 520 into portal 12 MB=0x69b4c3e3abd00
00000400:00000200:29.0:1773851876.615342:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22352@kfi7 of length 520/520 into md 0x77fe139dd [64] + 183952
00000800:00000200:29.0:1773851876.615346:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851876.615349:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851876.615351:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22416@kfi7: PUT: OK
00000100:00000001:29.0:1773851876.615352:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851876.615353:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851876.615354:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002e96ec60.
00000100:00000040:29.0:1773851876.615355:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000002e96ec60 x1859601624120576 msgsize 520
00000100:00100000:29.0:1773851876.615358:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00000001:29.0:1773851876.615361:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851876.615362:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00000001:31.0:1773851876.615363:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851876.615364:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851876.615364:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851876.615365:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851876.615365:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851876.615366:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851876.615367:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601624120576
00000020:00000001:31.0:1773851876.615368:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851876.615368:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:31.0:1773851876.615369:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851876.615371:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=312
00000020:00000001:31.0:1773851876.615372:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:31.0:1773851876.615373:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:31.0:1773851876.615374:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851876.615374:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851876.615375:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe4b474d.
00000020:00000010:31.0:1773851876.615376:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851876.615377:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851876.615378:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851876.615379:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851876.615379:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851876.615381:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:31.0:1773851876.615382:0:42267:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@000000002e96ec60 x1859601624120576/t0(0) o38->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852076 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1890-0'
00000100:00000001:31.0:1773851876.615384:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851876.615385:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.615386:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851876.615387:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851876.615388:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851876.615389:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22352@kfi7, seq: 2055542
00000100:00000001:28.0:1773851876.615389:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:31.0:1773851876.615390:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000028ddc8fe : new rpc_count 7
00000100:00000001:28.0:1773851876.615390:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851876.615391:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091507233536 : -106982202318080 : ffff9eb343d56300)
00000100:00000001:28.0:1773851876.615391:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851876.615392:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002e96ec60 x1859601624120576/t0(0) o38->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852076 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1890-0'
00000100:00000001:28.0:1773851876.615392:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.615395:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851876.615395:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851876.615396:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e96ec60 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:f6432f30-f3f3-4037-af49-7d5e0ec2eef9+312:39639:x1859601624120576:12345-22352@kfi7:38:default-tuolumne1890-0
00000100:00000200:31.0:1773851876.615398:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601624120576
00000020:00000001:31.0:1773851876.615399:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:31.0:1773851876.615400:0:42267:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:31.0:1773851876.615402:0:42267:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:31.0:1773851876.615403:0:42267:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:31.0:1773851876.615404:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851876.615405:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851876.615406:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 0000000064503462.
02000000:00000001:31.0:1773851876.615407:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.615407:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851876.615409:0:42267:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:31.0:1773851876.615410:0:42267:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client f6432f30-f3f3-4037-af49-7d5e0ec2eef9 (at 22352@kfi7) reconnecting
00010000:00000001:31.0:1773851876.615411:0:42267:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:31.0:1773851876.615412:0:42267:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:31.0:1773851876.615413:0:42267:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7 t182931271354 exp 0000000028ddc8fe cur 614151 last 1773851876
00010000:00000001:31.0:1773851876.615415:0:42267:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:31.0:1773851876.615415:0:42267:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:31.0:1773851876.615416:0:42267:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:31.0:1773851876.615417:0:42267:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:31.0:1773851876.615417:0:42267:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:31.0:1773851876.615418:0:42267:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:31.0:1773851876.615419:0:42267:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:31.0:1773851876.615420:0:42267:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:31.0:1773851876.615421:0:42267:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:31.0:1773851876.615421:0:42267:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.615423:0:42267:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:31.0:1773851876.615424:0:42267:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851876.615426:0:42267:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.615426:0:42267:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:31.0:1773851876.615427:0:42267:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli f6432f30-f3f3-4037-af49-7d5e0ec2eef9/0000000028ddc8fe free: 126633370845184 avail: 126633368748032
00000020:00000001:31.0:1773851876.615429:0:42267:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:31.0:1773851876.615429:0:42267:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli f6432f30-f3f3-4037-af49-7d5e0ec2eef9/0000000028ddc8fe avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:31.0:1773851876.615431:0:42267:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:31.0:1773851876.615433:0:42267:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:31.0:1773851876.615433:0:42267:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:31.0:1773851876.615434:0:42267:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli f6432f30-f3f3-4037-af49-7d5e0ec2eef9/0000000028ddc8fe ocd_grant: 1882456063 want: 32243712 left: 112130449866752
00000020:00000001:31.0:1773851876.615435:0:42267:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:31.0:1773851876.615436:0:42267:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 22352@kfi7 supports cksum type f7, return f7
00000004:00000001:31.0:1773851876.615437:0:42267:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:31.0:1773851876.615438:0:42267:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:31.0:1773851876.615439:0:42267:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:31.0:1773851876.615440:0:42267:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851876.615441:0:42267:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851876.615441:0:42267:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851876.615442:0:42267:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 0000000028ddc8fe : new rpc_count 6
00000020:00000040:31.0:1773851876.615443:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000020:00000040:31.0:1773851876.615444:0:42267:0:(genops.c:871:class_export_get()) GET export 0000000028ddc8fe refcount=313
00000100:00000040:31.0:1773851876.615445:0:42267:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 0000000028ddc8fe : new rpc_count 7
00000100:00000001:31.0:1773851876.615446:0:42267:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:31.0:1773851876.615447:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:31.0:1773851876.615448:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000400:00000200:31.0:1773851876.615449:0:42267:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:31.0:1773851876.615451:0:42267:0:(peer.c:1555:LNetPrimaryNID()) NID 22352@kfi7 primary NID 22352@kfi7 rc 0
00000100:00000001:31.0:1773851876.615505:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851876.615506:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aca4a393 refcount 3 to 22352@kfi7
00000100:00000001:31.0:1773851876.615507:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637062704693728 : -107011004857888 : ffff9eac8f1181e0)
00000100:00000001:31.0:1773851876.615507:0:42267:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446637062704693728 : -107011004857888 : 0xffff9eac8f1181e0)
00000100:00000040:31.0:1773851876.615508:0:42267:0:(connection.c:133:ptlrpc_connection_get()) conn=00000000aca4a393 refcount 3 to 22352@kfi7
00000100:00080000:31.0:1773851876.615509:0:42267:0:(import.c:86:import_set_state_nolock()) 00000000c01ec193 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:31.0:1773851876.615510:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aca4a393 refcount 2 to 22352@kfi7
00000100:00000001:31.0:1773851876.615511:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851876.615511:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aca4a393 refcount 3 to 22352@kfi7
00000100:00000001:31.0:1773851876.615512:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637062704693728 : -107011004857888 : ffff9eac8f1181e0)
02000000:00000001:31.0:1773851876.615513:0:42267:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:31.0:1773851876.615516:0:42267:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:31.0:1773851876.615517:0:42267:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.615518:0:42267:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:31.0:1773851876.615519:0:42267:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:31.0:1773851876.615519:0:42267:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:31.0:1773851876.615520:0:42267:0:(import.c:86:import_set_state_nolock()) 00000000c01ec193 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:31.0:1773851876.615521:0:42267:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:31.0:1773851876.615521:0:42267:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:31.0:1773851876.615522:0:42267:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:31.0:1773851876.615522:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000020:00000040:31.0:1773851876.615523:0:42267:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:31.0:1773851876.615524:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aca4a393 refcount 2 to 22352@kfi7
00010000:00000001:31.0:1773851876.615525:0:42267:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.615525:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851876.615526:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:31.0:1773851876.615527:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:31.0:1773851876.615527:0:42267:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851876.615528:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851876.615528:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851876.615529:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.615530:0:42267:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:31.0:1773851876.615530:0:42267:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:31.0:1773851876.615531:0:42267:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:31.0:1773851876.615532:0:42267:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:31.0:1773851876.615532:0:42267:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.615532:0:42267:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851876.615533:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264591503, transno 0, xid 1859601624120576
00010000:00000001:31.0:1773851876.615534:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851876.615535:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002e96ec60 x1859601624120576/t0(0) o38->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852076 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1890-0'
00010000:00000001:31.0:1773851876.615537:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851876.615537:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851876.615538:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=109 v=115 (1 1 1 115)
00000100:00001000:31.0:1773851876.615539:0:42267:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:31.0:1773851876.615540:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851876.615541:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aca4a393 refcount 3 to 22352@kfi7
00000100:00000001:31.0:1773851876.615541:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637062704693728 : -107011004857888 : ffff9eac8f1181e0)
02000000:00000001:31.0:1773851876.615542:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851876.615543:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.615544:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851876.615544:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22416@kfi7
00000400:00000010:31.0:1773851876.615545:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088e46351.
00000100:00000200:31.0:1773851876.615546:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1859601624120576, offset 0
00000400:00000200:31.0:1773851876.615547:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22416@kfi7
00000400:00000200:31.0:1773851876.615548:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:31.0:1773851876.615549:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000400:00000200:31.0:1773851876.615550:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000400:00000200:31.0:1773851876.615551:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000400:00000200:31.0:1773851876.615552:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22416@kfi7 local destination
00000400:00000200:31.0:1773851876.615553:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769542:8769542:1024:4294967295] 22416@kfi7 LPNI seq info [7352046:7352046:16:4294967295]
00000400:00000200:31.0:1773851876.615555:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000400:00000200:31.0:1773851876.615556:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:31.0:1773851876.615558:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22416@kfi7(22416@kfi7:22416@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851876.615559:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000800:00000200:31.0:1773851876.615560:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851876.615561:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:31.0:1773851876.615564:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851876.615566:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000123b Using peer 22416@kfi7(0x10000000000123b)
00000800:00000200:31.0:1773851876.615569:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 516 bytes to peer 0x10000000000123b: rc=0
00000800:00000200:31.0:1773851876.615570:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000123b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851876.615572:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851876.615573:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aca4a393 refcount 2 to 22352@kfi7
00010000:00000001:31.0:1773851876.615574:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851876.615574:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.615575:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851876.615576:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002e96ec60 x1859601624120576/t0(0) o38->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852076 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1890-0'
00000100:00100000:31.0:1773851876.615579:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e96ec60 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:f6432f30-f3f3-4037-af49-7d5e0ec2eef9+312:39639:x1859601624120576:12345-22352@kfi7:38:default-tuolumne1890-0 Request processed in 183us (222us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851876.615581:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22352@kfi7, seq: 2055542
00000100:00000040:31.0:1773851876.615582:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028ddc8fe : new rpc_count 6
00000100:00000001:31.0:1773851876.615583:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851876.615583:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851876.615584:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851876.615585:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851876.615586:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe4b474d.
00000020:00000040:31.0:1773851876.615586:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 311
00000100:00000001:31.0:1773851876.615587:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851876.615587:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000123b TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851876.615589:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851876.615591:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22416@kfi7: PUT: OK
00000400:00000200:29.0:1773851876.615592:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088e46351
00000400:00000010:29.0:1773851876.615593:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088e46351.
00000100:00000001:29.0:1773851876.615594:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851876.615595:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851876.615596:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000800:00000200:29.0:1773851876.615598:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000123b Transaction freed
00000800:00000200:10.0:1773851876.616375:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851876.616377:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851876.616378:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851876.616381:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851876.616383:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:10.0:1773851876.616384:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000400:00000200:10.0:1773851876.616386:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:10.0:1773851876.616387:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 1
00000400:00000200:10.0:1773851876.616388:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:10.0:1773851876.616389:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000400:00000200:10.0:1773851876.616390:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000400:00000200:10.0:1773851876.616391:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:13.0:1773851876.616392:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:10.0:1773851876.616392:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2864 into portal 13 MB=0x69b4c3ddad540
00000800:00000200:14.0:1773851876.616393:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851876.616393:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851876.616394:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851876.616395:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851876.616395:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000400:00000200:10.0:1773851876.616395:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2864/2864 into md 0x7813a3b29 [128] + 101456
00000800:00000200:14.0:1773851876.616397:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851876.616397:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22352@kfi7(000000007a052420):0x1240 version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851876.616397:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851876.616398:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851876.616398:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:14.0:1773851876.616399:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616400:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000800:00000200:13.0:1773851876.616400:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001240 Using peer 22352@kfi7(0x100000000001240)
00000400:00000200:10.0:1773851876.616400:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851876.616400:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000400:00000200:10.0:1773851876.616401:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000400:00000200:14.0:1773851876.616402:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:10.0:1773851876.616402:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:14.0:1773851876.616403:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000800:00000200:11.0:1773851876.616403:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000200:10.0:1773851876.616403:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:9.0:1773851876.616403:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22417@kfi7(00000000080a5f4f):0x123a version: 2; local version 2; negotiated version: 2
00000400:00000200:14.0:1773851876.616404:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:11.0:1773851876.616404:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000010:10.0:1773851876.616404:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005dc1f11c.
00000400:00000200:14.0:1773851876.616405:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000800:00000200:11.0:1773851876.616405:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:10.0:1773851876.616405:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000005dc1f11c x1859601617835328 msgsize 2864
00000800:00000200:9.0:1773851876.616405:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000123a Using peer 22417@kfi7(0x10000000000123a)
00000400:00000200:14.0:1773851876.616406:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000100:00100000:10.0:1773851876.616407:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000400:00000200:13.0:1773851876.616408:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:11.0:1773851876.616408:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851876.616408:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:14.0:1773851876.616409:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:10.0:1773851876.616409:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:29.0:1773851876.616410:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:13.0:1773851876.616410:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x100000000001240: rc=0
00000400:00000200:10.0:1773851876.616410:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000800:00000200:30.0:1773851876.616411:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.616411:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:14.0:1773851876.616411:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 392 into portal 23 MB=0x69b4c3dea6700
00000400:00000200:11.0:1773851876.616411:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000800:00000200:10.0:1773851876.616411:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000800:00000200:9.0:1773851876.616411:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x10000000000123a: rc=0
00000800:00000200:29.0:1773851876.616412:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851876.616412:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-22352@kfi7 of length 392/392 into md 0x82a5d6aad [2] + 960
00000800:00000200:13.0:1773851876.616412:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001240 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851876.616413:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000400:00000200:11.0:1773851876.616413:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000800:00000200:9.0:1773851876.616413:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000123a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851876.616414:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851876.616414:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:11.0:1773851876.616414:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000800:00000200:14.0:1773851876.616415:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851876.616415:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 1
00000400:00000200:29.0:1773851876.616416:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:14.0:1773851876.616416:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:30.0:1773851876.616417:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:11.0:1773851876.616417:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:29.0:1773851876.616418:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22416@kfi7 : PUT - for me
00000400:00000200:14.0:1773851876.616418:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000400:00000200:11.0:1773851876.616418:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000400:00000200:30.0:1773851876.616419:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00000001:14.0:1773851876.616419:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:11.0:1773851876.616419:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000100:00000001:10.0:1773851876.616419:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851876.616420:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00000200:14.0:1773851876.616420:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:11.0:1773851876.616420:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
02000000:00000001:10.0:1773851876.616420:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.616420:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:30.0:1773851876.616421:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22416@kfi7 : PUT - for me
00000400:00000200:29.0:1773851876.616421:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000100:00000010:14.0:1773851876.616421:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000841e6fde.
00000100:00000040:14.0:1773851876.616421:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000841e6fde x1859601618855680 msgsize 392
00000400:00000200:11.0:1773851876.616421:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 392 into portal 23 MB=0x69b4c3dda69c0
00000100:00000001:10.0:1773851876.616421:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.616422:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.616422:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617835328
00000400:00000200:29.0:1773851876.616423:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00100000:14.0:1773851876.616423:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000400:00000200:11.0:1773851876.616423:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-22352@kfi7 of length 392/392 into md 0x78166d169 [2] + 0
00000020:00000001:10.0:1773851876.616423:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.616423:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:29.0:1773851876.616424:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000800:00000200:13.0:1773851876.616424:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001240 TN_EVENT_TX_OK event status 0
00000020:00000001:10.0:1773851876.616424:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:9.0:1773851876.616424:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000123a TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851876.616425:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.616425:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000100:00000001:14.0:1773851876.616425:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851876.616426:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000400:00000200:14.0:1773851876.616426:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000800:00000200:11.0:1773851876.616426:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851876.616427:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000800:00000200:14.0:1773851876.616427:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000800:00000200:13.0:1773851876.616427:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001240 Transaction freed
00000800:00000200:9.0:1773851876.616427:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000123a Transaction freed
00000400:00000200:30.0:1773851876.616428:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000400:00000200:11.0:1773851876.616428:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:10.0:1773851876.616428:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=312
00000020:00000001:10.0:1773851876.616428:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:30.0:1773851876.616429:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 4
00000100:00000001:12.0:1773851876.616429:0:82880:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851876.616429:0:82880:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:11.0:1773851876.616429:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000020:00000001:10.0:1773851876.616429:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:29.0:1773851876.616430:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:12.0:1773851876.616430:0:82880:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851876.616430:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:30.0:1773851876.616431:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:29.0:1773851876.616431:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2544 into portal 12 MB=0x69b4c3de23940
00000100:00000001:12.0:1773851876.616431:0:82880:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851876.616431:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000001:10.0:1773851876.616431:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.616431:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:30.0:1773851876.616432:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4584 into portal 13 MB=0x69b4c3dda6500
00000400:00000200:29.0:1773851876.616432:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22352@kfi7 of length 2544/2544 into md 0x77fe139dd [64] + 184472
02000000:00000001:12.0:1773851876.616432:0:82880:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:11.0:1773851876.616432:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cd342c1.
00000020:00000010:10.0:1773851876.616432:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000100:00100000:12.0:1773851876.616433:0:82880:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618855680
00000020:00000001:12.0:1773851876.616433:0:82880:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000040:11.0:1773851876.616433:0:2510946:0:(events.c:358:request_in_callback()) incoming req@000000007cd342c1 x1859601617807808 msgsize 392
00000020:00000010:10.0:1773851876.616433:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000040:12.0:1773851876.616434:0:82880:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:12.0:1773851876.616434:0:82880:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:11.0:1773851876.616434:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000020:00000010:10.0:1773851876.616434:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000400:00000200:30.0:1773851876.616435:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4584/4584 into md 0x77fdd4a5d [128] + 113920
00000800:00000200:29.0:1773851876.616435:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851876.616435:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.616435:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851876.616436:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:10.0:1773851876.616436:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000800:00000200:30.0:1773851876.616437:0:2472963:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 6 trmk 1 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4584 bytes in 2 frags
00000400:00000200:29.0:1773851876.616437:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851876.616437:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000020:00000001:10.0:1773851876.616437:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.616437:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:29.0:1773851876.616438:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22416@kfi7: PUT: OK
00000020:00000001:10.0:1773851876.616438:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:8.0:1773851876.616438:0:60519:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851876.616439:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 6 trmk 1 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000100:00000001:29.0:1773851876.616439:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851876.616439:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000020:00000040:12.0:1773851876.616439:0:82880:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000800:00000200:11.0:1773851876.616439:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000001:10.0:1773851876.616439:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
02000000:00000001:8.0:1773851876.616439:0:60519:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851876.616439:0:60519:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000010:29.0:1773851876.616440:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000edda85db.
00000100:00000040:29.0:1773851876.616440:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000edda85db x1859601618319680 msgsize 2544
00000020:00000001:12.0:1773851876.616440:0:82880:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.616440:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.616440:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851876.616440:0:60519:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851876.616441:0:82880:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.616441:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
02000000:00000001:8.0:1773851876.616441:0:60519:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851876.616442:0:2472963:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 6 trmk 1 tmk 0 trr 0 tta 0x1234 Using peer 22416@kfi7(0x1234)
00000100:00100000:29.0:1773851876.616442:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00000001:12.0:1773851876.616442:0:82880:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851876.616442:0:82880:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:10.0:1773851876.616442:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851876.616442:0:60519:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617807808
00000020:00000001:8.0:1773851876.616442:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:29.0:1773851876.616443:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000010:12.0:1773851876.616443:0:82880:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e2ee169c.
00000001:00000001:10.0:1773851876.616443:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616443:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000040:8.0:1773851876.616443:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:29.0:1773851876.616444:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000020:00000010:12.0:1773851876.616444:0:82880:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000001:00000001:10.0:1773851876.616444:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616444:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:8.0:1773851876.616444:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:31.0:1773851876.616445:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000010:12.0:1773851876.616445:0:82880:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
00000001:00000001:10.0:1773851876.616445:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616445:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:8.0:1773851876.616445:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
02000000:00000001:31.0:1773851876.616446:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851876.616446:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851876.616446:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851876.616446:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851876.616446:0:82880:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851876.616446:0:82880:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.616446:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:8.0:1773851876.616446:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:12.0:1773851876.616447:0:82880:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851876.616447:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
02000000:00000001:31.0:1773851876.616448:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851876.616448:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618319680
00000020:00000001:10.0:1773851876.616448:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616448:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851876.616448:0:60519:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851876.616448:0:60519:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:31.0:1773851876.616449:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851876.616449:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000800:00000200:30.0:1773851876.616449:0:2472963:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:7 TN 00000000b68a0a1e: Posted read of 4584 bytes in 2 frags kp 22416@kfi7(0000000058dfa833) rma_iov.key 393217: rc=0
00000020:00000001:10.0:1773851876.616449:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:8.0:1773851876.616449:0:60519:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cebf0718.
00000020:00000001:31.0:1773851876.616450:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:10.0:1773851876.616450:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000040:31.0:1773851876.616451:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000020:00000001:31.0:1773851876.616451:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:30.0:1773851876.616451:0:2472963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 6 trmk 1 tmk 0 trr 0 tta 0x1234 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000020:00000001:10.0:1773851876.616451:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.616452:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00000001:10.0:1773851876.616452:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:8.0:1773851876.616452:0:60519:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000100:00000001:31.0:1773851876.616453:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000010:8.0:1773851876.616453:0:60519:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:31.0:1773851876.616454:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851876.616454:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe4b474d.
00002000:00100000:10.0:1773851876.616454:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024ef7:0x163cf:0x0]  req@000000005dc1f11c x1859601617835328/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2864/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:8.0:1773851876.616454:0:60519:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851876.616454:0:60519:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000010:31.0:1773851876.616455:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000100:00000001:8.0:1773851876.616455:0:60519:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:31.0:1773851876.616456:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851876.616457:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00002000:00000001:10.0:1773851876.616457:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:31.0:1773851876.616458:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:31.0:1773851876.616458:0:42267:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00002000:00100000:10.0:1773851876.616458:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000005dc1f11c with x1859601617835328
00010000:00000001:10.0:1773851876.616459:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.616459:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000004:00100000:31.0:1773851876.616460:0:42267:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000a38b8772 cookie 0x9b15b96d92892857  req@00000000edda85db x1859601618319680/t0(0) o101->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:516/0 lens 2544/0 e 0 to 0 dl 1773852631 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:10.0:1773851876.616462:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d148e59b refcount=3
00010000:00000001:31.0:1773851876.616463:0:42267:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:10.0:1773851876.616463:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637052097328640 : -107021612222976 : ffff9eaa16d1f600)
00010000:00000001:31.0:1773851876.616464:0:42267:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:31.0:1773851876.616464:0:42267:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.616464:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637052097328640 : -107021612222976 : ffff9eaa16d1f600)
00000100:00000001:31.0:1773851876.616465:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.616465:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.616466:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.616466:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616467:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851876.616468:0:2467684:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 6 trmk 1 tmk 0 trr 0 tta 0x1234 TN_EVENT_TAG_TX_OK event status 0
00000100:00000001:10.0:1773851876.616468:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851876.616469:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00080000:12.1:1773851876.616469:0:82880:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000841e6fde x1859601618855680/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 392/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:29.0:1773851876.616470:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22416@kfi7: PUT: OK
00000100:00000001:29.0:1773851876.616471:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851876.616472:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:29.0:1773851876.616472:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ddd02f81.
00000100:00000040:29.0:1773851876.616473:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ddd02f81 x1859601617806592 msgsize 4584
00000100:00080000:12.1:1773851876.616473:0:82880:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000007f5f3c4b x1859601618855680/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 392/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00100000:29.0:1773851876.616475:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00000001:29.0:1773851876.616476:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:12.0:1773851876.616476:0:82880:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:29.0:1773851876.616477:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00000001:12.0:1773851876.616477:0:82880:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:29.0:1773851876.616478:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 6 trmk 1 tmk 0 trr 0 tta 0x1234 Transaction freed
00000100:00000001:28.0:1773851876.616478:0:61389:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851876.616478:0:61389:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851876.616478:0:61389:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851876.616478:0:82880:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851876.616479:0:61389:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851876.616480:0:61389:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851876.616480:0:61389:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617806592
00000020:00000001:28.0:1773851876.616481:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851876.616481:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:28.0:1773851876.616482:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851876.616483:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=316
00000020:00000001:28.0:1773851876.616484:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:28.0:1773851876.616485:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:28.0:1773851876.616486:0:61389:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851876.616486:0:61389:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851876.616487:0:61389:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001aa5c9b3.
00000020:00000010:28.0:1773851876.616488:0:61389:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851876.616488:0:61389:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851876.616489:0:61389:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851876.616490:0:61389:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:28.0:1773851876.616491:0:61389:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:28.0:1773851876.616492:0:61389:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851876.616492:0:61389:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:28.0:1773851876.616493:0:61389:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851876.616494:0:61389:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000100:00080000:8.1:1773851876.616494:0:60519:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000007cd342c1 x1859601617807808/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 392/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:28.0:1773851876.616495:0:61389:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:28.0:1773851876.616495:0:61389:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.616496:0:61389:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:28.0:1773851876.616497:0:61389:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.616497:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00080000:8.1:1773851876.616497:0:60519:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000000fe33196 x1859601617807808/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 392/456 e 10 to 0 dl 1773851816 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111597530610688'
00000001:00000001:28.0:1773851876.616498:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:28.0:1773851876.616499:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616499:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:28.0:1773851876.616500:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616500:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851876.616500:0:60519:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000001:28.0:1773851876.616501:0:61389:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:8.0:1773851876.616501:0:60519:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:28.0:1773851876.616502:0:61389:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851876.616502:0:60519:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:28.0:1773851876.616503:0:61389:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.616503:0:61389:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:28.0:1773851876.616504:0:61389:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:28.0:1773851876.616505:0:61389:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:28.0:1773851876.616506:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:28.0:1773851876.616507:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240024e21:0xa504:0x0]  req@00000000ddd02f81 x1859601617806592/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4584/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:28.0:1773851876.616511:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:28.0:1773851876.616512:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ddd02f81 with x1859601617806592
00010000:00000001:28.0:1773851876.616512:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:28.0:1773851876.616513:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851876.616516:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000f26ad23 refcount=3
00000020:00000001:28.0:1773851876.616516:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123617258688 : -106950092292928 : ffff9ebabdbd7cc0)
00000100:00080000:31.1:1773851876.616517:0:42267:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000edda85db x1859601618319680/t0(0) o101->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:516/0 lens 2544/0 e 0 to 0 dl 1773852631 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:28.0:1773851876.616517:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637123617258688 : -106950092292928 : ffff9ebabdbd7cc0)
00010000:00000001:28.0:1773851876.616519:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851876.616519:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00080000:31.1:1773851876.616520:0:42267:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000b36e7460 x1859601618319680/t0(0) o101->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:115/0 lens 2544/3296 e 0 to 0 dl 1773852230 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111597530610688'
00002000:00000001:28.0:1773851876.616521:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:31.0:1773851876.616523:0:42267:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00000001:28.0:1773851876.616523:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.616524:0:42267:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:28.0:1773851876.616524:0:61389:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.616525:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00080000:10.1F:1773851876.616527:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000005dc1f11c x1859601617835328/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2864/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:10.1:1773851876.616530:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000071382410 x1859601617835328/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:662/0 lens 2864/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:12.0:1773851876.616533:0:82880:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851876.616533:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000010:12.0:1773851876.616534:0:82880:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000100:00000001:10.0:1773851876.616534:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:8.0:1773851876.616534:0:60519:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851876.616534:0:60519:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:12.0:1773851876.616535:0:82880:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000100:00000001:10.0:1773851876.616535:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:12.0:1773851876.616536:0:82880:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e2ee169c.
00002000:00000001:10.0:1773851876.616536:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:8.0:1773851876.616536:0:60519:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000040:12.0:1773851876.616537:0:82880:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 315
00000100:00000001:12.0:1773851876.616537:0:82880:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00100000:10.0:1773851876.616537:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024ef7:0x163cf:0x0]  req@000000005dc1f11c x1859601617835328/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2864/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:8.0:1773851876.616537:0:60519:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000cebf0718.
00000020:00000040:8.0:1773851876.616537:0:60519:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00080000:28.1F:1773851876.616538:0:61389:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000ddd02f81 x1859601617806592/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4584/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:8.0:1773851876.616538:0:60519:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:10.0:1773851876.616539:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.616540:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000005dc1f11c with x1859601617835328
00010000:00000001:10.0:1773851876.616540:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.616541:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:28.1:1773851876.616542:0:61389:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000004f99e664 x1859601617806592/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 4584/0 e 10 to 0 dl 1773851816 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:10.0:1773851876.616542:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d148e59b refcount=3
00000020:00000001:10.0:1773851876.616542:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637052097328640 : -107021612222976 : ffff9eaa16d1f600)
00010000:00000001:10.0:1773851876.616543:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637052097328640 : -107021612222976 : ffff9eaa16d1f600)
00000800:00000200:13.0:1773851876.616544:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00010000:00000001:10.0:1773851876.616544:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:31.0:1773851876.616545:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:28.0:1773851876.616545:0:61389:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000800:00000200:13.0:1773851876.616545:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00010000:00000001:10.0:1773851876.616545:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.616545:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000800:00000200:9.0:1773851876.616545:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000020:00000010:31.0:1773851876.616546:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851876.616546:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000100:00000001:28.0:1773851876.616546:0:61389:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:13.0:1773851876.616546:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851876.616546:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00002000:00000001:10.0:1773851876.616546:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.616546:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851876.616546:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000020:00000010:31.0:1773851876.616547:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe4b474d.
00000100:00000001:28.0:1773851876.616547:0:61389:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:11.0:1773851876.616547:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:10.0:1773851876.616547:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000040:31.0:1773851876.616548:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00002000:00000001:28.0:1773851876.616548:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:11.0:1773851876.616548:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:10.0:1773851876.616548:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000800:00000200:9.0:1773851876.616548:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851876.616549:0:42267:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00100000:28.0:1773851876.616549:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240024e21:0xa504:0x0]  req@00000000ddd02f81 x1859601617806592/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4584/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:15.0:1773851876.616549:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851876.616549:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851876.616549:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:10.0:1773851876.616549:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000800:00000200:15.0:1773851876.616550:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851876.616550:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851876.616550:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:10.0:1773851876.616550:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000100:00000001:10.0:1773851876.616550:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851876.616550:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00002000:00000001:28.0:1773851876.616551:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000800:00000200:15.0:1773851876.616551:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851876.616551:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851876.616551:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00100000:28.0:1773851876.616552:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ddd02f81 with x1859601617806592
00000400:00000200:9.0:1773851876.616552:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00010000:00000001:28.0:1773851876.616553:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:28.0:1773851876.616553:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:15.0:1773851876.616553:0:2513974:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22352@kfi7(000000000fcd3eb6):0x1233 version: 2; local version 2; negotiated version: 2
00000400:00000200:13.0:1773851876.616553:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000400:00000200:11.0:1773851876.616553:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000040:28.0:1773851876.616554:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000f26ad23 refcount=3
00000020:00000001:28.0:1773851876.616554:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123617258688 : -106950092292928 : ffff9ebabdbd7cc0)
00000800:00000200:14.0:1773851876.616554:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851876.616554:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:9.0:1773851876.616554:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00010000:00000001:28.0:1773851876.616555:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637123617258688 : -106950092292928 : ffff9ebabdbd7cc0)
00000800:00000200:15.0:1773851876.616555:0:2513974:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1233 Using peer 22352@kfi7(0x1233)
00000400:00000200:13.0:1773851876.616555:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000400:00000200:11.0:1773851876.616555:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000800:00000200:10.0:1773851876.616555:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851876.616555:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00010000:00000001:28.0:1773851876.616556:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851876.616556:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:13.0:1773851876.616556:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:10.0:1773851876.616556:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851876.616556:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 1
00002000:00000001:28.0:1773851876.616557:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:28.0:1773851876.616557:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851876.616557:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000800:00000200:10.0:1773851876.616557:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:28.0:1773851876.616558:0:61389:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851876.616558:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:9.0:1773851876.616558:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.616558:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000020:00000010:28.0:1773851876.616559:0:61389:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851876.616559:0:61389:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000400:00000200:14.0:1773851876.616559:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:10.0:1773851876.616559:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851876.616559:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000010:28.0:1773851876.616560:0:61389:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001aa5c9b3.
00000400:00000200:15.0:1773851876.616560:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000040:28.0:1773851876.616561:0:61389:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 311
00000400:00000200:14.0:1773851876.616561:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000400:00000200:13.0:1773851876.616561:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:11.0:1773851876.616561:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:28.0:1773851876.616562:0:61389:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851876.616562:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:11.0:1773851876.616562:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000800:00000200:15.0:1773851876.616563:0:2513974:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 38 bytes to peer 0x1233: rc=0
00000400:00000200:14.0:1773851876.616563:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:13.0:1773851876.616563:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 392 into portal 23 MB=0x69b4c3debdc80
00000400:00000200:11.0:1773851876.616563:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000800:00000200:15.0:1773851876.616564:0:2513974:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1233 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851876.616564:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:11.0:1773851876.616564:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000400:00000200:14.0:1773851876.616565:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:13.0:1773851876.616565:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-22352@kfi7 of length 392/392 into md 0x82a5d6aad [2] + 1352
00000400:00000200:11.0:1773851876.616565:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000200:14.0:1773851876.616566:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000400:00000200:14.0:1773851876.616567:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:13.0:1773851876.616567:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851876.616567:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:29.0:1773851876.616568:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:13.0:1773851876.616568:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.616568:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4584 into portal 13 MB=0x69b4c3dda4f40
00000400:00000200:10.0:1773851876.616569:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000800:00000200:30.0:1773851876.616570:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.616571:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:14.0:1773851876.616572:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2976 into portal 13 MB=0x69b4c3dda4ec0
00000400:00000200:11.0:1773851876.616572:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:30.0:1773851876.616573:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851876.616573:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000400:00000200:9.0:1773851876.616574:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4584/4584 into md 0x7813a3b29 [128] + 104320
00000800:00000200:29.0:1773851876.616575:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851876.616576:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3e008740
00000400:00000200:10.0:1773851876.616576:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000400:00000200:14.0:1773851876.616577:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2976/2976 into md 0x82a21912d [128] + 88696
00000800:00000200:30.0:1773851876.616578:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851876.616578:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000800:00000200:15.0:1773851876.616579:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1233 TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851876.616580:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851876.616580:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:13.0:1773851876.616580:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851876.616580:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:11.0:1773851876.616580:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 108904
00000400:00000200:10.0:1773851876.616580:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000800:00000200:9.0:1773851876.616580:0:2458095:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 14 trmk 1 tmk 0 trr 3 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4584 bytes in 2 frags
00000800:00000200:14.0:1773851876.616581:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851876.616581:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:29.0:1773851876.616582:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000800:00000200:15.0:1773851876.616582:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1233 Transaction freed
00000100:00000010:13.0:1773851876.616582:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dea72d8c.
00000800:00000200:11.0:1773851876.616582:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851876.616582:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000800:00000200:9.0:1773851876.616582:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 14 trmk 1 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000400:00000200:30.0:1773851876.616583:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:14.0:1773851876.616583:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:13.0:1773851876.616583:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000dea72d8c x1859601618951296 msgsize 392
00000400:00000200:10.0:1773851876.616583:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000400:00000200:29.0:1773851876.616584:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22416@kfi7 : PUT - for me
00000400:00000200:14.0:1773851876.616584:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000100:00100000:13.0:1773851876.616584:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000400:00000200:11.0:1773851876.616584:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851876.616584:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:30.0:1773851876.616585:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22416@kfi7 : PUT - for me
00000400:00000200:29.0:1773851876.616585:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00000001:14.0:1773851876.616585:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:13.0:1773851876.616585:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:11.0:1773851876.616585:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000400:00000200:10.0:1773851876.616585:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 680 into portal 13 MB=0x69b4c3dda4e00
00000800:00000200:9.0:1773851876.616585:0:2458095:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 14 trmk 1 tmk 0 trr 3 tta 0x30000000000123a Using peer 22417@kfi7(0x30000000000123a)
00000400:00000200:29.0:1773851876.616586:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000100:00000200:14.0:1773851876.616586:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:13.0:1773851876.616586:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000100:00000001:11.0:1773851876.616586:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:29.0:1773851876.616587:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.616587:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00000010:14.0:1773851876.616587:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000020a75753.
00000100:00000040:14.0:1773851876.616587:0:2514739:0:(events.c:358:request_in_callback()) incoming req@0000000020a75753 x1859601617800896 msgsize 2976
00000100:00000001:12.0:1773851876.616587:0:82880:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851876.616587:0:82880:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000200:11.0:1773851876.616587:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:10.0:1773851876.616587:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 680/680 into md 0x7813a3b29 [128] + 109392
00000400:00000200:29.0:1773851876.616588:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000800:00000200:13.0:1773851876.616588:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851876.616588:0:82880:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851876.616588:0:82880:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:11.0:1773851876.616588:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000158ac04d.
00000100:00000040:11.0:1773851876.616588:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000158ac04d x1859601620305728 msgsize 488
00000400:00000200:30.0:1773851876.616589:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00100000:14.0:1773851876.616589:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
02000000:00000001:12.0:1773851876.616589:0:82880:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851876.616589:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851876.616590:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00100000:12.0:1773851876.616590:0:82880:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618951296
00000020:00000001:12.0:1773851876.616590:0:82880:0:(genops.c:802:class_conn2export()) Process entered
00000100:00100000:11.0:1773851876.616590:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000400:00000200:30.0:1773851876.616591:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00000001:14.0:1773851876.616591:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000040:12.0:1773851876.616591:0:82880:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:12.0:1773851876.616591:0:82880:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:10.0:1773851876.616591:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851876.616592:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000400:00000200:30.0:1773851876.616592:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 4
00000400:00000200:14.0:1773851876.616592:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000040:12.0:1773851876.616592:0:82880:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=312
00000020:00000001:12.0:1773851876.616592:0:82880:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:10.0:1773851876.616592:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000400:00000200:29.0:1773851876.616593:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:12.0:1773851876.616593:0:82880:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:11.0:1773851876.616593:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851876.616593:0:2458095:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2054@kfi7:2 TN 00000000a87426ea: Posted read of 4584 bytes in 2 frags kp 22417@kfi7(00000000080a5f4f) rma_iov.key 917505: rc=0
00000400:00000200:30.0:1773851876.616594:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:14.0:1773851876.616594:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851876.616594:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:12.0:1773851876.616594:0:82880:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851876.616594:0:82880:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:10.0:1773851876.616594:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:30.0:1773851876.616595:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 1424 into portal 13 MB=0x69b4c3ddb2c00
00000400:00000200:29.0:1773851876.616595:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 392 into portal 23 MB=0x69b4c3ddd5740
02000000:00000001:13.0:1773851876.616595:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:12.0:1773851876.616595:0:82880:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e2ee169c.
00000400:00000200:11.0:1773851876.616595:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
02000000:00000001:10.0:1773851876.616595:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.616595:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851876.616595:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 14 trmk 1 tmk 0 trr 3 tta 0x30000000000123a TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000100:00000001:13.0:1773851876.616596:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000010:12.0:1773851876.616596:0:82880:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000800:00000200:11.0:1773851876.616596:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851876.616596:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851876.616597:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-22352@kfi7 of length 392/392 into md 0x7800526dd [2] + 1960
00000100:00000001:13.0:1773851876.616597:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:12.0:1773851876.616597:0:82880:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
02000000:00000001:10.0:1773851876.616597:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.616597:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620305728
00000400:00000010:29.0:1773851876.616598:0:2467684:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001e1a5d27.
02000000:00000001:13.0:1773851876.616598:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851876.616598:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617800896
00000100:00000001:12.0:1773851876.616598:0:82880:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851876.616598:0:82880:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851876.616598:0:82880:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851876.616598:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000020:00000001:10.0:1773851876.616598:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.616598:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:29.0:1773851876.616599:0:2467684:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000445271fa
00000020:00000001:13.0:1773851876.616599:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:11.0:1773851876.616599:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:10.0:1773851876.616599:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616599:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000800:00000200:9.0:1773851876.616599:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:30.0:1773851876.616600:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 1424/1424 into md 0x77fdd4a5d [128] + 118504
00000020:00000040:13.0:1773851876.616600:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.616600:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:11.0:1773851876.616600:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:10.0:1773851876.616600:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:9.0:1773851876.616600:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851876.616601:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00080000:12.1:1773851876.616601:0:82880:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000dea72d8c x1859601618951296/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 392/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:10.0:1773851876.616601:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:9.0:1773851876.616601:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851876.616602:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:13.0:1773851876.616602:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000100:00000001:10.0:1773851876.616602:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.616602:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:30.0:1773851876.616603:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851876.616603:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22416@kfi7: PUT: OK
00000020:00000001:13.0:1773851876.616603:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:11.0:1773851876.616603:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:10.0:1773851876.616603:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000400:00000200:30.0:1773851876.616604:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851876.616604:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000445271fa
00000020:00000001:13.0:1773851876.616604:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00080000:12.1:1773851876.616604:0:82880:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000d79a46f4 x1859601618951296/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 392/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:10.0:1773851876.616604:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000800:00000200:9.0:1773851876.616604:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851876.616605:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22416@kfi7: PUT: OK
00000400:00000010:29.0:1773851876.616605:0:2467684:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000445271fa (tot 253200619).
00000100:00000001:13.0:1773851876.616605:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.616605:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:11.0:1773851876.616605:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000010:10.0:1773851876.616605:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000100:00000001:30.0:1773851876.616606:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:29.0:1773851876.616606:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000020:00000010:13.0:1773851876.616606:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000400:00000200:11.0:1773851876.616606:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000100:00000001:10.0:1773851876.616606:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.616606:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:9.0:1773851876.616606:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000200:30.0:1773851876.616607:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000200:29.0:1773851876.616607:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000040:29.0:1773851876.616607:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000358988ea x1859601617999680 msgsize 392
00000100:00000001:12.0:1773851876.616607:0:82880:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:12.0:1773851876.616607:0:82880:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:11.0:1773851876.616607:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:10.0:1773851876.616607:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.616607:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:9.0:1773851876.616607:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000100:00000010:30.0:1773851876.616608:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003e6f3f13.
00000100:00000040:30.0:1773851876.616608:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000003e6f3f13 x1859601617857536 msgsize 1424
00000020:00000010:13.0:1773851876.616608:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000100:00000001:12.0:1773851876.616608:0:82880:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851876.616608:0:82880:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:11.0:1773851876.616608:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:10.0:1773851876.616608:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000100:00100000:29.0:1773851876.616609:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000020:00000010:13.0:1773851876.616609:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000020:00000010:12.0:1773851876.616609:0:82880:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000400:00000200:11.0:1773851876.616609:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:10.0:1773851876.616609:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.616609:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000100:00100000:30.0:1773851876.616610:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00000040:29.0:1773851876.616610:0:2467684:0:(events.c:370:request_in_callback()) Buffer complete: 56 buffers still posted
00000100:00000001:13.0:1773851876.616610:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000010:12.0:1773851876.616610:0:82880:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000020:00000010:12.0:1773851876.616610:0:82880:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e2ee169c.
00000400:00000200:11.0:1773851876.616610:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000020:00000001:10.0:1773851876.616610:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.616610:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851876.616611:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:13.0:1773851876.616611:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000040:12.0:1773851876.616611:0:82880:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:12.0:1773851876.616611:0:82880:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:11.0:1773851876.616611:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000001:00000001:10.0:1773851876.616611:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.616611:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851876.616612:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000100:00000001:29.0:1773851876.616612:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:13.0:1773851876.616612:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.616612:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000001:00000001:10.0:1773851876.616612:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:9.0:1773851876.616612:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:28.0:1773851876.616613:0:61389:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:13.0:1773851876.616613:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000001:00000001:10.0:1773851876.616613:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.616613:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:9.0:1773851876.616613:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000200:9.0:1773851876.616613:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000800:00000200:30.0:1773851876.616614:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:29.0:1773851876.616614:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
02000000:00000001:28.0:1773851876.616614:0:61389:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851876.616614:0:61389:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:13.0:1773851876.616614:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000001:00000001:10.0:1773851876.616614:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.616614:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616614:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616614:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000100:00000001:31.0:1773851876.616615:0:82937:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851876.616615:0:82937:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851876.616615:0:82937:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851876.616615:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851876.616615:0:61389:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851876.616615:0:61389:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616615:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.616615:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:9.0:1773851876.616615:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 6
00000100:00000001:31.0:1773851876.616616:0:82937:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851876.616616:0:82937:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851876.616616:0:61389:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617857536
00000020:00000001:28.0:1773851876.616616:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:13.0:1773851876.616616:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.616616:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616616:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:10.0:1773851876.616616:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616616:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851876.616617:0:82937:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617999680
00000020:00000001:31.0:1773851876.616617:0:82937:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851876.616617:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:11.0:1773851876.616617:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3e013600
00000020:00000001:10.0:1773851876.616617:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616617:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000040:31.0:1773851876.616618:0:82937:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:31.0:1773851876.616618:0:82937:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:28.0:1773851876.616618:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000001:00000001:13.0:1773851876.616618:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:11.0:1773851876.616618:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 110072
00002000:00000001:10.0:1773851876.616618:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.616618:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616618:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 1352 into portal 13 MB=0x69b4c3dda5080
00000020:00000040:31.0:1773851876.616619:0:82937:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:31.0:1773851876.616619:0:82937:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000040:28.0:1773851876.616619:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000001:00000001:13.0:1773851876.616619:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616619:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:31.0:1773851876.616620:0:82937:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:28.0:1773851876.616620:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:28.0:1773851876.616620:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:13.0:1773851876.616620:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00002000:00100000:10.0:1773851876.616620:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x24002496e:0x18a13:0x0]  req@00000000158ac04d x1859601620305728/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:31.0:1773851876.616621:0:82937:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851876.616621:0:82937:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:28.0:1773851876.616621:0:61389:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000001:00000001:13.0:1773851876.616621:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.616621:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:11.0:1773851876.616621:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:31.0:1773851876.616622:0:82937:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe4b474d.
00000100:00000001:28.0:1773851876.616622:0:61389:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851876.616622:0:61389:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001aa5c9b3.
00000001:00000001:13.0:1773851876.616622:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.616622:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:11.0:1773851876.616622:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.616622:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 1352/1352 into md 0x7813a3b29 [128] + 110560
00000020:00000010:31.0:1773851876.616623:0:82937:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:28.0:1773851876.616623:0:61389:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000001:00000001:13.0:1773851876.616623:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616623:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00002000:00000001:10.0:1773851876.616623:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.616623:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000158ac04d with x1859601620305728
00000020:00000010:31.0:1773851876.616624:0:82937:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000020:00000010:28.0:1773851876.616624:0:61389:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000020:00000001:13.0:1773851876.616624:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:11.0:1773851876.616624:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:10.0:1773851876.616624:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.616624:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:9.0:1773851876.616624:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851876.616625:0:82937:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851876.616625:0:61389:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851876.616625:0:61389:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.616625:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616625:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851876.616625:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000040:10.0:1773851876.616625:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008bbb8c1d refcount=3
00000400:00000200:9.0:1773851876.616625:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851876.616626:0:82937:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851876.616626:0:82937:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.616626:0:61389:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.616626:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:11.0:1773851876.616626:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000635a3e74.
00000020:00000001:10.0:1773851876.616626:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083615108992 : -106990094442624 : ffff9eb16d6d1f80)
00000400:00000200:9.0:1773851876.616626:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000020:00000001:28.0:1773851876.616627:0:61389:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851876.616627:0:61389:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000800:00000200:15.0:1773851876.616627:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000040:11.0:1773851876.616627:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000635a3e74 x1859601620350464 msgsize 488
00010000:00000001:10.0:1773851876.616627:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083615108992 : -106990094442624 : ffff9eb16d6d1f80)
00000020:00000001:28.0:1773851876.616628:0:61389:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00002000:00000001:13.0:1773851876.616628:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.616628:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.616628:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.616628:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00080000:31.1:1773851876.616629:0:82937:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000358988ea x1859601617999680/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:202/0 lens 392/0 e 0 to 0 dl 1773852317 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:28.0:1773851876.616629:0:61389:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:28.0:1773851876.616629:0:61389:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000800:00000200:15.0:1773851876.616629:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00002000:00000001:13.0:1773851876.616629:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00100000:11.0:1773851876.616629:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:11.0:1773851876.616629:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:10.0:1773851876.616629:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616629:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.616630:0:61389:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.616630:0:61389:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000800:00000200:15.0:1773851876.616630:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851876.616630:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.616631:0:61389:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:13.0:1773851876.616631:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240025c52:0x282f:0x0]  req@0000000020a75753 x1859601617800896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2976/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:11.0:1773851876.616631:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000100:00080000:31.1:1773851876.616632:0:82937:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000ec421d28 x1859601617999680/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:556/0 lens 392/0 e 1 to 0 dl 1773851916 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:28.0:1773851876.616632:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616632:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:15.0:1773851876.616632:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000001:00000001:28.0:1773851876.616633:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616633:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:11.0:1773851876.616633:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851876.616633:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851876.616633:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000001:00000001:28.0:1773851876.616634:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616634:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:9.0:1773851876.616634:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ff9fbb21.
00000100:00000040:9.0:1773851876.616634:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000ff9fbb21 x1859601617801344 msgsize 1352
00000400:00000200:15.0:1773851876.616635:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:14.0:1773851876.616635:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00002000:00000001:13.0:1773851876.616635:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.616635:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000020a75753 with x1859601617800896
00000800:00000200:11.0:1773851876.616635:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:31.0:1773851876.616636:0:82937:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:31.0:1773851876.616636:0:82937:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:28.0:1773851876.616636:0:61389:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:15.0:1773851876.616636:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000800:00000200:14.0:1773851876.616636:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00010000:00000001:13.0:1773851876.616636:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000800:00000200:11.0:1773851876.616636:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00080000:10.1:1773851876.616636:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000158ac04d x1859601620305728/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00100000:9.0:1773851876.616636:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:31.0:1773851876.616637:0:82937:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:28.0:1773851876.616637:0:61389:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.616637:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.616637:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:9.0:1773851876.616637:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:28.0:1773851876.616638:0:61389:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.616638:0:61389:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.616638:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000800:00000200:14.0:1773851876.616638:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851876.616638:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00080000:10.1:1773851876.616638:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000992df82e x1859601620305728/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 488/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616638:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00002000:00000001:28.0:1773851876.616639:0:61389:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000400:00000200:15.0:1773851876.616639:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000040:13.0:1773851876.616639:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000091c62b25 refcount=3
00000800:00000200:9.0:1773851876.616639:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000001:28.0:1773851876.616640:0:61389:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:28.0:1773851876.616640:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:15.0:1773851876.616640:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000800:00000200:14.0:1773851876.616640:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.616640:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637080518963584 : -106993190588032 : ffff9eb0b4e1b180)
00000800:00000200:11.0:1773851876.616640:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851876.616641:0:82937:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00002000:00100000:28.0:1773851876.616641:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240025037:0x9ccc:0x0]  req@000000003e6f3f13 x1859601617857536/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1424/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.616641:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00010000:00000001:13.0:1773851876.616641:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637080518963584 : -106993190588032 : ffff9eb0b4e1b180)
00000100:00000001:10.0:1773851876.616641:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000800:00000200:9.0:1773851876.616641:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000020:00000010:31.0:1773851876.616642:0:82937:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851876.616642:0:82937:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00010000:00000001:13.0:1773851876.616642:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:11.0:1773851876.616642:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:10.0:1773851876.616642:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:9.0:1773851876.616642:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:31.0:1773851876.616643:0:82937:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe4b474d.
00000400:00000200:14.0:1773851876.616643:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:13.0:1773851876.616643:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616643:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:10.0:1773851876.616643:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000040:31.0:1773851876.616644:0:82937:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00002000:00000001:28.0:1773851876.616644:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:15.0:1773851876.616644:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616644:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00002000:00000001:13.0:1773851876.616644:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616644:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00002000:00000001:10.0:1773851876.616644:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:9.0:1773851876.616644:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00100000:28.0:1773851876.616645:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003e6f3f13 with x1859601617857536
00000400:00000200:15.0:1773851876.616645:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2520 into portal 13 MB=0x69b4c3dda8d40
00000100:00000001:13.0:1773851876.616645:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616645:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00002000:00100000:10.0:1773851876.616645:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x24002496e:0x18a13:0x0]  req@00000000158ac04d x1859601620305728/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000010:31.0:1773851876.616646:0:82937:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000083cfc101.
00010000:00000001:28.0:1773851876.616646:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:28.0:1773851876.616646:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:14.0:1773851876.616646:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616646:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:11.0:1773851876.616646:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000800:00000200:9.0:1773851876.616646:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000010:31.0:1773851876.616647:0:82937:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059f0696b.
00000100:00000010:31.0:1773851876.616647:0:82937:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c08df85.
00000400:00000200:15.0:1773851876.616647:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2520/2520 into md 0x82a21912d [128] + 91672
00000400:00000200:11.0:1773851876.616647:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00002000:00000001:10.0:1773851876.616647:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000010:31.0:1773851876.616648:0:82937:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a0f4dbfb.
00000020:00000040:28.0:1773851876.616648:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007c97259f refcount=3
00000400:00000200:14.0:1773851876.616648:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616648:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:11.0:1773851876.616648:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00002000:00100000:10.0:1773851876.616648:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000158ac04d with x1859601620305728
00010000:00000001:10.0:1773851876.616648:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000010:31.0:1773851876.616649:0:82937:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de14b05e.
00000020:00000001:28.0:1773851876.616649:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102897500096 : -106970812051520 : ffff9eb5eabf0fc0)
00000400:00000200:14.0:1773851876.616649:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000400:00000200:11.0:1773851876.616649:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000020:00000001:10.0:1773851876.616649:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616649:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008bbb8c1d refcount=3
00000100:00000001:31.0:1773851876.616650:0:82937:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:28.0:1773851876.616650:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637102897500096 : -106970812051520 : ffff9eb5eabf0fc0)
00010000:00000001:28.0:1773851876.616650:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000800:00000200:15.0:1773851876.616650:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:10.0:1773851876.616650:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083615108992 : -106990094442624 : ffff9eb16d6d1f80)
00000400:00000200:9.0:1773851876.616650:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00010000:00000001:28.0:1773851876.616651:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:28.0:1773851876.616651:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:15.0:1773851876.616651:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851876.616651:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00080000:13.1F:1773851876.616651:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000020a75753 x1859601617800896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2976/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:11.0:1773851876.616651:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:10.0:1773851876.616651:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083615108992 : -106990094442624 : ffff9eb16d6d1f80)
00000100:00000200:31.0:1773851876.616652:0:82937:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt_readpage: registering portal 23
00002000:00000001:28.0:1773851876.616652:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851876.616652:0:61389:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.616652:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3de98280
00010000:00000001:10.0:1773851876.616652:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.616652:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:9.0:1773851876.616652:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000400:00000010:31.0:1773851876.616653:0:82937:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000d4d0e69a.
00000400:00000200:15.0:1773851876.616653:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000400:00000200:14.0:1773851876.616653:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x82a21912d [128] + 94192
00000400:00000200:11.0:1773851876.616653:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2400 into portal 13 MB=0x69b4c3ddaa780
00002000:00000001:10.0:1773851876.616653:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:9.0:1773851876.616653:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.616653:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000010:31.0:1773851876.616654:0:82937:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000dfa2c75d (tot 253200771).
00000400:00000200:11.0:1773851876.616654:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2400/2400 into md 0x7813a3b29 [128] + 111912
00002000:00000001:10.0:1773851876.616654:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616654:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:15.0:1773851876.616655:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851876.616655:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:14.0:1773851876.616655:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00080000:13.1:1773851876.616655:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e23f414c x1859601617800896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 2976/448 e 10 to 0 dl 1773851815 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616655:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000100:00000010:15.0:1773851876.616656:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000043120791.
00000800:00000200:11.0:1773851876.616656:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851876.616656:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 6
00000100:00000040:15.0:1773851876.616657:0:2513974:0:(events.c:358:request_in_callback()) incoming req@0000000043120791 x1859601617816896 msgsize 2520
00000400:00000200:14.0:1773851876.616657:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.616657:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00100000:15.0:1773851876.616658:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:13.0:1773851876.616658:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:11.0:1773851876.616658:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.616658:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3de5e480
00000100:00080000:28.1:1773851876.616659:0:61389:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000003e6f3f13 x1859601617857536/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1424/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:15.0:1773851876.616659:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:13.0:1773851876.616659:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:9.0:1773851876.616659:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 114312
00000400:00000200:15.0:1773851876.616660:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000100:00000001:13.0:1773851876.616660:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.616660:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:11.0:1773851876.616660:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000800:00000200:15.0:1773851876.616661:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00002000:00100000:13.0:1773851876.616661:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240025c52:0x282f:0x0]  req@0000000020a75753 x1859601617800896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2976/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:11.0:1773851876.616661:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851876.616661:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:9.0:1773851876.616661:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00080000:28.1:1773851876.616662:0:61389:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000fc7af08d x1859601617857536/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:703/0 lens 1424/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000010:11.0:1773851876.616662:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004aefacb6.
00000400:00000200:9.0:1773851876.616662:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851876.616663:0:2510946:0:(events.c:358:request_in_callback()) incoming req@000000004aefacb6 x1859601617823616 msgsize 2400
00000400:00000200:9.0:1773851876.616663:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000100:00000001:28.0:1773851876.616664:0:61389:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00100000:11.0:1773851876.616664:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:10.0:1773851876.616664:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:28.0:1773851876.616665:0:61389:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:11.0:1773851876.616665:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000010:10.0:1773851876.616665:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000100:00000001:28.0:1773851876.616666:0:61389:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:11.0:1773851876.616666:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000020:00000010:10.0:1773851876.616666:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00002000:00000001:28.0:1773851876.616667:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:10.0:1773851876.616667:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00002000:00100000:28.0:1773851876.616668:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240025037:0x9ccc:0x0]  req@000000003e6f3f13 x1859601617857536/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1424/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:13.0:1773851876.616668:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.616668:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000020a75753 with x1859601617800896
00000800:00000200:11.0:1773851876.616668:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000040:10.0:1773851876.616668:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:10.0:1773851876.616668:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851876.616668:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851876.616668:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00010000:00000001:13.0:1773851876.616669:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.616669:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000010:9.0:1773851876.616669:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006b3e2ace.
00000100:00000040:9.0:1773851876.616669:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006b3e2ace x1859601618560128 msgsize 488
00000400:00000200:14.0:1773851876.616670:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000100:00000001:14.0:1773851876.616670:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000020:00000040:13.0:1773851876.616670:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000091c62b25 refcount=3
00000800:00000200:11.0:1773851876.616670:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:10.0:1773851876.616670:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.616670:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00002000:00000001:28.0:1773851876.616671:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:28.0:1773851876.616671:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003e6f3f13 with x1859601617857536
00000100:00000200:14.0:1773851876.616671:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000001:13.0:1773851876.616671:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637080518963584 : -106993190588032 : ffff9eb0b4e1b180)
00000800:00000200:11.0:1773851876.616671:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:10.0:1773851876.616671:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.616671:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851876.616671:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:9.0:1773851876.616671:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000001:28.0:1773851876.616672:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:28.0:1773851876.616672:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000010:14.0:1773851876.616672:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac347a5f.
00000100:00000040:14.0:1773851876.616672:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000ac347a5f x1859601618797184 msgsize 488
00010000:00000001:13.0:1773851876.616672:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637080518963584 : -106993190588032 : ffff9eb0b4e1b180)
00000800:00000200:11.0:1773851876.616672:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:10.0:1773851876.616672:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616672:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000020:00000040:28.0:1773851876.616673:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007c97259f refcount=3
00000020:00000001:28.0:1773851876.616673:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102897500096 : -106970812051520 : ffff9eb5eabf0fc0)
00010000:00000001:13.0:1773851876.616673:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.616673:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616673:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00100000:10.0:1773851876.616673:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620350464
00000020:00000001:10.0:1773851876.616673:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:9.0:1773851876.616673:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00010000:00000001:28.0:1773851876.616674:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637102897500096 : -106970812051520 : ffff9eb5eabf0fc0)
00000100:00100000:14.0:1773851876.616674:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00002000:00000001:13.0:1773851876.616674:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851876.616674:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:10.0:1773851876.616674:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.616674:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00010000:00000001:28.0:1773851876.616675:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851876.616675:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:14.0:1773851876.616675:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:13.0:1773851876.616675:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.616675:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000040:10.0:1773851876.616675:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.616675:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00000001:28.0:1773851876.616676:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:28.0:1773851876.616676:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.616676:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000010:13.0:1773851876.616676:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000400:00000200:11.0:1773851876.616676:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:10.0:1773851876.616676:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:9.0:1773851876.616676:0:2458095:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 14 trmk 1 tmk 0 trr 3 tta 0x30000000000123a TN_EVENT_TAG_TX_OK event status 0
00000100:00000001:28.0:1773851876.616677:0:61389:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:14.0:1773851876.616677:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:11.0:1773851876.616677:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000100:00000001:10.0:1773851876.616677:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000010:28.0:1773851876.616678:0:61389:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851876.616678:0:61389:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:13.0:1773851876.616678:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000400:00000200:11.0:1773851876.616678:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:10.0:1773851876.616678:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.616678:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000400:00000200:9.0:1773851876.616678:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:28.0:1773851876.616679:0:61389:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001aa5c9b3.
00000020:00000040:13.0:1773851876.616679:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:13.0:1773851876.616679:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:11.0:1773851876.616679:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000010:10.0:1773851876.616679:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000040:28.0:1773851876.616680:0:61389:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000400:00000200:11.0:1773851876.616680:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000010:10.0:1773851876.616680:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000400:00000200:9.0:1773851876.616680:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000100:00000001:9.0:1773851876.616680:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:13.0:1773851876.616681:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:11.0:1773851876.616681:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000200:11.0:1773851876.616681:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000100:00000001:10.0:1773851876.616681:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000200:9.0:1773851876.616681:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:28.0:1773851876.616682:0:61389:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:13.0:1773851876.616682:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.616682:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:11.0:1773851876.616682:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:10.0:1773851876.616682:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000010:9.0:1773851876.616682:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000028eda8b2.
00000100:00000040:9.0:1773851876.616682:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000028eda8b2 x1859601617801024 msgsize 4584
00000100:00000001:13.0:1773851876.616683:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851876.616683:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616683:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3de9f480
00000020:00000001:10.0:1773851876.616683:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.616683:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00100000:13.0:1773851876.616684:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617816896
00000400:00000200:11.0:1773851876.616684:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 114800
00000020:00000001:10.0:1773851876.616684:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000001:10.0:1773851876.616684:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00100000:9.0:1773851876.616684:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000020:00000001:13.0:1773851876.616685:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.616685:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.616685:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.616685:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000100:00000001:9.0:1773851876.616685:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:13.0:1773851876.616686:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616686:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000800:00000200:11.0:1773851876.616686:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:10.0:1773851876.616686:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616686:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000020:00000001:13.0:1773851876.616687:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.616687:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.616687:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851876.616688:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.616688:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.616688:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:13.0:1773851876.616688:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:11.0:1773851876.616688:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:10.0:1773851876.616688:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:9.0:1773851876.616688:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 14 trmk 1 tmk 0 trr 3 tta 0x30000000000123a Transaction freed
00000800:00000200:30.0:1773851876.616689:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:13.0:1773851876.616689:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.616689:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:11.0:1773851876.616689:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000001:00000001:10.0:1773851876.616689:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.616689:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:30.0:1773851876.616690:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851876.616690:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:13.0:1773851876.616690:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000100:00000001:11.0:1773851876.616690:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851876.616690:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000001:00000001:10.0:1773851876.616690:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.616690:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616690:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851876.616691:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000100:00000010:11.0:1773851876.616691:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000211b859f.
00000020:00000001:10.0:1773851876.616691:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000800:00000200:30.0:1773851876.616692:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851876.616692:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851876.616692:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851876.616692:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000020:00000010:13.0:1773851876.616692:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00000040:11.0:1773851876.616692:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000211b859f x1859601618826368 msgsize 488
00000020:00000001:10.0:1773851876.616692:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616692:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616693:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00100000:11.0:1773851876.616693:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000020:00000001:10.0:1773851876.616693:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851876.616694:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000800:00000200:14.0:1773851876.616694:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:13.0:1773851876.616694:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.616694:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000100:00000001:11.0:1773851876.616694:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:10.0:1773851876.616694:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.616694:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851876.616695:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22416@kfi7 : PUT - for me
00000020:00000001:13.0:1773851876.616695:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:11.0:1773851876.616695:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00002000:00000001:10.0:1773851876.616695:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:30.0:1773851876.616696:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000800:00000200:14.0:1773851876.616696:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.616696:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:13.0:1773851876.616696:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000800:00000200:11.0:1773851876.616696:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00002000:00100000:10.0:1773851876.616696:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024b79:0x996b:0x0]  req@00000000635a3e74 x1859601620350464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:30.0:1773851876.616697:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000020:00000001:13.0:1773851876.616697:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000800:00000200:9.0:1773851876.616697:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851876.616697:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:30.0:1773851876.616698:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:14.0:1773851876.616698:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.616698:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.616698:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851876.616699:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000001:00000001:13.0:1773851876.616699:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.616699:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616699:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.616699:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000635a3e74 with x1859601620350464
00000800:00000200:9.0:1773851876.616699:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851876.616700:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000400:00000200:14.0:1773851876.616700:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000001:00000001:13.0:1773851876.616700:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616700:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00010000:00000001:10.0:1773851876.616700:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:29.0:1773851876.616701:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:14.0:1773851876.616701:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:13.0:1773851876.616701:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616701:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:10.0:1773851876.616701:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616701:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000397600fd refcount=3
00000800:00000200:9.0:1773851876.616701:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851876.616702:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:29.0:1773851876.616702:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22416@kfi7 : PUT - for me
00000001:00000001:13.0:1773851876.616702:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616702:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616702:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103067792512 : -106970641759104 : ffff9eb5f4e58480)
00010000:00000001:10.0:1773851876.616702:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637103067792512 : -106970641759104 : ffff9eb5f4e58480)
00000400:00000200:30.0:1773851876.616703:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 392 into portal 23 MB=0x69b4c3de73e40
00000020:00000001:13.0:1773851876.616703:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00010000:00000001:10.0:1773851876.616703:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:9.0:1773851876.616703:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:30.0:1773851876.616704:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-22352@kfi7 of length 392/392 into md 0x780052ffd [2] + 0
00000400:00000200:29.0:1773851876.616704:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000020:00000001:13.0:1773851876.616704:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616704:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.616704:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.616704:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:29.0:1773851876.616705:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000400:00000200:29.0:1773851876.616705:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000020:00000001:13.0:1773851876.616705:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616705:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.616705:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616705:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000400:00000200:29.0:1773851876.616706:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00002000:00000001:13.0:1773851876.616706:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.616706:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616706:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000800:00000200:30.0:1773851876.616707:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851876.616707:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 4
00000400:00000200:14.0:1773851876.616707:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00002000:00000001:13.0:1773851876.616707:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:10.1:1773851876.616707:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000635a3e74 x1859601620350464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616707:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000400:00000200:30.0:1773851876.616708:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851876.616708:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00100000:13.0:1773851876.616708:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240025ea0:0x6444:0x0]  req@0000000043120791 x1859601617816896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2520/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616708:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:30.0:1773851876.616709:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22416@kfi7: PUT: OK
00000400:00000200:29.0:1773851876.616709:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616709:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:9.0:1773851876.616709:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000100:00000001:30.0:1773851876.616710:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851876.616710:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000400:00000200:29.0:1773851876.616710:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 1424 into portal 13 MB=0x69b4c3ddba000
00000800:00000200:25.0:1773851876.616710:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:14.0:1773851876.616710:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00002000:00000001:13.0:1773851876.616710:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00080000:10.1:1773851876.616710:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000ce97bb54 x1859601620350464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 488/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616710:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000100:00000010:30.0:1773851876.616711:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ab74edb.
00000400:00000200:29.0:1773851876.616711:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 1424/1424 into md 0x77fdd4a5d [128] + 119928
00000800:00000200:25.0:1773851876.616711:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:14.0:1773851876.616711:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00100000:13.0:1773851876.616711:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000043120791 with x1859601617816896
00000400:00000200:9.0:1773851876.616711:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000040:30.0:1773851876.616712:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000006ab74edb x1859601618648640 msgsize 392
00000800:00000200:25.0:1773851876.616712:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851876.616712:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4320 into portal 13 MB=0x69b4c3ddb4c80
00010000:00000001:13.0:1773851876.616712:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.616712:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:9.0:1773851876.616712:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3e037140
00000100:00100000:30.0:1773851876.616713:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000800:00000200:29.0:1773851876.616713:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851876.616713:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000800:00000200:25.0:1773851876.616714:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851876.616714:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4320/4320 into md 0x82a21912d [128] + 94680
00000100:00000001:10.0:1773851876.616714:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:10.0:1773851876.616714:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851876.616714:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 115288
00000100:00000001:30.0:1773851876.616715:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851876.616715:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00000001:10.0:1773851876.616715:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:30.0:1773851876.616716:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000400:00000200:29.0:1773851876.616716:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22416@kfi7: PUT: OK
00000100:00000001:31.0:1773851876.616717:0:82937:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851876.616717:0:82937:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851876.616717:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851876.616717:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:25.0:1773851876.616717:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00002000:00100000:10.0:1773851876.616717:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024b79:0x996b:0x0]  req@00000000635a3e74 x1859601620350464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:9.0:1773851876.616717:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851876.616718:0:82937:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851876.616718:0:82937:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851876.616718:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000010:29.0:1773851876.616718:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000b1f22ce.
00000400:00000200:25.0:1773851876.616718:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000800:00000200:14.0:1773851876.616718:0:2514739:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000020:00000040:13.0:1773851876.616718:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000aebf8f96 refcount=3
00000400:00000200:9.0:1773851876.616718:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:31.0:1773851876.616719:0:82937:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851876.616719:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000000b1f22ce x1859601617887232 msgsize 1424
00000400:00000200:25.0:1773851876.616719:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.616719:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 1
00000020:00000001:13.0:1773851876.616719:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637076365178944 : -106997344372672 : ffff9eafbd4bf840)
00000400:00000200:9.0:1773851876.616719:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000100:00100000:31.0:1773851876.616720:0:82937:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618648640
00000020:00000001:31.0:1773851876.616720:0:82937:0:(genops.c:802:class_conn2export()) Process entered
00000100:00100000:29.0:1773851876.616720:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000400:00000200:25.0:1773851876.616720:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000800:00000200:14.0:1773851876.616720:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00010000:00000001:13.0:1773851876.616720:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637076365178944 : -106997344372672 : ffff9eafbd4bf840)
00000100:00000001:9.0:1773851876.616720:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000020:00000040:31.0:1773851876.616721:0:82937:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:29.0:1773851876.616721:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851876.616721:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00010000:00000001:13.0:1773851876.616721:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000200:9.0:1773851876.616721:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000001:31.0:1773851876.616722:0:82937:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851876.616722:0:82937:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000400:00000200:29.0:1773851876.616722:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000400:00000200:25.0:1773851876.616722:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00010000:00000001:13.0:1773851876.616722:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616722:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000010:9.0:1773851876.616722:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fdf2070c.
00000100:00000040:9.0:1773851876.616722:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000fdf2070c x1859601620496704 msgsize 488
00000020:00000001:31.0:1773851876.616723:0:82937:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:28.0:1773851876.616723:0:61389:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:27.0:1773851876.616723:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:25.0:1773851876.616723:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:14.0:1773851876.616723:0:2514739:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 Using peer 22352@kfi7(0x1233)
00002000:00000001:13.0:1773851876.616723:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616723:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616723:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.616723:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000635a3e74 with x1859601620350464
00000020:00000001:31.0:1773851876.616724:0:82937:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:29.0:1773851876.616724:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851876.616724:0:61389:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851876.616724:0:61389:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851876.616724:0:61389:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851876.616724:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851876.616724:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2360 into portal 13 MB=0x69b4c3ddaafc0
00010000:00000001:10.0:1773851876.616724:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.616724:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:9.0:1773851876.616724:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000800:00000200:27.0:1773851876.616728:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851876.616728:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
02000000:00000001:28.0:1773851876.616729:0:61389:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:13.1:1773851876.616729:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000043120791 x1859601617816896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2520/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616729:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000100:00000001:31.0:1773851876.616730:0:82937:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00100000:28.0:1773851876.616730:0:61389:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617887232
00000020:00000001:28.0:1773851876.616730:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:27.0:1773851876.616730:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:10.0:1773851876.616730:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000397600fd refcount=3
00000100:00000001:31.0:1773851876.616731:0:82937:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851876.616731:0:82937:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe4b474d.
00000020:00000040:28.0:1773851876.616731:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:28.0:1773851876.616731:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:25.0:1773851876.616731:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2360/2360 into md 0x1614fbabf9 [128] + 188408
00000020:00000001:10.0:1773851876.616731:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103067792512 : -106970641759104 : ffff9eb5f4e58480)
00010000:00000001:10.0:1773851876.616731:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637103067792512 : -106970641759104 : ffff9eb5f4e58480)
00000800:00000200:9.0:1773851876.616731:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000010:31.0:1773851876.616732:0:82937:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000040:28.0:1773851876.616732:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000400:00000200:27.0:1773851876.616732:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00080000:13.1:1773851876.616732:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000a14a2b0d x1859601617816896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 2520/0 e 5 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.616732:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000010:31.0:1773851876.616733:0:82937:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000020:00000001:28.0:1773851876.616733:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:28.0:1773851876.616733:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:27.0:1773851876.616733:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000800:00000200:25.0:1773851876.616733:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:10.0:1773851876.616733:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.616733:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616733:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.616734:0:82937:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851876.616734:0:82937:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851876.616734:0:61389:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:27.0:1773851876.616734:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00000001:31.0:1773851876.616735:0:82937:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851876.616735:0:61389:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851876.616735:0:61389:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001aa5c9b3.
00000400:00000200:27.0:1773851876.616735:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000400:00000200:25.0:1773851876.616735:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851876.616735:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.616735:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851876.616736:0:61389:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000400:00000200:27.0:1773851876.616736:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.616736:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000400:00000200:25.0:1773851876.616736:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000100:00000001:13.0:1773851876.616736:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:10.0:1773851876.616736:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:28.0:1773851876.616737:0:61389:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000800:00000200:26.0:1773851876.616737:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:25.0:1773851876.616737:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851876.616737:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:13.0:1773851876.616737:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:10.0:1773851876.616737:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000100:00080000:31.1:1773851876.616738:0:82937:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000006ab74edb x1859601618648640/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 392/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00000001:28.0:1773851876.616738:0:61389:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851876.616738:0:61389:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:27.0:1773851876.616738:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000800:00000200:26.0:1773851876.616738:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000100:00000010:25.0:1773851876.616738:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003d26ec3f.
00000800:00000200:14.0:1773851876.616738:0:2514739:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:3 TN 00000000ba933e94: Posted read of 4320 bytes in 2 frags kp 22352@kfi7(000000000fcd3eb6) rma_iov.key 2293761: rc=0
00002000:00000001:13.0:1773851876.616738:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:13.0:1773851876.616738:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240025ea0:0x6444:0x0]  req@0000000043120791 x1859601617816896/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2520/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:10.0:1773851876.616738:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000001:28.0:1773851876.616739:0:61389:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:28.0:1773851876.616739:0:61389:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:27.0:1773851876.616739:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:26.0:1773851876.616739:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000100:00000040:25.0:1773851876.616739:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000003d26ec3f x1859601617825728 msgsize 2360
00000020:00000040:10.0:1773851876.616739:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00000001:10.0:1773851876.616739:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00080000:31.1:1773851876.616740:0:82937:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000887a24fa x1859601618648640/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 392/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000020:00000001:28.0:1773851876.616740:0:61389:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:27.0:1773851876.616740:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3ddfaf00
00000100:00100000:25.0:1773851876.616740:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000020:00000001:28.0:1773851876.616741:0:61389:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851876.616741:0:61389:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000400:00000200:27.0:1773851876.616741:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 190768
00000800:00000200:26.0:1773851876.616741:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22353@kfi7(0000000016ff6d25):0x1239 version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851876.616741:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00002000:00000001:13.0:1773851876.616741:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.616741:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000043120791 with x1859601617816896
00000100:00000001:10.0:1773851876.616741:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.616741:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:28.0:1773851876.616742:0:61389:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000100:00000001:25.0:1773851876.616742:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000001:13.0:1773851876.616742:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:10.0:1773851876.616742:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.616742:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.616743:0:82937:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000001:28.0:1773851876.616743:0:61389:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.616743:0:61389:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:25.0:1773851876.616743:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:13.0:1773851876.616743:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616743:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000aebf8f96 refcount=3
02000000:00000001:10.0:1773851876.616743:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.616743:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:31.0:1773851876.616744:0:82937:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000001:00000001:28.0:1773851876.616744:0:61389:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.616744:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:27.0:1773851876.616744:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851876.616744:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1239 Using peer 22353@kfi7(0x1239)
00000100:00000001:24.0:1773851876.616744:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.616744:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:13.0:1773851876.616744:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637076365178944 : -106997344372672 : ffff9eafbd4bf840)
00000100:00100000:10.0:1773851876.616744:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617801344
00000020:00000001:10.0:1773851876.616744:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.616744:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000800:00000200:9.0:1773851876.616744:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851876.616745:0:82937:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000001:00000001:28.0:1773851876.616745:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:28.0:1773851876.616745:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:27.0:1773851876.616745:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851876.616745:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851876.616745:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.616745:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.616745:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637076365178944 : -106997344372672 : ffff9eafbd4bf840)
00010000:00000001:13.0:1773851876.616745:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:10.0:1773851876.616745:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616745:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000800:00000200:9.0:1773851876.616745:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851876.616746:0:82937:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851876.616746:0:82937:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000001:00000001:28.0:1773851876.616746:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:28.0:1773851876.616746:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:27.0:1773851876.616746:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000400:00000200:26.0:1773851876.616746:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
02000000:00000001:24.0:1773851876.616746:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.616746:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616746:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:10.0:1773851876.616746:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:31.0:1773851876.616747:0:82937:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000001:00000001:28.0:1773851876.616747:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.616747:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851876.616747:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:25.0:1773851876.616747:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00100000:24.0:1773851876.616747:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617825728
00000020:00000001:24.0:1773851876.616747:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00002000:00000001:13.0:1773851876.616747:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616747:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:10.0:1773851876.616747:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:31.0:1773851876.616748:0:82937:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe4b474d.
00000020:00000040:31.0:1773851876.616748:0:82937:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000020:00000001:28.0:1773851876.616748:0:61389:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000010:27.0:1773851876.616748:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eb28bb44.
00000800:00000200:26.0:1773851876.616748:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 38 bytes to peer 0x1239: rc=0
00000800:00000200:25.0:1773851876.616748:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000040:24.0:1773851876.616748:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000010:13.0:1773851876.616748:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000001:10.0:1773851876.616748:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.616748:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:9.0:1773851876.616748:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851876.616749:0:82937:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851876.616749:0:61389:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.616749:0:61389:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851876.616749:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000eb28bb44 x1859601618153216 msgsize 488
00000800:00000200:26.0:1773851876.616749:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1239 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:25.0:1773851876.616749:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:24.0:1773851876.616749:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000010:13.0:1773851876.616749:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:10.0:1773851876.616749:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000020:00000001:28.0:1773851876.616750:0:61389:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.616750:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000020:00000010:13.0:1773851876.616750:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000040:13.0:1773851876.616750:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000020:00000010:10.0:1773851876.616750:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000400:00000200:9.0:1773851876.616750:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00002000:00000001:28.0:1773851876.616751:0:61389:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:28.0:1773851876.616751:0:61389:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851876.616751:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000100:00000001:27.0:1773851876.616751:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:25.0:1773851876.616751:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:24.0:1773851876.616751:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.616751:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:10.0:1773851876.616751:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000400:00000200:9.0:1773851876.616751:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00002000:00000001:28.0:1773851876.616752:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:26.0:1773851876.616752:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000020:00000001:24.0:1773851876.616752:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.616752:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:9.0:1773851876.616752:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00002000:00100000:28.0:1773851876.616753:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x2400253ba:0x4975:0x0]  req@000000000b1f22ce x1859601617887232/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1424/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:27.0:1773851876.616753:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000800:00000200:26.0:1773851876.616753:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:24.0:1773851876.616753:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.616753:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:13.0:1773851876.616753:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.616753:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.616753:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.616753:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:9.0:1773851876.616753:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000800:00000200:27.0:1773851876.616754:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:26.0:1773851876.616754:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.616754:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.616754:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000100:00000001:13.0:1773851876.616754:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.616754:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616754:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.616754:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:25.0:1773851876.616755:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000020:00000010:24.0:1773851876.616755:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
02000000:00000001:13.0:1773851876.616755:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616755:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.616755:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000400:00000200:9.0:1773851876.616755:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00002000:00000001:28.0:1773851876.616756:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:28.0:1773851876.616756:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000000b1f22ce with x1859601617887232
00000800:00000200:26.0:1773851876.616756:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851876.616756:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00100000:13.0:1773851876.616756:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618797184
00000020:00000001:13.0:1773851876.616756:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:10.0:1773851876.616756:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.616756:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616756:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00010000:00000001:28.0:1773851876.616757:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:28.0:1773851876.616757:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:25.0:1773851876.616757:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 1
00000020:00000040:13.0:1773851876.616757:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000001:00000001:10.0:1773851876.616757:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:9.0:1773851876.616757:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000200:25.0:1773851876.616758:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000800:00000200:14.0:1773851876.616758:0:2514739:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 TN_EVENT_TAG_TX_OK event status 0
00000020:00000001:13.0:1773851876.616758:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616758:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000001:00000001:10.0:1773851876.616758:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.616758:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:9.0:1773851876.616758:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:27.0:1773851876.616759:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:25.0:1773851876.616759:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000400:00000200:14.0:1773851876.616759:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:13.0:1773851876.616759:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.616759:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.616759:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616759:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:9.0:1773851876.616759:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3de6f080
00000800:00000200:27.0:1773851876.616760:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851876.616760:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:13.0:1773851876.616760:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:11.0:1773851876.616760:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000001:00000001:10.0:1773851876.616760:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616760:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616760:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 115776
00000800:00000200:27.0:1773851876.616761:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851876.616761:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.616761:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000400:00000200:14.0:1773851876.616761:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000100:00000001:13.0:1773851876.616761:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.616761:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:11.0:1773851876.616761:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:10.0:1773851876.616761:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000040:28.0:1773851876.616762:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000093dc1da5 refcount=3
00000400:00000200:25.0:1773851876.616762:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:24.0:1773851876.616762:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.616762:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851876.616762:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.616762:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000010:13.0:1773851876.616762:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000800:00000200:11.0:1773851876.616762:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:10.0:1773851876.616762:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616762:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.616762:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:28.0:1773851876.616763:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123006452800 : -106950703098816 : ffff9eba99555440)
00010000:00000001:28.0:1773851876.616763:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637123006452800 : -106950703098816 : ffff9eba99555440)
00000800:00000200:27.0:1773851876.616763:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851876.616763:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22353@kfi7 : PUT - for me
00000400:00000200:25.0:1773851876.616763:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 3128 into portal 13 MB=0x69b4c3ddb9fc0
00000020:00000001:24.0:1773851876.616763:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.616763:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000010:14.0:1773851876.616763:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5120167.
00000020:00000010:13.0:1773851876.616763:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.616763:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851876.616764:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:26.0:1773851876.616764:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:26.0:1773851876.616764:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000400:00000200:25.0:1773851876.616764:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 3128/3128 into md 0x1614fbabf9 [128] + 191256
00000020:00000001:24.0:1773851876.616764:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000100:00000040:14.0:1773851876.616764:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000c5120167 x1859601617865856 msgsize 4320
00000020:00000010:13.0:1773851876.616764:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00002000:00000001:10.0:1773851876.616764:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.616764:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616764:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:28.0:1773851876.616765:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:28.0:1773851876.616765:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:26.0:1773851876.616765:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:24.0:1773851876.616765:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.616765:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000100:00000001:13.0:1773851876.616765:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.616765:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:11.0:1773851876.616765:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00002000:00000001:10.0:1773851876.616765:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:9.0:1773851876.616765:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00002000:00000001:28.0:1773851876.616766:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.616766:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:24.0:1773851876.616766:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.616766:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851876.616766:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:14.0:1773851876.616766:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:13.0:1773851876.616766:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.616766:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00002000:00100000:10.0:1773851876.616766:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0x2c0c:0x0]  req@00000000ff9fbb21 x1859601617801344/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 1352/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:9.0:1773851876.616766:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851876.616766:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:28.0:1773851876.616767:0:61389:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.616767:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000800:00000200:25.0:1773851876.616767:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:24.0:1773851876.616767:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:14.0:1773851876.616767:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000001:13.0:1773851876.616767:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000400:00000200:11.0:1773851876.616767:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000010:9.0:1773851876.616767:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000060c5431c.
00000100:00080000:28.1:1773851876.616768:0:61389:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000000b1f22ce x1859601617887232/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1424/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:27.0:1773851876.616768:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000001:00000001:24.0:1773851876.616768:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.616768:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:13.0:1773851876.616768:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851876.616768:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000400:00000200:11.0:1773851876.616768:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00002000:00000001:10.0:1773851876.616768:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000040:9.0:1773851876.616768:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000060c5431c x1859601618628736 msgsize 488
00000400:00000200:26.0:1773851876.616769:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:25.0:1773851876.616769:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:24.0:1773851876.616769:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.616769:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:14.0:1773851876.616769:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 Transaction freed
00000020:00000001:13.0:1773851876.616769:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00002000:00100000:10.0:1773851876.616769:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ff9fbb21 with x1859601617801344
00010000:00000001:10.0:1773851876.616769:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:27.0:1773851876.616770:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000400:00000200:26.0:1773851876.616770:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 3144 into portal 13 MB=0x69b4c3dda9980
00000400:00000200:25.0:1773851876.616770:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000001:00000001:24.0:1773851876.616770:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.616770:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:15.0:1773851876.616770:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000020:00000001:13.0:1773851876.616770:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616770:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:11.0:1773851876.616770:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:11.0:1773851876.616770:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:10.0:1773851876.616770:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:9.0:1773851876.616770:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00080000:28.1:1773851876.616771:0:61389:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e2b306e3 x1859601617887232/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 1424/0 e 2 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:27.0:1773851876.616771:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000001:00000001:24.0:1773851876.616771:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851876.616771:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000001:00000001:13.0:1773851876.616771:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616771:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:11.0:1773851876.616771:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:9.0:1773851876.616771:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851876.616772:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000400:00000200:26.0:1773851876.616772:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 3144/3144 into md 0x1614fbabf9 [128] + 194384
00000020:00000001:24.0:1773851876.616772:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851876.616772:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851876.616772:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:13.0:1773851876.616772:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:11.0:1773851876.616772:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000200:27.0:1773851876.616773:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00000001:25.0:1773851876.616773:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000020:00000001:24.0:1773851876.616773:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616773:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616773:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:11.0:1773851876.616773:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000020:00000040:10.0:1773851876.616773:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ca9f2c27 refcount=3
00000100:00000001:28.0:1773851876.616774:0:61389:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:28.0:1773851876.616774:0:61389:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:27.0:1773851876.616774:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000100:00000200:25.0:1773851876.616774:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:25.0:1773851876.616774:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000adc21199.
00000020:00000001:24.0:1773851876.616774:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616774:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616774:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616774:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092081939968 : -106981627611648 : ffff9eb36616b600)
00000100:00000001:28.0:1773851876.616775:0:61389:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:27.0:1773851876.616775:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 5
00000800:00000200:26.0:1773851876.616775:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:25.0:1773851876.616775:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000adc21199 x1859601617887168 msgsize 3128
00002000:00000001:24.0:1773851876.616775:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.616775:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851876.616775:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.616775:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.616775:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.616775:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637092081939968 : -106981627611648 : ffff9eb36616b600)
00010000:00000001:10.0:1773851876.616775:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:9.0:1773851876.616775:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00002000:00000001:28.0:1773851876.616776:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:27.0:1773851876.616776:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:26.0:1773851876.616776:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00000001:24.0:1773851876.616776:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:13.0:1773851876.616776:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616776:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:10.0:1773851876.616776:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:9.0:1773851876.616776:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00002000:00100000:28.0:1773851876.616777:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x2400253ba:0x4975:0x0]  req@000000000b1f22ce x1859601617887232/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1424/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:27.0:1773851876.616777:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3dfdc340
00000400:00000200:26.0:1773851876.616777:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22353@kfi7: PUT: OK
00000100:00100000:25.0:1773851876.616777:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00002000:00100000:24.0:1773851876.616777:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028973:0x2a13:0x0]  req@000000003d26ec3f x1859601617825728/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2360/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.616777:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.616777:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616777:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3e02ad00
00002000:00000001:10.0:1773851876.616777:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616777:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851876.616778:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:13.0:1773851876.616778:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.616778:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616778:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 116264
00000100:00000001:10.0:1773851876.616778:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:28.0:1773851876.616779:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:27.0:1773851876.616779:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 197528
00000400:00000200:15.0:1773851876.616779:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00002000:00000001:13.0:1773851876.616779:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:28.0:1773851876.616780:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000000b1f22ce with x1859601617887232
00010000:00000001:28.0:1773851876.616780:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00002000:00000001:24.0:1773851876.616780:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:15.0:1773851876.616780:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00100000:13.0:1773851876.616780:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240027894:0x311a:0x0]  req@00000000ac347a5f x1859601618797184/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:248/0 lens 488/0 e 0 to 0 dl 1773852363 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:11.0:1773851876.616780:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:28.0:1773851876.616781:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:27.0:1773851876.616781:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.616781:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00002000:00100000:24.0:1773851876.616781:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003d26ec3f with x1859601617825728
00000400:00000200:15.0:1773851876.616781:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000020:00000040:28.0:1773851876.616782:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000093dc1da5 refcount=3
00000020:00000001:28.0:1773851876.616782:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123006452800 : -106950703098816 : ffff9eba99555440)
00010000:00000001:24.0:1773851876.616782:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.616782:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:15.0:1773851876.616782:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:11.0:1773851876.616782:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00080000:10.1:1773851876.616782:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000ff9fbb21 x1859601617801344/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 1352/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:27.0:1773851876.616783:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851876.616783:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851876.616783:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:26.0:1773851876.616783:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004c01fc4.
00000800:00000200:25.0:1773851876.616783:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:15.0:1773851876.616783:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:11.0:1773851876.616783:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00010000:00000001:28.0:1773851876.616784:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637123006452800 : -106950703098816 : ffff9eba99555440)
00000400:00000200:27.0:1773851876.616784:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000100:00000040:26.0:1773851876.616784:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000004c01fc4 x1859601617820032 msgsize 3144
00000400:00000200:15.0:1773851876.616784:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000100:00000001:11.0:1773851876.616784:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:28.0:1773851876.616785:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851876.616785:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:15.0:1773851876.616785:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000200:11.0:1773851876.616785:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00080000:10.1:1773851876.616785:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000316be1a9 x1859601617801344/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 1352/448 e 10 to 0 dl 1773851815 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111597530610688'
00002000:00000001:28.0:1773851876.616786:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:28.0:1773851876.616786:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851876.616786:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000020:00000040:24.0:1773851876.616786:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006cbabb3d refcount=3
00000020:00000001:24.0:1773851876.616786:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092163019200 : -106981546532416 : ffff9eb36aebe1c0)
00000400:00000200:15.0:1773851876.616786:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4184 into portal 13 MB=0x69b4c3dda9800
00000100:00000010:11.0:1773851876.616786:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf80be40.
00000100:00000040:11.0:1773851876.616786:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000cf80be40 x1859601620446464 msgsize 488
00000100:00000001:28.0:1773851876.616787:0:61389:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:26.0:1773851876.616787:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:25.0:1773851876.616787:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00010000:00000001:24.0:1773851876.616787:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637092163019200 : -106981546532416 : ffff9eb36aebe1c0)
00000400:00000200:15.0:1773851876.616787:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4184/4184 into md 0x82a21912d [128] + 99000
00002000:00000001:13.0:1773851876.616787:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.616787:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ac347a5f with x1859601618797184
00000100:00000001:10.0:1773851876.616787:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000010:28.0:1773851876.616788:0:61389:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000800:00000200:25.0:1773851876.616788:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00010000:00000001:24.0:1773851876.616788:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.616788:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:13.0:1773851876.616788:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.616788:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:11.0:1773851876.616788:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:10.0:1773851876.616788:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:28.0:1773851876.616789:0:61389:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000400:00000200:26.0:1773851876.616789:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000800:00000200:25.0:1773851876.616789:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:24.0:1773851876.616789:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.616789:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851876.616789:0:2513974:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 2 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4184 bytes in 2 frags
00000100:00000001:11.0:1773851876.616789:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:10.0:1773851876.616789:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.616789:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:28.0:1773851876.616790:0:61389:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001aa5c9b3.
00000020:00000040:28.0:1773851876.616790:0:61389:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00000001:24.0:1773851876.616790:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851876.616790:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000020:00000040:13.0:1773851876.616790:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e3a32d93 refcount=3
00000400:00000200:11.0:1773851876.616790:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00002000:00100000:10.0:1773851876.616790:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0x2c0c:0x0]  req@00000000ff9fbb21 x1859601617801344/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 1352/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:28.0:1773851876.616791:0:61389:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851876.616791:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:25.0:1773851876.616791:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851876.616791:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:13.0:1773851876.616791:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637022437041152 : -107051272510464 : ffff9ea32eede400)
00000100:00000001:27.0:1773851876.616792:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851876.616792:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:15.0:1773851876.616792:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 2 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000800:00000200:14.0:1773851876.616792:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:13.0:1773851876.616792:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637022437041152 : -107051272510464 : ffff9ea32eede400)
00010000:00000001:13.0:1773851876.616792:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000800:00000200:11.0:1773851876.616792:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000010:27.0:1773851876.616793:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000065f48b03.
00000400:00000200:25.0:1773851876.616793:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00010000:00000001:13.0:1773851876.616793:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616793:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616793:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000040:27.0:1773851876.616794:0:2464256:0:(events.c:358:request_in_callback()) incoming req@0000000065f48b03 x1859601620124480 msgsize 488
00000800:00000200:26.0:1773851876.616794:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1239 TN_EVENT_TX_OK event status 0
00000800:00000200:15.0:1773851876.616794:0:2513974:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 2 tmk 0 trr 0 tta 0x1233 Using peer 22352@kfi7(0x1233)
00002000:00000001:13.0:1773851876.616794:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616794:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.616794:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ff9fbb21 with x1859601617801344
00010000:00000001:10.0:1773851876.616794:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:25.0:1773851876.616795:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22353@kfi7 : PUT - for me
00000800:00000200:14.0:1773851876.616795:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:10.0:1773851876.616795:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616795:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ca9f2c27 refcount=3
00000100:00100000:27.0:1773851876.616796:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000100:00000001:27.0:1773851876.616796:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:26.0:1773851876.616796:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1239 Transaction freed
00000400:00000200:25.0:1773851876.616796:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:10.0:1773851876.616796:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092081939968 : -106981627611648 : ffff9eb36616b600)
00000400:00000200:25.0:1773851876.616797:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000400:00000200:14.0:1773851876.616797:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:10.0:1773851876.616797:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637092081939968 : -106981627611648 : ffff9eb36616b600)
00010000:00000001:10.0:1773851876.616797:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:25.0:1773851876.616798:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:14.0:1773851876.616798:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00010000:00000001:10.0:1773851876.616798:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.616798:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:25.0:1773851876.616799:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000400:00000200:25.0:1773851876.616799:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000800:00000200:15.0:1773851876.616799:0:2513974:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:3 TN 0000000056f9fe8f: Posted read of 4184 bytes in 2 frags kp 22352@kfi7(000000000fcd3eb6) rma_iov.key 2293762: rc=0
00000400:00000200:14.0:1773851876.616799:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:10.0:1773851876.616799:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851876.616800:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000003d26ec3f x1859601617825728/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2360/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:14.0:1773851876.616800:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:27.0:1773851876.616801:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000800:00000200:15.0:1773851876.616801:0:2513974:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 2 tmk 0 trr 0 tta 0x1233 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000400:00000200:14.0:1773851876.616801:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616801:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000800:00000200:27.0:1773851876.616802:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851876.616802:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616802:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000400:00000200:25.0:1773851876.616803:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2912 into portal 13 MB=0x69b4c3dda6800
00000100:00080000:24.1:1773851876.616803:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000000549bd07 x1859601617825728/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:642/0 lens 2360/0 e 4 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:14.0:1773851876.616803:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:25.0:1773851876.616804:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2912/2912 into md 0x1614fbabf9 [128] + 198016
00000100:00000001:24.0:1773851876.616806:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:14.0:1773851876.616806:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2968 into portal 13 MB=0x69b4c3ddaac00
00000800:00000200:9.0:1773851876.616806:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:24.0:1773851876.616807:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:14.0:1773851876.616807:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2968/2968 into md 0x82a21912d [128] + 103184
00000100:00080000:13.1:1773851876.616807:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000ac347a5f x1859601618797184/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:248/0 lens 488/0 e 0 to 0 dl 1773852363 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:9.0:1773851876.616807:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851876.616808:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851876.616808:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851876.616808:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:9.0:1773851876.616808:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.616809:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00100000:24.0:1773851876.616809:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028973:0x2a13:0x0]  req@000000003d26ec3f x1859601617825728/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2360/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:14.0:1773851876.616809:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00080000:13.1:1773851876.616809:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000058fe9bdc x1859601618797184/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:602/0 lens 488/0 e 1 to 0 dl 1773851962 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:25.0:1773851876.616810:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22353@kfi7: PUT: OK
00000800:00000200:9.0:1773851876.616810:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:25.0:1773851876.616811:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851876.616811:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:14.0:1773851876.616811:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000010:25.0:1773851876.616812:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001dc89cc3.
00002000:00000001:24.0:1773851876.616812:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.616812:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003d26ec3f with x1859601617825728
00000400:00000200:14.0:1773851876.616812:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000100:00000001:13.0:1773851876.616812:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.616812:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851876.616812:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000040:25.0:1773851876.616813:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000001dc89cc3 x1859601617807360 msgsize 2912
00010000:00000001:24.0:1773851876.616813:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.616813:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:14.0:1773851876.616813:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:13.0:1773851876.616813:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:10.0:1773851876.616813:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.616813:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000400:00000200:9.0:1773851876.616813:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000400:00000200:9.0:1773851876.616813:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000040:24.0:1773851876.616814:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006cbabb3d refcount=3
00000100:00000200:14.0:1773851876.616814:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:13.0:1773851876.616814:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.616814:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:10.0:1773851876.616814:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000400:00000200:9.0:1773851876.616814:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000100:00100000:25.0:1773851876.616815:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000100:00000001:25.0:1773851876.616815:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000010:14.0:1773851876.616815:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a57ea628.
00000100:00000040:14.0:1773851876.616815:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000a57ea628 x1859601617824768 msgsize 2968
00002000:00100000:13.0:1773851876.616815:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240027894:0x311a:0x0]  req@00000000ac347a5f x1859601618797184/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:248/0 lens 488/0 e 0 to 0 dl 1773852363 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:10.0:1773851876.616815:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000400:00000200:9.0:1773851876.616815:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:25.0:1773851876.616816:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000800:00000200:15.0:1773851876.616816:0:2513974:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 2 tmk 0 trr 0 tta 0x1233 TN_EVENT_TAG_TX_OK event status 0
00000100:00000001:10.0:1773851876.616816:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851876.616816:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:24.0:1773851876.616817:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092163019200 : -106981546532416 : ffff9eb36aebe1c0)
00000100:00100000:14.0:1773851876.616817:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:10.0:1773851876.616817:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851876.616817:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000200:9.0:1773851876.616817:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:25.0:1773851876.616818:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00010000:00000001:24.0:1773851876.616818:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637092163019200 : -106981546532416 : ffff9eb36aebe1c0)
00000400:00000200:15.0:1773851876.616818:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851876.616818:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:13.0:1773851876.616818:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.616818:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ac347a5f with x1859601618797184
02000000:00000001:10.0:1773851876.616818:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.616818:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851876.616818:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3dea3000
00010000:00000001:24.0:1773851876.616819:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.616819:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:15.0:1773851876.616819:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000400:00000200:14.0:1773851876.616819:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00010000:00000001:13.0:1773851876.616819:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:10.0:1773851876.616819:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.616819:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.616820:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.616820:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.616820:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851876.616820:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:14.0:1773851876.616820:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000020:00000001:13.0:1773851876.616820:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616820:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e3a32d93 refcount=3
00000100:00100000:10.0:1773851876.616820:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617823616
00000400:00000200:9.0:1773851876.616820:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 116752
00000100:00000001:24.0:1773851876.616821:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851876.616821:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000100:00000010:15.0:1773851876.616821:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bdcadfa4.
00000020:00000001:13.0:1773851876.616821:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637022437041152 : -107051272510464 : ffff9ea32eede400)
00010000:00000001:13.0:1773851876.616821:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637022437041152 : -107051272510464 : ffff9ea32eede400)
00000020:00000001:10.0:1773851876.616821:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.616821:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000010:24.0:1773851876.616822:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000100:00000040:15.0:1773851876.616822:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000bdcadfa4 x1859601617819648 msgsize 4184
00010000:00000001:13.0:1773851876.616822:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:10.0:1773851876.616822:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616822:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000800:00000200:9.0:1773851876.616822:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:24.0:1773851876.616823:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00010000:00000001:13.0:1773851876.616823:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616823:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:10.0:1773851876.616823:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000040:24.0:1773851876.616824:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00100000:15.0:1773851876.616824:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:15.0:1773851876.616824:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:13.0:1773851876.616824:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616824:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:10.0:1773851876.616824:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.616824:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:9.0:1773851876.616824:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:24.0:1773851876.616825:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851876.616825:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000010:13.0:1773851876.616825:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000001:10.0:1773851876.616825:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.616825:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000400:00000200:9.0:1773851876.616825:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000100:00000001:24.0:1773851876.616826:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.616826:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:13.0:1773851876.616826:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:10.0:1773851876.616826:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000100:00000001:9.0:1773851876.616826:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:24.0:1773851876.616827:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.616827:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851876.616827:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 2 tmk 0 trr 0 tta 0x1233 Transaction freed
00000020:00000010:13.0:1773851876.616827:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000010:10.0:1773851876.616827:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000100:00000200:9.0:1773851876.616827:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
02000000:00000001:24.0:1773851876.616828:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.616828:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000100:00000001:10.0:1773851876.616828:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000010:9.0:1773851876.616828:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c66a90dc.
00000100:00000040:9.0:1773851876.616828:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c66a90dc x1859601618841600 msgsize 488
00000100:00100000:24.0:1773851876.616829:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618153216
00000020:00000001:24.0:1773851876.616829:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:13.0:1773851876.616829:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.616829:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.616829:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000040:24.0:1773851876.616830:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:13.0:1773851876.616830:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:10.0:1773851876.616830:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.616830:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000100:00100000:9.0:1773851876.616830:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000020:00000001:24.0:1773851876.616831:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.616831:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
02000000:00000001:13.0:1773851876.616831:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.616831:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:10.0:1773851876.616831:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:9.0:1773851876.616831:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:24.0:1773851876.616832:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.616832:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616832:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.616832:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000400:00000200:9.0:1773851876.616832:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:24.0:1773851876.616833:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
02000000:00000001:13.0:1773851876.616833:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851876.616833:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617865856
00000020:00000001:10.0:1773851876.616833:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.616833:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000800:00000200:9.0:1773851876.616833:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851876.616834:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.616834:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:13.0:1773851876.616834:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.616834:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000001:00000001:10.0:1773851876.616834:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.616834:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000010:24.0:1773851876.616835:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.616835:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616835:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000001:00000001:10.0:1773851876.616835:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.616835:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000010:24.0:1773851876.616836:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851876.616836:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.616836:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.616836:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.616836:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616836:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.616837:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:13.0:1773851876.616837:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.616837:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:24.0:1773851876.616838:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.616838:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000100:00000001:13.0:1773851876.616838:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.616838:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:10.0:1773851876.616838:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616838:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.616839:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.616839:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000010:13.0:1773851876.616839:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.616839:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616839:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.616840:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000010:13.0:1773851876.616840:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.616840:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.616841:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000010:13.0:1773851876.616841:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00002000:00000001:10.0:1773851876.616841:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:10.0:1773851876.616841:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x2400278bf:0x62f6:0x0]  req@000000004aefacb6 x1859601617823616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2400/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.616842:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.616842:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.616843:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851876.616843:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616843:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.616843:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000001:00000001:24.0:1773851876.616844:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:13.0:1773851876.616844:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.616844:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.616844:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000001:00000001:24.0:1773851876.616845:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.616845:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000001:00000001:24.0:1773851876.616846:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.616846:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.616846:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.616846:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000001:00000001:24.0:1773851876.616847:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.616847:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616847:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616847:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:24.0:1773851876.616848:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851876.616848:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616848:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.616849:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616849:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616849:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00000001:10.0:1773851876.616849:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000001:24.0:1773851876.616850:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.616850:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000001:00000001:13.0:1773851876.616850:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616850:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00100000:10.0:1773851876.616850:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000004aefacb6 with x1859601617823616
00010000:00000001:10.0:1773851876.616850:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.616851:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616851:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616851:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616851:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:24.0:1773851876.616852:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:13.0:1773851876.616852:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.616852:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:24.0:1773851876.616853:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024e21:0x3485:0x0]  req@00000000eb28bb44 x1859601618153216/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:13.0:1773851876.616853:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616854:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.616854:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000040:10.0:1773851876.616854:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000191b446c refcount=3
00000020:00000001:13.0:1773851876.616855:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.616855:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.616855:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637129323763328 : -106944385788288 : ffff9ebc11dfd680)
00002000:00000001:24.0:1773851876.616856:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.616856:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240024ae9:0x9c06:0x0]  req@00000000c5120167 x1859601617865856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4320/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.616856:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637129323763328 : -106944385788288 : ffff9ebc11dfd680)
00010000:00000001:10.0:1773851876.616857:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.616857:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00100000:24.0:1773851876.616858:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000eb28bb44 with x1859601618153216
00010000:00000001:24.0:1773851876.616858:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00002000:00000001:10.0:1773851876.616858:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616858:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.616859:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.616859:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000025544ab8 refcount=3
00002000:00000001:13.0:1773851876.616859:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:10.0:1773851876.616859:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.616860:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111777834496 : -106961931717120 : ffff9eb7fc0e3600)
00002000:00100000:13.0:1773851876.616860:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c5120167 with x1859601617865856
00010000:00000001:13.0:1773851876.616860:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00010000:00000001:24.0:1773851876.616861:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637111777834496 : -106961931717120 : ffff9eb7fc0e3600)
00000020:00000001:13.0:1773851876.616861:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:10.1:1773851876.616861:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000004aefacb6 x1859601617823616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2400/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:24.0:1773851876.616862:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.616862:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.616863:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.616863:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:10.1:1773851876.616863:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000006736143b x1859601617823616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:637/0 lens 2400/0 e 4 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:24.0:1773851876.616864:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.616865:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000710b9df refcount=3
00000020:00000001:13.0:1773851876.616866:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962483606592 : -107111225945024 : ffff9e95396d1440)
00000100:00000001:10.0:1773851876.616866:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00080000:24.1:1773851876.616867:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000eb28bb44 x1859601618153216/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.616867:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962483606592 : -107111225945024 : ffff9e95396d1440)
00000100:00000001:10.0:1773851876.616867:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00010000:00000001:13.0:1773851876.616868:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.616868:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:10.0:1773851876.616868:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.616868:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:13.0:1773851876.616869:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.616869:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.616869:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x2400278bf:0x62f6:0x0]  req@000000004aefacb6 x1859601617823616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2400/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:24.1:1773851876.616870:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000f96039c8 x1859601618153216/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 488/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.616870:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.616870:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851876.616871:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00002000:00000001:10.0:1773851876.616872:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.616872:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000004aefacb6 with x1859601617823616
00000800:00000200:9.0:1773851876.616872:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851876.616873:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851876.616873:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00010000:00000001:10.0:1773851876.616873:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.616873:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616873:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000191b446c refcount=3
00000100:00000001:24.0:1773851876.616874:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00080000:13.1:1773851876.616874:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000c5120167 x1859601617865856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4320/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:10.0:1773851876.616874:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637129323763328 : -106944385788288 : ffff9ebc11dfd680)
00000800:00000200:9.0:1773851876.616874:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00002000:00000001:24.0:1773851876.616875:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:10.0:1773851876.616875:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637129323763328 : -106944385788288 : ffff9ebc11dfd680)
00002000:00100000:24.0:1773851876.616876:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024e21:0x3485:0x0]  req@00000000eb28bb44 x1859601618153216/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:13.1:1773851876.616876:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000d448e632 x1859601617865856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:724/0 lens 4320/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.616876:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.616876:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:9.0:1773851876.616876:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00002000:00000001:10.0:1773851876.616877:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616877:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616877:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000400:00000200:9.0:1773851876.616878:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00002000:00000001:24.0:1773851876.616879:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.616879:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000eb28bb44 with x1859601618153216
00000400:00000200:9.0:1773851876.616879:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000400:00000200:9.0:1773851876.616879:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00010000:00000001:24.0:1773851876.616880:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.616880:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.616880:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.616880:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:10.0:1773851876.616880:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.616880:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000400:00000200:9.0:1773851876.616880:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000040:24.0:1773851876.616881:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000025544ab8 refcount=3
00000020:00000001:24.0:1773851876.616881:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111777834496 : -106961931717120 : ffff9eb7fc0e3600)
00000100:00000001:13.0:1773851876.616881:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851876.616881:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00010000:00000001:24.0:1773851876.616882:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637111777834496 : -106961931717120 : ffff9eb7fc0e3600)
00002000:00000001:13.0:1773851876.616882:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:10.0:1773851876.616882:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000010:10.0:1773851876.616882:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000400:00000200:9.0:1773851876.616882:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:9.0:1773851876.616882:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 1616 into portal 13 MB=0x69b4c3ddb4640
00010000:00000001:24.0:1773851876.616883:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00100000:13.0:1773851876.616883:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240024ae9:0x9c06:0x0]  req@00000000c5120167 x1859601617865856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4320/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:10.0:1773851876.616883:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00010000:00000001:24.0:1773851876.616884:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.616884:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:10.0:1773851876.616884:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851876.616884:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 1616/1616 into md 0x7813a3b29 [128] + 117240
00002000:00000001:24.0:1773851876.616885:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.616885:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00002000:00000001:13.0:1773851876.616885:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:10.0:1773851876.616885:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.616885:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:24.0:1773851876.616886:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00002000:00100000:13.0:1773851876.616886:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c5120167 with x1859601617865856
00010000:00000001:13.0:1773851876.616886:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:10.0:1773851876.616886:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.616886:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.616886:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:24.0:1773851876.616887:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
02000000:00000001:10.0:1773851876.616887:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616887:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:24.0:1773851876.616888:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.616888:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616888:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000710b9df refcount=3
00000100:00100000:10.0:1773851876.616888:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618560128
00000020:00000001:10.0:1773851876.616888:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.616888:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:9.0:1773851876.616888:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000020:00000040:24.0:1773851876.616889:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000100:00000001:24.0:1773851876.616889:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:13.0:1773851876.616889:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962483606592 : -107111225945024 : ffff9e95396d1440)
00010000:00000001:13.0:1773851876.616889:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636962483606592 : -107111225945024 : ffff9e95396d1440)
00000020:00000001:10.0:1773851876.616889:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:9.0:1773851876.616889:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851876.616889:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00010000:00000001:13.0:1773851876.616890:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000040:10.0:1773851876.616890:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000001:10.0:1773851876.616890:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000010:9.0:1773851876.616890:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000082b7098b.
00010000:00000001:13.0:1773851876.616891:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616891:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:10.0:1773851876.616891:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000040:9.0:1773851876.616891:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000082b7098b x1859601617864256 msgsize 1616
00002000:00000001:13.0:1773851876.616892:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616892:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851876.616892:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.616892:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851876.616892:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:9.0:1773851876.616892:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:24.0:1773851876.616893:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000010:13.0:1773851876.616893:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:10.0:1773851876.616893:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000400:00000200:9.0:1773851876.616893:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000800:00000200:25.0:1773851876.616894:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
02000000:00000001:24.0:1773851876.616894:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.616894:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000010:13.0:1773851876.616894:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:10.0:1773851876.616894:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000800:00000200:26.0:1773851876.616895:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851876.616895:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851876.616895:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:24.0:1773851876.616895:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851876.616895:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000040:13.0:1773851876.616895:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000020:00000010:10.0:1773851876.616895:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000100:00000001:10.0:1773851876.616895:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000800:00000200:9.0:1773851876.616895:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851876.616896:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851876.616896:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617887168
00000100:00000001:13.0:1773851876.616896:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.616896:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.616896:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000800:00000200:26.0:1773851876.616897:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851876.616897:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:24.0:1773851876.616897:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.616897:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:13.0:1773851876.616897:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:10.0:1773851876.616897:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.616897:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000001:24.0:1773851876.616898:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
02000000:00000001:13.0:1773851876.616898:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.616898:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:10.0:1773851876.616898:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000800:00000200:26.0:1773851876.616899:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851876.616899:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:24.0:1773851876.616899:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000001:24.0:1773851876.616899:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.616899:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851876.616899:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616899:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.616899:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.616900:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00100000:13.0:1773851876.616900:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617824768
00000020:00000001:10.0:1773851876.616900:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.616901:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00000001:24.0:1773851876.616901:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.616901:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:13.0:1773851876.616901:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.616901:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000001:00000001:10.0:1773851876.616901:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.616901:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851876.616902:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.616902:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.616902:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616902:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000001:00000001:10.0:1773851876.616902:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616902:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:9.0:1773851876.616902:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:26.0:1773851876.616903:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000400:00000200:25.0:1773851876.616903:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000020:00000010:24.0:1773851876.616903:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000001:13.0:1773851876.616903:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.616903:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616903:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:9.0:1773851876.616903:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:26.0:1773851876.616904:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.616904:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.616904:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.616904:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000001:00000001:10.0:1773851876.616904:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616904:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.616904:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851876.616905:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 1
00000400:00000200:26.0:1773851876.616905:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00000001:24.0:1773851876.616905:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.616905:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851876.616905:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851876.616905:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.616905:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:26.0:1773851876.616906:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000020:00000001:24.0:1773851876.616906:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.616906:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000010:13.0:1773851876.616906:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.616906:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616906:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.616906:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851876.616907:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:26.0:1773851876.616907:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:24.0:1773851876.616907:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000010:13.0:1773851876.616907:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000020:00000001:10.0:1773851876.616907:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616907:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000800:00000200:29.0:1773851876.616908:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:24.0:1773851876.616908:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.616908:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000100:00000001:13.0:1773851876.616908:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:10.0:1773851876.616908:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616908:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:25.0:1773851876.616909:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.616909:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000020:00000001:24.0:1773851876.616909:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.616909:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616909:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.616909:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00002000:00000001:10.0:1773851876.616909:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:9.0:1773851876.616909:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000800:00000200:29.0:1773851876.616910:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:24.0:1773851876.616910:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:13.0:1773851876.616910:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00002000:00100000:10.0:1773851876.616910:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x2400249e4:0xb103:0x0]  req@000000006b3e2ace x1859601618560128/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616910:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:25.0:1773851876.616911:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000001:00000001:24.0:1773851876.616911:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.616911:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:13.0:1773851876.616911:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:13.0:1773851876.616911:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:9.0:1773851876.616911:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000800:00000200:29.0:1773851876.616912:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851876.616912:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000001:00000001:24.0:1773851876.616912:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.616912:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:13.0:1773851876.616912:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.616912:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00002000:00000001:10.0:1773851876.616912:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:9.0:1773851876.616912:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:25.0:1773851876.616913:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000001:00000001:24.0:1773851876.616913:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.616913:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:13.0:1773851876.616913:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616913:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000800:00000200:11.0:1773851876.616913:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00002000:00100000:10.0:1773851876.616913:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000006b3e2ace with x1859601618560128
00000400:00000200:9.0:1773851876.616913:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000400:00000200:29.0:1773851876.616914:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:26.0:1773851876.616914:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:24.0:1773851876.616914:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.616914:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000001:00000001:13.0:1773851876.616914:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851876.616914:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00010000:00000001:10.0:1773851876.616914:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.616914:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:9.0:1773851876.616914:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000400:00000200:29.0:1773851876.616915:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22416@kfi7 : PUT - for me
00000400:00000200:26.0:1773851876.616915:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2640 into portal 13 MB=0x69b4c3dda9a40
00000020:00000001:24.0:1773851876.616915:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616915:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616915:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000040:10.0:1773851876.616915:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c5c87428 refcount=3
00000400:00000200:25.0:1773851876.616916:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:24.0:1773851876.616916:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.616916:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616916:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616916:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:11.0:1773851876.616916:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:10.0:1773851876.616916:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104776629056 : -106968932922560 : ffff9eb65ac04b40)
00010000:00000001:10.0:1773851876.616916:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104776629056 : -106968932922560 : ffff9eb65ac04b40)
00000400:00000200:9.0:1773851876.616916:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:29.0:1773851876.616917:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:26.0:1773851876.616917:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2640/2640 into md 0x1614fbabf9 [128] + 200928
00000400:00000200:25.0:1773851876.616917:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3df63000
00002000:00000001:24.0:1773851876.616917:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000001:00000001:13.0:1773851876.616917:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616917:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.616917:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:9.0:1773851876.616917:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3de983c0
00000400:00000200:29.0:1773851876.616918:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000020:00000001:24.0:1773851876.616918:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.616918:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:13.0:1773851876.616918:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.616918:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851876.616918:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00010000:00000001:10.0:1773851876.616918:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.616918:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:29.0:1773851876.616919:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000800:00000200:26.0:1773851876.616919:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.616919:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 203568
00002000:00100000:24.0:1773851876.616919:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028ca0:0x867e:0x0]  req@00000000adc21199 x1859601617887168/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3128/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:14.0:1773851876.616919:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000020:00000001:13.0:1773851876.616919:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616919:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616919:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.616919:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616919:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 118856
00000400:00000200:29.0:1773851876.616920:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000800:00000200:14.0:1773851876.616920:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00002000:00000001:13.0:1773851876.616920:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000400:00000200:11.0:1773851876.616920:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:29.0:1773851876.616921:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000400:00000200:26.0:1773851876.616921:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851876.616921:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:13.0:1773851876.616921:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.616921:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:10.1:1773851876.616921:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000006b3e2ace x1859601618560128/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:9.0:1773851876.616921:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851876.616922:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:25.0:1773851876.616922:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00000001:24.0:1773851876.616922:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.616922:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000adc21199 with x1859601617887168
00000800:00000200:14.0:1773851876.616922:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00100000:13.0:1773851876.616922:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240023430:0x1a8e6:0x0]  req@00000000a57ea628 x1859601617824768/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2968/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:11.0:1773851876.616922:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000400:00000200:29.0:1773851876.616923:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 1672 into portal 13 MB=0x69b4c3ddb1b00
00000400:00000200:26.0:1773851876.616923:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00010000:00000001:24.0:1773851876.616923:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:11.0:1773851876.616923:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.616923:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851876.616924:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 1672/1672 into md 0x77fdd4a5d [128] + 121352
00000100:00000001:26.0:1773851876.616924:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851876.616924:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:25.0:1773851876.616924:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000020:00000001:24.0:1773851876.616924:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:14.0:1773851876.616924:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:11.0:1773851876.616924:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000100:00080000:10.1:1773851876.616924:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000009800f135 x1859601618560128/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:679/0 lens 488/0 e 10 to 0 dl 1773852039 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:9.0:1773851876.616924:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000100:00000010:26.0:1773851876.616925:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003d57fa12.
00000100:00000040:26.0:1773851876.616925:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000003d57fa12 x1859601617820224 msgsize 2640
00002000:00000001:13.0:1773851876.616925:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:11.0:1773851876.616925:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:11.0:1773851876.616925:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000100:00000001:9.0:1773851876.616925:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:29.0:1773851876.616926:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851876.616926:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00100000:13.0:1773851876.616926:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000a57ea628 with x1859601617824768
00010000:00000001:13.0:1773851876.616926:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:11.0:1773851876.616926:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000100:00000200:9.0:1773851876.616926:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000040:24.0:1773851876.616927:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003e3583f1 refcount=3
00000400:00000200:14.0:1773851876.616927:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000020:00000001:13.0:1773851876.616927:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.616927:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000010:9.0:1773851876.616927:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e18e2448.
00000100:00000040:9.0:1773851876.616927:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e18e2448 x1859601618797504 msgsize 488
00000400:00000200:29.0:1773851876.616928:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:26.0:1773851876.616928:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000020:00000001:24.0:1773851876.616928:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064436632960 : -107009272918656 : ffff9eacf64ccd80)
00000400:00000200:14.0:1773851876.616928:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:11.0:1773851876.616928:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:10.0:1773851876.616928:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:29.0:1773851876.616929:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22416@kfi7: PUT: OK
00000100:00000001:26.0:1773851876.616929:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000001:24.0:1773851876.616929:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637064436632960 : -107009272918656 : ffff9eacf64ccd80)
00000400:00000200:11.0:1773851876.616929:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3dda6180
00000100:00000001:10.0:1773851876.616929:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.616929:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00100000:9.0:1773851876.616929:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:29.0:1773851876.616930:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:26.0:1773851876.616930:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000400:00000200:11.0:1773851876.616930:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 119344
00002000:00100000:10.0:1773851876.616930:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x2400249e4:0xb103:0x0]  req@000000006b3e2ace x1859601618560128/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:9.0:1773851876.616930:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000200:29.0:1773851876.616931:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:26.0:1773851876.616931:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851876.616931:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:24.0:1773851876.616931:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:14.0:1773851876.616931:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000020:00000040:13.0:1773851876.616931:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000062c4bfc0 refcount=3
00000020:00000001:13.0:1773851876.616931:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636983364177856 : -107090345373760 : ffff9e9a16014fc0)
00000100:00000010:29.0:1773851876.616932:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ad7ec7b.
00000100:00000040:29.0:1773851876.616932:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000002ad7ec7b x1859601617853184 msgsize 1672
00000100:00000200:25.0:1773851876.616932:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00010000:00000001:24.0:1773851876.616932:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.616932:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:14.0:1773851876.616932:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.616932:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00010000:00000001:13.0:1773851876.616932:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636983364177856 : -107090345373760 : ffff9e9a16014fc0)
00000800:00000200:11.0:1773851876.616932:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:10.0:1773851876.616932:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:9.0:1773851876.616932:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000100:00000010:25.0:1773851876.616933:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ff44480f.
00000100:00000040:25.0:1773851876.616933:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ff44480f x1859601619628032 msgsize 488
00002000:00000001:24.0:1773851876.616933:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.616933:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.616933:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00010000:00000001:13.0:1773851876.616933:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.616933:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00100000:10.0:1773851876.616933:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000006b3e2ace with x1859601618560128
00010000:00000001:10.0:1773851876.616933:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000800:00000200:9.0:1773851876.616933:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00100000:29.0:1773851876.616934:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000400:00000200:14.0:1773851876.616934:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:13.0:1773851876.616934:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.616934:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616934:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:10.0:1773851876.616934:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:29.0:1773851876.616935:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00100000:25.0:1773851876.616935:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000100:00080000:24.1:1773851876.616935:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000adc21199 x1859601617887168/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3128/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:14.0:1773851876.616935:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3de5f380
00000100:00000001:13.0:1773851876.616935:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.616935:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000020:00000040:10.0:1773851876.616935:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c5c87428 refcount=3
00000020:00000001:10.0:1773851876.616935:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104776629056 : -106968932922560 : ffff9eb65ac04b40)
00000400:00000200:29.0:1773851876.616936:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00000001:25.0:1773851876.616936:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851876.616936:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851876.616936:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00010000:00000001:10.0:1773851876.616936:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104776629056 : -106968932922560 : ffff9eb65ac04b40)
00000800:00000200:9.0:1773851876.616936:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.616937:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851876.616937:0:61389:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851876.616937:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000400:00000200:14.0:1773851876.616937:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x82a21912d [128] + 106152
00000100:00000010:11.0:1773851876.616937:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ace9a970.
00010000:00000001:10.0:1773851876.616937:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.616937:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:9.0:1773851876.616937:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
02000000:00000001:28.0:1773851876.616938:0:61389:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851876.616938:0:61389:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851876.616938:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00080000:24.1:1773851876.616938:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000014c36fd9 x1859601617887168/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 3128/0 e 2 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000040:11.0:1773851876.616938:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000ace9a970 x1859601617805696 msgsize 488
00002000:00000001:10.0:1773851876.616938:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.616938:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851876.616938:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:28.0:1773851876.616939:0:61389:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851876.616940:0:61389:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851876.616940:0:61389:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617853184
00000800:00000200:14.0:1773851876.616940:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:11.0:1773851876.616940:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:11.0:1773851876.616940:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851876.616940:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:28.0:1773851876.616941:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851876.616941:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:24.0:1773851876.616941:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:11.0:1773851876.616941:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:28.0:1773851876.616942:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851876.616942:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000100:00000001:24.0:1773851876.616942:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851876.616942:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:14.0:1773851876.616942:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.616942:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:28.0:1773851876.616943:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00000001:24.0:1773851876.616943:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:14.0:1773851876.616943:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000100:00080000:13.1:1773851876.616943:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000a57ea628 x1859601617824768/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2968/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:11.0:1773851876.616943:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:9.0:1773851876.616943:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000020:00000001:28.0:1773851876.616944:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00100000:24.0:1773851876.616944:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028ca0:0x867e:0x0]  req@00000000adc21199 x1859601617887168/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3128/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:14.0:1773851876.616944:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.616944:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:9.0:1773851876.616944:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:28.0:1773851876.616945:0:61389:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851876.616945:0:61389:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851876.616945:0:61389:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001aa5c9b3.
00000100:00000010:14.0:1773851876.616945:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c7f354c1.
00000400:00000200:9.0:1773851876.616945:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000020:00000010:28.0:1773851876.616946:0:61389:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000100:00000040:14.0:1773851876.616946:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000c7f354c1 x1859601618563968 msgsize 488
00000100:00080000:13.1:1773851876.616946:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000ff493993 x1859601617824768/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:637/0 lens 2968/0 e 4 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:11.0:1773851876.616946:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851876.616946:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851876.616946:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000010:28.0:1773851876.616947:0:61389:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00002000:00000001:24.0:1773851876.616947:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.616947:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000adc21199 with x1859601617887168
00000100:00100000:14.0:1773851876.616947:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000800:00000200:11.0:1773851876.616947:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851876.616947:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000400:00000200:9.0:1773851876.616947:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000100:00000001:28.0:1773851876.616948:0:61389:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00010000:00000001:24.0:1773851876.616948:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.616948:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.616948:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003e3583f1 refcount=3
00000100:00000001:14.0:1773851876.616948:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:13.0:1773851876.616948:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.616948:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851876.616948:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:28.0:1773851876.616949:0:61389:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:28.0:1773851876.616949:0:61389:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.616949:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064436632960 : -107009272918656 : ffff9eacf64ccd80)
00000400:00000200:14.0:1773851876.616949:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000100:00000001:13.0:1773851876.616949:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:11.0:1773851876.616949:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:10.0:1773851876.616949:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.616949:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000400:00000200:9.0:1773851876.616949:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 1760 into portal 13 MB=0x69b4c3dda6f40
00000020:00000001:28.0:1773851876.616950:0:61389:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851876.616950:0:61389:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00010000:00000001:24.0:1773851876.616950:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637064436632960 : -107009272918656 : ffff9eacf64ccd80)
00000800:00000200:14.0:1773851876.616950:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:13.0:1773851876.616950:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:10.0:1773851876.616950:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000400:00000200:9.0:1773851876.616950:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 1760/1760 into md 0x7813a3b29 [128] + 119832
00000020:00000001:28.0:1773851876.616951:0:61389:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00010000:00000001:24.0:1773851876.616951:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.616951:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.616951:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:11.0:1773851876.616951:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000040:10.0:1773851876.616951:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000020:00000001:28.0:1773851876.616952:0:61389:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00002000:00000001:24.0:1773851876.616952:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.616952:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:13.0:1773851876.616952:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240023430:0x1a8e6:0x0]  req@00000000a57ea628 x1859601617824768/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2968/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:11.0:1773851876.616952:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000100:00000001:10.0:1773851876.616952:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851876.616952:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:28.0:1773851876.616953:0:61389:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:28.0:1773851876.616953:0:61389:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.616953:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851876.616953:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:11.0:1773851876.616953:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:11.0:1773851876.616953:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000100:00000001:10.0:1773851876.616953:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.616953:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000001:00000001:28.0:1773851876.616954:0:61389:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:28.0:1773851876.616954:0:61389:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.616954:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00002000:00000001:13.0:1773851876.616954:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:11.0:1773851876.616954:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:10.0:1773851876.616954:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.616954:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616954:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:28.0:1773851876.616955:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616955:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000010:24.0:1773851876.616955:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00002000:00100000:13.0:1773851876.616955:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000a57ea628 with x1859601617824768
00000400:00000200:11.0:1773851876.616955:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
02000000:00000001:10.0:1773851876.616955:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.616955:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000001:00000001:28.0:1773851876.616956:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616956:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000040:24.0:1773851876.616956:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:24.0:1773851876.616956:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851876.616956:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.616956:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:11.0:1773851876.616956:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 5
00000100:00100000:10.0:1773851876.616956:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617801024
00000100:00000001:9.0:1773851876.616956:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851876.616956:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000001:00000001:28.0:1773851876.616957:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.616957:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.616957:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000062c4bfc0 refcount=3
00000020:00000001:13.0:1773851876.616957:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636983364177856 : -107090345373760 : ffff9e9a16014fc0)
00000400:00000200:11.0:1773851876.616957:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:10.0:1773851876.616957:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.616957:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000010:9.0:1773851876.616957:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000954463f0.
00000100:00000040:9.0:1773851876.616957:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000954463f0 x1859601617809216 msgsize 1760
00000020:00000001:28.0:1773851876.616958:0:61389:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:28.0:1773851876.616958:0:61389:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.616958:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636983364177856 : -107090345373760 : ffff9e9a16014fc0)
00000400:00000200:11.0:1773851876.616958:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3e006340
00000020:00000001:10.0:1773851876.616958:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.616958:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:28.0:1773851876.616959:0:61389:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.616959:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.616959:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:11.0:1773851876.616959:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 121592
00000020:00000001:10.0:1773851876.616959:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00100000:9.0:1773851876.616959:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:9.0:1773851876.616959:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:28.0:1773851876.616960:0:61389:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:28.0:1773851876.616960:0:61389:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00002000:00000001:13.0:1773851876.616960:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.616960:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851876.616960:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:10.0:1773851876.616960:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.616960:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:9.0:1773851876.616960:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000020:00000001:28.0:1773851876.616961:0:61389:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:28.0:1773851876.616961:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:24.0:1773851876.616961:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:13.0:1773851876.616961:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851876.616961:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.616961:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000800:00000200:9.0:1773851876.616961:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000800:00000200:26.0:1773851876.616962:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.616962:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
02000000:00000001:24.0:1773851876.616962:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.616962:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000010:13.0:1773851876.616962:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.616962:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000400:00000200:11.0:1773851876.616962:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:10.0:1773851876.616962:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00002000:00100000:28.0:1773851876.616963:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240028b4f:0x3aa5:0x0]  req@000000002ad7ec7b x1859601617853184/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1672/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:26.0:1773851876.616963:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851876.616963:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:24.0:1773851876.616963:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851876.616963:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000400:00000200:11.0:1773851876.616963:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000020:00000010:10.0:1773851876.616963:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000800:00000200:26.0:1773851876.616964:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851876.616964:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:24.0:1773851876.616964:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.616964:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:11.0:1773851876.616964:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851876.616964:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:10.0:1773851876.616964:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00100000:24.0:1773851876.616965:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617820032
00000020:00000001:24.0:1773851876.616965:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:13.0:1773851876.616965:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:11.0:1773851876.616965:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fcc0831a.
00000100:00000040:11.0:1773851876.616965:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000fcc0831a x1859601620296512 msgsize 488
00000100:00000001:10.0:1773851876.616965:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.616965:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00002000:00000001:28.0:1773851876.616966:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:28.0:1773851876.616966:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000002ad7ec7b with x1859601617853184
00000020:00000040:24.0:1773851876.616966:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:24.0:1773851876.616966:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.616966:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.616966:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:10.0:1773851876.616966:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00010000:00000001:28.0:1773851876.616967:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:28.0:1773851876.616967:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:26.0:1773851876.616967:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851876.616967:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:24.0:1773851876.616967:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:24.0:1773851876.616967:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.616967:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.616967:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851876.616967:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000020:00000001:10.0:1773851876.616967:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:10.0:1773851876.616967:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:26.0:1773851876.616968:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:24.0:1773851876.616968:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
02000000:00000001:13.0:1773851876.616968:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851876.616968:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617819648
00000100:00000001:11.0:1773851876.616968:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:11.0:1773851876.616968:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:10.0:1773851876.616968:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.616968:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000040:28.0:1773851876.616969:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000791ed8be refcount=3
00000400:00000200:25.0:1773851876.616969:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00000001:24.0:1773851876.616969:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.616969:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:13.0:1773851876.616969:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:10.0:1773851876.616969:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.616969:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:28.0:1773851876.616970:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637049226369216 : -107024483182400 : ffff9ea96bb298c0)
00000400:00000200:26.0:1773851876.616970:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000020:00000010:24.0:1773851876.616970:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000040:13.0:1773851876.616970:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000800:00000200:11.0:1773851876.616970:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000001:00000001:10.0:1773851876.616970:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851876.616971:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637049226369216 : -107024483182400 : ffff9ea96bb298c0)
00000400:00000200:26.0:1773851876.616971:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.616971:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000020:00000010:24.0:1773851876.616971:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000001:13.0:1773851876.616971:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.616971:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000001:00000001:10.0:1773851876.616971:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616971:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00010000:00000001:28.0:1773851876.616972:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851876.616972:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:28.0:1773851876.616972:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:26.0:1773851876.616972:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 1
00000020:00000010:24.0:1773851876.616972:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.616972:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.616972:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616972:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00000001:28.0:1773851876.616973:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851876.616973:0:61389:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.616973:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00000001:24.0:1773851876.616973:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.616973:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.616973:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.616973:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.616973:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.616973:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.616974:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000400:00000200:26.0:1773851876.616974:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:24.0:1773851876.616974:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:13.0:1773851876.616974:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.616974:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:10.0:1773851876.616974:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.616974:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851876.616975:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:24.0:1773851876.616975:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851876.616975:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000010:13.0:1773851876.616975:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.616975:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616975:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:28.1:1773851876.616976:0:61389:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000002ad7ec7b x1859601617853184/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1672/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:25.0:1773851876.616976:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000020:00000001:24.0:1773851876.616976:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851876.616976:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000010:13.0:1773851876.616976:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00002000:00000001:10.0:1773851876.616976:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000400:00000200:25.0:1773851876.616977:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.616977:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:24.0:1773851876.616977:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851876.616977:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000020:00000001:10.0:1773851876.616977:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.616977:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:25.0:1773851876.616978:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000001:00000001:24.0:1773851876.616978:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851876.616978:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.616978:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.616978:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00002000:00100000:10.0:1773851876.616978:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240026287:0x117d2:0x0]  req@0000000028eda8b2 x1859601617801024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 4584/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:28.1:1773851876.616979:0:61389:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000f737ebae x1859601617853184/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:693/0 lens 1672/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:26.0:1773851876.616979:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:24.0:1773851876.616979:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.616979:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.616979:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.616979:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:25.0:1773851876.616980:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:24.0:1773851876.616980:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.616980:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.616980:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:26.0:1773851876.616981:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2312 into portal 13 MB=0x69b4c3dda64c0
00000400:00000200:25.0:1773851876.616981:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3df19700
00000001:00000001:24.0:1773851876.616981:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.616981:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616981:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851876.616981:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00002000:00000001:10.0:1773851876.616981:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:28.0:1773851876.616982:0:61389:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:28.0:1773851876.616982:0:61389:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:26.0:1773851876.616982:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2312/2312 into md 0x1614fbabf9 [128] + 204056
00000020:00000001:24.0:1773851876.616982:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851876.616982:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616982:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.616982:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.616982:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000028eda8b2 with x1859601617801024
00010000:00000001:10.0:1773851876.616982:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:28.0:1773851876.616983:0:61389:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:24.0:1773851876.616983:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616983:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.616983:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.616983:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:28.0:1773851876.616984:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:26.0:1773851876.616984:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.616984:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 206368
00000020:00000001:24.0:1773851876.616984:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.616984:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000001:00000001:13.0:1773851876.616984:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.616984:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000040:10.0:1773851876.616984:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000059445a6a refcount=4
00000020:00000001:10.0:1773851876.616984:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637080377147968 : -106993332403648 : ffff9eb0ac6dc240)
00002000:00100000:28.0:1773851876.616985:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240028b4f:0x3aa5:0x0]  req@000000002ad7ec7b x1859601617853184/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1672/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.616985:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.616985:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:10.0:1773851876.616985:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637080377147968 : -106993332403648 : ffff9eb0ac6dc240)
00000400:00000200:26.0:1773851876.616986:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851876.616986:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:24.0:1773851876.616986:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000001:00000001:13.0:1773851876.616986:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.616986:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:26.0:1773851876.616987:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000400:00000200:25.0:1773851876.616987:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00100000:24.0:1773851876.616987:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028a9b:0xcb5b:0x0]  req@0000000004c01fc4 x1859601617820032/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:126/0 lens 3144/0 e 0 to 0 dl 1773852241 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:13.0:1773851876.616987:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616987:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00002000:00000001:28.0:1773851876.616988:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:28.0:1773851876.616988:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000002ad7ec7b with x1859601617853184
00000100:00000001:26.0:1773851876.616988:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851876.616988:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:25.0:1773851876.616988:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000020:00000001:13.0:1773851876.616988:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:10.0:1773851876.616988:0:61837:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 0000000059445a6a/0x21b6f08f07a2746e lrc: 4/0,0 mode: PW/PW res: [0x240026287:0x117d2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c42 expref: 315 pid: 61036 timeout: 615036 lvb_type: 0
00010000:00000001:28.0:1773851876.616989:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000010:26.0:1773851876.616989:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a49395e3.
00000020:00000001:13.0:1773851876.616989:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.616989:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.616990:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851876.616990:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000791ed8be refcount=3
00000100:00000040:26.0:1773851876.616990:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000a49395e3 x1859601617806528 msgsize 2312
00002000:00000001:24.0:1773851876.616990:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.616990:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000004c01fc4 with x1859601617820032
00002000:00000001:13.0:1773851876.616990:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.616990:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.616991:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637049226369216 : -107024483182400 : ffff9ea96bb298c0)
00010000:00000001:28.0:1773851876.616991:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637049226369216 : -107024483182400 : ffff9ea96bb298c0)
00000100:00100000:26.0:1773851876.616991:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00010000:00000001:24.0:1773851876.616991:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.616991:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:13.0:1773851876.616991:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000040:10.0:1773851876.616991:0:61837:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009af31d21 count: 3
00000100:00000001:26.0:1773851876.616992:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00002000:00100000:13.0:1773851876.616992:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240025319:0x6e2d:0x0]  req@00000000bdcadfa4 x1859601617819648/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4184/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.616992:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851876.616993:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851876.616993:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:28.0:1773851876.616993:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00010000:00000001:10.0:1773851876.616993:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:28.0:1773851876.616994:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851876.616994:0:61389:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:26.0:1773851876.616994:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000100:00000001:25.0:1773851876.616994:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000020:00000040:24.0:1773851876.616994:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ee2f5eb7 refcount=3
00002000:00000001:10.0:1773851876.616994:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000010:28.0:1773851876.616995:0:61389:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000800:00000200:26.0:1773851876.616995:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000200:25.0:1773851876.616995:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:25.0:1773851876.616995:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000028552e3f.
00000020:00000001:24.0:1773851876.616995:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637145936560704 : -106927772990912 : ffff9ebff0130240)
00002000:00000001:13.0:1773851876.616995:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.616995:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000bdcadfa4 with x1859601617819648
00002000:00010000:10.0:1773851876.616995:0:61837:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 0000000028eda8b2
00000020:00000010:28.0:1773851876.616996:0:61389:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000100:00000040:25.0:1773851876.616996:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000028552e3f x1859601619326720 msgsize 488
00010000:00000001:24.0:1773851876.616996:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637145936560704 : -106927772990912 : ffff9ebff0130240)
00010000:00000001:13.0:1773851876.616996:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.616996:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:10.0:1773851876.616996:0:61837:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.616996:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:28.0:1773851876.616997:0:61389:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001aa5c9b3.
00000020:00000040:28.0:1773851876.616997:0:61389:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00100000:25.0:1773851876.616997:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00010000:00000001:24.0:1773851876.616997:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.616997:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:28.0:1773851876.616998:0:61389:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851876.616998:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:24.0:1773851876.616998:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.616998:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851876.616999:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000100:00000001:24.0:1773851876.616999:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:10.1:1773851876.616999:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000028eda8b2 x1859601617801024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 4584/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:25.0:1773851876.617000:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000040:13.0:1773851876.617002:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cb0151f0 refcount=3
00000020:00000001:13.0:1773851876.617003:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095520595200 : -106978188956416 : ffff9eb4330c6d00)
00000100:00080000:10.1:1773851876.617003:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e5f5b349 x1859601617801024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 4584/448 e 10 to 0 dl 1773851815 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617004:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095520595200 : -106978188956416 : ffff9eb4330c6d00)
00000800:00000200:29.0:1773851876.617005:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00010000:00000001:13.0:1773851876.617005:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617005:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617005:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000800:00000200:29.0:1773851876.617006:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00002000:00000001:13.0:1773851876.617006:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617006:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000800:00000200:29.0:1773851876.617007:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:13.0:1773851876.617007:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617007:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:10.0:1773851876.617007:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617008:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:29.0:1773851876.617009:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00080000:24.1:1773851876.617009:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000004c01fc4 x1859601617820032/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:126/0 lens 3144/0 e 0 to 0 dl 1773852241 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617009:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240026287:0x117d2:0x0]  req@0000000028eda8b2 x1859601617801024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 4584/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:29.0:1773851876.617011:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00002000:00000001:10.0:1773851876.617011:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:29.0:1773851876.617012:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22416@kfi7 : PUT - for me
00000100:00080000:24.1:1773851876.617012:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000dd4397e6 x1859601617820032/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:682/0 lens 3144/0 e 4 to 0 dl 1773851840 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617012:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000028eda8b2 with x1859601617801024
00010000:00000001:10.0:1773851876.617012:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617013:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617013:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000059445a6a refcount=4
00000400:00000200:29.0:1773851876.617014:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.617014:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000100:00000001:24.0:1773851876.617014:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000001:10.0:1773851876.617014:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637080377147968 : -106993332403648 : ffff9eb0ac6dc240)
00000400:00000200:29.0:1773851876.617015:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00000001:24.0:1773851876.617015:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00010000:00000001:10.0:1773851876.617015:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637080377147968 : -106993332403648 : ffff9eb0ac6dc240)
00000100:00000001:24.0:1773851876.617016:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851876.617016:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:13.1:1773851876.617016:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000bdcadfa4 x1859601617819648/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4184/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00010000:10.0:1773851876.617016:0:61837:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 0000000059445a6a/0x21b6f08f07a2746e lrc: 4/0,0 mode: PW/PW res: [0x240026287:0x117d2:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c42 expref: 314 pid: 61036 timeout: 615036 lvb_type: 0
00000400:00000200:29.0:1773851876.617017:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00002000:00100000:24.0:1773851876.617017:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028a9b:0xcb5b:0x0]  req@0000000004c01fc4 x1859601617820032/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:126/0 lens 3144/0 e 0 to 0 dl 1773852241 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:29.0:1773851876.617018:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000100:00080000:13.1:1773851876.617018:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000b238be9a x1859601617819648/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 4184/0 e 5 to 0 dl 1773851816 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000040:10.0:1773851876.617018:0:61837:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009af31d21 count: 3
00000400:00000200:29.0:1773851876.617019:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:10.0:1773851876.617019:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:29.0:1773851876.617020:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2080 into portal 13 MB=0x69b4c3ddb2b00
00002000:00000001:24.0:1773851876.617020:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617020:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000004c01fc4 with x1859601617820032
00010000:00000001:10.0:1773851876.617020:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617020:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:29.0:1773851876.617021:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2080/2080 into md 0x77fdd4a5d [128] + 123024
00010000:00000001:24.0:1773851876.617021:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617021:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.617021:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.617021:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00002000:00010000:10.0:1773851876.617021:0:61837:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 0000000028eda8b2
00002000:00000001:10.0:1773851876.617021:0:61837:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:24.0:1773851876.617022:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ee2f5eb7 refcount=3
00000020:00000001:24.0:1773851876.617022:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637145936560704 : -106927772990912 : ffff9ebff0130240)
00000100:00000001:13.0:1773851876.617022:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851876.617022:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851876.617022:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.617023:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:24.0:1773851876.617023:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637145936560704 : -106927772990912 : ffff9ebff0130240)
00002000:00000001:13.0:1773851876.617023:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:10.0:1773851876.617023:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617023:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000800:00000200:9.0:1773851876.617023:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851876.617024:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:24.0:1773851876.617024:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617024:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00100000:13.0:1773851876.617024:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240025319:0x6e2d:0x0]  req@00000000bdcadfa4 x1859601617819648/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4184/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:10.0:1773851876.617024:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000800:00000200:9.0:1773851876.617024:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:24.0:1773851876.617025:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000040:10.0:1773851876.617025:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000400:00000200:29.0:1773851876.617026:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22416@kfi7: PUT: OK
00000100:00000001:29.0:1773851876.617026:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00002000:00000001:24.0:1773851876.617026:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617026:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00002000:00000001:13.0:1773851876.617026:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:10.0:1773851876.617026:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851876.617026:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:29.0:1773851876.617027:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000010:24.0:1773851876.617027:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00002000:00100000:13.0:1773851876.617027:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000bdcadfa4 with x1859601617819648
00010000:00000001:13.0:1773851876.617027:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000010:29.0:1773851876.617028:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009a17b279.
00000100:00000040:29.0:1773851876.617028:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000009a17b279 x1859601617857280 msgsize 2080
00000020:00000010:24.0:1773851876.617028:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:24.0:1773851876.617028:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.617028:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617028:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cb0151f0 refcount=3
00000400:00000200:9.0:1773851876.617028:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000040:24.0:1773851876.617029:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000020:00000001:13.0:1773851876.617029:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095520595200 : -106978188956416 : ffff9eb4330c6d00)
00000400:00000200:9.0:1773851876.617029:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22417@kfi7 : PUT - for me
00000100:00100000:29.0:1773851876.617030:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00000001:24.0:1773851876.617030:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851876.617030:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095520595200 : -106978188956416 : ffff9eb4330c6d00)
00000400:00000200:9.0:1773851876.617030:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:29.0:1773851876.617031:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000001:13.0:1773851876.617031:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617031:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:9.0:1773851876.617031:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000400:00000200:29.0:1773851876.617032:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00000001:28.0:1773851876.617032:0:61389:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00002000:00000001:13.0:1773851876.617032:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617032:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.617032:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.617032:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000800:00000200:29.0:1773851876.617033:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851876.617033:0:61389:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851876.617033:0:61389:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617033:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.617033:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000400:00000200:9.0:1773851876.617033:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000100:00000001:28.0:1773851876.617034:0:61389:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851876.617034:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000400:00000200:9.0:1773851876.617034:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
02000000:00000001:28.0:1773851876.617035:0:61389:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851876.617035:0:61389:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617857280
00000800:00000200:25.0:1773851876.617035:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000020:00000010:13.0:1773851876.617035:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000400:00000200:9.0:1773851876.617035:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3e04ae40
00000020:00000001:28.0:1773851876.617036:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851876.617036:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000800:00000200:27.0:1773851876.617036:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851876.617036:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.617036:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:24.0:1773851876.617036:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.617036:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000040:13.0:1773851876.617036:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 311
00000100:00000001:13.0:1773851876.617036:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851876.617036:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 122080
00000020:00000001:28.0:1773851876.617037:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851876.617037:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=312
00000800:00000200:27.0:1773851876.617037:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851876.617037:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000100:00000001:24.0:1773851876.617037:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.617037:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617037:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851876.617037:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:28.0:1773851876.617038:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:26.0:1773851876.617038:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851876.617038:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:24.0:1773851876.617038:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851876.617038:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617038:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617038:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:28.0:1773851876.617039:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00100000:24.0:1773851876.617039:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620124480
00000020:00000001:24.0:1773851876.617039:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:13.0:1773851876.617039:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617039:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617039:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851876.617039:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851876.617040:0:61389:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851876.617040:0:61389:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:26.0:1773851876.617040:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851876.617040:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:24.0:1773851876.617040:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:24.0:1773851876.617040:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
02000000:00000001:13.0:1773851876.617040:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617040:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.617040:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.617040:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22417@kfi7: PUT: OK
00000020:00000010:28.0:1773851876.617041:0:61389:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001aa5c9b3.
00000800:00000200:27.0:1773851876.617041:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000040:24.0:1773851876.617041:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000001:24.0:1773851876.617041:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00100000:13.0:1773851876.617041:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618563968
00000100:00100000:10.0:1773851876.617041:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618826368
00000020:00000010:28.0:1773851876.617042:0:61389:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000400:00000200:26.0:1773851876.617042:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.617042:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:24.0:1773851876.617042:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617042:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617042:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617042:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:9.0:1773851876.617042:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851876.617042:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000010:28.0:1773851876.617043:0:61389:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000800:00000200:27.0:1773851876.617043:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851876.617043:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000400:00000200:25.0:1773851876.617043:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22353@kfi7 : PUT - for me
00000100:00000001:24.0:1773851876.617043:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617043:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:13.0:1773851876.617043:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617043:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617043:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000010:9.0:1773851876.617043:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8355d51.
00000100:00000001:28.0:1773851876.617044:0:61389:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:26.0:1773851876.617044:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.617044:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000040:13.0:1773851876.617044:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000040:10.0:1773851876.617044:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000100:00000040:9.0:1773851876.617044:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000a8355d51 x1859601620577856 msgsize 488
00000100:00000001:28.0:1773851876.617045:0:61389:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:28.0:1773851876.617045:0:61389:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:26.0:1773851876.617045:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 1
00000020:00000010:24.0:1773851876.617045:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851876.617045:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.617045:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:11.0:1773851876.617045:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000020:00000001:10.0:1773851876.617045:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617045:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00100000:9.0:1773851876.617045:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000020:00000001:28.0:1773851876.617046:0:61389:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851876.617046:0:61389:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:26.0:1773851876.617046:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000100:00000001:24.0:1773851876.617046:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:13.0:1773851876.617046:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:11.0:1773851876.617046:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:10.0:1773851876.617046:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851876.617046:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:28.0:1773851876.617047:0:61389:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:26.0:1773851876.617047:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000100:00000001:24.0:1773851876.617047:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.617047:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000800:00000200:14.0:1773851876.617047:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000001:13.0:1773851876.617047:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617047:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:11.0:1773851876.617047:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851876.617047:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:9.0:1773851876.617047:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:28.0:1773851876.617048:0:61389:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:28.0:1773851876.617048:0:61389:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000400:00000200:26.0:1773851876.617048:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:24.0:1773851876.617048:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.617048:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000800:00000200:14.0:1773851876.617048:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:13.0:1773851876.617048:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000010:10.0:1773851876.617048:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000800:00000200:9.0:1773851876.617048:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 22417@kfi7(00000000080a5f4f):0x0 lsk 4667 rsk 14 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000001:28.0:1773851876.617049:0:61389:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.617049:0:61389:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:25.0:1773851876.617049:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:24.0:1773851876.617049:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617049:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000010:13.0:1773851876.617049:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:10.0:1773851876.617049:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000001:00000001:28.0:1773851876.617050:0:61389:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:28.0:1773851876.617050:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:25.0:1773851876.617050:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000020:00000001:24.0:1773851876.617050:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.617050:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851876.617050:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:13.0:1773851876.617050:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000800:00000200:11.0:1773851876.617050:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000010:10.0:1773851876.617050:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000001:00000001:28.0:1773851876.617051:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:25.0:1773851876.617051:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000001:00000001:24.0:1773851876.617051:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851876.617051:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617051:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:11.0:1773851876.617051:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000100:00000001:10.0:1773851876.617051:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000001:00000001:28.0:1773851876.617052:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.617052:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:25.0:1773851876.617052:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000001:00000001:24.0:1773851876.617052:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:14.0:1773851876.617052:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:13.0:1773851876.617052:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617052:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000100:00000001:10.0:1773851876.617052:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000001:00000001:28.0:1773851876.617053:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:28.0:1773851876.617053:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851876.617053:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000001:00000001:24.0:1773851876.617053:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.617053:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617053:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000400:00000200:11.0:1773851876.617053:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000020:00000001:10.0:1773851876.617053:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617053:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851876.617054:0:61389:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000001:00000001:24.0:1773851876.617054:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617054:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:14.0:1773851876.617054:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617054:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:11.0:1773851876.617054:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:10.0:1773851876.617054:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000001:28.0:1773851876.617055:0:61389:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.617055:0:61389:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851876.617055:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000001:00000001:24.0:1773851876.617055:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617055:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617055:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000400:00000200:11.0:1773851876.617055:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000020:00000001:10.0:1773851876.617055:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617055:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:28.0:1773851876.617056:0:61389:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851876.617056:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000400:00000200:26.0:1773851876.617056:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:24.0:1773851876.617056:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851876.617056:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617056:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000020:00000001:13.0:1773851876.617056:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617056:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.617056:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:10.0:1773851876.617056:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00002000:00000001:28.0:1773851876.617057:0:61389:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:28.0:1773851876.617057:0:61389:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.617057:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4336 into portal 13 MB=0x69b4c3ddaf340
00000400:00000200:25.0:1773851876.617057:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:24.0:1773851876.617057:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617057:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617057:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:13.0:1773851876.617057:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:11.0:1773851876.617057:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:10.0:1773851876.617057:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617057:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00002000:00000001:28.0:1773851876.617058:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:27.0:1773851876.617058:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.617058:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3dda6240
00002000:00000001:24.0:1773851876.617058:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000001:00000001:13.0:1773851876.617058:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617058:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617059:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617059:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:15.0:1773851876.617059:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:14.0:1773851876.617059:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000001:00000001:13.0:1773851876.617059:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617059:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617059:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00002000:00100000:28.0:1773851876.617060:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240025d6f:0x7a4:0x0]  req@000000009a17b279 x1859601617857280/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2080/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:13.0:1773851876.617060:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:11.0:1773851876.617060:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000001:00000001:10.0:1773851876.617060:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617060:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:27.0:1773851876.617061:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000400:00000200:26.0:1773851876.617061:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4336/4336 into md 0x1614fbabf9 [128] + 206856
00000400:00000200:14.0:1773851876.617061:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:13.0:1773851876.617061:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617061:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617061:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00100000:24.0:1773851876.617062:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024b81:0x2023:0x0]  req@0000000065f48b03 x1859601620124480/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:99/0 lens 488/0 e 0 to 0 dl 1773852214 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:15.0:1773851876.617062:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000001:00000001:13.0:1773851876.617062:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617062:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617062:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:28.0:1773851876.617063:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:27.0:1773851876.617063:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:13.0:1773851876.617063:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:11.0:1773851876.617063:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:10.0:1773851876.617063:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00002000:00100000:28.0:1773851876.617064:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000009a17b279 with x1859601617857280
00010000:00000001:28.0:1773851876.617064:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:25.0:1773851876.617064:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 211192
00002000:00000001:24.0:1773851876.617064:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:14.0:1773851876.617064:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000001:13.0:1773851876.617064:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617064:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617064:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851876.617065:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:27.0:1773851876.617065:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000800:00000200:26.0:1773851876.617065:0:2507427:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 39 trmk 1 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4336 bytes in 2 frags
00002000:00100000:24.0:1773851876.617065:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000065f48b03 with x1859601620124480
00000800:00000200:15.0:1773851876.617065:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:13.0:1773851876.617065:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.617065:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 3896 into portal 13 MB=0x69b4c3ddb7500
00000020:00000001:10.0:1773851876.617065:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:28.0:1773851876.617066:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c78aceb9 refcount=3
00000400:00000200:27.0:1773851876.617066:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 5
00000800:00000200:25.0:1773851876.617066:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:24.0:1773851876.617066:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617066:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:14.0:1773851876.617066:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00002000:00000001:13.0:1773851876.617066:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617066:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617066:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:28.0:1773851876.617067:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117995448960 : -106955714102656 : ffff9eb96ea77a80)
00000400:00000200:27.0:1773851876.617067:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:26.0:1773851876.617067:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 39 trmk 1 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000400:00000200:25.0:1773851876.617067:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:24.0:1773851876.617067:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000dc1f362c refcount=3
00000400:00000200:14.0:1773851876.617067:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617067:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851876.617067:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 3896/3896 into md 0x7813a3b29 [128] + 122568
00000020:00000001:10.0:1773851876.617067:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851876.617068:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637117995448960 : -106955714102656 : ffff9eb96ea77a80)
00000400:00000200:27.0:1773851876.617068:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3de72b00
00000400:00000200:25.0:1773851876.617068:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22353@kfi7: PUT: OK
00000020:00000001:24.0:1773851876.617068:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637030762996736 : -107042946554880 : ffff9ea51f31e400)
00010000:00000001:24.0:1773851876.617068:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637030762996736 : -107042946554880 : ffff9ea51f31e400)
00000800:00000200:15.0:1773851876.617068:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851876.617068:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2072 into portal 13 MB=0x69b4c3dda83c0
00002000:00000001:13.0:1773851876.617068:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:10.0:1773851876.617068:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:28.0:1773851876.617069:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:25.0:1773851876.617069:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:24.0:1773851876.617069:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:14.0:1773851876.617069:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2072/2072 into md 0x82a21912d [128] + 106640
00002000:00100000:13.0:1773851876.617069:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x24002352f:0x9d6:0x0]  req@00000000c7f354c1 x1859601618563968/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:198/0 lens 488/0 e 0 to 0 dl 1773852313 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:11.0:1773851876.617069:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00100000:10.0:1773851876.617069:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024ec6:0x1050:0x0]  req@00000000211b859f x1859601618826368/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:28.0:1773851876.617070:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:28.0:1773851876.617070:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:27.0:1773851876.617070:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 211680
00000800:00000200:26.0:1773851876.617070:0:2507427:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 39 trmk 1 tmk 0 trr 0 tta 0x123e Using peer 22353@kfi7(0x123e)
00000100:00000200:25.0:1773851876.617070:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:25.0:1773851876.617070:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000edade0bb.
00010000:00000001:24.0:1773851876.617070:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:15.0:1773851876.617070:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:28.0:1773851876.617071:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851876.617071:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000edade0bb x1859601617805888 msgsize 488
00002000:00000001:24.0:1773851876.617071:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617071:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617071:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00002000:00000001:13.0:1773851876.617071:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:11.0:1773851876.617071:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851876.617072:0:61389:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617072:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617072:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:14.0:1773851876.617072:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00100000:13.0:1773851876.617072:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c7f354c1 with x1859601618563968
00000400:00000200:11.0:1773851876.617072:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00002000:00000001:10.0:1773851876.617072:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617072:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000211b859f with x1859601618826368
00000100:00080000:28.1:1773851876.617073:0:61389:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000009a17b279 x1859601617857280/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2080/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:27.0:1773851876.617073:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:25.0:1773851876.617073:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000100:00000001:25.0:1773851876.617073:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851876.617073:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:14.0:1773851876.617073:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:13.0:1773851876.617073:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617073:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:11.0:1773851876.617073:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:10.0:1773851876.617073:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:27.0:1773851876.617074:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851876.617074:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000400:00000200:15.0:1773851876.617074:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000040:13.0:1773851876.617074:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f05ff2f5 refcount=3
00000100:00000200:11.0:1773851876.617074:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:11.0:1773851876.617074:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000011dd21eb.
00000020:00000001:10.0:1773851876.617074:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:26.0:1773851876.617075:0:2507427:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2054@kfi7:6 TN 0000000034381e9b: Posted read of 4336 bytes in 2 frags kp 22353@kfi7(00000000765e039b) rma_iov.key 2555905: rc=0
00000400:00000200:15.0:1773851876.617075:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:14.0:1773851876.617075:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000020:00000001:13.0:1773851876.617075:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637093695217536 : -106980014334080 : ffff9eb3c63f5f80)
00000100:00000040:11.0:1773851876.617075:0:2510946:0:(events.c:358:request_in_callback()) incoming req@0000000011dd21eb x1859601617876224 msgsize 3896
00000020:00000040:10.0:1773851876.617075:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000001719ad2d refcount=3
00000020:00000001:10.0:1773851876.617075:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636996976885760 : -107076732665856 : ffff9e9d4162c000)
00000100:00080000:28.1:1773851876.617076:0:61389:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000bbb24712 x1859601617857280/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:703/0 lens 2080/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:27.0:1773851876.617076:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000800:00000200:25.0:1773851876.617076:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 22353@kfi7(0000000016ff6d25):0x0 lsk 4666 rsk 44 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:15.0:1773851876.617076:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000100:00000001:14.0:1773851876.617076:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.617076:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00010000:00000001:13.0:1773851876.617076:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637093695217536 : -106980014334080 : ffff9eb3c63f5f80)
00010000:00000001:13.0:1773851876.617076:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617076:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636996976885760 : -107076732665856 : ffff9e9d4162c000)
00000100:00000001:27.0:1773851876.617077:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851876.617077:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:26.0:1773851876.617077:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 39 trmk 1 tmk 0 trr 0 tta 0x123e TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000400:00000200:15.0:1773851876.617077:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:13.0:1773851876.617077:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617077:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00100000:11.0:1773851876.617077:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00010000:00000001:10.0:1773851876.617077:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000010:27.0:1773851876.617078:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006c134c4d.
00000400:00000200:15.0:1773851876.617078:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2056 into portal 13 MB=0x69b4c3dda9400
00002000:00000001:13.0:1773851876.617078:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617078:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851876.617078:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:11.0:1773851876.617078:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00010000:00000001:10.0:1773851876.617078:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617078:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:28.0:1773851876.617079:0:61389:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:28.0:1773851876.617079:0:61389:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000040:27.0:1773851876.617079:0:2464256:0:(events.c:358:request_in_callback()) incoming req@000000006c134c4d x1859601618643712 msgsize 488
00000100:00000010:14.0:1773851876.617079:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc5a78ed.
00002000:00000001:10.0:1773851876.617079:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617079:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851876.617080:0:61389:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00080000:24.1:1773851876.617080:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000065f48b03 x1859601620124480/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:99/0 lens 488/0 e 0 to 0 dl 1773852214 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.617080:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2056/2056 into md 0x82a21912d [128] + 108712
00000100:00000040:14.0:1773851876.617080:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000bc5a78ed x1859601617814464 msgsize 2072
00000800:00000200:11.0:1773851876.617080:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00100000:27.0:1773851876.617081:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00002000:00000001:28.0:1773851876.617082:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:27.0:1773851876.617082:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:15.0:1773851876.617082:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:14.0:1773851876.617082:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00002000:00100000:28.0:1773851876.617083:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240025d6f:0x7a4:0x0]  req@000000009a17b279 x1859601617857280/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2080/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:27.0:1773851876.617083:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000100:00080000:24.1:1773851876.617083:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000037be8a8c x1859601620124480/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:571/0 lens 488/0 e 10 to 0 dl 1773851813 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:14.0:1773851876.617083:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:27.0:1773851876.617084:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006faf1aef: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:15.0:1773851876.617084:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851876.617084:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:15.0:1773851876.617085:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000800:00000200:14.0:1773851876.617085:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00002000:00000001:28.0:1773851876.617086:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:28.0:1773851876.617086:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000009a17b279 with x1859601617857280
00000100:00000001:24.0:1773851876.617086:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851876.617086:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:15.0:1773851876.617086:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00080000:13.1:1773851876.617086:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000c7f354c1 x1859601618563968/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:198/0 lens 488/0 e 0 to 0 dl 1773852313 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:28.0:1773851876.617087:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:28.0:1773851876.617087:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851876.617087:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000200:15.0:1773851876.617087:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000040:28.0:1773851876.617088:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c78aceb9 refcount=3
00002000:00000001:24.0:1773851876.617088:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851876.617088:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024b81:0x2023:0x0]  req@0000000065f48b03 x1859601620124480/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:99/0 lens 488/0 e 0 to 0 dl 1773852214 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000010:15.0:1773851876.617088:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000afef894e.
00000100:00000040:15.0:1773851876.617088:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000afef894e x1859601617818624 msgsize 2056
00000020:00000001:28.0:1773851876.617089:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117995448960 : -106955714102656 : ffff9eb96ea77a80)
00010000:00000001:28.0:1773851876.617089:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637117995448960 : -106955714102656 : ffff9eb96ea77a80)
00010000:00000001:28.0:1773851876.617090:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00100000:15.0:1773851876.617090:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00010000:00000001:28.0:1773851876.617091:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:28.0:1773851876.617091:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:15.0:1773851876.617091:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:28.0:1773851876.617092:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617093:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00002000:00000001:24.0:1773851876.617094:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617094:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000065f48b03 with x1859601620124480
00010000:00000001:24.0:1773851876.617095:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617095:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:15.0:1773851876.617095:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000020:00000040:24.0:1773851876.617096:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000dc1f362c refcount=3
00000020:00000001:24.0:1773851876.617097:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637030762996736 : -107042946554880 : ffff9ea51f31e400)
00010000:00000001:24.0:1773851876.617097:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637030762996736 : -107042946554880 : ffff9ea51f31e400)
00010000:00000001:24.0:1773851876.617098:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617099:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617099:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617099:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:13.1:1773851876.617100:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000004fe06c9b x1859601618563968/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:552/0 lens 488/0 e 1 to 0 dl 1773851912 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617103:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00080000:10.1:1773851876.617103:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000211b859f x1859601618826368/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617104:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:13.0:1773851876.617104:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617105:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:15.0:1773851876.617106:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00002000:00100000:13.0:1773851876.617106:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x24002352f:0x9d6:0x0]  req@00000000c7f354c1 x1859601618563968/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:198/0 lens 488/0 e 0 to 0 dl 1773852313 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:10.1:1773851876.617106:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000fe4f6333 x1859601618826368/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:679/0 lens 488/0 e 1 to 0 dl 1773852039 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:15.0:1773851876.617107:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000800:00000200:15.0:1773851876.617108:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:13.0:1773851876.617108:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:28.0:1773851876.617109:0:61389:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851876.617109:0:61389:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000100:00000001:24.0:1773851876.617109:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00002000:00100000:13.0:1773851876.617109:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c7f354c1 with x1859601618563968
00010000:00000001:13.0:1773851876.617109:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:10.0:1773851876.617109:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.617109:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:28.0:1773851876.617110:0:61389:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:24.0:1773851876.617110:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000800:00000200:15.0:1773851876.617110:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.617110:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617110:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f05ff2f5 refcount=3
00000100:00000001:10.0:1773851876.617110:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:28.0:1773851876.617111:0:61389:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001aa5c9b3.
00000020:00000010:24.0:1773851876.617111:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.617111:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637093695217536 : -106980014334080 : ffff9eb3c63f5f80)
00010000:00000001:13.0:1773851876.617111:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637093695217536 : -106980014334080 : ffff9eb3c63f5f80)
00002000:00000001:10.0:1773851876.617111:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000040:28.0:1773851876.617112:0:61389:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000020:00000010:24.0:1773851876.617112:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000400:00000200:15.0:1773851876.617112:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:13.0:1773851876.617112:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00100000:10.0:1773851876.617112:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024ec6:0x1050:0x0]  req@00000000211b859f x1859601618826368/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:28.0:1773851876.617113:0:61389:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:24.0:1773851876.617113:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00000001:24.0:1773851876.617113:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851876.617113:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00010000:00000001:13.0:1773851876.617113:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617113:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617113:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617114:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.617114:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000100:00000001:13.0:1773851876.617114:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:15.0:1773851876.617115:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000010:13.0:1773851876.617115:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617115:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00002000:00000001:10.0:1773851876.617115:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617115:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000211b859f with x1859601618826368
00000400:00000200:15.0:1773851876.617116:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000010:13.0:1773851876.617116:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00010000:00000001:10.0:1773851876.617116:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617116:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:15.0:1773851876.617117:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:15.0:1773851876.617117:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000040:13.0:1773851876.617117:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000020:00000040:10.0:1773851876.617117:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000001719ad2d refcount=3
00000020:00000001:10.0:1773851876.617117:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636996976885760 : -107076732665856 : ffff9e9d4162c000)
00000400:00000200:15.0:1773851876.617118:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4016 into portal 13 MB=0x69b4c3dda5d00
00000100:00000001:13.0:1773851876.617118:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851876.617118:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636996976885760 : -107076732665856 : ffff9e9d4162c000)
00000800:00000200:29.0:1773851876.617119:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.617119:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:15.0:1773851876.617119:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4016/4016 into md 0x82a21912d [128] + 110768
00000100:00000001:13.0:1773851876.617119:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.617119:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00010000:00000001:10.0:1773851876.617119:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000800:00000200:29.0:1773851876.617120:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851876.617120:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:13.0:1773851876.617120:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617120:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.617120:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617120:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000800:00000200:29.0:1773851876.617121:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851876.617121:0:2507427:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 39 trmk 1 tmk 0 trr 0 tta 0x123e TN_EVENT_TAG_TX_OK event status 0
00000100:00000001:24.0:1773851876.617121:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.617121:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.617121:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:15.0:1773851876.617121:0:2513974:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4016 bytes in 2 frags
02000000:00000001:13.0:1773851876.617121:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851876.617121:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617814464
00002000:00000001:10.0:1773851876.617121:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851876.617122:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:24.0:1773851876.617122:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617122:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617122:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:10.0:1773851876.617122:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617122:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
02000000:00000001:24.0:1773851876.617123:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851876.617123:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617807360
00000020:00000001:13.0:1773851876.617123:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617123:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000010:10.0:1773851876.617123:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000800:00000200:29.0:1773851876.617124:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851876.617124:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:24.0:1773851876.617124:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617124:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000800:00000200:15.0:1773851876.617124:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000020:00000001:13.0:1773851876.617124:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:10.0:1773851876.617124:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617124:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000400:00000200:26.0:1773851876.617125:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:24.0:1773851876.617125:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617125:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000001:13.0:1773851876.617125:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.617125:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851876.617126:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:26.0:1773851876.617126:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000400:00000200:25.0:1773851876.617126:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:24.0:1773851876.617126:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:15.0:1773851876.617126:0:2513974:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 Using peer 22352@kfi7(0x1233)
00000100:00000001:13.0:1773851876.617126:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617126:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:10.0:1773851876.617126:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:26.0:1773851876.617127:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000020:00000001:24.0:1773851876.617127:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:14.0:1773851876.617127:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000020:00000010:13.0:1773851876.617127:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
02000000:00000001:10.0:1773851876.617127:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617127:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:29.0:1773851876.617128:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22416@kfi7 : PUT - for me
00000100:00000200:26.0:1773851876.617128:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:25.0:1773851876.617128:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000100:00000001:24.0:1773851876.617128:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617128:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:14.0:1773851876.617128:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:13.0:1773851876.617128:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000100:00000001:10.0:1773851876.617128:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.617128:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851876.617129:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.617129:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000100:00000010:26.0:1773851876.617129:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b6b44c1.
00000100:00000040:26.0:1773851876.617129:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000002b6b44c1 x1859601617843008 msgsize 4336
00000400:00000200:25.0:1773851876.617129:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.617129:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000800:00000200:14.0:1773851876.617129:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:13.0:1773851876.617129:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00100000:10.0:1773851876.617129:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620496704
00000400:00000200:25.0:1773851876.617130:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000020:00000010:24.0:1773851876.617130:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000800:00000200:15.0:1773851876.617130:0:2513974:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:3 TN 0000000056f9fe8f: Posted read of 4016 bytes in 2 frags kp 22352@kfi7(000000000fcd3eb6) rma_iov.key 2293761: rc=0
00000100:00000001:13.0:1773851876.617130:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.617130:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617130:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617130:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617130:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:29.0:1773851876.617131:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:29.0:1773851876.617131:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00100000:26.0:1773851876.617131:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000400:00000200:25.0:1773851876.617131:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.617131:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.617131:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617131:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000040:10.0:1773851876.617131:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000400:00000200:29.0:1773851876.617132:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000100:00000001:26.0:1773851876.617132:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851876.617132:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000100:00000001:24.0:1773851876.617132:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617132:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:15.0:1773851876.617132:0:2513974:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000800:00000200:14.0:1773851876.617132:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.617132:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:13.0:1773851876.617132:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617132:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617132:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:29.0:1773851876.617133:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:25.0:1773851876.617133:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 4
00000020:00000001:24.0:1773851876.617133:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.617133:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617133:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617133:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000100:00000001:10.0:1773851876.617133:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:24.0:1773851876.617134:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000800:00000200:15.0:1773851876.617134:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000020:00000001:13.0:1773851876.617134:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617134:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617134:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000400:00000200:29.0:1773851876.617135:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 392 into portal 23 MB=0x69b4c3de601c0
00000400:00000200:26.0:1773851876.617135:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000800:00000200:15.0:1773851876.617135:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:14.0:1773851876.617135:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:13.0:1773851876.617135:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617135:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:10.0:1773851876.617135:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000400:00000200:29.0:1773851876.617136:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 17 from 12345-22352@kfi7 of length 392/392 into md 0x780052ffd [2] + 392
00000800:00000200:26.0:1773851876.617136:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 39 trmk 1 tmk 0 trr 0 tta 0x123e Transaction freed
00000400:00000200:25.0:1773851876.617136:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:24.0:1773851876.617136:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000001:00000001:13.0:1773851876.617136:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000010:10.0:1773851876.617136:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000400:00000200:25.0:1773851876.617137:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3df0e640
00000020:00000001:24.0:1773851876.617137:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851876.617137:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000800:00000200:15.0:1773851876.617137:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851876.617137:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000400:00000200:14.0:1773851876.617137:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:13.0:1773851876.617137:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617137:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:10.0:1773851876.617137:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000800:00000200:29.0:1773851876.617138:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.617138:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x1614fbabf9 [128] + 212168
00000020:00000001:24.0:1773851876.617138:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617138:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:14.0:1773851876.617138:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000001:00000001:13.0:1773851876.617138:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617138:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:10.0:1773851876.617138:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617138:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:29.0:1773851876.617139:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:24.0:1773851876.617139:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617139:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000800:00000200:15.0:1773851876.617139:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851876.617139:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:13.0:1773851876.617139:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617139:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.617139:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617139:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000800:00000200:31.0:1773851876.617140:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851876.617140:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851876.617140:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851876.617140:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22416@kfi7: PUT: OK
00000800:00000200:25.0:1773851876.617140:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:24.0:1773851876.617140:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617140:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:14.0:1773851876.617140:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000020:00000001:13.0:1773851876.617140:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617140:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617140:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000800:00000200:31.0:1773851876.617141:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:29.0:1773851876.617141:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000001:00000001:24.0:1773851876.617141:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617141:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:14.0:1773851876.617141:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000020:00000001:13.0:1773851876.617141:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617141:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617141:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000800:00000200:31.0:1773851876.617142:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851876.617142:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:29.0:1773851876.617142:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_readpage
00000100:00000010:29.0:1773851876.617142:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000983d5af5.
00000400:00000200:25.0:1773851876.617142:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:24.0:1773851876.617142:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617142:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00002000:00000001:13.0:1773851876.617142:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617142:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617142:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851876.617143:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000983d5af5 x1859601618567616 msgsize 392
00000400:00000200:25.0:1773851876.617143:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000020:00000001:24.0:1773851876.617143:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617143:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617143:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:13.0:1773851876.617143:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000001:00000001:10.0:1773851876.617143:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617143:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851876.617144:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:25.0:1773851876.617144:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851876.617144:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000001:24.0:1773851876.617144:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617144:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617144:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000400:00000200:14.0:1773851876.617144:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2792 into portal 13 MB=0x69b4c3ddaba80
00002000:00100000:13.0:1773851876.617144:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x2400289ae:0x1da64:0x0]  req@00000000bc5a78ed x1859601617814464/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2072/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:10.0:1773851876.617144:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617144:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:31.0:1773851876.617145:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00100000:29.0:1773851876.617145:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00000010:25.0:1773851876.617145:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f85862c4.
00000100:00000040:25.0:1773851876.617145:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000f85862c4 x1859601619281472 msgsize 488
00002000:00000001:24.0:1773851876.617145:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617145:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617145:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:10.0:1773851876.617145:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617145:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617145:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:30.0:1773851876.617146:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00000001:29.0:1773851876.617146:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:24.0:1773851876.617146:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:15.0:1773851876.617146:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:14.0:1773851876.617146:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2792/2792 into md 0x82a21912d [128] + 114784
00000001:00000001:10.0:1773851876.617146:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617146:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:31.0:1773851876.617147:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:30.0:1773851876.617147:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22416@kfi7 : PUT - for me
00000100:00100000:25.0:1773851876.617147:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00002000:00100000:24.0:1773851876.617147:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028cd7:0x36eb:0x0]  req@000000001dc89cc3 x1859601617807360/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2912/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.617147:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:13.0:1773851876.617147:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000001:10.0:1773851876.617147:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617147:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851876.617148:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22416@kfi7 : PUT - for me
00000400:00000200:29.0:1773851876.617148:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000100:00000001:28.0:1773851876.617148:0:82937:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851876.617148:0:82937:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851876.617148:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851876.617148:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000400:00000200:15.0:1773851876.617148:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000800:00000200:14.0:1773851876.617148:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00100000:13.0:1773851876.617148:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000bc5a78ed with x1859601617814464
00010000:00000001:13.0:1773851876.617148:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617148:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851876.617149:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000100:00000001:28.0:1773851876.617149:0:82937:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851876.617149:0:82937:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617149:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 5
00000400:00000200:14.0:1773851876.617149:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:13.0:1773851876.617149:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:10.0:1773851876.617149:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617149:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851876.617150:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 1
00000800:00000200:29.0:1773851876.617150:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 22416@kfi7(0000000058dfa833):0x0 lsk 4661 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:25.0:1773851876.617150:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00002000:00000001:24.0:1773851876.617150:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617150:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000001dc89cc3 with x1859601617807360
00000400:00000200:15.0:1773851876.617150:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:10.0:1773851876.617150:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:30.0:1773851876.617151:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
02000000:00000001:28.0:1773851876.617151:0:82937:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851876.617151:0:82937:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618567616
00010000:00000001:24.0:1773851876.617151:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:15.0:1773851876.617151:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 3144 into portal 13 MB=0x69b4c3dda58c0
00000400:00000200:14.0:1773851876.617151:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00002000:00100000:10.0:1773851876.617151:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028a9b:0xc23d:0x0]  req@00000000fdf2070c x1859601620496704/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:200/0 lens 488/0 e 0 to 0 dl 1773852315 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:30.0:1773851876.617152:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000020:00000001:28.0:1773851876.617152:0:82937:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851876.617152:0:82937:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:24.0:1773851876.617152:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:15.0:1773851876.617152:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 3144/3144 into md 0x82a21912d [128] + 117576
00000100:00000001:14.0:1773851876.617152:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.617152:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:31.0:1773851876.617153:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:30.0:1773851876.617153:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000020:00000001:28.0:1773851876.617153:0:82937:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851876.617153:0:82937:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000100:00000010:14.0:1773851876.617153:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d7af5e95.
00000020:00000040:13.0:1773851876.617153:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009045f510 refcount=3
00000020:00000001:13.0:1773851876.617153:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637087731504768 : -106985978046848 : ffff9eb262c85680)
00000020:00000001:28.0:1773851876.617154:0:82937:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000040:14.0:1773851876.617154:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000d7af5e95 x1859601617828480 msgsize 2792
00010000:00000001:13.0:1773851876.617154:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637087731504768 : -106985978046848 : ffff9eb262c85680)
00002000:00000001:10.0:1773851876.617154:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617154:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fdf2070c with x1859601620496704
00000400:00000200:31.0:1773851876.617155:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000020:00000001:28.0:1773851876.617155:0:82937:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:15.0:1773851876.617155:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:13.0:1773851876.617155:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617155:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851876.617155:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617155:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:31.0:1773851876.617156:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22416@kfi7 to cpt 7
00000400:00000200:31.0:1773851876.617156:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000100:00000001:28.0:1773851876.617156:0:82937:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851876.617156:0:82937:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000040:24.0:1773851876.617156:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000877d078a refcount=3
00000400:00000200:15.0:1773851876.617156:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:14.0:1773851876.617156:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:14.0:1773851876.617156:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:13.0:1773851876.617156:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617156:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617156:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000df8bf01a refcount=3
00000400:00000200:31.0:1773851876.617157:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 4
00000020:00000010:28.0:1773851876.617157:0:82937:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001aa5c9b3.
00000020:00000001:24.0:1773851876.617157:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637140973330304 : -106932736221312 : ffff9ebec83e1f80)
00000400:00000200:14.0:1773851876.617157:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000100:00000001:13.0:1773851876.617157:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617157:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107986285120 : -106965723266496 : ffff9eb71a0fc240)
00000400:00000200:30.0:1773851876.617158:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000010:28.0:1773851876.617158:0:82937:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00010000:00000001:24.0:1773851876.617158:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637140973330304 : -106932736221312 : ffff9ebec83e1f80)
00000400:00000200:15.0:1773851876.617158:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000100:00000001:15.0:1773851876.617158:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:10.0:1773851876.617158:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107986285120 : -106965723266496 : ffff9eb71a0fc240)
00000400:00000200:31.0:1773851876.617159:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000010:28.0:1773851876.617159:0:82937:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00010000:00000001:24.0:1773851876.617159:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000200:15.0:1773851876.617159:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:15.0:1773851876.617159:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c8209d04.
00000800:00000200:14.0:1773851876.617159:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00080000:13.1:1773851876.617159:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000bc5a78ed x1859601617814464/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2072/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617159:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:31.0:1773851876.617160:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2408 into portal 13 MB=0x69b4c3ddb0540
00000400:00000200:30.0:1773851876.617160:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 3880 into portal 13 MB=0x69b4c3ddaffc0
00000100:00000001:28.0:1773851876.617160:0:82937:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851876.617160:0:82937:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:24.0:1773851876.617160:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000040:15.0:1773851876.617160:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000c8209d04 x1859601617803456 msgsize 3144
00010000:00000001:10.0:1773851876.617160:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617160:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:30.0:1773851876.617161:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 3880/3880 into md 0x77fdd4a5d [128] + 125104
00000100:00000001:28.0:1773851876.617161:0:82937:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617161:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617161:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851876.617161:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000800:00000200:14.0:1773851876.617161:0:2514739:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 TN_EVENT_TAG_TX_OK event status 0
00000100:00080000:13.1:1773851876.617161:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000c9294ed6 x1859601617814464/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 2072/0 e 5 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617161:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617162:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.617162:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:10.0:1773851876.617162:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851876.617163:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2408/2408 into md 0x77fdd4a5d [128] + 128984
00000800:00000200:30.0:1773851876.617163:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851876.617163:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:14.0:1773851876.617163:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:15.0:1773851876.617164:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:14.0:1773851876.617164:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000100:00000001:14.0:1773851876.617164:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:13.0:1773851876.617164:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:30.0:1773851876.617165:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:14.0:1773851876.617165:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:14.0:1773851876.617165:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009403fbb9.
00000100:00000001:13.0:1773851876.617165:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:31.0:1773851876.617166:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851876.617166:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22416@kfi7: PUT: OK
00000100:00000040:14.0:1773851876.617166:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000009403fbb9 x1859601617804544 msgsize 4016
00000100:00000001:13.0:1773851876.617166:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617166:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:31.0:1773851876.617167:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851876.617167:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851876.617167:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00002000:00100000:13.0:1773851876.617167:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x2400289ae:0x1da64:0x0]  req@00000000bc5a78ed x1859601617814464/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2072/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000010:30.0:1773851876.617168:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f9a00720.
00000100:00080000:28.1:1773851876.617168:0:82937:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000983d5af5 x1859601618567616/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 392/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:''
00000100:00100000:14.0:1773851876.617168:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:14.0:1773851876.617168:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851876.617169:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22416@kfi7: PUT: OK
00000100:00000040:30.0:1773851876.617169:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000f9a00720 x1859601617846208 msgsize 3880
00000400:00000200:14.0:1773851876.617169:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000100:00100000:30.0:1773851876.617170:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00080000:28.1:1773851876.617170:0:82937:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000814cfebd x1859601618567616/t0(0) o35->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 392/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000800:00000200:14.0:1773851876.617170:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 Transaction freed
00000100:00000001:30.0:1773851876.617172:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:13.0:1773851876.617172:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:30.0:1773851876.617173:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 3
00000100:00000001:28.0:1773851876.617173:0:82937:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00100000:13.0:1773851876.617173:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000bc5a78ed with x1859601617814464
00010000:00000001:13.0:1773851876.617173:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:31.0:1773851876.617174:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851876.617174:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:30.0:1773851876.617174:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851876.617174:0:61389:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:28.0:1773851876.617174:0:82937:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:13.0:1773851876.617174:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:10.1:1773851876.617174:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000fdf2070c x1859601620496704/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:200/0 lens 488/0 e 0 to 0 dl 1773852315 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000010:31.0:1773851876.617175:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076fddf96.
02000000:00000001:29.0:1773851876.617175:0:61389:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851876.617175:0:61389:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851876.617175:0:82937:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000040:13.0:1773851876.617175:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009045f510 refcount=3
00000020:00000001:13.0:1773851876.617175:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637087731504768 : -106985978046848 : ffff9eb262c85680)
00000100:00000040:31.0:1773851876.617176:0:2465875:0:(events.c:358:request_in_callback()) incoming req@0000000076fddf96 x1859601617847616 msgsize 2408
00000100:00000001:29.0:1773851876.617176:0:61389:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851876.617176:0:61389:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617176:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637087731504768 : -106985978046848 : ffff9eb262c85680)
00000100:00100000:29.0:1773851876.617177:0:61389:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617846208
00010000:00000001:13.0:1773851876.617177:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617177:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00080000:10.1:1773851876.617177:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000c9942368 x1859601620496704/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:554/0 lens 488/0 e 13 to 0 dl 1773851914 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00100000:31.0:1773851876.617178:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22416@kfi7)
00000100:00000001:31.0:1773851876.617178:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:29.0:1773851876.617178:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851876.617178:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00002000:00000001:13.0:1773851876.617178:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617178:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851876.617179:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000010c45545 nid 22416@kfi7 refs 2
00000020:00000001:29.0:1773851876.617179:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.617179:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000040:29.0:1773851876.617180:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=316
00000020:00000001:29.0:1773851876.617180:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.617180:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:31.0:1773851876.617181:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22416@kfi7(0000000080e1213a):0x0 lsk 4668 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000020:00000001:29.0:1773851876.617181:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.617181:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617181:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:29.0:1773851876.617182:0:61389:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851876.617182:0:61389:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851876.617183:0:61389:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000100:00080000:24.1:1773851876.617183:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000001dc89cc3 x1859601617807360/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2912/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617183:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028a9b:0xc23d:0x0]  req@00000000fdf2070c x1859601620496704/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:200/0 lens 488/0 e 0 to 0 dl 1773852315 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:29.0:1773851876.617184:0:61389:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851876.617185:0:61389:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00002000:00000001:10.0:1773851876.617185:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:29.0:1773851876.617186:0:61389:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00080000:24.1:1773851876.617186:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000499a171b x1859601617807360/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 2912/0 e 10 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617186:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fdf2070c with x1859601620496704
00010000:00000001:10.0:1773851876.617186:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:29.0:1773851876.617187:0:61389:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:29.0:1773851876.617187:0:61389:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617187:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:29.0:1773851876.617188:0:61389:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000040:10.0:1773851876.617188:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000df8bf01a refcount=3
00000020:00000001:10.0:1773851876.617188:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107986285120 : -106965723266496 : ffff9eb71a0fc240)
00000020:00000001:29.0:1773851876.617189:0:61389:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:29.0:1773851876.617189:0:61389:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:28.0:1773851876.617189:0:82937:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:24.0:1773851876.617189:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00010000:00000001:10.0:1773851876.617189:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107986285120 : -106965723266496 : ffff9eb71a0fc240)
00000020:00000001:29.0:1773851876.617190:0:61389:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000010:28.0:1773851876.617190:0:82937:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851876.617190:0:82937:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000100:00000001:24.0:1773851876.617190:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:13.0:1773851876.617190:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.617190:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00010000:00000001:10.0:1773851876.617190:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617190:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617190:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:29.0:1773851876.617191:0:61389:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000010:28.0:1773851876.617191:0:82937:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001aa5c9b3.
00000100:00000001:24.0:1773851876.617191:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851876.617191:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:13.0:1773851876.617191:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00002000:00000001:10.0:1773851876.617191:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851876.617192:0:61389:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:28.0:1773851876.617192:0:82937:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 315
00002000:00100000:24.0:1773851876.617192:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240028cd7:0x36eb:0x0]  req@000000001dc89cc3 x1859601617807360/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2912/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:13.0:1773851876.617192:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617192:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617192:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000001:00000001:29.0:1773851876.617193:0:61389:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851876.617193:0:61389:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851876.617193:0:82937:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:13.0:1773851876.617193:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00000001:13.0:1773851876.617193:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:10.0:1773851876.617193:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000001:00000001:29.0:1773851876.617194:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851876.617194:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000800:00000200:14.0:1773851876.617194:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000020:00000010:10.0:1773851876.617194:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000001:00000001:29.0:1773851876.617195:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851876.617195:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00000001:24.0:1773851876.617195:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617195:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000001dc89cc3 with x1859601617807360
00000800:00000200:14.0:1773851876.617195:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000100:00000001:13.0:1773851876.617195:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.617195:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.617195:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000040:10.0:1773851876.617195:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:10.0:1773851876.617195:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000001:00000001:29.0:1773851876.617196:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851876.617196:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617196:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617196:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.617196:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851876.617196:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617196:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:29.0:1773851876.617197:0:61389:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000040:24.0:1773851876.617197:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000877d078a refcount=3
00000020:00000001:24.0:1773851876.617197:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637140973330304 : -106932736221312 : ffff9ebec83e1f80)
00000800:00000200:14.0:1773851876.617197:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:13.0:1773851876.617197:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617818624
02000000:00000001:10.0:1773851876.617197:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617197:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:29.0:1773851876.617198:0:61389:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851876.617198:0:61389:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617198:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637140973330304 : -106932736221312 : ffff9ebec83e1f80)
00000020:00000001:13.0:1773851876.617198:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617198:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:10.0:1773851876.617198:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851876.617199:0:61389:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617199:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000800:00000200:14.0:1773851876.617199:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.617199:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617199:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
02000000:00000001:10.0:1773851876.617199:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.617199:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618628736
00002000:00000001:29.0:1773851876.617200:0:61389:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00010000:00000001:24.0:1773851876.617200:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617200:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:13.0:1773851876.617200:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617200:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617200:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:29.0:1773851876.617201:0:61389:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:29.0:1773851876.617201:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:24.0:1773851876.617201:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617201:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851876.617201:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617201:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617201:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617201:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00002000:00100000:29.0:1773851876.617202:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240024d9f:0x92ef:0x0]  req@00000000f9a00720 x1859601617846208/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3880/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:24.0:1773851876.617202:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:14.0:1773851876.617202:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000100:00000001:13.0:1773851876.617202:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617202:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:10.0:1773851876.617202:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617202:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:24.0:1773851876.617203:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000400:00000200:14.0:1773851876.617203:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617203:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000020:00000010:13.0:1773851876.617203:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617203:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000010:24.0:1773851876.617204:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851876.617204:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000020:00000010:13.0:1773851876.617204:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000100:00000001:10.0:1773851876.617204:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617204:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000100:00000001:24.0:1773851876.617205:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851876.617205:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617205:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000010:13.0:1773851876.617205:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00002000:00000001:29.0:1773851876.617206:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:29.0:1773851876.617206:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000f9a00720 with x1859601617846208
00000100:00000001:13.0:1773851876.617206:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.617206:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000010:10.0:1773851876.617206:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617206:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00010000:00000001:29.0:1773851876.617207:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:14.0:1773851876.617207:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000020:00000001:13.0:1773851876.617207:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617207:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:10.0:1773851876.617207:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:29.0:1773851876.617208:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:14.0:1773851876.617208:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617208:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:13.0:1773851876.617208:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:10.0:1773851876.617208:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617208:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:14.0:1773851876.617209:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4392 into portal 13 MB=0x69b4c3dda6700
00000020:00000001:13.0:1773851876.617209:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617209:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617209:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000040:29.0:1773851876.617210:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000a3e27b12 refcount=3
00000800:00000200:26.0:1773851876.617210:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00000001:24.0:1773851876.617210:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.617210:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:14.0:1773851876.617210:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4392/4392 into md 0x82a21912d [128] + 120720
00000020:00000001:13.0:1773851876.617210:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617210:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617210:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617210:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:29.0:1773851876.617211:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125403056320 : -106948306495296 : ffff9ebb282e98c0)
00000800:00000200:26.0:1773851876.617211:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:24.0:1773851876.617211:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.617211:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851876.617211:0:2514739:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4392 bytes in 2 frags
00000001:00000001:13.0:1773851876.617211:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617211:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617211:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617211:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851876.617212:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637125403056320 : -106948306495296 : ffff9ebb282e98c0)
00000800:00000200:26.0:1773851876.617212:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:24.0:1773851876.617212:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851876.617212:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617820224
00000001:00000001:13.0:1773851876.617212:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617212:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617212:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617212:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851876.617213:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:24.0:1773851876.617213:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000001:00000001:13.0:1773851876.617213:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617213:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:29.0:1773851876.617214:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:29.0:1773851876.617214:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000800:00000200:26.0:1773851876.617214:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000040:24.0:1773851876.617214:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:24.0:1773851876.617214:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:14.0:1773851876.617214:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000001:00000001:13.0:1773851876.617214:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617214:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00000001:29.0:1773851876.617215:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.617215:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000001:00000001:13.0:1773851876.617215:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617215:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617215:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617215:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000001:29.0:1773851876.617216:0:61389:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.617216:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000001:24.0:1773851876.617216:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:24.0:1773851876.617216:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:14.0:1773851876.617216:0:2514739:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 Using peer 22352@kfi7(0x1240)
00000020:00000001:13.0:1773851876.617216:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000001:00000001:10.0:1773851876.617216:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617216:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617217:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:13.0:1773851876.617217:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617217:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617217:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.617217:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.617218:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22353@kfi7 : PUT - for me
00000100:00000001:24.0:1773851876.617218:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851876.617218:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.617218:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617218:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.617219:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000400:00000200:26.0:1773851876.617219:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 1
00000020:00000010:24.0:1773851876.617219:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00002000:00000001:13.0:1773851876.617219:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617219:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617219:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617219:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000100:00080000:29.1F:1773851876.617220:0:61389:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000f9a00720 x1859601617846208/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3880/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:26.0:1773851876.617220:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22353@kfi7 to cpt 6
00000020:00000010:24.0:1773851876.617220:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00002000:00000001:13.0:1773851876.617220:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617220:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851876.617221:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000100:00000001:24.0:1773851876.617221:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617221:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:14.0:1773851876.617221:0:2514739:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2054@kfi7:3 TN 00000000ba933e94: Posted read of 4392 bytes in 2 frags kp 22352@kfi7(000000007a052420) rma_iov.key 2359298: rc=0
00002000:00100000:13.0:1773851876.617221:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2aba:0x0]  req@00000000afef894e x1859601617818624/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 2056/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617221:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:26.0:1773851876.617222:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 3
00000020:00000001:24.0:1773851876.617222:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.617222:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00002000:00100000:10.0:1773851876.617222:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024976:0xc367:0x0]  req@0000000060c5431c x1859601618628736/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:224/0 lens 488/0 e 0 to 0 dl 1773852339 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:26.0:1773851876.617223:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:24.0:1773851876.617223:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000800:00000200:14.0:1773851876.617223:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000100:00080000:29.1:1773851876.617224:0:61389:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000006bbc2b00 x1859601617846208/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:677/0 lens 3880/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:26.0:1773851876.617224:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 3008 into portal 13 MB=0x69b4c3ddac740
00000020:00000001:24.0:1773851876.617224:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617224:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00002000:00000001:13.0:1773851876.617224:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617224:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000afef894e with x1859601617818624
00002000:00000001:10.0:1773851876.617224:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000400:00000200:26.0:1773851876.617225:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 3008/3008 into md 0x1614fbabf9 [128] + 212656
00000020:00000001:24.0:1773851876.617225:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.617225:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617225:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617225:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00100000:10.0:1773851876.617225:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000060c5431c with x1859601618628736
00010000:00000001:10.0:1773851876.617225:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000001:00000001:24.0:1773851876.617226:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:10.0:1773851876.617226:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:29.0:1773851876.617227:0:61389:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000001:00000001:24.0:1773851876.617227:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617227:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000040:10.0:1773851876.617227:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009f86e7f7 refcount=3
00000020:00000001:10.0:1773851876.617227:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104776628480 : -106968932923136 : ffff9eb65ac04900)
00000100:00000001:29.0:1773851876.617228:0:61389:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:26.0:1773851876.617228:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:24.0:1773851876.617228:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617228:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:10.0:1773851876.617228:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104776628480 : -106968932923136 : ffff9eb65ac04900)
00000100:00000001:29.0:1773851876.617229:0:61389:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000001:00000001:24.0:1773851876.617229:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617229:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:10.0:1773851876.617229:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00000001:29.0:1773851876.617230:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:26.0:1773851876.617230:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:24.0:1773851876.617230:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617230:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00002000:00100000:29.0:1773851876.617231:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240024d9f:0x92ef:0x0]  req@00000000f9a00720 x1859601617846208/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3880/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:26.0:1773851876.617231:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22353@kfi7: PUT: OK
00000020:00000001:24.0:1773851876.617231:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617231:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851876.617232:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851876.617232:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000001:24.0:1773851876.617232:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.617232:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008507e494 refcount=3
00010000:00000001:10.0:1773851876.617232:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617232:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617232:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:26.0:1773851876.617233:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e6396b73.
00002000:00000001:24.0:1773851876.617233:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617233:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617233:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120363008512 : -106953346543104 : ffff9eb9fbc59200)
00010000:00000001:13.0:1773851876.617233:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637120363008512 : -106953346543104 : ffff9eb9fbc59200)
00000100:00000001:10.0:1773851876.617233:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:29.0:1773851876.617234:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000040:26.0:1773851876.617234:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000e6396b73 x1859601617831744 msgsize 3008
00002000:00000001:24.0:1773851876.617234:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:13.0:1773851876.617234:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00100000:29.0:1773851876.617235:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000f9a00720 with x1859601617846208
00002000:00100000:24.0:1773851876.617235:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240027840:0x9249:0x0]  req@000000003d57fa12 x1859601617820224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:126/0 lens 2640/0 e 0 to 0 dl 1773852241 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617235:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00080000:10.1:1773851876.617235:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000060c5431c x1859601618628736/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:224/0 lens 488/0 e 0 to 0 dl 1773852339 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:29.0:1773851876.617236:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851876.617236:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:26.0:1773851876.617236:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22353@kfi7)
00000100:00000001:26.0:1773851876.617236:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:13.0:1773851876.617236:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617236:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851876.617237:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000a3e27b12 refcount=3
00000400:00000200:26.0:1773851876.617237:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a1e4f353 nid 22353@kfi7 refs 2
00000800:00000200:14.0:1773851876.617237:0:2514739:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 TN_EVENT_TAG_TX_OK event status 0
00000100:00000001:13.0:1773851876.617237:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851876.617238:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125403056320 : -106948306495296 : ffff9ebb282e98c0)
00010000:00000001:29.0:1773851876.617238:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637125403056320 : -106948306495296 : ffff9ebb282e98c0)
00000800:00000200:26.0:1773851876.617238:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 22353@kfi7(00000000765e039b):0x0 lsk 4671 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:14.0:1773851876.617238:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00080000:10.1:1773851876.617238:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000020839344 x1859601618628736/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:578/0 lens 488/0 e 3 to 0 dl 1773851938 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:29.0:1773851876.617239:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851876.617240:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:29.0:1773851876.617240:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:14.0:1773851876.617240:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00002000:00000001:29.0:1773851876.617241:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617241:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617241:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003d57fa12 with x1859601617820224
00000100:00000001:14.0:1773851876.617241:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.617241:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:10.0:1773851876.617241:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000800:00000200:9.0:1773851876.617241:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00010000:00000001:24.0:1773851876.617242:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617242:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000010:14.0:1773851876.617242:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fd114c43.
00000100:00000040:14.0:1773851876.617242:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000fd114c43 x1859601617807104 msgsize 4392
00000100:00080000:13.1:1773851876.617242:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000afef894e x1859601617818624/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 2056/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617242:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:10.0:1773851876.617242:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851876.617242:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851876.617243:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00002000:00000001:10.0:1773851876.617243:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:9.0:1773851876.617243:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851876.617244:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00100000:14.0:1773851876.617244:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00002000:00100000:10.0:1773851876.617244:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024976:0xc367:0x0]  req@0000000060c5431c x1859601618628736/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:224/0 lens 488/0 e 0 to 0 dl 1773852339 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:24.0:1773851876.617245:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000004b3b9bfd refcount=3
00000020:00000001:24.0:1773851876.617245:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128703991104 : -106945005560512 : ffff9ebbeceedd40)
00000800:00000200:15.0:1773851876.617245:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:14.0:1773851876.617245:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00080000:13.1:1773851876.617245:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000db2d0843 x1859601617818624/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 2056/0 e 5 to 0 dl 1773851816 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:9.0:1773851876.617245:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00010000:00000001:24.0:1773851876.617246:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637128703991104 : -106945005560512 : ffff9ebbeceedd40)
00000400:00000200:14.0:1773851876.617246:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00002000:00000001:10.0:1773851876.617246:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:29.0:1773851876.617247:0:61389:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00000001:24.0:1773851876.617247:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:13.0:1773851876.617247:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00100000:10.0:1773851876.617247:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000060c5431c with x1859601618628736
00010000:00000001:10.0:1773851876.617247:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:9.0:1773851876.617247:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000010:29.0:1773851876.617248:0:61389:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00010000:00000001:24.0:1773851876.617248:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617248:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617248:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851876.617248:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851876.617248:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 Transaction freed
00000100:00000001:13.0:1773851876.617248:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:10.0:1773851876.617248:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617248:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009f86e7f7 refcount=3
00000400:00000200:9.0:1773851876.617248:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000020:00000010:29.0:1773851876.617249:0:61389:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000100:00000001:24.0:1773851876.617249:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617249:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617249:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617249:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104776628480 : -106968932923136 : ffff9eb65ac04900)
00000400:00000200:9.0:1773851876.617249:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.617249:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000020:00000010:29.0:1773851876.617250:0:61389:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000400:00000200:15.0:1773851876.617250:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00100000:13.0:1773851876.617250:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2aba:0x0]  req@00000000afef894e x1859601617818624/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 2056/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617250:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104776628480 : -106968932923136 : ffff9eb65ac04900)
00000400:00000200:9.0:1773851876.617250:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000040:29.0:1773851876.617251:0:61389:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00080000:24.1:1773851876.617251:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000003d57fa12 x1859601617820224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:126/0 lens 2640/0 e 0 to 0 dl 1773852241 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.617251:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00010000:00000001:10.0:1773851876.617251:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:9.0:1773851876.617251:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000100:00000001:29.0:1773851876.617252:0:61389:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851876.617252:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:10.0:1773851876.617252:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617252:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617252:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851876.617252:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000100:00000001:29.0:1773851876.617253:0:61389:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:15.0:1773851876.617253:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00002000:00000001:13.0:1773851876.617253:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617253:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000afef894e with x1859601617818624
00000400:00000200:9.0:1773851876.617253:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
02000000:00000001:29.0:1773851876.617254:0:61389:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851876.617254:0:61389:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00080000:24.1:1773851876.617254:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000d453c2d3 x1859601617820224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:682/0 lens 2640/0 e 4 to 0 dl 1773851840 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.617254:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:13.0:1773851876.617254:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617254:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:9.0:1773851876.617254:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3dda8f40
00000100:00000001:29.0:1773851876.617255:0:61389:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851876.617255:0:61389:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617255:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000040:13.0:1773851876.617255:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008507e494 refcount=3
00000400:00000200:9.0:1773851876.617255:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 126464
00000100:00100000:29.0:1773851876.617256:0:61389:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617847616
00000400:00000200:15.0:1773851876.617256:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000020:00000001:13.0:1773851876.617256:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120363008512 : -106953346543104 : ffff9eb9fbc59200)
00010000:00000001:13.0:1773851876.617256:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637120363008512 : -106953346543104 : ffff9eb9fbc59200)
00000020:00000001:29.0:1773851876.617257:0:61389:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851876.617257:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:24.0:1773851876.617257:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000400:00000200:15.0:1773851876.617257:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:13.0:1773851876.617257:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617257:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:10.0:1773851876.617257:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851876.617257:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:29.0:1773851876.617258:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851876.617258:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000400:00000200:15.0:1773851876.617258:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3e03ae40
00002000:00000001:13.0:1773851876.617258:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617258:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:10.0:1773851876.617258:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000400:00000200:9.0:1773851876.617258:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:29.0:1773851876.617259:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000100:00000001:24.0:1773851876.617259:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851876.617259:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:15.0:1773851876.617259:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x82a21912d [128] + 125112
00000100:00000001:13.0:1773851876.617259:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617259:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000001:29.0:1773851876.617260:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:29.0:1773851876.617260:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:13.0:1773851876.617260:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617260:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:10.0:1773851876.617260:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617260:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000100:00000001:29.0:1773851876.617261:0:61389:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00002000:00100000:24.0:1773851876.617261:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240027840:0x9249:0x0]  req@000000003d57fa12 x1859601617820224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:126/0 lens 2640/0 e 0 to 0 dl 1773852241 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:15.0:1773851876.617261:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:13.0:1773851876.617261:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617261:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851876.617261:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00000100:00000001:29.0:1773851876.617262:0:61389:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851876.617262:0:61389:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000040:13.0:1773851876.617262:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:10.0:1773851876.617262:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:9.0:1773851876.617262:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851876.617262:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000010:29.0:1773851876.617263:0:61389:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00002000:00000001:24.0:1773851876.617263:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617263:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000003d57fa12 with x1859601617820224
00000400:00000200:15.0:1773851876.617263:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851876.617263:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851876.617263:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617263:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000010:9.0:1773851876.617263:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000971e3bfe.
00000100:00000040:9.0:1773851876.617263:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000971e3bfe x1859601617817408 msgsize 488
00000020:00000010:29.0:1773851876.617264:0:61389:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00010000:00000001:24.0:1773851876.617264:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617264:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:15.0:1773851876.617264:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000800:00000200:14.0:1773851876.617264:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000001:13.0:1773851876.617264:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.617264:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617264:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.617264:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851876.617265:0:61389:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000040:24.0:1773851876.617265:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000004b3b9bfd refcount=3
00000100:00000001:15.0:1773851876.617265:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851876.617265:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:14.0:1773851876.617265:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:13.0:1773851876.617265:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617265:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.617265:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620446464
00000100:00100000:9.0:1773851876.617265:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:9.0:1773851876.617265:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:29.0:1773851876.617266:0:61389:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:29.0:1773851876.617266:0:61389:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.617266:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128703991104 : -106945005560512 : ffff9ebbeceedd40)
00010000:00000001:24.0:1773851876.617266:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637128703991104 : -106945005560512 : ffff9ebbeceedd40)
00000100:00000010:15.0:1773851876.617266:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ee9c8599.
00000800:00000200:14.0:1773851876.617266:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:13.0:1773851876.617266:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851876.617266:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617828480
00000020:00000001:10.0:1773851876.617266:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617266:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:9.0:1773851876.617266:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000020:00000001:29.0:1773851876.617267:0:61389:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851876.617267:0:61389:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00010000:00000001:24.0:1773851876.617267:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000040:15.0:1773851876.617267:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000ee9c8599 x1859601620512320 msgsize 488
00000020:00000001:13.0:1773851876.617267:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:10.0:1773851876.617267:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:9.0:1773851876.617267:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000001:29.0:1773851876.617268:0:61389:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00010000:00000001:24.0:1773851876.617268:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617268:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617268:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851876.617268:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000020:00000040:13.0:1773851876.617268:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617268:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617268:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.617268:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:29.0:1773851876.617269:0:61389:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:29.0:1773851876.617269:0:61389:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000100:00000001:24.0:1773851876.617269:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:15.0:1773851876.617269:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000040:13.0:1773851876.617269:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000020:00000001:13.0:1773851876.617269:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617269:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:29.0:1773851876.617270:0:61389:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:29.0:1773851876.617270:0:61389:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000010:24.0:1773851876.617270:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:15.0:1773851876.617270:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000800:00000200:14.0:1773851876.617270:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.617270:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.617270:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.617270:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:29.0:1773851876.617271:0:61389:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617271:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000800:00000200:15.0:1773851876.617271:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:14.0:1773851876.617271:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:13.0:1773851876.617271:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617271:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617271:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000001:00000001:29.0:1773851876.617272:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851876.617272:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000010:24.0:1773851876.617272:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851876.617272:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00000020:00000010:13.0:1773851876.617272:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000010:10.0:1773851876.617272:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000001:00000001:29.0:1773851876.617273:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851876.617273:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000001:24.0:1773851876.617273:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851876.617273:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000400:00000200:14.0:1773851876.617273:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000010:13.0:1773851876.617273:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:10.0:1773851876.617273:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000100:00000001:10.0:1773851876.617273:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000001:00000001:29.0:1773851876.617274:0:61389:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851876.617274:0:61389:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617274:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:14.0:1773851876.617274:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000020:00000010:13.0:1773851876.617274:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00000001:10.0:1773851876.617274:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617274:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:29.0:1773851876.617275:0:61389:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:29.0:1773851876.617275:0:61389:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851876.617275:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.617275:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:14.0:1773851876.617275:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617275:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000100:00000001:13.0:1773851876.617275:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.617275:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617275:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617275:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000001:29.0:1773851876.617276:0:61389:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617276:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851876.617276:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617276:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617276:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617276:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851876.617277:0:61389:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:29.0:1773851876.617277:0:61389:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000100:00100000:24.0:1773851876.617277:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601619628032
00000400:00000200:14.0:1773851876.617277:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:14.0:1773851876.617277:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617277:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:10.0:1773851876.617277:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617277:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:29.0:1773851876.617278:0:61389:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617278:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617278:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:14.0:1773851876.617278:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2672 into portal 13 MB=0x69b4c3dda5a80
00000020:00000001:13.0:1773851876.617278:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851876.617278:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617278:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617278:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00002000:00000001:29.0:1773851876.617279:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:24.0:1773851876.617279:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617279:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=315
00000400:00000200:14.0:1773851876.617279:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2672/2672 into md 0x82a21912d [128] + 125600
00000020:00000001:13.0:1773851876.617279:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617279:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617279:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617279:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00002000:00100000:29.0:1773851876.617280:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240028973:0x2a1c:0x0]  req@0000000076fddf96 x1859601617847616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2408/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617280:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:13.0:1773851876.617280:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617280:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617280:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:24.0:1773851876.617281:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:14.0:1773851876.617281:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:13.0:1773851876.617281:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617281:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617281:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00000001:29.0:1773851876.617282:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:24.0:1773851876.617282:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617282:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:14.0:1773851876.617282:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:13.0:1773851876.617282:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617282:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617282:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617282:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:29.0:1773851876.617283:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000076fddf96 with x1859601617847616
00000020:00000010:24.0:1773851876.617283:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000400:00000200:14.0:1773851876.617283:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000001:00000001:13.0:1773851876.617283:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617283:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:10.0:1773851876.617283:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00010000:00000001:29.0:1773851876.617284:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:29.0:1773851876.617284:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000010:24.0:1773851876.617284:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851876.617284:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000100:00000001:14.0:1773851876.617284:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.617284:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000001:00000001:13.0:1773851876.617284:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617284:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.617284:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617284:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:14.0:1773851876.617285:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b74a3ce0.
00000100:00000040:14.0:1773851876.617285:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000b74a3ce0 x1859601617803904 msgsize 2672
00000020:00000001:13.0:1773851876.617285:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617285:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617286:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617286:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.617286:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617286:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617286:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617286:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617286:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851876.617287:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f2807069 refcount=3
00000020:00000001:29.0:1773851876.617287:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148090253312 : -106925619298304 : ffff9ec07071c000)
00000020:00000001:24.0:1773851876.617287:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00100000:14.0:1773851876.617287:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:14.0:1773851876.617287:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00002000:00000001:13.0:1773851876.617287:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617287:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617287:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:29.0:1773851876.617288:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637148090253312 : -106925619298304 : ffff9ec07071c000)
00000020:00000001:24.0:1773851876.617288:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000001:24.0:1773851876.617288:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:14.0:1773851876.617288:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00002000:00000001:13.0:1773851876.617288:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:10.0:1773851876.617288:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0x1807:0x0]  req@00000000cf80be40 x1859601620446464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:29.0:1773851876.617289:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:29.0:1773851876.617289:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:24.0:1773851876.617289:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851876.617289:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000800:00000200:14.0:1773851876.617289:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00002000:00100000:13.0:1773851876.617289:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2bcf:0x0]  req@00000000d7af5e95 x1859601617828480/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2792/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:29.0:1773851876.617290:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:29.0:1773851876.617290:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617290:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851876.617291:0:61389:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617291:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851876.617291:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617291:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000001:00000001:24.0:1773851876.617292:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617292:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00100000:10.0:1773851876.617292:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000cf80be40 with x1859601620446464
00010000:00000001:10.0:1773851876.617292:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00080000:29.1:1773851876.617293:0:61389:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000076fddf96 x1859601617847616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2408/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:24.0:1773851876.617293:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:10.0:1773851876.617293:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617293:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2a6630c refcount=3
00000001:00000001:24.0:1773851876.617294:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617294:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:10.0:1773851876.617294:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107986290880 : -106965723260736 : ffff9eb71a0fd8c0)
00000001:00000001:24.0:1773851876.617295:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617295:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00010000:00000001:10.0:1773851876.617295:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107986290880 : -106965723260736 : ffff9eb71a0fd8c0)
00000100:00080000:29.1:1773851876.617296:0:61389:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000596058c6 x1859601617847616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:683/0 lens 2408/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617296:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.617296:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617296:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:24.0:1773851876.617297:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617297:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617297:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00000001:10.0:1773851876.617297:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617297:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851876.617298:0:61389:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00000001:24.0:1773851876.617298:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00002000:00100000:13.0:1773851876.617298:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000d7af5e95 with x1859601617828480
00010000:00000001:13.0:1773851876.617298:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:10.0:1773851876.617298:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851876.617299:0:61389:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:24.0:1773851876.617299:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617299:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:13.0:1773851876.617299:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:10.1:1773851876.617299:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000cf80be40 x1859601620446464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:29.0:1773851876.617300:0:61389:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:29.0:1773851876.617300:0:61389:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851876.617300:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024a78:0x1655:0x0]  req@00000000ff44480f x1859601619628032/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:29.0:1773851876.617302:0:61389:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io07_021: refresh rw locks for [0x240028973:0x2a1c:0x0]  req@0000000076fddf96 x1859601617847616/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2408/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:13.0:1773851876.617302:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000003e02d1d refcount=3
00000020:00000001:13.0:1773851876.617302:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121654119168 : -106952055432448 : ffff9eba48ba5b00)
00000100:00080000:10.1:1773851876.617302:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000004b62bf3c x1859601620446464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 488/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:24.0:1773851876.617303:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00010000:00000001:13.0:1773851876.617303:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637121654119168 : -106952055432448 : ffff9eba48ba5b00)
00002000:00000001:29.0:1773851876.617304:0:61389:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617304:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ff44480f with x1859601619628032
00010000:00000001:24.0:1773851876.617304:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00010000:00000001:13.0:1773851876.617304:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617304:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00100000:29.0:1773851876.617305:0:61389:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000076fddf96 with x1859601617847616
00010000:00000001:29.0:1773851876.617305:0:61389:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617305:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617305:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ff93f4d7 refcount=3
00002000:00000001:13.0:1773851876.617305:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617305:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617305:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.617305:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:29.0:1773851876.617306:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851876.617306:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f2807069 refcount=3
00000020:00000001:24.0:1773851876.617306:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637159490534016 : -106914219017600 : ffff9ec317f43a80)
00000100:00000001:13.0:1773851876.617306:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617306:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:29.0:1773851876.617307:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148090253312 : -106925619298304 : ffff9ec07071c000)
00010000:00000001:24.0:1773851876.617307:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637159490534016 : -106914219017600 : ffff9ec317f43a80)
00002000:00000001:10.0:1773851876.617307:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:29.0:1773851876.617308:0:61389:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637148090253312 : -106925619298304 : ffff9ec07071c000)
00010000:00000001:29.0:1773851876.617308:0:61389:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617308:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00100000:10.0:1773851876.617308:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0x1807:0x0]  req@00000000cf80be40 x1859601620446464/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:29.0:1773851876.617309:0:61389:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851876.617309:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617309:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00080000:13.1:1773851876.617309:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000d7af5e95 x1859601617828480/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2792/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:29.0:1773851876.617310:0:61389:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:29.0:1773851876.617310:0:61389:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617310:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617310:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:24.0:1773851876.617311:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:13.1:1773851876.617311:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000bf3d3988 x1859601617828480/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:647/0 lens 2792/0 e 4 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617311:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000cf80be40 with x1859601620446464
00010000:00000001:10.0:1773851876.617311:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617312:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617312:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2a6630c refcount=3
00000020:00000001:10.0:1773851876.617313:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107986290880 : -106965723260736 : ffff9eb71a0fd8c0)
00010000:00000001:10.0:1773851876.617313:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637107986290880 : -106965723260736 : ffff9eb71a0fd8c0)
00000100:00000001:29.0:1773851876.617314:0:61389:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:13.0:1773851876.617314:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00010000:00000001:10.0:1773851876.617314:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000010:29.0:1773851876.617315:0:61389:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851876.617315:0:61389:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000100:00080000:24.1:1773851876.617315:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000ff44480f x1859601619628032/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617315:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:13.0:1773851876.617315:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00010000:00000001:10.0:1773851876.617315:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617315:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000010:29.0:1773851876.617316:0:61389:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00002000:00000001:13.0:1773851876.617316:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:10.0:1773851876.617316:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851876.617317:0:61389:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 314
00002000:00100000:13.0:1773851876.617317:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2bcf:0x0]  req@00000000d7af5e95 x1859601617828480/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2792/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:29.0:1773851876.617318:0:61389:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00080000:24.1:1773851876.617318:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000bd42ad6c x1859601619628032/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 488/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:13.0:1773851876.617319:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617320:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000d7af5e95 with x1859601617828480
00010000:00000001:13.0:1773851876.617320:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:24.0:1773851876.617321:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851876.617321:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:13.0:1773851876.617321:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617321:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000003e02d1d refcount=3
00000100:00000001:10.0:1773851876.617321:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617321:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000100:00000001:24.0:1773851876.617322:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:13.0:1773851876.617322:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121654119168 : -106952055432448 : ffff9eba48ba5b00)
00010000:00000001:13.0:1773851876.617322:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637121654119168 : -106952055432448 : ffff9eba48ba5b00)
00002000:00000001:24.0:1773851876.617323:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:10.0:1773851876.617323:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000010:10.0:1773851876.617323:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00002000:00100000:24.0:1773851876.617324:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024a78:0x1655:0x0]  req@00000000ff44480f x1859601619628032/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617324:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617324:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617324:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000040:10.0:1773851876.617324:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00002000:00000001:13.0:1773851876.617325:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617325:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851876.617325:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:24.0:1773851876.617326:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617326:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ff44480f with x1859601619628032
00000020:00000010:13.0:1773851876.617326:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000001:10.0:1773851876.617326:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617326:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00010000:00000001:24.0:1773851876.617327:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000800:00000200:14.0:1773851876.617327:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000020:00000010:13.0:1773851876.617327:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000100:00000001:10.0:1773851876.617327:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617327:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851876.617328:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:13.0:1773851876.617328:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
02000000:00000001:10.0:1773851876.617328:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851876.617329:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000040:13.0:1773851876.617329:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000100:00000001:13.0:1773851876.617329:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:10.0:1773851876.617329:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618841600
00000020:00000001:10.0:1773851876.617329:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:24.0:1773851876.617330:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.617330:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000040:10.0:1773851876.617330:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617330:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617331:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ff93f4d7 refcount=3
00000020:00000001:24.0:1773851876.617331:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637159490534016 : -106914219017600 : ffff9ec317f43a80)
00000800:00000200:14.0:1773851876.617331:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
02000000:00000001:13.0:1773851876.617331:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000040:10.0:1773851876.617331:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00010000:00000001:24.0:1773851876.617332:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637159490534016 : -106914219017600 : ffff9ec317f43a80)
00000100:00000001:13.0:1773851876.617332:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617332:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617332:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00010000:00000001:24.0:1773851876.617333:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
02000000:00000001:13.0:1773851876.617333:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617333:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00010000:00000001:24.0:1773851876.617334:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617334:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617334:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617334:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00100000:13.0:1773851876.617334:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617803456
00000020:00000001:13.0:1773851876.617334:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617334:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000800:00000200:11.0:1773851876.617334:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:10.0:1773851876.617334:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.617334:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:24.0:1773851876.617335:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:13.0:1773851876.617335:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617335:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000800:00000200:11.0:1773851876.617335:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000010:10.0:1773851876.617335:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000020:00000010:24.0:1773851876.617336:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:14.0:1773851876.617336:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000020:00000001:13.0:1773851876.617336:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:11.0:1773851876.617336:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000010:10.0:1773851876.617336:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000010:24.0:1773851876.617337:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000400:00000200:14.0:1773851876.617337:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617337:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000020:00000001:13.0:1773851876.617337:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:10.0:1773851876.617337:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000020:00000010:24.0:1773851876.617338:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000400:00000200:14.0:1773851876.617338:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:13.0:1773851876.617338:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617338:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:11.0:1773851876.617338:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:10.0:1773851876.617338:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000040:24.0:1773851876.617339:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000400:00000200:14.0:1773851876.617339:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000010:13.0:1773851876.617339:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617339:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617339:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000100:00000001:24.0:1773851876.617340:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851876.617340:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000020:00000010:13.0:1773851876.617340:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617340:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000020:00000001:10.0:1773851876.617340:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617340:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000100:00000001:24.0:1773851876.617341:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:14.0:1773851876.617341:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:13.0:1773851876.617341:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:11.0:1773851876.617341:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:10.0:1773851876.617341:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617341:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
02000000:00000001:24.0:1773851876.617342:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.617342:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.617342:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617342:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 3432 into portal 13 MB=0x69b4c3dda5940
00000100:00000001:13.0:1773851876.617342:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617342:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:11.0:1773851876.617342:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22417@kfi7 : PUT - for me
00000020:00000001:10.0:1773851876.617342:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
02000000:00000001:24.0:1773851876.617343:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617343:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 3432/3432 into md 0x82a21912d [128] + 128272
00000020:00000001:13.0:1773851876.617343:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617343:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:11.0:1773851876.617343:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000020:00000001:10.0:1773851876.617343:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617343:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00100000:24.0:1773851876.617344:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617806528
00000020:00000001:13.0:1773851876.617344:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:11.0:1773851876.617344:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000001:00000001:10.0:1773851876.617344:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617344:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:24.0:1773851876.617345:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617345:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617345:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617345:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000400:00000200:11.0:1773851876.617345:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22417@kfi7 to cpt 2
00000400:00000200:11.0:1773851876.617345:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00000001:00000001:10.0:1773851876.617345:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:24.0:1773851876.617346:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617346:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000800:00000200:14.0:1773851876.617346:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:13.0:1773851876.617346:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617346:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:11.0:1773851876.617346:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 4
00000001:00000001:10.0:1773851876.617346:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617346:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:24.0:1773851876.617347:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:24.0:1773851876.617347:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:14.0:1773851876.617347:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000001:00000001:13.0:1773851876.617347:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617347:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:11.0:1773851876.617347:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000001:00000001:10.0:1773851876.617347:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:24.0:1773851876.617348:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:15.0:1773851876.617348:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:14.0:1773851876.617348:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000001:00000001:13.0:1773851876.617348:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:11.0:1773851876.617348:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 488 into portal 13 MB=0x69b4c3dfb61c0
00000001:00000001:10.0:1773851876.617348:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617348:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:24.0:1773851876.617349:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851876.617349:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000800:00000200:15.0:1773851876.617349:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:14.0:1773851876.617349:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.617349:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000001:00000001:13.0:1773851876.617349:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617349:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:11.0:1773851876.617349:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 488/488 into md 0x7813a3b29 [128] + 126952
00000020:00000001:10.0:1773851876.617349:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617349:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617350:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000800:00000200:15.0:1773851876.617350:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000010:14.0:1773851876.617350:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa179b9f.
00000100:00000040:14.0:1773851876.617350:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000fa179b9f x1859601617803584 msgsize 3432
00000001:00000001:13.0:1773851876.617350:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617350:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617350:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617351:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.617351:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617351:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851876.617351:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00002000:00000001:10.0:1773851876.617351:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617351:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617352:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617352:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:15.0:1773851876.617352:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00100000:14.0:1773851876.617352:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:14.0:1773851876.617352:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:13.0:1773851876.617352:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617352:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:24.0:1773851876.617353:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.617353:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:14.0:1773851876.617353:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000001:13.0:1773851876.617353:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617353:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000400:00000200:11.0:1773851876.617353:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00002000:00100000:10.0:1773851876.617353:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0xb3b:0x0]  req@00000000c66a90dc x1859601618841600/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.617354:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000800:00000200:14.0:1773851876.617354:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000020:00000001:13.0:1773851876.617354:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617354:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000400:00000200:11.0:1773851876.617354:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22417@kfi7: PUT: OK
00002000:00100000:13.0:1773851876.617355:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2bba:0x0]  req@00000000c8209d04 x1859601617803456/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 3144/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:11.0:1773851876.617355:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851876.617355:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000400:00000200:15.0:1773851876.617356:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000100:00000010:11.0:1773851876.617356:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eb95e55c.
00002000:00000001:10.0:1773851876.617356:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617356:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c66a90dc with x1859601618841600
00000400:00000200:15.0:1773851876.617357:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000040:11.0:1773851876.617357:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000eb95e55c x1859601619968448 msgsize 488
00010000:00000001:10.0:1773851876.617357:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617357:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:15.0:1773851876.617358:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00002000:00000001:13.0:1773851876.617358:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617358:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c8209d04 with x1859601617803456
00000020:00000040:10.0:1773851876.617358:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000005968691 refcount=3
00000400:00000200:15.0:1773851876.617359:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:15.0:1773851876.617359:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00010000:00000001:13.0:1773851876.617359:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617359:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:11.0:1773851876.617359:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:11.0:1773851876.617359:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:10.0:1773851876.617359:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637084452924096 : -106989256627520 : ffff9eb19f5d2ac0)
00000400:00000200:11.0:1773851876.617360:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 3
00010000:00000001:10.0:1773851876.617360:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637084452924096 : -106989256627520 : ffff9eb19f5d2ac0)
00000400:00000200:15.0:1773851876.617361:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000800:00000200:11.0:1773851876.617361:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00010000:00000001:10.0:1773851876.617361:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617361:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617361:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000400:00000200:15.0:1773851876.617362:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:10.0:1773851876.617362:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617363:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000400:00000200:15.0:1773851876.617363:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 752 into portal 13 MB=0x69b4c3ddb6640
00000100:00000001:10.0:1773851876.617363:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617364:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:15.0:1773851876.617364:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 752/752 into md 0x82a21912d [128] + 131704
00000100:00080000:10.1:1773851876.617364:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000c66a90dc x1859601618841600/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617365:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851876.617365:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000040:13.0:1773851876.617365:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007c27bb81 refcount=3
00000020:00000001:24.0:1773851876.617366:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617366:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000800:00000200:15.0:1773851876.617366:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:13.0:1773851876.617366:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126220557568 : -106947488994048 : ffff9ebb58e8ad00)
00000001:00000001:24.0:1773851876.617367:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617367:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:15.0:1773851876.617367:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:13.0:1773851876.617367:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637126220557568 : -106947488994048 : ffff9ebb58e8ad00)
00010000:00000001:13.0:1773851876.617367:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00080000:10.1:1773851876.617367:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000005e195b8e x1859601618841600/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:679/0 lens 488/0 e 1 to 0 dl 1773852039 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:24.0:1773851876.617368:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617368:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:13.0:1773851876.617368:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617368:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000001:00000001:24.0:1773851876.617369:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617369:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:15.0:1773851876.617369:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00002000:00000001:13.0:1773851876.617369:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617369:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617370:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617370:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:15.0:1773851876.617370:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851876.617370:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000001:10.0:1773851876.617370:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.617370:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:24.0:1773851876.617371:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617371:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:15.0:1773851876.617371:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cf9dbede.
00000100:00000040:15.0:1773851876.617371:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000cf9dbede x1859601617872448 msgsize 752
00000100:00000001:10.0:1773851876.617371:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:24.0:1773851876.617372:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:13.1:1773851876.617372:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000c8209d04 x1859601617803456/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 3144/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617372:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:24.0:1773851876.617373:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617373:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851876.617373:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00002000:00100000:10.0:1773851876.617373:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0xb3b:0x0]  req@00000000c66a90dc x1859601618841600/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:24.0:1773851876.617374:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:15.0:1773851876.617374:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00002000:00100000:24.0:1773851876.617375:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024d2e:0xefac:0x0]  req@00000000a49395e3 x1859601617806528/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2312/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.617375:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000100:00080000:13.1:1773851876.617375:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e87e86ab x1859601617803456/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 3144/0 e 10 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617375:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000800:00000200:15.0:1773851876.617376:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00002000:00100000:10.0:1773851876.617376:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c66a90dc with x1859601618841600
00010000:00000001:10.0:1773851876.617376:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:13.0:1773851876.617377:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00000001:24.0:1773851876.617378:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617378:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000a49395e3 with x1859601617806528
00000100:00000001:13.0:1773851876.617378:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00010000:00000001:24.0:1773851876.617379:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:13.0:1773851876.617379:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617379:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617379:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:24.0:1773851876.617380:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00100000:13.0:1773851876.617380:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2bba:0x0]  req@00000000c8209d04 x1859601617803456/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 3144/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:10.0:1773851876.617380:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000005968691 refcount=3
00000020:00000001:10.0:1773851876.617380:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637084452924096 : -106989256627520 : ffff9eb19f5d2ac0)
00000020:00000040:24.0:1773851876.617381:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cd1974a1 refcount=3
00000020:00000001:24.0:1773851876.617381:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083215708736 : -106990493842880 : ffff9eb1559ec240)
00010000:00000001:10.0:1773851876.617381:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637084452924096 : -106989256627520 : ffff9eb19f5d2ac0)
00010000:00000001:24.0:1773851876.617382:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083215708736 : -106990493842880 : ffff9eb1559ec240)
00002000:00000001:13.0:1773851876.617382:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00010000:00000001:10.0:1773851876.617382:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617382:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851876.617383:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617383:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00100000:13.0:1773851876.617383:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000c8209d04 with x1859601617803456
00010000:00000001:13.0:1773851876.617383:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00002000:00000001:10.0:1773851876.617383:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617383:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617384:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617384:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617384:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:24.0:1773851876.617385:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617385:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617385:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007c27bb81 refcount=3
00000020:00000010:10.0:1773851876.617385:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617385:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000001:13.0:1773851876.617386:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126220557568 : -106947488994048 : ffff9ebb58e8ad00)
00010000:00000001:13.0:1773851876.617386:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637126220557568 : -106947488994048 : ffff9ebb58e8ad00)
00010000:00000001:13.0:1773851876.617387:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000010:10.0:1773851876.617387:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617387:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00010000:00000001:13.0:1773851876.617388:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617388:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:10.0:1773851876.617388:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00080000:24.1:1773851876.617389:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000a49395e3 x1859601617806528/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2312/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:13.0:1773851876.617389:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617389:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617390:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617390:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00080000:24.1:1773851876.617391:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000008c25b77d x1859601617806528/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 2312/0 e 10 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617391:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.617391:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.617392:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617864256
00000020:00000001:10.0:1773851876.617393:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617393:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:24.0:1773851876.617394:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.617394:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:10.0:1773851876.617394:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000010:13.0:1773851876.617395:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000040:10.0:1773851876.617395:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.617395:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:24.0:1773851876.617396:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:13.0:1773851876.617396:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:13.0:1773851876.617396:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.617396:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:24.0:1773851876.617397:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000040:13.0:1773851876.617397:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:10.0:1773851876.617397:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.617397:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00002000:00000001:24.0:1773851876.617398:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:13.0:1773851876.617398:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:10.0:1773851876.617398:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00002000:00100000:24.0:1773851876.617399:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024d2e:0xefac:0x0]  req@00000000a49395e3 x1859601617806528/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2312/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617399:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.617399:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:10.0:1773851876.617399:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000100:00000001:13.0:1773851876.617400:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617400:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:10.0:1773851876.617400:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00002000:00000001:24.0:1773851876.617401:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617401:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000a49395e3 with x1859601617806528
02000000:00000001:13.0:1773851876.617401:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617401:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.617401:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617401:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00010000:00000001:24.0:1773851876.617402:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00100000:13.0:1773851876.617402:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617804544
00000020:00000001:13.0:1773851876.617402:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:10.0:1773851876.617402:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.617403:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617403:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000cd1974a1 refcount=3
00000020:00000040:13.0:1773851876.617403:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617403:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:10.0:1773851876.617403:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851876.617404:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637083215708736 : -106990493842880 : ffff9eb1559ec240)
00000800:00000200:14.0:1773851876.617404:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000020:00000040:13.0:1773851876.617404:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.617404:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617404:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00010000:00000001:24.0:1773851876.617405:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637083215708736 : -106990493842880 : ffff9eb1559ec240)
00000800:00000200:14.0:1773851876.617405:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:13.0:1773851876.617405:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617405:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617405:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00010000:00000001:24.0:1773851876.617406:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617406:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:14.0:1773851876.617406:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:13.0:1773851876.617406:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:10.0:1773851876.617406:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617406:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00002000:00000001:24.0:1773851876.617407:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617407:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851876.617407:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:13.0:1773851876.617407:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851876.617407:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000001:00000001:10.0:1773851876.617407:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617407:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:24.0:1773851876.617408:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.617408:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000001:00000001:10.0:1773851876.617408:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617408:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617408:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000010:24.0:1773851876.617409:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:14.0:1773851876.617409:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000010:13.0:1773851876.617409:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000001:00000001:10.0:1773851876.617409:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617409:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617410:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:24.0:1773851876.617410:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000100:00000001:13.0:1773851876.617410:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:10.0:1773851876.617410:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.617410:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.617411:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000400:00000200:14.0:1773851876.617411:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000100:00000001:13.0:1773851876.617411:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617411:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617411:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617411:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617412:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851876.617412:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617412:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00000020:00000001:13.0:1773851876.617412:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:10.0:1773851876.617412:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617413:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:14.0:1773851876.617413:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617413:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00002000:00000001:10.0:1773851876.617413:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617413:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851876.617414:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.617414:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:14.0:1773851876.617414:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000001:13.0:1773851876.617414:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617414:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00002000:00000001:10.0:1773851876.617414:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:24.0:1773851876.617415:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851876.617415:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617415:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000400:00000200:14.0:1773851876.617415:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617415:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617415:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00002000:00100000:10.0:1773851876.617415:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028764:0xa724:0x0]  req@0000000082b7098b x1859601617864256/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1616/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00100000:24.0:1773851876.617416:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601619326720
00000400:00000200:14.0:1773851876.617416:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2048 into portal 13 MB=0x69b4c3ddab040
00000001:00000001:13.0:1773851876.617416:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617416:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:24.0:1773851876.617417:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617417:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000400:00000200:14.0:1773851876.617417:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2048/2048 into md 0x82a21912d [128] + 132456
00000001:00000001:13.0:1773851876.617417:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617417:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:24.0:1773851876.617418:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617418:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000001:00000001:13.0:1773851876.617418:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617418:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00002000:00000001:10.0:1773851876.617418:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617418:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000082b7098b with x1859601617864256
00000020:00000001:24.0:1773851876.617419:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:24.0:1773851876.617419:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:14.0:1773851876.617419:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:13.0:1773851876.617419:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617419:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00010000:00000001:10.0:1773851876.617419:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617419:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:14.0:1773851876.617420:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:13.0:1773851876.617420:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617420:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617421:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617421:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:14.0:1773851876.617421:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000020:00000001:13.0:1773851876.617421:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617422:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851876.617422:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000100:00000001:14.0:1773851876.617422:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.617422:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00002000:00000001:13.0:1773851876.617422:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617422:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617422:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f88c6a42 refcount=3
00000020:00000010:24.0:1773851876.617423:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000100:00000010:14.0:1773851876.617423:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007b64455b.
00002000:00000001:13.0:1773851876.617423:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617423:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119161250176 : -106954548301440 : ffff9eb9b4243180)
00000100:00000001:24.0:1773851876.617424:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617424:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000040:14.0:1773851876.617424:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000007b64455b x1859601617825856 msgsize 2048
00002000:00100000:13.0:1773851876.617424:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240027877:0xc9a4:0x0]  req@000000009403fbb9 x1859601617804544/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 4016/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617424:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637119161250176 : -106954548301440 : ffff9eb9b4243180)
00010000:00000001:10.0:1773851876.617424:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:24.0:1773851876.617425:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000100:00100000:14.0:1773851876.617425:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00010000:00000001:10.0:1773851876.617425:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617425:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:24.0:1773851876.617426:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.617426:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000100:00000001:14.0:1773851876.617426:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851876.617426:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00002000:00000001:10.0:1773851876.617426:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617426:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617427:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617427:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000800:00000200:14.0:1773851876.617427:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00002000:00000001:13.0:1773851876.617427:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617427:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000009403fbb9 with x1859601617804544
00000020:00000001:24.0:1773851876.617428:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.617428:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617428:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617428:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000001:00000001:24.0:1773851876.617429:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00080000:10.1:1773851876.617429:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000082b7098b x1859601617864256/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1616/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:24.0:1773851876.617430:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617430:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000040:13.0:1773851876.617430:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b8e993d3 refcount=3
00000001:00000001:24.0:1773851876.617431:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617431:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:13.0:1773851876.617431:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109508822656 : -106964200728960 : ffff9eb774cfd680)
00000001:00000001:24.0:1773851876.617432:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617432:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617432:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617432:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637109508822656 : -106964200728960 : ffff9eb774cfd680)
00010000:00000001:13.0:1773851876.617432:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:24.0:1773851876.617433:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00010000:00000001:13.0:1773851876.617433:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617433:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00080000:10.1:1773851876.617433:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000002798af57 x1859601617864256/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:718/0 lens 1616/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617434:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617434:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617434:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617435:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617435:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617435:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00000001:24.0:1773851876.617436:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617436:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617437:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:13.1:1773851876.617437:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000009403fbb9 x1859601617804544/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 4016/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617437:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00002000:00100000:24.0:1773851876.617438:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x2400249e6:0xa4e3:0x0]  req@0000000028552e3f x1859601619326720/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617438:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617438:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:13.1:1773851876.617439:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e90bcb0f x1859601617804544/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 4016/0 e 10 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617439:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028764:0xa724:0x0]  req@0000000082b7098b x1859601617864256/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 1616/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:24.0:1773851876.617441:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617441:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000028552e3f with x1859601619326720
00010000:00000001:24.0:1773851876.617442:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617442:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.617442:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00000001:10.0:1773851876.617442:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617442:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000082b7098b with x1859601617864256
00000100:00000001:13.0:1773851876.617443:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00010000:00000001:10.0:1773851876.617443:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617443:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617444:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007d324fc7 refcount=3
00000100:00000001:13.0:1773851876.617444:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000040:10.0:1773851876.617444:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f88c6a42 refcount=3
00000020:00000001:24.0:1773851876.617445:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138810448576 : -106934899103040 : ffff9ebe47532ac0)
00002000:00000001:13.0:1773851876.617445:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617445:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119161250176 : -106954548301440 : ffff9eb9b4243180)
00010000:00000001:24.0:1773851876.617446:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637138810448576 : -106934899103040 : ffff9ebe47532ac0)
00002000:00100000:13.0:1773851876.617446:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240027877:0xc9a4:0x0]  req@000000009403fbb9 x1859601617804544/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 4016/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617446:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637119161250176 : -106954548301440 : ffff9eb9b4243180)
00010000:00000001:24.0:1773851876.617447:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617447:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617447:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851876.617448:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617448:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617448:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617448:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000009403fbb9 with x1859601617804544
00002000:00000001:10.0:1773851876.617448:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617448:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617449:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617449:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617449:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617449:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.617449:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000040:13.0:1773851876.617450:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b8e993d3 refcount=3
00000020:00000010:10.0:1773851876.617450:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617450:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000100:00080000:24.1:1773851876.617451:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000028552e3f x1859601619326720/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:13.0:1773851876.617451:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109508822656 : -106964200728960 : ffff9eb774cfd680)
00000020:00000010:10.0:1773851876.617451:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00010000:00000001:13.0:1773851876.617452:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637109508822656 : -106964200728960 : ffff9eb774cfd680)
00010000:00000001:13.0:1773851876.617452:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000040:10.0:1773851876.617452:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00010000:00000001:13.0:1773851876.617453:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617453:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:10.0:1773851876.617453:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00080000:24.1:1773851876.617454:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000009951d6f6 x1859601619326720/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:542/0 lens 488/0 e 7 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:13.0:1773851876.617454:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617454:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617454:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617455:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617455:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.617456:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617457:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851876.617457:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:13.0:1773851876.617457:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.617457:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00100000:10.0:1773851876.617457:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618797504
00000020:00000001:10.0:1773851876.617457:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:24.0:1773851876.617458:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:13.0:1773851876.617458:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000040:10.0:1773851876.617458:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617458:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:24.0:1773851876.617459:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:13.0:1773851876.617459:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000040:13.0:1773851876.617459:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000040:10.0:1773851876.617459:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.617459:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00100000:24.0:1773851876.617460:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x2400249e6:0xa4e3:0x0]  req@0000000028552e3f x1859601619326720/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617460:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851876.617460:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.617461:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:10.0:1773851876.617461:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00002000:00000001:24.0:1773851876.617462:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617462:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000028552e3f with x1859601619326720
02000000:00000001:13.0:1773851876.617462:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.617462:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617462:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617462:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00010000:00000001:24.0:1773851876.617463:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:13.0:1773851876.617463:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851876.617463:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:10.0:1773851876.617463:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000001:24.0:1773851876.617464:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617464:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007d324fc7 refcount=3
00000100:00100000:13.0:1773851876.617464:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617807104
00000020:00000010:10.0:1773851876.617464:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000020:00000001:24.0:1773851876.617465:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138810448576 : -106934899103040 : ffff9ebe47532ac0)
00000020:00000001:13.0:1773851876.617465:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617465:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:10.0:1773851876.617465:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00010000:00000001:24.0:1773851876.617466:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637138810448576 : -106934899103040 : ffff9ebe47532ac0)
00010000:00000001:24.0:1773851876.617466:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:13.0:1773851876.617466:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617466:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000100:00000001:10.0:1773851876.617466:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617466:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00010000:00000001:24.0:1773851876.617467:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617467:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:13.0:1773851876.617467:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617467:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617467:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617467:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00002000:00000001:24.0:1773851876.617468:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617468:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:10.0:1773851876.617468:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000010:24.0:1773851876.617469:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000100:00000001:13.0:1773851876.617469:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617469:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:10.0:1773851876.617469:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617469:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000010:24.0:1773851876.617470:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:13.0:1773851876.617470:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.617470:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617471:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851876.617471:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000010:13.0:1773851876.617471:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000001:00000001:10.0:1773851876.617471:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617471:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617472:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:13.0:1773851876.617472:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00000001:13.0:1773851876.617472:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000001:00000001:10.0:1773851876.617472:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617472:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000001:24.0:1773851876.617473:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:13.0:1773851876.617473:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617473:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000001:00000001:10.0:1773851876.617473:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617473:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617473:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
02000000:00000001:24.0:1773851876.617474:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.617474:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:13.0:1773851876.617474:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000001:00000001:10.0:1773851876.617474:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617474:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:24.0:1773851876.617475:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617475:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:13.0:1773851876.617475:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617475:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851876.617476:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851876.617476:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617805888
00000020:00000001:13.0:1773851876.617476:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617476:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617476:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617476:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617477:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617477:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617477:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617477:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617478:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617478:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000800:00000200:14.0:1773851876.617478:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000001:00000001:13.0:1773851876.617478:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617478:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617478:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617478:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:24.0:1773851876.617479:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:14.0:1773851876.617479:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000001:00000001:13.0:1773851876.617479:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617479:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00100000:10.0:1773851876.617479:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024dce:0x5df4:0x0]  req@00000000e18e2448 x1859601618797504/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617480:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000800:00000200:14.0:1773851876.617480:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:13.0:1773851876.617480:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617480:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000001:24.0:1773851876.617481:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617481:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:13.0:1773851876.617481:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617481:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617482:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000800:00000200:14.0:1773851876.617482:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.617482:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617482:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617482:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617482:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000e18e2448 with x1859601618797504
00000020:00000010:24.0:1773851876.617483:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851876.617483:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.617483:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617483:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.617483:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617483:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851876.617484:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000400:00000200:14.0:1773851876.617484:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:13.0:1773851876.617484:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000040:10.0:1773851876.617484:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f14a88b0 refcount=3
00000100:00000001:24.0:1773851876.617485:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.617485:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000400:00000200:14.0:1773851876.617485:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000020:00000001:13.0:1773851876.617485:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617485:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110962622400 : -106962746929216 : ffff9eb7cb770fc0)
00000020:00000001:24.0:1773851876.617486:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.617486:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000400:00000200:14.0:1773851876.617486:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617486:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
00002000:00000001:13.0:1773851876.617486:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:13.0:1773851876.617486:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x24002352f:0x41b2:0x0]  req@00000000fd114c43 x1859601617807104/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4392/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617486:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637110962622400 : -106962746929216 : ffff9eb7cb770fc0)
00000020:00000001:24.0:1773851876.617487:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617487:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00010000:00000001:10.0:1773851876.617487:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:24.0:1773851876.617488:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.617488:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617488:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617488:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00010000:00000001:10.0:1773851876.617488:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617488:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617488:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617489:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000400:00000200:14.0:1773851876.617489:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00002000:00000001:13.0:1773851876.617489:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617489:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fd114c43 with x1859601617807104
00000100:00000001:10.0:1773851876.617489:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617490:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617490:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:14.0:1773851876.617490:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00010000:00000001:13.0:1773851876.617490:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617490:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000001:00000001:24.0:1773851876.617491:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617491:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000400:00000200:14.0:1773851876.617491:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4584 into portal 13 MB=0x69b4c3ddaab00
00000100:00080000:10.1:1773851876.617491:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000e18e2448 x1859601618797504/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:24.0:1773851876.617492:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617492:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617492:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617492:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4584/4584 into md 0x82a21912d [128] + 134504
00000020:00000001:24.0:1773851876.617493:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000800:00000200:14.0:1773851876.617493:0:2514739:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4584 bytes in 2 frags
00000100:00080000:10.1:1773851876.617493:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000001c7f81e3 x1859601618797504/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:679/0 lens 488/0 e 1 to 0 dl 1773852039 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617494:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617494:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617495:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851876.617495:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000020:00000040:13.0:1773851876.617495:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002ef68f5b refcount=3
00002000:00000001:24.0:1773851876.617496:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617496:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636925300662144 : -107148408889472 : ffff9e8c91265f80)
00000100:00000001:10.0:1773851876.617496:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000001:24.0:1773851876.617497:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617497:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000800:00000200:14.0:1773851876.617497:0:2514739:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 Using peer 22352@kfi7(0x1233)
00010000:00000001:13.0:1773851876.617497:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636925300662144 : -107148408889472 : ffff9e8c91265f80)
00010000:00000001:13.0:1773851876.617497:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:10.0:1773851876.617497:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:10.0:1773851876.617497:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00100000:24.0:1773851876.617498:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024a78:0x5985:0x0]  req@00000000edade0bb x1859601617805888/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 488/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617498:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617498:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617498:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:13.0:1773851876.617499:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.617499:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024dce:0x5df4:0x0]  req@00000000e18e2448 x1859601618797504/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:325/0 lens 488/0 e 0 to 0 dl 1773852440 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:14.0:1773851876.617500:0:2514739:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:3 TN 00000000ba933e94: Posted read of 4584 bytes in 2 frags kp 22352@kfi7(000000000fcd3eb6) rma_iov.key 2293761: rc=0
00000100:00000001:13.0:1773851876.617500:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617501:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617501:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000edade0bb with x1859601617805888
00000100:00080000:13.1:1773851876.617501:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000fd114c43 x1859601617807104/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4392/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:24.0:1773851876.617502:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000800:00000200:14.0:1773851876.617502:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00002000:00000001:10.0:1773851876.617502:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617502:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000e18e2448 with x1859601618797504
00000020:00000001:24.0:1773851876.617503:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617503:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c04e3724 refcount=4
00010000:00000001:10.0:1773851876.617503:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617504:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150608442496 : -106923101109120 : ffff9ec1068a4480)
00000020:00000001:10.0:1773851876.617504:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617504:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f14a88b0 refcount=3
00010000:00000001:24.0:1773851876.617505:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637150608442496 : -106923101109120 : ffff9ec1068a4480)
00000100:00080000:13.1:1773851876.617505:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000005d973b52 x1859601617807104/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 4392/0 e 10 to 0 dl 1773851816 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:10.0:1773851876.617505:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110962622400 : -106962746929216 : ffff9eb7cb770fc0)
00010000:00000001:10.0:1773851876.617506:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637110962622400 : -106962746929216 : ffff9eb7cb770fc0)
00010000:00000001:10.0:1773851876.617506:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851876.617507:0:61830:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 00000000c04e3724/0x21b6f08f07a27b3d lrc: 4/0,0 mode: PW/PW res: [0x240024a78:0x5985:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c6c expref: 314 pid: 61060 timeout: 615036 lvb_type: 0
00000100:00000001:13.0:1773851876.617507:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00010000:00000001:10.0:1773851876.617507:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617507:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:13.0:1773851876.617508:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00002000:00000001:10.0:1773851876.617508:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617509:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617509:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:10.0:1773851876.617509:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617509:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00002000:00100000:13.0:1773851876.617510:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x24002352f:0x41b2:0x0]  req@00000000fd114c43 x1859601617807104/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 4392/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:10.0:1773851876.617510:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00010000:00000040:24.0:1773851876.617511:0:61830:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004cd05f53 count: 3
00000020:00000010:10.0:1773851876.617511:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00010000:00000001:24.0:1773851876.617512:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617512:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000040:10.0:1773851876.617512:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00002000:00000001:24.0:1773851876.617513:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00010000:24.0:1773851876.617513:0:61830:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 00000000edade0bb
00002000:00000001:13.0:1773851876.617513:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617513:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fd114c43 with x1859601617807104
00000100:00000001:10.0:1773851876.617513:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:24.0:1773851876.617514:0:61830:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851876.617514:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617514:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.617514:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617514:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851876.617515:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851876.617515:0:2514739:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 TN_EVENT_TAG_TX_OK event status 0
00000020:00000040:13.0:1773851876.617515:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002ef68f5b refcount=3
00000100:00000001:10.0:1773851876.617515:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:13.0:1773851876.617516:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636925300662144 : -107148408889472 : ffff9e8c91265f80)
00000100:00000001:10.0:1773851876.617516:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.617516:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617517:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:13.0:1773851876.617517:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636925300662144 : -107148408889472 : ffff9e8c91265f80)
00010000:00000001:13.0:1773851876.617517:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00100000:10.0:1773851876.617517:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617805696
00000100:00080000:24.1:1773851876.617518:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000edade0bb x1859601617805888/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 488/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:14.0:1773851876.617518:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00010000:00000001:13.0:1773851876.617518:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617518:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:10.0:1773851876.617518:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617518:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617518:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:14.0:1773851876.617519:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851876.617519:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:14.0:1773851876.617519:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000890bbe22.
00002000:00000001:13.0:1773851876.617519:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617519:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000100:00000040:14.0:1773851876.617520:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000890bbe22 x1859601617824512 msgsize 4584
00000020:00000001:10.0:1773851876.617520:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617520:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00080000:24.1:1773851876.617521:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000069ad7697 x1859601617805888/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 488/0 e 10 to 0 dl 1773851815 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000800:00000200:15.0:1773851876.617521:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851876.617521:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000100:00100000:14.0:1773851876.617521:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:10.0:1773851876.617521:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:15.0:1773851876.617522:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:14.0:1773851876.617522:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851876.617522:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000100:00000001:10.0:1773851876.617522:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617522:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000100:00000001:24.0:1773851876.617523:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.617523:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617523:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000100:00000001:24.0:1773851876.617524:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000800:00000200:15.0:1773851876.617524:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851876.617524:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 35 trmk 1 tmk 0 trr 0 tta 0x1233 Transaction freed
00000020:00000010:13.0:1773851876.617524:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:10.0:1773851876.617524:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000100:00000001:24.0:1773851876.617525:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:24.0:1773851876.617525:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:13.0:1773851876.617525:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:13.0:1773851876.617525:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617525:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.617525:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00002000:00100000:24.0:1773851876.617526:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024a78:0x5985:0x0]  req@00000000edade0bb x1859601617805888/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 488/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000400:00000200:15.0:1773851876.617526:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000040:13.0:1773851876.617526:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000001:10.0:1773851876.617526:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617526:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:15.0:1773851876.617527:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22352@kfi7 : PUT - for me
00000100:00000001:13.0:1773851876.617527:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851876.617527:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000001:10.0:1773851876.617527:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:15.0:1773851876.617528:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:13.0:1773851876.617528:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:10.0:1773851876.617528:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617528:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00002000:00000001:24.0:1773851876.617529:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617529:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000edade0bb with x1859601617805888
00000400:00000200:15.0:1773851876.617529:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 1
02000000:00000001:13.0:1773851876.617529:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:10.0:1773851876.617529:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617530:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:15.0:1773851876.617530:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000100:00000001:13.0:1773851876.617530:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617530:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617530:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617530:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617531:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:15.0:1773851876.617531:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000400:00000200:15.0:1773851876.617531:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
02000000:00000001:13.0:1773851876.617531:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:13.0:1773851876.617531:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620512320
00000001:00000001:10.0:1773851876.617531:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617531:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000040:24.0:1773851876.617532:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c04e3724 refcount=4
00000020:00000001:24.0:1773851876.617532:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150608442496 : -106923101109120 : ffff9ec1068a4480)
00000400:00000200:15.0:1773851876.617532:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617532:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617532:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000001:00000001:10.0:1773851876.617532:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617532:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00010000:00000001:24.0:1773851876.617533:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637150608442496 : -106923101109120 : ffff9ec1068a4480)
00000400:00000200:15.0:1773851876.617533:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 4232 into portal 13 MB=0x69b4c3ddaa980
00000020:00000001:13.0:1773851876.617533:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617533:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000001:00000001:10.0:1773851876.617533:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617533:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851876.617534:0:61830:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 00000000c04e3724/0x21b6f08f07a27b3d lrc: 4/0,0 mode: PW/PW res: [0x240024a78:0x5985:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c6c expref: 314 pid: 61060 timeout: 615036 lvb_type: 0
00000020:00000001:13.0:1773851876.617534:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617534:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617534:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000400:00000200:15.0:1773851876.617535:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 4232/4232 into md 0x82a21912d [128] + 139088
00000100:00000001:13.0:1773851876.617535:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:10.0:1773851876.617535:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617535:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617536:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:10.0:1773851876.617536:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851876.617537:0:61830:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004cd05f53 count: 3
00010000:00000001:24.0:1773851876.617537:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000800:00000200:15.0:1773851876.617537:0:2513974:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4232 bytes in 2 frags
00000020:00000010:13.0:1773851876.617537:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000010:13.0:1773851876.617537:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00002000:00000001:10.0:1773851876.617537:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617537:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617538:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617538:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000010:13.0:1773851876.617538:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00002000:00000001:10.0:1773851876.617538:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00010000:24.0:1773851876.617539:0:61830:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 00000000edade0bb
00002000:00000001:24.0:1773851876.617539:0:61830:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851876.617539:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000100:00000001:13.0:1773851876.617539:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.617539:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00002000:00100000:10.0:1773851876.617539:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0x2a75:0x0]  req@00000000ace9a970 x1859601617805696/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 488/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:24.0:1773851876.617540:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:13.0:1773851876.617540:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617540:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000010:24.0:1773851876.617541:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000800:00000200:15.0:1773851876.617541:0:2513974:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 Using peer 22352@kfi7(0x1240)
00000020:00000001:13.0:1773851876.617541:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00002000:00000001:10.0:1773851876.617541:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000010:24.0:1773851876.617542:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:24.0:1773851876.617542:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.617542:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851876.617542:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00002000:00100000:10.0:1773851876.617542:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ace9a970 with x1859601617805696
00010000:00000001:10.0:1773851876.617542:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000040:24.0:1773851876.617543:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000001:13.0:1773851876.617543:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617543:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617543:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851876.617544:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851876.617544:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851876.617544:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000001:00000001:13.0:1773851876.617544:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617544:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617544:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000803087d4 refcount=4
00000020:00000001:10.0:1773851876.617544:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137417753088 : -106936291798528 : ffff9ebdf4505200)
00000100:00000001:24.0:1773851876.617545:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.617545:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:15.0:1773851876.617545:0:2513974:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2054@kfi7:3 TN 00000000a77a65b3: Posted read of 4232 bytes in 2 frags kp 22352@kfi7(000000007a052420) rma_iov.key 2359298: rc=0
00000001:00000001:13.0:1773851876.617545:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617545:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00010000:00000001:10.0:1773851876.617545:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637137417753088 : -106936291798528 : ffff9ebdf4505200)
00000100:00000001:24.0:1773851876.617546:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.617546:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851876.617546:0:2513974:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000800:00000200:14.0:1773851876.617546:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000001:00000001:13.0:1773851876.617546:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617546:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
02000000:00000001:24.0:1773851876.617547:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617547:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617547:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:10.0:1773851876.617547:0:61837:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 00000000803087d4/0x21b6f08f07a27ae2 lrc: 4/0,0 mode: PW/PW res: [0x240028973:0x2a75:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c65 expref: 313 pid: 61060 timeout: 615036 lvb_type: 0
00000100:00100000:24.0:1773851876.617548:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601618643712
00000020:00000001:24.0:1773851876.617548:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617548:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000800:00000200:14.0:1773851876.617548:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:13.0:1773851876.617548:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617548:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617549:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:13.0:1773851876.617549:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.617550:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000400:00000200:14.0:1773851876.617550:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000020:00000001:13.0:1773851876.617550:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:10.0:1773851876.617550:0:61837:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e3260aad count: 2
00010000:00000001:10.0:1773851876.617550:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:24.0:1773851876.617551:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:24.0:1773851876.617551:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000400:00000200:14.0:1773851876.617551:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22352@kfi7 : PUT - for me
00000400:00000200:14.0:1773851876.617551:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:13.0:1773851876.617551:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00010000:00000001:10.0:1773851876.617551:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617551:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:24.0:1773851876.617552:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:14.0:1773851876.617552:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00000020:00000001:13.0:1773851876.617552:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617552:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00010000:10.0:1773851876.617552:0:61837:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 00000000ace9a970
00002000:00000001:10.0:1773851876.617552:0:61837:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851876.617553:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851876.617553:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000400:00000200:14.0:1773851876.617553:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00000400:00000200:14.0:1773851876.617553:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00002000:00100000:13.0:1773851876.617553:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028951:0x2ad9:0x0]  req@00000000ee9c8599 x1859601620512320/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617553:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:24.0:1773851876.617554:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000400:00000200:14.0:1773851876.617554:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 4
00000400:00000200:14.0:1773851876.617555:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22352@kfi7 to cpt 3
00002000:00000001:13.0:1773851876.617555:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000010:24.0:1773851876.617556:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000400:00000200:14.0:1773851876.617556:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22352@kfi7 of length 2384 into portal 13 MB=0x69b4c3dda6e80
00002000:00100000:13.0:1773851876.617556:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ee9c8599 with x1859601620512320
00010000:00000001:13.0:1773851876.617556:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:24.0:1773851876.617557:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617557:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:14.0:1773851876.617557:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index d from 12345-22352@kfi7 of length 2384/2384 into md 0x82a21912d [128] + 143320
00000020:00000001:13.0:1773851876.617557:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:10.1:1773851876.617557:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000ace9a970 x1859601617805696/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 488/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617558:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.617558:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000040:13.0:1773851876.617558:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c02eda67 refcount=3
00000020:00000001:24.0:1773851876.617559:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000800:00000200:14.0:1773851876.617559:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:13.0:1773851876.617559:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637079191383872 : -106994518167744 : ffff9eb065c06f40)
00010000:00000001:13.0:1773851876.617559:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637079191383872 : -106994518167744 : ffff9eb065c06f40)
00000100:00080000:10.1:1773851876.617559:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000de5807e4 x1859601617805696/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 488/0 e 10 to 0 dl 1773851816 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617560:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617560:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000800:00000200:15.0:1773851876.617560:0:2513974:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 TN_EVENT_TAG_TX_OK event status 0
00000400:00000200:14.0:1773851876.617560:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:13.0:1773851876.617560:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:24.0:1773851876.617561:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.617561:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617561:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22352@kfi7: PUT: OK
00000100:00000001:14.0:1773851876.617561:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00010000:00000001:13.0:1773851876.617561:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617561:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617561:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617562:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851876.617562:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851876.617562:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:14.0:1773851876.617562:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000100:00000010:14.0:1773851876.617562:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f1afa03.
00000100:00000001:13.0:1773851876.617562:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617562:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000001:00000001:24.0:1773851876.617563:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617563:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000400:00000200:15.0:1773851876.617563:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22352@kfi7: PUT: OK
00000100:00000040:14.0:1773851876.617563:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000008f1afa03 x1859601617809024 msgsize 2384
00000100:00080000:13.1:1773851876.617563:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000ee9c8599 x1859601620512320/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617563:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000001:00000001:24.0:1773851876.617564:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617564:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00100000:14.0:1773851876.617564:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:10.0:1773851876.617564:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617564:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000001:00000001:24.0:1773851876.617565:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617565:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851876.617565:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00002000:00100000:10.0:1773851876.617565:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028973:0x2a75:0x0]  req@00000000ace9a970 x1859601617805696/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 488/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617566:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:24.0:1773851876.617566:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851876.617566:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 3
00000100:00080000:13.1:1773851876.617566:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000015b3f9f3 x1859601620512320/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 488/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617567:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851876.617567:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851876.617567:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000800:00000200:14.0:1773851876.617567:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 22352@kfi7(000000000fcd3eb6):0x0 lsk 4660 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000020:00000001:24.0:1773851876.617568:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617568:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000100:00000010:15.0:1773851876.617568:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005bcb43df.
00000100:00000040:15.0:1773851876.617568:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000005bcb43df x1859601617824128 msgsize 4232
00000100:00000001:13.0:1773851876.617568:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00000001:10.0:1773851876.617568:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617568:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ace9a970 with x1859601617805696
00000020:00000001:24.0:1773851876.617569:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617569:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:13.0:1773851876.617569:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00010000:00000001:10.0:1773851876.617569:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617569:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00100000:24.0:1773851876.617570:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240022c11:0x1bd30:0x0]  req@000000006c134c4d x1859601618643712/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:267/0 lens 488/0 e 0 to 0 dl 1773852382 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00100000:15.0:1773851876.617570:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22352@kfi7)
00000100:00000001:15.0:1773851876.617570:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:13.0:1773851876.617570:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617570:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000040:10.0:1773851876.617570:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000803087d4 refcount=4
00000400:00000200:15.0:1773851876.617571:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c89ac1b9 nid 22352@kfi7 refs 2
00002000:00100000:13.0:1773851876.617571:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028951:0x2ad9:0x0]  req@00000000ee9c8599 x1859601620512320/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:10.0:1773851876.617571:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137417753088 : -106936291798528 : ffff9ebdf4505200)
00010000:00000001:10.0:1773851876.617572:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637137417753088 : -106936291798528 : ffff9ebdf4505200)
00002000:00000001:24.0:1773851876.617573:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000800:00000200:15.0:1773851876.617573:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 22352@kfi7(000000007a052420):0x0 lsk 4673 rsk 36 tsk 36 trmk 2 tmk 0 trr 0 tta 0x1240 Transaction freed
00010000:00010000:10.0:1773851876.617573:0:61837:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 00000000803087d4/0x21b6f08f07a27ae2 lrc: 4/0,0 mode: PW/PW res: [0x240028973:0x2a75:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c65 expref: 314 pid: 61060 timeout: 615036 lvb_type: 0
00002000:00100000:24.0:1773851876.617574:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000006c134c4d with x1859601618643712
00010000:00000001:24.0:1773851876.617574:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00002000:00000001:13.0:1773851876.617574:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000001:24.0:1773851876.617575:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617575:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d1f86c38 refcount=3
00002000:00100000:13.0:1773851876.617575:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000ee9c8599 with x1859601620512320
00010000:00000001:13.0:1773851876.617575:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00010000:00000040:10.0:1773851876.617575:0:61837:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e3260aad count: 2
00000020:00000001:24.0:1773851876.617576:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636967408294080 : -107106301257536 : ffff9e965ef5d8c0)
00000020:00000001:13.0:1773851876.617576:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617576:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c02eda67 refcount=3
00010000:00000001:10.0:1773851876.617576:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617576:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851876.617577:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636967408294080 : -107106301257536 : ffff9e965ef5d8c0)
00000020:00000001:13.0:1773851876.617577:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637079191383872 : -106994518167744 : ffff9eb065c06f40)
00002000:00000001:10.0:1773851876.617577:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00010000:10.0:1773851876.617577:0:61837:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 00000000ace9a970
00010000:00000001:24.0:1773851876.617578:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617578:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637079191383872 : -106994518167744 : ffff9eb065c06f40)
00002000:00000001:10.0:1773851876.617578:0:61837:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.617578:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00000001:24.0:1773851876.617579:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:13.0:1773851876.617579:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617579:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000010:10.0:1773851876.617579:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00002000:00000001:24.0:1773851876.617580:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617580:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617580:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000010:10.0:1773851876.617580:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000100:00000001:24.0:1773851876.617581:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617581:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617581:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617581:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617581:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000010:13.0:1773851876.617582:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000001:10.0:1773851876.617582:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00080000:24.1:1773851876.617583:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000006c134c4d x1859601618643712/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:267/0 lens 488/0 e 0 to 0 dl 1773852382 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:13.0:1773851876.617583:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:13.0:1773851876.617583:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617583:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617583:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000040:13.0:1773851876.617584:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000100:00000001:10.0:1773851876.617584:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617584:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617585:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851876.617585:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851876.617586:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000011c460b6 x1859601618643712/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:621/0 lens 488/0 e 2 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617586:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.617586:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00100000:10.0:1773851876.617586:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617809216
00000020:00000001:10.0:1773851876.617586:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000001:13.0:1773851876.617587:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617587:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617587:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617587:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851876.617588:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
02000000:00000001:13.0:1773851876.617588:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617588:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000001:10.0:1773851876.617588:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:24.0:1773851876.617589:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00100000:13.0:1773851876.617589:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617803904
00000020:00000001:13.0:1773851876.617589:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617589:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617589:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:24.0:1773851876.617590:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:13.0:1773851876.617590:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.617590:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00002000:00000001:24.0:1773851876.617591:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000040:13.0:1773851876.617591:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:13.0:1773851876.617591:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.617591:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617591:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00002000:00100000:24.0:1773851876.617592:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240022c11:0x1bd30:0x0]  req@000000006c134c4d x1859601618643712/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:267/0 lens 488/0 e 0 to 0 dl 1773852382 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:13.0:1773851876.617592:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:10.0:1773851876.617592:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000100:00000001:13.0:1773851876.617593:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617593:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617593:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00002000:00000001:24.0:1773851876.617594:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000010:13.0:1773851876.617594:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617594:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.617594:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00002000:00100000:24.0:1773851876.617595:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000006c134c4d with x1859601618643712
00010000:00000001:24.0:1773851876.617595:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000010:13.0:1773851876.617595:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.617595:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617595:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.617596:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617596:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d1f86c38 refcount=3
00000020:00000010:13.0:1773851876.617596:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00000001:13.0:1773851876.617596:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:10.0:1773851876.617596:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:24.0:1773851876.617597:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636967408294080 : -107106301257536 : ffff9e965ef5d8c0)
00000100:00000001:13.0:1773851876.617597:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617597:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617597:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617597:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00010000:00000001:24.0:1773851876.617598:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636967408294080 : -107106301257536 : ffff9e965ef5d8c0)
00000020:00000001:13.0:1773851876.617598:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617598:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:10.0:1773851876.617598:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617598:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617599:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617599:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:13.0:1773851876.617599:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000001:00000001:10.0:1773851876.617599:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617599:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:24.0:1773851876.617600:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617600:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617600:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617600:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000001:00000001:10.0:1773851876.617600:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:24.0:1773851876.617601:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851876.617601:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000001:13.0:1773851876.617601:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617601:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617601:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617601:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617601:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000010:24.0:1773851876.617602:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000001:00000001:13.0:1773851876.617602:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617602:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617602:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617603:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000001:00000001:13.0:1773851876.617603:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:10.0:1773851876.617603:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000040:24.0:1773851876.617604:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000001:00000001:13.0:1773851876.617604:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617604:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617604:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:10.0:1773851876.617604:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617604:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617605:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000001:00000001:13.0:1773851876.617605:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617605:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617605:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617606:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.617606:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:13.0:1773851876.617606:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00002000:00000001:10.0:1773851876.617606:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617606:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617607:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.617607:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617607:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617607:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617607:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
02000000:00000001:24.0:1773851876.617608:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617608:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617608:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00002000:00100000:10.0:1773851876.617608:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240025010:0xaf19:0x0]  req@00000000954463f0 x1859601617809216/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 1760/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00100000:24.0:1773851876.617609:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617843008
00000020:00000001:24.0:1773851876.617609:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:13.0:1773851876.617609:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.617610:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:24.0:1773851876.617610:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:13.0:1773851876.617610:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000040:24.0:1773851876.617611:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:24.0:1773851876.617611:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00100000:13.0:1773851876.617611:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x2400276bf:0x19ef:0x0]  req@00000000b74a3ce0 x1859601617803904/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2672/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617611:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617611:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000954463f0 with x1859601617809216
00000020:00000001:24.0:1773851876.617612:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00010000:00000001:10.0:1773851876.617612:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617612:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851876.617613:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617613:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851876.617614:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00002000:00000001:13.0:1773851876.617614:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617614:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000b74a3ce0 with x1859601617803904
00000020:00000010:24.0:1773851876.617615:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851876.617615:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00010000:00000001:13.0:1773851876.617615:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617615:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617615:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f4e64540 refcount=3
00000100:00000001:24.0:1773851876.617616:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:10.0:1773851876.617616:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637069980470656 : -107003729080960 : ffff9eae40bd0d80)
00000100:00000001:24.0:1773851876.617617:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.617617:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00010000:00000001:10.0:1773851876.617617:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637069980470656 : -107003729080960 : ffff9eae40bd0d80)
00010000:00000001:10.0:1773851876.617617:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:24.0:1773851876.617618:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.617618:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00010000:00000001:10.0:1773851876.617618:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:24.0:1773851876.617619:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000040:13.0:1773851876.617619:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008c9c4cad refcount=3
00002000:00000001:10.0:1773851876.617619:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617619:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617620:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851876.617620:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617620:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095100974208 : -106978608577408 : ffff9eb41a098480)
00010000:00000001:13.0:1773851876.617620:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095100974208 : -106978608577408 : ffff9eb41a098480)
00000100:00000001:10.0:1773851876.617620:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617621:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617621:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00010000:00000001:13.0:1773851876.617621:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000001:00000001:24.0:1773851876.617622:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617622:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:13.0:1773851876.617622:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617622:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617622:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:10.1:1773851876.617622:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000954463f0 x1859601617809216/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 1760/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:24.0:1773851876.617623:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617623:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:13.0:1773851876.617623:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617624:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617624:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617625:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617625:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00080000:10.1:1773851876.617625:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000001ac9456f x1859601617809216/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 1760/0 e 10 to 0 dl 1773851816 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617626:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617627:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617627:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617627:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00002000:00000001:24.0:1773851876.617628:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617628:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617628:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00002000:00000001:24.0:1773851876.617629:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00080000:13.1:1773851876.617629:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000b74a3ce0 x1859601617803904/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2672/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617629:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617629:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:24.0:1773851876.617630:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x2400277e9:0x4a6f:0x0]  req@000000002b6b44c1 x1859601617843008/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4336/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617630:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240025010:0xaf19:0x0]  req@00000000954463f0 x1859601617809216/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 1760/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:13.1:1773851876.617632:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000007e4e7333 x1859601617803904/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 2672/0 e 10 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617633:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617633:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000954463f0 with x1859601617809216
00000100:00000001:13.0:1773851876.617634:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00010000:00000001:10.0:1773851876.617634:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617634:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:24.0:1773851876.617635:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:13.0:1773851876.617635:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000040:10.0:1773851876.617635:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000f4e64540 refcount=3
00002000:00100000:24.0:1773851876.617636:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000002b6b44c1 with x1859601617843008
00000100:00000001:13.0:1773851876.617636:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617636:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617636:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637069980470656 : -107003729080960 : ffff9eae40bd0d80)
00010000:00000001:24.0:1773851876.617637:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617637:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00100000:13.0:1773851876.617637:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x2400276bf:0x19ef:0x0]  req@00000000b74a3ce0 x1859601617803904/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 2672/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617637:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637069980470656 : -107003729080960 : ffff9eae40bd0d80)
00010000:00000001:10.0:1773851876.617638:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617638:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617638:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617639:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617640:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.617640:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000040:24.0:1773851876.617641:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000098ec5657 refcount=3
00000020:00000010:10.0:1773851876.617641:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000001:24.0:1773851876.617642:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127081961600 : -106946627590016 : ffff9ebb8c40a880)
00000020:00000010:10.0:1773851876.617642:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00010000:00000001:24.0:1773851876.617643:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637127081961600 : -106946627590016 : ffff9ebb8c40a880)
00002000:00000001:13.0:1773851876.617643:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617643:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000b74a3ce0 with x1859601617803904
00000020:00000040:10.0:1773851876.617643:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00010000:00000001:24.0:1773851876.617644:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617644:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:13.0:1773851876.617644:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617644:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.617644:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:24.0:1773851876.617645:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617645:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.617645:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008c9c4cad refcount=3
00000100:00000001:10.0:1773851876.617645:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:24.0:1773851876.617646:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617646:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095100974208 : -106978608577408 : ffff9eb41a098480)
00010000:00000001:13.0:1773851876.617646:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095100974208 : -106978608577408 : ffff9eb41a098480)
02000000:00000001:10.0:1773851876.617646:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617646:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:13.0:1773851876.617647:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:10.0:1773851876.617647:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851876.617647:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851876.617648:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000002b6b44c1 x1859601617843008/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4336/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617648:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617648:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00100000:10.0:1773851876.617648:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620296512
00002000:00000001:13.0:1773851876.617649:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617649:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000100:00080000:24.1:1773851876.617650:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000020316544 x1859601617843008/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:667/0 lens 4336/0 e 3 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:10.0:1773851876.617650:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617650:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617651:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.617651:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617652:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:24.0:1773851876.617653:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.617653:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851876.617653:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.617653:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:24.0:1773851876.617654:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:13.0:1773851876.617654:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:10.0:1773851876.617654:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000100:00000001:24.0:1773851876.617655:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:13.0:1773851876.617655:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000010:10.0:1773851876.617655:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00002000:00000001:24.0:1773851876.617656:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:13.0:1773851876.617656:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000040:13.0:1773851876.617656:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000010:10.0:1773851876.617656:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00002000:00100000:24.0:1773851876.617657:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x2400277e9:0x4a6f:0x0]  req@000000002b6b44c1 x1859601617843008/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4336/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617657:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.617657:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.617657:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:13.0:1773851876.617658:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:10.0:1773851876.617658:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617658:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00002000:00000001:24.0:1773851876.617659:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617659:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000002b6b44c1 with x1859601617843008
02000000:00000001:13.0:1773851876.617659:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.617659:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617659:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617659:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000001:10.0:1773851876.617659:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00010000:00000001:24.0:1773851876.617660:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617660:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
02000000:00000001:13.0:1773851876.617660:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617660:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000040:24.0:1773851876.617661:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000098ec5657 refcount=3
00000020:00000001:24.0:1773851876.617661:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127081961600 : -106946627590016 : ffff9ebb8c40a880)
00000100:00100000:13.0:1773851876.617661:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617803584
00000020:00000001:13.0:1773851876.617661:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:10.0:1773851876.617661:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617661:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617662:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637127081961600 : -106946627590016 : ffff9ebb8c40a880)
00000020:00000040:13.0:1773851876.617662:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617662:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000001:00000001:10.0:1773851876.617662:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617662:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617663:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000040:13.0:1773851876.617663:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:13.0:1773851876.617663:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.617663:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617663:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00010000:00000001:24.0:1773851876.617664:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617664:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617664:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617664:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.617664:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617664:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000001:24.0:1773851876.617665:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:13.0:1773851876.617665:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617665:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:10.0:1773851876.617665:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617665:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617666:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:13.0:1773851876.617666:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.617666:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.617666:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851876.617667:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:24.0:1773851876.617667:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000010:13.0:1773851876.617667:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.617667:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617667:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.617668:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000010:13.0:1773851876.617668:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00002000:00000001:10.0:1773851876.617668:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000100:00000001:24.0:1773851876.617669:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851876.617669:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.617669:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617669:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617669:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:24.0:1773851876.617670:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.617670:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:13.0:1773851876.617670:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617670:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00002000:00100000:10.0:1773851876.617670:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024be5:0x7200:0x0]  req@00000000fcc0831a x1859601620296512/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:24.0:1773851876.617671:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.617671:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617671:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
02000000:00000001:24.0:1773851876.617672:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617672:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851876.617672:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000100:00100000:24.0:1773851876.617673:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601619281472
00000020:00000001:13.0:1773851876.617673:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617673:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617674:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617674:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:24.0:1773851876.617674:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000001:00000001:13.0:1773851876.617674:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617674:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.617675:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:24.0:1773851876.617675:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:13.0:1773851876.617675:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617675:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:24.0:1773851876.617676:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:13.0:1773851876.617676:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617676:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00000001:10.0:1773851876.617676:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617676:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fcc0831a with x1859601620296512
00000100:00000001:24.0:1773851876.617677:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617677:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:13.0:1773851876.617677:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617677:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.617677:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617677:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000010:24.0:1773851876.617678:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.617678:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617678:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617678:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d56b1270 refcount=3
00000020:00000010:24.0:1773851876.617679:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000001:13.0:1773851876.617679:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617679:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637088088236480 : -106985621315136 : ffff9eb2780ba1c0)
00010000:00000001:10.0:1773851876.617679:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637088088236480 : -106985621315136 : ffff9eb2780ba1c0)
00000020:00000010:24.0:1773851876.617680:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.617680:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617680:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00010000:00000001:10.0:1773851876.617680:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:24.0:1773851876.617681:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617681:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.617681:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617681:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617681:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:10.0:1773851876.617681:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617681:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617681:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617682:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851876.617682:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00002000:00100000:13.0:1773851876.617682:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240024b87:0x7a06:0x0]  req@00000000fa179b9f x1859601617803584/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 3432/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617682:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617683:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617684:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851876.617684:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000100:00080000:10.1:1773851876.617684:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000fcc0831a x1859601620296512/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617685:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617685:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617685:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fa179b9f with x1859601617803584
00000001:00000001:24.0:1773851876.617686:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851876.617686:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617686:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617686:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:10.1:1773851876.617686:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000ffe4a400 x1859601620296512/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 488/0 e 1 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:24.0:1773851876.617687:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617687:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617688:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617689:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617689:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000040:13.0:1773851876.617689:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000de852cec refcount=3
00000100:00000001:10.0:1773851876.617689:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000001:00000001:24.0:1773851876.617690:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617690:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617690:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637145234915328 : -106928474636288 : ffff9ebfc640c000)
00000100:00000001:10.0:1773851876.617690:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:24.0:1773851876.617691:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617691:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637145234915328 : -106928474636288 : ffff9ebfc640c000)
00000100:00000001:10.0:1773851876.617691:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617691:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:24.0:1773851876.617692:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617692:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617692:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00000001:24.0:1773851876.617693:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617693:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617693:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617693:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617693:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.617693:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024be5:0x7200:0x0]  req@00000000fcc0831a x1859601620296512/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:24.0:1773851876.617694:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:13.0:1773851876.617694:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:24.0:1773851876.617695:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x2400276b7:0x3346:0x0]  req@00000000f85862c4 x1859601619281472/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:96/0 lens 488/0 e 0 to 0 dl 1773852211 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617695:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00080000:13.1:1773851876.617696:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000fa179b9f x1859601617803584/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 3432/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617696:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fcc0831a with x1859601620296512
00010000:00000001:10.0:1773851876.617696:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617697:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617697:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d56b1270 refcount=3
00002000:00000001:24.0:1773851876.617698:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617698:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000f85862c4 with x1859601619281472
00000020:00000001:10.0:1773851876.617698:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637088088236480 : -106985621315136 : ffff9eb2780ba1c0)
00010000:00000001:10.0:1773851876.617698:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637088088236480 : -106985621315136 : ffff9eb2780ba1c0)
00010000:00000001:24.0:1773851876.617699:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851876.617699:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:13.1:1773851876.617699:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e90c8a54 x1859601617803584/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 3432/0 e 10 to 0 dl 1773851815 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617699:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000040:24.0:1773851876.617700:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000037aa1398 refcount=3
00010000:00000001:10.0:1773851876.617700:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617700:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617700:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617701:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095675810304 : -106978033741312 : ffff9eb43c4cd200)
00010000:00000001:24.0:1773851876.617701:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095675810304 : -106978033741312 : ffff9eb43c4cd200)
00000100:00000001:13.0:1773851876.617701:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.617701:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00000001:24.0:1773851876.617702:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:13.0:1773851876.617702:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:10.0:1773851876.617702:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00010000:00000001:24.0:1773851876.617703:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617703:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617703:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617703:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617703:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:24.0:1773851876.617704:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:13.0:1773851876.617704:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240024b87:0x7a06:0x0]  req@00000000fa179b9f x1859601617803584/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 3432/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:10.0:1773851876.617704:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000010:10.0:1773851876.617704:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617705:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00080000:24.1:1773851876.617706:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000f85862c4 x1859601619281472/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:96/0 lens 488/0 e 0 to 0 dl 1773852211 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617706:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:13.0:1773851876.617707:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617707:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000fa179b9f with x1859601617803584
00000100:00000001:10.0:1773851876.617707:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617707:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00010000:00000001:13.0:1773851876.617708:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617708:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.617708:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617708:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:24.1:1773851876.617709:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000e64a05df x1859601619281472/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:474/0 lens 488/0 e 9 to 0 dl 1773851810 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:13.0:1773851876.617709:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000de852cec refcount=3
02000000:00000001:10.0:1773851876.617709:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617710:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637145234915328 : -106928474636288 : ffff9ebfc640c000)
00010000:00000001:13.0:1773851876.617710:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637145234915328 : -106928474636288 : ffff9ebfc640c000)
00000100:00100000:10.0:1773851876.617710:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601620577856
00000020:00000001:10.0:1773851876.617710:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00010000:00000001:13.0:1773851876.617711:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617711:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000040:10.0:1773851876.617711:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:10.0:1773851876.617711:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:24.0:1773851876.617712:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:24.0:1773851876.617712:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00002000:00000001:13.0:1773851876.617712:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617712:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617712:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.617712:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:24.0:1773851876.617713:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:13.0:1773851876.617713:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:10.0:1773851876.617713:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00000001:24.0:1773851876.617714:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:13.0:1773851876.617714:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617714:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000100:00000001:10.0:1773851876.617714:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00002000:00100000:24.0:1773851876.617715:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x2400276b7:0x3346:0x0]  req@00000000f85862c4 x1859601619281472/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:96/0 lens 488/0 e 0 to 0 dl 1773852211 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:13.0:1773851876.617715:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617715:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617715:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000020:00000040:13.0:1773851876.617716:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000010:10.0:1773851876.617716:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00002000:00000001:24.0:1773851876.617717:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:13.0:1773851876.617717:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:10.0:1773851876.617717:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00002000:00100000:24.0:1773851876.617718:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000f85862c4 with x1859601619281472
00010000:00000001:24.0:1773851876.617718:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:13.0:1773851876.617718:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:10.0:1773851876.617718:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.617718:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:24.0:1773851876.617719:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
02000000:00000001:13.0:1773851876.617719:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.617719:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617719:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617719:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617719:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000040:24.0:1773851876.617720:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000037aa1398 refcount=3
00000020:00000001:24.0:1773851876.617720:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095675810304 : -106978033741312 : ffff9eb43c4cd200)
02000000:00000001:13.0:1773851876.617720:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617720:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00010000:00000001:24.0:1773851876.617721:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095675810304 : -106978033741312 : ffff9eb43c4cd200)
00000100:00100000:13.0:1773851876.617721:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617872448
00000020:00000001:13.0:1773851876.617721:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000001:10.0:1773851876.617721:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617721:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00010000:00000001:24.0:1773851876.617722:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851876.617722:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:10.0:1773851876.617722:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00002000:00000001:24.0:1773851876.617723:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:24.0:1773851876.617723:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617723:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617723:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00000001:24.0:1773851876.617724:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851876.617724:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000001:00000001:10.0:1773851876.617724:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.617727:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617728:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617728:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000001:00000001:10.0:1773851876.617728:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617728:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.617729:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.617729:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000010:24.0:1773851876.617730:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:24.0:1773851876.617730:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000001:13.0:1773851876.617730:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:10.0:1773851876.617730:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617730:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000040:24.0:1773851876.617731:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:13.0:1773851876.617731:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617731:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:10.0:1773851876.617731:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617731:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:24.0:1773851876.617732:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:13.0:1773851876.617732:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.617732:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617732:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617733:0:61830:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851876.617733:0:61830:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:13.0:1773851876.617733:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.617733:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617734:0:61830:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851876.617734:0:61830:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851876.617734:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00000001:13.0:1773851876.617734:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00002000:00000001:10.0:1773851876.617734:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617734:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851876.617735:0:61830:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851876.617735:0:61830:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617831744
00000100:00000001:13.0:1773851876.617735:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617735:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00002000:00000001:10.0:1773851876.617735:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:24.0:1773851876.617736:0:61830:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851876.617736:0:61830:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617736:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617736:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00002000:00100000:10.0:1773851876.617736:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024bbd:0x896b:0x0]  req@00000000a8355d51 x1859601620577856/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:150/0 lens 488/0 e 0 to 0 dl 1773852265 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617737:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617737:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:13.0:1773851876.617737:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617738:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617738:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617738:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.617739:0:61830:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617739:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617739:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00002000:00000001:10.0:1773851876.617739:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617739:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000a8355d51 with x1859601620577856
00000100:00000001:24.0:1773851876.617740:0:61830:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851876.617740:0:61830:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851876.617740:0:61830:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000001:00000001:13.0:1773851876.617740:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617740:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:10.0:1773851876.617740:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000010:24.0:1773851876.617741:0:61830:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000001:00000001:13.0:1773851876.617741:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617741:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617741:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:10.0:1773851876.617741:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617741:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000457cbe7 refcount=3
00000020:00000010:24.0:1773851876.617742:0:61830:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000001:00000001:13.0:1773851876.617742:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617742:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617742:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937571264 : -107144771980352 : ffff9e8d69ed33c0)
00000100:00000001:24.0:1773851876.617743:0:61830:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851876.617743:0:61830:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617743:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617743:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.617743:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937571264 : -107144771980352 : ffff9e8d69ed33c0)
00000020:00000001:24.0:1773851876.617744:0:61830:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.617744:0:61830:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617744:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.617744:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617744:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:13.0:1773851876.617745:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617745:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00002000:00000001:10.0:1773851876.617745:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617745:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617746:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617746:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:10.0:1773851876.617746:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617747:0:61830:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00002000:00100000:13.0:1773851876.617747:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x24002505c:0x12988:0x0]  req@00000000cf9dbede x1859601617872448/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 752/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:10.1:1773851876.617747:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000a8355d51 x1859601620577856/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:150/0 lens 488/0 e 0 to 0 dl 1773852265 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617748:0:61830:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851876.617749:0:61830:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:24.0:1773851876.617749:0:61830:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:24.0:1773851876.617750:0:61830:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617750:0:61830:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00080000:10.1:1773851876.617750:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000c08b41d6 x1859601620577856/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:669/0 lens 488/0 e 2 to 0 dl 1773851864 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:24.0:1773851876.617751:0:61830:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851876.617751:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617752:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617752:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617753:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:24.0:1773851876.617753:0:61830:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851876.617753:0:61830:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617753:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617753:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000cf9dbede with x1859601617872448
00000100:00000001:10.0:1773851876.617753:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.617753:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:24.0:1773851876.617754:0:61830:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00010000:00000001:13.0:1773851876.617754:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617754:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:10.0:1773851876.617754:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:24.0:1773851876.617755:0:61830:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851876.617755:0:61830:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617755:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:24.0:1773851876.617756:0:61830:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.617756:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024bbd:0x896b:0x0]  req@00000000a8355d51 x1859601620577856/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:150/0 lens 488/0 e 0 to 0 dl 1773852265 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:24.0:1773851876.617757:0:61830:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:24.0:1773851876.617757:0:61830:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.617757:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d189e154 refcount=3
00002000:00000001:24.0:1773851876.617758:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:13.0:1773851876.617758:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102819353600 : -106970890198016 : ffff9eb5e616a400)
00010000:00000001:13.0:1773851876.617758:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637102819353600 : -106970890198016 : ffff9eb5e616a400)
00002000:00000001:10.0:1773851876.617758:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:24.0:1773851876.617759:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024b81:0xba8e:0x0]  req@00000000e6396b73 x1859601617831744/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:125/0 lens 3008/0 e 0 to 0 dl 1773852240 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617759:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00100000:10.0:1773851876.617759:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000a8355d51 with x1859601620577856
00010000:00000001:10.0:1773851876.617759:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00010000:00000001:13.0:1773851876.617760:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617760:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:10.0:1773851876.617760:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617760:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000457cbe7 refcount=3
00002000:00000001:24.0:1773851876.617761:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00000001:13.0:1773851876.617761:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617761:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617761:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937571264 : -107144771980352 : ffff9e8d69ed33c0)
00002000:00100000:24.0:1773851876.617762:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000e6396b73 with x1859601617831744
00010000:00000001:24.0:1773851876.617762:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00010000:00000001:10.0:1773851876.617762:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937571264 : -107144771980352 : ffff9e8d69ed33c0)
00000020:00000001:24.0:1773851876.617763:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:13.1:1773851876.617763:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000cf9dbede x1859601617872448/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 752/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617763:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617763:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617763:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617764:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851876.617766:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000046cdce15 refcount=3
00000100:00080000:13.1:1773851876.617766:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000b2693a4c x1859601617872448/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 752/0 e 2 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:24.0:1773851876.617767:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637124108686400 : -106949600865216 : ffff9ebadb081440)
00010000:00000001:24.0:1773851876.617768:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637124108686400 : -106949600865216 : ffff9ebadb081440)
00010000:00000001:24.0:1773851876.617768:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:13.0:1773851876.617768:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.617768:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00000001:24.0:1773851876.617769:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617769:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00000001:13.0:1773851876.617769:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:10.0:1773851876.617769:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00002000:00000001:24.0:1773851876.617770:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617770:0:61830:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617770:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617770:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000010:10.0:1773851876.617770:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00002000:00100000:13.0:1773851876.617771:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x24002505c:0x12988:0x0]  req@00000000cf9dbede x1859601617872448/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 752/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:10.0:1773851876.617771:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617771:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00080000:24.1:1773851876.617772:0:61830:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000e6396b73 x1859601617831744/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:125/0 lens 3008/0 e 0 to 0 dl 1773852240 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617772:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.617773:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00002000:00000001:13.0:1773851876.617774:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617774:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000cf9dbede with x1859601617872448
02000000:00000001:10.0:1773851876.617774:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617774:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00080000:24.1:1773851876.617775:0:61830:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000d30a7b6c x1859601617831744/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:681/0 lens 3008/0 e 3 to 0 dl 1773851839 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617775:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617775:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617775:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d189e154 refcount=3
00000100:00000001:10.0:1773851876.617775:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617776:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637102819353600 : -106970890198016 : ffff9eb5e616a400)
02000000:00000001:10.0:1773851876.617776:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.617776:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617876224
00000100:00000001:24.0:1773851876.617777:0:61830:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00010000:00000001:13.0:1773851876.617777:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637102819353600 : -106970890198016 : ffff9eb5e616a400)
00000020:00000001:10.0:1773851876.617777:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617777:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00010000:00000001:13.0:1773851876.617778:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617778:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:10.0:1773851876.617778:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617778:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000100:00000001:24.0:1773851876.617779:0:61830:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:24.0:1773851876.617779:0:61830:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617779:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617779:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617779:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00002000:00000001:24.0:1773851876.617780:0:61830:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:13.0:1773851876.617780:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.617780:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.617780:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.617780:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00002000:00100000:24.0:1773851876.617781:0:61830:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io06_034: refresh rw locks for [0x240024b81:0xba8e:0x0]  req@00000000e6396b73 x1859601617831744/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:125/0 lens 3008/0 e 0 to 0 dl 1773852240 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:13.0:1773851876.617781:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000100:00000001:10.0:1773851876.617781:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617781:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000020:00000010:13.0:1773851876.617782:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000010:10.0:1773851876.617782:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00002000:00000001:24.0:1773851876.617783:0:61830:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000020:00000040:13.0:1773851876.617783:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000020:00000010:10.0:1773851876.617783:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00002000:00100000:24.0:1773851876.617784:0:61830:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000e6396b73 with x1859601617831744
00010000:00000001:24.0:1773851876.617784:0:61830:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:13.0:1773851876.617784:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.617784:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:24.0:1773851876.617785:0:61830:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851876.617785:0:61830:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000046cdce15 refcount=3
00000100:00000001:13.0:1773851876.617785:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.617785:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851876.617785:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617785:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:24.0:1773851876.617786:0:61830:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637124108686400 : -106949600865216 : ffff9ebadb081440)
00000100:00000001:13.0:1773851876.617786:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617786:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617786:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00010000:00000001:24.0:1773851876.617787:0:61830:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637124108686400 : -106949600865216 : ffff9ebadb081440)
00010000:00000001:24.0:1773851876.617787:0:61830:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
02000000:00000001:13.0:1773851876.617787:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851876.617788:0:61830:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:24.0:1773851876.617788:0:61830:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000100:00100000:13.0:1773851876.617788:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617825856
00000020:00000001:13.0:1773851876.617788:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617788:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00002000:00000001:24.0:1773851876.617789:0:61830:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617789:0:61830:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:13.0:1773851876.617789:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617789:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=314
00000020:00000001:10.0:1773851876.617789:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:10.0:1773851876.617789:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000010:24.0:1773851876.617790:0:61830:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000001:13.0:1773851876.617790:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617790:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617790:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000010:24.0:1773851876.617791:0:61830:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000001:13.0:1773851876.617791:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.617791:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:10.0:1773851876.617791:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617791:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000010:24.0:1773851876.617792:0:61830:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851876.617792:0:61830:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 313
00000100:00000001:13.0:1773851876.617792:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:10.0:1773851876.617792:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851876.617793:0:61830:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:13.0:1773851876.617793:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000001:00000001:10.0:1773851876.617793:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617793:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000010:13.0:1773851876.617794:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617794:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000001:00000001:10.0:1773851876.617794:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617794:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617794:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:13.0:1773851876.617795:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000001:00000001:10.0:1773851876.617795:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617795:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000100:00000001:13.0:1773851876.617796:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617796:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617796:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617797:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617797:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:10.0:1773851876.617797:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617797:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617798:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851876.617798:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00002000:00000001:10.0:1773851876.617798:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617799:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617799:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617799:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617799:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000001:00000001:13.0:1773851876.617800:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617800:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.617800:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240023540:0x4058:0x0]  req@0000000011dd21eb x1859601617876224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3896/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:13.0:1773851876.617801:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617802:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617802:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617803:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617803:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00002000:00000001:10.0:1773851876.617803:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617803:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000011dd21eb with x1859601617876224
00000001:00000001:13.0:1773851876.617804:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617804:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00010000:00000001:10.0:1773851876.617804:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617804:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:13.0:1773851876.617805:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617805:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617806:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617807:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617807:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617808:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000040:10.0:1773851876.617808:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000078e68c20 refcount=3
00002000:00100000:13.0:1773851876.617809:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028c5b:0x1c0cb:0x0]  req@000000007b64455b x1859601617825856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2048/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:10.0:1773851876.617809:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637088173404544 : -106985536147072 : ffff9eb27d1f3180)
00010000:00000001:10.0:1773851876.617810:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637088173404544 : -106985536147072 : ffff9eb27d1f3180)
00010000:00000001:10.0:1773851876.617810:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00000001:13.0:1773851876.617811:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00010000:00000001:10.0:1773851876.617811:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617811:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00100000:13.0:1773851876.617812:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000007b64455b with x1859601617825856
00010000:00000001:13.0:1773851876.617812:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00002000:00000001:10.0:1773851876.617812:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617812:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617813:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00080000:10.1:1773851876.617814:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000011dd21eb x1859601617876224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3896/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:13.0:1773851876.617816:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c02d2600 refcount=3
00000020:00000001:13.0:1773851876.617817:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151622756416 : -106922086795200 : ffff9ec142ff7840)
00000100:00080000:10.1:1773851876.617817:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000a3ba3376 x1859601617876224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:715/0 lens 3896/0 e 2 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617818:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637151622756416 : -106922086795200 : ffff9ec142ff7840)
00010000:00000001:13.0:1773851876.617819:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617819:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617819:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617820:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617820:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.617821:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617822:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00080000:13.1:1773851876.617823:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000007b64455b x1859601617825856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2048/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617823:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617823:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:10.0:1773851876.617824:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240023540:0x4058:0x0]  req@0000000011dd21eb x1859601617876224/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 3896/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:13.1:1773851876.617825:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000110ba353 x1859601617825856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:642/0 lens 2048/0 e 4 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617826:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617827:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000011dd21eb with x1859601617876224
00010000:00000001:10.0:1773851876.617827:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:13.0:1773851876.617828:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.617828:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:10.0:1773851876.617828:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617828:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000078e68c20 refcount=3
00000100:00000001:13.0:1773851876.617829:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000001:10.0:1773851876.617829:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637088173404544 : -106985536147072 : ffff9eb27d1f3180)
00002000:00000001:13.0:1773851876.617830:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00000001:10.0:1773851876.617830:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637088173404544 : -106985536147072 : ffff9eb27d1f3180)
00002000:00100000:13.0:1773851876.617831:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028c5b:0x1c0cb:0x0]  req@000000007b64455b x1859601617825856/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 2048/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617831:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617831:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617832:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617832:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617833:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617833:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000007b64455b with x1859601617825856
00000100:00000001:10.0:1773851876.617833:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00000001:13.0:1773851876.617834:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000010:10.0:1773851876.617834:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617834:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000001:13.0:1773851876.617835:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617835:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c02d2600 refcount=3
00000020:00000010:10.0:1773851876.617835:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000001:13.0:1773851876.617836:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151622756416 : -106922086795200 : ffff9ec142ff7840)
00000020:00000040:10.0:1773851876.617836:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00010000:00000001:13.0:1773851876.617837:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637151622756416 : -106922086795200 : ffff9ec142ff7840)
00000100:00000001:10.0:1773851876.617837:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851876.617838:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617838:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:10.0:1773851876.617838:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617838:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00002000:00000001:13.0:1773851876.617839:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617839:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617839:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617839:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617840:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.617840:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
02000000:00000001:10.0:1773851876.617840:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.617840:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617817408
00000020:00000010:13.0:1773851876.617841:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000020:00000001:10.0:1773851876.617841:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617841:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000010:13.0:1773851876.617842:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.617842:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617842:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000040:13.0:1773851876.617843:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000100:00000001:13.0:1773851876.617843:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851876.617843:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.617844:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:10.0:1773851876.617844:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
02000000:00000001:13.0:1773851876.617845:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.617845:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851876.617845:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617845:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
02000000:00000001:13.0:1773851876.617846:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617846:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851876.617846:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000100:00100000:13.0:1773851876.617847:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617824512
00000020:00000010:10.0:1773851876.617847:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000001:13.0:1773851876.617848:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617848:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000010:10.0:1773851876.617848:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000020:00000001:13.0:1773851876.617849:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617849:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000100:00000001:10.0:1773851876.617849:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851876.617849:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617850:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:10.0:1773851876.617850:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617850:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617851:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.617851:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000001:10.0:1773851876.617851:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000100:00000001:13.0:1773851876.617852:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:10.0:1773851876.617852:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617852:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000010:13.0:1773851876.617853:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.617853:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617853:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:13.0:1773851876.617854:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617854:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000001:00000001:10.0:1773851876.617854:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:10.0:1773851876.617854:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617855:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000001:00000001:10.0:1773851876.617855:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617855:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000100:00000001:13.0:1773851876.617856:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617856:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000001:00000001:10.0:1773851876.617856:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617856:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.617857:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000001:00000001:10.0:1773851876.617857:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617857:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617858:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:13.0:1773851876.617858:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617858:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.617858:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617859:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617859:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617859:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617860:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617860:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:10.0:1773851876.617860:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617860:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000001:00000001:13.0:1773851876.617861:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617861:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:10.0:1773851876.617861:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617861:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000001:00000001:13.0:1773851876.617862:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00002000:00100000:10.0:1773851876.617862:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028de2:0x1bae1:0x0]  req@00000000971e3bfe x1859601617817408/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 488/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000001:00000001:13.0:1773851876.617863:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617863:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617863:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617864:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617865:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617865:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617865:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617865:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000971e3bfe with x1859601617817408
00000020:00000001:13.0:1773851876.617866:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617866:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851876.617866:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617866:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:13.0:1773851876.617867:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000040:10.0:1773851876.617867:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003c8cb2cf refcount=4
00000020:00000001:13.0:1773851876.617868:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617868:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617868:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637007043672704 : -107066665878912 : ffff9e9f9969ba80)
00002000:00100000:13.0:1773851876.617869:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028a2a:0x2e08:0x0]  req@00000000890bbe22 x1859601617824512/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4584/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617869:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637007043672704 : -107066665878912 : ffff9e9f9969ba80)
00010000:00010000:10.0:1773851876.617870:0:61837:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8cb2cf/0x21b6f08f07a28053 lrc: 4/0,0 mode: PW/PW res: [0x240028de2:0x1bae1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c9d expref: 313 pid: 60788 timeout: 615036 lvb_type: 0
00002000:00000001:13.0:1773851876.617872:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617872:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000890bbe22 with x1859601617824512
00010000:00000001:13.0:1773851876.617873:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00010000:00000040:10.0:1773851876.617873:0:61837:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008a3be60e count: 2
00010000:00000001:10.0:1773851876.617873:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:13.0:1773851876.617874:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00010000:00000001:10.0:1773851876.617874:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.617874:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00010000:10.0:1773851876.617875:0:61837:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 00000000971e3bfe
00002000:00000001:10.0:1773851876.617875:0:61837:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.617876:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:13.0:1773851876.617877:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002cfe0970 refcount=3
00000020:00000001:13.0:1773851876.617877:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637163397638848 : -106910311912768 : ffff9ec400d5eac0)
00010000:00000001:13.0:1773851876.617878:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637163397638848 : -106910311912768 : ffff9ec400d5eac0)
00000100:00080000:10.1:1773851876.617878:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000971e3bfe x1859601617817408/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 488/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.617879:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617879:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617880:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617880:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:10.1:1773851876.617880:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000006a9ca59a x1859601617817408/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 488/0 e 5 to 0 dl 1773851816 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.617881:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617883:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00080000:13.1:1773851876.617884:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000890bbe22 x1859601617824512/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4584/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00000001:10.0:1773851876.617884:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:10.0:1773851876.617884:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617885:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00100000:10.0:1773851876.617886:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240028de2:0x1bae1:0x0]  req@00000000971e3bfe x1859601617817408/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 488/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:13.1:1773851876.617887:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000075e32b16 x1859601617824512/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:637/0 lens 4584/0 e 4 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617888:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617889:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000971e3bfe with x1859601617817408
00010000:00000001:10.0:1773851876.617889:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000001:13.0:1773851876.617890:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000020:00000001:10.0:1773851876.617890:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617890:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003c8cb2cf refcount=4
00000100:00000001:13.0:1773851876.617891:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000001:10.0:1773851876.617891:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637007043672704 : -107066665878912 : ffff9e9f9969ba80)
00010000:00000001:10.0:1773851876.617891:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637007043672704 : -107066665878912 : ffff9e9f9969ba80)
00000100:00000001:13.0:1773851876.617892:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617892:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00010000:00010000:10.0:1773851876.617892:0:61837:0:(ldlm_lockd.c:601:ldlm_refresh_waiting_lock()) ### refreshed to 885s ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8cb2cf/0x21b6f08f07a28053 lrc: 4/0,0 mode: PW/PW res: [0x240028de2:0x1bae1:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 22352@kfi7 remote: 0x9b15b96d92890c9d expref: 313 pid: 60788 timeout: 615036 lvb_type: 0
00002000:00100000:13.0:1773851876.617893:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028a2a:0x2e08:0x0]  req@00000000890bbe22 x1859601617824512/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4584/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000040:10.0:1773851876.617895:0:61837:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008a3be60e count: 2
00010000:00000001:10.0:1773851876.617895:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00002000:00000001:13.0:1773851876.617896:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617896:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000890bbe22 with x1859601617824512
00010000:00000001:10.0:1773851876.617896:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:13.0:1773851876.617897:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00002000:00000001:10.0:1773851876.617897:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00010000:10.0:1773851876.617897:0:61837:0:(mdt_io.c:199:mdt_rw_hpreq_check()) lustre5-MDT0001: refreshed 1 locks timeout for req 00000000971e3bfe
00000020:00000001:13.0:1773851876.617898:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617898:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002cfe0970 refcount=3
00002000:00000001:10.0:1773851876.617898:0:61837:0:(mdt_io.c:200:mdt_rw_hpreq_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851876.617898:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000001:13.0:1773851876.617899:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637163397638848 : -106910311912768 : ffff9ec400d5eac0)
00010000:00000001:13.0:1773851876.617899:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637163397638848 : -106910311912768 : ffff9ec400d5eac0)
00000020:00000010:10.0:1773851876.617899:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00010000:00000001:13.0:1773851876.617900:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000010:10.0:1773851876.617900:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00010000:00000001:13.0:1773851876.617901:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617901:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617901:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:10.0:1773851876.617901:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617901:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00000100:00000001:13.0:1773851876.617902:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851876.617902:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:13.0:1773851876.617903:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617903:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000100:00000001:10.0:1773851876.617903:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617903:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:13.0:1773851876.617904:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617904:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617904:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.617905:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 311
00000100:00000001:13.0:1773851876.617905:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851876.617905:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851876.617905:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601619968448
00000100:00000001:13.0:1773851876.617906:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000020:00000001:10.0:1773851876.617906:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617906:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
02000000:00000001:13.0:1773851876.617907:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.617907:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:10.0:1773851876.617907:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.617908:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851876.617908:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851876.617908:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=312
00000020:00000001:10.0:1773851876.617908:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00100000:13.0:1773851876.617909:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617809024
00000020:00000001:10.0:1773851876.617909:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617910:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851876.617910:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000100:00000001:10.0:1773851876.617910:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.617910:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000001:13.0:1773851876.617911:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617911:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000010:10.0:1773851876.617911:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000020:00000001:13.0:1773851876.617912:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000010:10.0:1773851876.617912:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617912:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000020:00000001:13.0:1773851876.617913:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:10.0:1773851876.617913:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.617914:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617914:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:10.0:1773851876.617914:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617914:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000010:13.0:1773851876.617915:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000020:00000001:10.0:1773851876.617915:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617915:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657552 : -1035894064 : ffffffffc24182d0)
00000020:00000010:13.0:1773851876.617916:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000001:10.0:1773851876.617916:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000010:13.0:1773851876.617917:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00000001:13.0:1773851876.617917:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:13.0:1773851876.617917:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617917:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617917:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617918:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:10.0:1773851876.617918:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617918:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:13.0:1773851876.617919:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:13.0:1773851876.617919:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000001:00000001:10.0:1773851876.617919:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617920:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:13.0:1773851876.617920:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000001:00000001:10.0:1773851876.617920:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617920:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.617921:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:13.0:1773851876.617921:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617921:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617921:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617921:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617922:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:13.0:1773851876.617922:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617922:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617922:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000001:00000001:13.0:1773851876.617923:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617923:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:10.0:1773851876.617923:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617924:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617924:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:10.0:1773851876.617924:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617924:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617925:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617925:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617925:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:10.0:1773851876.617925:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617926:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:13.0:1773851876.617926:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617926:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:13.0:1773851876.617927:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.617927:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240025319:0x6298:0x0]  req@00000000eb95e55c x1859601619968448/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:13.0:1773851876.617928:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617928:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617929:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.617929:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:10.0:1773851876.617929:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617930:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240027894:0x44a8:0x0]  req@000000008f1afa03 x1859601617809024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 2384/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00100000:10.0:1773851876.617930:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000eb95e55c with x1859601619968448
00010000:00000001:10.0:1773851876.617931:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617931:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617932:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d400b819 refcount=3
00000020:00000001:10.0:1773851876.617932:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637039515094976 : -107034194456640 : ffff9ea728dc4fc0)
00002000:00000001:13.0:1773851876.617933:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617933:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000008f1afa03 with x1859601617809024
00010000:00000001:10.0:1773851876.617933:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637039515094976 : -107034194456640 : ffff9ea728dc4fc0)
00010000:00000001:13.0:1773851876.617934:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00010000:00000001:10.0:1773851876.617934:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617934:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:13.0:1773851876.617935:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00002000:00000001:10.0:1773851876.617935:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617935:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617936:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:10.1:1773851876.617937:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000eb95e55c x1859601619968448/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:10.1:1773851876.617940:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000f8da1d8b x1859601619968448/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:218/0 lens 488/0 e 12 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000040:13.0:1773851876.617941:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007133ab2c refcount=3
00000020:00000001:13.0:1773851876.617941:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104507953600 : -106969201598016 : ffff9eb64abca1c0)
00010000:00000001:13.0:1773851876.617942:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104507953600 : -106969201598016 : ffff9eb64abca1c0)
00000100:00000001:10.0:1773851876.617942:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00010000:00000001:13.0:1773851876.617943:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:10.0:1773851876.617943:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00010000:00000001:13.0:1773851876.617944:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617944:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617944:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617944:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:10.0:1773851876.617944:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:13.0:1773851876.617945:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.617946:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240025319:0x6298:0x0]  req@00000000eb95e55c x1859601619968448/t0(0) o3->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 488/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:13.1:1773851876.617947:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000008f1afa03 x1859601617809024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 2384/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.617948:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.617948:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 00000000eb95e55c with x1859601619968448
00000100:00080000:13.1:1773851876.617949:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@0000000044bcd4f4 x1859601617809024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:658/0 lens 2384/0 e 10 to 0 dl 1773851816 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.617949:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.617950:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617950:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d400b819 refcount=3
00000020:00000001:10.0:1773851876.617951:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637039515094976 : -107034194456640 : ffff9ea728dc4fc0)
00010000:00000001:10.0:1773851876.617951:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637039515094976 : -107034194456640 : ffff9ea728dc4fc0)
00000100:00000001:13.0:1773851876.617952:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00010000:00000001:10.0:1773851876.617952:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.617952:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:13.0:1773851876.617953:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00002000:00000001:10.0:1773851876.617953:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.617953:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617954:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00002000:00000001:13.0:1773851876.617954:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:10.0:1773851876.617954:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00002000:00100000:13.0:1773851876.617955:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240027894:0x44a8:0x0]  req@000000008f1afa03 x1859601617809024/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:102/0 lens 2384/0 e 0 to 0 dl 1773852217 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000010:10.0:1773851876.617955:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617955:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000010:10.0:1773851876.617956:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.617957:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00002000:00000001:13.0:1773851876.617958:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:13.0:1773851876.617958:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000008f1afa03 with x1859601617809024
00000100:00000001:10.0:1773851876.617958:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:13.0:1773851876.617959:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.617959:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617959:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007133ab2c refcount=3
00000020:00000001:13.0:1773851876.617960:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104507953600 : -106969201598016 : ffff9eb64abca1c0)
00010000:00000001:13.0:1773851876.617961:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104507953600 : -106969201598016 : ffff9eb64abca1c0)
00010000:00000001:13.0:1773851876.617962:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617962:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617963:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.617963:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617963:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000001:13.0:1773851876.617964:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.617964:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000200:10.0:1773851876.617964:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_io
00000020:00000010:13.0:1773851876.617965:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000100:00000010:10.0:1773851876.617965:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000007290475.
00000100:00000040:10.0:1773851876.617965:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000007290475 x1859601617800704 msgsize 680
00000020:00000010:13.0:1773851876.617966:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000040:13.0:1773851876.617966:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 311
00000100:00000001:13.0:1773851876.617967:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:10.0:1773851876.617967:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-22352@kfi7 (source: 12345-22417@kfi7)
00000100:00000001:13.0:1773851876.617968:0:62918:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:13.0:1773851876.617968:0:62918:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:13.0:1773851876.617969:0:62918:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617969:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:13.0:1773851876.617970:0:62918:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:13.0:1773851876.617970:0:62918:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851876.617970:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000495a8f35 nid 22417@kfi7 refs 2
00000100:00100000:13.0:1773851876.617971:0:62918:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617824128
00000020:00000001:13.0:1773851876.617971:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:10.0:1773851876.617971:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 22417@kfi7(00000000a10bb126):0x0 lsk 4659 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000020:00000040:13.0:1773851876.617972:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617972:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.617972:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=312
00000020:00000001:13.0:1773851876.617973:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000020:00000001:13.0:1773851876.617974:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000100:00000001:13.0:1773851876.617974:0:62918:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:13.0:1773851876.617975:0:62918:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:13.0:1773851876.617975:0:62918:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000072557611.
00000100:00000001:10.0:1773851876.617975:0:61837:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851876.617975:0:61837:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000010:13.0:1773851876.617976:0:62918:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b1de3b11.
00000020:00000010:13.0:1773851876.617976:0:62918:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e7f9c57.
00000100:00000001:10.0:1773851876.617976:0:61837:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851876.617976:0:61837:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617977:0:62918:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
02000000:00000001:10.0:1773851876.617977:0:61837:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.617978:0:62918:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:13.0:1773851876.617978:0:62918:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00000020:00000001:13.0:1773851876.617978:0:62918:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00100000:10.0:1773851876.617978:0:61837:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601617800704
00000020:00000001:13.0:1773851876.617979:0:62918:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00000020:00000001:13.0:1773851876.617979:0:62918:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:10.0:1773851876.617979:0:61837:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851876.617979:0:61837:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd51
00000020:00000001:13.0:1773851876.617980:0:62918:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:13.0:1773851876.617980:0:62918:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617980:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.617980:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028ddc8fe refcount=313
00000020:00000001:13.0:1773851876.617981:0:62918:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617981:0:62918:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000001:10.0:1773851876.617981:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:13.0:1773851876.617982:0:62918:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:13.0:1773851876.617982:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:10.0:1773851876.617982:0:61837:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959180394496 : -107114529157120 : ffff9e94748a1000)
00000001:00000001:13.0:1773851876.617983:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617983:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:10.0:1773851876.617983:0:61837:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851876.617983:0:61837:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000001:00000001:13.0:1773851876.617984:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:13.0:1773851876.617984:0:62918:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:13.0:1773851876.617984:0:62918:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:10.0:1773851876.617984:0:61837:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f0e31c7a.
00000020:00000001:13.0:1773851876.617985:0:62918:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000010:10.0:1773851876.617985:0:61837:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.617985:0:61837:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000020:00000001:13.0:1773851876.617986:0:62918:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851876.617986:0:62918:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617986:0:61837:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000020:00000001:13.0:1773851876.617987:0:62918:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.617987:0:61837:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:10.0:1773851876.617987:0:61837:0:(tgt_handler.c:872:tgt_hpreq_handler()) Process entered
00002000:00000001:13.0:1773851876.617988:0:62918:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00000020:00000001:13.0:1773851876.617988:0:62918:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617988:0:61837:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:10.0:1773851876.617988:0:61837:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673657600 : -1035894016 : ffffffffc2418300)
00002000:00000001:13.0:1773851876.617989:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.617989:0:61837:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00002000:00100000:13.0:1773851876.617990:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2bc7:0x0]  req@000000005bcb43df x1859601617824128/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4232/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000020:00000001:10.0:1773851876.617990:0:61837:0:(tgt_handler.c:245:tgt_ost_body_unpack()) Process entered
00000020:00000001:10.0:1773851876.617990:0:61837:0:(tgt_handler.c:140:tgt_validate_obdo()) Process entered
00000020:00000001:10.0:1773851876.617991:0:61837:0:(tgt_handler.c:175:tgt_validate_obdo()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:10.0:1773851876.617991:0:61837:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00002000:00000001:13.0:1773851876.617992:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000001:00000001:10.0:1773851876.617992:0:61837:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:13.0:1773851876.617993:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000005bcb43df with x1859601617824128
00010000:00000001:13.0:1773851876.617993:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000001:00000001:10.0:1773851876.617993:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617993:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000020:00000001:13.0:1773851876.617994:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000001:00000001:10.0:1773851876.617994:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617994:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:10.0:1773851876.617994:0:61837:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:10.0:1773851876.617995:0:61837:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851876.617996:0:61837:0:(tgt_handler.c:192:tgt_io_data_unpack()) Process entered
00000020:00000001:10.0:1773851876.617996:0:61837:0:(tgt_handler.c:235:tgt_io_data_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:13.0:1773851876.617997:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006aa871f8 refcount=3
00000020:00000001:13.0:1773851876.617997:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104989615616 : -106968719936000 : ffff9eb667723600)
00000020:00000001:10.0:1773851876.617997:0:61837:0:(tgt_handler.c:296:tgt_ost_body_unpack()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:13.0:1773851876.617998:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104989615616 : -106968719936000 : ffff9eb667723600)
00000020:00000001:10.0:1773851876.617998:0:61837:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617998:0:61837:0:(mdt_io.c:231:mdt_hp_brw()) Process entered
00010000:00000001:13.0:1773851876.617999:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.617999:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.617999:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00000020:00000001:10.0:1773851876.617999:0:61837:0:(tgt_handler.c:895:tgt_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:10.0:1773851876.617999:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00002000:00000001:13.0:1773851876.618000:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851876.618000:0:62918:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:10.0:1773851876.618000:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024d12:0x1eabd:0x0]  req@0000000007290475 x1859601617800704/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 680/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:13.1:1773851876.618001:0:62918:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000005bcb43df x1859601617824128/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4232/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00000100:00080000:13.1:1773851876.618004:0:62918:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@000000007f0fb55f x1859601617824128/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:637/0 lens 4232/0 e 4 to 0 dl 1773852075 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.618004:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.618005:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000007290475 with x1859601617800704
00010000:00000001:10.0:1773851876.618005:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.618006:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:13.0:1773851876.618007:0:62918:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:13.0:1773851876.618007:0:62918:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:13.0:1773851876.618008:0:62918:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000040:10.0:1773851876.618008:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c63f37aa refcount=3
00002000:00000001:13.0:1773851876.618009:0:62918:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000020:00000001:10.0:1773851876.618009:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637021271053952 : -107052438497664 : ffff9ea2e96e5680)
00010000:00000001:10.0:1773851876.618009:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637021271053952 : -107052438497664 : ffff9ea2e96e5680)
00002000:00100000:13.0:1773851876.618010:0:62918:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io03_046: refresh rw locks for [0x240028973:0x2bc7:0x0]  req@000000005bcb43df x1859601617824128/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:361/0 lens 4232/0 e 0 to 0 dl 1773852476 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:10.0:1773851876.618010:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.618011:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.618011:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.618011:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00002000:00000001:13.0:1773851876.618012:0:62918:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00000100:00000001:10.0:1773851876.618012:0:61837:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00002000:00100000:13.0:1773851876.618013:0:62918:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 000000005bcb43df with x1859601617824128
00010000:00000001:13.0:1773851876.618013:0:62918:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:13.0:1773851876.618014:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:13.0:1773851876.618014:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006aa871f8 refcount=3
00000020:00000001:13.0:1773851876.618015:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104989615616 : -106968719936000 : ffff9eb667723600)
00010000:00000001:13.0:1773851876.618015:0:62918:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637104989615616 : -106968719936000 : ffff9eb667723600)
00000100:00080000:10.1:1773851876.618015:0:61837:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@0000000007290475 x1859601617800704/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 680/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00010000:00000001:13.0:1773851876.618016:0:62918:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:13.0:1773851876.618017:0:62918:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:13.0:1773851876.618018:0:62918:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:13.0:1773851876.618018:0:62918:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:10.1:1773851876.618018:0:61837:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000f3e1744e x1859601617800704/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:657/0 lens 680/448 e 10 to 0 dl 1773851815 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111597530610688'
00000100:00000001:13.0:1773851876.618021:0:62918:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:13.0:1773851876.618021:0:62918:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b1de3b11.
00000100:00000001:10.0:1773851876.618021:0:61837:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:10.0:1773851876.618021:0:61837:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000020:00000010:13.0:1773851876.618022:0:62918:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e7f9c57.
00000100:00000001:10.0:1773851876.618022:0:61837:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000020:00000010:13.0:1773851876.618023:0:62918:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000072557611.
00000020:00000040:13.0:1773851876.618023:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 312
00002000:00000001:10.0:1773851876.618023:0:61837:0:(mdt_io.c:167:mdt_rw_hpreq_check()) Process entered
00000100:00000001:13.0:1773851876.618024:0:62918:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00002000:00100000:10.0:1773851876.618024:0:61837:0:(mdt_io.c:192:mdt_rw_hpreq_check()) @@@ lustre5-MDT0001 mdt_io02_046: refresh rw locks for [0x240024d12:0x1eabd:0x0]  req@0000000007290475 x1859601617800704/t0(0) o4->f6432f30-f3f3-4037-af49-7d5e0ec2eef9@22352@kfi7:101/0 lens 680/0 e 0 to 0 dl 1773852216 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833111597530610688'
00002000:00000001:10.0:1773851876.618026:0:61837:0:(mdt_io.c:101:mdt_prolong_dom_lock()) Process entered
00002000:00100000:10.0:1773851876.618026:0:61837:0:(mdt_io.c:108:mdt_prolong_dom_lock()) Prolong DOM lock for req 0000000007290475 with x1859601617800704
00010000:00000001:10.0:1773851876.618027:0:61837:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851876.618027:0:61837:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851876.618028:0:61837:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c63f37aa refcount=3
00000020:00000001:10.0:1773851876.618028:0:61837:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637021271053952 : -107052438497664 : ffff9ea2e96e5680)
00010000:00000001:10.0:1773851876.618029:0:61837:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637021271053952 : -107052438497664 : ffff9ea2e96e5680)
00010000:00000001:10.0:1773851876.618030:0:61837:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851876.618030:0:61837:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00002000:00000001:10.0:1773851876.618031:0:61837:0:(mdt_io.c:120:mdt_prolong_dom_lock()) Process leaving
00002000:00000001:10.0:1773851876.618031:0:61837:0:(mdt_io.c:203:mdt_rw_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851876.618032:0:61837:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851876.618033:0:61837:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851876.618034:0:61837:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000010:10.0:1773851876.618035:0:61837:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f0e31c7a.
00000020:00000040:10.0:1773851876.618035:0:61837:0:(genops.c:882:class_export_put()) PUTting export 0000000028ddc8fe : new refcount 311
00000100:00000001:10.0:1773851876.618036:0:61837:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851876.622899:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851876.622901:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851876.622904:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851876.622908:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851876.622912:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851876.622914:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:21.0:1773851876.622916:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851876.622917:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:21.0:1773851876.622919:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851876.622920:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:21.0:1773851876.622921:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:21.0:1773851876.622922:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851876.622924:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee1c080
00000400:00000200:21.0:1773851876.622927:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 7208
00000800:00000200:21.0:1773851876.622930:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851876.622936:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851876.622938:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000100:00000001:21.0:1773851876.622940:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851876.622941:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851876.622942:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a1f6fc72.
00000100:00000040:21.0:1773851876.622944:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000a1f6fc72 x1858059204935808 msgsize 224
00000100:00100000:21.0:1773851876.622946:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2081@kfi7)
00000100:00000001:21.0:1773851876.622948:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851876.622950:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:22.0:1773851876.622952:0:1537183:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851876.622952:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:22.0:1773851876.622954:0:1537183:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:22.0:1773851876.622955:0:1537183:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:22.0:1773851876.622956:0:1537183:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:22.0:1773851876.622958:0:1537183:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:22.0:1773851876.622959:0:1537183:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204935808
00000020:00000001:22.0:1773851876.622961:0:1537183:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:22.0:1773851876.622961:0:1537183:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:22.0:1773851876.622963:0:1537183:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:22.0:1773851876.622965:0:1537183:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:22.0:1773851876.622966:0:1537183:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:22.0:1773851876.622968:0:1537183:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:22.0:1773851876.622970:0:1537183:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:22.0:1773851876.622971:0:1537183:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:22.0:1773851876.622972:0:1537183:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000756cfb42.
00000020:00000010:22.0:1773851876.622974:0:1537183:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000019fb147b.
00000020:00000010:22.0:1773851876.622976:0:1537183:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000063acde6a.
00000100:00000040:22.0:1773851876.622978:0:1537183:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:22.0:1773851876.622979:0:1537183:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:22.0:1773851876.622980:0:1537183:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:22.0:1773851876.622980:0:1537183:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851876.622983:0:1537183:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851876.622985:0:1537183:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851876.622987:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851876.622988:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851876.622988:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851876.622989:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851876.622990:0:1537152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 3084760
00000100:00000001:22.0:1773851876.622992:0:1537183:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851876.622992:0:1537152:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:22.0:1773851876.622993:0:1537183:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851876.622993:0:1537152:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794357504 : -106943915194112 : ffff9ebc2dec8900)
00000100:00000040:20.0:1773851876.622995:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a1f6fc72 x1858059204935808/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:20.0:1773851876.623000:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851876.623001:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851876.623002:0:1537152:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1f6fc72 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0003-mdtlov_UUID+5:52355:x1858059204935808:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:20.0:1773851876.623005:0:1537152:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204935808
00000020:00000001:20.0:1773851876.623006:0:1537152:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851876.623008:0:1537152:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851876.623009:0:1537152:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851876.623010:0:1537152:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851876.623011:0:1537152:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:20.0:1773851876.623012:0:1537152:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851876.623013:0:1537152:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851876.623014:0:1537152:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851876.623015:0:1537152:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851876.623016:0:1537152:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851876.623017:0:1537152:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851876.623018:0:1537152:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851876.623019:0:1537152:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000621f12d8.
02000000:00000001:20.0:1773851876.623020:0:1537152:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851876.623021:0:1537152:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851876.623023:0:1537152:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:20.0:1773851876.623025:0:1537152:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:20.0:1773851876.623025:0:1537152:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:20.0:1773851876.623027:0:1537152:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:20.0:1773851876.623030:0:1537152:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:20.0:1773851876.623031:0:1537152:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:20.0:1773851876.623033:0:1537152:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:20.0:1773851876.623036:0:1537152:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851876.623037:0:1537152:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204935808
00010000:00000001:20.0:1773851876.623038:0:1537152:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851876.623040:0:1537152:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a1f6fc72 x1858059204935808/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:20.0:1773851876.623044:0:1537152:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851876.623045:0:1537152:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851876.623046:0:1537152:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=100 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851876.623048:0:1537152:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851876.623049:0:1537152:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:20.0:1773851876.623051:0:1537152:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:20.0:1773851876.623052:0:1537152:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851876.623053:0:1537152:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851876.623054:0:1537152:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851876.623056:0:1537152:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2081@kfi7
00000400:00000010:20.0:1773851876.623057:0:1537152:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007749ce00.
00000100:00000200:20.0:1773851876.623058:0:1537152:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204935808, offset 224
00000400:00000200:20.0:1773851876.623060:0:1537152:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2081@kfi7
00000400:00000200:20.0:1773851876.623062:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:20.0:1773851876.623064:0:1537152:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:20.0:1773851876.623065:0:1537152:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:20.0:1773851876.623067:0:1537152:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:20.0:1773851876.623069:0:1537152:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2081@kfi7 local destination
00000400:00000200:20.0:1773851876.623072:0:1537152:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769543:8769543:1024:4294967295] 2081@kfi7 LPNI seq info [23425170:23425170:16:4294967295]
00000400:00000200:20.0:1773851876.623074:0:1537152:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:20.0:1773851876.623075:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:20.0:1773851876.623079:0:1537152:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2081@kfi7(2081@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851876.623081:0:1537152:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000800:00000200:20.0:1773851876.623084:0:1537152:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851876.623085:0:1537152:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:20.0:1773851876.623089:0:1537152:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851876.623093:0:1537152:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 Using peer 2081@kfi7(0x200000000000275)
00000800:00000200:20.0:1773851876.623098:0:1537152:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000294c799f: Posted send of 468 bytes to peer 0x200000000000275: rc=0
00000800:00000200:20.0:1773851876.623101:0:1537152:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851876.623104:0:1537152:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851876.623105:0:1537152:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:20.0:1773851876.623107:0:1537152:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851876.623108:0:1537152:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851876.623109:0:1537152:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851876.623110:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a1f6fc72 x1858059204935808/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:20.0:1773851876.623121:0:1537152:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1f6fc72 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0003-mdtlov_UUID+5:52355:x1858059204935808:12345-2074@kfi7:41:default-yuba4-0 Request processed in 120us (176us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851876.623125:0:1537152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 3084760
00000100:00000040:20.0:1773851876.623126:0:1537152:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:20.0:1773851876.623127:0:1537152:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851876.623128:0:1537152:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851876.623129:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000019fb147b.
00000020:00000010:20.0:1773851876.623130:0:1537152:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000063acde6a.
00000020:00000010:20.0:1773851876.623132:0:1537152:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000756cfb42.
00000020:00000040:20.0:1773851876.623133:0:1537152:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:20.0:1773851876.623134:0:1537152:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851876.623142:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851876.623145:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851876.623147:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000400:00000200:21.0:1773851876.623148:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007749ce00
00000400:00000010:21.0:1773851876.623149:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007749ce00.
00000100:00000001:21.0:1773851876.623150:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851876.623151:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851876.623152:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:21.0:1773851876.623155:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 Transaction freed
00000004:00000001:7.0:1773851876.681732:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851876.681732:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:28.0:1773851876.681733:0:82937:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000100:00000010:7.0:1773851876.681733:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f71c1f0.
00000020:00000040:7.0:1773851876.681734:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851876.681735:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851876.681735:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851876.681736:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851876.681738:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000085d7323e.
00000100:00000001:7.0:1773851876.681739:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851876.681740:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851876.681740:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851876.681741:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007f71c1f0] to pc [ptlrpcd_01_01+1]  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851876.681744:0:82937:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +177s
00000100:00001000:28.0:1773851876.681745:0:82937:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +3s, asking for 30 secs on 0 early replies
00080000:00000001:7.0:1773851876.681745:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:28.0:1773851876.681746:0:82937:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00080000:00000010:7.0:1773851876.681746:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000007ec590c0.
00080000:00000001:7.0:1773851876.681747:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637007885820928 : -107065823730688 : ffff9e9fcb9be400)
00000100:00000001:4.0:1773851876.681747:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:7.0:1773851876.681748:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851876.681748:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:4.0:1773851876.681748:0:41064:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00000001:4.0:1773851876.681748:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:7.0:1773851876.681749:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851876.681749:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851876.681749:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00001000:7.0:1773851876.681750:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000004:00000010:7.0:1773851876.681750:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001dd711a8.
00000100:00000001:4.0:1773851876.681750:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851876.681750:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00080000:7.0:1773851876.681751:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614151135026833ns, next at 614152135025801ns, rc = 0
00000100:00000001:4.0:1773851876.681751:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851876.681751:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:7.0:1773851876.681752:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:4.0:1773851876.681752:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851876.681753:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851876.681754:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851876.681754:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851876.681755:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851876.681756:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851876.681756:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851876.681757:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051931968:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851876.681759:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851876.681759:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851876.681760:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851876.681760:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851876.681761:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000440074eb.
02000000:00000001:4.0:1773851876.681762:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851876.681763:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:4.0:1773851876.681763:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000010:4.0:1773851876.681764:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6473a15.
00000100:00000200:4.0:1773851876.681766:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051931968, portal 4
00000100:00000001:4.0:1773851876.681767:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851876.681767:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309147776 : -106994400403840 : ffff9eb06cc55e80)
00000100:00000040:4.0:1773851876.681768:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851876.681771:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851876.681772:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851876.681772:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f5d265c4.
00000100:00000200:4.0:1773851876.681773:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051931968, offset 0
00000400:00000200:4.0:1773851876.681775:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851876.681776:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851876.681777:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851876.681777:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851876.681779:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851876.681780:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851876.681782:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769541, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769543, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851876.681784:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851876.681784:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851876.681785:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851876.681786:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769544:8769544:1024:4294967295] 2099@kfi7 LPNI seq info [5403432:5403432:16:4294967295]
00000400:00000200:4.0:1773851876.681787:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851876.681788:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851876.681790:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851876.681791:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851876.681793:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851876.681794:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851876.681796:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851876.681798:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Using peer 2099@kfi7(0x2c1)
00000800:00000200:4.0:1773851876.681800:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x2c1: rc=0
00000800:00000200:4.0:1773851876.681802:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851876.681804:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851876.681804:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851876.681805:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851876.681805:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851876.681806:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851876.681814:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_EVENT_TX_OK event status 0
00000400:00000200:7.0:1773851876.681816:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851876.681817:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000400:00000200:7.0:1773851876.681818:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f5d265c4
00000400:00000010:7.0:1773851876.681818:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f5d265c4.
00000100:00000001:7.0:1773851876.681819:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:7.0:1773851876.681820:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851876.681823:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851876.681823:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851876.681826:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851876.681826:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:7.0:1773851876.681827:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:7.0:1773851876.681829:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Transaction freed
00000800:00000200:17.0:1773851876.681846:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.681847:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851876.681849:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851876.681851:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851876.681853:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.681854:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851876.681855:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.681856:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851876.681857:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.681857:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851876.681858:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851876.681860:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.681860:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4540
00000400:00000200:17.0:1773851876.681861:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.681863:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f1711 [1] + 224
00000800:00000200:17.0:1773851876.681865:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851876.681867:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851876.681868:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851876.681869:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851876.681870:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851876.681873:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851876.681876:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851876.681877:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851876.681879:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851876.681879:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851876.681879:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851876.681880:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851876.681880:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851876.681881:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851876.681881:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6473a15
00000400:00000010:4.0:1773851876.681882:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6473a15.
00000100:00000001:4.0:1773851876.681883:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851876.681883:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851876.681886:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851876.681888:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851876.681889:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851876.681889:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851876.681890:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851876.681890:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851876.681891:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851876.681891:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851876.681892:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=109 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851876.681893:0:41064:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=109 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851876.681894:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851876.681894:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851876.681895:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851876.681895:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851876.681896:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851876.681897:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851876.681897:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851876.681897:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851876.681898:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851876.681900:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851876.681901:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851876.681902:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851876.681902:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851876.681903:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851876.681903:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409127424 avail=351407067136 avail_mb=1372683856 hwm_mb=3131101 files=372011300 ffree=343172976 state=0: rc = 0
00000004:00000020:4.0:1773851876.681905:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409127424 free, 351407067136 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011300 files, 343172976 free files
00000004:00000001:4.0:1773851876.681906:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851876.681907:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851876.681909:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051931968:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851876.681911:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851876.681911:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851876.681912:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007f71c1f0 x1859433051931968/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852029 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851876.681914:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851876.681914:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851876.681915:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000440074eb.
02000000:00000001:4.0:1773851876.681916:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851876.681916:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851876.681917:0:41064:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851876.681917:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851876.681918:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000085d7323e.
02000000:00000001:4.0:1773851876.681919:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851876.681919:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851876.681919:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f71c1f0.
00000100:00000001:4.0:1773851876.681920:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851876.681920:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851876.681921:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851876.681921:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851876.681922:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851876.681922:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851876.681922:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851876.698797:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851876.698798:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851876.698800:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851876.698803:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851876.698806:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19507@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.698808:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19507@kfi7 : PUT - for me
00000400:00000200:25.0:1773851876.698810:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19507@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.698811:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac491d7c nid 19507@kfi7 refs 1
00000400:00000200:25.0:1773851876.698813:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19507@kfi7 to cpt 6
00000400:00000200:25.0:1773851876.698814:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac491d7c nid 19507@kfi7 refs 2
00000400:00000200:25.0:1773851876.698815:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ac491d7c nid 19507@kfi7 refs 3
00000400:00000200:25.0:1773851876.698817:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19699@kfi7 to cpt 0
00000400:00000200:25.0:1773851876.698819:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19699@kfi7 of length 224 into portal 12 MB=0x69b4ba58bee00
00000400:00000200:25.0:1773851876.698821:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19699@kfi7 of length 224/224 into md 0x16159c9699 [64] + 23896
00000800:00000200:25.0:1773851876.698824:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851876.698826:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851876.698828:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19507@kfi7: PUT: OK
00000100:00000001:25.0:1773851876.698829:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851876.698830:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851876.698831:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003456d983.
00000100:00000040:25.0:1773851876.698832:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000003456d983 x1859599062527488 msgsize 224
00000100:00100000:25.0:1773851876.698835:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19699@kfi7 (source: 12345-19507@kfi7)
00000100:00000001:25.0:1773851876.698836:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851876.698837:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac491d7c nid 19507@kfi7 refs 2
00000100:00000001:27.0:1773851876.698838:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851876.698838:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851876.698839:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851876.698839:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851876.698840:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851876.698840:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00100000:27.0:1773851876.698841:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599062527488
00000020:00000001:27.0:1773851876.698842:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851876.698842:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e243836b6
00000020:00000001:27.0:1773851876.698843:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851876.698846:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000038e2de22 refcount=5
00000020:00000001:27.0:1773851876.698846:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637081748899840 : -106991960651776 : ffff9eb0fe310800)
00000020:00000001:27.0:1773851876.698847:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637081748899840 : -106991960651776 : ffff9eb0fe310800)
00000100:00000001:27.0:1773851876.698849:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851876.698849:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851876.698850:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004120800c.
00000020:00000010:27.0:1773851876.698851:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851876.698852:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851876.698853:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851876.698853:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851876.698854:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851876.698855:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851876.698855:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851876.698856:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.698857:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851876.698858:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851876.698858:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851876.698859:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19699@kfi7, seq: 2025134
00000100:00000040:27.0:1773851876.698860:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000038e2de22 : new rpc_count 1
00000100:00000001:26.0:1773851876.698860:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851876.698860:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851876.698861:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102835060992 : -106970874490624 : ffff9eb5e7065100)
00000100:00000001:26.0:1773851876.698861:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851876.698862:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003456d983 x1859599062527488/t0(0) o400->415b28a0-92ce-400b-a19a-fa5d0fe9176d@19699@kfi7:126/0 lens 224/0 e 0 to 0 dl 1773852241 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1705-0'
00000100:00000001:26.0:1773851876.698862:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.698865:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851876.698865:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851876.698866:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003456d983 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:415b28a0-92ce-400b-a19a-fa5d0fe9176d+5:39524:x1859599062527488:12345-19699@kfi7:400:default-tuolumne1705-0
00000100:00000200:27.0:1773851876.698868:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599062527488
00000020:00000001:27.0:1773851876.698868:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851876.698869:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851876.698870:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.698871:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851876.698871:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851876.698872:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851876.698873:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599062527488, found 0 last_xid 1859599062527487
00000020:00000001:27.0:1773851876.698873:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851876.698874:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851876.698874:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851876.698875:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.698875:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851876.698876:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851876.698876:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851876.698878:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000085d8b0d1.
02000000:00000001:27.0:1773851876.698879:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.698880:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.698880:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851876.698881:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096681867, transno 0, xid 1859599062527488
00010000:00000001:27.0:1773851876.698882:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851876.698882:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003456d983 x1859599062527488/t0(0) o400->415b28a0-92ce-400b-a19a-fa5d0fe9176d@19699@kfi7:126/0 lens 224/224 e 0 to 0 dl 1773852241 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1705-0'
00010000:00000001:27.0:1773851876.698885:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851876.698885:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851876.698886:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=109 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851876.698887:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851876.698888:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000094459095 refcount 3 to 19699@kfi7
00000100:00000001:27.0:1773851876.698888:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051968 : -107154804499648 : ffff9e8b13f11b40)
02000000:00000001:27.0:1773851876.698889:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851876.698890:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851876.698890:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851876.698891:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19507@kfi7
00000400:00000010:27.0:1773851876.698891:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000501d7072.
00000100:00000200:27.0:1773851876.698892:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599062527488, offset 224
00000400:00000200:27.0:1773851876.698894:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19507@kfi7
00000400:00000200:27.0:1773851876.698895:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19507@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.698896:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ac491d7c nid 19507@kfi7 refs 1
00000400:00000200:27.0:1773851876.698897:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ac491d7c nid 19507@kfi7 refs 2
00000400:00000200:27.0:1773851876.698898:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ac491d7c nid 19507@kfi7 refs 3
00000400:00000200:27.0:1773851876.698899:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19507@kfi7 local destination
00000400:00000200:27.0:1773851876.698900:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769545:8769545:1024:4294967295] 19507@kfi7 LPNI seq info [2811564:2811564:16:4294967295]
00000400:00000200:27.0:1773851876.698902:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ac491d7c nid 19507@kfi7 refs 2
00000400:00000200:27.0:1773851876.698902:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19507@kfi7 to cpt 6
00000400:00000200:27.0:1773851876.698904:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19507@kfi7(19507@kfi7:19507@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851876.698905:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ac491d7c nid 19507@kfi7 refs 3
00000800:00000200:27.0:1773851876.698907:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851876.698908:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851876.698910:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851876.698912:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8 Using peer 19507@kfi7(0xc8)
00000800:00000200:27.0:1773851876.698915:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0xc8: rc=0
00000800:00000200:27.0:1773851876.698916:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851876.698918:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851876.698919:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000094459095 refcount 2 to 19699@kfi7
00010000:00000001:27.0:1773851876.698920:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851876.698920:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851876.698921:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851876.698922:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003456d983 x1859599062527488/t0(0) o400->415b28a0-92ce-400b-a19a-fa5d0fe9176d@19699@kfi7:126/0 lens 224/224 e 0 to 0 dl 1773852241 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1705-0'
00000100:00100000:27.0:1773851876.698924:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003456d983 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:415b28a0-92ce-400b-a19a-fa5d0fe9176d+5:39524:x1859599062527488:12345-19699@kfi7:400:default-tuolumne1705-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851876.698926:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19699@kfi7, seq: 2025134
00000100:00000040:27.0:1773851876.698927:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000038e2de22 : new rpc_count 0
00000100:00000001:27.0:1773851876.698928:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851876.698929:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851876.698929:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851876.698930:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851876.698931:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004120800c.
00000020:00000040:27.0:1773851876.698931:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000038e2de22 : new refcount 4
00000800:00000200:25.0:1773851876.698931:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851876.698932:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851876.698934:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851876.698935:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19507@kfi7: PUT: OK
00000400:00000200:25.0:1773851876.698937:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000501d7072
00000400:00000010:25.0:1773851876.698938:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000501d7072.
00000100:00000001:25.0:1773851876.698939:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851876.698940:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851876.698941:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ac491d7c nid 19507@kfi7 refs 2
00000800:00000200:25.0:1773851876.698943:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19507@kfi7(00000000876f30d1):0x0 lsk 201 rsk 41 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8 Transaction freed
00000800:00000200:5.0:1773851876.774774:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851876.774775:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851876.774777:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851876.774779:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851876.774781:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13505@kfi7 to cpt 1
00000400:00000200:5.0:1773851876.774783:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13505@kfi7 : PUT - for me
00000400:00000200:5.0:1773851876.774784:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13505@kfi7 to cpt 1
00000400:00000200:5.0:1773851876.774785:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000df075f4 nid 13505@kfi7 refs 1
00000400:00000200:5.0:1773851876.774786:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13505@kfi7 to cpt 1
00000400:00000200:5.0:1773851876.774786:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000df075f4 nid 13505@kfi7 refs 2
00000400:00000200:5.0:1773851876.774787:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000df075f4 nid 13505@kfi7 refs 3
00000400:00000200:5.0:1773851876.774788:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13313@kfi7 to cpt 7
00000400:00000200:5.0:1773851876.774789:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13313@kfi7 of length 224 into portal 12 MB=0x69b099f2c4180
00000400:00000200:5.0:1773851876.774791:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13313@kfi7 of length 224/224 into md 0x793926dc5 [64] + 149400
00000800:00000200:5.0:1773851876.774794:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851876.774795:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851876.774796:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13505@kfi7: PUT: OK
00000100:00000001:5.0:1773851876.774797:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851876.774798:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851876.774798:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ef4c1727.
00000100:00000040:5.0:1773851876.774799:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ef4c1727 x1859315487752576 msgsize 224
00000100:00100000:5.0:1773851876.774801:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13313@kfi7 (source: 12345-13505@kfi7)
00000100:00000001:5.0:1773851876.774801:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851876.774802:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000df075f4 nid 13505@kfi7 refs 2
00000100:00000001:7.0:1773851876.774803:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851876.774804:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851876.774804:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851876.774804:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851876.774805:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851876.774806:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851876.774806:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315487752576
00000020:00000001:7.0:1773851876.774807:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851876.774807:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9188f
00000020:00000001:7.0:1773851876.774808:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851876.774811:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000063aed1c refcount=6
00000020:00000001:7.0:1773851876.774812:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241961472 : -107152467590144 : ffff9e8b9f3b8400)
00000020:00000001:7.0:1773851876.774813:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241961472 : -107152467590144 : ffff9e8b9f3b8400)
00000100:00000001:7.0:1773851876.774814:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851876.774815:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851876.774815:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851876.774816:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851876.774817:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851876.774818:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851876.774819:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851876.774819:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851876.774820:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851876.774821:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851876.774821:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851876.774822:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851876.774823:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851876.774824:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851876.774824:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851876.774824:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851876.774825:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13313@kfi7, seq: 2001938
00000100:00000040:7.0:1773851876.774826:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000063aed1c : new rpc_count 1
00000100:00000001:4.0:1773851876.774826:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851876.774827:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273399680 : -107034436151936 : ffff9ea71a745580)
00000100:00000001:4.0:1773851876.774827:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851876.774828:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ef4c1727 x1859315487752576/t0(0) o400->9723292a-f310-48fa-a5d9-619359a5af77@13313@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1331-0'
00000100:00000001:7.0:1773851876.774830:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851876.774831:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851876.774832:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef4c1727 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:9723292a-f310-48fa-a5d9-619359a5af77+6:39633:x1859315487752576:12345-13313@kfi7:400:default-tuolumne1331-0
00000100:00000200:7.0:1773851876.774834:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315487752576
00000020:00000001:7.0:1773851876.774834:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851876.774835:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851876.774836:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851876.774836:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851876.774837:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851876.774838:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851876.774838:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315487752576, found 0 last_xid 1859315487752575
00000020:00000001:7.0:1773851876.774839:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851876.774840:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851876.774841:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851876.774841:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851876.774842:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851876.774842:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851876.774843:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851876.774843:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b984b53b.
02000000:00000001:7.0:1773851876.774844:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851876.774844:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851876.774845:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851876.774846:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104681321, transno 0, xid 1859315487752576
00010000:00000001:7.0:1773851876.774847:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851876.774848:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ef4c1727 x1859315487752576/t0(0) o400->9723292a-f310-48fa-a5d9-619359a5af77@13313@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1331-0'
00010000:00000001:7.0:1773851876.774850:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851876.774851:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851876.774851:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=108 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851876.774852:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851876.774853:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f7e5c190 refcount 3 to 13313@kfi7
00000100:00000001:7.0:1773851876.774854:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064512 : -107155994487104 : ffff9e8acd0356c0)
02000000:00000001:7.0:1773851876.774855:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851876.774856:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851876.774856:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851876.774858:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13505@kfi7
00000400:00000010:7.0:1773851876.774858:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009424d83.
00000100:00000200:7.0:1773851876.774859:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315487752576, offset 224
00000400:00000200:7.0:1773851876.774861:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13505@kfi7
00000400:00000200:7.0:1773851876.774861:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13505@kfi7 to cpt 1
00000400:00000200:7.0:1773851876.774862:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000df075f4 nid 13505@kfi7 refs 1
00000400:00000200:7.0:1773851876.774863:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000df075f4 nid 13505@kfi7 refs 2
00000400:00000200:7.0:1773851876.774864:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000df075f4 nid 13505@kfi7 refs 3
00000400:00000200:7.0:1773851876.774865:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13505@kfi7 local destination
00000400:00000200:7.0:1773851876.774867:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769546:8769546:1024:4294967295] 13505@kfi7 LPNI seq info [11837706:11837706:16:4294967295]
00000400:00000200:7.0:1773851876.774868:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000df075f4 nid 13505@kfi7 refs 2
00000400:00000200:7.0:1773851876.774869:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13505@kfi7 to cpt 1
00000400:00000200:7.0:1773851876.774870:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13505@kfi7(13505@kfi7:13505@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851876.774872:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000df075f4 nid 13505@kfi7 refs 3
00000800:00000200:7.0:1773851876.774873:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851876.774874:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851876.774876:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851876.774879:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011d2 Using peer 13505@kfi7(0x1000000000011d2)
00000800:00000200:7.0:1773851876.774882:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x1000000000011d2: rc=0
00000800:00000200:7.0:1773851876.774883:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851876.774885:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851876.774886:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f7e5c190 refcount 2 to 13313@kfi7
00010000:00000001:7.0:1773851876.774887:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851876.774887:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851876.774888:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851876.774888:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ef4c1727 x1859315487752576/t0(0) o400->9723292a-f310-48fa-a5d9-619359a5af77@13313@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1331-0'
00000100:00100000:7.0:1773851876.774895:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef4c1727 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:9723292a-f310-48fa-a5d9-619359a5af77+6:39633:x1859315487752576:12345-13313@kfi7:400:default-tuolumne1331-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851876.774895:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011d2 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851876.774896:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851876.774897:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13313@kfi7, seq: 2001938
00000400:00000200:5.0:1773851876.774897:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13505@kfi7: PUT: OK
00000100:00000040:7.0:1773851876.774898:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000063aed1c : new rpc_count 0
00000400:00000200:5.0:1773851876.774898:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009424d83
00000400:00000010:5.0:1773851876.774898:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009424d83.
00000100:00000001:7.0:1773851876.774899:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851876.774899:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851876.774900:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851876.774900:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000100:00000001:5.0:1773851876.774900:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851876.774901:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:5.0:1773851876.774901:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000df075f4 nid 13505@kfi7 refs 2
00000020:00000010:7.0:1773851876.774902:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000020:00000040:7.0:1773851876.774902:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000063aed1c : new refcount 5
00000800:00000200:5.0:1773851876.774902:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 13505@kfi7(00000000a6a5aa1f):0x0 lsk 4563 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011d2 Transaction freed
00000100:00000001:7.0:1773851876.774903:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851876.778179:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851876.778180:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:29.0:1773851876.778182:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851876.778183:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851876.778184:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851876.778184:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10690@kfi7(000000001a225413):0xb8a version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851876.778185:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851876.778186:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a Using peer 10690@kfi7(0xb8a)
00000800:00000200:30.0:1773851876.778187:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851876.778187:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10690@kfi7 to cpt 7
00000400:00000200:30.0:1773851876.778189:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10690@kfi7 to cpt 7
00000400:00000200:30.0:1773851876.778190:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10690@kfi7 : PUT - for me
00000800:00000200:29.0:1773851876.778190:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 38 bytes to peer 0xb8a: rc=0
00000400:00000200:30.0:1773851876.778191:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10690@kfi7 to cpt 7
00000800:00000200:29.0:1773851876.778191:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851876.778192:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a228655 nid 10690@kfi7 refs 1
00000400:00000200:30.0:1773851876.778193:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10690@kfi7 to cpt 7
00000400:00000200:30.0:1773851876.778193:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a228655 nid 10690@kfi7 refs 2
00000400:00000200:30.0:1773851876.778194:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008a228655 nid 10690@kfi7 refs 3
00000400:00000200:30.0:1773851876.778195:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10499@kfi7 to cpt 0
00000400:00000200:30.0:1773851876.778196:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10499@kfi7 of length 224 into portal 12 MB=0x69b461c6265c0
00000400:00000200:30.0:1773851876.778197:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10499@kfi7 of length 224/224 into md 0x77fe139dd [64] + 187016
00000800:00000200:30.0:1773851876.778200:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851876.778202:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851876.778203:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10690@kfi7: PUT: OK
00000800:00000200:29.0:1773851876.778203:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851876.778204:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851876.778204:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851876.778205:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c729812a.
00000800:00000200:29.0:1773851876.778205:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a Transaction freed
00000100:00000040:30.0:1773851876.778206:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000c729812a x1859575286490560 msgsize 224
00000100:00100000:30.0:1773851876.778207:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-10499@kfi7 (source: 12345-10690@kfi7)
00000100:00000001:30.0:1773851876.778208:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851876.778209:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008a228655 nid 10690@kfi7 refs 2
00000100:00000001:31.0:1773851876.778210:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851876.778210:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:30.0:1773851876.778210:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2069@kfi7:7 <- 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851876.778211:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851876.778211:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851876.778212:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851876.778213:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575286490560
00000020:00000001:31.0:1773851876.778213:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851876.778214:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc28e8feb
00000020:00000001:31.0:1773851876.778214:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851876.778219:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003fd22ffd refcount=5
00000020:00000001:31.0:1773851876.778220:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637140505843712 : -106933203707904 : ffff9ebeac60d800)
00000020:00000001:31.0:1773851876.778221:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637140505843712 : -106933203707904 : ffff9ebeac60d800)
00000100:00000001:31.0:1773851876.778222:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851876.778223:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851876.778223:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fe4b474d.
00000020:00000010:31.0:1773851876.778224:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851876.778225:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851876.778226:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851876.778227:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851876.778227:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851876.778228:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851876.778229:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851876.778230:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.778231:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851876.778232:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851876.778232:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851876.778232:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851876.778233:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10499@kfi7, seq: 2055543
00000100:00000001:28.0:1773851876.778233:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851876.778234:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003fd22ffd : new rpc_count 1
00000100:00000001:28.0:1773851876.778234:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.778235:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411253760 : -106960298297856 : ffff9eb85d6a3600)
00000100:00000001:28.0:1773851876.778235:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851876.778236:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c729812a x1859575286490560/t0(0) o400->b1d3fc06-89d0-436d-8d4f-50d0dee2021e@10499@kfi7:516/0 lens 224/0 e 0 to 0 dl 1773852631 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1159-0'
00000100:00000001:31.0:1773851876.778239:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851876.778239:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851876.778240:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c729812a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:b1d3fc06-89d0-436d-8d4f-50d0dee2021e+5:39767:x1859575286490560:12345-10499@kfi7:400:default-tuolumne1159-0
00000100:00000200:31.0:1773851876.778241:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575286490560
00000020:00000001:31.0:1773851876.778242:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851876.778243:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851876.778243:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.778244:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851876.778245:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851876.778245:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851876.778246:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575286490560, found 0 last_xid 1859575286490559
00000020:00000001:31.0:1773851876.778247:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851876.778248:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851876.778248:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851876.778249:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.778249:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851876.778250:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851876.778250:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851876.778251:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0660696.
02000000:00000001:31.0:1773851876.778252:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.778252:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.778253:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851876.778254:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096696716, transno 0, xid 1859575286490560
00010000:00000001:31.0:1773851876.778255:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851876.778256:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c729812a x1859575286490560/t0(0) o400->b1d3fc06-89d0-436d-8d4f-50d0dee2021e@10499@kfi7:516/0 lens 224/224 e 0 to 0 dl 1773852631 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1159-0'
00010000:00000001:31.0:1773851876.778258:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851876.778259:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851876.778259:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=109 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851876.778260:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851876.778261:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006b38164e refcount 3 to 10499@kfi7
00000100:00000001:31.0:1773851876.778262:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049856 : -107154804501760 : ffff9e8b13f11300)
02000000:00000001:31.0:1773851876.778263:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851876.778263:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851876.778264:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851876.778265:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10690@kfi7
00000400:00000010:31.0:1773851876.778265:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018a1fff7.
00000100:00000200:31.0:1773851876.778266:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575286490560, offset 224
00000400:00000200:31.0:1773851876.778267:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10690@kfi7
00000400:00000200:31.0:1773851876.778268:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10690@kfi7 to cpt 7
00000400:00000200:31.0:1773851876.778269:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a228655 nid 10690@kfi7 refs 1
00000400:00000200:31.0:1773851876.778270:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008a228655 nid 10690@kfi7 refs 2
00000400:00000200:31.0:1773851876.778271:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008a228655 nid 10690@kfi7 refs 3
00000400:00000200:31.0:1773851876.778272:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10690@kfi7 local destination
00000400:00000200:31.0:1773851876.778273:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769547:8769547:1024:4294967295] 10690@kfi7 LPNI seq info [367767:367767:16:4294967295]
00000400:00000200:31.0:1773851876.778274:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008a228655 nid 10690@kfi7 refs 2
00000400:00000200:31.0:1773851876.778275:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10690@kfi7 to cpt 7
00000400:00000200:31.0:1773851876.778277:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10690@kfi7(10690@kfi7:10690@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851876.778278:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008a228655 nid 10690@kfi7 refs 3
00000800:00000200:31.0:1773851876.778279:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851876.778280:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851876.778283:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851876.778287:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a Using peer 10690@kfi7(0xb8a)
00000800:00000200:31.0:1773851876.778290:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0xb8a: rc=0
00000800:00000200:31.0:1773851876.778291:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851876.778294:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851876.778294:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006b38164e refcount 2 to 10499@kfi7
00010000:00000001:31.0:1773851876.778295:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851876.778296:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851876.778296:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851876.778297:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c729812a x1859575286490560/t0(0) o400->b1d3fc06-89d0-436d-8d4f-50d0dee2021e@10499@kfi7:516/0 lens 224/224 e 0 to 0 dl 1773852631 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1159-0'
00000100:00100000:31.0:1773851876.778300:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c729812a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:b1d3fc06-89d0-436d-8d4f-50d0dee2021e+5:39767:x1859575286490560:12345-10499@kfi7:400:default-tuolumne1159-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851876.778302:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10499@kfi7, seq: 2055543
00000100:00000040:31.0:1773851876.778303:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003fd22ffd : new rpc_count 0
00000800:00000200:29.0:1773851876.778303:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851876.778304:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851876.778304:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851876.778304:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851876.778305:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851876.778305:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10690@kfi7: PUT: OK
00000020:00000010:31.0:1773851876.778306:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851876.778306:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fe4b474d.
00000400:00000200:29.0:1773851876.778306:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018a1fff7
00000020:00000040:31.0:1773851876.778307:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000003fd22ffd : new refcount 4
00000400:00000010:29.0:1773851876.778307:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018a1fff7.
00000100:00000001:29.0:1773851876.778307:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851876.778308:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851876.778308:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851876.778309:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008a228655 nid 10690@kfi7 refs 2
00000800:00000200:29.0:1773851876.778310:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 10690@kfi7(000000001a225413):0x0 lsk 2955 rsk 32 tsk 0 trmk 0 tmk 0 trr 7 tta 0xb8a Transaction freed
00000800:00000200:17.0:1773851876.814473:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.814473:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851876.814474:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851876.814476:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851876.814478:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.814479:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.36@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851876.814480:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.814481:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851876.814482:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.36@o2ib60 to cpt 5
00000400:00000200:17.0:1773851876.814482:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e45b2d38 nid 192.168.128.36@o2ib60 refs 2
00000400:00000200:17.0:1773851876.814484:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e45b2d38 nid 192.168.128.36@o2ib60 refs 3
00000400:00000200:17.0:1773851876.814485:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.36@o2ib60 to cpt 5
00000400:00000200:17.0:1773851876.814486:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.36@o2ib60 of length 224 into portal 12 MB=0x69b23efd44540
00000400:00000200:17.0:1773851876.814488:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.36@o2ib60 of length 224/224 into md 0x6a32cacf5 [64] + 46544
00000800:00000200:17.0:1773851876.814490:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851876.814491:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851876.814492:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851876.814493:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851876.814493:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851876.814495:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004b744baa.
00000100:00000040:17.0:1773851876.814496:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000004b744baa x1859428510090560 msgsize 224
00000100:00100000:17.0:1773851876.814497:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.36@o2ib60 (source: 12345-192.168.128.36@o2ib60)
00000100:00000001:17.0:1773851876.814499:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851876.814500:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:23.0:1773851876.814501:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851876.814501:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851876.814502:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851876.814503:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851876.814503:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851876.814504:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851876.814505:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859428510090560
00000020:00000001:23.0:1773851876.814505:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851876.814506:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b94c592a0
00000020:00000001:23.0:1773851876.814506:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851876.814510:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000022b0d4ef refcount=5
00000020:00000001:23.0:1773851876.814511:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636984814054400 : -107088895497216 : ffff9e9a6c6cac00)
00000020:00000001:23.0:1773851876.814512:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636984814054400 : -107088895497216 : ffff9e9a6c6cac00)
00000100:00000001:23.0:1773851876.814513:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851876.814513:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851876.814514:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851876.814515:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851876.814516:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851876.814517:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851876.814517:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851876.814518:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851876.814519:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851876.814520:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851876.814520:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851876.814522:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851876.814523:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851876.814523:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851876.814524:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851876.814524:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851876.814525:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.36@o2ib60, seq: 1998006
00000100:00000040:23.0:1773851876.814526:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000022b0d4ef : new rpc_count 1
00000100:00000001:23.0:1773851876.814526:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098720421760 : -106974989129856 : ffff9eb4f1c5e780)
00000100:00000001:20.0:1773851876.814526:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851876.814526:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851876.814528:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004b744baa x1859428510090560/t0(0) o400->19c5c721-089f-473d-ba73-d9e556f90632@192.168.128.36@o2ib60:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix36-0'
00000100:00000001:23.0:1773851876.814531:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851876.814531:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851876.814532:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004b744baa pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:19c5c721-089f-473d-ba73-d9e556f90632+5:40035:x1859428510090560:12345-192.168.128.36@o2ib60:400:default-matrix36-0
00000100:00000200:23.0:1773851876.814534:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859428510090560
00000020:00000001:23.0:1773851876.814534:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851876.814535:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851876.814536:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.814536:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851876.814537:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851876.814537:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851876.814538:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859428510090560, found 0 last_xid 1859428510090559
00000020:00000001:23.0:1773851876.814539:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851876.814540:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851876.814540:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851876.814541:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.814542:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851876.814542:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851876.814543:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851876.814543:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009c7cc222.
02000000:00000001:23.0:1773851876.814544:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851876.814545:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.814545:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851876.814546:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859428510090560
00010000:00000001:23.0:1773851876.814547:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851876.814548:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004b744baa x1859428510090560/t0(0) o400->19c5c721-089f-473d-ba73-d9e556f90632@192.168.128.36@o2ib60:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix36-0'
00010000:00000001:23.0:1773851876.814550:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851876.814551:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851876.814552:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=109 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851876.814553:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851876.814554:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002a71b933 refcount 3 to 192.168.128.36@o2ib60
00000100:00000001:23.0:1773851876.814554:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025952 : -107156745525664 : ffff9e8aa03f6660)
02000000:00000001:23.0:1773851876.814555:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851876.814556:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851876.814556:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851876.814557:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.36@o2ib60
00000400:00000010:23.0:1773851876.814558:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007062c552.
00000100:00000200:23.0:1773851876.814559:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859428510090560, offset 224
00000400:00000200:23.0:1773851876.814560:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.36@o2ib60
00000400:00000200:23.0:1773851876.814561:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.36@o2ib60 to cpt 5
00000400:00000200:23.0:1773851876.814562:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e45b2d38 nid 192.168.128.36@o2ib60 refs 2
00000400:00000200:23.0:1773851876.814564:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e45b2d38 nid 192.168.128.36@o2ib60 refs 3
00000400:00000200:23.0:1773851876.814565:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e45b2d38 nid 192.168.128.36@o2ib60 refs 4
00000400:00000200:23.0:1773851876.814567:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.36@o2ib60 routed destination
00000400:00000200:23.0:1773851876.814568:0:60934:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851876.814569:0:60934:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:23.0:1773851876.814570:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.36@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851876.814571:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851876.814572:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.36@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851876.814573:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851876.814574:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769548:8769548:1024:4294967295] 2094@kfi7 LPNI seq info [1258747006:1258747006:16:4294967295]
00000400:00000200:23.0:1773851876.814576:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:23.0:1773851876.814576:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:23.0:1773851876.814579:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.36@o2ib60(192.168.128.36@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851876.814581:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e45b2d38 nid 192.168.128.36@o2ib60 refs 3
00000800:00000200:23.0:1773851876.814583:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851876.814584:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851876.814586:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851876.814588:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:23.0:1773851876.814591:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:23.0:1773851876.814592:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851876.814594:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851876.814595:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002a71b933 refcount 2 to 192.168.128.36@o2ib60
00010000:00000001:23.0:1773851876.814596:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851876.814597:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.814597:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851876.814598:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004b744baa x1859428510090560/t0(0) o400->19c5c721-089f-473d-ba73-d9e556f90632@192.168.128.36@o2ib60:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix36-0'
00000100:00100000:23.0:1773851876.814601:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004b744baa pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:19c5c721-089f-473d-ba73-d9e556f90632+5:40035:x1859428510090560:12345-192.168.128.36@o2ib60:400:default-matrix36-0 Request processed in 69us (104us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851876.814601:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851876.814603:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851876.814604:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.36@o2ib60, seq: 1998006
00000100:00000040:23.0:1773851876.814604:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000022b0d4ef : new rpc_count 0
00000400:00000200:21.0:1773851876.814604:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:21.0:1773851876.814604:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007062c552
00000100:00000001:23.0:1773851876.814605:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:21.0:1773851876.814605:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007062c552.
00000100:00000001:21.0:1773851876.814605:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851876.814606:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851876.814606:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000100:00000001:21.0:1773851876.814606:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851876.814607:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851876.814607:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:23.0:1773851876.814608:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000020:00000040:23.0:1773851876.814608:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000022b0d4ef : new refcount 4
00000800:00000200:21.0:1773851876.814608:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Transaction freed
00000100:00000001:23.0:1773851876.814609:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851876.821180:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851876.821181:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851876.821182:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851876.821184:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851876.821187:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851876.821188:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 61@kfi7 : PUT - for me
00000400:00000200:2.0:1773851876.821189:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851876.821190:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:2.0:1773851876.821190:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851876.821191:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:2.0:1773851876.821192:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:2.0:1773851876.821193:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851876.821194:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a879f4940
00000400:00000200:2.0:1773851876.821195:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x7f7992401 [256] + 19184
00000800:00000200:2.0:1773851876.821197:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851876.821199:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851876.821200:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->61@kfi7: PUT: OK
00000100:00000001:2.0:1773851876.821201:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851876.821202:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:2.0:1773851876.821203:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005076f9f2.
00000100:00000040:2.0:1773851876.821204:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000005076f9f2 x1859388107082048 msgsize 224
00000100:00100000:2.0:1773851876.821205:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-61@kfi7)
00000100:00000001:2.0:1773851876.821206:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851876.821207:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:1.0:1773851876.821208:0:1203216:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851876.821209:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:1.0:1773851876.821209:0:1203216:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851876.821209:0:1203216:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851876.821210:0:1203216:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851876.821211:0:1203216:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851876.821212:0:1203216:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107082048
00000020:00000001:1.0:1773851876.821212:0:1203216:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851876.821213:0:1203216:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:1.0:1773851876.821213:0:1203216:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851876.821215:0:1203216:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:1.0:1773851876.821216:0:1203216:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:1.0:1773851876.821217:0:1203216:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:1.0:1773851876.821218:0:1203216:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851876.821219:0:1203216:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851876.821219:0:1203216:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851876.821221:0:1203216:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851876.821221:0:1203216:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000040:1.0:1773851876.821223:0:1203216:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:1.0:1773851876.821223:0:1203216:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851876.821224:0:1203216:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851876.821224:0:1203216:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851876.821226:0:1203216:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851876.821227:0:1203216:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851876.821228:0:1203216:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851876.821229:0:1203216:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851876.821230:0:180051:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851876.821230:0:180051:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851876.821231:0:1203216:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 3288271
00000100:00000040:1.0:1773851876.821232:0:1203216:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:1.0:1773851876.821232:0:1203216:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706778752 : -106953002772864 : ffff9eba10431680)
00000100:00000001:0.0:1773851876.821232:0:180051:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851876.821233:0:180051:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851876.821234:0:1203216:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005076f9f2 x1859388107082048/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:1.0:1773851876.821237:0:1203216:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851876.821237:0:1203216:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851876.821238:0:1203216:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005076f9f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_014:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388107082048:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:1.0:1773851876.821239:0:1203216:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107082048
00000020:00000001:1.0:1773851876.821240:0:1203216:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851876.821241:0:1203216:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851876.821242:0:1203216:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851876.821242:0:1203216:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851876.821243:0:1203216:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:1.0:1773851876.821244:0:1203216:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:1.0:1773851876.821244:0:1203216:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851876.821245:0:1203216:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851876.821245:0:1203216:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851876.821246:0:1203216:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851876.821247:0:1203216:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851876.821247:0:1203216:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851876.821248:0:1203216:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000e468cca7.
02000000:00000001:1.0:1773851876.821249:0:1203216:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851876.821250:0:1203216:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851876.821251:0:1203216:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:1.0:1773851876.821251:0:1203216:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:1.0:1773851876.821252:0:1203216:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:1.0:1773851876.821253:0:1203216:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 55050240 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:1.0:1773851876.821254:0:1203216:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132487 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:1.0:1773851876.821256:0:1203216:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851876.821256:0:1203216:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107082048
00010000:00000001:1.0:1773851876.821257:0:1203216:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851876.821258:0:1203216:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005076f9f2 x1859388107082048/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:1.0:1773851876.821261:0:1203216:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851876.821261:0:1203216:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851876.821262:0:1203216:0:(import.c:1951:at_measured()) add 1 to 00000000b7f0e4a1 time=130 v=66 (1 1 1 1)
00000100:00000001:1.0:1773851876.821263:0:1203216:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851876.821264:0:1203216:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:1.0:1773851876.821265:0:1203216:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:1.0:1773851876.821266:0:1203216:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851876.821266:0:1203216:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851876.821267:0:1203216:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851876.821268:0:1203216:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-61@kfi7
00000400:00000010:1.0:1773851876.821269:0:1203216:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c31a0ef.
00000100:00000200:1.0:1773851876.821270:0:1203216:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107082048, offset 224
00000400:00000200:1.0:1773851876.821271:0:1203216:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-61@kfi7
00000400:00000200:1.0:1773851876.821272:0:1203216:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:1.0:1773851876.821273:0:1203216:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:1.0:1773851876.821274:0:1203216:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:1.0:1773851876.821276:0:1203216:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:1.0:1773851876.821277:0:1203216:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  61@kfi7 local destination
00000400:00000200:1.0:1773851876.821278:0:1203216:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769549:8769549:1024:4294967295] 61@kfi7 LPNI seq info [37492103:37492103:16:4294967295]
00000400:00000200:1.0:1773851876.821280:0:1203216:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:1.0:1773851876.821280:0:1203216:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:1.0:1773851876.821282:0:1203216:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 61@kfi7(61@kfi7:61@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851876.821284:0:1203216:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000800:00000200:1.0:1773851876.821285:0:1203216:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851876.821286:0:1203216:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:1.0:1773851876.821288:0:1203216:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851876.821291:0:1203216:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f Using peer 61@kfi7(0x70f)
00000800:00000200:1.0:1773851876.821295:0:1203216:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 468 bytes to peer 0x70f: rc=0
00000800:00000200:1.0:1773851876.821297:0:1203216:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851876.821299:0:1203216:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851876.821300:0:1203216:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:1.0:1773851876.821301:0:1203216:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851876.821301:0:1203216:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851876.821302:0:1203216:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851876.821302:0:1203216:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005076f9f2 x1859388107082048/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:603/0 lens 224/368 e 0 to 0 dl 1773851963 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:1.0:1773851876.821305:0:1203216:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005076f9f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_014:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388107082048:12345-61@kfi7:41:default-yuba1-0 Request processed in 68us (101us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851876.821308:0:1203216:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 3288271
00000800:00000200:2.0:1773851876.821309:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f TN_EVENT_TX_OK event status 0
00000100:00000040:1.0:1773851876.821309:0:1203216:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:1.0:1773851876.821310:0:1203216:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851876.821310:0:1203216:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851876.821311:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851876.821311:0:1203216:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851876.821311:0:1203216:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000400:00000200:2.0:1773851876.821312:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->61@kfi7: PUT: OK
00000020:00000010:1.0:1773851876.821312:0:1203216:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:2.0:1773851876.821313:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c31a0ef
00000400:00000010:2.0:1773851876.821313:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c31a0ef.
00000020:00000040:1.0:1773851876.821313:0:1203216:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000100:00000001:2.0:1773851876.821314:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851876.821314:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:1.0:1773851876.821314:0:1203216:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851876.821315:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:2.0:1773851876.821317:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f Transaction freed
00000800:00000200:21.0:1773851876.863321:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851876.863321:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851876.863323:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851876.863325:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851876.863327:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19889@kfi7 to cpt 5
00000400:00000200:21.0:1773851876.863328:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19889@kfi7 : PUT - for me
00000400:00000200:21.0:1773851876.863329:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19889@kfi7 to cpt 5
00000400:00000200:21.0:1773851876.863331:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 1
00000400:00000200:21.0:1773851876.863332:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19889@kfi7 to cpt 5
00000400:00000200:21.0:1773851876.863333:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 2
00000400:00000200:21.0:1773851876.863334:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 3
00000400:00000200:21.0:1773851876.863334:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19888@kfi7 to cpt 2
00000400:00000200:21.0:1773851876.863336:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19888@kfi7 of length 224 into portal 12 MB=0x699e1789121c0
00000400:00000200:21.0:1773851876.863337:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19888@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 46768
00000800:00000200:21.0:1773851876.863339:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851876.863341:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851876.863342:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19889@kfi7: PUT: OK
00000100:00000001:21.0:1773851876.863343:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851876.863344:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851876.863345:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000016423484.
00000100:00000040:21.0:1773851876.863345:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000016423484 x1858043529732544 msgsize 224
00000100:00100000:21.0:1773851876.863347:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-19888@kfi7 (source: 12345-19889@kfi7)
00000100:00000001:21.0:1773851876.863348:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851876.863349:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 2
00000100:00000001:23.0:1773851876.863350:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851876.863351:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851876.863351:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851876.863351:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851876.863352:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851876.863352:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851876.863353:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043529732544
00000020:00000001:23.0:1773851876.863354:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851876.863354:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925cb
00000020:00000001:23.0:1773851876.863355:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851876.863358:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074740943 refcount=6
00000020:00000001:23.0:1773851876.863359:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631006208 : -107123078545408 : ffff9e9276f4c000)
00000020:00000001:23.0:1773851876.863360:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631006208 : -107123078545408 : ffff9e9276f4c000)
00000100:00000001:23.0:1773851876.863361:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851876.863362:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851876.863362:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851876.863363:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851876.863364:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851876.863365:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851876.863365:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851876.863366:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851876.863367:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851876.863367:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851876.863367:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851876.863368:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851876.863370:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851876.863370:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851876.863370:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851876.863370:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851876.863371:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19888@kfi7, seq: 1998007
00000100:00000040:23.0:1773851876.863372:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074740943 : new rpc_count 1
00000100:00000001:20.0:1773851876.863372:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851876.863373:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794370176 : -106943915181440 : ffff9ebc2decba80)
00000100:00000001:20.0:1773851876.863373:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851876.863374:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000016423484 x1858043529732544/t0(0) o400->9d899f00-7521-47fa-80fe-d9f357531b40@19888@kfi7:603/0 lens 224/0 e 0 to 0 dl 1773851963 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1726-0'
00000100:00000001:23.0:1773851876.863376:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851876.863377:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851876.863378:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016423484 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9d899f00-7521-47fa-80fe-d9f357531b40+6:39688:x1858043529732544:12345-19888@kfi7:400:default-tuolumne1726-0
00000100:00000200:23.0:1773851876.863380:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043529732544
00000020:00000001:23.0:1773851876.863381:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851876.863381:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851876.863382:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.863383:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851876.863383:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851876.863384:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851876.863385:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043529732544, found 0 last_xid 1858043529732543
00000020:00000001:23.0:1773851876.863385:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851876.863386:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851876.863387:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851876.863387:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.863388:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851876.863388:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851876.863389:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851876.863391:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e5d8fc56.
02000000:00000001:23.0:1773851876.863392:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851876.863392:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.863393:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851876.863393:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595943, transno 0, xid 1858043529732544
00010000:00000001:23.0:1773851876.863394:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851876.863395:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000016423484 x1858043529732544/t0(0) o400->9d899f00-7521-47fa-80fe-d9f357531b40@19888@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1726-0'
00010000:00000001:23.0:1773851876.863397:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851876.863398:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851876.863399:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=109 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851876.863400:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851876.863400:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000031b95f67 refcount 3 to 19888@kfi7
00000100:00000001:23.0:1773851876.863401:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051135904 : -107146658415712 : ffff9e8cf97c7ba0)
02000000:00000001:23.0:1773851876.863402:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851876.863402:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851876.863403:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851876.863404:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19889@kfi7
00000400:00000010:23.0:1773851876.863404:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a34f2baa.
00000100:00000200:23.0:1773851876.863406:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043529732544, offset 224
00000400:00000200:23.0:1773851876.863407:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19889@kfi7
00000400:00000200:23.0:1773851876.863408:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19889@kfi7 to cpt 5
00000400:00000200:23.0:1773851876.863409:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 1
00000400:00000200:23.0:1773851876.863410:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 2
00000400:00000200:23.0:1773851876.863411:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 3
00000400:00000200:23.0:1773851876.863412:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19889@kfi7 local destination
00000400:00000200:23.0:1773851876.863413:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769550:8769550:1024:4294967295] 19889@kfi7 LPNI seq info [2793234:2793234:16:4294967295]
00000400:00000200:23.0:1773851876.863415:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 2
00000400:00000200:23.0:1773851876.863415:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19889@kfi7 to cpt 5
00000400:00000200:23.0:1773851876.863417:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19889@kfi7(19889@kfi7:19889@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851876.863419:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 3
00000800:00000200:23.0:1773851876.863420:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851876.863421:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851876.863423:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851876.863425:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e12 Using peer 19889@kfi7(0x100000000000e12)
00000800:00000200:23.0:1773851876.863428:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x100000000000e12: rc=0
00000800:00000200:23.0:1773851876.863430:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e12 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851876.863431:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851876.863432:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000031b95f67 refcount 2 to 19888@kfi7
00010000:00000001:23.0:1773851876.863433:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851876.863434:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851876.863434:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851876.863435:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000016423484 x1858043529732544/t0(0) o400->9d899f00-7521-47fa-80fe-d9f357531b40@19888@kfi7:603/0 lens 224/224 e 0 to 0 dl 1773851963 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1726-0'
00000100:00100000:23.0:1773851876.863438:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016423484 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9d899f00-7521-47fa-80fe-d9f357531b40+6:39688:x1858043529732544:12345-19888@kfi7:400:default-tuolumne1726-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851876.863440:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e12 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851876.863441:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19888@kfi7, seq: 1998007
00000100:00000040:23.0:1773851876.863441:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074740943 : new rpc_count 0
00000100:00000001:23.0:1773851876.863442:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851876.863443:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851876.863443:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851876.863443:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851876.863444:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851876.863444:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19889@kfi7: PUT: OK
00000020:00000010:23.0:1773851876.863445:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000020:00000040:23.0:1773851876.863445:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000074740943 : new refcount 5
00000400:00000200:21.0:1773851876.863445:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a34f2baa
00000400:00000010:21.0:1773851876.863445:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a34f2baa.
00000100:00000001:23.0:1773851876.863446:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851876.863446:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851876.863446:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851876.863447:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6ef71a4 nid 19889@kfi7 refs 2
00000800:00000200:21.0:1773851876.863449:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 19889@kfi7(00000000763e2aa4):0x0 lsk 3603 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e12 Transaction freed
00000800:00000200:10.0:1773851876.943880:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851876.943880:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851876.943881:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851876.943881:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851876.943883:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851876.943883:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851876.943885:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851876.943885:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 23171@kfi7(00000000fd9beb9c):0xddf version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851876.943887:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf Using peer 23171@kfi7(0xddf)
00000400:00000200:10.0:1773851876.943888:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23171@kfi7 to cpt 2
00000400:00000200:9.0:1773851876.943889:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23171@kfi7 to cpt 2
00000400:00000200:10.0:1773851876.943890:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23171@kfi7 : PUT - for me
00000400:00000200:10.0:1773851876.943891:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23171@kfi7 to cpt 2
00000800:00000200:9.0:1773851876.943891:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0xddf: rc=0
00000400:00000200:10.0:1773851876.943893:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000033fc762 nid 23171@kfi7 refs 1
00000800:00000200:9.0:1773851876.943893:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851876.943894:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23171@kfi7 to cpt 2
00000400:00000200:10.0:1773851876.943895:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000033fc762 nid 23171@kfi7 refs 2
00000400:00000200:10.0:1773851876.943896:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000033fc762 nid 23171@kfi7 refs 3
00000400:00000200:10.0:1773851876.943896:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23170@kfi7 to cpt 7
00000400:00000200:10.0:1773851876.943897:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23170@kfi7 of length 224 into portal 12 MB=0x69b0a2d13e200
00000400:00000200:10.0:1773851876.943899:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23170@kfi7 of length 224/224 into md 0x78146ce49 [64] + 143960
00000800:00000200:10.0:1773851876.943901:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851876.943903:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851876.943904:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23171@kfi7: PUT: OK
00000100:00000001:10.0:1773851876.943905:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851876.943905:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851876.943906:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000053785240.
00000100:00000040:10.0:1773851876.943907:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000053785240 x1859317868519936 msgsize 224
00000800:00000200:9.0:1773851876.943907:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851876.943909:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-23170@kfi7 (source: 12345-23171@kfi7)
00000100:00000001:10.0:1773851876.943910:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851876.943911:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000033fc762 nid 23171@kfi7 refs 2
00000800:00000200:10.0:1773851876.943912:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000800:00000200:9.0:1773851876.943912:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf Transaction freed
00000100:00000001:11.0:1773851876.943913:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851876.943915:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851876.943915:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851876.943916:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851876.943918:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851876.943920:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317868519936
00000020:00000001:11.0:1773851876.943921:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851876.943922:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b20
00000020:00000001:11.0:1773851876.943923:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851876.943928:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d33b999e refcount=6
00000020:00000001:11.0:1773851876.943929:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743686144 : -107128965865472 : ffff9e91180b6000)
00000020:00000001:11.0:1773851876.943931:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743686144 : -107128965865472 : ffff9e91180b6000)
00000100:00000001:11.0:1773851876.943933:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851876.943934:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851876.943935:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008e6ffc9a.
00000020:00000010:11.0:1773851876.943937:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851876.943939:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000424bbaaa.
00000100:00000001:11.0:1773851876.943941:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851876.943941:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851876.943942:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851876.943945:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851876.943945:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851876.943946:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851876.943948:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851876.943950:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851876.943951:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851876.943951:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851876.943951:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851876.943952:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23170@kfi7, seq: 2130806
00000100:00000040:8.0:1773851876.943953:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d33b999e : new rpc_count 1
00000100:00000001:11.0:1773851876.943954:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851876.943954:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637143345361024 : -106930364190592 : ffff9ebf55a07080)
00000100:00000001:11.0:1773851876.943955:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851876.943956:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000053785240 x1859317868519936/t0(0) o400->1760babf-7442-4312-88fc-9f4b87413db0@23170@kfi7:93/0 lens 224/0 e 0 to 0 dl 1773852208 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1944-0'
00000100:00000001:8.0:1773851876.943960:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851876.943960:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851876.943962:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053785240 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1760babf-7442-4312-88fc-9f4b87413db0+6:39718:x1859317868519936:12345-23170@kfi7:400:default-tuolumne1944-0
00000100:00000200:8.0:1773851876.943963:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317868519936
00000020:00000001:8.0:1773851876.943964:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851876.943965:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851876.943966:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851876.943967:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851876.943967:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851876.943968:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851876.943969:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317868519936, found 0 last_xid 1859317868519935
00000020:00000001:8.0:1773851876.943970:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851876.943971:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851876.943971:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851876.943972:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851876.943973:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851876.943974:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851876.943974:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851876.943975:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cebf0718.
02000000:00000001:8.0:1773851876.943976:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851876.943977:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851876.943978:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851876.943979:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044124005, transno 0, xid 1859317868519936
00010000:00000001:8.0:1773851876.943981:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851876.943982:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000053785240 x1859317868519936/t0(0) o400->1760babf-7442-4312-88fc-9f4b87413db0@23170@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1944-0'
00010000:00000001:8.0:1773851876.943985:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851876.943986:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851876.943987:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=109 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851876.943988:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851876.943989:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004ae6632b refcount 3 to 23170@kfi7
00000100:00000001:8.0:1773851876.943990:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272064 : -107152618279552 : ffff9e8b96402d80)
02000000:00000001:8.0:1773851876.943991:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851876.943992:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851876.943993:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851876.943994:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23171@kfi7
00000400:00000010:8.0:1773851876.943995:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a36d61ab.
00000100:00000200:8.0:1773851876.943996:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317868519936, offset 224
00000400:00000200:8.0:1773851876.943998:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23171@kfi7
00000400:00000200:8.0:1773851876.943999:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23171@kfi7 to cpt 2
00000400:00000200:8.0:1773851876.944000:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000033fc762 nid 23171@kfi7 refs 1
00000400:00000200:8.0:1773851876.944002:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000033fc762 nid 23171@kfi7 refs 2
00000400:00000200:8.0:1773851876.944004:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000033fc762 nid 23171@kfi7 refs 3
00000400:00000200:8.0:1773851876.944005:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23171@kfi7 local destination
00000400:00000200:8.0:1773851876.944007:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769551:8769551:1024:4294967295] 23171@kfi7 LPNI seq info [332344:332344:16:4294967295]
00000400:00000200:8.0:1773851876.944009:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000033fc762 nid 23171@kfi7 refs 2
00000400:00000200:8.0:1773851876.944010:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23171@kfi7 to cpt 2
00000400:00000200:8.0:1773851876.944013:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23171@kfi7(23171@kfi7:23171@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851876.944014:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000033fc762 nid 23171@kfi7 refs 3
00000800:00000200:8.0:1773851876.944016:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851876.944018:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851876.944021:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851876.944025:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf Using peer 23171@kfi7(0xddf)
00000800:00000200:8.0:1773851876.944029:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0xddf: rc=0
00000800:00000200:8.0:1773851876.944031:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851876.944033:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851876.944034:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004ae6632b refcount 2 to 23170@kfi7
00010000:00000001:8.0:1773851876.944035:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851876.944036:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851876.944038:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851876.944039:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000053785240 x1859317868519936/t0(0) o400->1760babf-7442-4312-88fc-9f4b87413db0@23170@kfi7:93/0 lens 224/224 e 0 to 0 dl 1773852208 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1944-0'
00000100:00100000:8.0:1773851876.944043:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053785240 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1760babf-7442-4312-88fc-9f4b87413db0+6:39718:x1859317868519936:12345-23170@kfi7:400:default-tuolumne1944-0 Request processed in 83us (135us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851876.944046:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23170@kfi7, seq: 2130806
00000100:00000040:8.0:1773851876.944047:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d33b999e : new rpc_count 0
00000100:00000001:8.0:1773851876.944048:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851876.944049:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851876.944049:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:8.0:1773851876.944050:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000424bbaaa.
00000020:00000010:8.0:1773851876.944051:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008e6ffc9a.
00000020:00000040:8.0:1773851876.944052:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000d33b999e : new refcount 5
00000100:00000001:8.0:1773851876.944053:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851876.944058:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851876.944059:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851876.944060:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23171@kfi7: PUT: OK
00000400:00000200:9.0:1773851876.944061:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a36d61ab
00000400:00000010:9.0:1773851876.944061:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a36d61ab.
00000100:00000001:9.0:1773851876.944062:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851876.944063:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851876.944064:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000033fc762 nid 23171@kfi7 refs 2
00000800:00000200:9.0:1773851876.944065:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 23171@kfi7(00000000fd9beb9c):0x0 lsk 3552 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0xddf Transaction freed
00000800:00000200:18.0:1773851876.968837:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851876.968838:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851876.968840:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851876.968842:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851876.968844:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9346@kfi7 to cpt 4
00000400:00000200:18.0:1773851876.968846:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9346@kfi7 : PUT - for me
00000400:00000200:18.0:1773851876.968847:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9346@kfi7 to cpt 4
00000400:00000200:18.0:1773851876.968848:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d48a50d7 nid 9346@kfi7 refs 1
00000400:00000200:18.0:1773851876.968849:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9346@kfi7 to cpt 4
00000400:00000200:18.0:1773851876.968850:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d48a50d7 nid 9346@kfi7 refs 2
00000400:00000200:18.0:1773851876.968851:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d48a50d7 nid 9346@kfi7 refs 3
00000400:00000200:18.0:1773851876.968852:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9347@kfi7 to cpt 0
00000400:00000200:18.0:1773851876.968853:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9347@kfi7 of length 224 into portal 12 MB=0x69b4bd0a83500
00000400:00000200:18.0:1773851876.968854:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9347@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 25320
00000800:00000200:18.0:1773851876.968857:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851876.968859:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851876.968860:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9346@kfi7: PUT: OK
00000100:00000001:18.0:1773851876.968861:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851876.968862:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851876.968863:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f638512.
00000100:00000040:18.0:1773851876.968864:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001f638512 x1859599785800960 msgsize 224
00000100:00100000:18.0:1773851876.968866:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-9347@kfi7 (source: 12345-9346@kfi7)
00000100:00000001:18.0:1773851876.968867:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851876.968868:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d48a50d7 nid 9346@kfi7 refs 2
00000800:00000200:18.0:1773851876.968870:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851876.968870:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851876.968871:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851876.968872:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851876.968873:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851876.968875:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851876.968876:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599785800960
00000020:00000001:17.0:1773851876.968877:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851876.968878:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d781c3
00000020:00000001:17.0:1773851876.968879:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851876.968882:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000059ff989e refcount=11
00000020:00000001:17.0:1773851876.968883:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637081201427456 : -106992508124160 : ffff9eb0dd8f4400)
00000020:00000001:17.0:1773851876.968885:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637081201427456 : -106992508124160 : ffff9eb0dd8f4400)
00000100:00000001:17.0:1773851876.968886:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.968887:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851876.968889:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c935461.
00000020:00000010:17.0:1773851876.968890:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851876.968892:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851876.968894:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851876.968895:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851876.968896:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.968898:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851876.968899:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851876.968899:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.968901:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851876.968904:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851876.968904:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851876.968905:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851876.968905:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851876.968907:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9347@kfi7, seq: 2156364
00000100:00000040:17.0:1773851876.968908:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000059ff989e : new rpc_count 1
00000100:00000001:16.0:1773851876.968908:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.968909:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534651520 : -106946174900096 : ffff9ebba73c2880)
00000100:00000001:16.0:1773851876.968909:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.968911:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001f638512 x1859599785800960/t0(0) o400->5429e0fd-8252-4ced-b8b4-b70f17301da1@9347@kfi7:97/0 lens 224/0 e 0 to 0 dl 1773852212 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1080-0'
00000100:00000001:17.0:1773851876.968917:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851876.968918:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851876.968919:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f638512 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5429e0fd-8252-4ced-b8b4-b70f17301da1+11:39747:x1859599785800960:12345-9347@kfi7:400:default-tuolumne1080-0
00000100:00000200:17.0:1773851876.968922:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599785800960
00000020:00000001:17.0:1773851876.968923:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851876.968924:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851876.968925:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.968927:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851876.968928:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851876.968929:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851876.968930:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599785800960, found 0 last_xid 1859599785800959
00000020:00000001:17.0:1773851876.968931:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851876.968932:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851876.968933:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851876.968933:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.968934:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851876.968935:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851876.968935:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851876.968936:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000002a497fe.
02000000:00000001:17.0:1773851876.968937:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.968938:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.968939:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851876.968940:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098827534, transno 0, xid 1859599785800960
00010000:00000001:17.0:1773851876.968941:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851876.968942:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001f638512 x1859599785800960/t0(0) o400->5429e0fd-8252-4ced-b8b4-b70f17301da1@9347@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1080-0'
00010000:00000001:17.0:1773851876.968945:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851876.968946:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851876.968947:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=109 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851876.968948:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851876.968949:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002152e3a7 refcount 3 to 9347@kfi7
00000100:00000001:17.0:1773851876.968950:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958444288 : -107146751107328 : ffff9e8cf3f61f00)
02000000:00000001:17.0:1773851876.968951:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851876.968952:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851876.968953:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851876.968953:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9346@kfi7
00000400:00000010:17.0:1773851876.968954:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000043bc2cef.
00000100:00000200:17.0:1773851876.968956:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599785800960, offset 224
00000400:00000200:17.0:1773851876.968958:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9346@kfi7
00000400:00000200:17.0:1773851876.968959:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9346@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.968959:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d48a50d7 nid 9346@kfi7 refs 1
00000400:00000200:17.0:1773851876.968961:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d48a50d7 nid 9346@kfi7 refs 2
00000400:00000200:17.0:1773851876.968962:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d48a50d7 nid 9346@kfi7 refs 3
00000400:00000200:17.0:1773851876.968963:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9346@kfi7 local destination
00000400:00000200:17.0:1773851876.968965:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769552:8769552:1024:4294967295] 9346@kfi7 LPNI seq info [11928181:11928181:16:4294967295]
00000400:00000200:17.0:1773851876.968967:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d48a50d7 nid 9346@kfi7 refs 2
00000400:00000200:17.0:1773851876.968968:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9346@kfi7 to cpt 4
00000400:00000200:17.0:1773851876.968970:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9346@kfi7(9346@kfi7:9346@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851876.968971:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d48a50d7 nid 9346@kfi7 refs 3
00000800:00000200:17.0:1773851876.968973:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851876.968975:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851876.968979:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851876.968982:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x875 Using peer 9346@kfi7(0x875)
00000800:00000200:17.0:1773851876.968985:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x875: rc=0
00000800:00000200:17.0:1773851876.968987:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x875 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851876.968989:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851876.968990:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002152e3a7 refcount 2 to 9347@kfi7
00010000:00000001:17.0:1773851876.968990:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851876.968991:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851876.968992:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851876.968992:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f638512 x1859599785800960/t0(0) o400->5429e0fd-8252-4ced-b8b4-b70f17301da1@9347@kfi7:97/0 lens 224/224 e 0 to 0 dl 1773852212 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1080-0'
00000100:00100000:17.0:1773851876.968996:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f638512 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5429e0fd-8252-4ced-b8b4-b70f17301da1+11:39747:x1859599785800960:12345-9347@kfi7:400:default-tuolumne1080-0 Request processed in 78us (131us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851876.968998:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9347@kfi7, seq: 2156364
00000100:00000040:17.0:1773851876.968999:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000059ff989e : new rpc_count 0
00000100:00000001:17.0:1773851876.969000:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851876.969001:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851876.969001:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000800:00000200:19.0:1773851876.969002:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x875 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851876.969002:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851876.969003:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c935461.
00000400:00000200:19.0:1773851876.969004:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851876.969004:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000059ff989e : new refcount 10
00000100:00000001:17.0:1773851876.969004:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851876.969005:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9346@kfi7: PUT: OK
00000400:00000200:19.0:1773851876.969006:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000043bc2cef
00000400:00000010:19.0:1773851876.969007:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000043bc2cef.
00000100:00000001:19.0:1773851876.969008:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851876.969008:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851876.969009:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d48a50d7 nid 9346@kfi7 refs 2
00000800:00000200:19.0:1773851876.969011:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 9346@kfi7(00000000f99aa1c0):0x0 lsk 2166 rsk 35 tsk 0 trmk 0 tmk 0 trr 4 tta 0x875 Transaction freed
00000800:00000200:6.0:1773851877.070736:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851877.070737:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851877.070738:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851877.070740:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851877.070742:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.070744:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20435@kfi7 : PUT - for me
00000400:00000200:6.0:1773851877.070745:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.070745:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 1
00000400:00000200:6.0:1773851877.070747:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.070747:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000400:00000200:6.0:1773851877.070748:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 3
00000400:00000200:6.0:1773851877.070749:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.070750:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20435@kfi7 of length 224 into portal 12 MB=0x69b0955aec900
00000400:00000200:6.0:1773851877.070752:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20435@kfi7 of length 224/224 into md 0x793926dc5 [64] + 149624
00000800:00000200:6.0:1773851877.070754:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851877.070755:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851877.070757:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20435@kfi7: PUT: OK
00000100:00000001:6.0:1773851877.070758:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851877.070758:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851877.070760:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000085ddb741.
00000100:00000040:6.0:1773851877.070760:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000085ddb741 x1859314254792960 msgsize 224
00000100:00100000:6.0:1773851877.070762:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-20435@kfi7 (source: 12345-20435@kfi7)
00000100:00000001:6.0:1773851877.070763:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851877.070764:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851877.070764:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 2
02000000:00000001:7.0:1773851877.070765:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851877.070765:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851877.070765:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851877.070766:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851877.070767:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851877.070767:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314254792960
00000020:00000001:7.0:1773851877.070768:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851877.070768:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ea9
00000020:00000001:7.0:1773851877.070769:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851877.070771:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c2f31175 refcount=9
00000020:00000001:7.0:1773851877.070771:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239646208 : -107152469905408 : ffff9e8b9f183000)
00000020:00000001:7.0:1773851877.070772:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239646208 : -107152469905408 : ffff9e8b9f183000)
00000100:00000001:7.0:1773851877.070773:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.070774:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851877.070775:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851877.070776:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851877.070777:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851877.070777:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851877.070778:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851877.070778:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.070779:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851877.070780:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851877.070781:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.070782:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.070783:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851877.070783:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851877.070783:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851877.070783:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851877.070785:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20435@kfi7, seq: 2001939
00000100:00000040:7.0:1773851877.070785:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c2f31175 : new rpc_count 1
00000100:00000001:4.0:1773851877.070785:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.070786:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814084224 : -107101895467392 : ffff9e976590de80)
00000100:00000001:4.0:1773851877.070786:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.070787:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000085ddb741 x1859314254792960/t0(0) o400->6ba14574-1a49-4706-bf53-3e4ba013efbb@20435@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1765-0'
00000100:00000001:7.0:1773851877.070790:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.070790:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851877.070791:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000085ddb741 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6ba14574-1a49-4706-bf53-3e4ba013efbb+9:39815:x1859314254792960:12345-20435@kfi7:400:default-tuolumne1765-0
00000100:00000200:7.0:1773851877.070793:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314254792960
00000020:00000001:7.0:1773851877.070793:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851877.070794:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851877.070795:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.070795:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851877.070796:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851877.070796:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851877.070797:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314254792960, found 0 last_xid 1859314254792959
00000020:00000001:7.0:1773851877.070798:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851877.070798:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851877.070799:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851877.070800:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.070800:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851877.070801:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851877.070802:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851877.070802:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004c4d9c27.
02000000:00000001:7.0:1773851877.070803:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.070804:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.070804:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851877.070805:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181510848053, transno 0, xid 1859314254792960
00010000:00000001:7.0:1773851877.070806:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851877.070807:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000085ddb741 x1859314254792960/t0(0) o400->6ba14574-1a49-4706-bf53-3e4ba013efbb@20435@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1765-0'
00010000:00000001:7.0:1773851877.070810:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851877.070810:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851877.070811:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=109 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851877.070812:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851877.070813:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036b0aefc refcount 5 to 20435@kfi7
00000100:00000001:7.0:1773851877.070814:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931325663680 : -107142383887936 : ffff9e8df84499c0)
02000000:00000001:7.0:1773851877.070814:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851877.070815:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.070816:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851877.070817:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20435@kfi7
00000400:00000010:7.0:1773851877.070817:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edcc54b1.
00000100:00000200:7.0:1773851877.070818:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314254792960, offset 224
00000400:00000200:7.0:1773851877.070820:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20435@kfi7
00000400:00000200:7.0:1773851877.070820:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.070821:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 1
00000400:00000200:7.0:1773851877.070823:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000400:00000200:7.0:1773851877.070824:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 3
00000400:00000200:7.0:1773851877.070825:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20435@kfi7 local destination
00000400:00000200:7.0:1773851877.070826:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769553:8769553:1024:4294967295] 20435@kfi7 LPNI seq info [133133:133133:16:4294967295]
00000400:00000200:7.0:1773851877.070828:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000400:00000200:7.0:1773851877.070829:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.070830:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20435@kfi7(20435@kfi7:20435@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851877.070832:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 3
00000800:00000200:7.0:1773851877.070833:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851877.070834:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851877.070836:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851877.070839:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7fb Using peer 20435@kfi7(0x7fb)
00000800:00000200:7.0:1773851877.070842:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x7fb: rc=0
00000800:00000200:7.0:1773851877.070844:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7fb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851877.070846:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.070847:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036b0aefc refcount 4 to 20435@kfi7
00010000:00000001:7.0:1773851877.070847:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851877.070848:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.070849:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851877.070849:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000085ddb741 x1859314254792960/t0(0) o400->6ba14574-1a49-4706-bf53-3e4ba013efbb@20435@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1765-0'
00000100:00100000:7.0:1773851877.070853:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000085ddb741 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6ba14574-1a49-4706-bf53-3e4ba013efbb+9:39815:x1859314254792960:12345-20435@kfi7:400:default-tuolumne1765-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851877.070856:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20435@kfi7, seq: 2001939
00000100:00000040:7.0:1773851877.070856:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c2f31175 : new rpc_count 0
00000800:00000200:5.0:1773851877.070856:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7fb TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851877.070857:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851877.070857:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851877.070857:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851877.070858:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000200:5.0:1773851877.070858:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20435@kfi7: PUT: OK
00000020:00000010:7.0:1773851877.070859:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:5.0:1773851877.070859:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edcc54b1
00000400:00000010:5.0:1773851877.070859:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edcc54b1.
00000020:00000010:7.0:1773851877.070860:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000020:00000040:7.0:1773851877.070860:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000c2f31175 : new refcount 8
00000100:00000001:5.0:1773851877.070860:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851877.070861:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851877.070861:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851877.070862:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000800:00000200:5.0:1773851877.070863:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 20435@kfi7(00000000c4fdbfb2):0x0 lsk 2044 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7fb Transaction freed
00000800:00000200:13.0:1773851877.090322:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851877.090323:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851877.090325:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851877.090327:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851877.090329:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18883@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.090331:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18883@kfi7 : PUT - for me
00000400:00000200:13.0:1773851877.090332:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18883@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.090333:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb70666a nid 18883@kfi7 refs 1
00000400:00000200:13.0:1773851877.090335:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18883@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.090335:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb70666a nid 18883@kfi7 refs 2
00000400:00000200:13.0:1773851877.090336:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bb70666a nid 18883@kfi7 refs 3
00000400:00000200:13.0:1773851877.090337:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18883@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.090338:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18883@kfi7 of length 224 into portal 12 MB=0x699e0b20f5e80
00000400:00000200:13.0:1773851877.090340:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18883@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 38416
00000800:00000200:13.0:1773851877.090342:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851877.090344:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851877.090345:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18883@kfi7: PUT: OK
00000100:00000001:13.0:1773851877.090346:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851877.090346:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851877.090347:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008dd119a2.
00000100:00000040:13.0:1773851877.090348:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000008dd119a2 x1858040199339648 msgsize 224
00000100:00100000:13.0:1773851877.090350:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18883@kfi7 (source: 12345-18883@kfi7)
00000100:00000001:13.0:1773851877.090352:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851877.090353:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851877.090353:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bb70666a nid 18883@kfi7 refs 2
02000000:00000001:15.0:1773851877.090354:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851877.090354:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851877.090355:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851877.090355:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851877.090357:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851877.090357:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040199339648
00000020:00000001:15.0:1773851877.090358:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851877.090359:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac919df
00000020:00000001:15.0:1773851877.090359:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851877.090363:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000016c83429 refcount=6
00000020:00000001:15.0:1773851877.090363:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242228736 : -107152467322880 : ffff9e8b9f3f9800)
00000020:00000001:15.0:1773851877.090364:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242228736 : -107152467322880 : ffff9e8b9f3f9800)
00000100:00000001:15.0:1773851877.090366:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.090366:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851877.090367:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d450e38c.
00000020:00000010:15.0:1773851877.090369:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851877.090369:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851877.090371:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851877.090371:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851877.090372:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.090373:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851877.090373:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851877.090374:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.090375:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.090376:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851877.090376:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851877.090377:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851877.090377:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18883@kfi7, seq: 2289868
00000100:00000001:12.0:1773851877.090377:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851877.090378:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000016c83429 : new rpc_count 1
00000100:00000001:12.0:1773851877.090378:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.090379:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902250240 : -106994807301376 : ffff9eb054849b00)
00000100:00000001:12.0:1773851877.090379:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.090381:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008dd119a2 x1858040199339648/t0(0) o400->ca824cb4-82b6-4440-8db1-574ff00155a8@18883@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1671-0'
00000100:00000001:15.0:1773851877.090383:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.090384:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851877.090385:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008dd119a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ca824cb4-82b6-4440-8db1-574ff00155a8+6:39801:x1858040199339648:12345-18883@kfi7:400:default-tuolumne1671-0
00000100:00000200:15.0:1773851877.090386:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040199339648
00000020:00000001:15.0:1773851877.090387:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851877.090388:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851877.090389:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.090390:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851877.090390:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851877.090391:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851877.090392:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040199339648, found 0 last_xid 1858040199339647
00000020:00000001:15.0:1773851877.090393:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851877.090393:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851877.090394:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851877.090394:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.090395:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851877.090396:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851877.090396:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851877.090397:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000342ec44.
02000000:00000001:15.0:1773851877.090398:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.090398:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.090399:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851877.090400:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260599140, transno 0, xid 1858040199339648
00010000:00000001:15.0:1773851877.090401:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851877.090401:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008dd119a2 x1858040199339648/t0(0) o400->ca824cb4-82b6-4440-8db1-574ff00155a8@18883@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1671-0'
00010000:00000001:15.0:1773851877.090404:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851877.090405:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851877.090405:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=110 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851877.090406:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851877.090407:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006d998266 refcount 3 to 18883@kfi7
00000100:00000001:15.0:1773851877.090408:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487622560 : -107151221929056 : ffff9e8be97acba0)
02000000:00000001:15.0:1773851877.090409:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851877.090409:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.090410:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851877.090411:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18883@kfi7
00000400:00000010:15.0:1773851877.090412:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000011bada2.
00000100:00000200:15.0:1773851877.090412:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040199339648, offset 224
00000400:00000200:15.0:1773851877.090414:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18883@kfi7
00000400:00000200:15.0:1773851877.090414:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18883@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.090416:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb70666a nid 18883@kfi7 refs 1
00000400:00000200:15.0:1773851877.090417:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bb70666a nid 18883@kfi7 refs 2
00000400:00000200:15.0:1773851877.090418:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bb70666a nid 18883@kfi7 refs 3
00000400:00000200:15.0:1773851877.090419:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18883@kfi7 local destination
00000400:00000200:15.0:1773851877.090421:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769554:8769554:1024:4294967295] 18883@kfi7 LPNI seq info [479522:479522:16:4294967295]
00000400:00000200:15.0:1773851877.090422:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bb70666a nid 18883@kfi7 refs 2
00000400:00000200:15.0:1773851877.090423:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18883@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.090425:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18883@kfi7(18883@kfi7:18883@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851877.090426:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bb70666a nid 18883@kfi7 refs 3
00000800:00000200:15.0:1773851877.090427:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851877.090428:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851877.090430:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851877.090432:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26b Using peer 18883@kfi7(0x26b)
00000800:00000200:15.0:1773851877.090436:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x26b: rc=0
00000800:00000200:15.0:1773851877.090437:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851877.090439:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.090440:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006d998266 refcount 2 to 18883@kfi7
00010000:00000001:15.0:1773851877.090441:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851877.090441:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.090442:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851877.090442:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008dd119a2 x1858040199339648/t0(0) o400->ca824cb4-82b6-4440-8db1-574ff00155a8@18883@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1671-0'
00000100:00100000:15.0:1773851877.090446:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008dd119a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ca824cb4-82b6-4440-8db1-574ff00155a8+6:39801:x1858040199339648:12345-18883@kfi7:400:default-tuolumne1671-0 Request processed in 61us (96us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851877.090448:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18883@kfi7, seq: 2289868
00000100:00000040:15.0:1773851877.090450:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000016c83429 : new rpc_count 0
00000100:00000001:15.0:1773851877.090450:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851877.090450:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26b TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851877.090451:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851877.090451:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851877.090452:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851877.090452:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000020:00000010:15.0:1773851877.090453:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d450e38c.
00000400:00000200:13.0:1773851877.090453:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18883@kfi7: PUT: OK
00000020:00000040:15.0:1773851877.090454:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000016c83429 : new refcount 5
00000400:00000200:13.0:1773851877.090454:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000011bada2
00000400:00000010:13.0:1773851877.090454:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000011bada2.
00000100:00000001:15.0:1773851877.090455:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851877.090455:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851877.090455:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851877.090456:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bb70666a nid 18883@kfi7 refs 2
00000800:00000200:13.0:1773851877.090458:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18883@kfi7(00000000948d69a3):0x0 lsk 620 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26b Transaction freed
00000800:00000200:21.0:1773851877.160900:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851877.160901:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851877.160902:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851877.160904:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851877.160906:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13171@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.160907:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13171@kfi7 : PUT - for me
00000400:00000200:21.0:1773851877.160908:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13171@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.160909:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064066bec nid 13171@kfi7 refs 1
00000400:00000200:21.0:1773851877.160910:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13171@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.160910:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064066bec nid 13171@kfi7 refs 2
00000400:00000200:21.0:1773851877.160911:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000064066bec nid 13171@kfi7 refs 3
00000400:00000200:21.0:1773851877.160912:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13234@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.160913:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13234@kfi7 of length 224 into portal 12 MB=0x69b4c4c37bd40
00000400:00000200:21.0:1773851877.160914:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13234@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 46992
00000800:00000200:21.0:1773851877.160916:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851877.160917:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851877.160918:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13171@kfi7: PUT: OK
00000100:00000001:21.0:1773851877.160919:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851877.160920:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851877.160921:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1cac8e7.
00000100:00000040:21.0:1773851877.160922:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e1cac8e7 x1859601858805056 msgsize 224
00000100:00100000:21.0:1773851877.160923:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13234@kfi7 (source: 12345-13171@kfi7)
00000100:00000001:21.0:1773851877.160924:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851877.160925:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000064066bec nid 13171@kfi7 refs 2
00000100:00000001:23.0:1773851877.160926:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851877.160926:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851877.160926:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851877.160927:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851877.160927:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851877.160928:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851877.160929:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601858805056
00000020:00000001:23.0:1773851877.160929:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851877.160930:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78194
00000020:00000001:23.0:1773851877.160930:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851877.160932:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b03e6cfc refcount=602
00000020:00000001:23.0:1773851877.160933:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637124797449216 : -106948912102400 : ffff9ebb0415c400)
00000020:00000001:23.0:1773851877.160934:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637124797449216 : -106948912102400 : ffff9ebb0415c400)
00000100:00000001:23.0:1773851877.160935:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851877.160936:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851877.160937:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009c1daf7d.
00000020:00000010:23.0:1773851877.160938:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851877.160938:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851877.160939:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851877.160940:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851877.160940:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851877.160941:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851877.160941:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851877.160942:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.160943:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851877.160944:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851877.160945:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851877.160945:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851877.160945:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851877.160946:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13234@kfi7, seq: 1998008
00000100:00000001:23.0:1773851877.160947:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851877.160947:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b03e6cfc : new rpc_count 13
00000100:00000001:23.0:1773851877.160948:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851877.160948:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794378240 : -106943915173376 : ffff9ebc2decda00)
00000100:00000040:20.0:1773851877.160949:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e1cac8e7 x1859601858805056/t0(0) o400->287f02d3-54ec-4ae5-a397-7889dbda0366@13234@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1306-0'
00000100:00000001:20.0:1773851877.160952:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851877.160952:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851877.160953:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1cac8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:287f02d3-54ec-4ae5-a397-7889dbda0366+602:39570:x1859601858805056:12345-13234@kfi7:400:default-tuolumne1306-0
00000100:00000200:20.0:1773851877.160955:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601858805056
00000020:00000001:20.0:1773851877.160956:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851877.160957:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851877.160958:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851877.160958:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851877.160959:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851877.160960:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851877.160960:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601858805056, found 0 last_xid 1859601852485567
00000020:00000001:20.0:1773851877.160961:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851877.160962:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851877.160962:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851877.160963:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851877.160964:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851877.160964:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851877.160965:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851877.160966:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c0031985.
02000000:00000001:20.0:1773851877.160966:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851877.160967:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851877.160968:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851877.160968:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583306, transno 0, xid 1859601858805056
00010000:00000001:20.0:1773851877.160969:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851877.160970:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e1cac8e7 x1859601858805056/t0(0) o400->287f02d3-54ec-4ae5-a397-7889dbda0366@13234@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1306-0'
00010000:00000001:20.0:1773851877.160972:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851877.160972:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851877.160973:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=110 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851877.160974:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851877.160975:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0cecfe9 refcount 3 to 13234@kfi7
00000100:00000001:20.0:1773851877.160976:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094880 : -107139307456736 : ffff9e8eafa33720)
02000000:00000001:20.0:1773851877.160977:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851877.160977:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851877.160978:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851877.160979:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13171@kfi7
00000400:00000010:20.0:1773851877.160979:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe5250b8.
00000100:00000200:20.0:1773851877.160980:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601858805056, offset 224
00000400:00000200:20.0:1773851877.160982:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13171@kfi7
00000400:00000200:20.0:1773851877.160985:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13171@kfi7 to cpt 5
00000400:00000200:20.0:1773851877.160986:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064066bec nid 13171@kfi7 refs 1
00000400:00000200:20.0:1773851877.160987:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000064066bec nid 13171@kfi7 refs 2
00000400:00000200:20.0:1773851877.160988:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000064066bec nid 13171@kfi7 refs 3
00000400:00000200:20.0:1773851877.160989:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13171@kfi7 local destination
00000400:00000200:20.0:1773851877.160990:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769555:8769555:1024:4294967295] 13171@kfi7 LPNI seq info [531408:531408:16:4294967295]
00000400:00000200:20.0:1773851877.160992:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000064066bec nid 13171@kfi7 refs 2
00000400:00000200:20.0:1773851877.160993:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13171@kfi7 to cpt 5
00000400:00000200:20.0:1773851877.160995:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13171@kfi7(13171@kfi7:13171@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851877.160996:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000064066bec nid 13171@kfi7 refs 3
00000800:00000200:20.0:1773851877.160998:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851877.160999:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851877.161001:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851877.161003:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b0a Using peer 13171@kfi7(0x100000000000b0a)
00000800:00000200:20.0:1773851877.161006:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x100000000000b0a: rc=0
00000800:00000200:20.0:1773851877.161007:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b0a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851877.161009:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851877.161010:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0cecfe9 refcount 2 to 13234@kfi7
00010000:00000001:20.0:1773851877.161011:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851877.161011:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851877.161012:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851877.161013:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1cac8e7 x1859601858805056/t0(0) o400->287f02d3-54ec-4ae5-a397-7889dbda0366@13234@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1306-0'
00000100:00100000:20.0:1773851877.161016:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1cac8e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:287f02d3-54ec-4ae5-a397-7889dbda0366+602:39570:x1859601858805056:12345-13234@kfi7:400:default-tuolumne1306-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851877.161021:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13234@kfi7, seq: 1998008
00000100:00000040:20.0:1773851877.161022:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b03e6cfc : new rpc_count 12
00000100:00000001:20.0:1773851877.161023:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851877.161023:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851877.161024:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851877.161025:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:20.0:1773851877.161026:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009c1daf7d.
00000020:00000040:20.0:1773851877.161027:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b03e6cfc : new refcount 601
00000100:00000001:20.0:1773851877.161027:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851877.161032:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b0a TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851877.161034:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851877.161034:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13171@kfi7: PUT: OK
00000400:00000200:21.0:1773851877.161035:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe5250b8
00000400:00000010:21.0:1773851877.161036:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe5250b8.
00000100:00000001:21.0:1773851877.161037:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851877.161037:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851877.161038:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000064066bec nid 13171@kfi7 refs 2
00000800:00000200:21.0:1773851877.161039:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13171@kfi7(0000000099fee93c):0x0 lsk 2827 rsk 16 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b0a Transaction freed
00000800:00000200:30.0:1773851877.162368:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851877.162368:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851877.162369:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851877.162369:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:29.0:1773851877.162370:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851877.162371:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851877.162372:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851877.162372:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21442@kfi7(000000005b9e49ed):0x47b version: 2; local version 2; negotiated version: 2
00000400:00000200:30.0:1773851877.162375:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21442@kfi7 to cpt 7
00000800:00000200:29.0:1773851877.162375:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b Using peer 21442@kfi7(0x10000000000047b)
00000400:00000200:30.0:1773851877.162376:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21442@kfi7 : PUT - for me
00000400:00000200:30.0:1773851877.162377:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21442@kfi7 to cpt 7
00000400:00000200:30.0:1773851877.162377:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080f68fd2 nid 21442@kfi7 refs 1
00000400:00000200:30.0:1773851877.162378:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21442@kfi7 to cpt 7
00000400:00000200:30.0:1773851877.162379:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080f68fd2 nid 21442@kfi7 refs 2
00000400:00000200:30.0:1773851877.162380:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000080f68fd2 nid 21442@kfi7 refs 3
00000400:00000200:29.0:1773851877.162380:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21442@kfi7 to cpt 7
00000400:00000200:30.0:1773851877.162381:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21442@kfi7 to cpt 7
00000400:00000200:30.0:1773851877.162382:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21442@kfi7 of length 224 into portal 12 MB=0x699e190969dc0
00000800:00000200:29.0:1773851877.162382:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 38 bytes to peer 0x10000000000047b: rc=0
00000400:00000200:30.0:1773851877.162383:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21442@kfi7 of length 224/224 into md 0x77fe139dd [64] + 187240
00000800:00000200:29.0:1773851877.162383:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851877.162385:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851877.162386:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851877.162387:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21442@kfi7: PUT: OK
00000100:00000001:30.0:1773851877.162388:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851877.162389:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851877.162390:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bac9ca66.
00000100:00000040:30.0:1773851877.162390:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000bac9ca66 x1858043932745152 msgsize 224
00000100:00100000:30.0:1773851877.162392:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-21442@kfi7 (source: 12345-21442@kfi7)
00000100:00000001:30.0:1773851877.162393:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851877.162394:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000080f68fd2 nid 21442@kfi7 refs 2
00000800:00000200:31.0:1773851877.162395:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851877.162395:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:31.0:1773851877.162398:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2054@kfi7:7 <- 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b Transaction freed
00000100:00000001:29.0:1773851877.162398:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851877.162398:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851877.162399:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851877.162399:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851877.162400:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851877.162401:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043932745152
00000020:00000001:29.0:1773851877.162401:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851877.162402:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920ca
00000020:00000001:29.0:1773851877.162402:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851877.162405:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000706cbd28 refcount=1004
00000020:00000001:29.0:1773851877.162406:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629496832 : -107123080054784 : ffff9e9276ddb800)
00000020:00000001:29.0:1773851877.162406:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629496832 : -107123080054784 : ffff9e9276ddb800)
00000100:00000001:29.0:1773851877.162408:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851877.162409:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851877.162409:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851877.162410:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851877.162411:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851877.162412:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851877.162412:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851877.162413:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851877.162414:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851877.162414:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851877.162415:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.162416:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851877.162417:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851877.162417:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851877.162418:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851877.162418:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851877.162419:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21442@kfi7, seq: 2055544
00000100:00000040:29.0:1773851877.162419:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000706cbd28 : new rpc_count 8
00000100:00000001:29.0:1773851877.162420:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411258368 : -106960298293248 : ffff9eb85d6a4800)
00000100:00000001:28.0:1773851877.162420:0:60533:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.162420:0:60533:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851877.162422:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bac9ca66 x1858043932745152/t0(0) o400->76fb9548-052c-4505-a24b-97882ed0a9cb@21442@kfi7:665/0 lens 224/0 e 0 to 0 dl 1773852025 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1831-0'
00000100:00000001:29.0:1773851877.162424:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851877.162425:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851877.162426:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bac9ca66 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:76fb9548-052c-4505-a24b-97882ed0a9cb+1004:39612:x1858043932745152:12345-21442@kfi7:400:default-tuolumne1831-0
00000100:00000200:29.0:1773851877.162427:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043932745152
00000020:00000001:29.0:1773851877.162428:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851877.162429:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851877.162430:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851877.162430:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851877.162431:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851877.162432:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851877.162432:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043932745152, found 0 last_xid 1858043911711231
00000020:00000001:29.0:1773851877.162433:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851877.162434:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851877.162434:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851877.162435:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851877.162435:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851877.162436:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851877.162437:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851877.162437:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005e26a9ee.
02000000:00000001:29.0:1773851877.162438:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.162439:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851877.162439:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851877.162440:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590325, transno 0, xid 1858043932745152
00010000:00000001:29.0:1773851877.162441:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851877.162442:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bac9ca66 x1858043932745152/t0(0) o400->76fb9548-052c-4505-a24b-97882ed0a9cb@21442@kfi7:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1831-0'
00010000:00000001:29.0:1773851877.162444:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851877.162445:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851877.162445:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=110 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851877.162447:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851877.162448:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000465de10e refcount 3 to 21442@kfi7
00000100:00000001:29.0:1773851877.162449:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269472 : -107152618282144 : ffff9e8b96402360)
02000000:00000001:29.0:1773851877.162450:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851877.162450:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.162451:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851877.162452:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21442@kfi7
00000400:00000010:29.0:1773851877.162452:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006d9d8384.
00000100:00000200:29.0:1773851877.162453:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043932745152, offset 224
00000400:00000200:29.0:1773851877.162455:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21442@kfi7
00000400:00000200:29.0:1773851877.162456:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21442@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.162456:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080f68fd2 nid 21442@kfi7 refs 1
00000400:00000200:29.0:1773851877.162457:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000080f68fd2 nid 21442@kfi7 refs 2
00000400:00000200:29.0:1773851877.162458:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000080f68fd2 nid 21442@kfi7 refs 3
00000400:00000200:29.0:1773851877.162460:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21442@kfi7 local destination
00000400:00000200:29.0:1773851877.162462:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769556:8769556:1024:4294967295] 21442@kfi7 LPNI seq info [2113727:2113727:16:4294967295]
00000400:00000200:29.0:1773851877.162463:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000080f68fd2 nid 21442@kfi7 refs 2
00000400:00000200:29.0:1773851877.162464:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21442@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.162466:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21442@kfi7(21442@kfi7:21442@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851877.162467:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000080f68fd2 nid 21442@kfi7 refs 3
00000800:00000200:29.0:1773851877.162469:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851877.162470:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851877.162472:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851877.162474:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b Using peer 21442@kfi7(0x10000000000047b)
00000800:00000200:29.0:1773851877.162477:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 324 bytes to peer 0x10000000000047b: rc=0
00000800:00000200:29.0:1773851877.162478:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851877.162480:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851877.162481:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000465de10e refcount 2 to 21442@kfi7
00010000:00000001:29.0:1773851877.162482:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851877.162483:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851877.162483:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851877.162484:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bac9ca66 x1858043932745152/t0(0) o400->76fb9548-052c-4505-a24b-97882ed0a9cb@21442@kfi7:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1831-0'
00000100:00100000:29.0:1773851877.162487:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bac9ca66 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:76fb9548-052c-4505-a24b-97882ed0a9cb+1004:39612:x1858043932745152:12345-21442@kfi7:400:default-tuolumne1831-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851877.162490:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21442@kfi7, seq: 2055544
00000800:00000200:30.0:1773851877.162491:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851877.162491:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000706cbd28 : new rpc_count 7
00000400:00000200:30.0:1773851877.162492:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851877.162492:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851877.162492:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:30.0:1773851877.162493:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21442@kfi7: PUT: OK
00000020:00000010:29.0:1773851877.162493:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851877.162494:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006d9d8384
00000020:00000010:29.0:1773851877.162494:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000010:30.0:1773851877.162495:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006d9d8384.
00000100:00000001:30.0:1773851877.162495:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:29.0:1773851877.162495:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000020:00000040:29.0:1773851877.162495:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000706cbd28 : new refcount 1003
00000100:00000001:30.0:1773851877.162496:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:29.0:1773851877.162496:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851877.162497:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000080f68fd2 nid 21442@kfi7 refs 2
00000800:00000200:30.0:1773851877.162498:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 21442@kfi7(000000005b9e49ed):0x0 lsk 1148 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000047b Transaction freed
00000800:00000200:30.0:1773851877.163856:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851877.163856:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851877.163857:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:29.0:1773851877.163857:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851877.163858:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:29.0:1773851877.163858:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851877.163860:0:2472963:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13232@kfi7(00000000d5574912):0x8fa version: 2; local version 2; negotiated version: 2
00000800:00000200:29.0:1773851877.163860:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:30.0:1773851877.163862:0:2472963:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa Using peer 13232@kfi7(0x1000000000008fa)
00000400:00000200:29.0:1773851877.163862:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13232@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.163863:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13232@kfi7 : PUT - for me
00000400:00000200:30.0:1773851877.163864:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13232@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.163865:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13232@kfi7 to cpt 7
00000800:00000200:30.0:1773851877.163866:0:2472963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000c05b04ad: Posted send of 38 bytes to peer 0x1000000000008fa: rc=0
00000400:00000200:29.0:1773851877.163866:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 1
00000800:00000200:30.0:1773851877.163867:0:2472963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851877.163867:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13232@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.163868:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 2
00000400:00000200:29.0:1773851877.163869:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 3
00000400:00000200:29.0:1773851877.163870:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13232@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.163871:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13232@kfi7 of length 224 into portal 12 MB=0x699e1b161ecc0
00000400:00000200:29.0:1773851877.163872:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13232@kfi7 of length 224/224 into md 0x77fe139dd [64] + 187464
00000800:00000200:29.0:1773851877.163874:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851877.163875:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851877.163876:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13232@kfi7: PUT: OK
00000100:00000001:29.0:1773851877.163877:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851877.163877:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851877.163878:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007360b5af.
00000800:00000200:30.0:1773851877.163879:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851877.163879:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000007360b5af x1858044482940096 msgsize 224
00000100:00100000:29.0:1773851877.163880:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13232@kfi7 (source: 12345-13232@kfi7)
00000800:00000200:30.0:1773851877.163881:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c05b04ad: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa Transaction freed
00000100:00000001:29.0:1773851877.163881:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851877.163882:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 2
00000800:00000200:29.0:1773851877.163883:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851877.163886:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851877.163887:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851877.163887:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851877.163888:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851877.163889:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851877.163889:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044482940096
00000020:00000001:30.0:1773851877.163890:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851877.163890:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b36
00000020:00000001:30.0:1773851877.163891:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851877.163895:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000721b0db0 refcount=55
00000020:00000001:30.0:1773851877.163896:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628021248 : -107123081530368 : ffff9e9276c73400)
00000020:00000001:30.0:1773851877.163897:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628021248 : -107123081530368 : ffff9e9276c73400)
00000100:00000001:30.0:1773851877.163898:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851877.163898:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851877.163899:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005cf69b62.
00000020:00000010:30.0:1773851877.163900:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851877.163901:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b82ebc51.
00000100:00000001:30.0:1773851877.163902:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851877.163902:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851877.163903:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851877.163904:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851877.163905:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851877.163905:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.163906:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851877.163908:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851877.163908:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851877.163908:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851877.163908:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851877.163909:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13232@kfi7, seq: 2055545
00000100:00000001:30.0:1773851877.163910:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.163910:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000721b0db0 : new rpc_count 1
00000100:00000001:30.0:1773851877.163911:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.163911:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079339692160 : -106994369859456 : ffff9eb06e977080)
00000100:00000040:28.0:1773851877.163912:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007360b5af x1858044482940096/t0(0) o400->d698b16a-4c5c-47d0-a941-cd2339d45d63@13232@kfi7:94/0 lens 224/0 e 0 to 0 dl 1773852209 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1310-0'
00000100:00000001:28.0:1773851877.163915:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851877.163915:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851877.163916:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007360b5af pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d698b16a-4c5c-47d0-a941-cd2339d45d63+55:39629:x1858044482940096:12345-13232@kfi7:400:default-tuolumne1310-0
00000100:00000200:28.0:1773851877.163918:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044482940096
00000020:00000001:28.0:1773851877.163918:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851877.163919:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851877.163919:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.163920:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851877.163920:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851877.163921:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851877.163922:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044482940096, found 0 last_xid 1858044340312575
00000020:00000001:28.0:1773851877.163923:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851877.163923:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851877.163924:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851877.163924:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.163925:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851877.163925:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851877.163926:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851877.163926:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001aa5c9b3.
02000000:00000001:28.0:1773851877.163927:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.163927:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.163928:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851877.163929:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255028562, transno 0, xid 1858044482940096
00010000:00000001:28.0:1773851877.163929:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851877.163930:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007360b5af x1858044482940096/t0(0) o400->d698b16a-4c5c-47d0-a941-cd2339d45d63@13232@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1310-0'
00010000:00000001:28.0:1773851877.163933:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851877.163934:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851877.163934:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=110 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851877.163935:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851877.163936:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000070c2d698 refcount 3 to 13232@kfi7
00000100:00000001:28.0:1773851877.163937:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715062976 : -107155994488640 : ffff9e8acd0350c0)
02000000:00000001:28.0:1773851877.163937:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851877.163938:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.163939:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851877.163940:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13232@kfi7
00000400:00000010:28.0:1773851877.163941:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fbb7163e.
00000100:00000200:28.0:1773851877.163941:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044482940096, offset 224
00000400:00000200:28.0:1773851877.163943:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13232@kfi7
00000400:00000200:28.0:1773851877.163944:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13232@kfi7 to cpt 7
00000400:00000200:28.0:1773851877.163945:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 1
00000400:00000200:28.0:1773851877.163946:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 2
00000400:00000200:28.0:1773851877.163947:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 3
00000400:00000200:28.0:1773851877.163948:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13232@kfi7 local destination
00000400:00000200:28.0:1773851877.163950:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769557:8769557:1024:4294967295] 13232@kfi7 LPNI seq info [2131999:2131999:16:4294967295]
00000400:00000200:28.0:1773851877.163951:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 2
00000400:00000200:28.0:1773851877.163952:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13232@kfi7 to cpt 7
00000400:00000200:28.0:1773851877.163954:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13232@kfi7(13232@kfi7:13232@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851877.163955:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 3
00000800:00000200:28.0:1773851877.163957:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851877.163958:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851877.163961:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851877.163965:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa Using peer 13232@kfi7(0x1000000000008fa)
00000800:00000200:28.0:1773851877.163969:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x1000000000008fa: rc=0
00000800:00000200:28.0:1773851877.163970:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851877.163972:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.163973:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000070c2d698 refcount 2 to 13232@kfi7
00010000:00000001:28.0:1773851877.163974:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851877.163974:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.163975:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851877.163976:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007360b5af x1858044482940096/t0(0) o400->d698b16a-4c5c-47d0-a941-cd2339d45d63@13232@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1310-0'
00000100:00100000:28.0:1773851877.163980:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007360b5af pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d698b16a-4c5c-47d0-a941-cd2339d45d63+55:39629:x1858044482940096:12345-13232@kfi7:400:default-tuolumne1310-0 Request processed in 65us (101us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851877.163983:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13232@kfi7, seq: 2055545
00000100:00000040:28.0:1773851877.163983:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000721b0db0 : new rpc_count 0
00000100:00000001:28.0:1773851877.163984:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851877.163985:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851877.163985:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:28.0:1773851877.163986:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b82ebc51.
00000020:00000010:28.0:1773851877.163987:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005cf69b62.
00000020:00000040:28.0:1773851877.163987:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000721b0db0 : new refcount 54
00000100:00000001:28.0:1773851877.163988:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851877.163992:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851877.163994:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851877.163995:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13232@kfi7: PUT: OK
00000400:00000200:29.0:1773851877.163996:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fbb7163e
00000400:00000010:29.0:1773851877.163997:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fbb7163e.
00000100:00000001:29.0:1773851877.163997:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851877.163998:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851877.163998:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000081a3d2b6 nid 13232@kfi7 refs 2
00000800:00000200:29.0:1773851877.164000:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 13232@kfi7(00000000d5574912):0x0 lsk 2299 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008fa Transaction freed
00000800:00000200:17.0:1773851877.186471:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.186473:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851877.186475:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851877.186479:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851877.186483:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12003@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.186485:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12003@kfi7 : PUT - for me
00000400:00000200:17.0:1773851877.186487:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12003@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.186489:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000072528b79 nid 12003@kfi7 refs 1
00000400:00000200:17.0:1773851877.186490:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12003@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.186491:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000072528b79 nid 12003@kfi7 refs 2
00000400:00000200:17.0:1773851877.186493:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000072528b79 nid 12003@kfi7 refs 3
00000400:00000200:17.0:1773851877.186494:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11811@kfi7 to cpt 1
00000400:00000200:17.0:1773851877.186495:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11811@kfi7 of length 224 into portal 12 MB=0x69b196db932c0
00000400:00000200:17.0:1773851877.186498:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11811@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 25544
00000800:00000200:17.0:1773851877.186500:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851877.186503:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851877.186504:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12003@kfi7: PUT: OK
00000100:00000001:17.0:1773851877.186506:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851877.186506:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851877.186508:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed3771ed.
00000100:00000040:17.0:1773851877.186509:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ed3771ed x1859383377605312 msgsize 224
00000100:00100000:17.0:1773851877.186511:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-11811@kfi7 (source: 12345-12003@kfi7)
00000100:00000001:17.0:1773851877.186513:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851877.186514:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000072528b79 nid 12003@kfi7 refs 2
00000800:00000200:17.0:1773851877.186517:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851877.186521:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851877.186522:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851877.186522:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851877.186523:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851877.186524:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851877.186525:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859383377605312
00000020:00000001:17.0:1773851877.186526:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851877.186527:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0796851bbfc
00000020:00000001:17.0:1773851877.186528:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851877.186531:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a769672 refcount=5
00000020:00000001:17.0:1773851877.186532:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966850950144 : -107106858601472 : ffff9e963dbd7400)
00000020:00000001:17.0:1773851877.186533:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636966850950144 : -107106858601472 : ffff9e963dbd7400)
00000100:00000001:17.0:1773851877.186535:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.186536:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851877.186537:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c935461.
00000020:00000010:17.0:1773851877.186538:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.186539:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851877.186540:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851877.186541:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851877.186542:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.186543:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851877.186544:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851877.186544:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.186546:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.186548:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851877.186548:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851877.186548:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851877.186549:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851877.186550:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11811@kfi7, seq: 2156365
00000100:00000040:17.0:1773851877.186551:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a769672 : new rpc_count 1
00000100:00000001:16.0:1773851877.186551:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.186552:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144552192640 : -106929157358976 : ffff9ebf9d8f3a80)
00000100:00000001:16.0:1773851877.186552:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.186554:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed3771ed x1859383377605312/t0(0) o400->ef1539fe-3c2b-4507-96ab-63063906912c@11811@kfi7:98/0 lens 224/0 e 0 to 0 dl 1773852213 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1227-0'
00000100:00000001:17.0:1773851877.186558:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.186558:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851877.186560:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed3771ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ef1539fe-3c2b-4507-96ab-63063906912c+5:39644:x1859383377605312:12345-11811@kfi7:400:default-tuolumne1227-0
00000100:00000200:17.0:1773851877.186562:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859383377605312
00000020:00000001:17.0:1773851877.186563:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851877.186563:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851877.186564:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.186565:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851877.186566:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851877.186567:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851877.186569:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859383377605312, found 0 last_xid 1859383377605311
00000020:00000001:17.0:1773851877.186570:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851877.186571:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851877.186572:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851877.186573:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.186573:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851877.186574:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851877.186575:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851877.186577:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000026f5043d.
02000000:00000001:17.0:1773851877.186578:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.186579:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.186580:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851877.186581:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256977050, transno 0, xid 1859383377605312
00010000:00000001:17.0:1773851877.186582:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851877.186584:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed3771ed x1859383377605312/t0(0) o400->ef1539fe-3c2b-4507-96ab-63063906912c@11811@kfi7:98/0 lens 224/224 e 0 to 0 dl 1773852213 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1227-0'
00010000:00000001:17.0:1773851877.186587:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851877.186588:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851877.186589:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=110 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851877.186591:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851877.186592:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004548cc8c refcount 3 to 11811@kfi7
00000100:00000001:17.0:1773851877.186593:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412288 : -107145304139328 : ffff9e8d4a3519c0)
02000000:00000001:17.0:1773851877.186594:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851877.186595:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.186596:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851877.186597:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12003@kfi7
00000400:00000010:17.0:1773851877.186598:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000079b3bb7.
00000100:00000200:17.0:1773851877.186599:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859383377605312, offset 224
00000400:00000200:17.0:1773851877.186601:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12003@kfi7
00000400:00000200:17.0:1773851877.186602:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12003@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.186603:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000072528b79 nid 12003@kfi7 refs 1
00000400:00000200:17.0:1773851877.186605:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000072528b79 nid 12003@kfi7 refs 2
00000400:00000200:17.0:1773851877.186606:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000072528b79 nid 12003@kfi7 refs 3
00000400:00000200:17.0:1773851877.186608:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12003@kfi7 local destination
00000400:00000200:17.0:1773851877.186610:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769558:8769558:1024:4294967295] 12003@kfi7 LPNI seq info [22724191:22724191:16:4294967295]
00000400:00000200:17.0:1773851877.186612:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000072528b79 nid 12003@kfi7 refs 2
00000400:00000200:17.0:1773851877.186614:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12003@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.186617:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12003@kfi7(12003@kfi7:12003@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851877.186619:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000072528b79 nid 12003@kfi7 refs 3
00000800:00000200:17.0:1773851877.186620:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.186622:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851877.186625:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851877.186629:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xed7 Using peer 12003@kfi7(0xed7)
00000800:00000200:17.0:1773851877.186633:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0xed7: rc=0
00000800:00000200:17.0:1773851877.186635:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xed7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851877.186638:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.186639:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004548cc8c refcount 2 to 11811@kfi7
00010000:00000001:17.0:1773851877.186640:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851877.186641:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.186642:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851877.186643:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed3771ed x1859383377605312/t0(0) o400->ef1539fe-3c2b-4507-96ab-63063906912c@11811@kfi7:98/0 lens 224/224 e 0 to 0 dl 1773852213 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1227-0'
00000100:00100000:17.0:1773851877.186647:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed3771ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ef1539fe-3c2b-4507-96ab-63063906912c+5:39644:x1859383377605312:12345-11811@kfi7:400:default-tuolumne1227-0 Request processed in 89us (138us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851877.186651:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xed7 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851877.186651:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11811@kfi7, seq: 2156365
00000100:00000040:17.0:1773851877.186652:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a769672 : new rpc_count 0
00000400:00000200:19.0:1773851877.186653:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851877.186653:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851877.186654:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:19.0:1773851877.186655:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12003@kfi7: PUT: OK
00000020:00000010:17.0:1773851877.186655:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:19.0:1773851877.186656:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000079b3bb7
00000020:00000010:17.0:1773851877.186656:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000010:19.0:1773851877.186657:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000079b3bb7.
00000100:00000001:19.0:1773851877.186658:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851877.186658:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851877.186660:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000072528b79 nid 12003@kfi7 refs 2
00000020:00000010:17.0:1773851877.186660:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c935461.
00000020:00000040:17.0:1773851877.186661:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000009a769672 : new refcount 4
00000800:00000200:19.0:1773851877.186662:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 12003@kfi7(000000002bf58327):0x0 lsk 3800 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0xed7 Transaction freed
00000100:00000001:17.0:1773851877.186662:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851877.193730:0:41182:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000001:28.0:1773851877.193732:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851877.193733:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:8.0:1773851877.193733:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:28.0:1773851877.193734:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f28780a2.
00000004:00000020:8.0:1773851877.193734:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851877.193735:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851877.193735:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:28.0:1773851877.193735:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000100:00000040:27.0:1773851877.193735:0:41182:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +296s
00000100:00000010:8.0:1773851877.193735:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f494273.
00000020:00000040:8.0:1773851877.193735:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000100:00000010:29.0:1773851877.193736:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e06e3e2f.
00000100:00000001:28.0:1773851877.193736:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851877.193736:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00001000:27.0:1773851877.193736:0:41182:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 0 early replies
00000020:00000040:29.0:1773851877.193737:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
02000000:00000001:28.0:1773851877.193737:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.193737:0:41182:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.193737:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851877.193737:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:29.0:1773851877.193738:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851877.193738:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:8.0:1773851877.193738:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851877.193739:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851877.193739:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000067ad0b6.
02000000:00000010:8.0:1773851877.193739:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:28.0:1773851877.193740:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851877.193741:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:29.0:1773851877.193741:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.193741:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:8.0:1773851877.193741:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.193742:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.193742:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851877.193743:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851877.193743:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.193743:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f28780a2] to pc [ptlrpcd_07_00+0]  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851877.193743:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851877.193744:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001f494273] to pc [ptlrpcd_02_01+1]  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851877.193745:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e06e3e2f] to pc [ptlrpcd_07_01+1]  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851877.193748:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851877.193748:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851877.193749:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851877.193749:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851877.193749:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851877.193749:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:29.0:1773851877.193749:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008b002eeb.
00080000:00000010:28.0:1773851877.193749:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000066c4f8e2.
00000100:00000001:10.0:1773851877.193749:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:8.0:1773851877.193749:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851877.193750:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:31.0:1773851877.193750:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851877.193750:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851877.193750:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637071835653120 : -107001873898496 : ffff9eaeaf50e400)
00080000:00000001:28.0:1773851877.193750:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637152563337216 : -106921146214400 : ffff9ec17b0f9800)
00000100:00000001:10.0:1773851877.193750:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:8.0:1773851877.193750:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000cbcf7301.
00000100:00000040:30.0:1773851877.193751:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851877.193751:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851877.193751:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:11.0:1773851877.193751:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851877.193751:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851877.193751:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637113208219648 : -106960501331968 : ffff9eb851502800)
00080000:00000001:29.0:1773851877.193752:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851877.193752:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00000100:00000001:11.0:1773851877.193752:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851877.193752:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851877.193752:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851877.193753:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:29.0:1773851877.193753:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008a8fd4eb.
00080000:00000001:28.0:1773851877.193753:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851877.193753:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193754:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.193754:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:29.0:1773851877.193754:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614151647029568ns, next at 614152647028516ns, rc = 0
00000004:00001000:28.0:1773851877.193754:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000004:00001000:8.0:1773851877.193754:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
02000000:00000001:31.0:1773851877.193755:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851877.193755:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.193755:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851877.193755:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:29.0:1773851877.193755:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:10.0:1773851877.193755:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851877.193755:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851877.193755:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002c3202e3.
00000100:00100000:31.0:1773851877.193756:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f28780a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051932032:9@kfi7:13:default-yuba2-0
02000000:00000001:30.0:1773851877.193756:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851877.193756:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e06e3e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051932160:47@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851877.193756:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851877.193756:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:28.0:1773851877.193756:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009190cb73.
00000100:00000001:11.0:1773851877.193756:0:60519:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
02000000:00000001:10.0:1773851877.193756:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:8.0:1773851877.193756:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614151647032022ns, next at 614152647030419ns, rc = 0
00000004:00080000:28.0:1773851877.193757:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614151647031892ns, next at 614152647030810ns, rc = 0
02000000:00000001:10.0:1773851877.193757:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193758:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851877.193758:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:30.0:1773851877.193758:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851877.193758:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:28.0:1773851877.193758:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851877.193758:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851877.193758:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f494273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051932096:2084@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851877.193758:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851877.193759:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851877.193759:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851877.193759:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851877.193759:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:8.0:1773851877.193759:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851877.193759:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851877.193760:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:30.0:1773851877.193760:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:10.0:1773851877.193760:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:31.0:1773851877.193761:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000026644dfa.
02000000:00000010:30.0:1773851877.193761:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004219deee.
02000000:00000001:10.0:1773851877.193761:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851877.193761:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:31.0:1773851877.193762:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851877.193762:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851877.193762:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a5c4dee8.
00000400:00000200:31.0:1773851877.193763:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:30.0:1773851877.193763:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000010:30.0:1773851877.193763:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000040:11.0:1773851877.193763:0:60519:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +270s
02000000:00000001:10.0:1773851877.193763:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851877.193764:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000400:00000010:30.0:1773851877.193764:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00001000:11.0:1773851877.193764:0:60519:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000400:00000200:10.0:1773851877.193764:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000010:31.0:1773851877.193765:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000001:11.0:1773851877.193765:0:60519:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000400:00000010:10.0:1773851877.193765:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000100:00000200:31.0:1773851877.193766:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932032, portal 4
00000100:00000200:30.0:1773851877.193766:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932160, portal 4
00000100:00001000:11.0:1773851877.193766:0:60519:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -109s) for 114+30  req@000000000e26b193 x1859597924930816/t0(0) o49->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:522/0 lens 480/0 e 1 to 0 dl 1773851882 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111525036260352'
00000400:00000010:10.0:1773851877.193766:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000001:31.0:1773851877.193767:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851877.193767:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324245120 : -106976385306496 : ffff9eb49e8df080)
00000100:00000001:30.0:1773851877.193767:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851877.193767:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079339664512 : -106994369887104 : ffff9eb06e970480)
00000100:00000200:10.0:1773851877.193767:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932096, portal 4
00000100:00000040:31.0:1773851877.193768:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851877.193768:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851877.193768:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851877.193768:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491254016 : -107117218297600 : ffff9e93d4410900)
00000100:00001000:11.0:1773851877.193769:0:60519:0:(import.c:1951:at_measured()) add 139 to 00000000119ab4c7 time=131 v=114 (114 0 0 0)
00000100:00001000:11.0:1773851877.193770:0:60519:0:(import.c:2016:at_measured()) AT 00000000119ab4c7 change: old=114 new=139 delta=25 (val=139) hist 139 0 0 0
00000100:00000040:10.0:1773851877.193770:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851877.193771:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:30.0:1773851877.193771:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851877.193772:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:31.0:1773851877.193772:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000051546e8a.
00000100:00000040:30.0:1773851877.193772:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000400:00000010:30.0:1773851877.193772:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3d2c920.
00000100:00000010:11.0:1773851877.193772:0:60519:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007391cc99.
00000100:00000200:31.0:1773851877.193773:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932032, offset 0
00000100:00000200:30.0:1773851877.193773:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932160, offset 0
00000100:00000010:11.0:1773851877.193773:0:60519:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 480 at 000000008e6ffc9a.
00000100:00000001:10.0:1773851877.193773:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851877.193774:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000020:00000001:11.0:1773851877.193774:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851877.193774:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74122
00000100:00000040:10.0:1773851877.193774:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000010:10.0:1773851877.193774:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d6f27aa.
00000400:00000200:31.0:1773851877.193775:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000400:00000200:30.0:1773851877.193775:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000020:00000001:11.0:1773851877.193775:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000200:10.0:1773851877.193775:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932096, offset 0
00000400:00000200:30.0:1773851877.193776:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:30.0:1773851877.193777:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:10.0:1773851877.193777:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:30.0:1773851877.193778:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000020:00000040:11.0:1773851877.193778:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d60686f refcount=469
00000020:00000001:11.0:1773851877.193778:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000400:00000200:10.0:1773851877.193778:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:30.0:1773851877.193779:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000020:00000001:11.0:1773851877.193779:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000400:00000200:10.0:1773851877.193779:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000100:00000040:11.0:1773851877.193780:0:60519:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 000000009d60686f : new rpc_count 11
00000400:00000200:10.0:1773851877.193780:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:30.0:1773851877.193781:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769558, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769557, p:4294967295, g:4294967295, h:1000]
00000100:00000001:11.0:1773851877.193781:0:60519:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851877.193781:0:60519:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:10.0:1773851877.193781:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
02000000:00000010:11.0:1773851877.193782:0:60519:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000071055adf.
00000400:00000200:30.0:1773851877.193783:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
02000000:00000001:11.0:1773851877.193783:0:60519:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851877.193783:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000200:30.0:1773851877.193784:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851877.193784:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000100:00000001:11.0:1773851877.193784:0:60519:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851877.193785:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769559:8769559:1024:4294967295] 47@kfi7 LPNI seq info [5403021:5403021:16:4294967295]
00010000:00000001:11.0:1773851877.193785:0:60519:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000400:00000200:10.0:1773851877.193785:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769558, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769557, p:4294967295, g:4294967295, h:1000]
00010000:00000001:11.0:1773851877.193786:0:60519:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851877.193786:0:60519:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000400:00000200:30.0:1773851877.193787:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000040:11.0:1773851877.193787:0:60519:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc978f5f refcount 3 to 25667@kfi7
00000400:00000200:10.0:1773851877.193787:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851877.193788:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:11.0:1773851877.193788:0:60519:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106880 : -107156354444736 : ffff9e8ab78ed240)
00000400:00000200:10.0:1773851877.193788:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851877.193789:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
02000000:00000001:11.0:1773851877.193789:0:60519:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000400:00000200:10.0:1773851877.193789:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:31.0:1773851877.193790:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000200:30.0:1773851877.193790:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851877.193790:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769560:8769560:1024:4294967295] 2084@kfi7 LPNI seq info [5402746:5402746:16:4294967295]
00000400:00000200:31.0:1773851877.193791:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
02000000:00000001:11.0:1773851877.193791:0:60519:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851877.193791:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851877.193792:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:30.0:1773851877.193792:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000001:11.0:1773851877.193792:0:60519:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851877.193792:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851877.193793:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000800:00000200:30.0:1773851877.193793:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000040:11.0:1773851877.193793:0:60519:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25666@kfi7
00000400:00000010:11.0:1773851877.193793:0:60519:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a75bb48d.
00000100:00000200:11.0:1773851877.193794:0:60519:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597924930816, offset 0
00000400:00000200:31.0:1773851877.193795:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769560, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769559, p:4294967295, g:4294967295, h:1000]
00000800:00000200:30.0:1773851877.193795:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851877.193796:0:60519:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25666@kfi7
00000400:00000200:11.0:1773851877.193796:0:60519:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:10.0:1773851877.193796:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851877.193797:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:30.0:1773851877.193797:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851877.193797:0:60519:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 1
00000400:00000200:10.0:1773851877.193797:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:31.0:1773851877.193798:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851877.193798:0:60519:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:31.0:1773851877.193799:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000800:00000200:10.0:1773851877.193799:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:31.0:1773851877.193800:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769561:8769561:1023:4294967295] 9@kfi7 LPNI seq info [5403010:5403010:16:4294967295]
00000800:00000200:30.0:1773851877.193800:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000400:00000200:11.0:1773851877.193800:0:60519:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000800:00000200:10.0:1773851877.193801:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851877.193802:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:30.0:1773851877.193802:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000c05b04ad: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000400:00000200:11.0:1773851877.193802:0:60519:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25666@kfi7 local destination
00000400:00000200:31.0:1773851877.193803:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:11.0:1773851877.193803:0:60519:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769562:8769562:1023:4294967295] 25666@kfi7 LPNI seq info [611806:611806:16:4294967295]
00000800:00000200:10.0:1773851877.193803:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851877.193804:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851877.193805:0:60519:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:31.0:1773851877.193806:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000100:00000001:30.0:1773851877.193806:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.193806:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:11.0:1773851877.193806:0:60519:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000800:00000200:10.0:1773851877.193806:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Using peer 2084@kfi7(0x103)
00000400:00000200:31.0:1773851877.193807:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:30.0:1773851877.193807:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.193808:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851877.193809:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:30.0:1773851877.193809:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:11.0:1773851877.193809:0:60519:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25666@kfi7(25666@kfi7:25666@kfi7) <?> : PUT try# 0
00000800:00000200:31.0:1773851877.193810:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:30.0:1773851877.193810:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851877.193810:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:11.0:1773851877.193810:0:60519:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000800:00000200:10.0:1773851877.193810:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000003858ee31: Posted send of 324 bytes to peer 0x103: rc=0
00000100:00000001:30.0:1773851877.193811:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851877.193811:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:10.0:1773851877.193811:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:31.0:1773851877.193812:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:30.0:1773851877.193812:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.193812:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851877.193812:0:60519:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:10.0:1773851877.193813:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851877.193814:0:60519:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:10.0:1773851877.193814:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:31.0:1773851877.193815:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 Using peer 9@kfi7(0x200000000000324)
00000800:00000200:29.0:1773851877.193815:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851877.193815:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851877.193816:0:60519:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:10.0:1773851877.193816:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851877.193817:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851877.193817:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851877.193818:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x200000000000324: rc=0
00000400:00000200:29.0:1773851877.193818:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000100:00000001:10.0:1773851877.193818:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851877.193818:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:31.0:1773851877.193819:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851877.193819:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3d2c920
00000400:00000010:29.0:1773851877.193819:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3d2c920.
00000800:00000200:11.0:1773851877.193819:0:60519:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb Using peer 25666@kfi7(0x100000000000dcb)
00000100:00000001:10.0:1773851877.193819:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851877.193820:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:10.0:1773851877.193820:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851877.193820:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193821:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:29.0:1773851877.193821:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851877.193821:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193822:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:11.0:1773851877.193822:0:60519:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x100000000000dcb: rc=0
00000800:00000200:9.0:1773851877.193822:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851877.193823:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193823:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.193823:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:11.0:1773851877.193823:0:60519:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851877.193823:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851877.193824:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:29.0:1773851877.193824:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851877.193825:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851877.193825:0:60519:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851877.193825:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000400:00000200:9.0:1773851877.193825:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d6f27aa
00000100:00000001:31.0:1773851877.193826:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851877.193826:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:11.0:1773851877.193826:0:60519:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc978f5f refcount 2 to 25667@kfi7
00000400:00000010:9.0:1773851877.193826:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d6f27aa.
00000100:00000001:9.0:1773851877.193826:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:31.0:1773851877.193827:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851877.193827:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.193827:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.193827:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:11.0:1773851877.193827:0:60519:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 000000009d60686f : new rpc_count 10
00000100:00000200:9.0:1773851877.193827:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851877.193828:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851877.193828:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000020:00000040:11.0:1773851877.193828:0:60519:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 468
00000100:00000010:11.0:1773851877.193829:0:60519:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 480 at 000000008e6ffc9a.
00000100:00000010:11.0:1773851877.193829:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007391cc99.
00000800:00000200:31.0:1773851877.193830:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851877.193830:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000100:00000001:11.0:1773851877.193830:0:60519:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851877.193830:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851877.193831:0:60519:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +25s
00000100:00000040:9.0:1773851877.193831:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851877.193832:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851877.193832:0:60519:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851877.193833:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9@kfi7: PUT: OK
00000100:00000001:9.0:1773851877.193833:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851877.193834:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000051546e8a
00000100:00000001:9.0:1773851877.193834:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:31.0:1773851877.193835:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000051546e8a.
00000800:00000200:11.0:1773851877.193835:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851877.193835:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:31.0:1773851877.193836:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:9.0:1773851877.193836:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Transaction freed
00000100:00000200:31.0:1773851877.193837:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851877.193837:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851877.193838:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25666@kfi7: PUT: OK
00000400:00000200:11.0:1773851877.193839:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a75bb48d
00000400:00000010:11.0:1773851877.193839:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a75bb48d.
00000100:00000001:31.0:1773851877.193840:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851877.193840:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000040:31.0:1773851877.193841:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:11.0:1773851877.193841:0:2510946:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:11.0:1773851877.193841:0:2510946:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000071055adf.
02000000:00000001:11.0:1773851877.193842:0:2510946:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:11.0:1773851877.193842:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851877.193843:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193844:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851877.193844:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:31.0:1773851877.193845:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:11.0:1773851877.193845:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb Transaction freed
00000800:00000200:31.0:1773851877.193846:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 Transaction freed
00000800:00000200:21.0:1773851877.193851:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851877.193852:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851877.193854:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851877.193856:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851877.193858:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:21.0:1773851877.193858:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:25.0:1773851877.193859:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851877.193860:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851877.193860:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000400:00000200:21.0:1773851877.193861:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.193862:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000800:00000200:25.0:1773851877.193863:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851877.193863:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851877.193864:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851877.193864:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:21.0:1773851877.193865:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:25.0:1773851877.193866:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2084@kfi7 : PUT - for me
00000400:00000200:21.0:1773851877.193866:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:25.0:1773851877.193867:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851877.193867:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4600
00000400:00000200:25.0:1773851877.193868:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:21.0:1773851877.193868:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.193869:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d1295 [1] + 224
00000400:00000200:25.0:1773851877.193870:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.193870:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:25.0:1773851877.193871:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:21.0:1773851877.193871:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851877.193873:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:21.0:1773851877.193873:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851877.193874:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b45c0
00000400:00000200:21.0:1773851877.193874:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000400:00000200:25.0:1773851877.193875:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:21.0:1773851877.193875:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851877.193876:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b82879 [1] + 224
00000100:00000200:21.0:1773851877.193876:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851877.193878:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851877.193879:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:21.0:1773851877.193879:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851877.193880:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000001:25.0:1773851877.193882:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851877.193883:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851877.193883:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851877.193884:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:30.0:1773851877.193885:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851877.193885:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851877.193885:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851877.193886:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:25.0:1773851877.193886:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:30.0:1773851877.193887:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:30.0:1773851877.193888:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851877.193889:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:30.0:1773851877.193889:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:25.0:1773851877.193889:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:5.0:1773851877.193889:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851877.193889:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851877.193890:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851877.193890:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000200:30.0:1773851877.193891:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851877.193891:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851877.193892:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851877.193892:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851877.193893:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851877.193893:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:30.0:1773851877.193894:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:10.0:1773851877.193894:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851877.193894:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851877.193895:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:5.0:1773851877.193895:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:30.0:1773851877.193896:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851877.193896:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851877.193896:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851877.193896:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000400:00000200:5.0:1773851877.193896:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9@kfi7 : PUT - for me
00000100:00000001:30.0:1773851877.193897:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:10.0:1773851877.193897:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851877.193897:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
02000000:00000001:30.0:1773851877.193898:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851877.193898:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:10.0:1773851877.193898:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851877.193898:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000001:30.0:1773851877.193899:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851877.193899:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851877.193899:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.193899:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00001000:30.0:1773851877.193900:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=110 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851877.193900:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00001000:30.0:1773851877.193901:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=110 v=66 (1 1 1 1)
00000100:00000200:10.0:1773851877.193901:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851877.193901:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:30.0:1773851877.193902:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:5.0:1773851877.193902:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4580
00000100:00000001:30.0:1773851877.193903:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851877.193903:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:5.0:1773851877.193903:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00010000:00000001:30.0:1773851877.193904:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851877.193904:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851877.193904:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851877.193904:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b31485 [1] + 224
00000100:00000001:30.0:1773851877.193905:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851877.193905:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00000001:10.0:1773851877.193905:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851877.193905:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851877.193906:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851877.193906:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851877.193906:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:30.0:1773851877.193907:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851877.193907:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851877.193907:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851877.193907:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:10.0:1773851877.193908:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=110 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851877.193908:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851877.193909:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:10.0:1773851877.193909:0:41069:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=110 v=66 (1 1 1 1)
00000400:00000200:5.0:1773851877.193909:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9@kfi7: PUT: OK
00000100:00000001:30.0:1773851877.193910:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851877.193910:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851877.193910:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851877.193911:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851877.193911:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:10.0:1773851877.193911:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851877.193911:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:30.0:1773851877.193912:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00010000:00000001:10.0:1773851877.193912:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851877.193912:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:30.0:1773851877.193913:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603943424 avail=351601693696 avail_mb=1373444116 hwm_mb=3131103 files=372190429 ffree=343363226 state=0: rc = 0
00000100:00000001:10.0:1773851877.193913:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000020:30.0:1773851877.193914:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603943424 free, 351601693696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190429 files, 343363226 free files
00000100:00000040:10.0:1773851877.193914:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000100:00000001:10.0:1773851877.193914:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:5.0:1773851877.193914:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851877.193915:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851877.193916:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851877.193916:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851877.193917:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851877.193918:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851877.193918:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851877.193919:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:5.0:1773851877.193919:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:31.0:1773851877.193920:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851877.193920:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:30.0:1773851877.193920:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e06e3e2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051932160:47@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851877.193920:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851877.193920:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000800:00000200:5.0:1773851877.193920:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851877.193921:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:30.0:1773851877.193921:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:10.0:1773851877.193921:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000400:00000001:31.0:1773851877.193922:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:30.0:1773851877.193922:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:10.0:1773851877.193922:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593624576 avail=351576785920 avail_mb=1373346820 hwm_mb=3131103 files=372189932 ffree=343353149 state=0: rc = 0
00000400:00000010:31.0:1773851877.193923:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:31.0:1773851877.193923:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000100:00000040:30.0:1773851877.193923:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e06e3e2f x1859433051932160/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:31.0:1773851877.193924:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000004:00000020:10.0:1773851877.193924:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593624576 free, 351576785920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372189932 files, 343353149 free files
00000100:00000001:31.0:1773851877.193925:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851877.193925:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000001:10.0:1773851877.193925:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851877.193926:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851877.193926:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851877.193926:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004219deee.
02000000:00000001:30.0:1773851877.193927:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851877.193927:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:10.0:1773851877.193927:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:30.0:1773851877.193928:0:41089:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000020:00000001:30.0:1773851877.193928:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000200:31.0:1773851877.193929:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:30.0:1773851877.193929:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
02000000:00000001:30.0:1773851877.193930:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851877.193930:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00100000:10.0:1773851877.193930:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f494273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051932096:2084@kfi7:13:default-yuba2-0
00000100:00000010:30.0:1773851877.193931:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e06e3e2f.
00000100:00000001:10.0:1773851877.193931:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851877.193932:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851877.193932:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851877.193932:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851877.193932:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851877.193932:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851877.193932:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851877.193933:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851877.193933:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851877.193933:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851877.193933:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851877.193933:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001f494273 x1859433051932096/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851877.193934:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851877.193934:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.193934:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851877.193934:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851877.193935:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851877.193935:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00001000:31.0:1773851877.193936:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=110 v=66 (66 66 66 66)
02000000:00000001:10.0:1773851877.193936:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00001000:31.0:1773851877.193937:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=31 v=66 (1 1 1 1)
02000000:00000010:10.0:1773851877.193937:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a5c4dee8.
00000100:00000001:31.0:1773851877.193938:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851877.193938:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851877.193938:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851877.193938:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00010000:00000001:31.0:1773851877.193939:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000020:00000040:10.0:1773851877.193939:0:41069:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00010000:00000001:31.0:1773851877.193940:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851877.193940:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:31.0:1773851877.193941:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851877.193941:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
02000000:00000010:10.0:1773851877.193941:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:31.0:1773851877.193942:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851877.193942:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851877.193942:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851877.193942:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:31.0:1773851877.193943:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:10.0:1773851877.193943:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f494273.
00000100:00000001:10.0:1773851877.193944:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851877.193944:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851877.193945:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851877.193945:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851877.193946:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851877.193946:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193947:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851877.193947:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851877.193947:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851877.193947:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851877.193948:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851877.193949:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851877.193949:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480018944 avail=351478660096 avail_mb=1372963516 hwm_mb=3131101 files=372073116 ffree=343242206 state=0: rc = 0
00000004:00000020:31.0:1773851877.193951:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480018944 free, 351478660096 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073116 files, 343242206 free files
00000004:00000001:31.0:1773851877.193953:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851877.193954:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851877.193956:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f28780a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051932032:9@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851877.193958:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851877.193959:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851877.193960:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f28780a2 x1859433051932032/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851877.193962:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851877.193963:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851877.193963:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000026644dfa.
02000000:00000001:31.0:1773851877.193964:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851877.193965:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851877.193965:0:41088:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000020:00000001:31.0:1773851877.193966:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851877.193966:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000067ad0b6.
02000000:00000001:31.0:1773851877.193968:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851877.193968:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851877.193969:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f28780a2.
00000100:00000001:31.0:1773851877.193970:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851877.193970:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851877.193971:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851877.193971:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851877.193972:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851877.193973:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851877.193973:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851877.194729:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851877.194729:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851877.194730:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005a62979a.
00000020:00000040:30.0:1773851877.194731:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000100:00000001:30.0:1773851877.194731:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851877.194732:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851877.194732:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851877.194733:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006a3b4e25.
00000100:00000001:30.0:1773851877.194734:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.194735:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851877.194736:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851877.194737:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005a62979a] to pc [ptlrpcd_07_02+2]  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851877.194741:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:29.0:1773851877.194741:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851877.194742:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851877.194742:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:30.0:1773851877.194742:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004219deee.
00080000:00000001:30.0:1773851877.194742:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637052263046144 : -107021446505472 : ffff9eaa20b29c00)
00000100:00000001:29.0:1773851877.194742:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851877.194742:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851877.194743:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:29.0:1773851877.194743:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851877.194744:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851877.194745:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000004:00000010:30.0:1773851877.194746:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c87f334f.
00000004:00080000:30.0:1773851877.194746:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614151648021941ns, next at 614152648021049ns, rc = 0
00000100:00000001:29.0:1773851877.194746:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851877.194746:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851877.194747:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:29.0:1773851877.194747:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851877.194748:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851877.194748:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851877.194749:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851877.194749:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005a62979a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051932224:2104@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851877.194750:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:29.0:1773851877.194750:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851877.194751:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851877.194752:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:29.0:1773851877.194753:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000007e804b7.
02000000:00000001:29.0:1773851877.194753:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851877.194755:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000010:29.0:1773851877.194755:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f9cf276e.
00000400:00000010:29.0:1773851877.194756:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f75d3df.
00000100:00000200:29.0:1773851877.194757:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932224, portal 4
00000100:00000001:29.0:1773851877.194758:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851877.194759:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411260672 : -106960298290944 : ffff9eb85d6a5100)
00000100:00000040:29.0:1773851877.194760:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851877.194762:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851877.194763:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:29.0:1773851877.194763:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c2a5509b.
00000100:00000200:29.0:1773851877.194764:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932224, offset 0
00000400:00000200:29.0:1773851877.194766:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:29.0:1773851877.194766:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:29.0:1773851877.194767:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:29.0:1773851877.194768:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:29.0:1773851877.194770:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:29.0:1773851877.194773:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000400:00000200:29.0:1773851877.194774:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769560, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769562, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851877.194776:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851877.194777:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851877.194778:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000400:00000200:29.0:1773851877.194779:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769563:8769563:1024:4294967295] 2104@kfi7 LPNI seq info [5403378:5403378:16:4294967295]
00000400:00000200:29.0:1773851877.194780:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:29.0:1773851877.194781:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:29.0:1773851877.194783:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851877.194785:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000800:00000200:29.0:1773851877.194786:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851877.194787:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851877.194790:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851877.194792:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Using peer 2104@kfi7(0x19d)
00000800:00000200:29.0:1773851877.194795:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x19d: rc=0
00000800:00000200:29.0:1773851877.194796:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851877.194798:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.194799:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851877.194800:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.194800:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.194801:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851877.194802:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851877.194802:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851877.194803:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851877.194803:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851877.194803:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.194804:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851877.194806:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851877.194808:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851877.194810:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000400:00000200:29.0:1773851877.194810:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c2a5509b
00000400:00000010:29.0:1773851877.194811:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c2a5509b.
00000100:00000001:29.0:1773851877.194811:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851877.194812:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851877.194814:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851877.194815:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851877.194817:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.194818:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851877.194819:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:29.0:1773851877.194820:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Transaction freed
00000800:00000200:13.0:1773851877.194844:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851877.194845:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851877.194846:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851877.194849:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851877.194851:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.194852:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2104@kfi7 : PUT - for me
00000400:00000200:13.0:1773851877.194853:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.194854:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:13.0:1773851877.194855:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.194855:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:13.0:1773851877.194856:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:13.0:1773851877.194857:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.194858:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4640
00000400:00000200:13.0:1773851877.194859:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.194861:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f66cd [1] + 224
00000800:00000200:13.0:1773851877.194863:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851877.194865:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851877.194866:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000100:00000001:13.0:1773851877.194868:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:13.0:1773851877.194869:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:13.0:1773851877.194872:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851877.194876:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851877.194877:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:29.0:1773851877.194878:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851877.194878:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:29.0:1773851877.194879:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:13.0:1773851877.194879:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000001:29.0:1773851877.194880:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:29.0:1773851877.194881:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f9cf276e.
00000400:00000200:29.0:1773851877.194881:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f75d3df
00000400:00000010:29.0:1773851877.194882:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f75d3df.
00000100:00000001:29.0:1773851877.194883:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851877.194884:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851877.194886:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851877.194889:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851877.194889:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851877.194890:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851877.194890:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851877.194890:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851877.194891:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851877.194891:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851877.194893:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=110 v=66 (66 66 66 66)
00000100:00001000:29.0:1773851877.194894:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=110 v=66 (1 1 1 1)
00000100:00000001:29.0:1773851877.194895:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851877.194895:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851877.194896:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:29.0:1773851877.194896:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.194897:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851877.194897:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000001:29.0:1773851877.194898:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851877.194898:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851877.194899:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851877.194902:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851877.194902:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851877.194903:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851877.194903:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851877.194904:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000004:00000040:29.0:1773851877.194905:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615877120 avail=351613277184 avail_mb=1373489364 hwm_mb=3131103 files=372043433 ffree=343374880 state=0: rc = 0
00000004:00000020:29.0:1773851877.194907:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615877120 free, 351613277184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043433 files, 343374880 free files
00000004:00000001:29.0:1773851877.194908:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851877.194909:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:29.0:1773851877.194912:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005a62979a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051932224:2104@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851877.194913:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851877.194914:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851877.194915:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005a62979a x1859433051932224/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851877.194917:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851877.194918:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851877.194918:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000007e804b7.
02000000:00000001:29.0:1773851877.194920:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851877.194920:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851877.194920:0:41090:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000020:00000001:29.0:1773851877.194921:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851877.194922:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006a3b4e25.
02000000:00000001:29.0:1773851877.194922:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851877.194923:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851877.194923:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005a62979a.
00000100:00000001:29.0:1773851877.194924:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851877.194924:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851877.194925:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851877.194926:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851877.194926:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851877.194927:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851877.194927:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:23.0:1773851877.227975:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851877.227975:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851877.227975:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851877.227976:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:23.0:1773851877.227977:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851877.227978:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:23.0:1773851877.227979:0:2495434:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8786@kfi7(0000000075702bba):0x2a1 version: 2; local version 2; negotiated version: 2
00000800:00000200:23.0:1773851877.227981:0:2495434:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 Using peer 8786@kfi7(0x2a1)
00000800:00000200:21.0:1773851877.227981:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:23.0:1773851877.227983:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8786@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.227984:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8786@kfi7 to cpt 5
00000800:00000200:23.0:1773851877.227985:0:2495434:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 38 bytes to peer 0x2a1: rc=0
00000800:00000200:23.0:1773851877.227986:0:2495434:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:21.0:1773851877.227986:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8786@kfi7 : PUT - for me
00000400:00000200:21.0:1773851877.227988:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8786@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.227989:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d28b0684 nid 8786@kfi7 refs 1
00000400:00000200:21.0:1773851877.227991:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8786@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.227992:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d28b0684 nid 8786@kfi7 refs 2
00000400:00000200:21.0:1773851877.227994:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d28b0684 nid 8786@kfi7 refs 3
00000400:00000200:21.0:1773851877.227995:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8786@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.227997:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8786@kfi7 of length 224 into portal 12 MB=0x69b4bfa3bb940
00000400:00000200:21.0:1773851877.227999:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8786@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 47216
00000800:00000200:21.0:1773851877.228002:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851877.228005:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851877.228005:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851877.228007:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8786@kfi7: PUT: OK
00000100:00000001:21.0:1773851877.228008:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851877.228009:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851877.228010:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005c9f193b.
00000800:00000200:22.0:1773851877.228011:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003a94a903: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 Transaction freed
00000100:00000040:21.0:1773851877.228011:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005c9f193b x1859600483334464 msgsize 224
00000100:00100000:21.0:1773851877.228014:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-8786@kfi7 (source: 12345-8786@kfi7)
00000100:00000001:21.0:1773851877.228015:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851877.228017:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d28b0684 nid 8786@kfi7 refs 2
00000100:00000001:20.0:1773851877.228018:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851877.228019:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851877.228019:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851877.228020:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851877.228021:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851877.228023:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851877.228024:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600483334464
00000020:00000001:20.0:1773851877.228025:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851877.228026:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d8b26f
00000020:00000001:20.0:1773851877.228027:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851877.228032:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001eafc0e9 refcount=7
00000020:00000001:20.0:1773851877.228034:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637027496232960 : -107046213318656 : ffff9ea45c7b0800)
00000020:00000001:20.0:1773851877.228035:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637027496232960 : -107046213318656 : ffff9ea45c7b0800)
00000100:00000001:20.0:1773851877.228037:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851877.228038:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851877.228039:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000213eb2e8.
00000020:00000010:20.0:1773851877.228041:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851877.228042:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e4392d26.
00000100:00000001:20.0:1773851877.228044:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851877.228045:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851877.228045:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851877.228047:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851877.228048:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851877.228049:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851877.228050:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851877.228052:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851877.228053:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851877.228053:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851877.228054:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8786@kfi7, seq: 1998009
00000100:00000040:23.0:1773851877.228054:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001eafc0e9 : new rpc_count 1
00000100:00000001:20.0:1773851877.228054:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851877.228055:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794372480 : -106943915179136 : ffff9ebc2decc380)
00000100:00000001:20.0:1773851877.228055:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851877.228056:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851877.228057:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005c9f193b x1859600483334464/t0(0) o400->962e994a-314b-484c-b42f-6e299d24829d@8786@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1046-0'
00000100:00000001:23.0:1773851877.228059:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851877.228060:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851877.228061:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c9f193b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:962e994a-314b-484c-b42f-6e299d24829d+7:39483:x1859600483334464:12345-8786@kfi7:400:default-tuolumne1046-0
00000100:00000200:23.0:1773851877.228062:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600483334464
00000020:00000001:23.0:1773851877.228063:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851877.228063:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851877.228064:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.228065:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851877.228065:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851877.228066:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851877.228067:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600483334464, found 0 last_xid 1859600483334463
00000020:00000001:23.0:1773851877.228068:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851877.228069:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851877.228069:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851877.228070:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.228070:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851877.228071:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851877.228071:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851877.228072:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009c1daf7d.
02000000:00000001:23.0:1773851877.228073:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.228073:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.228074:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851877.228075:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859600483334464
00010000:00000001:23.0:1773851877.228075:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851877.228076:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005c9f193b x1859600483334464/t0(0) o400->962e994a-314b-484c-b42f-6e299d24829d@8786@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1046-0'
00010000:00000001:23.0:1773851877.228079:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851877.228079:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851877.228080:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=110 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851877.228081:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851877.228082:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001c1fc229 refcount 3 to 8786@kfi7
00000100:00000001:23.0:1773851877.228082:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402093152 : -107139307458464 : ffff9e8eafa33060)
02000000:00000001:23.0:1773851877.228083:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851877.228084:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.228084:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851877.228085:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8786@kfi7
00000400:00000010:23.0:1773851877.228086:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000451cdaad.
00000100:00000200:23.0:1773851877.228087:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600483334464, offset 224
00000400:00000200:23.0:1773851877.228089:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8786@kfi7
00000400:00000200:23.0:1773851877.228089:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8786@kfi7 to cpt 5
00000400:00000200:23.0:1773851877.228090:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d28b0684 nid 8786@kfi7 refs 1
00000400:00000200:23.0:1773851877.228091:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d28b0684 nid 8786@kfi7 refs 2
00000400:00000200:23.0:1773851877.228092:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d28b0684 nid 8786@kfi7 refs 3
00000400:00000200:23.0:1773851877.228094:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8786@kfi7 local destination
00000400:00000200:23.0:1773851877.228095:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769564:8769564:1024:4294967295] 8786@kfi7 LPNI seq info [22417:22417:16:4294967295]
00000400:00000200:23.0:1773851877.228097:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d28b0684 nid 8786@kfi7 refs 2
00000400:00000200:23.0:1773851877.228098:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8786@kfi7 to cpt 5
00000400:00000200:23.0:1773851877.228100:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8786@kfi7(8786@kfi7:8786@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851877.228101:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d28b0684 nid 8786@kfi7 refs 3
00000800:00000200:23.0:1773851877.228102:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851877.228103:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851877.228105:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851877.228108:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 Using peer 8786@kfi7(0x2a1)
00000800:00000200:23.0:1773851877.228111:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0x2a1: rc=0
00000800:00000200:23.0:1773851877.228112:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851877.228114:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851877.228115:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001c1fc229 refcount 2 to 8786@kfi7
00010000:00000001:23.0:1773851877.228116:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851877.228116:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.228117:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851877.228118:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005c9f193b x1859600483334464/t0(0) o400->962e994a-314b-484c-b42f-6e299d24829d@8786@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1046-0'
00000100:00100000:23.0:1773851877.228121:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c9f193b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:962e994a-314b-484c-b42f-6e299d24829d+7:39483:x1859600483334464:12345-8786@kfi7:400:default-tuolumne1046-0 Request processed in 60us (109us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851877.228123:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8786@kfi7, seq: 1998009
00000100:00000040:23.0:1773851877.228124:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001eafc0e9 : new rpc_count 0
00000100:00000001:23.0:1773851877.228125:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851877.228125:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851877.228128:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851877.228129:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:23.0:1773851877.228129:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e4392d26.
00000020:00000010:23.0:1773851877.228130:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000213eb2e8.
00000400:00000200:21.0:1773851877.228130:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:23.0:1773851877.228131:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000001eafc0e9 : new refcount 6
00000100:00000001:23.0:1773851877.228132:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851877.228132:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8786@kfi7: PUT: OK
00000400:00000200:21.0:1773851877.228133:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000451cdaad
00000400:00000010:21.0:1773851877.228134:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000451cdaad.
00000100:00000001:21.0:1773851877.228135:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851877.228136:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851877.228137:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d28b0684 nid 8786@kfi7 refs 2
00000800:00000200:21.0:1773851877.228139:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 8786@kfi7(0000000075702bba):0x0 lsk 674 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2a1 Transaction freed
00000400:00000200:29.0:1773851877.257735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851877.257737:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:9.0:1773851877.319223:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851877.319224:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851877.319225:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851877.319227:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851877.319229:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20218@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.319230:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20218@kfi7 : PUT - for me
00000400:00000200:9.0:1773851877.319231:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20218@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.319232:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009032e8e5 nid 20218@kfi7 refs 1
00000400:00000200:9.0:1773851877.319233:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20218@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.319233:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009032e8e5 nid 20218@kfi7 refs 2
00000400:00000200:9.0:1773851877.319234:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009032e8e5 nid 20218@kfi7 refs 3
00000400:00000200:9.0:1773851877.319235:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20219@kfi7 to cpt 5
00000400:00000200:9.0:1773851877.319236:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20219@kfi7 of length 224 into portal 12 MB=0x699de8e8bf680
00000400:00000200:9.0:1773851877.319237:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20219@kfi7 of length 224/224 into md 0x78146ce49 [64] + 144184
00000800:00000200:9.0:1773851877.319239:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851877.319240:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851877.319241:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20218@kfi7: PUT: OK
00000100:00000001:9.0:1773851877.319242:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851877.319242:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851877.319243:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c034d6b.
00000100:00000040:9.0:1773851877.319244:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009c034d6b x1858031013590656 msgsize 224
00000100:00100000:9.0:1773851877.319245:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20219@kfi7 (source: 12345-20218@kfi7)
00000100:00000001:9.0:1773851877.319246:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851877.319247:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009032e8e5 nid 20218@kfi7 refs 2
00000800:00000200:9.0:1773851877.319248:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851877.319248:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851877.319248:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851877.319249:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851877.319249:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851877.319250:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851877.319251:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031013590656
00000020:00000001:8.0:1773851877.319252:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851877.319252:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91103
00000020:00000001:8.0:1773851877.319253:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851877.319257:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c0042d98 refcount=6
00000020:00000001:8.0:1773851877.319258:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240337408 : -107152469214208 : ffff9e8b9f22bc00)
00000020:00000001:8.0:1773851877.319259:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240337408 : -107152469214208 : ffff9e8b9f22bc00)
00000100:00000001:8.0:1773851877.319260:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851877.319261:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851877.319262:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002eec3ec2.
00000020:00000010:8.0:1773851877.319263:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851877.319264:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851877.319265:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851877.319265:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851877.319266:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.319267:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851877.319268:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851877.319268:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.319269:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851877.319270:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851877.319270:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851877.319270:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851877.319271:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851877.319272:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851877.319272:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20219@kfi7, seq: 2130807
00000100:00000040:8.0:1773851877.319272:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c0042d98 : new rpc_count 1
00000100:00000001:11.0:1773851877.319273:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.319273:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096241664 : -107006613309952 : ffff9ead94d33600)
00000100:00000040:8.0:1773851877.319274:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c034d6b x1858031013590656/t0(0) o400->945aa60b-0774-471d-87a4-bd7b913c7374@20219@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne247-0'
00000100:00000001:8.0:1773851877.319277:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851877.319277:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851877.319278:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c034d6b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:945aa60b-0774-471d-87a4-bd7b913c7374+6:47835:x1858031013590656:12345-20219@kfi7:400:default-tuolumne247-0
00000100:00000200:8.0:1773851877.319279:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031013590656
00000020:00000001:8.0:1773851877.319280:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851877.319280:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851877.319281:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.319282:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851877.319282:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851877.319283:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851877.319283:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031013590656, found 0 last_xid 1858031013590655
00000020:00000001:8.0:1773851877.319284:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851877.319285:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851877.319285:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851877.319286:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.319286:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851877.319287:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851877.319287:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851877.319288:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c68901dd.
02000000:00000001:8.0:1773851877.319289:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.319290:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.319290:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851877.319291:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858031013590656
00010000:00000001:8.0:1773851877.319292:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851877.319292:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c034d6b x1858031013590656/t0(0) o400->945aa60b-0774-471d-87a4-bd7b913c7374@20219@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne247-0'
00010000:00000001:8.0:1773851877.319295:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851877.319295:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851877.319296:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=110 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851877.319297:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851877.319297:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000007481b9f refcount 5 to 20219@kfi7
00000100:00000001:8.0:1773851877.319298:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956271104 : -107146753280512 : ffff9e8cf3d4f600)
02000000:00000001:8.0:1773851877.319299:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851877.319299:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.319300:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851877.319301:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20218@kfi7
00000400:00000010:8.0:1773851877.319301:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ce37ba88.
00000100:00000200:8.0:1773851877.319302:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031013590656, offset 224
00000400:00000200:8.0:1773851877.319303:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20218@kfi7
00000400:00000200:8.0:1773851877.319304:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20218@kfi7 to cpt 2
00000400:00000200:8.0:1773851877.319305:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009032e8e5 nid 20218@kfi7 refs 1
00000400:00000200:8.0:1773851877.319306:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009032e8e5 nid 20218@kfi7 refs 2
00000400:00000200:8.0:1773851877.319307:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009032e8e5 nid 20218@kfi7 refs 3
00000400:00000200:8.0:1773851877.319308:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20218@kfi7 local destination
00000400:00000200:8.0:1773851877.319310:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769565:8769565:1024:4294967295] 20218@kfi7 LPNI seq info [28022:28022:16:4294967295]
00000400:00000200:8.0:1773851877.319311:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009032e8e5 nid 20218@kfi7 refs 2
00000400:00000200:8.0:1773851877.319312:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20218@kfi7 to cpt 2
00000400:00000200:8.0:1773851877.319314:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20218@kfi7(20218@kfi7:20218@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851877.319315:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009032e8e5 nid 20218@kfi7 refs 3
00000800:00000200:8.0:1773851877.319316:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851877.319317:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851877.319321:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851877.319323:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5eb Using peer 20218@kfi7(0x5eb)
00000800:00000200:8.0:1773851877.319326:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x5eb: rc=0
00000800:00000200:8.0:1773851877.319327:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851877.319329:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851877.319330:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000007481b9f refcount 4 to 20219@kfi7
00010000:00000001:8.0:1773851877.319331:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851877.319331:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.319332:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851877.319332:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c034d6b x1858031013590656/t0(0) o400->945aa60b-0774-471d-87a4-bd7b913c7374@20219@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne247-0'
00000100:00100000:8.0:1773851877.319337:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c034d6b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:945aa60b-0774-471d-87a4-bd7b913c7374+6:47835:x1858031013590656:12345-20219@kfi7:400:default-tuolumne247-0 Request processed in 59us (92us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851877.319339:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20219@kfi7, seq: 2130807
00000100:00000040:8.0:1773851877.319340:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c0042d98 : new rpc_count 0
00000100:00000001:8.0:1773851877.319340:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851877.319341:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851877.319342:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851877.319342:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851877.319343:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002eec3ec2.
00000020:00000040:8.0:1773851877.319344:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c0042d98 : new refcount 5
00000100:00000001:8.0:1773851877.319344:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851877.319349:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5eb TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851877.319351:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851877.319352:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20218@kfi7: PUT: OK
00000400:00000200:9.0:1773851877.319352:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ce37ba88
00000400:00000010:9.0:1773851877.319353:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ce37ba88.
00000100:00000001:9.0:1773851877.319354:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851877.319354:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851877.319355:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009032e8e5 nid 20218@kfi7 refs 2
00000800:00000200:9.0:1773851877.319356:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 20218@kfi7(00000000aa623df3):0x0 lsk 1516 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5eb Transaction freed
00000800:00000200:29.0:1773851877.358414:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851877.358415:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851877.358416:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851877.358419:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851877.358420:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23843@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.358422:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23843@kfi7 : PUT - for me
00000400:00000200:29.0:1773851877.358423:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23843@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.358424:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef336315 nid 23843@kfi7 refs 1
00000400:00000200:29.0:1773851877.358425:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23843@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.358425:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef336315 nid 23843@kfi7 refs 2
00000400:00000200:29.0:1773851877.358426:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ef336315 nid 23843@kfi7 refs 3
00000400:00000200:29.0:1773851877.358427:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24035@kfi7 to cpt 2
00000400:00000200:29.0:1773851877.358428:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24035@kfi7 of length 224 into portal 12 MB=0x699e17317d040
00000400:00000200:29.0:1773851877.358429:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24035@kfi7 of length 224/224 into md 0x77fe139dd [64] + 187688
00000800:00000200:29.0:1773851877.358431:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851877.358433:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851877.358434:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23843@kfi7: PUT: OK
00000100:00000001:29.0:1773851877.358435:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851877.358436:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851877.358436:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d462bc12.
00000100:00000040:29.0:1773851877.358437:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000d462bc12 x1858043437895744 msgsize 224
00000100:00100000:29.0:1773851877.358439:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-24035@kfi7 (source: 12345-23843@kfi7)
00000100:00000001:29.0:1773851877.358440:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851877.358440:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef336315 nid 23843@kfi7 refs 2
00000100:00000001:28.0:1773851877.358441:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851877.358442:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851877.358442:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851877.358442:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851877.358443:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851877.358444:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851877.358444:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043437895744
00000020:00000001:28.0:1773851877.358445:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851877.358446:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c2a
00000020:00000001:28.0:1773851877.358446:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851877.358449:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004c95c091 refcount=6
00000020:00000001:28.0:1773851877.358450:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743941120 : -107128965610496 : ffff9e91180f4400)
00000020:00000001:28.0:1773851877.358451:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743941120 : -107128965610496 : ffff9e91180f4400)
00000100:00000001:28.0:1773851877.358452:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851877.358453:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851877.358453:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851877.358454:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851877.358455:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851877.358457:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851877.358457:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851877.358458:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851877.358459:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851877.358459:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851877.358460:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.358460:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851877.358462:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851877.358462:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851877.358462:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851877.358463:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851877.358463:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24035@kfi7, seq: 2055546
00000100:00000001:30.0:1773851877.358464:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.358464:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004c95c091 : new rpc_count 1
00000100:00000001:30.0:1773851877.358465:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.358465:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079339691008 : -106994369860608 : ffff9eb06e976c00)
00000100:00000040:28.0:1773851877.358466:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d462bc12 x1858043437895744/t0(0) o400->b30a90c5-06f4-4d84-8a6a-bfc0ccb65523@24035@kfi7:665/0 lens 224/0 e 0 to 0 dl 1773852025 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1979-0'
00000100:00000001:28.0:1773851877.358469:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851877.358469:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851877.358470:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d462bc12 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:b30a90c5-06f4-4d84-8a6a-bfc0ccb65523+6:39692:x1858043437895744:12345-24035@kfi7:400:default-tuolumne1979-0
00000100:00000200:28.0:1773851877.358471:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043437895744
00000020:00000001:28.0:1773851877.358472:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851877.358473:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851877.358473:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.358474:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851877.358475:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851877.358475:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851877.358476:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043437895744, found 0 last_xid 1858043437895743
00000020:00000001:28.0:1773851877.358477:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851877.358478:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851877.358478:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851877.358479:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.358480:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851877.358480:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851877.358481:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851877.358481:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004a14fe5a.
02000000:00000001:28.0:1773851877.358483:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.358483:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.358484:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851877.358485:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260615292, transno 0, xid 1858043437895744
00010000:00000001:28.0:1773851877.358485:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851877.358486:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d462bc12 x1858043437895744/t0(0) o400->b30a90c5-06f4-4d84-8a6a-bfc0ccb65523@24035@kfi7:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1979-0'
00010000:00000001:28.0:1773851877.358489:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851877.358489:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851877.358490:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=110 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851877.358491:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851877.358492:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001306632d refcount 3 to 24035@kfi7
00000100:00000001:28.0:1773851877.358493:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581696 : -107154806969920 : ffff9e8b13cb69c0)
02000000:00000001:28.0:1773851877.358493:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851877.358494:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.358495:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851877.358495:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23843@kfi7
00000400:00000010:28.0:1773851877.358496:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dd059cb9.
00000100:00000200:28.0:1773851877.358497:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043437895744, offset 224
00000400:00000200:28.0:1773851877.358498:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23843@kfi7
00000400:00000200:28.0:1773851877.358499:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23843@kfi7 to cpt 7
00000400:00000200:28.0:1773851877.358500:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef336315 nid 23843@kfi7 refs 1
00000400:00000200:28.0:1773851877.358501:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ef336315 nid 23843@kfi7 refs 2
00000400:00000200:28.0:1773851877.358502:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ef336315 nid 23843@kfi7 refs 3
00000400:00000200:28.0:1773851877.358504:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23843@kfi7 local destination
00000400:00000200:28.0:1773851877.358505:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769566:8769566:1024:4294967295] 23843@kfi7 LPNI seq info [25157004:25157004:16:4294967295]
00000400:00000200:28.0:1773851877.358507:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ef336315 nid 23843@kfi7 refs 2
00000400:00000200:28.0:1773851877.358507:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23843@kfi7 to cpt 7
00000400:00000200:28.0:1773851877.358510:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23843@kfi7(23843@kfi7:23843@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851877.358511:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ef336315 nid 23843@kfi7 refs 3
00000800:00000200:28.0:1773851877.358513:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851877.358514:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851877.358516:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851877.358519:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe14 Using peer 23843@kfi7(0xe14)
00000800:00000200:28.0:1773851877.358522:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0xe14: rc=0
00000800:00000200:28.0:1773851877.358523:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe14 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851877.358525:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.358526:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001306632d refcount 2 to 24035@kfi7
00010000:00000001:28.0:1773851877.358527:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851877.358528:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.358529:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851877.358530:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d462bc12 x1858043437895744/t0(0) o400->b30a90c5-06f4-4d84-8a6a-bfc0ccb65523@24035@kfi7:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1979-0'
00000100:00100000:28.0:1773851877.358534:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d462bc12 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:b30a90c5-06f4-4d84-8a6a-bfc0ccb65523+6:39692:x1858043437895744:12345-24035@kfi7:400:default-tuolumne1979-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851877.358537:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24035@kfi7, seq: 2055546
00000100:00000040:28.0:1773851877.358538:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004c95c091 : new rpc_count 0
00000100:00000001:28.0:1773851877.358539:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851877.358539:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851877.358540:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851877.358541:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851877.358541:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851877.358542:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000004c95c091 : new refcount 5
00000100:00000001:28.0:1773851877.358543:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851877.358548:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe14 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851877.358549:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851877.358551:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23843@kfi7: PUT: OK
00000400:00000200:29.0:1773851877.358551:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dd059cb9
00000400:00000010:29.0:1773851877.358552:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dd059cb9.
00000100:00000001:29.0:1773851877.358552:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851877.358553:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851877.358554:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef336315 nid 23843@kfi7 refs 2
00000800:00000200:29.0:1773851877.358555:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2069@kfi7:7 -> 23843@kfi7(0000000084e4e513):0x0 lsk 3605 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe14 Transaction freed
00000800:00000200:31.0:1773851877.368202:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851877.368202:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851877.368203:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:29.0:1773851877.368203:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851877.368204:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:29.0:1773851877.368205:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851877.368206:0:2465875:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22115@kfi7(0000000058b70b0d):0xfab version: 2; local version 2; negotiated version: 2
00000800:00000200:31.0:1773851877.368208:0:2465875:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab Using peer 22115@kfi7(0x100000000000fab)
00000800:00000200:29.0:1773851877.368209:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851877.368210:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22115@kfi7 to cpt 7
00000800:00000200:31.0:1773851877.368212:0:2465875:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 38 bytes to peer 0x100000000000fab: rc=0
00000400:00000200:29.0:1773851877.368212:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22115@kfi7 to cpt 7
00000800:00000200:31.0:1773851877.368213:0:2465875:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851877.368213:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22115@kfi7 : PUT - for me
00000400:00000200:29.0:1773851877.368215:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22115@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.368216:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6e5d360 nid 22115@kfi7 refs 1
00000400:00000200:29.0:1773851877.368219:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22115@kfi7 to cpt 7
00000400:00000200:29.0:1773851877.368220:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6e5d360 nid 22115@kfi7 refs 2
00000400:00000200:29.0:1773851877.368221:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e6e5d360 nid 22115@kfi7 refs 3
00000400:00000200:29.0:1773851877.368223:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22178@kfi7 to cpt 0
00000400:00000200:29.0:1773851877.368224:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22178@kfi7 of length 224 into portal 12 MB=0x699e84457dac0
00000400:00000200:29.0:1773851877.368226:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22178@kfi7 of length 224/224 into md 0x77fe139dd [64] + 187912
00000800:00000200:31.0:1773851877.368228:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851877.368229:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851877.368230:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab Transaction freed
00000400:00000200:29.0:1773851877.368231:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851877.368233:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22115@kfi7: PUT: OK
00000100:00000001:29.0:1773851877.368235:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851877.368235:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851877.368236:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd52e765.
00000100:00000040:29.0:1773851877.368237:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000dd52e765 x1858072718334656 msgsize 224
00000100:00100000:29.0:1773851877.368240:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22178@kfi7 (source: 12345-22115@kfi7)
00000100:00000001:29.0:1773851877.368241:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851877.368243:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6e5d360 nid 22115@kfi7 refs 2
00000100:00000001:28.0:1773851877.368244:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851877.368245:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851877.368245:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851877.368245:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851877.368246:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851877.368247:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851877.368248:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858072718334656
00000020:00000001:28.0:1773851877.368249:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851877.368250:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c7f
00000020:00000001:28.0:1773851877.368251:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851877.368254:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004cfdd995 refcount=6
00000020:00000001:28.0:1773851877.368256:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628280320 : -107123081271296 : ffff9e9276cb2800)
00000020:00000001:28.0:1773851877.368257:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628280320 : -107123081271296 : ffff9e9276cb2800)
00000100:00000001:28.0:1773851877.368258:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851877.368259:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851877.368260:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851877.368261:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851877.368262:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851877.368264:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851877.368264:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851877.368265:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851877.368266:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851877.368267:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851877.368268:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.368269:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851877.368271:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851877.368272:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851877.368272:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851877.368273:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851877.368273:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22178@kfi7, seq: 2055547
00000100:00000040:28.0:1773851877.368274:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004cfdd995 : new rpc_count 1
00000100:00000001:30.0:1773851877.368275:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851877.368275:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.368275:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079339663360 : -106994369888256 : ffff9eb06e970000)
00000100:00000040:28.0:1773851877.368277:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dd52e765 x1858072718334656/t0(0) o400->52816436-c595-4190-99e3-f49dfd03ca36@22178@kfi7:517/0 lens 224/0 e 0 to 0 dl 1773852632 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1868-0'
00000100:00000001:28.0:1773851877.368282:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851877.368283:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851877.368284:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd52e765 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:52816436-c595-4190-99e3-f49dfd03ca36+6:39710:x1858072718334656:12345-22178@kfi7:400:default-tuolumne1868-0
00000100:00000200:28.0:1773851877.368286:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858072718334656
00000020:00000001:28.0:1773851877.368287:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851877.368288:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851877.368289:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.368291:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851877.368291:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851877.368293:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851877.368293:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858072718334656, found 0 last_xid 1858072718334655
00000020:00000001:28.0:1773851877.368295:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851877.368295:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851877.368296:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851877.368297:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.368298:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851877.368299:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851877.368299:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851877.368300:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007e39e2f6.
02000000:00000001:28.0:1773851877.368301:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.368302:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.368303:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851877.368304:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693483, transno 0, xid 1858072718334656
00010000:00000001:28.0:1773851877.368305:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851877.368307:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dd52e765 x1858072718334656/t0(0) o400->52816436-c595-4190-99e3-f49dfd03ca36@22178@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1868-0'
00010000:00000001:28.0:1773851877.368311:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851877.368312:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851877.368313:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=110 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851877.368315:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851877.368316:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c3a32ae2 refcount 3 to 22178@kfi7
00000100:00000001:28.0:1773851877.368317:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850078912 : -107143859472704 : ffff9e8da050f6c0)
02000000:00000001:28.0:1773851877.368318:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851877.368319:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.368320:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851877.368321:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22115@kfi7
00000400:00000010:28.0:1773851877.368322:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eed4dfca.
00000100:00000200:28.0:1773851877.368323:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858072718334656, offset 224
00000400:00000200:28.0:1773851877.368325:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22115@kfi7
00000400:00000200:28.0:1773851877.368326:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22115@kfi7 to cpt 7
00000400:00000200:28.0:1773851877.368328:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e6e5d360 nid 22115@kfi7 refs 1
00000400:00000200:28.0:1773851877.368329:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e6e5d360 nid 22115@kfi7 refs 2
00000400:00000200:28.0:1773851877.368332:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e6e5d360 nid 22115@kfi7 refs 3
00000400:00000200:28.0:1773851877.368334:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22115@kfi7 local destination
00000400:00000200:28.0:1773851877.368336:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769567:8769567:1024:4294967295] 22115@kfi7 LPNI seq info [12901536:12901536:16:4294967295]
00000400:00000200:28.0:1773851877.368338:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e6e5d360 nid 22115@kfi7 refs 2
00000400:00000200:28.0:1773851877.368340:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22115@kfi7 to cpt 7
00000400:00000200:28.0:1773851877.368344:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22115@kfi7(22115@kfi7:22115@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851877.368346:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e6e5d360 nid 22115@kfi7 refs 3
00000800:00000200:28.0:1773851877.368348:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851877.368349:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851877.368353:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851877.368357:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab Using peer 22115@kfi7(0x100000000000fab)
00000800:00000200:28.0:1773851877.368361:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x100000000000fab: rc=0
00000800:00000200:28.0:1773851877.368363:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851877.368366:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.368367:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c3a32ae2 refcount 2 to 22178@kfi7
00010000:00000001:28.0:1773851877.368369:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851877.368369:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.368372:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851877.368373:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd52e765 x1858072718334656/t0(0) o400->52816436-c595-4190-99e3-f49dfd03ca36@22178@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1868-0'
00000100:00100000:28.0:1773851877.368378:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd52e765 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:52816436-c595-4190-99e3-f49dfd03ca36+6:39710:x1858072718334656:12345-22178@kfi7:400:default-tuolumne1868-0 Request processed in 95us (140us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851877.368382:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22178@kfi7, seq: 2055547
00000100:00000040:28.0:1773851877.368383:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004cfdd995 : new rpc_count 0
00000100:00000001:28.0:1773851877.368385:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851877.368385:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851877.368386:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851877.368387:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851877.368388:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851877.368389:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000004cfdd995 : new refcount 5
00000100:00000001:28.0:1773851877.368390:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851877.368397:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851877.368399:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851877.368400:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22115@kfi7: PUT: OK
00000400:00000200:31.0:1773851877.368401:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eed4dfca
00000400:00000010:31.0:1773851877.368401:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eed4dfca.
00000100:00000001:31.0:1773851877.368402:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851877.368403:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851877.368403:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e6e5d360 nid 22115@kfi7 refs 2
00000800:00000200:31.0:1773851877.368405:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 22115@kfi7(0000000058b70b0d):0x0 lsk 4012 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000fab Transaction freed
00000800:00000200:17.0:1773851877.381811:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.381812:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851877.381813:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851877.381815:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851877.381817:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.381818:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21585@kfi7 : PUT - for me
00000400:00000200:17.0:1773851877.381819:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.381819:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 1
00000400:00000200:17.0:1773851877.381820:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.381821:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000400:00000200:17.0:1773851877.381821:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 3
00000400:00000200:17.0:1773851877.381822:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.381823:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21585@kfi7 of length 456 into portal 12 MB=0x69b0a628642c0
00000400:00000200:17.0:1773851877.381824:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21585@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 25768
00000800:00000200:17.0:1773851877.381826:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851877.381827:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851877.381828:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21585@kfi7: PUT: OK
00000100:00000001:17.0:1773851877.381829:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851877.381829:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851877.381830:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ff645ba9.
00000100:00000040:17.0:1773851877.381831:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ff645ba9 x1859318765208256 msgsize 456
00000100:00100000:17.0:1773851877.381832:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21585@kfi7 (source: 12345-21585@kfi7)
00000100:00000001:17.0:1773851877.381834:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851877.381834:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000800:00000200:17.0:1773851877.381836:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851877.381840:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851877.381840:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851877.381841:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851877.381841:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851877.381842:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851877.381842:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318765208256
00000020:00000001:17.0:1773851877.381843:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851877.381843:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f8e
00000020:00000001:17.0:1773851877.381844:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851877.381845:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cc7a8a1a refcount=4084
00000020:00000001:17.0:1773851877.381846:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744911872 : -107128964639744 : ffff9e91181e1400)
00000020:00000001:17.0:1773851877.381847:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744911872 : -107128964639744 : ffff9e91181e1400)
00000100:00000001:17.0:1773851877.381847:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.381848:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851877.381848:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c935461.
00000020:00000010:17.0:1773851877.381849:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.381850:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851877.381851:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851877.381851:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851877.381852:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.381853:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.381853:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.381854:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851877.381855:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851877.381855:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851877.381855:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851877.381856:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21585@kfi7, seq: 323103288
00000100:00000040:17.0:1773851877.381856:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cc7a8a1a : new rpc_count 22
00000100:00000001:17.0:1773851877.381857:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144552183424 : -106929157368192 : ffff9ebf9d8f1680)
00000100:00000001:16.0:1773851877.381857:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851877.381857:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.381858:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ff645ba9 x1859318765208256/t0(0) o17->592c507f-ccd6-4044-839f-fd99d46495b1@21585@kfi7:129/0 lens 456/0 e 0 to 0 dl 1773852244 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1842-0'
00000100:00000001:17.0:1773851877.381860:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.381861:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851877.381861:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff645ba9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:592c507f-ccd6-4044-839f-fd99d46495b1+4084:39447:x1859318765208256:12345-21585@kfi7:17:default-tuolumne1842-0
00000100:00000200:17.0:1773851877.381864:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318765208256
00000020:00000001:17.0:1773851877.381864:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851877.381865:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851877.381865:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.381866:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851877.381866:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:17.0:1773851877.381867:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851877.381868:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318765208256, found 0 last_xid 1859318764449279
00000020:00000001:17.0:1773851877.381868:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851877.381869:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851877.381869:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851877.381870:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:17.0:1773851877.381870:0:60961:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:17.0:1773851877.381871:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851877.381872:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851877.381873:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000003ee4e45a.
02000000:00000001:17.0:1773851877.381873:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.381874:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.381875:0:60961:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:17.0:1773851877.381875:0:60961:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:17.0:1773851877.381876:0:60961:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:17.0:1773851877.381877:0:60961:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.381878:0:60961:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:17.0:1773851877.381879:0:60961:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 592c507f-ccd6-4044-839f-fd99d46495b1/00000000cc7a8a1a free: 126633370845184 avail: 126633368748032
00000020:00000001:17.0:1773851877.381880:0:60961:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:17.0:1773851877.381880:0:60961:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 592c507f-ccd6-4044-839f-fd99d46495b1/00000000cc7a8a1a avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:17.0:1773851877.381882:0:60961:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:17.0:1773851877.381882:0:60961:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:17.0:1773851877.381883:0:60961:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 592c507f-ccd6-4044-839f-fd99d46495b1/00000000cc7a8a1a reports grant 1803288575 dropped 0, local 1882456063
00000020:00000001:17.0:1773851877.381884:0:60961:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:17.0:1773851877.381884:0:60961:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:17.0:1773851877.381885:0:60961:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851877.381886:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592388, transno 0, xid 1859318765208256
00010000:00000001:17.0:1773851877.381887:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851877.381887:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ff645ba9 x1859318765208256/t0(0) o17->592c507f-ccd6-4044-839f-fd99d46495b1@21585@kfi7:129/0 lens 456/432 e 0 to 0 dl 1773852244 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1842-0'
00010000:00000001:17.0:1773851877.381890:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851877.381891:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851877.381891:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=110 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851877.381892:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851877.381893:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001bda23be refcount 3 to 21585@kfi7
00000100:00000001:17.0:1773851877.381894:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583903168 : -107156125648448 : ffff9e8ac531f9c0)
02000000:00000001:17.0:1773851877.381895:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851877.381895:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.381896:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851877.381897:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21585@kfi7
00000400:00000010:17.0:1773851877.381897:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d429eef8.
00000100:00000200:17.0:1773851877.381898:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859318765208256, offset 224
00000400:00000200:17.0:1773851877.381899:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21585@kfi7
00000400:00000200:17.0:1773851877.381900:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.381901:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 1
00000400:00000200:17.0:1773851877.381902:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000400:00000200:17.0:1773851877.381903:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 3
00000400:00000200:17.0:1773851877.381904:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21585@kfi7 local destination
00000400:00000200:17.0:1773851877.381905:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769568:8769568:1024:4294967295] 21585@kfi7 LPNI seq info [8783152:8783152:16:4294967295]
00000400:00000200:17.0:1773851877.381906:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000400:00000200:17.0:1773851877.381907:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21585@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.381909:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21585@kfi7(21585@kfi7:21585@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851877.381910:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 3
00000800:00000200:17.0:1773851877.381911:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.381912:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:17.0:1773851877.381914:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851877.381917:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x964 Using peer 21585@kfi7(0x964)
00000800:00000200:17.0:1773851877.381920:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 532 bytes to peer 0x964: rc=0
00000800:00000200:17.0:1773851877.381922:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x964 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851877.381924:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.381925:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001bda23be refcount 2 to 21585@kfi7
00010000:00000001:17.0:1773851877.381925:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851877.381926:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.381927:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851877.381927:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ff645ba9 x1859318765208256/t0(0) o17->592c507f-ccd6-4044-839f-fd99d46495b1@21585@kfi7:129/0 lens 456/432 e 0 to 0 dl 1773852244 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1842-0'
00000100:00100000:17.0:1773851877.381930:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff645ba9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:592c507f-ccd6-4044-839f-fd99d46495b1+4084:39447:x1859318765208256:12345-21585@kfi7:17:default-tuolumne1842-0 Request processed in 69us (99us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851877.381933:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21585@kfi7, seq: 323103288
00000100:00000040:17.0:1773851877.381933:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cc7a8a1a : new rpc_count 21
00000800:00000200:18.0:1773851877.381934:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x964 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851877.381934:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851877.381935:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851877.381935:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.381936:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:18.0:1773851877.381937:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851877.381937:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c935461.
00000400:00000200:18.0:1773851877.381938:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21585@kfi7: PUT: OK
00000400:00000200:18.0:1773851877.381938:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d429eef8
00000020:00000040:17.0:1773851877.381938:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000cc7a8a1a : new refcount 4083
00000100:00000001:17.0:1773851877.381938:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:18.0:1773851877.381939:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d429eef8.
00000100:00000001:18.0:1773851877.381940:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851877.381940:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851877.381941:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000043fca12a nid 21585@kfi7 refs 2
00000800:00000200:18.0:1773851877.381943:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 21585@kfi7(000000008e0fd40a):0x0 lsk 2405 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x964 Transaction freed
00000800:00000200:21.0:1773851877.429816:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851877.429818:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851877.429820:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851877.429823:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851877.429826:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10752@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.429828:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10752@kfi7 : PUT - for me
00000400:00000200:21.0:1773851877.429830:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10752@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.429831:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ab996bf nid 10752@kfi7 refs 1
00000400:00000200:21.0:1773851877.429833:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10752@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.429834:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ab996bf nid 10752@kfi7 refs 2
00000400:00000200:21.0:1773851877.429836:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002ab996bf nid 10752@kfi7 refs 3
00000400:00000200:21.0:1773851877.429837:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10752@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.429838:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10752@kfi7 of length 224 into portal 12 MB=0x699e10bcea000
00000400:00000200:21.0:1773851877.429840:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10752@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 47440
00000800:00000200:21.0:1773851877.429843:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851877.429846:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851877.429847:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10752@kfi7: PUT: OK
00000100:00000001:21.0:1773851877.429849:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851877.429849:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851877.429850:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f12ef40.
00000100:00000040:21.0:1773851877.429851:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008f12ef40 x1858041705046016 msgsize 224
00000100:00100000:21.0:1773851877.429854:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-10752@kfi7 (source: 12345-10752@kfi7)
00000100:00000001:21.0:1773851877.429855:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851877.429856:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002ab996bf nid 10752@kfi7 refs 2
00000100:00000001:23.0:1773851877.429857:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851877.429857:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851877.429858:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851877.429858:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851877.429858:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851877.429859:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851877.429860:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041705046016
00000020:00000001:23.0:1773851877.429860:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851877.429861:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9175b
00000020:00000001:23.0:1773851877.429861:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851877.429865:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000010134f99 refcount=6
00000020:00000001:23.0:1773851877.429865:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241484288 : -107152468067328 : ffff9e8b9f343c00)
00000020:00000001:23.0:1773851877.429866:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241484288 : -107152468067328 : ffff9e8b9f343c00)
00000100:00000001:23.0:1773851877.429867:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851877.429868:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851877.429869:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004686297a.
00000020:00000010:23.0:1773851877.429870:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851877.429871:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851877.429871:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851877.429872:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851877.429872:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851877.429873:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851877.429874:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851877.429874:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.429875:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851877.429876:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851877.429877:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851877.429878:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10752@kfi7, seq: 1998010
00000100:00000040:23.0:1773851877.429878:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000010134f99 : new rpc_count 1
00000100:00000001:20.0:1773851877.429878:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851877.429878:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851877.429879:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794369024 : -106943915182592 : ffff9ebc2decb600)
00000100:00000001:20.0:1773851877.429879:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851877.429880:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008f12ef40 x1858041705046016/t0(0) o400->2626e41c-2556-4362-b7d4-fd41cc73a40b@10752@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1171-0'
00000100:00000001:20.0:1773851877.429880:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.429883:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851877.429884:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851877.429885:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f12ef40 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:2626e41c-2556-4362-b7d4-fd41cc73a40b+6:39653:x1858041705046016:12345-10752@kfi7:400:default-tuolumne1171-0
00000100:00000200:23.0:1773851877.429886:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041705046016
00000020:00000001:23.0:1773851877.429886:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851877.429887:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851877.429888:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.429888:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851877.429889:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851877.429890:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851877.429890:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041705046016, found 0 last_xid 1858041705046015
00000020:00000001:23.0:1773851877.429891:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851877.429892:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851877.429892:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851877.429893:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.429893:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851877.429894:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851877.429894:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851877.429895:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005fc8309b.
02000000:00000001:23.0:1773851877.429896:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.429897:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.429897:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851877.429898:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253967357, transno 0, xid 1858041705046016
00010000:00000001:23.0:1773851877.429899:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851877.429900:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008f12ef40 x1858041705046016/t0(0) o400->2626e41c-2556-4362-b7d4-fd41cc73a40b@10752@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1171-0'
00010000:00000001:23.0:1773851877.429902:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851877.429902:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851877.429903:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=110 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851877.429905:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851877.429905:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c46611d3 refcount 3 to 10752@kfi7
00000100:00000001:23.0:1773851877.429906:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108896 : -107156354442720 : ffff9e8ab78eda20)
02000000:00000001:23.0:1773851877.429908:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851877.429908:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.429909:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851877.429910:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10752@kfi7
00000400:00000010:23.0:1773851877.429910:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c56f69f.
00000100:00000200:23.0:1773851877.429911:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041705046016, offset 224
00000400:00000200:23.0:1773851877.429912:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10752@kfi7
00000400:00000200:23.0:1773851877.429913:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10752@kfi7 to cpt 5
00000400:00000200:23.0:1773851877.429914:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ab996bf nid 10752@kfi7 refs 1
00000400:00000200:23.0:1773851877.429915:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002ab996bf nid 10752@kfi7 refs 2
00000400:00000200:23.0:1773851877.429917:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002ab996bf nid 10752@kfi7 refs 3
00000400:00000200:23.0:1773851877.429918:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10752@kfi7 local destination
00000400:00000200:23.0:1773851877.429919:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769569:8769569:1024:4294967295] 10752@kfi7 LPNI seq info [4546481:4546481:16:4294967295]
00000400:00000200:23.0:1773851877.429920:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002ab996bf nid 10752@kfi7 refs 2
00000400:00000200:23.0:1773851877.429921:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10752@kfi7 to cpt 5
00000400:00000200:23.0:1773851877.429923:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10752@kfi7(10752@kfi7:10752@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851877.429924:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002ab996bf nid 10752@kfi7 refs 3
00000800:00000200:23.0:1773851877.429926:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851877.429927:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851877.429929:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851877.429931:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9e0 Using peer 10752@kfi7(0x9e0)
00000800:00000200:23.0:1773851877.429934:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x9e0: rc=0
00000800:00000200:23.0:1773851877.429936:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9e0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851877.429938:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851877.429938:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c46611d3 refcount 2 to 10752@kfi7
00010000:00000001:23.0:1773851877.429939:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851877.429940:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.429941:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851877.429941:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f12ef40 x1858041705046016/t0(0) o400->2626e41c-2556-4362-b7d4-fd41cc73a40b@10752@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1171-0'
00000100:00100000:23.0:1773851877.429945:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f12ef40 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:2626e41c-2556-4362-b7d4-fd41cc73a40b+6:39653:x1858041705046016:12345-10752@kfi7:400:default-tuolumne1171-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851877.429947:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10752@kfi7, seq: 1998010
00000100:00000040:23.0:1773851877.429947:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000010134f99 : new rpc_count 0
00000100:00000001:23.0:1773851877.429948:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851877.429949:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851877.429949:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851877.429950:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851877.429951:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004686297a.
00000020:00000040:23.0:1773851877.429951:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000010134f99 : new refcount 5
00000800:00000200:21.0:1773851877.429951:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9e0 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851877.429952:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851877.429953:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851877.429955:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10752@kfi7: PUT: OK
00000400:00000200:21.0:1773851877.429956:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c56f69f
00000400:00000010:21.0:1773851877.429957:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c56f69f.
00000100:00000001:21.0:1773851877.429958:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851877.429959:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851877.429960:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002ab996bf nid 10752@kfi7 refs 2
00000800:00000200:21.0:1773851877.429962:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 10752@kfi7(00000000436f32ea):0x0 lsk 2529 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9e0 Transaction freed
00010000:00000001:2.0:1773851877.513730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513732:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851877.513732:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851877.513733:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513733:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851877.513734:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513734:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513735:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513736:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851877.513736:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851877.513737:0:2506505:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851877.513738:0:2506505:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851877.513738:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513739:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851877.513739:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513740:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513740:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513741:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851877.513742:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851877.513742:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513742:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851877.513743:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513744:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513744:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851877.513748:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851877.513749:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851877.513749:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513750:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851877.513750:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513751:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851877.513751:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.513754:0:937839:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851877.513755:0:937839:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851877.513756:0:937839:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:17.0:1773851877.565911:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.565913:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851877.565914:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851877.565918:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851877.565921:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24368@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.565923:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24368@kfi7 : PUT - for me
00000400:00000200:17.0:1773851877.565924:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24368@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.565926:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b14adeb9 nid 24368@kfi7 refs 1
00000400:00000200:17.0:1773851877.565927:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24368@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.565928:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b14adeb9 nid 24368@kfi7 refs 2
00000400:00000200:17.0:1773851877.565930:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b14adeb9 nid 24368@kfi7 refs 3
00000400:00000200:17.0:1773851877.565931:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24561@kfi7 to cpt 1
00000400:00000200:17.0:1773851877.565933:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24561@kfi7 of length 224 into portal 12 MB=0x69b4b9a0f7f00
00000400:00000200:17.0:1773851877.565935:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24561@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 26224
00000800:00000200:17.0:1773851877.565938:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851877.565940:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851877.565942:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24368@kfi7: PUT: OK
00000100:00000001:17.0:1773851877.565944:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851877.565945:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851877.565946:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000092591488.
00000100:00000040:17.0:1773851877.565947:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000092591488 x1859598869823232 msgsize 224
00000100:00100000:17.0:1773851877.565949:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-24561@kfi7 (source: 12345-24368@kfi7)
00000100:00000001:17.0:1773851877.565951:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851877.565953:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b14adeb9 nid 24368@kfi7 refs 2
00000800:00000200:17.0:1773851877.565955:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851877.565959:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851877.565960:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851877.565961:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851877.565962:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851877.565963:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851877.565964:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598869823232
00000020:00000001:17.0:1773851877.565965:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851877.565966:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24384e6b
00000020:00000001:17.0:1773851877.565967:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851877.565971:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000346e41ae refcount=5
00000020:00000001:17.0:1773851877.565973:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637101692276736 : -106972017274880 : ffff9eb5a2e8d000)
00000020:00000001:17.0:1773851877.565974:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637101692276736 : -106972017274880 : ffff9eb5a2e8d000)
00000100:00000001:17.0:1773851877.565976:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.565977:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851877.565979:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004c935461.
00000020:00000010:17.0:1773851877.565980:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.565982:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851877.565983:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851877.565984:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851877.565985:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.565987:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851877.565988:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851877.565988:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.565990:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.565992:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851877.565993:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851877.565993:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851877.565994:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851877.565995:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24561@kfi7, seq: 2156366
00000100:00000040:17.0:1773851877.565997:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000346e41ae : new rpc_count 1
00000100:00000001:16.0:1773851877.565997:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.565998:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144552208768 : -106929157342848 : ffff9ebf9d8f7980)
00000100:00000001:16.0:1773851877.565998:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.566000:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000092591488 x1859598869823232/t0(0) o400->224daa91-2a4c-4fdf-8350-a044041101c1@24561@kfi7:98/0 lens 224/0 e 0 to 0 dl 1773852213 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2013-0'
00000100:00000001:17.0:1773851877.566005:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.566006:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851877.566008:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000092591488 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:224daa91-2a4c-4fdf-8350-a044041101c1+5:39726:x1859598869823232:12345-24561@kfi7:400:default-tuolumne2013-0
00000100:00000200:17.0:1773851877.566010:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598869823232
00000020:00000001:17.0:1773851877.566012:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851877.566013:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851877.566014:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.566015:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851877.566016:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851877.566017:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851877.566018:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598869823232, found 0 last_xid 1859598869823231
00000020:00000001:17.0:1773851877.566020:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851877.566022:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851877.566023:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851877.566024:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.566025:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851877.566026:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851877.566026:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851877.566029:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a9b721ff.
02000000:00000001:17.0:1773851877.566030:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.566031:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.566033:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851877.566034:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824070, transno 0, xid 1859598869823232
00010000:00000001:17.0:1773851877.566035:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851877.566037:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000092591488 x1859598869823232/t0(0) o400->224daa91-2a4c-4fdf-8350-a044041101c1@24561@kfi7:98/0 lens 224/224 e 0 to 0 dl 1773852213 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2013-0'
00010000:00000001:17.0:1773851877.566041:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851877.566042:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851877.566043:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=110 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851877.566045:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851877.566047:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001093b077 refcount 3 to 24561@kfi7
00000100:00000001:17.0:1773851877.566048:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231614336 : -107130477937280 : ffff9e90bdeafd80)
02000000:00000001:17.0:1773851877.566049:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851877.566050:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.566051:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851877.566053:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24368@kfi7
00000400:00000010:17.0:1773851877.566054:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df4ad511.
00000100:00000200:17.0:1773851877.566055:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598869823232, offset 224
00000400:00000200:17.0:1773851877.566058:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24368@kfi7
00000400:00000200:17.0:1773851877.566059:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24368@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.566060:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b14adeb9 nid 24368@kfi7 refs 1
00000400:00000200:17.0:1773851877.566062:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b14adeb9 nid 24368@kfi7 refs 2
00000400:00000200:17.0:1773851877.566064:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b14adeb9 nid 24368@kfi7 refs 3
00000400:00000200:17.0:1773851877.566066:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24368@kfi7 local destination
00000400:00000200:17.0:1773851877.566068:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769570:8769570:1024:4294967295] 24368@kfi7 LPNI seq info [11343596:11343596:16:4294967295]
00000400:00000200:17.0:1773851877.566071:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b14adeb9 nid 24368@kfi7 refs 2
00000400:00000200:17.0:1773851877.566073:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24368@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.566077:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24368@kfi7(24368@kfi7:24368@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851877.566079:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b14adeb9 nid 24368@kfi7 refs 3
00000800:00000200:17.0:1773851877.566081:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.566083:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851877.566086:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851877.566090:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b31 Using peer 24368@kfi7(0x100000000000b31)
00000800:00000200:17.0:1773851877.566094:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x100000000000b31: rc=0
00000800:00000200:17.0:1773851877.566096:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b31 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851877.566099:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.566100:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001093b077 refcount 2 to 24561@kfi7
00010000:00000001:17.0:1773851877.566100:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851877.566101:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.566102:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851877.566103:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000092591488 x1859598869823232/t0(0) o400->224daa91-2a4c-4fdf-8350-a044041101c1@24561@kfi7:98/0 lens 224/224 e 0 to 0 dl 1773852213 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2013-0'
00000100:00100000:17.0:1773851877.566106:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000092591488 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:224daa91-2a4c-4fdf-8350-a044041101c1+5:39726:x1859598869823232:12345-24561@kfi7:400:default-tuolumne2013-0 Request processed in 100us (159us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851877.566109:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24561@kfi7, seq: 2156366
00000100:00000040:17.0:1773851877.566110:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000346e41ae : new rpc_count 0
00000800:00000200:19.0:1773851877.566111:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b31 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851877.566111:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851877.566111:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851877.566112:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:19.0:1773851877.566113:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851877.566113:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:19.0:1773851877.566114:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24368@kfi7: PUT: OK
00000020:00000010:17.0:1773851877.566114:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004c935461.
00000400:00000200:19.0:1773851877.566115:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df4ad511
00000400:00000010:19.0:1773851877.566115:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df4ad511.
00000020:00000040:17.0:1773851877.566115:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000346e41ae : new refcount 4
00000100:00000001:19.0:1773851877.566116:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851877.566116:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851877.566116:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851877.566117:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b14adeb9 nid 24368@kfi7 refs 2
00000800:00000200:19.0:1773851877.566119:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 24368@kfi7(00000000070c734c):0x0 lsk 2866 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b31 Transaction freed
00000800:00000200:13.0:1773851877.572115:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851877.572116:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851877.572119:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851877.572122:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851877.572126:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23504@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.572129:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23504@kfi7 : PUT - for me
00000400:00000200:13.0:1773851877.572131:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23504@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.572132:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fbb297f0 nid 23504@kfi7 refs 1
00000400:00000200:13.0:1773851877.572134:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23504@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.572135:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fbb297f0 nid 23504@kfi7 refs 2
00000400:00000200:13.0:1773851877.572137:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fbb297f0 nid 23504@kfi7 refs 3
00000400:00000200:13.0:1773851877.572139:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23504@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.572141:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23504@kfi7 of length 224 into portal 12 MB=0x699e0ab4abf80
00000400:00000200:13.0:1773851877.572143:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23504@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 38640
00000800:00000200:13.0:1773851877.572146:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851877.572150:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851877.572153:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23504@kfi7: PUT: OK
00000100:00000001:13.0:1773851877.572154:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851877.572155:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851877.572157:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005fb3b212.
00000100:00000040:13.0:1773851877.572158:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005fb3b212 x1858040085790592 msgsize 224
00000100:00100000:13.0:1773851877.572160:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-23504@kfi7 (source: 12345-23504@kfi7)
00000100:00000001:13.0:1773851877.572162:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851877.572164:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fbb297f0 nid 23504@kfi7 refs 2
00000100:00000001:15.0:1773851877.572165:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851877.572166:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851877.572166:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851877.572167:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851877.572168:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851877.572169:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851877.572170:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040085790592
00000020:00000001:15.0:1773851877.572171:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851877.572171:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b97
00000020:00000001:15.0:1773851877.572172:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851877.572178:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000888a75d6 refcount=6
00000020:00000001:15.0:1773851877.572179:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743692288 : -107128965859328 : ffff9e91180b7800)
00000020:00000001:15.0:1773851877.572180:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743692288 : -107128965859328 : ffff9e91180b7800)
00000100:00000001:15.0:1773851877.572181:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.572182:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851877.572183:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d450e38c.
00000020:00000010:15.0:1773851877.572184:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851877.572185:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851877.572187:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851877.572187:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851877.572188:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.572189:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851877.572190:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851877.572190:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.572191:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.572193:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851877.572193:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851877.572193:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851877.572194:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851877.572195:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23504@kfi7, seq: 2289869
00000100:00000040:15.0:1773851877.572196:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000888a75d6 : new rpc_count 1
00000100:00000001:12.0:1773851877.572196:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.572197:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902247936 : -106994807303680 : ffff9eb054849200)
00000100:00000001:12.0:1773851877.572197:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.572198:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005fb3b212 x1858040085790592/t0(0) o400->f478a28f-4d46-40a0-912d-ef3ca68daef5@23504@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1953-0'
00000100:00000001:15.0:1773851877.572201:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.572202:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851877.572203:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005fb3b212 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f478a28f-4d46-40a0-912d-ef3ca68daef5+6:39805:x1858040085790592:12345-23504@kfi7:400:default-tuolumne1953-0
00000100:00000200:15.0:1773851877.572204:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040085790592
00000020:00000001:15.0:1773851877.572205:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851877.572206:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851877.572206:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.572207:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851877.572208:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851877.572209:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851877.572210:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040085790592, found 0 last_xid 1858040085790591
00000020:00000001:15.0:1773851877.572210:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851877.572211:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851877.572212:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851877.572213:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.572213:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851877.572214:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851877.572215:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851877.572215:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001dc253b5.
02000000:00000001:15.0:1773851877.572216:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.572216:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.572217:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851877.572218:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254004600, transno 0, xid 1858040085790592
00010000:00000001:15.0:1773851877.572219:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851877.572219:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005fb3b212 x1858040085790592/t0(0) o400->f478a28f-4d46-40a0-912d-ef3ca68daef5@23504@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1953-0'
00010000:00000001:15.0:1773851877.572222:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851877.572222:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851877.572224:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=110 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851877.572225:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851877.572225:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f2d1fa12 refcount 3 to 23504@kfi7
00000100:00000001:15.0:1773851877.572226:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151936 : -107154898399680 : ffff9e8b0e584e40)
02000000:00000001:15.0:1773851877.572227:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851877.572228:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.572228:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851877.572229:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23504@kfi7
00000400:00000010:15.0:1773851877.572230:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000723f04f5.
00000100:00000200:15.0:1773851877.572231:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040085790592, offset 224
00000400:00000200:15.0:1773851877.572233:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23504@kfi7
00000400:00000200:15.0:1773851877.572234:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23504@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.572234:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fbb297f0 nid 23504@kfi7 refs 1
00000400:00000200:15.0:1773851877.572236:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fbb297f0 nid 23504@kfi7 refs 2
00000400:00000200:15.0:1773851877.572237:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fbb297f0 nid 23504@kfi7 refs 3
00000400:00000200:15.0:1773851877.572238:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23504@kfi7 local destination
00000400:00000200:15.0:1773851877.572239:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769571:8769571:1024:4294967295] 23504@kfi7 LPNI seq info [836657:836657:16:4294967295]
00000400:00000200:15.0:1773851877.572241:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fbb297f0 nid 23504@kfi7 refs 2
00000400:00000200:15.0:1773851877.572241:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23504@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.572243:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23504@kfi7(23504@kfi7:23504@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851877.572244:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fbb297f0 nid 23504@kfi7 refs 3
00000800:00000200:15.0:1773851877.572246:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851877.572247:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851877.572249:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851877.572252:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x380 Using peer 23504@kfi7(0x380)
00000800:00000200:15.0:1773851877.572255:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x380: rc=0
00000800:00000200:15.0:1773851877.572257:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x380 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851877.572260:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.572261:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f2d1fa12 refcount 2 to 23504@kfi7
00010000:00000001:15.0:1773851877.572262:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851877.572263:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.572263:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851877.572264:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005fb3b212 x1858040085790592/t0(0) o400->f478a28f-4d46-40a0-912d-ef3ca68daef5@23504@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1953-0'
00000100:00100000:15.0:1773851877.572267:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005fb3b212 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f478a28f-4d46-40a0-912d-ef3ca68daef5+6:39805:x1858040085790592:12345-23504@kfi7:400:default-tuolumne1953-0 Request processed in 65us (108us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851877.572269:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x380 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851877.572270:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23504@kfi7, seq: 2289869
00000400:00000200:13.0:1773851877.572270:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:15.0:1773851877.572271:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000888a75d6 : new rpc_count 0
00000400:00000200:13.0:1773851877.572271:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23504@kfi7: PUT: OK
00000100:00000001:15.0:1773851877.572272:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851877.572272:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851877.572272:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000723f04f5
00000020:00000010:15.0:1773851877.572273:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000010:13.0:1773851877.572273:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000723f04f5.
00000100:00000001:13.0:1773851877.572273:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851877.572274:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000100:00000001:13.0:1773851877.572274:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851877.572275:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d450e38c.
00000020:00000040:15.0:1773851877.572275:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000888a75d6 : new refcount 5
00000400:00000200:13.0:1773851877.572275:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fbb297f0 nid 23504@kfi7 refs 2
00000100:00000001:15.0:1773851877.572276:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851877.572276:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 23504@kfi7(0000000014f23c30):0x0 lsk 897 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x380 Transaction freed
00000800:00000200:1.0:1773851877.589280:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851877.589281:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851877.589284:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851877.589288:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851877.589292:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8258@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.589294:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8258@kfi7 : PUT - for me
00000400:00000200:1.0:1773851877.589295:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8258@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.589297:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3d521da nid 8258@kfi7 refs 1
00000400:00000200:1.0:1773851877.589299:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8258@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.589300:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3d521da nid 8258@kfi7 refs 2
00000400:00000200:1.0:1773851877.589302:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b3d521da nid 8258@kfi7 refs 3
00000400:00000200:1.0:1773851877.589303:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8258@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.589305:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8258@kfi7 of length 224 into portal 12 MB=0x69b2fdff32840
00000400:00000200:1.0:1773851877.589308:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8258@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 37136
00000800:00000200:1.0:1773851877.589312:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851877.589315:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.589316:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8258@kfi7: PUT: OK
00000100:00000001:1.0:1773851877.589318:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851877.589319:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851877.589320:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001640dc34.
00000100:00000040:1.0:1773851877.589322:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000001640dc34 x1859479783286848 msgsize 224
00000100:00100000:1.0:1773851877.589324:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8258@kfi7 (source: 12345-8258@kfi7)
00000100:00000001:1.0:1773851877.589326:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851877.589328:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b3d521da nid 8258@kfi7 refs 2
00000100:00000001:0.0:1773851877.589329:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851877.589329:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851877.589330:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851877.589330:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851877.589331:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851877.589333:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851877.589334:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479783286848
00000020:00000001:0.0:1773851877.589335:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851877.589336:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2cd06
00000020:00000001:0.0:1773851877.589337:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851877.589340:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001e1db872 refcount=8
00000020:00000001:0.0:1773851877.589341:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104005366784 : -106969704184832 : ffff9eb62cc7c400)
00000020:00000001:0.0:1773851877.589343:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637104005366784 : -106969704184832 : ffff9eb62cc7c400)
00000100:00000001:0.0:1773851877.589345:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.589346:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851877.589347:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851877.589349:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.589350:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851877.589352:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851877.589353:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851877.589354:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851877.589356:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851877.589358:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851877.589358:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.589360:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851877.589362:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851877.589363:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851877.589363:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851877.589364:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851877.589365:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8258@kfi7, seq: 1997580
00000100:00000001:1.0:1773851877.589367:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851877.589367:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001e1db872 : new rpc_count 1
00000100:00000001:1.0:1773851877.589368:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.589368:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599723776 : -107004109827840 : ffff9eae2a0b5100)
00000100:00000040:0.0:1773851877.589370:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001640dc34 x1859479783286848/t0(0) o400->f490f017-596b-44b1-81a5-2b0540fbfdf4@8258@kfi7:517/0 lens 224/0 e 0 to 0 dl 1773852632 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1016-0'
00000100:00000001:0.0:1773851877.589376:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.589376:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851877.589378:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001640dc34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f490f017-596b-44b1-81a5-2b0540fbfdf4+8:40128:x1859479783286848:12345-8258@kfi7:400:default-tuolumne1016-0
00000100:00000200:0.0:1773851877.589381:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479783286848
00000020:00000001:0.0:1773851877.589382:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851877.589383:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851877.589384:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.589386:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851877.589386:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851877.589388:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851877.589389:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479783286848, found 0 last_xid 1859479783286847
00000020:00000001:0.0:1773851877.589390:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851877.589391:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851877.589392:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851877.589393:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.589394:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851877.589395:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851877.589396:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851877.589398:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000030135ad.
02000000:00000001:0.0:1773851877.589399:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.589400:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.589401:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851877.589402:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252789513, transno 0, xid 1859479783286848
00010000:00000001:0.0:1773851877.589404:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851877.589405:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001640dc34 x1859479783286848/t0(0) o400->f490f017-596b-44b1-81a5-2b0540fbfdf4@8258@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1016-0'
00010000:00000001:0.0:1773851877.589409:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851877.589410:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851877.589412:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=110 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851877.589414:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851877.589415:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cf367e69 refcount 3 to 8258@kfi7
00000100:00000001:0.0:1773851877.589416:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636962368739968 : -107111340811648 : ffff9e9532945a80)
02000000:00000001:0.0:1773851877.589417:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851877.589418:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.589419:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851877.589420:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8258@kfi7
00000400:00000010:0.0:1773851877.589421:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a92b0d66.
00000100:00000200:0.0:1773851877.589423:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859479783286848, offset 224
00000400:00000200:0.0:1773851877.589426:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8258@kfi7
00000400:00000200:0.0:1773851877.589428:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8258@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.589429:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3d521da nid 8258@kfi7 refs 1
00000400:00000200:0.0:1773851877.589431:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b3d521da nid 8258@kfi7 refs 2
00000400:00000200:0.0:1773851877.589433:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b3d521da nid 8258@kfi7 refs 3
00000400:00000200:0.0:1773851877.589435:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8258@kfi7 local destination
00000400:00000200:0.0:1773851877.589438:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769572:8769572:1024:4294967295] 8258@kfi7 LPNI seq info [2463345:2463345:16:4294967295]
00000400:00000200:0.0:1773851877.589440:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b3d521da nid 8258@kfi7 refs 2
00000400:00000200:0.0:1773851877.589441:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8258@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.589445:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8258@kfi7(8258@kfi7:8258@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851877.589447:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b3d521da nid 8258@kfi7 refs 3
00000800:00000200:0.0:1773851877.589450:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851877.589452:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851877.589456:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851877.589460:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1260 Using peer 8258@kfi7(0x1260)
00000800:00000200:0.0:1773851877.589466:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x1260: rc=0
00000800:00000200:0.0:1773851877.589468:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1260 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851877.589471:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851877.589473:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cf367e69 refcount 2 to 8258@kfi7
00010000:00000001:0.0:1773851877.589474:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851877.589475:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.589478:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851877.589479:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001640dc34 x1859479783286848/t0(0) o400->f490f017-596b-44b1-81a5-2b0540fbfdf4@8258@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1016-0'
00000100:00100000:0.0:1773851877.589485:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001640dc34 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f490f017-596b-44b1-81a5-2b0540fbfdf4+8:40128:x1859479783286848:12345-8258@kfi7:400:default-tuolumne1016-0 Request processed in 108us (162us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851877.589489:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8258@kfi7, seq: 1997580
00000100:00000040:0.0:1773851877.589490:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001e1db872 : new rpc_count 0
00000100:00000001:0.0:1773851877.589491:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851877.589492:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851877.589493:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.589494:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851877.589496:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000020:00000040:0.0:1773851877.589497:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000001e1db872 : new refcount 7
00000100:00000001:0.0:1773851877.589498:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851877.589507:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1260 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851877.589510:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.589511:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8258@kfi7: PUT: OK
00000400:00000200:1.0:1773851877.589513:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a92b0d66
00000400:00000010:1.0:1773851877.589514:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a92b0d66.
00000100:00000001:1.0:1773851877.589515:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851877.589516:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851877.589518:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b3d521da nid 8258@kfi7 refs 2
00000800:00000200:1.0:1773851877.589520:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8258@kfi7(000000007141cab4):0x0 lsk 4705 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1260 Transaction freed
00000800:00000200:19.0:1773851877.604445:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851877.604445:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:19.0:1773851877.604447:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:19.0:1773851877.604449:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:19.0:1773851877.604453:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14273@kfi7 to cpt 4
00000400:00000200:19.0:1773851877.604454:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14273@kfi7 : PUT - for me
00000400:00000200:19.0:1773851877.604455:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14273@kfi7 to cpt 4
00000400:00000200:19.0:1773851877.604456:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b407f0cc nid 14273@kfi7 refs 1
00000400:00000200:19.0:1773851877.604457:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14273@kfi7 to cpt 4
00000400:00000200:19.0:1773851877.604457:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b407f0cc nid 14273@kfi7 refs 2
00000400:00000200:19.0:1773851877.604458:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b407f0cc nid 14273@kfi7 refs 3
00000400:00000200:19.0:1773851877.604459:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14272@kfi7 to cpt 1
00000400:00000200:19.0:1773851877.604460:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14272@kfi7 of length 224 into portal 12 MB=0x699e10a638440
00000400:00000200:19.0:1773851877.604461:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14272@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 26448
00000800:00000200:19.0:1773851877.604463:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851877.604465:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851877.604466:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14273@kfi7: PUT: OK
00000100:00000001:19.0:1773851877.604467:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851877.604467:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851877.604468:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fd3822b2.
00000100:00000040:19.0:1773851877.604469:0:2464491:0:(events.c:358:request_in_callback()) incoming req@00000000fd3822b2 x1858041681249344 msgsize 224
00000100:00100000:19.0:1773851877.604470:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-14272@kfi7 (source: 12345-14273@kfi7)
00000100:00000001:19.0:1773851877.604471:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851877.604472:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b407f0cc nid 14273@kfi7 refs 2
00000800:00000200:19.0:1773851877.604473:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851877.604474:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851877.604475:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851877.604475:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851877.604476:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851877.604477:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851877.604479:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041681249344
00000020:00000001:17.0:1773851877.604480:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851877.604480:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91cef
00000020:00000001:17.0:1773851877.604481:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851877.604483:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007e577daa refcount=6
00000020:00000001:17.0:1773851877.604484:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628516864 : -107123081034752 : ffff9e9276cec400)
00000020:00000001:17.0:1773851877.604486:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628516864 : -107123081034752 : ffff9e9276cec400)
00000100:00000001:17.0:1773851877.604487:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.604488:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851877.604489:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b96cd922.
00000020:00000010:17.0:1773851877.604491:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.604492:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851877.604494:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851877.604494:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851877.604495:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.604497:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851877.604497:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851877.604498:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.604500:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.604502:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851877.604502:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851877.604503:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851877.604503:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851877.604504:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14272@kfi7, seq: 2156367
00000100:00000040:17.0:1773851877.604506:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007e577daa : new rpc_count 1
00000100:00000001:16.0:1773851877.604506:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.604507:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339140992 : -106987370410624 : ffff9eb20fca8d80)
00000100:00000001:16.0:1773851877.604507:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.604509:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fd3822b2 x1858041681249344/t0(0) o400->1f55680c-134e-4f21-bd7d-8b0ac1c4e015@14272@kfi7:98/0 lens 224/0 e 0 to 0 dl 1773852213 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1379-0'
00000100:00000001:17.0:1773851877.604514:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.604515:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851877.604517:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd3822b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1f55680c-134e-4f21-bd7d-8b0ac1c4e015+6:39823:x1858041681249344:12345-14272@kfi7:400:default-tuolumne1379-0
00000100:00000200:17.0:1773851877.604519:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041681249344
00000020:00000001:17.0:1773851877.604520:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851877.604521:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851877.604522:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.604523:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851877.604524:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851877.604525:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851877.604526:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041681249344, found 0 last_xid 1858041681249343
00000020:00000001:17.0:1773851877.604527:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851877.604528:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851877.604529:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851877.604530:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.604531:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851877.604532:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851877.604533:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851877.604534:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004c935461.
02000000:00000001:17.0:1773851877.604535:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.604536:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.604537:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851877.604538:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035363680, transno 0, xid 1858041681249344
00010000:00000001:17.0:1773851877.604539:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851877.604540:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fd3822b2 x1858041681249344/t0(0) o400->1f55680c-134e-4f21-bd7d-8b0ac1c4e015@14272@kfi7:98/0 lens 224/224 e 0 to 0 dl 1773852213 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1379-0'
00010000:00000001:17.0:1773851877.604545:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851877.604546:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851877.604547:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=110 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851877.604548:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851877.604549:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000e7cf771 refcount 3 to 14272@kfi7
00000100:00000001:17.0:1773851877.604551:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919543838880 : -107154165712736 : ffff9e8b3a0438a0)
02000000:00000001:17.0:1773851877.604552:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851877.604553:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.604554:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851877.604556:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14273@kfi7
00000400:00000010:17.0:1773851877.604557:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c441fca1.
00000100:00000200:17.0:1773851877.604558:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041681249344, offset 224
00000400:00000200:17.0:1773851877.604561:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14273@kfi7
00000400:00000200:17.0:1773851877.604562:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14273@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.604563:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b407f0cc nid 14273@kfi7 refs 1
00000400:00000200:17.0:1773851877.604565:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b407f0cc nid 14273@kfi7 refs 2
00000400:00000200:17.0:1773851877.604567:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b407f0cc nid 14273@kfi7 refs 3
00000400:00000200:17.0:1773851877.604569:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14273@kfi7 local destination
00000400:00000200:17.0:1773851877.604571:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769573:8769573:1024:4294967295] 14273@kfi7 LPNI seq info [529518:529518:16:4294967295]
00000400:00000200:17.0:1773851877.604573:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b407f0cc nid 14273@kfi7 refs 2
00000400:00000200:17.0:1773851877.604574:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14273@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.604578:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14273@kfi7(14273@kfi7:14273@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851877.604580:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b407f0cc nid 14273@kfi7 refs 3
00000800:00000200:17.0:1773851877.604582:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.604584:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851877.604588:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851877.604591:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1123 Using peer 14273@kfi7(0x1123)
00000800:00000200:17.0:1773851877.604596:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x1123: rc=0
00000800:00000200:17.0:1773851877.604598:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1123 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851877.604602:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.604603:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000e7cf771 refcount 2 to 14272@kfi7
00010000:00000001:17.0:1773851877.604604:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851877.604605:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.604606:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851877.604607:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fd3822b2 x1858041681249344/t0(0) o400->1f55680c-134e-4f21-bd7d-8b0ac1c4e015@14272@kfi7:98/0 lens 224/224 e 0 to 0 dl 1773852213 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1379-0'
00000800:00000200:19.0:1773851877.604612:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1123 TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851877.604614:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851877.604615:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14273@kfi7: PUT: OK
00000400:00000200:19.0:1773851877.604616:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c441fca1
00000400:00000010:19.0:1773851877.604616:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c441fca1.
00000100:00000001:19.0:1773851877.604617:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851877.604617:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851877.604618:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b407f0cc nid 14273@kfi7 refs 2
00000100:00100000:17.0:1773851877.604618:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd3822b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1f55680c-134e-4f21-bd7d-8b0ac1c4e015+6:39823:x1858041681249344:12345-14272@kfi7:400:default-tuolumne1379-0 Request processed in 103us (148us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851877.604620:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 14273@kfi7(00000000c054edba):0x0 lsk 4388 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1123 Transaction freed
00000100:00100000:17.0:1773851877.604622:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14272@kfi7, seq: 2156367
00000100:00000040:17.0:1773851877.604623:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007e577daa : new rpc_count 0
00000100:00000001:17.0:1773851877.604624:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851877.604625:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851877.604626:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.604627:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851877.604629:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b96cd922.
00000020:00000040:17.0:1773851877.604630:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007e577daa : new refcount 5
00000100:00000001:17.0:1773851877.604631:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851877.613274:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.613274:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851877.613276:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851877.613278:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851877.613280:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10016@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.613281:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10016@kfi7 : PUT - for me
00000400:00000200:17.0:1773851877.613282:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10016@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.613283:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf598d4 nid 10016@kfi7 refs 1
00000400:00000200:17.0:1773851877.613284:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10016@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.613285:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf598d4 nid 10016@kfi7 refs 2
00000400:00000200:17.0:1773851877.613286:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dcf598d4 nid 10016@kfi7 refs 3
00000400:00000200:17.0:1773851877.613287:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10016@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.613287:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10016@kfi7 of length 224 into portal 12 MB=0x699e138afd900
00000400:00000200:17.0:1773851877.613288:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10016@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 26672
00000800:00000200:17.0:1773851877.613290:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851877.613291:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851877.613293:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10016@kfi7: PUT: OK
00000100:00000001:17.0:1773851877.613294:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851877.613294:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851877.613295:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a012a84a.
00000100:00000040:17.0:1773851877.613296:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a012a84a x1858042458003712 msgsize 224
00000100:00100000:17.0:1773851877.613297:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-10016@kfi7 (source: 12345-10016@kfi7)
00000100:00000001:17.0:1773851877.613298:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851877.613299:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf598d4 nid 10016@kfi7 refs 2
00000800:00000200:17.0:1773851877.613300:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851877.613302:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851877.613303:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851877.613303:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851877.613303:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851877.613304:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851877.613304:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042458003712
00000020:00000001:17.0:1773851877.613305:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851877.613305:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ee8
00000020:00000001:17.0:1773851877.613306:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851877.613309:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000320eb160 refcount=6
00000020:00000001:17.0:1773851877.613310:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239888896 : -107152469662720 : ffff9e8b9f1be400)
00000020:00000001:17.0:1773851877.613311:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239888896 : -107152469662720 : ffff9e8b9f1be400)
00000100:00000001:17.0:1773851877.613312:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.613313:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851877.613313:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b96cd922.
00000020:00000010:17.0:1773851877.613314:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.613314:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851877.613315:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851877.613315:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851877.613316:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.613317:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851877.613317:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851877.613317:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.613318:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851877.613319:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851877.613319:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851877.613320:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851877.613320:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851877.613321:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10016@kfi7, seq: 2156368
00000100:00000040:17.0:1773851877.613321:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000320eb160 : new rpc_count 1
00000100:00000001:16.0:1773851877.613321:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.613322:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144552177664 : -106929157373952 : ffff9ebf9d8f0000)
00000100:00000001:16.0:1773851877.613322:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.613323:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a012a84a x1858042458003712/t0(0) o400->e7596c47-6096-45a6-92d7-5d3ede154b60@10016@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1119-0'
00000100:00000001:17.0:1773851877.613326:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851877.613326:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851877.613327:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a012a84a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e7596c47-6096-45a6-92d7-5d3ede154b60+6:39672:x1858042458003712:12345-10016@kfi7:400:default-tuolumne1119-0
00000100:00000200:17.0:1773851877.613328:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042458003712
00000020:00000001:17.0:1773851877.613329:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851877.613329:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851877.613330:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.613330:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851877.613331:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851877.613331:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851877.613332:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042458003712, found 0 last_xid 1858042458003711
00000020:00000001:17.0:1773851877.613333:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851877.613333:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851877.613334:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851877.613334:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.613335:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851877.613335:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851877.613336:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851877.613336:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002eef95bb.
02000000:00000001:17.0:1773851877.613337:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.613338:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.613338:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851877.613339:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183025249822, transno 0, xid 1858042458003712
00010000:00000001:17.0:1773851877.613339:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851877.613340:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a012a84a x1858042458003712/t0(0) o400->e7596c47-6096-45a6-92d7-5d3ede154b60@10016@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1119-0'
00010000:00000001:17.0:1773851877.613343:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851877.613344:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851877.613344:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=110 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851877.613345:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851877.613346:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b70313fc refcount 3 to 10016@kfi7
00000100:00000001:17.0:1773851877.613346:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992512 : -107142345559104 : ffff9e8dfa8d73c0)
02000000:00000001:17.0:1773851877.613347:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851877.613347:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851877.613348:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851877.613349:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10016@kfi7
00000400:00000010:17.0:1773851877.613349:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c4dc638.
00000100:00000200:17.0:1773851877.613350:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042458003712, offset 224
00000400:00000200:17.0:1773851877.613351:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10016@kfi7
00000400:00000200:17.0:1773851877.613352:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10016@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.613352:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf598d4 nid 10016@kfi7 refs 1
00000400:00000200:17.0:1773851877.613353:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dcf598d4 nid 10016@kfi7 refs 2
00000400:00000200:17.0:1773851877.613355:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dcf598d4 nid 10016@kfi7 refs 3
00000400:00000200:17.0:1773851877.613356:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10016@kfi7 local destination
00000400:00000200:17.0:1773851877.613357:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769574:8769574:1024:4294967295] 10016@kfi7 LPNI seq info [1573326:1573326:16:4294967295]
00000400:00000200:17.0:1773851877.613358:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dcf598d4 nid 10016@kfi7 refs 2
00000400:00000200:17.0:1773851877.613359:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10016@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.613361:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10016@kfi7(10016@kfi7:10016@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851877.613362:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dcf598d4 nid 10016@kfi7 refs 3
00000800:00000200:17.0:1773851877.613363:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.613363:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851877.613365:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851877.613367:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000825 Using peer 10016@kfi7(0x100000000000825)
00000800:00000200:17.0:1773851877.613370:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x100000000000825: rc=0
00000800:00000200:17.0:1773851877.613371:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000825 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851877.613374:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851877.613375:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b70313fc refcount 2 to 10016@kfi7
00010000:00000001:17.0:1773851877.613375:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851877.613376:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851877.613376:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851877.613377:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a012a84a x1858042458003712/t0(0) o400->e7596c47-6096-45a6-92d7-5d3ede154b60@10016@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1119-0'
00000100:00100000:17.0:1773851877.613380:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a012a84a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e7596c47-6096-45a6-92d7-5d3ede154b60+6:39672:x1858042458003712:12345-10016@kfi7:400:default-tuolumne1119-0 Request processed in 53us (83us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851877.613382:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10016@kfi7, seq: 2156368
00000100:00000040:17.0:1773851877.613383:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000320eb160 : new rpc_count 0
00000100:00000001:17.0:1773851877.613383:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:19.0:1773851877.613384:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000825 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851877.613384:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851877.613384:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851877.613384:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851877.613385:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b96cd922.
00000400:00000200:19.0:1773851877.613386:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851877.613386:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000320eb160 : new refcount 5
00000100:00000001:17.0:1773851877.613386:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851877.613387:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10016@kfi7: PUT: OK
00000400:00000200:19.0:1773851877.613387:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c4dc638
00000400:00000010:19.0:1773851877.613388:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c4dc638.
00000100:00000001:19.0:1773851877.613388:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851877.613389:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851877.613389:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf598d4 nid 10016@kfi7 refs 2
00000800:00000200:19.0:1773851877.613390:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 10016@kfi7(000000009b84418b):0x0 lsk 2086 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000825 Transaction freed
00000800:00000200:5.0:1773851877.651910:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851877.651911:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851877.651912:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851877.651914:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851877.651916:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.651917:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26362@kfi7 : PUT - for me
00000400:00000200:5.0:1773851877.651918:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.651919:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 1
00000400:00000200:5.0:1773851877.651920:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.651920:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000400:00000200:5.0:1773851877.651921:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 3
00000400:00000200:5.0:1773851877.651922:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.651923:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26362@kfi7 of length 224 into portal 12 MB=0x699de5a339980
00000400:00000200:5.0:1773851877.651924:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26362@kfi7 of length 224/224 into md 0x793926dc5 [64] + 149848
00000800:00000200:5.0:1773851877.651926:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851877.651927:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851877.651928:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26362@kfi7: PUT: OK
00000100:00000001:5.0:1773851877.651929:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851877.651929:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851877.651930:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a916e2d2.
00000100:00000040:5.0:1773851877.651931:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a916e2d2 x1858030135384448 msgsize 224
00000100:00100000:5.0:1773851877.651932:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26362@kfi7 (source: 12345-26362@kfi7)
00000100:00000001:5.0:1773851877.651933:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851877.651934:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000100:00000001:7.0:1773851877.651935:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851877.651935:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851877.651935:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851877.651936:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851877.651936:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851877.651937:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851877.651938:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030135384448
00000020:00000001:7.0:1773851877.651938:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851877.651939:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9117a
00000020:00000001:7.0:1773851877.651940:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851877.651942:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000091a90fbe refcount=6
00000020:00000001:7.0:1773851877.651942:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240526848 : -107152469024768 : ffff9e8b9f25a000)
00000020:00000001:7.0:1773851877.651943:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240526848 : -107152469024768 : ffff9e8b9f25a000)
00000100:00000001:7.0:1773851877.651944:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.651945:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851877.651946:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851877.651947:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851877.651947:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851877.651948:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851877.651949:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851877.651949:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.651950:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851877.651951:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851877.651951:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.651952:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.651953:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851877.651953:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851877.651954:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851877.651954:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851877.651955:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26362@kfi7, seq: 2001940
00000100:00000040:7.0:1773851877.651955:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000091a90fbe : new rpc_count 1
00000100:00000001:4.0:1773851877.651955:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.651956:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273382400 : -107034436169216 : ffff9ea71a741200)
00000100:00000001:4.0:1773851877.651956:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.651957:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a916e2d2 x1858030135384448/t0(0) o400->d5021920-3e19-48d8-99d7-83ba8437beb8@26362@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne271-0'
00000100:00000001:7.0:1773851877.651960:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.651960:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851877.651961:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a916e2d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d5021920-3e19-48d8-99d7-83ba8437beb8+6:47820:x1858030135384448:12345-26362@kfi7:400:default-tuolumne271-0
00000100:00000200:7.0:1773851877.651962:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030135384448
00000020:00000001:7.0:1773851877.651963:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851877.651964:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851877.651964:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.651965:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851877.651966:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851877.651967:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851877.651967:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030135384448, found 0 last_xid 1858030135384447
00000020:00000001:7.0:1773851877.651968:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851877.651969:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851877.651969:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851877.651970:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.651970:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851877.651971:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851877.651971:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851877.651973:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000003d798d0.
02000000:00000001:7.0:1773851877.651973:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.651974:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.651975:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851877.651975:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030135384448
00010000:00000001:7.0:1773851877.651976:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851877.651977:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a916e2d2 x1858030135384448/t0(0) o400->d5021920-3e19-48d8-99d7-83ba8437beb8@26362@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne271-0'
00010000:00000001:7.0:1773851877.651979:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851877.651980:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851877.651980:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=109 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851877.651981:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851877.651982:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a7df6c44 refcount 5 to 26362@kfi7
00000100:00000001:7.0:1773851877.651983:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231608032 : -107130477943584 : ffff9e90bdeae4e0)
02000000:00000001:7.0:1773851877.651984:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851877.651984:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.651985:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851877.651986:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26362@kfi7
00000400:00000010:7.0:1773851877.651986:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000100:00000200:7.0:1773851877.651988:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030135384448, offset 224
00000400:00000200:7.0:1773851877.651989:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26362@kfi7
00000400:00000200:7.0:1773851877.651990:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.651990:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 1
00000400:00000200:7.0:1773851877.651991:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000400:00000200:7.0:1773851877.651992:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 3
00000400:00000200:7.0:1773851877.651994:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26362@kfi7 local destination
00000400:00000200:7.0:1773851877.651996:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769575:8769575:1024:4294967295] 26362@kfi7 LPNI seq info [28179:28179:16:4294967295]
00000400:00000200:7.0:1773851877.651997:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000400:00000200:7.0:1773851877.651998:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.652000:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26362@kfi7(26362@kfi7:26362@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851877.652001:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 3
00000800:00000200:7.0:1773851877.652002:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851877.652003:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851877.652005:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851877.652007:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000209 Using peer 26362@kfi7(0x100000000000209)
00000800:00000200:7.0:1773851877.652010:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x100000000000209: rc=0
00000800:00000200:7.0:1773851877.652012:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000209 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851877.652014:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.652015:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a7df6c44 refcount 4 to 26362@kfi7
00010000:00000001:7.0:1773851877.652015:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851877.652016:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.652017:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851877.652017:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a916e2d2 x1858030135384448/t0(0) o400->d5021920-3e19-48d8-99d7-83ba8437beb8@26362@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne271-0'
00000100:00100000:7.0:1773851877.652020:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a916e2d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d5021920-3e19-48d8-99d7-83ba8437beb8+6:47820:x1858030135384448:12345-26362@kfi7:400:default-tuolumne271-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851877.652023:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26362@kfi7, seq: 2001940
00000100:00000040:7.0:1773851877.652024:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000091a90fbe : new rpc_count 0
00000800:00000200:5.0:1773851877.652024:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000209 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851877.652025:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851877.652025:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851877.652027:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851877.652028:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851877.652028:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:5.0:1773851877.652028:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26362@kfi7: PUT: OK
00000020:00000010:7.0:1773851877.652029:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000400:00000200:5.0:1773851877.652029:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000400:00000010:5.0:1773851877.652029:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:5.0:1773851877.652030:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851877.652030:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:7.0:1773851877.652031:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000091a90fbe : new refcount 5
00000100:00000001:7.0:1773851877.652031:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851877.652031:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000800:00000200:5.0:1773851877.652033:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 26362@kfi7(0000000060954945):0x0 lsk 522 rsk 90 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000209 Transaction freed
00000800:00000200:9.0:1773851877.654071:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851877.654072:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851877.654073:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851877.654074:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851877.654076:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10594@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.654077:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10594@kfi7 : PUT - for me
00000400:00000200:9.0:1773851877.654078:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10594@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.654079:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfd9b897 nid 10594@kfi7 refs 1
00000400:00000200:9.0:1773851877.654080:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10594@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.654080:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfd9b897 nid 10594@kfi7 refs 2
00000400:00000200:9.0:1773851877.654081:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfd9b897 nid 10594@kfi7 refs 3
00000400:00000200:9.0:1773851877.654082:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10595@kfi7 to cpt 5
00000400:00000200:9.0:1773851877.654083:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10595@kfi7 of length 224 into portal 12 MB=0x699e1aca16a00
00000400:00000200:9.0:1773851877.654084:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10595@kfi7 of length 224/224 into md 0x78146ce49 [64] + 144408
00000800:00000200:9.0:1773851877.654085:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851877.654087:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851877.654088:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10594@kfi7: PUT: OK
00000100:00000001:9.0:1773851877.654088:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851877.654089:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851877.654090:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cd7d2931.
00000100:00000040:9.0:1773851877.654090:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000cd7d2931 x1858044403214848 msgsize 224
00000100:00100000:9.0:1773851877.654091:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10595@kfi7 (source: 12345-10594@kfi7)
00000100:00000001:9.0:1773851877.654092:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851877.654093:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfd9b897 nid 10594@kfi7 refs 2
00000100:00000001:8.0:1773851877.654094:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851877.654094:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851877.654094:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851877.654095:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851877.654095:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851877.654096:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851877.654096:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044403214848
00000020:00000001:8.0:1773851877.654097:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851877.654097:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916e4
00000020:00000001:8.0:1773851877.654098:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851877.654100:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006465974f refcount=6
00000020:00000001:8.0:1773851877.654101:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241479168 : -107152468072448 : ffff9e8b9f342800)
00000020:00000001:8.0:1773851877.654102:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241479168 : -107152468072448 : ffff9e8b9f342800)
00000100:00000001:8.0:1773851877.654103:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851877.654104:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851877.654104:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002eec3ec2.
00000020:00000010:8.0:1773851877.654105:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851877.654106:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851877.654107:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851877.654107:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851877.654107:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.654108:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851877.654109:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851877.654109:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.654110:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851877.654111:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851877.654111:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851877.654111:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851877.654112:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851877.654112:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10595@kfi7, seq: 2130808
00000100:00000001:11.0:1773851877.654113:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851877.654113:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006465974f : new rpc_count 1
00000100:00000001:11.0:1773851877.654114:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.654114:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096246272 : -107006613305344 : ffff9ead94d34800)
00000100:00000040:8.0:1773851877.654115:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cd7d2931 x1858044403214848/t0(0) o400->8304e057-8618-410b-9db2-df781b4765da@10595@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1148-0'
00000100:00000001:8.0:1773851877.654117:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851877.654118:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851877.654119:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd7d2931 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8304e057-8618-410b-9db2-df781b4765da+6:39652:x1858044403214848:12345-10595@kfi7:400:default-tuolumne1148-0
00000100:00000200:8.0:1773851877.654120:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044403214848
00000020:00000001:8.0:1773851877.654120:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851877.654121:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851877.654122:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.654123:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851877.654123:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851877.654124:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851877.654125:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044403214848, found 0 last_xid 1858044403214847
00000020:00000001:8.0:1773851877.654126:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851877.654126:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851877.654127:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851877.654127:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.654128:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851877.654129:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851877.654129:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851877.654131:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004d47abeb.
02000000:00000001:8.0:1773851877.654132:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.654133:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.654133:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851877.654134:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698838, transno 0, xid 1858044403214848
00010000:00000001:8.0:1773851877.654135:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851877.654136:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cd7d2931 x1858044403214848/t0(0) o400->8304e057-8618-410b-9db2-df781b4765da@10595@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1148-0'
00010000:00000001:8.0:1773851877.654138:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851877.654139:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851877.654140:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=110 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851877.654141:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851877.654142:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000082d8f275 refcount 3 to 10595@kfi7
00000100:00000001:8.0:1773851877.654142:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450080 : -107146752101536 : ffff9e8cf3e6f360)
02000000:00000001:8.0:1773851877.654143:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851877.654144:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.654144:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851877.654145:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10594@kfi7
00000400:00000010:8.0:1773851877.654146:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079e75b3d.
00000100:00000200:8.0:1773851877.654147:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044403214848, offset 224
00000400:00000200:8.0:1773851877.654148:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10594@kfi7
00000400:00000200:8.0:1773851877.654149:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10594@kfi7 to cpt 2
00000400:00000200:8.0:1773851877.654150:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfd9b897 nid 10594@kfi7 refs 1
00000400:00000200:8.0:1773851877.654151:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfd9b897 nid 10594@kfi7 refs 2
00000400:00000200:8.0:1773851877.654153:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfd9b897 nid 10594@kfi7 refs 3
00000400:00000200:8.0:1773851877.654154:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10594@kfi7 local destination
00000400:00000200:8.0:1773851877.654156:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769576:8769576:1024:4294967295] 10594@kfi7 LPNI seq info [147310:147310:16:4294967295]
00000400:00000200:8.0:1773851877.654157:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfd9b897 nid 10594@kfi7 refs 2
00000400:00000200:8.0:1773851877.654158:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10594@kfi7 to cpt 2
00000400:00000200:8.0:1773851877.654160:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10594@kfi7(10594@kfi7:10594@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851877.654162:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfd9b897 nid 10594@kfi7 refs 3
00000800:00000200:8.0:1773851877.654163:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851877.654165:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851877.654169:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851877.654174:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000d1 Using peer 10594@kfi7(0x1000000000000d1)
00000800:00000200:8.0:1773851877.654179:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x1000000000000d1: rc=0
00000800:00000200:8.0:1773851877.654181:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851877.654185:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851877.654186:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000082d8f275 refcount 2 to 10595@kfi7
00010000:00000001:8.0:1773851877.654190:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851877.654190:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851877.654192:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851877.654193:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cd7d2931 x1858044403214848/t0(0) o400->8304e057-8618-410b-9db2-df781b4765da@10595@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1148-0'
00000100:00100000:8.0:1773851877.654199:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd7d2931 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8304e057-8618-410b-9db2-df781b4765da+6:39652:x1858044403214848:12345-10595@kfi7:400:default-tuolumne1148-0 Request processed in 80us (107us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851877.654203:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10595@kfi7, seq: 2130808
00000100:00000040:8.0:1773851877.654204:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006465974f : new rpc_count 0
00000100:00000001:8.0:1773851877.654206:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851877.654207:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851877.654208:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851877.654209:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000020:00000010:8.0:1773851877.654210:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002eec3ec2.
00000020:00000040:8.0:1773851877.654212:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000006465974f : new refcount 5
00000100:00000001:8.0:1773851877.654213:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851877.654220:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000d1 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851877.654222:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851877.654224:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10594@kfi7: PUT: OK
00000400:00000200:10.0:1773851877.654225:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079e75b3d
00000400:00000010:10.0:1773851877.654226:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079e75b3d.
00000100:00000001:10.0:1773851877.654227:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851877.654227:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851877.654228:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfd9b897 nid 10594@kfi7 refs 2
00000800:00000200:10.0:1773851877.654230:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 10594@kfi7(0000000026ea340e):0x0 lsk 210 rsk 55 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000d1 Transaction freed
00000800:00000200:17.0:1773851877.677353:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.677353:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851877.677355:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851877.677357:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851877.677359:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.677361:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.107@tcp : PUT - for me
00000400:00000200:17.0:1773851877.677362:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.677362:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851877.677364:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.107@tcp to cpt 7
00000400:00000200:17.0:1773851877.677365:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b369767 nid 172.16.70.107@tcp refs 2
00000400:00000200:17.0:1773851877.677367:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004b369767 nid 172.16.70.107@tcp refs 3
00000400:00000200:17.0:1773851877.677368:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.107@tcp to cpt 7
00000400:00000200:17.0:1773851877.677369:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.107@tcp of length 224 into portal 12 MB=0x69a19c8307e80
00000400:00000200:17.0:1773851877.677371:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.107@tcp of length 224/224 into md 0x77fe139dd [64] + 188136
00000800:00000200:17.0:1773851877.677373:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851877.677375:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851877.677376:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851877.677377:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851877.677378:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851877.677379:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000022ef8079.
00000100:00000040:17.0:1773851877.677379:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000022ef8079 x1858285383745152 msgsize 224
00000100:00100000:17.0:1773851877.677381:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.107@tcp (source: 12345-172.16.70.107@tcp)
00000100:00000001:17.0:1773851877.677383:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851877.677384:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851877.677385:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851877.677386:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851877.677387:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851877.677387:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851877.677388:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851877.677389:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851877.677389:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858285383745152
00000020:00000001:28.0:1773851877.677390:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851877.677391:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93052
00000020:00000001:28.0:1773851877.677391:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851877.677393:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000add7b40 refcount=6
00000020:00000001:28.0:1773851877.677394:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745147392 : -107128964404224 : ffff9e911821ac00)
00000020:00000001:28.0:1773851877.677395:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745147392 : -107128964404224 : ffff9e911821ac00)
00000100:00000001:28.0:1773851877.677396:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851877.677397:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851877.677398:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851877.677399:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851877.677400:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851877.677401:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851877.677401:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851877.677402:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851877.677403:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851877.677403:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851877.677404:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.677405:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851877.677406:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851877.677407:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851877.677408:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:28.0:1773851877.677408:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.107@tcp, seq: 2055548
00000100:00000001:30.0:1773851877.677409:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851877.677409:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.677409:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000add7b40 : new rpc_count 1
00000100:00000001:30.0:1773851877.677410:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.677411:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144552203008 : -106929157348608 : ffff9ebf9d8f6300)
00000100:00000040:28.0:1773851877.677412:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000022ef8079 x1858285383745152/t0(0) o400->93c22d17-7a88-4cba-8703-aa4c5335fb14@172.16.70.107@tcp:665/0 lens 224/0 e 0 to 0 dl 1773852025 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic7-0'
00000100:00000001:28.0:1773851877.677415:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851877.677415:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851877.677416:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022ef8079 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:93c22d17-7a88-4cba-8703-aa4c5335fb14+6:52966:x1858285383745152:12345-172.16.70.107@tcp:400:login-rzslic7-0
00000100:00000200:28.0:1773851877.677418:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858285383745152
00000020:00000001:28.0:1773851877.677418:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851877.677419:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851877.677420:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.677420:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851877.677421:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851877.677421:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851877.677422:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858285383745152, found 0 last_xid 1858285383745151
00000020:00000001:28.0:1773851877.677423:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851877.677423:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851877.677424:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851877.677425:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.677425:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851877.677426:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851877.677426:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851877.677427:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e6bd80eb.
02000000:00000001:28.0:1773851877.677427:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.677428:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.677428:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851877.677429:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858285383745152
00010000:00000001:28.0:1773851877.677430:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851877.677431:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000022ef8079 x1858285383745152/t0(0) o400->93c22d17-7a88-4cba-8703-aa4c5335fb14@172.16.70.107@tcp:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic7-0'
00010000:00000001:28.0:1773851877.677433:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851877.677434:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851877.677435:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=110 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851877.677436:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851877.677437:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000078ebab1f refcount 3 to 172.16.70.107@tcp
00000100:00000001:28.0:1773851877.677438:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212480 : -107155106339136 : ffff9e8b01f366c0)
02000000:00000001:28.0:1773851877.677439:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851877.677439:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851877.677440:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851877.677441:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.107@tcp
00000400:00000010:28.0:1773851877.677442:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af6e809e.
00000100:00000200:28.0:1773851877.677442:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858285383745152, offset 224
00000400:00000200:28.0:1773851877.677444:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.107@tcp
00000400:00000200:28.0:1773851877.677445:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.107@tcp to cpt 7
00000400:00000200:28.0:1773851877.677446:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b369767 nid 172.16.70.107@tcp refs 2
00000400:00000200:28.0:1773851877.677447:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004b369767 nid 172.16.70.107@tcp refs 3
00000400:00000200:28.0:1773851877.677449:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004b369767 nid 172.16.70.107@tcp refs 4
00000400:00000200:28.0:1773851877.677450:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.107@tcp routed destination
00000400:00000200:28.0:1773851877.677451:0:60533:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:28.0:1773851877.677453:0:60533:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:28.0:1773851877.677454:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.107@tcp: rtr pref emtpy: 1
00000400:00000200:28.0:1773851877.677455:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:28.0:1773851877.677456:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.107@tcp: rtr pref emtpy: 1
00000400:00000200:28.0:1773851877.677457:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:28.0:1773851877.677458:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769577:8769577:1024:4294967295] 17@kfi7 LPNI seq info [1250891906:1250891906:16:4294967295]
00000400:00000200:28.0:1773851877.677460:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:28.0:1773851877.677461:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:28.0:1773851877.677464:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.107@tcp(172.16.70.107@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851877.677465:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004b369767 nid 172.16.70.107@tcp refs 3
00000800:00000200:28.0:1773851877.677466:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851877.677468:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851877.677470:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851877.677475:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:28.0:1773851877.677477:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:28.0:1773851877.677479:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851877.677481:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851877.677482:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000078ebab1f refcount 2 to 172.16.70.107@tcp
00010000:00000001:28.0:1773851877.677483:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851877.677484:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851877.677484:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851877.677486:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000022ef8079 x1858285383745152/t0(0) o400->93c22d17-7a88-4cba-8703-aa4c5335fb14@172.16.70.107@tcp:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic7-0'
00000100:00100000:28.0:1773851877.677490:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022ef8079 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:93c22d17-7a88-4cba-8703-aa4c5335fb14+6:52966:x1858285383745152:12345-172.16.70.107@tcp:400:login-rzslic7-0 Request processed in 74us (109us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851877.677492:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.107@tcp, seq: 2055548
00000100:00000040:28.0:1773851877.677493:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000add7b40 : new rpc_count 0
00000100:00000001:28.0:1773851877.677494:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851877.677494:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851877.677495:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851877.677496:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851877.677496:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851877.677497:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000000add7b40 : new refcount 5
00000100:00000001:28.0:1773851877.677498:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851877.677505:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851877.677507:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851877.677508:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:31.0:1773851877.677509:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af6e809e
00000400:00000010:31.0:1773851877.677509:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af6e809e.
00000100:00000001:31.0:1773851877.677510:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851877.677511:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851877.677512:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:31.0:1773851877.677513:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Transaction freed
00000100:00000001:17.0:1773851877.705733:0:60961:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000001:10.0:1773851877.705734:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851877.705735:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:11.0:1773851877.705736:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851877.705737:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851877.705737:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007391cc99.
00000100:00000010:10.0:1773851877.705737:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004139ca59.
00000020:00000040:11.0:1773851877.705739:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000020:00000040:10.0:1773851877.705739:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000001:11.0:1773851877.705740:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851877.705740:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851877.705741:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851877.705741:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:17.0:1773851877.705742:0:60961:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +8s
02000000:00000001:11.0:1773851877.705742:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851877.705742:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851877.705744:0:60961:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 0 early replies
02000000:00000010:11.0:1773851877.705744:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003b54e2de.
02000000:00000010:10.0:1773851877.705744:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000002f6163b3.
00000100:00000001:17.0:1773851877.705745:0:60961:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851877.705746:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851877.705746:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851877.705747:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851877.705747:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851877.705748:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851877.705748:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851877.705750:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007391cc99] to pc [ptlrpcd_02_02+2]  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851877.705750:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004139ca59] to pc [ptlrpcd_02_03+3]  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:11.0:1773851877.705757:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851877.705757:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851877.705759:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851877.705759:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851877.705760:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851877.705760:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851877.705760:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851877.705761:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:9.0:1773851877.705762:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851877.705763:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851877.705767:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851877.705767:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851877.705768:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.705768:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851877.705769:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851877.705769:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851877.705770:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851877.705770:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851877.705771:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004139ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051932352:12@kfi7:13:default-yuba2-0
00000100:00100000:9.0:1773851877.705772:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007391cc99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051932288:42@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851877.705774:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851877.705774:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851877.705775:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851877.705775:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851877.705776:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851877.705776:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851877.705777:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851877.705777:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851877.705778:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b5df4ab7.
02000000:00000010:8.0:1773851877.705778:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003d905b3e.
02000000:00000001:9.0:1773851877.705779:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851877.705779:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851877.705781:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:9.0:1773851877.705782:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb5b7920.
00000400:00000200:8.0:1773851877.705782:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:8.0:1773851877.705783:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000400:00000010:9.0:1773851877.705784:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c6a04e2b.
00000400:00000010:8.0:1773851877.705784:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
00000100:00000200:9.0:1773851877.705785:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932288, portal 4
00000100:00000200:8.0:1773851877.705786:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932352, portal 4
00000100:00000001:9.0:1773851877.705787:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851877.705787:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446608768 : -106937262942848 : ffff9ebdba6dd580)
00000100:00000001:8.0:1773851877.705787:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851877.705787:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136770068608 : -106936939483008 : ffff9ebdcdb57080)
00000100:00000040:8.0:1773851877.705789:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851877.705790:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851877.705793:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:9.0:1773851877.705794:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851877.705795:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:8.0:1773851877.705795:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000286a46f2.
00000100:00000040:9.0:1773851877.705796:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:9.0:1773851877.705796:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027709c97.
00000100:00000200:9.0:1773851877.705797:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932288, offset 0
00000400:00000200:9.0:1773851877.705800:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000100:00000200:8.0:1773851877.705801:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932352, offset 0
00000400:00000200:9.0:1773851877.705802:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851877.705803:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:8.0:1773851877.705803:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:9.0:1773851877.705805:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851877.705807:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:9.0:1773851877.705809:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:9.0:1773851877.705812:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769573, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769577, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851877.705815:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851877.705817:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851877.705818:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:9.0:1773851877.705820:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769578:8769578:1024:4294967295] 42@kfi7 LPNI seq info [5404899:5404899:16:4294967295]
00000400:00000200:9.0:1773851877.705822:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851877.705823:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851877.705825:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851877.705826:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:8.0:1773851877.705827:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851877.705828:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851877.705829:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851877.705830:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:8.0:1773851877.705830:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000800:00000200:9.0:1773851877.705832:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:8.0:1773851877.705833:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769578, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769577, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851877.705834:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:8.0:1773851877.705836:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851877.705837:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:9.0:1773851877.705838:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:8.0:1773851877.705839:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000400:00000200:8.0:1773851877.705840:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769579:8769579:1024:4294967295] 12@kfi7 LPNI seq info [5403459:5403459:16:4294967295]
00000800:00000200:9.0:1773851877.705842:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000400:00000200:8.0:1773851877.705842:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851877.705843:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:9.0:1773851877.705847:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x17b: rc=0
00000400:00000200:8.0:1773851877.705847:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851877.705849:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:9.0:1773851877.705850:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:8.0:1773851877.705851:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:9.0:1773851877.705853:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851877.705853:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851877.705854:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851877.705856:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851877.705857:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851877.705858:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:8.0:1773851877.705859:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851877.705860:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851877.705861:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851877.705862:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:8.0:1773851877.705862:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Using peer 12@kfi7(0x200000000000473)
00000100:00000001:9.0:1773851877.705863:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851877.705866:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851877.705867:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851877.705871:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000800:00000200:8.0:1773851877.705873:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x200000000000473: rc=0
00000400:00000200:9.0:1773851877.705874:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:8.0:1773851877.705875:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851877.705876:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:9.0:1773851877.705878:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027709c97
00000100:00000001:8.0:1773851877.705878:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851877.705879:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027709c97.
00000100:00000001:8.0:1773851877.705879:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851877.705880:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:8.0:1773851877.705880:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851877.705881:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851877.705883:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.705884:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851877.705886:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851877.705886:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851877.705886:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000040:9.0:1773851877.705887:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851877.705888:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851877.705888:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851877.705891:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851877.705892:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:8.0:1773851877.705893:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851877.705894:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:8.0:1773851877.705894:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851877.705895:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851877.705896:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000400:00000200:10.0:1773851877.705897:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851877.705899:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000400:00000200:10.0:1773851877.705901:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000286a46f2
00000400:00000010:10.0:1773851877.705901:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000286a46f2.
00000800:00000200:25.0:1773851877.705902:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:10.0:1773851877.705902:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:25.0:1773851877.705903:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:10.0:1773851877.705904:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851877.705905:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851877.705908:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:25.0:1773851877.705909:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:10.0:1773851877.705909:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851877.705912:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000001:10.0:1773851877.705913:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851877.705914:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851877.705916:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000001:10.0:1773851877.705917:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851877.705918:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:10.0:1773851877.705918:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:25.0:1773851877.705919:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.705920:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:10.0:1773851877.705921:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Transaction freed
00000400:00000200:25.0:1773851877.705922:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851877.705924:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.705925:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4680
00000400:00000200:25.0:1773851877.705927:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.705929:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b82899 [1] + 224
00000800:00000200:25.0:1773851877.705932:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851877.705935:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851877.705936:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851877.705938:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851877.705940:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851877.705940:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851877.705941:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851877.705943:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:25.0:1773851877.705945:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851877.705947:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851877.705949:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:25.0:1773851877.705951:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851877.705951:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:25.0:1773851877.705952:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851877.705953:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:11.0:1773851877.705954:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851877.705954:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000800:00000200:25.0:1773851877.705955:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851877.705955:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851877.705956:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000001:11.0:1773851877.705957:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:9.0:1773851877.705957:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000001:11.0:1773851877.705958:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:9.0:1773851877.705958:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000010:11.0:1773851877.705959:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb5b7920.
00000400:00000200:9.0:1773851877.705959:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:11.0:1773851877.705960:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c6a04e2b
00000400:00000010:11.0:1773851877.705961:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c6a04e2b.
00000100:00000001:11.0:1773851877.705962:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851877.705962:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b46c0
00000400:00000200:9.0:1773851877.705963:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000200:11.0:1773851877.705964:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851877.705965:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781698029 [1] + 224
00000800:00000200:9.0:1773851877.705968:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:11.0:1773851877.705969:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851877.705971:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851877.705973:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851877.705973:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000100:00000001:11.0:1773851877.705974:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851877.705974:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851877.705975:0:41070:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:9.0:1773851877.705975:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:11.0:1773851877.705977:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:11.0:1773851877.705977:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851877.705978:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851877.705980:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851877.705980:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:11.0:1773851877.705981:0:41070:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=110 v=66 (66 66 66 66)
00000100:00001000:11.0:1773851877.705983:0:41070:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=110 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851877.705985:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851877.705985:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851877.705986:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851877.705987:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:9.0:1773851877.705987:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:8.0:1773851877.705987:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00010000:00000001:11.0:1773851877.705988:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.705988:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851877.705989:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:8.0:1773851877.705989:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:11.0:1773851877.705990:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851877.705990:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000400:00000001:8.0:1773851877.705990:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851877.705990:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000100:00000001:11.0:1773851877.705991:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:8.0:1773851877.705991:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000100:00000001:11.0:1773851877.705992:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851877.705992:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000100:00000040:11.0:1773851877.705993:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851877.705993:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851877.705994:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851877.705998:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851877.705999:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000200:8.0:1773851877.705999:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851877.706000:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851877.706001:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:11.0:1773851877.706002:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000004:00000040:11.0:1773851877.706003:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351379010560 avail=351376041984 avail_mb=1372562664 hwm_mb=3131103 files=372019049 ffree=343143565 state=0: rc = 0
00000100:00000001:8.0:1773851877.706003:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851877.706003:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.706004:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851877.706005:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851877.706005:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851877.706006:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:11.0:1773851877.706007:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351379010560 free, 351376041984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019049 files, 343143565 free files
02000000:00000001:8.0:1773851877.706007:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851877.706009:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=110 v=66 (66 66 66 66)
00000004:00000001:11.0:1773851877.706010:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851877.706010:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=110 v=66 (1 1 1 1)
00000100:00000040:11.0:1773851877.706011:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851877.706012:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851877.706012:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851877.706013:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851877.706014:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.706015:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00100000:11.0:1773851877.706016:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007391cc99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051932288:42@kfi7:13:default-yuba2-0
00000100:00000040:8.0:1773851877.706016:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:8.0:1773851877.706017:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851877.706018:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.706018:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851877.706019:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851877.706019:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:11.0:1773851877.706020:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007391cc99 x1859433051932288/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851877.706024:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851877.706025:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851877.706025:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851877.706026:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851877.706028:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000100:00000001:11.0:1773851877.706029:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000040:8.0:1773851877.706029:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541486592 avail=351539420160 avail_mb=1373200860 hwm_mb=3131101 files=372136606 ffree=343302233 state=0: rc = 0
02000000:00000001:11.0:1773851877.706030:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:11.0:1773851877.706031:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b5df4ab7.
00000004:00000020:8.0:1773851877.706032:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541486592 free, 351539420160 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136606 files, 343302233 free files
02000000:00000001:11.0:1773851877.706033:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851877.706034:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000001:8.0:1773851877.706034:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851877.706035:0:41070:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:11.0:1773851877.706036:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:8.0:1773851877.706036:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:11.0:1773851877.706037:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003b54e2de.
02000000:00000001:11.0:1773851877.706038:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851877.706039:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851877.706040:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007391cc99.
00000100:00100000:8.0:1773851877.706040:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004139ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051932352:12@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851877.706041:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851877.706042:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.706042:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851877.706043:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.706043:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851877.706044:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:8.0:1773851877.706044:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004139ca59 x1859433051932352/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852030 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851877.706045:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851877.706046:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851877.706047:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.706048:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851877.706048:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851877.706049:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003d905b3e.
02000000:00000001:8.0:1773851877.706050:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851877.706051:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851877.706051:0:41071:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:8.0:1773851877.706052:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851877.706053:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000002f6163b3.
02000000:00000001:8.0:1773851877.706054:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851877.706055:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851877.706055:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004139ca59.
00000100:00000001:8.0:1773851877.706057:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851877.706057:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.706058:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.706059:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851877.706060:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.706061:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851877.706061:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851877.764873:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851877.764874:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851877.764875:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851877.764877:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851877.764879:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14144@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.764880:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14144@kfi7 : PUT - for me
00000400:00000200:9.0:1773851877.764881:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14144@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.764882:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aaff1b05 nid 14144@kfi7 refs 1
00000400:00000200:9.0:1773851877.764883:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14144@kfi7 to cpt 2
00000400:00000200:9.0:1773851877.764884:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aaff1b05 nid 14144@kfi7 refs 2
00000400:00000200:9.0:1773851877.764885:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aaff1b05 nid 14144@kfi7 refs 3
00000400:00000200:9.0:1773851877.764885:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14208@kfi7 to cpt 5
00000400:00000200:9.0:1773851877.764886:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14208@kfi7 of length 224 into portal 12 MB=0x69b0a4c45a240
00000400:00000200:9.0:1773851877.764888:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14208@kfi7 of length 224/224 into md 0x78146ce49 [64] + 144632
00000800:00000200:9.0:1773851877.764890:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851877.764891:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851877.764892:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14144@kfi7: PUT: OK
00000100:00000001:9.0:1773851877.764893:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851877.764893:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851877.764894:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000059df8e8.
00000100:00000040:9.0:1773851877.764895:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000059df8e8 x1859318391874112 msgsize 224
00000100:00100000:9.0:1773851877.764896:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14208@kfi7 (source: 12345-14144@kfi7)
00000100:00000001:9.0:1773851877.764898:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851877.764898:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aaff1b05 nid 14144@kfi7 refs 2
00000800:00000200:9.0:1773851877.764900:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851877.764900:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851877.764901:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851877.764902:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851877.764903:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851877.764904:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851877.764905:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318391874112
00000020:00000001:8.0:1773851877.764906:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851877.764907:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91930
00000020:00000001:8.0:1773851877.764908:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851877.764910:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b2880095 refcount=6
00000020:00000001:8.0:1773851877.764911:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241988096 : -107152467563520 : ffff9e8b9f3bec00)
00000020:00000001:8.0:1773851877.764912:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241988096 : -107152467563520 : ffff9e8b9f3bec00)
00000100:00000001:8.0:1773851877.764914:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851877.764915:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851877.764916:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002eec3ec2.
00000020:00000010:8.0:1773851877.764918:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851877.764919:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d7fea1f2.
00000100:00000001:8.0:1773851877.764921:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851877.764921:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851877.764922:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851877.764924:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851877.764924:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851877.764925:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.764927:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851877.764928:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851877.764929:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851877.764929:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851877.764929:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851877.764930:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14208@kfi7, seq: 2130809
00000100:00000040:11.0:1773851877.764931:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b2880095 : new rpc_count 1
00000100:00000001:11.0:1773851877.764931:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096240512 : -107006613311104 : ffff9ead94d33180)
00000100:00000001:8.0:1773851877.764931:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851877.764932:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851877.764933:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000059df8e8 x1859318391874112/t0(0) o400->81590e8a-7551-413f-8147-98a3fcf2ff6e@14208@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1380-0'
00000100:00000001:11.0:1773851877.764935:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851877.764936:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851877.764937:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000059df8e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:81590e8a-7551-413f-8147-98a3fcf2ff6e+6:39746:x1859318391874112:12345-14208@kfi7:400:default-tuolumne1380-0
00000100:00000200:11.0:1773851877.764938:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318391874112
00000020:00000001:11.0:1773851877.764939:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851877.764939:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851877.764940:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851877.764941:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851877.764943:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851877.764944:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851877.764945:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318391874112, found 0 last_xid 1859318391874111
00000020:00000001:11.0:1773851877.764946:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851877.764946:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851877.764947:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851877.764947:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851877.764948:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851877.764949:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851877.764949:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851877.764950:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000071055adf.
02000000:00000001:11.0:1773851877.764951:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851877.764952:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851877.764952:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851877.764953:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096685142, transno 0, xid 1859318391874112
00010000:00000001:11.0:1773851877.764954:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851877.764955:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000059df8e8 x1859318391874112/t0(0) o400->81590e8a-7551-413f-8147-98a3fcf2ff6e@14208@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1380-0'
00010000:00000001:11.0:1773851877.764957:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851877.764958:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851877.764958:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=110 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851877.764959:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851877.764960:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8a74805 refcount 3 to 14208@kfi7
00000100:00000001:11.0:1773851877.764961:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109280 : -107156354442336 : ffff9e8ab78edba0)
02000000:00000001:11.0:1773851877.764962:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851877.764962:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851877.764963:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851877.764964:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14144@kfi7
00000400:00000010:11.0:1773851877.764964:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a75bb48d.
00000100:00000200:11.0:1773851877.764965:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318391874112, offset 224
00000400:00000200:11.0:1773851877.764966:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14144@kfi7
00000400:00000200:11.0:1773851877.764967:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14144@kfi7 to cpt 2
00000400:00000200:11.0:1773851877.764968:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aaff1b05 nid 14144@kfi7 refs 1
00000400:00000200:11.0:1773851877.764969:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aaff1b05 nid 14144@kfi7 refs 2
00000400:00000200:11.0:1773851877.764971:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aaff1b05 nid 14144@kfi7 refs 3
00000400:00000200:11.0:1773851877.764972:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14144@kfi7 local destination
00000400:00000200:11.0:1773851877.764973:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769580:8769580:1024:4294967295] 14144@kfi7 LPNI seq info [3381797:3381797:16:4294967295]
00000400:00000200:11.0:1773851877.764975:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aaff1b05 nid 14144@kfi7 refs 2
00000400:00000200:11.0:1773851877.764976:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14144@kfi7 to cpt 2
00000400:00000200:11.0:1773851877.764978:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14144@kfi7(14144@kfi7:14144@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851877.764979:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aaff1b05 nid 14144@kfi7 refs 3
00000800:00000200:11.0:1773851877.764980:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851877.764981:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851877.764983:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851877.764985:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xee1 Using peer 14144@kfi7(0xee1)
00000800:00000200:11.0:1773851877.764988:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0xee1: rc=0
00000800:00000200:11.0:1773851877.764990:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xee1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851877.764991:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851877.764992:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8a74805 refcount 2 to 14208@kfi7
00010000:00000001:11.0:1773851877.764993:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851877.764993:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851877.764994:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851877.764995:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000059df8e8 x1859318391874112/t0(0) o400->81590e8a-7551-413f-8147-98a3fcf2ff6e@14208@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1380-0'
00000100:00100000:11.0:1773851877.764998:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000059df8e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:81590e8a-7551-413f-8147-98a3fcf2ff6e+6:39746:x1859318391874112:12345-14208@kfi7:400:default-tuolumne1380-0 Request processed in 62us (102us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851877.765001:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14208@kfi7, seq: 2130809
00000100:00000040:11.0:1773851877.765001:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b2880095 : new rpc_count 0
00000100:00000001:11.0:1773851877.765002:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851877.765003:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xee1 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851877.765004:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851877.765004:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:11.0:1773851877.765005:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d7fea1f2.
00000400:00000200:9.0:1773851877.765005:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851877.765006:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002eec3ec2.
00000400:00000200:9.0:1773851877.765006:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14144@kfi7: PUT: OK
00000020:00000040:11.0:1773851877.765007:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000b2880095 : new refcount 5
00000100:00000001:11.0:1773851877.765007:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851877.765007:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a75bb48d
00000400:00000010:9.0:1773851877.765007:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a75bb48d.
00000100:00000001:9.0:1773851877.765008:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851877.765008:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851877.765009:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aaff1b05 nid 14144@kfi7 refs 2
00000800:00000200:9.0:1773851877.765010:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14144@kfi7(00000000c84128ae):0x0 lsk 3810 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xee1 Transaction freed
00000800:00000200:1.0:1773851877.797184:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851877.797185:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851877.797187:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851877.797188:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851877.797190:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11808@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.797192:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11808@kfi7 : PUT - for me
00000400:00000200:1.0:1773851877.797193:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11808@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.797193:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b203639 nid 11808@kfi7 refs 1
00000400:00000200:1.0:1773851877.797194:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11808@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.797195:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b203639 nid 11808@kfi7 refs 2
00000400:00000200:1.0:1773851877.797196:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000b203639 nid 11808@kfi7 refs 3
00000400:00000200:1.0:1773851877.797196:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11808@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.797197:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11808@kfi7 of length 224 into portal 12 MB=0x69b4b57980200
00000400:00000200:1.0:1773851877.797199:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11808@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 37360
00000800:00000200:1.0:1773851877.797200:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851877.797202:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.797203:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11808@kfi7: PUT: OK
00000100:00000001:1.0:1773851877.797204:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851877.797204:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851877.797205:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009e75376d.
00000100:00000040:1.0:1773851877.797206:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000009e75376d x1859597754696192 msgsize 224
00000100:00100000:1.0:1773851877.797208:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11808@kfi7 (source: 12345-11808@kfi7)
00000100:00000001:1.0:1773851877.797209:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851877.797210:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000b203639 nid 11808@kfi7 refs 2
00000100:00000001:0.0:1773851877.797210:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851877.797211:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851877.797211:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851877.797211:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851877.797212:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851877.797212:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851877.797213:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597754696192
00000020:00000001:0.0:1773851877.797214:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851877.797214:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7a7e1
00000020:00000001:0.0:1773851877.797214:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851877.797216:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d2fce0a9 refcount=5
00000020:00000001:0.0:1773851877.797216:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636971025235968 : -107102684315648 : ffff9e97368c0000)
00000020:00000001:0.0:1773851877.797218:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636971025235968 : -107102684315648 : ffff9e97368c0000)
00000100:00000001:0.0:1773851877.797218:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.797219:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851877.797220:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851877.797221:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.797222:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851877.797222:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851877.797223:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851877.797223:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851877.797224:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851877.797225:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851877.797225:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.797226:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851877.797227:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851877.797227:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851877.797228:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851877.797228:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851877.797229:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11808@kfi7, seq: 1997581
00000100:00000040:0.0:1773851877.797229:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d2fce0a9 : new rpc_count 1
00000100:00000001:1.0:1773851877.797230:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851877.797230:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.797230:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637069599734144 : -107004109817472 : ffff9eae2a0b7980)
00000100:00000040:0.0:1773851877.797231:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009e75376d x1859597754696192/t0(0) o400->98231de8-6ec7-41f2-9da5-66ab5b9510c1@11808@kfi7:517/0 lens 224/0 e 0 to 0 dl 1773852632 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1231-0'
00000100:00000001:0.0:1773851877.797233:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.797234:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851877.797235:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e75376d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:98231de8-6ec7-41f2-9da5-66ab5b9510c1+5:39725:x1859597754696192:12345-11808@kfi7:400:default-tuolumne1231-0
00000100:00000200:0.0:1773851877.797236:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597754696192
00000020:00000001:0.0:1773851877.797236:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851877.797237:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851877.797238:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.797238:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851877.797239:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851877.797239:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851877.797240:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597754696192, found 0 last_xid 1859597754696191
00000020:00000001:0.0:1773851877.797240:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851877.797241:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851877.797242:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851877.797242:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.797243:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851877.797243:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851877.797244:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851877.797244:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000267c870d.
02000000:00000001:0.0:1773851877.797245:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.797246:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.797246:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851877.797247:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690944681, transno 0, xid 1859597754696192
00010000:00000001:0.0:1773851877.797247:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851877.797248:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009e75376d x1859597754696192/t0(0) o400->98231de8-6ec7-41f2-9da5-66ab5b9510c1@11808@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1231-0'
00010000:00000001:0.0:1773851877.797250:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851877.797251:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851877.797252:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=110 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851877.797253:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851877.797253:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000086b2d947 refcount 3 to 11808@kfi7
00000100:00000001:0.0:1773851877.797254:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530571648 : -107154178979968 : ffff9e8b3939c780)
02000000:00000001:0.0:1773851877.797254:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851877.797255:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.797255:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851877.797256:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11808@kfi7
00000400:00000010:0.0:1773851877.797257:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079ba0077.
00000100:00000200:0.0:1773851877.797258:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597754696192, offset 224
00000400:00000200:0.0:1773851877.797259:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11808@kfi7
00000400:00000200:0.0:1773851877.797260:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11808@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.797260:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b203639 nid 11808@kfi7 refs 1
00000400:00000200:0.0:1773851877.797261:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000b203639 nid 11808@kfi7 refs 2
00000400:00000200:0.0:1773851877.797262:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000b203639 nid 11808@kfi7 refs 3
00000400:00000200:0.0:1773851877.797263:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11808@kfi7 local destination
00000400:00000200:0.0:1773851877.797264:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769581:8769581:1024:4294967295] 11808@kfi7 LPNI seq info [569376:569376:16:4294967295]
00000400:00000200:0.0:1773851877.797266:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000b203639 nid 11808@kfi7 refs 2
00000400:00000200:0.0:1773851877.797267:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11808@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.797268:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11808@kfi7(11808@kfi7:11808@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851877.797269:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000b203639 nid 11808@kfi7 refs 3
00000800:00000200:0.0:1773851877.797271:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851877.797272:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851877.797274:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851877.797276:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x895 Using peer 11808@kfi7(0x895)
00000800:00000200:0.0:1773851877.797278:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x895: rc=0
00000800:00000200:0.0:1773851877.797280:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x895 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851877.797281:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851877.797282:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000086b2d947 refcount 2 to 11808@kfi7
00010000:00000001:0.0:1773851877.797283:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851877.797283:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.797284:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851877.797284:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009e75376d x1859597754696192/t0(0) o400->98231de8-6ec7-41f2-9da5-66ab5b9510c1@11808@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1231-0'
00000100:00100000:0.0:1773851877.797289:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e75376d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:98231de8-6ec7-41f2-9da5-66ab5b9510c1+5:39725:x1859597754696192:12345-11808@kfi7:400:default-tuolumne1231-0 Request processed in 53us (80us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851877.797291:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11808@kfi7, seq: 1997581
00000100:00000040:0.0:1773851877.797291:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d2fce0a9 : new rpc_count 0
00000100:00000001:0.0:1773851877.797292:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851877.797292:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851877.797293:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.797293:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851877.797294:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000020:00000040:0.0:1773851877.797295:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000d2fce0a9 : new refcount 4
00000100:00000001:0.0:1773851877.797295:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851877.797300:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x895 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851877.797302:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.797303:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11808@kfi7: PUT: OK
00000400:00000200:1.0:1773851877.797304:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079ba0077
00000400:00000010:1.0:1773851877.797304:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079ba0077.
00000100:00000001:1.0:1773851877.797305:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851877.797305:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851877.797306:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000b203639 nid 11808@kfi7 refs 2
00000800:00000200:1.0:1773851877.797308:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11808@kfi7(00000000f6cc9665):0x0 lsk 2198 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x895 Transaction freed
00000800:00000200:5.0:1773851877.819500:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851877.819501:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851877.819502:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851877.819504:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851877.819506:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26035@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.819507:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26035@kfi7 : PUT - for me
00000400:00000200:5.0:1773851877.819508:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26035@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.819508:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020c02486 nid 26035@kfi7 refs 1
00000400:00000200:5.0:1773851877.819509:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26035@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.819510:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020c02486 nid 26035@kfi7 refs 2
00000400:00000200:5.0:1773851877.819510:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000020c02486 nid 26035@kfi7 refs 3
00000400:00000200:5.0:1773851877.819511:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26035@kfi7 to cpt 1
00000400:00000200:5.0:1773851877.819512:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26035@kfi7 of length 224 into portal 12 MB=0x69b4c394af600
00000400:00000200:5.0:1773851877.819513:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26035@kfi7 of length 224/224 into md 0x793926dc5 [64] + 150072
00000800:00000200:5.0:1773851877.819515:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851877.819516:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851877.819517:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26035@kfi7: PUT: OK
00000100:00000001:5.0:1773851877.819518:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851877.819518:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851877.819520:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000004bf1225.
00000100:00000040:5.0:1773851877.819520:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000004bf1225 x1859601541297664 msgsize 224
00000100:00100000:5.0:1773851877.819522:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26035@kfi7 (source: 12345-26035@kfi7)
00000100:00000001:5.0:1773851877.819523:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851877.819523:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000020c02486 nid 26035@kfi7 refs 2
00000100:00000001:7.0:1773851877.819524:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851877.819525:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851877.819525:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851877.819525:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851877.819526:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851877.819526:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851877.819527:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601541297664
00000020:00000001:7.0:1773851877.819528:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851877.819528:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78e21
00000020:00000001:7.0:1773851877.819529:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851877.819530:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009c29c0cf refcount=26
00000020:00000001:7.0:1773851877.819531:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117487806464 : -106956221745152 : ffff9eb950657800)
00000020:00000001:7.0:1773851877.819532:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117487806464 : -106956221745152 : ffff9eb950657800)
00000100:00000001:7.0:1773851877.819533:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.819534:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851877.819534:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851877.819535:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851877.819536:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851877.819537:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851877.819537:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851877.819537:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.819538:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851877.819539:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851877.819539:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.819540:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.819541:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851877.819542:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851877.819542:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851877.819542:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851877.819543:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26035@kfi7, seq: 2001941
00000100:00000040:7.0:1773851877.819544:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009c29c0cf : new rpc_count 1
00000100:00000001:7.0:1773851877.819544:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273406592 : -107034436145024 : ffff9ea71a747080)
00000100:00000001:4.0:1773851877.819544:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851877.819544:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.819545:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000004bf1225 x1859601541297664/t0(0) o400->13dba3bf-2efd-4d7b-98aa-6cd66cec9e48@26035@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2106-0'
00000100:00000001:7.0:1773851877.819548:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.819549:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851877.819550:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000004bf1225 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:13dba3bf-2efd-4d7b-98aa-6cd66cec9e48+26:39713:x1859601541297664:12345-26035@kfi7:400:default-tuolumne2106-0
00000100:00000200:7.0:1773851877.819551:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601541297664
00000020:00000001:7.0:1773851877.819552:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851877.819552:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851877.819553:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.819554:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851877.819554:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851877.819555:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851877.819555:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601541297664, found 0 last_xid 1859601540937407
00000020:00000001:7.0:1773851877.819556:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851877.819557:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851877.819557:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851877.819558:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.819558:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851877.819559:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851877.819559:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851877.819561:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002602e6b9.
02000000:00000001:7.0:1773851877.819562:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.819563:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.819563:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851877.819564:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260519402, transno 0, xid 1859601541297664
00010000:00000001:7.0:1773851877.819565:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851877.819565:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000004bf1225 x1859601541297664/t0(0) o400->13dba3bf-2efd-4d7b-98aa-6cd66cec9e48@26035@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2106-0'
00010000:00000001:7.0:1773851877.819568:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851877.819568:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851877.819569:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=109 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851877.819570:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851877.819571:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000044f70606 refcount 3 to 26035@kfi7
00000100:00000001:7.0:1773851877.819572:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410176 : -107145304141440 : ffff9e8d4a351180)
02000000:00000001:7.0:1773851877.819573:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851877.819574:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.819575:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851877.819575:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26035@kfi7
00000400:00000010:7.0:1773851877.819576:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a1436362.
00000100:00000200:7.0:1773851877.819577:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601541297664, offset 224
00000400:00000200:7.0:1773851877.819578:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26035@kfi7
00000400:00000200:7.0:1773851877.819579:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26035@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.819580:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020c02486 nid 26035@kfi7 refs 1
00000400:00000200:7.0:1773851877.819581:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000020c02486 nid 26035@kfi7 refs 2
00000400:00000200:7.0:1773851877.819582:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000020c02486 nid 26035@kfi7 refs 3
00000400:00000200:7.0:1773851877.819583:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26035@kfi7 local destination
00000400:00000200:7.0:1773851877.819584:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769582:8769582:1024:4294967295] 26035@kfi7 LPNI seq info [11477215:11477215:16:4294967295]
00000400:00000200:7.0:1773851877.819586:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000020c02486 nid 26035@kfi7 refs 2
00000400:00000200:7.0:1773851877.819586:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26035@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.819588:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26035@kfi7(26035@kfi7:26035@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851877.819589:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000020c02486 nid 26035@kfi7 refs 3
00000800:00000200:7.0:1773851877.819591:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851877.819592:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851877.819594:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851877.819596:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000960 Using peer 26035@kfi7(0x100000000000960)
00000800:00000200:7.0:1773851877.819599:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x100000000000960: rc=0
00000800:00000200:7.0:1773851877.819600:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000960 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851877.819602:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.819603:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000044f70606 refcount 2 to 26035@kfi7
00010000:00000001:7.0:1773851877.819604:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851877.819605:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.819605:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851877.819606:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000004bf1225 x1859601541297664/t0(0) o400->13dba3bf-2efd-4d7b-98aa-6cd66cec9e48@26035@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2106-0'
00000100:00100000:7.0:1773851877.819609:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000004bf1225 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:13dba3bf-2efd-4d7b-98aa-6cd66cec9e48+26:39713:x1859601541297664:12345-26035@kfi7:400:default-tuolumne2106-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851877.819612:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26035@kfi7, seq: 2001941
00000800:00000200:5.0:1773851877.819612:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000960 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851877.819613:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009c29c0cf : new rpc_count 0
00000400:00000200:5.0:1773851877.819613:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851877.819614:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851877.819614:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851877.819614:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26035@kfi7: PUT: OK
00000020:00000010:7.0:1773851877.819615:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851877.819615:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:5.0:1773851877.819615:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a1436362
00000400:00000010:5.0:1773851877.819615:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a1436362.
00000020:00000010:7.0:1773851877.819616:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000100:00000001:5.0:1773851877.819616:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851877.819616:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:7.0:1773851877.819617:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009c29c0cf : new refcount 25
00000400:00000200:5.0:1773851877.819617:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000020c02486 nid 26035@kfi7 refs 2
00000100:00000001:7.0:1773851877.819618:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851877.819618:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 26035@kfi7(0000000061a56984):0x0 lsk 2401 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000960 Transaction freed
00000800:00000200:13.0:1773851877.821774:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851877.821776:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851877.821778:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851877.821781:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851877.821784:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.821786:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000400:00000200:13.0:1773851877.821788:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.821789:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:13.0:1773851877.821791:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.821792:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:13.0:1773851877.821794:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:13.0:1773851877.821796:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.821797:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 224 into portal 12 MB=0x699e168130a80
00000400:00000200:13.0:1773851877.821800:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2104@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 38864
00000800:00000200:13.0:1773851877.821803:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851877.821806:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851877.821807:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00000001:13.0:1773851877.821809:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851877.821809:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851877.821811:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000051ccbbb6.
00000100:00000040:13.0:1773851877.821812:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000051ccbbb6 x1858043253033600 msgsize 224
00000100:00100000:13.0:1773851877.821815:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-2104@kfi7 (source: 12345-2104@kfi7)
00000100:00000001:13.0:1773851877.821816:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851877.821818:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:15.0:1773851877.821819:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851877.821820:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851877.821820:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851877.821821:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851877.821822:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851877.821823:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851877.821824:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043253033600
00000020:00000001:15.0:1773851877.821826:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851877.821826:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acbac25
00000020:00000001:15.0:1773851877.821827:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851877.821834:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005fd2ab7e refcount=5
00000020:00000001:15.0:1773851877.821835:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934536828928 : -107139172722688 : ffff9e8eb7ab1800)
00000020:00000001:15.0:1773851877.821836:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934536828928 : -107139172722688 : ffff9e8eb7ab1800)
00000100:00000001:15.0:1773851877.821838:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.821840:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851877.821841:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000087969700.
00000020:00000010:15.0:1773851877.821843:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851877.821844:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851877.821846:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851877.821847:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851877.821848:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.821849:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851877.821850:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851877.821851:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.821852:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.821855:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851877.821855:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851877.821855:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851877.821856:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851877.821857:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2104@kfi7, seq: 2289870
00000100:00000040:15.0:1773851877.821858:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005fd2ab7e : new rpc_count 1
00000100:00000001:15.0:1773851877.821859:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902254848 : -106994807296768 : ffff9eb05484ad00)
00000100:00000001:12.0:1773851877.821859:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851877.821860:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.821861:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000051ccbbb6 x1858043253033600/t0(0) o400->lustre5-MDT0001-lwp-OST0016_UUID@2104@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba123-0'
00000100:00000001:15.0:1773851877.821866:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.821867:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851877.821868:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051ccbbb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:lustre5-MDT0001-lwp-OST0016_UUID+5:272640:x1858043253033600:12345-2104@kfi7:400:default-yuba123-0
00000100:00000200:15.0:1773851877.821871:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043253033600
00000020:00000001:15.0:1773851877.821872:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851877.821873:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851877.821874:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.821875:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851877.821876:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851877.821877:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:15.0:1773851877.821879:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851877.821880:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851877.821880:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851877.821881:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.821882:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851877.821884:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851877.821885:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851877.821886:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e845e4b6.
02000000:00000001:15.0:1773851877.821887:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.821888:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.821889:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851877.821890:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858043253033600
00010000:00000001:15.0:1773851877.821892:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851877.821893:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000051ccbbb6 x1858043253033600/t0(0) o400->lustre5-MDT0001-lwp-OST0016_UUID@2104@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba123-0'
00010000:00000001:15.0:1773851877.821897:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851877.821898:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851877.821900:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=110 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851877.821901:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851877.821903:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000255bcc5b refcount 7 to 2104@kfi7
00000100:00000001:15.0:1773851877.821904:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299744 : -107155980251872 : ffff9e8acddc8d20)
02000000:00000001:15.0:1773851877.821905:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851877.821906:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.821907:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851877.821908:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:15.0:1773851877.821909:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000085014459.
00000100:00000200:15.0:1773851877.821911:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043253033600, offset 224
00000400:00000200:15.0:1773851877.821913:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:15.0:1773851877.821914:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.821916:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:15.0:1773851877.821917:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:15.0:1773851877.821919:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:15.0:1773851877.821921:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2104@kfi7 local destination
00000400:00000200:15.0:1773851877.821923:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769583:8769583:1024:4294967295] 2104@kfi7 LPNI seq info [5403379:5403379:16:4294967295]
00000400:00000200:15.0:1773851877.821926:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:15.0:1773851877.821927:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.821930:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851877.821932:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000800:00000200:15.0:1773851877.821936:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851877.821937:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851877.821941:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851877.821945:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000800:00000200:15.0:1773851877.821950:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
00000800:00000200:15.0:1773851877.821953:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851877.821956:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.821957:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000255bcc5b refcount 6 to 2104@kfi7
00010000:00000001:15.0:1773851877.821958:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851877.821959:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.821960:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851877.821961:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000051ccbbb6 x1858043253033600/t0(0) o400->lustre5-MDT0001-lwp-OST0016_UUID@2104@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba123-0'
00000800:00000200:14.0:1773851877.821965:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851877.821967:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051ccbbb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:lustre5-MDT0001-lwp-OST0016_UUID+5:272640:x1858043253033600:12345-2104@kfi7:400:default-yuba123-0 Request processed in 100us (154us total) trans 0 rc 0/0
00000400:00000200:14.0:1773851877.821967:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851877.821968:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00100000:15.0:1773851877.821971:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2104@kfi7, seq: 2289870
00000400:00000200:14.0:1773851877.821971:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000085014459
00000100:00000040:15.0:1773851877.821972:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005fd2ab7e : new rpc_count 0
00000400:00000010:14.0:1773851877.821972:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000085014459.
00000100:00000001:14.0:1773851877.821973:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851877.821973:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851877.821974:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851877.821974:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:14.0:1773851877.821974:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000020:00000010:15.0:1773851877.821975:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:14.0:1773851877.821975:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000019e Transaction freed
00000020:00000010:15.0:1773851877.821976:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000020:00000010:15.0:1773851877.821978:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000087969700.
00000020:00000040:15.0:1773851877.821980:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000005fd2ab7e : new refcount 4
00000100:00000001:15.0:1773851877.821981:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851877.853158:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851877.853159:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851877.853160:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851877.853162:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851877.853164:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11378@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.853165:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11378@kfi7 : PUT - for me
00000400:00000200:25.0:1773851877.853166:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11378@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.853167:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a513c17 nid 11378@kfi7 refs 1
00000400:00000200:25.0:1773851877.853168:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11378@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.853170:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a513c17 nid 11378@kfi7 refs 2
00000400:00000200:25.0:1773851877.853170:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007a513c17 nid 11378@kfi7 refs 3
00000400:00000200:25.0:1773851877.853171:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11442@kfi7 to cpt 1
00000400:00000200:25.0:1773851877.853172:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11442@kfi7 of length 224 into portal 12 MB=0x69b4c3a7d1ec0
00000400:00000200:25.0:1773851877.853174:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11442@kfi7 of length 224/224 into md 0x16159c9699 [64] + 24120
00000800:00000200:25.0:1773851877.853176:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851877.853178:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851877.853178:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11378@kfi7: PUT: OK
00000100:00000001:25.0:1773851877.853180:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851877.853180:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851877.853181:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000532dc73c.
00000100:00000040:25.0:1773851877.853182:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000532dc73c x1859601561362112 msgsize 224
00000100:00100000:25.0:1773851877.853183:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-11442@kfi7 (source: 12345-11378@kfi7)
00000100:00000001:25.0:1773851877.853185:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851877.853185:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007a513c17 nid 11378@kfi7 refs 2
00000100:00000001:27.0:1773851877.853187:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851877.853187:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851877.853188:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851877.853189:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851877.853190:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851877.853191:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851877.853192:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601561362112
00000020:00000001:27.0:1773851877.853193:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851877.853194:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8a5b1
00000020:00000001:27.0:1773851877.853195:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851877.853197:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000032370f7 refcount=5
00000020:00000001:27.0:1773851877.853199:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637099837505536 : -106973872046080 : ffff9eb5345b4000)
00000020:00000001:27.0:1773851877.853200:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637099837505536 : -106973872046080 : ffff9eb5345b4000)
00000100:00000001:27.0:1773851877.853202:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851877.853203:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851877.853204:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004120800c.
00000020:00000010:27.0:1773851877.853206:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851877.853207:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851877.853209:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851877.853209:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851877.853210:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851877.853212:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851877.853213:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851877.853214:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.853215:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851877.853218:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851877.853219:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851877.853219:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851877.853219:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851877.853221:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11442@kfi7, seq: 2025135
00000100:00000040:27.0:1773851877.853222:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000032370f7 : new rpc_count 1
00000100:00000001:26.0:1773851877.853222:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.853223:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102835049472 : -106970874502144 : ffff9eb5e7062400)
00000100:00000001:26.0:1773851877.853223:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851877.853225:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000532dc73c x1859601561362112/t0(0) o400->7584676b-f587-4d14-83ba-7c9c7958d821@11442@kfi7:127/0 lens 224/0 e 0 to 0 dl 1773852242 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1194-0'
00000100:00000001:27.0:1773851877.853230:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851877.853231:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851877.853232:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000532dc73c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7584676b-f587-4d14-83ba-7c9c7958d821+5:39615:x1859601561362112:12345-11442@kfi7:400:default-tuolumne1194-0
00000100:00000200:27.0:1773851877.853234:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601561362112
00000020:00000001:27.0:1773851877.853235:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851877.853236:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851877.853237:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.853238:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851877.853239:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851877.853240:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851877.853241:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601561362112, found 0 last_xid 1859601561362111
00000020:00000001:27.0:1773851877.853243:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851877.853244:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851877.853244:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851877.853245:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.853246:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851877.853247:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851877.853248:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851877.853249:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ee739c74.
02000000:00000001:27.0:1773851877.853250:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.853251:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.853253:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851877.853254:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035299088, transno 0, xid 1859601561362112
00010000:00000001:27.0:1773851877.853255:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851877.853256:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000532dc73c x1859601561362112/t0(0) o400->7584676b-f587-4d14-83ba-7c9c7958d821@11442@kfi7:127/0 lens 224/224 e 0 to 0 dl 1773852242 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1194-0'
00010000:00000001:27.0:1773851877.853266:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851877.853267:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851877.853269:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=110 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851877.853271:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851877.853272:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002cc79817 refcount 3 to 11442@kfi7
00000100:00000001:27.0:1773851877.853273:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703936 : -107156155847680 : ffff9e8ac3652c00)
02000000:00000001:27.0:1773851877.853275:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851877.853276:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.853277:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851877.853278:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11378@kfi7
00000400:00000010:27.0:1773851877.853279:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6a62ce1.
00000100:00000200:27.0:1773851877.853281:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601561362112, offset 224
00000400:00000200:27.0:1773851877.853284:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11378@kfi7
00000400:00000200:27.0:1773851877.853285:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11378@kfi7 to cpt 6
00000400:00000200:27.0:1773851877.853286:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007a513c17 nid 11378@kfi7 refs 1
00000400:00000200:27.0:1773851877.853288:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007a513c17 nid 11378@kfi7 refs 2
00000400:00000200:27.0:1773851877.853290:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007a513c17 nid 11378@kfi7 refs 3
00000400:00000200:27.0:1773851877.853292:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11378@kfi7 local destination
00000400:00000200:27.0:1773851877.853294:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769584:8769584:1024:4294967295] 11378@kfi7 LPNI seq info [343864:343864:16:4294967295]
00000400:00000200:27.0:1773851877.853297:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007a513c17 nid 11378@kfi7 refs 2
00000400:00000200:27.0:1773851877.853298:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11378@kfi7 to cpt 6
00000400:00000200:27.0:1773851877.853302:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11378@kfi7(11378@kfi7:11378@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851877.853304:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007a513c17 nid 11378@kfi7 refs 3
00000800:00000200:27.0:1773851877.853306:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851877.853308:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851877.853312:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851877.853316:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000d4e Using peer 11378@kfi7(0x100000000000d4e)
00000800:00000200:27.0:1773851877.853324:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x100000000000d4e: rc=0
00000800:00000200:27.0:1773851877.853327:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000d4e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851877.853330:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851877.853332:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002cc79817 refcount 2 to 11442@kfi7
00010000:00000001:27.0:1773851877.853333:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851877.853334:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.853335:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851877.853336:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000532dc73c x1859601561362112/t0(0) o400->7584676b-f587-4d14-83ba-7c9c7958d821@11442@kfi7:127/0 lens 224/224 e 0 to 0 dl 1773852242 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1194-0'
00000800:00000200:25.0:1773851877.853339:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000d4e TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851877.853341:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000532dc73c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7584676b-f587-4d14-83ba-7c9c7958d821+5:39615:x1859601561362112:12345-11442@kfi7:400:default-tuolumne1194-0 Request processed in 111us (159us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851877.853341:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851877.853342:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11378@kfi7: PUT: OK
00000400:00000200:25.0:1773851877.853342:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6a62ce1
00000400:00000010:25.0:1773851877.853343:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6a62ce1.
00000100:00000001:25.0:1773851877.853343:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851877.853344:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:27.0:1773851877.853345:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11442@kfi7, seq: 2025135
00000400:00000200:25.0:1773851877.853345:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007a513c17 nid 11378@kfi7 refs 2
00000800:00000200:25.0:1773851877.853346:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 11378@kfi7(00000000c3dcc392):0x0 lsk 3407 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000d4e Transaction freed
00000100:00000040:27.0:1773851877.853347:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000032370f7 : new rpc_count 0
00000100:00000001:27.0:1773851877.853348:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851877.853349:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851877.853350:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851877.853351:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851877.853352:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004120800c.
00000020:00000040:27.0:1773851877.853354:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000032370f7 : new refcount 4
00000100:00000001:27.0:1773851877.853355:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851877.863945:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851877.863945:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851877.863946:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851877.863946:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851877.863947:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851877.863948:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851877.863949:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18720@kfi7(00000000832dcfec):0x262 version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851877.863950:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851877.863951:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 Using peer 18720@kfi7(0x100000000000262)
00000400:00000200:6.0:1773851877.863952:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18720@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.863953:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18720@kfi7 : PUT - for me
00000400:00000200:5.0:1773851877.863953:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18720@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.863954:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18720@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.863954:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3464c2b nid 18720@kfi7 refs 1
00000400:00000200:6.0:1773851877.863955:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18720@kfi7 to cpt 1
00000800:00000200:5.0:1773851877.863955:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 38 bytes to peer 0x100000000000262: rc=0
00000400:00000200:6.0:1773851877.863956:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3464c2b nid 18720@kfi7 refs 2
00000800:00000200:5.0:1773851877.863956:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851877.863957:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c3464c2b nid 18720@kfi7 refs 3
00000400:00000200:6.0:1773851877.863958:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18720@kfi7 to cpt 1
00000400:00000200:6.0:1773851877.863958:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18720@kfi7 of length 224 into portal 12 MB=0x69b4b5f2c08c0
00000400:00000200:6.0:1773851877.863960:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18720@kfi7 of length 224/224 into md 0x793926dc5 [64] + 150296
00000800:00000200:6.0:1773851877.863961:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851877.863963:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851877.863964:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18720@kfi7: PUT: OK
00000100:00000001:6.0:1773851877.863965:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851877.863965:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851877.863967:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000032fc10ca.
00000100:00000040:6.0:1773851877.863967:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000032fc10ca x1859597881837760 msgsize 224
00000800:00000200:5.0:1773851877.863968:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851877.863969:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-18720@kfi7 (source: 12345-18720@kfi7)
00000100:00000001:6.0:1773851877.863970:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:5.0:1773851877.863970:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 Transaction freed
00000100:00000001:7.0:1773851877.863971:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851877.863971:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3464c2b nid 18720@kfi7 refs 2
02000000:00000001:7.0:1773851877.863972:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851877.863972:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851877.863972:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851877.863973:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851877.863974:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851877.863975:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597881837760
00000020:00000001:7.0:1773851877.863975:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851877.863976:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2445e476
00000020:00000001:7.0:1773851877.863977:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851877.863980:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000096dc517f refcount=5
00000020:00000001:7.0:1773851877.863980:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118176527360 : -106955533024256 : ffff9eb979728400)
00000020:00000001:7.0:1773851877.863981:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118176527360 : -106955533024256 : ffff9eb979728400)
00000100:00000001:7.0:1773851877.863982:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.863983:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851877.863984:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851877.863985:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851877.863986:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851877.863987:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851877.863987:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851877.863988:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.863989:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851877.863989:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851877.863990:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.863990:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.863991:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851877.863992:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851877.863992:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851877.863992:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851877.863993:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18720@kfi7, seq: 2001942
00000100:00000040:7.0:1773851877.863994:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000096dc517f : new rpc_count 1
00000100:00000001:4.0:1773851877.863994:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.863995:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814089984 : -107101895461632 : ffff9e976590f500)
00000100:00000001:4.0:1773851877.863995:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.863996:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000032fc10ca x1859597881837760/t0(0) o400->eee45790-ddd2-4e9b-8bc3-fd0943eab17b@18720@kfi7:665/0 lens 224/0 e 0 to 0 dl 1773852025 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1663-0'
00000100:00000001:7.0:1773851877.863998:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.863999:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851877.864000:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032fc10ca pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:eee45790-ddd2-4e9b-8bc3-fd0943eab17b+5:39740:x1859597881837760:12345-18720@kfi7:400:default-tuolumne1663-0
00000100:00000200:7.0:1773851877.864001:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597881837760
00000020:00000001:7.0:1773851877.864002:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851877.864003:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851877.864003:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.864004:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851877.864004:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851877.864005:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851877.864006:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597881837760, found 0 last_xid 1859597881837759
00000020:00000001:7.0:1773851877.864006:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851877.864007:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851877.864008:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851877.864008:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.864009:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851877.864009:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851877.864010:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851877.864011:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b3d316d3.
02000000:00000001:7.0:1773851877.864012:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.864012:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.864013:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851877.864014:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044150120, transno 0, xid 1859597881837760
00010000:00000001:7.0:1773851877.864015:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851877.864016:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000032fc10ca x1859597881837760/t0(0) o400->eee45790-ddd2-4e9b-8bc3-fd0943eab17b@18720@kfi7:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1663-0'
00010000:00000001:7.0:1773851877.864018:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851877.864019:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851877.864019:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=109 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851877.864020:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851877.864021:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c5234a6f refcount 3 to 18720@kfi7
00000100:00000001:7.0:1773851877.864022:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612896 : -107130477938720 : ffff9e90bdeaf7e0)
02000000:00000001:7.0:1773851877.864022:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851877.864023:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.864024:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851877.864025:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18720@kfi7
00000400:00000010:7.0:1773851877.864025:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000084a606f7.
00000100:00000200:7.0:1773851877.864026:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597881837760, offset 224
00000400:00000200:7.0:1773851877.864027:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18720@kfi7
00000400:00000200:7.0:1773851877.864028:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18720@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.864029:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3464c2b nid 18720@kfi7 refs 1
00000400:00000200:7.0:1773851877.864030:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c3464c2b nid 18720@kfi7 refs 2
00000400:00000200:7.0:1773851877.864031:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c3464c2b nid 18720@kfi7 refs 3
00000400:00000200:7.0:1773851877.864033:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18720@kfi7 local destination
00000400:00000200:7.0:1773851877.864034:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769585:8769585:1024:4294967295] 18720@kfi7 LPNI seq info [433820:433820:16:4294967295]
00000400:00000200:7.0:1773851877.864036:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c3464c2b nid 18720@kfi7 refs 2
00000400:00000200:7.0:1773851877.864037:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18720@kfi7 to cpt 1
00000400:00000200:7.0:1773851877.864039:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18720@kfi7(18720@kfi7:18720@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851877.864040:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c3464c2b nid 18720@kfi7 refs 3
00000800:00000200:7.0:1773851877.864041:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851877.864042:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851877.864046:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851877.864049:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 Using peer 18720@kfi7(0x100000000000262)
00000800:00000200:7.0:1773851877.864051:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x100000000000262: rc=0
00000800:00000200:7.0:1773851877.864053:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851877.864055:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851877.864056:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c5234a6f refcount 2 to 18720@kfi7
00010000:00000001:7.0:1773851877.864057:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851877.864058:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851877.864058:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851877.864059:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000032fc10ca x1859597881837760/t0(0) o400->eee45790-ddd2-4e9b-8bc3-fd0943eab17b@18720@kfi7:665/0 lens 224/224 e 0 to 0 dl 1773852025 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1663-0'
00000100:00100000:7.0:1773851877.864063:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032fc10ca pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:eee45790-ddd2-4e9b-8bc3-fd0943eab17b+5:39740:x1859597881837760:12345-18720@kfi7:400:default-tuolumne1663-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851877.864064:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851877.864066:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18720@kfi7, seq: 2001942
00000100:00000040:7.0:1773851877.864066:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000096dc517f : new rpc_count 0
00000400:00000200:5.0:1773851877.864066:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851877.864067:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851877.864067:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18720@kfi7: PUT: OK
00000100:00000001:7.0:1773851877.864068:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851877.864068:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000200:5.0:1773851877.864068:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000084a606f7
00000400:00000010:5.0:1773851877.864068:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000084a606f7.
00000020:00000010:7.0:1773851877.864069:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000100:00000001:5.0:1773851877.864069:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851877.864069:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851877.864070:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000400:00000200:5.0:1773851877.864070:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3464c2b nid 18720@kfi7 refs 2
00000020:00000040:7.0:1773851877.864071:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000096dc517f : new refcount 4
00000100:00000001:7.0:1773851877.864071:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851877.864072:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 18720@kfi7(00000000832dcfec):0x0 lsk 611 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000262 Transaction freed
00000800:00000200:21.0:1773851877.886820:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851877.886821:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851877.886823:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851877.886824:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851877.886826:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10320@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.886827:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10320@kfi7 : PUT - for me
00000400:00000200:21.0:1773851877.886828:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10320@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.886829:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 1
00000400:00000200:21.0:1773851877.886830:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10320@kfi7 to cpt 5
00000400:00000200:21.0:1773851877.886830:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 2
00000400:00000200:21.0:1773851877.886831:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 3
00000400:00000200:21.0:1773851877.886832:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10384@kfi7 to cpt 0
00000400:00000200:21.0:1773851877.886833:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10384@kfi7 of length 224 into portal 12 MB=0x69b479644a180
00000400:00000200:21.0:1773851877.886834:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10384@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 47664
00000800:00000200:21.0:1773851877.886835:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851877.886837:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851877.886838:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10320@kfi7: PUT: OK
00000100:00000001:21.0:1773851877.886839:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851877.886839:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851877.886840:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000065599e88.
00000100:00000040:21.0:1773851877.886841:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000065599e88 x1859581626327424 msgsize 224
00000100:00100000:21.0:1773851877.886842:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-10384@kfi7 (source: 12345-10320@kfi7)
00000100:00000001:21.0:1773851877.886843:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851877.886844:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 2
00000800:00000200:21.0:1773851877.886845:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851877.886846:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851877.886847:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851877.886848:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851877.886849:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851877.886850:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851877.886851:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859581626327424
00000020:00000001:23.0:1773851877.886852:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851877.886853:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3e827f
00000020:00000001:23.0:1773851877.886854:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851877.886858:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac8a319a refcount=5
00000020:00000001:23.0:1773851877.886860:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637058272387072 : -107015437164544 : ffff9eab86e1e000)
00000020:00000001:23.0:1773851877.886861:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637058272387072 : -107015437164544 : ffff9eab86e1e000)
00000100:00000001:23.0:1773851877.886863:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851877.886864:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851877.886865:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004686297a.
00000020:00000010:23.0:1773851877.886867:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851877.886868:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851877.886869:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851877.886870:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851877.886872:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851877.886873:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851877.886874:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851877.886875:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.886876:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851877.886878:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851877.886879:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851877.886879:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851877.886879:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851877.886881:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10384@kfi7, seq: 1998011
00000100:00000040:23.0:1773851877.886882:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac8a319a : new rpc_count 1
00000100:00000001:20.0:1773851877.886882:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.886883:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794355200 : -106943915196416 : ffff9ebc2dec8000)
00000100:00000001:20.0:1773851877.886883:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851877.886885:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000065599e88 x1859581626327424/t0(0) o400->addac687-a4e5-4c66-aa29-89744ba77e83@10384@kfi7:517/0 lens 224/0 e 0 to 0 dl 1773852632 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1138-0'
00000100:00000001:23.0:1773851877.886890:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851877.886891:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851877.886892:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065599e88 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:addac687-a4e5-4c66-aa29-89744ba77e83+5:39698:x1859581626327424:12345-10384@kfi7:400:default-tuolumne1138-0
00000100:00000200:23.0:1773851877.886894:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859581626327424
00000020:00000001:23.0:1773851877.886895:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851877.886896:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851877.886897:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.886898:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851877.886899:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851877.886901:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851877.886901:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859581626327424, found 0 last_xid 1859581626327423
00000020:00000001:23.0:1773851877.886903:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851877.886904:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851877.886905:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851877.886905:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.886907:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851877.886908:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851877.886908:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851877.886910:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002745c85f.
02000000:00000001:23.0:1773851877.886911:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.886912:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.886914:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851877.886915:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182908937724, transno 0, xid 1859581626327424
00010000:00000001:23.0:1773851877.886917:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851877.886918:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000065599e88 x1859581626327424/t0(0) o400->addac687-a4e5-4c66-aa29-89744ba77e83@10384@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1138-0'
00010000:00000001:23.0:1773851877.886922:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851877.886923:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851877.886924:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=110 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851877.886926:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851877.886927:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000faa3b0db refcount 3 to 10384@kfi7
00000100:00000001:23.0:1773851877.886929:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958004960 : -107146751546656 : ffff9e8cf3ef6ae0)
02000000:00000001:23.0:1773851877.886930:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851877.886931:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851877.886932:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851877.886933:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10320@kfi7
00000400:00000010:23.0:1773851877.886934:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000571e5f64.
00000100:00000200:23.0:1773851877.886935:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859581626327424, offset 224
00000400:00000200:23.0:1773851877.886938:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10320@kfi7
00000400:00000200:23.0:1773851877.886939:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10320@kfi7 to cpt 5
00000400:00000200:23.0:1773851877.886940:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 1
00000400:00000200:23.0:1773851877.886942:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 2
00000400:00000200:23.0:1773851877.886944:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 3
00000400:00000200:23.0:1773851877.886946:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10320@kfi7 local destination
00000400:00000200:23.0:1773851877.886948:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769586:8769586:1024:4294967295] 10320@kfi7 LPNI seq info [17112257:17112257:16:4294967295]
00000400:00000200:23.0:1773851877.886950:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 2
00000400:00000200:23.0:1773851877.886952:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10320@kfi7 to cpt 5
00000400:00000200:23.0:1773851877.886955:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10320@kfi7(10320@kfi7:10320@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851877.886957:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 3
00000800:00000200:23.0:1773851877.886959:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851877.886961:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851877.886965:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851877.886969:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000011c Using peer 10320@kfi7(0x10000000000011c)
00000800:00000200:23.0:1773851877.886974:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x10000000000011c: rc=0
00000800:00000200:23.0:1773851877.886977:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000011c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851877.886980:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851877.886982:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000faa3b0db refcount 2 to 10384@kfi7
00010000:00000001:23.0:1773851877.886983:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851877.886984:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851877.886985:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851877.886986:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000065599e88 x1859581626327424/t0(0) o400->addac687-a4e5-4c66-aa29-89744ba77e83@10384@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1138-0'
00000800:00000200:21.0:1773851877.886987:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000011c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851877.886988:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851877.886989:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10320@kfi7: PUT: OK
00000400:00000200:21.0:1773851877.886990:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000571e5f64
00000400:00000010:21.0:1773851877.886990:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000571e5f64.
00000100:00000001:21.0:1773851877.886991:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851877.886991:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:23.0:1773851877.886992:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065599e88 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:addac687-a4e5-4c66-aa29-89744ba77e83+5:39698:x1859581626327424:12345-10384@kfi7:400:default-tuolumne1138-0 Request processed in 101us (150us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851877.886992:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1cc38e5 nid 10320@kfi7 refs 2
00000800:00000200:21.0:1773851877.886994:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 10320@kfi7(0000000092c31a6a):0x0 lsk 285 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000011c Transaction freed
00000100:00100000:23.0:1773851877.886996:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10384@kfi7, seq: 1998011
00000100:00000040:23.0:1773851877.886997:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac8a319a : new rpc_count 0
00000100:00000001:23.0:1773851877.886998:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851877.886999:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851877.887000:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851877.887001:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851877.887002:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004686297a.
00000020:00000040:23.0:1773851877.887004:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000ac8a319a : new refcount 4
00000100:00000001:23.0:1773851877.887005:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851877.909334:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851877.909335:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851877.909336:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851877.909338:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851877.909340:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.909342:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.152@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851877.909343:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851877.909344:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851877.909345:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.152@o2ib600 to cpt 1
00000400:00000200:17.0:1773851877.909349:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000089b1dd9b nid 172.19.3.152@o2ib600 refs 2
00000400:00000200:17.0:1773851877.909350:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000089b1dd9b nid 172.19.3.152@o2ib600 refs 3
00000400:00000200:17.0:1773851877.909351:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.152@o2ib600 to cpt 1
00000400:00000200:17.0:1773851877.909353:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.152@o2ib600 of length 224 into portal 12 MB=0x699f51ba52d00
00000400:00000200:17.0:1773851877.909354:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.152@o2ib600 of length 224/224 into md 0x793926dc5 [64] + 150520
00000800:00000200:17.0:1773851877.909357:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851877.909358:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851877.909359:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851877.909361:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851877.909361:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851877.909362:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b24dec72.
00000100:00000040:17.0:1773851877.909363:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b24dec72 x1858127870110976 msgsize 224
00000100:00100000:17.0:1773851877.909365:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.152@o2ib600 (source: 12345-172.19.3.152@o2ib600)
00000100:00000001:17.0:1773851877.909367:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851877.909368:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851877.909369:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851877.909371:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851877.909372:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851877.909373:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851877.909374:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851877.909375:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851877.909377:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858127870110976
00000020:00000001:7.0:1773851877.909378:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851877.909379:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a5d
00000020:00000001:7.0:1773851877.909380:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851877.909381:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e4ac7e36 refcount=6
00000020:00000001:7.0:1773851877.909383:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627771392 : -107123081780224 : ffff9e9276c36400)
00000020:00000001:7.0:1773851877.909384:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627771392 : -107123081780224 : ffff9e9276c36400)
00000100:00000001:7.0:1773851877.909386:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851877.909387:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851877.909388:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5e8bc3e.
00000020:00000010:7.0:1773851877.909390:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851877.909391:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851877.909392:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851877.909393:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851877.909394:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.909395:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851877.909396:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851877.909397:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851877.909398:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851877.909401:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851877.909401:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851877.909401:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851877.909401:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851877.909403:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.152@o2ib600, seq: 2001943
00000100:00000040:4.0:1773851877.909403:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e4ac7e36 : new rpc_count 1
00000100:00000001:7.0:1773851877.909404:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851877.909404:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144552204160 : -106929157347456 : ffff9ebf9d8f6780)
00000100:00000001:7.0:1773851877.909405:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851877.909405:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b24dec72 x1858127870110976/t0(0) o400->bf97a379-93af-4849-8153-06c10eba2d4d@172.19.3.152@o2ib600:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic2-0'
00000100:00000001:4.0:1773851877.909408:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851877.909408:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851877.909409:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b24dec72 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:bf97a379-93af-4849-8153-06c10eba2d4d+6:26664:x1858127870110976:12345-172.19.3.152@o2ib600:400:login-oslic2-0
00000100:00000200:4.0:1773851877.909411:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858127870110976
00000020:00000001:4.0:1773851877.909411:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851877.909412:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851877.909413:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851877.909413:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851877.909414:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851877.909415:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851877.909415:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858127870110976, found 0 last_xid 1858127870110975
00000020:00000001:4.0:1773851877.909416:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851877.909417:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851877.909417:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851877.909418:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851877.909418:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851877.909419:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851877.909419:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851877.909420:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000004817707.
02000000:00000001:4.0:1773851877.909421:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851877.909421:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851877.909422:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851877.909423:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183217098306, transno 0, xid 1858127870110976
00010000:00000001:4.0:1773851877.909424:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851877.909425:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b24dec72 x1858127870110976/t0(0) o400->bf97a379-93af-4849-8153-06c10eba2d4d@172.19.3.152@o2ib600:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic2-0'
00010000:00000001:4.0:1773851877.909427:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851877.909427:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851877.909428:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=109 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851877.909429:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851877.909430:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000092d009a1 refcount 3 to 172.19.3.152@o2ib600
00000100:00000001:4.0:1773851877.909431:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612992 : -107130477938624 : ffff9e90bdeaf840)
02000000:00000001:4.0:1773851877.909431:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851877.909432:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851877.909432:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851877.909433:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.152@o2ib600
00000400:00000010:4.0:1773851877.909434:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6473a15.
00000100:00000200:4.0:1773851877.909435:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858127870110976, offset 224
00000400:00000200:4.0:1773851877.909436:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.152@o2ib600
00000400:00000200:4.0:1773851877.909437:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.152@o2ib600 to cpt 1
00000400:00000200:4.0:1773851877.909438:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000089b1dd9b nid 172.19.3.152@o2ib600 refs 2
00000400:00000200:4.0:1773851877.909439:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000089b1dd9b nid 172.19.3.152@o2ib600 refs 3
00000400:00000200:4.0:1773851877.909441:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000089b1dd9b nid 172.19.3.152@o2ib600 refs 4
00000400:00000200:4.0:1773851877.909442:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.152@o2ib600 routed destination
00000400:00000200:4.0:1773851877.909443:0:61015:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:4.0:1773851877.909444:0:61015:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:4.0:1773851877.909445:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.152@o2ib600: rtr pref emtpy: 1
00000400:00000200:4.0:1773851877.909446:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:4.0:1773851877.909447:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.152@o2ib600: rtr pref emtpy: 1
00000400:00000200:4.0:1773851877.909448:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:4.0:1773851877.909449:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769587:8769587:1024:4294967295] 17@kfi7 LPNI seq info [1250891907:1250891907:16:4294967295]
00000400:00000200:4.0:1773851877.909450:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:4.0:1773851877.909451:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:4.0:1773851877.909453:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.152@o2ib600(172.19.3.152@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851877.909455:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000089b1dd9b nid 172.19.3.152@o2ib600 refs 3
00000800:00000200:4.0:1773851877.909457:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851877.909458:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851877.909460:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851877.909462:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:4.0:1773851877.909465:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:4.0:1773851877.909466:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851877.909468:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851877.909469:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000092d009a1 refcount 2 to 172.19.3.152@o2ib600
00010000:00000001:4.0:1773851877.909470:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851877.909470:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851877.909471:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851877.909472:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b24dec72 x1858127870110976/t0(0) o400->bf97a379-93af-4849-8153-06c10eba2d4d@172.19.3.152@o2ib600:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic2-0'
00000100:00100000:4.0:1773851877.909476:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b24dec72 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:bf97a379-93af-4849-8153-06c10eba2d4d+6:26664:x1858127870110976:12345-172.19.3.152@o2ib600:400:login-oslic2-0 Request processed in 67us (112us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851877.909478:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.152@o2ib600, seq: 2001943
00000100:00000040:4.0:1773851877.909479:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e4ac7e36 : new rpc_count 0
00000100:00000001:4.0:1773851877.909480:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851877.909480:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851877.909481:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:4.0:1773851877.909482:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000020:00000010:4.0:1773851877.909483:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5e8bc3e.
00000020:00000040:4.0:1773851877.909483:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e4ac7e36 : new refcount 5
00000100:00000001:4.0:1773851877.909484:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851877.909491:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851877.909494:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851877.909496:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:5.0:1773851877.909497:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6473a15
00000400:00000010:5.0:1773851877.909498:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6473a15.
00000100:00000001:5.0:1773851877.909499:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851877.909500:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851877.909501:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:5.0:1773851877.909504:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Transaction freed
00000800:00000200:25.0:1773851877.913020:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851877.913021:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851877.913022:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851877.913024:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851877.913026:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21057@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.913027:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21057@kfi7 : PUT - for me
00000400:00000200:25.0:1773851877.913028:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21057@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.913029:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000609b6d7f nid 21057@kfi7 refs 1
00000400:00000200:25.0:1773851877.913031:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21057@kfi7 to cpt 6
00000400:00000200:25.0:1773851877.913031:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000609b6d7f nid 21057@kfi7 refs 2
00000400:00000200:25.0:1773851877.913032:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000609b6d7f nid 21057@kfi7 refs 3
00000400:00000200:25.0:1773851877.913033:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21121@kfi7 to cpt 2
00000400:00000200:25.0:1773851877.913034:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21121@kfi7 of length 224 into portal 12 MB=0x69b0a8bd19100
00000400:00000200:25.0:1773851877.913035:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21121@kfi7 of length 224/224 into md 0x16159c9699 [64] + 24344
00000800:00000200:25.0:1773851877.913036:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851877.913038:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851877.913039:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21057@kfi7: PUT: OK
00000100:00000001:25.0:1773851877.913040:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851877.913040:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851877.913042:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000046e60a1d.
00000100:00000040:25.0:1773851877.913043:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000046e60a1d x1859319458009344 msgsize 224
00000100:00100000:25.0:1773851877.913044:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-21121@kfi7 (source: 12345-21057@kfi7)
00000100:00000001:25.0:1773851877.913045:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851877.913046:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851877.913046:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000609b6d7f nid 21057@kfi7 refs 2
02000000:00000001:27.0:1773851877.913047:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851877.913047:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851877.913047:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851877.913048:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851877.913049:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851877.913049:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319458009344
00000020:00000001:27.0:1773851877.913050:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851877.913050:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92585
00000020:00000001:27.0:1773851877.913051:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851877.913053:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004621c6d8 refcount=6
00000020:00000001:27.0:1773851877.913054:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630761472 : -107123078790144 : ffff9e9276f10400)
00000020:00000001:27.0:1773851877.913055:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630761472 : -107123078790144 : ffff9e9276f10400)
00000100:00000001:27.0:1773851877.913056:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851877.913057:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851877.913057:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851877.913058:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851877.913059:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851877.913060:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851877.913061:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851877.913061:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851877.913062:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851877.913062:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851877.913063:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.913064:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851877.913065:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851877.913065:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851877.913066:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851877.913066:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21121@kfi7, seq: 2025136
00000100:00000001:26.0:1773851877.913066:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851877.913067:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004621c6d8 : new rpc_count 1
00000100:00000001:26.0:1773851877.913067:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.913068:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637027291344128 : -107046418207488 : ffff9ea45044ad00)
00000100:00000001:26.0:1773851877.913068:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851877.913069:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000046e60a1d x1859319458009344/t0(0) o400->edc14252-7f1f-470f-b3ed-8778885511d8@21121@kfi7:94/0 lens 224/0 e 0 to 0 dl 1773852209 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1812-0'
00000100:00000001:27.0:1773851877.913072:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851877.913072:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851877.913073:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046e60a1d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:edc14252-7f1f-470f-b3ed-8778885511d8+6:39657:x1859319458009344:12345-21121@kfi7:400:default-tuolumne1812-0
00000100:00000200:27.0:1773851877.913074:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319458009344
00000020:00000001:27.0:1773851877.913075:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851877.913075:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851877.913076:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.913077:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851877.913077:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851877.913078:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851877.913079:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319458009344, found 0 last_xid 1859319458009343
00000020:00000001:27.0:1773851877.913080:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851877.913081:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851877.913081:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851877.913082:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.913083:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851877.913083:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851877.913084:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851877.913084:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000069dc7ab.
02000000:00000001:27.0:1773851877.913085:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.913085:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.913086:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851877.913087:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044161933, transno 0, xid 1859319458009344
00010000:00000001:27.0:1773851877.913087:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851877.913088:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000046e60a1d x1859319458009344/t0(0) o400->edc14252-7f1f-470f-b3ed-8778885511d8@21121@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1812-0'
00010000:00000001:27.0:1773851877.913090:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851877.913091:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851877.913092:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=110 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851877.913093:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851877.913093:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000075b82fb1 refcount 3 to 21121@kfi7
00000100:00000001:27.0:1773851877.913094:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810485888 : -107154899065728 : ffff9e8b0e4e2480)
02000000:00000001:27.0:1773851877.913095:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851877.913095:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851877.913096:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851877.913096:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21057@kfi7
00000400:00000010:27.0:1773851877.913097:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ff7a8930.
00000100:00000200:27.0:1773851877.913098:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859319458009344, offset 224
00000400:00000200:27.0:1773851877.913099:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21057@kfi7
00000400:00000200:27.0:1773851877.913100:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21057@kfi7 to cpt 6
00000400:00000200:27.0:1773851877.913101:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000609b6d7f nid 21057@kfi7 refs 1
00000400:00000200:27.0:1773851877.913102:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000609b6d7f nid 21057@kfi7 refs 2
00000400:00000200:27.0:1773851877.913103:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000609b6d7f nid 21057@kfi7 refs 3
00000400:00000200:27.0:1773851877.913104:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21057@kfi7 local destination
00000400:00000200:27.0:1773851877.913105:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769588:8769588:1024:4294967295] 21057@kfi7 LPNI seq info [9091860:9091860:16:4294967295]
00000400:00000200:27.0:1773851877.913107:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000609b6d7f nid 21057@kfi7 refs 2
00000400:00000200:27.0:1773851877.913107:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21057@kfi7 to cpt 6
00000400:00000200:27.0:1773851877.913109:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21057@kfi7(21057@kfi7:21057@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851877.913110:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000609b6d7f nid 21057@kfi7 refs 3
00000800:00000200:27.0:1773851877.913112:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851877.913113:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851877.913115:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851877.913117:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1049 Using peer 21057@kfi7(0x1049)
00000800:00000200:27.0:1773851877.913120:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0x1049: rc=0
00000800:00000200:27.0:1773851877.913121:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1049 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851877.913123:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851877.913124:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000075b82fb1 refcount 2 to 21121@kfi7
00010000:00000001:27.0:1773851877.913125:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851877.913125:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851877.913126:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851877.913127:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000046e60a1d x1859319458009344/t0(0) o400->edc14252-7f1f-470f-b3ed-8778885511d8@21121@kfi7:94/0 lens 224/224 e 0 to 0 dl 1773852209 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1812-0'
00000100:00100000:27.0:1773851877.913129:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046e60a1d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:edc14252-7f1f-470f-b3ed-8778885511d8+6:39657:x1859319458009344:12345-21121@kfi7:400:default-tuolumne1812-0 Request processed in 57us (86us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851877.913132:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21121@kfi7, seq: 2025136
00000100:00000040:27.0:1773851877.913132:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004621c6d8 : new rpc_count 0
00000100:00000001:27.0:1773851877.913133:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851877.913133:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851877.913133:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1049 TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851877.913134:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851877.913134:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851877.913135:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851877.913135:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21057@kfi7: PUT: OK
00000020:00000010:27.0:1773851877.913136:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000020:00000040:27.0:1773851877.913136:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000004621c6d8 : new refcount 5
00000400:00000200:25.0:1773851877.913136:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ff7a8930
00000100:00000001:27.0:1773851877.913137:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851877.913137:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ff7a8930.
00000100:00000001:25.0:1773851877.913137:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851877.913138:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851877.913138:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000609b6d7f nid 21057@kfi7 refs 2
00000800:00000200:25.0:1773851877.913140:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 21057@kfi7(0000000007c776c5):0x0 lsk 4170 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1049 Transaction freed
00000800:00000200:1.0:1773851877.931613:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851877.931614:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851877.931615:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851877.931617:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851877.931619:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25778@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.931621:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25778@kfi7 : PUT - for me
00000400:00000200:1.0:1773851877.931621:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25778@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.931622:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079fca6f7 nid 25778@kfi7 refs 1
00000400:00000200:1.0:1773851877.931623:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25778@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.931624:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079fca6f7 nid 25778@kfi7 refs 2
00000400:00000200:1.0:1773851877.931625:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000079fca6f7 nid 25778@kfi7 refs 3
00000400:00000200:1.0:1773851877.931625:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25715@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.931626:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25715@kfi7 of length 224 into portal 12 MB=0x699e463d9db80
00000400:00000200:1.0:1773851877.931628:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25715@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 37584
00000800:00000200:1.0:1773851877.931629:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851877.931631:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.931632:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25778@kfi7: PUT: OK
00000100:00000001:1.0:1773851877.931633:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851877.931633:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851877.931635:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000051ee02e8.
00000100:00000040:1.0:1773851877.931636:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000051ee02e8 x1858056067079040 msgsize 224
00000100:00100000:1.0:1773851877.931637:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25715@kfi7 (source: 12345-25778@kfi7)
00000100:00000001:1.0:1773851877.931638:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851877.931639:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000079fca6f7 nid 25778@kfi7 refs 2
00000100:00000001:0.0:1773851877.931640:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851877.931640:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851877.931641:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851877.931641:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851877.931641:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851877.931642:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851877.931643:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858056067079040
00000020:00000001:0.0:1773851877.931643:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851877.931644:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926ea
00000020:00000001:0.0:1773851877.931644:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851877.931646:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000094b5a163 refcount=6
00000020:00000001:0.0:1773851877.931647:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631265280 : -107123078286336 : ffff9e9276f8b400)
00000020:00000001:0.0:1773851877.931647:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631265280 : -107123078286336 : ffff9e9276f8b400)
00000100:00000001:0.0:1773851877.931648:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.931649:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851877.931650:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851877.931651:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.931652:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851877.931652:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851877.931653:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851877.931653:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851877.931654:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851877.931655:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851877.931655:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.931656:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851877.931657:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851877.931658:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851877.931658:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851877.931658:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851877.931659:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25715@kfi7, seq: 1997582
00000100:00000001:1.0:1773851877.931660:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851877.931660:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000094b5a163 : new rpc_count 1
00000100:00000001:1.0:1773851877.931661:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.931661:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134783684480 : -106938925867136 : ffff9ebd574f9f80)
00000100:00000040:0.0:1773851877.931662:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000051ee02e8 x1858056067079040/t0(0) o400->5ace861d-f5d0-4cca-a6a7-ca00b5032b7d@25715@kfi7:517/0 lens 224/0 e 0 to 0 dl 1773852632 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2090-0'
00000100:00000001:0.0:1773851877.931665:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.931665:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851877.931666:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051ee02e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5ace861d-f5d0-4cca-a6a7-ca00b5032b7d+6:39761:x1858056067079040:12345-25715@kfi7:400:default-tuolumne2090-0
00000100:00000200:0.0:1773851877.931668:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858056067079040
00000020:00000001:0.0:1773851877.931669:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851877.931669:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851877.931670:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.931671:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851877.931671:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851877.931672:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851877.931672:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858056067079040, found 0 last_xid 1858056067079039
00000020:00000001:0.0:1773851877.931673:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851877.931674:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851877.931674:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851877.931675:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.931676:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851877.931676:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851877.931677:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851877.931678:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a23f72cc.
02000000:00000001:0.0:1773851877.931679:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.931679:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.931680:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851877.931681:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106669663, transno 0, xid 1858056067079040
00010000:00000001:0.0:1773851877.931682:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851877.931683:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000051ee02e8 x1858056067079040/t0(0) o400->5ace861d-f5d0-4cca-a6a7-ca00b5032b7d@25715@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2090-0'
00010000:00000001:0.0:1773851877.931685:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851877.931686:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851877.931686:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=110 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851877.931688:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851877.931688:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003a2b40fa refcount 3 to 25715@kfi7
00000100:00000001:0.0:1773851877.931689:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379072 : -107155980172544 : ffff9e8acdddc300)
02000000:00000001:0.0:1773851877.931690:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851877.931690:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.931691:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851877.931692:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25778@kfi7
00000400:00000010:0.0:1773851877.931693:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b7cd9ccd.
00000100:00000200:0.0:1773851877.931694:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858056067079040, offset 224
00000400:00000200:0.0:1773851877.931695:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25778@kfi7
00000400:00000200:0.0:1773851877.931696:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25778@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.931697:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000079fca6f7 nid 25778@kfi7 refs 1
00000400:00000200:0.0:1773851877.931698:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000079fca6f7 nid 25778@kfi7 refs 2
00000400:00000200:0.0:1773851877.931699:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000079fca6f7 nid 25778@kfi7 refs 3
00000400:00000200:0.0:1773851877.931701:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25778@kfi7 local destination
00000400:00000200:0.0:1773851877.931703:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769589:8769589:1024:4294967295] 25778@kfi7 LPNI seq info [1875683:1875683:16:4294967295]
00000400:00000200:0.0:1773851877.931705:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000079fca6f7 nid 25778@kfi7 refs 2
00000400:00000200:0.0:1773851877.931706:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25778@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.931709:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25778@kfi7(25778@kfi7:25778@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851877.931711:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000079fca6f7 nid 25778@kfi7 refs 3
00000800:00000200:0.0:1773851877.931713:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851877.931715:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851877.931719:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851877.931723:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa98 Using peer 25778@kfi7(0xa98)
00000800:00000200:0.0:1773851877.931734:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0xa98: rc=0
00000800:00000200:0.0:1773851877.931737:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa98 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851877.931740:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851877.931742:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003a2b40fa refcount 2 to 25715@kfi7
00010000:00000001:0.0:1773851877.931746:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851877.931746:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.931747:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851877.931749:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000051ee02e8 x1858056067079040/t0(0) o400->5ace861d-f5d0-4cca-a6a7-ca00b5032b7d@25715@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2090-0'
00000100:00100000:0.0:1773851877.931755:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051ee02e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5ace861d-f5d0-4cca-a6a7-ca00b5032b7d+6:39761:x1858056067079040:12345-25715@kfi7:400:default-tuolumne2090-0 Request processed in 88us (117us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851877.931759:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25715@kfi7, seq: 1997582
00000100:00000040:0.0:1773851877.931761:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000094b5a163 : new rpc_count 0
00000100:00000001:0.0:1773851877.931762:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851877.931763:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851877.931764:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.931765:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851877.931767:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000020:00000040:0.0:1773851877.931768:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000094b5a163 : new refcount 5
00000100:00000001:0.0:1773851877.931769:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851877.931778:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa98 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851877.931781:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.931783:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25778@kfi7: PUT: OK
00000400:00000200:1.0:1773851877.931785:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b7cd9ccd
00000400:00000010:1.0:1773851877.931786:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b7cd9ccd.
00000100:00000001:1.0:1773851877.931787:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851877.931788:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851877.931790:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000079fca6f7 nid 25778@kfi7 refs 2
00000800:00000200:1.0:1773851877.931793:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 25778@kfi7(000000006d31cfa0):0x0 lsk 2713 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa98 Transaction freed
00000800:00000200:13.0:1773851877.952203:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851877.952204:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851877.952205:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851877.952207:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851877.952209:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.952210:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13872@kfi7 : PUT - for me
00000400:00000200:13.0:1773851877.952212:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.952213:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 1
00000400:00000200:13.0:1773851877.952215:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.952216:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000400:00000200:13.0:1773851877.952217:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 3
00000400:00000200:13.0:1773851877.952218:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.952219:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13872@kfi7 of length 224 into portal 12 MB=0x69b0a0dfe1000
00000400:00000200:13.0:1773851877.952220:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13872@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 39088
00000800:00000200:13.0:1773851877.952222:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851877.952224:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851877.952225:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13872@kfi7: PUT: OK
00000100:00000001:13.0:1773851877.952226:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851877.952226:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851877.952227:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000053c2879d.
00000100:00000040:13.0:1773851877.952227:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000053c2879d x1859317346996224 msgsize 224
00000100:00100000:13.0:1773851877.952229:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13872@kfi7 (source: 12345-13872@kfi7)
00000100:00000001:13.0:1773851877.952230:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851877.952231:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851877.952231:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 2
02000000:00000001:15.0:1773851877.952232:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851877.952232:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851877.952232:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851877.952233:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851877.952234:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851877.952235:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317346996224
00000020:00000001:15.0:1773851877.952236:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851877.952236:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918d5
00000020:00000001:15.0:1773851877.952237:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851877.952241:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000371a9e8c refcount=6
00000020:00000001:15.0:1773851877.952241:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241980928 : -107152467570688 : ffff9e8b9f3bd000)
00000020:00000001:15.0:1773851877.952242:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241980928 : -107152467570688 : ffff9e8b9f3bd000)
00000100:00000001:15.0:1773851877.952243:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.952244:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851877.952245:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000087969700.
00000020:00000010:15.0:1773851877.952246:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851877.952247:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851877.952247:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851877.952248:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851877.952248:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.952249:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851877.952250:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851877.952250:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.952251:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.952252:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851877.952252:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851877.952253:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851877.952253:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851877.952254:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13872@kfi7, seq: 2289871
00000100:00000040:15.0:1773851877.952254:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000371a9e8c : new rpc_count 1
00000100:00000001:12.0:1773851877.952254:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.952255:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902252544 : -106994807299072 : ffff9eb05484a400)
00000100:00000001:12.0:1773851877.952255:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.952256:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000053c2879d x1859317346996224/t0(0) o400->e6c6fc0a-49cd-4dc8-a85a-543fd4d76558@13872@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1357-0'
00000100:00000001:15.0:1773851877.952259:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.952259:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851877.952260:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053c2879d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e6c6fc0a-49cd-4dc8-a85a-543fd4d76558+6:39840:x1859317346996224:12345-13872@kfi7:400:default-tuolumne1357-0
00000100:00000200:15.0:1773851877.952261:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317346996224
00000020:00000001:15.0:1773851877.952265:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851877.952265:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851877.952266:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.952267:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851877.952267:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851877.952268:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851877.952268:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317346996224, found 0 last_xid 1859317346996223
00000020:00000001:15.0:1773851877.952269:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851877.952270:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851877.952270:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851877.952271:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.952271:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851877.952272:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851877.952272:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851877.952273:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d450e38c.
02000000:00000001:15.0:1773851877.952273:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.952274:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.952275:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851877.952275:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317346996224
00010000:00000001:15.0:1773851877.952276:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851877.952277:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000053c2879d x1859317346996224/t0(0) o400->e6c6fc0a-49cd-4dc8-a85a-543fd4d76558@13872@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1357-0'
00010000:00000001:15.0:1773851877.952279:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851877.952280:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851877.952281:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=110 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851877.952282:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851877.952282:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cceb951d refcount 5 to 13872@kfi7
00000100:00000001:15.0:1773851877.952283:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928521907776 : -107145187643840 : ffff9e8d5126ae40)
02000000:00000001:15.0:1773851877.952284:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851877.952284:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.952285:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851877.952286:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13872@kfi7
00000400:00000010:15.0:1773851877.952286:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9765a66.
00000100:00000200:15.0:1773851877.952287:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317346996224, offset 224
00000400:00000200:15.0:1773851877.952289:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13872@kfi7
00000400:00000200:15.0:1773851877.952290:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.952291:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 1
00000400:00000200:15.0:1773851877.952292:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000400:00000200:15.0:1773851877.952293:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 3
00000400:00000200:15.0:1773851877.952294:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13872@kfi7 local destination
00000400:00000200:15.0:1773851877.952296:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769590:8769590:1024:4294967295] 13872@kfi7 LPNI seq info [1102685:1102685:16:4294967295]
00000400:00000200:15.0:1773851877.952297:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000400:00000200:15.0:1773851877.952298:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13872@kfi7 to cpt 3
00000400:00000200:15.0:1773851877.952300:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13872@kfi7(13872@kfi7:13872@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851877.952301:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 3
00000800:00000200:15.0:1773851877.952302:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851877.952303:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851877.952305:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851877.952307:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000045a Using peer 13872@kfi7(0x10000000000045a)
00000800:00000200:15.0:1773851877.952310:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x10000000000045a: rc=0
00000800:00000200:15.0:1773851877.952311:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000045a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851877.952314:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851877.952314:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cceb951d refcount 4 to 13872@kfi7
00010000:00000001:15.0:1773851877.952315:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851877.952315:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851877.952316:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851877.952317:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000053c2879d x1859317346996224/t0(0) o400->e6c6fc0a-49cd-4dc8-a85a-543fd4d76558@13872@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1357-0'
00000100:00100000:15.0:1773851877.952320:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053c2879d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:e6c6fc0a-49cd-4dc8-a85a-543fd4d76558+6:39840:x1859317346996224:12345-13872@kfi7:400:default-tuolumne1357-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851877.952324:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13872@kfi7, seq: 2289871
00000800:00000200:13.0:1773851877.952324:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000045a TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851877.952325:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000371a9e8c : new rpc_count 0
00000400:00000200:13.0:1773851877.952325:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851877.952326:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851877.952326:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851877.952326:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13872@kfi7: PUT: OK
00000020:00000010:15.0:1773851877.952327:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851877.952327:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9765a66
00000400:00000010:13.0:1773851877.952327:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9765a66.
00000020:00000010:15.0:1773851877.952328:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000100:00000001:13.0:1773851877.952328:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851877.952329:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000087969700.
00000020:00000040:15.0:1773851877.952329:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000371a9e8c : new refcount 5
00000100:00000001:13.0:1773851877.952329:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851877.952330:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851877.952330:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be45948c nid 13872@kfi7 refs 2
00000800:00000200:13.0:1773851877.952331:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 13872@kfi7(00000000a328c9d9):0x0 lsk 1115 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000045a Transaction freed
00000800:00000200:13.0:1773851877.968001:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851877.968002:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851877.968003:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851877.968005:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851877.968006:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10563@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.968010:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10563@kfi7 : PUT - for me
00000400:00000200:13.0:1773851877.968011:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10563@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.968012:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e65a681 nid 10563@kfi7 refs 1
00000400:00000200:13.0:1773851877.968013:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10563@kfi7 to cpt 3
00000400:00000200:13.0:1773851877.968014:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e65a681 nid 10563@kfi7 refs 2
00000400:00000200:13.0:1773851877.968015:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005e65a681 nid 10563@kfi7 refs 3
00000400:00000200:13.0:1773851877.968016:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10626@kfi7 to cpt 4
00000400:00000200:13.0:1773851877.968016:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10626@kfi7 of length 224 into portal 12 MB=0x69b0a8e98fd00
00000400:00000200:13.0:1773851877.968017:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10626@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 39312
00000800:00000200:13.0:1773851877.968019:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851877.968020:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851877.968022:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10563@kfi7: PUT: OK
00000100:00000001:13.0:1773851877.968022:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851877.968023:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851877.968023:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e26db4b.
00000100:00000040:13.0:1773851877.968024:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005e26db4b x1859319504633088 msgsize 224
00000100:00100000:13.0:1773851877.968025:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10626@kfi7 (source: 12345-10563@kfi7)
00000100:00000001:13.0:1773851877.968026:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851877.968027:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005e65a681 nid 10563@kfi7 refs 2
00000100:00000001:15.0:1773851877.968028:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851877.968028:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851877.968028:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851877.968028:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851877.968029:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851877.968030:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851877.968030:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319504633088
00000020:00000001:15.0:1773851877.968031:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851877.968031:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e2b
00000020:00000001:15.0:1773851877.968032:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851877.968033:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076fd7a6b refcount=6
00000020:00000001:15.0:1773851877.968034:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239661568 : -107152469890048 : ffff9e8b9f186c00)
00000020:00000001:15.0:1773851877.968035:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239661568 : -107152469890048 : ffff9e8b9f186c00)
00000100:00000001:15.0:1773851877.968036:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851877.968037:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851877.968037:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000087969700.
00000020:00000010:15.0:1773851877.968038:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851877.968038:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000044ca7c72.
00000100:00000001:15.0:1773851877.968039:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851877.968039:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851877.968040:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851877.968040:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851877.968041:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851877.968041:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851877.968042:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851877.968043:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851877.968044:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851877.968044:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851877.968044:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851877.968045:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10626@kfi7, seq: 2289872
00000100:00000001:15.0:1773851877.968046:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851877.968046:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000076fd7a6b : new rpc_count 1
00000100:00000001:15.0:1773851877.968047:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851877.968047:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902258304 : -106994807293312 : ffff9eb05484ba80)
00000100:00000040:12.0:1773851877.968048:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005e26db4b x1859319504633088/t0(0) o400->590e8172-81b3-4fd7-915e-aefe53455967@10626@kfi7:604/0 lens 224/0 e 0 to 0 dl 1773851964 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1160-0'
00000100:00000001:12.0:1773851877.968051:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851877.968051:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851877.968052:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e26db4b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:590e8172-81b3-4fd7-915e-aefe53455967+6:39900:x1859319504633088:12345-10626@kfi7:400:default-tuolumne1160-0
00000100:00000200:12.0:1773851877.968053:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319504633088
00000020:00000001:12.0:1773851877.968054:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851877.968055:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851877.968055:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851877.968056:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851877.968056:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851877.968057:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851877.968057:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319504633088, found 0 last_xid 1859319504633087
00000020:00000001:12.0:1773851877.968058:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851877.968058:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851877.968059:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851877.968059:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851877.968060:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851877.968060:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851877.968061:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851877.968061:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e2ee169c.
02000000:00000001:12.0:1773851877.968062:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851877.968062:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851877.968063:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851877.968063:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596100, transno 0, xid 1859319504633088
00010000:00000001:12.0:1773851877.968064:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851877.968065:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005e26db4b x1859319504633088/t0(0) o400->590e8172-81b3-4fd7-915e-aefe53455967@10626@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1160-0'
00010000:00000001:12.0:1773851877.968067:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851877.968068:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851877.968069:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=110 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851877.968070:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851877.968070:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000020f3bac4 refcount 3 to 10626@kfi7
00000100:00000001:12.0:1773851877.968071:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583901056 : -107156125650560 : ffff9e8ac531f180)
02000000:00000001:12.0:1773851877.968071:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851877.968072:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851877.968073:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851877.968073:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10563@kfi7
00000400:00000010:12.0:1773851877.968074:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e9ba439.
00000100:00000200:12.0:1773851877.968075:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859319504633088, offset 224
00000400:00000200:12.0:1773851877.968076:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10563@kfi7
00000400:00000200:12.0:1773851877.968077:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10563@kfi7 to cpt 3
00000400:00000200:12.0:1773851877.968078:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e65a681 nid 10563@kfi7 refs 1
00000400:00000200:12.0:1773851877.968079:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005e65a681 nid 10563@kfi7 refs 2
00000400:00000200:12.0:1773851877.968080:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005e65a681 nid 10563@kfi7 refs 3
00000400:00000200:12.0:1773851877.968081:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10563@kfi7 local destination
00000400:00000200:12.0:1773851877.968083:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769591:8769591:1024:4294967295] 10563@kfi7 LPNI seq info [37526835:37526835:16:4294967295]
00000400:00000200:12.0:1773851877.968084:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005e65a681 nid 10563@kfi7 refs 2
00000400:00000200:12.0:1773851877.968085:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10563@kfi7 to cpt 3
00000400:00000200:12.0:1773851877.968086:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10563@kfi7(10563@kfi7:10563@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851877.968088:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005e65a681 nid 10563@kfi7 refs 3
00000800:00000200:12.0:1773851877.968090:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851877.968091:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851877.968093:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851877.968095:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000010e Using peer 10563@kfi7(0x10000000000010e)
00000800:00000200:12.0:1773851877.968098:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x10000000000010e: rc=0
00000800:00000200:12.0:1773851877.968100:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000010e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851877.968103:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851877.968104:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000020f3bac4 refcount 2 to 10626@kfi7
00010000:00000001:12.0:1773851877.968105:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851877.968105:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851877.968106:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851877.968106:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e26db4b x1859319504633088/t0(0) o400->590e8172-81b3-4fd7-915e-aefe53455967@10626@kfi7:604/0 lens 224/224 e 0 to 0 dl 1773851964 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1160-0'
00000100:00100000:12.0:1773851877.968111:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e26db4b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:590e8172-81b3-4fd7-915e-aefe53455967+6:39900:x1859319504633088:12345-10626@kfi7:400:default-tuolumne1160-0 Request processed in 59us (86us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851877.968113:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10626@kfi7, seq: 2289872
00000100:00000040:12.0:1773851877.968114:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000076fd7a6b : new rpc_count 0
00000100:00000001:12.0:1773851877.968114:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851877.968115:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851877.968115:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851877.968116:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000044ca7c72.
00000020:00000010:12.0:1773851877.968117:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000087969700.
00000020:00000040:12.0:1773851877.968117:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000076fd7a6b : new refcount 5
00000100:00000001:12.0:1773851877.968118:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851877.968123:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000010e TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851877.968124:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851877.968125:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10563@kfi7: PUT: OK
00000400:00000200:13.0:1773851877.968126:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e9ba439
00000400:00000010:13.0:1773851877.968126:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e9ba439.
00000100:00000001:13.0:1773851877.968127:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851877.968127:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851877.968128:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005e65a681 nid 10563@kfi7 refs 2
00000800:00000200:13.0:1773851877.968129:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10563@kfi7(0000000086f606ed):0x0 lsk 271 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000010e Transaction freed
00000800:00000200:1.0:1773851877.996409:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851877.996409:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851877.996411:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851877.996413:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851877.996415:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10706@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.996416:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10706@kfi7 : PUT - for me
00000400:00000200:1.0:1773851877.996417:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10706@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.996418:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e5c507c3 nid 10706@kfi7 refs 1
00000400:00000200:1.0:1773851877.996419:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10706@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.996419:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e5c507c3 nid 10706@kfi7 refs 2
00000400:00000200:1.0:1773851877.996420:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e5c507c3 nid 10706@kfi7 refs 3
00000400:00000200:1.0:1773851877.996421:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10706@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.996422:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10706@kfi7 of length 224 into portal 12 MB=0x69a9e73faac00
00000400:00000200:1.0:1773851877.996423:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10706@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 37808
00000800:00000200:1.0:1773851877.996425:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851877.996426:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.996427:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10706@kfi7: PUT: OK
00000100:00000001:1.0:1773851877.996428:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851877.996429:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851877.996430:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006fb24a8a.
00000100:00000040:1.0:1773851877.996430:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000006fb24a8a x1858855201582080 msgsize 224
00000100:00100000:1.0:1773851877.996432:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-10706@kfi7 (source: 12345-10706@kfi7)
00000100:00000001:1.0:1773851877.996433:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851877.996434:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e5c507c3 nid 10706@kfi7 refs 2
00000100:00000001:0.0:1773851877.996434:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851877.996435:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851877.996435:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851877.996435:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851877.996436:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851877.996436:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851877.996437:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858855201582080
00000020:00000001:0.0:1773851877.996437:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851877.996438:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9270d
00000020:00000001:0.0:1773851877.996438:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851877.996440:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006fbf1aea refcount=6
00000020:00000001:0.0:1773851877.996441:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631251968 : -107123078299648 : ffff9e9276f88000)
00000020:00000001:0.0:1773851877.996441:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631251968 : -107123078299648 : ffff9e9276f88000)
00000100:00000001:0.0:1773851877.996442:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.996443:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851877.996443:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851877.996444:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.996445:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851877.996446:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851877.996446:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851877.996447:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851877.996447:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851877.996448:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851877.996448:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.996449:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851877.996450:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851877.996451:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851877.996451:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851877.996451:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851877.996452:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10706@kfi7, seq: 1997583
00000100:00000001:1.0:1773851877.996453:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851877.996453:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851877.996453:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006fbf1aea : new rpc_count 1
00000100:00000001:0.0:1773851877.996453:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134783691392 : -106938925860224 : ffff9ebd574fba80)
00000100:00000040:0.0:1773851877.996454:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006fb24a8a x1858855201582080/t0(0) o400->dadc7ec3-140c-4ae7-a98d-8e696224cde5@10706@kfi7:517/0 lens 224/0 e 0 to 0 dl 1773852632 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1157-0'
00000100:00000001:0.0:1773851877.996456:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851877.996457:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851877.996458:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006fb24a8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:dadc7ec3-140c-4ae7-a98d-8e696224cde5+6:39677:x1858855201582080:12345-10706@kfi7:400:default-tuolumne1157-0
00000100:00000200:0.0:1773851877.996459:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858855201582080
00000020:00000001:0.0:1773851877.996459:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851877.996460:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851877.996460:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.996461:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851877.996461:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851877.996462:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851877.996462:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858855201582080, found 0 last_xid 1858855201582079
00000020:00000001:0.0:1773851877.996463:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851877.996464:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851877.996464:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851877.996464:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.996465:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851877.996465:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851877.996466:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851877.996467:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005e3aed91.
02000000:00000001:0.0:1773851877.996467:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.996468:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.996468:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851877.996469:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686877, transno 0, xid 1858855201582080
00010000:00000001:0.0:1773851877.996470:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851877.996470:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006fb24a8a x1858855201582080/t0(0) o400->dadc7ec3-140c-4ae7-a98d-8e696224cde5@10706@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1157-0'
00010000:00000001:0.0:1773851877.996475:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851877.996476:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851877.996476:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=110 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851877.996477:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851877.996478:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0767f1f refcount 3 to 10706@kfi7
00000100:00000001:0.0:1773851877.996479:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530571552 : -107154178980064 : ffff9e8b3939c720)
02000000:00000001:0.0:1773851877.996479:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851877.996480:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851877.996480:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851877.996481:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10706@kfi7
00000400:00000010:0.0:1773851877.996482:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050d1fed3.
00000100:00000200:0.0:1773851877.996482:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858855201582080, offset 224
00000400:00000200:0.0:1773851877.996483:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10706@kfi7
00000400:00000200:0.0:1773851877.996484:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10706@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.996485:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e5c507c3 nid 10706@kfi7 refs 1
00000400:00000200:0.0:1773851877.996486:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e5c507c3 nid 10706@kfi7 refs 2
00000400:00000200:0.0:1773851877.996487:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e5c507c3 nid 10706@kfi7 refs 3
00000400:00000200:0.0:1773851877.996488:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10706@kfi7 local destination
00000400:00000200:0.0:1773851877.996489:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769592:8769592:1024:4294967295] 10706@kfi7 LPNI seq info [1030990:1030990:16:4294967295]
00000400:00000200:0.0:1773851877.996490:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e5c507c3 nid 10706@kfi7 refs 2
00000400:00000200:0.0:1773851877.996491:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10706@kfi7 to cpt 0
00000400:00000200:0.0:1773851877.996493:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10706@kfi7(10706@kfi7:10706@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851877.996494:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e5c507c3 nid 10706@kfi7 refs 3
00000800:00000200:0.0:1773851877.996495:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851877.996496:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851877.996498:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851877.996500:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a2 Using peer 10706@kfi7(0x5a2)
00000800:00000200:0.0:1773851877.996504:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x5a2: rc=0
00000800:00000200:0.0:1773851877.996505:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851877.996507:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851877.996507:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0767f1f refcount 2 to 10706@kfi7
00010000:00000001:0.0:1773851877.996508:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851877.996508:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851877.996509:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851877.996510:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006fb24a8a x1858855201582080/t0(0) o400->dadc7ec3-140c-4ae7-a98d-8e696224cde5@10706@kfi7:517/0 lens 224/224 e 0 to 0 dl 1773852632 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1157-0'
00000100:00100000:0.0:1773851877.996514:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006fb24a8a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:dadc7ec3-140c-4ae7-a98d-8e696224cde5+6:39677:x1858855201582080:12345-10706@kfi7:400:default-tuolumne1157-0 Request processed in 56us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851877.996516:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10706@kfi7, seq: 1997583
00000100:00000040:0.0:1773851877.996516:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006fbf1aea : new rpc_count 0
00000100:00000001:0.0:1773851877.996517:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851877.996517:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851877.996518:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851877.996519:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851877.996519:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000020:00000040:0.0:1773851877.996520:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000006fbf1aea : new refcount 5
00000100:00000001:0.0:1773851877.996520:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851877.996525:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a2 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851877.996527:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851877.996528:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10706@kfi7: PUT: OK
00000400:00000200:1.0:1773851877.996528:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050d1fed3
00000400:00000010:1.0:1773851877.996529:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050d1fed3.
00000100:00000001:1.0:1773851877.996530:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851877.996530:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851877.996531:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e5c507c3 nid 10706@kfi7 refs 2
00000800:00000200:1.0:1773851877.996533:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 10706@kfi7(000000001f344fa0):0x0 lsk 1443 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5a2 Transaction freed
00000800:00000200:2.0:1773851877.997956:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851877.997956:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851877.997957:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851877.997957:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851877.997959:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851877.997959:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:1.0:1773851877.997961:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14481@kfi7(00000000fb43fa82):0xb1f version: 2; local version 2; negotiated version: 2
00000800:00000200:2.0:1773851877.997962:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851877.997963:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f Using peer 14481@kfi7(0x100000000000b1f)
00000400:00000200:2.0:1773851877.997964:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14481@kfi7 to cpt 0
00000400:00000200:2.0:1773851877.997965:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14481@kfi7 : PUT - for me
00000400:00000200:1.0:1773851877.997965:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14481@kfi7 to cpt 0
00000400:00000200:2.0:1773851877.997966:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14481@kfi7 to cpt 0
00000400:00000200:2.0:1773851877.997967:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e31def3 nid 14481@kfi7 refs 1
00000800:00000200:1.0:1773851877.997967:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 38 bytes to peer 0x100000000000b1f: rc=0
00000400:00000200:2.0:1773851877.997969:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14481@kfi7 to cpt 0
00000800:00000200:1.0:1773851877.997969:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851877.997970:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e31def3 nid 14481@kfi7 refs 2
00000400:00000200:2.0:1773851877.997971:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002e31def3 nid 14481@kfi7 refs 3
00000400:00000200:2.0:1773851877.997972:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14416@kfi7 to cpt 1
00000400:00000200:2.0:1773851877.997973:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14416@kfi7 of length 456 into portal 12 MB=0x69b4b990178c0
00000400:00000200:2.0:1773851877.997974:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14416@kfi7 of length 456/456 into md 0x7fb56e801 [64] + 38032
00000800:00000200:2.0:1773851877.997976:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009005aa0b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851877.997980:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851877.997981:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14481@kfi7: PUT: OK
00000100:00000001:2.0:1773851877.997982:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:3.0:1773851877.997983:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f TN_EVENT_TX_OK event status 0
00000100:00000200:2.0:1773851877.997983:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851877.997984:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bea580ab.
00000100:00000040:2.0:1773851877.997984:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000bea580ab x1859598852126912 msgsize 456
00000800:00000200:3.0:1773851877.997986:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f Transaction freed
00000100:00100000:2.0:1773851877.997986:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-14416@kfi7 (source: 12345-14481@kfi7)
00000100:00000001:2.0:1773851877.997987:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851877.997988:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002e31def3 nid 14481@kfi7 refs 2
00000800:00000200:2.0:1773851877.997989:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009005aa0b: 2054@kfi7:0 <- 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851877.997989:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851877.997989:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851877.997990:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851877.997990:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851877.997991:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851877.997991:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598852126912
00000020:00000001:1.0:1773851877.997992:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851877.997992:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389274d9
00000020:00000001:1.0:1773851877.997993:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851877.997996:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000af15ad0 refcount=5
00000020:00000001:1.0:1773851877.997997:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130178666496 : -106943530885120 : ffff9ebc44d4a000)
00000020:00000001:1.0:1773851877.997997:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130178666496 : -106943530885120 : ffff9ebc44d4a000)
00000100:00000001:1.0:1773851877.997998:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851877.997999:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851877.997999:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851877.998000:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851877.998001:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851877.998002:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851877.998002:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851877.998003:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851877.998004:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851877.998005:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851877.998006:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851877.998006:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851877.998007:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:1.0:1773851877.998007:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14416@kfi7, seq: 408701480
00000100:00000001:2.0:1773851877.998008:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851877.998008:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851877.998008:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000af15ad0 : new rpc_count 1
00000100:00000001:2.0:1773851877.998009:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851877.998009:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120706804096 : -106953002747520 : ffff9eba10437980)
00000100:00000040:1.0:1773851877.998010:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bea580ab x1859598852126912/t0(0) o17->7ffff185-dc24-4f2d-b76d-cc468e1cb97b@14416@kfi7:604/0 lens 456/0 e 0 to 0 dl 1773851964 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1394-0'
00000100:00000001:1.0:1773851877.998012:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851877.998013:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851877.998014:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bea580ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7ffff185-dc24-4f2d-b76d-cc468e1cb97b+5:39554:x1859598852126912:12345-14416@kfi7:17:default-tuolumne1394-0
00000100:00000200:1.0:1773851877.998015:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598852126912
00000020:00000001:1.0:1773851877.998016:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851877.998016:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851877.998017:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851877.998017:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851877.998018:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:1.0:1773851877.998019:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851877.998019:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598852126912, found 0 last_xid 1859598852126911
00000020:00000001:1.0:1773851877.998020:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851877.998020:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851877.998021:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851877.998021:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851877.998022:0:60951:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:1.0:1773851877.998023:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851877.998023:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851877.998025:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000025c0fa71.
02000000:00000001:1.0:1773851877.998026:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851877.998026:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851877.998027:0:60951:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:1.0:1773851877.998028:0:60951:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:1.0:1773851877.998029:0:60951:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:1.0:1773851877.998031:0:60951:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851877.998031:0:60951:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:1.0:1773851877.998032:0:60951:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7ffff185-dc24-4f2d-b76d-cc468e1cb97b/000000000af15ad0 free: 126633370845184 avail: 126633368748032
00000020:00000001:1.0:1773851877.998033:0:60951:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:1.0:1773851877.998034:0:60951:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7ffff185-dc24-4f2d-b76d-cc468e1cb97b/000000000af15ad0 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:1.0:1773851877.998035:0:60951:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:1.0:1773851877.998036:0:60951:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:1.0:1773851877.998037:0:60951:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 7ffff185-dc24-4f2d-b76d-cc468e1cb97b/000000000af15ad0 reports grant 1812987903 dropped 0, local 1881145343
00000020:00000001:1.0:1773851877.998038:0:60951:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:1.0:1773851877.998038:0:60951:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:1.0:1773851877.998039:0:60951:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851877.998039:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691410, transno 0, xid 1859598852126912
00010000:00000001:1.0:1773851877.998040:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851877.998041:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bea580ab x1859598852126912/t0(0) o17->7ffff185-dc24-4f2d-b76d-cc468e1cb97b@14416@kfi7:604/0 lens 456/432 e 0 to 0 dl 1773851964 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1394-0'
00010000:00000001:1.0:1773851877.998043:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851877.998044:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851877.998044:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=110 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851877.998045:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851877.998046:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ceb9ff84 refcount 3 to 14416@kfi7
00000100:00000001:1.0:1773851877.998047:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410272 : -107145304141344 : ffff9e8d4a3511e0)
02000000:00000001:1.0:1773851877.998048:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851877.998048:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851877.998049:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851877.998049:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14481@kfi7
00000400:00000010:1.0:1773851877.998050:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f672ead.
00000100:00000200:1.0:1773851877.998051:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598852126912, offset 224
00000400:00000200:1.0:1773851877.998052:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14481@kfi7
00000400:00000200:1.0:1773851877.998052:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14481@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.998053:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e31def3 nid 14481@kfi7 refs 1
00000400:00000200:1.0:1773851877.998054:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002e31def3 nid 14481@kfi7 refs 2
00000400:00000200:1.0:1773851877.998056:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002e31def3 nid 14481@kfi7 refs 3
00000400:00000200:1.0:1773851877.998057:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14481@kfi7 local destination
00000400:00000200:1.0:1773851877.998058:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769593:8769593:1024:4294967295] 14481@kfi7 LPNI seq info [732240:732240:16:4294967295]
00000400:00000200:1.0:1773851877.998059:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002e31def3 nid 14481@kfi7 refs 2
00000400:00000200:1.0:1773851877.998060:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14481@kfi7 to cpt 0
00000400:00000200:1.0:1773851877.998063:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14481@kfi7(14481@kfi7:14481@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851877.998064:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002e31def3 nid 14481@kfi7 refs 3
00000800:00000200:1.0:1773851877.998065:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851877.998066:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:1.0:1773851877.998068:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851877.998070:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f Using peer 14481@kfi7(0x100000000000b1f)
00000800:00000200:1.0:1773851877.998073:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 532 bytes to peer 0x100000000000b1f: rc=0
00000800:00000200:1.0:1773851877.998074:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851877.998076:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851877.998076:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ceb9ff84 refcount 2 to 14416@kfi7
00010000:00000001:1.0:1773851877.998077:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851877.998077:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851877.998078:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851877.998079:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bea580ab x1859598852126912/t0(0) o17->7ffff185-dc24-4f2d-b76d-cc468e1cb97b@14416@kfi7:604/0 lens 456/432 e 0 to 0 dl 1773851964 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1394-0'
00000100:00100000:1.0:1773851877.998082:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bea580ab pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7ffff185-dc24-4f2d-b76d-cc468e1cb97b+5:39554:x1859598852126912:12345-14416@kfi7:17:default-tuolumne1394-0 Request processed in 68us (97us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851877.998084:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14416@kfi7, seq: 408701480
00000100:00000040:1.0:1773851877.998085:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000af15ad0 : new rpc_count 0
00000100:00000001:1.0:1773851877.998086:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:2.0:1773851877.998087:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851877.998087:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851877.998087:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851877.998088:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000020:00000010:1.0:1773851877.998088:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:2.0:1773851877.998089:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:1.0:1773851877.998089:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000000af15ad0 : new refcount 4
00000400:00000200:2.0:1773851877.998090:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14481@kfi7: PUT: OK
00000100:00000001:1.0:1773851877.998090:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851877.998091:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f672ead
00000400:00000010:2.0:1773851877.998091:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f672ead.
00000100:00000001:2.0:1773851877.998092:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851877.998092:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851877.998093:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002e31def3 nid 14481@kfi7 refs 2
00000800:00000200:2.0:1773851877.998095:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 14481@kfi7(00000000fb43fa82):0x0 lsk 2848 rsk 36 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000b1f Transaction freed
00000800:00000200:17.0:1773851878.004556:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.004557:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.004558:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.004560:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.004562:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17569@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.004563:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17569@kfi7 : PUT - for me
00000400:00000200:17.0:1773851878.004565:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17569@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.004566:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066f8e346 nid 17569@kfi7 refs 1
00000400:00000200:17.0:1773851878.004567:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17569@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.004567:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066f8e346 nid 17569@kfi7 refs 2
00000400:00000200:17.0:1773851878.004568:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000066f8e346 nid 17569@kfi7 refs 3
00000400:00000200:17.0:1773851878.004570:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17568@kfi7 to cpt 1
00000400:00000200:17.0:1773851878.004571:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17568@kfi7 of length 224 into portal 12 MB=0x69b4be8061e80
00000400:00000200:17.0:1773851878.004572:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17568@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 26896
00000800:00000200:17.0:1773851878.004574:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.004576:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.004577:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17569@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.004577:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.004578:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.004579:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006357fd5e.
00000100:00000040:17.0:1773851878.004580:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000006357fd5e x1859600177831552 msgsize 224
00000100:00100000:17.0:1773851878.004581:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-17568@kfi7 (source: 12345-17569@kfi7)
00000100:00000001:17.0:1773851878.004583:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.004584:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000066f8e346 nid 17569@kfi7 refs 2
00000800:00000200:17.0:1773851878.004585:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851878.004588:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851878.004588:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851878.004589:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851878.004589:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851878.004590:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851878.004591:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600177831552
00000020:00000001:17.0:1773851878.004591:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851878.004592:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81ca3
00000020:00000001:17.0:1773851878.004592:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851878.004595:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000057c732ae refcount=5
00000020:00000001:17.0:1773851878.004595:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636994755066880 : -107078954484736 : ffff9e9cbcf47c00)
00000020:00000001:17.0:1773851878.004596:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636994755066880 : -107078954484736 : ffff9e9cbcf47c00)
00000100:00000001:17.0:1773851878.004597:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.004598:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851878.004598:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b96cd922.
00000020:00000010:17.0:1773851878.004600:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.004601:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851878.004602:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851878.004602:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851878.004603:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.004604:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851878.004604:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851878.004604:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.004605:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.004607:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851878.004607:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851878.004607:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851878.004607:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851878.004608:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17568@kfi7, seq: 2156369
00000100:00000040:17.0:1773851878.004609:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000057c732ae : new rpc_count 1
00000100:00000001:16.0:1773851878.004609:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851878.004609:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.004610:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985321728 : -106952724229888 : ffff9eba20dd5100)
00000100:00000040:17.0:1773851878.004611:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006357fd5e x1859600177831552/t0(0) o400->4b6c066c-46e1-4a1e-a265-5e2ebaeedead@17568@kfi7:99/0 lens 224/0 e 0 to 0 dl 1773852214 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1584-0'
00000100:00000001:17.0:1773851878.004613:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.004614:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851878.004615:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006357fd5e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4b6c066c-46e1-4a1e-a265-5e2ebaeedead+5:39554:x1859600177831552:12345-17568@kfi7:400:default-tuolumne1584-0
00000100:00000200:17.0:1773851878.004616:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600177831552
00000020:00000001:17.0:1773851878.004617:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851878.004617:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851878.004618:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.004619:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851878.004619:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851878.004620:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851878.004620:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600177831552, found 0 last_xid 1859600177831551
00000020:00000001:17.0:1773851878.004621:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851878.004622:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851878.004622:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851878.004623:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.004624:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851878.004624:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851878.004624:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851878.004625:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000e9023ef.
02000000:00000001:17.0:1773851878.004627:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.004627:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.004628:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851878.004629:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104680052, transno 0, xid 1859600177831552
00010000:00000001:17.0:1773851878.004629:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851878.004630:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006357fd5e x1859600177831552/t0(0) o400->4b6c066c-46e1-4a1e-a265-5e2ebaeedead@17568@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1584-0'
00010000:00000001:17.0:1773851878.004633:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851878.004633:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851878.004634:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=111 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851878.004635:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851878.004636:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000089c80545 refcount 3 to 17568@kfi7
00000100:00000001:17.0:1773851878.004636:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702112 : -107156155849504 : ffff9e8ac36524e0)
02000000:00000001:17.0:1773851878.004637:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851878.004638:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.004639:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851878.004639:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17569@kfi7
00000400:00000010:17.0:1773851878.004640:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2680273.
00000100:00000200:17.0:1773851878.004640:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600177831552, offset 224
00000400:00000200:17.0:1773851878.004642:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17569@kfi7
00000400:00000200:17.0:1773851878.004643:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17569@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.004643:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066f8e346 nid 17569@kfi7 refs 1
00000400:00000200:17.0:1773851878.004645:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000066f8e346 nid 17569@kfi7 refs 2
00000400:00000200:17.0:1773851878.004646:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000066f8e346 nid 17569@kfi7 refs 3
00000400:00000200:17.0:1773851878.004647:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17569@kfi7 local destination
00000400:00000200:17.0:1773851878.004648:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769594:8769594:1024:4294967295] 17569@kfi7 LPNI seq info [16664299:16664299:16:4294967295]
00000400:00000200:17.0:1773851878.004649:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000066f8e346 nid 17569@kfi7 refs 2
00000400:00000200:17.0:1773851878.004650:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17569@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.004652:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17569@kfi7(17569@kfi7:17569@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851878.004653:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000066f8e346 nid 17569@kfi7 refs 3
00000800:00000200:17.0:1773851878.004654:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.004655:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851878.004658:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.004660:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000229 Using peer 17569@kfi7(0x100000000000229)
00000800:00000200:17.0:1773851878.004663:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x100000000000229: rc=0
00000800:00000200:17.0:1773851878.004665:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000229 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851878.004667:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.004668:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000089c80545 refcount 2 to 17568@kfi7
00010000:00000001:17.0:1773851878.004668:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851878.004669:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.004670:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851878.004670:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006357fd5e x1859600177831552/t0(0) o400->4b6c066c-46e1-4a1e-a265-5e2ebaeedead@17568@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1584-0'
00000100:00100000:17.0:1773851878.004673:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006357fd5e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4b6c066c-46e1-4a1e-a265-5e2ebaeedead+5:39554:x1859600177831552:12345-17568@kfi7:400:default-tuolumne1584-0 Request processed in 59us (93us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851878.004676:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17568@kfi7, seq: 2156369
00000100:00000040:17.0:1773851878.004676:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000057c732ae : new rpc_count 0
00000800:00000200:19.0:1773851878.004677:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000229 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851878.004677:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851878.004678:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851878.004678:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:19.0:1773851878.004679:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851878.004679:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:19.0:1773851878.004680:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17569@kfi7: PUT: OK
00000020:00000010:17.0:1773851878.004680:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b96cd922.
00000020:00000040:17.0:1773851878.004680:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000057c732ae : new refcount 4
00000400:00000200:19.0:1773851878.004681:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2680273
00000400:00000010:19.0:1773851878.004681:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2680273.
00000100:00000001:17.0:1773851878.004681:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851878.004682:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851878.004682:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851878.004683:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000066f8e346 nid 17569@kfi7 refs 2
00000800:00000200:19.0:1773851878.004685:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17569@kfi7(00000000d68bc87d):0x0 lsk 554 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000229 Transaction freed
00000800:00000200:21.0:1773851878.022493:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851878.022493:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851878.022494:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851878.022496:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851878.022498:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25235@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.022499:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25235@kfi7 : PUT - for me
00000400:00000200:21.0:1773851878.022500:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25235@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.022500:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089bfd08 nid 25235@kfi7 refs 1
00000400:00000200:21.0:1773851878.022502:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25235@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.022502:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089bfd08 nid 25235@kfi7 refs 2
00000400:00000200:21.0:1773851878.022503:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000089bfd08 nid 25235@kfi7 refs 3
00000400:00000200:21.0:1773851878.022504:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25234@kfi7 to cpt 2
00000400:00000200:21.0:1773851878.022504:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25234@kfi7 of length 224 into portal 12 MB=0x699e09d08a4c0
00000400:00000200:21.0:1773851878.022505:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25234@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 47888
00000800:00000200:21.0:1773851878.022507:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851878.022508:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851878.022509:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25235@kfi7: PUT: OK
00000100:00000001:21.0:1773851878.022510:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851878.022510:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851878.022511:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c484e6ab.
00000100:00000040:21.0:1773851878.022512:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c484e6ab x1858039846577344 msgsize 224
00000100:00100000:21.0:1773851878.022513:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25234@kfi7 (source: 12345-25235@kfi7)
00000100:00000001:21.0:1773851878.022514:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851878.022515:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000089bfd08 nid 25235@kfi7 refs 2
00000100:00000001:23.0:1773851878.022517:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851878.022517:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851878.022518:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851878.022519:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851878.022520:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851878.022521:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851878.022522:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039846577344
00000020:00000001:23.0:1773851878.022523:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851878.022524:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91635
00000020:00000001:23.0:1773851878.022525:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851878.022529:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7ec5d7a refcount=10
00000020:00000001:23.0:1773851878.022530:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241267200 : -107152468284416 : ffff9e8b9f30ec00)
00000020:00000001:23.0:1773851878.022531:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241267200 : -107152468284416 : ffff9e8b9f30ec00)
00000100:00000001:23.0:1773851878.022533:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.022534:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851878.022535:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004686297a.
00000020:00000010:23.0:1773851878.022536:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851878.022538:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851878.022539:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851878.022540:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851878.022540:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.022542:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851878.022543:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851878.022543:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.022545:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.022547:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851878.022547:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851878.022548:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851878.022548:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851878.022549:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25234@kfi7, seq: 1998012
00000100:00000040:23.0:1773851878.022550:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7ec5d7a : new rpc_count 1
00000100:00000001:23.0:1773851878.022551:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794381696 : -106943915169920 : ffff9ebc2dece780)
00000100:00000001:20.0:1773851878.022551:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851878.022552:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.022553:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c484e6ab x1858039846577344/t0(0) o400->315d3ba4-b3ae-4fd2-b314-9376ebbb9010@25234@kfi7:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2070-0'
00000100:00000001:23.0:1773851878.022558:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.022559:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851878.022560:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c484e6ab pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:315d3ba4-b3ae-4fd2-b314-9376ebbb9010+10:39706:x1858039846577344:12345-25234@kfi7:400:default-tuolumne2070-0
00000100:00000200:23.0:1773851878.022562:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039846577344
00000020:00000001:23.0:1773851878.022563:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851878.022564:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851878.022565:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.022566:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851878.022567:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851878.022569:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851878.022570:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039846577344, found 0 last_xid 1858039846577343
00000020:00000001:23.0:1773851878.022571:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851878.022572:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851878.022573:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851878.022573:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.022574:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851878.022575:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851878.022576:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851878.022577:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000588d8800.
02000000:00000001:23.0:1773851878.022578:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.022579:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.022580:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851878.022581:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182743635887, transno 0, xid 1858039846577344
00010000:00000001:23.0:1773851878.022582:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851878.022584:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c484e6ab x1858039846577344/t0(0) o400->315d3ba4-b3ae-4fd2-b314-9376ebbb9010@25234@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2070-0'
00010000:00000001:23.0:1773851878.022588:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851878.022589:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851878.022590:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=111 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851878.022592:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851878.022593:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ebb89ce2 refcount 3 to 25234@kfi7
00000100:00000001:23.0:1773851878.022594:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810488000 : -107154899063616 : ffff9e8b0e4e2cc0)
02000000:00000001:23.0:1773851878.022595:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851878.022596:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.022597:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851878.022599:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25235@kfi7
00000400:00000010:23.0:1773851878.022599:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a342ba58.
00000100:00000200:23.0:1773851878.022601:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039846577344, offset 224
00000400:00000200:23.0:1773851878.022603:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25235@kfi7
00000400:00000200:23.0:1773851878.022604:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25235@kfi7 to cpt 5
00000400:00000200:23.0:1773851878.022605:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000089bfd08 nid 25235@kfi7 refs 1
00000400:00000200:23.0:1773851878.022607:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000089bfd08 nid 25235@kfi7 refs 2
00000400:00000200:23.0:1773851878.022609:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000089bfd08 nid 25235@kfi7 refs 3
00000400:00000200:23.0:1773851878.022611:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25235@kfi7 local destination
00000400:00000200:23.0:1773851878.022613:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769595:8769595:1024:4294967295] 25235@kfi7 LPNI seq info [38914:38914:16:4294967295]
00000400:00000200:23.0:1773851878.022615:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000089bfd08 nid 25235@kfi7 refs 2
00000400:00000200:23.0:1773851878.022617:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25235@kfi7 to cpt 5
00000400:00000200:23.0:1773851878.022620:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25235@kfi7(25235@kfi7:25235@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851878.022622:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000089bfd08 nid 25235@kfi7 refs 3
00000800:00000200:23.0:1773851878.022624:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851878.022626:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851878.022629:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851878.022633:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000dd6 Using peer 25235@kfi7(0x100000000000dd6)
00000800:00000200:23.0:1773851878.022638:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x100000000000dd6: rc=0
00000800:00000200:23.0:1773851878.022640:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000dd6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851878.022643:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.022645:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ebb89ce2 refcount 2 to 25234@kfi7
00010000:00000001:23.0:1773851878.022646:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851878.022647:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.022648:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851878.022649:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c484e6ab x1858039846577344/t0(0) o400->315d3ba4-b3ae-4fd2-b314-9376ebbb9010@25234@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2070-0'
00000800:00000200:21.0:1773851878.022650:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000dd6 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851878.022652:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851878.022652:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25235@kfi7: PUT: OK
00000400:00000200:21.0:1773851878.022653:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a342ba58
00000100:00100000:23.0:1773851878.022654:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c484e6ab pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:315d3ba4-b3ae-4fd2-b314-9376ebbb9010+10:39706:x1858039846577344:12345-25234@kfi7:400:default-tuolumne2070-0 Request processed in 95us (141us total) trans 0 rc 0/0
00000400:00000010:21.0:1773851878.022654:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a342ba58.
00000100:00000001:21.0:1773851878.022654:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851878.022654:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851878.022655:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000089bfd08 nid 25235@kfi7 refs 2
00000800:00000200:21.0:1773851878.022656:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25235@kfi7(00000000ce2c6e6e):0x0 lsk 3543 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000dd6 Transaction freed
00000100:00100000:23.0:1773851878.022658:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25234@kfi7, seq: 1998012
00000100:00000040:23.0:1773851878.022659:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7ec5d7a : new rpc_count 0
00000100:00000001:23.0:1773851878.022660:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851878.022661:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851878.022662:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851878.022664:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851878.022665:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004686297a.
00000020:00000040:23.0:1773851878.022666:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000a7ec5d7a : new refcount 9
00000100:00000001:23.0:1773851878.022667:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851878.047125:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.047125:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.047127:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.047129:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.047132:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.047133:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22771@kfi7 : PUT - for me
00000400:00000200:17.0:1773851878.047134:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.047135:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 1
00000400:00000200:17.0:1773851878.047136:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.047136:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:17.0:1773851878.047137:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 3
00000400:00000200:17.0:1773851878.047138:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22579@kfi7 to cpt 1
00000400:00000200:17.0:1773851878.047139:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22579@kfi7 of length 224 into portal 12 MB=0x69b4c77cd2cc0
00000400:00000200:17.0:1773851878.047140:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22579@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 27120
00000800:00000200:17.0:1773851878.047142:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.047143:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.047144:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22771@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.047145:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.047146:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.047146:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d3f01a9.
00000100:00000040:17.0:1773851878.047147:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009d3f01a9 x1859602590018752 msgsize 224
00000100:00100000:17.0:1773851878.047148:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22579@kfi7 (source: 12345-22771@kfi7)
00000100:00000001:17.0:1773851878.047150:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.047151:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000800:00000200:17.0:1773851878.047152:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851878.047154:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851878.047155:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851878.047155:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851878.047156:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851878.047157:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851878.047157:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602590018752
00000020:00000001:17.0:1773851878.047158:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851878.047158:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7abc5
00000020:00000001:17.0:1773851878.047159:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851878.047160:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ce28a53c refcount=407
00000020:00000001:17.0:1773851878.047161:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119298217984 : -106954411333632 : ffff9eb9bc4e2800)
00000020:00000001:17.0:1773851878.047162:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119298217984 : -106954411333632 : ffff9eb9bc4e2800)
00000100:00000001:17.0:1773851878.047163:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.047163:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851878.047164:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097472cd0.
00000020:00000010:17.0:1773851878.047165:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.047166:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851878.047166:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851878.047167:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851878.047167:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.047168:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851878.047169:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851878.047169:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.047170:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.047171:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851878.047171:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851878.047172:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851878.047172:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851878.047173:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22579@kfi7, seq: 2156370
00000100:00000040:17.0:1773851878.047173:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ce28a53c : new rpc_count 9
00000100:00000001:16.0:1773851878.047173:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.047174:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985309056 : -106952724242560 : ffff9eba20dd1f80)
00000100:00000001:16.0:1773851878.047174:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.047175:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009d3f01a9 x1859602590018752/t0(0) o400->2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7@22579@kfi7:99/0 lens 224/0 e 0 to 0 dl 1773852214 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1897-0'
00000100:00000001:17.0:1773851878.047178:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.047178:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851878.047179:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d3f01a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7+407:39519:x1859602590018752:12345-22579@kfi7:400:default-tuolumne1897-0
00000100:00000200:17.0:1773851878.047180:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602590018752
00000020:00000001:17.0:1773851878.047181:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851878.047182:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851878.047182:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.047183:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851878.047184:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851878.047184:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851878.047185:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602590018752, found 0 last_xid 1859602583200319
00000020:00000001:17.0:1773851878.047186:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851878.047187:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851878.047187:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851878.047188:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.047188:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851878.047189:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851878.047189:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851878.047190:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b3ee48c3.
02000000:00000001:17.0:1773851878.047191:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.047191:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.047192:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851878.047193:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592937, transno 0, xid 1859602590018752
00010000:00000001:17.0:1773851878.047194:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851878.047194:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009d3f01a9 x1859602590018752/t0(0) o400->2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7@22579@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1897-0'
00010000:00000001:17.0:1773851878.047197:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851878.047197:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851878.047198:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=111 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851878.047199:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851878.047200:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ff5c9ebe refcount 3 to 22579@kfi7
00000100:00000001:17.0:1773851878.047200:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703744 : -107156155847872 : ffff9e8ac3652b40)
02000000:00000001:17.0:1773851878.047201:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851878.047202:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.047202:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851878.047203:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22771@kfi7
00000400:00000010:17.0:1773851878.047204:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012f08013.
00000100:00000200:17.0:1773851878.047204:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602590018752, offset 224
00000400:00000200:17.0:1773851878.047206:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22771@kfi7
00000400:00000200:17.0:1773851878.047206:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.047207:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 1
00000400:00000200:17.0:1773851878.047208:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:17.0:1773851878.047209:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 3
00000400:00000200:17.0:1773851878.047210:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22771@kfi7 local destination
00000400:00000200:17.0:1773851878.047212:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769596:8769596:1024:4294967295] 22771@kfi7 LPNI seq info [3370901:3370901:16:4294967295]
00000400:00000200:17.0:1773851878.047214:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:17.0:1773851878.047214:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.047216:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22771@kfi7(22771@kfi7:22771@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851878.047217:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 3
00000800:00000200:17.0:1773851878.047219:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.047220:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851878.047222:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.047224:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10a4 Using peer 22771@kfi7(0x10a4)
00000800:00000200:17.0:1773851878.047226:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x10a4: rc=0
00000800:00000200:17.0:1773851878.047228:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851878.047230:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.047231:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ff5c9ebe refcount 2 to 22579@kfi7
00010000:00000001:17.0:1773851878.047232:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851878.047232:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.047233:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851878.047233:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d3f01a9 x1859602590018752/t0(0) o400->2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7@22579@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1897-0'
00000100:00100000:17.0:1773851878.047236:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d3f01a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7+407:39519:x1859602590018752:12345-22579@kfi7:400:default-tuolumne1897-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851878.047239:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22579@kfi7, seq: 2156370
00000100:00000040:17.0:1773851878.047239:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ce28a53c : new rpc_count 8
00000800:00000200:19.0:1773851878.047240:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10a4 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851878.047240:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851878.047241:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851878.047241:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:19.0:1773851878.047242:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851878.047242:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:19.0:1773851878.047243:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22771@kfi7: PUT: OK
00000020:00000010:17.0:1773851878.047243:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097472cd0.
00000400:00000200:19.0:1773851878.047244:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012f08013
00000400:00000010:19.0:1773851878.047244:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012f08013.
00000020:00000040:17.0:1773851878.047244:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000ce28a53c : new refcount 406
00000100:00000001:19.0:1773851878.047245:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851878.047245:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851878.047245:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851878.047246:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000800:00000200:19.0:1773851878.047248:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 22771@kfi7(000000009b8e779e):0x0 lsk 4261 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10a4 Transaction freed
00000800:00000200:17.0:1773851878.057315:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.057316:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.057317:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.057319:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.057321:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.057322:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.28@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851878.057323:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.057324:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851878.057325:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.28@o2ib60 to cpt 5
00000400:00000200:17.0:1773851878.057326:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fe72501 nid 192.168.128.28@o2ib60 refs 2
00000400:00000200:17.0:1773851878.057327:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006fe72501 nid 192.168.128.28@o2ib60 refs 3
00000400:00000200:17.0:1773851878.057329:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.28@o2ib60 to cpt 5
00000400:00000200:17.0:1773851878.057330:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.28@o2ib60 of length 224 into portal 12 MB=0x69b2338e21800
00000400:00000200:17.0:1773851878.057331:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.28@o2ib60 of length 224/224 into md 0x6a32cacf5 [64] + 48112
00000800:00000200:17.0:1773851878.057333:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.057334:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.057336:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.057337:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.057337:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.057338:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000086cf5214.
00000100:00000040:17.0:1773851878.057338:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000086cf5214 x1859425440765952 msgsize 224
00000100:00100000:17.0:1773851878.057340:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.28@o2ib60 (source: 12345-192.168.128.28@o2ib60)
00000100:00000001:17.0:1773851878.057342:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.057343:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851878.057344:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851878.057345:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851878.057346:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851878.057346:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851878.057347:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851878.057347:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851878.057348:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859425440765952
00000020:00000001:23.0:1773851878.057349:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851878.057349:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2ced96
00000020:00000001:23.0:1773851878.057350:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851878.057355:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077f1e4d3 refcount=6
00000020:00000001:23.0:1773851878.057355:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637078041626624 : -106995667924992 : ffff9eb021388800)
00000020:00000001:23.0:1773851878.057356:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637078041626624 : -106995667924992 : ffff9eb021388800)
00000100:00000001:23.0:1773851878.057357:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.057358:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851878.057359:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ed998973.
00000020:00000010:23.0:1773851878.057360:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851878.057360:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851878.057361:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851878.057362:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851878.057362:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.057363:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851878.057364:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851878.057364:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.057365:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.057366:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851878.057367:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851878.057367:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851878.057367:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851878.057368:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.28@o2ib60, seq: 1998013
00000100:00000040:23.0:1773851878.057369:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077f1e4d3 : new rpc_count 2
00000100:00000001:20.0:1773851878.057369:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.057370:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985305600 : -106952724246016 : ffff9eba20dd1200)
00000100:00000001:20.0:1773851878.057370:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.057371:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000086cf5214 x1859425440765952/t0(0) o400->1c1023c5-d856-425e-a99b-21ffbcbac060@192.168.128.28@o2ib60:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix28-0'
00000100:00000001:23.0:1773851878.057374:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.057374:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851878.057376:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086cf5214 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:1c1023c5-d856-425e-a99b-21ffbcbac060+6:39967:x1859425440765952:12345-192.168.128.28@o2ib60:400:default-matrix28-0
00000100:00000200:23.0:1773851878.057377:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859425440765952
00000020:00000001:23.0:1773851878.057377:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851878.057378:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851878.057379:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.057379:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851878.057380:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851878.057381:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851878.057381:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859425440765952, found 0 last_xid 1859425440757759
00000020:00000001:23.0:1773851878.057382:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851878.057383:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851878.057383:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851878.057384:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.057384:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851878.057385:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851878.057385:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851878.057386:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004686297a.
02000000:00000001:23.0:1773851878.057386:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.057387:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.057388:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851878.057388:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182562245015, transno 0, xid 1859425440765952
00010000:00000001:23.0:1773851878.057389:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851878.057390:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000086cf5214 x1859425440765952/t0(0) o400->1c1023c5-d856-425e-a99b-21ffbcbac060@192.168.128.28@o2ib60:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix28-0'
00010000:00000001:23.0:1773851878.057392:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851878.057393:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851878.057393:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=111 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851878.057395:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851878.057396:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000775a6ffd refcount 3 to 192.168.128.28@o2ib60
00000100:00000001:23.0:1773851878.057397:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424335136 : -107145285216480 : ffff9e8d4b55d720)
02000000:00000001:23.0:1773851878.057398:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851878.057398:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.057399:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851878.057400:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.28@o2ib60
00000400:00000010:23.0:1773851878.057400:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000598e4ceb.
00000100:00000200:23.0:1773851878.057401:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859425440765952, offset 224
00000400:00000200:23.0:1773851878.057402:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.28@o2ib60
00000400:00000200:23.0:1773851878.057404:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.28@o2ib60 to cpt 5
00000400:00000200:23.0:1773851878.057405:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fe72501 nid 192.168.128.28@o2ib60 refs 2
00000400:00000200:23.0:1773851878.057406:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006fe72501 nid 192.168.128.28@o2ib60 refs 3
00000400:00000200:23.0:1773851878.057408:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006fe72501 nid 192.168.128.28@o2ib60 refs 4
00000400:00000200:23.0:1773851878.057409:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.28@o2ib60 routed destination
00000400:00000200:23.0:1773851878.057410:0:60934:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851878.057411:0:60934:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:23.0:1773851878.057412:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.28@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851878.057413:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851878.057414:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.28@o2ib60: rtr pref emtpy: 1
00000400:00000200:23.0:1773851878.057415:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851878.057416:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769597:8769597:1024:4294967295] 17@kfi7 LPNI seq info [1250891908:1250891908:16:4294967295]
00000400:00000200:23.0:1773851878.057417:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:23.0:1773851878.057418:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:23.0:1773851878.057420:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.28@o2ib60(192.168.128.28@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851878.057422:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006fe72501 nid 192.168.128.28@o2ib60 refs 3
00000800:00000200:23.0:1773851878.057423:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851878.057424:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851878.057427:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851878.057429:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:23.0:1773851878.057432:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:23.0:1773851878.057434:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851878.057436:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.057437:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000775a6ffd refcount 2 to 192.168.128.28@o2ib60
00010000:00000001:23.0:1773851878.057437:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851878.057438:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.057438:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851878.057439:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000086cf5214 x1859425440765952/t0(0) o400->1c1023c5-d856-425e-a99b-21ffbcbac060@192.168.128.28@o2ib60:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix28-0'
00000100:00100000:23.0:1773851878.057442:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086cf5214 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:1c1023c5-d856-425e-a99b-21ffbcbac060+6:39967:x1859425440765952:12345-192.168.128.28@o2ib60:400:default-matrix28-0 Request processed in 67us (103us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851878.057444:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851878.057445:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.28@o2ib60, seq: 1998013
00000100:00000040:23.0:1773851878.057445:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077f1e4d3 : new rpc_count 1
00000400:00000200:21.0:1773851878.057445:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851878.057446:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851878.057446:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:21.0:1773851878.057446:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000598e4ceb
00000100:00000001:23.0:1773851878.057447:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851878.057447:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000010:21.0:1773851878.057447:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000598e4ceb.
00000100:00000001:21.0:1773851878.057447:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851878.057448:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000100:00000001:21.0:1773851878.057448:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851878.057449:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ed998973.
00000020:00000040:23.0:1773851878.057449:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000077f1e4d3 : new refcount 5
00000400:00000200:21.0:1773851878.057449:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:23.0:1773851878.057450:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851878.057450:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Transaction freed
00000800:00000200:5.0:1773851878.092921:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851878.092922:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851878.092924:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851878.092928:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851878.092931:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8274@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.092933:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8274@kfi7 : PUT - for me
00000400:00000200:5.0:1773851878.092935:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8274@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.092936:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000628eeee nid 8274@kfi7 refs 1
00000400:00000200:5.0:1773851878.092938:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8274@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.092940:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000628eeee nid 8274@kfi7 refs 2
00000400:00000200:5.0:1773851878.092941:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000628eeee nid 8274@kfi7 refs 3
00000400:00000200:5.0:1773851878.092943:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8275@kfi7 to cpt 4
00000400:00000200:5.0:1773851878.092945:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8275@kfi7 of length 224 into portal 12 MB=0x69af03b7a6d80
00000400:00000200:5.0:1773851878.092947:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8275@kfi7 of length 224/224 into md 0x793926dc5 [64] + 150744
00000800:00000200:5.0:1773851878.092950:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851878.092953:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851878.092955:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8274@kfi7: PUT: OK
00000100:00000001:5.0:1773851878.092957:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851878.092958:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851878.092959:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004d4a1efb.
00000100:00000040:5.0:1773851878.092960:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000004d4a1efb x1859206440971648 msgsize 224
00000100:00100000:5.0:1773851878.092963:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-8275@kfi7 (source: 12345-8274@kfi7)
00000100:00000001:5.0:1773851878.092965:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851878.092966:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000628eeee nid 8274@kfi7 refs 2
00000100:00000001:4.0:1773851878.092967:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851878.092968:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851878.092969:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851878.092969:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851878.092969:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851878.092970:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851878.092971:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859206440971648
00000020:00000001:4.0:1773851878.092972:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851878.092973:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92928
00000020:00000001:4.0:1773851878.092974:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851878.092976:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007e281350 refcount=7
00000020:00000001:4.0:1773851878.092977:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743183360 : -107128966368256 : ffff9e911803b400)
00000020:00000001:4.0:1773851878.092978:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743183360 : -107128966368256 : ffff9e911803b400)
00000100:00000001:4.0:1773851878.092979:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851878.092980:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851878.092981:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000590a9782.
00000020:00000010:4.0:1773851878.092983:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851878.092984:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ae5cff2b.
00000100:00000001:4.0:1773851878.092985:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851878.092985:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851878.092986:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.092987:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851878.092988:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851878.092988:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.092990:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.092991:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851878.092992:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851878.092993:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851878.092993:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851878.092993:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8275@kfi7, seq: 2001944
00000100:00000040:4.0:1773851878.092994:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007e281350 : new rpc_count 1
00000100:00000001:7.0:1773851878.092995:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.092995:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637039273397376 : -107034436154240 : ffff9ea71a744c80)
00000100:00000001:7.0:1773851878.092996:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851878.092997:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004d4a1efb x1859206440971648/t0(0) o400->5853c9c4-ca2b-4488-81bc-f1af96abe6d8@8275@kfi7:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1014-0'
00000100:00000001:4.0:1773851878.093000:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851878.093000:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851878.093001:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d4a1efb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5853c9c4-ca2b-4488-81bc-f1af96abe6d8+7:39523:x1859206440971648:12345-8275@kfi7:400:default-tuolumne1014-0
00000100:00000200:4.0:1773851878.093005:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859206440971648
00000020:00000001:4.0:1773851878.093006:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851878.093007:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851878.093008:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.093008:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851878.093009:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851878.093010:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851878.093011:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859206440971648, found 0 last_xid 1859206440430719
00000020:00000001:4.0:1773851878.093012:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851878.093013:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851878.093014:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851878.093014:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.093015:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851878.093016:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851878.093017:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851878.093018:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000055b3f869.
02000000:00000001:4.0:1773851878.093019:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.093019:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.093020:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851878.093021:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252834125, transno 0, xid 1859206440971648
00010000:00000001:4.0:1773851878.093022:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851878.093023:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004d4a1efb x1859206440971648/t0(0) o400->5853c9c4-ca2b-4488-81bc-f1af96abe6d8@8275@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1014-0'
00010000:00000001:4.0:1773851878.093026:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851878.093027:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851878.093028:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=110 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851878.093030:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851878.093030:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000082cda656 refcount 3 to 8275@kfi7
00000100:00000001:4.0:1773851878.093031:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516896 : -107156126034720 : ffff9e8ac52c14e0)
02000000:00000001:4.0:1773851878.093032:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851878.093033:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.093034:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851878.093034:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8274@kfi7
00000400:00000010:4.0:1773851878.093035:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a851431c.
00000100:00000200:4.0:1773851878.093037:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859206440971648, offset 224
00000400:00000200:4.0:1773851878.093038:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8274@kfi7
00000400:00000200:4.0:1773851878.093039:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8274@kfi7 to cpt 1
00000400:00000200:4.0:1773851878.093040:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000628eeee nid 8274@kfi7 refs 1
00000400:00000200:4.0:1773851878.093042:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000628eeee nid 8274@kfi7 refs 2
00000400:00000200:4.0:1773851878.093043:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000628eeee nid 8274@kfi7 refs 3
00000400:00000200:4.0:1773851878.093045:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8274@kfi7 local destination
00000400:00000200:4.0:1773851878.093046:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769598:8769598:1024:4294967295] 8274@kfi7 LPNI seq info [6205236:6205236:16:4294967295]
00000400:00000200:4.0:1773851878.093048:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000628eeee nid 8274@kfi7 refs 2
00000400:00000200:4.0:1773851878.093049:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8274@kfi7 to cpt 1
00000400:00000200:4.0:1773851878.093051:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8274@kfi7(8274@kfi7:8274@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851878.093053:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000628eeee nid 8274@kfi7 refs 3
00000800:00000200:4.0:1773851878.093055:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851878.093056:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851878.093059:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851878.093063:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011a9 Using peer 8274@kfi7(0x1000000000011a9)
00000800:00000200:4.0:1773851878.093066:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x1000000000011a9: rc=0
00000800:00000200:4.0:1773851878.093067:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011a9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851878.093070:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851878.093071:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000082cda656 refcount 2 to 8275@kfi7
00010000:00000001:4.0:1773851878.093071:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851878.093072:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.093073:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851878.093073:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004d4a1efb x1859206440971648/t0(0) o400->5853c9c4-ca2b-4488-81bc-f1af96abe6d8@8275@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1014-0'
00000100:00100000:4.0:1773851878.093078:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d4a1efb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5853c9c4-ca2b-4488-81bc-f1af96abe6d8+7:39523:x1859206440971648:12345-8275@kfi7:400:default-tuolumne1014-0 Request processed in 78us (117us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851878.093084:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8275@kfi7, seq: 2001944
00000100:00000040:4.0:1773851878.093085:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007e281350 : new rpc_count 0
00000100:00000001:4.0:1773851878.093086:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851878.093086:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851878.093087:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851878.093088:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ae5cff2b.
00000020:00000010:4.0:1773851878.093089:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000590a9782.
00000020:00000040:4.0:1773851878.093090:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000007e281350 : new refcount 6
00000100:00000001:4.0:1773851878.093091:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851878.093098:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011a9 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851878.093101:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851878.093103:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8274@kfi7: PUT: OK
00000400:00000200:5.0:1773851878.093105:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a851431c
00000400:00000010:5.0:1773851878.093106:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a851431c.
00000100:00000001:5.0:1773851878.093107:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851878.093108:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851878.093109:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000628eeee nid 8274@kfi7 refs 2
00000800:00000200:5.0:1773851878.093111:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 8274@kfi7(000000002796a701):0x0 lsk 4522 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000011a9 Transaction freed
00000800:00000200:5.0:1773851878.139532:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851878.139532:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851878.139534:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851878.139535:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851878.139537:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25875@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.139538:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25875@kfi7 : PUT - for me
00000400:00000200:5.0:1773851878.139539:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25875@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.139540:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000551b27a nid 25875@kfi7 refs 1
00000400:00000200:5.0:1773851878.139541:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25875@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.139541:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000551b27a nid 25875@kfi7 refs 2
00000400:00000200:5.0:1773851878.139542:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000551b27a nid 25875@kfi7 refs 3
00000400:00000200:5.0:1773851878.139542:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25874@kfi7 to cpt 6
00000400:00000200:5.0:1773851878.139543:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25874@kfi7 of length 224 into portal 12 MB=0x69b4c9b7b2fc0
00000400:00000200:5.0:1773851878.139544:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25874@kfi7 of length 224/224 into md 0x793926dc5 [64] + 150968
00000800:00000200:5.0:1773851878.139546:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851878.139547:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851878.139548:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25875@kfi7: PUT: OK
00000100:00000001:5.0:1773851878.139548:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851878.139548:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851878.139549:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a4c4c29b.
00000100:00000040:5.0:1773851878.139550:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a4c4c29b x1859603188625344 msgsize 224
00000100:00100000:5.0:1773851878.139551:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25874@kfi7 (source: 12345-25875@kfi7)
00000100:00000001:5.0:1773851878.139551:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851878.139552:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000551b27a nid 25875@kfi7 refs 2
00000800:00000200:5.0:1773851878.139553:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851878.139553:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851878.139553:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851878.139554:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851878.139554:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851878.139555:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851878.139555:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603188625344
00000020:00000001:4.0:1773851878.139556:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851878.139556:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e62a1fae8
00000020:00000001:4.0:1773851878.139557:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851878.139558:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c192b922 refcount=5
00000020:00000001:4.0:1773851878.139559:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118814162944 : -106954895388672 : ffff9eb99f741000)
00000020:00000001:4.0:1773851878.139560:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118814162944 : -106954895388672 : ffff9eb99f741000)
00000100:00000001:4.0:1773851878.139560:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851878.139561:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851878.139562:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000590a9782.
00000020:00000010:4.0:1773851878.139562:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851878.139563:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ae5cff2b.
00000100:00000001:4.0:1773851878.139564:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851878.139564:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851878.139565:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.139565:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851878.139566:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851878.139566:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.139567:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851878.139568:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851878.139568:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851878.139569:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851878.139569:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851878.139570:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25874@kfi7, seq: 2001945
00000100:00000040:7.0:1773851878.139570:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c192b922 : new rpc_count 1
00000100:00000001:4.0:1773851878.139570:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.139571:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636993527812608 : -107080181739008 : ffff9e9c73ce1200)
00000100:00000001:4.0:1773851878.139571:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851878.139572:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a4c4c29b x1859603188625344/t0(0) o400->060e715a-c07a-46b5-b454-aa19d2d00c62@25874@kfi7:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2117-0'
00000100:00000001:7.0:1773851878.139577:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851878.139577:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851878.139578:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4c4c29b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:060e715a-c07a-46b5-b454-aa19d2d00c62+5:39594:x1859603188625344:12345-25874@kfi7:400:default-tuolumne2117-0
00000100:00000200:7.0:1773851878.139579:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603188625344
00000020:00000001:7.0:1773851878.139580:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851878.139580:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851878.139581:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851878.139581:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851878.139582:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851878.139582:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851878.139583:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603188625344, found 0 last_xid 1859603188625343
00000020:00000001:7.0:1773851878.139584:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851878.139584:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851878.139584:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851878.139585:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851878.139585:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851878.139586:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851878.139586:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851878.139587:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f5e8bc3e.
02000000:00000001:7.0:1773851878.139588:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.139588:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851878.139589:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851878.139589:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183126141616, transno 0, xid 1859603188625344
00010000:00000001:7.0:1773851878.139590:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851878.139590:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a4c4c29b x1859603188625344/t0(0) o400->060e715a-c07a-46b5-b454-aa19d2d00c62@25874@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2117-0'
00010000:00000001:7.0:1773851878.139593:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851878.139593:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851878.139594:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=110 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851878.139595:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851878.139595:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b77c4f8f refcount 3 to 25874@kfi7
00000100:00000001:7.0:1773851878.139596:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335680 : -107152617215936 : ffff9e8b96506840)
02000000:00000001:7.0:1773851878.139597:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851878.139598:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.139598:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851878.139599:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25875@kfi7
00000400:00000010:7.0:1773851878.139600:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012c6c860.
00000100:00000200:7.0:1773851878.139600:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859603188625344, offset 224
00000400:00000200:7.0:1773851878.139601:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25875@kfi7
00000400:00000200:7.0:1773851878.139602:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25875@kfi7 to cpt 1
00000400:00000200:7.0:1773851878.139603:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000551b27a nid 25875@kfi7 refs 1
00000400:00000200:7.0:1773851878.139604:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000551b27a nid 25875@kfi7 refs 2
00000400:00000200:7.0:1773851878.139605:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000551b27a nid 25875@kfi7 refs 3
00000400:00000200:7.0:1773851878.139606:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25875@kfi7 local destination
00000400:00000200:7.0:1773851878.139607:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769599:8769599:1024:4294967295] 25875@kfi7 LPNI seq info [9140724:9140724:16:4294967295]
00000400:00000200:7.0:1773851878.139608:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000551b27a nid 25875@kfi7 refs 2
00000400:00000200:7.0:1773851878.139609:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25875@kfi7 to cpt 1
00000400:00000200:7.0:1773851878.139610:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25875@kfi7(25875@kfi7:25875@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851878.139611:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000551b27a nid 25875@kfi7 refs 3
00000800:00000200:7.0:1773851878.139613:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851878.139614:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851878.139616:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851878.139618:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004af Using peer 25875@kfi7(0x1000000000004af)
00000800:00000200:7.0:1773851878.139621:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x1000000000004af: rc=0
00000800:00000200:7.0:1773851878.139622:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004af TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851878.139623:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851878.139624:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b77c4f8f refcount 2 to 25874@kfi7
00010000:00000001:7.0:1773851878.139625:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851878.139626:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851878.139626:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851878.139627:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a4c4c29b x1859603188625344/t0(0) o400->060e715a-c07a-46b5-b454-aa19d2d00c62@25874@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2117-0'
00000100:00100000:7.0:1773851878.139630:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4c4c29b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:060e715a-c07a-46b5-b454-aa19d2d00c62+5:39594:x1859603188625344:12345-25874@kfi7:400:default-tuolumne2117-0 Request processed in 52us (80us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851878.139632:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25874@kfi7, seq: 2001945
00000100:00000040:7.0:1773851878.139633:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c192b922 : new rpc_count 0
00000100:00000001:7.0:1773851878.139634:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851878.139634:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:5.0:1773851878.139634:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004af TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851878.139635:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000400:00000200:5.0:1773851878.139635:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851878.139636:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ae5cff2b.
00000020:00000010:7.0:1773851878.139636:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000590a9782.
00000400:00000200:5.0:1773851878.139636:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25875@kfi7: PUT: OK
00000020:00000040:7.0:1773851878.139637:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000c192b922 : new refcount 4
00000400:00000200:5.0:1773851878.139637:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012c6c860
00000100:00000001:7.0:1773851878.139638:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:5.0:1773851878.139638:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012c6c860.
00000100:00000001:5.0:1773851878.139638:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851878.139638:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851878.139639:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000551b27a nid 25875@kfi7 refs 2
00000800:00000200:5.0:1773851878.139640:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 25875@kfi7(00000000f0cbfc54):0x0 lsk 1200 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004af Transaction freed
00000800:00000200:17.0:1773851878.192106:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.192107:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.192108:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.192110:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.192112:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23923@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.192114:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23923@kfi7 : PUT - for me
00000400:00000200:17.0:1773851878.192114:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23923@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.192115:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016f26205 nid 23923@kfi7 refs 1
00000400:00000200:17.0:1773851878.192116:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23923@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.192117:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016f26205 nid 23923@kfi7 refs 2
00000400:00000200:17.0:1773851878.192118:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000016f26205 nid 23923@kfi7 refs 3
00000400:00000200:17.0:1773851878.192119:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23923@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.192120:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23923@kfi7 of length 224 into portal 12 MB=0x699e1136a1340
00000400:00000200:17.0:1773851878.192121:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23923@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 27344
00000800:00000200:17.0:1773851878.192122:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.192125:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.192126:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23923@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.192127:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.192127:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.192128:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000014d73f8.
00000100:00000040:17.0:1773851878.192129:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000014d73f8 x1858041832674112 msgsize 224
00000100:00100000:17.0:1773851878.192131:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23923@kfi7 (source: 12345-23923@kfi7)
00000100:00000001:17.0:1773851878.192132:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.192133:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000016f26205 nid 23923@kfi7 refs 2
00000800:00000200:17.0:1773851878.192135:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851878.192137:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851878.192138:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851878.192139:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851878.192140:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851878.192140:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851878.192141:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041832674112
00000020:00000001:17.0:1773851878.192142:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851878.192142:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ab8
00000020:00000001:17.0:1773851878.192143:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851878.192144:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006544eb5f refcount=6
00000020:00000001:17.0:1773851878.192145:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627746816 : -107123081804800 : ffff9e9276c30400)
00000020:00000001:17.0:1773851878.192146:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627746816 : -107123081804800 : ffff9e9276c30400)
00000100:00000001:17.0:1773851878.192147:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.192148:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851878.192148:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097472cd0.
00000020:00000010:17.0:1773851878.192149:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.192150:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851878.192151:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851878.192152:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851878.192152:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.192153:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851878.192153:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851878.192154:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.192155:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.192156:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851878.192156:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851878.192156:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851878.192156:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851878.192157:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23923@kfi7, seq: 2156371
00000100:00000040:17.0:1773851878.192158:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006544eb5f : new rpc_count 1
00000100:00000001:16.0:1773851878.192158:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.192159:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985300992 : -106952724250624 : ffff9eba20dd0000)
00000100:00000001:16.0:1773851878.192159:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.192160:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000014d73f8 x1858041832674112/t0(0) o400->c591ef48-5fd3-478e-8148-d03138abe968@23923@kfi7:99/0 lens 224/0 e 0 to 0 dl 1773852214 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1978-0'
00000100:00000001:17.0:1773851878.192162:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.192163:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851878.192164:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000014d73f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c591ef48-5fd3-478e-8148-d03138abe968+6:39684:x1858041832674112:12345-23923@kfi7:400:default-tuolumne1978-0
00000100:00000200:17.0:1773851878.192165:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041832674112
00000020:00000001:17.0:1773851878.192166:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851878.192166:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851878.192167:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.192168:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851878.192168:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851878.192169:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851878.192170:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041832674112, found 0 last_xid 1858041832674111
00000020:00000001:17.0:1773851878.192170:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851878.192171:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851878.192171:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851878.192172:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.192173:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851878.192173:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851878.192174:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851878.192174:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b96cd922.
02000000:00000001:17.0:1773851878.192175:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.192176:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.192176:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851878.192177:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183257393263, transno 0, xid 1858041832674112
00010000:00000001:17.0:1773851878.192178:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851878.192178:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000014d73f8 x1858041832674112/t0(0) o400->c591ef48-5fd3-478e-8148-d03138abe968@23923@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1978-0'
00010000:00000001:17.0:1773851878.192181:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851878.192181:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851878.192182:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=111 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851878.192183:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851878.192184:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006ed8cf16 refcount 3 to 23923@kfi7
00000100:00000001:17.0:1773851878.192184:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583952896 : -107156125598720 : ffff9e8ac532bc00)
02000000:00000001:17.0:1773851878.192185:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851878.192186:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.192186:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851878.192187:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23923@kfi7
00000400:00000010:17.0:1773851878.192188:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081e4cca7.
00000100:00000200:17.0:1773851878.192189:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041832674112, offset 224
00000400:00000200:17.0:1773851878.192190:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23923@kfi7
00000400:00000200:17.0:1773851878.192191:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23923@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.192192:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016f26205 nid 23923@kfi7 refs 1
00000400:00000200:17.0:1773851878.192193:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000016f26205 nid 23923@kfi7 refs 2
00000400:00000200:17.0:1773851878.192194:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000016f26205 nid 23923@kfi7 refs 3
00000400:00000200:17.0:1773851878.192195:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23923@kfi7 local destination
00000400:00000200:17.0:1773851878.192196:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769600:8769600:1024:4294967295] 23923@kfi7 LPNI seq info [4287317:4287317:16:4294967295]
00000400:00000200:17.0:1773851878.192197:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000016f26205 nid 23923@kfi7 refs 2
00000400:00000200:17.0:1773851878.192198:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23923@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.192200:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23923@kfi7(23923@kfi7:23923@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851878.192201:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000016f26205 nid 23923@kfi7 refs 3
00000800:00000200:17.0:1773851878.192202:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.192203:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851878.192205:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.192207:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000090 Using peer 23923@kfi7(0x100000000000090)
00000800:00000200:17.0:1773851878.192210:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x100000000000090: rc=0
00000800:00000200:17.0:1773851878.192212:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000090 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851878.192214:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.192215:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006ed8cf16 refcount 2 to 23923@kfi7
00010000:00000001:17.0:1773851878.192215:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851878.192216:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.192216:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851878.192217:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000014d73f8 x1858041832674112/t0(0) o400->c591ef48-5fd3-478e-8148-d03138abe968@23923@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1978-0'
00000100:00100000:17.0:1773851878.192220:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000014d73f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c591ef48-5fd3-478e-8148-d03138abe968+6:39684:x1858041832674112:12345-23923@kfi7:400:default-tuolumne1978-0 Request processed in 57us (90us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851878.192224:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000090 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851878.192224:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23923@kfi7, seq: 2156371
00000400:00000200:19.0:1773851878.192225:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:17.0:1773851878.192225:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006544eb5f : new rpc_count 0
00000400:00000200:19.0:1773851878.192226:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23923@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.192226:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851878.192226:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:19.0:1773851878.192227:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081e4cca7
00000020:00000010:17.0:1773851878.192227:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.192227:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000010:19.0:1773851878.192228:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081e4cca7.
00000100:00000001:19.0:1773851878.192228:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:17.0:1773851878.192228:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097472cd0.
00000100:00000001:19.0:1773851878.192229:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:17.0:1773851878.192229:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000006544eb5f : new refcount 5
00000400:00000200:19.0:1773851878.192230:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000016f26205 nid 23923@kfi7 refs 2
00000100:00000001:17.0:1773851878.192230:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0:1773851878.192231:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 23923@kfi7(00000000ef84b249):0x0 lsk 145 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000090 Transaction freed
00000004:00000001:9.0:1773851878.217731:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:31.0:1773851878.217732:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851878.217732:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:9.0:1773851878.217732:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:5.0:1773851878.217732:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851878.217733:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:30.0:1773851878.217733:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851878.217733:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:9.0:1773851878.217733:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ed65dc4.
00000004:00000001:7.0:1773851878.217733:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851878.217733:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:31.0:1773851878.217734:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fede61b9.
00000004:00000020:30.0:1773851878.217734:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851878.217734:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c668476b.
00000100:00000010:10.0:1773851878.217734:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004139ca59.
00000004:00000020:7.0:1773851878.217734:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:6.0:1773851878.217734:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:31.0:1773851878.217735:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000020:00000040:30.0:1773851878.217735:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000040:10.0:1773851878.217735:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000020:00000040:9.0:1773851878.217735:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000100:00000010:7.0:1773851878.217735:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c40ba58.
00000004:00000020:6.0:1773851878.217735:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851878.217735:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cd156083.
00000100:00000010:5.0:1773851878.217735:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000072253d59.
00000100:00000001:31.0:1773851878.217736:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851878.217736:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:9.0:1773851878.217736:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:9.0:1773851878.217736:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:7.0:1773851878.217736:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851878.217736:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000020:00000040:5.0:1773851878.217736:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
02000000:00000001:31.0:1773851878.217737:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851878.217737:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851878.217737:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851878.217737:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851878.217737:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217737:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851878.217737:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851878.217737:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:31.0:1773851878.217738:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851878.217738:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:10.0:1773851878.217738:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000009c52eb5f.
02000000:00000001:7.0:1773851878.217738:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851878.217738:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851878.217738:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851878.217739:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851878.217739:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851878.217739:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000001:7.0:1773851878.217739:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851878.217739:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851878.217739:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851878.217740:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000005b98a0eb.
02000000:00000010:30.0:1773851878.217740:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000005711a3d9.
00000100:00000001:10.0:1773851878.217740:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851878.217740:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851878.217740:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851878.217740:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000c821af11.
02000000:00000010:6.0:1773851878.217740:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003004e465.
02000000:00000010:5.0:1773851878.217740:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000097fed2c.
00000100:00000001:31.0:1773851878.217741:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.217741:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851878.217741:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004139ca59] to pc [ptlrpcd_02_00+0]  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851878.217741:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851878.217741:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217741:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851878.217741:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851878.217742:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:31.0:1773851878.217742:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.217742:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851878.217742:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217742:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851878.217742:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851878.217742:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851878.217743:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217743:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217743:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851878.217743:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851878.217744:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fede61b9] to pc [ptlrpcd_07_00+0]  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851878.217744:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c668476b] to pc [ptlrpcd_07_03+3]  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851878.217744:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000cd156083] to pc [ptlrpcd_01_02+2]  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851878.217745:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006ed65dc4] to pc [ptlrpcd_02_01+1]  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851878.217745:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004c40ba58] to pc [ptlrpcd_01_03+3]  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851878.217745:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000072253d59] to pc [ptlrpcd_01_00+0]  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851878.217746:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:11.0:1773851878.217747:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851878.217747:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851878.217747:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:10.0:1773851878.217747:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a5c4dee8.
00000100:00000040:11.0:1773851878.217748:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851878.217748:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637132423696384 : -106941285855232 : ffff9ebccaa51000)
00080000:00000001:9.0:1773851878.217748:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851878.217748:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851878.217748:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851878.217748:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000001:30.0:1773851878.217749:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851878.217749:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000010:9.0:1773851878.217749:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b5df4ab7.
00000100:00000040:8.0:1773851878.217749:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851878.217749:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851878.217749:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851878.217750:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851878.217750:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851878.217750:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637060855536640 : -107012854014976 : ffff9eac20d99c00)
00080000:00000001:5.0:1773851878.217750:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851878.217750:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851878.217751:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:30.0:1773851878.217751:0:41089:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:29.0:1773851878.217751:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851878.217751:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851878.217751:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851878.217751:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851878.217751:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00000004:00000010:10.0:1773851878.217751:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f08a797f.
00080000:00000001:9.0:1773851878.217751:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851878.217751:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851878.217751:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:31.0:1773851878.217752:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000026644dfa.
00000100:00000001:30.0:1773851878.217752:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:29.0:1773851878.217752:0:41090:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00000001:29.0:1773851878.217752:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851878.217752:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851878.217752:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:11.0:1773851878.217752:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:10.0:1773851878.217752:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614152671027934ns, next at 614153671026792ns, rc = 0
00080000:00000001:9.0:1773851878.217752:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217752:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851878.217752:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:5.0:1773851878.217752:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e74fa322.
00080000:00000001:5.0:1773851878.217752:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637120408810496 : -106953300741120 : ffff9eb9fe807400)
00000100:00000001:4.0:1773851878.217752:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:31.0:1773851878.217753:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637142427109376 : -106931282442240 : ffff9ebf1ee50800)
00000100:00000001:30.0:1773851878.217753:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851878.217753:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851878.217753:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851878.217753:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851878.217753:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:10.0:1773851878.217753:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00001000:9.0:1773851878.217753:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000040:7.0:1773851878.217753:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851878.217753:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851878.217753:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:31.0:1773851878.217754:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851878.217754:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851878.217754:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851878.217754:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851878.217754:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851878.217754:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851878.217754:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004139ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051932416:37@kfi7:13:default-yuba2-0
00080000:00000001:10.0:1773851878.217754:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:9.0:1773851878.217754:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c76f7615.
00000004:00080000:9.0:1773851878.217754:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614152671030048ns, next at 614153671029066ns, rc = 0
00000100:00000001:8.0:1773851878.217754:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851878.217754:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217754:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851878.217754:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:4.0:1773851878.217754:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.217755:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851878.217755:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851878.217755:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:11.0:1773851878.217755:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:10.0:1773851878.217755:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851878.217755:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851878.217755:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851878.217755:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851878.217755:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851878.217755:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851878.217756:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851878.217756:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:11.0:1773851878.217756:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851878.217756:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:9.0:1773851878.217756:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851878.217756:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006ed65dc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051932480:2060@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851878.217756:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:5.0:1773851878.217756:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000004:00000010:5.0:1773851878.217756:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000842b0298.
00080000:00000001:31.0:1773851878.217757:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851878.217757:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008d4d2444.
00000004:00000001:9.0:1773851878.217757:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851878.217757:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:7.0:1773851878.217757:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217757:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851878.217757:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851878.217757:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614152671032633ns, next at 614153671031711ns, rc = 0
00000004:00001000:31.0:1773851878.217758:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:30.0:1773851878.217758:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851878.217758:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851878.217758:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:11.0:1773851878.217758:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851878.217758:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851878.217758:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851878.217758:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:7.0:1773851878.217758:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851878.217758:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:5.0:1773851878.217758:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00000010:31.0:1773851878.217759:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000587be2c3.
02000000:00000001:30.0:1773851878.217759:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:29.0:1773851878.217759:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851878.217759:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:11.0:1773851878.217759:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000010:11.0:1773851878.217759:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
02000000:00000010:8.0:1773851878.217759:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003d905b3e.
02000000:00000001:8.0:1773851878.217759:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851878.217759:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851878.217759:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cd156083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051932736:36@kfi7:13:default-yuba2-0
02000000:00000001:6.0:1773851878.217759:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851878.217759:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.217759:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851878.217759:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:31.0:1773851878.217760:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614152671035669ns, next at 614153671034617ns, rc = 0
02000000:00000001:30.0:1773851878.217760:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851878.217760:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851878.217760:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005cb89f82.
00000400:00000200:8.0:1773851878.217760:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00100000:6.0:1773851878.217760:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c40ba58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051932672:2074@kfi7:41:default-yuba2-0
00000004:00000001:5.0:1773851878.217760:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851878.217761:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:30.0:1773851878.217761:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fede61b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051932544:60@kfi7:13:default-yuba2-0
00000100:00100000:29.0:1773851878.217761:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c668476b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051932608:13@kfi7:41:default-yuba2-0
00000100:00000200:11.0:1773851878.217761:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932416, portal 4
00000400:00000010:8.0:1773851878.217761:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000001:7.0:1773851878.217761:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:6.0:1773851878.217761:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851878.217761:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851878.217761:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:31.0:1773851878.217762:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.217762:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851878.217762:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:29.0:1773851878.217762:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:11.0:1773851878.217762:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851878.217762:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136770068608 : -106936939483008 : ffff9ebdcdb57080)
00000400:00000010:8.0:1773851878.217762:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
02000000:00000001:7.0:1773851878.217762:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851878.217762:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851878.217762:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851878.217762:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851878.217763:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851878.217763:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851878.217763:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:11.0:1773851878.217763:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851878.217763:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932480, portal 4
00000100:00000001:8.0:1773851878.217763:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:7.0:1773851878.217763:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:6.0:1773851878.217763:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:5.0:1773851878.217763:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851878.217763:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851878.217763:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000072253d59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051932800:2061@kfi7:13:default-yuba2-0
02000000:00000001:30.0:1773851878.217764:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851878.217764:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851878.217764:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:8.0:1773851878.217764:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637067096228992 : -107006613322624 : ffff9ead94d30480)
02000000:00000010:7.0:1773851878.217764:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000079e097e6.
02000000:00000001:7.0:1773851878.217764:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851878.217765:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bbafe549.
02000000:00000001:30.0:1773851878.217765:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851878.217765:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000007e804b7.
00000100:00000040:8.0:1773851878.217765:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:6.0:1773851878.217765:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006d4a620a.
00000400:00000200:30.0:1773851878.217766:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
02000000:00000001:29.0:1773851878.217766:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217766:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851878.217766:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:7.0:1773851878.217766:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
02000000:00000001:6.0:1773851878.217766:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.217766:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851878.217766:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:30.0:1773851878.217767:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000040:11.0:1773851878.217767:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000100:00000001:8.0:1773851878.217767:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:7.0:1773851878.217767:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e33961df.
00000400:00000200:6.0:1773851878.217767:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
02000000:00000001:4.0:1773851878.217767:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851878.217768:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000400:00000200:29.0:1773851878.217768:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:29.0:1773851878.217768:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f9cf276e.
00000400:00000010:11.0:1773851878.217768:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f8443cb8.
00000100:00000200:11.0:1773851878.217768:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932416, offset 0
00000100:00000040:8.0:1773851878.217768:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:8.0:1773851878.217768:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7b495c.
00000400:00000010:6.0:1773851878.217768:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
02000000:00000001:4.0:1773851878.217768:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:29.0:1773851878.217769:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f75d3df.
00000100:00000200:8.0:1773851878.217769:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932480, offset 0
00000100:00000200:7.0:1773851878.217769:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932736, portal 4
00000100:00000001:7.0:1773851878.217769:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:6.0:1773851878.217769:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003599bb60.
02000000:00000010:4.0:1773851878.217769:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000440074eb.
00000100:00000200:30.0:1773851878.217770:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932544, portal 4
00000100:00000001:30.0:1773851878.217770:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:29.0:1773851878.217770:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932608, portal 4
00000400:00000200:11.0:1773851878.217770:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000100:00000001:7.0:1773851878.217770:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814087680 : -107101895463936 : ffff9e976590ec00)
00000100:00000200:6.0:1773851878.217770:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932672, portal 4
02000000:00000001:4.0:1773851878.217770:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.217771:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999080832 : -107038710470784 : ffff9ea61baf6780)
00000100:00000001:29.0:1773851878.217771:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:7.0:1773851878.217771:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851878.217771:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:30.0:1773851878.217772:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851878.217772:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411246848 : -106960298304768 : ffff9eb85d6a1b00)
00000400:00000200:11.0:1773851878.217772:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:8.0:1773851878.217772:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000100:00000001:6.0:1773851878.217772:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309153536 : -106994400398080 : ffff9eb06cc57500)
00000400:00000200:4.0:1773851878.217772:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:11.0:1773851878.217773:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000040:6.0:1773851878.217773:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851878.217773:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000100:00000040:29.0:1773851878.217774:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851878.217774:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:7.0:1773851878.217774:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:30.0:1773851878.217775:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851878.217775:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000010:7.0:1773851878.217775:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c188dd4f.
00000400:00000010:4.0:1773851878.217775:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000615c4c0e.
00000100:00000040:30.0:1773851878.217776:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000100:00000001:29.0:1773851878.217776:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:11.0:1773851878.217776:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000200:7.0:1773851878.217776:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932736, offset 0
00000100:00000001:6.0:1773851878.217776:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:4.0:1773851878.217776:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932800, portal 4
00000400:00000010:30.0:1773851878.217777:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004cd96fcd.
00000400:00000200:11.0:1773851878.217777:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000100:00000001:4.0:1773851878.217777:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:30.0:1773851878.217778:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932544, offset 0
00000100:00000040:29.0:1773851878.217778:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000200:7.0:1773851878.217778:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000100:00000040:6.0:1773851878.217778:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000100:00000001:4.0:1773851878.217778:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637118484826112 : -106955224725504 : ffff9eb98bd2c800)
00000400:00000200:30.0:1773851878.217779:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000010:29.0:1773851878.217779:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c2a5509b.
00000400:00000200:11.0:1773851878.217779:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769596, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769600, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851878.217779:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:6.0:1773851878.217779:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb11c5dc.
00000400:00000200:30.0:1773851878.217780:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000200:29.0:1773851878.217780:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051932608, offset 0
00000400:00000200:7.0:1773851878.217780:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000100:00000200:6.0:1773851878.217780:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051932672, offset 0
00000100:00000040:4.0:1773851878.217780:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851878.217781:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:11.0:1773851878.217781:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851878.217781:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:6.0:1773851878.217781:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:30.0:1773851878.217782:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:29.0:1773851878.217782:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:11.0:1773851878.217782:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851878.217783:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000200:7.0:1773851878.217783:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:30.0:1773851878.217784:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:11.0:1773851878.217784:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769601:8769601:1024:4294967295] 37@kfi7 LPNI seq info [5403396:5403396:16:4294967295]
00000400:00000200:30.0:1773851878.217785:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:11.0:1773851878.217785:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:7.0:1773851878.217785:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000100:00000001:4.0:1773851878.217785:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:11.0:1773851878.217786:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851878.217786:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769601, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769600, p:4294967295, g:4294967295, h:1000]
00000100:00000040:4.0:1773851878.217786:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000200:30.0:1773851878.217787:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769601, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769600, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851878.217787:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000010:4.0:1773851878.217787:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d5c2697.
00000400:00000200:8.0:1773851878.217788:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000100:00000200:4.0:1773851878.217788:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932800, offset 0
00000400:00000200:30.0:1773851878.217789:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851878.217789:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851878.217789:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:7.0:1773851878.217789:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851878.217790:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:7.0:1773851878.217790:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851878.217791:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:7.0:1773851878.217791:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000400:00000200:4.0:1773851878.217791:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:30.0:1773851878.217792:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769602:8769602:1024:4294967295] 60@kfi7 LPNI seq info [5404310:5404310:16:4294967295]
00000400:00000200:8.0:1773851878.217792:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000200:7.0:1773851878.217792:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769603:8769603:1024:4294967295] 36@kfi7 LPNI seq info [5403969:5403969:16:4294967295]
00000400:00000200:30.0:1773851878.217793:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:8.0:1773851878.217793:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769601, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769603, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851878.217794:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:7.0:1773851878.217794:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:8.0:1773851878.217795:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851878.217795:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:29.0:1773851878.217796:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:8.0:1773851878.217796:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851878.217797:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:8.0:1773851878.217797:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000400:00000200:6.0:1773851878.217797:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:30.0:1773851878.217798:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851878.217798:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:8.0:1773851878.217798:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769604:8769604:1024:4294967295] 2060@kfi7 LPNI seq info [5404995:5404995:16:4294967295]
00000400:00000200:6.0:1773851878.217798:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851878.217799:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:7.0:1773851878.217799:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851878.217799:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:30.0:1773851878.217800:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:8.0:1773851878.217800:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:6.0:1773851878.217800:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851878.217801:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:8.0:1773851878.217801:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:7.0:1773851878.217801:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:30.0:1773851878.217802:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:6.0:1773851878.217802:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000400:00000200:29.0:1773851878.217803:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769604, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769603, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851878.217803:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:30.0:1773851878.217804:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851878.217804:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769604, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769603, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851878.217805:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851878.217805:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000800:00000200:7.0:1773851878.217805:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851878.217806:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851878.217806:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851878.217806:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:6.0:1773851878.217806:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851878.217807:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851878.217807:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851878.217807:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000400:00000200:29.0:1773851878.217808:0:41090:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133319, 23133318]
00000800:00000200:8.0:1773851878.217808:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:30.0:1773851878.217809:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Using peer 60@kfi7(0x2000000000001dc)
00000800:00000200:8.0:1773851878.217809:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851878.217809:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851878.217810:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000800:00000200:7.0:1773851878.217810:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000400:00000200:6.0:1773851878.217810:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425166, 23425170]
00000400:00000200:29.0:1773851878.217811:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769605:8769605:1023:4294967295] 13@kfi7 LPNI seq info [23133320:23133320:16:4294967295]
00000800:00000200:30.0:1773851878.217812:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000030498a96: Posted send of 324 bytes to peer 0x2000000000001dc: rc=0
00000800:00000200:8.0:1773851878.217812:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851878.217812:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000400:00000200:29.0:1773851878.217813:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:7.0:1773851878.217813:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000400:00000200:6.0:1773851878.217813:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769606:8769606:1023:4294967295] 2081@kfi7 LPNI seq info [23425171:23425171:16:4294967295]
00000800:00000200:30.0:1773851878.217814:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:8.0:1773851878.217814:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Using peer 2060@kfi7(0x1c0)
00000400:00000200:29.0:1773851878.217815:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:7.0:1773851878.217815:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851878.217815:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:6.0:1773851878.217816:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:30.0:1773851878.217817:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.217817:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:8.0:1773851878.217817:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x1c0: rc=0
00000100:00000001:7.0:1773851878.217817:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851878.217817:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:30.0:1773851878.217818:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851878.217818:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851878.217818:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851878.217818:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851878.217819:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851878.217819:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:8.0:1773851878.217819:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851878.217819:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217819:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851878.217819:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000100:00000001:30.0:1773851878.217820:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851878.217820:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:8.0:1773851878.217820:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217820:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851878.217821:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:8.0:1773851878.217821:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:11.0:1773851878.217822:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851878.217822:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851878.217822:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851878.217823:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851878.217823:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851878.217823:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851878.217823:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:8.0:1773851878.217824:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851878.217825:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:6.0:1773851878.217825:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:4.0:1773851878.217825:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000800:00000200:29.0:1773851878.217826:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851878.217826:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851878.217826:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851878.217826:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851878.217826:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:30.0:1773851878.217827:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851878.217827:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851878.217827:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851878.217827:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:6.0:1773851878.217827:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851878.217827:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000100:00000001:7.0:1773851878.217828:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851878.217828:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851878.217828:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851878.217829:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:29.0:1773851878.217829:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:11.0:1773851878.217829:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000100:00000001:7.0:1773851878.217829:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851878.217829:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1020, d:10, s:8769606, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769603, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851878.217830:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000800:00000200:6.0:1773851878.217830:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851878.217831:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004cd96fcd
00000400:00000010:30.0:1773851878.217832:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004cd96fcd.
00000100:00000001:30.0:1773851878.217832:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851878.217832:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x102: rc=0
00000800:00000200:11.0:1773851878.217832:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x1a3: rc=0
00000800:00000200:9.0:1773851878.217832:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851878.217832:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851878.217832:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000200:30.0:1773851878.217833:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851878.217833:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851878.217833:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Using peer 2081@kfi7(0x270)
00000800:00000200:29.0:1773851878.217834:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:11.0:1773851878.217834:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851878.217834:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:4.0:1773851878.217834:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:30.0:1773851878.217835:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:4.0:1773851878.217835:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000100:00000040:30.0:1773851878.217836:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851878.217836:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217836:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217836:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851878.217836:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000400:00000200:9.0:1773851878.217836:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7b495c
00000800:00000200:6.0:1773851878.217836:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 324 bytes to peer 0x270: rc=0
00000100:00000001:29.0:1773851878.217837:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851878.217837:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217837:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851878.217837:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7b495c.
00000400:00000200:4.0:1773851878.217837:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769607:8769607:1022:4294967295] 2061@kfi7 LPNI seq info [5403462:5403462:16:4294967295]
00000100:00000001:30.0:1773851878.217838:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851878.217838:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851878.217838:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217838:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851878.217838:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:6.0:1773851878.217838:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851878.217839:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:29.0:1773851878.217839:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217839:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851878.217839:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000200:9.0:1773851878.217839:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851878.217839:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851878.217839:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:30.0:1773851878.217840:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:6.0:1773851878.217840:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851878.217841:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851878.217841:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851878.217841:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217841:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851878.217841:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:30.0:1773851878.217842:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Transaction freed
00000100:00000001:11.0:1773851878.217842:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217842:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851878.217843:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851878.217843:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851878.217843:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851878.217844:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851878.217844:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:11.0:1773851878.217845:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851878.217845:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851878.217845:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:4.0:1773851878.217845:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000100:00000001:9.0:1773851878.217846:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851878.217846:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:6.0:1773851878.217846:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217846:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851878.217847:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851878.217847:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:4.0:1773851878.217847:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:29.0:1773851878.217848:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851878.217848:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:9.0:1773851878.217848:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:11.0:1773851878.217849:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f8443cb8
00000800:00000200:9.0:1773851878.217849:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Transaction freed
00000400:00000200:29.0:1773851878.217850:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000010:11.0:1773851878.217850:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f8443cb8.
00000100:00000001:11.0:1773851878.217850:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851878.217851:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c2a5509b
00000400:00000010:29.0:1773851878.217851:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c2a5509b.
00000100:00000200:11.0:1773851878.217851:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851878.217852:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851878.217853:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851878.217854:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851878.217854:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851878.217854:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851878.217855:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851878.217855:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:29.0:1773851878.217856:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851878.217857:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851878.217857:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:5.0:1773851878.217857:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c188dd4f
00000100:00000001:11.0:1773851878.217858:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:5.0:1773851878.217858:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c188dd4f.
00000100:00000001:5.0:1773851878.217858:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851878.217859:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851878.217859:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851878.217859:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000200:5.0:1773851878.217859:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851878.217861:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:11.0:1773851878.217861:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000800:00000200:4.0:1773851878.217861:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851878.217862:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851878.217862:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:29.0:1773851878.217863:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Transaction freed
00000400:00000200:7.0:1773851878.217863:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:5.0:1773851878.217863:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851878.217863:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851878.217864:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000800:00000200:21.0:1773851878.217865:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:7.0:1773851878.217865:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb11c5dc
00000100:00000001:5.0:1773851878.217865:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851878.217865:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:21.0:1773851878.217866:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000010:7.0:1773851878.217866:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb11c5dc.
00000800:00000200:21.0:1773851878.217867:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851878.217867:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:7.0:1773851878.217867:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851878.217867:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:4.0:1773851878.217867:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.217868:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:5.0:1773851878.217868:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:21.0:1773851878.217869:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:19.0:1773851878.217869:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.217869:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:19.0:1773851878.217870:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:7.0:1773851878.217870:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:19.0:1773851878.217871:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.217871:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:7.0:1773851878.217871:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851878.217871:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Using peer 2061@kfi7(0x20000000000019b)
00000400:00000200:21.0:1773851878.217872:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:19.0:1773851878.217873:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851878.217873:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851878.217873:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851878.217874:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 60@kfi7 : PUT - for me
00000100:00000001:7.0:1773851878.217874:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:22.0:1773851878.217875:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:17.0:1773851878.217875:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:7.0:1773851878.217875:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:22.0:1773851878.217876:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:19.0:1773851878.217876:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.217876:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000800:00000200:4.0:1773851878.217876:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x20000000000019b: rc=0
00000800:00000200:29.0:1773851878.217877:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:21.0:1773851878.217877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:17.0:1773851878.217877:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:7.0:1773851878.217877:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Transaction freed
00000800:00000200:29.0:1773851878.217878:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851878.217878:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851878.217878:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:19.0:1773851878.217878:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2060@kfi7 : PUT - for me
00000400:00000200:21.0:1773851878.217879:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:17.0:1773851878.217879:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000800:00000200:4.0:1773851878.217879:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:29.0:1773851878.217880:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851878.217880:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.217880:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.217881:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:29.0:1773851878.217882:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851878.217882:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:17.0:1773851878.217882:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:21.0:1773851878.217883:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:19.0:1773851878.217883:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:29.0:1773851878.217884:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851878.217884:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:19.0:1773851878.217884:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000100:00000001:4.0:1773851878.217884:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851878.217885:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:4.0:1773851878.217885:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:22.0:1773851878.217886:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:19.0:1773851878.217886:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:4.0:1773851878.217886:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851878.217887:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000400:00000200:21.0:1773851878.217887:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4780
00000400:00000200:19.0:1773851878.217887:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:4.0:1773851878.217887:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851878.217888:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:21.0:1773851878.217888:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:19.0:1773851878.217888:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:29.0:1773851878.217889:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:22.0:1773851878.217889:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.217889:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d1355 [1] + 224
00000400:00000200:17.0:1773851878.217889:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:4.0:1773851878.217889:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851878.217890:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851878.217890:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:19.0:1773851878.217890:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.217890:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4840
00000100:00000001:4.0:1773851878.217890:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:29.0:1773851878.217891:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:22.0:1773851878.217891:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:21.0:1773851878.217891:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851878.217891:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4740
00000100:00000001:4.0:1773851878.217891:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851878.217892:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:22.0:1773851878.217892:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:19.0:1773851878.217892:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.217892:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:4.0:1773851878.217892:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:22.0:1773851878.217893:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851878.217893:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.217893:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f1871 [1] + 224
00000100:00000001:4.0:1773851878.217893:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851878.217894:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:21.0:1773851878.217894:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000400:00000200:29.0:1773851878.217895:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4700
00000400:00000200:22.0:1773851878.217895:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:21.0:1773851878.217895:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:19.0:1773851878.217895:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f1851 [1] + 224
00000800:00000200:17.0:1773851878.217895:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851878.217896:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851878.217896:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b47c0
00000100:00000200:21.0:1773851878.217896:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:22.0:1773851878.217897:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:19.0:1773851878.217897:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.217897:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.217898:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x78008103d [1] + 224
00000100:00000040:21.0:1773851878.217898:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851878.217898:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000800:00000200:23.0:1773851878.217899:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851878.217899:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:22.0:1773851878.217899:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d1375 [1] + 224
00000100:00000001:17.0:1773851878.217899:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:5.0:1773851878.217899:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851878.217899:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851878.217900:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851878.217900:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851878.217900:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:23.0:1773851878.217901:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004edcc86d: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851878.217901:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:17.0:1773851878.217901:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851878.217902:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:22.0:1773851878.217902:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:21.0:1773851878.217902:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:19.0:1773851878.217902:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000400:00000200:5.0:1773851878.217902:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000400:00000200:5.0:1773851878.217902:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d5c2697
00000400:00000010:5.0:1773851878.217902:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d5c2697.
00000400:00000200:29.0:1773851878.217903:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000800:00000200:23.0:1773851878.217903:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004edcc86d: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851878.217903:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:19.0:1773851878.217903:0:2464491:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:5.0:1773851878.217903:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851878.217904:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851878.217904:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:22.0:1773851878.217904:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851878.217904:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000040:17.0:1773851878.217904:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851878.217904:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.217905:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:30.0:1773851878.217905:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:23.0:1773851878.217905:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851878.217905:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000100:00000200:19.0:1773851878.217905:0:2464491:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:30.0:1773851878.217906:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:29.0:1773851878.217906:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851878.217906:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000100:00000001:5.0:1773851878.217906:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:30.0:1773851878.217907:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851878.217907:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000100:00000001:17.0:1773851878.217907:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:5.0:1773851878.217907:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851878.217908:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:30.0:1773851878.217908:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:29.0:1773851878.217908:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851878.217908:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000040:19.0:1773851878.217908:0:2464491:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851878.217908:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:23.0:1773851878.217909:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000100:00000001:22.0:1773851878.217909:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851878.217909:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851878.217909:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851878.217909:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:30.0:1773851878.217910:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:23.0:1773851878.217910:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000800:00000200:17.0:1773851878.217910:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851878.217910:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851878.217910:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000200:22.0:1773851878.217911:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:7.0:1773851878.217911:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851878.217911:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:30.0:1773851878.217912:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851878.217912:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:23.0:1773851878.217912:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000010:7.0:1773851878.217912:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000800:00000200:5.0:1773851878.217912:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Transaction freed
00000400:00000200:29.0:1773851878.217913:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:23.0:1773851878.217913:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000100:00000001:19.0:1773851878.217913:0:2464491:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:7.0:1773851878.217913:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e33961df
00000400:00000010:7.0:1773851878.217913:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e33961df.
00000400:00000200:23.0:1773851878.217914:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000040:22.0:1773851878.217914:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851878.217914:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851878.217914:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851878.217914:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851878.217915:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851878.217915:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851878.217915:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:23.0:1773851878.217915:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4800
00000400:00000200:19.0:1773851878.217915:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000001:11.0:1773851878.217915:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851878.217915:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851878.217915:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:7.0:1773851878.217915:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.217916:0:41089:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:23.0:1773851878.217916:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:19.0:1773851878.217916:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000024734d67: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000001:11.0:1773851878.217916:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:8.0:1773851878.217916:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
02000000:00000001:30.0:1773851878.217917:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851878.217917:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:11.0:1773851878.217917:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000001:8.0:1773851878.217917:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851878.217917:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000100:00000001:30.0:1773851878.217918:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851878.217918:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:11.0:1773851878.217918:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005cb89f82
00000400:00000010:11.0:1773851878.217918:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005cb89f82.
00000400:00000200:8.0:1773851878.217918:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000100:00000200:7.0:1773851878.217918:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851878.217919:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851878.217919:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=111 v=66 (66 66 66 66)
00000100:00000001:11.0:1773851878.217919:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:8.0:1773851878.217919:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000400:00000200:23.0:1773851878.217920:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78008105d [1] + 224
00000400:00000200:22.0:1773851878.217920:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000200:11.0:1773851878.217920:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851878.217920:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:30.0:1773851878.217921:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=111 v=66 (1 1 1 1)
00000800:00000200:22.0:1773851878.217921:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:8.0:1773851878.217921:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851878.217921:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851878.217922:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851878.217922:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851878.217922:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851878.217922:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851878.217922:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851878.217922:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:23.0:1773851878.217922:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004edcc86d: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851878.217922:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851878.217922:0:41066:0:(client.c:1428:after_reply()) Process entered
00000400:00000001:31.0:1773851878.217923:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00010000:00000001:30.0:1773851878.217923:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851878.217923:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851878.217923:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851878.217923:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851878.217923:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851878.217923:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000001:31.0:1773851878.217924:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:30.0:1773851878.217924:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000800:00000200:29.0:1773851878.217924:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851878.217924:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851878.217924:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851878.217925:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f9cf276e.
00000400:00000200:31.0:1773851878.217925:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f75d3df
00000100:00000040:30.0:1773851878.217925:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000400:00000200:23.0:1773851878.217925:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000001:11.0:1773851878.217925:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851878.217925:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:7.0:1773851878.217925:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851878.217926:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f75d3df.
00000100:00000001:30.0:1773851878.217926:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851878.217926:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851878.217926:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:23.0:1773851878.217926:0:2495434:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851878.217926:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851878.217926:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851878.217926:0:41069:0:(client.c:1428:after_reply()) Process entered
00000100:00001000:7.0:1773851878.217926:0:41066:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=111 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851878.217927:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:30.0:1773851878.217927:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:23.0:1773851878.217927:0:2495434:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851878.217927:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851878.217927:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:8.0:1773851878.217927:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851878.217927:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:7.0:1773851878.217927:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=111 v=66 (1 1 1 1)
00000100:00000200:31.0:1773851878.217928:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851878.217928:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:11.0:1773851878.217928:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851878.217928:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851878.217928:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851878.217928:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217928:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851878.217928:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851878.217929:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2061@kfi7 : PUT - for me
02000000:00000001:11.0:1773851878.217929:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851878.217929:0:41068:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=111 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851878.217929:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=111 v=66 (66 66 66 66)
00010000:00000001:7.0:1773851878.217929:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851878.217930:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851878.217930:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:29.0:1773851878.217930:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:23.0:1773851878.217930:0:2495434:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851878.217930:0:41069:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=111 v=66 (1 1 1 1)
00010000:00000001:7.0:1773851878.217930:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851878.217931:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.217931:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851878.217931:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000100:00001000:11.0:1773851878.217931:0:41068:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=111 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851878.217931:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851878.217931:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851878.217931:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217931:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851878.217931:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000004:00000001:30.0:1773851878.217932:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851878.217932:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000400:00000200:29.0:1773851878.217932:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.217932:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:11.0:1773851878.217932:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851878.217932:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851878.217932:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851878.217932:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217932:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851878.217932:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851878.217933:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851878.217933:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:30.0:1773851878.217933:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351228416 avail=351348342784 avail_mb=1372454464 hwm_mb=3131103 files=372084058 ffree=343116434 state=0: rc = 0
00000400:00000200:29.0:1773851878.217933:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00010000:00000001:11.0:1773851878.217933:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851878.217933:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851878.217933:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851878.217934:0:41090:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:29.0:1773851878.217934:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:23.0:1773851878.217934:0:2495434:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851878.217934:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851878.217934:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000040:8.0:1773851878.217934:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000001:8.0:1773851878.217934:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000001:31.0:1773851878.217935:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851878.217935:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000020:30.0:1773851878.217935:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351228416 free, 351348342784 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372084058 files, 343116434 free files
00000400:00000200:29.0:1773851878.217935:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4880
00000100:00000001:11.0:1773851878.217935:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851878.217935:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851878.217935:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851878.217936:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851878.217936:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851878.217936:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:23.0:1773851878.217936:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000040:11.0:1773851878.217936:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851878.217936:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851878.217936:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851878.217936:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:31.0:1773851878.217937:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=111 v=66 (66 66 66 66)
00000004:00000001:30.0:1773851878.217937:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:23.0:1773851878.217937:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004edcc86d: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851878.217937:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851878.217937:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851878.217937:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:31.0:1773851878.217938:0:41090:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=111 v=66 (1 1 1 1)
00000100:00000040:30.0:1773851878.217938:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:29.0:1773851878.217938:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x78008107d [1] + 224
00000100:00000001:11.0:1773851878.217938:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851878.217938:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:7.0:1773851878.217938:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851878.217939:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851878.217939:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217939:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851878.217939:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851878.217939:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851878.217939:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:7.0:1773851878.217939:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00010000:00000001:31.0:1773851878.217940:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00100000:30.0:1773851878.217940:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fede61b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051932544:60@kfi7:13:default-yuba2-0
00000800:00000200:29.0:1773851878.217940:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000001:11.0:1773851878.217940:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:11.0:1773851878.217940:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000004:00000001:8.0:1773851878.217940:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851878.217940:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851878.217940:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500108800 avail=351498039296 avail_mb=1373039216 hwm_mb=3131103 files=372097688 ffree=343261825 state=0: rc = 0
00000400:00000001:6.0:1773851878.217940:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851878.217940:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:31.0:1773851878.217941:0:41090:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:11.0:1773851878.217941:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690116096 avail=351687634944 avail_mb=1373779824 hwm_mb=3131103 files=372231188 ffree=343447379 state=0: rc = 0
00000004:00000040:8.0:1773851878.217941:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504325632 avail=351502170112 avail_mb=1373055352 hwm_mb=3131103 files=372056181 ffree=343265943 state=0: rc = 0
00000100:00000001:31.0:1773851878.217942:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851878.217942:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000400:00000200:29.0:1773851878.217942:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000020:7.0:1773851878.217942:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500108800 free, 351498039296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097688 files, 343261825 free files
00000400:00000010:6.0:1773851878.217942:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851878.217942:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003599bb60
00000100:00000001:31.0:1773851878.217943:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851878.217943:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.217943:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851878.217943:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000004:00000020:11.0:1773851878.217943:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690116096 free, 351687634944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231188 files, 343447379 free files
00000004:00000020:8.0:1773851878.217943:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504325632 free, 351502170112 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056181 files, 343265943 free files
00000400:00000010:6.0:1773851878.217943:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003599bb60.
00000100:00000040:31.0:1773851878.217944:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.217944:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851878.217944:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:11.0:1773851878.217944:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851878.217944:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851878.217944:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217944:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:30.0:1773851878.217945:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fede61b9 x1859433051932544/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:29.0:1773851878.217945:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851878.217945:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:6.0:1773851878.217945:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:11.0:1773851878.217946:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851878.217946:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851878.217947:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851878.217947:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:31.0:1773851878.217948:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851878.217948:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851878.217948:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:29.0:1773851878.217948:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:11.0:1773851878.217948:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004139ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051932416:37@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851878.217948:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006ed65dc4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051932480:2060@kfi7:13:default-yuba2-0
00000100:00100000:7.0:1773851878.217948:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cd156083 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051932736:36@kfi7:13:default-yuba2-0
00000100:00000200:6.0:1773851878.217948:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:31.0:1773851878.217949:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000010:30.0:1773851878.217949:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bbafe549.
00000004:00000020:31.0:1773851878.217950:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097312 blocks, 31192444992 free, 31192409536 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238816 files, 2962368433 free files
02000000:00000001:30.0:1773851878.217950:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851878.217950:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851878.217950:0:41089:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00000001:11.0:1773851878.217950:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851878.217950:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851878.217950:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851878.217950:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851878.217950:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851878.217951:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851878.217951:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:11.0:1773851878.217951:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004139ca59 x1859433051932416/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851878.217951:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006ed65dc4 x1859433051932480/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851878.217951:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851878.217952:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:30.0:1773851878.217952:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000005b98a0eb.
00000100:00000001:29.0:1773851878.217952:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:7.0:1773851878.217952:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000cd156083 x1859433051932736/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851878.217952:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:30.0:1773851878.217953:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851878.217953:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000400:00000200:29.0:1773851878.217953:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:6.0:1773851878.217953:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:30.0:1773851878.217954:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fede61b9.
00000800:00000200:29.0:1773851878.217954:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851878.217954:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851878.217954:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:8.0:1773851878.217954:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851878.217954:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851878.217954:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:6.0:1773851878.217954:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851878.217954:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00100000:31.0:1773851878.217955:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c668476b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051932608:13@kfi7:41:default-yuba2-0
00000100:00000001:30.0:1773851878.217955:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000010:11.0:1773851878.217955:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008d4d2444.
02000000:00000010:8.0:1773851878.217955:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003d905b3e.
02000000:00000001:7.0:1773851878.217955:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851878.217955:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000079e097e6.
00000100:00000001:6.0:1773851878.217955:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851878.217955:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.217955:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851878.217955:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851878.217956:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.217956:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:11.0:1773851878.217956:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851878.217956:0:41068:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:8.0:1773851878.217956:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851878.217956:0:41069:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:6.0:1773851878.217956:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851878.217957:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.217957:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000040:11.0:1773851878.217957:0:41068:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000020:00000040:8.0:1773851878.217957:0:41069:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000020:00000001:8.0:1773851878.217957:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:7.0:1773851878.217957:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851878.217957:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00001000:6.0:1773851878.217957:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=111 v=66 (66 66 66 66)
00000400:00000001:4.0:1773851878.217957:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851878.217957:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851878.217958:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851878.217958:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c668476b x1859433051932608/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.217958:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.217958:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000001:11.0:1773851878.217958:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851878.217958:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000009c52eb5f.
02000000:00000010:8.0:1773851878.217958:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000020:00000040:7.0:1773851878.217958:0:41066:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000100:00001000:6.0:1773851878.217958:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=111 v=66 (1 1 1 1)
00000400:00000010:4.0:1773851878.217958:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000100:00000001:30.0:1773851878.217959:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851878.217959:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851878.217959:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:8.0:1773851878.217959:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851878.217959:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:7.0:1773851878.217959:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851878.217959:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003004e465.
00000100:00000001:6.0:1773851878.217959:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851878.217959:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851878.217959:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000615c4c0e
00000100:00000001:31.0:1773851878.217960:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000010:11.0:1773851878.217960:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004139ca59.
00000100:00000010:8.0:1773851878.217960:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006ed65dc4.
02000000:00000001:7.0:1773851878.217960:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:6.0:1773851878.217960:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:4.0:1773851878.217960:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000615c4c0e.
02000000:00000001:31.0:1773851878.217961:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851878.217961:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851878.217961:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851878.217961:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851878.217961:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851878.217961:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851878.217961:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cd156083.
00010000:00000001:6.0:1773851878.217961:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217961:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:4.0:1773851878.217961:0:41064:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000010:31.0:1773851878.217962:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000007e804b7.
00000100:00000001:11.0:1773851878.217962:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851878.217962:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851878.217962:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851878.217962:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851878.217962:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:6.0:1773851878.217962:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
02000000:00000001:31.0:1773851878.217963:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:11.0:1773851878.217963:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851878.217963:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851878.217963:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851878.217963:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851878.217963:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851878.217963:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851878.217963:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851878.217963:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851878.217963:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:31.0:1773851878.217964:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851878.217964:0:41090:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:11.0:1773851878.217964:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851878.217964:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.217964:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851878.217964:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851878.217964:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:31.0:1773851878.217965:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851878.217965:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000005711a3d9.
00000100:00000001:7.0:1773851878.217965:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851878.217965:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851878.217966:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851878.217967:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851878.217967:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c668476b.
00000100:00000001:6.0:1773851878.217967:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851878.217968:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851878.217968:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851878.217968:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851878.217968:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:4.0:1773851878.217968:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851878.217969:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851878.217969:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851878.217970:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000020:6.0:1773851878.217970:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223680 blocks, 31250856320 free, 31250830848 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121328 files, 2868730951 free files
00000100:00000001:31.0:1773851878.217971:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851878.217971:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851878.217971:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851878.217972:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.217972:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:6.0:1773851878.217973:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851878.217973:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.217974:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00100000:6.0:1773851878.217975:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c40ba58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051932672:2074@kfi7:41:default-yuba2-0
02000000:00000001:4.0:1773851878.217975:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851878.217975:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851878.217976:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217977:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851878.217977:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217978:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851878.217978:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004c40ba58 x1859433051932672/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:4.0:1773851878.217979:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=111 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851878.217981:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00001000:4.0:1773851878.217981:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=111 v=66 (1 1 1 1)
02000000:00000001:6.0:1773851878.217982:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851878.217982:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006d4a620a.
00000100:00000001:4.0:1773851878.217982:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:6.0:1773851878.217983:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:4.0:1773851878.217983:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851878.217984:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851878.217984:0:41067:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00010000:00000001:4.0:1773851878.217984:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000020:00000001:6.0:1773851878.217985:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00010000:00000001:4.0:1773851878.217985:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851878.217986:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000c821af11.
02000000:00000001:6.0:1773851878.217986:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:4.0:1773851878.217986:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:6.0:1773851878.217987:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851878.217987:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004c40ba58.
00000100:00000040:4.0:1773851878.217987:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:6.0:1773851878.217988:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851878.217988:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851878.217988:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217989:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851878.217989:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851878.217990:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:4.0:1773851878.217990:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851878.217991:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851878.217991:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851878.217992:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.217994:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851878.217995:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851878.217997:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851878.217998:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851878.217999:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851878.218000:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399725568 free=351492688896 avail=351490286592 avail_mb=1373008932 hwm_mb=3131103 files=372077977 ffree=343254579 state=0: rc = 0
00000004:00000020:4.0:1773851878.218003:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399725568 blocks, 351492688896 free, 351490286592 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372077977 files, 343254579 free files
00000004:00000001:4.0:1773851878.218006:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851878.218007:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851878.218012:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000072253d59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051932800:2061@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851878.218015:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.218016:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851878.218017:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000072253d59 x1859433051932800/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851878.218021:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851878.218022:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851878.218022:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000440074eb.
02000000:00000001:4.0:1773851878.218024:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851878.218025:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851878.218025:0:41064:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000020:00000001:4.0:1773851878.218026:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851878.218027:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000097fed2c.
02000000:00000001:4.0:1773851878.218028:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851878.218029:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851878.218030:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000072253d59.
00000100:00000001:4.0:1773851878.218031:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851878.218032:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.218033:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.218034:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851878.218035:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.218036:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851878.218036:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851878.281733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851878.281735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:13.0:1773851878.304199:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851878.304200:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851878.304201:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851878.304203:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851878.304205:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10432@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.304206:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10432@kfi7 : PUT - for me
00000400:00000200:13.0:1773851878.304207:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10432@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.304208:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7c794cb nid 10432@kfi7 refs 1
00000400:00000200:13.0:1773851878.304209:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10432@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.304210:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7c794cb nid 10432@kfi7 refs 2
00000400:00000200:13.0:1773851878.304211:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e7c794cb nid 10432@kfi7 refs 3
00000400:00000200:13.0:1773851878.304212:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10432@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.304213:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10432@kfi7 of length 224 into portal 12 MB=0x699e2a538fc00
00000400:00000200:13.0:1773851878.304214:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10432@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 39536
00000800:00000200:13.0:1773851878.304216:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851878.304218:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851878.304219:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10432@kfi7: PUT: OK
00000100:00000001:13.0:1773851878.304220:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851878.304220:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851878.304221:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000b8a246c.
00000100:00000040:13.0:1773851878.304222:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000000b8a246c x1858048573897728 msgsize 224
00000100:00100000:13.0:1773851878.304224:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10432@kfi7 (source: 12345-10432@kfi7)
00000100:00000001:13.0:1773851878.304225:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851878.304226:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7c794cb nid 10432@kfi7 refs 2
00000100:00000001:12.0:1773851878.304226:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851878.304227:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851878.304227:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851878.304228:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851878.304228:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851878.304229:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851878.304230:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858048573897728
00000020:00000001:12.0:1773851878.304230:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851878.304231:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916a5
00000020:00000001:12.0:1773851878.304231:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851878.304236:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000af3213de refcount=6
00000020:00000001:12.0:1773851878.304237:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241246720 : -107152468304896 : ffff9e8b9f309c00)
00000020:00000001:12.0:1773851878.304237:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241246720 : -107152468304896 : ffff9e8b9f309c00)
00000100:00000001:12.0:1773851878.304238:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851878.304240:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851878.304241:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ebe075ad.
00000020:00000010:12.0:1773851878.304242:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851878.304243:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
00000100:00000001:12.0:1773851878.304244:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851878.304244:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851878.304245:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851878.304246:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851878.304246:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851878.304247:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851878.304248:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851878.304249:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851878.304249:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851878.304249:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851878.304250:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851878.304251:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851878.304251:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10432@kfi7, seq: 2289873
00000100:00000040:12.0:1773851878.304251:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000af3213de : new rpc_count 1
00000100:00000001:15.0:1773851878.304252:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851878.304252:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902253696 : -106994807297920 : ffff9eb05484a880)
00000100:00000040:12.0:1773851878.304253:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000b8a246c x1858048573897728/t0(0) o400->a62a4e85-4367-40a5-bbb1-567dc163ef78@10432@kfi7:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1139-0'
00000100:00000001:12.0:1773851878.304256:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851878.304256:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851878.304257:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b8a246c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a62a4e85-4367-40a5-bbb1-567dc163ef78+6:39802:x1858048573897728:12345-10432@kfi7:400:default-tuolumne1139-0
00000100:00000200:12.0:1773851878.304258:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858048573897728
00000020:00000001:12.0:1773851878.304259:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851878.304259:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851878.304260:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.304261:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851878.304261:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851878.304262:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851878.304262:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858048573897728, found 0 last_xid 1858048573897727
00000020:00000001:12.0:1773851878.304263:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851878.304264:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851878.304264:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851878.304265:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.304266:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851878.304266:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851878.304267:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851878.304268:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000adaa2743.
02000000:00000001:12.0:1773851878.304268:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851878.304269:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.304270:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851878.304270:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106927587, transno 0, xid 1858048573897728
00010000:00000001:12.0:1773851878.304271:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851878.304272:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000b8a246c x1858048573897728/t0(0) o400->a62a4e85-4367-40a5-bbb1-567dc163ef78@10432@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1139-0'
00010000:00000001:12.0:1773851878.304274:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851878.304275:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851878.304275:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=111 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851878.304276:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851878.304277:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000051024c23 refcount 3 to 10432@kfi7
00000100:00000001:12.0:1773851878.304277:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299648 : -107155980251968 : ffff9e8acddc8cc0)
02000000:00000001:12.0:1773851878.304278:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851878.304279:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851878.304279:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851878.304280:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10432@kfi7
00000400:00000010:12.0:1773851878.304281:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dd0185dc.
00000100:00000200:12.0:1773851878.304281:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858048573897728, offset 224
00000400:00000200:12.0:1773851878.304283:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10432@kfi7
00000400:00000200:12.0:1773851878.304284:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10432@kfi7 to cpt 3
00000400:00000200:12.0:1773851878.304285:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7c794cb nid 10432@kfi7 refs 1
00000400:00000200:12.0:1773851878.304286:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e7c794cb nid 10432@kfi7 refs 2
00000400:00000200:12.0:1773851878.304287:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e7c794cb nid 10432@kfi7 refs 3
00000400:00000200:12.0:1773851878.304288:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10432@kfi7 local destination
00000400:00000200:12.0:1773851878.304289:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769608:8769608:1024:4294967295] 10432@kfi7 LPNI seq info [22727047:22727047:16:4294967295]
00000400:00000200:12.0:1773851878.304291:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e7c794cb nid 10432@kfi7 refs 2
00000400:00000200:12.0:1773851878.304291:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10432@kfi7 to cpt 3
00000400:00000200:12.0:1773851878.304293:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10432@kfi7(10432@kfi7:10432@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851878.304295:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e7c794cb nid 10432@kfi7 refs 3
00000800:00000200:12.0:1773851878.304296:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851878.304297:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851878.304299:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851878.304301:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000151 Using peer 10432@kfi7(0x100000000000151)
00000800:00000200:12.0:1773851878.304304:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x100000000000151: rc=0
00000800:00000200:12.0:1773851878.304305:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000151 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851878.304307:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851878.304308:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000051024c23 refcount 2 to 10432@kfi7
00010000:00000001:12.0:1773851878.304309:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851878.304309:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.304310:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851878.304310:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000b8a246c x1858048573897728/t0(0) o400->a62a4e85-4367-40a5-bbb1-567dc163ef78@10432@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1139-0'
00000100:00100000:12.0:1773851878.304315:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b8a246c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a62a4e85-4367-40a5-bbb1-567dc163ef78+6:39802:x1858048573897728:12345-10432@kfi7:400:default-tuolumne1139-0 Request processed in 57us (90us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851878.304317:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10432@kfi7, seq: 2289873
00000100:00000040:12.0:1773851878.304317:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000af3213de : new rpc_count 0
00000100:00000001:12.0:1773851878.304318:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851878.304318:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851878.304319:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851878.304320:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000020:00000010:12.0:1773851878.304321:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ebe075ad.
00000020:00000040:12.0:1773851878.304321:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000af3213de : new refcount 5
00000100:00000001:12.0:1773851878.304322:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851878.304327:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000151 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851878.304331:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851878.304332:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10432@kfi7: PUT: OK
00000400:00000200:13.0:1773851878.304333:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dd0185dc
00000400:00000010:13.0:1773851878.304333:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dd0185dc.
00000100:00000001:13.0:1773851878.304334:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851878.304335:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851878.304335:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7c794cb nid 10432@kfi7 refs 2
00000800:00000200:13.0:1773851878.304337:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 10432@kfi7(000000002c3f2fc2):0x0 lsk 338 rsk 65 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000151 Transaction freed
00000800:00000200:1.0:1773851878.361705:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.361706:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851878.361707:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851878.361709:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851878.361711:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19411@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.361713:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19411@kfi7 : PUT - for me
00000400:00000200:1.0:1773851878.361714:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19411@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.361714:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007746b0d3 nid 19411@kfi7 refs 1
00000400:00000200:1.0:1773851878.361715:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19411@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.361716:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007746b0d3 nid 19411@kfi7 refs 2
00000400:00000200:1.0:1773851878.361717:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007746b0d3 nid 19411@kfi7 refs 3
00000400:00000200:1.0:1773851878.361718:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19218@kfi7 to cpt 3
00000400:00000200:1.0:1773851878.361719:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19218@kfi7 of length 224 into portal 12 MB=0x69b4ba22d3380
00000400:00000200:1.0:1773851878.361720:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19218@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 38488
00000800:00000200:1.0:1773851878.361722:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851878.361724:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851878.361729:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19411@kfi7: PUT: OK
00000100:00000001:1.0:1773851878.361730:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851878.361730:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851878.361731:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000028f382de.
00000100:00000040:1.0:1773851878.361732:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000028f382de x1859599005987712 msgsize 224
00000100:00100000:1.0:1773851878.361734:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-19218@kfi7 (source: 12345-19411@kfi7)
00000100:00000001:1.0:1773851878.361736:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851878.361737:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007746b0d3 nid 19411@kfi7 refs 2
00000800:00000200:1.0:1773851878.361738:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851878.361741:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851878.361741:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851878.361742:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851878.361742:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851878.361743:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851878.361744:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599005987712
00000020:00000001:1.0:1773851878.361744:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851878.361745:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a87
00000020:00000001:1.0:1773851878.361745:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851878.361747:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b858ed74 refcount=5
00000020:00000001:1.0:1773851878.361748:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063872043008 : -107009837508608 : ffff9eacd4a5d800)
00000020:00000001:1.0:1773851878.361749:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637063872043008 : -107009837508608 : ffff9eacd4a5d800)
00000100:00000001:1.0:1773851878.361750:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.361750:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851878.361751:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851878.361752:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851878.361753:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851878.361754:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851878.361754:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851878.361755:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851878.361756:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851878.361757:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851878.361757:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.361758:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851878.361759:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851878.361760:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851878.361760:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851878.361760:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851878.361761:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19218@kfi7, seq: 1997584
00000100:00000001:2.0:1773851878.361762:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851878.361762:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851878.361762:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b858ed74 : new rpc_count 1
00000100:00000001:1.0:1773851878.361762:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134783677568 : -106938925874048 : ffff9ebd574f8480)
00000100:00000040:1.0:1773851878.361764:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000028f382de x1859599005987712/t0(0) o400->bd23fa25-41f8-4660-a97d-1e80a3ee2e7d@19218@kfi7:518/0 lens 224/0 e 0 to 0 dl 1773852633 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1701-0'
00000100:00000001:1.0:1773851878.361767:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.361767:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851878.361768:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028f382de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bd23fa25-41f8-4660-a97d-1e80a3ee2e7d+5:39712:x1859599005987712:12345-19218@kfi7:400:default-tuolumne1701-0
00000100:00000200:1.0:1773851878.361769:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599005987712
00000020:00000001:1.0:1773851878.361770:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851878.361771:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851878.361771:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.361772:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851878.361773:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851878.361773:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851878.361774:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599005987712, found 0 last_xid 1859599005987711
00000020:00000001:1.0:1773851878.361775:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851878.361776:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851878.361776:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851878.361776:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.361777:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851878.361778:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851878.361778:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851878.361779:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eec9c017.
02000000:00000001:1.0:1773851878.361780:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.361781:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.361781:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851878.361782:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694841, transno 0, xid 1859599005987712
00010000:00000001:1.0:1773851878.361783:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851878.361783:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000028f382de x1859599005987712/t0(0) o400->bd23fa25-41f8-4660-a97d-1e80a3ee2e7d@19218@kfi7:518/0 lens 224/224 e 0 to 0 dl 1773852633 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1701-0'
00010000:00000001:1.0:1773851878.361786:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851878.361786:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851878.361787:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=111 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851878.361788:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851878.361789:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006bc78e8b refcount 3 to 19218@kfi7
00000100:00000001:1.0:1773851878.361790:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487622944 : -107151221928672 : ffff9e8be97acd20)
02000000:00000001:1.0:1773851878.361793:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851878.361793:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.361794:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851878.361795:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19411@kfi7
00000400:00000010:1.0:1773851878.361796:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000237c3343.
00000100:00000200:1.0:1773851878.361796:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599005987712, offset 224
00000400:00000200:1.0:1773851878.361798:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19411@kfi7
00000400:00000200:1.0:1773851878.361798:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19411@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.361799:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007746b0d3 nid 19411@kfi7 refs 1
00000400:00000200:1.0:1773851878.361800:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007746b0d3 nid 19411@kfi7 refs 2
00000400:00000200:1.0:1773851878.361801:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007746b0d3 nid 19411@kfi7 refs 3
00000400:00000200:1.0:1773851878.361802:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19411@kfi7 local destination
00000400:00000200:1.0:1773851878.361804:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769609:8769609:1024:4294967295] 19411@kfi7 LPNI seq info [14933782:14933782:16:4294967295]
00000400:00000200:1.0:1773851878.361805:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007746b0d3 nid 19411@kfi7 refs 2
00000400:00000200:1.0:1773851878.361806:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19411@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.361808:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19411@kfi7(19411@kfi7:19411@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851878.361809:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007746b0d3 nid 19411@kfi7 refs 3
00000800:00000200:1.0:1773851878.361810:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.361811:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851878.361813:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851878.361815:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11c1 Using peer 19411@kfi7(0x11c1)
00000800:00000200:1.0:1773851878.361818:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 324 bytes to peer 0x11c1: rc=0
00000800:00000200:1.0:1773851878.361819:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851878.361821:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851878.361822:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006bc78e8b refcount 2 to 19218@kfi7
00010000:00000001:1.0:1773851878.361823:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851878.361823:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.361824:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851878.361825:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000028f382de x1859599005987712/t0(0) o400->bd23fa25-41f8-4660-a97d-1e80a3ee2e7d@19218@kfi7:518/0 lens 224/224 e 0 to 0 dl 1773852633 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1701-0'
00000100:00100000:1.0:1773851878.361828:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028f382de pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bd23fa25-41f8-4660-a97d-1e80a3ee2e7d+5:39712:x1859599005987712:12345-19218@kfi7:400:default-tuolumne1701-0 Request processed in 60us (95us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851878.361830:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19218@kfi7, seq: 1997584
00000100:00000040:1.0:1773851878.361831:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b858ed74 : new rpc_count 0
00000100:00000001:1.0:1773851878.361832:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:2.0:1773851878.361833:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11c1 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851878.361833:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851878.361833:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851878.361834:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000400:00000200:2.0:1773851878.361835:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851878.361835:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000020:00000040:1.0:1773851878.361835:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000b858ed74 : new refcount 4
00000100:00000001:1.0:1773851878.361836:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851878.361837:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19411@kfi7: PUT: OK
00000400:00000200:2.0:1773851878.361837:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000237c3343
00000400:00000010:2.0:1773851878.361838:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000237c3343.
00000100:00000001:2.0:1773851878.361839:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851878.361840:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851878.361841:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007746b0d3 nid 19411@kfi7 refs 2
00000800:00000200:2.0:1773851878.361842:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 19411@kfi7(00000000b0463a58):0x0 lsk 4546 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x11c1 Transaction freed
00000800:00000200:22.0:1773851878.389168:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851878.389168:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851878.389169:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851878.389169:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851878.389170:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851878.389171:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851878.389172:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26099@kfi7(00000000f65291a7):0xf91 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851878.389173:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851878.389174:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 Using peer 26099@kfi7(0xf91)
00000400:00000200:22.0:1773851878.389175:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26099@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.389177:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26099@kfi7 to cpt 5
00000400:00000200:22.0:1773851878.389178:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26099@kfi7 : PUT - for me
00000400:00000200:22.0:1773851878.389179:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26099@kfi7 to cpt 5
00000800:00000200:21.0:1773851878.389179:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0xf91: rc=0
00000400:00000200:22.0:1773851878.389180:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ec4bec5 nid 26099@kfi7 refs 1
00000400:00000200:22.0:1773851878.389181:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26099@kfi7 to cpt 5
00000800:00000200:21.0:1773851878.389181:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851878.389182:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ec4bec5 nid 26099@kfi7 refs 2
00000400:00000200:22.0:1773851878.389183:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009ec4bec5 nid 26099@kfi7 refs 3
00000400:00000200:22.0:1773851878.389184:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25907@kfi7 to cpt 2
00000400:00000200:22.0:1773851878.389185:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25907@kfi7 of length 224 into portal 12 MB=0x69ab24c954080
00000400:00000200:22.0:1773851878.389187:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25907@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 48336
00000800:00000200:22.0:1773851878.389189:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851878.389191:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851878.389192:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26099@kfi7: PUT: OK
00000100:00000001:22.0:1773851878.389193:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:21.0:1773851878.389193:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 TN_EVENT_TX_OK event status 0
00000100:00000200:22.0:1773851878.389194:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851878.389195:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d705acf2.
00000800:00000200:21.0:1773851878.389195:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 Transaction freed
00000100:00000040:22.0:1773851878.389196:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000d705acf2 x1858940439969920 msgsize 224
00000100:00100000:22.0:1773851878.389197:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-25907@kfi7 (source: 12345-26099@kfi7)
00000100:00000001:22.0:1773851878.389198:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851878.389199:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009ec4bec5 nid 26099@kfi7 refs 2
00000100:00000001:23.0:1773851878.389200:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851878.389201:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851878.389201:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:22.0:1773851878.389201:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851878.389202:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851878.389202:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851878.389203:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858940439969920
00000020:00000001:23.0:1773851878.389204:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851878.389204:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9148a
00000020:00000001:23.0:1773851878.389205:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851878.389208:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000345b1f6f refcount=6
00000020:00000001:23.0:1773851878.389209:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240793088 : -107152468758528 : ffff9e8b9f29b000)
00000020:00000001:23.0:1773851878.389210:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240793088 : -107152468758528 : ffff9e8b9f29b000)
00000100:00000001:23.0:1773851878.389211:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.389212:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851878.389213:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ed998973.
00000020:00000010:23.0:1773851878.389214:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851878.389214:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851878.389215:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851878.389216:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851878.389216:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.389217:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851878.389217:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851878.389218:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.389219:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.389220:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851878.389220:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851878.389220:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851878.389220:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851878.389221:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25907@kfi7, seq: 1998014
00000100:00000040:23.0:1773851878.389222:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000345b1f6f : new rpc_count 1
00000100:00000001:20.0:1773851878.389222:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.389223:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382173952 : -106946327377664 : ffff9ebb9e258900)
00000100:00000001:20.0:1773851878.389223:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.389224:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d705acf2 x1858940439969920/t0(0) o400->4b729b47-6ca6-472a-899a-1ec63fb6b2fb@25907@kfi7:666/0 lens 224/0 e 0 to 0 dl 1773852026 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2105-0'
00000100:00000001:23.0:1773851878.389226:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.389227:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851878.389228:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d705acf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4b729b47-6ca6-472a-899a-1ec63fb6b2fb+6:39400:x1858940439969920:12345-25907@kfi7:400:default-tuolumne2105-0
00000100:00000200:23.0:1773851878.389229:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858940439969920
00000020:00000001:23.0:1773851878.389230:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851878.389231:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851878.389231:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.389232:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851878.389232:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851878.389233:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851878.389234:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858940439969920, found 0 last_xid 1858940439969919
00000020:00000001:23.0:1773851878.389235:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851878.389235:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851878.389236:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851878.389236:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.389239:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851878.389240:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851878.389240:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851878.389241:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aa8bc0c2.
02000000:00000001:23.0:1773851878.389242:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.389243:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.389243:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851878.389244:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154592180, transno 0, xid 1858940439969920
00010000:00000001:23.0:1773851878.389245:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851878.389246:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d705acf2 x1858940439969920/t0(0) o400->4b729b47-6ca6-472a-899a-1ec63fb6b2fb@25907@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2105-0'
00010000:00000001:23.0:1773851878.389248:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851878.389249:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851878.389250:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=111 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851878.389251:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851878.389252:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001534dd2f refcount 3 to 25907@kfi7
00000100:00000001:23.0:1773851878.389252:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579392 : -107154806972224 : ffff9e8b13cb60c0)
02000000:00000001:23.0:1773851878.389253:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851878.389254:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.389254:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851878.389255:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26099@kfi7
00000400:00000010:23.0:1773851878.389256:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003279a6c9.
00000100:00000200:23.0:1773851878.389257:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858940439969920, offset 224
00000400:00000200:23.0:1773851878.389258:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26099@kfi7
00000400:00000200:23.0:1773851878.389259:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26099@kfi7 to cpt 5
00000400:00000200:23.0:1773851878.389260:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ec4bec5 nid 26099@kfi7 refs 1
00000400:00000200:23.0:1773851878.389261:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009ec4bec5 nid 26099@kfi7 refs 2
00000400:00000200:23.0:1773851878.389263:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009ec4bec5 nid 26099@kfi7 refs 3
00000400:00000200:23.0:1773851878.389264:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26099@kfi7 local destination
00000400:00000200:23.0:1773851878.389265:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769610:8769610:1024:4294967295] 26099@kfi7 LPNI seq info [130718:130718:16:4294967295]
00000400:00000200:23.0:1773851878.389267:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009ec4bec5 nid 26099@kfi7 refs 2
00000400:00000200:23.0:1773851878.389267:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26099@kfi7 to cpt 5
00000400:00000200:23.0:1773851878.389269:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26099@kfi7(26099@kfi7:26099@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851878.389271:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009ec4bec5 nid 26099@kfi7 refs 3
00000800:00000200:23.0:1773851878.389273:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851878.389274:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851878.389276:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851878.389278:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 Using peer 26099@kfi7(0xf91)
00000800:00000200:23.0:1773851878.389281:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0xf91: rc=0
00000800:00000200:23.0:1773851878.389282:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851878.389284:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.389285:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001534dd2f refcount 2 to 25907@kfi7
00010000:00000001:23.0:1773851878.389286:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851878.389286:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.389287:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851878.389288:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d705acf2 x1858940439969920/t0(0) o400->4b729b47-6ca6-472a-899a-1ec63fb6b2fb@25907@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2105-0'
00000100:00100000:23.0:1773851878.389291:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d705acf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4b729b47-6ca6-472a-899a-1ec63fb6b2fb+6:39400:x1858940439969920:12345-25907@kfi7:400:default-tuolumne2105-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851878.389293:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25907@kfi7, seq: 1998014
00000100:00000040:23.0:1773851878.389294:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000345b1f6f : new rpc_count 0
00000100:00000001:23.0:1773851878.389294:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851878.389294:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851878.389295:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851878.389295:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851878.389295:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851878.389296:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000400:00000200:21.0:1773851878.389296:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26099@kfi7: PUT: OK
00000020:00000010:23.0:1773851878.389297:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ed998973.
00000400:00000200:21.0:1773851878.389297:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003279a6c9
00000400:00000010:21.0:1773851878.389297:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003279a6c9.
00000020:00000040:23.0:1773851878.389298:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000345b1f6f : new refcount 5
00000100:00000001:23.0:1773851878.389298:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851878.389298:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851878.389298:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851878.389299:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009ec4bec5 nid 26099@kfi7 refs 2
00000800:00000200:21.0:1773851878.389301:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 26099@kfi7(00000000f65291a7):0x0 lsk 3986 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf91 Transaction freed
00000800:00000200:21.0:1773851878.433401:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851878.433401:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851878.433402:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851878.433404:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851878.433406:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13776@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.433407:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13776@kfi7 : PUT - for me
00000400:00000200:21.0:1773851878.433407:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13776@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.433408:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f214ef5 nid 13776@kfi7 refs 1
00000400:00000200:21.0:1773851878.433410:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13776@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.433410:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f214ef5 nid 13776@kfi7 refs 2
00000400:00000200:21.0:1773851878.433411:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008f214ef5 nid 13776@kfi7 refs 3
00000400:00000200:21.0:1773851878.433412:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13776@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.433413:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13776@kfi7 of length 224 into portal 12 MB=0x69b4bca0b3980
00000400:00000200:21.0:1773851878.433414:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13776@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 48560
00000800:00000200:21.0:1773851878.433415:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851878.433417:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851878.433417:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13776@kfi7: PUT: OK
00000100:00000001:21.0:1773851878.433418:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851878.433418:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851878.433419:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c16257d8.
00000100:00000040:21.0:1773851878.433420:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c16257d8 x1859599674849664 msgsize 224
00000100:00100000:21.0:1773851878.433421:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13776@kfi7 (source: 12345-13776@kfi7)
00000100:00000001:21.0:1773851878.433421:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851878.433422:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008f214ef5 nid 13776@kfi7 refs 2
00000100:00000001:23.0:1773851878.433423:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851878.433423:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851878.433423:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851878.433424:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851878.433424:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851878.433425:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851878.433425:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599674849664
00000020:00000001:23.0:1773851878.433426:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851878.433426:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38956b1e
00000020:00000001:23.0:1773851878.433427:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851878.433431:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007ec522b1 refcount=7
00000020:00000001:23.0:1773851878.433431:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103112256512 : -106970597295104 : ffff9eb5f78bfc00)
00000020:00000001:23.0:1773851878.433432:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637103112256512 : -106970597295104 : ffff9eb5f78bfc00)
00000100:00000001:23.0:1773851878.433433:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.433434:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851878.433434:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ed998973.
00000020:00000010:23.0:1773851878.433435:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851878.433435:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851878.433436:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851878.433437:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851878.433437:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.433438:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851878.433439:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851878.433439:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.433440:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851878.433441:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851878.433441:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851878.433441:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851878.433442:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13776@kfi7, seq: 1998015
00000100:00000040:23.0:1773851878.433442:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007ec522b1 : new rpc_count 2
00000100:00000001:20.0:1773851878.433442:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851878.433442:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.433443:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129794358656 : -106943915192960 : ffff9ebc2dec8d80)
00000100:00000001:20.0:1773851878.433443:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.433444:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c16257d8 x1859599674849664/t0(0) o400->4109ff27-9e90-425c-accb-7a02287a1338@13776@kfi7:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1345-0'
00000100:00000001:23.0:1773851878.433447:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851878.433447:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851878.433448:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c16257d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4109ff27-9e90-425c-accb-7a02287a1338+7:39620:x1859599674849664:12345-13776@kfi7:400:default-tuolumne1345-0
00000100:00000200:23.0:1773851878.433449:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599674849664
00000020:00000001:23.0:1773851878.433450:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851878.433451:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851878.433451:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.433452:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851878.433452:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851878.433453:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851878.433453:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599674849664, found 0 last_xid 1859599672310719
00000020:00000001:23.0:1773851878.433454:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851878.433454:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851878.433455:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851878.433455:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.433456:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851878.433456:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851878.433457:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851878.433458:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ee2993f8.
02000000:00000001:23.0:1773851878.433459:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.433459:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.433460:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851878.433460:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183237405401, transno 0, xid 1859599674849664
00010000:00000001:23.0:1773851878.433461:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851878.433462:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c16257d8 x1859599674849664/t0(0) o400->4109ff27-9e90-425c-accb-7a02287a1338@13776@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1345-0'
00010000:00000001:23.0:1773851878.433464:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851878.433464:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851878.433465:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=111 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851878.433466:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851878.433466:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a9bfc14 refcount 3 to 13776@kfi7
00000100:00000001:23.0:1773851878.433467:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106496 : -107156354445120 : ffff9e8ab78ed0c0)
02000000:00000001:23.0:1773851878.433468:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851878.433468:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851878.433468:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851878.433469:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13776@kfi7
00000400:00000010:23.0:1773851878.433470:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000403003e5.
00000100:00000200:23.0:1773851878.433470:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599674849664, offset 224
00000400:00000200:23.0:1773851878.433472:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13776@kfi7
00000400:00000200:23.0:1773851878.433473:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13776@kfi7 to cpt 5
00000400:00000200:23.0:1773851878.433474:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008f214ef5 nid 13776@kfi7 refs 1
00000400:00000200:23.0:1773851878.433475:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008f214ef5 nid 13776@kfi7 refs 2
00000400:00000200:23.0:1773851878.433476:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008f214ef5 nid 13776@kfi7 refs 3
00000400:00000200:23.0:1773851878.433477:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13776@kfi7 local destination
00000400:00000200:23.0:1773851878.433478:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769611:8769611:1024:4294967295] 13776@kfi7 LPNI seq info [7553175:7553175:16:4294967295]
00000400:00000200:23.0:1773851878.433480:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008f214ef5 nid 13776@kfi7 refs 2
00000400:00000200:23.0:1773851878.433480:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13776@kfi7 to cpt 5
00000400:00000200:23.0:1773851878.433482:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13776@kfi7(13776@kfi7:13776@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851878.433483:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008f214ef5 nid 13776@kfi7 refs 3
00000800:00000200:23.0:1773851878.433485:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851878.433485:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851878.433487:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851878.433489:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000869 Using peer 13776@kfi7(0x100000000000869)
00000800:00000200:23.0:1773851878.433492:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x100000000000869: rc=0
00000800:00000200:23.0:1773851878.433494:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000869 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851878.433495:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851878.433496:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a9bfc14 refcount 2 to 13776@kfi7
00010000:00000001:23.0:1773851878.433497:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851878.433497:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851878.433498:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851878.433498:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c16257d8 x1859599674849664/t0(0) o400->4109ff27-9e90-425c-accb-7a02287a1338@13776@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1345-0'
00000100:00100000:23.0:1773851878.433501:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c16257d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4109ff27-9e90-425c-accb-7a02287a1338+7:39620:x1859599674849664:12345-13776@kfi7:400:default-tuolumne1345-0 Request processed in 54us (81us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851878.433504:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000869 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851878.433505:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13776@kfi7, seq: 1998015
00000400:00000200:21.0:1773851878.433505:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:23.0:1773851878.433506:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007ec522b1 : new rpc_count 1
00000100:00000001:23.0:1773851878.433506:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851878.433506:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13776@kfi7: PUT: OK
00000400:00000200:21.0:1773851878.433506:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000403003e5
00000100:00000001:23.0:1773851878.433507:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851878.433507:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000010:21.0:1773851878.433507:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000403003e5.
00000100:00000001:21.0:1773851878.433507:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851878.433507:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851878.433508:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000400:00000200:21.0:1773851878.433508:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008f214ef5 nid 13776@kfi7 refs 2
00000020:00000010:23.0:1773851878.433509:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ed998973.
00000020:00000040:23.0:1773851878.433509:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000007ec522b1 : new refcount 6
00000100:00000001:23.0:1773851878.433510:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851878.433510:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 13776@kfi7(0000000036fed97b):0x0 lsk 2154 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000869 Transaction freed
00000800:00000200:17.0:1773851878.493440:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.493440:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.493442:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.493444:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.493446:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25507@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.493447:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25507@kfi7 : PUT - for me
00000400:00000200:17.0:1773851878.493448:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25507@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.493449:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a74e9c03 nid 25507@kfi7 refs 1
00000400:00000200:17.0:1773851878.493450:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25507@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.493451:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a74e9c03 nid 25507@kfi7 refs 2
00000400:00000200:17.0:1773851878.493452:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a74e9c03 nid 25507@kfi7 refs 3
00000400:00000200:17.0:1773851878.493453:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25442@kfi7 to cpt 5
00000400:00000200:17.0:1773851878.493454:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25442@kfi7 of length 224 into portal 12 MB=0x69b2e40c44080
00000400:00000200:17.0:1773851878.493455:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25442@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 27568
00000800:00000200:17.0:1773851878.493457:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.493458:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.493459:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25507@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.493460:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.493461:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.493462:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b847edc0.
00000100:00000040:17.0:1773851878.493463:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b847edc0 x1859472817668224 msgsize 224
00000100:00100000:17.0:1773851878.493464:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25442@kfi7 (source: 12345-25507@kfi7)
00000100:00000001:17.0:1773851878.493465:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.493466:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a74e9c03 nid 25507@kfi7 refs 2
00000800:00000200:17.0:1773851878.493467:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851878.493470:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851878.493470:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851878.493471:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851878.493471:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851878.493472:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851878.493473:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859472817668224
00000020:00000001:17.0:1773851878.493473:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851878.493474:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c9b8f00fd
00000020:00000001:17.0:1773851878.493474:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851878.493476:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000089048516 refcount=5
00000020:00000001:17.0:1773851878.493476:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138479724544 : -106935229827072 : ffff9ebe339cb800)
00000020:00000001:17.0:1773851878.493477:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138479724544 : -106935229827072 : ffff9ebe339cb800)
00000100:00000001:17.0:1773851878.493478:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.493479:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851878.493479:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097472cd0.
00000020:00000010:17.0:1773851878.493480:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.493481:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851878.493482:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851878.493482:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851878.493482:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.493483:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851878.493484:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851878.493484:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.493485:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.493486:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851878.493486:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851878.493486:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851878.493487:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25442@kfi7, seq: 2156372
00000100:00000001:16.0:1773851878.493487:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851878.493488:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000089048516 : new rpc_count 1
00000100:00000001:16.0:1773851878.493488:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.493489:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985314816 : -106952724236800 : ffff9eba20dd3600)
00000100:00000001:16.0:1773851878.493489:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.493490:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b847edc0 x1859472817668224/t0(0) o400->5b2ab6d3-df72-48f1-a469-0c7dd01abafc@25442@kfi7:99/0 lens 224/0 e 0 to 0 dl 1773852214 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2076-0'
00000100:00000001:17.0:1773851878.493493:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.493493:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851878.493494:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b847edc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5b2ab6d3-df72-48f1-a469-0c7dd01abafc+5:40036:x1859472817668224:12345-25442@kfi7:400:default-tuolumne2076-0
00000100:00000200:17.0:1773851878.493495:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859472817668224
00000020:00000001:17.0:1773851878.493496:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851878.493496:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851878.493497:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.493498:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851878.493498:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851878.493499:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851878.493499:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859472817668224, found 0 last_xid 1859472817668223
00000020:00000001:17.0:1773851878.493500:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851878.493501:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851878.493501:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851878.493502:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.493502:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851878.493503:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851878.493503:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851878.493504:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b479367b.
02000000:00000001:17.0:1773851878.493505:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.493505:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.493506:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851878.493507:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183011602060, transno 0, xid 1859472817668224
00010000:00000001:17.0:1773851878.493507:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851878.493508:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b847edc0 x1859472817668224/t0(0) o400->5b2ab6d3-df72-48f1-a469-0c7dd01abafc@25442@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2076-0'
00010000:00000001:17.0:1773851878.493510:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851878.493511:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851878.493512:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=111 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851878.493515:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851878.493516:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e09756e1 refcount 3 to 25442@kfi7
00000100:00000001:17.0:1773851878.493516:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026336 : -107156745525280 : ffff9e8aa03f67e0)
02000000:00000001:17.0:1773851878.493517:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851878.493518:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.493518:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851878.493519:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25507@kfi7
00000400:00000010:17.0:1773851878.493520:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000094b822eb.
00000100:00000200:17.0:1773851878.493521:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859472817668224, offset 224
00000400:00000200:17.0:1773851878.493522:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25507@kfi7
00000400:00000200:17.0:1773851878.493522:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25507@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.493523:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a74e9c03 nid 25507@kfi7 refs 1
00000400:00000200:17.0:1773851878.493524:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a74e9c03 nid 25507@kfi7 refs 2
00000400:00000200:17.0:1773851878.493525:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a74e9c03 nid 25507@kfi7 refs 3
00000400:00000200:17.0:1773851878.493526:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25507@kfi7 local destination
00000400:00000200:17.0:1773851878.493527:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769612:8769612:1024:4294967295] 25507@kfi7 LPNI seq info [770272:770272:16:4294967295]
00000400:00000200:17.0:1773851878.493528:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a74e9c03 nid 25507@kfi7 refs 2
00000400:00000200:17.0:1773851878.493529:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25507@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.493531:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25507@kfi7(25507@kfi7:25507@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851878.493532:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a74e9c03 nid 25507@kfi7 refs 3
00000800:00000200:17.0:1773851878.493533:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.493534:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851878.493537:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.493539:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x351 Using peer 25507@kfi7(0x351)
00000800:00000200:17.0:1773851878.493542:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x351: rc=0
00000800:00000200:17.0:1773851878.493543:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x351 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851878.493545:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.493546:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e09756e1 refcount 2 to 25442@kfi7
00010000:00000001:17.0:1773851878.493547:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851878.493547:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.493548:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851878.493548:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b847edc0 x1859472817668224/t0(0) o400->5b2ab6d3-df72-48f1-a469-0c7dd01abafc@25442@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2076-0'
00000100:00100000:17.0:1773851878.493552:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b847edc0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5b2ab6d3-df72-48f1-a469-0c7dd01abafc+5:40036:x1859472817668224:12345-25442@kfi7:400:default-tuolumne2076-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851878.493554:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25442@kfi7, seq: 2156372
00000100:00000040:17.0:1773851878.493555:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000089048516 : new rpc_count 0
00000800:00000200:18.0:1773851878.493556:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x351 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851878.493556:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851878.493556:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851878.493556:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851878.493557:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851878.493557:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:18.0:1773851878.493558:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25507@kfi7: PUT: OK
00000020:00000010:17.0:1773851878.493558:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097472cd0.
00000400:00000200:18.0:1773851878.493559:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000094b822eb
00000020:00000040:17.0:1773851878.493559:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000089048516 : new refcount 4
00000400:00000010:18.0:1773851878.493560:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000094b822eb.
00000100:00000001:18.0:1773851878.493560:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851878.493560:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851878.493561:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851878.493562:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a74e9c03 nid 25507@kfi7 refs 2
00000800:00000200:18.0:1773851878.493563:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 25507@kfi7(0000000019405c46):0x0 lsk 850 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x351 Transaction freed
00000800:00000200:29.0:1773851878.517003:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851878.517004:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851878.517005:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851878.517007:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851878.517009:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24322@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.517010:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24322@kfi7 : PUT - for me
00000400:00000200:29.0:1773851878.517011:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24322@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.517012:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b40374fb nid 24322@kfi7 refs 1
00000400:00000200:29.0:1773851878.517013:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24322@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.517014:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b40374fb nid 24322@kfi7 refs 2
00000400:00000200:29.0:1773851878.517014:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b40374fb nid 24322@kfi7 refs 3
00000400:00000200:29.0:1773851878.517015:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24515@kfi7 to cpt 5
00000400:00000200:29.0:1773851878.517016:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24515@kfi7 of length 224 into portal 12 MB=0x69b87fccb2d80
00000400:00000200:29.0:1773851878.517017:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24515@kfi7 of length 224/224 into md 0x77fe139dd [64] + 188360
00000800:00000200:29.0:1773851878.517019:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851878.517021:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.517022:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24322@kfi7: PUT: OK
00000100:00000001:29.0:1773851878.517023:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851878.517023:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851878.517024:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e06e3e2f.
00000100:00000040:29.0:1773851878.517025:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000e06e3e2f x1859858224328064 msgsize 224
00000100:00100000:29.0:1773851878.517026:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-24515@kfi7 (source: 12345-24322@kfi7)
00000100:00000001:29.0:1773851878.517027:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851878.517028:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b40374fb nid 24322@kfi7 refs 2
00000800:00000200:29.0:1773851878.517029:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851878.517029:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851878.517029:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851878.517030:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851878.517030:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851878.517032:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851878.517033:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859858224328064
00000020:00000001:28.0:1773851878.517033:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851878.517034:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f088e783d992
00000020:00000001:28.0:1773851878.517034:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851878.517037:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003c03296c refcount=5
00000020:00000001:28.0:1773851878.517037:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637079685341184 : -106994024210432 : ffff9eb08331a000)
00000020:00000001:28.0:1773851878.517038:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637079685341184 : -106994024210432 : ffff9eb08331a000)
00000100:00000001:28.0:1773851878.517039:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851878.517041:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851878.517041:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851878.517043:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851878.517043:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851878.517044:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851878.517045:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851878.517046:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851878.517047:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851878.517047:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851878.517048:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.517049:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.517050:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851878.517050:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851878.517050:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851878.517051:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851878.517051:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24515@kfi7, seq: 2055549
00000100:00000001:30.0:1773851878.517052:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851878.517052:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003c03296c : new rpc_count 1
00000100:00000001:30.0:1773851878.517053:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.517053:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079339664512 : -106994369887104 : ffff9eb06e970480)
00000100:00000040:28.0:1773851878.517054:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e06e3e2f x1859858224328064/t0(0) o400->3e5c1a46-febe-41cd-be05-b3129928c7bb@24515@kfi7:666/0 lens 224/0 e 0 to 0 dl 1773852026 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2023-0'
00000100:00000001:28.0:1773851878.517057:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851878.517057:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851878.517058:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e06e3e2f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:3e5c1a46-febe-41cd-be05-b3129928c7bb+5:39794:x1859858224328064:12345-24515@kfi7:400:default-tuolumne2023-0
00000100:00000200:28.0:1773851878.517060:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859858224328064
00000020:00000001:28.0:1773851878.517061:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851878.517062:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851878.517063:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.517063:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851878.517064:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851878.517065:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851878.517065:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859858224328064, found 0 last_xid 1859858224328063
00000020:00000001:28.0:1773851878.517066:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851878.517067:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851878.517067:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851878.517068:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.517069:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851878.517069:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851878.517070:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851878.517070:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000027a2a550.
02000000:00000001:28.0:1773851878.517071:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.517071:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.517072:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851878.517073:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044183336, transno 0, xid 1859858224328064
00010000:00000001:28.0:1773851878.517074:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851878.517075:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e06e3e2f x1859858224328064/t0(0) o400->3e5c1a46-febe-41cd-be05-b3129928c7bb@24515@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2023-0'
00010000:00000001:28.0:1773851878.517077:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851878.517077:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851878.517078:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=111 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851878.517079:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851878.517080:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3dee18c refcount 3 to 24515@kfi7
00000100:00000001:28.0:1773851878.517081:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106592 : -107156354445024 : ffff9e8ab78ed120)
02000000:00000001:28.0:1773851878.517081:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851878.517082:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.517082:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851878.517083:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24322@kfi7
00000400:00000010:28.0:1773851878.517084:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ebafbfca.
00000100:00000200:28.0:1773851878.517085:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859858224328064, offset 224
00000400:00000200:28.0:1773851878.517086:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24322@kfi7
00000400:00000200:28.0:1773851878.517087:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24322@kfi7 to cpt 7
00000400:00000200:28.0:1773851878.517088:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b40374fb nid 24322@kfi7 refs 1
00000400:00000200:28.0:1773851878.517089:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b40374fb nid 24322@kfi7 refs 2
00000400:00000200:28.0:1773851878.517091:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b40374fb nid 24322@kfi7 refs 3
00000400:00000200:28.0:1773851878.517092:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24322@kfi7 local destination
00000400:00000200:28.0:1773851878.517093:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769613:8769613:1024:4294967295] 24322@kfi7 LPNI seq info [7170769:7170769:16:4294967295]
00000400:00000200:28.0:1773851878.517095:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b40374fb nid 24322@kfi7 refs 2
00000400:00000200:28.0:1773851878.517095:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24322@kfi7 to cpt 7
00000400:00000200:28.0:1773851878.517097:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24322@kfi7(24322@kfi7:24322@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851878.517098:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b40374fb nid 24322@kfi7 refs 3
00000800:00000200:28.0:1773851878.517100:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851878.517101:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851878.517103:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851878.517105:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x576 Using peer 24322@kfi7(0x576)
00000800:00000200:28.0:1773851878.517108:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x576: rc=0
00000800:00000200:28.0:1773851878.517110:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x576 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851878.517112:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851878.517113:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3dee18c refcount 2 to 24515@kfi7
00010000:00000001:28.0:1773851878.517114:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851878.517114:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.517115:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851878.517115:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e06e3e2f x1859858224328064/t0(0) o400->3e5c1a46-febe-41cd-be05-b3129928c7bb@24515@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2023-0'
00000100:00100000:28.0:1773851878.517120:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e06e3e2f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:3e5c1a46-febe-41cd-be05-b3129928c7bb+5:39794:x1859858224328064:12345-24515@kfi7:400:default-tuolumne2023-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851878.517123:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24515@kfi7, seq: 2055549
00000100:00000040:28.0:1773851878.517124:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003c03296c : new rpc_count 0
00000100:00000001:28.0:1773851878.517125:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851878.517125:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851878.517126:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851878.517127:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851878.517128:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851878.517128:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000003c03296c : new refcount 4
00000100:00000001:28.0:1773851878.517129:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851878.517134:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x576 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851878.517136:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.517137:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24322@kfi7: PUT: OK
00000400:00000200:29.0:1773851878.517138:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ebafbfca
00000400:00000010:29.0:1773851878.517139:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ebafbfca.
00000100:00000001:29.0:1773851878.517139:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851878.517140:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851878.517140:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b40374fb nid 24322@kfi7 refs 2
00000800:00000200:29.0:1773851878.517142:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2069@kfi7:7 -> 24322@kfi7(0000000001982b93):0x0 lsk 1399 rsk 25 tsk 0 trmk 0 tmk 0 trr 7 tta 0x576 Transaction freed
00010000:00000001:2.0:1773851878.537730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537730:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851878.537731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851878.537732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851878.537733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851878.537734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851878.537735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851878.537736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851878.537737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851878.537738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851878.537740:0:849254:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851878.537740:0:849254:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851878.537741:0:849254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:2.0:1773851878.566382:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.566382:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851878.566383:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851878.566383:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851878.566384:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851878.566384:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:1.0:1773851878.566386:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22322@kfi7(0000000085c6b206):0x4fd version: 2; local version 2; negotiated version: 2
00000800:00000200:2.0:1773851878.566387:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851878.566388:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd Using peer 22322@kfi7(0x4fd)
00000400:00000200:2.0:1773851878.566389:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22322@kfi7 to cpt 0
00000400:00000200:2.0:1773851878.566390:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22322@kfi7 : PUT - for me
00000400:00000200:1.0:1773851878.566390:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22322@kfi7 to cpt 0
00000400:00000200:2.0:1773851878.566391:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22322@kfi7 to cpt 0
00000800:00000200:1.0:1773851878.566391:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 38 bytes to peer 0x4fd: rc=0
00000400:00000200:2.0:1773851878.566392:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000073be73e nid 22322@kfi7 refs 1
00000400:00000200:2.0:1773851878.566393:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22322@kfi7 to cpt 0
00000800:00000200:1.0:1773851878.566393:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851878.566395:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000073be73e nid 22322@kfi7 refs 2
00000400:00000200:2.0:1773851878.566395:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000073be73e nid 22322@kfi7 refs 3
00000400:00000200:2.0:1773851878.566396:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22514@kfi7 to cpt 2
00000400:00000200:2.0:1773851878.566397:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22514@kfi7 of length 456 into portal 12 MB=0x69aef8f4c4180
00000400:00000200:2.0:1773851878.566399:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22514@kfi7 of length 456/456 into md 0x7fb56e801 [64] + 38712
00000800:00000200:2.0:1773851878.566401:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851878.566402:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851878.566403:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22322@kfi7: PUT: OK
00000100:00000001:2.0:1773851878.566404:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851878.566405:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:1.0:1773851878.566405:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd TN_EVENT_TX_OK event status 0
00000100:00000010:2.0:1773851878.566406:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc8a408f.
00000100:00000040:2.0:1773851878.566407:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000dc8a408f x1859203552264576 msgsize 456
00000800:00000200:1.0:1773851878.566407:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd Transaction freed
00000100:00100000:2.0:1773851878.566408:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-22514@kfi7 (source: 12345-22322@kfi7)
00000100:00000001:2.0:1773851878.566409:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851878.566410:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000073be73e nid 22322@kfi7 refs 2
00000800:00000200:2.0:1773851878.566412:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009005aa0b: 2069@kfi7:0 <- 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851878.566412:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851878.566413:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851878.566414:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851878.566415:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851878.566415:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851878.566416:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859203552264576
00000020:00000001:1.0:1773851878.566417:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851878.566417:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ea1
00000020:00000001:1.0:1773851878.566418:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851878.566423:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e1c8effe refcount=6
00000020:00000001:1.0:1773851878.566423:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629018624 : -107123080532992 : ffff9e9276d66c00)
00000020:00000001:1.0:1773851878.566424:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629018624 : -107123080532992 : ffff9e9276d66c00)
00000100:00000001:1.0:1773851878.566425:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.566426:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851878.566426:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851878.566427:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851878.566428:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851878.566429:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851878.566430:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851878.566430:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.566431:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.566432:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851878.566433:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851878.566434:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851878.566434:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851878.566434:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851878.566435:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851878.566435:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22514@kfi7, seq: 408701481
00000100:00000040:1.0:1773851878.566435:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e1c8effe : new rpc_count 1
00000100:00000001:2.0:1773851878.566436:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.566436:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637031984551296 : -107041725000320 : ffff9ea568015580)
00000100:00000040:1.0:1773851878.566437:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dc8a408f x1859203552264576/t0(0) o17->5e2b9d3f-4949-45a9-952b-76188e1d8cac@22514@kfi7:605/0 lens 456/0 e 0 to 0 dl 1773851965 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1881-0'
00000100:00000001:1.0:1773851878.566440:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.566440:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851878.566441:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc8a408f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5e2b9d3f-4949-45a9-952b-76188e1d8cac+6:39702:x1859203552264576:12345-22514@kfi7:17:default-tuolumne1881-0
00000100:00000200:1.0:1773851878.566443:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859203552264576
00000020:00000001:1.0:1773851878.566443:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851878.566444:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851878.566445:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.566446:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851878.566446:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:1.0:1773851878.566447:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851878.566448:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859203552264576, found 0 last_xid 1859203552264575
00000020:00000001:1.0:1773851878.566449:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851878.566449:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851878.566450:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851878.566450:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:1.0:1773851878.566451:0:60951:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:1.0:1773851878.566452:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851878.566452:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851878.566453:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000a9c5d6df.
02000000:00000001:1.0:1773851878.566454:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.566455:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.566455:0:60951:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:1.0:1773851878.566456:0:60951:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:1.0:1773851878.566456:0:60951:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:1.0:1773851878.566457:0:60951:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.566458:0:60951:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:1.0:1773851878.566458:0:60951:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 5e2b9d3f-4949-45a9-952b-76188e1d8cac/00000000e1c8effe free: 126633370845184 avail: 126633368748032
00000020:00000001:1.0:1773851878.566459:0:60951:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:1.0:1773851878.566460:0:60951:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 5e2b9d3f-4949-45a9-952b-76188e1d8cac/00000000e1c8effe avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:1.0:1773851878.566461:0:60951:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:1.0:1773851878.566462:0:60951:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:1.0:1773851878.566462:0:60951:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 5e2b9d3f-4949-45a9-952b-76188e1d8cac/00000000e1c8effe reports grant 1808924670 dropped 0, local 1873674239
00000020:00000001:1.0:1773851878.566463:0:60951:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:1.0:1773851878.566464:0:60951:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:1.0:1773851878.566464:0:60951:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851878.566465:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252857852, transno 0, xid 1859203552264576
00010000:00000001:1.0:1773851878.566465:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851878.566466:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dc8a408f x1859203552264576/t0(0) o17->5e2b9d3f-4949-45a9-952b-76188e1d8cac@22514@kfi7:605/0 lens 456/432 e 0 to 0 dl 1773851965 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1881-0'
00010000:00000001:1.0:1773851878.566469:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851878.566470:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851878.566470:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=111 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851878.566471:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851878.566472:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f44337d2 refcount 3 to 22514@kfi7
00000100:00000001:1.0:1773851878.566473:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074983264 : -107155634568352 : ffff9e8ae2774360)
02000000:00000001:1.0:1773851878.566474:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851878.566474:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.566475:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851878.566476:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22322@kfi7
00000400:00000010:1.0:1773851878.566476:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000b2d6ec9.
00000100:00000200:1.0:1773851878.566477:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859203552264576, offset 224
00000400:00000200:1.0:1773851878.566479:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22322@kfi7
00000400:00000200:1.0:1773851878.566480:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22322@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.566481:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000073be73e nid 22322@kfi7 refs 1
00000400:00000200:1.0:1773851878.566482:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000073be73e nid 22322@kfi7 refs 2
00000400:00000200:1.0:1773851878.566483:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000073be73e nid 22322@kfi7 refs 3
00000400:00000200:1.0:1773851878.566484:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22322@kfi7 local destination
00000400:00000200:1.0:1773851878.566486:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769614:8769614:1024:4294967295] 22322@kfi7 LPNI seq info [9519157:9519157:16:4294967295]
00000400:00000200:1.0:1773851878.566487:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000073be73e nid 22322@kfi7 refs 2
00000400:00000200:1.0:1773851878.566488:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22322@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.566490:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22322@kfi7(22322@kfi7:22322@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851878.566491:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000073be73e nid 22322@kfi7 refs 3
00000800:00000200:1.0:1773851878.566492:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.566493:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:1.0:1773851878.566495:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851878.566497:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd Using peer 22322@kfi7(0x4fd)
00000800:00000200:1.0:1773851878.566502:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 532 bytes to peer 0x4fd: rc=0
00000800:00000200:1.0:1773851878.566503:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851878.566505:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851878.566506:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f44337d2 refcount 2 to 22514@kfi7
00010000:00000001:1.0:1773851878.566507:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851878.566507:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.566508:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851878.566509:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dc8a408f x1859203552264576/t0(0) o17->5e2b9d3f-4949-45a9-952b-76188e1d8cac@22514@kfi7:605/0 lens 456/432 e 0 to 0 dl 1773851965 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1881-0'
00000100:00100000:1.0:1773851878.566512:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc8a408f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5e2b9d3f-4949-45a9-952b-76188e1d8cac+6:39702:x1859203552264576:12345-22514@kfi7:17:default-tuolumne1881-0 Request processed in 71us (104us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851878.566514:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22514@kfi7, seq: 408701481
00000100:00000040:1.0:1773851878.566515:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e1c8effe : new rpc_count 0
00000800:00000200:2.0:1773851878.566516:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851878.566516:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851878.566516:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851878.566517:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851878.566517:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:2.0:1773851878.566518:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22322@kfi7: PUT: OK
00000020:00000010:1.0:1773851878.566518:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000020:00000010:1.0:1773851878.566518:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:2.0:1773851878.566519:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000b2d6ec9
00000020:00000040:1.0:1773851878.566519:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000e1c8effe : new refcount 5
00000400:00000010:2.0:1773851878.566520:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000b2d6ec9.
00000100:00000001:2.0:1773851878.566520:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851878.566520:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851878.566521:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851878.566522:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000073be73e nid 22322@kfi7 refs 2
00000800:00000200:2.0:1773851878.566523:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22322@kfi7(0000000085c6b206):0x0 lsk 1278 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4fd Transaction freed
00000800:00000200:17.0:1773851878.606109:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.606110:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.606111:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.606114:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.606116:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.606118:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.167@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851878.606119:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.606120:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851878.606121:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.167@o2ib600 to cpt 0
00000400:00000200:17.0:1773851878.606123:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f316d7b nid 172.19.3.167@o2ib600 refs 2
00000400:00000200:17.0:1773851878.606124:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002f316d7b nid 172.19.3.167@o2ib600 refs 3
00000400:00000200:17.0:1773851878.606126:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.167@o2ib600 to cpt 0
00000400:00000200:17.0:1773851878.606128:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.167@o2ib600 of length 224 into portal 12 MB=0x69a7463973040
00000400:00000200:17.0:1773851878.606130:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.167@o2ib600 of length 224/224 into md 0x7fb56e801 [64] + 39168
00000800:00000200:17.0:1773851878.606132:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.606134:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.606136:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.606137:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.606137:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.606138:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000003676c66.
00000100:00000040:17.0:1773851878.606139:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000003676c66 x1858674538000448 msgsize 224
00000100:00100000:17.0:1773851878.606141:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.167@o2ib600 (source: 12345-172.19.3.167@o2ib600)
00000100:00000001:17.0:1773851878.606143:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.606144:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851878.606145:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851878.606146:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851878.606147:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851878.606147:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851878.606148:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851878.606148:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851878.606149:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858674538000448
00000020:00000001:1.0:1773851878.606149:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851878.606150:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90eef
00000020:00000001:1.0:1773851878.606150:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851878.606151:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005456f265 refcount=6
00000020:00000001:1.0:1773851878.606151:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239879680 : -107152469671936 : ffff9e8b9f1bc000)
00000020:00000001:1.0:1773851878.606153:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239879680 : -107152469671936 : ffff9e8b9f1bc000)
00000100:00000001:1.0:1773851878.606154:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.606155:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851878.606155:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851878.606156:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851878.606156:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851878.606157:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851878.606158:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851878.606158:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851878.606159:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851878.606159:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851878.606160:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.606161:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851878.606162:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851878.606162:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851878.606163:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851878.606163:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851878.606163:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.167@o2ib600, seq: 1997585
00000100:00000001:2.0:1773851878.606164:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851878.606164:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005456f265 : new rpc_count 1
00000100:00000001:2.0:1773851878.606165:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.606165:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985327488 : -106952724224128 : ffff9eba20dd6780)
00000100:00000040:1.0:1773851878.606166:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000003676c66 x1858674538000448/t0(0) o400->35468967-9f48-46c7-a636-a8a2fd5ce1a9@172.19.3.167@o2ib600:518/0 lens 224/0 e 0 to 0 dl 1773852633 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic17-0'
00000100:00000001:1.0:1773851878.606169:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.606169:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851878.606170:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003676c66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:35468967-9f48-46c7-a636-a8a2fd5ce1a9+6:32004:x1858674538000448:12345-172.19.3.167@o2ib600:400:default-oslic17-0
00000100:00000200:1.0:1773851878.606172:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858674538000448
00000020:00000001:1.0:1773851878.606172:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851878.606173:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851878.606173:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.606174:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851878.606174:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851878.606175:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851878.606175:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858674538000448, found 0 last_xid 1858674538000447
00000020:00000001:1.0:1773851878.606176:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851878.606178:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851878.606178:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851878.606179:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.606179:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851878.606180:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851878.606180:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851878.606181:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000199054b2.
02000000:00000001:1.0:1773851878.606181:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.606182:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.606183:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851878.606183:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858674538000448
00010000:00000001:1.0:1773851878.606184:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851878.606185:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000003676c66 x1858674538000448/t0(0) o400->35468967-9f48-46c7-a636-a8a2fd5ce1a9@172.19.3.167@o2ib600:518/0 lens 224/224 e 0 to 0 dl 1773852633 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic17-0'
00010000:00000001:1.0:1773851878.606187:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851878.606188:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851878.606188:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=111 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851878.606189:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851878.606190:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007cb19aa0 refcount 3 to 172.19.3.167@o2ib600
00000100:00000001:1.0:1773851878.606191:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050048 : -107154804501568 : ffff9e8b13f113c0)
02000000:00000001:1.0:1773851878.606191:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851878.606192:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.606192:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851878.606193:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.167@o2ib600
00000400:00000010:1.0:1773851878.606194:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e89a281.
00000100:00000200:1.0:1773851878.606195:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858674538000448, offset 224
00000400:00000200:1.0:1773851878.606196:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.167@o2ib600
00000400:00000200:1.0:1773851878.606197:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.167@o2ib600 to cpt 0
00000400:00000200:1.0:1773851878.606199:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f316d7b nid 172.19.3.167@o2ib600 refs 2
00000400:00000200:1.0:1773851878.606200:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002f316d7b nid 172.19.3.167@o2ib600 refs 3
00000400:00000200:1.0:1773851878.606201:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002f316d7b nid 172.19.3.167@o2ib600 refs 4
00000400:00000200:1.0:1773851878.606202:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.167@o2ib600 routed destination
00000400:00000200:1.0:1773851878.606203:0:60951:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:1.0:1773851878.606214:0:60951:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:1.0:1773851878.606216:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.167@o2ib600: rtr pref emtpy: 1
00000400:00000200:1.0:1773851878.606217:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:1.0:1773851878.606219:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.167@o2ib600: rtr pref emtpy: 1
00000400:00000200:1.0:1773851878.606219:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:1.0:1773851878.606220:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769615:8769615:1024:4294967295] 2094@kfi7 LPNI seq info [1258747007:1258747007:16:4294967295]
00000400:00000200:1.0:1773851878.606222:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:1.0:1773851878.606222:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:1.0:1773851878.606225:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.167@o2ib600(172.19.3.167@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851878.606226:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002f316d7b nid 172.19.3.167@o2ib600 refs 3
00000800:00000200:1.0:1773851878.606228:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.606229:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851878.606231:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851878.606233:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:1.0:1773851878.606236:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:1.0:1773851878.606238:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851878.606239:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851878.606240:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007cb19aa0 refcount 2 to 172.19.3.167@o2ib600
00010000:00000001:1.0:1773851878.606241:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851878.606241:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.606242:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851878.606243:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000003676c66 x1858674538000448/t0(0) o400->35468967-9f48-46c7-a636-a8a2fd5ce1a9@172.19.3.167@o2ib600:518/0 lens 224/224 e 0 to 0 dl 1773852633 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic17-0'
00000100:00100000:1.0:1773851878.606246:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003676c66 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:35468967-9f48-46c7-a636-a8a2fd5ce1a9+6:32004:x1858674538000448:12345-172.19.3.167@o2ib600:400:default-oslic17-0 Request processed in 76us (106us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851878.606248:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.167@o2ib600, seq: 1997585
00000800:00000200:2.0:1773851878.606249:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00000040:1.0:1773851878.606250:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005456f265 : new rpc_count 0
00000100:00000001:1.0:1773851878.606250:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851878.606251:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851878.606251:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851878.606251:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:2.0:1773851878.606252:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:1.0:1773851878.606252:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000020:00000010:1.0:1773851878.606252:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:2.0:1773851878.606253:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e89a281
00000400:00000010:2.0:1773851878.606253:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e89a281.
00000020:00000040:1.0:1773851878.606253:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005456f265 : new refcount 5
00000100:00000001:2.0:1773851878.606254:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851878.606254:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:1.0:1773851878.606254:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851878.606255:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:2.0:1773851878.606257:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Transaction freed
00000800:00000200:1.0:1773851878.608841:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.608842:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851878.608845:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851878.608848:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851878.608851:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8834@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.608853:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8834@kfi7 : PUT - for me
00000400:00000200:1.0:1773851878.608855:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8834@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.608856:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e249ffb1 nid 8834@kfi7 refs 1
00000400:00000200:1.0:1773851878.608858:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8834@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.608859:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e249ffb1 nid 8834@kfi7 refs 2
00000400:00000200:1.0:1773851878.608860:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e249ffb1 nid 8834@kfi7 refs 3
00000400:00000200:1.0:1773851878.608862:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8835@kfi7 to cpt 3
00000400:00000200:1.0:1773851878.608863:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8835@kfi7 of length 224 into portal 12 MB=0x69b4bfa37da80
00000400:00000200:1.0:1773851878.608866:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8835@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 39392
00000800:00000200:1.0:1773851878.608869:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851878.608872:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851878.608874:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8834@kfi7: PUT: OK
00000100:00000001:1.0:1773851878.608875:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851878.608876:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851878.608878:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008e86e227.
00000100:00000040:1.0:1773851878.608879:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000008e86e227 x1859600483080832 msgsize 224
00000100:00100000:1.0:1773851878.608882:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8835@kfi7 (source: 12345-8834@kfi7)
00000100:00000001:1.0:1773851878.608885:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851878.608886:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e249ffb1 nid 8834@kfi7 refs 2
00000800:00000200:1.0:1773851878.608888:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851878.608893:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851878.608893:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851878.608894:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851878.608895:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851878.608896:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851878.608897:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600483080832
00000020:00000001:1.0:1773851878.608897:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851878.608898:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d8cfb8
00000020:00000001:1.0:1773851878.608899:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851878.608903:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001f7d26e2 refcount=8
00000020:00000001:1.0:1773851878.608903:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096548145152 : -106977161406464 : ffff9eb4704b9800)
00000020:00000001:1.0:1773851878.608904:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637096548145152 : -106977161406464 : ffff9eb4704b9800)
00000100:00000001:1.0:1773851878.608906:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.608907:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851878.608907:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851878.608909:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851878.608910:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851878.608911:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851878.608911:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851878.608912:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851878.608913:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851878.608914:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851878.608915:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.608916:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851878.608918:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851878.608918:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851878.608919:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851878.608919:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851878.608920:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8835@kfi7, seq: 1997586
00000100:00000001:2.0:1773851878.608921:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851878.608921:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001f7d26e2 : new rpc_count 1
00000100:00000001:2.0:1773851878.608922:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.608922:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130782262144 : -106942927289472 : ffff9ebc68cec380)
00000100:00000040:1.0:1773851878.608923:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008e86e227 x1859600483080832/t0(0) o400->7f77dcec-0691-45ca-90f0-a54fd1de0727@8835@kfi7:518/0 lens 224/0 e 0 to 0 dl 1773852633 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1048-0'
00000100:00000001:1.0:1773851878.608929:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851878.608929:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851878.608931:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e86e227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7f77dcec-0691-45ca-90f0-a54fd1de0727+8:39550:x1859600483080832:12345-8835@kfi7:400:default-tuolumne1048-0
00000100:00000200:1.0:1773851878.608933:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600483080832
00000020:00000001:1.0:1773851878.608934:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851878.608934:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851878.608935:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.608936:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851878.608937:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851878.608938:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851878.608939:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600483080832, found 0 last_xid 1859600483080831
00000020:00000001:1.0:1773851878.608940:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851878.608941:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851878.608941:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851878.608942:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.608943:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851878.608944:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851878.608944:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851878.608945:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000042b9c0ff.
02000000:00000001:1.0:1773851878.608946:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.608947:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.608948:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851878.608949:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859600483080832
00010000:00000001:1.0:1773851878.608950:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851878.608951:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008e86e227 x1859600483080832/t0(0) o400->7f77dcec-0691-45ca-90f0-a54fd1de0727@8835@kfi7:518/0 lens 224/224 e 0 to 0 dl 1773852633 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1048-0'
00010000:00000001:1.0:1773851878.608956:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851878.608957:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851878.608958:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=111 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851878.608960:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851878.608961:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce20e648 refcount 3 to 8835@kfi7
00000100:00000001:1.0:1773851878.608962:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298688 : -107155980252928 : ffff9e8acddc8900)
02000000:00000001:1.0:1773851878.608964:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851878.608965:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851878.608966:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851878.608967:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8834@kfi7
00000400:00000010:1.0:1773851878.608968:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000409960d4.
00000100:00000200:1.0:1773851878.608970:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600483080832, offset 224
00000400:00000200:1.0:1773851878.608972:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8834@kfi7
00000400:00000200:1.0:1773851878.608974:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8834@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.608975:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e249ffb1 nid 8834@kfi7 refs 1
00000400:00000200:1.0:1773851878.608977:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e249ffb1 nid 8834@kfi7 refs 2
00000400:00000200:1.0:1773851878.608979:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e249ffb1 nid 8834@kfi7 refs 3
00000400:00000200:1.0:1773851878.608981:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8834@kfi7 local destination
00000400:00000200:1.0:1773851878.608983:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769616:8769616:1024:4294967295] 8834@kfi7 LPNI seq info [17362:17362:16:4294967295]
00000400:00000200:1.0:1773851878.608985:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e249ffb1 nid 8834@kfi7 refs 2
00000400:00000200:1.0:1773851878.608987:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8834@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.608991:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8834@kfi7(8834@kfi7:8834@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851878.608993:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e249ffb1 nid 8834@kfi7 refs 3
00000800:00000200:1.0:1773851878.608995:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.608997:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851878.609001:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851878.609005:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x117 Using peer 8834@kfi7(0x117)
00000800:00000200:1.0:1773851878.609010:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x117: rc=0
00000800:00000200:1.0:1773851878.609013:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x117 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851878.609016:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851878.609017:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce20e648 refcount 2 to 8835@kfi7
00010000:00000001:1.0:1773851878.609019:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851878.609019:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851878.609021:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851878.609023:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008e86e227 x1859600483080832/t0(0) o400->7f77dcec-0691-45ca-90f0-a54fd1de0727@8835@kfi7:518/0 lens 224/224 e 0 to 0 dl 1773852633 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1048-0'
00000800:00000200:2.0:1773851878.609028:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x117 TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851878.609028:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e86e227 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:7f77dcec-0691-45ca-90f0-a54fd1de0727+8:39550:x1859600483080832:12345-8835@kfi7:400:default-tuolumne1048-0 Request processed in 99us (148us total) trans 0 rc 0/0
00000400:00000200:2.0:1773851878.609032:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851878.609033:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8835@kfi7, seq: 1997586
00000400:00000200:2.0:1773851878.609034:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8834@kfi7: PUT: OK
00000100:00000040:1.0:1773851878.609034:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001f7d26e2 : new rpc_count 0
00000400:00000200:2.0:1773851878.609035:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000409960d4
00000100:00000001:1.0:1773851878.609035:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:2.0:1773851878.609036:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000409960d4.
00000100:00000001:1.0:1773851878.609036:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:2.0:1773851878.609037:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851878.609037:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851878.609037:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851878.609038:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000400:00000200:2.0:1773851878.609039:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e249ffb1 nid 8834@kfi7 refs 2
00000020:00000010:1.0:1773851878.609039:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000020:00000040:1.0:1773851878.609040:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000001f7d26e2 : new refcount 7
00000800:00000200:2.0:1773851878.609041:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 8834@kfi7(00000000648aa22f):0x0 lsk 280 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x117 Transaction freed
00000100:00000001:1.0:1773851878.609042:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851878.633153:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.633154:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.633155:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.633158:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.633160:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.633161:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2060@kfi7 : PUT - for me
00000400:00000200:17.0:1773851878.633162:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.633163:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:17.0:1773851878.633164:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.633165:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:17.0:1773851878.633166:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:17.0:1773851878.633167:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.633168:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 224 into portal 12 MB=0x699e2246b4e40
00000400:00000200:17.0:1773851878.633170:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2060@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 27792
00000800:00000200:17.0:1773851878.633172:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.633174:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.633175:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.633177:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.633177:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.633178:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009488938a.
00000100:00000040:17.0:1773851878.633179:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000009488938a x1858046412934720 msgsize 224
00000100:00100000:17.0:1773851878.633181:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-2060@kfi7 (source: 12345-2060@kfi7)
00000100:00000001:17.0:1773851878.633182:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.633183:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:17.0:1773851878.633185:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851878.633187:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851878.633188:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851878.633189:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851878.633189:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851878.633190:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851878.633191:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858046412934720
00000020:00000001:17.0:1773851878.633192:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851878.633192:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acd224a
00000020:00000001:17.0:1773851878.633193:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851878.633195:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b036a95 refcount=5
00000020:00000001:17.0:1773851878.633196:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928642979840 : -107145066571776 : ffff9e8d585e1800)
00000020:00000001:17.0:1773851878.633197:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928642979840 : -107145066571776 : ffff9e8d585e1800)
00000100:00000001:17.0:1773851878.633198:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.633199:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851878.633200:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097472cd0.
00000020:00000010:17.0:1773851878.633201:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.633202:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851878.633203:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851878.633204:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851878.633204:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.633205:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851878.633206:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851878.633206:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.633207:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.633209:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851878.633209:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851878.633210:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851878.633210:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851878.633211:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2060@kfi7, seq: 2156373
00000100:00000040:17.0:1773851878.633212:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b036a95 : new rpc_count 1
00000100:00000001:17.0:1773851878.633212:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985303296 : -106952724248320 : ffff9eba20dd0900)
00000100:00000001:16.0:1773851878.633212:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851878.633212:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.633213:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009488938a x1858046412934720/t0(0) o400->lustre5-MDT0001-lwp-OST0001_UUID@2060@kfi7:99/0 lens 224/0 e 0 to 0 dl 1773852214 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba102-0'
00000100:00000001:17.0:1773851878.633216:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.633217:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851878.633218:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009488938a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:lustre5-MDT0001-lwp-OST0001_UUID+5:272703:x1858046412934720:12345-2060@kfi7:400:default-yuba102-0
00000100:00000200:17.0:1773851878.633219:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858046412934720
00000020:00000001:17.0:1773851878.633220:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851878.633221:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851878.633221:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.633222:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851878.633222:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851878.633223:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:17.0:1773851878.633224:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851878.633224:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851878.633225:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851878.633225:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.633226:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851878.633227:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851878.633227:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851878.633229:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000910516dd.
02000000:00000001:17.0:1773851878.633230:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.633230:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.633231:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851878.633231:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858046412934720
00010000:00000001:17.0:1773851878.633232:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851878.633233:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009488938a x1858046412934720/t0(0) o400->lustre5-MDT0001-lwp-OST0001_UUID@2060@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba102-0'
00010000:00000001:17.0:1773851878.633235:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851878.633236:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851878.633237:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=111 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851878.633238:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851878.633238:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000667bf0e7 refcount 7 to 2060@kfi7
00000100:00000001:17.0:1773851878.633239:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583515936 : -107156126035680 : ffff9e8ac52c1120)
02000000:00000001:17.0:1773851878.633240:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851878.633240:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.633241:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851878.633242:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:17.0:1773851878.633242:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003fab839b.
00000100:00000200:17.0:1773851878.633243:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858046412934720, offset 224
00000400:00000200:17.0:1773851878.633244:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000200:17.0:1773851878.633245:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.633246:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:17.0:1773851878.633247:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:17.0:1773851878.633248:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:17.0:1773851878.633249:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2060@kfi7 local destination
00000400:00000200:17.0:1773851878.633250:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769617:8769617:1024:4294967295] 2060@kfi7 LPNI seq info [5404996:5404996:16:4294967295]
00000400:00000200:17.0:1773851878.633251:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:17.0:1773851878.633252:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.633254:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851878.633255:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:17.0:1773851878.633256:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.633257:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851878.633259:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.633261:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000001c1 Using peer 2060@kfi7(0x2000000000001c1)
00000800:00000200:17.0:1773851878.633266:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x2000000000001c1: rc=0
00000800:00000200:17.0:1773851878.633267:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000001c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851878.633269:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.633270:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000667bf0e7 refcount 6 to 2060@kfi7
00010000:00000001:17.0:1773851878.633271:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851878.633271:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.633272:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851878.633272:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009488938a x1858046412934720/t0(0) o400->lustre5-MDT0001-lwp-OST0001_UUID@2060@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba102-0'
00000100:00100000:17.0:1773851878.633275:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009488938a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:lustre5-MDT0001-lwp-OST0001_UUID+5:272703:x1858046412934720:12345-2060@kfi7:400:default-yuba102-0 Request processed in 58us (96us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851878.633277:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000001c1 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851878.633278:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2060@kfi7, seq: 2156373
00000100:00000040:17.0:1773851878.633278:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b036a95 : new rpc_count 0
00000400:00000200:19.0:1773851878.633279:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851878.633279:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:19.0:1773851878.633280:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000400:00000200:19.0:1773851878.633280:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003fab839b
00000100:00000001:17.0:1773851878.633280:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851878.633280:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000010:19.0:1773851878.633281:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003fab839b.
00000100:00000001:19.0:1773851878.633281:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:17.0:1773851878.633281:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000100:00000001:19.0:1773851878.633282:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:17.0:1773851878.633282:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097472cd0.
00000020:00000040:17.0:1773851878.633282:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000003b036a95 : new refcount 4
00000400:00000200:19.0:1773851878.633283:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:17.0:1773851878.633283:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0:1773851878.633284:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2000000000001c1 Transaction freed
00000800:00000200:29.0:1773851878.704065:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851878.704066:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851878.704067:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851878.704069:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851878.704071:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11923@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.704072:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11923@kfi7 : PUT - for me
00000400:00000200:29.0:1773851878.704073:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11923@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.704073:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048f1dabb nid 11923@kfi7 refs 1
00000400:00000200:29.0:1773851878.704074:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11923@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.704075:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048f1dabb nid 11923@kfi7 refs 2
00000400:00000200:29.0:1773851878.704076:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000048f1dabb nid 11923@kfi7 refs 3
00000400:00000200:29.0:1773851878.704077:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11858@kfi7 to cpt 0
00000400:00000200:29.0:1773851878.704077:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11858@kfi7 of length 224 into portal 12 MB=0x69b4b7373cc00
00000400:00000200:29.0:1773851878.704079:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11858@kfi7 of length 224/224 into md 0x77fe139dd [64] + 188584
00000800:00000200:29.0:1773851878.704080:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851878.704082:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.704083:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11923@kfi7: PUT: OK
00000100:00000001:29.0:1773851878.704083:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851878.704084:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851878.704086:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009223ebff.
00000100:00000040:29.0:1773851878.704087:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000009223ebff x1859598222085120 msgsize 224
00000100:00100000:29.0:1773851878.704088:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11858@kfi7 (source: 12345-11923@kfi7)
00000100:00000001:29.0:1773851878.704089:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851878.704090:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000048f1dabb nid 11923@kfi7 refs 2
00000800:00000200:29.0:1773851878.704092:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851878.704092:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851878.704093:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851878.704094:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851878.704094:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851878.704096:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851878.704097:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598222085120
00000020:00000001:28.0:1773851878.704098:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851878.704099:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79f60
00000020:00000001:28.0:1773851878.704100:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851878.704103:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000206da1ac refcount=5
00000020:00000001:28.0:1773851878.704104:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637048890776576 : -107024818775040 : ffff9ea957b1dc00)
00000020:00000001:28.0:1773851878.704105:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637048890776576 : -107024818775040 : ffff9ea957b1dc00)
00000100:00000001:28.0:1773851878.704106:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851878.704107:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851878.704108:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851878.704110:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851878.704111:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851878.704112:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851878.704113:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851878.704114:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851878.704115:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851878.704116:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851878.704117:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.704118:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851878.704120:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851878.704121:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851878.704121:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851878.704122:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851878.704123:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11858@kfi7, seq: 2055550
00000100:00000040:28.0:1773851878.704124:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000206da1ac : new rpc_count 1
00000100:00000001:30.0:1773851878.704125:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.704125:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136557439360 : -106937152112256 : ffff9ebdc108f980)
00000100:00000001:30.0:1773851878.704126:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851878.704127:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009223ebff x1859598222085120/t0(0) o400->c43e9202-1a3c-424b-8b95-198655f97ded@11858@kfi7:666/0 lens 224/0 e 0 to 0 dl 1773852026 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1238-0'
00000100:00000001:28.0:1773851878.704132:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851878.704133:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851878.704134:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009223ebff pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c43e9202-1a3c-424b-8b95-198655f97ded+5:39545:x1859598222085120:12345-11858@kfi7:400:default-tuolumne1238-0
00000100:00000200:28.0:1773851878.704136:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598222085120
00000020:00000001:28.0:1773851878.704137:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851878.704138:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851878.704139:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.704140:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851878.704141:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851878.704142:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851878.704143:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598222085120, found 0 last_xid 1859598222085119
00000020:00000001:28.0:1773851878.704145:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851878.704146:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851878.704146:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851878.704147:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.704148:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851878.704149:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851878.704150:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851878.704151:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f45ca2b5.
02000000:00000001:28.0:1773851878.704152:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.704153:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.704154:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851878.704155:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597574, transno 0, xid 1859598222085120
00010000:00000001:28.0:1773851878.704156:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851878.704157:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009223ebff x1859598222085120/t0(0) o400->c43e9202-1a3c-424b-8b95-198655f97ded@11858@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1238-0'
00010000:00000001:28.0:1773851878.704162:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851878.704162:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851878.704164:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=111 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851878.704166:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851878.704167:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000044b7848e refcount 3 to 11858@kfi7
00000100:00000001:28.0:1773851878.704169:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530570592 : -107154178981024 : ffff9e8b3939c360)
02000000:00000001:28.0:1773851878.704170:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851878.704171:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.704172:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851878.704173:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11923@kfi7
00000400:00000010:28.0:1773851878.704175:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ebafbfca.
00000100:00000200:28.0:1773851878.704176:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598222085120, offset 224
00000400:00000200:28.0:1773851878.704178:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11923@kfi7
00000400:00000200:28.0:1773851878.704179:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11923@kfi7 to cpt 7
00000400:00000200:28.0:1773851878.704181:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048f1dabb nid 11923@kfi7 refs 1
00000400:00000200:28.0:1773851878.704182:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000048f1dabb nid 11923@kfi7 refs 2
00000400:00000200:28.0:1773851878.704184:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000048f1dabb nid 11923@kfi7 refs 3
00000400:00000200:28.0:1773851878.704186:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11923@kfi7 local destination
00000400:00000200:28.0:1773851878.704188:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769618:8769618:1024:4294967295] 11923@kfi7 LPNI seq info [5056123:5056123:16:4294967295]
00000400:00000200:28.0:1773851878.704190:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000048f1dabb nid 11923@kfi7 refs 2
00000400:00000200:28.0:1773851878.704192:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11923@kfi7 to cpt 7
00000400:00000200:28.0:1773851878.704195:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11923@kfi7(11923@kfi7:11923@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851878.704197:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000048f1dabb nid 11923@kfi7 refs 3
00000800:00000200:28.0:1773851878.704199:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851878.704201:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851878.704205:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851878.704208:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000591 Using peer 11923@kfi7(0x100000000000591)
00000800:00000200:28.0:1773851878.704213:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x100000000000591: rc=0
00000800:00000200:28.0:1773851878.704216:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000591 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851878.704224:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851878.704225:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000044b7848e refcount 2 to 11858@kfi7
00010000:00000001:28.0:1773851878.704226:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851878.704227:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.704227:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851878.704228:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009223ebff x1859598222085120/t0(0) o400->c43e9202-1a3c-424b-8b95-198655f97ded@11858@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1238-0'
00000100:00100000:28.0:1773851878.704231:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009223ebff pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c43e9202-1a3c-424b-8b95-198655f97ded+5:39545:x1859598222085120:12345-11858@kfi7:400:default-tuolumne1238-0 Request processed in 98us (143us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851878.704233:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11858@kfi7, seq: 2055550
00000100:00000040:28.0:1773851878.704234:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000206da1ac : new rpc_count 0
00000100:00000001:28.0:1773851878.704235:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851878.704236:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851878.704236:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851878.704237:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851878.704238:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851878.704239:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000206da1ac : new refcount 4
00000100:00000001:28.0:1773851878.704240:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851878.704246:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000591 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851878.704248:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.704249:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11923@kfi7: PUT: OK
00000400:00000200:29.0:1773851878.704250:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ebafbfca
00000400:00000010:29.0:1773851878.704250:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ebafbfca.
00000100:00000001:29.0:1773851878.704251:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851878.704251:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851878.704252:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000048f1dabb nid 11923@kfi7 refs 2
00000800:00000200:29.0:1773851878.704253:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 11923@kfi7(00000000055dfa28):0x0 lsk 1426 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000591 Transaction freed
00000004:00000001:29.0:1773851878.729729:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:25.0:1773851878.729729:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851878.729730:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:25.0:1773851878.729730:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851878.729731:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d90c76df.
00000100:00000010:25.0:1773851878.729731:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003eab7519.
00000020:00000040:29.0:1773851878.729732:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000020:00000040:25.0:1773851878.729732:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000100:00000001:29.0:1773851878.729733:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851878.729733:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:25.0:1773851878.729733:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851878.729734:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851878.729734:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:29.0:1773851878.729735:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
02000000:00000001:25.0:1773851878.729735:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851878.729736:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000027c5b29c.
00000100:00000001:29.0:1773851878.729737:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851878.729737:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851878.729738:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851878.729738:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851878.729738:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:29.0:1773851878.729739:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d90c76df] to pc [ptlrpcd_07_01+1]  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851878.729739:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851878.729740:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003eab7519] to pc [ptlrpcd_06_02+2]  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851878.729743:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851878.729744:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:29.0:1773851878.729744:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000007e804b7.
00000100:00000001:28.0:1773851878.729744:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:25.0:1773851878.729744:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851878.729745:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851878.729745:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851878.729745:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637083194991616 : -106990514560000 : ffff9eb15462a400)
00000100:00000001:28.0:1773851878.729745:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729745:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:25.0:1773851878.729745:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000009a939c.
00000100:00000040:30.0:1773851878.729746:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851878.729746:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:27.0:1773851878.729746:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851878.729746:0:41086:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:26.0:1773851878.729746:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:25.0:1773851878.729746:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637110744560640 : -106962964990976 : ffff9eb7be77b400)
00080000:00000001:29.0:1773851878.729747:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851878.729747:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851878.729747:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851878.729747:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00001000:29.0:1773851878.729748:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000004:00000010:29.0:1773851878.729748:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000056a30c13.
00080000:00000001:25.0:1773851878.729748:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729749:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:29.0:1773851878.729749:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614153183024705ns, next at 614154183023643ns, rc = 0
00000004:00001000:25.0:1773851878.729749:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000100:00000001:30.0:1773851878.729750:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851878.729750:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:27.0:1773851878.729750:0:41086:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:25.0:1773851878.729750:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ff7ef01c.
02000000:00000001:30.0:1773851878.729751:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:29.0:1773851878.729751:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729751:0:41086:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:25.0:1773851878.729751:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614153183026248ns, next at 614154183025065ns, rc = 0
02000000:00000001:30.0:1773851878.729752:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851878.729752:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851878.729752:0:41086:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:27.0:1773851878.729752:0:41086:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851878.729752:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:25.0:1773851878.729752:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851878.729753:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d90c76df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051932864:2090@kfi7:13:default-yuba2-0
00000100:00100000:27.0:1773851878.729753:0:41086:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003eab7519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_02:lustre5-MDT0001-mdtlov_UUID:41086:1859433051932928:2068@kfi7:13:default-yuba2-0
00000004:00000001:25.0:1773851878.729753:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729754:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851878.729755:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851878.729755:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729755:0:41086:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:27.0:1773851878.729755:0:41086:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851878.729756:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:27.0:1773851878.729756:0:41086:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851878.729757:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bbafe549.
02000000:00000001:27.0:1773851878.729757:0:41086:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:27.0:1773851878.729757:0:41086:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f99dfdf6.
02000000:00000001:30.0:1773851878.729758:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851878.729758:0:41086:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851878.729759:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:30.0:1773851878.729760:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000200:27.0:1773851878.729760:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000010:27.0:1773851878.729760:0:41086:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000052625ffc.
00000400:00000010:30.0:1773851878.729761:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000400:00000010:27.0:1773851878.729761:0:41086:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e42f1f7.
00000100:00000200:30.0:1773851878.729762:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932864, portal 4
00000100:00000001:30.0:1773851878.729763:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:27.0:1773851878.729763:0:41086:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932928, portal 4
00000100:00000001:30.0:1773851878.729764:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636955373912960 : -107118335638656 : ffff9e9391a7c380)
00000100:00000001:27.0:1773851878.729764:0:41086:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:27.0:1773851878.729764:0:41086:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637027291352192 : -107046418199424 : ffff9ea45044cc80)
00000100:00000040:30.0:1773851878.729765:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:27.0:1773851878.729766:0:41086:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.729768:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851878.729769:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:30.0:1773851878.729769:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004cd96fcd.
00000100:00000001:27.0:1773851878.729769:0:41086:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:30.0:1773851878.729770:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932864, offset 0
00000100:00000040:27.0:1773851878.729770:0:41086:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:27.0:1773851878.729770:0:41086:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000705ba323.
00000400:00000200:30.0:1773851878.729771:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000100:00000200:27.0:1773851878.729771:0:41086:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932928, offset 0
00000400:00000200:30.0:1773851878.729772:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851878.729772:0:41086:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:30.0:1773851878.729773:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:27.0:1773851878.729773:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:30.0:1773851878.729774:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851878.729774:0:41086:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:30.0:1773851878.729775:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:27.0:1773851878.729775:0:41086:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851878.729776:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000200:27.0:1773851878.729777:0:41086:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851878.729778:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769616, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769618, p:4294967295, g:4294967295, h:1000]
00000400:00000200:27.0:1773851878.729778:0:41086:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:30.0:1773851878.729779:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851878.729780:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:27.0:1773851878.729780:0:41086:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769616, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769618, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851878.729781:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:27.0:1773851878.729782:0:41086:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:27.0:1773851878.729782:0:41086:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851878.729783:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769619:8769619:1024:4294967295] 2090@kfi7 LPNI seq info [5404252:5404252:16:4294967295]
00000400:00000200:27.0:1773851878.729783:0:41086:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:30.0:1773851878.729784:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:30.0:1773851878.729785:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851878.729785:0:41086:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769620:8769620:1024:4294967295] 2068@kfi7 LPNI seq info [5403700:5403700:16:4294967295]
00000400:00000200:27.0:1773851878.729786:0:41086:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:27.0:1773851878.729787:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:30.0:1773851878.729788:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851878.729789:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:27.0:1773851878.729790:0:41086:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000800:00000200:30.0:1773851878.729791:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:27.0:1773851878.729791:0:41086:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:27.0:1773851878.729792:0:41086:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:30.0:1773851878.729793:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851878.729794:0:41086:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851878.729795:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851878.729796:0:41086:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851878.729798:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000800:00000200:27.0:1773851878.729799:0:41086:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Using peer 2068@kfi7(0x62f)
00000800:00000200:27.0:1773851878.729802:0:41086:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x62f: rc=0
00000800:00000200:30.0:1773851878.729803:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000030498a96: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:30.0:1773851878.729804:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:27.0:1773851878.729804:0:41086:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851878.729806:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729806:0:41086:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729806:0:41086:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851878.729807:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:27.0:1773851878.729807:0:41086:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729808:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729808:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729808:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729808:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.729809:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.729810:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851878.729810:0:41086:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851878.729810:0:41086:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851878.729811:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851878.729811:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851878.729811:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851878.729811:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851878.729811:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729812:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851878.729812:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729812:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729813:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851878.729813:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851878.729815:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851878.729815:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851878.729816:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:25.0:1773851878.729816:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.729817:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004cd96fcd
00000400:00000010:29.0:1773851878.729817:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004cd96fcd.
00000100:00000001:29.0:1773851878.729818:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:25.0:1773851878.729818:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000100:00000200:29.0:1773851878.729819:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851878.729819:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000705ba323
00000100:00000001:29.0:1773851878.729821:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:25.0:1773851878.729821:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000705ba323.
00000100:00000040:29.0:1773851878.729822:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851878.729822:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:25.0:1773851878.729823:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851878.729825:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851878.729825:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:25.0:1773851878.729825:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851878.729826:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000040:25.0:1773851878.729826:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851878.729828:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000100:00000001:25.0:1773851878.729828:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851878.729829:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851878.729830:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:25.0:1773851878.729831:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Transaction freed
00000800:00000200:1.0:1773851878.729843:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851878.729843:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851878.729845:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851878.729847:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851878.729849:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851878.729850:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000800:00000200:21.0:1773851878.729851:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:1.0:1773851878.729851:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851878.729852:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:1.0:1773851878.729852:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:1.0:1773851878.729853:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851878.729854:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851878.729854:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851878.729855:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:21.0:1773851878.729856:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851878.729856:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851878.729857:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851878.729857:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b48c0
00000400:00000200:21.0:1773851878.729859:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:1.0:1773851878.729859:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:21.0:1773851878.729860:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851878.729860:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71dc01 [1] + 224
00000400:00000200:21.0:1773851878.729861:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:21.0:1773851878.729862:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.729863:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:1.0:1773851878.729863:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851878.729864:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:21.0:1773851878.729865:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851878.729865:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851878.729866:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4900
00000400:00000200:1.0:1773851878.729866:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:21.0:1773851878.729867:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851878.729868:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d13d5 [1] + 224
00000100:00000001:1.0:1773851878.729868:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851878.729869:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:1.0:1773851878.729869:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851878.729871:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851878.729872:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000100:00000040:1.0:1773851878.729872:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851878.729873:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851878.729874:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851878.729876:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:21.0:1773851878.729877:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851878.729877:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851878.729878:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851878.729878:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:1.0:1773851878.729878:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851878.729879:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851878.729880:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:30.0:1773851878.729880:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:21.0:1773851878.729880:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:30.0:1773851878.729881:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000200:21.0:1773851878.729881:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000010:30.0:1773851878.729882:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:30.0:1773851878.729882:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:27.0:1773851878.729882:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851878.729883:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:27.0:1773851878.729883:0:41086:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:21.0:1773851878.729883:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:30.0:1773851878.729884:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:27.0:1773851878.729884:0:41086:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:27.0:1773851878.729885:0:41086:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000052625ffc.
00000400:00000200:27.0:1773851878.729885:0:41086:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e42f1f7
00000100:00000200:30.0:1773851878.729886:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:27.0:1773851878.729886:0:41086:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e42f1f7.
00000100:00000001:27.0:1773851878.729887:0:41086:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:27.0:1773851878.729887:0:41086:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.729889:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851878.729890:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.729890:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:27.0:1773851878.729890:0:41086:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851878.729891:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851878.729891:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851878.729892:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851878.729893:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851878.729893:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=111 v=66 (66 66 66 66)
00000100:00000001:27.0:1773851878.729893:0:41086:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:27.0:1773851878.729893:0:41086:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:30.0:1773851878.729894:0:41089:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=111 v=66 (1 1 1 1)
00000100:00000001:27.0:1773851878.729894:0:41086:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:27.0:1773851878.729894:0:41086:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851878.729895:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:27.0:1773851878.729895:0:41086:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851878.729895:0:41086:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729896:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851878.729896:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:27.0:1773851878.729896:0:41086:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851878.729897:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851878.729897:0:41086:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=111 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851878.729898:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851878.729898:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00001000:27.0:1773851878.729898:0:41086:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=111 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851878.729899:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851878.729899:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729899:0:41086:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:27.0:1773851878.729899:0:41086:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851878.729900:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:27.0:1773851878.729900:0:41086:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:27.0:1773851878.729901:0:41086:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729901:0:41086:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:27.0:1773851878.729902:0:41086:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:27.0:1773851878.729902:0:41086:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851878.729903:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:27.0:1773851878.729903:0:41086:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729904:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851878.729904:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:27.0:1773851878.729904:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:30.0:1773851878.729905:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851878.729905:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851878.729906:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351388964864 avail=351386286080 avail_mb=1372602680 hwm_mb=3131103 files=372019060 ffree=343153286 state=0: rc = 0
00000100:00000001:27.0:1773851878.729906:0:41086:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:27.0:1773851878.729907:0:41086:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:27.0:1773851878.729907:0:41086:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:30.0:1773851878.729908:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351388964864 free, 351386286080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019060 files, 343153286 free files
00000004:00000001:27.0:1773851878.729908:0:41086:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:27.0:1773851878.729909:0:41086:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000001:30.0:1773851878.729910:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:27.0:1773851878.729910:0:41086:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350958986240 avail=350956917760 avail_mb=1370925460 hwm_mb=3131103 files=371563970 ffree=342733385 state=0: rc = 0
00000100:00000040:30.0:1773851878.729911:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:27.0:1773851878.729912:0:41086:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350958986240 free, 350956917760 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371563970 files, 342733385 free files
00000004:00000001:27.0:1773851878.729914:0:41086:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851878.729915:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:30.0:1773851878.729916:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d90c76df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051932864:2090@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851878.729918:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:27.0:1773851878.729918:0:41086:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003eab7519 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_02:lustre5-MDT0001-mdtlov_UUID:41086:1859433051932928:2068@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851878.729919:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:27.0:1773851878.729919:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851878.729920:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d90c76df x1859433051932864/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:27.0:1773851878.729920:0:41086:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:27.0:1773851878.729921:0:41086:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003eab7519 x1859433051932928/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852031 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851878.729922:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851878.729923:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851878.729923:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bbafe549.
00000100:00000001:27.0:1773851878.729923:0:41086:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:27.0:1773851878.729924:0:41086:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:27.0:1773851878.729924:0:41086:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f99dfdf6.
02000000:00000001:30.0:1773851878.729925:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851878.729925:0:41089:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:27.0:1773851878.729925:0:41086:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000040:30.0:1773851878.729926:0:41089:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000001:30.0:1773851878.729926:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:27.0:1773851878.729926:0:41086:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:27.0:1773851878.729926:0:41086:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
02000000:00000010:30.0:1773851878.729927:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
00000020:00000001:27.0:1773851878.729927:0:41086:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:30.0:1773851878.729928:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851878.729928:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:27.0:1773851878.729928:0:41086:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000027c5b29c.
02000000:00000001:27.0:1773851878.729928:0:41086:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000010:30.0:1773851878.729929:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d90c76df.
02000000:00000001:27.0:1773851878.729929:0:41086:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:27.0:1773851878.729929:0:41086:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003eab7519.
00000100:00000001:30.0:1773851878.729930:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851878.729930:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851878.729930:0:41086:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851878.729931:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.729931:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851878.729931:0:41086:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851878.729931:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851878.729932:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.729932:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851878.729932:0:41086:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851878.729933:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729933:0:41086:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.729933:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851878.729934:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851878.740846:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851878.740846:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851878.740847:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851878.740850:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851878.740851:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9776@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.740853:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9776@kfi7 : PUT - for me
00000400:00000200:25.0:1773851878.740853:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9776@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.740854:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000999dd828 nid 9776@kfi7 refs 1
00000400:00000200:25.0:1773851878.740855:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9776@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.740856:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000999dd828 nid 9776@kfi7 refs 2
00000400:00000200:25.0:1773851878.740857:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000999dd828 nid 9776@kfi7 refs 3
00000400:00000200:25.0:1773851878.740857:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9777@kfi7 to cpt 1
00000400:00000200:25.0:1773851878.740858:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9777@kfi7 of length 224 into portal 12 MB=0x699e1cc13c700
00000400:00000200:25.0:1773851878.740860:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9777@kfi7 of length 224/224 into md 0x16159c9699 [64] + 24568
00000800:00000200:25.0:1773851878.740861:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851878.740863:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851878.740864:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9776@kfi7: PUT: OK
00000100:00000001:25.0:1773851878.740865:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851878.740866:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851878.740866:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003eab7519.
00000100:00000040:25.0:1773851878.740867:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000003eab7519 x1858044930803456 msgsize 224
00000100:00100000:25.0:1773851878.740868:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9777@kfi7 (source: 12345-9776@kfi7)
00000100:00000001:25.0:1773851878.740869:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851878.740870:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000999dd828 nid 9776@kfi7 refs 2
00000100:00000001:27.0:1773851878.740871:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851878.740871:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851878.740872:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851878.740872:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851878.740873:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851878.740874:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851878.740874:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044930803456
00000020:00000001:27.0:1773851878.740875:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851878.740876:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91707
00000020:00000001:27.0:1773851878.740876:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851878.740877:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e142eb63 refcount=6
00000020:00000001:27.0:1773851878.740878:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241494528 : -107152468057088 : ffff9e8b9f346400)
00000020:00000001:27.0:1773851878.740879:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241494528 : -107152468057088 : ffff9e8b9f346400)
00000100:00000001:27.0:1773851878.740880:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851878.740881:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851878.740881:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851878.740882:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851878.740883:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851878.740884:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851878.740884:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851878.740885:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851878.740886:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851878.740886:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851878.740887:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.740888:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851878.740889:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851878.740889:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851878.740889:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851878.740890:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9777@kfi7, seq: 2025137
00000100:00000001:26.0:1773851878.740890:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851878.740891:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e142eb63 : new rpc_count 1
00000100:00000001:26.0:1773851878.740891:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.740892:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637027291352192 : -107046418199424 : ffff9ea45044cc80)
00000100:00000001:26.0:1773851878.740892:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851878.740893:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003eab7519 x1858044930803456/t0(0) o400->37eb8836-1dc2-4b49-a220-77d37db09836@9777@kfi7:128/0 lens 224/0 e 0 to 0 dl 1773852243 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1101-0'
00000100:00000001:27.0:1773851878.740895:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851878.740896:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851878.740896:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003eab7519 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:37eb8836-1dc2-4b49-a220-77d37db09836+6:39863:x1858044930803456:12345-9777@kfi7:400:default-tuolumne1101-0
00000100:00000200:27.0:1773851878.740898:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044930803456
00000020:00000001:27.0:1773851878.740901:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851878.740901:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851878.740902:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.740903:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851878.740903:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851878.740904:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851878.740904:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044930803456, found 0 last_xid 1858044930803455
00000020:00000001:27.0:1773851878.740905:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851878.740906:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851878.740906:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851878.740907:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.740907:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851878.740908:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851878.740909:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851878.740909:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004120800c.
02000000:00000001:27.0:1773851878.740910:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.740910:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.740911:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851878.740912:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105408272, transno 0, xid 1858044930803456
00010000:00000001:27.0:1773851878.740912:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851878.740913:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003eab7519 x1858044930803456/t0(0) o400->37eb8836-1dc2-4b49-a220-77d37db09836@9777@kfi7:128/0 lens 224/224 e 0 to 0 dl 1773852243 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1101-0'
00010000:00000001:27.0:1773851878.740916:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851878.740916:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851878.740917:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=111 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851878.740918:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851878.740918:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008835e562 refcount 3 to 9777@kfi7
00000100:00000001:27.0:1773851878.740919:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413632 : -107145304137984 : ffff9e8d4a351f00)
02000000:00000001:27.0:1773851878.740920:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851878.740921:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.740921:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851878.740922:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9776@kfi7
00000400:00000010:27.0:1773851878.740922:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e42f1f7.
00000100:00000200:27.0:1773851878.740923:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044930803456, offset 224
00000400:00000200:27.0:1773851878.740924:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9776@kfi7
00000400:00000200:27.0:1773851878.740926:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9776@kfi7 to cpt 6
00000400:00000200:27.0:1773851878.740927:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000999dd828 nid 9776@kfi7 refs 1
00000400:00000200:27.0:1773851878.740928:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000999dd828 nid 9776@kfi7 refs 2
00000400:00000200:27.0:1773851878.740929:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000999dd828 nid 9776@kfi7 refs 3
00000400:00000200:27.0:1773851878.740930:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9776@kfi7 local destination
00000400:00000200:27.0:1773851878.740931:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769621:8769621:1024:4294967295] 9776@kfi7 LPNI seq info [21329249:21329249:16:4294967295]
00000400:00000200:27.0:1773851878.740932:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000999dd828 nid 9776@kfi7 refs 2
00000400:00000200:27.0:1773851878.740933:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9776@kfi7 to cpt 6
00000400:00000200:27.0:1773851878.740935:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9776@kfi7(9776@kfi7:9776@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851878.740936:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000999dd828 nid 9776@kfi7 refs 3
00000800:00000200:27.0:1773851878.740937:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851878.740938:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851878.740940:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851878.740942:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd27 Using peer 9776@kfi7(0xd27)
00000800:00000200:27.0:1773851878.740945:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0xd27: rc=0
00000800:00000200:27.0:1773851878.740946:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd27 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851878.740948:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851878.740949:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008835e562 refcount 2 to 9777@kfi7
00010000:00000001:27.0:1773851878.740950:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851878.740950:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.740951:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851878.740951:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003eab7519 x1858044930803456/t0(0) o400->37eb8836-1dc2-4b49-a220-77d37db09836@9777@kfi7:128/0 lens 224/224 e 0 to 0 dl 1773852243 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1101-0'
00000100:00100000:27.0:1773851878.740954:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003eab7519 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:37eb8836-1dc2-4b49-a220-77d37db09836+6:39863:x1858044930803456:12345-9777@kfi7:400:default-tuolumne1101-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851878.740956:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9777@kfi7, seq: 2025137
00000100:00000040:27.0:1773851878.740957:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e142eb63 : new rpc_count 0
00000100:00000001:27.0:1773851878.740958:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851878.740958:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851878.740958:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd27 TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851878.740959:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851878.740959:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851878.740959:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851878.740960:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000400:00000200:25.0:1773851878.740960:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9776@kfi7: PUT: OK
00000020:00000040:27.0:1773851878.740961:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000e142eb63 : new refcount 5
00000400:00000200:25.0:1773851878.740961:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e42f1f7
00000400:00000010:25.0:1773851878.740961:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e42f1f7.
00000100:00000001:27.0:1773851878.740962:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851878.740962:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851878.740962:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851878.740963:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000999dd828 nid 9776@kfi7 refs 2
00000800:00000200:25.0:1773851878.740964:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 9776@kfi7(0000000004fafdc2):0x0 lsk 3368 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd27 Transaction freed
00000800:00000200:25.0:1773851878.763329:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851878.763330:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851878.763332:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851878.763336:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851878.763339:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26306@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.763341:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26306@kfi7 : PUT - for me
00000400:00000200:25.0:1773851878.763343:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26306@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.763344:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 1
00000400:00000200:25.0:1773851878.763346:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26306@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.763347:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 2
00000400:00000200:25.0:1773851878.763348:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 3
00000400:00000200:25.0:1773851878.763351:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26114@kfi7 to cpt 3
00000400:00000200:25.0:1773851878.763352:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26114@kfi7 of length 456 into portal 12 MB=0x69b4bddcf14c0
00000400:00000200:25.0:1773851878.763354:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26114@kfi7 of length 456/456 into md 0x16159c9699 [64] + 24792
00000800:00000200:25.0:1773851878.763357:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851878.763360:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851878.763362:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26306@kfi7: PUT: OK
00000100:00000001:25.0:1773851878.763363:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851878.763364:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851878.763365:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000062ccc933.
00000100:00000040:25.0:1773851878.763366:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000062ccc933 x1859600006452416 msgsize 456
00000100:00100000:25.0:1773851878.763369:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26114@kfi7 (source: 12345-26306@kfi7)
00000100:00000001:25.0:1773851878.763370:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851878.763372:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851878.763372:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 2
02000000:00000001:27.0:1773851878.763373:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851878.763373:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851878.763373:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851878.763374:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851878.763374:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00100000:27.0:1773851878.763375:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600006452416
00000020:00000001:27.0:1773851878.763375:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851878.763376:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38930723
00000020:00000001:27.0:1773851878.763377:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851878.763378:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008a20ce2a refcount=5
00000020:00000001:27.0:1773851878.763379:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126896303104 : -106946813248512 : ffff9ebb812fbc00)
00000020:00000001:27.0:1773851878.763379:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126896303104 : -106946813248512 : ffff9ebb812fbc00)
00000100:00000001:27.0:1773851878.763380:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851878.763381:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851878.763381:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851878.763382:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851878.763383:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851878.763384:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851878.763384:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851878.763385:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.763386:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.763387:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851878.763388:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851878.763388:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851878.763390:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26114@kfi7, seq: 1451911034
00000100:00000040:27.0:1773851878.763390:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008a20ce2a : new rpc_count 1
00000100:00000001:26.0:1773851878.763390:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851878.763391:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106092995840 : -106967616555776 : ffff9eb6a9367500)
00000100:00000001:26.0:1773851878.763391:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851878.763392:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000062ccc933 x1859600006452416/t0(0) o17->a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8@26114@kfi7:128/0 lens 456/0 e 0 to 0 dl 1773852243 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2135-0'
00000100:00000001:26.0:1773851878.763392:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851878.763393:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.763395:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851878.763396:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851878.763397:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062ccc933 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8+5:39507:x1859600006452416:12345-26114@kfi7:17:default-tuolumne2135-0
00000100:00000200:27.0:1773851878.763398:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600006452416
00000020:00000001:27.0:1773851878.763399:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851878.763399:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851878.763400:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.763401:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851878.763401:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:27.0:1773851878.763402:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851878.763402:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600006452416, found 0 last_xid 1859600006452415
00000020:00000001:27.0:1773851878.763403:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851878.763404:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851878.763404:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851878.763405:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851878.763405:0:41182:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:27.0:1773851878.763406:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851878.763407:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851878.763408:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000f99dfdf6.
02000000:00000001:27.0:1773851878.763408:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.763409:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.763410:0:41182:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:27.0:1773851878.763410:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:27.0:1773851878.763411:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:27.0:1773851878.763413:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.763414:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:27.0:1773851878.763415:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8/000000008a20ce2a free: 126633370845184 avail: 126633368748032
00000020:00000001:27.0:1773851878.763416:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:27.0:1773851878.763417:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8/000000008a20ce2a avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:27.0:1773851878.763420:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:27.0:1773851878.763421:0:41182:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:27.0:1773851878.763422:0:41182:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8/000000008a20ce2a reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:27.0:1773851878.763423:0:41182:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:27.0:1773851878.763424:0:41182:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:27.0:1773851878.763424:0:41182:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851878.763425:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013637240, transno 0, xid 1859600006452416
00010000:00000001:27.0:1773851878.763426:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851878.763427:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000062ccc933 x1859600006452416/t0(0) o17->a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8@26114@kfi7:128/0 lens 456/432 e 0 to 0 dl 1773852243 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2135-0'
00010000:00000001:27.0:1773851878.763430:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851878.763430:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851878.763431:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=111 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851878.763432:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851878.763433:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005074db3a refcount 3 to 26114@kfi7
00000100:00000001:27.0:1773851878.763434:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152608 : -107139310399008 : ffff9e8eaf7651e0)
02000000:00000001:27.0:1773851878.763435:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851878.763435:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.763436:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851878.763436:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26306@kfi7
00000400:00000010:27.0:1773851878.763437:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000492f3438.
00000100:00000200:27.0:1773851878.763438:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859600006452416, offset 224
00000400:00000200:27.0:1773851878.763439:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26306@kfi7
00000400:00000200:27.0:1773851878.763440:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26306@kfi7 to cpt 6
00000400:00000200:27.0:1773851878.763441:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 1
00000400:00000200:27.0:1773851878.763442:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 2
00000400:00000200:27.0:1773851878.763443:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 3
00000400:00000200:27.0:1773851878.763444:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26306@kfi7 local destination
00000400:00000200:27.0:1773851878.763445:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769622:8769622:1024:4294967295] 26306@kfi7 LPNI seq info [12745640:12745640:16:4294967295]
00000400:00000200:27.0:1773851878.763446:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 2
00000400:00000200:27.0:1773851878.763447:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26306@kfi7 to cpt 6
00000400:00000200:27.0:1773851878.763450:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26306@kfi7(26306@kfi7:26306@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851878.763451:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 3
00000800:00000200:27.0:1773851878.763452:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851878.763453:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:27.0:1773851878.763455:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851878.763457:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb24 Using peer 26306@kfi7(0xb24)
00000800:00000200:27.0:1773851878.763460:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000013625cac: Posted send of 532 bytes to peer 0xb24: rc=0
00000800:00000200:27.0:1773851878.763461:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb24 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851878.763463:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851878.763463:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005074db3a refcount 2 to 26114@kfi7
00010000:00000001:27.0:1773851878.763464:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851878.763464:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.763465:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851878.763466:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000062ccc933 x1859600006452416/t0(0) o17->a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8@26114@kfi7:128/0 lens 456/432 e 0 to 0 dl 1773852243 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2135-0'
00000100:00100000:27.0:1773851878.763468:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062ccc933 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:a9039ed5-828d-4982-a2b2-b5a0f7d1ebb8+5:39507:x1859600006452416:12345-26114@kfi7:17:default-tuolumne2135-0 Request processed in 72us (101us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851878.763471:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26114@kfi7, seq: 1451911034
00000100:00000040:27.0:1773851878.763472:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008a20ce2a : new rpc_count 0
00000100:00000001:27.0:1773851878.763472:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851878.763473:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851878.763473:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851878.763474:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851878.763474:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000800:00000200:25.0:1773851878.763474:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb24 TN_EVENT_TX_OK event status 0
00000020:00000040:27.0:1773851878.763475:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000008a20ce2a : new refcount 4
00000100:00000001:27.0:1773851878.763476:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851878.763477:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851878.763478:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26306@kfi7: PUT: OK
00000400:00000200:25.0:1773851878.763479:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000492f3438
00000400:00000010:25.0:1773851878.763480:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000492f3438.
00000100:00000001:25.0:1773851878.763481:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851878.763482:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851878.763483:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ed7a8a8 nid 26306@kfi7 refs 2
00000800:00000200:25.0:1773851878.763485:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 26306@kfi7(0000000053825373):0x0 lsk 2853 rsk 12 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb24 Transaction freed
00000800:00000200:5.0:1773851878.820273:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851878.820275:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851878.820278:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851878.820281:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851878.820284:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23443@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.820286:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23443@kfi7 : PUT - for me
00000400:00000200:5.0:1773851878.820288:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23443@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.820289:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001c5ca9e nid 23443@kfi7 refs 1
00000400:00000200:5.0:1773851878.820290:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23443@kfi7 to cpt 1
00000400:00000200:5.0:1773851878.820291:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001c5ca9e nid 23443@kfi7 refs 2
00000400:00000200:5.0:1773851878.820293:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000001c5ca9e nid 23443@kfi7 refs 3
00000400:00000200:5.0:1773851878.820294:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23442@kfi7 to cpt 6
00000400:00000200:5.0:1773851878.820296:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23442@kfi7 of length 224 into portal 12 MB=0x69b095c69f200
00000400:00000200:5.0:1773851878.820298:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23442@kfi7 of length 224/224 into md 0x793926dc5 [64] + 151192
00000800:00000200:5.0:1773851878.820301:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851878.820304:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851878.820305:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23443@kfi7: PUT: OK
00000100:00000001:5.0:1773851878.820307:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851878.820307:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851878.820309:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000072253d59.
00000100:00000040:5.0:1773851878.820310:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000072253d59 x1859314367721984 msgsize 224
00000100:00100000:5.0:1773851878.820312:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23442@kfi7 (source: 12345-23443@kfi7)
00000100:00000001:5.0:1773851878.820314:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851878.820315:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000001c5ca9e nid 23443@kfi7 refs 2
00000100:00000001:7.0:1773851878.820317:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851878.820318:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851878.820318:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851878.820319:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851878.820319:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851878.820321:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851878.820322:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314367721984
00000020:00000001:7.0:1773851878.820323:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851878.820324:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92761
00000020:00000001:7.0:1773851878.820325:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851878.820328:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f980195 refcount=6
00000020:00000001:7.0:1773851878.820329:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631510016 : -107123078041600 : ffff9e9276fc7000)
00000020:00000001:7.0:1773851878.820331:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631510016 : -107123078041600 : ffff9e9276fc7000)
00000100:00000001:7.0:1773851878.820333:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851878.820334:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851878.820335:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004b94ae4b.
00000020:00000010:7.0:1773851878.820337:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851878.820339:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000482fd989.
00000100:00000001:7.0:1773851878.820341:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851878.820341:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851878.820343:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851878.820345:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851878.820346:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851878.820347:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851878.820348:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851878.820350:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851878.820351:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851878.820351:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851878.820351:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851878.820352:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23442@kfi7, seq: 2001946
00000100:00000040:4.0:1773851878.820353:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f980195 : new rpc_count 1
00000100:00000001:7.0:1773851878.820354:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.820354:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637118484826112 : -106955224725504 : ffff9eb98bd2c800)
00000100:00000001:7.0:1773851878.820355:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851878.820355:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000072253d59 x1859314367721984/t0(0) o400->26665082-132a-431c-a10c-8166fc07d7a1@23442@kfi7:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1958-0'
00000100:00000001:4.0:1773851878.820358:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851878.820358:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851878.820360:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000072253d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:26665082-132a-431c-a10c-8166fc07d7a1+6:39584:x1859314367721984:12345-23442@kfi7:400:default-tuolumne1958-0
00000100:00000200:4.0:1773851878.820361:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314367721984
00000020:00000001:4.0:1773851878.820362:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851878.820362:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851878.820363:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.820364:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851878.820364:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851878.820365:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851878.820366:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314367721984, found 0 last_xid 1859314367721983
00000020:00000001:4.0:1773851878.820367:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851878.820368:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851878.820368:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851878.820369:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.820370:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851878.820370:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851878.820371:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851878.820372:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000590a9782.
02000000:00000001:4.0:1773851878.820373:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.820373:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.820374:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851878.820375:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044150548, transno 0, xid 1859314367721984
00010000:00000001:4.0:1773851878.820376:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851878.820377:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000072253d59 x1859314367721984/t0(0) o400->26665082-132a-431c-a10c-8166fc07d7a1@23442@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1958-0'
00010000:00000001:4.0:1773851878.820379:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851878.820380:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851878.820381:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=110 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851878.820382:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851878.820383:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005371e219 refcount 3 to 23442@kfi7
00000100:00000001:4.0:1773851878.820384:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420128 : -107156724131488 : ffff9e8aa185d960)
02000000:00000001:4.0:1773851878.820385:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851878.820385:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851878.820386:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851878.820387:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23443@kfi7
00000400:00000010:4.0:1773851878.820388:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000615c4c0e.
00000100:00000200:4.0:1773851878.820389:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314367721984, offset 224
00000400:00000200:4.0:1773851878.820390:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23443@kfi7
00000400:00000200:4.0:1773851878.820391:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23443@kfi7 to cpt 1
00000400:00000200:4.0:1773851878.820392:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001c5ca9e nid 23443@kfi7 refs 1
00000400:00000200:4.0:1773851878.820393:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000001c5ca9e nid 23443@kfi7 refs 2
00000400:00000200:4.0:1773851878.820395:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000001c5ca9e nid 23443@kfi7 refs 3
00000400:00000200:4.0:1773851878.820396:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23443@kfi7 local destination
00000400:00000200:4.0:1773851878.820397:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769623:8769623:1024:4294967295] 23443@kfi7 LPNI seq info [455517:455517:16:4294967295]
00000400:00000200:4.0:1773851878.820399:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000001c5ca9e nid 23443@kfi7 refs 2
00000400:00000200:4.0:1773851878.820399:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23443@kfi7 to cpt 1
00000400:00000200:4.0:1773851878.820401:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23443@kfi7(23443@kfi7:23443@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851878.820402:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000001c5ca9e nid 23443@kfi7 refs 3
00000800:00000200:4.0:1773851878.820404:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851878.820405:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851878.820407:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851878.820409:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21 Using peer 23443@kfi7(0x21)
00000800:00000200:4.0:1773851878.820412:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x21: rc=0
00000800:00000200:4.0:1773851878.820414:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851878.820417:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851878.820418:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005371e219 refcount 2 to 23442@kfi7
00010000:00000001:4.0:1773851878.820418:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851878.820419:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851878.820420:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851878.820420:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000072253d59 x1859314367721984/t0(0) o400->26665082-132a-431c-a10c-8166fc07d7a1@23442@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1958-0'
00000100:00100000:4.0:1773851878.820425:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000072253d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:26665082-132a-431c-a10c-8166fc07d7a1+6:39584:x1859314367721984:12345-23442@kfi7:400:default-tuolumne1958-0 Request processed in 66us (114us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851878.820428:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23442@kfi7, seq: 2001946
00000100:00000040:4.0:1773851878.820428:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f980195 : new rpc_count 0
00000100:00000001:4.0:1773851878.820429:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851878.820430:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851878.820430:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:4.0:1773851878.820431:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000482fd989.
00000020:00000010:4.0:1773851878.820433:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004b94ae4b.
00000020:00000040:4.0:1773851878.820433:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000003f980195 : new refcount 5
00000100:00000001:4.0:1773851878.820434:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851878.820441:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851878.820444:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851878.820446:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23443@kfi7: PUT: OK
00000400:00000200:5.0:1773851878.820447:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000615c4c0e
00000400:00000010:5.0:1773851878.820449:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000615c4c0e.
00000100:00000001:5.0:1773851878.820450:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851878.820451:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851878.820452:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000001c5ca9e nid 23443@kfi7 refs 2
00000800:00000200:5.0:1773851878.820455:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 23443@kfi7(000000002747db50):0x0 lsk 34 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21 Transaction freed
00000800:00000200:18.0:1773851878.831915:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.831915:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851878.831917:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.831917:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851878.831919:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.831919:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851878.831922:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851878.831922:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8864@kfi7(00000000f6036062):0x288 version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851878.831925:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8864@kfi7 to cpt 4
00000800:00000200:17.0:1773851878.831925:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 Using peer 8864@kfi7(0x288)
00000400:00000200:18.0:1773851878.831927:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8864@kfi7 : PUT - for me
00000400:00000200:17.0:1773851878.831928:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8864@kfi7 to cpt 4
00000400:00000200:18.0:1773851878.831929:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8864@kfi7 to cpt 4
00000400:00000200:18.0:1773851878.831931:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d01f434 nid 8864@kfi7 refs 1
00000800:00000200:17.0:1773851878.831931:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 38 bytes to peer 0x288: rc=0
00000400:00000200:18.0:1773851878.831933:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8864@kfi7 to cpt 4
00000800:00000200:17.0:1773851878.831933:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851878.831934:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d01f434 nid 8864@kfi7 refs 2
00000400:00000200:18.0:1773851878.831935:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002d01f434 nid 8864@kfi7 refs 3
00000400:00000200:18.0:1773851878.831937:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8865@kfi7 to cpt 7
00000400:00000200:18.0:1773851878.831939:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8865@kfi7 of length 456 into portal 12 MB=0x69b1907162e00
00000400:00000200:18.0:1773851878.831941:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8865@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 28016
00000800:00000200:18.0:1773851878.831944:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851878.831947:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851878.831947:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851878.831948:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8864@kfi7: PUT: OK
00000100:00000001:18.0:1773851878.831950:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851878.831951:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:17.0:1773851878.831951:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 Transaction freed
00000100:00000010:18.0:1773851878.831952:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000c7ef22a.
00000100:00000040:18.0:1773851878.831953:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000000c7ef22a x1859381655645696 msgsize 456
00000100:00100000:18.0:1773851878.831955:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-8865@kfi7 (source: 12345-8864@kfi7)
00000100:00000001:18.0:1773851878.831957:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851878.831958:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002d01f434 nid 8864@kfi7 refs 2
00000100:00000001:17.0:1773851878.831959:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851878.831960:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851878.831961:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851878.831961:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851878.831962:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851878.831963:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851878.831964:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381655645696
00000020:00000001:17.0:1773851878.831965:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851878.831966:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07966881ad6
00000020:00000001:17.0:1773851878.831967:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851878.831972:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002e697baa refcount=10
00000020:00000001:17.0:1773851878.831973:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000020:00000001:17.0:1773851878.831974:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637009509338112 : -107064200213504 : ffff9ea02c60cc00)
00000100:00000001:17.0:1773851878.831976:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.831977:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851878.831978:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097472cd0.
00000020:00000010:17.0:1773851878.831980:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.831981:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851878.831982:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851878.831983:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851878.831984:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.831985:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.831987:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.831989:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851878.831989:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851878.831990:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851878.831990:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851878.831992:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8865@kfi7, seq: 323103289
00000100:00000040:17.0:1773851878.831993:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002e697baa : new rpc_count 2
00000100:00000001:16.0:1773851878.831993:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.831994:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534658432 : -106946174893184 : ffff9ebba73c4380)
00000100:00000001:16.0:1773851878.831994:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.831996:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000c7ef22a x1859381655645696/t0(0) o17->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:518/0 lens 456/0 e 0 to 0 dl 1773852633 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1040-0'
00000100:00000001:17.0:1773851878.832001:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.832002:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851878.832003:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c7ef22a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:f4813154-7699-4896-9522-14f850a6fb2e+10:40035:x1859381655645696:12345-8865@kfi7:17:default-tuolumne1040-0
00000100:00000200:17.0:1773851878.832005:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381655645696
00000020:00000001:17.0:1773851878.832006:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851878.832007:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851878.832008:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.832010:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851878.832010:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:17.0:1773851878.832012:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851878.832013:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381655645696, found 0 last_xid 1859381655553663
00000020:00000001:17.0:1773851878.832014:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851878.832015:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851878.832016:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851878.832017:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:17.0:1773851878.832018:0:60961:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:17.0:1773851878.832020:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851878.832021:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851878.832022:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000006f63178d.
02000000:00000001:17.0:1773851878.832023:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.832024:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.832025:0:60961:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:17.0:1773851878.832026:0:60961:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:17.0:1773851878.832027:0:60961:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:17.0:1773851878.832029:0:60961:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.832030:0:60961:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:17.0:1773851878.832032:0:60961:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli f4813154-7699-4896-9522-14f850a6fb2e/000000002e697baa free: 126633370845184 avail: 126633368748032
00000020:00000001:17.0:1773851878.832034:0:60961:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:17.0:1773851878.832034:0:60961:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli f4813154-7699-4896-9522-14f850a6fb2e/000000002e697baa avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:17.0:1773851878.832037:0:60961:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:17.0:1773851878.832038:0:60961:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:17.0:1773851878.832039:0:60961:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli f4813154-7699-4896-9522-14f850a6fb2e/000000002e697baa reports grant 1396703232 dropped 0, local 1464860672
00000020:00000001:17.0:1773851878.832041:0:60961:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:17.0:1773851878.832042:0:60961:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:17.0:1773851878.832043:0:60961:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851878.832044:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183034610706, transno 0, xid 1859381655645696
00010000:00000001:17.0:1773851878.832045:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851878.832046:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000c7ef22a x1859381655645696/t0(0) o17->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:518/0 lens 456/432 e 0 to 0 dl 1773852633 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1040-0'
00010000:00000001:17.0:1773851878.832050:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851878.832051:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851878.832053:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=111 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851878.832055:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851878.832056:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053217cde refcount 3 to 8865@kfi7
00000100:00000001:17.0:1773851878.832057:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212384 : -107155106339232 : ffff9e8b01f36660)
02000000:00000001:17.0:1773851878.832058:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851878.832059:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.832060:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851878.832061:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8864@kfi7
00000400:00000010:17.0:1773851878.832062:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057d98c22.
00000100:00000200:17.0:1773851878.832063:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859381655645696, offset 224
00000400:00000200:17.0:1773851878.832065:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8864@kfi7
00000400:00000200:17.0:1773851878.832067:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8864@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.832068:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d01f434 nid 8864@kfi7 refs 1
00000400:00000200:17.0:1773851878.832070:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002d01f434 nid 8864@kfi7 refs 2
00000400:00000200:17.0:1773851878.832071:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002d01f434 nid 8864@kfi7 refs 3
00000400:00000200:17.0:1773851878.832073:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8864@kfi7 local destination
00000400:00000200:17.0:1773851878.832075:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769624:8769624:1024:4294967295] 8864@kfi7 LPNI seq info [1300264:1300264:16:4294967295]
00000400:00000200:17.0:1773851878.832078:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002d01f434 nid 8864@kfi7 refs 2
00000400:00000200:17.0:1773851878.832079:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8864@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.832082:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8864@kfi7(8864@kfi7:8864@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851878.832084:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002d01f434 nid 8864@kfi7 refs 3
00000800:00000200:17.0:1773851878.832086:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.832089:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:17.0:1773851878.832092:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.832096:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 Using peer 8864@kfi7(0x288)
00000800:00000200:17.0:1773851878.832100:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 532 bytes to peer 0x288: rc=0
00000800:00000200:17.0:1773851878.832102:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851878.832106:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.832107:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053217cde refcount 2 to 8865@kfi7
00010000:00000001:17.0:1773851878.832108:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851878.832109:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.832110:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851878.832111:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000c7ef22a x1859381655645696/t0(0) o17->f4813154-7699-4896-9522-14f850a6fb2e@8865@kfi7:518/0 lens 456/432 e 0 to 0 dl 1773852633 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1040-0'
00000100:00100000:17.0:1773851878.832116:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c7ef22a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:f4813154-7699-4896-9522-14f850a6fb2e+10:40035:x1859381655645696:12345-8865@kfi7:17:default-tuolumne1040-0 Request processed in 114us (162us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851878.832118:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851878.832120:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:17.0:1773851878.832120:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8865@kfi7, seq: 323103289
00000100:00000040:17.0:1773851878.832121:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002e697baa : new rpc_count 1
00000400:00000200:19.0:1773851878.832122:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8864@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.832122:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:19.0:1773851878.832123:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057d98c22
00000100:00000001:17.0:1773851878.832123:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:19.0:1773851878.832124:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057d98c22.
00000020:00000010:17.0:1773851878.832124:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000100:00000001:19.0:1773851878.832125:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:17.0:1773851878.832125:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000100:00000001:19.0:1773851878.832126:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851878.832127:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002d01f434 nid 8864@kfi7 refs 2
00000020:00000010:17.0:1773851878.832127:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097472cd0.
00000020:00000040:17.0:1773851878.832128:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000002e697baa : new refcount 9
00000100:00000001:17.0:1773851878.832129:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0:1773851878.832130:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 8864@kfi7(00000000f6036062):0x0 lsk 649 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x288 Transaction freed
00000800:00000200:17.0:1773851878.885274:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.885274:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851878.885275:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851878.885278:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851878.885281:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10003@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.885282:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10003@kfi7 : PUT - for me
00000400:00000200:17.0:1773851878.885282:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10003@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.885283:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000430de829 nid 10003@kfi7 refs 1
00000400:00000200:17.0:1773851878.885284:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10003@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.885285:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000430de829 nid 10003@kfi7 refs 2
00000400:00000200:17.0:1773851878.885286:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000430de829 nid 10003@kfi7 refs 3
00000400:00000200:17.0:1773851878.885287:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10194@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.885288:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10194@kfi7 of length 224 into portal 12 MB=0x69b90d2086240
00000400:00000200:17.0:1773851878.885289:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10194@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 28472
00000800:00000200:17.0:1773851878.885290:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851878.885292:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851878.885293:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10003@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.885294:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851878.885294:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851878.885295:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ea7ac81.
00000100:00000040:17.0:1773851878.885296:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000006ea7ac81 x1859896161624640 msgsize 224
00000100:00100000:17.0:1773851878.885297:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-10194@kfi7 (source: 12345-10003@kfi7)
00000100:00000001:17.0:1773851878.885298:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851878.885299:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000430de829 nid 10003@kfi7 refs 2
00000800:00000200:17.0:1773851878.885300:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851878.885302:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851878.885303:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851878.885303:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851878.885303:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851878.885304:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851878.885305:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859896161624640
00000020:00000001:17.0:1773851878.885305:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851878.885306:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08ac5fedf85
00000020:00000001:17.0:1773851878.885306:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851878.885308:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e64be284 refcount=5
00000020:00000001:17.0:1773851878.885308:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139701031936 : -106934008519680 : ffff9ebe7c686400)
00000020:00000001:17.0:1773851878.885309:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139701031936 : -106934008519680 : ffff9ebe7c686400)
00000100:00000001:17.0:1773851878.885310:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.885311:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851878.885311:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000097472cd0.
00000020:00000010:17.0:1773851878.885312:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.885312:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851878.885313:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851878.885313:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851878.885314:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.885314:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851878.885315:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851878.885315:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.885316:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851878.885317:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851878.885317:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851878.885317:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851878.885318:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10194@kfi7, seq: 2156374
00000100:00000001:16.0:1773851878.885318:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851878.885319:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e64be284 : new rpc_count 1
00000100:00000001:17.0:1773851878.885319:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985302144 : -106952724249472 : ffff9eba20dd0480)
00000100:00000001:16.0:1773851878.885319:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851878.885319:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.885320:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ea7ac81 x1859896161624640/t0(0) o400->5cc03d07-5a90-4885-b74c-25e4c0678e5c@10194@kfi7:99/0 lens 224/0 e 0 to 0 dl 1773852214 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1125-0'
00000100:00000001:17.0:1773851878.885323:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851878.885323:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851878.885324:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ea7ac81 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5cc03d07-5a90-4885-b74c-25e4c0678e5c+5:39483:x1859896161624640:12345-10194@kfi7:400:default-tuolumne1125-0
00000100:00000200:17.0:1773851878.885325:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859896161624640
00000020:00000001:17.0:1773851878.885326:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851878.885326:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851878.885327:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.885328:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851878.885328:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851878.885329:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851878.885329:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859896161624640, found 0 last_xid 1859896161624639
00000020:00000001:17.0:1773851878.885330:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851878.885330:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851878.885331:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851878.885331:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.885332:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851878.885332:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851878.885332:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851878.885333:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cab9d33d.
02000000:00000001:17.0:1773851878.885334:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.885334:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.885335:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851878.885335:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859896161624640
00010000:00000001:17.0:1773851878.885336:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851878.885337:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ea7ac81 x1859896161624640/t0(0) o400->5cc03d07-5a90-4885-b74c-25e4c0678e5c@10194@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1125-0'
00010000:00000001:17.0:1773851878.885339:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851878.885340:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851878.885340:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=111 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851878.885341:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851878.885342:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000086068c02 refcount 3 to 10194@kfi7
00000100:00000001:17.0:1773851878.885342:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583545856 : -107156126005760 : ffff9e8ac52c8600)
02000000:00000001:17.0:1773851878.885343:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851878.885343:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851878.885344:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851878.885344:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10003@kfi7
00000400:00000010:17.0:1773851878.885345:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004cb7cc9f.
00000100:00000200:17.0:1773851878.885346:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859896161624640, offset 224
00000400:00000200:17.0:1773851878.885347:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10003@kfi7
00000400:00000200:17.0:1773851878.885347:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10003@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.885348:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000430de829 nid 10003@kfi7 refs 1
00000400:00000200:17.0:1773851878.885349:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000430de829 nid 10003@kfi7 refs 2
00000400:00000200:17.0:1773851878.885360:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000430de829 nid 10003@kfi7 refs 3
00000400:00000200:17.0:1773851878.885361:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10003@kfi7 local destination
00000400:00000200:17.0:1773851878.885362:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769625:8769625:1024:4294967295] 10003@kfi7 LPNI seq info [777935:777935:16:4294967295]
00000400:00000200:17.0:1773851878.885363:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000430de829 nid 10003@kfi7 refs 2
00000400:00000200:17.0:1773851878.885364:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10003@kfi7 to cpt 4
00000400:00000200:17.0:1773851878.885366:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10003@kfi7(10003@kfi7:10003@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851878.885367:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000430de829 nid 10003@kfi7 refs 3
00000800:00000200:17.0:1773851878.885368:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851878.885369:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851878.885371:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851878.885373:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b24 Using peer 10003@kfi7(0x100000000000b24)
00000800:00000200:17.0:1773851878.885376:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x100000000000b24: rc=0
00000800:00000200:17.0:1773851878.885377:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b24 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851878.885379:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851878.885379:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000086068c02 refcount 2 to 10194@kfi7
00010000:00000001:17.0:1773851878.885380:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851878.885380:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851878.885381:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851878.885382:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ea7ac81 x1859896161624640/t0(0) o400->5cc03d07-5a90-4885-b74c-25e4c0678e5c@10194@kfi7:99/0 lens 224/224 e 0 to 0 dl 1773852214 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1125-0'
00000100:00100000:17.0:1773851878.885384:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ea7ac81 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5cc03d07-5a90-4885-b74c-25e4c0678e5c+5:39483:x1859896161624640:12345-10194@kfi7:400:default-tuolumne1125-0 Request processed in 61us (88us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851878.885386:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10194@kfi7, seq: 2156374
00000100:00000040:17.0:1773851878.885387:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e64be284 : new rpc_count 0
00000100:00000001:17.0:1773851878.885388:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:19.0:1773851878.885389:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b24 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851878.885389:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851878.885389:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851878.885390:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851878.885390:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000097472cd0.
00000400:00000200:19.0:1773851878.885391:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851878.885391:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000e64be284 : new refcount 4
00000400:00000200:19.0:1773851878.885392:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10003@kfi7: PUT: OK
00000100:00000001:17.0:1773851878.885392:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851878.885393:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004cb7cc9f
00000400:00000010:19.0:1773851878.885393:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004cb7cc9f.
00000100:00000001:19.0:1773851878.885394:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851878.885394:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851878.885395:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000430de829 nid 10003@kfi7 refs 2
00000800:00000200:19.0:1773851878.885397:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 10003@kfi7(0000000015b48f8e):0x0 lsk 2853 rsk 38 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b24 Transaction freed
00000800:00000200:13.0:1773851878.932609:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851878.932610:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851878.932613:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851878.932617:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851878.932621:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13283@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.932623:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13283@kfi7 : PUT - for me
00000400:00000200:13.0:1773851878.932625:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13283@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.932627:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c14f2b0f nid 13283@kfi7 refs 1
00000400:00000200:13.0:1773851878.932629:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13283@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.932631:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c14f2b0f nid 13283@kfi7 refs 2
00000400:00000200:13.0:1773851878.932632:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c14f2b0f nid 13283@kfi7 refs 3
00000400:00000200:13.0:1773851878.932634:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13283@kfi7 to cpt 3
00000400:00000200:13.0:1773851878.932636:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13283@kfi7 of length 224 into portal 12 MB=0x699e136fca140
00000400:00000200:13.0:1773851878.932638:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13283@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 39760
00000800:00000200:13.0:1773851878.932642:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851878.932645:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851878.932647:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13283@kfi7: PUT: OK
00000100:00000001:13.0:1773851878.932648:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851878.932649:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851878.932651:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003205da23.
00000100:00000040:13.0:1773851878.932653:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003205da23 x1858042429481280 msgsize 224
00000100:00100000:13.0:1773851878.932656:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13283@kfi7 (source: 12345-13283@kfi7)
00000100:00000001:13.0:1773851878.932657:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851878.932659:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c14f2b0f nid 13283@kfi7 refs 2
00000800:00000200:13.0:1773851878.932661:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851878.932661:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851878.932663:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851878.932664:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851878.932665:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851878.932666:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851878.932668:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042429481280
00000020:00000001:12.0:1773851878.932669:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851878.932670:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91afe
00000020:00000001:12.0:1773851878.932671:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851878.932677:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a739436c refcount=6
00000020:00000001:12.0:1773851878.932678:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627766272 : -107123081785344 : ffff9e9276c35000)
00000020:00000001:12.0:1773851878.932680:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627766272 : -107123081785344 : ffff9e9276c35000)
00000100:00000001:12.0:1773851878.932682:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851878.932683:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851878.932684:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ebe075ad.
00000020:00000010:12.0:1773851878.932686:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851878.932688:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
00000100:00000001:12.0:1773851878.932689:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851878.932690:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851878.932691:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851878.932693:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851878.932694:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851878.932694:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851878.932696:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851878.932699:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851878.932699:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851878.932700:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851878.932700:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851878.932702:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13283@kfi7, seq: 2289874
00000100:00000001:15.0:1773851878.932703:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851878.932703:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a739436c : new rpc_count 1
00000100:00000001:12.0:1773851878.932704:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902243328 : -106994807308288 : ffff9eb054848000)
00000100:00000001:15.0:1773851878.932705:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851878.932706:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003205da23 x1858042429481280/t0(0) o400->2c0528c5-3e68-40a9-b584-631c7575d2fd@13283@kfi7:605/0 lens 224/0 e 0 to 0 dl 1773851965 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1307-0'
00000100:00000001:12.0:1773851878.932712:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851878.932712:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851878.932714:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003205da23 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:2c0528c5-3e68-40a9-b584-631c7575d2fd+6:39636:x1858042429481280:12345-13283@kfi7:400:default-tuolumne1307-0
00000100:00000200:12.0:1773851878.932719:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042429481280
00000020:00000001:12.0:1773851878.932720:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851878.932721:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851878.932723:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.932724:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851878.932731:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851878.932732:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851878.932733:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042429481280, found 0 last_xid 1858042429481279
00000020:00000001:12.0:1773851878.932734:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851878.932735:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851878.932736:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851878.932737:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.932738:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851878.932739:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851878.932740:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851878.932741:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000914af88c.
02000000:00000001:12.0:1773851878.932742:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851878.932743:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.932743:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851878.932744:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689461, transno 0, xid 1858042429481280
00010000:00000001:12.0:1773851878.932745:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851878.932746:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003205da23 x1858042429481280/t0(0) o400->2c0528c5-3e68-40a9-b584-631c7575d2fd@13283@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1307-0'
00010000:00000001:12.0:1773851878.932749:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851878.932749:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851878.932750:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=111 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851878.932751:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851878.932752:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c214bf5d refcount 3 to 13283@kfi7
00000100:00000001:12.0:1773851878.932753:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729297344 : -107155980254272 : ffff9e8acddc83c0)
02000000:00000001:12.0:1773851878.932754:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851878.932754:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851878.932755:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851878.932756:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13283@kfi7
00000400:00000010:12.0:1773851878.932757:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008781a478.
00000100:00000200:12.0:1773851878.932758:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042429481280, offset 224
00000400:00000200:12.0:1773851878.932760:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13283@kfi7
00000400:00000200:12.0:1773851878.932761:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13283@kfi7 to cpt 3
00000400:00000200:12.0:1773851878.932762:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c14f2b0f nid 13283@kfi7 refs 1
00000400:00000200:12.0:1773851878.932763:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c14f2b0f nid 13283@kfi7 refs 2
00000400:00000200:12.0:1773851878.932764:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c14f2b0f nid 13283@kfi7 refs 3
00000400:00000200:12.0:1773851878.932766:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13283@kfi7 local destination
00000400:00000200:12.0:1773851878.932767:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769626:8769626:1024:4294967295] 13283@kfi7 LPNI seq info [7695778:7695778:16:4294967295]
00000400:00000200:12.0:1773851878.932769:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c14f2b0f nid 13283@kfi7 refs 2
00000400:00000200:12.0:1773851878.932770:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13283@kfi7 to cpt 3
00000400:00000200:12.0:1773851878.932772:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13283@kfi7(13283@kfi7:13283@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851878.932773:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c14f2b0f nid 13283@kfi7 refs 3
00000800:00000200:12.0:1773851878.932775:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851878.932776:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851878.932778:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851878.932781:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000052a Using peer 13283@kfi7(0x10000000000052a)
00000800:00000200:12.0:1773851878.932784:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0x10000000000052a: rc=0
00000800:00000200:12.0:1773851878.932786:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000052a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851878.932788:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851878.932789:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c214bf5d refcount 2 to 13283@kfi7
00010000:00000001:12.0:1773851878.932789:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851878.932790:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851878.932790:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851878.932791:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003205da23 x1858042429481280/t0(0) o400->2c0528c5-3e68-40a9-b584-631c7575d2fd@13283@kfi7:605/0 lens 224/224 e 0 to 0 dl 1773851965 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1307-0'
00000100:00100000:12.0:1773851878.932796:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003205da23 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:2c0528c5-3e68-40a9-b584-631c7575d2fd+6:39636:x1858042429481280:12345-13283@kfi7:400:default-tuolumne1307-0 Request processed in 83us (142us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851878.932799:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13283@kfi7, seq: 2289874
00000100:00000040:12.0:1773851878.932799:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a739436c : new rpc_count 0
00000100:00000001:12.0:1773851878.932800:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851878.932800:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851878.932801:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851878.932802:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000020:00000010:12.0:1773851878.932802:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ebe075ad.
00000020:00000040:12.0:1773851878.932803:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000a739436c : new refcount 5
00000100:00000001:12.0:1773851878.932804:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851878.932810:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000052a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851878.932812:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851878.932813:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13283@kfi7: PUT: OK
00000400:00000200:13.0:1773851878.932814:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008781a478
00000400:00000010:13.0:1773851878.932814:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008781a478.
00000100:00000001:13.0:1773851878.932815:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851878.932815:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851878.932816:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c14f2b0f nid 13283@kfi7 refs 2
00000800:00000200:13.0:1773851878.932817:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 13283@kfi7(0000000058472c20):0x0 lsk 1323 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000052a Transaction freed
00000800:00000200:29.0:1773851878.941927:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851878.941928:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851878.941929:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851878.941931:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851878.941933:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.941935:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19395@kfi7 : PUT - for me
00000400:00000200:29.0:1773851878.941936:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.941936:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 1
00000400:00000200:29.0:1773851878.941937:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:29.0:1773851878.941938:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:29.0:1773851878.941939:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000400:00000200:29.0:1773851878.941940:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19394@kfi7 to cpt 4
00000400:00000200:29.0:1773851878.941941:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19394@kfi7 of length 224 into portal 12 MB=0x69b097c9281c0
00000400:00000200:29.0:1773851878.941942:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19394@kfi7 of length 224/224 into md 0x77fe139dd [64] + 188808
00000800:00000200:29.0:1773851878.941944:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851878.941945:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.941946:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19395@kfi7: PUT: OK
00000100:00000001:29.0:1773851878.941947:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851878.941948:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851878.941949:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ffd7e266.
00000100:00000040:29.0:1773851878.941949:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ffd7e266 x1859314907251136 msgsize 224
00000100:00100000:29.0:1773851878.941951:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19394@kfi7 (source: 12345-19395@kfi7)
00000100:00000001:29.0:1773851878.941952:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851878.941953:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000100:00000001:28.0:1773851878.941953:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851878.941954:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851878.941954:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851878.941954:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851878.941955:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851878.941956:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851878.941957:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314907251136
00000020:00000001:28.0:1773851878.941957:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851878.941958:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c8c
00000020:00000001:28.0:1773851878.941959:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851878.941961:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230f87c9 refcount=725
00000020:00000001:28.0:1773851878.941961:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743934976 : -107128965616640 : ffff9e91180f2c00)
00000020:00000001:28.0:1773851878.941962:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743934976 : -107128965616640 : ffff9e91180f2c00)
00000100:00000001:28.0:1773851878.941966:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851878.941967:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851878.941967:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851878.941968:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851878.941969:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851878.941970:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851878.941970:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851878.941971:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851878.941972:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851878.941973:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851878.941973:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.941974:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851878.941975:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851878.941976:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851878.941976:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851878.941976:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851878.941977:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19394@kfi7, seq: 2055551
00000100:00000040:28.0:1773851878.941977:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230f87c9 : new rpc_count 12
00000100:00000001:30.0:1773851878.941978:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851878.941978:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.941978:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636955373901440 : -107118335650176 : ffff9e9391a79680)
00000100:00000040:28.0:1773851878.941979:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ffd7e266 x1859314907251136/t0(0) o400->98f52e34-938a-4df6-a93f-54c89d007e99@19394@kfi7:666/0 lens 224/0 e 0 to 0 dl 1773852026 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1703-0'
00000100:00000001:28.0:1773851878.941982:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851878.941983:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851878.941984:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ffd7e266 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:98f52e34-938a-4df6-a93f-54c89d007e99+725:39962:x1859314907251136:12345-19394@kfi7:400:default-tuolumne1703-0
00000100:00000200:28.0:1773851878.941985:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314907251136
00000020:00000001:28.0:1773851878.941986:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851878.941986:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851878.941987:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.941988:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851878.941988:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851878.941989:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851878.941990:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314907251136, found 0 last_xid 1859314900154687
00000020:00000001:28.0:1773851878.941991:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851878.941991:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851878.941993:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851878.941993:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.941994:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851878.941995:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851878.941995:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851878.941996:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000adb0a5b7.
02000000:00000001:28.0:1773851878.941996:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.941997:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.941997:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851878.941998:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264580894, transno 0, xid 1859314907251136
00010000:00000001:28.0:1773851878.941999:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851878.942000:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ffd7e266 x1859314907251136/t0(0) o400->98f52e34-938a-4df6-a93f-54c89d007e99@19394@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1703-0'
00010000:00000001:28.0:1773851878.942002:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851878.942003:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851878.942003:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=111 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851878.942004:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851878.942005:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e162e19 refcount 5 to 19394@kfi7
00000100:00000001:28.0:1773851878.942006:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370152288 : -107145339399328 : ffff9e8d481b1360)
02000000:00000001:28.0:1773851878.942007:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851878.942007:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851878.942008:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851878.942009:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19395@kfi7
00000400:00000010:28.0:1773851878.942009:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af6e809e.
00000100:00000200:28.0:1773851878.942010:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314907251136, offset 224
00000400:00000200:28.0:1773851878.942011:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19395@kfi7
00000400:00000200:28.0:1773851878.942012:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:28.0:1773851878.942013:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 1
00000400:00000200:28.0:1773851878.942014:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:28.0:1773851878.942015:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000400:00000200:28.0:1773851878.942016:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19395@kfi7 local destination
00000400:00000200:28.0:1773851878.942018:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769627:8769627:1024:4294967295] 19395@kfi7 LPNI seq info [8381839:8381839:16:4294967295]
00000400:00000200:28.0:1773851878.942019:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:28.0:1773851878.942020:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:28.0:1773851878.942022:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19395@kfi7(19395@kfi7:19395@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851878.942023:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000800:00000200:28.0:1773851878.942025:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851878.942026:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851878.942028:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851878.942031:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000005eb Using peer 19395@kfi7(0x1000000000005eb)
00000800:00000200:28.0:1773851878.942034:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x1000000000005eb: rc=0
00000800:00000200:28.0:1773851878.942035:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000005eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851878.942037:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851878.942038:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e162e19 refcount 4 to 19394@kfi7
00010000:00000001:28.0:1773851878.942039:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851878.942039:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851878.942040:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851878.942041:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ffd7e266 x1859314907251136/t0(0) o400->98f52e34-938a-4df6-a93f-54c89d007e99@19394@kfi7:666/0 lens 224/224 e 0 to 0 dl 1773852026 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1703-0'
00000100:00100000:28.0:1773851878.942046:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ffd7e266 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:98f52e34-938a-4df6-a93f-54c89d007e99+725:39962:x1859314907251136:12345-19394@kfi7:400:default-tuolumne1703-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851878.942048:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19394@kfi7, seq: 2055551
00000100:00000040:28.0:1773851878.942049:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230f87c9 : new rpc_count 11
00000100:00000001:28.0:1773851878.942049:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851878.942050:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851878.942050:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851878.942051:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851878.942052:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851878.942053:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000230f87c9 : new refcount 724
00000100:00000001:28.0:1773851878.942054:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851878.942058:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000005eb TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851878.942060:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851878.942061:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19395@kfi7: PUT: OK
00000400:00000200:29.0:1773851878.942062:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af6e809e
00000400:00000010:29.0:1773851878.942062:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af6e809e.
00000100:00000001:29.0:1773851878.942063:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851878.942063:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851878.942064:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000800:00000200:29.0:1773851878.942065:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 19395@kfi7(00000000ecc5877c):0x0 lsk 1516 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000005eb Transaction freed
00000800:00000200:25.0:1773851878.972658:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851878.972660:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851878.972662:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851878.972666:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851878.972670:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9315@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.972672:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9315@kfi7 : PUT - for me
00000400:00000200:25.0:1773851878.972674:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9315@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.972675:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 1
00000400:00000200:25.0:1773851878.972677:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9315@kfi7 to cpt 6
00000400:00000200:25.0:1773851878.972678:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 2
00000400:00000200:25.0:1773851878.972680:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 3
00000400:00000200:25.0:1773851878.972681:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9314@kfi7 to cpt 3
00000400:00000200:25.0:1773851878.972683:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9314@kfi7 of length 224 into portal 12 MB=0x699e16ef52b80
00000400:00000200:25.0:1773851878.972685:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9314@kfi7 of length 224/224 into md 0x16159c9699 [64] + 25248
00000800:00000200:25.0:1773851878.972688:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851878.972691:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851878.972693:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9315@kfi7: PUT: OK
00000100:00000001:25.0:1773851878.972695:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851878.972695:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851878.972697:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b0ed3c4e.
00000100:00000040:25.0:1773851878.972698:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b0ed3c4e x1858043368516480 msgsize 224
00000100:00100000:25.0:1773851878.972700:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9314@kfi7 (source: 12345-9315@kfi7)
00000100:00000001:25.0:1773851878.972702:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851878.972704:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 2
00000100:00000001:27.0:1773851878.972705:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851878.972706:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851878.972706:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851878.972707:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851878.972708:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851878.972709:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851878.972711:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043368516480
00000020:00000001:27.0:1773851878.972712:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851878.972712:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91444
00000020:00000001:27.0:1773851878.972713:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851878.972717:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac49a5b7 refcount=6
00000020:00000001:27.0:1773851878.972718:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240782848 : -107152468768768 : ffff9e8b9f298800)
00000020:00000001:27.0:1773851878.972719:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240782848 : -107152468768768 : ffff9e8b9f298800)
00000100:00000001:27.0:1773851878.972721:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851878.972722:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851878.972723:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851878.972724:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851878.972730:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851878.972731:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851878.972732:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851878.972732:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851878.972733:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851878.972734:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851878.972734:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.972736:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851878.972737:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851878.972738:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851878.972738:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851878.972738:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851878.972739:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9314@kfi7, seq: 2025138
00000100:00000040:27.0:1773851878.972740:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac49a5b7 : new rpc_count 1
00000100:00000001:27.0:1773851878.972740:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106092984320 : -106967616567296 : ffff9eb6a9364800)
00000100:00000001:26.0:1773851878.972740:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851878.972740:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851878.972742:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b0ed3c4e x1858043368516480/t0(0) o400->d70ce047-4bf6-48ff-897c-997a2a0df16d@9314@kfi7:95/0 lens 224/0 e 0 to 0 dl 1773852210 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1068-0'
00000100:00000001:27.0:1773851878.972745:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851878.972746:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851878.972746:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b0ed3c4e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:d70ce047-4bf6-48ff-897c-997a2a0df16d+6:39816:x1858043368516480:12345-9314@kfi7:400:default-tuolumne1068-0
00000100:00000200:27.0:1773851878.972750:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043368516480
00000020:00000001:27.0:1773851878.972751:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851878.972752:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851878.972753:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.972753:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851878.972754:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851878.972755:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851878.972756:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043368516480, found 0 last_xid 1858043368516479
00000020:00000001:27.0:1773851878.972756:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851878.972757:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851878.972758:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851878.972758:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.972759:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851878.972760:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851878.972760:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851878.972761:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005af104ac.
02000000:00000001:27.0:1773851878.972762:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.972763:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.972763:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851878.972764:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046142084, transno 0, xid 1858043368516480
00010000:00000001:27.0:1773851878.972765:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851878.972766:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b0ed3c4e x1858043368516480/t0(0) o400->d70ce047-4bf6-48ff-897c-997a2a0df16d@9314@kfi7:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1068-0'
00010000:00000001:27.0:1773851878.972769:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851878.972769:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851878.972770:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=111 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851878.972771:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851878.972772:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b37dfa21 refcount 3 to 9314@kfi7
00000100:00000001:27.0:1773851878.972773:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154432 : -107139310397184 : ffff9e8eaf765900)
02000000:00000001:27.0:1773851878.972775:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851878.972775:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851878.972776:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851878.972777:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9315@kfi7
00000400:00000010:27.0:1773851878.972777:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000435f583e.
00000100:00000200:27.0:1773851878.972779:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043368516480, offset 224
00000400:00000200:27.0:1773851878.972780:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9315@kfi7
00000400:00000200:27.0:1773851878.972781:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9315@kfi7 to cpt 6
00000400:00000200:27.0:1773851878.972782:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 1
00000400:00000200:27.0:1773851878.972783:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 2
00000400:00000200:27.0:1773851878.972784:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 3
00000400:00000200:27.0:1773851878.972786:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9315@kfi7 local destination
00000400:00000200:27.0:1773851878.972787:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769628:8769628:1024:4294967295] 9315@kfi7 LPNI seq info [8576399:8576399:16:4294967295]
00000400:00000200:27.0:1773851878.972789:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 2
00000400:00000200:27.0:1773851878.972790:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9315@kfi7 to cpt 6
00000400:00000200:27.0:1773851878.972792:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9315@kfi7(9315@kfi7:9315@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851878.972793:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 3
00000800:00000200:27.0:1773851878.972795:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851878.972796:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851878.972799:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851878.972801:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x109 Using peer 9315@kfi7(0x109)
00000800:00000200:27.0:1773851878.972804:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x109: rc=0
00000800:00000200:27.0:1773851878.972806:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x109 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851878.972808:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851878.972809:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b37dfa21 refcount 2 to 9314@kfi7
00010000:00000001:27.0:1773851878.972810:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851878.972810:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851878.972811:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851878.972812:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b0ed3c4e x1858043368516480/t0(0) o400->d70ce047-4bf6-48ff-897c-997a2a0df16d@9314@kfi7:95/0 lens 224/224 e 0 to 0 dl 1773852210 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1068-0'
00000100:00100000:27.0:1773851878.972816:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b0ed3c4e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:d70ce047-4bf6-48ff-897c-997a2a0df16d+6:39816:x1858043368516480:12345-9314@kfi7:400:default-tuolumne1068-0 Request processed in 70us (117us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851878.972819:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9314@kfi7, seq: 2025138
00000800:00000200:25.0:1773851878.972819:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x109 TN_EVENT_TX_OK event status 0
00000100:00000040:27.0:1773851878.972820:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac49a5b7 : new rpc_count 0
00000400:00000200:25.0:1773851878.972820:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851878.972821:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851878.972821:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851878.972821:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9315@kfi7: PUT: OK
00000020:00000010:27.0:1773851878.972822:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851878.972822:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000435f583e
00000020:00000010:27.0:1773851878.972823:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000010:25.0:1773851878.972823:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000435f583e.
00000100:00000001:25.0:1773851878.972823:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:27.0:1773851878.972824:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000100:00000001:25.0:1773851878.972824:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:27.0:1773851878.972825:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000ac49a5b7 : new refcount 5
00000100:00000001:27.0:1773851878.972825:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851878.972825:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9b26ce5 nid 9315@kfi7 refs 2
00000800:00000200:25.0:1773851878.972827:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 9315@kfi7(0000000046be7081):0x0 lsk 266 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x109 Transaction freed
00000800:00000200:1.0:1773851879.002739:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851879.002740:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851879.002741:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851879.002744:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851879.002746:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22131@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.002748:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22131@kfi7 : PUT - for me
00000400:00000200:1.0:1773851879.002749:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22131@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.002750:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 1
00000400:00000200:1.0:1773851879.002752:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22131@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.002753:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 2
00000400:00000200:1.0:1773851879.002754:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 3
00000400:00000200:1.0:1773851879.002755:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22194@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.002756:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22194@kfi7 of length 224 into portal 12 MB=0x69b095514cd00
00000400:00000200:1.0:1773851879.002758:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22194@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 39616
00000800:00000200:1.0:1773851879.002759:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851879.002764:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851879.002765:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22131@kfi7: PUT: OK
00000100:00000001:1.0:1773851879.002766:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851879.002766:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851879.002769:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000765709be.
00000100:00000040:1.0:1773851879.002769:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000765709be x1859314244701440 msgsize 224
00000100:00100000:1.0:1773851879.002771:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22194@kfi7 (source: 12345-22131@kfi7)
00000100:00000001:1.0:1773851879.002773:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851879.002774:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 2
00000800:00000200:1.0:1773851879.002776:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004096d8c5: 2054@kfi7:0 <- 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851879.002778:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851879.002779:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851879.002780:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851879.002780:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851879.002782:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851879.002782:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314244701440
00000020:00000001:1.0:1773851879.002783:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851879.002784:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ee6
00000020:00000001:1.0:1773851879.002784:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851879.002789:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bb58be45 refcount=6
00000020:00000001:1.0:1773851879.002790:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744647680 : -107128964903936 : ffff9e91181a0c00)
00000020:00000001:1.0:1773851879.002791:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744647680 : -107128964903936 : ffff9e91181a0c00)
00000100:00000001:1.0:1773851879.002792:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851879.002793:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851879.002794:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851879.002795:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851879.002796:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851879.002797:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851879.002798:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851879.002798:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851879.002799:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851879.002800:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851879.002803:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.002804:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851879.002806:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851879.002806:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851879.002806:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851879.002807:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851879.002807:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22194@kfi7, seq: 1997587
00000100:00000040:1.0:1773851879.002808:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bb58be45 : new rpc_count 1
00000100:00000001:2.0:1773851879.002809:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.002809:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112263296 : -106950597288320 : ffff9eba9fa3de80)
00000100:00000001:2.0:1773851879.002810:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851879.002811:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000765709be x1859314244701440/t0(0) o400->28ce7309-3993-4049-a096-ec528c01b7d1@22194@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1866-0'
00000100:00000001:1.0:1773851879.002814:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851879.002814:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851879.002816:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000765709be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:28ce7309-3993-4049-a096-ec528c01b7d1+6:39583:x1859314244701440:12345-22194@kfi7:400:default-tuolumne1866-0
00000100:00000200:1.0:1773851879.002817:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314244701440
00000020:00000001:1.0:1773851879.002818:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851879.002819:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851879.002819:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.002820:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851879.002821:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851879.002822:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851879.002822:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314244701440, found 0 last_xid 1859314244701439
00000020:00000001:1.0:1773851879.002823:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851879.002824:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851879.002825:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851879.002825:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.002826:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851879.002827:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851879.002827:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851879.002828:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000969e5849.
02000000:00000001:1.0:1773851879.002829:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.002830:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.002830:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851879.002831:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044156453, transno 0, xid 1859314244701440
00010000:00000001:1.0:1773851879.002832:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851879.002834:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000765709be x1859314244701440/t0(0) o400->28ce7309-3993-4049-a096-ec528c01b7d1@22194@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1866-0'
00010000:00000001:1.0:1773851879.002837:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851879.002837:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851879.002838:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=112 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851879.002839:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851879.002840:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a4aa1e05 refcount 3 to 22194@kfi7
00000100:00000001:1.0:1773851879.002841:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958440928 : -107146751110688 : ffff9e8cf3f611e0)
02000000:00000001:1.0:1773851879.002842:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851879.002842:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.002843:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851879.002844:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22131@kfi7
00000400:00000010:1.0:1773851879.002845:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004af764b3.
00000100:00000200:1.0:1773851879.002846:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314244701440, offset 224
00000400:00000200:1.0:1773851879.002848:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22131@kfi7
00000400:00000200:1.0:1773851879.002849:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22131@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.002850:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 1
00000400:00000200:1.0:1773851879.002851:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 2
00000400:00000200:1.0:1773851879.002852:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 3
00000400:00000200:1.0:1773851879.002854:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22131@kfi7 local destination
00000400:00000200:1.0:1773851879.002855:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769629:8769629:1024:4294967295] 22131@kfi7 LPNI seq info [980700:980700:16:4294967295]
00000400:00000200:1.0:1773851879.002857:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 2
00000400:00000200:1.0:1773851879.002857:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22131@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.002860:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22131@kfi7(22131@kfi7:22131@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851879.002861:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 3
00000800:00000200:1.0:1773851879.002862:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851879.002863:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851879.002865:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851879.002867:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fbb Using peer 22131@kfi7(0x100000000000fbb)
00000800:00000200:1.0:1773851879.002870:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0x100000000000fbb: rc=0
00000800:00000200:1.0:1773851879.002872:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fbb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851879.002874:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851879.002875:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a4aa1e05 refcount 2 to 22194@kfi7
00010000:00000001:1.0:1773851879.002876:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851879.002876:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.002877:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851879.002877:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000765709be x1859314244701440/t0(0) o400->28ce7309-3993-4049-a096-ec528c01b7d1@22194@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1866-0'
00000100:00100000:1.0:1773851879.002880:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000765709be pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:28ce7309-3993-4049-a096-ec528c01b7d1+6:39583:x1859314244701440:12345-22194@kfi7:400:default-tuolumne1866-0 Request processed in 65us (110us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851879.002882:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22194@kfi7, seq: 1997587
00000100:00000040:1.0:1773851879.002883:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bb58be45 : new rpc_count 0
00000100:00000001:1.0:1773851879.002884:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851879.002884:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:3.0:1773851879.002885:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fbb TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851879.002885:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851879.002885:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000020:00000010:1.0:1773851879.002886:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:3.0:1773851879.002887:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:1.0:1773851879.002887:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000bb58be45 : new refcount 5
00000400:00000200:3.0:1773851879.002888:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22131@kfi7: PUT: OK
00000100:00000001:1.0:1773851879.002888:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851879.002889:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004af764b3
00000400:00000010:3.0:1773851879.002890:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004af764b3.
00000100:00000001:3.0:1773851879.002890:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851879.002891:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851879.002892:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6dba0a6 nid 22131@kfi7 refs 2
00000800:00000200:3.0:1773851879.002893:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2054@kfi7:0 -> 22131@kfi7(000000008f770703):0x0 lsk 4028 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fbb Transaction freed
00000800:00000200:9.0:1773851879.067349:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851879.067350:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851879.067351:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851879.067354:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851879.067356:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851879.067357:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.29@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851879.067358:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851879.067359:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851879.067360:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.29@o2ib60 to cpt 6
00000400:00000200:9.0:1773851879.067362:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002c2fcf8 nid 192.168.128.29@o2ib60 refs 2
00000400:00000200:9.0:1773851879.067363:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000002c2fcf8 nid 192.168.128.29@o2ib60 refs 3
00000400:00000200:9.0:1773851879.067365:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.29@o2ib60 to cpt 6
00000400:00000200:9.0:1773851879.067366:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.29@o2ib60 of length 224 into portal 12 MB=0x69b22d4e2bd80
00000400:00000200:9.0:1773851879.067368:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.29@o2ib60 of length 224/224 into md 0x16159c9699 [64] + 25472
00000800:00000200:9.0:1773851879.067370:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851879.067372:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851879.067373:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851879.067374:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851879.067374:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851879.067376:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f5e0fb06.
00000100:00000040:9.0:1773851879.067376:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f5e0fb06 x1859423763086720 msgsize 224
00000100:00100000:9.0:1773851879.067378:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.29@o2ib60 (source: 12345-192.168.128.29@o2ib60)
00000100:00000001:9.0:1773851879.067380:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851879.067381:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:27.0:1773851879.067383:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851879.067383:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851879.067383:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851879.067384:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851879.067384:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851879.067385:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851879.067386:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859423763086720
00000020:00000001:27.0:1773851879.067386:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851879.067387:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2ced57
00000020:00000001:27.0:1773851879.067387:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851879.067389:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047d5b6d0 refcount=6
00000020:00000001:27.0:1773851879.067390:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105607996416 : -106968101555200 : ffff9eb68c4df400)
00000020:00000001:27.0:1773851879.067391:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105607996416 : -106968101555200 : ffff9eb68c4df400)
00000100:00000001:27.0:1773851879.067392:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.067392:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851879.067393:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851879.067394:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851879.067395:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851879.067396:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851879.067396:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851879.067396:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.067397:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851879.067398:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851879.067398:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.067399:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.067401:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851879.067402:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851879.067402:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851879.067402:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851879.067403:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.29@o2ib60, seq: 2025139
00000100:00000040:27.0:1773851879.067404:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047d5b6d0 : new rpc_count 2
00000100:00000001:27.0:1773851879.067404:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096250880 : -107006613300736 : ffff9ead94d35a00)
00000100:00000001:26.0:1773851879.067404:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851879.067404:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.067406:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f5e0fb06 x1859423763086720/t0(0) o400->21302aa0-e233-4eaa-ab68-cfd28a7997c5@192.168.128.29@o2ib60:129/0 lens 224/0 e 0 to 0 dl 1773852244 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix29-0'
00000100:00000001:27.0:1773851879.067409:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.067409:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851879.067410:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f5e0fb06 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:21302aa0-e233-4eaa-ab68-cfd28a7997c5+6:40037:x1859423763086720:12345-192.168.128.29@o2ib60:400:default-matrix29-0
00000100:00000200:27.0:1773851879.067411:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859423763086720
00000020:00000001:27.0:1773851879.067412:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851879.067413:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851879.067413:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.067414:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851879.067414:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851879.067415:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851879.067416:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859423763086720, found 0 last_xid 1859423762844607
00000020:00000001:27.0:1773851879.067417:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851879.067417:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851879.067418:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851879.067418:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.067419:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851879.067419:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851879.067420:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851879.067421:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000765db2cc.
02000000:00000001:27.0:1773851879.067421:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.067422:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.067423:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851879.067423:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182564317516, transno 0, xid 1859423763086720
00010000:00000001:27.0:1773851879.067424:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851879.067425:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f5e0fb06 x1859423763086720/t0(0) o400->21302aa0-e233-4eaa-ab68-cfd28a7997c5@192.168.128.29@o2ib60:129/0 lens 224/224 e 0 to 0 dl 1773852244 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix29-0'
00010000:00000001:27.0:1773851879.067430:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851879.067431:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851879.067432:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=112 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851879.067433:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851879.067433:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3973035 refcount 3 to 192.168.128.29@o2ib60
00000100:00000001:27.0:1773851879.067434:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366321728 : -107142343229888 : ffff9e8dfab0fe40)
02000000:00000001:27.0:1773851879.067435:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851879.067436:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.067436:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851879.067438:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.29@o2ib60
00000400:00000010:27.0:1773851879.067438:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000435f583e.
00000100:00000200:27.0:1773851879.067439:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859423763086720, offset 224
00000400:00000200:27.0:1773851879.067441:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.29@o2ib60
00000400:00000200:27.0:1773851879.067442:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.29@o2ib60 to cpt 6
00000400:00000200:27.0:1773851879.067443:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002c2fcf8 nid 192.168.128.29@o2ib60 refs 2
00000400:00000200:27.0:1773851879.067444:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000002c2fcf8 nid 192.168.128.29@o2ib60 refs 3
00000400:00000200:27.0:1773851879.067445:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000002c2fcf8 nid 192.168.128.29@o2ib60 refs 4
00000400:00000200:27.0:1773851879.067446:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.29@o2ib60 routed destination
00000400:00000200:27.0:1773851879.067448:0:41182:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:27.0:1773851879.067449:0:41182:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:27.0:1773851879.067450:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.29@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851879.067451:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:27.0:1773851879.067452:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.29@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851879.067453:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:27.0:1773851879.067454:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769630:8769630:1024:4294967295] 2094@kfi7 LPNI seq info [1258747008:1258747008:16:4294967295]
00000400:00000200:27.0:1773851879.067456:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:27.0:1773851879.067456:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:27.0:1773851879.067459:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.29@o2ib60(192.168.128.29@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851879.067460:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000002c2fcf8 nid 192.168.128.29@o2ib60 refs 3
00000800:00000200:27.0:1773851879.067462:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851879.067463:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851879.067465:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851879.067468:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:27.0:1773851879.067471:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:27.0:1773851879.067472:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851879.067474:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.067475:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3973035 refcount 2 to 192.168.128.29@o2ib60
00010000:00000001:27.0:1773851879.067476:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851879.067477:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.067477:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851879.067478:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f5e0fb06 x1859423763086720/t0(0) o400->21302aa0-e233-4eaa-ab68-cfd28a7997c5@192.168.128.29@o2ib60:129/0 lens 224/224 e 0 to 0 dl 1773852244 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix29-0'
00000100:00100000:27.0:1773851879.067481:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f5e0fb06 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:21302aa0-e233-4eaa-ab68-cfd28a7997c5+6:40037:x1859423763086720:12345-192.168.128.29@o2ib60:400:default-matrix29-0 Request processed in 72us (104us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851879.067483:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851879.067484:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.29@o2ib60, seq: 2025139
00000100:00000040:27.0:1773851879.067484:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047d5b6d0 : new rpc_count 1
00000400:00000200:25.0:1773851879.067484:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851879.067485:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851879.067485:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:27.0:1773851879.067486:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851879.067486:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851879.067486:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000435f583e
00000400:00000010:25.0:1773851879.067486:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000435f583e.
00000020:00000010:27.0:1773851879.067487:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000100:00000001:25.0:1773851879.067487:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851879.067487:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851879.067488:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000400:00000200:25.0:1773851879.067488:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000040:27.0:1773851879.067489:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000047d5b6d0 : new refcount 5
00000100:00000001:27.0:1773851879.067489:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851879.067489:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Transaction freed
00000800:00000200:17.0:1773851879.076182:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.076183:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851879.076185:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851879.076188:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851879.076192:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15315@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.076194:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15315@kfi7 : PUT - for me
00000400:00000200:17.0:1773851879.076196:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15315@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.076197:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 1
00000400:00000200:17.0:1773851879.076199:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15315@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.076200:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 2
00000400:00000200:17.0:1773851879.076201:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 3
00000400:00000200:17.0:1773851879.076203:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15314@kfi7 to cpt 1
00000400:00000200:17.0:1773851879.076204:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15314@kfi7 of length 224 into portal 12 MB=0x69a70f41377c0
00000400:00000200:17.0:1773851879.076207:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15314@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 28696
00000800:00000200:17.0:1773851879.076210:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851879.076213:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851879.076214:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15315@kfi7: PUT: OK
00000100:00000001:17.0:1773851879.076216:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851879.076217:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851879.076218:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007407633a.
00000100:00000040:17.0:1773851879.076219:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000007407633a x1858659782195136 msgsize 224
00000100:00100000:17.0:1773851879.076221:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15314@kfi7 (source: 12345-15315@kfi7)
00000100:00000001:17.0:1773851879.076224:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851879.076226:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 2
00000800:00000200:17.0:1773851879.076228:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851879.076232:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851879.076233:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851879.076234:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851879.076235:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851879.076236:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851879.076237:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858659782195136
00000020:00000001:17.0:1773851879.076238:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851879.076239:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f18
00000020:00000001:17.0:1773851879.076240:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851879.076243:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009261fdf7 refcount=6
00000020:00000001:17.0:1773851879.076244:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629019648 : -107123080531968 : ffff9e9276d67000)
00000020:00000001:17.0:1773851879.076245:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629019648 : -107123080531968 : ffff9e9276d67000)
00000100:00000001:17.0:1773851879.076246:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.076247:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851879.076248:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851879.076250:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851879.076251:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851879.076252:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851879.076253:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851879.076254:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.076256:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851879.076256:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851879.076257:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.076258:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.076260:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851879.076261:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851879.076261:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851879.076261:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851879.076263:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15314@kfi7, seq: 2156375
00000100:00000040:17.0:1773851879.076264:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009261fdf7 : new rpc_count 1
00000100:00000001:16.0:1773851879.076264:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.076265:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985330944 : -106952724220672 : ffff9eba20dd7500)
00000100:00000001:16.0:1773851879.076265:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851879.076267:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007407633a x1858659782195136/t0(0) o400->8b13f879-8ccf-43eb-80e1-a5b26e5dcddc@15314@kfi7:100/0 lens 224/0 e 0 to 0 dl 1773852215 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1445-0'
00000100:00000001:17.0:1773851879.076272:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.076273:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851879.076274:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007407633a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8b13f879-8ccf-43eb-80e1-a5b26e5dcddc+6:58060:x1858659782195136:12345-15314@kfi7:400:default-tuolumne1445-0
00000100:00000200:17.0:1773851879.076276:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858659782195136
00000020:00000001:17.0:1773851879.076277:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851879.076278:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851879.076279:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.076280:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851879.076281:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851879.076282:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851879.076283:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858659782195136, found 0 last_xid 1858659782195135
00000020:00000001:17.0:1773851879.076284:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851879.076285:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851879.076286:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851879.076287:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.076288:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851879.076289:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851879.076289:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851879.076290:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000093b89798.
02000000:00000001:17.0:1773851879.076292:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.076292:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.076293:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851879.076294:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044160474, transno 0, xid 1858659782195136
00010000:00000001:17.0:1773851879.076296:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851879.076297:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007407633a x1858659782195136/t0(0) o400->8b13f879-8ccf-43eb-80e1-a5b26e5dcddc@15314@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1445-0'
00010000:00000001:17.0:1773851879.076301:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851879.076302:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851879.076303:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=112 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851879.076305:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851879.076306:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007a7ae597 refcount 3 to 15314@kfi7
00000100:00000001:17.0:1773851879.076307:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327303552 : -107155382248064 : ffff9e8af1815d80)
02000000:00000001:17.0:1773851879.076309:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851879.076310:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.076311:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851879.076312:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15315@kfi7
00000400:00000010:17.0:1773851879.076313:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006a8bd081.
00000100:00000200:17.0:1773851879.076314:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858659782195136, offset 224
00000400:00000200:17.0:1773851879.076317:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15315@kfi7
00000400:00000200:17.0:1773851879.076318:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15315@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.076319:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 1
00000400:00000200:17.0:1773851879.076321:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 2
00000400:00000200:17.0:1773851879.076322:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 3
00000400:00000200:17.0:1773851879.076324:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15315@kfi7 local destination
00000400:00000200:17.0:1773851879.076326:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769631:8769631:1024:4294967295] 15315@kfi7 LPNI seq info [184538:184538:16:4294967295]
00000400:00000200:17.0:1773851879.076329:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 2
00000400:00000200:17.0:1773851879.076330:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15315@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.076333:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15315@kfi7(15315@kfi7:15315@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851879.076335:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 3
00000800:00000200:17.0:1773851879.076337:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.076339:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851879.076342:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851879.076346:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa31 Using peer 15315@kfi7(0xa31)
00000800:00000200:17.0:1773851879.076350:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0xa31: rc=0
00000800:00000200:17.0:1773851879.076353:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa31 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851879.076356:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851879.076357:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007a7ae597 refcount 2 to 15314@kfi7
00010000:00000001:17.0:1773851879.076358:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851879.076359:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.076361:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851879.076362:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007407633a x1858659782195136/t0(0) o400->8b13f879-8ccf-43eb-80e1-a5b26e5dcddc@15314@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1445-0'
00000100:00100000:17.0:1773851879.076367:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007407633a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8b13f879-8ccf-43eb-80e1-a5b26e5dcddc+6:58060:x1858659782195136:12345-15314@kfi7:400:default-tuolumne1445-0 Request processed in 94us (147us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851879.076368:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa31 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851879.076370:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:17.0:1773851879.076371:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15314@kfi7, seq: 2156375
00000400:00000200:18.0:1773851879.076372:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15315@kfi7: PUT: OK
00000100:00000040:17.0:1773851879.076372:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009261fdf7 : new rpc_count 0
00000100:00000001:17.0:1773851879.076373:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851879.076374:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006a8bd081
00000400:00000010:18.0:1773851879.076374:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006a8bd081.
00000100:00000001:17.0:1773851879.076374:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851879.076375:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000100:00000001:18.0:1773851879.076376:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:17.0:1773851879.076376:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000100:00000001:18.0:1773851879.076377:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:17.0:1773851879.076377:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000400:00000200:18.0:1773851879.076378:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000052d6cbb9 nid 15315@kfi7 refs 2
00000020:00000040:17.0:1773851879.076379:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000009261fdf7 : new refcount 5
00000800:00000200:18.0:1773851879.076380:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 15315@kfi7(000000001e8aca5d):0x0 lsk 2610 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa31 Transaction freed
00000100:00000001:17.0:1773851879.076380:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851879.169509:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851879.169510:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851879.169512:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851879.169515:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851879.169518:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21490@kfi7 to cpt 1
00000400:00000200:5.0:1773851879.169520:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21490@kfi7 : PUT - for me
00000400:00000200:5.0:1773851879.169521:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21490@kfi7 to cpt 1
00000400:00000200:5.0:1773851879.169522:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c24e234 nid 21490@kfi7 refs 1
00000400:00000200:5.0:1773851879.169524:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21490@kfi7 to cpt 1
00000400:00000200:5.0:1773851879.169525:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c24e234 nid 21490@kfi7 refs 2
00000400:00000200:5.0:1773851879.169526:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c24e234 nid 21490@kfi7 refs 3
00000400:00000200:5.0:1773851879.169528:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21298@kfi7 to cpt 7
00000400:00000200:5.0:1773851879.169529:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21298@kfi7 of length 224 into portal 12 MB=0x69b094f2a41c0
00000400:00000200:5.0:1773851879.169531:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21298@kfi7 of length 224/224 into md 0x793926dc5 [64] + 151416
00000800:00000200:5.0:1773851879.169534:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851879.169537:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851879.169538:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21490@kfi7: PUT: OK
00000100:00000001:5.0:1773851879.169539:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851879.169540:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851879.169542:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000093e3ddf1.
00000100:00000040:5.0:1773851879.169543:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000093e3ddf1 x1859314145444288 msgsize 224
00000100:00100000:5.0:1773851879.169545:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-21298@kfi7 (source: 12345-21490@kfi7)
00000100:00000001:5.0:1773851879.169546:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851879.169548:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c24e234 nid 21490@kfi7 refs 2
00000100:00000001:4.0:1773851879.169549:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851879.169550:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851879.169550:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851879.169551:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851879.169551:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851879.169553:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851879.169554:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314145444288
00000020:00000001:4.0:1773851879.169555:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851879.169556:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91540
00000020:00000001:4.0:1773851879.169557:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851879.169559:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000655f3fbe refcount=8
00000020:00000001:4.0:1773851879.169560:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241035776 : -107152468515840 : ffff9e8b9f2d6400)
00000020:00000001:4.0:1773851879.169561:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241035776 : -107152468515840 : ffff9e8b9f2d6400)
00000100:00000001:4.0:1773851879.169563:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851879.169565:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851879.169567:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000983d7486.
00000020:00000010:4.0:1773851879.169568:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851879.169570:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000febcce7f.
00000100:00000001:4.0:1773851879.169571:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851879.169572:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851879.169573:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.169575:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851879.169575:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851879.169576:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.169578:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851879.169580:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851879.169580:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851879.169581:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851879.169581:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851879.169582:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21298@kfi7, seq: 2001947
00000100:00000001:7.0:1773851879.169584:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851879.169584:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000655f3fbe : new rpc_count 1
00000100:00000001:7.0:1773851879.169585:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.169585:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108959232 : -106938600592384 : ffff9ebd6ab2ec00)
00000100:00000040:4.0:1773851879.169587:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000093e3ddf1 x1859314145444288/t0(0) o400->c1c4f2cd-e658-456b-afdb-87dd18c12ba6@21298@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1817-0'
00000100:00000001:4.0:1773851879.169592:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851879.169592:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851879.169594:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093e3ddf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c1c4f2cd-e658-456b-afdb-87dd18c12ba6+8:39551:x1859314145444288:12345-21298@kfi7:400:default-tuolumne1817-0
00000100:00000200:4.0:1773851879.169596:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314145444288
00000020:00000001:4.0:1773851879.169597:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851879.169598:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851879.169599:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.169600:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851879.169601:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851879.169602:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851879.169603:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314145444288, found 0 last_xid 1859314145444287
00000020:00000001:4.0:1773851879.169604:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851879.169605:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851879.169606:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851879.169607:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.169609:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851879.169610:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851879.169611:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851879.169612:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dc5155ae.
02000000:00000001:4.0:1773851879.169613:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.169614:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.169615:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851879.169616:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044152728, transno 0, xid 1859314145444288
00010000:00000001:4.0:1773851879.169617:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851879.169619:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000093e3ddf1 x1859314145444288/t0(0) o400->c1c4f2cd-e658-456b-afdb-87dd18c12ba6@21298@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1817-0'
00010000:00000001:4.0:1773851879.169623:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851879.169624:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851879.169625:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=111 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851879.169626:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851879.169627:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d4e5afc1 refcount 3 to 21298@kfi7
00000100:00000001:4.0:1773851879.169629:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270720 : -107152618280896 : ffff9e8b96402840)
02000000:00000001:4.0:1773851879.169630:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851879.169631:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.169632:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851879.169633:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21490@kfi7
00000400:00000010:4.0:1773851879.169634:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000092a2acd5.
00000100:00000200:4.0:1773851879.169636:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314145444288, offset 224
00000400:00000200:4.0:1773851879.169638:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21490@kfi7
00000400:00000200:4.0:1773851879.169639:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21490@kfi7 to cpt 1
00000400:00000200:4.0:1773851879.169641:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c24e234 nid 21490@kfi7 refs 1
00000400:00000200:4.0:1773851879.169642:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c24e234 nid 21490@kfi7 refs 2
00000400:00000200:4.0:1773851879.169644:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c24e234 nid 21490@kfi7 refs 3
00000400:00000200:4.0:1773851879.169646:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21490@kfi7 local destination
00000400:00000200:4.0:1773851879.169648:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769632:8769632:1024:4294967295] 21490@kfi7 LPNI seq info [197384:197384:16:4294967295]
00000400:00000200:4.0:1773851879.169651:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c24e234 nid 21490@kfi7 refs 2
00000400:00000200:4.0:1773851879.169652:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21490@kfi7 to cpt 1
00000400:00000200:4.0:1773851879.169655:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21490@kfi7(21490@kfi7:21490@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851879.169658:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c24e234 nid 21490@kfi7 refs 3
00000800:00000200:4.0:1773851879.169660:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851879.169662:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851879.169665:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851879.169669:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xbda Using peer 21490@kfi7(0xbda)
00000800:00000200:4.0:1773851879.169674:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0xbda: rc=0
00000800:00000200:4.0:1773851879.169676:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xbda TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851879.169680:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851879.169681:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d4e5afc1 refcount 2 to 21298@kfi7
00010000:00000001:4.0:1773851879.169682:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851879.169685:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.169686:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851879.169687:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000093e3ddf1 x1859314145444288/t0(0) o400->c1c4f2cd-e658-456b-afdb-87dd18c12ba6@21298@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1817-0'
00000100:00100000:4.0:1773851879.169693:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093e3ddf1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c1c4f2cd-e658-456b-afdb-87dd18c12ba6+8:39551:x1859314145444288:12345-21298@kfi7:400:default-tuolumne1817-0 Request processed in 100us (149us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851879.169697:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21298@kfi7, seq: 2001947
00000100:00000040:4.0:1773851879.169698:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000655f3fbe : new rpc_count 0
00000100:00000001:4.0:1773851879.169699:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851879.169700:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851879.169701:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851879.169702:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000febcce7f.
00000020:00000010:4.0:1773851879.169704:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000983d7486.
00000020:00000040:4.0:1773851879.169705:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000655f3fbe : new refcount 7
00000100:00000001:4.0:1773851879.169706:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851879.169714:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xbda TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851879.169716:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851879.169718:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21490@kfi7: PUT: OK
00000400:00000200:5.0:1773851879.169719:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000092a2acd5
00000400:00000010:5.0:1773851879.169720:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000092a2acd5.
00000100:00000001:5.0:1773851879.169721:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851879.169722:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851879.169723:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c24e234 nid 21490@kfi7 refs 2
00000800:00000200:5.0:1773851879.169733:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 21490@kfi7(00000000c81a24a8):0x0 lsk 3035 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xbda Transaction freed
00080000:00000001:30.0:1773851879.172426:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851879.172429:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851879.172477:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851879.172478:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851879.172526:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851879.172527:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851879.172575:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851879.172576:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851879.172880:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 000000005711a3d9 (tot 253201027).
00000400:00000010:30.0:1773851879.172883:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 000000005711a3d9 (tot 253200771).
00000800:00000200:31.0:1773851879.223185:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851879.223187:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851879.223189:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851879.223191:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851879.223194:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20819@kfi7 to cpt 7
00000400:00000200:31.0:1773851879.223195:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20819@kfi7 : PUT - for me
00000400:00000200:31.0:1773851879.223196:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20819@kfi7 to cpt 7
00000400:00000200:31.0:1773851879.223197:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002bd7a49b nid 20819@kfi7 refs 1
00000400:00000200:31.0:1773851879.223199:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20819@kfi7 to cpt 7
00000400:00000200:31.0:1773851879.223199:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002bd7a49b nid 20819@kfi7 refs 2
00000400:00000200:31.0:1773851879.223200:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002bd7a49b nid 20819@kfi7 refs 3
00000400:00000200:31.0:1773851879.223201:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20883@kfi7 to cpt 2
00000400:00000200:31.0:1773851879.223203:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20883@kfi7 of length 224 into portal 12 MB=0x69b16ec481780
00000400:00000200:31.0:1773851879.223204:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20883@kfi7 of length 224/224 into md 0x77fe139dd [64] + 189032
00000800:00000200:31.0:1773851879.223206:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851879.223208:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851879.223209:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20819@kfi7: PUT: OK
00000100:00000001:31.0:1773851879.223210:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851879.223211:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851879.223212:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000055bd4bee.
00000100:00000040:31.0:1773851879.223212:0:2465875:0:(events.c:358:request_in_callback()) incoming req@0000000055bd4bee x1859372615997312 msgsize 224
00000100:00100000:31.0:1773851879.223214:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-20883@kfi7 (source: 12345-20819@kfi7)
00000100:00000001:31.0:1773851879.223215:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851879.223216:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002bd7a49b nid 20819@kfi7 refs 2
00000100:00000001:28.0:1773851879.223216:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:31.0:1773851879.223217:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b43813d: 2054@kfi7:7 <- 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851879.223217:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851879.223217:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851879.223218:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851879.223218:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851879.223219:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372615997312
00000020:00000001:28.0:1773851879.223220:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851879.223220:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae827d9
00000020:00000001:28.0:1773851879.223221:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851879.223223:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000e5ee4e6 refcount=5
00000020:00000001:28.0:1773851879.223224:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944755895296 : -107128953656320 : ffff9e9118c5ac00)
00000020:00000001:28.0:1773851879.223225:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944755895296 : -107128953656320 : ffff9e9118c5ac00)
00000100:00000001:28.0:1773851879.223226:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851879.223226:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851879.223227:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851879.223228:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851879.223229:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851879.223230:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851879.223230:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851879.223230:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851879.223232:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851879.223232:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851879.223233:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851879.223234:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851879.223235:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851879.223235:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851879.223236:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851879.223236:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851879.223237:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20883@kfi7, seq: 2055552
00000100:00000001:30.0:1773851879.223238:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851879.223238:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000e5ee4e6 : new rpc_count 1
00000100:00000001:28.0:1773851879.223238:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637034999065856 : -107038710485760 : ffff9ea61baf2d00)
00000100:00000001:30.0:1773851879.223239:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851879.223239:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000055bd4bee x1859372615997312/t0(0) o400->c48f5630-b7b7-4757-88b2-608d62016f8d@20883@kfi7:667/0 lens 224/0 e 0 to 0 dl 1773852027 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1798-0'
00000100:00000001:28.0:1773851879.223242:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851879.223243:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851879.223244:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055bd4bee pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c48f5630-b7b7-4757-88b2-608d62016f8d+5:39741:x1859372615997312:12345-20883@kfi7:400:default-tuolumne1798-0
00000100:00000200:28.0:1773851879.223246:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372615997312
00000020:00000001:28.0:1773851879.223246:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851879.223247:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851879.223248:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.223248:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851879.223249:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851879.223250:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851879.223250:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372615997312, found 0 last_xid 1859372615997311
00000020:00000001:28.0:1773851879.223251:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851879.223252:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851879.223252:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851879.223253:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.223253:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851879.223254:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851879.223255:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851879.223255:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d9820241.
02000000:00000001:28.0:1773851879.223256:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851879.223257:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.223258:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851879.223258:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044159408, transno 0, xid 1859372615997312
00010000:00000001:28.0:1773851879.223259:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851879.223260:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000055bd4bee x1859372615997312/t0(0) o400->c48f5630-b7b7-4757-88b2-608d62016f8d@20883@kfi7:667/0 lens 224/224 e 0 to 0 dl 1773852027 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1798-0'
00010000:00000001:28.0:1773851879.223262:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851879.223263:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851879.223263:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=112 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851879.223265:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851879.223265:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009eb5bf3c refcount 3 to 20883@kfi7
00000100:00000001:28.0:1773851879.223266:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526775008 : -107156182776608 : ffff9e8ac1ca44e0)
02000000:00000001:28.0:1773851879.223267:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851879.223268:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851879.223268:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851879.223270:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20819@kfi7
00000400:00000010:28.0:1773851879.223270:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eed4dfca.
00000100:00000200:28.0:1773851879.223271:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372615997312, offset 224
00000400:00000200:28.0:1773851879.223272:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20819@kfi7
00000400:00000200:28.0:1773851879.223273:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20819@kfi7 to cpt 7
00000400:00000200:28.0:1773851879.223274:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002bd7a49b nid 20819@kfi7 refs 1
00000400:00000200:28.0:1773851879.223275:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002bd7a49b nid 20819@kfi7 refs 2
00000400:00000200:28.0:1773851879.223276:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002bd7a49b nid 20819@kfi7 refs 3
00000400:00000200:28.0:1773851879.223277:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20819@kfi7 local destination
00000400:00000200:28.0:1773851879.223278:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769633:8769633:1024:4294967295] 20819@kfi7 LPNI seq info [106417:106417:16:4294967295]
00000400:00000200:28.0:1773851879.223280:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002bd7a49b nid 20819@kfi7 refs 2
00000400:00000200:28.0:1773851879.223281:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20819@kfi7 to cpt 7
00000400:00000200:28.0:1773851879.223282:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20819@kfi7(20819@kfi7:20819@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851879.223284:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002bd7a49b nid 20819@kfi7 refs 3
00000800:00000200:28.0:1773851879.223285:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851879.223286:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851879.223289:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851879.223291:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dad Using peer 20819@kfi7(0x100000000000dad)
00000800:00000200:28.0:1773851879.223294:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x100000000000dad: rc=0
00000800:00000200:28.0:1773851879.223295:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851879.223298:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851879.223299:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009eb5bf3c refcount 2 to 20883@kfi7
00010000:00000001:28.0:1773851879.223299:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851879.223300:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.223301:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851879.223301:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000055bd4bee x1859372615997312/t0(0) o400->c48f5630-b7b7-4757-88b2-608d62016f8d@20883@kfi7:667/0 lens 224/224 e 0 to 0 dl 1773852027 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1798-0'
00000100:00100000:28.0:1773851879.223309:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055bd4bee pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c48f5630-b7b7-4757-88b2-608d62016f8d+5:39741:x1859372615997312:12345-20883@kfi7:400:default-tuolumne1798-0 Request processed in 66us (96us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851879.223312:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20883@kfi7, seq: 2055552
00000100:00000040:28.0:1773851879.223313:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000e5ee4e6 : new rpc_count 0
00000100:00000001:28.0:1773851879.223313:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851879.223314:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851879.223315:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851879.223315:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851879.223316:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851879.223317:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000000e5ee4e6 : new refcount 4
00000100:00000001:28.0:1773851879.223318:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851879.223323:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dad TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851879.223325:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851879.223327:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20819@kfi7: PUT: OK
00000400:00000200:30.0:1773851879.223328:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eed4dfca
00000400:00000010:30.0:1773851879.223328:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eed4dfca.
00000100:00000001:30.0:1773851879.223329:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851879.223330:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851879.223331:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002bd7a49b nid 20819@kfi7 refs 2
00000800:00000200:30.0:1773851879.223333:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 20819@kfi7(00000000ac03d518):0x0 lsk 3502 rsk 15 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dad Transaction freed
00000800:00000200:22.0:1773851879.224967:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851879.224967:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851879.224968:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851879.224968:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851879.224969:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851879.224969:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851879.224970:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8608@kfi7(000000001a2f74f1):0x2b6 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851879.224971:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851879.224972:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 Using peer 8608@kfi7(0x2b6)
00000400:00000200:22.0:1773851879.224974:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8608@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.224974:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8608@kfi7 to cpt 5
00000400:00000200:22.0:1773851879.224975:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8608@kfi7 : PUT - for me
00000400:00000200:22.0:1773851879.224976:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8608@kfi7 to cpt 5
00000400:00000200:22.0:1773851879.224977:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d94c0b63 nid 8608@kfi7 refs 1
00000800:00000200:21.0:1773851879.224977:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0x2b6: rc=0
00000800:00000200:21.0:1773851879.224978:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851879.224979:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8608@kfi7 to cpt 5
00000400:00000200:22.0:1773851879.224979:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d94c0b63 nid 8608@kfi7 refs 2
00000400:00000200:22.0:1773851879.224980:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d94c0b63 nid 8608@kfi7 refs 3
00000400:00000200:22.0:1773851879.224981:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8545@kfi7 to cpt 5
00000400:00000200:22.0:1773851879.224982:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8545@kfi7 of length 224 into portal 12 MB=0x69b17188d7800
00000400:00000200:22.0:1773851879.224984:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8545@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 48784
00000800:00000200:22.0:1773851879.224986:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851879.224988:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851879.224989:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8608@kfi7: PUT: OK
00000100:00000001:22.0:1773851879.224990:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:21.0:1773851879.224990:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 TN_EVENT_TX_OK event status 0
00000100:00000200:22.0:1773851879.224991:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851879.224992:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cde48072.
00000100:00000040:22.0:1773851879.224992:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000cde48072 x1859373358741504 msgsize 224
00000800:00000200:21.0:1773851879.224993:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 Transaction freed
00000100:00100000:22.0:1773851879.224994:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-8545@kfi7 (source: 12345-8608@kfi7)
00000100:00000001:22.0:1773851879.224995:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851879.224996:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d94c0b63 nid 8608@kfi7 refs 2
00000100:00000001:23.0:1773851879.224997:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851879.224997:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851879.224998:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851879.224998:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851879.224998:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851879.224999:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851879.225000:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373358741504
00000020:00000001:23.0:1773851879.225000:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851879.225001:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92084
00000020:00000001:23.0:1773851879.225002:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851879.225006:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001f312555 refcount=10
00000020:00000001:23.0:1773851879.225007:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629498880 : -107123080052736 : ffff9e9276ddc000)
00000020:00000001:23.0:1773851879.225008:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629498880 : -107123080052736 : ffff9e9276ddc000)
00000100:00000001:23.0:1773851879.225009:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851879.225009:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851879.225010:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000023d189b5.
00000020:00000010:23.0:1773851879.225011:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851879.225012:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851879.225013:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851879.225013:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851879.225014:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851879.225015:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851879.225015:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851879.225016:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851879.225017:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851879.225018:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851879.225018:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851879.225019:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851879.225019:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851879.225020:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8545@kfi7, seq: 1998016
00000100:00000001:23.0:1773851879.225021:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851879.225021:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851879.225021:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001f312555 : new rpc_count 2
00000100:00000001:20.0:1773851879.225021:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382178560 : -106946327373056 : ffff9ebb9e259b00)
00000100:00000040:20.0:1773851879.225023:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cde48072 x1859373358741504/t0(0) o400->26b3f2f0-ef6a-4f00-baec-59b67c89eb48@8545@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1024-0'
00000100:00000001:20.0:1773851879.225029:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851879.225029:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851879.225030:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cde48072 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:26b3f2f0-ef6a-4f00-baec-59b67c89eb48+10:39712:x1859373358741504:12345-8545@kfi7:400:default-tuolumne1024-0
00000100:00000200:20.0:1773851879.225032:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373358741504
00000020:00000001:20.0:1773851879.225032:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851879.225033:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851879.225034:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.225035:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851879.225035:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851879.225036:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851879.225037:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373358741504, found 0 last_xid 1859373358356287
00000020:00000001:20.0:1773851879.225037:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851879.225038:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851879.225039:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851879.225040:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.225040:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851879.225041:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851879.225042:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851879.225042:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006d120ec0.
02000000:00000001:20.0:1773851879.225043:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.225044:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.225044:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851879.225045:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183061363559, transno 0, xid 1859373358741504
00010000:00000001:20.0:1773851879.225046:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851879.225047:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cde48072 x1859373358741504/t0(0) o400->26b3f2f0-ef6a-4f00-baec-59b67c89eb48@8545@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1024-0'
00010000:00000001:20.0:1773851879.225049:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851879.225050:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851879.225051:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=112 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851879.225052:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851879.225053:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f2d3722b refcount 3 to 8545@kfi7
00000100:00000001:20.0:1773851879.225054:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452000 : -107146752099616 : ffff9e8cf3e6fae0)
02000000:00000001:20.0:1773851879.225055:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851879.225056:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.225056:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851879.225057:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8608@kfi7
00000400:00000010:20.0:1773851879.225058:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003cda9dd5.
00000100:00000200:20.0:1773851879.225059:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373358741504, offset 224
00000400:00000200:20.0:1773851879.225060:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8608@kfi7
00000400:00000200:20.0:1773851879.225061:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8608@kfi7 to cpt 5
00000400:00000200:20.0:1773851879.225062:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d94c0b63 nid 8608@kfi7 refs 1
00000400:00000200:20.0:1773851879.225063:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d94c0b63 nid 8608@kfi7 refs 2
00000400:00000200:20.0:1773851879.225064:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d94c0b63 nid 8608@kfi7 refs 3
00000400:00000200:20.0:1773851879.225065:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8608@kfi7 local destination
00000400:00000200:20.0:1773851879.225067:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769634:8769634:1024:4294967295] 8608@kfi7 LPNI seq info [3433606:3433606:16:4294967295]
00000400:00000200:20.0:1773851879.225068:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d94c0b63 nid 8608@kfi7 refs 2
00000400:00000200:20.0:1773851879.225069:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8608@kfi7 to cpt 5
00000400:00000200:20.0:1773851879.225071:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8608@kfi7(8608@kfi7:8608@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851879.225072:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d94c0b63 nid 8608@kfi7 refs 3
00000800:00000200:20.0:1773851879.225073:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851879.225075:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851879.225077:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851879.225079:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 Using peer 8608@kfi7(0x2b6)
00000800:00000200:20.0:1773851879.225082:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x2b6: rc=0
00000800:00000200:20.0:1773851879.225084:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851879.225086:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851879.225087:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f2d3722b refcount 2 to 8545@kfi7
00010000:00000001:20.0:1773851879.225088:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851879.225088:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.225090:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851879.225093:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cde48072 x1859373358741504/t0(0) o400->26b3f2f0-ef6a-4f00-baec-59b67c89eb48@8545@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1024-0'
00000100:00100000:20.0:1773851879.225096:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cde48072 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:26b3f2f0-ef6a-4f00-baec-59b67c89eb48+10:39712:x1859373358741504:12345-8545@kfi7:400:default-tuolumne1024-0 Request processed in 66us (103us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851879.225099:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8545@kfi7, seq: 1998016
00000100:00000040:20.0:1773851879.225100:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001f312555 : new rpc_count 1
00000100:00000001:20.0:1773851879.225101:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851879.225101:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851879.225102:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851879.225103:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:20.0:1773851879.225104:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000023d189b5.
00000020:00000040:20.0:1773851879.225105:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000001f312555 : new refcount 9
00000100:00000001:20.0:1773851879.225105:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851879.225110:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851879.225112:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851879.225113:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8608@kfi7: PUT: OK
00000400:00000200:21.0:1773851879.225113:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003cda9dd5
00000400:00000010:21.0:1773851879.225114:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003cda9dd5.
00000100:00000001:21.0:1773851879.225114:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851879.225115:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851879.225115:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d94c0b63 nid 8608@kfi7 refs 2
00000800:00000200:21.0:1773851879.225117:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 8608@kfi7(000000001a2f74f1):0x0 lsk 695 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x2b6 Transaction freed
00000800:00000200:25.0:1773851879.241638:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851879.241639:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851879.241640:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851879.241642:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851879.241644:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17905@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.241645:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17905@kfi7 : PUT - for me
00000400:00000200:25.0:1773851879.241646:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17905@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.241647:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6bf5274 nid 17905@kfi7 refs 1
00000400:00000200:25.0:1773851879.241647:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17905@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.241648:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6bf5274 nid 17905@kfi7 refs 2
00000400:00000200:25.0:1773851879.241649:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6bf5274 nid 17905@kfi7 refs 3
00000400:00000200:25.0:1773851879.241650:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17713@kfi7 to cpt 4
00000400:00000200:25.0:1773851879.241651:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17713@kfi7 of length 224 into portal 12 MB=0x69b4bbe4e1d40
00000400:00000200:25.0:1773851879.241652:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17713@kfi7 of length 224/224 into md 0x16159c9699 [64] + 25696
00000800:00000200:25.0:1773851879.241653:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851879.241655:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851879.241666:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17905@kfi7: PUT: OK
00000100:00000001:25.0:1773851879.241667:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851879.241668:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851879.241669:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f82600f9.
00000100:00000040:25.0:1773851879.241670:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000f82600f9 x1859599477906752 msgsize 224
00000100:00100000:25.0:1773851879.241671:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17713@kfi7 (source: 12345-17905@kfi7)
00000100:00000001:25.0:1773851879.241672:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851879.241673:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6bf5274 nid 17905@kfi7 refs 2
00000100:00000001:27.0:1773851879.241674:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851879.241674:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851879.241674:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851879.241675:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851879.241675:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851879.241676:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851879.241677:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599477906752
00000020:00000001:27.0:1773851879.241678:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851879.241678:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f7f8
00000020:00000001:27.0:1773851879.241679:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851879.241680:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000d2a6238 refcount=5
00000020:00000001:27.0:1773851879.241681:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637050128735232 : -107023580816384 : ffff9ea9a17b9c00)
00000020:00000001:27.0:1773851879.241682:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637050128735232 : -107023580816384 : ffff9ea9a17b9c00)
00000100:00000001:27.0:1773851879.241683:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.241683:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851879.241684:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851879.241685:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851879.241686:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851879.241687:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851879.241687:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851879.241687:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.241688:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851879.241689:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851879.241689:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.241690:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.241691:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851879.241691:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851879.241692:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851879.241692:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851879.241693:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17713@kfi7, seq: 2025140
00000100:00000040:27.0:1773851879.241693:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000d2a6238 : new rpc_count 1
00000100:00000001:26.0:1773851879.241693:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.241694:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252469632 : -106967457081984 : ffff9eb6b2b7d580)
00000100:00000001:26.0:1773851879.241694:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.241695:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f82600f9 x1859599477906752/t0(0) o400->39a98642-cad8-4a1b-85e3-f04806feb560@17713@kfi7:129/0 lens 224/0 e 0 to 0 dl 1773852244 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1597-0'
00000100:00000001:27.0:1773851879.241698:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.241698:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851879.241699:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f82600f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:39a98642-cad8-4a1b-85e3-f04806feb560+5:39506:x1859599477906752:12345-17713@kfi7:400:default-tuolumne1597-0
00000100:00000200:27.0:1773851879.241700:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599477906752
00000020:00000001:27.0:1773851879.241701:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851879.241702:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851879.241703:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.241703:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851879.241704:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851879.241705:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851879.241705:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599477906752, found 0 last_xid 1859599477906751
00000020:00000001:27.0:1773851879.241706:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851879.241707:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851879.241707:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851879.241707:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.241708:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851879.241709:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851879.241709:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851879.241710:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000019de93b8.
02000000:00000001:27.0:1773851879.241711:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.241711:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.241712:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851879.241713:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597596, transno 0, xid 1859599477906752
00010000:00000001:27.0:1773851879.241713:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851879.241714:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f82600f9 x1859599477906752/t0(0) o400->39a98642-cad8-4a1b-85e3-f04806feb560@17713@kfi7:129/0 lens 224/224 e 0 to 0 dl 1773852244 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1597-0'
00010000:00000001:27.0:1773851879.241717:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851879.241717:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851879.241718:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=112 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851879.241719:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851879.241720:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005c36e0f0 refcount 3 to 17713@kfi7
00000100:00000001:27.0:1773851879.241720:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095776800 : -107152613774816 : ffff9e8b9684ea20)
02000000:00000001:27.0:1773851879.241721:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851879.241722:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.241722:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851879.241723:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17905@kfi7
00000400:00000010:27.0:1773851879.241723:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000492f3438.
00000100:00000200:27.0:1773851879.241724:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599477906752, offset 224
00000004:00000001:11.0:1773851879.241730:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851879.241730:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000400:00000200:27.0:1773851879.241731:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17905@kfi7
00000400:00000200:27.0:1773851879.241731:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17905@kfi7 to cpt 6
00000004:00000001:15.0:1773851879.241731:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851879.241731:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851879.241731:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007391cc99.
00000004:00000020:10.0:1773851879.241731:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851879.241731:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004139ca59.
00000004:00000020:15.0:1773851879.241732:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:15.0:1773851879.241732:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000391be4bf.
00000020:00000040:11.0:1773851879.241732:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000020:00000040:10.0:1773851879.241732:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000004:00000001:3.0:1773851879.241732:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000400:00000200:27.0:1773851879.241733:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6bf5274 nid 17905@kfi7 refs 1
00000400:00000200:27.0:1773851879.241733:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6bf5274 nid 17905@kfi7 refs 2
00000020:00000040:15.0:1773851879.241733:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:11.0:1773851879.241733:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851879.241733:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:3.0:1773851879.241733:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:3.0:1773851879.241733:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000090b676d7.
00000100:00000001:15.0:1773851879.241734:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851879.241734:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851879.241734:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851879.241734:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:3.0:1773851879.241734:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000400:00000200:27.0:1773851879.241735:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6bf5274 nid 17905@kfi7 refs 3
02000000:00000001:15.0:1773851879.241735:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:11.0:1773851879.241735:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003b54e2de.
02000000:00000001:10.0:1773851879.241735:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851879.241735:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004dd7265c.
00000100:00000001:3.0:1773851879.241735:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:3.0:1773851879.241735:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000400:00000200:27.0:1773851879.241736:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17905@kfi7 local destination
02000000:00000001:15.0:1773851879.241736:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851879.241736:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851879.241736:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851879.241736:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851879.241737:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769635:8769635:1024:4294967295] 17905@kfi7 LPNI seq info [18918562:18918562:16:4294967295]
02000000:00000010:15.0:1773851879.241737:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000bfa9c3a9.
00000100:00000001:11.0:1773851879.241737:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851879.241737:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851879.241738:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851879.241738:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851879.241738:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e8a43341.
00000400:00000200:27.0:1773851879.241739:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6bf5274 nid 17905@kfi7 refs 2
00000400:00000200:27.0:1773851879.241739:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17905@kfi7 to cpt 6
00000100:00000001:15.0:1773851879.241739:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851879.241739:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007391cc99] to pc [ptlrpcd_02_03+3]  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851879.241739:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004139ca59] to pc [ptlrpcd_02_02+2]  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851879.241739:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.241740:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851879.241740:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851879.241740:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851879.241741:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17905@kfi7(17905@kfi7:17905@kfi7) <?> : PUT try# 0
00000100:00000001:15.0:1773851879.241741:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851879.241742:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6bf5274 nid 17905@kfi7 refs 3
00000100:00000040:15.0:1773851879.241742:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000391be4bf] to pc [ptlrpcd_03_03+3]  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851879.241742:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851879.241742:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:3.0:1773851879.241742:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000090b676d7] to pc [ptlrpcd_00_01+1]  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:27.0:1773851879.241743:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00080000:00000010:11.0:1773851879.241743:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008d4d2444.
00080000:00000010:10.0:1773851879.241743:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000030215ab3.
00000100:00000001:9.0:1773851879.241743:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851879.241743:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851879.241744:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637094389172224 : -106979320379392 : ffff9eb3ef9c4800)
00080000:00000001:10.0:1773851879.241744:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637069136942080 : -107004572609536 : ffff9eae0e75d400)
00000100:00000001:9.0:1773851879.241744:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851879.241744:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851879.241744:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851879.241744:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000800:00000200:27.0:1773851879.241745:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00080000:00000001:11.0:1773851879.241745:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851879.241745:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:9.0:1773851879.241745:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851879.241745:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:15.0:1773851879.241746:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851879.241746:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851879.241746:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851879.241746:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00080000:00000001:3.0:1773851879.241746:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000800:00000200:27.0:1773851879.241747:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:14.0:1773851879.241747:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851879.241747:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:11.0:1773851879.241747:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00000010:11.0:1773851879.241747:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003ca21ec7.
00000004:00000010:10.0:1773851879.241747:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000000c181bd0.
00080000:00000010:3.0:1773851879.241747:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c5d70cdb.
00000100:00000001:2.0:1773851879.241747:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:15.0:1773851879.241748:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000002cb18dd9.
00000100:00000001:14.0:1773851879.241748:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851879.241748:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:11.0:1773851879.241748:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614153695023824ns, next at 614154695022892ns, rc = 0
00000004:00080000:10.0:1773851879.241748:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614153695023454ns, next at 614154695022432ns, rc = 0
00000100:00000001:8.0:1773851879.241748:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851879.241748:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851879.241748:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637143730353152 : -106929979198464 : ffff9ebf6c92f400)
00000100:00000001:2.0:1773851879.241748:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851879.241748:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851879.241748:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:27.0:1773851879.241749:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x318 Using peer 17905@kfi7(0x318)
00080000:00000001:15.0:1773851879.241749:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637117712578560 : -106955996973056 : ffff9eb95dcb3800)
00000100:00000001:14.0:1773851879.241749:0:41075:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:11.0:1773851879.241749:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851879.241749:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851879.241749:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851879.241749:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851879.241749:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:1.0:1773851879.241749:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851879.241750:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:14.0:1773851879.241750:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851879.241750:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851879.241750:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851879.241750:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851879.241750:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007391cc99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051932992:6@kfi7:13:default-yuba2-0
00080000:00000001:3.0:1773851879.241750:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851879.241750:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:15.0:1773851879.241751:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851879.241751:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:3.0:1773851879.241751:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000800:00000200:27.0:1773851879.241752:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x318: rc=0
00000004:00001000:15.0:1773851879.241752:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00000004:00000010:15.0:1773851879.241752:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000bba5ef0f.
00000100:00000001:8.0:1773851879.241752:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851879.241752:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000010:3.0:1773851879.241752:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c207bf94.
00000004:00080000:3.0:1773851879.241752:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614153695027942ns, next at 614154695026910ns, rc = 0
00000800:00000200:27.0:1773851879.241753:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x318 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000004:00080000:15.0:1773851879.241753:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614153695028884ns, next at 614154695027701ns, rc = 0
00000100:00000001:14.0:1773851879.241753:0:41075:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:8.0:1773851879.241753:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851879.241753:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:3.0:1773851879.241753:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:2.0:1773851879.241753:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851879.241753:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851879.241754:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:14.0:1773851879.241754:0:41075:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851879.241754:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000003d905b3e.
00080000:00000001:3.0:1773851879.241754:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851879.241754:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:27.0:1773851879.241755:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851879.241755:0:41075:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:14.0:1773851879.241755:0:41075:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851879.241755:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851879.241755:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851879.241755:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.241756:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005c36e0f0 refcount 2 to 17713@kfi7
00010000:00000001:27.0:1773851879.241756:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00080000:00000001:15.0:1773851879.241756:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851879.241756:0:41075:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000391be4bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051933184:54@kfi7:13:default-yuba2-0
00000400:00000200:8.0:1773851879.241756:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00100000:2.0:1773851879.241756:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000090b676d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051933120:2095@kfi7:13:default-yuba2-0
00000020:00000001:27.0:1773851879.241757:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.241757:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851879.241757:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000001:2.0:1773851879.241757:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000020:00000001:27.0:1773851879.241758:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000001:14.0:1773851879.241758:0:41075:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:8.0:1773851879.241758:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
02000000:00000001:2.0:1773851879.241758:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:27.0:1773851879.241759:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f82600f9 x1859599477906752/t0(0) o400->39a98642-cad8-4a1b-85e3-f04806feb560@17713@kfi7:129/0 lens 224/224 e 0 to 0 dl 1773852244 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1597-0'
02000000:00000001:14.0:1773851879.241759:0:41075:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:14.0:1773851879.241759:0:41075:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851879.241759:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051932992, portal 4
02000000:00000001:2.0:1773851879.241759:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851879.241759:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:14.0:1773851879.241760:0:41075:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:8.0:1773851879.241760:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851879.241760:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446608768 : -106937262942848 : ffff9ebdba6dd580)
02000000:00000010:2.0:1773851879.241760:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f82e5278.
00000100:00100000:27.0:1773851879.241761:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f82600f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:39a98642-cad8-4a1b-85e3-f04806feb560+5:39506:x1859599477906752:12345-17713@kfi7:400:default-tuolumne1597-0 Request processed in 63us (91us total) trans 0 rc 0/0
02000000:00000010:14.0:1773851879.241761:0:41075:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
00000100:00000001:9.0:1773851879.241761:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851879.241761:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851879.241761:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851879.241762:0:41075:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851879.241762:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:8.0:1773851879.241762:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851879.241762:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851879.241763:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
02000000:00000001:9.0:1773851879.241763:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:2.0:1773851879.241763:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000100:00100000:27.0:1773851879.241764:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17713@kfi7, seq: 2025140
00000400:00000010:14.0:1773851879.241764:0:41075:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000400:00000010:14.0:1773851879.241764:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000100:00100000:9.0:1773851879.241764:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004139ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051933056:31@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851879.241764:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:2.0:1773851879.241764:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8c1b5d.
00000100:00000040:27.0:1773851879.241765:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000d2a6238 : new rpc_count 0
00000100:00000001:9.0:1773851879.241765:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:8.0:1773851879.241765:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:8.0:1773851879.241765:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1f08bfb.
00000100:00000001:27.0:1773851879.241766:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851879.241766:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851879.241766:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x318 TN_EVENT_TX_OK event status 0
00000100:00000200:14.0:1773851879.241766:0:41075:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933184, portal 4
02000000:00000001:9.0:1773851879.241766:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:8.0:1773851879.241766:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051932992, offset 0
00000100:00000200:2.0:1773851879.241766:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933120, portal 4
00000020:00000010:27.0:1773851879.241767:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851879.241767:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851879.241767:0:41075:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:14.0:1773851879.241767:0:41075:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860224128 : -107049849327488 : ffff9ea383c1f080)
02000000:00000001:9.0:1773851879.241767:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851879.241767:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:8.0:1773851879.241767:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000100:00000001:2.0:1773851879.241767:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851879.241767:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288712832 : -106964420838784 : ffff9eb767b13a80)
00000020:00000010:27.0:1773851879.241768:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851879.241768:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000400:00000200:25.0:1773851879.241768:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17905@kfi7: PUT: OK
02000000:00000010:9.0:1773851879.241768:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006c07bf65.
00000020:00000040:27.0:1773851879.241769:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000000d2a6238 : new refcount 4
00000400:00000200:25.0:1773851879.241769:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000492f3438
00000400:00000010:25.0:1773851879.241769:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000492f3438.
00000100:00000040:14.0:1773851879.241769:0:41075:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851879.241769:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851879.241769:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000040:2.0:1773851879.241769:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851879.241770:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851879.241770:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851879.241770:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:8.0:1773851879.241770:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:8.0:1773851879.241770:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:25.0:1773851879.241771:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6bf5274 nid 17905@kfi7 refs 2
00000100:00000001:14.0:1773851879.241772:0:41075:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851879.241772:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:2.0:1773851879.241772:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000800:00000200:25.0:1773851879.241773:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 17905@kfi7(000000008716ec6e):0x0 lsk 793 rsk 18 tsk 0 trmk 0 tmk 0 trr 6 tta 0x318 Transaction freed
00000100:00000040:14.0:1773851879.241773:0:41075:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000200:8.0:1773851879.241773:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000010:14.0:1773851879.241774:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003941c87b.
00000100:00000040:2.0:1773851879.241774:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000010:2.0:1773851879.241774:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e8fe3b5d.
00000100:00000200:14.0:1773851879.241775:0:41075:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933184, offset 0
00000400:00000200:8.0:1773851879.241775:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769635, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769633, p:4294967295, g:4294967295, h:1000]
00000100:00000200:2.0:1773851879.241775:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933120, offset 0
00000400:00000200:14.0:1773851879.241777:0:41075:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:8.0:1773851879.241777:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:2.0:1773851879.241777:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:14.0:1773851879.241778:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851879.241778:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851879.241778:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851879.241779:0:41075:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:8.0:1773851879.241779:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:2.0:1773851879.241779:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:14.0:1773851879.241780:0:41075:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:8.0:1773851879.241780:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769636:8769636:1024:4294967295] 6@kfi7 LPNI seq info [5405033:5405033:16:4294967295]
00000400:00000200:14.0:1773851879.241781:0:41075:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851879.241781:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:2.0:1773851879.241781:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:8.0:1773851879.241782:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:14.0:1773851879.241783:0:41075:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:9.0:1773851879.241783:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:9.0:1773851879.241783:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000400:00000200:2.0:1773851879.241783:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000010:9.0:1773851879.241784:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027709c97.
00000400:00000200:2.0:1773851879.241784:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:14.0:1773851879.241785:0:41075:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769635, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769636, p:4294967295, g:4294967295, h:1000]
00000100:00000200:9.0:1773851879.241786:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933056, portal 4
00000400:00000200:2.0:1773851879.241786:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769635, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769636, p:4294967295, g:4294967295, h:1000]
00000400:00000200:14.0:1773851879.241787:0:41075:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:9.0:1773851879.241787:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851879.241787:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136770068608 : -106936939483008 : ffff9ebdcdb57080)
00000400:00000200:14.0:1773851879.241788:0:41075:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851879.241788:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:14.0:1773851879.241789:0:41075:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000100:00000040:9.0:1773851879.241789:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851879.241789:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:14.0:1773851879.241790:0:41075:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769637:8769637:1024:4294967295] 54@kfi7 LPNI seq info [5403924:5403924:16:4294967295]
00000400:00000200:2.0:1773851879.241790:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:14.0:1773851879.241792:0:41075:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:9.0:1773851879.241792:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:2.0:1773851879.241792:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769638:8769638:1024:4294967295] 2095@kfi7 LPNI seq info [5406045:5406045:16:4294967295]
00000400:00000200:14.0:1773851879.241793:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000040:9.0:1773851879.241793:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:9.0:1773851879.241793:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000635b52f2.
00000400:00000200:2.0:1773851879.241793:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000200:9.0:1773851879.241794:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933056, offset 0
00000400:00000200:2.0:1773851879.241794:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851879.241795:0:41075:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851879.241795:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000400:00000200:14.0:1773851879.241797:0:41075:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851879.241797:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:9.0:1773851879.241798:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:8.0:1773851879.241798:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851879.241798:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000800:00000200:14.0:1773851879.241799:0:41075:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851879.241799:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:9.0:1773851879.241800:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:8.0:1773851879.241800:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:2.0:1773851879.241800:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000800:00000200:14.0:1773851879.241801:0:41075:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851879.241802:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000800:00000200:8.0:1773851879.241802:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:2.0:1773851879.241802:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:14.0:1773851879.241803:0:41075:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851879.241803:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851879.241804:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769638, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769636, p:4294967295, g:4294967295, h:1000]
00000800:00000200:2.0:1773851879.241804:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851879.241806:0:41075:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b Using peer 54@kfi7(0x33b)
00000400:00000200:9.0:1773851879.241806:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:8.0:1773851879.241806:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851879.241806:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851879.241807:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851879.241808:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000800:00000200:14.0:1773851879.241809:0:41075:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ba933e94: Posted send of 324 bytes to peer 0x33b: rc=0
00000800:00000200:8.0:1773851879.241809:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000800:00000200:2.0:1773851879.241809:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000400:00000200:9.0:1773851879.241810:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769639:8769639:1023:4294967295] 31@kfi7 LPNI seq info [5403620:5403620:16:4294967295]
00000800:00000200:14.0:1773851879.241811:0:41075:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851879.241811:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:9.0:1773851879.241812:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:8.0:1773851879.241812:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000100:00000001:14.0:1773851879.241813:0:41075:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851879.241813:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851879.241813:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000009005aa0b: Posted send of 324 bytes to peer 0x5c0: rc=0
00000100:00000001:14.0:1773851879.241814:0:41075:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851879.241814:0:41075:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851879.241814:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851879.241815:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851879.241815:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000100:00000001:14.0:1773851879.241816:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851879.241816:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851879.241816:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851879.241817:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:9.0:1773851879.241817:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000100:00000001:8.0:1773851879.241817:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241817:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241817:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851879.241818:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851879.241818:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851879.241818:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851879.241818:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851879.241819:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851879.241819:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851879.241819:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:2.0:1773851879.241819:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851879.241820:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851879.241820:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851879.241820:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:2.0:1773851879.241820:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851879.241821:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851879.241821:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851879.241821:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851879.241822:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851879.241822:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851879.241822:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851879.241823:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851879.241823:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851879.241823:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851879.241823:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241824:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851879.241826:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851879.241826:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Using peer 31@kfi7(0x200000000000560)
00000800:00000200:1.0:1773851879.241826:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000400:00000200:15.0:1773851879.241828:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851879.241828:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851879.241829:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x200000000000560: rc=0
00000100:00000001:8.0:1773851879.241829:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851879.241829:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:15.0:1773851879.241830:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->54@kfi7: PUT: OK
00000800:00000200:10.0:1773851879.241830:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851879.241830:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851879.241830:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e8fe3b5d
00000400:00000200:15.0:1773851879.241831:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003941c87b
00000400:00000010:15.0:1773851879.241831:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003941c87b.
00000800:00000200:9.0:1773851879.241831:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000010:1.0:1773851879.241831:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e8fe3b5d.
00000100:00000001:15.0:1773851879.241832:0:2513974:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:10.0:1773851879.241832:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851879.241832:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:15.0:1773851879.241833:0:2513974:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851879.241833:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:9.0:1773851879.241833:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851879.241833:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851879.241834:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1f08bfb
00000100:00000001:9.0:1773851879.241834:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851879.241834:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851879.241835:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1f08bfb.
00000100:00000001:9.0:1773851879.241835:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.241836:0:2513974:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:10.0:1773851879.241836:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851879.241836:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851879.241836:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851879.241836:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851879.241837:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851879.241837:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000040:1.0:1773851879.241837:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:15.0:1773851879.241838:0:2513974:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851879.241838:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851879.241839:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851879.241839:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851879.241839:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.241840:0:2513974:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851879.241840:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851879.241840:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.241840:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.241841:0:2513974:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:1.0:1773851879.241841:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:15.0:1773851879.241842:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:10.0:1773851879.241842:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851879.241842:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:10.0:1773851879.241843:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:9.0:1773851879.241843:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_EVENT_TX_OK event status 0
00000800:00000200:15.0:1773851879.241844:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b Transaction freed
00000400:00000200:10.0:1773851879.241844:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:9.0:1773851879.241844:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:1.0:1773851879.241844:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000800:00000200:10.0:1773851879.241846:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Transaction freed
00000400:00000200:9.0:1773851879.241846:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000400:00000200:9.0:1773851879.241846:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000635b52f2
00000400:00000010:9.0:1773851879.241847:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000635b52f2.
00000100:00000001:9.0:1773851879.241847:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851879.241848:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851879.241851:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851879.241851:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851879.241854:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851879.241854:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851879.241855:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:9.0:1773851879.241856:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Transaction freed
00000800:00000200:13.0:1773851879.241859:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851879.241860:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851879.241861:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851879.241863:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851879.241864:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:1.0:1773851879.241865:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:13.0:1773851879.241866:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 54@kfi7 : PUT - for me
00000800:00000200:1.0:1773851879.241866:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851879.241867:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.241867:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000800:00000200:1.0:1773851879.241867:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851879.241868:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:13.0:1773851879.241868:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:29.0:1773851879.241869:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851879.241869:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000800:00000200:1.0:1773851879.241869:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851879.241870:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851879.241870:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:13.0:1773851879.241871:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851879.241871:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851879.241872:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4a00
00000800:00000200:29.0:1773851879.241873:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851879.241873:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851879.241873:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:13.0:1773851879.241874:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f67ad [1] + 224
00000400:00000200:1.0:1773851879.241874:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851879.241875:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:1.0:1773851879.241875:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:29.0:1773851879.241876:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000800:00000200:13.0:1773851879.241876:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851879.241876:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851879.241877:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:1.0:1773851879.241877:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:29.0:1773851879.241878:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:13.0:1773851879.241878:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851879.241878:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:29.0:1773851879.241879:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851879.241879:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->54@kfi7: PUT: OK
00000400:00000200:29.0:1773851879.241880:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:1.0:1773851879.241880:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851879.241881:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000100:00000001:13.0:1773851879.241881:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851879.241881:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4940
00000400:00000200:29.0:1773851879.241882:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000200:13.0:1773851879.241882:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851879.241882:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851879.241883:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b49c0
00000800:00000200:17.0:1773851879.241883:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:29.0:1773851879.241884:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:17.0:1773851879.241884:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:1.0:1773851879.241884:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71dc41 [1] + 224
00000800:00000200:17.0:1773851879.241885:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:13.0:1773851879.241885:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851879.241886:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78008117d [1] + 224
00000800:00000200:1.0:1773851879.241886:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851879.241887:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851879.241888:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:13.0:1773851879.241888:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851879.241888:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851879.241889:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851879.241889:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:14.0:1773851879.241889:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851879.241889:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:1.0:1773851879.241889:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:14.0:1773851879.241890:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:14.0:1773851879.241890:0:41075:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:13.0:1773851879.241890:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851879.241890:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851879.241891:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:17.0:1773851879.241891:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000001:14.0:1773851879.241891:0:41075:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851879.241892:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851879.241892:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:14.0:1773851879.241892:0:41075:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000400:00000200:14.0:1773851879.241892:0:41075:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
00000100:00000200:1.0:1773851879.241892:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851879.241893:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851879.241893:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000010:14.0:1773851879.241893:0:41075:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000400:00000200:17.0:1773851879.241894:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:14.0:1773851879.241894:0:41075:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851879.241895:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000200:14.0:1773851879.241895:0:41075:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851879.241895:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851879.241896:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851879.241896:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:17.0:1773851879.241897:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.241898:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4980
00000100:00000200:14.0:1773851879.241898:0:41075:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851879.241899:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:1.0:1773851879.241899:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851879.241900:0:41075:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851879.241900:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000001:29.0:1773851879.241901:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851879.241901:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:17.0:1773851879.241901:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f1931 [1] + 224
00000100:00000001:14.0:1773851879.241901:0:41075:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851879.241901:0:41075:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:8.0:1773851879.241901:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:14.0:1773851879.241902:0:41075:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:14.0:1773851879.241902:0:41075:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851879.241902:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851879.241902:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:1.0:1773851879.241902:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000800:00000200:29.0:1773851879.241903:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851879.241903:0:41075:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:8.0:1773851879.241903:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851879.241903:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:2.0:1773851879.241903:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:17.0:1773851879.241904:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:14.0:1773851879.241904:0:41075:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851879.241904:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000001:2.0:1773851879.241904:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:17.0:1773851879.241905:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00001000:14.0:1773851879.241905:0:41075:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=112 v=66 (66 66 66 66)
00000400:00000200:8.0:1773851879.241905:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000400:00000010:8.0:1773851879.241905:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000400:00000001:2.0:1773851879.241905:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:2.0:1773851879.241905:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000400:00000200:17.0:1773851879.241906:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000100:00001000:14.0:1773851879.241906:0:41075:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=112 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851879.241906:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:2.0:1773851879.241906:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8c1b5d
00000100:00000001:14.0:1773851879.241907:0:41075:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:14.0:1773851879.241907:0:41075:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851879.241907:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:2.0:1773851879.241907:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8c1b5d.
00000100:00000001:2.0:1773851879.241907:0:41061:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:17.0:1773851879.241908:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:14.0:1773851879.241908:0:41075:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:17.0:1773851879.241909:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:14.0:1773851879.241909:0:41075:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:2.0:1773851879.241909:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851879.241910:0:41075:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:14.0:1773851879.241910:0:41075:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000200:8.0:1773851879.241910:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851879.241911:0:41075:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:14.0:1773851879.241911:0:41075:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851879.241912:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:14.0:1773851879.241912:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:2.0:1773851879.241912:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851879.241914:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851879.241914:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851879.241915:0:41075:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851879.241915:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851879.241915:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.241916:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851879.241916:0:41071:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:2.0:1773851879.241916:0:41061:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:2.0:1773851879.241916:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:17.0:1773851879.241917:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:14.0:1773851879.241917:0:41075:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:14.0:1773851879.241917:0:41075:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851879.241917:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851879.241917:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851879.241917:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000001:14.0:1773851879.241918:0:41075:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851879.241918:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851879.241918:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851879.241918:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241918:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851879.241919:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000004:00000040:14.0:1773851879.241919:0:41075:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000004:00000040:14.0:1773851879.241919:0:41075:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524049920 avail=351521309696 avail_mb=1373130116 hwm_mb=3131103 files=372113834 ffree=343285205 state=0: rc = 0
00000400:00000001:9.0:1773851879.241919:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
02000000:00000001:8.0:1773851879.241919:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851879.241919:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:9.0:1773851879.241920:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:8.0:1773851879.241920:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=112 v=66 (66 66 66 66)
00000100:00001000:2.0:1773851879.241920:0:41061:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=112 v=66 (66 66 66 66)
00000004:00000020:14.0:1773851879.241921:0:41075:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524049920 free, 351521309696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113834 files, 343285205 free files
00000400:00000010:9.0:1773851879.241921:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000100:00001000:8.0:1773851879.241921:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=27 v=66 (1 1 1 1)
00000100:00001000:2.0:1773851879.241921:0:41061:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=112 v=66 (1 1 1 1)
00000400:00000200:9.0:1773851879.241922:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027709c97
00000400:00000010:9.0:1773851879.241922:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027709c97.
00000100:00000001:8.0:1773851879.241922:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851879.241922:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:14.0:1773851879.241923:0:41075:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851879.241923:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851879.241923:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241923:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851879.241924:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:9.0:1773851879.241924:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:8.0:1773851879.241924:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:2.0:1773851879.241924:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851879.241925:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.241925:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241925:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:8.0:1773851879.241926:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:2.0:1773851879.241926:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00100000:14.0:1773851879.241927:0:41075:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000391be4bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051933184:54@kfi7:13:default-yuba2-0
00000100:00000200:9.0:1773851879.241927:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851879.241927:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000001:2.0:1773851879.241927:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:14.0:1773851879.241928:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851879.241928:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851879.241928:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241928:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851879.241929:0:41075:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851879.241929:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:8.0:1773851879.241929:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:2.0:1773851879.241929:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:14.0:1773851879.241930:0:41075:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000391be4bf x1859433051933184/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851879.241930:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851879.241931:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851879.241931:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:14.0:1773851879.241932:0:41075:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:9.0:1773851879.241932:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851879.241932:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851879.241932:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851879.241932:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851879.241932:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:14.0:1773851879.241933:0:41075:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:9.0:1773851879.241933:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851879.241933:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851879.241933:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851879.241933:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:14.0:1773851879.241934:0:41075:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
02000000:00000001:14.0:1773851879.241934:0:41075:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00001000:9.0:1773851879.241934:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=112 v=66 (66 66 66 66)
00000004:00000001:8.0:1773851879.241934:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:2.0:1773851879.241934:0:41061:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000001:14.0:1773851879.241935:0:41075:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:14.0:1773851879.241935:0:41075:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000100:00001000:9.0:1773851879.241935:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=112 v=66 (1 1 1 1)
00000004:00000040:8.0:1773851879.241935:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000004:00000040:2.0:1773851879.241935:0:41061:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000020:00000001:14.0:1773851879.241936:0:41075:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:9.0:1773851879.241936:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000040:8.0:1773851879.241936:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420254208 avail=351417807872 avail_mb=1372725812 hwm_mb=3131103 files=372008959 ffree=343183842 state=0: rc = 0
00000004:00000040:2.0:1773851879.241936:0:41061:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449328640 avail=351446803456 avail_mb=1372839076 hwm_mb=3131103 files=372160955 ffree=343212235 state=0: rc = 0
02000000:00000010:14.0:1773851879.241937:0:41075:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000bfa9c3a9.
02000000:00000001:14.0:1773851879.241937:0:41075:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:9.0:1773851879.241937:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851879.241937:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:8.0:1773851879.241937:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420254208 free, 351417807872 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372008959 files, 343183842 free files
02000000:00000001:14.0:1773851879.241938:0:41075:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00010000:00000001:9.0:1773851879.241938:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:14.0:1773851879.241939:0:41075:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000391be4bf.
00000100:00000001:14.0:1773851879.241939:0:41075:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851879.241939:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000001:8.0:1773851879.241939:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:2.0:1773851879.241939:0:41061:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449328640 free, 351446803456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160955 files, 343212235 free files
00000100:00000001:14.0:1773851879.241940:0:41075:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:9.0:1773851879.241940:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000001:9.0:1773851879.241940:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851879.241940:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851879.241940:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:14.0:1773851879.241941:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851879.241941:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:9.0:1773851879.241941:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:2.0:1773851879.241941:0:41061:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851879.241942:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851879.241942:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007391cc99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051932992:6@kfi7:13:default-yuba2-0
00000100:00000040:2.0:1773851879.241942:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:14.0:1773851879.241943:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851879.241943:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851879.241944:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851879.241945:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851879.241945:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851879.241945:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:2.0:1773851879.241945:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000090b676d7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051933120:2095@kfi7:13:default-yuba2-0
00000004:00000001:9.0:1773851879.241946:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:8.0:1773851879.241946:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:9.0:1773851879.241947:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851879.241947:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666640896 avail=351645434880 avail_mb=1373614980 hwm_mb=3131103 files=372237822 ffree=343424454 state=0: rc = 0
00000100:00000040:8.0:1773851879.241947:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007391cc99 x1859433051932992/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851879.241947:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851879.241948:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:2.0:1773851879.241948:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000090b676d7 x1859433051933120/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:9.0:1773851879.241949:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666640896 free, 351645434880 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237822 files, 343424454 free files
00000100:00000001:8.0:1773851879.241950:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851879.241950:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:9.0:1773851879.241951:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851879.241951:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000003d905b3e.
00000100:00000001:2.0:1773851879.241951:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:2.0:1773851879.241951:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:8.0:1773851879.241952:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000010:2.0:1773851879.241952:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f82e5278.
00000100:00000040:9.0:1773851879.241953:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:8.0:1773851879.241953:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851879.241953:0:41071:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
02000000:00000001:2.0:1773851879.241953:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851879.241954:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851879.241954:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003b54e2de.
00000020:00000001:2.0:1773851879.241954:0:41061:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851879.241954:0:41061:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000100:00100000:9.0:1773851879.241955:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004139ca59 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051933056:31@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851879.241955:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:2.0:1773851879.241955:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:2.0:1773851879.241955:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e8a43341.
02000000:00000001:8.0:1773851879.241956:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851879.241956:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007391cc99.
02000000:00000001:2.0:1773851879.241956:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:9.0:1773851879.241957:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851879.241957:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851879.241957:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851879.241957:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:2.0:1773851879.241957:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851879.241957:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000090b676d7.
00000100:00000040:9.0:1773851879.241958:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004139ca59 x1859433051933056/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851879.241958:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851879.241958:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851879.241959:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851879.241959:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241959:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851879.241959:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851879.241960:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:8.0:1773851879.241960:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851879.241960:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:9.0:1773851879.241961:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851879.241961:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006c07bf65.
00000100:00000001:8.0:1773851879.241961:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241961:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.241961:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851879.241962:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851879.241963:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851879.241963:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851879.241964:0:41070:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000020:00000001:9.0:1773851879.241964:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851879.241965:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004dd7265c.
02000000:00000001:9.0:1773851879.241966:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851879.241967:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851879.241967:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004139ca59.
00000100:00000001:9.0:1773851879.241968:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851879.241968:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851879.241969:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851879.241970:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851879.241970:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851879.241971:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851879.241971:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851879.247169:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851879.247170:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851879.247172:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851879.247174:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851879.247176:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.247178:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15354@kfi7 : PUT - for me
00000400:00000200:13.0:1773851879.247179:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.247180:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 1
00000400:00000200:13.0:1773851879.247181:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.247182:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000400:00000200:13.0:1773851879.247183:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 3
00000400:00000200:13.0:1773851879.247184:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15355@kfi7 to cpt 6
00000400:00000200:13.0:1773851879.247185:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15355@kfi7 of length 224 into portal 12 MB=0x699de8bbe2680
00000400:00000200:13.0:1773851879.247187:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15355@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 39984
00000800:00000200:13.0:1773851879.247189:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851879.247191:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.247193:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15354@kfi7: PUT: OK
00000100:00000001:13.0:1773851879.247194:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851879.247194:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851879.247195:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000098678835.
00000100:00000040:13.0:1773851879.247196:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000098678835 x1858030966548096 msgsize 224
00000100:00100000:13.0:1773851879.247198:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-15355@kfi7 (source: 12345-15354@kfi7)
00000100:00000001:13.0:1773851879.247199:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851879.247200:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000100:00000001:12.0:1773851879.247201:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851879.247202:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851879.247202:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851879.247202:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851879.247203:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851879.247204:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851879.247205:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966548096
00000020:00000001:12.0:1773851879.247205:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851879.247206:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f35
00000020:00000001:12.0:1773851879.247207:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851879.247211:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cef005c6 refcount=6
00000020:00000001:12.0:1773851879.247212:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239894016 : -107152469657600 : ffff9e8b9f1bf800)
00000020:00000001:12.0:1773851879.247213:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239894016 : -107152469657600 : ffff9e8b9f1bf800)
00000100:00000001:12.0:1773851879.247214:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851879.247215:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851879.247216:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ebe075ad.
00000020:00000010:12.0:1773851879.247217:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851879.247218:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
00000100:00000001:12.0:1773851879.247219:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851879.247219:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851879.247220:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851879.247221:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851879.247222:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851879.247223:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.247224:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851879.247226:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.247226:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.247226:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851879.247227:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851879.247228:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15355@kfi7, seq: 2289875
00000100:00000040:12.0:1773851879.247228:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cef005c6 : new rpc_count 1
00000100:00000001:15.0:1773851879.247229:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.247229:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.247229:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902269824 : -106994807281792 : ffff9eb05484e780)
00000100:00000040:12.0:1773851879.247231:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000098678835 x1858030966548096/t0(0) o400->6c47a5de-da6a-45a6-b2ca-5182593bb493@15355@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne228-0'
00000100:00000001:12.0:1773851879.247234:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851879.247234:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851879.247235:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098678835 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:6c47a5de-da6a-45a6-b2ca-5182593bb493+6:48004:x1858030966548096:12345-15355@kfi7:400:default-tuolumne228-0
00000100:00000200:12.0:1773851879.247237:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966548096
00000020:00000001:12.0:1773851879.247238:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851879.247238:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851879.247239:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.247240:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851879.247240:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851879.247241:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851879.247242:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966548096, found 0 last_xid 1858030966548095
00000020:00000001:12.0:1773851879.247243:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851879.247243:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851879.247244:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851879.247245:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.247245:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851879.247246:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851879.247247:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851879.247248:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b36d35eb.
02000000:00000001:12.0:1773851879.247248:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.247249:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.247250:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851879.247250:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030966548096
00010000:00000001:12.0:1773851879.247251:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851879.247253:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000098678835 x1858030966548096/t0(0) o400->6c47a5de-da6a-45a6-b2ca-5182593bb493@15355@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne228-0'
00010000:00000001:12.0:1773851879.247256:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851879.247256:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851879.247257:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=112 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851879.247258:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851879.247259:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000090c2d766 refcount 5 to 15355@kfi7
00000100:00000001:12.0:1773851879.247260:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331584 : -107155410220032 : ffff9e8aefd68c00)
02000000:00000001:12.0:1773851879.247261:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851879.247261:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.247262:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851879.247263:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15354@kfi7
00000400:00000010:12.0:1773851879.247264:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ec46d43c.
00000100:00000200:12.0:1773851879.247265:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966548096, offset 224
00000400:00000200:12.0:1773851879.247266:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15354@kfi7
00000400:00000200:12.0:1773851879.247267:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:12.0:1773851879.247268:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 1
00000400:00000200:12.0:1773851879.247270:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000400:00000200:12.0:1773851879.247271:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 3
00000400:00000200:12.0:1773851879.247272:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15354@kfi7 local destination
00000400:00000200:12.0:1773851879.247275:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769640:8769640:1024:4294967295] 15354@kfi7 LPNI seq info [28066:28066:16:4294967295]
00000400:00000200:12.0:1773851879.247278:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000400:00000200:12.0:1773851879.247279:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:12.0:1773851879.247283:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15354@kfi7(15354@kfi7:15354@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851879.247285:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 3
00000800:00000200:12.0:1773851879.247288:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851879.247290:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851879.247294:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851879.247298:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3db Using peer 15354@kfi7(0x3db)
00000800:00000200:12.0:1773851879.247305:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x3db: rc=0
00000800:00000200:12.0:1773851879.247307:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3db TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851879.247311:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851879.247313:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000090c2d766 refcount 4 to 15355@kfi7
00010000:00000001:12.0:1773851879.247316:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851879.247317:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.247318:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851879.247320:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098678835 x1858030966548096/t0(0) o400->6c47a5de-da6a-45a6-b2ca-5182593bb493@15355@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne228-0'
00000100:00100000:12.0:1773851879.247326:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098678835 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:6c47a5de-da6a-45a6-b2ca-5182593bb493+6:48004:x1858030966548096:12345-15355@kfi7:400:default-tuolumne228-0 Request processed in 90us (128us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851879.247330:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15355@kfi7, seq: 2289875
00000100:00000040:12.0:1773851879.247331:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cef005c6 : new rpc_count 0
00000100:00000001:12.0:1773851879.247333:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851879.247333:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851879.247334:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851879.247336:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000020:00000010:12.0:1773851879.247337:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ebe075ad.
00000020:00000040:12.0:1773851879.247339:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000cef005c6 : new refcount 5
00000100:00000001:12.0:1773851879.247340:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851879.247347:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3db TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851879.247349:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.247351:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15354@kfi7: PUT: OK
00000400:00000200:13.0:1773851879.247352:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ec46d43c
00000400:00000010:13.0:1773851879.247352:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ec46d43c.
00000100:00000001:13.0:1773851879.247353:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851879.247354:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851879.247355:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000800:00000200:13.0:1773851879.247356:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 15354@kfi7(000000009618ffcb):0x0 lsk 988 rsk 90 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3db Transaction freed
00000400:00000200:29.0:1773851879.305735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851879.305738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:13.0:1773851879.441912:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851879.441913:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851879.441914:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851879.441916:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851879.441918:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17760@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.441919:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17760@kfi7 : PUT - for me
00000400:00000200:13.0:1773851879.441920:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17760@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.441923:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b639823 nid 17760@kfi7 refs 1
00000400:00000200:13.0:1773851879.441924:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17760@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.441925:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b639823 nid 17760@kfi7 refs 2
00000400:00000200:13.0:1773851879.441926:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000b639823 nid 17760@kfi7 refs 3
00000400:00000200:13.0:1773851879.441927:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17824@kfi7 to cpt 7
00000400:00000200:13.0:1773851879.441927:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17824@kfi7 of length 224 into portal 12 MB=0x699e0d205ec40
00000400:00000200:13.0:1773851879.441928:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17824@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 40208
00000800:00000200:13.0:1773851879.441930:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851879.441931:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.441932:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17760@kfi7: PUT: OK
00000100:00000001:13.0:1773851879.441933:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851879.441933:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851879.441934:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000557dbe3b.
00000100:00000040:13.0:1773851879.441935:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000557dbe3b x1858040735591488 msgsize 224
00000100:00100000:13.0:1773851879.441936:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-17824@kfi7 (source: 12345-17760@kfi7)
00000100:00000001:13.0:1773851879.441937:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851879.441938:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000b639823 nid 17760@kfi7 refs 2
00000800:00000200:13.0:1773851879.441939:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851879.441939:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851879.441939:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851879.441939:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851879.441940:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851879.441940:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851879.441941:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040735591488
00000020:00000001:12.0:1773851879.441941:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851879.441941:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9178c
00000020:00000001:12.0:1773851879.441942:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851879.441946:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000137e299b refcount=167
00000020:00000001:12.0:1773851879.441946:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241488384 : -107152468063232 : ffff9e8b9f344c00)
00000020:00000001:12.0:1773851879.441947:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241488384 : -107152468063232 : ffff9e8b9f344c00)
00000100:00000001:12.0:1773851879.441948:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851879.441949:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851879.441949:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ebe075ad.
00000020:00000010:12.0:1773851879.441950:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851879.441950:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
00000100:00000001:12.0:1773851879.441951:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851879.441951:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851879.441952:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851879.441952:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851879.441953:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851879.441953:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.441954:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851879.441955:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.441955:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.441955:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851879.441956:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851879.441956:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17824@kfi7, seq: 2289876
00000100:00000001:15.0:1773851879.441957:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.441957:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851879.441957:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000137e299b : new rpc_count 1
00000100:00000001:12.0:1773851879.441957:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902244480 : -106994807307136 : ffff9eb054848480)
00000100:00000040:12.0:1773851879.441958:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000557dbe3b x1858040735591488/t0(0) o400->a3712ee9-fb9c-449a-927b-03a2c7dfce0c@17824@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1600-0'
00000100:00000001:12.0:1773851879.441960:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851879.441961:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851879.441961:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000557dbe3b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a3712ee9-fb9c-449a-927b-03a2c7dfce0c+167:39600:x1858040735591488:12345-17824@kfi7:400:default-tuolumne1600-0
00000100:00000200:12.0:1773851879.441963:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040735591488
00000020:00000001:12.0:1773851879.441963:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851879.441963:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851879.441964:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.441964:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851879.441965:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851879.441965:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851879.441966:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040735591488, found 0 last_xid 1858040735194495
00000020:00000001:12.0:1773851879.441966:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851879.441967:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851879.441967:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851879.441968:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.441968:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851879.441968:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851879.441969:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851879.441969:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ee1930e5.
02000000:00000001:12.0:1773851879.441970:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.441970:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.441971:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851879.441971:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062706, transno 0, xid 1858040735591488
00010000:00000001:12.0:1773851879.441972:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851879.441972:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000557dbe3b x1858040735591488/t0(0) o400->a3712ee9-fb9c-449a-927b-03a2c7dfce0c@17824@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1600-0'
00010000:00000001:12.0:1773851879.441975:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851879.441975:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851879.441975:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=112 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851879.441976:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851879.441977:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000388b3a7a refcount 3 to 17824@kfi7
00000100:00000001:12.0:1773851879.441977:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271200 : -107152618280416 : ffff9e8b96402a20)
02000000:00000001:12.0:1773851879.441978:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851879.441978:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.441979:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851879.441980:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17760@kfi7
00000400:00000010:12.0:1773851879.441980:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002b741276.
00000100:00000200:12.0:1773851879.441981:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040735591488, offset 224
00000400:00000200:12.0:1773851879.441982:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17760@kfi7
00000400:00000200:12.0:1773851879.441983:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17760@kfi7 to cpt 3
00000400:00000200:12.0:1773851879.441984:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b639823 nid 17760@kfi7 refs 1
00000400:00000200:12.0:1773851879.441985:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000b639823 nid 17760@kfi7 refs 2
00000400:00000200:12.0:1773851879.441986:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000b639823 nid 17760@kfi7 refs 3
00000400:00000200:12.0:1773851879.441987:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17760@kfi7 local destination
00000400:00000200:12.0:1773851879.441988:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769641:8769641:1024:4294967295] 17760@kfi7 LPNI seq info [883686:883686:16:4294967295]
00000400:00000200:12.0:1773851879.441989:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000b639823 nid 17760@kfi7 refs 2
00000400:00000200:12.0:1773851879.441991:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17760@kfi7 to cpt 3
00000400:00000200:12.0:1773851879.441993:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17760@kfi7(17760@kfi7:17760@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851879.441994:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000b639823 nid 17760@kfi7 refs 3
00000800:00000200:12.0:1773851879.441995:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851879.441996:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851879.441998:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851879.442000:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x82a Using peer 17760@kfi7(0x82a)
00000800:00000200:12.0:1773851879.442002:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x82a: rc=0
00000800:00000200:12.0:1773851879.442003:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x82a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851879.442005:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851879.442005:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000388b3a7a refcount 2 to 17824@kfi7
00010000:00000001:12.0:1773851879.442006:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851879.442006:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.442007:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851879.442007:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000557dbe3b x1858040735591488/t0(0) o400->a3712ee9-fb9c-449a-927b-03a2c7dfce0c@17824@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1600-0'
00000100:00100000:12.0:1773851879.442010:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000557dbe3b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a3712ee9-fb9c-449a-927b-03a2c7dfce0c+167:39600:x1858040735591488:12345-17824@kfi7:400:default-tuolumne1600-0 Request processed in 48us (74us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851879.442013:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17824@kfi7, seq: 2289876
00000100:00000040:12.0:1773851879.442013:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000137e299b : new rpc_count 0
00000100:00000001:12.0:1773851879.442014:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851879.442014:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851879.442014:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851879.442015:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000020:00000010:12.0:1773851879.442016:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ebe075ad.
00000020:00000040:12.0:1773851879.442016:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000137e299b : new refcount 166
00000100:00000001:12.0:1773851879.442017:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851879.442021:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x82a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851879.442023:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.442024:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17760@kfi7: PUT: OK
00000400:00000200:13.0:1773851879.442025:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002b741276
00000400:00000010:13.0:1773851879.442025:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002b741276.
00000100:00000001:13.0:1773851879.442026:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851879.442026:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851879.442027:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000b639823 nid 17760@kfi7 refs 2
00000800:00000200:13.0:1773851879.442028:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17760@kfi7(00000000439515bd):0x0 lsk 2091 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x82a Transaction freed
00000800:00000200:25.0:1773851879.442815:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851879.442815:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851879.442817:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851879.442819:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851879.442820:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19795@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.442822:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19795@kfi7 : PUT - for me
00000400:00000200:25.0:1773851879.442822:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19795@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.442824:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cad00e62 nid 19795@kfi7 refs 1
00000400:00000200:25.0:1773851879.442825:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19795@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.442825:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cad00e62 nid 19795@kfi7 refs 2
00000400:00000200:25.0:1773851879.442827:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cad00e62 nid 19795@kfi7 refs 3
00000400:00000200:25.0:1773851879.442828:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19858@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.442829:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19858@kfi7 of length 224 into portal 12 MB=0x699e0d489a1c0
00000400:00000200:25.0:1773851879.442830:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19858@kfi7 of length 224/224 into md 0x16159c9699 [64] + 25920
00000800:00000200:25.0:1773851879.442831:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851879.442833:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851879.442834:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19795@kfi7: PUT: OK
00000100:00000001:25.0:1773851879.442835:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851879.442836:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851879.442837:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bffe00c0.
00000100:00000040:25.0:1773851879.442838:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bffe00c0 x1858040777777600 msgsize 224
00000100:00100000:25.0:1773851879.442839:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19858@kfi7 (source: 12345-19795@kfi7)
00000100:00000001:25.0:1773851879.442840:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851879.442841:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851879.442841:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cad00e62 nid 19795@kfi7 refs 2
02000000:00000001:27.0:1773851879.442842:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851879.442842:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851879.442842:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851879.442843:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851879.442844:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851879.442844:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040777777600
00000020:00000001:27.0:1773851879.442845:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851879.442845:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92642
00000020:00000001:27.0:1773851879.442846:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851879.442848:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002414a081 refcount=6
00000020:00000001:27.0:1773851879.442849:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631013376 : -107123078538240 : ffff9e9276f4dc00)
00000020:00000001:27.0:1773851879.442849:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631013376 : -107123078538240 : ffff9e9276f4dc00)
00000100:00000001:27.0:1773851879.442850:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.442851:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851879.442851:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851879.442852:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851879.442853:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851879.442854:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851879.442854:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851879.442855:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.442856:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851879.442856:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851879.442856:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.442857:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.442859:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851879.442859:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851879.442859:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851879.442859:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851879.442860:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19858@kfi7, seq: 2025141
00000100:00000040:27.0:1773851879.442862:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002414a081 : new rpc_count 1
00000100:00000001:26.0:1773851879.442862:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.442863:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252476544 : -106967457075072 : ffff9eb6b2b7f080)
00000100:00000001:26.0:1773851879.442863:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.442864:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bffe00c0 x1858040777777600/t0(0) o400->c11e5730-ddc4-4084-840d-0b7d3637c5d9@19858@kfi7:96/0 lens 224/0 e 0 to 0 dl 1773852211 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1734-0'
00000100:00000001:27.0:1773851879.442866:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.442867:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851879.442868:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bffe00c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c11e5730-ddc4-4084-840d-0b7d3637c5d9+6:39675:x1858040777777600:12345-19858@kfi7:400:default-tuolumne1734-0
00000100:00000200:27.0:1773851879.442869:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040777777600
00000020:00000001:27.0:1773851879.442870:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851879.442870:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851879.442871:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.442871:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851879.442872:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851879.442873:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851879.442873:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040777777600, found 0 last_xid 1858040777777599
00000020:00000001:27.0:1773851879.442874:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851879.442875:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851879.442875:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851879.442876:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.442876:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851879.442877:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851879.442877:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851879.442878:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ce691930.
02000000:00000001:27.0:1773851879.442879:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.442880:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.442880:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851879.442881:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104890271, transno 0, xid 1858040777777600
00010000:00000001:27.0:1773851879.442882:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851879.442882:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bffe00c0 x1858040777777600/t0(0) o400->c11e5730-ddc4-4084-840d-0b7d3637c5d9@19858@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1734-0'
00010000:00000001:27.0:1773851879.442885:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851879.442886:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851879.442887:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=112 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851879.442887:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851879.442888:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c6b3e109 refcount 3 to 19858@kfi7
00000100:00000001:27.0:1773851879.442889:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366321632 : -107142343229984 : ffff9e8dfab0fde0)
02000000:00000001:27.0:1773851879.442890:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851879.442890:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.442891:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851879.442892:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19795@kfi7
00000400:00000010:27.0:1773851879.442892:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e42f1f7.
00000100:00000200:27.0:1773851879.442893:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040777777600, offset 224
00000400:00000200:27.0:1773851879.442894:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19795@kfi7
00000400:00000200:27.0:1773851879.442895:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19795@kfi7 to cpt 6
00000400:00000200:27.0:1773851879.442896:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cad00e62 nid 19795@kfi7 refs 1
00000400:00000200:27.0:1773851879.442897:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cad00e62 nid 19795@kfi7 refs 2
00000400:00000200:27.0:1773851879.442898:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cad00e62 nid 19795@kfi7 refs 3
00000400:00000200:27.0:1773851879.442899:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19795@kfi7 local destination
00000400:00000200:27.0:1773851879.442900:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769642:8769642:1024:4294967295] 19795@kfi7 LPNI seq info [7458779:7458779:16:4294967295]
00000400:00000200:27.0:1773851879.442901:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cad00e62 nid 19795@kfi7 refs 2
00000400:00000200:27.0:1773851879.442902:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19795@kfi7 to cpt 6
00000400:00000200:27.0:1773851879.442904:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19795@kfi7(19795@kfi7:19795@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851879.442905:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cad00e62 nid 19795@kfi7 refs 3
00000800:00000200:27.0:1773851879.442906:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851879.442907:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851879.442909:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851879.442912:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc74 Using peer 19795@kfi7(0xc74)
00000800:00000200:27.0:1773851879.442914:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0xc74: rc=0
00000800:00000200:27.0:1773851879.442915:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc74 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851879.442919:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.442920:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c6b3e109 refcount 2 to 19858@kfi7
00010000:00000001:27.0:1773851879.442920:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851879.442921:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.442921:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851879.442922:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bffe00c0 x1858040777777600/t0(0) o400->c11e5730-ddc4-4084-840d-0b7d3637c5d9@19858@kfi7:96/0 lens 224/224 e 0 to 0 dl 1773852211 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1734-0'
00000100:00100000:27.0:1773851879.442925:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bffe00c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:c11e5730-ddc4-4084-840d-0b7d3637c5d9+6:39675:x1858040777777600:12345-19858@kfi7:400:default-tuolumne1734-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851879.442927:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19858@kfi7, seq: 2025141
00000100:00000040:27.0:1773851879.442928:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002414a081 : new rpc_count 0
00000800:00000200:25.0:1773851879.442928:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc74 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851879.442929:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851879.442929:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851879.442930:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851879.442930:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851879.442930:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19795@kfi7: PUT: OK
00000020:00000010:27.0:1773851879.442931:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851879.442931:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000400:00000200:25.0:1773851879.442931:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e42f1f7
00000020:00000040:27.0:1773851879.442932:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002414a081 : new refcount 5
00000400:00000010:25.0:1773851879.442932:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e42f1f7.
00000100:00000001:25.0:1773851879.442932:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851879.442932:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:27.0:1773851879.442933:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851879.442933:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cad00e62 nid 19795@kfi7 refs 2
00000800:00000200:25.0:1773851879.442935:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 19795@kfi7(00000000a667ed72):0x0 lsk 3189 rsk 46 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc74 Transaction freed
00000800:00000200:13.0:1773851879.482981:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851879.482983:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851879.482985:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851879.482987:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851879.482989:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9665@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.482990:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9665@kfi7 : PUT - for me
00000400:00000200:13.0:1773851879.482991:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9665@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.482992:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000955a619c nid 9665@kfi7 refs 1
00000400:00000200:13.0:1773851879.482993:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9665@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.482994:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000955a619c nid 9665@kfi7 refs 2
00000400:00000200:13.0:1773851879.482995:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000955a619c nid 9665@kfi7 refs 3
00000400:00000200:13.0:1773851879.482995:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9665@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.482996:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9665@kfi7 of length 224 into portal 12 MB=0x69a8a25212a80
00000400:00000200:13.0:1773851879.482998:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9665@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 40432
00000800:00000200:13.0:1773851879.482999:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851879.483001:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.483002:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9665@kfi7: PUT: OK
00000100:00000001:13.0:1773851879.483003:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851879.483003:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851879.483004:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009fd62e86.
00000100:00000040:13.0:1773851879.483004:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009fd62e86 x1858767979358848 msgsize 224
00000100:00100000:13.0:1773851879.483006:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9665@kfi7 (source: 12345-9665@kfi7)
00000100:00000001:13.0:1773851879.483007:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851879.483008:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000955a619c nid 9665@kfi7 refs 2
00000100:00000001:12.0:1773851879.483008:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851879.483009:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851879.483009:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851879.483009:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851879.483010:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851879.483010:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851879.483011:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858767979358848
00000020:00000001:12.0:1773851879.483012:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851879.483012:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91651
00000020:00000001:12.0:1773851879.483013:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851879.483015:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a93813e6 refcount=6
00000020:00000001:12.0:1773851879.483016:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241257984 : -107152468293632 : ffff9e8b9f30c800)
00000020:00000001:12.0:1773851879.483017:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241257984 : -107152468293632 : ffff9e8b9f30c800)
00000100:00000001:12.0:1773851879.483018:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851879.483019:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851879.483019:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ebe075ad.
00000020:00000010:12.0:1773851879.483020:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851879.483021:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
00000100:00000001:12.0:1773851879.483022:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851879.483022:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851879.483022:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851879.483023:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851879.483024:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851879.483024:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.483025:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851879.483026:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.483026:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851879.483027:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851879.483027:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851879.483028:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851879.483028:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9665@kfi7, seq: 2289877
00000100:00000040:12.0:1773851879.483028:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a93813e6 : new rpc_count 1
00000100:00000001:15.0:1773851879.483029:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.483029:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902251392 : -106994807300224 : ffff9eb054849f80)
00000100:00000040:12.0:1773851879.483030:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009fd62e86 x1858767979358848/t0(0) o400->fe328838-b2da-4582-b2ca-61fd90f2d9f2@9665@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1091-0'
00000100:00000001:12.0:1773851879.483032:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851879.483033:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851879.483034:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009fd62e86 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:fe328838-b2da-4582-b2ca-61fd90f2d9f2+6:39216:x1858767979358848:12345-9665@kfi7:400:default-tuolumne1091-0
00000100:00000200:12.0:1773851879.483035:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858767979358848
00000020:00000001:12.0:1773851879.483036:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851879.483036:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851879.483037:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.483038:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851879.483038:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851879.483039:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851879.483039:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858767979358848, found 0 last_xid 1858767979358847
00000020:00000001:12.0:1773851879.483040:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851879.483041:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851879.483041:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851879.483042:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.483042:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851879.483043:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851879.483043:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851879.483044:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000133184a0.
02000000:00000001:12.0:1773851879.483044:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.483045:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.483045:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851879.483046:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530879, transno 0, xid 1858767979358848
00010000:00000001:12.0:1773851879.483047:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851879.483047:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009fd62e86 x1858767979358848/t0(0) o400->fe328838-b2da-4582-b2ca-61fd90f2d9f2@9665@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1091-0'
00010000:00000001:12.0:1773851879.483049:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851879.483050:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851879.483051:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=112 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851879.483052:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851879.483052:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000084a6ba72 refcount 3 to 9665@kfi7
00000100:00000001:12.0:1773851879.483053:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151168 : -107154898400448 : ffff9e8b0e584b40)
02000000:00000001:12.0:1773851879.483053:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851879.483054:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.483054:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851879.483055:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9665@kfi7
00000400:00000010:12.0:1773851879.483056:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002b741276.
00000100:00000200:12.0:1773851879.483057:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858767979358848, offset 224
00000400:00000200:12.0:1773851879.483058:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9665@kfi7
00000400:00000200:12.0:1773851879.483059:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9665@kfi7 to cpt 3
00000400:00000200:12.0:1773851879.483060:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000955a619c nid 9665@kfi7 refs 1
00000400:00000200:12.0:1773851879.483061:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000955a619c nid 9665@kfi7 refs 2
00000400:00000200:12.0:1773851879.483062:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000955a619c nid 9665@kfi7 refs 3
00000400:00000200:12.0:1773851879.483063:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9665@kfi7 local destination
00000400:00000200:12.0:1773851879.483064:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769643:8769643:1024:4294967295] 9665@kfi7 LPNI seq info [17497:17497:16:4294967295]
00000400:00000200:12.0:1773851879.483065:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000955a619c nid 9665@kfi7 refs 2
00000400:00000200:12.0:1773851879.483066:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9665@kfi7 to cpt 3
00000400:00000200:12.0:1773851879.483068:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9665@kfi7(9665@kfi7:9665@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851879.483069:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000955a619c nid 9665@kfi7 refs 3
00000800:00000200:12.0:1773851879.483070:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851879.483071:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851879.483073:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851879.483075:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x909 Using peer 9665@kfi7(0x909)
00000800:00000200:12.0:1773851879.483077:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0x909: rc=0
00000800:00000200:12.0:1773851879.483078:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x909 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851879.483080:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851879.483081:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000084a6ba72 refcount 2 to 9665@kfi7
00010000:00000001:12.0:1773851879.483081:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851879.483082:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851879.483082:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851879.483083:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009fd62e86 x1858767979358848/t0(0) o400->fe328838-b2da-4582-b2ca-61fd90f2d9f2@9665@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1091-0'
00000100:00100000:12.0:1773851879.483087:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009fd62e86 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:fe328838-b2da-4582-b2ca-61fd90f2d9f2+6:39216:x1858767979358848:12345-9665@kfi7:400:default-tuolumne1091-0 Request processed in 52us (80us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851879.483089:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9665@kfi7, seq: 2289877
00000100:00000040:12.0:1773851879.483090:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a93813e6 : new rpc_count 0
00000100:00000001:12.0:1773851879.483090:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851879.483091:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851879.483091:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851879.483092:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000020:00000010:12.0:1773851879.483093:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ebe075ad.
00000020:00000040:12.0:1773851879.483093:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000a93813e6 : new refcount 5
00000100:00000001:12.0:1773851879.483094:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851879.483099:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x909 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851879.483100:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.483101:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9665@kfi7: PUT: OK
00000400:00000200:13.0:1773851879.483103:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002b741276
00000400:00000010:13.0:1773851879.483103:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002b741276.
00000100:00000001:13.0:1773851879.483104:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851879.483105:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851879.483106:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000955a619c nid 9665@kfi7 refs 2
00000800:00000200:13.0:1773851879.483107:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 9665@kfi7(00000000c0e64da5):0x0 lsk 2314 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x909 Transaction freed
00000800:00000200:5.0:1773851879.495359:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851879.495360:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851879.495362:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851879.495365:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851879.495368:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13840@kfi7 to cpt 1
00000400:00000200:5.0:1773851879.495370:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13840@kfi7 : PUT - for me
00000400:00000200:5.0:1773851879.495372:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13840@kfi7 to cpt 1
00000400:00000200:5.0:1773851879.495373:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a301b5c9 nid 13840@kfi7 refs 1
00000400:00000200:5.0:1773851879.495374:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13840@kfi7 to cpt 1
00000400:00000200:5.0:1773851879.495376:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a301b5c9 nid 13840@kfi7 refs 2
00000400:00000200:5.0:1773851879.495377:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a301b5c9 nid 13840@kfi7 refs 3
00000400:00000200:5.0:1773851879.495378:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14033@kfi7 to cpt 7
00000400:00000200:5.0:1773851879.495380:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14033@kfi7 of length 224 into portal 12 MB=0x69b4b86294a80
00000400:00000200:5.0:1773851879.495382:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14033@kfi7 of length 224/224 into md 0x793926dc5 [64] + 151640
00000800:00000200:5.0:1773851879.495385:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851879.495388:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851879.495390:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13840@kfi7: PUT: OK
00000100:00000001:5.0:1773851879.495392:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851879.495392:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851879.495394:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000093a51a8c.
00000100:00000040:5.0:1773851879.495395:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000093a51a8c x1859598535969408 msgsize 224
00000100:00100000:5.0:1773851879.495397:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14033@kfi7 (source: 12345-13840@kfi7)
00000100:00000001:5.0:1773851879.495399:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851879.495400:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a301b5c9 nid 13840@kfi7 refs 2
00000100:00000001:4.0:1773851879.495400:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851879.495401:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851879.495402:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851879.495402:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851879.495402:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851879.495403:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851879.495404:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598535969408
00000020:00000001:4.0:1773851879.495405:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851879.495405:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7a67c
00000020:00000001:4.0:1773851879.495406:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851879.495408:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006d1329ac refcount=5
00000020:00000001:4.0:1773851879.495409:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114127523840 : -106959582027776 : ffff9eb8881ba000)
00000020:00000001:4.0:1773851879.495409:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637114127523840 : -106959582027776 : ffff9eb8881ba000)
00000100:00000001:4.0:1773851879.495411:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851879.495412:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851879.495412:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000983d7486.
00000020:00000010:4.0:1773851879.495413:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851879.495414:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000febcce7f.
00000100:00000001:4.0:1773851879.495415:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851879.495415:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851879.495416:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.495417:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851879.495418:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851879.495418:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.495419:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.495420:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851879.495421:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851879.495421:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851879.495422:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851879.495422:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14033@kfi7, seq: 2001948
00000100:00000040:4.0:1773851879.495422:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006d1329ac : new rpc_count 1
00000100:00000001:7.0:1773851879.495423:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.495423:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108951168 : -106938600600448 : ffff9ebd6ab2cc80)
00000100:00000001:7.0:1773851879.495424:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851879.495424:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000093a51a8c x1859598535969408/t0(0) o400->f43c6101-0986-4083-be48-1cc050113bf2@14033@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1361-0'
00000100:00000001:4.0:1773851879.495427:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851879.495427:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851879.495428:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093a51a8c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:f43c6101-0986-4083-be48-1cc050113bf2+5:39605:x1859598535969408:12345-14033@kfi7:400:default-tuolumne1361-0
00000100:00000200:4.0:1773851879.495431:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598535969408
00000020:00000001:4.0:1773851879.495432:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851879.495432:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851879.495433:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.495434:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851879.495434:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851879.495435:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851879.495436:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598535969408, found 0 last_xid 1859598535969407
00000020:00000001:4.0:1773851879.495437:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851879.495437:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851879.495438:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851879.495438:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.495439:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851879.495440:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851879.495441:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851879.495441:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002d5b6c5e.
02000000:00000001:4.0:1773851879.495442:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.495442:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.495443:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851879.495444:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096680985, transno 0, xid 1859598535969408
00010000:00000001:4.0:1773851879.495445:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851879.495445:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000093a51a8c x1859598535969408/t0(0) o400->f43c6101-0986-4083-be48-1cc050113bf2@14033@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1361-0'
00010000:00000001:4.0:1773851879.495448:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851879.495448:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851879.495449:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=111 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851879.495450:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851879.495451:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c46f5423 refcount 3 to 14033@kfi7
00000100:00000001:4.0:1773851879.495451:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412883072 : -107156296668544 : ffff9e8abb006a80)
02000000:00000001:4.0:1773851879.495453:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851879.495453:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.495454:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851879.495454:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13840@kfi7
00000400:00000010:4.0:1773851879.495455:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cb2a5541.
00000100:00000200:4.0:1773851879.495457:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598535969408, offset 224
00000400:00000200:4.0:1773851879.495458:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13840@kfi7
00000400:00000200:4.0:1773851879.495459:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13840@kfi7 to cpt 1
00000400:00000200:4.0:1773851879.495460:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a301b5c9 nid 13840@kfi7 refs 1
00000400:00000200:4.0:1773851879.495461:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a301b5c9 nid 13840@kfi7 refs 2
00000400:00000200:4.0:1773851879.495462:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a301b5c9 nid 13840@kfi7 refs 3
00000400:00000200:4.0:1773851879.495463:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13840@kfi7 local destination
00000400:00000200:4.0:1773851879.495464:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769644:8769644:1024:4294967295] 13840@kfi7 LPNI seq info [9131022:9131022:16:4294967295]
00000400:00000200:4.0:1773851879.495466:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a301b5c9 nid 13840@kfi7 refs 2
00000400:00000200:4.0:1773851879.495467:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13840@kfi7 to cpt 1
00000400:00000200:4.0:1773851879.495469:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13840@kfi7(13840@kfi7:13840@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851879.495470:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a301b5c9 nid 13840@kfi7 refs 3
00000800:00000200:4.0:1773851879.495471:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851879.495472:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851879.495475:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851879.495477:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000042 Using peer 13840@kfi7(0x100000000000042)
00000800:00000200:4.0:1773851879.495480:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x100000000000042: rc=0
00000800:00000200:4.0:1773851879.495482:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000042 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851879.495484:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851879.495485:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c46f5423 refcount 2 to 14033@kfi7
00010000:00000001:4.0:1773851879.495486:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851879.495486:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851879.495487:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851879.495488:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000093a51a8c x1859598535969408/t0(0) o400->f43c6101-0986-4083-be48-1cc050113bf2@14033@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1361-0'
00000100:00100000:4.0:1773851879.495492:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093a51a8c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:f43c6101-0986-4083-be48-1cc050113bf2+5:39605:x1859598535969408:12345-14033@kfi7:400:default-tuolumne1361-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851879.495495:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14033@kfi7, seq: 2001948
00000100:00000040:4.0:1773851879.495496:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006d1329ac : new rpc_count 0
00000100:00000001:4.0:1773851879.495497:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851879.495498:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851879.495498:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851879.495499:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000febcce7f.
00000020:00000010:4.0:1773851879.495500:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000983d7486.
00000020:00000040:4.0:1773851879.495501:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000006d1329ac : new refcount 4
00000100:00000001:4.0:1773851879.495501:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851879.495508:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000042 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851879.495511:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851879.495512:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13840@kfi7: PUT: OK
00000400:00000200:5.0:1773851879.495514:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cb2a5541
00000400:00000010:5.0:1773851879.495514:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cb2a5541.
00000100:00000001:5.0:1773851879.495515:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851879.495516:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851879.495517:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a301b5c9 nid 13840@kfi7 refs 2
00000800:00000200:5.0:1773851879.495520:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 13840@kfi7(00000000f0d5394b):0x0 lsk 67 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000042 Transaction freed
00000800:00000200:13.0:1773851879.534750:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851879.534751:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851879.534752:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851879.534754:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851879.534757:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.534758:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19451@kfi7 : PUT - for me
00000400:00000200:13.0:1773851879.534759:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.534760:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 1
00000400:00000200:13.0:1773851879.534762:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.534762:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000400:00000200:13.0:1773851879.534763:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 3
00000400:00000200:13.0:1773851879.534764:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:13.0:1773851879.534766:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19451@kfi7 of length 440 into portal 12 MB=0x699de86f2f4c0
00000400:00000200:13.0:1773851879.534767:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19451@kfi7 of length 440/440 into md 0x82a36e8ed [64] + 40656
00000800:00000200:13.0:1773851879.534769:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851879.534771:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.534772:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19451@kfi7: PUT: OK
00000100:00000001:13.0:1773851879.534773:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851879.534774:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851879.534775:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0d44bb5.
00000100:00000040:13.0:1773851879.534775:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000a0d44bb5 x1858030886122688 msgsize 440
00000100:00100000:13.0:1773851879.534777:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-19451@kfi7 (source: 12345-19451@kfi7)
00000100:00000001:13.0:1773851879.534779:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851879.534780:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000800:00000200:13.0:1773851879.534781:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851879.534782:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851879.534783:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851879.534784:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851879.534784:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851879.534786:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851879.534787:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030886122688
00000020:00000001:12.0:1773851879.534788:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851879.534789:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911f1
00000020:00000001:12.0:1773851879.534790:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851879.534798:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b310dee7 refcount=6
00000020:00000001:12.0:1773851879.534799:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240529920 : -107152469021696 : ffff9e8b9f25ac00)
00000020:00000001:12.0:1773851879.534800:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240529920 : -107152469021696 : ffff9e8b9f25ac00)
00000100:00000001:12.0:1773851879.534801:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851879.534802:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851879.534802:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ebe075ad.
00000020:00000010:12.0:1773851879.534804:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851879.534804:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000074568ee0.
00000100:00000001:12.0:1773851879.534805:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851879.534806:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851879.534806:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.534807:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.534808:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851879.534810:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.534810:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.534810:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851879.534811:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851879.534812:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19451@kfi7, seq: 411190552
00000100:00000040:15.0:1773851879.534813:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b310dee7 : new rpc_count 1
00000100:00000001:12.0:1773851879.534814:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.534814:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.534815:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902262912 : -106994807288704 : ffff9eb05484cc80)
00000100:00000040:15.0:1773851879.534816:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a0d44bb5 x1858030886122688/t0(0) o41->9bfa694b-cad6-42e9-9ec8-d8f485ccc73e@19451@kfi7:606/0 lens 440/0 e 0 to 0 dl 1773851966 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne244-0'
00000100:00000001:15.0:1773851879.534820:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851879.534820:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851879.534821:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0d44bb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:9bfa694b-cad6-42e9-9ec8-d8f485ccc73e+6:111786:x1858030886122688:12345-19451@kfi7:41:default-tuolumne244-0
00000100:00000200:15.0:1773851879.534823:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030886122688
00000020:00000001:15.0:1773851879.534824:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851879.534825:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851879.534826:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851879.534826:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851879.534827:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:15.0:1773851879.534828:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851879.534829:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030886122688, found 0 last_xid 1858030886122687
00000020:00000001:15.0:1773851879.534829:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851879.534830:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851879.534831:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851879.534832:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.534832:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851879.534833:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851879.534834:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000006972b6af.
02000000:00000001:15.0:1773851879.534835:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.534836:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534837:0:60824:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:15.0:1773851879.534838:0:60824:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:15.0:1773851879.534839:0:60824:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534841:0:60824:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:15.0:1773851879.534842:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851879.534844:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534847:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851879.534847:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534849:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851879.534849:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534850:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851879.534851:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534853:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851879.534853:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534854:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851879.534855:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534857:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534858:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500108800 free, 351498039296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097688 files, 343261825 free files
00000004:00000001:15.0:1773851879.534860:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534861:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534862:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504325632 free, 351502170112 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056181 files, 343265943 free files
00000004:00000001:15.0:1773851879.534863:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534864:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534865:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690116096 free, 351687634944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231188 files, 343447379 free files
00000004:00000001:15.0:1773851879.534866:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534868:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534868:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382747136 free, 351380685824 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978698 files, 343147214 free files
00000004:00000001:15.0:1773851879.534870:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534871:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534872:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958986240 free, 350956917760 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563970 files, 342733385 free files
00000004:00000001:15.0:1773851879.534873:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534875:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534875:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351228416 free, 351348342784 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084058 files, 343116434 free files
00000004:00000001:15.0:1773851879.534876:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534878:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534878:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482152960 free, 351481205760 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097085 files, 343244290 free files
00000004:00000001:15.0:1773851879.534880:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534881:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534882:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449328640 free, 351446803456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160955 files, 343212235 free files
00000004:00000001:15.0:1773851879.534883:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534885:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534886:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353651200 free, 351351214080 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083311 files, 343118800 free files
00000004:00000001:15.0:1773851879.534887:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534888:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534889:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388964864 free, 351386286080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019060 files, 343153286 free files
00000004:00000001:15.0:1773851879.534890:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534891:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534892:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406563328 free, 351404190720 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127257 files, 343170472 free files
00000004:00000001:15.0:1773851879.534893:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534895:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534895:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351379010560 free, 351376041984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019049 files, 343143565 free files
00000004:00000001:15.0:1773851879.534896:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534898:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534898:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466009600 free, 351462818816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062839 files, 343228525 free files
00000004:00000001:15.0:1773851879.534899:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534900:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534901:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489062912 free, 351485961216 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066805 files, 343251038 free files
00000004:00000001:15.0:1773851879.534902:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534904:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534904:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492688896 free, 351490286592 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372077977 files, 343254579 free files
00000004:00000001:15.0:1773851879.534905:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534906:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534907:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524049920 free, 351521309696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113834 files, 343285205 free files
00000004:00000001:15.0:1773851879.534908:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534910:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534910:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510610944 free, 351507976192 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095741 files, 343272081 free files
00000004:00000001:15.0:1773851879.534912:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534913:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534913:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541486592 free, 351539420160 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136606 files, 343302233 free files
00000004:00000001:15.0:1773851879.534915:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534916:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534916:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470692352 free, 351461572608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064520 files, 343233098 free files
00000004:00000001:15.0:1773851879.534918:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534919:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534919:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666640896 free, 351645434880 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237822 files, 343424454 free files
00000004:00000001:15.0:1773851879.534920:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534921:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534922:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545811968 free, 351536147456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116422 files, 343306457 free files
00000004:00000001:15.0:1773851879.534923:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534924:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534925:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603943424 free, 351601693696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190429 files, 343363226 free files
00000004:00000001:15.0:1773851879.534926:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534927:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534927:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615877120 free, 351613277184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043433 files, 343374880 free files
00000004:00000001:15.0:1773851879.534929:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534930:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534930:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420254208 free, 351417807872 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008959 files, 343183842 free files
00000004:00000001:15.0:1773851879.534932:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534933:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534933:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409127424 free, 351407067136 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011300 files, 343172976 free files
00000004:00000001:15.0:1773851879.534935:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534936:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534936:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480018944 free, 351478660096 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073116 files, 343242206 free files
00000004:00000001:15.0:1773851879.534938:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534940:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534940:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593624576 free, 351576785920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189932 files, 343353149 free files
00000004:00000001:15.0:1773851879.534942:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534943:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851879.534943:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464067072 free, 351458185216 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064787 files, 343226628 free files
00000004:00000001:15.0:1773851879.534944:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534945:0:60824:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534946:0:60824:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:15.0:1773851879.534947:0:60824:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 66060288 granted 1839581985855 pending 396361728 free 40309314153349120 avail 40308834736013312
00000004:00000020:15.0:1773851879.534949:0:60824:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841141150720 free, 9841023992576 avail; 10969025192 objects: 9610489405 free; state 100
00000020:00000001:15.0:1773851879.534951:0:60824:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:15.0:1773851879.534955:0:60824:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851879.534956:0:60824:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851879.534957:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768342, transno 0, xid 1858030886122688
00010000:00000001:15.0:1773851879.534958:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851879.534959:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a0d44bb5 x1858030886122688/t0(0) o41->9bfa694b-cad6-42e9-9ec8-d8f485ccc73e@19451@kfi7:606/0 lens 440/368 e 0 to 0 dl 1773851966 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne244-0'
00010000:00000001:15.0:1773851879.534962:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851879.534962:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851879.534963:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=112 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851879.534964:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851879.534965:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000020c12e0 refcount 5 to 19451@kfi7
00000100:00000001:15.0:1773851879.534966:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151072 : -107154898400544 : ffff9e8b0e584ae0)
02000000:00000001:15.0:1773851879.534967:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851879.534967:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.534968:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851879.534969:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19451@kfi7
00000400:00000010:15.0:1773851879.534969:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c2b163d5.
00000100:00000200:15.0:1773851879.534970:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030886122688, offset 224
00000400:00000200:15.0:1773851879.534972:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19451@kfi7
00000400:00000200:15.0:1773851879.534973:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:15.0:1773851879.534974:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 1
00000400:00000200:15.0:1773851879.534975:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000400:00000200:15.0:1773851879.534976:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 3
00000400:00000200:15.0:1773851879.534978:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19451@kfi7 local destination
00000400:00000200:15.0:1773851879.534979:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769645:8769645:1024:4294967295] 19451@kfi7 LPNI seq info [28186:28186:16:4294967295]
00000400:00000200:15.0:1773851879.534981:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000400:00000200:15.0:1773851879.534981:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:15.0:1773851879.534983:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19451@kfi7(19451@kfi7:19451@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851879.534985:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 3
00000800:00000200:15.0:1773851879.534986:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851879.534988:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:15.0:1773851879.534990:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851879.534992:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bd Using peer 19451@kfi7(0x1000000000002bd)
00000800:00000200:15.0:1773851879.534995:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 468 bytes to peer 0x1000000000002bd: rc=0
00000800:00000200:15.0:1773851879.534997:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851879.534999:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851879.535000:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000020c12e0 refcount 4 to 19451@kfi7
00010000:00000001:15.0:1773851879.535000:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851879.535001:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851879.535002:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851879.535003:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0d44bb5 x1858030886122688/t0(0) o41->9bfa694b-cad6-42e9-9ec8-d8f485ccc73e@19451@kfi7:606/0 lens 440/368 e 0 to 0 dl 1773851966 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne244-0'
00000100:00100000:15.0:1773851879.535006:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0d44bb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:9bfa694b-cad6-42e9-9ec8-d8f485ccc73e+6:111786:x1858030886122688:12345-19451@kfi7:41:default-tuolumne244-0 Request processed in 185us (229us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851879.535009:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19451@kfi7, seq: 411190552
00000100:00000040:15.0:1773851879.535010:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b310dee7 : new rpc_count 0
00000800:00000200:14.0:1773851879.535010:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bd TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851879.535011:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851879.535011:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851879.535012:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000400:00000200:14.0:1773851879.535012:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851879.535013:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000074568ee0.
00000400:00000200:14.0:1773851879.535013:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19451@kfi7: PUT: OK
00000020:00000010:15.0:1773851879.535014:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ebe075ad.
00000020:00000040:15.0:1773851879.535014:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000b310dee7 : new refcount 5
00000400:00000200:14.0:1773851879.535014:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c2b163d5
00000100:00000001:15.0:1773851879.535015:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:14.0:1773851879.535015:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c2b163d5.
00000100:00000001:14.0:1773851879.535015:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851879.535016:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851879.535017:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000800:00000200:14.0:1773851879.535019:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 19451@kfi7(00000000c5b4cd02):0x0 lsk 702 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000002bd Transaction freed
00010000:00000001:2.0:1773851879.561731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561738:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851879.561738:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851879.561739:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561739:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851879.561740:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561740:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561741:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561742:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851879.561743:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851879.561743:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561744:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851879.561744:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561745:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561746:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561747:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851879.561747:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851879.561748:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561748:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851879.561749:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561749:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561750:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851879.561751:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851879.561751:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851879.561756:0:937835:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:29.0:1773851879.561757:0:937835:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851879.561758:0:937835:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851879.677236:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851879.677238:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851879.677240:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851879.677244:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851879.677248:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17088@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.677250:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17088@kfi7 : PUT - for me
00000400:00000200:25.0:1773851879.677252:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17088@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.677253:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000003605690 nid 17088@kfi7 refs 1
00000400:00000200:25.0:1773851879.677255:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17088@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.677256:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000003605690 nid 17088@kfi7 refs 2
00000400:00000200:25.0:1773851879.677258:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000003605690 nid 17088@kfi7 refs 3
00000400:00000200:25.0:1773851879.677260:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16897@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.677261:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16897@kfi7 of length 224 into portal 12 MB=0x69b4b62503140
00000400:00000200:25.0:1773851879.677264:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16897@kfi7 of length 224/224 into md 0x16159c9699 [64] + 26144
00000800:00000200:25.0:1773851879.677267:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851879.677270:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851879.677272:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17088@kfi7: PUT: OK
00000100:00000001:25.0:1773851879.677273:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851879.677274:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851879.677275:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a47d62e0.
00000100:00000040:25.0:1773851879.677276:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000a47d62e0 x1859597934539072 msgsize 224
00000100:00100000:25.0:1773851879.677279:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16897@kfi7 (source: 12345-17088@kfi7)
00000100:00000001:25.0:1773851879.677281:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851879.677282:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000003605690 nid 17088@kfi7 refs 2
00000100:00000001:27.0:1773851879.677284:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851879.677285:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851879.677285:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851879.677286:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851879.677286:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851879.677288:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851879.677289:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597934539072
00000020:00000001:27.0:1773851879.677291:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851879.677291:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81564
00000020:00000001:27.0:1773851879.677293:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851879.677295:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005d18176f refcount=5
00000020:00000001:27.0:1773851879.677296:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097955883008 : -106975753668608 : ffff9eb4c433f800)
00000020:00000001:27.0:1773851879.677298:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097955883008 : -106975753668608 : ffff9eb4c433f800)
00000100:00000001:27.0:1773851879.677300:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.677313:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851879.677314:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000069daf706.
00000020:00000010:27.0:1773851879.677316:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851879.677318:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851879.677319:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851879.677320:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851879.677321:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.677322:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851879.677323:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851879.677324:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.677326:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851879.677328:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851879.677329:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851879.677329:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851879.677330:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851879.677331:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16897@kfi7, seq: 2025142
00000100:00000040:27.0:1773851879.677332:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005d18176f : new rpc_count 1
00000100:00000001:26.0:1773851879.677332:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.677333:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252473088 : -106967457078528 : ffff9eb6b2b7e300)
00000100:00000001:26.0:1773851879.677333:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.677336:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a47d62e0 x1859597934539072/t0(0) o400->13cdfe3f-408d-4b4c-a8f9-f7d3602e8f2d@16897@kfi7:129/0 lens 224/0 e 0 to 0 dl 1773852244 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1555-0'
00000100:00000001:27.0:1773851879.677341:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851879.677342:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851879.677344:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a47d62e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:13cdfe3f-408d-4b4c-a8f9-f7d3602e8f2d+5:39550:x1859597934539072:12345-16897@kfi7:400:default-tuolumne1555-0
00000100:00000200:27.0:1773851879.677346:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597934539072
00000020:00000001:27.0:1773851879.677348:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851879.677349:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851879.677350:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.677351:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851879.677352:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851879.677353:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851879.677354:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597934539072, found 0 last_xid 1859597934539071
00000020:00000001:27.0:1773851879.677356:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851879.677357:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851879.677358:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851879.677359:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.677361:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851879.677362:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851879.677363:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851879.677365:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000954e1708.
02000000:00000001:27.0:1773851879.677366:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.677368:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.677369:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851879.677370:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044175833, transno 0, xid 1859597934539072
00010000:00000001:27.0:1773851879.677372:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851879.677373:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a47d62e0 x1859597934539072/t0(0) o400->13cdfe3f-408d-4b4c-a8f9-f7d3602e8f2d@16897@kfi7:129/0 lens 224/224 e 0 to 0 dl 1773852244 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1555-0'
00010000:00000001:27.0:1773851879.677378:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851879.677379:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851879.677381:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=112 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851879.677383:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851879.677384:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0b62a65 refcount 3 to 16897@kfi7
00000100:00000001:27.0:1773851879.677385:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985418112 : -107156724133504 : ffff9e8aa185d180)
02000000:00000001:27.0:1773851879.677387:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851879.677388:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851879.677389:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851879.677390:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17088@kfi7
00000400:00000010:27.0:1773851879.677391:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000705ba323.
00000100:00000200:27.0:1773851879.677392:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597934539072, offset 224
00000400:00000200:27.0:1773851879.677395:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17088@kfi7
00000400:00000200:27.0:1773851879.677397:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17088@kfi7 to cpt 6
00000400:00000200:27.0:1773851879.677398:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000003605690 nid 17088@kfi7 refs 1
00000400:00000200:27.0:1773851879.677400:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000003605690 nid 17088@kfi7 refs 2
00000400:00000200:27.0:1773851879.677402:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000003605690 nid 17088@kfi7 refs 3
00000400:00000200:27.0:1773851879.677405:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17088@kfi7 local destination
00000400:00000200:27.0:1773851879.677407:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769646:8769646:1024:4294967295] 17088@kfi7 LPNI seq info [1182847:1182847:16:4294967295]
00000400:00000200:27.0:1773851879.677410:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000003605690 nid 17088@kfi7 refs 2
00000400:00000200:27.0:1773851879.677411:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17088@kfi7 to cpt 6
00000400:00000200:27.0:1773851879.677415:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17088@kfi7(17088@kfi7:17088@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851879.677418:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000003605690 nid 17088@kfi7 refs 3
00000800:00000200:27.0:1773851879.677421:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851879.677422:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851879.677426:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851879.677430:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f4e Using peer 17088@kfi7(0x100000000000f4e)
00000800:00000200:27.0:1773851879.677433:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x100000000000f4e: rc=0
00000800:00000200:27.0:1773851879.677435:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f4e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851879.677437:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851879.677438:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0b62a65 refcount 2 to 16897@kfi7
00010000:00000001:27.0:1773851879.677439:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851879.677440:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851879.677440:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851879.677441:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a47d62e0 x1859597934539072/t0(0) o400->13cdfe3f-408d-4b4c-a8f9-f7d3602e8f2d@16897@kfi7:129/0 lens 224/224 e 0 to 0 dl 1773852244 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1555-0'
00000100:00100000:27.0:1773851879.677445:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a47d62e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:13cdfe3f-408d-4b4c-a8f9-f7d3602e8f2d+5:39550:x1859597934539072:12345-16897@kfi7:400:default-tuolumne1555-0 Request processed in 102us (167us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851879.677447:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16897@kfi7, seq: 2025142
00000100:00000040:27.0:1773851879.677448:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005d18176f : new rpc_count 0
00000800:00000200:25.0:1773851879.677448:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f4e TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851879.677449:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851879.677449:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851879.677450:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851879.677450:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851879.677451:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851879.677451:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000069daf706.
00000400:00000200:25.0:1773851879.677451:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17088@kfi7: PUT: OK
00000020:00000040:27.0:1773851879.677452:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000005d18176f : new refcount 4
00000400:00000200:25.0:1773851879.677452:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000705ba323
00000400:00000010:25.0:1773851879.677452:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000705ba323.
00000100:00000001:27.0:1773851879.677453:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851879.677453:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851879.677453:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851879.677455:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000003605690 nid 17088@kfi7 refs 2
00000800:00000200:25.0:1773851879.677457:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 17088@kfi7(000000008e5e3f22):0x0 lsk 3919 rsk 3 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f4e Transaction freed
00000800:00000200:17.0:1773851879.719334:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.719335:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851879.719337:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851879.719339:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851879.719340:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19682@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.719341:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19682@kfi7 : PUT - for me
00000400:00000200:17.0:1773851879.719342:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19682@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.719343:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096f65c56 nid 19682@kfi7 refs 1
00000400:00000200:17.0:1773851879.719344:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19682@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.719345:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096f65c56 nid 19682@kfi7 refs 2
00000400:00000200:17.0:1773851879.719346:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096f65c56 nid 19682@kfi7 refs 3
00000400:00000200:17.0:1773851879.719347:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19683@kfi7 to cpt 0
00000400:00000200:17.0:1773851879.719348:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19683@kfi7 of length 224 into portal 12 MB=0x699e15bda5200
00000400:00000200:17.0:1773851879.719349:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19683@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 28920
00000800:00000200:17.0:1773851879.719350:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851879.719354:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851879.719355:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19682@kfi7: PUT: OK
00000100:00000001:17.0:1773851879.719356:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851879.719356:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851879.719357:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8832e93.
00000100:00000040:17.0:1773851879.719358:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000d8832e93 x1858043047989760 msgsize 224
00000100:00100000:17.0:1773851879.719359:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19683@kfi7 (source: 12345-19682@kfi7)
00000100:00000001:17.0:1773851879.719360:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851879.719361:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096f65c56 nid 19682@kfi7 refs 2
00000800:00000200:17.0:1773851879.719362:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851879.719365:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851879.719365:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851879.719366:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851879.719366:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851879.719367:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851879.719368:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043047989760
00000020:00000001:17.0:1773851879.719368:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851879.719369:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916dd
00000020:00000001:17.0:1773851879.719369:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851879.719371:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000afd95e7c refcount=710
00000020:00000001:17.0:1773851879.719372:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241481216 : -107152468070400 : ffff9e8b9f343000)
00000020:00000001:17.0:1773851879.719373:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241481216 : -107152468070400 : ffff9e8b9f343000)
00000100:00000001:17.0:1773851879.719374:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.719374:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851879.719375:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851879.719376:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851879.719377:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851879.719378:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851879.719378:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851879.719378:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.719379:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851879.719380:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851879.719381:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.719381:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.719383:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851879.719383:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851879.719384:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19683@kfi7, seq: 2156376
00000100:00000001:16.0:1773851879.719384:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:17.0:1773851879.719385:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000afd95e7c : new rpc_count 11
00000100:00000001:17.0:1773851879.719385:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985307904 : -106952724243712 : ffff9eba20dd1b00)
00000100:00000001:16.0:1773851879.719385:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851879.719386:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d8832e93 x1858043047989760/t0(0) o400->93368f21-5f10-4a11-aee1-c989c3028670@19683@kfi7:100/0 lens 224/0 e 0 to 0 dl 1773852215 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1707-0'
00000100:00000001:16.0:1773851879.719386:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851879.719387:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.719389:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.719390:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851879.719391:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8832e93 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:93368f21-5f10-4a11-aee1-c989c3028670+710:39845:x1858043047989760:12345-19683@kfi7:400:default-tuolumne1707-0
00000100:00000200:17.0:1773851879.719392:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043047989760
00000020:00000001:17.0:1773851879.719393:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851879.719393:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851879.719394:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.719394:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851879.719395:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851879.719396:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851879.719396:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043047989760, found 0 last_xid 1858043040999167
00000020:00000001:17.0:1773851879.719397:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851879.719398:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851879.719398:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851879.719399:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.719400:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851879.719400:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851879.719401:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851879.719401:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000068c52c48.
02000000:00000001:17.0:1773851879.719402:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.719403:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.719403:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851879.719404:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583300, transno 0, xid 1858043047989760
00010000:00000001:17.0:1773851879.719405:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851879.719406:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d8832e93 x1858043047989760/t0(0) o400->93368f21-5f10-4a11-aee1-c989c3028670@19683@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1707-0'
00010000:00000001:17.0:1773851879.719408:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851879.719409:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851879.719409:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=112 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851879.719410:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851879.719411:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009d09723a refcount 3 to 19683@kfi7
00000100:00000001:17.0:1773851879.719412:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002752 : -107146751548864 : ffff9e8cf3ef6240)
02000000:00000001:17.0:1773851879.719413:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851879.719413:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.719414:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851879.719415:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19682@kfi7
00000400:00000010:17.0:1773851879.719415:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002b4feb6f.
00000100:00000200:17.0:1773851879.719416:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043047989760, offset 224
00000400:00000200:17.0:1773851879.719417:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19682@kfi7
00000400:00000200:17.0:1773851879.719419:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19682@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.719419:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096f65c56 nid 19682@kfi7 refs 1
00000400:00000200:17.0:1773851879.719420:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096f65c56 nid 19682@kfi7 refs 2
00000400:00000200:17.0:1773851879.719421:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096f65c56 nid 19682@kfi7 refs 3
00000400:00000200:17.0:1773851879.719422:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19682@kfi7 local destination
00000400:00000200:17.0:1773851879.719424:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769647:8769647:1024:4294967295] 19682@kfi7 LPNI seq info [973254:973254:16:4294967295]
00000400:00000200:17.0:1773851879.719425:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096f65c56 nid 19682@kfi7 refs 2
00000400:00000200:17.0:1773851879.719426:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19682@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.719428:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19682@kfi7(19682@kfi7:19682@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851879.719429:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096f65c56 nid 19682@kfi7 refs 3
00000800:00000200:17.0:1773851879.719430:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.719431:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851879.719433:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851879.719435:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb Using peer 19682@kfi7(0xdb)
00000800:00000200:17.0:1773851879.719438:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0xdb: rc=0
00000800:00000200:17.0:1773851879.719440:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851879.719442:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851879.719442:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009d09723a refcount 2 to 19683@kfi7
00010000:00000001:17.0:1773851879.719443:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851879.719443:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.719444:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851879.719445:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8832e93 x1858043047989760/t0(0) o400->93368f21-5f10-4a11-aee1-c989c3028670@19683@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1707-0'
00000100:00100000:17.0:1773851879.719448:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8832e93 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:93368f21-5f10-4a11-aee1-c989c3028670+710:39845:x1858043047989760:12345-19683@kfi7:400:default-tuolumne1707-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851879.719450:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19683@kfi7, seq: 2156376
00000100:00000040:17.0:1773851879.719450:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000afd95e7c : new rpc_count 10
00000100:00000001:17.0:1773851879.719451:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851879.719451:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851879.719452:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851879.719453:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851879.719453:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000800:00000200:19.0:1773851879.719454:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb TN_EVENT_TX_OK event status 0
00000020:00000040:17.0:1773851879.719454:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000afd95e7c : new refcount 709
00000400:00000200:19.0:1773851879.719455:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851879.719455:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851879.719457:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19682@kfi7: PUT: OK
00000400:00000200:19.0:1773851879.719457:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002b4feb6f
00000400:00000010:19.0:1773851879.719458:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002b4feb6f.
00000100:00000001:19.0:1773851879.719459:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851879.719459:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851879.719460:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096f65c56 nid 19682@kfi7 refs 2
00000800:00000200:19.0:1773851879.719462:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2069@kfi7:4 -> 19682@kfi7(000000001b865d89):0x0 lsk 220 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdb Transaction freed
00000004:00000001:4.0:1773851879.753730:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851879.753731:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:4.0:1773851879.753731:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851879.753732:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:7.0:1773851879.753732:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:4.0:1773851879.753732:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002737bf0b.
00000020:00000040:4.0:1773851879.753732:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000010:30.0:1773851879.753733:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005d50b08c.
00000004:00000020:7.0:1773851879.753733:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851879.753733:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b9a17ed.
00000004:00000001:5.0:1773851879.753733:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851879.753733:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:4.0:1773851879.753733:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:30.0:1773851879.753734:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000100:00000010:5.0:1773851879.753734:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e62e4afc.
02000000:00000001:4.0:1773851879.753734:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851879.753735:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:7.0:1773851879.753735:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
02000000:00000001:4.0:1773851879.753735:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851879.753736:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:7.0:1773851879.753736:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851879.753736:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:5.0:1773851879.753736:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
02000000:00000010:4.0:1773851879.753736:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000015991966.
00000100:00000001:5.0:1773851879.753737:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851879.753737:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851879.753737:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851879.753738:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851879.753738:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851879.753738:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753738:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851879.753738:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851879.753739:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000005711a3d9.
02000000:00000010:7.0:1773851879.753739:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000daca50c1.
00000100:00000001:7.0:1773851879.753739:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851879.753739:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000100f702c.
00000100:00000040:4.0:1773851879.753739:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002737bf0b] to pc [ptlrpcd_01_01+1]  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851879.753740:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851879.753740:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851879.753741:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753741:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851879.753741:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005b9a17ed] to pc [ptlrpcd_01_02+2]  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851879.753741:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851879.753742:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851879.753742:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851879.753743:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851879.753743:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e62e4afc] to pc [ptlrpcd_01_03+3]  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851879.753744:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005d50b08c] to pc [ptlrpcd_07_02+2]  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:4.0:1773851879.753744:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753745:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851879.753745:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000001:7.0:1773851879.753746:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753746:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:4.0:1773851879.753746:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851879.753746:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753747:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:6.0:1773851879.753747:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851879.753748:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851879.753748:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851879.753749:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:7.0:1773851879.753749:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851879.753749:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851879.753749:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851879.753750:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851879.753750:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:30.0:1773851879.753750:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bbafe549.
00000100:00000001:6.0:1773851879.753750:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851879.753750:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851879.753750:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851879.753750:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851879.753751:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851879.753751:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637058028497920 : -107015681053696 : ffff9eab78586c00)
00000100:00000001:28.0:1773851879.753751:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851879.753751:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753751:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851879.753751:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851879.753751:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000010:5.0:1773851879.753751:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f88a82b3.
00000100:00000001:4.0:1773851879.753751:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851879.753751:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:31.0:1773851879.753752:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851879.753752:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:7.0:1773851879.753752:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851879.753752:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851879.753752:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637137300839424 : -106936408712192 : ffff9ebded585c00)
02000000:00000001:7.0:1773851879.753753:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851879.753753:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b9a17ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051933312:7@kfi7:41:default-yuba2-0
00000100:00100000:6.0:1773851879.753753:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002737bf0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051933248:2098@kfi7:41:default-yuba2-0
00080000:00000001:5.0:1773851879.753753:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:4.0:1773851879.753753:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851879.753754:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753754:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:6.0:1773851879.753754:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851879.753755:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:30.0:1773851879.753755:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000004:00000010:30.0:1773851879.753755:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ea398889.
02000000:00000001:6.0:1773851879.753755:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:5.0:1773851879.753755:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851879.753755:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000100:00000001:4.0:1773851879.753755:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851879.753756:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851879.753756:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614154207031607ns, next at 614155207030625ns, rc = 0
02000000:00000001:6.0:1773851879.753756:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851879.753756:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000010:5.0:1773851879.753756:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003526249d.
00000100:00000001:4.0:1773851879.753756:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851879.753757:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851879.753757:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851879.753757:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851879.753757:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851879.753757:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851879.753757:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006d4a620a.
00000004:00080000:5.0:1773851879.753757:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614154207033010ns, next at 614155207031577ns, rc = 0
02000000:00000001:4.0:1773851879.753757:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:31.0:1773851879.753758:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005d50b08c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051933440:2080@kfi7:13:default-yuba2-0
00080000:00000001:30.0:1773851879.753758:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851879.753758:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851879.753758:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000079e097e6.
02000000:00000001:6.0:1773851879.753758:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851879.753758:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851879.753759:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851879.753759:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851879.753759:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00080000:00000001:5.0:1773851879.753759:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:4.0:1773851879.753759:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e62e4afc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051933376:3@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851879.753760:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:5.0:1773851879.753760:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851879.753760:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753760:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851879.753761:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851879.753761:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851879.753761:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:7.0:1773851879.753761:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:6.0:1773851879.753761:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000400:00000010:6.0:1773851879.753761:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003599bb60.
02000000:00000001:4.0:1773851879.753761:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851879.753761:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851879.753762:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:7.0:1773851879.753762:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e33961df.
02000000:00000001:4.0:1773851879.753762:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:31.0:1773851879.753763:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f14d9ff9.
00000100:00000200:7.0:1773851879.753763:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933312, portal 4
00000100:00000200:6.0:1773851879.753763:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933248, portal 4
00000100:00000001:6.0:1773851879.753763:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000010:4.0:1773851879.753763:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000440074eb.
02000000:00000001:31.0:1773851879.753764:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753764:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851879.753764:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309133952 : -106994400417664 : ffff9eb06cc52880)
00000100:00000001:6.0:1773851879.753764:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528697216 : -106978180854400 : ffff9eb433880d80)
02000000:00000001:4.0:1773851879.753764:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851879.753765:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000040:7.0:1773851879.753765:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851879.753765:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851879.753765:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000010:31.0:1773851879.753766:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000400:00000010:4.0:1773851879.753766:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000010:4.0:1773851879.753766:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007d52025f.
00000400:00000010:31.0:1773851879.753767:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000200:31.0:1773851879.753768:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933440, portal 4
00000100:00000001:7.0:1773851879.753768:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851879.753768:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:4.0:1773851879.753768:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933376, portal 4
00000100:00000001:31.0:1773851879.753769:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:7.0:1773851879.753769:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000100:00000040:6.0:1773851879.753769:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000100:00000001:4.0:1773851879.753769:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851879.753769:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637135108952320 : -106938600599296 : ffff9ebd6ab2d100)
00000100:00000001:31.0:1773851879.753770:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411268736 : -106960298282880 : ffff9eb85d6a7080)
00000400:00000010:7.0:1773851879.753770:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000045c9ef1.
00000100:00000200:7.0:1773851879.753770:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051933312, offset 0
00000400:00000010:6.0:1773851879.753770:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000183eed5a.
00000100:00000200:6.0:1773851879.753770:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051933248, offset 0
00000100:00000040:31.0:1773851879.753771:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851879.753771:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851879.753772:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:7.0:1773851879.753773:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:6.0:1773851879.753773:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:4.0:1773851879.753773:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:31.0:1773851879.753774:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:6.0:1773851879.753774:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000100:00000040:4.0:1773851879.753774:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000100:00000040:31.0:1773851879.753775:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000200:6.0:1773851879.753775:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000010:4.0:1773851879.753775:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000970b84f9.
00000100:00000200:4.0:1773851879.753775:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933376, offset 0
00000400:00000010:31.0:1773851879.753776:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000051546e8a.
00000400:00000200:6.0:1773851879.753776:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:4.0:1773851879.753776:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000100:00000200:31.0:1773851879.753777:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933440, offset 0
00000400:00000200:6.0:1773851879.753777:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000400:00000200:31.0:1773851879.753778:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:31.0:1773851879.753779:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851879.753779:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769647, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769646, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851879.753780:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:31.0:1773851879.753781:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:6.0:1773851879.753781:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851879.753782:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851879.753782:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851879.753783:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:6.0:1773851879.753783:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346206, 20346204]
00000400:00000200:31.0:1773851879.753784:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:6.0:1773851879.753785:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000400:00000200:31.0:1773851879.753786:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769647, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769646, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851879.753787:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769648:8769648:1024:4294967295] 2105@kfi7 LPNI seq info [20346207:20346207:16:4294967295]
00000400:00000200:31.0:1773851879.753788:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:6.0:1773851879.753788:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:6.0:1773851879.753789:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:7.0:1773851879.753790:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:7.0:1773851879.753791:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:7.0:1773851879.753792:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:6.0:1773851879.753792:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851879.753793:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:6.0:1773851879.753793:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:31.0:1773851879.753794:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851879.753795:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:7.0:1773851879.753795:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000800:00000200:6.0:1773851879.753795:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:31.0:1773851879.753796:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769649:8769649:1024:4294967295] 2080@kfi7 LPNI seq info [5404393:5404393:16:4294967295]
00000400:00000200:7.0:1773851879.753796:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769649, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769648, p:4294967295, g:4294967295, h:1000]
00000800:00000200:6.0:1773851879.753797:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851879.753798:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851879.753798:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851879.753799:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851879.753799:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851879.753800:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851879.753801:0:41066:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340066, 17340064]
00000400:00000200:31.0:1773851879.753802:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851879.753803:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851879.753803:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000400:00000200:7.0:1773851879.753804:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769650:8769650:1023:4294967295] 7@kfi7 LPNI seq info [17340067:17340067:16:4294967295]
00000800:00000200:31.0:1773851879.753805:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:7.0:1773851879.753806:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:31.0:1773851879.753807:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851879.753807:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:4.0:1773851879.753808:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:31.0:1773851879.753809:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851879.753809:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:7.0:1773851879.753810:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851879.753810:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:6.0:1773851879.753811:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851879.753812:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Using peer 2080@kfi7(0x64e)
00000400:00000200:7.0:1773851879.753812:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:4.0:1773851879.753812:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:7.0:1773851879.753813:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851879.753813:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000400:00000200:4.0:1773851879.753813:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000800:00000200:7.0:1773851879.753814:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851879.753814:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769650, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769648, p:4294967295, g:4294967295, h:1000]
00000800:00000200:31.0:1773851879.753815:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x64e: rc=0
00000400:00000200:4.0:1773851879.753816:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:31.0:1773851879.753817:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851879.753817:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851879.753817:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 324 bytes to peer 0x20000000000085c: rc=0
00000400:00000200:4.0:1773851879.753817:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851879.753818:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000100:00000001:31.0:1773851879.753819:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851879.753819:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851879.753819:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769651:8769651:1023:4294967295] 3@kfi7 LPNI seq info [5406223:5406223:16:4294967295]
00000100:00000001:31.0:1773851879.753820:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:7.0:1773851879.753820:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Using peer 7@kfi7(0x11b1)
00000100:00000001:31.0:1773851879.753821:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851879.753821:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753821:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851879.753821:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:31.0:1773851879.753822:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851879.753822:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851879.753822:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:31.0:1773851879.753823:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851879.753823:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:7.0:1773851879.753823:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x11b1: rc=0
00000100:00000001:6.0:1773851879.753823:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753823:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851879.753824:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851879.753824:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851879.753824:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851879.753825:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851879.753825:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851879.753825:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851879.753826:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753826:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753826:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:4.0:1773851879.753826:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851879.753827:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851879.753827:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851879.753827:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851879.753827:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851879.753827:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:30.0:1773851879.753828:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851879.753828:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753828:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753828:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753829:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851879.753829:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:30.0:1773851879.753830:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851879.753830:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:30.0:1773851879.753831:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000100:00000001:7.0:1773851879.753831:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851879.753831:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851879.753831:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851879.753832:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000051546e8a
00000100:00000001:7.0:1773851879.753832:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851879.753833:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000051546e8a.
00000100:00000001:30.0:1773851879.753833:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851879.753834:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851879.753836:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851879.753837:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:4.0:1773851879.753837:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000040:30.0:1773851879.753838:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851879.753838:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851879.753839:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851879.753839:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851879.753839:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851879.753840:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000001:30.0:1773851879.753841:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851879.753841:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851879.753841:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000400:00000200:5.0:1773851879.753841:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000183eed5a
00000800:00000200:4.0:1773851879.753841:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851879.753842:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:6.0:1773851879.753842:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000045c9ef1
00000400:00000010:5.0:1773851879.753842:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000183eed5a.
00000400:00000010:6.0:1773851879.753843:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000045c9ef1.
00000100:00000001:5.0:1773851879.753843:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851879.753843:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851879.753843:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Using peer 3@kfi7(0x2000000000003b5)
00000800:00000200:30.0:1773851879.753844:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Transaction freed
00000100:00000001:6.0:1773851879.753844:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851879.753844:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851879.753846:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:4.0:1773851879.753846:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x2000000000003b5: rc=0
00000100:00000001:6.0:1773851879.753847:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851879.753847:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851879.753848:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851879.753848:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851879.753849:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753850:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851879.753850:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753850:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851879.753851:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851879.753851:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851879.753851:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753851:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851879.753852:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:4.0:1773851879.753852:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851879.753853:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:4.0:1773851879.753853:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851879.753853:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:6.0:1773851879.753854:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Transaction freed
00000800:00000200:5.0:1773851879.753854:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000085c Transaction freed
00000100:00000001:4.0:1773851879.753855:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851879.753856:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851879.753859:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753860:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851879.753862:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851879.753864:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851879.753865:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000800:00000200:25.0:1773851879.753866:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:5.0:1773851879.753866:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000970b84f9
00000400:00000010:5.0:1773851879.753866:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000970b84f9.
00000800:00000200:25.0:1773851879.753867:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:5.0:1773851879.753867:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:25.0:1773851879.753868:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:5.0:1773851879.753868:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851879.753870:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:5.0:1773851879.753870:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:25.0:1773851879.753871:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851879.753871:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851879.753871:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000040:5.0:1773851879.753871:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851879.753872:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851879.753872:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851879.753873:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000001:5.0:1773851879.753873:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851879.753873:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851879.753874:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2105@kfi7 : PUT - for me
00000800:00000200:9.0:1773851879.753874:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851879.753875:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851879.753875:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:25.0:1773851879.753876:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:5.0:1773851879.753876:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Transaction freed
00000400:00000200:25.0:1773851879.753877:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:13.0:1773851879.753877:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:9.0:1773851879.753877:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851879.753878:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851879.753879:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:13.0:1773851879.753879:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:9.0:1773851879.753879:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:25.0:1773851879.753880:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:13.0:1773851879.753880:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851879.753881:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851879.753881:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:13.0:1773851879.753882:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:9.0:1773851879.753882:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:25.0:1773851879.753883:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4a40
00000400:00000200:13.0:1773851879.753883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851879.753883:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:25.0:1773851879.753884:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:13.0:1773851879.753884:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:13.0:1773851879.753885:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:9.0:1773851879.753885:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:25.0:1773851879.753886:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b31625 [1] + 224
00000400:00000200:13.0:1773851879.753886:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851879.753886:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:13.0:1773851879.753887:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4a80
00000400:00000200:9.0:1773851879.753887:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:25.0:1773851879.753888:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851879.753888:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851879.753888:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851879.753889:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4b00
00000400:00000200:25.0:1773851879.753890:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851879.753890:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f686d [1] + 224
00000400:00000200:9.0:1773851879.753890:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:25.0:1773851879.753891:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851879.753892:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851879.753892:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781698129 [1] + 224
00000800:00000200:13.0:1773851879.753893:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:25.0:1773851879.753894:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851879.753895:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851879.753895:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851879.753896:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:13.0:1773851879.753896:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000800:00000200:29.0:1773851879.753897:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:25.0:1773851879.753897:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851879.753897:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851879.753898:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851879.753898:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000800:00000200:29.0:1773851879.753899:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:13.0:1773851879.753899:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851879.753899:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851879.753900:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851879.753901:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:29.0:1773851879.753902:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851879.753902:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000040:13.0:1773851879.753902:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851879.753903:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851879.753903:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:6.0:1773851879.753904:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:29.0:1773851879.753905:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:25.0:1773851879.753905:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000001:6.0:1773851879.753905:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851879.753906:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 3@kfi7 : PUT - for me
00000100:00000001:13.0:1773851879.753906:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:9.0:1773851879.753906:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851879.753906:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851879.753906:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003599bb60
00000400:00000200:13.0:1773851879.753907:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000010:6.0:1773851879.753907:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003599bb60.
00000100:00000001:6.0:1773851879.753907:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851879.753908:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:7.0:1773851879.753908:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851879.753908:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:6.0:1773851879.753908:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851879.753909:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000001:7.0:1773851879.753909:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851879.753909:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851879.753910:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:13.0:1773851879.753910:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000010:7.0:1773851879.753910:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:29.0:1773851879.753911:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:9.0:1773851879.753911:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:7.0:1773851879.753911:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e33961df
00000400:00000010:7.0:1773851879.753911:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e33961df.
00000100:00000200:6.0:1773851879.753911:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851879.753912:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:9.0:1773851879.753912:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:7.0:1773851879.753912:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851879.753913:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851879.753913:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851879.753913:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000200:7.0:1773851879.753913:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:31.0:1773851879.753914:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:29.0:1773851879.753914:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4ac0
00000800:00000200:9.0:1773851879.753914:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851879.753914:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851879.753914:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:31.0:1773851879.753915:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851879.753915:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000100:00000001:6.0:1773851879.753915:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851879.753915:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:31.0:1773851879.753916:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000400:00000200:29.0:1773851879.753916:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000200:7.0:1773851879.753916:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851879.753916:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:29.0:1773851879.753917:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78008119d [1] + 224
00000100:00000001:6.0:1773851879.753917:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851879.753917:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851879.753918:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:31.0:1773851879.753918:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:6.0:1773851879.753918:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=112 v=66 (66 66 66 66)
00000100:00000200:31.0:1773851879.753919:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:6.0:1773851879.753919:0:41065:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=112 v=66 (1 1 1 1)
00000800:00000200:29.0:1773851879.753920:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851879.753920:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851879.753920:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851879.753921:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851879.753921:0:41066:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:6.0:1773851879.753921:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851879.753921:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:31.0:1773851879.753922:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851879.753922:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:7.0:1773851879.753922:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851879.753922:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:6.0:1773851879.753922:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851879.753923:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000100:00000001:7.0:1773851879.753923:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851879.753923:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753923:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851879.753923:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:31.0:1773851879.753924:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851879.753924:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:7.0:1773851879.753924:0:41066:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=138 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851879.753924:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851879.753924:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851879.753925:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:7.0:1773851879.753925:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=144 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851879.753926:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851879.753926:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851879.753926:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:29.0:1773851879.753926:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851879.753926:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:6.0:1773851879.753926:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851879.753927:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851879.753927:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851879.753927:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:31.0:1773851879.753928:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851879.753928:0:41066:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753928:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:31.0:1773851879.753929:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=112 v=66 (66 66 66 66)
00000100:00000040:29.0:1773851879.753929:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851879.753929:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851879.753929:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:6.0:1773851879.753929:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00001000:31.0:1773851879.753930:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=112 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851879.753930:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851879.753930:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753930:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851879.753930:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851879.753931:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851879.753931:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851879.753931:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:6.0:1773851879.753931:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000000 blocks, 31354645376 free, 31354603200 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064079 files, 2870603519 free files
00010000:00000001:31.0:1773851879.753932:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851879.753933:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851879.753933:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:29.0:1773851879.753933:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851879.753933:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:6.0:1773851879.753933:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851879.753934:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00000001:7.0:1773851879.753934:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851879.753934:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:6.0:1773851879.753934:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851879.753935:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851879.753935:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851879.753935:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000004:00000001:7.0:1773851879.753935:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851879.753935:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:31.0:1773851879.753936:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:7.0:1773851879.753936:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031776 blocks, 31536850944 free, 31536821248 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425307 files, 2779492966 free files
00000100:00000001:4.0:1773851879.753936:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851879.753937:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000004:00000001:7.0:1773851879.753937:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851879.753937:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002737bf0b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051933248:2098@kfi7:41:default-yuba2-0
00000400:00000001:4.0:1773851879.753937:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:31.0:1773851879.753938:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:7.0:1773851879.753938:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851879.753938:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:4.0:1773851879.753938:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851879.753938:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000100:00000001:31.0:1773851879.753939:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851879.753939:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:4.0:1773851879.753939:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007d52025f
00000100:00000001:31.0:1773851879.753940:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851879.753940:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:6.0:1773851879.753940:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002737bf0b x1859433051933248/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:4.0:1773851879.753940:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007d52025f.
00000004:00000040:31.0:1773851879.753941:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000100:00100000:7.0:1773851879.753941:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b9a17ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051933312:7@kfi7:41:default-yuba2-0
00000100:00000001:4.0:1773851879.753941:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000040:31.0:1773851879.753942:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510564864 avail=351507933184 avail_mb=1373077864 hwm_mb=3131103 files=372095679 ffree=343272036 state=0: rc = 0
00000100:00000001:6.0:1773851879.753942:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851879.753942:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000200:4.0:1773851879.753942:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:31.0:1773851879.753943:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510564864 free, 351507933184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095679 files, 343272036 free files
00000100:00000001:7.0:1773851879.753943:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851879.753943:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:6.0:1773851879.753943:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006d4a620a.
00000100:00000040:7.0:1773851879.753944:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005b9a17ed x1859433051933312/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:6.0:1773851879.753944:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851879.753944:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000001:31.0:1773851879.753945:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:6.0:1773851879.753945:0:41065:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000020:00000001:6.0:1773851879.753945:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000200:4.0:1773851879.753945:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851879.753946:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000010:6.0:1773851879.753946:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000015991966.
00000100:00000040:31.0:1773851879.753947:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851879.753947:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851879.753947:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000079e097e6.
02000000:00000001:6.0:1773851879.753947:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851879.753947:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:4.0:1773851879.753947:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:7.0:1773851879.753948:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851879.753948:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000010:6.0:1773851879.753948:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002737bf0b.
00000100:00000001:4.0:1773851879.753948:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:31.0:1773851879.753949:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005d50b08c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051933440:2080@kfi7:13:default-yuba2-0
00000020:00000040:7.0:1773851879.753949:0:41066:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:6.0:1773851879.753949:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851879.753949:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.753949:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851879.753949:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000020:00000001:7.0:1773851879.753950:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851879.753950:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000daca50c1.
00000100:00000001:6.0:1773851879.753950:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.753950:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851879.753950:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851879.753951:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851879.753951:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:7.0:1773851879.753951:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851879.753951:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:6.0:1773851879.753951:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851879.753951:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851879.753951:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:4.0:1773851879.753951:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851879.753952:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005d50b08c x1859433051933440/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:7.0:1773851879.753952:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b9a17ed.
00000100:00000001:7.0:1773851879.753952:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851879.753952:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851879.753952:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=112 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851879.753953:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851879.753953:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:4.0:1773851879.753953:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=112 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851879.753954:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851879.753954:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851879.753954:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753954:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851879.753954:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851879.753955:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851879.753955:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851879.753955:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851879.753955:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000010:31.0:1773851879.753956:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f14d9ff9.
00010000:00000001:4.0:1773851879.753956:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753956:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:31.0:1773851879.753957:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851879.753957:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851879.753957:0:41090:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000100:00000040:4.0:1773851879.753957:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:4.0:1773851879.753957:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000020:00000001:31.0:1773851879.753958:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:4.0:1773851879.753958:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851879.753959:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000005711a3d9.
00000100:00000040:4.0:1773851879.753959:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851879.753960:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851879.753960:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851879.753961:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005d50b08c.
00000100:00000001:4.0:1773851879.753961:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851879.753962:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851879.753962:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.753962:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851879.753963:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.753963:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851879.753963:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851879.753964:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851879.753964:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851879.753964:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000100:00000001:31.0:1773851879.753965:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851879.753965:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851879.753965:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353583616 avail=351351207936 avail_mb=1372465656 hwm_mb=3131101 files=372083227 ffree=343118734 state=0: rc = 0
00000004:00000020:4.0:1773851879.753967:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353583616 free, 351351207936 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083227 files, 343118734 free files
00000004:00000001:4.0:1773851879.753968:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851879.753969:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851879.753977:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e62e4afc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051933376:3@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851879.753979:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.753979:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851879.753980:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e62e4afc x1859433051933376/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852032 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851879.753983:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851879.753983:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851879.753984:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000440074eb.
02000000:00000001:4.0:1773851879.753985:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851879.753985:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851879.753986:0:41067:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000020:00000001:4.0:1773851879.753986:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851879.753987:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000100f702c.
02000000:00000001:4.0:1773851879.753988:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851879.753988:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851879.753989:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e62e4afc.
00000100:00000001:4.0:1773851879.753990:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851879.753990:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.753991:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851879.753992:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851879.753992:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851879.753993:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851879.753993:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851879.783473:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.783474:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851879.783476:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851879.783478:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851879.783480:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.783481:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.115@tcp : PUT - for me
00000400:00000200:17.0:1773851879.783482:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.783483:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851879.783485:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.115@tcp to cpt 7
00000400:00000200:17.0:1773851879.783486:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e3703aa nid 172.16.70.115@tcp refs 2
00000400:00000200:17.0:1773851879.783488:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005e3703aa nid 172.16.70.115@tcp refs 3
00000400:00000200:17.0:1773851879.783489:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.115@tcp to cpt 7
00000400:00000200:17.0:1773851879.783490:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.115@tcp of length 224 into portal 12 MB=0x69a0efea4d1c0
00000400:00000200:17.0:1773851879.783491:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.115@tcp of length 224/224 into md 0x77fe139dd [64] + 189256
00000800:00000200:17.0:1773851879.783493:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851879.783495:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851879.783496:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851879.783497:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851879.783498:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851879.783498:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8a0b53c.
00000100:00000040:17.0:1773851879.783499:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b8a0b53c x1858239052698048 msgsize 224
00000100:00100000:17.0:1773851879.783500:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.115@tcp (source: 12345-172.16.70.115@tcp)
00000100:00000001:17.0:1773851879.783502:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851879.783503:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851879.783504:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851879.783505:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851879.783506:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851879.783506:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851879.783507:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851879.783508:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851879.783508:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858239052698048
00000020:00000001:28.0:1773851879.783509:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851879.783509:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9309f
00000020:00000001:28.0:1773851879.783510:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851879.783513:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000091dca594 refcount=6
00000020:00000001:28.0:1773851879.783514:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745136128 : -107128964415488 : ffff9e9118218000)
00000020:00000001:28.0:1773851879.783515:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745136128 : -107128964415488 : ffff9e9118218000)
00000100:00000001:28.0:1773851879.783516:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851879.783517:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851879.783518:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000020e58959.
00000020:00000010:28.0:1773851879.783519:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851879.783520:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851879.783521:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851879.783521:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851879.783523:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851879.783524:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851879.783524:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851879.783525:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851879.783526:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851879.783528:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851879.783528:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851879.783528:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851879.783528:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851879.783529:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.115@tcp, seq: 2055553
00000100:00000001:30.0:1773851879.783530:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851879.783530:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000091dca594 : new rpc_count 1
00000100:00000001:30.0:1773851879.783531:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851879.783531:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985324032 : -106952724227584 : ffff9eba20dd5a00)
00000100:00000040:28.0:1773851879.783532:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b8a0b53c x1858239052698048/t0(0) o400->41973dc5-6ed7-4715-ae3c-8a5cd82f7beb@172.16.70.115@tcp:667/0 lens 224/0 e 0 to 0 dl 1773852027 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic15-0'
00000100:00000001:28.0:1773851879.783535:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851879.783536:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851879.783537:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8a0b53c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:41973dc5-6ed7-4715-ae3c-8a5cd82f7beb+6:50015:x1858239052698048:12345-172.16.70.115@tcp:400:default-rzslic15-0
00000100:00000200:28.0:1773851879.783538:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858239052698048
00000020:00000001:28.0:1773851879.783539:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851879.783539:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851879.783540:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.783541:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851879.783541:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851879.783542:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851879.783543:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858239052698048, found 0 last_xid 1858239052698047
00000020:00000001:28.0:1773851879.783544:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851879.783544:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851879.783545:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851879.783545:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.783546:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851879.783547:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851879.783547:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851879.783548:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000427ecd1f.
02000000:00000001:28.0:1773851879.783549:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851879.783549:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.783551:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851879.783551:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858239052698048
00010000:00000001:28.0:1773851879.783552:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851879.783553:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b8a0b53c x1858239052698048/t0(0) o400->41973dc5-6ed7-4715-ae3c-8a5cd82f7beb@172.16.70.115@tcp:667/0 lens 224/224 e 0 to 0 dl 1773852027 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic15-0'
00010000:00000001:28.0:1773851879.783556:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851879.783556:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851879.783557:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=112 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851879.783558:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851879.783559:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f1daada8 refcount 3 to 172.16.70.115@tcp
00000100:00000001:28.0:1773851879.783560:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957481344 : -107146752070272 : ffff9e8cf3e76d80)
02000000:00000001:28.0:1773851879.783560:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851879.783561:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851879.783561:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851879.783562:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.115@tcp
00000400:00000010:28.0:1773851879.783563:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dd059cb9.
00000100:00000200:28.0:1773851879.783564:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858239052698048, offset 224
00000400:00000200:28.0:1773851879.783565:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.115@tcp
00000400:00000200:28.0:1773851879.783566:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.115@tcp to cpt 7
00000400:00000200:28.0:1773851879.783567:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e3703aa nid 172.16.70.115@tcp refs 2
00000400:00000200:28.0:1773851879.783568:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005e3703aa nid 172.16.70.115@tcp refs 3
00000400:00000200:28.0:1773851879.783569:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005e3703aa nid 172.16.70.115@tcp refs 4
00000400:00000200:28.0:1773851879.783571:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.115@tcp routed destination
00000400:00000200:28.0:1773851879.783572:0:60533:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:28.0:1773851879.783573:0:60533:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:28.0:1773851879.783574:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.115@tcp: rtr pref emtpy: 1
00000400:00000200:28.0:1773851879.783575:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:28.0:1773851879.783576:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.115@tcp: rtr pref emtpy: 1
00000400:00000200:28.0:1773851879.783577:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:28.0:1773851879.783578:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769652:8769652:1024:4294967295] 2094@kfi7 LPNI seq info [1258747009:1258747009:16:4294967295]
00000400:00000200:28.0:1773851879.783580:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:28.0:1773851879.783581:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:28.0:1773851879.783584:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.115@tcp(172.16.70.115@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851879.783585:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005e3703aa nid 172.16.70.115@tcp refs 3
00000800:00000200:28.0:1773851879.783587:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851879.783588:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851879.783591:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851879.783593:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:28.0:1773851879.783596:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:28.0:1773851879.783598:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851879.783600:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851879.783601:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f1daada8 refcount 2 to 172.16.70.115@tcp
00010000:00000001:28.0:1773851879.783601:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851879.783602:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851879.783604:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851879.783605:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8a0b53c x1858239052698048/t0(0) o400->41973dc5-6ed7-4715-ae3c-8a5cd82f7beb@172.16.70.115@tcp:667/0 lens 224/224 e 0 to 0 dl 1773852027 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic15-0'
00000100:00100000:28.0:1773851879.783608:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8a0b53c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:41973dc5-6ed7-4715-ae3c-8a5cd82f7beb+6:50015:x1858239052698048:12345-172.16.70.115@tcp:400:default-rzslic15-0 Request processed in 72us (108us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851879.783610:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.115@tcp, seq: 2055553
00000100:00000040:28.0:1773851879.783611:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000091dca594 : new rpc_count 0
00000100:00000001:28.0:1773851879.783612:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851879.783612:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851879.783613:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851879.783614:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851879.783614:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000020e58959.
00000020:00000040:28.0:1773851879.783615:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000091dca594 : new refcount 5
00000100:00000001:28.0:1773851879.783616:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851879.783623:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851879.783624:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851879.783625:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:29.0:1773851879.783626:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dd059cb9
00000400:00000010:29.0:1773851879.783627:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dd059cb9.
00000100:00000001:29.0:1773851879.783627:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851879.783628:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851879.783629:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:29.0:1773851879.783630:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Transaction freed
00000800:00000200:1.0:1773851879.785237:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851879.785239:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851879.785242:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851879.785246:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851879.785250:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16243@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.785252:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16243@kfi7 : PUT - for me
00000400:00000200:1.0:1773851879.785254:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16243@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.785255:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000683048d7 nid 16243@kfi7 refs 1
00000400:00000200:1.0:1773851879.785258:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16243@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.785259:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000683048d7 nid 16243@kfi7 refs 2
00000400:00000200:1.0:1773851879.785261:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000683048d7 nid 16243@kfi7 refs 3
00000400:00000200:1.0:1773851879.785262:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16243@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.785264:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16243@kfi7 of length 224 into portal 12 MB=0x69b4b9a3ce200
00000400:00000200:1.0:1773851879.785267:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16243@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 39840
00000800:00000200:1.0:1773851879.785270:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851879.785274:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851879.785276:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16243@kfi7: PUT: OK
00000100:00000001:1.0:1773851879.785278:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851879.785279:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851879.785280:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000627cb71a.
00000100:00000040:1.0:1773851879.785282:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000627cb71a x1859598872797696 msgsize 224
00000100:00100000:1.0:1773851879.785286:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-16243@kfi7 (source: 12345-16243@kfi7)
00000100:00000001:1.0:1773851879.785289:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851879.785291:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000683048d7 nid 16243@kfi7 refs 2
00000800:00000200:1.0:1773851879.785293:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a8cd379f: 2069@kfi7:0 <- 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851879.785298:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851879.785299:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851879.785300:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851879.785301:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851879.785303:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851879.785304:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598872797696
00000020:00000001:1.0:1773851879.785305:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851879.785306:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38945826
00000020:00000001:1.0:1773851879.785307:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851879.785311:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cf3aec1f refcount=5
00000020:00000001:1.0:1773851879.785312:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637081260659712 : -106992448891904 : ffff9eb0e1171400)
00000020:00000001:1.0:1773851879.785314:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637081260659712 : -106992448891904 : ffff9eb0e1171400)
00000100:00000001:1.0:1773851879.785315:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851879.785316:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851879.785318:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851879.785320:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851879.785321:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851879.785323:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851879.785324:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851879.785325:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851879.785327:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851879.785327:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851879.785328:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.785330:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851879.785332:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851879.785333:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851879.785333:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851879.785334:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851879.785335:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16243@kfi7, seq: 1997588
00000100:00000040:1.0:1773851879.785336:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cf3aec1f : new rpc_count 1
00000100:00000001:2.0:1773851879.785337:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851879.785338:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.785338:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112254080 : -106950597297536 : ffff9eba9fa3ba80)
00000100:00000040:1.0:1773851879.785340:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000627cb71a x1859598872797696/t0(0) o400->31eb4c8f-a4b2-4e58-a0fe-acbb758a93b2@16243@kfi7:519/0 lens 224/0 e 0 to 0 dl 1773852634 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1498-0'
00000100:00000001:1.0:1773851879.785346:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851879.785347:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851879.785349:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000627cb71a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:31eb4c8f-a4b2-4e58-a0fe-acbb758a93b2+5:39771:x1859598872797696:12345-16243@kfi7:400:default-tuolumne1498-0
00000100:00000200:1.0:1773851879.785351:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598872797696
00000020:00000001:1.0:1773851879.785352:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851879.785353:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851879.785354:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.785356:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851879.785357:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851879.785358:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851879.785359:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598872797696, found 0 last_xid 1859598872797695
00000020:00000001:1.0:1773851879.785361:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851879.785362:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851879.785363:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851879.785364:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.785365:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851879.785366:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851879.785367:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851879.785368:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f5405d62.
02000000:00000001:1.0:1773851879.785369:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.785370:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.785372:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851879.785373:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044158459, transno 0, xid 1859598872797696
00010000:00000001:1.0:1773851879.785374:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851879.785376:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000627cb71a x1859598872797696/t0(0) o400->31eb4c8f-a4b2-4e58-a0fe-acbb758a93b2@16243@kfi7:519/0 lens 224/224 e 0 to 0 dl 1773852634 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1498-0'
00010000:00000001:1.0:1773851879.785381:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851879.785382:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851879.785383:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=112 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851879.785385:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851879.785386:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008c7ec491 refcount 3 to 16243@kfi7
00000100:00000001:1.0:1773851879.785387:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850079680 : -107143859471936 : ffff9e8da050f9c0)
02000000:00000001:1.0:1773851879.785389:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851879.785390:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851879.785391:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851879.785393:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16243@kfi7
00000400:00000010:1.0:1773851879.785394:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000de236318.
00000100:00000200:1.0:1773851879.785395:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598872797696, offset 224
00000400:00000200:1.0:1773851879.785397:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16243@kfi7
00000400:00000200:1.0:1773851879.785399:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16243@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.785400:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000683048d7 nid 16243@kfi7 refs 1
00000400:00000200:1.0:1773851879.785401:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000683048d7 nid 16243@kfi7 refs 2
00000400:00000200:1.0:1773851879.785403:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000683048d7 nid 16243@kfi7 refs 3
00000400:00000200:1.0:1773851879.785405:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16243@kfi7 local destination
00000400:00000200:1.0:1773851879.785407:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769653:8769653:1024:4294967295] 16243@kfi7 LPNI seq info [8321761:8321761:16:4294967295]
00000400:00000200:1.0:1773851879.785409:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000683048d7 nid 16243@kfi7 refs 2
00000400:00000200:1.0:1773851879.785410:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16243@kfi7 to cpt 0
00000400:00000200:1.0:1773851879.785413:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16243@kfi7(16243@kfi7:16243@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851879.785415:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000683048d7 nid 16243@kfi7 refs 3
00000800:00000200:1.0:1773851879.785417:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851879.785419:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851879.785422:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851879.785426:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x433 Using peer 16243@kfi7(0x433)
00000800:00000200:1.0:1773851879.785431:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 324 bytes to peer 0x433: rc=0
00000800:00000200:1.0:1773851879.785433:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x433 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851879.785436:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851879.785437:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008c7ec491 refcount 2 to 16243@kfi7
00010000:00000001:1.0:1773851879.785439:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851879.785439:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851879.785441:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851879.785442:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000627cb71a x1859598872797696/t0(0) o400->31eb4c8f-a4b2-4e58-a0fe-acbb758a93b2@16243@kfi7:519/0 lens 224/224 e 0 to 0 dl 1773852634 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1498-0'
00000100:00100000:1.0:1773851879.785447:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000627cb71a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:31eb4c8f-a4b2-4e58-a0fe-acbb758a93b2+5:39771:x1859598872797696:12345-16243@kfi7:400:default-tuolumne1498-0 Request processed in 100us (164us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851879.785448:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x433 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851879.785451:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851879.785451:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16243@kfi7, seq: 1997588
00000400:00000200:2.0:1773851879.785452:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16243@kfi7: PUT: OK
00000100:00000040:1.0:1773851879.785452:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cf3aec1f : new rpc_count 0
00000100:00000001:1.0:1773851879.785453:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851879.785454:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:2.0:1773851879.785455:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000de236318
00000400:00000010:2.0:1773851879.785455:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000de236318.
00000020:00000010:1.0:1773851879.785455:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000100:00000001:2.0:1773851879.785456:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851879.785456:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000100:00000001:2.0:1773851879.785457:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851879.785457:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:2.0:1773851879.785458:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000683048d7 nid 16243@kfi7 refs 2
00000020:00000040:1.0:1773851879.785459:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000cf3aec1f : new refcount 4
00000100:00000001:1.0:1773851879.785460:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851879.785461:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2069@kfi7:0 -> 16243@kfi7(0000000090fbd602):0x0 lsk 1076 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x433 Transaction freed
00000800:00000200:9.0:1773851879.798927:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851879.798928:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851879.798930:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851879.798932:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851879.798934:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25776@kfi7 to cpt 2
00000400:00000200:9.0:1773851879.798935:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25776@kfi7 : PUT - for me
00000400:00000200:9.0:1773851879.798936:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25776@kfi7 to cpt 2
00000400:00000200:9.0:1773851879.798937:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000865e42fe nid 25776@kfi7 refs 1
00000400:00000200:9.0:1773851879.798938:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25776@kfi7 to cpt 2
00000400:00000200:9.0:1773851879.798939:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000865e42fe nid 25776@kfi7 refs 2
00000400:00000200:9.0:1773851879.798940:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000865e42fe nid 25776@kfi7 refs 3
00000400:00000200:9.0:1773851879.798941:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25776@kfi7 to cpt 2
00000400:00000200:9.0:1773851879.798942:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25776@kfi7 of length 224 into portal 12 MB=0x69baaab792800
00000400:00000200:9.0:1773851879.798944:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25776@kfi7 of length 224/224 into md 0x78146ce49 [64] + 144856
00000800:00000200:9.0:1773851879.798946:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851879.798948:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851879.798949:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25776@kfi7: PUT: OK
00000100:00000001:9.0:1773851879.798950:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851879.798951:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851879.798952:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000021c764a0.
00000100:00000040:9.0:1773851879.798953:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000021c764a0 x1860007183853568 msgsize 224
00000100:00100000:9.0:1773851879.798955:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-25776@kfi7 (source: 12345-25776@kfi7)
00000100:00000001:9.0:1773851879.798956:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851879.798957:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000865e42fe nid 25776@kfi7 refs 2
00000100:00000001:11.0:1773851879.798958:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851879.798959:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851879.798959:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851879.798959:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851879.798960:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851879.798960:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851879.798961:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860007183853568
00000020:00000001:11.0:1773851879.798962:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851879.798962:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08efa17fdd9
00000020:00000001:11.0:1773851879.798963:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851879.798966:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008988c0d6 refcount=9
00000020:00000001:11.0:1773851879.798966:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637064460510208 : -107009249041408 : ffff9eacf7b92400)
00000020:00000001:11.0:1773851879.798967:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637064460510208 : -107009249041408 : ffff9eacf7b92400)
00000100:00000001:11.0:1773851879.798968:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851879.798969:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851879.798970:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c71e88b4.
00000020:00000010:11.0:1773851879.798971:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851879.798972:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e5e3c0b.
00000100:00000001:11.0:1773851879.798973:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851879.798973:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851879.798974:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851879.798975:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851879.798975:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851879.798976:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851879.798977:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851879.798978:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851879.798979:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851879.798979:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851879.798980:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25776@kfi7, seq: 2130810
00000100:00000001:8.0:1773851879.798980:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851879.798981:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008988c0d6 : new rpc_count 1
00000100:00000001:8.0:1773851879.798981:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851879.798982:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096247424 : -107006613304192 : ffff9ead94d34c80)
00000100:00000001:8.0:1773851879.798982:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851879.798983:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000021c764a0 x1860007183853568/t0(0) o400->5d535516-8d1d-4ed5-991d-fe3944b437c6@25776@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2094-0'
00000100:00000001:11.0:1773851879.798986:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851879.798987:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851879.798988:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021c764a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5d535516-8d1d-4ed5-991d-fe3944b437c6+9:39644:x1860007183853568:12345-25776@kfi7:400:default-tuolumne2094-0
00000100:00000200:11.0:1773851879.798989:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860007183853568
00000020:00000001:11.0:1773851879.798990:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851879.798991:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851879.798991:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851879.798992:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851879.798993:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851879.798993:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851879.798994:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860007183853568, found 0 last_xid 1860007183853567
00000020:00000001:11.0:1773851879.798995:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851879.798996:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851879.798996:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851879.798997:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851879.798997:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851879.798998:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851879.798999:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851879.798999:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008e6ffc9a.
02000000:00000001:11.0:1773851879.799000:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851879.799000:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851879.799001:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851879.799002:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260566035, transno 0, xid 1860007183853568
00010000:00000001:11.0:1773851879.799003:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851879.799004:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000021c764a0 x1860007183853568/t0(0) o400->5d535516-8d1d-4ed5-991d-fe3944b437c6@25776@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2094-0'
00010000:00000001:11.0:1773851879.799006:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851879.799007:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851879.799008:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=112 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851879.799009:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851879.799010:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000822042d4 refcount 3 to 25776@kfi7
00000100:00000001:11.0:1773851879.799011:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581216 : -107154806970400 : ffff9e8b13cb67e0)
02000000:00000001:11.0:1773851879.799012:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851879.799013:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851879.799013:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851879.799014:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25776@kfi7
00000400:00000010:11.0:1773851879.799015:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005cb89f82.
00000100:00000200:11.0:1773851879.799016:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860007183853568, offset 224
00000400:00000200:11.0:1773851879.799017:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25776@kfi7
00000400:00000200:11.0:1773851879.799018:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25776@kfi7 to cpt 2
00000400:00000200:11.0:1773851879.799019:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000865e42fe nid 25776@kfi7 refs 1
00000400:00000200:11.0:1773851879.799020:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000865e42fe nid 25776@kfi7 refs 2
00000400:00000200:11.0:1773851879.799021:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000865e42fe nid 25776@kfi7 refs 3
00000400:00000200:11.0:1773851879.799023:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25776@kfi7 local destination
00000400:00000200:11.0:1773851879.799024:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769654:8769654:1024:4294967295] 25776@kfi7 LPNI seq info [2450068:2450068:16:4294967295]
00000400:00000200:11.0:1773851879.799025:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000865e42fe nid 25776@kfi7 refs 2
00000400:00000200:11.0:1773851879.799026:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25776@kfi7 to cpt 2
00000400:00000200:11.0:1773851879.799028:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25776@kfi7(25776@kfi7:25776@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851879.799029:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000865e42fe nid 25776@kfi7 refs 3
00000800:00000200:11.0:1773851879.799031:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851879.799032:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851879.799034:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851879.799036:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000974 Using peer 25776@kfi7(0x100000000000974)
00000800:00000200:11.0:1773851879.799040:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x100000000000974: rc=0
00000800:00000200:11.0:1773851879.799041:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000974 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851879.799043:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851879.799045:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000822042d4 refcount 2 to 25776@kfi7
00010000:00000001:11.0:1773851879.799046:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851879.799046:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851879.799047:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851879.799048:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000021c764a0 x1860007183853568/t0(0) o400->5d535516-8d1d-4ed5-991d-fe3944b437c6@25776@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2094-0'
00000100:00100000:11.0:1773851879.799051:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021c764a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:5d535516-8d1d-4ed5-991d-fe3944b437c6+9:39644:x1860007183853568:12345-25776@kfi7:400:default-tuolumne2094-0 Request processed in 63us (97us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851879.799053:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25776@kfi7, seq: 2130810
00000100:00000040:11.0:1773851879.799054:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008988c0d6 : new rpc_count 0
00000800:00000200:9.0:1773851879.799054:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000974 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851879.799055:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851879.799055:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851879.799056:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851879.799056:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851879.799057:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e5e3c0b.
00000400:00000200:9.0:1773851879.799057:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25776@kfi7: PUT: OK
00000400:00000200:9.0:1773851879.799057:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005cb89f82
00000020:00000010:11.0:1773851879.799058:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c71e88b4.
00000400:00000010:9.0:1773851879.799058:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005cb89f82.
00000020:00000040:11.0:1773851879.799059:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000008988c0d6 : new refcount 8
00000100:00000001:11.0:1773851879.799059:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851879.799059:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851879.799059:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851879.799060:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000865e42fe nid 25776@kfi7 refs 2
00000800:00000200:9.0:1773851879.799062:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 25776@kfi7(000000008410eabf):0x0 lsk 2421 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000974 Transaction freed
00000800:00000200:17.0:1773851879.963482:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.963483:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851879.963485:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851879.963489:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851879.963492:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.963495:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.42@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851879.963496:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.963498:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851879.963500:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.42@o2ib60 to cpt 3
00000400:00000200:17.0:1773851879.963503:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009a4d520b nid 192.168.128.42@o2ib60 refs 2
00000400:00000200:17.0:1773851879.963505:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009a4d520b nid 192.168.128.42@o2ib60 refs 3
00000400:00000200:17.0:1773851879.963508:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.42@o2ib60 to cpt 3
00000400:00000200:17.0:1773851879.963510:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.42@o2ib60 of length 224 into portal 12 MB=0x69b2407f09e00
00000400:00000200:17.0:1773851879.963512:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.42@o2ib60 of length 224/224 into md 0x82a36e8ed [64] + 41096
00000800:00000200:17.0:1773851879.963515:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851879.963518:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851879.963520:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851879.963521:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851879.963522:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851879.963523:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002fda4938.
00000100:00000040:17.0:1773851879.963525:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002fda4938 x1859428914601472 msgsize 224
00000100:00100000:17.0:1773851879.963528:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.42@o2ib60 (source: 12345-192.168.128.42@o2ib60)
00000100:00000001:17.0:1773851879.963531:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851879.963532:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851879.963535:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851879.963537:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851879.963539:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851879.963540:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851879.963541:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851879.963543:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851879.963545:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859428914601472
00000020:00000001:15.0:1773851879.963547:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851879.963548:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b37e9dd70
00000020:00000001:15.0:1773851879.963549:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851879.963554:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000579508da refcount=5
00000020:00000001:15.0:1773851879.963556:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127181267968 : -106946528283648 : ffff9ebb922bf400)
00000020:00000001:15.0:1773851879.963558:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127181267968 : -106946528283648 : ffff9ebb922bf400)
00000100:00000001:15.0:1773851879.963560:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851879.963562:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851879.963563:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000916e2cfc.
00000020:00000010:15.0:1773851879.963566:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851879.963567:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007edbe72e.
00000100:00000001:15.0:1773851879.963569:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851879.963570:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851879.963571:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851879.963574:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851879.963575:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851879.963576:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.963578:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851879.963582:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851879.963583:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851879.963583:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851879.963584:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851879.963586:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.42@o2ib60, seq: 2289878
00000100:00000040:15.0:1773851879.963587:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000579508da : new rpc_count 1
00000100:00000001:12.0:1773851879.963588:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851879.963589:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.963590:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985319424 : -106952724232192 : ffff9eba20dd4800)
00000100:00000040:15.0:1773851879.963593:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002fda4938 x1859428914601472/t0(0) o400->de1a4375-2bf0-4748-a6ca-fb908d5a8929@192.168.128.42@o2ib60:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix42-0'
00000100:00000001:15.0:1773851879.963600:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851879.963601:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851879.963603:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fda4938 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:de1a4375-2bf0-4748-a6ca-fb908d5a8929+5:39800:x1859428914601472:12345-192.168.128.42@o2ib60:400:default-matrix42-0
00000100:00000200:15.0:1773851879.963606:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859428914601472
00000020:00000001:15.0:1773851879.963607:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851879.963609:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851879.963610:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851879.963611:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851879.963612:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851879.963614:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851879.963615:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859428914601472, found 0 last_xid 1859428914601471
00000020:00000001:15.0:1773851879.963617:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851879.963618:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851879.963619:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851879.963620:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851879.963621:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851879.963622:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851879.963623:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851879.963625:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000087969700.
02000000:00000001:15.0:1773851879.963626:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.963627:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851879.963628:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851879.963629:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183077428011, transno 0, xid 1859428914601472
00010000:00000001:15.0:1773851879.963631:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851879.963633:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002fda4938 x1859428914601472/t0(0) o400->de1a4375-2bf0-4748-a6ca-fb908d5a8929@192.168.128.42@o2ib60:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix42-0'
00010000:00000001:15.0:1773851879.963638:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851879.963639:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851879.963641:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=112 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851879.963643:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851879.963645:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dfae22e8 refcount 3 to 192.168.128.42@o2ib60
00000100:00000001:15.0:1773851879.963646:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919864218848 : -107153845332768 : ffff9e8b4d1cd4e0)
02000000:00000001:15.0:1773851879.963648:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851879.963649:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851879.963650:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851879.963652:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.42@o2ib60
00000400:00000010:15.0:1773851879.963653:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050bc9375.
00000100:00000200:15.0:1773851879.963655:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859428914601472, offset 224
00000400:00000200:15.0:1773851879.963658:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.42@o2ib60
00000400:00000200:15.0:1773851879.963661:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.42@o2ib60 to cpt 3
00000400:00000200:15.0:1773851879.963663:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009a4d520b nid 192.168.128.42@o2ib60 refs 2
00000400:00000200:15.0:1773851879.963665:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009a4d520b nid 192.168.128.42@o2ib60 refs 3
00000400:00000200:15.0:1773851879.963667:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009a4d520b nid 192.168.128.42@o2ib60 refs 4
00000400:00000200:15.0:1773851879.963669:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.42@o2ib60 routed destination
00000400:00000200:15.0:1773851879.963670:0:60824:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:15.0:1773851879.963671:0:60824:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:15.0:1773851879.963673:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.42@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851879.963674:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:15.0:1773851879.963675:0:60824:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.42@o2ib60: rtr pref emtpy: 1
00000400:00000200:15.0:1773851879.963676:0:60824:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:15.0:1773851879.963678:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769655:8769655:1024:4294967295] 17@kfi7 LPNI seq info [1250891909:1250891909:16:4294967295]
00000400:00000200:15.0:1773851879.963679:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:15.0:1773851879.963680:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:15.0:1773851879.963683:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.42@o2ib60(192.168.128.42@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851879.963685:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009a4d520b nid 192.168.128.42@o2ib60 refs 3
00000800:00000200:15.0:1773851879.963687:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851879.963689:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851879.963692:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851879.963697:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:15.0:1773851879.963700:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:15.0:1773851879.963702:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851879.963705:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851879.963706:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dfae22e8 refcount 2 to 192.168.128.42@o2ib60
00010000:00000001:15.0:1773851879.963707:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851879.963707:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851879.963708:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851879.963709:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002fda4938 x1859428914601472/t0(0) o400->de1a4375-2bf0-4748-a6ca-fb908d5a8929@192.168.128.42@o2ib60:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix42-0'
00000100:00100000:15.0:1773851879.963713:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fda4938 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:de1a4375-2bf0-4748-a6ca-fb908d5a8929+5:39800:x1859428914601472:12345-192.168.128.42@o2ib60:400:default-matrix42-0 Request processed in 112us (187us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851879.963716:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.42@o2ib60, seq: 2289878
00000100:00000040:15.0:1773851879.963716:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000579508da : new rpc_count 0
00000100:00000001:15.0:1773851879.963717:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851879.963717:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851879.963718:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851879.963718:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851879.963719:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007edbe72e.
00000400:00000200:13.0:1773851879.963719:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851879.963720:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000916e2cfc.
00000020:00000040:15.0:1773851879.963720:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000579508da : new refcount 4
00000400:00000200:13.0:1773851879.963720:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:15.0:1773851879.963721:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851879.963721:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050bc9375
00000400:00000010:13.0:1773851879.963721:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050bc9375.
00000100:00000001:13.0:1773851879.963722:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851879.963722:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851879.963723:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:13.0:1773851879.963727:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000800:00000200:21.0:1773851879.969937:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851879.969938:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851879.969939:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851879.969941:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851879.969942:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.969943:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15098@kfi7 : PUT - for me
00000400:00000200:21.0:1773851879.969944:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.969945:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 1
00000400:00000200:21.0:1773851879.969946:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.969946:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000400:00000200:21.0:1773851879.969947:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 3
00000400:00000200:21.0:1773851879.969948:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.969949:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15098@kfi7 of length 224 into portal 12 MB=0x699de8b691b80
00000400:00000200:21.0:1773851879.969950:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15098@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 49008
00000800:00000200:21.0:1773851879.969952:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851879.969953:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851879.969954:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15098@kfi7: PUT: OK
00000100:00000001:21.0:1773851879.969955:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851879.969956:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851879.969957:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000016b94a12.
00000100:00000040:21.0:1773851879.969958:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000016b94a12 x1858030960974720 msgsize 224
00000100:00100000:21.0:1773851879.969959:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15098@kfi7 (source: 12345-15098@kfi7)
00000100:00000001:21.0:1773851879.969960:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851879.969961:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000800:00000200:21.0:1773851879.969962:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851879.969962:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851879.969962:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851879.969963:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851879.969963:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851879.969964:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851879.969965:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030960974720
00000020:00000001:20.0:1773851879.969965:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851879.969966:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f6d
00000020:00000001:20.0:1773851879.969967:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851879.969968:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000078472369 refcount=6
00000020:00000001:20.0:1773851879.969969:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239872512 : -107152469679104 : ffff9e8b9f1ba400)
00000020:00000001:20.0:1773851879.969970:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239872512 : -107152469679104 : ffff9e8b9f1ba400)
00000100:00000001:20.0:1773851879.969971:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851879.969972:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851879.969973:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a84cdd70.
00000020:00000010:20.0:1773851879.969974:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851879.969975:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851879.969976:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851879.969976:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851879.969978:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851879.969979:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851879.969979:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851879.969980:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.969981:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851879.969982:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851879.969982:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851879.969983:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851879.969983:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851879.969984:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15098@kfi7, seq: 1998017
00000100:00000040:20.0:1773851879.969984:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000078472369 : new rpc_count 1
00000100:00000001:23.0:1773851879.969985:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851879.969985:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.969985:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637101167801600 : -106972541750016 : ffff9eb583a5f500)
00000100:00000040:20.0:1773851879.969986:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000016b94a12 x1858030960974720/t0(0) o400->35f07a87-8380-46a4-941d-2126a7e90dcf@15098@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne227-0'
00000100:00000001:20.0:1773851879.969989:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851879.969990:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851879.969991:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016b94a12 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:35f07a87-8380-46a4-941d-2126a7e90dcf+6:47806:x1858030960974720:12345-15098@kfi7:400:default-tuolumne227-0
00000100:00000200:20.0:1773851879.969992:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030960974720
00000020:00000001:20.0:1773851879.969993:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851879.969993:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851879.969994:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.969995:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851879.969995:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851879.969996:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851879.969997:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030960974720, found 0 last_xid 1858030960974719
00000020:00000001:20.0:1773851879.969998:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851879.969998:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851879.969999:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851879.970000:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.970000:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851879.970001:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851879.970002:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851879.970002:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000213eb2e8.
02000000:00000001:20.0:1773851879.970003:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.970003:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.970005:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851879.970005:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030960974720
00010000:00000001:20.0:1773851879.970006:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851879.970007:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000016b94a12 x1858030960974720/t0(0) o400->35f07a87-8380-46a4-941d-2126a7e90dcf@15098@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne227-0'
00010000:00000001:20.0:1773851879.970009:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851879.970010:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851879.970011:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=112 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851879.970012:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851879.970013:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008c70ad21 refcount 5 to 15098@kfi7
00000100:00000001:20.0:1773851879.970013:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025664 : -107156745525952 : ffff9e8aa03f6540)
02000000:00000001:20.0:1773851879.970014:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851879.970015:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.970016:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851879.970016:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15098@kfi7
00000400:00000010:20.0:1773851879.970017:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039a01a83.
00000100:00000200:20.0:1773851879.970018:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030960974720, offset 224
00000400:00000200:20.0:1773851879.970019:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15098@kfi7
00000400:00000200:20.0:1773851879.970020:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:20.0:1773851879.970021:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 1
00000400:00000200:20.0:1773851879.970022:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000400:00000200:20.0:1773851879.970023:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 3
00000400:00000200:20.0:1773851879.970024:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15098@kfi7 local destination
00000400:00000200:20.0:1773851879.970025:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769656:8769656:1024:4294967295] 15098@kfi7 LPNI seq info [24418:24418:16:4294967295]
00000400:00000200:20.0:1773851879.970027:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000400:00000200:20.0:1773851879.970028:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:20.0:1773851879.970030:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15098@kfi7(15098@kfi7:15098@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851879.970031:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 3
00000800:00000200:20.0:1773851879.970032:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851879.970033:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851879.970035:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851879.970039:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x674 Using peer 15098@kfi7(0x674)
00000800:00000200:20.0:1773851879.970042:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0x674: rc=0
00000800:00000200:20.0:1773851879.970044:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x674 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851879.970046:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851879.970047:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008c70ad21 refcount 4 to 15098@kfi7
00010000:00000001:20.0:1773851879.970047:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851879.970048:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.970048:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851879.970049:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000016b94a12 x1858030960974720/t0(0) o400->35f07a87-8380-46a4-941d-2126a7e90dcf@15098@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne227-0'
00000100:00100000:20.0:1773851879.970053:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016b94a12 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:35f07a87-8380-46a4-941d-2126a7e90dcf+6:47806:x1858030960974720:12345-15098@kfi7:400:default-tuolumne227-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851879.970056:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15098@kfi7, seq: 1998017
00000100:00000040:20.0:1773851879.970056:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000078472369 : new rpc_count 0
00000100:00000001:20.0:1773851879.970057:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851879.970058:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851879.970058:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851879.970059:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851879.970060:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a84cdd70.
00000020:00000040:20.0:1773851879.970061:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000078472369 : new refcount 5
00000100:00000001:20.0:1773851879.970061:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851879.970066:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x674 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851879.970068:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851879.970069:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15098@kfi7: PUT: OK
00000400:00000200:21.0:1773851879.970069:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039a01a83
00000400:00000010:21.0:1773851879.970070:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039a01a83.
00000100:00000001:21.0:1773851879.970070:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851879.970071:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851879.970072:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000800:00000200:21.0:1773851879.970073:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 15098@kfi7(00000000eef88976):0x0 lsk 1653 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x674 Transaction freed
00000800:00000200:21.0:1773851879.970572:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851879.970573:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851879.970574:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851879.970575:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851879.970577:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.970578:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15098@kfi7 : PUT - for me
00000400:00000200:21.0:1773851879.970579:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.970579:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 1
00000400:00000200:21.0:1773851879.970580:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.970581:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000400:00000200:21.0:1773851879.970581:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 3
00000400:00000200:21.0:1773851879.970582:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:21.0:1773851879.970583:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15098@kfi7 of length 224 into portal 12 MB=0x699de8b692300
00000400:00000200:21.0:1773851879.970583:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15098@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 49232
00000800:00000200:21.0:1773851879.970585:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851879.970586:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851879.970587:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15098@kfi7: PUT: OK
00000100:00000001:21.0:1773851879.970588:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851879.970588:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851879.970589:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000b822e59.
00000100:00000040:21.0:1773851879.970589:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000b822e59 x1858030960976640 msgsize 224
00000100:00100000:21.0:1773851879.970591:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15098@kfi7 (source: 12345-15098@kfi7)
00000100:00000001:21.0:1773851879.970591:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851879.970592:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000800:00000200:21.0:1773851879.970593:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851879.970593:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851879.970593:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851879.970594:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851879.970594:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851879.970595:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851879.970595:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030960976640
00000020:00000001:20.0:1773851879.970596:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851879.970596:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9132c
00000020:00000001:20.0:1773851879.970597:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851879.970601:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000741b213b refcount=6
00000020:00000001:20.0:1773851879.970601:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716217856 : -107155993333760 : ffff9e8acd14f000)
00000020:00000001:20.0:1773851879.970602:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716217856 : -107155993333760 : ffff9e8acd14f000)
00000100:00000001:20.0:1773851879.970603:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851879.970603:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851879.970604:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a84cdd70.
00000020:00000010:20.0:1773851879.970605:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851879.970605:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851879.970606:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851879.970606:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851879.970607:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851879.970608:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851879.970608:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851879.970609:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.970610:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851879.970611:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851879.970611:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851879.970611:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851879.970612:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851879.970612:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15098@kfi7, seq: 1998018
00000100:00000001:23.0:1773851879.970613:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851879.970613:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851879.970613:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000741b213b : new rpc_count 1
00000100:00000001:20.0:1773851879.970613:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956258048 : -106937753293568 : ffff9ebd9d33ad00)
00000100:00000040:20.0:1773851879.970614:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000b822e59 x1858030960976640/t0(0) o400->6322e2fc-2c41-4fee-993d-6f0053cf4a2a@15098@kfi7:606/0 lens 224/0 e 0 to 0 dl 1773851966 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne227-0'
00000100:00000001:20.0:1773851879.970617:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851879.970618:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851879.970619:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b822e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:6322e2fc-2c41-4fee-993d-6f0053cf4a2a+6:47804:x1858030960976640:12345-15098@kfi7:400:default-tuolumne227-0
00000100:00000200:20.0:1773851879.970620:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030960976640
00000020:00000001:20.0:1773851879.970621:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851879.970621:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851879.970622:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.970622:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851879.970623:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851879.970624:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851879.970625:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030960976640, found 0 last_xid 1858030960976639
00000020:00000001:20.0:1773851879.970626:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851879.970626:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851879.970626:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851879.970627:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.970627:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851879.970628:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851879.970628:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851879.970629:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007247ac18.
02000000:00000001:20.0:1773851879.970629:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.970630:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.970630:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851879.970631:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768032, transno 0, xid 1858030960976640
00010000:00000001:20.0:1773851879.970631:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851879.970632:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000b822e59 x1858030960976640/t0(0) o400->6322e2fc-2c41-4fee-993d-6f0053cf4a2a@15098@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne227-0'
00010000:00000001:20.0:1773851879.970635:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851879.970635:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851879.970636:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=112 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851879.970637:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851879.970637:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008c70ad21 refcount 5 to 15098@kfi7
00000100:00000001:20.0:1773851879.970638:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025664 : -107156745525952 : ffff9e8aa03f6540)
02000000:00000001:20.0:1773851879.970638:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851879.970639:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851879.970639:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851879.970640:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15098@kfi7
00000400:00000010:20.0:1773851879.970641:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039a01a83.
00000100:00000200:20.0:1773851879.970641:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030960976640, offset 224
00000400:00000200:20.0:1773851879.970642:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15098@kfi7
00000400:00000200:20.0:1773851879.970643:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:20.0:1773851879.970644:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 1
00000400:00000200:20.0:1773851879.970644:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000400:00000200:20.0:1773851879.970645:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 3
00000400:00000200:20.0:1773851879.970647:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15098@kfi7 local destination
00000400:00000200:20.0:1773851879.970648:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769657:8769657:1024:4294967295] 15098@kfi7 LPNI seq info [24419:24419:16:4294967295]
00000400:00000200:20.0:1773851879.970650:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000400:00000200:20.0:1773851879.970650:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15098@kfi7 to cpt 5
00000400:00000200:20.0:1773851879.970652:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15098@kfi7(15098@kfi7:15098@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851879.970653:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 3
00000800:00000200:20.0:1773851879.970655:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851879.970656:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851879.970658:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851879.970660:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000065a Using peer 15098@kfi7(0x10000000000065a)
00000800:00000200:20.0:1773851879.970663:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x10000000000065a: rc=0
00000800:00000200:20.0:1773851879.970664:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000065a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851879.970666:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851879.970666:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008c70ad21 refcount 4 to 15098@kfi7
00010000:00000001:20.0:1773851879.970667:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851879.970667:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851879.970668:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851879.970669:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000b822e59 x1858030960976640/t0(0) o400->6322e2fc-2c41-4fee-993d-6f0053cf4a2a@15098@kfi7:606/0 lens 224/224 e 0 to 0 dl 1773851966 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne227-0'
00000100:00100000:20.0:1773851879.970672:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b822e59 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:6322e2fc-2c41-4fee-993d-6f0053cf4a2a+6:47804:x1858030960976640:12345-15098@kfi7:400:default-tuolumne227-0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851879.970674:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15098@kfi7, seq: 1998018
00000100:00000040:20.0:1773851879.970675:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000741b213b : new rpc_count 0
00000100:00000001:20.0:1773851879.970676:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851879.970676:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851879.970677:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851879.970678:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851879.970679:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a84cdd70.
00000020:00000040:20.0:1773851879.970680:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000741b213b : new refcount 5
00000100:00000001:20.0:1773851879.970681:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851879.970685:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000065a TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851879.970686:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851879.970687:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15098@kfi7: PUT: OK
00000400:00000200:21.0:1773851879.970688:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039a01a83
00000400:00000010:21.0:1773851879.970688:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039a01a83.
00000100:00000001:21.0:1773851879.970689:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851879.970689:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851879.970690:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005c91fa45 nid 15098@kfi7 refs 2
00000800:00000200:21.0:1773851879.970691:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 15098@kfi7(00000000ad49865a):0x0 lsk 1627 rsk 86 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000065a Transaction freed
00000800:00000200:17.0:1773851879.971156:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.971157:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851879.971158:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851879.971160:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851879.971162:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22593@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.971163:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22593@kfi7 : PUT - for me
00000400:00000200:17.0:1773851879.971164:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22593@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.971165:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae0f51af nid 22593@kfi7 refs 1
00000400:00000200:17.0:1773851879.971166:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22593@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.971166:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae0f51af nid 22593@kfi7 refs 2
00000400:00000200:17.0:1773851879.971167:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ae0f51af nid 22593@kfi7 refs 3
00000400:00000200:17.0:1773851879.971169:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22592@kfi7 to cpt 1
00000400:00000200:17.0:1773851879.971169:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22592@kfi7 of length 224 into portal 12 MB=0x69b4b9a245e40
00000400:00000200:17.0:1773851879.971171:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22592@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 29144
00000800:00000200:17.0:1773851879.971173:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851879.971175:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851879.971176:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22593@kfi7: PUT: OK
00000100:00000001:17.0:1773851879.971177:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851879.971177:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851879.971178:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a623ef4.
00000100:00000040:17.0:1773851879.971178:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000004a623ef4 x1859598871191104 msgsize 224
00000100:00100000:17.0:1773851879.971180:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22592@kfi7 (source: 12345-22593@kfi7)
00000100:00000001:17.0:1773851879.971181:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851879.971182:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ae0f51af nid 22593@kfi7 refs 2
00000800:00000200:17.0:1773851879.971183:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851879.971186:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851879.971186:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851879.971187:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851879.971187:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851879.971188:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851879.971189:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598871191104
00000020:00000001:17.0:1773851879.971189:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851879.971190:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389427c0
00000020:00000001:17.0:1773851879.971190:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851879.971192:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001f5a9347 refcount=5
00000020:00000001:17.0:1773851879.971192:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637147356650496 : -106926352901120 : ffff9ec044b7dc00)
00000020:00000001:17.0:1773851879.971193:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637147356650496 : -106926352901120 : ffff9ec044b7dc00)
00000100:00000001:17.0:1773851879.971194:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.971195:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851879.971195:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851879.971196:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851879.971197:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851879.971201:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851879.971201:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851879.971201:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.971202:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851879.971203:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851879.971203:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.971204:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.971205:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851879.971205:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851879.971206:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851879.971206:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851879.971207:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22592@kfi7, seq: 2156377
00000100:00000040:17.0:1773851879.971208:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001f5a9347 : new rpc_count 1
00000100:00000001:17.0:1773851879.971208:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120985332096 : -106952724219520 : ffff9eba20dd7980)
00000100:00000001:16.0:1773851879.971208:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851879.971208:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851879.971209:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a623ef4 x1859598871191104/t0(0) o400->ba724e99-4442-4d77-a52c-dad0223b09b6@22592@kfi7:100/0 lens 224/0 e 0 to 0 dl 1773852215 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1908-0'
00000100:00000001:17.0:1773851879.971212:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.971212:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851879.971213:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a623ef4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ba724e99-4442-4d77-a52c-dad0223b09b6+5:39682:x1859598871191104:12345-22592@kfi7:400:default-tuolumne1908-0
00000100:00000200:17.0:1773851879.971215:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598871191104
00000020:00000001:17.0:1773851879.971215:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851879.971216:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851879.971216:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.971217:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851879.971218:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851879.971218:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851879.971219:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598871191104, found 0 last_xid 1859598871191103
00000020:00000001:17.0:1773851879.971220:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851879.971220:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851879.971221:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851879.971221:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.971222:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851879.971222:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851879.971223:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851879.971223:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002140430e.
02000000:00000001:17.0:1773851879.971225:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.971225:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.971226:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851879.971226:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262826023, transno 0, xid 1859598871191104
00010000:00000001:17.0:1773851879.971227:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851879.971228:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a623ef4 x1859598871191104/t0(0) o400->ba724e99-4442-4d77-a52c-dad0223b09b6@22592@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1908-0'
00010000:00000001:17.0:1773851879.971230:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851879.971231:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851879.971232:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=112 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851879.971233:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851879.971234:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000087e2fe1b refcount 3 to 22592@kfi7
00000100:00000001:17.0:1773851879.971234:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702784 : -107156155848832 : ffff9e8ac3652780)
02000000:00000001:17.0:1773851879.971235:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851879.971235:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.971236:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851879.971237:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22593@kfi7
00000400:00000010:17.0:1773851879.971237:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008cb88761.
00000100:00000200:17.0:1773851879.971238:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598871191104, offset 224
00000400:00000200:17.0:1773851879.971239:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22593@kfi7
00000400:00000200:17.0:1773851879.971240:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22593@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.971241:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae0f51af nid 22593@kfi7 refs 1
00000400:00000200:17.0:1773851879.971242:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ae0f51af nid 22593@kfi7 refs 2
00000400:00000200:17.0:1773851879.971243:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ae0f51af nid 22593@kfi7 refs 3
00000400:00000200:17.0:1773851879.971244:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22593@kfi7 local destination
00000400:00000200:17.0:1773851879.971245:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769658:8769658:1024:4294967295] 22593@kfi7 LPNI seq info [7169890:7169890:16:4294967295]
00000400:00000200:17.0:1773851879.971246:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ae0f51af nid 22593@kfi7 refs 2
00000400:00000200:17.0:1773851879.971247:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22593@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.971249:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22593@kfi7(22593@kfi7:22593@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851879.971250:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ae0f51af nid 22593@kfi7 refs 3
00000800:00000200:17.0:1773851879.971251:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.971252:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851879.971255:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851879.971258:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa06 Using peer 22593@kfi7(0xa06)
00000800:00000200:17.0:1773851879.971260:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0xa06: rc=0
00000800:00000200:17.0:1773851879.971262:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa06 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851879.971264:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851879.971264:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000087e2fe1b refcount 2 to 22592@kfi7
00010000:00000001:17.0:1773851879.971265:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851879.971265:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.971266:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851879.971267:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a623ef4 x1859598871191104/t0(0) o400->ba724e99-4442-4d77-a52c-dad0223b09b6@22592@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1908-0'
00000100:00100000:17.0:1773851879.971269:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a623ef4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ba724e99-4442-4d77-a52c-dad0223b09b6+5:39682:x1859598871191104:12345-22592@kfi7:400:default-tuolumne1908-0 Request processed in 57us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851879.971271:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22592@kfi7, seq: 2156377
00000100:00000040:17.0:1773851879.971272:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001f5a9347 : new rpc_count 0
00000100:00000001:17.0:1773851879.971273:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851879.971273:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:18.0:1773851879.971274:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa06 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851879.971274:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851879.971274:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:18.0:1773851879.971275:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851879.971275:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000400:00000200:18.0:1773851879.971276:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22593@kfi7: PUT: OK
00000020:00000040:17.0:1773851879.971276:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000001f5a9347 : new refcount 4
00000400:00000200:18.0:1773851879.971277:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008cb88761
00000400:00000010:18.0:1773851879.971277:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008cb88761.
00000100:00000001:17.0:1773851879.971277:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851879.971279:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851879.971279:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851879.971280:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ae0f51af nid 22593@kfi7 refs 2
00000800:00000200:18.0:1773851879.971281:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 22593@kfi7(0000000015568078):0x0 lsk 2567 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa06 Transaction freed
00000800:00000200:17.0:1773851879.989220:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.989220:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851879.989221:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851879.989223:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851879.989225:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24609@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.989226:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24609@kfi7 : PUT - for me
00000400:00000200:17.0:1773851879.989227:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24609@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.989228:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ac647a4 nid 24609@kfi7 refs 1
00000400:00000200:17.0:1773851879.989229:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24609@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.989230:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ac647a4 nid 24609@kfi7 refs 2
00000400:00000200:17.0:1773851879.989230:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006ac647a4 nid 24609@kfi7 refs 3
00000400:00000200:17.0:1773851879.989231:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24608@kfi7 to cpt 1
00000400:00000200:17.0:1773851879.989232:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24608@kfi7 of length 224 into portal 12 MB=0x699e0f3df6f00
00000400:00000200:17.0:1773851879.989234:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24608@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 29368
00000800:00000200:17.0:1773851879.989235:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851879.989237:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851879.989238:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24609@kfi7: PUT: OK
00000100:00000001:17.0:1773851879.989238:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851879.989238:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851879.989241:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000039135d8c.
00000100:00000040:17.0:1773851879.989241:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000039135d8c x1858041303494400 msgsize 224
00000100:00100000:17.0:1773851879.989242:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-24608@kfi7 (source: 12345-24609@kfi7)
00000100:00000001:17.0:1773851879.989243:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851879.989244:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006ac647a4 nid 24609@kfi7 refs 2
00000800:00000200:17.0:1773851879.989245:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851879.989247:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851879.989248:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851879.989248:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851879.989248:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851879.989249:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851879.989250:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041303494400
00000020:00000001:17.0:1773851879.989250:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851879.989250:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d81
00000020:00000001:17.0:1773851879.989251:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851879.989253:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bdfcccdc refcount=6
00000020:00000001:17.0:1773851879.989253:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744417280 : -107128965134336 : ffff9e9118168800)
00000020:00000001:17.0:1773851879.989254:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744417280 : -107128965134336 : ffff9e9118168800)
00000100:00000001:17.0:1773851879.989255:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.989255:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851879.989256:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851879.989256:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851879.989257:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851879.989258:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851879.989258:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851879.989258:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.989259:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851879.989259:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851879.989260:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.989260:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851879.989261:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851879.989262:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851879.989263:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24608@kfi7, seq: 2156378
00000100:00000040:17.0:1773851879.989263:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bdfcccdc : new rpc_count 1
00000100:00000001:16.0:1773851879.989263:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851879.989264:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637000632638208 : -107073076913408 : ffff9e9e1b491b00)
00000100:00000040:17.0:1773851879.989264:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000039135d8c x1858041303494400/t0(0) o400->5bfa0796-9cfa-4700-b632-ad509344904b@24608@kfi7:100/0 lens 224/0 e 0 to 0 dl 1773852215 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2031-0'
00000100:00000001:16.0:1773851879.989264:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851879.989264:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851879.989265:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.989267:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851879.989267:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851879.989268:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039135d8c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5bfa0796-9cfa-4700-b632-ad509344904b+6:39660:x1858041303494400:12345-24608@kfi7:400:default-tuolumne2031-0
00000100:00000200:17.0:1773851879.989269:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041303494400
00000020:00000001:17.0:1773851879.989269:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851879.989270:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851879.989270:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.989271:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851879.989271:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851879.989272:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851879.989273:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041303494400, found 0 last_xid 1858041303494399
00000020:00000001:17.0:1773851879.989274:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851879.989274:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851879.989275:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851879.989275:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.989275:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851879.989276:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851879.989276:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851879.989277:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f7d852e9.
02000000:00000001:17.0:1773851879.989277:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.989278:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.989278:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851879.989279:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044177522, transno 0, xid 1858041303494400
00010000:00000001:17.0:1773851879.989280:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851879.989280:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000039135d8c x1858041303494400/t0(0) o400->5bfa0796-9cfa-4700-b632-ad509344904b@24608@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2031-0'
00010000:00000001:17.0:1773851879.989283:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851879.989283:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851879.989284:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=112 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851879.989285:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851879.989285:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b03a0731 refcount 3 to 24608@kfi7
00000100:00000001:17.0:1773851879.989286:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412864 : -107145304138752 : ffff9e8d4a351c00)
02000000:00000001:17.0:1773851879.989287:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851879.989287:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851879.989287:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851879.989288:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24609@kfi7
00000400:00000010:17.0:1773851879.989288:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004efcc765.
00000100:00000200:17.0:1773851879.989289:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041303494400, offset 224
00000400:00000200:17.0:1773851879.989290:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24609@kfi7
00000400:00000200:17.0:1773851879.989291:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24609@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.989291:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ac647a4 nid 24609@kfi7 refs 1
00000400:00000200:17.0:1773851879.989292:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006ac647a4 nid 24609@kfi7 refs 2
00000400:00000200:17.0:1773851879.989293:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006ac647a4 nid 24609@kfi7 refs 3
00000400:00000200:17.0:1773851879.989294:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24609@kfi7 local destination
00000400:00000200:17.0:1773851879.989295:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769659:8769659:1024:4294967295] 24609@kfi7 LPNI seq info [14040109:14040109:16:4294967295]
00000400:00000200:17.0:1773851879.989296:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006ac647a4 nid 24609@kfi7 refs 2
00000400:00000200:17.0:1773851879.989297:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24609@kfi7 to cpt 4
00000400:00000200:17.0:1773851879.989299:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24609@kfi7(24609@kfi7:24609@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851879.989300:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006ac647a4 nid 24609@kfi7 refs 3
00000800:00000200:17.0:1773851879.989301:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851879.989302:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851879.989304:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851879.989306:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15e Using peer 24609@kfi7(0x15e)
00000800:00000200:17.0:1773851879.989309:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x15e: rc=0
00000800:00000200:17.0:1773851879.989310:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851879.989312:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851879.989312:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b03a0731 refcount 2 to 24608@kfi7
00010000:00000001:17.0:1773851879.989313:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851879.989313:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851879.989314:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851879.989314:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000039135d8c x1858041303494400/t0(0) o400->5bfa0796-9cfa-4700-b632-ad509344904b@24608@kfi7:100/0 lens 224/224 e 0 to 0 dl 1773852215 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2031-0'
00000100:00100000:17.0:1773851879.989317:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039135d8c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5bfa0796-9cfa-4700-b632-ad509344904b+6:39660:x1858041303494400:12345-24608@kfi7:400:default-tuolumne2031-0 Request processed in 50us (75us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851879.989319:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24608@kfi7, seq: 2156378
00000100:00000040:17.0:1773851879.989320:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bdfcccdc : new rpc_count 0
00000100:00000001:17.0:1773851879.989320:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851879.989321:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851879.989321:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851879.989322:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851879.989323:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000020:00000040:17.0:1773851879.989323:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000bdfcccdc : new refcount 5
00000100:00000001:17.0:1773851879.989324:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:19.0:1773851879.989326:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15e TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851879.989328:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851879.989330:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24609@kfi7: PUT: OK
00000400:00000200:19.0:1773851879.989330:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004efcc765
00000400:00000010:19.0:1773851879.989331:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004efcc765.
00000100:00000001:19.0:1773851879.989332:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851879.989332:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851879.989333:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006ac647a4 nid 24609@kfi7 refs 2
00000800:00000200:19.0:1773851879.989335:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 24609@kfi7(00000000595f5a3e):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x15e Transaction freed
00080000:00000001:28.0:1773851880.003492:0:48687:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:28.0:1773851880.003494:0:48687:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851880.003500:0:48687:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:28.0:1773851880.003500:0:48687:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851880.003507:0:48687:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:28.0:1773851880.003508:0:48687:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851880.003513:0:48687:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:28.0:1773851880.003514:0:48687:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851880.003519:0:48687:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:28.0:1773851880.003519:0:48687:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851880.009465:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851880.009467:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851880.009469:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851880.009476:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851880.009479:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21312@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.009481:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21312@kfi7 : PUT - for me
00000400:00000200:6.0:1773851880.009483:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21312@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.009484:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009097c65 nid 21312@kfi7 refs 1
00000400:00000200:6.0:1773851880.009486:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21312@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.009487:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009097c65 nid 21312@kfi7 refs 2
00000400:00000200:6.0:1773851880.009489:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000009097c65 nid 21312@kfi7 refs 3
00000400:00000200:6.0:1773851880.009490:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21376@kfi7 to cpt 5
00000400:00000200:6.0:1773851880.009492:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21376@kfi7 of length 224 into portal 12 MB=0x69b0a17cff980
00000400:00000200:6.0:1773851880.009495:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21376@kfi7 of length 224/224 into md 0x793926dc5 [64] + 151864
00000800:00000200:6.0:1773851880.009498:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851880.009501:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851880.009503:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21312@kfi7: PUT: OK
00000100:00000001:6.0:1773851880.009505:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851880.009505:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851880.009507:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007e3f559f.
00000100:00000040:6.0:1773851880.009508:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000007e3f559f x1859317511747968 msgsize 224
00000100:00100000:6.0:1773851880.009510:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-21376@kfi7 (source: 12345-21312@kfi7)
00000100:00000001:6.0:1773851880.009512:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851880.009514:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000009097c65 nid 21312@kfi7 refs 2
00000100:00000001:4.0:1773851880.009515:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851880.009516:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851880.009516:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851880.009517:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851880.009518:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851880.009519:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851880.009520:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317511747968
00000020:00000001:4.0:1773851880.009521:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851880.009522:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92649
00000020:00000001:4.0:1773851880.009523:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851880.009526:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d11de174 refcount=6
00000020:00000001:4.0:1773851880.009527:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631009280 : -107123078542336 : ffff9e9276f4cc00)
00000020:00000001:4.0:1773851880.009529:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631009280 : -107123078542336 : ffff9e9276f4cc00)
00000100:00000001:4.0:1773851880.009531:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851880.009532:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851880.009533:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000983d7486.
00000020:00000010:4.0:1773851880.009535:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851880.009536:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000febcce7f.
00000100:00000001:4.0:1773851880.009537:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851880.009538:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851880.009539:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851880.009540:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851880.009541:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851880.009542:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.009543:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851880.009546:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851880.009546:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851880.009546:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851880.009547:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851880.009548:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21376@kfi7, seq: 2001949
00000100:00000001:7.0:1773851880.009549:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851880.009549:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d11de174 : new rpc_count 1
00000100:00000001:7.0:1773851880.009550:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.009550:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814061184 : -107101895490432 : ffff9e9765908480)
00000100:00000040:4.0:1773851880.009552:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007e3f559f x1859317511747968/t0(0) o400->7128f775-ced3-4992-b261-2b92356bab04@21376@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1828-0'
00000100:00000001:4.0:1773851880.009557:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851880.009558:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851880.009559:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e3f559f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:7128f775-ced3-4992-b261-2b92356bab04+6:39512:x1859317511747968:12345-21376@kfi7:400:default-tuolumne1828-0
00000100:00000200:4.0:1773851880.009561:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317511747968
00000020:00000001:4.0:1773851880.009562:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851880.009563:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851880.009565:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851880.009566:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851880.009566:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851880.009568:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851880.009569:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317511747968, found 0 last_xid 1859317511747967
00000020:00000001:4.0:1773851880.009571:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851880.009573:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851880.009574:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851880.009575:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851880.009576:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851880.009577:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851880.009578:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851880.009581:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002bdffbd5.
02000000:00000001:4.0:1773851880.009582:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.009583:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851880.009585:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851880.009586:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096702842, transno 0, xid 1859317511747968
00010000:00000001:4.0:1773851880.009587:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851880.009589:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007e3f559f x1859317511747968/t0(0) o400->7128f775-ced3-4992-b261-2b92356bab04@21376@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1828-0'
00010000:00000001:4.0:1773851880.009594:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851880.009595:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851880.009596:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=112 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851880.009598:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851880.009600:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c93ace3f refcount 3 to 21376@kfi7
00000100:00000001:4.0:1773851880.009601:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452960 : -107146752098656 : ffff9e8cf3e6fea0)
02000000:00000001:4.0:1773851880.009603:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851880.009604:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.009605:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851880.009606:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21312@kfi7
00000400:00000010:4.0:1773851880.009608:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007d52025f.
00000100:00000200:4.0:1773851880.009609:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317511747968, offset 224
00000400:00000200:4.0:1773851880.009611:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21312@kfi7
00000400:00000200:4.0:1773851880.009613:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21312@kfi7 to cpt 1
00000400:00000200:4.0:1773851880.009614:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009097c65 nid 21312@kfi7 refs 1
00000400:00000200:4.0:1773851880.009616:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000009097c65 nid 21312@kfi7 refs 2
00000400:00000200:4.0:1773851880.009618:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000009097c65 nid 21312@kfi7 refs 3
00000400:00000200:4.0:1773851880.009621:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21312@kfi7 local destination
00000400:00000200:4.0:1773851880.009623:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769660:8769660:1024:4294967295] 21312@kfi7 LPNI seq info [813308:813308:16:4294967295]
00000400:00000200:4.0:1773851880.009626:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000009097c65 nid 21312@kfi7 refs 2
00000400:00000200:4.0:1773851880.009640:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21312@kfi7 to cpt 1
00000400:00000200:4.0:1773851880.009644:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21312@kfi7(21312@kfi7:21312@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851880.009647:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000009097c65 nid 21312@kfi7 refs 3
00000800:00000200:4.0:1773851880.009649:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851880.009651:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851880.009656:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851880.009660:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000beb Using peer 21312@kfi7(0x100000000000beb)
00000800:00000200:4.0:1773851880.009665:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x100000000000beb: rc=0
00000800:00000200:4.0:1773851880.009668:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000beb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851880.009671:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851880.009673:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c93ace3f refcount 2 to 21376@kfi7
00010000:00000001:4.0:1773851880.009677:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851880.009677:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851880.009679:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851880.009680:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007e3f559f x1859317511747968/t0(0) o400->7128f775-ced3-4992-b261-2b92356bab04@21376@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1828-0'
00000100:00100000:4.0:1773851880.009686:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e3f559f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:7128f775-ced3-4992-b261-2b92356bab04+6:39512:x1859317511747968:12345-21376@kfi7:400:default-tuolumne1828-0 Request processed in 128us (177us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851880.009690:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21376@kfi7, seq: 2001949
00000100:00000040:4.0:1773851880.009692:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d11de174 : new rpc_count 0
00000100:00000001:4.0:1773851880.009694:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851880.009695:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851880.009696:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851880.009697:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000febcce7f.
00000020:00000010:4.0:1773851880.009699:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000983d7486.
00000020:00000040:4.0:1773851880.009700:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000d11de174 : new refcount 5
00000100:00000001:4.0:1773851880.009702:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851880.009710:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000beb TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851880.009714:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851880.009716:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21312@kfi7: PUT: OK
00000400:00000200:5.0:1773851880.009718:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007d52025f
00000400:00000010:5.0:1773851880.009719:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007d52025f.
00000100:00000001:5.0:1773851880.009720:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851880.009721:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851880.009722:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000009097c65 nid 21312@kfi7 refs 2
00000800:00000200:5.0:1773851880.009730:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 21312@kfi7(00000000371fe91a):0x0 lsk 3052 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000beb Transaction freed
00000800:00000200:21.0:1773851880.011273:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851880.011274:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851880.011275:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851880.011277:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851880.011278:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23939@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.011279:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23939@kfi7 : PUT - for me
00000400:00000200:21.0:1773851880.011280:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23939@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.011282:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e38fa99 nid 23939@kfi7 refs 1
00000400:00000200:21.0:1773851880.011283:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23939@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.011283:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e38fa99 nid 23939@kfi7 refs 2
00000400:00000200:21.0:1773851880.011284:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001e38fa99 nid 23939@kfi7 refs 3
00000400:00000200:21.0:1773851880.011285:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23875@kfi7 to cpt 1
00000400:00000200:21.0:1773851880.011286:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23875@kfi7 of length 224 into portal 12 MB=0x699e1106be900
00000400:00000200:21.0:1773851880.011287:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23875@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 49456
00000800:00000200:21.0:1773851880.011289:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851880.011290:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.011291:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23939@kfi7: PUT: OK
00000100:00000001:21.0:1773851880.011292:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851880.011292:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851880.011293:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000920c0ca.
00000100:00000040:21.0:1773851880.011293:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000920c0ca x1858041782462720 msgsize 224
00000100:00100000:21.0:1773851880.011295:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23875@kfi7 (source: 12345-23939@kfi7)
00000100:00000001:21.0:1773851880.011296:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851880.011297:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001e38fa99 nid 23939@kfi7 refs 2
00000100:00000001:20.0:1773851880.011297:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851880.011298:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851880.011298:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851880.011298:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851880.011299:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851880.011300:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851880.011301:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041782462720
00000020:00000001:20.0:1773851880.011301:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851880.011302:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c7e
00000020:00000001:20.0:1773851880.011302:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851880.011305:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000063f4f293 refcount=6
00000020:00000001:20.0:1773851880.011306:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743948288 : -107128965603328 : ffff9e91180f6000)
00000020:00000001:20.0:1773851880.011306:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743948288 : -107128965603328 : ffff9e91180f6000)
00000100:00000001:20.0:1773851880.011307:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.011308:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851880.011309:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a84cdd70.
00000020:00000010:20.0:1773851880.011310:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.011311:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851880.011312:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851880.011312:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851880.011313:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851880.011314:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851880.011314:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851880.011315:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.011316:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851880.011317:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851880.011317:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851880.011317:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851880.011318:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851880.011318:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23875@kfi7, seq: 1998019
00000100:00000001:23.0:1773851880.011319:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851880.011319:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000063f4f293 : new rpc_count 1
00000100:00000001:23.0:1773851880.011320:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.011320:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956263808 : -106937753287808 : ffff9ebd9d33c380)
00000100:00000040:20.0:1773851880.011321:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000920c0ca x1858041782462720/t0(0) o400->bb5a05a3-0f5c-4557-bdd2-aa43f32b3ec3@23875@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1992-0'
00000100:00000001:20.0:1773851880.011324:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.011325:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851880.011326:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000920c0ca pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:bb5a05a3-0f5c-4557-bdd2-aa43f32b3ec3+6:39690:x1858041782462720:12345-23875@kfi7:400:default-tuolumne1992-0
00000100:00000200:20.0:1773851880.011327:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041782462720
00000020:00000001:20.0:1773851880.011327:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851880.011328:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851880.011329:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.011330:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851880.011330:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851880.011331:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851880.011331:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041782462720, found 0 last_xid 1858041782462719
00000020:00000001:20.0:1773851880.011332:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851880.011333:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851880.011334:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851880.011334:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.011335:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851880.011335:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851880.011336:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851880.011336:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000539a19d6.
02000000:00000001:20.0:1773851880.011337:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.011338:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.011338:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851880.011339:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263921265, transno 0, xid 1858041782462720
00010000:00000001:20.0:1773851880.011340:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851880.011341:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000920c0ca x1858041782462720/t0(0) o400->bb5a05a3-0f5c-4557-bdd2-aa43f32b3ec3@23875@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1992-0'
00010000:00000001:20.0:1773851880.011343:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851880.011344:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851880.011345:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=113 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851880.011346:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851880.011346:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e72992e7 refcount 3 to 23875@kfi7
00000100:00000001:20.0:1773851880.011347:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740762656 : -107153968788960 : ffff9e8b45c10a20)
02000000:00000001:20.0:1773851880.011348:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851880.011349:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.011349:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851880.011350:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23939@kfi7
00000400:00000010:20.0:1773851880.011351:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003cda9dd5.
00000100:00000200:20.0:1773851880.011352:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041782462720, offset 224
00000400:00000200:20.0:1773851880.011353:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23939@kfi7
00000400:00000200:20.0:1773851880.011354:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23939@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.011355:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e38fa99 nid 23939@kfi7 refs 1
00000400:00000200:20.0:1773851880.011356:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001e38fa99 nid 23939@kfi7 refs 2
00000400:00000200:20.0:1773851880.011357:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001e38fa99 nid 23939@kfi7 refs 3
00000400:00000200:20.0:1773851880.011358:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23939@kfi7 local destination
00000400:00000200:20.0:1773851880.011359:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769661:8769661:1024:4294967295] 23939@kfi7 LPNI seq info [8823000:8823000:16:4294967295]
00000400:00000200:20.0:1773851880.011360:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001e38fa99 nid 23939@kfi7 refs 2
00000400:00000200:20.0:1773851880.011361:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23939@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.011363:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23939@kfi7(23939@kfi7:23939@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851880.011364:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001e38fa99 nid 23939@kfi7 refs 3
00000800:00000200:20.0:1773851880.011366:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851880.011367:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851880.011369:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851880.011371:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000091c Using peer 23939@kfi7(0x10000000000091c)
00000800:00000200:20.0:1773851880.011374:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x10000000000091c: rc=0
00000800:00000200:20.0:1773851880.011375:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000091c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851880.011377:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851880.011378:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e72992e7 refcount 2 to 23875@kfi7
00010000:00000001:20.0:1773851880.011379:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851880.011380:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.011380:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851880.011381:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000920c0ca x1858041782462720/t0(0) o400->bb5a05a3-0f5c-4557-bdd2-aa43f32b3ec3@23875@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1992-0'
00000100:00100000:20.0:1773851880.011384:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000920c0ca pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:bb5a05a3-0f5c-4557-bdd2-aa43f32b3ec3+6:39690:x1858041782462720:12345-23875@kfi7:400:default-tuolumne1992-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851880.011387:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23875@kfi7, seq: 1998019
00000100:00000040:20.0:1773851880.011387:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000063f4f293 : new rpc_count 0
00000100:00000001:20.0:1773851880.011388:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851880.011389:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851880.011389:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.011390:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851880.011391:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a84cdd70.
00000020:00000040:20.0:1773851880.011391:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000063f4f293 : new refcount 5
00000100:00000001:20.0:1773851880.011392:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851880.011396:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000091c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851880.011399:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.011400:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23939@kfi7: PUT: OK
00000400:00000200:21.0:1773851880.011401:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003cda9dd5
00000400:00000010:21.0:1773851880.011402:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003cda9dd5.
00000100:00000001:21.0:1773851880.011402:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851880.011403:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851880.011404:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001e38fa99 nid 23939@kfi7 refs 2
00000800:00000200:21.0:1773851880.011405:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23939@kfi7(00000000280eed07):0x0 lsk 2333 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000091c Transaction freed
00000800:00000200:17.0:1773851880.014026:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851880.014027:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851880.014029:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851880.014031:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851880.014033:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.014034:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.166@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851880.014035:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.014036:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851880.014037:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.166@o2ib600 to cpt 7
00000400:00000200:17.0:1773851880.014038:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000100a524e nid 172.19.3.166@o2ib600 refs 2
00000400:00000200:17.0:1773851880.014040:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000100a524e nid 172.19.3.166@o2ib600 refs 3
00000400:00000200:17.0:1773851880.014041:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.166@o2ib600 to cpt 7
00000400:00000200:17.0:1773851880.014042:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.166@o2ib600 of length 224 into portal 12 MB=0x699f27f195000
00000400:00000200:17.0:1773851880.014044:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.166@o2ib600 of length 224/224 into md 0x77fe139dd [64] + 189480
00000800:00000200:17.0:1773851880.014046:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851880.014047:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851880.014049:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851880.014050:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851880.014050:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851880.014051:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000018a9b63.
00000100:00000040:17.0:1773851880.014052:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000018a9b63 x1858116653764608 msgsize 224
00000100:00100000:17.0:1773851880.014053:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.166@o2ib600 (source: 12345-172.19.3.166@o2ib600)
00000100:00000001:17.0:1773851880.014056:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851880.014056:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851880.014058:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851880.014060:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851880.014060:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851880.014061:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851880.014061:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851880.014062:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851880.014063:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858116653764608
00000020:00000001:29.0:1773851880.014064:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851880.014064:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d91
00000020:00000001:29.0:1773851880.014065:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851880.014069:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a896bbad refcount=6
00000020:00000001:29.0:1773851880.014070:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239485440 : -107152470066176 : ffff9e8b9f15bc00)
00000020:00000001:29.0:1773851880.014070:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239485440 : -107152470066176 : ffff9e8b9f15bc00)
00000100:00000001:29.0:1773851880.014071:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851880.014072:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851880.014073:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002f4c3dac.
00000020:00000010:29.0:1773851880.014074:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851880.014075:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851880.014076:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851880.014077:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851880.014077:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851880.014079:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851880.014080:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851880.014080:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851880.014081:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851880.014083:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851880.014084:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851880.014084:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851880.014084:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851880.014085:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.166@o2ib600, seq: 2055554
00000100:00000001:30.0:1773851880.014086:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851880.014086:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a896bbad : new rpc_count 1
00000100:00000001:30.0:1773851880.014087:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851880.014087:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102216576 : -107041607335040 : ffff9ea56f04c380)
00000100:00000040:29.0:1773851880.014089:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000018a9b63 x1858116653764608/t0(0) o400->e0d77f3c-f476-47e4-89b0-89e29379c363@172.19.3.166@o2ib600:668/0 lens 224/0 e 0 to 0 dl 1773852028 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic16-0'
00000100:00000001:29.0:1773851880.014092:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851880.014092:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851880.014093:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000018a9b63 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e0d77f3c-f476-47e4-89b0-89e29379c363+6:24752:x1858116653764608:12345-172.19.3.166@o2ib600:400:default-oslic16-0
00000100:00000200:29.0:1773851880.014095:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858116653764608
00000020:00000001:29.0:1773851880.014096:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851880.014097:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851880.014097:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851880.014098:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851880.014099:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851880.014099:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851880.014100:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858116653764608, found 0 last_xid 1858116653764607
00000020:00000001:29.0:1773851880.014101:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851880.014101:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851880.014102:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851880.014102:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851880.014103:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851880.014104:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851880.014104:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851880.014105:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000019a8004d.
02000000:00000001:29.0:1773851880.014106:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851880.014106:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851880.014107:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851880.014108:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858116653764608
00010000:00000001:29.0:1773851880.014109:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851880.014110:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000018a9b63 x1858116653764608/t0(0) o400->e0d77f3c-f476-47e4-89b0-89e29379c363@172.19.3.166@o2ib600:668/0 lens 224/224 e 0 to 0 dl 1773852028 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic16-0'
00010000:00000001:29.0:1773851880.014113:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851880.014113:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851880.014114:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=113 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851880.014116:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851880.014116:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000040e0aa2a refcount 3 to 172.19.3.166@o2ib600
00000100:00000001:29.0:1773851880.014117:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270528 : -107152618281088 : ffff9e8b96402780)
02000000:00000001:29.0:1773851880.014118:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851880.014119:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851880.014119:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851880.014121:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.166@o2ib600
00000400:00000010:29.0:1773851880.014121:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c2a5509b.
00000100:00000200:29.0:1773851880.014122:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858116653764608, offset 224
00000400:00000200:29.0:1773851880.014124:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.166@o2ib600
00000400:00000200:29.0:1773851880.014126:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.166@o2ib600 to cpt 7
00000400:00000200:29.0:1773851880.014127:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000100a524e nid 172.19.3.166@o2ib600 refs 2
00000400:00000200:29.0:1773851880.014129:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000100a524e nid 172.19.3.166@o2ib600 refs 3
00000400:00000200:29.0:1773851880.014130:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000100a524e nid 172.19.3.166@o2ib600 refs 4
00000400:00000200:29.0:1773851880.014132:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.166@o2ib600 routed destination
00000400:00000200:29.0:1773851880.014133:0:60533:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:29.0:1773851880.014134:0:60533:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:29.0:1773851880.014135:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.166@o2ib600: rtr pref emtpy: 1
00000400:00000200:29.0:1773851880.014137:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:29.0:1773851880.014138:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.166@o2ib600: rtr pref emtpy: 1
00000400:00000200:29.0:1773851880.014138:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:29.0:1773851880.014139:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769662:8769662:1024:4294967295] 17@kfi7 LPNI seq info [1250891910:1250891910:16:4294967295]
00000400:00000200:29.0:1773851880.014141:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:29.0:1773851880.014142:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:29.0:1773851880.014145:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.166@o2ib600(172.19.3.166@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851880.014146:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000100a524e nid 172.19.3.166@o2ib600 refs 3
00000800:00000200:29.0:1773851880.014148:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851880.014149:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851880.014152:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851880.014154:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:29.0:1773851880.014158:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:29.0:1773851880.014159:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851880.014161:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851880.014162:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000040e0aa2a refcount 2 to 172.19.3.166@o2ib600
00010000:00000001:29.0:1773851880.014163:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851880.014164:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851880.014165:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851880.014166:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000018a9b63 x1858116653764608/t0(0) o400->e0d77f3c-f476-47e4-89b0-89e29379c363@172.19.3.166@o2ib600:668/0 lens 224/224 e 0 to 0 dl 1773852028 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic16-0'
00000100:00100000:29.0:1773851880.014169:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000018a9b63 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:e0d77f3c-f476-47e4-89b0-89e29379c363+6:24752:x1858116653764608:12345-172.19.3.166@o2ib600:400:default-oslic16-0 Request processed in 76us (116us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851880.014172:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.166@o2ib600, seq: 2055554
00000100:00000040:29.0:1773851880.014173:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a896bbad : new rpc_count 0
00000100:00000001:29.0:1773851880.014174:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851880.014174:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:30.0:1773851880.014175:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851880.014175:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851880.014176:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851880.014176:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002f4c3dac.
00000020:00000040:29.0:1773851880.014177:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000a896bbad : new refcount 5
00000100:00000001:29.0:1773851880.014178:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851880.014179:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851880.014181:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:30.0:1773851880.014181:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c2a5509b
00000400:00000010:30.0:1773851880.014182:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c2a5509b.
00000100:00000001:30.0:1773851880.014183:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851880.014184:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851880.014185:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:30.0:1773851880.014186:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Transaction freed
00000800:00000200:17.0:1773851880.050284:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851880.050284:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851880.050286:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851880.050288:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851880.050290:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11003@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.050291:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11003@kfi7 : PUT - for me
00000400:00000200:17.0:1773851880.050292:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11003@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.050293:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e4c0d09 nid 11003@kfi7 refs 1
00000400:00000200:17.0:1773851880.050294:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11003@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.050294:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e4c0d09 nid 11003@kfi7 refs 2
00000400:00000200:17.0:1773851880.050295:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005e4c0d09 nid 11003@kfi7 refs 3
00000400:00000200:17.0:1773851880.050296:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:17.0:1773851880.050297:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11002@kfi7 of length 224 into portal 12 MB=0x699de8cc2f280
00000400:00000200:17.0:1773851880.050298:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11002@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 29592
00000800:00000200:17.0:1773851880.050299:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851880.050301:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851880.050302:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11003@kfi7: PUT: OK
00000100:00000001:17.0:1773851880.050303:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851880.050303:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851880.050304:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aea2ef9a.
00000100:00000040:17.0:1773851880.050304:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000aea2ef9a x1858030983639680 msgsize 224
00000100:00100000:17.0:1773851880.050306:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-11002@kfi7 (source: 12345-11003@kfi7)
00000100:00000001:17.0:1773851880.050307:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851880.050308:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005e4c0d09 nid 11003@kfi7 refs 2
00000800:00000200:17.0:1773851880.050309:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851880.050312:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851880.050312:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851880.050313:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851880.050314:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851880.050314:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851880.050315:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030983639680
00000020:00000001:17.0:1773851880.050315:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851880.050316:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fba
00000020:00000001:17.0:1773851880.050316:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851880.050318:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fa3e4715 refcount=6
00000020:00000001:17.0:1773851880.050319:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239869440 : -107152469682176 : ffff9e8b9f1b9800)
00000020:00000001:17.0:1773851880.050320:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239869440 : -107152469682176 : ffff9e8b9f1b9800)
00000100:00000001:17.0:1773851880.050321:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851880.050321:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851880.050322:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851880.050323:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851880.050324:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851880.050324:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851880.050325:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851880.050325:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851880.050326:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851880.050327:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851880.050327:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851880.050328:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851880.050329:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851880.050329:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851880.050329:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851880.050329:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851880.050330:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11002@kfi7, seq: 2156379
00000100:00000040:17.0:1773851880.050331:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fa3e4715 : new rpc_count 1
00000100:00000001:16.0:1773851880.050331:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851880.050332:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102211968 : -107041607339648 : ffff9ea56f04b180)
00000100:00000001:16.0:1773851880.050332:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851880.050333:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aea2ef9a x1858030983639680/t0(0) o400->bb6bad4e-7d43-4949-bbf3-ea2464622519@11003@kfi7:101/0 lens 224/0 e 0 to 0 dl 1773852216 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne211-0'
00000100:00000001:17.0:1773851880.050335:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851880.050336:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851880.050337:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aea2ef9a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:bb6bad4e-7d43-4949-bbf3-ea2464622519+6:47808:x1858030983639680:12345-11002@kfi7:400:default-tuolumne211-0
00000100:00000200:17.0:1773851880.050338:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030983639680
00000020:00000001:17.0:1773851880.050339:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851880.050340:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851880.050340:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851880.050341:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851880.050341:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851880.050342:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851880.050343:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030983639680, found 0 last_xid 1858030983639679
00000020:00000001:17.0:1773851880.050344:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851880.050344:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851880.050345:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851880.050345:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851880.050346:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851880.050346:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851880.050347:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851880.050348:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008c9abc21.
02000000:00000001:17.0:1773851880.050348:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851880.050349:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851880.050349:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851880.050350:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030983639680
00010000:00000001:17.0:1773851880.050351:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851880.050352:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aea2ef9a x1858030983639680/t0(0) o400->bb6bad4e-7d43-4949-bbf3-ea2464622519@11003@kfi7:101/0 lens 224/224 e 0 to 0 dl 1773852216 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne211-0'
00010000:00000001:17.0:1773851880.050354:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851880.050354:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851880.050355:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=113 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851880.050356:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851880.050357:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005956c3ca refcount 3 to 11003@kfi7
00000100:00000001:17.0:1773851880.050357:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924290916096 : -107149418635520 : ffff9e8c54f6df00)
02000000:00000001:17.0:1773851880.050358:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851880.050359:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851880.050359:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851880.050360:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11003@kfi7
00000400:00000010:17.0:1773851880.050361:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008b5cd57e.
00000100:00000200:17.0:1773851880.050361:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030983639680, offset 224
00000400:00000200:17.0:1773851880.050362:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11003@kfi7
00000400:00000200:17.0:1773851880.050364:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11003@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.050364:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005e4c0d09 nid 11003@kfi7 refs 1
00000400:00000200:17.0:1773851880.050365:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005e4c0d09 nid 11003@kfi7 refs 2
00000400:00000200:17.0:1773851880.050366:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005e4c0d09 nid 11003@kfi7 refs 3
00000400:00000200:17.0:1773851880.050368:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11003@kfi7 local destination
00000400:00000200:17.0:1773851880.050369:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769663:8769663:1024:4294967295] 11003@kfi7 LPNI seq info [28072:28072:16:4294967295]
00000400:00000200:17.0:1773851880.050370:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005e4c0d09 nid 11003@kfi7 refs 2
00000400:00000200:17.0:1773851880.050371:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11003@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.050372:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11003@kfi7(11003@kfi7:11003@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851880.050374:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005e4c0d09 nid 11003@kfi7 refs 3
00000800:00000200:17.0:1773851880.050375:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851880.050376:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851880.050378:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851880.050380:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000597 Using peer 11003@kfi7(0x100000000000597)
00000800:00000200:17.0:1773851880.050382:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x100000000000597: rc=0
00000800:00000200:17.0:1773851880.050384:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000597 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851880.050386:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851880.050387:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005956c3ca refcount 2 to 11003@kfi7
00010000:00000001:17.0:1773851880.050387:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851880.050388:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851880.050389:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851880.050389:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aea2ef9a x1858030983639680/t0(0) o400->bb6bad4e-7d43-4949-bbf3-ea2464622519@11003@kfi7:101/0 lens 224/224 e 0 to 0 dl 1773852216 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne211-0'
00000100:00100000:17.0:1773851880.050392:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aea2ef9a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:bb6bad4e-7d43-4949-bbf3-ea2464622519+6:47808:x1858030983639680:12345-11002@kfi7:400:default-tuolumne211-0 Request processed in 56us (87us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851880.050396:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11002@kfi7, seq: 2156379
00000100:00000040:17.0:1773851880.050397:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fa3e4715 : new rpc_count 0
00000800:00000200:18.0:1773851880.050398:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000597 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851880.050398:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851880.050399:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851880.050399:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851880.050399:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851880.050400:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11003@kfi7: PUT: OK
00000020:00000010:17.0:1773851880.050400:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000400:00000200:18.0:1773851880.050401:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008b5cd57e
00000020:00000010:17.0:1773851880.050401:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000020:00000040:17.0:1773851880.050401:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000fa3e4715 : new refcount 5
00000400:00000010:18.0:1773851880.050402:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008b5cd57e.
00000100:00000001:18.0:1773851880.050402:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851880.050402:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851880.050403:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851880.050403:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005e4c0d09 nid 11003@kfi7 refs 2
00000800:00000200:18.0:1773851880.050405:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 11003@kfi7(00000000a9518256):0x0 lsk 1432 rsk 126 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000597 Transaction freed
00000800:00000200:9.0:1773851880.061144:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851880.061145:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851880.061146:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851880.061148:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851880.061150:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851880.061151:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.15@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851880.061152:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851880.061153:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851880.061155:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.15@o2ib60 to cpt 0
00000400:00000200:9.0:1773851880.061157:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005bf91bf0 nid 192.168.128.15@o2ib60 refs 2
00000400:00000200:9.0:1773851880.061158:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005bf91bf0 nid 192.168.128.15@o2ib60 refs 3
00000400:00000200:9.0:1773851880.061160:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.15@o2ib60 to cpt 0
00000400:00000200:9.0:1773851880.061161:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.15@o2ib60 of length 224 into portal 12 MB=0x69a39fd2327c0
00000400:00000200:9.0:1773851880.061163:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.15@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 40064
00000800:00000200:9.0:1773851880.061165:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851880.061167:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851880.061168:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851880.061169:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851880.061169:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851880.061170:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003535d259.
00000100:00000040:9.0:1773851880.061171:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003535d259 x1858423711016896 msgsize 224
00000100:00100000:9.0:1773851880.061173:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.15@o2ib60 (source: 12345-192.168.128.15@o2ib60)
00000100:00000001:9.0:1773851880.061175:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851880.061176:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851880.061177:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851880.061178:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851880.061179:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851880.061179:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851880.061180:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851880.061181:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851880.061181:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858423711016896
00000020:00000001:1.0:1773851880.061182:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851880.061182:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d28
00000020:00000001:1.0:1773851880.061183:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851880.061184:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8911891 refcount=59791
00000020:00000001:1.0:1773851880.061185:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239499776 : -107152470051840 : ffff9e8b9f15f400)
00000020:00000001:1.0:1773851880.061186:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239499776 : -107152470051840 : ffff9e8b9f15f400)
00000100:00000001:1.0:1773851880.061187:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851880.061188:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851880.061188:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851880.061189:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851880.061190:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851880.061191:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851880.061192:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851880.061193:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851880.061194:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851880.061194:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851880.061194:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.061196:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851880.061197:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851880.061197:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851880.061198:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851880.061198:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851880.061199:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.15@o2ib60, seq: 1997589
00000100:00000001:2.0:1773851880.061200:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851880.061200:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8911891 : new rpc_count 6
00000100:00000001:1.0:1773851880.061200:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096237056 : -107006613314560 : ffff9ead94d32400)
00000100:00000001:2.0:1773851880.061201:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851880.061202:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003535d259 x1858423711016896/t0(0) o400->a6584785-3693-41d4-9d33-74287039577b@192.168.128.15@o2ib60:520/0 lens 224/0 e 0 to 0 dl 1773852635 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix15-0'
00000100:00000001:1.0:1773851880.061205:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851880.061205:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851880.061207:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003535d259 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a6584785-3693-41d4-9d33-74287039577b+59791:39770:x1858423711016896:12345-192.168.128.15@o2ib60:400:default-matrix15-0
00000100:00000200:1.0:1773851880.061208:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858423711016896
00000020:00000001:1.0:1773851880.061208:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851880.061209:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851880.061210:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.061211:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851880.061211:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851880.061212:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851880.061212:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858423711016896, found 0 last_xid 1858423707674175
00000020:00000001:1.0:1773851880.061213:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851880.061214:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851880.061214:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851880.061215:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.061216:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851880.061216:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851880.061217:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851880.061218:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fb530a1d.
02000000:00000001:1.0:1773851880.061219:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.061220:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.061221:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851880.061221:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264143893, transno 0, xid 1858423711016896
00010000:00000001:1.0:1773851880.061222:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851880.061223:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003535d259 x1858423711016896/t0(0) o400->a6584785-3693-41d4-9d33-74287039577b@192.168.128.15@o2ib60:520/0 lens 224/224 e 0 to 0 dl 1773852635 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix15-0'
00010000:00000001:1.0:1773851880.061226:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851880.061226:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851880.061227:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=113 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851880.061228:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851880.061229:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0b07fff refcount 3 to 192.168.128.15@o2ib60
00000100:00000001:1.0:1773851880.061230:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530573472 : -107154178978144 : ffff9e8b3939cea0)
02000000:00000001:1.0:1773851880.061230:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851880.061231:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.061232:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851880.061233:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.15@o2ib60
00000400:00000010:1.0:1773851880.061233:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000226d8b0f.
00000100:00000200:1.0:1773851880.061234:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858423711016896, offset 224
00000400:00000200:1.0:1773851880.061236:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.15@o2ib60
00000400:00000200:1.0:1773851880.061237:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.15@o2ib60 to cpt 0
00000400:00000200:1.0:1773851880.061238:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005bf91bf0 nid 192.168.128.15@o2ib60 refs 2
00000400:00000200:1.0:1773851880.061240:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005bf91bf0 nid 192.168.128.15@o2ib60 refs 3
00000400:00000200:1.0:1773851880.061241:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005bf91bf0 nid 192.168.128.15@o2ib60 refs 4
00000400:00000200:1.0:1773851880.061242:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.15@o2ib60 routed destination
00000400:00000200:1.0:1773851880.061244:0:60951:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:1.0:1773851880.061244:0:60951:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:1.0:1773851880.061246:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.15@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851880.061247:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:1.0:1773851880.061248:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.15@o2ib60: rtr pref emtpy: 1
00000400:00000200:1.0:1773851880.061249:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:1.0:1773851880.061250:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769664:8769664:1024:4294967295] 2094@kfi7 LPNI seq info [1258747010:1258747010:16:4294967295]
00000400:00000200:1.0:1773851880.061252:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:1.0:1773851880.061253:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:1.0:1773851880.061255:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.15@o2ib60(192.168.128.15@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851880.061257:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005bf91bf0 nid 192.168.128.15@o2ib60 refs 3
00000800:00000200:1.0:1773851880.061258:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851880.061259:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851880.061262:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851880.061264:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:1.0:1773851880.061267:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:1.0:1773851880.061268:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851880.061271:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851880.061272:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0b07fff refcount 2 to 192.168.128.15@o2ib60
00010000:00000001:1.0:1773851880.061272:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851880.061273:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.061274:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851880.061275:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003535d259 x1858423711016896/t0(0) o400->a6584785-3693-41d4-9d33-74287039577b@192.168.128.15@o2ib60:520/0 lens 224/224 e 0 to 0 dl 1773852635 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix15-0'
00000100:00100000:1.0:1773851880.061278:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003535d259 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:a6584785-3693-41d4-9d33-74287039577b+59791:39770:x1858423711016896:12345-192.168.128.15@o2ib60:400:default-matrix15-0 Request processed in 72us (106us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851880.061280:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.15@o2ib60, seq: 1997589
00000100:00000040:1.0:1773851880.061281:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8911891 : new rpc_count 5
00000100:00000001:1.0:1773851880.061282:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851880.061283:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851880.061283:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000800:00000200:2.0:1773851880.061284:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851880.061284:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000020:00000010:1.0:1773851880.061285:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:2.0:1773851880.061286:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:1.0:1773851880.061286:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000c8911891 : new refcount 59790
00000400:00000200:2.0:1773851880.061287:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:2.0:1773851880.061287:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000226d8b0f
00000100:00000001:1.0:1773851880.061287:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:2.0:1773851880.061288:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000226d8b0f.
00000100:00000001:2.0:1773851880.061289:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851880.061289:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851880.061290:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:2.0:1773851880.061291:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Transaction freed
00000800:00000200:6.0:1773851880.066447:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851880.066449:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851880.066450:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851880.066452:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851880.066456:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19809@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.066457:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19809@kfi7 : PUT - for me
00000400:00000200:6.0:1773851880.066458:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19809@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.066459:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c057aac6 nid 19809@kfi7 refs 1
00000400:00000200:6.0:1773851880.066460:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19809@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.066460:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c057aac6 nid 19809@kfi7 refs 2
00000400:00000200:6.0:1773851880.066461:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c057aac6 nid 19809@kfi7 refs 3
00000400:00000200:6.0:1773851880.066462:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19809@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.066463:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19809@kfi7 of length 224 into portal 12 MB=0x69b4c46802600
00000400:00000200:6.0:1773851880.066465:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19809@kfi7 of length 224/224 into md 0x793926dc5 [64] + 152088
00000800:00000200:6.0:1773851880.066466:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851880.066468:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851880.066469:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19809@kfi7: PUT: OK
00000100:00000001:6.0:1773851880.066470:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851880.066471:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851880.066471:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000b9cf576.
00000100:00000040:6.0:1773851880.066472:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000000b9cf576 x1859601762887168 msgsize 224
00000100:00100000:6.0:1773851880.066473:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-19809@kfi7 (source: 12345-19809@kfi7)
00000100:00000001:6.0:1773851880.066475:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851880.066476:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c057aac6 nid 19809@kfi7 refs 2
00000800:00000200:6.0:1773851880.066477:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851880.066477:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851880.066478:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851880.066479:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851880.066480:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851880.066481:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851880.066482:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601762887168
00000020:00000001:4.0:1773851880.066483:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851880.066484:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff74939
00000020:00000001:4.0:1773851880.066485:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851880.066487:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d00b1b3e refcount=5
00000020:00000001:4.0:1773851880.066488:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128509555712 : -106945199995904 : ffff9ebbe1580400)
00000020:00000001:4.0:1773851880.066489:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128509555712 : -106945199995904 : ffff9ebbe1580400)
00000100:00000001:4.0:1773851880.066491:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851880.066492:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851880.066493:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000983d7486.
00000020:00000010:4.0:1773851880.066494:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851880.066496:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000febcce7f.
00000100:00000001:4.0:1773851880.066497:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851880.066498:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851880.066498:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851880.066500:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851880.066501:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851880.066501:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.066503:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851880.066504:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851880.066505:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851880.066505:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851880.066505:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851880.066506:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19809@kfi7, seq: 2001950
00000100:00000040:7.0:1773851880.066507:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d00b1b3e : new rpc_count 1
00000100:00000001:4.0:1773851880.066507:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.066508:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814069248 : -107101895482368 : ffff9e976590a400)
00000100:00000001:4.0:1773851880.066508:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.066509:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000b9cf576 x1859601762887168/t0(0) o400->94cd9207-73c0-4c31-b2af-19d4030b06f7@19809@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1728-0'
00000100:00000001:7.0:1773851880.066512:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851880.066512:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851880.066513:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b9cf576 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:94cd9207-73c0-4c31-b2af-19d4030b06f7+5:39508:x1859601762887168:12345-19809@kfi7:400:default-tuolumne1728-0
00000100:00000200:7.0:1773851880.066515:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601762887168
00000020:00000001:7.0:1773851880.066516:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851880.066516:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851880.066517:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.066518:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851880.066519:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851880.066520:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851880.066520:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601762887168, found 0 last_xid 1859601762887167
00000020:00000001:7.0:1773851880.066521:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851880.066522:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851880.066522:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851880.066523:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.066523:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851880.066524:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851880.066525:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851880.066525:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004b94ae4b.
02000000:00000001:7.0:1773851880.066526:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.066527:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.066528:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851880.066528:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183249746311, transno 0, xid 1859601762887168
00010000:00000001:7.0:1773851880.066529:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851880.066530:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000b9cf576 x1859601762887168/t0(0) o400->94cd9207-73c0-4c31-b2af-19d4030b06f7@19809@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1728-0'
00010000:00000001:7.0:1773851880.066532:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851880.066533:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851880.066534:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=112 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851880.066535:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851880.066535:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006ea9bf5 refcount 3 to 19809@kfi7
00000100:00000001:7.0:1773851880.066536:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703168 : -107156155848448 : ffff9e8ac3652900)
02000000:00000001:7.0:1773851880.066537:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851880.066538:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.066538:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851880.066539:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19809@kfi7
00000400:00000010:7.0:1773851880.066540:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e33961df.
00000100:00000200:7.0:1773851880.066541:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601762887168, offset 224
00000400:00000200:7.0:1773851880.066542:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19809@kfi7
00000400:00000200:7.0:1773851880.066543:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19809@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.066544:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c057aac6 nid 19809@kfi7 refs 1
00000400:00000200:7.0:1773851880.066546:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c057aac6 nid 19809@kfi7 refs 2
00000400:00000200:7.0:1773851880.066547:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c057aac6 nid 19809@kfi7 refs 3
00000400:00000200:7.0:1773851880.066548:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19809@kfi7 local destination
00000400:00000200:7.0:1773851880.066549:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769665:8769665:1024:4294967295] 19809@kfi7 LPNI seq info [684609:684609:16:4294967295]
00000400:00000200:7.0:1773851880.066551:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c057aac6 nid 19809@kfi7 refs 2
00000400:00000200:7.0:1773851880.066552:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19809@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.066553:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19809@kfi7(19809@kfi7:19809@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851880.066555:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c057aac6 nid 19809@kfi7 refs 3
00000800:00000200:7.0:1773851880.066556:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851880.066557:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851880.066559:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851880.066562:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c2 Using peer 19809@kfi7(0x4c2)
00000800:00000200:7.0:1773851880.066564:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x4c2: rc=0
00000800:00000200:7.0:1773851880.066566:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851880.066568:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.066569:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006ea9bf5 refcount 2 to 19809@kfi7
00010000:00000001:7.0:1773851880.066569:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851880.066570:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.066570:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851880.066571:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000b9cf576 x1859601762887168/t0(0) o400->94cd9207-73c0-4c31-b2af-19d4030b06f7@19809@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1728-0'
00000100:00100000:7.0:1773851880.066574:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b9cf576 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:94cd9207-73c0-4c31-b2af-19d4030b06f7+5:39508:x1859601762887168:12345-19809@kfi7:400:default-tuolumne1728-0 Request processed in 61us (101us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851880.066577:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19809@kfi7, seq: 2001950
00000100:00000040:7.0:1773851880.066578:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d00b1b3e : new rpc_count 0
00000100:00000001:7.0:1773851880.066579:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851880.066580:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851880.066580:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000800:00000200:6.0:1773851880.066580:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c2 TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851880.066581:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000febcce7f.
00000400:00000200:6.0:1773851880.066581:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851880.066582:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000983d7486.
00000020:00000040:7.0:1773851880.066583:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000d00b1b3e : new refcount 4
00000100:00000001:7.0:1773851880.066583:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851880.066583:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19809@kfi7: PUT: OK
00000400:00000200:6.0:1773851880.066584:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e33961df
00000400:00000010:6.0:1773851880.066584:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e33961df.
00000100:00000001:6.0:1773851880.066585:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851880.066585:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851880.066587:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c057aac6 nid 19809@kfi7 refs 2
00000800:00000200:6.0:1773851880.066588:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19809@kfi7(00000000249d6f39):0x0 lsk 1219 rsk 23 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c2 Transaction freed
00000800:00000200:13.0:1773851880.067475:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851880.067476:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851880.067478:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851880.067480:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851880.067482:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12419@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.067483:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12419@kfi7 : PUT - for me
00000400:00000200:13.0:1773851880.067484:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12419@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.067485:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008b0ba3d nid 12419@kfi7 refs 1
00000400:00000200:13.0:1773851880.067486:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12419@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.067487:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008b0ba3d nid 12419@kfi7 refs 2
00000400:00000200:13.0:1773851880.067488:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000008b0ba3d nid 12419@kfi7 refs 3
00000400:00000200:13.0:1773851880.067489:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12418@kfi7 to cpt 0
00000400:00000200:13.0:1773851880.067490:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12418@kfi7 of length 224 into portal 12 MB=0x69b4b569fb080
00000400:00000200:13.0:1773851880.067491:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12418@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 41320
00000800:00000200:13.0:1773851880.067493:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851880.067495:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851880.067497:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12419@kfi7: PUT: OK
00000100:00000001:13.0:1773851880.067498:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851880.067498:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851880.067499:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b34b88dd.
00000100:00000040:13.0:1773851880.067500:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000b34b88dd x1859597738422400 msgsize 224
00000100:00100000:13.0:1773851880.067501:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12418@kfi7 (source: 12345-12419@kfi7)
00000100:00000001:13.0:1773851880.067502:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851880.067503:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000008b0ba3d nid 12419@kfi7 refs 2
00000800:00000200:13.0:1773851880.067504:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851880.067505:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851880.067506:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851880.067507:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851880.067507:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851880.067509:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851880.067510:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597738422400
00000020:00000001:15.0:1773851880.067511:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851880.067512:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f8f4
00000020:00000001:15.0:1773851880.067513:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851880.067517:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000089eddb4d refcount=5
00000020:00000001:15.0:1773851880.067518:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113888240640 : -106959821310976 : ffff9eb879d87400)
00000020:00000001:15.0:1773851880.067519:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113888240640 : -106959821310976 : ffff9eb879d87400)
00000100:00000001:15.0:1773851880.067521:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851880.067522:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851880.067524:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000916e2cfc.
00000020:00000010:15.0:1773851880.067525:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851880.067527:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007edbe72e.
00000100:00000001:15.0:1773851880.067528:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851880.067529:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851880.067530:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851880.067531:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851880.067532:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851880.067533:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851880.067534:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851880.067537:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851880.067537:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851880.067537:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851880.067538:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851880.067539:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12418@kfi7, seq: 2289879
00000100:00000040:15.0:1773851880.067541:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000089eddb4d : new rpc_count 1
00000100:00000001:12.0:1773851880.067541:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851880.067542:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902274432 : -106994807277184 : ffff9eb05484f980)
00000100:00000001:12.0:1773851880.067542:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851880.067543:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b34b88dd x1859597738422400/t0(0) o400->bd3c2b10-e896-48f5-8d5c-dc9151bf9f95@12418@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1272-0'
00000100:00000001:15.0:1773851880.067549:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851880.067549:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851880.067551:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b34b88dd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:bd3c2b10-e896-48f5-8d5c-dc9151bf9f95+5:39760:x1859597738422400:12345-12418@kfi7:400:default-tuolumne1272-0
00000100:00000200:15.0:1773851880.067553:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597738422400
00000020:00000001:15.0:1773851880.067554:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851880.067555:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851880.067556:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851880.067557:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851880.067558:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851880.067559:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851880.067560:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597738422400, found 0 last_xid 1859597738422399
00000020:00000001:15.0:1773851880.067562:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851880.067563:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851880.067563:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851880.067564:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851880.067565:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851880.067566:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851880.067567:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851880.067570:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c3ef4cf6.
02000000:00000001:15.0:1773851880.067571:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851880.067572:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851880.067573:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851880.067574:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096702075, transno 0, xid 1859597738422400
00010000:00000001:15.0:1773851880.067575:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851880.067576:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b34b88dd x1859597738422400/t0(0) o400->bd3c2b10-e896-48f5-8d5c-dc9151bf9f95@12418@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1272-0'
00010000:00000001:15.0:1773851880.067581:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851880.067582:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851880.067583:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=113 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851880.067584:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851880.067586:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000093c7d4f9 refcount 3 to 12418@kfi7
00000100:00000001:15.0:1773851880.067587:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005440 : -107146751546176 : ffff9e8cf3ef6cc0)
02000000:00000001:15.0:1773851880.067588:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851880.067589:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851880.067590:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851880.067591:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12419@kfi7
00000400:00000010:15.0:1773851880.067592:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000d55f9f0.
00000100:00000200:15.0:1773851880.067593:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597738422400, offset 224
00000400:00000200:15.0:1773851880.067596:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12419@kfi7
00000400:00000200:15.0:1773851880.067597:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12419@kfi7 to cpt 3
00000400:00000200:15.0:1773851880.067599:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008b0ba3d nid 12419@kfi7 refs 1
00000400:00000200:15.0:1773851880.067600:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000008b0ba3d nid 12419@kfi7 refs 2
00000400:00000200:15.0:1773851880.067603:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000008b0ba3d nid 12419@kfi7 refs 3
00000400:00000200:15.0:1773851880.067604:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12419@kfi7 local destination
00000400:00000200:15.0:1773851880.067607:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769666:8769666:1024:4294967295] 12419@kfi7 LPNI seq info [308589:308589:16:4294967295]
00000400:00000200:15.0:1773851880.067609:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000008b0ba3d nid 12419@kfi7 refs 2
00000400:00000200:15.0:1773851880.067611:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12419@kfi7 to cpt 3
00000400:00000200:15.0:1773851880.067614:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12419@kfi7(12419@kfi7:12419@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851880.067616:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000008b0ba3d nid 12419@kfi7 refs 3
00000800:00000200:15.0:1773851880.067619:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851880.067621:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851880.067625:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851880.067629:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000092 Using peer 12419@kfi7(0x100000000000092)
00000800:00000200:15.0:1773851880.067634:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x100000000000092: rc=0
00000800:00000200:15.0:1773851880.067636:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000092 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851880.067640:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851880.067641:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000093c7d4f9 refcount 2 to 12418@kfi7
00010000:00000001:15.0:1773851880.067642:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851880.067643:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851880.067644:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851880.067645:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b34b88dd x1859597738422400/t0(0) o400->bd3c2b10-e896-48f5-8d5c-dc9151bf9f95@12418@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1272-0'
00000800:00000200:13.0:1773851880.067648:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000092 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851880.067649:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851880.067650:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b34b88dd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:bd3c2b10-e896-48f5-8d5c-dc9151bf9f95+5:39760:x1859597738422400:12345-12418@kfi7:400:default-tuolumne1272-0 Request processed in 100us (149us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851880.067650:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12419@kfi7: PUT: OK
00000400:00000200:13.0:1773851880.067651:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000d55f9f0
00000400:00000010:13.0:1773851880.067651:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000d55f9f0.
00000100:00000001:13.0:1773851880.067652:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851880.067652:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851880.067653:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000008b0ba3d nid 12419@kfi7 refs 2
00000100:00100000:15.0:1773851880.067654:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12418@kfi7, seq: 2289879
00000100:00000040:15.0:1773851880.067655:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000089eddb4d : new rpc_count 0
00000800:00000200:13.0:1773851880.067655:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 12419@kfi7(00000000cd3baf9d):0x0 lsk 147 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000092 Transaction freed
00000100:00000001:15.0:1773851880.067656:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851880.067657:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851880.067658:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851880.067659:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007edbe72e.
00000020:00000010:15.0:1773851880.067661:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000916e2cfc.
00000020:00000040:15.0:1773851880.067662:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000089eddb4d : new refcount 4
00000100:00000001:15.0:1773851880.067663:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851880.082704:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851880.082706:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851880.082708:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851880.082711:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851880.082714:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13818@kfi7 to cpt 6
00000400:00000200:25.0:1773851880.082717:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13818@kfi7 : PUT - for me
00000400:00000200:25.0:1773851880.082719:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13818@kfi7 to cpt 6
00000400:00000200:25.0:1773851880.082720:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002853a627 nid 13818@kfi7 refs 1
00000400:00000200:25.0:1773851880.082722:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13818@kfi7 to cpt 6
00000400:00000200:25.0:1773851880.082723:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002853a627 nid 13818@kfi7 refs 2
00000400:00000200:25.0:1773851880.082731:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002853a627 nid 13818@kfi7 refs 3
00000400:00000200:25.0:1773851880.082733:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13819@kfi7 to cpt 1
00000400:00000200:25.0:1773851880.082734:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13819@kfi7 of length 440 into portal 12 MB=0x699de8c318f40
00000400:00000200:25.0:1773851880.082737:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13819@kfi7 of length 440/440 into md 0x16159c9699 [64] + 26368
00000800:00000200:25.0:1773851880.082740:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851880.082744:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851880.082745:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13818@kfi7: PUT: OK
00000100:00000001:25.0:1773851880.082748:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851880.082748:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851880.082750:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd9236ac.
00000100:00000040:25.0:1773851880.082751:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000dd9236ac x1858030974111552 msgsize 440
00000100:00100000:25.0:1773851880.082754:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-13819@kfi7 (source: 12345-13818@kfi7)
00000100:00000001:25.0:1773851880.082756:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851880.082757:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002853a627 nid 13818@kfi7 refs 2
00000100:00000001:27.0:1773851880.082758:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851880.082760:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851880.082760:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851880.082761:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851880.082762:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851880.082763:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851880.082765:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030974111552
00000020:00000001:27.0:1773851880.082766:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851880.082766:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9118f
00000020:00000001:27.0:1773851880.082768:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851880.082771:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003bb8e38d refcount=6
00000020:00000001:27.0:1773851880.082772:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240531968 : -107152469019648 : ffff9e8b9f25b400)
00000020:00000001:27.0:1773851880.082773:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240531968 : -107152469019648 : ffff9e8b9f25b400)
00000100:00000001:27.0:1773851880.082775:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851880.082776:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851880.082777:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005efb579a.
00000020:00000010:27.0:1773851880.082779:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851880.082780:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000040:27.0:1773851880.082782:0:41182:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +82s
00000100:00000001:27.0:1773851880.082783:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851880.082784:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851880.082785:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.082787:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.082788:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851880.082791:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851880.082792:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851880.082792:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851880.082793:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851880.082794:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13819@kfi7, seq: 1451911035
00000100:00000040:27.0:1773851880.082795:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003bb8e38d : new rpc_count 1
00000100:00000001:26.0:1773851880.082795:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.082796:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252471936 : -106967457079680 : ffff9eb6b2b7de80)
00000100:00000001:26.0:1773851880.082797:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851880.082798:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dd9236ac x1858030974111552/t0(0) o41->9e3a8776-cba2-4e17-86e4-afe9f824ed79@13819@kfi7:607/0 lens 440/0 e 0 to 0 dl 1773851967 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne222-0'
00000100:00000001:27.0:1773851880.082804:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851880.082805:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851880.082806:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dd9236ac pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:9e3a8776-cba2-4e17-86e4-afe9f824ed79+6:110141:x1858030974111552:12345-13819@kfi7:41:default-tuolumne222-0
00000100:00000200:27.0:1773851880.082809:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030974111552
00000020:00000001:27.0:1773851880.082811:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851880.082812:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851880.082813:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.082814:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851880.082815:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:27.0:1773851880.082817:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851880.082818:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030974111552, found 0 last_xid 1858030974111551
00000020:00000001:27.0:1773851880.082819:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851880.082821:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851880.082822:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851880.082822:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.082824:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851880.082825:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851880.082826:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000006f608fbb.
02000000:00000001:27.0:1773851880.082827:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.082829:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082830:0:41182:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:27.0:1773851880.082831:0:41182:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:27.0:1773851880.082832:0:41182:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082834:0:41182:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:27.0:1773851880.082836:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:27.0:1773851880.082838:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082841:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:27.0:1773851880.082842:0:41182:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082843:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:27.0:1773851880.082844:0:41182:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082845:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:27.0:1773851880.082846:0:41182:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082847:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:27.0:1773851880.082848:0:41182:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082849:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:27.0:1773851880.082850:0:41182:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082852:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082853:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500108800 free, 351498039296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097688 files, 343261825 free files
00000004:00000001:27.0:1773851880.082856:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082858:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082858:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504325632 free, 351502170112 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056181 files, 343265943 free files
00000004:00000001:27.0:1773851880.082864:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082865:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082866:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690116096 free, 351687634944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231188 files, 343447379 free files
00000004:00000001:27.0:1773851880.082868:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082869:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082870:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382747136 free, 351380685824 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978698 files, 343147214 free files
00000004:00000001:27.0:1773851880.082872:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082874:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082874:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958986240 free, 350956917760 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563970 files, 342733385 free files
00000004:00000001:27.0:1773851880.082877:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082878:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082879:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351228416 free, 351348342784 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084058 files, 343116434 free files
00000004:00000001:27.0:1773851880.082881:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082882:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082883:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482152960 free, 351481205760 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097085 files, 343244290 free files
00000004:00000001:27.0:1773851880.082885:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082887:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082888:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449328640 free, 351446803456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160955 files, 343212235 free files
00000004:00000001:27.0:1773851880.082890:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082891:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082892:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353583616 free, 351351207936 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083227 files, 343118734 free files
00000004:00000001:27.0:1773851880.082894:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082896:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082896:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388964864 free, 351386286080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019060 files, 343153286 free files
00000004:00000001:27.0:1773851880.082899:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082900:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082900:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406563328 free, 351404190720 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127257 files, 343170472 free files
00000004:00000001:27.0:1773851880.082904:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082905:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082906:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351379010560 free, 351376041984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019049 files, 343143565 free files
00000004:00000001:27.0:1773851880.082908:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082909:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082910:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466009600 free, 351462818816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062839 files, 343228525 free files
00000004:00000001:27.0:1773851880.082912:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082913:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082914:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489062912 free, 351485961216 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066805 files, 343251038 free files
00000004:00000001:27.0:1773851880.082916:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082917:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082918:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492688896 free, 351490286592 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372077977 files, 343254579 free files
00000004:00000001:27.0:1773851880.082920:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082921:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082922:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524049920 free, 351521309696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113834 files, 343285205 free files
00000004:00000001:27.0:1773851880.082924:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082926:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082926:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510564864 free, 351507933184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095679 files, 343272036 free files
00000004:00000001:27.0:1773851880.082929:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082930:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082930:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541486592 free, 351539420160 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136606 files, 343302233 free files
00000004:00000001:27.0:1773851880.082933:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082934:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082935:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470692352 free, 351461572608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064520 files, 343233098 free files
00000004:00000001:27.0:1773851880.082937:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082938:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082939:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666640896 free, 351645434880 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237822 files, 343424454 free files
00000004:00000001:27.0:1773851880.082942:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082943:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082944:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545811968 free, 351536147456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116422 files, 343306457 free files
00000004:00000001:27.0:1773851880.082946:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082948:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082948:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603943424 free, 351601693696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190429 files, 343363226 free files
00000004:00000001:27.0:1773851880.082951:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082952:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082953:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615877120 free, 351613277184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043433 files, 343374880 free files
00000004:00000001:27.0:1773851880.082955:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082956:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082956:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420254208 free, 351417807872 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008959 files, 343183842 free files
00000004:00000001:27.0:1773851880.082959:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082960:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082960:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409127424 free, 351407067136 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011300 files, 343172976 free files
00000004:00000001:27.0:1773851880.082963:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082964:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082965:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480018944 free, 351478660096 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073116 files, 343242206 free files
00000004:00000001:27.0:1773851880.082967:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082968:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082969:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593624576 free, 351576785920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189932 files, 343353149 free files
00000004:00000001:27.0:1773851880.082971:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082972:0:41182:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:27.0:1773851880.082973:0:41182:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464067072 free, 351458185216 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064787 files, 343226628 free files
00000004:00000001:27.0:1773851880.082975:0:41182:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082976:0:41182:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082977:0:41182:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:27.0:1773851880.082980:0:41182:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 66060288 granted 1839581985855 pending 396361728 free 40309313687781376 avail 40308834534686720
00000004:00000020:27.0:1773851880.082982:0:41182:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841141037056 free, 9841023943424 avail; 10969025134 objects: 9610489294 free; state 100
00000020:00000001:27.0:1773851880.082984:0:41182:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:27.0:1773851880.082988:0:41182:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851880.082990:0:41182:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851880.082991:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768292, transno 0, xid 1858030974111552
00010000:00000001:27.0:1773851880.082992:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851880.082994:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dd9236ac x1858030974111552/t0(0) o41->9e3a8776-cba2-4e17-86e4-afe9f824ed79@13819@kfi7:607/0 lens 440/368 e 0 to 0 dl 1773851967 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne222-0'
00010000:00000001:27.0:1773851880.082999:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851880.083000:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851880.083001:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=113 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851880.083004:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851880.083005:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000112f6e4e refcount 5 to 13819@kfi7
00000100:00000001:27.0:1773851880.083006:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931325663872 : -107142383887744 : ffff9e8df8449a80)
02000000:00000001:27.0:1773851880.083008:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851880.083009:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.083010:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851880.083011:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13818@kfi7
00000400:00000010:27.0:1773851880.083013:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ff7a8930.
00000100:00000200:27.0:1773851880.083014:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030974111552, offset 224
00000400:00000200:27.0:1773851880.083017:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13818@kfi7
00000400:00000200:27.0:1773851880.083018:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13818@kfi7 to cpt 6
00000400:00000200:27.0:1773851880.083020:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002853a627 nid 13818@kfi7 refs 1
00000400:00000200:27.0:1773851880.083022:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002853a627 nid 13818@kfi7 refs 2
00000400:00000200:27.0:1773851880.083024:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002853a627 nid 13818@kfi7 refs 3
00000400:00000200:27.0:1773851880.083026:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13818@kfi7 local destination
00000400:00000200:27.0:1773851880.083029:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769667:8769667:1024:4294967295] 13818@kfi7 LPNI seq info [28027:28027:16:4294967295]
00000400:00000200:27.0:1773851880.083032:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002853a627 nid 13818@kfi7 refs 2
00000400:00000200:27.0:1773851880.083033:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13818@kfi7 to cpt 6
00000400:00000200:27.0:1773851880.083037:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13818@kfi7(13818@kfi7:13818@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851880.083041:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002853a627 nid 13818@kfi7 refs 3
00000800:00000200:27.0:1773851880.083043:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851880.083045:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:27.0:1773851880.083049:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851880.083054:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003d5 Using peer 13818@kfi7(0x1000000000003d5)
00000800:00000200:27.0:1773851880.083059:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000005690846: Posted send of 468 bytes to peer 0x1000000000003d5: rc=0
00000800:00000200:27.0:1773851880.083062:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003d5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851880.083066:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851880.083067:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000112f6e4e refcount 4 to 13819@kfi7
00010000:00000001:27.0:1773851880.083069:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851880.083070:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.083071:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851880.083072:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd9236ac x1858030974111552/t0(0) o41->9e3a8776-cba2-4e17-86e4-afe9f824ed79@13819@kfi7:607/0 lens 440/368 e 0 to 0 dl 1773851967 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne222-0'
00000800:00000200:25.0:1773851880.083078:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003d5 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851880.083079:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dd9236ac pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:9e3a8776-cba2-4e17-86e4-afe9f824ed79+6:110141:x1858030974111552:12345-13819@kfi7:41:default-tuolumne222-0 Request processed in 274us (326us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851880.083082:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851880.083083:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13819@kfi7, seq: 1451911035
00000400:00000200:25.0:1773851880.083083:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13818@kfi7: PUT: OK
00000100:00000040:27.0:1773851880.083084:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003bb8e38d : new rpc_count 0
00000400:00000200:25.0:1773851880.083085:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ff7a8930
00000100:00000001:27.0:1773851880.083086:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:25.0:1773851880.083086:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ff7a8930.
00000100:00000001:27.0:1773851880.083087:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851880.083087:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851880.083087:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851880.083088:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851880.083089:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851880.083089:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002853a627 nid 13818@kfi7 refs 2
00000020:00000010:27.0:1773851880.083091:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005efb579a.
00000020:00000040:27.0:1773851880.083092:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000003bb8e38d : new refcount 5
00000800:00000200:25.0:1773851880.083092:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 13818@kfi7(0000000070599ffb):0x0 lsk 982 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003d5 Transaction freed
00000100:00000001:27.0:1773851880.083094:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851880.096848:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851880.096849:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851880.096851:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851880.096853:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851880.096855:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25121@kfi7 to cpt 1
00000400:00000200:5.0:1773851880.096857:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25121@kfi7 : PUT - for me
00000400:00000200:5.0:1773851880.096858:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25121@kfi7 to cpt 1
00000400:00000200:5.0:1773851880.096859:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050a53f99 nid 25121@kfi7 refs 1
00000400:00000200:5.0:1773851880.096860:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25121@kfi7 to cpt 1
00000400:00000200:5.0:1773851880.096861:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050a53f99 nid 25121@kfi7 refs 2
00000400:00000200:5.0:1773851880.096862:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000050a53f99 nid 25121@kfi7 refs 3
00000400:00000200:5.0:1773851880.096863:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25120@kfi7 to cpt 6
00000400:00000200:5.0:1773851880.096864:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25120@kfi7 of length 224 into portal 12 MB=0x69b823a25f1c0
00000400:00000200:5.0:1773851880.096865:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25120@kfi7 of length 224/224 into md 0x793926dc5 [64] + 152312
00000800:00000200:5.0:1773851880.096868:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851880.096870:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851880.096871:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25121@kfi7: PUT: OK
00000100:00000001:5.0:1773851880.096872:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851880.096872:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851880.096873:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000c193dd1.
00000100:00000040:5.0:1773851880.096874:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000000c193dd1 x1859833483882944 msgsize 224
00000100:00100000:5.0:1773851880.096876:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25120@kfi7 (source: 12345-25121@kfi7)
00000100:00000001:5.0:1773851880.096877:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851880.096878:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851880.096878:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000050a53f99 nid 25121@kfi7 refs 2
02000000:00000001:7.0:1773851880.096879:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851880.096879:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851880.096879:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851880.096880:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851880.096881:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851880.096881:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833483882944
00000020:00000001:7.0:1773851880.096882:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851880.096882:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875d374709
00000020:00000001:7.0:1773851880.096883:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851880.096885:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009e0adeb3 refcount=5
00000020:00000001:7.0:1773851880.096886:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138053904384 : -106935655647232 : ffff9ebe1a3b3800)
00000020:00000001:7.0:1773851880.096886:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138053904384 : -106935655647232 : ffff9ebe1a3b3800)
00000100:00000001:7.0:1773851880.096887:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851880.096888:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851880.096889:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000023886e40.
00000020:00000010:7.0:1773851880.096890:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851880.096891:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851880.096892:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851880.096892:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851880.096893:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851880.096894:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851880.096894:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851880.096895:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.096896:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851880.096897:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851880.096897:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851880.096898:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851880.096898:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25120@kfi7, seq: 2001951
00000100:00000001:4.0:1773851880.096898:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851880.096900:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009e0adeb3 : new rpc_count 1
00000100:00000001:7.0:1773851880.096900:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108938496 : -106938600613120 : ffff9ebd6ab29b00)
00000100:00000001:4.0:1773851880.096900:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.096900:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.096902:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000c193dd1 x1859833483882944/t0(0) o400->db74aa88-900f-4c81-923a-0667afeea603@25120@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2063-0'
00000100:00000001:7.0:1773851880.096904:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851880.096904:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851880.096905:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c193dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:db74aa88-900f-4c81-923a-0667afeea603+5:39670:x1859833483882944:12345-25120@kfi7:400:default-tuolumne2063-0
00000100:00000200:7.0:1773851880.096907:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833483882944
00000020:00000001:7.0:1773851880.096908:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851880.096908:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851880.096909:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.096910:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851880.096910:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851880.096911:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851880.096912:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833483882944, found 0 last_xid 1859833483882943
00000020:00000001:7.0:1773851880.096912:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851880.096913:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851880.096914:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851880.096914:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.096915:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851880.096915:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851880.096916:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851880.096917:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e30be6d3.
02000000:00000001:7.0:1773851880.096917:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.096918:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.096919:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851880.096919:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013968854, transno 0, xid 1859833483882944
00010000:00000001:7.0:1773851880.096920:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851880.096921:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000c193dd1 x1859833483882944/t0(0) o400->db74aa88-900f-4c81-923a-0667afeea603@25120@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2063-0'
00010000:00000001:7.0:1773851880.096924:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851880.096924:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851880.096936:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=112 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851880.096937:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851880.096937:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000089dfd8b2 refcount 3 to 25120@kfi7
00000100:00000001:7.0:1773851880.096938:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299332064 : -107155410219552 : ffff9e8aefd68de0)
02000000:00000001:7.0:1773851880.096939:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851880.096939:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.096940:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851880.096941:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25121@kfi7
00000400:00000010:7.0:1773851880.096942:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f88013b1.
00000100:00000200:7.0:1773851880.096943:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833483882944, offset 224
00000400:00000200:7.0:1773851880.096944:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25121@kfi7
00000400:00000200:7.0:1773851880.096945:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25121@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.096946:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000050a53f99 nid 25121@kfi7 refs 1
00000400:00000200:7.0:1773851880.096947:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000050a53f99 nid 25121@kfi7 refs 2
00000400:00000200:7.0:1773851880.096948:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000050a53f99 nid 25121@kfi7 refs 3
00000400:00000200:7.0:1773851880.096949:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25121@kfi7 local destination
00000400:00000200:7.0:1773851880.096950:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769668:8769668:1024:4294967295] 25121@kfi7 LPNI seq info [538341:538341:16:4294967295]
00000400:00000200:7.0:1773851880.096951:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000050a53f99 nid 25121@kfi7 refs 2
00000400:00000200:7.0:1773851880.096952:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25121@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.096954:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25121@kfi7(25121@kfi7:25121@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851880.096955:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000050a53f99 nid 25121@kfi7 refs 3
00000800:00000200:7.0:1773851880.096956:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851880.096957:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851880.096960:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851880.096962:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000045c Using peer 25121@kfi7(0x10000000000045c)
00000800:00000200:7.0:1773851880.096965:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x10000000000045c: rc=0
00000800:00000200:7.0:1773851880.096966:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000045c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851880.096970:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.096971:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000089dfd8b2 refcount 2 to 25120@kfi7
00010000:00000001:7.0:1773851880.096972:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851880.096972:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.096973:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851880.096974:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000c193dd1 x1859833483882944/t0(0) o400->db74aa88-900f-4c81-923a-0667afeea603@25120@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2063-0'
00000100:00100000:7.0:1773851880.096978:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c193dd1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:db74aa88-900f-4c81-923a-0667afeea603+5:39670:x1859833483882944:12345-25120@kfi7:400:default-tuolumne2063-0 Request processed in 72us (102us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851880.096978:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000045c TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851880.096980:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25120@kfi7, seq: 2001951
00000400:00000200:6.0:1773851880.096980:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:7.0:1773851880.096981:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009e0adeb3 : new rpc_count 0
00000100:00000001:7.0:1773851880.096981:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851880.096981:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25121@kfi7: PUT: OK
00000400:00000200:6.0:1773851880.096981:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f88013b1
00000100:00000001:7.0:1773851880.096982:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:6.0:1773851880.096982:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f88013b1.
00000020:00000010:7.0:1773851880.096983:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851880.096983:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000100:00000001:6.0:1773851880.096983:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851880.096983:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851880.096984:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000023886e40.
00000400:00000200:6.0:1773851880.096984:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000050a53f99 nid 25121@kfi7 refs 2
00000020:00000040:7.0:1773851880.096985:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009e0adeb3 : new refcount 4
00000100:00000001:7.0:1773851880.096986:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851880.096986:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 25121@kfi7(00000000f993c3e2):0x0 lsk 1117 rsk 5 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000045c Transaction freed
00000004:00000001:0.0:1773851880.265730:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851880.265731:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:4.0:1773851880.265731:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:0.0:1773851880.265731:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:6.0:1773851880.265732:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851880.265732:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0a8a955.
00000004:00000020:4.0:1773851880.265732:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:4.0:1773851880.265732:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b45d1f4a.
00000100:00000010:0.0:1773851880.265732:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003eba7ea5.
00000020:00000040:0.0:1773851880.265732:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000004:00000001:8.0:1773851880.265733:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851880.265733:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:6.0:1773851880.265733:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000100:00000001:0.0:1773851880.265733:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:29.0:1773851880.265734:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851880.265734:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:8.0:1773851880.265734:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f494273.
00000100:00000001:6.0:1773851880.265734:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:4.0:1773851880.265734:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000100:00000001:4.0:1773851880.265734:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:0.0:1773851880.265734:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:29.0:1773851880.265735:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:28.0:1773851880.265735:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:6.0:1773851880.265735:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851880.265735:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:0.0:1773851880.265735:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:29.0:1773851880.265736:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e4a3e705.
00000100:00000010:28.0:1773851880.265736:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eacf5249.
00000020:00000040:8.0:1773851880.265736:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
02000000:00000001:6.0:1773851880.265736:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851880.265736:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851880.265736:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000930126ef.
00000020:00000040:29.0:1773851880.265737:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:8.0:1773851880.265737:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851880.265737:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:6.0:1773851880.265737:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d8277e2a.
02000000:00000010:4.0:1773851880.265737:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000015991966.
00000100:00000001:0.0:1773851880.265737:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851880.265738:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:28.0:1773851880.265738:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
02000000:00000001:8.0:1773851880.265738:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265738:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265738:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851880.265738:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.265738:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:0.0:1773851880.265738:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:29.0:1773851880.265739:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:28.0:1773851880.265739:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851880.265739:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.265739:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851880.265740:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851880.265740:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:8.0:1773851880.265740:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:0.0:1773851880.265740:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851880.265741:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851880.265741:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851880.265741:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a0a8a955] to pc [ptlrpcd_01_01+1]  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851880.265741:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b45d1f4a] to pc [ptlrpcd_01_00+0]  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:0.0:1773851880.265741:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003eba7ea5] to pc [ptlrpcd_00_02+2]  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:29.0:1773851880.265742:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
02000000:00000010:28.0:1773851880.265742:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000037668ce6.
00000100:00000001:8.0:1773851880.265742:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851880.265743:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851880.265743:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851880.265744:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851880.265744:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:4.0:1773851880.265744:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:0.0:1773851880.265744:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851880.265745:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851880.265745:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:8.0:1773851880.265745:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001f494273] to pc [ptlrpcd_02_00+0]  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:6.0:1773851880.265745:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006d4a620a.
00080000:00000010:4.0:1773851880.265745:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000440074eb.
00000100:00000001:29.0:1773851880.265746:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851880.265746:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851880.265746:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637127435374592 : -106946274177024 : ffff9ebba1515000)
00000100:00000001:5.0:1773851880.265746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:4.0:1773851880.265746:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637119344523264 : -106954365028352 : ffff9eb9bf10b800)
00000100:00000001:2.0:1773851880.265746:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:2.0:1773851880.265746:0:41063:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:1.0:1773851880.265746:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851880.265746:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851880.265747:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851880.265747:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851880.265747:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:4.0:1773851880.265747:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:2.0:1773851880.265747:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:29.0:1773851880.265748:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e4a3e705] to pc [ptlrpcd_07_03+3]  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851880.265748:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000eacf5249] to pc [ptlrpcd_07_00+0]  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851880.265748:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:4.0:1773851880.265748:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.265748:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851880.265748:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:6.0:1773851880.265749:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:4.0:1773851880.265749:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000004:00000010:4.0:1773851880.265749:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003b332ecd.
00000100:00000001:2.0:1773851880.265749:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851880.265749:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:8.0:1773851880.265750:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00001000:6.0:1773851880.265750:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00000004:00080000:4.0:1773851880.265750:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614154719025675ns, next at 614155719024814ns, rc = 0
00000100:00000001:2.0:1773851880.265750:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851880.265751:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851880.265751:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:8.0:1773851880.265751:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003d905b3e.
00000004:00000010:6.0:1773851880.265751:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d20fff1b.
00000100:00000001:5.0:1773851880.265751:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:4.0:1773851880.265751:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:2.0:1773851880.265751:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851880.265752:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:10.0:1773851880.265752:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851880.265752:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851880.265752:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637099944976384 : -106973764575232 : ffff9eb53ac32000)
00000004:00080000:6.0:1773851880.265752:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614154719027669ns, next at 614155719026126ns, rc = 0
00000100:00000001:5.0:1773851880.265752:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851880.265752:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:4.0:1773851880.265752:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851880.265753:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851880.265753:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:6.0:1773851880.265753:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851880.265753:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851880.265753:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851880.265754:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851880.265754:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851880.265754:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0a8a955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051933632:46@kfi7:13:default-yuba2-0
00000100:00000001:2.0:1773851880.265754:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851880.265754:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851880.265755:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:29.0:1773851880.265755:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851880.265755:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:8.0:1773851880.265755:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000100:00000001:5.0:1773851880.265755:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:2.0:1773851880.265755:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:31.0:1773851880.265756:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851880.265756:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851880.265756:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851880.265756:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851880.265756:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d26c8531.
02000000:00000001:2.0:1773851880.265756:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851880.265757:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:11.0:1773851880.265757:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:8.0:1773851880.265757:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614154719032889ns, next at 614155719031436ns, rc = 0
02000000:00000001:5.0:1773851880.265757:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851880.265757:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851880.265758:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851880.265758:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:11.0:1773851880.265758:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851880.265758:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851880.265758:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:2.0:1773851880.265758:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003eba7ea5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051933504:2057@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851880.265759:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851880.265759:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00100000:11.0:1773851880.265759:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f494273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051933696:2055@kfi7:13:default-yuba2-0
02000000:00000010:5.0:1773851880.265759:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008cdb9567.
00000100:00000001:2.0:1773851880.265759:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:29.0:1773851880.265760:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:8.0:1773851880.265760:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851880.265760:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851880.265760:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851880.265760:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:2.0:1773851880.265760:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851880.265761:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:30.0:1773851880.265761:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851880.265761:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265761:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:11.0:1773851880.265761:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:5.0:1773851880.265761:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000010:5.0:1773851880.265761:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000984a9f71.
02000000:00000001:2.0:1773851880.265761:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:2.0:1773851880.265761:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f82e5278.
00000100:00000001:31.0:1773851880.265762:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:28.0:1773851880.265762:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000082f32462.
02000000:00000001:11.0:1773851880.265762:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851880.265762:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:5.0:1773851880.265762:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
02000000:00000001:2.0:1773851880.265762:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851880.265763:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851880.265763:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851880.265763:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637023296504832 : -107050413046784 : ffff9ea362284400)
02000000:00000010:11.0:1773851880.265763:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000031994f28.
00000400:00000200:2.0:1773851880.265763:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00100000:31.0:1773851880.265764:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e4a3e705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051933760:2056@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851880.265764:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851880.265764:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851880.265764:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851880.265764:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:11.0:1773851880.265764:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851880.265764:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933632, portal 4
00000400:00000010:2.0:1773851880.265764:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000100:00000001:30.0:1773851880.265765:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851880.265765:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:11.0:1773851880.265765:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:5.0:1773851880.265765:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851880.265765:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814076160 : -107101895475456 : ffff9e976590bf00)
00000400:00000010:2.0:1773851880.265765:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8c1b5d.
00000100:00000001:31.0:1773851880.265766:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851880.265766:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851880.265766:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000100:00000200:2.0:1773851880.265766:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933504, portal 4
02000000:00000001:31.0:1773851880.265767:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00100000:30.0:1773851880.265767:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000eacf5249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051933824:2065@kfi7:13:default-yuba2-0
00080000:00000001:28.0:1773851880.265767:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851880.265767:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f8443cb8.
00000100:00000040:5.0:1773851880.265767:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851880.265767:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:31.0:1773851880.265768:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851880.265768:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00001000:28.0:1773851880.265768:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000100:00000200:11.0:1773851880.265768:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933696, portal 4
00000100:00000001:2.0:1773851880.265768:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203085184 : -107102506466432 : ffff9e974125c380)
02000000:00000001:31.0:1773851880.265769:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:30.0:1773851880.265769:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:11.0:1773851880.265769:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:2.0:1773851880.265769:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:31.0:1773851880.265770:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f14d9ff9.
02000000:00000001:31.0:1773851880.265770:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851880.265770:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851880.265770:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000010:28.0:1773851880.265770:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000035c48161.
00000100:00000001:11.0:1773851880.265770:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491254016 : -107117218297600 : ffff9e93d4410900)
00000100:00000001:5.0:1773851880.265770:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851880.265771:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000004:00080000:28.0:1773851880.265771:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614154719046474ns, next at 614155719044711ns, rc = 0
00000100:00000040:11.0:1773851880.265771:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851880.265771:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000010:5.0:1773851880.265771:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036e7f712.
00000400:00000010:31.0:1773851880.265772:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
02000000:00000010:30.0:1773851880.265772:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008b45a117.
00080000:00000001:28.0:1773851880.265772:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000200:5.0:1773851880.265772:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933632, offset 0
00000100:00000001:2.0:1773851880.265772:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:31.0:1773851880.265773:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
02000000:00000001:30.0:1773851880.265773:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851880.265773:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851880.265773:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000010:2.0:1773851880.265773:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000978b4844.
00000400:00000200:30.0:1773851880.265774:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000004:00000001:28.0:1773851880.265774:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265774:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:5.0:1773851880.265774:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000100:00000200:31.0:1773851880.265775:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933760, portal 4
00000100:00000001:31.0:1773851880.265775:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:30.0:1773851880.265775:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000040:11.0:1773851880.265775:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000010:11.0:1773851880.265775:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005cb89f82.
00000400:00000200:5.0:1773851880.265775:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000200:2.0:1773851880.265775:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933504, offset 0
00000100:00000001:31.0:1773851880.265776:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636955373899136 : -107118335652480 : ffff9e9391a78d80)
00000400:00000010:30.0:1773851880.265776:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00000200:11.0:1773851880.265776:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933696, offset 0
00000400:00000200:5.0:1773851880.265776:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:5.0:1773851880.265777:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:2.0:1773851880.265777:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000100:00000040:31.0:1773851880.265778:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851880.265778:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933824, portal 4
00000400:00000200:11.0:1773851880.265778:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:5.0:1773851880.265778:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:2.0:1773851880.265778:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:30.0:1773851880.265779:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851880.265779:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324237056 : -106976385314560 : ffff9eb49e8dd100)
00000400:00000200:11.0:1773851880.265779:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:2.0:1773851880.265779:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000100:00000001:31.0:1773851880.265780:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:11.0:1773851880.265780:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:5.0:1773851880.265780:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000400:00000200:2.0:1773851880.265780:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000040:30.0:1773851880.265781:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851880.265781:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000100:00000040:31.0:1773851880.265782:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000010:31.0:1773851880.265782:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000051546e8a.
00000400:00000200:11.0:1773851880.265782:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:5.0:1773851880.265782:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769665, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769668, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851880.265782:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000100:00000200:31.0:1773851880.265783:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933760, offset 0
00000400:00000200:11.0:1773851880.265783:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:31.0:1773851880.265784:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000200:11.0:1773851880.265784:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:5.0:1773851880.265784:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:2.0:1773851880.265784:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769665, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769668, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851880.265785:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:11.0:1773851880.265786:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769665, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769668, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851880.265786:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851880.265786:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000400:00000200:2.0:1773851880.265786:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851880.265787:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000100:00000001:30.0:1773851880.265787:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:2.0:1773851880.265787:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851880.265788:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000040:30.0:1773851880.265788:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000200:5.0:1773851880.265788:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769669:8769669:1024:4294967295] 46@kfi7 LPNI seq info [5403860:5403860:16:4294967295]
00000400:00000200:2.0:1773851880.265788:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000010:30.0:1773851880.265789:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005645ee20.
00000100:00000200:30.0:1773851880.265789:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933824, offset 0
00000400:00000200:11.0:1773851880.265789:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:11.0:1773851880.265789:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851880.265789:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:2.0:1773851880.265789:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769670:8769670:1024:4294967295] 2057@kfi7 LPNI seq info [5404109:5404109:16:4294967295]
00000400:00000200:31.0:1773851880.265790:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:11.0:1773851880.265790:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000200:5.0:1773851880.265790:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:31.0:1773851880.265791:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000400:00000200:30.0:1773851880.265791:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000400:00000200:11.0:1773851880.265791:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769671:8769671:1024:4294967295] 2055@kfi7 LPNI seq info [5404672:5404672:16:4294967295]
00000400:00000200:2.0:1773851880.265791:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:2.0:1773851880.265792:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:31.0:1773851880.265793:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769670, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769671, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851880.265793:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:11.0:1773851880.265794:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:31.0:1773851880.265795:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:2.0:1773851880.265795:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851880.265796:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851880.265797:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000400:00000200:2.0:1773851880.265797:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:31.0:1773851880.265798:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769672:8769672:1022:4294967295] 2056@kfi7 LPNI seq info [5402402:5402402:16:4294967295]
00000400:00000200:11.0:1773851880.265798:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851880.265798:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000800:00000200:2.0:1773851880.265799:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:31.0:1773851880.265800:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:11.0:1773851880.265800:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:5.0:1773851880.265800:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:2.0:1773851880.265800:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851880.265801:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:11.0:1773851880.265801:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:5.0:1773851880.265802:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:2.0:1773851880.265802:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851880.265803:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:11.0:1773851880.265803:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851880.265804:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851880.265805:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851880.265805:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000800:00000200:2.0:1773851880.265805:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000400:00000200:31.0:1773851880.265806:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:30.0:1773851880.265806:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:11.0:1773851880.265806:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851880.265806:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851880.265807:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:30.0:1773851880.265808:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000800:00000200:2.0:1773851880.265808:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000497e951d: Posted send of 324 bytes to peer 0x295: rc=0
00000800:00000200:31.0:1773851880.265809:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:11.0:1773851880.265809:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000800:00000200:5.0:1773851880.265809:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000800:00000200:31.0:1773851880.265810:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851880.265810:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8769672, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769671, p:4294967295, g:4294967295, h:1000]
00000800:00000200:2.0:1773851880.265810:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851880.265812:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:2.0:1773851880.265812:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.265812:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:31.0:1773851880.265813:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851880.265813:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:11.0:1773851880.265813:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000800:00000200:5.0:1773851880.265813:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 324 bytes to peer 0x3df: rc=0
00000100:00000001:2.0:1773851880.265813:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851880.265814:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000100:00000001:2.0:1773851880.265814:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851880.265815:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:5.0:1773851880.265815:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851880.265815:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851880.265816:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Using peer 2056@kfi7(0x204)
00000400:00000200:30.0:1773851880.265816:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769673:8769673:1023:4294967295] 2065@kfi7 LPNI seq info [5402831:5402831:16:4294967295]
00000400:00000200:30.0:1773851880.265817:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:11.0:1773851880.265817:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265817:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851880.265817:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851880.265818:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:11.0:1773851880.265818:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851880.265818:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:31.0:1773851880.265819:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x204: rc=0
00000100:00000001:11.0:1773851880.265819:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265819:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851880.265819:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851880.265819:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851880.265820:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851880.265820:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851880.265820:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851880.265821:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000100:00000001:11.0:1773851880.265821:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851880.265821:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851880.265821:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851880.265822:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265822:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851880.265822:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851880.265822:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:1.0:1773851880.265822:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851880.265823:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851880.265823:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000001:11.0:1773851880.265823:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265823:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851880.265823:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851880.265823:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851880.265823:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000100:00000001:31.0:1773851880.265824:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851880.265824:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851880.265824:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851880.265824:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000978b4844
00000400:00000010:1.0:1773851880.265824:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000978b4844.
00000100:00000001:31.0:1773851880.265825:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:5.0:1773851880.265825:0:41065:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:5.0:1773851880.265825:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851880.265825:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:30.0:1773851880.265826:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:10.0:1773851880.265826:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851880.265826:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000200:1.0:1773851880.265826:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851880.265827:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851880.265827:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851880.265827:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851880.265827:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851880.265828:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851880.265828:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:30.0:1773851880.265828:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851880.265828:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851880.265828:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851880.265828:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:31.0:1773851880.265829:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851880.265829:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851880.265829:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000800:00000200:6.0:1773851880.265829:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000100:00000040:5.0:1773851880.265829:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851880.265829:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:30.0:1773851880.265830:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851880.265830:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005cb89f82
00000100:00000040:1.0:1773851880.265830:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:10.0:1773851880.265831:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005cb89f82.
00000400:00000200:6.0:1773851880.265831:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851880.265832:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:6.0:1773851880.265832:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000001:5.0:1773851880.265832:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851880.265832:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.265832:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851880.265833:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000100:00000200:10.0:1773851880.265833:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851880.265833:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036e7f712
00000400:00000010:6.0:1773851880.265833:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036e7f712.
02000000:00000001:5.0:1773851880.265833:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:5.0:1773851880.265833:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.265833:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851880.265833:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:6.0:1773851880.265834:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00100000:5.0:1773851880.265834:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b45d1f4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051933568:2085@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851880.265834:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851880.265834:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:29.0:1773851880.265835:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_EVENT_TX_OK event status 0
00000100:00000200:6.0:1773851880.265835:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851880.265836:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:1.0:1773851880.265836:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000800:00000200:30.0:1773851880.265837:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000400:00000200:29.0:1773851880.265837:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:10.0:1773851880.265837:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851880.265837:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851880.265837:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:5.0:1773851880.265837:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:6.0:1773851880.265838:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:5.0:1773851880.265838:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851880.265838:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000800:00000200:30.0:1773851880.265839:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851880.265839:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
02000000:00000010:5.0:1773851880.265839:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ed398635.
00000400:00000200:29.0:1773851880.265840:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000051546e8a
00000100:00000001:10.0:1773851880.265840:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851880.265840:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
02000000:00000001:5.0:1773851880.265840:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851880.265841:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000051546e8a.
00000100:00000001:29.0:1773851880.265841:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:10.0:1773851880.265841:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:6.0:1773851880.265841:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851880.265841:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:6.0:1773851880.265842:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:5.0:1773851880.265842:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000017c05240.
00000100:00000001:30.0:1773851880.265843:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:29.0:1773851880.265843:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:10.0:1773851880.265843:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Transaction freed
00000400:00000200:6.0:1773851880.265843:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000010:5.0:1773851880.265843:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070d325a2.
00000100:00000200:5.0:1773851880.265843:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933568, portal 4
00000100:00000001:30.0:1773851880.265844:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851880.265844:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851880.265844:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000100:00000001:5.0:1773851880.265844:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851880.265845:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851880.265846:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851880.265846:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851880.265847:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851880.265848:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851880.265848:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851880.265849:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851880.265849:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851880.265849:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851880.265850:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851880.265850:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851880.265850:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851880.265850:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851880.265850:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528701824 : -106978180849792 : ffff9eb433881f80)
00000400:00000200:31.0:1773851880.265851:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851880.265851:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000040:5.0:1773851880.265851:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851880.265853:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000800:00000200:29.0:1773851880.265853:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Transaction freed
00000800:00000200:13.0:1773851880.265853:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851880.265853:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:31.0:1773851880.265854:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005645ee20
00000400:00000010:31.0:1773851880.265854:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005645ee20.
00000100:00000001:5.0:1773851880.265854:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:31.0:1773851880.265855:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:13.0:1773851880.265855:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:5.0:1773851880.265855:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000010:5.0:1773851880.265855:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000690e571.
00000100:00000200:31.0:1773851880.265856:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851880.265856:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933568, offset 0
00000800:00000200:13.0:1773851880.265857:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851880.265857:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000400:00000200:5.0:1773851880.265858:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851880.265859:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:13.0:1773851880.265859:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:5.0:1773851880.265859:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000040:31.0:1773851880.265860:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851880.265860:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000200:5.0:1773851880.265860:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:13.0:1773851880.265861:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:5.0:1773851880.265861:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000001:31.0:1773851880.265862:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851880.265862:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:5.0:1773851880.265862:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000100:00000001:31.0:1773851880.265863:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:13.0:1773851880.265863:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.265863:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851880.265864:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:5.0:1773851880.265864:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769672, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769673, p:4294967295, g:4294967295, h:1000]
00000400:00000200:13.0:1773851880.265865:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000800:00000200:31.0:1773851880.265866:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Transaction freed
00000400:00000200:13.0:1773851880.265866:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:9.0:1773851880.265866:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:5.0:1773851880.265866:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:13.0:1773851880.265867:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4b40
00000800:00000200:9.0:1773851880.265867:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851880.265867:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851880.265867:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:13.0:1773851880.265868:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000800:00000200:9.0:1773851880.265868:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851880.265868:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769674:8769674:1024:4294967295] 2085@kfi7 LPNI seq info [5403242:5403242:16:4294967295]
00000400:00000200:13.0:1773851880.265869:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f68cd [1] + 224
00000800:00000200:9.0:1773851880.265870:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851880.265870:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:13.0:1773851880.265871:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851880.265871:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:9.0:1773851880.265872:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:22.0:1773851880.265873:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:13.0:1773851880.265873:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851880.265873:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000400:00000200:5.0:1773851880.265873:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000800:00000200:22.0:1773851880.265874:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851880.265874:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000100:00000001:13.0:1773851880.265875:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851880.265875:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:5.0:1773851880.265875:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000800:00000200:22.0:1773851880.265876:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:13.0:1773851880.265876:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851880.265876:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000800:00000200:5.0:1773851880.265876:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:9.0:1773851880.265877:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:5.0:1773851880.265877:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851880.265878:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:22.0:1773851880.265879:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:13.0:1773851880.265879:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851880.265879:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:5.0:1773851880.265879:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851880.265880:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:22.0:1773851880.265881:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:9.0:1773851880.265881:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4bc0
00000100:00000001:13.0:1773851880.265882:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851880.265882:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:5.0:1773851880.265882:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Using peer 2085@kfi7(0x113)
00000800:00000200:1.0:1773851880.265882:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:22.0:1773851880.265883:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:13.0:1773851880.265883:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:1.0:1773851880.265883:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:22.0:1773851880.265884:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:9.0:1773851880.265884:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781698169 [1] + 224
00000800:00000200:5.0:1773851880.265884:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 324 bytes to peer 0x113: rc=0
00000100:00000001:2.0:1773851880.265884:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:1.0:1773851880.265884:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851880.265885:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000800:00000200:13.0:1773851880.265885:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851880.265885:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:22.0:1773851880.265886:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:9.0:1773851880.265886:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851880.265886:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000001:2.0:1773851880.265886:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:2.0:1773851880.265886:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:22.0:1773851880.265887:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:5.0:1773851880.265887:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:2.0:1773851880.265887:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000400:00000200:2.0:1773851880.265887:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8c1b5d
00000800:00000200:1.0:1773851880.265887:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851880.265888:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000100:00000001:5.0:1773851880.265888:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851880.265888:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:2.0:1773851880.265888:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8c1b5d.
00000400:00000200:1.0:1773851880.265888:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:22.0:1773851880.265889:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:17.0:1773851880.265889:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000100:00000001:5.0:1773851880.265889:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.265889:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:22.0:1773851880.265890:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4c00
00000800:00000200:17.0:1773851880.265890:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:5.0:1773851880.265890:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:2.0:1773851880.265890:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851880.265890:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:22.0:1773851880.265891:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:1.0:1773851880.265891:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:17.0:1773851880.265892:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851880.265892:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851880.265892:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:22.0:1773851880.265893:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d1475 [1] + 224
00000400:00000200:9.0:1773851880.265893:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000200:2.0:1773851880.265893:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851880.265893:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:17.0:1773851880.265894:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851880.265894:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:22.0:1773851880.265895:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851880.265895:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851880.265895:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851880.265895:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:17.0:1773851880.265896:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:5.0:1773851880.265896:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851880.265896:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851880.265896:0:41063:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:22.0:1773851880.265897:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851880.265897:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000100:00000001:9.0:1773851880.265897:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851880.265897:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
02000000:00000001:2.0:1773851880.265897:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:1.0:1773851880.265897:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:17.0:1773851880.265898:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000200:9.0:1773851880.265898:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851880.265898:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000690e571
00000100:00000001:2.0:1773851880.265898:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851880.265898:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851880.265898:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4c40
00000400:00000200:22.0:1773851880.265899:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000400:00000200:17.0:1773851880.265899:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000010:5.0:1773851880.265899:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000690e571.
00000100:00000001:5.0:1773851880.265899:0:2507993:0:(events.c:53:request_out_callback()) Process entered
02000000:00000001:2.0:1773851880.265899:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851880.265900:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:2.0:1773851880.265900:0:41063:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=113 v=66 (66 66 66 66)
00000400:00000200:1.0:1773851880.265900:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:22.0:1773851880.265901:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851880.265901:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000040:9.0:1773851880.265901:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:2.0:1773851880.265901:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=113 v=66 (1 1 1 1)
00000100:00000200:22.0:1773851880.265902:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851880.265902:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:17.0:1773851880.265902:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000001:2.0:1773851880.265902:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:1.0:1773851880.265902:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71dcc1 [1] + 224
00000100:00000001:5.0:1773851880.265903:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851880.265903:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851880.265903:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.265903:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:17.0:1773851880.265904:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:17.0:1773851880.265904:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4c80
00010000:00000001:2.0:1773851880.265904:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851880.265904:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851880.265905:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:2.0:1773851880.265905:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:2.0:1773851880.265905:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000400:00000200:1.0:1773851880.265905:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:22.0:1773851880.265906:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851880.265906:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851880.265906:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851880.265906:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:2.0:1773851880.265906:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:2.0:1773851880.265906:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851880.265907:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f19d1 [1] + 224
00000400:00000200:9.0:1773851880.265907:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:5.0:1773851880.265907:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000040:2.0:1773851880.265907:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:1.0:1773851880.265907:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000800:00000200:9.0:1773851880.265908:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851880.265908:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851880.265908:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851880.265908:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:17.0:1773851880.265909:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:6.0:1773851880.265909:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:5.0:1773851880.265909:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Transaction freed
00000100:00000200:1.0:1773851880.265909:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:22.0:1773851880.265910:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851880.265910:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:6.0:1773851880.265910:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:6.0:1773851880.265910:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000984a9f71.
00000100:00000001:2.0:1773851880.265910:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:22.0:1773851880.265911:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:17.0:1773851880.265911:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000400:00000200:6.0:1773851880.265911:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00000400:00000010:6.0:1773851880.265911:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
00000100:00000001:2.0:1773851880.265911:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851880.265911:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851880.265912:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851880.265912:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851880.265912:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:2.0:1773851880.265912:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:1.0:1773851880.265912:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:22.0:1773851880.265913:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851880.265913:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:11.0:1773851880.265913:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:6.0:1773851880.265913:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:2.0:1773851880.265913:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000004:00000040:2.0:1773851880.265913:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406505984 avail=351404207104 avail_mb=1372672684 hwm_mb=3131103 files=372127181 ffree=343170416 state=0: rc = 0
00000100:00000200:17.0:1773851880.265914:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:11.0:1773851880.265914:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:11.0:1773851880.265915:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000200:11.0:1773851880.265915:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f8443cb8
00000004:00000020:2.0:1773851880.265915:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406505984 free, 351404207104 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127181 files, 343170416 free files
00000100:00000001:1.0:1773851880.265915:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:11.0:1773851880.265916:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f8443cb8.
00000100:00000200:6.0:1773851880.265916:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851880.265917:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:17.0:1773851880.265917:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851880.265917:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:2.0:1773851880.265917:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851880.265917:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:31.0:1773851880.265918:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:11.0:1773851880.265918:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:2.0:1773851880.265918:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:1.0:1773851880.265918:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851880.265919:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851880.265919:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:6.0:1773851880.265919:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:31.0:1773851880.265920:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000100:00000001:6.0:1773851880.265920:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851880.265920:0:41065:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:31.0:1773851880.265921:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000400:00000010:31.0:1773851880.265921:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:17.0:1773851880.265921:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:11.0:1773851880.265921:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851880.265921:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851880.265921:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00100000:2.0:1773851880.265921:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003eba7ea5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051933504:2057@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851880.265922:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851880.265922:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:6.0:1773851880.265922:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.265922:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:31.0:1773851880.265923:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851880.265923:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:17.0:1773851880.265923:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:6.0:1773851880.265923:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.265923:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851880.265924:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851880.265924:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851880.265924:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:6.0:1773851880.265924:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=113 v=66 (66 66 66 66)
00000100:00000040:2.0:1773851880.265924:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003eba7ea5 x1859433051933504/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:30.0:1773851880.265925:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851880.265925:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:11.0:1773851880.265925:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851880.265925:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:6.0:1773851880.265925:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=113 v=66 (1 1 1 1)
00000100:00000200:31.0:1773851880.265926:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851880.265926:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:11.0:1773851880.265926:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851880.265926:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851880.265926:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851880.265927:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:30.0:1773851880.265927:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:11.0:1773851880.265927:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851880.265927:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851880.265927:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851880.265928:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851880.265928:0:41088:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:11.0:1773851880.265928:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265928:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851880.265929:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851880.265929:0:41091:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:30.0:1773851880.265929:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:11.0:1773851880.265929:0:41068:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=113 v=66 (66 66 66 66)
00000100:00000040:6.0:1773851880.265929:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000001:6.0:1773851880.265929:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:2.0:1773851880.265929:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851880.265930:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851880.265930:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:11.0:1773851880.265930:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=113 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851880.265930:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851880.265930:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:2.0:1773851880.265930:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f82e5278.
00000100:00000001:31.0:1773851880.265931:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851880.265931:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265931:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851880.265931:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851880.265931:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:31.0:1773851880.265932:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=113 v=66 (66 66 66 66)
00000100:00000200:30.0:1773851880.265932:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:11.0:1773851880.265932:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:2.0:1773851880.265932:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00001000:31.0:1773851880.265933:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=113 v=66 (1 1 1 1)
00010000:00000001:11.0:1773851880.265933:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265933:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:2.0:1773851880.265933:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851880.265933:0:41063:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000100:00000001:31.0:1773851880.265934:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851880.265934:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851880.265934:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851880.265934:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:6.0:1773851880.265934:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000020:00000001:2.0:1773851880.265934:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:2.0:1773851880.265934:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000930126ef.
00000100:00000001:31.0:1773851880.265935:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851880.265935:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851880.265935:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851880.265935:0:41088:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:11.0:1773851880.265935:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851880.265935:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265935:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851880.265935:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:2.0:1773851880.265935:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:31.0:1773851880.265936:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851880.265936:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851880.265936:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:11.0:1773851880.265936:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:6.0:1773851880.265936:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
02000000:00000001:2.0:1773851880.265936:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851880.265936:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003eba7ea5.
00000100:00000001:31.0:1773851880.265937:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851880.265937:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:31.0:1773851880.265937:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851880.265937:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:6.0:1773851880.265937:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351488958464 avail=351485868032 avail_mb=1372991672 hwm_mb=3131103 files=372066686 ffree=343250936 state=0: rc = 0
00000100:00000001:2.0:1773851880.265937:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851880.265937:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851880.265938:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851880.265938:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.265938:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851880.265939:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:30.0:1773851880.265939:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=113 v=66 (66 66 66 66)
00000100:00000001:11.0:1773851880.265939:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851880.265939:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000020:6.0:1773851880.265939:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351488958464 free, 351485868032 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066686 files, 343250936 free files
00000100:00000001:2.0:1773851880.265939:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851880.265939:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851880.265940:0:41088:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=113 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851880.265940:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851880.265940:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:6.0:1773851880.265940:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851880.265940:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:2.0:1773851880.265940:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851880.265940:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851880.265941:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851880.265941:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851880.265941:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:5.0:1773851880.265941:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851880.265942:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:30.0:1773851880.265942:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000040:11.0:1773851880.265942:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000004:00000040:11.0:1773851880.265942:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382739968 avail=351380654080 avail_mb=1372580680 hwm_mb=3131101 files=371978674 ffree=343147207 state=0: rc = 0
00000800:00000200:5.0:1773851880.265942:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851880.265943:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851880.265943:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:30.0:1773851880.265943:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851880.265944:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:30.0:1773851880.265944:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000020:11.0:1773851880.265944:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382739968 free, 351380654080 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978674 files, 343147207 free files
00000100:00100000:6.0:1773851880.265944:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0a8a955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051933632:46@kfi7:13:default-yuba2-0
00000800:00000200:5.0:1773851880.265944:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000004:00000040:31.0:1773851880.265945:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000100:00000040:30.0:1773851880.265945:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000001:30.0:1773851880.265945:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:5.0:1773851880.265945:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000004:00000040:31.0:1773851880.265946:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545778176 avail=351536156672 avail_mb=1373188112 hwm_mb=3131103 files=372116375 ffree=343306424 state=0: rc = 0
00000100:00000001:30.0:1773851880.265946:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851880.265946:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265946:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:31.0:1773851880.265947:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545778176 free, 351536156672 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116375 files, 343306424 free files
00000100:00000040:30.0:1773851880.265947:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:11.0:1773851880.265947:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851880.265947:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851880.265947:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2085@kfi7 : PUT - for me
00000100:00000040:6.0:1773851880.265948:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a0a8a955 x1859433051933632/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851880.265948:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851880.265948:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000004:00000001:31.0:1773851880.265949:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851880.265949:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000040:31.0:1773851880.265950:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851880.265950:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00100000:11.0:1773851880.265950:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f494273 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051933696:2055@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851880.265950:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000400:00000200:5.0:1773851880.265950:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:5.0:1773851880.265950:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000001:30.0:1773851880.265951:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851880.265951:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:6.0:1773851880.265951:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:5.0:1773851880.265951:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000004:00000001:30.0:1773851880.265952:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851880.265952:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000100:00000001:11.0:1773851880.265952:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851880.265952:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:6.0:1773851880.265952:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008cdb9567.
00000400:00000200:5.0:1773851880.265952:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4b80
00000100:00100000:31.0:1773851880.265953:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e4a3e705 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051933760:2056@kfi7:13:default-yuba2-0
00000004:00000040:30.0:1773851880.265953:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464004608 avail=351458210816 avail_mb=1372883636 hwm_mb=3131101 files=372064708 ffree=343226567 state=0: rc = 0
00000100:00000040:11.0:1773851880.265953:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001f494273 x1859433051933696/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:6.0:1773851880.265953:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851880.265953:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851880.265953:0:41065:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000400:00000200:5.0:1773851880.265953:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000020:00000001:6.0:1773851880.265954:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000200:5.0:1773851880.265954:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b31725 [1] + 224
00000100:00000001:31.0:1773851880.265955:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851880.265955:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000020:30.0:1773851880.265955:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464004608 free, 351458210816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064708 files, 343226567 free files
02000000:00000010:6.0:1773851880.265955:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d8277e2a.
02000000:00000001:6.0:1773851880.265955:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:31.0:1773851880.265956:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e4a3e705 x1859433051933760/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:30.0:1773851880.265956:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265956:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851880.265956:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:6.0:1773851880.265956:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851880.265956:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a0a8a955.
00000800:00000200:5.0:1773851880.265956:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:30.0:1773851880.265957:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:11.0:1773851880.265957:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000031994f28.
02000000:00000001:11.0:1773851880.265958:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:6.0:1773851880.265958:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851880.265958:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851880.265958:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851880.265959:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851880.265959:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:11.0:1773851880.265959:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851880.265959:0:41068:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000100:00000001:6.0:1773851880.265959:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265959:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851880.265959:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
02000000:00000010:31.0:1773851880.265960:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f14d9ff9.
00000100:00100000:30.0:1773851880.265960:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000eacf5249 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051933824:2065@kfi7:13:default-yuba2-0
00000020:00000001:11.0:1773851880.265960:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:6.0:1773851880.265960:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851880.265960:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851880.265960:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851880.265961:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851880.265961:0:41091:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:11.0:1773851880.265961:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:11.0:1773851880.265961:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:6.0:1773851880.265961:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265961:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:31.0:1773851880.265962:0:41091:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:30.0:1773851880.265962:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851880.265962:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:11.0:1773851880.265962:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:31.0:1773851880.265963:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851880.265963:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
00000100:00000040:30.0:1773851880.265963:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000eacf5249 x1859433051933824/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:11.0:1773851880.265963:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f494273.
00000100:00000040:5.0:1773851880.265963:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851880.265964:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:11.0:1773851880.265964:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851880.265964:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851880.265964:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851880.265965:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851880.265965:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e4a3e705.
00000100:00000001:11.0:1773851880.265965:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851880.265966:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851880.265966:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851880.265966:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851880.265966:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851880.265966:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.265966:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851880.265966:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851880.265966:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:31.0:1773851880.265967:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:30.0:1773851880.265967:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008b45a117.
00000100:00000001:11.0:1773851880.265967:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265967:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851880.265967:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:30.0:1773851880.265968:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851880.265968:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000400:00000001:6.0:1773851880.265968:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851880.265968:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:5.0:1773851880.265968:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851880.265969:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851880.265969:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:30.0:1773851880.265969:0:41088:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000020:00000001:30.0:1773851880.265969:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000400:00000010:6.0:1773851880.265969:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000017c05240.
00000100:00000001:31.0:1773851880.265970:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851880.265970:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851880.265970:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000037668ce6.
00000400:00000200:6.0:1773851880.265970:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070d325a2
00000400:00000010:6.0:1773851880.265970:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070d325a2.
02000000:00000001:30.0:1773851880.265971:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:6.0:1773851880.265971:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:6.0:1773851880.265971:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851880.265972:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851880.265972:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eacf5249.
00000100:00000001:30.0:1773851880.265973:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851880.265973:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851880.265974:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:6.0:1773851880.265974:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851880.265975:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851880.265975:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851880.265976:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851880.265976:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265976:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851880.265977:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851880.265977:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851880.265978:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851880.265978:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851880.265979:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851880.265980:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851880.265981:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=113 v=66 (66 66 66 66)
00000100:00001000:6.0:1773851880.265982:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=113 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851880.265983:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851880.265984:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851880.265984:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851880.265985:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.265986:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851880.265986:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000001:6.0:1773851880.265987:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851880.265987:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851880.265988:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851880.265991:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851880.265991:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851880.265992:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851880.265992:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:6.0:1773851880.265993:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000004:00000040:6.0:1773851880.265994:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351465977856 avail=351462881280 avail_mb=1372901880 hwm_mb=3131103 files=372062785 ffree=343228494 state=0: rc = 0
00000004:00000020:6.0:1773851880.265996:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351465977856 free, 351462881280 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062785 files, 343228494 free files
00000004:00000001:6.0:1773851880.265997:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851880.265998:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:6.0:1773851880.266001:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b45d1f4a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051933568:2085@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851880.266003:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851880.266003:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851880.266004:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b45d1f4a x1859433051933568/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851880.266006:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851880.266008:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851880.266008:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ed398635.
02000000:00000001:6.0:1773851880.266009:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851880.266009:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851880.266010:0:41065:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000020:00000001:6.0:1773851880.266010:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851880.266011:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000015991966.
02000000:00000001:6.0:1773851880.266012:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851880.266012:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851880.266013:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b45d1f4a.
00000100:00000001:6.0:1773851880.266013:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851880.266014:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851880.266014:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851880.266015:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851880.266016:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.266016:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851880.266017:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851880.278580:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851880.278580:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851880.278581:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851880.278581:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851880.278582:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851880.278582:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851880.278584:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14195@kfi7(00000000b0d9288f):0xf0d version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851880.278585:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851880.278586:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d Using peer 14195@kfi7(0x100000000000f0d)
00000400:00000200:26.0:1773851880.278587:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14195@kfi7 to cpt 6
00000400:00000200:25.0:1773851880.278588:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14195@kfi7 to cpt 6
00000400:00000200:26.0:1773851880.278589:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14195@kfi7 : PUT - for me
00000400:00000200:26.0:1773851880.278590:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14195@kfi7 to cpt 6
00000400:00000200:26.0:1773851880.278591:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024470014 nid 14195@kfi7 refs 1
00000800:00000200:25.0:1773851880.278591:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x100000000000f0d: rc=0
00000800:00000200:25.0:1773851880.278592:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851880.278593:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14195@kfi7 to cpt 6
00000400:00000200:26.0:1773851880.278593:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024470014 nid 14195@kfi7 refs 2
00000400:00000200:26.0:1773851880.278595:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000024470014 nid 14195@kfi7 refs 3
00000400:00000200:26.0:1773851880.278596:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14194@kfi7 to cpt 3
00000400:00000200:26.0:1773851880.278600:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14194@kfi7 of length 224 into portal 12 MB=0x69b4b970f2dc0
00000400:00000200:26.0:1773851880.278602:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14194@kfi7 of length 224/224 into md 0x16159c9699 [64] + 26808
00000800:00000200:26.0:1773851880.278604:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851880.278605:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851880.278606:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851880.278608:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14195@kfi7: PUT: OK
00000800:00000200:25.0:1773851880.278608:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d Transaction freed
00000100:00000001:26.0:1773851880.278609:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851880.278609:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851880.278611:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003ed7fdb6.
00000100:00000040:26.0:1773851880.278612:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000003ed7fdb6 x1859598819470784 msgsize 224
00000100:00100000:26.0:1773851880.278614:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-14194@kfi7 (source: 12345-14195@kfi7)
00000100:00000001:26.0:1773851880.278615:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851880.278616:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000024470014 nid 14195@kfi7 refs 2
00000100:00000001:27.0:1773851880.278617:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851880.278618:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851880.278618:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851880.278619:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851880.278619:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851880.278620:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851880.278621:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598819470784
00000020:00000001:27.0:1773851880.278622:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851880.278622:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3891dec2
00000020:00000001:27.0:1773851880.278623:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851880.278624:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dbf39e59 refcount=5
00000020:00000001:27.0:1773851880.278625:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637062531149824 : -107011178401792 : ffff9eac84b97000)
00000020:00000001:27.0:1773851880.278626:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637062531149824 : -107011178401792 : ffff9eac84b97000)
00000100:00000001:27.0:1773851880.278627:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851880.278628:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851880.278629:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005efb579a.
00000020:00000010:27.0:1773851880.278630:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851880.278631:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851880.278632:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851880.278633:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851880.278633:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851880.278634:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851880.278635:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851880.278635:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.278636:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851880.278638:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851880.278638:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851880.278638:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851880.278639:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14194@kfi7, seq: 2025143
00000100:00000001:26.0:1773851880.278639:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851880.278640:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dbf39e59 : new rpc_count 1
00000100:00000001:26.0:1773851880.278640:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.278641:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637094820347904 : -106978889203712 : ffff9eb4094f8000)
00000100:00000001:26.0:1773851880.278641:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851880.278642:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003ed7fdb6 x1859598819470784/t0(0) o400->7bef6a78-a130-4b18-8420-3540d5837554@14194@kfi7:130/0 lens 224/0 e 0 to 0 dl 1773852245 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1370-0'
00000100:00000001:27.0:1773851880.278646:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851880.278646:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851880.278647:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ed7fdb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7bef6a78-a130-4b18-8420-3540d5837554+5:39329:x1859598819470784:12345-14194@kfi7:400:default-tuolumne1370-0
00000100:00000200:27.0:1773851880.278651:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598819470784
00000020:00000001:27.0:1773851880.278651:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851880.278652:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851880.278653:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.278653:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851880.278654:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851880.278655:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851880.278656:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598819470784, found 0 last_xid 1859598819470783
00000020:00000001:27.0:1773851880.278656:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851880.278657:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851880.278657:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851880.278658:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.278659:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851880.278659:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851880.278660:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851880.278660:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008f6f3672.
02000000:00000001:27.0:1773851880.278661:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.278662:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.278662:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851880.278663:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698890, transno 0, xid 1859598819470784
00010000:00000001:27.0:1773851880.278664:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851880.278664:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003ed7fdb6 x1859598819470784/t0(0) o400->7bef6a78-a130-4b18-8420-3540d5837554@14194@kfi7:130/0 lens 224/224 e 0 to 0 dl 1773852245 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1370-0'
00010000:00000001:27.0:1773851880.278667:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851880.278667:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851880.278668:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=113 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851880.278669:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851880.278670:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000da7054b4 refcount 3 to 14194@kfi7
00000100:00000001:27.0:1773851880.278671:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902779360 : -107154806772256 : ffff9e8b13ce6de0)
02000000:00000001:27.0:1773851880.278672:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851880.278672:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.278673:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851880.278674:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14195@kfi7
00000400:00000010:27.0:1773851880.278674:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6a62ce1.
00000100:00000200:27.0:1773851880.278675:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598819470784, offset 224
00000400:00000200:27.0:1773851880.278677:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14195@kfi7
00000400:00000200:27.0:1773851880.278677:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14195@kfi7 to cpt 6
00000400:00000200:27.0:1773851880.278679:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024470014 nid 14195@kfi7 refs 1
00000400:00000200:27.0:1773851880.278680:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000024470014 nid 14195@kfi7 refs 2
00000400:00000200:27.0:1773851880.278680:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000024470014 nid 14195@kfi7 refs 3
00000400:00000200:27.0:1773851880.278682:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14195@kfi7 local destination
00000400:00000200:27.0:1773851880.278683:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769675:8769675:1024:4294967295] 14195@kfi7 LPNI seq info [248991:248991:16:4294967295]
00000400:00000200:27.0:1773851880.278684:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000024470014 nid 14195@kfi7 refs 2
00000400:00000200:27.0:1773851880.278685:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14195@kfi7 to cpt 6
00000400:00000200:27.0:1773851880.278687:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14195@kfi7(14195@kfi7:14195@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851880.278688:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000024470014 nid 14195@kfi7 refs 3
00000800:00000200:27.0:1773851880.278690:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851880.278691:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851880.278693:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851880.278695:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d Using peer 14195@kfi7(0x100000000000f0d)
00000800:00000200:27.0:1773851880.278697:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000005690846: Posted send of 324 bytes to peer 0x100000000000f0d: rc=0
00000800:00000200:27.0:1773851880.278699:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851880.278701:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851880.278702:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000da7054b4 refcount 2 to 14194@kfi7
00010000:00000001:27.0:1773851880.278702:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851880.278703:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.278703:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851880.278704:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003ed7fdb6 x1859598819470784/t0(0) o400->7bef6a78-a130-4b18-8420-3540d5837554@14194@kfi7:130/0 lens 224/224 e 0 to 0 dl 1773852245 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1370-0'
00000100:00100000:27.0:1773851880.278707:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ed7fdb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7bef6a78-a130-4b18-8420-3540d5837554+5:39329:x1859598819470784:12345-14194@kfi7:400:default-tuolumne1370-0 Request processed in 60us (94us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851880.278710:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14194@kfi7, seq: 2025143
00000800:00000200:25.0:1773851880.278710:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d TN_EVENT_TX_OK event status 0
00000100:00000040:27.0:1773851880.278711:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dbf39e59 : new rpc_count 0
00000100:00000001:27.0:1773851880.278711:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851880.278712:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851880.278712:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851880.278713:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851880.278713:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851880.278713:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14195@kfi7: PUT: OK
00000400:00000200:25.0:1773851880.278713:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6a62ce1
00000020:00000010:27.0:1773851880.278714:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005efb579a.
00000400:00000010:25.0:1773851880.278714:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6a62ce1.
00000020:00000040:27.0:1773851880.278715:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000dbf39e59 : new refcount 4
00000100:00000001:27.0:1773851880.278715:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851880.278715:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851880.278715:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851880.278716:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000024470014 nid 14195@kfi7 refs 2
00000800:00000200:25.0:1773851880.278717:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2054@kfi7:6 -> 14195@kfi7(00000000b0d9288f):0x0 lsk 3854 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f0d Transaction freed
00000400:00000200:29.0:1773851880.329736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851880.329738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851880.336849:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851880.336850:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851880.336852:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851880.336853:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851880.336855:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12755@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.336857:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12755@kfi7 : PUT - for me
00000400:00000200:21.0:1773851880.336858:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12755@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.336859:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c809486 nid 12755@kfi7 refs 1
00000400:00000200:21.0:1773851880.336860:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12755@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.336861:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c809486 nid 12755@kfi7 refs 2
00000400:00000200:21.0:1773851880.336862:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005c809486 nid 12755@kfi7 refs 3
00000400:00000200:21.0:1773851880.336862:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12754@kfi7 to cpt 2
00000400:00000200:21.0:1773851880.336863:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12754@kfi7 of length 224 into portal 12 MB=0x69b4b87af5e80
00000400:00000200:21.0:1773851880.336865:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12754@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 49680
00000800:00000200:21.0:1773851880.336866:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851880.336868:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.336868:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12755@kfi7: PUT: OK
00000100:00000001:21.0:1773851880.336869:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851880.336870:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851880.336873:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002d1da931.
00000100:00000040:21.0:1773851880.336874:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002d1da931 x1859598561533568 msgsize 224
00000100:00100000:21.0:1773851880.336875:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12754@kfi7 (source: 12345-12755@kfi7)
00000100:00000001:21.0:1773851880.336876:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851880.336877:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005c809486 nid 12755@kfi7 refs 2
00000100:00000001:20.0:1773851880.336877:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851880.336878:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851880.336878:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851880.336878:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851880.336879:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851880.336879:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851880.336880:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598561533568
00000020:00000001:20.0:1773851880.336881:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851880.336881:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e54b
00000020:00000001:20.0:1773851880.336882:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851880.336885:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bb21ebcf refcount=5
00000020:00000001:20.0:1773851880.336886:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072919490560 : -107000790061056 : ffff9eaeefeaf000)
00000020:00000001:20.0:1773851880.336887:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072919490560 : -107000790061056 : ffff9eaeefeaf000)
00000100:00000001:20.0:1773851880.336888:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.336888:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851880.336889:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a84cdd70.
00000020:00000010:20.0:1773851880.336890:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.336891:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851880.336891:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851880.336894:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851880.336895:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851880.336896:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851880.336896:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851880.336897:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.336898:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851880.336899:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851880.336899:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851880.336900:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851880.336900:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851880.336901:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851880.336901:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12754@kfi7, seq: 1998020
00000100:00000040:20.0:1773851880.336901:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bb21ebcf : new rpc_count 1
00000100:00000001:23.0:1773851880.336902:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.336902:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956259200 : -106937753292416 : ffff9ebd9d33b180)
00000100:00000040:20.0:1773851880.336903:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002d1da931 x1859598561533568/t0(0) o400->423e2083-235f-43c1-9f81-26863e7a35a6@12754@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1285-0'
00000100:00000001:20.0:1773851880.336906:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.336906:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851880.336907:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d1da931 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:423e2083-235f-43c1-9f81-26863e7a35a6+5:39693:x1859598561533568:12345-12754@kfi7:400:default-tuolumne1285-0
00000100:00000200:20.0:1773851880.336909:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598561533568
00000020:00000001:20.0:1773851880.336909:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851880.336910:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851880.336910:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.336911:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851880.336912:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851880.336912:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851880.336913:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598561533568, found 0 last_xid 1859598561533567
00000020:00000001:20.0:1773851880.336914:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851880.336914:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851880.336915:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851880.336915:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.336916:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851880.336916:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851880.336917:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851880.336918:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000040bbe88b.
02000000:00000001:20.0:1773851880.336918:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.336919:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.336920:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851880.336921:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686490, transno 0, xid 1859598561533568
00010000:00000001:20.0:1773851880.336921:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851880.336922:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002d1da931 x1859598561533568/t0(0) o400->423e2083-235f-43c1-9f81-26863e7a35a6@12754@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1285-0'
00010000:00000001:20.0:1773851880.336924:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851880.336925:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851880.336926:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=113 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851880.336926:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851880.336927:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c30c6a62 refcount 3 to 12754@kfi7
00000100:00000001:20.0:1773851880.336928:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581888 : -107154806969728 : ffff9e8b13cb6a80)
02000000:00000001:20.0:1773851880.336929:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851880.336929:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.336930:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851880.336931:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12755@kfi7
00000400:00000010:20.0:1773851880.336931:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe5250b8.
00000100:00000200:20.0:1773851880.336932:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598561533568, offset 224
00000400:00000200:20.0:1773851880.336933:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12755@kfi7
00000400:00000200:20.0:1773851880.336934:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12755@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.336935:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c809486 nid 12755@kfi7 refs 1
00000400:00000200:20.0:1773851880.336936:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005c809486 nid 12755@kfi7 refs 2
00000400:00000200:20.0:1773851880.336938:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005c809486 nid 12755@kfi7 refs 3
00000400:00000200:20.0:1773851880.336939:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12755@kfi7 local destination
00000400:00000200:20.0:1773851880.336940:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769676:8769676:1024:4294967295] 12755@kfi7 LPNI seq info [9758070:9758070:16:4294967295]
00000400:00000200:20.0:1773851880.336941:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005c809486 nid 12755@kfi7 refs 2
00000400:00000200:20.0:1773851880.336942:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12755@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.336944:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12755@kfi7(12755@kfi7:12755@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851880.336945:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005c809486 nid 12755@kfi7 refs 3
00000800:00000200:20.0:1773851880.336947:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851880.336948:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851880.336952:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851880.336954:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x109e Using peer 12755@kfi7(0x109e)
00000800:00000200:20.0:1773851880.336957:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x109e: rc=0
00000800:00000200:20.0:1773851880.336959:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x109e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851880.336961:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851880.336962:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c30c6a62 refcount 2 to 12754@kfi7
00010000:00000001:20.0:1773851880.336962:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851880.336963:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.336964:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851880.336964:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002d1da931 x1859598561533568/t0(0) o400->423e2083-235f-43c1-9f81-26863e7a35a6@12754@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1285-0'
00000100:00100000:20.0:1773851880.336969:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d1da931 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:423e2083-235f-43c1-9f81-26863e7a35a6+5:39693:x1859598561533568:12345-12754@kfi7:400:default-tuolumne1285-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851880.336971:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12754@kfi7, seq: 1998020
00000100:00000040:20.0:1773851880.336972:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bb21ebcf : new rpc_count 0
00000100:00000001:20.0:1773851880.336973:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851880.336973:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851880.336974:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.336975:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851880.336975:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a84cdd70.
00000020:00000040:20.0:1773851880.336976:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000bb21ebcf : new refcount 4
00000100:00000001:20.0:1773851880.336977:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851880.336982:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x109e TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851880.336983:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.336985:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12755@kfi7: PUT: OK
00000400:00000200:21.0:1773851880.336985:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe5250b8
00000400:00000010:21.0:1773851880.336986:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe5250b8.
00000100:00000001:21.0:1773851880.336987:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851880.336987:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851880.336988:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005c809486 nid 12755@kfi7 refs 2
00000800:00000200:21.0:1773851880.336989:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 12755@kfi7(00000000e6d9b620):0x0 lsk 4255 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x109e Transaction freed
00000800:00000200:21.0:1773851880.430069:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851880.430070:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851880.430071:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851880.430073:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851880.430075:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18915@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.430076:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18915@kfi7 : PUT - for me
00000400:00000200:21.0:1773851880.430077:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18915@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.430078:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 1
00000400:00000200:21.0:1773851880.430079:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18915@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.430079:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 2
00000400:00000200:21.0:1773851880.430080:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 3
00000400:00000200:21.0:1773851880.430081:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18915@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.430082:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18915@kfi7 of length 224 into portal 12 MB=0x699e0af584080
00000400:00000200:21.0:1773851880.430083:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18915@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 49904
00000800:00000200:21.0:1773851880.430085:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851880.430086:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.430087:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18915@kfi7: PUT: OK
00000100:00000001:21.0:1773851880.430088:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851880.430088:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851880.430089:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ceb283e8.
00000100:00000040:21.0:1773851880.430089:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ceb283e8 x1858040153784448 msgsize 224
00000100:00100000:21.0:1773851880.430091:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18915@kfi7 (source: 12345-18915@kfi7)
00000100:00000001:21.0:1773851880.430092:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851880.430092:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 2
00000100:00000001:20.0:1773851880.430093:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851880.430093:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851880.430094:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851880.430094:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851880.430094:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851880.430095:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851880.430095:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040153784448
00000020:00000001:20.0:1773851880.430096:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851880.430097:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913fe
00000020:00000001:20.0:1773851880.430097:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851880.430101:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001411b324 refcount=6
00000020:00000001:20.0:1773851880.430101:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169315328 : -107127540236288 : ffff9e916d04c000)
00000020:00000001:20.0:1773851880.430102:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169315328 : -107127540236288 : ffff9e916d04c000)
00000100:00000001:20.0:1773851880.430103:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.430104:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851880.430105:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a84cdd70.
00000020:00000010:20.0:1773851880.430105:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.430106:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851880.430107:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851880.430107:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851880.430107:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851880.430108:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851880.430108:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851880.430109:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.430110:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851880.430111:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851880.430111:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851880.430111:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851880.430112:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851880.430112:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18915@kfi7, seq: 1998021
00000100:00000001:23.0:1773851880.430113:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851880.430113:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851880.430113:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001411b324 : new rpc_count 1
00000100:00000001:20.0:1773851880.430114:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956252288 : -106937753299328 : ffff9ebd9d339680)
00000100:00000040:20.0:1773851880.430115:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ceb283e8 x1858040153784448/t0(0) o400->626a0b3f-f353-4eca-a00e-303f68b016be@18915@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1659-0'
00000100:00000001:20.0:1773851880.430118:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.430118:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851880.430119:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ceb283e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:626a0b3f-f353-4eca-a00e-303f68b016be+6:39637:x1858040153784448:12345-18915@kfi7:400:default-tuolumne1659-0
00000100:00000200:20.0:1773851880.430120:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040153784448
00000020:00000001:20.0:1773851880.430121:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851880.430121:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851880.430122:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.430123:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851880.430124:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851880.430124:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851880.430125:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040153784448, found 0 last_xid 1858040153784447
00000020:00000001:20.0:1773851880.430125:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851880.430126:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851880.430126:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851880.430127:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.430127:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851880.430128:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851880.430128:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851880.430129:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001cb0952d.
02000000:00000001:20.0:1773851880.430130:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.430130:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.430131:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851880.430131:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260595458, transno 0, xid 1858040153784448
00010000:00000001:20.0:1773851880.430132:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851880.430133:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ceb283e8 x1858040153784448/t0(0) o400->626a0b3f-f353-4eca-a00e-303f68b016be@18915@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1659-0'
00010000:00000001:20.0:1773851880.430135:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851880.430135:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851880.430136:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=113 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851880.430137:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851880.430137:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000101a6791 refcount 3 to 18915@kfi7
00000100:00000001:20.0:1773851880.430138:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107264 : -107156354444352 : ffff9e8ab78ed3c0)
02000000:00000001:20.0:1773851880.430139:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851880.430139:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.430140:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851880.430140:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18915@kfi7
00000400:00000010:20.0:1773851880.430141:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007749ce00.
00000100:00000200:20.0:1773851880.430142:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040153784448, offset 224
00000400:00000200:20.0:1773851880.430143:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18915@kfi7
00000400:00000200:20.0:1773851880.430144:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18915@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.430145:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 1
00000400:00000200:20.0:1773851880.430146:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 2
00000400:00000200:20.0:1773851880.430147:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 3
00000400:00000200:20.0:1773851880.430148:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18915@kfi7 local destination
00000400:00000200:20.0:1773851880.430150:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769677:8769677:1024:4294967295] 18915@kfi7 LPNI seq info [981731:981731:16:4294967295]
00000400:00000200:20.0:1773851880.430151:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 2
00000400:00000200:20.0:1773851880.430152:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18915@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.430154:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18915@kfi7(18915@kfi7:18915@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851880.430155:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 3
00000800:00000200:20.0:1773851880.430156:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851880.430157:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851880.430159:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851880.430161:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x589 Using peer 18915@kfi7(0x589)
00000800:00000200:20.0:1773851880.430163:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x589: rc=0
00000800:00000200:20.0:1773851880.430165:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x589 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851880.430166:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851880.430167:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000101a6791 refcount 2 to 18915@kfi7
00010000:00000001:20.0:1773851880.430167:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851880.430168:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.430168:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851880.430169:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ceb283e8 x1858040153784448/t0(0) o400->626a0b3f-f353-4eca-a00e-303f68b016be@18915@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1659-0'
00000100:00100000:20.0:1773851880.430172:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ceb283e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:626a0b3f-f353-4eca-a00e-303f68b016be+6:39637:x1858040153784448:12345-18915@kfi7:400:default-tuolumne1659-0 Request processed in 53us (82us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851880.430175:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18915@kfi7, seq: 1998021
00000100:00000040:20.0:1773851880.430176:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001411b324 : new rpc_count 0
00000100:00000001:20.0:1773851880.430177:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851880.430177:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851880.430178:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.430178:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851880.430179:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a84cdd70.
00000020:00000040:20.0:1773851880.430180:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000001411b324 : new refcount 5
00000100:00000001:20.0:1773851880.430180:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851880.430185:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x589 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851880.430187:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.430188:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18915@kfi7: PUT: OK
00000400:00000200:21.0:1773851880.430188:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007749ce00
00000400:00000010:21.0:1773851880.430189:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007749ce00.
00000100:00000001:21.0:1773851880.430189:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851880.430190:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851880.430190:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a23bc8d4 nid 18915@kfi7 refs 2
00000800:00000200:21.0:1773851880.430191:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 18915@kfi7(00000000fc2e7aa1):0x0 lsk 1418 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x589 Transaction freed
00000800:00000200:1.0:1773851880.528133:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851880.528134:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851880.528135:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851880.528138:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851880.528139:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.528141:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8402@kfi7 : PUT - for me
00000400:00000200:1.0:1773851880.528142:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.528142:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 1
00000400:00000200:1.0:1773851880.528143:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.528144:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000400:00000200:1.0:1773851880.528145:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000400:00000200:1.0:1773851880.528145:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.528147:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 224 into portal 12 MB=0x69b175f72d740
00000400:00000200:1.0:1773851880.528148:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8211@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 40288
00000800:00000200:1.0:1773851880.528150:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851880.528152:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851880.528152:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8402@kfi7: PUT: OK
00000100:00000001:1.0:1773851880.528153:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851880.528154:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851880.528155:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d9ebfb5.
00000100:00000040:1.0:1773851880.528156:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000009d9ebfb5 x1859374548178752 msgsize 224
00000100:00100000:1.0:1773851880.528157:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8402@kfi7)
00000100:00000001:1.0:1773851880.528158:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851880.528159:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000800:00000200:1.0:1773851880.528161:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006dafc333: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851880.528164:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851880.528164:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851880.528165:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851880.528165:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851880.528166:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851880.528167:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548178752
00000020:00000001:1.0:1773851880.528167:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851880.528168:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:1.0:1773851880.528169:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851880.528170:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=9
00000020:00000001:1.0:1773851880.528171:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:1.0:1773851880.528171:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:1.0:1773851880.528172:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851880.528173:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851880.528174:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851880.528175:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851880.528176:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851880.528177:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851880.528178:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851880.528178:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851880.528179:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851880.528180:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851880.528180:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.528181:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851880.528182:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851880.528183:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851880.528183:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851880.528183:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851880.528184:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 1997590
00000100:00000001:2.0:1773851880.528185:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.528185:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851880.528185:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:1.0:1773851880.528185:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112247168 : -106950597304448 : ffff9eba9fa39f80)
00000100:00000040:1.0:1773851880.528187:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009d9ebfb5 x1859374548178752/t0(0) o400->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:520/0 lens 224/0 e 0 to 0 dl 1773852635 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1013-0'
00000100:00000001:1.0:1773851880.528189:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851880.528189:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851880.528190:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d9ebfb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3f7a09dd-93e3-48df-8594-85e44391fba9+9:39763:x1859374548178752:12345-8211@kfi7:400:default-tuolumne1013-0
00000100:00000200:1.0:1773851880.528192:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548178752
00000020:00000001:1.0:1773851880.528192:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851880.528193:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851880.528194:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.528194:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851880.528195:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851880.528195:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851880.528196:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374548178752, found 0 last_xid 1859374548178751
00000020:00000001:1.0:1773851880.528197:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851880.528197:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851880.528198:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851880.528199:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.528199:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851880.528200:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851880.528200:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851880.528203:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c9e75f78.
02000000:00000001:1.0:1773851880.528203:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.528206:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.528207:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851880.528208:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183038203122, transno 0, xid 1859374548178752
00010000:00000001:1.0:1773851880.528209:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851880.528209:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009d9ebfb5 x1859374548178752/t0(0) o400->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:520/0 lens 224/224 e 0 to 0 dl 1773852635 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1013-0'
00010000:00000001:1.0:1773851880.528212:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851880.528212:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851880.528213:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=113 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851880.528214:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851880.528215:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:1.0:1773851880.528215:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:1.0:1773851880.528216:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851880.528217:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.528218:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851880.528218:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8402@kfi7
00000400:00000010:1.0:1773851880.528219:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003054ad65.
00000100:00000200:1.0:1773851880.528220:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374548178752, offset 224
00000400:00000200:1.0:1773851880.528221:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8402@kfi7
00000400:00000200:1.0:1773851880.528222:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.528223:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 1
00000400:00000200:1.0:1773851880.528224:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000400:00000200:1.0:1773851880.528225:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000400:00000200:1.0:1773851880.528226:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8402@kfi7 local destination
00000400:00000200:1.0:1773851880.528227:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769678:8769678:1024:4294967295] 8402@kfi7 LPNI seq info [7629403:7629403:16:4294967295]
00000400:00000200:1.0:1773851880.528229:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000400:00000200:1.0:1773851880.528229:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.528231:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8402@kfi7(8402@kfi7:8402@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851880.528232:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000800:00000200:1.0:1773851880.528233:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851880.528234:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851880.528238:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851880.528241:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f Using peer 8402@kfi7(0x10000000000052f)
00000800:00000200:1.0:1773851880.528244:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006dafc333: Posted send of 324 bytes to peer 0x10000000000052f: rc=0
00000800:00000200:1.0:1773851880.528245:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851880.528247:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851880.528249:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:1.0:1773851880.528249:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851880.528250:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.528250:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851880.528251:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d9ebfb5 x1859374548178752/t0(0) o400->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:520/0 lens 224/224 e 0 to 0 dl 1773852635 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1013-0'
00000100:00100000:1.0:1773851880.528254:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d9ebfb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3f7a09dd-93e3-48df-8594-85e44391fba9+9:39763:x1859374548178752:12345-8211@kfi7:400:default-tuolumne1013-0 Request processed in 64us (97us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851880.528257:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 1997590
00000100:00000040:1.0:1773851880.528257:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
00000800:00000200:2.0:1773851880.528258:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851880.528258:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851880.528259:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851880.528259:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:2.0:1773851880.528260:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851880.528260:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000400:00000200:2.0:1773851880.528261:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8402@kfi7: PUT: OK
00000020:00000010:1.0:1773851880.528261:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:2.0:1773851880.528262:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003054ad65
00000020:00000040:1.0:1773851880.528262:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 8
00000100:00000001:1.0:1773851880.528262:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:2.0:1773851880.528263:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003054ad65.
00000100:00000001:2.0:1773851880.528264:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851880.528264:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851880.528265:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000800:00000200:2.0:1773851880.528267:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006dafc333: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f Transaction freed
00010000:00000001:2.0:1773851880.585731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.585735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.585737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.585739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.585741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.585743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.585745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851880.585747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851880.585748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851880.585756:0:205377:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:15.0:1773851880.585758:0:205377:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:15.0:1773851880.585759:0:205377:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:13.0:1773851880.714407:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851880.714409:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851880.714411:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851880.714414:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851880.714417:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21137@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.714419:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21137@kfi7 : PUT - for me
00000400:00000200:13.0:1773851880.714421:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21137@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.714422:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 1
00000400:00000200:13.0:1773851880.714424:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21137@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.714425:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 2
00000400:00000200:13.0:1773851880.714426:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 3
00000400:00000200:13.0:1773851880.714428:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21137@kfi7 to cpt 3
00000400:00000200:13.0:1773851880.714430:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21137@kfi7 of length 224 into portal 12 MB=0x69b0a3eb88e00
00000400:00000200:13.0:1773851880.714432:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21137@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 41544
00000800:00000200:13.0:1773851880.714434:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851880.714437:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851880.714438:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21137@kfi7: PUT: OK
00000100:00000001:13.0:1773851880.714440:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851880.714440:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851880.714442:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004204575f.
00000100:00000040:13.0:1773851880.714443:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000004204575f x1859318164524544 msgsize 224
00000100:00100000:13.0:1773851880.714445:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21137@kfi7 (source: 12345-21137@kfi7)
00000100:00000001:13.0:1773851880.714447:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851880.714448:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 2
00000100:00000001:15.0:1773851880.714449:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851880.714450:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851880.714451:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851880.714451:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851880.714452:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851880.714453:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851880.714454:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318164524544
00000020:00000001:15.0:1773851880.714455:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851880.714456:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9255b
00000020:00000001:15.0:1773851880.714457:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851880.714463:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004718cba7 refcount=6
00000020:00000001:15.0:1773851880.714464:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630782976 : -107123078768640 : ffff9e9276f15800)
00000020:00000001:15.0:1773851880.714465:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630782976 : -107123078768640 : ffff9e9276f15800)
00000100:00000001:15.0:1773851880.714467:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851880.714468:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851880.714469:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000916e2cfc.
00000020:00000010:15.0:1773851880.714470:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851880.714471:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007edbe72e.
00000100:00000001:15.0:1773851880.714473:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851880.714474:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851880.714474:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851880.714476:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851880.714477:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851880.714478:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851880.714479:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851880.714481:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851880.714482:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851880.714482:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851880.714482:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851880.714485:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21137@kfi7, seq: 2289880
00000100:00000001:15.0:1773851880.714487:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851880.714487:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004718cba7 : new rpc_count 1
00000100:00000001:15.0:1773851880.714488:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851880.714488:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902266368 : -106994807285248 : ffff9eb05484da00)
00000100:00000040:12.0:1773851880.714491:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004204575f x1859318164524544/t0(0) o400->b06fabbe-283a-469f-b740-6d675aea8edd@21137@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1810-0'
00000100:00000001:12.0:1773851880.714497:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851880.714497:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851880.714499:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004204575f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:b06fabbe-283a-469f-b740-6d675aea8edd+6:39643:x1859318164524544:12345-21137@kfi7:400:default-tuolumne1810-0
00000100:00000200:12.0:1773851880.714501:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318164524544
00000020:00000001:12.0:1773851880.714502:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851880.714504:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851880.714505:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851880.714506:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851880.714507:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851880.714508:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851880.714509:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318164524544, found 0 last_xid 1859318164524543
00000020:00000001:12.0:1773851880.714511:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851880.714512:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851880.714512:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851880.714513:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851880.714514:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851880.714517:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851880.714517:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851880.714519:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000048bd73e6.
02000000:00000001:12.0:1773851880.714520:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851880.714521:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851880.714522:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851880.714523:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183052318569, transno 0, xid 1859318164524544
00010000:00000001:12.0:1773851880.714524:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851880.714526:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004204575f x1859318164524544/t0(0) o400->b06fabbe-283a-469f-b740-6d675aea8edd@21137@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1810-0'
00010000:00000001:12.0:1773851880.714530:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851880.714531:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851880.714532:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=113 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851880.714534:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851880.714535:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000662a3825 refcount 3 to 21137@kfi7
00000100:00000001:12.0:1773851880.714536:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620544 : -107151221931072 : ffff9e8be97ac3c0)
02000000:00000001:12.0:1773851880.714538:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851880.714539:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851880.714540:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851880.714541:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21137@kfi7
00000400:00000010:12.0:1773851880.714542:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ec46d43c.
00000100:00000200:12.0:1773851880.714545:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318164524544, offset 224
00000400:00000200:12.0:1773851880.714547:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21137@kfi7
00000400:00000200:12.0:1773851880.714549:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21137@kfi7 to cpt 3
00000400:00000200:12.0:1773851880.714551:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 1
00000400:00000200:12.0:1773851880.714553:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 2
00000400:00000200:12.0:1773851880.714555:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 3
00000400:00000200:12.0:1773851880.714557:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21137@kfi7 local destination
00000400:00000200:12.0:1773851880.714559:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769679:8769679:1024:4294967295] 21137@kfi7 LPNI seq info [3587128:3587128:16:4294967295]
00000400:00000200:12.0:1773851880.714562:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 2
00000400:00000200:12.0:1773851880.714563:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21137@kfi7 to cpt 3
00000400:00000200:12.0:1773851880.714566:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21137@kfi7(21137@kfi7:21137@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851880.714569:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 3
00000800:00000200:12.0:1773851880.714572:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851880.714574:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851880.714578:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851880.714582:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000333 Using peer 21137@kfi7(0x100000000000333)
00000800:00000200:12.0:1773851880.714587:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x100000000000333: rc=0
00000800:00000200:12.0:1773851880.714590:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000333 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851880.714593:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851880.714595:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000662a3825 refcount 2 to 21137@kfi7
00010000:00000001:12.0:1773851880.714596:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851880.714599:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851880.714600:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851880.714602:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004204575f x1859318164524544/t0(0) o400->b06fabbe-283a-469f-b740-6d675aea8edd@21137@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1810-0'
00000100:00100000:12.0:1773851880.714607:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004204575f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:b06fabbe-283a-469f-b740-6d675aea8edd+6:39643:x1859318164524544:12345-21137@kfi7:400:default-tuolumne1810-0 Request processed in 109us (163us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851880.714611:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21137@kfi7, seq: 2289880
00000100:00000040:12.0:1773851880.714612:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004718cba7 : new rpc_count 0
00000100:00000001:12.0:1773851880.714613:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851880.714614:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851880.714615:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851880.714617:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007edbe72e.
00000020:00000010:12.0:1773851880.714618:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000916e2cfc.
00000020:00000040:12.0:1773851880.714619:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000004718cba7 : new refcount 5
00000100:00000001:12.0:1773851880.714621:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851880.714629:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000333 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851880.714631:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851880.714633:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21137@kfi7: PUT: OK
00000400:00000200:13.0:1773851880.714634:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ec46d43c
00000400:00000010:13.0:1773851880.714635:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ec46d43c.
00000100:00000001:13.0:1773851880.714636:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851880.714637:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851880.714638:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004dfa7ba4 nid 21137@kfi7 refs 2
00000800:00000200:13.0:1773851880.714640:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 21137@kfi7(000000008a1752fa):0x0 lsk 820 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000333 Transaction freed
00000004:00000001:6.0:1773851880.777733:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851880.777734:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851880.777735:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0a8a955.
00000020:00000040:6.0:1773851880.777736:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851880.777738:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851880.777739:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851880.777739:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851880.777741:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d8277e2a.
00000100:00000001:6.0:1773851880.777742:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.777744:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851880.777745:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851880.777746:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a0a8a955] to pc [ptlrpcd_01_02+2]  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851880.777752:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:6.0:1773851880.777754:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008cdb9567.
00000100:00000001:7.0:1773851880.777755:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:6.0:1773851880.777755:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637116129372160 : -106957580179456 : ffff9eb8ff6d6800)
00000100:00000001:4.0:1773851880.777755:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851880.777756:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851880.777756:0:41067:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00080000:00000001:6.0:1773851880.777757:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851880.777757:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:6.0:1773851880.777758:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.777758:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00001000:6.0:1773851880.777759:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000100:00000001:4.0:1773851880.777759:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851880.777760:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851880.777760:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851880.777761:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:6.0:1773851880.777762:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004dcb721a.
00000004:00080000:6.0:1773851880.777763:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614155231038408ns, next at 614156231036724ns, rc = 0
00000100:00000040:4.0:1773851880.777763:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851880.777764:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:6.0:1773851880.777765:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851880.777766:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.777767:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851880.777768:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851880.777770:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851880.777771:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851880.777772:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a0a8a955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051933888:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851880.777775:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851880.777775:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851880.777776:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851880.777777:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851880.777779:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000084a5b49f.
02000000:00000001:4.0:1773851880.777779:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851880.777781:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:4.0:1773851880.777782:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000010:4.0:1773851880.777784:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fcac908a.
00000100:00000200:4.0:1773851880.777785:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933888, portal 4
00000100:00000001:4.0:1773851880.777786:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851880.777787:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814076160 : -107101895475456 : ffff9e976590bf00)
00000100:00000040:4.0:1773851880.777789:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851880.777793:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851880.777795:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:4.0:1773851880.777795:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f42716b0.
00000100:00000200:4.0:1773851880.777796:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933888, offset 0
00000400:00000200:4.0:1773851880.777799:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:4.0:1773851880.777800:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851880.777801:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:4.0:1773851880.777803:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851880.777805:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:4.0:1773851880.777807:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:4.0:1773851880.777809:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769677, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769679, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851880.777812:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851880.777814:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851880.777815:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:4.0:1773851880.777816:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769680:8769680:1024:4294967295] 16@kfi7 LPNI seq info [5403818:5403818:16:4294967295]
00000400:00000200:4.0:1773851880.777821:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851880.777822:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851880.777826:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851880.777828:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:4.0:1773851880.777831:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851880.777833:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851880.777837:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851880.777841:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Using peer 16@kfi7(0x15d)
00000800:00000200:4.0:1773851880.777845:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x15d: rc=0
00000800:00000200:4.0:1773851880.777848:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851880.777851:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.777852:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851880.777853:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.777854:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.777857:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851880.777866:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851880.777869:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851880.777870:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000400:00000200:6.0:1773851880.777872:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f42716b0
00000400:00000010:6.0:1773851880.777872:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f42716b0.
00000100:00000001:6.0:1773851880.777873:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851880.777875:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851880.777879:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851880.777880:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851880.777883:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851880.777884:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851880.777886:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:6.0:1773851880.777888:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Transaction freed
00000800:00000200:29.0:1773851880.777944:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851880.777946:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851880.777948:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851880.777952:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851880.777956:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851880.777958:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851880.777960:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851880.777962:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851880.777964:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851880.777965:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851880.777966:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851880.777968:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851880.777970:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4cc0
00000400:00000200:29.0:1773851880.777971:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851880.777973:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x78008125d [1] + 224
00000800:00000200:29.0:1773851880.777978:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851880.777981:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851880.777982:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851880.777984:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851880.777987:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851880.777992:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851880.777998:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851880.777999:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:4.0:1773851880.778000:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851880.778001:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851880.778002:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000001:4.0:1773851880.778002:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851880.778003:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851880.778004:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851880.778005:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fcac908a
00000400:00000010:4.0:1773851880.778006:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fcac908a.
00000100:00000001:4.0:1773851880.778007:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851880.778008:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851880.778014:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851880.778018:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851880.778019:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851880.778020:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851880.778021:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851880.778021:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851880.778023:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851880.778024:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851880.778025:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=113 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851880.778027:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=113 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851880.778029:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851880.778030:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851880.778031:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851880.778032:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.778033:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851880.778034:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:4.0:1773851880.778035:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851880.778036:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851880.778038:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851880.778043:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851880.778044:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851880.778045:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851880.778046:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851880.778047:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851880.778048:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482152960 avail=351481133056 avail_mb=1372973176 hwm_mb=3131103 files=372097085 ffree=343244290 state=0: rc = 0
00000004:00000020:4.0:1773851880.778052:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482152960 free, 351481133056 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097085 files, 343244290 free files
00000004:00000001:4.0:1773851880.778054:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851880.778056:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851880.778061:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a0a8a955 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051933888:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851880.778064:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851880.778066:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851880.778067:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a0a8a955 x1859433051933888/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852033 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851880.778072:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851880.778073:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851880.778074:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000084a5b49f.
02000000:00000001:4.0:1773851880.778076:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851880.778077:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851880.778077:0:41067:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:4.0:1773851880.778078:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851880.778079:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d8277e2a.
02000000:00000001:4.0:1773851880.778081:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851880.778081:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851880.778082:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a0a8a955.
00000100:00000001:4.0:1773851880.778084:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851880.778084:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851880.778085:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851880.778087:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851880.778087:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851880.778089:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851880.778089:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851880.800079:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851880.800079:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851880.800080:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851880.800080:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851880.800081:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851880.800081:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851880.800083:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26362@kfi7(00000000fc70d9b5):0x20d version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851880.800084:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851880.800086:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000800:00000200:5.0:1773851880.800086:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d Using peer 26362@kfi7(0x20d)
00000400:00000200:6.0:1773851880.800087:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26362@kfi7 : PUT - for me
00000400:00000200:5.0:1773851880.800087:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.800088:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.800089:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 1
00000800:00000200:5.0:1773851880.800089:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 38 bytes to peer 0x20d: rc=0
00000400:00000200:6.0:1773851880.800090:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000800:00000200:5.0:1773851880.800091:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851880.800092:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000400:00000200:6.0:1773851880.800092:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 3
00000400:00000200:6.0:1773851880.800093:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:6.0:1773851880.800094:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26362@kfi7 of length 440 into portal 12 MB=0x699de5a3399c0
00000400:00000200:6.0:1773851880.800096:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26362@kfi7 of length 440/440 into md 0x793926dc5 [64] + 152536
00000800:00000200:6.0:1773851880.800097:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851880.800099:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851880.800100:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26362@kfi7: PUT: OK
00000100:00000001:6.0:1773851880.800101:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851880.800102:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851880.800102:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d709aa94.
00000100:00000040:6.0:1773851880.800103:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000d709aa94 x1858030135384512 msgsize 440
00000800:00000200:5.0:1773851880.800103:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851880.800105:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-26362@kfi7 (source: 12345-26362@kfi7)
00000100:00000001:6.0:1773851880.800106:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:5.0:1773851880.800106:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d Transaction freed
00000400:00000200:6.0:1773851880.800107:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000100:00000001:7.0:1773851880.800108:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851880.800108:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851880.800109:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851880.800109:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851880.800109:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2069@kfi7:1 <- 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851880.800110:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851880.800111:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030135384512
00000020:00000001:7.0:1773851880.800112:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851880.800112:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9117a
00000020:00000001:7.0:1773851880.800113:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851880.800113:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000091a90fbe refcount=6
00000020:00000001:7.0:1773851880.800114:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240526848 : -107152469024768 : ffff9e8b9f25a000)
00000020:00000001:7.0:1773851880.800115:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240526848 : -107152469024768 : ffff9e8b9f25a000)
00000100:00000001:7.0:1773851880.800117:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851880.800118:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851880.800119:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851880.800120:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851880.800121:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851880.800122:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851880.800122:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851880.800123:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.800124:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.800125:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851880.800126:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851880.800127:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851880.800127:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851880.800127:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851880.800128:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26362@kfi7, seq: 371100846
00000100:00000040:7.0:1773851880.800129:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000091a90fbe : new rpc_count 1
00000100:00000001:4.0:1773851880.800129:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.800130:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814072704 : -107101895478912 : ffff9e976590b180)
00000100:00000001:4.0:1773851880.800130:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.800131:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d709aa94 x1858030135384512/t0(0) o41->d5021920-3e19-48d8-99d7-83ba8437beb8@26362@kfi7:607/0 lens 440/0 e 0 to 0 dl 1773851967 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne271-0'
00000100:00000001:7.0:1773851880.800135:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851880.800135:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851880.800136:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d709aa94 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d5021920-3e19-48d8-99d7-83ba8437beb8+6:109347:x1858030135384512:12345-26362@kfi7:41:default-tuolumne271-0
00000100:00000200:7.0:1773851880.800138:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030135384512
00000020:00000001:7.0:1773851880.800139:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851880.800140:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851880.800140:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.800141:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851880.800142:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:7.0:1773851880.800142:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851880.800143:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030135384512, found 0 last_xid 1858030135384511
00000020:00000001:7.0:1773851880.800144:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851880.800145:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851880.800145:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851880.800146:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.800147:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851880.800148:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851880.800148:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000079e097e6.
02000000:00000001:7.0:1773851880.800149:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.800150:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800151:0:60963:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:7.0:1773851880.800152:0:60963:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:7.0:1773851880.800152:0:60963:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800154:0:60963:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:7.0:1773851880.800155:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851880.800156:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800158:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851880.800159:0:60963:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800160:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851880.800160:0:60963:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800161:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851880.800162:0:60963:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800162:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851880.800163:0:60963:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800164:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851880.800164:0:60963:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800165:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800166:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500108800 free, 351498039296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097688 files, 343261825 free files
00000004:00000001:7.0:1773851880.800167:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800168:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800169:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504325632 free, 351502170112 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056181 files, 343265943 free files
00000004:00000001:7.0:1773851880.800170:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800171:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800172:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690116096 free, 351687634944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231188 files, 343447379 free files
00000004:00000001:7.0:1773851880.800173:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800174:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800174:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382739968 free, 351380654080 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978674 files, 343147207 free files
00000004:00000001:7.0:1773851880.800176:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800177:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800177:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958986240 free, 350956917760 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563970 files, 342733385 free files
00000004:00000001:7.0:1773851880.800179:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800180:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800180:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351228416 free, 351348342784 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372084058 files, 343116434 free files
00000004:00000001:7.0:1773851880.800182:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800182:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800183:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482152960 free, 351481133056 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097085 files, 343244290 free files
00000004:00000001:7.0:1773851880.800184:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800185:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800185:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449328640 free, 351446803456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160955 files, 343212235 free files
00000004:00000001:7.0:1773851880.800187:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800187:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800188:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353583616 free, 351351207936 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083227 files, 343118734 free files
00000004:00000001:7.0:1773851880.800189:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800190:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800190:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388964864 free, 351386286080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019060 files, 343153286 free files
00000004:00000001:7.0:1773851880.800192:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800192:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800193:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406505984 free, 351404207104 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127181 files, 343170416 free files
00000004:00000001:7.0:1773851880.800195:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800195:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800196:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351379010560 free, 351376041984 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019049 files, 343143565 free files
00000004:00000001:7.0:1773851880.800197:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800198:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800198:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351465977856 free, 351462881280 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062785 files, 343228494 free files
00000004:00000001:7.0:1773851880.800199:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800200:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800200:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351488958464 free, 351485868032 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066686 files, 343250936 free files
00000004:00000001:7.0:1773851880.800202:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800202:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800203:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492688896 free, 351490286592 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372077977 files, 343254579 free files
00000004:00000001:7.0:1773851880.800204:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800205:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800206:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524049920 free, 351521309696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113834 files, 343285205 free files
00000004:00000001:7.0:1773851880.800207:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800208:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800209:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510564864 free, 351507933184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095679 files, 343272036 free files
00000004:00000001:7.0:1773851880.800210:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800211:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800211:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541486592 free, 351539420160 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136606 files, 343302233 free files
00000004:00000001:7.0:1773851880.800213:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800213:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800214:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470692352 free, 351461572608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064520 files, 343233098 free files
00000004:00000001:7.0:1773851880.800215:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800216:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800217:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666640896 free, 351645434880 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237822 files, 343424454 free files
00000004:00000001:7.0:1773851880.800218:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800219:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800220:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545778176 free, 351536156672 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116375 files, 343306424 free files
00000004:00000001:7.0:1773851880.800221:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800222:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800222:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603943424 free, 351601693696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190429 files, 343363226 free files
00000004:00000001:7.0:1773851880.800224:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800224:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800225:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615877120 free, 351613277184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043433 files, 343374880 free files
00000004:00000001:7.0:1773851880.800227:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800228:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800228:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420254208 free, 351417807872 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008959 files, 343183842 free files
00000004:00000001:7.0:1773851880.800230:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800231:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800231:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409127424 free, 351407067136 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011300 files, 343172976 free files
00000004:00000001:7.0:1773851880.800232:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800233:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800234:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480018944 free, 351478660096 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073116 files, 343242206 free files
00000004:00000001:7.0:1773851880.800235:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800236:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800236:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593624576 free, 351576785920 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189932 files, 343353149 free files
00000004:00000001:7.0:1773851880.800238:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800238:0:60963:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851880.800239:0:60963:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464004608 free, 351458210816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064708 files, 343226567 free files
00000004:00000001:7.0:1773851880.800241:0:60963:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800241:0:60963:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800242:0:60963:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:7.0:1773851880.800243:0:60963:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 66060288 granted 1839581985855 pending 396361728 free 40309312471433216 avail 40308834190753792
00000004:00000020:7.0:1773851880.800244:0:60963:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841140740096 free, 9841023859456 avail; 10969024844 objects: 9610489004 free; state 100
00000020:00000001:7.0:1773851880.800247:0:60963:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:7.0:1773851880.800250:0:60963:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851880.800251:0:60963:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851880.800251:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030135384512
00010000:00000001:7.0:1773851880.800252:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851880.800253:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d709aa94 x1858030135384512/t0(0) o41->d5021920-3e19-48d8-99d7-83ba8437beb8@26362@kfi7:607/0 lens 440/368 e 0 to 0 dl 1773851967 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne271-0'
00010000:00000001:7.0:1773851880.800256:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851880.800257:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851880.800258:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=112 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851880.800259:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851880.800260:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a7df6c44 refcount 5 to 26362@kfi7
00000100:00000001:7.0:1773851880.800261:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231608032 : -107130477943584 : ffff9e90bdeae4e0)
02000000:00000001:7.0:1773851880.800262:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851880.800262:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.800263:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851880.800264:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26362@kfi7
00000400:00000010:7.0:1773851880.800265:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b13b474a.
00000100:00000200:7.0:1773851880.800266:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030135384512, offset 224
00000400:00000200:7.0:1773851880.800267:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26362@kfi7
00000400:00000200:7.0:1773851880.800268:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.800269:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 1
00000400:00000200:7.0:1773851880.800270:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000400:00000200:7.0:1773851880.800271:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 3
00000400:00000200:7.0:1773851880.800272:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26362@kfi7 local destination
00000400:00000200:7.0:1773851880.800274:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769681:8769681:1024:4294967295] 26362@kfi7 LPNI seq info [28180:28180:16:4294967295]
00000400:00000200:7.0:1773851880.800276:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000400:00000200:7.0:1773851880.800276:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26362@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.800279:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26362@kfi7(26362@kfi7:26362@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851880.800280:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 3
00000800:00000200:7.0:1773851880.800282:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851880.800283:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:7.0:1773851880.800285:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851880.800288:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d Using peer 26362@kfi7(0x20d)
00000800:00000200:7.0:1773851880.800291:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 468 bytes to peer 0x20d: rc=0
00000800:00000200:7.0:1773851880.800293:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851880.800297:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.800298:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a7df6c44 refcount 4 to 26362@kfi7
00010000:00000001:7.0:1773851880.800299:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851880.800300:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.800300:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851880.800301:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d709aa94 x1858030135384512/t0(0) o41->d5021920-3e19-48d8-99d7-83ba8437beb8@26362@kfi7:607/0 lens 440/368 e 0 to 0 dl 1773851967 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne271-0'
00000100:00100000:7.0:1773851880.800305:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d709aa94 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d5021920-3e19-48d8-99d7-83ba8437beb8+6:109347:x1858030135384512:12345-26362@kfi7:41:default-tuolumne271-0 Request processed in 169us (201us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851880.800305:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851880.800307:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851880.800308:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26362@kfi7, seq: 371100846
00000100:00000040:7.0:1773851880.800308:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000091a90fbe : new rpc_count 0
00000400:00000200:6.0:1773851880.800308:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26362@kfi7: PUT: OK
00000100:00000001:7.0:1773851880.800309:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:6.0:1773851880.800309:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b13b474a
00000400:00000010:6.0:1773851880.800309:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b13b474a.
00000100:00000001:7.0:1773851880.800310:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851880.800310:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000100:00000001:6.0:1773851880.800310:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851880.800311:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000100:00000001:6.0:1773851880.800311:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851880.800311:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000044ff67c4 nid 26362@kfi7 refs 2
00000020:00000010:7.0:1773851880.800312:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000020:00000040:7.0:1773851880.800313:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000091a90fbe : new refcount 5
00000100:00000001:7.0:1773851880.800313:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851880.800313:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 26362@kfi7(00000000fc70d9b5):0x0 lsk 526 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20d Transaction freed
00000800:00000200:25.0:1773851880.836285:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851880.836286:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851880.836287:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851880.836289:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851880.836290:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13025@kfi7 to cpt 6
00000400:00000200:25.0:1773851880.836291:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13025@kfi7 : PUT - for me
00000400:00000200:25.0:1773851880.836292:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13025@kfi7 to cpt 6
00000400:00000200:25.0:1773851880.836293:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fbe56122 nid 13025@kfi7 refs 1
00000400:00000200:25.0:1773851880.836294:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13025@kfi7 to cpt 6
00000400:00000200:25.0:1773851880.836294:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fbe56122 nid 13025@kfi7 refs 2
00000400:00000200:25.0:1773851880.836295:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fbe56122 nid 13025@kfi7 refs 3
00000400:00000200:25.0:1773851880.836296:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12833@kfi7 to cpt 4
00000400:00000200:25.0:1773851880.836297:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12833@kfi7 of length 224 into portal 12 MB=0x69b4b57c26900
00000400:00000200:25.0:1773851880.836298:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12833@kfi7 of length 224/224 into md 0x16159c9699 [64] + 27032
00000800:00000200:25.0:1773851880.836300:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851880.836301:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851880.836302:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13025@kfi7: PUT: OK
00000100:00000001:25.0:1773851880.836303:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851880.836304:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851880.836305:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000075e7bcf2.
00000100:00000040:25.0:1773851880.836305:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000075e7bcf2 x1859597757475072 msgsize 224
00000100:00100000:25.0:1773851880.836307:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12833@kfi7 (source: 12345-13025@kfi7)
00000100:00000001:25.0:1773851880.836308:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851880.836309:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851880.836309:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fbe56122 nid 13025@kfi7 refs 2
02000000:00000001:27.0:1773851880.836310:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851880.836310:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851880.836310:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851880.836311:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851880.836311:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00100000:27.0:1773851880.836312:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597757475072
00000020:00000001:27.0:1773851880.836313:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851880.836313:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f582
00000020:00000001:27.0:1773851880.836314:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851880.836315:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003e117783 refcount=5
00000020:00000001:27.0:1773851880.836315:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636997385462784 : -107076324088832 : ffff9e9d59bd2400)
00000020:00000001:27.0:1773851880.836316:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636997385462784 : -107076324088832 : ffff9e9d59bd2400)
00000100:00000001:27.0:1773851880.836317:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851880.836318:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851880.836318:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005efb579a.
00000020:00000010:27.0:1773851880.836319:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851880.836320:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851880.836321:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851880.836321:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851880.836322:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851880.836323:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851880.836323:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851880.836324:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.836325:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851880.836326:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851880.836326:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851880.836327:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851880.836327:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851880.836328:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12833@kfi7, seq: 2025144
00000100:00000040:27.0:1773851880.836329:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003e117783 : new rpc_count 1
00000100:00000001:27.0:1773851880.836329:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252462720 : -106967457088896 : ffff9eb6b2b7ba80)
00000100:00000001:26.0:1773851880.836329:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851880.836329:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851880.836330:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000075e7bcf2 x1859597757475072/t0(0) o400->65f6935f-fd69-47fd-98f4-32e117f299b4@12833@kfi7:130/0 lens 224/0 e 0 to 0 dl 1773852245 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1295-0'
00000100:00000001:27.0:1773851880.836333:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851880.836333:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851880.836334:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075e7bcf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:65f6935f-fd69-47fd-98f4-32e117f299b4+5:39533:x1859597757475072:12345-12833@kfi7:400:default-tuolumne1295-0
00000100:00000200:27.0:1773851880.836336:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597757475072
00000020:00000001:27.0:1773851880.836336:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851880.836337:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851880.836338:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.836338:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851880.836339:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851880.836340:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851880.836340:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597757475072, found 0 last_xid 1859597757475071
00000020:00000001:27.0:1773851880.836341:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851880.836341:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851880.836342:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851880.836343:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.836343:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851880.836344:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851880.836344:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851880.836345:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000069daf706.
02000000:00000001:27.0:1773851880.836345:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.836346:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.836347:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851880.836347:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688330, transno 0, xid 1859597757475072
00010000:00000001:27.0:1773851880.836348:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851880.836349:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000075e7bcf2 x1859597757475072/t0(0) o400->65f6935f-fd69-47fd-98f4-32e117f299b4@12833@kfi7:130/0 lens 224/224 e 0 to 0 dl 1773852245 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1295-0'
00010000:00000001:27.0:1773851880.836354:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851880.836354:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851880.836355:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=113 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851880.836356:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851880.836357:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f46a3cbe refcount 3 to 12833@kfi7
00000100:00000001:27.0:1773851880.836358:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095776320 : -107152613775296 : ffff9e8b9684e840)
02000000:00000001:27.0:1773851880.836359:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851880.836359:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851880.836360:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851880.836361:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13025@kfi7
00000400:00000010:27.0:1773851880.836361:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000501d7072.
00000100:00000200:27.0:1773851880.836362:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597757475072, offset 224
00000400:00000200:27.0:1773851880.836364:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13025@kfi7
00000400:00000200:27.0:1773851880.836364:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13025@kfi7 to cpt 6
00000400:00000200:27.0:1773851880.836365:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fbe56122 nid 13025@kfi7 refs 1
00000400:00000200:27.0:1773851880.836366:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fbe56122 nid 13025@kfi7 refs 2
00000400:00000200:27.0:1773851880.836367:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fbe56122 nid 13025@kfi7 refs 3
00000400:00000200:27.0:1773851880.836368:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13025@kfi7 local destination
00000400:00000200:27.0:1773851880.836370:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769682:8769682:1024:4294967295] 13025@kfi7 LPNI seq info [399891:399891:16:4294967295]
00000400:00000200:27.0:1773851880.836371:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fbe56122 nid 13025@kfi7 refs 2
00000400:00000200:27.0:1773851880.836372:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13025@kfi7 to cpt 6
00000400:00000200:27.0:1773851880.836374:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13025@kfi7(13025@kfi7:13025@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851880.836375:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fbe56122 nid 13025@kfi7 refs 3
00000800:00000200:27.0:1773851880.836376:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851880.836377:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851880.836379:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851880.836381:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1149 Using peer 13025@kfi7(0x1149)
00000800:00000200:27.0:1773851880.836386:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x1149: rc=0
00000800:00000200:27.0:1773851880.836387:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1149 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851880.836389:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851880.836390:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f46a3cbe refcount 2 to 12833@kfi7
00010000:00000001:27.0:1773851880.836391:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851880.836391:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851880.836392:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851880.836392:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000075e7bcf2 x1859597757475072/t0(0) o400->65f6935f-fd69-47fd-98f4-32e117f299b4@12833@kfi7:130/0 lens 224/224 e 0 to 0 dl 1773852245 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1295-0'
00000100:00100000:27.0:1773851880.836395:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075e7bcf2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:65f6935f-fd69-47fd-98f4-32e117f299b4+5:39533:x1859597757475072:12345-12833@kfi7:400:default-tuolumne1295-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851880.836398:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12833@kfi7, seq: 2025144
00000100:00000040:27.0:1773851880.836399:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003e117783 : new rpc_count 0
00000800:00000200:25.0:1773851880.836399:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1149 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851880.836400:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851880.836400:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851880.836400:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851880.836401:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851880.836401:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851880.836401:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13025@kfi7: PUT: OK
00000400:00000200:25.0:1773851880.836401:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000501d7072
00000020:00000010:27.0:1773851880.836402:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005efb579a.
00000400:00000010:25.0:1773851880.836402:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000501d7072.
00000020:00000040:27.0:1773851880.836403:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000003e117783 : new refcount 4
00000100:00000001:27.0:1773851880.836403:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851880.836403:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851880.836403:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851880.836404:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fbe56122 nid 13025@kfi7 refs 2
00000800:00000200:25.0:1773851880.836405:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 13025@kfi7(00000000e9ca2ac3):0x0 lsk 4426 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1149 Transaction freed
00000800:00000200:9.0:1773851880.842451:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851880.842454:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851880.842456:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851880.842461:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851880.842465:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851880.842468:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.169@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851880.842470:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851880.842471:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851880.842474:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.169@o2ib600 to cpt 2
00000400:00000200:9.0:1773851880.842477:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065a88ca5 nid 172.19.3.169@o2ib600 refs 2
00000400:00000200:9.0:1773851880.842480:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000065a88ca5 nid 172.19.3.169@o2ib600 refs 3
00000400:00000200:9.0:1773851880.842482:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.169@o2ib600 to cpt 2
00000400:00000200:9.0:1773851880.842484:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.169@o2ib600 of length 224 into portal 12 MB=0x699f324bde240
00000400:00000200:9.0:1773851880.842488:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.169@o2ib600 of length 224/224 into md 0x78146ce49 [64] + 145080
00000800:00000200:9.0:1773851880.842492:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851880.842495:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851880.842499:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851880.842501:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851880.842502:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851880.842503:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ed65dc4.
00000100:00000040:9.0:1773851880.842505:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006ed65dc4 x1858119432790592 msgsize 224
00000100:00100000:9.0:1773851880.842509:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.169@o2ib600 (source: 12345-172.19.3.169@o2ib600)
00000100:00000001:9.0:1773851880.842511:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851880.842513:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:11.0:1773851880.842514:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851880.842515:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851880.842516:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851880.842516:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851880.842517:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851880.842518:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851880.842520:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858119432790592
00000020:00000001:11.0:1773851880.842521:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851880.842522:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90da6
00000020:00000001:11.0:1773851880.842523:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851880.842529:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000008e1ac1a refcount=6
00000020:00000001:11.0:1773851880.842530:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239472128 : -107152470079488 : ffff9e8b9f158800)
00000020:00000001:11.0:1773851880.842531:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239472128 : -107152470079488 : ffff9e8b9f158800)
00000100:00000001:11.0:1773851880.842533:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851880.842535:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851880.842536:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c71e88b4.
00000020:00000010:11.0:1773851880.842538:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851880.842540:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e5e3c0b.
00000100:00000001:11.0:1773851880.842542:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851880.842543:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851880.842544:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851880.842549:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851880.842550:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851880.842551:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.842553:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851880.842556:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851880.842557:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851880.842557:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851880.842558:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851880.842559:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.169@o2ib600, seq: 2130811
00000100:00000040:11.0:1773851880.842561:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000008e1ac1a : new rpc_count 1
00000100:00000001:8.0:1773851880.842561:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.842562:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096228992 : -107006613322624 : ffff9ead94d30480)
00000100:00000001:8.0:1773851880.842563:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851880.842565:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ed65dc4 x1858119432790592/t0(0) o400->af737ef4-7c1f-45ff-864d-6928c21b17d5@172.19.3.169@o2ib600:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic19-0'
00000100:00000001:11.0:1773851880.842570:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851880.842571:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851880.842573:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ed65dc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:af737ef4-7c1f-45ff-864d-6928c21b17d5+6:24734:x1858119432790592:12345-172.19.3.169@o2ib600:400:default-oslic19-0
00000100:00000200:11.0:1773851880.842576:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858119432790592
00000020:00000001:11.0:1773851880.842578:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851880.842579:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851880.842580:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.842581:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851880.842582:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851880.842584:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851880.842585:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858119432790592, found 0 last_xid 1858119432790591
00000020:00000001:11.0:1773851880.842587:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851880.842588:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851880.842589:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851880.842590:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.842591:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851880.842592:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851880.842593:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851880.842595:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b2a6a33c.
02000000:00000001:11.0:1773851880.842596:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.842597:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.842598:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851880.842600:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 175677242499, transno 0, xid 1858119432790592
00010000:00000001:11.0:1773851880.842602:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851880.842604:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ed65dc4 x1858119432790592/t0(0) o400->af737ef4-7c1f-45ff-864d-6928c21b17d5@172.19.3.169@o2ib600:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic19-0'
00010000:00000001:11.0:1773851880.842609:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851880.842610:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851880.842611:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=113 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851880.842613:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851880.842615:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c7be9886 refcount 3 to 172.19.3.169@o2ib600
00000100:00000001:11.0:1773851880.842616:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636956444388544 : -107117265163072 : ffff9e93d175ecc0)
02000000:00000001:11.0:1773851880.842617:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851880.842618:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.842619:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851880.842621:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.169@o2ib600
00000400:00000010:11.0:1773851880.842622:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f8443cb8.
00000100:00000200:11.0:1773851880.842623:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858119432790592, offset 224
00000400:00000200:11.0:1773851880.842625:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.169@o2ib600
00000400:00000200:11.0:1773851880.842627:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.169@o2ib600 to cpt 2
00000400:00000200:11.0:1773851880.842628:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065a88ca5 nid 172.19.3.169@o2ib600 refs 2
00000400:00000200:11.0:1773851880.842630:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000065a88ca5 nid 172.19.3.169@o2ib600 refs 3
00000400:00000200:11.0:1773851880.842632:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000065a88ca5 nid 172.19.3.169@o2ib600 refs 4
00000400:00000200:11.0:1773851880.842634:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.169@o2ib600 routed destination
00000400:00000200:11.0:1773851880.842635:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:11.0:1773851880.842636:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:11.0:1773851880.842638:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.169@o2ib600: rtr pref emtpy: 1
00000400:00000200:11.0:1773851880.842639:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:11.0:1773851880.842640:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.169@o2ib600: rtr pref emtpy: 1
00000400:00000200:11.0:1773851880.842641:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:11.0:1773851880.842643:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769683:8769683:1024:4294967295] 2094@kfi7 LPNI seq info [1258747011:1258747011:16:4294967295]
00000400:00000200:11.0:1773851880.842644:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:11.0:1773851880.842645:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:11.0:1773851880.842649:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.169@o2ib600(172.19.3.169@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851880.842650:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000065a88ca5 nid 172.19.3.169@o2ib600 refs 3
00000800:00000200:11.0:1773851880.842652:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851880.842654:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851880.842656:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851880.842659:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:11.0:1773851880.842662:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:11.0:1773851880.842664:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851880.842666:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851880.842667:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c7be9886 refcount 2 to 172.19.3.169@o2ib600
00010000:00000001:11.0:1773851880.842668:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851880.842669:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.842670:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851880.842671:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ed65dc4 x1858119432790592/t0(0) o400->af737ef4-7c1f-45ff-864d-6928c21b17d5@172.19.3.169@o2ib600:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic19-0'
00000100:00100000:11.0:1773851880.842675:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ed65dc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:af737ef4-7c1f-45ff-864d-6928c21b17d5+6:24734:x1858119432790592:12345-172.19.3.169@o2ib600:400:default-oslic19-0 Request processed in 103us (169us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851880.842675:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851880.842677:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851880.842678:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.169@o2ib600, seq: 2130811
00000400:00000200:9.0:1773851880.842678:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000040:11.0:1773851880.842679:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000008e1ac1a : new rpc_count 0
00000400:00000200:9.0:1773851880.842679:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f8443cb8
00000100:00000001:11.0:1773851880.842680:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851880.842680:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:9.0:1773851880.842680:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f8443cb8.
00000020:00000010:11.0:1773851880.842681:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000100:00000001:9.0:1773851880.842681:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851880.842681:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851880.842682:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e5e3c0b.
00000020:00000010:11.0:1773851880.842683:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c71e88b4.
00000400:00000200:9.0:1773851880.842683:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000040:11.0:1773851880.842684:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000008e1ac1a : new refcount 5
00000100:00000001:11.0:1773851880.842685:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851880.842685:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Transaction freed
00000800:00000200:9.0:1773851880.880190:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851880.880191:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851880.880192:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851880.880194:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851880.880196:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851880.880197:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.33@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851880.880198:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851880.880199:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851880.880200:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.33@o2ib60 to cpt 2
00000400:00000200:9.0:1773851880.880201:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000248e446a nid 192.168.128.33@o2ib60 refs 2
00000400:00000200:9.0:1773851880.880202:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000248e446a nid 192.168.128.33@o2ib60 refs 3
00000400:00000200:9.0:1773851880.880203:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.33@o2ib60 to cpt 2
00000400:00000200:9.0:1773851880.880204:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.33@o2ib60 of length 224 into portal 12 MB=0x69b2132170a80
00000400:00000200:9.0:1773851880.880205:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.33@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 145304
00000800:00000200:9.0:1773851880.880207:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851880.880209:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851880.880210:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851880.880210:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851880.880211:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851880.880211:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000837d256e.
00000100:00000040:9.0:1773851880.880212:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000837d256e x1859416736860800 msgsize 224
00000100:00100000:9.0:1773851880.880214:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.33@o2ib60 (source: 12345-192.168.128.33@o2ib60)
00000100:00000001:9.0:1773851880.880215:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851880.880216:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851880.880216:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
02000000:00000001:11.0:1773851880.880217:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851880.880217:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851880.880217:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851880.880218:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851880.880219:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851880.880219:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859416736860800
00000020:00000001:11.0:1773851880.880220:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851880.880220:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ae92
00000020:00000001:11.0:1773851880.880221:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851880.880225:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000813c9fa2 refcount=5
00000020:00000001:11.0:1773851880.880225:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132009547776 : -106941700003840 : ffff9ebcb1f5a800)
00000020:00000001:11.0:1773851880.880226:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132009547776 : -106941700003840 : ffff9ebcb1f5a800)
00000100:00000001:11.0:1773851880.880227:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851880.880229:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851880.880229:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c71e88b4.
00000020:00000010:11.0:1773851880.880230:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851880.880231:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e5e3c0b.
00000100:00000001:11.0:1773851880.880232:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851880.880232:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851880.880233:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851880.880233:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851880.880234:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851880.880234:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.880235:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851880.880237:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851880.880237:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851880.880237:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851880.880238:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851880.880239:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.33@o2ib60, seq: 2130812
00000100:00000040:11.0:1773851880.880239:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000813c9fa2 : new rpc_count 1
00000100:00000001:8.0:1773851880.880239:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.880240:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067096255488 : -107006613296128 : ffff9ead94d36c00)
00000100:00000001:8.0:1773851880.880240:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851880.880242:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000837d256e x1859416736860800/t0(0) o400->39655517-769d-4a76-a270-7ed517296650@192.168.128.33@o2ib60:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix33-0'
00000100:00000001:11.0:1773851880.880245:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851880.880245:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851880.880247:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000837d256e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:39655517-769d-4a76-a270-7ed517296650+5:39980:x1859416736860800:12345-192.168.128.33@o2ib60:400:default-matrix33-0
00000100:00000200:11.0:1773851880.880249:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859416736860800
00000020:00000001:11.0:1773851880.880249:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851880.880250:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851880.880251:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.880251:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851880.880252:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851880.880253:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851880.880253:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859416736860800, found 0 last_xid 1859416736860799
00000020:00000001:11.0:1773851880.880254:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851880.880255:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851880.880255:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851880.880256:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.880256:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851880.880257:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851880.880257:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851880.880259:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000020bb41bb.
02000000:00000001:11.0:1773851880.880260:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.880260:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.880261:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851880.880262:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180984103965, transno 0, xid 1859416736860800
00010000:00000001:11.0:1773851880.880263:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851880.880264:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000837d256e x1859416736860800/t0(0) o400->39655517-769d-4a76-a270-7ed517296650@192.168.128.33@o2ib60:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix33-0'
00010000:00000001:11.0:1773851880.880267:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851880.880268:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851880.880269:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=113 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851880.880271:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851880.880272:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004cc4bbd4 refcount 3 to 192.168.128.33@o2ib60
00000100:00000001:11.0:1773851880.880273:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637087932011264 : -106985777540352 : ffff9eb26ebbd300)
02000000:00000001:11.0:1773851880.880274:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851880.880275:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851880.880276:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851880.880277:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.33@o2ib60
00000400:00000010:11.0:1773851880.880279:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a75bb48d.
00000100:00000200:11.0:1773851880.880280:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859416736860800, offset 224
00000400:00000200:11.0:1773851880.880282:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.33@o2ib60
00000400:00000200:11.0:1773851880.880284:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.33@o2ib60 to cpt 2
00000400:00000200:11.0:1773851880.880286:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000248e446a nid 192.168.128.33@o2ib60 refs 2
00000400:00000200:11.0:1773851880.880289:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000248e446a nid 192.168.128.33@o2ib60 refs 3
00000400:00000200:11.0:1773851880.880291:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000248e446a nid 192.168.128.33@o2ib60 refs 4
00000400:00000200:11.0:1773851880.880293:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.33@o2ib60 routed destination
00000400:00000200:11.0:1773851880.880295:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:11.0:1773851880.880297:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:11.0:1773851880.880299:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.33@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851880.880300:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:11.0:1773851880.880302:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.33@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851880.880303:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:11.0:1773851880.880305:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769684:8769684:1024:4294967295] 17@kfi7 LPNI seq info [1250891911:1250891911:16:4294967295]
00000400:00000200:11.0:1773851880.880307:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:11.0:1773851880.880309:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:11.0:1773851880.880314:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.33@o2ib60(192.168.128.33@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851880.880316:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000248e446a nid 192.168.128.33@o2ib60 refs 3
00000800:00000200:11.0:1773851880.880319:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851880.880321:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851880.880325:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851880.880329:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:11.0:1773851880.880335:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:11.0:1773851880.880337:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851880.880341:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851880.880344:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004cc4bbd4 refcount 2 to 192.168.128.33@o2ib60
00010000:00000001:11.0:1773851880.880345:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851880.880346:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851880.880347:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851880.880348:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000837d256e x1859416736860800/t0(0) o400->39655517-769d-4a76-a270-7ed517296650@192.168.128.33@o2ib60:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix33-0'
00000800:00000200:9.0:1773851880.880352:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851880.880355:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000837d256e pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:39655517-769d-4a76-a270-7ed517296650+5:39980:x1859416736860800:12345-192.168.128.33@o2ib60:400:default-matrix33-0 Request processed in 109us (142us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851880.880355:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851880.880357:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:9.0:1773851880.880359:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a75bb48d
00000400:00000010:9.0:1773851880.880359:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a75bb48d.
00000100:00100000:11.0:1773851880.880360:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.33@o2ib60, seq: 2130812
00000100:00000001:9.0:1773851880.880361:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851880.880361:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:11.0:1773851880.880362:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000813c9fa2 : new rpc_count 0
00000100:00000001:11.0:1773851880.880363:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851880.880363:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:11.0:1773851880.880364:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851880.880364:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000800:00000200:9.0:1773851880.880365:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000020:00000010:11.0:1773851880.880366:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e5e3c0b.
00000020:00000010:11.0:1773851880.880367:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c71e88b4.
00000020:00000040:11.0:1773851880.880368:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000813c9fa2 : new refcount 4
00000100:00000001:11.0:1773851880.880369:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851880.924473:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851880.924474:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851880.924475:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851880.924477:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851880.924479:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20225@kfi7 to cpt 0
00000400:00000200:3.0:1773851880.924480:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20225@kfi7 : PUT - for me
00000400:00000200:3.0:1773851880.924481:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20225@kfi7 to cpt 0
00000400:00000200:3.0:1773851880.924482:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000011cf8082 nid 20225@kfi7 refs 1
00000400:00000200:3.0:1773851880.924483:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20225@kfi7 to cpt 0
00000400:00000200:3.0:1773851880.924484:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000011cf8082 nid 20225@kfi7 refs 2
00000400:00000200:3.0:1773851880.924485:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000011cf8082 nid 20225@kfi7 refs 3
00000400:00000200:3.0:1773851880.924486:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20417@kfi7 to cpt 2
00000400:00000200:3.0:1773851880.924487:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20417@kfi7 of length 224 into portal 12 MB=0x69b4c36535fc0
00000400:00000200:3.0:1773851880.924489:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20417@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 40512
00000800:00000200:3.0:1773851880.924492:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851880.924494:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851880.924495:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20225@kfi7: PUT: OK
00000100:00000001:3.0:1773851880.924496:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851880.924497:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851880.924498:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009f3ad1ff.
00000100:00000040:3.0:1773851880.924499:0:2506738:0:(events.c:358:request_in_callback()) incoming req@000000009f3ad1ff x1859601491517376 msgsize 224
00000100:00100000:3.0:1773851880.924500:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-20417@kfi7 (source: 12345-20225@kfi7)
00000100:00000001:3.0:1773851880.924502:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851880.924503:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000011cf8082 nid 20225@kfi7 refs 2
00000100:00000001:1.0:1773851880.924503:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:3.0:1773851880.924504:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:1.0:1773851880.924504:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851880.924505:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851880.924505:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851880.924506:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851880.924507:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601491517376
00000020:00000001:1.0:1773851880.924508:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851880.924509:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7e133
00000020:00000001:1.0:1773851880.924509:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851880.924511:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000007ce7510 refcount=8
00000020:00000001:1.0:1773851880.924512:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637115580155904 : -106958129395712 : ffff9eb8deb10800)
00000020:00000001:1.0:1773851880.924513:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637115580155904 : -106958129395712 : ffff9eb8deb10800)
00000100:00000001:1.0:1773851880.924514:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851880.924515:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851880.924516:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851880.924517:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851880.924518:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851880.924519:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851880.924519:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851880.924520:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851880.924521:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851880.924521:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851880.924522:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.924523:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851880.924524:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851880.924525:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851880.924525:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851880.924525:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851880.924526:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20417@kfi7, seq: 1997591
00000100:00000001:2.0:1773851880.924527:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851880.924527:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851880.924527:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000007ce7510 : new rpc_count 1
00000100:00000001:1.0:1773851880.924527:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288700160 : -106964420851456 : ffff9eb767b10900)
00000100:00000040:1.0:1773851880.924529:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009f3ad1ff x1859601491517376/t0(0) o400->558b41c5-f8ee-4f37-99b2-53c81e15e61f@20417@kfi7:520/0 lens 224/0 e 0 to 0 dl 1773852635 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1763-0'
00000100:00000001:1.0:1773851880.924532:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851880.924532:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851880.924534:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f3ad1ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:558b41c5-f8ee-4f37-99b2-53c81e15e61f+8:39562:x1859601491517376:12345-20417@kfi7:400:default-tuolumne1763-0
00000100:00000200:1.0:1773851880.924535:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601491517376
00000020:00000001:1.0:1773851880.924536:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851880.924536:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851880.924537:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.924538:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851880.924538:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851880.924539:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851880.924540:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601491517376, found 0 last_xid 1859601491517375
00000020:00000001:1.0:1773851880.924540:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851880.924541:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851880.924542:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851880.924542:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.924543:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851880.924543:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851880.924544:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851880.924545:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4f6f0ab.
02000000:00000001:1.0:1773851880.924545:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.924546:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.924547:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851880.924548:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181510848020, transno 0, xid 1859601491517376
00010000:00000001:1.0:1773851880.924548:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851880.924549:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009f3ad1ff x1859601491517376/t0(0) o400->558b41c5-f8ee-4f37-99b2-53c81e15e61f@20417@kfi7:520/0 lens 224/224 e 0 to 0 dl 1773852635 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1763-0'
00010000:00000001:1.0:1773851880.924552:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851880.924552:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851880.924553:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=113 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851880.924554:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851880.924555:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000070270f9d refcount 3 to 20417@kfi7
00000100:00000001:1.0:1773851880.924555:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526775584 : -107156182776032 : ffff9e8ac1ca4720)
02000000:00000001:1.0:1773851880.924556:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851880.924557:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851880.924557:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851880.924558:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20225@kfi7
00000400:00000010:1.0:1773851880.924559:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000605f25c.
00000100:00000200:1.0:1773851880.924559:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601491517376, offset 224
00000400:00000200:1.0:1773851880.924561:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20225@kfi7
00000400:00000200:1.0:1773851880.924561:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20225@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.924562:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000011cf8082 nid 20225@kfi7 refs 1
00000400:00000200:1.0:1773851880.924564:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000011cf8082 nid 20225@kfi7 refs 2
00000400:00000200:1.0:1773851880.924565:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000011cf8082 nid 20225@kfi7 refs 3
00000400:00000200:1.0:1773851880.924566:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20225@kfi7 local destination
00000400:00000200:1.0:1773851880.924567:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769685:8769685:1024:4294967295] 20225@kfi7 LPNI seq info [111408:111408:16:4294967295]
00000400:00000200:1.0:1773851880.924569:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000011cf8082 nid 20225@kfi7 refs 2
00000400:00000200:1.0:1773851880.924569:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20225@kfi7 to cpt 0
00000400:00000200:1.0:1773851880.924571:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20225@kfi7(20225@kfi7:20225@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851880.924572:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000011cf8082 nid 20225@kfi7 refs 3
00000800:00000200:1.0:1773851880.924574:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851880.924575:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851880.924577:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851880.924579:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d8d Using peer 20225@kfi7(0x100000000000d8d)
00000800:00000200:1.0:1773851880.924582:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a8cd379f: Posted send of 324 bytes to peer 0x100000000000d8d: rc=0
00000800:00000200:1.0:1773851880.924584:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d8d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851880.924585:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851880.924586:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000070270f9d refcount 2 to 20417@kfi7
00010000:00000001:1.0:1773851880.924587:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851880.924587:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851880.924588:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851880.924589:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009f3ad1ff x1859601491517376/t0(0) o400->558b41c5-f8ee-4f37-99b2-53c81e15e61f@20417@kfi7:520/0 lens 224/224 e 0 to 0 dl 1773852635 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1763-0'
00000100:00100000:1.0:1773851880.924592:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f3ad1ff pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:558b41c5-f8ee-4f37-99b2-53c81e15e61f+8:39562:x1859601491517376:12345-20417@kfi7:400:default-tuolumne1763-0 Request processed in 59us (92us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851880.924594:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20417@kfi7, seq: 1997591
00000100:00000040:1.0:1773851880.924595:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000007ce7510 : new rpc_count 0
00000100:00000001:1.0:1773851880.924595:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:3.0:1773851880.924596:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d8d TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851880.924596:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851880.924596:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:3.0:1773851880.924597:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851880.924597:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000400:00000200:3.0:1773851880.924598:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20225@kfi7: PUT: OK
00000020:00000010:1.0:1773851880.924598:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000400:00000200:3.0:1773851880.924599:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000605f25c
00000020:00000040:1.0:1773851880.924599:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000007ce7510 : new refcount 7
00000100:00000001:1.0:1773851880.924599:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:3.0:1773851880.924600:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000605f25c.
00000100:00000001:3.0:1773851880.924600:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:3.0:1773851880.924601:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851880.924601:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000011cf8082 nid 20225@kfi7 refs 2
00000800:00000200:3.0:1773851880.924603:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a8cd379f: 2054@kfi7:0 -> 20225@kfi7(00000000caeb3bc7):0x0 lsk 3470 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000d8d Transaction freed
00000800:00000200:5.0:1773851880.992187:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851880.992188:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851880.992190:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851880.992193:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851880.992196:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12819@kfi7 to cpt 1
00000400:00000200:5.0:1773851880.992197:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12819@kfi7 : PUT - for me
00000400:00000200:5.0:1773851880.992199:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12819@kfi7 to cpt 1
00000400:00000200:5.0:1773851880.992200:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c064d372 nid 12819@kfi7 refs 1
00000400:00000200:5.0:1773851880.992202:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12819@kfi7 to cpt 1
00000400:00000200:5.0:1773851880.992203:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c064d372 nid 12819@kfi7 refs 2
00000400:00000200:5.0:1773851880.992204:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c064d372 nid 12819@kfi7 refs 3
00000400:00000200:5.0:1773851880.992206:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12818@kfi7 to cpt 6
00000400:00000200:5.0:1773851880.992207:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12818@kfi7 of length 224 into portal 12 MB=0x69b9bc2be9840
00000400:00000200:5.0:1773851880.992210:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12818@kfi7 of length 224/224 into md 0x793926dc5 [64] + 152976
00000800:00000200:5.0:1773851880.992213:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851880.992216:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851880.992217:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12819@kfi7: PUT: OK
00000100:00000001:5.0:1773851880.992219:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851880.992220:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851880.992221:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002869ab40.
00000100:00000040:5.0:1773851880.992223:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000002869ab40 x1859943149770816 msgsize 224
00000100:00100000:5.0:1773851880.992225:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12818@kfi7 (source: 12345-12819@kfi7)
00000100:00000001:5.0:1773851880.992226:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851880.992228:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c064d372 nid 12819@kfi7 refs 2
00000100:00000001:7.0:1773851880.992229:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851880.992229:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851880.992230:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851880.992230:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851880.992231:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851880.992232:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851880.992233:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859943149770816
00000020:00000001:7.0:1773851880.992234:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851880.992235:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08c2eee0bbe
00000020:00000001:7.0:1773851880.992236:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851880.992238:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000030f87919 refcount=5
00000020:00000001:7.0:1773851880.992239:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137140300800 : -106936569250816 : ffff9ebde3c6bc00)
00000020:00000001:7.0:1773851880.992240:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637137140300800 : -106936569250816 : ffff9ebde3c6bc00)
00000100:00000001:7.0:1773851880.992242:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851880.992244:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851880.992245:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851880.992246:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851880.992248:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851880.992249:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851880.992250:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851880.992251:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851880.992252:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851880.992253:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851880.992254:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.992255:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851880.992257:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851880.992258:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851880.992258:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851880.992258:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851880.992259:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12818@kfi7, seq: 2001952
00000100:00000040:7.0:1773851880.992261:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000030f87919 : new rpc_count 1
00000100:00000001:4.0:1773851880.992261:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.992262:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108953472 : -106938600598144 : ffff9ebd6ab2d580)
00000100:00000001:4.0:1773851880.992262:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.992263:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002869ab40 x1859943149770816/t0(0) o400->1b160838-febc-4bb6-99b8-876245f9ec33@12818@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1301-0'
00000100:00000001:7.0:1773851880.992268:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851880.992269:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851880.992270:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002869ab40 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1b160838-febc-4bb6-99b8-876245f9ec33+5:39752:x1859943149770816:12345-12818@kfi7:400:default-tuolumne1301-0
00000100:00000200:7.0:1773851880.992272:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859943149770816
00000020:00000001:7.0:1773851880.992273:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851880.992274:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851880.992275:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.992276:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851880.992277:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851880.992278:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851880.992279:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859943149770816, found 0 last_xid 1859943149770815
00000020:00000001:7.0:1773851880.992280:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851880.992282:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851880.992282:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851880.992283:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.992285:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851880.992285:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851880.992286:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851880.992287:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ac8973e8.
02000000:00000001:7.0:1773851880.992288:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.992289:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.992290:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851880.992291:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859943149770816
00010000:00000001:7.0:1773851880.992292:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851880.992294:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002869ab40 x1859943149770816/t0(0) o400->1b160838-febc-4bb6-99b8-876245f9ec33@12818@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1301-0'
00010000:00000001:7.0:1773851880.992298:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851880.992298:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851880.992299:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=112 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851880.992301:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851880.992302:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003e8a8618 refcount 3 to 12818@kfi7
00000100:00000001:7.0:1773851880.992303:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330144 : -107155410221472 : ffff9e8aefd68660)
02000000:00000001:7.0:1773851880.992305:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851880.992305:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851880.992306:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851880.992308:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12819@kfi7
00000400:00000010:7.0:1773851880.992309:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b13b474a.
00000100:00000200:7.0:1773851880.992310:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859943149770816, offset 224
00000400:00000200:7.0:1773851880.992312:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12819@kfi7
00000400:00000200:7.0:1773851880.992313:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12819@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.992315:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c064d372 nid 12819@kfi7 refs 1
00000400:00000200:7.0:1773851880.992317:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c064d372 nid 12819@kfi7 refs 2
00000400:00000200:7.0:1773851880.992318:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c064d372 nid 12819@kfi7 refs 3
00000400:00000200:7.0:1773851880.992320:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12819@kfi7 local destination
00000400:00000200:7.0:1773851880.992322:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769686:8769686:1024:4294967295] 12819@kfi7 LPNI seq info [202297:202297:16:4294967295]
00000400:00000200:7.0:1773851880.992325:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c064d372 nid 12819@kfi7 refs 2
00000400:00000200:7.0:1773851880.992326:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12819@kfi7 to cpt 1
00000400:00000200:7.0:1773851880.992329:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12819@kfi7(12819@kfi7:12819@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851880.992332:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c064d372 nid 12819@kfi7 refs 3
00000800:00000200:7.0:1773851880.992334:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851880.992336:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851880.992340:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851880.992343:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086d Using peer 12819@kfi7(0x10000000000086d)
00000800:00000200:7.0:1773851880.992348:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x10000000000086d: rc=0
00000800:00000200:7.0:1773851880.992351:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851880.992354:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851880.992355:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003e8a8618 refcount 2 to 12818@kfi7
00010000:00000001:7.0:1773851880.992356:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851880.992357:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851880.992358:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851880.992359:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002869ab40 x1859943149770816/t0(0) o400->1b160838-febc-4bb6-99b8-876245f9ec33@12818@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1301-0'
00000100:00100000:7.0:1773851880.992364:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002869ab40 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1b160838-febc-4bb6-99b8-876245f9ec33+5:39752:x1859943149770816:12345-12818@kfi7:400:default-tuolumne1301-0 Request processed in 95us (140us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851880.992366:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086d TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851880.992368:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12818@kfi7, seq: 2001952
00000100:00000040:7.0:1773851880.992369:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000030f87919 : new rpc_count 0
00000400:00000200:5.0:1773851880.992369:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851880.992370:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12819@kfi7: PUT: OK
00000100:00000001:7.0:1773851880.992371:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851880.992372:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851880.992372:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851880.992372:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b13b474a
00000400:00000010:5.0:1773851880.992372:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b13b474a.
00000020:00000010:7.0:1773851880.992374:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000100:00000001:5.0:1773851880.992374:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851880.992374:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851880.992375:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000020:00000040:7.0:1773851880.992376:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000030f87919 : new refcount 4
00000400:00000200:5.0:1773851880.992376:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c064d372 nid 12819@kfi7 refs 2
00000100:00000001:7.0:1773851880.992377:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851880.992378:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 12819@kfi7(0000000013551243):0x0 lsk 2158 rsk 11 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086d Transaction freed
00000800:00000200:21.0:1773851880.999864:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851880.999865:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851880.999866:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851880.999868:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851880.999869:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23075@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.999871:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23075@kfi7 : PUT - for me
00000400:00000200:21.0:1773851880.999872:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23075@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.999873:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4ad4584 nid 23075@kfi7 refs 1
00000400:00000200:21.0:1773851880.999875:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23075@kfi7 to cpt 5
00000400:00000200:21.0:1773851880.999875:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4ad4584 nid 23075@kfi7 refs 2
00000400:00000200:21.0:1773851880.999876:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c4ad4584 nid 23075@kfi7 refs 3
00000400:00000200:21.0:1773851880.999877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23266@kfi7 to cpt 4
00000400:00000200:21.0:1773851880.999878:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23266@kfi7 of length 224 into portal 12 MB=0x699e0a66f95c0
00000400:00000200:21.0:1773851880.999879:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23266@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 50128
00000800:00000200:21.0:1773851880.999881:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851880.999882:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.999884:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23075@kfi7: PUT: OK
00000100:00000001:21.0:1773851880.999885:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851880.999885:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851880.999886:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c1902cc9.
00000100:00000040:21.0:1773851880.999887:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c1902cc9 x1858040004318656 msgsize 224
00000100:00100000:21.0:1773851880.999888:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23266@kfi7 (source: 12345-23075@kfi7)
00000100:00000001:21.0:1773851880.999889:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851880.999890:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4ad4584 nid 23075@kfi7 refs 2
00000100:00000001:20.0:1773851880.999891:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851880.999891:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851880.999892:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851880.999892:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851880.999892:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851880.999893:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851880.999894:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040004318656
00000020:00000001:20.0:1773851880.999895:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851880.999895:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92af6
00000020:00000001:20.0:1773851880.999896:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851880.999899:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d5baf37 refcount=8
00000020:00000001:20.0:1773851880.999900:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743682048 : -107128965869568 : ffff9e91180b5000)
00000020:00000001:20.0:1773851880.999901:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743682048 : -107128965869568 : ffff9e91180b5000)
00000100:00000001:20.0:1773851880.999902:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.999902:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851880.999903:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851880.999905:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.999906:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851880.999906:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851880.999907:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851880.999907:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851880.999908:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851880.999909:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851880.999909:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.999910:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851880.999911:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851880.999912:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851880.999912:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851880.999912:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851880.999913:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23266@kfi7, seq: 1998022
00000100:00000001:23.0:1773851880.999914:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851880.999914:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851880.999914:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d5baf37 : new rpc_count 1
00000100:00000001:20.0:1773851880.999914:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956277632 : -106937753273984 : ffff9ebd9d33f980)
00000100:00000040:20.0:1773851880.999916:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c1902cc9 x1858040004318656/t0(0) o400->f2f31c5f-1106-40af-8269-022804e0a543@23266@kfi7:607/0 lens 224/0 e 0 to 0 dl 1773851967 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1931-0'
00000100:00000001:20.0:1773851880.999919:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851880.999919:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851880.999920:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1902cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f2f31c5f-1106-40af-8269-022804e0a543+8:39665:x1858040004318656:12345-23266@kfi7:400:default-tuolumne1931-0
00000100:00000200:20.0:1773851880.999922:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040004318656
00000020:00000001:20.0:1773851880.999922:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851880.999923:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851880.999923:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.999924:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851880.999925:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851880.999925:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851880.999926:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040004318656, found 0 last_xid 1858040004318655
00000020:00000001:20.0:1773851880.999927:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851880.999928:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851880.999928:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851880.999928:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.999929:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851880.999930:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851880.999930:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851880.999931:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d257712f.
02000000:00000001:20.0:1773851880.999931:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.999932:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.999933:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851880.999934:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668656625, transno 0, xid 1858040004318656
00010000:00000001:20.0:1773851880.999934:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851880.999935:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c1902cc9 x1858040004318656/t0(0) o400->f2f31c5f-1106-40af-8269-022804e0a543@23266@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1931-0'
00010000:00000001:20.0:1773851880.999937:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851880.999938:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851880.999939:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=113 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851880.999940:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851880.999941:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc1c99b5 refcount 3 to 23266@kfi7
00000100:00000001:20.0:1773851880.999942:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517568 : -107156126034048 : ffff9e8ac52c1780)
02000000:00000001:20.0:1773851880.999942:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851880.999943:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851880.999944:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851880.999944:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23075@kfi7
00000400:00000010:20.0:1773851880.999945:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b1efbb09.
00000100:00000200:20.0:1773851880.999946:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040004318656, offset 224
00000400:00000200:20.0:1773851880.999947:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23075@kfi7
00000400:00000200:20.0:1773851880.999948:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23075@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.999949:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4ad4584 nid 23075@kfi7 refs 1
00000400:00000200:20.0:1773851880.999950:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c4ad4584 nid 23075@kfi7 refs 2
00000400:00000200:20.0:1773851880.999951:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c4ad4584 nid 23075@kfi7 refs 3
00000400:00000200:20.0:1773851880.999952:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23075@kfi7 local destination
00000400:00000200:20.0:1773851880.999953:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769687:8769687:1024:4294967295] 23075@kfi7 LPNI seq info [546957:546957:16:4294967295]
00000400:00000200:20.0:1773851880.999955:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c4ad4584 nid 23075@kfi7 refs 2
00000400:00000200:20.0:1773851880.999956:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23075@kfi7 to cpt 5
00000400:00000200:20.0:1773851880.999958:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23075@kfi7(23075@kfi7:23075@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851880.999959:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c4ad4584 nid 23075@kfi7 refs 3
00000800:00000200:20.0:1773851880.999960:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851880.999961:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851880.999964:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851880.999966:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc5e Using peer 23075@kfi7(0xc5e)
00000800:00000200:20.0:1773851880.999969:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0xc5e: rc=0
00000800:00000200:20.0:1773851880.999970:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc5e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851880.999972:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851880.999973:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc1c99b5 refcount 2 to 23266@kfi7
00010000:00000001:20.0:1773851880.999974:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851880.999975:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851880.999975:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851880.999976:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c1902cc9 x1858040004318656/t0(0) o400->f2f31c5f-1106-40af-8269-022804e0a543@23266@kfi7:607/0 lens 224/224 e 0 to 0 dl 1773851967 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1931-0'
00000100:00100000:20.0:1773851880.999980:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1902cc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f2f31c5f-1106-40af-8269-022804e0a543+8:39665:x1858040004318656:12345-23266@kfi7:400:default-tuolumne1931-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851880.999983:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23266@kfi7, seq: 1998022
00000100:00000040:20.0:1773851880.999983:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d5baf37 : new rpc_count 0
00000100:00000001:20.0:1773851880.999984:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851880.999985:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851880.999985:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851880.999986:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851880.999987:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851880.999987:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000002d5baf37 : new refcount 7
00000100:00000001:20.0:1773851880.999988:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851880.999993:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc5e TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851880.999995:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851880.999996:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23075@kfi7: PUT: OK
00000400:00000200:21.0:1773851880.999996:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b1efbb09
00000400:00000010:21.0:1773851880.999997:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b1efbb09.
00000100:00000001:21.0:1773851880.999997:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851880.999998:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851880.999999:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4ad4584 nid 23075@kfi7 refs 2
00000800:00000200:21.0:1773851881.000000:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 23075@kfi7(00000000141eaf40):0x0 lsk 3167 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xc5e Transaction freed
00000800:00000200:29.0:1773851881.034735:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851881.034736:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851881.034737:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851881.034739:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851881.034741:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11970@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.034743:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11970@kfi7 : PUT - for me
00000400:00000200:29.0:1773851881.034743:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11970@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.034744:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093f74143 nid 11970@kfi7 refs 1
00000400:00000200:29.0:1773851881.034747:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11970@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.034747:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093f74143 nid 11970@kfi7 refs 2
00000400:00000200:29.0:1773851881.034748:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000093f74143 nid 11970@kfi7 refs 3
00000400:00000200:29.0:1773851881.034749:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11971@kfi7 to cpt 2
00000400:00000200:29.0:1773851881.034750:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11971@kfi7 of length 224 into portal 12 MB=0x69b4b9a22d240
00000400:00000200:29.0:1773851881.034752:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11971@kfi7 of length 224/224 into md 0x77fe139dd [64] + 189704
00000800:00000200:29.0:1773851881.034754:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851881.034756:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851881.034757:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11970@kfi7: PUT: OK
00000100:00000001:29.0:1773851881.034758:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851881.034759:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851881.034760:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e4a3e705.
00000100:00000040:29.0:1773851881.034761:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000e4a3e705 x1859598871089728 msgsize 224
00000100:00100000:29.0:1773851881.034763:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11971@kfi7 (source: 12345-11970@kfi7)
00000100:00000001:29.0:1773851881.034764:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851881.034765:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000093f74143 nid 11970@kfi7 refs 2
00000800:00000200:29.0:1773851881.034767:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851881.034769:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851881.034771:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851881.034771:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851881.034772:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851881.034773:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851881.034774:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598871089728
00000020:00000001:29.0:1773851881.034774:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851881.034775:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7b39c
00000020:00000001:29.0:1773851881.034776:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851881.034779:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fbe5ad97 refcount=5
00000020:00000001:29.0:1773851881.034780:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637156230023168 : -106917479528448 : ffff9ec2559cc800)
00000020:00000001:29.0:1773851881.034781:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637156230023168 : -106917479528448 : ffff9ec2559cc800)
00000100:00000001:29.0:1773851881.034782:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851881.034783:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851881.034784:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851881.034785:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851881.034786:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851881.034787:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851881.034787:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851881.034789:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851881.034790:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851881.034791:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851881.034791:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851881.034793:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851881.034794:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851881.034794:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851881.034794:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851881.034795:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851881.034795:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11971@kfi7, seq: 2055555
00000100:00000001:30.0:1773851881.034796:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851881.034796:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fbe5ad97 : new rpc_count 1
00000100:00000001:30.0:1773851881.034797:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851881.034797:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636955373899136 : -107118335652480 : ffff9e9391a78d80)
00000100:00000040:29.0:1773851881.034798:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e4a3e705 x1859598871089728/t0(0) o400->7fe24386-f9e8-4e54-9bee-99e938b23643@11971@kfi7:669/0 lens 224/0 e 0 to 0 dl 1773852029 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1239-0'
00000100:00000001:29.0:1773851881.034801:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851881.034801:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851881.034802:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e4a3e705 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:7fe24386-f9e8-4e54-9bee-99e938b23643+5:39712:x1859598871089728:12345-11971@kfi7:400:default-tuolumne1239-0
00000100:00000200:29.0:1773851881.034805:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598871089728
00000020:00000001:29.0:1773851881.034806:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851881.034807:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851881.034808:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.034808:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851881.034809:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851881.034810:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851881.034811:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598871089728, found 0 last_xid 1859598871089727
00000020:00000001:29.0:1773851881.034812:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851881.034812:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851881.034813:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851881.034814:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.034814:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851881.034815:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851881.034816:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851881.034817:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fe340259.
02000000:00000001:29.0:1773851881.034818:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851881.034818:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.034819:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851881.034820:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154593256, transno 0, xid 1859598871089728
00010000:00000001:29.0:1773851881.034821:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851881.034822:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e4a3e705 x1859598871089728/t0(0) o400->7fe24386-f9e8-4e54-9bee-99e938b23643@11971@kfi7:669/0 lens 224/224 e 0 to 0 dl 1773852029 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1239-0'
00010000:00000001:29.0:1773851881.034824:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851881.034825:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851881.034825:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=114 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851881.034827:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851881.034827:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003949ff50 refcount 3 to 11971@kfi7
00000100:00000001:29.0:1773851881.034828:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551675264 : -107156157876352 : ffff9e8ac3463780)
02000000:00000001:29.0:1773851881.034829:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851881.034829:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851881.034830:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851881.034831:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11970@kfi7
00000400:00000010:29.0:1773851881.034832:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c4455194.
00000100:00000200:29.0:1773851881.034833:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598871089728, offset 224
00000400:00000200:29.0:1773851881.034835:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11970@kfi7
00000400:00000200:29.0:1773851881.034836:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11970@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.034836:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093f74143 nid 11970@kfi7 refs 1
00000400:00000200:29.0:1773851881.034837:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000093f74143 nid 11970@kfi7 refs 2
00000400:00000200:29.0:1773851881.034838:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000093f74143 nid 11970@kfi7 refs 3
00000400:00000200:29.0:1773851881.034840:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11970@kfi7 local destination
00000400:00000200:29.0:1773851881.034841:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769688:8769688:1024:4294967295] 11970@kfi7 LPNI seq info [2186514:2186514:16:4294967295]
00000400:00000200:29.0:1773851881.034842:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000093f74143 nid 11970@kfi7 refs 2
00000400:00000200:29.0:1773851881.034843:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11970@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.034845:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11970@kfi7(11970@kfi7:11970@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851881.034847:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000093f74143 nid 11970@kfi7 refs 3
00000800:00000200:29.0:1773851881.034848:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851881.034849:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851881.034851:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851881.034853:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006b7 Using peer 11970@kfi7(0x1000000000006b7)
00000800:00000200:29.0:1773851881.034857:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0x1000000000006b7: rc=0
00000800:00000200:29.0:1773851881.034858:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006b7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851881.034860:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851881.034861:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003949ff50 refcount 2 to 11971@kfi7
00010000:00000001:29.0:1773851881.034862:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851881.034862:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.034863:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851881.034863:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e4a3e705 x1859598871089728/t0(0) o400->7fe24386-f9e8-4e54-9bee-99e938b23643@11971@kfi7:669/0 lens 224/224 e 0 to 0 dl 1773852029 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1239-0'
00000100:00100000:29.0:1773851881.034866:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e4a3e705 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:7fe24386-f9e8-4e54-9bee-99e938b23643+5:39712:x1859598871089728:12345-11971@kfi7:400:default-tuolumne1239-0 Request processed in 65us (104us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851881.034869:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11971@kfi7, seq: 2055555
00000100:00000040:29.0:1773851881.034870:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fbe5ad97 : new rpc_count 0
00000100:00000001:29.0:1773851881.034871:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851881.034871:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:30.0:1773851881.034872:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006b7 TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851881.034872:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851881.034873:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851881.034873:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000400:00000200:30.0:1773851881.034874:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:29.0:1773851881.034874:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000fbe5ad97 : new refcount 4
00000400:00000200:30.0:1773851881.034875:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11970@kfi7: PUT: OK
00000100:00000001:29.0:1773851881.034875:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851881.034876:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c4455194
00000400:00000010:30.0:1773851881.034876:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c4455194.
00000100:00000001:30.0:1773851881.034877:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851881.034877:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851881.034878:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000093f74143 nid 11970@kfi7 refs 2
00000800:00000200:30.0:1773851881.034880:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 11970@kfi7(0000000045ba1d6e):0x0 lsk 1720 rsk 35 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006b7 Transaction freed
00000800:00000200:10.0:1773851881.052777:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851881.052778:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851881.052781:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851881.052785:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851881.052788:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15537@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.052791:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15537@kfi7 : PUT - for me
00000400:00000200:10.0:1773851881.052793:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15537@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.052795:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8740f72 nid 15537@kfi7 refs 1
00000400:00000200:10.0:1773851881.052797:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15537@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.052798:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8740f72 nid 15537@kfi7 refs 2
00000400:00000200:10.0:1773851881.052800:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b8740f72 nid 15537@kfi7 refs 3
00000400:00000200:10.0:1773851881.052802:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15473@kfi7 to cpt 7
00000400:00000200:10.0:1773851881.052803:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15473@kfi7 of length 224 into portal 12 MB=0x699e08fd25400
00000400:00000200:10.0:1773851881.052806:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15473@kfi7 of length 224/224 into md 0x78146ce49 [64] + 145528
00000800:00000200:10.0:1773851881.052810:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851881.052813:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851881.052815:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15537@kfi7: PUT: OK
00000100:00000001:10.0:1773851881.052817:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851881.052817:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851881.052819:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004139ca59.
00000100:00000040:10.0:1773851881.052820:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000004139ca59 x1858039624913920 msgsize 224
00000100:00100000:10.0:1773851881.052823:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-15473@kfi7 (source: 12345-15537@kfi7)
00000100:00000001:10.0:1773851881.052824:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851881.052826:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8740f72 nid 15537@kfi7 refs 2
00000100:00000001:11.0:1773851881.052827:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851881.052828:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851881.052828:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851881.052829:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851881.052829:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851881.052830:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851881.052831:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039624913920
00000020:00000001:11.0:1773851881.052832:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851881.052833:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92983
00000020:00000001:11.0:1773851881.052834:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851881.052837:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b07cc59d refcount=6
00000020:00000001:11.0:1773851881.052838:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743193600 : -107128966358016 : ffff9e911803dc00)
00000020:00000001:11.0:1773851881.052840:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743193600 : -107128966358016 : ffff9e911803dc00)
00000100:00000001:11.0:1773851881.052841:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851881.052842:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851881.052843:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9ba5d0e.
00000020:00000010:11.0:1773851881.052845:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851881.052847:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009e5e3c0b.
00000100:00000001:11.0:1773851881.052848:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851881.052849:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851881.052850:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851881.052851:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851881.052852:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851881.052853:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851881.052854:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851881.052856:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851881.052856:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851881.052856:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851881.052857:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851881.052858:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15473@kfi7, seq: 2130813
00000100:00000001:11.0:1773851881.052859:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851881.052859:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b07cc59d : new rpc_count 1
00000100:00000001:11.0:1773851881.052860:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851881.052860:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136770068608 : -106936939483008 : ffff9ebdcdb57080)
00000100:00000040:8.0:1773851881.052861:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004139ca59 x1858039624913920/t0(0) o400->0b4cca66-cd05-4db7-8310-0d6f7320cfa6@15473@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1454-0'
00000100:00000001:8.0:1773851881.052864:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851881.052865:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851881.052866:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004139ca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:0b4cca66-cd05-4db7-8310-0d6f7320cfa6+6:39644:x1858039624913920:12345-15473@kfi7:400:default-tuolumne1454-0
00000100:00000200:8.0:1773851881.052869:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039624913920
00000020:00000001:8.0:1773851881.052870:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851881.052871:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851881.052872:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851881.052873:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851881.052873:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851881.052874:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851881.052875:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039624913920, found 0 last_xid 1858039624913919
00000020:00000001:8.0:1773851881.052876:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851881.052877:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851881.052877:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851881.052878:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851881.052879:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851881.052880:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851881.052880:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851881.052881:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000078a42ea4.
02000000:00000001:8.0:1773851881.052882:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851881.052883:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851881.052884:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851881.052885:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035365115, transno 0, xid 1858039624913920
00010000:00000001:8.0:1773851881.052886:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851881.052887:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004139ca59 x1858039624913920/t0(0) o400->0b4cca66-cd05-4db7-8310-0d6f7320cfa6@15473@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1454-0'
00010000:00000001:8.0:1773851881.052890:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851881.052890:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851881.052891:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=114 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851881.052893:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851881.052893:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000028f74979 refcount 3 to 15473@kfi7
00000100:00000001:8.0:1773851881.052895:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064128 : -107155994487488 : ffff9e8acd035540)
02000000:00000001:8.0:1773851881.052895:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851881.052896:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851881.052897:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851881.052898:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15537@kfi7
00000400:00000010:8.0:1773851881.052899:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
00000100:00000200:8.0:1773851881.052900:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039624913920, offset 224
00000400:00000200:8.0:1773851881.052902:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15537@kfi7
00000400:00000200:8.0:1773851881.052903:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15537@kfi7 to cpt 2
00000400:00000200:8.0:1773851881.052905:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8740f72 nid 15537@kfi7 refs 1
00000400:00000200:8.0:1773851881.052906:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b8740f72 nid 15537@kfi7 refs 2
00000400:00000200:8.0:1773851881.052907:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b8740f72 nid 15537@kfi7 refs 3
00000400:00000200:8.0:1773851881.052909:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15537@kfi7 local destination
00000400:00000200:8.0:1773851881.052910:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769689:8769689:1024:4294967295] 15537@kfi7 LPNI seq info [1184218:1184218:16:4294967295]
00000400:00000200:8.0:1773851881.052912:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b8740f72 nid 15537@kfi7 refs 2
00000400:00000200:8.0:1773851881.052913:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15537@kfi7 to cpt 2
00000400:00000200:8.0:1773851881.052915:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15537@kfi7(15537@kfi7:15537@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851881.052916:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b8740f72 nid 15537@kfi7 refs 3
00000800:00000200:8.0:1773851881.052918:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851881.052920:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851881.052922:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851881.052925:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000460 Using peer 15537@kfi7(0x100000000000460)
00000800:00000200:8.0:1773851881.052928:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x100000000000460: rc=0
00000800:00000200:8.0:1773851881.052930:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000460 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851881.052932:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851881.052933:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000028f74979 refcount 2 to 15473@kfi7
00010000:00000001:8.0:1773851881.052934:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851881.052934:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851881.052935:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851881.052936:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004139ca59 x1858039624913920/t0(0) o400->0b4cca66-cd05-4db7-8310-0d6f7320cfa6@15473@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1454-0'
00000100:00100000:8.0:1773851881.052941:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004139ca59 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:0b4cca66-cd05-4db7-8310-0d6f7320cfa6+6:39644:x1858039624913920:12345-15473@kfi7:400:default-tuolumne1454-0 Request processed in 76us (120us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851881.052944:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15473@kfi7, seq: 2130813
00000100:00000040:8.0:1773851881.052945:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b07cc59d : new rpc_count 0
00000100:00000001:8.0:1773851881.052946:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851881.052946:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851881.052947:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000020:00000010:8.0:1773851881.052948:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009e5e3c0b.
00000020:00000010:8.0:1773851881.052949:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9ba5d0e.
00000020:00000040:8.0:1773851881.052950:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b07cc59d : new refcount 5
00000100:00000001:8.0:1773851881.052951:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851881.052958:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000460 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851881.052962:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851881.052964:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15537@kfi7: PUT: OK
00000400:00000200:9.0:1773851881.052977:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000400:00000010:9.0:1773851881.052978:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000100:00000001:9.0:1773851881.052980:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851881.052981:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851881.052982:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8740f72 nid 15537@kfi7 refs 2
00000800:00000200:9.0:1773851881.052985:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 15537@kfi7(00000000277809e4):0x0 lsk 1121 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000460 Transaction freed
00000800:00000200:21.0:1773851881.055880:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851881.055881:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851881.055883:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851881.055886:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851881.055890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9328@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.055892:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9328@kfi7 : PUT - for me
00000400:00000200:21.0:1773851881.055893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9328@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.055895:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048d65923 nid 9328@kfi7 refs 1
00000400:00000200:21.0:1773851881.055896:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9328@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.055897:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048d65923 nid 9328@kfi7 refs 2
00000400:00000200:21.0:1773851881.055899:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000048d65923 nid 9328@kfi7 refs 3
00000400:00000200:21.0:1773851881.055900:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9392@kfi7 to cpt 1
00000400:00000200:21.0:1773851881.055902:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9392@kfi7 of length 224 into portal 12 MB=0x69b7bc4b61a80
00000400:00000200:21.0:1773851881.055904:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9392@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 50352
00000800:00000200:21.0:1773851881.055907:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851881.055910:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851881.055912:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9328@kfi7: PUT: OK
00000100:00000001:21.0:1773851881.055913:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851881.055914:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851881.055915:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009b5df7f0.
00000100:00000040:21.0:1773851881.055917:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009b5df7f0 x1859805743815296 msgsize 224
00000100:00100000:21.0:1773851881.055919:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9392@kfi7 (source: 12345-9328@kfi7)
00000100:00000001:21.0:1773851881.055921:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851881.055922:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000048d65923 nid 9328@kfi7 refs 2
00000100:00000001:20.0:1773851881.055922:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851881.055923:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851881.055923:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851881.055924:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851881.055924:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851881.055925:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00100000:20.0:1773851881.055925:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859805743815296
00000020:00000001:20.0:1773851881.055926:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851881.055926:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f085916ca746
00000020:00000001:20.0:1773851881.055927:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851881.055930:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000058ef00ce refcount=7
00000020:00000001:20.0:1773851881.055931:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637052270674944 : -107021438876672 : ffff9eaa21270400)
00000020:00000001:20.0:1773851881.055932:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637052270674944 : -107021438876672 : ffff9eaa21270400)
00000100:00000001:20.0:1773851881.055933:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.055933:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851881.055934:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851881.055935:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.055936:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851881.055938:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851881.055938:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851881.055939:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851881.055940:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851881.055940:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851881.055941:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.055942:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851881.055943:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851881.055944:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851881.055944:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851881.055944:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9392@kfi7, seq: 1998023
00000100:00000001:23.0:1773851881.055945:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:20.0:1773851881.055945:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000058ef00ce : new rpc_count 1
00000100:00000001:23.0:1773851881.055946:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.055946:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956246528 : -106937753305088 : ffff9ebd9d338000)
00000100:00000001:23.0:1773851881.055947:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.055947:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009b5df7f0 x1859805743815296/t0(0) o400->555fed48-d1b8-45aa-b445-ad2b1cc230cc@9392@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1070-0'
00000100:00000001:20.0:1773851881.055950:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.055950:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851881.055951:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009b5df7f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:555fed48-d1b8-45aa-b445-ad2b1cc230cc+7:39376:x1859805743815296:12345-9392@kfi7:400:default-tuolumne1070-0
00000100:00000200:20.0:1773851881.055953:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859805743815296
00000020:00000001:20.0:1773851881.055954:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851881.055954:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851881.055955:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.055956:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851881.055956:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851881.055957:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851881.055957:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859805743815296, found 0 last_xid 1859805743815295
00000020:00000001:20.0:1773851881.055958:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851881.055959:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851881.055959:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851881.055960:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.055961:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851881.055961:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851881.055962:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851881.055962:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e280c4fa.
02000000:00000001:20.0:1773851881.055964:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.055964:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.055965:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851881.055966:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182768628552, transno 0, xid 1859805743815296
00010000:00000001:20.0:1773851881.055966:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851881.055967:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009b5df7f0 x1859805743815296/t0(0) o400->555fed48-d1b8-45aa-b445-ad2b1cc230cc@9392@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1070-0'
00010000:00000001:20.0:1773851881.055970:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851881.055970:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851881.055971:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=114 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851881.055972:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851881.055973:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000065f4c464 refcount 3 to 9392@kfi7
00000100:00000001:20.0:1773851881.055973:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411424 : -107145304140192 : ffff9e8d4a351660)
02000000:00000001:20.0:1773851881.055974:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851881.055974:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.055975:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851881.055976:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9328@kfi7
00000400:00000010:20.0:1773851881.055977:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a48173f.
00000100:00000200:20.0:1773851881.055977:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859805743815296, offset 224
00000400:00000200:20.0:1773851881.055979:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9328@kfi7
00000400:00000200:20.0:1773851881.055979:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9328@kfi7 to cpt 5
00000400:00000200:20.0:1773851881.055980:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048d65923 nid 9328@kfi7 refs 1
00000400:00000200:20.0:1773851881.055982:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000048d65923 nid 9328@kfi7 refs 2
00000400:00000200:20.0:1773851881.055983:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000048d65923 nid 9328@kfi7 refs 3
00000400:00000200:20.0:1773851881.055984:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9328@kfi7 local destination
00000400:00000200:20.0:1773851881.055986:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769690:8769690:1024:4294967295] 9328@kfi7 LPNI seq info [196284:196284:16:4294967295]
00000400:00000200:20.0:1773851881.055987:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000048d65923 nid 9328@kfi7 refs 2
00000400:00000200:20.0:1773851881.055988:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9328@kfi7 to cpt 5
00000400:00000200:20.0:1773851881.055990:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9328@kfi7(9328@kfi7:9328@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851881.055991:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000048d65923 nid 9328@kfi7 refs 3
00000800:00000200:20.0:1773851881.055992:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851881.055993:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851881.055996:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851881.055998:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ab Using peer 9328@kfi7(0x1000000000011ab)
00000800:00000200:20.0:1773851881.056001:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x1000000000011ab: rc=0
00000800:00000200:20.0:1773851881.056003:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851881.056005:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.056006:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000065f4c464 refcount 2 to 9392@kfi7
00010000:00000001:20.0:1773851881.056007:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851881.056007:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.056008:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851881.056009:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009b5df7f0 x1859805743815296/t0(0) o400->555fed48-d1b8-45aa-b445-ad2b1cc230cc@9392@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1070-0'
00000100:00100000:20.0:1773851881.056012:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009b5df7f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:555fed48-d1b8-45aa-b445-ad2b1cc230cc+7:39376:x1859805743815296:12345-9392@kfi7:400:default-tuolumne1070-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851881.056015:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9392@kfi7, seq: 1998023
00000100:00000040:20.0:1773851881.056016:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000058ef00ce : new rpc_count 0
00000100:00000001:20.0:1773851881.056017:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851881.056017:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851881.056018:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.056019:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851881.056019:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851881.056020:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000058ef00ce : new refcount 6
00000100:00000001:20.0:1773851881.056021:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851881.056027:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ab TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851881.056028:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851881.056030:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9328@kfi7: PUT: OK
00000400:00000200:22.0:1773851881.056031:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a48173f
00000400:00000010:22.0:1773851881.056031:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a48173f.
00000100:00000001:22.0:1773851881.056032:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851881.056032:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851881.056033:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000048d65923 nid 9328@kfi7 refs 2
00000800:00000200:22.0:1773851881.056035:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 9328@kfi7(000000000c02276d):0x0 lsk 4524 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ab Transaction freed
00000800:00000200:14.0:1773851881.148589:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851881.148590:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851881.148593:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851881.148596:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851881.148600:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21488@kfi7 to cpt 3
00000400:00000200:14.0:1773851881.148602:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21488@kfi7 : PUT - for me
00000400:00000200:14.0:1773851881.148603:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21488@kfi7 to cpt 3
00000400:00000200:14.0:1773851881.148606:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2778624 nid 21488@kfi7 refs 1
00000400:00000200:14.0:1773851881.148607:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21488@kfi7 to cpt 3
00000400:00000200:14.0:1773851881.148609:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2778624 nid 21488@kfi7 refs 2
00000400:00000200:14.0:1773851881.148610:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c2778624 nid 21488@kfi7 refs 3
00000400:00000200:14.0:1773851881.148612:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21488@kfi7 to cpt 3
00000400:00000200:14.0:1773851881.148613:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21488@kfi7 of length 224 into portal 12 MB=0x69b09642cfcc0
00000400:00000200:14.0:1773851881.148616:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21488@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 41768
00000800:00000200:14.0:1773851881.148619:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851881.148622:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851881.148624:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21488@kfi7: PUT: OK
00000100:00000001:14.0:1773851881.148626:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851881.148628:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851881.148629:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000a23492d.
00000100:00000040:14.0:1773851881.148630:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000000a23492d x1859314497944768 msgsize 224
00000100:00100000:14.0:1773851881.148633:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-21488@kfi7 (source: 12345-21488@kfi7)
00000100:00000001:14.0:1773851881.148634:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851881.148636:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c2778624 nid 21488@kfi7 refs 2
00000100:00000001:12.0:1773851881.148637:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851881.148638:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851881.148639:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851881.148639:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851881.148641:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851881.148642:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851881.148643:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314497944768
00000020:00000001:12.0:1773851881.148644:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851881.148645:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e76
00000020:00000001:12.0:1773851881.148646:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851881.148653:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7f17201 refcount=6
00000020:00000001:12.0:1773851881.148654:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744675328 : -107128964876288 : ffff9e91181a7800)
00000020:00000001:12.0:1773851881.148655:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744675328 : -107128964876288 : ffff9e91181a7800)
00000100:00000001:12.0:1773851881.148657:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851881.148658:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851881.148660:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851881.148662:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851881.148663:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a30c3e95.
00000100:00000001:12.0:1773851881.148664:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851881.148665:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851881.148666:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851881.148668:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851881.148669:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851881.148669:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.148671:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851881.148674:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851881.148674:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851881.148674:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851881.148675:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851881.148676:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21488@kfi7, seq: 2289881
00000100:00000001:15.0:1773851881.148677:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851881.148677:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7f17201 : new rpc_count 1
00000100:00000001:12.0:1773851881.148678:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562675328 : -106978146876288 : ffff9eb4358e8480)
00000100:00000001:15.0:1773851881.148679:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851881.148680:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000a23492d x1859314497944768/t0(0) o400->e01c023f-68b3-4f6e-8721-340a2a7753b7@21488@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1821-0'
00000100:00000001:12.0:1773851881.148685:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851881.148685:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851881.148687:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a23492d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e01c023f-68b3-4f6e-8721-340a2a7753b7+6:39547:x1859314497944768:12345-21488@kfi7:400:default-tuolumne1821-0
00000100:00000200:12.0:1773851881.148689:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314497944768
00000020:00000001:12.0:1773851881.148690:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851881.148691:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851881.148692:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851881.148693:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851881.148694:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851881.148695:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851881.148696:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314497944768, found 0 last_xid 1859314497944767
00000020:00000001:12.0:1773851881.148697:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851881.148698:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851881.148699:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851881.148700:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851881.148701:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851881.148702:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851881.148703:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851881.148704:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ebe075ad.
02000000:00000001:12.0:1773851881.148705:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.148706:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851881.148707:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851881.148708:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260551863, transno 0, xid 1859314497944768
00010000:00000001:12.0:1773851881.148709:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851881.148710:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000a23492d x1859314497944768/t0(0) o400->e01c023f-68b3-4f6e-8721-340a2a7753b7@21488@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1821-0'
00010000:00000001:12.0:1773851881.148714:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851881.148715:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851881.148716:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=114 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851881.148718:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851881.148719:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005a638c6f refcount 3 to 21488@kfi7
00000100:00000001:12.0:1773851881.148721:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902778016 : -107154806773600 : ffff9e8b13ce68a0)
02000000:00000001:12.0:1773851881.148722:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851881.148722:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.148724:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851881.148731:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21488@kfi7
00000400:00000010:12.0:1773851881.148732:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008781a478.
00000100:00000200:12.0:1773851881.148734:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314497944768, offset 224
00000400:00000200:12.0:1773851881.148736:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21488@kfi7
00000400:00000200:12.0:1773851881.148737:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21488@kfi7 to cpt 3
00000400:00000200:12.0:1773851881.148739:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2778624 nid 21488@kfi7 refs 1
00000400:00000200:12.0:1773851881.148741:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c2778624 nid 21488@kfi7 refs 2
00000400:00000200:12.0:1773851881.148743:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c2778624 nid 21488@kfi7 refs 3
00000400:00000200:12.0:1773851881.148745:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21488@kfi7 local destination
00000400:00000200:12.0:1773851881.148747:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769691:8769691:1024:4294967295] 21488@kfi7 LPNI seq info [1419384:1419384:16:4294967295]
00000400:00000200:12.0:1773851881.148750:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c2778624 nid 21488@kfi7 refs 2
00000400:00000200:12.0:1773851881.148751:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21488@kfi7 to cpt 3
00000400:00000200:12.0:1773851881.148755:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21488@kfi7(21488@kfi7:21488@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851881.148758:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c2778624 nid 21488@kfi7 refs 3
00000800:00000200:12.0:1773851881.148760:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851881.148763:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851881.148767:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851881.148771:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000093a Using peer 21488@kfi7(0x10000000000093a)
00000800:00000200:12.0:1773851881.148776:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0x10000000000093a: rc=0
00000800:00000200:12.0:1773851881.148779:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000093a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851881.148783:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851881.148785:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005a638c6f refcount 2 to 21488@kfi7
00010000:00000001:12.0:1773851881.148788:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851881.148789:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851881.148790:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851881.148792:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000a23492d x1859314497944768/t0(0) o400->e01c023f-68b3-4f6e-8721-340a2a7753b7@21488@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1821-0'
00000100:00100000:12.0:1773851881.148798:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a23492d pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e01c023f-68b3-4f6e-8721-340a2a7753b7+6:39547:x1859314497944768:12345-21488@kfi7:400:default-tuolumne1821-0 Request processed in 111us (166us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851881.148805:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21488@kfi7, seq: 2289881
00000100:00000040:12.0:1773851881.148807:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7f17201 : new rpc_count 0
00000100:00000001:12.0:1773851881.148808:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851881.148809:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851881.148810:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851881.148812:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a30c3e95.
00000020:00000010:12.0:1773851881.148814:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000020:00000040:12.0:1773851881.148815:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000a7f17201 : new refcount 5
00000100:00000001:12.0:1773851881.148816:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851881.148827:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000093a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851881.148830:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851881.148832:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21488@kfi7: PUT: OK
00000400:00000200:13.0:1773851881.148833:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008781a478
00000400:00000010:13.0:1773851881.148835:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008781a478.
00000100:00000001:13.0:1773851881.148836:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851881.148837:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851881.148838:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c2778624 nid 21488@kfi7 refs 2
00000800:00000200:13.0:1773851881.148841:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 21488@kfi7(00000000bbdd7c81):0x0 lsk 2363 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000093a Transaction freed
00000800:00000200:3.0:1773851881.159253:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851881.159254:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851881.159256:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851881.159259:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851881.159261:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22000@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.159262:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22000@kfi7 : PUT - for me
00000400:00000200:3.0:1773851881.159263:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22000@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.159264:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077fa93af nid 22000@kfi7 refs 1
00000400:00000200:3.0:1773851881.159265:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22000@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.159265:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077fa93af nid 22000@kfi7 refs 2
00000400:00000200:3.0:1773851881.159266:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000077fa93af nid 22000@kfi7 refs 3
00000400:00000200:3.0:1773851881.159267:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22001@kfi7 to cpt 3
00000400:00000200:3.0:1773851881.159269:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22001@kfi7 of length 224 into portal 12 MB=0x699e144cd4940
00000400:00000200:3.0:1773851881.159270:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22001@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 40736
00000800:00000200:3.0:1773851881.159271:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851881.159273:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851881.159274:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22000@kfi7: PUT: OK
00000100:00000001:3.0:1773851881.159275:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851881.159276:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851881.159276:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e4bb8b9d.
00000100:00000040:3.0:1773851881.159277:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000e4bb8b9d x1858042661259584 msgsize 224
00000100:00100000:3.0:1773851881.159278:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-22001@kfi7 (source: 12345-22000@kfi7)
00000100:00000001:3.0:1773851881.159279:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851881.159280:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000077fa93af nid 22000@kfi7 refs 2
00000100:00000001:1.0:1773851881.159281:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851881.159281:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851881.159282:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851881.159282:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851881.159282:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851881.159283:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851881.159284:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042661259584
00000020:00000001:1.0:1773851881.159284:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851881.159285:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac928f0
00000020:00000001:1.0:1773851881.159286:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851881.159289:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b5ad3c87 refcount=6
00000020:00000001:1.0:1773851881.159289:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742956032 : -107128966595584 : ffff9e9118003c00)
00000020:00000001:1.0:1773851881.159290:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742956032 : -107128966595584 : ffff9e9118003c00)
00000100:00000001:1.0:1773851881.159291:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851881.159292:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851881.159293:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851881.159294:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851881.159294:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851881.159295:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851881.159296:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851881.159296:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851881.159297:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851881.159297:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851881.159298:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851881.159299:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851881.159300:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851881.159300:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851881.159300:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851881.159301:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851881.159301:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22001@kfi7, seq: 1997592
00000100:00000001:2.0:1773851881.159302:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851881.159302:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b5ad3c87 : new rpc_count 1
00000100:00000001:2.0:1773851881.159303:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851881.159304:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288719744 : -106964420831872 : ffff9eb767b15580)
00000100:00000040:1.0:1773851881.159305:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e4bb8b9d x1858042661259584/t0(0) o400->b315b74a-78b0-48f6-80f7-86a5245d1493@22001@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1853-0'
00000100:00000001:1.0:1773851881.159308:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851881.159308:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851881.159309:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e4bb8b9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:b315b74a-78b0-48f6-80f7-86a5245d1493+6:39796:x1858042661259584:12345-22001@kfi7:400:default-tuolumne1853-0
00000100:00000200:1.0:1773851881.159310:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042661259584
00000020:00000001:1.0:1773851881.159311:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851881.159311:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851881.159312:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851881.159313:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851881.159313:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851881.159314:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851881.159314:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042661259584, found 0 last_xid 1858042661259583
00000020:00000001:1.0:1773851881.159315:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851881.159316:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851881.159316:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851881.159317:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851881.159317:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851881.159318:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851881.159318:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851881.159319:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000003bb782c.
02000000:00000001:1.0:1773851881.159320:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851881.159321:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851881.159321:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851881.159322:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262830990, transno 0, xid 1858042661259584
00010000:00000001:1.0:1773851881.159323:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851881.159324:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e4bb8b9d x1858042661259584/t0(0) o400->b315b74a-78b0-48f6-80f7-86a5245d1493@22001@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1853-0'
00010000:00000001:1.0:1773851881.159326:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851881.159327:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851881.159327:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=114 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851881.159329:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851881.159330:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0b86637 refcount 3 to 22001@kfi7
00000100:00000001:1.0:1773851881.159330:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298112 : -107155980253504 : ffff9e8acddc86c0)
02000000:00000001:1.0:1773851881.159331:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851881.159332:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851881.159332:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851881.159333:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22000@kfi7
00000400:00000010:1.0:1773851881.159334:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089f888d1.
00000100:00000200:1.0:1773851881.159335:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042661259584, offset 224
00000400:00000200:1.0:1773851881.159336:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22000@kfi7
00000400:00000200:1.0:1773851881.159337:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22000@kfi7 to cpt 0
00000400:00000200:1.0:1773851881.159338:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077fa93af nid 22000@kfi7 refs 1
00000400:00000200:1.0:1773851881.159339:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000077fa93af nid 22000@kfi7 refs 2
00000400:00000200:1.0:1773851881.159340:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000077fa93af nid 22000@kfi7 refs 3
00000400:00000200:1.0:1773851881.159341:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22000@kfi7 local destination
00000400:00000200:1.0:1773851881.159342:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769692:8769692:1024:4294967295] 22000@kfi7 LPNI seq info [14473726:14473726:16:4294967295]
00000400:00000200:1.0:1773851881.159344:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000077fa93af nid 22000@kfi7 refs 2
00000400:00000200:1.0:1773851881.159344:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22000@kfi7 to cpt 0
00000400:00000200:1.0:1773851881.159346:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22000@kfi7(22000@kfi7:22000@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851881.159348:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000077fa93af nid 22000@kfi7 refs 3
00000800:00000200:1.0:1773851881.159349:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851881.159350:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851881.159352:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851881.159354:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe68 Using peer 22000@kfi7(0xe68)
00000800:00000200:1.0:1773851881.159357:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000004096d8c5: Posted send of 324 bytes to peer 0xe68: rc=0
00000800:00000200:1.0:1773851881.159358:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe68 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851881.159360:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851881.159362:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0b86637 refcount 2 to 22001@kfi7
00010000:00000001:1.0:1773851881.159362:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851881.159363:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851881.159363:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851881.159364:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e4bb8b9d x1858042661259584/t0(0) o400->b315b74a-78b0-48f6-80f7-86a5245d1493@22001@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1853-0'
00000100:00100000:1.0:1773851881.159367:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e4bb8b9d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:b315b74a-78b0-48f6-80f7-86a5245d1493+6:39796:x1858042661259584:12345-22001@kfi7:400:default-tuolumne1853-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851881.159369:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22001@kfi7, seq: 1997592
00000100:00000040:1.0:1773851881.159370:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b5ad3c87 : new rpc_count 0
00000100:00000001:1.0:1773851881.159370:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851881.159371:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851881.159371:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000800:00000200:2.0:1773851881.159372:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe68 TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851881.159372:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000020:00000010:1.0:1773851881.159373:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000020:00000040:1.0:1773851881.159373:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000b5ad3c87 : new refcount 5
00000400:00000200:2.0:1773851881.159374:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851881.159374:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851881.159375:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22000@kfi7: PUT: OK
00000400:00000200:2.0:1773851881.159376:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089f888d1
00000400:00000010:2.0:1773851881.159377:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089f888d1.
00000100:00000001:2.0:1773851881.159377:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851881.159378:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851881.159379:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000077fa93af nid 22000@kfi7 refs 2
00000800:00000200:2.0:1773851881.159380:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004096d8c5: 2069@kfi7:0 -> 22000@kfi7(000000008a326aee):0x0 lsk 3689 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe68 Transaction freed
00000800:00000200:25.0:1773851881.194836:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851881.194837:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851881.194839:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851881.194843:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851881.194846:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.194848:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:25.0:1773851881.194849:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.194851:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:25.0:1773851881.194852:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.194853:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851881.194854:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:25.0:1773851881.194856:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851881.194857:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed43fd00
00000400:00000200:25.0:1773851881.194859:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x160dfce379 [256] + 14064
00000800:00000200:25.0:1773851881.194862:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851881.194865:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851881.194867:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851881.194868:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851881.194868:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851881.194869:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000065605aa0.
00000100:00000040:25.0:1773851881.194870:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000065605aa0 x1858062667480320 msgsize 224
00000100:00100000:25.0:1773851881.194871:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000100:00000001:25.0:1773851881.194873:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851881.194874:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851881.194875:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851881.194878:0:1691804:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851881.194879:0:1691804:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851881.194879:0:1691804:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851881.194880:0:1691804:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851881.194880:0:1691804:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851881.194881:0:1691804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667480320
00000020:00000001:25.0:1773851881.194882:0:1691804:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851881.194882:0:1691804:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:25.0:1773851881.194883:0:1691804:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851881.194884:0:1691804:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:25.0:1773851881.194885:0:1691804:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:25.0:1773851881.194886:0:1691804:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:25.0:1773851881.194887:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851881.194887:0:1691804:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851881.194888:0:1691804:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fc844a13.
00000020:00000010:25.0:1773851881.194889:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851881.194890:0:1691804:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055dcba11.
00000100:00000040:25.0:1773851881.194892:0:1691804:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:25.0:1773851881.194892:0:1691804:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851881.194893:0:1691804:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851881.194893:0:1691804:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851881.194895:0:1691804:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851881.194896:0:1691804:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851881.194897:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851881.194897:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851881.194898:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851881.194898:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851881.194899:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799985
00000100:00000001:25.0:1773851881.194900:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851881.194900:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:25.0:1773851881.194901:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851881.194901:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252474240 : -106967457077376 : ffff9eb6b2b7e780)
00000100:00000040:24.0:1773851881.194902:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000065605aa0 x1858062667480320/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:24.0:1773851881.194905:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851881.194906:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851881.194907:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065605aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667480320:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:24.0:1773851881.194909:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667480320
00000020:00000001:24.0:1773851881.194909:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851881.194910:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851881.194910:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851881.194911:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851881.194912:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851881.194913:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851881.194913:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851881.194914:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851881.194914:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851881.194915:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851881.194916:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851881.194916:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851881.194917:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000006a0aec2e.
02000000:00000001:24.0:1773851881.194918:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851881.194919:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851881.194920:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851881.194920:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851881.194921:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851881.194922:0:1537164:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851881.194923:0:1537164:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851881.194924:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 66060288 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851881.194925:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132403 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851881.194926:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851881.194927:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667480320
00010000:00000001:24.0:1773851881.194928:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851881.194929:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000065605aa0 x1858062667480320/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:24.0:1773851881.194931:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851881.194932:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851881.194933:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=8 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851881.194934:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851881.194934:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:24.0:1773851881.194935:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:24.0:1773851881.194937:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851881.194937:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851881.194938:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851881.194939:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:24.0:1773851881.194940:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000773be3f9.
00000100:00000200:24.0:1773851881.194941:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667480320, offset 224
00000400:00000200:24.0:1773851881.194942:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:24.0:1773851881.194943:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851881.194944:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:24.0:1773851881.194945:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851881.194946:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:24.0:1773851881.194947:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2105@kfi7 local destination
00000400:00000200:24.0:1773851881.194949:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769693:8769693:1024:4294967295] 2105@kfi7 LPNI seq info [20346208:20346208:16:4294967295]
00000400:00000200:24.0:1773851881.194950:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851881.194951:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851881.194953:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851881.194954:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:24.0:1773851881.194956:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851881.194957:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851881.194959:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851881.194962:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000800:00000200:24.0:1773851881.194965:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000067401146: Posted send of 468 bytes to peer 0x4c6: rc=0
00000800:00000200:24.0:1773851881.194967:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851881.194969:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851881.194970:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:24.0:1773851881.194971:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851881.194973:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851881.194973:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851881.194974:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000065605aa0 x1858062667480320/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:24.0:1773851881.194977:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065605aa0 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667480320:12345-2098@kfi7:41:default-yuba6-0 Request processed in 71us (107us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851881.194979:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799985
00000100:00000040:24.0:1773851881.194980:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:24.0:1773851881.194981:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851881.194981:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851881.194982:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851881.194983:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055dcba11.
00000020:00000010:24.0:1773851881.194984:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fc844a13.
00000020:00000040:24.0:1773851881.194984:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:24.0:1773851881.194985:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851881.194990:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851881.194992:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851881.194993:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:25.0:1773851881.194994:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000773be3f9
00000400:00000010:25.0:1773851881.194995:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000773be3f9.
00000100:00000001:25.0:1773851881.194995:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851881.194996:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851881.194997:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851881.194998:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Transaction freed
00000800:00000200:17.0:1773851881.234254:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.234256:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851881.234258:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851881.234261:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851881.234265:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22355@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.234266:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22355@kfi7 : PUT - for me
00000400:00000200:17.0:1773851881.234268:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22355@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.234269:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf14371d nid 22355@kfi7 refs 1
00000400:00000200:17.0:1773851881.234271:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22355@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.234272:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf14371d nid 22355@kfi7 refs 2
00000400:00000200:17.0:1773851881.234274:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf14371d nid 22355@kfi7 refs 3
00000400:00000200:17.0:1773851881.234275:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22355@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.234277:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22355@kfi7 of length 224 into portal 12 MB=0x699e10d0bfa00
00000400:00000200:17.0:1773851881.234279:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22355@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 29816
00000800:00000200:17.0:1773851881.234282:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851881.234285:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851881.234286:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22355@kfi7: PUT: OK
00000100:00000001:17.0:1773851881.234288:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851881.234289:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851881.234291:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000050a031f2.
00000100:00000040:17.0:1773851881.234292:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000050a031f2 x1858041725843968 msgsize 224
00000100:00100000:17.0:1773851881.234295:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22355@kfi7 (source: 12345-22355@kfi7)
00000100:00000001:17.0:1773851881.234297:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851881.234298:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf14371d nid 22355@kfi7 refs 2
00000800:00000200:17.0:1773851881.234301:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851881.234305:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851881.234306:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851881.234306:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851881.234307:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851881.234309:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851881.234310:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041725843968
00000020:00000001:17.0:1773851881.234311:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851881.234311:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a01
00000020:00000001:17.0:1773851881.234312:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851881.234315:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005e1082f5 refcount=6
00000020:00000001:17.0:1773851881.234316:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743461888 : -107128966089728 : ffff9e911807f400)
00000020:00000001:17.0:1773851881.234318:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743461888 : -107128966089728 : ffff9e911807f400)
00000100:00000001:17.0:1773851881.234319:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851881.234320:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851881.234321:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851881.234323:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851881.234324:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851881.234325:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851881.234326:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851881.234327:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851881.234328:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851881.234329:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851881.234330:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.234332:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851881.234334:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851881.234334:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851881.234335:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851881.234336:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22355@kfi7, seq: 2156380
00000100:00000001:16.0:1773851881.234336:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851881.234337:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005e1082f5 : new rpc_count 1
00000100:00000001:16.0:1773851881.234338:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.234339:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102230400 : -107041607321216 : ffff9ea56f04f980)
00000100:00000001:16.0:1773851881.234339:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851881.234341:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000050a031f2 x1858041725843968/t0(0) o400->ebfac265-86bb-46e5-8ade-ea4f707d1238@22355@kfi7:102/0 lens 224/0 e 0 to 0 dl 1773852217 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1894-0'
00000100:00000001:17.0:1773851881.234346:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851881.234346:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851881.234348:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050a031f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ebfac265-86bb-46e5-8ade-ea4f707d1238+6:39660:x1858041725843968:12345-22355@kfi7:400:default-tuolumne1894-0
00000100:00000200:17.0:1773851881.234350:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041725843968
00000020:00000001:17.0:1773851881.234351:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851881.234352:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851881.234353:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.234354:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851881.234355:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851881.234356:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851881.234357:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041725843968, found 0 last_xid 1858041725843967
00000020:00000001:17.0:1773851881.234358:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851881.234359:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851881.234360:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851881.234361:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.234362:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851881.234363:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851881.234364:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851881.234365:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000097472cd0.
02000000:00000001:17.0:1773851881.234366:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.234367:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.234368:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851881.234369:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044151676, transno 0, xid 1858041725843968
00010000:00000001:17.0:1773851881.234370:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851881.234372:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000050a031f2 x1858041725843968/t0(0) o400->ebfac265-86bb-46e5-8ade-ea4f707d1238@22355@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1894-0'
00010000:00000001:17.0:1773851881.234376:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851881.234377:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851881.234378:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=114 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851881.234383:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851881.234384:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce409107 refcount 3 to 22355@kfi7
00000100:00000001:17.0:1773851881.234385:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583901152 : -107156125650464 : ffff9e8ac531f1e0)
02000000:00000001:17.0:1773851881.234387:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851881.234387:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.234388:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851881.234390:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22355@kfi7
00000400:00000010:17.0:1773851881.234391:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007c9bad05.
00000100:00000200:17.0:1773851881.234392:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041725843968, offset 224
00000400:00000200:17.0:1773851881.234394:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22355@kfi7
00000400:00000200:17.0:1773851881.234396:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22355@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.234397:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf14371d nid 22355@kfi7 refs 1
00000400:00000200:17.0:1773851881.234398:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf14371d nid 22355@kfi7 refs 2
00000400:00000200:17.0:1773851881.234400:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf14371d nid 22355@kfi7 refs 3
00000400:00000200:17.0:1773851881.234402:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22355@kfi7 local destination
00000400:00000200:17.0:1773851881.234404:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769694:8769694:1024:4294967295] 22355@kfi7 LPNI seq info [7068771:7068771:16:4294967295]
00000400:00000200:17.0:1773851881.234407:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf14371d nid 22355@kfi7 refs 2
00000400:00000200:17.0:1773851881.234408:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22355@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.234411:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22355@kfi7(22355@kfi7:22355@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851881.234413:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf14371d nid 22355@kfi7 refs 3
00000800:00000200:17.0:1773851881.234415:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.234417:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851881.234421:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851881.234425:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd3 Using peer 22355@kfi7(0xd3)
00000800:00000200:17.0:1773851881.234429:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0xd3: rc=0
00000800:00000200:17.0:1773851881.234432:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851881.234435:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851881.234437:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce409107 refcount 2 to 22355@kfi7
00010000:00000001:17.0:1773851881.234438:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851881.234439:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.234440:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851881.234441:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000050a031f2 x1858041725843968/t0(0) o400->ebfac265-86bb-46e5-8ade-ea4f707d1238@22355@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1894-0'
00000100:00100000:17.0:1773851881.234446:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050a031f2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ebfac265-86bb-46e5-8ade-ea4f707d1238+6:39660:x1858041725843968:12345-22355@kfi7:400:default-tuolumne1894-0 Request processed in 99us (153us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851881.234447:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd3 TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851881.234449:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851881.234450:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22355@kfi7: PUT: OK
00000400:00000200:19.0:1773851881.234450:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007c9bad05
00000100:00100000:17.0:1773851881.234450:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22355@kfi7, seq: 2156380
00000400:00000010:19.0:1773851881.234451:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007c9bad05.
00000100:00000001:19.0:1773851881.234451:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851881.234451:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:17.0:1773851881.234451:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005e1082f5 : new rpc_count 0
00000400:00000200:19.0:1773851881.234452:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf14371d nid 22355@kfi7 refs 2
00000100:00000001:17.0:1773851881.234453:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851881.234453:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:19.0:1773851881.234454:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 22355@kfi7(000000002935992c):0x0 lsk 212 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xd3 Transaction freed
00000020:00000010:17.0:1773851881.234454:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851881.234455:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851881.234457:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000020:00000040:17.0:1773851881.234458:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000005e1082f5 : new refcount 5
00000100:00000001:17.0:1773851881.234459:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:3.0:1773851881.258468:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851881.258469:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851881.258470:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851881.258473:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851881.258475:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22529@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.258476:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22529@kfi7 : PUT - for me
00000400:00000200:3.0:1773851881.258477:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22529@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.258478:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d16d323 nid 22529@kfi7 refs 1
00000400:00000200:3.0:1773851881.258479:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22529@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.258479:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d16d323 nid 22529@kfi7 refs 2
00000400:00000200:3.0:1773851881.258480:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003d16d323 nid 22529@kfi7 refs 3
00000400:00000200:3.0:1773851881.258481:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22529@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.258482:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22529@kfi7 of length 224 into portal 12 MB=0x69b16f1bfd940
00000400:00000200:3.0:1773851881.258484:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22529@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 40960
00000800:00000200:3.0:1773851881.258485:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851881.258487:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851881.258488:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22529@kfi7: PUT: OK
00000100:00000001:3.0:1773851881.258489:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851881.258489:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851881.258490:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3bb6976.
00000100:00000040:3.0:1773851881.258491:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000e3bb6976 x1859372707731776 msgsize 224
00000100:00100000:3.0:1773851881.258492:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-22529@kfi7 (source: 12345-22529@kfi7)
00000100:00000001:3.0:1773851881.258493:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851881.258494:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003d16d323 nid 22529@kfi7 refs 2
00000800:00000200:3.0:1773851881.258495:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851881.258496:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851881.258496:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851881.258497:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851881.258498:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851881.258499:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851881.258500:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372707731776
00000020:00000001:1.0:1773851881.258501:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851881.258502:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d59
00000020:00000001:1.0:1773851881.258503:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851881.258505:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000b1af0f3 refcount=627
00000020:00000001:1.0:1773851881.258506:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239476224 : -107152470075392 : ffff9e8b9f159800)
00000020:00000001:1.0:1773851881.258507:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239476224 : -107152470075392 : ffff9e8b9f159800)
00000100:00000001:1.0:1773851881.258509:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851881.258510:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851881.258511:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040e8a7a7.
00000020:00000010:1.0:1773851881.258512:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851881.258514:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d1b66ea.
00000100:00000001:1.0:1773851881.258515:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851881.258516:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851881.258516:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851881.258518:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851881.258518:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851881.258519:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851881.258521:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851881.258522:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851881.258523:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851881.258523:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851881.258523:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851881.258524:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22529@kfi7, seq: 1997593
00000100:00000040:2.0:1773851881.258525:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000b1af0f3 : new rpc_count 16
00000100:00000001:1.0:1773851881.258525:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851881.258526:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288725504 : -106964420826112 : ffff9eb767b16c00)
00000100:00000001:1.0:1773851881.258526:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851881.258527:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3bb6976 x1859372707731776/t0(0) o400->f61681f3-4133-41d6-92e0-a5a4ecd7e345@22529@kfi7:521/0 lens 224/0 e 0 to 0 dl 1773852636 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1907-0'
00000100:00000001:2.0:1773851881.258530:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851881.258531:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851881.258532:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3bb6976 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f61681f3-4133-41d6-92e0-a5a4ecd7e345+627:39715:x1859372707731776:12345-22529@kfi7:400:default-tuolumne1907-0
00000100:00000200:2.0:1773851881.258533:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372707731776
00000020:00000001:2.0:1773851881.258534:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851881.258534:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851881.258535:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.258536:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851881.258536:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851881.258537:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851881.258538:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372707731776, found 0 last_xid 1859372701124863
00000020:00000001:2.0:1773851881.258539:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851881.258540:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851881.258540:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851881.258541:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.258542:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851881.258542:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851881.258543:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851881.258544:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0f2d01c.
02000000:00000001:2.0:1773851881.258544:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851881.258545:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.258546:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851881.258547:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264579675, transno 0, xid 1859372707731776
00010000:00000001:2.0:1773851881.258547:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851881.258548:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3bb6976 x1859372707731776/t0(0) o400->f61681f3-4133-41d6-92e0-a5a4ecd7e345@22529@kfi7:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1907-0'
00010000:00000001:2.0:1773851881.258551:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851881.258552:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851881.258552:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=114 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851881.258556:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851881.258557:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cfb8864a refcount 3 to 22529@kfi7
00000100:00000001:2.0:1773851881.258558:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850080928 : -107143859470688 : ffff9e8da050fea0)
02000000:00000001:2.0:1773851881.258559:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851881.258560:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851881.258560:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851881.258561:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22529@kfi7
00000400:00000010:2.0:1773851881.258562:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8c1b5d.
00000100:00000200:2.0:1773851881.258563:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372707731776, offset 224
00000400:00000200:2.0:1773851881.258564:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22529@kfi7
00000400:00000200:2.0:1773851881.258565:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22529@kfi7 to cpt 0
00000400:00000200:2.0:1773851881.258566:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d16d323 nid 22529@kfi7 refs 1
00000400:00000200:2.0:1773851881.258567:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003d16d323 nid 22529@kfi7 refs 2
00000400:00000200:2.0:1773851881.258569:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003d16d323 nid 22529@kfi7 refs 3
00000400:00000200:2.0:1773851881.258570:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22529@kfi7 local destination
00000400:00000200:2.0:1773851881.258571:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769695:8769695:1024:4294967295] 22529@kfi7 LPNI seq info [420191:420191:16:4294967295]
00000400:00000200:2.0:1773851881.258572:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003d16d323 nid 22529@kfi7 refs 2
00000400:00000200:2.0:1773851881.258573:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22529@kfi7 to cpt 0
00000400:00000200:2.0:1773851881.258575:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22529@kfi7(22529@kfi7:22529@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851881.258577:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003d16d323 nid 22529@kfi7 refs 3
00000800:00000200:2.0:1773851881.258578:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851881.258579:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851881.258581:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851881.258584:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000006df Using peer 22529@kfi7(0x1000000000006df)
00000800:00000200:2.0:1773851881.258587:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000497e951d: Posted send of 324 bytes to peer 0x1000000000006df: rc=0
00000800:00000200:2.0:1773851881.258588:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000006df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851881.258590:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851881.258592:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cfb8864a refcount 2 to 22529@kfi7
00010000:00000001:2.0:1773851881.258593:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851881.258593:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.258594:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851881.258595:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3bb6976 x1859372707731776/t0(0) o400->f61681f3-4133-41d6-92e0-a5a4ecd7e345@22529@kfi7:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1907-0'
00000100:00100000:2.0:1773851881.258598:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3bb6976 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f61681f3-4133-41d6-92e0-a5a4ecd7e345+627:39715:x1859372707731776:12345-22529@kfi7:400:default-tuolumne1907-0 Request processed in 67us (107us total) trans 0 rc 0/0
00000800:00000200:3.0:1773851881.258601:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000006df TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851881.258601:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22529@kfi7, seq: 1997593
00000100:00000040:2.0:1773851881.258602:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000b1af0f3 : new rpc_count 15
00000400:00000200:3.0:1773851881.258603:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851881.258603:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851881.258603:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:3.0:1773851881.258604:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22529@kfi7: PUT: OK
00000020:00000010:2.0:1773851881.258604:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:3.0:1773851881.258605:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8c1b5d
00000020:00000010:2.0:1773851881.258605:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d1b66ea.
00000400:00000010:3.0:1773851881.258606:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8c1b5d.
00000100:00000001:3.0:1773851881.258606:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:2.0:1773851881.258606:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040e8a7a7.
00000100:00000001:3.0:1773851881.258607:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:2.0:1773851881.258607:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000b1af0f3 : new refcount 626
00000100:00000001:2.0:1773851881.258607:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:3.0:1773851881.258608:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003d16d323 nid 22529@kfi7 refs 2
00000800:00000200:3.0:1773851881.258609:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 22529@kfi7(00000000bf671f0f):0x0 lsk 1760 rsk 32 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000006df Transaction freed
00000800:00000200:17.0:1773851881.261909:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.261910:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851881.261911:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851881.261913:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851881.261915:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.261916:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.23@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851881.261917:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.261918:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851881.261919:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.23@o2ib60 to cpt 0
00000400:00000200:17.0:1773851881.261920:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003693e482 nid 192.168.128.23@o2ib60 refs 2
00000400:00000200:17.0:1773851881.261921:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003693e482 nid 192.168.128.23@o2ib60 refs 3
00000400:00000200:17.0:1773851881.261922:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.23@o2ib60 to cpt 0
00000400:00000200:17.0:1773851881.261924:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.23@o2ib60 of length 224 into portal 12 MB=0x69a3b275cbb00
00000400:00000200:17.0:1773851881.261925:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.23@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 41184
00000800:00000200:17.0:1773851881.261927:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851881.261929:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851881.261930:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851881.261931:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851881.261932:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851881.261932:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001785415b.
00000100:00000040:17.0:1773851881.261933:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001785415b x1858428714400512 msgsize 224
00000100:00100000:17.0:1773851881.261935:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.23@o2ib60 (source: 12345-192.168.128.23@o2ib60)
00000100:00000001:17.0:1773851881.261937:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851881.261937:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851881.261939:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851881.261939:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851881.261940:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851881.261941:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851881.261941:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851881.261942:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851881.261943:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858428714400512
00000020:00000001:2.0:1773851881.261943:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851881.261943:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e0f
00000020:00000001:2.0:1773851881.261944:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851881.261945:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047619235 refcount=6
00000020:00000001:2.0:1773851881.261946:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239645184 : -107152469906432 : ffff9e8b9f182c00)
00000020:00000001:2.0:1773851881.261946:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239645184 : -107152469906432 : ffff9e8b9f182c00)
00000100:00000001:2.0:1773851881.261947:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851881.261948:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851881.261948:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7ccc6d.
00000020:00000010:2.0:1773851881.261949:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851881.261950:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a912de76.
00000100:00000001:2.0:1773851881.261951:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851881.261951:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851881.261952:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851881.261953:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851881.261953:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851881.261954:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851881.261955:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851881.261956:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851881.261956:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851881.261957:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.23@o2ib60, seq: 1997594
00000100:00000040:2.0:1773851881.261958:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047619235 : new rpc_count 1
00000100:00000001:1.0:1773851881.261958:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851881.261958:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851881.261959:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102215424 : -107041607336192 : ffff9ea56f04bf00)
00000100:00000001:1.0:1773851881.261959:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851881.261960:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001785415b x1858428714400512/t0(0) o400->1eee2702-a727-4d02-bd4c-315b2775c545@192.168.128.23@o2ib60:521/0 lens 224/0 e 0 to 0 dl 1773852636 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix23-0'
00000100:00000001:1.0:1773851881.261960:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851881.261963:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851881.261963:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851881.261964:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001785415b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:1eee2702-a727-4d02-bd4c-315b2775c545+6:39697:x1858428714400512:12345-192.168.128.23@o2ib60:400:default-matrix23-0
00000100:00000200:2.0:1773851881.261965:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858428714400512
00000020:00000001:2.0:1773851881.261966:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851881.261967:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851881.261967:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.261968:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851881.261968:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851881.261969:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851881.261969:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858428714400512, found 0 last_xid 1858428714400511
00000020:00000001:2.0:1773851881.261970:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851881.261971:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851881.261971:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851881.261971:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.261972:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851881.261972:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851881.261973:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851881.261974:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000045ae486b.
02000000:00000001:2.0:1773851881.261975:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851881.261975:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.261976:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851881.261976:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183138549451, transno 0, xid 1858428714400512
00010000:00000001:2.0:1773851881.261977:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851881.261978:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001785415b x1858428714400512/t0(0) o400->1eee2702-a727-4d02-bd4c-315b2775c545@192.168.128.23@o2ib60:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix23-0'
00010000:00000001:2.0:1773851881.261980:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851881.261981:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851881.261981:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=114 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851881.261982:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851881.261983:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000af0005d8 refcount 3 to 192.168.128.23@o2ib60
00000100:00000001:2.0:1773851881.261984:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729381664 : -107155980169952 : ffff9e8acdddcd20)
02000000:00000001:2.0:1773851881.261984:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851881.261985:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851881.261985:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851881.261986:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.23@o2ib60
00000400:00000010:2.0:1773851881.261987:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e1355ef.
00000100:00000200:2.0:1773851881.261988:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858428714400512, offset 224
00000400:00000200:2.0:1773851881.261989:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.23@o2ib60
00000400:00000200:2.0:1773851881.261990:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.23@o2ib60 to cpt 0
00000400:00000200:2.0:1773851881.261991:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003693e482 nid 192.168.128.23@o2ib60 refs 2
00000400:00000200:2.0:1773851881.261992:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003693e482 nid 192.168.128.23@o2ib60 refs 3
00000400:00000200:2.0:1773851881.261993:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003693e482 nid 192.168.128.23@o2ib60 refs 4
00000400:00000200:2.0:1773851881.261995:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.23@o2ib60 routed destination
00000400:00000200:2.0:1773851881.261996:0:42868:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:2.0:1773851881.261997:0:42868:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:2.0:1773851881.261998:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.23@o2ib60: rtr pref emtpy: 1
00000400:00000200:2.0:1773851881.261999:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:2.0:1773851881.262000:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.23@o2ib60: rtr pref emtpy: 1
00000400:00000200:2.0:1773851881.262001:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:2.0:1773851881.262003:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769696:8769696:1024:4294967295] 2094@kfi7 LPNI seq info [1258747012:1258747012:16:4294967295]
00000400:00000200:2.0:1773851881.262004:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:2.0:1773851881.262005:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:2.0:1773851881.262007:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.23@o2ib60(192.168.128.23@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851881.262009:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003693e482 nid 192.168.128.23@o2ib60 refs 3
00000800:00000200:2.0:1773851881.262010:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851881.262011:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851881.262013:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851881.262015:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:2.0:1773851881.262018:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000009005aa0b: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:2.0:1773851881.262019:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851881.262021:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851881.262022:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000af0005d8 refcount 2 to 192.168.128.23@o2ib60
00010000:00000001:2.0:1773851881.262022:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851881.262023:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851881.262023:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851881.262024:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001785415b x1858428714400512/t0(0) o400->1eee2702-a727-4d02-bd4c-315b2775c545@192.168.128.23@o2ib60:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix23-0'
00000100:00100000:2.0:1773851881.262027:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001785415b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:1eee2702-a727-4d02-bd4c-315b2775c545+6:39697:x1858428714400512:12345-192.168.128.23@o2ib60:400:default-matrix23-0 Request processed in 63us (93us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851881.262030:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.23@o2ib60, seq: 1997594
00000100:00000040:2.0:1773851881.262030:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047619235 : new rpc_count 0
00000800:00000200:1.0:1773851881.262030:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851881.262031:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:1.0:1773851881.262031:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851881.262032:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851881.262032:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851881.262033:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a912de76.
00000020:00000010:2.0:1773851881.262033:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7ccc6d.
00000400:00000200:1.0:1773851881.262033:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000040:2.0:1773851881.262034:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000047619235 : new refcount 5
00000400:00000200:1.0:1773851881.262034:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e1355ef
00000400:00000010:1.0:1773851881.262034:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e1355ef.
00000100:00000001:2.0:1773851881.262035:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851881.262035:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851881.262035:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851881.262036:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:1.0:1773851881.262038:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000000c Transaction freed
00000004:00000001:11.0:1773851881.289733:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851881.289733:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851881.289734:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001937abea.
00000020:00000040:11.0:1773851881.289736:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851881.289737:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851881.289738:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851881.289739:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851881.289741:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000171bdcdb.
00000100:00000001:11.0:1773851881.289743:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851881.289744:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851881.289746:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851881.289747:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001937abea] to pc [ptlrpcd_02_01+1]  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851881.289754:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:10.0:1773851881.289754:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851881.289755:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851881.289755:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851881.289755:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:11.0:1773851881.289756:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000031994f28.
00000100:00000040:10.0:1773851881.289756:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851881.289756:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851881.289758:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637127544641536 : -106946164910080 : ffff9ebba7d49800)
00080000:00000001:11.0:1773851881.289759:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:10.0:1773851881.289759:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851881.289759:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851881.289760:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:11.0:1773851881.289761:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851881.289761:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851881.289762:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000100:00100000:10.0:1773851881.289762:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001937abea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051933952:2075@kfi7:13:default-yuba2-0
00000004:00000010:11.0:1773851881.289763:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f5284480.
00000004:00080000:11.0:1773851881.289764:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614155743039981ns, next at 614156743038328ns, rc = 0
00000100:00000001:10.0:1773851881.289764:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851881.289764:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851881.289765:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851881.289765:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:11.0:1773851881.289766:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000010:10.0:1773851881.289767:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000057e04f70.
02000000:00000001:10.0:1773851881.289767:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851881.289768:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851881.289769:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851881.289769:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:10.0:1773851881.289770:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000400:00000010:10.0:1773851881.289770:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000200:10.0:1773851881.289771:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051933952, portal 4
00000100:00000001:10.0:1773851881.289772:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851881.289773:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446588032 : -106937262963584 : ffff9ebdba6d8480)
00000100:00000040:10.0:1773851881.289774:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851881.289776:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851881.289777:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:10.0:1773851881.289778:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b02d1546.
00000100:00000200:10.0:1773851881.289779:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051933952, offset 0
00000400:00000200:10.0:1773851881.289780:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:10.0:1773851881.289781:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.289782:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:10.0:1773851881.289783:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851881.289784:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:10.0:1773851881.289785:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:10.0:1773851881.289787:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769694, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769696, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851881.289789:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:10.0:1773851881.289790:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851881.289791:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:10.0:1773851881.289792:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769697:8769697:1024:4294967295] 2075@kfi7 LPNI seq info [5403913:5403913:16:4294967295]
00000400:00000200:10.0:1773851881.289793:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851881.289794:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.289796:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851881.289797:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:10.0:1773851881.289798:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851881.289799:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851881.289802:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851881.289805:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Using peer 2075@kfi7(0x4e8)
00000800:00000200:10.0:1773851881.289808:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000000600ceff: Posted send of 324 bytes to peer 0x4e8: rc=0
00000800:00000200:10.0:1773851881.289810:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851881.289812:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851881.289812:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851881.289813:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851881.289814:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851881.289814:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851881.289816:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851881.289816:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851881.289817:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851881.289817:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851881.289817:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851881.289818:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851881.289821:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851881.289823:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851881.289824:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000400:00000200:9.0:1773851881.289825:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b02d1546
00000400:00000010:9.0:1773851881.289826:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b02d1546.
00000100:00000001:9.0:1773851881.289827:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851881.289828:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851881.289831:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851881.289832:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851881.289835:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851881.289835:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851881.289836:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851881.289838:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Transaction freed
00000800:00000200:9.0:1773851881.289863:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851881.289864:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851881.289866:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851881.289868:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851881.289870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851881.289871:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851881.289872:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851881.289874:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851881.289874:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851881.289875:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851881.289876:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851881.289877:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851881.289878:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4d00
00000400:00000200:9.0:1773851881.289879:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851881.289880:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781698209 [1] + 224
00000800:00000200:9.0:1773851881.289882:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851881.289883:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851881.289884:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851881.289885:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851881.289886:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851881.289889:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851881.289892:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851881.289893:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851881.289893:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000100:00000001:10.0:1773851881.289894:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851881.289894:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:10.0:1773851881.289895:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851881.289895:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851881.289896:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:10.0:1773851881.289896:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851881.289897:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851881.289897:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851881.289898:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851881.289901:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851881.289903:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851881.289904:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851881.289904:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851881.289905:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851881.289906:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851881.289906:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851881.289907:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851881.289908:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=114 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851881.289909:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=114 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851881.289910:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851881.289911:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851881.289912:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851881.289912:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851881.289913:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851881.289913:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:10.0:1773851881.289914:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851881.289914:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851881.289915:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851881.289918:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851881.289919:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851881.289919:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851881.289920:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851881.289921:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851881.289921:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470657536 avail=351461516288 avail_mb=1372896548 hwm_mb=3131103 files=372064464 ffree=343233064 state=0: rc = 0
00000004:00000020:10.0:1773851881.289923:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470657536 free, 351461516288 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064464 files, 343233064 free files
00000004:00000001:10.0:1773851881.289925:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851881.289926:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851881.289928:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001937abea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051933952:2075@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851881.289930:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851881.289930:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851881.289931:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001937abea x1859433051933952/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851881.289933:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851881.289934:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851881.289934:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000057e04f70.
02000000:00000001:10.0:1773851881.289936:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851881.289936:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851881.289937:0:41069:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:10.0:1773851881.289938:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851881.289938:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000171bdcdb.
02000000:00000001:10.0:1773851881.289939:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851881.289939:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851881.289940:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001937abea.
00000100:00000001:10.0:1773851881.289941:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851881.289941:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851881.289942:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851881.289942:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851881.289943:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851881.289943:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851881.289944:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851881.353731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851881.353733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:13.0:1773851881.416204:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851881.416205:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851881.416206:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851881.416208:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851881.416210:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851881.416211:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:13.0:1773851881.416211:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851881.416212:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:13.0:1773851881.416213:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851881.416213:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:13.0:1773851881.416214:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:13.0:1773851881.416215:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851881.416216:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a860ae640
00000400:00000200:13.0:1773851881.416217:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x8242bd2ed [256] + 3240
00000800:00000200:13.0:1773851881.416218:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851881.416220:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851881.416221:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000100:00000001:13.0:1773851881.416222:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851881.416222:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:13.0:1773851881.416223:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005475b5af.
00000100:00000040:13.0:1773851881.416224:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005475b5af x1859388080580160 msgsize 224
00000100:00100000:13.0:1773851881.416225:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-7@kfi7)
00000100:00000001:13.0:1773851881.416226:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851881.416227:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:13.0:1773851881.416229:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851881.416229:0:1537104:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851881.416230:0:1537104:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851881.416231:0:1537104:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851881.416232:0:1537104:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851881.416234:0:1537104:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851881.416235:0:1537104:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080580160
00000020:00000001:12.0:1773851881.416236:0:1537104:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851881.416237:0:1537104:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:12.0:1773851881.416238:0:1537104:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851881.416241:0:1537104:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:12.0:1773851881.416242:0:1537104:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:12.0:1773851881.416244:0:1537104:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:12.0:1773851881.416245:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851881.416246:0:1537104:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851881.416248:0:1537104:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851881.416250:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851881.416251:0:1537104:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a30c3e95.
00000100:00000040:12.0:1773851881.416253:0:1537104:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:12.0:1773851881.416255:0:1537104:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851881.416256:0:1537104:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851881.416257:0:1537104:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.416258:0:1537104:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.416260:0:1537104:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851881.416263:0:1537104:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851881.416264:0:1537109:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851881.416264:0:1537104:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851881.416265:0:1537109:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851881.416266:0:1537104:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 1164652
00000100:00000001:14.0:1773851881.416268:0:1537109:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851881.416268:0:1537104:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:14.0:1773851881.416269:0:1537109:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.416269:0:1537104:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902272128 : -106994807279488 : ffff9eb05484f080)
00000100:00000040:12.0:1773851881.416271:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005475b5af x1859388080580160/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:12.0:1773851881.416277:0:1537104:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851881.416277:0:1537104:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851881.416279:0:1537104:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005475b5af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080580160:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:12.0:1773851881.416282:0:1537104:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080580160
00000020:00000001:12.0:1773851881.416283:0:1537104:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851881.416284:0:1537104:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851881.416285:0:1537104:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851881.416286:0:1537104:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851881.416287:0:1537104:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:12.0:1773851881.416288:0:1537104:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:12.0:1773851881.416289:0:1537104:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851881.416290:0:1537104:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851881.416291:0:1537104:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851881.416292:0:1537104:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.416294:0:1537104:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851881.416294:0:1537104:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851881.416296:0:1537104:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000062acc877.
02000000:00000001:12.0:1773851881.416297:0:1537104:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.416298:0:1537104:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851881.416300:0:1537104:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:12.0:1773851881.416301:0:1537104:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:12.0:1773851881.416302:0:1537104:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:12.0:1773851881.416304:0:1537104:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 66060288 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:12.0:1773851881.416306:0:1537104:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132403 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:12.0:1773851881.416308:0:1537104:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851881.416310:0:1537104:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080580160
00010000:00000001:12.0:1773851881.416311:0:1537104:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851881.416313:0:1537104:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005475b5af x1859388080580160/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:12.0:1773851881.416318:0:1537104:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851881.416319:0:1537104:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851881.416321:0:1537104:0:(import.c:1951:at_measured()) add 1 to 00000000a8c7027b time=41 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851881.416323:0:1537104:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851881.416324:0:1537104:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:12.0:1773851881.416325:0:1537104:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:12.0:1773851881.416327:0:1537104:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851881.416327:0:1537104:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.416329:0:1537104:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851881.416330:0:1537104:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:12.0:1773851881.416331:0:1537104:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dd0185dc.
00000100:00000200:12.0:1773851881.416333:0:1537104:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080580160, offset 224
00000400:00000200:12.0:1773851881.416335:0:1537104:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:12.0:1773851881.416337:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:12.0:1773851881.416339:0:1537104:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:12.0:1773851881.416341:0:1537104:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:12.0:1773851881.416342:0:1537104:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:12.0:1773851881.416344:0:1537104:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  7@kfi7 local destination
00000400:00000200:12.0:1773851881.416347:0:1537104:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769698:8769698:1024:4294967295] 7@kfi7 LPNI seq info [17340068:17340068:16:4294967295]
00000400:00000200:12.0:1773851881.416350:0:1537104:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:12.0:1773851881.416351:0:1537104:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:12.0:1773851881.416355:0:1537104:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851881.416357:0:1537104:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000800:00000200:12.0:1773851881.416360:0:1537104:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851881.416362:0:1537104:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:12.0:1773851881.416366:0:1537104:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851881.416371:0:1537104:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a Using peer 7@kfi7(0x20000000000119a)
00000800:00000200:12.0:1773851881.416380:0:1537104:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 468 bytes to peer 0x20000000000119a: rc=0
00000800:00000200:12.0:1773851881.416383:0:1537104:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851881.416386:0:1537104:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851881.416388:0:1537104:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:12.0:1773851881.416390:0:1537104:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851881.416391:0:1537104:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851881.416391:0:1537104:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851881.416392:0:1537104:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005475b5af x1859388080580160/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:12.0:1773851881.416395:0:1537104:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005475b5af pname:cluuid+ref:pid:xid:nid:opc:job mdt_out03_005:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080580160:12345-7@kfi7:41:default-yuba5-0 Request processed in 118us (171us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851881.416398:0:1537104:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 1164652
00000100:00000040:12.0:1773851881.416399:0:1537104:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:12.0:1773851881.416400:0:1537104:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851881.416400:0:1537104:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851881.416401:0:1537104:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851881.416402:0:1537104:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a30c3e95.
00000020:00000010:12.0:1773851881.416403:0:1537104:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000020:00000040:12.0:1773851881.416404:0:1537104:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:12.0:1773851881.416404:0:1537104:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851881.416411:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851881.416413:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851881.416414:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000400:00000200:14.0:1773851881.416415:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dd0185dc
00000400:00000010:14.0:1773851881.416415:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dd0185dc.
00000100:00000001:14.0:1773851881.416416:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851881.416417:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851881.416418:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:14.0:1773851881.416420:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000119a Transaction freed
00000800:00000200:9.0:1773851881.427812:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851881.427813:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851881.427814:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851881.427814:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851881.427816:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851881.427816:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851881.427819:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17681@kfi7(0000000087546cfa):0x9d1 version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851881.427820:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851881.427822:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 Using peer 17681@kfi7(0x1000000000009d1)
00000400:00000200:10.0:1773851881.427823:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.427825:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17681@kfi7 : PUT - for me
00000400:00000200:9.0:1773851881.427826:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.427827:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.427828:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 1
00000800:00000200:9.0:1773851881.427829:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x1000000000009d1: rc=0
00000400:00000200:10.0:1773851881.427830:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.427831:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 2
00000800:00000200:9.0:1773851881.427831:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851881.427832:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 3
00000400:00000200:10.0:1773851881.427834:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:10.0:1773851881.427835:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17681@kfi7 of length 456 into portal 12 MB=0x699e1357a2d80
00000400:00000200:10.0:1773851881.427838:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17681@kfi7 of length 456/456 into md 0x78146ce49 [64] + 145752
00000800:00000200:10.0:1773851881.427841:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851881.427844:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851881.427846:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851881.427847:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17681@kfi7: PUT: OK
00000100:00000001:10.0:1773851881.427849:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851881.427849:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851881.427850:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 Transaction freed
00000100:00000010:10.0:1773851881.427851:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e57f485b.
00000100:00000040:10.0:1773851881.427852:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000e57f485b x1858042404154752 msgsize 456
00000100:00100000:10.0:1773851881.427855:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-17681@kfi7 (source: 12345-17681@kfi7)
00000100:00000001:10.0:1773851881.427857:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851881.427858:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 2
00000100:00000001:8.0:1773851881.427859:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851881.427860:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851881.427861:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851881.427861:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851881.427862:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851881.427864:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851881.427865:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042404154752
00000020:00000001:8.0:1773851881.427866:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851881.427867:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92611
00000020:00000001:8.0:1773851881.427868:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851881.427872:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000013630f62 refcount=3502
00000020:00000001:8.0:1773851881.427873:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631004160 : -107123078547456 : ffff9e9276f4b800)
00000020:00000001:8.0:1773851881.427875:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631004160 : -107123078547456 : ffff9e9276f4b800)
00000100:00000001:8.0:1773851881.427877:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851881.427878:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851881.427879:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002e308d77.
00000020:00000010:8.0:1773851881.427881:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851881.427882:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000073de0a88.
00000100:00000001:8.0:1773851881.427884:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851881.427885:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851881.427886:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851881.427888:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851881.427890:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851881.427892:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851881.427893:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851881.427893:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851881.427893:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851881.427895:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17681@kfi7, seq: 406391010
00000100:00000040:11.0:1773851881.427896:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000013630f62 : new rpc_count 12
00000100:00000001:8.0:1773851881.427897:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851881.427898:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087773696 : -106944621777920 : ffff9ebc03ceec00)
00000100:00000001:8.0:1773851881.427898:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851881.427900:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e57f485b x1858042404154752/t0(0) o17->8f4c580e-cb98-4f09-8f03-170cdd130106@17681@kfi7:608/0 lens 456/0 e 0 to 0 dl 1773851968 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1601-0'
00000100:00000001:11.0:1773851881.427904:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851881.427905:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851881.427907:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e57f485b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8f4c580e-cb98-4f09-8f03-170cdd130106+3502:39709:x1858042404154752:12345-17681@kfi7:17:default-tuolumne1601-0
00000100:00000200:11.0:1773851881.427909:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042404154752
00000020:00000001:11.0:1773851881.427910:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851881.427911:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851881.427912:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851881.427913:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851881.427914:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:11.0:1773851881.427915:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851881.427916:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042404154752, found 0 last_xid 1858042403418431
00000020:00000001:11.0:1773851881.427918:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851881.427919:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851881.427919:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851881.427920:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851881.427921:0:60898:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:11.0:1773851881.427923:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851881.427924:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851881.427925:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000778474da.
02000000:00000001:11.0:1773851881.427926:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851881.427927:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851881.427929:0:60898:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:11.0:1773851881.427930:0:60898:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:11.0:1773851881.427931:0:60898:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851881.427934:0:60898:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851881.427935:0:60898:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851881.427936:0:60898:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 8f4c580e-cb98-4f09-8f03-170cdd130106/0000000013630f62 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851881.427938:0:60898:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851881.427939:0:60898:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 8f4c580e-cb98-4f09-8f03-170cdd130106/0000000013630f62 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851881.427941:0:60898:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851881.427943:0:60898:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:11.0:1773851881.427943:0:60898:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 8f4c580e-cb98-4f09-8f03-170cdd130106/0000000013630f62 reports grant 1797783551 dropped 0, local 1882456063
00000020:00000001:11.0:1773851881.427945:0:60898:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:11.0:1773851881.427946:0:60898:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:11.0:1773851881.427947:0:60898:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851881.427948:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264585740, transno 0, xid 1858042404154752
00010000:00000001:11.0:1773851881.427949:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851881.427951:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e57f485b x1858042404154752/t0(0) o17->8f4c580e-cb98-4f09-8f03-170cdd130106@17681@kfi7:608/0 lens 456/432 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1601-0'
00010000:00000001:11.0:1773851881.427955:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851881.427956:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851881.427957:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=114 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851881.427959:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851881.427960:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3132021 refcount 3 to 17681@kfi7
00000100:00000001:11.0:1773851881.427961:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959056768 : -107146750494848 : ffff9e8cf3ff7780)
02000000:00000001:11.0:1773851881.427963:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851881.427963:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851881.427964:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851881.427966:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17681@kfi7
00000400:00000010:11.0:1773851881.427967:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b9bacf7b.
00000100:00000200:11.0:1773851881.427968:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858042404154752, offset 224
00000400:00000200:11.0:1773851881.427971:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17681@kfi7
00000400:00000200:11.0:1773851881.427972:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:11.0:1773851881.427974:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 1
00000400:00000200:11.0:1773851881.427975:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 2
00000400:00000200:11.0:1773851881.427978:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 3
00000400:00000200:11.0:1773851881.427980:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17681@kfi7 local destination
00000400:00000200:11.0:1773851881.427982:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769699:8769699:1024:4294967295] 17681@kfi7 LPNI seq info [8343729:8343729:16:4294967295]
00000400:00000200:11.0:1773851881.427985:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 2
00000400:00000200:11.0:1773851881.427986:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17681@kfi7 to cpt 2
00000400:00000200:11.0:1773851881.427989:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17681@kfi7(17681@kfi7:17681@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851881.427991:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 3
00000800:00000200:11.0:1773851881.427994:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851881.427995:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:11.0:1773851881.427999:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851881.428002:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 Using peer 17681@kfi7(0x1000000000009d1)
00000800:00000200:11.0:1773851881.428007:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 532 bytes to peer 0x1000000000009d1: rc=0
00000800:00000200:11.0:1773851881.428009:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851881.428012:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851881.428013:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3132021 refcount 2 to 17681@kfi7
00010000:00000001:11.0:1773851881.428015:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851881.428016:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851881.428017:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851881.428018:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e57f485b x1858042404154752/t0(0) o17->8f4c580e-cb98-4f09-8f03-170cdd130106@17681@kfi7:608/0 lens 456/432 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1601-0'
00000100:00100000:11.0:1773851881.428024:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e57f485b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8f4c580e-cb98-4f09-8f03-170cdd130106+3502:39709:x1858042404154752:12345-17681@kfi7:17:default-tuolumne1601-0 Request processed in 118us (171us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851881.428024:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851881.428026:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851881.428028:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17681@kfi7, seq: 406391010
00000400:00000200:9.0:1773851881.428028:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17681@kfi7: PUT: OK
00000100:00000040:11.0:1773851881.428029:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000013630f62 : new rpc_count 11
00000400:00000200:9.0:1773851881.428030:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b9bacf7b
00000400:00000010:9.0:1773851881.428030:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b9bacf7b.
00000100:00000001:11.0:1773851881.428031:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851881.428031:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851881.428032:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851881.428032:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851881.428033:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:11.0:1773851881.428034:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000073de0a88.
00000400:00000200:9.0:1773851881.428034:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf8cfa7a nid 17681@kfi7 refs 2
00000020:00000010:11.0:1773851881.428036:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002e308d77.
00000800:00000200:9.0:1773851881.428036:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 17681@kfi7(0000000087546cfa):0x0 lsk 2514 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009d1 Transaction freed
00000020:00000040:11.0:1773851881.428037:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000013630f62 : new refcount 3501
00000100:00000001:11.0:1773851881.428038:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851881.489629:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851881.489630:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851881.489633:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851881.489637:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851881.489641:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.489643:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:21.0:1773851881.489645:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.489646:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:21.0:1773851881.489648:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.489650:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:21.0:1773851881.489651:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851881.489653:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.489655:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c975040
00000400:00000200:21.0:1773851881.489657:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 7432
00000800:00000200:21.0:1773851881.489660:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851881.489663:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851881.489665:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000100:00000001:21.0:1773851881.489666:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851881.489667:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851881.489669:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a6d6306.
00000100:00000040:21.0:1773851881.489670:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008a6d6306 x1858065608953920 msgsize 224
00000100:00100000:21.0:1773851881.489672:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-13@kfi7)
00000100:00000001:21.0:1773851881.489673:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851881.489675:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:20.0:1773851881.489676:0:1537152:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851881.489677:0:1537152:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851881.489678:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851881.489678:0:1537152:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851881.489679:0:1537152:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851881.489680:0:1537152:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851881.489682:0:1537152:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608953920
00000020:00000001:20.0:1773851881.489683:0:1537152:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851881.489684:0:1537152:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:20.0:1773851881.489685:0:1537152:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851881.489686:0:1537152:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:20.0:1773851881.489687:0:1537152:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:20.0:1773851881.489688:0:1537152:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:20.0:1773851881.489690:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.489691:0:1537152:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851881.489692:0:1537152:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851881.489694:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.489695:0:1537152:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000040:20.0:1773851881.489697:0:1537152:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:20.0:1773851881.489698:0:1537152:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851881.489699:0:1537152:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851881.489700:0:1537152:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.489701:0:1537152:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.489703:0:1537152:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851881.489705:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851881.489706:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851881.489706:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851881.489707:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851881.489708:0:1537152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 3084761
00000100:00000001:22.0:1773851881.489709:0:1537183:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.489709:0:1537152:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:22.0:1773851881.489710:0:1537183:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.489710:0:1537152:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956276480 : -106937753275136 : ffff9ebd9d33f500)
00000100:00000040:20.0:1773851881.489712:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a6d6306 x1858065608953920/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:20.0:1773851881.489716:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.489717:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851881.489719:0:1537152:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a6d6306 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52334:x1858065608953920:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:20.0:1773851881.489721:0:1537152:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608953920
00000020:00000001:20.0:1773851881.489722:0:1537152:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851881.489723:0:1537152:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851881.489724:0:1537152:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.489731:0:1537152:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851881.489732:0:1537152:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:20.0:1773851881.489734:0:1537152:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851881.489734:0:1537152:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851881.489735:0:1537152:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851881.489736:0:1537152:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851881.489737:0:1537152:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.489738:0:1537152:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851881.489739:0:1537152:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851881.489741:0:1537152:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000001b010f7a.
02000000:00000001:20.0:1773851881.489742:0:1537152:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.489743:0:1537152:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851881.489745:0:1537152:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:20.0:1773851881.489745:0:1537152:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:20.0:1773851881.489746:0:1537152:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:20.0:1773851881.489748:0:1537152:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 82575360 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:20.0:1773851881.489750:0:1537152:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132277 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:20.0:1773851881.489752:0:1537152:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851881.489754:0:1537152:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608953920
00010000:00000001:20.0:1773851881.489755:0:1537152:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851881.489756:0:1537152:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008a6d6306 x1858065608953920/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:20.0:1773851881.489760:0:1537152:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851881.489761:0:1537152:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851881.489762:0:1537152:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=105 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851881.489764:0:1537152:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851881.489765:0:1537152:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:20.0:1773851881.489766:0:1537152:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:20.0:1773851881.489768:0:1537152:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851881.489769:0:1537152:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.489770:0:1537152:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851881.489771:0:1537152:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:20.0:1773851881.489772:0:1537152:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000408d3b17.
00000100:00000200:20.0:1773851881.489773:0:1537152:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608953920, offset 224
00000400:00000200:20.0:1773851881.489776:0:1537152:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:20.0:1773851881.489777:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851881.489779:0:1537152:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:20.0:1773851881.489781:0:1537152:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851881.489783:0:1537152:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:20.0:1773851881.489785:0:1537152:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13@kfi7 local destination
00000400:00000200:20.0:1773851881.489787:0:1537152:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769700:8769700:1024:4294967295] 13@kfi7 LPNI seq info [23133321:23133321:16:4294967295]
00000400:00000200:20.0:1773851881.489790:0:1537152:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851881.489791:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851881.489794:0:1537152:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851881.489796:0:1537152:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:20.0:1773851881.489798:0:1537152:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851881.489800:0:1537152:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:20.0:1773851881.489804:0:1537152:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851881.489808:0:1537152:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c Using peer 13@kfi7(0x20000000000095c)
00000800:00000200:20.0:1773851881.489812:0:1537152:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 468 bytes to peer 0x20000000000095c: rc=0
00000800:00000200:20.0:1773851881.489815:0:1537152:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851881.489818:0:1537152:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.489819:0:1537152:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:20.0:1773851881.489821:0:1537152:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851881.489822:0:1537152:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.489823:0:1537152:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851881.489824:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a6d6306 x1858065608953920/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:20.0:1773851881.489829:0:1537152:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a6d6306 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52334:x1858065608953920:12345-13@kfi7:41:default-yuba3-0 Request processed in 112us (159us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851881.489833:0:1537152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 3084761
00000100:00000040:20.0:1773851881.489836:0:1537152:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000100:00000001:20.0:1773851881.489837:0:1537152:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851881.489838:0:1537152:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851881.489839:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.489840:0:1537152:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851881.489842:0:1537152:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851881.489843:0:1537152:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:20.0:1773851881.489844:0:1537152:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851881.489851:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851881.489854:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851881.489855:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000400:00000200:21.0:1773851881.489857:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000408d3b17
00000400:00000010:21.0:1773851881.489858:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000408d3b17.
00000100:00000001:21.0:1773851881.489859:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851881.489860:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851881.489862:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:21.0:1773851881.489864:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c Transaction freed
00000800:00000200:9.0:1773851881.504611:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851881.504613:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851881.504615:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851881.504619:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851881.504622:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851881.504625:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.13@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851881.504627:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851881.504628:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851881.504631:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.13@o2ib60 to cpt 6
00000400:00000200:9.0:1773851881.504632:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 2
00000400:00000200:9.0:1773851881.504635:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 3
00000400:00000200:9.0:1773851881.504637:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.13@o2ib60 to cpt 6
00000400:00000200:9.0:1773851881.504639:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.13@o2ib60 of length 456 into portal 12 MB=0x69b23f5816c80
00000400:00000200:9.0:1773851881.504642:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.13@o2ib60 of length 456/456 into md 0x16159c9699 [64] + 27256
00000800:00000200:9.0:1773851881.504647:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851881.504650:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851881.504651:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851881.504653:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851881.504654:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851881.504657:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d5b4cb35.
00000100:00000040:9.0:1773851881.504658:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d5b4cb35 x1859428605324416 msgsize 456
00000100:00100000:9.0:1773851881.504661:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.13@o2ib60 (source: 12345-192.168.128.13@o2ib60)
00000100:00000001:9.0:1773851881.504664:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851881.504666:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:27.0:1773851881.504668:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851881.504668:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851881.504670:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851881.504670:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851881.504671:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851881.504673:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851881.504674:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859428605324416
00000020:00000001:27.0:1773851881.504675:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851881.504676:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b94c646a1
00000020:00000001:27.0:1773851881.504677:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851881.504679:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000326b1e3c refcount=5
00000020:00000001:27.0:1773851881.504684:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637122381626368 : -106951327925248 : ffff9eba74173c00)
00000020:00000001:27.0:1773851881.504686:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637122381626368 : -106951327925248 : ffff9eba74173c00)
00000100:00000001:27.0:1773851881.504688:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.504690:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851881.504691:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005efb579a.
00000020:00000010:27.0:1773851881.504693:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851881.504694:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851881.504695:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851881.504696:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851881.504697:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.504699:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.504701:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851881.504703:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851881.504704:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851881.504704:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851881.504704:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851881.504706:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.13@o2ib60, seq: 1451911036
00000100:00000040:27.0:1773851881.504707:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000326b1e3c : new rpc_count 1
00000100:00000001:26.0:1773851881.504708:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.504709:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162657024 : -106971546894592 : ffff9eb5bef23f00)
00000100:00000001:26.0:1773851881.504709:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.504711:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d5b4cb35 x1859428605324416/t0(0) o17->ccc82350-18ee-45d9-ab27-98645d1b8106@192.168.128.13@o2ib60:162/0 lens 456/0 e 0 to 0 dl 1773852277 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-matrix13-0'
00000100:00000001:27.0:1773851881.504717:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.504718:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851881.504719:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5b4cb35 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ccc82350-18ee-45d9-ab27-98645d1b8106+5:39825:x1859428605324416:12345-192.168.128.13@o2ib60:17:default-matrix13-0
00000100:00000200:27.0:1773851881.504722:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859428605324416
00000020:00000001:27.0:1773851881.504723:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851881.504724:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851881.504732:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.504733:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851881.504734:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:27.0:1773851881.504736:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851881.504737:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859428605324416, found 0 last_xid 1859428605324415
00000020:00000001:27.0:1773851881.504738:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851881.504740:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851881.504741:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851881.504742:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851881.504743:0:41182:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:27.0:1773851881.504745:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851881.504745:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851881.504747:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000006f63468a.
02000000:00000001:27.0:1773851881.504748:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.504749:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.504751:0:41182:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:27.0:1773851881.504752:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:27.0:1773851881.504753:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:27.0:1773851881.504755:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.504756:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:27.0:1773851881.504757:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli ccc82350-18ee-45d9-ab27-98645d1b8106/00000000326b1e3c free: 126633370845184 avail: 126633368748032
00000020:00000001:27.0:1773851881.504759:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:27.0:1773851881.504760:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli ccc82350-18ee-45d9-ab27-98645d1b8106/00000000326b1e3c avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:27.0:1773851881.504762:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:27.0:1773851881.504764:0:41182:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:27.0:1773851881.504765:0:41182:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli ccc82350-18ee-45d9-ab27-98645d1b8106/00000000326b1e3c reports grant 1812725759 dropped 0, local 1880883199
00000020:00000001:27.0:1773851881.504767:0:41182:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:27.0:1773851881.504768:0:41182:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:27.0:1773851881.504768:0:41182:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851881.504770:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181753912660, transno 0, xid 1859428605324416
00010000:00000001:27.0:1773851881.504771:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851881.504772:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d5b4cb35 x1859428605324416/t0(0) o17->ccc82350-18ee-45d9-ab27-98645d1b8106@192.168.128.13@o2ib60:162/0 lens 456/432 e 0 to 0 dl 1773852277 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-matrix13-0'
00010000:00000001:27.0:1773851881.504777:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851881.504778:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851881.504779:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=114 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851881.504781:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851881.504783:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004057d3fb refcount 3 to 192.168.128.13@o2ib60
00000100:00000001:27.0:1773851881.504784:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858688 : -107149578692928 : ffff9e8c4b6c96c0)
02000000:00000001:27.0:1773851881.504786:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851881.504787:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.504788:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851881.504789:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.13@o2ib60
00000400:00000010:27.0:1773851881.504791:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008bb3da7f.
00000100:00000200:27.0:1773851881.504792:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859428605324416, offset 224
00000400:00000200:27.0:1773851881.504795:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.13@o2ib60
00000400:00000200:27.0:1773851881.504797:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.13@o2ib60 to cpt 6
00000400:00000200:27.0:1773851881.504799:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 2
00000400:00000200:27.0:1773851881.504801:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 3
00000400:00000200:27.0:1773851881.504803:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 4
00000400:00000200:27.0:1773851881.504805:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.13@o2ib60 routed destination
00000400:00000200:27.0:1773851881.504807:0:41182:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:27.0:1773851881.504809:0:41182:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:27.0:1773851881.504811:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.13@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851881.504813:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:27.0:1773851881.504815:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.13@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851881.504816:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:27.0:1773851881.504818:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769701:8769701:1024:4294967295] 17@kfi7 LPNI seq info [1250891912:1250891912:16:4294967295]
00000400:00000200:27.0:1773851881.504820:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:27.0:1773851881.504822:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:27.0:1773851881.504826:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.13@o2ib60(192.168.128.13@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851881.504829:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002f442be5 nid 192.168.128.13@o2ib60 refs 3
00000800:00000200:27.0:1773851881.504832:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851881.504834:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:27.0:1773851881.504838:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851881.504842:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:27.0:1773851881.504847:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 532 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:27.0:1773851881.504850:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851881.504854:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.504855:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004057d3fb refcount 2 to 192.168.128.13@o2ib60
00010000:00000001:27.0:1773851881.504857:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851881.504857:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.504858:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851881.504861:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d5b4cb35 x1859428605324416/t0(0) o17->ccc82350-18ee-45d9-ab27-98645d1b8106@192.168.128.13@o2ib60:162/0 lens 456/432 e 0 to 0 dl 1773852277 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-matrix13-0'
00000800:00000200:25.0:1773851881.504863:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851881.504866:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851881.504867:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5b4cb35 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ccc82350-18ee-45d9-ab27-98645d1b8106+5:39825:x1859428605324416:12345-192.168.128.13@o2ib60:17:default-matrix13-0 Request processed in 148us (207us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851881.504867:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:25.0:1773851881.504869:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008bb3da7f
00000400:00000010:25.0:1773851881.504870:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008bb3da7f.
00000100:00100000:27.0:1773851881.504871:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.13@o2ib60, seq: 1451911036
00000100:00000001:25.0:1773851881.504871:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851881.504872:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:27.0:1773851881.504873:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000326b1e3c : new rpc_count 0
00000400:00000200:25.0:1773851881.504873:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:27.0:1773851881.504874:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851881.504875:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851881.504876:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000800:00000200:25.0:1773851881.504876:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000001a Transaction freed
00000020:00000010:27.0:1773851881.504877:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851881.504878:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005efb579a.
00000020:00000040:27.0:1773851881.504879:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000326b1e3c : new refcount 4
00000100:00000001:27.0:1773851881.504881:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851881.550723:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851881.550732:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851881.550734:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851881.550738:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851881.550741:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24976@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.550744:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24976@kfi7 : PUT - for me
00000400:00000200:21.0:1773851881.550745:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24976@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.550747:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029f2339c nid 24976@kfi7 refs 1
00000400:00000200:21.0:1773851881.550749:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24976@kfi7 to cpt 5
00000400:00000200:21.0:1773851881.550750:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029f2339c nid 24976@kfi7 refs 2
00000400:00000200:21.0:1773851881.550752:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000029f2339c nid 24976@kfi7 refs 3
00000400:00000200:21.0:1773851881.550754:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24977@kfi7 to cpt 1
00000400:00000200:21.0:1773851881.550755:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24977@kfi7 of length 224 into portal 12 MB=0x69b4cf38bbc40
00000400:00000200:21.0:1773851881.550758:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24977@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 50576
00000800:00000200:21.0:1773851881.550761:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851881.550764:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851881.550766:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24976@kfi7: PUT: OK
00000100:00000001:21.0:1773851881.550768:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851881.550768:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851881.550770:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004cbf2019.
00000100:00000040:21.0:1773851881.550771:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000004cbf2019 x1859604666104896 msgsize 224
00000100:00100000:21.0:1773851881.550773:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24977@kfi7 (source: 12345-24976@kfi7)
00000100:00000001:21.0:1773851881.550775:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851881.550777:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000029f2339c nid 24976@kfi7 refs 2
00000100:00000001:20.0:1773851881.550777:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851881.550778:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851881.550779:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851881.550779:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851881.550779:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851881.550781:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851881.550782:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859604666104896
00000020:00000001:20.0:1773851881.550783:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851881.550784:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7de4d
00000020:00000001:20.0:1773851881.550785:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851881.550788:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000131a0fdc refcount=5
00000020:00000001:20.0:1773851881.550789:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111503897600 : -106962205654016 : ffff9eb7ebba4400)
00000020:00000001:20.0:1773851881.550790:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111503897600 : -106962205654016 : ffff9eb7ebba4400)
00000100:00000001:20.0:1773851881.550792:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.550793:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851881.550794:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851881.550795:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.550796:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851881.550798:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851881.550799:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851881.550800:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851881.550801:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851881.550802:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851881.550803:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.550804:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851881.550806:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851881.550807:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851881.550807:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851881.550808:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851881.550809:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24977@kfi7, seq: 1998024
00000100:00000001:23.0:1773851881.550811:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.550811:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000131a0fdc : new rpc_count 1
00000100:00000001:23.0:1773851881.550812:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.550812:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956254592 : -106937753297024 : ffff9ebd9d339f80)
00000100:00000040:20.0:1773851881.550814:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004cbf2019 x1859604666104896/t0(0) o400->5f2ec2cf-4783-4c55-95b7-44244db39e8b@24977@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2050-0'
00000100:00000001:20.0:1773851881.550818:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.550819:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851881.550820:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004cbf2019 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:5f2ec2cf-4783-4c55-95b7-44244db39e8b+5:39567:x1859604666104896:12345-24977@kfi7:400:default-tuolumne2050-0
00000100:00000200:20.0:1773851881.550822:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859604666104896
00000020:00000001:20.0:1773851881.550823:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851881.550824:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851881.550825:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.550826:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851881.550827:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851881.550828:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851881.550829:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859604666104896, found 0 last_xid 1859604666104895
00000020:00000001:20.0:1773851881.550830:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851881.550831:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851881.550832:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851881.550833:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.550834:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851881.550835:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851881.550835:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851881.550836:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dad9de51.
02000000:00000001:20.0:1773851881.550837:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.550838:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.550839:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851881.550840:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260566051, transno 0, xid 1859604666104896
00010000:00000001:20.0:1773851881.550842:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851881.550843:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004cbf2019 x1859604666104896/t0(0) o400->5f2ec2cf-4783-4c55-95b7-44244db39e8b@24977@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2050-0'
00010000:00000001:20.0:1773851881.550847:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851881.550848:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851881.550850:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=114 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851881.550851:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851881.550852:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000fe31545 refcount 3 to 24977@kfi7
00000100:00000001:20.0:1773851881.550854:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231611936 : -107130477939680 : ffff9e90bdeaf420)
02000000:00000001:20.0:1773851881.550855:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851881.550856:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.550857:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851881.550858:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24976@kfi7
00000400:00000010:20.0:1773851881.550859:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c6b46a6.
00000100:00000200:20.0:1773851881.550860:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859604666104896, offset 224
00000400:00000200:20.0:1773851881.550862:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24976@kfi7
00000400:00000200:20.0:1773851881.550863:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24976@kfi7 to cpt 5
00000400:00000200:20.0:1773851881.550865:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029f2339c nid 24976@kfi7 refs 1
00000400:00000200:20.0:1773851881.550866:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000029f2339c nid 24976@kfi7 refs 2
00000400:00000200:20.0:1773851881.550868:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000029f2339c nid 24976@kfi7 refs 3
00000400:00000200:20.0:1773851881.550870:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24976@kfi7 local destination
00000400:00000200:20.0:1773851881.550872:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769702:8769702:1024:4294967295] 24976@kfi7 LPNI seq info [508029:508029:16:4294967295]
00000400:00000200:20.0:1773851881.550874:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000029f2339c nid 24976@kfi7 refs 2
00000400:00000200:20.0:1773851881.550875:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24976@kfi7 to cpt 5
00000400:00000200:20.0:1773851881.550879:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24976@kfi7(24976@kfi7:24976@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851881.550880:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000029f2339c nid 24976@kfi7 refs 3
00000800:00000200:20.0:1773851881.550883:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851881.550884:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851881.550888:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851881.550892:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x11ec Using peer 24976@kfi7(0x11ec)
00000800:00000200:20.0:1773851881.550896:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x11ec: rc=0
00000800:00000200:20.0:1773851881.550898:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x11ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851881.550905:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.550908:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000fe31545 refcount 2 to 24977@kfi7
00010000:00000001:20.0:1773851881.550910:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851881.550910:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.550911:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851881.550913:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004cbf2019 x1859604666104896/t0(0) o400->5f2ec2cf-4783-4c55-95b7-44244db39e8b@24977@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2050-0'
00000100:00100000:20.0:1773851881.550918:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004cbf2019 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:5f2ec2cf-4783-4c55-95b7-44244db39e8b+5:39567:x1859604666104896:12345-24977@kfi7:400:default-tuolumne2050-0 Request processed in 99us (146us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851881.550922:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24977@kfi7, seq: 1998024
00000100:00000040:20.0:1773851881.550923:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000131a0fdc : new rpc_count 0
00000100:00000001:20.0:1773851881.550925:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851881.550925:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851881.550926:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.550927:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851881.550929:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851881.550930:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000131a0fdc : new refcount 4
00000100:00000001:20.0:1773851881.550932:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851881.550939:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x11ec TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851881.550942:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851881.550944:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24976@kfi7: PUT: OK
00000400:00000200:21.0:1773851881.550945:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c6b46a6
00000400:00000010:21.0:1773851881.550946:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c6b46a6.
00000100:00000001:21.0:1773851881.550947:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851881.550947:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851881.550949:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000029f2339c nid 24976@kfi7 refs 2
00000800:00000200:21.0:1773851881.550951:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 24976@kfi7(000000006aa10d24):0x0 lsk 4589 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x11ec Transaction freed
00000800:00000200:25.0:1773851881.560892:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851881.560893:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851881.560895:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851881.560897:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851881.560899:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.560900:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24827@kfi7 : PUT - for me
00000400:00000200:25.0:1773851881.560901:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.560902:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 1
00000400:00000200:25.0:1773851881.560903:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.560903:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000400:00000200:25.0:1773851881.560904:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 3
00000400:00000200:25.0:1773851881.560906:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24826@kfi7 to cpt 3
00000400:00000200:25.0:1773851881.560907:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24826@kfi7 of length 224 into portal 12 MB=0x699de8d44c200
00000400:00000200:25.0:1773851881.560908:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24826@kfi7 of length 224/224 into md 0x16159c9699 [64] + 27712
00000800:00000200:25.0:1773851881.560910:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851881.560912:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851881.560913:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24827@kfi7: PUT: OK
00000100:00000001:25.0:1773851881.560914:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851881.560914:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851881.560915:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a37c4d1.
00000100:00000040:25.0:1773851881.560916:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000002a37c4d1 x1858030992146944 msgsize 224
00000100:00100000:25.0:1773851881.560917:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24826@kfi7 (source: 12345-24827@kfi7)
00000100:00000001:25.0:1773851881.560918:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851881.560919:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000100:00000001:27.0:1773851881.560920:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851881.560920:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851881.560921:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851881.560921:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851881.560921:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851881.560922:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851881.560923:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030992146944
00000020:00000001:27.0:1773851881.560923:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851881.560924:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910d9
00000020:00000001:27.0:1773851881.560924:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851881.560925:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d8addc6d refcount=6
00000020:00000001:27.0:1773851881.560926:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240335360 : -107152469216256 : ffff9e8b9f22b400)
00000020:00000001:27.0:1773851881.560927:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240335360 : -107152469216256 : ffff9e8b9f22b400)
00000100:00000001:27.0:1773851881.560928:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.560929:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851881.560930:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005efb579a.
00000020:00000010:27.0:1773851881.560931:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851881.560931:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851881.560932:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851881.560933:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851881.560933:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851881.560934:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851881.560934:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851881.560935:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.560936:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851881.560937:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851881.560937:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851881.560937:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851881.560937:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851881.560938:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24826@kfi7, seq: 2025145
00000100:00000040:27.0:1773851881.560939:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d8addc6d : new rpc_count 1
00000100:00000001:26.0:1773851881.560939:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.560940:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252470784 : -106967457080832 : ffff9eb6b2b7da00)
00000100:00000001:26.0:1773851881.560940:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.560941:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002a37c4d1 x1858030992146944/t0(0) o400->403d9fd1-8ccc-4a61-bd32-22f71300cddc@24826@kfi7:131/0 lens 224/0 e 0 to 0 dl 1773852246 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne265-0'
00000100:00000001:27.0:1773851881.560944:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.560944:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851881.560945:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a37c4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:403d9fd1-8ccc-4a61-bd32-22f71300cddc+6:47847:x1858030992146944:12345-24826@kfi7:400:default-tuolumne265-0
00000100:00000200:27.0:1773851881.560947:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030992146944
00000020:00000001:27.0:1773851881.560948:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851881.560948:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851881.560949:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.560950:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851881.560950:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851881.560951:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851881.560952:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030992146944, found 0 last_xid 1858030992146943
00000020:00000001:27.0:1773851881.560953:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851881.560954:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851881.560955:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851881.560956:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.560956:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851881.560957:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851881.560957:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851881.560959:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b3096835.
02000000:00000001:27.0:1773851881.560959:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.560960:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.560961:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851881.560961:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030992146944
00010000:00000001:27.0:1773851881.560962:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851881.560963:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002a37c4d1 x1858030992146944/t0(0) o400->403d9fd1-8ccc-4a61-bd32-22f71300cddc@24826@kfi7:131/0 lens 224/224 e 0 to 0 dl 1773852246 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne265-0'
00010000:00000001:27.0:1773851881.560965:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851881.560966:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851881.560966:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=114 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851881.560968:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851881.560968:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b3d5deb2 refcount 5 to 24826@kfi7
00000100:00000001:27.0:1773851881.560969:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015834496 : -107152693717120 : ffff9e8b91c11780)
02000000:00000001:27.0:1773851881.560970:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851881.560970:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.560971:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851881.560972:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24827@kfi7
00000400:00000010:27.0:1773851881.560972:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cedf447c.
00000100:00000200:27.0:1773851881.560973:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030992146944, offset 224
00000400:00000200:27.0:1773851881.560975:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24827@kfi7
00000400:00000200:27.0:1773851881.560975:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:27.0:1773851881.560976:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 1
00000400:00000200:27.0:1773851881.560977:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000400:00000200:27.0:1773851881.560978:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 3
00000400:00000200:27.0:1773851881.560979:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24827@kfi7 local destination
00000400:00000200:27.0:1773851881.560981:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769703:8769703:1024:4294967295] 24827@kfi7 LPNI seq info [28029:28029:16:4294967295]
00000400:00000200:27.0:1773851881.560982:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000400:00000200:27.0:1773851881.560983:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24827@kfi7 to cpt 6
00000400:00000200:27.0:1773851881.560985:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24827@kfi7(24827@kfi7:24827@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851881.560986:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 3
00000800:00000200:27.0:1773851881.560988:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851881.560988:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851881.560991:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851881.560993:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x371 Using peer 24827@kfi7(0x371)
00000800:00000200:27.0:1773851881.560996:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x371: rc=0
00000800:00000200:27.0:1773851881.560997:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x371 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851881.560999:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.561000:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b3d5deb2 refcount 4 to 24826@kfi7
00010000:00000001:27.0:1773851881.561001:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851881.561001:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.561002:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851881.561003:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a37c4d1 x1858030992146944/t0(0) o400->403d9fd1-8ccc-4a61-bd32-22f71300cddc@24826@kfi7:131/0 lens 224/224 e 0 to 0 dl 1773852246 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne265-0'
00000100:00100000:27.0:1773851881.561006:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a37c4d1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:403d9fd1-8ccc-4a61-bd32-22f71300cddc+6:47847:x1858030992146944:12345-24826@kfi7:400:default-tuolumne265-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851881.561008:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24826@kfi7, seq: 2025145
00000100:00000040:27.0:1773851881.561009:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d8addc6d : new rpc_count 0
00000800:00000200:25.0:1773851881.561009:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x371 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851881.561010:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851881.561010:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851881.561010:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851881.561011:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851881.561011:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000020:00000010:27.0:1773851881.561012:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005efb579a.
00000400:00000200:25.0:1773851881.561012:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24827@kfi7: PUT: OK
00000400:00000200:25.0:1773851881.561012:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cedf447c
00000020:00000040:27.0:1773851881.561013:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000d8addc6d : new refcount 5
00000100:00000001:27.0:1773851881.561013:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851881.561013:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cedf447c.
00000100:00000001:25.0:1773851881.561014:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851881.561014:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851881.561015:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003449b5a6 nid 24827@kfi7 refs 2
00000800:00000200:25.0:1773851881.561016:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 24827@kfi7(0000000045d2d861):0x0 lsk 882 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x371 Transaction freed
00010000:00000001:2.0:1773851881.609732:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609733:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851881.609734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851881.609735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851881.609736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851881.609737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851881.609739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851881.609740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851881.609741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851881.609741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851881.609744:0:41154:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851881.609745:0:41154:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851881.609746:0:41154:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851881.688927:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851881.688930:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851881.688931:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851881.688933:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851881.688934:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.688936:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851881.688937:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.688937:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851881.688938:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.688939:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:25.0:1773851881.688940:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851881.688941:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851881.688941:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 224 into portal 12 MB=0x699e0ee250d40
00000400:00000200:25.0:1773851881.688943:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-42@kfi7 of length 224/224 into md 0x16159c9699 [64] + 27936
00000800:00000200:25.0:1773851881.688944:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851881.688946:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851881.688947:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851881.688948:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851881.688948:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851881.688949:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc528e99.
00000100:00000040:25.0:1773851881.688950:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bc528e99 x1858041207393600 msgsize 224
00000100:00100000:25.0:1773851881.688951:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-42@kfi7 (source: 12345-42@kfi7)
00000100:00000001:25.0:1773851881.688952:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851881.688953:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:27.0:1773851881.688954:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851881.688954:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851881.688955:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851881.688955:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851881.688955:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851881.688956:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851881.688957:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041207393600
00000020:00000001:27.0:1773851881.688957:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851881.688957:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb2cea
00000020:00000001:27.0:1773851881.688958:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851881.688959:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005e28aac5 refcount=5
00000020:00000001:27.0:1773851881.688960:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636938913763328 : -107134795788288 : ffff9e8fbc8dd000)
00000020:00000001:27.0:1773851881.688961:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636938913763328 : -107134795788288 : ffff9e8fbc8dd000)
00000100:00000001:27.0:1773851881.688962:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.688963:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851881.688963:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000052694ebb.
00000020:00000010:27.0:1773851881.688964:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851881.688965:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851881.688965:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851881.688966:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851881.688966:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851881.688967:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851881.688967:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851881.688967:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.688968:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851881.688969:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851881.688969:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851881.688970:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-42@kfi7, seq: 2025146
00000100:00000040:27.0:1773851881.688971:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005e28aac5 : new rpc_count 1
00000100:00000001:26.0:1773851881.688971:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851881.688971:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851881.688972:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252456960 : -106967457094656 : ffff9eb6b2b7a400)
00000100:00000001:26.0:1773851881.688972:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.688973:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc528e99 x1858041207393600/t0(0) o400->lustre5-MDT0001-lwp-OST000b_UUID@42@kfi7:131/0 lens 224/0 e 0 to 0 dl 1773852246 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba112-0'
00000100:00000001:26.0:1773851881.688974:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.688975:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.688976:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851881.688977:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc528e99 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-lwp-OST000b_UUID+5:272640:x1858041207393600:12345-42@kfi7:400:default-yuba112-0
00000100:00000200:27.0:1773851881.688978:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041207393600
00000020:00000001:27.0:1773851881.688979:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851881.688979:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851881.688980:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.688980:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851881.688981:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851881.688981:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:27.0:1773851881.688982:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851881.688982:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851881.688983:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851881.688983:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.688984:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851881.688984:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851881.688985:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851881.688985:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003bfd905f.
02000000:00000001:27.0:1773851881.688986:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.688986:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.688987:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851881.688987:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041207393600
00010000:00000001:27.0:1773851881.688988:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851881.688989:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc528e99 x1858041207393600/t0(0) o400->lustre5-MDT0001-lwp-OST000b_UUID@42@kfi7:131/0 lens 224/224 e 0 to 0 dl 1773852246 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba112-0'
00010000:00000001:27.0:1773851881.688991:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851881.688991:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851881.688992:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=114 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851881.688993:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851881.688994:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a922f980 refcount 7 to 42@kfi7
00000100:00000001:27.0:1773851881.688994:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985418016 : -107156724133600 : ffff9e8aa185d120)
02000000:00000001:27.0:1773851881.688995:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851881.688995:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.688996:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851881.688997:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:27.0:1773851881.688998:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000086885a67.
00000100:00000200:27.0:1773851881.688998:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041207393600, offset 224
00000400:00000200:27.0:1773851881.689000:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:27.0:1773851881.689001:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:27.0:1773851881.689001:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:27.0:1773851881.689002:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:27.0:1773851881.689003:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:27.0:1773851881.689004:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  42@kfi7 local destination
00000400:00000200:27.0:1773851881.689006:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769704:8769704:1024:4294967295] 42@kfi7 LPNI seq info [5404900:5404900:16:4294967295]
00000400:00000200:27.0:1773851881.689007:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:27.0:1773851881.689007:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:27.0:1773851881.689010:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851881.689011:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000800:00000200:27.0:1773851881.689012:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851881.689013:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851881.689015:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851881.689017:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000183 Using peer 42@kfi7(0x200000000000183)
00000800:00000200:27.0:1773851881.689019:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0x200000000000183: rc=0
00000800:00000200:27.0:1773851881.689020:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000183 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851881.689022:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.689023:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a922f980 refcount 6 to 42@kfi7
00010000:00000001:27.0:1773851881.689023:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851881.689024:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.689024:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851881.689025:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc528e99 x1858041207393600/t0(0) o400->lustre5-MDT0001-lwp-OST000b_UUID@42@kfi7:131/0 lens 224/224 e 0 to 0 dl 1773852246 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba112-0'
00000100:00100000:27.0:1773851881.689028:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc528e99 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-lwp-OST000b_UUID+5:272640:x1858041207393600:12345-42@kfi7:400:default-yuba112-0 Request processed in 52us (77us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851881.689032:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-42@kfi7, seq: 2025146
00000100:00000040:27.0:1773851881.689033:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005e28aac5 : new rpc_count 0
00000100:00000001:27.0:1773851881.689034:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851881.689034:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851881.689034:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000800:00000200:25.0:1773851881.689034:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000183 TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851881.689035:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851881.689035:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851881.689036:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000052694ebb.
00000020:00000040:27.0:1773851881.689036:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000005e28aac5 : new refcount 4
00000400:00000200:25.0:1773851881.689036:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000100:00000001:27.0:1773851881.689037:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851881.689037:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000086885a67
00000400:00000010:25.0:1773851881.689037:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000086885a67.
00000100:00000001:25.0:1773851881.689038:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851881.689038:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851881.689038:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:25.0:1773851881.689039:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000183 Transaction freed
00000800:00000200:29.0:1773851881.709717:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851881.709718:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851881.709719:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851881.709722:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851881.709724:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14643@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.709728:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14643@kfi7 : PUT - for me
00000400:00000200:29.0:1773851881.709729:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14643@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.709730:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fdab3ca nid 14643@kfi7 refs 1
00000400:00000200:29.0:1773851881.709732:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14643@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.709732:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fdab3ca nid 14643@kfi7 refs 2
00000400:00000200:29.0:1773851881.709733:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005fdab3ca nid 14643@kfi7 refs 3
00000400:00000200:29.0:1773851881.709734:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14834@kfi7 to cpt 6
00000400:00000200:29.0:1773851881.709735:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14834@kfi7 of length 224 into portal 12 MB=0x699e10eb5a440
00000400:00000200:29.0:1773851881.709736:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14834@kfi7 of length 224/224 into md 0x77fe139dd [64] + 189928
00000800:00000200:29.0:1773851881.709738:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851881.709740:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851881.709742:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14643@kfi7: PUT: OK
00000100:00000001:29.0:1773851881.709742:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851881.709743:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851881.709744:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d90c76df.
00000100:00000040:29.0:1773851881.709745:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000d90c76df x1858041753740352 msgsize 224
00000100:00100000:29.0:1773851881.709746:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-14834@kfi7 (source: 12345-14643@kfi7)
00000100:00000001:29.0:1773851881.709747:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851881.709748:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005fdab3ca nid 14643@kfi7 refs 2
00000800:00000200:29.0:1773851881.709750:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851881.709752:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851881.709753:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851881.709753:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851881.709754:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851881.709755:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851881.709756:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041753740352
00000020:00000001:29.0:1773851881.709756:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851881.709757:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d82
00000020:00000001:29.0:1773851881.709757:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851881.709761:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dfd94642 refcount=780
00000020:00000001:29.0:1773851881.709762:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628504576 : -107123081047040 : ffff9e9276ce9400)
00000020:00000001:29.0:1773851881.709763:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628504576 : -107123081047040 : ffff9e9276ce9400)
00000100:00000001:29.0:1773851881.709764:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851881.709765:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851881.709765:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851881.709766:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851881.709767:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851881.709768:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851881.709768:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851881.709769:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851881.709770:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851881.709770:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851881.709771:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851881.709772:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851881.709773:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851881.709773:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851881.709774:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851881.709774:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851881.709775:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14834@kfi7, seq: 2055556
00000100:00000001:30.0:1773851881.709776:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851881.709776:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851881.709776:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dfd94642 : new rpc_count 16
00000100:00000001:29.0:1773851881.709776:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636955373912960 : -107118335638656 : ffff9e9391a7c380)
00000100:00000040:29.0:1773851881.709777:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d90c76df x1858041753740352/t0(0) o400->3bd4a035-19f8-423a-bfa5-462795c91e86@14834@kfi7:102/0 lens 224/0 e 0 to 0 dl 1773852217 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1401-0'
00000100:00000001:29.0:1773851881.709780:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851881.709780:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851881.709781:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d90c76df pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:3bd4a035-19f8-423a-bfa5-462795c91e86+780:39695:x1858041753740352:12345-14834@kfi7:400:default-tuolumne1401-0
00000100:00000200:29.0:1773851881.709783:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041753740352
00000020:00000001:29.0:1773851881.709784:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851881.709784:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851881.709785:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.709786:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851881.709786:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851881.709787:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851881.709788:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041753740352, found 0 last_xid 1858041747926527
00000020:00000001:29.0:1773851881.709788:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851881.709789:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851881.709790:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851881.709790:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.709791:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851881.709791:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851881.709792:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851881.709793:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002f4c3dac.
02000000:00000001:29.0:1773851881.709793:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851881.709794:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.709795:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851881.709795:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588009, transno 0, xid 1858041753740352
00010000:00000001:29.0:1773851881.709796:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851881.709797:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d90c76df x1858041753740352/t0(0) o400->3bd4a035-19f8-423a-bfa5-462795c91e86@14834@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1401-0'
00010000:00000001:29.0:1773851881.709800:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851881.709802:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851881.709803:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=114 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851881.709804:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851881.709805:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000001fab8f8 refcount 3 to 14834@kfi7
00000100:00000001:29.0:1773851881.709806:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313741888 : -107139395809728 : ffff9e8eaa5f0e40)
02000000:00000001:29.0:1773851881.709806:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851881.709807:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851881.709808:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851881.709809:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14643@kfi7
00000400:00000010:29.0:1773851881.709809:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb36d36b.
00000100:00000200:29.0:1773851881.709810:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041753740352, offset 224
00000400:00000200:29.0:1773851881.709812:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14643@kfi7
00000400:00000200:29.0:1773851881.709813:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14643@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.709814:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fdab3ca nid 14643@kfi7 refs 1
00000400:00000200:29.0:1773851881.709815:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005fdab3ca nid 14643@kfi7 refs 2
00000400:00000200:29.0:1773851881.709816:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005fdab3ca nid 14643@kfi7 refs 3
00000400:00000200:29.0:1773851881.709818:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14643@kfi7 local destination
00000400:00000200:29.0:1773851881.709819:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769705:8769705:1024:4294967295] 14643@kfi7 LPNI seq info [6656895:6656895:16:4294967295]
00000400:00000200:29.0:1773851881.709821:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005fdab3ca nid 14643@kfi7 refs 2
00000400:00000200:29.0:1773851881.709822:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14643@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.709824:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14643@kfi7(14643@kfi7:14643@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851881.709825:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005fdab3ca nid 14643@kfi7 refs 3
00000800:00000200:29.0:1773851881.709827:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851881.709828:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851881.709830:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851881.709833:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001131 Using peer 14643@kfi7(0x100000000001131)
00000800:00000200:29.0:1773851881.709837:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0x100000000001131: rc=0
00000800:00000200:29.0:1773851881.709839:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001131 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851881.709842:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851881.709843:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000001fab8f8 refcount 2 to 14834@kfi7
00010000:00000001:29.0:1773851881.709844:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851881.709845:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851881.709846:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851881.709846:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d90c76df x1858041753740352/t0(0) o400->3bd4a035-19f8-423a-bfa5-462795c91e86@14834@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1401-0'
00000100:00100000:29.0:1773851881.709850:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d90c76df pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:3bd4a035-19f8-423a-bfa5-462795c91e86+780:39695:x1858041753740352:12345-14834@kfi7:400:default-tuolumne1401-0 Request processed in 69us (104us total) trans 0 rc 0/0
00000800:00000200:31.0:1773851881.709853:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001131 TN_EVENT_TX_OK event status 0
00000100:00100000:29.0:1773851881.709853:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14834@kfi7, seq: 2055556
00000100:00000040:29.0:1773851881.709854:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dfd94642 : new rpc_count 15
00000400:00000200:31.0:1773851881.709855:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851881.709855:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851881.709855:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851881.709856:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:31.0:1773851881.709857:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14643@kfi7: PUT: OK
00000020:00000010:29.0:1773851881.709857:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000200:31.0:1773851881.709858:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb36d36b
00000020:00000010:29.0:1773851881.709858:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000400:00000010:31.0:1773851881.709859:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb36d36b.
00000100:00000001:31.0:1773851881.709859:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:29.0:1773851881.709859:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000dfd94642 : new refcount 779
00000100:00000001:29.0:1773851881.709859:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851881.709860:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851881.709861:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005fdab3ca nid 14643@kfi7 refs 2
00000800:00000200:31.0:1773851881.709863:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 14643@kfi7(000000002f45b86b):0x0 lsk 4402 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001131 Transaction freed
00000800:00000200:3.0:1773851881.730324:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851881.730324:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851881.730325:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851881.730325:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:3.0:1773851881.730326:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851881.730326:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:1.0:1773851881.730328:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 23681@kfi7(000000007a148860):0xa01 version: 2; local version 2; negotiated version: 2
00000800:00000200:3.0:1773851881.730329:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851881.730330:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 Using peer 23681@kfi7(0xa01)
00000400:00000200:3.0:1773851881.730331:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23681@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.730332:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23681@kfi7 : PUT - for me
00000400:00000200:3.0:1773851881.730333:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23681@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.730334:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d701baeb nid 23681@kfi7 refs 1
00000400:00000200:3.0:1773851881.730335:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23681@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.730336:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d701baeb nid 23681@kfi7 refs 2
00000400:00000200:3.0:1773851881.730337:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d701baeb nid 23681@kfi7 refs 3
00000400:00000200:3.0:1773851881.730338:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23680@kfi7 to cpt 5
00000400:00000200:1.0:1773851881.730338:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23681@kfi7 to cpt 0
00000400:00000200:3.0:1773851881.730339:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23680@kfi7 of length 224 into portal 12 MB=0x69b4c37e4a080
00000800:00000200:1.0:1773851881.730339:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 38 bytes to peer 0xa01: rc=0
00000400:00000200:3.0:1773851881.730341:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23680@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 41408
00000800:00000200:1.0:1773851881.730341:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:3.0:1773851881.730343:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851881.730345:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851881.730346:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23681@kfi7: PUT: OK
00000100:00000001:3.0:1773851881.730347:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851881.730347:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851881.730348:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c1b32ea8.
00000100:00000040:3.0:1773851881.730349:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000c1b32ea8 x1859601517813888 msgsize 224
00000100:00100000:3.0:1773851881.730351:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-23680@kfi7 (source: 12345-23681@kfi7)
00000100:00000001:3.0:1773851881.730353:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:1.0:1773851881.730353:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 TN_EVENT_TX_OK event status 0
00000400:00000200:3.0:1773851881.730354:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d701baeb nid 23681@kfi7 refs 2
00000100:00000001:0.0:1773851881.730354:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:3.0:1773851881.730355:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851881.730355:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851881.730355:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851881.730356:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 Transaction freed
00000100:00000001:0.0:1773851881.730356:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851881.730357:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851881.730357:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601517813888
00000020:00000001:0.0:1773851881.730358:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851881.730358:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7aa0c
00000020:00000001:0.0:1773851881.730359:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851881.730362:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000070c93f5c refcount=5
00000020:00000001:0.0:1773851881.730362:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165884731392 : -106907824820224 : ffff9ec49513f000)
00000020:00000001:0.0:1773851881.730363:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165884731392 : -106907824820224 : ffff9ec49513f000)
00000100:00000001:0.0:1773851881.730364:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851881.730365:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851881.730366:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851881.730367:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851881.730367:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851881.730368:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851881.730369:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851881.730369:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851881.730370:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851881.730370:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851881.730371:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851881.730372:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851881.730373:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851881.730373:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851881.730374:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851881.730374:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851881.730375:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23680@kfi7, seq: 1997595
00000100:00000001:1.0:1773851881.730376:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851881.730376:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851881.730376:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000070c93f5c : new rpc_count 1
00000100:00000001:0.0:1773851881.730376:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288705920 : -106964420845696 : ffff9eb767b11f80)
00000100:00000040:0.0:1773851881.730377:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c1b32ea8 x1859601517813888/t0(0) o400->340e632f-f615-4a09-abee-85d3da5ed6b9@23680@kfi7:521/0 lens 224/0 e 0 to 0 dl 1773852636 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1972-0'
00000100:00000001:0.0:1773851881.730380:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851881.730381:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851881.730382:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1b32ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:340e632f-f615-4a09-abee-85d3da5ed6b9+5:39461:x1859601517813888:12345-23680@kfi7:400:default-tuolumne1972-0
00000100:00000200:0.0:1773851881.730383:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601517813888
00000020:00000001:0.0:1773851881.730383:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851881.730384:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851881.730385:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.730385:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851881.730386:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851881.730386:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851881.730387:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601517813888, found 0 last_xid 1859601517813887
00000020:00000001:0.0:1773851881.730388:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851881.730388:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851881.730389:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851881.730389:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.730390:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851881.730390:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851881.730391:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851881.730392:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000019a5801c.
02000000:00000001:0.0:1773851881.730393:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851881.730393:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.730394:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851881.730395:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044109801, transno 0, xid 1859601517813888
00010000:00000001:0.0:1773851881.730395:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851881.730396:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c1b32ea8 x1859601517813888/t0(0) o400->340e632f-f615-4a09-abee-85d3da5ed6b9@23680@kfi7:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1972-0'
00010000:00000001:0.0:1773851881.730398:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851881.730399:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851881.730400:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=114 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851881.730401:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851881.730401:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e63288b4 refcount 3 to 23680@kfi7
00000100:00000001:0.0:1773851881.730402:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999947968 : -107156709603648 : ffff9e8aa26386c0)
02000000:00000001:0.0:1773851881.730403:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851881.730403:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851881.730404:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851881.730405:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23681@kfi7
00000400:00000010:0.0:1773851881.730406:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003e3aad49.
00000100:00000200:0.0:1773851881.730406:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601517813888, offset 224
00000400:00000200:0.0:1773851881.730408:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23681@kfi7
00000400:00000200:0.0:1773851881.730409:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23681@kfi7 to cpt 0
00000400:00000200:0.0:1773851881.730410:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d701baeb nid 23681@kfi7 refs 1
00000400:00000200:0.0:1773851881.730411:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d701baeb nid 23681@kfi7 refs 2
00000400:00000200:0.0:1773851881.730412:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d701baeb nid 23681@kfi7 refs 3
00000400:00000200:0.0:1773851881.730413:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23681@kfi7 local destination
00000400:00000200:0.0:1773851881.730414:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769706:8769706:1024:4294967295] 23681@kfi7 LPNI seq info [8416109:8416109:16:4294967295]
00000400:00000200:0.0:1773851881.730415:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d701baeb nid 23681@kfi7 refs 2
00000400:00000200:0.0:1773851881.730416:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23681@kfi7 to cpt 0
00000400:00000200:0.0:1773851881.730418:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23681@kfi7(23681@kfi7:23681@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851881.730419:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d701baeb nid 23681@kfi7 refs 3
00000800:00000200:0.0:1773851881.730420:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851881.730421:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851881.730423:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851881.730425:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 Using peer 23681@kfi7(0xa01)
00000800:00000200:0.0:1773851881.730428:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0xa01: rc=0
00000800:00000200:0.0:1773851881.730429:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851881.730431:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851881.730432:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e63288b4 refcount 2 to 23680@kfi7
00010000:00000001:0.0:1773851881.730432:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851881.730433:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.730434:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851881.730435:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c1b32ea8 x1859601517813888/t0(0) o400->340e632f-f615-4a09-abee-85d3da5ed6b9@23680@kfi7:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1972-0'
00000100:00100000:0.0:1773851881.730439:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1b32ea8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:340e632f-f615-4a09-abee-85d3da5ed6b9+5:39461:x1859601517813888:12345-23680@kfi7:400:default-tuolumne1972-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851881.730441:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23680@kfi7, seq: 1997595
00000100:00000040:0.0:1773851881.730441:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000070c93f5c : new rpc_count 0
00000100:00000001:0.0:1773851881.730442:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851881.730442:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851881.730443:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851881.730444:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851881.730444:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000020:00000040:0.0:1773851881.730445:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000070c93f5c : new refcount 4
00000100:00000001:0.0:1773851881.730446:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851881.730450:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851881.730452:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851881.730453:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23681@kfi7: PUT: OK
00000400:00000200:1.0:1773851881.730454:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003e3aad49
00000400:00000010:1.0:1773851881.730455:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003e3aad49.
00000100:00000001:1.0:1773851881.730455:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851881.730456:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851881.730457:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d701baeb nid 23681@kfi7 refs 2
00000800:00000200:1.0:1773851881.730458:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 23681@kfi7(000000007a148860):0x0 lsk 2562 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa01 Transaction freed
00000800:00000200:29.0:1773851881.742879:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851881.742880:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851881.742882:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851881.742885:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851881.742887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.742888:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2074@kfi7 : PUT - for me
00000400:00000200:29.0:1773851881.742889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.742890:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851881.742892:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.742892:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851881.742894:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851881.742895:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851881.742896:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee20440
00000400:00000200:29.0:1773851881.742898:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x77ec58b3d [256] + 21224
00000800:00000200:29.0:1773851881.742901:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851881.742903:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851881.742904:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000100:00000001:29.0:1773851881.742906:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851881.742907:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:29.0:1773851881.742909:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000152c46ae.
00000100:00000040:29.0:1773851881.742910:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000152c46ae x1858059204953152 msgsize 224
00000100:00100000:29.0:1773851881.742911:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2074@kfi7)
00000100:00000001:29.0:1773851881.742913:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851881.742914:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851881.742916:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851881.742919:0:41218:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851881.742922:0:41218:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851881.742922:0:41218:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851881.742923:0:41218:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851881.742924:0:41218:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851881.742925:0:41218:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204953152
00000020:00000001:28.0:1773851881.742926:0:41218:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851881.742927:0:41218:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:28.0:1773851881.742928:0:41218:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851881.742932:0:41218:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:28.0:1773851881.742933:0:41218:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:28.0:1773851881.742934:0:41218:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:28.0:1773851881.742936:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851881.742937:0:41218:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851881.742938:0:41218:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851881.742940:0:41218:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851881.742941:0:41218:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000040:28.0:1773851881.742943:0:41218:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:28.0:1773851881.742944:0:41218:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851881.742944:0:41218:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851881.742945:0:41218:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851881.742947:0:41218:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851881.742949:0:41218:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851881.742952:0:157090:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851881.742952:0:41218:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851881.742953:0:157090:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851881.742953:0:41218:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851881.742954:0:41218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 6571512
00000100:00000001:30.0:1773851881.742955:0:157090:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851881.742955:0:41218:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:30.0:1773851881.742956:0:157090:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851881.742956:0:41218:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637084837692288 : -106988871859328 : ffff9eb1b64c4380)
00000100:00000040:28.0:1773851881.742958:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000152c46ae x1858059204953152/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:28.0:1773851881.742962:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851881.742962:0:41218:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851881.742964:0:41218:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000152c46ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52355:x1858059204953152:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:28.0:1773851881.742966:0:41218:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204953152
00000020:00000001:28.0:1773851881.742968:0:41218:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851881.742969:0:41218:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851881.742969:0:41218:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851881.742970:0:41218:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851881.742971:0:41218:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:28.0:1773851881.742972:0:41218:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:28.0:1773851881.742973:0:41218:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851881.742974:0:41218:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851881.742974:0:41218:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851881.742976:0:41218:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851881.742977:0:41218:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851881.742977:0:41218:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851881.742978:0:41218:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000a09be9d1.
02000000:00000001:28.0:1773851881.742979:0:41218:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851881.742980:0:41218:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851881.742982:0:41218:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:28.0:1773851881.742984:0:41218:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:28.0:1773851881.742984:0:41218:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851881.742986:0:41218:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:28.0:1773851881.742988:0:41218:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:28.0:1773851881.742989:0:41218:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 82575360 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:28.0:1773851881.742991:0:41218:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132277 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:28.0:1773851881.742993:0:41218:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851881.742994:0:41218:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204953152
00010000:00000001:28.0:1773851881.742995:0:41218:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851881.742996:0:41218:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000152c46ae x1858059204953152/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:28.0:1773851881.743000:0:41218:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851881.743000:0:41218:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851881.743001:0:41218:0:(import.c:1951:at_measured()) add 1 to 00000000f04ba3b2 time=135 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851881.743003:0:41218:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851881.743004:0:41218:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:28.0:1773851881.743005:0:41218:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:28.0:1773851881.743006:0:41218:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851881.743007:0:41218:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851881.743009:0:41218:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851881.743010:0:41218:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:28.0:1773851881.743011:0:41218:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fbb7163e.
00000100:00000200:28.0:1773851881.743013:0:41218:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204953152, offset 224
00000400:00000200:28.0:1773851881.743015:0:41218:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:28.0:1773851881.743017:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851881.743018:0:41218:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:28.0:1773851881.743020:0:41218:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851881.743021:0:41218:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851881.743023:0:41218:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851881.743025:0:41218:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769707:8769707:1024:4294967295] 2074@kfi7 LPNI seq info [23425172:23425172:16:4294967295]
00000400:00000200:28.0:1773851881.743027:0:41218:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851881.743027:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851881.743030:0:41218:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851881.743032:0:41218:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:28.0:1773851881.743035:0:41218:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851881.743036:0:41218:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:28.0:1773851881.743040:0:41218:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851881.743042:0:41218:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Using peer 2074@kfi7(0x20000000000097e)
00000800:00000200:28.0:1773851881.743047:0:41218:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 468 bytes to peer 0x20000000000097e: rc=0
00000800:00000200:28.0:1773851881.743049:0:41218:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851881.743051:0:41218:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851881.743052:0:41218:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:28.0:1773851881.743053:0:41218:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851881.743055:0:41218:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851881.743056:0:41218:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851881.743056:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000152c46ae x1858059204953152/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:28.0:1773851881.743061:0:41218:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000152c46ae pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52355:x1858059204953152:12345-2074@kfi7:41:default-yuba4-0 Request processed in 98us (150us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851881.743063:0:41218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 6571512
00000100:00000040:28.0:1773851881.743064:0:41218:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:28.0:1773851881.743065:0:41218:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851881.743066:0:41218:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851881.743066:0:41218:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851881.743067:0:41218:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851881.743069:0:41218:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851881.743070:0:41218:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:28.0:1773851881.743071:0:41218:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851881.743076:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851881.743078:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851881.743079:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000400:00000200:29.0:1773851881.743080:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fbb7163e
00000400:00000010:29.0:1773851881.743081:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fbb7163e.
00000100:00000001:29.0:1773851881.743082:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851881.743082:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851881.743083:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851881.743085:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Transaction freed
00000800:00000200:18.0:1773851881.781827:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851881.781828:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851881.781830:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851881.781832:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851881.781834:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17810@kfi7 to cpt 4
00000400:00000200:18.0:1773851881.781835:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17810@kfi7 : PUT - for me
00000400:00000200:18.0:1773851881.781836:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17810@kfi7 to cpt 4
00000400:00000200:18.0:1773851881.781837:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ae0e19e nid 17810@kfi7 refs 1
00000400:00000200:18.0:1773851881.781838:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17810@kfi7 to cpt 4
00000400:00000200:18.0:1773851881.781839:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ae0e19e nid 17810@kfi7 refs 2
00000400:00000200:18.0:1773851881.781840:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002ae0e19e nid 17810@kfi7 refs 3
00000400:00000200:18.0:1773851881.781841:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17810@kfi7 to cpt 4
00000400:00000200:18.0:1773851881.781842:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17810@kfi7 of length 224 into portal 12 MB=0x69b81a61b4e00
00000400:00000200:18.0:1773851881.781843:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17810@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 30040
00000800:00000200:18.0:1773851881.781845:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851881.781847:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851881.781848:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17810@kfi7: PUT: OK
00000100:00000001:18.0:1773851881.781850:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851881.781850:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851881.781851:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000340e4ee5.
00000100:00000040:18.0:1773851881.781852:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000340e4ee5 x1859831000157696 msgsize 224
00000100:00100000:18.0:1773851881.781853:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-17810@kfi7 (source: 12345-17810@kfi7)
00000100:00000001:18.0:1773851881.781854:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851881.781856:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002ae0e19e nid 17810@kfi7 refs 2
00000800:00000200:18.0:1773851881.781857:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851881.781857:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851881.781858:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851881.781859:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851881.781860:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851881.781861:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851881.781862:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831000157696
00000020:00000001:17.0:1773851881.781863:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851881.781863:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce5c39d
00000020:00000001:17.0:1773851881.781864:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851881.781867:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000014ee665f refcount=5
00000020:00000001:17.0:1773851881.781868:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127408780288 : -106946300771328 : ffff9ebb9fbb8400)
00000020:00000001:17.0:1773851881.781869:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127408780288 : -106946300771328 : ffff9ebb9fbb8400)
00000100:00000001:17.0:1773851881.781871:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851881.781872:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851881.781873:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851881.781874:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851881.781875:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851881.781877:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851881.781878:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851881.781879:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851881.781881:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851881.781881:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851881.781882:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.781884:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851881.781885:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851881.781886:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851881.781886:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851881.781887:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851881.781888:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17810@kfi7, seq: 2156381
00000100:00000040:17.0:1773851881.781889:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000014ee665f : new rpc_count 1
00000100:00000001:16.0:1773851881.781889:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.781890:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534653824 : -106946174897792 : ffff9ebba73c3180)
00000100:00000001:16.0:1773851881.781890:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851881.781892:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000340e4ee5 x1859831000157696/t0(0) o400->033a2d5a-e96f-4e57-aeab-7712f512a886@17810@kfi7:102/0 lens 224/0 e 0 to 0 dl 1773852217 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1606-0'
00000100:00000001:17.0:1773851881.781896:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851881.781897:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851881.781898:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000340e4ee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:033a2d5a-e96f-4e57-aeab-7712f512a886+5:39631:x1859831000157696:12345-17810@kfi7:400:default-tuolumne1606-0
00000100:00000200:17.0:1773851881.781900:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831000157696
00000020:00000001:17.0:1773851881.781901:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851881.781902:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851881.781903:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.781904:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851881.781905:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851881.781906:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851881.781907:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831000157696, found 0 last_xid 1859831000157695
00000020:00000001:17.0:1773851881.781908:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851881.781909:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851881.781910:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851881.781911:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.781912:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851881.781913:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851881.781914:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851881.781915:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000074eabed9.
02000000:00000001:17.0:1773851881.781916:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.781918:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.781919:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851881.781920:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262818883, transno 0, xid 1859831000157696
00010000:00000001:17.0:1773851881.781921:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851881.781923:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000340e4ee5 x1859831000157696/t0(0) o400->033a2d5a-e96f-4e57-aeab-7712f512a886@17810@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1606-0'
00010000:00000001:17.0:1773851881.781927:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851881.781928:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851881.781929:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=114 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851881.781931:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851881.781932:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006cba154b refcount 3 to 17810@kfi7
00000100:00000001:17.0:1773851881.781933:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095777184 : -107152613774432 : ffff9e8b9684eba0)
02000000:00000001:17.0:1773851881.781934:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851881.781935:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.781936:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851881.781937:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17810@kfi7
00000400:00000010:17.0:1773851881.781938:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007c9bad05.
00000100:00000200:17.0:1773851881.781939:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831000157696, offset 224
00000400:00000200:17.0:1773851881.781941:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17810@kfi7
00000400:00000200:17.0:1773851881.781943:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17810@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.781944:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ae0e19e nid 17810@kfi7 refs 1
00000400:00000200:17.0:1773851881.781945:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002ae0e19e nid 17810@kfi7 refs 2
00000400:00000200:17.0:1773851881.781947:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002ae0e19e nid 17810@kfi7 refs 3
00000400:00000200:17.0:1773851881.781949:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17810@kfi7 local destination
00000400:00000200:17.0:1773851881.781951:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769708:8769708:1024:4294967295] 17810@kfi7 LPNI seq info [733061:733061:16:4294967295]
00000400:00000200:17.0:1773851881.781953:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002ae0e19e nid 17810@kfi7 refs 2
00000400:00000200:17.0:1773851881.781954:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17810@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.781958:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17810@kfi7(17810@kfi7:17810@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851881.781960:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002ae0e19e nid 17810@kfi7 refs 3
00000800:00000200:17.0:1773851881.781962:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.781964:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851881.781972:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851881.781976:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x7f0 Using peer 17810@kfi7(0x7f0)
00000800:00000200:17.0:1773851881.781981:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x7f0: rc=0
00000800:00000200:17.0:1773851881.781983:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x7f0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851881.781987:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851881.781989:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006cba154b refcount 2 to 17810@kfi7
00010000:00000001:17.0:1773851881.781990:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851881.781991:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.781992:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851881.781993:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000340e4ee5 x1859831000157696/t0(0) o400->033a2d5a-e96f-4e57-aeab-7712f512a886@17810@kfi7:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1606-0'
00000800:00000200:18.0:1773851881.781998:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x7f0 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851881.781999:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:17.0:1773851881.781999:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000340e4ee5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:033a2d5a-e96f-4e57-aeab-7712f512a886+5:39631:x1859831000157696:12345-17810@kfi7:400:default-tuolumne1606-0 Request processed in 101us (146us total) trans 0 rc 0/0
00000400:00000200:18.0:1773851881.782001:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17810@kfi7: PUT: OK
00000400:00000200:18.0:1773851881.782002:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007c9bad05
00000400:00000010:18.0:1773851881.782002:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007c9bad05.
00000100:00000001:18.0:1773851881.782003:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851881.782003:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:17.0:1773851881.782003:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17810@kfi7, seq: 2156381
00000400:00000200:18.0:1773851881.782004:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002ae0e19e nid 17810@kfi7 refs 2
00000100:00000040:17.0:1773851881.782004:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000014ee665f : new rpc_count 0
00000100:00000001:17.0:1773851881.782005:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851881.782006:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 17810@kfi7(000000009c51b382):0x0 lsk 2033 rsk 39 tsk 0 trmk 0 tmk 0 trr 4 tta 0x7f0 Transaction freed
00000100:00000001:17.0:1773851881.782006:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851881.782007:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851881.782008:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851881.782010:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000020:00000040:17.0:1773851881.782011:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000014ee665f : new refcount 4
00000100:00000001:17.0:1773851881.782011:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851881.801734:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851881.801736:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851881.801738:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b9a17ed.
00000020:00000040:7.0:1773851881.801739:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851881.801740:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851881.801741:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851881.801743:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851881.801744:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000daca50c1.
00000100:00000001:7.0:1773851881.801746:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851881.801747:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851881.801748:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851881.801751:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005b9a17ed] to pc [ptlrpcd_01_03+3]  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851881.801758:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851881.801758:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851881.801759:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851881.801759:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:4.0:1773851881.801760:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:7.0:1773851881.801761:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000007aa9bdb9.
00000100:00000001:5.0:1773851881.801761:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851881.801762:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851881.801763:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637132234820608 : -106941474731008 : ffff9ebcbf630c00)
00000100:00000001:4.0:1773851881.801763:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:7.0:1773851881.801764:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851881.801764:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851881.801764:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851881.801765:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851881.801766:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851881.801766:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b9a17ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051934016:2099@kfi7:13:default-yuba2-0
00000004:00001000:7.0:1773851881.801767:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000100:00000001:4.0:1773851881.801767:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000010:7.0:1773851881.801768:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000092e3152a.
02000000:00000001:4.0:1773851881.801768:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851881.801769:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851881.801769:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00080000:7.0:1773851881.801770:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614156255045270ns, next at 614157255043527ns, rc = 0
02000000:00000010:4.0:1773851881.801770:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000084a5b49f.
00080000:00000001:7.0:1773851881.801771:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851881.801771:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851881.801772:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00080000:00000001:7.0:1773851881.801773:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851881.801773:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000004:00000001:7.0:1773851881.801774:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851881.801774:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fcac908a.
00000100:00000200:4.0:1773851881.801775:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934016, portal 4
00000100:00000001:4.0:1773851881.801776:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851881.801776:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309133952 : -106994400417664 : ffff9eb06cc52880)
00000100:00000040:4.0:1773851881.801778:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851881.801780:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851881.801781:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851881.801782:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000534d0766.
00000100:00000200:4.0:1773851881.801782:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934016, offset 0
00000400:00000200:4.0:1773851881.801784:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851881.801785:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851881.801786:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851881.801787:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851881.801788:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851881.801789:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851881.801791:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769708, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769707, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851881.801792:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851881.801793:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851881.801794:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851881.801795:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769709:8769709:1024:4294967295] 2099@kfi7 LPNI seq info [5403433:5403433:16:4294967295]
00000400:00000200:4.0:1773851881.801796:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851881.801797:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851881.801800:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851881.801801:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851881.801803:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851881.801804:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851881.801807:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851881.801809:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Using peer 2099@kfi7(0x2000000000002c4)
00000800:00000200:4.0:1773851881.801813:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x2000000000002c4: rc=0
00000800:00000200:4.0:1773851881.801815:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851881.801817:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851881.801817:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851881.801818:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851881.801819:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851881.801821:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851881.801822:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851881.801823:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851881.801824:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851881.801824:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851881.801829:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851881.801830:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851881.801831:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851881.801834:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851881.801835:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851881.801837:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000534d0766
00000400:00000010:5.0:1773851881.801837:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000534d0766.
00000100:00000001:5.0:1773851881.801839:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851881.801840:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851881.801845:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851881.801846:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851881.801850:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851881.801851:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851881.801853:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851881.801855:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Transaction freed
00000800:00000200:17.0:1773851881.801866:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.801867:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851881.801869:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851881.801873:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851881.801877:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.801879:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851881.801880:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.801882:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851881.801883:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.801884:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851881.801885:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851881.801887:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.801888:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4d40
00000400:00000200:17.0:1773851881.801890:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.801892:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f1a31 [1] + 224
00000800:00000200:17.0:1773851881.801895:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851881.801898:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851881.801900:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851881.801901:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851881.801903:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851881.801908:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851881.801914:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851881.801916:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000100:00000001:4.0:1773851881.801916:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851881.801917:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:17.0:1773851881.801918:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000001:4.0:1773851881.801918:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851881.801918:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851881.801919:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851881.801920:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fcac908a
00000400:00000010:4.0:1773851881.801920:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fcac908a.
00000100:00000001:4.0:1773851881.801921:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851881.801922:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851881.801925:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851881.801927:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851881.801928:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851881.801929:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851881.801929:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851881.801930:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851881.801931:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851881.801931:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851881.801932:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=114 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851881.801934:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=114 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851881.801934:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851881.801935:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851881.801936:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851881.801936:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851881.801937:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851881.801938:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851881.801939:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851881.801939:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851881.801940:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851881.801942:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851881.801943:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851881.801944:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851881.801945:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851881.801945:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851881.801946:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409096704 avail=351407137792 avail_mb=1372684132 hwm_mb=3131101 files=372011237 ffree=343172946 state=0: rc = 0
00000004:00000020:4.0:1773851881.801948:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409096704 free, 351407137792 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011237 files, 343172946 free files
00000004:00000001:4.0:1773851881.801950:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851881.801951:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851881.801954:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b9a17ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051934016:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851881.801957:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851881.801958:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851881.801958:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005b9a17ed x1859433051934016/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852034 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851881.801961:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851881.801962:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851881.801962:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000084a5b49f.
02000000:00000001:4.0:1773851881.801963:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851881.801964:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851881.801964:0:41067:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851881.801965:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851881.801966:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000daca50c1.
02000000:00000001:4.0:1773851881.801967:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851881.801967:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851881.801968:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b9a17ed.
00000100:00000001:4.0:1773851881.801969:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851881.801969:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851881.801970:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851881.801970:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851881.801971:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851881.801971:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851881.801972:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851881.820645:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851881.820646:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851881.820647:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851881.820647:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851881.820648:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851881.820649:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851881.820651:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12851@kfi7(00000000a8750ec5):0xf0e version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851881.820652:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851881.820654:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e Using peer 12851@kfi7(0xf0e)
00000400:00000200:14.0:1773851881.820655:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12851@kfi7 to cpt 3
00000400:00000200:14.0:1773851881.820657:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12851@kfi7 : PUT - for me
00000400:00000200:13.0:1773851881.820657:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12851@kfi7 to cpt 3
00000400:00000200:14.0:1773851881.820659:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12851@kfi7 to cpt 3
00000800:00000200:13.0:1773851881.820661:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0xf0e: rc=0
00000400:00000200:14.0:1773851881.820662:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000010eb4bb nid 12851@kfi7 refs 1
00000800:00000200:13.0:1773851881.820663:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851881.820664:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12851@kfi7 to cpt 3
00000400:00000200:14.0:1773851881.820666:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000010eb4bb nid 12851@kfi7 refs 2
00000400:00000200:14.0:1773851881.820667:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000010eb4bb nid 12851@kfi7 refs 3
00000400:00000200:14.0:1773851881.820669:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12850@kfi7 to cpt 0
00000400:00000200:14.0:1773851881.820670:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12850@kfi7 of length 456 into portal 12 MB=0x69b31285e54c0
00000400:00000200:14.0:1773851881.820673:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12850@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 41992
00000800:00000200:14.0:1773851881.820676:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851881.820678:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851881.820679:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851881.820680:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12851@kfi7: PUT: OK
00000100:00000001:14.0:1773851881.820681:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851881.820682:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:13.0:1773851881.820682:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e Transaction freed
00000100:00000010:14.0:1773851881.820683:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002029ef2e.
00000100:00000040:14.0:1773851881.820684:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000002029ef2e x1859485293237440 msgsize 456
00000100:00100000:14.0:1773851881.820687:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-12850@kfi7 (source: 12345-12851@kfi7)
00000100:00000001:14.0:1773851881.820688:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851881.820690:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000010eb4bb nid 12851@kfi7 refs 2
00000100:00000001:12.0:1773851881.820691:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851881.820692:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851881.820692:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851881.820693:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851881.820694:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851881.820695:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851881.820696:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859485293237440
00000020:00000001:12.0:1773851881.820697:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851881.820698:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cdbf9ab69
00000020:00000001:12.0:1773851881.820699:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851881.820707:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007c78454a refcount=6
00000020:00000001:12.0:1773851881.820708:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637091931392000 : -106981778159616 : ffff9eb35d1d8800)
00000020:00000001:12.0:1773851881.820710:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637091931392000 : -106981778159616 : ffff9eb35d1d8800)
00000100:00000001:12.0:1773851881.820711:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851881.820713:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851881.820714:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f473717f.
00000020:00000010:12.0:1773851881.820715:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851881.820716:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a30c3e95.
00000100:00000001:12.0:1773851881.820718:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851881.820719:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851881.820720:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.820721:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.820723:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851881.820726:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851881.820730:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851881.820731:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851881.820732:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851881.820733:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12850@kfi7, seq: 411190553
00000100:00000040:15.0:1773851881.820734:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007c78454a : new rpc_count 2
00000100:00000001:12.0:1773851881.820734:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851881.820735:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562693760 : -106978146857856 : ffff9eb4358ecc80)
00000100:00000001:12.0:1773851881.820735:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851881.820737:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002029ef2e x1859485293237440/t0(0) o17->6be4b68a-6d5b-4579-b0f0-7705ceabaada@12850@kfi7:521/0 lens 456/0 e 0 to 0 dl 1773852636 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1289-0'
00000100:00000001:15.0:1773851881.820742:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851881.820742:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851881.820744:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002029ef2e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6be4b68a-6d5b-4579-b0f0-7705ceabaada+6:40054:x1859485293237440:12345-12850@kfi7:17:default-tuolumne1289-0
00000100:00000200:15.0:1773851881.820746:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859485293237440
00000020:00000001:15.0:1773851881.820747:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851881.820748:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851881.820749:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.820750:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851881.820751:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:15.0:1773851881.820752:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851881.820753:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859485293237440, found 0 last_xid 1859485292331455
00000020:00000001:15.0:1773851881.820754:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851881.820755:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851881.820756:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851881.820757:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851881.820758:0:60824:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:15.0:1773851881.820760:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851881.820761:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851881.820762:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000001966da90.
02000000:00000001:15.0:1773851881.820763:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851881.820765:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.820766:0:60824:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:15.0:1773851881.820767:0:60824:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:15.0:1773851881.820768:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851881.820771:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.820772:0:60824:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:15.0:1773851881.820773:0:60824:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 6be4b68a-6d5b-4579-b0f0-7705ceabaada/000000007c78454a free: 126633370845184 avail: 126633368748032
00000020:00000001:15.0:1773851881.820775:0:60824:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:15.0:1773851881.820776:0:60824:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 6be4b68a-6d5b-4579-b0f0-7705ceabaada/000000007c78454a avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:15.0:1773851881.820778:0:60824:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:15.0:1773851881.820779:0:60824:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:15.0:1773851881.820780:0:60824:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 6be4b68a-6d5b-4579-b0f0-7705ceabaada/000000007c78454a reports grant 1814298623 dropped 0, local 1882456063
00000020:00000001:15.0:1773851881.820782:0:60824:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:15.0:1773851881.820783:0:60824:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:15.0:1773851881.820783:0:60824:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851881.820785:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183235704902, transno 0, xid 1859485293237440
00010000:00000001:15.0:1773851881.820786:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851881.820787:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002029ef2e x1859485293237440/t0(0) o17->6be4b68a-6d5b-4579-b0f0-7705ceabaada@12850@kfi7:521/0 lens 456/432 e 0 to 0 dl 1773852636 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1289-0'
00010000:00000001:15.0:1773851881.820791:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851881.820792:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851881.820793:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=114 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851881.820795:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851881.820796:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000078f06161 refcount 3 to 12850@kfi7
00000100:00000001:15.0:1773851881.820797:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729381088 : -107155980170528 : ffff9e8acdddcae0)
02000000:00000001:15.0:1773851881.820798:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851881.820799:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851881.820800:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851881.820801:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12851@kfi7
00000400:00000010:15.0:1773851881.820802:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edce5c74.
00000100:00000200:15.0:1773851881.820804:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859485293237440, offset 224
00000400:00000200:15.0:1773851881.820806:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12851@kfi7
00000400:00000200:15.0:1773851881.820808:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12851@kfi7 to cpt 3
00000400:00000200:15.0:1773851881.820810:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000010eb4bb nid 12851@kfi7 refs 1
00000400:00000200:15.0:1773851881.820811:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000010eb4bb nid 12851@kfi7 refs 2
00000400:00000200:15.0:1773851881.820813:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000010eb4bb nid 12851@kfi7 refs 3
00000400:00000200:15.0:1773851881.820815:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12851@kfi7 local destination
00000400:00000200:15.0:1773851881.820818:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769710:8769710:1024:4294967295] 12851@kfi7 LPNI seq info [2887728:2887728:16:4294967295]
00000400:00000200:15.0:1773851881.820820:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000010eb4bb nid 12851@kfi7 refs 2
00000400:00000200:15.0:1773851881.820821:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12851@kfi7 to cpt 3
00000400:00000200:15.0:1773851881.820824:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12851@kfi7(12851@kfi7:12851@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851881.820826:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000010eb4bb nid 12851@kfi7 refs 3
00000800:00000200:15.0:1773851881.820829:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851881.820831:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:15.0:1773851881.820834:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851881.820838:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e Using peer 12851@kfi7(0xf0e)
00000800:00000200:15.0:1773851881.820843:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 532 bytes to peer 0xf0e: rc=0
00000800:00000200:15.0:1773851881.820845:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851881.820848:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851881.820850:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000078f06161 refcount 2 to 12850@kfi7
00010000:00000001:15.0:1773851881.820851:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851881.820851:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.820852:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851881.820854:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002029ef2e x1859485293237440/t0(0) o17->6be4b68a-6d5b-4579-b0f0-7705ceabaada@12850@kfi7:521/0 lens 456/432 e 0 to 0 dl 1773852636 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1289-0'
00000100:00100000:15.0:1773851881.820859:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002029ef2e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6be4b68a-6d5b-4579-b0f0-7705ceabaada+6:40054:x1859485293237440:12345-12850@kfi7:17:default-tuolumne1289-0 Request processed in 116us (173us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851881.820861:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851881.820862:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12850@kfi7, seq: 411190553
00000400:00000200:13.0:1773851881.820863:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:15.0:1773851881.820864:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007c78454a : new rpc_count 1
00000100:00000001:15.0:1773851881.820865:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851881.820865:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12851@kfi7: PUT: OK
00000100:00000001:15.0:1773851881.820866:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851881.820867:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000400:00000200:13.0:1773851881.820867:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edce5c74
00000020:00000010:15.0:1773851881.820868:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a30c3e95.
00000400:00000010:13.0:1773851881.820868:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edce5c74.
00000100:00000001:13.0:1773851881.820869:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851881.820870:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f473717f.
00000100:00000001:13.0:1773851881.820870:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:15.0:1773851881.820871:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000007c78454a : new refcount 5
00000400:00000200:13.0:1773851881.820871:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000010eb4bb nid 12851@kfi7 refs 2
00000100:00000001:15.0:1773851881.820872:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851881.820874:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 12851@kfi7(00000000a8750ec5):0x0 lsk 3855 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf0e Transaction freed
00000800:00000200:17.0:1773851881.826354:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.826355:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851881.826357:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851881.826360:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851881.826366:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.826368:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.20@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851881.826370:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.826371:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851881.826373:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.20@o2ib60 to cpt 5
00000400:00000200:17.0:1773851881.826375:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e036345 nid 192.168.128.20@o2ib60 refs 2
00000400:00000200:17.0:1773851881.826377:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008e036345 nid 192.168.128.20@o2ib60 refs 3
00000400:00000200:17.0:1773851881.826378:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.20@o2ib60 to cpt 5
00000400:00000200:17.0:1773851881.826380:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.20@o2ib60 of length 224 into portal 12 MB=0x69b233bf2d040
00000400:00000200:17.0:1773851881.826383:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.20@o2ib60 of length 224/224 into md 0x6a32cacf5 [64] + 50800
00000800:00000200:17.0:1773851881.826386:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851881.826389:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851881.826390:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851881.826392:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851881.826393:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851881.826394:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000007d65f5.
00000100:00000040:17.0:1773851881.826395:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000007d65f5 x1859425492193344 msgsize 224
00000100:00100000:17.0:1773851881.826399:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.20@o2ib60 (source: 12345-192.168.128.20@o2ib60)
00000100:00000001:17.0:1773851881.826401:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851881.826402:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851881.826404:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851881.826405:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851881.826406:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851881.826407:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851881.826408:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851881.826409:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851881.826411:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859425492193344
00000020:00000001:20.0:1773851881.826412:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851881.826412:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2ced5e
00000020:00000001:20.0:1773851881.826414:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851881.826416:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cfe3d977 refcount=6
00000020:00000001:20.0:1773851881.826417:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962029553664 : -107111679997952 : ffff9e951e5cc800)
00000020:00000001:20.0:1773851881.826419:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636962029553664 : -107111679997952 : ffff9e951e5cc800)
00000100:00000001:20.0:1773851881.826420:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.826423:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851881.826424:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851881.826426:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.826427:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851881.826429:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851881.826429:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851881.826430:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851881.826432:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851881.826433:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851881.826433:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.826435:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851881.826437:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851881.826438:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851881.826438:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851881.826440:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851881.826440:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.20@o2ib60, seq: 1998025
00000100:00000001:23.0:1773851881.826442:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.826442:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cfe3d977 : new rpc_count 2
00000100:00000001:23.0:1773851881.826443:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.826443:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102199296 : -107041607352320 : ffff9ea56f048000)
00000100:00000040:20.0:1773851881.826445:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000007d65f5 x1859425492193344/t0(0) o400->6fae2f28-b25c-4445-afde-a2aa417c7b51@192.168.128.20@o2ib60:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix20-0'
00000100:00000001:20.0:1773851881.826450:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851881.826451:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851881.826453:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000007d65f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:6fae2f28-b25c-4445-afde-a2aa417c7b51+6:40037:x1859425492193344:12345-192.168.128.20@o2ib60:400:default-matrix20-0
00000100:00000200:20.0:1773851881.826455:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859425492193344
00000020:00000001:20.0:1773851881.826456:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851881.826457:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851881.826458:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.826460:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851881.826460:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851881.826462:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851881.826463:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859425492193344, found 0 last_xid 1859425490791039
00000020:00000001:20.0:1773851881.826464:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851881.826465:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851881.826466:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851881.826468:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.826469:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851881.826470:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851881.826470:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851881.826471:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e5c0cb63.
02000000:00000001:20.0:1773851881.826472:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.826473:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.826474:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851881.826476:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253606043, transno 0, xid 1859425492193344
00010000:00000001:20.0:1773851881.826477:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851881.826478:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000007d65f5 x1859425492193344/t0(0) o400->6fae2f28-b25c-4445-afde-a2aa417c7b51@192.168.128.20@o2ib60:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix20-0'
00010000:00000001:20.0:1773851881.826483:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851881.826483:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851881.826484:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=114 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851881.826486:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851881.826488:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fdfcf94c refcount 3 to 192.168.128.20@o2ib60
00000100:00000001:20.0:1773851881.826489:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092243104 : -107152617308512 : ffff9e8b964efea0)
02000000:00000001:20.0:1773851881.826490:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851881.826491:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851881.826492:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851881.826494:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.20@o2ib60
00000400:00000010:20.0:1773851881.826495:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f2b7e97.
00000100:00000200:20.0:1773851881.826496:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859425492193344, offset 224
00000400:00000200:20.0:1773851881.826499:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.20@o2ib60
00000400:00000200:20.0:1773851881.826501:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.20@o2ib60 to cpt 5
00000400:00000200:20.0:1773851881.826503:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e036345 nid 192.168.128.20@o2ib60 refs 2
00000400:00000200:20.0:1773851881.826505:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008e036345 nid 192.168.128.20@o2ib60 refs 3
00000400:00000200:20.0:1773851881.826508:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008e036345 nid 192.168.128.20@o2ib60 refs 4
00000400:00000200:20.0:1773851881.826510:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.20@o2ib60 routed destination
00000400:00000200:20.0:1773851881.826512:0:61145:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:20.0:1773851881.826514:0:61145:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:20.0:1773851881.826516:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.20@o2ib60: rtr pref emtpy: 1
00000400:00000200:20.0:1773851881.826519:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:20.0:1773851881.826521:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.20@o2ib60: rtr pref emtpy: 1
00000400:00000200:20.0:1773851881.826522:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:20.0:1773851881.826524:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769711:8769711:1024:4294967295] 2094@kfi7 LPNI seq info [1258747013:1258747013:16:4294967295]
00000400:00000200:20.0:1773851881.826526:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:20.0:1773851881.826528:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:20.0:1773851881.826532:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.20@o2ib60(192.168.128.20@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851881.826535:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008e036345 nid 192.168.128.20@o2ib60 refs 3
00000800:00000200:20.0:1773851881.826537:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851881.826539:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851881.826542:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851881.826546:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:20.0:1773851881.826551:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:20.0:1773851881.826553:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851881.826557:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851881.826559:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fdfcf94c refcount 2 to 192.168.128.20@o2ib60
00010000:00000001:20.0:1773851881.826560:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851881.826561:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851881.826562:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851881.826563:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000007d65f5 x1859425492193344/t0(0) o400->6fae2f28-b25c-4445-afde-a2aa417c7b51@192.168.128.20@o2ib60:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix20-0'
00000100:00100000:20.0:1773851881.826569:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000007d65f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:6fae2f28-b25c-4445-afde-a2aa417c7b51+6:40037:x1859425492193344:12345-192.168.128.20@o2ib60:400:default-matrix20-0 Request processed in 117us (172us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851881.826573:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.20@o2ib60, seq: 1998025
00000100:00000040:20.0:1773851881.826574:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cfe3d977 : new rpc_count 1
00000100:00000001:20.0:1773851881.826576:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851881.826577:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851881.826578:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851881.826579:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851881.826581:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851881.826582:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000cfe3d977 : new refcount 5
00000100:00000001:20.0:1773851881.826583:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851881.826591:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851881.826594:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851881.826596:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:21.0:1773851881.826597:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f2b7e97
00000400:00000010:21.0:1773851881.826598:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f2b7e97.
00000100:00000001:21.0:1773851881.826599:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851881.826600:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851881.826601:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:21.0:1773851881.826603:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Transaction freed
00000800:00000200:17.0:1773851881.849920:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.849920:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851881.849921:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851881.849923:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851881.849925:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.849927:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.35@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851881.849927:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851881.849928:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851881.849929:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.35@o2ib60 to cpt 4
00000400:00000200:17.0:1773851881.849931:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d72e96b nid 192.168.128.35@o2ib60 refs 2
00000400:00000200:17.0:1773851881.849932:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001d72e96b nid 192.168.128.35@o2ib60 refs 3
00000400:00000200:17.0:1773851881.849933:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.35@o2ib60 to cpt 4
00000400:00000200:17.0:1773851881.849934:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.35@o2ib60 of length 224 into portal 12 MB=0x69b271bdaeb00
00000400:00000200:17.0:1773851881.849935:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.35@o2ib60 of length 224/224 into md 0x6ab01b5d1 [64] + 30264
00000800:00000200:17.0:1773851881.849937:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851881.849938:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851881.849939:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851881.849940:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851881.849940:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851881.849941:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000028443fa9.
00000100:00000040:17.0:1773851881.849942:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000028443fa9 x1859442133625600 msgsize 224
00000100:00100000:17.0:1773851881.849943:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.35@o2ib60 (source: 12345-192.168.128.35@o2ib60)
00000100:00000001:17.0:1773851881.849944:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851881.849945:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851881.849946:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851881.849949:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851881.849949:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851881.849950:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851881.849950:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851881.849951:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851881.849951:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859442133625600
00000020:00000001:17.0:1773851881.849952:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851881.849952:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b94c594e5
00000020:00000001:17.0:1773851881.849953:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851881.849955:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f11b9dd9 refcount=5
00000020:00000001:17.0:1773851881.849956:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637124929107968 : -106948780443648 : ffff9ebb0beeb800)
00000020:00000001:17.0:1773851881.849957:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637124929107968 : -106948780443648 : ffff9ebb0beeb800)
00000100:00000001:17.0:1773851881.849958:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851881.849959:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851881.849959:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851881.849960:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851881.849961:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851881.849962:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851881.849962:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851881.849963:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851881.849964:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851881.849964:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851881.849964:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.849965:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851881.849966:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851881.849967:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851881.849967:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851881.849967:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851881.849968:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.35@o2ib60, seq: 2156382
00000100:00000040:17.0:1773851881.849969:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f11b9dd9 : new rpc_count 1
00000100:00000001:17.0:1773851881.849969:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102229248 : -107041607322368 : ffff9ea56f04f500)
00000100:00000001:16.0:1773851881.849969:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851881.849970:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000028443fa9 x1859442133625600/t0(0) o400->b5f30821-c9f0-4041-a239-6bb6405a6c71@192.168.128.35@o2ib60:102/0 lens 224/0 e 0 to 0 dl 1773852217 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix35-0'
00000100:00000001:16.0:1773851881.849970:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.849973:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851881.849973:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851881.849974:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028443fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b5f30821-c9f0-4041-a239-6bb6405a6c71+5:39941:x1859442133625600:12345-192.168.128.35@o2ib60:400:default-matrix35-0
00000100:00000200:17.0:1773851881.849976:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859442133625600
00000020:00000001:17.0:1773851881.849976:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851881.849977:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851881.849978:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.849978:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851881.849979:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851881.849979:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851881.849980:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859442133625600, found 0 last_xid 1859442133625599
00000020:00000001:17.0:1773851881.849981:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851881.849982:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851881.849982:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851881.849982:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.849983:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851881.849984:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851881.849984:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851881.849985:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f7968a22.
02000000:00000001:17.0:1773851881.849985:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.849986:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.849987:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851881.849987:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859442133625600
00010000:00000001:17.0:1773851881.849988:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851881.849989:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000028443fa9 x1859442133625600/t0(0) o400->b5f30821-c9f0-4041-a239-6bb6405a6c71@192.168.128.35@o2ib60:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix35-0'
00010000:00000001:17.0:1773851881.849991:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851881.849992:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851881.849992:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=114 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851881.849993:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851881.849994:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000275ebb0c refcount 3 to 192.168.128.35@o2ib60
00000100:00000001:17.0:1773851881.849995:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095777280 : -107152613774336 : ffff9e8b9684ec00)
02000000:00000001:17.0:1773851881.849995:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851881.849996:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851881.849997:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851881.849997:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.35@o2ib60
00000400:00000010:17.0:1773851881.849998:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008b5cd57e.
00000100:00000200:17.0:1773851881.849999:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859442133625600, offset 224
00000400:00000200:17.0:1773851881.850000:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.35@o2ib60
00000400:00000200:17.0:1773851881.850001:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.35@o2ib60 to cpt 4
00000400:00000200:17.0:1773851881.850002:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d72e96b nid 192.168.128.35@o2ib60 refs 2
00000400:00000200:17.0:1773851881.850003:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001d72e96b nid 192.168.128.35@o2ib60 refs 3
00000400:00000200:17.0:1773851881.850004:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001d72e96b nid 192.168.128.35@o2ib60 refs 4
00000400:00000200:17.0:1773851881.850006:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.35@o2ib60 routed destination
00000400:00000200:17.0:1773851881.850007:0:60961:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:17.0:1773851881.850008:0:60961:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:17.0:1773851881.850009:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.35@o2ib60: rtr pref emtpy: 1
00000400:00000200:17.0:1773851881.850010:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:17.0:1773851881.850011:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.35@o2ib60: rtr pref emtpy: 1
00000400:00000200:17.0:1773851881.850012:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:17.0:1773851881.850013:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769712:8769712:1024:4294967295] 17@kfi7 LPNI seq info [1250891913:1250891913:16:4294967295]
00000400:00000200:17.0:1773851881.850015:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:17.0:1773851881.850015:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:17.0:1773851881.850018:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.35@o2ib60(192.168.128.35@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851881.850019:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001d72e96b nid 192.168.128.35@o2ib60 refs 3
00000800:00000200:17.0:1773851881.850020:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851881.850021:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851881.850023:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851881.850025:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:17.0:1773851881.850028:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:17.0:1773851881.850030:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851881.850031:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851881.850032:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000275ebb0c refcount 2 to 192.168.128.35@o2ib60
00010000:00000001:17.0:1773851881.850033:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851881.850034:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851881.850034:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851881.850035:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000028443fa9 x1859442133625600/t0(0) o400->b5f30821-c9f0-4041-a239-6bb6405a6c71@192.168.128.35@o2ib60:102/0 lens 224/224 e 0 to 0 dl 1773852217 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix35-0'
00000100:00100000:17.0:1773851881.850038:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028443fa9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b5f30821-c9f0-4041-a239-6bb6405a6c71+5:39941:x1859442133625600:12345-192.168.128.35@o2ib60:400:default-matrix35-0 Request processed in 64us (95us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851881.850042:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851881.850042:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.35@o2ib60, seq: 2156382
00000400:00000200:18.0:1773851881.850043:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:17.0:1773851881.850043:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f11b9dd9 : new rpc_count 0
00000400:00000200:18.0:1773851881.850044:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:17.0:1773851881.850044:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851881.850045:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008b5cd57e
00000400:00000010:18.0:1773851881.850045:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008b5cd57e.
00000100:00000001:17.0:1773851881.850045:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851881.850045:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000100:00000001:18.0:1773851881.850046:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:17.0:1773851881.850046:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000100:00000001:18.0:1773851881.850047:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:17.0:1773851881.850047:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000400:00000200:18.0:1773851881.850048:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000040:17.0:1773851881.850048:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000f11b9dd9 : new refcount 4
00000100:00000001:17.0:1773851881.850048:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851881.850049:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000001a Transaction freed
00000800:00000200:13.0:1773851881.864959:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851881.864959:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851881.864961:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851881.864964:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851881.864966:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13008@kfi7 to cpt 3
00000400:00000200:13.0:1773851881.864967:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13008@kfi7 : PUT - for me
00000400:00000200:13.0:1773851881.864968:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13008@kfi7 to cpt 3
00000400:00000200:13.0:1773851881.864970:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a480ef94 nid 13008@kfi7 refs 1
00000400:00000200:13.0:1773851881.864971:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13008@kfi7 to cpt 3
00000400:00000200:13.0:1773851881.864971:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a480ef94 nid 13008@kfi7 refs 2
00000400:00000200:13.0:1773851881.864972:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a480ef94 nid 13008@kfi7 refs 3
00000400:00000200:13.0:1773851881.864973:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12816@kfi7 to cpt 0
00000400:00000200:13.0:1773851881.864974:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12816@kfi7 of length 224 into portal 12 MB=0x69b4bfb6d0480
00000400:00000200:13.0:1773851881.864975:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12816@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 42448
00000800:00000200:13.0:1773851881.864977:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851881.864978:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851881.864979:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13008@kfi7: PUT: OK
00000100:00000001:13.0:1773851881.864980:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851881.864980:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851881.864981:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b0abc25.
00000100:00000040:13.0:1773851881.864981:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000002b0abc25 x1859600503342208 msgsize 224
00000100:00100000:13.0:1773851881.864983:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12816@kfi7 (source: 12345-13008@kfi7)
00000100:00000001:13.0:1773851881.864984:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851881.864985:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851881.864985:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a480ef94 nid 13008@kfi7 refs 2
02000000:00000001:15.0:1773851881.864986:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851881.864986:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851881.864986:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851881.864987:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851881.864988:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851881.864988:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600503342208
00000020:00000001:15.0:1773851881.864989:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851881.864989:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d870d6
00000020:00000001:15.0:1773851881.864990:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851881.864994:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001cff3502 refcount=5
00000020:00000001:15.0:1773851881.864995:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637147339099136 : -106926370452480 : ffff9ec043ac0c00)
00000020:00000001:15.0:1773851881.864996:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637147339099136 : -106926370452480 : ffff9ec043ac0c00)
00000100:00000001:15.0:1773851881.864997:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851881.864997:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851881.864998:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000916e2cfc.
00000020:00000010:15.0:1773851881.864999:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851881.865000:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851881.865001:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851881.865001:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851881.865002:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851881.865002:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851881.865003:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851881.865003:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851881.865004:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851881.865005:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851881.865006:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851881.865006:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851881.865006:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851881.865007:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12816@kfi7, seq: 2289882
00000100:00000040:15.0:1773851881.865008:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001cff3502 : new rpc_count 1
00000100:00000001:15.0:1773851881.865008:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902270976 : -106994807280640 : ffff9eb05484ec00)
00000100:00000001:12.0:1773851881.865008:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851881.865008:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851881.865009:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002b0abc25 x1859600503342208/t0(0) o400->c9fc049e-f6cc-450d-9ef6-5ee8d0b524d6@12816@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1297-0'
00000100:00000001:15.0:1773851881.865012:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851881.865012:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851881.865013:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b0abc25 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c9fc049e-f6cc-450d-9ef6-5ee8d0b524d6+5:39493:x1859600503342208:12345-12816@kfi7:400:default-tuolumne1297-0
00000100:00000200:15.0:1773851881.865014:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600503342208
00000020:00000001:15.0:1773851881.865015:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851881.865015:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851881.865016:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.865016:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851881.865017:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851881.865018:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851881.865018:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600503342208, found 0 last_xid 1859600503342207
00000020:00000001:15.0:1773851881.865019:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851881.865019:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851881.865020:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851881.865020:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.865021:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851881.865021:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851881.865022:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851881.865023:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e1930db3.
02000000:00000001:15.0:1773851881.865023:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851881.865024:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.865025:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851881.865025:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183248430795, transno 0, xid 1859600503342208
00010000:00000001:15.0:1773851881.865026:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851881.865027:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002b0abc25 x1859600503342208/t0(0) o400->c9fc049e-f6cc-450d-9ef6-5ee8d0b524d6@12816@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1297-0'
00010000:00000001:15.0:1773851881.865029:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851881.865029:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851881.865030:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=114 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851881.865031:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851881.865032:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fa146f07 refcount 3 to 12816@kfi7
00000100:00000001:15.0:1773851881.865032:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545856768 : -107154163694848 : ffff9e8b3a230300)
02000000:00000001:15.0:1773851881.865033:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851881.865034:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851881.865034:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851881.865035:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13008@kfi7
00000400:00000010:15.0:1773851881.865036:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c8b6bf6d.
00000100:00000200:15.0:1773851881.865036:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600503342208, offset 224
00000400:00000200:15.0:1773851881.865038:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13008@kfi7
00000400:00000200:15.0:1773851881.865039:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13008@kfi7 to cpt 3
00000400:00000200:15.0:1773851881.865039:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a480ef94 nid 13008@kfi7 refs 1
00000400:00000200:15.0:1773851881.865040:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a480ef94 nid 13008@kfi7 refs 2
00000400:00000200:15.0:1773851881.865042:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a480ef94 nid 13008@kfi7 refs 3
00000400:00000200:15.0:1773851881.865043:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13008@kfi7 local destination
00000400:00000200:15.0:1773851881.865044:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769713:8769713:1024:4294967295] 13008@kfi7 LPNI seq info [306270:306270:16:4294967295]
00000400:00000200:15.0:1773851881.865045:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a480ef94 nid 13008@kfi7 refs 2
00000400:00000200:15.0:1773851881.865046:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13008@kfi7 to cpt 3
00000400:00000200:15.0:1773851881.865047:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13008@kfi7(13008@kfi7:13008@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851881.865048:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a480ef94 nid 13008@kfi7 refs 3
00000800:00000200:15.0:1773851881.865050:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851881.865051:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851881.865052:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851881.865055:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd0d Using peer 13008@kfi7(0xd0d)
00000800:00000200:15.0:1773851881.865057:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0xd0d: rc=0
00000800:00000200:15.0:1773851881.865059:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd0d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851881.865062:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851881.865063:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fa146f07 refcount 2 to 12816@kfi7
00010000:00000001:15.0:1773851881.865064:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851881.865064:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851881.865065:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851881.865065:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002b0abc25 x1859600503342208/t0(0) o400->c9fc049e-f6cc-450d-9ef6-5ee8d0b524d6@12816@kfi7:608/0 lens 224/224 e 0 to 0 dl 1773851968 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1297-0'
00000100:00100000:15.0:1773851881.865068:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b0abc25 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c9fc049e-f6cc-450d-9ef6-5ee8d0b524d6+5:39493:x1859600503342208:12345-12816@kfi7:400:default-tuolumne1297-0 Request processed in 56us (86us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851881.865070:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12816@kfi7, seq: 2289882
00000100:00000040:15.0:1773851881.865071:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001cff3502 : new rpc_count 0
00000800:00000200:13.0:1773851881.865071:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd0d TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851881.865072:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851881.865072:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851881.865072:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851881.865073:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851881.865073:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000400:00000200:13.0:1773851881.865073:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13008@kfi7: PUT: OK
00000400:00000200:13.0:1773851881.865073:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c8b6bf6d
00000020:00000010:15.0:1773851881.865074:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000916e2cfc.
00000400:00000010:13.0:1773851881.865074:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c8b6bf6d.
00000020:00000040:15.0:1773851881.865075:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000001cff3502 : new refcount 4
00000100:00000001:15.0:1773851881.865076:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851881.865077:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851881.865078:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851881.865079:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a480ef94 nid 13008@kfi7 refs 2
00000800:00000200:13.0:1773851881.865080:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 13008@kfi7(000000002534df95):0x0 lsk 3342 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd0d Transaction freed
00000800:00000200:1.0:1773851881.868988:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851881.868989:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851881.868991:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851881.868995:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851881.868998:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14400@kfi7 to cpt 0
00000400:00000200:1.0:1773851881.869000:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14400@kfi7 : PUT - for me
00000400:00000200:1.0:1773851881.869002:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14400@kfi7 to cpt 0
00000400:00000200:1.0:1773851881.869004:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe457d47 nid 14400@kfi7 refs 1
00000400:00000200:1.0:1773851881.869005:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14400@kfi7 to cpt 0
00000400:00000200:1.0:1773851881.869006:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe457d47 nid 14400@kfi7 refs 2
00000400:00000200:1.0:1773851881.869008:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fe457d47 nid 14400@kfi7 refs 3
00000400:00000200:1.0:1773851881.869010:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14400@kfi7 to cpt 0
00000400:00000200:1.0:1773851881.869011:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14400@kfi7 of length 224 into portal 12 MB=0x69b4b84329a80
00000400:00000200:1.0:1773851881.869014:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14400@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 41632
00000800:00000200:1.0:1773851881.869017:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851881.869020:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851881.869022:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14400@kfi7: PUT: OK
00000100:00000001:1.0:1773851881.869023:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851881.869024:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851881.869026:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a7aee9a.
00000100:00000040:1.0:1773851881.869027:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007a7aee9a x1859598503025280 msgsize 224
00000100:00100000:1.0:1773851881.869030:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14400@kfi7 (source: 12345-14400@kfi7)
00000100:00000001:1.0:1773851881.869031:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851881.869033:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fe457d47 nid 14400@kfi7 refs 2
00000100:00000001:0.0:1773851881.869034:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851881.869035:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851881.869035:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851881.869035:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851881.869036:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851881.869037:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851881.869038:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598503025280
00000020:00000001:0.0:1773851881.869039:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851881.869040:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d77f8c
00000020:00000001:0.0:1773851881.869041:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851881.869044:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8ceda8f refcount=5
00000020:00000001:0.0:1773851881.869044:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118506533888 : -106955203017728 : ffff9eb98d1e0400)
00000020:00000001:0.0:1773851881.869046:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118506533888 : -106955203017728 : ffff9eb98d1e0400)
00000100:00000001:0.0:1773851881.869047:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851881.869048:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851881.869049:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851881.869051:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851881.869052:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851881.869053:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851881.869054:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851881.869055:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851881.869056:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851881.869057:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851881.869057:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851881.869059:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851881.869061:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851881.869062:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851881.869062:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851881.869062:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851881.869063:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14400@kfi7, seq: 1997596
00000100:00000001:1.0:1773851881.869064:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851881.869064:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8ceda8f : new rpc_count 1
00000100:00000001:1.0:1773851881.869065:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851881.869065:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112265600 : -106950597286016 : ffff9eba9fa3e780)
00000100:00000040:0.0:1773851881.869067:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007a7aee9a x1859598503025280/t0(0) o400->26259936-d967-4a7f-957b-a6075b56f649@14400@kfi7:521/0 lens 224/0 e 0 to 0 dl 1773852636 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1396-0'
00000100:00000001:0.0:1773851881.869071:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851881.869072:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851881.869073:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a7aee9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:26259936-d967-4a7f-957b-a6075b56f649+5:39669:x1859598503025280:12345-14400@kfi7:400:default-tuolumne1396-0
00000100:00000200:0.0:1773851881.869075:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598503025280
00000020:00000001:0.0:1773851881.869076:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851881.869077:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851881.869078:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.869079:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851881.869080:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851881.869081:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851881.869082:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598503025280, found 0 last_xid 1859598503025279
00000020:00000001:0.0:1773851881.869083:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851881.869084:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851881.869085:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851881.869086:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.869087:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851881.869088:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851881.869089:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851881.869091:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008a86114e.
02000000:00000001:0.0:1773851881.869092:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851881.869093:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.869095:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851881.869096:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096699255, transno 0, xid 1859598503025280
00010000:00000001:0.0:1773851881.869098:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851881.869100:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007a7aee9a x1859598503025280/t0(0) o400->26259936-d967-4a7f-957b-a6075b56f649@14400@kfi7:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1396-0'
00010000:00000001:0.0:1773851881.869104:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851881.869105:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851881.869107:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=114 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851881.869109:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851881.869110:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008a310d57 refcount 3 to 14400@kfi7
00000100:00000001:0.0:1773851881.869111:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850078432 : -107143859473184 : ffff9e8da050f4e0)
02000000:00000001:0.0:1773851881.869113:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851881.869114:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851881.869115:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851881.869116:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14400@kfi7
00000400:00000010:0.0:1773851881.869118:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af09dc10.
00000100:00000200:0.0:1773851881.869119:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598503025280, offset 224
00000400:00000200:0.0:1773851881.869122:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14400@kfi7
00000400:00000200:0.0:1773851881.869123:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14400@kfi7 to cpt 0
00000400:00000200:0.0:1773851881.869125:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe457d47 nid 14400@kfi7 refs 1
00000400:00000200:0.0:1773851881.869127:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fe457d47 nid 14400@kfi7 refs 2
00000400:00000200:0.0:1773851881.869129:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fe457d47 nid 14400@kfi7 refs 3
00000400:00000200:0.0:1773851881.869131:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14400@kfi7 local destination
00000400:00000200:0.0:1773851881.869133:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769714:8769714:1024:4294967295] 14400@kfi7 LPNI seq info [8871330:8871330:16:4294967295]
00000400:00000200:0.0:1773851881.869136:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fe457d47 nid 14400@kfi7 refs 2
00000400:00000200:0.0:1773851881.869138:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14400@kfi7 to cpt 0
00000400:00000200:0.0:1773851881.869141:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14400@kfi7(14400@kfi7:14400@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851881.869144:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fe457d47 nid 14400@kfi7 refs 3
00000800:00000200:0.0:1773851881.869146:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851881.869148:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851881.869153:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851881.869158:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x42c Using peer 14400@kfi7(0x42c)
00000800:00000200:0.0:1773851881.869163:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x42c: rc=0
00000800:00000200:0.0:1773851881.869165:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x42c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851881.869169:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851881.869170:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008a310d57 refcount 2 to 14400@kfi7
00010000:00000001:0.0:1773851881.869172:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851881.869175:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851881.869176:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851881.869177:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a7aee9a x1859598503025280/t0(0) o400->26259936-d967-4a7f-957b-a6075b56f649@14400@kfi7:521/0 lens 224/224 e 0 to 0 dl 1773852636 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1396-0'
00000100:00100000:0.0:1773851881.869183:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a7aee9a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:26259936-d967-4a7f-957b-a6075b56f649+5:39669:x1859598503025280:12345-14400@kfi7:400:default-tuolumne1396-0 Request processed in 110us (155us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851881.869188:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14400@kfi7, seq: 1997596
00000100:00000040:0.0:1773851881.869189:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8ceda8f : new rpc_count 0
00000100:00000001:0.0:1773851881.869191:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851881.869192:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851881.869193:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851881.869194:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851881.869196:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000020:00000040:0.0:1773851881.869197:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000c8ceda8f : new refcount 4
00000100:00000001:0.0:1773851881.869198:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851881.869206:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x42c TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851881.869209:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851881.869210:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14400@kfi7: PUT: OK
00000400:00000200:1.0:1773851881.869211:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af09dc10
00000400:00000010:1.0:1773851881.869212:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af09dc10.
00000100:00000001:1.0:1773851881.869213:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851881.869213:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851881.869214:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fe457d47 nid 14400@kfi7 refs 2
00000800:00000200:1.0:1773851881.869217:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 14400@kfi7(00000000e286bc8b):0x0 lsk 1069 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x42c Transaction freed
00000800:00000200:26.0:1773851881.937055:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851881.937056:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851881.937057:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851881.937059:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851881.937061:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25552@kfi7 to cpt 6
00000400:00000200:26.0:1773851881.937062:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25552@kfi7 : PUT - for me
00000400:00000200:26.0:1773851881.937063:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25552@kfi7 to cpt 6
00000400:00000200:26.0:1773851881.937064:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d046c2e nid 25552@kfi7 refs 1
00000400:00000200:26.0:1773851881.937065:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25552@kfi7 to cpt 6
00000400:00000200:26.0:1773851881.937066:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d046c2e nid 25552@kfi7 refs 2
00000400:00000200:26.0:1773851881.937067:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007d046c2e nid 25552@kfi7 refs 3
00000400:00000200:26.0:1773851881.937068:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25360@kfi7 to cpt 3
00000400:00000200:26.0:1773851881.937069:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25360@kfi7 of length 224 into portal 12 MB=0x699e0db361ac0
00000400:00000200:26.0:1773851881.937070:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25360@kfi7 of length 224/224 into md 0x16159c9699 [64] + 28160
00000800:00000200:26.0:1773851881.937072:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851881.937074:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851881.937074:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25552@kfi7: PUT: OK
00000100:00000001:26.0:1773851881.937075:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851881.937076:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851881.937078:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008ebd3455.
00000100:00000040:26.0:1773851881.937078:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000008ebd3455 x1858040889744064 msgsize 224
00000100:00100000:26.0:1773851881.937080:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-25360@kfi7 (source: 12345-25552@kfi7)
00000100:00000001:26.0:1773851881.937081:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851881.937082:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:26.0:1773851881.937082:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007d046c2e nid 25552@kfi7 refs 2
02000000:00000001:27.0:1773851881.937083:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851881.937083:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:26.0:1773851881.937083:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851881.937084:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851881.937085:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851881.937086:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040889744064
00000020:00000001:27.0:1773851881.937086:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851881.937087:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92841
00000020:00000001:27.0:1773851881.937087:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851881.937090:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003d2fc83b refcount=6
00000020:00000001:27.0:1773851881.937091:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742960128 : -107128966591488 : ffff9e9118004c00)
00000020:00000001:27.0:1773851881.937091:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742960128 : -107128966591488 : ffff9e9118004c00)
00000100:00000001:27.0:1773851881.937092:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.937093:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851881.937094:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000052694ebb.
00000020:00000010:27.0:1773851881.937095:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851881.937096:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851881.937097:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851881.937097:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851881.937098:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851881.937099:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851881.937099:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851881.937100:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.937100:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851881.937102:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851881.937102:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851881.937102:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851881.937103:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25360@kfi7, seq: 2025147
00000100:00000001:26.0:1773851881.937103:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851881.937104:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003d2fc83b : new rpc_count 1
00000100:00000001:26.0:1773851881.937104:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.937105:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144347100032 : -106929362451584 : ffff9ebf9155c380)
00000100:00000001:26.0:1773851881.937105:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.937106:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008ebd3455 x1858040889744064/t0(0) o400->f05c0a5f-6d48-4113-a63d-e47650e3fd9e@25360@kfi7:131/0 lens 224/0 e 0 to 0 dl 1773852246 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2081-0'
00000100:00000001:27.0:1773851881.937109:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851881.937109:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851881.937110:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008ebd3455 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:f05c0a5f-6d48-4113-a63d-e47650e3fd9e+6:39826:x1858040889744064:12345-25360@kfi7:400:default-tuolumne2081-0
00000100:00000200:27.0:1773851881.937111:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040889744064
00000020:00000001:27.0:1773851881.937112:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851881.937112:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851881.937113:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.937114:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851881.937114:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851881.937115:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851881.937116:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040889744064, found 0 last_xid 1858040889744063
00000020:00000001:27.0:1773851881.937116:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851881.937117:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851881.937118:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851881.937118:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.937119:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851881.937119:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851881.937120:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851881.937121:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005efb579a.
02000000:00000001:27.0:1773851881.937121:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.937122:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.937122:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851881.937123:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106587556, transno 0, xid 1858040889744064
00010000:00000001:27.0:1773851881.937124:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851881.937125:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008ebd3455 x1858040889744064/t0(0) o400->f05c0a5f-6d48-4113-a63d-e47650e3fd9e@25360@kfi7:131/0 lens 224/224 e 0 to 0 dl 1773852246 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2081-0'
00010000:00000001:27.0:1773851881.937131:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851881.937131:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851881.937132:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=114 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851881.937133:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851881.937134:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000053ae140a refcount 3 to 25360@kfi7
00000100:00000001:27.0:1773851881.937135:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154912 : -107139310396704 : ffff9e8eaf765ae0)
02000000:00000001:27.0:1773851881.937136:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851881.937136:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851881.937137:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851881.937138:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25552@kfi7
00000400:00000010:27.0:1773851881.937138:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047cdbb20.
00000100:00000200:27.0:1773851881.937139:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040889744064, offset 224
00000400:00000200:27.0:1773851881.937140:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25552@kfi7
00000400:00000200:27.0:1773851881.937141:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25552@kfi7 to cpt 6
00000400:00000200:27.0:1773851881.937142:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d046c2e nid 25552@kfi7 refs 1
00000400:00000200:27.0:1773851881.937143:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007d046c2e nid 25552@kfi7 refs 2
00000400:00000200:27.0:1773851881.937144:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007d046c2e nid 25552@kfi7 refs 3
00000400:00000200:27.0:1773851881.937145:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25552@kfi7 local destination
00000400:00000200:27.0:1773851881.937146:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769715:8769715:1024:4294967295] 25552@kfi7 LPNI seq info [1506162:1506162:16:4294967295]
00000400:00000200:27.0:1773851881.937148:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007d046c2e nid 25552@kfi7 refs 2
00000400:00000200:27.0:1773851881.937149:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25552@kfi7 to cpt 6
00000400:00000200:27.0:1773851881.937151:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25552@kfi7(25552@kfi7:25552@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851881.937152:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007d046c2e nid 25552@kfi7 refs 3
00000800:00000200:27.0:1773851881.937153:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851881.937154:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851881.937156:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851881.937159:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001059 Using peer 25552@kfi7(0x100000000001059)
00000800:00000200:27.0:1773851881.937163:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x100000000001059: rc=0
00000800:00000200:27.0:1773851881.937165:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001059 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851881.937167:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851881.937168:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000053ae140a refcount 2 to 25360@kfi7
00010000:00000001:27.0:1773851881.937168:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851881.937169:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851881.937170:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851881.937170:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008ebd3455 x1858040889744064/t0(0) o400->f05c0a5f-6d48-4113-a63d-e47650e3fd9e@25360@kfi7:131/0 lens 224/224 e 0 to 0 dl 1773852246 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2081-0'
00000100:00100000:27.0:1773851881.937174:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008ebd3455 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:f05c0a5f-6d48-4113-a63d-e47650e3fd9e+6:39826:x1858040889744064:12345-25360@kfi7:400:default-tuolumne2081-0 Request processed in 64us (94us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851881.937176:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25360@kfi7, seq: 2025147
00000100:00000040:27.0:1773851881.937177:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003d2fc83b : new rpc_count 0
00000800:00000200:26.0:1773851881.937177:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001059 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851881.937178:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851881.937178:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:26.0:1773851881.937178:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851881.937179:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851881.937179:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:26.0:1773851881.937179:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25552@kfi7: PUT: OK
00000020:00000010:27.0:1773851881.937180:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000052694ebb.
00000400:00000200:26.0:1773851881.937180:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047cdbb20
00000020:00000040:27.0:1773851881.937181:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000003d2fc83b : new refcount 5
00000400:00000010:26.0:1773851881.937181:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047cdbb20.
00000100:00000001:27.0:1773851881.937182:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851881.937182:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851881.937182:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851881.937183:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007d046c2e nid 25552@kfi7 refs 2
00000800:00000200:26.0:1773851881.937184:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 25552@kfi7(0000000043101972):0x0 lsk 4186 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001059 Transaction freed
00000800:00000200:5.0:1773851881.941176:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851881.941177:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851881.941178:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851881.941180:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851881.941182:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851881.941183:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851881.941184:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851881.941184:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851881.941185:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851881.941186:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851881.941187:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851881.941187:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851881.941189:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a879fd280
00000400:00000200:5.0:1773851881.941190:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 7408
00000800:00000200:5.0:1773851881.941192:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851881.941193:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851881.941194:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851881.941195:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851881.941196:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851881.941197:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001999f385.
00000100:00000040:5.0:1773851881.941197:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000001999f385 x1859388107117184 msgsize 224
00000100:00100000:5.0:1773851881.941199:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851881.941200:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851881.941201:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000100:00000001:6.0:1773851881.941202:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851881.941202:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851881.941202:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851881.941203:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851881.941204:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851881.941205:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851881.941206:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107117184
00000020:00000001:6.0:1773851881.941206:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851881.941207:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:6.0:1773851881.941208:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851881.941209:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:6.0:1773851881.941210:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:6.0:1773851881.941210:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:6.0:1773851881.941212:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851881.941213:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851881.941214:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851881.941215:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851881.941216:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851881.941217:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851881.941217:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851881.941218:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851881.941218:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851881.941220:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851881.941221:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851881.941222:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851881.941223:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851881.941223:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851881.941223:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851881.941224:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314084
00000100:00000040:6.0:1773851881.941224:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:6.0:1773851881.941225:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108960384 : -106938600591232 : ffff9ebd6ab2f080)
00000100:00000001:5.0:1773851881.941225:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851881.941225:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851881.941226:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001999f385 x1859388107117184/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:608/0 lens 224/0 e 0 to 0 dl 1773851968 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:6.0:1773851881.941229:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851881.941229:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851881.941230:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001999f385 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40156:x1859388107117184:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:6.0:1773851881.941232:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107117184
00000020:00000001:6.0:1773851881.941233:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851881.941233:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851881.941234:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851881.941235:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851881.941235:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851881.941236:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851881.941237:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851881.941238:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851881.941238:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851881.941239:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851881.941240:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851881.941240:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851881.941241:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000009501d5b0.
02000000:00000001:6.0:1773851881.941242:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851881.941243:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851881.941244:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851881.941244:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851881.941245:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851881.941246:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 82575360 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851881.941247:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132277 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851881.941248:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851881.941249:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107117184
00010000:00000001:6.0:1773851881.941250:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851881.941251:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001999f385 x1859388107117184/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:6.0:1773851881.941253:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851881.941254:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851881.941254:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=110 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851881.941255:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851881.941256:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:6.0:1773851881.941257:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:6.0:1773851881.941258:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851881.941258:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851881.941259:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851881.941260:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:6.0:1773851881.941260:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003599bb60.
00000100:00000200:6.0:1773851881.941262:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107117184, offset 224
00000400:00000200:6.0:1773851881.941263:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:6.0:1773851881.941264:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851881.941265:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:6.0:1773851881.941266:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851881.941267:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:6.0:1773851881.941269:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:6.0:1773851881.941270:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769716:8769716:1024:4294967295] 43@kfi7 LPNI seq info [37492104:37492104:16:4294967295]
00000400:00000200:6.0:1773851881.941271:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851881.941272:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851881.941274:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851881.941275:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:6.0:1773851881.941277:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851881.941278:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851881.941280:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851881.941282:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Using peer 43@kfi7(0x20000000000070b)
00000800:00000200:6.0:1773851881.941286:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000001aa19562: Posted send of 468 bytes to peer 0x20000000000070b: rc=0
00000800:00000200:6.0:1773851881.941287:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851881.941289:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851881.941290:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:6.0:1773851881.941291:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851881.941291:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851881.941292:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851881.941293:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001999f385 x1859388107117184/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:608/0 lens 224/368 e 0 to 0 dl 1773851968 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:6.0:1773851881.941296:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001999f385 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40156:x1859388107117184:12345-61@kfi7:41:default-yuba1-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851881.941299:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851881.941300:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314084
00000400:00000200:5.0:1773851881.941300:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:6.0:1773851881.941301:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000400:00000200:5.0:1773851881.941301:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->43@kfi7: PUT: OK
00000100:00000001:6.0:1773851881.941302:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851881.941302:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851881.941302:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003599bb60
00000020:00000010:6.0:1773851881.941303:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000400:00000010:5.0:1773851881.941303:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003599bb60.
00000100:00000001:5.0:1773851881.941303:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:6.0:1773851881.941304:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000100:00000001:5.0:1773851881.941304:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851881.941304:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000020:00000010:6.0:1773851881.941305:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000020:00000040:6.0:1773851881.941306:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000100:00000001:6.0:1773851881.941306:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851881.941306:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 43@kfi7(00000000a584ab07):0x0 lsk 1804 rsk 1649 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000070b Transaction freed
00000800:00000200:17.0:1773851882.055517:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.055519:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851882.055521:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851882.055525:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851882.055529:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20339@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.055531:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20339@kfi7 : PUT - for me
00000400:00000200:17.0:1773851882.055533:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20339@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.055535:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0847837 nid 20339@kfi7 refs 1
00000400:00000200:17.0:1773851882.055537:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20339@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.055538:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0847837 nid 20339@kfi7 refs 2
00000400:00000200:17.0:1773851882.055540:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a0847837 nid 20339@kfi7 refs 3
00000400:00000200:17.0:1773851882.055542:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20402@kfi7 to cpt 5
00000400:00000200:17.0:1773851882.055544:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20402@kfi7 of length 224 into portal 12 MB=0x69b81a0b1e740
00000400:00000200:17.0:1773851882.055546:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20402@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 30488
00000800:00000200:17.0:1773851882.055549:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851882.055552:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.055554:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20339@kfi7: PUT: OK
00000100:00000001:17.0:1773851882.055556:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851882.055558:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851882.055559:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1ad4cec.
00000100:00000040:17.0:1773851882.055560:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000e1ad4cec x1859830909364032 msgsize 224
00000100:00100000:17.0:1773851882.055563:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20402@kfi7 (source: 12345-20339@kfi7)
00000100:00000001:17.0:1773851882.055566:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851882.055567:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0847837 nid 20339@kfi7 refs 2
00000800:00000200:17.0:1773851882.055570:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851882.055575:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851882.055576:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851882.055576:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851882.055577:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851882.055579:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851882.055580:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830909364032
00000020:00000001:17.0:1773851882.055581:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851882.055582:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce78ce2
00000020:00000001:17.0:1773851882.055583:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851882.055587:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a93e5e5f refcount=5
00000020:00000001:17.0:1773851882.055588:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637002358868992 : -107071350682624 : ffff9e9e822d4c00)
00000020:00000001:17.0:1773851882.055590:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637002358868992 : -107071350682624 : ffff9e9e822d4c00)
00000100:00000001:17.0:1773851882.055591:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851882.055592:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851882.055594:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851882.055595:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851882.055597:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851882.055598:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851882.055599:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851882.055600:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851882.055602:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851882.055602:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851882.055603:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.055605:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851882.055607:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851882.055608:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851882.055608:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851882.055608:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851882.055610:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20402@kfi7, seq: 2156383
00000100:00000040:17.0:1773851882.055612:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a93e5e5f : new rpc_count 1
00000100:00000001:16.0:1773851882.055612:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.055613:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102207360 : -107041607344256 : ffff9ea56f049f80)
00000100:00000001:16.0:1773851882.055613:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851882.055615:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e1ad4cec x1859830909364032/t0(0) o400->04f7d471-b024-47fe-8ad9-b8782b02da23@20402@kfi7:103/0 lens 224/0 e 0 to 0 dl 1773852218 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1754-0'
00000100:00000001:17.0:1773851882.055620:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851882.055621:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851882.055623:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1ad4cec pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:04f7d471-b024-47fe-8ad9-b8782b02da23+5:39538:x1859830909364032:12345-20402@kfi7:400:default-tuolumne1754-0
00000100:00000200:17.0:1773851882.055625:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830909364032
00000020:00000001:17.0:1773851882.055626:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851882.055627:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851882.055628:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.055629:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851882.055630:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851882.055631:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851882.055632:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830909364032, found 0 last_xid 1859830909364031
00000020:00000001:17.0:1773851882.055634:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851882.055635:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851882.055636:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851882.055637:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.055638:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851882.055639:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851882.055640:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851882.055642:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001700370a.
02000000:00000001:17.0:1773851882.055643:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.055644:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.055645:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851882.055647:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096680788, transno 0, xid 1859830909364032
00010000:00000001:17.0:1773851882.055648:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851882.055650:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e1ad4cec x1859830909364032/t0(0) o400->04f7d471-b024-47fe-8ad9-b8782b02da23@20402@kfi7:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1754-0'
00010000:00000001:17.0:1773851882.055654:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851882.055655:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851882.055658:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=115 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851882.055660:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851882.055661:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001aca6514 refcount 3 to 20402@kfi7
00000100:00000001:17.0:1773851882.055662:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108320 : -107156354443296 : ffff9e8ab78ed7e0)
02000000:00000001:17.0:1773851882.055664:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851882.055665:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.055666:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851882.055667:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20339@kfi7
00000400:00000010:17.0:1773851882.055668:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004efcc765.
00000100:00000200:17.0:1773851882.055669:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830909364032, offset 224
00000400:00000200:17.0:1773851882.055671:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20339@kfi7
00000400:00000200:17.0:1773851882.055673:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20339@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.055674:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0847837 nid 20339@kfi7 refs 1
00000400:00000200:17.0:1773851882.055676:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a0847837 nid 20339@kfi7 refs 2
00000400:00000200:17.0:1773851882.055678:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a0847837 nid 20339@kfi7 refs 3
00000400:00000200:17.0:1773851882.055680:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20339@kfi7 local destination
00000400:00000200:17.0:1773851882.055682:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769717:8769717:1024:4294967295] 20339@kfi7 LPNI seq info [154935:154935:16:4294967295]
00000400:00000200:17.0:1773851882.055685:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a0847837 nid 20339@kfi7 refs 2
00000400:00000200:17.0:1773851882.055686:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20339@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.055689:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20339@kfi7(20339@kfi7:20339@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851882.055691:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a0847837 nid 20339@kfi7 refs 3
00000800:00000200:17.0:1773851882.055693:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.055694:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851882.055698:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851882.055701:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdd4 Using peer 20339@kfi7(0xdd4)
00000800:00000200:17.0:1773851882.055706:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0xdd4: rc=0
00000800:00000200:17.0:1773851882.055708:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdd4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851882.055716:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851882.055717:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001aca6514 refcount 2 to 20402@kfi7
00010000:00000001:17.0:1773851882.055718:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851882.055719:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.055720:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851882.055721:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1ad4cec x1859830909364032/t0(0) o400->04f7d471-b024-47fe-8ad9-b8782b02da23@20402@kfi7:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1754-0'
00000800:00000200:18.0:1773851882.055723:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdd4 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851882.055732:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851882.055734:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20339@kfi7: PUT: OK
00000100:00100000:17.0:1773851882.055734:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1ad4cec pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:04f7d471-b024-47fe-8ad9-b8782b02da23+5:39538:x1859830909364032:12345-20402@kfi7:400:default-tuolumne1754-0 Request processed in 112us (172us total) trans 0 rc 0/0
00000400:00000200:18.0:1773851882.055735:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004efcc765
00000400:00000010:18.0:1773851882.055735:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004efcc765.
00000100:00000001:18.0:1773851882.055736:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851882.055737:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851882.055738:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0847837 nid 20339@kfi7 refs 2
00000100:00100000:17.0:1773851882.055738:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20402@kfi7, seq: 2156383
00000100:00000040:17.0:1773851882.055739:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a93e5e5f : new rpc_count 0
00000100:00000001:17.0:1773851882.055740:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851882.055741:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 20339@kfi7(00000000c65021ee):0x0 lsk 3541 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0xdd4 Transaction freed
00000100:00000001:17.0:1773851882.055741:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851882.055742:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851882.055743:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:17.0:1773851882.055744:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000020:00000040:17.0:1773851882.055745:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000a93e5e5f : new refcount 4
00000100:00000001:17.0:1773851882.055746:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851882.137188:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851882.137189:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851882.137190:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851882.137192:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851882.137193:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18419@kfi7 to cpt 1
00000400:00000200:5.0:1773851882.137194:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18419@kfi7 : PUT - for me
00000400:00000200:5.0:1773851882.137195:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18419@kfi7 to cpt 1
00000400:00000200:5.0:1773851882.137196:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006da806bc nid 18419@kfi7 refs 1
00000400:00000200:5.0:1773851882.137197:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18419@kfi7 to cpt 1
00000400:00000200:5.0:1773851882.137198:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006da806bc nid 18419@kfi7 refs 2
00000400:00000200:5.0:1773851882.137198:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006da806bc nid 18419@kfi7 refs 3
00000400:00000200:5.0:1773851882.137199:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18226@kfi7 to cpt 3
00000400:00000200:5.0:1773851882.137200:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18226@kfi7 of length 224 into portal 12 MB=0x69b097bc37e40
00000400:00000200:5.0:1773851882.137201:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18226@kfi7 of length 224/224 into md 0x793926dc5 [64] + 153200
00000800:00000200:5.0:1773851882.137203:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851882.137205:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851882.137206:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18419@kfi7: PUT: OK
00000100:00000001:5.0:1773851882.137206:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851882.137207:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851882.137208:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f232033b.
00000100:00000040:5.0:1773851882.137208:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000f232033b x1859314893684288 msgsize 224
00000100:00100000:5.0:1773851882.137210:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-18226@kfi7 (source: 12345-18419@kfi7)
00000100:00000001:5.0:1773851882.137210:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851882.137211:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006da806bc nid 18419@kfi7 refs 2
00000100:00000001:7.0:1773851882.137212:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851882.137213:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851882.137213:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851882.137213:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851882.137214:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851882.137215:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851882.137215:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314893684288
00000020:00000001:7.0:1773851882.137216:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851882.137216:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917e7
00000020:00000001:7.0:1773851882.137217:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851882.137218:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f851a1f2 refcount=6
00000020:00000001:7.0:1773851882.137219:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241751552 : -107152467800064 : ffff9e8b9f385000)
00000020:00000001:7.0:1773851882.137220:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241751552 : -107152467800064 : ffff9e8b9f385000)
00000100:00000001:7.0:1773851882.137221:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851882.137222:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851882.137222:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851882.137223:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851882.137224:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851882.137225:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851882.137225:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851882.137226:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851882.137227:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851882.137227:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851882.137228:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.137229:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851882.137230:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851882.137230:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851882.137230:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851882.137231:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18226@kfi7, seq: 2001953
00000100:00000001:4.0:1773851882.137231:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851882.137232:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f851a1f2 : new rpc_count 1
00000100:00000001:4.0:1773851882.137232:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.137233:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108956928 : -106938600594688 : ffff9ebd6ab2e300)
00000100:00000001:4.0:1773851882.137233:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851882.137234:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f232033b x1859314893684288/t0(0) o400->d1da5f82-1bee-4eb8-b412-92e09775d329@18226@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1625-0'
00000100:00000001:7.0:1773851882.137237:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851882.137237:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851882.137238:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f232033b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d1da5f82-1bee-4eb8-b412-92e09775d329+6:39596:x1859314893684288:12345-18226@kfi7:400:default-tuolumne1625-0
00000100:00000200:7.0:1773851882.137239:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314893684288
00000020:00000001:7.0:1773851882.137240:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851882.137240:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851882.137241:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.137242:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851882.137242:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851882.137243:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851882.137244:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314893684288, found 0 last_xid 1859314893684287
00000020:00000001:7.0:1773851882.137244:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851882.137245:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851882.137246:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851882.137247:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.137247:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851882.137248:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851882.137249:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851882.137249:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000023886e40.
02000000:00000001:7.0:1773851882.137250:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.137250:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.137251:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851882.137252:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044105736, transno 0, xid 1859314893684288
00010000:00000001:7.0:1773851882.137252:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851882.137253:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f232033b x1859314893684288/t0(0) o400->d1da5f82-1bee-4eb8-b412-92e09775d329@18226@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1625-0'
00010000:00000001:7.0:1773851882.137255:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851882.137256:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851882.137257:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=114 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851882.137258:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851882.137258:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004f6fe1be refcount 3 to 18226@kfi7
00000100:00000001:7.0:1773851882.137259:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487623328 : -107151221928288 : ffff9e8be97acea0)
02000000:00000001:7.0:1773851882.137260:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851882.137260:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.137261:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851882.137262:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18419@kfi7
00000400:00000010:7.0:1773851882.137262:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f88013b1.
00000100:00000200:7.0:1773851882.137263:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314893684288, offset 224
00000400:00000200:7.0:1773851882.137264:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18419@kfi7
00000400:00000200:7.0:1773851882.137265:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18419@kfi7 to cpt 1
00000400:00000200:7.0:1773851882.137266:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006da806bc nid 18419@kfi7 refs 1
00000400:00000200:7.0:1773851882.137267:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006da806bc nid 18419@kfi7 refs 2
00000400:00000200:7.0:1773851882.137268:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006da806bc nid 18419@kfi7 refs 3
00000400:00000200:7.0:1773851882.137269:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18419@kfi7 local destination
00000400:00000200:7.0:1773851882.137270:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769718:8769718:1024:4294967295] 18419@kfi7 LPNI seq info [8732095:8732095:16:4294967295]
00000400:00000200:7.0:1773851882.137272:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006da806bc nid 18419@kfi7 refs 2
00000400:00000200:7.0:1773851882.137273:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18419@kfi7 to cpt 1
00000400:00000200:7.0:1773851882.137275:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18419@kfi7(18419@kfi7:18419@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851882.137276:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006da806bc nid 18419@kfi7 refs 3
00000800:00000200:7.0:1773851882.137278:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851882.137279:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851882.137281:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851882.137283:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001001 Using peer 18419@kfi7(0x100000000001001)
00000800:00000200:7.0:1773851882.137286:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x100000000001001: rc=0
00000800:00000200:7.0:1773851882.137288:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001001 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851882.137290:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851882.137290:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004f6fe1be refcount 2 to 18226@kfi7
00010000:00000001:7.0:1773851882.137291:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851882.137292:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.137292:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851882.137293:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f232033b x1859314893684288/t0(0) o400->d1da5f82-1bee-4eb8-b412-92e09775d329@18226@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1625-0'
00000100:00100000:7.0:1773851882.137296:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f232033b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d1da5f82-1bee-4eb8-b412-92e09775d329+6:39596:x1859314893684288:12345-18226@kfi7:400:default-tuolumne1625-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851882.137298:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18226@kfi7, seq: 2001953
00000100:00000040:7.0:1773851882.137299:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f851a1f2 : new rpc_count 0
00000800:00000200:5.0:1773851882.137299:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001001 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851882.137300:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851882.137300:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851882.137301:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851882.137301:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851882.137301:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18419@kfi7: PUT: OK
00000020:00000010:7.0:1773851882.137302:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000400:00000200:5.0:1773851882.137302:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f88013b1
00000020:00000010:7.0:1773851882.137303:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000400:00000010:5.0:1773851882.137303:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f88013b1.
00000100:00000001:5.0:1773851882.137303:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:7.0:1773851882.137304:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000f851a1f2 : new refcount 5
00000100:00000001:5.0:1773851882.137304:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851882.137304:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006da806bc nid 18419@kfi7 refs 2
00000100:00000001:7.0:1773851882.137305:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851882.137306:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 18419@kfi7(00000000550ae651):0x0 lsk 4098 rsk 46 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000001001 Transaction freed
00000800:00000200:13.0:1773851882.147194:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851882.147194:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851882.147195:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851882.147197:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851882.147199:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18595@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.147200:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18595@kfi7 : PUT - for me
00000400:00000200:13.0:1773851882.147201:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18595@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.147202:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097530667 nid 18595@kfi7 refs 1
00000400:00000200:13.0:1773851882.147203:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18595@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.147203:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097530667 nid 18595@kfi7 refs 2
00000400:00000200:13.0:1773851882.147204:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000097530667 nid 18595@kfi7 refs 3
00000400:00000200:13.0:1773851882.147205:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18530@kfi7 to cpt 4
00000400:00000200:13.0:1773851882.147206:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18530@kfi7 of length 224 into portal 12 MB=0x699e107bddcc0
00000400:00000200:13.0:1773851882.147207:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18530@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 42672
00000800:00000200:13.0:1773851882.147209:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851882.147210:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851882.147211:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18595@kfi7: PUT: OK
00000100:00000001:13.0:1773851882.147212:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851882.147213:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851882.147213:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005c87d00f.
00000100:00000040:13.0:1773851882.147214:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005c87d00f x1858041636838592 msgsize 224
00000100:00100000:13.0:1773851882.147215:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18530@kfi7 (source: 12345-18595@kfi7)
00000100:00000001:13.0:1773851882.147216:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851882.147217:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000097530667 nid 18595@kfi7 refs 2
00000100:00000001:15.0:1773851882.147218:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851882.147218:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851882.147219:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851882.147219:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851882.147219:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851882.147220:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851882.147221:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041636838592
00000020:00000001:15.0:1773851882.147221:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851882.147222:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92394
00000020:00000001:15.0:1773851882.147222:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851882.147227:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047b179cd refcount=6
00000020:00000001:15.0:1773851882.147227:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630300672 : -107123079250944 : ffff9e9276e9fc00)
00000020:00000001:15.0:1773851882.147228:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630300672 : -107123079250944 : ffff9e9276e9fc00)
00000100:00000001:15.0:1773851882.147229:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.147230:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851882.147230:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000916e2cfc.
00000020:00000010:15.0:1773851882.147231:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851882.147232:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851882.147233:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851882.147233:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851882.147234:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.147235:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851882.147235:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851882.147235:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.147236:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.147237:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851882.147238:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851882.147238:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851882.147238:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851882.147239:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18530@kfi7, seq: 2289883
00000100:00000040:15.0:1773851882.147239:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047b179cd : new rpc_count 1
00000100:00000001:15.0:1773851882.147240:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902261760 : -106994807289856 : ffff9eb05484c800)
00000100:00000001:12.0:1773851882.147240:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851882.147240:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851882.147241:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005c87d00f x1858041636838592/t0(0) o400->30f2ea7e-3194-47ed-be58-3467a1784929@18530@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1644-0'
00000100:00000001:15.0:1773851882.147244:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.147244:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851882.147245:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c87d00f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:30f2ea7e-3194-47ed-be58-3467a1784929+6:39663:x1858041636838592:12345-18530@kfi7:400:default-tuolumne1644-0
00000100:00000200:15.0:1773851882.147246:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041636838592
00000020:00000001:15.0:1773851882.147247:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851882.147247:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851882.147248:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.147248:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851882.147249:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851882.147250:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851882.147250:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041636838592, found 0 last_xid 1858041636838591
00000020:00000001:15.0:1773851882.147251:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851882.147251:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851882.147252:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851882.147252:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.147253:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851882.147254:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851882.147254:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851882.147255:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a69e3790.
02000000:00000001:15.0:1773851882.147256:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.147256:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.147257:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851882.147258:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260754406, transno 0, xid 1858041636838592
00010000:00000001:15.0:1773851882.147258:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851882.147259:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005c87d00f x1858041636838592/t0(0) o400->30f2ea7e-3194-47ed-be58-3467a1784929@18530@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1644-0'
00010000:00000001:15.0:1773851882.147262:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851882.147263:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851882.147263:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=115 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851882.147264:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851882.147265:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a2ab8368 refcount 3 to 18530@kfi7
00000100:00000001:15.0:1773851882.147266:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960704 : -107156125590912 : ffff9e8ac532da80)
02000000:00000001:15.0:1773851882.147267:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851882.147267:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.147268:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851882.147269:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18595@kfi7
00000400:00000010:15.0:1773851882.147270:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006efdb9c7.
00000100:00000200:15.0:1773851882.147271:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041636838592, offset 224
00000400:00000200:15.0:1773851882.147272:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18595@kfi7
00000400:00000200:15.0:1773851882.147273:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18595@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.147274:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097530667 nid 18595@kfi7 refs 1
00000400:00000200:15.0:1773851882.147276:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000097530667 nid 18595@kfi7 refs 2
00000400:00000200:15.0:1773851882.147277:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000097530667 nid 18595@kfi7 refs 3
00000400:00000200:15.0:1773851882.147278:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18595@kfi7 local destination
00000400:00000200:15.0:1773851882.147279:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769719:8769719:1024:4294967295] 18595@kfi7 LPNI seq info [6974805:6974805:16:4294967295]
00000400:00000200:15.0:1773851882.147280:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000097530667 nid 18595@kfi7 refs 2
00000400:00000200:15.0:1773851882.147281:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18595@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.147283:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18595@kfi7(18595@kfi7:18595@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851882.147284:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000097530667 nid 18595@kfi7 refs 3
00000800:00000200:15.0:1773851882.147286:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851882.147287:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851882.147289:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851882.147291:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ea1 Using peer 18595@kfi7(0x100000000000ea1)
00000800:00000200:15.0:1773851882.147294:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x100000000000ea1: rc=0
00000800:00000200:15.0:1773851882.147295:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ea1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851882.147297:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851882.147298:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a2ab8368 refcount 2 to 18530@kfi7
00010000:00000001:15.0:1773851882.147299:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851882.147299:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.147300:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851882.147301:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005c87d00f x1858041636838592/t0(0) o400->30f2ea7e-3194-47ed-be58-3467a1784929@18530@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1644-0'
00000100:00100000:15.0:1773851882.147304:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c87d00f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:30f2ea7e-3194-47ed-be58-3467a1784929+6:39663:x1858041636838592:12345-18530@kfi7:400:default-tuolumne1644-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851882.147306:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18530@kfi7, seq: 2289883
00000100:00000040:15.0:1773851882.147307:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047b179cd : new rpc_count 0
00000100:00000001:15.0:1773851882.147308:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851882.147308:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851882.147308:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ea1 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851882.147309:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851882.147309:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851882.147310:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000020:00000010:15.0:1773851882.147310:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000916e2cfc.
00000400:00000200:13.0:1773851882.147310:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18595@kfi7: PUT: OK
00000020:00000040:15.0:1773851882.147311:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000047b179cd : new refcount 5
00000400:00000200:13.0:1773851882.147311:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006efdb9c7
00000400:00000010:13.0:1773851882.147311:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006efdb9c7.
00000100:00000001:15.0:1773851882.147312:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851882.147312:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851882.147312:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851882.147313:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000097530667 nid 18595@kfi7 refs 2
00000800:00000200:13.0:1773851882.147314:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 18595@kfi7(000000006214aac7):0x0 lsk 3746 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ea1 Transaction freed
00000800:00000200:29.0:1773851882.149207:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851882.149208:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851882.149211:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851882.149220:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851882.149223:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18209@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.149225:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18209@kfi7 : PUT - for me
00000400:00000200:29.0:1773851882.149227:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18209@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.149228:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583101bd nid 18209@kfi7 refs 1
00000400:00000200:29.0:1773851882.149230:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18209@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.149231:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583101bd nid 18209@kfi7 refs 2
00000400:00000200:29.0:1773851882.149233:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000583101bd nid 18209@kfi7 refs 3
00000400:00000200:29.0:1773851882.149234:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18208@kfi7 to cpt 4
00000400:00000200:29.0:1773851882.149236:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18208@kfi7 of length 224 into portal 12 MB=0x699e0980c0640
00000400:00000200:29.0:1773851882.149238:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18208@kfi7 of length 224/224 into md 0x77fe139dd [64] + 190152
00000800:00000200:29.0:1773851882.149241:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851882.149244:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851882.149245:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18209@kfi7: PUT: OK
00000100:00000001:29.0:1773851882.149247:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851882.149248:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851882.149249:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b7b6badf.
00000100:00000040:29.0:1773851882.149250:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000b7b6badf x1858039762912832 msgsize 224
00000100:00100000:29.0:1773851882.149253:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-18208@kfi7 (source: 12345-18209@kfi7)
00000100:00000001:29.0:1773851882.149255:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851882.149256:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000583101bd nid 18209@kfi7 refs 2
00000800:00000200:29.0:1773851882.149259:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851882.149263:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851882.149264:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851882.149265:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851882.149266:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851882.149267:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851882.149268:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039762912832
00000020:00000001:29.0:1773851882.149270:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851882.149271:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92363
00000020:00000001:29.0:1773851882.149272:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851882.149276:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000789be69d refcount=6
00000020:00000001:29.0:1773851882.149277:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630275072 : -107123079276544 : ffff9e9276e99800)
00000020:00000001:29.0:1773851882.149279:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630275072 : -107123079276544 : ffff9e9276e99800)
00000100:00000001:29.0:1773851882.149281:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851882.149282:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851882.149283:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851882.149285:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851882.149286:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851882.149287:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851882.149288:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851882.149289:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851882.149291:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851882.149291:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851882.149292:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.149294:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851882.149296:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851882.149297:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851882.149297:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851882.149298:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851882.149298:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18208@kfi7, seq: 2055557
00000100:00000040:29.0:1773851882.149299:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000789be69d : new rpc_count 1
00000100:00000001:30.0:1773851882.149300:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851882.149301:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.149301:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058761480704 : -107014948070912 : ffff9eaba408da00)
00000100:00000040:29.0:1773851882.149303:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b7b6badf x1858039762912832/t0(0) o400->c4445939-422f-451d-9a2d-37e469960735@18208@kfi7:670/0 lens 224/0 e 0 to 0 dl 1773852030 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1631-0'
00000100:00000001:29.0:1773851882.149308:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851882.149308:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851882.149310:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7b6badf pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c4445939-422f-451d-9a2d-37e469960735+6:39844:x1858039762912832:12345-18208@kfi7:400:default-tuolumne1631-0
00000100:00000200:29.0:1773851882.149312:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039762912832
00000020:00000001:29.0:1773851882.149313:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851882.149314:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851882.149315:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.149317:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851882.149318:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851882.149319:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851882.149320:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039762912832, found 0 last_xid 1858039762912831
00000020:00000001:29.0:1773851882.149321:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851882.149322:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851882.149323:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851882.149324:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.149325:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851882.149326:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851882.149327:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851882.149328:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b511ce4a.
02000000:00000001:29.0:1773851882.149329:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.149330:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.149332:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851882.149333:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262837205, transno 0, xid 1858039762912832
00010000:00000001:29.0:1773851882.149334:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851882.149335:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b7b6badf x1858039762912832/t0(0) o400->c4445939-422f-451d-9a2d-37e469960735@18208@kfi7:670/0 lens 224/224 e 0 to 0 dl 1773852030 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1631-0'
00010000:00000001:29.0:1773851882.149340:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851882.149341:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851882.149342:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=115 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851882.149344:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851882.149345:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002d0b4b8b refcount 3 to 18208@kfi7
00000100:00000001:29.0:1773851882.149346:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926931066880 : -107146778484736 : ffff9e8cf2546000)
02000000:00000001:29.0:1773851882.149348:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851882.149348:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.149349:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851882.149351:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18209@kfi7
00000400:00000010:29.0:1773851882.149352:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f18c1ca6.
00000100:00000200:29.0:1773851882.149353:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039762912832, offset 224
00000400:00000200:29.0:1773851882.149355:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18209@kfi7
00000400:00000200:29.0:1773851882.149357:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18209@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.149358:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000583101bd nid 18209@kfi7 refs 1
00000400:00000200:29.0:1773851882.149359:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000583101bd nid 18209@kfi7 refs 2
00000400:00000200:29.0:1773851882.149362:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000583101bd nid 18209@kfi7 refs 3
00000400:00000200:29.0:1773851882.149364:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18209@kfi7 local destination
00000400:00000200:29.0:1773851882.149366:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769720:8769720:1024:4294967295] 18209@kfi7 LPNI seq info [100316:100316:16:4294967295]
00000400:00000200:29.0:1773851882.149369:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000583101bd nid 18209@kfi7 refs 2
00000400:00000200:29.0:1773851882.149370:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18209@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.149373:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18209@kfi7(18209@kfi7:18209@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851882.149375:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000583101bd nid 18209@kfi7 refs 3
00000800:00000200:29.0:1773851882.149377:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851882.149379:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851882.149383:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851882.149387:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000111a Using peer 18209@kfi7(0x10000000000111a)
00000800:00000200:29.0:1773851882.149392:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x10000000000111a: rc=0
00000800:00000200:29.0:1773851882.149395:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000111a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851882.149398:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851882.149399:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002d0b4b8b refcount 2 to 18208@kfi7
00010000:00000001:29.0:1773851882.149400:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851882.149401:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.149402:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851882.149404:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b7b6badf x1858039762912832/t0(0) o400->c4445939-422f-451d-9a2d-37e469960735@18208@kfi7:670/0 lens 224/224 e 0 to 0 dl 1773852030 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1631-0'
00000800:00000200:30.0:1773851882.149408:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000111a TN_EVENT_TX_OK event status 0
00000100:00100000:29.0:1773851882.149409:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7b6badf pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c4445939-422f-451d-9a2d-37e469960735+6:39844:x1858039762912832:12345-18208@kfi7:400:default-tuolumne1631-0 Request processed in 100us (157us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851882.149412:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:29.0:1773851882.149413:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18208@kfi7, seq: 2055557
00000400:00000200:30.0:1773851882.149414:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18209@kfi7: PUT: OK
00000100:00000040:29.0:1773851882.149414:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000789be69d : new rpc_count 0
00000400:00000200:30.0:1773851882.149415:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f18c1ca6
00000400:00000010:30.0:1773851882.149416:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f18c1ca6.
00000100:00000001:29.0:1773851882.149416:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851882.149417:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851882.149417:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:30.0:1773851882.149418:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:29.0:1773851882.149418:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851882.149419:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000583101bd nid 18209@kfi7 refs 2
00000020:00000010:29.0:1773851882.149419:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851882.149420:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000800:00000200:30.0:1773851882.149422:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 18209@kfi7(00000000f944cc61):0x0 lsk 4379 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000111a Transaction freed
00000020:00000040:29.0:1773851882.149422:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000789be69d : new refcount 5
00000100:00000001:29.0:1773851882.149423:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851882.264287:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851882.264288:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851882.264290:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008cd44c55: 2069@kfi7:3 <- 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851882.264292:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008cd44c55: 2069@kfi7:3 <- 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851882.264294:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23585@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.264296:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23585@kfi7 : PUT - for me
00000400:00000200:15.0:1773851882.264297:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23585@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.264298:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f231154 nid 23585@kfi7 refs 1
00000400:00000200:15.0:1773851882.264300:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23585@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.264300:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f231154 nid 23585@kfi7 refs 2
00000400:00000200:15.0:1773851882.264301:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006f231154 nid 23585@kfi7 refs 3
00000400:00000200:15.0:1773851882.264302:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23777@kfi7 to cpt 6
00000400:00000200:15.0:1773851882.264303:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23777@kfi7 of length 224 into portal 12 MB=0x69b0a705be780
00000400:00000200:15.0:1773851882.264305:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23777@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 42896
00000800:00000200:15.0:1773851882.264307:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008cd44c55: 2069@kfi7:3 <- 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851882.264309:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851882.264310:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23585@kfi7: PUT: OK
00000100:00000001:15.0:1773851882.264312:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851882.264312:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851882.264313:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009e59aa5.
00000100:00000040:15.0:1773851882.264314:0:2513974:0:(events.c:358:request_in_callback()) incoming req@0000000009e59aa5 x1859318997313408 msgsize 224
00000100:00100000:15.0:1773851882.264316:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-23777@kfi7 (source: 12345-23585@kfi7)
00000100:00000001:15.0:1773851882.264318:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851882.264319:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006f231154 nid 23585@kfi7 refs 2
00000800:00000200:15.0:1773851882.264321:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008cd44c55: 2069@kfi7:3 <- 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851882.264323:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851882.264324:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851882.264324:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851882.264325:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851882.264326:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851882.264327:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318997313408
00000020:00000001:15.0:1773851882.264327:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851882.264328:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bba
00000020:00000001:15.0:1773851882.264329:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851882.264333:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001bba3921 refcount=6
00000020:00000001:15.0:1773851882.264334:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743940096 : -107128965611520 : ffff9e91180f4000)
00000020:00000001:15.0:1773851882.264335:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743940096 : -107128965611520 : ffff9e91180f4000)
00000100:00000001:15.0:1773851882.264336:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.264337:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851882.264338:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005a6ddf9a.
00000020:00000010:15.0:1773851882.264339:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851882.264340:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851882.264342:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851882.264342:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851882.264343:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.264343:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851882.264344:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851882.264344:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.264345:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.264346:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851882.264347:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851882.264348:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23777@kfi7, seq: 2289884
00000100:00000001:12.0:1773851882.264348:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851882.264348:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851882.264349:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001bba3921 : new rpc_count 1
00000100:00000001:12.0:1773851882.264349:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.264350:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860220672 : -107049849330944 : ffff9ea383c1e300)
00000100:00000040:15.0:1773851882.264351:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009e59aa5 x1859318997313408/t0(0) o400->d63191d8-0241-491e-81fd-1c42f6210088@23777@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1967-0'
00000100:00000001:12.0:1773851882.264351:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.264354:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.264354:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851882.264355:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009e59aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:d63191d8-0241-491e-81fd-1c42f6210088+6:39521:x1859318997313408:12345-23777@kfi7:400:default-tuolumne1967-0
00000100:00000200:15.0:1773851882.264357:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318997313408
00000020:00000001:15.0:1773851882.264358:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851882.264359:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851882.264359:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.264360:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851882.264360:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851882.264361:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851882.264361:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318997313408, found 0 last_xid 1859318997313407
00000020:00000001:15.0:1773851882.264362:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851882.264363:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851882.264363:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851882.264364:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.264364:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851882.264365:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851882.264365:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851882.264366:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000916e2cfc.
02000000:00000001:15.0:1773851882.264366:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.264367:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.264368:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851882.264368:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182420920749, transno 0, xid 1859318997313408
00010000:00000001:15.0:1773851882.264369:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851882.264370:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009e59aa5 x1859318997313408/t0(0) o400->d63191d8-0241-491e-81fd-1c42f6210088@23777@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1967-0'
00010000:00000001:15.0:1773851882.264372:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851882.264372:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851882.264373:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=115 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851882.264374:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851882.264375:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000079d6b38b refcount 3 to 23777@kfi7
00000100:00000001:15.0:1773851882.264375:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329664 : -107155410221952 : ffff9e8aefd68480)
02000000:00000001:15.0:1773851882.264376:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851882.264376:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.264377:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851882.264378:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23585@kfi7
00000400:00000010:15.0:1773851882.264378:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a10312a3.
00000100:00000200:15.0:1773851882.264379:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318997313408, offset 224
00000400:00000200:15.0:1773851882.264380:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23585@kfi7
00000400:00000200:15.0:1773851882.264381:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23585@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.264382:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f231154 nid 23585@kfi7 refs 1
00000400:00000200:15.0:1773851882.264383:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006f231154 nid 23585@kfi7 refs 2
00000400:00000200:15.0:1773851882.264384:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006f231154 nid 23585@kfi7 refs 3
00000400:00000200:15.0:1773851882.264385:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23585@kfi7 local destination
00000400:00000200:15.0:1773851882.264386:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769721:8769721:1024:4294967295] 23585@kfi7 LPNI seq info [16292785:16292785:16:4294967295]
00000400:00000200:15.0:1773851882.264387:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006f231154 nid 23585@kfi7 refs 2
00000400:00000200:15.0:1773851882.264388:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23585@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.264390:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23585@kfi7(23585@kfi7:23585@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851882.264391:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006f231154 nid 23585@kfi7 refs 3
00000800:00000200:15.0:1773851882.264392:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851882.264393:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851882.264394:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851882.264396:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa2b Using peer 23585@kfi7(0xa2b)
00000800:00000200:15.0:1773851882.264399:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0xa2b: rc=0
00000800:00000200:15.0:1773851882.264400:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa2b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851882.264402:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851882.264403:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000079d6b38b refcount 2 to 23777@kfi7
00010000:00000001:15.0:1773851882.264404:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851882.264404:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.264405:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851882.264405:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009e59aa5 x1859318997313408/t0(0) o400->d63191d8-0241-491e-81fd-1c42f6210088@23777@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1967-0'
00000100:00100000:15.0:1773851882.264408:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009e59aa5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:d63191d8-0241-491e-81fd-1c42f6210088+6:39521:x1859318997313408:12345-23777@kfi7:400:default-tuolumne1967-0 Request processed in 53us (93us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851882.264410:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23777@kfi7, seq: 2289884
00000100:00000040:15.0:1773851882.264411:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001bba3921 : new rpc_count 0
00000100:00000001:15.0:1773851882.264412:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851882.264412:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851882.264413:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851882.264413:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000020:00000010:15.0:1773851882.264414:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005a6ddf9a.
00000020:00000040:15.0:1773851882.264415:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000001bba3921 : new refcount 5
00000100:00000001:15.0:1773851882.264415:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851882.264416:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa2b TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851882.264418:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851882.264420:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23585@kfi7: PUT: OK
00000400:00000200:13.0:1773851882.264421:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a10312a3
00000400:00000010:13.0:1773851882.264422:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a10312a3.
00000100:00000001:13.0:1773851882.264423:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851882.264424:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851882.264425:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006f231154 nid 23585@kfi7 refs 2
00000800:00000200:13.0:1773851882.264427:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 23585@kfi7(00000000a7986c51):0x0 lsk 2604 rsk 52 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa2b Transaction freed
00000800:00000200:10.0:1773851882.268865:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851882.268866:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851882.268867:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851882.268869:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851882.268871:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25200@kfi7 to cpt 2
00000400:00000200:10.0:1773851882.268872:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25200@kfi7 : PUT - for me
00000400:00000200:10.0:1773851882.268873:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25200@kfi7 to cpt 2
00000400:00000200:10.0:1773851882.268874:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000704624cb nid 25200@kfi7 refs 1
00000400:00000200:10.0:1773851882.268875:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25200@kfi7 to cpt 2
00000400:00000200:10.0:1773851882.268876:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000704624cb nid 25200@kfi7 refs 2
00000400:00000200:10.0:1773851882.268877:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000704624cb nid 25200@kfi7 refs 3
00000400:00000200:10.0:1773851882.268878:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25265@kfi7 to cpt 1
00000400:00000200:10.0:1773851882.268878:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25265@kfi7 of length 224 into portal 12 MB=0x699e14ef5e780
00000400:00000200:10.0:1773851882.268880:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25265@kfi7 of length 224/224 into md 0x78146ce49 [64] + 146208
00000800:00000200:10.0:1773851882.268881:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851882.268883:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851882.268884:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25200@kfi7: PUT: OK
00000100:00000001:10.0:1773851882.268885:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851882.268885:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851882.268887:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bb7ef7c5.
00000100:00000040:10.0:1773851882.268887:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000bb7ef7c5 x1858042831693696 msgsize 224
00000100:00100000:10.0:1773851882.268889:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-25265@kfi7 (source: 12345-25200@kfi7)
00000100:00000001:10.0:1773851882.268890:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851882.268891:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:10.0:1773851882.268891:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000704624cb nid 25200@kfi7 refs 2
02000000:00000001:11.0:1773851882.268892:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851882.268892:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851882.268892:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851882.268893:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851882.268894:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851882.268894:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042831693696
00000020:00000001:11.0:1773851882.268895:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851882.268895:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925d2
00000020:00000001:11.0:1773851882.268896:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851882.268898:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000208dc75f refcount=6
00000020:00000001:11.0:1773851882.268899:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630995968 : -107123078555648 : ffff9e9276f49800)
00000020:00000001:11.0:1773851882.268900:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630995968 : -107123078555648 : ffff9e9276f49800)
00000100:00000001:11.0:1773851882.268901:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851882.268902:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851882.268902:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9ba5d0e.
00000020:00000010:11.0:1773851882.268903:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851882.268904:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004334b4cb.
00000100:00000001:11.0:1773851882.268905:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851882.268906:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851882.268906:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851882.268908:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851882.268908:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851882.268908:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.268909:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851882.268910:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851882.268911:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851882.268911:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851882.268911:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851882.268912:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25265@kfi7, seq: 2130814
00000100:00000040:11.0:1773851882.268913:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000208dc75f : new rpc_count 1
00000100:00000001:11.0:1773851882.268913:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087777152 : -106944621774464 : ffff9ebc03cef980)
00000100:00000001:8.0:1773851882.268913:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851882.268914:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bb7ef7c5 x1858042831693696/t0(0) o400->501c7ec3-1f63-4960-87ac-26e14c1e67a2@25265@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2062-0'
00000100:00000001:8.0:1773851882.268914:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.268918:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851882.268918:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851882.268919:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb7ef7c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:501c7ec3-1f63-4960-87ac-26e14c1e67a2+6:39671:x1858042831693696:12345-25265@kfi7:400:default-tuolumne2062-0
00000100:00000200:11.0:1773851882.268920:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042831693696
00000020:00000001:11.0:1773851882.268921:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851882.268922:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851882.268922:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.268923:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851882.268923:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851882.268924:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851882.268925:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042831693696, found 0 last_xid 1858042831693695
00000020:00000001:11.0:1773851882.268925:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851882.268926:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851882.268927:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851882.268927:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.268928:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851882.268928:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851882.268929:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851882.268929:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c71e88b4.
02000000:00000001:11.0:1773851882.268930:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.268931:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.268931:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851882.268932:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044134910, transno 0, xid 1858042831693696
00010000:00000001:11.0:1773851882.268933:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851882.268934:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bb7ef7c5 x1858042831693696/t0(0) o400->501c7ec3-1f63-4960-87ac-26e14c1e67a2@25265@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2062-0'
00010000:00000001:11.0:1773851882.268936:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851882.268936:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851882.268937:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=115 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851882.268938:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851882.268939:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e5de830 refcount 3 to 25265@kfi7
00000100:00000001:11.0:1773851882.268940:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413152 : -107145304138464 : ffff9e8d4a351d20)
02000000:00000001:11.0:1773851882.268941:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851882.268941:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.268942:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851882.268943:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25200@kfi7
00000400:00000010:11.0:1773851882.268943:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000800d7738.
00000100:00000200:11.0:1773851882.268944:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042831693696, offset 224
00000400:00000200:11.0:1773851882.268945:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25200@kfi7
00000400:00000200:11.0:1773851882.268946:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25200@kfi7 to cpt 2
00000400:00000200:11.0:1773851882.268947:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000704624cb nid 25200@kfi7 refs 1
00000400:00000200:11.0:1773851882.268948:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000704624cb nid 25200@kfi7 refs 2
00000400:00000200:11.0:1773851882.268949:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000704624cb nid 25200@kfi7 refs 3
00000400:00000200:11.0:1773851882.268950:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25200@kfi7 local destination
00000400:00000200:11.0:1773851882.268951:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769722:8769722:1024:4294967295] 25200@kfi7 LPNI seq info [471144:471144:16:4294967295]
00000400:00000200:11.0:1773851882.268953:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000704624cb nid 25200@kfi7 refs 2
00000400:00000200:11.0:1773851882.268953:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25200@kfi7 to cpt 2
00000400:00000200:11.0:1773851882.268955:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25200@kfi7(25200@kfi7:25200@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851882.268957:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000704624cb nid 25200@kfi7 refs 3
00000800:00000200:11.0:1773851882.268958:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851882.268959:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851882.268961:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851882.268963:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ce7 Using peer 25200@kfi7(0x100000000000ce7)
00000800:00000200:11.0:1773851882.268966:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x100000000000ce7: rc=0
00000800:00000200:11.0:1773851882.268967:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ce7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851882.268969:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851882.268970:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e5de830 refcount 2 to 25265@kfi7
00010000:00000001:11.0:1773851882.268971:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851882.268972:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.268973:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851882.268973:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bb7ef7c5 x1858042831693696/t0(0) o400->501c7ec3-1f63-4960-87ac-26e14c1e67a2@25265@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2062-0'
00000100:00100000:11.0:1773851882.268976:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb7ef7c5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:501c7ec3-1f63-4960-87ac-26e14c1e67a2+6:39671:x1858042831693696:12345-25265@kfi7:400:default-tuolumne2062-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851882.268979:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25265@kfi7, seq: 2130814
00000100:00000040:11.0:1773851882.268980:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000208dc75f : new rpc_count 0
00000100:00000001:11.0:1773851882.268980:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851882.268980:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ce7 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851882.268981:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851882.268981:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:9.0:1773851882.268981:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851882.268982:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004334b4cb.
00000400:00000200:9.0:1773851882.268982:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25200@kfi7: PUT: OK
00000020:00000010:11.0:1773851882.268983:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9ba5d0e.
00000400:00000200:9.0:1773851882.268983:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000800d7738
00000020:00000040:11.0:1773851882.268984:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000208dc75f : new refcount 5
00000100:00000001:11.0:1773851882.268984:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851882.268984:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000800d7738.
00000100:00000001:9.0:1773851882.268985:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851882.268985:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851882.268986:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000704624cb nid 25200@kfi7 refs 2
00000800:00000200:9.0:1773851882.268987:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 25200@kfi7(00000000bda2272f):0x0 lsk 3304 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ce7 Transaction freed
00000004:00000001:8.0:1773851882.313733:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851882.313734:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851882.313734:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851882.313734:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000098ed735f.
00000004:00000020:28.0:1773851882.313735:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:8.0:1773851882.313735:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000100:00000010:28.0:1773851882.313736:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dd126538.
00000100:00000001:8.0:1773851882.313736:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:30.0:1773851882.313737:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851882.313737:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:8.0:1773851882.313737:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000001:29.0:1773851882.313738:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851882.313738:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:28.0:1773851882.313738:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
02000000:00000001:8.0:1773851882.313738:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:30.0:1773851882.313739:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bbbc6c68.
00000100:00000001:28.0:1773851882.313739:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:8.0:1773851882.313739:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000020:00000040:30.0:1773851882.313740:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000100:00000010:29.0:1773851882.313740:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a30876a5.
02000000:00000001:28.0:1773851882.313740:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851882.313740:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851882.313741:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:29.0:1773851882.313741:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
02000000:00000001:28.0:1773851882.313741:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.313741:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:30.0:1773851882.313742:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851882.313742:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.313743:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851882.313743:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:28.0:1773851882.313743:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004cbfdeea.
00000100:00000040:8.0:1773851882.313743:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000098ed735f] to pc [ptlrpcd_02_02+2]  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851882.313744:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851882.313744:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851882.313745:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006a3b4e25.
00000100:00000001:28.0:1773851882.313745:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851882.313746:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:28.0:1773851882.313746:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851882.313747:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851882.313747:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.313748:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851882.313748:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851882.313749:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851882.313749:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000010:8.0:1773851882.313749:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000016817709.
00000100:00000001:30.0:1773851882.313750:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.313750:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851882.313750:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000dd126538] to pc [ptlrpcd_07_01+1]  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851882.313750:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851882.313750:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:8.0:1773851882.313750:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637109778929664 : -106963930621952 : ffff9eb784e95800)
00000100:00000001:10.0:1773851882.313751:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.313751:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:8.0:1773851882.313751:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851882.313752:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851882.313752:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851882.313753:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000bbbc6c68] to pc [ptlrpcd_07_03+3]  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851882.313753:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a30876a5] to pc [ptlrpcd_07_02+2]  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:8.0:1773851882.313753:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00000100:00000040:9.0:1773851882.313754:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:8.0:1773851882.313756:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000093d522ac.
00000004:00080000:8.0:1773851882.313757:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614156767032596ns, next at 614157767029330ns, rc = 0
00000100:00000001:31.0:1773851882.313758:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:8.0:1773851882.313758:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:31.0:1773851882.313759:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851882.313759:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851882.313759:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851882.313759:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851882.313759:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851882.313759:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851882.313760:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851882.313761:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851882.313761:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:29.0:1773851882.313761:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:28.0:1773851882.313761:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000090e4bc2e.
02000000:00000001:9.0:1773851882.313761:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851882.313762:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:30.0:1773851882.313763:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008b45a117.
00080000:00000010:29.0:1773851882.313763:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000000fbea343.
00080000:00000001:28.0:1773851882.313763:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636942607812608 : -107131101739008 : ffff9e9098bc8800)
00000100:00000001:31.0:1773851882.313764:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851882.313764:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851882.313764:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:9.0:1773851882.313764:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000098ed735f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051934080:2084@kfi7:13:default-yuba2-0
02000000:00000001:31.0:1773851882.313765:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851882.313765:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851882.313765:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637162951821312 : -106910757730304 : ffff9ec3e6434800)
00080000:00000001:29.0:1773851882.313765:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637069020939264 : -107004688612352 : ffff9eae078bc400)
00000100:00100000:31.0:1773851882.313766:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dd126538 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051934144:9@kfi7:13:default-yuba2-0
00080000:00000001:30.0:1773851882.313766:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851882.313766:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851882.313766:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851882.313767:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000100:00000001:9.0:1773851882.313767:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851882.313768:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851882.313768:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:30.0:1773851882.313768:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851882.313768:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851882.313768:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851882.313769:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851882.313769:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000004:00001000:29.0:1773851882.313769:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00000004:00000010:28.0:1773851882.313769:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002582d5ce.
02000000:00000001:9.0:1773851882.313769:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851882.313770:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:9.0:1773851882.313770:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:31.0:1773851882.313771:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f14d9ff9.
00000004:00000010:30.0:1773851882.313771:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008c3c9be0.
00000004:00000010:29.0:1773851882.313771:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009e6d4c58.
02000000:00000001:31.0:1773851882.313772:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851882.313772:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614156767047674ns, next at 614157767046061ns, rc = 0
00000004:00080000:29.0:1773851882.313772:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614156767047824ns, next at 614157767045941ns, rc = 0
02000000:00000010:9.0:1773851882.313772:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006c07bf65.
00000400:00000200:31.0:1773851882.313773:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:31.0:1773851882.313774:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00080000:00000001:30.0:1773851882.313774:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:29.0:1773851882.313774:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00080000:28.0:1773851882.313774:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614156767049237ns, next at 614157767043837ns, rc = 0
02000000:00000001:9.0:1773851882.313774:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851882.313775:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00080000:00000001:28.0:1773851882.313775:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:9.0:1773851882.313775:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000200:31.0:1773851882.313776:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934144, portal 4
00080000:00000001:29.0:1773851882.313776:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851882.313776:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00080000:00000001:30.0:1773851882.313777:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851882.313777:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851882.313777:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851882.313778:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851882.313778:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324216320 : -106976385335296 : ffff9eb49e8d8000)
00000004:00000001:30.0:1773851882.313778:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851882.313778:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851882.313778:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027709c97.
00000100:00000040:31.0:1773851882.313780:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851882.313780:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934080, portal 4
00000100:00000001:30.0:1773851882.313781:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851882.313781:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851882.313781:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851882.313781:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851882.313782:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:30.0:1773851882.313782:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.313782:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851882.313782:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491274752 : -107117218276864 : ffff9e93d4415a00)
00000100:00000040:31.0:1773851882.313783:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:31.0:1773851882.313784:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018a1fff7.
00000100:00000040:29.0:1773851882.313784:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851882.313784:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851882.313785:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934144, offset 0
00000100:00000001:28.0:1773851882.313785:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851882.313785:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:31.0:1773851882.313786:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000100:00000001:28.0:1773851882.313786:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:31.0:1773851882.313787:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:31.0:1773851882.313788:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000001:29.0:1773851882.313788:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:28.0:1773851882.313788:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851882.313789:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:29.0:1773851882.313789:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.313789:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851882.313790:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000200:31.0:1773851882.313791:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
02000000:00000001:29.0:1773851882.313791:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:9.0:1773851882.313791:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000635b52f2.
00000400:00000200:31.0:1773851882.313792:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
02000000:00000001:29.0:1773851882.313792:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851882.313793:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a30876a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051934272:47@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851882.313793:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000200:9.0:1773851882.313793:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934080, offset 0
00000400:00000200:31.0:1773851882.313794:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769721, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769722, p:4294967295, g:4294967295, h:1000]
00000100:00000001:28.0:1773851882.313794:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851882.313795:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:9.0:1773851882.313795:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:31.0:1773851882.313796:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:29.0:1773851882.313796:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851882.313796:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851882.313797:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
02000000:00000001:29.0:1773851882.313797:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:9.0:1773851882.313797:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851882.313798:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
02000000:00000001:29.0:1773851882.313798:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851882.313798:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bbbc6c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051934208:2104@kfi7:13:default-yuba2-0
00000400:00000200:9.0:1773851882.313798:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:31.0:1773851882.313799:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769723:8769723:1024:4294967295] 9@kfi7 LPNI seq info [5403011:5403011:16:4294967295]
02000000:00000001:29.0:1773851882.313799:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:29.0:1773851882.313800:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000860b557b.
00000100:00000001:28.0:1773851882.313800:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:9.0:1773851882.313800:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851882.313801:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
02000000:00000001:29.0:1773851882.313801:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851882.313801:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:31.0:1773851882.313802:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
02000000:00000001:28.0:1773851882.313802:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851882.313802:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:29.0:1773851882.313803:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
02000000:00000001:28.0:1773851882.313803:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:31.0:1773851882.313804:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000400:00000010:29.0:1773851882.313804:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000008c4dba48.
02000000:00000010:28.0:1773851882.313804:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000481ea804.
00000400:00000200:9.0:1773851882.313804:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
02000000:00000001:28.0:1773851882.313805:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851882.313806:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000010:29.0:1773851882.313806:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f18c1ca6.
00000400:00000200:28.0:1773851882.313807:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:9.0:1773851882.313807:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769723, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769722, p:4294967295, g:4294967295, h:1000]
00000800:00000200:31.0:1773851882.313808:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000200:29.0:1773851882.313808:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934272, portal 4
00000800:00000200:31.0:1773851882.313809:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:28.0:1773851882.313809:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000100:00000001:29.0:1773851882.313810:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851882.313810:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637058761461120 : -107014948090496 : ffff9eaba4088d80)
00000400:00000010:28.0:1773851882.313810:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000063d86a5d.
00000400:00000200:9.0:1773851882.313810:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:31.0:1773851882.313812:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:28.0:1773851882.313812:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934208, portal 4
00000400:00000200:9.0:1773851882.313812:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:29.0:1773851882.313813:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851882.313813:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:31.0:1773851882.313814:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000100:00000001:28.0:1773851882.313814:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411264128 : -106960298287488 : ffff9eb85d6a5e80)
00000400:00000200:9.0:1773851882.313814:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:9.0:1773851882.313815:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769724:8769724:1024:4294967295] 2084@kfi7 LPNI seq info [5402747:5402747:16:4294967295]
00000100:00000001:29.0:1773851882.313817:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851882.313817:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851882.313818:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x31e: rc=0
00000400:00000200:9.0:1773851882.313819:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:31.0:1773851882.313820:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:29.0:1773851882.313820:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000400:00000010:29.0:1773851882.313820:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb36d36b.
00000100:00000200:29.0:1773851882.313821:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934272, offset 0
00000100:00000001:28.0:1773851882.313821:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851882.313821:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:31.0:1773851882.313822:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851882.313823:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:28.0:1773851882.313823:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000100:00000001:31.0:1773851882.313824:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851882.313824:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851882.313824:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000010:28.0:1773851882.313824:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ca2a170b.
00000100:00000001:31.0:1773851882.313825:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851882.313825:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000200:28.0:1773851882.313825:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934208, offset 0
00000100:00000001:31.0:1773851882.313826:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:9.0:1773851882.313826:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000100:00000001:31.0:1773851882.313827:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851882.313827:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000001:31.0:1773851882.313828:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851882.313828:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851882.313828:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851882.313828:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000001:31.0:1773851882.313829:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851882.313829:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:28.0:1773851882.313829:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000800:00000200:9.0:1773851882.313830:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:29.0:1773851882.313831:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:29.0:1773851882.313833:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000800:00000200:9.0:1773851882.313833:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851882.313836:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769723, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769724, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851882.313837:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851882.313841:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Using peer 2084@kfi7(0x2000000000000ff)
00000400:00000200:29.0:1773851882.313843:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851882.313845:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851882.313846:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000800:00000200:9.0:1773851882.313846:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x2000000000000ff: rc=0
00000400:00000200:29.0:1773851882.313848:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769725:8769725:1023:4294967295] 47@kfi7 LPNI seq info [5403022:5403022:16:4294967295]
00000800:00000200:9.0:1773851882.313849:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851882.313851:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:29.0:1773851882.313852:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:9.0:1773851882.313852:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.313853:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:28.0:1773851882.313854:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:9.0:1773851882.313855:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851882.313856:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851882.313856:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000100:00000001:9.0:1773851882.313856:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.313857:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851882.313858:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:28.0:1773851882.313858:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:9.0:1773851882.313859:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:28.0:1773851882.313860:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:9.0:1773851882.313860:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:10.0:1773851882.313861:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851882.313861:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851882.313862:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851882.313862:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000100:00000001:9.0:1773851882.313862:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851882.313863:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851882.313864:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851882.313864:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851882.313864:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851882.313865:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769725, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769724, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851882.313865:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000400:00000200:10.0:1773851882.313867:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000635b52f2
00000400:00000010:10.0:1773851882.313867:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000635b52f2.
00000800:00000200:29.0:1773851882.313868:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:10.0:1773851882.313868:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:28.0:1773851882.313869:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851882.313870:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000200:10.0:1773851882.313870:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851882.313871:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000800:00000200:29.0:1773851882.313872:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 Using peer 47@kfi7(0x274)
00000400:00000200:28.0:1773851882.313873:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769726:8769726:1023:4294967295] 2104@kfi7 LPNI seq info [5403380:5403380:16:4294967295]
00000100:00000001:10.0:1773851882.313874:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:5.0:1773851882.313875:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:28.0:1773851882.313876:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000040:10.0:1773851882.313876:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851882.313877:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 324 bytes to peer 0x274: rc=0
00000400:00000200:28.0:1773851882.313877:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:5.0:1773851882.313877:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851882.313879:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851882.313880:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851882.313880:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851882.313881:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000100:00000001:10.0:1773851882.313881:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:29.0:1773851882.313883:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851882.313883:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:10.0:1773851882.313883:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:5.0:1773851882.313883:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:29.0:1773851882.313884:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851882.313885:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851882.313885:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Transaction freed
00000400:00000200:5.0:1773851882.313886:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:29.0:1773851882.313887:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.313888:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851882.313888:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000100:00000001:29.0:1773851882.313890:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:5.0:1773851882.313890:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:29.0:1773851882.313891:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:5.0:1773851882.313891:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:29.0:1773851882.313892:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851882.313892:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:29.0:1773851882.313893:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851882.313893:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851882.313893:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000800:00000200:31.0:1773851882.313895:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851882.313895:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851882.313895:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851882.313895:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:25.0:1773851882.313895:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:5.0:1773851882.313895:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 4
00000400:00000200:31.0:1773851882.313896:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851882.313896:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:28.0:1773851882.313897:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851882.313897:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:31.0:1773851882.313898:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000800:00000200:25.0:1773851882.313898:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851882.313898:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4dc0
00000400:00000200:31.0:1773851882.313899:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018a1fff7
00000400:00000200:30.0:1773851882.313899:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:31.0:1773851882.313900:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018a1fff7.
00000100:00000001:31.0:1773851882.313900:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:5.0:1773851882.313900:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000200:31.0:1773851882.313901:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851882.313901:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->47@kfi7: PUT: OK
00000800:00000200:28.0:1773851882.313901:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851882.313902:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb36d36b
00000800:00000200:25.0:1773851882.313902:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000010:30.0:1773851882.313903:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb36d36b.
00000400:00000200:5.0:1773851882.313903:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b31825 [1] + 224
00000100:00000001:31.0:1773851882.313904:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851882.313904:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000040:31.0:1773851882.313905:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851882.313905:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000200:30.0:1773851882.313906:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851882.313906:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000800:00000200:5.0:1773851882.313906:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851882.313907:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851882.313907:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2084@kfi7 : PUT - for me
00000100:00000001:31.0:1773851882.313908:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851882.313908:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851882.313909:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:5.0:1773851882.313909:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851882.313910:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:25.0:1773851882.313910:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:5.0:1773851882.313910:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000800:00000200:31.0:1773851882.313911:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000800:00000200:28.0:1773851882.313911:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
00000100:00000040:30.0:1773851882.313912:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851882.313912:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:5.0:1773851882.313912:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851882.313913:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:28.0:1773851882.313914:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000200:5.0:1773851882.313914:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851882.313915:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000001:30.0:1773851882.313916:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851882.313916:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:30.0:1773851882.313917:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851882.313918:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4d80
00000400:00000200:30.0:1773851882.313919:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:28.0:1773851882.313919:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851882.313919:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851882.313920:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:30.0:1773851882.313921:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 Transaction freed
00000100:00000001:28.0:1773851882.313921:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851882.313922:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851882.313922:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b82af9 [1] + 224
00000100:00000001:28.0:1773851882.313924:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851882.313925:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851882.313925:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851882.313925:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851882.313926:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:5.0:1773851882.313926:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:31.0:1773851882.313927:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851882.313927:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851882.313927:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000001:31.0:1773851882.313928:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:25.0:1773851882.313928:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:31.0:1773851882.313929:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851882.313929:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:5.0:1773851882.313929:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000010:31.0:1773851882.313930:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000100:00000001:28.0:1773851882.313930:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:25.0:1773851882.313930:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000400:00000200:31.0:1773851882.313931:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000400:00000010:31.0:1773851882.313932:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:25.0:1773851882.313932:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851882.313932:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000100:00000001:31.0:1773851882.313933:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:31.0:1773851882.313934:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:25.0:1773851882.313934:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851882.313934:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851882.313935:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:31.0:1773851882.313938:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851882.313938:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000100:00000040:25.0:1773851882.313939:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851882.313939:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851882.313941:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851882.313941:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851882.313942:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851882.313942:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:29.0:1773851882.313942:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851882.313942:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:31.0:1773851882.313943:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851882.313943:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851882.313944:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851882.313944:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851882.313945:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851882.313945:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000400:00000200:21.0:1773851882.313945:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 47@kfi7 : PUT - for me
00000100:00001000:31.0:1773851882.313946:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=115 v=66 (66 66 66 66)
00000400:00000200:29.0:1773851882.313946:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ca2a170b
00000100:00000001:25.0:1773851882.313946:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851882.313946:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00001000:31.0:1773851882.313947:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=36 v=66 (1 1 1 1)
00000400:00000010:29.0:1773851882.313947:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ca2a170b.
00000100:00000001:29.0:1773851882.313948:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:25.0:1773851882.313948:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:31.0:1773851882.313949:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851882.313949:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851882.313949:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000001:9.0:1773851882.313949:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00010000:00000001:31.0:1773851882.313950:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:29.0:1773851882.313950:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851882.313950:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:21.0:1773851882.313950:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:9.0:1773851882.313950:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00010000:00000001:31.0:1773851882.313951:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851882.313952:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851882.313952:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000400:00000200:21.0:1773851882.313952:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000001:9.0:1773851882.313952:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851882.313952:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851882.313953:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851882.313953:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851882.313953:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000010:9.0:1773851882.313954:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000100:00000040:31.0:1773851882.313955:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851882.313955:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:21.0:1773851882.313955:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:9.0:1773851882.313955:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027709c97
00000400:00000010:9.0:1773851882.313956:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027709c97.
00000100:00000040:29.0:1773851882.313957:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851882.313957:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4e40
00000100:00000001:31.0:1773851882.313958:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851882.313959:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851882.313959:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851882.313959:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000004:00000001:31.0:1773851882.313960:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851882.313960:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000040:31.0:1773851882.313961:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000400:00000200:21.0:1773851882.313961:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d1575 [1] + 224
00000004:00000040:31.0:1773851882.313962:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351479985152 avail=351478683648 avail_mb=1372963608 hwm_mb=3131101 files=372073055 ffree=343242173 state=0: rc = 0
00000100:00000001:29.0:1773851882.313962:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851882.313962:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851882.313963:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000004:00000020:31.0:1773851882.313964:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351479985152 free, 351478683648 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073055 files, 343242173 free files
00000400:00000200:29.0:1773851882.313964:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:21.0:1773851882.313965:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851882.313967:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000004:00000001:31.0:1773851882.313968:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851882.313968:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Transaction freed
00000400:00000200:21.0:1773851882.313968:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851882.313968:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:31.0:1773851882.313969:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:13.0:1773851882.313969:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851882.313970:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->47@kfi7: PUT: OK
00000800:00000200:13.0:1773851882.313971:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:21.0:1773851882.313972:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851882.313972:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:31.0:1773851882.313973:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dd126538 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051934144:9@kfi7:13:default-yuba2-0
00000400:00000200:13.0:1773851882.313973:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000200:21.0:1773851882.313974:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851882.313974:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000100:00000001:31.0:1773851882.313975:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851882.313975:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:31.0:1773851882.313976:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:13.0:1773851882.313976:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000100:00000040:31.0:1773851882.313977:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000dd126538 x1859433051934144/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:13.0:1773851882.313977:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:9.0:1773851882.313977:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851882.313978:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:13.0:1773851882.313978:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:9.0:1773851882.313978:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:21.0:1773851882.313979:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851882.313979:0:41070:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:31.0:1773851882.313980:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851882.313980:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:13.0:1773851882.313980:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
02000000:00000001:9.0:1773851882.313980:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000010:31.0:1773851882.313981:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f14d9ff9.
00000400:00000200:13.0:1773851882.313981:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4e00
00000100:00000001:9.0:1773851882.313981:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:13.0:1773851882.313982:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:9.0:1773851882.313982:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851882.313983:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851882.313983:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000400:00000200:13.0:1773851882.313983:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f69cd [1] + 224
00000020:00000040:31.0:1773851882.313984:0:41089:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
02000000:00000001:9.0:1773851882.313984:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851882.313985:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851882.313985:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004cbfdeea.
00000800:00000200:13.0:1773851882.313985:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:31.0:1773851882.313986:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:21.0:1773851882.313986:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851882.313986:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00001000:9.0:1773851882.313986:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=115 v=66 (66 66 66 66)
02000000:00000001:31.0:1773851882.313987:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851882.313987:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd126538.
00000400:00000200:13.0:1773851882.313987:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00000001:31.0:1773851882.313988:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000400:00000200:21.0:1773851882.313988:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:13.0:1773851882.313988:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:9.0:1773851882.313988:0:41070:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=115 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851882.313989:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851882.313989:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851882.313989:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:13.0:1773851882.313989:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851882.313990:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851882.313990:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851882.313990:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851882.313990:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851882.313991:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851882.313991:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851882.313991:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851882.313992:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:29.0:1773851882.313992:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:13.0:1773851882.313992:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:9.0:1773851882.313992:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000001:29.0:1773851882.313993:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:9.0:1773851882.313993:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851882.313994:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000008c4dba48.
00000400:00000200:29.0:1773851882.313995:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f18c1ca6
00000100:00000001:9.0:1773851882.313995:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000010:29.0:1773851882.313996:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f18c1ca6.
00000100:00000001:13.0:1773851882.313996:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:9.0:1773851882.313996:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000400:00000200:13.0:1773851882.313997:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:9.0:1773851882.313997:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851882.313998:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851882.313998:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:29.0:1773851882.313999:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851882.313999:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:13.0:1773851882.313999:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851882.314000:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:9.0:1773851882.314000:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:28.0:1773851882.314001:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851882.314002:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:28.0:1773851882.314004:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000200:29.0:1773851882.314005:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851882.314005:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000063d86a5d
00000100:00000001:9.0:1773851882.314005:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:28.0:1773851882.314006:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000063d86a5d.
00000100:00000001:9.0:1773851882.314006:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851882.314007:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851882.314007:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:28.0:1773851882.314009:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:9.0:1773851882.314009:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:29.0:1773851882.314010:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:9.0:1773851882.314010:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000100:00000001:29.0:1773851882.314011:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:9.0:1773851882.314011:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593614336 avail=351576797184 avail_mb=1373346864 hwm_mb=3131103 files=372189913 ffree=343353139 state=0: rc = 0
00000100:00000001:29.0:1773851882.314012:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851882.314013:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851882.314014:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851882.314015:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851882.314015:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:9.0:1773851882.314015:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593614336 free, 351576797184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372189913 files, 343353139 free files
02000000:00000001:29.0:1773851882.314016:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851882.314017:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851882.314018:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=115 v=66 (66 66 66 66)
00000100:00000040:9.0:1773851882.314018:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851882.314019:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851882.314020:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:29.0:1773851882.314021:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=115 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851882.314021:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851882.314022:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851882.314022:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851882.314023:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851882.314023:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.314024:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851882.314025:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:28.0:1773851882.314025:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851882.314025:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000098ed735f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051934080:2084@kfi7:13:default-yuba2-0
00000100:00001000:28.0:1773851882.314026:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=115 v=66 (66 66 66 66)
00010000:00000001:29.0:1773851882.314027:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.314027:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851882.314028:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851882.314028:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851882.314029:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00001000:28.0:1773851882.314029:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=115 v=66 (1 1 1 1)
00000100:00000040:9.0:1773851882.314029:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000098ed735f x1859433051934080/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851882.314030:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851882.314031:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851882.314031:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851882.314031:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.314032:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:29.0:1773851882.314033:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:28.0:1773851882.314033:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:9.0:1773851882.314033:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851882.314033:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006c07bf65.
00010000:00000001:28.0:1773851882.314034:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851882.314035:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:9.0:1773851882.314035:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:28.0:1773851882.314036:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000020:00000001:9.0:1773851882.314036:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851882.314036:0:41070:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000100:00000001:28.0:1773851882.314037:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000020:00000001:9.0:1773851882.314037:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:29.0:1773851882.314038:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851882.314038:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851882.314038:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000040:28.0:1773851882.314039:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:9.0:1773851882.314039:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:29.0:1773851882.314040:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851882.314040:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:9.0:1773851882.314040:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851882.314040:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098ed735f.
00000004:00000001:29.0:1773851882.314041:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851882.314041:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000040:29.0:1773851882.314042:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000100:00000001:28.0:1773851882.314042:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851882.314042:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:29.0:1773851882.314043:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603934208 avail=351601682432 avail_mb=1373444072 hwm_mb=3131103 files=372190399 ffree=343363217 state=0: rc = 0
00000100:00000001:28.0:1773851882.314043:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851882.314043:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851882.314044:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851882.314044:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851882.314044:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851882.314044:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:29.0:1773851882.314045:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603934208 free, 351601682432 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190399 files, 343363217 free files
00000004:00000040:28.0:1773851882.314045:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851882.314045:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851882.314045:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:28.0:1773851882.314046:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615872000 avail=351613287424 avail_mb=1373489404 hwm_mb=3131103 files=372043417 ffree=343374875 state=0: rc = 0
00000004:00000001:29.0:1773851882.314047:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851882.314048:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:28.0:1773851882.314048:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615872000 free, 351613287424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043417 files, 343374875 free files
00000004:00000001:28.0:1773851882.314050:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851882.314051:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a30876a5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051934272:47@kfi7:13:default-yuba2-0
00000100:00000040:28.0:1773851882.314051:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851882.314053:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851882.314054:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851882.314055:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a30876a5 x1859433051934272/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:28.0:1773851882.314055:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bbbc6c68 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051934208:2104@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851882.314057:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851882.314057:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851882.314058:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:28.0:1773851882.314058:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000bbbc6c68 x1859433051934208/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:29.0:1773851882.314059:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851882.314059:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000860b557b.
02000000:00000001:29.0:1773851882.314061:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851882.314061:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851882.314061:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851882.314061:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000040:29.0:1773851882.314062:0:41090:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
02000000:00000010:28.0:1773851882.314062:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000481ea804.
00000020:00000001:29.0:1773851882.314063:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:28.0:1773851882.314063:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000010:29.0:1773851882.314064:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000020:00000001:28.0:1773851882.314064:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851882.314064:0:41091:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
02000000:00000001:29.0:1773851882.314065:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851882.314065:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:28.0:1773851882.314065:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851882.314065:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006a3b4e25.
00000100:00000010:29.0:1773851882.314066:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a30876a5.
02000000:00000001:28.0:1773851882.314066:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:29.0:1773851882.314067:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851882.314067:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:28.0:1773851882.314067:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851882.314067:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bbbc6c68.
00000100:00000001:29.0:1773851882.314068:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851882.314068:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851882.314069:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851882.314069:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851882.314069:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851882.314070:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.314070:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851882.314070:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851882.314070:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.314071:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851882.314071:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851882.314072:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851882.373793:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.373794:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851882.373795:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851882.373797:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851882.373799:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.373800:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.108@tcp : PUT - for me
00000400:00000200:17.0:1773851882.373801:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.373802:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851882.373803:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.108@tcp to cpt 0
00000400:00000200:17.0:1773851882.373805:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001f52d8c1 nid 172.16.70.108@tcp refs 2
00000400:00000200:17.0:1773851882.373806:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001f52d8c1 nid 172.16.70.108@tcp refs 3
00000400:00000200:17.0:1773851882.373808:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.108@tcp to cpt 0
00000400:00000200:17.0:1773851882.373809:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.108@tcp of length 224 into portal 12 MB=0x69a140cb57800
00000400:00000200:17.0:1773851882.373810:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.108@tcp of length 224/224 into md 0x7fb56e801 [64] + 41856
00000800:00000200:17.0:1773851882.373812:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851882.373813:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.373815:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851882.373816:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851882.373816:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851882.373817:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002dfa88e2.
00000100:00000040:17.0:1773851882.373818:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002dfa88e2 x1858260763506688 msgsize 224
00000100:00100000:17.0:1773851882.373819:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.108@tcp (source: 12345-172.16.70.108@tcp)
00000100:00000001:17.0:1773851882.373821:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851882.373822:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851882.373823:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851882.373824:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851882.373824:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851882.373825:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851882.373825:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851882.373826:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851882.373827:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858260763506688
00000020:00000001:0.0:1773851882.373827:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851882.373828:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9306e
00000020:00000001:0.0:1773851882.373831:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851882.373832:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f6454d5c refcount=7
00000020:00000001:0.0:1773851882.373833:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745144320 : -107128964407296 : ffff9e911821a000)
00000020:00000001:0.0:1773851882.373834:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745144320 : -107128964407296 : ffff9e911821a000)
00000100:00000001:0.0:1773851882.373835:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851882.373836:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851882.373836:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851882.373837:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851882.373838:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851882.373839:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851882.373840:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851882.373840:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851882.373841:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851882.373842:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851882.373842:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851882.373843:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851882.373844:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851882.373845:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851882.373846:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851882.373846:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851882.373846:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.108@tcp, seq: 1997597
00000100:00000001:1.0:1773851882.373847:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851882.373847:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f6454d5c : new rpc_count 2
00000100:00000001:1.0:1773851882.373848:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851882.373848:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102218880 : -107041607332736 : ffff9ea56f04cc80)
00000100:00000040:0.0:1773851882.373849:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002dfa88e2 x1858260763506688/t0(0) o400->32859ecf-de5f-4885-ad6a-a0a868764196@172.16.70.108@tcp:522/0 lens 224/0 e 0 to 0 dl 1773852637 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic8-0'
00000100:00000001:0.0:1773851882.373852:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851882.373853:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851882.373854:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dfa88e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:32859ecf-de5f-4885-ad6a-a0a868764196+7:52997:x1858260763506688:12345-172.16.70.108@tcp:400:login-rzslic8-0
00000100:00000200:0.0:1773851882.373855:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858260763506688
00000020:00000001:0.0:1773851882.373856:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851882.373857:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851882.373857:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851882.373858:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851882.373859:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851882.373860:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851882.373860:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858260763506688, found 0 last_xid 1858260752620031
00000020:00000001:0.0:1773851882.373861:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851882.373862:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851882.373862:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851882.373863:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851882.373863:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851882.373864:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851882.373864:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851882.373865:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000066317c30.
02000000:00000001:0.0:1773851882.373866:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851882.373866:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851882.373867:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851882.373868:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263616638, transno 0, xid 1858260763506688
00010000:00000001:0.0:1773851882.373868:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851882.373869:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002dfa88e2 x1858260763506688/t0(0) o400->32859ecf-de5f-4885-ad6a-a0a868764196@172.16.70.108@tcp:522/0 lens 224/224 e 0 to 0 dl 1773852637 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic8-0'
00010000:00000001:0.0:1773851882.373872:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851882.373872:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851882.373873:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=115 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851882.373874:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851882.373875:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8d5cf3e refcount 3 to 172.16.70.108@tcp
00000100:00000001:0.0:1773851882.373876:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850078240 : -107143859473376 : ffff9e8da050f420)
02000000:00000001:0.0:1773851882.373876:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851882.373877:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851882.373877:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851882.373878:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.108@tcp
00000400:00000010:0.0:1773851882.373879:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ee348cea.
00000100:00000200:0.0:1773851882.373880:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858260763506688, offset 224
00000400:00000200:0.0:1773851882.373881:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.108@tcp
00000400:00000200:0.0:1773851882.373882:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.108@tcp to cpt 0
00000400:00000200:0.0:1773851882.373884:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001f52d8c1 nid 172.16.70.108@tcp refs 2
00000400:00000200:0.0:1773851882.373885:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001f52d8c1 nid 172.16.70.108@tcp refs 3
00000400:00000200:0.0:1773851882.373886:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001f52d8c1 nid 172.16.70.108@tcp refs 4
00000400:00000200:0.0:1773851882.373888:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.108@tcp routed destination
00000400:00000200:0.0:1773851882.373890:0:42868:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:0.0:1773851882.373891:0:42868:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:0.0:1773851882.373893:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.108@tcp: rtr pref emtpy: 1
00000400:00000200:0.0:1773851882.373894:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:0.0:1773851882.373895:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.108@tcp: rtr pref emtpy: 1
00000400:00000200:0.0:1773851882.373896:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:0.0:1773851882.373897:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769727:8769727:1024:4294967295] 17@kfi7 LPNI seq info [1250891914:1250891914:16:4294967295]
00000400:00000200:0.0:1773851882.373899:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:0.0:1773851882.373900:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:0.0:1773851882.373902:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.108@tcp(172.16.70.108@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851882.373904:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001f52d8c1 nid 172.16.70.108@tcp refs 3
00000800:00000200:0.0:1773851882.373905:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851882.373907:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851882.373909:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851882.373911:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:0.0:1773851882.373914:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:0.0:1773851882.373916:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851882.373918:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851882.373919:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8d5cf3e refcount 2 to 172.16.70.108@tcp
00010000:00000001:0.0:1773851882.373920:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851882.373920:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851882.373921:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851882.373921:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002dfa88e2 x1858260763506688/t0(0) o400->32859ecf-de5f-4885-ad6a-a0a868764196@172.16.70.108@tcp:522/0 lens 224/224 e 0 to 0 dl 1773852637 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic8-0'
00000100:00100000:0.0:1773851882.373926:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dfa88e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:32859ecf-de5f-4885-ad6a-a0a868764196+7:52997:x1858260763506688:12345-172.16.70.108@tcp:400:login-rzslic8-0 Request processed in 73us (107us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851882.373929:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.108@tcp, seq: 1997597
00000100:00000040:0.0:1773851882.373930:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f6454d5c : new rpc_count 1
00000100:00000001:0.0:1773851882.373931:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851882.373931:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851882.373932:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851882.373932:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851882.373933:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000020:00000040:0.0:1773851882.373934:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000f6454d5c : new refcount 6
00000100:00000001:0.0:1773851882.373934:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851882.373940:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851882.373942:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851882.373943:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:1.0:1773851882.373944:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ee348cea
00000400:00000010:1.0:1773851882.373945:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ee348cea.
00000100:00000001:1.0:1773851882.373946:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851882.373946:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851882.373947:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:1.0:1773851882.373949:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Transaction freed
00000400:00000200:29.0:1773851882.377737:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851882.377739:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:17.0:1773851882.431121:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.431122:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851882.431123:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851882.431125:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851882.431127:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21347@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.431128:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21347@kfi7 : PUT - for me
00000400:00000200:17.0:1773851882.431129:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21347@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.431129:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013f32bd3 nid 21347@kfi7 refs 1
00000400:00000200:17.0:1773851882.431130:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21347@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.431131:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013f32bd3 nid 21347@kfi7 refs 2
00000400:00000200:17.0:1773851882.431132:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013f32bd3 nid 21347@kfi7 refs 3
00000400:00000200:17.0:1773851882.431133:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21410@kfi7 to cpt 5
00000400:00000200:17.0:1773851882.431133:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21410@kfi7 of length 224 into portal 12 MB=0x699e0e1f18dc0
00000400:00000200:17.0:1773851882.431135:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21410@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 30712
00000800:00000200:17.0:1773851882.431136:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851882.431138:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.431139:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21347@kfi7: PUT: OK
00000100:00000001:17.0:1773851882.431140:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851882.431140:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851882.431141:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002970e4b4.
00000100:00000040:17.0:1773851882.431141:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002970e4b4 x1858041002692032 msgsize 224
00000100:00100000:17.0:1773851882.431143:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21410@kfi7 (source: 12345-21347@kfi7)
00000100:00000001:17.0:1773851882.431144:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851882.431145:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000013f32bd3 nid 21347@kfi7 refs 2
00000800:00000200:17.0:1773851882.431146:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851882.431148:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851882.431149:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851882.431149:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851882.431150:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851882.431151:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851882.431151:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041002692032
00000020:00000001:17.0:1773851882.431152:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851882.431152:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913d4
00000020:00000001:17.0:1773851882.431153:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851882.431155:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007544342a refcount=6
00000020:00000001:17.0:1773851882.431156:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169309184 : -107127540242432 : ffff9e916d04a800)
00000020:00000001:17.0:1773851882.431157:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169309184 : -107127540242432 : ffff9e916d04a800)
00000100:00000001:17.0:1773851882.431158:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851882.431158:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851882.431159:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ccd42b1.
00000020:00000010:17.0:1773851882.431160:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851882.431161:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3c32d38.
00000100:00000001:17.0:1773851882.431161:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851882.431162:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851882.431163:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851882.431164:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851882.431164:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851882.431165:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.431166:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851882.431167:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851882.431167:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851882.431168:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851882.431168:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851882.431169:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21410@kfi7, seq: 2156384
00000100:00000001:17.0:1773851882.431170:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851882.431170:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007544342a : new rpc_count 1
00000100:00000001:17.0:1773851882.431171:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.431171:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102202752 : -107041607348864 : ffff9ea56f048d80)
00000100:00000040:16.0:1773851882.431175:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002970e4b4 x1858041002692032/t0(0) o400->555b8e0b-e3a4-489b-bc5f-b89d210ffdd6@21410@kfi7:103/0 lens 224/0 e 0 to 0 dl 1773852218 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1820-0'
00000100:00000001:16.0:1773851882.431178:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851882.431179:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851882.431180:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002970e4b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:555b8e0b-e3a4-489b-bc5f-b89d210ffdd6+6:39646:x1858041002692032:12345-21410@kfi7:400:default-tuolumne1820-0
00000100:00000200:16.0:1773851882.431181:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041002692032
00000020:00000001:16.0:1773851882.431182:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851882.431182:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851882.431183:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.431184:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851882.431185:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851882.431185:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851882.431186:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041002692032, found 0 last_xid 1858041002692031
00000020:00000001:16.0:1773851882.431187:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851882.431188:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851882.431188:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851882.431189:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.431189:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851882.431190:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851882.431191:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851882.431192:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000091929c7c.
02000000:00000001:16.0:1773851882.431192:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.431193:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.431194:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851882.431195:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262827487, transno 0, xid 1858041002692032
00010000:00000001:16.0:1773851882.431197:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851882.431198:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002970e4b4 x1858041002692032/t0(0) o400->555b8e0b-e3a4-489b-bc5f-b89d210ffdd6@21410@kfi7:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1820-0'
00010000:00000001:16.0:1773851882.431203:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851882.431204:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851882.431205:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=115 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851882.431207:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851882.431209:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008f990e0a refcount 3 to 21410@kfi7
00000100:00000001:16.0:1773851882.431210:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027392 : -107156745524224 : ffff9e8aa03f6c00)
02000000:00000001:16.0:1773851882.431211:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851882.431212:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.431213:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851882.431215:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21347@kfi7
00000400:00000010:16.0:1773851882.431216:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003fc27269.
00000100:00000200:16.0:1773851882.431218:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041002692032, offset 224
00000400:00000200:16.0:1773851882.431221:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21347@kfi7
00000400:00000200:16.0:1773851882.431223:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21347@kfi7 to cpt 4
00000400:00000200:16.0:1773851882.431224:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013f32bd3 nid 21347@kfi7 refs 1
00000400:00000200:16.0:1773851882.431226:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013f32bd3 nid 21347@kfi7 refs 2
00000400:00000200:16.0:1773851882.431228:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013f32bd3 nid 21347@kfi7 refs 3
00000400:00000200:16.0:1773851882.431231:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21347@kfi7 local destination
00000400:00000200:16.0:1773851882.431233:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769728:8769728:1024:4294967295] 21347@kfi7 LPNI seq info [112217:112217:16:4294967295]
00000400:00000200:16.0:1773851882.431236:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000013f32bd3 nid 21347@kfi7 refs 2
00000400:00000200:16.0:1773851882.431237:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21347@kfi7 to cpt 4
00000400:00000200:16.0:1773851882.431241:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21347@kfi7(21347@kfi7:21347@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851882.431243:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013f32bd3 nid 21347@kfi7 refs 3
00000800:00000200:16.0:1773851882.431246:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851882.431249:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851882.431253:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851882.431258:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9f4 Using peer 21347@kfi7(0x9f4)
00000800:00000200:16.0:1773851882.431265:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x9f4: rc=0
00000800:00000200:16.0:1773851882.431267:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9f4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851882.431271:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851882.431273:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008f990e0a refcount 2 to 21410@kfi7
00010000:00000001:16.0:1773851882.431277:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851882.431278:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.431280:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851882.431281:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002970e4b4 x1858041002692032/t0(0) o400->555b8e0b-e3a4-489b-bc5f-b89d210ffdd6@21410@kfi7:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1820-0'
00000100:00100000:16.0:1773851882.431287:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002970e4b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:555b8e0b-e3a4-489b-bc5f-b89d210ffdd6+6:39646:x1858041002692032:12345-21410@kfi7:400:default-tuolumne1820-0 Request processed in 107us (144us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851882.431291:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21410@kfi7, seq: 2156384
00000100:00000040:16.0:1773851882.431293:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007544342a : new rpc_count 0
00000100:00000001:16.0:1773851882.431294:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851882.431295:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851882.431296:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:16.0:1773851882.431298:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3c32d38.
00000020:00000010:16.0:1773851882.431299:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ccd42b1.
00000020:00000040:16.0:1773851882.431301:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000007544342a : new refcount 5
00000100:00000001:16.0:1773851882.431302:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851882.431312:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9f4 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851882.431315:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.431317:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21347@kfi7: PUT: OK
00000400:00000200:17.0:1773851882.431319:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003fc27269
00000400:00000010:17.0:1773851882.431320:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003fc27269.
00000100:00000001:17.0:1773851882.431321:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851882.431322:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851882.431324:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000013f32bd3 nid 21347@kfi7 refs 2
00000800:00000200:17.0:1773851882.431327:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 21347@kfi7(000000000b2d339e):0x0 lsk 2549 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9f4 Transaction freed
00000800:00000200:21.0:1773851882.493376:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851882.493378:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851882.493380:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851882.493384:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851882.493387:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16208@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.493389:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16208@kfi7 : PUT - for me
00000400:00000200:21.0:1773851882.493391:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16208@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.493393:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f9d7a98 nid 16208@kfi7 refs 1
00000400:00000200:21.0:1773851882.493394:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16208@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.493396:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f9d7a98 nid 16208@kfi7 refs 2
00000400:00000200:21.0:1773851882.493398:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007f9d7a98 nid 16208@kfi7 refs 3
00000400:00000200:21.0:1773851882.493400:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16209@kfi7 to cpt 0
00000400:00000200:21.0:1773851882.493401:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16209@kfi7 of length 224 into portal 12 MB=0x69b4b54c80000
00000400:00000200:21.0:1773851882.493404:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16209@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 51024
00000800:00000200:21.0:1773851882.493407:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851882.493410:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851882.493411:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16208@kfi7: PUT: OK
00000100:00000001:21.0:1773851882.493413:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851882.493414:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851882.493415:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009ca778bc.
00000100:00000040:21.0:1773851882.493416:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009ca778bc x1859597707509760 msgsize 224
00000100:00100000:21.0:1773851882.493419:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16209@kfi7 (source: 12345-16208@kfi7)
00000100:00000001:21.0:1773851882.493420:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851882.493421:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007f9d7a98 nid 16208@kfi7 refs 2
00000100:00000001:20.0:1773851882.493422:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851882.493422:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851882.493423:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851882.493423:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851882.493423:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851882.493424:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851882.493425:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597707509760
00000020:00000001:20.0:1773851882.493426:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851882.493427:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8096a
00000020:00000001:20.0:1773851882.493427:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851882.493431:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000278d1763 refcount=5
00000020:00000001:20.0:1773851882.493432:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944059334656 : -107129650216960 : ffff9e90ef410000)
00000020:00000001:20.0:1773851882.493433:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944059334656 : -107129650216960 : ffff9e90ef410000)
00000100:00000001:20.0:1773851882.493434:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851882.493435:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851882.493436:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851882.493437:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851882.493438:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851882.493439:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851882.493439:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851882.493440:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851882.493441:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851882.493441:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851882.493442:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.493443:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851882.493445:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851882.493445:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851882.493445:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851882.493446:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851882.493447:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16209@kfi7, seq: 1998026
00000100:00000040:20.0:1773851882.493447:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000278d1763 : new rpc_count 1
00000100:00000001:23.0:1773851882.493448:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851882.493448:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.493449:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956247680 : -106937753303936 : ffff9ebd9d338480)
00000100:00000040:20.0:1773851882.493451:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009ca778bc x1859597707509760/t0(0) o400->33cd74be-31f1-4a7f-8346-034c8e193501@16209@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1506-0'
00000100:00000001:20.0:1773851882.493454:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851882.493455:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851882.493456:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009ca778bc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:33cd74be-31f1-4a7f-8346-034c8e193501+5:39718:x1859597707509760:12345-16209@kfi7:400:default-tuolumne1506-0
00000100:00000200:20.0:1773851882.493457:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597707509760
00000020:00000001:20.0:1773851882.493458:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851882.493459:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851882.493460:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.493460:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851882.493461:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851882.493462:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851882.493463:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597707509760, found 0 last_xid 1859597707509759
00000020:00000001:20.0:1773851882.493464:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851882.493464:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851882.493465:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851882.493465:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.493466:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851882.493467:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851882.493468:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851882.493468:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dff89d47.
02000000:00000001:20.0:1773851882.493469:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.493470:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.493470:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851882.493471:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044151839, transno 0, xid 1859597707509760
00010000:00000001:20.0:1773851882.493472:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851882.493473:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009ca778bc x1859597707509760/t0(0) o400->33cd74be-31f1-4a7f-8346-034c8e193501@16209@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1506-0'
00010000:00000001:20.0:1773851882.493476:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851882.493477:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851882.493477:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=115 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851882.493479:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851882.493480:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000082b532c8 refcount 3 to 16209@kfi7
00000100:00000001:20.0:1773851882.493481:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049184 : -107154804502432 : ffff9e8b13f11060)
02000000:00000001:20.0:1773851882.493482:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851882.493483:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.493483:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851882.493484:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16208@kfi7
00000400:00000010:20.0:1773851882.493485:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e2f6c1a.
00000100:00000200:20.0:1773851882.493486:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597707509760, offset 224
00000400:00000200:20.0:1773851882.493487:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16208@kfi7
00000400:00000200:20.0:1773851882.493488:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16208@kfi7 to cpt 5
00000400:00000200:20.0:1773851882.493489:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f9d7a98 nid 16208@kfi7 refs 1
00000400:00000200:20.0:1773851882.493490:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007f9d7a98 nid 16208@kfi7 refs 2
00000400:00000200:20.0:1773851882.493491:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007f9d7a98 nid 16208@kfi7 refs 3
00000400:00000200:20.0:1773851882.493492:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16208@kfi7 local destination
00000400:00000200:20.0:1773851882.493493:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769729:8769729:1024:4294967295] 16208@kfi7 LPNI seq info [177015:177015:16:4294967295]
00000400:00000200:20.0:1773851882.493495:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007f9d7a98 nid 16208@kfi7 refs 2
00000400:00000200:20.0:1773851882.493496:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16208@kfi7 to cpt 5
00000400:00000200:20.0:1773851882.493498:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16208@kfi7(16208@kfi7:16208@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851882.493499:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007f9d7a98 nid 16208@kfi7 refs 3
00000800:00000200:20.0:1773851882.493500:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851882.493502:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851882.493504:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851882.493506:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x24f Using peer 16208@kfi7(0x24f)
00000800:00000200:20.0:1773851882.493509:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x24f: rc=0
00000800:00000200:20.0:1773851882.493510:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x24f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851882.493512:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851882.493513:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000082b532c8 refcount 2 to 16209@kfi7
00010000:00000001:20.0:1773851882.493514:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851882.493514:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.493515:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851882.493516:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009ca778bc x1859597707509760/t0(0) o400->33cd74be-31f1-4a7f-8346-034c8e193501@16209@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1506-0'
00000100:00100000:20.0:1773851882.493520:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009ca778bc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:33cd74be-31f1-4a7f-8346-034c8e193501+5:39718:x1859597707509760:12345-16209@kfi7:400:default-tuolumne1506-0 Request processed in 65us (103us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851882.493522:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16209@kfi7, seq: 1998026
00000100:00000040:20.0:1773851882.493523:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000278d1763 : new rpc_count 0
00000100:00000001:20.0:1773851882.493523:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851882.493524:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851882.493525:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851882.493525:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851882.493526:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851882.493527:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000278d1763 : new refcount 4
00000100:00000001:20.0:1773851882.493527:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851882.493532:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x24f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851882.493534:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851882.493535:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16208@kfi7: PUT: OK
00000400:00000200:21.0:1773851882.493536:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e2f6c1a
00000400:00000010:21.0:1773851882.493536:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e2f6c1a.
00000100:00000001:21.0:1773851882.493537:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851882.493537:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851882.493538:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007f9d7a98 nid 16208@kfi7 refs 2
00000800:00000200:21.0:1773851882.493539:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 16208@kfi7(00000000510303ea):0x0 lsk 592 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x24f Transaction freed
00000800:00000200:29.0:1773851882.517148:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851882.517149:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851882.517151:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851882.517153:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851882.517155:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.517156:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23034@kfi7 : PUT - for me
00000400:00000200:29.0:1773851882.517157:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.517158:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 1
00000400:00000200:29.0:1773851882.517160:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.517161:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:29.0:1773851882.517162:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000400:00000200:29.0:1773851882.517163:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.517164:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23034@kfi7 of length 224 into portal 12 MB=0x699de8c0a77c0
00000400:00000200:29.0:1773851882.517165:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23034@kfi7 of length 224/224 into md 0x77fe139dd [64] + 190376
00000800:00000200:29.0:1773851882.517167:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851882.517171:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851882.517172:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23034@kfi7: PUT: OK
00000100:00000001:29.0:1773851882.517173:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851882.517173:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851882.517174:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a30876a5.
00000100:00000040:29.0:1773851882.517175:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a30876a5 x1858030971549632 msgsize 224
00000100:00100000:29.0:1773851882.517177:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23034@kfi7 (source: 12345-23034@kfi7)
00000100:00000001:29.0:1773851882.517178:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851882.517179:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000800:00000200:29.0:1773851882.517181:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851882.517184:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851882.517184:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851882.517185:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851882.517185:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851882.517186:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851882.517187:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030971549632
00000020:00000001:29.0:1773851882.517188:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851882.517188:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f66
00000020:00000001:29.0:1773851882.517189:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851882.517192:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffb3a416 refcount=6
00000020:00000001:29.0:1773851882.517193:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239883776 : -107152469667840 : ffff9e8b9f1bd000)
00000020:00000001:29.0:1773851882.517194:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239883776 : -107152469667840 : ffff9e8b9f1bd000)
00000100:00000001:29.0:1773851882.517195:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851882.517195:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851882.517196:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851882.517197:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851882.517198:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851882.517199:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851882.517199:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851882.517200:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851882.517201:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851882.517202:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851882.517203:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.517203:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851882.517205:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851882.517205:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851882.517205:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851882.517205:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851882.517206:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23034@kfi7, seq: 2055558
00000100:00000001:30.0:1773851882.517207:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851882.517207:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffb3a416 : new rpc_count 1
00000100:00000001:30.0:1773851882.517208:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.517208:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058761461120 : -107014948090496 : ffff9eaba4088d80)
00000100:00000040:29.0:1773851882.517209:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a30876a5 x1858030971549632/t0(0) o400->45bd401a-695a-4206-8ea0-572e6ceeaaff@23034@kfi7:670/0 lens 224/0 e 0 to 0 dl 1773852030 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne258-0'
00000100:00000001:29.0:1773851882.517212:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851882.517212:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851882.517213:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a30876a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:45bd401a-695a-4206-8ea0-572e6ceeaaff+6:47838:x1858030971549632:12345-23034@kfi7:400:default-tuolumne258-0
00000100:00000200:29.0:1773851882.517215:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030971549632
00000020:00000001:29.0:1773851882.517216:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851882.517217:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851882.517217:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.517218:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851882.517219:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851882.517219:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851882.517220:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030971549632, found 0 last_xid 1858030971549631
00000020:00000001:29.0:1773851882.517221:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851882.517222:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851882.517222:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851882.517223:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.517223:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851882.517224:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851882.517224:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851882.517225:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006e1155eb.
02000000:00000001:29.0:1773851882.517226:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.517227:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.517227:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851882.517228:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030971549632
00010000:00000001:29.0:1773851882.517229:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851882.517231:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a30876a5 x1858030971549632/t0(0) o400->45bd401a-695a-4206-8ea0-572e6ceeaaff@23034@kfi7:670/0 lens 224/224 e 0 to 0 dl 1773852030 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne258-0'
00010000:00000001:29.0:1773851882.517233:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851882.517234:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851882.517234:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=115 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851882.517236:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851882.517236:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000c0cbd96 refcount 5 to 23034@kfi7
00000100:00000001:29.0:1773851882.517237:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231807328 : -107130477744288 : ffff9e90bdedef60)
02000000:00000001:29.0:1773851882.517238:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851882.517239:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851882.517240:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851882.517241:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23034@kfi7
00000400:00000010:29.0:1773851882.517241:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f18c1ca6.
00000100:00000200:29.0:1773851882.517242:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030971549632, offset 224
00000400:00000200:29.0:1773851882.517243:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23034@kfi7
00000400:00000200:29.0:1773851882.517244:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.517245:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 1
00000400:00000200:29.0:1773851882.517247:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:29.0:1773851882.517248:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000400:00000200:29.0:1773851882.517249:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23034@kfi7 local destination
00000400:00000200:29.0:1773851882.517250:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769730:8769730:1024:4294967295] 23034@kfi7 LPNI seq info [28009:28009:16:4294967295]
00000400:00000200:29.0:1773851882.517252:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:29.0:1773851882.517253:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851882.517254:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23034@kfi7(23034@kfi7:23034@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851882.517256:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000800:00000200:29.0:1773851882.517257:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851882.517258:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851882.517260:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851882.517263:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x723 Using peer 23034@kfi7(0x723)
00000800:00000200:29.0:1773851882.517267:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 324 bytes to peer 0x723: rc=0
00000800:00000200:29.0:1773851882.517268:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x723 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851882.517270:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851882.517271:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000c0cbd96 refcount 4 to 23034@kfi7
00010000:00000001:29.0:1773851882.517271:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851882.517272:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851882.517273:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851882.517273:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a30876a5 x1858030971549632/t0(0) o400->45bd401a-695a-4206-8ea0-572e6ceeaaff@23034@kfi7:670/0 lens 224/224 e 0 to 0 dl 1773852030 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne258-0'
00000100:00100000:29.0:1773851882.517276:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a30876a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:45bd401a-695a-4206-8ea0-572e6ceeaaff+6:47838:x1858030971549632:12345-23034@kfi7:400:default-tuolumne258-0 Request processed in 63us (100us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851882.517279:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23034@kfi7, seq: 2055558
00000100:00000040:29.0:1773851882.517279:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffb3a416 : new rpc_count 0
00000800:00000200:30.0:1773851882.517280:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x723 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851882.517280:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851882.517281:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851882.517281:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851882.517282:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851882.517282:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000200:30.0:1773851882.517283:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23034@kfi7: PUT: OK
00000020:00000010:29.0:1773851882.517283:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000400:00000200:30.0:1773851882.517284:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f18c1ca6
00000020:00000040:29.0:1773851882.517284:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000ffb3a416 : new refcount 5
00000100:00000001:29.0:1773851882.517284:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:30.0:1773851882.517285:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f18c1ca6.
00000100:00000001:30.0:1773851882.517286:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851882.517286:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851882.517287:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000800:00000200:30.0:1773851882.517289:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 23034@kfi7(0000000098b8a3ee):0x0 lsk 1828 rsk 92 tsk 0 trmk 0 tmk 0 trr 7 tta 0x723 Transaction freed
00000800:00000200:1.0:1773851882.533641:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851882.533643:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851882.533645:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851882.533649:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851882.533653:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24241@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.533655:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24241@kfi7 : PUT - for me
00000400:00000200:1.0:1773851882.533657:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24241@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.533658:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077f9606e nid 24241@kfi7 refs 1
00000400:00000200:1.0:1773851882.533660:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24241@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.533661:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077f9606e nid 24241@kfi7 refs 2
00000400:00000200:1.0:1773851882.533663:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000077f9606e nid 24241@kfi7 refs 3
00000400:00000200:1.0:1773851882.533665:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24176@kfi7 to cpt 1
00000400:00000200:1.0:1773851882.533667:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24176@kfi7 of length 224 into portal 12 MB=0x69b464ae6ebc0
00000400:00000200:1.0:1773851882.533669:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24176@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 42080
00000800:00000200:1.0:1773851882.533674:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851882.533677:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851882.533679:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24241@kfi7: PUT: OK
00000100:00000001:1.0:1773851882.533681:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851882.533681:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851882.533683:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000971b470e.
00000100:00000040:1.0:1773851882.533685:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000971b470e x1859576066927552 msgsize 224
00000100:00100000:1.0:1773851882.533687:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24176@kfi7 (source: 12345-24241@kfi7)
00000100:00000001:1.0:1773851882.533689:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851882.533691:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000077f9606e nid 24241@kfi7 refs 2
00000100:00000001:0.0:1773851882.533692:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851882.533693:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851882.533694:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851882.533694:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851882.533695:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851882.533697:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851882.533698:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576066927552
00000020:00000001:0.0:1773851882.533699:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851882.533700:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc36193d2
00000020:00000001:0.0:1773851882.533701:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851882.533704:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007879c39b refcount=5
00000020:00000001:0.0:1773851882.533705:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113628441600 : -106960081110016 : ffff9eb86a5c3c00)
00000020:00000001:0.0:1773851882.533707:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113628441600 : -106960081110016 : ffff9eb86a5c3c00)
00000100:00000001:0.0:1773851882.533709:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851882.533710:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851882.533711:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000067ef58f9.
00000020:00000010:0.0:1773851882.533713:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851882.533714:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851882.533716:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851882.533716:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851882.533718:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851882.533719:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851882.533720:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851882.533721:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851882.533723:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851882.533726:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851882.533731:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851882.533732:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851882.533732:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851882.533733:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24176@kfi7, seq: 1997598
00000100:00000040:1.0:1773851882.533734:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007879c39b : new rpc_count 1
00000100:00000001:0.0:1773851882.533734:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851882.533735:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112267904 : -106950597283712 : ffff9eba9fa3f080)
00000100:00000001:0.0:1773851882.533736:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851882.533738:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000971b470e x1859576066927552/t0(0) o400->77ab09a8-e49c-4f93-9b95-1688f9d67e24@24176@kfi7:522/0 lens 224/0 e 0 to 0 dl 1773852637 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1998-0'
00000100:00000001:1.0:1773851882.533743:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851882.533744:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851882.533746:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000971b470e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:77ab09a8-e49c-4f93-9b95-1688f9d67e24+5:39803:x1859576066927552:12345-24176@kfi7:400:default-tuolumne1998-0
00000100:00000200:1.0:1773851882.533748:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576066927552
00000020:00000001:1.0:1773851882.533750:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851882.533751:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851882.533752:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.533753:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851882.533754:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851882.533756:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851882.533757:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576066927552, found 0 last_xid 1859576066927551
00000020:00000001:1.0:1773851882.533759:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851882.533760:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851882.533761:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851882.533762:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.533764:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851882.533765:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851882.533766:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851882.533767:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000040e8a7a7.
02000000:00000001:1.0:1773851882.533768:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851882.533770:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.533771:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851882.533772:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182422090692, transno 0, xid 1859576066927552
00010000:00000001:1.0:1773851882.533774:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851882.533775:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000971b470e x1859576066927552/t0(0) o400->77ab09a8-e49c-4f93-9b95-1688f9d67e24@24176@kfi7:522/0 lens 224/224 e 0 to 0 dl 1773852637 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1998-0'
00010000:00000001:1.0:1773851882.533780:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851882.533781:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851882.533782:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=115 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851882.533784:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851882.533786:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006c1abeab refcount 3 to 24176@kfi7
00000100:00000001:1.0:1773851882.533787:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232979040 : -107130476572576 : ffff9e90bdffd060)
02000000:00000001:1.0:1773851882.533788:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851882.533789:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851882.533790:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851882.533792:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24241@kfi7
00000400:00000010:1.0:1773851882.533793:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a9b6731.
00000100:00000200:1.0:1773851882.533795:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576066927552, offset 224
00000400:00000200:1.0:1773851882.533797:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24241@kfi7
00000400:00000200:1.0:1773851882.533799:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24241@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.533800:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077f9606e nid 24241@kfi7 refs 1
00000400:00000200:1.0:1773851882.533802:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000077f9606e nid 24241@kfi7 refs 2
00000400:00000200:1.0:1773851882.533804:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000077f9606e nid 24241@kfi7 refs 3
00000400:00000200:1.0:1773851882.533806:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24241@kfi7 local destination
00000400:00000200:1.0:1773851882.533809:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769731:8769731:1024:4294967295] 24241@kfi7 LPNI seq info [8018682:8018682:16:4294967295]
00000400:00000200:1.0:1773851882.533812:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000077f9606e nid 24241@kfi7 refs 2
00000400:00000200:1.0:1773851882.533813:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24241@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.533817:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24241@kfi7(24241@kfi7:24241@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851882.533819:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000077f9606e nid 24241@kfi7 refs 3
00000800:00000200:1.0:1773851882.533820:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851882.533822:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851882.533825:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851882.533828:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c57 Using peer 24241@kfi7(0x100000000000c57)
00000800:00000200:1.0:1773851882.533831:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x100000000000c57: rc=0
00000800:00000200:1.0:1773851882.533833:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c57 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851882.533835:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851882.533836:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006c1abeab refcount 2 to 24176@kfi7
00010000:00000001:1.0:1773851882.533837:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851882.533838:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.533839:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851882.533840:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000971b470e x1859576066927552/t0(0) o400->77ab09a8-e49c-4f93-9b95-1688f9d67e24@24176@kfi7:522/0 lens 224/224 e 0 to 0 dl 1773852637 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1998-0'
00000100:00100000:1.0:1773851882.533843:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000971b470e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:77ab09a8-e49c-4f93-9b95-1688f9d67e24+5:39803:x1859576066927552:12345-24176@kfi7:400:default-tuolumne1998-0 Request processed in 99us (158us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851882.533846:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24176@kfi7, seq: 1997598
00000100:00000040:1.0:1773851882.533846:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007879c39b : new rpc_count 0
00000100:00000001:1.0:1773851882.533847:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:2.0:1773851882.533848:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c57 TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851882.533848:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851882.533849:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000400:00000200:2.0:1773851882.533850:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:1.0:1773851882.533850:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:1.0:1773851882.533851:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000067ef58f9.
00000400:00000200:2.0:1773851882.533852:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24241@kfi7: PUT: OK
00000400:00000200:2.0:1773851882.533853:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a9b6731
00000020:00000040:1.0:1773851882.533853:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000007879c39b : new refcount 4
00000100:00000001:1.0:1773851882.533853:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:2.0:1773851882.533854:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a9b6731.
00000100:00000001:2.0:1773851882.533855:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851882.533855:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851882.533856:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000077f9606e nid 24241@kfi7 refs 2
00000800:00000200:2.0:1773851882.533858:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2054@kfi7:0 -> 24241@kfi7(000000008e9c9295):0x0 lsk 3160 rsk 26 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000c57 Transaction freed
00000800:00000200:1.0:1773851882.565009:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851882.565010:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851882.565011:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851882.565013:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851882.565015:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25571@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.565016:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25571@kfi7 : PUT - for me
00000400:00000200:1.0:1773851882.565017:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25571@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.565018:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ee1f628 nid 25571@kfi7 refs 1
00000400:00000200:1.0:1773851882.565020:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25571@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.565020:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ee1f628 nid 25571@kfi7 refs 2
00000400:00000200:1.0:1773851882.565021:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007ee1f628 nid 25571@kfi7 refs 3
00000400:00000200:1.0:1773851882.565022:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25379@kfi7 to cpt 5
00000400:00000200:1.0:1773851882.565022:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25379@kfi7 of length 224 into portal 12 MB=0x699e10bf85900
00000400:00000200:1.0:1773851882.565024:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25379@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 42304
00000800:00000200:1.0:1773851882.565025:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851882.565027:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851882.565028:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25571@kfi7: PUT: OK
00000100:00000001:1.0:1773851882.565028:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851882.565029:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851882.565029:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc87013e.
00000100:00000040:1.0:1773851882.565030:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000dc87013e x1858041707780352 msgsize 224
00000100:00100000:1.0:1773851882.565031:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25379@kfi7 (source: 12345-25571@kfi7)
00000100:00000001:1.0:1773851882.565032:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851882.565033:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007ee1f628 nid 25571@kfi7 refs 2
00000800:00000200:1.0:1773851882.565035:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851882.565037:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851882.565040:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851882.565041:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851882.565041:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851882.565042:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851882.565042:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041707780352
00000020:00000001:1.0:1773851882.565043:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851882.565043:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c8d
00000020:00000001:1.0:1773851882.565044:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851882.565046:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e343df53 refcount=6
00000020:00000001:1.0:1773851882.565046:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628294656 : -107123081256960 : ffff9e9276cb6000)
00000020:00000001:1.0:1773851882.565047:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628294656 : -107123081256960 : ffff9e9276cb6000)
00000100:00000001:1.0:1773851882.565047:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851882.565048:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851882.565049:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a4593418.
00000020:00000010:1.0:1773851882.565050:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851882.565051:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f309d4d6.
00000100:00000001:1.0:1773851882.565052:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851882.565052:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851882.565052:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851882.565053:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851882.565054:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851882.565054:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851882.565055:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851882.565056:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851882.565056:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851882.565056:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:1.0:1773851882.565057:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25379@kfi7, seq: 1997599
00000100:00000001:0.0:1773851882.565057:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:1.0:1773851882.565058:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e343df53 : new rpc_count 1
00000100:00000001:0.0:1773851882.565058:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851882.565059:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112258688 : -106950597292928 : ffff9eba9fa3cc80)
00000100:00000001:0.0:1773851882.565059:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851882.565060:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dc87013e x1858041707780352/t0(0) o400->5303d5c2-8335-4281-bbba-d443f52ce18d@25379@kfi7:522/0 lens 224/0 e 0 to 0 dl 1773852637 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2075-0'
00000100:00000001:1.0:1773851882.565062:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851882.565063:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851882.565063:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc87013e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5303d5c2-8335-4281-bbba-d443f52ce18d+6:39687:x1858041707780352:12345-25379@kfi7:400:default-tuolumne2075-0
00000100:00000200:1.0:1773851882.565066:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041707780352
00000020:00000001:1.0:1773851882.565067:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851882.565067:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851882.565068:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.565068:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851882.565069:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851882.565070:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851882.565070:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041707780352, found 0 last_xid 1858041707780351
00000020:00000001:1.0:1773851882.565071:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851882.565071:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851882.565072:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851882.565072:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.565073:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851882.565073:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851882.565073:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851882.565074:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009cddef84.
02000000:00000001:1.0:1773851882.565075:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851882.565075:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.565076:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851882.565077:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104961278, transno 0, xid 1858041707780352
00010000:00000001:1.0:1773851882.565077:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851882.565078:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dc87013e x1858041707780352/t0(0) o400->5303d5c2-8335-4281-bbba-d443f52ce18d@25379@kfi7:522/0 lens 224/224 e 0 to 0 dl 1773852637 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2075-0'
00010000:00000001:1.0:1773851882.565080:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851882.565081:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851882.565081:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=115 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851882.565082:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851882.565083:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ecd77fbc refcount 3 to 25379@kfi7
00000100:00000001:1.0:1773851882.565084:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107552 : -107156354444064 : ffff9e8ab78ed4e0)
02000000:00000001:1.0:1773851882.565084:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851882.565085:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851882.565085:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851882.565086:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25571@kfi7
00000400:00000010:1.0:1773851882.565087:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004677a1ce.
00000100:00000200:1.0:1773851882.565088:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041707780352, offset 224
00000400:00000200:1.0:1773851882.565089:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25571@kfi7
00000400:00000200:1.0:1773851882.565090:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25571@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.565091:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ee1f628 nid 25571@kfi7 refs 1
00000400:00000200:1.0:1773851882.565092:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007ee1f628 nid 25571@kfi7 refs 2
00000400:00000200:1.0:1773851882.565093:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007ee1f628 nid 25571@kfi7 refs 3
00000400:00000200:1.0:1773851882.565094:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25571@kfi7 local destination
00000400:00000200:1.0:1773851882.565095:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769732:8769732:1024:4294967295] 25571@kfi7 LPNI seq info [317329:317329:16:4294967295]
00000400:00000200:1.0:1773851882.565096:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007ee1f628 nid 25571@kfi7 refs 2
00000400:00000200:1.0:1773851882.565097:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25571@kfi7 to cpt 0
00000400:00000200:1.0:1773851882.565099:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25571@kfi7(25571@kfi7:25571@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851882.565100:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007ee1f628 nid 25571@kfi7 refs 3
00000800:00000200:1.0:1773851882.565101:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851882.565101:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851882.565103:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851882.565105:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xcbc Using peer 25571@kfi7(0xcbc)
00000800:00000200:1.0:1773851882.565108:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 324 bytes to peer 0xcbc: rc=0
00000800:00000200:1.0:1773851882.565109:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xcbc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851882.565111:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851882.565112:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ecd77fbc refcount 2 to 25379@kfi7
00010000:00000001:1.0:1773851882.565112:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851882.565113:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851882.565113:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851882.565114:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dc87013e x1858041707780352/t0(0) o400->5303d5c2-8335-4281-bbba-d443f52ce18d@25379@kfi7:522/0 lens 224/224 e 0 to 0 dl 1773852637 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2075-0'
00000100:00100000:1.0:1773851882.565117:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc87013e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5303d5c2-8335-4281-bbba-d443f52ce18d+6:39687:x1858041707780352:12345-25379@kfi7:400:default-tuolumne2075-0 Request processed in 54us (86us total) trans 0 rc 0/0
00000100:00100000:1.0:1773851882.565119:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25379@kfi7, seq: 1997599
00000100:00000040:1.0:1773851882.565120:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e343df53 : new rpc_count 0
00000100:00000001:1.0:1773851882.565120:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851882.565121:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851882.565121:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000800:00000200:2.0:1773851882.565122:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xcbc TN_EVENT_TX_OK event status 0
00000020:00000010:1.0:1773851882.565122:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f309d4d6.
00000020:00000010:1.0:1773851882.565122:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a4593418.
00000400:00000200:2.0:1773851882.565123:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:1.0:1773851882.565123:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000e343df53 : new refcount 5
00000100:00000001:1.0:1773851882.565123:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851882.565124:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25571@kfi7: PUT: OK
00000400:00000200:2.0:1773851882.565126:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004677a1ce
00000400:00000010:2.0:1773851882.565126:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004677a1ce.
00000100:00000001:2.0:1773851882.565127:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851882.565127:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851882.565128:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007ee1f628 nid 25571@kfi7 refs 2
00000800:00000200:2.0:1773851882.565129:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 25571@kfi7(000000000e2c943c):0x0 lsk 3261 rsk 50 tsk 0 trmk 0 tmk 0 trr 0 tta 0xcbc Transaction freed
00000800:00000200:13.0:1773851882.579450:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851882.579451:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851882.579452:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851882.579454:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851882.579456:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25394@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.579457:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25394@kfi7 : PUT - for me
00000400:00000200:13.0:1773851882.579458:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25394@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.579460:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027c9fa69 nid 25394@kfi7 refs 1
00000400:00000200:13.0:1773851882.579462:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25394@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.579462:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027c9fa69 nid 25394@kfi7 refs 2
00000400:00000200:13.0:1773851882.579463:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000027c9fa69 nid 25394@kfi7 refs 3
00000400:00000200:13.0:1773851882.579464:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25586@kfi7 to cpt 5
00000400:00000200:13.0:1773851882.579465:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25586@kfi7 of length 224 into portal 12 MB=0x699e09533d3c0
00000400:00000200:13.0:1773851882.579467:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25586@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 43120
00000800:00000200:13.0:1773851882.579469:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851882.579470:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851882.579471:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25394@kfi7: PUT: OK
00000100:00000001:13.0:1773851882.579472:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851882.579473:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851882.579474:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007befa5b8.
00000100:00000040:13.0:1773851882.579474:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000007befa5b8 x1858039715189696 msgsize 224
00000100:00100000:13.0:1773851882.579476:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25586@kfi7 (source: 12345-25394@kfi7)
00000100:00000001:13.0:1773851882.579477:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851882.579478:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000027c9fa69 nid 25394@kfi7 refs 2
00000100:00000001:15.0:1773851882.579479:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851882.579479:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851882.579479:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851882.579480:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851882.579480:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851882.579481:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851882.579482:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039715189696
00000020:00000001:15.0:1773851882.579483:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851882.579483:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9297c
00000020:00000001:15.0:1773851882.579484:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851882.579488:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d18fbbf refcount=6
00000020:00000001:15.0:1773851882.579489:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743187456 : -107128966364160 : ffff9e911803c400)
00000020:00000001:15.0:1773851882.579490:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743187456 : -107128966364160 : ffff9e911803c400)
00000100:00000001:15.0:1773851882.579491:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.579492:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851882.579493:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005a6ddf9a.
00000020:00000010:15.0:1773851882.579494:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851882.579495:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851882.579496:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851882.579496:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851882.579497:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.579498:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851882.579498:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851882.579499:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.579500:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.579501:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851882.579502:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851882.579503:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25586@kfi7, seq: 2289885
00000100:00000001:12.0:1773851882.579503:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:15.0:1773851882.579504:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d18fbbf : new rpc_count 1
00000100:00000001:15.0:1773851882.579504:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902246784 : -106994807304832 : ffff9eb054848d80)
00000100:00000001:12.0:1773851882.579504:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851882.579505:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851882.579506:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007befa5b8 x1858039715189696/t0(0) o400->7c341dda-ed27-4efe-8dfc-0ff4b0a86951@25586@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2073-0'
00000100:00000001:12.0:1773851882.579506:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.579509:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.579509:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851882.579510:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007befa5b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7c341dda-ed27-4efe-8dfc-0ff4b0a86951+6:39657:x1858039715189696:12345-25586@kfi7:400:default-tuolumne2073-0
00000100:00000200:15.0:1773851882.579511:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039715189696
00000020:00000001:15.0:1773851882.579512:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851882.579513:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851882.579513:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.579514:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851882.579515:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851882.579516:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851882.579516:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039715189696, found 0 last_xid 1858039715189695
00000020:00000001:15.0:1773851882.579517:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851882.579518:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851882.579518:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851882.579519:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.579520:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851882.579520:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851882.579521:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851882.579522:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a416ad54.
02000000:00000001:15.0:1773851882.579523:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.579523:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.579524:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851882.579525:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104960798, transno 0, xid 1858039715189696
00010000:00000001:15.0:1773851882.579525:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851882.579526:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007befa5b8 x1858039715189696/t0(0) o400->7c341dda-ed27-4efe-8dfc-0ff4b0a86951@25586@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2073-0'
00010000:00000001:15.0:1773851882.579529:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851882.579530:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851882.579531:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=115 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851882.579532:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851882.579533:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000001733363 refcount 3 to 25586@kfi7
00000100:00000001:15.0:1773851882.579534:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027584 : -107156745524032 : ffff9e8aa03f6cc0)
02000000:00000001:15.0:1773851882.579534:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851882.579535:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.579536:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851882.579536:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25394@kfi7
00000400:00000010:15.0:1773851882.579537:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000db81fd34.
00000100:00000200:15.0:1773851882.579538:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039715189696, offset 224
00000400:00000200:15.0:1773851882.579541:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25394@kfi7
00000400:00000200:15.0:1773851882.579542:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25394@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.579544:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027c9fa69 nid 25394@kfi7 refs 1
00000400:00000200:15.0:1773851882.579545:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000027c9fa69 nid 25394@kfi7 refs 2
00000400:00000200:15.0:1773851882.579547:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000027c9fa69 nid 25394@kfi7 refs 3
00000400:00000200:15.0:1773851882.579549:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25394@kfi7 local destination
00000400:00000200:15.0:1773851882.579552:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769733:8769733:1024:4294967295] 25394@kfi7 LPNI seq info [202112:202112:16:4294967295]
00000400:00000200:15.0:1773851882.579554:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000027c9fa69 nid 25394@kfi7 refs 2
00000400:00000200:15.0:1773851882.579556:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25394@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.579559:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25394@kfi7(25394@kfi7:25394@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851882.579562:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000027c9fa69 nid 25394@kfi7 refs 3
00000800:00000200:15.0:1773851882.579564:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851882.579566:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851882.579570:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851882.579575:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ab2 Using peer 25394@kfi7(0x100000000000ab2)
00000800:00000200:15.0:1773851882.579580:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x100000000000ab2: rc=0
00000800:00000200:15.0:1773851882.579583:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ab2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851882.579590:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851882.579592:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000001733363 refcount 2 to 25586@kfi7
00010000:00000001:15.0:1773851882.579593:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851882.579594:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.579595:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000800:00000200:14.0:1773851882.579595:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ab2 TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851882.579596:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007befa5b8 x1858039715189696/t0(0) o400->7c341dda-ed27-4efe-8dfc-0ff4b0a86951@25586@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2073-0'
00000400:00000200:14.0:1773851882.579597:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851882.579598:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25394@kfi7: PUT: OK
00000400:00000200:14.0:1773851882.579599:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000db81fd34
00000400:00000010:14.0:1773851882.579599:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000db81fd34.
00000100:00000001:14.0:1773851882.579600:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851882.579601:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:15.0:1773851882.579602:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007befa5b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7c341dda-ed27-4efe-8dfc-0ff4b0a86951+6:39657:x1858039715189696:12345-25586@kfi7:400:default-tuolumne2073-0 Request processed in 92us (127us total) trans 0 rc 0/0
00000400:00000200:14.0:1773851882.579602:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000027c9fa69 nid 25394@kfi7 refs 2
00000800:00000200:14.0:1773851882.579604:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 25394@kfi7(00000000dcf5228c):0x0 lsk 2739 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ab2 Transaction freed
00000100:00100000:15.0:1773851882.579607:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25586@kfi7, seq: 2289885
00000100:00000040:15.0:1773851882.579608:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d18fbbf : new rpc_count 0
00000100:00000001:15.0:1773851882.579610:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851882.579611:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851882.579612:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851882.579613:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000020:00000010:15.0:1773851882.579614:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005a6ddf9a.
00000020:00000040:15.0:1773851882.579616:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000002d18fbbf : new refcount 5
00000100:00000001:15.0:1773851882.579617:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851882.633735:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633736:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851882.633737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851882.633739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851882.633741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851882.633743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851882.633745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851882.633747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851882.633749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851882.633750:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851882.633755:0:849255:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851882.633756:0:849255:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851882.633757:0:849255:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:9.0:1773851882.668514:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851882.668515:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851882.668516:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851882.668519:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851882.668520:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11712@kfi7 to cpt 2
00000400:00000200:9.0:1773851882.668521:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11712@kfi7 : PUT - for me
00000400:00000200:9.0:1773851882.668522:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11712@kfi7 to cpt 2
00000400:00000200:9.0:1773851882.668523:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006196df1b nid 11712@kfi7 refs 1
00000400:00000200:9.0:1773851882.668524:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11712@kfi7 to cpt 2
00000400:00000200:9.0:1773851882.668525:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006196df1b nid 11712@kfi7 refs 2
00000400:00000200:9.0:1773851882.668526:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006196df1b nid 11712@kfi7 refs 3
00000400:00000200:9.0:1773851882.668527:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11712@kfi7 to cpt 2
00000400:00000200:9.0:1773851882.668528:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11712@kfi7 of length 224 into portal 12 MB=0x69b43e40ed140
00000400:00000200:9.0:1773851882.668529:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11712@kfi7 of length 224/224 into md 0x78146ce49 [64] + 146432
00000800:00000200:9.0:1773851882.668531:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851882.668533:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851882.668534:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11712@kfi7: PUT: OK
00000100:00000001:9.0:1773851882.668535:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851882.668535:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851882.668536:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070d816a2.
00000100:00000040:9.0:1773851882.668537:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000070d816a2 x1859565751554368 msgsize 224
00000100:00100000:9.0:1773851882.668538:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-11712@kfi7 (source: 12345-11712@kfi7)
00000100:00000001:9.0:1773851882.668539:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851882.668540:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006196df1b nid 11712@kfi7 refs 2
00000100:00000001:11.0:1773851882.668541:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851882.668541:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851882.668542:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851882.668542:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851882.668542:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851882.668543:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851882.668544:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859565751554368
00000020:00000001:11.0:1773851882.668544:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851882.668545:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07d9151ed48
00000020:00000001:11.0:1773851882.668545:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851882.668548:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c96ecb89 refcount=5
00000020:00000001:11.0:1773851882.668549:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128136163328 : -106945573388288 : ffff9ebbcb168000)
00000020:00000001:11.0:1773851882.668549:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128136163328 : -106945573388288 : ffff9ebbcb168000)
00000100:00000001:11.0:1773851882.668550:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851882.668551:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851882.668552:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9ba5d0e.
00000020:00000010:11.0:1773851882.668553:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851882.668554:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004334b4cb.
00000100:00000001:11.0:1773851882.668554:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851882.668557:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851882.668557:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851882.668558:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851882.668559:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851882.668559:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.668560:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851882.668561:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851882.668561:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851882.668561:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851882.668562:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11712@kfi7, seq: 2130815
00000100:00000001:8.0:1773851882.668562:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851882.668563:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c96ecb89 : new rpc_count 1
00000100:00000001:8.0:1773851882.668563:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.668564:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162670848 : -106971546880768 : ffff9eb5bef27500)
00000100:00000001:8.0:1773851882.668564:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851882.668565:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000070d816a2 x1859565751554368/t0(0) o400->c1654519-4ee4-4a4d-8432-57bd5be208dd@11712@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1219-0'
00000100:00000001:11.0:1773851882.668567:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851882.668568:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851882.668569:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070d816a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c1654519-4ee4-4a4d-8432-57bd5be208dd+5:39649:x1859565751554368:12345-11712@kfi7:400:default-tuolumne1219-0
00000100:00000200:11.0:1773851882.668570:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859565751554368
00000020:00000001:11.0:1773851882.668571:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851882.668571:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851882.668572:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.668572:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851882.668573:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851882.668574:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851882.668574:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859565751554368, found 0 last_xid 1859565751554367
00000020:00000001:11.0:1773851882.668575:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851882.668576:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851882.668576:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851882.668577:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.668577:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851882.668578:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851882.668578:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851882.668579:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006beb7abc.
02000000:00000001:11.0:1773851882.668579:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.668580:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.668581:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851882.668582:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691266, transno 0, xid 1859565751554368
00010000:00000001:11.0:1773851882.668582:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851882.668583:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000070d816a2 x1859565751554368/t0(0) o400->c1654519-4ee4-4a4d-8432-57bd5be208dd@11712@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1219-0'
00010000:00000001:11.0:1773851882.668586:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851882.668586:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851882.668587:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=115 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851882.668588:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851882.668588:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000f8333d9 refcount 3 to 11712@kfi7
00000100:00000001:11.0:1773851882.668589:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274738336 : -107155434813280 : ffff9e8aee5f48a0)
02000000:00000001:11.0:1773851882.668590:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851882.668590:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.668591:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851882.668592:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11712@kfi7
00000400:00000010:11.0:1773851882.668592:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000641ade85.
00000100:00000200:11.0:1773851882.668593:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859565751554368, offset 224
00000400:00000200:11.0:1773851882.668594:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11712@kfi7
00000400:00000200:11.0:1773851882.668595:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11712@kfi7 to cpt 2
00000400:00000200:11.0:1773851882.668595:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006196df1b nid 11712@kfi7 refs 1
00000400:00000200:11.0:1773851882.668596:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006196df1b nid 11712@kfi7 refs 2
00000400:00000200:11.0:1773851882.668597:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006196df1b nid 11712@kfi7 refs 3
00000400:00000200:11.0:1773851882.668598:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11712@kfi7 local destination
00000400:00000200:11.0:1773851882.668599:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769734:8769734:1024:4294967295] 11712@kfi7 LPNI seq info [166049:166049:16:4294967295]
00000400:00000200:11.0:1773851882.668601:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006196df1b nid 11712@kfi7 refs 2
00000400:00000200:11.0:1773851882.668602:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11712@kfi7 to cpt 2
00000400:00000200:11.0:1773851882.668603:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11712@kfi7(11712@kfi7:11712@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851882.668605:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006196df1b nid 11712@kfi7 refs 3
00000800:00000200:11.0:1773851882.668606:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851882.668607:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851882.668611:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851882.668613:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004b7 Using peer 11712@kfi7(0x1000000000004b7)
00000800:00000200:11.0:1773851882.668616:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x1000000000004b7: rc=0
00000800:00000200:11.0:1773851882.668617:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004b7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851882.668620:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851882.668621:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000f8333d9 refcount 2 to 11712@kfi7
00010000:00000001:11.0:1773851882.668621:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851882.668622:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851882.668623:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851882.668623:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000070d816a2 x1859565751554368/t0(0) o400->c1654519-4ee4-4a4d-8432-57bd5be208dd@11712@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1219-0'
00000100:00100000:11.0:1773851882.668626:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070d816a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c1654519-4ee4-4a4d-8432-57bd5be208dd+5:39649:x1859565751554368:12345-11712@kfi7:400:default-tuolumne1219-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851882.668628:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11712@kfi7, seq: 2130815
00000100:00000040:11.0:1773851882.668629:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c96ecb89 : new rpc_count 0
00000100:00000001:11.0:1773851882.668630:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851882.668631:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851882.668631:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000800:00000200:10.0:1773851882.668631:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004b7 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851882.668632:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004334b4cb.
00000020:00000010:11.0:1773851882.668633:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9ba5d0e.
00000020:00000040:11.0:1773851882.668633:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000c96ecb89 : new refcount 4
00000400:00000200:10.0:1773851882.668633:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851882.668634:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851882.668634:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11712@kfi7: PUT: OK
00000400:00000200:10.0:1773851882.668635:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000641ade85
00000400:00000010:10.0:1773851882.668636:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000641ade85.
00000100:00000001:10.0:1773851882.668636:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851882.668637:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851882.668638:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006196df1b nid 11712@kfi7 refs 2
00000800:00000200:10.0:1773851882.668639:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 11712@kfi7(00000000a3b43f28):0x0 lsk 1208 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004b7 Transaction freed
00000800:00000200:21.0:1773851882.682732:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851882.682733:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851882.682735:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851882.682748:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851882.682750:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18483@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.682752:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18483@kfi7 : PUT - for me
00000400:00000200:21.0:1773851882.682753:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18483@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.682754:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051101a8d nid 18483@kfi7 refs 1
00000400:00000200:21.0:1773851882.682755:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18483@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.682756:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051101a8d nid 18483@kfi7 refs 2
00000400:00000200:21.0:1773851882.682757:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000051101a8d nid 18483@kfi7 refs 3
00000400:00000200:21.0:1773851882.682758:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18483@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.682759:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18483@kfi7 of length 224 into portal 12 MB=0x69b0954e82080
00000400:00000200:21.0:1773851882.682760:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18483@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 51248
00000800:00000200:21.0:1773851882.682763:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851882.682764:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851882.682766:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18483@kfi7: PUT: OK
00000100:00000001:21.0:1773851882.682767:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851882.682768:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851882.682769:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005feaf29b.
00000100:00000040:21.0:1773851882.682770:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005feaf29b x1859314241773696 msgsize 224
00000100:00100000:21.0:1773851882.682772:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18483@kfi7 (source: 12345-18483@kfi7)
00000100:00000001:21.0:1773851882.682773:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851882.682775:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000051101a8d nid 18483@kfi7 refs 2
00000100:00000001:20.0:1773851882.682776:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851882.682777:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851882.682777:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851882.682777:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851882.682778:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851882.682779:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851882.682780:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314241773696
00000020:00000001:20.0:1773851882.682781:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851882.682782:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92730
00000020:00000001:20.0:1773851882.682783:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851882.682787:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a99489cc refcount=6
00000020:00000001:20.0:1773851882.682789:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631256064 : -107123078295552 : ffff9e9276f89000)
00000020:00000001:20.0:1773851882.682790:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631256064 : -107123078295552 : ffff9e9276f89000)
00000100:00000001:20.0:1773851882.682792:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851882.682793:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851882.682794:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851882.682796:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851882.682798:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851882.682799:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851882.682800:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851882.682801:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851882.682803:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851882.682804:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851882.682804:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.682806:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851882.682809:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851882.682809:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851882.682809:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851882.682810:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851882.682811:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18483@kfi7, seq: 1998027
00000100:00000040:20.0:1773851882.682812:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a99489cc : new rpc_count 1
00000100:00000001:23.0:1773851882.682813:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851882.682814:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.682814:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956266112 : -106937753285504 : ffff9ebd9d33cc80)
00000100:00000040:20.0:1773851882.682816:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005feaf29b x1859314241773696/t0(0) o400->32831f5d-c7d2-4def-b112-79c67b43983e@18483@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1641-0'
00000100:00000001:20.0:1773851882.682821:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851882.682822:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851882.682824:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005feaf29b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:32831f5d-c7d2-4def-b112-79c67b43983e+6:39541:x1859314241773696:12345-18483@kfi7:400:default-tuolumne1641-0
00000100:00000200:20.0:1773851882.682826:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314241773696
00000020:00000001:20.0:1773851882.682827:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851882.682828:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851882.682829:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.682831:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851882.682831:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851882.682833:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851882.682834:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314241773696, found 0 last_xid 1859314241773695
00000020:00000001:20.0:1773851882.682836:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851882.682837:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851882.682838:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851882.682839:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.682840:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851882.682841:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851882.682842:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851882.682844:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a84cdd70.
02000000:00000001:20.0:1773851882.682845:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.682846:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.682847:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851882.682848:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262824995, transno 0, xid 1859314241773696
00010000:00000001:20.0:1773851882.682850:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851882.682851:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005feaf29b x1859314241773696/t0(0) o400->32831f5d-c7d2-4def-b112-79c67b43983e@18483@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1641-0'
00010000:00000001:20.0:1773851882.682856:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851882.682857:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851882.682858:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=115 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851882.682860:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851882.682862:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0d8e3a9 refcount 3 to 18483@kfi7
00000100:00000001:20.0:1773851882.682863:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095840 : -107139307455776 : ffff9e8eafa33ae0)
02000000:00000001:20.0:1773851882.682864:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851882.682865:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.682866:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851882.682868:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18483@kfi7
00000400:00000010:20.0:1773851882.682869:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c06062.
00000100:00000200:20.0:1773851882.682870:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314241773696, offset 224
00000400:00000200:20.0:1773851882.682873:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18483@kfi7
00000400:00000200:20.0:1773851882.682874:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18483@kfi7 to cpt 5
00000400:00000200:20.0:1773851882.682876:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051101a8d nid 18483@kfi7 refs 1
00000400:00000200:20.0:1773851882.682878:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000051101a8d nid 18483@kfi7 refs 2
00000400:00000200:20.0:1773851882.682880:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000051101a8d nid 18483@kfi7 refs 3
00000400:00000200:20.0:1773851882.682882:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18483@kfi7 local destination
00000400:00000200:20.0:1773851882.682885:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769735:8769735:1024:4294967295] 18483@kfi7 LPNI seq info [573411:573411:16:4294967295]
00000400:00000200:20.0:1773851882.682887:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000051101a8d nid 18483@kfi7 refs 2
00000400:00000200:20.0:1773851882.682889:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18483@kfi7 to cpt 5
00000400:00000200:20.0:1773851882.682893:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18483@kfi7(18483@kfi7:18483@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851882.682895:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000051101a8d nid 18483@kfi7 refs 3
00000800:00000200:20.0:1773851882.682898:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851882.682900:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851882.682904:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851882.682908:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x753 Using peer 18483@kfi7(0x753)
00000800:00000200:20.0:1773851882.682912:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x753: rc=0
00000800:00000200:20.0:1773851882.682914:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x753 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851882.682917:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851882.682919:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0d8e3a9 refcount 2 to 18483@kfi7
00010000:00000001:20.0:1773851882.682920:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851882.682923:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.682924:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851882.682925:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005feaf29b x1859314241773696/t0(0) o400->32831f5d-c7d2-4def-b112-79c67b43983e@18483@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1641-0'
00000100:00100000:20.0:1773851882.682930:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005feaf29b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:32831f5d-c7d2-4def-b112-79c67b43983e+6:39541:x1859314241773696:12345-18483@kfi7:400:default-tuolumne1641-0 Request processed in 108us (159us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851882.682934:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18483@kfi7, seq: 1998027
00000100:00000040:20.0:1773851882.682935:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a99489cc : new rpc_count 0
00000100:00000001:20.0:1773851882.682937:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851882.682937:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851882.682938:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851882.682939:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851882.682941:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851882.682942:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000a99489cc : new refcount 5
00000100:00000001:20.0:1773851882.682943:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851882.682951:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x753 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851882.682953:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851882.682955:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18483@kfi7: PUT: OK
00000400:00000200:21.0:1773851882.682956:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c06062
00000400:00000010:21.0:1773851882.682957:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c06062.
00000100:00000001:21.0:1773851882.682959:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851882.682960:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851882.682961:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000051101a8d nid 18483@kfi7 refs 2
00000800:00000200:21.0:1773851882.682964:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18483@kfi7(00000000858445ec):0x0 lsk 1876 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x753 Transaction freed
00000800:00000200:18.0:1773851882.686373:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.686373:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851882.686374:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851882.686374:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851882.686376:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851882.686376:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851882.686379:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851882.686379:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25986@kfi7(00000000f0f112ff):0x10ac version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851882.686382:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000800:00000200:17.0:1773851882.686382:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac Using peer 25986@kfi7(0x1000000000010ac)
00000400:00000200:18.0:1773851882.686384:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25986@kfi7 : PUT - for me
00000400:00000200:17.0:1773851882.686385:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:18.0:1773851882.686386:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:18.0:1773851882.686387:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 1
00000800:00000200:17.0:1773851882.686387:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x1000000000010ac: rc=0
00000400:00000200:18.0:1773851882.686389:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000800:00000200:17.0:1773851882.686390:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851882.686391:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000400:00000200:18.0:1773851882.686392:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 3
00000400:00000200:18.0:1773851882.686394:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:18.0:1773851882.686395:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25986@kfi7 of length 520 into portal 12 MB=0x699e10ccce6c0
00000400:00000200:18.0:1773851882.686397:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25986@kfi7 of length 520/520 into md 0x6ab01b5d1 [64] + 30936
00000800:00000200:18.0:1773851882.686400:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851882.686403:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851882.686403:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851882.686405:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25986@kfi7: PUT: OK
00000100:00000001:18.0:1773851882.686406:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851882.686407:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851882.686408:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001fe91f27.
00000100:00000040:18.0:1773851882.686409:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001fe91f27 x1858041721710272 msgsize 520
00000800:00000200:17.0:1773851882.686410:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac Transaction freed
00000100:00100000:18.0:1773851882.686412:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-25986@kfi7 (source: 12345-25986@kfi7)
00000100:00000001:18.0:1773851882.686414:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851882.686415:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000100:00000001:16.0:1773851882.686416:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851882.686417:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851882.686418:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851882.686418:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851882.686419:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851882.686420:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851882.686421:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041721710272
00000020:00000001:16.0:1773851882.686422:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851882.686423:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91efc
00000020:00000001:16.0:1773851882.686424:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851882.686428:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a86137e3 refcount=9
00000020:00000001:16.0:1773851882.686429:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629008384 : -107123080543232 : ffff9e9276d64400)
00000020:00000001:16.0:1773851882.686431:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629008384 : -107123080543232 : ffff9e9276d64400)
00000100:00000001:16.0:1773851882.686432:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851882.686433:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851882.686436:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dcd298eb.
00000020:00000010:16.0:1773851882.686438:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851882.686439:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004afc5e58.
00000100:00000001:16.0:1773851882.686441:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851882.686442:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851882.686443:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851882.686445:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:16.0:1773851882.686446:0:61039:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@000000001fe91f27 x1858041721710272/t0(0) o38->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852082 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2120-0'
00000100:00000001:16.0:1773851882.686451:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851882.686451:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.686453:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851882.686455:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851882.686456:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851882.686456:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851882.686456:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851882.686458:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25986@kfi7, seq: 2156385
00000100:00000001:17.0:1773851882.686459:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851882.686459:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a86137e3 : new rpc_count 2
00000100:00000001:17.0:1773851882.686460:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.686460:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534646912 : -106946174904704 : ffff9ebba73c1680)
00000100:00000040:16.0:1773851882.686462:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001fe91f27 x1858041721710272/t0(0) o38->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852082 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2120-0'
00000100:00000001:16.0:1773851882.686466:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851882.686467:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851882.686469:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fe91f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:86175010-6b73-4218-8cde-3f3a1c0aa50a+9:39824:x1858041721710272:12345-25986@kfi7:38:default-tuolumne2120-0
00000100:00000200:16.0:1773851882.686471:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041721710272
00000020:00000001:16.0:1773851882.686472:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:16.0:1773851882.686473:0:61039:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:16.0:1773851882.686476:0:61039:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:16.0:1773851882.686477:0:61039:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:16.0:1773851882.686479:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851882.686480:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851882.686482:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 000000001830fab9.
02000000:00000001:16.0:1773851882.686483:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.686484:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:16.0:1773851882.686486:0:61039:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:16.0:1773851882.686487:0:61039:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 86175010-6b73-4218-8cde-3f3a1c0aa50a (at 25986@kfi7) reconnecting
00010000:00000001:16.0:1773851882.686489:0:61039:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:16.0:1773851882.686491:0:61039:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:16.0:1773851882.686493:0:61039:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from 86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7 t176180472368 exp 00000000a86137e3 cur 614157 last 1773851882
00010000:00000001:16.0:1773851882.686495:0:61039:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:16.0:1773851882.686496:0:61039:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:16.0:1773851882.686497:0:61039:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:16.0:1773851882.686499:0:61039:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:16.0:1773851882.686500:0:61039:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:16.0:1773851882.686501:0:61039:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:16.0:1773851882.686502:0:61039:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:16.0:1773851882.686503:0:61039:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:16.0:1773851882.686505:0:61039:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:16.0:1773851882.686506:0:61039:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.686507:0:61039:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:16.0:1773851882.686508:0:61039:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:16.0:1773851882.686510:0:61039:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 86175010-6b73-4218-8cde-3f3a1c0aa50a/00000000a86137e3 free: 126633370845184 avail: 126633368748032
00000020:00000001:16.0:1773851882.686511:0:61039:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:16.0:1773851882.686512:0:61039:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 86175010-6b73-4218-8cde-3f3a1c0aa50a/00000000a86137e3 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:16.0:1773851882.686514:0:61039:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:16.0:1773851882.686516:0:61039:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:16.0:1773851882.686517:0:61039:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:16.0:1773851882.686518:0:61039:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli 86175010-6b73-4218-8cde-3f3a1c0aa50a/00000000a86137e3 ocd_grant: 1878786047 want: 2097152 left: 112130449866752
00000020:00000001:16.0:1773851882.686520:0:61039:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:16.0:1773851882.686521:0:61039:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 25986@kfi7 supports cksum type f7, return f7
00000004:00000001:16.0:1773851882.686523:0:61039:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:16.0:1773851882.686524:0:61039:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:16.0:1773851882.686525:0:61039:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:16.0:1773851882.686526:0:61039:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:16.0:1773851882.686528:0:61039:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:16.0:1773851882.686529:0:61039:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851882.686530:0:61039:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 00000000a86137e3 : new rpc_count 1
00000020:00000040:16.0:1773851882.686531:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000a86137e3 : new refcount 9
00000020:00000040:16.0:1773851882.686533:0:61039:0:(genops.c:871:class_export_get()) GET export 00000000a86137e3 refcount=10
00000100:00000040:16.0:1773851882.686534:0:61039:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 00000000a86137e3 : new rpc_count 2
00000100:00000001:16.0:1773851882.686536:0:61039:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:16.0:1773851882.686537:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:16.0:1773851882.686538:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 1
00000400:00000200:16.0:1773851882.686540:0:61039:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000400:00000200:16.0:1773851882.686543:0:61039:0:(peer.c:1555:LNetPrimaryNID()) NID 25986@kfi7 primary NID 25986@kfi7 rc 0
00000100:00000001:16.0:1773851882.686599:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851882.686600:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000065a40ac2 refcount 3 to 25986@kfi7
00000100:00000001:16.0:1773851882.686601:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959840 : -107156125591776 : ffff9e8ac532d720)
00000100:00000001:16.0:1773851882.686603:0:61039:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446636917583959840 : -107156125591776 : 0xffff9e8ac532d720)
00000100:00000040:16.0:1773851882.686605:0:61039:0:(connection.c:133:ptlrpc_connection_get()) conn=0000000065a40ac2 refcount 3 to 25986@kfi7
00000100:00080000:16.0:1773851882.686606:0:61039:0:(import.c:86:import_set_state_nolock()) 00000000f1da339a nCÞ: changing import state from FULL to RECOVER
00010000:00000040:16.0:1773851882.686608:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000065a40ac2 refcount 2 to 25986@kfi7
00000100:00000001:16.0:1773851882.686609:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851882.686610:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000065a40ac2 refcount 3 to 25986@kfi7
00000100:00000001:16.0:1773851882.686611:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959840 : -107156125591776 : ffff9e8ac532d720)
02000000:00000001:16.0:1773851882.686613:0:61039:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:16.0:1773851882.686614:0:61039:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:16.0:1773851882.686615:0:61039:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.686617:0:61039:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:16.0:1773851882.686618:0:61039:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:16.0:1773851882.686618:0:61039:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.0:1773851882.686619:0:61039:0:(import.c:86:import_set_state_nolock()) 00000000f1da339a nCÞ: changing import state from RECOVER to FULL
00000100:00000001:16.0:1773851882.686621:0:61039:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:16.0:1773851882.686621:0:61039:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:16.0:1773851882.686622:0:61039:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:16.0:1773851882.686623:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000a86137e3 : new refcount 9
00000020:00000040:16.0:1773851882.686624:0:61039:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:16.0:1773851882.686626:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000065a40ac2 refcount 2 to 25986@kfi7
00010000:00000001:16.0:1773851882.686627:0:61039:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.686628:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851882.686630:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:16.0:1773851882.686631:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:16.0:1773851882.686632:0:61039:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851882.686633:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851882.686634:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851882.686635:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.686636:0:61039:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:16.0:1773851882.686638:0:61039:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:16.0:1773851882.686638:0:61039:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:16.0:1773851882.686639:0:61039:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:16.0:1773851882.686640:0:61039:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.686641:0:61039:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851882.686642:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183220364662, transno 0, xid 1858041721710272
00010000:00000001:16.0:1773851882.686643:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851882.686645:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001fe91f27 x1858041721710272/t0(0) o38->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852082 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2120-0'
00010000:00000001:16.0:1773851882.686649:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851882.686650:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851882.686651:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=115 v=315 (315 214 1 1)
00000100:00001000:16.0:1773851882.686653:0:61039:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:16.0:1773851882.686654:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851882.686655:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000065a40ac2 refcount 3 to 25986@kfi7
00000100:00000001:16.0:1773851882.686656:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959840 : -107156125591776 : ffff9e8ac532d720)
02000000:00000001:16.0:1773851882.686658:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851882.686659:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.686660:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851882.686661:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25986@kfi7
00000400:00000010:16.0:1773851882.686662:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e46202c7.
00000100:00000200:16.0:1773851882.686663:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1858041721710272, offset 0
00000400:00000200:16.0:1773851882.686665:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25986@kfi7
00000400:00000200:16.0:1773851882.686667:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:16.0:1773851882.686668:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 1
00000400:00000200:16.0:1773851882.686669:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000400:00000200:16.0:1773851882.686671:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 3
00000400:00000200:16.0:1773851882.686674:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25986@kfi7 local destination
00000400:00000200:16.0:1773851882.686676:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769736:8769736:1024:4294967295] 25986@kfi7 LPNI seq info [8088243:8088243:16:4294967295]
00000400:00000200:16.0:1773851882.686678:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000400:00000200:16.0:1773851882.686679:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:16.0:1773851882.686683:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25986@kfi7(25986@kfi7:25986@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851882.686685:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 3
00000800:00000200:16.0:1773851882.686687:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851882.686688:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:16.0:1773851882.686691:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851882.686694:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac Using peer 25986@kfi7(0x1000000000010ac)
00000800:00000200:16.0:1773851882.686698:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000279c411a: Posted send of 516 bytes to peer 0x1000000000010ac: rc=0
00000800:00000200:16.0:1773851882.686700:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851882.686702:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851882.686703:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000065a40ac2 refcount 2 to 25986@kfi7
00010000:00000001:16.0:1773851882.686704:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851882.686704:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.686705:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851882.686706:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001fe91f27 x1858041721710272/t0(0) o38->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852082 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2120-0'
00000100:00100000:16.0:1773851882.686711:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fe91f27 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:86175010-6b73-4218-8cde-3f3a1c0aa50a+9:39824:x1858041721710272:12345-25986@kfi7:38:default-tuolumne2120-0 Request processed in 244us (301us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851882.686714:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25986@kfi7, seq: 2156385
00000100:00000040:16.0:1773851882.686714:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a86137e3 : new rpc_count 1
00000100:00000001:16.0:1773851882.686715:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851882.686716:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851882.686717:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851882.686718:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004afc5e58.
00000020:00000010:16.0:1773851882.686719:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dcd298eb.
00000020:00000040:16.0:1773851882.686720:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000a86137e3 : new refcount 8
00000100:00000001:16.0:1773851882.686720:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851882.686725:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851882.686730:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.686731:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25986@kfi7: PUT: OK
00000400:00000200:17.0:1773851882.686732:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e46202c7
00000400:00000010:17.0:1773851882.686732:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e46202c7.
00000100:00000001:17.0:1773851882.686733:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851882.686734:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851882.686734:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000800:00000200:17.0:1773851882.686736:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 25986@kfi7(00000000f0f112ff):0x0 lsk 4269 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000010ac Transaction freed
00000800:00000200:17.0:1773851882.687308:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.687309:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:17.0:1773851882.687310:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851882.687312:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25986@kfi7(000000001900b10e):0x9ab version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851882.687313:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ab Using peer 25986@kfi7(0x9ab)
00000400:00000200:17.0:1773851882.687315:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000800:00000200:17.0:1773851882.687317:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 38 bytes to peer 0x9ab: rc=0
00000800:00000200:18.0:1773851882.687318:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.687318:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:18.0:1773851882.687319:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851882.687320:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851882.687322:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851882.687324:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:18.0:1773851882.687325:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25986@kfi7 : PUT - for me
00000400:00000200:18.0:1773851882.687326:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:18.0:1773851882.687327:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 1
00000400:00000200:18.0:1773851882.687328:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000400:00000200:18.0:1773851882.687328:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000400:00000200:18.0:1773851882.687329:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 3
00000400:00000200:18.0:1773851882.687330:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25986@kfi7 to cpt 4
00000800:00000200:17.0:1773851882.687330:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ab TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851882.687331:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25986@kfi7 of length 2536 into portal 12 MB=0x699e10cc058c0
00000400:00000200:18.0:1773851882.687332:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25986@kfi7 of length 2536/2536 into md 0x6ab01b5d1 [64] + 31456
00000800:00000200:17.0:1773851882.687333:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ab Transaction freed
00000800:00000200:18.0:1773851882.687334:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851882.687336:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851882.687337:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25986@kfi7: PUT: OK
00000100:00000001:18.0:1773851882.687338:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851882.687338:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851882.687339:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d6a4ffa6.
00000100:00000040:18.0:1773851882.687340:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000d6a4ffa6 x1858041720887488 msgsize 2536
00000100:00100000:18.0:1773851882.687342:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-25986@kfi7 (source: 12345-25986@kfi7)
00000100:00000001:18.0:1773851882.687342:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851882.687343:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eae8d055 nid 25986@kfi7 refs 2
00000100:00000001:16.0:1773851882.687344:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851882.687345:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25986@kfi7(000000001900b10e):0x0 lsk 2476 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851882.687345:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851882.687345:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851882.687345:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851882.687346:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851882.687347:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041720887488
00000020:00000001:16.0:1773851882.687347:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851882.687348:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91efc
00000020:00000001:16.0:1773851882.687348:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851882.687349:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a86137e3 refcount=9
00000020:00000001:16.0:1773851882.687350:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629008384 : -107123080543232 : ffff9e9276d64400)
00000020:00000001:16.0:1773851882.687350:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629008384 : -107123080543232 : ffff9e9276d64400)
00000100:00000001:16.0:1773851882.687351:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851882.687351:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851882.687352:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dcd298eb.
00000020:00000010:16.0:1773851882.687352:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851882.687353:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004afc5e58.
00000100:00000001:16.0:1773851882.687354:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851882.687354:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:16.0:1773851882.687355:0:61039:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:16.0:1773851882.687357:0:61039:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000723e31eb cookie 0xf02ba29db91f6cc  req@00000000d6a4ffa6 x1858041720887488/t0(0) o101->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:522/0 lens 2536/0 e 0 to 0 dl 1773852637 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833102055220575232'
00010000:00000001:16.0:1773851882.687360:0:61039:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:16.0:1773851882.687360:0:61039:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:16.0:1773851882.687361:0:61039:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.687361:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:16.1:1773851882.687363:0:61039:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@00000000d6a4ffa6 x1858041720887488/t0(0) o101->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:522/0 lens 2536/0 e 0 to 0 dl 1773852637 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-833102055220575232'
00000100:00080000:16.1:1773851882.687366:0:61039:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000f27b964c x1858041720887488/t0(0) o101->86175010-6b73-4218-8cde-3f3a1c0aa50a@25986@kfi7:390/0 lens 2536/5304 e 0 to 0 dl 1773851816 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833102055220575232'
00000100:00000001:16.0:1773851882.687369:0:61039:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:16.0:1773851882.687370:0:61039:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:16.0:1773851882.687371:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851882.687372:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851882.687372:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851882.687373:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004afc5e58.
00000020:00000010:16.0:1773851882.687374:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dcd298eb.
00000020:00000040:16.0:1773851882.687374:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000a86137e3 : new refcount 8
00000100:00000001:16.0:1773851882.687375:0:61039:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851882.701962:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851882.701963:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851882.701965:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851882.701967:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851882.701969:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10193@kfi7 to cpt 1
00000400:00000200:6.0:1773851882.701970:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10193@kfi7 : PUT - for me
00000400:00000200:6.0:1773851882.701971:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10193@kfi7 to cpt 1
00000400:00000200:6.0:1773851882.701972:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d409e81d nid 10193@kfi7 refs 1
00000400:00000200:6.0:1773851882.701973:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10193@kfi7 to cpt 1
00000400:00000200:6.0:1773851882.701974:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d409e81d nid 10193@kfi7 refs 2
00000400:00000200:6.0:1773851882.701975:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d409e81d nid 10193@kfi7 refs 3
00000400:00000200:6.0:1773851882.701976:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10192@kfi7 to cpt 6
00000400:00000200:6.0:1773851882.701977:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10192@kfi7 of length 224 into portal 12 MB=0x69b4b72b18880
00000400:00000200:6.0:1773851882.701978:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10192@kfi7 of length 224/224 into md 0x793926dc5 [64] + 153424
00000800:00000200:6.0:1773851882.701980:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851882.701982:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851882.701983:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10193@kfi7: PUT: OK
00000100:00000001:6.0:1773851882.701984:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851882.701985:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851882.701986:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000be3da377.
00000100:00000040:6.0:1773851882.701987:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000be3da377 x1859598209353856 msgsize 224
00000100:00100000:6.0:1773851882.701988:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-10192@kfi7 (source: 12345-10193@kfi7)
00000100:00000001:6.0:1773851882.701989:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851882.701990:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d409e81d nid 10193@kfi7 refs 2
00000100:00000001:7.0:1773851882.701991:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851882.701991:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851882.701992:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851882.701992:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851882.701992:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001aa19562: 2054@kfi7:1 <- 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851882.701993:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851882.701994:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598209353856
00000020:00000001:7.0:1773851882.701994:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851882.701995:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d78241
00000020:00000001:7.0:1773851882.701995:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851882.701997:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d86f309e refcount=6
00000020:00000001:7.0:1773851882.701998:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112406126592 : -106961303425024 : ffff9eb821813000)
00000020:00000001:7.0:1773851882.701998:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637112406126592 : -106961303425024 : ffff9eb821813000)
00000100:00000001:7.0:1773851882.701999:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851882.702000:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851882.702001:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851882.702002:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851882.702003:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851882.702003:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851882.702004:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851882.702004:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851882.702005:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851882.702006:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851882.702006:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.702007:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851882.702008:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851882.702009:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851882.702010:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10192@kfi7, seq: 2001954
00000100:00000040:7.0:1773851882.702010:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d86f309e : new rpc_count 2
00000100:00000001:4.0:1773851882.702010:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851882.702010:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851882.702011:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814086528 : -107101895465088 : ffff9e976590e780)
00000100:00000001:4.0:1773851882.702011:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851882.702012:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000be3da377 x1859598209353856/t0(0) o400->30dfd5f0-9936-49fc-a445-35fee1392e0a@10192@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1121-0'
00000100:00000001:4.0:1773851882.702012:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.702015:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851882.702015:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851882.702016:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be3da377 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:30dfd5f0-9936-49fc-a445-35fee1392e0a+6:39498:x1859598209353856:12345-10192@kfi7:400:default-tuolumne1121-0
00000100:00000200:7.0:1773851882.702018:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598209353856
00000020:00000001:7.0:1773851882.702018:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851882.702019:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851882.702020:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.702020:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851882.702021:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851882.702022:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851882.702022:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598209353856, found 0 last_xid 1859598207436927
00000020:00000001:7.0:1773851882.702023:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851882.702024:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851882.702024:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851882.702024:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.702025:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851882.702026:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851882.702026:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851882.702029:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2097652.
02000000:00000001:7.0:1773851882.702029:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.702030:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.702030:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851882.702031:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183247727060, transno 0, xid 1859598209353856
00010000:00000001:7.0:1773851882.702032:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851882.702032:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000be3da377 x1859598209353856/t0(0) o400->30dfd5f0-9936-49fc-a445-35fee1392e0a@10192@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1121-0'
00010000:00000001:7.0:1773851882.702035:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851882.702035:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851882.702036:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=114 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851882.702037:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851882.702038:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000c6a290a refcount 3 to 10192@kfi7
00000100:00000001:7.0:1773851882.702038:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857728 : -107149578693888 : ffff9e8c4b6c9300)
02000000:00000001:7.0:1773851882.702039:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851882.702039:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.702040:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851882.702042:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10193@kfi7
00000400:00000010:7.0:1773851882.702042:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e33961df.
00000100:00000200:7.0:1773851882.702043:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598209353856, offset 224
00000400:00000200:7.0:1773851882.702045:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10193@kfi7
00000400:00000200:7.0:1773851882.702045:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10193@kfi7 to cpt 1
00000400:00000200:7.0:1773851882.702046:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d409e81d nid 10193@kfi7 refs 1
00000400:00000200:7.0:1773851882.702047:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d409e81d nid 10193@kfi7 refs 2
00000400:00000200:7.0:1773851882.702048:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d409e81d nid 10193@kfi7 refs 3
00000400:00000200:7.0:1773851882.702049:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10193@kfi7 local destination
00000400:00000200:7.0:1773851882.702051:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769737:8769737:1024:4294967295] 10193@kfi7 LPNI seq info [3661985:3661985:16:4294967295]
00000400:00000200:7.0:1773851882.702052:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d409e81d nid 10193@kfi7 refs 2
00000400:00000200:7.0:1773851882.702053:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10193@kfi7 to cpt 1
00000400:00000200:7.0:1773851882.702054:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10193@kfi7(10193@kfi7:10193@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851882.702055:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d409e81d nid 10193@kfi7 refs 3
00000800:00000200:7.0:1773851882.702057:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851882.702058:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851882.702060:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851882.702062:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001a0 Using peer 10193@kfi7(0x1000000000001a0)
00000800:00000200:7.0:1773851882.702064:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x1000000000001a0: rc=0
00000800:00000200:7.0:1773851882.702066:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001a0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851882.702068:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851882.702068:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000c6a290a refcount 2 to 10192@kfi7
00010000:00000001:7.0:1773851882.702069:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851882.702070:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.702070:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851882.702071:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000be3da377 x1859598209353856/t0(0) o400->30dfd5f0-9936-49fc-a445-35fee1392e0a@10192@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1121-0'
00000100:00100000:7.0:1773851882.702077:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be3da377 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:30dfd5f0-9936-49fc-a445-35fee1392e0a+6:39498:x1859598209353856:12345-10192@kfi7:400:default-tuolumne1121-0 Request processed in 62us (89us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851882.702080:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10192@kfi7, seq: 2001954
00000100:00000040:7.0:1773851882.702081:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d86f309e : new rpc_count 1
00000800:00000200:6.0:1773851882.702081:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001a0 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851882.702082:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851882.702082:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:6.0:1773851882.702082:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851882.702083:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851882.702083:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000020:00000010:7.0:1773851882.702084:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000400:00000200:6.0:1773851882.702084:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10193@kfi7: PUT: OK
00000400:00000200:6.0:1773851882.702084:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e33961df
00000020:00000040:7.0:1773851882.702085:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000d86f309e : new refcount 5
00000400:00000010:6.0:1773851882.702085:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e33961df.
00000100:00000001:6.0:1773851882.702085:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851882.702086:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851882.702086:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851882.702087:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d409e81d nid 10193@kfi7 refs 2
00000800:00000200:6.0:1773851882.702089:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 10193@kfi7(00000000d1a6162e):0x0 lsk 417 rsk 4 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000001a0 Transaction freed
00000800:00000200:17.0:1773851882.754937:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.754938:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851882.754940:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851882.754942:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851882.754944:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18467@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.754945:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18467@kfi7 : PUT - for me
00000400:00000200:17.0:1773851882.754947:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18467@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.754947:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f04e9f30 nid 18467@kfi7 refs 1
00000400:00000200:17.0:1773851882.754949:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18467@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.754950:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f04e9f30 nid 18467@kfi7 refs 2
00000400:00000200:17.0:1773851882.754951:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f04e9f30 nid 18467@kfi7 refs 3
00000400:00000200:17.0:1773851882.754951:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18466@kfi7 to cpt 1
00000400:00000200:17.0:1773851882.754953:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18466@kfi7 of length 224 into portal 12 MB=0x699e0c1b38d80
00000400:00000200:17.0:1773851882.754954:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18466@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 33992
00000800:00000200:17.0:1773851882.754956:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851882.754958:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.754959:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18467@kfi7: PUT: OK
00000100:00000001:17.0:1773851882.754960:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851882.754960:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851882.754961:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001fd91b94.
00000100:00000040:17.0:1773851882.754962:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001fd91b94 x1858040461757824 msgsize 224
00000100:00100000:17.0:1773851882.754964:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18466@kfi7 (source: 12345-18467@kfi7)
00000100:00000001:17.0:1773851882.754965:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851882.754966:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f04e9f30 nid 18467@kfi7 refs 2
00000100:00000001:16.0:1773851882.754966:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851882.754967:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851882.754967:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851882.754968:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851882.754968:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851882.754969:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851882.754970:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040461757824
00000020:00000001:16.0:1773851882.754970:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851882.754971:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91aa3
00000020:00000001:16.0:1773851882.754971:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851882.754974:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ad8d3989 refcount=6
00000020:00000001:16.0:1773851882.754974:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627745792 : -107123081805824 : ffff9e9276c30000)
00000020:00000001:16.0:1773851882.754975:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627745792 : -107123081805824 : ffff9e9276c30000)
00000100:00000001:16.0:1773851882.754977:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851882.754977:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851882.754978:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dcd298eb.
00000020:00000010:16.0:1773851882.754979:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851882.754980:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004afc5e58.
00000100:00000001:16.0:1773851882.754981:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851882.754982:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851882.754982:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851882.754983:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851882.754984:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851882.754985:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.754986:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851882.754987:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851882.754987:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851882.754988:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851882.754988:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851882.754989:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851882.754989:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18466@kfi7, seq: 2156386
00000100:00000040:16.0:1773851882.754989:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ad8d3989 : new rpc_count 1
00000100:00000001:17.0:1773851882.754990:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.754990:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102213120 : -107041607338496 : ffff9ea56f04b600)
00000100:00000040:16.0:1773851882.754992:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001fd91b94 x1858040461757824/t0(0) o400->b8e3b530-2a64-4e74-bb9c-b129cc3847c0@18466@kfi7:103/0 lens 224/0 e 0 to 0 dl 1773852218 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1643-0'
00000100:00000001:16.0:1773851882.754995:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851882.754995:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851882.754996:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fd91b94 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:b8e3b530-2a64-4e74-bb9c-b129cc3847c0+6:39727:x1858040461757824:12345-18466@kfi7:400:default-tuolumne1643-0
00000100:00000200:16.0:1773851882.754997:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040461757824
00000020:00000001:16.0:1773851882.754998:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851882.754999:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851882.754999:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.755000:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851882.755001:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851882.755001:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851882.755002:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040461757824, found 0 last_xid 1858040461757823
00000020:00000001:16.0:1773851882.755003:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851882.755004:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851882.755004:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851882.755005:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.755005:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851882.755006:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851882.755007:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851882.755008:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000be5af505.
02000000:00000001:16.0:1773851882.755008:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.755009:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.755010:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851882.755010:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254106985, transno 0, xid 1858040461757824
00010000:00000001:16.0:1773851882.755011:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851882.755012:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001fd91b94 x1858040461757824/t0(0) o400->b8e3b530-2a64-4e74-bb9c-b129cc3847c0@18466@kfi7:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1643-0'
00010000:00000001:16.0:1773851882.755014:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851882.755015:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851882.755016:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=115 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851882.755017:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851882.755018:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000570f7849 refcount 3 to 18466@kfi7
00000100:00000001:16.0:1773851882.755018:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704224 : -107156155847392 : ffff9e8ac3652d20)
02000000:00000001:16.0:1773851882.755019:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851882.755020:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.755021:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851882.755021:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18467@kfi7
00000400:00000010:16.0:1773851882.755022:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002def1aea.
00000100:00000200:16.0:1773851882.755023:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040461757824, offset 224
00000400:00000200:16.0:1773851882.755024:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18467@kfi7
00000400:00000200:16.0:1773851882.755025:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18467@kfi7 to cpt 4
00000400:00000200:16.0:1773851882.755026:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f04e9f30 nid 18467@kfi7 refs 1
00000400:00000200:16.0:1773851882.755027:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f04e9f30 nid 18467@kfi7 refs 2
00000400:00000200:16.0:1773851882.755028:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f04e9f30 nid 18467@kfi7 refs 3
00000400:00000200:16.0:1773851882.755029:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18467@kfi7 local destination
00000400:00000200:16.0:1773851882.755030:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769738:8769738:1024:4294967295] 18467@kfi7 LPNI seq info [1143714:1143714:16:4294967295]
00000400:00000200:16.0:1773851882.755032:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f04e9f30 nid 18467@kfi7 refs 2
00000400:00000200:16.0:1773851882.755033:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18467@kfi7 to cpt 4
00000400:00000200:16.0:1773851882.755035:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18467@kfi7(18467@kfi7:18467@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851882.755036:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f04e9f30 nid 18467@kfi7 refs 3
00000800:00000200:16.0:1773851882.755037:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851882.755038:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851882.755041:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851882.755043:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x563 Using peer 18467@kfi7(0x563)
00000800:00000200:16.0:1773851882.755046:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x563: rc=0
00000800:00000200:16.0:1773851882.755048:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x563 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851882.755050:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851882.755050:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000570f7849 refcount 2 to 18466@kfi7
00010000:00000001:16.0:1773851882.755052:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851882.755052:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851882.755053:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851882.755055:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001fd91b94 x1858040461757824/t0(0) o400->b8e3b530-2a64-4e74-bb9c-b129cc3847c0@18466@kfi7:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1643-0'
00000100:00100000:16.0:1773851882.755058:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fd91b94 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:b8e3b530-2a64-4e74-bb9c-b129cc3847c0+6:39727:x1858040461757824:12345-18466@kfi7:400:default-tuolumne1643-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851882.755061:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18466@kfi7, seq: 2156386
00000100:00000040:16.0:1773851882.755061:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ad8d3989 : new rpc_count 0
00000100:00000001:16.0:1773851882.755062:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851882.755063:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851882.755063:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851882.755064:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004afc5e58.
00000020:00000010:16.0:1773851882.755065:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dcd298eb.
00000020:00000040:16.0:1773851882.755065:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000ad8d3989 : new refcount 5
00000100:00000001:16.0:1773851882.755066:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851882.755071:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x563 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851882.755072:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.755074:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18467@kfi7: PUT: OK
00000400:00000200:17.0:1773851882.755074:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002def1aea
00000400:00000010:17.0:1773851882.755075:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002def1aea.
00000100:00000001:17.0:1773851882.755076:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851882.755076:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851882.755077:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f04e9f30 nid 18467@kfi7 refs 2
00000800:00000200:17.0:1773851882.755079:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18467@kfi7(00000000f0566087):0x0 lsk 1380 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x563 Transaction freed
00000800:00000200:21.0:1773851882.778280:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851882.778280:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851882.778282:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851882.778284:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851882.778285:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23219@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.778286:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23219@kfi7 : PUT - for me
00000400:00000200:21.0:1773851882.778287:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23219@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.778289:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040eba151 nid 23219@kfi7 refs 1
00000400:00000200:21.0:1773851882.778290:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23219@kfi7 to cpt 5
00000400:00000200:21.0:1773851882.778291:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040eba151 nid 23219@kfi7 refs 2
00000400:00000200:21.0:1773851882.778292:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000040eba151 nid 23219@kfi7 refs 3
00000400:00000200:21.0:1773851882.778293:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23155@kfi7 to cpt 1
00000400:00000200:21.0:1773851882.778294:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23155@kfi7 of length 224 into portal 12 MB=0x69b7c9c2c9240
00000400:00000200:21.0:1773851882.778295:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23155@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 51472
00000800:00000200:21.0:1773851882.778297:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851882.778298:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851882.778299:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23219@kfi7: PUT: OK
00000100:00000001:21.0:1773851882.778300:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851882.778301:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851882.778301:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006d070ab8.
00000100:00000040:21.0:1773851882.778302:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006d070ab8 x1859809358680640 msgsize 224
00000100:00100000:21.0:1773851882.778303:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23155@kfi7 (source: 12345-23219@kfi7)
00000100:00000001:21.0:1773851882.778304:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851882.778305:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000040eba151 nid 23219@kfi7 refs 2
00000100:00000001:20.0:1773851882.778306:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851882.778306:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851882.778307:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851882.778307:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851882.778307:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851882.778308:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851882.778309:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859809358680640
00000020:00000001:20.0:1773851882.778310:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851882.778310:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f085d7af2524
00000020:00000001:20.0:1773851882.778311:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851882.778314:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000857d6f9b refcount=5
00000020:00000001:20.0:1773851882.778315:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138206825472 : -106935502726144 : ffff9ebe23589c00)
00000020:00000001:20.0:1773851882.778316:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138206825472 : -106935502726144 : ffff9ebe23589c00)
00000100:00000001:20.0:1773851882.778317:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851882.778318:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851882.778319:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851882.778319:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851882.778320:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851882.778321:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851882.778321:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851882.778322:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851882.778323:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851882.778323:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851882.778324:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.778325:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851882.778326:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851882.778326:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851882.778326:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851882.778327:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851882.778327:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23155@kfi7, seq: 1998028
00000100:00000001:23.0:1773851882.778328:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851882.778328:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000857d6f9b : new rpc_count 1
00000100:00000001:23.0:1773851882.778329:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.778329:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956249984 : -106937753301632 : ffff9ebd9d338d80)
00000100:00000040:20.0:1773851882.778330:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006d070ab8 x1859809358680640/t0(0) o400->59bae583-a57d-4c74-8c96-7b345cd5fd2f@23155@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1930-0'
00000100:00000001:20.0:1773851882.778332:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851882.778333:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851882.778334:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006d070ab8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:59bae583-a57d-4c74-8c96-7b345cd5fd2f+5:39611:x1859809358680640:12345-23155@kfi7:400:default-tuolumne1930-0
00000100:00000200:20.0:1773851882.778335:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859809358680640
00000020:00000001:20.0:1773851882.778336:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851882.778336:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851882.778337:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.778338:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851882.778338:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851882.778339:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851882.778340:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859809358680640, found 0 last_xid 1859809358680639
00000020:00000001:20.0:1773851882.778340:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851882.778341:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851882.778341:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851882.778342:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.778342:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851882.778343:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851882.778343:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851882.778345:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007faa02a7.
02000000:00000001:20.0:1773851882.778346:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.778346:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.778347:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851882.778347:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182172107912, transno 0, xid 1859809358680640
00010000:00000001:20.0:1773851882.778348:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851882.778349:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006d070ab8 x1859809358680640/t0(0) o400->59bae583-a57d-4c74-8c96-7b345cd5fd2f@23155@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1930-0'
00010000:00000001:20.0:1773851882.778351:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851882.778352:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851882.778352:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=115 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851882.778353:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851882.778354:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000059470a81 refcount 3 to 23155@kfi7
00000100:00000001:20.0:1773851882.778355:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231613088 : -107130477938528 : ffff9e90bdeaf8a0)
02000000:00000001:20.0:1773851882.778356:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851882.778356:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851882.778357:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851882.778357:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23219@kfi7
00000400:00000010:20.0:1773851882.778358:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000056b73a04.
00000100:00000200:20.0:1773851882.778358:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859809358680640, offset 224
00000400:00000200:20.0:1773851882.778360:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23219@kfi7
00000400:00000200:20.0:1773851882.778360:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23219@kfi7 to cpt 5
00000400:00000200:20.0:1773851882.778361:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000040eba151 nid 23219@kfi7 refs 1
00000400:00000200:20.0:1773851882.778363:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000040eba151 nid 23219@kfi7 refs 2
00000400:00000200:20.0:1773851882.778364:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000040eba151 nid 23219@kfi7 refs 3
00000400:00000200:20.0:1773851882.778365:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23219@kfi7 local destination
00000400:00000200:20.0:1773851882.778366:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769739:8769739:1024:4294967295] 23219@kfi7 LPNI seq info [18203:18203:16:4294967295]
00000400:00000200:20.0:1773851882.778367:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000040eba151 nid 23219@kfi7 refs 2
00000400:00000200:20.0:1773851882.778368:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23219@kfi7 to cpt 5
00000400:00000200:20.0:1773851882.778370:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23219@kfi7(23219@kfi7:23219@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851882.778371:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000040eba151 nid 23219@kfi7 refs 3
00000800:00000200:20.0:1773851882.778372:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851882.778374:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851882.778376:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851882.778378:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f99 Using peer 23219@kfi7(0x100000000000f99)
00000800:00000200:20.0:1773851882.778381:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x100000000000f99: rc=0
00000800:00000200:20.0:1773851882.778382:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f99 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851882.778384:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851882.778385:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000059470a81 refcount 2 to 23155@kfi7
00010000:00000001:20.0:1773851882.778386:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851882.778386:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851882.778387:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851882.778387:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006d070ab8 x1859809358680640/t0(0) o400->59bae583-a57d-4c74-8c96-7b345cd5fd2f@23155@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1930-0'
00000100:00100000:20.0:1773851882.778391:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006d070ab8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:59bae583-a57d-4c74-8c96-7b345cd5fd2f+5:39611:x1859809358680640:12345-23155@kfi7:400:default-tuolumne1930-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851882.778393:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23155@kfi7, seq: 1998028
00000100:00000040:20.0:1773851882.778394:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000857d6f9b : new rpc_count 0
00000100:00000001:20.0:1773851882.778395:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851882.778395:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851882.778396:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851882.778397:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851882.778398:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851882.778398:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000857d6f9b : new refcount 4
00000100:00000001:20.0:1773851882.778399:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851882.778403:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f99 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851882.778405:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851882.778406:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23219@kfi7: PUT: OK
00000400:00000200:21.0:1773851882.778406:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000056b73a04
00000400:00000010:21.0:1773851882.778407:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000056b73a04.
00000100:00000001:21.0:1773851882.778407:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851882.778408:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851882.778409:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000040eba151 nid 23219@kfi7 refs 2
00000800:00000200:21.0:1773851882.778410:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 23219@kfi7(00000000f37bfb2a):0x0 lsk 3994 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000f99 Transaction freed
00000004:00000001:10.0:1773851882.825730:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851882.825731:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851882.825731:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851882.825731:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851882.825732:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d4a564a2.
00000100:00000010:10.0:1773851882.825732:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000089acaf6f.
00000020:00000040:11.0:1773851882.825733:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000020:00000040:10.0:1773851882.825733:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000001:11.0:1773851882.825734:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851882.825735:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851882.825735:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851882.825736:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851882.825736:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:11.0:1773851882.825737:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000073bbffc.
02000000:00000001:10.0:1773851882.825737:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825738:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825739:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:10.0:1773851882.825739:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b4289b24.
00000100:00000001:11.0:1773851882.825740:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851882.825740:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851882.825741:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d4a564a2] to pc [ptlrpcd_02_03+3]  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851882.825742:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851882.825743:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851882.825745:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851882.825745:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000089acaf6f] to pc [ptlrpcd_02_00+0]  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825746:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851882.825747:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851882.825747:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825747:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851882.825747:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:8.0:1773851882.825748:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825751:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851882.825751:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851882.825752:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851882.825752:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:11.0:1773851882.825753:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851882.825753:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:8.0:1773851882.825753:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851882.825753:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4a564a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051934336:42@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851882.825754:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851882.825754:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851882.825754:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851882.825755:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825755:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851882.825755:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851882.825756:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851882.825756:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:11.0:1773851882.825757:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000010:8.0:1773851882.825757:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000023401374.
00000100:00000001:11.0:1773851882.825758:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851882.825758:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851882.825758:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851882.825759:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851882.825759:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:8.0:1773851882.825759:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00100000:11.0:1773851882.825760:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000089acaf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051934400:12@kfi7:13:default-yuba2-0
00000400:00000010:8.0:1773851882.825760:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054a4b090.
00000100:00000001:11.0:1773851882.825761:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:11.0:1773851882.825761:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000200:8.0:1773851882.825761:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934336, portal 4
02000000:00000001:11.0:1773851882.825762:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825762:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:11.0:1773851882.825763:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:8.0:1773851882.825763:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446613376 : -106937262938240 : ffff9ebdba6de780)
02000000:00000010:11.0:1773851882.825764:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b21c4693.
02000000:00000001:11.0:1773851882.825764:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851882.825764:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851882.825765:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:11.0:1773851882.825766:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000100:00000001:8.0:1773851882.825766:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:11.0:1773851882.825767:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009d07bcea.
00000100:00000200:11.0:1773851882.825767:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934400, portal 4
00000100:00000040:8.0:1773851882.825767:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:8.0:1773851882.825767:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
00000100:00000001:11.0:1773851882.825768:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851882.825768:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087749504 : -106944621802112 : ffff9ebc03ce8d80)
00000100:00000200:8.0:1773851882.825768:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934336, offset 0
00000100:00000040:11.0:1773851882.825769:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851882.825769:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:8.0:1773851882.825770:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851882.825771:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000100:00000001:11.0:1773851882.825772:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851882.825772:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000040:11.0:1773851882.825773:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:11.0:1773851882.825773:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000fb1e983.
00000100:00000200:11.0:1773851882.825774:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934400, offset 0
00000400:00000200:8.0:1773851882.825774:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:11.0:1773851882.825775:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:8.0:1773851882.825775:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:8.0:1773851882.825777:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769738, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769739, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851882.825779:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851882.825780:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851882.825780:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:8.0:1773851882.825781:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769740:8769740:1024:4294967295] 42@kfi7 LPNI seq info [5404901:5404901:16:4294967295]
00000400:00000200:8.0:1773851882.825783:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:8.0:1773851882.825783:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:11.0:1773851882.825784:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:11.0:1773851882.825785:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:11.0:1773851882.825785:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:11.0:1773851882.825786:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:8.0:1773851882.825786:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851882.825787:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000400:00000200:8.0:1773851882.825787:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:11.0:1773851882.825789:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769740, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769739, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851882.825789:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851882.825790:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851882.825791:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:11.0:1773851882.825791:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851882.825792:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000800:00000200:8.0:1773851882.825792:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851882.825793:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769741:8769741:1024:4294967295] 12@kfi7 LPNI seq info [5403460:5403460:16:4294967295]
00000400:00000200:11.0:1773851882.825794:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:11.0:1773851882.825795:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:8.0:1773851882.825795:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000400:00000200:11.0:1773851882.825797:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851882.825797:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x17b: rc=0
00000400:00000200:11.0:1773851882.825799:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:8.0:1773851882.825799:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:11.0:1773851882.825800:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851882.825801:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851882.825801:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825801:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851882.825802:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851882.825803:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851882.825803:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825803:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851882.825804:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851882.825805:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:11.0:1773851882.825806:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Using peer 12@kfi7(0x200000000000473)
00000100:00000001:8.0:1773851882.825806:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851882.825806:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:11.0:1773851882.825808:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x200000000000473: rc=0
00000800:00000200:11.0:1773851882.825810:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851882.825811:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825811:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825811:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825812:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:9.0:1773851882.825812:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851882.825813:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851882.825813:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851882.825814:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825815:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851882.825815:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:9.0:1773851882.825815:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:9.0:1773851882.825815:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000100:00000001:11.0:1773851882.825816:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:11.0:1773851882.825816:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:9.0:1773851882.825816:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000100:00000001:11.0:1773851882.825817:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851882.825817:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.825817:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:11.0:1773851882.825818:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851882.825818:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851882.825820:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851882.825821:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851882.825824:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851882.825824:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851882.825824:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851882.825825:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851882.825825:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:11.0:1773851882.825827:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000800:00000200:9.0:1773851882.825827:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000400:00000200:11.0:1773851882.825828:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000fb1e983
00000400:00000010:11.0:1773851882.825828:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000fb1e983.
00000100:00000001:11.0:1773851882.825829:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:11.0:1773851882.825829:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851882.825832:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851882.825833:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851882.825835:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825836:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851882.825837:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:11.0:1773851882.825839:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Transaction freed
00000800:00000200:26.0:1773851882.825850:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851882.825850:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851882.825852:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851882.825854:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851882.825856:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:26.0:1773851882.825857:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000800:00000200:9.0:1773851882.825857:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:26.0:1773851882.825858:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000800:00000200:9.0:1773851882.825858:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:26.0:1773851882.825859:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000800:00000200:9.0:1773851882.825859:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851882.825860:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:26.0:1773851882.825861:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:9.0:1773851882.825861:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851882.825862:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:26.0:1773851882.825863:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851882.825863:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:26.0:1773851882.825864:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4e80
00000400:00000200:26.0:1773851882.825865:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851882.825865:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:9.0:1773851882.825866:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:26.0:1773851882.825867:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b82b19 [1] + 224
00000400:00000200:9.0:1773851882.825867:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851882.825868:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851882.825868:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:26.0:1773851882.825870:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851882.825870:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:26.0:1773851882.825871:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851882.825871:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851882.825872:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4ec0
00000400:00000200:26.0:1773851882.825873:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:9.0:1773851882.825873:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000001:26.0:1773851882.825874:0:2507427:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851882.825874:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x7816982c9 [1] + 224
00000100:00000200:26.0:1773851882.825876:0:2507427:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851882.825876:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851882.825877:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851882.825878:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000100:00000040:26.0:1773851882.825879:0:2507427:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851882.825879:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851882.825880:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851882.825883:0:2507427:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:9.0:1773851882.825883:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:26.0:1773851882.825884:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:26.0:1773851882.825885:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851882.825885:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851882.825885:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851882.825886:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:8.0:1773851882.825886:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851882.825886:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:11.0:1773851882.825887:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851882.825887:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000010:8.0:1773851882.825887:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000100:00000001:11.0:1773851882.825888:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:11.0:1773851882.825888:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851882.825888:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:8.0:1773851882.825888:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054a4b090
00000400:00000010:8.0:1773851882.825888:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054a4b090.
00000400:00000010:11.0:1773851882.825889:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000200:11.0:1773851882.825889:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009d07bcea
00000800:00000200:9.0:1773851882.825889:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851882.825889:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:11.0:1773851882.825890:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009d07bcea.
00000100:00000001:11.0:1773851882.825890:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851882.825890:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:11.0:1773851882.825891:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851882.825892:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825894:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851882.825895:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851882.825895:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851882.825896:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851882.825896:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:11.0:1773851882.825897:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825897:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851882.825898:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825899:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851882.825899:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:8.0:1773851882.825899:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=115 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851882.825899:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=115 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851882.825900:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851882.825900:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851882.825900:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851882.825901:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851882.825901:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825901:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851882.825901:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:11.0:1773851882.825902:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851882.825902:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851882.825903:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=115 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851882.825903:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851882.825903:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00001000:11.0:1773851882.825904:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=115 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851882.825904:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851882.825904:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825905:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851882.825905:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851882.825905:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:11.0:1773851882.825906:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:11.0:1773851882.825906:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825907:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851882.825907:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:8.0:1773851882.825907:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851882.825908:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851882.825908:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825908:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851882.825908:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:11.0:1773851882.825909:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:8.0:1773851882.825909:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851882.825910:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000100:00000001:11.0:1773851882.825911:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:8.0:1773851882.825911:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351379000320 avail=351376073728 avail_mb=1372562788 hwm_mb=3131103 files=372019023 ffree=343143555 state=0: rc = 0
00000100:00000001:11.0:1773851882.825912:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000020:8.0:1773851882.825912:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351379000320 free, 351376073728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019023 files, 343143555 free files
00000100:00000001:11.0:1773851882.825913:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851882.825913:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:11.0:1773851882.825914:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:11.0:1773851882.825914:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541508096 avail=351539533824 avail_mb=1373201304 hwm_mb=3131101 files=372136587 ffree=343302254 state=0: rc = 0
00000004:00000001:8.0:1773851882.825914:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851882.825915:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:11.0:1773851882.825916:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541508096 free, 351539533824 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136587 files, 343302254 free files
00000100:00100000:8.0:1773851882.825917:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4a564a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051934336:42@kfi7:13:default-yuba2-0
00000004:00000001:11.0:1773851882.825918:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851882.825918:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825918:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851882.825919:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851882.825920:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d4a564a2 x1859433051934336/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825922:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851882.825922:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851882.825923:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000023401374.
00000100:00100000:11.0:1773851882.825924:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000089acaf6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051934400:12@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851882.825924:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851882.825924:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851882.825925:0:41071:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:8.0:1773851882.825925:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:11.0:1773851882.825926:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:8.0:1773851882.825926:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000073bbffc.
00000100:00000001:11.0:1773851882.825927:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:8.0:1773851882.825927:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851882.825927:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851882.825927:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4a564a2.
00000100:00000040:11.0:1773851882.825928:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000089acaf6f x1859433051934400/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852035 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851882.825928:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851882.825929:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851882.825929:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851882.825930:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851882.825930:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851882.825930:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851882.825931:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825933:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851882.825934:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:11.0:1773851882.825934:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b21c4693.
02000000:00000001:11.0:1773851882.825936:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851882.825936:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851882.825937:0:41068:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:11.0:1773851882.825938:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851882.825939:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b4289b24.
02000000:00000001:11.0:1773851882.825940:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851882.825940:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851882.825941:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000089acaf6f.
00000100:00000001:11.0:1773851882.825942:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851882.825943:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851882.825944:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851882.825945:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851882.825946:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851882.825947:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851882.825948:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851882.867601:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.867602:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851882.867603:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851882.867605:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851882.867607:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.867608:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.27@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851882.867609:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.867610:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851882.867611:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.27@o2ib60 to cpt 4
00000400:00000200:17.0:1773851882.867612:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4751f3d nid 192.168.128.27@o2ib60 refs 2
00000400:00000200:17.0:1773851882.867613:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f4751f3d nid 192.168.128.27@o2ib60 refs 3
00000400:00000200:17.0:1773851882.867614:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.27@o2ib60 to cpt 4
00000400:00000200:17.0:1773851882.867615:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.27@o2ib60 of length 224 into portal 12 MB=0x69b22d46e8380
00000400:00000200:17.0:1773851882.867616:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.27@o2ib60 of length 224/224 into md 0x6ab01b5d1 [64] + 34216
00000800:00000200:17.0:1773851882.867618:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851882.867620:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851882.867621:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851882.867622:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851882.867622:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851882.867623:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000089eeec88.
00000100:00000040:17.0:1773851882.867624:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000089eeec88 x1859423755469696 msgsize 224
00000100:00100000:17.0:1773851882.867626:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.27@o2ib60 (source: 12345-192.168.128.27@o2ib60)
00000100:00000001:17.0:1773851882.867627:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851882.867628:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851882.867629:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851882.867630:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851882.867630:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851882.867631:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851882.867632:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851882.867633:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851882.867634:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859423755469696
00000020:00000001:16.0:1773851882.867635:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851882.867636:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2cee5a
00000020:00000001:16.0:1773851882.867637:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851882.867641:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f2a8d5cb refcount=5
00000020:00000001:16.0:1773851882.867642:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056052841472 : -107017656710144 : ffff9eab02964c00)
00000020:00000001:16.0:1773851882.867643:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056052841472 : -107017656710144 : ffff9eab02964c00)
00000100:00000001:16.0:1773851882.867645:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851882.867646:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851882.867647:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851882.867648:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851882.867650:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004afc5e58.
00000100:00000001:16.0:1773851882.867652:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851882.867653:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851882.867654:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851882.867655:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851882.867656:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851882.867656:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851882.867658:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851882.867659:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851882.867660:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851882.867660:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851882.867660:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851882.867661:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.27@o2ib60, seq: 2156387
00000100:00000040:17.0:1773851882.867662:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f2a8d5cb : new rpc_count 1
00000100:00000001:16.0:1773851882.867662:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.867663:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102217728 : -107041607333888 : ffff9ea56f04c800)
00000100:00000001:16.0:1773851882.867663:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851882.867664:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000089eeec88 x1859423755469696/t0(0) o400->55d2ea89-f8fc-44e5-83b8-e7e018afa7f7@192.168.128.27@o2ib60:103/0 lens 224/0 e 0 to 0 dl 1773852218 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix27-0'
00000100:00000001:17.0:1773851882.867667:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851882.867667:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851882.867668:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089eeec88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:55d2ea89-f8fc-44e5-83b8-e7e018afa7f7+5:40175:x1859423755469696:12345-192.168.128.27@o2ib60:400:default-matrix27-0
00000100:00000200:17.0:1773851882.867670:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859423755469696
00000020:00000001:17.0:1773851882.867670:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851882.867671:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851882.867672:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.867672:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851882.867673:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851882.867674:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851882.867674:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859423755469696, found 0 last_xid 1859423755469695
00000020:00000001:17.0:1773851882.867675:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851882.867675:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851882.867676:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851882.867677:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.867678:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851882.867678:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851882.867679:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851882.867680:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006ccd42b1.
02000000:00000001:17.0:1773851882.867680:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.867681:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.867682:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851882.867682:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181430514258, transno 0, xid 1859423755469696
00010000:00000001:17.0:1773851882.867683:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851882.867684:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000089eeec88 x1859423755469696/t0(0) o400->55d2ea89-f8fc-44e5-83b8-e7e018afa7f7@192.168.128.27@o2ib60:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix27-0'
00010000:00000001:17.0:1773851882.867686:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851882.867687:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851882.867688:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=115 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851882.867689:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851882.867689:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000047bddf9 refcount 3 to 192.168.128.27@o2ib60
00000100:00000001:17.0:1773851882.867690:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924290914944 : -107149418636672 : ffff9e8c54f6da80)
02000000:00000001:17.0:1773851882.867691:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851882.867691:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851882.867692:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851882.867693:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.27@o2ib60
00000400:00000010:17.0:1773851882.867694:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008cb88761.
00000100:00000200:17.0:1773851882.867695:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859423755469696, offset 224
00000400:00000200:17.0:1773851882.867696:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.27@o2ib60
00000400:00000200:17.0:1773851882.867697:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.27@o2ib60 to cpt 4
00000400:00000200:17.0:1773851882.867698:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4751f3d nid 192.168.128.27@o2ib60 refs 2
00000400:00000200:17.0:1773851882.867699:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f4751f3d nid 192.168.128.27@o2ib60 refs 3
00000400:00000200:17.0:1773851882.867701:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f4751f3d nid 192.168.128.27@o2ib60 refs 4
00000400:00000200:17.0:1773851882.867702:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.27@o2ib60 routed destination
00000400:00000200:17.0:1773851882.867703:0:60961:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:17.0:1773851882.867704:0:60961:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:17.0:1773851882.867705:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.27@o2ib60: rtr pref emtpy: 1
00000400:00000200:17.0:1773851882.867706:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:17.0:1773851882.867707:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.27@o2ib60: rtr pref emtpy: 1
00000400:00000200:17.0:1773851882.867708:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:17.0:1773851882.867709:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769742:8769742:1024:4294967295] 2094@kfi7 LPNI seq info [1258747014:1258747014:16:4294967295]
00000400:00000200:17.0:1773851882.867710:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851882.867711:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851882.867713:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.27@o2ib60(192.168.128.27@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851882.867715:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f4751f3d nid 192.168.128.27@o2ib60 refs 3
00000800:00000200:17.0:1773851882.867716:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851882.867717:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851882.867719:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851882.867721:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:17.0:1773851882.867724:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:17.0:1773851882.867730:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851882.867732:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851882.867733:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000047bddf9 refcount 2 to 192.168.128.27@o2ib60
00010000:00000001:17.0:1773851882.867734:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851882.867734:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851882.867735:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851882.867735:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000089eeec88 x1859423755469696/t0(0) o400->55d2ea89-f8fc-44e5-83b8-e7e018afa7f7@192.168.128.27@o2ib60:103/0 lens 224/224 e 0 to 0 dl 1773852218 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix27-0'
00000800:00000200:19.0:1773851882.867738:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:19.0:1773851882.867739:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:17.0:1773851882.867739:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089eeec88 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:55d2ea89-f8fc-44e5-83b8-e7e018afa7f7+5:40175:x1859423755469696:12345-192.168.128.27@o2ib60:400:default-matrix27-0 Request processed in 71us (113us total) trans 0 rc 0/0
00000400:00000200:19.0:1773851882.867740:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:19.0:1773851882.867741:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008cb88761
00000400:00000010:19.0:1773851882.867741:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008cb88761.
00000100:00100000:17.0:1773851882.867741:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.27@o2ib60, seq: 2156387
00000100:00000001:19.0:1773851882.867742:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851882.867742:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:17.0:1773851882.867742:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f2a8d5cb : new rpc_count 0
00000400:00000200:19.0:1773851882.867743:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:17.0:1773851882.867743:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:19.0:1773851882.867744:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000100:00000001:17.0:1773851882.867744:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851882.867744:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:17.0:1773851882.867745:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004afc5e58.
00000020:00000010:17.0:1773851882.867746:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:17.0:1773851882.867747:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000f2a8d5cb : new refcount 4
00000100:00000001:17.0:1773851882.867747:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851882.889375:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851882.889375:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851882.889376:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851882.889376:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851882.889377:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851882.889378:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851882.889379:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16512@kfi7(000000008d54e809):0x813 version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851882.889381:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 Using peer 16512@kfi7(0x100000000000813)
00000800:00000200:25.0:1773851882.889382:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851882.889383:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16512@kfi7 to cpt 6
00000800:00000200:26.0:1773851882.889385:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 38 bytes to peer 0x100000000000813: rc=0
00000400:00000200:25.0:1773851882.889385:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16512@kfi7 to cpt 6
00000800:00000200:26.0:1773851882.889386:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:25.0:1773851882.889387:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16512@kfi7 : PUT - for me
00000400:00000200:25.0:1773851882.889388:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16512@kfi7 to cpt 6
00000400:00000200:25.0:1773851882.889390:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003df93de2 nid 16512@kfi7 refs 1
00000400:00000200:25.0:1773851882.889392:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16512@kfi7 to cpt 6
00000400:00000200:25.0:1773851882.889393:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003df93de2 nid 16512@kfi7 refs 2
00000400:00000200:25.0:1773851882.889394:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003df93de2 nid 16512@kfi7 refs 3
00000400:00000200:25.0:1773851882.889396:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16513@kfi7 to cpt 1
00000400:00000200:25.0:1773851882.889397:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16513@kfi7 of length 224 into portal 12 MB=0x69b4bac13b740
00000800:00000200:26.0:1773851882.889398:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851882.889399:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16513@kfi7 of length 224/224 into md 0x16159c9699 [64] + 28384
00000800:00000200:26.0:1773851882.889400:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 Transaction freed
00000800:00000200:25.0:1773851882.889402:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851882.889405:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851882.889407:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16512@kfi7: PUT: OK
00000100:00000001:25.0:1773851882.889408:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851882.889409:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851882.889410:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b50e361d.
00000100:00000040:25.0:1773851882.889411:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b50e361d x1859599172089664 msgsize 224
00000100:00100000:25.0:1773851882.889414:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16513@kfi7 (source: 12345-16512@kfi7)
00000100:00000001:25.0:1773851882.889415:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851882.889417:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003df93de2 nid 16512@kfi7 refs 2
00000100:00000001:27.0:1773851882.889418:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851882.889419:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851882.889419:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851882.889420:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851882.889421:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851882.889422:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851882.889423:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599172089664
00000020:00000001:27.0:1773851882.889424:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851882.889425:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3892ed30
00000020:00000001:27.0:1773851882.889426:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851882.889428:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002ffc2e6a refcount=5
00000020:00000001:27.0:1773851882.889430:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637115937610752 : -106957771940864 : ffff9eb8f3ff5c00)
00000020:00000001:27.0:1773851882.889432:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637115937610752 : -106957771940864 : ffff9eb8f3ff5c00)
00000100:00000001:27.0:1773851882.889433:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851882.889434:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851882.889436:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000052694ebb.
00000020:00000010:27.0:1773851882.889437:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851882.889439:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000055d80f68.
00000100:00000001:27.0:1773851882.889440:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851882.889441:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851882.889441:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851882.889443:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851882.889444:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851882.889444:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851882.889446:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851882.889448:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851882.889448:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851882.889448:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851882.889449:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851882.889449:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16513@kfi7, seq: 2025148
00000100:00000001:27.0:1773851882.889450:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851882.889450:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002ffc2e6a : new rpc_count 1
00000100:00000001:27.0:1773851882.889451:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851882.889451:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252452352 : -106967457099264 : ffff9eb6b2b79200)
00000100:00000040:26.0:1773851882.889452:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b50e361d x1859599172089664/t0(0) o400->d516967d-4dad-42e0-a4a9-25b4832db2f2@16513@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1524-0'
00000100:00000001:26.0:1773851882.889455:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851882.889456:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851882.889457:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b50e361d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d516967d-4dad-42e0-a4a9-25b4832db2f2+5:39566:x1859599172089664:12345-16513@kfi7:400:default-tuolumne1524-0
00000100:00000200:26.0:1773851882.889458:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599172089664
00000020:00000001:26.0:1773851882.889459:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851882.889459:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851882.889460:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851882.889461:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851882.889462:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851882.889463:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851882.889463:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599172089664, found 0 last_xid 1859599172089663
00000020:00000001:26.0:1773851882.889464:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851882.889465:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851882.889465:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851882.889466:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851882.889466:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851882.889467:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851882.889468:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851882.889469:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000305b1095.
02000000:00000001:26.0:1773851882.889469:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851882.889470:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851882.889471:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851882.889471:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597376, transno 0, xid 1859599172089664
00010000:00000001:26.0:1773851882.889472:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851882.889473:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b50e361d x1859599172089664/t0(0) o400->d516967d-4dad-42e0-a4a9-25b4832db2f2@16513@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1524-0'
00010000:00000001:26.0:1773851882.889476:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851882.889476:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851882.889478:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=115 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851882.889479:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851882.889479:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002a27bb83 refcount 3 to 16513@kfi7
00000100:00000001:26.0:1773851882.889480:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232979904 : -107130476571712 : ffff9e90bdffd3c0)
02000000:00000001:26.0:1773851882.889482:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851882.889482:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851882.889483:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851882.889484:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16512@kfi7
00000400:00000010:26.0:1773851882.889485:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e24181d3.
00000100:00000200:26.0:1773851882.889486:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599172089664, offset 224
00000400:00000200:26.0:1773851882.889487:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16512@kfi7
00000400:00000200:26.0:1773851882.889488:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16512@kfi7 to cpt 6
00000400:00000200:26.0:1773851882.889489:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003df93de2 nid 16512@kfi7 refs 1
00000400:00000200:26.0:1773851882.889490:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003df93de2 nid 16512@kfi7 refs 2
00000400:00000200:26.0:1773851882.889491:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003df93de2 nid 16512@kfi7 refs 3
00000400:00000200:26.0:1773851882.889493:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16512@kfi7 local destination
00000400:00000200:26.0:1773851882.889494:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769743:8769743:1024:4294967295] 16512@kfi7 LPNI seq info [11032113:11032113:16:4294967295]
00000400:00000200:26.0:1773851882.889496:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003df93de2 nid 16512@kfi7 refs 2
00000400:00000200:26.0:1773851882.889497:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16512@kfi7 to cpt 6
00000400:00000200:26.0:1773851882.889500:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16512@kfi7(16512@kfi7:16512@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851882.889501:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003df93de2 nid 16512@kfi7 refs 3
00000800:00000200:26.0:1773851882.889502:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851882.889503:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851882.889506:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851882.889508:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 Using peer 16512@kfi7(0x100000000000813)
00000800:00000200:26.0:1773851882.889510:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x100000000000813: rc=0
00000800:00000200:26.0:1773851882.889512:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851882.889514:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851882.889515:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002a27bb83 refcount 2 to 16513@kfi7
00010000:00000001:26.0:1773851882.889516:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851882.889517:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851882.889517:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851882.889518:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b50e361d x1859599172089664/t0(0) o400->d516967d-4dad-42e0-a4a9-25b4832db2f2@16513@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1524-0'
00000100:00100000:26.0:1773851882.889521:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b50e361d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:d516967d-4dad-42e0-a4a9-25b4832db2f2+5:39566:x1859599172089664:12345-16513@kfi7:400:default-tuolumne1524-0 Request processed in 65us (109us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851882.889524:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16513@kfi7, seq: 2025148
00000100:00000040:26.0:1773851882.889524:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002ffc2e6a : new rpc_count 0
00000800:00000200:25.0:1773851882.889524:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851882.889525:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851882.889526:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851882.889527:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:26.0:1773851882.889527:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000055d80f68.
00000400:00000200:25.0:1773851882.889527:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851882.889528:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000052694ebb.
00000020:00000040:26.0:1773851882.889529:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000002ffc2e6a : new refcount 4
00000400:00000200:25.0:1773851882.889529:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16512@kfi7: PUT: OK
00000100:00000001:26.0:1773851882.889530:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851882.889530:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e24181d3
00000400:00000010:25.0:1773851882.889531:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e24181d3.
00000100:00000001:25.0:1773851882.889532:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851882.889532:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851882.889534:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003df93de2 nid 16512@kfi7 refs 2
00000800:00000200:25.0:1773851882.889536:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 16512@kfi7(000000008d54e809):0x0 lsk 2068 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000813 Transaction freed
00000800:00000200:13.0:1773851882.894513:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851882.894514:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851882.894516:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851882.894519:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851882.894522:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13969@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.894523:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13969@kfi7 : PUT - for me
00000400:00000200:13.0:1773851882.894525:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13969@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.894526:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b794fd6a nid 13969@kfi7 refs 1
00000400:00000200:13.0:1773851882.894528:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13969@kfi7 to cpt 3
00000400:00000200:13.0:1773851882.894529:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b794fd6a nid 13969@kfi7 refs 2
00000400:00000200:13.0:1773851882.894530:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b794fd6a nid 13969@kfi7 refs 3
00000400:00000200:13.0:1773851882.894533:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13968@kfi7 to cpt 0
00000400:00000200:13.0:1773851882.894534:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13968@kfi7 of length 224 into portal 12 MB=0x69b4bc5a2fc80
00000400:00000200:13.0:1773851882.894536:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13968@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 43344
00000800:00000200:13.0:1773851882.894539:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851882.894541:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851882.894543:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13969@kfi7: PUT: OK
00000100:00000001:13.0:1773851882.894544:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851882.894545:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851882.894546:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000052790486.
00000100:00000040:13.0:1773851882.894547:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000052790486 x1859599600909440 msgsize 224
00000100:00100000:13.0:1773851882.894549:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13968@kfi7 (source: 12345-13969@kfi7)
00000100:00000001:13.0:1773851882.894551:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851882.894552:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b794fd6a nid 13969@kfi7 refs 2
00000100:00000001:15.0:1773851882.894554:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851882.894554:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851882.894555:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851882.894556:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851882.894556:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851882.894558:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851882.894559:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599600909440
00000020:00000001:15.0:1773851882.894560:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851882.894561:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3891987c
00000020:00000001:15.0:1773851882.894561:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851882.894568:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000005ea1a6c refcount=5
00000020:00000001:15.0:1773851882.894570:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134928596992 : -106938780954624 : ffff9ebd5ff2d000)
00000020:00000001:15.0:1773851882.894571:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134928596992 : -106938780954624 : ffff9ebd5ff2d000)
00000100:00000001:15.0:1773851882.894572:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.894574:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851882.894575:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005a6ddf9a.
00000020:00000010:15.0:1773851882.894577:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851882.894578:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851882.894579:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851882.894580:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851882.894581:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.894582:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851882.894583:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851882.894584:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.894585:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851882.894587:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851882.894588:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851882.894588:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851882.894588:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851882.894590:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13968@kfi7, seq: 2289886
00000100:00000040:15.0:1773851882.894591:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000005ea1a6c : new rpc_count 1
00000100:00000001:12.0:1773851882.894591:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.894592:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902264064 : -106994807287552 : ffff9eb05484d100)
00000100:00000001:12.0:1773851882.894592:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851882.894594:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000052790486 x1859599600909440/t0(0) o400->bfcc4b1a-4014-4d8b-8182-2c8d402ff0d1@13968@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1362-0'
00000100:00000001:15.0:1773851882.894598:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851882.894599:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851882.894600:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052790486 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:bfcc4b1a-4014-4d8b-8182-2c8d402ff0d1+5:39729:x1859599600909440:12345-13968@kfi7:400:default-tuolumne1362-0
00000100:00000200:15.0:1773851882.894602:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599600909440
00000020:00000001:15.0:1773851882.894603:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851882.894604:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851882.894605:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.894606:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851882.894607:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851882.894608:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851882.894609:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599600909440, found 0 last_xid 1859599600909439
00000020:00000001:15.0:1773851882.894610:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851882.894611:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851882.894612:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851882.894613:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.894614:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851882.894615:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851882.894616:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851882.894617:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f72b5e77.
02000000:00000001:15.0:1773851882.894618:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.894619:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.894620:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851882.894621:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694955, transno 0, xid 1859599600909440
00010000:00000001:15.0:1773851882.894622:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851882.894624:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000052790486 x1859599600909440/t0(0) o400->bfcc4b1a-4014-4d8b-8182-2c8d402ff0d1@13968@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1362-0'
00010000:00000001:15.0:1773851882.894627:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851882.894628:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851882.894629:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=115 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851882.894631:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851882.894632:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b5d9699 refcount 3 to 13968@kfi7
00000100:00000001:15.0:1773851882.894633:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572416 : -107154178979200 : ffff9e8b3939ca80)
02000000:00000001:15.0:1773851882.894634:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851882.894635:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851882.894636:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851882.894637:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13969@kfi7
00000400:00000010:15.0:1773851882.894638:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000067df834c.
00000100:00000200:15.0:1773851882.894639:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599600909440, offset 224
00000400:00000200:15.0:1773851882.894641:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13969@kfi7
00000400:00000200:15.0:1773851882.894643:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13969@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.894644:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b794fd6a nid 13969@kfi7 refs 1
00000400:00000200:15.0:1773851882.894645:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b794fd6a nid 13969@kfi7 refs 2
00000400:00000200:15.0:1773851882.894647:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b794fd6a nid 13969@kfi7 refs 3
00000400:00000200:15.0:1773851882.894649:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13969@kfi7 local destination
00000400:00000200:15.0:1773851882.894651:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769744:8769744:1024:4294967295] 13969@kfi7 LPNI seq info [9239106:9239106:16:4294967295]
00000400:00000200:15.0:1773851882.894653:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b794fd6a nid 13969@kfi7 refs 2
00000400:00000200:15.0:1773851882.894654:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13969@kfi7 to cpt 3
00000400:00000200:15.0:1773851882.894657:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13969@kfi7(13969@kfi7:13969@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851882.894660:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b794fd6a nid 13969@kfi7 refs 3
00000800:00000200:15.0:1773851882.894662:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851882.894664:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851882.894667:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851882.894671:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aea Using peer 13969@kfi7(0x100000000000aea)
00000800:00000200:15.0:1773851882.894675:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x100000000000aea: rc=0
00000800:00000200:15.0:1773851882.894678:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851882.894681:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851882.894682:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b5d9699 refcount 2 to 13968@kfi7
00010000:00000001:15.0:1773851882.894683:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851882.894684:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851882.894685:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851882.894686:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000052790486 x1859599600909440/t0(0) o400->bfcc4b1a-4014-4d8b-8182-2c8d402ff0d1@13968@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1362-0'
00000100:00100000:15.0:1773851882.894691:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052790486 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:bfcc4b1a-4014-4d8b-8182-2c8d402ff0d1+5:39729:x1859599600909440:12345-13968@kfi7:400:default-tuolumne1362-0 Request processed in 91us (142us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851882.894693:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aea TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851882.894694:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13968@kfi7, seq: 2289886
00000100:00000040:15.0:1773851882.894695:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000005ea1a6c : new rpc_count 0
00000400:00000200:13.0:1773851882.894695:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851882.894696:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851882.894697:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851882.894697:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13969@kfi7: PUT: OK
00000020:00000010:15.0:1773851882.894698:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851882.894698:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000067df834c
00000020:00000010:15.0:1773851882.894699:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000400:00000010:13.0:1773851882.894699:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000067df834c.
00000020:00000010:15.0:1773851882.894700:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005a6ddf9a.
00000100:00000001:13.0:1773851882.894700:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851882.894701:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:15.0:1773851882.894702:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000005ea1a6c : new refcount 4
00000400:00000200:13.0:1773851882.894702:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b794fd6a nid 13969@kfi7 refs 2
00000100:00000001:15.0:1773851882.894703:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851882.894704:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 13969@kfi7(00000000a4211886):0x0 lsk 2795 rsk 3 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aea Transaction freed
00000800:00000200:5.0:1773851882.933805:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851882.933806:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851882.933808:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851882.933811:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851882.933815:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16259@kfi7 to cpt 1
00000400:00000200:5.0:1773851882.933817:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16259@kfi7 : PUT - for me
00000400:00000200:5.0:1773851882.933818:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16259@kfi7 to cpt 1
00000400:00000200:5.0:1773851882.933819:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000462fe058 nid 16259@kfi7 refs 1
00000400:00000200:5.0:1773851882.933821:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16259@kfi7 to cpt 1
00000400:00000200:5.0:1773851882.933822:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000462fe058 nid 16259@kfi7 refs 2
00000400:00000200:5.0:1773851882.933823:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000462fe058 nid 16259@kfi7 refs 3
00000400:00000200:5.0:1773851882.933824:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16194@kfi7 to cpt 2
00000400:00000200:5.0:1773851882.933826:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16194@kfi7 of length 224 into portal 12 MB=0x69b4b959a8d00
00000400:00000200:5.0:1773851882.933828:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16194@kfi7 of length 224/224 into md 0x793926dc5 [64] + 153648
00000800:00000200:5.0:1773851882.933830:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851882.933833:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851882.933834:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16259@kfi7: PUT: OK
00000100:00000001:5.0:1773851882.933836:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851882.933837:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851882.933838:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005bb2d662.
00000100:00000040:5.0:1773851882.933839:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000005bb2d662 x1859598795050240 msgsize 224
00000100:00100000:5.0:1773851882.933841:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-16194@kfi7 (source: 12345-16259@kfi7)
00000100:00000001:5.0:1773851882.933843:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851882.933844:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000462fe058 nid 16259@kfi7 refs 2
00000100:00000001:7.0:1773851882.933845:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851882.933846:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851882.933846:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851882.933847:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851882.933848:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851882.933849:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851882.933850:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598795050240
00000020:00000001:7.0:1773851882.933851:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851882.933852:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38922547
00000020:00000001:7.0:1773851882.933853:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851882.933856:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000016cfd597 refcount=5
00000020:00000001:7.0:1773851882.933857:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138365012992 : -106935344538624 : ffff9ebe2cc65c00)
00000020:00000001:7.0:1773851882.933858:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138365012992 : -106935344538624 : ffff9ebe2cc65c00)
00000100:00000001:7.0:1773851882.933859:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851882.933860:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851882.933862:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851882.933863:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851882.933865:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851882.933866:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851882.933866:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851882.933867:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851882.933869:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851882.933870:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851882.933870:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.933872:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851882.933874:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851882.933874:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851882.933875:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851882.933875:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851882.933876:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16194@kfi7, seq: 2001955
00000100:00000040:7.0:1773851882.933877:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000016cfd597 : new rpc_count 1
00000100:00000001:4.0:1773851882.933878:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.933879:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108955776 : -106938600595840 : ffff9ebd6ab2de80)
00000100:00000001:4.0:1773851882.933879:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851882.933880:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005bb2d662 x1859598795050240/t0(0) o400->a5ccf090-93df-479f-8b9f-a4cbab357d28@16194@kfi7:609/0 lens 224/0 e 0 to 0 dl 1773851969 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1512-0'
00000100:00000001:7.0:1773851882.933885:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851882.933885:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851882.933887:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005bb2d662 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:a5ccf090-93df-479f-8b9f-a4cbab357d28+5:39604:x1859598795050240:12345-16194@kfi7:400:default-tuolumne1512-0
00000100:00000200:7.0:1773851882.933889:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598795050240
00000020:00000001:7.0:1773851882.933890:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851882.933890:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851882.933891:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.933892:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851882.933893:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851882.933894:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851882.933895:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598795050240, found 0 last_xid 1859598795050239
00000020:00000001:7.0:1773851882.933897:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851882.933897:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851882.933898:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851882.933899:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.933900:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851882.933901:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851882.933902:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851882.933903:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005977b9a0.
02000000:00000001:7.0:1773851882.933904:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.933905:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.933907:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851882.933908:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044121232, transno 0, xid 1859598795050240
00010000:00000001:7.0:1773851882.933909:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851882.933910:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005bb2d662 x1859598795050240/t0(0) o400->a5ccf090-93df-479f-8b9f-a4cbab357d28@16194@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1512-0'
00010000:00000001:7.0:1773851882.933914:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851882.933915:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851882.933916:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=114 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851882.933918:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851882.933919:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b428f086 refcount 3 to 16194@kfi7
00000100:00000001:7.0:1773851882.933920:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274737472 : -107155434814144 : ffff9e8aee5f4540)
02000000:00000001:7.0:1773851882.933921:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851882.933922:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851882.933923:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851882.933924:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16259@kfi7
00000400:00000010:7.0:1773851882.933925:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000045c9ef1.
00000100:00000200:7.0:1773851882.933927:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598795050240, offset 224
00000400:00000200:7.0:1773851882.933929:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16259@kfi7
00000400:00000200:7.0:1773851882.933931:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16259@kfi7 to cpt 1
00000400:00000200:7.0:1773851882.933932:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000462fe058 nid 16259@kfi7 refs 1
00000400:00000200:7.0:1773851882.933934:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000462fe058 nid 16259@kfi7 refs 2
00000400:00000200:7.0:1773851882.933936:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000462fe058 nid 16259@kfi7 refs 3
00000400:00000200:7.0:1773851882.933938:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16259@kfi7 local destination
00000400:00000200:7.0:1773851882.933940:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769745:8769745:1024:4294967295] 16259@kfi7 LPNI seq info [306256:306256:16:4294967295]
00000400:00000200:7.0:1773851882.933942:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000462fe058 nid 16259@kfi7 refs 2
00000400:00000200:7.0:1773851882.933943:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16259@kfi7 to cpt 1
00000400:00000200:7.0:1773851882.933946:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16259@kfi7(16259@kfi7:16259@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851882.933948:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000462fe058 nid 16259@kfi7 refs 3
00000800:00000200:7.0:1773851882.933950:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851882.933952:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851882.933956:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851882.933962:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006ee Using peer 16259@kfi7(0x1000000000006ee)
00000800:00000200:7.0:1773851882.933967:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x1000000000006ee: rc=0
00000800:00000200:7.0:1773851882.933969:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006ee TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851882.933972:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851882.933973:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b428f086 refcount 2 to 16194@kfi7
00010000:00000001:7.0:1773851882.933975:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851882.933975:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851882.933976:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851882.933977:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005bb2d662 x1859598795050240/t0(0) o400->a5ccf090-93df-479f-8b9f-a4cbab357d28@16194@kfi7:609/0 lens 224/224 e 0 to 0 dl 1773851969 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1512-0'
00000100:00100000:7.0:1773851882.933983:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005bb2d662 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:a5ccf090-93df-479f-8b9f-a4cbab357d28+5:39604:x1859598795050240:12345-16194@kfi7:400:default-tuolumne1512-0 Request processed in 97us (142us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851882.933984:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006ee TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851882.933986:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851882.933987:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16194@kfi7, seq: 2001955
00000100:00000040:7.0:1773851882.933988:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000016cfd597 : new rpc_count 0
00000400:00000200:5.0:1773851882.933988:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16259@kfi7: PUT: OK
00000100:00000001:7.0:1773851882.933989:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851882.933989:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000045c9ef1
00000100:00000001:7.0:1773851882.933990:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:5.0:1773851882.933990:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000045c9ef1.
00000020:00000010:7.0:1773851882.933991:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000100:00000001:5.0:1773851882.933991:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851882.933992:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000100:00000001:5.0:1773851882.933992:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851882.933993:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000020:00000040:7.0:1773851882.933994:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000016cfd597 : new refcount 4
00000400:00000200:5.0:1773851882.933994:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000462fe058 nid 16259@kfi7 refs 2
00000100:00000001:7.0:1773851882.933995:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851882.933996:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16259@kfi7(00000000ddaa2fae):0x0 lsk 1775 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006ee Transaction freed
00000800:00000200:30.0:1773851883.059801:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851883.059803:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851883.059806:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851883.059810:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851883.059814:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14706@kfi7 to cpt 7
00000400:00000200:30.0:1773851883.059817:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14706@kfi7 : PUT - for me
00000400:00000200:30.0:1773851883.059819:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14706@kfi7 to cpt 7
00000400:00000200:30.0:1773851883.059821:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f272b5b nid 14706@kfi7 refs 1
00000400:00000200:30.0:1773851883.059823:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14706@kfi7 to cpt 7
00000400:00000200:30.0:1773851883.059825:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f272b5b nid 14706@kfi7 refs 2
00000400:00000200:30.0:1773851883.059826:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009f272b5b nid 14706@kfi7 refs 3
00000400:00000200:30.0:1773851883.059828:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14706@kfi7 to cpt 7
00000400:00000200:30.0:1773851883.059830:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14706@kfi7 of length 224 into portal 12 MB=0x69b4bbd41c240
00000400:00000200:30.0:1773851883.059834:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14706@kfi7 of length 224/224 into md 0x77fe139dd [64] + 190600
00000800:00000200:30.0:1773851883.059838:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851883.059841:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851883.059843:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14706@kfi7: PUT: OK
00000100:00000001:30.0:1773851883.059845:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851883.059846:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851883.059847:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bf844e4d.
00000100:00000040:30.0:1773851883.059849:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000bf844e4d x1859599460319808 msgsize 224
00000100:00100000:30.0:1773851883.059851:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-14706@kfi7 (source: 12345-14706@kfi7)
00000100:00000001:30.0:1773851883.059853:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851883.059855:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009f272b5b nid 14706@kfi7 refs 2
00000100:00000001:29.0:1773851883.059856:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851883.059858:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:29.0:1773851883.059858:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851883.059859:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851883.059860:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851883.059861:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.059862:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599460319808
00000020:00000001:29.0:1773851883.059863:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851883.059864:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e177
00000020:00000001:29.0:1773851883.059865:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851883.059869:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000032f974ed refcount=5
00000020:00000001:29.0:1773851883.059870:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132181355520 : -106941528196096 : ffff9ebcbc333c00)
00000020:00000001:29.0:1773851883.059872:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132181355520 : -106941528196096 : ffff9ebcbc333c00)
00000100:00000001:29.0:1773851883.059873:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.059874:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851883.059875:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851883.059876:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.059877:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851883.059879:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851883.059879:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851883.059880:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.059881:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851883.059882:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851883.059882:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.059883:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.059885:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851883.059885:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851883.059885:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851883.059885:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851883.059886:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14706@kfi7, seq: 2055559
00000100:00000001:30.0:1773851883.059887:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.059887:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000032f974ed : new rpc_count 1
00000100:00000001:30.0:1773851883.059888:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.059888:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411242240 : -106960298309376 : ffff9eb85d6a0900)
00000100:00000040:29.0:1773851883.059890:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bf844e4d x1859599460319808/t0(0) o400->de584cfe-272d-4880-83d1-8e07d6273364@14706@kfi7:671/0 lens 224/0 e 0 to 0 dl 1773852031 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1402-0'
00000100:00000001:29.0:1773851883.059893:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.059893:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851883.059894:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf844e4d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:de584cfe-272d-4880-83d1-8e07d6273364+5:39529:x1859599460319808:12345-14706@kfi7:400:default-tuolumne1402-0
00000100:00000200:29.0:1773851883.059896:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599460319808
00000020:00000001:29.0:1773851883.059897:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851883.059898:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851883.059898:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.059899:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851883.059900:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851883.059901:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851883.059901:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599460319808, found 0 last_xid 1859599460319807
00000020:00000001:29.0:1773851883.059902:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851883.059907:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851883.059907:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851883.059908:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.059908:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851883.059909:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851883.059910:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851883.059911:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002e5f6277.
02000000:00000001:29.0:1773851883.059911:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.059912:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.059913:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851883.059914:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154593768, transno 0, xid 1859599460319808
00010000:00000001:29.0:1773851883.059915:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851883.059916:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bf844e4d x1859599460319808/t0(0) o400->de584cfe-272d-4880-83d1-8e07d6273364@14706@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1402-0'
00010000:00000001:29.0:1773851883.059918:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851883.059919:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851883.059920:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=116 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851883.059921:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851883.059921:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000feb21a7f refcount 3 to 14706@kfi7
00000100:00000001:29.0:1773851883.059922:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271968 : -107152618279648 : ffff9e8b96402d20)
02000000:00000001:29.0:1773851883.059923:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851883.059923:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.059924:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.059925:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14706@kfi7
00000400:00000010:29.0:1773851883.059926:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c4455194.
00000100:00000200:29.0:1773851883.059926:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599460319808, offset 224
00000400:00000200:29.0:1773851883.059928:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14706@kfi7
00000400:00000200:29.0:1773851883.059929:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14706@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.059929:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f272b5b nid 14706@kfi7 refs 1
00000400:00000200:29.0:1773851883.059930:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009f272b5b nid 14706@kfi7 refs 2
00000400:00000200:29.0:1773851883.059931:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009f272b5b nid 14706@kfi7 refs 3
00000400:00000200:29.0:1773851883.059932:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14706@kfi7 local destination
00000400:00000200:29.0:1773851883.059934:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769746:8769746:1024:4294967295] 14706@kfi7 LPNI seq info [19484714:19484714:16:4294967295]
00000400:00000200:29.0:1773851883.059935:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009f272b5b nid 14706@kfi7 refs 2
00000400:00000200:29.0:1773851883.059936:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14706@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.059938:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14706@kfi7(14706@kfi7:14706@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851883.059940:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009f272b5b nid 14706@kfi7 refs 3
00000800:00000200:29.0:1773851883.059941:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.059942:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851883.059944:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851883.059946:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3b2 Using peer 14706@kfi7(0x3b2)
00000800:00000200:29.0:1773851883.059949:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0x3b2: rc=0
00000800:00000200:29.0:1773851883.059951:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3b2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851883.059953:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.059954:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000feb21a7f refcount 2 to 14706@kfi7
00010000:00000001:29.0:1773851883.059954:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851883.059955:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.059956:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851883.059956:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bf844e4d x1859599460319808/t0(0) o400->de584cfe-272d-4880-83d1-8e07d6273364@14706@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1402-0'
00000100:00100000:29.0:1773851883.059959:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf844e4d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:de584cfe-272d-4880-83d1-8e07d6273364+5:39529:x1859599460319808:12345-14706@kfi7:400:default-tuolumne1402-0 Request processed in 65us (110us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851883.059961:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14706@kfi7, seq: 2055559
00000100:00000040:29.0:1773851883.059962:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000032f974ed : new rpc_count 0
00000800:00000200:30.0:1773851883.059963:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3b2 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851883.059963:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851883.059963:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851883.059964:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851883.059965:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851883.059965:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851883.059965:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000400:00000200:30.0:1773851883.059966:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14706@kfi7: PUT: OK
00000020:00000040:29.0:1773851883.059966:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000032f974ed : new refcount 4
00000400:00000200:30.0:1773851883.059967:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c4455194
00000400:00000010:30.0:1773851883.059967:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c4455194.
00000100:00000001:29.0:1773851883.059967:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.059968:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851883.059968:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851883.059969:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009f272b5b nid 14706@kfi7 refs 2
00000800:00000200:30.0:1773851883.059971:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 14706@kfi7(0000000099b78ac9):0x0 lsk 947 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3b2 Transaction freed
00000800:00000200:22.0:1773851883.071790:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851883.071790:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851883.071790:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851883.071791:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851883.071792:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851883.071792:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851883.071794:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851883.071794:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14802@kfi7(00000000bbdcb60d):0x2d8 version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851883.071795:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 Using peer 14802@kfi7(0x1000000000002d8)
00000400:00000200:22.0:1773851883.071796:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14802@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.071797:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14802@kfi7 to cpt 5
00000400:00000200:22.0:1773851883.071798:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14802@kfi7 : PUT - for me
00000400:00000200:22.0:1773851883.071798:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14802@kfi7 to cpt 5
00000400:00000200:22.0:1773851883.071799:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003221c610 nid 14802@kfi7 refs 1
00000800:00000200:21.0:1773851883.071799:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0x1000000000002d8: rc=0
00000400:00000200:22.0:1773851883.071800:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14802@kfi7 to cpt 5
00000400:00000200:22.0:1773851883.071801:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003221c610 nid 14802@kfi7 refs 2
00000800:00000200:21.0:1773851883.071801:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851883.071802:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003221c610 nid 14802@kfi7 refs 3
00000400:00000200:22.0:1773851883.071802:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14611@kfi7 to cpt 5
00000400:00000200:22.0:1773851883.071803:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14611@kfi7 of length 224 into portal 12 MB=0x699e0ef09a7c0
00000400:00000200:22.0:1773851883.071805:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14611@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 51696
00000800:00000200:22.0:1773851883.071807:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851883.071808:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851883.071809:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14802@kfi7: PUT: OK
00000100:00000001:22.0:1773851883.071810:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:21.0:1773851883.071810:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 TN_EVENT_TX_OK event status 0
00000100:00000200:22.0:1773851883.071811:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851883.071812:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002088b21b.
00000100:00000040:22.0:1773851883.071812:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000002088b21b x1858041222375360 msgsize 224
00000800:00000200:21.0:1773851883.071812:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 Transaction freed
00000100:00100000:22.0:1773851883.071814:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-14611@kfi7 (source: 12345-14802@kfi7)
00000100:00000001:22.0:1773851883.071815:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851883.071816:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003221c610 nid 14802@kfi7 refs 2
00000100:00000001:20.0:1773851883.071816:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:22.0:1773851883.071817:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851883.071817:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851883.071817:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851883.071818:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851883.071818:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851883.071819:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041222375360
00000020:00000001:20.0:1773851883.071820:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851883.071820:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91dcf
00000020:00000001:20.0:1773851883.071821:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851883.071824:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e7fd1cf1 refcount=6
00000020:00000001:20.0:1773851883.071825:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628764672 : -107123080786944 : ffff9e9276d28c00)
00000020:00000001:20.0:1773851883.071825:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628764672 : -107123080786944 : ffff9e9276d28c00)
00000100:00000001:20.0:1773851883.071826:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.071827:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851883.071828:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000001b967a9.
00000020:00000010:20.0:1773851883.071829:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.071830:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851883.071830:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851883.071831:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851883.071831:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851883.071832:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851883.071833:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851883.071833:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.071834:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851883.071836:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851883.071836:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851883.071836:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851883.071836:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851883.071837:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14611@kfi7, seq: 1998029
00000100:00000001:23.0:1773851883.071838:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851883.071838:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.071838:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e7fd1cf1 : new rpc_count 1
00000100:00000001:20.0:1773851883.071841:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382183168 : -106946327368448 : ffff9ebb9e25ad00)
00000100:00000040:20.0:1773851883.071842:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002088b21b x1858041222375360/t0(0) o400->de912de7-5d26-45b8-ab60-0443fd919b3c@14611@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1413-0'
00000100:00000001:20.0:1773851883.071845:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.071845:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851883.071846:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002088b21b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:de912de7-5d26-45b8-ab60-0443fd919b3c+6:39687:x1858041222375360:12345-14611@kfi7:400:default-tuolumne1413-0
00000100:00000200:20.0:1773851883.071847:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041222375360
00000020:00000001:20.0:1773851883.071848:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851883.071848:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851883.071849:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.071849:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851883.071850:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851883.071851:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851883.071851:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041222375360, found 0 last_xid 1858041222375359
00000020:00000001:20.0:1773851883.071852:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851883.071853:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851883.071853:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851883.071854:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.071854:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851883.071855:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851883.071855:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851883.071856:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000de3c658a.
02000000:00000001:20.0:1773851883.071857:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.071857:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.071858:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851883.071859:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694154, transno 0, xid 1858041222375360
00010000:00000001:20.0:1773851883.071859:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851883.071860:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002088b21b x1858041222375360/t0(0) o400->de912de7-5d26-45b8-ab60-0443fd919b3c@14611@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1413-0'
00010000:00000001:20.0:1773851883.071862:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851883.071863:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851883.071864:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=116 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851883.071865:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851883.071866:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005d632e79 refcount 3 to 14611@kfi7
00000100:00000001:20.0:1773851883.071867:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451232 : -107146752100384 : ffff9e8cf3e6f7e0)
02000000:00000001:20.0:1773851883.071868:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851883.071868:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.071869:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851883.071869:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14802@kfi7
00000400:00000010:20.0:1773851883.071870:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000046fff747.
00000100:00000200:20.0:1773851883.071871:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041222375360, offset 224
00000400:00000200:20.0:1773851883.071872:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14802@kfi7
00000400:00000200:20.0:1773851883.071873:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14802@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.071873:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003221c610 nid 14802@kfi7 refs 1
00000400:00000200:20.0:1773851883.071874:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003221c610 nid 14802@kfi7 refs 2
00000400:00000200:20.0:1773851883.071875:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003221c610 nid 14802@kfi7 refs 3
00000400:00000200:20.0:1773851883.071877:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14802@kfi7 local destination
00000400:00000200:20.0:1773851883.071878:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769747:8769747:1024:4294967295] 14802@kfi7 LPNI seq info [9585256:9585256:16:4294967295]
00000400:00000200:20.0:1773851883.071879:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003221c610 nid 14802@kfi7 refs 2
00000400:00000200:20.0:1773851883.071880:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14802@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.071881:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14802@kfi7(14802@kfi7:14802@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851883.071882:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003221c610 nid 14802@kfi7 refs 3
00000800:00000200:20.0:1773851883.071884:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851883.071885:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851883.071887:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851883.071889:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 Using peer 14802@kfi7(0x1000000000002d8)
00000800:00000200:20.0:1773851883.071892:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x1000000000002d8: rc=0
00000800:00000200:20.0:1773851883.071893:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851883.071895:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.071896:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005d632e79 refcount 2 to 14611@kfi7
00010000:00000001:20.0:1773851883.071897:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851883.071897:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.071898:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851883.071899:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002088b21b x1858041222375360/t0(0) o400->de912de7-5d26-45b8-ab60-0443fd919b3c@14611@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1413-0'
00000100:00100000:20.0:1773851883.071902:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002088b21b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:de912de7-5d26-45b8-ab60-0443fd919b3c+6:39687:x1858041222375360:12345-14611@kfi7:400:default-tuolumne1413-0 Request processed in 57us (89us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851883.071904:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14611@kfi7, seq: 1998029
00000100:00000040:20.0:1773851883.071905:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e7fd1cf1 : new rpc_count 0
00000100:00000001:20.0:1773851883.071906:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851883.071906:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851883.071907:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.071907:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851883.071908:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000001b967a9.
00000020:00000040:20.0:1773851883.071909:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000e7fd1cf1 : new refcount 5
00000100:00000001:20.0:1773851883.071910:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851883.071914:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851883.071915:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.071916:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14802@kfi7: PUT: OK
00000400:00000200:21.0:1773851883.071917:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000046fff747
00000400:00000010:21.0:1773851883.071918:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000046fff747.
00000100:00000001:21.0:1773851883.071918:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851883.071919:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851883.071920:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003221c610 nid 14802@kfi7 refs 2
00000800:00000200:21.0:1773851883.071921:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 14802@kfi7(00000000bbdcb60d):0x0 lsk 729 rsk 54 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000002d8 Transaction freed
00000800:00000200:29.0:1773851883.073825:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.073826:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851883.073829:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851883.073832:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851883.073835:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16371@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.073837:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16371@kfi7 : PUT - for me
00000400:00000200:29.0:1773851883.073839:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16371@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.073840:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d463e387 nid 16371@kfi7 refs 1
00000400:00000200:29.0:1773851883.073843:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16371@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.073844:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d463e387 nid 16371@kfi7 refs 2
00000400:00000200:29.0:1773851883.073845:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d463e387 nid 16371@kfi7 refs 3
00000400:00000200:29.0:1773851883.073847:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16370@kfi7 to cpt 4
00000400:00000200:29.0:1773851883.073849:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16370@kfi7 of length 224 into portal 12 MB=0x69b4c3a5dd380
00000400:00000200:29.0:1773851883.073851:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16370@kfi7 of length 224/224 into md 0x77fe139dd [64] + 190824
00000800:00000200:29.0:1773851883.073854:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851883.073857:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851883.073859:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16371@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.073861:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851883.073861:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851883.073863:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000018cb496e.
00000100:00000040:29.0:1773851883.073864:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000018cb496e x1859601559311232 msgsize 224
00000100:00100000:29.0:1773851883.073867:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16370@kfi7 (source: 12345-16371@kfi7)
00000100:00000001:29.0:1773851883.073869:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851883.073870:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d463e387 nid 16371@kfi7 refs 2
00000800:00000200:29.0:1773851883.073873:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851883.073877:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851883.073878:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851883.073879:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851883.073880:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851883.073881:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.073883:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601559311232
00000020:00000001:29.0:1773851883.073884:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851883.073885:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e61d4c81e
00000020:00000001:29.0:1773851883.073885:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851883.073889:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b651e73 refcount=5
00000020:00000001:29.0:1773851883.073890:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126059452416 : -106947650099200 : ffff9ebb4f4e6800)
00000020:00000001:29.0:1773851883.073891:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126059452416 : -106947650099200 : ffff9ebb4f4e6800)
00000100:00000001:29.0:1773851883.073892:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.073893:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851883.073894:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851883.073896:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.073897:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851883.073898:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851883.073899:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851883.073900:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.073901:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851883.073902:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851883.073903:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.073905:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.073906:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851883.073907:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851883.073907:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851883.073908:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851883.073909:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16370@kfi7, seq: 2055560
00000100:00000001:30.0:1773851883.073910:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.073910:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b651e73 : new rpc_count 1
00000100:00000001:30.0:1773851883.073911:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.073911:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058761465728 : -107014948085888 : ffff9eaba4089f80)
00000100:00000040:29.0:1773851883.073913:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000018cb496e x1859601559311232/t0(0) o400->2be3b49c-b550-4b9c-8666-b802d0346635@16370@kfi7:671/0 lens 224/0 e 0 to 0 dl 1773852031 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1497-0'
00000100:00000001:29.0:1773851883.073917:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.073918:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851883.073919:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018cb496e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:2be3b49c-b550-4b9c-8666-b802d0346635+5:39484:x1859601559311232:12345-16370@kfi7:400:default-tuolumne1497-0
00000100:00000200:29.0:1773851883.073921:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601559311232
00000020:00000001:29.0:1773851883.073923:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851883.073924:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851883.073925:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.073926:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851883.073927:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851883.073928:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851883.073929:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601559311232, found 0 last_xid 1859601559311231
00000020:00000001:29.0:1773851883.073930:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851883.073931:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851883.073932:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851883.073933:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.073934:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851883.073935:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851883.073936:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851883.073937:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009b0ce531.
02000000:00000001:29.0:1773851883.073938:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.073939:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.073940:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851883.073941:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915823482, transno 0, xid 1859601559311232
00010000:00000001:29.0:1773851883.073942:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851883.073944:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000018cb496e x1859601559311232/t0(0) o400->2be3b49c-b550-4b9c-8666-b802d0346635@16370@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1497-0'
00010000:00000001:29.0:1773851883.073947:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851883.073948:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851883.073949:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=116 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851883.073951:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851883.073952:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000085f94df5 refcount 3 to 16370@kfi7
00000100:00000001:29.0:1773851883.073953:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583544320 : -107156126007296 : ffff9e8ac52c8000)
02000000:00000001:29.0:1773851883.073955:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851883.073955:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.073956:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.073958:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16371@kfi7
00000400:00000010:29.0:1773851883.073959:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c2a5509b.
00000100:00000200:29.0:1773851883.073960:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601559311232, offset 224
00000400:00000200:29.0:1773851883.073962:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16371@kfi7
00000400:00000200:29.0:1773851883.073964:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16371@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.073966:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d463e387 nid 16371@kfi7 refs 1
00000400:00000200:29.0:1773851883.073968:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d463e387 nid 16371@kfi7 refs 2
00000400:00000200:29.0:1773851883.073969:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d463e387 nid 16371@kfi7 refs 3
00000400:00000200:29.0:1773851883.073971:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16371@kfi7 local destination
00000400:00000200:29.0:1773851883.073973:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769748:8769748:1024:4294967295] 16371@kfi7 LPNI seq info [404289:404289:16:4294967295]
00000400:00000200:29.0:1773851883.073976:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d463e387 nid 16371@kfi7 refs 2
00000400:00000200:29.0:1773851883.073977:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16371@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.073980:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16371@kfi7(16371@kfi7:16371@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851883.073982:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d463e387 nid 16371@kfi7 refs 3
00000800:00000200:29.0:1773851883.073984:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.073986:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851883.073989:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851883.073993:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004bb Using peer 16371@kfi7(0x1000000000004bb)
00000800:00000200:29.0:1773851883.073998:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 324 bytes to peer 0x1000000000004bb: rc=0
00000800:00000200:29.0:1773851883.074000:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004bb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851883.074004:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.074005:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000085f94df5 refcount 2 to 16370@kfi7
00010000:00000001:29.0:1773851883.074006:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851883.074007:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.074008:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851883.074009:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000018cb496e x1859601559311232/t0(0) o400->2be3b49c-b550-4b9c-8666-b802d0346635@16370@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1497-0'
00000100:00100000:29.0:1773851883.074014:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018cb496e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:2be3b49c-b550-4b9c-8666-b802d0346635+5:39484:x1859601559311232:12345-16370@kfi7:400:default-tuolumne1497-0 Request processed in 96us (149us total) trans 0 rc 0/0
00000800:00000200:30.0:1773851883.074016:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004bb TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851883.074019:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851883.074021:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16371@kfi7: PUT: OK
00000100:00100000:29.0:1773851883.074021:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16370@kfi7, seq: 2055560
00000400:00000200:30.0:1773851883.074022:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c2a5509b
00000100:00000040:29.0:1773851883.074022:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b651e73 : new rpc_count 0
00000400:00000010:30.0:1773851883.074023:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c2a5509b.
00000100:00000001:29.0:1773851883.074023:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851883.074024:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851883.074024:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:30.0:1773851883.074025:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:29.0:1773851883.074025:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851883.074026:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d463e387 nid 16371@kfi7 refs 2
00000020:00000010:29.0:1773851883.074026:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000800:00000200:30.0:1773851883.074028:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 16371@kfi7(00000000043d750b):0x0 lsk 1212 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004bb Transaction freed
00000020:00000010:29.0:1773851883.074028:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000020:00000040:29.0:1773851883.074029:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000003b651e73 : new refcount 4
00000100:00000001:29.0:1773851883.074030:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851883.127133:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851883.127134:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851883.127136:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851883.127139:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851883.127142:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17763@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.127144:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17763@kfi7 : PUT - for me
00000400:00000200:21.0:1773851883.127145:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17763@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.127147:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf6c58ea nid 17763@kfi7 refs 1
00000400:00000200:21.0:1773851883.127149:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17763@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.127150:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf6c58ea nid 17763@kfi7 refs 2
00000400:00000200:21.0:1773851883.127151:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf6c58ea nid 17763@kfi7 refs 3
00000400:00000200:21.0:1773851883.127153:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17762@kfi7 to cpt 1
00000400:00000200:21.0:1773851883.127154:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17762@kfi7 of length 224 into portal 12 MB=0x69b4b9b568040
00000400:00000200:21.0:1773851883.127156:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17762@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 51920
00000800:00000200:21.0:1773851883.127159:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851883.127161:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.127163:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17763@kfi7: PUT: OK
00000100:00000001:21.0:1773851883.127164:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851883.127165:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851883.127166:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f50f372d.
00000100:00000040:21.0:1773851883.127167:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000f50f372d x1859598891253824 msgsize 224
00000100:00100000:21.0:1773851883.127170:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17762@kfi7 (source: 12345-17763@kfi7)
00000100:00000001:21.0:1773851883.127171:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851883.127172:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf6c58ea nid 17763@kfi7 refs 2
00000100:00000001:20.0:1773851883.127173:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851883.127174:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851883.127175:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851883.127175:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851883.127176:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851883.127177:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851883.127178:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598891253824
00000020:00000001:20.0:1773851883.127179:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851883.127180:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8151e
00000020:00000001:20.0:1773851883.127181:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851883.127186:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d3a1bead refcount=5
00000020:00000001:20.0:1773851883.127187:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139351566336 : -106934357985280 : ffff9ebe6793f800)
00000020:00000001:20.0:1773851883.127188:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139351566336 : -106934357985280 : ffff9ebe6793f800)
00000100:00000001:20.0:1773851883.127190:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.127191:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851883.127192:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d412f602.
00000020:00000010:20.0:1773851883.127194:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.127196:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851883.127197:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851883.127197:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851883.127198:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851883.127200:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851883.127201:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851883.127201:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.127203:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851883.127205:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851883.127205:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851883.127205:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851883.127206:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851883.127207:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17762@kfi7, seq: 1998030
00000100:00000001:23.0:1773851883.127208:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.127208:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d3a1bead : new rpc_count 1
00000100:00000001:23.0:1773851883.127209:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.127209:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956260352 : -106937753291264 : ffff9ebd9d33b600)
00000100:00000040:20.0:1773851883.127211:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f50f372d x1859598891253824/t0(0) o400->df0fc43e-168f-4645-885d-a52a932e9649@17762@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1596-0'
00000100:00000001:20.0:1773851883.127216:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.127216:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851883.127218:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f50f372d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:df0fc43e-168f-4645-885d-a52a932e9649+5:39579:x1859598891253824:12345-17762@kfi7:400:default-tuolumne1596-0
00000100:00000200:20.0:1773851883.127220:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598891253824
00000020:00000001:20.0:1773851883.127221:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851883.127222:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851883.127223:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.127224:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851883.127224:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851883.127226:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851883.127227:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598891253824, found 0 last_xid 1859598891253823
00000020:00000001:20.0:1773851883.127228:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851883.127229:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851883.127230:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851883.127230:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.127231:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851883.127232:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851883.127233:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851883.127235:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000048fc4e5f.
02000000:00000001:20.0:1773851883.127236:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.127237:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.127238:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851883.127239:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106221537, transno 0, xid 1859598891253824
00010000:00000001:20.0:1773851883.127240:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851883.127241:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f50f372d x1859598891253824/t0(0) o400->df0fc43e-168f-4645-885d-a52a932e9649@17762@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1596-0'
00010000:00000001:20.0:1773851883.127245:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851883.127246:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851883.127247:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=116 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851883.127249:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851883.127250:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000858a501b refcount 3 to 17762@kfi7
00000100:00000001:20.0:1773851883.127251:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413440 : -107145304138176 : ffff9e8d4a351e40)
02000000:00000001:20.0:1773851883.127253:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851883.127253:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.127254:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851883.127255:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17763@kfi7
00000400:00000010:20.0:1773851883.127256:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6c83aab.
00000100:00000200:20.0:1773851883.127258:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598891253824, offset 224
00000400:00000200:20.0:1773851883.127260:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17763@kfi7
00000400:00000200:20.0:1773851883.127261:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17763@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.127262:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf6c58ea nid 17763@kfi7 refs 1
00000400:00000200:20.0:1773851883.127264:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf6c58ea nid 17763@kfi7 refs 2
00000400:00000200:20.0:1773851883.127266:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf6c58ea nid 17763@kfi7 refs 3
00000400:00000200:20.0:1773851883.127268:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17763@kfi7 local destination
00000400:00000200:20.0:1773851883.127270:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769749:8769749:1024:4294967295] 17763@kfi7 LPNI seq info [12271659:12271659:16:4294967295]
00000400:00000200:20.0:1773851883.127272:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf6c58ea nid 17763@kfi7 refs 2
00000400:00000200:20.0:1773851883.127273:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17763@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.127277:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17763@kfi7(17763@kfi7:17763@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851883.127278:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf6c58ea nid 17763@kfi7 refs 3
00000800:00000200:20.0:1773851883.127281:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851883.127283:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851883.127286:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851883.127290:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa8f Using peer 17763@kfi7(0xa8f)
00000800:00000200:20.0:1773851883.127294:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0xa8f: rc=0
00000800:00000200:20.0:1773851883.127296:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa8f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851883.127299:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.127301:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000858a501b refcount 2 to 17762@kfi7
00010000:00000001:20.0:1773851883.127302:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851883.127305:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.127306:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851883.127307:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f50f372d x1859598891253824/t0(0) o400->df0fc43e-168f-4645-885d-a52a932e9649@17762@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1596-0'
00000100:00100000:20.0:1773851883.127312:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f50f372d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:df0fc43e-168f-4645-885d-a52a932e9649+5:39579:x1859598891253824:12345-17762@kfi7:400:default-tuolumne1596-0 Request processed in 95us (144us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851883.127315:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17762@kfi7, seq: 1998030
00000100:00000040:20.0:1773851883.127316:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d3a1bead : new rpc_count 0
00000100:00000001:20.0:1773851883.127318:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851883.127318:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851883.127319:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.127320:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851883.127322:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d412f602.
00000020:00000040:20.0:1773851883.127323:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000d3a1bead : new refcount 4
00000100:00000001:20.0:1773851883.127324:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851883.127332:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa8f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851883.127334:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.127336:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17763@kfi7: PUT: OK
00000400:00000200:21.0:1773851883.127337:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6c83aab
00000400:00000010:21.0:1773851883.127338:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6c83aab.
00000100:00000001:21.0:1773851883.127339:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851883.127340:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851883.127341:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf6c58ea nid 17763@kfi7 refs 2
00000800:00000200:21.0:1773851883.127343:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 17763@kfi7(000000009fc8e3a9):0x0 lsk 2704 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa8f Transaction freed
00000800:00000200:13.0:1773851883.137020:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851883.137021:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851883.137022:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851883.137024:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9170@kfi7(00000000fb9ea1b7):0xf81 version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851883.137025:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851883.137026:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851883.137026:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 Using peer 9170@kfi7(0x100000000000f81)
00000800:00000200:14.0:1773851883.137027:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851883.137027:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9170@kfi7 to cpt 3
00000800:00000200:13.0:1773851883.137029:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x100000000000f81: rc=0
00000800:00000200:14.0:1773851883.137030:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851883.137031:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851883.137032:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9170@kfi7 to cpt 3
00000400:00000200:14.0:1773851883.137033:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9170@kfi7 : PUT - for me
00000400:00000200:14.0:1773851883.137034:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9170@kfi7 to cpt 3
00000400:00000200:14.0:1773851883.137035:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 1
00000400:00000200:14.0:1773851883.137037:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9170@kfi7 to cpt 3
00000400:00000200:14.0:1773851883.137037:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 2
00000400:00000200:14.0:1773851883.137038:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 3
00000400:00000200:14.0:1773851883.137039:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8979@kfi7 to cpt 3
00000400:00000200:14.0:1773851883.137040:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8979@kfi7 of length 224 into portal 12 MB=0x699e42a5bf580
00000400:00000200:14.0:1773851883.137041:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8979@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 43568
00000800:00000200:14.0:1773851883.137043:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851883.137043:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851883.137045:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851883.137045:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 Transaction freed
00000400:00000200:14.0:1773851883.137046:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9170@kfi7: PUT: OK
00000100:00000001:14.0:1773851883.137047:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851883.137048:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851883.137049:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000015cbd3ce.
00000100:00000040:14.0:1773851883.137049:0:2514739:0:(events.c:358:request_in_callback()) incoming req@0000000015cbd3ce x1858055102526848 msgsize 224
00000100:00100000:14.0:1773851883.137051:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-8979@kfi7 (source: 12345-9170@kfi7)
00000100:00000001:14.0:1773851883.137052:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851883.137053:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:14.0:1773851883.137053:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 2
02000000:00000001:15.0:1773851883.137054:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851883.137054:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851883.137055:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851883.137055:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851883.137056:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851883.137056:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858055102526848
00000020:00000001:15.0:1773851883.137057:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851883.137057:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9298a
00000020:00000001:15.0:1773851883.137058:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851883.137062:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002eda4eb7 refcount=126
00000020:00000001:15.0:1773851883.137063:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743189504 : -107128966362112 : ffff9e911803cc00)
00000020:00000001:15.0:1773851883.137063:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743189504 : -107128966362112 : ffff9e911803cc00)
00000100:00000001:15.0:1773851883.137064:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851883.137065:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851883.137066:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000c5e8003.
00000020:00000010:15.0:1773851883.137067:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851883.137068:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851883.137068:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851883.137069:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851883.137069:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851883.137070:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851883.137071:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851883.137071:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851883.137072:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851883.137073:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851883.137073:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851883.137073:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851883.137074:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8979@kfi7, seq: 2289887
00000100:00000001:12.0:1773851883.137074:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851883.137075:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002eda4eb7 : new rpc_count 2
00000100:00000001:12.0:1773851883.137075:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851883.137076:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562677632 : -106978146873984 : ffff9eb4358e8d80)
00000100:00000001:12.0:1773851883.137076:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851883.137077:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000015cbd3ce x1858055102526848/t0(0) o400->407b5661-aeac-4193-94ec-3d90f24ca73d@8979@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1061-0'
00000100:00000001:15.0:1773851883.137079:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851883.137079:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851883.137080:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015cbd3ce pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:407b5661-aeac-4193-94ec-3d90f24ca73d+126:39835:x1858055102526848:12345-8979@kfi7:400:default-tuolumne1061-0
00000100:00000200:15.0:1773851883.137083:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858055102526848
00000020:00000001:15.0:1773851883.137084:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851883.137084:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851883.137085:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851883.137085:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851883.137086:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851883.137087:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851883.137087:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858055102526848, found 0 last_xid 1858054990582783
00000020:00000001:15.0:1773851883.137088:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851883.137089:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851883.137089:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851883.137090:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851883.137090:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851883.137091:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851883.137091:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851883.137092:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005a6ddf9a.
02000000:00000001:15.0:1773851883.137092:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851883.137093:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851883.137094:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851883.137094:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263981246, transno 0, xid 1858055102526848
00010000:00000001:15.0:1773851883.137095:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851883.137096:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000015cbd3ce x1858055102526848/t0(0) o400->407b5661-aeac-4193-94ec-3d90f24ca73d@8979@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1061-0'
00010000:00000001:15.0:1773851883.137098:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851883.137098:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851883.137099:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=116 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851883.137100:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851883.137101:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c920e272 refcount 3 to 8979@kfi7
00000100:00000001:15.0:1773851883.137101:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642469184 : -107157067082432 : ffff9e8a8d14d540)
02000000:00000001:15.0:1773851883.137102:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851883.137103:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851883.137103:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851883.137104:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9170@kfi7
00000400:00000010:15.0:1773851883.137105:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000db5fd08.
00000100:00000200:15.0:1773851883.137106:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858055102526848, offset 224
00000400:00000200:15.0:1773851883.137107:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9170@kfi7
00000400:00000200:15.0:1773851883.137108:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9170@kfi7 to cpt 3
00000400:00000200:15.0:1773851883.137109:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 1
00000400:00000200:15.0:1773851883.137110:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 2
00000400:00000200:15.0:1773851883.137111:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 3
00000400:00000200:15.0:1773851883.137112:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9170@kfi7 local destination
00000400:00000200:15.0:1773851883.137113:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769750:8769750:1024:4294967295] 9170@kfi7 LPNI seq info [8043923:8043923:16:4294967295]
00000400:00000200:15.0:1773851883.137115:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 2
00000400:00000200:15.0:1773851883.137115:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9170@kfi7 to cpt 3
00000400:00000200:15.0:1773851883.137117:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9170@kfi7(9170@kfi7:9170@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851883.137118:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 3
00000800:00000200:15.0:1773851883.137119:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851883.137121:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851883.137123:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851883.137125:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 Using peer 9170@kfi7(0x100000000000f81)
00000800:00000200:15.0:1773851883.137127:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x100000000000f81: rc=0
00000800:00000200:15.0:1773851883.137129:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851883.137131:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851883.137132:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c920e272 refcount 2 to 8979@kfi7
00010000:00000001:15.0:1773851883.137132:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851883.137133:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851883.137133:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851883.137134:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000015cbd3ce x1858055102526848/t0(0) o400->407b5661-aeac-4193-94ec-3d90f24ca73d@8979@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1061-0'
00000100:00100000:15.0:1773851883.137137:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015cbd3ce pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:407b5661-aeac-4193-94ec-3d90f24ca73d+126:39835:x1858055102526848:12345-8979@kfi7:400:default-tuolumne1061-0 Request processed in 57us (86us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851883.137139:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8979@kfi7, seq: 2289887
00000100:00000040:15.0:1773851883.137140:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002eda4eb7 : new rpc_count 1
00000800:00000200:13.0:1773851883.137140:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851883.137141:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851883.137141:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851883.137142:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851883.137142:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851883.137143:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000020:00000010:15.0:1773851883.137143:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000c5e8003.
00000400:00000200:13.0:1773851883.137143:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9170@kfi7: PUT: OK
00000400:00000200:13.0:1773851883.137143:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000db5fd08
00000020:00000040:15.0:1773851883.137144:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000002eda4eb7 : new refcount 125
00000400:00000010:13.0:1773851883.137144:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000db5fd08.
00000100:00000001:13.0:1773851883.137144:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851883.137145:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851883.137145:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851883.137146:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000006c7e0a1 nid 9170@kfi7 refs 2
00000800:00000200:13.0:1773851883.137147:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 9170@kfi7(00000000fb9ea1b7):0x0 lsk 3970 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000f81 Transaction freed
00000800:00000200:21.0:1773851883.146481:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851883.146482:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851883.146483:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851883.146485:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851883.146487:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25489@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.146488:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25489@kfi7 : PUT - for me
00000400:00000200:21.0:1773851883.146489:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25489@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.146490:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000462017e9 nid 25489@kfi7 refs 1
00000400:00000200:21.0:1773851883.146491:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25489@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.146492:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000462017e9 nid 25489@kfi7 refs 2
00000400:00000200:21.0:1773851883.146492:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000462017e9 nid 25489@kfi7 refs 3
00000400:00000200:21.0:1773851883.146493:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25488@kfi7 to cpt 2
00000400:00000200:21.0:1773851883.146494:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25488@kfi7 of length 224 into portal 12 MB=0x69b4b5a32fd80
00000400:00000200:21.0:1773851883.146495:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25488@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 52144
00000800:00000200:21.0:1773851883.146497:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851883.146499:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.146500:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25489@kfi7: PUT: OK
00000100:00000001:21.0:1773851883.146501:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851883.146501:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851883.146502:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f0f1f09.
00000100:00000040:21.0:1773851883.146503:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008f0f1f09 x1859597798407552 msgsize 224
00000100:00100000:21.0:1773851883.146504:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25488@kfi7 (source: 12345-25489@kfi7)
00000100:00000001:21.0:1773851883.146505:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851883.146506:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000462017e9 nid 25489@kfi7 refs 2
00000100:00000001:20.0:1773851883.146506:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851883.146507:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851883.146507:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851883.146507:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851883.146508:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851883.146509:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851883.146510:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597798407552
00000020:00000001:20.0:1773851883.146511:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851883.146511:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e75d53
00000020:00000001:20.0:1773851883.146512:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851883.146514:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000091886f84 refcount=5
00000020:00000001:20.0:1773851883.146515:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118315326464 : -106955394225152 : ffff9eb981b86c00)
00000020:00000001:20.0:1773851883.146516:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118315326464 : -106955394225152 : ffff9eb981b86c00)
00000100:00000001:20.0:1773851883.146517:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.146517:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851883.146518:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d412f602.
00000020:00000010:20.0:1773851883.146519:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.146520:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851883.146521:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851883.146521:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851883.146522:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851883.146523:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851883.146523:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851883.146524:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.146524:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851883.146525:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851883.146526:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851883.146526:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851883.146526:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851883.146527:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25488@kfi7, seq: 1998031
00000100:00000001:23.0:1773851883.146528:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851883.146528:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.146528:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000091886f84 : new rpc_count 1
00000100:00000001:20.0:1773851883.146528:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956264960 : -106937753286656 : ffff9ebd9d33c800)
00000100:00000040:20.0:1773851883.146529:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008f0f1f09 x1859597798407552/t0(0) o400->1c571ba4-21ce-4cb4-9391-9d364d3dfdb2@25488@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2082-0'
00000100:00000001:20.0:1773851883.146532:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.146532:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851883.146533:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f0f1f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1c571ba4-21ce-4cb4-9391-9d364d3dfdb2+5:39465:x1859597798407552:12345-25488@kfi7:400:default-tuolumne2082-0
00000100:00000200:20.0:1773851883.146535:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597798407552
00000020:00000001:20.0:1773851883.146535:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851883.146536:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851883.146537:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.146538:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851883.146538:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851883.146539:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851883.146540:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597798407552, found 0 last_xid 1859597798407551
00000020:00000001:20.0:1773851883.146540:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851883.146541:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851883.146542:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851883.146542:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.146543:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851883.146543:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851883.146544:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851883.146544:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000838ba3cf.
02000000:00000001:20.0:1773851883.146545:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.146546:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.146546:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851883.146547:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106585505, transno 0, xid 1859597798407552
00010000:00000001:20.0:1773851883.146547:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851883.146548:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008f0f1f09 x1859597798407552/t0(0) o400->1c571ba4-21ce-4cb4-9391-9d364d3dfdb2@25488@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2082-0'
00010000:00000001:20.0:1773851883.146550:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851883.146551:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851883.146552:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=116 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851883.146553:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851883.146553:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f1302295 refcount 3 to 25488@kfi7
00000100:00000001:20.0:1773851883.146554:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551677088 : -107156157874528 : ffff9e8ac3463ea0)
02000000:00000001:20.0:1773851883.146555:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851883.146556:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.146556:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851883.146557:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25489@kfi7
00000400:00000010:20.0:1773851883.146558:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c6360cc6.
00000100:00000200:20.0:1773851883.146558:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597798407552, offset 224
00000400:00000200:20.0:1773851883.146560:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25489@kfi7
00000400:00000200:20.0:1773851883.146561:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25489@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.146562:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000462017e9 nid 25489@kfi7 refs 1
00000400:00000200:20.0:1773851883.146563:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000462017e9 nid 25489@kfi7 refs 2
00000400:00000200:20.0:1773851883.146564:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000462017e9 nid 25489@kfi7 refs 3
00000400:00000200:20.0:1773851883.146565:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25489@kfi7 local destination
00000400:00000200:20.0:1773851883.146566:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769751:8769751:1024:4294967295] 25489@kfi7 LPNI seq info [8568435:8568435:16:4294967295]
00000400:00000200:20.0:1773851883.146568:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000462017e9 nid 25489@kfi7 refs 2
00000400:00000200:20.0:1773851883.146569:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25489@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.146570:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25489@kfi7(25489@kfi7:25489@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851883.146571:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000462017e9 nid 25489@kfi7 refs 3
00000800:00000200:20.0:1773851883.146573:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851883.146574:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851883.146576:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851883.146578:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000860 Using peer 25489@kfi7(0x100000000000860)
00000800:00000200:20.0:1773851883.146581:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x100000000000860: rc=0
00000800:00000200:20.0:1773851883.146583:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000860 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851883.146585:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.146585:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f1302295 refcount 2 to 25488@kfi7
00010000:00000001:20.0:1773851883.146586:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851883.146586:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.146587:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851883.146588:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f0f1f09 x1859597798407552/t0(0) o400->1c571ba4-21ce-4cb4-9391-9d364d3dfdb2@25488@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2082-0'
00000100:00100000:20.0:1773851883.146591:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f0f1f09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:1c571ba4-21ce-4cb4-9391-9d364d3dfdb2+5:39465:x1859597798407552:12345-25488@kfi7:400:default-tuolumne2082-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851883.146593:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25488@kfi7, seq: 1998031
00000100:00000040:20.0:1773851883.146594:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000091886f84 : new rpc_count 0
00000100:00000001:20.0:1773851883.146595:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851883.146596:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851883.146597:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.146598:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851883.146598:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d412f602.
00000020:00000040:20.0:1773851883.146599:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000091886f84 : new refcount 4
00000100:00000001:20.0:1773851883.146600:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851883.146604:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000860 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851883.146605:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.146606:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25489@kfi7: PUT: OK
00000400:00000200:21.0:1773851883.146607:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c6360cc6
00000400:00000010:21.0:1773851883.146608:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c6360cc6.
00000100:00000001:21.0:1773851883.146608:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851883.146609:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851883.146610:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000462017e9 nid 25489@kfi7 refs 2
00000800:00000200:21.0:1773851883.146611:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25489@kfi7(00000000ec6b657c):0x0 lsk 2145 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000860 Transaction freed
00000800:00000200:5.0:1773851883.158484:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851883.158485:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851883.158486:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851883.158488:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851883.158490:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13408@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.158491:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13408@kfi7 : PUT - for me
00000400:00000200:5.0:1773851883.158492:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13408@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.158493:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0325b7b nid 13408@kfi7 refs 1
00000400:00000200:5.0:1773851883.158493:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13408@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.158494:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0325b7b nid 13408@kfi7 refs 2
00000400:00000200:5.0:1773851883.158495:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0325b7b nid 13408@kfi7 refs 3
00000400:00000200:5.0:1773851883.158495:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000400:00000200:5.0:1773851883.158496:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13409@kfi7 of length 224 into portal 12 MB=0x699e0e468aa80
00000400:00000200:5.0:1773851883.158497:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13409@kfi7 of length 224/224 into md 0x793926dc5 [64] + 153872
00000800:00000200:5.0:1773851883.158499:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851883.158500:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851883.158501:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13408@kfi7: PUT: OK
00000100:00000001:5.0:1773851883.158502:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851883.158502:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851883.158503:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000047d93a2c.
00000100:00000040:5.0:1773851883.158503:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000047d93a2c x1858041044052608 msgsize 224
00000100:00100000:5.0:1773851883.158504:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13409@kfi7 (source: 12345-13408@kfi7)
00000100:00000001:5.0:1773851883.158505:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851883.158506:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0325b7b nid 13408@kfi7 refs 2
00000100:00000001:7.0:1773851883.158507:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851883.158507:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851883.158507:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851883.158508:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851883.158508:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851883.158509:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851883.158510:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041044052608
00000020:00000001:7.0:1773851883.158510:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851883.158511:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91bde
00000020:00000001:7.0:1773851883.158513:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851883.158514:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000063bfc185 refcount=6
00000020:00000001:7.0:1773851883.158515:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628032512 : -107123081519104 : ffff9e9276c76000)
00000020:00000001:7.0:1773851883.158515:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628032512 : -107123081519104 : ffff9e9276c76000)
00000100:00000001:7.0:1773851883.158516:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851883.158517:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851883.158518:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851883.158519:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851883.158520:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851883.158521:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851883.158521:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851883.158521:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.158522:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851883.158523:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851883.158523:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.158524:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.158525:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851883.158525:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851883.158525:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851883.158526:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13409@kfi7, seq: 2001956
00000100:00000001:4.0:1773851883.158526:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851883.158527:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000063bfc185 : new rpc_count 1
00000100:00000001:4.0:1773851883.158527:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.158528:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108933888 : -106938600617728 : ffff9ebd6ab28900)
00000100:00000001:4.0:1773851883.158528:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851883.158529:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000047d93a2c x1858041044052608/t0(0) o400->fa027664-f086-4b18-b24e-0ccbf0e384dc@13409@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1328-0'
00000100:00000001:7.0:1773851883.158532:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851883.158532:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851883.158533:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000047d93a2c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fa027664-f086-4b18-b24e-0ccbf0e384dc+6:39730:x1858041044052608:12345-13409@kfi7:400:default-tuolumne1328-0
00000100:00000200:7.0:1773851883.158535:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041044052608
00000020:00000001:7.0:1773851883.158535:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851883.158536:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851883.158536:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.158537:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851883.158538:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851883.158539:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851883.158540:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041044052608, found 0 last_xid 1858041044052607
00000020:00000001:7.0:1773851883.158541:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851883.158541:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851883.158542:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851883.158542:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.158543:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851883.158544:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851883.158544:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851883.158545:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001bdd2584.
02000000:00000001:7.0:1773851883.158546:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.158546:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.158547:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851883.158548:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182685357324, transno 0, xid 1858041044052608
00010000:00000001:7.0:1773851883.158549:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851883.158550:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000047d93a2c x1858041044052608/t0(0) o400->fa027664-f086-4b18-b24e-0ccbf0e384dc@13409@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1328-0'
00010000:00000001:7.0:1773851883.158552:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851883.158553:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851883.158553:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=115 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851883.158554:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851883.158555:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003cf8d890 refcount 3 to 13409@kfi7
00000100:00000001:7.0:1773851883.158556:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517472 : -107156126034144 : ffff9e8ac52c1720)
02000000:00000001:7.0:1773851883.158557:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851883.158557:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.158558:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851883.158559:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13408@kfi7
00000400:00000010:7.0:1773851883.158559:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c188dd4f.
00000100:00000200:7.0:1773851883.158560:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041044052608, offset 224
00000400:00000200:7.0:1773851883.158561:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13408@kfi7
00000400:00000200:7.0:1773851883.158562:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13408@kfi7 to cpt 1
00000400:00000200:7.0:1773851883.158563:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0325b7b nid 13408@kfi7 refs 1
00000400:00000200:7.0:1773851883.158564:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d0325b7b nid 13408@kfi7 refs 2
00000400:00000200:7.0:1773851883.158565:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d0325b7b nid 13408@kfi7 refs 3
00000400:00000200:7.0:1773851883.158567:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13408@kfi7 local destination
00000400:00000200:7.0:1773851883.158568:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769752:8769752:1024:4294967295] 13408@kfi7 LPNI seq info [2316377:2316377:16:4294967295]
00000400:00000200:7.0:1773851883.158569:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0325b7b nid 13408@kfi7 refs 2
00000400:00000200:7.0:1773851883.158570:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13408@kfi7 to cpt 1
00000400:00000200:7.0:1773851883.158572:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13408@kfi7(13408@kfi7:13408@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851883.158573:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d0325b7b nid 13408@kfi7 refs 3
00000800:00000200:7.0:1773851883.158575:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851883.158576:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851883.158578:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851883.158580:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000022d Using peer 13408@kfi7(0x10000000000022d)
00000800:00000200:7.0:1773851883.158583:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x10000000000022d: rc=0
00000800:00000200:7.0:1773851883.158584:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000022d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851883.158586:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851883.158587:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003cf8d890 refcount 2 to 13409@kfi7
00010000:00000001:7.0:1773851883.158588:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851883.158588:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.158589:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851883.158589:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000047d93a2c x1858041044052608/t0(0) o400->fa027664-f086-4b18-b24e-0ccbf0e384dc@13409@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1328-0'
00000100:00100000:7.0:1773851883.158592:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000047d93a2c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fa027664-f086-4b18-b24e-0ccbf0e384dc+6:39730:x1858041044052608:12345-13409@kfi7:400:default-tuolumne1328-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851883.158595:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13409@kfi7, seq: 2001956
00000100:00000040:7.0:1773851883.158596:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000063bfc185 : new rpc_count 0
00000800:00000200:5.0:1773851883.158596:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000022d TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851883.158597:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851883.158597:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851883.158597:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851883.158598:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851883.158598:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000400:00000200:5.0:1773851883.158598:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13408@kfi7: PUT: OK
00000020:00000010:7.0:1773851883.158599:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000400:00000200:5.0:1773851883.158599:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c188dd4f
00000020:00000040:7.0:1773851883.158600:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000063bfc185 : new refcount 5
00000400:00000010:5.0:1773851883.158600:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c188dd4f.
00000100:00000001:5.0:1773851883.158600:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851883.158601:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851883.158601:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851883.158601:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0325b7b nid 13408@kfi7 refs 2
00000800:00000200:5.0:1773851883.158603:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 13408@kfi7(00000000f69eadaf):0x0 lsk 558 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000022d Transaction freed
00000800:00000200:17.0:1773851883.179621:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851883.179623:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851883.179625:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851883.179629:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851883.179633:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.179635:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.49@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851883.179637:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.179639:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851883.179641:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.49@o2ib60 to cpt 2
00000400:00000200:17.0:1773851883.179644:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b539fe2 nid 192.168.128.49@o2ib60 refs 2
00000400:00000200:17.0:1773851883.179646:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004b539fe2 nid 192.168.128.49@o2ib60 refs 3
00000400:00000200:17.0:1773851883.179647:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.49@o2ib60 to cpt 2
00000400:00000200:17.0:1773851883.179650:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.49@o2ib60 of length 224 into portal 12 MB=0x69a39cf0956c0
00000400:00000200:17.0:1773851883.179652:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.49@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 146656
00000800:00000200:17.0:1773851883.179656:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851883.179658:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851883.179659:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851883.179660:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851883.179661:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851883.179662:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dda98377.
00000100:00000040:17.0:1773851883.179662:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000dda98377 x1858422937573056 msgsize 224
00000100:00100000:17.0:1773851883.179665:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.49@o2ib60 (source: 12345-192.168.128.49@o2ib60)
00000100:00000001:17.0:1773851883.179667:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851883.179668:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851883.179670:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851883.179671:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851883.179671:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851883.179672:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851883.179672:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.179673:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851883.179674:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858422937573056
00000020:00000001:11.0:1773851883.179675:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851883.179675:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dde
00000020:00000001:11.0:1773851883.179676:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851883.179680:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001348d666 refcount=6
00000020:00000001:11.0:1773851883.179680:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239474176 : -107152470077440 : ffff9e8b9f159000)
00000020:00000001:11.0:1773851883.179682:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239474176 : -107152470077440 : ffff9e8b9f159000)
00000100:00000001:11.0:1773851883.179684:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851883.179685:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851883.179686:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000dad0a37.
00000020:00000010:11.0:1773851883.179687:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851883.179688:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004334b4cb.
00000100:00000001:11.0:1773851883.179689:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851883.179690:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851883.179690:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.179692:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851883.179692:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851883.179693:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.179694:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.179696:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851883.179697:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851883.179697:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851883.179697:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851883.179698:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.49@o2ib60, seq: 2130816
00000100:00000040:11.0:1773851883.179699:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001348d666 : new rpc_count 1
00000100:00000001:8.0:1773851883.179699:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.179700:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102226944 : -107041607324672 : ffff9ea56f04ec00)
00000100:00000001:8.0:1773851883.179701:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851883.179702:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dda98377 x1858422937573056/t0(0) o400->b8ed48d8-8ab0-42e9-9faf-9f998341cf32@192.168.128.49@o2ib60:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix49-0'
00000100:00000001:11.0:1773851883.179705:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851883.179705:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851883.179706:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dda98377 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b8ed48d8-8ab0-42e9-9faf-9f998341cf32+6:39783:x1858422937573056:12345-192.168.128.49@o2ib60:400:default-matrix49-0
00000100:00000200:11.0:1773851883.179708:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858422937573056
00000020:00000001:11.0:1773851883.179709:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851883.179710:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851883.179711:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.179712:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851883.179712:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851883.179713:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851883.179714:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858422937573056, found 0 last_xid 1858422937573055
00000020:00000001:11.0:1773851883.179715:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851883.179716:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851883.179717:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851883.179717:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.179718:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851883.179719:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851883.179719:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851883.179720:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009f86d943.
02000000:00000001:11.0:1773851883.179721:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.179722:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.179723:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851883.179723:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183222003376, transno 0, xid 1858422937573056
00010000:00000001:11.0:1773851883.179724:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851883.179730:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dda98377 x1858422937573056/t0(0) o400->b8ed48d8-8ab0-42e9-9faf-9f998341cf32@192.168.128.49@o2ib60:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix49-0'
00010000:00000001:11.0:1773851883.179733:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851883.179733:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851883.179734:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=116 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851883.179735:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851883.179736:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002057b60f refcount 3 to 192.168.128.49@o2ib60
00000100:00000001:11.0:1773851883.179737:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582752 : -107154806968864 : ffff9e8b13cb6de0)
02000000:00000001:11.0:1773851883.179738:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851883.179739:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.179740:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851883.179741:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.49@o2ib60
00000400:00000010:11.0:1773851883.179741:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009d07bcea.
00000100:00000200:11.0:1773851883.179742:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858422937573056, offset 224
00000400:00000200:11.0:1773851883.179744:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.49@o2ib60
00000400:00000200:11.0:1773851883.179745:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.49@o2ib60 to cpt 2
00000400:00000200:11.0:1773851883.179747:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b539fe2 nid 192.168.128.49@o2ib60 refs 2
00000400:00000200:11.0:1773851883.179748:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004b539fe2 nid 192.168.128.49@o2ib60 refs 3
00000400:00000200:11.0:1773851883.179749:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004b539fe2 nid 192.168.128.49@o2ib60 refs 4
00000400:00000200:11.0:1773851883.179751:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.49@o2ib60 routed destination
00000400:00000200:11.0:1773851883.179752:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:11.0:1773851883.179754:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:11.0:1773851883.179755:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.49@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851883.179757:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:11.0:1773851883.179758:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.49@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851883.179759:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:11.0:1773851883.179760:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769753:8769753:1024:4294967295] 17@kfi7 LPNI seq info [1250891915:1250891915:16:4294967295]
00000400:00000200:11.0:1773851883.179762:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:11.0:1773851883.179763:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:11.0:1773851883.179765:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.49@o2ib60(192.168.128.49@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851883.179767:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004b539fe2 nid 192.168.128.49@o2ib60 refs 3
00000800:00000200:11.0:1773851883.179768:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851883.179770:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851883.179772:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851883.179774:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:11.0:1773851883.179777:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:11.0:1773851883.179778:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851883.179780:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851883.179781:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002057b60f refcount 2 to 192.168.128.49@o2ib60
00010000:00000001:11.0:1773851883.179782:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851883.179783:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.179784:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851883.179785:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dda98377 x1858422937573056/t0(0) o400->b8ed48d8-8ab0-42e9-9faf-9f998341cf32@192.168.128.49@o2ib60:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix49-0'
00000100:00100000:11.0:1773851883.179788:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dda98377 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:b8ed48d8-8ab0-42e9-9faf-9f998341cf32+6:39783:x1858422937573056:12345-192.168.128.49@o2ib60:400:default-matrix49-0 Request processed in 82us (124us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851883.179791:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.49@o2ib60, seq: 2130816
00000100:00000040:11.0:1773851883.179792:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001348d666 : new rpc_count 0
00000800:00000200:10.0:1773851883.179792:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851883.179793:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851883.179793:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851883.179793:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851883.179794:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851883.179794:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004334b4cb.
00000020:00000010:11.0:1773851883.179795:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000dad0a37.
00000400:00000200:10.0:1773851883.179795:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:10.0:1773851883.179795:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009d07bcea
00000020:00000040:11.0:1773851883.179796:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000001348d666 : new refcount 5
00000400:00000010:10.0:1773851883.179796:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009d07bcea.
00000100:00000001:11.0:1773851883.179797:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851883.179797:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851883.179798:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851883.179799:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:10.0:1773851883.179800:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000800:00000200:21.0:1773851883.233966:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851883.233968:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851883.233970:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851883.233973:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851883.233976:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26497@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.233978:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26497@kfi7 : PUT - for me
00000400:00000200:21.0:1773851883.233979:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26497@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.233982:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a728309 nid 26497@kfi7 refs 1
00000400:00000200:21.0:1773851883.233984:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26497@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.233985:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a728309 nid 26497@kfi7 refs 2
00000400:00000200:21.0:1773851883.233986:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a728309 nid 26497@kfi7 refs 3
00000400:00000200:21.0:1773851883.233988:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26432@kfi7 to cpt 7
00000400:00000200:21.0:1773851883.233989:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26432@kfi7 of length 456 into portal 12 MB=0x69b4b585cf700
00000400:00000200:21.0:1773851883.233991:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26432@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 52368
00000800:00000200:21.0:1773851883.233994:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851883.233996:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.233998:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26497@kfi7: PUT: OK
00000100:00000001:21.0:1773851883.233999:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851883.234000:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851883.234001:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000018e4ffc1.
00000100:00000040:21.0:1773851883.234002:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000018e4ffc1 x1859597767603968 msgsize 456
00000100:00100000:21.0:1773851883.234005:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-26432@kfi7 (source: 12345-26497@kfi7)
00000100:00000001:21.0:1773851883.234006:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851883.234007:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a728309 nid 26497@kfi7 refs 2
00000800:00000200:21.0:1773851883.234009:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851883.234009:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851883.234009:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851883.234010:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851883.234011:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851883.234012:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851883.234013:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597767603968
00000020:00000001:20.0:1773851883.234014:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851883.234015:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74a13
00000020:00000001:20.0:1773851883.234016:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851883.234020:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bab2d1fe refcount=5
00000020:00000001:20.0:1773851883.234021:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118315328512 : -106955394223104 : ffff9eb981b87400)
00000020:00000001:20.0:1773851883.234022:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118315328512 : -106955394223104 : ffff9eb981b87400)
00000100:00000001:20.0:1773851883.234024:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.234025:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851883.234026:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d412f602.
00000020:00000010:20.0:1773851883.234028:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.234029:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851883.234030:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851883.234031:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851883.234032:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.234033:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.234035:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851883.234037:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851883.234037:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851883.234037:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851883.234038:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851883.234039:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26432@kfi7, seq: 335333148
00000100:00000040:20.0:1773851883.234040:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bab2d1fe : new rpc_count 1
00000100:00000001:23.0:1773851883.234041:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.234041:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956274176 : -106937753277440 : ffff9ebd9d33ec00)
00000100:00000001:23.0:1773851883.234042:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.234044:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000018e4ffc1 x1859597767603968/t0(0) o17->79b3382c-c76d-4cf8-bd53-f6867af98d14@26432@kfi7:671/0 lens 456/0 e 0 to 0 dl 1773852031 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2148-0'
00000100:00000001:20.0:1773851883.234049:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851883.234050:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851883.234051:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018e4ffc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:79b3382c-c76d-4cf8-bd53-f6867af98d14+5:39458:x1859597767603968:12345-26432@kfi7:17:default-tuolumne2148-0
00000100:00000200:20.0:1773851883.234053:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597767603968
00000020:00000001:20.0:1773851883.234054:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851883.234055:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851883.234056:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.234057:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851883.234058:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:20.0:1773851883.234059:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851883.234060:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597767603968, found 0 last_xid 1859597767603967
00000020:00000001:20.0:1773851883.234061:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851883.234062:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851883.234063:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851883.234064:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851883.234065:0:61145:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:20.0:1773851883.234067:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851883.234067:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851883.234070:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000fb916768.
02000000:00000001:20.0:1773851883.234070:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.234072:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.234073:0:61145:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:20.0:1773851883.234074:0:61145:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:20.0:1773851883.234075:0:61145:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:20.0:1773851883.234077:0:61145:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.234078:0:61145:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:20.0:1773851883.234080:0:61145:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 79b3382c-c76d-4cf8-bd53-f6867af98d14/00000000bab2d1fe free: 126633370845184 avail: 126633368748032
00000020:00000001:20.0:1773851883.234082:0:61145:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:20.0:1773851883.234082:0:61145:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 79b3382c-c76d-4cf8-bd53-f6867af98d14/00000000bab2d1fe avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:20.0:1773851883.234085:0:61145:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:20.0:1773851883.234087:0:61145:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:20.0:1773851883.234087:0:61145:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 79b3382c-c76d-4cf8-bd53-f6867af98d14/00000000bab2d1fe reports grant 39059456 dropped 0, local 40108032
00000020:00000001:20.0:1773851883.234089:0:61145:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:20.0:1773851883.234090:0:61145:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:20.0:1773851883.234091:0:61145:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851883.234092:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014372177, transno 0, xid 1859597767603968
00010000:00000001:20.0:1773851883.234093:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851883.234095:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000018e4ffc1 x1859597767603968/t0(0) o17->79b3382c-c76d-4cf8-bd53-f6867af98d14@26432@kfi7:671/0 lens 456/432 e 0 to 0 dl 1773852031 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2148-0'
00010000:00000001:20.0:1773851883.234099:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851883.234099:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851883.234101:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=116 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851883.234102:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851883.234103:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007df46277 refcount 3 to 26432@kfi7
00000100:00000001:20.0:1773851883.234105:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603213344 : -107155106338272 : ffff9e8b01f36a20)
02000000:00000001:20.0:1773851883.234106:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851883.234107:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851883.234108:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851883.234109:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26497@kfi7
00000400:00000010:20.0:1773851883.234110:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dac508ec.
00000100:00000200:20.0:1773851883.234111:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859597767603968, offset 224
00000400:00000200:20.0:1773851883.234113:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26497@kfi7
00000400:00000200:20.0:1773851883.234115:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26497@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.234116:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a728309 nid 26497@kfi7 refs 1
00000400:00000200:20.0:1773851883.234118:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a728309 nid 26497@kfi7 refs 2
00000400:00000200:20.0:1773851883.234120:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a728309 nid 26497@kfi7 refs 3
00000400:00000200:20.0:1773851883.234122:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26497@kfi7 local destination
00000400:00000200:20.0:1773851883.234124:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769754:8769754:1024:4294967295] 26497@kfi7 LPNI seq info [72225:72225:16:4294967295]
00000400:00000200:20.0:1773851883.234126:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a728309 nid 26497@kfi7 refs 2
00000400:00000200:20.0:1773851883.234127:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26497@kfi7 to cpt 5
00000400:00000200:20.0:1773851883.234130:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26497@kfi7(26497@kfi7:26497@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851883.234132:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a728309 nid 26497@kfi7 refs 3
00000800:00000200:20.0:1773851883.234135:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851883.234136:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:20.0:1773851883.234140:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851883.234144:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd43 Using peer 26497@kfi7(0xd43)
00000800:00000200:20.0:1773851883.234148:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 532 bytes to peer 0xd43: rc=0
00000800:00000200:20.0:1773851883.234150:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd43 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851883.234153:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851883.234154:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007df46277 refcount 2 to 26432@kfi7
00010000:00000001:20.0:1773851883.234155:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851883.234156:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851883.234159:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851883.234161:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000018e4ffc1 x1859597767603968/t0(0) o17->79b3382c-c76d-4cf8-bd53-f6867af98d14@26432@kfi7:671/0 lens 456/432 e 0 to 0 dl 1773852031 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2148-0'
00000100:00100000:20.0:1773851883.234166:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018e4ffc1 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:79b3382c-c76d-4cf8-bd53-f6867af98d14+5:39458:x1859597767603968:12345-26432@kfi7:17:default-tuolumne2148-0 Request processed in 116us (162us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851883.234170:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26432@kfi7, seq: 335333148
00000100:00000040:20.0:1773851883.234171:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bab2d1fe : new rpc_count 0
00000100:00000001:20.0:1773851883.234172:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851883.234173:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851883.234174:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851883.234175:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:20.0:1773851883.234176:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d412f602.
00000020:00000040:20.0:1773851883.234177:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000bab2d1fe : new refcount 4
00000100:00000001:20.0:1773851883.234178:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851883.234186:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd43 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851883.234189:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.234190:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26497@kfi7: PUT: OK
00000400:00000200:21.0:1773851883.234192:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dac508ec
00000400:00000010:21.0:1773851883.234192:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dac508ec.
00000100:00000001:21.0:1773851883.234193:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851883.234194:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851883.234195:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a728309 nid 26497@kfi7 refs 2
00000800:00000200:21.0:1773851883.234198:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 26497@kfi7(0000000052e3f236):0x0 lsk 3396 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xd43 Transaction freed
00000800:00000200:5.0:1773851883.249447:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851883.249449:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851883.249451:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851883.249454:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851883.249457:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10688@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.249459:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10688@kfi7 : PUT - for me
00000400:00000200:5.0:1773851883.249460:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10688@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.249461:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d6d201d nid 10688@kfi7 refs 1
00000400:00000200:5.0:1773851883.249462:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10688@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.249463:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d6d201d nid 10688@kfi7 refs 2
00000400:00000200:5.0:1773851883.249465:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005d6d201d nid 10688@kfi7 refs 3
00000400:00000200:5.0:1773851883.249466:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10688@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.249467:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10688@kfi7 of length 224 into portal 12 MB=0x69aef5c939f80
00000400:00000200:5.0:1773851883.249470:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10688@kfi7 of length 224/224 into md 0x793926dc5 [64] + 154096
00000800:00000200:5.0:1773851883.249472:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851883.249475:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851883.249476:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10688@kfi7: PUT: OK
00000100:00000001:5.0:1773851883.249478:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851883.249479:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851883.249480:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eaae0686.
00000100:00000040:5.0:1773851883.249481:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000eaae0686 x1859202701303680 msgsize 224
00000100:00100000:5.0:1773851883.249484:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10688@kfi7 (source: 12345-10688@kfi7)
00000100:00000001:5.0:1773851883.249485:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851883.249487:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005d6d201d nid 10688@kfi7 refs 2
00000100:00000001:7.0:1773851883.249488:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851883.249489:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851883.249489:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851883.249489:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851883.249490:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851883.249491:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851883.249492:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859202701303680
00000020:00000001:7.0:1773851883.249493:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851883.249494:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac923ef
00000020:00000001:7.0:1773851883.249495:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851883.249497:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003aed4794 refcount=6
00000020:00000001:7.0:1773851883.249499:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630528000 : -107123079023616 : ffff9e9276ed7400)
00000020:00000001:7.0:1773851883.249500:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630528000 : -107123079023616 : ffff9e9276ed7400)
00000100:00000001:7.0:1773851883.249501:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851883.249502:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851883.249503:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851883.249505:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851883.249506:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851883.249507:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851883.249508:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851883.249508:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.249510:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851883.249511:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851883.249511:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.249513:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.249515:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851883.249515:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851883.249515:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851883.249516:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851883.249517:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10688@kfi7, seq: 2001957
00000100:00000040:7.0:1773851883.249519:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003aed4794 : new rpc_count 1
00000100:00000001:4.0:1773851883.249519:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.249520:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108946560 : -106938600605056 : ffff9ebd6ab2ba80)
00000100:00000001:4.0:1773851883.249520:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851883.249521:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eaae0686 x1859202701303680/t0(0) o400->b2747abc-7310-4cf9-aef5-8b40453be502@10688@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1155-0'
00000100:00000001:7.0:1773851883.249527:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851883.249527:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851883.249529:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eaae0686 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:b2747abc-7310-4cf9-aef5-8b40453be502+6:39797:x1859202701303680:12345-10688@kfi7:400:default-tuolumne1155-0
00000100:00000200:7.0:1773851883.249531:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859202701303680
00000020:00000001:7.0:1773851883.249532:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851883.249532:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851883.249533:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.249535:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851883.249535:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851883.249537:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851883.249537:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859202701303680, found 0 last_xid 1859202701303679
00000020:00000001:7.0:1773851883.249539:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851883.249540:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851883.249541:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851883.249541:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.249543:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851883.249544:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851883.249544:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851883.249546:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f68bda87.
02000000:00000001:7.0:1773851883.249547:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.249548:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.249549:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851883.249550:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104682551, transno 0, xid 1859202701303680
00010000:00000001:7.0:1773851883.249551:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851883.249552:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eaae0686 x1859202701303680/t0(0) o400->b2747abc-7310-4cf9-aef5-8b40453be502@10688@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1155-0'
00010000:00000001:7.0:1773851883.249556:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851883.249557:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851883.249559:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=115 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851883.249560:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851883.249562:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001ce17024 refcount 3 to 10688@kfi7
00000100:00000001:7.0:1773851883.249563:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411328 : -107145304140288 : ffff9e8d4a351600)
02000000:00000001:7.0:1773851883.249565:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851883.249565:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.249566:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851883.249568:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10688@kfi7
00000400:00000010:7.0:1773851883.249569:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012c6c860.
00000100:00000200:7.0:1773851883.249570:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859202701303680, offset 224
00000400:00000200:7.0:1773851883.249572:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10688@kfi7
00000400:00000200:7.0:1773851883.249573:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10688@kfi7 to cpt 1
00000400:00000200:7.0:1773851883.249575:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d6d201d nid 10688@kfi7 refs 1
00000400:00000200:7.0:1773851883.249576:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005d6d201d nid 10688@kfi7 refs 2
00000400:00000200:7.0:1773851883.249578:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005d6d201d nid 10688@kfi7 refs 3
00000400:00000200:7.0:1773851883.249580:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10688@kfi7 local destination
00000400:00000200:7.0:1773851883.249582:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769755:8769755:1024:4294967295] 10688@kfi7 LPNI seq info [398265:398265:16:4294967295]
00000400:00000200:7.0:1773851883.249585:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005d6d201d nid 10688@kfi7 refs 2
00000400:00000200:7.0:1773851883.249586:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10688@kfi7 to cpt 1
00000400:00000200:7.0:1773851883.249589:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10688@kfi7(10688@kfi7:10688@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851883.249591:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005d6d201d nid 10688@kfi7 refs 3
00000800:00000200:7.0:1773851883.249593:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851883.249595:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851883.249598:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851883.249602:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x12c Using peer 10688@kfi7(0x12c)
00000800:00000200:7.0:1773851883.249606:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x12c: rc=0
00000800:00000200:7.0:1773851883.249609:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x12c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851883.249612:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851883.249613:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001ce17024 refcount 2 to 10688@kfi7
00010000:00000001:7.0:1773851883.249615:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851883.249615:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851883.249618:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851883.249619:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eaae0686 x1859202701303680/t0(0) o400->b2747abc-7310-4cf9-aef5-8b40453be502@10688@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1155-0'
00000100:00100000:7.0:1773851883.249624:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eaae0686 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:b2747abc-7310-4cf9-aef5-8b40453be502+6:39797:x1859202701303680:12345-10688@kfi7:400:default-tuolumne1155-0 Request processed in 97us (142us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851883.249624:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x12c TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851883.249626:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851883.249628:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10688@kfi7, seq: 2001957
00000400:00000200:5.0:1773851883.249628:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10688@kfi7: PUT: OK
00000100:00000040:7.0:1773851883.249629:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003aed4794 : new rpc_count 0
00000400:00000200:5.0:1773851883.249629:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012c6c860
00000400:00000010:5.0:1773851883.249630:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012c6c860.
00000100:00000001:7.0:1773851883.249631:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851883.249631:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851883.249631:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851883.249631:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851883.249632:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851883.249633:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000400:00000200:5.0:1773851883.249633:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005d6d201d nid 10688@kfi7 refs 2
00000020:00000010:7.0:1773851883.249635:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000800:00000200:5.0:1773851883.249635:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 10688@kfi7(000000008f8e5700):0x0 lsk 301 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x12c Transaction freed
00000020:00000040:7.0:1773851883.249636:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000003aed4794 : new refcount 5
00000100:00000001:7.0:1773851883.249637:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851883.275184:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851883.275185:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851883.275186:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851883.275188:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851883.275190:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13650@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.275192:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13650@kfi7 : PUT - for me
00000400:00000200:17.0:1773851883.275193:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13650@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.275194:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068263eb0 nid 13650@kfi7 refs 1
00000400:00000200:17.0:1773851883.275195:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13650@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.275195:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068263eb0 nid 13650@kfi7 refs 2
00000400:00000200:17.0:1773851883.275196:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000068263eb0 nid 13650@kfi7 refs 3
00000400:00000200:17.0:1773851883.275197:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13714@kfi7 to cpt 0
00000400:00000200:17.0:1773851883.275198:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13714@kfi7 of length 224 into portal 12 MB=0x69b4c45a05380
00000400:00000200:17.0:1773851883.275199:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13714@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 34440
00000800:00000200:17.0:1773851883.275201:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851883.275203:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851883.275204:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13650@kfi7: PUT: OK
00000100:00000001:17.0:1773851883.275205:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851883.275205:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851883.275206:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000002561eb6.
00000100:00000040:17.0:1773851883.275207:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000002561eb6 x1859601748218752 msgsize 224
00000100:00100000:17.0:1773851883.275208:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13714@kfi7 (source: 12345-13650@kfi7)
00000100:00000001:17.0:1773851883.275210:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851883.275211:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000068263eb0 nid 13650@kfi7 refs 2
00000800:00000200:17.0:1773851883.275212:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851883.275215:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851883.275215:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851883.275216:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851883.275216:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851883.275217:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851883.275218:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601748218752
00000020:00000001:17.0:1773851883.275218:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851883.275219:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff744a8
00000020:00000001:17.0:1773851883.275219:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851883.275222:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000089f2220 refcount=7
00000020:00000001:17.0:1773851883.275222:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126376828928 : -106947332722688 : ffff9ebb62393000)
00000020:00000001:17.0:1773851883.275223:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126376828928 : -106947332722688 : ffff9ebb62393000)
00000100:00000001:17.0:1773851883.275224:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851883.275225:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851883.275226:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009d196d35.
00000020:00000010:17.0:1773851883.275228:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851883.275228:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000032d56dbe.
00000100:00000001:17.0:1773851883.275229:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851883.275230:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851883.275230:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851883.275231:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851883.275232:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851883.275232:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851883.275233:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851883.275234:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851883.275234:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851883.275235:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851883.275235:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851883.275236:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13714@kfi7, seq: 2156388
00000100:00000040:17.0:1773851883.275236:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000089f2220 : new rpc_count 1
00000100:00000001:17.0:1773851883.275237:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102220032 : -107041607331584 : ffff9ea56f04d100)
00000100:00000001:16.0:1773851883.275237:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851883.275237:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851883.275238:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000002561eb6 x1859601748218752/t0(0) o400->48248bef-f322-41dc-9213-6548700ba21e@13714@kfi7:104/0 lens 224/0 e 0 to 0 dl 1773852219 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1350-0'
00000100:00000001:17.0:1773851883.275244:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851883.275244:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851883.275245:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002561eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:48248bef-f322-41dc-9213-6548700ba21e+7:39694:x1859601748218752:12345-13714@kfi7:400:default-tuolumne1350-0
00000100:00000200:17.0:1773851883.275246:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601748218752
00000020:00000001:17.0:1773851883.275247:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851883.275247:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851883.275248:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851883.275249:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851883.275249:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851883.275250:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851883.275250:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601748218752, found 0 last_xid 1859601748218751
00000020:00000001:17.0:1773851883.275251:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851883.275252:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851883.275252:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851883.275253:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851883.275254:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851883.275254:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851883.275255:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851883.275255:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e939c9c.
02000000:00000001:17.0:1773851883.275256:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851883.275256:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851883.275257:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851883.275258:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181514100899, transno 0, xid 1859601748218752
00010000:00000001:17.0:1773851883.275258:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851883.275259:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000002561eb6 x1859601748218752/t0(0) o400->48248bef-f322-41dc-9213-6548700ba21e@13714@kfi7:104/0 lens 224/224 e 0 to 0 dl 1773852219 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1350-0'
00010000:00000001:17.0:1773851883.275261:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851883.275262:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851883.275263:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=116 v=315 (315 214 1 1)
00000100:00000001:17.0:1773851883.275264:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851883.275265:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036b1be70 refcount 3 to 13714@kfi7
00000100:00000001:17.0:1773851883.275265:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051296 : -107154804500320 : ffff9e8b13f118a0)
02000000:00000001:17.0:1773851883.275267:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851883.275267:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851883.275268:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851883.275269:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13650@kfi7
00000400:00000010:17.0:1773851883.275269:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002b4feb6f.
00000100:00000200:17.0:1773851883.275270:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601748218752, offset 224
00000400:00000200:17.0:1773851883.275271:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13650@kfi7
00000400:00000200:17.0:1773851883.275272:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13650@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.275273:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068263eb0 nid 13650@kfi7 refs 1
00000400:00000200:17.0:1773851883.275274:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000068263eb0 nid 13650@kfi7 refs 2
00000400:00000200:17.0:1773851883.275275:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000068263eb0 nid 13650@kfi7 refs 3
00000400:00000200:17.0:1773851883.275276:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13650@kfi7 local destination
00000400:00000200:17.0:1773851883.275277:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769756:8769756:1024:4294967295] 13650@kfi7 LPNI seq info [1158173:1158173:16:4294967295]
00000400:00000200:17.0:1773851883.275279:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000068263eb0 nid 13650@kfi7 refs 2
00000400:00000200:17.0:1773851883.275279:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13650@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.275281:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13650@kfi7(13650@kfi7:13650@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851883.275282:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000068263eb0 nid 13650@kfi7 refs 3
00000800:00000200:17.0:1773851883.275283:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851883.275284:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851883.275286:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851883.275289:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000d39 Using peer 13650@kfi7(0x100000000000d39)
00000800:00000200:17.0:1773851883.275292:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x100000000000d39: rc=0
00000800:00000200:17.0:1773851883.275293:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000d39 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851883.275295:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851883.275296:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036b1be70 refcount 2 to 13714@kfi7
00010000:00000001:17.0:1773851883.275297:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851883.275298:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851883.275298:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851883.275299:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000002561eb6 x1859601748218752/t0(0) o400->48248bef-f322-41dc-9213-6548700ba21e@13714@kfi7:104/0 lens 224/224 e 0 to 0 dl 1773852219 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1350-0'
00000100:00100000:17.0:1773851883.275302:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002561eb6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:48248bef-f322-41dc-9213-6548700ba21e+7:39694:x1859601748218752:12345-13714@kfi7:400:default-tuolumne1350-0 Request processed in 57us (94us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851883.275304:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13714@kfi7, seq: 2156388
00000100:00000040:17.0:1773851883.275305:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000089f2220 : new rpc_count 0
00000800:00000200:18.0:1773851883.275306:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000d39 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851883.275306:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851883.275306:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:18.0:1773851883.275307:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851883.275307:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851883.275308:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13650@kfi7: PUT: OK
00000020:00000010:17.0:1773851883.275308:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000032d56dbe.
00000020:00000010:17.0:1773851883.275308:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009d196d35.
00000400:00000200:18.0:1773851883.275309:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002b4feb6f
00000400:00000010:18.0:1773851883.275309:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002b4feb6f.
00000020:00000040:17.0:1773851883.275309:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000089f2220 : new refcount 6
00000100:00000001:18.0:1773851883.275310:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851883.275310:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851883.275310:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851883.275311:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000068263eb0 nid 13650@kfi7 refs 2
00000800:00000200:18.0:1773851883.275313:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 13650@kfi7(000000001d2ba8f5):0x0 lsk 3386 rsk 22 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000d39 Transaction freed
00000800:00000200:5.0:1773851883.295776:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851883.295777:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851883.295779:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851883.295783:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851883.295786:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18529@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.295788:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18529@kfi7 : PUT - for me
00000400:00000200:5.0:1773851883.295789:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18529@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.295790:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2e36b11 nid 18529@kfi7 refs 1
00000400:00000200:5.0:1773851883.295792:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18529@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.295793:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2e36b11 nid 18529@kfi7 refs 2
00000400:00000200:5.0:1773851883.295794:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2e36b11 nid 18529@kfi7 refs 3
00000400:00000200:5.0:1773851883.295799:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18528@kfi7 to cpt 6
00000400:00000200:5.0:1773851883.295800:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18528@kfi7 of length 224 into portal 12 MB=0x69b4b8ec0cd80
00000400:00000200:5.0:1773851883.295802:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18528@kfi7 of length 224/224 into md 0x793926dc5 [64] + 154320
00000800:00000200:5.0:1773851883.295805:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851883.295808:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851883.295810:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18529@kfi7: PUT: OK
00000100:00000001:5.0:1773851883.295812:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851883.295812:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851883.295814:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c2caac8.
00000100:00000040:5.0:1773851883.295815:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000009c2caac8 x1859598680116608 msgsize 224
00000100:00100000:5.0:1773851883.295817:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-18528@kfi7 (source: 12345-18529@kfi7)
00000100:00000001:5.0:1773851883.295819:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851883.295820:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2e36b11 nid 18529@kfi7 refs 2
00000100:00000001:7.0:1773851883.295822:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851883.295823:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851883.295823:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851883.295824:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851883.295824:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851883.295826:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851883.295827:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598680116608
00000020:00000001:7.0:1773851883.295828:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851883.295829:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82a64
00000020:00000001:7.0:1773851883.295830:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851883.295832:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000562fa745 refcount=5
00000020:00000001:7.0:1773851883.295833:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637094614328320 : -106979095223296 : ffff9eb3fd07e400)
00000020:00000001:7.0:1773851883.295834:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637094614328320 : -106979095223296 : ffff9eb3fd07e400)
00000100:00000001:7.0:1773851883.295836:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851883.295838:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851883.295839:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007099dd67.
00000020:00000010:7.0:1773851883.295840:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851883.295842:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851883.295843:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851883.295844:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851883.295846:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.295847:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851883.295848:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851883.295849:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.295851:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851883.295852:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851883.295853:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851883.295853:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851883.295853:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851883.295854:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18528@kfi7, seq: 2001958
00000100:00000001:7.0:1773851883.295856:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851883.295856:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000562fa745 : new rpc_count 1
00000100:00000001:7.0:1773851883.295857:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.295857:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108958080 : -106938600593536 : ffff9ebd6ab2e780)
00000100:00000040:4.0:1773851883.295858:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c2caac8 x1859598680116608/t0(0) o400->5dcdcc66-31c6-4367-b2a6-b776cc042a37@18528@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1648-0'
00000100:00000001:4.0:1773851883.295862:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851883.295862:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851883.295863:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c2caac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5dcdcc66-31c6-4367-b2a6-b776cc042a37+5:39737:x1859598680116608:12345-18528@kfi7:400:default-tuolumne1648-0
00000100:00000200:4.0:1773851883.295865:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598680116608
00000020:00000001:4.0:1773851883.295866:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851883.295867:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851883.295867:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.295868:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851883.295869:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851883.295870:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851883.295871:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598680116608, found 0 last_xid 1859598680116607
00000020:00000001:4.0:1773851883.295872:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851883.295872:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851883.295873:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851883.295874:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.295875:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851883.295875:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851883.295876:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851883.295877:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000983d7486.
02000000:00000001:4.0:1773851883.295878:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.295881:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.295882:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851883.295883:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260700079, transno 0, xid 1859598680116608
00010000:00000001:4.0:1773851883.295884:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851883.295885:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c2caac8 x1859598680116608/t0(0) o400->5dcdcc66-31c6-4367-b2a6-b776cc042a37@18528@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1648-0'
00010000:00000001:4.0:1773851883.295888:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851883.295889:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851883.295889:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=115 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851883.295891:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851883.295892:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007903bf61 refcount 3 to 18528@kfi7
00000100:00000001:4.0:1773851883.295893:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331104 : -107155410220512 : ffff9e8aefd68a20)
02000000:00000001:4.0:1773851883.295893:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851883.295894:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.295895:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851883.295896:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18529@kfi7
00000400:00000010:4.0:1773851883.295897:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fcac908a.
00000100:00000200:4.0:1773851883.295897:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598680116608, offset 224
00000400:00000200:4.0:1773851883.295899:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18529@kfi7
00000400:00000200:4.0:1773851883.295900:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18529@kfi7 to cpt 1
00000400:00000200:4.0:1773851883.295901:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2e36b11 nid 18529@kfi7 refs 1
00000400:00000200:4.0:1773851883.295902:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2e36b11 nid 18529@kfi7 refs 2
00000400:00000200:4.0:1773851883.295903:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2e36b11 nid 18529@kfi7 refs 3
00000400:00000200:4.0:1773851883.295905:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18529@kfi7 local destination
00000400:00000200:4.0:1773851883.295906:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769757:8769757:1024:4294967295] 18529@kfi7 LPNI seq info [13170930:13170930:16:4294967295]
00000400:00000200:4.0:1773851883.295908:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2e36b11 nid 18529@kfi7 refs 2
00000400:00000200:4.0:1773851883.295909:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18529@kfi7 to cpt 1
00000400:00000200:4.0:1773851883.295911:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18529@kfi7(18529@kfi7:18529@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851883.295912:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2e36b11 nid 18529@kfi7 refs 3
00000800:00000200:4.0:1773851883.295914:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851883.295915:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851883.295920:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851883.295923:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd66 Using peer 18529@kfi7(0xd66)
00000800:00000200:4.0:1773851883.295927:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0xd66: rc=0
00000800:00000200:4.0:1773851883.295928:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd66 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851883.295930:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851883.295931:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007903bf61 refcount 2 to 18528@kfi7
00010000:00000001:4.0:1773851883.295932:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851883.295933:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.295934:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851883.295934:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c2caac8 x1859598680116608/t0(0) o400->5dcdcc66-31c6-4367-b2a6-b776cc042a37@18528@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1648-0'
00000100:00100000:4.0:1773851883.295940:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c2caac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5dcdcc66-31c6-4367-b2a6-b776cc042a37+5:39737:x1859598680116608:12345-18528@kfi7:400:default-tuolumne1648-0 Request processed in 77us (124us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851883.295943:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18528@kfi7, seq: 2001958
00000100:00000040:4.0:1773851883.295944:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000562fa745 : new rpc_count 0
00000100:00000001:4.0:1773851883.295945:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851883.295946:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851883.295947:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:4.0:1773851883.295948:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000020:00000010:4.0:1773851883.295949:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007099dd67.
00000020:00000040:4.0:1773851883.295950:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000562fa745 : new refcount 4
00000100:00000001:4.0:1773851883.295951:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851883.295956:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd66 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851883.295958:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851883.295959:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18529@kfi7: PUT: OK
00000400:00000200:5.0:1773851883.295960:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fcac908a
00000400:00000010:5.0:1773851883.295960:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fcac908a.
00000100:00000001:5.0:1773851883.295961:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851883.295962:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851883.295962:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2e36b11 nid 18529@kfi7 refs 2
00000800:00000200:5.0:1773851883.295964:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 18529@kfi7(00000000366a0b35):0x0 lsk 3431 rsk 29 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd66 Transaction freed
00000004:00000001:9.0:1773851883.337730:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851883.337731:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851883.337731:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:9.0:1773851883.337731:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:9.0:1773851883.337731:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8b299c6.
00000004:00000001:6.0:1773851883.337731:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851883.337731:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:10.0:1773851883.337732:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d72bffb1.
00000020:00000040:9.0:1773851883.337732:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000004:00000001:7.0:1773851883.337732:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851883.337732:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:5.0:1773851883.337732:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:10.0:1773851883.337733:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000100:00000001:10.0:1773851883.337733:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:9.0:1773851883.337733:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:7.0:1773851883.337733:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851883.337733:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b9a17ed.
00000100:00000010:6.0:1773851883.337733:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ae5d597.
00000100:00000010:5.0:1773851883.337733:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000adffc73b.
00000020:00000040:5.0:1773851883.337733:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
00000004:00000001:31.0:1773851883.337734:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851883.337734:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:30.0:1773851883.337734:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851883.337734:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:9.0:1773851883.337734:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:9.0:1773851883.337734:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:7.0:1773851883.337734:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851883.337734:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000100:00000001:5.0:1773851883.337734:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:31.0:1773851883.337735:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fede61b9.
00000100:00000010:30.0:1773851883.337735:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000015cb12b7.
02000000:00000001:10.0:1773851883.337735:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851883.337735:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851883.337735:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
00000100:00000001:7.0:1773851883.337735:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851883.337735:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851883.337735:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851883.337735:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851883.337735:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:31.0:1773851883.337736:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000020:00000040:30.0:1773851883.337736:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
02000000:00000010:10.0:1773851883.337736:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000068b7b641.
00000100:00000001:9.0:1773851883.337736:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851883.337736:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851883.337736:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851883.337736:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851883.337737:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851883.337737:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851883.337737:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851883.337737:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851883.337737:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:7.0:1773851883.337737:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e26c1bf7.
02000000:00000010:6.0:1773851883.337737:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a478f995.
02000000:00000010:5.0:1773851883.337737:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000100f702c.
02000000:00000001:31.0:1773851883.337738:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851883.337738:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851883.337738:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851883.337738:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337738:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851883.337738:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851883.337738:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851883.337739:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851883.337739:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851883.337739:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d72bffb1] to pc [ptlrpcd_02_01+1]  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851883.337739:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e8b299c6] to pc [ptlrpcd_02_02+2]  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851883.337739:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851883.337739:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851883.337739:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851883.337739:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:30.0:1773851883.337740:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000daa395b6.
00000100:00000040:7.0:1773851883.337740:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005b9a17ed] to pc [ptlrpcd_01_00+0]  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851883.337740:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851883.337740:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851883.337740:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000adffc73b] to pc [ptlrpcd_01_01+1]  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851883.337741:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851883.337741:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005ae5d597] to pc [ptlrpcd_01_02+2]  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851883.337742:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:31.0:1773851883.337743:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b789a785.
00000100:00000001:30.0:1773851883.337743:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851883.337744:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851883.337744:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:30.0:1773851883.337744:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000015cb12b7] to pc [ptlrpcd_07_00+0]  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851883.337744:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:9.0:1773851883.337744:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851883.337745:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337745:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851883.337745:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:10.0:1773851883.337745:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000057e04f70.
00080000:00000001:10.0:1773851883.337745:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637087551114240 : -106986158437376 : ffff9eb25807cc00)
00080000:00000010:9.0:1773851883.337745:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006c07bf65.
00080000:00000001:9.0:1773851883.337745:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636983192651776 : -107090516899840 : ffff9e9a0bc80800)
00000100:00000001:8.0:1773851883.337745:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:7.0:1773851883.337745:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851883.337745:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851883.337745:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:31.0:1773851883.337746:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fede61b9] to pc [ptlrpcd_07_01+1]  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851883.337746:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:10.0:1773851883.337746:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:9.0:1773851883.337746:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:8.0:1773851883.337746:0:41071:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:8.0:1773851883.337746:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851883.337746:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:5.0:1773851883.337746:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ed398635.
00000100:00000001:4.0:1773851883.337746:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851883.337746:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:11.0:1773851883.337747:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851883.337747:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851883.337747:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:5.0:1773851883.337747:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637102242295808 : -106971467255808 : ffff9eb5c3b17000)
00000100:00000040:4.0:1773851883.337747:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851883.337748:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851883.337748:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00080000:00000001:9.0:1773851883.337748:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:9.0:1773851883.337748:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:8.0:1773851883.337748:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851883.337748:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851883.337748:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851883.337748:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000001:30.0:1773851883.337749:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337749:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:10.0:1773851883.337749:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006f95015c.
00000004:00000010:9.0:1773851883.337749:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f3739e71.
00000100:00000001:8.0:1773851883.337749:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:7.0:1773851883.337749:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:7.0:1773851883.337749:0:41067:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:6.0:1773851883.337749:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851883.337749:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851883.337749:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00080000:00000001:31.0:1773851883.337750:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:28.0:1773851883.337750:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851883.337750:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.337750:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:10.0:1773851883.337750:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614157791025581ns, next at 614158791024499ns, rc = 0
00000004:00080000:9.0:1773851883.337750:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614157791025491ns, next at 614158791024469ns, rc = 0
00000100:00000040:8.0:1773851883.337750:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851883.337750:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851883.337750:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:5.0:1773851883.337750:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000000bfb9d2e.
00000100:00000001:4.0:1773851883.337750:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000010:31.0:1773851883.337751:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f14d9ff9.
00000100:00000001:29.0:1773851883.337751:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851883.337751:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851883.337751:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:11.0:1773851883.337751:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851883.337751:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:9.0:1773851883.337751:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:7.0:1773851883.337751:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:6.0:1773851883.337751:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:5.0:1773851883.337751:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614157791026783ns, next at 614158791025581ns, rc = 0
00080000:00000001:31.0:1773851883.337752:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636921722234880 : -107151987316736 : ffff9e8bbbdbe800)
00000100:00000001:29.0:1773851883.337752:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851883.337752:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:28.0:1773851883.337752:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:11.0:1773851883.337752:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d72bffb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051934528:37@kfi7:13:default-yuba2-0
00080000:00000001:10.0:1773851883.337752:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851883.337752:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.337752:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851883.337752:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.337752:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851883.337752:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851883.337752:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851883.337752:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:31.0:1773851883.337753:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:29.0:1773851883.337753:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851883.337753:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:10.0:1773851883.337753:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851883.337753:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.337753:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851883.337753:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851883.337753:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851883.337753:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851883.337753:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:5.0:1773851883.337753:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851883.337753:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851883.337754:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.337754:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851883.337754:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851883.337754:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851883.337754:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851883.337754:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851883.337754:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851883.337754:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005b9a17ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051934592:2074@kfi7:41:default-yuba2-0
00000004:00001000:31.0:1773851883.337755:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:28.0:1773851883.337755:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:11.0:1773851883.337755:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:11.0:1773851883.337755:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b21c4693.
00000100:00100000:8.0:1773851883.337755:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e8b299c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051934464:2060@kfi7:13:default-yuba2-0
02000000:00000001:6.0:1773851883.337755:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:4.0:1773851883.337755:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000010:31.0:1773851883.337756:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000093b5d959.
00000100:00000001:29.0:1773851883.337756:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851883.337756:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851883.337756:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.337756:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.337756:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851883.337756:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851883.337756:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851883.337756:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851883.337756:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851883.337756:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00080000:31.0:1773851883.337757:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614157791032374ns, next at 614158791031121ns, rc = 0
02000000:00000001:29.0:1773851883.337757:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851883.337757:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851883.337757:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851883.337757:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000010:11.0:1773851883.337757:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
02000000:00000001:8.0:1773851883.337757:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337757:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851883.337757:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851883.337757:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000adffc73b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051934656:2061@kfi7:13:default-yuba2-0
02000000:00000001:4.0:1773851883.337757:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851883.337757:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:31.0:1773851883.337758:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:29.0:1773851883.337758:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851883.337758:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000015cb12b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051934784:13@kfi7:41:default-yuba2-0
00000400:00000010:11.0:1773851883.337758:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000fb1e983.
00000100:00000001:9.0:1773851883.337758:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851883.337758:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851883.337758:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:7.0:1773851883.337758:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:6.0:1773851883.337758:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:4.0:1773851883.337758:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000084a5b49f.
00080000:00000001:31.0:1773851883.337759:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.337759:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fede61b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051934848:60@kfi7:13:default-yuba2-0
00000100:00000200:11.0:1773851883.337759:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934528, portal 4
02000000:00000010:8.0:1773851883.337759:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000023401374.
02000000:00000001:8.0:1773851883.337759:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851883.337759:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851883.337759:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851883.337759:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851883.337760:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.337760:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:28.0:1773851883.337760:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851883.337760:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:11.0:1773851883.337760:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851883.337760:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087757568 : -106944621794048 : ffff9ebc03cead00)
00000400:00000200:8.0:1773851883.337760:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
02000000:00000001:7.0:1773851883.337760:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851883.337760:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:4.0:1773851883.337760:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
02000000:00000001:29.0:1773851883.337761:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851883.337761:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851883.337761:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851883.337761:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:9.0:1773851883.337761:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:8.0:1773851883.337761:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00100000:7.0:1773851883.337761:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ae5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051934720:36@kfi7:13:default-yuba2-0
02000000:00000010:6.0:1773851883.337761:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000050743369.
00000400:00000010:4.0:1773851883.337761:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
02000000:00000001:29.0:1773851883.337762:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:29.0:1773851883.337762:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000860b557b.
02000000:00000010:28.0:1773851883.337762:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000481ea804.
00000100:00000040:11.0:1773851883.337762:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851883.337762:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851883.337762:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054a4b090.
00000100:00000001:7.0:1773851883.337762:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851883.337762:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851883.337762:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851883.337762:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007836e8de.
02000000:00000001:29.0:1773851883.337763:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851883.337763:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851883.337763:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934464, portal 4
02000000:00000001:7.0:1773851883.337763:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851883.337763:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:6.0:1773851883.337763:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000010:6.0:1773851883.337763:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000200:4.0:1773851883.337763:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934592, portal 4
00000400:00000200:29.0:1773851883.337764:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:11.0:1773851883.337764:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851883.337764:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851883.337764:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637102162648960 : -106971546902656 : ffff9eb5bef21f80)
00000400:00000010:6.0:1773851883.337764:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009b8a7556.
00000100:00000001:4.0:1773851883.337764:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:29.0:1773851883.337765:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000008c4dba48.
00000400:00000200:28.0:1773851883.337765:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000040:11.0:1773851883.337765:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000100:00000040:8.0:1773851883.337765:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:7.0:1773851883.337765:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000067b7447a.
02000000:00000001:7.0:1773851883.337765:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851883.337765:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934656, portal 4
00000100:00000001:4.0:1773851883.337765:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309133952 : -106994400417664 : ffff9eb06cc52880)
00000400:00000010:29.0:1773851883.337766:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f75d3df.
00000400:00000010:28.0:1773851883.337766:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000010:11.0:1773851883.337766:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a08630ef.
00000400:00000200:7.0:1773851883.337766:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:6.0:1773851883.337766:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851883.337766:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637135108954624 : -106938600596992 : ffff9ebd6ab2da00)
00000100:00000040:4.0:1773851883.337766:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851883.337767:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934848, portal 4
00000400:00000010:28.0:1773851883.337767:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000063d86a5d.
00000100:00000200:11.0:1773851883.337767:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934528, offset 0
00000400:00000010:7.0:1773851883.337767:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000100:00000001:29.0:1773851883.337768:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851883.337768:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999080832 : -107038710470784 : ffff9ea61baf6780)
00000100:00000200:28.0:1773851883.337768:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934784, portal 4
00000100:00000001:28.0:1773851883.337768:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:11.0:1773851883.337768:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000100:00000001:8.0:1773851883.337768:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851883.337768:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:7.0:1773851883.337768:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000084a606f7.
00000100:00000040:6.0:1773851883.337768:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851883.337769:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411254912 : -106960298296704 : ffff9eb85d6a3a80)
00000400:00000200:11.0:1773851883.337769:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000010:8.0:1773851883.337769:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1f08bfb.
00000100:00000200:8.0:1773851883.337769:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934464, offset 0
00000100:00000200:7.0:1773851883.337769:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934720, portal 4
00000100:00000001:4.0:1773851883.337769:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.337770:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851883.337770:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000001:7.0:1773851883.337770:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851883.337770:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814073856 : -107101895477760 : ffff9e976590b600)
00000100:00000001:6.0:1773851883.337770:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851883.337770:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:4.0:1773851883.337770:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071e50439.
00000100:00000040:28.0:1773851883.337771:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851883.337771:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:8.0:1773851883.337771:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000100:00000040:7.0:1773851883.337771:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851883.337771:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000100:00000200:4.0:1773851883.337771:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051934592, offset 0
00000400:00000200:11.0:1773851883.337772:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000010:6.0:1773851883.337772:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b4270b1f.
00000100:00000001:29.0:1773851883.337773:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:6.0:1773851883.337773:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934656, offset 0
00000400:00000200:4.0:1773851883.337773:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:4.0:1773851883.337773:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:28.0:1773851883.337774:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:11.0:1773851883.337774:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000100:00000001:7.0:1773851883.337774:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851883.337774:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000100:00000040:29.0:1773851883.337775:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000100:00000040:28.0:1773851883.337775:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000100:00000040:7.0:1773851883.337775:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000200:6.0:1773851883.337775:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:4.0:1773851883.337775:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000010:29.0:1773851883.337776:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006d9d8384.
00000400:00000010:28.0:1773851883.337776:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091f735e9.
00000400:00000200:11.0:1773851883.337776:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769757, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769756, p:4294967295, g:4294967295, h:1000]
00000400:00000010:7.0:1773851883.337776:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a1436362.
00000100:00000200:29.0:1773851883.337777:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934848, offset 0
00000100:00000200:28.0:1773851883.337777:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051934784, offset 0
00000100:00000200:7.0:1773851883.337777:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934720, offset 0
00000400:00000200:4.0:1773851883.337777:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:11.0:1773851883.337778:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851883.337778:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851883.337779:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:11.0:1773851883.337779:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851883.337779:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000200:7.0:1773851883.337779:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:4.0:1773851883.337780:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769757, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769756, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851883.337781:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:28.0:1773851883.337781:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:11.0:1773851883.337781:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769758:8769758:1024:4294967295] 37@kfi7 LPNI seq info [5403397:5403397:16:4294967295]
00000400:00000200:28.0:1773851883.337782:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:4.0:1773851883.337782:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851883.337783:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:11.0:1773851883.337783:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:4.0:1773851883.337783:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000400:00000200:11.0:1773851883.337784:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:4.0:1773851883.337784:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851883.337785:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:8.0:1773851883.337785:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:8.0:1773851883.337786:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:4.0:1773851883.337786:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425172, 23425171]
00000400:00000200:28.0:1773851883.337787:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:8.0:1773851883.337787:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:8.0:1773851883.337788:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:4.0:1773851883.337788:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000400:00000200:28.0:1773851883.337789:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769757, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769758, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851883.337789:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000200:4.0:1773851883.337789:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769759:8769759:1024:4294967295] 2081@kfi7 LPNI seq info [23425173:23425173:16:4294967295]
00000400:00000200:28.0:1773851883.337791:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851883.337791:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769759, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769758, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851883.337791:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:28.0:1773851883.337792:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851883.337792:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851883.337792:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:28.0:1773851883.337793:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851883.337793:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851883.337793:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:28.0:1773851883.337794:0:41088:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133319, 23133321]
00000400:00000200:8.0:1773851883.337794:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000400:00000200:6.0:1773851883.337794:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:8.0:1773851883.337795:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769760:8769760:1024:4294967295] 2060@kfi7 LPNI seq info [5404997:5404997:16:4294967295]
00000400:00000200:6.0:1773851883.337795:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:4.0:1773851883.337795:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851883.337796:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 30@kfi7
00000400:00000200:4.0:1773851883.337796:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851883.337797:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769761:8769761:1024:4294967295] 30@kfi7 LPNI seq info [23133322:23133322:16:4294967295]
00000400:00000200:8.0:1773851883.337797:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:6.0:1773851883.337797:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:8.0:1773851883.337798:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:6.0:1773851883.337798:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000800:00000200:4.0:1773851883.337798:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:28.0:1773851883.337799:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000800:00000200:4.0:1773851883.337799:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851883.337800:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851883.337800:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769759, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769761, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851883.337801:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:8.0:1773851883.337801:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851883.337802:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:6.0:1773851883.337802:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:4.0:1773851883.337802:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851883.337803:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:6.0:1773851883.337803:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851883.337804:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:8.0:1773851883.337804:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:6.0:1773851883.337804:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000800:00000200:4.0:1773851883.337804:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Using peer 2081@kfi7(0x270)
00000400:00000200:29.0:1773851883.337805:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000800:00000200:8.0:1773851883.337805:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851883.337805:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769762:8769762:1023:4294967295] 2061@kfi7 LPNI seq info [5403463:5403463:16:4294967295]
00000400:00000200:29.0:1773851883.337806:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000800:00000200:8.0:1773851883.337807:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851883.337807:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:4.0:1773851883.337807:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x270: rc=0
00000400:00000200:29.0:1773851883.337808:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769762, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769761, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851883.337808:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:7.0:1773851883.337809:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:4.0:1773851883.337809:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851883.337810:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:8.0:1773851883.337810:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Using peer 2060@kfi7(0x2000000000001c1)
00000400:00000200:7.0:1773851883.337810:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000100:00000001:4.0:1773851883.337810:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851883.337811:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851883.337811:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:4.0:1773851883.337811:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851883.337812:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:7.0:1773851883.337812:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:4.0:1773851883.337812:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851883.337813:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769763:8769763:1023:4294967295] 60@kfi7 LPNI seq info [5404311:5404311:16:4294967295]
00000800:00000200:8.0:1773851883.337813:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x2000000000001c1: rc=0
00000400:00000200:7.0:1773851883.337813:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000100:00000001:4.0:1773851883.337813:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851883.337814:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:8.0:1773851883.337814:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851883.337815:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:7.0:1773851883.337815:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769762, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769763, p:4294967295, g:4294967295, h:1000]
00000100:00000001:4.0:1773851883.337815:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851883.337816:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.337816:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851883.337816:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851883.337817:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851883.337817:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851883.337817:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:4.0:1773851883.337817:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851883.337817:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851883.337818:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851883.337818:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851883.337818:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851883.337819:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:11.0:1773851883.337819:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851883.337819:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851883.337819:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000400:00000200:11.0:1773851883.337820:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:7.0:1773851883.337820:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769764:8769764:1023:4294967295] 36@kfi7 LPNI seq info [5403970:5403970:16:4294967295]
00000800:00000200:29.0:1773851883.337821:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:7.0:1773851883.337821:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:11.0:1773851883.337822:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:5.0:1773851883.337822:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851883.337822:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851883.337823:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851883.337823:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:4.0:1773851883.337823:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851883.337824:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851883.337824:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851883.337824:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:28.0:1773851883.337825:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 30@kfi7(13@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851883.337825:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000800:00000200:29.0:1773851883.337826:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851883.337826:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_EVENT_TX_OK event status 0
00000400:00000200:7.0:1773851883.337826:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851883.337826:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:5.0:1773851883.337826:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071e50439
00000400:00000010:5.0:1773851883.337826:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071e50439.
00000100:00000001:5.0:1773851883.337826:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:28.0:1773851883.337827:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:11.0:1773851883.337827:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851883.337827:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000200:5.0:1773851883.337827:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851883.337828:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Using peer 60@kfi7(0x2000000000001dc)
00000400:00000200:9.0:1773851883.337828:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851883.337828:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:28.0:1773851883.337829:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:6.0:1773851883.337829:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851883.337830:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Using peer 37@kfi7(0x2000000000001a4)
00000400:00000200:9.0:1773851883.337830:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000400:00000200:9.0:1773851883.337830:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1f08bfb
00000800:00000200:7.0:1773851883.337830:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:5.0:1773851883.337830:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:28.0:1773851883.337831:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:9.0:1773851883.337831:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1f08bfb.
00000800:00000200:7.0:1773851883.337831:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851883.337831:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000040:5.0:1773851883.337831:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851883.337832:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x2000000000001dc: rc=0
00000100:00000001:9.0:1773851883.337832:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851883.337832:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851883.337833:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851883.337833:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x2000000000001a4: rc=0
00000100:00000001:5.0:1773851883.337833:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851883.337833:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851883.337834:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851883.337834:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851883.337834:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000800:00000200:11.0:1773851883.337835:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851883.337835:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851883.337835:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:28.0:1773851883.337836:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000100:00000040:9.0:1773851883.337836:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851883.337836:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Transaction freed
00000100:00000001:11.0:1773851883.337837:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337837:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:7.0:1773851883.337837:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b Using peer 36@kfi7(0x21b)
00000800:00000200:6.0:1773851883.337837:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000001aa19562: Posted send of 324 bytes to peer 0x19b: rc=0
00000100:00000001:11.0:1773851883.337838:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851883.337838:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337839:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337839:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851883.337839:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:6.0:1773851883.337839:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851883.337840:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:9.0:1773851883.337840:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:7.0:1773851883.337840:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x21b: rc=0
00000800:00000200:28.0:1773851883.337841:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x2000000000000fe: rc=0
00000100:00000001:11.0:1773851883.337841:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:11.0:1773851883.337841:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:7.0:1773851883.337841:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851883.337841:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851883.337841:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851883.337842:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851883.337842:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851883.337842:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851883.337843:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851883.337843:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851883.337843:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Transaction freed
00000100:00000001:7.0:1773851883.337843:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337843:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851883.337843:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337844:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851883.337844:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851883.337845:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337845:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337845:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851883.337845:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851883.337845:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:28.0:1773851883.337846:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851883.337846:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851883.337846:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851883.337846:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851883.337846:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851883.337846:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851883.337847:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851883.337847:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851883.337848:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.337848:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851883.337848:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:7.0:1773851883.337848:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851883.337848:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.337849:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.337849:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851883.337849:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:11.0:1773851883.337849:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.337850:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851883.337850:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:28.0:1773851883.337850:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:11.0:1773851883.337850:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a08630ef
00000400:00000010:11.0:1773851883.337850:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a08630ef.
00000400:00000200:7.0:1773851883.337850:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851883.337851:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851883.337851:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:11.0:1773851883.337851:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:7.0:1773851883.337851:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.337852:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851883.337852:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851883.337852:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:11.0:1773851883.337852:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851883.337852:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b4270b1f
00000100:00000001:29.0:1773851883.337853:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.337853:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851883.337853:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b4270b1f.
00000100:00000001:7.0:1773851883.337853:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:11.0:1773851883.337854:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:7.0:1773851883.337854:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851883.337855:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000100:00000040:11.0:1773851883.337855:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851883.337857:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337857:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337857:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:5.0:1773851883.337857:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b TN_EVENT_TX_OK event status 0
00000800:00000200:31.0:1773851883.337858:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851883.337858:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851883.337858:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337858:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:7.0:1773851883.337858:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851883.337858:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851883.337859:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:11.0:1773851883.337859:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:5.0:1773851883.337859:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->36@kfi7: PUT: OK
00000400:00000200:31.0:1773851883.337860:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851883.337860:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851883.337860:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851883.337860:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000100:00000001:7.0:1773851883.337860:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851883.337860:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a1436362
00000400:00000200:31.0:1773851883.337861:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000400:00000200:30.0:1773851883.337861:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000800:00000200:17.0:1773851883.337861:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851883.337861:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Transaction freed
00000100:00000001:7.0:1773851883.337861:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:5.0:1773851883.337861:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a1436362.
00000100:00000001:5.0:1773851883.337861:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:30.0:1773851883.337862:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006d9d8384
00000800:00000200:21.0:1773851883.337862:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851883.337862:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:5.0:1773851883.337862:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851883.337863:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091f735e9
00000400:00000010:31.0:1773851883.337863:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091f735e9.
00000400:00000010:30.0:1773851883.337863:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006d9d8384.
00000100:00000001:30.0:1773851883.337863:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:7.0:1773851883.337863:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:31.0:1773851883.337864:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851883.337864:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851883.337864:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000800:00000200:7.0:1773851883.337864:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000100:00000001:5.0:1773851883.337864:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:31.0:1773851883.337865:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851883.337865:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000800:00000200:17.0:1773851883.337865:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:5.0:1773851883.337865:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851883.337867:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.337867:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:17.0:1773851883.337867:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:5.0:1773851883.337867:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851883.337867:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851883.337868:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851883.337868:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:17.0:1773851883.337868:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2060@kfi7 : PUT - for me
00000100:00000040:31.0:1773851883.337869:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851883.337869:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851883.337869:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.337869:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:5.0:1773851883.337869:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:21.0:1773851883.337870:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:17.0:1773851883.337870:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:31.0:1773851883.337871:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.337871:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851883.337871:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000800:00000200:5.0:1773851883.337871:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x21b Transaction freed
00000100:00000001:31.0:1773851883.337872:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:30.0:1773851883.337872:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851883.337872:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:31.0:1773851883.337873:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:30.0:1773851883.337873:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:21.0:1773851883.337873:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4f80
00000400:00000200:17.0:1773851883.337873:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.337873:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:17.0:1773851883.337874:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:31.0:1773851883.337875:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe Transaction freed
00000800:00000200:30.0:1773851883.337875:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Transaction freed
00000400:00000200:21.0:1773851883.337875:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851883.337876:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x7800813dd [1] + 224
00000400:00000200:17.0:1773851883.337876:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851883.337877:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4f00
00000400:00000200:17.0:1773851883.337878:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:21.0:1773851883.337880:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851883.337881:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.337882:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000400:00000200:17.0:1773851883.337882:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f1b31 [1] + 224
00000100:00000001:21.0:1773851883.337884:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:17.0:1773851883.337884:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851883.337885:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000200:21.0:1773851883.337885:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851883.337886:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:22.0:1773851883.337886:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851883.337886:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:29.0:1773851883.337887:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851883.337887:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000400:00000200:17.0:1773851883.337887:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000800:00000200:29.0:1773851883.337888:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851883.337888:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:21.0:1773851883.337888:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:18.0:1773851883.337888:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:17.0:1773851883.337888:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:5.0:1773851883.337888:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000200:17.0:1773851883.337889:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851883.337889:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851883.337890:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:18.0:1773851883.337890:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851883.337891:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851883.337891:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851883.337892:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:22.0:1773851883.337892:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:21.0:1773851883.337892:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:17.0:1773851883.337892:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851883.337893:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851883.337893:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851883.337893:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 60@kfi7 : PUT - for me
00000400:00000200:21.0:1773851883.337893:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:18.0:1773851883.337893:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851883.337893:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:4.0:1773851883.337893:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:22.0:1773851883.337894:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:21.0:1773851883.337894:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851883.337894:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:30.0:1773851883.337895:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851883.337895:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:18.0:1773851883.337895:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:5.0:1773851883.337895:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000001:4.0:1773851883.337895:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:29.0:1773851883.337896:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000400:00000200:22.0:1773851883.337896:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000001:4.0:1773851883.337896:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851883.337896:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:29.0:1773851883.337897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851883.337897:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:18.0:1773851883.337897:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 36@kfi7 : PUT - for me
00000100:00000001:17.0:1773851883.337897:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851883.337897:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000800:00000200:30.0:1773851883.337898:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851883.337898:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:5.0:1773851883.337898:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:4.0:1773851883.337898:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007836e8de
00000400:00000010:4.0:1773851883.337898:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007836e8de.
00000400:00000200:29.0:1773851883.337899:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:22.0:1773851883.337899:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:17.0:1773851883.337899:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:8.0:1773851883.337899:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851883.337899:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000100:00000001:4.0:1773851883.337899:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:22.0:1773851883.337900:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5080
00000400:00000200:18.0:1773851883.337900:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:17.0:1773851883.337900:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851883.337900:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:4.0:1773851883.337900:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851883.337901:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851883.337901:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851883.337901:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000001:8.0:1773851883.337901:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851883.337901:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851883.337901:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:29.0:1773851883.337902:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:18.0:1773851883.337902:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:8.0:1773851883.337902:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:5.0:1773851883.337902:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:29.0:1773851883.337903:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:22.0:1773851883.337903:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d1675 [1] + 224
00000400:00000200:18.0:1773851883.337903:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:8.0:1773851883.337903:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054a4b090
00000400:00000010:8.0:1773851883.337903:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054a4b090.
00000400:00000200:5.0:1773851883.337903:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000100:00000200:4.0:1773851883.337903:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:22.0:1773851883.337904:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851883.337904:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:8.0:1773851883.337904:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851883.337905:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000200:8.0:1773851883.337905:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851883.337905:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:30.0:1773851883.337906:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 37@kfi7 : PUT - for me
00000400:00000200:29.0:1773851883.337906:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851883.337906:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851883.337906:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:5.0:1773851883.337906:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5040
00000100:00000001:4.0:1773851883.337906:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851883.337906:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851883.337907:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4fc0
00000400:00000200:22.0:1773851883.337907:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000400:00000200:18.0:1773851883.337907:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5000
00000100:00000001:4.0:1773851883.337907:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851883.337907:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:30.0:1773851883.337908:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:22.0:1773851883.337908:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:18.0:1773851883.337908:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000200:8.0:1773851883.337908:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851883.337908:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:4.0:1773851883.337908:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851883.337908:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:22.0:1773851883.337909:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851883.337909:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d1695 [1] + 224
02000000:00000001:4.0:1773851883.337909:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851883.337910:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f1b51 [1] + 224
00000100:00000001:8.0:1773851883.337910:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851883.337910:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:4.0:1773851883.337910:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=116 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851883.337911:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851883.337911:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000800:00000200:5.0:1773851883.337911:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:4.0:1773851883.337911:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=116 v=66 (1 1 1 1)
00000100:00000040:22.0:1773851883.337912:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851883.337912:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851883.337912:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.337912:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851883.337912:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851883.337913:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:8.0:1773851883.337913:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851883.337913:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=116 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851883.337913:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:4.0:1773851883.337913:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:18.0:1773851883.337914:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00001000:8.0:1773851883.337914:0:41071:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=116 v=66 (1 1 1 1)
00000400:00000200:5.0:1773851883.337914:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00010000:00000001:4.0:1773851883.337914:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.337914:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:8.0:1773851883.337915:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851883.337915:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:4.0:1773851883.337915:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00000001:4.0:1773851883.337915:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:22.0:1773851883.337916:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:18.0:1773851883.337916:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->36@kfi7: PUT: OK
00000100:00000001:8.0:1773851883.337916:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851883.337916:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:5.0:1773851883.337916:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851883.337916:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851883.337917:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:18.0:1773851883.337917:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:8.0:1773851883.337917:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.337917:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851883.337917:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:18.0:1773851883.337918:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851883.337918:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000001:8.0:1773851883.337918:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:5.0:1773851883.337918:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851883.337919:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851883.337919:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:22.0:1773851883.337919:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851883.337919:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.337919:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000001:31.0:1773851883.337920:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:30.0:1773851883.337920:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000040:8.0:1773851883.337920:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851883.337920:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851883.337920:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:31.0:1773851883.337921:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:30.0:1773851883.337921:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000040:18.0:1773851883.337921:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:4.0:1773851883.337921:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000010:31.0:1773851883.337922:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000008c4dba48.
00000400:00000200:31.0:1773851883.337922:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f75d3df
00000400:00000200:30.0:1773851883.337922:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:8.0:1773851883.337922:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851883.337922:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851883.337922:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000020:4.0:1773851883.337922:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223680 blocks, 31250856608 free, 31250825952 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121349 files, 2868730977 free files
00000400:00000010:31.0:1773851883.337923:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f75d3df.
00000100:00000001:31.0:1773851883.337923:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851883.337923:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:8.0:1773851883.337923:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851883.337923:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000001:4.0:1773851883.337923:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851883.337924:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:28.0:1773851883.337924:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851883.337924:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000040:8.0:1773851883.337924:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851883.337924:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504310272 avail=351502173184 avail_mb=1373055364 hwm_mb=3131103 files=372056150 ffree=343265928 state=0: rc = 0
00000400:00000200:5.0:1773851883.337924:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000040:4.0:1773851883.337924:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:31.0:1773851883.337925:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851883.337925:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000001:28.0:1773851883.337925:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:18.0:1773851883.337925:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:5.0:1773851883.337925:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000200:30.0:1773851883.337926:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b4f40
00000400:00000200:29.0:1773851883.337926:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x7800813fd [1] + 224
00000400:00000001:28.0:1773851883.337926:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:28.0:1773851883.337926:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000200:18.0:1773851883.337926:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000004:00000020:8.0:1773851883.337926:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504310272 free, 351502173184 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056150 files, 343265928 free files
00000400:00000200:30.0:1773851883.337927:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:28.0:1773851883.337927:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000063d86a5d
00000100:00000001:7.0:1773851883.337927:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:31.0:1773851883.337928:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851883.337928:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:28.0:1773851883.337928:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000063d86a5d.
00000100:00000001:28.0:1773851883.337928:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:18.0:1773851883.337928:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 36@kfi7(000000009b76ec2d):0x0 lsk 540 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000004:00000001:8.0:1773851883.337928:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337928:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851883.337929:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x7800813bd [1] + 224
00000100:00000200:28.0:1773851883.337929:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851883.337929:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:7.0:1773851883.337929:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851883.337929:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851883.337930:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851883.337930:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:7.0:1773851883.337930:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000100:00100000:4.0:1773851883.337930:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005b9a17ed pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051934592:2074@kfi7:41:default-yuba2-0
00000100:00000001:31.0:1773851883.337931:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851883.337931:0:41089:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:30.0:1773851883.337931:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851883.337931:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000100:00100000:8.0:1773851883.337931:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e8b299c6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051934464:2060@kfi7:13:default-yuba2-0
00000400:00000200:7.0:1773851883.337931:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000084a606f7
02000000:00000001:31.0:1773851883.337932:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851883.337932:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:30.0:1773851883.337932:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:28.0:1773851883.337932:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:7.0:1773851883.337932:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000084a606f7.
00000100:00000001:7.0:1773851883.337932:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:4.0:1773851883.337932:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851883.337933:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.337933:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851883.337933:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851883.337933:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:7.0:1773851883.337933:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851883.337933:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851883.337933:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005b9a17ed x1859433051934592/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851883.337934:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851883.337934:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000100:00000200:29.0:1773851883.337934:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851883.337934:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851883.337934:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:8.0:1773851883.337934:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e8b299c6 x1859433051934464/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:31.0:1773851883.337935:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=116 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851883.337935:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851883.337935:0:41088:0:(client.c:1428:after_reply()) Process entered
00000100:00001000:31.0:1773851883.337936:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=116 v=66 (1 1 1 1)
02000000:00000001:28.0:1773851883.337936:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851883.337936:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851883.337936:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:7.0:1773851883.337936:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851883.337936:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:31.0:1773851883.337937:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:30.0:1773851883.337937:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851883.337937:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851883.337937:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851883.337937:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:4.0:1773851883.337937:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:31.0:1773851883.337938:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851883.337938:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:29.0:1773851883.337938:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:28.0:1773851883.337938:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=116 v=66 (66 66 66 66)
02000000:00000010:8.0:1773851883.337938:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000023401374.
02000000:00000010:4.0:1773851883.337938:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000084a5b49f.
00010000:00000001:31.0:1773851883.337939:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851883.337939:0:41088:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=116 v=66 (1 1 1 1)
02000000:00000001:8.0:1773851883.337939:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:7.0:1773851883.337939:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851883.337939:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851883.337939:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:31.0:1773851883.337940:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851883.337940:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000100:00000040:30.0:1773851883.337940:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851883.337940:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000020:00000001:8.0:1773851883.337940:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851883.337940:0:41071:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000100:00000001:7.0:1773851883.337940:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851883.337940:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000020:00000001:4.0:1773851883.337940:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851883.337940:0:41064:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000001:31.0:1773851883.337941:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851883.337941:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851883.337941:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851883.337941:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000020:00000001:8.0:1773851883.337941:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851883.337941:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851883.337941:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.337941:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:31.0:1773851883.337942:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851883.337942:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:28.0:1773851883.337942:0:41088:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851883.337942:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
02000000:00000001:7.0:1773851883.337942:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851883.337942:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e26c1bf7.
00000100:00000001:30.0:1773851883.337943:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851883.337943:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:28.0:1773851883.337943:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851883.337943:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
02000000:00000001:8.0:1773851883.337943:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:7.0:1773851883.337943:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=116 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851883.337943:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:4.0:1773851883.337943:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851883.337943:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000400:00000200:30.0:1773851883.337944:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:28.0:1773851883.337944:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851883.337944:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851883.337944:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851883.337944:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e8b299c6.
00000100:00001000:7.0:1773851883.337944:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=116 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851883.337944:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000010:4.0:1773851883.337944:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b9a17ed.
00000100:00000001:31.0:1773851883.337945:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851883.337945:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000040:28.0:1773851883.337945:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851883.337945:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851883.337945:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.337945:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851883.337945:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851883.337946:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851883.337946:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851883.337946:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851883.337946:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851883.337946:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851883.337946:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.337946:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851883.337946:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:4.0:1773851883.337946:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851883.337946:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851883.337947:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851883.337947:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000001:11.0:1773851883.337947:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851883.337947:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851883.337947:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851883.337947:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.337947:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000040:31.0:1773851883.337948:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851883.337948:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351179264 avail=351348417536 avail_mb=1372454756 hwm_mb=3131103 files=372083978 ffree=343116386 state=0: rc = 0
00000100:00000001:28.0:1773851883.337948:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000001:11.0:1773851883.337948:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851883.337948:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851883.337948:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337948:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851883.337948:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:4.0:1773851883.337948:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.337948:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851883.337949:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:11.0:1773851883.337949:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000200:11.0:1773851883.337949:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000fb1e983
00000100:00000001:7.0:1773851883.337949:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851883.337949:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.337949:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:31.0:1773851883.337950:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351179264 free, 351348417536 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372083978 files, 343116386 free files
00000004:00000001:28.0:1773851883.337950:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000010:11.0:1773851883.337950:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000fb1e983.
00000100:00000040:7.0:1773851883.337950:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:28.0:1773851883.337951:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097216 blocks, 31192444256 free, 31192388064 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238742 files, 2962368363 free files
00000100:00000001:11.0:1773851883.337951:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:6.0:1773851883.337951:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000004:00000001:31.0:1773851883.337952:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851883.337952:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851883.337952:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:6.0:1773851883.337952:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:31.0:1773851883.337953:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851883.337953:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851883.337953:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:6.0:1773851883.337953:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851883.337953:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009b8a7556
00000100:00000001:7.0:1773851883.337954:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000010:6.0:1773851883.337954:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009b8a7556.
00000100:00000200:11.0:1773851883.337955:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851883.337955:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851883.337955:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:6.0:1773851883.337955:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00100000:31.0:1773851883.337956:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fede61b9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051934848:60@kfi7:13:default-yuba2-0
00000100:00100000:28.0:1773851883.337956:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000015cb12b7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051934784:13@kfi7:41:default-yuba2-0
00000004:00000040:7.0:1773851883.337956:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000100:00000200:6.0:1773851883.337956:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851883.337957:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:7.0:1773851883.337957:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500073984 avail=351498038272 avail_mb=1373039212 hwm_mb=3131103 files=372097643 ffree=343261791 state=0: rc = 0
00000100:00000001:31.0:1773851883.337958:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851883.337958:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851883.337958:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851883.337958:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851883.337958:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851883.337959:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fede61b9 x1859433051934848/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851883.337959:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000015cb12b7 x1859433051934784/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851883.337959:0:41069:0:(client.c:1428:after_reply()) Process entered
00000004:00000020:7.0:1773851883.337959:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500073984 free, 351498038272 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097643 files, 343261791 free files
00000100:00000200:6.0:1773851883.337959:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:11.0:1773851883.337960:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:11.0:1773851883.337960:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000001:7.0:1773851883.337960:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851883.337961:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851883.337961:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:28.0:1773851883.337961:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:11.0:1773851883.337961:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.337961:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851883.337961:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851883.337961:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000010:31.0:1773851883.337962:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000860b557b.
02000000:00000001:28.0:1773851883.337962:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851883.337962:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000481ea804.
00000100:00001000:11.0:1773851883.337962:0:41069:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=116 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851883.337962:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851883.337962:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851883.337963:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00001000:11.0:1773851883.337963:0:41069:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=116 v=66 (1 1 1 1)
02000000:00000001:6.0:1773851883.337963:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851883.337963:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:31.0:1773851883.337964:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851883.337964:0:41089:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
02000000:00000001:28.0:1773851883.337964:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851883.337964:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851883.337964:0:41088:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:11.0:1773851883.337964:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00100000:7.0:1773851883.337964:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ae5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051934720:36@kfi7:13:default-yuba2-0
00000100:00000001:6.0:1773851883.337964:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851883.337965:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851883.337965:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b789a785.
00000020:00000001:28.0:1773851883.337965:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851883.337965:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000daa395b6.
00000100:00000001:11.0:1773851883.337965:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851883.337965:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851883.337966:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851883.337966:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:11.0:1773851883.337966:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851883.337966:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:6.0:1773851883.337966:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=116 v=66 (66 66 66 66)
00000100:00001000:6.0:1773851883.337966:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=116 v=66 (1 1 1 1)
02000000:00000001:31.0:1773851883.337967:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851883.337967:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fede61b9.
02000000:00000001:28.0:1773851883.337967:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851883.337967:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000015cb12b7.
00010000:00000001:11.0:1773851883.337967:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337967:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851883.337967:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851883.337967:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005ae5d597 x1859433051934720/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851883.337968:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851883.337968:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:11.0:1773851883.337968:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000001:6.0:1773851883.337968:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851883.337968:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851883.337969:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851883.337969:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851883.337969:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851883.337969:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.337969:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851883.337969:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851883.337969:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851883.337969:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851883.337970:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851883.337970:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:11.0:1773851883.337970:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851883.337970:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851883.337970:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:6.0:1773851883.337970:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851883.337971:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851883.337971:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851883.337971:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851883.337971:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:7.0:1773851883.337971:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000067b7447a.
00000100:00000040:6.0:1773851883.337971:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:6.0:1773851883.337971:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851883.337972:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851883.337972:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851883.337972:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:6.0:1773851883.337972:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.337973:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851883.337973:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000020:00000001:7.0:1773851883.337973:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851883.337973:0:41067:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000100:00000040:6.0:1773851883.337973:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851883.337974:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851883.337974:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000001:11.0:1773851883.337975:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:11.0:1773851883.337975:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
02000000:00000010:7.0:1773851883.337975:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a478f995.
00000100:00000001:6.0:1773851883.337975:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:11.0:1773851883.337976:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690076160 avail=351687681024 avail_mb=1373780004 hwm_mb=3131103 files=372231133 ffree=343447340 state=0: rc = 0
02000000:00000001:7.0:1773851883.337976:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851883.337976:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:6.0:1773851883.337976:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000010:7.0:1773851883.337977:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005ae5d597.
00000100:00000001:7.0:1773851883.337977:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851883.337977:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851883.337977:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:11.0:1773851883.337978:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690076160 free, 351687681024 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231133 files, 343447340 free files
00000100:00000001:7.0:1773851883.337978:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.337978:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:6.0:1773851883.337978:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000100:00000001:7.0:1773851883.337979:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000040:6.0:1773851883.337979:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399725568 free=351492706304 avail=351490288640 avail_mb=1373008940 hwm_mb=3131103 files=372077978 ffree=343254596 state=0: rc = 0
00000004:00000001:11.0:1773851883.337980:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337980:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851883.337980:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:11.0:1773851883.337981:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851883.337981:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:6.0:1773851883.337982:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399725568 blocks, 351492706304 free, 351490288640 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372077978 files, 343254596 free files
00000100:00100000:11.0:1773851883.337984:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d72bffb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051934528:37@kfi7:13:default-yuba2-0
00000004:00000001:6.0:1773851883.337984:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851883.337985:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851883.337987:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.337987:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851883.337988:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d72bffb1 x1859433051934528/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:6.0:1773851883.337988:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000adffc73b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051934656:2061@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851883.337990:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:6.0:1773851883.337990:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:11.0:1773851883.337991:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:6.0:1773851883.337991:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:11.0:1773851883.337992:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b21c4693.
00000100:00000040:6.0:1773851883.337992:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000adffc73b x1859433051934656/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:11.0:1773851883.337993:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851883.337993:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851883.337993:0:41069:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000020:00000001:11.0:1773851883.337994:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:6.0:1773851883.337994:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000010:11.0:1773851883.337995:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000068b7b641.
02000000:00000001:11.0:1773851883.337995:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851883.337995:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851883.337995:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000050743369.
02000000:00000001:11.0:1773851883.337996:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851883.337996:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d72bffb1.
00000100:00000001:11.0:1773851883.337997:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:6.0:1773851883.337997:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851883.337997:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:11.0:1773851883.337998:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:6.0:1773851883.337998:0:41065:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000100:00000001:11.0:1773851883.337999:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.337999:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:6.0:1773851883.337999:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851883.337999:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000100f702c.
00000100:00000001:11.0:1773851883.338000:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.338000:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:6.0:1773851883.338000:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:11.0:1773851883.338001:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851883.338001:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851883.338001:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000adffc73b.
00000100:00000001:6.0:1773851883.338002:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851883.338003:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851883.338003:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851883.338004:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851883.338005:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851883.338005:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851883.338006:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851883.393128:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.393128:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851883.393129:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851883.393129:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851883.393130:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851883.393130:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851883.393133:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851883.393133:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20531@kfi7(00000000d1812073):0xebd version: 2; local version 2; negotiated version: 2
00000400:00000200:30.0:1773851883.393135:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20531@kfi7 to cpt 7
00000800:00000200:29.0:1773851883.393135:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd Using peer 20531@kfi7(0x100000000000ebd)
00000400:00000200:30.0:1773851883.393136:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20531@kfi7 : PUT - for me
00000400:00000200:29.0:1773851883.393137:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20531@kfi7 to cpt 7
00000400:00000200:30.0:1773851883.393138:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20531@kfi7 to cpt 7
00000800:00000200:29.0:1773851883.393139:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 38 bytes to peer 0x100000000000ebd: rc=0
00000400:00000200:30.0:1773851883.393140:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001329c02f nid 20531@kfi7 refs 1
00000400:00000200:30.0:1773851883.393141:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20531@kfi7 to cpt 7
00000800:00000200:29.0:1773851883.393141:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851883.393145:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001329c02f nid 20531@kfi7 refs 2
00000400:00000200:30.0:1773851883.393146:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001329c02f nid 20531@kfi7 refs 3
00000400:00000200:30.0:1773851883.393147:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20722@kfi7 to cpt 6
00000400:00000200:30.0:1773851883.393148:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20722@kfi7 of length 456 into portal 12 MB=0x69b0a8ed56f80
00000400:00000200:30.0:1773851883.393150:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20722@kfi7 of length 456/456 into md 0x77fe139dd [64] + 191048
00000800:00000200:30.0:1773851883.393152:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851883.393154:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851883.393155:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20531@kfi7: PUT: OK
00000100:00000001:30.0:1773851883.393156:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:29.0:1773851883.393156:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd TN_EVENT_TX_OK event status 0
00000100:00000200:30.0:1773851883.393157:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851883.393158:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000033de482b.
00000100:00000040:30.0:1773851883.393159:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000033de482b x1859319508594560 msgsize 456
00000800:00000200:29.0:1773851883.393159:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd Transaction freed
00000100:00100000:30.0:1773851883.393161:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-20722@kfi7 (source: 12345-20531@kfi7)
00000100:00000001:30.0:1773851883.393162:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851883.393163:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001329c02f nid 20531@kfi7 refs 2
00000800:00000200:30.0:1773851883.393164:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2054@kfi7:7 <- 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851883.393164:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851883.393164:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851883.393165:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851883.393165:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851883.393166:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.393167:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319508594560
00000020:00000001:29.0:1773851883.393168:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851883.393169:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92474
00000020:00000001:29.0:1773851883.393170:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851883.393172:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000466f3600 refcount=2681
00000020:00000001:29.0:1773851883.393173:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630513664 : -107123079037952 : ffff9e9276ed3c00)
00000020:00000001:29.0:1773851883.393174:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630513664 : -107123079037952 : ffff9e9276ed3c00)
00000100:00000001:29.0:1773851883.393175:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.393176:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851883.393177:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851883.393178:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.393178:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851883.393180:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851883.393180:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851883.393181:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.393182:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.393183:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.393185:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851883.393185:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851883.393185:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851883.393186:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851883.393187:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20722@kfi7, seq: 364304983
00000100:00000040:29.0:1773851883.393187:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000466f3600 : new rpc_count 8
00000100:00000001:30.0:1773851883.393188:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.393188:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.393188:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411251456 : -106960298300160 : ffff9eb85d6a2d00)
00000100:00000040:29.0:1773851883.393190:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000033de482b x1859319508594560/t0(0) o17->c3cf85f9-085b-4799-9c8b-160b726ef4b9@20722@kfi7:164/0 lens 456/0 e 0 to 0 dl 1773852279 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1769-0'
00000100:00000001:29.0:1773851883.393193:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.393193:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851883.393194:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033de482b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c3cf85f9-085b-4799-9c8b-160b726ef4b9+2681:39483:x1859319508594560:12345-20722@kfi7:17:default-tuolumne1769-0
00000100:00000200:29.0:1773851883.393195:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319508594560
00000020:00000001:29.0:1773851883.393196:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851883.393196:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851883.393197:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.393198:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851883.393198:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:29.0:1773851883.393199:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851883.393200:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319508594560, found 0 last_xid 1859319507907903
00000020:00000001:29.0:1773851883.393201:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851883.393202:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851883.393202:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851883.393203:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851883.393204:0:60533:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:29.0:1773851883.393205:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851883.393206:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851883.393207:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000860b557b.
02000000:00000001:29.0:1773851883.393207:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.393208:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.393209:0:60533:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:29.0:1773851883.393210:0:60533:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:29.0:1773851883.393211:0:60533:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:29.0:1773851883.393213:0:60533:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.393213:0:60533:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:29.0:1773851883.393214:0:60533:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli c3cf85f9-085b-4799-9c8b-160b726ef4b9/00000000466f3600 free: 126633370845184 avail: 126633368748032
00000020:00000001:29.0:1773851883.393216:0:60533:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:29.0:1773851883.393216:0:60533:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli c3cf85f9-085b-4799-9c8b-160b726ef4b9/00000000466f3600 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:29.0:1773851883.393218:0:60533:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:29.0:1773851883.393219:0:60533:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:29.0:1773851883.393220:0:60533:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli c3cf85f9-085b-4799-9c8b-160b726ef4b9/00000000466f3600 reports grant 1718091775 dropped 0, local 1786249215
00000020:00000001:29.0:1773851883.393221:0:60533:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:29.0:1773851883.393222:0:60533:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:29.0:1773851883.393222:0:60533:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851883.393223:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583865, transno 0, xid 1859319508594560
00010000:00000001:29.0:1773851883.393224:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851883.393225:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000033de482b x1859319508594560/t0(0) o17->c3cf85f9-085b-4799-9c8b-160b726ef4b9@20722@kfi7:164/0 lens 456/432 e 0 to 0 dl 1773852279 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1769-0'
00010000:00000001:29.0:1773851883.393227:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851883.393228:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851883.393228:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=116 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851883.393229:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851883.393231:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008ad01126 refcount 3 to 20722@kfi7
00000100:00000001:29.0:1773851883.393231:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858496 : -107149578693120 : ffff9e8c4b6c9600)
02000000:00000001:29.0:1773851883.393232:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851883.393233:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.393233:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.393234:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20531@kfi7
00000400:00000010:29.0:1773851883.393235:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000004015b2d.
00000100:00000200:29.0:1773851883.393236:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859319508594560, offset 224
00000400:00000200:29.0:1773851883.393237:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20531@kfi7
00000400:00000200:29.0:1773851883.393238:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20531@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.393239:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001329c02f nid 20531@kfi7 refs 1
00000400:00000200:29.0:1773851883.393240:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001329c02f nid 20531@kfi7 refs 2
00000400:00000200:29.0:1773851883.393241:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001329c02f nid 20531@kfi7 refs 3
00000400:00000200:29.0:1773851883.393242:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20531@kfi7 local destination
00000400:00000200:29.0:1773851883.393243:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769765:8769765:1024:4294967295] 20531@kfi7 LPNI seq info [25201615:25201615:16:4294967295]
00000400:00000200:29.0:1773851883.393245:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001329c02f nid 20531@kfi7 refs 2
00000400:00000200:29.0:1773851883.393246:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20531@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.393248:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20531@kfi7(20531@kfi7:20531@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851883.393249:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001329c02f nid 20531@kfi7 refs 3
00000800:00000200:29.0:1773851883.393250:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.393251:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:29.0:1773851883.393253:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851883.393256:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd Using peer 20531@kfi7(0x100000000000ebd)
00000800:00000200:29.0:1773851883.393258:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 532 bytes to peer 0x100000000000ebd: rc=0
00000800:00000200:29.0:1773851883.393260:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851883.393261:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.393263:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008ad01126 refcount 2 to 20722@kfi7
00010000:00000001:29.0:1773851883.393263:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851883.393264:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.393265:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851883.393265:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000033de482b x1859319508594560/t0(0) o17->c3cf85f9-085b-4799-9c8b-160b726ef4b9@20722@kfi7:164/0 lens 456/432 e 0 to 0 dl 1773852279 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1769-0'
00000100:00100000:29.0:1773851883.393268:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033de482b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:c3cf85f9-085b-4799-9c8b-160b726ef4b9+2681:39483:x1859319508594560:12345-20722@kfi7:17:default-tuolumne1769-0 Request processed in 74us (108us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851883.393270:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20722@kfi7, seq: 364304983
00000100:00000040:29.0:1773851883.393271:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000466f3600 : new rpc_count 7
00000800:00000200:30.0:1773851883.393272:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851883.393272:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851883.393272:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851883.393273:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851883.393274:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851883.393274:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851883.393274:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000400:00000200:30.0:1773851883.393275:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20531@kfi7: PUT: OK
00000020:00000040:29.0:1773851883.393275:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000466f3600 : new refcount 2680
00000400:00000200:30.0:1773851883.393276:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000004015b2d
00000400:00000010:30.0:1773851883.393276:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000004015b2d.
00000100:00000001:29.0:1773851883.393276:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.393277:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851883.393277:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851883.393278:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001329c02f nid 20531@kfi7 refs 2
00000800:00000200:30.0:1773851883.393279:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 20531@kfi7(00000000d1812073):0x0 lsk 3774 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000ebd Transaction freed
00000400:00000200:29.0:1773851883.401730:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851883.401731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:29.0:1773851883.430544:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.430544:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851883.430546:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851883.430548:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851883.430549:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22306@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.430550:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22306@kfi7 : PUT - for me
00000400:00000200:29.0:1773851883.430551:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22306@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.430554:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d88ae60c nid 22306@kfi7 refs 1
00000400:00000200:29.0:1773851883.430555:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22306@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.430556:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d88ae60c nid 22306@kfi7 refs 2
00000400:00000200:29.0:1773851883.430557:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d88ae60c nid 22306@kfi7 refs 3
00000400:00000200:29.0:1773851883.430558:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22498@kfi7 to cpt 1
00000400:00000200:29.0:1773851883.430559:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22498@kfi7 of length 224 into portal 12 MB=0x69b4b5b83c640
00000400:00000200:29.0:1773851883.430560:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22498@kfi7 of length 224/224 into md 0x77fe139dd [64] + 191504
00000800:00000200:29.0:1773851883.430561:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851883.430563:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851883.430564:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22306@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.430565:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851883.430565:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851883.430566:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000afd0259c.
00000100:00000040:29.0:1773851883.430567:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000afd0259c x1859597820479040 msgsize 224
00000100:00100000:29.0:1773851883.430568:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22498@kfi7 (source: 12345-22306@kfi7)
00000100:00000001:29.0:1773851883.430569:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851883.430570:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d88ae60c nid 22306@kfi7 refs 2
00000800:00000200:29.0:1773851883.430571:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851883.430574:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851883.430574:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851883.430574:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851883.430575:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851883.430575:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.430576:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597820479040
00000020:00000001:29.0:1773851883.430577:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851883.430577:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e249bac25
00000020:00000001:29.0:1773851883.430577:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851883.430582:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006bf71f0e refcount=5
00000020:00000001:29.0:1773851883.430583:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127986153472 : -106945723398144 : ffff9ebbc2258800)
00000020:00000001:29.0:1773851883.430583:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127986153472 : -106945723398144 : ffff9ebbc2258800)
00000100:00000001:29.0:1773851883.430584:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.430585:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851883.430585:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000436037ce.
00000020:00000010:29.0:1773851883.430586:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.430587:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851883.430588:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851883.430588:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851883.430588:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.430589:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851883.430590:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851883.430590:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.430591:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.430592:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851883.430592:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851883.430593:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22498@kfi7, seq: 2055561
00000100:00000001:30.0:1773851883.430594:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851883.430594:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:29.0:1773851883.430594:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006bf71f0e : new rpc_count 1
00000100:00000001:29.0:1773851883.430594:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058761477248 : -107014948074368 : ffff9eaba408cc80)
00000100:00000001:30.0:1773851883.430595:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.430595:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000afd0259c x1859597820479040/t0(0) o400->ea5cd8f0-5a05-4e0c-849e-a102c90769b8@22498@kfi7:671/0 lens 224/0 e 0 to 0 dl 1773852031 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1883-0'
00000100:00000001:30.0:1773851883.430596:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.430598:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.430598:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851883.430599:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afd0259c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ea5cd8f0-5a05-4e0c-849e-a102c90769b8+5:39620:x1859597820479040:12345-22498@kfi7:400:default-tuolumne1883-0
00000100:00000200:29.0:1773851883.430600:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597820479040
00000020:00000001:29.0:1773851883.430601:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851883.430601:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851883.430602:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.430602:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851883.430602:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851883.430603:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851883.430604:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597820479040, found 0 last_xid 1859597820479039
00000020:00000001:29.0:1773851883.430604:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851883.430605:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851883.430605:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851883.430606:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.430606:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851883.430607:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851883.430607:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851883.430611:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2276ea4.
02000000:00000001:29.0:1773851883.430611:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.430612:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.430612:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851883.430613:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694492, transno 0, xid 1859597820479040
00010000:00000001:29.0:1773851883.430613:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851883.430614:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000afd0259c x1859597820479040/t0(0) o400->ea5cd8f0-5a05-4e0c-849e-a102c90769b8@22498@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1883-0'
00010000:00000001:29.0:1773851883.430617:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851883.430617:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851883.430618:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=116 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851883.430619:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851883.430619:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000031fc9d84 refcount 3 to 22498@kfi7
00000100:00000001:29.0:1773851883.430620:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412384 : -107145304139232 : ffff9e8d4a351a20)
02000000:00000001:29.0:1773851883.430620:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851883.430621:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.430621:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.430622:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22306@kfi7
00000400:00000010:29.0:1773851883.430623:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000038c1b0d0.
00000100:00000200:29.0:1773851883.430623:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597820479040, offset 224
00000400:00000200:29.0:1773851883.430625:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22306@kfi7
00000400:00000200:29.0:1773851883.430625:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22306@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.430626:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d88ae60c nid 22306@kfi7 refs 1
00000400:00000200:29.0:1773851883.430627:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d88ae60c nid 22306@kfi7 refs 2
00000400:00000200:29.0:1773851883.430628:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d88ae60c nid 22306@kfi7 refs 3
00000400:00000200:29.0:1773851883.430629:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22306@kfi7 local destination
00000400:00000200:29.0:1773851883.430630:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769766:8769766:1024:4294967295] 22306@kfi7 LPNI seq info [192747:192747:16:4294967295]
00000400:00000200:29.0:1773851883.430631:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d88ae60c nid 22306@kfi7 refs 2
00000400:00000200:29.0:1773851883.430632:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22306@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.430634:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22306@kfi7(22306@kfi7:22306@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851883.430635:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d88ae60c nid 22306@kfi7 refs 3
00000800:00000200:29.0:1773851883.430636:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.430638:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851883.430639:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851883.430641:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000117b Using peer 22306@kfi7(0x10000000000117b)
00000800:00000200:29.0:1773851883.430644:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 324 bytes to peer 0x10000000000117b: rc=0
00000800:00000200:29.0:1773851883.430646:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000117b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851883.430647:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.430648:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000031fc9d84 refcount 2 to 22498@kfi7
00010000:00000001:29.0:1773851883.430649:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851883.430649:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.430650:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851883.430650:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000afd0259c x1859597820479040/t0(0) o400->ea5cd8f0-5a05-4e0c-849e-a102c90769b8@22498@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1883-0'
00000100:00100000:29.0:1773851883.430653:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afd0259c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:ea5cd8f0-5a05-4e0c-849e-a102c90769b8+5:39620:x1859597820479040:12345-22498@kfi7:400:default-tuolumne1883-0 Request processed in 55us (85us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851883.430655:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22498@kfi7, seq: 2055561
00000100:00000040:29.0:1773851883.430656:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006bf71f0e : new rpc_count 0
00000100:00000001:29.0:1773851883.430657:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851883.430657:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:31.0:1773851883.430658:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000117b TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851883.430658:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.430658:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851883.430659:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000436037ce.
00000020:00000040:29.0:1773851883.430659:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000006bf71f0e : new refcount 4
00000400:00000200:31.0:1773851883.430660:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851883.430660:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851883.430662:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22306@kfi7: PUT: OK
00000400:00000200:31.0:1773851883.430662:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000038c1b0d0
00000400:00000010:31.0:1773851883.430663:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000038c1b0d0.
00000100:00000001:31.0:1773851883.430663:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851883.430664:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851883.430664:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d88ae60c nid 22306@kfi7 refs 2
00000800:00000200:31.0:1773851883.430666:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 22306@kfi7(00000000a4bfc153):0x0 lsk 4476 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000117b Transaction freed
00000800:00000200:9.0:1773851883.441756:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851883.441757:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851883.441759:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851883.441763:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851883.441766:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16050@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.441768:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16050@kfi7 : PUT - for me
00000400:00000200:9.0:1773851883.441769:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16050@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.441771:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007677645f nid 16050@kfi7 refs 1
00000400:00000200:9.0:1773851883.441772:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16050@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.441774:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007677645f nid 16050@kfi7 refs 2
00000400:00000200:9.0:1773851883.441775:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007677645f nid 16050@kfi7 refs 3
00000400:00000200:9.0:1773851883.441776:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15987@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.441778:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15987@kfi7 of length 224 into portal 12 MB=0x69b4b54279580
00000400:00000200:9.0:1773851883.441780:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15987@kfi7 of length 224/224 into md 0x78146ce49 [64] + 146880
00000800:00000200:9.0:1773851883.441784:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851883.441787:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851883.441788:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16050@kfi7: PUT: OK
00000100:00000001:9.0:1773851883.441790:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851883.441791:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851883.441792:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000584ddf2d.
00000100:00000040:9.0:1773851883.441793:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000584ddf2d x1859597696996736 msgsize 224
00000100:00100000:9.0:1773851883.441796:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-15987@kfi7 (source: 12345-16050@kfi7)
00000100:00000001:9.0:1773851883.441798:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851883.441799:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007677645f nid 16050@kfi7 refs 2
00000100:00000001:11.0:1773851883.441800:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851883.441801:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851883.441801:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851883.441802:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851883.441803:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.441804:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851883.441805:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597696996736
00000020:00000001:11.0:1773851883.441806:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851883.441807:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8225a
00000020:00000001:11.0:1773851883.441808:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851883.441812:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ebc8dd03 refcount=8
00000020:00000001:11.0:1773851883.441813:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165079527424 : -106908630024192 : ffff9ec465158000)
00000020:00000001:11.0:1773851883.441814:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165079527424 : -106908630024192 : ffff9ec465158000)
00000100:00000001:11.0:1773851883.441816:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851883.441829:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851883.441830:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000dad0a37.
00000020:00000010:11.0:1773851883.441831:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851883.441833:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004334b4cb.
00000100:00000001:11.0:1773851883.441834:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851883.441835:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851883.441836:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.441837:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851883.441838:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851883.441839:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.441840:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.441842:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851883.441843:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851883.441843:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851883.441844:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851883.441845:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15987@kfi7, seq: 2130817
00000100:00000040:11.0:1773851883.441846:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ebc8dd03 : new rpc_count 1
00000100:00000001:8.0:1773851883.441846:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.441847:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162642048 : -106971546909568 : ffff9eb5bef20480)
00000100:00000001:8.0:1773851883.441848:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851883.441849:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000584ddf2d x1859597696996736/t0(0) o400->3cdd8be9-fc02-4514-9369-4edf9ffe50be@15987@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1482-0'
00000100:00000001:11.0:1773851883.441854:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851883.441854:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851883.441856:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000584ddf2d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3cdd8be9-fc02-4514-9369-4edf9ffe50be+8:39558:x1859597696996736:12345-15987@kfi7:400:default-tuolumne1482-0
00000100:00000200:11.0:1773851883.441858:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597696996736
00000020:00000001:11.0:1773851883.441859:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851883.441860:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851883.441861:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.441862:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851883.441863:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851883.441865:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851883.441866:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597696996736, found 0 last_xid 1859597696996735
00000020:00000001:11.0:1773851883.441867:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851883.441868:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851883.441869:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851883.441870:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.441871:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851883.441872:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851883.441873:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851883.441874:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000019bc4832.
02000000:00000001:11.0:1773851883.441875:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.441876:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.441877:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851883.441878:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181926801106, transno 0, xid 1859597696996736
00010000:00000001:11.0:1773851883.441880:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851883.441881:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000584ddf2d x1859597696996736/t0(0) o400->3cdd8be9-fc02-4514-9369-4edf9ffe50be@15987@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1482-0'
00010000:00000001:11.0:1773851883.441886:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851883.441887:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851883.441888:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=116 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851883.441889:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851883.441891:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000022b9780d refcount 3 to 15987@kfi7
00000100:00000001:11.0:1773851883.441892:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810485504 : -107154899066112 : ffff9e8b0e4e2300)
02000000:00000001:11.0:1773851883.441893:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851883.441894:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.441895:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851883.441896:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16050@kfi7
00000400:00000010:11.0:1773851883.441897:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000fb1e983.
00000100:00000200:11.0:1773851883.441899:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597696996736, offset 224
00000400:00000200:11.0:1773851883.441901:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16050@kfi7
00000400:00000200:11.0:1773851883.441902:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16050@kfi7 to cpt 2
00000400:00000200:11.0:1773851883.441904:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007677645f nid 16050@kfi7 refs 1
00000400:00000200:11.0:1773851883.441905:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007677645f nid 16050@kfi7 refs 2
00000400:00000200:11.0:1773851883.441907:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007677645f nid 16050@kfi7 refs 3
00000400:00000200:11.0:1773851883.441909:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16050@kfi7 local destination
00000400:00000200:11.0:1773851883.441911:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769767:8769767:1024:4294967295] 16050@kfi7 LPNI seq info [504533:504533:16:4294967295]
00000400:00000200:11.0:1773851883.441914:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007677645f nid 16050@kfi7 refs 2
00000400:00000200:11.0:1773851883.441915:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16050@kfi7 to cpt 2
00000400:00000200:11.0:1773851883.441918:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16050@kfi7(16050@kfi7:16050@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851883.441923:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007677645f nid 16050@kfi7 refs 3
00000800:00000200:11.0:1773851883.441925:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851883.441926:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851883.441930:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851883.441934:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de1 Using peer 16050@kfi7(0x100000000000de1)
00000800:00000200:11.0:1773851883.441938:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x100000000000de1: rc=0
00000800:00000200:11.0:1773851883.441941:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851883.441944:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851883.441945:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000022b9780d refcount 2 to 15987@kfi7
00010000:00000001:11.0:1773851883.441946:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851883.441947:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.441948:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851883.441949:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000584ddf2d x1859597696996736/t0(0) o400->3cdd8be9-fc02-4514-9369-4edf9ffe50be@15987@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1482-0'
00000100:00100000:11.0:1773851883.441955:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000584ddf2d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:3cdd8be9-fc02-4514-9369-4edf9ffe50be+8:39558:x1859597696996736:12345-15987@kfi7:400:default-tuolumne1482-0 Request processed in 99us (160us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851883.441956:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de1 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851883.441958:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851883.441959:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15987@kfi7, seq: 2130817
00000100:00000040:11.0:1773851883.441960:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ebc8dd03 : new rpc_count 0
00000400:00000200:9.0:1773851883.441960:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16050@kfi7: PUT: OK
00000400:00000200:9.0:1773851883.441961:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000fb1e983
00000100:00000001:11.0:1773851883.441962:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:9.0:1773851883.441962:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000fb1e983.
00000100:00000001:11.0:1773851883.441963:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851883.441963:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851883.441964:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000100:00000001:9.0:1773851883.441964:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851883.441965:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004334b4cb.
00000020:00000010:11.0:1773851883.441966:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000dad0a37.
00000400:00000200:9.0:1773851883.441966:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007677645f nid 16050@kfi7 refs 2
00000020:00000040:11.0:1773851883.441968:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000ebc8dd03 : new refcount 7
00000800:00000200:9.0:1773851883.441968:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 16050@kfi7(00000000976d1d35):0x0 lsk 3554 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000de1 Transaction freed
00000100:00000001:11.0:1773851883.441969:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851883.541244:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851883.541245:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851883.541246:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851883.541248:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851883.541250:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22658@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.541251:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22658@kfi7 : PUT - for me
00000400:00000200:9.0:1773851883.541252:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22658@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.541253:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c198875a nid 22658@kfi7 refs 1
00000400:00000200:9.0:1773851883.541254:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22658@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.541254:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c198875a nid 22658@kfi7 refs 2
00000400:00000200:9.0:1773851883.541255:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c198875a nid 22658@kfi7 refs 3
00000400:00000200:9.0:1773851883.541256:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22658@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.541257:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22658@kfi7 of length 224 into portal 12 MB=0x699e1170f5640
00000400:00000200:9.0:1773851883.541258:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22658@kfi7 of length 224/224 into md 0x78146ce49 [64] + 147104
00000800:00000200:9.0:1773851883.541259:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851883.541261:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851883.541262:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22658@kfi7: PUT: OK
00000100:00000001:9.0:1773851883.541262:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851883.541263:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851883.541263:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000780c0ea7.
00000100:00000040:9.0:1773851883.541264:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000780c0ea7 x1858041893836352 msgsize 224
00000100:00100000:9.0:1773851883.541265:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22658@kfi7 (source: 12345-22658@kfi7)
00000100:00000001:9.0:1773851883.541266:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851883.541267:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c198875a nid 22658@kfi7 refs 2
00000100:00000001:11.0:1773851883.541268:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851883.541268:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851883.541269:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851883.541269:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851883.541269:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.541270:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851883.541270:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041893836352
00000020:00000001:11.0:1773851883.541271:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851883.541271:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a78
00000020:00000001:11.0:1773851883.541272:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851883.541275:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002ce2f258 refcount=6
00000020:00000001:11.0:1773851883.541275:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743432192 : -107128966119424 : ffff9e9118078000)
00000020:00000001:11.0:1773851883.541276:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743432192 : -107128966119424 : ffff9e9118078000)
00000100:00000001:11.0:1773851883.541277:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851883.541278:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851883.541278:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000dad0a37.
00000020:00000010:11.0:1773851883.541279:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851883.541279:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004334b4cb.
00000100:00000001:11.0:1773851883.541280:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851883.541280:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851883.541281:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.541282:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851883.541282:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851883.541282:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.541283:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.541284:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851883.541284:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851883.541285:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22658@kfi7, seq: 2130818
00000100:00000001:8.0:1773851883.541285:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851883.541285:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851883.541286:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002ce2f258 : new rpc_count 1
00000100:00000001:8.0:1773851883.541286:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.541286:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.541287:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162644352 : -106971546907264 : ffff9eb5bef20d80)
00000100:00000040:11.0:1773851883.541288:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000780c0ea7 x1858041893836352/t0(0) o400->0b8ee026-6e55-49e5-91aa-2c31e881d1a0@22658@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1912-0'
00000100:00000001:11.0:1773851883.541290:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851883.541291:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851883.541291:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000780c0ea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:0b8ee026-6e55-49e5-91aa-2c31e881d1a0+6:39830:x1858041893836352:12345-22658@kfi7:400:default-tuolumne1912-0
00000100:00000200:11.0:1773851883.541294:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041893836352
00000020:00000001:11.0:1773851883.541294:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851883.541295:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851883.541296:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.541296:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851883.541296:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851883.541297:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851883.541298:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041893836352, found 0 last_xid 1858041893836351
00000020:00000001:11.0:1773851883.541298:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851883.541299:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851883.541299:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851883.541299:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.541300:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851883.541300:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851883.541301:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851883.541301:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dcdc448f.
02000000:00000001:11.0:1773851883.541302:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.541302:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.541303:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851883.541304:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098911094, transno 0, xid 1858041893836352
00010000:00000001:11.0:1773851883.541304:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851883.541305:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000780c0ea7 x1858041893836352/t0(0) o400->0b8ee026-6e55-49e5-91aa-2c31e881d1a0@22658@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1912-0'
00010000:00000001:11.0:1773851883.541307:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851883.541308:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851883.541308:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=116 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851883.541309:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851883.541310:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005d939bbb refcount 3 to 22658@kfi7
00000100:00000001:11.0:1773851883.541310:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058688 : -107146750492928 : ffff9e8cf3ff7f00)
02000000:00000001:11.0:1773851883.541311:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851883.541311:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.541312:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851883.541313:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22658@kfi7
00000400:00000010:11.0:1773851883.541313:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a08630ef.
00000100:00000200:11.0:1773851883.541314:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041893836352, offset 224
00000400:00000200:11.0:1773851883.541316:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22658@kfi7
00000400:00000200:11.0:1773851883.541316:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22658@kfi7 to cpt 2
00000400:00000200:11.0:1773851883.541317:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c198875a nid 22658@kfi7 refs 1
00000400:00000200:11.0:1773851883.541318:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c198875a nid 22658@kfi7 refs 2
00000400:00000200:11.0:1773851883.541319:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c198875a nid 22658@kfi7 refs 3
00000400:00000200:11.0:1773851883.541320:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22658@kfi7 local destination
00000400:00000200:11.0:1773851883.541321:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769768:8769768:1024:4294967295] 22658@kfi7 LPNI seq info [262077:262077:16:4294967295]
00000400:00000200:11.0:1773851883.541322:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c198875a nid 22658@kfi7 refs 2
00000400:00000200:11.0:1773851883.541323:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22658@kfi7 to cpt 2
00000400:00000200:11.0:1773851883.541324:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22658@kfi7(22658@kfi7:22658@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851883.541326:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c198875a nid 22658@kfi7 refs 3
00000800:00000200:11.0:1773851883.541327:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851883.541328:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851883.541329:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851883.541331:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000940 Using peer 22658@kfi7(0x100000000000940)
00000800:00000200:11.0:1773851883.541334:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x100000000000940: rc=0
00000800:00000200:11.0:1773851883.541335:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000940 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851883.541337:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851883.541338:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005d939bbb refcount 2 to 22658@kfi7
00010000:00000001:11.0:1773851883.541338:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851883.541338:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851883.541339:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851883.541340:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000780c0ea7 x1858041893836352/t0(0) o400->0b8ee026-6e55-49e5-91aa-2c31e881d1a0@22658@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1912-0'
00000100:00100000:11.0:1773851883.541342:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000780c0ea7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:0b8ee026-6e55-49e5-91aa-2c31e881d1a0+6:39830:x1858041893836352:12345-22658@kfi7:400:default-tuolumne1912-0 Request processed in 51us (78us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851883.541344:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22658@kfi7, seq: 2130818
00000100:00000040:11.0:1773851883.541345:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002ce2f258 : new rpc_count 0
00000100:00000001:11.0:1773851883.541346:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851883.541346:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851883.541346:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851883.541347:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004334b4cb.
00000020:00000010:11.0:1773851883.541348:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000dad0a37.
00000800:00000200:9.0:1773851883.541348:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000940 TN_EVENT_TX_OK event status 0
00000020:00000040:11.0:1773851883.541349:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000002ce2f258 : new refcount 5
00000100:00000001:11.0:1773851883.541349:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851883.541349:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851883.541350:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22658@kfi7: PUT: OK
00000400:00000200:9.0:1773851883.541351:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a08630ef
00000400:00000010:9.0:1773851883.541351:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a08630ef.
00000100:00000001:9.0:1773851883.541352:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851883.541352:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851883.541353:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c198875a nid 22658@kfi7 refs 2
00000800:00000200:9.0:1773851883.541354:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 22658@kfi7(00000000258a4369):0x0 lsk 2369 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000940 Transaction freed
00000800:00000200:1.0:1773851883.631655:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851883.631656:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851883.631657:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851883.631660:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851883.631663:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22482@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.631664:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22482@kfi7 : PUT - for me
00000400:00000200:1.0:1773851883.631665:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22482@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.631666:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c1f46b5 nid 22482@kfi7 refs 1
00000400:00000200:1.0:1773851883.631667:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22482@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.631668:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c1f46b5 nid 22482@kfi7 refs 2
00000400:00000200:1.0:1773851883.631669:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001c1f46b5 nid 22482@kfi7 refs 3
00000400:00000200:1.0:1773851883.631670:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22482@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.631671:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22482@kfi7 of length 224 into portal 12 MB=0x69b4b62f22000
00000400:00000200:1.0:1773851883.631672:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22482@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 42528
00000800:00000200:1.0:1773851883.631674:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851883.631676:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851883.631677:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22482@kfi7: PUT: OK
00000100:00000001:1.0:1773851883.631678:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851883.631679:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851883.631680:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000024b31861.
00000100:00000040:1.0:1773851883.631681:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000024b31861 x1859597945151488 msgsize 224
00000100:00100000:1.0:1773851883.631683:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22482@kfi7 (source: 12345-22482@kfi7)
00000100:00000001:1.0:1773851883.631685:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851883.631685:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001c1f46b5 nid 22482@kfi7 refs 2
00000800:00000200:1.0:1773851883.631687:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000076179a5b: 2069@kfi7:0 <- 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851883.631690:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851883.631690:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851883.631691:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851883.631691:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851883.631692:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851883.631693:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597945151488
00000020:00000001:1.0:1773851883.631693:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851883.631694:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e243297cd
00000020:00000001:1.0:1773851883.631694:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851883.631696:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000094bbfd00 refcount=5
00000020:00000001:1.0:1773851883.631697:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637093256347648 : -106980453203968 : ffff9eb3ac16c000)
00000020:00000001:1.0:1773851883.631698:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637093256347648 : -106980453203968 : ffff9eb3ac16c000)
00000100:00000001:1.0:1773851883.631699:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851883.631699:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851883.631700:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a4593418.
00000020:00000010:1.0:1773851883.631701:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851883.631702:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f309d4d6.
00000100:00000001:1.0:1773851883.631703:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851883.631703:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851883.631704:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851883.631705:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851883.631705:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851883.631705:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851883.631706:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851883.631708:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851883.631708:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851883.631708:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851883.631708:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851883.631709:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22482@kfi7, seq: 1997600
00000100:00000040:1.0:1773851883.631711:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000094bbfd00 : new rpc_count 1
00000100:00000001:1.0:1773851883.631711:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112242560 : -106950597309056 : ffff9eba9fa38d80)
00000100:00000001:0.0:1773851883.631711:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851883.631711:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851883.631712:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000024b31861 x1859597945151488/t0(0) o400->d886750f-bd0f-4a0f-8c19-5dde254ab044@22482@kfi7:523/0 lens 224/0 e 0 to 0 dl 1773852638 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1893-0'
00000100:00000001:1.0:1773851883.631715:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851883.631715:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851883.631716:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000024b31861 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:d886750f-bd0f-4a0f-8c19-5dde254ab044+5:39486:x1859597945151488:12345-22482@kfi7:400:default-tuolumne1893-0
00000100:00000200:1.0:1773851883.631718:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597945151488
00000020:00000001:1.0:1773851883.631718:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851883.631719:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851883.631720:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851883.631720:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851883.631721:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851883.631722:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851883.631722:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597945151488, found 0 last_xid 1859597945151487
00000020:00000001:1.0:1773851883.631723:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851883.631724:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851883.631724:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851883.631727:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851883.631728:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851883.631728:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851883.631729:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851883.631730:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea99c5fd.
02000000:00000001:1.0:1773851883.631731:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851883.631731:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851883.631732:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851883.631733:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915823521, transno 0, xid 1859597945151488
00010000:00000001:1.0:1773851883.631733:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851883.631734:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000024b31861 x1859597945151488/t0(0) o400->d886750f-bd0f-4a0f-8c19-5dde254ab044@22482@kfi7:523/0 lens 224/224 e 0 to 0 dl 1773852638 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1893-0'
00010000:00000001:1.0:1773851883.631737:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851883.631737:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851883.631738:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=116 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851883.631739:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851883.631740:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000ae77c49 refcount 3 to 22482@kfi7
00000100:00000001:1.0:1773851883.631741:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049472 : -107154804502144 : ffff9e8b13f11180)
02000000:00000001:1.0:1773851883.631742:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851883.631742:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851883.631743:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851883.631744:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22482@kfi7
00000400:00000010:1.0:1773851883.631744:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000adbde9c1.
00000100:00000200:1.0:1773851883.631745:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597945151488, offset 224
00000400:00000200:1.0:1773851883.631746:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22482@kfi7
00000400:00000200:1.0:1773851883.631747:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22482@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.631748:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c1f46b5 nid 22482@kfi7 refs 1
00000400:00000200:1.0:1773851883.631749:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001c1f46b5 nid 22482@kfi7 refs 2
00000400:00000200:1.0:1773851883.631750:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001c1f46b5 nid 22482@kfi7 refs 3
00000400:00000200:1.0:1773851883.631751:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22482@kfi7 local destination
00000400:00000200:1.0:1773851883.631752:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769769:8769769:1024:4294967295] 22482@kfi7 LPNI seq info [421959:421959:16:4294967295]
00000400:00000200:1.0:1773851883.631754:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001c1f46b5 nid 22482@kfi7 refs 2
00000400:00000200:1.0:1773851883.631754:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22482@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.631756:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22482@kfi7(22482@kfi7:22482@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851883.631757:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001c1f46b5 nid 22482@kfi7 refs 3
00000800:00000200:1.0:1773851883.631758:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851883.631759:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851883.631761:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851883.631764:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x90b Using peer 22482@kfi7(0x90b)
00000800:00000200:1.0:1773851883.631767:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 324 bytes to peer 0x90b: rc=0
00000800:00000200:1.0:1773851883.631768:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x90b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851883.631772:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851883.631772:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000ae77c49 refcount 2 to 22482@kfi7
00010000:00000001:1.0:1773851883.631773:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851883.631774:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851883.631774:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851883.631775:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000024b31861 x1859597945151488/t0(0) o400->d886750f-bd0f-4a0f-8c19-5dde254ab044@22482@kfi7:523/0 lens 224/224 e 0 to 0 dl 1773852638 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1893-0'
00000100:00100000:1.0:1773851883.631778:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000024b31861 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:d886750f-bd0f-4a0f-8c19-5dde254ab044+5:39486:x1859597945151488:12345-22482@kfi7:400:default-tuolumne1893-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851883.631780:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x90b TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851883.631781:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22482@kfi7, seq: 1997600
00000100:00000040:1.0:1773851883.631781:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000094bbfd00 : new rpc_count 0
00000400:00000200:2.0:1773851883.631782:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851883.631782:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851883.631783:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22482@kfi7: PUT: OK
00000100:00000001:1.0:1773851883.631783:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:1.0:1773851883.631783:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000400:00000200:2.0:1773851883.631784:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000adbde9c1
00000400:00000010:2.0:1773851883.631784:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000adbde9c1.
00000020:00000010:1.0:1773851883.631784:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f309d4d6.
00000100:00000001:2.0:1773851883.631785:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851883.631785:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851883.631785:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a4593418.
00000400:00000200:2.0:1773851883.631786:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001c1f46b5 nid 22482@kfi7 refs 2
00000020:00000040:1.0:1773851883.631786:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000094bbfd00 : new refcount 4
00000100:00000001:1.0:1773851883.631787:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851883.631788:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 22482@kfi7(000000006d186d34):0x0 lsk 2316 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x90b Transaction freed
00010000:00000001:2.0:1773851883.657729:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657730:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851883.657731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851883.657732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851883.657734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851883.657734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851883.657736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851883.657736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851883.657737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851883.657738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851883.657744:0:937841:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:31.0:1773851883.657745:0:937841:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:31.0:1773851883.657746:0:937841:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:29.0:1773851883.669864:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.669865:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851883.669866:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851883.669870:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851883.669872:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23424@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.669873:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23424@kfi7 : PUT - for me
00000400:00000200:29.0:1773851883.669874:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23424@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.669876:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008db1c05e nid 23424@kfi7 refs 1
00000400:00000200:29.0:1773851883.669878:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23424@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.669878:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008db1c05e nid 23424@kfi7 refs 2
00000400:00000200:29.0:1773851883.669880:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008db1c05e nid 23424@kfi7 refs 3
00000400:00000200:29.0:1773851883.669880:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23361@kfi7 to cpt 6
00000400:00000200:29.0:1773851883.669881:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23361@kfi7 of length 224 into portal 12 MB=0x69b0a1f888580
00000400:00000200:29.0:1773851883.669882:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23361@kfi7 of length 224/224 into md 0x77fe139dd [64] + 191728
00000800:00000200:29.0:1773851883.669884:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851883.669886:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851883.669887:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23424@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.669888:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851883.669889:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851883.669890:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000008df5d4a.
00000100:00000040:29.0:1773851883.669890:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000008df5d4a x1859317641282944 msgsize 224
00000100:00100000:29.0:1773851883.669892:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23361@kfi7 (source: 12345-23424@kfi7)
00000100:00000001:29.0:1773851883.669894:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851883.669894:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008db1c05e nid 23424@kfi7 refs 2
00000800:00000200:29.0:1773851883.669896:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851883.669898:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851883.669899:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851883.669900:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851883.669900:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851883.669901:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.669901:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317641282944
00000020:00000001:29.0:1773851883.669903:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851883.669903:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b43
00000020:00000001:29.0:1773851883.669904:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851883.669907:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000698d93d0 refcount=6
00000020:00000001:29.0:1773851883.669908:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743667712 : -107128965883904 : ffff9e91180b1800)
00000020:00000001:29.0:1773851883.669909:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743667712 : -107128965883904 : ffff9e91180b1800)
00000100:00000001:29.0:1773851883.669910:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.669911:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851883.669911:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000cd8161e.
00000020:00000010:29.0:1773851883.669912:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.669913:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851883.669914:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851883.669914:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851883.669915:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.669916:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851883.669916:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851883.669917:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.669918:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.669919:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851883.669919:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851883.669919:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851883.669919:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851883.669920:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23361@kfi7, seq: 2055562
00000100:00000001:30.0:1773851883.669921:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.669921:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000698d93d0 : new rpc_count 1
00000100:00000001:30.0:1773851883.669922:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.669922:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058761481856 : -107014948069760 : ffff9eaba408de80)
00000100:00000040:29.0:1773851883.669923:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000008df5d4a x1859317641282944/t0(0) o400->d62eba99-88d2-426a-95f0-a77d60577709@23361@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1956-0'
00000100:00000001:29.0:1773851883.669926:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.669926:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851883.669927:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008df5d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d62eba99-88d2-426a-95f0-a77d60577709+6:39564:x1859317641282944:12345-23361@kfi7:400:default-tuolumne1956-0
00000100:00000200:29.0:1773851883.669928:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317641282944
00000020:00000001:29.0:1773851883.669929:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851883.669930:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851883.669930:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.669931:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851883.669932:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851883.669933:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851883.669933:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317641282944, found 0 last_xid 1859317641282943
00000020:00000001:29.0:1773851883.669934:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851883.669935:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851883.669935:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851883.669936:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.669937:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851883.669937:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851883.669938:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851883.669938:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000436037ce.
02000000:00000001:29.0:1773851883.669939:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.669939:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.669940:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851883.669941:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044146007, transno 0, xid 1859317641282944
00010000:00000001:29.0:1773851883.669942:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851883.669942:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000008df5d4a x1859317641282944/t0(0) o400->d62eba99-88d2-426a-95f0-a77d60577709@23361@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1956-0'
00010000:00000001:29.0:1773851883.669945:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851883.669945:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851883.669946:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=116 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851883.669947:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851883.669948:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fedcfdd7 refcount 3 to 23361@kfi7
00000100:00000001:29.0:1773851883.669949:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643689888 : -107157065861728 : ffff9e8a8d2775a0)
02000000:00000001:29.0:1773851883.669950:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851883.669950:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.669951:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.669952:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23424@kfi7
00000400:00000010:29.0:1773851883.669953:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000906c4b9a.
00000100:00000200:29.0:1773851883.669953:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317641282944, offset 224
00000400:00000200:29.0:1773851883.669954:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23424@kfi7
00000400:00000200:29.0:1773851883.669955:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23424@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.669956:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008db1c05e nid 23424@kfi7 refs 1
00000400:00000200:29.0:1773851883.669957:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008db1c05e nid 23424@kfi7 refs 2
00000400:00000200:29.0:1773851883.669959:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008db1c05e nid 23424@kfi7 refs 3
00000400:00000200:29.0:1773851883.669960:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23424@kfi7 local destination
00000400:00000200:29.0:1773851883.669961:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769770:8769770:1024:4294967295] 23424@kfi7 LPNI seq info [499149:499149:16:4294967295]
00000400:00000200:29.0:1773851883.669962:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008db1c05e nid 23424@kfi7 refs 2
00000400:00000200:29.0:1773851883.669963:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23424@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.669965:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23424@kfi7(23424@kfi7:23424@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851883.669966:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008db1c05e nid 23424@kfi7 refs 3
00000800:00000200:29.0:1773851883.669967:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.669968:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851883.669970:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851883.669972:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1011 Using peer 23424@kfi7(0x1011)
00000800:00000200:29.0:1773851883.669976:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0x1011: rc=0
00000800:00000200:29.0:1773851883.669977:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1011 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851883.669979:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.669980:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fedcfdd7 refcount 2 to 23361@kfi7
00010000:00000001:29.0:1773851883.669980:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851883.669981:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.669981:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851883.669982:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000008df5d4a x1859317641282944/t0(0) o400->d62eba99-88d2-426a-95f0-a77d60577709@23361@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1956-0'
00000100:00100000:29.0:1773851883.669985:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008df5d4a pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:d62eba99-88d2-426a-95f0-a77d60577709+6:39564:x1859317641282944:12345-23361@kfi7:400:default-tuolumne1956-0 Request processed in 58us (94us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851883.669987:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23361@kfi7, seq: 2055562
00000100:00000040:29.0:1773851883.669988:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000698d93d0 : new rpc_count 0
00000800:00000200:30.0:1773851883.669989:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1011 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851883.669989:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851883.669990:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851883.669990:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851883.669991:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851883.669991:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000200:30.0:1773851883.669992:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23424@kfi7: PUT: OK
00000020:00000010:29.0:1773851883.669992:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000cd8161e.
00000400:00000200:30.0:1773851883.669993:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000906c4b9a
00000400:00000010:30.0:1773851883.669993:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000906c4b9a.
00000020:00000040:29.0:1773851883.669993:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000698d93d0 : new refcount 5
00000100:00000001:30.0:1773851883.669994:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851883.669994:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.669995:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851883.669996:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008db1c05e nid 23424@kfi7 refs 2
00000800:00000200:30.0:1773851883.669997:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 23424@kfi7(000000009bb52c9c):0x0 lsk 4114 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1011 Transaction freed
00000800:00000200:9.0:1773851883.754181:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851883.754183:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851883.754185:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851883.754189:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851883.754192:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9298@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.754194:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9298@kfi7 : PUT - for me
00000400:00000200:9.0:1773851883.754195:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9298@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.754196:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 1
00000400:00000200:9.0:1773851883.754198:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9298@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.754199:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 2
00000400:00000200:9.0:1773851883.754200:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 3
00000400:00000200:9.0:1773851883.754202:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9362@kfi7 to cpt 5
00000400:00000200:9.0:1773851883.754203:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9362@kfi7 of length 224 into portal 12 MB=0x699e14e249e80
00000400:00000200:9.0:1773851883.754206:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9362@kfi7 of length 224/224 into md 0x78146ce49 [64] + 147328
00000800:00000200:9.0:1773851883.754208:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851883.754211:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851883.754213:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9298@kfi7: PUT: OK
00000100:00000001:9.0:1773851883.754214:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851883.754215:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851883.754216:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cd190731.
00000100:00000040:9.0:1773851883.754217:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000cd190731 x1858042817977984 msgsize 224
00000100:00100000:9.0:1773851883.754220:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-9362@kfi7 (source: 12345-9298@kfi7)
00000100:00000001:9.0:1773851883.754222:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851883.754223:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 2
00000100:00000001:11.0:1773851883.754224:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851883.754225:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851883.754225:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851883.754226:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851883.754226:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851883.754228:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851883.754229:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042817977984
00000020:00000001:11.0:1773851883.754230:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851883.754230:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9141a
00000020:00000001:11.0:1773851883.754231:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851883.754237:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c894bee8 refcount=445
00000020:00000001:11.0:1773851883.754238:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240780800 : -107152468770816 : ffff9e8b9f298000)
00000020:00000001:11.0:1773851883.754239:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240780800 : -107152468770816 : ffff9e8b9f298000)
00000100:00000001:11.0:1773851883.754241:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851883.754242:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851883.754243:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000dad0a37.
00000020:00000010:11.0:1773851883.754245:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851883.754246:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004334b4cb.
00000100:00000001:11.0:1773851883.754247:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851883.754248:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851883.754249:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.754250:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851883.754251:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851883.754251:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.754253:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851883.754255:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851883.754256:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851883.754256:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851883.754256:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851883.754258:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9362@kfi7, seq: 2130819
00000100:00000040:8.0:1773851883.754259:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c894bee8 : new rpc_count 5
00000100:00000001:11.0:1773851883.754260:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851883.754260:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.754260:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162654720 : -106971546896896 : ffff9eb5bef23600)
00000100:00000040:8.0:1773851883.754262:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cd190731 x1858042817977984/t0(0) o400->7c16d158-8ab1-4a3c-916a-c05459bcd3f4@9362@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1078-0'
00000100:00000001:8.0:1773851883.754267:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851883.754268:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851883.754269:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd190731 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7c16d158-8ab1-4a3c-916a-c05459bcd3f4+445:39783:x1858042817977984:12345-9362@kfi7:400:default-tuolumne1078-0
00000100:00000200:8.0:1773851883.754272:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042817977984
00000020:00000001:8.0:1773851883.754273:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851883.754274:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851883.754275:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851883.754276:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851883.754277:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851883.754278:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851883.754279:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042817977984, found 0 last_xid 1858042810905279
00000020:00000001:8.0:1773851883.754281:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851883.754282:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851883.754282:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851883.754283:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851883.754284:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851883.754285:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851883.754286:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851883.754287:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002f409275.
02000000:00000001:8.0:1773851883.754289:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.754290:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851883.754291:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851883.754292:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583292, transno 0, xid 1858042817977984
00010000:00000001:8.0:1773851883.754294:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851883.754295:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cd190731 x1858042817977984/t0(0) o400->7c16d158-8ab1-4a3c-916a-c05459bcd3f4@9362@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1078-0'
00010000:00000001:8.0:1773851883.754299:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851883.754300:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851883.754301:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=116 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851883.754303:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851883.754304:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000405af361 refcount 3 to 9362@kfi7
00000100:00000001:8.0:1773851883.754306:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450272 : -107146752101344 : ffff9e8cf3e6f420)
02000000:00000001:8.0:1773851883.754307:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851883.754308:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851883.754309:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851883.754310:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9298@kfi7
00000400:00000010:8.0:1773851883.754311:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054a4b090.
00000100:00000200:8.0:1773851883.754312:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042817977984, offset 224
00000400:00000200:8.0:1773851883.754315:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9298@kfi7
00000400:00000200:8.0:1773851883.754316:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9298@kfi7 to cpt 2
00000400:00000200:8.0:1773851883.754317:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 1
00000400:00000200:8.0:1773851883.754319:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 2
00000400:00000200:8.0:1773851883.754321:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 3
00000400:00000200:8.0:1773851883.754323:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9298@kfi7 local destination
00000400:00000200:8.0:1773851883.754325:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769771:8769771:1024:4294967295] 9298@kfi7 LPNI seq info [8994561:8994561:16:4294967295]
00000400:00000200:8.0:1773851883.754327:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 2
00000400:00000200:8.0:1773851883.754328:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9298@kfi7 to cpt 2
00000400:00000200:8.0:1773851883.754332:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9298@kfi7(9298@kfi7:9298@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851883.754334:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 3
00000800:00000200:8.0:1773851883.754336:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851883.754338:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851883.754342:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851883.754345:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000c64 Using peer 9298@kfi7(0x100000000000c64)
00000800:00000200:8.0:1773851883.754350:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x100000000000c64: rc=0
00000800:00000200:8.0:1773851883.754353:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000c64 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851883.754356:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851883.754357:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000405af361 refcount 2 to 9362@kfi7
00010000:00000001:8.0:1773851883.754358:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851883.754359:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851883.754363:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851883.754364:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cd190731 x1858042817977984/t0(0) o400->7c16d158-8ab1-4a3c-916a-c05459bcd3f4@9362@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1078-0'
00000100:00100000:8.0:1773851883.754369:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd190731 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7c16d158-8ab1-4a3c-916a-c05459bcd3f4+445:39783:x1858042817977984:12345-9362@kfi7:400:default-tuolumne1078-0 Request processed in 101us (151us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851883.754373:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9362@kfi7, seq: 2130819
00000100:00000040:8.0:1773851883.754374:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c894bee8 : new rpc_count 4
00000100:00000001:8.0:1773851883.754375:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851883.754376:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851883.754377:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:8.0:1773851883.754379:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004334b4cb.
00000020:00000010:8.0:1773851883.754380:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000dad0a37.
00000020:00000040:8.0:1773851883.754382:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c894bee8 : new refcount 444
00000100:00000001:8.0:1773851883.754383:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851883.754390:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000c64 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851883.754393:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851883.754395:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9298@kfi7: PUT: OK
00000400:00000200:9.0:1773851883.754396:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054a4b090
00000400:00000010:9.0:1773851883.754397:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054a4b090.
00000100:00000001:9.0:1773851883.754399:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851883.754399:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851883.754401:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6e4bb8e nid 9298@kfi7 refs 2
00000800:00000200:9.0:1773851883.754403:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 9298@kfi7(000000000de4c308):0x0 lsk 3173 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000c64 Transaction freed
00000800:00000200:9.0:1773851883.789837:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851883.789838:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851883.789839:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851883.789841:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851883.789843:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.789844:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.22@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851883.789845:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851883.789846:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851883.789847:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.22@o2ib60 to cpt 7
00000400:00000200:9.0:1773851883.789848:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 2
00000400:00000200:9.0:1773851883.789849:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 3
00000400:00000200:9.0:1773851883.789850:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.22@o2ib60 to cpt 7
00000400:00000200:9.0:1773851883.789851:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.22@o2ib60 of length 224 into portal 12 MB=0x69b1932774140
00000400:00000200:9.0:1773851883.789853:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.22@o2ib60 of length 224/224 into md 0x77fe139dd [64] + 191952
00000800:00000200:9.0:1773851883.789854:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851883.789856:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851883.789857:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851883.789858:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851883.789859:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851883.789859:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c2a6e4df.
00000100:00000040:9.0:1773851883.789860:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c2a6e4df x1859382383427904 msgsize 224
00000100:00100000:9.0:1773851883.789862:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.22@o2ib60 (source: 12345-192.168.128.22@o2ib60)
00000100:00000001:9.0:1773851883.789864:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851883.789865:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851883.789866:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851883.789867:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851883.789868:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851883.789868:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851883.789869:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851883.789870:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.789870:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859382383427904
00000020:00000001:29.0:1773851883.789871:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851883.789871:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae625ad
00000020:00000001:29.0:1773851883.789872:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851883.789875:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000043ba3412 refcount=859
00000020:00000001:29.0:1773851883.789875:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928631480320 : -107145078071296 : ffff9e8d57aea000)
00000020:00000001:29.0:1773851883.789876:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928631480320 : -107145078071296 : ffff9e8d57aea000)
00000100:00000001:29.0:1773851883.789877:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.789879:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851883.789879:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000cd8161e.
00000020:00000010:29.0:1773851883.789880:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.789881:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851883.789882:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851883.789882:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851883.789883:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.789884:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851883.789884:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851883.789885:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.789886:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.789887:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851883.789888:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851883.789888:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851883.789888:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851883.789889:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.22@o2ib60, seq: 2055563
00000100:00000001:30.0:1773851883.789890:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.789890:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000043ba3412 : new rpc_count 2
00000100:00000001:29.0:1773851883.789890:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162668544 : -106971546883072 : ffff9eb5bef26c00)
00000100:00000001:30.0:1773851883.789891:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.789892:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c2a6e4df x1859382383427904/t0(0) o400->107bb794-15dd-432e-83be-a15ea9179233@192.168.128.22@o2ib60:671/0 lens 224/0 e 0 to 0 dl 1773852031 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix22-0'
00000100:00000001:29.0:1773851883.789895:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.789896:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851883.789897:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2a6e4df pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:107bb794-15dd-432e-83be-a15ea9179233+859:39869:x1859382383427904:12345-192.168.128.22@o2ib60:400:default-matrix22-0
00000100:00000200:29.0:1773851883.789899:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859382383427904
00000020:00000001:29.0:1773851883.789899:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851883.789900:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851883.789901:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.789901:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851883.789902:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851883.789903:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851883.789903:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859382383427904, found 0 last_xid 1859382383185087
00000020:00000001:29.0:1773851883.789904:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851883.789905:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851883.789905:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851883.789906:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.789907:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851883.789907:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851883.789908:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851883.789910:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d23aa690.
02000000:00000001:29.0:1773851883.789911:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.789911:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.789912:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851883.789912:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256272491, transno 0, xid 1859382383427904
00010000:00000001:29.0:1773851883.789913:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851883.789914:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c2a6e4df x1859382383427904/t0(0) o400->107bb794-15dd-432e-83be-a15ea9179233@192.168.128.22@o2ib60:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix22-0'
00010000:00000001:29.0:1773851883.789916:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851883.789917:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851883.789918:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=116 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851883.789919:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851883.789920:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bf08c7d9 refcount 3 to 192.168.128.22@o2ib60
00000100:00000001:29.0:1773851883.789920:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064704 : -107155994486912 : ffff9e8acd035780)
02000000:00000001:29.0:1773851883.789921:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851883.789922:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.789923:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.789924:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.22@o2ib60
00000400:00000010:29.0:1773851883.789924:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1fc7045.
00000100:00000200:29.0:1773851883.789925:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859382383427904, offset 224
00000400:00000200:29.0:1773851883.789927:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.22@o2ib60
00000400:00000200:29.0:1773851883.789928:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.22@o2ib60 to cpt 7
00000400:00000200:29.0:1773851883.789929:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 2
00000400:00000200:29.0:1773851883.789930:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 3
00000400:00000200:29.0:1773851883.789932:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 4
00000400:00000200:29.0:1773851883.789933:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.22@o2ib60 routed destination
00000400:00000200:29.0:1773851883.789934:0:60533:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:29.0:1773851883.789935:0:60533:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:29.0:1773851883.789937:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.22@o2ib60: rtr pref emtpy: 1
00000400:00000200:29.0:1773851883.789938:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:29.0:1773851883.789939:0:60533:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.22@o2ib60: rtr pref emtpy: 1
00000400:00000200:29.0:1773851883.789940:0:60533:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:29.0:1773851883.789941:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769772:8769772:1024:4294967295] 2094@kfi7 LPNI seq info [1258747015:1258747015:16:4294967295]
00000400:00000200:29.0:1773851883.789943:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:29.0:1773851883.789944:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:29.0:1773851883.789946:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.22@o2ib60(192.168.128.22@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851883.789948:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 3
00000800:00000200:29.0:1773851883.789949:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.789950:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851883.789952:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851883.789955:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:29.0:1773851883.789958:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:29.0:1773851883.789959:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851883.789961:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.789962:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bf08c7d9 refcount 2 to 192.168.128.22@o2ib60
00010000:00000001:29.0:1773851883.789963:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851883.789963:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.789964:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851883.789965:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c2a6e4df x1859382383427904/t0(0) o400->107bb794-15dd-432e-83be-a15ea9179233@192.168.128.22@o2ib60:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix22-0'
00000100:00100000:29.0:1773851883.789968:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2a6e4df pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:107bb794-15dd-432e-83be-a15ea9179233+859:39869:x1859382383427904:12345-192.168.128.22@o2ib60:400:default-matrix22-0 Request processed in 72us (107us total) trans 0 rc 0/0
00000800:00000200:30.0:1773851883.789970:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:29.0:1773851883.789971:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.22@o2ib60, seq: 2055563
00000100:00000040:29.0:1773851883.789971:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000043ba3412 : new rpc_count 1
00000400:00000200:30.0:1773851883.789972:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851883.789972:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:30.0:1773851883.789973:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.789973:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:30.0:1773851883.789974:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1fc7045
00000020:00000010:29.0:1773851883.789974:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.789974:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000010:30.0:1773851883.789975:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1fc7045.
00000100:00000001:30.0:1773851883.789975:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:29.0:1773851883.789975:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000cd8161e.
00000100:00000001:30.0:1773851883.789976:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:29.0:1773851883.789976:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000043ba3412 : new refcount 858
00000400:00000200:30.0:1773851883.789977:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:29.0:1773851883.789977:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851883.789978:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Transaction freed
00000004:00000001:29.0:1773851883.849731:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851883.849732:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851883.849732:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1522f00.
00000020:00000040:29.0:1773851883.849733:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000004:00000001:25.0:1773851883.849733:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:29.0:1773851883.849734:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:25.0:1773851883.849734:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:29.0:1773851883.849735:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:25.0:1773851883.849735:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000180d3c9f.
02000000:00000001:29.0:1773851883.849736:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:25.0:1773851883.849736:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
02000000:00000010:29.0:1773851883.849737:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:25.0:1773851883.849737:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851883.849738:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851883.849738:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:29.0:1773851883.849739:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851883.849740:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851883.849740:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.849741:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f1522f00] to pc [ptlrpcd_07_02+2]  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:25.0:1773851883.849741:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000fc341f21.
00000100:00000001:25.0:1773851883.849743:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851883.849745:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:29.0:1773851883.849746:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:25.0:1773851883.849746:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.849747:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851883.849747:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851883.849748:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851883.849748:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:29.0:1773851883.849748:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004b2bac97.
00000100:00000001:28.0:1773851883.849748:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851883.849748:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000180d3c9f] to pc [ptlrpcd_06_03+3]  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851883.849749:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851883.849749:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636955482308608 : -107118227243008 : ffff9e93981dc000)
00080000:00000001:29.0:1773851883.849750:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851883.849751:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851883.849751:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000100:00000001:30.0:1773851883.849752:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:29.0:1773851883.849752:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000fe342f04.
00000100:00000001:30.0:1773851883.849753:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:29.0:1773851883.849753:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614158303028416ns, next at 614159303027534ns, rc = 0
02000000:00000001:30.0:1773851883.849754:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:30.0:1773851883.849754:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851883.849754:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:25.0:1773851883.849754:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00100000:30.0:1773851883.849755:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f1522f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051934912:2090@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851883.849755:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851883.849755:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.849755:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851883.849756:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851883.849757:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:27.0:1773851883.849757:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851883.849757:0:41087:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:25.0:1773851883.849757:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000002f44558a.
02000000:00000001:30.0:1773851883.849758:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:27.0:1773851883.849758:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851883.849758:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:25.0:1773851883.849758:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637020698513408 : -107053011038208 : ffff9ea2c74e1000)
02000000:00000001:30.0:1773851883.849759:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851883.849759:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:25.0:1773851883.849759:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000010:30.0:1773851883.849760:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000009f1993ff.
00000100:00000001:26.0:1773851883.849760:0:41087:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:30.0:1773851883.849761:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.849761:0:41087:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851883.849761:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851883.849762:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
02000000:00000001:26.0:1773851883.849762:0:41087:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:26.0:1773851883.849762:0:41087:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:25.0:1773851883.849762:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000400:00000010:30.0:1773851883.849763:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000010:30.0:1773851883.849763:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00100000:26.0:1773851883.849763:0:41087:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000180d3c9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_03:lustre5-MDT0001-mdtlov_UUID:41087:1859433051934976:2068@kfi7:13:default-yuba2-0
00000004:00000010:25.0:1773851883.849764:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004d77e57b.
00000100:00000200:30.0:1773851883.849765:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934912, portal 4
00000100:00000001:26.0:1773851883.849765:0:41087:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:26.0:1773851883.849765:0:41087:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:30.0:1773851883.849766:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851883.849766:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637058761471488 : -107014948080128 : ffff9eaba408b600)
02000000:00000001:26.0:1773851883.849766:0:41087:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:25.0:1773851883.849766:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614158303041210ns, next at 614159303038976ns, rc = 0
02000000:00000001:26.0:1773851883.849767:0:41087:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:25.0:1773851883.849767:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:30.0:1773851883.849768:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:26.0:1773851883.849768:0:41087:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e7700903.
02000000:00000001:26.0:1773851883.849768:0:41087:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851883.849769:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.849770:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:26.0:1773851883.849770:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000004:00000001:25.0:1773851883.849770:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851883.849771:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:26.0:1773851883.849771:0:41087:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f00e36c9.
00000400:00000010:30.0:1773851883.849772:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000086f5fbd7.
00000400:00000010:26.0:1773851883.849772:0:41087:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004b36f071.
00000100:00000200:30.0:1773851883.849773:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934912, offset 0
00000100:00000200:26.0:1773851883.849773:0:41087:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051934976, portal 4
00000400:00000200:30.0:1773851883.849774:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000100:00000001:26.0:1773851883.849774:0:41087:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:26.0:1773851883.849774:0:41087:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637106252459264 : -106967457092352 : ffff9eb6b2b7ad00)
00000400:00000200:30.0:1773851883.849775:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:30.0:1773851883.849776:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000100:00000040:26.0:1773851883.849776:0:41087:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851883.849777:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:30.0:1773851883.849778:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000001:26.0:1773851883.849778:0:41087:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851883.849779:0:41087:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000200:30.0:1773851883.849780:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000010:26.0:1773851883.849780:0:41087:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ec73ae2a.
00000100:00000200:26.0:1773851883.849781:0:41087:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051934976, offset 0
00000400:00000200:30.0:1773851883.849782:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769770, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769772, p:4294967295, g:4294967295, h:1000]
00000400:00000200:26.0:1773851883.849782:0:41087:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:30.0:1773851883.849784:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:26.0:1773851883.849784:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:30.0:1773851883.849785:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851883.849785:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:26.0:1773851883.849785:0:41087:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:30.0:1773851883.849786:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769773:8769773:1024:4294967295] 2090@kfi7 LPNI seq info [5404253:5404253:16:4294967295]
00000400:00000200:26.0:1773851883.849786:0:41087:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:26.0:1773851883.849787:0:41087:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851883.849788:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:26.0:1773851883.849788:0:41087:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:30.0:1773851883.849789:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:26.0:1773851883.849790:0:41087:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769773, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769772, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851883.849791:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851883.849792:0:41087:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851883.849793:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:26.0:1773851883.849793:0:41087:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851883.849794:0:41087:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000800:00000200:30.0:1773851883.849795:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:26.0:1773851883.849795:0:41087:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769774:8769774:1024:4294967295] 2068@kfi7 LPNI seq info [5403701:5403701:16:4294967295]
00000800:00000200:30.0:1773851883.849796:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:26.0:1773851883.849797:0:41087:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:30.0:1773851883.849798:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:26.0:1773851883.849798:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:30.0:1773851883.849801:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000400:00000200:26.0:1773851883.849801:0:41087:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851883.849803:0:41087:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:26.0:1773851883.849804:0:41087:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:30.0:1773851883.849805:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000bfd826e8: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:30.0:1773851883.849806:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:26.0:1773851883.849806:0:41087:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:30.0:1773851883.849808:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851883.849808:0:41087:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:30.0:1773851883.849809:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851883.849809:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851883.849810:0:41087:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000100:00000001:30.0:1773851883.849811:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.849811:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.849812:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851883.849813:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851883.849814:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851883.849814:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:26.0:1773851883.849814:0:41087:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000100:00000001:30.0:1773851883.849815:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.849815:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851883.849815:0:41087:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:29.0:1773851883.849816:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851883.849817:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851883.849817:0:41087:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.849818:0:41087:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851883.849819:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000100:00000001:26.0:1773851883.849819:0:41087:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851883.849820:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000086f5fbd7
00000400:00000010:29.0:1773851883.849820:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000086f5fbd7.
00000100:00000001:26.0:1773851883.849820:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.849821:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:26.0:1773851883.849821:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:29.0:1773851883.849822:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851883.849822:0:41087:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851883.849822:0:41087:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:26.0:1773851883.849823:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851883.849824:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:26.0:1773851883.849824:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851883.849824:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.849825:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851883.849825:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851883.849827:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851883.849828:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.849828:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851883.849829:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000800:00000200:29.0:1773851883.849830:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000400:00000200:25.0:1773851883.849830:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851883.849832:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000400:00000200:25.0:1773851883.849833:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ec73ae2a
00000400:00000010:25.0:1773851883.849834:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ec73ae2a.
00000100:00000001:25.0:1773851883.849835:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:25.0:1773851883.849836:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851883.849841:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:25.0:1773851883.849842:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851883.849846:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851883.849847:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:1.0:1773851883.849847:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:25.0:1773851883.849848:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:1.0:1773851883.849848:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851883.849850:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Transaction freed
00000800:00000200:1.0:1773851883.849850:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851883.849852:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851883.849855:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.849856:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:1.0:1773851883.849857:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.849858:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:1.0:1773851883.849859:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851883.849860:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851883.849861:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:21.0:1773851883.849863:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:1.0:1773851883.849863:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851883.849864:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:1.0:1773851883.849864:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b50c0
00000400:00000200:1.0:1773851883.849865:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851883.849866:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851883.849867:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71de61 [1] + 224
00000800:00000200:21.0:1773851883.849868:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851883.849869:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851883.849870:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.849872:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:21.0:1773851883.849872:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851883.849872:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.849873:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:1.0:1773851883.849873:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:21.0:1773851883.849874:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000001:1.0:1773851883.849874:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851883.849875:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:21.0:1773851883.849876:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000100:00000200:1.0:1773851883.849876:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851883.849877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851883.849877:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5100
00000400:00000200:21.0:1773851883.849878:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000040:1.0:1773851883.849879:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851883.849880:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d16b5 [1] + 224
00000800:00000200:21.0:1773851883.849881:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851883.849883:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851883.849884:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:1.0:1773851883.849884:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851883.849885:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851883.849886:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851883.849887:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:21.0:1773851883.849887:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:1.0:1773851883.849887:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851883.849888:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851883.849888:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:21.0:1773851883.849888:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851883.849889:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851883.849890:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:30.0:1773851883.849891:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000040:21.0:1773851883.849891:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851883.849892:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:30.0:1773851883.849893:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851883.849895:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:30.0:1773851883.849896:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851883.849896:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:26.0:1773851883.849897:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:21.0:1773851883.849897:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851883.849898:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851883.849898:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851883.849899:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.849899:0:41090:0:(client.c:1428:after_reply()) Process entered
00000400:00000001:26.0:1773851883.849899:0:41087:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:26.0:1773851883.849899:0:41087:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:30.0:1773851883.849900:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851883.849900:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:26.0:1773851883.849900:0:41087:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f00e36c9.
00000100:00000001:30.0:1773851883.849901:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851883.849901:0:41087:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004b36f071
02000000:00000001:30.0:1773851883.849902:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:26.0:1773851883.849902:0:41087:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004b36f071.
00000100:00001000:30.0:1773851883.849903:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=116 v=66 (66 66 66 66)
00000100:00000001:26.0:1773851883.849903:0:41087:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:30.0:1773851883.849904:0:41090:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=116 v=66 (1 1 1 1)
00000100:00000200:26.0:1773851883.849904:0:41087:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851883.849905:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851883.849906:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851883.849906:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851883.849907:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:26.0:1773851883.849907:0:41087:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851883.849908:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851883.849908:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:30.0:1773851883.849909:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851883.849909:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851883.849910:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851883.849910:0:41087:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851883.849910:0:41087:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851883.849911:0:41087:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:26.0:1773851883.849911:0:41087:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:26.0:1773851883.849912:0:41087:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851883.849912:0:41087:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.849913:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:26.0:1773851883.849913:0:41087:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851883.849914:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00001000:26.0:1773851883.849914:0:41087:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=116 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851883.849915:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851883.849915:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:26.0:1773851883.849915:0:41087:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=116 v=66 (1 1 1 1)
00000004:00000040:30.0:1773851883.849916:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851883.849917:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351388944384 avail=351386287104 avail_mb=1372602684 hwm_mb=3131103 files=372019025 ffree=343153266 state=0: rc = 0
00000100:00000001:26.0:1773851883.849917:0:41087:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:26.0:1773851883.849917:0:41087:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851883.849918:0:41087:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:30.0:1773851883.849919:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351388944384 free, 351386287104 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019025 files, 343153266 free files
00010000:00000001:26.0:1773851883.849919:0:41087:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.849920:0:41087:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:26.0:1773851883.849920:0:41087:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000004:00000001:30.0:1773851883.849921:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.849921:0:41087:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851883.849921:0:41087:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851883.849922:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:26.0:1773851883.849922:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:30.0:1773851883.849925:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f1522f00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051934912:2090@kfi7:13:default-yuba2-0
00000100:00000001:26.0:1773851883.849925:0:41087:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851883.849926:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851883.849926:0:41087:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:26.0:1773851883.849926:0:41087:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.849927:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:26.0:1773851883.849927:0:41087:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:30.0:1773851883.849928:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f1522f00 x1859433051934912/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:26.0:1773851883.849928:0:41087:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:26.0:1773851883.849928:0:41087:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350959007744 avail=350956974080 avail_mb=1370925680 hwm_mb=3131103 files=371563974 ffree=342733406 state=0: rc = 0
00000100:00000001:30.0:1773851883.849930:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851883.849931:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851883.849931:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000009f1993ff.
00000004:00000020:26.0:1773851883.849931:0:41087:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350959007744 free, 350956974080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371563974 files, 342733406 free files
00000004:00000001:26.0:1773851883.849932:0:41087:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851883.849933:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851883.849933:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851883.849933:0:41090:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000100:00000040:26.0:1773851883.849933:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:30.0:1773851883.849934:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851883.849935:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
02000000:00000001:30.0:1773851883.849936:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851883.849936:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00100000:26.0:1773851883.849936:0:41087:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000180d3c9f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_03:lustre5-MDT0001-mdtlov_UUID:41087:1859433051934976:2068@kfi7:13:default-yuba2-0
00000100:00000010:30.0:1773851883.849937:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1522f00.
00000100:00000001:30.0:1773851883.849938:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851883.849938:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851883.849938:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.849939:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851883.849939:0:41087:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851883.849940:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851883.849940:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851883.849940:0:41087:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000180d3c9f x1859433051934976/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852036 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851883.849941:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851883.849941:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.849942:0:41087:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:26.0:1773851883.849943:0:41087:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:26.0:1773851883.849943:0:41087:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e7700903.
02000000:00000001:26.0:1773851883.849944:0:41087:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851883.849945:0:41087:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851883.849946:0:41087:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:26.0:1773851883.849946:0:41087:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:26.0:1773851883.849947:0:41087:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000fc341f21.
02000000:00000001:26.0:1773851883.849948:0:41087:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851883.849948:0:41087:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851883.849949:0:41087:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000180d3c9f.
00000100:00000001:26.0:1773851883.849950:0:41087:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851883.849950:0:41087:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851883.849951:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851883.849951:0:41087:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851883.849952:0:41087:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.849952:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851883.849953:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851883.875748:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851883.875748:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851883.875750:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851883.875752:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851883.875754:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21824@kfi7 to cpt 6
00000400:00000200:26.0:1773851883.875755:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21824@kfi7 : PUT - for me
00000400:00000200:26.0:1773851883.875756:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21824@kfi7 to cpt 6
00000400:00000200:26.0:1773851883.875757:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f64f7103 nid 21824@kfi7 refs 1
00000400:00000200:26.0:1773851883.875758:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21824@kfi7 to cpt 6
00000400:00000200:26.0:1773851883.875759:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f64f7103 nid 21824@kfi7 refs 2
00000400:00000200:26.0:1773851883.875760:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f64f7103 nid 21824@kfi7 refs 3
00000400:00000200:26.0:1773851883.875761:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21888@kfi7 to cpt 1
00000400:00000200:26.0:1773851883.875762:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21888@kfi7 of length 224 into portal 12 MB=0x69b4c39411440
00000400:00000200:26.0:1773851883.875763:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21888@kfi7 of length 224/224 into md 0x16159c9699 [64] + 28608
00000800:00000200:26.0:1773851883.875765:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851883.875767:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851883.875768:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21824@kfi7: PUT: OK
00000100:00000001:26.0:1773851883.875769:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851883.875770:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851883.875771:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000017093a6a.
00000100:00000040:26.0:1773851883.875772:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000017093a6a x1859601540650048 msgsize 224
00000100:00100000:26.0:1773851883.875774:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-21888@kfi7 (source: 12345-21824@kfi7)
00000100:00000001:26.0:1773851883.875775:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851883.875776:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f64f7103 nid 21824@kfi7 refs 2
00000800:00000200:26.0:1773851883.875778:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851883.875781:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851883.875781:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851883.875782:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851883.875782:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851883.875783:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851883.875784:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601540650048
00000020:00000001:26.0:1773851883.875785:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851883.875785:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff75f2e
00000020:00000001:26.0:1773851883.875786:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851883.875788:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008ee0e70f refcount=5
00000020:00000001:26.0:1773851883.875789:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103051436032 : -106970658115584 : ffff9eb5f3ebf000)
00000020:00000001:26.0:1773851883.875790:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637103051436032 : -106970658115584 : ffff9eb5f3ebf000)
00000100:00000001:26.0:1773851883.875791:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851883.875792:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851883.875792:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd5c6346.
00000020:00000010:26.0:1773851883.875793:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851883.875794:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000051cbc4a7.
00000100:00000001:26.0:1773851883.875795:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851883.875796:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851883.875796:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851883.875797:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851883.875798:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851883.875798:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.875799:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851883.875801:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851883.875801:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851883.875801:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851883.875801:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851883.875803:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21888@kfi7, seq: 2025149
00000100:00000040:27.0:1773851883.875803:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008ee0e70f : new rpc_count 1
00000100:00000001:27.0:1773851883.875804:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144347095424 : -106929362456192 : ffff9ebf9155b180)
00000100:00000001:26.0:1773851883.875804:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851883.875804:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851883.875805:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000017093a6a x1859601540650048/t0(0) o400->8ba86647-5042-4b09-8393-7928f9d67aa0@21888@kfi7:133/0 lens 224/0 e 0 to 0 dl 1773852248 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1860-0'
00000100:00000001:27.0:1773851883.875808:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851883.875809:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851883.875810:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000017093a6a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:8ba86647-5042-4b09-8393-7928f9d67aa0+5:39666:x1859601540650048:12345-21888@kfi7:400:default-tuolumne1860-0
00000100:00000200:27.0:1773851883.875811:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601540650048
00000020:00000001:27.0:1773851883.875812:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851883.875813:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851883.875813:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851883.875814:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851883.875815:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851883.875815:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851883.875816:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601540650048, found 0 last_xid 1859601540650047
00000020:00000001:27.0:1773851883.875817:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851883.875817:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851883.875818:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851883.875818:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851883.875819:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851883.875819:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851883.875820:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851883.875821:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000052694ebb.
02000000:00000001:27.0:1773851883.875821:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851883.875822:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851883.875822:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851883.875823:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044152806, transno 0, xid 1859601540650048
00010000:00000001:27.0:1773851883.875824:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851883.875825:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000017093a6a x1859601540650048/t0(0) o400->8ba86647-5042-4b09-8393-7928f9d67aa0@21888@kfi7:133/0 lens 224/224 e 0 to 0 dl 1773852248 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1860-0'
00010000:00000001:27.0:1773851883.875827:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851883.875828:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851883.875828:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=116 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851883.875829:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851883.875830:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004ab351e7 refcount 3 to 21888@kfi7
00000100:00000001:27.0:1773851883.875831:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231613472 : -107130477938144 : ffff9e90bdeafa20)
02000000:00000001:27.0:1773851883.875832:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851883.875832:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851883.875833:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851883.875833:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21824@kfi7
00000400:00000010:27.0:1773851883.875834:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bb280001.
00000100:00000200:27.0:1773851883.875835:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601540650048, offset 224
00000400:00000200:27.0:1773851883.875836:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21824@kfi7
00000400:00000200:27.0:1773851883.875837:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21824@kfi7 to cpt 6
00000400:00000200:27.0:1773851883.875840:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f64f7103 nid 21824@kfi7 refs 1
00000400:00000200:27.0:1773851883.875840:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f64f7103 nid 21824@kfi7 refs 2
00000400:00000200:27.0:1773851883.875842:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f64f7103 nid 21824@kfi7 refs 3
00000400:00000200:27.0:1773851883.875843:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21824@kfi7 local destination
00000400:00000200:27.0:1773851883.875844:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769775:8769775:1024:4294967295] 21824@kfi7 LPNI seq info [525250:525250:16:4294967295]
00000400:00000200:27.0:1773851883.875845:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f64f7103 nid 21824@kfi7 refs 2
00000400:00000200:27.0:1773851883.875846:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21824@kfi7 to cpt 6
00000400:00000200:27.0:1773851883.875848:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21824@kfi7(21824@kfi7:21824@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851883.875849:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f64f7103 nid 21824@kfi7 refs 3
00000800:00000200:27.0:1773851883.875850:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851883.875851:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851883.875853:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851883.875855:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x283 Using peer 21824@kfi7(0x283)
00000800:00000200:27.0:1773851883.875858:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0x283: rc=0
00000800:00000200:27.0:1773851883.875860:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x283 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851883.875862:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851883.875862:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004ab351e7 refcount 2 to 21888@kfi7
00010000:00000001:27.0:1773851883.875863:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851883.875864:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851883.875864:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851883.875865:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000017093a6a x1859601540650048/t0(0) o400->8ba86647-5042-4b09-8393-7928f9d67aa0@21888@kfi7:133/0 lens 224/224 e 0 to 0 dl 1773852248 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1860-0'
00000100:00100000:27.0:1773851883.875868:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000017093a6a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:8ba86647-5042-4b09-8393-7928f9d67aa0+5:39666:x1859601540650048:12345-21888@kfi7:400:default-tuolumne1860-0 Request processed in 59us (95us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851883.875870:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21888@kfi7, seq: 2025149
00000100:00000040:27.0:1773851883.875872:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008ee0e70f : new rpc_count 0
00000800:00000200:26.0:1773851883.875872:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x283 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851883.875873:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851883.875873:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851883.875874:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:26.0:1773851883.875874:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851883.875875:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000051cbc4a7.
00000400:00000200:26.0:1773851883.875875:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21824@kfi7: PUT: OK
00000020:00000010:27.0:1773851883.875876:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd5c6346.
00000020:00000040:27.0:1773851883.875876:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000008ee0e70f : new refcount 4
00000400:00000200:26.0:1773851883.875876:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bb280001
00000100:00000001:27.0:1773851883.875877:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:26.0:1773851883.875877:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bb280001.
00000100:00000001:26.0:1773851883.875878:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851883.875878:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851883.875879:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f64f7103 nid 21824@kfi7 refs 2
00000800:00000200:26.0:1773851883.875881:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 21824@kfi7(00000000127bd200):0x0 lsk 644 rsk 27 tsk 0 trmk 0 tmk 0 trr 6 tta 0x283 Transaction freed
00000800:00000200:18.0:1773851883.876696:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851883.876697:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851883.876698:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851883.876700:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851883.876702:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:18.0:1773851883.876703:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:18.0:1773851883.876704:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:18.0:1773851883.876705:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:18.0:1773851883.876706:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:18.0:1773851883.876707:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:18.0:1773851883.876708:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:18.0:1773851883.876708:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:18.0:1773851883.876709:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e359c0
00000400:00000200:18.0:1773851883.876711:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 34664
00000800:00000200:18.0:1773851883.876713:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851883.876716:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851883.876718:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000100:00000001:18.0:1773851883.876719:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851883.876719:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851883.876720:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cea2f75e.
00000100:00000040:18.0:1773851883.876721:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000cea2f75e x1859316187617728 msgsize 224
00000100:00100000:18.0:1773851883.876723:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:18.0:1773851883.876724:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851883.876730:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:18.0:1773851883.876732:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851883.876734:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851883.876734:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851883.876735:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851883.876736:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851883.876737:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851883.876738:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187617728
00000020:00000001:17.0:1773851883.876739:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851883.876740:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:17.0:1773851883.876741:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851883.876742:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:17.0:1773851883.876744:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:17.0:1773851883.876745:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:17.0:1773851883.876747:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851883.876748:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851883.876749:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009d196d35.
00000020:00000010:17.0:1773851883.876750:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851883.876752:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000032d56dbe.
00000100:00000001:17.0:1773851883.876753:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851883.876754:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851883.876767:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851883.876769:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851883.876769:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851883.876770:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851883.876772:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851883.876774:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851883.876774:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851883.876774:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851883.876775:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851883.876776:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156389
00000100:00000040:16.0:1773851883.876776:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:17.0:1773851883.876777:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851883.876777:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851883.876777:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534672256 : -106946174879360 : ffff9ebba73c7980)
00000100:00000040:16.0:1773851883.876778:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cea2f75e x1859316187617728/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:166/0 lens 224/0 e 0 to 0 dl 1773852281 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:16.0:1773851883.876781:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851883.876782:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851883.876783:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cea2f75e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39684:x1859316187617728:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:16.0:1773851883.876784:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187617728
00000020:00000001:16.0:1773851883.876785:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851883.876786:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851883.876786:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851883.876787:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851883.876787:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851883.876788:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851883.876789:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187617728, found 0 last_xid 1859316186815935
00000020:00000001:16.0:1773851883.876790:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851883.876791:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851883.876791:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851883.876792:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851883.876793:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851883.876793:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851883.876794:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851883.876795:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000be07868d.
02000000:00000001:16.0:1773851883.876795:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851883.876796:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851883.876796:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851883.876797:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187617728
00010000:00000001:16.0:1773851883.876798:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851883.876799:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cea2f75e x1859316187617728/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:166/0 lens 224/224 e 0 to 0 dl 1773852281 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:16.0:1773851883.876801:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851883.876802:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851883.876802:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=116 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851883.876804:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851883.876804:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:16.0:1773851883.876805:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:16.0:1773851883.876806:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851883.876806:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851883.876807:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851883.876808:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:16.0:1773851883.876808:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037f3647a.
00000100:00000200:16.0:1773851883.876809:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187617728, offset 224
00000400:00000200:16.0:1773851883.876811:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:16.0:1773851883.876812:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:16.0:1773851883.876813:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:16.0:1773851883.876814:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:16.0:1773851883.876815:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:16.0:1773851883.876816:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:16.0:1773851883.876818:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769776:8769776:1024:4294967295] 20881@kfi7 LPNI seq info [16890554:16890554:16:4294967295]
00000400:00000200:16.0:1773851883.876820:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:16.0:1773851883.876820:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:16.0:1773851883.876823:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851883.876824:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:16.0:1773851883.876825:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851883.876827:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851883.876829:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851883.876831:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Using peer 20881@kfi7(0x10000000000027f)
00000800:00000200:16.0:1773851883.876834:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x10000000000027f: rc=0
00000800:00000200:16.0:1773851883.876836:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851883.876838:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851883.876839:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:16.0:1773851883.876840:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851883.876840:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851883.876841:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851883.876842:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cea2f75e x1859316187617728/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:166/0 lens 224/224 e 0 to 0 dl 1773852281 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000100:00100000:16.0:1773851883.876846:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cea2f75e pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39684:x1859316187617728:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 64us (125us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851883.876849:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156389
00000100:00000040:16.0:1773851883.876850:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000100:00000001:16.0:1773851883.876851:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851883.876851:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851883.876852:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:16.0:1773851883.876853:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000032d56dbe.
00000020:00000010:16.0:1773851883.876854:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009d196d35.
00000020:00000040:16.0:1773851883.876857:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:16.0:1773851883.876857:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851883.876864:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851883.876866:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851883.876867:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000400:00000200:18.0:1773851883.876868:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037f3647a
00000400:00000010:18.0:1773851883.876868:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037f3647a.
00000100:00000001:18.0:1773851883.876869:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851883.876869:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851883.876870:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:18.0:1773851883.876872:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Transaction freed
00000800:00000200:29.0:1773851883.904165:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.904167:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851883.904168:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851883.904170:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851883.904172:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8818@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.904173:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8818@kfi7 : PUT - for me
00000400:00000200:29.0:1773851883.904174:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8818@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.904175:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4802e38 nid 8818@kfi7 refs 1
00000400:00000200:29.0:1773851883.904176:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8818@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.904177:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4802e38 nid 8818@kfi7 refs 2
00000400:00000200:29.0:1773851883.904178:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f4802e38 nid 8818@kfi7 refs 3
00000400:00000200:29.0:1773851883.904179:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8882@kfi7 to cpt 3
00000400:00000200:29.0:1773851883.904179:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8882@kfi7 of length 224 into portal 12 MB=0x69a9d8dd02300
00000400:00000200:29.0:1773851883.904181:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8882@kfi7 of length 224/224 into md 0x77fe139dd [64] + 192176
00000800:00000200:29.0:1773851883.904183:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851883.904184:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851883.904186:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8818@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.904186:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851883.904187:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851883.904188:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000068759d78.
00000100:00000040:29.0:1773851883.904189:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000068759d78 x1858851340034816 msgsize 224
00000100:00100000:29.0:1773851883.904190:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-8882@kfi7 (source: 12345-8818@kfi7)
00000100:00000001:29.0:1773851883.904192:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851883.904192:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f4802e38 nid 8818@kfi7 refs 2
00000800:00000200:29.0:1773851883.904194:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851883.904196:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851883.904197:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851883.904197:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851883.904198:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851883.904199:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851883.904200:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858851340034816
00000020:00000001:29.0:1773851883.904200:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851883.904201:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91715
00000020:00000001:29.0:1773851883.904201:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851883.904206:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000ce2be64 refcount=9
00000020:00000001:29.0:1773851883.904206:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241475072 : -107152468076544 : ffff9e8b9f341800)
00000020:00000001:29.0:1773851883.904207:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241475072 : -107152468076544 : ffff9e8b9f341800)
00000100:00000001:29.0:1773851883.904208:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.904209:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851883.904210:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a8d492b0.
00000020:00000010:29.0:1773851883.904211:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.904211:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851883.904212:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851883.904213:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851883.904213:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851883.904214:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851883.904215:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851883.904215:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.904216:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851883.904217:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851883.904217:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851883.904218:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851883.904218:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851883.904218:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8882@kfi7, seq: 2055564
00000100:00000001:30.0:1773851883.904219:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.904219:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000ce2be64 : new rpc_count 1
00000100:00000001:30.0:1773851883.904220:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.904220:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058761476096 : -107014948075520 : ffff9eaba408c800)
00000100:00000040:29.0:1773851883.904221:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000068759d78 x1858851340034816/t0(0) o400->af4acc05-4b57-416c-be65-d747feda5149@8882@kfi7:671/0 lens 224/0 e 0 to 0 dl 1773852031 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1034-0'
00000100:00000001:29.0:1773851883.904224:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851883.904224:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851883.904225:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068759d78 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:af4acc05-4b57-416c-be65-d747feda5149+9:39798:x1858851340034816:12345-8882@kfi7:400:default-tuolumne1034-0
00000100:00000200:29.0:1773851883.904226:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858851340034816
00000020:00000001:29.0:1773851883.904227:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851883.904228:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851883.904228:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.904229:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851883.904229:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851883.904230:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851883.904231:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858851340034816, found 0 last_xid 1858851340034815
00000020:00000001:29.0:1773851883.904232:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851883.904233:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851883.904233:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851883.904234:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.904234:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851883.904235:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851883.904235:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851883.904236:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000cd8161e.
02000000:00000001:29.0:1773851883.904236:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.904237:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.904238:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851883.904238:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058216449, transno 0, xid 1858851340034816
00010000:00000001:29.0:1773851883.904239:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851883.904240:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000068759d78 x1858851340034816/t0(0) o400->af4acc05-4b57-416c-be65-d747feda5149@8882@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1034-0'
00010000:00000001:29.0:1773851883.904242:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851883.904243:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851883.904243:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=116 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851883.904244:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851883.904245:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8449464 refcount 3 to 8882@kfi7
00000100:00000001:29.0:1773851883.904246:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642469088 : -107157067082528 : ffff9e8a8d14d4e0)
02000000:00000001:29.0:1773851883.904247:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851883.904247:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851883.904248:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851883.904249:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8818@kfi7
00000400:00000010:29.0:1773851883.904249:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bfe97a25.
00000100:00000200:29.0:1773851883.904250:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858851340034816, offset 224
00000400:00000200:29.0:1773851883.904251:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8818@kfi7
00000400:00000200:29.0:1773851883.904252:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8818@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.904253:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f4802e38 nid 8818@kfi7 refs 1
00000400:00000200:29.0:1773851883.904254:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f4802e38 nid 8818@kfi7 refs 2
00000400:00000200:29.0:1773851883.904255:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f4802e38 nid 8818@kfi7 refs 3
00000400:00000200:29.0:1773851883.904256:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8818@kfi7 local destination
00000400:00000200:29.0:1773851883.904257:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769777:8769777:1024:4294967295] 8818@kfi7 LPNI seq info [2596422:2596422:16:4294967295]
00000400:00000200:29.0:1773851883.904258:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f4802e38 nid 8818@kfi7 refs 2
00000400:00000200:29.0:1773851883.904259:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8818@kfi7 to cpt 7
00000400:00000200:29.0:1773851883.904261:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8818@kfi7(8818@kfi7:8818@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851883.904262:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f4802e38 nid 8818@kfi7 refs 3
00000800:00000200:29.0:1773851883.904263:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851883.904264:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851883.904266:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851883.904268:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf33 Using peer 8818@kfi7(0xf33)
00000800:00000200:29.0:1773851883.904271:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 324 bytes to peer 0xf33: rc=0
00000800:00000200:29.0:1773851883.904272:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf33 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851883.904274:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851883.904275:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8449464 refcount 2 to 8882@kfi7
00010000:00000001:29.0:1773851883.904275:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851883.904276:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851883.904276:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851883.904277:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000068759d78 x1858851340034816/t0(0) o400->af4acc05-4b57-416c-be65-d747feda5149@8882@kfi7:671/0 lens 224/224 e 0 to 0 dl 1773852031 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1034-0'
00000100:00100000:29.0:1773851883.904280:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068759d78 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:af4acc05-4b57-416c-be65-d747feda5149+9:39798:x1858851340034816:12345-8882@kfi7:400:default-tuolumne1034-0 Request processed in 55us (90us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851883.904282:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8882@kfi7, seq: 2055564
00000100:00000040:29.0:1773851883.904283:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000ce2be64 : new rpc_count 0
00000100:00000001:29.0:1773851883.904284:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851883.904284:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:30.0:1773851883.904285:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf33 TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851883.904285:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851883.904286:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851883.904286:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a8d492b0.
00000400:00000200:30.0:1773851883.904287:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:29.0:1773851883.904287:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000000ce2be64 : new refcount 8
00000400:00000200:30.0:1773851883.904288:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8818@kfi7: PUT: OK
00000100:00000001:29.0:1773851883.904288:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851883.904289:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bfe97a25
00000400:00000010:30.0:1773851883.904289:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bfe97a25.
00000100:00000001:30.0:1773851883.904290:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851883.904290:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851883.904291:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f4802e38 nid 8818@kfi7 refs 2
00000800:00000200:30.0:1773851883.904292:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 8818@kfi7(00000000037994ca):0x0 lsk 3892 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf33 Transaction freed
00000800:00000200:5.0:1773851883.908928:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851883.908929:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851883.908930:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851883.908932:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851883.908934:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20003@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.908935:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20003@kfi7 : PUT - for me
00000400:00000200:5.0:1773851883.908935:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20003@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.908936:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003f39ec7a nid 20003@kfi7 refs 1
00000400:00000200:5.0:1773851883.908938:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20003@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.908938:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003f39ec7a nid 20003@kfi7 refs 2
00000400:00000200:5.0:1773851883.908939:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003f39ec7a nid 20003@kfi7 refs 3
00000400:00000200:5.0:1773851883.908940:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20003@kfi7 to cpt 1
00000400:00000200:5.0:1773851883.908941:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20003@kfi7 of length 224 into portal 12 MB=0x69b0a17051bc0
00000400:00000200:5.0:1773851883.908942:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20003@kfi7 of length 224/224 into md 0x793926dc5 [64] + 154544
00000800:00000200:5.0:1773851883.908944:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851883.908945:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851883.908946:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20003@kfi7: PUT: OK
00000100:00000001:5.0:1773851883.908947:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851883.908947:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851883.908948:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000322664ea.
00000100:00000040:5.0:1773851883.908949:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000322664ea x1859317498452928 msgsize 224
00000100:00100000:5.0:1773851883.908950:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20003@kfi7 (source: 12345-20003@kfi7)
00000100:00000001:5.0:1773851883.908951:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851883.908952:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003f39ec7a nid 20003@kfi7 refs 2
00000800:00000200:5.0:1773851883.908953:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851883.908953:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851883.908953:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851883.908954:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851883.908955:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851883.908955:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851883.908956:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317498452928
00000020:00000001:4.0:1773851883.908957:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851883.908957:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92298
00000020:00000001:4.0:1773851883.908958:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851883.908960:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c2ae246a refcount=6
00000020:00000001:4.0:1773851883.908961:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630016000 : -107123079535616 : ffff9e9276e5a400)
00000020:00000001:4.0:1773851883.908962:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630016000 : -107123079535616 : ffff9e9276e5a400)
00000100:00000001:4.0:1773851883.908963:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851883.908964:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851883.908965:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001dd2088e.
00000020:00000010:4.0:1773851883.908966:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851883.908967:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8ab1166.
00000100:00000001:4.0:1773851883.908968:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851883.908969:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851883.908969:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851883.908970:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851883.908971:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851883.908971:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.908972:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851883.908974:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851883.908974:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851883.908974:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851883.908975:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851883.908975:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20003@kfi7, seq: 2001959
00000100:00000001:7.0:1773851883.908976:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851883.908976:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c2ae246a : new rpc_count 1
00000100:00000001:7.0:1773851883.908977:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.908977:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108940800 : -106938600610816 : ffff9ebd6ab2a400)
00000100:00000040:4.0:1773851883.908978:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000322664ea x1859317498452928/t0(0) o400->5ae1c0b9-5b70-42d8-8556-f2d9f8a4db2d@20003@kfi7:610/0 lens 224/0 e 0 to 0 dl 1773851970 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1739-0'
00000100:00000001:4.0:1773851883.908981:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851883.908981:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851883.908982:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000322664ea pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5ae1c0b9-5b70-42d8-8556-f2d9f8a4db2d+6:39531:x1859317498452928:12345-20003@kfi7:400:default-tuolumne1739-0
00000100:00000200:4.0:1773851883.908983:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317498452928
00000020:00000001:4.0:1773851883.908984:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851883.908985:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851883.908985:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.908986:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851883.908986:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851883.908987:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851883.908988:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317498452928, found 0 last_xid 1859317498452927
00000020:00000001:4.0:1773851883.908989:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851883.908990:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851883.908991:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851883.908991:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.908992:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851883.908992:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851883.908993:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851883.908994:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003595cda4.
02000000:00000001:4.0:1773851883.908994:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.908995:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.908996:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851883.908996:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096685763, transno 0, xid 1859317498452928
00010000:00000001:4.0:1773851883.908997:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851883.908998:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000322664ea x1859317498452928/t0(0) o400->5ae1c0b9-5b70-42d8-8556-f2d9f8a4db2d@20003@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1739-0'
00010000:00000001:4.0:1773851883.909000:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851883.909001:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851883.909002:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=115 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851883.909003:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851883.909003:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005c23db17 refcount 3 to 20003@kfi7
00000100:00000001:4.0:1773851883.909004:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412960 : -107145304138656 : ffff9e8d4a351c60)
02000000:00000001:4.0:1773851883.909005:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851883.909006:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851883.909006:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851883.909007:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20003@kfi7
00000400:00000010:4.0:1773851883.909008:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007836e8de.
00000100:00000200:4.0:1773851883.909009:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317498452928, offset 224
00000400:00000200:4.0:1773851883.909010:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20003@kfi7
00000400:00000200:4.0:1773851883.909011:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20003@kfi7 to cpt 1
00000400:00000200:4.0:1773851883.909012:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003f39ec7a nid 20003@kfi7 refs 1
00000400:00000200:4.0:1773851883.909013:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003f39ec7a nid 20003@kfi7 refs 2
00000400:00000200:4.0:1773851883.909014:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003f39ec7a nid 20003@kfi7 refs 3
00000400:00000200:4.0:1773851883.909015:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20003@kfi7 local destination
00000400:00000200:4.0:1773851883.909016:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769778:8769778:1024:4294967295] 20003@kfi7 LPNI seq info [1179087:1179087:16:4294967295]
00000400:00000200:4.0:1773851883.909018:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003f39ec7a nid 20003@kfi7 refs 2
00000400:00000200:4.0:1773851883.909019:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20003@kfi7 to cpt 1
00000400:00000200:4.0:1773851883.909020:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20003@kfi7(20003@kfi7:20003@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851883.909022:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003f39ec7a nid 20003@kfi7 refs 3
00000800:00000200:4.0:1773851883.909023:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851883.909024:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851883.909026:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851883.909028:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf3 Using peer 20003@kfi7(0xf3)
00000800:00000200:4.0:1773851883.909031:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0xf3: rc=0
00000800:00000200:4.0:1773851883.909033:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851883.909035:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851883.909036:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005c23db17 refcount 2 to 20003@kfi7
00010000:00000001:4.0:1773851883.909037:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851883.909037:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851883.909038:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851883.909039:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000322664ea x1859317498452928/t0(0) o400->5ae1c0b9-5b70-42d8-8556-f2d9f8a4db2d@20003@kfi7:610/0 lens 224/224 e 0 to 0 dl 1773851970 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1739-0'
00000100:00100000:4.0:1773851883.909043:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000322664ea pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5ae1c0b9-5b70-42d8-8556-f2d9f8a4db2d+6:39531:x1859317498452928:12345-20003@kfi7:400:default-tuolumne1739-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851883.909046:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20003@kfi7, seq: 2001959
00000100:00000040:4.0:1773851883.909047:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c2ae246a : new rpc_count 0
00000100:00000001:4.0:1773851883.909048:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851883.909048:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851883.909049:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851883.909049:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8ab1166.
00000020:00000010:4.0:1773851883.909050:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001dd2088e.
00000020:00000040:4.0:1773851883.909051:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000c2ae246a : new refcount 5
00000100:00000001:4.0:1773851883.909052:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851883.909057:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf3 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851883.909058:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851883.909059:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20003@kfi7: PUT: OK
00000400:00000200:5.0:1773851883.909060:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007836e8de
00000400:00000010:5.0:1773851883.909060:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007836e8de.
00000100:00000001:5.0:1773851883.909061:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851883.909061:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851883.909062:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003f39ec7a nid 20003@kfi7 refs 2
00000800:00000200:5.0:1773851883.909064:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 20003@kfi7(00000000ae60056e):0x0 lsk 244 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf3 Transaction freed
00000800:00000200:10.0:1773851884.017998:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851884.017999:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851884.018000:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851884.018002:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851884.018004:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22480@kfi7 to cpt 2
00000400:00000200:10.0:1773851884.018005:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22480@kfi7 : PUT - for me
00000400:00000200:10.0:1773851884.018006:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22480@kfi7 to cpt 2
00000400:00000200:10.0:1773851884.018007:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eaa2074 nid 22480@kfi7 refs 1
00000400:00000200:10.0:1773851884.018008:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22480@kfi7 to cpt 2
00000400:00000200:10.0:1773851884.018009:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eaa2074 nid 22480@kfi7 refs 2
00000400:00000200:10.0:1773851884.018010:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004eaa2074 nid 22480@kfi7 refs 3
00000400:00000200:10.0:1773851884.018010:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22481@kfi7 to cpt 5
00000400:00000200:10.0:1773851884.018014:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22481@kfi7 of length 224 into portal 12 MB=0x699e2e3cb9080
00000400:00000200:10.0:1773851884.018015:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22481@kfi7 of length 224/224 into md 0x78146ce49 [64] + 147552
00000800:00000200:10.0:1773851884.018017:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851884.018019:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851884.018020:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22480@kfi7: PUT: OK
00000100:00000001:10.0:1773851884.018021:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851884.018021:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851884.018022:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000016034629.
00000100:00000040:10.0:1773851884.018023:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000016034629 x1858049623691392 msgsize 224
00000100:00100000:10.0:1773851884.018024:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-22481@kfi7 (source: 12345-22480@kfi7)
00000100:00000001:10.0:1773851884.018025:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851884.018026:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004eaa2074 nid 22480@kfi7 refs 2
00000800:00000200:10.0:1773851884.018027:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851884.018027:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851884.018027:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851884.018028:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851884.018028:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851884.018029:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851884.018030:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049623691392
00000020:00000001:8.0:1773851884.018030:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851884.018031:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929e5
00000020:00000001:8.0:1773851884.018031:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851884.018035:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000088ea187f refcount=6
00000020:00000001:8.0:1773851884.018036:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743195648 : -107128966355968 : ffff9e911803e400)
00000020:00000001:8.0:1773851884.018036:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743195648 : -107128966355968 : ffff9e911803e400)
00000100:00000001:8.0:1773851884.018037:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851884.018038:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851884.018039:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e602d741.
00000020:00000010:8.0:1773851884.018040:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851884.018041:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e231bd3.
00000100:00000001:8.0:1773851884.018041:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851884.018042:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851884.018042:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.018043:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851884.018044:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851884.018044:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.018045:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.018046:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.018047:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.018047:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851884.018047:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851884.018048:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22481@kfi7, seq: 2130820
00000100:00000040:8.0:1773851884.018048:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000088ea187f : new rpc_count 1
00000100:00000001:11.0:1773851884.018049:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.018049:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.018049:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087752960 : -106944621798656 : ffff9ebc03ce9b00)
00000100:00000040:8.0:1773851884.018050:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000016034629 x1858049623691392/t0(0) o400->7b8be151-430f-4762-8645-49f603f45f07@22481@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1889-0'
00000100:00000001:8.0:1773851884.018052:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851884.018053:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851884.018053:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000016034629 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7b8be151-430f-4762-8645-49f603f45f07+6:39664:x1858049623691392:12345-22481@kfi7:400:default-tuolumne1889-0
00000100:00000200:8.0:1773851884.018055:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858049623691392
00000020:00000001:8.0:1773851884.018055:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851884.018056:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851884.018056:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.018057:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851884.018057:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851884.018058:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851884.018059:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858049623691392, found 0 last_xid 1858049623691391
00000020:00000001:8.0:1773851884.018060:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851884.018060:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851884.018061:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851884.018061:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.018062:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851884.018062:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851884.018063:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851884.018064:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000507b87d9.
02000000:00000001:8.0:1773851884.018064:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.018065:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.018065:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851884.018066:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044151841, transno 0, xid 1858049623691392
00010000:00000001:8.0:1773851884.018067:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851884.018067:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000016034629 x1858049623691392/t0(0) o400->7b8be151-430f-4762-8645-49f603f45f07@22481@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1889-0'
00010000:00000001:8.0:1773851884.018069:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851884.018070:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851884.018070:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=117 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851884.018071:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851884.018072:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000463cc2c9 refcount 3 to 22481@kfi7
00000100:00000001:8.0:1773851884.018073:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025184 : -107156745526432 : ffff9e8aa03f6360)
02000000:00000001:8.0:1773851884.018073:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851884.018074:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.018074:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851884.018075:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22480@kfi7
00000400:00000010:8.0:1773851884.018075:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7b495c.
00000100:00000200:8.0:1773851884.018076:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858049623691392, offset 224
00000400:00000200:8.0:1773851884.018077:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22480@kfi7
00000400:00000200:8.0:1773851884.018078:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22480@kfi7 to cpt 2
00000400:00000200:8.0:1773851884.018079:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004eaa2074 nid 22480@kfi7 refs 1
00000400:00000200:8.0:1773851884.018080:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004eaa2074 nid 22480@kfi7 refs 2
00000400:00000200:8.0:1773851884.018081:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004eaa2074 nid 22480@kfi7 refs 3
00000400:00000200:8.0:1773851884.018081:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22480@kfi7 local destination
00000400:00000200:8.0:1773851884.018083:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769779:8769779:1024:4294967295] 22480@kfi7 LPNI seq info [1064446:1064446:16:4294967295]
00000400:00000200:8.0:1773851884.018084:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004eaa2074 nid 22480@kfi7 refs 2
00000400:00000200:8.0:1773851884.018085:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22480@kfi7 to cpt 2
00000400:00000200:8.0:1773851884.018087:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22480@kfi7(22480@kfi7:22480@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851884.018088:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004eaa2074 nid 22480@kfi7 refs 3
00000800:00000200:8.0:1773851884.018089:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851884.018090:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851884.018092:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851884.018094:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004d9 Using peer 22480@kfi7(0x1000000000004d9)
00000800:00000200:8.0:1773851884.018096:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x1000000000004d9: rc=0
00000800:00000200:8.0:1773851884.018098:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004d9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851884.018099:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851884.018100:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000463cc2c9 refcount 2 to 22481@kfi7
00010000:00000001:8.0:1773851884.018101:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851884.018101:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.018102:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851884.018102:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000016034629 x1858049623691392/t0(0) o400->7b8be151-430f-4762-8645-49f603f45f07@22481@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1889-0'
00000100:00100000:8.0:1773851884.018106:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000016034629 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7b8be151-430f-4762-8645-49f603f45f07+6:39664:x1858049623691392:12345-22481@kfi7:400:default-tuolumne1889-0 Request processed in 53us (83us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851884.018108:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22481@kfi7, seq: 2130820
00000100:00000040:8.0:1773851884.018109:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000088ea187f : new rpc_count 0
00000100:00000001:8.0:1773851884.018110:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851884.018110:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851884.018111:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851884.018111:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e231bd3.
00000020:00000010:8.0:1773851884.018112:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e602d741.
00000020:00000040:8.0:1773851884.018113:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000088ea187f : new refcount 5
00000100:00000001:8.0:1773851884.018114:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851884.018118:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004d9 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851884.018120:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851884.018121:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22480@kfi7: PUT: OK
00000400:00000200:10.0:1773851884.018122:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7b495c
00000400:00000010:10.0:1773851884.018122:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7b495c.
00000100:00000001:10.0:1773851884.018123:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851884.018124:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851884.018124:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004eaa2074 nid 22480@kfi7 refs 2
00000800:00000200:10.0:1773851884.018126:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 22480@kfi7(000000003e867ddf):0x0 lsk 1242 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004d9 Transaction freed
00000800:00000200:25.0:1773851884.018267:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851884.018268:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851884.018269:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851884.018271:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851884.018272:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13187@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.018274:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13187@kfi7 : PUT - for me
00000400:00000200:25.0:1773851884.018274:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13187@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.018275:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 1
00000400:00000200:25.0:1773851884.018276:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13187@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.018277:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 2
00000400:00000200:25.0:1773851884.018278:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 3
00000400:00000200:25.0:1773851884.018279:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13186@kfi7 to cpt 2
00000400:00000200:25.0:1773851884.018280:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13186@kfi7 of length 224 into portal 12 MB=0x699e16d3eac80
00000400:00000200:25.0:1773851884.018281:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13186@kfi7 of length 224/224 into md 0x16159c9699 [64] + 28832
00000800:00000200:25.0:1773851884.018283:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851884.018284:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851884.018285:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13187@kfi7: PUT: OK
00000100:00000001:25.0:1773851884.018286:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851884.018287:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851884.018287:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c8ba2c70.
00000100:00000040:25.0:1773851884.018288:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c8ba2c70 x1858043339779200 msgsize 224
00000100:00100000:25.0:1773851884.018289:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-13186@kfi7 (source: 12345-13187@kfi7)
00000100:00000001:25.0:1773851884.018290:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851884.018291:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 2
00000100:00000001:27.0:1773851884.018292:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851884.018292:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851884.018293:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851884.018293:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851884.018293:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851884.018294:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851884.018295:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043339779200
00000020:00000001:27.0:1773851884.018296:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851884.018296:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92944
00000020:00000001:27.0:1773851884.018297:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851884.018299:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ede68c04 refcount=6
00000020:00000001:27.0:1773851884.018299:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743201792 : -107128966349824 : ffff9e911803fc00)
00000020:00000001:27.0:1773851884.018300:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743201792 : -107128966349824 : ffff9e911803fc00)
00000100:00000001:27.0:1773851884.018301:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851884.018302:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851884.018303:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000095a8ac67.
00000020:00000010:27.0:1773851884.018304:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851884.018305:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094f466b7.
00000100:00000001:27.0:1773851884.018305:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851884.018306:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851884.018307:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.018307:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851884.018308:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851884.018308:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.018309:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.018310:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851884.018311:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851884.018311:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851884.018311:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851884.018312:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13186@kfi7, seq: 2025150
00000100:00000040:27.0:1773851884.018313:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ede68c04 : new rpc_count 1
00000100:00000001:27.0:1773851884.018314:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252458112 : -106967457093504 : ffff9eb6b2b7a880)
00000100:00000001:26.0:1773851884.018314:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851884.018314:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851884.018315:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c8ba2c70 x1858043339779200/t0(0) o400->ab7d7534-1b39-4b4d-b1a8-3952467ed725@13186@kfi7:134/0 lens 224/0 e 0 to 0 dl 1773852249 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1320-0'
00000100:00000001:27.0:1773851884.018318:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851884.018318:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851884.018319:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8ba2c70 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ab7d7534-1b39-4b4d-b1a8-3952467ed725+6:39687:x1858043339779200:12345-13186@kfi7:400:default-tuolumne1320-0
00000100:00000200:27.0:1773851884.018320:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043339779200
00000020:00000001:27.0:1773851884.018321:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851884.018322:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851884.018322:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.018323:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851884.018324:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851884.018324:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851884.018325:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043339779200, found 0 last_xid 1858043339779199
00000020:00000001:27.0:1773851884.018326:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851884.018326:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851884.018327:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851884.018327:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.018328:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851884.018329:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851884.018329:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851884.018331:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d0341cfe.
02000000:00000001:27.0:1773851884.018331:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.018332:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.018332:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851884.018333:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182241605948, transno 0, xid 1858043339779200
00010000:00000001:27.0:1773851884.018334:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851884.018335:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c8ba2c70 x1858043339779200/t0(0) o400->ab7d7534-1b39-4b4d-b1a8-3952467ed725@13186@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1320-0'
00010000:00000001:27.0:1773851884.018337:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851884.018338:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851884.018339:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=117 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851884.018340:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851884.018341:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006dac310c refcount 3 to 13186@kfi7
00000100:00000001:27.0:1773851884.018341:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366287520 : -107142343264096 : ffff9e8dfab078a0)
02000000:00000001:27.0:1773851884.018342:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851884.018343:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.018344:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851884.018345:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13187@kfi7
00000400:00000010:27.0:1773851884.018345:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000099e1821d.
00000100:00000200:27.0:1773851884.018346:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043339779200, offset 224
00000400:00000200:27.0:1773851884.018347:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13187@kfi7
00000400:00000200:27.0:1773851884.018348:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13187@kfi7 to cpt 6
00000400:00000200:27.0:1773851884.018349:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 1
00000400:00000200:27.0:1773851884.018350:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 2
00000400:00000200:27.0:1773851884.018351:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 3
00000400:00000200:27.0:1773851884.018352:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13187@kfi7 local destination
00000400:00000200:27.0:1773851884.018353:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769780:8769780:1024:4294967295] 13187@kfi7 LPNI seq info [379925:379925:16:4294967295]
00000400:00000200:27.0:1773851884.018355:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 2
00000400:00000200:27.0:1773851884.018355:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13187@kfi7 to cpt 6
00000400:00000200:27.0:1773851884.018357:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13187@kfi7(13187@kfi7:13187@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851884.018359:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 3
00000800:00000200:27.0:1773851884.018360:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851884.018361:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851884.018363:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851884.018365:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x459 Using peer 13187@kfi7(0x459)
00000800:00000200:27.0:1773851884.018368:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0x459: rc=0
00000800:00000200:27.0:1773851884.018369:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x459 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851884.018373:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851884.018374:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006dac310c refcount 2 to 13186@kfi7
00010000:00000001:27.0:1773851884.018375:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851884.018375:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.018376:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851884.018376:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c8ba2c70 x1858043339779200/t0(0) o400->ab7d7534-1b39-4b4d-b1a8-3952467ed725@13186@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1320-0'
00000100:00100000:27.0:1773851884.018380:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8ba2c70 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ab7d7534-1b39-4b4d-b1a8-3952467ed725+6:39687:x1858043339779200:12345-13186@kfi7:400:default-tuolumne1320-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851884.018381:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x459 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851884.018382:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851884.018383:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13186@kfi7, seq: 2025150
00000100:00000040:27.0:1773851884.018383:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ede68c04 : new rpc_count 0
00000400:00000200:25.0:1773851884.018383:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13187@kfi7: PUT: OK
00000400:00000200:25.0:1773851884.018383:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000099e1821d
00000100:00000001:27.0:1773851884.018384:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:25.0:1773851884.018384:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000099e1821d.
00000100:00000001:27.0:1773851884.018385:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851884.018385:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851884.018385:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851884.018386:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851884.018386:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094f466b7.
00000400:00000200:25.0:1773851884.018386:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4f0ffe0 nid 13187@kfi7 refs 2
00000020:00000010:27.0:1773851884.018387:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000095a8ac67.
00000800:00000200:25.0:1773851884.018387:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 13187@kfi7(00000000aeab01e7):0x0 lsk 1114 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x459 Transaction freed
00000020:00000040:27.0:1773851884.018388:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000ede68c04 : new refcount 5
00000100:00000001:27.0:1773851884.018389:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851884.053074:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851884.053075:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851884.053076:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851884.053080:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851884.053083:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.053084:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2084@kfi7 : PUT - for me
00000400:00000200:25.0:1773851884.053086:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.053087:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:25.0:1773851884.053088:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.053089:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:25.0:1773851884.053090:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:25.0:1773851884.053092:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.053093:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 224 into portal 12 MB=0x699e1862bef40
00000400:00000200:25.0:1773851884.053094:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2084@kfi7 of length 224/224 into md 0x16159c9699 [64] + 29056
00000800:00000200:25.0:1773851884.053097:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851884.053099:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851884.053101:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000001:25.0:1773851884.053102:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851884.053103:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851884.053104:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f42047e2.
00000100:00000040:25.0:1773851884.053105:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000f42047e2 x1858043757981504 msgsize 224
00000100:00100000:25.0:1773851884.053107:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-2084@kfi7 (source: 12345-2084@kfi7)
00000100:00000001:25.0:1773851884.053108:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851884.053109:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:27.0:1773851884.053111:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851884.053111:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851884.053111:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851884.053112:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851884.053113:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851884.053114:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851884.053115:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043757981504
00000020:00000001:27.0:1773851884.053116:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851884.053116:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793aca062d
00000020:00000001:27.0:1773851884.053117:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851884.053119:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000045bb5874 refcount=5
00000020:00000001:27.0:1773851884.053120:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944780431360 : -107128929120256 : ffff9e911a3c1000)
00000020:00000001:27.0:1773851884.053121:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944780431360 : -107128929120256 : ffff9e911a3c1000)
00000100:00000001:27.0:1773851884.053123:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851884.053125:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851884.053126:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000095a8ac67.
00000020:00000010:27.0:1773851884.053127:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851884.053128:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094f466b7.
00000100:00000001:27.0:1773851884.053129:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851884.053130:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851884.053131:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.053132:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851884.053132:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851884.053133:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.053134:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.053136:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851884.053137:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851884.053137:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851884.053138:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2084@kfi7, seq: 2025151
00000100:00000001:26.0:1773851884.053138:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851884.053139:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000045bb5874 : new rpc_count 1
00000100:00000001:26.0:1773851884.053139:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.053140:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252465024 : -106967457086592 : ffff9eb6b2b7c380)
00000100:00000001:26.0:1773851884.053140:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851884.053142:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f42047e2 x1858043757981504/t0(0) o400->lustre5-MDT0001-lwp-OST001a_UUID@2084@kfi7:134/0 lens 224/0 e 0 to 0 dl 1773852249 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba127-0'
00000100:00000001:27.0:1773851884.053147:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851884.053147:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851884.053149:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f42047e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-lwp-OST001a_UUID+5:272672:x1858043757981504:12345-2084@kfi7:400:default-yuba127-0
00000100:00000200:27.0:1773851884.053151:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043757981504
00000020:00000001:27.0:1773851884.053152:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851884.053153:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851884.053153:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.053154:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851884.053155:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851884.053156:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:27.0:1773851884.053157:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851884.053158:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851884.053159:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851884.053159:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.053160:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851884.053161:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851884.053162:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851884.053163:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000447f333e.
02000000:00000001:27.0:1773851884.053164:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.053165:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.053165:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851884.053166:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858043757981504
00010000:00000001:27.0:1773851884.053167:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851884.053169:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f42047e2 x1858043757981504/t0(0) o400->lustre5-MDT0001-lwp-OST001a_UUID@2084@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba127-0'
00010000:00000001:27.0:1773851884.053173:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851884.053173:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851884.053174:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=117 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851884.053176:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851884.053177:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009494ead4 refcount 7 to 2084@kfi7
00000100:00000001:27.0:1773851884.053178:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420800 : -107156724130816 : ffff9e8aa185dc00)
02000000:00000001:27.0:1773851884.053179:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851884.053180:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.053180:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851884.053182:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000010:27.0:1773851884.053183:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003f689320.
00000100:00000200:27.0:1773851884.053184:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043757981504, offset 224
00000400:00000200:27.0:1773851884.053186:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:27.0:1773851884.053187:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:27.0:1773851884.053188:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:27.0:1773851884.053189:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:27.0:1773851884.053191:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:27.0:1773851884.053193:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2084@kfi7 local destination
00000400:00000200:27.0:1773851884.053195:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769781:8769781:1024:4294967295] 2084@kfi7 LPNI seq info [5402748:5402748:16:4294967295]
00000400:00000200:27.0:1773851884.053197:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:27.0:1773851884.053198:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:27.0:1773851884.053201:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851884.053203:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000800:00000200:27.0:1773851884.053205:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851884.053207:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851884.053211:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851884.053215:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x103 Using peer 2084@kfi7(0x103)
00000800:00000200:27.0:1773851884.053219:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x103: rc=0
00000800:00000200:27.0:1773851884.053221:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851884.053224:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851884.053226:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009494ead4 refcount 6 to 2084@kfi7
00010000:00000001:27.0:1773851884.053227:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851884.053227:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.053228:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851884.053229:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f42047e2 x1858043757981504/t0(0) o400->lustre5-MDT0001-lwp-OST001a_UUID@2084@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba127-0'
00000800:00000200:25.0:1773851884.053234:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x103 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851884.053235:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f42047e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-lwp-OST001a_UUID+5:272672:x1858043757981504:12345-2084@kfi7:400:default-yuba127-0 Request processed in 87us (129us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851884.053237:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851884.053239:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2084@kfi7, seq: 2025151
00000400:00000200:25.0:1773851884.053239:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000040:27.0:1773851884.053240:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000045bb5874 : new rpc_count 0
00000400:00000200:25.0:1773851884.053240:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003f689320
00000100:00000001:27.0:1773851884.053241:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:25.0:1773851884.053241:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003f689320.
00000100:00000001:27.0:1773851884.053242:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851884.053242:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:27.0:1773851884.053243:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000100:00000001:25.0:1773851884.053243:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851884.053244:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094f466b7.
00000400:00000200:25.0:1773851884.053244:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000020:00000010:27.0:1773851884.053245:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000095a8ac67.
00000020:00000040:27.0:1773851884.053246:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000045bb5874 : new refcount 4
00000100:00000001:27.0:1773851884.053247:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851884.053247:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x103 Transaction freed
00000800:00000200:9.0:1773851884.082163:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851884.082164:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851884.082166:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851884.082168:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851884.082170:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25522@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.082172:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25522@kfi7 : PUT - for me
00000400:00000200:9.0:1773851884.082173:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25522@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.082174:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a23fb99 nid 25522@kfi7 refs 1
00000400:00000200:9.0:1773851884.082176:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25522@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.082176:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a23fb99 nid 25522@kfi7 refs 2
00000400:00000200:9.0:1773851884.082177:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001a23fb99 nid 25522@kfi7 refs 3
00000400:00000200:9.0:1773851884.082178:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25523@kfi7 to cpt 5
00000400:00000200:9.0:1773851884.082179:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25523@kfi7 of length 224 into portal 12 MB=0x699e1aa5c2600
00000400:00000200:9.0:1773851884.082180:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25523@kfi7 of length 224/224 into md 0x78146ce49 [64] + 147776
00000800:00000200:9.0:1773851884.082182:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.082184:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.082185:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25522@kfi7: PUT: OK
00000100:00000001:9.0:1773851884.082186:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851884.082187:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851884.082188:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a0df941.
00000100:00000040:9.0:1773851884.082188:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000001a0df941 x1858044365121024 msgsize 224
00000100:00100000:9.0:1773851884.082190:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-25523@kfi7 (source: 12345-25522@kfi7)
00000100:00000001:9.0:1773851884.082191:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851884.082191:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001a23fb99 nid 25522@kfi7 refs 2
00000100:00000001:8.0:1773851884.082192:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851884.082193:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851884.082193:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851884.082193:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851884.082194:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851884.082194:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851884.082195:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044365121024
00000020:00000001:8.0:1773851884.082195:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851884.082196:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9144b
00000020:00000001:8.0:1773851884.082196:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851884.082201:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000488c9892 refcount=11
00000020:00000001:8.0:1773851884.082201:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240798208 : -107152468753408 : ffff9e8b9f29c400)
00000020:00000001:8.0:1773851884.082202:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240798208 : -107152468753408 : ffff9e8b9f29c400)
00000100:00000001:8.0:1773851884.082203:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851884.082204:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851884.082204:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e602d741.
00000020:00000010:8.0:1773851884.082205:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851884.082206:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e231bd3.
00000100:00000001:8.0:1773851884.082207:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851884.082207:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851884.082208:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.082208:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851884.082209:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851884.082209:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.082210:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.082211:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.082212:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.082212:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851884.082212:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851884.082213:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851884.082213:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25523@kfi7, seq: 2130821
00000100:00000040:8.0:1773851884.082213:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000488c9892 : new rpc_count 2
00000100:00000001:11.0:1773851884.082214:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.082214:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162661632 : -106971546889984 : ffff9eb5bef25100)
00000100:00000040:8.0:1773851884.082215:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a0df941 x1858044365121024/t0(0) o400->2a3b768b-3706-4b8b-ab59-8678f29dd5fa@25523@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2074-0'
00000100:00000001:8.0:1773851884.082217:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851884.082220:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851884.082221:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a0df941 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2a3b768b-3706-4b8b-ab59-8678f29dd5fa+11:39674:x1858044365121024:12345-25523@kfi7:400:default-tuolumne2074-0
00000100:00000200:8.0:1773851884.082222:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044365121024
00000020:00000001:8.0:1773851884.082222:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851884.082223:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851884.082223:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.082224:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851884.082224:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851884.082225:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851884.082226:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044365121024, found 0 last_xid 1858044365106175
00000020:00000001:8.0:1773851884.082226:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851884.082227:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851884.082227:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851884.082228:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.082228:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851884.082229:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851884.082229:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851884.082230:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004d4282a4.
02000000:00000001:8.0:1773851884.082230:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.082231:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.082232:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851884.082232:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260469755, transno 0, xid 1858044365121024
00010000:00000001:8.0:1773851884.082233:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851884.082234:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a0df941 x1858044365121024/t0(0) o400->2a3b768b-3706-4b8b-ab59-8678f29dd5fa@25523@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2074-0'
00010000:00000001:8.0:1773851884.082236:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851884.082236:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851884.082237:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=117 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851884.082238:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851884.082238:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000331dd63d refcount 3 to 25523@kfi7
00000100:00000001:8.0:1773851884.082239:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027008 : -107156745524608 : ffff9e8aa03f6a80)
02000000:00000001:8.0:1773851884.082240:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851884.082240:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.082241:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851884.082242:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25522@kfi7
00000400:00000010:8.0:1773851884.082242:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000286a46f2.
00000100:00000200:8.0:1773851884.082243:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044365121024, offset 224
00000400:00000200:8.0:1773851884.082244:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25522@kfi7
00000400:00000200:8.0:1773851884.082245:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25522@kfi7 to cpt 2
00000400:00000200:8.0:1773851884.082245:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a23fb99 nid 25522@kfi7 refs 1
00000400:00000200:8.0:1773851884.082246:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001a23fb99 nid 25522@kfi7 refs 2
00000400:00000200:8.0:1773851884.082247:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001a23fb99 nid 25522@kfi7 refs 3
00000400:00000200:8.0:1773851884.082248:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25522@kfi7 local destination
00000400:00000200:8.0:1773851884.082249:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769782:8769782:1024:4294967295] 25522@kfi7 LPNI seq info [14585150:14585150:16:4294967295]
00000400:00000200:8.0:1773851884.082251:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001a23fb99 nid 25522@kfi7 refs 2
00000400:00000200:8.0:1773851884.082251:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25522@kfi7 to cpt 2
00000400:00000200:8.0:1773851884.082253:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25522@kfi7(25522@kfi7:25522@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851884.082254:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001a23fb99 nid 25522@kfi7 refs 3
00000800:00000200:8.0:1773851884.082255:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851884.082256:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851884.082258:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851884.082260:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003fa Using peer 25522@kfi7(0x1000000000003fa)
00000800:00000200:8.0:1773851884.082263:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x1000000000003fa: rc=0
00000800:00000200:8.0:1773851884.082264:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003fa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851884.082266:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851884.082266:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000331dd63d refcount 2 to 25523@kfi7
00010000:00000001:8.0:1773851884.082267:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851884.082267:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.082268:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851884.082269:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a0df941 x1858044365121024/t0(0) o400->2a3b768b-3706-4b8b-ab59-8678f29dd5fa@25523@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2074-0'
00000100:00100000:8.0:1773851884.082273:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a0df941 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2a3b768b-3706-4b8b-ab59-8678f29dd5fa+11:39674:x1858044365121024:12345-25523@kfi7:400:default-tuolumne2074-0 Request processed in 53us (82us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851884.082275:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25523@kfi7, seq: 2130821
00000100:00000040:8.0:1773851884.082276:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000488c9892 : new rpc_count 1
00000100:00000001:8.0:1773851884.082276:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851884.082277:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851884.082277:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851884.082278:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e231bd3.
00000020:00000010:8.0:1773851884.082279:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e602d741.
00000020:00000040:8.0:1773851884.082279:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000488c9892 : new refcount 10
00000100:00000001:8.0:1773851884.082280:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851884.082285:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003fa TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851884.082286:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.082287:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25522@kfi7: PUT: OK
00000400:00000200:9.0:1773851884.082288:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000286a46f2
00000400:00000010:9.0:1773851884.082289:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000286a46f2.
00000100:00000001:9.0:1773851884.082289:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851884.082290:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851884.082291:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001a23fb99 nid 25522@kfi7 refs 2
00000800:00000200:9.0:1773851884.082292:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 25522@kfi7(00000000181093a8):0x0 lsk 1019 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003fa Transaction freed
00000800:00000200:5.0:1773851884.121495:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851884.121496:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851884.121497:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851884.121499:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851884.121500:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24595@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.121502:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24595@kfi7 : PUT - for me
00000400:00000200:5.0:1773851884.121503:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24595@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.121503:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ffcb2bd nid 24595@kfi7 refs 1
00000400:00000200:5.0:1773851884.121504:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24595@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.121505:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ffcb2bd nid 24595@kfi7 refs 2
00000400:00000200:5.0:1773851884.121505:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002ffcb2bd nid 24595@kfi7 refs 3
00000400:00000200:5.0:1773851884.121506:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24787@kfi7 to cpt 4
00000400:00000200:5.0:1773851884.121507:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24787@kfi7 of length 224 into portal 12 MB=0x699e10c93f500
00000400:00000200:5.0:1773851884.121508:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24787@kfi7 of length 224/224 into md 0x793926dc5 [64] + 154768
00000800:00000200:5.0:1773851884.121510:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851884.121511:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.121512:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24595@kfi7: PUT: OK
00000100:00000001:5.0:1773851884.121513:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851884.121513:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851884.121514:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000000a7edf8.
00000100:00000040:5.0:1773851884.121515:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000000a7edf8 x1858041717978368 msgsize 224
00000100:00100000:5.0:1773851884.121516:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-24787@kfi7 (source: 12345-24595@kfi7)
00000100:00000001:5.0:1773851884.121517:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851884.121518:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002ffcb2bd nid 24595@kfi7 refs 2
00000100:00000001:4.0:1773851884.121518:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851884.121519:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851884.121519:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851884.121519:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851884.121520:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851884.121521:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851884.121521:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041717978368
00000020:00000001:4.0:1773851884.121522:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851884.121522:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d9d
00000020:00000001:4.0:1773851884.121523:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851884.121525:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e4639783 refcount=6
00000020:00000001:4.0:1773851884.121526:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744422400 : -107128965129216 : ffff9e9118169c00)
00000020:00000001:4.0:1773851884.121527:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744422400 : -107128965129216 : ffff9e9118169c00)
00000100:00000001:4.0:1773851884.121528:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851884.121529:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851884.121529:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001dd2088e.
00000020:00000010:4.0:1773851884.121530:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851884.121531:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8ab1166.
00000100:00000001:4.0:1773851884.121532:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851884.121532:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851884.121533:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.121533:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851884.121534:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851884.121534:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.121535:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.121536:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851884.121537:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851884.121537:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851884.121537:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851884.121538:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24787@kfi7, seq: 2001960
00000100:00000001:7.0:1773851884.121539:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.121539:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.121539:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e4639783 : new rpc_count 1
00000100:00000001:4.0:1773851884.121539:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108936192 : -106938600615424 : ffff9ebd6ab29200)
00000100:00000040:4.0:1773851884.121540:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000000a7edf8 x1858041717978368/t0(0) o400->cb49a17f-411f-42a1-923d-ae9587d67f41@24787@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2037-0'
00000100:00000001:4.0:1773851884.121543:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851884.121543:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851884.121544:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000a7edf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:cb49a17f-411f-42a1-923d-ae9587d67f41+6:39850:x1858041717978368:12345-24787@kfi7:400:default-tuolumne2037-0
00000100:00000200:4.0:1773851884.121546:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041717978368
00000020:00000001:4.0:1773851884.121547:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851884.121547:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851884.121548:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.121548:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851884.121549:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851884.121550:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851884.121550:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041717978368, found 0 last_xid 1858041717978367
00000020:00000001:4.0:1773851884.121551:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851884.121552:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851884.121552:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851884.121553:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.121553:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851884.121554:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851884.121554:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851884.121556:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002aecfbc6.
02000000:00000001:4.0:1773851884.121556:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.121557:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.121558:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851884.121558:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183045370935, transno 0, xid 1858041717978368
00010000:00000001:4.0:1773851884.121559:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851884.121560:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000000a7edf8 x1858041717978368/t0(0) o400->cb49a17f-411f-42a1-923d-ae9587d67f41@24787@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2037-0'
00010000:00000001:4.0:1773851884.121562:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851884.121563:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851884.121563:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=116 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851884.121564:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851884.121565:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000da6c027c refcount 3 to 24787@kfi7
00000100:00000001:4.0:1773851884.121566:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301334240 : -107155408217376 : ffff9e8aeff51ae0)
02000000:00000001:4.0:1773851884.121566:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851884.121567:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.121568:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851884.121568:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24595@kfi7
00000400:00000010:4.0:1773851884.121569:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4bdb4b7.
00000100:00000200:4.0:1773851884.121570:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041717978368, offset 224
00000400:00000200:4.0:1773851884.121572:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24595@kfi7
00000400:00000200:4.0:1773851884.121572:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24595@kfi7 to cpt 1
00000400:00000200:4.0:1773851884.121573:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002ffcb2bd nid 24595@kfi7 refs 1
00000400:00000200:4.0:1773851884.121574:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002ffcb2bd nid 24595@kfi7 refs 2
00000400:00000200:4.0:1773851884.121575:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002ffcb2bd nid 24595@kfi7 refs 3
00000400:00000200:4.0:1773851884.121577:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24595@kfi7 local destination
00000400:00000200:4.0:1773851884.121578:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769783:8769783:1024:4294967295] 24595@kfi7 LPNI seq info [13772846:13772846:16:4294967295]
00000400:00000200:4.0:1773851884.121579:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002ffcb2bd nid 24595@kfi7 refs 2
00000400:00000200:4.0:1773851884.121580:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24595@kfi7 to cpt 1
00000400:00000200:4.0:1773851884.121582:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24595@kfi7(24595@kfi7:24595@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851884.121583:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002ffcb2bd nid 24595@kfi7 refs 3
00000800:00000200:4.0:1773851884.121584:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851884.121585:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851884.121587:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851884.121589:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x103c Using peer 24595@kfi7(0x103c)
00000800:00000200:4.0:1773851884.121592:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x103c: rc=0
00000800:00000200:4.0:1773851884.121594:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x103c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851884.121596:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.121597:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000da6c027c refcount 2 to 24787@kfi7
00010000:00000001:4.0:1773851884.121597:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851884.121598:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.121599:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851884.121599:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000000a7edf8 x1858041717978368/t0(0) o400->cb49a17f-411f-42a1-923d-ae9587d67f41@24787@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2037-0'
00000100:00100000:4.0:1773851884.121602:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000a7edf8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:cb49a17f-411f-42a1-923d-ae9587d67f41+6:39850:x1858041717978368:12345-24787@kfi7:400:default-tuolumne2037-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851884.121605:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24787@kfi7, seq: 2001960
00000100:00000040:4.0:1773851884.121606:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e4639783 : new rpc_count 0
00000100:00000001:4.0:1773851884.121606:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851884.121607:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851884.121607:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851884.121608:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8ab1166.
00000020:00000010:4.0:1773851884.121609:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001dd2088e.
00000020:00000040:4.0:1773851884.121610:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e4639783 : new refcount 5
00000100:00000001:4.0:1773851884.121611:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851884.121623:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x103c TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851884.121625:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.121626:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24595@kfi7: PUT: OK
00000400:00000200:5.0:1773851884.121626:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4bdb4b7
00000400:00000010:5.0:1773851884.121627:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4bdb4b7.
00000100:00000001:5.0:1773851884.121627:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851884.121628:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851884.121629:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002ffcb2bd nid 24595@kfi7 refs 2
00000800:00000200:5.0:1773851884.121630:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 24595@kfi7(000000001e552504):0x0 lsk 4157 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x103c Transaction freed
00080000:00000001:30.0:1773851884.173939:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851884.173941:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851884.173969:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851884.173969:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851884.173998:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851884.173998:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851884.174026:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851884.174026:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851884.174222:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 000000008a71a94e (tot 253201027).
00000400:00000010:30.0:1773851884.174224:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 000000008a71a94e (tot 253200771).
00000800:00000200:17.0:1773851884.176050:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851884.176051:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851884.176052:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851884.176054:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851884.176056:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25795@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.176057:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25795@kfi7 : PUT - for me
00000400:00000200:17.0:1773851884.176058:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25795@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.176059:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ef2ba11 nid 25795@kfi7 refs 1
00000400:00000200:17.0:1773851884.176060:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25795@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.176060:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ef2ba11 nid 25795@kfi7 refs 2
00000400:00000200:17.0:1773851884.176061:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001ef2ba11 nid 25795@kfi7 refs 3
00000400:00000200:17.0:1773851884.176062:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25602@kfi7 to cpt 6
00000400:00000200:17.0:1773851884.176063:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25602@kfi7 of length 224 into portal 12 MB=0x69b4b98c7fe00
00000400:00000200:17.0:1773851884.176065:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25602@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 34888
00000800:00000200:17.0:1773851884.176067:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851884.176068:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.176069:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25795@kfi7: PUT: OK
00000100:00000001:17.0:1773851884.176070:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851884.176071:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851884.176072:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000061b2e33.
00000100:00000040:17.0:1773851884.176072:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000061b2e33 x1859598848359936 msgsize 224
00000100:00100000:17.0:1773851884.176075:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-25602@kfi7 (source: 12345-25795@kfi7)
00000100:00000001:17.0:1773851884.176075:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851884.176076:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001ef2ba11 nid 25795@kfi7 refs 2
00000100:00000001:16.0:1773851884.176077:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851884.176077:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851884.176078:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851884.176078:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851884.176078:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851884.176079:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851884.176080:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598848359936
00000020:00000001:16.0:1773851884.176080:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851884.176081:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3b7c0318
00000020:00000001:16.0:1773851884.176081:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851884.176084:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005cf5235f refcount=23
00000020:00000001:16.0:1773851884.176085:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636941370613760 : -107132338937856 : ffff9e904efe6000)
00000020:00000001:16.0:1773851884.176085:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636941370613760 : -107132338937856 : ffff9e904efe6000)
00000100:00000001:16.0:1773851884.176086:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.176088:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851884.176088:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851884.176089:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.176090:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851884.176091:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851884.176091:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851884.176092:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851884.176093:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851884.176093:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851884.176094:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.176095:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851884.176096:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851884.176096:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851884.176097:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851884.176097:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851884.176098:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25602@kfi7, seq: 2156390
00000100:00000001:17.0:1773851884.176099:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.176099:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005cf5235f : new rpc_count 1
00000100:00000001:17.0:1773851884.176100:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.176100:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102206208 : -107041607345408 : ffff9ea56f049b00)
00000100:00000040:16.0:1773851884.176101:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000061b2e33 x1859598848359936/t0(0) o400->827e52ce-922a-4fad-af6a-c0e3896e3e97@25602@kfi7:105/0 lens 224/0 e 0 to 0 dl 1773852220 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2103-0'
00000100:00000001:16.0:1773851884.176104:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.176105:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851884.176106:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000061b2e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:827e52ce-922a-4fad-af6a-c0e3896e3e97+23:39594:x1859598848359936:12345-25602@kfi7:400:default-tuolumne2103-0
00000100:00000200:16.0:1773851884.176107:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598848359936
00000020:00000001:16.0:1773851884.176108:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851884.176108:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851884.176109:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.176110:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851884.176110:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851884.176111:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851884.176112:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598848359936, found 0 last_xid 1859598847996927
00000020:00000001:16.0:1773851884.176113:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851884.176113:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851884.176114:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851884.176114:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.176115:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851884.176116:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851884.176116:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851884.176117:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dcd298eb.
02000000:00000001:16.0:1773851884.176117:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.176118:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.176119:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851884.176119:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260519392, transno 0, xid 1859598848359936
00010000:00000001:16.0:1773851884.176120:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851884.176121:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000061b2e33 x1859598848359936/t0(0) o400->827e52ce-922a-4fad-af6a-c0e3896e3e97@25602@kfi7:105/0 lens 224/224 e 0 to 0 dl 1773852220 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2103-0'
00010000:00000001:16.0:1773851884.176123:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851884.176124:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851884.176125:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=117 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851884.176126:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851884.176126:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008393d060 refcount 3 to 25602@kfi7
00000100:00000001:16.0:1773851884.176127:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643689312 : -107157065862304 : ffff9e8a8d277360)
02000000:00000001:16.0:1773851884.176128:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851884.176128:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.176130:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851884.176130:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25795@kfi7
00000400:00000010:16.0:1773851884.176131:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009703cb8c.
00000100:00000200:16.0:1773851884.176132:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598848359936, offset 224
00000400:00000200:16.0:1773851884.176133:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25795@kfi7
00000400:00000200:16.0:1773851884.176134:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25795@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.176135:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ef2ba11 nid 25795@kfi7 refs 1
00000400:00000200:16.0:1773851884.176136:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001ef2ba11 nid 25795@kfi7 refs 2
00000400:00000200:16.0:1773851884.176137:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001ef2ba11 nid 25795@kfi7 refs 3
00000400:00000200:16.0:1773851884.176138:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25795@kfi7 local destination
00000400:00000200:16.0:1773851884.176139:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769784:8769784:1024:4294967295] 25795@kfi7 LPNI seq info [329263:329263:16:4294967295]
00000400:00000200:16.0:1773851884.176141:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001ef2ba11 nid 25795@kfi7 refs 2
00000400:00000200:16.0:1773851884.176141:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25795@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.176143:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25795@kfi7(25795@kfi7:25795@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851884.176144:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001ef2ba11 nid 25795@kfi7 refs 3
00000800:00000200:16.0:1773851884.176145:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851884.176146:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851884.176149:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851884.176151:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001139 Using peer 25795@kfi7(0x100000000001139)
00000800:00000200:16.0:1773851884.176154:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0x100000000001139: rc=0
00000800:00000200:16.0:1773851884.176155:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001139 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851884.176157:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.176158:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008393d060 refcount 2 to 25602@kfi7
00010000:00000001:16.0:1773851884.176159:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851884.176159:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.176160:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851884.176161:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000061b2e33 x1859598848359936/t0(0) o400->827e52ce-922a-4fad-af6a-c0e3896e3e97@25602@kfi7:105/0 lens 224/224 e 0 to 0 dl 1773852220 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2103-0'
00000100:00100000:16.0:1773851884.176166:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000061b2e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:827e52ce-922a-4fad-af6a-c0e3896e3e97+23:39594:x1859598848359936:12345-25602@kfi7:400:default-tuolumne2103-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851884.176169:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25602@kfi7, seq: 2156390
00000100:00000040:16.0:1773851884.176169:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005cf5235f : new rpc_count 0
00000100:00000001:16.0:1773851884.176170:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851884.176171:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851884.176171:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.176172:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:16.0:1773851884.176173:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:16.0:1773851884.176173:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000005cf5235f : new refcount 22
00000100:00000001:16.0:1773851884.176174:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851884.176179:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001139 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851884.176181:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.176182:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25795@kfi7: PUT: OK
00000400:00000200:17.0:1773851884.176182:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009703cb8c
00000400:00000010:17.0:1773851884.176183:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009703cb8c.
00000100:00000001:17.0:1773851884.176184:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851884.176184:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851884.176185:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001ef2ba11 nid 25795@kfi7 refs 2
00000800:00000200:17.0:1773851884.176187:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 25795@kfi7(00000000b9e81996):0x0 lsk 4410 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001139 Transaction freed
00000800:00000200:9.0:1773851884.206118:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851884.206119:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851884.206120:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851884.206122:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851884.206124:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24289@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.206125:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24289@kfi7 : PUT - for me
00000400:00000200:9.0:1773851884.206126:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24289@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.206127:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048a75ec0 nid 24289@kfi7 refs 1
00000400:00000200:9.0:1773851884.206128:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24289@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.206128:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048a75ec0 nid 24289@kfi7 refs 2
00000400:00000200:9.0:1773851884.206129:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000048a75ec0 nid 24289@kfi7 refs 3
00000400:00000200:9.0:1773851884.206130:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24288@kfi7 to cpt 7
00000400:00000200:9.0:1773851884.206131:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24288@kfi7 of length 224 into portal 12 MB=0x69b4c67fe0580
00000400:00000200:9.0:1773851884.206132:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24288@kfi7 of length 224/224 into md 0x78146ce49 [64] + 148000
00000800:00000200:9.0:1773851884.206134:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.206136:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.206136:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24289@kfi7: PUT: OK
00000100:00000001:9.0:1773851884.206138:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851884.206139:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851884.206140:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006b87cbe9.
00000100:00000040:9.0:1773851884.206140:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006b87cbe9 x1859602324784512 msgsize 224
00000100:00100000:9.0:1773851884.206142:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24288@kfi7 (source: 12345-24289@kfi7)
00000100:00000001:9.0:1773851884.206143:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851884.206144:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000048a75ec0 nid 24289@kfi7 refs 2
00000100:00000001:8.0:1773851884.206144:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851884.206145:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851884.206145:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851884.206145:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851884.206146:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851884.206146:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851884.206147:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602324784512
00000020:00000001:8.0:1773851884.206148:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851884.206148:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff82327
00000020:00000001:8.0:1773851884.206149:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851884.206150:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ec1e301b refcount=5
00000020:00000001:8.0:1773851884.206151:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142710543360 : -106930999008256 : ffff9ebf2fc9e400)
00000020:00000001:8.0:1773851884.206152:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142710543360 : -106930999008256 : ffff9ebf2fc9e400)
00000100:00000001:8.0:1773851884.206153:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851884.206153:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851884.206154:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e602d741.
00000020:00000010:8.0:1773851884.206155:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851884.206156:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e231bd3.
00000100:00000001:8.0:1773851884.206156:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851884.206157:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851884.206157:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.206158:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851884.206159:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851884.206159:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.206160:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.206161:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.206162:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.206162:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851884.206162:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851884.206163:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851884.206163:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24288@kfi7, seq: 2130822
00000100:00000040:8.0:1773851884.206163:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ec1e301b : new rpc_count 1
00000100:00000001:11.0:1773851884.206164:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.206164:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162647808 : -106971546903808 : ffff9eb5bef21b00)
00000100:00000040:8.0:1773851884.206165:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006b87cbe9 x1859602324784512/t0(0) o400->7109fb11-a004-4646-ac36-08a9f34f09d3@24288@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1999-0'
00000100:00000001:8.0:1773851884.206167:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851884.206167:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851884.206168:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b87cbe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7109fb11-a004-4646-ac36-08a9f34f09d3+5:39713:x1859602324784512:12345-24288@kfi7:400:default-tuolumne1999-0
00000100:00000200:8.0:1773851884.206170:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602324784512
00000020:00000001:8.0:1773851884.206170:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851884.206171:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851884.206171:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.206172:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851884.206172:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851884.206173:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851884.206173:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602324784512, found 0 last_xid 1859602324784511
00000020:00000001:8.0:1773851884.206174:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851884.206175:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851884.206175:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851884.206176:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.206176:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851884.206177:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851884.206177:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851884.206178:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006033ebe7.
02000000:00000001:8.0:1773851884.206178:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.206179:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.206180:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851884.206180:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263920975, transno 0, xid 1859602324784512
00010000:00000001:8.0:1773851884.206181:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851884.206182:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006b87cbe9 x1859602324784512/t0(0) o400->7109fb11-a004-4646-ac36-08a9f34f09d3@24288@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1999-0'
00010000:00000001:8.0:1773851884.206184:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851884.206184:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851884.206185:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=117 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851884.206186:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851884.206187:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000018a0db9e refcount 3 to 24288@kfi7
00000100:00000001:8.0:1773851884.206187:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882496 : -107156296669120 : ffff9e8abb006840)
02000000:00000001:8.0:1773851884.206188:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851884.206188:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.206189:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851884.206189:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24289@kfi7
00000400:00000010:8.0:1773851884.206190:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079e75b3d.
00000100:00000200:8.0:1773851884.206191:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602324784512, offset 224
00000400:00000200:8.0:1773851884.206192:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24289@kfi7
00000400:00000200:8.0:1773851884.206193:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24289@kfi7 to cpt 2
00000400:00000200:8.0:1773851884.206193:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048a75ec0 nid 24289@kfi7 refs 1
00000400:00000200:8.0:1773851884.206194:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000048a75ec0 nid 24289@kfi7 refs 2
00000400:00000200:8.0:1773851884.206195:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000048a75ec0 nid 24289@kfi7 refs 3
00000400:00000200:8.0:1773851884.206196:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24289@kfi7 local destination
00000400:00000200:8.0:1773851884.206197:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769785:8769785:1024:4294967295] 24289@kfi7 LPNI seq info [9474426:9474426:16:4294967295]
00000400:00000200:8.0:1773851884.206198:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000048a75ec0 nid 24289@kfi7 refs 2
00000400:00000200:8.0:1773851884.206199:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24289@kfi7 to cpt 2
00000400:00000200:8.0:1773851884.206201:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24289@kfi7(24289@kfi7:24289@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851884.206202:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000048a75ec0 nid 24289@kfi7 refs 3
00000800:00000200:8.0:1773851884.206203:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851884.206204:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851884.206206:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851884.206209:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000723 Using peer 24289@kfi7(0x100000000000723)
00000800:00000200:8.0:1773851884.206212:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x100000000000723: rc=0
00000800:00000200:8.0:1773851884.206213:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000723 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851884.206215:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851884.206216:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000018a0db9e refcount 2 to 24288@kfi7
00010000:00000001:8.0:1773851884.206216:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851884.206217:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851884.206217:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851884.206218:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006b87cbe9 x1859602324784512/t0(0) o400->7109fb11-a004-4646-ac36-08a9f34f09d3@24288@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1999-0'
00000100:00100000:8.0:1773851884.206222:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b87cbe9 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7109fb11-a004-4646-ac36-08a9f34f09d3+5:39713:x1859602324784512:12345-24288@kfi7:400:default-tuolumne1999-0 Request processed in 53us (79us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851884.206224:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24288@kfi7, seq: 2130822
00000100:00000040:8.0:1773851884.206225:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ec1e301b : new rpc_count 0
00000100:00000001:8.0:1773851884.206225:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851884.206226:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851884.206226:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851884.206227:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e231bd3.
00000020:00000010:8.0:1773851884.206228:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e602d741.
00000020:00000040:8.0:1773851884.206228:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000ec1e301b : new refcount 4
00000100:00000001:8.0:1773851884.206229:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851884.206234:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000723 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851884.206235:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.206236:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24289@kfi7: PUT: OK
00000400:00000200:9.0:1773851884.206237:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079e75b3d
00000400:00000010:9.0:1773851884.206237:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079e75b3d.
00000100:00000001:9.0:1773851884.206238:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851884.206239:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851884.206239:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000048a75ec0 nid 24289@kfi7 refs 2
00000800:00000200:9.0:1773851884.206241:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 24289@kfi7(000000002d9ff6a7):0x0 lsk 1828 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000723 Transaction freed
00000800:00000200:21.0:1773851884.230873:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851884.230874:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851884.230875:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851884.230878:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851884.230880:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24816@kfi7 to cpt 5
00000400:00000200:21.0:1773851884.230881:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24816@kfi7 : PUT - for me
00000400:00000200:21.0:1773851884.230882:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24816@kfi7 to cpt 5
00000400:00000200:21.0:1773851884.230883:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a65bb5c nid 24816@kfi7 refs 1
00000400:00000200:21.0:1773851884.230885:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24816@kfi7 to cpt 5
00000400:00000200:21.0:1773851884.230885:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a65bb5c nid 24816@kfi7 refs 2
00000400:00000200:21.0:1773851884.230886:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002a65bb5c nid 24816@kfi7 refs 3
00000400:00000200:21.0:1773851884.230887:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24624@kfi7 to cpt 2
00000400:00000200:21.0:1773851884.230888:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24624@kfi7 of length 224 into portal 12 MB=0x69af004390e00
00000400:00000200:21.0:1773851884.230889:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24624@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 52824
00000800:00000200:21.0:1773851884.230891:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851884.230892:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851884.230893:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24816@kfi7: PUT: OK
00000100:00000001:21.0:1773851884.230894:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851884.230895:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851884.230896:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000045963d54.
00000100:00000040:21.0:1773851884.230896:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000045963d54 x1859205513940480 msgsize 224
00000100:00100000:21.0:1773851884.230898:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24624@kfi7 (source: 12345-24816@kfi7)
00000100:00000001:21.0:1773851884.230899:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851884.230900:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002a65bb5c nid 24816@kfi7 refs 2
00000800:00000200:21.0:1773851884.230901:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851884.230901:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851884.230902:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851884.230903:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851884.230905:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851884.230906:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851884.230907:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859205513940480
00000020:00000001:20.0:1773851884.230908:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851884.230909:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914d7
00000020:00000001:20.0:1773851884.230910:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851884.230914:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a72ef238 refcount=6
00000020:00000001:20.0:1773851884.230916:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240794112 : -107152468757504 : ffff9e8b9f29b400)
00000020:00000001:20.0:1773851884.230917:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240794112 : -107152468757504 : ffff9e8b9f29b400)
00000100:00000001:20.0:1773851884.230918:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851884.230919:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851884.230920:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d412f602.
00000020:00000010:20.0:1773851884.230922:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851884.230923:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000683f948d.
00000100:00000001:20.0:1773851884.230924:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851884.230925:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851884.230926:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851884.230928:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851884.230928:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851884.230929:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851884.230931:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851884.230933:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851884.230933:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851884.230933:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851884.230934:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851884.230935:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24624@kfi7, seq: 1998032
00000100:00000040:23.0:1773851884.230936:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a72ef238 : new rpc_count 1
00000100:00000001:23.0:1773851884.230936:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956267264 : -106937753284352 : ffff9ebd9d33d100)
00000100:00000001:20.0:1773851884.230936:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851884.230937:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851884.230939:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000045963d54 x1859205513940480/t0(0) o400->363cc9e2-06a5-4c6f-af98-3f4020a7bb8f@24624@kfi7:524/0 lens 224/0 e 0 to 0 dl 1773852639 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2029-0'
00000100:00000001:23.0:1773851884.230942:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851884.230943:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851884.230944:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000045963d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:363cc9e2-06a5-4c6f-af98-3f4020a7bb8f+6:39618:x1859205513940480:12345-24624@kfi7:400:default-tuolumne2029-0
00000100:00000200:23.0:1773851884.230945:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859205513940480
00000020:00000001:23.0:1773851884.230946:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851884.230947:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851884.230948:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.230948:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851884.230949:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851884.230950:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851884.230950:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859205513940480, found 0 last_xid 1859205513940479
00000020:00000001:23.0:1773851884.230951:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851884.230952:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851884.230952:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851884.230953:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.230954:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851884.230954:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851884.230955:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851884.230956:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000023d189b5.
02000000:00000001:23.0:1773851884.230957:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851884.230958:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.230958:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851884.230959:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260651853, transno 0, xid 1859205513940480
00010000:00000001:23.0:1773851884.230960:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851884.230961:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000045963d54 x1859205513940480/t0(0) o400->363cc9e2-06a5-4c6f-af98-3f4020a7bb8f@24624@kfi7:524/0 lens 224/224 e 0 to 0 dl 1773852639 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2029-0'
00010000:00000001:23.0:1773851884.230964:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851884.230964:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851884.230965:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=117 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851884.230967:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851884.230968:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ae3a925f refcount 3 to 24624@kfi7
00000100:00000001:23.0:1773851884.230968:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959055040 : -107146750496576 : ffff9e8cf3ff70c0)
02000000:00000001:23.0:1773851884.230969:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851884.230970:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851884.230971:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851884.230972:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24816@kfi7
00000400:00000010:23.0:1773851884.230972:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc3746cb.
00000100:00000200:23.0:1773851884.230974:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859205513940480, offset 224
00000400:00000200:23.0:1773851884.230975:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24816@kfi7
00000400:00000200:23.0:1773851884.230976:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24816@kfi7 to cpt 5
00000400:00000200:23.0:1773851884.230977:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a65bb5c nid 24816@kfi7 refs 1
00000400:00000200:23.0:1773851884.230979:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002a65bb5c nid 24816@kfi7 refs 2
00000400:00000200:23.0:1773851884.230980:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002a65bb5c nid 24816@kfi7 refs 3
00000400:00000200:23.0:1773851884.230981:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24816@kfi7 local destination
00000400:00000200:23.0:1773851884.230983:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769786:8769786:1024:4294967295] 24816@kfi7 LPNI seq info [516887:516887:16:4294967295]
00000400:00000200:23.0:1773851884.230984:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002a65bb5c nid 24816@kfi7 refs 2
00000400:00000200:23.0:1773851884.230985:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24816@kfi7 to cpt 5
00000400:00000200:23.0:1773851884.230987:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24816@kfi7(24816@kfi7:24816@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851884.230989:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002a65bb5c nid 24816@kfi7 refs 3
00000800:00000200:23.0:1773851884.230990:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851884.230992:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851884.230994:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851884.230997:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e0f Using peer 24816@kfi7(0x100000000000e0f)
00000800:00000200:23.0:1773851884.231000:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x100000000000e0f: rc=0
00000800:00000200:23.0:1773851884.231001:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e0f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851884.231004:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851884.231005:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ae3a925f refcount 2 to 24624@kfi7
00010000:00000001:23.0:1773851884.231006:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851884.231007:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.231007:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851884.231008:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000045963d54 x1859205513940480/t0(0) o400->363cc9e2-06a5-4c6f-af98-3f4020a7bb8f@24624@kfi7:524/0 lens 224/224 e 0 to 0 dl 1773852639 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2029-0'
00000100:00100000:23.0:1773851884.231011:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000045963d54 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:363cc9e2-06a5-4c6f-af98-3f4020a7bb8f+6:39618:x1859205513940480:12345-24624@kfi7:400:default-tuolumne2029-0 Request processed in 68us (114us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851884.231014:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24624@kfi7, seq: 1998032
00000800:00000200:21.0:1773851884.231014:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e0f TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851884.231015:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a72ef238 : new rpc_count 0
00000400:00000200:21.0:1773851884.231015:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851884.231016:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851884.231016:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851884.231016:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24816@kfi7: PUT: OK
00000020:00000010:23.0:1773851884.231017:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000400:00000200:21.0:1773851884.231017:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc3746cb
00000400:00000010:21.0:1773851884.231017:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc3746cb.
00000020:00000010:23.0:1773851884.231018:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000683f948d.
00000020:00000010:23.0:1773851884.231019:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d412f602.
00000100:00000001:21.0:1773851884.231019:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851884.231019:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:23.0:1773851884.231020:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000a72ef238 : new refcount 5
00000400:00000200:21.0:1773851884.231020:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002a65bb5c nid 24816@kfi7 refs 2
00000100:00000001:23.0:1773851884.231021:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851884.231022:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 24816@kfi7(00000000445bbb81):0x0 lsk 3600 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e0f Transaction freed
00000800:00000200:29.0:1773851884.258901:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.258902:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851884.258903:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851884.258905:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851884.258907:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17633@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.258909:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17633@kfi7 : PUT - for me
00000400:00000200:29.0:1773851884.258910:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17633@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.258911:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4af961f nid 17633@kfi7 refs 1
00000400:00000200:29.0:1773851884.258912:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17633@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.258913:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4af961f nid 17633@kfi7 refs 2
00000400:00000200:29.0:1773851884.258914:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e4af961f nid 17633@kfi7 refs 3
00000400:00000200:29.0:1773851884.258914:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17633@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.258915:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17633@kfi7 of length 224 into portal 12 MB=0x69b4b931fde40
00000400:00000200:29.0:1773851884.258917:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17633@kfi7 of length 224/224 into md 0x77fe139dd [64] + 192400
00000800:00000200:29.0:1773851884.258919:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851884.258921:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851884.258922:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17633@kfi7: PUT: OK
00000100:00000001:29.0:1773851884.258923:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851884.258923:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851884.258924:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1522f00.
00000100:00000040:29.0:1773851884.258925:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f1522f00 x1859598753455680 msgsize 224
00000100:00100000:29.0:1773851884.258927:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17633@kfi7 (source: 12345-17633@kfi7)
00000100:00000001:29.0:1773851884.258928:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851884.258929:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e4af961f nid 17633@kfi7 refs 2
00000800:00000200:29.0:1773851884.258931:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851884.258933:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851884.258933:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851884.258934:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851884.258934:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851884.258935:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851884.258936:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598753455680
00000020:00000001:29.0:1773851884.258936:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851884.258937:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8099b
00000020:00000001:29.0:1773851884.258937:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851884.258942:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fede496f refcount=8
00000020:00000001:29.0:1773851884.258942:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117170323456 : -106956539228160 : ffff9eb93d791000)
00000020:00000001:29.0:1773851884.258943:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117170323456 : -106956539228160 : ffff9eb93d791000)
00000100:00000001:29.0:1773851884.258944:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.258945:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851884.258946:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a8d492b0.
00000020:00000010:29.0:1773851884.258947:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851884.258947:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851884.258948:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851884.258949:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851884.258949:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851884.258950:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851884.258951:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851884.258951:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.258952:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851884.258953:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851884.258954:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851884.258954:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851884.258954:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851884.258954:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17633@kfi7, seq: 2055565
00000100:00000001:30.0:1773851884.258955:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851884.258955:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fede496f : new rpc_count 1
00000100:00000001:30.0:1773851884.258956:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.258956:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058761471488 : -107014948080128 : ffff9eaba408b600)
00000100:00000040:29.0:1773851884.258957:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f1522f00 x1859598753455680/t0(0) o400->29856548-4271-4889-a205-e4e0845be9f2@17633@kfi7:672/0 lens 224/0 e 0 to 0 dl 1773852032 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1583-0'
00000100:00000001:29.0:1773851884.258960:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.258961:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851884.258961:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1522f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:29856548-4271-4889-a205-e4e0845be9f2+8:39566:x1859598753455680:12345-17633@kfi7:400:default-tuolumne1583-0
00000100:00000200:29.0:1773851884.258963:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598753455680
00000020:00000001:29.0:1773851884.258963:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851884.258964:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851884.258964:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.258965:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851884.258966:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851884.258966:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851884.258967:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598753455680, found 0 last_xid 1859598753455679
00000020:00000001:29.0:1773851884.258968:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851884.258968:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851884.258969:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851884.258969:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.258970:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851884.258971:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851884.258971:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851884.258972:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b8ea7eb2.
02000000:00000001:29.0:1773851884.258972:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.258973:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.258974:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851884.258974:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182337367090, transno 0, xid 1859598753455680
00010000:00000001:29.0:1773851884.258975:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851884.258976:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f1522f00 x1859598753455680/t0(0) o400->29856548-4271-4889-a205-e4e0845be9f2@17633@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1583-0'
00010000:00000001:29.0:1773851884.258978:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851884.258978:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851884.258979:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=117 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851884.258980:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851884.258981:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000050513968 refcount 3 to 17633@kfi7
00000100:00000001:29.0:1773851884.258982:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066048 : -107155994485568 : ffff9e8acd035cc0)
02000000:00000001:29.0:1773851884.258983:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851884.258984:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.258984:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851884.258985:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17633@kfi7
00000400:00000010:29.0:1773851884.258986:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e59cee39.
00000100:00000200:29.0:1773851884.258986:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598753455680, offset 224
00000400:00000200:29.0:1773851884.258988:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17633@kfi7
00000400:00000200:29.0:1773851884.258988:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17633@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.258989:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4af961f nid 17633@kfi7 refs 1
00000400:00000200:29.0:1773851884.258990:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e4af961f nid 17633@kfi7 refs 2
00000400:00000200:29.0:1773851884.258991:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e4af961f nid 17633@kfi7 refs 3
00000400:00000200:29.0:1773851884.258992:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17633@kfi7 local destination
00000400:00000200:29.0:1773851884.258994:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769787:8769787:1024:4294967295] 17633@kfi7 LPNI seq info [12527634:12527634:16:4294967295]
00000400:00000200:29.0:1773851884.258995:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e4af961f nid 17633@kfi7 refs 2
00000400:00000200:29.0:1773851884.258996:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17633@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.258997:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17633@kfi7(17633@kfi7:17633@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851884.258999:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e4af961f nid 17633@kfi7 refs 3
00000800:00000200:29.0:1773851884.259000:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.259001:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851884.259003:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851884.259005:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ce Using peer 17633@kfi7(0x1000000000000ce)
00000800:00000200:29.0:1773851884.259008:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x1000000000000ce: rc=0
00000800:00000200:29.0:1773851884.259009:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851884.259011:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851884.259012:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000050513968 refcount 2 to 17633@kfi7
00010000:00000001:29.0:1773851884.259013:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851884.259016:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.259016:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851884.259017:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1522f00 x1859598753455680/t0(0) o400->29856548-4271-4889-a205-e4e0845be9f2@17633@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1583-0'
00000100:00100000:29.0:1773851884.259020:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1522f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:29856548-4271-4889-a205-e4e0845be9f2+8:39566:x1859598753455680:12345-17633@kfi7:400:default-tuolumne1583-0 Request processed in 59us (94us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851884.259022:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17633@kfi7, seq: 2055565
00000800:00000200:30.0:1773851884.259023:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ce TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851884.259023:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fede496f : new rpc_count 0
00000100:00000001:29.0:1773851884.259024:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851884.259024:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:30.0:1773851884.259025:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851884.259025:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851884.259025:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851884.259026:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a8d492b0.
00000400:00000200:30.0:1773851884.259027:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17633@kfi7: PUT: OK
00000020:00000040:29.0:1773851884.259027:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000fede496f : new refcount 7
00000400:00000200:30.0:1773851884.259028:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e59cee39
00000400:00000010:30.0:1773851884.259028:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e59cee39.
00000100:00000001:29.0:1773851884.259028:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851884.259029:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851884.259029:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851884.259030:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e4af961f nid 17633@kfi7 refs 2
00000800:00000200:30.0:1773851884.259032:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2054@kfi7:7 -> 17633@kfi7(00000000c017c76e):0x0 lsk 207 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000ce Transaction freed
00000800:00000200:1.0:1773851884.306783:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851884.306784:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851884.306787:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851884.306790:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851884.306794:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25427@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.306796:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25427@kfi7 : PUT - for me
00000400:00000200:1.0:1773851884.306798:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25427@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.306799:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005586c122 nid 25427@kfi7 refs 1
00000400:00000200:1.0:1773851884.306801:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25427@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.306802:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005586c122 nid 25427@kfi7 refs 2
00000400:00000200:1.0:1773851884.306804:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005586c122 nid 25427@kfi7 refs 3
00000400:00000200:1.0:1773851884.306806:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25490@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.306808:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25490@kfi7 of length 224 into portal 12 MB=0x69b16ef1ea980
00000400:00000200:1.0:1773851884.306810:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25490@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 42752
00000800:00000200:1.0:1773851884.306814:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851884.306816:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851884.306818:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25427@kfi7: PUT: OK
00000100:00000001:1.0:1773851884.306820:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851884.306820:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851884.306822:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000651be842.
00000100:00000040:1.0:1773851884.306823:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000651be842 x1859372663613824 msgsize 224
00000100:00100000:1.0:1773851884.306825:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25490@kfi7 (source: 12345-25427@kfi7)
00000100:00000001:1.0:1773851884.306828:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851884.306829:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005586c122 nid 25427@kfi7 refs 2
00000800:00000200:1.0:1773851884.306832:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851884.306836:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851884.306837:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851884.306837:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851884.306838:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851884.306840:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851884.306841:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372663613824
00000020:00000001:1.0:1773851884.306842:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851884.306842:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92fbf
00000020:00000001:1.0:1773851884.306843:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851884.306846:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000deffb2b8 refcount=6
00000020:00000001:1.0:1773851884.306847:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744907776 : -107128964643840 : ffff9e91181e0400)
00000020:00000001:1.0:1773851884.306848:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744907776 : -107128964643840 : ffff9e91181e0400)
00000100:00000001:1.0:1773851884.306850:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851884.306851:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851884.306852:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aaa4c47a.
00000020:00000010:1.0:1773851884.306854:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851884.306855:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f309d4d6.
00000100:00000001:1.0:1773851884.306857:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851884.306858:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851884.306859:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851884.306860:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851884.306861:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851884.306862:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.306863:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851884.306865:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851884.306866:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851884.306866:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851884.306867:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851884.306868:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25490@kfi7, seq: 1997601
00000100:00000040:1.0:1773851884.306869:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000deffb2b8 : new rpc_count 1
00000100:00000001:0.0:1773851884.306869:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.306870:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112248320 : -106950597303296 : ffff9eba9fa3a400)
00000100:00000001:0.0:1773851884.306870:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851884.306872:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000651be842 x1859372663613824/t0(0) o400->4a6d5062-edf3-4d80-bcd5-bfa7123d2849@25490@kfi7:524/0 lens 224/0 e 0 to 0 dl 1773852639 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2086-0'
00000100:00000001:1.0:1773851884.306877:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851884.306877:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851884.306879:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000651be842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4a6d5062-edf3-4d80-bcd5-bfa7123d2849+6:39725:x1859372663613824:12345-25490@kfi7:400:default-tuolumne2086-0
00000100:00000200:1.0:1773851884.306881:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372663613824
00000020:00000001:1.0:1773851884.306882:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851884.306883:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851884.306884:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.306885:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851884.306886:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851884.306887:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851884.306888:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372663613824, found 0 last_xid 1859372663613823
00000020:00000001:1.0:1773851884.306889:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851884.306890:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851884.306891:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851884.306892:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.306893:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851884.306894:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851884.306895:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851884.306896:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a4593418.
02000000:00000001:1.0:1773851884.306897:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.306899:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.306900:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851884.306901:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254665448, transno 0, xid 1859372663613824
00010000:00000001:1.0:1773851884.306902:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851884.306904:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000651be842 x1859372663613824/t0(0) o400->4a6d5062-edf3-4d80-bcd5-bfa7123d2849@25490@kfi7:524/0 lens 224/224 e 0 to 0 dl 1773852639 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2086-0'
00010000:00000001:1.0:1773851884.306908:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851884.306909:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851884.306910:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=117 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851884.306912:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851884.306913:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f37d4576 refcount 3 to 25490@kfi7
00000100:00000001:1.0:1773851884.306914:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049280 : -107154804502336 : ffff9e8b13f110c0)
02000000:00000001:1.0:1773851884.306915:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851884.306916:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.306917:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851884.306918:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25427@kfi7
00000400:00000010:1.0:1773851884.306919:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000077f3bf52.
00000100:00000200:1.0:1773851884.306921:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372663613824, offset 224
00000400:00000200:1.0:1773851884.306923:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25427@kfi7
00000400:00000200:1.0:1773851884.306924:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25427@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.306925:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005586c122 nid 25427@kfi7 refs 1
00000400:00000200:1.0:1773851884.306927:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005586c122 nid 25427@kfi7 refs 2
00000400:00000200:1.0:1773851884.306929:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005586c122 nid 25427@kfi7 refs 3
00000400:00000200:1.0:1773851884.306931:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25427@kfi7 local destination
00000400:00000200:1.0:1773851884.306933:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769788:8769788:1024:4294967295] 25427@kfi7 LPNI seq info [412586:412586:16:4294967295]
00000400:00000200:1.0:1773851884.306935:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005586c122 nid 25427@kfi7 refs 2
00000400:00000200:1.0:1773851884.306937:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25427@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.306940:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25427@kfi7(25427@kfi7:25427@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851884.306942:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005586c122 nid 25427@kfi7 refs 3
00000800:00000200:1.0:1773851884.306944:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851884.306946:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851884.306953:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851884.306957:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20a Using peer 25427@kfi7(0x20a)
00000800:00000200:1.0:1773851884.306961:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 324 bytes to peer 0x20a: rc=0
00000800:00000200:1.0:1773851884.306963:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851884.306966:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851884.306968:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f37d4576 refcount 2 to 25490@kfi7
00010000:00000001:1.0:1773851884.306969:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851884.306970:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.306971:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851884.306972:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000651be842 x1859372663613824/t0(0) o400->4a6d5062-edf3-4d80-bcd5-bfa7123d2849@25490@kfi7:524/0 lens 224/224 e 0 to 0 dl 1773852639 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2086-0'
00000100:00100000:1.0:1773851884.306977:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000651be842 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:4a6d5062-edf3-4d80-bcd5-bfa7123d2849+6:39725:x1859372663613824:12345-25490@kfi7:400:default-tuolumne2086-0 Request processed in 99us (153us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851884.306978:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20a TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851884.306980:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851884.306981:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25490@kfi7, seq: 1997601
00000400:00000200:2.0:1773851884.306982:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25427@kfi7: PUT: OK
00000100:00000040:1.0:1773851884.306982:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000deffb2b8 : new rpc_count 0
00000400:00000200:2.0:1773851884.306983:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000077f3bf52
00000400:00000010:2.0:1773851884.306984:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000077f3bf52.
00000100:00000001:1.0:1773851884.306984:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851884.306984:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:2.0:1773851884.306985:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851884.306985:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000100:00000001:2.0:1773851884.306986:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851884.306986:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f309d4d6.
00000400:00000200:2.0:1773851884.306987:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005586c122 nid 25427@kfi7 refs 2
00000020:00000010:1.0:1773851884.306988:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aaa4c47a.
00000020:00000040:1.0:1773851884.306989:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000deffb2b8 : new refcount 5
00000800:00000200:2.0:1773851884.306990:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2069@kfi7:0 -> 25427@kfi7(00000000c21c1e9a):0x0 lsk 523 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20a Transaction freed
00000100:00000001:1.0:1773851884.306990:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851884.310378:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851884.310379:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851884.310380:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851884.310382:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851884.310384:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24562@kfi7 to cpt 4
00000400:00000200:18.0:1773851884.310385:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24562@kfi7 : PUT - for me
00000400:00000200:18.0:1773851884.310386:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24562@kfi7 to cpt 4
00000400:00000200:18.0:1773851884.310387:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 1
00000400:00000200:18.0:1773851884.310389:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24562@kfi7 to cpt 4
00000400:00000200:18.0:1773851884.310389:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 2
00000400:00000200:18.0:1773851884.310390:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 3
00000400:00000200:18.0:1773851884.310391:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24371@kfi7 to cpt 5
00000400:00000200:18.0:1773851884.310392:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24371@kfi7 of length 224 into portal 12 MB=0x69b4b87812300
00000400:00000200:18.0:1773851884.310394:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24371@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 35112
00000800:00000200:18.0:1773851884.310396:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851884.310398:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851884.310399:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24562@kfi7: PUT: OK
00000100:00000001:18.0:1773851884.310400:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851884.310401:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851884.310402:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009eb4ccfc.
00000100:00000040:18.0:1773851884.310402:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000009eb4ccfc x1859598558503680 msgsize 224
00000100:00100000:18.0:1773851884.310404:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-24371@kfi7 (source: 12345-24562@kfi7)
00000100:00000001:18.0:1773851884.310405:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851884.310406:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 2
00000100:00000001:16.0:1773851884.310407:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851884.310407:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851884.310408:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851884.310408:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851884.310408:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851884.310409:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851884.310410:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598558503680
00000020:00000001:16.0:1773851884.310411:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851884.310411:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2437c7dc
00000020:00000001:16.0:1773851884.310412:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851884.310415:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000050911f1e refcount=5
00000020:00000001:16.0:1773851884.310415:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148199836672 : -106925509714944 : ffff9ec076f9dc00)
00000020:00000001:16.0:1773851884.310416:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148199836672 : -106925509714944 : ffff9ec076f9dc00)
00000100:00000001:16.0:1773851884.310417:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.310418:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851884.310419:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851884.310420:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.310421:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851884.310422:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851884.310422:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851884.310423:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851884.310424:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851884.310425:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851884.310425:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.310426:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851884.310427:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851884.310428:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851884.310429:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851884.310429:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851884.310429:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24371@kfi7, seq: 2156391
00000100:00000040:16.0:1773851884.310429:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000050911f1e : new rpc_count 1
00000100:00000001:17.0:1773851884.310430:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.310430:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534671104 : -106946174880512 : ffff9ebba73c7500)
00000100:00000001:17.0:1773851884.310431:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.310431:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009eb4ccfc x1859598558503680/t0(0) o400->20f5b407-f989-430d-ab99-0051ee5d1423@24371@kfi7:105/0 lens 224/0 e 0 to 0 dl 1773852220 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2009-0'
00000100:00000001:16.0:1773851884.310434:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.310434:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851884.310435:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009eb4ccfc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:20f5b407-f989-430d-ab99-0051ee5d1423+5:39524:x1859598558503680:12345-24371@kfi7:400:default-tuolumne2009-0
00000100:00000200:16.0:1773851884.310437:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598558503680
00000020:00000001:16.0:1773851884.310437:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851884.310438:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851884.310439:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.310439:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851884.310440:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851884.310441:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851884.310441:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598558503680, found 0 last_xid 1859598558503679
00000020:00000001:16.0:1773851884.310442:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851884.310443:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851884.310444:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851884.310444:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.310445:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851884.310445:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851884.310446:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851884.310447:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000faef80ef.
02000000:00000001:16.0:1773851884.310447:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.310448:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.310449:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851884.310449:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046961379, transno 0, xid 1859598558503680
00010000:00000001:16.0:1773851884.310451:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851884.310452:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009eb4ccfc x1859598558503680/t0(0) o400->20f5b407-f989-430d-ab99-0051ee5d1423@24371@kfi7:105/0 lens 224/224 e 0 to 0 dl 1773852220 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2009-0'
00010000:00000001:16.0:1773851884.310454:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851884.310455:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851884.310455:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=117 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851884.310456:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851884.310457:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c39eb9da refcount 3 to 24371@kfi7
00000100:00000001:16.0:1773851884.310458:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024800 : -107156745526816 : ffff9e8aa03f61e0)
02000000:00000001:16.0:1773851884.310459:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851884.310459:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.310460:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851884.310461:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24562@kfi7
00000400:00000010:16.0:1773851884.310461:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cb7f95f1.
00000100:00000200:16.0:1773851884.310462:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598558503680, offset 224
00000400:00000200:16.0:1773851884.310463:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24562@kfi7
00000400:00000200:16.0:1773851884.310464:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24562@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.310465:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 1
00000400:00000200:16.0:1773851884.310466:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 2
00000400:00000200:16.0:1773851884.310467:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 3
00000400:00000200:16.0:1773851884.310468:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24562@kfi7 local destination
00000400:00000200:16.0:1773851884.310469:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769789:8769789:1024:4294967295] 24562@kfi7 LPNI seq info [7938533:7938533:16:4294967295]
00000400:00000200:16.0:1773851884.310471:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 2
00000400:00000200:16.0:1773851884.310472:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24562@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.310474:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24562@kfi7(24562@kfi7:24562@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851884.310475:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 3
00000800:00000200:16.0:1773851884.310476:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851884.310477:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851884.310479:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851884.310484:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cba Using peer 24562@kfi7(0x100000000000cba)
00000800:00000200:16.0:1773851884.310486:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x100000000000cba: rc=0
00000800:00000200:16.0:1773851884.310488:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cba TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851884.310490:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.310491:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c39eb9da refcount 2 to 24371@kfi7
00010000:00000001:16.0:1773851884.310492:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851884.310492:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.310493:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851884.310494:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009eb4ccfc x1859598558503680/t0(0) o400->20f5b407-f989-430d-ab99-0051ee5d1423@24371@kfi7:105/0 lens 224/224 e 0 to 0 dl 1773852220 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2009-0'
00000100:00100000:16.0:1773851884.310498:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009eb4ccfc pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:20f5b407-f989-430d-ab99-0051ee5d1423+5:39524:x1859598558503680:12345-24371@kfi7:400:default-tuolumne2009-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851884.310501:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24371@kfi7, seq: 2156391
00000100:00000040:16.0:1773851884.310501:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000050911f1e : new rpc_count 0
00000100:00000001:16.0:1773851884.310502:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851884.310503:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851884.310503:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.310504:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:16.0:1773851884.310505:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:16.0:1773851884.310506:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000050911f1e : new refcount 4
00000100:00000001:16.0:1773851884.310507:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851884.310512:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cba TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851884.310513:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851884.310514:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24562@kfi7: PUT: OK
00000400:00000200:18.0:1773851884.310515:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cb7f95f1
00000400:00000010:18.0:1773851884.310516:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cb7f95f1.
00000100:00000001:18.0:1773851884.310516:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851884.310517:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851884.310518:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a8ac9c52 nid 24562@kfi7 refs 2
00000800:00000200:18.0:1773851884.310520:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 24562@kfi7(00000000a9d0f91d):0x0 lsk 3259 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cba Transaction freed
00000004:00000001:15.0:1773851884.361731:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:3.0:1773851884.361731:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:15.0:1773851884.361732:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:11.0:1773851884.361732:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851884.361732:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:3.0:1773851884.361732:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:15.0:1773851884.361733:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000373f1cb1.
00000004:00000020:11.0:1773851884.361733:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851884.361733:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000918809b0.
00000004:00000020:10.0:1773851884.361733:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851884.361733:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c66d318a.
00000100:00000010:3.0:1773851884.361733:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042fd7e5c.
00000020:00000040:11.0:1773851884.361734:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000020:00000040:10.0:1773851884.361734:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000020:00000040:3.0:1773851884.361734:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000020:00000040:15.0:1773851884.361735:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:11.0:1773851884.361735:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851884.361735:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:3.0:1773851884.361735:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:3.0:1773851884.361735:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:15.0:1773851884.361736:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851884.361736:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851884.361736:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:3.0:1773851884.361736:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851884.361737:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851884.361737:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851884.361737:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851884.361738:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851884.361738:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004ecafcc4.
02000000:00000010:10.0:1773851884.361738:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001e07dc98.
02000000:00000010:3.0:1773851884.361738:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004d587788.
02000000:00000010:15.0:1773851884.361739:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000fcad1a1f.
00000100:00000001:11.0:1773851884.361739:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851884.361739:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851884.361739:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851884.361740:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.361740:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851884.361740:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851884.361740:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851884.361740:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851884.361741:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851884.361741:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851884.361741:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851884.361742:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.361742:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000918809b0] to pc [ptlrpcd_02_03+3]  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851884.361742:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c66d318a] to pc [ptlrpcd_02_00+0]  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:3.0:1773851884.361742:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000042fd7e5c] to pc [ptlrpcd_00_03+3]  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:15.0:1773851884.361743:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000373f1cb1] to pc [ptlrpcd_03_00+0]  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851884.361746:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851884.361746:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:3.0:1773851884.361746:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:11.0:1773851884.361747:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b21c4693.
00080000:00000010:10.0:1773851884.361747:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d12ddd64.
00080000:00000001:10.0:1773851884.361747:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636917851018240 : -107155858533376 : ffff9e8ad51dd400)
00000100:00000001:8.0:1773851884.361747:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851884.361747:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:3.0:1773851884.361747:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000047b60e6.
00000100:00000001:2.0:1773851884.361747:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:15.0:1773851884.361748:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851884.361748:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121423155200 : -106952286396416 : ffff9eba3af62000)
00080000:00000001:10.0:1773851884.361748:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851884.361748:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851884.361748:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851884.361748:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:3.0:1773851884.361748:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130284289024 : -106943425262592 : ffff9ebc4b204c00)
00000100:00000001:2.0:1773851884.361748:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851884.361748:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851884.361749:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851884.361749:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361749:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:8.0:1773851884.361749:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:3.0:1773851884.361749:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:2.0:1773851884.361749:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851884.361749:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851884.361750:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851884.361750:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851884.361750:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851884.361750:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00080000:00000010:15.0:1773851884.361751:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000000d6db354.
00080000:00000001:15.0:1773851884.361751:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637103695526912 : -106970014024704 : ffff9eb61a4ffc00)
00000100:00000001:14.0:1773851884.361751:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361751:0:41072:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851884.361751:0:41072:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:11.0:1773851884.361751:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00000010:10.0:1773851884.361751:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000080eaf73c.
00000100:00000040:9.0:1773851884.361751:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851884.361751:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:3.0:1773851884.361751:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:3.0:1773851884.361751:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000100:00000040:2.0:1773851884.361751:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:15.0:1773851884.361752:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000010:11.0:1773851884.361752:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000821a390a.
00000004:00080000:10.0:1773851884.361752:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614158815027183ns, next at 614159815026161ns, rc = 0
00000100:00000001:8.0:1773851884.361752:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851884.361753:0:41072:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:11.0:1773851884.361753:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614158815028285ns, next at 614159815027473ns, rc = 0
00080000:00000001:10.0:1773851884.361753:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851884.361753:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851884.361753:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851884.361753:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:3.0:1773851884.361753:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c0b4dc02.
00080000:00000001:15.0:1773851884.361754:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:15.0:1773851884.361754:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00080000:00000001:11.0:1773851884.361754:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00000001:10.0:1773851884.361754:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361754:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851884.361754:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851884.361754:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000918809b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051935168:6@kfi7:13:default-yuba2-0
00000004:00080000:3.0:1773851884.361754:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614158815029257ns, next at 614159815027844ns, rc = 0
00000100:00000001:2.0:1773851884.361754:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851884.361754:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:15.0:1773851884.361755:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006b96063c.
00080000:00000001:11.0:1773851884.361755:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851884.361755:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851884.361755:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:8.0:1773851884.361755:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:3.0:1773851884.361755:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:2.0:1773851884.361755:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:15.0:1773851884.361756:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614158815031641ns, next at 614159815030469ns, rc = 0
00000100:00000001:12.0:1773851884.361756:0:41072:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:12.0:1773851884.361756:0:41072:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851884.361756:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851884.361756:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851884.361756:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851884.361756:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851884.361756:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851884.361756:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851884.361757:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:12.0:1773851884.361757:0:41072:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851884.361757:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:2.0:1773851884.361757:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000042fd7e5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051935040:2095@kfi7:13:default-yuba2-0
02000000:00000001:12.0:1773851884.361758:0:41072:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851884.361758:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c66d318a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051935104:31@kfi7:13:default-yuba2-0
02000000:00000010:8.0:1773851884.361758:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000023401374.
02000000:00000001:8.0:1773851884.361758:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851884.361759:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851884.361759:0:41072:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000373f1cb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_00:lustre5-MDT0001-mdtlov_UUID:41072:1859433051935232:54@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851884.361759:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:8.0:1773851884.361759:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000001:2.0:1773851884.361759:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:15.0:1773851884.361760:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361760:0:41072:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:10.0:1773851884.361760:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:9.0:1773851884.361760:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851884.361760:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851884.361760:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
02000000:00000001:2.0:1773851884.361760:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:12.0:1773851884.361761:0:41072:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:10.0:1773851884.361761:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851884.361761:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:8.0:1773851884.361761:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ce37ba88.
02000000:00000001:2.0:1773851884.361761:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851884.361761:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:12.0:1773851884.361762:0:41072:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851884.361762:0:41072:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:8.0:1773851884.361762:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935168, portal 4
00000100:00000001:8.0:1773851884.361762:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000010:2.0:1773851884.361762:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f82e5278.
00000100:00000001:8.0:1773851884.361763:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446612224 : -106937262939392 : ffff9ebdba6de300)
02000000:00000001:2.0:1773851884.361763:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:12.0:1773851884.361764:0:41072:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001e613f2a.
00000100:00000001:10.0:1773851884.361764:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:8.0:1773851884.361764:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851884.361764:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
02000000:00000001:12.0:1773851884.361765:0:41072:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851884.361765:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851884.361765:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000003878eca.
00000400:00000010:2.0:1773851884.361765:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000400:00000200:12.0:1773851884.361766:0:41072:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
02000000:00000001:9.0:1773851884.361766:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361766:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:2.0:1773851884.361766:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000757d75ef.
00000400:00000010:12.0:1773851884.361767:0:41072:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000001259ac8.
00000400:00000010:12.0:1773851884.361767:0:41072:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e9ba439.
00000400:00000200:9.0:1773851884.361767:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:9.0:1773851884.361767:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000100:00000040:8.0:1773851884.361767:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:8.0:1773851884.361767:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a36d61ab.
00000100:00000200:2.0:1773851884.361767:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935040, portal 4
00000400:00000010:9.0:1773851884.361768:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027709c97.
00000100:00000200:8.0:1773851884.361768:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935168, offset 0
00000100:00000001:2.0:1773851884.361768:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851884.361768:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288728960 : -106964420822656 : ffff9eb767b17980)
00000100:00000200:12.0:1773851884.361769:0:41072:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935232, portal 4
00000100:00000001:12.0:1773851884.361769:0:41072:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:8.0:1773851884.361769:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000100:00000001:12.0:1773851884.361770:0:41072:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860202240 : -107049849349376 : ffff9ea383c19b00)
00000100:00000200:9.0:1773851884.361770:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935104, portal 4
00000100:00000001:9.0:1773851884.361770:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:8.0:1773851884.361770:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000040:2.0:1773851884.361770:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:12.0:1773851884.361771:0:41072:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851884.361771:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087769088 : -106944621782528 : ffff9ebc03ceda00)
00000400:00000200:8.0:1773851884.361771:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000100:00000040:9.0:1773851884.361772:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851884.361772:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:8.0:1773851884.361773:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:2.0:1773851884.361773:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:12.0:1773851884.361774:0:41072:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851884.361774:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000100:00000040:2.0:1773851884.361774:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000010:2.0:1773851884.361774:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009a9b731f.
00000100:00000040:12.0:1773851884.361775:0:41072:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000100:00000001:9.0:1773851884.361775:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851884.361775:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769788, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769789, p:4294967295, g:4294967295, h:1000]
00000100:00000200:2.0:1773851884.361775:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935040, offset 0
00000400:00000010:12.0:1773851884.361776:0:41072:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d61c8fc4.
00000100:00000200:12.0:1773851884.361776:0:41072:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935232, offset 0
00000100:00000040:9.0:1773851884.361776:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:9.0:1773851884.361777:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000635b52f2.
00000100:00000200:9.0:1773851884.361777:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935104, offset 0
00000400:00000200:8.0:1773851884.361777:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:2.0:1773851884.361777:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:12.0:1773851884.361778:0:41072:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:8.0:1773851884.361778:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851884.361778:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:12.0:1773851884.361779:0:41072:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851884.361779:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000400:00000200:8.0:1773851884.361779:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:2.0:1773851884.361779:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:12.0:1773851884.361780:0:41072:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:8.0:1773851884.361780:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769790:8769790:1024:4294967295] 6@kfi7 LPNI seq info [5405034:5405034:16:4294967295]
00000400:00000200:2.0:1773851884.361780:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:2.0:1773851884.361781:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:12.0:1773851884.361782:0:41072:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:8.0:1773851884.361782:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:12.0:1773851884.361783:0:41072:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851884.361783:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851884.361783:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:12.0:1773851884.361784:0:41072:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:9.0:1773851884.361784:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:9.0:1773851884.361785:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:2.0:1773851884.361785:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769790, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769789, p:4294967295, g:4294967295, h:1000]
00000400:00000200:12.0:1773851884.361786:0:41072:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769790, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769789, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851884.361786:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851884.361787:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:12.0:1773851884.361788:0:41072:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851884.361788:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:2.0:1773851884.361788:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:12.0:1773851884.361789:0:41072:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851884.361789:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000200:2.0:1773851884.361789:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:12.0:1773851884.361790:0:41072:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:12.0:1773851884.361791:0:41072:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769792:8769792:1024:4294967295] 54@kfi7 LPNI seq info [5403925:5403925:16:4294967295]
00000400:00000200:9.0:1773851884.361791:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769790, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769789, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851884.361791:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769791:8769791:1024:4294967295] 2095@kfi7 LPNI seq info [5406046:5406046:16:4294967295]
00000400:00000200:12.0:1773851884.361793:0:41072:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851884.361793:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:2.0:1773851884.361793:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:12.0:1773851884.361794:0:41072:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851884.361794:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851884.361795:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000200:2.0:1773851884.361795:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:9.0:1773851884.361799:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769793:8769793:1023:4294967295] 31@kfi7 LPNI seq info [5403621:5403621:16:4294967295]
00000400:00000200:12.0:1773851884.361802:0:41072:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851884.361802:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:12.0:1773851884.361804:0:41072:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851884.361804:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:8.0:1773851884.361805:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851884.361805:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000800:00000200:12.0:1773851884.361806:0:41072:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851884.361807:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851884.361807:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:2.0:1773851884.361807:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000800:00000200:12.0:1773851884.361808:0:41072:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851884.361808:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:8.0:1773851884.361808:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851884.361809:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851884.361810:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:2.0:1773851884.361810:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:12.0:1773851884.361811:0:41072:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851884.361812:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851884.361812:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851884.361812:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851884.361814:0:41072:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000800:00000200:2.0:1773851884.361814:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851884.361815:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Using peer 6@kfi7(0x54b)
00000800:00000200:9.0:1773851884.361817:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851884.361818:0:41072:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000800:00000200:8.0:1773851884.361818:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x54b: rc=0
00000800:00000200:2.0:1773851884.361818:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Using peer 2095@kfi7(0x2000000000005b3)
00000800:00000200:12.0:1773851884.361820:0:41072:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851884.361820:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Using peer 31@kfi7(0x56e)
00000800:00000200:8.0:1773851884.361820:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851884.361821:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 0000000014e57432: Posted send of 324 bytes to peer 0x2000000000005b3: rc=0
00000100:00000001:12.0:1773851884.361822:0:41072:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361822:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361823:0:41072:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851884.361823:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:2.0:1773851884.361823:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851884.361824:0:41072:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851884.361824:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x56e: rc=0
00000100:00000001:8.0:1773851884.361824:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361825:0:41072:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851884.361825:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851884.361825:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361825:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851884.361825:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361826:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851884.361826:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851884.361827:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361828:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851884.361828:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361829:0:41072:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851884.361829:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361829:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851884.361829:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851884.361830:0:41072:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851884.361830:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851884.361830:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851884.361830:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851884.361830:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:12.0:1773851884.361831:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851884.361831:0:41072:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851884.361831:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851884.361832:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851884.361832:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851884.361832:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851884.361833:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851884.361833:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851884.361834:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361835:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.361835:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851884.361835:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_EVENT_TX_OK event status 0
00000100:00000001:12.0:1773851884.361836:0:41072:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361836:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361837:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361837:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:13.0:1773851884.361838:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000800:00000200:11.0:1773851884.361838:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_EVENT_TX_OK event status 0
00000800:00000200:10.0:1773851884.361838:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851884.361838:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:1.0:1773851884.361838:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851884.361839:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851884.361840:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851884.361840:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851884.361840:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000400:00000200:13.0:1773851884.361841:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:10.0:1773851884.361841:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851884.361841:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851884.361842:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d61c8fc4
00000400:00000200:11.0:1773851884.361842:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851884.361842:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851884.361842:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009a9b731f
00000400:00000010:13.0:1773851884.361843:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d61c8fc4.
00000400:00000200:10.0:1773851884.361843:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000400:00000010:1.0:1773851884.361843:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009a9b731f.
00000100:00000001:13.0:1773851884.361844:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:11.0:1773851884.361844:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:1.0:1773851884.361844:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:13.0:1773851884.361845:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851884.361845:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a36d61ab
00000400:00000010:10.0:1773851884.361846:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a36d61ab.
00000100:00000200:1.0:1773851884.361846:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851884.361847:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000635b52f2
00000100:00000001:10.0:1773851884.361847:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000010:11.0:1773851884.361848:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000635b52f2.
00000100:00000001:13.0:1773851884.361849:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851884.361849:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851884.361849:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:13.0:1773851884.361850:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:11.0:1773851884.361851:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851884.361851:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:13.0:1773851884.361853:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851884.361853:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851884.361854:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:10.0:1773851884.361854:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:13.0:1773851884.361855:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:11.0:1773851884.361856:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851884.361856:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851884.361857:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000100:00000040:11.0:1773851884.361858:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851884.361858:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.361859:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:10.0:1773851884.361860:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851884.361861:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:10.0:1773851884.361862:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:11.0:1773851884.361863:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.361864:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851884.361864:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:1.0:1773851884.361864:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Transaction freed
00000400:00000200:11.0:1773851884.361866:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:10.0:1773851884.361867:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Transaction freed
00000800:00000200:11.0:1773851884.361869:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Transaction freed
00000800:00000200:13.0:1773851884.361872:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:17.0:1773851884.361873:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:13.0:1773851884.361873:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851884.361874:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851884.361875:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851884.361877:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851884.361877:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851884.361879:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:13.0:1773851884.361879:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:29.0:1773851884.361880:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851884.361881:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851884.361881:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000800:00000200:29.0:1773851884.361882:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851884.361883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:29.0:1773851884.361884:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851884.361884:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:17.0:1773851884.361885:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:13.0:1773851884.361885:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851884.361886:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000800:00000200:1.0:1773851884.361886:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:29.0:1773851884.361887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851884.361887:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000800:00000200:1.0:1773851884.361887:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851884.361888:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:13.0:1773851884.361888:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:29.0:1773851884.361889:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:29.0:1773851884.361890:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851884.361890:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:13.0:1773851884.361890:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5200
00000800:00000200:1.0:1773851884.361890:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851884.361892:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:29.0:1773851884.361893:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:17.0:1773851884.361893:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:13.0:1773851884.361893:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f6a4d [1] + 224
00000800:00000200:1.0:1773851884.361894:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851884.361895:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.361896:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:17.0:1773851884.361896:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:13.0:1773851884.361896:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851884.361897:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:29.0:1773851884.361898:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851884.361898:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:13.0:1773851884.361898:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851884.361898:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:17.0:1773851884.361899:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:13.0:1773851884.361899:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:29.0:1773851884.361900:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5140
00000100:00000001:13.0:1773851884.361901:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851884.361901:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:29.0:1773851884.361902:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851884.361902:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000200:13.0:1773851884.361902:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851884.361903:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851884.361904:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78008153d [1] + 224
00000400:00000200:17.0:1773851884.361904:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5180
00000400:00000200:1.0:1773851884.361905:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:17.0:1773851884.361906:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:29.0:1773851884.361907:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:13.0:1773851884.361907:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851884.361908:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851884.361909:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.361909:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f1bd1 [1] + 224
00000400:00000200:1.0:1773851884.361909:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:29.0:1773851884.361911:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000400:00000200:1.0:1773851884.361911:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:29.0:1773851884.361913:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:17.0:1773851884.361913:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851884.361913:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000200:29.0:1773851884.361915:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851884.361915:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b51c0
00000400:00000200:17.0:1773851884.361916:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:29.0:1773851884.361918:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851884.361918:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:17.0:1773851884.361919:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:13.0:1773851884.361919:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851884.361920:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:1.0:1773851884.361920:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71dea1 [1] + 224
00000100:00000001:17.0:1773851884.361921:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:12.0:1773851884.361921:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851884.361922:0:41072:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851884.361923:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:17.0:1773851884.361923:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851884.361923:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000001:12.0:1773851884.361923:0:41072:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:29.0:1773851884.361924:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000001:12.0:1773851884.361924:0:41072:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:1.0:1773851884.361924:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851884.361926:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000010:12.0:1773851884.361926:0:41072:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000001259ac8.
00000100:00000001:2.0:1773851884.361926:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:12.0:1773851884.361927:0:41072:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e9ba439
00000100:00000001:2.0:1773851884.361927:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:12.0:1773851884.361928:0:41072:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e9ba439.
00000400:00000200:1.0:1773851884.361928:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:17.0:1773851884.361929:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851884.361929:0:41072:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:2.0:1773851884.361929:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:2.0:1773851884.361930:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:1.0:1773851884.361930:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000100:00000200:12.0:1773851884.361931:0:41072:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:2.0:1773851884.361931:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000400:00000200:2.0:1773851884.361932:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000757d75ef
00000100:00000001:1.0:1773851884.361932:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:2.0:1773851884.361933:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000757d75ef.
00000100:00000200:1.0:1773851884.361933:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851884.361935:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:17.0:1773851884.361936:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:2.0:1773851884.361936:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851884.361937:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000200:12.0:1773851884.361937:0:41072:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851884.361939:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:1.0:1773851884.361939:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851884.361940:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851884.361940:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:9.0:1773851884.361941:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:12.0:1773851884.361942:0:41072:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:9.0:1773851884.361942:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:12.0:1773851884.361943:0:41072:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:2.0:1773851884.361943:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851884.361944:0:41072:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:9.0:1773851884.361944:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
02000000:00000001:12.0:1773851884.361945:0:41072:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:9.0:1773851884.361945:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027709c97
00000100:00000001:12.0:1773851884.361946:0:41072:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:9.0:1773851884.361946:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027709c97.
00000100:00000001:1.0:1773851884.361946:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:12.0:1773851884.361947:0:41072:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361947:0:41068:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:12.0:1773851884.361948:0:41072:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361948:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851884.361948:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851884.361948:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000200:9.0:1773851884.361949:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851884.361949:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851884.361949:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:12.0:1773851884.361950:0:41072:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=117 v=66 (66 66 66 66)
00000400:00000001:8.0:1773851884.361950:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:2.0:1773851884.361950:0:41063:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:1.0:1773851884.361950:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:8.0:1773851884.361951:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851884.361951:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
02000000:00000001:2.0:1773851884.361951:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:8.0:1773851884.361952:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ce37ba88
00000100:00000001:2.0:1773851884.361952:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:12.0:1773851884.361953:0:41072:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=117 v=66 (1 1 1 1)
00000400:00000010:8.0:1773851884.361953:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ce37ba88.
00000100:00000001:2.0:1773851884.361953:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.361954:0:41071:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:2.0:1773851884.361954:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361955:0:41072:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:9.0:1773851884.361955:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851884.361955:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851884.361956:0:41072:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851884.361956:0:41063:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=117 v=66 (66 66 66 66)
00010000:00000001:12.0:1773851884.361957:0:41072:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:12.0:1773851884.361958:0:41072:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851884.361958:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:2.0:1773851884.361959:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=117 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851884.361960:0:41072:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851884.361960:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:12.0:1773851884.361961:0:41072:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:9.0:1773851884.361961:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.361961:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851884.361961:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:12.0:1773851884.361962:0:41072:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:12.0:1773851884.361962:0:41072:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361962:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:8.0:1773851884.361962:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.361962:0:41071:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:2.0:1773851884.361962:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851884.361963:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:8.0:1773851884.361963:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851884.361963:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:2.0:1773851884.361963:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:12.0:1773851884.361964:0:41072:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851884.361964:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851884.361964:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.361964:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851884.361965:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361966:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851884.361966:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=117 v=66 (66 66 66 66)
00000100:00000001:2.0:1773851884.361966:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:2.0:1773851884.361966:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
02000000:00000001:9.0:1773851884.361967:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851884.361967:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=32 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851884.361968:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851884.361968:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851884.361968:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:2.0:1773851884.361968:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851884.361969:0:41072:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:9.0:1773851884.361969:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=117 v=66 (66 66 66 66)
00010000:00000001:8.0:1773851884.361969:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851884.361970:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851884.361970:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:12.0:1773851884.361971:0:41072:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00001000:9.0:1773851884.361971:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=117 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851884.361971:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851884.361971:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000001:8.0:1773851884.361972:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851884.361972:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.361973:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:12.0:1773851884.361974:0:41072:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851884.361974:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851884.361974:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:9.0:1773851884.361975:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:2.0:1773851884.361975:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:12.0:1773851884.361976:0:41072:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00010000:00000001:9.0:1773851884.361976:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:12.0:1773851884.361977:0:41072:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851884.361977:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:8.0:1773851884.361977:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851884.361977:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000040:12.0:1773851884.361978:0:41072:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524038656 avail=351521285120 avail_mb=1373130020 hwm_mb=3131103 files=372113802 ffree=343285194 state=0: rc = 0
00000100:00000040:9.0:1773851884.361978:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000001:8.0:1773851884.361978:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851884.361978:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851884.361978:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851884.361979:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:8.0:1773851884.361979:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851884.361980:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:8.0:1773851884.361980:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000004:00000001:2.0:1773851884.361980:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851884.361981:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420241920 avail=351417801728 avail_mb=1372725788 hwm_mb=3131103 files=372008924 ffree=343183830 state=0: rc = 0
00000004:00000040:2.0:1773851884.361981:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000100:00000040:9.0:1773851884.361982:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:12.0:1773851884.361983:0:41072:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524038656 free, 351521285120 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113802 files, 343285194 free files
00000004:00000040:2.0:1773851884.361983:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449331712 avail=351446774784 avail_mb=1372838964 hwm_mb=3131103 files=372160939 ffree=343212238 state=0: rc = 0
00000004:00000020:8.0:1773851884.361984:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420241920 free, 351417801728 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372008924 files, 343183830 free files
00000004:00000001:8.0:1773851884.361985:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851884.361986:0:41072:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:2.0:1773851884.361986:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449331712 free, 351446774784 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160939 files, 343212238 free files
00000100:00000001:9.0:1773851884.361987:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:8.0:1773851884.361987:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:12.0:1773851884.361988:0:41072:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851884.361989:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851884.361989:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851884.361989:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851884.361991:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:2.0:1773851884.361991:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:9.0:1773851884.361992:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851884.361993:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666597888 avail=351645407232 avail_mb=1373614872 hwm_mb=3131103 files=372237763 ffree=343424412 state=0: rc = 0
00000100:00100000:12.0:1773851884.361994:0:41072:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000373f1cb1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_00:lustre5-MDT0001-mdtlov_UUID:41072:1859433051935232:54@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851884.361994:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000918809b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051935168:6@kfi7:13:default-yuba2-0
00000100:00000001:12.0:1773851884.361996:0:41072:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.361996:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:9.0:1773851884.361997:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666597888 free, 351645407232 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237763 files, 343424412 free files
00000100:00000001:8.0:1773851884.361997:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00100000:2.0:1773851884.361997:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000042fd7e5c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051935040:2095@kfi7:13:default-yuba2-0
00000100:00000001:12.0:1773851884.361998:0:41072:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851884.361998:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000918809b0 x1859433051935168/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:12.0:1773851884.361999:0:41072:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000373f1cb1 x1859433051935232/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851884.362000:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851884.362000:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851884.362001:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851884.362002:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851884.362002:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851884.362002:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851884.362003:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000023401374.
00000100:00000001:12.0:1773851884.362004:0:41072:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:2.0:1773851884.362004:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000042fd7e5c x1859433051935040/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:12.0:1773851884.362005:0:41072:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:8.0:1773851884.362005:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851884.362005:0:41071:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:12.0:1773851884.362006:0:41072:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001e613f2a.
00000020:00000040:8.0:1773851884.362006:0:41071:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000020:00000001:8.0:1773851884.362007:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851884.362007:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004ecafcc4.
02000000:00000001:12.0:1773851884.362008:0:41072:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00100000:9.0:1773851884.362008:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c66d318a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051935104:31@kfi7:13:default-yuba2-0
00000100:00000001:2.0:1773851884.362008:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:12.0:1773851884.362009:0:41072:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:8.0:1773851884.362009:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851884.362009:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:2.0:1773851884.362009:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000040:12.0:1773851884.362010:0:41072:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000100:00000010:8.0:1773851884.362010:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000918809b0.
00000020:00000001:12.0:1773851884.362011:0:41072:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:9.0:1773851884.362011:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.362011:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000010:2.0:1773851884.362011:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f82e5278.
02000000:00000010:12.0:1773851884.362012:0:41072:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000fcad1a1f.
00000100:00000001:9.0:1773851884.362012:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851884.362012:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.362013:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.362013:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:2.0:1773851884.362013:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:12.0:1773851884.362014:0:41072:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:9.0:1773851884.362014:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c66d318a x1859433051935104/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851884.362014:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.362014:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000001:2.0:1773851884.362014:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851884.362014:0:41063:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
02000000:00000001:12.0:1773851884.362015:0:41072:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:12.0:1773851884.362015:0:41072:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000373f1cb1.
00000100:00000001:8.0:1773851884.362015:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851884.362015:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:12.0:1773851884.362017:0:41072:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000010:2.0:1773851884.362017:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004d587788.
00000100:00000001:12.0:1773851884.362018:0:41072:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851884.362018:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:2.0:1773851884.362018:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:12.0:1773851884.362019:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:2.0:1773851884.362019:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:9.0:1773851884.362020:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000010:2.0:1773851884.362020:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042fd7e5c.
00000100:00000001:12.0:1773851884.362021:0:41072:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:12.0:1773851884.362021:0:41072:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851884.362021:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000003878eca.
00000100:00000001:2.0:1773851884.362021:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:12.0:1773851884.362022:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851884.362022:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851884.362023:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851884.362023:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:2.0:1773851884.362023:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851884.362024:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851884.362025:0:41068:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:2.0:1773851884.362025:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:9.0:1773851884.362026:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:2.0:1773851884.362026:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851884.362027:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001e07dc98.
00000100:00000001:2.0:1773851884.362027:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851884.362028:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851884.362029:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851884.362029:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851884.362030:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c66d318a.
00000100:00000001:9.0:1773851884.362032:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851884.362033:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851884.362034:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851884.362036:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851884.362036:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851884.362038:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851884.362038:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851884.363383:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851884.363384:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851884.363385:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851884.363388:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851884.363390:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363391:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13563@kfi7 : PUT - for me
00000400:00000200:9.0:1773851884.363392:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363392:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 1
00000400:00000200:9.0:1773851884.363393:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363394:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000400:00000200:9.0:1773851884.363395:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 3
00000400:00000200:9.0:1773851884.363396:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363397:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13563@kfi7 of length 224 into portal 12 MB=0x699de8bd81a80
00000400:00000200:9.0:1773851884.363398:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13563@kfi7 of length 224/224 into md 0x78146ce49 [64] + 148224
00000800:00000200:9.0:1773851884.363399:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.363402:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.363402:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13563@kfi7: PUT: OK
00000100:00000001:9.0:1773851884.363404:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851884.363404:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851884.363405:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000050480d87.
00000100:00000040:9.0:1773851884.363405:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000050480d87 x1858030968248960 msgsize 224
00000100:00100000:9.0:1773851884.363407:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13563@kfi7 (source: 12345-13563@kfi7)
00000100:00000001:9.0:1773851884.363408:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851884.363409:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000100:00000001:8.0:1773851884.363409:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851884.363410:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851884.363410:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851884.363411:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851884.363411:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851884.363412:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851884.363413:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968248960
00000020:00000001:8.0:1773851884.363413:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851884.363414:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fc1
00000020:00000001:8.0:1773851884.363414:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851884.363417:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e087310f refcount=6
00000020:00000001:8.0:1773851884.363417:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239873536 : -107152469678080 : ffff9e8b9f1ba800)
00000020:00000001:8.0:1773851884.363418:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239873536 : -107152469678080 : ffff9e8b9f1ba800)
00000100:00000001:8.0:1773851884.363419:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851884.363420:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851884.363421:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e602d741.
00000020:00000010:8.0:1773851884.363422:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851884.363423:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e231bd3.
00000100:00000001:8.0:1773851884.363424:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851884.363425:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851884.363425:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851884.363426:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851884.363427:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851884.363427:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851884.363428:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851884.363430:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.363430:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851884.363430:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851884.363430:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851884.363431:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13563@kfi7, seq: 2130823
00000100:00000040:11.0:1773851884.363432:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e087310f : new rpc_count 1
00000100:00000001:8.0:1773851884.363432:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.363433:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162666240 : -106971546885376 : ffff9eb5bef26300)
00000100:00000001:8.0:1773851884.363433:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.363434:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000050480d87 x1858030968248960/t0(0) o400->9012fc5a-b782-4f9d-967d-91abf9f6659d@13563@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne221-0'
00000100:00000001:11.0:1773851884.363437:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851884.363437:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851884.363438:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050480d87 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9012fc5a-b782-4f9d-967d-91abf9f6659d+6:47747:x1858030968248960:12345-13563@kfi7:400:default-tuolumne221-0
00000100:00000200:11.0:1773851884.363440:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968248960
00000020:00000001:11.0:1773851884.363440:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851884.363441:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851884.363442:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363442:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851884.363443:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851884.363444:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851884.363444:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968248960, found 0 last_xid 1858030968248959
00000020:00000001:11.0:1773851884.363445:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851884.363446:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851884.363446:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851884.363447:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363448:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851884.363448:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851884.363449:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851884.363449:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000dad0a37.
02000000:00000001:11.0:1773851884.363450:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.363451:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363451:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851884.363452:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030968248960
00010000:00000001:11.0:1773851884.363453:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851884.363453:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000050480d87 x1858030968248960/t0(0) o400->9012fc5a-b782-4f9d-967d-91abf9f6659d@13563@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne221-0'
00010000:00000001:11.0:1773851884.363456:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851884.363456:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851884.363457:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=117 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851884.363458:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851884.363459:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a00b6082 refcount 5 to 13563@kfi7
00000100:00000001:11.0:1773851884.363460:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366287712 : -107142343263904 : ffff9e8dfab07960)
02000000:00000001:11.0:1773851884.363460:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851884.363461:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.363462:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851884.363462:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13563@kfi7
00000400:00000010:11.0:1773851884.363463:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001e5494cf.
00000100:00000200:11.0:1773851884.363464:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968248960, offset 224
00000400:00000200:11.0:1773851884.363465:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13563@kfi7
00000400:00000200:11.0:1773851884.363465:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.363466:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 1
00000400:00000200:11.0:1773851884.363467:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000400:00000200:11.0:1773851884.363468:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 3
00000400:00000200:11.0:1773851884.363469:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13563@kfi7 local destination
00000400:00000200:11.0:1773851884.363470:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769794:8769794:1024:4294967295] 13563@kfi7 LPNI seq info [24464:24464:16:4294967295]
00000400:00000200:11.0:1773851884.363472:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000400:00000200:11.0:1773851884.363472:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.363474:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13563@kfi7(13563@kfi7:13563@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851884.363475:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 3
00000800:00000200:11.0:1773851884.363477:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851884.363478:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851884.363479:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851884.363482:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004c6 Using peer 13563@kfi7(0x1000000000004c6)
00000800:00000200:11.0:1773851884.363485:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x1000000000004c6: rc=0
00000800:00000200:11.0:1773851884.363486:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851884.363488:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.363489:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a00b6082 refcount 4 to 13563@kfi7
00010000:00000001:11.0:1773851884.363490:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851884.363490:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363491:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851884.363491:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000050480d87 x1858030968248960/t0(0) o400->9012fc5a-b782-4f9d-967d-91abf9f6659d@13563@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne221-0'
00000100:00100000:11.0:1773851884.363494:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050480d87 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9012fc5a-b782-4f9d-967d-91abf9f6659d+6:47747:x1858030968248960:12345-13563@kfi7:400:default-tuolumne221-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851884.363497:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13563@kfi7, seq: 2130823
00000100:00000040:11.0:1773851884.363497:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e087310f : new rpc_count 0
00000800:00000200:9.0:1773851884.363498:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004c6 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851884.363499:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851884.363499:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851884.363500:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:11.0:1773851884.363500:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e231bd3.
00000400:00000200:9.0:1773851884.363500:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851884.363501:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e602d741.
00000400:00000200:9.0:1773851884.363501:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13563@kfi7: PUT: OK
00000020:00000040:11.0:1773851884.363502:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000e087310f : new refcount 5
00000400:00000200:9.0:1773851884.363502:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001e5494cf
00000400:00000010:9.0:1773851884.363502:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001e5494cf.
00000100:00000001:11.0:1773851884.363503:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851884.363503:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851884.363503:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851884.363504:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000800:00000200:9.0:1773851884.363505:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 13563@kfi7(0000000074426705):0x0 lsk 1223 rsk 84 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000004c6 Transaction freed
00000800:00000200:9.0:1773851884.363765:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851884.363766:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851884.363767:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851884.363769:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851884.363770:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363772:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13563@kfi7 : PUT - for me
00000400:00000200:9.0:1773851884.363772:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363773:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 1
00000400:00000200:9.0:1773851884.363774:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363775:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000400:00000200:9.0:1773851884.363776:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 3
00000400:00000200:9.0:1773851884.363777:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.363777:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13563@kfi7 of length 224 into portal 12 MB=0x699de8bd82200
00000400:00000200:9.0:1773851884.363779:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13563@kfi7 of length 224/224 into md 0x78146ce49 [64] + 148448
00000800:00000200:9.0:1773851884.363780:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.363782:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.363783:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13563@kfi7: PUT: OK
00000100:00000001:9.0:1773851884.363784:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851884.363784:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851884.363785:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a92198bc.
00000100:00000040:9.0:1773851884.363785:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000a92198bc x1858030968250880 msgsize 224
00000100:00100000:9.0:1773851884.363787:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13563@kfi7 (source: 12345-13563@kfi7)
00000100:00000001:9.0:1773851884.363788:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851884.363788:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000100:00000001:11.0:1773851884.363789:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851884.363789:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851884.363790:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851884.363790:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851884.363790:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851884.363791:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851884.363791:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968250880
00000020:00000001:11.0:1773851884.363792:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851884.363792:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91299
00000020:00000001:11.0:1773851884.363793:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851884.363796:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000042376cd2 refcount=6
00000020:00000001:11.0:1773851884.363796:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716214784 : -107155993336832 : ffff9e8acd14e400)
00000020:00000001:11.0:1773851884.363797:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716214784 : -107155993336832 : ffff9e8acd14e400)
00000100:00000001:11.0:1773851884.363798:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851884.363798:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851884.363799:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9ba5d0e.
00000020:00000010:11.0:1773851884.363800:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851884.363800:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851884.363801:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851884.363801:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851884.363802:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851884.363802:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851884.363803:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851884.363803:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.363804:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851884.363805:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.363805:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851884.363805:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851884.363806:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13563@kfi7, seq: 2130824
00000100:00000001:8.0:1773851884.363806:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851884.363807:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000042376cd2 : new rpc_count 1
00000100:00000001:8.0:1773851884.363807:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.363808:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162665088 : -106971546886528 : ffff9eb5bef25e80)
00000100:00000001:8.0:1773851884.363808:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.363809:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a92198bc x1858030968250880/t0(0) o400->796b6073-c7e0-4bbd-b7b0-6a2ccfae47ec@13563@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne221-0'
00000100:00000001:11.0:1773851884.363811:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851884.363811:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851884.363812:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a92198bc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:796b6073-c7e0-4bbd-b7b0-6a2ccfae47ec+6:47745:x1858030968250880:12345-13563@kfi7:400:default-tuolumne221-0
00000100:00000200:11.0:1773851884.363814:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968250880
00000020:00000001:11.0:1773851884.363814:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851884.363815:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851884.363815:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363816:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851884.363816:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851884.363817:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851884.363817:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968250880, found 0 last_xid 1858030968250879
00000020:00000001:11.0:1773851884.363818:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851884.363818:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851884.363819:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851884.363819:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363820:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851884.363820:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851884.363820:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851884.363823:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e537a2e.
02000000:00000001:11.0:1773851884.363823:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.363824:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363824:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851884.363825:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768340, transno 0, xid 1858030968250880
00010000:00000001:11.0:1773851884.363825:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851884.363826:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a92198bc x1858030968250880/t0(0) o400->796b6073-c7e0-4bbd-b7b0-6a2ccfae47ec@13563@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne221-0'
00010000:00000001:11.0:1773851884.363831:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851884.363832:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851884.363832:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=117 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851884.363833:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851884.363834:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a00b6082 refcount 5 to 13563@kfi7
00000100:00000001:11.0:1773851884.363834:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366287712 : -107142343263904 : ffff9e8dfab07960)
02000000:00000001:11.0:1773851884.363835:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851884.363835:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.363836:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851884.363837:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13563@kfi7
00000400:00000010:11.0:1773851884.363837:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000151638b3.
00000100:00000200:11.0:1773851884.363838:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968250880, offset 224
00000400:00000200:11.0:1773851884.363839:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13563@kfi7
00000400:00000200:11.0:1773851884.363840:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.363841:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 1
00000400:00000200:11.0:1773851884.363842:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000400:00000200:11.0:1773851884.363843:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 3
00000400:00000200:11.0:1773851884.363844:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13563@kfi7 local destination
00000400:00000200:11.0:1773851884.363845:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769795:8769795:1024:4294967295] 13563@kfi7 LPNI seq info [24465:24465:16:4294967295]
00000400:00000200:11.0:1773851884.363846:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000400:00000200:11.0:1773851884.363847:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13563@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.363849:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13563@kfi7(13563@kfi7:13563@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851884.363850:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 3
00000800:00000200:11.0:1773851884.363851:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851884.363852:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851884.363854:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851884.363856:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x87b Using peer 13563@kfi7(0x87b)
00000800:00000200:11.0:1773851884.363860:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x87b: rc=0
00000800:00000200:11.0:1773851884.363861:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x87b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851884.363863:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.363864:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a00b6082 refcount 4 to 13563@kfi7
00010000:00000001:11.0:1773851884.363864:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851884.363865:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.363865:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851884.363866:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a92198bc x1858030968250880/t0(0) o400->796b6073-c7e0-4bbd-b7b0-6a2ccfae47ec@13563@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne221-0'
00000100:00100000:11.0:1773851884.363869:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a92198bc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:796b6073-c7e0-4bbd-b7b0-6a2ccfae47ec+6:47745:x1858030968250880:12345-13563@kfi7:400:default-tuolumne221-0 Request processed in 57us (82us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851884.363871:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13563@kfi7, seq: 2130824
00000100:00000040:11.0:1773851884.363871:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000042376cd2 : new rpc_count 0
00000100:00000001:11.0:1773851884.363872:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851884.363873:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851884.363873:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000800:00000200:9.0:1773851884.363873:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x87b TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851884.363874:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000020:00000010:11.0:1773851884.363875:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9ba5d0e.
00000020:00000040:11.0:1773851884.363875:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000042376cd2 : new refcount 5
00000400:00000200:9.0:1773851884.363875:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851884.363876:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851884.363876:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13563@kfi7: PUT: OK
00000400:00000200:9.0:1773851884.363876:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000151638b3
00000400:00000010:9.0:1773851884.363877:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000151638b3.
00000100:00000001:9.0:1773851884.363877:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851884.363878:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851884.363878:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9d59bdf nid 13563@kfi7 refs 2
00000800:00000200:9.0:1773851884.363879:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 13563@kfi7(00000000d70b018b):0x0 lsk 2172 rsk 87 tsk 0 trmk 0 tmk 0 trr 2 tta 0x87b Transaction freed
00000400:00000200:29.0:1773851884.425732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851884.425734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:3.0:1773851884.538024:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851884.538024:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851884.538025:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851884.538026:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:3.0:1773851884.538028:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851884.538028:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:3.0:1773851884.538031:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851884.538031:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13489@kfi7(0000000091f78886):0x3ef version: 2; local version 2; negotiated version: 2
00000400:00000200:3.0:1773851884.538034:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13489@kfi7 to cpt 0
00000800:00000200:1.0:1773851884.538035:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef Using peer 13489@kfi7(0x1000000000003ef)
00000400:00000200:3.0:1773851884.538037:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13489@kfi7 : PUT - for me
00000400:00000200:1.0:1773851884.538038:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13489@kfi7 to cpt 0
00000400:00000200:3.0:1773851884.538039:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13489@kfi7 to cpt 0
00000400:00000200:3.0:1773851884.538040:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008baca74 nid 13489@kfi7 refs 1
00000800:00000200:1.0:1773851884.538041:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 38 bytes to peer 0x1000000000003ef: rc=0
00000400:00000200:3.0:1773851884.538042:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13489@kfi7 to cpt 0
00000400:00000200:3.0:1773851884.538043:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008baca74 nid 13489@kfi7 refs 2
00000800:00000200:1.0:1773851884.538044:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:3.0:1773851884.538045:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000008baca74 nid 13489@kfi7 refs 3
00000400:00000200:3.0:1773851884.538047:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13489@kfi7 to cpt 0
00000400:00000200:3.0:1773851884.538048:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13489@kfi7 of length 224 into portal 12 MB=0x699e126a149c0
00000400:00000200:3.0:1773851884.538051:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13489@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 42976
00000800:00000200:3.0:1773851884.538054:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851884.538056:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851884.538058:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13489@kfi7: PUT: OK
00000800:00000200:1.0:1773851884.538058:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef TN_EVENT_TX_OK event status 0
00000100:00000001:3.0:1773851884.538059:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851884.538060:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851884.538062:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042fd7e5c.
00000800:00000200:1.0:1773851884.538062:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c74e384d: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef Transaction freed
00000100:00000040:3.0:1773851884.538063:0:2506738:0:(events.c:358:request_in_callback()) incoming req@0000000042fd7e5c x1858042155059648 msgsize 224
00000100:00100000:3.0:1773851884.538065:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-13489@kfi7 (source: 12345-13489@kfi7)
00000100:00000001:3.0:1773851884.538067:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851884.538068:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000008baca74 nid 13489@kfi7 refs 2
00000100:00000001:1.0:1773851884.538069:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851884.538070:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851884.538071:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851884.538071:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851884.538072:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851884.538073:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851884.538074:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042155059648
00000020:00000001:1.0:1773851884.538076:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851884.538076:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91405
00000020:00000001:1.0:1773851884.538077:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851884.538085:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000096bb389 refcount=6
00000020:00000001:1.0:1773851884.538086:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169305088 : -107127540246528 : ffff9e916d049800)
00000020:00000001:1.0:1773851884.538087:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169305088 : -107127540246528 : ffff9e916d049800)
00000100:00000001:1.0:1773851884.538089:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851884.538090:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851884.538091:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aaa4c47a.
00000020:00000010:1.0:1773851884.538093:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851884.538094:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f309d4d6.
00000100:00000001:1.0:1773851884.538096:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851884.538096:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851884.538097:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851884.538099:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851884.538100:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851884.538101:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.538102:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851884.538104:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851884.538105:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851884.538105:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851884.538105:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851884.538107:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13489@kfi7, seq: 1997602
00000100:00000040:1.0:1773851884.538108:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000096bb389 : new rpc_count 1
00000100:00000001:0.0:1773851884.538108:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.538109:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288728960 : -106964420822656 : ffff9eb767b17980)
00000100:00000001:0.0:1773851884.538109:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851884.538111:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042fd7e5c x1858042155059648/t0(0) o400->3339bed1-3f8a-4ebb-91dc-4a750d32bdbb@13489@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1326-0'
00000100:00000001:1.0:1773851884.538116:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851884.538117:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851884.538118:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042fd7e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3339bed1-3f8a-4ebb-91dc-4a750d32bdbb+6:39815:x1858042155059648:12345-13489@kfi7:400:default-tuolumne1326-0
00000100:00000200:1.0:1773851884.538121:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042155059648
00000020:00000001:1.0:1773851884.538122:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851884.538127:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851884.538128:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.538129:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851884.538130:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851884.538132:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851884.538133:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042155059648, found 0 last_xid 1858042155059647
00000020:00000001:1.0:1773851884.538134:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851884.538135:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851884.538136:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851884.538137:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.538138:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851884.538139:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851884.538140:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851884.538143:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003daa7856.
02000000:00000001:1.0:1773851884.538144:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.538145:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.538146:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851884.538148:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182614973378, transno 0, xid 1858042155059648
00010000:00000001:1.0:1773851884.538149:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851884.538151:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042fd7e5c x1858042155059648/t0(0) o400->3339bed1-3f8a-4ebb-91dc-4a750d32bdbb@13489@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1326-0'
00010000:00000001:1.0:1773851884.538156:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851884.538157:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851884.538158:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=117 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851884.538160:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851884.538161:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000fd66339 refcount 3 to 13489@kfi7
00000100:00000001:1.0:1773851884.538163:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958444192 : -107146751107424 : ffff9e8cf3f61ea0)
02000000:00000001:1.0:1773851884.538164:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851884.538165:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851884.538166:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851884.538168:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13489@kfi7
00000400:00000010:1.0:1773851884.538169:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001ad7c3a1.
00000100:00000200:1.0:1773851884.538171:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042155059648, offset 224
00000400:00000200:1.0:1773851884.538173:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13489@kfi7
00000400:00000200:1.0:1773851884.538175:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13489@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.538177:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008baca74 nid 13489@kfi7 refs 1
00000400:00000200:1.0:1773851884.538179:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000008baca74 nid 13489@kfi7 refs 2
00000400:00000200:1.0:1773851884.538181:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000008baca74 nid 13489@kfi7 refs 3
00000400:00000200:1.0:1773851884.538183:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13489@kfi7 local destination
00000400:00000200:1.0:1773851884.538186:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769796:8769796:1024:4294967295] 13489@kfi7 LPNI seq info [10507448:10507448:16:4294967295]
00000400:00000200:1.0:1773851884.538188:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000008baca74 nid 13489@kfi7 refs 2
00000400:00000200:1.0:1773851884.538190:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13489@kfi7 to cpt 0
00000400:00000200:1.0:1773851884.538194:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13489@kfi7(13489@kfi7:13489@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851884.538196:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000008baca74 nid 13489@kfi7 refs 3
00000800:00000200:1.0:1773851884.538199:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851884.538201:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851884.538205:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851884.538209:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef Using peer 13489@kfi7(0x1000000000003ef)
00000800:00000200:1.0:1773851884.538214:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000c74e384d: Posted send of 324 bytes to peer 0x1000000000003ef: rc=0
00000800:00000200:1.0:1773851884.538217:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851884.538220:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851884.538222:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000fd66339 refcount 2 to 13489@kfi7
00010000:00000001:1.0:1773851884.538223:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851884.538224:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851884.538225:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851884.538227:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042fd7e5c x1858042155059648/t0(0) o400->3339bed1-3f8a-4ebb-91dc-4a750d32bdbb@13489@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1326-0'
00000100:00100000:1.0:1773851884.538233:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042fd7e5c pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3339bed1-3f8a-4ebb-91dc-4a750d32bdbb+6:39815:x1858042155059648:12345-13489@kfi7:400:default-tuolumne1326-0 Request processed in 115us (169us total) trans 0 rc 0/0
00000800:00000200:2.0:1773851884.538234:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851884.538237:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851884.538237:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13489@kfi7, seq: 1997602
00000400:00000200:2.0:1773851884.538239:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13489@kfi7: PUT: OK
00000100:00000040:1.0:1773851884.538239:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000096bb389 : new rpc_count 0
00000100:00000001:1.0:1773851884.538240:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:2.0:1773851884.538241:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001ad7c3a1
00000100:00000001:1.0:1773851884.538241:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:2.0:1773851884.538242:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001ad7c3a1.
00000020:00000010:1.0:1773851884.538242:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000100:00000001:2.0:1773851884.538243:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851884.538244:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:1.0:1773851884.538244:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f309d4d6.
00000400:00000200:2.0:1773851884.538245:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000008baca74 nid 13489@kfi7 refs 2
00000020:00000010:1.0:1773851884.538245:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aaa4c47a.
00000020:00000040:1.0:1773851884.538247:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000096bb389 : new refcount 5
00000100:00000001:1.0:1773851884.538248:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851884.538249:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c74e384d: 2054@kfi7:0 -> 13489@kfi7(0000000091f78886):0x0 lsk 1008 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ef Transaction freed
00000800:00000200:29.0:1773851884.547370:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.547371:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851884.547372:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851884.547374:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851884.547376:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9250@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.547377:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9250@kfi7 : PUT - for me
00000400:00000200:29.0:1773851884.547378:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9250@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.547379:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051a121fb nid 9250@kfi7 refs 1
00000400:00000200:29.0:1773851884.547381:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9250@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.547381:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051a121fb nid 9250@kfi7 refs 2
00000400:00000200:29.0:1773851884.547382:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000051a121fb nid 9250@kfi7 refs 3
00000400:00000200:29.0:1773851884.547383:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9442@kfi7 to cpt 2
00000400:00000200:29.0:1773851884.547384:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9442@kfi7 of length 224 into portal 12 MB=0x699e245220a00
00000400:00000200:29.0:1773851884.547386:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9442@kfi7 of length 224/224 into md 0x77fe139dd [64] + 192624
00000800:00000200:29.0:1773851884.547388:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851884.547390:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851884.547391:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9250@kfi7: PUT: OK
00000100:00000001:29.0:1773851884.547392:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851884.547392:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851884.547393:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000088c53149.
00000100:00000040:29.0:1773851884.547394:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000088c53149 x1858046961781248 msgsize 224
00000100:00100000:29.0:1773851884.547395:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-9442@kfi7 (source: 12345-9250@kfi7)
00000100:00000001:29.0:1773851884.547397:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851884.547398:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000051a121fb nid 9250@kfi7 refs 2
00000800:00000200:29.0:1773851884.547399:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851884.547402:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851884.547402:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851884.547403:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851884.547403:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851884.547404:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851884.547405:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858046961781248
00000020:00000001:29.0:1773851884.547405:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851884.547406:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9276f
00000020:00000001:29.0:1773851884.547406:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851884.547409:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000db8b4897 refcount=6
00000020:00000001:29.0:1773851884.547410:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631501824 : -107123078049792 : ffff9e9276fc5000)
00000020:00000001:29.0:1773851884.547411:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631501824 : -107123078049792 : ffff9e9276fc5000)
00000100:00000001:29.0:1773851884.547412:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.547413:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851884.547413:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851884.547414:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851884.547415:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851884.547416:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851884.547416:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851884.547417:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851884.547418:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851884.547419:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851884.547419:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.547420:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851884.547421:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851884.547422:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851884.547422:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851884.547423:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851884.547423:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9442@kfi7, seq: 2055566
00000100:00000001:30.0:1773851884.547424:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851884.547424:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851884.547424:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000db8b4897 : new rpc_count 1
00000100:00000001:29.0:1773851884.547424:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144162613888 : -106929546937728 : ffff9ebf8656ba80)
00000100:00000040:29.0:1773851884.547425:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000088c53149 x1858046961781248/t0(0) o400->0d53d5cd-1582-4c3d-822b-c7c3625b7afe@9442@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1067-0'
00000100:00000001:29.0:1773851884.547428:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.547428:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851884.547429:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000088c53149 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:0d53d5cd-1582-4c3d-822b-c7c3625b7afe+6:39703:x1858046961781248:12345-9442@kfi7:400:default-tuolumne1067-0
00000100:00000200:29.0:1773851884.547431:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858046961781248
00000020:00000001:29.0:1773851884.547431:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851884.547432:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851884.547433:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.547433:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851884.547434:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851884.547435:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851884.547435:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858046961781248, found 0 last_xid 1858046961781247
00000020:00000001:29.0:1773851884.547436:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851884.547437:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851884.547437:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851884.547438:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.547439:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851884.547439:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851884.547440:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851884.547440:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003e8dfd37.
02000000:00000001:29.0:1773851884.547441:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.547442:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.547443:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851884.547444:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182632171377, transno 0, xid 1858046961781248
00010000:00000001:29.0:1773851884.547444:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851884.547445:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000088c53149 x1858046961781248/t0(0) o400->0d53d5cd-1582-4c3d-822b-c7c3625b7afe@9442@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1067-0'
00010000:00000001:29.0:1773851884.547447:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851884.547448:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851884.547449:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=117 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851884.547450:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851884.547450:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000add8d9f refcount 3 to 9442@kfi7
00000100:00000001:29.0:1773851884.547451:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581504 : -107154806970112 : ffff9e8b13cb6900)
02000000:00000001:29.0:1773851884.547452:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851884.547452:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.547453:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851884.547454:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9250@kfi7
00000400:00000010:29.0:1773851884.547454:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000844552bf.
00000100:00000200:29.0:1773851884.547455:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858046961781248, offset 224
00000400:00000200:29.0:1773851884.547457:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9250@kfi7
00000400:00000200:29.0:1773851884.547458:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9250@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.547458:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051a121fb nid 9250@kfi7 refs 1
00000400:00000200:29.0:1773851884.547459:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000051a121fb nid 9250@kfi7 refs 2
00000400:00000200:29.0:1773851884.547460:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000051a121fb nid 9250@kfi7 refs 3
00000400:00000200:29.0:1773851884.547462:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9250@kfi7 local destination
00000400:00000200:29.0:1773851884.547463:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769797:8769797:1024:4294967295] 9250@kfi7 LPNI seq info [16703770:16703770:16:4294967295]
00000400:00000200:29.0:1773851884.547464:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000051a121fb nid 9250@kfi7 refs 2
00000400:00000200:29.0:1773851884.547465:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9250@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.547467:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9250@kfi7(9250@kfi7:9250@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851884.547468:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000051a121fb nid 9250@kfi7 refs 3
00000800:00000200:29.0:1773851884.547469:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.547470:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851884.547472:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851884.547475:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0xada Using peer 9250@kfi7(0xada)
00000800:00000200:29.0:1773851884.547478:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0xada: rc=0
00000800:00000200:29.0:1773851884.547479:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0xada TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851884.547481:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851884.547482:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000add8d9f refcount 2 to 9442@kfi7
00010000:00000001:29.0:1773851884.547483:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851884.547483:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.547484:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851884.547484:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000088c53149 x1858046961781248/t0(0) o400->0d53d5cd-1582-4c3d-822b-c7c3625b7afe@9442@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1067-0'
00000100:00100000:29.0:1773851884.547487:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000088c53149 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:0d53d5cd-1582-4c3d-822b-c7c3625b7afe+6:39703:x1858046961781248:12345-9442@kfi7:400:default-tuolumne1067-0 Request processed in 58us (92us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851884.547490:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9442@kfi7, seq: 2055566
00000100:00000040:29.0:1773851884.547490:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000db8b4897 : new rpc_count 0
00000100:00000001:29.0:1773851884.547491:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:30.0:1773851884.547492:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0xada TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851884.547492:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851884.547492:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851884.547493:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851884.547493:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851884.547494:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000020:00000040:29.0:1773851884.547494:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000db8b4897 : new refcount 5
00000400:00000200:30.0:1773851884.547495:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9250@kfi7: PUT: OK
00000400:00000200:30.0:1773851884.547495:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000844552bf
00000100:00000001:29.0:1773851884.547495:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:30.0:1773851884.547496:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000844552bf.
00000100:00000001:30.0:1773851884.547497:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851884.547497:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851884.547498:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000051a121fb nid 9250@kfi7 refs 2
00000800:00000200:30.0:1773851884.547500:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 9250@kfi7(000000006fade65a):0x0 lsk 2779 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0xada Transaction freed
00000800:00000200:5.0:1773851884.549077:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851884.549078:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851884.549079:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851884.549082:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851884.549083:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.549085:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22011@kfi7 : PUT - for me
00000400:00000200:5.0:1773851884.549086:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.549086:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 1
00000400:00000200:5.0:1773851884.549087:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.549088:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000400:00000200:5.0:1773851884.549089:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 3
00000400:00000200:5.0:1773851884.549089:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22010@kfi7 to cpt 6
00000400:00000200:5.0:1773851884.549090:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22010@kfi7 of length 224 into portal 12 MB=0x699de8dad1f00
00000400:00000200:5.0:1773851884.549092:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22010@kfi7 of length 224/224 into md 0x793926dc5 [64] + 154992
00000800:00000200:5.0:1773851884.549094:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851884.549095:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.549096:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22011@kfi7: PUT: OK
00000100:00000001:5.0:1773851884.549097:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851884.549097:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851884.549098:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000aeb8ce6.
00000100:00000040:5.0:1773851884.549099:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000000aeb8ce6 x1858030998986496 msgsize 224
00000100:00100000:5.0:1773851884.549100:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22010@kfi7 (source: 12345-22011@kfi7)
00000100:00000001:5.0:1773851884.549101:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851884.549102:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000100:00000001:4.0:1773851884.549103:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851884.549103:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851884.549104:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851884.549104:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851884.549104:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851884.549105:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851884.549106:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030998986496
00000020:00000001:4.0:1773851884.549107:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851884.549107:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910e0
00000020:00000001:4.0:1773851884.549108:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851884.549110:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f043a4ac refcount=6
00000020:00000001:4.0:1773851884.549111:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240327168 : -107152469224448 : ffff9e8b9f229400)
00000020:00000001:4.0:1773851884.549111:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240327168 : -107152469224448 : ffff9e8b9f229400)
00000100:00000001:4.0:1773851884.549112:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851884.549113:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851884.549114:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000095d1dd51.
00000020:00000010:4.0:1773851884.549115:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851884.549116:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f8ab1166.
00000100:00000001:4.0:1773851884.549117:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851884.549117:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851884.549117:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.549118:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851884.549119:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851884.549119:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.549120:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851884.549122:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851884.549122:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851884.549123:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851884.549123:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851884.549124:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22010@kfi7, seq: 2001961
00000100:00000040:7.0:1773851884.549124:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f043a4ac : new rpc_count 1
00000100:00000001:7.0:1773851884.549125:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108943104 : -106938600608512 : ffff9ebd6ab2ad00)
00000100:00000001:4.0:1773851884.549125:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.549125:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851884.549127:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000aeb8ce6 x1858030998986496/t0(0) o400->6a6416fb-d943-45bf-b6a3-08edfaf86446@22010@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne254-0'
00000100:00000001:7.0:1773851884.549129:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851884.549130:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851884.549131:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000aeb8ce6 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6a6416fb-d943-45bf-b6a3-08edfaf86446+6:47809:x1858030998986496:12345-22010@kfi7:400:default-tuolumne254-0
00000100:00000200:7.0:1773851884.549133:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030998986496
00000020:00000001:7.0:1773851884.549133:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851884.549134:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851884.549135:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851884.549135:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851884.549136:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851884.549137:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851884.549137:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030998986496, found 0 last_xid 1858030998986495
00000020:00000001:7.0:1773851884.549138:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851884.549139:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851884.549139:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851884.549140:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851884.549141:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851884.549142:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851884.549142:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851884.549143:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007099dd67.
02000000:00000001:7.0:1773851884.549145:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.549145:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851884.549146:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851884.549147:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030998986496
00010000:00000001:7.0:1773851884.549148:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851884.549149:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000aeb8ce6 x1858030998986496/t0(0) o400->6a6416fb-d943-45bf-b6a3-08edfaf86446@22010@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne254-0'
00010000:00000001:7.0:1773851884.549152:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851884.549152:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851884.549153:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=116 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851884.549155:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851884.549155:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000056f6d055 refcount 5 to 22010@kfi7
00000100:00000001:7.0:1773851884.549156:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366318272 : -107142343233344 : ffff9e8dfab0f0c0)
02000000:00000001:7.0:1773851884.549157:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851884.549158:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.549158:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851884.549160:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22011@kfi7
00000400:00000010:7.0:1773851884.549160:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000084a606f7.
00000100:00000200:7.0:1773851884.549161:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030998986496, offset 224
00000400:00000200:7.0:1773851884.549163:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22011@kfi7
00000400:00000200:7.0:1773851884.549164:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:7.0:1773851884.549165:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 1
00000400:00000200:7.0:1773851884.549166:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000400:00000200:7.0:1773851884.549167:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 3
00000400:00000200:7.0:1773851884.549168:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22011@kfi7 local destination
00000400:00000200:7.0:1773851884.549170:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769798:8769798:1024:4294967295] 22011@kfi7 LPNI seq info [24416:24416:16:4294967295]
00000400:00000200:7.0:1773851884.549172:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000400:00000200:7.0:1773851884.549172:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:7.0:1773851884.549175:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22011@kfi7(22011@kfi7:22011@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851884.549176:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 3
00000800:00000200:7.0:1773851884.549178:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851884.549179:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851884.549182:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851884.549184:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4b3 Using peer 22011@kfi7(0x4b3)
00000800:00000200:7.0:1773851884.549188:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x4b3: rc=0
00000800:00000200:7.0:1773851884.549189:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851884.549192:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851884.549192:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000056f6d055 refcount 4 to 22010@kfi7
00010000:00000001:7.0:1773851884.549193:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851884.549194:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851884.549195:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851884.549196:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000aeb8ce6 x1858030998986496/t0(0) o400->6a6416fb-d943-45bf-b6a3-08edfaf86446@22010@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne254-0'
00000100:00100000:7.0:1773851884.549199:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000aeb8ce6 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6a6416fb-d943-45bf-b6a3-08edfaf86446+6:47809:x1858030998986496:12345-22010@kfi7:400:default-tuolumne254-0 Request processed in 69us (99us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851884.549202:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22010@kfi7, seq: 2001961
00000800:00000200:5.0:1773851884.549202:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4b3 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851884.549203:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f043a4ac : new rpc_count 0
00000100:00000001:7.0:1773851884.549204:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851884.549205:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851884.549205:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:7.0:1773851884.549206:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f8ab1166.
00000400:00000200:5.0:1773851884.549206:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851884.549207:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000095d1dd51.
00000400:00000200:5.0:1773851884.549207:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22011@kfi7: PUT: OK
00000020:00000040:7.0:1773851884.549208:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000f043a4ac : new refcount 5
00000400:00000200:5.0:1773851884.549208:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000084a606f7
00000100:00000001:7.0:1773851884.549209:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:5.0:1773851884.549209:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000084a606f7.
00000100:00000001:5.0:1773851884.549210:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851884.549210:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851884.549211:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000800:00000200:5.0:1773851884.549213:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 22011@kfi7(000000009da2d772):0x0 lsk 1204 rsk 87 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4b3 Transaction freed
00000800:00000200:5.0:1773851884.549533:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851884.549534:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851884.549536:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851884.549540:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851884.549543:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.549544:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22011@kfi7 : PUT - for me
00000400:00000200:5.0:1773851884.549546:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.549547:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 1
00000400:00000200:5.0:1773851884.549548:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.549549:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000400:00000200:5.0:1773851884.549551:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 3
00000400:00000200:5.0:1773851884.549553:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22010@kfi7 to cpt 6
00000400:00000200:5.0:1773851884.549554:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22010@kfi7 of length 224 into portal 12 MB=0x699de8dad26c0
00000400:00000200:5.0:1773851884.549556:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22010@kfi7 of length 224/224 into md 0x793926dc5 [64] + 155216
00000800:00000200:5.0:1773851884.549558:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851884.549561:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.549562:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22011@kfi7: PUT: OK
00000100:00000001:5.0:1773851884.549564:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851884.549564:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851884.549566:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d917b5b7.
00000100:00000040:5.0:1773851884.549567:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d917b5b7 x1858030998988480 msgsize 224
00000100:00100000:5.0:1773851884.549569:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22010@kfi7 (source: 12345-22011@kfi7)
00000100:00000001:5.0:1773851884.549571:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851884.549572:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000100:00000001:7.0:1773851884.549573:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851884.549574:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851884.549574:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851884.549575:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851884.549575:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851884.549576:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851884.549578:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030998988480
00000020:00000001:7.0:1773851884.549579:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851884.549580:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912ca
00000020:00000001:7.0:1773851884.549581:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851884.549583:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cf2220d6 refcount=6
00000020:00000001:7.0:1773851884.549584:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716211712 : -107155993339904 : ffff9e8acd14d800)
00000020:00000001:7.0:1773851884.549585:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716211712 : -107155993339904 : ffff9e8acd14d800)
00000100:00000001:7.0:1773851884.549586:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851884.549587:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851884.549589:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c19ce0d6.
00000020:00000010:7.0:1773851884.549590:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851884.549591:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004ae5698b.
00000100:00000001:7.0:1773851884.549593:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851884.549594:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851884.549595:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851884.549596:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851884.549597:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851884.549597:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.549599:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851884.549601:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851884.549601:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851884.549601:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851884.549601:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851884.549602:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22010@kfi7, seq: 2001962
00000100:00000001:7.0:1773851884.549603:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.549603:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cf2220d6 : new rpc_count 1
00000100:00000001:4.0:1773851884.549603:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108941952 : -106938600609664 : ffff9ebd6ab2a880)
00000100:00000001:7.0:1773851884.549604:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.549604:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d917b5b7 x1858030998988480/t0(0) o400->6a0f110d-169a-4b73-820a-4592bc6b3e06@22010@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne254-0'
00000100:00000001:4.0:1773851884.549607:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851884.549607:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851884.549608:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d917b5b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6a0f110d-169a-4b73-820a-4592bc6b3e06+6:47808:x1858030998988480:12345-22010@kfi7:400:default-tuolumne254-0
00000100:00000200:4.0:1773851884.549610:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030998988480
00000020:00000001:4.0:1773851884.549610:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851884.549611:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851884.549611:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.549612:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851884.549612:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851884.549613:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851884.549613:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030998988480, found 0 last_xid 1858030998988479
00000020:00000001:4.0:1773851884.549614:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851884.549614:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851884.549615:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851884.549615:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.549616:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851884.549616:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851884.549617:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851884.549617:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000095d1dd51.
02000000:00000001:4.0:1773851884.549618:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.549618:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.549619:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851884.549620:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767859, transno 0, xid 1858030998988480
00010000:00000001:4.0:1773851884.549621:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851884.549622:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d917b5b7 x1858030998988480/t0(0) o400->6a0f110d-169a-4b73-820a-4592bc6b3e06@22010@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne254-0'
00010000:00000001:4.0:1773851884.549624:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851884.549625:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851884.549626:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=116 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851884.549627:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851884.549627:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000056f6d055 refcount 5 to 22010@kfi7
00000100:00000001:4.0:1773851884.549628:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366318272 : -107142343233344 : ffff9e8dfab0f0c0)
02000000:00000001:4.0:1773851884.549629:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851884.549629:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.549630:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851884.549631:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22011@kfi7
00000400:00000010:4.0:1773851884.549631:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ae348a6c.
00000100:00000200:4.0:1773851884.549632:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030998988480, offset 224
00000400:00000200:4.0:1773851884.549634:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22011@kfi7
00000400:00000200:4.0:1773851884.549634:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:4.0:1773851884.549635:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 1
00000400:00000200:4.0:1773851884.549636:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000400:00000200:4.0:1773851884.549638:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 3
00000400:00000200:4.0:1773851884.549639:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22011@kfi7 local destination
00000400:00000200:4.0:1773851884.549640:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769799:8769799:1024:4294967295] 22011@kfi7 LPNI seq info [24417:24417:16:4294967295]
00000400:00000200:4.0:1773851884.549641:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000400:00000200:4.0:1773851884.549642:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22011@kfi7 to cpt 1
00000400:00000200:4.0:1773851884.549644:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22011@kfi7(22011@kfi7:22011@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851884.549645:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 3
00000800:00000200:4.0:1773851884.549647:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851884.549647:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851884.549650:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851884.549652:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a6 Using peer 22011@kfi7(0x1000000000004a6)
00000800:00000200:4.0:1773851884.549655:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x1000000000004a6: rc=0
00000800:00000200:4.0:1773851884.549657:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851884.549659:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.549660:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000056f6d055 refcount 4 to 22010@kfi7
00010000:00000001:4.0:1773851884.549661:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851884.549661:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.549661:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851884.549662:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d917b5b7 x1858030998988480/t0(0) o400->6a0f110d-169a-4b73-820a-4592bc6b3e06@22010@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne254-0'
00000100:00100000:4.0:1773851884.549666:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d917b5b7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:6a0f110d-169a-4b73-820a-4592bc6b3e06+6:47808:x1858030998988480:12345-22010@kfi7:400:default-tuolumne254-0 Request processed in 59us (99us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851884.549669:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22010@kfi7, seq: 2001962
00000100:00000040:4.0:1773851884.549670:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cf2220d6 : new rpc_count 0
00000100:00000001:4.0:1773851884.549670:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851884.549671:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851884.549671:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:4.0:1773851884.549672:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004ae5698b.
00000020:00000010:4.0:1773851884.549673:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c19ce0d6.
00000020:00000040:4.0:1773851884.549673:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000cf2220d6 : new refcount 5
00000100:00000001:4.0:1773851884.549674:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851884.549680:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a6 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851884.549683:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.549684:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22011@kfi7: PUT: OK
00000400:00000200:5.0:1773851884.549685:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ae348a6c
00000400:00000010:5.0:1773851884.549686:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ae348a6c.
00000100:00000001:5.0:1773851884.549687:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851884.549688:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851884.549689:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2b8d61e nid 22011@kfi7 refs 2
00000800:00000200:5.0:1773851884.549691:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 22011@kfi7(00000000524142e7):0x0 lsk 1191 rsk 86 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a6 Transaction freed
00000800:00000200:29.0:1773851884.641894:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.641894:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851884.641896:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851884.641898:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851884.641900:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16562@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.641902:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16562@kfi7 : PUT - for me
00000400:00000200:29.0:1773851884.641902:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16562@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.641904:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fabc175 nid 16562@kfi7 refs 1
00000400:00000200:29.0:1773851884.641906:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16562@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.641907:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fabc175 nid 16562@kfi7 refs 2
00000400:00000200:29.0:1773851884.641907:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005fabc175 nid 16562@kfi7 refs 3
00000400:00000200:29.0:1773851884.641908:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16498@kfi7 to cpt 3
00000400:00000200:29.0:1773851884.641909:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16498@kfi7 of length 224 into portal 12 MB=0x69a9df519d300
00000400:00000200:29.0:1773851884.641910:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16498@kfi7 of length 224/224 into md 0x77fe139dd [64] + 192848
00000800:00000200:29.0:1773851884.641912:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851884.641914:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851884.641915:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16562@kfi7: PUT: OK
00000100:00000001:29.0:1773851884.641916:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851884.641917:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851884.641917:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a11c0a22.
00000100:00000040:29.0:1773851884.641918:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a11c0a22 x1858853072917248 msgsize 224
00000100:00100000:29.0:1773851884.641920:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16498@kfi7 (source: 12345-16562@kfi7)
00000100:00000001:29.0:1773851884.641921:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851884.641922:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005fabc175 nid 16562@kfi7 refs 2
00000800:00000200:29.0:1773851884.641923:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851884.641926:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851884.641926:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851884.641927:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851884.641927:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851884.641928:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851884.641929:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858853072917248
00000020:00000001:29.0:1773851884.641929:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851884.641930:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac919a7
00000020:00000001:29.0:1773851884.641930:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851884.641934:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000066e4ca23 refcount=6
00000020:00000001:29.0:1773851884.641935:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242234880 : -107152467316736 : ffff9e8b9f3fb000)
00000020:00000001:29.0:1773851884.641936:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242234880 : -107152467316736 : ffff9e8b9f3fb000)
00000100:00000001:29.0:1773851884.641937:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.641938:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851884.641939:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851884.641940:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851884.641941:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851884.641941:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851884.641942:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851884.641942:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851884.641943:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851884.641944:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851884.641944:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.641945:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851884.641946:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851884.641946:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851884.641947:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851884.641947:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851884.641948:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16498@kfi7, seq: 2055567
00000100:00000040:29.0:1773851884.641948:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000066e4ca23 : new rpc_count 1
00000100:00000001:30.0:1773851884.641949:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851884.641949:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.641949:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144162621952 : -106929546929664 : ffff9ebf8656da00)
00000100:00000040:29.0:1773851884.641950:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a11c0a22 x1858853072917248/t0(0) o400->a42b4514-a4c5-49c2-86c4-97cf7037f116@16498@kfi7:672/0 lens 224/0 e 0 to 0 dl 1773852032 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1514-0'
00000100:00000001:29.0:1773851884.641953:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.641953:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851884.641954:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a11c0a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:a42b4514-a4c5-49c2-86c4-97cf7037f116+6:39609:x1858853072917248:12345-16498@kfi7:400:default-tuolumne1514-0
00000100:00000200:29.0:1773851884.641956:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858853072917248
00000020:00000001:29.0:1773851884.641956:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851884.641957:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851884.641957:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.641958:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851884.641959:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851884.641959:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851884.641960:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858853072917248, found 0 last_xid 1858853072917247
00000020:00000001:29.0:1773851884.641961:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851884.641962:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851884.641962:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851884.641963:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.641963:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851884.641964:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851884.641964:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851884.641965:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b42abb09.
02000000:00000001:29.0:1773851884.641966:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.641966:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.641967:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851884.641968:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105133502, transno 0, xid 1858853072917248
00010000:00000001:29.0:1773851884.641969:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851884.641970:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a11c0a22 x1858853072917248/t0(0) o400->a42b4514-a4c5-49c2-86c4-97cf7037f116@16498@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1514-0'
00010000:00000001:29.0:1773851884.641972:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851884.641972:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851884.641973:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=117 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851884.641974:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851884.641975:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f1e5b719 refcount 3 to 16498@kfi7
00000100:00000001:29.0:1773851884.641976:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151360 : -107154898400256 : ffff9e8b0e584c00)
02000000:00000001:29.0:1773851884.641976:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851884.641977:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.641977:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851884.641978:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16562@kfi7
00000400:00000010:29.0:1773851884.641979:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ff40b36.
00000100:00000200:29.0:1773851884.641980:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858853072917248, offset 224
00000400:00000200:29.0:1773851884.641981:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16562@kfi7
00000400:00000200:29.0:1773851884.641981:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16562@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.641982:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005fabc175 nid 16562@kfi7 refs 1
00000400:00000200:29.0:1773851884.641983:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005fabc175 nid 16562@kfi7 refs 2
00000400:00000200:29.0:1773851884.641984:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005fabc175 nid 16562@kfi7 refs 3
00000400:00000200:29.0:1773851884.641985:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16562@kfi7 local destination
00000400:00000200:29.0:1773851884.641987:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769800:8769800:1024:4294967295] 16562@kfi7 LPNI seq info [10315447:10315447:16:4294967295]
00000400:00000200:29.0:1773851884.641988:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005fabc175 nid 16562@kfi7 refs 2
00000400:00000200:29.0:1773851884.641989:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16562@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.641991:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16562@kfi7(16562@kfi7:16562@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851884.641992:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005fabc175 nid 16562@kfi7 refs 3
00000800:00000200:29.0:1773851884.641993:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.641994:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851884.641997:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851884.641999:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0xaf9 Using peer 16562@kfi7(0xaf9)
00000800:00000200:29.0:1773851884.642002:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0xaf9: rc=0
00000800:00000200:29.0:1773851884.642003:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0xaf9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851884.642005:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851884.642006:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f1e5b719 refcount 2 to 16498@kfi7
00010000:00000001:29.0:1773851884.642007:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851884.642007:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.642008:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851884.642009:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a11c0a22 x1858853072917248/t0(0) o400->a42b4514-a4c5-49c2-86c4-97cf7037f116@16498@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1514-0'
00000100:00100000:29.0:1773851884.642012:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a11c0a22 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:a42b4514-a4c5-49c2-86c4-97cf7037f116+6:39609:x1858853072917248:12345-16498@kfi7:400:default-tuolumne1514-0 Request processed in 58us (93us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851884.642014:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16498@kfi7, seq: 2055567
00000800:00000200:30.0:1773851884.642015:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0xaf9 TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851884.642015:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000066e4ca23 : new rpc_count 0
00000100:00000001:29.0:1773851884.642016:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851884.642016:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:30.0:1773851884.642017:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851884.642017:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851884.642018:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16562@kfi7: PUT: OK
00000020:00000010:29.0:1773851884.642018:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851884.642018:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000400:00000200:30.0:1773851884.642019:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ff40b36
00000400:00000010:30.0:1773851884.642019:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ff40b36.
00000020:00000040:29.0:1773851884.642019:0:60533:0:(genops.c:882:class_export_put()) PUTting export 0000000066e4ca23 : new refcount 5
00000100:00000001:30.0:1773851884.642020:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851884.642020:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851884.642021:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851884.642022:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005fabc175 nid 16562@kfi7 refs 2
00000800:00000200:30.0:1773851884.642023:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 16562@kfi7(0000000058bcb18e):0x0 lsk 2810 rsk 82 tsk 0 trmk 0 tmk 0 trr 7 tta 0xaf9 Transaction freed
00010000:00000001:2.0:1773851884.681730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681730:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.681731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.681732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.681734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.681736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.681736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.681738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851884.681739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851884.681739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851884.681743:0:937836:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851884.681743:0:937836:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851884.681744:0:937836:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:18.0:1773851884.694607:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851884.694607:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851884.694607:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851884.694607:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:17.0:1773851884.694608:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851884.694609:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851884.694611:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851884.694611:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13409@kfi7(000000002132de7f):0x22c version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851884.694612:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c Using peer 13409@kfi7(0x22c)
00000400:00000200:18.0:1773851884.694613:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000400:00000200:18.0:1773851884.694614:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13409@kfi7 : PUT - for me
00000400:00000200:17.0:1773851884.694614:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000400:00000200:18.0:1773851884.694615:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000400:00000200:18.0:1773851884.694616:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ce466ab3 nid 13409@kfi7 refs 1
00000800:00000200:17.0:1773851884.694616:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 38 bytes to peer 0x22c: rc=0
00000400:00000200:18.0:1773851884.694617:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000800:00000200:17.0:1773851884.694617:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851884.694618:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ce466ab3 nid 13409@kfi7 refs 2
00000400:00000200:18.0:1773851884.694618:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ce466ab3 nid 13409@kfi7 refs 3
00000400:00000200:18.0:1773851884.694619:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000400:00000200:18.0:1773851884.694620:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13409@kfi7 of length 456 into portal 12 MB=0x699e0e468abc0
00000400:00000200:18.0:1773851884.694621:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13409@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 35336
00000800:00000200:18.0:1773851884.694623:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851884.694625:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851884.694625:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13409@kfi7: PUT: OK
00000100:00000001:18.0:1773851884.694626:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851884.694627:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851884.694628:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac6bf677.
00000100:00000040:18.0:1773851884.694629:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000ac6bf677 x1858041044052928 msgsize 456
00000800:00000200:17.0:1773851884.694629:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851884.694630:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-13409@kfi7 (source: 12345-13409@kfi7)
00000100:00000001:18.0:1773851884.694631:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851884.694631:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ce466ab3 nid 13409@kfi7 refs 2
00000800:00000200:17.0:1773851884.694631:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c Transaction freed
00000100:00000001:16.0:1773851884.694632:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851884.694633:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851884.694633:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851884.694633:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851884.694634:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851884.694634:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851884.694635:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041044052928
00000020:00000001:16.0:1773851884.694636:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851884.694636:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91bde
00000020:00000001:16.0:1773851884.694638:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851884.694641:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000063bfc185 refcount=6
00000020:00000001:16.0:1773851884.694642:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628032512 : -107123081519104 : ffff9e9276c76000)
00000020:00000001:16.0:1773851884.694642:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628032512 : -107123081519104 : ffff9e9276c76000)
00000100:00000001:16.0:1773851884.694643:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.694644:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851884.694644:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851884.694645:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.694646:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851884.694647:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851884.694647:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851884.694648:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.694649:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.694650:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851884.694651:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851884.694651:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851884.694651:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851884.694651:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851884.694652:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13409@kfi7, seq: 323103290
00000100:00000001:17.0:1773851884.694653:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.694653:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000063bfc185 : new rpc_count 1
00000100:00000001:17.0:1773851884.694654:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.694654:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127534668800 : -106946174882816 : ffff9ebba73c6c00)
00000100:00000040:16.0:1773851884.694655:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ac6bf677 x1858041044052928/t0(0) o17->fa027664-f086-4b18-b24e-0ccbf0e384dc@13409@kfi7:611/0 lens 456/0 e 0 to 0 dl 1773851971 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1328-0'
00000100:00000001:16.0:1773851884.694657:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.694658:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851884.694659:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac6bf677 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:fa027664-f086-4b18-b24e-0ccbf0e384dc+6:39725:x1858041044052928:12345-13409@kfi7:17:default-tuolumne1328-0
00000100:00000200:16.0:1773851884.694660:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041044052928
00000020:00000001:16.0:1773851884.694661:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851884.694661:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851884.694662:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.694663:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851884.694663:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:16.0:1773851884.694664:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851884.694664:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041044052928, found 0 last_xid 1858041044052927
00000020:00000001:16.0:1773851884.694666:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851884.694666:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851884.694667:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851884.694667:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:16.0:1773851884.694668:0:61039:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:16.0:1773851884.694669:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851884.694669:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851884.694671:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000be570691.
02000000:00000001:16.0:1773851884.694671:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.694672:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.694673:0:61039:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:16.0:1773851884.694673:0:61039:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:16.0:1773851884.694674:0:61039:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:16.0:1773851884.694676:0:61039:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.694677:0:61039:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:16.0:1773851884.694677:0:61039:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli fa027664-f086-4b18-b24e-0ccbf0e384dc/0000000063bfc185 free: 126633370845184 avail: 126633368748032
00000020:00000001:16.0:1773851884.694679:0:61039:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:16.0:1773851884.694679:0:61039:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli fa027664-f086-4b18-b24e-0ccbf0e384dc/0000000063bfc185 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:16.0:1773851884.694681:0:61039:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:16.0:1773851884.694681:0:61039:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:16.0:1773851884.694682:0:61039:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli fa027664-f086-4b18-b24e-0ccbf0e384dc/0000000063bfc185 reports grant 1792933884 dropped 0, local 1856372735
00000020:00000001:16.0:1773851884.694683:0:61039:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:16.0:1773851884.694684:0:61039:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:16.0:1773851884.694684:0:61039:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851884.694685:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182685357324, transno 0, xid 1858041044052928
00010000:00000001:16.0:1773851884.694686:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851884.694686:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ac6bf677 x1858041044052928/t0(0) o17->fa027664-f086-4b18-b24e-0ccbf0e384dc@13409@kfi7:611/0 lens 456/432 e 0 to 0 dl 1773851971 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1328-0'
00010000:00000001:16.0:1773851884.694689:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851884.694689:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851884.694690:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=117 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851884.694691:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851884.694692:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003cf8d890 refcount 3 to 13409@kfi7
00000100:00000001:16.0:1773851884.694693:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517472 : -107156126034144 : ffff9e8ac52c1720)
02000000:00000001:16.0:1773851884.694694:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851884.694694:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.694695:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851884.694696:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13409@kfi7
00000400:00000010:16.0:1773851884.694696:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cba1b548.
00000100:00000200:16.0:1773851884.694697:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858041044052928, offset 224
00000400:00000200:16.0:1773851884.694699:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13409@kfi7
00000400:00000200:16.0:1773851884.694699:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.694700:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ce466ab3 nid 13409@kfi7 refs 1
00000400:00000200:16.0:1773851884.694701:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ce466ab3 nid 13409@kfi7 refs 2
00000400:00000200:16.0:1773851884.694702:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ce466ab3 nid 13409@kfi7 refs 3
00000400:00000200:16.0:1773851884.694703:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13409@kfi7 local destination
00000400:00000200:16.0:1773851884.694704:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769801:8769801:1024:4294967295] 13409@kfi7 LPNI seq info [2316378:2316378:16:4294967295]
00000400:00000200:16.0:1773851884.694706:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ce466ab3 nid 13409@kfi7 refs 2
00000400:00000200:16.0:1773851884.694706:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13409@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.694709:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13409@kfi7(13409@kfi7:13409@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851884.694710:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ce466ab3 nid 13409@kfi7 refs 3
00000800:00000200:16.0:1773851884.694712:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851884.694713:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:16.0:1773851884.694715:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851884.694717:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c Using peer 13409@kfi7(0x22c)
00000800:00000200:16.0:1773851884.694720:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009aebe925: Posted send of 532 bytes to peer 0x22c: rc=0
00000800:00000200:16.0:1773851884.694721:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851884.694723:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.694724:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003cf8d890 refcount 2 to 13409@kfi7
00010000:00000001:16.0:1773851884.694730:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851884.694731:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.694732:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851884.694733:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac6bf677 x1858041044052928/t0(0) o17->fa027664-f086-4b18-b24e-0ccbf0e384dc@13409@kfi7:611/0 lens 456/432 e 0 to 0 dl 1773851971 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1328-0'
00000100:00100000:16.0:1773851884.694736:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac6bf677 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:fa027664-f086-4b18-b24e-0ccbf0e384dc+6:39725:x1858041044052928:12345-13409@kfi7:17:default-tuolumne1328-0 Request processed in 77us (106us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851884.694738:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13409@kfi7, seq: 323103290
00000100:00000040:16.0:1773851884.694739:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000063bfc185 : new rpc_count 0
00000100:00000001:16.0:1773851884.694739:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851884.694740:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851884.694740:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.694741:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:16.0:1773851884.694742:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:16.0:1773851884.694743:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000063bfc185 : new refcount 5
00000100:00000001:16.0:1773851884.694743:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851884.694748:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851884.694750:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.694751:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13409@kfi7: PUT: OK
00000400:00000200:17.0:1773851884.694752:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cba1b548
00000400:00000010:17.0:1773851884.694752:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cba1b548.
00000100:00000001:17.0:1773851884.694753:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851884.694754:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851884.694754:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ce466ab3 nid 13409@kfi7 refs 2
00000800:00000200:17.0:1773851884.694756:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 13409@kfi7(000000002132de7f):0x0 lsk 557 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x22c Transaction freed
00000800:00000200:5.0:1773851884.739523:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851884.739524:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851884.739526:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851884.739530:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851884.739533:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.739535:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9@kfi7 : PUT - for me
00000400:00000200:5.0:1773851884.739537:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.739538:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000200:5.0:1773851884.739540:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.739541:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:5.0:1773851884.739543:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:5.0:1773851884.739544:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851884.739546:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 224 into portal 12 MB=0x699e0fb6bb2c0
00000400:00000200:5.0:1773851884.739549:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9@kfi7 of length 224/224 into md 0x793926dc5 [64] + 155440
00000800:00000200:5.0:1773851884.739551:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851884.739554:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.739556:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9@kfi7: PUT: OK
00000100:00000001:5.0:1773851884.739558:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851884.739558:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851884.739560:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000018c950fc.
00000100:00000040:5.0:1773851884.739561:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000018c950fc x1858041430127296 msgsize 224
00000100:00100000:5.0:1773851884.739563:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-9@kfi7 (source: 12345-9@kfi7)
00000100:00000001:5.0:1773851884.739565:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851884.739566:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:4.0:1773851884.739566:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851884.739567:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851884.739568:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851884.739568:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851884.739568:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851884.739569:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851884.739570:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041430127296
00000020:00000001:4.0:1773851884.739571:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851884.739571:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acce67d
00000020:00000001:4.0:1773851884.739574:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851884.739576:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d6f0a222 refcount=5
00000020:00000001:4.0:1773851884.739577:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956528130048 : -107117181421568 : ffff9e93d673b800)
00000020:00000001:4.0:1773851884.739578:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636956528130048 : -107117181421568 : ffff9e93d673b800)
00000100:00000001:4.0:1773851884.739579:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851884.739580:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851884.739581:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001dd2088e.
00000020:00000010:4.0:1773851884.739582:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851884.739583:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851884.739584:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851884.739585:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851884.739585:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.739586:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851884.739587:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851884.739588:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.739589:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.739590:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851884.739590:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851884.739591:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851884.739592:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851884.739592:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9@kfi7, seq: 2001963
00000100:00000001:7.0:1773851884.739593:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.739593:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d6f0a222 : new rpc_count 1
00000100:00000001:4.0:1773851884.739593:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108948864 : -106938600602752 : ffff9ebd6ab2c380)
00000100:00000001:7.0:1773851884.739594:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.739595:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000018c950fc x1858041430127296/t0(0) o400->lustre5-MDT0001-lwp-OST0019_UUID@9@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba126-0'
00000100:00000001:4.0:1773851884.739598:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851884.739598:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851884.739599:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000018c950fc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:lustre5-MDT0001-lwp-OST0019_UUID+5:232277:x1858041430127296:12345-9@kfi7:400:default-yuba126-0
00000100:00000200:4.0:1773851884.739601:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041430127296
00000020:00000001:4.0:1773851884.739602:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851884.739602:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851884.739603:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.739604:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851884.739604:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851884.739605:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:4.0:1773851884.739607:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851884.739607:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851884.739608:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851884.739609:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.739609:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851884.739610:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851884.739611:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851884.739612:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009634af66.
02000000:00000001:4.0:1773851884.739613:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.739614:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.739614:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851884.739615:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041430127296
00010000:00000001:4.0:1773851884.739616:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851884.739617:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000018c950fc x1858041430127296/t0(0) o400->lustre5-MDT0001-lwp-OST0019_UUID@9@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba126-0'
00010000:00000001:4.0:1773851884.739620:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851884.739620:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851884.739621:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=116 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851884.739623:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851884.739623:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b9f4d429 refcount 7 to 9@kfi7
00000100:00000001:4.0:1773851884.739624:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701728 : -107156155849888 : ffff9e8ac3652360)
02000000:00000001:4.0:1773851884.739625:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851884.739626:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.739627:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851884.739628:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:4.0:1773851884.739628:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009607a9dc.
00000100:00000200:4.0:1773851884.739629:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041430127296, offset 224
00000400:00000200:4.0:1773851884.739631:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000400:00000200:4.0:1773851884.739632:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:4.0:1773851884.739633:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000200:4.0:1773851884.739634:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:4.0:1773851884.739635:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:4.0:1773851884.739637:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9@kfi7 local destination
00000400:00000200:4.0:1773851884.739638:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769802:8769802:1024:4294967295] 9@kfi7 LPNI seq info [5403012:5403012:16:4294967295]
00000400:00000200:4.0:1773851884.739642:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:4.0:1773851884.739643:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:4.0:1773851884.739645:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851884.739647:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000800:00000200:4.0:1773851884.739648:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851884.739650:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851884.739652:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851884.739655:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000324 Using peer 9@kfi7(0x200000000000324)
00000800:00000200:4.0:1773851884.739658:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x200000000000324: rc=0
00000800:00000200:4.0:1773851884.739660:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000324 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851884.739662:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.739663:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b9f4d429 refcount 6 to 9@kfi7
00010000:00000001:4.0:1773851884.739664:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851884.739665:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851884.739666:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851884.739668:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000018c950fc x1858041430127296/t0(0) o400->lustre5-MDT0001-lwp-OST0019_UUID@9@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba126-0'
00000100:00100000:4.0:1773851884.739672:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000018c950fc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:lustre5-MDT0001-lwp-OST0019_UUID+5:232277:x1858041430127296:12345-9@kfi7:400:default-yuba126-0 Request processed in 73us (110us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851884.739675:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9@kfi7, seq: 2001963
00000100:00000040:4.0:1773851884.739676:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d6f0a222 : new rpc_count 0
00000100:00000001:4.0:1773851884.739677:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851884.739678:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851884.739678:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851884.739679:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851884.739680:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001dd2088e.
00000020:00000040:4.0:1773851884.739681:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000d6f0a222 : new refcount 4
00000100:00000001:4.0:1773851884.739682:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851884.739687:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000324 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851884.739689:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.739690:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9@kfi7: PUT: OK
00000400:00000200:5.0:1773851884.739691:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009607a9dc
00000400:00000010:5.0:1773851884.739691:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009607a9dc.
00000100:00000001:5.0:1773851884.739692:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851884.739692:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851884.739693:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:5.0:1773851884.739694:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000324 Transaction freed
00000800:00000200:22.0:1773851884.757021:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851884.757022:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851884.757023:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851884.757025:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851884.757028:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15043@kfi7 to cpt 5
00000400:00000200:22.0:1773851884.757029:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15043@kfi7 : PUT - for me
00000400:00000200:22.0:1773851884.757030:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15043@kfi7 to cpt 5
00000400:00000200:22.0:1773851884.757031:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000566858a9 nid 15043@kfi7 refs 1
00000400:00000200:22.0:1773851884.757032:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15043@kfi7 to cpt 5
00000400:00000200:22.0:1773851884.757032:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000566858a9 nid 15043@kfi7 refs 2
00000400:00000200:22.0:1773851884.757033:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000566858a9 nid 15043@kfi7 refs 3
00000400:00000200:22.0:1773851884.757034:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15042@kfi7 to cpt 2
00000400:00000200:22.0:1773851884.757035:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15042@kfi7 of length 224 into portal 12 MB=0x69b093d5f4340
00000400:00000200:22.0:1773851884.757036:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15042@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 53048
00000800:00000200:22.0:1773851884.757038:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851884.757039:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851884.757040:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15043@kfi7: PUT: OK
00000100:00000001:22.0:1773851884.757041:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851884.757042:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851884.757043:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009f6be2a2.
00000100:00000040:22.0:1773851884.757043:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000009f6be2a2 x1859313846928192 msgsize 224
00000100:00100000:22.0:1773851884.757045:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-15042@kfi7 (source: 12345-15043@kfi7)
00000100:00000001:22.0:1773851884.757046:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851884.757046:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000566858a9 nid 15043@kfi7 refs 2
00000100:00000001:23.0:1773851884.757047:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851884.757048:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851884.757048:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851884.757049:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851884.757049:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851884.757051:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851884.757051:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313846928192
00000020:00000001:23.0:1773851884.757052:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851884.757053:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f5d
00000020:00000001:23.0:1773851884.757054:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851884.757058:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001fc978c4 refcount=6
00000020:00000001:23.0:1773851884.757058:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744918016 : -107128964633600 : ffff9e91181e2c00)
00000020:00000001:23.0:1773851884.757060:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744918016 : -107128964633600 : ffff9e91181e2c00)
00000100:00000001:23.0:1773851884.757061:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851884.757062:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851884.757063:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f252686b.
00000020:00000010:23.0:1773851884.757064:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851884.757066:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851884.757067:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851884.757067:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851884.757068:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851884.757069:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851884.757070:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851884.757071:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851884.757072:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851884.757073:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851884.757073:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851884.757074:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851884.757074:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851884.757076:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851884.757076:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15042@kfi7, seq: 1998033
00000100:00000040:20.0:1773851884.757076:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001fc978c4 : new rpc_count 1
00000100:00000001:23.0:1773851884.757077:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851884.757077:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382202752 : -106946327348864 : ffff9ebb9e25f980)
00000100:00000040:20.0:1773851884.757079:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009f6be2a2 x1859313846928192/t0(0) o400->d6330d39-9017-44c1-994f-017473e91d61@15042@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1431-0'
00000100:00000001:20.0:1773851884.757081:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851884.757082:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851884.757083:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f6be2a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d6330d39-9017-44c1-994f-017473e91d61+6:39642:x1859313846928192:12345-15042@kfi7:400:default-tuolumne1431-0
00000100:00000200:20.0:1773851884.757085:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313846928192
00000020:00000001:20.0:1773851884.757086:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851884.757086:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851884.757087:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851884.757088:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851884.757088:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851884.757089:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851884.757090:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313846928192, found 0 last_xid 1859313846928191
00000020:00000001:20.0:1773851884.757091:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851884.757091:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851884.757092:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851884.757092:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851884.757093:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851884.757094:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851884.757094:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851884.757095:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000e2522f4.
02000000:00000001:20.0:1773851884.757096:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851884.757096:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851884.757097:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851884.757098:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255655021, transno 0, xid 1859313846928192
00010000:00000001:20.0:1773851884.757098:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851884.757099:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009f6be2a2 x1859313846928192/t0(0) o400->d6330d39-9017-44c1-994f-017473e91d61@15042@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1431-0'
00010000:00000001:20.0:1773851884.757101:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851884.757102:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851884.757103:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=117 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851884.757104:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851884.757105:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004a9ef722 refcount 3 to 15042@kfi7
00000100:00000001:20.0:1773851884.757105:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899610944 : -107146809940672 : ffff9e8cf0746540)
02000000:00000001:20.0:1773851884.757106:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851884.757107:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851884.757107:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851884.757109:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15043@kfi7
00000400:00000010:20.0:1773851884.757109:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f21c7ec.
00000100:00000200:20.0:1773851884.757110:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859313846928192, offset 224
00000400:00000200:20.0:1773851884.757111:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15043@kfi7
00000400:00000200:20.0:1773851884.757112:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15043@kfi7 to cpt 5
00000400:00000200:20.0:1773851884.757113:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000566858a9 nid 15043@kfi7 refs 1
00000400:00000200:20.0:1773851884.757114:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000566858a9 nid 15043@kfi7 refs 2
00000400:00000200:20.0:1773851884.757115:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000566858a9 nid 15043@kfi7 refs 3
00000400:00000200:20.0:1773851884.757117:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15043@kfi7 local destination
00000400:00000200:20.0:1773851884.757118:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769803:8769803:1024:4294967295] 15043@kfi7 LPNI seq info [240662:240662:16:4294967295]
00000400:00000200:20.0:1773851884.757119:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000566858a9 nid 15043@kfi7 refs 2
00000400:00000200:20.0:1773851884.757120:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15043@kfi7 to cpt 5
00000400:00000200:20.0:1773851884.757122:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15043@kfi7(15043@kfi7:15043@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851884.757123:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000566858a9 nid 15043@kfi7 refs 3
00000800:00000200:20.0:1773851884.757125:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851884.757126:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851884.757128:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851884.757130:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011e1 Using peer 15043@kfi7(0x1000000000011e1)
00000800:00000200:20.0:1773851884.757134:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x1000000000011e1: rc=0
00000800:00000200:20.0:1773851884.757135:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011e1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851884.757137:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851884.757138:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004a9ef722 refcount 2 to 15042@kfi7
00010000:00000001:20.0:1773851884.757139:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851884.757139:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851884.757140:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851884.757141:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009f6be2a2 x1859313846928192/t0(0) o400->d6330d39-9017-44c1-994f-017473e91d61@15042@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1431-0'
00000100:00100000:20.0:1773851884.757148:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f6be2a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d6330d39-9017-44c1-994f-017473e91d61+6:39642:x1859313846928192:12345-15042@kfi7:400:default-tuolumne1431-0 Request processed in 65us (104us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851884.757151:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15042@kfi7, seq: 1998033
00000100:00000040:20.0:1773851884.757151:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001fc978c4 : new rpc_count 0
00000100:00000001:20.0:1773851884.757152:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851884.757153:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851884.757153:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851884.757154:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:20.0:1773851884.757155:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f252686b.
00000020:00000040:20.0:1773851884.757156:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000001fc978c4 : new refcount 5
00000100:00000001:20.0:1773851884.757156:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851884.757162:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011e1 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851884.757163:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851884.757164:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15043@kfi7: PUT: OK
00000400:00000200:22.0:1773851884.757165:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f21c7ec
00000400:00000010:22.0:1773851884.757165:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f21c7ec.
00000100:00000001:22.0:1773851884.757166:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851884.757166:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851884.757168:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000566858a9 nid 15043@kfi7 refs 2
00000800:00000200:22.0:1773851884.757169:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15043@kfi7(00000000b2bcecf4):0x0 lsk 4578 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011e1 Transaction freed
00000800:00000200:14.0:1773851884.777183:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851884.777184:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851884.777185:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851884.777187:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851884.777190:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18129@kfi7 to cpt 3
00000400:00000200:14.0:1773851884.777191:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18129@kfi7 : PUT - for me
00000400:00000200:14.0:1773851884.777192:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18129@kfi7 to cpt 3
00000400:00000200:14.0:1773851884.777193:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007af0f8ba nid 18129@kfi7 refs 1
00000400:00000200:14.0:1773851884.777195:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18129@kfi7 to cpt 3
00000400:00000200:14.0:1773851884.777195:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007af0f8ba nid 18129@kfi7 refs 2
00000400:00000200:14.0:1773851884.777196:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007af0f8ba nid 18129@kfi7 refs 3
00000400:00000200:14.0:1773851884.777197:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17936@kfi7 to cpt 5
00000400:00000200:14.0:1773851884.777198:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17936@kfi7 of length 224 into portal 12 MB=0x69b4ba5dd7b40
00000400:00000200:14.0:1773851884.777200:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17936@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 43792
00000800:00000200:14.0:1773851884.777201:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851884.777203:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851884.777204:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18129@kfi7: PUT: OK
00000100:00000001:14.0:1773851884.777205:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851884.777206:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851884.777206:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f77d275a.
00000100:00000040:14.0:1773851884.777207:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000f77d275a x1859599067872064 msgsize 224
00000100:00100000:14.0:1773851884.777209:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-17936@kfi7 (source: 12345-18129@kfi7)
00000100:00000001:14.0:1773851884.777210:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851884.777211:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:14.0:1773851884.777211:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007af0f8ba nid 18129@kfi7 refs 2
02000000:00000001:15.0:1773851884.777212:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851884.777212:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851884.777213:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851884.777213:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851884.777214:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851884.777215:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599067872064
00000020:00000001:15.0:1773851884.777216:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851884.777216:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38966c49
00000020:00000001:15.0:1773851884.777217:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851884.777220:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000080994932 refcount=10
00000020:00000001:15.0:1773851884.777221:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097485486080 : -106976224065536 : ffff9eb4a82a4800)
00000020:00000001:15.0:1773851884.777222:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097485486080 : -106976224065536 : ffff9eb4a82a4800)
00000100:00000001:15.0:1773851884.777223:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851884.777224:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851884.777224:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000c5e8003.
00000020:00000010:15.0:1773851884.777225:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851884.777226:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851884.777227:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851884.777227:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851884.777228:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851884.777229:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851884.777230:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851884.777230:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851884.777231:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851884.777232:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851884.777233:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851884.777233:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851884.777234:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17936@kfi7, seq: 2289888
00000100:00000001:12.0:1773851884.777234:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851884.777235:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000080994932 : new rpc_count 3
00000100:00000001:12.0:1773851884.777235:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851884.777236:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562688000 : -106978146863616 : ffff9eb4358eb600)
00000100:00000001:12.0:1773851884.777236:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851884.777237:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f77d275a x1859599067872064/t0(0) o400->87b76d15-c25b-4f6f-903c-f5cfb2f3e5f2@17936@kfi7:524/0 lens 224/0 e 0 to 0 dl 1773852639 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1617-0'
00000100:00000001:15.0:1773851884.777240:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851884.777240:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851884.777241:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f77d275a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:87b76d15-c25b-4f6f-903c-f5cfb2f3e5f2+10:39485:x1859599067872064:12345-17936@kfi7:400:default-tuolumne1617-0
00000100:00000200:15.0:1773851884.777243:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599067872064
00000020:00000001:15.0:1773851884.777243:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851884.777244:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851884.777245:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851884.777245:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851884.777246:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851884.777247:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851884.777247:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599067872064, found 0 last_xid 1859599066765759
00000020:00000001:15.0:1773851884.777248:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851884.777249:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851884.777249:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851884.777250:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851884.777251:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851884.777251:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851884.777252:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851884.777254:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000054b091d3.
02000000:00000001:15.0:1773851884.777254:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851884.777255:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851884.777256:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851884.777257:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182938054058, transno 0, xid 1859599067872064
00010000:00000001:15.0:1773851884.777257:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851884.777258:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f77d275a x1859599067872064/t0(0) o400->87b76d15-c25b-4f6f-903c-f5cfb2f3e5f2@17936@kfi7:524/0 lens 224/224 e 0 to 0 dl 1773852639 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1617-0'
00010000:00000001:15.0:1773851884.777261:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851884.777261:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851884.777262:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=117 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851884.777263:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851884.777264:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001294981b refcount 3 to 17936@kfi7
00000100:00000001:15.0:1773851884.777264:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999947680 : -107156709603936 : ffff9e8aa26385a0)
02000000:00000001:15.0:1773851884.777265:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851884.777265:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851884.777266:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851884.777267:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18129@kfi7
00000400:00000010:15.0:1773851884.777268:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006486d8f3.
00000100:00000200:15.0:1773851884.777269:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599067872064, offset 224
00000400:00000200:15.0:1773851884.777270:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18129@kfi7
00000400:00000200:15.0:1773851884.777271:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18129@kfi7 to cpt 3
00000400:00000200:15.0:1773851884.777272:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007af0f8ba nid 18129@kfi7 refs 1
00000400:00000200:15.0:1773851884.777273:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007af0f8ba nid 18129@kfi7 refs 2
00000400:00000200:15.0:1773851884.777274:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007af0f8ba nid 18129@kfi7 refs 3
00000400:00000200:15.0:1773851884.777275:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18129@kfi7 local destination
00000400:00000200:15.0:1773851884.777277:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769804:8769804:1024:4294967295] 18129@kfi7 LPNI seq info [498184:498184:16:4294967295]
00000400:00000200:15.0:1773851884.777279:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007af0f8ba nid 18129@kfi7 refs 2
00000400:00000200:15.0:1773851884.777279:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18129@kfi7 to cpt 3
00000400:00000200:15.0:1773851884.777281:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18129@kfi7(18129@kfi7:18129@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851884.777282:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007af0f8ba nid 18129@kfi7 refs 3
00000800:00000200:15.0:1773851884.777284:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851884.777285:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851884.777287:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851884.777290:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x319 Using peer 18129@kfi7(0x319)
00000800:00000200:15.0:1773851884.777293:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x319: rc=0
00000800:00000200:15.0:1773851884.777295:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x319 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851884.777297:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851884.777298:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001294981b refcount 2 to 17936@kfi7
00010000:00000001:15.0:1773851884.777299:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851884.777299:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851884.777300:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851884.777301:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f77d275a x1859599067872064/t0(0) o400->87b76d15-c25b-4f6f-903c-f5cfb2f3e5f2@17936@kfi7:524/0 lens 224/224 e 0 to 0 dl 1773852639 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1617-0'
00000100:00100000:15.0:1773851884.777304:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f77d275a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:87b76d15-c25b-4f6f-903c-f5cfb2f3e5f2+10:39485:x1859599067872064:12345-17936@kfi7:400:default-tuolumne1617-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851884.777306:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17936@kfi7, seq: 2289888
00000100:00000040:15.0:1773851884.777307:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000080994932 : new rpc_count 2
00000800:00000200:13.0:1773851884.777307:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x319 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851884.777308:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851884.777308:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851884.777308:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851884.777309:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851884.777309:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18129@kfi7: PUT: OK
00000020:00000010:15.0:1773851884.777310:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000400:00000200:13.0:1773851884.777310:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006486d8f3
00000400:00000010:13.0:1773851884.777310:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006486d8f3.
00000020:00000010:15.0:1773851884.777311:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000c5e8003.
00000100:00000001:13.0:1773851884.777311:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:15.0:1773851884.777312:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000080994932 : new refcount 9
00000100:00000001:15.0:1773851884.777312:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851884.777312:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851884.777312:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007af0f8ba nid 18129@kfi7 refs 2
00000800:00000200:13.0:1773851884.777314:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 18129@kfi7(00000000555286e3):0x0 lsk 794 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x319 Transaction freed
00000800:00000200:22.0:1773851884.835533:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851884.835534:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851884.835535:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851884.835537:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851884.835539:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23282@kfi7 to cpt 5
00000400:00000200:22.0:1773851884.835540:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23282@kfi7 : PUT - for me
00000400:00000200:22.0:1773851884.835541:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23282@kfi7 to cpt 5
00000400:00000200:22.0:1773851884.835542:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e5c9a162 nid 23282@kfi7 refs 1
00000400:00000200:22.0:1773851884.835543:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23282@kfi7 to cpt 5
00000400:00000200:22.0:1773851884.835543:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e5c9a162 nid 23282@kfi7 refs 2
00000400:00000200:22.0:1773851884.835544:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e5c9a162 nid 23282@kfi7 refs 3
00000400:00000200:22.0:1773851884.835545:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23282@kfi7 to cpt 5
00000400:00000200:22.0:1773851884.835546:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23282@kfi7 of length 224 into portal 12 MB=0x69b7c9c69a400
00000400:00000200:22.0:1773851884.835547:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23282@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 53272
00000800:00000200:22.0:1773851884.835548:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851884.835550:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851884.835551:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23282@kfi7: PUT: OK
00000100:00000001:22.0:1773851884.835552:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851884.835552:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851884.835553:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f6c90ea5.
00000100:00000040:22.0:1773851884.835553:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000f6c90ea5 x1859809362682880 msgsize 224
00000100:00100000:22.0:1773851884.835555:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-23282@kfi7 (source: 12345-23282@kfi7)
00000100:00000001:22.0:1773851884.835556:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851884.835556:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e5c9a162 nid 23282@kfi7 refs 2
00000800:00000200:22.0:1773851884.835557:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851884.835558:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851884.835559:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851884.835560:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851884.835560:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851884.835562:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851884.835563:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859809362682880
00000020:00000001:20.0:1773851884.835564:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851884.835565:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f085d7ae7ad1
00000020:00000001:20.0:1773851884.835566:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851884.835570:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000002f626e7 refcount=5
00000020:00000001:20.0:1773851884.835571:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637088870051840 : -106984839499776 : ffff9eb2a6a53000)
00000020:00000001:20.0:1773851884.835573:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637088870051840 : -106984839499776 : ffff9eb2a6a53000)
00000100:00000001:20.0:1773851884.835575:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851884.835576:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851884.835577:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aeeb6e1.
00000020:00000010:20.0:1773851884.835578:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851884.835580:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000404a8aa2.
00000100:00000001:20.0:1773851884.835581:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851884.835582:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851884.835583:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851884.835584:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851884.835588:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851884.835588:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851884.835590:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851884.835592:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851884.835592:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851884.835592:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851884.835593:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851884.835594:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23282@kfi7, seq: 1998034
00000100:00000040:23.0:1773851884.835595:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000002f626e7 : new rpc_count 1
00000100:00000001:20.0:1773851884.835595:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851884.835596:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382179712 : -106946327371904 : ffff9ebb9e259f80)
00000100:00000001:20.0:1773851884.835596:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851884.835597:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f6c90ea5 x1859809362682880/t0(0) o400->10c733fd-0ec7-45e6-8099-6580d9f8d958@23282@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1929-0'
00000100:00000001:23.0:1773851884.835600:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851884.835601:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851884.835602:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f6c90ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:10c733fd-0ec7-45e6-8099-6580d9f8d958+5:39573:x1859809362682880:12345-23282@kfi7:400:default-tuolumne1929-0
00000100:00000200:23.0:1773851884.835604:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859809362682880
00000020:00000001:23.0:1773851884.835604:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851884.835605:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851884.835606:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.835607:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851884.835607:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851884.835608:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851884.835609:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859809362682880, found 0 last_xid 1859809362682879
00000020:00000001:23.0:1773851884.835610:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851884.835610:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851884.835611:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851884.835612:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.835613:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851884.835613:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851884.835614:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851884.835615:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f252686b.
02000000:00000001:23.0:1773851884.835615:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851884.835616:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.835617:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851884.835618:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182174458092, transno 0, xid 1859809362682880
00010000:00000001:23.0:1773851884.835618:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851884.835619:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f6c90ea5 x1859809362682880/t0(0) o400->10c733fd-0ec7-45e6-8099-6580d9f8d958@23282@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1929-0'
00010000:00000001:23.0:1773851884.835622:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851884.835623:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851884.835624:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=117 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851884.835625:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851884.835626:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000008870007 refcount 3 to 23282@kfi7
00000100:00000001:23.0:1773851884.835626:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094784 : -107139307456832 : ffff9e8eafa336c0)
02000000:00000001:23.0:1773851884.835627:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851884.835628:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851884.835629:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851884.835630:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23282@kfi7
00000400:00000010:23.0:1773851884.835630:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008506b019.
00000100:00000200:23.0:1773851884.835631:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859809362682880, offset 224
00000400:00000200:23.0:1773851884.835633:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23282@kfi7
00000400:00000200:23.0:1773851884.835634:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23282@kfi7 to cpt 5
00000400:00000200:23.0:1773851884.835635:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e5c9a162 nid 23282@kfi7 refs 1
00000400:00000200:23.0:1773851884.835637:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e5c9a162 nid 23282@kfi7 refs 2
00000400:00000200:23.0:1773851884.835638:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e5c9a162 nid 23282@kfi7 refs 3
00000400:00000200:23.0:1773851884.835639:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23282@kfi7 local destination
00000400:00000200:23.0:1773851884.835641:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769805:8769805:1024:4294967295] 23282@kfi7 LPNI seq info [128391:128391:16:4294967295]
00000400:00000200:23.0:1773851884.835642:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e5c9a162 nid 23282@kfi7 refs 2
00000400:00000200:23.0:1773851884.835644:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23282@kfi7 to cpt 5
00000400:00000200:23.0:1773851884.835646:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23282@kfi7(23282@kfi7:23282@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851884.835647:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e5c9a162 nid 23282@kfi7 refs 3
00000800:00000200:23.0:1773851884.835649:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851884.835650:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851884.835653:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851884.835655:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000068e Using peer 23282@kfi7(0x10000000000068e)
00000800:00000200:23.0:1773851884.835659:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x10000000000068e: rc=0
00000800:00000200:23.0:1773851884.835660:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000068e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851884.835662:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851884.835663:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000008870007 refcount 2 to 23282@kfi7
00010000:00000001:23.0:1773851884.835664:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851884.835664:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851884.835665:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851884.835666:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f6c90ea5 x1859809362682880/t0(0) o400->10c733fd-0ec7-45e6-8099-6580d9f8d958@23282@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1929-0'
00000100:00100000:23.0:1773851884.835669:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f6c90ea5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:10c733fd-0ec7-45e6-8099-6580d9f8d958+5:39573:x1859809362682880:12345-23282@kfi7:400:default-tuolumne1929-0 Request processed in 68us (115us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851884.835671:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23282@kfi7, seq: 1998034
00000100:00000040:23.0:1773851884.835672:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000002f626e7 : new rpc_count 0
00000100:00000001:23.0:1773851884.835673:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851884.835673:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:22.0:1773851884.835673:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000068e TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851884.835674:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000400:00000200:22.0:1773851884.835674:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851884.835675:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000404a8aa2.
00000400:00000200:22.0:1773851884.835675:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23282@kfi7: PUT: OK
00000020:00000010:23.0:1773851884.835676:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aeeb6e1.
00000400:00000200:22.0:1773851884.835676:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008506b019
00000400:00000010:22.0:1773851884.835676:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008506b019.
00000020:00000040:23.0:1773851884.835677:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000002f626e7 : new refcount 4
00000100:00000001:22.0:1773851884.835677:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851884.835678:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851884.835678:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851884.835678:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e5c9a162 nid 23282@kfi7 refs 2
00000800:00000200:22.0:1773851884.835680:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 23282@kfi7(000000004d81bb5f):0x0 lsk 1679 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000068e Transaction freed
00000800:00000200:9.0:1773851884.836752:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851884.836753:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851884.836755:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851884.836757:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851884.836759:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18545@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.836760:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18545@kfi7 : PUT - for me
00000400:00000200:9.0:1773851884.836761:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18545@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.836762:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aaba8c15 nid 18545@kfi7 refs 1
00000400:00000200:9.0:1773851884.836763:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18545@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.836763:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aaba8c15 nid 18545@kfi7 refs 2
00000400:00000200:9.0:1773851884.836764:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aaba8c15 nid 18545@kfi7 refs 3
00000400:00000200:9.0:1773851884.836765:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18609@kfi7 to cpt 6
00000400:00000200:9.0:1773851884.836766:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18609@kfi7 of length 224 into portal 12 MB=0x69b82e2348b00
00000400:00000200:9.0:1773851884.836767:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18609@kfi7 of length 224/224 into md 0x78146ce49 [64] + 148672
00000800:00000200:9.0:1773851884.836769:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.836770:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.836771:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18545@kfi7: PUT: OK
00000100:00000001:9.0:1773851884.836772:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851884.836773:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851884.836773:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fae3a9db.
00000100:00000040:9.0:1773851884.836774:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000fae3a9db x1859836303411968 msgsize 224
00000100:00100000:9.0:1773851884.836775:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18609@kfi7 (source: 12345-18545@kfi7)
00000100:00000001:9.0:1773851884.836776:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851884.836777:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aaba8c15 nid 18545@kfi7 refs 2
00000100:00000001:11.0:1773851884.836778:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851884.836778:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851884.836779:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851884.836779:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851884.836779:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851884.836780:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851884.836781:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836303411968
00000020:00000001:11.0:1773851884.836782:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851884.836782:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d70999
00000020:00000001:11.0:1773851884.836783:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851884.836786:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000098d9be1f refcount=5
00000020:00000001:11.0:1773851884.836786:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127801016320 : -106945908535296 : ffff9ebbb71c9000)
00000020:00000001:11.0:1773851884.836788:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127801016320 : -106945908535296 : ffff9ebbb71c9000)
00000100:00000001:11.0:1773851884.836789:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851884.836790:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851884.836790:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a9ba5d0e.
00000020:00000010:11.0:1773851884.836791:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851884.836792:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851884.836793:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851884.836794:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851884.836794:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851884.836795:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851884.836796:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851884.836796:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.836797:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851884.836798:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.836799:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851884.836799:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18609@kfi7, seq: 2130825
00000100:00000040:11.0:1773851884.836800:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000098d9be1f : new rpc_count 1
00000100:00000001:8.0:1773851884.836800:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851884.836800:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851884.836801:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162659328 : -106971546892288 : ffff9eb5bef24800)
00000100:00000001:8.0:1773851884.836801:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.836802:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fae3a9db x1859836303411968/t0(0) o400->8adfec84-31f0-4db5-bb76-97cbb4b31588@18609@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1646-0'
00000100:00000001:8.0:1773851884.836802:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.836805:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851884.836805:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851884.836806:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fae3a9db pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8adfec84-31f0-4db5-bb76-97cbb4b31588+5:40282:x1859836303411968:12345-18609@kfi7:400:default-tuolumne1646-0
00000100:00000200:11.0:1773851884.836807:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836303411968
00000020:00000001:11.0:1773851884.836808:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851884.836809:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851884.836809:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.836810:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851884.836810:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851884.836811:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851884.836812:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836303411968, found 0 last_xid 1859836303411967
00000020:00000001:11.0:1773851884.836812:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851884.836814:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851884.836814:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851884.836815:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.836815:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851884.836816:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851884.836817:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851884.836818:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d0e62174.
02000000:00000001:11.0:1773851884.836818:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.836819:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.836820:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851884.836820:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262832046, transno 0, xid 1859836303411968
00010000:00000001:11.0:1773851884.836821:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851884.836822:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fae3a9db x1859836303411968/t0(0) o400->8adfec84-31f0-4db5-bb76-97cbb4b31588@18609@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1646-0'
00010000:00000001:11.0:1773851884.836824:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851884.836825:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851884.836825:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=117 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851884.836826:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851884.836827:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008d957cfd refcount 3 to 18609@kfi7
00000100:00000001:11.0:1773851884.836828:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860320 : -107149578691296 : ffff9e8c4b6c9d20)
02000000:00000001:11.0:1773851884.836829:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851884.836829:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.836830:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851884.836831:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18545@kfi7
00000400:00000010:11.0:1773851884.836831:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006b3931a1.
00000100:00000200:11.0:1773851884.836832:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836303411968, offset 224
00000400:00000200:11.0:1773851884.836833:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18545@kfi7
00000400:00000200:11.0:1773851884.836834:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18545@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.836835:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aaba8c15 nid 18545@kfi7 refs 1
00000400:00000200:11.0:1773851884.836835:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aaba8c15 nid 18545@kfi7 refs 2
00000400:00000200:11.0:1773851884.836836:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aaba8c15 nid 18545@kfi7 refs 3
00000400:00000200:11.0:1773851884.836837:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18545@kfi7 local destination
00000400:00000200:11.0:1773851884.836839:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769806:8769806:1024:4294967295] 18545@kfi7 LPNI seq info [9495929:9495929:16:4294967295]
00000400:00000200:11.0:1773851884.836840:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aaba8c15 nid 18545@kfi7 refs 2
00000400:00000200:11.0:1773851884.836841:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18545@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.836843:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18545@kfi7(18545@kfi7:18545@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851884.836844:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aaba8c15 nid 18545@kfi7 refs 3
00000800:00000200:11.0:1773851884.836845:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851884.836846:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851884.836848:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851884.836850:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000020c Using peer 18545@kfi7(0x10000000000020c)
00000800:00000200:11.0:1773851884.836853:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x10000000000020c: rc=0
00000800:00000200:11.0:1773851884.836855:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000020c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851884.836857:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.836857:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008d957cfd refcount 2 to 18609@kfi7
00010000:00000001:11.0:1773851884.836858:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851884.836859:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.836859:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851884.836860:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fae3a9db x1859836303411968/t0(0) o400->8adfec84-31f0-4db5-bb76-97cbb4b31588@18609@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1646-0'
00000100:00100000:11.0:1773851884.836863:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fae3a9db pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8adfec84-31f0-4db5-bb76-97cbb4b31588+5:40282:x1859836303411968:12345-18609@kfi7:400:default-tuolumne1646-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851884.836865:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18609@kfi7, seq: 2130825
00000100:00000040:11.0:1773851884.836866:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000098d9be1f : new rpc_count 0
00000100:00000001:11.0:1773851884.836867:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851884.836867:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000020c TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851884.836868:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851884.836868:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851884.836869:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000400:00000200:9.0:1773851884.836869:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851884.836870:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a9ba5d0e.
00000400:00000200:9.0:1773851884.836870:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18545@kfi7: PUT: OK
00000020:00000040:11.0:1773851884.836871:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000098d9be1f : new refcount 4
00000400:00000200:9.0:1773851884.836871:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006b3931a1
00000400:00000010:9.0:1773851884.836872:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006b3931a1.
00000100:00000001:9.0:1773851884.836872:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851884.836873:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851884.836873:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851884.836874:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aaba8c15 nid 18545@kfi7 refs 2
00000800:00000200:9.0:1773851884.836875:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18545@kfi7(000000004d7ccd5d):0x0 lsk 525 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000020c Transaction freed
00000800:00000200:25.0:1773851884.851162:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851884.851163:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851884.851165:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851884.851168:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851884.851171:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12064@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.851173:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12064@kfi7 : PUT - for me
00000400:00000200:25.0:1773851884.851174:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12064@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.851175:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ad18746b nid 12064@kfi7 refs 1
00000400:00000200:25.0:1773851884.851177:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12064@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.851178:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ad18746b nid 12064@kfi7 refs 2
00000400:00000200:25.0:1773851884.851179:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ad18746b nid 12064@kfi7 refs 3
00000400:00000200:25.0:1773851884.851181:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12257@kfi7 to cpt 4
00000400:00000200:25.0:1773851884.851182:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12257@kfi7 of length 224 into portal 12 MB=0x69b4b58466580
00000400:00000200:25.0:1773851884.851184:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12257@kfi7 of length 224/224 into md 0x16159c9699 [64] + 29280
00000800:00000200:25.0:1773851884.851187:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851884.851189:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851884.851191:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12064@kfi7: PUT: OK
00000100:00000001:25.0:1773851884.851193:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851884.851193:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851884.851195:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b1374dd5.
00000100:00000040:25.0:1773851884.851196:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b1374dd5 x1859597766124928 msgsize 224
00000100:00100000:25.0:1773851884.851198:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12257@kfi7 (source: 12345-12064@kfi7)
00000100:00000001:25.0:1773851884.851200:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851884.851201:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ad18746b nid 12064@kfi7 refs 2
00000100:00000001:27.0:1773851884.851202:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851884.851203:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851884.851204:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851884.851204:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851884.851205:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851884.851206:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851884.851207:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597766124928
00000020:00000001:27.0:1773851884.851208:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851884.851209:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8041c
00000020:00000001:27.0:1773851884.851210:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851884.851212:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bf6e0517 refcount=5
00000020:00000001:27.0:1773851884.851213:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138594739200 : -106935114812416 : ffff9ebe3a77b400)
00000020:00000001:27.0:1773851884.851214:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138594739200 : -106935114812416 : ffff9ebe3a77b400)
00000100:00000001:27.0:1773851884.851216:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851884.851217:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851884.851218:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000095a8ac67.
00000020:00000010:27.0:1773851884.851219:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851884.851221:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094f466b7.
00000100:00000001:27.0:1773851884.851222:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851884.851222:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851884.851223:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.851225:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851884.851225:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851884.851226:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.851228:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.851230:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851884.851230:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851884.851230:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851884.851231:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851884.851232:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12257@kfi7, seq: 2025152
00000100:00000040:27.0:1773851884.851233:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bf6e0517 : new rpc_count 1
00000100:00000001:26.0:1773851884.851233:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.851234:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252460416 : -106967457091200 : ffff9eb6b2b7b180)
00000100:00000001:26.0:1773851884.851235:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851884.851236:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b1374dd5 x1859597766124928/t0(0) o400->e00014c4-6139-4a19-b13a-f231f053a99f@12257@kfi7:134/0 lens 224/0 e 0 to 0 dl 1773852249 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1247-0'
00000100:00000001:27.0:1773851884.851241:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851884.851242:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851884.851243:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1374dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e00014c4-6139-4a19-b13a-f231f053a99f+5:39703:x1859597766124928:12345-12257@kfi7:400:default-tuolumne1247-0
00000100:00000200:27.0:1773851884.851245:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597766124928
00000020:00000001:27.0:1773851884.851246:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851884.851247:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851884.851248:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.851249:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851884.851250:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851884.851251:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851884.851252:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597766124928, found 0 last_xid 1859597766124927
00000020:00000001:27.0:1773851884.851254:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851884.851255:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851884.851255:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851884.851256:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.851257:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851884.851258:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851884.851259:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851884.851261:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000014c57716.
02000000:00000001:27.0:1773851884.851262:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.851263:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.851264:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851884.851265:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691480, transno 0, xid 1859597766124928
00010000:00000001:27.0:1773851884.851267:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851884.851268:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b1374dd5 x1859597766124928/t0(0) o400->e00014c4-6139-4a19-b13a-f231f053a99f@12257@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1247-0'
00010000:00000001:27.0:1773851884.851272:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851884.851273:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851884.851274:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=117 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851884.851276:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851884.851277:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000061ab3f2c refcount 3 to 12257@kfi7
00000100:00000001:27.0:1773851884.851278:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583910112 : -107156125641504 : ffff9e8ac53214e0)
02000000:00000001:27.0:1773851884.851279:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851884.851280:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.851281:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851884.851282:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12064@kfi7
00000400:00000010:27.0:1773851884.851283:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000872a87a5.
00000100:00000200:27.0:1773851884.851285:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597766124928, offset 224
00000400:00000200:27.0:1773851884.851286:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12064@kfi7
00000400:00000200:27.0:1773851884.851289:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12064@kfi7 to cpt 6
00000400:00000200:27.0:1773851884.851290:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ad18746b nid 12064@kfi7 refs 1
00000400:00000200:27.0:1773851884.851292:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ad18746b nid 12064@kfi7 refs 2
00000400:00000200:27.0:1773851884.851294:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ad18746b nid 12064@kfi7 refs 3
00000400:00000200:27.0:1773851884.851296:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12064@kfi7 local destination
00000400:00000200:27.0:1773851884.851298:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769807:8769807:1024:4294967295] 12064@kfi7 LPNI seq info [348464:348464:16:4294967295]
00000400:00000200:27.0:1773851884.851300:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ad18746b nid 12064@kfi7 refs 2
00000400:00000200:27.0:1773851884.851302:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12064@kfi7 to cpt 6
00000400:00000200:27.0:1773851884.851305:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12064@kfi7(12064@kfi7:12064@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851884.851307:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ad18746b nid 12064@kfi7 refs 3
00000800:00000200:27.0:1773851884.851309:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851884.851311:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851884.851314:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851884.851318:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf6 Using peer 12064@kfi7(0xf6)
00000800:00000200:27.0:1773851884.851323:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0xf6: rc=0
00000800:00000200:27.0:1773851884.851325:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851884.851328:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851884.851330:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000061ab3f2c refcount 2 to 12257@kfi7
00010000:00000001:27.0:1773851884.851331:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851884.851332:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851884.851333:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851884.851334:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b1374dd5 x1859597766124928/t0(0) o400->e00014c4-6139-4a19-b13a-f231f053a99f@12257@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1247-0'
00000800:00000200:25.0:1773851884.851339:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf6 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851884.851340:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1374dd5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e00014c4-6139-4a19-b13a-f231f053a99f+5:39703:x1859597766124928:12345-12257@kfi7:400:default-tuolumne1247-0 Request processed in 98us (143us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851884.851342:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851884.851343:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12064@kfi7: PUT: OK
00000100:00100000:27.0:1773851884.851344:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12257@kfi7, seq: 2025152
00000100:00000040:27.0:1773851884.851345:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bf6e0517 : new rpc_count 0
00000400:00000200:25.0:1773851884.851345:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000872a87a5
00000100:00000001:27.0:1773851884.851346:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:25.0:1773851884.851346:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000872a87a5.
00000100:00000001:27.0:1773851884.851347:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851884.851347:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:27.0:1773851884.851348:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000100:00000001:25.0:1773851884.851348:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851884.851349:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094f466b7.
00000400:00000200:25.0:1773851884.851349:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ad18746b nid 12064@kfi7 refs 2
00000020:00000010:27.0:1773851884.851350:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000095a8ac67.
00000800:00000200:25.0:1773851884.851351:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 12064@kfi7(00000000e67b1e69):0x0 lsk 247 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf6 Transaction freed
00000020:00000040:27.0:1773851884.851352:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000bf6e0517 : new refcount 4
00000100:00000001:27.0:1773851884.851353:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851884.855448:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851884.855449:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851884.855450:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851884.855452:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851884.855454:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10115@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.855455:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10115@kfi7 : PUT - for me
00000400:00000200:9.0:1773851884.855456:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10115@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.855457:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004215fb84 nid 10115@kfi7 refs 1
00000400:00000200:9.0:1773851884.855458:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10115@kfi7 to cpt 2
00000400:00000200:9.0:1773851884.855459:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004215fb84 nid 10115@kfi7 refs 2
00000400:00000200:9.0:1773851884.855460:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004215fb84 nid 10115@kfi7 refs 3
00000400:00000200:9.0:1773851884.855461:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10050@kfi7 to cpt 4
00000400:00000200:9.0:1773851884.855462:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10050@kfi7 of length 224 into portal 12 MB=0x69b4b59d87e00
00000400:00000200:9.0:1773851884.855463:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10050@kfi7 of length 224/224 into md 0x78146ce49 [64] + 148896
00000800:00000200:9.0:1773851884.855465:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.855466:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851884.855467:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10115@kfi7: PUT: OK
00000100:00000001:9.0:1773851884.855468:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851884.855468:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851884.855469:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007e613acf.
00000100:00000040:9.0:1773851884.855470:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000007e613acf x1859597792476672 msgsize 224
00000100:00100000:9.0:1773851884.855472:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10050@kfi7 (source: 12345-10115@kfi7)
00000100:00000001:9.0:1773851884.855473:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851884.855474:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851884.855474:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004215fb84 nid 10115@kfi7 refs 2
02000000:00000001:11.0:1773851884.855475:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851884.855475:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851884.855475:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851884.855476:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851884.855476:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851884.855477:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597792476672
00000020:00000001:11.0:1773851884.855478:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851884.855478:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d78910
00000020:00000001:11.0:1773851884.855479:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851884.855482:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000438455ea refcount=5
00000020:00000001:11.0:1773851884.855482:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106464109568 : -106967245442048 : ffff9eb6bf553400)
00000020:00000001:11.0:1773851884.855483:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106464109568 : -106967245442048 : ffff9eb6bf553400)
00000100:00000001:11.0:1773851884.855484:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851884.855485:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851884.855486:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003573e2ff.
00000020:00000010:11.0:1773851884.855487:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851884.855487:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851884.855488:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851884.855489:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851884.855489:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851884.855490:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851884.855490:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851884.855491:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.855492:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851884.855493:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851884.855493:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851884.855493:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851884.855494:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10050@kfi7, seq: 2130826
00000100:00000001:8.0:1773851884.855494:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851884.855495:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000438455ea : new rpc_count 1
00000100:00000001:8.0:1773851884.855495:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.855496:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162669696 : -106971546881920 : ffff9eb5bef27080)
00000100:00000001:8.0:1773851884.855496:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.855498:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007e613acf x1859597792476672/t0(0) o400->499c2009-2cb1-43fa-b5ec-7346db3ba1f6@10050@kfi7:611/0 lens 224/0 e 0 to 0 dl 1773851971 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1128-0'
00000100:00000001:11.0:1773851884.855500:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851884.855500:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851884.855502:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e613acf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:499c2009-2cb1-43fa-b5ec-7346db3ba1f6+5:39709:x1859597792476672:12345-10050@kfi7:400:default-tuolumne1128-0
00000100:00000200:11.0:1773851884.855503:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597792476672
00000020:00000001:11.0:1773851884.855504:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851884.855504:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851884.855505:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.855506:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851884.855506:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851884.855507:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851884.855507:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597792476672, found 0 last_xid 1859597792476671
00000020:00000001:11.0:1773851884.855508:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851884.855509:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851884.855509:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851884.855510:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.855511:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851884.855511:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851884.855512:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851884.855512:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a9ba5d0e.
02000000:00000001:11.0:1773851884.855513:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.855513:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.855514:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851884.855515:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824182, transno 0, xid 1859597792476672
00010000:00000001:11.0:1773851884.855515:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851884.855516:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007e613acf x1859597792476672/t0(0) o400->499c2009-2cb1-43fa-b5ec-7346db3ba1f6@10050@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1128-0'
00010000:00000001:11.0:1773851884.855518:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851884.855519:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851884.855519:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=117 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851884.855520:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851884.855521:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007e5aff25 refcount 3 to 10050@kfi7
00000100:00000001:11.0:1773851884.855522:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958880 : -107156125592736 : ffff9e8ac532d360)
02000000:00000001:11.0:1773851884.855523:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851884.855523:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.855524:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851884.855525:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10115@kfi7
00000400:00000010:11.0:1773851884.855525:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000040309670.
00000100:00000200:11.0:1773851884.855526:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597792476672, offset 224
00000400:00000200:11.0:1773851884.855527:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10115@kfi7
00000400:00000200:11.0:1773851884.855528:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10115@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.855529:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004215fb84 nid 10115@kfi7 refs 1
00000400:00000200:11.0:1773851884.855530:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004215fb84 nid 10115@kfi7 refs 2
00000400:00000200:11.0:1773851884.855531:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004215fb84 nid 10115@kfi7 refs 3
00000400:00000200:11.0:1773851884.855532:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10115@kfi7 local destination
00000400:00000200:11.0:1773851884.855534:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769808:8769808:1024:4294967295] 10115@kfi7 LPNI seq info [575791:575791:16:4294967295]
00000400:00000200:11.0:1773851884.855535:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004215fb84 nid 10115@kfi7 refs 2
00000400:00000200:11.0:1773851884.855536:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10115@kfi7 to cpt 2
00000400:00000200:11.0:1773851884.855537:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10115@kfi7(10115@kfi7:10115@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851884.855538:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004215fb84 nid 10115@kfi7 refs 3
00000800:00000200:11.0:1773851884.855540:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851884.855541:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851884.855543:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851884.855545:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000867 Using peer 10115@kfi7(0x100000000000867)
00000800:00000200:11.0:1773851884.855548:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x100000000000867: rc=0
00000800:00000200:11.0:1773851884.855549:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000867 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851884.855551:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851884.855552:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007e5aff25 refcount 2 to 10050@kfi7
00010000:00000001:11.0:1773851884.855552:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851884.855553:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851884.855554:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851884.855554:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007e613acf x1859597792476672/t0(0) o400->499c2009-2cb1-43fa-b5ec-7346db3ba1f6@10050@kfi7:611/0 lens 224/224 e 0 to 0 dl 1773851971 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1128-0'
00000100:00100000:11.0:1773851884.855561:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e613acf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:499c2009-2cb1-43fa-b5ec-7346db3ba1f6+5:39709:x1859597792476672:12345-10050@kfi7:400:default-tuolumne1128-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851884.855561:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000867 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851884.855562:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851884.855563:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10050@kfi7, seq: 2130826
00000100:00000040:11.0:1773851884.855563:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000438455ea : new rpc_count 0
00000400:00000200:9.0:1773851884.855563:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10115@kfi7: PUT: OK
00000100:00000001:11.0:1773851884.855564:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851884.855564:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000040309670
00000100:00000001:11.0:1773851884.855565:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851884.855565:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000010:9.0:1773851884.855565:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000040309670.
00000100:00000001:9.0:1773851884.855565:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851884.855566:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000100:00000001:9.0:1773851884.855566:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851884.855567:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003573e2ff.
00000400:00000200:9.0:1773851884.855567:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004215fb84 nid 10115@kfi7 refs 2
00000020:00000040:11.0:1773851884.855568:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000438455ea : new refcount 4
00000100:00000001:11.0:1773851884.855568:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851884.855568:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 10115@kfi7(0000000024a55377):0x0 lsk 2152 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000867 Transaction freed
00000800:00000200:17.0:1773851884.863189:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851884.863190:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851884.863191:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851884.863193:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851884.863195:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23088@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.863196:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23088@kfi7 : PUT - for me
00000400:00000200:17.0:1773851884.863197:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23088@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.863198:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000714e6632 nid 23088@kfi7 refs 1
00000400:00000200:17.0:1773851884.863200:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23088@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.863200:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000714e6632 nid 23088@kfi7 refs 2
00000400:00000200:17.0:1773851884.863201:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000714e6632 nid 23088@kfi7 refs 3
00000400:00000200:17.0:1773851884.863202:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23281@kfi7 to cpt 2
00000400:00000200:17.0:1773851884.863203:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23281@kfi7 of length 224 into portal 12 MB=0x69b0a3d5c1880
00000400:00000200:17.0:1773851884.863205:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23281@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 35792
00000800:00000200:17.0:1773851884.863206:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851884.863208:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.863209:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23088@kfi7: PUT: OK
00000100:00000001:17.0:1773851884.863210:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851884.863211:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851884.863211:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000080f13bf4.
00000100:00000040:17.0:1773851884.863212:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000080f13bf4 x1859318141687936 msgsize 224
00000100:00100000:17.0:1773851884.863213:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23281@kfi7 (source: 12345-23088@kfi7)
00000100:00000001:17.0:1773851884.863214:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851884.863215:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000714e6632 nid 23088@kfi7 refs 2
00000100:00000001:16.0:1773851884.863216:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851884.863216:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851884.863217:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851884.863217:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851884.863217:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851884.863218:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851884.863219:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318141687936
00000020:00000001:16.0:1773851884.863219:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851884.863220:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a32
00000020:00000001:16.0:1773851884.863221:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851884.863224:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bd24cda6 refcount=6
00000020:00000001:16.0:1773851884.863225:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743457792 : -107128966093824 : ffff9e911807e400)
00000020:00000001:16.0:1773851884.863226:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743457792 : -107128966093824 : ffff9e911807e400)
00000100:00000001:16.0:1773851884.863227:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.863228:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851884.863228:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851884.863229:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.863230:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851884.863231:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851884.863232:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851884.863232:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851884.863233:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851884.863234:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851884.863234:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.863235:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851884.863236:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851884.863237:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851884.863237:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851884.863237:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851884.863238:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23281@kfi7, seq: 2156392
00000100:00000001:17.0:1773851884.863239:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851884.863239:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.863239:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bd24cda6 : new rpc_count 1
00000100:00000001:16.0:1773851884.863239:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102221184 : -107041607330432 : ffff9ea56f04d580)
00000100:00000040:16.0:1773851884.863240:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000080f13bf4 x1859318141687936/t0(0) o400->49822a8d-54f8-4458-a4cc-1ff5b4baf300@23281@kfi7:672/0 lens 224/0 e 0 to 0 dl 1773852032 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1933-0'
00000100:00000001:16.0:1773851884.863243:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.863243:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851884.863244:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000080f13bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:49822a8d-54f8-4458-a4cc-1ff5b4baf300+6:39687:x1859318141687936:12345-23281@kfi7:400:default-tuolumne1933-0
00000100:00000200:16.0:1773851884.863245:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318141687936
00000020:00000001:16.0:1773851884.863246:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851884.863247:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851884.863247:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.863248:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851884.863248:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851884.863249:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851884.863250:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318141687936, found 0 last_xid 1859318141687935
00000020:00000001:16.0:1773851884.863251:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851884.863251:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851884.863252:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851884.863252:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.863253:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851884.863254:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851884.863254:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851884.863255:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dcefc8a7.
02000000:00000001:16.0:1773851884.863256:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.863257:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.863258:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851884.863258:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044138866, transno 0, xid 1859318141687936
00010000:00000001:16.0:1773851884.863259:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851884.863260:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000080f13bf4 x1859318141687936/t0(0) o400->49822a8d-54f8-4458-a4cc-1ff5b4baf300@23281@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1933-0'
00010000:00000001:16.0:1773851884.863262:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851884.863263:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851884.863264:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=117 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851884.863264:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851884.863265:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000054911398 refcount 3 to 23281@kfi7
00000100:00000001:16.0:1773851884.863266:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899612960 : -107146809938656 : ffff9e8cf0746d20)
02000000:00000001:16.0:1773851884.863267:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851884.863267:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.863268:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851884.863269:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23088@kfi7
00000400:00000010:16.0:1773851884.863269:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000253254b8.
00000100:00000200:16.0:1773851884.863270:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318141687936, offset 224
00000400:00000200:16.0:1773851884.863271:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23088@kfi7
00000400:00000200:16.0:1773851884.863272:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23088@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.863273:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000714e6632 nid 23088@kfi7 refs 1
00000400:00000200:16.0:1773851884.863274:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000714e6632 nid 23088@kfi7 refs 2
00000400:00000200:16.0:1773851884.863275:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000714e6632 nid 23088@kfi7 refs 3
00000400:00000200:16.0:1773851884.863276:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23088@kfi7 local destination
00000400:00000200:16.0:1773851884.863277:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769809:8769809:1024:4294967295] 23088@kfi7 LPNI seq info [7875175:7875175:16:4294967295]
00000400:00000200:16.0:1773851884.863278:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000714e6632 nid 23088@kfi7 refs 2
00000400:00000200:16.0:1773851884.863279:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23088@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.863281:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23088@kfi7(23088@kfi7:23088@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851884.863282:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000714e6632 nid 23088@kfi7 refs 3
00000800:00000200:16.0:1773851884.863284:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851884.863285:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851884.863290:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851884.863292:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc2b Using peer 23088@kfi7(0xc2b)
00000800:00000200:16.0:1773851884.863295:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 324 bytes to peer 0xc2b: rc=0
00000800:00000200:16.0:1773851884.863296:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc2b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851884.863298:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.863299:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000054911398 refcount 2 to 23281@kfi7
00010000:00000001:16.0:1773851884.863300:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851884.863300:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.863301:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851884.863302:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000080f13bf4 x1859318141687936/t0(0) o400->49822a8d-54f8-4458-a4cc-1ff5b4baf300@23281@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1933-0'
00000100:00100000:16.0:1773851884.863306:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000080f13bf4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:49822a8d-54f8-4458-a4cc-1ff5b4baf300+6:39687:x1859318141687936:12345-23281@kfi7:400:default-tuolumne1933-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851884.863308:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23281@kfi7, seq: 2156392
00000100:00000040:16.0:1773851884.863309:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bd24cda6 : new rpc_count 0
00000100:00000001:16.0:1773851884.863310:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851884.863311:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851884.863311:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.863312:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:16.0:1773851884.863313:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:16.0:1773851884.863313:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000bd24cda6 : new refcount 5
00000100:00000001:16.0:1773851884.863314:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851884.863319:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc2b TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851884.863321:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.863322:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23088@kfi7: PUT: OK
00000400:00000200:17.0:1773851884.863323:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000253254b8
00000400:00000010:17.0:1773851884.863323:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000253254b8.
00000100:00000001:17.0:1773851884.863324:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851884.863324:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851884.863325:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000714e6632 nid 23088@kfi7 refs 2
00000800:00000200:17.0:1773851884.863327:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 23088@kfi7(0000000086910468):0x0 lsk 3116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xc2b Transaction freed
00000100:00000001:11.0:1773851884.873731:0:60898:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000001:5.0:1773851884.873731:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851884.873731:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:30.0:1773851884.873732:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851884.873732:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:5.0:1773851884.873732:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5ea564b.
00000004:00000020:30.0:1773851884.873733:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:7.0:1773851884.873733:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851884.873733:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c40ba58.
00000020:00000040:5.0:1773851884.873733:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000004:00000001:4.0:1773851884.873733:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:30.0:1773851884.873734:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000051de97e6.
00000020:00000040:7.0:1773851884.873734:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:5.0:1773851884.873734:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851884.873734:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:4.0:1773851884.873734:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:4.0:1773851884.873734:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aed85170.
00000020:00000040:30.0:1773851884.873735:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000100:00000001:7.0:1773851884.873735:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851884.873735:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851884.873735:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:4.0:1773851884.873735:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
02000000:00000001:7.0:1773851884.873736:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851884.873736:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000de2ed169.
02000000:00000010:5.0:1773851884.873736:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000097fed2c.
00000100:00000001:4.0:1773851884.873736:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851884.873737:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851884.873737:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:11.0:1773851884.873737:0:60898:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +41s
00000100:00001000:11.0:1773851884.873737:0:60898:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +4s, asking for 30 secs on 0 early replies
00000100:00000001:7.0:1773851884.873737:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851884.873737:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851884.873737:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851884.873737:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851884.873738:0:60898:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851884.873738:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:4.0:1773851884.873738:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000030ba13a7.
02000000:00000001:30.0:1773851884.873739:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.873739:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851884.873739:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.873739:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.873739:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:30.0:1773851884.873740:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000008a71a94e.
00000100:00000001:7.0:1773851884.873740:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851884.873740:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c5ea564b] to pc [ptlrpcd_01_03+3]  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851884.873740:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851884.873741:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851884.873741:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004c40ba58] to pc [ptlrpcd_01_00+0]  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851884.873741:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000aed85170] to pc [ptlrpcd_01_01+1]  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851884.873742:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851884.873743:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851884.873744:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000051de97e6] to pc [ptlrpcd_07_03+3]  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851884.873745:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:6.0:1773851884.873746:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:7.0:1773851884.873747:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873747:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851884.873747:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:5.0:1773851884.873747:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c0b8705f.
00080000:00000001:5.0:1773851884.873747:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637106690717696 : -106967018833920 : ffff9eb6ccd6f800)
00000004:00000001:4.0:1773851884.873747:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.873748:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851884.873748:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:6.0:1773851884.873748:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851884.873748:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851884.873749:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:7.0:1773851884.873749:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851884.873749:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851884.873750:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00001000:5.0:1773851884.873750:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000100:00000001:4.0:1773851884.873750:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851884.873750:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:30.0:1773851884.873751:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000009f1993ff.
00000100:00000001:28.0:1773851884.873751:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851884.873751:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000010:5.0:1773851884.873751:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001434ee84.
00080000:00000001:30.0:1773851884.873752:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636958653173760 : -107115056377856 : ffff9e94551d5000)
00000100:00000001:29.0:1773851884.873752:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851884.873752:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851884.873752:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:7.0:1773851884.873752:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:5.0:1773851884.873752:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614159327027121ns, next at 614160327026029ns, rc = 0
00080000:00000001:30.0:1773851884.873753:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851884.873753:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851884.873753:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:6.0:1773851884.873753:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851884.873753:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851884.873753:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:5.0:1773851884.873753:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851884.873754:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851884.873754:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851884.873754:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851884.873754:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851884.873754:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851884.873754:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851884.873755:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00100000:7.0:1773851884.873755:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c40ba58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051935360:7@kfi7:41:default-yuba2-0
00000100:00100000:6.0:1773851884.873755:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5ea564b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051935296:3@kfi7:13:default-yuba2-0
00000004:00000010:30.0:1773851884.873756:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000097482484.
00000004:00080000:30.0:1773851884.873756:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614159327031960ns, next at 614160327030988ns, rc = 0
00000100:00000001:4.0:1773851884.873756:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851884.873757:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851884.873757:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851884.873757:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:6.0:1773851884.873757:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851884.873757:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:4.0:1773851884.873757:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851884.873757:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851884.873758:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:28.0:1773851884.873758:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851884.873758:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851884.873758:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:6.0:1773851884.873758:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851884.873758:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:4.0:1773851884.873758:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851884.873759:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851884.873759:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851884.873759:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851884.873759:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851884.873759:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000067b7447a.
02000000:00000010:6.0:1773851884.873759:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000050743369.
00000100:00100000:28.0:1773851884.873760:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051de97e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051935488:2080@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851884.873760:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851884.873760:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851884.873761:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:6.0:1773851884.873761:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000010:6.0:1773851884.873761:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:4.0:1773851884.873761:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851884.873762:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:7.0:1773851884.873762:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:6.0:1773851884.873762:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009b8a7556.
00000100:00000001:4.0:1773851884.873762:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851884.873763:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851884.873763:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851884.873763:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
02000000:00000001:4.0:1773851884.873763:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851884.873764:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:7.0:1773851884.873764:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935360, portal 4
00000100:00000200:6.0:1773851884.873764:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935296, portal 4
00000100:00000001:6.0:1773851884.873764:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:4.0:1773851884.873764:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851884.873765:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000481ea804.
02000000:00000001:28.0:1773851884.873765:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.873765:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851884.873765:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309153536 : -106994400398080 : ffff9eb06cc57500)
00000100:00000001:6.0:1773851884.873765:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637135108944256 : -106938600607360 : ffff9ebd6ab2b180)
00000100:00100000:4.0:1773851884.873765:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aed85170 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051935424:2098@kfi7:41:default-yuba2-0
00000100:00000040:6.0:1773851884.873766:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851884.873766:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:28.0:1773851884.873767:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000040:7.0:1773851884.873767:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851884.873767:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851884.873767:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:28.0:1773851884.873768:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000010:28.0:1773851884.873768:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000063d86a5d.
02000000:00000001:4.0:1773851884.873768:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:6.0:1773851884.873769:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851884.873769:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
02000000:00000010:4.0:1773851884.873769:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000084a5b49f.
00000100:00000200:28.0:1773851884.873770:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935488, portal 4
00000100:00000001:7.0:1773851884.873770:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000010:6.0:1773851884.873770:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007fdfc970.
02000000:00000001:4.0:1773851884.873770:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851884.873771:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851884.873771:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411271040 : -106960298280576 : ffff9eb85d6a7980)
00000100:00000040:7.0:1773851884.873771:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:7.0:1773851884.873771:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000edcc54b1.
00000100:00000200:6.0:1773851884.873771:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935296, offset 0
00000400:00000200:4.0:1773851884.873771:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851884.873772:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000010:4.0:1773851884.873772:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000100:00000040:28.0:1773851884.873773:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851884.873773:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051935360, offset 0
00000400:00000200:6.0:1773851884.873773:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000010:4.0:1773851884.873773:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7eb278.
00000400:00000200:7.0:1773851884.873774:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:6.0:1773851884.873774:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:6.0:1773851884.873774:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000200:4.0:1773851884.873774:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935424, portal 4
00000100:00000001:28.0:1773851884.873775:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:4.0:1773851884.873775:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851884.873775:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528713344 : -106978180838272 : ffff9eb433884c80)
00000400:00000200:6.0:1773851884.873776:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000040:4.0:1773851884.873776:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851884.873777:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000010:28.0:1773851884.873777:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d3aa665.
00000400:00000200:6.0:1773851884.873777:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000100:00000200:28.0:1773851884.873778:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935488, offset 0
00000400:00000200:6.0:1773851884.873778:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769809, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769808, p:4294967295, g:4294967295, h:1000]
00000100:00000001:4.0:1773851884.873779:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:28.0:1773851884.873780:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:6.0:1773851884.873780:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000040:4.0:1773851884.873780:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000200:28.0:1773851884.873781:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000010:4.0:1773851884.873781:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009607a9dc.
00000400:00000200:6.0:1773851884.873782:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851884.873782:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000100:00000200:4.0:1773851884.873782:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051935424, offset 0
00000400:00000200:28.0:1773851884.873783:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:6.0:1773851884.873783:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769810:8769810:1024:4294967295] 3@kfi7 LPNI seq info [5406224:5406224:16:4294967295]
00000400:00000200:4.0:1773851884.873783:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:28.0:1773851884.873784:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:6.0:1773851884.873785:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:28.0:1773851884.873786:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:6.0:1773851884.873786:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:28.0:1773851884.873787:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:7.0:1773851884.873787:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:7.0:1773851884.873788:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:28.0:1773851884.873789:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769809, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769810, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851884.873789:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:7.0:1773851884.873790:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:7.0:1773851884.873791:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000400:00000200:7.0:1773851884.873793:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769809, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769810, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851884.873794:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851884.873795:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851884.873795:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851884.873796:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:7.0:1773851884.873796:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851884.873797:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769811:8769811:1024:4294967295] 2080@kfi7 LPNI seq info [5404394:5404394:16:4294967295]
00000400:00000200:7.0:1773851884.873797:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851884.873798:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340066, 17340068]
00000400:00000200:28.0:1773851884.873799:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:28.0:1773851884.873800:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851884.873800:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 8@kfi7
00000400:00000200:7.0:1773851884.873801:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769812:8769812:1024:4294967295] 8@kfi7 LPNI seq info [17340069:17340069:16:4294967295]
00000400:00000200:7.0:1773851884.873802:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:6.0:1773851884.873803:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851884.873804:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851884.873804:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:6.0:1773851884.873805:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:4.0:1773851884.873805:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:28.0:1773851884.873806:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:6.0:1773851884.873806:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851884.873806:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:7.0:1773851884.873807:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 8@kfi7(7@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851884.873807:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:7.0:1773851884.873808:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:6.0:1773851884.873808:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851884.873808:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:28.0:1773851884.873809:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:4.0:1773851884.873809:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000800:00000200:7.0:1773851884.873810:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851884.873810:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851884.873811:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851884.873811:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769812, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769810, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851884.873812:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851884.873812:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Using peer 3@kfi7(0x2000000000003b5)
00000400:00000200:4.0:1773851884.873813:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:28.0:1773851884.873814:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851884.873814:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851884.873814:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851884.873815:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:6.0:1773851884.873816:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 324 bytes to peer 0x2000000000003b5: rc=0
00000400:00000200:4.0:1773851884.873816:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346206, 20346208]
00000800:00000200:28.0:1773851884.873817:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Using peer 2080@kfi7(0x64e)
00000800:00000200:7.0:1773851884.873817:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 Using peer 8@kfi7(0x11a4)
00000800:00000200:6.0:1773851884.873817:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851884.873817:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2098@kfi7
00000400:00000200:4.0:1773851884.873818:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769813:8769813:1023:4294967295] 2098@kfi7 LPNI seq info [20346209:20346209:16:4294967295]
00000100:00000001:6.0:1773851884.873819:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873820:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851884.873820:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:7.0:1773851884.873821:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x11a4: rc=0
00000100:00000001:6.0:1773851884.873821:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851884.873821:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000800:00000200:7.0:1773851884.873822:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851884.873822:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873822:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:28.0:1773851884.873823:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x64e: rc=0
00000400:00000200:4.0:1773851884.873823:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851884.873824:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873824:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851884.873824:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851884.873825:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851884.873825:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873825:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851884.873825:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851884.873825:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851884.873826:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851884.873826:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873826:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851884.873826:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000100:00000001:7.0:1773851884.873827:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851884.873828:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851884.873829:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851884.873829:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851884.873830:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851884.873830:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.873831:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851884.873832:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851884.873832:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851884.873833:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851884.873834:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851884.873835:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851884.873835:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 TN_EVENT_TX_OK event status 0
00000800:00000200:4.0:1773851884.873835:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:28.0:1773851884.873836:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851884.873836:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851884.873836:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000800:00000200:4.0:1773851884.873836:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851884.873837:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00000400:00000200:5.0:1773851884.873837:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007fdfc970
00000400:00000010:5.0:1773851884.873837:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007fdfc970.
00000100:00000001:28.0:1773851884.873838:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851884.873838:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000edcc54b1
00000100:00000001:5.0:1773851884.873838:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:28.0:1773851884.873839:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000010:6.0:1773851884.873839:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000edcc54b1.
00000100:00000200:5.0:1773851884.873839:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851884.873840:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:6.0:1773851884.873840:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:28.0:1773851884.873841:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:6.0:1773851884.873841:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851884.873841:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:28.0:1773851884.873842:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851884.873842:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851884.873843:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851884.873843:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851884.873844:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851884.873844:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Using peer 2098@kfi7(0x2000000000004bc)
00000100:00000001:5.0:1773851884.873846:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873847:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873847:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851884.873847:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851884.873848:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:5.0:1773851884.873848:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:4.0:1773851884.873848:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x2000000000004bc: rc=0
00000100:00000001:28.0:1773851884.873849:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851884.873850:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851884.873850:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851884.873850:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11a4 Transaction freed
00000800:00000200:5.0:1773851884.873850:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Transaction freed
00000800:00000200:4.0:1773851884.873850:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851884.873853:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.873853:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851884.873854:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851884.873856:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000100:00000001:4.0:1773851884.873856:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851884.873857:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d3aa665
00000100:00000001:4.0:1773851884.873857:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851884.873858:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d3aa665.
00000100:00000001:4.0:1773851884.873858:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.873859:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851884.873860:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:4.0:1773851884.873860:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000200:29.0:1773851884.873861:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851884.873861:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851884.873861:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851884.873865:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.873866:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851884.873866:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851884.873867:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851884.873868:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851884.873868:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851884.873870:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000400:00000200:6.0:1773851884.873871:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009607a9dc
00000400:00000010:6.0:1773851884.873871:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009607a9dc.
00000100:00000001:6.0:1773851884.873872:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851884.873873:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851884.873873:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851884.873874:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851884.873875:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:6.0:1773851884.873875:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851884.873876:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851884.873878:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2069@kfi7:7 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x64e Transaction freed
00000800:00000200:31.0:1773851884.873879:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:6.0:1773851884.873879:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851884.873880:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:6.0:1773851884.873880:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851884.873880:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:31.0:1773851884.873881:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851884.873882:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851884.873882:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851884.873882:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Transaction freed
00000800:00000200:9.0:1773851884.873884:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851884.873885:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851884.873888:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:9.0:1773851884.873889:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851884.873890:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:31.0:1773851884.873891:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851884.873892:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:31.0:1773851884.873893:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:31.0:1773851884.873894:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:25.0:1773851884.873894:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:31.0:1773851884.873895:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:25.0:1773851884.873895:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851884.873895:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:31.0:1773851884.873896:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:31.0:1773851884.873897:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851884.873897:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:25.0:1773851884.873898:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.873898:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:31.0:1773851884.873899:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5240
00000400:00000200:31.0:1773851884.873900:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851884.873901:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:31.0:1773851884.873902:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78008159d [1] + 224
00000800:00000200:25.0:1773851884.873902:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851884.873902:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:9.0:1773851884.873904:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:5.0:1773851884.873904:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:31.0:1773851884.873905:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851884.873906:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:9.0:1773851884.873906:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:5.0:1773851884.873906:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:31.0:1773851884.873907:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851884.873908:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000400:00000200:25.0:1773851884.873908:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:9.0:1773851884.873908:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5300
00000800:00000200:5.0:1773851884.873908:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851884.873910:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851884.873910:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:9.0:1773851884.873910:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000200:31.0:1773851884.873912:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851884.873912:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:9.0:1773851884.873913:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781698509 [1] + 224
00000800:00000200:5.0:1773851884.873913:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851884.873914:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.873915:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00000040:31.0:1773851884.873916:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851884.873916:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851884.873916:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851884.873917:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851884.873919:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:5.0:1773851884.873919:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:25.0:1773851884.873920:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5280
00000400:00000200:9.0:1773851884.873920:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851884.873921:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851884.873921:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851884.873922:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:5.0:1773851884.873922:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:31.0:1773851884.873923:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:25.0:1773851884.873923:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:9.0:1773851884.873924:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851884.873924:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851884.873924:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000800:00000200:31.0:1773851884.873925:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851884.873925:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f6aad [1] + 224
00000100:00000001:6.0:1773851884.873925:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851884.873925:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000200:9.0:1773851884.873926:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:6.0:1773851884.873927:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851884.873927:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851884.873927:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:25.0:1773851884.873929:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:6.0:1773851884.873929:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:5.0:1773851884.873929:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851884.873930:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009b8a7556
00000400:00000010:6.0:1773851884.873931:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009b8a7556.
00000400:00000200:5.0:1773851884.873931:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b52c0
00000400:00000200:25.0:1773851884.873932:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:9.0:1773851884.873932:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851884.873932:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851884.873933:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000200:6.0:1773851884.873934:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851884.873935:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00000400:00000200:5.0:1773851884.873935:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b31a25 [1] + 224
00000100:00000001:25.0:1773851884.873936:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851884.873939:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851884.873939:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:6.0:1773851884.873939:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851884.873939:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851884.873941:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:28.0:1773851884.873942:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851884.873942:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851884.873943:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851884.873943:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:25.0:1773851884.873944:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851884.873944:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851884.873944:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851884.873944:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000400:00000001:28.0:1773851884.873945:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:6.0:1773851884.873945:0:41067:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:5.0:1773851884.873945:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:28.0:1773851884.873946:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:6.0:1773851884.873946:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:28.0:1773851884.873947:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000001:6.0:1773851884.873947:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:5.0:1773851884.873947:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851884.873948:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000063d86a5d
00000100:00000001:6.0:1773851884.873948:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:28.0:1773851884.873949:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000063d86a5d.
02000000:00000001:6.0:1773851884.873949:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851884.873950:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=117 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851884.873951:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:25.0:1773851884.873951:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:6.0:1773851884.873952:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=117 v=66 (1 1 1 1)
00000100:00000200:28.0:1773851884.873953:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851884.873953:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00000040:5.0:1773851884.873953:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851884.873954:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851884.873954:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000800:00000200:25.0:1773851884.873955:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851884.873955:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851884.873955:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:7.0:1773851884.873956:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00010000:00000001:6.0:1773851884.873956:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000001:7.0:1773851884.873957:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:6.0:1773851884.873957:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851884.873958:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000100:00000001:6.0:1773851884.873958:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:28.0:1773851884.873959:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851884.873959:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000100:00000040:6.0:1773851884.873959:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:5.0:1773851884.873959:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:7.0:1773851884.873960:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:6.0:1773851884.873960:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:5.0:1773851884.873960:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:4.0:1773851884.873960:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851884.873960:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851884.873961:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:4.0:1773851884.873961:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:7.0:1773851884.873962:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:6.0:1773851884.873962:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:4.0:1773851884.873962:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851884.873962:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000100:00000200:7.0:1773851884.873963:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851884.873963:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000200:4.0:1773851884.873963:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7eb278
00000100:00000001:28.0:1773851884.873964:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851884.873964:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:4.0:1773851884.873964:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7eb278.
00000100:00000001:4.0:1773851884.873964:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851884.873966:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851884.873966:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:4.0:1773851884.873966:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851884.873967:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851884.873967:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851884.873968:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873968:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000200:7.0:1773851884.873969:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851884.873969:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:4.0:1773851884.873969:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:28.0:1773851884.873970:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851884.873970:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:28.0:1773851884.873971:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=117 v=66 (66 66 66 66)
00000004:00000040:6.0:1773851884.873971:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000100:00000001:4.0:1773851884.873972:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:28.0:1773851884.873973:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=117 v=66 (1 1 1 1)
00000004:00000040:6.0:1773851884.873973:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353563136 avail=351351192576 avail_mb=1372465596 hwm_mb=3131101 files=372083192 ffree=343118714 state=0: rc = 0
00000100:00000001:4.0:1773851884.873973:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851884.873974:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851884.873974:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.873974:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851884.873974:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851884.873975:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851884.873975:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:4.0:1773851884.873975:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851884.873976:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851884.873976:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000020:6.0:1773851884.873976:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353563136 free, 351351192576 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083192 files, 343118714 free files
00000100:00000001:4.0:1773851884.873976:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851884.873977:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851884.873977:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000001:4.0:1773851884.873977:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851884.873978:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.873978:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851884.873978:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=117 v=66 (66 66 66 66)
02000000:00000001:7.0:1773851884.873979:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851884.873979:0:41065:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=117 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851884.873980:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851884.873980:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00001000:7.0:1773851884.873980:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=143 v=66 (66 66 66 66)
00000100:00000001:4.0:1773851884.873980:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851884.873981:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851884.873981:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851884.873981:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851884.873982:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851884.873982:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=149 v=66 (1 1 1 1)
00000004:00000001:6.0:1773851884.873982:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851884.873982:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851884.873983:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851884.873983:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851884.873983:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000040:28.0:1773851884.873984:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851884.873984:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851884.873984:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851884.873985:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.873985:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851884.873986:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:4.0:1773851884.873986:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:7.0:1773851884.873987:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.873988:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:28.0:1773851884.873989:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:7.0:1773851884.873989:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00100000:6.0:1773851884.873989:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5ea564b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051935296:3@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851884.873989:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851884.873990:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851884.873990:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851884.873991:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851884.873991:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851884.873991:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.873991:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851884.873991:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851884.873992:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851884.873992:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:4.0:1773851884.873992:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33736000000 blocks, 31354645696 free, 31354610240 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064122 files, 2870603548 free files
00000004:00000001:28.0:1773851884.873993:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:6.0:1773851884.873993:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:28.0:1773851884.873994:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000100:00000040:6.0:1773851884.873994:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c5ea564b x1859433051935296/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:28.0:1773851884.873995:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510600704 avail=351508029440 avail_mb=1373078240 hwm_mb=3131103 files=372095697 ffree=343272071 state=0: rc = 0
00000004:00000001:4.0:1773851884.873995:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851884.873996:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851884.873998:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851884.873998:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000020:28.0:1773851884.873999:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510600704 free, 351508029440 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095697 files, 343272071 free files
00000100:00000001:7.0:1773851884.873999:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:6.0:1773851884.873999:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:4.0:1773851884.873999:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aed85170 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051935424:2098@kfi7:41:default-yuba2-0
00000100:00000001:7.0:1773851884.874000:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:6.0:1773851884.874000:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000050743369.
00000004:00000001:7.0:1773851884.874001:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851884.874001:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.874001:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:6.0:1773851884.874002:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:4.0:1773851884.874002:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000aed85170 x1859433051935424/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:7.0:1773851884.874003:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031808 blocks, 31536853184 free, 31536799104 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425444 files, 2779493163 free files
00000020:00000001:6.0:1773851884.874003:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851884.874003:0:41067:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000020:00000001:6.0:1773851884.874004:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851884.874005:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000097fed2c.
00000100:00000001:4.0:1773851884.874005:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851884.874005:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:7.0:1773851884.874006:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851884.874006:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000084a5b49f.
02000000:00000001:6.0:1773851884.874007:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851884.874007:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851884.874007:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:7.0:1773851884.874008:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:6.0:1773851884.874008:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851884.874008:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5ea564b.
00000020:00000040:4.0:1773851884.874008:0:41065:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000020:00000001:4.0:1773851884.874008:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851884.874009:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000030ba13a7.
00000100:00000001:6.0:1773851884.874010:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:4.0:1773851884.874010:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851884.874010:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:6.0:1773851884.874011:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851884.874011:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:4.0:1773851884.874011:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aed85170.
00000100:00000001:4.0:1773851884.874011:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851884.874012:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:7.0:1773851884.874013:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c40ba58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051935360:7@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851884.874013:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851884.874013:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.874013:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851884.874013:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851884.874014:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851884.874014:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.874014:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851884.874015:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851884.874015:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.874016:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851884.874017:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851884.874017:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851884.874018:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004c40ba58 x1859433051935360/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851884.874019:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851884.874022:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851884.874023:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:28.0:1773851884.874024:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051de97e6 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051935488:2080@kfi7:13:default-yuba2-0
02000000:00000010:7.0:1773851884.874024:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000067b7447a.
02000000:00000001:7.0:1773851884.874026:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:28.0:1773851884.874027:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851884.874027:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851884.874027:0:41064:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:28.0:1773851884.874028:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:7.0:1773851884.874029:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:28.0:1773851884.874030:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000051de97e6 x1859433051935488/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852037 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:7.0:1773851884.874030:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000de2ed169.
02000000:00000001:7.0:1773851884.874031:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851884.874032:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851884.874032:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004c40ba58.
00000100:00000001:28.0:1773851884.874034:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851884.874034:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851884.874034:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:28.0:1773851884.874035:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851884.874036:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000481ea804.
00000100:00000001:7.0:1773851884.874036:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851884.874037:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:28.0:1773851884.874038:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:7.0:1773851884.874038:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851884.874039:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:7.0:1773851884.874039:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851884.874039:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:28.0:1773851884.874040:0:41091:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000020:00000001:28.0:1773851884.874041:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851884.874042:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000008a71a94e.
02000000:00000001:28.0:1773851884.874043:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851884.874044:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851884.874044:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000051de97e6.
00000100:00000001:28.0:1773851884.874046:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851884.874047:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851884.874048:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851884.874049:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851884.874050:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851884.874051:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851884.874051:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851884.941700:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851884.941701:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851884.941703:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851884.941705:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851884.941707:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.941708:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851884.941709:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.941709:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851884.941710:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.941711:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851884.941712:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851884.941712:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851884.941713:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 224 into portal 12 MB=0x699e0e0342000
00000400:00000200:17.0:1773851884.941714:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2099@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 36016
00000800:00000200:17.0:1773851884.941716:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851884.941717:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.941718:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851884.941719:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851884.941719:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851884.941720:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f38700f7.
00000100:00000040:17.0:1773851884.941721:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f38700f7 x1858040973500416 msgsize 224
00000100:00100000:17.0:1773851884.941722:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-2099@kfi7 (source: 12345-2099@kfi7)
00000100:00000001:17.0:1773851884.941723:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851884.941724:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000100:00000001:16.0:1773851884.941724:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851884.941725:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851884.941725:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851884.941726:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851884.941729:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851884.941729:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851884.941730:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040973500416
00000020:00000001:16.0:1773851884.941740:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851884.941741:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9641c
00000020:00000001:16.0:1773851884.941741:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851884.941744:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000032097042 refcount=5
00000020:00000001:16.0:1773851884.941744:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636940277847040 : -107133431704576 : ffff9e900ddc1400)
00000020:00000001:16.0:1773851884.941745:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636940277847040 : -107133431704576 : ffff9e900ddc1400)
00000100:00000001:16.0:1773851884.941746:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.941747:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851884.941748:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851884.941748:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.941749:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851884.941750:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851884.941750:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851884.941751:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851884.941752:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851884.941752:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851884.941752:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.941753:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851884.941754:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851884.941755:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851884.941755:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851884.941755:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851884.941755:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2099@kfi7, seq: 2156393
00000100:00000001:17.0:1773851884.941756:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.941756:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000032097042 : new rpc_count 1
00000100:00000001:17.0:1773851884.941757:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.941757:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102228096 : -107041607323520 : ffff9ea56f04f080)
00000100:00000040:16.0:1773851884.941758:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f38700f7 x1858040973500416/t0(0) o400->lustre5-MDT0001-lwp-OST0018_UUID@2099@kfi7:136/0 lens 224/0 e 0 to 0 dl 1773852251 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba125-0'
00000100:00000001:16.0:1773851884.941760:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851884.941761:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851884.941762:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f38700f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:lustre5-MDT0001-lwp-OST0018_UUID+5:272672:x1858040973500416:12345-2099@kfi7:400:default-yuba125-0
00000100:00000200:16.0:1773851884.941763:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040973500416
00000020:00000001:16.0:1773851884.941764:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851884.941764:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851884.941765:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.941765:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851884.941766:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851884.941767:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:16.0:1773851884.941767:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851884.941768:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851884.941768:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851884.941769:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.941769:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851884.941770:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851884.941770:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851884.941771:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006734c829.
02000000:00000001:16.0:1773851884.941771:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.941772:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.941772:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851884.941773:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858040973500416
00010000:00000001:16.0:1773851884.941773:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851884.941774:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f38700f7 x1858040973500416/t0(0) o400->lustre5-MDT0001-lwp-OST0018_UUID@2099@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba125-0'
00010000:00000001:16.0:1773851884.941776:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851884.941777:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851884.941778:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=117 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851884.941779:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851884.941779:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000017c7746a refcount 7 to 2099@kfi7
00000100:00000001:16.0:1773851884.941780:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583961376 : -107156125590240 : ffff9e8ac532dd20)
02000000:00000001:16.0:1773851884.941781:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851884.941781:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851884.941782:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851884.941783:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:16.0:1773851884.941783:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a27f9aab.
00000100:00000200:16.0:1773851884.941784:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040973500416, offset 224
00000400:00000200:16.0:1773851884.941786:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:16.0:1773851884.941786:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.941787:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:16.0:1773851884.941788:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:16.0:1773851884.941789:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:16.0:1773851884.941790:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2099@kfi7 local destination
00000400:00000200:16.0:1773851884.941792:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769814:8769814:1024:4294967295] 2099@kfi7 LPNI seq info [5403434:5403434:16:4294967295]
00000400:00000200:16.0:1773851884.941794:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:16.0:1773851884.941794:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:16.0:1773851884.941797:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851884.941798:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:16.0:1773851884.941799:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851884.941800:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851884.941802:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851884.941804:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2c1 Using peer 2099@kfi7(0x2c1)
00000800:00000200:16.0:1773851884.941807:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 324 bytes to peer 0x2c1: rc=0
00000800:00000200:16.0:1773851884.941808:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851884.941810:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851884.941811:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000017c7746a refcount 6 to 2099@kfi7
00010000:00000001:16.0:1773851884.941811:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851884.941812:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851884.941812:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851884.941813:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f38700f7 x1858040973500416/t0(0) o400->lustre5-MDT0001-lwp-OST0018_UUID@2099@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba125-0'
00000100:00100000:16.0:1773851884.941817:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f38700f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:lustre5-MDT0001-lwp-OST0018_UUID+5:272672:x1858040973500416:12345-2099@kfi7:400:default-yuba125-0 Request processed in 56us (95us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851884.941819:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2099@kfi7, seq: 2156393
00000100:00000040:16.0:1773851884.941820:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000032097042 : new rpc_count 0
00000100:00000001:16.0:1773851884.941821:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851884.941821:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851884.941821:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851884.941822:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:16.0:1773851884.941825:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:16.0:1773851884.941825:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000032097042 : new refcount 4
00000100:00000001:16.0:1773851884.941826:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851884.941831:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2c1 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851884.941833:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851884.941834:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000400:00000200:17.0:1773851884.941835:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a27f9aab
00000400:00000010:17.0:1773851884.941835:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a27f9aab.
00000100:00000001:17.0:1773851884.941836:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851884.941836:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851884.941837:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851884.941839:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2069@kfi7:4 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x2c1 Transaction freed
00000800:00000200:25.0:1773851884.941973:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851884.941974:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851884.941975:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851884.941978:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851884.941980:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10768@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.941981:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10768@kfi7 : PUT - for me
00000400:00000200:25.0:1773851884.941982:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10768@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.941983:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d50d375 nid 10768@kfi7 refs 1
00000400:00000200:25.0:1773851884.941985:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10768@kfi7 to cpt 6
00000400:00000200:25.0:1773851884.941985:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d50d375 nid 10768@kfi7 refs 2
00000400:00000200:25.0:1773851884.941986:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007d50d375 nid 10768@kfi7 refs 3
00000400:00000200:25.0:1773851884.941987:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10961@kfi7 to cpt 3
00000400:00000200:25.0:1773851884.941988:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10961@kfi7 of length 224 into portal 12 MB=0x699e0fb5cf4c0
00000400:00000200:25.0:1773851884.941990:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10961@kfi7 of length 224/224 into md 0x16159c9699 [64] + 29504
00000800:00000200:25.0:1773851884.941992:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851884.941994:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851884.941995:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10768@kfi7: PUT: OK
00000100:00000001:25.0:1773851884.941996:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851884.941997:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851884.941998:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d1c409e7.
00000100:00000040:25.0:1773851884.941998:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000d1c409e7 x1858041429161152 msgsize 224
00000100:00100000:25.0:1773851884.942000:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-10961@kfi7 (source: 12345-10768@kfi7)
00000100:00000001:25.0:1773851884.942002:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851884.942002:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007d50d375 nid 10768@kfi7 refs 2
00000100:00000001:27.0:1773851884.942004:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851884.942004:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851884.942005:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851884.942006:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851884.942007:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851884.942008:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851884.942010:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041429161152
00000020:00000001:27.0:1773851884.942011:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851884.942011:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a1e
00000020:00000001:27.0:1773851884.942013:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851884.942015:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cd66db8b refcount=166
00000020:00000001:27.0:1773851884.942016:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242236928 : -107152467314688 : ffff9e8b9f3fb800)
00000020:00000001:27.0:1773851884.942017:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242236928 : -107152467314688 : ffff9e8b9f3fb800)
00000100:00000001:27.0:1773851884.942019:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851884.942020:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851884.942021:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000029e4ca65.
00000020:00000010:27.0:1773851884.942023:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851884.942024:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000094f466b7.
00000100:00000001:27.0:1773851884.942026:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851884.942026:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851884.942027:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.942029:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851884.942030:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851884.942030:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851884.942032:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851884.942034:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851884.942034:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851884.942034:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851884.942035:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851884.942036:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10961@kfi7, seq: 2025153
00000100:00000001:27.0:1773851884.942037:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851884.942037:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cd66db8b : new rpc_count 1
00000100:00000001:26.0:1773851884.942038:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252453504 : -106967457098112 : ffff9eb6b2b79680)
00000100:00000001:27.0:1773851884.942039:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851884.942039:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d1c409e7 x1858041429161152/t0(0) o400->446e9609-5858-4eca-9f24-d0cc50da9fa3@10961@kfi7:134/0 lens 224/0 e 0 to 0 dl 1773852249 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1169-0'
00000100:00000001:26.0:1773851884.942042:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851884.942043:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851884.942044:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d1c409e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:446e9609-5858-4eca-9f24-d0cc50da9fa3+166:39668:x1858041429161152:12345-10961@kfi7:400:default-tuolumne1169-0
00000100:00000200:26.0:1773851884.942046:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041429161152
00000020:00000001:26.0:1773851884.942047:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851884.942048:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851884.942049:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851884.942050:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851884.942051:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851884.942052:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851884.942052:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041429161152, found 0 last_xid 1858041428764991
00000020:00000001:26.0:1773851884.942053:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851884.942054:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851884.942055:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851884.942055:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851884.942056:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851884.942057:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851884.942057:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851884.942058:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f009aeee.
02000000:00000001:26.0:1773851884.942059:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851884.942060:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851884.942061:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851884.942062:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264063215, transno 0, xid 1858041429161152
00010000:00000001:26.0:1773851884.942063:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851884.942064:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d1c409e7 x1858041429161152/t0(0) o400->446e9609-5858-4eca-9f24-d0cc50da9fa3@10961@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1169-0'
00010000:00000001:26.0:1773851884.942067:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851884.942067:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851884.942068:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=117 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851884.942069:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851884.942070:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000070ef1428 refcount 3 to 10961@kfi7
00000100:00000001:26.0:1773851884.942071:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150208 : -107154898401408 : ffff9e8b0e584780)
02000000:00000001:26.0:1773851884.942072:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851884.942073:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851884.942073:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851884.942074:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10768@kfi7
00000400:00000010:26.0:1773851884.942075:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004b36f071.
00000100:00000200:26.0:1773851884.942077:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041429161152, offset 224
00000400:00000200:26.0:1773851884.942078:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10768@kfi7
00000400:00000200:26.0:1773851884.942079:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10768@kfi7 to cpt 6
00000400:00000200:26.0:1773851884.942080:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007d50d375 nid 10768@kfi7 refs 1
00000400:00000200:26.0:1773851884.942081:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007d50d375 nid 10768@kfi7 refs 2
00000400:00000200:26.0:1773851884.942082:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007d50d375 nid 10768@kfi7 refs 3
00000400:00000200:26.0:1773851884.942084:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10768@kfi7 local destination
00000400:00000200:26.0:1773851884.942085:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769815:8769815:1024:4294967295] 10768@kfi7 LPNI seq info [535940:535940:16:4294967295]
00000400:00000200:26.0:1773851884.942086:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007d50d375 nid 10768@kfi7 refs 2
00000400:00000200:26.0:1773851884.942087:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10768@kfi7 to cpt 6
00000400:00000200:26.0:1773851884.942089:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10768@kfi7(10768@kfi7:10768@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851884.942090:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007d50d375 nid 10768@kfi7 refs 3
00000800:00000200:26.0:1773851884.942092:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851884.942093:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851884.942095:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851884.942097:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x196 Using peer 10768@kfi7(0x196)
00000800:00000200:26.0:1773851884.942100:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 324 bytes to peer 0x196: rc=0
00000800:00000200:26.0:1773851884.942102:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x196 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851884.942104:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851884.942105:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000070ef1428 refcount 2 to 10961@kfi7
00010000:00000001:26.0:1773851884.942105:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851884.942106:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851884.942106:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851884.942107:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d1c409e7 x1858041429161152/t0(0) o400->446e9609-5858-4eca-9f24-d0cc50da9fa3@10961@kfi7:134/0 lens 224/224 e 0 to 0 dl 1773852249 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1169-0'
00000100:00100000:26.0:1773851884.942110:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d1c409e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:446e9609-5858-4eca-9f24-d0cc50da9fa3+166:39668:x1858041429161152:12345-10961@kfi7:400:default-tuolumne1169-0 Request processed in 67us (111us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851884.942113:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10961@kfi7, seq: 2025153
00000800:00000200:25.0:1773851884.942113:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x196 TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851884.942114:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cd66db8b : new rpc_count 0
00000100:00000001:26.0:1773851884.942114:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851884.942115:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851884.942115:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851884.942115:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10768@kfi7: PUT: OK
00000020:00000010:26.0:1773851884.942116:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:26.0:1773851884.942116:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000094f466b7.
00000400:00000200:25.0:1773851884.942116:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004b36f071
00000020:00000010:26.0:1773851884.942117:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000029e4ca65.
00000400:00000010:25.0:1773851884.942117:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004b36f071.
00000100:00000001:25.0:1773851884.942117:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:26.0:1773851884.942118:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000cd66db8b : new refcount 165
00000100:00000001:25.0:1773851884.942118:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:26.0:1773851884.942119:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851884.942119:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007d50d375 nid 10768@kfi7 refs 2
00000800:00000200:25.0:1773851884.942120:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 10768@kfi7(00000000d644bd2a):0x0 lsk 407 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x196 Transaction freed
00000800:00000200:29.0:1773851884.945863:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.945864:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851884.945865:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851884.945867:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851884.945869:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15507@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.945871:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15507@kfi7 : PUT - for me
00000400:00000200:29.0:1773851884.945872:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15507@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.945873:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e084344 nid 15507@kfi7 refs 1
00000400:00000200:29.0:1773851884.945874:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15507@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.945875:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e084344 nid 15507@kfi7 refs 2
00000400:00000200:29.0:1773851884.945876:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008e084344 nid 15507@kfi7 refs 3
00000400:00000200:29.0:1773851884.945877:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15442@kfi7 to cpt 0
00000400:00000200:29.0:1773851884.945878:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15442@kfi7 of length 224 into portal 12 MB=0x69b4b55b5d900
00000400:00000200:29.0:1773851884.945879:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15442@kfi7 of length 224/224 into md 0x77fe139dd [64] + 193072
00000800:00000200:29.0:1773851884.945881:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851884.945883:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851884.945884:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15507@kfi7: PUT: OK
00000100:00000001:29.0:1773851884.945885:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851884.945885:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851884.945887:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3afdabf.
00000100:00000040:29.0:1773851884.945888:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000e3afdabf x1859597723097344 msgsize 224
00000100:00100000:29.0:1773851884.945889:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15442@kfi7 (source: 12345-15507@kfi7)
00000100:00000001:29.0:1773851884.945891:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851884.945892:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008e084344 nid 15507@kfi7 refs 2
00000800:00000200:29.0:1773851884.945893:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851884.945896:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851884.945896:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851884.945897:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851884.945897:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851884.945898:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851884.945899:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597723097344
00000020:00000001:29.0:1773851884.945899:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851884.945900:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80924
00000020:00000001:29.0:1773851884.945900:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851884.945902:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000bf4e6bd refcount=5
00000020:00000001:29.0:1773851884.945903:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134494411776 : -106939215139840 : ffff9ebd4611ac00)
00000020:00000001:29.0:1773851884.945904:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134494411776 : -106939215139840 : ffff9ebd4611ac00)
00000100:00000001:29.0:1773851884.945905:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.945906:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851884.945906:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851884.945907:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851884.945908:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851884.945909:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851884.945910:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851884.945910:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851884.945912:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851884.945912:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851884.945913:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.945914:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851884.945915:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851884.945915:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851884.945916:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15442@kfi7, seq: 2055568
00000100:00000001:30.0:1773851884.945917:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851884.945917:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:29.0:1773851884.945917:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000bf4e6bd : new rpc_count 1
00000100:00000001:30.0:1773851884.945918:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.945918:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262223616 : -106943447328000 : ffff9ebc49cf9b00)
00000100:00000001:30.0:1773851884.945920:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851884.945920:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3afdabf x1859597723097344/t0(0) o400->6db2e439-b90e-4806-a000-4842946d3536@15442@kfi7:672/0 lens 224/0 e 0 to 0 dl 1773852032 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1462-0'
00000100:00000001:29.0:1773851884.945923:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851884.945923:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851884.945924:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3afdabf pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:6db2e439-b90e-4806-a000-4842946d3536+5:39566:x1859597723097344:12345-15442@kfi7:400:default-tuolumne1462-0
00000100:00000200:29.0:1773851884.945925:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597723097344
00000020:00000001:29.0:1773851884.945926:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851884.945927:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851884.945928:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.945928:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851884.945929:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851884.945930:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851884.945930:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597723097344, found 0 last_xid 1859597723097343
00000020:00000001:29.0:1773851884.945931:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851884.945932:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851884.945933:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851884.945933:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.945934:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851884.945935:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851884.945935:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851884.945936:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2d18ae5.
02000000:00000001:29.0:1773851884.945937:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.945938:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.945938:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851884.945939:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413766788, transno 0, xid 1859597723097344
00010000:00000001:29.0:1773851884.945940:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851884.945941:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3afdabf x1859597723097344/t0(0) o400->6db2e439-b90e-4806-a000-4842946d3536@15442@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1462-0'
00010000:00000001:29.0:1773851884.945944:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851884.945944:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851884.945945:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=117 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851884.945946:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851884.945947:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008a2c39db refcount 3 to 15442@kfi7
00000100:00000001:29.0:1773851884.945948:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545857632 : -107154163693984 : ffff9e8b3a230660)
02000000:00000001:29.0:1773851884.945949:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851884.945949:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851884.945950:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851884.945951:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15507@kfi7
00000400:00000010:29.0:1773851884.945952:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dee493e9.
00000100:00000200:29.0:1773851884.945953:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597723097344, offset 224
00000400:00000200:29.0:1773851884.945955:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15507@kfi7
00000400:00000200:29.0:1773851884.945955:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15507@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.945956:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e084344 nid 15507@kfi7 refs 1
00000400:00000200:29.0:1773851884.945958:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008e084344 nid 15507@kfi7 refs 2
00000400:00000200:29.0:1773851884.945959:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008e084344 nid 15507@kfi7 refs 3
00000400:00000200:29.0:1773851884.945960:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15507@kfi7 local destination
00000400:00000200:29.0:1773851884.945962:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769816:8769816:1024:4294967295] 15507@kfi7 LPNI seq info [259967:259967:16:4294967295]
00000400:00000200:29.0:1773851884.945963:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008e084344 nid 15507@kfi7 refs 2
00000400:00000200:29.0:1773851884.945964:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15507@kfi7 to cpt 7
00000400:00000200:29.0:1773851884.945966:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15507@kfi7(15507@kfi7:15507@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851884.945967:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008e084344 nid 15507@kfi7 refs 3
00000800:00000200:29.0:1773851884.945969:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851884.945970:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851884.945975:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851884.945978:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf4b Using peer 15507@kfi7(0xf4b)
00000800:00000200:29.0:1773851884.945981:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0xf4b: rc=0
00000800:00000200:29.0:1773851884.945983:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf4b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851884.945985:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851884.945986:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008a2c39db refcount 2 to 15442@kfi7
00010000:00000001:29.0:1773851884.945987:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851884.945987:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851884.945988:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851884.945989:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3afdabf x1859597723097344/t0(0) o400->6db2e439-b90e-4806-a000-4842946d3536@15442@kfi7:672/0 lens 224/224 e 0 to 0 dl 1773852032 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1462-0'
00000100:00100000:29.0:1773851884.945993:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3afdabf pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:6db2e439-b90e-4806-a000-4842946d3536+5:39566:x1859597723097344:12345-15442@kfi7:400:default-tuolumne1462-0 Request processed in 69us (104us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851884.945996:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15442@kfi7, seq: 2055568
00000100:00000040:29.0:1773851884.945996:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000bf4e6bd : new rpc_count 0
00000800:00000200:30.0:1773851884.945997:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf4b TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851884.945997:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851884.945998:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851884.945998:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851884.945999:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851884.945999:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000200:30.0:1773851884.946000:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15507@kfi7: PUT: OK
00000020:00000010:29.0:1773851884.946000:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000400:00000200:30.0:1773851884.946001:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dee493e9
00000020:00000040:29.0:1773851884.946001:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000000bf4e6bd : new refcount 4
00000400:00000010:30.0:1773851884.946002:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dee493e9.
00000100:00000001:29.0:1773851884.946002:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851884.946003:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851884.946003:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851884.946004:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008e084344 nid 15507@kfi7 refs 2
00000800:00000200:30.0:1773851884.946006:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 15507@kfi7(000000009afd3781):0x0 lsk 3916 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf4b Transaction freed
00000800:00000200:13.0:1773851885.010109:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851885.010110:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851885.010111:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851885.010113:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851885.010115:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10131@kfi7 to cpt 3
00000400:00000200:13.0:1773851885.010116:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10131@kfi7 : PUT - for me
00000400:00000200:13.0:1773851885.010116:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10131@kfi7 to cpt 3
00000400:00000200:13.0:1773851885.010117:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcd9123a nid 10131@kfi7 refs 1
00000400:00000200:13.0:1773851885.010118:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10131@kfi7 to cpt 3
00000400:00000200:13.0:1773851885.010119:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcd9123a nid 10131@kfi7 refs 2
00000400:00000200:13.0:1773851885.010120:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dcd9123a nid 10131@kfi7 refs 3
00000400:00000200:13.0:1773851885.010120:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10131@kfi7 to cpt 3
00000400:00000200:13.0:1773851885.010121:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10131@kfi7 of length 224 into portal 12 MB=0x69b90d20a4dc0
00000400:00000200:13.0:1773851885.010122:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10131@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 44016
00000800:00000200:13.0:1773851885.010125:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851885.010126:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851885.010127:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10131@kfi7: PUT: OK
00000100:00000001:13.0:1773851885.010128:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851885.010129:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851885.010130:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000edb7bcdf.
00000100:00000040:13.0:1773851885.010131:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000edb7bcdf x1859896161750464 msgsize 224
00000100:00100000:13.0:1773851885.010134:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10131@kfi7 (source: 12345-10131@kfi7)
00000100:00000001:13.0:1773851885.010135:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851885.010137:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcd9123a nid 10131@kfi7 refs 2
00000100:00000001:15.0:1773851885.010138:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851885.010139:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851885.010139:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851885.010139:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851885.010140:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851885.010142:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851885.010143:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859896161750464
00000020:00000001:15.0:1773851885.010144:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851885.010145:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08ac0b3d235
00000020:00000001:15.0:1773851885.010146:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851885.010151:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a31067d4 refcount=5
00000020:00000001:15.0:1773851885.010152:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637006988442624 : -107066721108992 : ffff9e9f961efc00)
00000020:00000001:15.0:1773851885.010154:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637006988442624 : -107066721108992 : ffff9e9f961efc00)
00000100:00000001:15.0:1773851885.010155:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851885.010156:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851885.010158:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000c5e8003.
00000020:00000010:15.0:1773851885.010159:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851885.010161:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dc4c326c.
00000100:00000001:15.0:1773851885.010163:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851885.010163:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851885.010164:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851885.010166:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851885.010181:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851885.010181:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851885.010183:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851885.010184:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851885.010185:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851885.010185:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851885.010185:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851885.010186:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10131@kfi7, seq: 2289889
00000100:00000001:15.0:1773851885.010187:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851885.010187:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a31067d4 : new rpc_count 1
00000100:00000001:15.0:1773851885.010188:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851885.010188:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902256000 : -106994807295616 : ffff9eb05484b180)
00000100:00000040:12.0:1773851885.010189:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000edb7bcdf x1859896161750464/t0(0) o400->618779ff-01b3-48a8-94ed-a16cbe3c873b@10131@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1126-0'
00000100:00000001:12.0:1773851885.010192:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851885.010192:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851885.010193:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000edb7bcdf pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:618779ff-01b3-48a8-94ed-a16cbe3c873b+5:39501:x1859896161750464:12345-10131@kfi7:400:default-tuolumne1126-0
00000100:00000200:12.0:1773851885.010194:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859896161750464
00000020:00000001:12.0:1773851885.010195:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851885.010195:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851885.010196:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.010197:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851885.010197:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851885.010198:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851885.010198:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859896161750464, found 0 last_xid 1859896161750463
00000020:00000001:12.0:1773851885.010199:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851885.010200:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851885.010200:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851885.010201:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.010201:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851885.010202:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851885.010202:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851885.010203:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f473717f.
02000000:00000001:12.0:1773851885.010204:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851885.010204:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.010205:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851885.010206:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859896161750464
00010000:00000001:12.0:1773851885.010207:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851885.010208:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000edb7bcdf x1859896161750464/t0(0) o400->618779ff-01b3-48a8-94ed-a16cbe3c873b@10131@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1126-0'
00010000:00000001:12.0:1773851885.010211:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851885.010211:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851885.010212:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=118 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851885.010213:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851885.010214:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000deb439b6 refcount 3 to 10131@kfi7
00000100:00000001:12.0:1773851885.010215:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154624 : -107139310396992 : ffff9e8eaf7659c0)
02000000:00000001:12.0:1773851885.010216:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851885.010217:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851885.010217:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851885.010218:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10131@kfi7
00000400:00000010:12.0:1773851885.010219:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e9ba439.
00000100:00000200:12.0:1773851885.010220:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859896161750464, offset 224
00000400:00000200:12.0:1773851885.010222:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10131@kfi7
00000400:00000200:12.0:1773851885.010223:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10131@kfi7 to cpt 3
00000400:00000200:12.0:1773851885.010224:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcd9123a nid 10131@kfi7 refs 1
00000400:00000200:12.0:1773851885.010225:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dcd9123a nid 10131@kfi7 refs 2
00000400:00000200:12.0:1773851885.010227:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dcd9123a nid 10131@kfi7 refs 3
00000400:00000200:12.0:1773851885.010228:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10131@kfi7 local destination
00000400:00000200:12.0:1773851885.010230:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769817:8769817:1024:4294967295] 10131@kfi7 LPNI seq info [201520:201520:16:4294967295]
00000400:00000200:12.0:1773851885.010231:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dcd9123a nid 10131@kfi7 refs 2
00000400:00000200:12.0:1773851885.010232:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10131@kfi7 to cpt 3
00000400:00000200:12.0:1773851885.010234:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10131@kfi7(10131@kfi7:10131@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851885.010235:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dcd9123a nid 10131@kfi7 refs 3
00000800:00000200:12.0:1773851885.010237:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851885.010238:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851885.010240:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851885.010242:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000e9 Using peer 10131@kfi7(0x1000000000000e9)
00000800:00000200:12.0:1773851885.010246:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0x1000000000000e9: rc=0
00000800:00000200:12.0:1773851885.010247:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000e9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851885.010250:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851885.010251:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000deb439b6 refcount 2 to 10131@kfi7
00010000:00000001:12.0:1773851885.010252:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851885.010252:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.010253:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851885.010254:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000edb7bcdf x1859896161750464/t0(0) o400->618779ff-01b3-48a8-94ed-a16cbe3c873b@10131@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1126-0'
00000100:00100000:12.0:1773851885.010258:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000edb7bcdf pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:618779ff-01b3-48a8-94ed-a16cbe3c873b+5:39501:x1859896161750464:12345-10131@kfi7:400:default-tuolumne1126-0 Request processed in 66us (126us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851885.010261:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10131@kfi7, seq: 2289889
00000100:00000040:12.0:1773851885.010262:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a31067d4 : new rpc_count 0
00000100:00000001:12.0:1773851885.010263:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851885.010263:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851885.010264:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851885.010265:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dc4c326c.
00000020:00000010:12.0:1773851885.010266:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000c5e8003.
00000020:00000040:12.0:1773851885.010266:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000a31067d4 : new refcount 4
00000100:00000001:12.0:1773851885.010267:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851885.010273:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000e9 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851885.010275:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851885.010276:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10131@kfi7: PUT: OK
00000400:00000200:14.0:1773851885.010277:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e9ba439
00000400:00000010:14.0:1773851885.010277:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e9ba439.
00000100:00000001:14.0:1773851885.010278:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851885.010279:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851885.010280:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcd9123a nid 10131@kfi7 refs 2
00000800:00000200:14.0:1773851885.010282:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 10131@kfi7(000000009f325216):0x0 lsk 234 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000000e9 Transaction freed
00000800:00000200:30.0:1773851885.131049:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851885.131049:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851885.131050:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851885.131051:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851885.131051:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851885.131052:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851885.131053:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20099@kfi7(00000000edac6f37):0xd75 version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851885.131055:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851885.131056:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 Using peer 20099@kfi7(0xd75)
00000400:00000200:30.0:1773851885.131057:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20099@kfi7 to cpt 7
00000400:00000200:30.0:1773851885.131058:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20099@kfi7 : PUT - for me
00000400:00000200:29.0:1773851885.131058:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20099@kfi7 to cpt 7
00000400:00000200:30.0:1773851885.131059:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20099@kfi7 to cpt 7
00000400:00000200:30.0:1773851885.131060:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f68a090 nid 20099@kfi7 refs 1
00000800:00000200:29.0:1773851885.131060:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 38 bytes to peer 0xd75: rc=0
00000800:00000200:29.0:1773851885.131061:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851885.131062:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20099@kfi7 to cpt 7
00000400:00000200:30.0:1773851885.131062:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f68a090 nid 20099@kfi7 refs 2
00000400:00000200:30.0:1773851885.131063:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005f68a090 nid 20099@kfi7 refs 3
00000400:00000200:30.0:1773851885.131064:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20035@kfi7 to cpt 3
00000400:00000200:30.0:1773851885.131065:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20035@kfi7 of length 456 into portal 12 MB=0x69b4b9f0ff040
00000400:00000200:30.0:1773851885.131067:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20035@kfi7 of length 456/456 into md 0x77fe139dd [64] + 193296
00000800:00000200:30.0:1773851885.131069:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851885.131071:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851885.131072:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20099@kfi7: PUT: OK
00000100:00000001:30.0:1773851885.131073:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:29.0:1773851885.131073:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 TN_EVENT_TX_OK event status 0
00000100:00000200:30.0:1773851885.131074:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851885.131074:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005474ef7d.
00000100:00000040:30.0:1773851885.131075:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000005474ef7d x1859598953738304 msgsize 456
00000800:00000200:29.0:1773851885.131075:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 Transaction freed
00000100:00100000:30.0:1773851885.131077:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-20035@kfi7 (source: 12345-20099@kfi7)
00000100:00000001:30.0:1773851885.131078:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851885.131079:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005f68a090 nid 20099@kfi7 refs 2
00000800:00000200:30.0:1773851885.131080:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fd057322: 2069@kfi7:7 <- 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851885.131080:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851885.131080:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851885.131081:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851885.131081:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851885.131082:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851885.131083:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598953738304
00000020:00000001:29.0:1773851885.131084:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851885.131084:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2438c318
00000020:00000001:29.0:1773851885.131085:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851885.131088:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bc0c213 refcount=3083
00000020:00000001:29.0:1773851885.131088:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098492729344 : -106975216822272 : ffff9eb4e4339800)
00000020:00000001:29.0:1773851885.131089:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098492729344 : -106975216822272 : ffff9eb4e4339800)
00000100:00000001:29.0:1773851885.131090:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851885.131091:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851885.131092:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851885.131093:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851885.131094:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851885.131095:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851885.131095:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851885.131096:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.131097:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.131098:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851885.131099:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851885.131100:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851885.131100:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851885.131100:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851885.131101:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20035@kfi7, seq: 364304984
00000100:00000001:30.0:1773851885.131102:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851885.131102:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bc0c213 : new rpc_count 8
00000100:00000001:30.0:1773851885.131103:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.131103:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411256064 : -106960298295552 : ffff9eb85d6a3f00)
00000100:00000040:29.0:1773851885.131104:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005474ef7d x1859598953738304/t0(0) o17->84194c2b-5abd-4f3b-8780-4114522f643e@20035@kfi7:612/0 lens 456/0 e 0 to 0 dl 1773851972 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1752-0'
00000100:00000001:29.0:1773851885.131107:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851885.131107:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851885.131108:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005474ef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:84194c2b-5abd-4f3b-8780-4114522f643e+3083:39706:x1859598953738304:12345-20035@kfi7:17:default-tuolumne1752-0
00000100:00000200:29.0:1773851885.131110:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598953738304
00000020:00000001:29.0:1773851885.131111:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851885.131112:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851885.131112:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.131113:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851885.131114:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:29.0:1773851885.131114:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851885.131115:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598953738304, found 0 last_xid 1859598953024191
00000020:00000001:29.0:1773851885.131116:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851885.131117:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851885.131117:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851885.131118:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851885.131119:0:60533:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:29.0:1773851885.131120:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851885.131120:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851885.131121:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000098ed3885.
02000000:00000001:29.0:1773851885.131122:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.131123:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.131124:0:60533:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:29.0:1773851885.131124:0:60533:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:29.0:1773851885.131125:0:60533:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:29.0:1773851885.131126:0:60533:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.131127:0:60533:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:29.0:1773851885.131128:0:60533:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 84194c2b-5abd-4f3b-8780-4114522f643e/000000005bc0c213 free: 126633370845184 avail: 126633368748032
00000020:00000001:29.0:1773851885.131129:0:60533:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:29.0:1773851885.131130:0:60533:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 84194c2b-5abd-4f3b-8780-4114522f643e/000000005bc0c213 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:29.0:1773851885.131131:0:60533:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:29.0:1773851885.131132:0:60533:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:29.0:1773851885.131133:0:60533:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 84194c2b-5abd-4f3b-8780-4114522f643e/000000005bc0c213 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:29.0:1773851885.131134:0:60533:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:29.0:1773851885.131134:0:60533:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:29.0:1773851885.131135:0:60533:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851885.131136:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588994, transno 0, xid 1859598953738304
00010000:00000001:29.0:1773851885.131136:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851885.131137:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005474ef7d x1859598953738304/t0(0) o17->84194c2b-5abd-4f3b-8780-4114522f643e@20035@kfi7:612/0 lens 456/432 e 0 to 0 dl 1773851972 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1752-0'
00010000:00000001:29.0:1773851885.131140:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851885.131140:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851885.131141:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=118 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851885.131142:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851885.131143:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e0a70026 refcount 3 to 20035@kfi7
00000100:00000001:29.0:1773851885.131144:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155392 : -107139310396224 : ffff9e8eaf765cc0)
02000000:00000001:29.0:1773851885.131144:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851885.131145:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.131146:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851885.131147:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20099@kfi7
00000400:00000010:29.0:1773851885.131147:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f6d59d8b.
00000100:00000200:29.0:1773851885.131148:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598953738304, offset 224
00000400:00000200:29.0:1773851885.131150:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20099@kfi7
00000400:00000200:29.0:1773851885.131151:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20099@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.131151:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005f68a090 nid 20099@kfi7 refs 1
00000400:00000200:29.0:1773851885.131152:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005f68a090 nid 20099@kfi7 refs 2
00000400:00000200:29.0:1773851885.131154:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005f68a090 nid 20099@kfi7 refs 3
00000400:00000200:29.0:1773851885.131155:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20099@kfi7 local destination
00000400:00000200:29.0:1773851885.131156:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769818:8769818:1024:4294967295] 20099@kfi7 LPNI seq info [13001239:13001239:16:4294967295]
00000400:00000200:29.0:1773851885.131161:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005f68a090 nid 20099@kfi7 refs 2
00000400:00000200:29.0:1773851885.131161:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20099@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.131163:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20099@kfi7(20099@kfi7:20099@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851885.131164:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005f68a090 nid 20099@kfi7 refs 3
00000800:00000200:29.0:1773851885.131166:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851885.131167:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:29.0:1773851885.131169:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851885.131171:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 Using peer 20099@kfi7(0xd75)
00000800:00000200:29.0:1773851885.131174:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 532 bytes to peer 0xd75: rc=0
00000800:00000200:29.0:1773851885.131175:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851885.131177:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851885.131178:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e0a70026 refcount 2 to 20035@kfi7
00010000:00000001:29.0:1773851885.131179:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851885.131179:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.131180:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851885.131180:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005474ef7d x1859598953738304/t0(0) o17->84194c2b-5abd-4f3b-8780-4114522f643e@20035@kfi7:612/0 lens 456/432 e 0 to 0 dl 1773851972 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1752-0'
00000100:00100000:29.0:1773851885.131183:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005474ef7d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:84194c2b-5abd-4f3b-8780-4114522f643e+3083:39706:x1859598953738304:12345-20035@kfi7:17:default-tuolumne1752-0 Request processed in 76us (107us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851885.131186:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20035@kfi7, seq: 364304984
00000800:00000200:30.0:1773851885.131187:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 TN_EVENT_TX_OK event status 0
00000100:00000040:29.0:1773851885.131187:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bc0c213 : new rpc_count 7
00000100:00000001:29.0:1773851885.131187:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851885.131188:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851885.131188:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851885.131189:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851885.131189:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000200:30.0:1773851885.131190:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20099@kfi7: PUT: OK
00000400:00000200:30.0:1773851885.131190:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f6d59d8b
00000020:00000010:29.0:1773851885.131190:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000400:00000010:30.0:1773851885.131191:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f6d59d8b.
00000020:00000040:29.0:1773851885.131191:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000005bc0c213 : new refcount 3082
00000100:00000001:30.0:1773851885.131192:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851885.131192:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:29.0:1773851885.131192:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851885.131193:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005f68a090 nid 20099@kfi7 refs 2
00000800:00000200:30.0:1773851885.131194:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2069@kfi7:7 -> 20099@kfi7(00000000edac6f37):0x0 lsk 3446 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0xd75 Transaction freed
00000800:00000200:21.0:1773851885.132336:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851885.132337:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851885.132338:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851885.132340:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851885.132342:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15153@kfi7 to cpt 5
00000400:00000200:21.0:1773851885.132343:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15153@kfi7 : PUT - for me
00000400:00000200:21.0:1773851885.132344:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15153@kfi7 to cpt 5
00000400:00000200:21.0:1773851885.132345:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 1
00000400:00000200:21.0:1773851885.132346:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15153@kfi7 to cpt 5
00000400:00000200:21.0:1773851885.132347:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 2
00000400:00000200:21.0:1773851885.132348:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 3
00000400:00000200:21.0:1773851885.132349:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15152@kfi7 to cpt 2
00000400:00000200:21.0:1773851885.132350:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15152@kfi7 of length 224 into portal 12 MB=0x69b473e9bbb40
00000400:00000200:21.0:1773851885.132352:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15152@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 53496
00000800:00000200:21.0:1773851885.132353:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851885.132355:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851885.132356:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15153@kfi7: PUT: OK
00000100:00000001:21.0:1773851885.132357:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851885.132357:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851885.132358:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000050773b4d.
00000100:00000040:21.0:1773851885.132359:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000050773b4d x1859580155640640 msgsize 224
00000100:00100000:21.0:1773851885.132360:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15152@kfi7 (source: 12345-15153@kfi7)
00000100:00000001:21.0:1773851885.132361:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851885.132362:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 2
00000100:00000001:23.0:1773851885.132363:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851885.132363:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851885.132364:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851885.132364:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851885.132365:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851885.132365:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851885.132366:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580155640640
00000020:00000001:23.0:1773851885.132367:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851885.132367:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddd08a2fd
00000020:00000001:23.0:1773851885.132368:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851885.132371:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f7172cfd refcount=5
00000020:00000001:23.0:1773851885.132372:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110979929088 : -106962729622528 : ffff9eb7cc7f2400)
00000020:00000001:23.0:1773851885.132373:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110979929088 : -106962729622528 : ffff9eb7cc7f2400)
00000100:00000001:23.0:1773851885.132374:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851885.132375:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851885.132376:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ed998973.
00000020:00000010:23.0:1773851885.132377:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851885.132378:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851885.132379:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851885.132379:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851885.132380:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851885.132381:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851885.132381:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851885.132382:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851885.132383:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851885.132384:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851885.132384:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851885.132385:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851885.132385:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851885.132386:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15152@kfi7, seq: 1998035
00000100:00000040:23.0:1773851885.132387:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f7172cfd : new rpc_count 1
00000100:00000001:23.0:1773851885.132387:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956253440 : -106937753298176 : ffff9ebd9d339b00)
00000100:00000001:20.0:1773851885.132387:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851885.132387:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851885.132389:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000050773b4d x1859580155640640/t0(0) o400->b8062759-57cb-4ea7-8462-b42e4b5edc7d@15152@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1437-0'
00000100:00000001:23.0:1773851885.132392:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851885.132392:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851885.132394:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050773b4d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b8062759-57cb-4ea7-8462-b42e4b5edc7d+5:39687:x1859580155640640:12345-15152@kfi7:400:default-tuolumne1437-0
00000100:00000200:23.0:1773851885.132395:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580155640640
00000020:00000001:23.0:1773851885.132396:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851885.132396:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851885.132397:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.132398:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851885.132398:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851885.132399:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851885.132400:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580155640640, found 0 last_xid 1859580155640639
00000020:00000001:23.0:1773851885.132400:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851885.132401:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851885.132402:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851885.132402:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.132403:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851885.132403:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851885.132404:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851885.132405:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006c66711c.
02000000:00000001:23.0:1773851885.132405:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851885.132406:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.132407:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851885.132407:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255655020, transno 0, xid 1859580155640640
00010000:00000001:23.0:1773851885.132408:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851885.132409:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000050773b4d x1859580155640640/t0(0) o400->b8062759-57cb-4ea7-8462-b42e4b5edc7d@15152@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1437-0'
00010000:00000001:23.0:1773851885.132411:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851885.132412:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851885.132413:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=118 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851885.132414:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851885.132415:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000092787291 refcount 3 to 15152@kfi7
00000100:00000001:23.0:1773851885.132415:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810486560 : -107154899065056 : ffff9e8b0e4e2720)
02000000:00000001:23.0:1773851885.132416:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851885.132417:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851885.132418:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851885.132419:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15153@kfi7
00000400:00000010:23.0:1773851885.132419:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d767c6.
00000100:00000200:23.0:1773851885.132420:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580155640640, offset 224
00000400:00000200:23.0:1773851885.132421:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15153@kfi7
00000400:00000200:23.0:1773851885.132422:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15153@kfi7 to cpt 5
00000400:00000200:23.0:1773851885.132423:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 1
00000400:00000200:23.0:1773851885.132424:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 2
00000400:00000200:23.0:1773851885.132425:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 3
00000400:00000200:23.0:1773851885.132426:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15153@kfi7 local destination
00000400:00000200:23.0:1773851885.132428:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769819:8769819:1024:4294967295] 15153@kfi7 LPNI seq info [922620:922620:16:4294967295]
00000400:00000200:23.0:1773851885.132429:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 2
00000400:00000200:23.0:1773851885.132430:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15153@kfi7 to cpt 5
00000400:00000200:23.0:1773851885.132432:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15153@kfi7(15153@kfi7:15153@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851885.132433:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 3
00000800:00000200:23.0:1773851885.132434:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851885.132435:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851885.132438:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851885.132440:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e22 Using peer 15153@kfi7(0x100000000000e22)
00000800:00000200:23.0:1773851885.132443:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x100000000000e22: rc=0
00000800:00000200:23.0:1773851885.132444:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e22 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851885.132447:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851885.132448:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000092787291 refcount 2 to 15152@kfi7
00010000:00000001:23.0:1773851885.132448:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851885.132449:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.132449:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851885.132450:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000050773b4d x1859580155640640/t0(0) o400->b8062759-57cb-4ea7-8462-b42e4b5edc7d@15152@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1437-0'
00000800:00000200:21.0:1773851885.132455:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e22 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851885.132456:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050773b4d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b8062759-57cb-4ea7-8462-b42e4b5edc7d+5:39687:x1859580155640640:12345-15152@kfi7:400:default-tuolumne1437-0 Request processed in 64us (97us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851885.132456:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851885.132457:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15153@kfi7: PUT: OK
00000400:00000200:21.0:1773851885.132458:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d767c6
00000100:00100000:23.0:1773851885.132459:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15152@kfi7, seq: 1998035
00000400:00000010:21.0:1773851885.132459:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d767c6.
00000100:00000001:21.0:1773851885.132459:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000040:23.0:1773851885.132460:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f7172cfd : new rpc_count 0
00000100:00000001:21.0:1773851885.132460:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851885.132461:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851885.132461:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b3c8a6e1 nid 15153@kfi7 refs 2
00000100:00000001:23.0:1773851885.132462:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851885.132462:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000800:00000200:21.0:1773851885.132462:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 15153@kfi7(0000000044d7a347):0x0 lsk 3619 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e22 Transaction freed
00000020:00000010:23.0:1773851885.132463:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:23.0:1773851885.132464:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ed998973.
00000020:00000040:23.0:1773851885.132464:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000f7172cfd : new refcount 4
00000100:00000001:23.0:1773851885.132465:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851885.284837:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851885.284839:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851885.284841:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851885.284844:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851885.284848:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24643@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.284850:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24643@kfi7 : PUT - for me
00000400:00000200:17.0:1773851885.284851:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24643@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.284852:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2d85667 nid 24643@kfi7 refs 1
00000400:00000200:17.0:1773851885.284854:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24643@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.284855:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2d85667 nid 24643@kfi7 refs 2
00000400:00000200:17.0:1773851885.284856:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d2d85667 nid 24643@kfi7 refs 3
00000400:00000200:17.0:1773851885.284858:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24706@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.284859:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24706@kfi7 of length 224 into portal 12 MB=0x699e116050a00
00000400:00000200:17.0:1773851885.284861:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24706@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 36240
00000800:00000200:17.0:1773851885.284864:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851885.284867:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851885.284868:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24643@kfi7: PUT: OK
00000100:00000001:17.0:1773851885.284870:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851885.284870:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851885.284873:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000922a8b42.
00000100:00000040:17.0:1773851885.284874:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000922a8b42 x1858041876384256 msgsize 224
00000100:00100000:17.0:1773851885.284876:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-24706@kfi7 (source: 12345-24643@kfi7)
00000100:00000001:17.0:1773851885.284878:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851885.284879:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d2d85667 nid 24643@kfi7 refs 2
00000800:00000200:17.0:1773851885.284881:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851885.284881:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851885.284882:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851885.284882:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851885.284883:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851885.284885:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851885.284886:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041876384256
00000020:00000001:16.0:1773851885.284887:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851885.284888:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92745
00000020:00000001:16.0:1773851885.284889:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851885.284891:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007cb62c78 refcount=6
00000020:00000001:16.0:1773851885.284893:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631275520 : -107123078276096 : ffff9e9276f8dc00)
00000020:00000001:16.0:1773851885.284894:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631275520 : -107123078276096 : ffff9e9276f8dc00)
00000100:00000001:16.0:1773851885.284896:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851885.284897:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851885.284898:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851885.284900:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851885.284901:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851885.284903:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851885.284903:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851885.284905:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851885.284906:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851885.284907:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851885.284908:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.284909:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851885.284912:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851885.284912:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851885.284912:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851885.284912:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851885.284914:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24706@kfi7, seq: 2156394
00000100:00000040:16.0:1773851885.284915:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007cb62c78 : new rpc_count 1
00000100:00000001:17.0:1773851885.284916:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.284916:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102224640 : -107041607326976 : ffff9ea56f04e300)
00000100:00000001:17.0:1773851885.284917:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851885.284918:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000922a8b42 x1858041876384256/t0(0) o400->ca96c84e-f5df-422c-b73c-694abdced49e@24706@kfi7:106/0 lens 224/0 e 0 to 0 dl 1773852221 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2040-0'
00000100:00000001:16.0:1773851885.284929:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851885.284929:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851885.284931:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000922a8b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:ca96c84e-f5df-422c-b73c-694abdced49e+6:39796:x1858041876384256:12345-24706@kfi7:400:default-tuolumne2040-0
00000100:00000200:16.0:1773851885.284933:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041876384256
00000020:00000001:16.0:1773851885.284934:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851885.284935:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851885.284936:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.284938:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851885.284938:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851885.284940:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851885.284941:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041876384256, found 0 last_xid 1858041876384255
00000020:00000001:16.0:1773851885.284942:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851885.284944:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851885.284944:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851885.284945:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.284947:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851885.284947:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851885.284948:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851885.284950:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003dbe8338.
02000000:00000001:16.0:1773851885.284951:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.284952:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.284953:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851885.284954:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260652812, transno 0, xid 1858041876384256
00010000:00000001:16.0:1773851885.284956:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851885.284957:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000922a8b42 x1858041876384256/t0(0) o400->ca96c84e-f5df-422c-b73c-694abdced49e@24706@kfi7:106/0 lens 224/224 e 0 to 0 dl 1773852221 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2040-0'
00010000:00000001:16.0:1773851885.284961:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851885.284962:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851885.284964:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=118 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851885.284966:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851885.284967:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000eff3de4 refcount 3 to 24706@kfi7
00000100:00000001:16.0:1773851885.284969:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958976 : -107156125592640 : ffff9e8ac532d3c0)
02000000:00000001:16.0:1773851885.284971:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851885.284972:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.284973:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851885.284974:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24643@kfi7
00000400:00000010:16.0:1773851885.284975:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fcf0fdcf.
00000100:00000200:16.0:1773851885.284976:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041876384256, offset 224
00000400:00000200:16.0:1773851885.284979:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24643@kfi7
00000400:00000200:16.0:1773851885.284981:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24643@kfi7 to cpt 4
00000400:00000200:16.0:1773851885.284982:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2d85667 nid 24643@kfi7 refs 1
00000400:00000200:16.0:1773851885.284983:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d2d85667 nid 24643@kfi7 refs 2
00000400:00000200:16.0:1773851885.284985:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d2d85667 nid 24643@kfi7 refs 3
00000400:00000200:16.0:1773851885.284988:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24643@kfi7 local destination
00000400:00000200:16.0:1773851885.284990:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769820:8769820:1024:4294967295] 24643@kfi7 LPNI seq info [21647416:21647416:16:4294967295]
00000400:00000200:16.0:1773851885.284992:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d2d85667 nid 24643@kfi7 refs 2
00000400:00000200:16.0:1773851885.284993:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24643@kfi7 to cpt 4
00000400:00000200:16.0:1773851885.284997:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24643@kfi7(24643@kfi7:24643@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851885.284999:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d2d85667 nid 24643@kfi7 refs 3
00000800:00000200:16.0:1773851885.285002:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851885.285004:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851885.285007:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851885.285011:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000119f Using peer 24643@kfi7(0x10000000000119f)
00000800:00000200:16.0:1773851885.285016:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009aebe925: Posted send of 324 bytes to peer 0x10000000000119f: rc=0
00000800:00000200:16.0:1773851885.285018:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000119f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851885.285021:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851885.285023:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000eff3de4 refcount 2 to 24706@kfi7
00010000:00000001:16.0:1773851885.285024:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851885.285027:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.285028:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851885.285029:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000922a8b42 x1858041876384256/t0(0) o400->ca96c84e-f5df-422c-b73c-694abdced49e@24706@kfi7:106/0 lens 224/224 e 0 to 0 dl 1773852221 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2040-0'
00000100:00100000:16.0:1773851885.285034:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000922a8b42 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:ca96c84e-f5df-422c-b73c-694abdced49e+6:39796:x1858041876384256:12345-24706@kfi7:400:default-tuolumne2040-0 Request processed in 105us (160us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851885.285038:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24706@kfi7, seq: 2156394
00000100:00000040:16.0:1773851885.285039:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007cb62c78 : new rpc_count 0
00000100:00000001:16.0:1773851885.285041:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851885.285042:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851885.285042:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851885.285044:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:16.0:1773851885.285045:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:16.0:1773851885.285046:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000007cb62c78 : new refcount 5
00000100:00000001:16.0:1773851885.285047:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851885.285056:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000119f TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851885.285059:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851885.285060:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24643@kfi7: PUT: OK
00000400:00000200:17.0:1773851885.285062:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fcf0fdcf
00000400:00000010:17.0:1773851885.285062:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fcf0fdcf.
00000100:00000001:17.0:1773851885.285064:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851885.285064:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851885.285065:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d2d85667 nid 24643@kfi7 refs 2
00000800:00000200:17.0:1773851885.285068:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 24643@kfi7(00000000c92849c0):0x0 lsk 4512 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000119f Transaction freed
00000800:00000200:10.0:1773851885.348172:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851885.348173:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851885.348174:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851885.348177:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851885.348179:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18626@kfi7 to cpt 2
00000400:00000200:10.0:1773851885.348180:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18626@kfi7 : PUT - for me
00000400:00000200:10.0:1773851885.348181:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18626@kfi7 to cpt 2
00000400:00000200:10.0:1773851885.348182:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bce3378d nid 18626@kfi7 refs 1
00000400:00000200:10.0:1773851885.348183:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18626@kfi7 to cpt 2
00000400:00000200:10.0:1773851885.348184:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bce3378d nid 18626@kfi7 refs 2
00000400:00000200:10.0:1773851885.348184:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bce3378d nid 18626@kfi7 refs 3
00000400:00000200:10.0:1773851885.348185:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18627@kfi7 to cpt 5
00000400:00000200:10.0:1773851885.348186:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18627@kfi7 of length 224 into portal 12 MB=0x699e0c5266ac0
00000400:00000200:10.0:1773851885.348188:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18627@kfi7 of length 224/224 into md 0x78146ce49 [64] + 149120
00000800:00000200:10.0:1773851885.348190:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851885.348191:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851885.348192:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18626@kfi7: PUT: OK
00000100:00000001:10.0:1773851885.348193:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851885.348194:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851885.348195:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000232b8977.
00000100:00000040:10.0:1773851885.348195:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000232b8977 x1858040519617216 msgsize 224
00000100:00100000:10.0:1773851885.348197:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-18627@kfi7 (source: 12345-18626@kfi7)
00000100:00000001:10.0:1773851885.348198:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851885.348199:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:10.0:1773851885.348199:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bce3378d nid 18626@kfi7 refs 2
02000000:00000001:11.0:1773851885.348200:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851885.348200:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851885.348200:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851885.348201:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851885.348202:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851885.348202:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040519617216
00000020:00000001:11.0:1773851885.348203:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851885.348203:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920b5
00000020:00000001:11.0:1773851885.348204:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851885.348206:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000cb75014 refcount=6
00000020:00000001:11.0:1773851885.348207:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629500928 : -107123080050688 : ffff9e9276ddc800)
00000020:00000001:11.0:1773851885.348208:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629500928 : -107123080050688 : ffff9e9276ddc800)
00000100:00000001:11.0:1773851885.348209:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.348209:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851885.348210:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003573e2ff.
00000020:00000010:11.0:1773851885.348211:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851885.348212:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851885.348213:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851885.348214:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851885.348214:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.348215:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851885.348215:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851885.348216:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.348217:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.348218:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851885.348218:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851885.348218:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851885.348219:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18627@kfi7, seq: 2130827
00000100:00000001:8.0:1773851885.348219:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851885.348220:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000cb75014 : new rpc_count 1
00000100:00000001:8.0:1773851885.348220:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.348221:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087758720 : -106944621792896 : ffff9ebc03ceb180)
00000100:00000001:8.0:1773851885.348221:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.348222:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000232b8977 x1858040519617216/t0(0) o400->11015511-2a2d-465e-a856-78c0cf45a8f7@18627@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1655-0'
00000100:00000001:11.0:1773851885.348225:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.348225:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851885.348226:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000232b8977 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:11015511-2a2d-465e-a856-78c0cf45a8f7+6:39642:x1858040519617216:12345-18627@kfi7:400:default-tuolumne1655-0
00000100:00000200:11.0:1773851885.348228:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040519617216
00000020:00000001:11.0:1773851885.348228:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851885.348229:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851885.348229:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.348230:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851885.348231:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851885.348231:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851885.348232:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040519617216, found 0 last_xid 1858040519617215
00000020:00000001:11.0:1773851885.348233:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851885.348233:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851885.348234:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851885.348234:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.348235:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851885.348235:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851885.348236:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851885.348237:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f1e87786.
02000000:00000001:11.0:1773851885.348238:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.348238:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.348239:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851885.348240:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044143711, transno 0, xid 1858040519617216
00010000:00000001:11.0:1773851885.348240:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851885.348241:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000232b8977 x1858040519617216/t0(0) o400->11015511-2a2d-465e-a856-78c0cf45a8f7@18627@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1655-0'
00010000:00000001:11.0:1773851885.348243:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851885.348244:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851885.348245:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=118 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851885.348246:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851885.348246:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002fc0c401 refcount 3 to 18627@kfi7
00000100:00000001:11.0:1773851885.348247:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452480 : -107146752099136 : ffff9e8cf3e6fcc0)
02000000:00000001:11.0:1773851885.348248:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851885.348249:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.348249:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851885.348250:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18626@kfi7
00000400:00000010:11.0:1773851885.348251:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b8ad34c8.
00000100:00000200:11.0:1773851885.348252:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040519617216, offset 224
00000400:00000200:11.0:1773851885.348253:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18626@kfi7
00000400:00000200:11.0:1773851885.348254:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18626@kfi7 to cpt 2
00000400:00000200:11.0:1773851885.348255:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bce3378d nid 18626@kfi7 refs 1
00000400:00000200:11.0:1773851885.348256:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bce3378d nid 18626@kfi7 refs 2
00000400:00000200:11.0:1773851885.348257:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bce3378d nid 18626@kfi7 refs 3
00000400:00000200:11.0:1773851885.348258:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18626@kfi7 local destination
00000400:00000200:11.0:1773851885.348259:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769821:8769821:1024:4294967295] 18626@kfi7 LPNI seq info [1474323:1474323:16:4294967295]
00000400:00000200:11.0:1773851885.348261:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bce3378d nid 18626@kfi7 refs 2
00000400:00000200:11.0:1773851885.348262:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18626@kfi7 to cpt 2
00000400:00000200:11.0:1773851885.348264:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18626@kfi7(18626@kfi7:18626@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851885.348265:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bce3378d nid 18626@kfi7 refs 3
00000800:00000200:11.0:1773851885.348266:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851885.348267:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851885.348270:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851885.348272:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2b4 Using peer 18626@kfi7(0x2b4)
00000800:00000200:11.0:1773851885.348275:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x2b4: rc=0
00000800:00000200:11.0:1773851885.348277:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2b4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851885.348279:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.348280:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002fc0c401 refcount 2 to 18627@kfi7
00010000:00000001:11.0:1773851885.348280:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851885.348281:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.348282:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851885.348282:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000232b8977 x1858040519617216/t0(0) o400->11015511-2a2d-465e-a856-78c0cf45a8f7@18627@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1655-0'
00000100:00100000:11.0:1773851885.348285:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000232b8977 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:11015511-2a2d-465e-a856-78c0cf45a8f7+6:39642:x1858040519617216:12345-18627@kfi7:400:default-tuolumne1655-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851885.348288:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18627@kfi7, seq: 2130827
00000100:00000040:11.0:1773851885.348289:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000cb75014 : new rpc_count 0
00000100:00000001:11.0:1773851885.348290:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851885.348290:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:10.0:1773851885.348290:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2b4 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851885.348291:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851885.348291:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000400:00000200:10.0:1773851885.348291:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851885.348292:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003573e2ff.
00000400:00000200:10.0:1773851885.348292:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18626@kfi7: PUT: OK
00000020:00000040:11.0:1773851885.348293:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000000cb75014 : new refcount 5
00000400:00000200:10.0:1773851885.348293:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b8ad34c8
00000400:00000010:10.0:1773851885.348293:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b8ad34c8.
00000100:00000001:11.0:1773851885.348294:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851885.348294:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851885.348295:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851885.348296:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bce3378d nid 18626@kfi7 refs 2
00000800:00000200:10.0:1773851885.348297:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 18626@kfi7(00000000e1183d34):0x0 lsk 693 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2b4 Transaction freed
00000800:00000200:9.0:1773851885.361943:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851885.361944:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851885.361945:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851885.361947:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851885.361949:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851885.361950:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.17@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851885.361951:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851885.361951:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851885.361953:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.17@o2ib60 to cpt 2
00000400:00000200:9.0:1773851885.361954:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007000e63b nid 192.168.128.17@o2ib60 refs 2
00000400:00000200:9.0:1773851885.361955:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007000e63b nid 192.168.128.17@o2ib60 refs 3
00000400:00000200:9.0:1773851885.361956:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.17@o2ib60 to cpt 2
00000400:00000200:9.0:1773851885.361957:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.17@o2ib60 of length 224 into portal 12 MB=0x69b1b657bb7c0
00000400:00000200:9.0:1773851885.361959:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.17@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 149344
00000800:00000200:9.0:1773851885.361960:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851885.361962:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851885.361964:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851885.361964:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851885.361965:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851885.361966:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8b299c6.
00000100:00000040:9.0:1773851885.361966:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e8b299c6 x1859391829292992 msgsize 224
00000100:00100000:9.0:1773851885.361968:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.17@o2ib60 (source: 12345-192.168.128.17@o2ib60)
00000100:00000001:9.0:1773851885.361969:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851885.361970:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851885.361970:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
02000000:00000001:11.0:1773851885.361971:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851885.361971:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851885.361971:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851885.361971:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851885.361972:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851885.361973:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859391829292992
00000020:00000001:11.0:1773851885.361974:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851885.361974:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae827bd
00000020:00000001:11.0:1773851885.361975:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851885.361978:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000611ae31d refcount=5
00000020:00000001:11.0:1773851885.361979:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944777226240 : -107128932325376 : ffff9e911a0b2800)
00000020:00000001:11.0:1773851885.361979:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944777226240 : -107128932325376 : ffff9e911a0b2800)
00000100:00000001:11.0:1773851885.361980:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.361981:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851885.361982:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e17f60bc.
00000020:00000010:11.0:1773851885.361982:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851885.361983:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851885.361984:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851885.361984:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851885.361984:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.361985:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851885.361986:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851885.361986:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.361987:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.361988:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851885.361988:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851885.361988:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851885.361988:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851885.361989:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.17@o2ib60, seq: 2130828
00000100:00000040:11.0:1773851885.361990:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000611ae31d : new rpc_count 1
00000100:00000001:11.0:1773851885.361990:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102162648960 : -106971546902656 : ffff9eb5bef21f80)
00000100:00000001:8.0:1773851885.361990:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851885.361991:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.361992:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e8b299c6 x1859391829292992/t0(0) o400->60247939-68e9-448e-8ff0-339f37097635@192.168.128.17@o2ib60:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix17-0'
00000100:00000001:11.0:1773851885.361994:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.361994:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851885.361996:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8b299c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:60247939-68e9-448e-8ff0-339f37097635+5:39944:x1859391829292992:12345-192.168.128.17@o2ib60:400:default-matrix17-0
00000100:00000200:11.0:1773851885.361997:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859391829292992
00000020:00000001:11.0:1773851885.361997:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851885.361998:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851885.361998:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.361999:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851885.361999:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851885.362000:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851885.362001:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859391829292992, found 0 last_xid 1859391829292991
00000020:00000001:11.0:1773851885.362001:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851885.362002:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851885.362002:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851885.362003:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.362003:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851885.362003:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851885.362004:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851885.362004:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003573e2ff.
02000000:00000001:11.0:1773851885.362005:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.362005:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.362006:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851885.362006:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183234531349, transno 0, xid 1859391829292992
00010000:00000001:11.0:1773851885.362007:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851885.362008:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e8b299c6 x1859391829292992/t0(0) o400->60247939-68e9-448e-8ff0-339f37097635@192.168.128.17@o2ib60:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix17-0'
00010000:00000001:11.0:1773851885.362010:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851885.362010:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851885.362011:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=118 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851885.362012:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851885.362013:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009ff54156 refcount 3 to 192.168.128.17@o2ib60
00000100:00000001:11.0:1773851885.362013:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810487328 : -107154899064288 : ffff9e8b0e4e2a20)
02000000:00000001:11.0:1773851885.362014:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851885.362014:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.362015:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851885.362016:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.17@o2ib60
00000400:00000010:11.0:1773851885.362016:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000557250e8.
00000100:00000200:11.0:1773851885.362017:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859391829292992, offset 224
00000400:00000200:11.0:1773851885.362018:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.17@o2ib60
00000400:00000200:11.0:1773851885.362019:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.17@o2ib60 to cpt 2
00000400:00000200:11.0:1773851885.362020:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007000e63b nid 192.168.128.17@o2ib60 refs 2
00000400:00000200:11.0:1773851885.362022:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007000e63b nid 192.168.128.17@o2ib60 refs 3
00000400:00000200:11.0:1773851885.362023:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007000e63b nid 192.168.128.17@o2ib60 refs 4
00000400:00000200:11.0:1773851885.362024:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.17@o2ib60 routed destination
00000400:00000200:11.0:1773851885.362025:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:11.0:1773851885.362026:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:11.0:1773851885.362028:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.17@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851885.362029:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:11.0:1773851885.362030:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.17@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851885.362030:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:11.0:1773851885.362031:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769822:8769822:1024:4294967295] 17@kfi7 LPNI seq info [1250891916:1250891916:16:4294967295]
00000400:00000200:11.0:1773851885.362032:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:11.0:1773851885.362033:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:11.0:1773851885.362036:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.17@o2ib60(192.168.128.17@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851885.362037:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007000e63b nid 192.168.128.17@o2ib60 refs 3
00000800:00000200:11.0:1773851885.362039:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851885.362040:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851885.362042:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851885.362044:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:11.0:1773851885.362047:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:11.0:1773851885.362048:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851885.362050:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.362051:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009ff54156 refcount 2 to 192.168.128.17@o2ib60
00010000:00000001:11.0:1773851885.362052:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851885.362052:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.362053:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851885.362054:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8b299c6 x1859391829292992/t0(0) o400->60247939-68e9-448e-8ff0-339f37097635@192.168.128.17@o2ib60:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix17-0'
00000100:00100000:11.0:1773851885.362057:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8b299c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:60247939-68e9-448e-8ff0-339f37097635+5:39944:x1859391829292992:12345-192.168.128.17@o2ib60:400:default-matrix17-0 Request processed in 62us (89us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851885.362059:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.17@o2ib60, seq: 2130828
00000100:00000040:11.0:1773851885.362060:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000611ae31d : new rpc_count 0
00000100:00000001:11.0:1773851885.362060:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851885.362060:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851885.362061:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851885.362061:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:9.0:1773851885.362061:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851885.362062:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000020:00000010:11.0:1773851885.362062:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e17f60bc.
00000020:00000040:11.0:1773851885.362063:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000611ae31d : new refcount 4
00000100:00000001:11.0:1773851885.362063:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851885.362063:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:9.0:1773851885.362063:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000557250e8
00000400:00000010:9.0:1773851885.362064:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000557250e8.
00000100:00000001:9.0:1773851885.362064:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851885.362064:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851885.362065:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851885.362067:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000100:00000001:13.0:1773851885.385733:0:62918:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000001:8.0:1773851885.385734:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:4.0:1773851885.385734:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851885.385735:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:4.0:1773851885.385735:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:0.0:1773851885.385735:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:29.0:1773851885.385736:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:4.0:1773851885.385736:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aed85170.
00000100:00000010:8.0:1773851885.385737:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa9519f1.
00000020:00000040:4.0:1773851885.385737:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000100:00000001:4.0:1773851885.385737:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:0.0:1773851885.385737:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:29.0:1773851885.385738:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:4.0:1773851885.385738:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:0.0:1773851885.385738:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc6defe8.
00000100:00000010:29.0:1773851885.385739:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000035649470.
00000004:00000001:28.0:1773851885.385739:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:8.0:1773851885.385739:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
00000004:00000001:6.0:1773851885.385739:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
02000000:00000001:4.0:1773851885.385739:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851885.385740:0:61389:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000020:6.0:1773851885.385740:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000010:4.0:1773851885.385740:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000030ba13a7.
00000020:00000040:0.0:1773851885.385740:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000020:00000040:29.0:1773851885.385741:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000004:00000020:28.0:1773851885.385741:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000040:13.0:1773851885.385741:0:62918:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +147s
00000100:00001000:13.0:1773851885.385741:0:62918:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000100:00000001:8.0:1773851885.385741:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:6.0:1773851885.385741:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000091054246.
00000100:00000001:4.0:1773851885.385741:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.385742:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:28.0:1773851885.385742:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d814cbce.
00000100:00000001:4.0:1773851885.385742:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851885.385742:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.385742:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:13.0:1773851885.385743:0:62918:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
02000000:00000001:8.0:1773851885.385743:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:6.0:1773851885.385743:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
02000000:00000001:0.0:1773851885.385743:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851885.385744:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:8.0:1773851885.385744:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851885.385744:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000aed85170] to pc [ptlrpcd_01_02+2]  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851885.385745:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:28.0:1773851885.385745:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000100:00001000:13.0:1773851885.385745:0:62918:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -110s) for 115+30  req@000000001dacf8ea x1859581344341248/t0(0) o3->064db4fd-29a2-4998-87eb-87410af369ba@10289@kfi7:530/0 lens 488/0 e 1 to 0 dl 1773851890 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833019102440324096'
00000100:00000001:6.0:1773851885.385745:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:0.0:1773851885.385745:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851885.385746:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:28.0:1773851885.385747:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:8.0:1773851885.385747:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
02000000:00000001:6.0:1773851885.385747:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851885.385748:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
02000000:00000001:28.0:1773851885.385748:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00080000:00000001:4.0:1773851885.385748:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000010:0.0:1773851885.385748:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d8f54850.
02000000:00000001:28.0:1773851885.385749:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851885.385749:0:62918:0:(import.c:1951:at_measured()) add 140 to 00000000e37a4de3 time=139 v=115 (115 0 0 0)
00000100:00000001:8.0:1773851885.385749:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:4.0:1773851885.385749:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000084a5b49f.
00000100:00000001:29.0:1773851885.385750:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:13.0:1773851885.385750:0:62918:0:(import.c:2016:at_measured()) AT 00000000e37a4de3 change: old=115 new=140 delta=25 (val=140) hist 140 0 0 0
02000000:00000010:6.0:1773851885.385750:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000008df2c937.
00000100:00000001:5.0:1773851885.385750:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:4.0:1773851885.385750:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637133169311744 : -106940540239872 : ffff9ebcf7164000)
00000100:00000001:0.0:1773851885.385750:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851885.385751:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851885.385751:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851885.385751:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385751:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:4.0:1773851885.385751:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:29.0:1773851885.385752:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:28.0:1773851885.385752:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000061a31c4e.
00000100:00000010:13.0:1773851885.385752:0:62918:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000033186979.
00000100:00000001:7.0:1773851885.385752:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385752:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:4.0:1773851885.385752:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.385752:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000010:13.0:1773851885.385753:0:62918:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 488 at 0000000072557611.
00000100:00000001:8.0:1773851885.385753:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851885.385753:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000004:00001000:4.0:1773851885.385753:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000100:00000040:30.0:1773851885.385754:0:61389:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +286s
00000100:00000001:29.0:1773851885.385754:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851885.385754:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:13.0:1773851885.385754:0:62918:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:13.0:1773851885.385754:0:62918:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f110a
00000100:00000001:6.0:1773851885.385754:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:4.0:1773851885.385754:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ea849ea5.
00000004:00080000:4.0:1773851885.385754:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614159839030025ns, next at 614160839028913ns, rc = 0
00000020:00000001:13.0:1773851885.385755:0:62918:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000040:8.0:1773851885.385755:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fa9519f1] to pc [ptlrpcd_02_01+1]  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:4.0:1773851885.385755:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:0.0:1773851885.385755:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851885.385756:0:61389:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000100:00000040:29.0:1773851885.385756:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000035649470] to pc [ptlrpcd_07_00+0]  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851885.385756:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851885.385757:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851885.385757:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000091054246] to pc [ptlrpcd_01_03+3]  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:4.0:1773851885.385757:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851885.385757:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851885.385757:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000cc6defe8] to pc [ptlrpcd_00_00+0]  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851885.385758:0:61389:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000040:28.0:1773851885.385759:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d814cbce] to pc [ptlrpcd_07_01+1]  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:30.0:1773851885.385760:0:61389:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -110s) for 115+30  req@0000000031e08781 x1859600015989568/t0(0) o3->2e4690cb-9273-47ad-9caf-9a633dba768d@14816@kfi7:530/0 lens 488/0 e 1 to 0 dl 1773851890 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833019073751284736'
00000020:00000040:13.0:1773851885.385760:0:62918:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000093f7bc7d refcount=2398
00000020:00000001:13.0:1773851885.385761:0:62918:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133707048960 : -106940002502656 : ffff9ebd17237800)
00000020:00000001:13.0:1773851885.385762:0:62918:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133707048960 : -106940002502656 : ffff9ebd17237800)
00000100:00000040:13.0:1773851885.385763:0:62918:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 0000000093f7bc7d : new rpc_count 11
00000100:00000001:13.0:1773851885.385764:0:62918:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00080000:00000001:8.0:1773851885.385764:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:6.0:1773851885.385764:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:13.0:1773851885.385765:0:62918:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000001:10.0:1773851885.385765:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:0.0:1773851885.385765:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851885.385766:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:13.0:1773851885.385766:0:62918:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e27e57b.
00000100:00000001:10.0:1773851885.385766:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851885.385766:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851885.385766:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:6.0:1773851885.385766:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000050743369.
00000100:00000040:5.0:1773851885.385766:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851885.385767:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:13.0:1773851885.385767:0:62918:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851885.385767:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851885.385767:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:8.0:1773851885.385767:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000639e9ee0.
00000100:00000001:7.0:1773851885.385767:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:6.0:1773851885.385767:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121237336064 : -106952472215552 : ffff9eba2fe2c000)
00000100:00000001:31.0:1773851885.385768:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:30.0:1773851885.385768:0:61389:0:(import.c:1951:at_measured()) add 140 to 0000000024e3e702 time=139 v=115 (115 0 0 0)
00000100:00000001:13.0:1773851885.385768:0:62918:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851885.385768:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637111157640192 : -106962551911424 : ffff9eb7d716cc00)
00000100:00000001:7.0:1773851885.385768:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:2.0:1773851885.385768:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851885.385768:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851885.385769:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:28.0:1773851885.385769:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000481ea804.
00010000:00000001:13.0:1773851885.385769:0:62918:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000040:10.0:1773851885.385769:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851885.385769:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:2.0:1773851885.385769:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.385769:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:30.0:1773851885.385770:0:61389:0:(import.c:2016:at_measured()) AT 0000000024e3e702 change: old=115 new=140 delta=25 (val=140) hist 140 0 0 0
00010000:00000001:13.0:1773851885.385770:0:62918:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851885.385770:0:62918:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00080000:00000001:8.0:1773851885.385770:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:7.0:1773851885.385770:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851885.385770:0:41060:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:31.0:1773851885.385771:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851885.385771:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637106775428096 : -106966934123520 : ffff9eb6d1e38c00)
00000100:00000040:13.0:1773851885.385771:0:62918:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d693aee3 refcount 3 to 10289@kfi7
00080000:00000001:6.0:1773851885.385771:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385771:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851885.385771:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851885.385772:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:13.0:1773851885.385772:0:62918:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636956483013344 : -107117226538272 : ffff9e93d3c34ae0)
00080000:00000001:8.0:1773851885.385772:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851885.385773:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000010:30.0:1773851885.385773:0:61389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d540d74a.
02000000:00000001:13.0:1773851885.385773:0:62918:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000004:00001000:8.0:1773851885.385773:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000004:00001000:6.0:1773851885.385773:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
02000000:00000001:5.0:1773851885.385773:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:1.0:1773851885.385773:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851885.385774:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851885.385774:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:6.0:1773851885.385774:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000069f0f9aa.
02000000:00000001:5.0:1773851885.385774:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:30.0:1773851885.385775:0:61389:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 488 at 000000005cf69b62.
00000100:00000001:29.0:1773851885.385775:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:28.0:1773851885.385775:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851885.385775:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851885.385775:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000084664319.
00000100:00000001:7.0:1773851885.385775:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:6.0:1773851885.385775:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614159839050884ns, next at 614160839049301ns, rc = 0
00000100:00000001:29.0:1773851885.385776:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:28.0:1773851885.385776:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
02000000:00000001:13.0:1773851885.385776:0:62918:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.385776:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851885.385776:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000aed85170 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051935552:2085@kfi7:13:default-yuba2-0
00000020:00000001:30.0:1773851885.385777:0:61389:0:(genops.c:802:class_conn2export()) Process entered
02000000:00000001:10.0:1773851885.385777:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:8.0:1773851885.385777:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614159839052327ns, next at 614160839050183ns, rc = 0
02000000:00000001:7.0:1773851885.385777:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:6.0:1773851885.385777:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:31.0:1773851885.385778:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000020:00000040:30.0:1773851885.385778:0:61389:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eb8e
00000100:00000040:29.0:1773851885.385778:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:28.0:1773851885.385778:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ce3e28d5.
00000100:00000001:13.0:1773851885.385778:0:62918:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:10.0:1773851885.385778:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851885.385778:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385778:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:1.0:1773851885.385778:0:41060:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851885.385779:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851885.385779:0:61389:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000004:00080000:28.0:1773851885.385779:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614159839054411ns, next at 614160839052507ns, rc = 0
00000100:00000040:13.0:1773851885.385779:0:62918:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10288@kfi7
00080000:00000001:8.0:1773851885.385779:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:6.0:1773851885.385779:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851885.385779:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:13.0:1773851885.385780:0:62918:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000077b1e550.
00000100:00100000:10.0:1773851885.385780:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa9519f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051935616:2055@kfi7:13:default-yuba2-0
00000100:00100000:7.0:1773851885.385780:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091054246 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051935808:46@kfi7:13:default-yuba2-0
00000004:00000001:6.0:1773851885.385780:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851885.385780:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.385780:0:41060:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851885.385781:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:28.0:1773851885.385781:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000200:13.0:1773851885.385781:0:62918:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859581344341248, offset 0
00080000:00000001:8.0:1773851885.385781:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851885.385781:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:31.0:1773851885.385782:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851885.385782:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851885.385782:0:62918:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10288@kfi7
00000004:00000001:8.0:1773851885.385782:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.385782:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:1.0:1773851885.385782:0:41060:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:29.0:1773851885.385783:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851885.385783:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851885.385783:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851885.385783:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851885.385783:0:41060:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851885.385784:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035649470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051935744:2056@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851885.385784:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851885.385784:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851885.385784:0:62918:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10288@kfi7 to cpt 3
02000000:00000001:10.0:1773851885.385784:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851885.385784:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:5.0:1773851885.385784:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bd258f76.
02000000:00000001:10.0:1773851885.385785:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851885.385785:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000067b7447a.
02000000:00000001:5.0:1773851885.385785:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851885.385785:0:41060:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051935680:2057@kfi7:13:default-yuba2-0
00000020:00000040:30.0:1773851885.385786:0:61389:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b95f86f refcount=1259
02000000:00000001:29.0:1773851885.385786:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:13.0:1773851885.385786:0:62918:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0acdc2f nid 10288@kfi7 refs 1
02000000:00000001:10.0:1773851885.385786:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:7.0:1773851885.385786:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851885.385787:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000020:00000001:30.0:1773851885.385787:0:61389:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959166629888 : -107114542921728 : ffff9e9473b80800)
02000000:00000001:29.0:1773851885.385787:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851885.385787:0:62918:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b0acdc2f nid 10288@kfi7 refs 2
00000400:00000200:5.0:1773851885.385787:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
02000000:00000001:31.0:1773851885.385788:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:1.0:1773851885.385788:0:41060:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851885.385789:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851885.385789:0:61389:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959166629888 : -107114542921728 : ffff9e9473b80800)
00000100:00100000:29.0:1773851885.385789:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d814cbce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051935872:2065@kfi7:13:default-yuba2-0
00000400:00000200:13.0:1773851885.385789:0:62918:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b0acdc2f nid 10288@kfi7 refs 3
02000000:00000010:10.0:1773851885.385789:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000086e8148e.
00000400:00000200:7.0:1773851885.385789:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000010:5.0:1773851885.385789:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000573cf79c.
02000000:00000001:1.0:1773851885.385789:0:41060:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851885.385790:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:30.0:1773851885.385790:0:61389:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 000000004b95f86f : new rpc_count 8
00000400:00000200:13.0:1773851885.385790:0:62918:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10288@kfi7 local destination
02000000:00000001:10.0:1773851885.385790:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851885.385790:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:5.0:1773851885.385790:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000690e571.
02000000:00000001:1.0:1773851885.385790:0:41060:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.385791:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:7.0:1773851885.385791:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
02000000:00000010:31.0:1773851885.385792:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000cadf7b2e.
00000100:00000001:30.0:1773851885.385792:0:61389:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:13.0:1773851885.385792:0:62918:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769823:8769823:1024:4294967295] 10288@kfi7 LPNI seq info [25143192:25143192:16:4294967295]
00000400:00000200:10.0:1773851885.385792:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000200:5.0:1773851885.385792:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935552, portal 4
02000000:00000001:1.0:1773851885.385792:0:41060:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:30.0:1773851885.385793:0:61389:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000001:29.0:1773851885.385793:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:10.0:1773851885.385793:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000100:00000200:7.0:1773851885.385793:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935808, portal 4
00000100:00000001:5.0:1773851885.385793:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000010:1.0:1773851885.385793:0:41060:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000cc9e4dfe.
02000000:00000001:31.0:1773851885.385794:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851885.385794:0:61389:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2d1e620.
02000000:00000001:29.0:1773851885.385794:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851885.385794:0:62918:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b0acdc2f nid 10288@kfi7 refs 2
00000100:00000001:7.0:1773851885.385794:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851885.385794:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528713344 : -106978180838272 : ffff9eb433884c80)
02000000:00000001:30.0:1773851885.385795:0:61389:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851885.385795:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:13.0:1773851885.385795:0:62918:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10288@kfi7 to cpt 3
00000400:00000010:10.0:1773851885.385795:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000001:7.0:1773851885.385795:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814083072 : -107101895468544 : ffff9e976590da00)
02000000:00000001:1.0:1773851885.385795:0:41060:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851885.385796:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
02000000:00000010:29.0:1773851885.385796:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ef2b4bb2.
00000100:00000040:5.0:1773851885.385796:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851885.385797:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000100:00000001:30.0:1773851885.385797:0:61389:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851885.385797:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935616, portal 4
00000100:00000040:7.0:1773851885.385797:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851885.385797:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
02000000:00000001:29.0:1773851885.385798:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851885.385798:0:62918:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10288@kfi7(10288@kfi7:10288@kfi7) <?> : PUT try# 0
00000100:00000001:10.0:1773851885.385798:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:31.0:1773851885.385799:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00010000:00000001:30.0:1773851885.385799:0:61389:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:10.0:1773851885.385799:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491256320 : -107117218295296 : ffff9e93d4411200)
00000400:00000010:1.0:1773851885.385799:0:41060:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000001f97a09c.
00010000:00000001:30.0:1773851885.385800:0:61389:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851885.385800:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851885.385800:0:62918:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b0acdc2f nid 10288@kfi7 refs 3
00000400:00000010:1.0:1773851885.385800:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090cc6d90.
00000100:00000200:31.0:1773851885.385801:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935744, portal 4
00000400:00000010:29.0:1773851885.385801:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b37fd7a9.
00000100:00000001:7.0:1773851885.385801:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:5.0:1773851885.385801:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:31.0:1773851885.385802:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851885.385802:0:61389:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000400:00000010:29.0:1773851885.385802:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d566f385.
00000800:00000200:13.0:1773851885.385802:0:62918:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000040:10.0:1773851885.385802:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:1.0:1773851885.385802:0:41060:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935680, portal 4
00000100:00000001:31.0:1773851885.385803:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130262238592 : -106943447313024 : ffff9ebc49cfd580)
00000100:00000040:30.0:1773851885.385803:0:61389:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d828d9f5 refcount 3 to 14816@kfi7
00000100:00000040:7.0:1773851885.385803:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000010:7.0:1773851885.385803:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009424d83.
00000100:00000040:5.0:1773851885.385803:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000800:00000200:13.0:1773851885.385804:0:62918:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:5.0:1773851885.385804:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070d325a2.
00000100:00000001:1.0:1773851885.385804:0:41060:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851885.385805:0:61389:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412881536 : -107156296670080 : ffff9e8abb006480)
00000100:00000200:29.0:1773851885.385805:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935872, portal 4
00000100:00000200:7.0:1773851885.385805:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935808, offset 0
00000100:00000001:1.0:1773851885.385805:0:41060:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203078272 : -107102506473344 : ffff9e974125a880)
00000100:00000040:31.0:1773851885.385806:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851885.385806:0:61389:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000800:00000200:13.0:1773851885.385806:0:62918:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:5.0:1773851885.385806:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935552, offset 0
00000100:00000001:29.0:1773851885.385807:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851885.385807:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851885.385807:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000100:00000040:1.0:1773851885.385807:0:41060:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851885.385808:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324223232 : -106976385328384 : ffff9eb49e8d9b00)
00000100:00000040:10.0:1773851885.385808:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000800:00000200:13.0:1773851885.385809:0:62918:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf Using peer 10288@kfi7(0x100000000000fbf)
00000400:00000010:10.0:1773851885.385809:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a8b35bae.
00000400:00000200:7.0:1773851885.385809:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:5.0:1773851885.385809:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
02000000:00000001:30.0:1773851885.385810:0:61389:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851885.385810:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851885.385810:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00000001:31.0:1773851885.385811:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:30.0:1773851885.385811:0:61389:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:10.0:1773851885.385811:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935616, offset 0
00000400:00000200:7.0:1773851885.385812:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:1.0:1773851885.385812:0:41060:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851885.385813:0:61389:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14816@kfi7
00000400:00000200:10.0:1773851885.385813:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000100:00000040:31.0:1773851885.385814:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000010:30.0:1773851885.385814:0:61389:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000800:00000200:13.0:1773851885.385814:0:62918:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 324 bytes to peer 0x100000000000fbf: rc=0
00000400:00000200:7.0:1773851885.385814:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000040:1.0:1773851885.385814:0:41060:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000010:31.0:1773851885.385815:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018a1fff7.
00000100:00000001:29.0:1773851885.385815:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851885.385815:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000200:31.0:1773851885.385816:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935744, offset 0
00000100:00000200:30.0:1773851885.385816:0:61389:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600015989568, offset 0
00000800:00000200:13.0:1773851885.385816:0:62918:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:29.0:1773851885.385817:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000200:10.0:1773851885.385817:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:7.0:1773851885.385817:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000400:00000010:1.0:1773851885.385817:0:41060:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009da9b420.
00000400:00000010:29.0:1773851885.385818:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b0ca5bfc.
00000100:00000001:13.0:1773851885.385818:0:62918:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851885.385818:0:41060:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935680, offset 0
00000400:00000200:30.0:1773851885.385819:0:61389:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14816@kfi7
00000100:00000040:13.0:1773851885.385819:0:62918:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d693aee3 refcount 2 to 10289@kfi7
00000400:00000200:10.0:1773851885.385819:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000040:13.0:1773851885.385820:0:62918:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 0000000093f7bc7d : new rpc_count 10
00000400:00000200:7.0:1773851885.385820:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769821, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769823, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851885.385821:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000200:30.0:1773851885.385821:0:61389:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14816@kfi7 to cpt 7
00000020:00000040:13.0:1773851885.385821:0:62918:0:(genops.c:882:class_export_put()) PUTting export 0000000093f7bc7d : new refcount 2397
00000400:00000200:1.0:1773851885.385821:0:41060:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000100:00000010:13.0:1773851885.385822:0:62918:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 488 at 0000000072557611.
00000400:00000200:30.0:1773851885.385823:0:61389:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54c326c nid 14816@kfi7 refs 1
00000100:00000200:29.0:1773851885.385823:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935872, offset 0
00000100:00000010:13.0:1773851885.385823:0:62918:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000033186979.
00000400:00000200:7.0:1773851885.385823:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:1.0:1773851885.385823:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:13.0:1773851885.385824:0:62918:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851885.385824:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:1.0:1773851885.385824:0:41060:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:29.0:1773851885.385825:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000100:00000040:13.0:1773851885.385825:0:62918:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +25s
00000100:00000001:13.0:1773851885.385825:0:62918:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851885.385826:0:61389:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e54c326c nid 14816@kfi7 refs 2
00000400:00000200:7.0:1773851885.385826:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000400:00000200:1.0:1773851885.385827:0:41060:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:7.0:1773851885.385828:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769824:8769824:1024:4294967295] 46@kfi7 LPNI seq info [5403861:5403861:16:4294967295]
00000400:00000200:30.0:1773851885.385829:0:61389:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e54c326c nid 14816@kfi7 refs 3
00000400:00000200:10.0:1773851885.385829:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:1.0:1773851885.385829:0:41060:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:7.0:1773851885.385830:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:10.0:1773851885.385831:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:30.0:1773851885.385832:0:61389:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14816@kfi7 local destination
00000400:00000200:7.0:1773851885.385832:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:1.0:1773851885.385832:0:41060:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000800:00000200:13.0:1773851885.385833:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851885.385834:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851885.385834:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:30.0:1773851885.385835:0:61389:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769825:8769825:1024:4294967295] 14816@kfi7 LPNI seq info [15965451:15965451:16:4294967295]
00000400:00000200:10.0:1773851885.385835:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769825, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769823, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851885.385835:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:1.0:1773851885.385835:0:41060:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769825, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769823, p:4294967295, g:4294967295, h:1000]
00000400:00000200:13.0:1773851885.385836:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10288@kfi7: PUT: OK
00000400:00000200:13.0:1773851885.385837:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000077b1e550
00000400:00000010:13.0:1773851885.385837:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000077b1e550.
00000400:00000200:5.0:1773851885.385837:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:30.0:1773851885.385838:0:61389:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e54c326c nid 14816@kfi7 refs 2
00000100:00000001:13.0:1773851885.385838:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000400:00000200:10.0:1773851885.385838:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
02000000:00000001:13.0:1773851885.385839:0:2514888:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:13.0:1773851885.385839:0:2514888:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001e27e57b.
00000400:00000200:10.0:1773851885.385839:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851885.385839:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851885.385839:0:41060:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851885.385840:0:61389:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14816@kfi7 to cpt 7
02000000:00000001:13.0:1773851885.385840:0:2514888:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:13.0:1773851885.385841:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851885.385841:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000200:5.0:1773851885.385841:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000400:00000200:1.0:1773851885.385841:0:41060:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:13.0:1773851885.385842:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0acdc2f nid 10288@kfi7 refs 2
00000400:00000200:1.0:1773851885.385842:0:41060:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:10.0:1773851885.385843:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769826:8769826:1023:4294967295] 2055@kfi7 LPNI seq info [5404673:5404673:16:4294967295]
00000800:00000200:13.0:1773851885.385844:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000391fbc73: 2054@kfi7:3 -> 10288@kfi7(000000006d970efe):0x0 lsk 4032 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000fbf Transaction freed
00000400:00000200:5.0:1773851885.385844:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769827, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769823, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851885.385845:0:61389:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14816@kfi7(14816@kfi7:14816@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851885.385845:0:41060:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769827:8769827:1023:4294967295] 2057@kfi7 LPNI seq info [5404110:5404110:16:4294967295]
00000400:00000200:10.0:1773851885.385846:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:10.0:1773851885.385847:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:1.0:1773851885.385847:0:41060:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:30.0:1773851885.385848:0:61389:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e54c326c nid 14816@kfi7 refs 3
00000400:00000200:1.0:1773851885.385848:0:41060:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:31.0:1773851885.385850:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:31.0:1773851885.385852:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000800:00000200:30.0:1773851885.385852:0:61389:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:10.0:1773851885.385852:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851885.385852:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:7.0:1773851885.385853:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851885.385853:0:41060:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851885.385854:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:5.0:1773851885.385854:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:30.0:1773851885.385855:0:61389:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851885.385855:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:1.0:1773851885.385855:0:41060:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:7.0:1773851885.385856:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:5.0:1773851885.385856:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:31.0:1773851885.385857:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000800:00000200:10.0:1773851885.385858:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:7.0:1773851885.385858:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851885.385858:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769828:8769828:1024:4294967295] 2085@kfi7 LPNI seq info [5403243:5403243:16:4294967295]
00000800:00000200:1.0:1773851885.385858:0:41060:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:31.0:1773851885.385859:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000800:00000200:30.0:1773851885.385860:0:61389:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851885.385860:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851885.385860:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851885.385860:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:1.0:1773851885.385860:0:41060:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851885.385862:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1020, d:10, s:8769827, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769828, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851885.385862:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:10.0:1773851885.385863:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851885.385863:0:41060:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851885.385864:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851885.385865:0:61389:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 Using peer 14816@kfi7(0x57)
00000400:00000200:31.0:1773851885.385866:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:10.0:1773851885.385866:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Using peer 2055@kfi7(0x2f3)
00000400:00000200:31.0:1773851885.385867:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851885.385867:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000800:00000200:1.0:1773851885.385867:0:41060:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000400:00000200:31.0:1773851885.385869:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000800:00000200:7.0:1773851885.385869:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000400:00000200:5.0:1773851885.385869:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:31.0:1773851885.385871:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769829:8769829:1023:4294967295] 2056@kfi7 LPNI seq info [5402403:5402403:16:4294967295]
00000800:00000200:10.0:1773851885.385871:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000019dc57a6: Posted send of 324 bytes to peer 0x2f3: rc=0
00000800:00000200:1.0:1773851885.385871:0:41060:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000076179a5b: Posted send of 324 bytes to peer 0x295: rc=0
00000800:00000200:30.0:1773851885.385872:0:61389:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000fd057322: Posted send of 324 bytes to peer 0x57: rc=0
00000800:00000200:5.0:1773851885.385872:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:10.0:1773851885.385873:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:1.0:1773851885.385873:0:41060:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851885.385874:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:5.0:1773851885.385874:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851885.385875:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:30.0:1773851885.385875:0:61389:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851885.385876:0:41060:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.385876:0:41060:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851885.385877:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:10.0:1773851885.385877:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851885.385877:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:1.0:1773851885.385877:0:41060:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851885.385878:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:31.0:1773851885.385879:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851885.385879:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000100:00000001:10.0:1773851885.385879:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.385879:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851885.385880:0:61389:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851885.385880:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851885.385880:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x3df: rc=0
00000100:00000001:1.0:1773851885.385880:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851885.385881:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:10.0:1773851885.385881:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:7.0:1773851885.385881:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:5.0:1773851885.385881:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Using peer 2085@kfi7(0x200000000000110)
00000100:00000001:1.0:1773851885.385881:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851885.385881:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:31.0:1773851885.385882:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000040:30.0:1773851885.385882:0:61389:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d828d9f5 refcount 2 to 14816@kfi7
00000100:00000001:10.0:1773851885.385882:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:1.0:1773851885.385882:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851885.385883:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000001:10.0:1773851885.385883:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851885.385883:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.385883:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851885.385883:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851885.385884:0:61389:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 000000004b95f86f : new rpc_count 7
00000800:00000200:11.0:1773851885.385884:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851885.385884:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851885.385884:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851885.385884:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:1.0:1773851885.385884:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851885.385885:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000020:00000040:30.0:1773851885.385885:0:61389:0:(genops.c:882:class_export_put()) PUTting export 000000004b95f86f : new refcount 1258
00000400:00000200:29.0:1773851885.385885:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000100:00000001:10.0:1773851885.385885:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.385885:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.385885:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851885.385885:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 324 bytes to peer 0x200000000000110: rc=0
00000800:00000200:2.0:1773851885.385885:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000100:00000010:30.0:1773851885.385886:0:61389:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 488 at 000000005cf69b62.
00000100:00000001:10.0:1773851885.385886:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.385886:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851885.385887:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:11.0:1773851885.385887:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851885.385887:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:5.0:1773851885.385887:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851885.385887:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000010:30.0:1773851885.385888:0:61389:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d540d74a.
00000400:00000200:29.0:1773851885.385888:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1020, d:10, s:8769827, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769829, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851885.385888:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:7.0:1773851885.385888:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851885.385888:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:11.0:1773851885.385889:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a8b35bae
00000100:00000001:7.0:1773851885.385889:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851885.385889:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851885.385889:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000100:00000001:30.0:1773851885.385890:0:61389:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851885.385890:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a8b35bae.
00000100:00000001:7.0:1773851885.385890:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385890:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385890:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:2.0:1773851885.385890:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009da9b420
00000100:00000001:11.0:1773851885.385891:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:5.0:1773851885.385891:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:2.0:1773851885.385891:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009da9b420.
00000800:00000200:31.0:1773851885.385892:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000040:30.0:1773851885.385892:0:61389:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_io at +25s
00000400:00000200:29.0:1773851885.385892:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000200:11.0:1773851885.385892:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851885.385892:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851885.385892:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385892:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851885.385892:0:2506505:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851885.385893:0:61389:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851885.385893:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000200:2.0:1773851885.385893:0:2506505:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851885.385894:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851885.385894:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851885.385894:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851885.385895:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000100:00000001:11.0:1773851885.385895:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851885.385895:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851885.385895:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:6.0:1773851885.385896:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000001:5.0:1773851885.385896:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385896:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851885.385896:0:2506505:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:31.0:1773851885.385897:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000400:00000200:29.0:1773851885.385897:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769830:8769830:1022:4294967295] 2065@kfi7 LPNI seq info [5402832:5402832:16:4294967295]
00000100:00000040:11.0:1773851885.385897:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851885.385897:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009424d83
00000100:00000040:2.0:1773851885.385897:0:2506505:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851885.385898:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009424d83.
00000100:00000001:6.0:1773851885.385898:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:30.0:1773851885.385899:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851885.385899:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:11.0:1773851885.385900:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.385900:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:6.0:1773851885.385900:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851885.385900:0:2506505:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851885.385901:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:11.0:1773851885.385901:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:2.0:1773851885.385901:0:2506505:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851885.385902:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851885.385902:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:31.0:1773851885.385903:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000100:00000001:6.0:1773851885.385903:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:30.0:1773851885.385904:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14816@kfi7: PUT: OK
00000800:00000200:11.0:1773851885.385904:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Transaction freed
00000100:00000040:6.0:1773851885.385904:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851885.385905:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851885.385905:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000200:29.0:1773851885.385905:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000800:00000200:7.0:1773851885.385905:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_EVENT_TX_OK event status 0
00000400:00000010:30.0:1773851885.385906:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:30.0:1773851885.385907:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000400:00000200:29.0:1773851885.385907:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:7.0:1773851885.385907:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851885.385907:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851885.385908:0:2472963:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000400:00000200:7.0:1773851885.385908:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000001:6.0:1773851885.385908:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851885.385909:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851885.385909:0:2472963:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2d1e620.
00000400:00000200:7.0:1773851885.385909:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070d325a2
00000400:00000200:6.0:1773851885.385909:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:31.0:1773851885.385910:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:30.0:1773851885.385910:0:2472963:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:30.0:1773851885.385910:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000800:00000200:29.0:1773851885.385910:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000010:7.0:1773851885.385910:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070d325a2.
00000800:00000200:2.0:1773851885.385910:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000076179a5b: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000100:00000001:31.0:1773851885.385911:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851885.385911:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e54c326c nid 14816@kfi7 refs 2
00000800:00000200:29.0:1773851885.385911:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851885.385911:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:7.0:1773851885.385911:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:6.0:1773851885.385911:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000100:00000001:31.0:1773851885.385912:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851885.385912:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:7.0:1773851885.385912:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851885.385913:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851885.385913:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 14816@kfi7(0000000098c6fce7):0x0 lsk 88 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x57 Transaction freed
00000800:00000200:9.0:1773851885.385913:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851885.385913:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851885.385914:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851885.385914:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851885.385914:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851885.385914:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851885.385915:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:9.0:1773851885.385915:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:7.0:1773851885.385915:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851885.385916:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851885.385916:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851885.385917:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851885.385917:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851885.385917:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851885.385917:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000800:00000200:14.0:1773851885.385917:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851885.385918:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851885.385918:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851885.385919:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851885.385919:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851885.385920:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000400:00000200:14.0:1773851885.385920:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851885.385920:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:7.0:1773851885.385920:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:30.0:1773851885.385921:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018a1fff7
00000800:00000200:29.0:1773851885.385921:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000800:00000200:21.0:1773851885.385921:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000010:30.0:1773851885.385922:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018a1fff7.
00000800:00000200:21.0:1773851885.385922:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:14.0:1773851885.385922:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000200:9.0:1773851885.385922:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000800:00000200:7.0:1773851885.385922:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ab24271c: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Transaction freed
00000100:00000001:30.0:1773851885.385923:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851885.385923:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851885.385923:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851885.385923:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000200:30.0:1773851885.385924:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851885.385924:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851885.385924:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:9.0:1773851885.385924:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00000001:29.0:1773851885.385925:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.385925:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:14.0:1773851885.385925:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851885.385925:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:29.0:1773851885.385926:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851885.385926:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851885.385926:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:30.0:1773851885.385927:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851885.385927:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851885.385927:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:9.0:1773851885.385927:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:29.0:1773851885.385928:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851885.385928:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000040:30.0:1773851885.385929:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851885.385929:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851885.385929:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:21.0:1773851885.385929:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:14.0:1773851885.385929:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851885.385929:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:29.0:1773851885.385930:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:14.0:1773851885.385930:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b53c0
00000400:00000200:9.0:1773851885.385930:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5440
00000100:00000001:29.0:1773851885.385931:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851885.385931:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851885.385931:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:9.0:1773851885.385931:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:30.0:1773851885.385932:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.385932:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851885.385932:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:14.0:1773851885.385932:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:30.0:1773851885.385933:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851885.385933:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:14.0:1773851885.385933:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f6b0d [1] + 224
00000400:00000200:9.0:1773851885.385933:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781698569 [1] + 224
00000400:00000200:30.0:1773851885.385934:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:21.0:1773851885.385934:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851885.385935:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:30.0:1773851885.385936:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Transaction freed
00000400:00000200:21.0:1773851885.385936:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:14.0:1773851885.385936:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851885.385936:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851885.385937:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:14.0:1773851885.385937:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851885.385937:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:30.0:1773851885.385938:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851885.385939:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5380
00000400:00000200:14.0:1773851885.385939:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000400:00000200:9.0:1773851885.385939:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000400:00000200:30.0:1773851885.385940:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851885.385940:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:14.0:1773851885.385940:0:2514739:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851885.385940:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851885.385941:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851885.385941:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:30.0:1773851885.385942:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000400:00000200:21.0:1773851885.385942:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d1755 [1] + 224
00000100:00000200:14.0:1773851885.385942:0:2514739:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851885.385942:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:30.0:1773851885.385943:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b0ca5bfc
00000400:00000010:30.0:1773851885.385943:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b0ca5bfc.
00000100:00000001:30.0:1773851885.385944:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851885.385944:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851885.385944:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851885.385944:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:14.0:1773851885.385945:0:2514739:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851885.385946:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851885.385947:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:30.0:1773851885.385948:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851885.385948:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851885.385948:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851885.385949:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:21.0:1773851885.385950:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:14.0:1773851885.385950:0:2514739:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851885.385950:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:1.0:1773851885.385950:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000001:30.0:1773851885.385951:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851885.385951:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:14.0:1773851885.385951:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:9.0:1773851885.385951:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:5.0:1773851885.385951:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2085@kfi7 : PUT - for me
00000800:00000200:1.0:1773851885.385951:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851885.385952:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:21.0:1773851885.385952:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851885.385952:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851885.385952:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:1.0:1773851885.385952:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:0.0:1773851885.385952:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851885.385953:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:9.0:1773851885.385953:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851885.385953:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851885.385953:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000001:0.0:1773851885.385953:0:41060:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:30.0:1773851885.385954:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Transaction freed
00000800:00000200:14.0:1773851885.385954:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000001:7.0:1773851885.385954:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851885.385954:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851885.385954:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000001:0.0:1773851885.385954:0:41060:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:21.0:1773851885.385955:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:7.0:1773851885.385955:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:5.0:1773851885.385955:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:1.0:1773851885.385955:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000001:0.0:1773851885.385955:0:41060:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:7.0:1773851885.385956:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000400:00000010:7.0:1773851885.385956:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000400:00000200:5.0:1773851885.385956:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000010:0.0:1773851885.385956:0:41060:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000001f97a09c.
00000100:00000001:7.0:1773851885.385957:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851885.385957:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851885.385957:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:0.0:1773851885.385957:0:41060:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090cc6d90
00000400:00000010:0.0:1773851885.385957:0:41060:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090cc6d90.
00000100:00000001:21.0:1773851885.385958:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:7.0:1773851885.385958:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851885.385958:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5340
00000400:00000200:1.0:1773851885.385958:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000100:00000001:0.0:1773851885.385958:0:41060:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851885.385959:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000200:0.0:1773851885.385959:0:41060:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851885.385960:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851885.385960:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851885.385960:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:21.0:1773851885.385961:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851885.385961:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:7.0:1773851885.385961:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851885.385961:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b31a65 [1] + 224
00000400:00000200:1.0:1773851885.385961:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000001:10.0:1773851885.385962:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:1.0:1773851885.385962:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000200:0.0:1773851885.385962:0:41060:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:10.0:1773851885.385963:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851885.385963:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000100:00000001:7.0:1773851885.385963:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851885.385963:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851885.385963:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851885.385963:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:10.0:1773851885.385964:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000100:00000001:7.0:1773851885.385964:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851885.385964:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:5.0:1773851885.385964:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851885.385964:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000010:10.0:1773851885.385965:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851885.385965:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851885.385965:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851885.385965:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851885.385965:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:0.0:1773851885.385965:0:41060:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:0.0:1773851885.385965:0:41060:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:10.0:1773851885.385966:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851885.385966:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851885.385966:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000400:00000200:1.0:1773851885.385966:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5400
00000100:00000001:0.0:1773851885.385966:0:41060:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:0.0:1773851885.385966:0:41060:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:7.0:1773851885.385967:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=118 v=66 (66 66 66 66)
00000100:00000001:5.0:1773851885.385967:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851885.385967:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:0.0:1773851885.385967:0:41060:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851885.385967:0:41060:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851885.385968:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=118 v=66 (1 1 1 1)
00000100:00000200:5.0:1773851885.385968:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851885.385968:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71df01 [1] + 224
02000000:00000001:0.0:1773851885.385968:0:41060:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851885.385969:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851885.385969:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851885.385969:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851885.385969:0:41060:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=118 v=66 (66 66 66 66)
00010000:00000001:7.0:1773851885.385970:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851885.385970:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851885.385970:0:41060:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=118 v=66 (1 1 1 1)
00000800:00000200:17.0:1773851885.385971:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000100:00000001:7.0:1773851885.385971:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851885.385971:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000040:5.0:1773851885.385971:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851885.385971:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:0.0:1773851885.385971:0:41060:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000800:00000200:17.0:1773851885.385972:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:10.0:1773851885.385972:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851885.385972:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851885.385972:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851885.385972:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.385972:0:41060:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851885.385972:0:41060:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000800:00000200:17.0:1773851885.385973:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851885.385973:0:41069:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:1.0:1773851885.385973:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:0.0:1773851885.385973:0:41060:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.385973:0:41060:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:10.0:1773851885.385974:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851885.385974:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:7.0:1773851885.385974:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851885.385974:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851885.385974:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000100:00000040:0.0:1773851885.385974:0:41060:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000800:00000200:17.0:1773851885.385975:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:10.0:1773851885.385975:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851885.385975:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851885.385975:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:1.0:1773851885.385975:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:0.0:1773851885.385975:0:41060:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:0.0:1773851885.385975:0:41060:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851885.385976:0:41069:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=118 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851885.385976:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:1.0:1773851885.385976:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:0.0:1773851885.385976:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:17.0:1773851885.385977:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00001000:10.0:1773851885.385977:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=118 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851885.385977:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851885.385977:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851885.385977:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851885.385978:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000100:00000001:10.0:1773851885.385978:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:7.0:1773851885.385978:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851885.385978:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000400:00000200:17.0:1773851885.385979:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:10.0:1773851885.385979:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:7.0:1773851885.385979:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351488995328 avail=351486047232 avail_mb=1372992372 hwm_mb=3131103 files=372066699 ffree=343250972 state=0: rc = 0
00000100:00000001:5.0:1773851885.385979:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851885.385979:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:1.0:1773851885.385979:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851885.385979:0:41060:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:17.0:1773851885.385980:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00010000:00000001:10.0:1773851885.385980:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851885.385980:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:5.0:1773851885.385980:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:0.0:1773851885.385980:0:41060:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851885.385980:0:41060:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851885.385981:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000004:00000020:7.0:1773851885.385981:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351488995328 free, 351486047232 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066699 files, 343250972 free files
00000400:00000001:5.0:1773851885.385981:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:5.0:1773851885.385981:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000573cf79c.
00000004:00000001:0.0:1773851885.385981:0:41060:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:17.0:1773851885.385982:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:10.0:1773851885.385982:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851885.385982:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000004:00000001:7.0:1773851885.385982:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:0.0:1773851885.385982:0:41060:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000400:00000200:17.0:1773851885.385983:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000001:10.0:1773851885.385983:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851885.385983:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851885.385983:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:1.0:1773851885.385983:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:0.0:1773851885.385983:0:41060:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406495744 avail=351404186624 avail_mb=1372672604 hwm_mb=3131103 files=372127153 ffree=343170406 state=0: rc = 0
00000100:00000040:10.0:1773851885.385984:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:5.0:1773851885.385984:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000690e571
00000400:00000010:5.0:1773851885.385984:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000690e571.
00000400:00000200:1.0:1773851885.385984:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:31.0:1773851885.385985:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:17.0:1773851885.385985:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:5.0:1773851885.385985:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000020:0.0:1773851885.385985:0:41060:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406495744 free, 351404186624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127153 files, 343170406 free files
00000100:00000001:31.0:1773851885.385986:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:17.0:1773851885.385986:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5480
00000100:00100000:7.0:1773851885.385986:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091054246 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051935808:46@kfi7:13:default-yuba2-0
00000100:00000200:5.0:1773851885.385986:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851885.385986:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851885.385987:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:17.0:1773851885.385987:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:10.0:1773851885.385987:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:0.0:1773851885.385987:0:41060:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:31.0:1773851885.385988:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851885.385988:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:17.0:1773851885.385988:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f1c71 [1] + 224
00000100:00000001:10.0:1773851885.385988:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851885.385988:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851885.385988:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:0.0:1773851885.385988:0:41060:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:31.0:1773851885.385989:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000004:00000001:10.0:1773851885.385989:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851885.385989:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00000001:7.0:1773851885.385989:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851885.385989:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000091054246 x1859433051935808/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:5.0:1773851885.385989:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851885.385990:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:31.0:1773851885.385990:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:17.0:1773851885.385990:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000040:10.0:1773851885.385990:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382736896 avail=351380674560 avail_mb=1372580760 hwm_mb=3131101 files=371978648 ffree=343147204 state=0: rc = 0
00000100:00000200:31.0:1773851885.385991:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851885.385991:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00100000:0.0:1773851885.385991:0:41060:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre5-MDT0001-mdtlov_UUID:41060:1859433051935680:2057@kfi7:13:default-yuba2-0
00000400:00000200:17.0:1773851885.385992:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000020:10.0:1773851885.385992:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382736896 free, 351380674560 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978648 files, 343147204 free files
00000100:00000001:7.0:1773851885.385992:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851885.385992:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:5.0:1773851885.385992:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851885.385993:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
02000000:00000010:7.0:1773851885.385993:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000067b7447a.
00000100:00000001:5.0:1773851885.385993:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851885.385993:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:0.0:1773851885.385993:0:41060:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:31.0:1773851885.385994:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851885.385994:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:10.0:1773851885.385994:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.385994:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851885.385994:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.385994:0:41060:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:17.0:1773851885.385995:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851885.385995:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851885.385995:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851885.385995:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851885.385995:0:41067:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
02000000:00000001:5.0:1773851885.385995:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851885.385995:0:41060:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000cc6defe8 x1859433051935680/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:7.0:1773851885.385996:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:5.0:1773851885.385996:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=118 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851885.385997:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851885.385997:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:7.0:1773851885.385997:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000008df2c937.
00000100:00001000:5.0:1773851885.385997:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=118 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851885.385997:0:41060:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:0.0:1773851885.385997:0:41060:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:31.0:1773851885.385998:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851885.385998:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:17.0:1773851885.385998:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:10.0:1773851885.385998:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa9519f1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051935616:2055@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851885.385998:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851885.385998:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:5.0:1773851885.385998:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000010:0.0:1773851885.385998:0:41060:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000cc9e4dfe.
00000100:00000001:31.0:1773851885.385999:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851885.385999:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:7.0:1773851885.385999:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000091054246.
00000100:00000001:5.0:1773851885.385999:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851885.385999:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:0.0:1773851885.385999:0:41060:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:31.0:1773851885.386000:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851885.386000:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851885.386000:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851885.386000:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851885.386000:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:5.0:1773851885.386000:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.386000:0:41060:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:0.0:1773851885.386000:0:41060:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000100:00001000:31.0:1773851885.386001:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=118 v=66 (66 66 66 66)
00000100:00000001:17.0:1773851885.386001:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:10.0:1773851885.386001:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fa9519f1 x1859433051935616/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851885.386001:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851885.386001:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851885.386001:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000020:00000001:0.0:1773851885.386001:0:41060:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:31.0:1773851885.386002:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=118 v=66 (1 1 1 1)
00000400:00000200:17.0:1773851885.386002:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:7.0:1773851885.386002:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851885.386002:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.386002:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851885.386002:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851885.386002:0:41060:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d8f54850.
00000100:00000001:31.0:1773851885.386003:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851885.386003:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851885.386003:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851885.386003:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851885.386003:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851885.386003:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:0.0:1773851885.386003:0:41060:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:0.0:1773851885.386003:0:41060:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:31.0:1773851885.386004:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851885.386004:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:29.0:1773851885.386004:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:17.0:1773851885.386004:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:10.0:1773851885.386004:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000010:0.0:1773851885.386004:0:41060:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc6defe8.
00010000:00000001:31.0:1773851885.386005:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:29.0:1773851885.386005:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851885.386005:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000010:10.0:1773851885.386005:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000086e8148e.
00000100:00000001:0.0:1773851885.386005:0:41060:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:0.0:1773851885.386005:0:41060:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851885.386006:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851885.386006:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000400:00000010:29.0:1773851885.386006:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b37fd7a9.
00000400:00000200:29.0:1773851885.386006:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d566f385
02000000:00000001:10.0:1773851885.386006:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851885.386006:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:5.0:1773851885.386006:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:0.0:1773851885.386006:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851885.386007:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851885.386007:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851885.386007:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d566f385.
00000020:00000040:10.0:1773851885.386007:0:41069:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000100:00000001:5.0:1773851885.386007:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851885.386007:0:41060:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:0.0:1773851885.386007:0:41060:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851885.386008:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851885.386008:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000020:00000001:10.0:1773851885.386008:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851885.386008:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:5.0:1773851885.386008:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851885.386008:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:0.0:1773851885.386008:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:29.0:1773851885.386009:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:10.0:1773851885.386009:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000040:5.0:1773851885.386009:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000100:00000001:0.0:1773851885.386009:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851885.386010:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000004:00000040:5.0:1773851885.386010:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351465959424 avail=351462820864 avail_mb=1372901644 hwm_mb=3131103 files=372062753 ffree=343228476 state=0: rc = 0
00000100:00000001:31.0:1773851885.386011:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:29.0:1773851885.386011:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000010:10.0:1773851885.386011:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa9519f1.
00000100:00000001:10.0:1773851885.386011:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851885.386012:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851885.386012:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851885.386012:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851885.386012:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:5.0:1773851885.386012:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351465959424 free, 351462820864 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062753 files, 343228476 free files
00000004:00000001:31.0:1773851885.386013:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851885.386013:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000100:00000001:10.0:1773851885.386013:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000040:31.0:1773851885.386014:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545810944 avail=351536179200 avail_mb=1373188200 hwm_mb=3131103 files=372116390 ffree=343306456 state=0: rc = 0
00000100:00000001:29.0:1773851885.386014:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851885.386014:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851885.386014:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851885.386014:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851885.386015:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851885.386015:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851885.386015:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851885.386015:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851885.386015:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:31.0:1773851885.386016:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545810944 free, 351536179200 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116390 files, 343306456 free files
00000100:00000001:29.0:1773851885.386016:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851885.386016:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:31.0:1773851885.386017:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851885.386017:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851885.386018:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=118 v=66 (66 66 66 66)
00000100:00000040:31.0:1773851885.386019:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:29.0:1773851885.386019:0:41089:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=118 v=66 (1 1 1 1)
00000100:00100000:5.0:1773851885.386019:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000aed85170 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051935552:2085@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851885.386020:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851885.386020:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.386020:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:31.0:1773851885.386021:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035649470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051935744:2056@kfi7:13:default-yuba2-0
00010000:00000001:29.0:1773851885.386021:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:29.0:1773851885.386021:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.386021:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851885.386022:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851885.386022:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000040:5.0:1773851885.386022:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000aed85170 x1859433051935552/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851885.386023:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851885.386023:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851885.386023:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851885.386023:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851885.386024:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000035649470 x1859433051935744/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:29.0:1773851885.386024:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851885.386025:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851885.386025:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851885.386026:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bd258f76.
00000100:00000001:31.0:1773851885.386027:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851885.386027:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:29.0:1773851885.386027:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:5.0:1773851885.386027:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851885.386027:0:41066:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:31.0:1773851885.386028:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000cadf7b2e.
00000100:00000001:29.0:1773851885.386028:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851885.386028:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851885.386028:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000040:5.0:1773851885.386028:0:41066:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000020:00000001:5.0:1773851885.386028:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:31.0:1773851885.386029:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851885.386029:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000040:29.0:1773851885.386029:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
02000000:00000010:5.0:1773851885.386029:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000030ba13a7.
00000020:00000040:31.0:1773851885.386030:0:41088:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000020:00000001:31.0:1773851885.386030:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000040:29.0:1773851885.386030:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351463986176 avail=351458203648 avail_mb=1372883608 hwm_mb=3131101 files=372064679 ffree=343226549 state=0: rc = 0
02000000:00000001:5.0:1773851885.386030:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851885.386030:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:31.0:1773851885.386031:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
00000100:00000010:5.0:1773851885.386031:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aed85170.
02000000:00000001:31.0:1773851885.386032:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851885.386032:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000004:00000020:29.0:1773851885.386032:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351463986176 free, 351458203648 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064679 files, 343226549 free files
00000100:00000001:5.0:1773851885.386032:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851885.386032:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:31.0:1773851885.386033:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000035649470.
00000004:00000001:29.0:1773851885.386033:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.386033:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851885.386033:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851885.386034:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:29.0:1773851885.386034:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851885.386034:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.386034:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851885.386035:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851885.386035:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851885.386036:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851885.386037:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851885.386037:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851885.386037:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d814cbce pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051935872:2065@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851885.386038:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851885.386038:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.386038:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851885.386039:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851885.386040:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d814cbce x1859433051935872/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851885.386042:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851885.386042:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851885.386043:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ef2b4bb2.
02000000:00000001:29.0:1773851885.386044:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851885.386044:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851885.386045:0:41089:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000020:00000001:29.0:1773851885.386045:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851885.386046:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000061a31c4e.
02000000:00000001:29.0:1773851885.386047:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851885.386047:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851885.386047:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d814cbce.
00000100:00000001:29.0:1773851885.386048:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851885.386049:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851885.386049:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851885.386050:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851885.386050:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.386051:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851885.386051:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851885.388479:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851885.388481:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851885.388483:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851885.388486:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851885.388489:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15874@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.388491:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15874@kfi7 : PUT - for me
00000400:00000200:1.0:1773851885.388493:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15874@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.388494:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000390faaba nid 15874@kfi7 refs 1
00000400:00000200:1.0:1773851885.388495:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15874@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.388496:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000390faaba nid 15874@kfi7 refs 2
00000400:00000200:1.0:1773851885.388498:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000390faaba nid 15874@kfi7 refs 3
00000400:00000200:1.0:1773851885.388499:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16066@kfi7 to cpt 3
00000400:00000200:1.0:1773851885.388501:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16066@kfi7 of length 224 into portal 12 MB=0x69b4b6fabf6c0
00000400:00000200:1.0:1773851885.388503:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16066@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 43200
00000800:00000200:1.0:1773851885.388506:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851885.388509:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851885.388510:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15874@kfi7: PUT: OK
00000100:00000001:1.0:1773851885.388512:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851885.388513:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851885.388515:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000000f273ac.
00000100:00000040:1.0:1773851885.388516:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000000f273ac x1859598158657216 msgsize 224
00000100:00100000:1.0:1773851885.388518:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-16066@kfi7 (source: 12345-15874@kfi7)
00000100:00000001:1.0:1773851885.388521:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851885.388535:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000390faaba nid 15874@kfi7 refs 2
00000800:00000200:1.0:1773851885.388538:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000504a0e6c: 2069@kfi7:0 <- 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851885.388542:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851885.388543:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851885.388544:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851885.388544:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851885.388546:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851885.388547:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598158657216
00000020:00000001:1.0:1773851885.388548:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851885.388549:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80e02
00000020:00000001:1.0:1773851885.388550:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851885.388553:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000369078ed refcount=5
00000020:00000001:1.0:1773851885.388554:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118088194048 : -106955621357568 : ffff9eb9742ea800)
00000020:00000001:1.0:1773851885.388555:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118088194048 : -106955621357568 : ffff9eb9742ea800)
00000100:00000001:1.0:1773851885.388556:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851885.388557:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851885.388559:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000aaa4c47a.
00000020:00000010:1.0:1773851885.388560:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851885.388562:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f309d4d6.
00000100:00000001:1.0:1773851885.388563:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851885.388564:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851885.388565:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851885.388566:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851885.388567:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851885.388568:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.388570:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851885.388572:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851885.388572:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851885.388572:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851885.388573:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:1.0:1773851885.388574:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16066@kfi7, seq: 1997603
00000100:00000040:1.0:1773851885.388575:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000369078ed : new rpc_count 1
00000100:00000001:1.0:1773851885.388576:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112252928 : -106950597298688 : ffff9eba9fa3b600)
00000100:00000001:0.0:1773851885.388576:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.388577:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851885.388578:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000000f273ac x1859598158657216/t0(0) o400->3a2da581-8a53-490e-abc3-cf57737e2cfe@16066@kfi7:525/0 lens 224/0 e 0 to 0 dl 1773852640 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1495-0'
00000100:00000001:1.0:1773851885.388588:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851885.388588:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:1.0:1773851885.388590:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000000f273ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3a2da581-8a53-490e-abc3-cf57737e2cfe+5:39572:x1859598158657216:12345-16066@kfi7:400:default-tuolumne1495-0
00000100:00000200:1.0:1773851885.388592:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598158657216
00000020:00000001:1.0:1773851885.388593:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:1.0:1773851885.388594:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:1.0:1773851885.388595:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851885.388596:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:1.0:1773851885.388597:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:1.0:1773851885.388599:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:1.0:1773851885.388600:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598158657216, found 0 last_xid 1859598158657215
00000020:00000001:1.0:1773851885.388601:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:1.0:1773851885.388603:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:1.0:1773851885.388604:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:1.0:1773851885.388604:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851885.388605:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:1.0:1773851885.388607:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:1.0:1773851885.388607:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:1.0:1773851885.388609:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000027fb93dc.
02000000:00000001:1.0:1773851885.388610:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.388611:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851885.388612:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:1.0:1773851885.388613:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104970989, transno 0, xid 1859598158657216
00010000:00000001:1.0:1773851885.388615:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:1.0:1773851885.388616:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000000f273ac x1859598158657216/t0(0) o400->3a2da581-8a53-490e-abc3-cf57737e2cfe@16066@kfi7:525/0 lens 224/224 e 0 to 0 dl 1773852640 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1495-0'
00010000:00000001:1.0:1773851885.388620:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:1.0:1773851885.388621:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:1.0:1773851885.388622:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=118 v=600 (1 1121 1 1)
00000100:00000001:1.0:1773851885.388624:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:1.0:1773851885.388625:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001bea3e9b refcount 3 to 16066@kfi7
00000100:00000001:1.0:1773851885.388627:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729296576 : -107155980255040 : ffff9e8acddc80c0)
02000000:00000001:1.0:1773851885.388629:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:1.0:1773851885.388629:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.388631:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:1.0:1773851885.388632:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15874@kfi7
00000400:00000010:1.0:1773851885.388633:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003083b24b.
00000100:00000200:1.0:1773851885.388635:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598158657216, offset 224
00000400:00000200:1.0:1773851885.388637:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15874@kfi7
00000400:00000200:1.0:1773851885.388638:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15874@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.388640:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000390faaba nid 15874@kfi7 refs 1
00000400:00000200:1.0:1773851885.388641:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000390faaba nid 15874@kfi7 refs 2
00000400:00000200:1.0:1773851885.388643:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000390faaba nid 15874@kfi7 refs 3
00000400:00000200:1.0:1773851885.388645:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15874@kfi7 local destination
00000400:00000200:1.0:1773851885.388647:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769831:8769831:1024:4294967295] 15874@kfi7 LPNI seq info [5741739:5741739:16:4294967295]
00000400:00000200:1.0:1773851885.388650:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000390faaba nid 15874@kfi7 refs 2
00000400:00000200:1.0:1773851885.388651:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15874@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.388654:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15874@kfi7(15874@kfi7:15874@kfi7) <?> : PUT try# 0
00000400:00000200:1.0:1773851885.388656:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000390faaba nid 15874@kfi7 refs 3
00000800:00000200:1.0:1773851885.388658:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851885.388660:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:1.0:1773851885.388663:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851885.388667:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x170 Using peer 15874@kfi7(0x170)
00000800:00000200:1.0:1773851885.388672:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000504a0e6c: Posted send of 324 bytes to peer 0x170: rc=0
00000800:00000200:1.0:1773851885.388674:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x170 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:1.0:1773851885.388677:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851885.388679:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001bea3e9b refcount 2 to 16066@kfi7
00010000:00000001:1.0:1773851885.388680:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:1.0:1773851885.388680:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851885.388682:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:1.0:1773851885.388683:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000000f273ac x1859598158657216/t0(0) o400->3a2da581-8a53-490e-abc3-cf57737e2cfe@16066@kfi7:525/0 lens 224/224 e 0 to 0 dl 1773852640 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1495-0'
00000800:00000200:3.0:1773851885.388689:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x170 TN_EVENT_TX_OK event status 0
00000100:00100000:1.0:1773851885.388689:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000000f273ac pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3a2da581-8a53-490e-abc3-cf57737e2cfe+5:39572:x1859598158657216:12345-16066@kfi7:400:default-tuolumne1495-0 Request processed in 100us (171us total) trans 0 rc 0/0
00000400:00000200:3.0:1773851885.388692:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:1.0:1773851885.388693:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16066@kfi7, seq: 1997603
00000400:00000200:3.0:1773851885.388694:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15874@kfi7: PUT: OK
00000100:00000040:1.0:1773851885.388694:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000369078ed : new rpc_count 0
00000400:00000200:3.0:1773851885.388695:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003083b24b
00000100:00000001:1.0:1773851885.388695:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:3.0:1773851885.388696:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003083b24b.
00000100:00000001:1.0:1773851885.388696:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:3.0:1773851885.388697:0:2506738:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:1.0:1773851885.388697:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000100:00000001:3.0:1773851885.388698:0:2506738:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:3.0:1773851885.388699:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000390faaba nid 15874@kfi7 refs 2
00000020:00000010:1.0:1773851885.388699:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f309d4d6.
00000020:00000010:1.0:1773851885.388700:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000aaa4c47a.
00000020:00000040:1.0:1773851885.388701:0:60951:0:(genops.c:882:class_export_put()) PUTting export 00000000369078ed : new refcount 4
00000800:00000200:3.0:1773851885.388702:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000504a0e6c: 2069@kfi7:0 -> 15874@kfi7(000000001f2900e3):0x0 lsk 369 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x170 Transaction freed
00000100:00000001:1.0:1773851885.388702:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851885.407841:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851885.407842:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851885.407843:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851885.407845:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851885.407847:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18449@kfi7 to cpt 5
00000400:00000200:21.0:1773851885.407848:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18449@kfi7 : PUT - for me
00000400:00000200:21.0:1773851885.407849:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18449@kfi7 to cpt 5
00000400:00000200:21.0:1773851885.407850:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000802a8c6f nid 18449@kfi7 refs 1
00000400:00000200:21.0:1773851885.407851:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18449@kfi7 to cpt 5
00000400:00000200:21.0:1773851885.407852:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000802a8c6f nid 18449@kfi7 refs 2
00000400:00000200:21.0:1773851885.407853:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000802a8c6f nid 18449@kfi7 refs 3
00000400:00000200:21.0:1773851885.407853:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18640@kfi7 to cpt 4
00000400:00000200:21.0:1773851885.407854:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18640@kfi7 of length 224 into portal 12 MB=0x69b4b5e906000
00000400:00000200:21.0:1773851885.407856:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18640@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 53720
00000800:00000200:21.0:1773851885.407857:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851885.407859:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851885.407861:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18449@kfi7: PUT: OK
00000100:00000001:21.0:1773851885.407861:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851885.407862:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851885.407863:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000049dc0514.
00000100:00000040:21.0:1773851885.407864:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000049dc0514 x1859597871636480 msgsize 224
00000100:00100000:21.0:1773851885.407865:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18640@kfi7 (source: 12345-18449@kfi7)
00000100:00000001:21.0:1773851885.407866:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851885.407867:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000802a8c6f nid 18449@kfi7 refs 2
00000100:00000001:23.0:1773851885.407868:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851885.407868:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851885.407868:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851885.407869:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851885.407869:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851885.407870:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851885.407871:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597871636480
00000020:00000001:23.0:1773851885.407871:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851885.407872:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e758fa
00000020:00000001:23.0:1773851885.407872:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851885.407877:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004055493f refcount=5
00000020:00000001:23.0:1773851885.407878:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118315327488 : -106955394224128 : ffff9eb981b87000)
00000020:00000001:23.0:1773851885.407879:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118315327488 : -106955394224128 : ffff9eb981b87000)
00000100:00000001:23.0:1773851885.407880:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851885.407881:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851885.407881:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058dbbd5e.
00000020:00000010:23.0:1773851885.407883:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851885.407883:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851885.407884:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851885.407885:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851885.407885:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851885.407886:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851885.407889:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851885.407890:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851885.407891:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851885.407892:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851885.407892:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851885.407892:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851885.407893:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18640@kfi7, seq: 1998036
00000100:00000001:20.0:1773851885.407893:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851885.407894:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004055493f : new rpc_count 1
00000100:00000001:20.0:1773851885.407894:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851885.407895:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956268416 : -106937753283200 : ffff9ebd9d33d580)
00000100:00000001:20.0:1773851885.407895:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851885.407896:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000049dc0514 x1859597871636480/t0(0) o400->072901b4-668e-4475-880e-ee79ee82438e@18640@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1649-0'
00000100:00000001:23.0:1773851885.407899:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851885.407900:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851885.407900:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049dc0514 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:072901b4-668e-4475-880e-ee79ee82438e+5:39627:x1859597871636480:12345-18640@kfi7:400:default-tuolumne1649-0
00000100:00000200:23.0:1773851885.407902:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597871636480
00000020:00000001:23.0:1773851885.407902:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851885.407903:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851885.407904:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.407904:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851885.407905:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851885.407905:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851885.407906:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597871636480, found 0 last_xid 1859597871636479
00000020:00000001:23.0:1773851885.407907:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851885.407907:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851885.407908:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851885.407908:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.407909:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851885.407910:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851885.407910:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851885.407911:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ed998973.
02000000:00000001:23.0:1773851885.407912:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851885.407912:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.407913:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851885.407914:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183004257416, transno 0, xid 1859597871636480
00010000:00000001:23.0:1773851885.407915:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851885.407915:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000049dc0514 x1859597871636480/t0(0) o400->072901b4-668e-4475-880e-ee79ee82438e@18640@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1649-0'
00010000:00000001:23.0:1773851885.407918:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851885.407918:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851885.407919:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=118 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851885.407920:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851885.407921:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d59703e8 refcount 3 to 18640@kfi7
00000100:00000001:23.0:1773851885.407922:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583546912 : -107156126004704 : ffff9e8ac52c8a20)
02000000:00000001:23.0:1773851885.407922:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851885.407923:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851885.407924:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851885.407924:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18449@kfi7
00000400:00000010:23.0:1773851885.407925:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042659cea.
00000100:00000200:23.0:1773851885.407926:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597871636480, offset 224
00000400:00000200:23.0:1773851885.407927:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18449@kfi7
00000400:00000200:23.0:1773851885.407928:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18449@kfi7 to cpt 5
00000400:00000200:23.0:1773851885.407929:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000802a8c6f nid 18449@kfi7 refs 1
00000400:00000200:23.0:1773851885.407930:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000802a8c6f nid 18449@kfi7 refs 2
00000400:00000200:23.0:1773851885.407931:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000802a8c6f nid 18449@kfi7 refs 3
00000400:00000200:23.0:1773851885.407932:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18449@kfi7 local destination
00000400:00000200:23.0:1773851885.407933:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769832:8769832:1024:4294967295] 18449@kfi7 LPNI seq info [1493559:1493559:16:4294967295]
00000400:00000200:23.0:1773851885.407935:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000802a8c6f nid 18449@kfi7 refs 2
00000400:00000200:23.0:1773851885.407936:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18449@kfi7 to cpt 5
00000400:00000200:23.0:1773851885.407937:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18449@kfi7(18449@kfi7:18449@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851885.407938:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000802a8c6f nid 18449@kfi7 refs 3
00000800:00000200:23.0:1773851885.407940:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851885.407941:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851885.407943:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851885.407948:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xda4 Using peer 18449@kfi7(0xda4)
00000800:00000200:23.0:1773851885.407951:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0xda4: rc=0
00000800:00000200:23.0:1773851885.407953:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xda4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851885.407955:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851885.407956:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d59703e8 refcount 2 to 18640@kfi7
00010000:00000001:23.0:1773851885.407956:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851885.407957:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851885.407957:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851885.407958:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000049dc0514 x1859597871636480/t0(0) o400->072901b4-668e-4475-880e-ee79ee82438e@18640@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1649-0'
00000100:00100000:23.0:1773851885.407961:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049dc0514 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:072901b4-668e-4475-880e-ee79ee82438e+5:39627:x1859597871636480:12345-18640@kfi7:400:default-tuolumne1649-0 Request processed in 61us (96us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851885.407963:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18640@kfi7, seq: 1998036
00000100:00000040:23.0:1773851885.407964:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004055493f : new rpc_count 0
00000100:00000001:23.0:1773851885.407966:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851885.407966:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xda4 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851885.407967:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851885.407967:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851885.407968:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851885.407968:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851885.407968:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18449@kfi7: PUT: OK
00000020:00000010:23.0:1773851885.407969:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058dbbd5e.
00000400:00000200:21.0:1773851885.407969:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042659cea
00000020:00000040:23.0:1773851885.407970:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000004055493f : new refcount 4
00000100:00000001:23.0:1773851885.407970:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:21.0:1773851885.407970:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042659cea.
00000100:00000001:21.0:1773851885.407970:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851885.407971:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851885.407972:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000802a8c6f nid 18449@kfi7 refs 2
00000800:00000200:21.0:1773851885.407973:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 18449@kfi7(0000000014e48478):0x0 lsk 3493 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0xda4 Transaction freed
00000800:00000200:1.0:1773851885.409082:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851885.409083:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851885.409084:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851885.409086:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851885.409089:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9939@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.409090:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9939@kfi7 : PUT - for me
00000400:00000200:1.0:1773851885.409091:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9939@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.409092:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173b83fb nid 9939@kfi7 refs 1
00000400:00000200:1.0:1773851885.409093:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9939@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.409094:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173b83fb nid 9939@kfi7 refs 2
00000400:00000200:1.0:1773851885.409094:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000173b83fb nid 9939@kfi7 refs 3
00000400:00000200:1.0:1773851885.409095:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9747@kfi7 to cpt 6
00000400:00000200:1.0:1773851885.409096:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9747@kfi7 of length 224 into portal 12 MB=0x69af05c1a5a80
00000400:00000200:1.0:1773851885.409097:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9747@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 43424
00000800:00000200:1.0:1773851885.409099:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851885.409102:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851885.409103:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9939@kfi7: PUT: OK
00000100:00000001:1.0:1773851885.409103:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851885.409104:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851885.409105:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006bbeddc5.
00000100:00000040:1.0:1773851885.409106:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000006bbeddc5 x1859206988323456 msgsize 224
00000100:00100000:1.0:1773851885.409107:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9747@kfi7 (source: 12345-9939@kfi7)
00000100:00000001:1.0:1773851885.409108:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851885.409109:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000173b83fb nid 9939@kfi7 refs 2
00000800:00000200:1.0:1773851885.409111:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851885.409113:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851885.409114:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851885.409114:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851885.409115:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851885.409115:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851885.409116:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859206988323456
00000020:00000001:1.0:1773851885.409117:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851885.409117:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92991
00000020:00000001:1.0:1773851885.409118:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851885.409120:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d0917d3b refcount=6
00000020:00000001:1.0:1773851885.409121:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743177216 : -107128966374400 : ffff9e9118039c00)
00000020:00000001:1.0:1773851885.409122:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743177216 : -107128966374400 : ffff9e9118039c00)
00000100:00000001:1.0:1773851885.409123:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851885.409124:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851885.409125:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000073925268.
00000020:00000010:1.0:1773851885.409126:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851885.409127:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f309d4d6.
00000100:00000001:1.0:1773851885.409127:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851885.409128:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851885.409128:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851885.409129:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:1.0:1773851885.409130:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:1.0:1773851885.409130:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.409131:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851885.409132:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851885.409132:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851885.409133:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851885.409133:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851885.409134:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9747@kfi7, seq: 1997604
00000100:00000001:1.0:1773851885.409135:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851885.409135:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d0917d3b : new rpc_count 1
00000100:00000001:1.0:1773851885.409136:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.409136:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112260992 : -106950597290624 : ffff9eba9fa3d580)
00000100:00000040:0.0:1773851885.409137:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006bbeddc5 x1859206988323456/t0(0) o400->a67fdd34-09f7-4c70-af2d-2bd537e94292@9747@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1109-0'
00000100:00000001:0.0:1773851885.409140:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851885.409140:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851885.409141:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006bbeddc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a67fdd34-09f7-4c70-af2d-2bd537e94292+6:39729:x1859206988323456:12345-9747@kfi7:400:default-tuolumne1109-0
00000100:00000200:0.0:1773851885.409143:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859206988323456
00000020:00000001:0.0:1773851885.409144:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851885.409144:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851885.409145:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.409146:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851885.409146:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851885.409147:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851885.409148:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859206988323456, found 0 last_xid 1859206988323455
00000020:00000001:0.0:1773851885.409149:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851885.409149:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851885.409150:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851885.409151:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.409151:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851885.409152:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851885.409152:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851885.409153:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000067ef58f9.
02000000:00000001:0.0:1773851885.409154:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.409155:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.409156:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851885.409157:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183223770661, transno 0, xid 1859206988323456
00010000:00000001:0.0:1773851885.409158:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851885.409159:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006bbeddc5 x1859206988323456/t0(0) o400->a67fdd34-09f7-4c70-af2d-2bd537e94292@9747@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1109-0'
00010000:00000001:0.0:1773851885.409161:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851885.409162:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851885.409162:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=118 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851885.409163:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851885.409164:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000577093f2 refcount 3 to 9747@kfi7
00000100:00000001:0.0:1773851885.409165:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330336 : -107155410221280 : ffff9e8aefd68720)
02000000:00000001:0.0:1773851885.409166:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851885.409166:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.409167:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851885.409168:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9939@kfi7
00000400:00000010:0.0:1773851885.409168:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bcd8159c.
00000100:00000200:0.0:1773851885.409169:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859206988323456, offset 224
00000400:00000200:0.0:1773851885.409171:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9939@kfi7
00000400:00000200:0.0:1773851885.409172:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9939@kfi7 to cpt 0
00000400:00000200:0.0:1773851885.409172:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173b83fb nid 9939@kfi7 refs 1
00000400:00000200:0.0:1773851885.409174:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000173b83fb nid 9939@kfi7 refs 2
00000400:00000200:0.0:1773851885.409175:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000173b83fb nid 9939@kfi7 refs 3
00000400:00000200:0.0:1773851885.409176:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9939@kfi7 local destination
00000400:00000200:0.0:1773851885.409178:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769833:8769833:1024:4294967295] 9939@kfi7 LPNI seq info [3888145:3888145:16:4294967295]
00000400:00000200:0.0:1773851885.409179:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000173b83fb nid 9939@kfi7 refs 2
00000400:00000200:0.0:1773851885.409180:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9939@kfi7 to cpt 0
00000400:00000200:0.0:1773851885.409182:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9939@kfi7(9939@kfi7:9939@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851885.409183:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000173b83fb nid 9939@kfi7 refs 3
00000800:00000200:0.0:1773851885.409185:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851885.409186:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851885.409188:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851885.409191:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x440 Using peer 9939@kfi7(0x440)
00000800:00000200:0.0:1773851885.409194:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x440: rc=0
00000800:00000200:0.0:1773851885.409196:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x440 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851885.409198:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851885.409199:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000577093f2 refcount 2 to 9747@kfi7
00010000:00000001:0.0:1773851885.409200:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851885.409200:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.409201:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851885.409201:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006bbeddc5 x1859206988323456/t0(0) o400->a67fdd34-09f7-4c70-af2d-2bd537e94292@9747@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1109-0'
00000100:00100000:0.0:1773851885.409206:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006bbeddc5 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a67fdd34-09f7-4c70-af2d-2bd537e94292+6:39729:x1859206988323456:12345-9747@kfi7:400:default-tuolumne1109-0 Request processed in 65us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851885.409209:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9747@kfi7, seq: 1997604
00000100:00000040:0.0:1773851885.409209:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d0917d3b : new rpc_count 0
00000100:00000001:0.0:1773851885.409210:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851885.409211:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851885.409212:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:0.0:1773851885.409212:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f309d4d6.
00000020:00000010:0.0:1773851885.409213:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000073925268.
00000020:00000040:0.0:1773851885.409214:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000d0917d3b : new refcount 5
00000100:00000001:0.0:1773851885.409215:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851885.409220:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x440 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851885.409221:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851885.409222:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9939@kfi7: PUT: OK
00000400:00000200:1.0:1773851885.409223:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bcd8159c
00000400:00000010:1.0:1773851885.409224:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bcd8159c.
00000100:00000001:1.0:1773851885.409224:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851885.409225:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851885.409226:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000173b83fb nid 9939@kfi7 refs 2
00000800:00000200:1.0:1773851885.409227:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 9939@kfi7(00000000f77d6841):0x0 lsk 1089 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x440 Transaction freed
00000800:00000200:10.0:1773851885.447783:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851885.447783:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851885.447784:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851885.447784:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851885.447786:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851885.447786:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851885.447789:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19922@kfi7(00000000ad56b0bc):0xfb version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851885.447790:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851885.447792:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb Using peer 19922@kfi7(0x1000000000000fb)
00000400:00000200:10.0:1773851885.447793:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19922@kfi7 to cpt 2
00000400:00000200:10.0:1773851885.447794:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19922@kfi7 : PUT - for me
00000400:00000200:9.0:1773851885.447795:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19922@kfi7 to cpt 2
00000400:00000200:10.0:1773851885.447796:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19922@kfi7 to cpt 2
00000400:00000200:10.0:1773851885.447797:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055d68d82 nid 19922@kfi7 refs 1
00000800:00000200:9.0:1773851885.447798:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000438708cd: Posted send of 38 bytes to peer 0x1000000000000fb: rc=0
00000400:00000200:10.0:1773851885.447799:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19922@kfi7 to cpt 2
00000400:00000200:10.0:1773851885.447800:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055d68d82 nid 19922@kfi7 refs 2
00000800:00000200:9.0:1773851885.447800:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851885.447802:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000055d68d82 nid 19922@kfi7 refs 3
00000400:00000200:10.0:1773851885.447803:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19923@kfi7 to cpt 5
00000400:00000200:10.0:1773851885.447805:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19923@kfi7 of length 224 into portal 12 MB=0x69b4c3b2645c0
00000400:00000200:10.0:1773851885.447807:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19923@kfi7 of length 224/224 into md 0x78146ce49 [64] + 149568
00000800:00000200:10.0:1773851885.447810:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005269f40f: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851885.447813:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851885.447814:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19922@kfi7: PUT: OK
00000800:00000200:9.0:1773851885.447814:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851885.447816:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851885.447817:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851885.447818:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000953abe9d.
00000100:00000040:10.0:1773851885.447819:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000953abe9d x1859601572447680 msgsize 224
00000800:00000200:9.0:1773851885.447819:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb Transaction freed
00000100:00100000:10.0:1773851885.447821:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-19923@kfi7 (source: 12345-19922@kfi7)
00000100:00000001:10.0:1773851885.447824:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851885.447825:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000055d68d82 nid 19922@kfi7 refs 2
00000100:00000001:11.0:1773851885.447826:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851885.447827:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851885.447828:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005269f40f: 2054@kfi7:2 <- 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851885.447829:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851885.447829:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851885.447831:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851885.447832:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601572447680
00000020:00000001:11.0:1773851885.447833:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851885.447833:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e628919ac
00000020:00000001:11.0:1773851885.447834:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851885.447840:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000af6ab754 refcount=8
00000020:00000001:11.0:1773851885.447841:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107320480768 : -106966389070848 : ffff9eb6f2606400)
00000020:00000001:11.0:1773851885.447842:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107320480768 : -106966389070848 : ffff9eb6f2606400)
00000100:00000001:11.0:1773851885.447844:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.447845:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851885.447846:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e17f60bc.
00000020:00000010:11.0:1773851885.447848:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851885.447849:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851885.447850:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851885.447851:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851885.447852:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.447854:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851885.447854:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851885.447855:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.447856:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.447858:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851885.447859:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851885.447859:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851885.447860:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851885.447861:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19923@kfi7, seq: 2130829
00000100:00000040:11.0:1773851885.447862:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000af6ab754 : new rpc_count 1
00000100:00000001:8.0:1773851885.447862:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.447863:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087770240 : -106944621781376 : ffff9ebc03cede80)
00000100:00000001:8.0:1773851885.447863:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.447865:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000953abe9d x1859601572447680/t0(0) o400->ec62449b-c6e5-48aa-95b9-34348c729b66@19923@kfi7:673/0 lens 224/0 e 0 to 0 dl 1773852033 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1733-0'
00000100:00000001:11.0:1773851885.447869:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.447870:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851885.447871:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000953abe9d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:ec62449b-c6e5-48aa-95b9-34348c729b66+8:39576:x1859601572447680:12345-19923@kfi7:400:default-tuolumne1733-0
00000100:00000200:11.0:1773851885.447874:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601572447680
00000020:00000001:11.0:1773851885.447875:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851885.447876:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851885.447877:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.447878:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851885.447879:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851885.447880:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851885.447881:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601572447680, found 0 last_xid 1859601572447679
00000020:00000001:11.0:1773851885.447882:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851885.447884:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851885.447884:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851885.447885:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.447886:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851885.447887:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851885.447888:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851885.447890:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ac49237b.
02000000:00000001:11.0:1773851885.447891:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.447892:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.447893:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851885.447894:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182847780283, transno 0, xid 1859601572447680
00010000:00000001:11.0:1773851885.447895:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851885.447897:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000953abe9d x1859601572447680/t0(0) o400->ec62449b-c6e5-48aa-95b9-34348c729b66@19923@kfi7:673/0 lens 224/224 e 0 to 0 dl 1773852033 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1733-0'
00010000:00000001:11.0:1773851885.447901:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851885.447902:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851885.447904:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=118 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851885.447906:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851885.447907:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000043794073 refcount 3 to 19923@kfi7
00000100:00000001:11.0:1773851885.447908:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096032 : -107139307455584 : ffff9e8eafa33ba0)
02000000:00000001:11.0:1773851885.447910:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851885.447911:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.447912:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851885.447913:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19922@kfi7
00000400:00000010:11.0:1773851885.447914:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000841fb28d.
00000100:00000200:11.0:1773851885.447916:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601572447680, offset 224
00000400:00000200:11.0:1773851885.447918:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19922@kfi7
00000400:00000200:11.0:1773851885.447920:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19922@kfi7 to cpt 2
00000400:00000200:11.0:1773851885.447922:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000055d68d82 nid 19922@kfi7 refs 1
00000400:00000200:11.0:1773851885.447924:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000055d68d82 nid 19922@kfi7 refs 2
00000400:00000200:11.0:1773851885.447926:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000055d68d82 nid 19922@kfi7 refs 3
00000400:00000200:11.0:1773851885.447928:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19922@kfi7 local destination
00000400:00000200:11.0:1773851885.447930:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769834:8769834:1024:4294967295] 19922@kfi7 LPNI seq info [1367906:1367906:16:4294967295]
00000400:00000200:11.0:1773851885.447933:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000055d68d82 nid 19922@kfi7 refs 2
00000400:00000200:11.0:1773851885.447935:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19922@kfi7 to cpt 2
00000400:00000200:11.0:1773851885.447938:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19922@kfi7(19922@kfi7:19922@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851885.447941:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000055d68d82 nid 19922@kfi7 refs 3
00000800:00000200:11.0:1773851885.447943:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851885.447945:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851885.447949:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851885.447954:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb Using peer 19922@kfi7(0x1000000000000fb)
00000800:00000200:11.0:1773851885.447958:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x1000000000000fb: rc=0
00000800:00000200:11.0:1773851885.447960:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851885.447964:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.447965:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000043794073 refcount 2 to 19923@kfi7
00010000:00000001:11.0:1773851885.447966:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851885.447966:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.447967:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851885.447968:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000953abe9d x1859601572447680/t0(0) o400->ec62449b-c6e5-48aa-95b9-34348c729b66@19923@kfi7:673/0 lens 224/224 e 0 to 0 dl 1773852033 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1733-0'
00000100:00100000:11.0:1773851885.447971:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000953abe9d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:ec62449b-c6e5-48aa-95b9-34348c729b66+8:39576:x1859601572447680:12345-19923@kfi7:400:default-tuolumne1733-0 Request processed in 101us (151us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851885.447973:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851885.447974:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851885.447976:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19922@kfi7: PUT: OK
00000100:00100000:11.0:1773851885.447977:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19923@kfi7, seq: 2130829
00000400:00000200:9.0:1773851885.447977:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000841fb28d
00000400:00000010:9.0:1773851885.447977:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000841fb28d.
00000100:00000040:11.0:1773851885.447978:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000af6ab754 : new rpc_count 0
00000100:00000001:9.0:1773851885.447978:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851885.447979:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851885.447979:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851885.447979:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851885.447980:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:9.0:1773851885.447980:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000055d68d82 nid 19922@kfi7 refs 2
00000020:00000010:11.0:1773851885.447981:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000800:00000200:9.0:1773851885.447981:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 19922@kfi7(00000000ad56b0bc):0x0 lsk 252 rsk 33 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000000fb Transaction freed
00000020:00000010:11.0:1773851885.447982:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e17f60bc.
00000020:00000040:11.0:1773851885.447983:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000af6ab754 : new refcount 7
00000100:00000001:11.0:1773851885.447984:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851885.449733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851885.449734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:9.0:1773851885.453702:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851885.453704:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851885.453705:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851885.453709:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851885.453712:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851885.453713:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 46@kfi7 : PUT - for me
00000400:00000200:9.0:1773851885.453715:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851885.453716:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:9.0:1773851885.453717:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851885.453718:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:9.0:1773851885.453719:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:9.0:1773851885.453721:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851885.453722:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 224 into portal 12 MB=0x699e1020d47c0
00000400:00000200:9.0:1773851885.453724:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-46@kfi7 of length 224/224 into md 0x78146ce49 [64] + 149792
00000800:00000200:9.0:1773851885.453733:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851885.453738:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851885.453740:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000100:00000001:9.0:1773851885.453741:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851885.453742:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851885.453744:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004dbd2060.
00000100:00000040:9.0:1773851885.453745:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004dbd2060 x1858041541380032 msgsize 224
00000100:00100000:9.0:1773851885.453747:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-46@kfi7 (source: 12345-46@kfi7)
00000100:00000001:9.0:1773851885.453749:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851885.453750:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:11.0:1773851885.453751:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851885.453752:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851885.453752:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851885.453752:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851885.453753:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851885.453754:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851885.453755:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041541380032
00000020:00000001:11.0:1773851885.453756:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851885.453756:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb7846
00000020:00000001:11.0:1773851885.453757:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851885.453760:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000326def65 refcount=5
00000020:00000001:11.0:1773851885.453761:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946173099008 : -107127536452608 : ffff9e916d3e7c00)
00000020:00000001:11.0:1773851885.453763:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946173099008 : -107127536452608 : ffff9e916d3e7c00)
00000100:00000001:11.0:1773851885.453764:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.453765:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851885.453766:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e17f60bc.
00000020:00000010:11.0:1773851885.453767:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851885.453768:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851885.453769:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851885.453770:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851885.453771:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.453772:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851885.453772:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851885.453773:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.453774:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851885.453777:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851885.453777:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851885.453777:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851885.453778:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851885.453779:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-46@kfi7, seq: 2130830
00000100:00000040:11.0:1773851885.453780:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000326def65 : new rpc_count 1
00000100:00000001:8.0:1773851885.453780:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.453781:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114804630784 : -106958904920832 : ffff9eb8b0777500)
00000100:00000001:8.0:1773851885.453781:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.453782:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004dbd2060 x1858041541380032/t0(0) o400->lustre5-MDT0001-lwp-OST000d_UUID@46@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba114-0'
00000100:00000001:11.0:1773851885.453787:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851885.453788:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851885.453789:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004dbd2060 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:lustre5-MDT0001-lwp-OST000d_UUID+5:272569:x1858041541380032:12345-46@kfi7:400:default-yuba114-0
00000100:00000200:11.0:1773851885.453791:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041541380032
00000020:00000001:11.0:1773851885.453792:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851885.453793:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851885.453794:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.453795:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851885.453795:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851885.453796:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:11.0:1773851885.453797:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851885.453798:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851885.453799:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851885.453800:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.453800:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851885.453801:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851885.453802:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851885.453803:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e8843aa.
02000000:00000001:11.0:1773851885.453804:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.453805:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.453806:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851885.453806:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041541380032
00010000:00000001:11.0:1773851885.453808:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851885.453809:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004dbd2060 x1858041541380032/t0(0) o400->lustre5-MDT0001-lwp-OST000d_UUID@46@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba114-0'
00010000:00000001:11.0:1773851885.453813:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851885.453814:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851885.453814:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=118 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851885.453816:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851885.453818:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d72d6e92 refcount 7 to 46@kfi7
00000100:00000001:11.0:1773851885.453819:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959056864 : -107146750494752 : ffff9e8cf3ff77e0)
02000000:00000001:11.0:1773851885.453820:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851885.453820:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851885.453821:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851885.453822:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000010:11.0:1773851885.453823:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1f8095d.
00000100:00000200:11.0:1773851885.453824:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041541380032, offset 224
00000400:00000200:11.0:1773851885.453826:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000200:11.0:1773851885.453827:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:11.0:1773851885.453828:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:11.0:1773851885.453830:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:11.0:1773851885.453831:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:11.0:1773851885.453833:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  46@kfi7 local destination
00000400:00000200:11.0:1773851885.453835:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769835:8769835:1024:4294967295] 46@kfi7 LPNI seq info [5403862:5403862:16:4294967295]
00000400:00000200:11.0:1773851885.453838:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:11.0:1773851885.453839:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:11.0:1773851885.453842:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851885.453844:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:11.0:1773851885.453847:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851885.453849:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851885.453852:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851885.453857:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000003de Using peer 46@kfi7(0x2000000000003de)
00000800:00000200:11.0:1773851885.453862:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x2000000000003de: rc=0
00000800:00000200:11.0:1773851885.453864:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000003de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851885.453871:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851885.453872:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d72d6e92 refcount 6 to 46@kfi7
00010000:00000001:11.0:1773851885.453873:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851885.453874:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851885.453875:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851885.453876:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004dbd2060 x1858041541380032/t0(0) o400->lustre5-MDT0001-lwp-OST000d_UUID@46@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba114-0'
00000800:00000200:9.0:1773851885.453879:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000003de TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851885.453882:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851885.453883:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004dbd2060 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:lustre5-MDT0001-lwp-OST000d_UUID+5:272569:x1858041541380032:12345-46@kfi7:400:default-yuba114-0 Request processed in 94us (136us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851885.453884:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->46@kfi7: PUT: OK
00000400:00000200:9.0:1773851885.453885:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1f8095d
00000400:00000010:9.0:1773851885.453885:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1f8095d.
00000100:00000001:9.0:1773851885.453886:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:11.0:1773851885.453887:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-46@kfi7, seq: 2130830
00000100:00000001:9.0:1773851885.453887:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:11.0:1773851885.453888:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000326def65 : new rpc_count 0
00000400:00000200:9.0:1773851885.453888:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:11.0:1773851885.453890:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851885.453890:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851885.453890:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 46@kfi7(00000000a415e838):0x0 lsk 991 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000003de Transaction freed
00000020:00000010:11.0:1773851885.453891:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851885.453892:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000020:00000010:11.0:1773851885.453894:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e17f60bc.
00000020:00000040:11.0:1773851885.453895:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000326def65 : new refcount 4
00000100:00000001:11.0:1773851885.453896:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851885.488229:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851885.488230:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851885.488231:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851885.488233:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851885.488236:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20370@kfi7 to cpt 3
00000400:00000200:13.0:1773851885.488237:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20370@kfi7 : PUT - for me
00000400:00000200:13.0:1773851885.488238:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20370@kfi7 to cpt 3
00000400:00000200:13.0:1773851885.488240:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fde7ef5 nid 20370@kfi7 refs 1
00000400:00000200:13.0:1773851885.488241:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20370@kfi7 to cpt 3
00000400:00000200:13.0:1773851885.488241:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fde7ef5 nid 20370@kfi7 refs 2
00000400:00000200:13.0:1773851885.488242:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006fde7ef5 nid 20370@kfi7 refs 3
00000400:00000200:13.0:1773851885.488243:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20371@kfi7 to cpt 6
00000400:00000200:13.0:1773851885.488244:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20371@kfi7 of length 224 into portal 12 MB=0x699e0ebd85e40
00000400:00000200:13.0:1773851885.488245:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20371@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 44240
00000800:00000200:13.0:1773851885.488247:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851885.488248:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851885.488249:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20370@kfi7: PUT: OK
00000100:00000001:13.0:1773851885.488250:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851885.488251:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851885.488251:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000033186979.
00000100:00000040:13.0:1773851885.488252:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000033186979 x1858041168813632 msgsize 224
00000100:00100000:13.0:1773851885.488253:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20371@kfi7 (source: 12345-20370@kfi7)
00000100:00000001:13.0:1773851885.488254:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851885.488255:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006fde7ef5 nid 20370@kfi7 refs 2
00000800:00000200:13.0:1773851885.488256:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851885.488256:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851885.488257:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851885.488257:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851885.488258:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851885.488259:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851885.488260:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041168813632
00000020:00000001:12.0:1773851885.488260:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851885.488261:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e38
00000020:00000001:12.0:1773851885.488261:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851885.488264:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000678456aa refcount=364
00000020:00000001:12.0:1773851885.488265:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628762624 : -107123080788992 : ffff9e9276d28400)
00000020:00000001:12.0:1773851885.488266:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628762624 : -107123080788992 : ffff9e9276d28400)
00000100:00000001:12.0:1773851885.488267:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851885.488268:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851885.488271:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007d88af77.
00000020:00000010:12.0:1773851885.488272:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851885.488273:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002e0b7f3f.
00000100:00000001:12.0:1773851885.488274:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851885.488274:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851885.488275:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851885.488276:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851885.488277:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851885.488277:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851885.488278:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851885.488279:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851885.488280:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851885.488280:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851885.488280:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851885.488281:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20371@kfi7, seq: 2289890
00000100:00000001:15.0:1773851885.488282:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851885.488282:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000678456aa : new rpc_count 12
00000100:00000001:12.0:1773851885.488282:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902265216 : -106994807286400 : ffff9eb05484d580)
00000100:00000001:15.0:1773851885.488283:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851885.488284:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000033186979 x1858041168813632/t0(0) o400->f2a5e305-02f8-4462-b17e-321aee48ad09@20371@kfi7:673/0 lens 224/0 e 0 to 0 dl 1773852033 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1766-0'
00000100:00000001:12.0:1773851885.488286:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851885.488287:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851885.488287:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000033186979 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f2a5e305-02f8-4462-b17e-321aee48ad09+364:39687:x1858041168813632:12345-20371@kfi7:400:default-tuolumne1766-0
00000100:00000200:12.0:1773851885.488289:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041168813632
00000020:00000001:12.0:1773851885.488289:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851885.488290:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851885.488291:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.488291:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851885.488292:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851885.488292:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851885.488293:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041168813632, found 0 last_xid 1858041161124095
00000020:00000001:12.0:1773851885.488294:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851885.488294:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851885.488295:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851885.488296:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.488296:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851885.488297:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851885.488297:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851885.488298:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002da1f47f.
02000000:00000001:12.0:1773851885.488299:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851885.488300:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.488300:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851885.488301:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583807, transno 0, xid 1858041168813632
00010000:00000001:12.0:1773851885.488302:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851885.488303:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000033186979 x1858041168813632/t0(0) o400->f2a5e305-02f8-4462-b17e-321aee48ad09@20371@kfi7:673/0 lens 224/224 e 0 to 0 dl 1773852033 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1766-0'
00010000:00000001:12.0:1773851885.488305:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851885.488306:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851885.488307:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=118 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851885.488308:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851885.488308:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cce24a8b refcount 3 to 20371@kfi7
00000100:00000001:12.0:1773851885.488309:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643688928 : -107157065862688 : ffff9e8a8d2771e0)
02000000:00000001:12.0:1773851885.488310:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851885.488310:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851885.488311:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851885.488312:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20370@kfi7
00000400:00000010:12.0:1773851885.488312:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d0c203c4.
00000100:00000200:12.0:1773851885.488314:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041168813632, offset 224
00000400:00000200:12.0:1773851885.488315:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20370@kfi7
00000400:00000200:12.0:1773851885.488316:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20370@kfi7 to cpt 3
00000400:00000200:12.0:1773851885.488317:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006fde7ef5 nid 20370@kfi7 refs 1
00000400:00000200:12.0:1773851885.488318:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006fde7ef5 nid 20370@kfi7 refs 2
00000400:00000200:12.0:1773851885.488319:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006fde7ef5 nid 20370@kfi7 refs 3
00000400:00000200:12.0:1773851885.488320:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20370@kfi7 local destination
00000400:00000200:12.0:1773851885.488321:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769836:8769836:1024:4294967295] 20370@kfi7 LPNI seq info [8892543:8892543:16:4294967295]
00000400:00000200:12.0:1773851885.488324:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006fde7ef5 nid 20370@kfi7 refs 2
00000400:00000200:12.0:1773851885.488324:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20370@kfi7 to cpt 3
00000400:00000200:12.0:1773851885.488326:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20370@kfi7(20370@kfi7:20370@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851885.488327:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006fde7ef5 nid 20370@kfi7 refs 3
00000800:00000200:12.0:1773851885.488329:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851885.488330:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851885.488332:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851885.488334:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000eeb Using peer 20370@kfi7(0x100000000000eeb)
00000800:00000200:12.0:1773851885.488337:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x100000000000eeb: rc=0
00000800:00000200:12.0:1773851885.488339:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000eeb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851885.488341:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851885.488341:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cce24a8b refcount 2 to 20371@kfi7
00010000:00000001:12.0:1773851885.488342:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851885.488343:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851885.488343:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851885.488344:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000033186979 x1858041168813632/t0(0) o400->f2a5e305-02f8-4462-b17e-321aee48ad09@20371@kfi7:673/0 lens 224/224 e 0 to 0 dl 1773852033 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1766-0'
00000100:00100000:12.0:1773851885.488349:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000033186979 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f2a5e305-02f8-4462-b17e-321aee48ad09+364:39687:x1858041168813632:12345-20371@kfi7:400:default-tuolumne1766-0 Request processed in 61us (96us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851885.488351:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20371@kfi7, seq: 2289890
00000100:00000040:12.0:1773851885.488352:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000678456aa : new rpc_count 11
00000100:00000001:12.0:1773851885.488353:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851885.488353:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851885.488354:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851885.488355:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002e0b7f3f.
00000020:00000010:12.0:1773851885.488355:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007d88af77.
00000020:00000040:12.0:1773851885.488357:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000678456aa : new refcount 363
00000100:00000001:12.0:1773851885.488357:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851885.488362:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000eeb TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851885.488364:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851885.488365:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20370@kfi7: PUT: OK
00000400:00000200:13.0:1773851885.488366:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d0c203c4
00000400:00000010:13.0:1773851885.488366:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d0c203c4.
00000100:00000001:13.0:1773851885.488367:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851885.488367:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851885.488369:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006fde7ef5 nid 20370@kfi7 refs 2
00000800:00000200:13.0:1773851885.488370:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20370@kfi7(0000000033560dac):0x0 lsk 3820 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000eeb Transaction freed
00000800:00000200:17.0:1773851885.520203:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851885.520204:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851885.520207:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851885.520210:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851885.520214:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9872@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.520216:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9872@kfi7 : PUT - for me
00000400:00000200:17.0:1773851885.520218:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9872@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.520219:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000526e544c nid 9872@kfi7 refs 1
00000400:00000200:17.0:1773851885.520222:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9872@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.520223:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000526e544c nid 9872@kfi7 refs 2
00000400:00000200:17.0:1773851885.520226:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000526e544c nid 9872@kfi7 refs 3
00000400:00000200:17.0:1773851885.520227:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9809@kfi7 to cpt 3
00000400:00000200:17.0:1773851885.520229:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9809@kfi7 of length 224 into portal 12 MB=0x69b4becbd2540
00000400:00000200:17.0:1773851885.520231:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9809@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 36464
00000800:00000200:17.0:1773851885.520235:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851885.520238:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851885.520240:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9872@kfi7: PUT: OK
00000100:00000001:17.0:1773851885.520242:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851885.520243:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851885.520244:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006fa596c4.
00000100:00000040:17.0:1773851885.520246:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000006fa596c4 x1859600256935232 msgsize 224
00000100:00100000:17.0:1773851885.520248:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9809@kfi7 (source: 12345-9872@kfi7)
00000100:00000001:17.0:1773851885.520250:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851885.520252:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000526e544c nid 9872@kfi7 refs 2
00000100:00000001:16.0:1773851885.520253:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851885.520254:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851885.520254:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851885.520255:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851885.520256:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851885.520257:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851885.520258:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600256935232
00000020:00000001:16.0:1773851885.520259:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851885.520260:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7b32c
00000020:00000001:16.0:1773851885.520261:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851885.520264:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bd9ae612 refcount=434
00000020:00000001:16.0:1773851885.520265:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112482147328 : -106961227404288 : ffff9eb826092c00)
00000020:00000001:16.0:1773851885.520267:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637112482147328 : -106961227404288 : ffff9eb826092c00)
00000100:00000001:16.0:1773851885.520269:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851885.520270:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851885.520272:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851885.520273:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851885.520275:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851885.520276:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851885.520278:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851885.520279:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851885.520281:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851885.520281:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851885.520282:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.520284:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851885.520286:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851885.520287:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851885.520287:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851885.520288:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851885.520289:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9809@kfi7, seq: 2156395
00000100:00000001:17.0:1773851885.520291:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851885.520291:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bd9ae612 : new rpc_count 2
00000100:00000001:17.0:1773851885.520292:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.520292:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102223488 : -107041607328128 : ffff9ea56f04de80)
00000100:00000040:16.0:1773851885.520294:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006fa596c4 x1859600256935232/t0(0) o400->039bd2dd-a8e9-4141-8fec-ec772eebc470@9809@kfi7:137/0 lens 224/0 e 0 to 0 dl 1773852252 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1106-0'
00000100:00000001:16.0:1773851885.520300:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851885.520300:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851885.520302:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006fa596c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:039bd2dd-a8e9-4141-8fec-ec772eebc470+434:39699:x1859600256935232:12345-9809@kfi7:400:default-tuolumne1106-0
00000100:00000200:16.0:1773851885.520305:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600256935232
00000020:00000001:16.0:1773851885.520306:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851885.520307:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851885.520308:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.520310:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851885.520310:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851885.520312:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851885.520313:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600256935232, found 0 last_xid 1859600113053759
00000020:00000001:16.0:1773851885.520315:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851885.520316:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851885.520317:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851885.520317:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.520319:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851885.520320:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851885.520320:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851885.520322:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f7aa2a92.
02000000:00000001:16.0:1773851885.520323:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.520325:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.520326:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851885.520327:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263972863, transno 0, xid 1859600256935232
00010000:00000001:16.0:1773851885.520329:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851885.520330:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006fa596c4 x1859600256935232/t0(0) o400->039bd2dd-a8e9-4141-8fec-ec772eebc470@9809@kfi7:137/0 lens 224/224 e 0 to 0 dl 1773852252 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1106-0'
00010000:00000001:16.0:1773851885.520335:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851885.520336:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851885.520337:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=118 v=315 (315 214 1 1)
00000100:00000001:16.0:1773851885.520339:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851885.520341:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e2c7e018 refcount 3 to 9809@kfi7
00000100:00000001:16.0:1773851885.520342:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487623040 : -107151221928576 : ffff9e8be97acd80)
02000000:00000001:16.0:1773851885.520344:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851885.520345:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.520346:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851885.520347:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9872@kfi7
00000400:00000010:16.0:1773851885.520348:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007675fa37.
00000100:00000200:16.0:1773851885.520350:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600256935232, offset 224
00000400:00000200:16.0:1773851885.520353:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9872@kfi7
00000400:00000200:16.0:1773851885.520354:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9872@kfi7 to cpt 4
00000400:00000200:16.0:1773851885.520356:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000526e544c nid 9872@kfi7 refs 1
00000400:00000200:16.0:1773851885.520358:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000526e544c nid 9872@kfi7 refs 2
00000400:00000200:16.0:1773851885.520360:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000526e544c nid 9872@kfi7 refs 3
00000400:00000200:16.0:1773851885.520362:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9872@kfi7 local destination
00000400:00000200:16.0:1773851885.520364:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769837:8769837:1024:4294967295] 9872@kfi7 LPNI seq info [16509316:16509316:16:4294967295]
00000400:00000200:16.0:1773851885.520367:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000526e544c nid 9872@kfi7 refs 2
00000400:00000200:16.0:1773851885.520368:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9872@kfi7 to cpt 4
00000400:00000200:16.0:1773851885.520372:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9872@kfi7(9872@kfi7:9872@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851885.520375:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000526e544c nid 9872@kfi7 refs 3
00000800:00000200:16.0:1773851885.520377:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851885.520379:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851885.520387:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851885.520391:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ff Using peer 9872@kfi7(0x9ff)
00000800:00000200:16.0:1773851885.520397:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x9ff: rc=0
00000800:00000200:16.0:1773851885.520399:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851885.520403:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851885.520405:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e2c7e018 refcount 2 to 9809@kfi7
00010000:00000001:16.0:1773851885.520408:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851885.520409:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851885.520410:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851885.520411:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006fa596c4 x1859600256935232/t0(0) o400->039bd2dd-a8e9-4141-8fec-ec772eebc470@9809@kfi7:137/0 lens 224/224 e 0 to 0 dl 1773852252 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1106-0'
00000100:00100000:16.0:1773851885.520418:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006fa596c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:039bd2dd-a8e9-4141-8fec-ec772eebc470+434:39699:x1859600256935232:12345-9809@kfi7:400:default-tuolumne1106-0 Request processed in 117us (171us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851885.520423:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9809@kfi7, seq: 2156395
00000100:00000040:16.0:1773851885.520424:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bd9ae612 : new rpc_count 1
00000100:00000001:16.0:1773851885.520425:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851885.520426:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851885.520427:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851885.520429:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:16.0:1773851885.520430:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000020:00000040:16.0:1773851885.520432:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000bd9ae612 : new refcount 433
00000100:00000001:16.0:1773851885.520433:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851885.520442:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ff TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851885.520444:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851885.520446:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9872@kfi7: PUT: OK
00000400:00000200:17.0:1773851885.520448:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007675fa37
00000400:00000010:17.0:1773851885.520449:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007675fa37.
00000100:00000001:17.0:1773851885.520450:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851885.520451:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851885.520452:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000526e544c nid 9872@kfi7 refs 2
00000800:00000200:17.0:1773851885.520454:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 9872@kfi7(00000000315e6616):0x0 lsk 2560 rsk 28 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ff Transaction freed
00000800:00000200:6.0:1773851885.680964:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851885.680964:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851885.680966:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851885.680968:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851885.680970:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23346@kfi7 to cpt 1
00000400:00000200:6.0:1773851885.680971:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23346@kfi7 : PUT - for me
00000400:00000200:6.0:1773851885.680972:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23346@kfi7 to cpt 1
00000400:00000200:6.0:1773851885.680973:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000670de03e nid 23346@kfi7 refs 1
00000400:00000200:6.0:1773851885.680974:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23346@kfi7 to cpt 1
00000400:00000200:6.0:1773851885.680975:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000670de03e nid 23346@kfi7 refs 2
00000400:00000200:6.0:1773851885.680976:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000670de03e nid 23346@kfi7 refs 3
00000400:00000200:6.0:1773851885.680977:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23539@kfi7 to cpt 6
00000400:00000200:6.0:1773851885.680978:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23539@kfi7 of length 224 into portal 12 MB=0x699e134c3d740
00000400:00000200:6.0:1773851885.680979:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23539@kfi7 of length 224/224 into md 0x793926dc5 [64] + 155664
00000800:00000200:6.0:1773851885.680981:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851885.680983:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851885.680984:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23346@kfi7: PUT: OK
00000100:00000001:6.0:1773851885.680985:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851885.680985:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851885.680986:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc2df4e3.
00000100:00000040:6.0:1773851885.680987:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000cc2df4e3 x1858042392205120 msgsize 224
00000100:00100000:6.0:1773851885.680988:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-23539@kfi7 (source: 12345-23346@kfi7)
00000100:00000001:6.0:1773851885.680989:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851885.680990:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000670de03e nid 23346@kfi7 refs 2
00000800:00000200:6.0:1773851885.680991:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851885.680991:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851885.680991:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851885.680992:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851885.680992:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851885.680993:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851885.680994:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042392205120
00000020:00000001:4.0:1773851885.680994:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851885.680995:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b58
00000020:00000001:4.0:1773851885.680995:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851885.680997:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d93f899b refcount=6
00000020:00000001:4.0:1773851885.680998:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743674880 : -107128965876736 : ffff9e91180b3400)
00000020:00000001:4.0:1773851885.680998:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743674880 : -107128965876736 : ffff9e91180b3400)
00000100:00000001:4.0:1773851885.681000:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851885.681001:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851885.681001:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001dd2088e.
00000020:00000010:4.0:1773851885.681002:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851885.681003:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851885.681004:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851885.681004:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851885.681005:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851885.681006:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851885.681007:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851885.681007:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851885.681008:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851885.681009:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851885.681010:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851885.681010:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851885.681010:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851885.681011:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23539@kfi7, seq: 2001964
00000100:00000001:7.0:1773851885.681012:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851885.681012:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d93f899b : new rpc_count 1
00000100:00000001:4.0:1773851885.681012:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814071552 : -107101895480064 : ffff9e976590ad00)
00000100:00000001:7.0:1773851885.681013:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851885.681014:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cc2df4e3 x1858042392205120/t0(0) o400->0f993e34-709a-4343-81ef-63608c1ec716@23539@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1945-0'
00000100:00000001:4.0:1773851885.681016:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851885.681018:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851885.681018:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc2df4e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:0f993e34-709a-4343-81ef-63608c1ec716+6:39668:x1858042392205120:12345-23539@kfi7:400:default-tuolumne1945-0
00000100:00000200:4.0:1773851885.681020:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042392205120
00000020:00000001:4.0:1773851885.681020:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851885.681021:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851885.681022:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.681023:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851885.681023:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851885.681024:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851885.681025:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042392205120, found 0 last_xid 1858042392205119
00000020:00000001:4.0:1773851885.681025:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851885.681026:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851885.681027:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851885.681027:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.681028:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851885.681029:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851885.681029:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851885.681030:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000e1561a7.
02000000:00000001:4.0:1773851885.681031:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851885.681031:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.681032:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851885.681032:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044150573, transno 0, xid 1858042392205120
00010000:00000001:4.0:1773851885.681033:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851885.681034:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cc2df4e3 x1858042392205120/t0(0) o400->0f993e34-709a-4343-81ef-63608c1ec716@23539@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1945-0'
00010000:00000001:4.0:1773851885.681036:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851885.681037:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851885.681037:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=117 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851885.681038:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851885.681039:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b351c99 refcount 3 to 23539@kfi7
00000100:00000001:4.0:1773851885.681040:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336832 : -107152617214784 : ffff9e8b96506cc0)
02000000:00000001:4.0:1773851885.681041:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851885.681041:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851885.681043:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851885.681043:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23346@kfi7
00000400:00000010:4.0:1773851885.681044:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7eb278.
00000100:00000200:4.0:1773851885.681045:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042392205120, offset 224
00000400:00000200:4.0:1773851885.681046:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23346@kfi7
00000400:00000200:4.0:1773851885.681047:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23346@kfi7 to cpt 1
00000400:00000200:4.0:1773851885.681048:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000670de03e nid 23346@kfi7 refs 1
00000400:00000200:4.0:1773851885.681049:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000670de03e nid 23346@kfi7 refs 2
00000400:00000200:4.0:1773851885.681050:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000670de03e nid 23346@kfi7 refs 3
00000400:00000200:4.0:1773851885.681052:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23346@kfi7 local destination
00000400:00000200:4.0:1773851885.681053:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769838:8769838:1024:4294967295] 23346@kfi7 LPNI seq info [346849:346849:16:4294967295]
00000400:00000200:4.0:1773851885.681054:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000670de03e nid 23346@kfi7 refs 2
00000400:00000200:4.0:1773851885.681055:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23346@kfi7 to cpt 1
00000400:00000200:4.0:1773851885.681057:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23346@kfi7(23346@kfi7:23346@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851885.681058:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000670de03e nid 23346@kfi7 refs 3
00000800:00000200:4.0:1773851885.681059:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851885.681060:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851885.681062:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851885.681064:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000930 Using peer 23346@kfi7(0x100000000000930)
00000800:00000200:4.0:1773851885.681067:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x100000000000930: rc=0
00000800:00000200:4.0:1773851885.681068:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000930 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851885.681070:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851885.681071:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b351c99 refcount 2 to 23539@kfi7
00010000:00000001:4.0:1773851885.681072:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851885.681072:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.681073:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851885.681074:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc2df4e3 x1858042392205120/t0(0) o400->0f993e34-709a-4343-81ef-63608c1ec716@23539@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1945-0'
00000100:00100000:4.0:1773851885.681079:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc2df4e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:0f993e34-709a-4343-81ef-63608c1ec716+6:39668:x1858042392205120:12345-23539@kfi7:400:default-tuolumne1945-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851885.681081:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23539@kfi7, seq: 2001964
00000100:00000040:4.0:1773851885.681081:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d93f899b : new rpc_count 0
00000100:00000001:4.0:1773851885.681082:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851885.681083:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851885.681083:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851885.681084:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851885.681085:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001dd2088e.
00000020:00000040:4.0:1773851885.681086:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000d93f899b : new refcount 5
00000100:00000001:4.0:1773851885.681086:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851885.681093:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000930 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851885.681095:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851885.681097:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23346@kfi7: PUT: OK
00000400:00000200:5.0:1773851885.681097:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7eb278
00000400:00000010:5.0:1773851885.681098:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7eb278.
00000100:00000001:5.0:1773851885.681099:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851885.681100:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851885.681101:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000670de03e nid 23346@kfi7 refs 2
00000800:00000200:5.0:1773851885.681103:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 23346@kfi7(0000000070cebf49):0x0 lsk 2353 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000930 Transaction freed
00000800:00000200:29.0:1773851885.691906:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851885.691906:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851885.691908:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851885.691910:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851885.691912:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16850@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.691913:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16850@kfi7 : PUT - for me
00000400:00000200:29.0:1773851885.691914:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16850@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.691916:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de4400ca nid 16850@kfi7 refs 1
00000400:00000200:29.0:1773851885.691917:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16850@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.691918:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de4400ca nid 16850@kfi7 refs 2
00000400:00000200:29.0:1773851885.691919:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de4400ca nid 16850@kfi7 refs 3
00000400:00000200:29.0:1773851885.691920:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16658@kfi7 to cpt 4
00000400:00000200:29.0:1773851885.691921:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16658@kfi7 of length 224 into portal 12 MB=0x69b4b9582c3c0
00000400:00000200:29.0:1773851885.691922:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16658@kfi7 of length 224/224 into md 0x77fe139dd [64] + 193752
00000800:00000200:29.0:1773851885.691924:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851885.691928:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851885.691929:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16850@kfi7: PUT: OK
00000100:00000001:29.0:1773851885.691930:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851885.691931:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851885.691932:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6d33b31.
00000100:00000040:29.0:1773851885.691932:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a6d33b31 x1859598793491392 msgsize 224
00000100:00100000:29.0:1773851885.691934:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16658@kfi7 (source: 12345-16850@kfi7)
00000100:00000001:29.0:1773851885.691935:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851885.691936:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de4400ca nid 16850@kfi7 refs 2
00000800:00000200:29.0:1773851885.691938:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc48149a: 2069@kfi7:7 <- 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851885.691941:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851885.691941:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851885.691942:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851885.691942:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851885.691943:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851885.691944:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598793491392
00000020:00000001:29.0:1773851885.691944:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851885.691945:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389169c1
00000020:00000001:29.0:1773851885.691945:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851885.691950:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000898a8ead refcount=5
00000020:00000001:29.0:1773851885.691951:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104807726080 : -106968901825536 : ffff9eb65c9acc00)
00000020:00000001:29.0:1773851885.691952:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637104807726080 : -106968901825536 : ffff9eb65c9acc00)
00000100:00000001:29.0:1773851885.691953:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851885.691953:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851885.691954:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851885.691955:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851885.691956:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851885.691957:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851885.691957:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851885.691958:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851885.691959:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851885.691959:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851885.691960:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.691961:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851885.691962:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851885.691963:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851885.691963:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851885.691963:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851885.691964:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16658@kfi7, seq: 2055569
00000100:00000001:30.0:1773851885.691965:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851885.691965:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851885.691965:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000898a8ead : new rpc_count 1
00000100:00000001:29.0:1773851885.691965:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262245504 : -106943447306112 : ffff9ebc49cff080)
00000100:00000040:29.0:1773851885.691967:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6d33b31 x1859598793491392/t0(0) o400->797e9cc3-4fa1-4447-8bcc-fba45bc98db6@16658@kfi7:673/0 lens 224/0 e 0 to 0 dl 1773852033 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1541-0'
00000100:00000001:29.0:1773851885.691969:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851885.691970:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851885.691971:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d33b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:797e9cc3-4fa1-4447-8bcc-fba45bc98db6+5:39563:x1859598793491392:12345-16658@kfi7:400:default-tuolumne1541-0
00000100:00000200:29.0:1773851885.691972:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598793491392
00000020:00000001:29.0:1773851885.691973:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851885.691974:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851885.691974:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.691975:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851885.691976:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851885.691976:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851885.691977:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598793491392, found 0 last_xid 1859598793491391
00000020:00000001:29.0:1773851885.691978:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851885.691979:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851885.691979:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851885.691980:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.691980:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851885.691981:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851885.691982:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851885.691982:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b905bb3d.
02000000:00000001:29.0:1773851885.691983:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.691983:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.691984:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851885.691985:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044182978, transno 0, xid 1859598793491392
00010000:00000001:29.0:1773851885.691986:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851885.691987:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6d33b31 x1859598793491392/t0(0) o400->797e9cc3-4fa1-4447-8bcc-fba45bc98db6@16658@kfi7:673/0 lens 224/224 e 0 to 0 dl 1773852033 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1541-0'
00010000:00000001:29.0:1773851885.691989:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851885.691990:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851885.691991:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=118 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851885.691992:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851885.691992:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f8bfb53a refcount 3 to 16658@kfi7
00000100:00000001:29.0:1773851885.691993:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993184 : -107142345558432 : ffff9e8dfa8d7660)
02000000:00000001:29.0:1773851885.691994:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851885.691994:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851885.691995:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851885.691996:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16850@kfi7
00000400:00000010:29.0:1773851885.691996:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d566f385.
00000100:00000200:29.0:1773851885.691997:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598793491392, offset 224
00000400:00000200:29.0:1773851885.691999:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16850@kfi7
00000400:00000200:29.0:1773851885.691999:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16850@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.692000:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de4400ca nid 16850@kfi7 refs 1
00000400:00000200:29.0:1773851885.692001:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de4400ca nid 16850@kfi7 refs 2
00000400:00000200:29.0:1773851885.692002:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de4400ca nid 16850@kfi7 refs 3
00000400:00000200:29.0:1773851885.692003:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16850@kfi7 local destination
00000400:00000200:29.0:1773851885.692004:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769839:8769839:1024:4294967295] 16850@kfi7 LPNI seq info [3827148:3827148:16:4294967295]
00000400:00000200:29.0:1773851885.692006:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000de4400ca nid 16850@kfi7 refs 2
00000400:00000200:29.0:1773851885.692007:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16850@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.692008:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16850@kfi7(16850@kfi7:16850@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851885.692009:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de4400ca nid 16850@kfi7 refs 3
00000800:00000200:29.0:1773851885.692010:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851885.692012:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851885.692014:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851885.692016:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf1e Using peer 16850@kfi7(0xf1e)
00000800:00000200:29.0:1773851885.692019:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0xf1e: rc=0
00000800:00000200:29.0:1773851885.692020:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf1e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851885.692022:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851885.692023:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f8bfb53a refcount 2 to 16658@kfi7
00010000:00000001:29.0:1773851885.692024:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851885.692024:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851885.692025:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851885.692025:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6d33b31 x1859598793491392/t0(0) o400->797e9cc3-4fa1-4447-8bcc-fba45bc98db6@16658@kfi7:673/0 lens 224/224 e 0 to 0 dl 1773852033 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1541-0'
00000100:00100000:29.0:1773851885.692028:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d33b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:797e9cc3-4fa1-4447-8bcc-fba45bc98db6+5:39563:x1859598793491392:12345-16658@kfi7:400:default-tuolumne1541-0 Request processed in 58us (95us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851885.692031:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16658@kfi7, seq: 2055569
00000100:00000040:29.0:1773851885.692031:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000898a8ead : new rpc_count 0
00000100:00000001:29.0:1773851885.692032:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:31.0:1773851885.692033:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf1e TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851885.692033:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851885.692033:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:31.0:1773851885.692034:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851885.692034:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000200:31.0:1773851885.692035:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16850@kfi7: PUT: OK
00000020:00000010:29.0:1773851885.692035:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000400:00000200:31.0:1773851885.692036:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d566f385
00000020:00000040:29.0:1773851885.692036:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000898a8ead : new refcount 4
00000100:00000001:29.0:1773851885.692036:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:31.0:1773851885.692037:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d566f385.
00000100:00000001:31.0:1773851885.692038:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851885.692038:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851885.692039:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000de4400ca nid 16850@kfi7 refs 2
00000800:00000200:31.0:1773851885.692041:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2069@kfi7:7 -> 16850@kfi7(0000000033ea47a9):0x0 lsk 3871 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0xf1e Transaction freed
00010000:00000001:2.0:1773851885.705736:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705737:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851885.705738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851885.705739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851885.705742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851885.705744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851885.705746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851885.705747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851885.705749:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851885.705750:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851885.705753:0:61303:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851885.705754:0:61303:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851885.705755:0:61303:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851885.840994:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851885.840995:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851885.840996:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851885.840998:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851885.840999:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17651@kfi7 to cpt 6
00000400:00000200:25.0:1773851885.841001:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17651@kfi7 : PUT - for me
00000400:00000200:25.0:1773851885.841001:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17651@kfi7 to cpt 6
00000400:00000200:25.0:1773851885.841002:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713c1e53 nid 17651@kfi7 refs 1
00000400:00000200:25.0:1773851885.841003:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17651@kfi7 to cpt 6
00000400:00000200:25.0:1773851885.841003:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713c1e53 nid 17651@kfi7 refs 2
00000400:00000200:25.0:1773851885.841004:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000713c1e53 nid 17651@kfi7 refs 3
00000400:00000200:25.0:1773851885.841005:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17651@kfi7 to cpt 6
00000400:00000200:25.0:1773851885.841006:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17651@kfi7 of length 224 into portal 12 MB=0x69b4b968bbe40
00000400:00000200:25.0:1773851885.841007:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17651@kfi7 of length 224/224 into md 0x16159c9699 [64] + 29728
00000800:00000200:25.0:1773851885.841009:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851885.841011:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851885.841012:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17651@kfi7: PUT: OK
00000100:00000001:25.0:1773851885.841013:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851885.841013:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851885.841014:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007e20d84d.
00000100:00000040:25.0:1773851885.841015:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000007e20d84d x1859598810857024 msgsize 224
00000100:00100000:25.0:1773851885.841016:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17651@kfi7 (source: 12345-17651@kfi7)
00000100:00000001:25.0:1773851885.841017:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851885.841018:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000713c1e53 nid 17651@kfi7 refs 2
00000100:00000001:26.0:1773851885.841019:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851885.841019:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851885.841020:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851885.841020:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851885.841021:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851885.841021:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851885.841022:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598810857024
00000020:00000001:26.0:1773851885.841023:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851885.841023:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d825a2
00000020:00000001:26.0:1773851885.841024:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851885.841026:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000037569597 refcount=5
00000020:00000001:26.0:1773851885.841026:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113519884288 : -106960189667328 : ffff9eb863e3c800)
00000020:00000001:26.0:1773851885.841027:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113519884288 : -106960189667328 : ffff9eb863e3c800)
00000100:00000001:26.0:1773851885.841028:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851885.841029:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851885.841030:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000066e61092.
00000020:00000010:26.0:1773851885.841031:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851885.841031:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000634fac99.
00000100:00000001:26.0:1773851885.841032:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851885.841033:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851885.841033:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851885.841034:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851885.841035:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851885.841035:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851885.841036:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851885.841038:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851885.841038:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851885.841039:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17651@kfi7, seq: 2025154
00000100:00000040:27.0:1773851885.841040:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000037569597 : new rpc_count 1
00000100:00000001:27.0:1773851885.841041:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252478848 : -106967457072768 : ffff9eb6b2b7f980)
00000100:00000040:27.0:1773851885.841042:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007e20d84d x1859598810857024/t0(0) o400->d5ee30a2-8c66-40b9-b2be-a1f62e2563e0@17651@kfi7:135/0 lens 224/0 e 0 to 0 dl 1773852250 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1577-0'
00000100:00000001:27.0:1773851885.841044:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851885.841045:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851885.841046:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007e20d84d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:d5ee30a2-8c66-40b9-b2be-a1f62e2563e0+5:39701:x1859598810857024:12345-17651@kfi7:400:default-tuolumne1577-0
00000100:00000200:27.0:1773851885.841047:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598810857024
00000020:00000001:27.0:1773851885.841048:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851885.841048:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851885.841049:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851885.841049:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851885.841050:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851885.841051:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851885.841051:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598810857024, found 0 last_xid 1859598810857023
00000020:00000001:27.0:1773851885.841052:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851885.841053:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851885.841053:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851885.841054:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851885.841054:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851885.841055:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851885.841055:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851885.841056:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000679f9c9c.
02000000:00000001:27.0:1773851885.841057:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851885.841057:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851885.841058:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851885.841059:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597119, transno 0, xid 1859598810857024
00010000:00000001:27.0:1773851885.841059:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851885.841060:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007e20d84d x1859598810857024/t0(0) o400->d5ee30a2-8c66-40b9-b2be-a1f62e2563e0@17651@kfi7:135/0 lens 224/224 e 0 to 0 dl 1773852250 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1577-0'
00010000:00000001:27.0:1773851885.841063:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851885.841063:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851885.841064:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=118 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851885.841065:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851885.841066:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009ada1291 refcount 3 to 17651@kfi7
00000100:00000001:27.0:1773851885.841067:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858592 : -107149578693024 : ffff9e8c4b6c9660)
02000000:00000001:27.0:1773851885.841068:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851885.841068:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851885.841069:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851885.841070:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17651@kfi7
00000400:00000010:27.0:1773851885.841070:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000033455368.
00000100:00000200:27.0:1773851885.841071:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598810857024, offset 224
00000400:00000200:27.0:1773851885.841073:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17651@kfi7
00000400:00000200:27.0:1773851885.841074:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17651@kfi7 to cpt 6
00000400:00000200:27.0:1773851885.841074:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713c1e53 nid 17651@kfi7 refs 1
00000400:00000200:27.0:1773851885.841075:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000713c1e53 nid 17651@kfi7 refs 2
00000400:00000200:27.0:1773851885.841077:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000713c1e53 nid 17651@kfi7 refs 3
00000400:00000200:27.0:1773851885.841078:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17651@kfi7 local destination
00000400:00000200:27.0:1773851885.841079:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769840:8769840:1024:4294967295] 17651@kfi7 LPNI seq info [13637827:13637827:16:4294967295]
00000400:00000200:27.0:1773851885.841080:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000713c1e53 nid 17651@kfi7 refs 2
00000400:00000200:27.0:1773851885.841081:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17651@kfi7 to cpt 6
00000400:00000200:27.0:1773851885.841083:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17651@kfi7(17651@kfi7:17651@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851885.841085:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000713c1e53 nid 17651@kfi7 refs 3
00000800:00000200:27.0:1773851885.841086:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851885.841087:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851885.841089:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851885.841091:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000c6 Using peer 17651@kfi7(0x1000000000000c6)
00000800:00000200:27.0:1773851885.841096:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x1000000000000c6: rc=0
00000800:00000200:27.0:1773851885.841098:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851885.841100:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851885.841101:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009ada1291 refcount 2 to 17651@kfi7
00010000:00000001:27.0:1773851885.841102:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851885.841102:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851885.841103:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851885.841104:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007e20d84d x1859598810857024/t0(0) o400->d5ee30a2-8c66-40b9-b2be-a1f62e2563e0@17651@kfi7:135/0 lens 224/224 e 0 to 0 dl 1773852250 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1577-0'
00000100:00100000:27.0:1773851885.841107:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007e20d84d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:d5ee30a2-8c66-40b9-b2be-a1f62e2563e0+5:39701:x1859598810857024:12345-17651@kfi7:400:default-tuolumne1577-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851885.841109:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000c6 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851885.841110:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17651@kfi7, seq: 2025154
00000100:00000040:27.0:1773851885.841111:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000037569597 : new rpc_count 0
00000100:00000001:27.0:1773851885.841111:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851885.841111:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851885.841112:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851885.841112:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851885.841112:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17651@kfi7: PUT: OK
00000020:00000010:27.0:1773851885.841113:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000634fac99.
00000400:00000200:25.0:1773851885.841113:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000033455368
00000400:00000010:25.0:1773851885.841113:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000033455368.
00000020:00000010:27.0:1773851885.841114:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000066e61092.
00000100:00000001:25.0:1773851885.841114:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851885.841114:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:27.0:1773851885.841115:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000037569597 : new refcount 4
00000400:00000200:25.0:1773851885.841115:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000713c1e53 nid 17651@kfi7 refs 2
00000100:00000001:27.0:1773851885.841116:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851885.841117:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2054@kfi7:6 -> 17651@kfi7(00000000815400d1):0x0 lsk 199 rsk 9 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000000c6 Transaction freed
00000004:00000001:6.0:1773851885.897731:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:16.0:1773851885.897732:0:61039:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000020:6.0:1773851885.897732:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851885.897733:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f62829d.
00000020:00000040:6.0:1773851885.897734:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851885.897735:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851885.897736:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851885.897737:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851885.897738:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000433e2d1e.
00000100:00000040:16.0:1773851885.897739:0:61039:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +481s
00000100:00000001:6.0:1773851885.897739:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851885.897740:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851885.897740:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851885.897741:0:61039:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000100:00000001:16.0:1773851885.897742:0:61039:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000040:6.0:1773851885.897742:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001f62829d] to pc [ptlrpcd_01_00+0]  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:16.0:1773851885.897744:0:61039:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -310s) for 315+30  req@0000000028026b49 x1860017285302400/t0(0) o101->77619cb0-8f4f-4f76-8139-796ed1eec537@8193@kfi7:530/0 lens 592/5304 e 9 to 0 dl 1773851890 ref 2 fl Interpret:/0/0 rc 0/0 job:'tuolumne-834501773553172480'
00080000:00000001:6.0:1773851885.897746:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:6.0:1773851885.897747:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000002a0c38fc.
00000100:00000001:7.0:1773851885.897748:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:6.0:1773851885.897748:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637087052304384 : -106986657247232 : ffff9eb23a4c9000)
00000100:00000001:4.0:1773851885.897748:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851885.897749:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851885.897749:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851885.897749:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851885.897749:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851885.897750:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851885.897750:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851885.897751:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000004:00000010:6.0:1773851885.897752:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002aa2fcf0.
00000100:00000001:7.0:1773851885.897753:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851885.897753:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851885.897753:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614160351028391ns, next at 614161351027429ns, rc = 0
02000000:00000001:7.0:1773851885.897754:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:6.0:1773851885.897754:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851885.897755:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851885.897755:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851885.897756:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001f62829d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051935936:16@kfi7:13:default-yuba2-0
00000004:00000001:6.0:1773851885.897756:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851885.897757:0:61039:0:(import.c:1951:at_measured()) add 340 to 00000000268b17f2 time=118 v=315 (315 214 1 1)
00000100:00000001:7.0:1773851885.897757:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851885.897757:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851885.897758:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851885.897759:0:61039:0:(import.c:2016:at_measured()) AT 00000000268b17f2 change: old=315 new=340 delta=25 (val=340) hist 340 214 1 1
02000000:00000001:7.0:1773851885.897759:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851885.897759:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000067b7447a.
02000000:00000001:7.0:1773851885.897760:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851885.897761:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000100:00000010:16.0:1773851885.897762:0:61039:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000caa5ad98.
00000400:00000010:7.0:1773851885.897762:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:7.0:1773851885.897763:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000100:00000010:16.0:1773851885.897764:0:61039:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 592 at 00000000a8ac8f28.
00000100:00000200:7.0:1773851885.897765:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051935936, portal 4
00000100:00000001:7.0:1773851885.897765:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000020:00000001:16.0:1773851885.897766:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851885.897766:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a66cfd
00000100:00000001:7.0:1773851885.897766:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814064640 : -107101895486976 : ffff9e9765909200)
00000100:00000040:7.0:1773851885.897767:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:16.0:1773851885.897768:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851885.897769:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eeb0d8da refcount=9
00000020:00000001:16.0:1773851885.897770:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132685773824 : -106941023777792 : ffff9ebcda440c00)
00000100:00000001:7.0:1773851885.897770:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851885.897770:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:7.0:1773851885.897771:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc26fd9e.
00000020:00000001:16.0:1773851885.897772:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132685773824 : -106941023777792 : ffff9ebcda440c00)
00000100:00000200:7.0:1773851885.897772:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051935936, offset 0
00000100:00000040:16.0:1773851885.897774:0:61039:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 00000000eeb0d8da : new rpc_count 2
00000400:00000200:7.0:1773851885.897774:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000100:00000001:16.0:1773851885.897775:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:7.0:1773851885.897775:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
02000000:00000001:16.0:1773851885.897776:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:7.0:1773851885.897776:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
02000000:00000010:16.0:1773851885.897777:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000060477f49.
00000400:00000200:7.0:1773851885.897777:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851885.897778:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
02000000:00000001:16.0:1773851885.897779:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.897780:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851885.897780:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:7.0:1773851885.897781:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769839, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769840, p:4294967295, g:4294967295, h:1000]
00010000:00000001:16.0:1773851885.897782:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851885.897783:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851885.897783:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:16.0:1773851885.897784:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000400:00000200:7.0:1773851885.897784:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:16.0:1773851885.897785:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000118b0a6e refcount 5 to 8193@kfi7
00000400:00000200:7.0:1773851885.897785:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:7.0:1773851885.897786:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769841:8769841:1024:4294967295] 16@kfi7 LPNI seq info [5403819:5403819:16:4294967295]
00000100:00000001:16.0:1773851885.897787:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231608608 : -107130477943008 : ffff9e90bdeae720)
00000400:00000200:7.0:1773851885.897787:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
02000000:00000001:16.0:1773851885.897788:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000400:00000200:7.0:1773851885.897788:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
02000000:00000001:16.0:1773851885.897791:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851885.897791:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000100:00000001:16.0:1773851885.897792:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851885.897793:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8385@kfi7
00000400:00000200:7.0:1773851885.897793:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000010:16.0:1773851885.897795:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c3bdcee3.
00000800:00000200:7.0:1773851885.897796:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000200:16.0:1773851885.897797:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860017285302400, offset 0
00000800:00000200:7.0:1773851885.897798:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:16.0:1773851885.897800:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8385@kfi7
00000400:00000200:16.0:1773851885.897802:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8385@kfi7 to cpt 4
00000800:00000200:7.0:1773851885.897802:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:16.0:1773851885.897804:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df944ca6 nid 8385@kfi7 refs 1
00000400:00000200:16.0:1773851885.897806:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000df944ca6 nid 8385@kfi7 refs 2
00000400:00000200:16.0:1773851885.897808:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000df944ca6 nid 8385@kfi7 refs 3
00000800:00000200:7.0:1773851885.897810:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Using peer 16@kfi7(0x15d)
00000400:00000200:16.0:1773851885.897811:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8385@kfi7 local destination
00000400:00000200:16.0:1773851885.897814:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769842:8769842:1023:4294967295] 8385@kfi7 LPNI seq info [9187008:9187008:16:4294967295]
00000800:00000200:7.0:1773851885.897816:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x15d: rc=0
00000400:00000200:16.0:1773851885.897817:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000df944ca6 nid 8385@kfi7 refs 2
00000400:00000200:16.0:1773851885.897818:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8385@kfi7 to cpt 4
00000800:00000200:7.0:1773851885.897819:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851885.897822:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:16.0:1773851885.897823:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8385@kfi7(8385@kfi7:8385@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851885.897823:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:16.0:1773851885.897825:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000df944ca6 nid 8385@kfi7 refs 3
00000100:00000001:7.0:1773851885.897825:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.897826:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.897827:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:16.0:1773851885.897828:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:7.0:1773851885.897829:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:16.0:1773851885.897830:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:7.0:1773851885.897830:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851885.897831:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851885.897832:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851885.897832:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.897833:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851885.897833:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_EVENT_TX_OK event status 0
00000800:00000200:16.0:1773851885.897835:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:5.0:1773851885.897836:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851885.897839:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000800:00000200:16.0:1773851885.897840:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 Using peer 8385@kfi7(0xe38)
00000400:00000200:5.0:1773851885.897840:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc26fd9e
00000400:00000010:5.0:1773851885.897841:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc26fd9e.
00000100:00000001:5.0:1773851885.897842:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851885.897844:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:16.0:1773851885.897846:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0xe38: rc=0
00000800:00000200:16.0:1773851885.897848:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851885.897850:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851885.897851:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:16.0:1773851885.897852:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851885.897856:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851885.897857:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000118b0a6e refcount 4 to 8193@kfi7
00000100:00000040:16.0:1773851885.897858:0:61039:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 00000000eeb0d8da : new rpc_count 1
00000100:00000001:5.0:1773851885.897858:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851885.897859:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000020:00000040:16.0:1773851885.897860:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000eeb0d8da : new refcount 8
00000100:00000010:16.0:1773851885.897861:0:61039:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 592 at 00000000a8ac8f28.
00000100:00000010:16.0:1773851885.897862:0:61039:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000caa5ad98.
00000800:00000200:5.0:1773851885.897862:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Transaction freed
00000100:00000001:16.0:1773851885.897864:0:61039:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851885.897866:0:61039:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +25s
00000100:00000001:16.0:1773851885.897867:0:61039:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851885.897879:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851885.897883:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851885.897884:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8385@kfi7: PUT: OK
00000400:00000200:17.0:1773851885.897886:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c3bdcee3
00000400:00000010:17.0:1773851885.897887:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c3bdcee3.
00000100:00000001:17.0:1773851885.897888:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:17.0:1773851885.897889:0:2511435:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:17.0:1773851885.897890:0:2511435:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000060477f49.
02000000:00000001:17.0:1773851885.897892:0:2511435:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:17.0:1773851885.897893:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851885.897894:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000df944ca6 nid 8385@kfi7 refs 2
00000800:00000200:17.0:1773851885.897897:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8385@kfi7(00000000f49da052):0x0 lsk 3641 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe38 Transaction freed
00000800:00000200:29.0:1773851885.897935:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851885.897937:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851885.897939:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851885.897943:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851885.897947:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.897950:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851885.897951:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.897954:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851885.897956:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.897957:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851885.897959:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851885.897961:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.897962:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b54c0
00000400:00000200:29.0:1773851885.897964:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851885.897966:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x78008169d [1] + 224
00000800:00000200:29.0:1773851885.897970:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851885.897973:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851885.897975:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851885.897977:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851885.897978:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851885.897983:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851885.897989:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851885.897991:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:29.0:1773851885.897993:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851885.897993:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851885.897993:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851885.897995:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851885.897995:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851885.897997:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851885.897997:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000400:00000010:7.0:1773851885.897998:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:7.0:1773851885.898000:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851885.898001:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851885.898006:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851885.898010:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851885.898011:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851885.898012:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851885.898013:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851885.898014:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851885.898015:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851885.898016:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851885.898019:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=118 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851885.898021:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=118 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851885.898022:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851885.898023:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851885.898024:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851885.898025:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.898026:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851885.898027:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:7.0:1773851885.898028:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851885.898029:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851885.898030:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851885.898035:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851885.898036:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851885.898036:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851885.898038:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851885.898039:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851885.898040:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482180608 avail=351481243648 avail_mb=1372973608 hwm_mb=3131103 files=372097084 ffree=343244317 state=0: rc = 0
00000004:00000020:7.0:1773851885.898043:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482180608 free, 351481243648 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097084 files, 343244317 free files
00000004:00000001:7.0:1773851885.898045:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851885.898047:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851885.898051:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001f62829d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051935936:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851885.898054:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851885.898055:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851885.898056:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001f62829d x1859433051935936/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852038 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851885.898060:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851885.898061:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851885.898061:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000067b7447a.
02000000:00000001:7.0:1773851885.898063:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851885.898064:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851885.898065:0:41064:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:7.0:1773851885.898066:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851885.898067:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000433e2d1e.
02000000:00000001:7.0:1773851885.898068:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851885.898069:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851885.898070:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f62829d.
00000100:00000001:7.0:1773851885.898071:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851885.898071:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851885.898072:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851885.898074:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851885.898074:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851885.898075:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851885.898076:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851885.901019:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851885.901019:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851885.901021:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851885.901021:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851885.901023:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851885.901023:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851885.901027:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851885.901027:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20914@kfi7(00000000625a7c5e):0x438 version: 2; local version 2; negotiated version: 2
00000400:00000200:6.0:1773851885.901030:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20914@kfi7 to cpt 1
00000800:00000200:5.0:1773851885.901030:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 Using peer 20914@kfi7(0x438)
00000400:00000200:6.0:1773851885.901032:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20914@kfi7 : PUT - for me
00000400:00000200:5.0:1773851885.901033:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20914@kfi7 to cpt 1
00000400:00000200:6.0:1773851885.901034:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20914@kfi7 to cpt 1
00000400:00000200:6.0:1773851885.901036:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016c9c6aa nid 20914@kfi7 refs 1
00000800:00000200:5.0:1773851885.901036:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 38 bytes to peer 0x438: rc=0
00000400:00000200:6.0:1773851885.901037:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20914@kfi7 to cpt 1
00000400:00000200:6.0:1773851885.901039:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016c9c6aa nid 20914@kfi7 refs 2
00000800:00000200:5.0:1773851885.901039:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851885.901041:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000016c9c6aa nid 20914@kfi7 refs 3
00000400:00000200:6.0:1773851885.901042:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20851@kfi7 to cpt 1
00000400:00000200:6.0:1773851885.901044:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20851@kfi7 of length 224 into portal 12 MB=0x69b1738189740
00000400:00000200:6.0:1773851885.901046:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20851@kfi7 of length 224/224 into md 0x793926dc5 [64] + 155888
00000800:00000200:6.0:1773851885.901050:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851885.901052:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851885.901053:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851885.901054:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20914@kfi7: PUT: OK
00000100:00000001:6.0:1773851885.901056:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:5.0:1773851885.901056:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 Transaction freed
00000100:00000200:6.0:1773851885.901057:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851885.901058:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000003d1b49d.
00000100:00000040:6.0:1773851885.901060:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000003d1b49d x1859373887952704 msgsize 224
00000100:00100000:6.0:1773851885.901063:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-20851@kfi7 (source: 12345-20914@kfi7)
00000100:00000001:6.0:1773851885.901064:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851885.901066:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000016c9c6aa nid 20914@kfi7 refs 2
00000100:00000001:4.0:1773851885.901066:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851885.901066:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851885.901067:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851885.901067:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851885.901068:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851885.901068:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851885.901069:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373887952704
00000020:00000001:4.0:1773851885.901070:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851885.901070:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793aed50be
00000020:00000001:4.0:1773851885.901071:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851885.901072:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e2cbe338 refcount=349
00000020:00000001:4.0:1773851885.901073:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636957978762240 : -107115730789376 : ffff9e942cea9c00)
00000020:00000001:4.0:1773851885.901074:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636957978762240 : -107115730789376 : ffff9e942cea9c00)
00000100:00000001:4.0:1773851885.901075:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851885.901076:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851885.901076:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001dd2088e.
00000020:00000010:4.0:1773851885.901078:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851885.901079:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851885.901080:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851885.901080:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851885.901082:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851885.901082:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851885.901083:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851885.901084:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851885.901084:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851885.901086:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851885.901086:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851885.901087:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:4.0:1773851885.901087:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20851@kfi7, seq: 2001965
00000100:00000001:7.0:1773851885.901088:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:4.0:1773851885.901088:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e2cbe338 : new rpc_count 2
00000100:00000001:7.0:1773851885.901089:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851885.901089:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814075008 : -107101895476608 : ffff9e976590ba80)
00000100:00000001:7.0:1773851885.901090:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851885.901090:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000003d1b49d x1859373887952704/t0(0) o400->273df3b6-9fa1-4c12-8521-702eef7fcac7@20851@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1786-0'
00000100:00000001:4.0:1773851885.901093:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851885.901093:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851885.901094:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003d1b49d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:273df3b6-9fa1-4c12-8521-702eef7fcac7+349:39868:x1859373887952704:12345-20851@kfi7:400:default-tuolumne1786-0
00000100:00000200:4.0:1773851885.901096:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373887952704
00000020:00000001:4.0:1773851885.901096:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851885.901097:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851885.901098:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.901098:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851885.901099:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851885.901100:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851885.901100:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373887952704, found 0 last_xid 1859373862553727
00000020:00000001:4.0:1773851885.901101:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851885.901102:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851885.901103:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851885.901103:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.901104:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851885.901105:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851885.901105:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851885.901107:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000ae6ea09.
02000000:00000001:4.0:1773851885.901108:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851885.901108:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.901109:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851885.901110:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264075629, transno 0, xid 1859373887952704
00010000:00000001:4.0:1773851885.901111:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851885.901112:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000003d1b49d x1859373887952704/t0(0) o400->273df3b6-9fa1-4c12-8521-702eef7fcac7@20851@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1786-0'
00010000:00000001:4.0:1773851885.901114:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851885.901115:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851885.901115:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=117 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851885.901117:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851885.901117:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036181180 refcount 3 to 20851@kfi7
00000100:00000001:4.0:1773851885.901118:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740761792 : -107153968789824 : ffff9e8b45c106c0)
02000000:00000001:4.0:1773851885.901119:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851885.901119:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851885.901120:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851885.901121:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20914@kfi7
00000400:00000010:4.0:1773851885.901122:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ae348a6c.
00000100:00000200:4.0:1773851885.901122:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373887952704, offset 224
00000400:00000200:4.0:1773851885.901124:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20914@kfi7
00000400:00000200:4.0:1773851885.901125:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20914@kfi7 to cpt 1
00000400:00000200:4.0:1773851885.901126:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016c9c6aa nid 20914@kfi7 refs 1
00000400:00000200:4.0:1773851885.901127:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000016c9c6aa nid 20914@kfi7 refs 2
00000400:00000200:4.0:1773851885.901128:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000016c9c6aa nid 20914@kfi7 refs 3
00000400:00000200:4.0:1773851885.901129:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20914@kfi7 local destination
00000400:00000200:4.0:1773851885.901130:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769843:8769843:1024:4294967295] 20914@kfi7 LPNI seq info [3493449:3493449:16:4294967295]
00000400:00000200:4.0:1773851885.901132:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000016c9c6aa nid 20914@kfi7 refs 2
00000400:00000200:4.0:1773851885.901132:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20914@kfi7 to cpt 1
00000400:00000200:4.0:1773851885.901134:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20914@kfi7(20914@kfi7:20914@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851885.901136:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000016c9c6aa nid 20914@kfi7 refs 3
00000800:00000200:4.0:1773851885.901137:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851885.901138:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851885.901140:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851885.901143:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 Using peer 20914@kfi7(0x438)
00000800:00000200:4.0:1773851885.901146:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x438: rc=0
00000800:00000200:4.0:1773851885.901147:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851885.901149:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851885.901150:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036181180 refcount 2 to 20851@kfi7
00010000:00000001:4.0:1773851885.901151:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851885.901151:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851885.901152:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851885.901153:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000003d1b49d x1859373887952704/t0(0) o400->273df3b6-9fa1-4c12-8521-702eef7fcac7@20851@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1786-0'
00000100:00100000:4.0:1773851885.901157:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003d1b49d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:273df3b6-9fa1-4c12-8521-702eef7fcac7+349:39868:x1859373887952704:12345-20851@kfi7:400:default-tuolumne1786-0 Request processed in 64us (97us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851885.901160:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20851@kfi7, seq: 2001965
00000100:00000040:4.0:1773851885.901160:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e2cbe338 : new rpc_count 1
00000100:00000001:4.0:1773851885.901161:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851885.901162:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851885.901163:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851885.901163:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851885.901164:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001dd2088e.
00000020:00000040:4.0:1773851885.901165:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e2cbe338 : new refcount 348
00000100:00000001:4.0:1773851885.901166:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851885.901172:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851885.901175:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851885.901177:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20914@kfi7: PUT: OK
00000400:00000200:5.0:1773851885.901178:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ae348a6c
00000400:00000010:5.0:1773851885.901179:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ae348a6c.
00000100:00000001:5.0:1773851885.901180:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851885.901180:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851885.901182:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000016c9c6aa nid 20914@kfi7 refs 2
00000800:00000200:5.0:1773851885.901185:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 20914@kfi7(00000000625a7c5e):0x0 lsk 1081 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x438 Transaction freed
00000800:00000200:1.0:1773851885.926014:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851885.926015:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851885.926016:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851885.926018:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851885.926020:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.926021:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8643@kfi7 : PUT - for me
00000400:00000200:1.0:1773851885.926022:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.926023:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:1.0:1773851885.926024:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851885.926025:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:1.0:1773851885.926025:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:1.0:1773851885.926026:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8642@kfi7 to cpt 5
00000400:00000200:1.0:1773851885.926027:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8642@kfi7 of length 224 into portal 12 MB=0x69b2fcca1ea80
00000400:00000200:1.0:1773851885.926029:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8642@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 43648
00000800:00000200:1.0:1773851885.926031:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851885.926033:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851885.926034:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8643@kfi7: PUT: OK
00000100:00000001:1.0:1773851885.926035:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851885.926035:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851885.926036:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000077fb3542.
00000100:00000040:1.0:1773851885.926037:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000077fb3542 x1859479459195520 msgsize 224
00000100:00100000:1.0:1773851885.926039:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8642@kfi7 (source: 12345-8643@kfi7)
00000100:00000001:1.0:1773851885.926040:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851885.926041:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000100:00000001:0.0:1773851885.926041:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851885.926042:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851885.926042:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851885.926042:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851885.926043:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851885.926044:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851885.926044:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479459195520
00000020:00000001:0.0:1773851885.926045:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851885.926045:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2dc17
00000020:00000001:0.0:1773851885.926047:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851885.926050:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c985270 refcount=8
00000020:00000001:0.0:1773851885.926050:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000020:00000001:0.0:1773851885.926051:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000100:00000001:0.0:1773851885.926052:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851885.926053:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851885.926054:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ce9c9c6a.
00000020:00000010:0.0:1773851885.926056:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851885.926056:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851885.926057:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851885.926058:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851885.926058:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851885.926059:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851885.926060:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851885.926060:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.926061:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851885.926062:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851885.926063:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851885.926063:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851885.926063:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851885.926064:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8642@kfi7, seq: 1997605
00000100:00000001:1.0:1773851885.926065:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851885.926065:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851885.926065:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c985270 : new rpc_count 1
00000100:00000001:0.0:1773851885.926066:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112241408 : -106950597310208 : ffff9eba9fa38900)
00000100:00000040:0.0:1773851885.926067:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000077fb3542 x1859479459195520/t0(0) o400->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:612/0 lens 224/0 e 0 to 0 dl 1773851972 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1031-0'
00000100:00000001:0.0:1773851885.926069:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851885.926070:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851885.926071:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077fb3542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:40020:x1859479459195520:12345-8642@kfi7:400:default-tuolumne1031-0
00000100:00000200:0.0:1773851885.926072:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479459195520
00000020:00000001:0.0:1773851885.926073:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851885.926073:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851885.926074:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.926075:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851885.926075:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851885.926077:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851885.926077:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479459195520, found 0 last_xid 1859479459195519
00000020:00000001:0.0:1773851885.926078:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851885.926079:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851885.926079:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851885.926080:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.926080:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851885.926081:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851885.926081:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851885.926082:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009492f30b.
02000000:00000001:0.0:1773851885.926083:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.926084:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.926084:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851885.926085:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183033875552, transno 0, xid 1859479459195520
00010000:00000001:0.0:1773851885.926086:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851885.926086:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000077fb3542 x1859479459195520/t0(0) o400->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1031-0'
00010000:00000001:0.0:1773851885.926089:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851885.926089:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851885.926090:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=118 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851885.926091:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851885.926092:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0e27e8d refcount 3 to 8642@kfi7
00000100:00000001:0.0:1773851885.926093:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636920560355392 : -107153149196224 : ffff9e8b769b0840)
02000000:00000001:0.0:1773851885.926094:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851885.926094:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851885.926095:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851885.926096:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8643@kfi7
00000400:00000010:0.0:1773851885.926096:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000080b751ba.
00000100:00000200:0.0:1773851885.926097:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859479459195520, offset 224
00000400:00000200:0.0:1773851885.926098:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8643@kfi7
00000400:00000200:0.0:1773851885.926099:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:0.0:1773851885.926100:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:0.0:1773851885.926101:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:0.0:1773851885.926102:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:0.0:1773851885.926104:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8643@kfi7 local destination
00000400:00000200:0.0:1773851885.926105:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769844:8769844:1024:4294967295] 8643@kfi7 LPNI seq info [4079471:4079471:16:4294967295]
00000400:00000200:0.0:1773851885.926107:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:0.0:1773851885.926107:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:0.0:1773851885.926109:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8643@kfi7(8643@kfi7:8643@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851885.926111:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000800:00000200:0.0:1773851885.926112:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851885.926113:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851885.926115:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851885.926117:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001272 Using peer 8643@kfi7(0x100000000001272)
00000800:00000200:0.0:1773851885.926120:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x100000000001272: rc=0
00000800:00000200:0.0:1773851885.926121:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001272 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851885.926123:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851885.926124:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0e27e8d refcount 2 to 8642@kfi7
00010000:00000001:0.0:1773851885.926125:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851885.926125:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851885.926126:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851885.926127:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000077fb3542 x1859479459195520/t0(0) o400->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:612/0 lens 224/224 e 0 to 0 dl 1773851972 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1031-0'
00000100:00100000:0.0:1773851885.926131:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077fb3542 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:40020:x1859479459195520:12345-8642@kfi7:400:default-tuolumne1031-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851885.926133:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8642@kfi7, seq: 1997605
00000100:00000040:0.0:1773851885.926134:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c985270 : new rpc_count 0
00000100:00000001:0.0:1773851885.926134:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851885.926135:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851885.926136:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851885.926137:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851885.926138:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ce9c9c6a.
00000020:00000040:0.0:1773851885.926138:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 7
00000100:00000001:0.0:1773851885.926139:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851885.926146:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001272 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851885.926148:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851885.926149:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8643@kfi7: PUT: OK
00000400:00000200:1.0:1773851885.926149:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000080b751ba
00000400:00000010:1.0:1773851885.926150:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000080b751ba.
00000100:00000001:1.0:1773851885.926151:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851885.926151:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851885.926152:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000800:00000200:1.0:1773851885.926154:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 8643@kfi7(00000000a75d84e7):0x0 lsk 4723 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001272 Transaction freed
00000800:00000200:17.0:1773851885.983543:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851885.983543:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851885.983545:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851885.983547:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851885.983548:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19488@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.983550:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19488@kfi7 : PUT - for me
00000400:00000200:17.0:1773851885.983551:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19488@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.983551:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d1d16f1 nid 19488@kfi7 refs 1
00000400:00000200:17.0:1773851885.983553:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19488@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.983553:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d1d16f1 nid 19488@kfi7 refs 2
00000400:00000200:17.0:1773851885.983554:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003d1d16f1 nid 19488@kfi7 refs 3
00000400:00000200:17.0:1773851885.983555:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19681@kfi7 to cpt 1
00000400:00000200:17.0:1773851885.983556:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19681@kfi7 of length 224 into portal 12 MB=0x69b4b76a9d1c0
00000400:00000200:17.0:1773851885.983557:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19681@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 36688
00000800:00000200:17.0:1773851885.983560:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851885.983561:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851885.983562:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19488@kfi7: PUT: OK
00000100:00000001:17.0:1773851885.983564:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851885.983565:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851885.983565:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e239dbe0.
00000100:00000040:17.0:1773851885.983566:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000e239dbe0 x1859598275957184 msgsize 224
00000100:00100000:17.0:1773851885.983568:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19681@kfi7 (source: 12345-19488@kfi7)
00000100:00000001:17.0:1773851885.983568:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851885.983569:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003d1d16f1 nid 19488@kfi7 refs 2
00000100:00000001:16.0:1773851885.983570:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851885.983571:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2069@kfi7:4 <- 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851885.983571:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851885.983571:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851885.983572:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851885.983572:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851885.983573:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598275957184
00000020:00000001:16.0:1773851885.983574:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851885.983575:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e73d1d
00000020:00000001:16.0:1773851885.983575:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851885.983578:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000018178951 refcount=5
00000020:00000001:16.0:1773851885.983579:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119305054208 : -106954404497408 : ffff9eb9bcb67800)
00000020:00000001:16.0:1773851885.983580:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119305054208 : -106954404497408 : ffff9eb9bcb67800)
00000100:00000001:16.0:1773851885.983581:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851885.983582:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851885.983582:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060477f49.
00000020:00000010:16.0:1773851885.983584:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851885.983584:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000095be4e87.
00000100:00000001:16.0:1773851885.983586:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851885.983586:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851885.983587:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851885.983588:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851885.983588:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851885.983589:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851885.983590:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851885.983591:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851885.983591:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851885.983592:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851885.983592:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851885.983593:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19681@kfi7, seq: 2156396
00000100:00000040:17.0:1773851885.983594:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000018178951 : new rpc_count 1
00000100:00000001:16.0:1773851885.983594:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851885.983595:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102201600 : -107041607350016 : ffff9ea56f048900)
00000100:00000001:16.0:1773851885.983595:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851885.983596:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e239dbe0 x1859598275957184/t0(0) o400->2041eee8-28a7-4630-807e-edab0d9f42a7@19681@kfi7:137/0 lens 224/0 e 0 to 0 dl 1773852252 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1711-0'
00000100:00000001:17.0:1773851885.983598:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851885.983599:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851885.983600:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e239dbe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2041eee8-28a7-4630-807e-edab0d9f42a7+5:39448:x1859598275957184:12345-19681@kfi7:400:default-tuolumne1711-0
00000100:00000200:17.0:1773851885.983601:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598275957184
00000020:00000001:17.0:1773851885.983602:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851885.983603:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851885.983603:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851885.983604:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851885.983605:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851885.983606:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851885.983606:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598275957184, found 0 last_xid 1859598275957183
00000020:00000001:17.0:1773851885.983607:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851885.983608:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851885.983608:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851885.983609:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851885.983609:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851885.983610:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851885.983611:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851885.983612:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fe2616b9.
02000000:00000001:17.0:1773851885.983613:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851885.983613:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851885.983614:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851885.983614:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096685498, transno 0, xid 1859598275957184
00010000:00000001:17.0:1773851885.983615:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851885.983616:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e239dbe0 x1859598275957184/t0(0) o400->2041eee8-28a7-4630-807e-edab0d9f42a7@19681@kfi7:137/0 lens 224/224 e 0 to 0 dl 1773852252 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1711-0'
00010000:00000001:17.0:1773851885.983618:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851885.983619:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851885.983620:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=118 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851885.983621:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851885.983621:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e9661aa refcount 3 to 19681@kfi7
00000100:00000001:17.0:1773851885.983622:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411520 : -107145304140096 : ffff9e8d4a3516c0)
02000000:00000001:17.0:1773851885.983623:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851885.983623:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851885.983624:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851885.983625:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19488@kfi7
00000400:00000010:17.0:1773851885.983626:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006a8bd081.
00000100:00000200:17.0:1773851885.983626:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598275957184, offset 224
00000400:00000200:17.0:1773851885.983628:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19488@kfi7
00000400:00000200:17.0:1773851885.983629:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19488@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.983629:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d1d16f1 nid 19488@kfi7 refs 1
00000400:00000200:17.0:1773851885.983630:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003d1d16f1 nid 19488@kfi7 refs 2
00000400:00000200:17.0:1773851885.983632:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003d1d16f1 nid 19488@kfi7 refs 3
00000400:00000200:17.0:1773851885.983633:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19488@kfi7 local destination
00000400:00000200:17.0:1773851885.983634:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769845:8769845:1024:4294967295] 19488@kfi7 LPNI seq info [12205083:12205083:16:4294967295]
00000400:00000200:17.0:1773851885.983635:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003d1d16f1 nid 19488@kfi7 refs 2
00000400:00000200:17.0:1773851885.983636:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19488@kfi7 to cpt 4
00000400:00000200:17.0:1773851885.983638:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19488@kfi7(19488@kfi7:19488@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851885.983639:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003d1d16f1 nid 19488@kfi7 refs 3
00000800:00000200:17.0:1773851885.983640:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851885.983641:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851885.983643:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851885.983646:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe07 Using peer 19488@kfi7(0xe07)
00000800:00000200:17.0:1773851885.983649:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0xe07: rc=0
00000800:00000200:17.0:1773851885.983650:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe07 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851885.983652:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851885.983653:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e9661aa refcount 2 to 19681@kfi7
00010000:00000001:17.0:1773851885.983654:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851885.983654:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851885.983655:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851885.983655:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e239dbe0 x1859598275957184/t0(0) o400->2041eee8-28a7-4630-807e-edab0d9f42a7@19681@kfi7:137/0 lens 224/224 e 0 to 0 dl 1773852252 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1711-0'
00000100:00100000:17.0:1773851885.983658:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e239dbe0 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2041eee8-28a7-4630-807e-edab0d9f42a7+5:39448:x1859598275957184:12345-19681@kfi7:400:default-tuolumne1711-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851885.983661:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19681@kfi7, seq: 2156396
00000100:00000040:17.0:1773851885.983662:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000018178951 : new rpc_count 0
00000100:00000001:17.0:1773851885.983662:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851885.983663:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe07 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851885.983663:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:18.0:1773851885.983664:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851885.983664:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:17.0:1773851885.983664:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000095be4e87.
00000020:00000010:17.0:1773851885.983665:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060477f49.
00000400:00000200:18.0:1773851885.983666:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19488@kfi7: PUT: OK
00000400:00000200:18.0:1773851885.983666:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006a8bd081
00000020:00000040:17.0:1773851885.983666:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000018178951 : new refcount 4
00000100:00000001:17.0:1773851885.983667:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:18.0:1773851885.983668:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006a8bd081.
00000100:00000001:18.0:1773851885.983668:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851885.983669:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851885.983670:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003d1d16f1 nid 19488@kfi7 refs 2
00000800:00000200:18.0:1773851885.983671:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2069@kfi7:4 -> 19488@kfi7(00000000a4125275):0x0 lsk 3592 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe07 Transaction freed
00000800:00000200:6.0:1773851886.011463:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851886.011463:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851886.011463:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851886.011464:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851886.011465:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851886.011465:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851886.011466:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21456@kfi7(00000000716efd3d):0x441 version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851886.011467:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851886.011468:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 Using peer 21456@kfi7(0x100000000000441)
00000400:00000200:6.0:1773851886.011469:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21456@kfi7 to cpt 1
00000400:00000200:6.0:1773851886.011470:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21456@kfi7 : PUT - for me
00000400:00000200:5.0:1773851886.011470:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21456@kfi7 to cpt 1
00000400:00000200:6.0:1773851886.011471:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21456@kfi7 to cpt 1
00000400:00000200:6.0:1773851886.011472:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ce85d2ce nid 21456@kfi7 refs 1
00000800:00000200:5.0:1773851886.011472:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 38 bytes to peer 0x100000000000441: rc=0
00000400:00000200:6.0:1773851886.011473:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21456@kfi7 to cpt 1
00000800:00000200:5.0:1773851886.011473:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851886.011474:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ce85d2ce nid 21456@kfi7 refs 2
00000400:00000200:6.0:1773851886.011475:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ce85d2ce nid 21456@kfi7 refs 3
00000400:00000200:6.0:1773851886.011476:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21264@kfi7 to cpt 7
00000400:00000200:6.0:1773851886.011477:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21264@kfi7 of length 456 into portal 12 MB=0x69a9e054f9b80
00000400:00000200:6.0:1773851886.011479:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21264@kfi7 of length 456/456 into md 0x793926dc5 [64] + 156112
00000800:00000200:6.0:1773851886.011480:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851886.011482:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851886.011483:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21456@kfi7: PUT: OK
00000100:00000001:6.0:1773851886.011484:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851886.011484:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851886.011485:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f62829d.
00000800:00000200:5.0:1773851886.011485:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 TN_EVENT_TX_OK event status 0
00000100:00000040:6.0:1773851886.011486:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000001f62829d x1858853344877440 msgsize 456
00000100:00100000:6.0:1773851886.011487:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-21264@kfi7 (source: 12345-21456@kfi7)
00000800:00000200:5.0:1773851886.011487:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 Transaction freed
00000100:00000001:6.0:1773851886.011488:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851886.011489:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ce85d2ce nid 21456@kfi7 refs 2
00000100:00000001:4.0:1773851886.011489:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851886.011490:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2054@kfi7:1 <- 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851886.011490:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851886.011490:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851886.011491:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851886.011492:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851886.011492:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858853344877440
00000020:00000001:4.0:1773851886.011493:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851886.011493:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918c7
00000020:00000001:4.0:1773851886.011495:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851886.011498:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f7a2a9f refcount=642
00000020:00000001:4.0:1773851886.011499:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241989120 : -107152467562496 : ffff9e8b9f3bf000)
00000020:00000001:4.0:1773851886.011500:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241989120 : -107152467562496 : ffff9e8b9f3bf000)
00000100:00000001:4.0:1773851886.011501:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851886.011502:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851886.011503:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851886.011504:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851886.011504:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851886.011505:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851886.011506:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851886.011506:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.011507:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.011508:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851886.011510:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851886.011510:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851886.011510:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851886.011510:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851886.011511:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21264@kfi7, seq: 371100847
00000100:00000001:7.0:1773851886.011512:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.011512:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f7a2a9f : new rpc_count 8
00000100:00000001:7.0:1773851886.011513:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.011513:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814064640 : -107101895486976 : ffff9e9765909200)
00000100:00000040:4.0:1773851886.011514:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001f62829d x1858853344877440/t0(0) o17->628ab049-f83e-430f-963a-928b8c6224b2@21264@kfi7:674/0 lens 456/0 e 0 to 0 dl 1773852034 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1825-0'
00000100:00000001:4.0:1773851886.011516:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851886.011517:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851886.011518:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f62829d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:628ab049-f83e-430f-963a-928b8c6224b2+642:39841:x1858853344877440:12345-21264@kfi7:17:default-tuolumne1825-0
00000100:00000200:4.0:1773851886.011519:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858853344877440
00000020:00000001:4.0:1773851886.011520:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851886.011520:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851886.011521:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.011522:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851886.011522:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:4.0:1773851886.011523:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851886.011524:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858853344877440, found 0 last_xid 1858853306708543
00000020:00000001:4.0:1773851886.011525:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851886.011526:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851886.011526:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851886.011527:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851886.011527:0:61015:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:4.0:1773851886.011528:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851886.011529:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851886.011530:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000007695976d.
02000000:00000001:4.0:1773851886.011531:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.011532:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.011533:0:61015:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:4.0:1773851886.011533:0:61015:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:4.0:1773851886.011534:0:61015:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:4.0:1773851886.011535:0:61015:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.011536:0:61015:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:4.0:1773851886.011537:0:61015:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 628ab049-f83e-430f-963a-928b8c6224b2/000000004f7a2a9f free: 126633370845184 avail: 126633368748032
00000020:00000001:4.0:1773851886.011538:0:61015:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:4.0:1773851886.011538:0:61015:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 628ab049-f83e-430f-963a-928b8c6224b2/000000004f7a2a9f avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:4.0:1773851886.011540:0:61015:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:4.0:1773851886.011541:0:61015:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:4.0:1773851886.011541:0:61015:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 628ab049-f83e-430f-963a-928b8c6224b2/000000004f7a2a9f reports grant 1793196031 dropped 0, local 1864499199
00000020:00000001:4.0:1773851886.011542:0:61015:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:4.0:1773851886.011543:0:61015:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:4.0:1773851886.011543:0:61015:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851886.011544:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264570088, transno 0, xid 1858853344877440
00010000:00000001:4.0:1773851886.011544:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851886.011545:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001f62829d x1858853344877440/t0(0) o17->628ab049-f83e-430f-963a-928b8c6224b2@21264@kfi7:674/0 lens 456/432 e 0 to 0 dl 1773852034 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1825-0'
00010000:00000001:4.0:1773851886.011548:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851886.011548:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851886.011549:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=118 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851886.011550:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851886.011551:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000827f918 refcount 3 to 21264@kfi7
00000100:00000001:4.0:1773851886.011554:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271104 : -107152618280512 : ffff9e8b964029c0)
02000000:00000001:4.0:1773851886.011555:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851886.011555:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.011556:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851886.011557:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21456@kfi7
00000400:00000010:4.0:1773851886.011558:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4bdb4b7.
00000100:00000200:4.0:1773851886.011558:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858853344877440, offset 224
00000400:00000200:4.0:1773851886.011560:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21456@kfi7
00000400:00000200:4.0:1773851886.011561:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21456@kfi7 to cpt 1
00000400:00000200:4.0:1773851886.011561:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ce85d2ce nid 21456@kfi7 refs 1
00000400:00000200:4.0:1773851886.011563:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ce85d2ce nid 21456@kfi7 refs 2
00000400:00000200:4.0:1773851886.011564:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ce85d2ce nid 21456@kfi7 refs 3
00000400:00000200:4.0:1773851886.011565:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21456@kfi7 local destination
00000400:00000200:4.0:1773851886.011566:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769846:8769846:1024:4294967295] 21456@kfi7 LPNI seq info [3604955:3604955:16:4294967295]
00000400:00000200:4.0:1773851886.011568:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ce85d2ce nid 21456@kfi7 refs 2
00000400:00000200:4.0:1773851886.011568:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21456@kfi7 to cpt 1
00000400:00000200:4.0:1773851886.011571:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21456@kfi7(21456@kfi7:21456@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851886.011572:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ce85d2ce nid 21456@kfi7 refs 3
00000800:00000200:4.0:1773851886.011573:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851886.011574:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:4.0:1773851886.011576:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851886.011578:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 Using peer 21456@kfi7(0x100000000000441)
00000800:00000200:4.0:1773851886.011581:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 532 bytes to peer 0x100000000000441: rc=0
00000800:00000200:4.0:1773851886.011582:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851886.011584:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.011585:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000827f918 refcount 2 to 21264@kfi7
00010000:00000001:4.0:1773851886.011586:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851886.011587:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.011587:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851886.011588:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f62829d x1858853344877440/t0(0) o17->628ab049-f83e-430f-963a-928b8c6224b2@21264@kfi7:674/0 lens 456/432 e 0 to 0 dl 1773852034 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1825-0'
00000100:00100000:4.0:1773851886.011592:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f62829d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:628ab049-f83e-430f-963a-928b8c6224b2+642:39841:x1858853344877440:12345-21264@kfi7:17:default-tuolumne1825-0 Request processed in 75us (106us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851886.011595:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21264@kfi7, seq: 371100847
00000100:00000040:4.0:1773851886.011595:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f7a2a9f : new rpc_count 7
00000100:00000001:4.0:1773851886.011596:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851886.011597:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851886.011597:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851886.011598:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851886.011599:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851886.011599:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004f7a2a9f : new refcount 641
00000100:00000001:4.0:1773851886.011600:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851886.011605:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851886.011607:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851886.011608:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21456@kfi7: PUT: OK
00000400:00000200:5.0:1773851886.011609:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4bdb4b7
00000400:00000010:5.0:1773851886.011609:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4bdb4b7.
00000100:00000001:5.0:1773851886.011610:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851886.011610:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851886.011611:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ce85d2ce nid 21456@kfi7 refs 2
00000800:00000200:5.0:1773851886.011612:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 21456@kfi7(00000000716efd3d):0x0 lsk 1090 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000441 Transaction freed
00000800:00000200:25.0:1773851886.068026:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851886.068027:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851886.068029:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851886.068031:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851886.068033:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.068035:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16122@kfi7 : PUT - for me
00000400:00000200:25.0:1773851886.068036:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.068037:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 1
00000400:00000200:25.0:1773851886.068038:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.068039:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000400:00000200:25.0:1773851886.068040:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 3
00000400:00000200:25.0:1773851886.068041:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.068043:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16122@kfi7 of length 224 into portal 12 MB=0x699de8bf40300
00000400:00000200:25.0:1773851886.068044:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16122@kfi7 of length 224/224 into md 0x16159c9699 [64] + 29952
00000800:00000200:25.0:1773851886.068046:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851886.068048:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851886.068049:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16122@kfi7: PUT: OK
00000100:00000001:25.0:1773851886.068050:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851886.068051:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851886.068052:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b145a6f.
00000100:00000040:25.0:1773851886.068053:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000005b145a6f x1858030970077952 msgsize 224
00000100:00100000:25.0:1773851886.068054:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16122@kfi7 (source: 12345-16122@kfi7)
00000100:00000001:25.0:1773851886.068055:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851886.068056:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000100:00000001:27.0:1773851886.068057:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851886.068058:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851886.068058:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851886.068058:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851886.068059:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851886.068060:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851886.068061:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030970077952
00000020:00000001:27.0:1773851886.068061:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851886.068062:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90eb7
00000020:00000001:27.0:1773851886.068063:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851886.068064:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000240389c2 refcount=6
00000020:00000001:27.0:1773851886.068065:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239660544 : -107152469891072 : ffff9e8b9f186800)
00000020:00000001:27.0:1773851886.068066:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239660544 : -107152469891072 : ffff9e8b9f186800)
00000100:00000001:27.0:1773851886.068067:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851886.068068:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851886.068069:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0454dd1.
00000020:00000010:27.0:1773851886.068070:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851886.068071:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003b2e2389.
00000100:00000001:27.0:1773851886.068072:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851886.068073:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851886.068074:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851886.068075:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851886.068075:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851886.068076:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851886.068077:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851886.068078:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851886.068079:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851886.068080:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16122@kfi7, seq: 2025155
00000100:00000001:26.0:1773851886.068080:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:27.0:1773851886.068081:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000240389c2 : new rpc_count 1
00000100:00000001:26.0:1773851886.068081:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851886.068082:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252463872 : -106967457087744 : ffff9eb6b2b7bf00)
00000100:00000001:26.0:1773851886.068082:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851886.068083:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005b145a6f x1858030970077952/t0(0) o400->2b5470c0-7421-4ca4-a83b-dba8a88de723@16122@kfi7:136/0 lens 224/0 e 0 to 0 dl 1773852251 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne231-0'
00000100:00000001:26.0:1773851886.068083:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851886.068086:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851886.068087:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851886.068088:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b145a6f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2b5470c0-7421-4ca4-a83b-dba8a88de723+6:48619:x1858030970077952:12345-16122@kfi7:400:default-tuolumne231-0
00000100:00000200:27.0:1773851886.068089:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030970077952
00000020:00000001:27.0:1773851886.068090:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851886.068091:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851886.068091:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851886.068092:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851886.068093:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851886.068094:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851886.068094:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030970077952, found 0 last_xid 1858030970077951
00000020:00000001:27.0:1773851886.068097:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851886.068098:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851886.068098:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851886.068099:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851886.068100:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851886.068100:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851886.068101:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851886.068102:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea65eaac.
02000000:00000001:27.0:1773851886.068102:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851886.068103:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851886.068104:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851886.068105:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030970077952
00010000:00000001:27.0:1773851886.068105:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851886.068106:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005b145a6f x1858030970077952/t0(0) o400->2b5470c0-7421-4ca4-a83b-dba8a88de723@16122@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne231-0'
00010000:00000001:27.0:1773851886.068109:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851886.068110:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851886.068111:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=119 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851886.068112:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851886.068113:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008d96cbb9 refcount 5 to 16122@kfi7
00000100:00000001:27.0:1773851886.068113:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329184 : -107155410222432 : ffff9e8aefd682a0)
02000000:00000001:27.0:1773851886.068114:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851886.068115:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851886.068116:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851886.068116:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16122@kfi7
00000400:00000010:27.0:1773851886.068117:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003e821a0f.
00000100:00000200:27.0:1773851886.068118:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030970077952, offset 224
00000400:00000200:27.0:1773851886.068119:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16122@kfi7
00000400:00000200:27.0:1773851886.068121:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:27.0:1773851886.068121:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 1
00000400:00000200:27.0:1773851886.068122:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000400:00000200:27.0:1773851886.068124:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 3
00000400:00000200:27.0:1773851886.068125:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16122@kfi7 local destination
00000400:00000200:27.0:1773851886.068127:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769847:8769847:1024:4294967295] 16122@kfi7 LPNI seq info [28018:28018:16:4294967295]
00000400:00000200:27.0:1773851886.068129:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000400:00000200:27.0:1773851886.068130:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:27.0:1773851886.068132:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16122@kfi7(16122@kfi7:16122@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851886.068134:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 3
00000800:00000200:27.0:1773851886.068135:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851886.068136:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851886.068139:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851886.068142:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000099d Using peer 16122@kfi7(0x10000000000099d)
00000800:00000200:27.0:1773851886.068145:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0x10000000000099d: rc=0
00000800:00000200:27.0:1773851886.068147:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000099d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851886.068149:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851886.068150:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008d96cbb9 refcount 4 to 16122@kfi7
00010000:00000001:27.0:1773851886.068151:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851886.068152:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851886.068152:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851886.068153:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b145a6f x1858030970077952/t0(0) o400->2b5470c0-7421-4ca4-a83b-dba8a88de723@16122@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne231-0'
00000100:00100000:27.0:1773851886.068156:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b145a6f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2b5470c0-7421-4ca4-a83b-dba8a88de723+6:48619:x1858030970077952:12345-16122@kfi7:400:default-tuolumne231-0 Request processed in 69us (103us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851886.068159:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16122@kfi7, seq: 2025155
00000100:00000040:27.0:1773851886.068160:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000240389c2 : new rpc_count 0
00000800:00000200:25.0:1773851886.068160:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000099d TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851886.068161:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851886.068162:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851886.068162:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851886.068163:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851886.068163:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003b2e2389.
00000400:00000200:25.0:1773851886.068163:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16122@kfi7: PUT: OK
00000400:00000200:25.0:1773851886.068164:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003e821a0f
00000020:00000010:27.0:1773851886.068165:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0454dd1.
00000400:00000010:25.0:1773851886.068165:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003e821a0f.
00000020:00000040:27.0:1773851886.068166:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000240389c2 : new refcount 5
00000100:00000001:25.0:1773851886.068166:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851886.068166:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:27.0:1773851886.068167:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851886.068167:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005d1ef9d6 nid 16122@kfi7 refs 2
00000800:00000200:25.0:1773851886.068169:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 16122@kfi7(00000000ab5b7be9):0x0 lsk 2462 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000099d Transaction freed
00000800:00000200:25.0:1773851886.314829:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851886.314830:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851886.314831:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851886.314833:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851886.314834:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.314835:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:25.0:1773851886.314836:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.314837:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:25.0:1773851886.314838:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.314839:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851886.314839:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:25.0:1773851886.314840:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851886.314841:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed445ac0
00000400:00000200:25.0:1773851886.314842:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x160dfce379 [256] + 14288
00000800:00000200:25.0:1773851886.314844:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851886.314845:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851886.314846:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851886.314847:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851886.314848:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851886.314848:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000741b2495.
00000100:00000040:25.0:1773851886.314849:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000741b2495 x1858062667504320 msgsize 224
00000100:00100000:25.0:1773851886.314851:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000100:00000001:25.0:1773851886.314852:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851886.314852:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851886.314854:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851886.314854:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851886.314855:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851886.314856:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851886.314857:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851886.314858:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851886.314859:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667504320
00000020:00000001:24.0:1773851886.314860:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851886.314861:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:24.0:1773851886.314862:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851886.314863:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:24.0:1773851886.314864:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:24.0:1773851886.314866:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:24.0:1773851886.314867:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851886.314868:0:1537164:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851886.314869:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851886.314870:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851886.314871:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000100:00000040:24.0:1773851886.314873:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851886.314874:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851886.314875:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851886.314876:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.314878:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.314879:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851886.314881:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851886.314881:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851886.314882:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851886.314882:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851886.314884:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799986
00000100:00000001:25.0:1773851886.314885:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851886.314885:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851886.314885:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:24.0:1773851886.314886:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252447744 : -106967457103872 : ffff9eb6b2b78000)
00000100:00000040:24.0:1773851886.314888:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000741b2495 x1858062667504320/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:24.0:1773851886.314893:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851886.314893:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851886.314895:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000741b2495 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667504320:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:24.0:1773851886.314897:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667504320
00000020:00000001:24.0:1773851886.314898:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851886.314899:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851886.314900:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851886.314901:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851886.314901:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851886.314903:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851886.314903:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851886.314904:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851886.314905:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851886.314906:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.314907:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851886.314908:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851886.314909:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000001254c003.
02000000:00000001:24.0:1773851886.314910:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.314911:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851886.314912:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851886.314913:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851886.314914:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851886.314915:0:1537164:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851886.314917:0:1537164:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851886.314918:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 85721088 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851886.314919:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132253 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851886.314921:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851886.314922:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667504320
00010000:00000001:24.0:1773851886.314924:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851886.314925:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000741b2495 x1858062667504320/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:24.0:1773851886.314929:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851886.314930:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851886.314931:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=13 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851886.314933:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851886.314934:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:24.0:1773851886.314935:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:24.0:1773851886.314937:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851886.314937:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.314938:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851886.314940:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:24.0:1773851886.314941:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c143d7e9.
00000100:00000200:24.0:1773851886.314942:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667504320, offset 224
00000400:00000200:24.0:1773851886.314944:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:24.0:1773851886.314946:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851886.314947:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:24.0:1773851886.314948:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851886.314950:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:24.0:1773851886.314952:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2105@kfi7 local destination
00000400:00000200:24.0:1773851886.314954:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769848:8769848:1024:4294967295] 2105@kfi7 LPNI seq info [20346210:20346210:16:4294967295]
00000400:00000200:24.0:1773851886.314957:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851886.314958:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851886.314961:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851886.314963:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:24.0:1773851886.314966:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851886.314968:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851886.314972:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851886.314976:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000800:00000200:24.0:1773851886.314980:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000067401146: Posted send of 468 bytes to peer 0x4c6: rc=0
00000800:00000200:24.0:1773851886.314983:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851886.314986:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851886.314989:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:24.0:1773851886.314990:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851886.314991:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851886.314992:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851886.314993:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000741b2495 x1858062667504320/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:24.0:1773851886.314998:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000741b2495 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52188:x1858062667504320:12345-2098@kfi7:41:default-yuba6-0 Request processed in 105us (148us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851886.315002:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799986
00000100:00000040:24.0:1773851886.315003:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:24.0:1773851886.315005:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851886.315005:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851886.315006:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851886.315007:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:24.0:1773851886.315008:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851886.315010:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:24.0:1773851886.315011:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851886.315017:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851886.315019:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851886.315020:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:25.0:1773851886.315021:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c143d7e9
00000400:00000010:25.0:1773851886.315021:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c143d7e9.
00000100:00000001:25.0:1773851886.315022:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851886.315022:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851886.315023:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851886.315024:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Transaction freed
00000800:00000200:31.0:1773851886.354406:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851886.354407:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851886.354408:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851886.354411:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851886.354413:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:31.0:1773851886.354414:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20730@kfi7 : PUT - for me
00000400:00000200:31.0:1773851886.354415:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:31.0:1773851886.354416:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 1
00000400:00000200:31.0:1773851886.354418:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:31.0:1773851886.354419:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000400:00000200:31.0:1773851886.354419:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 3
00000400:00000200:31.0:1773851886.354420:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:31.0:1773851886.354422:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20731@kfi7 of length 224 into portal 12 MB=0x699de8bc30680
00000400:00000200:31.0:1773851886.354423:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20731@kfi7 of length 224/224 into md 0x77fe139dd [64] + 193976
00000800:00000200:31.0:1773851886.354426:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851886.354428:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851886.354430:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20730@kfi7: PUT: OK
00000100:00000001:31.0:1773851886.354431:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851886.354431:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851886.354432:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fede61b9.
00000100:00000040:31.0:1773851886.354433:0:2465875:0:(events.c:358:request_in_callback()) incoming req@00000000fede61b9 x1858030966867584 msgsize 224
00000100:00100000:31.0:1773851886.354435:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-20731@kfi7 (source: 12345-20730@kfi7)
00000100:00000001:31.0:1773851886.354436:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851886.354437:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000800:00000200:31.0:1773851886.354438:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f78341e7: 2054@kfi7:7 <- 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851886.354439:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851886.354440:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851886.354440:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851886.354441:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851886.354442:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851886.354444:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966867584
00000020:00000001:29.0:1773851886.354445:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851886.354445:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fdd
00000020:00000001:29.0:1773851886.354446:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851886.354449:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fe26bdb2 refcount=6
00000020:00000001:29.0:1773851886.354450:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240097792 : -107152469453824 : ffff9e8b9f1f1400)
00000020:00000001:29.0:1773851886.354452:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240097792 : -107152469453824 : ffff9e8b9f1f1400)
00000100:00000001:29.0:1773851886.354454:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851886.354455:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851886.354456:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851886.354457:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851886.354459:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851886.354460:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851886.354461:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851886.354461:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.354463:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851886.354464:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851886.354465:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.354466:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.354468:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851886.354469:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851886.354470:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851886.354470:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851886.354471:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20731@kfi7, seq: 2055570
00000100:00000001:30.0:1773851886.354472:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851886.354472:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fe26bdb2 : new rpc_count 1
00000100:00000001:30.0:1773851886.354473:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.354473:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637034999080832 : -107038710470784 : ffff9ea61baf6780)
00000100:00000040:29.0:1773851886.354475:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fede61b9 x1858030966867584/t0(0) o400->684088fc-62a8-467c-a563-d2663be551c4@20731@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne249-0'
00000100:00000001:29.0:1773851886.354480:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851886.354481:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851886.354483:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fede61b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:684088fc-62a8-467c-a563-d2663be551c4+6:47815:x1858030966867584:12345-20731@kfi7:400:default-tuolumne249-0
00000100:00000200:29.0:1773851886.354485:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966867584
00000020:00000001:29.0:1773851886.354486:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851886.354487:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851886.354488:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.354489:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851886.354490:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851886.354491:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851886.354492:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966867584, found 0 last_xid 1858030966867583
00000020:00000001:29.0:1773851886.354494:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851886.354495:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851886.354496:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851886.354497:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.354498:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851886.354499:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851886.354500:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851886.354501:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007644643c.
02000000:00000001:29.0:1773851886.354502:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.354503:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.354504:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851886.354505:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030966867584
00010000:00000001:29.0:1773851886.354506:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851886.354508:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fede61b9 x1858030966867584/t0(0) o400->684088fc-62a8-467c-a563-d2663be551c4@20731@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne249-0'
00010000:00000001:29.0:1773851886.354512:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851886.354513:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851886.354514:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=119 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851886.354516:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851886.354517:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000a2cc74 refcount 5 to 20731@kfi7
00000100:00000001:29.0:1773851886.354518:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526777120 : -107156182774496 : ffff9e8ac1ca4d20)
02000000:00000001:29.0:1773851886.354520:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851886.354520:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.354521:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851886.354523:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20730@kfi7
00000400:00000010:29.0:1773851886.354524:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3501a9c.
00000100:00000200:29.0:1773851886.354525:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966867584, offset 224
00000400:00000200:29.0:1773851886.354528:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20730@kfi7
00000400:00000200:29.0:1773851886.354529:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.354530:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 1
00000400:00000200:29.0:1773851886.354532:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000400:00000200:29.0:1773851886.354534:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 3
00000400:00000200:29.0:1773851886.354536:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20730@kfi7 local destination
00000400:00000200:29.0:1773851886.354538:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769849:8769849:1024:4294967295] 20730@kfi7 LPNI seq info [28143:28143:16:4294967295]
00000400:00000200:29.0:1773851886.354540:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000400:00000200:29.0:1773851886.354542:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20730@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.354546:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20730@kfi7(20730@kfi7:20730@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851886.354548:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 3
00000800:00000200:29.0:1773851886.354551:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851886.354552:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851886.354557:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851886.354561:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006f9 Using peer 20730@kfi7(0x1000000000006f9)
00000800:00000200:29.0:1773851886.354566:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 324 bytes to peer 0x1000000000006f9: rc=0
00000800:00000200:29.0:1773851886.354569:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006f9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851886.354572:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851886.354574:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000a2cc74 refcount 4 to 20731@kfi7
00010000:00000001:29.0:1773851886.354575:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851886.354576:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.354577:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851886.354579:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fede61b9 x1858030966867584/t0(0) o400->684088fc-62a8-467c-a563-d2663be551c4@20731@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne249-0'
00000800:00000200:31.0:1773851886.354584:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006f9 TN_EVENT_TX_OK event status 0
00000100:00100000:29.0:1773851886.354584:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fede61b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:684088fc-62a8-467c-a563-d2663be551c4+6:47815:x1858030966867584:12345-20731@kfi7:400:default-tuolumne249-0 Request processed in 103us (150us total) trans 0 rc 0/0
00000400:00000200:31.0:1773851886.354585:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851886.354587:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20730@kfi7: PUT: OK
00000400:00000200:31.0:1773851886.354587:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3501a9c
00000400:00000010:31.0:1773851886.354588:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3501a9c.
00000100:00000001:31.0:1773851886.354589:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851886.354589:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:29.0:1773851886.354589:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20731@kfi7, seq: 2055570
00000400:00000200:31.0:1773851886.354590:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a11da3b8 nid 20730@kfi7 refs 2
00000100:00000040:29.0:1773851886.354590:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fe26bdb2 : new rpc_count 0
00000800:00000200:31.0:1773851886.354592:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2054@kfi7:7 -> 20730@kfi7(0000000040e9a9e1):0x0 lsk 1786 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000006f9 Transaction freed
00000100:00000001:29.0:1773851886.354592:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851886.354592:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851886.354593:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851886.354595:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851886.354596:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000020:00000040:29.0:1773851886.354597:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000fe26bdb2 : new refcount 5
00000100:00000001:29.0:1773851886.354599:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851886.409731:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000040:30.0:1773851886.409732:0:2513753:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre5-MDT0001-mdtlov_UUID->lustre5-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000004:00000020:11.0:1773851886.409732:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851886.409733:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dbcdff99.
00000020:00000040:11.0:1773851886.409734:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:30.0:1773851886.409735:0:2513753:0:(pinger.c:136:ptlrpc_ping()) Process entered
00000100:00000010:30.0:1773851886.409736:0:2513753:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d540d74a.
00000020:00000040:30.0:1773851886.409736:0:2513753:0:(genops.c:1094:class_import_get()) import 00000000e9760d64 refcount=3 obd=lustre5-MDT0000-osp-MDT0001
00000100:00000001:11.0:1773851886.409736:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851886.409736:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:30.0:1773851886.409737:0:2513753:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851886.409737:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851886.409738:0:2513753:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851886.409739:0:2513753:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851886.409739:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000545d49bf.
02000000:00000010:30.0:1773851886.409740:0:2513753:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000040d06717.
00000100:00000001:11.0:1773851886.409740:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851886.409741:0:2513753:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.409741:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851886.409742:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851886.409743:0:2513753:0:(pinger.c:151:ptlrpc_ping()) @@@ pinging lustre5-MDT0001-mdtlov_UUID->lustre5-MDT0000_UUID  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00000040:11.0:1773851886.409743:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000dbcdff99] to pc [ptlrpcd_02_02+2]  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851886.409746:0:2513753:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851886.409747:0:2513753:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851886.409747:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:30.0:1773851886.409748:0:2513753:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d540d74a] to pc [ptlrpcd_07_02+2]  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851886.409749:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851886.409749:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851886.409749:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:11.0:1773851886.409750:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f009d922.
00000100:00000001:10.0:1773851886.409750:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:30.0:1773851886.409751:0:2513753:0:(pinger.c:160:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851886.409751:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637109198635008 : -106964510916608 : ffff9eb76252c000)
00000100:00000040:10.0:1773851886.409751:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851886.409751:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851886.409752:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:29.0:1773851886.409753:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851886.409753:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851886.409753:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851886.409753:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.409754:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:28.0:1773851886.409754:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851886.409754:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000100:00000001:10.0:1773851886.409754:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:29.0:1773851886.409755:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:11.0:1773851886.409755:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000837934f8.
00000100:00000001:10.0:1773851886.409755:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:11.0:1773851886.409756:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614160863031335ns, next at 614161863030133ns, rc = 0
02000000:00000001:10.0:1773851886.409756:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:10.0:1773851886.409756:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.409757:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:11.0:1773851886.409757:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:29.0:1773851886.409758:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851886.409758:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851886.409758:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000dbcdff99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051936000:2075@kfi7:13:default-yuba2-0
02000000:00000001:29.0:1773851886.409759:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000001:11.0:1773851886.409759:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409759:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:29.0:1773851886.409760:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851886.409760:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d540d74a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051936064:61@kfi7:400:default-yuba2-0
02000000:00000001:10.0:1773851886.409760:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851886.409760:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851886.409761:0:2513753:0:(pinger.c:320:ptlrpc_pinger_main()) next wakeup in 11 (614210)
02000000:00000001:10.0:1773851886.409761:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:29.0:1773851886.409762:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:29.0:1773851886.409762:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:10.0:1773851886.409762:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000086e8148e.
02000000:00000001:10.0:1773851886.409762:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851886.409763:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851886.409763:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:29.0:1773851886.409764:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000002306b43.
00000400:00000200:10.0:1773851886.409764:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:10.0:1773851886.409764:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
02000000:00000001:29.0:1773851886.409765:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851886.409765:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000400:00000200:29.0:1773851886.409766:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000200:10.0:1773851886.409766:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936000, portal 4
00000100:00000001:10.0:1773851886.409766:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:29.0:1773851886.409767:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b37fd7a9.
00000400:00000010:29.0:1773851886.409767:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ff351f68.
00000100:00000001:10.0:1773851886.409767:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446616832 : -106937262934784 : ffff9ebdba6df500)
00000100:00000040:10.0:1773851886.409768:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851886.409769:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1859433051936064, portal 4
00000100:00000001:29.0:1773851886.409770:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851886.409770:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411239936 : -106960298311680 : ffff9eb85d6a0000)
00000100:00000001:10.0:1773851886.409771:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851886.409772:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:10.0:1773851886.409772:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f2c89b6.
00000100:00000040:29.0:1773851886.409773:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851886.409773:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936000, offset 0
00000400:00000200:10.0:1773851886.409774:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:10.0:1773851886.409775:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000100:00000001:29.0:1773851886.409777:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851886.409777:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000100:00000040:29.0:1773851886.409778:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-61@kfi7
00000400:00000200:10.0:1773851886.409778:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000010:29.0:1773851886.409779:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050b15012.
00000400:00000200:10.0:1773851886.409779:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000100:00000200:29.0:1773851886.409780:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051936064, offset 0
00000400:00000200:10.0:1773851886.409780:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:29.0:1773851886.409782:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-61@kfi7
00000400:00000200:10.0:1773851886.409782:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769848, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769849, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851886.409784:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:10.0:1773851886.409784:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:10.0:1773851886.409785:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851886.409786:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:10.0:1773851886.409786:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:29.0:1773851886.409787:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:10.0:1773851886.409787:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769850:8769850:1024:4294967295] 2075@kfi7 LPNI seq info [5403914:5403914:16:4294967295]
00000400:00000200:10.0:1773851886.409788:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:29.0:1773851886.409789:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:10.0:1773851886.409789:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:29.0:1773851886.409791:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  61@kfi7 local destination
00000400:00000200:10.0:1773851886.409791:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851886.409792:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:29.0:1773851886.409794:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769850, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769849, p:4294967295, g:4294967295, h:1000]
00000800:00000200:10.0:1773851886.409794:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851886.409795:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851886.409797:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:10.0:1773851886.409798:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851886.409799:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851886.409800:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:10.0:1773851886.409800:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Using peer 2075@kfi7(0x4e8)
00000400:00000200:29.0:1773851886.409802:0:41090:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[43@kfi7, 61@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[37492104, 37492103]
00000800:00000200:10.0:1773851886.409804:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000005269f40f: Posted send of 324 bytes to peer 0x4e8: rc=0
00000400:00000200:29.0:1773851886.409805:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 61@kfi7
00000800:00000200:10.0:1773851886.409805:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851886.409807:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769851:8769851:1024:4294967295] 61@kfi7 LPNI seq info [37492105:37492105:16:4294967295]
00000100:00000001:10.0:1773851886.409807:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409808:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851886.409808:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851886.409809:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:10.0:1773851886.409809:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409810:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851886.409811:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:10.0:1773851886.409811:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851886.409812:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851886.409813:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851886.409813:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851886.409814:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409814:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851886.409815:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 61@kfi7(61@kfi7:61@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851886.409817:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000800:00000200:10.0:1773851886.409817:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851886.409819:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:10.0:1773851886.409819:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851886.409820:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000800:00000200:29.0:1773851886.409821:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851886.409821:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f2c89b6
00000400:00000010:10.0:1773851886.409822:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f2c89b6.
00000100:00000001:10.0:1773851886.409822:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851886.409823:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851886.409825:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:10.0:1773851886.409826:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851886.409827:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851886.409829:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851886.409830:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e Using peer 61@kfi7(0x20000000000081e)
00000100:00000001:10.0:1773851886.409830:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851886.409831:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:10.0:1773851886.409833:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Transaction freed
00000800:00000200:29.0:1773851886.409835:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x20000000000081e: rc=0
00000800:00000200:29.0:1773851886.409837:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851886.409840:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.409841:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851886.409843:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.409844:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.409845:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.409847:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851886.409848:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851886.409849:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851886.409850:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851886.409851:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851886.409854:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851886.409854:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851886.409858:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851886.409859:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000400:00000200:30.0:1773851886.409861:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050b15012
00000400:00000010:30.0:1773851886.409862:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050b15012.
00000100:00000001:30.0:1773851886.409863:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851886.409864:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851886.409869:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851886.409870:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 2 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851886.409874:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851886.409875:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851886.409876:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:30.0:1773851886.409879:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2054@kfi7:7 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000081e Transaction freed
00000800:00000200:2.0:1773851886.409884:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851886.409885:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851886.409886:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851886.409888:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851886.409891:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851886.409892:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 61@kfi7 : PUT - for me
00000400:00000200:2.0:1773851886.409893:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851886.409894:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:2.0:1773851886.409895:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851886.409901:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:2.0:1773851886.409902:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000800:00000200:10.0:1773851886.409903:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:2.0:1773851886.409903:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000800:00000200:10.0:1773851886.409904:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:2.0:1773851886.409904:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 4 MB=0x69b24fe8b5540
00000800:00000200:10.0:1773851886.409905:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851886.409905:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000800:00000200:10.0:1773851886.409907:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851886.409907:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-61@kfi7 of length 224/224 into md 0x7fb71dfa1 [1] + 224
00000400:00000200:10.0:1773851886.409909:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000800:00000200:2.0:1773851886.409910:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851886.409911:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:10.0:1773851886.409912:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851886.409912:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:2.0:1773851886.409912:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851886.409913:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:2.0:1773851886.409913:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000400:00000200:10.0:1773851886.409914:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851886.409915:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000100:00000001:2.0:1773851886.409915:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:2.0:1773851886.409916:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:2.0:1773851886.409923:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851886.409926:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851886.409927:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5500
00000100:00000001:2.0:1773851886.409927:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851886.409928:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:2.0:1773851886.409929:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:29.0:1773851886.409930:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:10.0:1773851886.409930:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x7816985e9 [1] + 224
00000800:00000200:2.0:1773851886.409930:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851886.409931:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:10.0:1773851886.409931:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:29.0:1773851886.409932:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851886.409933:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:10.0:1773851886.409933:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:29.0:1773851886.409934:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b37fd7a9.
00000400:00000200:10.0:1773851886.409934:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000400:00000200:29.0:1773851886.409935:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ff351f68
00000100:00000001:10.0:1773851886.409935:0:2464469:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:29.0:1773851886.409936:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ff351f68.
00000100:00000200:10.0:1773851886.409936:0:2464469:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851886.409937:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851886.409939:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851886.409939:0:2464469:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851886.409943:0:2464469:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:29.0:1773851886.409944:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RNQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851886.409944:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:10.0:1773851886.409945:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851886.409947:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851886.409948:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851886.409948:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:10.0:1773851886.409948:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:29.0:1773851886.409949:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:10.0:1773851886.409949:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851886.409950:0:41090:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851886.409950:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:10.0:1773851886.409950:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000100:00000001:29.0:1773851886.409951:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:10.0:1773851886.409951:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851886.409951:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:29.0:1773851886.409952:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409952:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851886.409952:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851886.409953:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851886.409954:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000004ec81d4d time=119 v=66 (66 66 66 66)
00000100:00000200:10.0:1773851886.409955:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:29.0:1773851886.409956:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000016ebd31 time=169 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851886.409957:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851886.409958:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851886.409958:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.409959:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409959:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851886.409959:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00010000:00000001:29.0:1773851886.409960:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:10.0:1773851886.409960:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:29.0:1773851886.409961:0:41090:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409961:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851886.409961:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.409962:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00001000:10.0:1773851886.409962:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=119 v=66 (66 66 66 66)
00000100:00000040:29.0:1773851886.409963:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0000-osp-MDT0001: skip recheck: last_committed 172505579298
00000100:00001000:10.0:1773851886.409963:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=119 v=66 (1 1 1 1)
00000100:00000001:29.0:1773851886.409964:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851886.409964:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409964:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851886.409965:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851886.409966:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:10.0:1773851886.409966:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851886.409966:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.409967:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851886.409967:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:10.0:1773851886.409968:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851886.409969:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.409970:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:10.0:1773851886.409970:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851886.409972:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851886.409972:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851886.409973:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851886.409973:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:29.0:1773851886.409974:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851886.409974:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851886.409975:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851886.409975:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851886.409976:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470656512 avail=351461533696 avail_mb=1372896616 hwm_mb=3131103 files=372064445 ffree=343233063 state=0: rc = 0
00000004:00000020:10.0:1773851886.409978:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470656512 free, 351461533696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064445 files, 343233063 free files
00000004:00000001:10.0:1773851886.409979:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851886.409980:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d540d74a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051936064:61@kfi7:400:default-yuba2-0
00000100:00000040:10.0:1773851886.409980:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851886.409982:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.409983:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00100000:10.0:1773851886.409983:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000dbcdff99 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051936000:2075@kfi7:13:default-yuba2-0
00000100:00000040:29.0:1773851886.409984:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d540d74a x1859433051936064/t0(0) o400->lustre5-MDT0000-osp-MDT0001@61@kfi7:24/4 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Complete:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851886.409985:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851886.409985:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851886.409986:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000dbcdff99 x1859433051936000/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851886.409989:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:10.0:1773851886.409989:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851886.409990:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851886.409990:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000002306b43.
02000000:00000001:10.0:1773851886.409990:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851886.409991:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000086e8148e.
02000000:00000001:29.0:1773851886.409992:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:10.0:1773851886.409992:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851886.409992:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000001:29.0:1773851886.409993:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851886.409993:0:41070:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000040:29.0:1773851886.409994:0:41090:0:(genops.c:1107:class_import_put()) import 00000000e9760d64 refcount=2 obd=lustre5-MDT0000-osp-MDT0001
00000020:00000001:10.0:1773851886.409994:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:29.0:1773851886.409995:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851886.409995:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000545d49bf.
02000000:00000001:10.0:1773851886.409995:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000010:29.0:1773851886.409996:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000040d06717.
02000000:00000001:10.0:1773851886.409996:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851886.409996:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dbcdff99.
02000000:00000001:29.0:1773851886.409997:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:10.0:1773851886.409997:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:29.0:1773851886.409998:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851886.409998:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d540d74a.
00000100:00000001:10.0:1773851886.409998:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851886.409998:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851886.409999:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851886.410000:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851886.410000:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851886.410000:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851886.410000:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851886.410000:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.410001:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.410003:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851886.410003:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.410004:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851886.410005:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851886.415090:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851886.415091:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851886.415092:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851886.415094:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851886.415095:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:13.0:1773851886.415096:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15354@kfi7 : PUT - for me
00000400:00000200:13.0:1773851886.415097:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:13.0:1773851886.415098:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 1
00000400:00000200:13.0:1773851886.415099:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:13.0:1773851886.415099:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000400:00000200:13.0:1773851886.415100:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 3
00000400:00000200:13.0:1773851886.415101:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15355@kfi7 to cpt 6
00000400:00000200:13.0:1773851886.415101:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15355@kfi7 of length 224 into portal 12 MB=0x699de8bbe3540
00000400:00000200:13.0:1773851886.415103:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15355@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 44464
00000800:00000200:13.0:1773851886.415104:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851886.415106:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851886.415107:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15354@kfi7: PUT: OK
00000100:00000001:13.0:1773851886.415108:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851886.415108:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851886.415109:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c588b2b9.
00000100:00000040:13.0:1773851886.415110:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c588b2b9 x1858030966551872 msgsize 224
00000100:00100000:13.0:1773851886.415111:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-15355@kfi7 (source: 12345-15354@kfi7)
00000100:00000001:13.0:1773851886.415112:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851886.415113:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000100:00000001:12.0:1773851886.415114:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851886.415115:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851886.415115:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851886.415115:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851886.415116:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851886.415117:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851886.415118:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966551872
00000020:00000001:12.0:1773851886.415118:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851886.415119:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91276
00000020:00000001:12.0:1773851886.415119:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851886.415125:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c2082f48 refcount=6
00000020:00000001:12.0:1773851886.415125:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716199424 : -107155993352192 : ffff9e8acd14a800)
00000020:00000001:12.0:1773851886.415126:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716199424 : -107155993352192 : ffff9e8acd14a800)
00000100:00000001:12.0:1773851886.415127:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851886.415128:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851886.415129:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007d88af77.
00000020:00000010:12.0:1773851886.415130:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851886.415131:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002e0b7f3f.
00000100:00000001:12.0:1773851886.415132:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851886.415133:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851886.415133:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851886.415134:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851886.415135:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851886.415135:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851886.415136:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851886.415138:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851886.415138:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851886.415138:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851886.415138:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851886.415140:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15355@kfi7, seq: 2289891
00000100:00000040:15.0:1773851886.415141:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c2082f48 : new rpc_count 1
00000100:00000001:15.0:1773851886.415141:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078902260608 : -106994807291008 : ffff9eb05484c380)
00000100:00000001:12.0:1773851886.415141:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851886.415141:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851886.415143:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c588b2b9 x1858030966551872/t0(0) o400->87dc702d-454f-4fdf-82aa-ac80e2c85321@15355@kfi7:136/0 lens 224/0 e 0 to 0 dl 1773852251 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne228-0'
00000100:00000001:15.0:1773851886.415145:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851886.415146:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851886.415147:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c588b2b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:87dc702d-454f-4fdf-82aa-ac80e2c85321+6:47999:x1858030966551872:12345-15355@kfi7:400:default-tuolumne228-0
00000100:00000200:15.0:1773851886.415148:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966551872
00000020:00000001:15.0:1773851886.415149:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851886.415149:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851886.415150:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.415151:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851886.415152:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851886.415152:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851886.415153:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966551872, found 0 last_xid 1858030966551871
00000020:00000001:15.0:1773851886.415154:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851886.415154:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851886.415155:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851886.415156:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.415157:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851886.415157:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851886.415158:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851886.415159:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000c5e8003.
02000000:00000001:15.0:1773851886.415159:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.415160:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.415161:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851886.415162:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767568, transno 0, xid 1858030966551872
00010000:00000001:15.0:1773851886.415162:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851886.415163:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c588b2b9 x1858030966551872/t0(0) o400->87dc702d-454f-4fdf-82aa-ac80e2c85321@15355@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne228-0'
00010000:00000001:15.0:1773851886.415166:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851886.415166:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851886.415167:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=119 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851886.415168:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851886.415169:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000090c2d766 refcount 5 to 15355@kfi7
00000100:00000001:15.0:1773851886.415170:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331584 : -107155410220032 : ffff9e8aefd68c00)
02000000:00000001:15.0:1773851886.415170:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851886.415171:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.415172:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851886.415173:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15354@kfi7
00000400:00000010:15.0:1773851886.415173:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000616bd872.
00000100:00000200:15.0:1773851886.415174:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966551872, offset 224
00000400:00000200:15.0:1773851886.415176:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15354@kfi7
00000400:00000200:15.0:1773851886.415177:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.415178:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 1
00000400:00000200:15.0:1773851886.415179:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000400:00000200:15.0:1773851886.415180:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 3
00000400:00000200:15.0:1773851886.415181:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15354@kfi7 local destination
00000400:00000200:15.0:1773851886.415182:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769852:8769852:1024:4294967295] 15354@kfi7 LPNI seq info [28067:28067:16:4294967295]
00000400:00000200:15.0:1773851886.415184:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000400:00000200:15.0:1773851886.415185:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15354@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.415186:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15354@kfi7(15354@kfi7:15354@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851886.415188:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 3
00000800:00000200:15.0:1773851886.415189:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851886.415190:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851886.415193:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851886.415195:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003da Using peer 15354@kfi7(0x1000000000003da)
00000800:00000200:15.0:1773851886.415198:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x1000000000003da: rc=0
00000800:00000200:15.0:1773851886.415199:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003da TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851886.415202:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851886.415202:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000090c2d766 refcount 4 to 15355@kfi7
00010000:00000001:15.0:1773851886.415203:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851886.415204:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.415204:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851886.415205:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c588b2b9 x1858030966551872/t0(0) o400->87dc702d-454f-4fdf-82aa-ac80e2c85321@15355@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne228-0'
00000100:00100000:15.0:1773851886.415208:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c588b2b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:87dc702d-454f-4fdf-82aa-ac80e2c85321+6:47999:x1858030966551872:12345-15355@kfi7:400:default-tuolumne228-0 Request processed in 61us (97us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851886.415211:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15355@kfi7, seq: 2289891
00000100:00000040:15.0:1773851886.415211:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c2082f48 : new rpc_count 0
00000800:00000200:13.0:1773851886.415211:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003da TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851886.415212:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851886.415213:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851886.415213:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000400:00000200:13.0:1773851886.415213:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851886.415214:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002e0b7f3f.
00000400:00000200:13.0:1773851886.415214:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15354@kfi7: PUT: OK
00000020:00000010:15.0:1773851886.415215:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007d88af77.
00000400:00000200:13.0:1773851886.415215:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000616bd872
00000400:00000010:13.0:1773851886.415215:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000616bd872.
00000020:00000040:15.0:1773851886.415216:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000c2082f48 : new refcount 5
00000100:00000001:13.0:1773851886.415216:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851886.415216:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851886.415217:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851886.415217:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002fe4f68f nid 15354@kfi7 refs 2
00000800:00000200:13.0:1773851886.415218:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 15354@kfi7(000000009e6b2c96):0x0 lsk 987 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000003da Transaction freed
00000800:00000200:13.0:1773851886.448859:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851886.448860:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851886.448860:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851886.448860:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851886.448861:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851886.448862:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851886.448863:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20289@kfi7(000000005e218297):0x98e version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851886.448864:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851886.448865:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e Using peer 20289@kfi7(0x10000000000098e)
00000400:00000200:14.0:1773851886.448866:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20289@kfi7 to cpt 3
00000400:00000200:14.0:1773851886.448867:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20289@kfi7 : PUT - for me
00000400:00000200:13.0:1773851886.448867:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20289@kfi7 to cpt 3
00000400:00000200:14.0:1773851886.448868:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20289@kfi7 to cpt 3
00000400:00000200:14.0:1773851886.448869:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d14b925c nid 20289@kfi7 refs 1
00000800:00000200:13.0:1773851886.448869:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x10000000000098e: rc=0
00000800:00000200:13.0:1773851886.448870:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851886.448871:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20289@kfi7 to cpt 3
00000400:00000200:14.0:1773851886.448872:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d14b925c nid 20289@kfi7 refs 2
00000400:00000200:14.0:1773851886.448873:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d14b925c nid 20289@kfi7 refs 3
00000400:00000200:14.0:1773851886.448874:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20289@kfi7 to cpt 3
00000400:00000200:14.0:1773851886.448875:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20289@kfi7 of length 224 into portal 12 MB=0x69b461e6ffb80
00000400:00000200:14.0:1773851886.448876:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20289@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 44688
00000800:00000200:14.0:1773851886.448878:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851886.448880:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851886.448881:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20289@kfi7: PUT: OK
00000100:00000001:14.0:1773851886.448881:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851886.448882:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851886.448883:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036988056.
00000800:00000200:13.0:1773851886.448883:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e TN_EVENT_TX_OK event status 0
00000100:00000040:14.0:1773851886.448884:0:2514739:0:(events.c:358:request_in_callback()) incoming req@0000000036988056 x1859575320935296 msgsize 224
00000100:00100000:14.0:1773851886.448885:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-20289@kfi7 (source: 12345-20289@kfi7)
00000800:00000200:13.0:1773851886.448885:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e Transaction freed
00000100:00000001:14.0:1773851886.448886:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851886.448887:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d14b925c nid 20289@kfi7 refs 2
00000100:00000001:15.0:1773851886.448888:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851886.448889:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851886.448889:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:14.0:1773851886.448889:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2054@kfi7:3 <- 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851886.448890:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851886.448890:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851886.448891:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575320935296
00000020:00000001:15.0:1773851886.448892:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851886.448892:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc30a9d94
00000020:00000001:15.0:1773851886.448893:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851886.448897:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000f98164c refcount=8
00000020:00000001:15.0:1773851886.448898:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125221668864 : -106948487882752 : ffff9ebb1d5ed800)
00000020:00000001:15.0:1773851886.448898:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125221668864 : -106948487882752 : ffff9ebb1d5ed800)
00000100:00000001:15.0:1773851886.448899:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851886.448900:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851886.448902:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab8026e0.
00000020:00000010:15.0:1773851886.448902:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851886.448903:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851886.448904:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851886.448905:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851886.448905:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851886.448906:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851886.448906:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851886.448907:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.448907:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851886.448908:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851886.448909:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851886.448909:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851886.448909:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851886.448910:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20289@kfi7, seq: 2289892
00000100:00000040:15.0:1773851886.448910:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000f98164c : new rpc_count 1
00000100:00000001:12.0:1773851886.448910:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.448911:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562692608 : -106978146859008 : ffff9eb4358ec800)
00000100:00000001:12.0:1773851886.448911:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851886.448912:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036988056 x1859575320935296/t0(0) o400->37550827-847c-44fa-8c97-b39ac6e44246@20289@kfi7:138/0 lens 224/0 e 0 to 0 dl 1773852253 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1764-0'
00000100:00000001:15.0:1773851886.448915:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851886.448915:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851886.448916:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036988056 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:37550827-847c-44fa-8c97-b39ac6e44246+8:39685:x1859575320935296:12345-20289@kfi7:400:default-tuolumne1764-0
00000100:00000200:15.0:1773851886.448919:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575320935296
00000020:00000001:15.0:1773851886.448919:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851886.448920:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851886.448920:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.448921:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851886.448921:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851886.448922:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851886.448923:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575320935296, found 0 last_xid 1859575320935295
00000020:00000001:15.0:1773851886.448923:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851886.448924:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851886.448924:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851886.448925:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.448925:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851886.448926:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851886.448926:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851886.448927:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cdb11527.
02000000:00000001:15.0:1773851886.448928:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.448928:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.448929:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851886.448929:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181510847158, transno 0, xid 1859575320935296
00010000:00000001:15.0:1773851886.448930:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851886.448931:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036988056 x1859575320935296/t0(0) o400->37550827-847c-44fa-8c97-b39ac6e44246@20289@kfi7:138/0 lens 224/224 e 0 to 0 dl 1773852253 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1764-0'
00010000:00000001:15.0:1773851886.448933:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851886.448933:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851886.448934:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=119 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851886.448935:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851886.448936:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007c4047df refcount 3 to 20289@kfi7
00000100:00000001:15.0:1773851886.448936:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620832 : -107151221930784 : ffff9e8be97ac4e0)
02000000:00000001:15.0:1773851886.448937:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851886.448938:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.448938:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851886.448939:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20289@kfi7
00000400:00000010:15.0:1773851886.448939:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000077952c7.
00000100:00000200:15.0:1773851886.448941:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575320935296, offset 224
00000400:00000200:15.0:1773851886.448942:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20289@kfi7
00000400:00000200:15.0:1773851886.448943:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20289@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.448944:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d14b925c nid 20289@kfi7 refs 1
00000400:00000200:15.0:1773851886.448944:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d14b925c nid 20289@kfi7 refs 2
00000400:00000200:15.0:1773851886.448945:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d14b925c nid 20289@kfi7 refs 3
00000400:00000200:15.0:1773851886.448947:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20289@kfi7 local destination
00000400:00000200:15.0:1773851886.448948:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769853:8769853:1024:4294967295] 20289@kfi7 LPNI seq info [200909:200909:16:4294967295]
00000400:00000200:15.0:1773851886.448949:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d14b925c nid 20289@kfi7 refs 2
00000400:00000200:15.0:1773851886.448950:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20289@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.448952:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20289@kfi7(20289@kfi7:20289@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851886.448953:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d14b925c nid 20289@kfi7 refs 3
00000800:00000200:15.0:1773851886.448954:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851886.448955:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851886.448957:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851886.448959:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e Using peer 20289@kfi7(0x10000000000098e)
00000800:00000200:15.0:1773851886.448962:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x10000000000098e: rc=0
00000800:00000200:15.0:1773851886.448963:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851886.448965:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851886.448965:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007c4047df refcount 2 to 20289@kfi7
00010000:00000001:15.0:1773851886.448966:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851886.448966:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.448967:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851886.448967:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036988056 x1859575320935296/t0(0) o400->37550827-847c-44fa-8c97-b39ac6e44246@20289@kfi7:138/0 lens 224/224 e 0 to 0 dl 1773852253 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1764-0'
00000100:00100000:15.0:1773851886.448970:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036988056 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:37550827-847c-44fa-8c97-b39ac6e44246+8:39685:x1859575320935296:12345-20289@kfi7:400:default-tuolumne1764-0 Request processed in 55us (86us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851886.448973:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20289@kfi7, seq: 2289892
00000100:00000040:15.0:1773851886.448973:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000f98164c : new rpc_count 0
00000100:00000001:15.0:1773851886.448974:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851886.448974:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851886.448975:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851886.448975:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000800:00000200:13.0:1773851886.448975:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851886.448976:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab8026e0.
00000020:00000040:15.0:1773851886.448976:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000000f98164c : new refcount 7
00000100:00000001:15.0:1773851886.448977:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851886.448977:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851886.448978:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20289@kfi7: PUT: OK
00000400:00000200:13.0:1773851886.448988:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000077952c7
00000400:00000010:13.0:1773851886.448989:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000077952c7.
00000100:00000001:13.0:1773851886.448989:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851886.448990:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851886.448990:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d14b925c nid 20289@kfi7 refs 2
00000800:00000200:13.0:1773851886.448992:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 20289@kfi7(000000005e218297):0x0 lsk 2447 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000098e Transaction freed
00000400:00000200:29.0:1773851886.473736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851886.473739:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851886.493621:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851886.493622:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851886.493623:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851886.493625:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851886.493627:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24112@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.493628:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24112@kfi7 : PUT - for me
00000400:00000200:21.0:1773851886.493629:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24112@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.493629:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8e0273a nid 24112@kfi7 refs 1
00000400:00000200:21.0:1773851886.493631:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24112@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.493631:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8e0273a nid 24112@kfi7 refs 2
00000400:00000200:21.0:1773851886.493633:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e8e0273a nid 24112@kfi7 refs 3
00000400:00000200:21.0:1773851886.493633:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24113@kfi7 to cpt 0
00000400:00000200:21.0:1773851886.493634:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24113@kfi7 of length 224 into portal 12 MB=0x699e0e08bfd00
00000400:00000200:21.0:1773851886.493636:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24113@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 53944
00000800:00000200:21.0:1773851886.493637:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851886.493639:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851886.493640:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24112@kfi7: PUT: OK
00000100:00000001:21.0:1773851886.493641:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851886.493642:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851886.493643:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e80f8e7e.
00000100:00000040:21.0:1773851886.493643:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e80f8e7e x1858040979258624 msgsize 224
00000100:00100000:21.0:1773851886.493645:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24113@kfi7 (source: 12345-24112@kfi7)
00000100:00000001:21.0:1773851886.493646:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851886.493647:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8e0273a nid 24112@kfi7 refs 2
00000100:00000001:23.0:1773851886.493648:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851886.493648:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851886.493648:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851886.493649:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851886.493649:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851886.493650:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851886.493651:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040979258624
00000020:00000001:23.0:1773851886.493651:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851886.493652:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ca8
00000020:00000001:23.0:1773851886.493653:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851886.493655:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b5390dff refcount=6
00000020:00000001:23.0:1773851886.493656:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744183808 : -107128965367808 : ffff9e911812f800)
00000020:00000001:23.0:1773851886.493657:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744183808 : -107128965367808 : ffff9e911812f800)
00000100:00000001:23.0:1773851886.493658:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851886.493658:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851886.493659:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058dbbd5e.
00000020:00000010:23.0:1773851886.493660:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851886.493661:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851886.493662:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851886.493662:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851886.493663:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851886.493664:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851886.493665:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851886.493665:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851886.493666:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851886.493667:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851886.493667:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851886.493668:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851886.493668:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851886.493669:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24113@kfi7, seq: 1998037
00000100:00000040:23.0:1773851886.493669:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b5390dff : new rpc_count 1
00000100:00000001:23.0:1773851886.493670:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956275328 : -106937753276288 : ffff9ebd9d33f080)
00000100:00000001:20.0:1773851886.493670:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.493670:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851886.493671:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e80f8e7e x1858040979258624/t0(0) o400->de72d1da-6fdf-4983-86eb-5052913c8ad0@24113@kfi7:526/0 lens 224/0 e 0 to 0 dl 1773852641 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1997-0'
00000100:00000001:23.0:1773851886.493674:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851886.493675:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851886.493676:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e80f8e7e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:de72d1da-6fdf-4983-86eb-5052913c8ad0+6:39639:x1858040979258624:12345-24113@kfi7:400:default-tuolumne1997-0
00000100:00000200:23.0:1773851886.493677:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040979258624
00000020:00000001:23.0:1773851886.493677:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851886.493678:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851886.493679:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851886.493680:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851886.493680:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851886.493682:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851886.493682:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040979258624, found 0 last_xid 1858040979258623
00000020:00000001:23.0:1773851886.493683:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851886.493684:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851886.493684:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851886.493685:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851886.493686:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851886.493686:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851886.493687:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851886.493688:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000da862ab6.
02000000:00000001:23.0:1773851886.493688:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851886.493689:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851886.493690:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851886.493690:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044156546, transno 0, xid 1858040979258624
00010000:00000001:23.0:1773851886.493691:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851886.493692:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e80f8e7e x1858040979258624/t0(0) o400->de72d1da-6fdf-4983-86eb-5052913c8ad0@24113@kfi7:526/0 lens 224/224 e 0 to 0 dl 1773852641 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1997-0'
00010000:00000001:23.0:1773851886.493694:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851886.493695:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851886.493696:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=119 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851886.493697:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851886.493698:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000622ef956 refcount 3 to 24113@kfi7
00000100:00000001:23.0:1773851886.493698:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051776 : -107154804499840 : ffff9e8b13f11a80)
02000000:00000001:23.0:1773851886.493699:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851886.493700:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851886.493700:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851886.493701:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24112@kfi7
00000400:00000010:23.0:1773851886.493702:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042659cea.
00000100:00000200:23.0:1773851886.493703:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040979258624, offset 224
00000400:00000200:23.0:1773851886.493704:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24112@kfi7
00000400:00000200:23.0:1773851886.493705:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24112@kfi7 to cpt 5
00000400:00000200:23.0:1773851886.493706:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8e0273a nid 24112@kfi7 refs 1
00000400:00000200:23.0:1773851886.493707:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e8e0273a nid 24112@kfi7 refs 2
00000400:00000200:23.0:1773851886.493709:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e8e0273a nid 24112@kfi7 refs 3
00000400:00000200:23.0:1773851886.493710:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24112@kfi7 local destination
00000400:00000200:23.0:1773851886.493712:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769854:8769854:1024:4294967295] 24112@kfi7 LPNI seq info [265192:265192:16:4294967295]
00000400:00000200:23.0:1773851886.493714:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e8e0273a nid 24112@kfi7 refs 2
00000400:00000200:23.0:1773851886.493714:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24112@kfi7 to cpt 5
00000400:00000200:23.0:1773851886.493716:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24112@kfi7(24112@kfi7:24112@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851886.493718:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e8e0273a nid 24112@kfi7 refs 3
00000800:00000200:23.0:1773851886.493719:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851886.493720:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851886.493722:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851886.493724:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb22 Using peer 24112@kfi7(0xb22)
00000800:00000200:23.0:1773851886.493730:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0xb22: rc=0
00000800:00000200:23.0:1773851886.493731:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb22 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851886.493733:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851886.493734:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000622ef956 refcount 2 to 24113@kfi7
00010000:00000001:23.0:1773851886.493735:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851886.493735:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851886.493736:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851886.493737:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e80f8e7e x1858040979258624/t0(0) o400->de72d1da-6fdf-4983-86eb-5052913c8ad0@24113@kfi7:526/0 lens 224/224 e 0 to 0 dl 1773852641 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1997-0'
00000100:00100000:23.0:1773851886.493740:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e80f8e7e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:de72d1da-6fdf-4983-86eb-5052913c8ad0+6:39639:x1858040979258624:12345-24113@kfi7:400:default-tuolumne1997-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851886.493742:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24113@kfi7, seq: 1998037
00000100:00000040:23.0:1773851886.493743:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b5390dff : new rpc_count 0
00000100:00000001:23.0:1773851886.493743:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851886.493744:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851886.493744:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb22 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851886.493745:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851886.493745:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851886.493746:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:23.0:1773851886.493746:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058dbbd5e.
00000400:00000200:21.0:1773851886.493746:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24112@kfi7: PUT: OK
00000400:00000200:21.0:1773851886.493747:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042659cea
00000020:00000040:23.0:1773851886.493748:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000b5390dff : new refcount 5
00000100:00000001:23.0:1773851886.493748:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:21.0:1773851886.493748:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042659cea.
00000100:00000001:21.0:1773851886.493748:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851886.493749:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851886.493750:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8e0273a nid 24112@kfi7 refs 2
00000800:00000200:21.0:1773851886.493751:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 24112@kfi7(00000000b54f01a3):0x0 lsk 2851 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb22 Transaction freed
00000800:00000200:5.0:1773851886.497060:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851886.497062:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851886.497064:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851886.497067:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851886.497071:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19427@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.497073:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19427@kfi7 : PUT - for me
00000400:00000200:5.0:1773851886.497074:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19427@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.497076:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e52b73ff nid 19427@kfi7 refs 1
00000400:00000200:5.0:1773851886.497078:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19427@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.497079:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e52b73ff nid 19427@kfi7 refs 2
00000400:00000200:5.0:1773851886.497080:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e52b73ff nid 19427@kfi7 refs 3
00000400:00000200:5.0:1773851886.497082:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19235@kfi7 to cpt 7
00000400:00000200:5.0:1773851886.497084:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19235@kfi7 of length 224 into portal 12 MB=0x69b4b603d5b40
00000400:00000200:5.0:1773851886.497086:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19235@kfi7 of length 224/224 into md 0x793926dc5 [64] + 156568
00000800:00000200:5.0:1773851886.497089:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851886.497092:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851886.497094:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19427@kfi7: PUT: OK
00000100:00000001:5.0:1773851886.497096:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851886.497096:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851886.497099:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d36b2d14.
00000100:00000040:5.0:1773851886.497100:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000d36b2d14 x1859597899750208 msgsize 224
00000100:00100000:5.0:1773851886.497103:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19235@kfi7 (source: 12345-19427@kfi7)
00000100:00000001:5.0:1773851886.497105:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851886.497106:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e52b73ff nid 19427@kfi7 refs 2
00000100:00000001:4.0:1773851886.497106:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851886.497107:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851886.497107:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851886.497108:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851886.497108:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851886.497109:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00100000:4.0:1773851886.497109:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597899750208
00000020:00000001:4.0:1773851886.497110:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851886.497110:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d809fd
00000020:00000001:4.0:1773851886.497111:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851886.497113:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d81767e7 refcount=5
00000020:00000001:4.0:1773851886.497113:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134494420992 : -106939215130624 : ffff9ebd4611d000)
00000020:00000001:4.0:1773851886.497114:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134494420992 : -106939215130624 : ffff9ebd4611d000)
00000100:00000001:4.0:1773851886.497115:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851886.497116:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851886.497117:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851886.497118:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851886.497119:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851886.497120:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851886.497120:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851886.497121:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.497122:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851886.497122:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851886.497123:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.497123:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.497125:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851886.497125:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851886.497126:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:4.0:1773851886.497126:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19235@kfi7, seq: 2001966
00000100:00000001:7.0:1773851886.497127:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851886.497127:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.497127:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d81767e7 : new rpc_count 1
00000100:00000001:4.0:1773851886.497127:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108937344 : -106938600614272 : ffff9ebd6ab29680)
00000100:00000001:7.0:1773851886.497128:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.497129:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d36b2d14 x1859597899750208/t0(0) o400->cae557bd-2029-4417-a8b4-b65f4eb0ad1c@19235@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1691-0'
00000100:00000001:4.0:1773851886.497131:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851886.497131:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851886.497132:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d36b2d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:cae557bd-2029-4417-a8b4-b65f4eb0ad1c+5:39574:x1859597899750208:12345-19235@kfi7:400:default-tuolumne1691-0
00000100:00000200:4.0:1773851886.497134:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597899750208
00000020:00000001:4.0:1773851886.497134:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851886.497135:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851886.497135:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.497136:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851886.497137:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851886.497137:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851886.497138:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597899750208, found 0 last_xid 1859597899750207
00000020:00000001:4.0:1773851886.497139:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851886.497139:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851886.497140:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851886.497140:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.497141:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851886.497142:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851886.497142:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851886.497143:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000074e40d31.
02000000:00000001:4.0:1773851886.497144:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.497145:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.497145:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851886.497146:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096705865, transno 0, xid 1859597899750208
00010000:00000001:4.0:1773851886.497147:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851886.497147:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d36b2d14 x1859597899750208/t0(0) o400->cae557bd-2029-4417-a8b4-b65f4eb0ad1c@19235@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1691-0'
00010000:00000001:4.0:1773851886.497150:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851886.497150:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851886.497151:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=118 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851886.497152:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851886.497153:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000084804dbf refcount 3 to 19235@kfi7
00000100:00000001:4.0:1773851886.497153:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272448 : -107152618279168 : ffff9e8b96402f00)
02000000:00000001:4.0:1773851886.497154:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851886.497155:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.497155:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851886.497156:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19427@kfi7
00000400:00000010:4.0:1773851886.497157:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007836e8de.
00000100:00000200:4.0:1773851886.497158:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597899750208, offset 224
00000400:00000200:4.0:1773851886.497159:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19427@kfi7
00000400:00000200:4.0:1773851886.497159:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19427@kfi7 to cpt 1
00000400:00000200:4.0:1773851886.497160:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e52b73ff nid 19427@kfi7 refs 1
00000400:00000200:4.0:1773851886.497161:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e52b73ff nid 19427@kfi7 refs 2
00000400:00000200:4.0:1773851886.497162:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e52b73ff nid 19427@kfi7 refs 3
00000400:00000200:4.0:1773851886.497163:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19427@kfi7 local destination
00000400:00000200:4.0:1773851886.497165:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769855:8769855:1024:4294967295] 19427@kfi7 LPNI seq info [304613:304613:16:4294967295]
00000400:00000200:4.0:1773851886.497166:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e52b73ff nid 19427@kfi7 refs 2
00000400:00000200:4.0:1773851886.497167:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19427@kfi7 to cpt 1
00000400:00000200:4.0:1773851886.497169:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19427@kfi7(19427@kfi7:19427@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851886.497170:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e52b73ff nid 19427@kfi7 refs 3
00000800:00000200:4.0:1773851886.497172:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851886.497173:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851886.497175:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851886.497177:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb41 Using peer 19427@kfi7(0xb41)
00000800:00000200:4.0:1773851886.497180:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0xb41: rc=0
00000800:00000200:4.0:1773851886.497182:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb41 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851886.497184:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.497185:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000084804dbf refcount 2 to 19235@kfi7
00010000:00000001:4.0:1773851886.497185:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851886.497186:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.497187:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851886.497187:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d36b2d14 x1859597899750208/t0(0) o400->cae557bd-2029-4417-a8b4-b65f4eb0ad1c@19235@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1691-0'
00000100:00100000:4.0:1773851886.497192:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d36b2d14 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:cae557bd-2029-4417-a8b4-b65f4eb0ad1c+5:39574:x1859597899750208:12345-19235@kfi7:400:default-tuolumne1691-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851886.497194:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19235@kfi7, seq: 2001966
00000100:00000040:4.0:1773851886.497195:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d81767e7 : new rpc_count 0
00000100:00000001:4.0:1773851886.497196:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851886.497196:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851886.497197:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851886.497197:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851886.497198:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851886.497199:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000d81767e7 : new refcount 4
00000100:00000001:4.0:1773851886.497200:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851886.497206:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb41 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851886.497208:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851886.497210:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19427@kfi7: PUT: OK
00000400:00000200:5.0:1773851886.497212:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007836e8de
00000400:00000010:5.0:1773851886.497212:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007836e8de.
00000100:00000001:5.0:1773851886.497214:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851886.497214:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851886.497215:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e52b73ff nid 19427@kfi7 refs 2
00000800:00000200:5.0:1773851886.497218:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19427@kfi7(00000000eb0bcd5e):0x0 lsk 2882 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0xb41 Transaction freed
00000800:00000200:27.0:1773851886.525779:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851886.525779:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851886.525779:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851886.525780:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851886.525781:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851886.525782:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851886.525783:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21091@kfi7(00000000effbb1d5):0x967 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851886.525784:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 Using peer 21091@kfi7(0x100000000000967)
00000800:00000200:27.0:1773851886.525785:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851886.525787:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21091@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.525787:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21091@kfi7 to cpt 6
00000400:00000200:27.0:1773851886.525789:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21091@kfi7 : PUT - for me
00000800:00000200:25.0:1773851886.525789:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x100000000000967: rc=0
00000400:00000200:27.0:1773851886.525790:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21091@kfi7 to cpt 6
00000800:00000200:25.0:1773851886.525790:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851886.525791:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2289047 nid 21091@kfi7 refs 1
00000400:00000200:27.0:1773851886.525793:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21091@kfi7 to cpt 6
00000400:00000200:27.0:1773851886.525793:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2289047 nid 21091@kfi7 refs 2
00000400:00000200:27.0:1773851886.525794:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2289047 nid 21091@kfi7 refs 3
00000400:00000200:27.0:1773851886.525795:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21091@kfi7 to cpt 6
00000400:00000200:27.0:1773851886.525796:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21091@kfi7 of length 224 into portal 12 MB=0x699e111b7e980
00000400:00000200:27.0:1773851886.525798:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21091@kfi7 of length 224/224 into md 0x16159c9699 [64] + 30176
00000800:00000200:27.0:1773851886.525800:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851886.525801:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851886.525802:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851886.525803:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21091@kfi7: PUT: OK
00000800:00000200:25.0:1773851886.525804:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 Transaction freed
00000100:00000001:27.0:1773851886.525805:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851886.525805:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851886.525806:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a578e67d.
00000100:00000040:27.0:1773851886.525807:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000a578e67d x1858041804220800 msgsize 224
00000100:00100000:27.0:1773851886.525809:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-21091@kfi7 (source: 12345-21091@kfi7)
00000100:00000001:27.0:1773851886.525811:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851886.525812:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2289047 nid 21091@kfi7 refs 2
00000800:00000200:27.0:1773851886.525813:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2054@kfi7:6 <- 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851886.525817:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851886.525818:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851886.525819:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851886.525819:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851886.525820:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851886.525821:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041804220800
00000020:00000001:27.0:1773851886.525822:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851886.525822:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac927a0
00000020:00000001:27.0:1773851886.525823:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851886.525825:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007020cd84 refcount=6
00000020:00000001:27.0:1773851886.525825:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631484416 : -107123078067200 : ffff9e9276fc0c00)
00000020:00000001:27.0:1773851886.525826:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631484416 : -107123078067200 : ffff9e9276fc0c00)
00000100:00000001:27.0:1773851886.525827:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851886.525828:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851886.525829:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0454dd1.
00000020:00000010:27.0:1773851886.525830:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851886.525831:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003b2e2389.
00000100:00000001:27.0:1773851886.525832:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851886.525832:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851886.525833:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851886.525834:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851886.525835:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851886.525835:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851886.525836:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851886.525838:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851886.525838:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851886.525838:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851886.525838:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851886.525839:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21091@kfi7, seq: 2025156
00000100:00000001:27.0:1773851886.525840:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851886.525840:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007020cd84 : new rpc_count 1
00000100:00000001:27.0:1773851886.525841:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851886.525841:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998414720 : -107053711136896 : ffff9ea29d936780)
00000100:00000040:26.0:1773851886.525843:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a578e67d x1858041804220800/t0(0) o400->81e49505-0e86-4185-a5e9-3953ea0e8d79@21091@kfi7:136/0 lens 224/0 e 0 to 0 dl 1773852251 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1804-0'
00000100:00000001:26.0:1773851886.525845:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851886.525846:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851886.525847:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a578e67d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:81e49505-0e86-4185-a5e9-3953ea0e8d79+6:39857:x1858041804220800:12345-21091@kfi7:400:default-tuolumne1804-0
00000100:00000200:26.0:1773851886.525848:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041804220800
00000020:00000001:26.0:1773851886.525849:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851886.525849:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851886.525850:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.525851:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851886.525851:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851886.525852:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851886.525853:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041804220800, found 0 last_xid 1858041804220799
00000020:00000001:26.0:1773851886.525854:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851886.525854:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851886.525855:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851886.525855:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.525856:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851886.525857:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851886.525857:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851886.525858:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000066e61092.
02000000:00000001:26.0:1773851886.525859:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851886.525859:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.525860:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851886.525861:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698507, transno 0, xid 1858041804220800
00010000:00000001:26.0:1773851886.525862:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851886.525863:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a578e67d x1858041804220800/t0(0) o400->81e49505-0e86-4185-a5e9-3953ea0e8d79@21091@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1804-0'
00010000:00000001:26.0:1773851886.525865:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851886.525866:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851886.525866:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=119 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851886.525868:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851886.525869:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002fed2358 refcount 3 to 21091@kfi7
00000100:00000001:26.0:1773851886.525869:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130859936 : -107149578691680 : ffff9e8c4b6c9ba0)
02000000:00000001:26.0:1773851886.525870:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851886.525871:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851886.525871:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851886.525872:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21091@kfi7
00000400:00000010:26.0:1773851886.525873:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f71e1c4.
00000100:00000200:26.0:1773851886.525874:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041804220800, offset 224
00000400:00000200:26.0:1773851886.525875:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21091@kfi7
00000400:00000200:26.0:1773851886.525876:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21091@kfi7 to cpt 6
00000400:00000200:26.0:1773851886.525876:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2289047 nid 21091@kfi7 refs 1
00000400:00000200:26.0:1773851886.525877:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2289047 nid 21091@kfi7 refs 2
00000400:00000200:26.0:1773851886.525879:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2289047 nid 21091@kfi7 refs 3
00000400:00000200:26.0:1773851886.525880:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21091@kfi7 local destination
00000400:00000200:26.0:1773851886.525881:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769856:8769856:1024:4294967295] 21091@kfi7 LPNI seq info [154950:154950:16:4294967295]
00000400:00000200:26.0:1773851886.525883:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2289047 nid 21091@kfi7 refs 2
00000400:00000200:26.0:1773851886.525883:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21091@kfi7 to cpt 6
00000400:00000200:26.0:1773851886.525885:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21091@kfi7(21091@kfi7:21091@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851886.525886:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2289047 nid 21091@kfi7 refs 3
00000800:00000200:26.0:1773851886.525887:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851886.525888:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851886.525891:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851886.525894:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 Using peer 21091@kfi7(0x100000000000967)
00000800:00000200:26.0:1773851886.525896:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001c682e34: Posted send of 324 bytes to peer 0x100000000000967: rc=0
00000800:00000200:26.0:1773851886.525898:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851886.525900:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851886.525901:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002fed2358 refcount 2 to 21091@kfi7
00010000:00000001:26.0:1773851886.525902:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851886.525902:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.525903:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851886.525904:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a578e67d x1858041804220800/t0(0) o400->81e49505-0e86-4185-a5e9-3953ea0e8d79@21091@kfi7:136/0 lens 224/224 e 0 to 0 dl 1773852251 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1804-0'
00000100:00100000:26.0:1773851886.525907:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a578e67d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:81e49505-0e86-4185-a5e9-3953ea0e8d79+6:39857:x1858041804220800:12345-21091@kfi7:400:default-tuolumne1804-0 Request processed in 61us (99us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851886.525909:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21091@kfi7, seq: 2025156
00000800:00000200:25.0:1773851886.525909:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851886.525910:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007020cd84 : new rpc_count 0
00000400:00000200:25.0:1773851886.525910:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851886.525911:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851886.525911:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21091@kfi7: PUT: OK
00000100:00000001:26.0:1773851886.525912:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851886.525912:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851886.525912:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f71e1c4
00000020:00000010:26.0:1773851886.525913:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003b2e2389.
00000400:00000010:25.0:1773851886.525913:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f71e1c4.
00000100:00000001:25.0:1773851886.525913:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:26.0:1773851886.525914:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0454dd1.
00000100:00000001:25.0:1773851886.525914:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:26.0:1773851886.525915:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000007020cd84 : new refcount 5
00000100:00000001:26.0:1773851886.525915:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851886.525915:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2289047 nid 21091@kfi7 refs 2
00000800:00000200:25.0:1773851886.525916:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2054@kfi7:6 -> 21091@kfi7(00000000effbb1d5):0x0 lsk 2408 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000967 Transaction freed
00000800:00000200:25.0:1773851886.536181:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851886.536182:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851886.536183:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851886.536185:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851886.536187:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.536188:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851886.536189:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.536190:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851886.536190:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.536191:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851886.536192:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851886.536192:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851886.536193:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a860b8080
00000400:00000200:25.0:1773851886.536194:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 14512
00000800:00000200:25.0:1773851886.536196:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851886.536198:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851886.536199:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851886.536200:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851886.536200:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851886.536201:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000002dc7e88.
00000100:00000040:25.0:1773851886.536202:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000002dc7e88 x1859388080619648 msgsize 224
00000100:00100000:25.0:1773851886.536203:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851886.536205:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:24.0:1773851886.536206:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851886.536206:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851886.536207:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851886.536207:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851886.536209:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
02000000:00000001:24.0:1773851886.536209:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851886.536209:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080619648
00000800:00000200:25.0:1773851886.536210:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000001:24.0:1773851886.536210:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851886.536210:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:24.0:1773851886.536211:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851886.536211:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:24.0:1773851886.536212:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:24.0:1773851886.536213:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:24.0:1773851886.536214:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851886.536214:0:1537164:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851886.536215:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851886.536215:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851886.536216:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000100:00000040:24.0:1773851886.536217:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851886.536218:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851886.536218:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851886.536219:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.536220:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.536221:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851886.536222:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851886.536222:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851886.536222:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851886.536223:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851886.536223:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799987
00000100:00000040:24.0:1773851886.536223:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:25.0:1773851886.536224:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851886.536224:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.536224:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252477696 : -106967457073920 : ffff9eb6b2b7f500)
00000100:00000040:24.0:1773851886.536225:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000002dc7e88 x1859388080619648/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:24.0:1773851886.536228:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851886.536228:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851886.536229:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002dc7e88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38115:x1859388080619648:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:24.0:1773851886.536230:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080619648
00000020:00000001:24.0:1773851886.536231:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851886.536231:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851886.536232:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851886.536233:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851886.536234:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851886.536234:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851886.536235:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851886.536235:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851886.536236:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851886.536236:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.536237:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851886.536237:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851886.536238:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000020e51d3f.
02000000:00000001:24.0:1773851886.536239:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.536239:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851886.536240:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851886.536241:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851886.536241:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851886.536242:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 85721088 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851886.536243:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132253 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851886.536244:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851886.536244:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080619648
00010000:00000001:24.0:1773851886.536245:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851886.536246:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000002dc7e88 x1859388080619648/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:24.0:1773851886.536248:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851886.536249:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851886.536249:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=13 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851886.536250:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851886.536251:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:24.0:1773851886.536251:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:24.0:1773851886.536252:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851886.536252:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851886.536253:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851886.536254:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:24.0:1773851886.536254:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c389395c.
00000100:00000200:24.0:1773851886.536255:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080619648, offset 224
00000400:00000200:24.0:1773851886.536256:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:24.0:1773851886.536258:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851886.536259:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:24.0:1773851886.536260:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851886.536261:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:24.0:1773851886.536262:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:24.0:1773851886.536263:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769857:8769857:1024:4294967295] 8@kfi7 LPNI seq info [17340070:17340070:16:4294967295]
00000400:00000200:24.0:1773851886.536264:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851886.536265:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851886.536266:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851886.536267:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:24.0:1773851886.536269:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851886.536270:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851886.536272:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851886.536274:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000800:00000200:24.0:1773851886.536277:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007491e18f: Posted send of 468 bytes to peer 0x200000000001191: rc=0
00000800:00000200:24.0:1773851886.536278:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851886.536280:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851886.536281:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:24.0:1773851886.536281:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851886.536282:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851886.536282:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851886.536283:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000002dc7e88 x1859388080619648/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:24.0:1773851886.536287:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002dc7e88 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38115:x1859388080619648:12345-7@kfi7:41:default-yuba5-0 Request processed in 58us (84us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851886.536289:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799987
00000100:00000040:24.0:1773851886.536290:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:24.0:1773851886.536291:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851886.536291:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851886.536292:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851886.536293:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000020:00000010:24.0:1773851886.536293:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851886.536294:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:24.0:1773851886.536295:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851886.536299:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851886.536301:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851886.536302:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000400:00000200:26.0:1773851886.536303:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c389395c
00000400:00000010:26.0:1773851886.536304:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c389395c.
00000100:00000001:26.0:1773851886.536304:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851886.536305:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851886.536306:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:26.0:1773851886.536307:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Transaction freed
00000800:00000200:21.0:1773851886.548328:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851886.548329:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851886.548330:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851886.548333:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851886.548336:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25955@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.548337:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25955@kfi7 : PUT - for me
00000400:00000200:21.0:1773851886.548338:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25955@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.548339:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012070f74 nid 25955@kfi7 refs 1
00000400:00000200:21.0:1773851886.548341:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25955@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.548341:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012070f74 nid 25955@kfi7 refs 2
00000400:00000200:21.0:1773851886.548342:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000012070f74 nid 25955@kfi7 refs 3
00000400:00000200:21.0:1773851886.548343:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25955@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.548344:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25955@kfi7 of length 224 into portal 12 MB=0x699f7f03abac0
00000400:00000200:21.0:1773851886.548346:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25955@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 54168
00000800:00000200:21.0:1773851886.548348:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851886.548350:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851886.548351:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25955@kfi7: PUT: OK
00000100:00000001:21.0:1773851886.548352:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851886.548353:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851886.548354:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa8fda36.
00000100:00000040:21.0:1773851886.548354:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000aa8fda36 x1858140026616512 msgsize 224
00000100:00100000:21.0:1773851886.548355:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25955@kfi7 (source: 12345-25955@kfi7)
00000100:00000001:21.0:1773851886.548356:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851886.548358:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000012070f74 nid 25955@kfi7 refs 2
00000100:00000001:23.0:1773851886.548359:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851886.548359:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851886.548360:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851886.548361:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851886.548362:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851886.548363:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851886.548364:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858140026616512
00000020:00000001:23.0:1773851886.548365:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851886.548366:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f48
00000020:00000001:23.0:1773851886.548367:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851886.548371:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000745fce4 refcount=10
00000020:00000001:23.0:1773851886.548372:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744933376 : -107128964618240 : ffff9e91181e6800)
00000020:00000001:23.0:1773851886.548373:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744933376 : -107128964618240 : ffff9e91181e6800)
00000100:00000001:23.0:1773851886.548375:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851886.548376:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851886.548377:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058dbbd5e.
00000020:00000010:23.0:1773851886.548378:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851886.548379:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851886.548381:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851886.548381:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851886.548382:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851886.548384:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851886.548384:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851886.548385:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851886.548387:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851886.548388:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851886.548388:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851886.548389:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851886.548389:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851886.548390:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25955@kfi7, seq: 1998038
00000100:00000001:23.0:1773851886.548391:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851886.548391:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000745fce4 : new rpc_count 1
00000100:00000001:23.0:1773851886.548392:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.548392:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956271872 : -106937753279744 : ffff9ebd9d33e300)
00000100:00000040:20.0:1773851886.548393:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa8fda36 x1858140026616512/t0(0) o400->2142e948-4577-44ed-9c6f-096ef8ddde6f@25955@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2108-0'
00000100:00000001:20.0:1773851886.548396:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851886.548396:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851886.548397:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa8fda36 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:2142e948-4577-44ed-9c6f-096ef8ddde6f+10:39821:x1858140026616512:12345-25955@kfi7:400:default-tuolumne2108-0
00000100:00000200:20.0:1773851886.548399:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858140026616512
00000020:00000001:20.0:1773851886.548399:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851886.548400:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851886.548401:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.548402:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851886.548403:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851886.548404:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851886.548404:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858140026616512, found 0 last_xid 1858140026616511
00000020:00000001:20.0:1773851886.548405:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851886.548406:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851886.548406:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851886.548407:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.548407:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851886.548408:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851886.548408:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851886.548409:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006ec06fbb.
02000000:00000001:20.0:1773851886.548410:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.548411:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.548411:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851886.548412:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260540097, transno 0, xid 1858140026616512
00010000:00000001:20.0:1773851886.548412:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851886.548413:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa8fda36 x1858140026616512/t0(0) o400->2142e948-4577-44ed-9c6f-096ef8ddde6f@25955@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2108-0'
00010000:00000001:20.0:1773851886.548415:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851886.548416:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851886.548417:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=119 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851886.548418:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851886.548418:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002ea08979 refcount 3 to 25955@kfi7
00000100:00000001:20.0:1773851886.548419:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025376 : -107156745526240 : ffff9e8aa03f6420)
02000000:00000001:20.0:1773851886.548420:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851886.548420:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.548421:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851886.548422:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25955@kfi7
00000400:00000010:20.0:1773851886.548423:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e022745.
00000100:00000200:20.0:1773851886.548423:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858140026616512, offset 224
00000400:00000200:20.0:1773851886.548425:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25955@kfi7
00000400:00000200:20.0:1773851886.548425:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25955@kfi7 to cpt 5
00000400:00000200:20.0:1773851886.548426:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012070f74 nid 25955@kfi7 refs 1
00000400:00000200:20.0:1773851886.548427:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000012070f74 nid 25955@kfi7 refs 2
00000400:00000200:20.0:1773851886.548429:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000012070f74 nid 25955@kfi7 refs 3
00000400:00000200:20.0:1773851886.548430:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25955@kfi7 local destination
00000400:00000200:20.0:1773851886.548432:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769858:8769858:1024:4294967295] 25955@kfi7 LPNI seq info [7490695:7490695:16:4294967295]
00000400:00000200:20.0:1773851886.548433:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000012070f74 nid 25955@kfi7 refs 2
00000400:00000200:20.0:1773851886.548434:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25955@kfi7 to cpt 5
00000400:00000200:20.0:1773851886.548436:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25955@kfi7(25955@kfi7:25955@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851886.548437:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000012070f74 nid 25955@kfi7 refs 3
00000800:00000200:20.0:1773851886.548439:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851886.548440:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851886.548442:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851886.548444:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000920 Using peer 25955@kfi7(0x100000000000920)
00000800:00000200:20.0:1773851886.548448:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x100000000000920: rc=0
00000800:00000200:20.0:1773851886.548449:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000920 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851886.548451:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851886.548452:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002ea08979 refcount 2 to 25955@kfi7
00010000:00000001:20.0:1773851886.548453:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851886.548453:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.548454:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851886.548455:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa8fda36 x1858140026616512/t0(0) o400->2142e948-4577-44ed-9c6f-096ef8ddde6f@25955@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2108-0'
00000100:00100000:20.0:1773851886.548458:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa8fda36 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:2142e948-4577-44ed-9c6f-096ef8ddde6f+10:39821:x1858140026616512:12345-25955@kfi7:400:default-tuolumne2108-0 Request processed in 61us (103us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851886.548461:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25955@kfi7, seq: 1998038
00000100:00000040:20.0:1773851886.548462:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000745fce4 : new rpc_count 0
00000100:00000001:20.0:1773851886.548463:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851886.548464:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851886.548464:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851886.548465:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:20.0:1773851886.548466:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058dbbd5e.
00000020:00000040:20.0:1773851886.548467:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000000745fce4 : new refcount 9
00000100:00000001:20.0:1773851886.548468:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851886.548472:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000920 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851886.548474:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851886.548475:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25955@kfi7: PUT: OK
00000400:00000200:21.0:1773851886.548476:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e022745
00000400:00000010:21.0:1773851886.548476:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e022745.
00000100:00000001:21.0:1773851886.548477:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851886.548477:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851886.548478:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000012070f74 nid 25955@kfi7 refs 2
00000800:00000200:21.0:1773851886.548480:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25955@kfi7(000000007b4ec279):0x0 lsk 2337 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000920 Transaction freed
00000800:00000200:21.0:1773851886.609005:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851886.609006:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851886.609008:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851886.609011:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851886.609014:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11904@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.609015:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11904@kfi7 : PUT - for me
00000400:00000200:21.0:1773851886.609017:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11904@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.609019:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec172d13 nid 11904@kfi7 refs 1
00000400:00000200:21.0:1773851886.609021:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11904@kfi7 to cpt 5
00000400:00000200:21.0:1773851886.609022:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec172d13 nid 11904@kfi7 refs 2
00000400:00000200:21.0:1773851886.609024:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ec172d13 nid 11904@kfi7 refs 3
00000400:00000200:21.0:1773851886.609025:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11840@kfi7 to cpt 1
00000400:00000200:21.0:1773851886.609026:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11840@kfi7 of length 224 into portal 12 MB=0x69b4b57691880
00000400:00000200:21.0:1773851886.609028:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11840@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 54392
00000800:00000200:21.0:1773851886.609031:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851886.609033:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851886.609035:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11904@kfi7: PUT: OK
00000100:00000001:21.0:1773851886.609037:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851886.609037:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851886.609039:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ef063acd.
00000100:00000040:21.0:1773851886.609040:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ef063acd x1859597751621760 msgsize 224
00000100:00100000:21.0:1773851886.609042:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-11840@kfi7 (source: 12345-11904@kfi7)
00000100:00000001:21.0:1773851886.609044:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851886.609045:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec172d13 nid 11904@kfi7 refs 2
00000100:00000001:20.0:1773851886.609047:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851886.609048:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851886.609048:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851886.609049:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851886.609049:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851886.609051:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851886.609052:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597751621760
00000020:00000001:20.0:1773851886.609053:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851886.609053:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79cd5
00000020:00000001:20.0:1773851886.609054:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851886.609059:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047ad6b5e refcount=5
00000020:00000001:20.0:1773851886.609060:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125744045056 : -106947965506560 : ffff9ebb3c81ac00)
00000020:00000001:20.0:1773851886.609061:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125744045056 : -106947965506560 : ffff9ebb3c81ac00)
00000100:00000001:20.0:1773851886.609063:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851886.609064:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851886.609065:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aeeb6e1.
00000020:00000010:20.0:1773851886.609067:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851886.609068:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000afae15a5.
00000100:00000001:20.0:1773851886.609069:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851886.609070:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851886.609071:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851886.609073:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851886.609074:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851886.609074:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.609076:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851886.609078:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851886.609079:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851886.609079:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851886.609080:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851886.609080:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11840@kfi7, seq: 1998039
00000100:00000001:23.0:1773851886.609082:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851886.609082:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047ad6b5e : new rpc_count 1
00000100:00000001:23.0:1773851886.609083:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.609084:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956270720 : -106937753280896 : ffff9ebd9d33de80)
00000100:00000040:20.0:1773851886.609086:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ef063acd x1859597751621760/t0(0) o400->4dd3bb54-cde8-4176-9cd6-befea9b6b1d1@11840@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1236-0'
00000100:00000001:20.0:1773851886.609091:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851886.609092:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851886.609094:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef063acd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:4dd3bb54-cde8-4176-9cd6-befea9b6b1d1+5:39675:x1859597751621760:12345-11840@kfi7:400:default-tuolumne1236-0
00000100:00000200:20.0:1773851886.609096:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597751621760
00000020:00000001:20.0:1773851886.609097:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851886.609098:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851886.609099:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.609100:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851886.609101:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851886.609102:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851886.609103:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597751621760, found 0 last_xid 1859597751621759
00000020:00000001:20.0:1773851886.609104:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851886.609105:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851886.609106:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851886.609107:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.609108:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851886.609108:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851886.609109:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851886.609110:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d412f602.
02000000:00000001:20.0:1773851886.609111:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.609112:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.609113:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851886.609114:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182684910078, transno 0, xid 1859597751621760
00010000:00000001:20.0:1773851886.609115:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851886.609117:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ef063acd x1859597751621760/t0(0) o400->4dd3bb54-cde8-4176-9cd6-befea9b6b1d1@11840@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1236-0'
00010000:00000001:20.0:1773851886.609122:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851886.609122:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851886.609123:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=119 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851886.609126:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851886.609127:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007b8d7c3b refcount 3 to 11840@kfi7
00000100:00000001:20.0:1773851886.609128:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553701824 : -107156155849792 : ffff9e8ac36523c0)
02000000:00000001:20.0:1773851886.609130:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851886.609130:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851886.609131:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851886.609133:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11904@kfi7
00000400:00000010:20.0:1773851886.609134:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008110c84f.
00000100:00000200:20.0:1773851886.609135:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597751621760, offset 224
00000400:00000200:20.0:1773851886.609137:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11904@kfi7
00000400:00000200:20.0:1773851886.609139:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11904@kfi7 to cpt 5
00000400:00000200:20.0:1773851886.609140:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec172d13 nid 11904@kfi7 refs 1
00000400:00000200:20.0:1773851886.609142:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ec172d13 nid 11904@kfi7 refs 2
00000400:00000200:20.0:1773851886.609144:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ec172d13 nid 11904@kfi7 refs 3
00000400:00000200:20.0:1773851886.609146:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11904@kfi7 local destination
00000400:00000200:20.0:1773851886.609148:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769859:8769859:1024:4294967295] 11904@kfi7 LPNI seq info [399604:399604:16:4294967295]
00000400:00000200:20.0:1773851886.609151:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ec172d13 nid 11904@kfi7 refs 2
00000400:00000200:20.0:1773851886.609152:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11904@kfi7 to cpt 5
00000400:00000200:20.0:1773851886.609156:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11904@kfi7(11904@kfi7:11904@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851886.609158:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ec172d13 nid 11904@kfi7 refs 3
00000800:00000200:20.0:1773851886.609160:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851886.609162:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851886.609166:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851886.609170:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000932 Using peer 11904@kfi7(0x100000000000932)
00000800:00000200:20.0:1773851886.609175:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0x100000000000932: rc=0
00000800:00000200:20.0:1773851886.609178:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000932 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851886.609181:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851886.609183:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007b8d7c3b refcount 2 to 11840@kfi7
00010000:00000001:20.0:1773851886.609185:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851886.609185:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851886.609186:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851886.609187:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ef063acd x1859597751621760/t0(0) o400->4dd3bb54-cde8-4176-9cd6-befea9b6b1d1@11840@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1236-0'
00000100:00100000:20.0:1773851886.609193:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef063acd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:4dd3bb54-cde8-4176-9cd6-befea9b6b1d1+5:39675:x1859597751621760:12345-11840@kfi7:400:default-tuolumne1236-0 Request processed in 101us (152us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851886.609197:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11840@kfi7, seq: 1998039
00000100:00000040:20.0:1773851886.609198:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047ad6b5e : new rpc_count 0
00000100:00000001:20.0:1773851886.609200:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851886.609200:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851886.609201:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851886.609202:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000afae15a5.
00000020:00000010:20.0:1773851886.609204:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aeeb6e1.
00000020:00000040:20.0:1773851886.609205:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000047ad6b5e : new refcount 4
00000100:00000001:20.0:1773851886.609206:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851886.609214:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000932 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851886.609218:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851886.609220:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11904@kfi7: PUT: OK
00000400:00000200:21.0:1773851886.609221:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008110c84f
00000400:00000010:21.0:1773851886.609222:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008110c84f.
00000100:00000001:21.0:1773851886.609223:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851886.609224:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851886.609225:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec172d13 nid 11904@kfi7 refs 2
00000800:00000200:21.0:1773851886.609228:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 11904@kfi7(000000004e34f458):0x0 lsk 2355 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000932 Transaction freed
00000800:00000200:5.0:1773851886.609630:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851886.609631:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851886.609633:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851886.609636:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851886.609638:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.609640:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851886.609641:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.609642:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851886.609643:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.609644:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851886.609645:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851886.609645:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851886.609647:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c97fb80
00000400:00000200:5.0:1773851886.609649:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x793844545 [256] + 7632
00000800:00000200:5.0:1773851886.609651:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851886.609653:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851886.609654:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851886.609655:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851886.609656:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851886.609657:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e20256d4.
00000100:00000040:5.0:1773851886.609658:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e20256d4 x1858065608997760 msgsize 224
00000100:00100000:5.0:1773851886.609659:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00000100:00000001:5.0:1773851886.609660:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851886.609661:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000001:6.0:1773851886.609662:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851886.609663:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851886.609663:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851886.609664:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851886.609664:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851886.609665:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851886.609666:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065608997760
00000020:00000001:6.0:1773851886.609667:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851886.609667:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:6.0:1773851886.609668:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851886.609669:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:6.0:1773851886.609670:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:6.0:1773851886.609670:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:6.0:1773851886.609671:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851886.609672:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851886.609673:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851886.609675:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851886.609675:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851886.609677:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851886.609678:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851886.609679:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851886.609679:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851886.609681:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851886.609682:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851886.609683:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851886.609684:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851886.609684:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851886.609684:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851886.609685:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314085
00000100:00000040:6.0:1773851886.609686:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:5.0:1773851886.609686:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851886.609687:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108961536 : -106938600590080 : ffff9ebd6ab2f500)
00000100:00000001:5.0:1773851886.609687:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851886.609688:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e20256d4 x1858065608997760/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:6.0:1773851886.609691:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851886.609691:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851886.609692:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e20256d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065608997760:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:6.0:1773851886.609693:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065608997760
00000020:00000001:6.0:1773851886.609694:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851886.609695:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851886.609695:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851886.609696:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851886.609697:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851886.609698:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851886.609698:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851886.609699:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851886.609700:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851886.609700:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851886.609701:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851886.609701:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851886.609703:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000e487b715.
02000000:00000001:6.0:1773851886.609703:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851886.609704:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851886.609705:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851886.609706:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851886.609706:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851886.609708:0:1537125:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:6.0:1773851886.609709:0:1537125:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851886.609710:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 85721088 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851886.609711:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132253 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851886.609713:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851886.609713:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065608997760
00010000:00000001:6.0:1773851886.609714:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851886.609715:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e20256d4 x1858065608997760/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:6.0:1773851886.609718:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851886.609718:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851886.609719:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=115 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851886.609720:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851886.609721:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:6.0:1773851886.609722:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:6.0:1773851886.609723:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851886.609723:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851886.609724:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851886.609729:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000400:00000010:6.0:1773851886.609730:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009b8a7556.
00000100:00000200:6.0:1773851886.609731:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065608997760, offset 224
00000400:00000200:6.0:1773851886.609732:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000400:00000200:6.0:1773851886.609733:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851886.609734:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:6.0:1773851886.609735:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851886.609736:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:6.0:1773851886.609738:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  30@kfi7 local destination
00000400:00000200:6.0:1773851886.609739:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769860:8769860:1024:4294967295] 30@kfi7 LPNI seq info [23133323:23133323:16:4294967295]
00000400:00000200:6.0:1773851886.609741:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851886.609741:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851886.609744:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851886.609745:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000800:00000200:6.0:1773851886.609749:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851886.609750:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851886.609752:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851886.609755:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 Using peer 30@kfi7(0xa16)
00000800:00000200:6.0:1773851886.609758:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 468 bytes to peer 0xa16: rc=0
00000800:00000200:6.0:1773851886.609760:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851886.609762:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851886.609762:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:6.0:1773851886.609763:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851886.609764:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851886.609764:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851886.609765:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e20256d4 x1858065608997760/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:6.0:1773851886.609768:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e20256d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065608997760:12345-13@kfi7:41:default-yuba3-0 Request processed in 77us (110us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851886.609771:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314085
00000800:00000200:5.0:1773851886.609771:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 TN_EVENT_TX_OK event status 0
00000100:00000040:6.0:1773851886.609772:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000100:00000001:6.0:1773851886.609772:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851886.609773:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851886.609773:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:6.0:1773851886.609774:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:6.0:1773851886.609774:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000400:00000200:5.0:1773851886.609774:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000020:00000010:6.0:1773851886.609775:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000400:00000200:5.0:1773851886.609775:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009b8a7556
00000400:00000010:5.0:1773851886.609775:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009b8a7556.
00000020:00000040:6.0:1773851886.609776:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:5.0:1773851886.609776:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851886.609776:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:6.0:1773851886.609777:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851886.609777:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851886.609778:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2069@kfi7:1 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa16 Transaction freed
00000800:00000200:29.0:1773851886.631866:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851886.631867:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851886.631868:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851886.631871:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851886.631873:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21874@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.631875:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21874@kfi7 : PUT - for me
00000400:00000200:29.0:1773851886.631876:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21874@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.631877:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000375f8873 nid 21874@kfi7 refs 1
00000400:00000200:29.0:1773851886.631879:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21874@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.631880:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000375f8873 nid 21874@kfi7 refs 2
00000400:00000200:29.0:1773851886.631881:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000375f8873 nid 21874@kfi7 refs 3
00000400:00000200:29.0:1773851886.631882:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21875@kfi7 to cpt 2
00000400:00000200:29.0:1773851886.631883:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21875@kfi7 of length 224 into portal 12 MB=0x69b0a325cce00
00000400:00000200:29.0:1773851886.631884:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21875@kfi7 of length 224/224 into md 0x77fe139dd [64] + 194200
00000800:00000200:29.0:1773851886.631886:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851886.631888:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851886.631889:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21874@kfi7: PUT: OK
00000100:00000001:29.0:1773851886.631890:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851886.631891:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851886.631892:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066f616b8.
00000100:00000040:29.0:1773851886.631893:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000066f616b8 x1859317957185024 msgsize 224
00000100:00100000:29.0:1773851886.631894:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21875@kfi7 (source: 12345-21874@kfi7)
00000100:00000001:29.0:1773851886.631895:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851886.631896:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000375f8873 nid 21874@kfi7 refs 2
00000800:00000200:29.0:1773851886.631898:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000015728a5f: 2069@kfi7:7 <- 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851886.631901:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851886.631902:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851886.631902:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851886.631903:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851886.631904:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851886.631904:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317957185024
00000020:00000001:29.0:1773851886.631905:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851886.631905:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92714
00000020:00000001:29.0:1773851886.631906:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851886.631910:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003197b24a refcount=6
00000020:00000001:29.0:1773851886.631910:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631266304 : -107123078285312 : ffff9e9276f8b800)
00000020:00000001:29.0:1773851886.631912:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631266304 : -107123078285312 : ffff9e9276f8b800)
00000100:00000001:29.0:1773851886.631913:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851886.631914:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851886.631915:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851886.631916:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851886.631917:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851886.631918:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851886.631918:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851886.631919:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.631920:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851886.631921:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851886.631921:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.631922:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851886.631924:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851886.631925:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851886.631925:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851886.631925:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851886.631926:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21875@kfi7, seq: 2055571
00000100:00000040:29.0:1773851886.631926:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003197b24a : new rpc_count 1
00000100:00000001:30.0:1773851886.631927:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851886.631927:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.631927:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262242048 : -106943447309568 : ffff9ebc49cfe300)
00000100:00000040:29.0:1773851886.631928:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066f616b8 x1859317957185024/t0(0) o400->002319da-5376-4010-a9e7-91be4cad6ebd@21875@kfi7:674/0 lens 224/0 e 0 to 0 dl 1773852034 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1850-0'
00000100:00000001:29.0:1773851886.631931:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851886.631932:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851886.631933:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f616b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:002319da-5376-4010-a9e7-91be4cad6ebd+6:39476:x1859317957185024:12345-21875@kfi7:400:default-tuolumne1850-0
00000100:00000200:29.0:1773851886.631934:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317957185024
00000020:00000001:29.0:1773851886.631935:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851886.631935:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851886.631936:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.631937:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851886.631937:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851886.631938:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851886.631939:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317957185024, found 0 last_xid 1859317957185023
00000020:00000001:29.0:1773851886.631940:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851886.631941:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851886.631941:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851886.631942:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.631943:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851886.631944:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851886.631944:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851886.631945:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003750b809.
02000000:00000001:29.0:1773851886.631946:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.631946:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.631947:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851886.631948:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260392076, transno 0, xid 1859317957185024
00010000:00000001:29.0:1773851886.631949:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851886.631950:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066f616b8 x1859317957185024/t0(0) o400->002319da-5376-4010-a9e7-91be4cad6ebd@21875@kfi7:674/0 lens 224/224 e 0 to 0 dl 1773852034 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1850-0'
00010000:00000001:29.0:1773851886.631952:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851886.631953:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851886.631954:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=119 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851886.631955:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851886.631955:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009f17c968 refcount 3 to 21875@kfi7
00000100:00000001:29.0:1773851886.631956:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810488384 : -107154899063232 : ffff9e8b0e4e2e40)
02000000:00000001:29.0:1773851886.631957:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851886.631958:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851886.631958:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851886.631959:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21874@kfi7
00000400:00000010:29.0:1773851886.631960:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ff351f68.
00000100:00000200:29.0:1773851886.631961:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317957185024, offset 224
00000400:00000200:29.0:1773851886.631962:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21874@kfi7
00000400:00000200:29.0:1773851886.631963:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21874@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.631964:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000375f8873 nid 21874@kfi7 refs 1
00000400:00000200:29.0:1773851886.631965:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000375f8873 nid 21874@kfi7 refs 2
00000400:00000200:29.0:1773851886.631966:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000375f8873 nid 21874@kfi7 refs 3
00000400:00000200:29.0:1773851886.631967:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21874@kfi7 local destination
00000400:00000200:29.0:1773851886.631968:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769861:8769861:1024:4294967295] 21874@kfi7 LPNI seq info [616030:616030:16:4294967295]
00000400:00000200:29.0:1773851886.631970:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000375f8873 nid 21874@kfi7 refs 2
00000400:00000200:29.0:1773851886.631971:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21874@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.631973:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21874@kfi7(21874@kfi7:21874@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851886.631974:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000375f8873 nid 21874@kfi7 refs 3
00000800:00000200:29.0:1773851886.631975:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851886.631976:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851886.631978:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851886.631980:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106 Using peer 21874@kfi7(0x106)
00000800:00000200:29.0:1773851886.631984:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000015728a5f: Posted send of 324 bytes to peer 0x106: rc=0
00000800:00000200:29.0:1773851886.631985:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851886.631987:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851886.631988:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009f17c968 refcount 2 to 21875@kfi7
00010000:00000001:29.0:1773851886.631989:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851886.631989:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851886.631990:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851886.631991:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066f616b8 x1859317957185024/t0(0) o400->002319da-5376-4010-a9e7-91be4cad6ebd@21875@kfi7:674/0 lens 224/224 e 0 to 0 dl 1773852034 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1850-0'
00000100:00100000:29.0:1773851886.631994:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f616b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:002319da-5376-4010-a9e7-91be4cad6ebd+6:39476:x1859317957185024:12345-21875@kfi7:400:default-tuolumne1850-0 Request processed in 61us (100us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851886.631996:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21875@kfi7, seq: 2055571
00000100:00000040:29.0:1773851886.631997:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003197b24a : new rpc_count 0
00000800:00000200:30.0:1773851886.631998:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851886.631998:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851886.631998:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851886.631999:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851886.632000:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000400:00000200:30.0:1773851886.632001:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851886.632001:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000020:00000040:29.0:1773851886.632001:0:60533:0:(genops.c:882:class_export_put()) PUTting export 000000003197b24a : new refcount 5
00000400:00000200:30.0:1773851886.632002:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21874@kfi7: PUT: OK
00000100:00000001:29.0:1773851886.632002:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851886.632003:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ff351f68
00000400:00000010:30.0:1773851886.632004:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ff351f68.
00000100:00000001:30.0:1773851886.632005:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851886.632005:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851886.632006:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000375f8873 nid 21874@kfi7 refs 2
00000800:00000200:30.0:1773851886.632008:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015728a5f: 2069@kfi7:7 -> 21874@kfi7(000000006192e4e8):0x0 lsk 263 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x106 Transaction freed
00000800:00000200:9.0:1773851886.650459:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851886.650460:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851886.650461:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851886.650463:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851886.650465:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11602@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.650466:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11602@kfi7 : PUT - for me
00000400:00000200:9.0:1773851886.650467:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11602@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.650468:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000631d162e nid 11602@kfi7 refs 1
00000400:00000200:9.0:1773851886.650470:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11602@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.650470:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000631d162e nid 11602@kfi7 refs 2
00000400:00000200:9.0:1773851886.650471:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000631d162e nid 11602@kfi7 refs 3
00000400:00000200:9.0:1773851886.650473:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11667@kfi7 to cpt 1
00000400:00000200:9.0:1773851886.650473:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11667@kfi7 of length 224 into portal 12 MB=0x69b0a5a24ab40
00000400:00000200:9.0:1773851886.650475:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11667@kfi7 of length 224/224 into md 0x78146ce49 [64] + 150016
00000800:00000200:9.0:1773851886.650477:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851886.650479:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851886.650480:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11602@kfi7: PUT: OK
00000100:00000001:9.0:1773851886.650481:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851886.650481:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851886.650482:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f55020b.
00000100:00000040:9.0:1773851886.650483:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000002f55020b x1859318624594752 msgsize 224
00000100:00100000:9.0:1773851886.650485:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-11667@kfi7 (source: 12345-11602@kfi7)
00000100:00000001:9.0:1773851886.650486:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851886.650487:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000631d162e nid 11602@kfi7 refs 2
00000800:00000200:9.0:1773851886.650488:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851886.650489:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851886.650490:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851886.650491:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851886.650492:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851886.650493:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851886.650495:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318624594752
00000020:00000001:11.0:1773851886.650496:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851886.650497:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918b2
00000020:00000001:11.0:1773851886.650498:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851886.650500:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f2929013 refcount=6
00000020:00000001:11.0:1773851886.650501:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241984000 : -107152467567616 : ffff9e8b9f3bdc00)
00000020:00000001:11.0:1773851886.650503:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241984000 : -107152467567616 : ffff9e8b9f3bdc00)
00000100:00000001:11.0:1773851886.650504:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851886.650505:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851886.650507:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e17f60bc.
00000020:00000010:11.0:1773851886.650508:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851886.650509:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851886.650512:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851886.650512:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851886.650513:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851886.650515:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851886.650516:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851886.650517:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.650518:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851886.650521:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851886.650522:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851886.650522:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851886.650523:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851886.650524:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11667@kfi7, seq: 2130831
00000100:00000040:11.0:1773851886.650525:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f2929013 : new rpc_count 1
00000100:00000001:11.0:1773851886.650526:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114804629632 : -106958904921984 : ffff9eb8b0777080)
00000100:00000001:8.0:1773851886.650526:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851886.650527:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851886.650528:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f55020b x1859318624594752/t0(0) o400->4710d746-4187-4cc4-8ff9-1d6512515efe@11667@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1222-0'
00000100:00000001:11.0:1773851886.650533:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851886.650534:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851886.650536:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f55020b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:4710d746-4187-4cc4-8ff9-1d6512515efe+6:39778:x1859318624594752:12345-11667@kfi7:400:default-tuolumne1222-0
00000100:00000200:11.0:1773851886.650538:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318624594752
00000020:00000001:11.0:1773851886.650539:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851886.650540:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851886.650541:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.650542:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851886.650543:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851886.650545:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851886.650546:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318624594752, found 0 last_xid 1859318624594751
00000020:00000001:11.0:1773851886.650547:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851886.650548:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851886.650549:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851886.650550:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.650551:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851886.650552:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851886.650553:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851886.650556:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000853c4d02.
02000000:00000001:11.0:1773851886.650557:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.650558:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.650559:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851886.650560:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256977049, transno 0, xid 1859318624594752
00010000:00000001:11.0:1773851886.650561:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851886.650563:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f55020b x1859318624594752/t0(0) o400->4710d746-4187-4cc4-8ff9-1d6512515efe@11667@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1222-0'
00010000:00000001:11.0:1773851886.650567:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851886.650569:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851886.650570:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=119 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851886.650572:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851886.650573:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009c186ed5 refcount 3 to 11667@kfi7
00000100:00000001:11.0:1773851886.650574:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740763232 : -107153968788384 : ffff9e8b45c10c60)
02000000:00000001:11.0:1773851886.650576:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851886.650576:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.650577:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851886.650579:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11602@kfi7
00000400:00000010:11.0:1773851886.650580:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000100:00000200:11.0:1773851886.650581:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318624594752, offset 224
00000400:00000200:11.0:1773851886.650584:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11602@kfi7
00000400:00000200:11.0:1773851886.650585:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11602@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.650587:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000631d162e nid 11602@kfi7 refs 1
00000400:00000200:11.0:1773851886.650588:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000631d162e nid 11602@kfi7 refs 2
00000400:00000200:11.0:1773851886.650590:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000631d162e nid 11602@kfi7 refs 3
00000400:00000200:11.0:1773851886.650592:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11602@kfi7 local destination
00000400:00000200:11.0:1773851886.650595:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769862:8769862:1024:4294967295] 11602@kfi7 LPNI seq info [5507800:5507800:16:4294967295]
00000400:00000200:11.0:1773851886.650597:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000631d162e nid 11602@kfi7 refs 2
00000400:00000200:11.0:1773851886.650598:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11602@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.650602:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11602@kfi7(11602@kfi7:11602@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851886.650604:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000631d162e nid 11602@kfi7 refs 3
00000800:00000200:11.0:1773851886.650606:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851886.650608:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851886.650612:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851886.650616:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xb71 Using peer 11602@kfi7(0xb71)
00000800:00000200:11.0:1773851886.650621:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0xb71: rc=0
00000800:00000200:11.0:1773851886.650624:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xb71 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851886.650628:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851886.650629:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009c186ed5 refcount 2 to 11667@kfi7
00010000:00000001:11.0:1773851886.650630:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851886.650631:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.650632:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851886.650634:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f55020b x1859318624594752/t0(0) o400->4710d746-4187-4cc4-8ff9-1d6512515efe@11667@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1222-0'
00000800:00000200:9.0:1773851886.650636:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xb71 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851886.650638:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851886.650639:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11602@kfi7: PUT: OK
00000100:00100000:11.0:1773851886.650640:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f55020b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:4710d746-4187-4cc4-8ff9-1d6512515efe+6:39778:x1859318624594752:12345-11667@kfi7:400:default-tuolumne1222-0 Request processed in 105us (155us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851886.650640:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000400:00000010:9.0:1773851886.650641:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000100:00000001:9.0:1773851886.650641:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851886.650642:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:11.0:1773851886.650643:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11667@kfi7, seq: 2130831
00000400:00000200:9.0:1773851886.650643:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000631d162e nid 11602@kfi7 refs 2
00000800:00000200:9.0:1773851886.650644:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 11602@kfi7(0000000056d0a39c):0x0 lsk 2930 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xb71 Transaction freed
00000100:00000040:11.0:1773851886.650645:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f2929013 : new rpc_count 0
00000100:00000001:11.0:1773851886.650646:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851886.650647:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851886.650648:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851886.650649:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000020:00000010:11.0:1773851886.650651:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e17f60bc.
00000020:00000040:11.0:1773851886.650652:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000f2929013 : new refcount 5
00000100:00000001:11.0:1773851886.650654:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851886.680706:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851886.680707:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851886.680710:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851886.680713:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851886.680716:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17969@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.680718:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17969@kfi7 : PUT - for me
00000400:00000200:9.0:1773851886.680719:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17969@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.680720:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edc78cad nid 17969@kfi7 refs 1
00000400:00000200:9.0:1773851886.680722:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17969@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.680723:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edc78cad nid 17969@kfi7 refs 2
00000400:00000200:9.0:1773851886.680724:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000edc78cad nid 17969@kfi7 refs 3
00000400:00000200:9.0:1773851886.680731:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18160@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.680732:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18160@kfi7 of length 224 into portal 12 MB=0x69b6239679c00
00000400:00000200:9.0:1773851886.680734:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18160@kfi7 of length 224/224 into md 0x78146ce49 [64] + 150240
00000800:00000200:9.0:1773851886.680737:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851886.680739:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851886.680741:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17969@kfi7: PUT: OK
00000100:00000001:9.0:1773851886.680742:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851886.680742:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851886.680744:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000ae94b46.
00000100:00000040:9.0:1773851886.680745:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000000ae94b46 x1859696032455680 msgsize 224
00000100:00100000:9.0:1773851886.680747:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18160@kfi7 (source: 12345-17969@kfi7)
00000100:00000001:9.0:1773851886.680749:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851886.680750:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000edc78cad nid 17969@kfi7 refs 2
00000100:00000001:11.0:1773851886.680751:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851886.680752:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851886.680752:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851886.680752:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2054@kfi7:2 <- 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851886.680753:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851886.680754:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851886.680755:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859696032455680
00000020:00000001:11.0:1773851886.680756:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851886.680756:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f081566e2f21
00000020:00000001:11.0:1773851886.680758:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851886.680761:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000042a69784 refcount=5
00000020:00000001:11.0:1773851886.680762:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130169078784 : -106943540472832 : ffff9ebc44425400)
00000020:00000001:11.0:1773851886.680763:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130169078784 : -106943540472832 : ffff9ebc44425400)
00000100:00000001:11.0:1773851886.680765:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851886.680767:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851886.680768:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e17f60bc.
00000020:00000010:11.0:1773851886.680769:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851886.680770:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851886.680772:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851886.680772:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851886.680773:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851886.680774:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851886.680775:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851886.680775:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.680777:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851886.680778:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851886.680779:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851886.680779:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851886.680780:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18160@kfi7, seq: 2130832
00000100:00000001:8.0:1773851886.680780:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851886.680781:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000042a69784 : new rpc_count 1
00000100:00000001:8.0:1773851886.680781:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.680782:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856903808 : -106914852647808 : ffff9ec2f22fcc80)
00000100:00000001:8.0:1773851886.680782:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851886.680784:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000ae94b46 x1859696032455680/t0(0) o400->018cee44-0f42-4464-b203-ecf502474cbd@18160@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1613-0'
00000100:00000001:11.0:1773851886.680789:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851886.680789:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851886.680790:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ae94b46 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:018cee44-0f42-4464-b203-ecf502474cbd+5:39465:x1859696032455680:12345-18160@kfi7:400:default-tuolumne1613-0
00000100:00000200:11.0:1773851886.680792:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859696032455680
00000020:00000001:11.0:1773851886.680793:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851886.680794:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851886.680795:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.680795:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851886.680796:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851886.680797:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851886.680798:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859696032455680, found 0 last_xid 1859696032455679
00000020:00000001:11.0:1773851886.680799:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851886.680800:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851886.680801:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851886.680802:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.680803:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851886.680804:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851886.680804:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851886.680806:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f08fd302.
02000000:00000001:11.0:1773851886.680807:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.680808:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.680809:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851886.680810:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183226442280, transno 0, xid 1859696032455680
00010000:00000001:11.0:1773851886.680811:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851886.680812:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000ae94b46 x1859696032455680/t0(0) o400->018cee44-0f42-4464-b203-ecf502474cbd@18160@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1613-0'
00010000:00000001:11.0:1773851886.680816:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851886.680817:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851886.680817:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=119 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851886.680819:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851886.680820:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b2fa9716 refcount 3 to 18160@kfi7
00000100:00000001:11.0:1773851886.680821:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579488 : -107154806972128 : ffff9e8b13cb6120)
02000000:00000001:11.0:1773851886.680822:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851886.680823:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851886.680824:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851886.680825:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17969@kfi7
00000400:00000010:11.0:1773851886.680825:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008f5867f4.
00000100:00000200:11.0:1773851886.680827:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859696032455680, offset 224
00000400:00000200:11.0:1773851886.680829:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17969@kfi7
00000400:00000200:11.0:1773851886.680830:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17969@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.680831:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000edc78cad nid 17969@kfi7 refs 1
00000400:00000200:11.0:1773851886.680833:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000edc78cad nid 17969@kfi7 refs 2
00000400:00000200:11.0:1773851886.680834:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000edc78cad nid 17969@kfi7 refs 3
00000400:00000200:11.0:1773851886.680836:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17969@kfi7 local destination
00000400:00000200:11.0:1773851886.680838:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769863:8769863:1024:4294967295] 17969@kfi7 LPNI seq info [1668667:1668667:16:4294967295]
00000400:00000200:11.0:1773851886.680840:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000edc78cad nid 17969@kfi7 refs 2
00000400:00000200:11.0:1773851886.680842:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17969@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.680845:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17969@kfi7(17969@kfi7:17969@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851886.680847:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000edc78cad nid 17969@kfi7 refs 3
00000800:00000200:11.0:1773851886.680849:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851886.680851:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851886.680854:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851886.680858:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000323 Using peer 17969@kfi7(0x100000000000323)
00000800:00000200:11.0:1773851886.680862:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x100000000000323: rc=0
00000800:00000200:11.0:1773851886.680864:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000323 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851886.680867:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851886.680868:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b2fa9716 refcount 2 to 18160@kfi7
00010000:00000001:11.0:1773851886.680869:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851886.680870:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851886.680871:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851886.680872:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000ae94b46 x1859696032455680/t0(0) o400->018cee44-0f42-4464-b203-ecf502474cbd@18160@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1613-0'
00000100:00100000:11.0:1773851886.680877:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ae94b46 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:018cee44-0f42-4464-b203-ecf502474cbd+5:39465:x1859696032455680:12345-18160@kfi7:400:default-tuolumne1613-0 Request processed in 87us (131us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851886.680880:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000323 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851886.680881:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18160@kfi7, seq: 2130832
00000100:00000040:11.0:1773851886.680882:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000042a69784 : new rpc_count 0
00000100:00000001:11.0:1773851886.680883:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851886.680883:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851886.680884:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851886.680885:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000400:00000200:9.0:1773851886.680885:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17969@kfi7: PUT: OK
00000020:00000010:11.0:1773851886.680886:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000400:00000200:9.0:1773851886.680886:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008f5867f4
00000020:00000010:11.0:1773851886.680887:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e17f60bc.
00000020:00000040:11.0:1773851886.680888:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000042a69784 : new refcount 4
00000400:00000010:9.0:1773851886.680888:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008f5867f4.
00000100:00000001:11.0:1773851886.680889:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851886.680889:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851886.680889:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851886.680891:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000edc78cad nid 17969@kfi7 refs 2
00000800:00000200:9.0:1773851886.680893:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17969@kfi7(000000001feafd86):0x0 lsk 804 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000323 Transaction freed
00010000:00000001:2.0:1773851886.729730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729732:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851886.729732:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851886.729733:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729734:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851886.729734:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729735:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729735:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729736:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851886.729737:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851886.729737:0:2506505:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851886.729738:0:2506505:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851886.729738:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729739:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851886.729739:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729740:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729740:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729741:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851886.729741:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851886.729742:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729742:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851886.729743:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729743:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729744:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851886.729749:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851886.729749:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851886.729750:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729750:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851886.729751:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729751:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851886.729752:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851886.729756:0:61289:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:25.0:1773851886.729757:0:61289:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:25.0:1773851886.729757:0:61289:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:3.0:1773851886.779946:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851886.779947:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851886.779948:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851886.779950:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851886.779952:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19123@kfi7 to cpt 0
00000400:00000200:3.0:1773851886.779953:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19123@kfi7 : PUT - for me
00000400:00000200:3.0:1773851886.779954:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19123@kfi7 to cpt 0
00000400:00000200:3.0:1773851886.779955:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bc336e2 nid 19123@kfi7 refs 1
00000400:00000200:3.0:1773851886.779956:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19123@kfi7 to cpt 0
00000400:00000200:3.0:1773851886.779956:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bc336e2 nid 19123@kfi7 refs 2
00000400:00000200:3.0:1773851886.779957:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009bc336e2 nid 19123@kfi7 refs 3
00000400:00000200:3.0:1773851886.779958:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19059@kfi7 to cpt 5
00000400:00000200:3.0:1773851886.779959:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19059@kfi7 of length 224 into portal 12 MB=0x699e14be9bc00
00000400:00000200:3.0:1773851886.779960:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19059@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 43872
00000800:00000200:3.0:1773851886.779962:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851886.779964:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851886.779965:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19123@kfi7: PUT: OK
00000100:00000001:3.0:1773851886.779966:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851886.779966:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851886.779967:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000090b676d7.
00000100:00000040:3.0:1773851886.779968:0:2506738:0:(events.c:358:request_in_callback()) incoming req@0000000090b676d7 x1858042780564480 msgsize 224
00000100:00100000:3.0:1773851886.779969:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-19059@kfi7 (source: 12345-19123@kfi7)
00000100:00000001:3.0:1773851886.779970:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851886.779971:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bc336e2 nid 19123@kfi7 refs 2
00000800:00000200:3.0:1773851886.779972:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851886.779972:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851886.779973:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851886.779973:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851886.779974:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851886.779975:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851886.779976:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042780564480
00000020:00000001:0.0:1773851886.779976:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851886.779977:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9246d
00000020:00000001:0.0:1773851886.779978:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851886.779979:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007ac53ef5 refcount=7
00000020:00000001:0.0:1773851886.779980:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630512640 : -107123079038976 : ffff9e9276ed3800)
00000020:00000001:0.0:1773851886.779980:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630512640 : -107123079038976 : ffff9e9276ed3800)
00000100:00000001:0.0:1773851886.779981:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851886.779982:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851886.779983:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033ae8c39.
00000020:00000010:0.0:1773851886.779984:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851886.779985:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851886.779986:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851886.779986:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851886.779987:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851886.779988:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851886.779989:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851886.779989:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851886.779990:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851886.779992:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851886.779992:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851886.779992:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851886.779992:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851886.779993:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19059@kfi7, seq: 1997606
00000100:00000001:1.0:1773851886.779994:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851886.779994:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007ac53ef5 : new rpc_count 1
00000100:00000001:1.0:1773851886.779995:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851886.779995:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288712832 : -106964420838784 : ffff9eb767b13a80)
00000100:00000040:0.0:1773851886.779996:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000090b676d7 x1858042780564480/t0(0) o400->25453dc5-5e86-4d12-b935-b3af936c4b09@19059@kfi7:526/0 lens 224/0 e 0 to 0 dl 1773852641 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1674-0'
00000100:00000001:0.0:1773851886.779999:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851886.779999:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851886.780000:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b676d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:25453dc5-5e86-4d12-b935-b3af936c4b09+7:39646:x1858042780564480:12345-19059@kfi7:400:default-tuolumne1674-0
00000100:00000200:0.0:1773851886.780001:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042780564480
00000020:00000001:0.0:1773851886.780002:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851886.780002:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851886.780003:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851886.780004:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851886.780004:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851886.780005:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851886.780005:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042780564480, found 0 last_xid 1858042780564479
00000020:00000001:0.0:1773851886.780006:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851886.780007:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851886.780007:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851886.780008:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851886.780008:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851886.780009:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851886.780009:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851886.780010:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000966d95a6.
02000000:00000001:0.0:1773851886.780011:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851886.780012:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851886.780012:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851886.780013:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044131331, transno 0, xid 1858042780564480
00010000:00000001:0.0:1773851886.780014:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851886.780015:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000090b676d7 x1858042780564480/t0(0) o400->25453dc5-5e86-4d12-b935-b3af936c4b09@19059@kfi7:526/0 lens 224/224 e 0 to 0 dl 1773852641 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1674-0'
00010000:00000001:0.0:1773851886.780017:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851886.780018:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851886.780019:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=119 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851886.780020:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851886.780021:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004d5de210 refcount 3 to 19059@kfi7
00000100:00000001:0.0:1773851886.780022:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956270528 : -107146753281088 : ffff9e8cf3d4f3c0)
02000000:00000001:0.0:1773851886.780022:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851886.780023:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851886.780023:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851886.780024:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19123@kfi7
00000400:00000010:0.0:1773851886.780025:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013214890.
00000100:00000200:0.0:1773851886.780026:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042780564480, offset 224
00000400:00000200:0.0:1773851886.780027:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19123@kfi7
00000400:00000200:0.0:1773851886.780028:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19123@kfi7 to cpt 0
00000400:00000200:0.0:1773851886.780029:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bc336e2 nid 19123@kfi7 refs 1
00000400:00000200:0.0:1773851886.780030:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009bc336e2 nid 19123@kfi7 refs 2
00000400:00000200:0.0:1773851886.780031:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009bc336e2 nid 19123@kfi7 refs 3
00000400:00000200:0.0:1773851886.780032:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19123@kfi7 local destination
00000400:00000200:0.0:1773851886.780034:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769864:8769864:1024:4294967295] 19123@kfi7 LPNI seq info [10568958:10568958:16:4294967295]
00000400:00000200:0.0:1773851886.780035:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bc336e2 nid 19123@kfi7 refs 2
00000400:00000200:0.0:1773851886.780035:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19123@kfi7 to cpt 0
00000400:00000200:0.0:1773851886.780038:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19123@kfi7(19123@kfi7:19123@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851886.780039:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009bc336e2 nid 19123@kfi7 refs 3
00000800:00000200:0.0:1773851886.780040:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851886.780041:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851886.780043:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851886.780045:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000730 Using peer 19123@kfi7(0x100000000000730)
00000800:00000200:0.0:1773851886.780048:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x100000000000730: rc=0
00000800:00000200:0.0:1773851886.780050:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000730 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851886.780051:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851886.780052:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004d5de210 refcount 2 to 19059@kfi7
00010000:00000001:0.0:1773851886.780053:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851886.780053:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851886.780054:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851886.780055:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000090b676d7 x1858042780564480/t0(0) o400->25453dc5-5e86-4d12-b935-b3af936c4b09@19059@kfi7:526/0 lens 224/224 e 0 to 0 dl 1773852641 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1674-0'
00000100:00100000:0.0:1773851886.780059:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b676d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:25453dc5-5e86-4d12-b935-b3af936c4b09+7:39646:x1858042780564480:12345-19059@kfi7:400:default-tuolumne1674-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851886.780061:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19059@kfi7, seq: 1997606
00000100:00000040:0.0:1773851886.780062:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007ac53ef5 : new rpc_count 0
00000100:00000001:0.0:1773851886.780063:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851886.780063:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851886.780064:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851886.780064:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851886.780065:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033ae8c39.
00000020:00000040:0.0:1773851886.780066:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000007ac53ef5 : new refcount 6
00000100:00000001:0.0:1773851886.780066:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851886.780072:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000730 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851886.780076:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851886.780077:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19123@kfi7: PUT: OK
00000400:00000200:1.0:1773851886.780078:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013214890
00000400:00000010:1.0:1773851886.780079:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013214890.
00000100:00000001:1.0:1773851886.780079:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851886.780080:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851886.780080:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bc336e2 nid 19123@kfi7 refs 2
00000800:00000200:1.0:1773851886.780082:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 19123@kfi7(000000004675d582):0x0 lsk 1841 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000730 Transaction freed
00000800:00000200:17.0:1773851886.806209:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851886.806210:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851886.806211:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851886.806214:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851886.806216:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24690@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.806218:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24690@kfi7 : PUT - for me
00000400:00000200:17.0:1773851886.806218:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24690@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.806219:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006eb2b344 nid 24690@kfi7 refs 1
00000400:00000200:17.0:1773851886.806220:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24690@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.806221:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006eb2b344 nid 24690@kfi7 refs 2
00000400:00000200:17.0:1773851886.806222:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006eb2b344 nid 24690@kfi7 refs 3
00000400:00000200:17.0:1773851886.806223:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24755@kfi7 to cpt 2
00000400:00000200:17.0:1773851886.806224:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24755@kfi7 of length 224 into portal 12 MB=0x69b475c4f7a00
00000400:00000200:17.0:1773851886.806225:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24755@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 36912
00000800:00000200:17.0:1773851886.806227:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851886.806228:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851886.806230:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24690@kfi7: PUT: OK
00000100:00000001:17.0:1773851886.806231:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851886.806231:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851886.806232:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bed042ed.
00000100:00000040:17.0:1773851886.806233:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bed042ed x1859580653959680 msgsize 224
00000100:00100000:17.0:1773851886.806235:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-24755@kfi7 (source: 12345-24690@kfi7)
00000100:00000001:17.0:1773851886.806237:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851886.806237:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006eb2b344 nid 24690@kfi7 refs 2
00000800:00000200:17.0:1773851886.806239:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851886.806241:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851886.806242:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851886.806242:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851886.806243:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851886.806244:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851886.806245:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580653959680
00000020:00000001:17.0:1773851886.806247:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851886.806247:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddd034ac3
00000020:00000001:17.0:1773851886.806248:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851886.806251:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001809f309 refcount=5
00000020:00000001:17.0:1773851886.806252:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636965086632960 : -107108622918656 : ffff9e95d4941c00)
00000020:00000001:17.0:1773851886.806253:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636965086632960 : -107108622918656 : ffff9e95d4941c00)
00000100:00000001:17.0:1773851886.806254:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851886.806255:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851886.806255:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851886.806256:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851886.806257:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851886.806258:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851886.806259:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851886.806259:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851886.806260:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851886.806261:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851886.806261:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851886.806262:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851886.806263:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851886.806264:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851886.806264:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851886.806264:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851886.806265:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24755@kfi7, seq: 2156397
00000100:00000040:17.0:1773851886.806266:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001809f309 : new rpc_count 1
00000100:00000001:17.0:1773851886.806266:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102214272 : -107041607337344 : ffff9ea56f04ba80)
00000100:00000001:16.0:1773851886.806266:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851886.806267:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851886.806268:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bed042ed x1859580653959680/t0(0) o400->dd652694-84f9-4d5b-bb3b-769e10df6707@24755@kfi7:107/0 lens 224/0 e 0 to 0 dl 1773852222 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2026-0'
00000100:00000001:17.0:1773851886.806270:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851886.806270:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851886.806271:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bed042ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:dd652694-84f9-4d5b-bb3b-769e10df6707+5:39817:x1859580653959680:12345-24755@kfi7:400:default-tuolumne2026-0
00000100:00000200:17.0:1773851886.806273:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580653959680
00000020:00000001:17.0:1773851886.806273:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851886.806274:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851886.806274:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851886.806276:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851886.806276:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851886.806277:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851886.806278:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580653959680, found 0 last_xid 1859580653959679
00000020:00000001:17.0:1773851886.806279:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851886.806279:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851886.806280:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851886.806280:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851886.806281:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851886.806282:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851886.806282:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851886.806283:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000017c5db81.
02000000:00000001:17.0:1773851886.806283:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851886.806284:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851886.806285:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851886.806285:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253097821, transno 0, xid 1859580653959680
00010000:00000001:17.0:1773851886.806286:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851886.806287:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bed042ed x1859580653959680/t0(0) o400->dd652694-84f9-4d5b-bb3b-769e10df6707@24755@kfi7:107/0 lens 224/224 e 0 to 0 dl 1773852222 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2026-0'
00010000:00000001:17.0:1773851886.806289:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851886.806290:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851886.806291:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=119 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851886.806292:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851886.806292:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fd58039e refcount 3 to 24755@kfi7
00000100:00000001:17.0:1773851886.806293:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810487616 : -107154899064000 : ffff9e8b0e4e2b40)
02000000:00000001:17.0:1773851886.806294:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851886.806294:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851886.806295:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851886.806296:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24690@kfi7
00000400:00000010:17.0:1773851886.806297:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004cb7cc9f.
00000100:00000200:17.0:1773851886.806297:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580653959680, offset 224
00000400:00000200:17.0:1773851886.806299:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24690@kfi7
00000400:00000200:17.0:1773851886.806300:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24690@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.806300:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006eb2b344 nid 24690@kfi7 refs 1
00000400:00000200:17.0:1773851886.806301:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006eb2b344 nid 24690@kfi7 refs 2
00000400:00000200:17.0:1773851886.806302:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006eb2b344 nid 24690@kfi7 refs 3
00000400:00000200:17.0:1773851886.806303:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24690@kfi7 local destination
00000400:00000200:17.0:1773851886.806305:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769865:8769865:1024:4294967295] 24690@kfi7 LPNI seq info [12324233:12324233:16:4294967295]
00000400:00000200:17.0:1773851886.806307:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006eb2b344 nid 24690@kfi7 refs 2
00000400:00000200:17.0:1773851886.806307:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24690@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.806309:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24690@kfi7(24690@kfi7:24690@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851886.806310:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006eb2b344 nid 24690@kfi7 refs 3
00000800:00000200:17.0:1773851886.806311:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851886.806312:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851886.806314:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851886.806316:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bb0 Using peer 24690@kfi7(0x100000000000bb0)
00000800:00000200:17.0:1773851886.806319:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x100000000000bb0: rc=0
00000800:00000200:17.0:1773851886.806321:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bb0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851886.806323:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851886.806323:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fd58039e refcount 2 to 24755@kfi7
00010000:00000001:17.0:1773851886.806324:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851886.806325:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851886.806325:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851886.806326:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bed042ed x1859580653959680/t0(0) o400->dd652694-84f9-4d5b-bb3b-769e10df6707@24755@kfi7:107/0 lens 224/224 e 0 to 0 dl 1773852222 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2026-0'
00000100:00100000:17.0:1773851886.806329:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bed042ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:dd652694-84f9-4d5b-bb3b-769e10df6707+5:39817:x1859580653959680:12345-24755@kfi7:400:default-tuolumne2026-0 Request processed in 58us (95us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851886.806331:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24755@kfi7, seq: 2156397
00000100:00000040:17.0:1773851886.806332:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001809f309 : new rpc_count 0
00000100:00000001:17.0:1773851886.806333:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851886.806333:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:18.0:1773851886.806334:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bb0 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851886.806334:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851886.806335:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000020:00000010:17.0:1773851886.806336:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000400:00000200:18.0:1773851886.806337:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851886.806337:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000001809f309 : new refcount 4
00000100:00000001:17.0:1773851886.806337:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851886.806339:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24690@kfi7: PUT: OK
00000400:00000200:18.0:1773851886.806340:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004cb7cc9f
00000400:00000010:18.0:1773851886.806341:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004cb7cc9f.
00000100:00000001:18.0:1773851886.806342:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851886.806342:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851886.806343:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006eb2b344 nid 24690@kfi7 refs 2
00000800:00000200:18.0:1773851886.806345:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2054@kfi7:4 -> 24690@kfi7(00000000604bd2ef):0x0 lsk 2993 rsk 10 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000bb0 Transaction freed
00000800:00000200:11.0:1773851886.819001:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851886.819001:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851886.819002:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:11.0:1773851886.819003:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851886.819004:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851886.819004:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:11.0:1773851886.819006:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851886.819006:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17440@kfi7(00000000a3eeae06):0xdce version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851886.819008:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce Using peer 17440@kfi7(0xdce)
00000400:00000200:11.0:1773851886.819009:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17440@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.819010:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17440@kfi7 : PUT - for me
00000400:00000200:9.0:1773851886.819010:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17440@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.819011:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17440@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.819012:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091179ab9 nid 17440@kfi7 refs 1
00000800:00000200:9.0:1773851886.819012:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000438708cd: Posted send of 38 bytes to peer 0xdce: rc=0
00000400:00000200:11.0:1773851886.819014:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17440@kfi7 to cpt 2
00000400:00000200:11.0:1773851886.819014:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091179ab9 nid 17440@kfi7 refs 2
00000800:00000200:9.0:1773851886.819014:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851886.819015:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000091179ab9 nid 17440@kfi7 refs 3
00000400:00000200:11.0:1773851886.819016:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17633@kfi7 to cpt 7
00000400:00000200:11.0:1773851886.819017:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17633@kfi7 of length 456 into portal 12 MB=0x69b4b931fdf40
00000400:00000200:11.0:1773851886.819019:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17633@kfi7 of length 456/456 into md 0x78146ce49 [64] + 150464
00000800:00000200:11.0:1773851886.819021:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851886.819022:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851886.819023:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17440@kfi7: PUT: OK
00000100:00000001:11.0:1773851886.819025:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851886.819025:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851886.819025:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce TN_EVENT_TX_OK event status 0
00000100:00000010:11.0:1773851886.819026:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000cac33a6.
00000100:00000040:11.0:1773851886.819027:0:2510946:0:(events.c:358:request_in_callback()) incoming req@000000000cac33a6 x1859598753455936 msgsize 456
00000100:00100000:11.0:1773851886.819028:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-17633@kfi7 (source: 12345-17440@kfi7)
00000800:00000200:9.0:1773851886.819028:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce Transaction freed
00000100:00000001:11.0:1773851886.819030:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:11.0:1773851886.819031:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000091179ab9 nid 17440@kfi7 refs 2
00000800:00000200:11.0:1773851886.819032:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2069@kfi7:2 <- 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851886.819033:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851886.819034:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851886.819034:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851886.819035:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851886.819036:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851886.819037:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598753455936
00000020:00000001:9.0:1773851886.819038:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851886.819038:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8099b
00000020:00000001:9.0:1773851886.819039:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851886.819044:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fede496f refcount=8
00000020:00000001:9.0:1773851886.819045:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117170323456 : -106956539228160 : ffff9eb93d791000)
00000020:00000001:9.0:1773851886.819046:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117170323456 : -106956539228160 : ffff9eb93d791000)
00000100:00000001:9.0:1773851886.819050:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851886.819051:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851886.819052:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ede84d6e.
00000020:00000010:9.0:1773851886.819053:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c8fc5a75.
00000020:00000010:9.0:1773851886.819054:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008e3d6b9d.
00000100:00000001:9.0:1773851886.819055:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851886.819055:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851886.819056:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851886.819057:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851886.819058:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851886.819060:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851886.819060:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851886.819060:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851886.819060:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851886.819061:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17633@kfi7, seq: 406391011
00000100:00000040:9.0:1773851886.819062:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fede496f : new rpc_count 1
00000100:00000001:9.0:1773851886.819063:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136446589184 : -106937262962432 : ffff9ebdba6d8900)
00000100:00000001:8.0:1773851886.819063:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851886.819063:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851886.819064:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000cac33a6 x1859598753455936/t0(0) o17->29856548-4271-4889-a205-e4e0845be9f2@17633@kfi7:674/0 lens 456/0 e 0 to 0 dl 1773852034 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1583-0'
00000100:00000001:9.0:1773851886.819067:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851886.819068:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851886.819069:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000cac33a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:29856548-4271-4889-a205-e4e0845be9f2+8:39570:x1859598753455936:12345-17633@kfi7:17:default-tuolumne1583-0
00000100:00000200:9.0:1773851886.819071:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598753455936
00000020:00000001:9.0:1773851886.819071:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851886.819072:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851886.819073:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851886.819074:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851886.819074:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:9.0:1773851886.819075:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851886.819076:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598753455936, found 0 last_xid 1859598753455935
00000020:00000001:9.0:1773851886.819077:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851886.819078:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851886.819078:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851886.819079:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851886.819081:0:60898:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:9.0:1773851886.819082:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851886.819082:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851886.819083:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000003878eca.
02000000:00000001:9.0:1773851886.819084:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851886.819084:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851886.819085:0:60898:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:9.0:1773851886.819086:0:60898:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:9.0:1773851886.819086:0:60898:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:9.0:1773851886.819088:0:60898:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851886.819089:0:60898:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:9.0:1773851886.819090:0:60898:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 29856548-4271-4889-a205-e4e0845be9f2/00000000fede496f free: 126633370845184 avail: 126633368748032
00000020:00000001:9.0:1773851886.819091:0:60898:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:9.0:1773851886.819091:0:60898:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 29856548-4271-4889-a205-e4e0845be9f2/00000000fede496f avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:9.0:1773851886.819093:0:60898:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:9.0:1773851886.819094:0:60898:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:9.0:1773851886.819094:0:60898:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 29856548-4271-4889-a205-e4e0845be9f2/00000000fede496f reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:9.0:1773851886.819095:0:60898:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:9.0:1773851886.819096:0:60898:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:9.0:1773851886.819096:0:60898:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851886.819097:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182337367090, transno 0, xid 1859598753455936
00010000:00000001:9.0:1773851886.819098:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851886.819099:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000cac33a6 x1859598753455936/t0(0) o17->29856548-4271-4889-a205-e4e0845be9f2@17633@kfi7:674/0 lens 456/432 e 0 to 0 dl 1773852034 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1583-0'
00010000:00000001:9.0:1773851886.819101:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851886.819102:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851886.819103:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=119 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851886.819105:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851886.819105:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000050513968 refcount 3 to 17633@kfi7
00000100:00000001:9.0:1773851886.819106:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066048 : -107155994485568 : ffff9e8acd035cc0)
02000000:00000001:9.0:1773851886.819107:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851886.819108:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851886.819108:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851886.819110:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17440@kfi7
00000400:00000010:9.0:1773851886.819110:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027709c97.
00000100:00000200:9.0:1773851886.819111:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598753455936, offset 224
00000400:00000200:9.0:1773851886.819113:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17440@kfi7
00000400:00000200:9.0:1773851886.819114:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17440@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.819115:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091179ab9 nid 17440@kfi7 refs 1
00000400:00000200:9.0:1773851886.819116:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000091179ab9 nid 17440@kfi7 refs 2
00000400:00000200:9.0:1773851886.819117:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000091179ab9 nid 17440@kfi7 refs 3
00000400:00000200:9.0:1773851886.819118:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17440@kfi7 local destination
00000400:00000200:9.0:1773851886.819120:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769866:8769866:1024:4294967295] 17440@kfi7 LPNI seq info [12527635:12527635:16:4294967295]
00000400:00000200:9.0:1773851886.819122:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000091179ab9 nid 17440@kfi7 refs 2
00000400:00000200:9.0:1773851886.819122:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17440@kfi7 to cpt 2
00000400:00000200:9.0:1773851886.819124:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17440@kfi7(17440@kfi7:17440@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851886.819126:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000091179ab9 nid 17440@kfi7 refs 3
00000800:00000200:9.0:1773851886.819127:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851886.819129:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:9.0:1773851886.819131:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851886.819133:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce Using peer 17440@kfi7(0xdce)
00000800:00000200:9.0:1773851886.819136:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000438708cd: Posted send of 532 bytes to peer 0xdce: rc=0
00000800:00000200:9.0:1773851886.819138:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851886.819140:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851886.819141:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000050513968 refcount 2 to 17633@kfi7
00010000:00000001:9.0:1773851886.819141:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851886.819142:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851886.819143:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851886.819143:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000cac33a6 x1859598753455936/t0(0) o17->29856548-4271-4889-a205-e4e0845be9f2@17633@kfi7:674/0 lens 456/432 e 0 to 0 dl 1773852034 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1583-0'
00000100:00100000:9.0:1773851886.819149:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000cac33a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:29856548-4271-4889-a205-e4e0845be9f2+8:39570:x1859598753455936:12345-17633@kfi7:17:default-tuolumne1583-0 Request processed in 81us (122us total) trans 0 rc 0/0
00000800:00000200:11.0:1773851886.819150:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851886.819152:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:9.0:1773851886.819152:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17633@kfi7, seq: 406391011
00000400:00000200:11.0:1773851886.819153:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17440@kfi7: PUT: OK
00000100:00000040:9.0:1773851886.819153:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fede496f : new rpc_count 0
00000400:00000200:11.0:1773851886.819154:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027709c97
00000100:00000001:9.0:1773851886.819154:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851886.819154:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:11.0:1773851886.819155:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027709c97.
00000020:00000010:9.0:1773851886.819155:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c8fc5a75.
00000100:00000001:11.0:1773851886.819156:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851886.819156:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:9.0:1773851886.819156:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008e3d6b9d.
00000400:00000200:11.0:1773851886.819157:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000091179ab9 nid 17440@kfi7 refs 2
00000020:00000010:9.0:1773851886.819157:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ede84d6e.
00000800:00000200:11.0:1773851886.819158:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 17440@kfi7(00000000a3eeae06):0x0 lsk 3535 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0xdce Transaction freed
00000020:00000040:9.0:1773851886.819158:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000fede496f : new refcount 7
00000100:00000001:9.0:1773851886.819158:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851886.862887:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851886.862889:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851886.862891:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851886.862894:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851886.862897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.862899:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2074@kfi7 : PUT - for me
00000400:00000200:29.0:1773851886.862901:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.862902:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851886.862904:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.862905:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851886.862906:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851886.862908:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851886.862909:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee22380
00000400:00000200:29.0:1773851886.862912:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x77ec58b3d [256] + 21448
00000800:00000200:29.0:1773851886.862915:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851886.862918:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851886.862920:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000100:00000001:29.0:1773851886.862921:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851886.862922:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:29.0:1773851886.862923:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000060b4f873.
00000100:00000040:29.0:1773851886.862924:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000060b4f873 x1858059204961152 msgsize 224
00000100:00100000:29.0:1773851886.862927:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2074@kfi7)
00000100:00000001:29.0:1773851886.862928:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851886.862930:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:28.0:1773851886.862932:0:41218:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851886.862933:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851886.862933:0:41218:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851886.862934:0:41218:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851886.862935:0:41218:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851886.862936:0:41218:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851886.862938:0:41218:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204961152
00000020:00000001:28.0:1773851886.862939:0:41218:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851886.862939:0:41218:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:28.0:1773851886.862941:0:41218:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851886.862942:0:41218:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:28.0:1773851886.862944:0:41218:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:28.0:1773851886.862945:0:41218:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:28.0:1773851886.862947:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851886.862948:0:41218:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851886.862949:0:41218:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851886.862952:0:41218:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851886.862953:0:41218:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000040:28.0:1773851886.862955:0:41218:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:28.0:1773851886.862956:0:41218:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851886.862957:0:41218:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851886.862958:0:41218:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851886.862960:0:41218:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851886.862961:0:41218:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851886.862964:0:157090:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851886.862964:0:41218:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851886.862965:0:157090:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851886.862965:0:41218:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851886.862967:0:41218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 6571513
00000100:00000040:28.0:1773851886.862968:0:41218:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:30.0:1773851886.862969:0:157090:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851886.862970:0:157090:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851886.862970:0:41218:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262240896 : -106943447310720 : ffff9ebc49cfde80)
00000100:00000040:28.0:1773851886.862972:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000060b4f873 x1858059204961152/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:28.0:1773851886.862976:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851886.862977:0:41218:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851886.862979:0:41218:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000060b4f873 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204961152:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:28.0:1773851886.862981:0:41218:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204961152
00000020:00000001:28.0:1773851886.862982:0:41218:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851886.862983:0:41218:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851886.862984:0:41218:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851886.862985:0:41218:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851886.862986:0:41218:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:28.0:1773851886.862988:0:41218:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:28.0:1773851886.862989:0:41218:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851886.862990:0:41218:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851886.862991:0:41218:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851886.862992:0:41218:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851886.862993:0:41218:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851886.862994:0:41218:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851886.862997:0:41218:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000a1025b1d.
02000000:00000001:28.0:1773851886.862998:0:41218:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851886.862999:0:41218:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851886.863001:0:41218:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:28.0:1773851886.863002:0:41218:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:28.0:1773851886.863003:0:41218:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:28.0:1773851886.863004:0:41218:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 85721088 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:28.0:1773851886.863006:0:41218:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132253 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:28.0:1773851886.863008:0:41218:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851886.863009:0:41218:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204961152
00010000:00000001:28.0:1773851886.863011:0:41218:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851886.863012:0:41218:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000060b4f873 x1858059204961152/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:28.0:1773851886.863017:0:41218:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851886.863018:0:41218:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851886.863019:0:41218:0:(import.c:1951:at_measured()) add 1 to 00000000f04ba3b2 time=140 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851886.863021:0:41218:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851886.863022:0:41218:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:28.0:1773851886.863023:0:41218:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:28.0:1773851886.863025:0:41218:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851886.863025:0:41218:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851886.863026:0:41218:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851886.863028:0:41218:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:28.0:1773851886.863029:0:41218:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000063d86a5d.
00000100:00000200:28.0:1773851886.863031:0:41218:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204961152, offset 224
00000400:00000200:28.0:1773851886.863033:0:41218:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:28.0:1773851886.863035:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851886.863036:0:41218:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:28.0:1773851886.863038:0:41218:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851886.863040:0:41218:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851886.863042:0:41218:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851886.863045:0:41218:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769867:8769867:1024:4294967295] 2074@kfi7 LPNI seq info [23425174:23425174:16:4294967295]
00000400:00000200:28.0:1773851886.863047:0:41218:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851886.863049:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851886.863053:0:41218:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851886.863054:0:41218:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:28.0:1773851886.863058:0:41218:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851886.863060:0:41218:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:28.0:1773851886.863064:0:41218:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851886.863068:0:41218:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Using peer 2074@kfi7(0x20000000000097e)
00000800:00000200:28.0:1773851886.863073:0:41218:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004360a85a: Posted send of 468 bytes to peer 0x20000000000097e: rc=0
00000800:00000200:28.0:1773851886.863076:0:41218:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851886.863079:0:41218:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851886.863083:0:41218:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:28.0:1773851886.863084:0:41218:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851886.863085:0:41218:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851886.863086:0:41218:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851886.863087:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000060b4f873 x1858059204961152/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:613/0 lens 224/368 e 0 to 0 dl 1773851973 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:28.0:1773851886.863093:0:41218:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000060b4f873 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204961152:12345-2074@kfi7:41:default-yuba4-0 Request processed in 115us (167us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851886.863097:0:41218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 6571513
00000100:00000040:28.0:1773851886.863098:0:41218:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:28.0:1773851886.863100:0:41218:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851886.863100:0:41218:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851886.863101:0:41218:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851886.863103:0:41218:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851886.863104:0:41218:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851886.863106:0:41218:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:28.0:1773851886.863107:0:41218:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851886.863118:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851886.863120:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851886.863123:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000400:00000200:29.0:1773851886.863124:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000063d86a5d
00000400:00000010:29.0:1773851886.863125:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000063d86a5d.
00000100:00000001:29.0:1773851886.863126:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851886.863127:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851886.863128:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851886.863131:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Transaction freed
00000800:00000200:15.0:1773851886.904787:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851886.904788:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851886.904790:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851886.904792:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851886.904794:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25889@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.904796:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25889@kfi7 : PUT - for me
00000400:00000200:15.0:1773851886.904797:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25889@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.904798:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ef954c4 nid 25889@kfi7 refs 1
00000400:00000200:15.0:1773851886.904799:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25889@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.904800:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ef954c4 nid 25889@kfi7 refs 2
00000400:00000200:15.0:1773851886.904801:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ef954c4 nid 25889@kfi7 refs 3
00000400:00000200:15.0:1773851886.904802:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26080@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.904803:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26080@kfi7 of length 224 into portal 12 MB=0x699e1401b0c80
00000400:00000200:15.0:1773851886.904804:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26080@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 44912
00000800:00000200:15.0:1773851886.904807:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851886.904809:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851886.904810:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25889@kfi7: PUT: OK
00000100:00000001:15.0:1773851886.904811:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851886.904812:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851886.904813:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f609d59.
00000100:00000040:15.0:1773851886.904814:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000008f609d59 x1858042582469760 msgsize 224
00000100:00100000:15.0:1773851886.904815:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-26080@kfi7 (source: 12345-25889@kfi7)
00000100:00000001:15.0:1773851886.904817:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851886.904818:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ef954c4 nid 25889@kfi7 refs 2
00000800:00000200:15.0:1773851886.904819:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a77a65b3: 2054@kfi7:3 <- 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851886.904822:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851886.904823:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851886.904824:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851886.904824:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851886.904825:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851886.904826:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042582469760
00000020:00000001:15.0:1773851886.904826:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851886.904827:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92809
00000020:00000001:15.0:1773851886.904827:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851886.904830:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007487e26a refcount=325
00000020:00000001:15.0:1773851886.904831:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631482368 : -107123078069248 : ffff9e9276fc0400)
00000020:00000001:15.0:1773851886.904832:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631482368 : -107123078069248 : ffff9e9276fc0400)
00000100:00000001:15.0:1773851886.904833:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851886.904834:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851886.904835:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ab8026e0.
00000020:00000010:15.0:1773851886.904836:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851886.904836:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851886.904837:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851886.904838:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851886.904838:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851886.904840:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851886.904840:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851886.904840:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.904841:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851886.904843:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851886.904843:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851886.904843:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851886.904844:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26080@kfi7, seq: 2289893
00000100:00000001:12.0:1773851886.904844:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851886.904845:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007487e26a : new rpc_count 3
00000100:00000001:15.0:1773851886.904846:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860211456 : -107049849340160 : ffff9ea383c1bf00)
00000100:00000001:12.0:1773851886.904846:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851886.904846:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851886.904847:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008f609d59 x1858042582469760/t0(0) o400->180e8271-63ad-4ad5-bdd9-af4c3ccfc7e2@26080@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2111-0'
00000100:00000001:15.0:1773851886.904850:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851886.904850:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851886.904851:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f609d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:180e8271-63ad-4ad5-bdd9-af4c3ccfc7e2+325:39722:x1858042582469760:12345-26080@kfi7:400:default-tuolumne2111-0
00000100:00000200:15.0:1773851886.904852:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042582469760
00000020:00000001:15.0:1773851886.904853:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851886.904854:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851886.904854:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.904855:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851886.904856:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851886.904857:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851886.904857:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042582469760, found 0 last_xid 1858042511103935
00000020:00000001:15.0:1773851886.904858:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851886.904859:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851886.904859:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851886.904860:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.904861:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851886.904861:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851886.904862:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851886.904863:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e1f1abcb.
02000000:00000001:15.0:1773851886.904863:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.904864:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.904865:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851886.904865:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263746243, transno 0, xid 1858042582469760
00010000:00000001:15.0:1773851886.904866:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851886.904867:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008f609d59 x1858042582469760/t0(0) o400->180e8271-63ad-4ad5-bdd9-af4c3ccfc7e2@26080@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2111-0'
00010000:00000001:15.0:1773851886.904869:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851886.904870:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851886.904871:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=119 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851886.904872:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851886.904873:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007f4ed732 refcount 3 to 26080@kfi7
00000100:00000001:15.0:1773851886.904874:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902777536 : -107154806774080 : ffff9e8b13ce66c0)
02000000:00000001:15.0:1773851886.904875:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851886.904875:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851886.904876:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851886.904877:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25889@kfi7
00000400:00000010:15.0:1773851886.904878:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f009b6f1.
00000100:00000200:15.0:1773851886.904879:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042582469760, offset 224
00000400:00000200:15.0:1773851886.904880:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25889@kfi7
00000400:00000200:15.0:1773851886.904881:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25889@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.904882:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ef954c4 nid 25889@kfi7 refs 1
00000400:00000200:15.0:1773851886.904883:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ef954c4 nid 25889@kfi7 refs 2
00000400:00000200:15.0:1773851886.904884:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ef954c4 nid 25889@kfi7 refs 3
00000400:00000200:15.0:1773851886.904885:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25889@kfi7 local destination
00000400:00000200:15.0:1773851886.904886:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769868:8769868:1024:4294967295] 25889@kfi7 LPNI seq info [953166:953166:16:4294967295]
00000400:00000200:15.0:1773851886.904888:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ef954c4 nid 25889@kfi7 refs 2
00000400:00000200:15.0:1773851886.904888:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25889@kfi7 to cpt 3
00000400:00000200:15.0:1773851886.904890:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25889@kfi7(25889@kfi7:25889@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851886.904891:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ef954c4 nid 25889@kfi7 refs 3
00000800:00000200:15.0:1773851886.904892:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851886.904894:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851886.904896:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851886.904898:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010d3 Using peer 25889@kfi7(0x1000000000010d3)
00000800:00000200:15.0:1773851886.904901:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x1000000000010d3: rc=0
00000800:00000200:15.0:1773851886.904902:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010d3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851886.904906:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851886.904907:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007f4ed732 refcount 2 to 26080@kfi7
00010000:00000001:15.0:1773851886.904908:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851886.904909:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851886.904909:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851886.904910:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f609d59 x1858042582469760/t0(0) o400->180e8271-63ad-4ad5-bdd9-af4c3ccfc7e2@26080@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2111-0'
00000100:00100000:15.0:1773851886.904913:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f609d59 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:180e8271-63ad-4ad5-bdd9-af4c3ccfc7e2+325:39722:x1858042582469760:12345-26080@kfi7:400:default-tuolumne2111-0 Request processed in 63us (98us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851886.904916:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26080@kfi7, seq: 2289893
00000100:00000040:15.0:1773851886.904916:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007487e26a : new rpc_count 2
00000100:00000001:15.0:1773851886.904917:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851886.904918:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851886.904918:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:13.0:1773851886.904918:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010d3 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851886.904919:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000020:00000010:15.0:1773851886.904920:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ab8026e0.
00000020:00000040:15.0:1773851886.904921:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000007487e26a : new refcount 324
00000100:00000001:15.0:1773851886.904921:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851886.904921:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851886.904922:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25889@kfi7: PUT: OK
00000400:00000200:13.0:1773851886.904924:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f009b6f1
00000400:00000010:13.0:1773851886.904925:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f009b6f1.
00000100:00000001:13.0:1773851886.904926:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851886.904927:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851886.904928:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ef954c4 nid 25889@kfi7 refs 2
00000800:00000200:13.0:1773851886.904931:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2054@kfi7:3 -> 25889@kfi7(00000000a1e14902):0x0 lsk 4308 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000010d3 Transaction freed
00000800:00000200:5.0:1773851886.919836:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851886.919838:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851886.919840:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851886.919848:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851886.919852:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13696@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.919854:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13696@kfi7 : PUT - for me
00000400:00000200:5.0:1773851886.919856:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13696@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.919858:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d1aba64 nid 13696@kfi7 refs 1
00000400:00000200:5.0:1773851886.919859:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13696@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.919861:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d1aba64 nid 13696@kfi7 refs 2
00000400:00000200:5.0:1773851886.919862:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003d1aba64 nid 13696@kfi7 refs 3
00000400:00000200:5.0:1773851886.919864:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13696@kfi7 to cpt 1
00000400:00000200:5.0:1773851886.919866:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13696@kfi7 of length 224 into portal 12 MB=0x699e11bec5cc0
00000400:00000200:5.0:1773851886.919868:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13696@kfi7 of length 224/224 into md 0x793926dc5 [64] + 156792
00000800:00000200:5.0:1773851886.919872:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851886.919875:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851886.919877:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13696@kfi7: PUT: OK
00000100:00000001:5.0:1773851886.919879:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851886.919880:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851886.919881:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000021268423.
00000100:00000040:5.0:1773851886.919883:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000021268423 x1858041975430336 msgsize 224
00000100:00100000:5.0:1773851886.919886:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13696@kfi7 (source: 12345-13696@kfi7)
00000100:00000001:5.0:1773851886.919887:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851886.919889:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003d1aba64 nid 13696@kfi7 refs 2
00000100:00000001:4.0:1773851886.919890:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851886.919891:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851886.919892:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851886.919892:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851886.919893:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851886.919894:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851886.919896:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041975430336
00000020:00000001:4.0:1773851886.919897:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851886.919898:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91abf
00000020:00000001:4.0:1773851886.919899:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851886.919901:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000536fedfb refcount=9
00000020:00000001:4.0:1773851886.919903:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627776512 : -107123081775104 : ffff9e9276c37800)
00000020:00000001:4.0:1773851886.919904:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627776512 : -107123081775104 : ffff9e9276c37800)
00000100:00000001:4.0:1773851886.919905:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851886.919906:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851886.919907:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851886.919909:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851886.919910:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851886.919911:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851886.919912:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851886.919913:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.919914:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851886.919915:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851886.919915:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.919917:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.919919:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851886.919920:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851886.919920:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851886.919920:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851886.919921:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13696@kfi7, seq: 2001967
00000100:00000040:4.0:1773851886.919922:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000536fedfb : new rpc_count 1
00000100:00000001:7.0:1773851886.919923:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851886.919923:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.919924:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108939648 : -106938600611968 : ffff9ebd6ab29f80)
00000100:00000040:4.0:1773851886.919925:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000021268423 x1858041975430336/t0(0) o400->b6f6d463-99eb-4026-b12b-54db0e995bd9@13696@kfi7:613/0 lens 224/0 e 0 to 0 dl 1773851973 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1348-0'
00000100:00000001:4.0:1773851886.919930:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851886.919930:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851886.919932:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000021268423 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b6f6d463-99eb-4026-b12b-54db0e995bd9+9:39809:x1858041975430336:12345-13696@kfi7:400:default-tuolumne1348-0
00000100:00000200:4.0:1773851886.919934:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041975430336
00000020:00000001:4.0:1773851886.919935:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851886.919936:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851886.919937:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.919938:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851886.919939:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851886.919940:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851886.919941:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041975430336, found 0 last_xid 1858041975430335
00000020:00000001:4.0:1773851886.919943:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851886.919944:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851886.919944:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851886.919945:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.919946:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851886.919947:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851886.919948:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851886.919949:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000095e31fc9.
02000000:00000001:4.0:1773851886.919950:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.919951:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.919952:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851886.919953:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181513856714, transno 0, xid 1858041975430336
00010000:00000001:4.0:1773851886.919954:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851886.919956:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000021268423 x1858041975430336/t0(0) o400->b6f6d463-99eb-4026-b12b-54db0e995bd9@13696@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1348-0'
00010000:00000001:4.0:1773851886.919959:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851886.919960:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851886.919961:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=118 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851886.919963:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851886.919964:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ad9bddc9 refcount 3 to 13696@kfi7
00000100:00000001:4.0:1773851886.919965:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327300096 : -107155382251520 : ffff9e8af1815000)
02000000:00000001:4.0:1773851886.919966:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851886.919967:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.919968:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851886.919970:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13696@kfi7
00000400:00000010:4.0:1773851886.919971:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071e50439.
00000100:00000200:4.0:1773851886.919972:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041975430336, offset 224
00000400:00000200:4.0:1773851886.919974:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13696@kfi7
00000400:00000200:4.0:1773851886.919975:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13696@kfi7 to cpt 1
00000400:00000200:4.0:1773851886.919977:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d1aba64 nid 13696@kfi7 refs 1
00000400:00000200:4.0:1773851886.919978:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003d1aba64 nid 13696@kfi7 refs 2
00000400:00000200:4.0:1773851886.919980:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003d1aba64 nid 13696@kfi7 refs 3
00000400:00000200:4.0:1773851886.919983:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13696@kfi7 local destination
00000400:00000200:4.0:1773851886.919985:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769869:8769869:1024:4294967295] 13696@kfi7 LPNI seq info [256605:256605:16:4294967295]
00000400:00000200:4.0:1773851886.919987:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003d1aba64 nid 13696@kfi7 refs 2
00000400:00000200:4.0:1773851886.919988:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13696@kfi7 to cpt 1
00000400:00000200:4.0:1773851886.919992:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13696@kfi7(13696@kfi7:13696@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851886.919993:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003d1aba64 nid 13696@kfi7 refs 3
00000800:00000200:4.0:1773851886.919995:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851886.919997:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851886.920001:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851886.920004:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b8 Using peer 13696@kfi7(0x1000000000005b8)
00000800:00000200:4.0:1773851886.920009:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x1000000000005b8: rc=0
00000800:00000200:4.0:1773851886.920011:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851886.920014:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.920015:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ad9bddc9 refcount 2 to 13696@kfi7
00010000:00000001:4.0:1773851886.920016:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851886.920017:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851886.920020:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851886.920021:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000021268423 x1858041975430336/t0(0) o400->b6f6d463-99eb-4026-b12b-54db0e995bd9@13696@kfi7:613/0 lens 224/224 e 0 to 0 dl 1773851973 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1348-0'
00000100:00100000:4.0:1773851886.920026:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000021268423 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:b6f6d463-99eb-4026-b12b-54db0e995bd9+9:39809:x1858041975430336:12345-13696@kfi7:400:default-tuolumne1348-0 Request processed in 95us (143us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851886.920030:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13696@kfi7, seq: 2001967
00000100:00000040:4.0:1773851886.920031:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000536fedfb : new rpc_count 0
00000100:00000001:4.0:1773851886.920033:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851886.920033:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851886.920034:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851886.920035:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851886.920037:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851886.920038:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000536fedfb : new refcount 8
00000100:00000001:4.0:1773851886.920039:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851886.920048:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b8 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851886.920051:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851886.920053:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13696@kfi7: PUT: OK
00000400:00000200:5.0:1773851886.920054:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071e50439
00000400:00000010:5.0:1773851886.920054:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071e50439.
00000100:00000001:5.0:1773851886.920056:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851886.920057:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851886.920058:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003d1aba64 nid 13696@kfi7 refs 2
00000800:00000200:5.0:1773851886.920061:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 13696@kfi7(00000000d92833cf):0x0 lsk 1465 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000005b8 Transaction freed
00000004:00000001:7.0:1773851886.921730:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851886.921730:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851886.921731:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c40ba58.
00000020:00000040:7.0:1773851886.921732:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851886.921733:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851886.921733:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851886.921735:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851886.921736:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000de2ed169.
00000100:00000001:7.0:1773851886.921737:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851886.921738:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851886.921738:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851886.921739:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000004c40ba58] to pc [ptlrpcd_01_01+1]  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851886.921744:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:7.0:1773851886.921745:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000067b7447a.
00000100:00000001:5.0:1773851886.921745:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851886.921745:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851886.921745:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:7.0:1773851886.921746:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637150883086336 : -106922826465280 : ffff9ec116e90000)
00000100:00000001:5.0:1773851886.921746:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.921746:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:7.0:1773851886.921747:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:4.0:1773851886.921747:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851886.921748:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:7.0:1773851886.921748:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000004:00000010:7.0:1773851886.921749:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000cd1af22d.
00000100:00000001:4.0:1773851886.921749:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851886.921749:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:7.0:1773851886.921750:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614161375025595ns, next at 614162375024503ns, rc = 0
02000000:00000001:4.0:1773851886.921750:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:7.0:1773851886.921751:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851886.921751:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851886.921752:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851886.921752:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000004c40ba58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051936128:2099@kfi7:13:default-yuba2-0
00000004:00000001:7.0:1773851886.921753:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.921753:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851886.921754:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851886.921754:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851886.921755:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851886.921756:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f3d94c91.
02000000:00000001:4.0:1773851886.921756:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851886.921757:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:4.0:1773851886.921758:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000010:4.0:1773851886.921759:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fcac908a.
00000100:00000200:4.0:1773851886.921760:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936128, portal 4
00000100:00000001:4.0:1773851886.921760:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851886.921761:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309153536 : -106994400398080 : ffff9eb06cc57500)
00000100:00000040:4.0:1773851886.921762:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851886.921764:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851886.921765:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851886.921765:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000534d0766.
00000100:00000200:4.0:1773851886.921767:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936128, offset 0
00000400:00000200:4.0:1773851886.921768:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851886.921769:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851886.921769:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851886.921770:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851886.921772:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851886.921773:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851886.921774:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769866, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769869, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851886.921776:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851886.921777:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851886.921777:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851886.921778:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769870:8769870:1024:4294967295] 2099@kfi7 LPNI seq info [5403435:5403435:16:4294967295]
00000400:00000200:4.0:1773851886.921780:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851886.921780:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851886.921783:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851886.921784:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851886.921785:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851886.921786:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851886.921788:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851886.921790:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Using peer 2099@kfi7(0x2c1)
00000800:00000200:4.0:1773851886.921793:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x2c1: rc=0
00000800:00000200:4.0:1773851886.921794:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851886.921796:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.921796:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851886.921797:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.921798:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.921799:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.921801:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851886.921802:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851886.921802:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851886.921803:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851886.921807:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851886.921807:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851886.921808:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851886.921808:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851886.921809:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851886.921810:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000534d0766
00000400:00000010:5.0:1773851886.921811:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000534d0766.
00000100:00000001:5.0:1773851886.921811:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851886.921812:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851886.921815:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851886.921816:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851886.921819:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851886.921819:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851886.921820:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851886.921822:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Transaction freed
00000800:00000200:17.0:1773851886.921846:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851886.921847:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851886.921848:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851886.921850:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851886.921852:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.921853:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851886.921854:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.921855:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851886.921856:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.921857:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851886.921858:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851886.921859:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.921859:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5580
00000400:00000200:17.0:1773851886.921860:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851886.921862:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f1d11 [1] + 224
00000800:00000200:17.0:1773851886.921864:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851886.921865:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851886.921866:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851886.921867:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851886.921868:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851886.921871:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851886.921875:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851886.921876:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851886.921877:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851886.921877:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851886.921878:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851886.921879:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851886.921879:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851886.921880:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851886.921881:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fcac908a
00000400:00000010:4.0:1773851886.921881:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fcac908a.
00000100:00000001:4.0:1773851886.921882:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851886.921883:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851886.921885:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851886.921888:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851886.921888:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.921889:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851886.921889:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851886.921890:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851886.921890:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851886.921891:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851886.921892:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=119 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851886.921893:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=119 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851886.921894:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851886.921894:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851886.921895:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851886.921896:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.921896:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851886.921897:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851886.921897:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851886.921898:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.921899:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851886.921901:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851886.921902:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851886.921903:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851886.921903:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851886.921904:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851886.921905:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409096704 avail=351407031296 avail_mb=1372683716 hwm_mb=3131101 files=372011237 ffree=343172946 state=0: rc = 0
00000004:00000020:4.0:1773851886.921907:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409096704 free, 351407031296 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011237 files, 343172946 free files
00000004:00000001:4.0:1773851886.921908:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851886.921909:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851886.921912:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000004c40ba58 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051936128:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851886.921913:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.921914:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851886.921915:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000004c40ba58 x1859433051936128/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852039 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851886.921917:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851886.921917:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851886.921918:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f3d94c91.
02000000:00000001:4.0:1773851886.921919:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851886.921920:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851886.921920:0:41065:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851886.921921:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851886.921922:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000de2ed169.
02000000:00000001:4.0:1773851886.921922:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851886.921923:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851886.921923:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004c40ba58.
00000100:00000001:4.0:1773851886.921924:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851886.921924:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.921925:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851886.921926:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851886.921926:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851886.921927:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851886.921927:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851886.984654:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851886.984655:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851886.984657:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851886.984661:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851886.984664:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.984666:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9857@kfi7 : PUT - for me
00000400:00000200:25.0:1773851886.984667:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.984668:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 1
00000400:00000200:25.0:1773851886.984670:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:25.0:1773851886.984671:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000400:00000200:25.0:1773851886.984672:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 3
00000400:00000200:25.0:1773851886.984674:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9792@kfi7 to cpt 7
00000400:00000200:25.0:1773851886.984675:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9792@kfi7 of length 456 into portal 12 MB=0x699e1bdff33c0
00000400:00000200:25.0:1773851886.984677:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9792@kfi7 of length 456/456 into md 0x16159c9699 [64] + 30400
00000800:00000200:25.0:1773851886.984680:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851886.984683:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851886.984685:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9857@kfi7: PUT: OK
00000100:00000001:25.0:1773851886.984686:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851886.984687:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851886.984688:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bb4bad3c.
00000100:00000040:25.0:1773851886.984691:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000bb4bad3c x1858044694574016 msgsize 456
00000100:00100000:25.0:1773851886.984693:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9792@kfi7 (source: 12345-9857@kfi7)
00000100:00000001:25.0:1773851886.984695:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851886.984696:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000100:00000001:26.0:1773851886.984697:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851886.984698:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851886.984699:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851886.984699:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851886.984700:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851886.984701:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851886.984703:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044694574016
00000020:00000001:26.0:1773851886.984704:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851886.984704:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913f7
00000020:00000001:26.0:1773851886.984705:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851886.984707:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000090286c59 refcount=60
00000020:00000001:26.0:1773851886.984708:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169324544 : -107127540227072 : ffff9e916d04e400)
00000020:00000001:26.0:1773851886.984709:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169324544 : -107127540227072 : ffff9e916d04e400)
00000100:00000001:26.0:1773851886.984711:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851886.984712:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851886.984713:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd5c6346.
00000020:00000010:26.0:1773851886.984715:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851886.984716:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000001:26.0:1773851886.984718:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851886.984718:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851886.984719:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851886.984721:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851886.984722:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851886.984725:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851886.984729:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851886.984730:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851886.984732:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851886.984732:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9792@kfi7, seq: 1451911037
00000100:00000001:27.0:1773851886.984733:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851886.984733:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000090286c59 : new rpc_count 5
00000100:00000001:26.0:1773851886.984734:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252455808 : -106967457095808 : ffff9eb6b2b79f80)
00000100:00000001:27.0:1773851886.984735:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851886.984736:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bb4bad3c x1858044694574016/t0(0) o17->4a414851-4769-4450-adb9-4713c5b9a5c0@9792@kfi7:167/0 lens 456/0 e 0 to 0 dl 1773852282 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1108-0'
00000100:00000001:26.0:1773851886.984740:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851886.984742:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851886.984743:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb4bad3c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4a414851-4769-4450-adb9-4713c5b9a5c0+60:39796:x1858044694574016:12345-9792@kfi7:17:default-tuolumne1108-0
00000100:00000200:26.0:1773851886.984746:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044694574016
00000020:00000001:26.0:1773851886.984747:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851886.984748:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851886.984750:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.984751:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851886.984752:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:26.0:1773851886.984754:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851886.984755:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044694574016, found 0 last_xid 1858044693998975
00000020:00000001:26.0:1773851886.984756:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851886.984757:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851886.984758:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851886.984759:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851886.984760:0:60973:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:26.0:1773851886.984762:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851886.984763:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851886.984764:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000e7700903.
02000000:00000001:26.0:1773851886.984766:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851886.984767:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.984769:0:60973:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:26.0:1773851886.984770:0:60973:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:26.0:1773851886.984771:0:60973:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:26.0:1773851886.984774:0:60973:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.984776:0:60973:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:26.0:1773851886.984777:0:60973:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 4a414851-4769-4450-adb9-4713c5b9a5c0/0000000090286c59 free: 126633370845184 avail: 126633368748032
00000020:00000001:26.0:1773851886.984779:0:60973:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:26.0:1773851886.984780:0:60973:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 4a414851-4769-4450-adb9-4713c5b9a5c0/0000000090286c59 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:26.0:1773851886.984783:0:60973:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:26.0:1773851886.984785:0:60973:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:26.0:1773851886.984786:0:60973:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 4a414851-4769-4450-adb9-4713c5b9a5c0/0000000090286c59 reports grant 1810628607 dropped 0, local 1880358911
00000020:00000001:26.0:1773851886.984788:0:60973:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:26.0:1773851886.984790:0:60973:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:26.0:1773851886.984791:0:60973:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851886.984792:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581691, transno 0, xid 1858044694574016
00010000:00000001:26.0:1773851886.984793:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851886.984795:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bb4bad3c x1858044694574016/t0(0) o17->4a414851-4769-4450-adb9-4713c5b9a5c0@9792@kfi7:167/0 lens 456/432 e 0 to 0 dl 1773852282 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1108-0'
00010000:00000001:26.0:1773851886.984800:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851886.984801:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851886.984802:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=119 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851886.984804:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851886.984806:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6edfea0 refcount 3 to 9792@kfi7
00000100:00000001:26.0:1773851886.984807:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063648 : -107155994487968 : ffff9e8acd035360)
02000000:00000001:26.0:1773851886.984809:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851886.984810:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851886.984811:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851886.984812:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9857@kfi7
00000400:00000010:26.0:1773851886.984814:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008661a9da.
00000100:00000200:26.0:1773851886.984815:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858044694574016, offset 224
00000400:00000200:26.0:1773851886.984818:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9857@kfi7
00000400:00000200:26.0:1773851886.984819:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:26.0:1773851886.984821:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 1
00000400:00000200:26.0:1773851886.984823:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000400:00000200:26.0:1773851886.984825:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 3
00000400:00000200:26.0:1773851886.984827:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9857@kfi7 local destination
00000400:00000200:26.0:1773851886.984830:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769871:8769871:1024:4294967295] 9857@kfi7 LPNI seq info [556666:556666:16:4294967295]
00000400:00000200:26.0:1773851886.984832:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000400:00000200:26.0:1773851886.984834:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9857@kfi7 to cpt 6
00000400:00000200:26.0:1773851886.984838:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9857@kfi7(9857@kfi7:9857@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851886.984840:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 3
00000800:00000200:26.0:1773851886.984842:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851886.984844:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:26.0:1773851886.984852:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851886.984857:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1dc Using peer 9857@kfi7(0x1dc)
00000800:00000200:26.0:1773851886.984862:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001c682e34: Posted send of 532 bytes to peer 0x1dc: rc=0
00000800:00000200:26.0:1773851886.984865:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851886.984869:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851886.984870:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6edfea0 refcount 2 to 9792@kfi7
00010000:00000001:26.0:1773851886.984872:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851886.984872:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851886.984874:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851886.984875:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bb4bad3c x1858044694574016/t0(0) o17->4a414851-4769-4450-adb9-4713c5b9a5c0@9792@kfi7:167/0 lens 456/432 e 0 to 0 dl 1773852282 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1108-0'
00000800:00000200:25.0:1773851886.984880:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1dc TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851886.984881:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb4bad3c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4a414851-4769-4450-adb9-4713c5b9a5c0+60:39796:x1858044694574016:12345-9792@kfi7:17:default-tuolumne1108-0 Request processed in 140us (190us total) trans 0 rc 0/0
00000400:00000200:25.0:1773851886.984883:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851886.984885:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9857@kfi7: PUT: OK
00000100:00100000:26.0:1773851886.984886:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9792@kfi7, seq: 1451911037
00000400:00000200:25.0:1773851886.984887:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008661a9da
00000100:00000040:26.0:1773851886.984888:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000090286c59 : new rpc_count 4
00000400:00000010:25.0:1773851886.984888:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008661a9da.
00000100:00000001:26.0:1773851886.984889:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851886.984889:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851886.984890:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851886.984890:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:26.0:1773851886.984891:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851886.984892:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000281fce92 nid 9857@kfi7 refs 2
00000020:00000010:26.0:1773851886.984893:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000020:00000010:26.0:1773851886.984894:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd5c6346.
00000800:00000200:25.0:1773851886.984895:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 9857@kfi7(0000000051d3b51d):0x0 lsk 477 rsk 55 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1dc Transaction freed
00000020:00000040:26.0:1773851886.984896:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000090286c59 : new refcount 59
00000100:00000001:26.0:1773851886.984897:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851887.034734:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851887.034735:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851887.034736:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851887.034738:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851887.034739:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20929@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.034740:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20929@kfi7 : PUT - for me
00000400:00000200:29.0:1773851887.034741:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20929@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.034742:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005556dc6f nid 20929@kfi7 refs 1
00000400:00000200:29.0:1773851887.034743:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20929@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.034744:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005556dc6f nid 20929@kfi7 refs 2
00000400:00000200:29.0:1773851887.034745:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005556dc6f nid 20929@kfi7 refs 3
00000400:00000200:29.0:1773851887.034745:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20929@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.034746:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20929@kfi7 of length 224 into portal 12 MB=0x69b1704542100
00000400:00000200:29.0:1773851887.034747:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20929@kfi7 of length 224/224 into md 0x77fe139dd [64] + 194424
00000400:00000010:29.0:1773851887.034748:0:2467684:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000044f64af2.
00000400:00000200:29.0:1773851887.034749:0:2467684:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 000000003f8bce6d
00000800:00000200:29.0:1773851887.034750:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851887.034752:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851887.034752:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20929@kfi7: PUT: OK
00000400:00000200:29.0:1773851887.034753:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003f8bce6d
00000400:00000010:29.0:1773851887.034754:0:2467684:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 1144 at 000000003f8bce6d (tot 253199627).
00000100:00000001:29.0:1773851887.034755:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851887.034756:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000040:29.0:1773851887.034757:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a6f8fb29 x1859373019439360 msgsize 224
00000100:00100000:29.0:1773851887.034758:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-20929@kfi7 (source: 12345-20929@kfi7)
00000100:00000040:29.0:1773851887.034758:0:2467684:0:(events.c:370:request_in_callback()) Buffer complete: 50 buffers still posted
00000100:00000001:29.0:1773851887.034760:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851887.034761:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005556dc6f nid 20929@kfi7 refs 2
00000800:00000200:29.0:1773851887.034762:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d8feb356: 2069@kfi7:7 <- 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851887.034764:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851887.034765:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851887.034765:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851887.034766:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851887.034767:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851887.034767:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373019439360
00000020:00000001:29.0:1773851887.034768:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851887.034768:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793aeb9548
00000020:00000001:29.0:1773851887.034769:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851887.034772:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000528df26e refcount=5
00000020:00000001:29.0:1773851887.034772:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956525139968 : -107117184411648 : ffff9e93d6461800)
00000020:00000001:29.0:1773851887.034773:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636956525139968 : -107117184411648 : ffff9e93d6461800)
00000100:00000001:29.0:1773851887.034774:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851887.034775:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851887.034775:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000002306b43.
00000020:00000010:29.0:1773851887.034776:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851887.034777:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851887.034777:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851887.034778:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851887.034778:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.034779:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851887.034780:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851887.034780:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.034781:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.034782:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851887.034783:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851887.034783:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851887.034783:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851887.034784:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20929@kfi7, seq: 2055572
00000100:00000001:30.0:1773851887.034785:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.034785:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851887.034785:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000528df26e : new rpc_count 1
00000100:00000001:29.0:1773851887.034785:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636930013067344 : -107143696484272 : ffff9e8daa07f850)
00000100:00000040:29.0:1773851887.034786:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6f8fb29 x1859373019439360/t0(0) o400->5c881508-2489-4f75-964c-5287a6beb079@20929@kfi7:139/0 lens 224/0 e 0 to 0 dl 1773852254 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1795-0'
00000100:00000001:29.0:1773851887.034789:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851887.034789:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851887.034790:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6f8fb29 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:5c881508-2489-4f75-964c-5287a6beb079+5:39726:x1859373019439360:12345-20929@kfi7:400:default-tuolumne1795-0
00000100:00000200:29.0:1773851887.034791:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373019439360
00000020:00000001:29.0:1773851887.034792:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851887.034792:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851887.034793:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.034793:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851887.034794:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851887.034794:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851887.034795:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373019439360, found 0 last_xid 1859373019439359
00000020:00000001:29.0:1773851887.034796:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851887.034796:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851887.034797:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851887.034797:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.034798:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851887.034798:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851887.034799:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851887.034799:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a8d492b0.
02000000:00000001:29.0:1773851887.034800:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.034800:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.034801:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851887.034802:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262823445, transno 0, xid 1859373019439360
00010000:00000001:29.0:1773851887.034802:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851887.034803:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6f8fb29 x1859373019439360/t0(0) o400->5c881508-2489-4f75-964c-5287a6beb079@20929@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1795-0'
00010000:00000001:29.0:1773851887.034805:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851887.034806:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851887.034806:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=120 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851887.034807:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851887.034808:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000012f1f784 refcount 3 to 20929@kfi7
00000100:00000001:29.0:1773851887.034808:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066624 : -107155994484992 : ffff9e8acd035f00)
02000000:00000001:29.0:1773851887.034809:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851887.034810:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.034810:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851887.034811:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20929@kfi7
00000400:00000010:29.0:1773851887.034811:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf20a357.
00000100:00000200:29.0:1773851887.034812:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373019439360, offset 224
00000400:00000200:29.0:1773851887.034813:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20929@kfi7
00000400:00000200:29.0:1773851887.034814:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20929@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.034814:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005556dc6f nid 20929@kfi7 refs 1
00000400:00000200:29.0:1773851887.034815:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005556dc6f nid 20929@kfi7 refs 2
00000400:00000200:29.0:1773851887.034816:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005556dc6f nid 20929@kfi7 refs 3
00000400:00000200:29.0:1773851887.034817:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20929@kfi7 local destination
00000400:00000200:29.0:1773851887.034818:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769872:8769872:1024:4294967295] 20929@kfi7 LPNI seq info [2777782:2777782:16:4294967295]
00000400:00000200:29.0:1773851887.034820:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005556dc6f nid 20929@kfi7 refs 2
00000400:00000200:29.0:1773851887.034820:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20929@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.034822:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20929@kfi7(20929@kfi7:20929@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851887.034823:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005556dc6f nid 20929@kfi7 refs 3
00000800:00000200:29.0:1773851887.034824:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851887.034825:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851887.034826:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851887.034829:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x71a Using peer 20929@kfi7(0x71a)
00000800:00000200:29.0:1773851887.034831:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d8feb356: Posted send of 324 bytes to peer 0x71a: rc=0
00000800:00000200:29.0:1773851887.034833:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x71a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851887.034835:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851887.034836:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000012f1f784 refcount 2 to 20929@kfi7
00010000:00000001:29.0:1773851887.034837:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851887.034837:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.034838:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851887.034838:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6f8fb29 x1859373019439360/t0(0) o400->5c881508-2489-4f75-964c-5287a6beb079@20929@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1795-0'
00000100:00100000:29.0:1773851887.034841:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6f8fb29 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:5c881508-2489-4f75-964c-5287a6beb079+5:39726:x1859373019439360:12345-20929@kfi7:400:default-tuolumne1795-0 Request processed in 51us (83us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851887.034843:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20929@kfi7, seq: 2055572
00000100:00000040:29.0:1773851887.034844:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000528df26e : new rpc_count 0
00000100:00000001:29.0:1773851887.034845:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851887.034845:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:30.0:1773851887.034846:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x71a TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851887.034846:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851887.034846:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851887.034847:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000002306b43.
00000400:00000200:30.0:1773851887.034848:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:29.0:1773851887.034848:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000528df26e : new refcount 4
00000400:00000200:30.0:1773851887.034850:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20929@kfi7: PUT: OK
00000400:00000200:30.0:1773851887.034851:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf20a357
00000400:00000010:30.0:1773851887.034852:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf20a357.
00000100:00000001:30.0:1773851887.034853:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851887.034853:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851887.034854:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005556dc6f nid 20929@kfi7 refs 2
00000800:00000200:30.0:1773851887.034856:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d8feb356: 2069@kfi7:7 -> 20929@kfi7(00000000f6d7f79a):0x0 lsk 1819 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x71a Transaction freed
02000000:00000001:29.0:1773851887.034947:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034948:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a8d492b0.
02000000:00000001:29.0:1773851887.034949:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
02000000:00000001:29.0:1773851887.034949:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034949:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003750b809.
02000000:00000001:29.0:1773851887.034950:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034951:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000066f616b8.
02000000:00000001:29.0:1773851887.034951:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034952:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007644643c.
02000000:00000001:29.0:1773851887.034952:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034953:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fede61b9.
02000000:00000001:29.0:1773851887.034953:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034954:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b905bb3d.
02000000:00000001:29.0:1773851887.034954:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034955:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6d33b31.
02000000:00000001:29.0:1773851887.034955:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034956:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000098ed3885.
02000000:00000001:29.0:1773851887.034957:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034957:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005474ef7d.
02000000:00000001:29.0:1773851887.034958:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034958:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2d18ae5.
02000000:00000001:29.0:1773851887.034958:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034959:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3afdabf.
02000000:00000001:29.0:1773851887.034960:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034960:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b42abb09.
02000000:00000001:29.0:1773851887.034960:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034961:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a11c0a22.
02000000:00000001:29.0:1773851887.034961:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034962:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003e8dfd37.
02000000:00000001:29.0:1773851887.034962:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034963:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000088c53149.
02000000:00000001:29.0:1773851887.034963:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034964:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b8ea7eb2.
02000000:00000001:29.0:1773851887.034964:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034965:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1522f00.
02000000:00000001:29.0:1773851887.034965:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034966:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000cd8161e.
02000000:00000001:29.0:1773851887.034966:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034966:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000068759d78.
02000000:00000001:29.0:1773851887.034967:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034967:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d23aa690.
02000000:00000001:29.0:1773851887.034968:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034968:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c2a6e4df.
02000000:00000001:29.0:1773851887.034969:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034969:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000436037ce.
02000000:00000001:29.0:1773851887.034970:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034970:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000008df5d4a.
02000000:00000001:29.0:1773851887.034971:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034971:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a2276ea4.
02000000:00000001:29.0:1773851887.034972:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034972:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000afd0259c.
02000000:00000001:29.0:1773851887.034973:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034973:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000860b557b.
02000000:00000001:29.0:1773851887.034974:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034974:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000033de482b.
02000000:00000001:29.0:1773851887.034975:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034975:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009b0ce531.
02000000:00000001:29.0:1773851887.034976:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034977:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000018cb496e.
02000000:00000001:29.0:1773851887.034978:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034979:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e5f6277.
02000000:00000001:29.0:1773851887.034980:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034980:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bf844e4d.
02000000:00000001:29.0:1773851887.034981:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034982:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e1155eb.
02000000:00000001:29.0:1773851887.034983:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034983:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a30876a5.
02000000:00000001:29.0:1773851887.034984:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034985:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b511ce4a.
02000000:00000001:29.0:1773851887.034986:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034986:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b7b6badf.
02000000:00000001:29.0:1773851887.034988:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034988:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002f4c3dac.
02000000:00000001:29.0:1773851887.034989:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034990:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d90c76df.
02000000:00000001:29.0:1773851887.034991:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034992:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fe340259.
02000000:00000001:29.0:1773851887.034993:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034993:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e4a3e705.
02000000:00000001:29.0:1773851887.034994:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034995:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000019a8004d.
02000000:00000001:29.0:1773851887.034996:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.034997:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000018a9b63.
02000000:00000001:29.0:1773851887.034998:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.034999:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000427ecd1f.
02000000:00000001:29.0:1773851887.035000:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035001:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8a0b53c.
02000000:00000001:29.0:1773851887.035002:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035003:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d9820241.
02000000:00000001:29.0:1773851887.035005:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035005:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000055bd4bee.
02000000:00000001:29.0:1773851887.035007:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035008:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000adb0a5b7.
02000000:00000001:29.0:1773851887.035010:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035010:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ffd7e266.
02000000:00000001:29.0:1773851887.035012:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035013:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f45ca2b5.
02000000:00000001:29.0:1773851887.035014:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035014:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009223ebff.
02000000:00000001:29.0:1773851887.035016:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035017:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027a2a550.
02000000:00000001:29.0:1773851887.035018:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035018:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e06e3e2f.
02000000:00000001:29.0:1773851887.035020:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035020:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e6bd80eb.
02000000:00000001:29.0:1773851887.035021:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035022:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000022ef8079.
02000000:00000001:29.0:1773851887.035024:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035025:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007e39e2f6.
02000000:00000001:29.0:1773851887.035026:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035027:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd52e765.
02000000:00000001:29.0:1773851887.035028:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035029:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004a14fe5a.
02000000:00000001:29.0:1773851887.035030:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035030:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d462bc12.
02000000:00000001:29.0:1773851887.035032:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035033:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001aa5c9b3.
02000000:00000001:29.0:1773851887.035034:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035034:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007360b5af.
02000000:00000001:29.0:1773851887.035036:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035037:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005e26a9ee.
02000000:00000001:29.0:1773851887.035037:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035038:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bac9ca66.
02000000:00000001:29.0:1773851887.035039:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035040:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b0660696.
02000000:00000001:29.0:1773851887.035042:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035042:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c729812a.
00000100:00000010:29.0:1773851887.035044:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000edda85db.
02000000:00000001:29.0:1773851887.035046:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035046:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000064503462.
02000000:00000001:29.0:1773851887.035048:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035049:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002e96ec60.
02000000:00000001:29.0:1773851887.035050:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035051:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d4b2a38b.
02000000:00000001:29.0:1773851887.035052:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035052:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003680650d.
02000000:00000001:29.0:1773851887.035054:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035055:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e2131fd4.
02000000:00000001:29.0:1773851887.035056:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035057:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000010d12885.
02000000:00000001:29.0:1773851887.035058:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035059:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000961be362.
02000000:00000001:29.0:1773851887.035061:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035061:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042fb68a8.
02000000:00000001:29.0:1773851887.035063:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035063:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000081f5e7b6.
02000000:00000001:29.0:1773851887.035065:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035065:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dfb36aad.
02000000:00000001:29.0:1773851887.035067:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035067:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004e821577.
02000000:00000001:29.0:1773851887.035069:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035070:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db2f56d6.
02000000:00000001:29.0:1773851887.035072:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035072:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bbe8a27c.
02000000:00000001:29.0:1773851887.035074:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035074:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031e17c5f.
02000000:00000001:29.0:1773851887.035076:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035076:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e8ebf5fc.
02000000:00000001:29.0:1773851887.035078:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035079:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d3c4c877.
02000000:00000001:29.0:1773851887.035080:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035081:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d3ffe5a1.
02000000:00000001:29.0:1773851887.035082:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035082:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008d27fc55.
02000000:00000001:29.0:1773851887.035084:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035085:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000009fd8e64.
02000000:00000001:29.0:1773851887.035086:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035087:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae9e3688.
02000000:00000001:29.0:1773851887.035089:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035089:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000055961172.
02000000:00000001:29.0:1773851887.035091:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035092:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d0626453.
02000000:00000001:29.0:1773851887.035093:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035094:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000036c31916.
02000000:00000001:29.0:1773851887.035095:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035096:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d6a92c0.
02000000:00000001:29.0:1773851887.035097:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035098:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005251a13b.
02000000:00000001:29.0:1773851887.035099:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035099:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fc459a46.
00000100:00000010:29.0:1773851887.035101:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002e49b11.
00000100:00000010:29.0:1773851887.035103:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000912e612e.
02000000:00000001:29.0:1773851887.035104:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035105:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000047470845.
02000000:00000001:29.0:1773851887.035106:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035106:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000475f095e.
02000000:00000001:29.0:1773851887.035108:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035109:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b56c4382.
02000000:00000001:29.0:1773851887.035110:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035110:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002e35df54.
02000000:00000001:29.0:1773851887.035112:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035112:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b0bf80b5.
02000000:00000001:29.0:1773851887.035113:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035114:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cbf4de82.
02000000:00000001:29.0:1773851887.035115:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035116:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000439bdbce.
02000000:00000001:29.0:1773851887.035117:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035118:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000768d3f8c.
02000000:00000001:29.0:1773851887.035119:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035120:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000013c4fc80.
02000000:00000001:29.0:1773851887.035121:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035121:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061cdc96b.
02000000:00000001:29.0:1773851887.035123:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035123:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000044b93b22.
02000000:00000001:29.0:1773851887.035124:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035128:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a078b22.
02000000:00000001:29.0:1773851887.035129:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035130:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000089b4f0eb.
02000000:00000001:29.0:1773851887.035131:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035132:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000910ae6c1.
02000000:00000001:29.0:1773851887.035133:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035133:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006eaed4a4.
02000000:00000001:29.0:1773851887.035134:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035135:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ceb28833.
02000000:00000001:29.0:1773851887.035136:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035137:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000e469be4.
02000000:00000001:29.0:1773851887.035138:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035138:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bbaecf5d.
02000000:00000001:29.0:1773851887.035139:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035140:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a057a76.
02000000:00000001:29.0:1773851887.035141:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035142:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003923c340.
02000000:00000001:29.0:1773851887.035143:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035143:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000590ddc6f.
02000000:00000001:29.0:1773851887.035144:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035145:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007813b1d8.
02000000:00000001:29.0:1773851887.035146:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035147:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007019ce07.
02000000:00000001:29.0:1773851887.035148:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035148:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c8760cc.
02000000:00000001:29.0:1773851887.035149:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035150:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001e41aca0.
02000000:00000001:29.0:1773851887.035151:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035151:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e1f81b2.
02000000:00000001:29.0:1773851887.035153:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035153:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000792e21df.
02000000:00000001:29.0:1773851887.035155:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035155:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000053710b31.
02000000:00000001:29.0:1773851887.035156:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035157:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000062db5345.
02000000:00000001:29.0:1773851887.035158:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035159:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3705785.
02000000:00000001:29.0:1773851887.035160:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035161:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000088ac99d7.
02000000:00000001:29.0:1773851887.035162:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035163:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059df2607.
02000000:00000001:29.0:1773851887.035165:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035165:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c23c12a5.
02000000:00000001:29.0:1773851887.035166:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035167:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d5a724c.
02000000:00000001:29.0:1773851887.035168:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035169:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f6d7394b.
02000000:00000001:29.0:1773851887.035170:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035170:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005a583396.
02000000:00000001:29.0:1773851887.035172:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035172:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005a34f240.
02000000:00000001:29.0:1773851887.035173:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035174:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000003e3966f.
02000000:00000001:29.0:1773851887.035175:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035176:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000016bd66c2.
02000000:00000001:29.0:1773851887.035176:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035177:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004db24b81.
02000000:00000001:29.0:1773851887.035178:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035179:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e51428c9.
02000000:00000001:29.0:1773851887.035180:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035180:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f5dab2c.
02000000:00000001:29.0:1773851887.035182:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035183:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000259b265.
02000000:00000001:29.0:1773851887.035184:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035184:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000211d2bff.
02000000:00000001:29.0:1773851887.035186:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035186:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aceb0722.
02000000:00000001:29.0:1773851887.035187:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035188:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005ad871fc.
02000000:00000001:29.0:1773851887.035189:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035190:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000041347fd5.
02000000:00000001:29.0:1773851887.035191:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035192:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008b9dc5f9.
02000000:00000001:29.0:1773851887.035193:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035193:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000021731e2.
02000000:00000001:29.0:1773851887.035194:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035195:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000848e3fb7.
02000000:00000001:29.0:1773851887.035196:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035197:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004da15451.
02000000:00000001:29.0:1773851887.035198:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035199:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cb82d82f.
02000000:00000001:29.0:1773851887.035200:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035201:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000082af503b.
02000000:00000001:29.0:1773851887.035201:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035202:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000863ffac5.
02000000:00000001:29.0:1773851887.035203:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035204:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ddcc3c3f.
02000000:00000001:29.0:1773851887.035205:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035205:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec3041ec.
02000000:00000001:29.0:1773851887.035207:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035208:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000052fa1d65.
02000000:00000001:29.0:1773851887.035209:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035209:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b0276502.
02000000:00000001:29.0:1773851887.035210:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035211:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000546cd5ce.
02000000:00000001:29.0:1773851887.035212:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035212:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000011bf6eb6.
02000000:00000001:29.0:1773851887.035214:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035214:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008fa1195c.
02000000:00000001:29.0:1773851887.035215:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035216:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004f53da15.
02000000:00000001:29.0:1773851887.035217:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035217:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001375c5db.
02000000:00000001:29.0:1773851887.035218:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035219:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dbf510ca.
02000000:00000001:29.0:1773851887.035221:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035221:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006fc03af3.
02000000:00000001:29.0:1773851887.035222:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035223:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004372f111.
02000000:00000001:29.0:1773851887.035225:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035225:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d78bc747.
02000000:00000001:29.0:1773851887.035227:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035227:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002856329d.
02000000:00000001:29.0:1773851887.035229:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035230:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000ce89abbc.
02000000:00000001:29.0:1773851887.035231:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035232:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000828a2183.
02000000:00000001:29.0:1773851887.035233:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035234:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000003eec177.
02000000:00000001:29.0:1773851887.035235:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035236:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c843f8ed.
02000000:00000001:29.0:1773851887.035238:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035238:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ede70ba4.
02000000:00000001:29.0:1773851887.035239:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035240:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036759c4c.
02000000:00000001:29.0:1773851887.035241:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035242:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000536cf4d6.
02000000:00000001:29.0:1773851887.035243:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035244:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5bb58f1.
02000000:00000001:29.0:1773851887.035245:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035246:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad2b899b.
02000000:00000001:29.0:1773851887.035247:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035248:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000080859878.
02000000:00000001:29.0:1773851887.035249:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035250:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000fa543a7.
02000000:00000001:29.0:1773851887.035251:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035251:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cb4a8fc1.
02000000:00000001:29.0:1773851887.035253:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035253:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a041213d.
02000000:00000001:29.0:1773851887.035255:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035255:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c01b7c03.
02000000:00000001:29.0:1773851887.035257:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035257:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b8ecea64.
02000000:00000001:29.0:1773851887.035259:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035260:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f3f8f0d8.
02000000:00000001:29.0:1773851887.035261:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035262:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000063ec6403.
02000000:00000001:29.0:1773851887.035263:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035263:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b5235fc3.
02000000:00000001:29.0:1773851887.035265:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035265:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e47eb631.
02000000:00000001:29.0:1773851887.035266:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035267:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f03d494.
02000000:00000001:29.0:1773851887.035268:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035269:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004846a21a.
02000000:00000001:29.0:1773851887.035270:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035271:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d1f7d67d.
02000000:00000001:29.0:1773851887.035272:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035272:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000047dc5ef9.
02000000:00000001:29.0:1773851887.035273:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035274:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b4c75ac7.
02000000:00000001:29.0:1773851887.035276:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035276:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000899fc249.
02000000:00000001:29.0:1773851887.035277:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035278:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000737c706c.
02000000:00000001:29.0:1773851887.035279:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035280:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cd411c23.
02000000:00000001:29.0:1773851887.035282:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035282:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c007e06.
02000000:00000001:29.0:1773851887.035284:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035285:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e268637b.
02000000:00000001:29.0:1773851887.035286:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035286:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000388449aa.
02000000:00000001:29.0:1773851887.035288:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035289:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f9c7c302.
02000000:00000001:29.0:1773851887.035290:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035291:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f5c688d.
02000000:00000001:29.0:1773851887.035292:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035293:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001595abdd.
02000000:00000001:29.0:1773851887.035294:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035295:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004125a548.
02000000:00000001:29.0:1773851887.035296:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035297:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000083005af7.
02000000:00000001:29.0:1773851887.035298:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035299:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c71f8a20.
02000000:00000001:29.0:1773851887.035300:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035301:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006ee5136e.
02000000:00000001:29.0:1773851887.035302:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035303:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004e39c75d.
02000000:00000001:29.0:1773851887.035304:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035306:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000309a702a.
02000000:00000001:29.0:1773851887.035307:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035307:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005aaa3402.
02000000:00000001:29.0:1773851887.035309:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035310:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000001e64c96.
02000000:00000001:29.0:1773851887.035311:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035311:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000496b8f62.
02000000:00000001:29.0:1773851887.035313:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035314:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000015155d29.
02000000:00000001:29.0:1773851887.035316:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035316:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f3edd57a.
02000000:00000001:29.0:1773851887.035318:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035318:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ceb3b4a6.
02000000:00000001:29.0:1773851887.035319:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035320:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad479508.
02000000:00000001:29.0:1773851887.035322:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035322:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b7e8ad0d.
02000000:00000001:29.0:1773851887.035324:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035324:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000083794617.
02000000:00000001:29.0:1773851887.035325:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035326:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f37a3433.
02000000:00000001:29.0:1773851887.035327:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035328:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b1982c10.
02000000:00000001:29.0:1773851887.035329:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035330:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008c112e85.
02000000:00000001:29.0:1773851887.035331:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035332:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004468da38.
02000000:00000001:29.0:1773851887.035333:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035334:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c8e5216d.
02000000:00000001:29.0:1773851887.035335:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035336:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000097803a98.
02000000:00000001:29.0:1773851887.035337:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035338:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b4aa73e4.
02000000:00000001:29.0:1773851887.035339:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035340:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d00e119c.
02000000:00000001:29.0:1773851887.035341:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035342:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d7aa1437.
02000000:00000001:29.0:1773851887.035343:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035344:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000543749aa.
02000000:00000001:29.0:1773851887.035345:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035346:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000064d31181.
02000000:00000001:29.0:1773851887.035347:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035348:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b2ab906b.
02000000:00000001:29.0:1773851887.035349:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035350:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bef19b5b.
02000000:00000001:29.0:1773851887.035351:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035351:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003e308ff7.
02000000:00000001:29.0:1773851887.035353:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035354:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000025d2a996.
02000000:00000001:29.0:1773851887.035355:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035356:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031392470.
02000000:00000001:29.0:1773851887.035357:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035358:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a5f84808.
02000000:00000001:29.0:1773851887.035360:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035360:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004ef04081.
02000000:00000001:29.0:1773851887.035362:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035363:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009f353d06.
02000000:00000001:29.0:1773851887.035364:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035364:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000217c2e7.
02000000:00000001:29.0:1773851887.035366:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035366:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000032ef3259.
02000000:00000001:29.0:1773851887.035367:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035368:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ceec6c49.
02000000:00000001:29.0:1773851887.035369:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035370:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000e9f67bb0.
02000000:00000001:29.0:1773851887.035371:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035372:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8bb7992.
02000000:00000001:29.0:1773851887.035373:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035374:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad1c0d73.
02000000:00000001:29.0:1773851887.035375:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035376:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000093a4bdc.
02000000:00000001:29.0:1773851887.035377:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035378:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002fdd8d54.
02000000:00000001:29.0:1773851887.035379:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035379:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fd2b39c4.
02000000:00000001:29.0:1773851887.035381:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035382:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cb79a0c5.
02000000:00000001:29.0:1773851887.035384:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035384:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c52fac07.
02000000:00000001:29.0:1773851887.035386:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035386:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b4252b4e.
02000000:00000001:29.0:1773851887.035387:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035388:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000088cead73.
02000000:00000001:29.0:1773851887.035390:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035390:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e1288339.
02000000:00000001:29.0:1773851887.035391:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035392:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000062c0ca66.
02000000:00000001:29.0:1773851887.035393:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035394:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004c041e40.
02000000:00000001:29.0:1773851887.035395:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035396:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb2f43fd.
02000000:00000001:29.0:1773851887.035397:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035398:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c0d1fe47.
02000000:00000001:29.0:1773851887.035399:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035400:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f0c0660c.
02000000:00000001:29.0:1773851887.035401:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035402:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fe19af99.
02000000:00000001:29.0:1773851887.035403:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035404:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e1c723ea.
02000000:00000001:29.0:1773851887.035405:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035406:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000238b2613.
02000000:00000001:29.0:1773851887.035407:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035408:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1b17a23.
02000000:00000001:29.0:1773851887.035409:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035410:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000adf8f91b.
02000000:00000001:29.0:1773851887.035411:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035412:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000182ebf41.
02000000:00000001:29.0:1773851887.035413:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035414:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008af9e3b3.
02000000:00000001:29.0:1773851887.035415:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035416:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000333fbfa4.
02000000:00000001:29.0:1773851887.035417:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035418:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001d1a7a8a.
02000000:00000001:29.0:1773851887.035419:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035421:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000042094d87.
02000000:00000001:29.0:1773851887.035422:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035423:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b7ab105f.
02000000:00000001:29.0:1773851887.035424:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035424:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0c62afe.
02000000:00000001:29.0:1773851887.035426:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035426:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000061049fe5.
02000000:00000001:29.0:1773851887.035427:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035428:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056e05a01.
02000000:00000001:29.0:1773851887.035429:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035430:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000694036ea.
02000000:00000001:29.0:1773851887.035431:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035432:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005eed34e7.
02000000:00000001:29.0:1773851887.035433:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035434:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000761cf767.
02000000:00000001:29.0:1773851887.035435:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035436:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000328d89c9.
02000000:00000001:29.0:1773851887.035437:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035438:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009b78eae0.
02000000:00000001:29.0:1773851887.035440:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035440:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000593d5b1.
02000000:00000001:29.0:1773851887.035442:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035442:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069907261.
02000000:00000001:29.0:1773851887.035444:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035445:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f6ba6e11.
02000000:00000001:29.0:1773851887.035446:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035447:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000088bd73c8.
02000000:00000001:29.0:1773851887.035448:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035448:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cca2a948.
02000000:00000001:29.0:1773851887.035450:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035451:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000003eda824d.
02000000:00000001:29.0:1773851887.035452:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035453:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007205c70f.
02000000:00000001:29.0:1773851887.035454:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035455:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e8a160c.
02000000:00000001:29.0:1773851887.035456:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035456:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000da69eff3.
02000000:00000001:29.0:1773851887.035458:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035459:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006b022f54.
02000000:00000001:29.0:1773851887.035460:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035461:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6eabe39.
02000000:00000001:29.0:1773851887.035462:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035463:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b92c4ee7.
02000000:00000001:29.0:1773851887.035464:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035465:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f37fb891.
02000000:00000001:29.0:1773851887.035467:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035467:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000bd69d754.
02000000:00000001:29.0:1773851887.035469:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035470:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c23b007.
02000000:00000001:29.0:1773851887.035471:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035472:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000833e2e5a.
02000000:00000001:29.0:1773851887.035473:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035474:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003a15e32e.
02000000:00000001:29.0:1773851887.035475:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035476:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e6269dcf.
02000000:00000001:29.0:1773851887.035477:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035478:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000599fe334.
02000000:00000001:29.0:1773851887.035479:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035480:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000054a7febb.
02000000:00000001:29.0:1773851887.035481:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035481:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056826228.
02000000:00000001:29.0:1773851887.035482:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035483:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084317c76.
02000000:00000001:29.0:1773851887.035484:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035485:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000099be4fd9.
02000000:00000001:29.0:1773851887.035486:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035487:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000050a6fdc2.
02000000:00000001:29.0:1773851887.035488:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035489:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006db6dd3a.
02000000:00000001:29.0:1773851887.035490:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035491:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000edefed54.
02000000:00000001:29.0:1773851887.035493:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035494:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f3dcb147.
02000000:00000001:29.0:1773851887.035495:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035496:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ccdcdd1e.
02000000:00000001:29.0:1773851887.035497:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035498:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000305b24f2.
02000000:00000001:29.0:1773851887.035500:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035500:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005b012337.
02000000:00000001:29.0:1773851887.035501:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035502:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a73ee51.
02000000:00000001:29.0:1773851887.035504:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035504:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c2eb484b.
02000000:00000001:29.0:1773851887.035505:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035506:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000082b3f44d.
02000000:00000001:29.0:1773851887.035508:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035508:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ec823cb4.
02000000:00000001:29.0:1773851887.035510:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035511:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000090045927.
02000000:00000001:29.0:1773851887.035512:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035513:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000001a7acf23.
02000000:00000001:29.0:1773851887.035514:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035515:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009563a137.
02000000:00000001:29.0:1773851887.035516:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035517:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000061c4ca31.
02000000:00000001:29.0:1773851887.035518:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035519:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000064e2cf4a.
02000000:00000001:29.0:1773851887.035520:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035521:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e2396574.
02000000:00000001:29.0:1773851887.035522:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035523:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a75aefe5.
02000000:00000001:29.0:1773851887.035524:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035525:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fcfbdaf9.
02000000:00000001:29.0:1773851887.035526:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035527:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b16a7a8b.
02000000:00000001:29.0:1773851887.035528:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035529:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b5a5e3cf.
02000000:00000001:29.0:1773851887.035530:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035530:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000169578b1.
02000000:00000001:29.0:1773851887.035532:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035532:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030bf4a39.
02000000:00000001:29.0:1773851887.035533:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035534:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ecc7091d.
02000000:00000001:29.0:1773851887.035535:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035537:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002b46a622.
02000000:00000001:29.0:1773851887.035538:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035539:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000549c6e2.
02000000:00000001:29.0:1773851887.035540:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035541:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000851d9292.
02000000:00000001:29.0:1773851887.035542:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035542:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005a37a3d5.
02000000:00000001:29.0:1773851887.035544:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035544:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002c3dc80e.
02000000:00000001:29.0:1773851887.035546:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035546:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd18e629.
02000000:00000001:29.0:1773851887.035548:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035548:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000029c29f15.
02000000:00000001:29.0:1773851887.035549:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035550:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000073f742cf.
02000000:00000001:29.0:1773851887.035551:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035552:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001c69715f.
02000000:00000001:29.0:1773851887.035554:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035554:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000b7f985b.
02000000:00000001:29.0:1773851887.035555:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035556:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f16bd15f.
02000000:00000001:29.0:1773851887.035557:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035558:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000910f896b.
02000000:00000001:29.0:1773851887.035559:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035560:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000091b15b77.
02000000:00000001:29.0:1773851887.035561:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035562:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079778f3f.
02000000:00000001:29.0:1773851887.035563:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035564:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000055e86862.
02000000:00000001:29.0:1773851887.035565:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035565:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e252872c.
02000000:00000001:29.0:1773851887.035567:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035567:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e8b59080.
02000000:00000001:29.0:1773851887.035569:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035570:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a5abff2d.
02000000:00000001:29.0:1773851887.035571:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035571:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000dcaffd0b.
02000000:00000001:29.0:1773851887.035573:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035574:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009faf04da.
02000000:00000001:29.0:1773851887.035576:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035576:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000006ceec31.
02000000:00000001:29.0:1773851887.035578:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035578:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000faf80ace.
02000000:00000001:29.0:1773851887.035580:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035581:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a00abc5f.
02000000:00000001:29.0:1773851887.035582:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035582:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006b9b5ef9.
02000000:00000001:29.0:1773851887.035584:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035585:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000d2f5e0b3.
02000000:00000001:29.0:1773851887.035587:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035587:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a4582e9e.
02000000:00000001:29.0:1773851887.035589:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035589:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000099927fb9.
02000000:00000001:29.0:1773851887.035591:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035591:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000052d8d915.
02000000:00000001:29.0:1773851887.035593:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035593:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e78c040a.
02000000:00000001:29.0:1773851887.035594:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035595:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c8803a9.
02000000:00000001:29.0:1773851887.035597:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035597:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000020b4543a.
02000000:00000001:29.0:1773851887.035599:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035599:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000928706ac.
02000000:00000001:29.0:1773851887.035601:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035601:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030c754d0.
02000000:00000001:29.0:1773851887.035602:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035603:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003725559d.
02000000:00000001:29.0:1773851887.035604:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035605:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000da4a0e05.
02000000:00000001:29.0:1773851887.035606:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035607:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b0634a01.
02000000:00000001:29.0:1773851887.035609:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035609:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c8629420.
02000000:00000001:29.0:1773851887.035610:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035611:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7798a4e.
02000000:00000001:29.0:1773851887.035612:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035614:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000096b10263.
02000000:00000001:29.0:1773851887.035615:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035615:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000077b1237f.
02000000:00000001:29.0:1773851887.035617:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035618:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000716bf014.
02000000:00000001:29.0:1773851887.035619:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035619:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f89ace29.
02000000:00000001:29.0:1773851887.035621:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035621:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000064dfafc5.
02000000:00000001:29.0:1773851887.035623:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035623:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000048ef7498.
02000000:00000001:29.0:1773851887.035625:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035626:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001d8800a8.
02000000:00000001:29.0:1773851887.035627:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035627:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000010db27c7.
02000000:00000001:29.0:1773851887.035629:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035629:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b3235450.
02000000:00000001:29.0:1773851887.035630:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035631:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d11e7c6f.
02000000:00000001:29.0:1773851887.035632:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035633:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000514af8cf.
02000000:00000001:29.0:1773851887.035634:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035635:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004ed9cce.
02000000:00000001:29.0:1773851887.035636:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035637:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000068afee8.
02000000:00000001:29.0:1773851887.035639:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035639:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000935ff735.
02000000:00000001:29.0:1773851887.035641:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035641:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000a1b6e3c6.
02000000:00000001:29.0:1773851887.035643:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035644:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006c01983f.
02000000:00000001:29.0:1773851887.035645:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035646:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 0000000077d985d1.
02000000:00000001:29.0:1773851887.035648:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035648:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ddcb232d.
02000000:00000001:29.0:1773851887.035649:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035650:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c0bec54e.
02000000:00000001:29.0:1773851887.035651:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035652:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000087eb6c6.
02000000:00000001:29.0:1773851887.035654:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035654:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b14a312b.
02000000:00000001:29.0:1773851887.035655:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035656:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000348dc57a.
02000000:00000001:29.0:1773851887.035658:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035658:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fe387974.
02000000:00000001:29.0:1773851887.035659:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035660:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000002104291.
02000000:00000001:29.0:1773851887.035662:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035663:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005ad94301.
02000000:00000001:29.0:1773851887.035664:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035665:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a81e39de.
02000000:00000001:29.0:1773851887.035666:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035667:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f9d5dc60.
02000000:00000001:29.0:1773851887.035668:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035669:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c22606bd.
02000000:00000001:29.0:1773851887.035670:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035671:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b49971ad.
02000000:00000001:29.0:1773851887.035672:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035673:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000feb0992f.
02000000:00000001:29.0:1773851887.035674:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035675:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004649f7e6.
02000000:00000001:29.0:1773851887.035676:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035676:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061619ead.
02000000:00000001:29.0:1773851887.035678:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035679:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005d1604b5.
02000000:00000001:29.0:1773851887.035680:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035681:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c310fc1.
02000000:00000001:29.0:1773851887.035682:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035683:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000b7da336.
02000000:00000001:29.0:1773851887.035684:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035685:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5c59480.
02000000:00000001:29.0:1773851887.035686:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035687:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000032112a86.
02000000:00000001:29.0:1773851887.035688:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035689:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a14cef5.
02000000:00000001:29.0:1773851887.035691:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035692:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dc3e48ae.
02000000:00000001:29.0:1773851887.035693:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035693:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0827ef3.
02000000:00000001:29.0:1773851887.035695:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035695:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006cf67b25.
02000000:00000001:29.0:1773851887.035696:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035697:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000224b5973.
02000000:00000001:29.0:1773851887.035698:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035699:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000398367e9.
02000000:00000001:29.0:1773851887.035700:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035701:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008db92b53.
02000000:00000001:29.0:1773851887.035702:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035703:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000d13258e.
02000000:00000001:29.0:1773851887.035704:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035705:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a9f041e.
02000000:00000001:29.0:1773851887.035706:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035707:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006e3925ec.
02000000:00000001:29.0:1773851887.035708:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035709:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000917efb3f.
02000000:00000001:29.0:1773851887.035710:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035711:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000405c1a92.
02000000:00000001:29.0:1773851887.035712:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035712:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000048d184fd.
02000000:00000001:29.0:1773851887.035713:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035714:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dec59fbd.
02000000:00000001:29.0:1773851887.035715:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035716:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007ea94ddd.
02000000:00000001:29.0:1773851887.035717:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035718:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f11d26a5.
02000000:00000001:29.0:1773851887.035719:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035719:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b92072c8.
02000000:00000001:29.0:1773851887.035721:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035721:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ab4b6757.
02000000:00000001:29.0:1773851887.035722:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035723:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d58e8d07.
02000000:00000001:29.0:1773851887.035724:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035733:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000029870154.
02000000:00000001:29.0:1773851887.035734:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035736:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a47bef8c.
02000000:00000001:29.0:1773851887.035738:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035738:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fec70064.
02000000:00000001:29.0:1773851887.035739:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035740:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d74af74.
02000000:00000001:29.0:1773851887.035741:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035742:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000064e126d1.
02000000:00000001:29.0:1773851887.035743:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035744:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aec5d915.
02000000:00000001:29.0:1773851887.035745:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035746:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002f580909.
02000000:00000001:29.0:1773851887.035747:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035748:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c72e6b0b.
02000000:00000001:29.0:1773851887.035750:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035750:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c3fe837b.
02000000:00000001:29.0:1773851887.035751:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035752:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024f75470.
02000000:00000001:29.0:1773851887.035753:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035754:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009628fbc3.
02000000:00000001:29.0:1773851887.035755:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035756:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002758d9cb.
02000000:00000001:29.0:1773851887.035757:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035758:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000070fc3cd.
02000000:00000001:29.0:1773851887.035759:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035760:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036021913.
02000000:00000001:29.0:1773851887.035761:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035762:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000001c4ee78d.
02000000:00000001:29.0:1773851887.035763:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035764:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce89b5ac.
02000000:00000001:29.0:1773851887.035765:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035766:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000987fd341.
02000000:00000001:29.0:1773851887.035767:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035768:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006f5ab120.
02000000:00000001:29.0:1773851887.035769:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035770:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005c0f5777.
02000000:00000001:29.0:1773851887.035772:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035772:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d94ea2b6.
02000000:00000001:29.0:1773851887.035774:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035775:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d6ac5f50.
02000000:00000001:29.0:1773851887.035777:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035777:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b6bb712.
02000000:00000001:29.0:1773851887.035779:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035780:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000051a8ca66.
02000000:00000001:29.0:1773851887.035781:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035782:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000326c2620.
02000000:00000001:29.0:1773851887.035783:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035784:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cd40c2a6.
02000000:00000001:29.0:1773851887.035785:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035786:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cd232ef.
02000000:00000001:29.0:1773851887.035787:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035788:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d5e8a69.
02000000:00000001:29.0:1773851887.035789:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035790:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cd1f7a38.
02000000:00000001:29.0:1773851887.035791:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035791:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ddd3e934.
02000000:00000001:29.0:1773851887.035793:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035793:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056a2441c.
02000000:00000001:29.0:1773851887.035795:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035795:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000081d0475c.
02000000:00000001:29.0:1773851887.035797:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035797:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a1305173.
02000000:00000001:29.0:1773851887.035798:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035799:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a0a04aac.
02000000:00000001:29.0:1773851887.035800:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035801:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c6b1233.
02000000:00000001:29.0:1773851887.035802:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035803:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b4816a2e.
02000000:00000001:29.0:1773851887.035804:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035805:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000d3cf201.
02000000:00000001:29.0:1773851887.035806:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035807:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000212a158d.
02000000:00000001:29.0:1773851887.035808:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035808:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004025b7d6.
02000000:00000001:29.0:1773851887.035810:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035811:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000556cfb21.
02000000:00000001:29.0:1773851887.035812:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035813:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000051648e09.
02000000:00000001:29.0:1773851887.035814:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035815:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b9b39ca7.
02000000:00000001:29.0:1773851887.035816:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035816:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cafe43f0.
02000000:00000001:29.0:1773851887.035817:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035818:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000adfbb91d.
02000000:00000001:29.0:1773851887.035819:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035820:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cbca8ded.
02000000:00000001:29.0:1773851887.035821:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035822:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000a201730.
02000000:00000001:29.0:1773851887.035823:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035823:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000054126564.
02000000:00000001:29.0:1773851887.035824:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035825:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e403ff4a.
02000000:00000001:29.0:1773851887.035826:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035827:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc671a5d.
02000000:00000001:29.0:1773851887.035828:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035829:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cbe4fd89.
02000000:00000001:29.0:1773851887.035830:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035830:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d048ded3.
02000000:00000001:29.0:1773851887.035832:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035832:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c9dc6c8f.
02000000:00000001:29.0:1773851887.035834:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035834:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005646fa92.
00000100:00000010:29.0:1773851887.035836:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db51ab7d.
00000100:00000010:29.0:1773851887.035837:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7c34b0e.
02000000:00000001:29.0:1773851887.035839:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035840:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008afa9b81.
02000000:00000001:29.0:1773851887.035841:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035841:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6e4bdfd.
02000000:00000001:29.0:1773851887.035842:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035843:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fb251c55.
02000000:00000001:29.0:1773851887.035844:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035845:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac2bcf57.
02000000:00000001:29.0:1773851887.035846:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035847:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002d04dafe.
02000000:00000001:29.0:1773851887.035848:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035849:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002735c2f4.
02000000:00000001:29.0:1773851887.035850:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035851:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f2228f16.
02000000:00000001:29.0:1773851887.035853:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035853:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000670d6d05.
02000000:00000001:29.0:1773851887.035855:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035855:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000816b2eb1.
02000000:00000001:29.0:1773851887.035856:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035857:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017e601ea.
02000000:00000001:29.0:1773851887.035859:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035859:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b2917813.
02000000:00000001:29.0:1773851887.035860:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035861:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e6c7853b.
02000000:00000001:29.0:1773851887.035863:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035863:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000004c880fe.
02000000:00000001:29.0:1773851887.035865:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035866:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008bc5439b.
02000000:00000001:29.0:1773851887.035867:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035868:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005de69a70.
02000000:00000001:29.0:1773851887.035870:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035871:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000191fe6d1.
02000000:00000001:29.0:1773851887.035872:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035873:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 000000004b9042c0.
02000000:00000001:29.0:1773851887.035875:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035876:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000777adc3e.
02000000:00000001:29.0:1773851887.035877:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035878:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000ecddc45f.
02000000:00000001:29.0:1773851887.035880:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035880:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bf9ad5d5.
02000000:00000001:29.0:1773851887.035882:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035883:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007eafd9b8.
02000000:00000001:29.0:1773851887.035884:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035885:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dc9db7ff.
02000000:00000001:29.0:1773851887.035886:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035887:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e0539ee5.
02000000:00000001:29.0:1773851887.035888:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035889:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c75acb6b.
02000000:00000001:29.0:1773851887.035890:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035891:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000064988b78.
02000000:00000001:29.0:1773851887.035893:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035893:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b97a5aeb.
02000000:00000001:29.0:1773851887.035895:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035895:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dd805aaa.
02000000:00000001:29.0:1773851887.035897:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035897:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098900028.
02000000:00000001:29.0:1773851887.035899:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035900:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e02fd9ec.
02000000:00000001:29.0:1773851887.035901:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035902:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000914ae2d4.
02000000:00000001:29.0:1773851887.035903:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035904:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009800ebfd.
02000000:00000001:29.0:1773851887.035905:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035906:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000006a29682.
02000000:00000001:29.0:1773851887.035907:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035908:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b6b5b560.
02000000:00000001:29.0:1773851887.035909:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035910:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017fbeb73.
02000000:00000001:29.0:1773851887.035911:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035912:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000063510a5d.
02000000:00000001:29.0:1773851887.035913:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035914:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c711cd6f.
02000000:00000001:29.0:1773851887.035915:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035916:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000be551a72.
02000000:00000001:29.0:1773851887.035917:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035918:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a1a9a566.
02000000:00000001:29.0:1773851887.035919:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035920:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c8722205.
02000000:00000001:29.0:1773851887.035922:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035922:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000936ecf4a.
02000000:00000001:29.0:1773851887.035924:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035925:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fa1a88ff.
02000000:00000001:29.0:1773851887.035926:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035926:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000093201dd9.
02000000:00000001:29.0:1773851887.035928:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035929:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e2d3184.
02000000:00000001:29.0:1773851887.035930:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035931:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b986452b.
02000000:00000001:29.0:1773851887.035932:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035933:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000019f21369.
02000000:00000001:29.0:1773851887.035934:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035935:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001ba0dadc.
02000000:00000001:29.0:1773851887.035936:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035937:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ec0cbf1.
02000000:00000001:29.0:1773851887.035938:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035938:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b5326896.
02000000:00000001:29.0:1773851887.035940:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035941:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000011ceffa8.
02000000:00000001:29.0:1773851887.035942:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035943:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ab4e514.
02000000:00000001:29.0:1773851887.035944:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035945:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b75f00e9.
02000000:00000001:29.0:1773851887.035946:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035947:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8796be2.
02000000:00000001:29.0:1773851887.035948:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035949:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094dd242c.
02000000:00000001:29.0:1773851887.035950:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035951:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000537bc7a8.
02000000:00000001:29.0:1773851887.035953:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035953:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006219e456.
02000000:00000001:29.0:1773851887.035954:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035955:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000035e00feb.
02000000:00000001:29.0:1773851887.035956:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035957:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cde8e94d.
02000000:00000001:29.0:1773851887.035958:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035959:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000255e33b2.
02000000:00000001:29.0:1773851887.035960:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035961:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008f821f71.
02000000:00000001:29.0:1773851887.035962:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035963:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d53d0dac.
02000000:00000001:29.0:1773851887.035964:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035965:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000033ec7777.
02000000:00000001:29.0:1773851887.035966:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035967:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009bdd383f.
02000000:00000001:29.0:1773851887.035968:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035969:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f40c1c11.
02000000:00000001:29.0:1773851887.035970:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035971:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e614f210.
02000000:00000001:29.0:1773851887.035972:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035973:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000610be8f4.
02000000:00000001:29.0:1773851887.035974:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035975:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000027190374.
02000000:00000001:29.0:1773851887.035976:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035977:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b0e61195.
02000000:00000001:29.0:1773851887.035978:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035979:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000886aaedb.
02000000:00000001:29.0:1773851887.035981:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035981:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003da71132.
02000000:00000001:29.0:1773851887.035983:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035984:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a7d6694f.
02000000:00000001:29.0:1773851887.035985:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035986:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008bea9167.
02000000:00000001:29.0:1773851887.035987:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035988:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000057b6ff4b.
02000000:00000001:29.0:1773851887.035989:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035990:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000991d0222.
02000000:00000001:29.0:1773851887.035991:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035991:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a5edd29.
02000000:00000001:29.0:1773851887.035992:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035993:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cba0dd56.
02000000:00000001:29.0:1773851887.035994:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035995:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007e336437.
02000000:00000001:29.0:1773851887.035995:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035996:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ff9c282f.
02000000:00000001:29.0:1773851887.035997:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.035997:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006a089a9e.
02000000:00000001:29.0:1773851887.035998:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.035999:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c02ffa32.
02000000:00000001:29.0:1773851887.036000:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036000:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000be100114.
02000000:00000001:29.0:1773851887.036001:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036001:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000096f2f131.
02000000:00000001:29.0:1773851887.036002:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036003:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000071cdb8d9.
02000000:00000001:29.0:1773851887.036003:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036004:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000007f78e10.
02000000:00000001:29.0:1773851887.036005:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036005:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bc60dafd.
02000000:00000001:29.0:1773851887.036006:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036006:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006d6a4113.
02000000:00000001:29.0:1773851887.036007:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036008:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000070412908.
02000000:00000001:29.0:1773851887.036009:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036009:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002f7ef880.
02000000:00000001:29.0:1773851887.036010:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036011:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031d13996.
02000000:00000001:29.0:1773851887.036012:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036012:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003e51c632.
02000000:00000001:29.0:1773851887.036013:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036014:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c4e32f1.
02000000:00000001:29.0:1773851887.036015:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036015:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002dab5a88.
02000000:00000001:29.0:1773851887.036016:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036016:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fe4c7fac.
02000000:00000001:29.0:1773851887.036017:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036018:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008e120e03.
02000000:00000001:29.0:1773851887.036019:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036019:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007ff51363.
02000000:00000001:29.0:1773851887.036020:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036021:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007a84e649.
02000000:00000001:29.0:1773851887.036022:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036022:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000239feb56.
02000000:00000001:29.0:1773851887.036023:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036024:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027d0ea8e.
02000000:00000001:29.0:1773851887.036025:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036025:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f68b7de0.
02000000:00000001:29.0:1773851887.036026:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036027:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000096442e29.
02000000:00000001:29.0:1773851887.036028:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036028:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006712e5ee.
02000000:00000001:29.0:1773851887.036029:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036030:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000038ced6e0.
02000000:00000001:29.0:1773851887.036031:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036031:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008205daca.
02000000:00000001:29.0:1773851887.036033:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036033:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004dd208bf.
02000000:00000001:29.0:1773851887.036034:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036034:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009b6427db.
02000000:00000001:29.0:1773851887.036035:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036036:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009e839de5.
02000000:00000001:29.0:1773851887.036036:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036037:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000075280634.
02000000:00000001:29.0:1773851887.036038:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036039:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb4833c0.
02000000:00000001:29.0:1773851887.036040:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036040:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000266d0e28.
02000000:00000001:29.0:1773851887.036041:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036042:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003f7f1533.
02000000:00000001:29.0:1773851887.036042:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036043:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e834d44.
02000000:00000001:29.0:1773851887.036044:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036044:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001bb332fd.
02000000:00000001:29.0:1773851887.036045:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036045:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c92a3098.
02000000:00000001:29.0:1773851887.036047:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036047:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ef700c84.
02000000:00000001:29.0:1773851887.036048:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036048:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002f86f66c.
02000000:00000001:29.0:1773851887.036049:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036050:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bad0b432.
02000000:00000001:29.0:1773851887.036050:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036051:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b9c39cc0.
02000000:00000001:29.0:1773851887.036052:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036052:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004039a294.
02000000:00000001:29.0:1773851887.036053:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036053:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b3126308.
02000000:00000001:29.0:1773851887.036054:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036055:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006f4bd501.
02000000:00000001:29.0:1773851887.036055:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036056:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fbc24f67.
02000000:00000001:29.0:1773851887.036057:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036058:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000071c8ac30.
02000000:00000001:29.0:1773851887.036059:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036059:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b5c8e200.
02000000:00000001:29.0:1773851887.036061:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036061:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003707e116.
02000000:00000001:29.0:1773851887.036062:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036062:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fd73c786.
02000000:00000001:29.0:1773851887.036063:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036063:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004efbcbad.
02000000:00000001:29.0:1773851887.036064:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036064:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000039acc666.
02000000:00000001:29.0:1773851887.036066:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036066:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000008c56d60f.
02000000:00000001:29.0:1773851887.036067:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036067:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000067fab2df.
02000000:00000001:29.0:1773851887.036068:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036069:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000031569ba6.
02000000:00000001:29.0:1773851887.036069:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036070:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000da82784c.
02000000:00000001:29.0:1773851887.036071:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036071:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005789cf78.
02000000:00000001:29.0:1773851887.036071:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036072:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009175c45.
02000000:00000001:29.0:1773851887.036072:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036073:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000164e542d.
02000000:00000001:29.0:1773851887.036073:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036074:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f0ae1022.
02000000:00000001:29.0:1773851887.036075:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036075:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000677a4d2a.
02000000:00000001:29.0:1773851887.036076:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036076:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f2b51d9.
02000000:00000001:29.0:1773851887.036077:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036077:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000091e9f102.
02000000:00000001:29.0:1773851887.036078:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036078:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ce5fc80.
02000000:00000001:29.0:1773851887.036079:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036079:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a0859ac.
02000000:00000001:29.0:1773851887.036080:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036080:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002e8d95e3.
02000000:00000001:29.0:1773851887.036081:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036082:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000011e8acc2.
02000000:00000001:29.0:1773851887.036082:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036083:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006c2a7afb.
02000000:00000001:29.0:1773851887.036083:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036084:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000400d06f.
02000000:00000001:29.0:1773851887.036085:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036085:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000062d2bab1.
02000000:00000001:29.0:1773851887.036086:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036086:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000035806851.
02000000:00000001:29.0:1773851887.036086:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036087:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000072b3a0e9.
02000000:00000001:29.0:1773851887.036088:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036088:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fd40c1c1.
02000000:00000001:29.0:1773851887.036089:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036089:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a5d12044.
02000000:00000001:29.0:1773851887.036090:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036090:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000001325898.
02000000:00000001:29.0:1773851887.036091:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036091:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000631f28e3.
02000000:00000001:29.0:1773851887.036092:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036092:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009fffbeee.
02000000:00000001:29.0:1773851887.036093:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036093:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006228d592.
02000000:00000001:29.0:1773851887.036094:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036094:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000112afdcd.
02000000:00000001:29.0:1773851887.036095:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036095:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000581e392c.
02000000:00000001:29.0:1773851887.036096:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036096:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000978f6c91.
02000000:00000001:29.0:1773851887.036097:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036097:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025fc0341.
02000000:00000001:29.0:1773851887.036098:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036099:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000864a185f.
02000000:00000001:29.0:1773851887.036099:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036100:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb266bd5.
02000000:00000001:29.0:1773851887.036101:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036102:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000016f7159a.
02000000:00000001:29.0:1773851887.036102:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036103:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e56693e8.
02000000:00000001:29.0:1773851887.036104:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036104:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e6637f33.
02000000:00000001:29.0:1773851887.036105:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036105:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a102734.
02000000:00000001:29.0:1773851887.036106:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036107:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001d0ac19a.
02000000:00000001:29.0:1773851887.036107:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036108:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003f564a70.
02000000:00000001:29.0:1773851887.036109:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036109:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000098c02440.
02000000:00000001:29.0:1773851887.036110:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036110:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c96c661b.
02000000:00000001:29.0:1773851887.036111:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036111:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cebeed65.
02000000:00000001:29.0:1773851887.036112:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036113:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059555dd7.
02000000:00000001:29.0:1773851887.036114:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036114:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000999357b2.
02000000:00000001:29.0:1773851887.036115:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036115:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6e5cf9f.
02000000:00000001:29.0:1773851887.036116:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036116:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ccfe3b13.
02000000:00000001:29.0:1773851887.036117:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036117:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000859e544c.
02000000:00000001:29.0:1773851887.036118:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036119:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000011a9fdc.
02000000:00000001:29.0:1773851887.036120:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036120:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061d9e81b.
02000000:00000001:29.0:1773851887.036121:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036121:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000087161a8d.
02000000:00000001:29.0:1773851887.036122:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036122:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006073d2e6.
02000000:00000001:29.0:1773851887.036123:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036124:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000fee61c7.
02000000:00000001:29.0:1773851887.036125:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036125:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c91fde6c.
02000000:00000001:29.0:1773851887.036126:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036126:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008d89d2d6.
02000000:00000001:29.0:1773851887.036127:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036127:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e8679e9.
02000000:00000001:29.0:1773851887.036128:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036128:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000de078ed7.
02000000:00000001:29.0:1773851887.036129:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036129:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005008d49e.
02000000:00000001:29.0:1773851887.036130:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036131:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ecb6758e.
02000000:00000001:29.0:1773851887.036131:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036132:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000b9280a9.
02000000:00000001:29.0:1773851887.036133:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036133:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027bfe829.
02000000:00000001:29.0:1773851887.036134:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036134:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003227ae4f.
02000000:00000001:29.0:1773851887.036135:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036135:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006bdbe32b.
02000000:00000001:29.0:1773851887.036136:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036136:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f3174169.
02000000:00000001:29.0:1773851887.036137:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036137:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fdbf7af9.
02000000:00000001:29.0:1773851887.036138:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036139:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e98ddb88.
02000000:00000001:29.0:1773851887.036139:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036140:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002b2b288c.
02000000:00000001:29.0:1773851887.036141:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036141:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000052bbb658.
02000000:00000001:29.0:1773851887.036142:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036143:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ee0a5731.
02000000:00000001:29.0:1773851887.036143:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036144:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000333a770f.
02000000:00000001:29.0:1773851887.036144:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036145:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b4d0dadc.
02000000:00000001:29.0:1773851887.036145:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036146:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b02b7eac.
02000000:00000001:29.0:1773851887.036146:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036147:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000469fd6f2.
02000000:00000001:29.0:1773851887.036147:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036148:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b77f0418.
02000000:00000001:29.0:1773851887.036149:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036149:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e3833868.
02000000:00000001:29.0:1773851887.036150:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036150:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000a0af893.
02000000:00000001:29.0:1773851887.036151:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036151:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fcf0c450.
02000000:00000001:29.0:1773851887.036152:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036152:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001be7d0f3.
02000000:00000001:29.0:1773851887.036153:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036154:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000be7d031e.
02000000:00000001:29.0:1773851887.036154:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036155:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac32f532.
02000000:00000001:29.0:1773851887.036155:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036156:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e55bd85a.
02000000:00000001:29.0:1773851887.036157:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036157:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001fc632f5.
02000000:00000001:29.0:1773851887.036158:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036158:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027e9d8b2.
02000000:00000001:29.0:1773851887.036159:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036159:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000800e4a67.
02000000:00000001:29.0:1773851887.036160:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036161:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000038d10a0.
02000000:00000001:29.0:1773851887.036161:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036162:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d76dfae.
02000000:00000001:29.0:1773851887.036163:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036163:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000f9762b2e.
02000000:00000001:29.0:1773851887.036165:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036165:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000098695b81.
02000000:00000001:29.0:1773851887.036166:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036166:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002b8a7c83.
02000000:00000001:29.0:1773851887.036167:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036167:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e777104.
02000000:00000001:29.0:1773851887.036168:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036169:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000dbc44ecd.
02000000:00000001:29.0:1773851887.036169:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036170:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003016f5d7.
00000100:00000010:29.0:1773851887.036170:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3a3e828.
02000000:00000001:29.0:1773851887.036171:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036172:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003570bdc3.
02000000:00000001:29.0:1773851887.036172:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036173:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002572f840.
02000000:00000001:29.0:1773851887.036174:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036174:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000694077e0.
02000000:00000001:29.0:1773851887.036175:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036175:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b6df0ba4.
02000000:00000001:29.0:1773851887.036176:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036177:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000008a89284.
02000000:00000001:29.0:1773851887.036177:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036178:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005a9a713e.
02000000:00000001:29.0:1773851887.036179:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036179:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000104401bc.
02000000:00000001:29.0:1773851887.036180:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036180:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae182973.
02000000:00000001:29.0:1773851887.036181:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036182:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003c7af487.
02000000:00000001:29.0:1773851887.036182:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036183:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000231b9a75.
02000000:00000001:29.0:1773851887.036183:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036184:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fbf0c978.
02000000:00000001:29.0:1773851887.036184:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036185:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000abef47a3.
02000000:00000001:29.0:1773851887.036186:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036186:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ebdfd257.
02000000:00000001:29.0:1773851887.036187:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036187:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000061ce9c3c.
02000000:00000001:29.0:1773851887.036188:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036189:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cf7789c8.
02000000:00000001:29.0:1773851887.036189:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036190:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b4aeb287.
02000000:00000001:29.0:1773851887.036191:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036191:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000eba059e.
02000000:00000001:29.0:1773851887.036192:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036192:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c520bc95.
02000000:00000001:29.0:1773851887.036193:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036194:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e7de554c.
02000000:00000001:29.0:1773851887.036195:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036195:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000039037949.
02000000:00000001:29.0:1773851887.036196:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036196:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000045b36511.
02000000:00000001:29.0:1773851887.036197:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036198:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f7da1dc8.
02000000:00000001:29.0:1773851887.036199:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036199:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b19d5fb4.
02000000:00000001:29.0:1773851887.036200:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036200:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d1ef439f.
02000000:00000001:29.0:1773851887.036201:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036202:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b148a505.
02000000:00000001:29.0:1773851887.036202:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036203:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007bf22880.
02000000:00000001:29.0:1773851887.036203:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036204:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000773750f9.
02000000:00000001:29.0:1773851887.036205:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036205:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004c1d9eea.
02000000:00000001:29.0:1773851887.036206:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036207:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009576bba0.
02000000:00000001:29.0:1773851887.036208:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036208:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dac2ea56.
02000000:00000001:29.0:1773851887.036209:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036209:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000079d0fcdf.
02000000:00000001:29.0:1773851887.036210:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036211:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000019c0888.
02000000:00000001:29.0:1773851887.036212:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036212:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f80dd66b.
02000000:00000001:29.0:1773851887.036213:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036214:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005c12c8de.
02000000:00000001:29.0:1773851887.036215:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036215:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 5600 at 00000000ecb9204a.
02000000:00000001:29.0:1773851887.036216:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036217:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4a74fbc.
02000000:00000001:29.0:1773851887.036218:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036218:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007424aff7.
02000000:00000001:29.0:1773851887.036219:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036219:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eedb6844.
02000000:00000001:29.0:1773851887.036220:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036221:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000665ad029.
02000000:00000001:29.0:1773851887.036221:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036222:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006f654f39.
02000000:00000001:29.0:1773851887.036223:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036223:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e7970cbe.
02000000:00000001:29.0:1773851887.036224:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036225:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000046845db1.
00000100:00000010:29.0:1773851887.036225:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b15e009a.
00000100:00000010:29.0:1773851887.036226:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b33d3a7e.
02000000:00000001:29.0:1773851887.036227:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036228:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003eda30a8.
02000000:00000001:29.0:1773851887.036228:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036229:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eae48f83.
02000000:00000001:29.0:1773851887.036230:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036230:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000ccf064d.
02000000:00000001:29.0:1773851887.036231:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036231:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000abf2898c.
02000000:00000001:29.0:1773851887.036232:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036233:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009b44b1ae.
02000000:00000001:29.0:1773851887.036233:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036234:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000060dc0a3e.
02000000:00000001:29.0:1773851887.036234:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036235:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b1ca8081.
02000000:00000001:29.0:1773851887.036236:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036236:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006d72e1a9.
02000000:00000001:29.0:1773851887.036237:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036238:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003f3deefd.
02000000:00000001:29.0:1773851887.036238:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036239:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000720bfc57.
02000000:00000001:29.0:1773851887.036240:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036240:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004b613d45.
02000000:00000001:29.0:1773851887.036241:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036243:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007dfdb61.
02000000:00000001:29.0:1773851887.036244:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036245:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000341a55fd.
02000000:00000001:29.0:1773851887.036245:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036246:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001c2dcadb.
00000100:00000010:29.0:1773851887.036247:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002da92120.
02000000:00000001:29.0:1773851887.036248:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036248:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000067b7e858.
02000000:00000001:29.0:1773851887.036249:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036250:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a3763be.
02000000:00000001:29.0:1773851887.036251:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036251:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000024ccbf69.
02000000:00000001:29.0:1773851887.036251:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036252:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000ef13acb.
02000000:00000001:29.0:1773851887.036253:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036253:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008fcd5079.
02000000:00000001:29.0:1773851887.036254:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036254:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007e5c3d48.
02000000:00000001:29.0:1773851887.036255:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036256:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad015ddf.
02000000:00000001:29.0:1773851887.036256:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036257:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000032e1e294.
02000000:00000001:29.0:1773851887.036258:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036258:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008ff63259.
02000000:00000001:29.0:1773851887.036259:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036259:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005f0e83de.
02000000:00000001:29.0:1773851887.036261:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036261:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a38d3df0.
02000000:00000001:29.0:1773851887.036262:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036262:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000988f797d.
02000000:00000001:29.0:1773851887.036263:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036264:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006332ee28.
02000000:00000001:29.0:1773851887.036265:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036265:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000075345bb1.
02000000:00000001:29.0:1773851887.036266:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036267:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad2e58fc.
02000000:00000001:29.0:1773851887.036267:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036268:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bda4032c.
02000000:00000001:29.0:1773851887.036269:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036269:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b6a6aaa3.
02000000:00000001:29.0:1773851887.036270:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036271:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a2deac76.
02000000:00000001:29.0:1773851887.036272:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036272:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000fa7a201.
02000000:00000001:29.0:1773851887.036273:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036273:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000446fa88d.
02000000:00000001:29.0:1773851887.036275:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036275:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012e84c3d.
02000000:00000001:29.0:1773851887.036276:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036276:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000106c7788.
02000000:00000001:29.0:1773851887.036277:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036278:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008c4d5aa9.
02000000:00000001:29.0:1773851887.036278:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036279:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad116d4c.
02000000:00000001:29.0:1773851887.036280:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036280:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005a1a83aa.
02000000:00000001:29.0:1773851887.036281:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036282:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007c943e6.
02000000:00000001:29.0:1773851887.036282:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036283:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003d638e90.
02000000:00000001:29.0:1773851887.036284:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036284:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009c0d324.
02000000:00000001:29.0:1773851887.036285:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036285:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000095c972be.
02000000:00000001:29.0:1773851887.036286:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036287:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000e22ad56.
02000000:00000001:29.0:1773851887.036288:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036288:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006fd29e11.
02000000:00000001:29.0:1773851887.036289:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036290:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000075e2ae.
02000000:00000001:29.0:1773851887.036291:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036291:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009c9cce24.
02000000:00000001:29.0:1773851887.036292:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036292:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c9aa0dc7.
02000000:00000001:29.0:1773851887.036293:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036293:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007647f8f7.
02000000:00000001:29.0:1773851887.036295:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036295:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000029da6e44.
02000000:00000001:29.0:1773851887.036297:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036297:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d627d364.
02000000:00000001:29.0:1773851887.036298:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036298:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009175e083.
02000000:00000001:29.0:1773851887.036299:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036299:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006dbbb910.
02000000:00000001:29.0:1773851887.036300:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036300:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae585415.
02000000:00000001:29.0:1773851887.036301:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036302:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002b8cfade.
02000000:00000001:29.0:1773851887.036302:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036303:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004e8e432a.
02000000:00000001:29.0:1773851887.036304:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036305:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c493fe77.
02000000:00000001:29.0:1773851887.036305:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036306:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007149e05f.
02000000:00000001:29.0:1773851887.036307:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036307:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000053ef9295.
02000000:00000001:29.0:1773851887.036308:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036308:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004935895a.
02000000:00000001:29.0:1773851887.036309:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036310:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e1e6fe0d.
02000000:00000001:29.0:1773851887.036311:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036311:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000513a44a4.
02000000:00000001:29.0:1773851887.036312:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036312:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000004dd75b21.
02000000:00000001:29.0:1773851887.036313:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036314:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086b555e4.
02000000:00000001:29.0:1773851887.036315:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036315:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005432cd12.
02000000:00000001:29.0:1773851887.036315:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036316:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000881ff58b.
02000000:00000001:29.0:1773851887.036317:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036317:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ebce1a2e.
02000000:00000001:29.0:1773851887.036318:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036318:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000060fbe85c.
02000000:00000001:29.0:1773851887.036319:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036320:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000b6b05afd.
02000000:00000001:29.0:1773851887.036321:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036321:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b0f2cc97.
02000000:00000001:29.0:1773851887.036322:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036322:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000083d89800.
02000000:00000001:29.0:1773851887.036323:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036323:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a2e4c449.
02000000:00000001:29.0:1773851887.036324:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036325:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f077b4de.
02000000:00000001:29.0:1773851887.036326:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036326:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007fccf737.
02000000:00000001:29.0:1773851887.036327:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036327:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000052f8924c.
02000000:00000001:29.0:1773851887.036328:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036328:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000044217918.
02000000:00000001:29.0:1773851887.036329:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036330:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000de07c84c.
02000000:00000001:29.0:1773851887.036330:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036331:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c8e68d6.
02000000:00000001:29.0:1773851887.036332:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036332:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000650e48fe.
02000000:00000001:29.0:1773851887.036333:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036333:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bdd23aba.
02000000:00000001:29.0:1773851887.036334:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036335:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a4a078a3.
02000000:00000001:29.0:1773851887.036335:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036336:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aea9ea08.
02000000:00000001:29.0:1773851887.036337:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036337:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad724e4d.
02000000:00000001:29.0:1773851887.036338:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036338:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005bf44609.
02000000:00000001:29.0:1773851887.036339:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036340:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000001618fbbf.
02000000:00000001:29.0:1773851887.036341:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036341:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c9964da8.
02000000:00000001:29.0:1773851887.036342:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036342:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000078053822.
02000000:00000001:29.0:1773851887.036343:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036343:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008c711d61.
02000000:00000001:29.0:1773851887.036345:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036345:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007877e9cd.
02000000:00000001:29.0:1773851887.036346:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036346:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e11655bc.
02000000:00000001:29.0:1773851887.036347:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036347:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000065d111fe.
02000000:00000001:29.0:1773851887.036348:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036349:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004778bde7.
02000000:00000001:29.0:1773851887.036349:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036350:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001df9bf38.
02000000:00000001:29.0:1773851887.036351:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036351:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c95ac314.
02000000:00000001:29.0:1773851887.036352:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036353:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ae6bbd1e.
02000000:00000001:29.0:1773851887.036353:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036354:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006606009d.
02000000:00000001:29.0:1773851887.036354:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036355:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000083519f2d.
02000000:00000001:29.0:1773851887.036355:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036356:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000050dc4ae8.
00000100:00000010:29.0:1773851887.036357:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000804d032c.
02000000:00000001:29.0:1773851887.036358:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036358:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002ea6482c.
02000000:00000001:29.0:1773851887.036359:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036360:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5023770.
02000000:00000001:29.0:1773851887.036360:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036361:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006ed3b313.
02000000:00000001:29.0:1773851887.036362:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036362:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000909b6575.
02000000:00000001:29.0:1773851887.036363:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036363:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000008de5cd1.
02000000:00000001:29.0:1773851887.036364:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036364:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a79925a.
02000000:00000001:29.0:1773851887.036365:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036366:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007dbeb200.
02000000:00000001:29.0:1773851887.036366:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036367:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec98fb84.
02000000:00000001:29.0:1773851887.036368:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036368:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000cbd6904e.
02000000:00000001:29.0:1773851887.036369:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036370:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004f9c6441.
02000000:00000001:29.0:1773851887.036371:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036371:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c4f0577e.
02000000:00000001:29.0:1773851887.036372:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036372:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de94d7a3.
00000100:00000010:29.0:1773851887.036373:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001e5e31f3.
02000000:00000001:29.0:1773851887.036374:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036374:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000000da0ebb8.
02000000:00000001:29.0:1773851887.036375:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036376:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000058079bbf.
02000000:00000001:29.0:1773851887.036377:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036377:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000ac2fe0fa.
02000000:00000001:29.0:1773851887.036378:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036378:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036bce3cc.
02000000:00000001:29.0:1773851887.036379:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036379:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007af973a9.
02000000:00000001:29.0:1773851887.036380:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036381:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000095fde1b7.
02000000:00000001:29.0:1773851887.036382:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036382:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000aae44987.
02000000:00000001:29.0:1773851887.036383:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036383:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e54efa63.
02000000:00000001:29.0:1773851887.036384:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036384:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000423d54ff.
02000000:00000001:29.0:1773851887.036385:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036385:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004bd8acd0.
02000000:00000001:29.0:1773851887.036386:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036387:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000707f835a.
02000000:00000001:29.0:1773851887.036387:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036388:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002100fb5e.
02000000:00000001:29.0:1773851887.036389:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036389:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006392c63e.
02000000:00000001:29.0:1773851887.036390:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036390:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e516e10f.
02000000:00000001:29.0:1773851887.036391:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036392:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ccb6addf.
02000000:00000001:29.0:1773851887.036392:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036393:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b59bf18e.
02000000:00000001:29.0:1773851887.036394:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036394:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000057a12859.
02000000:00000001:29.0:1773851887.036395:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036395:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db416e28.
02000000:00000001:29.0:1773851887.036396:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036396:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f029511a.
02000000:00000001:29.0:1773851887.036397:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036398:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000063ec0703.
02000000:00000001:29.0:1773851887.036398:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036399:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000049bbe91b.
02000000:00000001:29.0:1773851887.036399:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036400:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000049be8300.
02000000:00000001:29.0:1773851887.036400:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036401:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003ac8adba.
02000000:00000001:29.0:1773851887.036401:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036402:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc8f75d4.
02000000:00000001:29.0:1773851887.036403:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036403:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000035de4ac2.
02000000:00000001:29.0:1773851887.036404:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036405:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aedee83e.
02000000:00000001:29.0:1773851887.036406:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036406:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b001ac16.
02000000:00000001:29.0:1773851887.036407:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036408:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e46ef854.
02000000:00000001:29.0:1773851887.036409:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036410:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b414ceed.
02000000:00000001:29.0:1773851887.036410:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036411:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e4468870.
02000000:00000001:29.0:1773851887.036411:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036412:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000862868e1.
02000000:00000001:29.0:1773851887.036413:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036413:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000071e5e01.
02000000:00000001:29.0:1773851887.036414:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036414:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000af5df419.
02000000:00000001:29.0:1773851887.036415:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036415:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b17c63b.
02000000:00000001:29.0:1773851887.036416:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036417:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f3850c6e.
02000000:00000001:29.0:1773851887.036418:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036418:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b8119522.
02000000:00000001:29.0:1773851887.036419:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036419:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000002205f6.
02000000:00000001:29.0:1773851887.036420:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036421:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000284fbcad.
02000000:00000001:29.0:1773851887.036422:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036422:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000d980d36c.
02000000:00000001:29.0:1773851887.036423:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036423:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005c6f2f4c.
02000000:00000001:29.0:1773851887.036424:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036425:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000009b93f0b.
02000000:00000001:29.0:1773851887.036426:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036426:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002601a108.
02000000:00000001:29.0:1773851887.036427:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036427:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000db4168b4.
02000000:00000001:29.0:1773851887.036428:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036428:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001ab0dea0.
02000000:00000001:29.0:1773851887.036430:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036430:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000069ae7cc9.
02000000:00000001:29.0:1773851887.036431:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036432:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001d4a79e8.
02000000:00000001:29.0:1773851887.036432:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036433:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000000101968d.
02000000:00000001:29.0:1773851887.036434:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036434:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008ceca3f5.
02000000:00000001:29.0:1773851887.036435:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036436:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c9241e10.
02000000:00000001:29.0:1773851887.036436:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036437:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f407d93c.
02000000:00000001:29.0:1773851887.036437:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036438:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000009fec5849.
02000000:00000001:29.0:1773851887.036439:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036439:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f7000f06.
02000000:00000001:29.0:1773851887.036440:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036441:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000b3e20348.
02000000:00000001:29.0:1773851887.036441:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036442:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000be6922d.
02000000:00000001:29.0:1773851887.036443:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036443:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 00000000f19261b0.
02000000:00000001:29.0:1773851887.036444:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036444:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e49c09bb.
02000000:00000001:29.0:1773851887.036445:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036445:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000005b7441f0.
02000000:00000001:29.0:1773851887.036446:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036447:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad8a2639.
02000000:00000001:29.0:1773851887.036448:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036448:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000086bf6b0b.
02000000:00000001:29.0:1773851887.036449:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036449:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a76ccd94.
02000000:00000001:29.0:1773851887.036450:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036450:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000005ac9c114.
02000000:00000001:29.0:1773851887.036451:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036451:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d32b7aa9.
02000000:00000001:29.0:1773851887.036452:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036452:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ba84396b.
02000000:00000001:29.0:1773851887.036453:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036453:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000286fc37.
02000000:00000001:29.0:1773851887.036455:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036455:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 000000000483a8ad.
02000000:00000001:29.0:1773851887.036456:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036457:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ae3b834e.
02000000:00000001:29.0:1773851887.036458:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036458:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000bf1a19e.
02000000:00000001:29.0:1773851887.036459:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036459:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002c01c5b5.
02000000:00000001:29.0:1773851887.036460:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036461:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ba331b61.
02000000:00000001:29.0:1773851887.036462:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036462:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000be59da23.
02000000:00000001:29.0:1773851887.036463:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036464:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 0000000078432228.
02000000:00000001:29.0:1773851887.036465:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036465:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002128bab1.
02000000:00000001:29.0:1773851887.036466:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036467:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb37cdcf.
02000000:00000001:29.0:1773851887.036467:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036468:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002b4cbee0.
02000000:00000001:29.0:1773851887.036469:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036469:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ff1efc8c.
02000000:00000001:29.0:1773851887.036470:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036471:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cdb5275e.
02000000:00000001:29.0:1773851887.036472:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036472:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce77d84d.
02000000:00000001:29.0:1773851887.036473:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036473:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000078720678.
02000000:00000001:29.0:1773851887.036474:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036474:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000028b485d3.
02000000:00000001:29.0:1773851887.036475:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036475:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c323b8c1.
02000000:00000001:29.0:1773851887.036477:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036477:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004d68d812.
02000000:00000001:29.0:1773851887.036478:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036478:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cff7f56.
02000000:00000001:29.0:1773851887.036479:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036479:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 000000003c53ea39.
02000000:00000001:29.0:1773851887.036480:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036481:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019ab354f.
02000000:00000001:29.0:1773851887.036481:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036482:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d4d2227.
02000000:00000001:29.0:1773851887.036483:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036483:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002cef8273.
02000000:00000001:29.0:1773851887.036484:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036484:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000917f8ed1.
02000000:00000001:29.0:1773851887.036485:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036485:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004057097c.
02000000:00000001:29.0:1773851887.036486:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036487:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e52f3139.
02000000:00000001:29.0:1773851887.036487:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036488:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000040481d4e.
02000000:00000001:29.0:1773851887.036489:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036489:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030e96984.
02000000:00000001:29.0:1773851887.036490:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036490:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b4fba57f.
02000000:00000001:29.0:1773851887.036491:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036491:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bf43391e.
02000000:00000001:29.0:1773851887.036492:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036492:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bfa89351.
02000000:00000001:29.0:1773851887.036493:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036493:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d52b50ee.
02000000:00000001:29.0:1773851887.036494:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036494:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009119cece.
02000000:00000001:29.0:1773851887.036495:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036495:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007d5c3c24.
02000000:00000001:29.0:1773851887.036496:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036496:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c1096acb.
02000000:00000001:29.0:1773851887.036497:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036497:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084128b6d.
02000000:00000001:29.0:1773851887.036498:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036498:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b4226ad5.
02000000:00000001:29.0:1773851887.036499:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036499:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bc0d26e4.
02000000:00000001:29.0:1773851887.036500:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036500:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000977d25b1.
02000000:00000001:29.0:1773851887.036501:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036502:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000892748a5.
02000000:00000001:29.0:1773851887.036503:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036503:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009970af64.
02000000:00000001:29.0:1773851887.036504:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036504:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000001d03e24.
02000000:00000001:29.0:1773851887.036505:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036505:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ccaabefa.
02000000:00000001:29.0:1773851887.036506:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036506:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e518eaab.
02000000:00000001:29.0:1773851887.036507:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036508:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000af6111bf.
02000000:00000001:29.0:1773851887.036509:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036509:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000030e6f4e.
02000000:00000001:29.0:1773851887.036510:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036511:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d25fe682.
02000000:00000001:29.0:1773851887.036511:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036512:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000089f7281c.
02000000:00000001:29.0:1773851887.036512:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036513:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056bf7b74.
02000000:00000001:29.0:1773851887.036514:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036514:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007026f420.
02000000:00000001:29.0:1773851887.036515:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036515:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a9c3d0a0.
02000000:00000001:29.0:1773851887.036516:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036516:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008c3321cc.
02000000:00000001:29.0:1773851887.036517:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036517:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086b14f2a.
02000000:00000001:29.0:1773851887.036518:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036518:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bfb9ea0b.
02000000:00000001:29.0:1773851887.036519:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036519:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000507c500c.
02000000:00000001:29.0:1773851887.036520:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036521:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001c6b205a.
02000000:00000001:29.0:1773851887.036521:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036522:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006386a200.
02000000:00000001:29.0:1773851887.036523:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036523:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007c5e32ee.
02000000:00000001:29.0:1773851887.036524:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036524:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000674ed1e8.
02000000:00000001:29.0:1773851887.036525:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036526:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a9ac5929.
02000000:00000001:29.0:1773851887.036527:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036527:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000064082fc6.
02000000:00000001:29.0:1773851887.036528:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036528:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002c3c9921.
02000000:00000001:29.0:1773851887.036529:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036529:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005fe3475c.
02000000:00000001:29.0:1773851887.036530:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036531:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b9a027d4.
02000000:00000001:29.0:1773851887.036532:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036532:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d3ad7bff.
02000000:00000001:29.0:1773851887.036533:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036533:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a8d36278.
02000000:00000001:29.0:1773851887.036534:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036534:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000014f69e28.
02000000:00000001:29.0:1773851887.036535:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036536:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ae3e602a.
02000000:00000001:29.0:1773851887.036536:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036537:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000979f45eb.
02000000:00000001:29.0:1773851887.036538:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036538:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003ea081c9.
02000000:00000001:29.0:1773851887.036539:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036539:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017a02798.
02000000:00000001:29.0:1773851887.036540:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036540:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000e04ae69.
02000000:00000001:29.0:1773851887.036541:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036541:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cd0eff8c.
02000000:00000001:29.0:1773851887.036543:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036543:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005b64a2a1.
02000000:00000001:29.0:1773851887.036544:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036544:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d264c130.
02000000:00000001:29.0:1773851887.036545:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036545:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a074b4ad.
02000000:00000001:29.0:1773851887.036546:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036546:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000038de65ed.
02000000:00000001:29.0:1773851887.036548:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036548:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c73fe70b.
02000000:00000001:29.0:1773851887.036549:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036549:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b85f2a21.
02000000:00000001:29.0:1773851887.036550:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036550:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000041ec1ba.
02000000:00000001:29.0:1773851887.036551:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036551:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a93c38b1.
02000000:00000001:29.0:1773851887.036552:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036553:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008134b88f.
02000000:00000001:29.0:1773851887.036553:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036554:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007e619b3e.
02000000:00000001:29.0:1773851887.036555:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036555:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005ccdc1be.
02000000:00000001:29.0:1773851887.036557:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036557:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000687f4131.
02000000:00000001:29.0:1773851887.036558:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036558:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eb86f871.
02000000:00000001:29.0:1773851887.036559:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036559:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000de2e42db.
02000000:00000001:29.0:1773851887.036560:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036561:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000891a21f0.
02000000:00000001:29.0:1773851887.036562:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036562:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e9dc0a76.
02000000:00000001:29.0:1773851887.036563:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036564:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006af08dd2.
02000000:00000001:29.0:1773851887.036564:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036565:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a37a49fc.
02000000:00000001:29.0:1773851887.036565:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036566:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e1eb0e4b.
02000000:00000001:29.0:1773851887.036567:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036567:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000074f0ff4f.
02000000:00000001:29.0:1773851887.036568:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036569:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000042a220ff.
02000000:00000001:29.0:1773851887.036569:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036570:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a995dfc.
02000000:00000001:29.0:1773851887.036571:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036571:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009eb63909.
02000000:00000001:29.0:1773851887.036572:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036572:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000078131de.
02000000:00000001:29.0:1773851887.036573:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036574:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ddab2029.
02000000:00000001:29.0:1773851887.036574:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036575:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000528f4588.
02000000:00000001:29.0:1773851887.036576:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036576:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bbd4e363.
02000000:00000001:29.0:1773851887.036577:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036577:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000732d27b2.
02000000:00000001:29.0:1773851887.036578:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036579:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000003d6b3ca.
02000000:00000001:29.0:1773851887.036579:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036580:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a77ffc9.
02000000:00000001:29.0:1773851887.036581:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036581:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a72fd66.
02000000:00000001:29.0:1773851887.036582:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036583:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000078183244.
02000000:00000001:29.0:1773851887.036583:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036584:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c71773a1.
02000000:00000001:29.0:1773851887.036584:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036585:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f8aaf43e.
02000000:00000001:29.0:1773851887.036586:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036586:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000060768ac3.
02000000:00000001:29.0:1773851887.036588:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036588:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000da757aff.
02000000:00000001:29.0:1773851887.036589:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036590:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000091394c0b.
02000000:00000001:29.0:1773851887.036590:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036591:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ccb2ae7e.
02000000:00000001:29.0:1773851887.036592:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036592:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000038aa0f55.
02000000:00000001:29.0:1773851887.036593:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036593:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002dd7d3a8.
02000000:00000001:29.0:1773851887.036594:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036595:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000053efa73b.
02000000:00000001:29.0:1773851887.036595:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036596:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e697ba6d.
02000000:00000001:29.0:1773851887.036597:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036597:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d600e7a7.
02000000:00000001:29.0:1773851887.036598:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036598:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000029fb77e.
02000000:00000001:29.0:1773851887.036599:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036600:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000074739df2.
02000000:00000001:29.0:1773851887.036600:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036601:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f06301f4.
02000000:00000001:29.0:1773851887.036602:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036603:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad7c9ab7.
02000000:00000001:29.0:1773851887.036603:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036604:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000079480601.
02000000:00000001:29.0:1773851887.036605:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036605:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005979d700.
02000000:00000001:29.0:1773851887.036606:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036607:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000748efe04.
02000000:00000001:29.0:1773851887.036608:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036608:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084886a11.
02000000:00000001:29.0:1773851887.036609:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036609:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000043b9ebde.
02000000:00000001:29.0:1773851887.036610:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036611:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008f5492c6.
02000000:00000001:29.0:1773851887.036611:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036612:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037a15708.
02000000:00000001:29.0:1773851887.036613:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036613:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000352ea24d.
02000000:00000001:29.0:1773851887.036614:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036614:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d477257.
02000000:00000001:29.0:1773851887.036615:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036616:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009dc53d4f.
02000000:00000001:29.0:1773851887.036616:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036617:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ecc5577f.
02000000:00000001:29.0:1773851887.036617:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036618:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000039ddde85.
02000000:00000001:29.0:1773851887.036618:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036619:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017cd0349.
02000000:00000001:29.0:1773851887.036620:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036620:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000067050e0f.
02000000:00000001:29.0:1773851887.036621:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036621:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f4aebbb1.
02000000:00000001:29.0:1773851887.036622:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036622:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004b7c7eea.
02000000:00000001:29.0:1773851887.036623:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036623:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017202dab.
02000000:00000001:29.0:1773851887.036624:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036624:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000066c8dabf.
02000000:00000001:29.0:1773851887.036625:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036625:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eec396ba.
02000000:00000001:29.0:1773851887.036626:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036627:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000037ce5d65.
02000000:00000001:29.0:1773851887.036627:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036628:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b926ac7.
02000000:00000001:29.0:1773851887.036629:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036630:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000059c9b18f.
02000000:00000001:29.0:1773851887.036630:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036631:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ece2cf83.
02000000:00000001:29.0:1773851887.036632:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036632:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000060792377.
02000000:00000001:29.0:1773851887.036633:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036633:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f0d8dae.
02000000:00000001:29.0:1773851887.036634:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036635:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002c536f97.
02000000:00000001:29.0:1773851887.036636:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036636:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e1b8fb6a.
02000000:00000001:29.0:1773851887.036637:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036637:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012d65548.
02000000:00000001:29.0:1773851887.036638:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036639:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001b139b16.
02000000:00000001:29.0:1773851887.036639:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036640:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009140ff57.
02000000:00000001:29.0:1773851887.036640:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036640:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003611199b.
02000000:00000001:29.0:1773851887.036642:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036642:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094dd1dc8.
02000000:00000001:29.0:1773851887.036643:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036643:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056cba73c.
02000000:00000001:29.0:1773851887.036644:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036644:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d8388c5e.
02000000:00000001:29.0:1773851887.036645:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036645:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000569e59aa.
02000000:00000001:29.0:1773851887.036646:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036647:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000388d53fb.
02000000:00000001:29.0:1773851887.036647:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036648:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000911b84ce.
02000000:00000001:29.0:1773851887.036648:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036649:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000027914ea8.
02000000:00000001:29.0:1773851887.036650:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036650:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000be922e39.
02000000:00000001:29.0:1773851887.036651:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036651:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b096321d.
02000000:00000001:29.0:1773851887.036653:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036653:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fc4cdb46.
02000000:00000001:29.0:1773851887.036654:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036655:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b3107865.
02000000:00000001:29.0:1773851887.036656:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036656:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000044b95947.
02000000:00000001:29.0:1773851887.036657:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036658:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000343c4bee.
02000000:00000001:29.0:1773851887.036658:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036659:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e16fd001.
02000000:00000001:29.0:1773851887.036660:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036660:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d4f39d98.
02000000:00000001:29.0:1773851887.036661:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036661:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb688ae0.
02000000:00000001:29.0:1773851887.036662:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036662:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000078292c3e.
02000000:00000001:29.0:1773851887.036663:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036664:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008059dd99.
00000100:00000010:29.0:1773851887.036664:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000274f354.
00000100:00000010:29.0:1773851887.036665:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000030e11240.
00000100:00000010:29.0:1773851887.036666:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006e34792a.
00000100:00000010:29.0:1773851887.036667:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001d8c3d75.
00000100:00000010:29.0:1773851887.036668:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000573988ab.
00000100:00000010:29.0:1773851887.036669:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d1f7bdb1.
02000000:00000001:29.0:1773851887.036670:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036671:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 672 at 0000000098ebb2d2.
02000000:00000001:29.0:1773851887.036672:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036672:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b08e5ebb.
02000000:00000001:29.0:1773851887.036674:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036675:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f18f2076.
02000000:00000001:29.0:1773851887.036675:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036676:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000087384f4.
02000000:00000001:29.0:1773851887.036676:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036677:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000498058d8.
02000000:00000001:29.0:1773851887.036678:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036678:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000032327377.
02000000:00000001:29.0:1773851887.036679:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036679:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000063dfe419.
02000000:00000001:29.0:1773851887.036680:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036680:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000457edbdb.
02000000:00000001:29.0:1773851887.036681:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036682:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e114d15d.
02000000:00000001:29.0:1773851887.036682:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036683:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000036e5c422.
02000000:00000001:29.0:1773851887.036684:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036684:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a14ebccf.
02000000:00000001:29.0:1773851887.036685:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036685:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009f22a579.
02000000:00000001:29.0:1773851887.036686:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036686:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005beb5257.
02000000:00000001:29.0:1773851887.036687:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036688:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004b59af2d.
02000000:00000001:29.0:1773851887.036688:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036689:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005f0baeab.
02000000:00000001:29.0:1773851887.036690:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036690:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000edc4976c.
02000000:00000001:29.0:1773851887.036691:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036691:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b9c26b08.
02000000:00000001:29.0:1773851887.036692:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036692:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b6014e06.
02000000:00000001:29.0:1773851887.036693:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036694:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c60c8a6a.
02000000:00000001:29.0:1773851887.036695:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036695:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008f074717.
02000000:00000001:29.0:1773851887.036696:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036696:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e29426e5.
02000000:00000001:29.0:1773851887.036697:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036697:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000005b8b056.
02000000:00000001:29.0:1773851887.036698:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036698:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009fa3eb5d.
02000000:00000001:29.0:1773851887.036699:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036699:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000088036c61.
02000000:00000001:29.0:1773851887.036700:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036701:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002473a317.
02000000:00000001:29.0:1773851887.036701:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036703:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c854becd.
02000000:00000001:29.0:1773851887.036704:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036704:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000021728599.
02000000:00000001:29.0:1773851887.036705:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036705:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f2258c6d.
02000000:00000001:29.0:1773851887.036706:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036706:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b9d8cc32.
02000000:00000001:29.0:1773851887.036707:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036707:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec1082c6.
02000000:00000001:29.0:1773851887.036708:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036709:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000429615f.
02000000:00000001:29.0:1773851887.036710:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036710:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031d38510.
02000000:00000001:29.0:1773851887.036712:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036712:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cf875bc5.
02000000:00000001:29.0:1773851887.036713:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036714:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001f360bf5.
02000000:00000001:29.0:1773851887.036714:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036715:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001f466ef2.
02000000:00000001:29.0:1773851887.036715:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036716:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c393ac6.
02000000:00000001:29.0:1773851887.036717:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036717:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000098e515b6.
02000000:00000001:29.0:1773851887.036718:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036718:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c7b5afa3.
02000000:00000001:29.0:1773851887.036719:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036720:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007ca2eb71.
02000000:00000001:29.0:1773851887.036721:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036721:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000047e03165.
02000000:00000001:29.0:1773851887.036722:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036722:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d21f4699.
02000000:00000001:29.0:1773851887.036723:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036723:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002238e3ef.
02000000:00000001:29.0:1773851887.036724:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036728:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c8d57c8c.
02000000:00000001:29.0:1773851887.036729:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036729:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008a15eff5.
02000000:00000001:29.0:1773851887.036730:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036730:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ce69f6ac.
02000000:00000001:29.0:1773851887.036731:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036731:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000027887e3.
02000000:00000001:29.0:1773851887.036732:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036733:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000081cdd327.
02000000:00000001:29.0:1773851887.036733:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036734:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c08cf1fb.
02000000:00000001:29.0:1773851887.036735:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036735:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000084c3a8dc.
02000000:00000001:29.0:1773851887.036736:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036736:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019a5a873.
02000000:00000001:29.0:1773851887.036737:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036738:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002dd8e2e6.
02000000:00000001:29.0:1773851887.036738:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036739:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059e5e32a.
02000000:00000001:29.0:1773851887.036740:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036740:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bb2c4bae.
02000000:00000001:29.0:1773851887.036741:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036741:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ecde410a.
02000000:00000001:29.0:1773851887.036742:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036742:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000263bbf87.
02000000:00000001:29.0:1773851887.036743:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036743:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d042be25.
02000000:00000001:29.0:1773851887.036744:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036745:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000c17a6e33.
02000000:00000001:29.0:1773851887.036746:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036746:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ffffe924.
02000000:00000001:29.0:1773851887.036747:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036748:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000139284d9.
02000000:00000001:29.0:1773851887.036748:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036749:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d71d316e.
02000000:00000001:29.0:1773851887.036750:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036750:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007914fbc1.
02000000:00000001:29.0:1773851887.036751:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036751:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000004438786.
02000000:00000001:29.0:1773851887.036752:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036753:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c43f18e8.
02000000:00000001:29.0:1773851887.036753:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036754:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009b7ee72b.
02000000:00000001:29.0:1773851887.036755:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036755:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000065df3649.
02000000:00000001:29.0:1773851887.036756:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036756:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000007660248.
02000000:00000001:29.0:1773851887.036757:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036758:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c0ac232d.
02000000:00000001:29.0:1773851887.036758:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036759:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007b684945.
02000000:00000001:29.0:1773851887.036759:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036760:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b8dd8d03.
02000000:00000001:29.0:1773851887.036760:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036761:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008e072546.
02000000:00000001:29.0:1773851887.036762:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036762:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000f97cb68.
02000000:00000001:29.0:1773851887.036763:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036763:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c3e37f3.
02000000:00000001:29.0:1773851887.036765:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036765:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d2dc5896.
02000000:00000001:29.0:1773851887.036766:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036767:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008cbb2c5f.
02000000:00000001:29.0:1773851887.036768:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036768:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006af2dc3b.
02000000:00000001:29.0:1773851887.036769:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036769:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e0c189e6.
02000000:00000001:29.0:1773851887.036770:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036770:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000074dd6fe7.
02000000:00000001:29.0:1773851887.036771:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036771:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037ee0b1c.
02000000:00000001:29.0:1773851887.036772:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036773:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bc84e0c2.
02000000:00000001:29.0:1773851887.036773:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036774:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b72dcd37.
02000000:00000001:29.0:1773851887.036774:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036775:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000005065aaec.
02000000:00000001:29.0:1773851887.036776:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036776:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005fc06f8b.
02000000:00000001:29.0:1773851887.036777:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036777:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000021b89a8c.
02000000:00000001:29.0:1773851887.036778:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036778:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a6afcd3a.
02000000:00000001:29.0:1773851887.036779:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036780:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000077e814df.
02000000:00000001:29.0:1773851887.036780:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036781:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000096c90763.
02000000:00000001:29.0:1773851887.036781:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036782:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012e15aa3.
02000000:00000001:29.0:1773851887.036783:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036783:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000010668785.
02000000:00000001:29.0:1773851887.036784:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036784:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030bb6c6e.
02000000:00000001:29.0:1773851887.036785:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036785:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000038785f7e.
02000000:00000001:29.0:1773851887.036786:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036786:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a9237c54.
02000000:00000001:29.0:1773851887.036787:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036787:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000612bac4e.
02000000:00000001:29.0:1773851887.036788:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036789:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 00000000c9e79372.
02000000:00000001:29.0:1773851887.036790:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036790:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cb4684cd.
02000000:00000001:29.0:1773851887.036791:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036791:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000048980410.
02000000:00000001:29.0:1773851887.036792:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036792:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000793a1b4.
02000000:00000001:29.0:1773851887.036793:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036793:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000c60fb70.
02000000:00000001:29.0:1773851887.036794:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036794:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001bbd8c6f.
02000000:00000001:29.0:1773851887.036796:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036796:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000044706e09.
02000000:00000001:29.0:1773851887.036797:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036798:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000017ad9c84.
02000000:00000001:29.0:1773851887.036798:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036799:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008dc9ce33.
02000000:00000001:29.0:1773851887.036799:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036800:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1f77670.
02000000:00000001:29.0:1773851887.036801:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036802:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ce5840a.
02000000:00000001:29.0:1773851887.036802:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036803:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000788c27b4.
02000000:00000001:29.0:1773851887.036803:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036804:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003ca581e6.
02000000:00000001:29.0:1773851887.036804:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036805:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000023b01032.
02000000:00000001:29.0:1773851887.036806:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036806:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008b88cc48.
02000000:00000001:29.0:1773851887.036806:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036807:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000010d64a07.
02000000:00000001:29.0:1773851887.036808:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036808:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004bdb6727.
02000000:00000001:29.0:1773851887.036809:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036809:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005a3281e6.
02000000:00000001:29.0:1773851887.036810:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036810:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000076716b3b.
02000000:00000001:29.0:1773851887.036811:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036811:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c147d69.
02000000:00000001:29.0:1773851887.036813:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036813:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f4ab3809.
02000000:00000001:29.0:1773851887.036814:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036814:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000dd8fa708.
02000000:00000001:29.0:1773851887.036815:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036815:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c4db7a3e.
02000000:00000001:29.0:1773851887.036816:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036816:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007de4fa49.
02000000:00000001:29.0:1773851887.036817:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036818:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008be399af.
02000000:00000001:29.0:1773851887.036818:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036819:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000035867fae.
02000000:00000001:29.0:1773851887.036819:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036820:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000094e3fe8d.
02000000:00000001:29.0:1773851887.036821:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036821:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001b460046.
02000000:00000001:29.0:1773851887.036822:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036823:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000438e8559.
02000000:00000001:29.0:1773851887.036823:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036824:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009c588490.
02000000:00000001:29.0:1773851887.036824:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036825:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000422d98e0.
02000000:00000001:29.0:1773851887.036825:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036826:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000032696dbc.
02000000:00000001:29.0:1773851887.036827:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036827:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001c8eeac6.
02000000:00000001:29.0:1773851887.036828:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036828:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a9343bb.
02000000:00000001:29.0:1773851887.036830:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036830:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003b73245e.
02000000:00000001:29.0:1773851887.036831:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036831:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e16c2529.
02000000:00000001:29.0:1773851887.036833:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036833:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c6cea88b.
02000000:00000001:29.0:1773851887.036834:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036834:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006794a36b.
02000000:00000001:29.0:1773851887.036835:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036836:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004310599f.
02000000:00000001:29.0:1773851887.036837:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036837:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031b2b886.
02000000:00000001:29.0:1773851887.036838:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036838:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 624 at 00000000c59cafa4.
02000000:00000001:29.0:1773851887.036839:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036840:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ab0012af.
02000000:00000001:29.0:1773851887.036841:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036841:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000a27bfca.
02000000:00000001:29.0:1773851887.036842:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036842:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000adb21cab.
02000000:00000001:29.0:1773851887.036843:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036844:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000028d5f0e6.
02000000:00000001:29.0:1773851887.036845:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036845:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000059883378.
02000000:00000001:29.0:1773851887.036846:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036846:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000014722d49.
02000000:00000001:29.0:1773851887.036847:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036848:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cbb5f55b.
02000000:00000001:29.0:1773851887.036848:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036849:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002be21950.
02000000:00000001:29.0:1773851887.036849:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036850:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000090cbd20e.
02000000:00000001:29.0:1773851887.036851:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036851:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000000ef7b052.
02000000:00000001:29.0:1773851887.036852:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036852:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d411da6f.
02000000:00000001:29.0:1773851887.036853:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036854:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000030df1c43.
02000000:00000001:29.0:1773851887.036854:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036855:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000797edcb0.
02000000:00000001:29.0:1773851887.036856:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036856:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008aac42e1.
02000000:00000001:29.0:1773851887.036857:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036857:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004553dab9.
02000000:00000001:29.0:1773851887.036859:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036859:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f07c76c0.
02000000:00000001:29.0:1773851887.036860:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036860:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000650205f2.
02000000:00000001:29.0:1773851887.036861:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036862:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008a9b2cfa.
02000000:00000001:29.0:1773851887.036863:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036863:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c9db5bdb.
02000000:00000001:29.0:1773851887.036864:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036864:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008bce6dde.
02000000:00000001:29.0:1773851887.036865:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036865:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000064a88af3.
02000000:00000001:29.0:1773851887.036866:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036866:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ad22d49e.
02000000:00000001:29.0:1773851887.036867:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036867:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8adf01f.
02000000:00000001:29.0:1773851887.036869:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036869:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a35f1d8.
02000000:00000001:29.0:1773851887.036870:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036870:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000086c5bb4d.
02000000:00000001:29.0:1773851887.036871:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036872:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002d830ee5.
02000000:00000001:29.0:1773851887.036872:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036872:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006c3613c3.
02000000:00000001:29.0:1773851887.036874:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036874:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f00dd1a2.
02000000:00000001:29.0:1773851887.036875:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036875:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009dab02ef.
02000000:00000001:29.0:1773851887.036876:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036877:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eb883436.
02000000:00000001:29.0:1773851887.036877:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036878:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001388dd5f.
02000000:00000001:29.0:1773851887.036878:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036879:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006ea0446a.
02000000:00000001:29.0:1773851887.036880:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036880:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000faf9b8e0.
02000000:00000001:29.0:1773851887.036881:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036881:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000123e48e9.
02000000:00000001:29.0:1773851887.036882:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036882:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000039ef0089.
02000000:00000001:29.0:1773851887.036883:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036884:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f963f4df.
02000000:00000001:29.0:1773851887.036885:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036885:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003856a310.
02000000:00000001:29.0:1773851887.036886:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036886:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000090263841.
02000000:00000001:29.0:1773851887.036887:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036888:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a8293919.
02000000:00000001:29.0:1773851887.036889:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036889:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 000000007871486c.
02000000:00000001:29.0:1773851887.036890:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036890:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000029d09fd2.
02000000:00000001:29.0:1773851887.036891:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036892:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000076aaaa06.
02000000:00000001:29.0:1773851887.036892:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036893:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f34386df.
02000000:00000001:29.0:1773851887.036893:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036894:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000c7e36f8e.
02000000:00000001:29.0:1773851887.036894:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036895:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d653edd7.
02000000:00000001:29.0:1773851887.036896:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036896:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012bf3eb9.
02000000:00000001:29.0:1773851887.036897:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036897:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000056f3382e.
02000000:00000001:29.0:1773851887.036898:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036898:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b36fbb7f.
02000000:00000001:29.0:1773851887.036899:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036899:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003927ae96.
02000000:00000001:29.0:1773851887.036900:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036900:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000492c35fe.
02000000:00000001:29.0:1773851887.036901:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036901:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003d6174e4.
02000000:00000001:29.0:1773851887.036902:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036902:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006f1d6188.
02000000:00000001:29.0:1773851887.036903:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036904:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a60887dd.
02000000:00000001:29.0:1773851887.036904:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036905:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007dc819da.
02000000:00000001:29.0:1773851887.036905:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036906:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009ec7944.
02000000:00000001:29.0:1773851887.036907:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036907:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000007263443f.
02000000:00000001:29.0:1773851887.036908:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036908:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000025ac48fb.
02000000:00000001:29.0:1773851887.036909:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036909:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f37c615d.
02000000:00000001:29.0:1773851887.036910:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036910:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000071845b6f.
02000000:00000001:29.0:1773851887.036911:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036912:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000056a9c57d.
02000000:00000001:29.0:1773851887.036913:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036913:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001fb8da98.
02000000:00000001:29.0:1773851887.036914:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036914:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000087097d49.
02000000:00000001:29.0:1773851887.036915:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036915:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000274a50be.
02000000:00000001:29.0:1773851887.036916:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036917:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000059e1f7b.
02000000:00000001:29.0:1773851887.036917:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036918:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004807f30f.
02000000:00000001:29.0:1773851887.036918:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036919:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002e004580.
02000000:00000001:29.0:1773851887.036919:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036920:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000084b5caba.
02000000:00000001:29.0:1773851887.036920:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036921:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000efbb1317.
02000000:00000001:29.0:1773851887.036922:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036922:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000273d2152.
02000000:00000001:29.0:1773851887.036923:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036923:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f0e19a2c.
02000000:00000001:29.0:1773851887.036924:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036924:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b9b814e2.
02000000:00000001:29.0:1773851887.036925:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036926:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d0dbeb92.
02000000:00000001:29.0:1773851887.036926:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036927:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000009336e2e.
02000000:00000001:29.0:1773851887.036927:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036928:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000efed54c5.
02000000:00000001:29.0:1773851887.036929:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036929:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b304e1e8.
02000000:00000001:29.0:1773851887.036930:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036931:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000038ef4728.
02000000:00000001:29.0:1773851887.036931:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036932:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002e30abfc.
02000000:00000001:29.0:1773851887.036932:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036933:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000057382eed.
02000000:00000001:29.0:1773851887.036933:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036934:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000316846da.
02000000:00000001:29.0:1773851887.036935:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036935:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000facc351d.
02000000:00000001:29.0:1773851887.036936:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036936:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000014929c9b.
02000000:00000001:29.0:1773851887.036937:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036937:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ed18da83.
02000000:00000001:29.0:1773851887.036938:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036949:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bfc02468.
02000000:00000001:29.0:1773851887.036949:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036950:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e815e306.
02000000:00000001:29.0:1773851887.036950:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036951:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004a112b43.
02000000:00000001:29.0:1773851887.036952:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036952:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f8e2f4e8.
02000000:00000001:29.0:1773851887.036953:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036953:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d195074.
02000000:00000001:29.0:1773851887.036954:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036954:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000007e0083f.
02000000:00000001:29.0:1773851887.036955:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036955:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f1441ba3.
02000000:00000001:29.0:1773851887.036956:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036956:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005ff3be5d.
02000000:00000001:29.0:1773851887.036957:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036957:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003a5799f1.
02000000:00000001:29.0:1773851887.036958:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036959:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 688 at 0000000098ee5cfc.
02000000:00000001:29.0:1773851887.036959:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036960:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001b6d3396.
02000000:00000001:29.0:1773851887.036961:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036962:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e6cf2fe3.
02000000:00000001:29.0:1773851887.036962:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036963:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008c2ddb9c.
02000000:00000001:29.0:1773851887.036964:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036964:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e47a4962.
02000000:00000001:29.0:1773851887.036965:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036965:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000aa16f8a5.
02000000:00000001:29.0:1773851887.036966:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036967:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009c36f7bc.
02000000:00000001:29.0:1773851887.036967:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036968:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e6ba91e1.
02000000:00000001:29.0:1773851887.036968:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036969:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009fa96200.
02000000:00000001:29.0:1773851887.036969:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036970:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b21aff5c.
02000000:00000001:29.0:1773851887.036971:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036972:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004c9fe911.
02000000:00000001:29.0:1773851887.036972:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036972:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000887840d2.
02000000:00000001:29.0:1773851887.036973:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036974:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000001a654854.
02000000:00000001:29.0:1773851887.036974:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036975:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002db9dc7d.
02000000:00000001:29.0:1773851887.036975:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036976:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000fdc91b5d.
02000000:00000001:29.0:1773851887.036977:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036977:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000048bc074b.
02000000:00000001:29.0:1773851887.036978:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036978:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000003a13c831.
02000000:00000001:29.0:1773851887.036979:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036979:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000273570b.
02000000:00000001:29.0:1773851887.036980:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036980:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000048bb61f5.
02000000:00000001:29.0:1773851887.036981:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036981:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ef53b5fc.
02000000:00000001:29.0:1773851887.036982:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036982:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000d35f2e1e.
02000000:00000001:29.0:1773851887.036983:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036983:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000af09cd8a.
02000000:00000001:29.0:1773851887.036984:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036985:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bd528a9b.
02000000:00000001:29.0:1773851887.036985:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036986:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000efe6cbaa.
02000000:00000001:29.0:1773851887.036986:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036987:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000bd08d4c0.
02000000:00000001:29.0:1773851887.036987:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036988:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d393d330.
02000000:00000001:29.0:1773851887.036988:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036989:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000642b4035.
02000000:00000001:29.0:1773851887.036990:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036990:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000705ec536.
02000000:00000001:29.0:1773851887.036991:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036991:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000ca2d491b.
02000000:00000001:29.0:1773851887.036991:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036992:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000eea4b40c.
02000000:00000001:29.0:1773851887.036993:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036993:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000004ad912a1.
02000000:00000001:29.0:1773851887.036994:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036994:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001d12064a.
02000000:00000001:29.0:1773851887.036995:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036995:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000039297216.
02000000:00000001:29.0:1773851887.036996:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036996:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000004d88bb8d.
02000000:00000001:29.0:1773851887.036997:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.036998:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000036052f44.
02000000:00000001:29.0:1773851887.036998:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.036999:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000077994549.
02000000:00000001:29.0:1773851887.036999:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037000:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000637482d0.
02000000:00000001:29.0:1773851887.037000:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037001:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000120ee44c.
02000000:00000001:29.0:1773851887.037002:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037002:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000037d7733b.
02000000:00000001:29.0:1773851887.037002:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037003:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003cd1ca2a.
02000000:00000001:29.0:1773851887.037004:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037004:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008321fb7b.
02000000:00000001:29.0:1773851887.037005:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037005:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f50166b8.
02000000:00000001:29.0:1773851887.037007:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037007:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000006f0c42a2.
02000000:00000001:29.0:1773851887.037008:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037008:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cca02ff.
02000000:00000001:29.0:1773851887.037009:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037010:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000005082790c.
02000000:00000001:29.0:1773851887.037010:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037011:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4dc3c2c.
02000000:00000001:29.0:1773851887.037012:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037012:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cfe6d327.
02000000:00000001:29.0:1773851887.037013:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037013:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007ab02556.
02000000:00000001:29.0:1773851887.037014:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037015:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008ed7c1e6.
02000000:00000001:29.0:1773851887.037015:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037016:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000828bbd80.
02000000:00000001:29.0:1773851887.037017:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037017:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f89072dc.
02000000:00000001:29.0:1773851887.037018:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037018:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009871e009.
02000000:00000001:29.0:1773851887.037020:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037020:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 0000000012a5e3e2.
02000000:00000001:29.0:1773851887.037021:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037021:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000465eff21.
02000000:00000001:29.0:1773851887.037022:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037023:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a1a98dd9.
02000000:00000001:29.0:1773851887.037023:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037024:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000a333d7b.
02000000:00000001:29.0:1773851887.037025:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037026:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000931054ac.
02000000:00000001:29.0:1773851887.037027:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037027:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000da500fd4.
02000000:00000001:29.0:1773851887.037028:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037028:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000f9e11c16.
02000000:00000001:29.0:1773851887.037029:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037029:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005b13827c.
02000000:00000001:29.0:1773851887.037030:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037031:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cedc0027.
02000000:00000001:29.0:1773851887.037031:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037032:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001fbdbc6c.
02000000:00000001:29.0:1773851887.037033:0:60533:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:29.0:1773851887.037033:0:60533:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000620d152c.
02000000:00000001:29.0:1773851887.037034:0:60533:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:29.0:1773851887.037034:0:60533:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ecebd921.
00000100:00000001:29.0:1773851887.037035:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:29.0:1773851887.037036:0:60533:0:(niobuf.c:993:ptlrpc_register_rqbd()) mdt: registering portal 12
00000400:00000010:29.0:1773851887.037037:0:60533:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b37fd7a9.
00000400:00000010:29.0:1773851887.037038:0:60533:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 1144 at 00000000008822e0 (tot 253200771).
00000800:00000200:13.0:1773851887.046053:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851887.046054:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851887.046055:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851887.046058:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851887.046060:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24915@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.046061:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24915@kfi7 : PUT - for me
00000400:00000200:13.0:1773851887.046062:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24915@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.046064:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b74c36b7 nid 24915@kfi7 refs 1
00000400:00000200:13.0:1773851887.046066:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24915@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.046067:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b74c36b7 nid 24915@kfi7 refs 2
00000400:00000200:13.0:1773851887.046068:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b74c36b7 nid 24915@kfi7 refs 3
00000400:00000200:13.0:1773851887.046069:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24978@kfi7 to cpt 4
00000400:00000200:13.0:1773851887.046070:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24978@kfi7 of length 224 into portal 12 MB=0x699e0f8883600
00000400:00000200:13.0:1773851887.046072:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24978@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 45136
00000800:00000200:13.0:1773851887.046074:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851887.046076:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851887.046077:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24915@kfi7: PUT: OK
00000100:00000001:13.0:1773851887.046078:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851887.046079:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851887.046081:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076b4fff5.
00000100:00000040:13.0:1773851887.046081:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000076b4fff5 x1858041381664256 msgsize 224
00000100:00100000:13.0:1773851887.046083:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24978@kfi7 (source: 12345-24915@kfi7)
00000100:00000001:13.0:1773851887.046084:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851887.046085:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b74c36b7 nid 24915@kfi7 refs 2
00000100:00000001:15.0:1773851887.046086:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851887.046086:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851887.046086:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851887.046087:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851887.046087:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851887.046088:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851887.046089:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041381664256
00000020:00000001:15.0:1773851887.046089:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851887.046090:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e0d
00000020:00000001:15.0:1773851887.046090:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851887.046095:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac25341f refcount=6
00000020:00000001:15.0:1773851887.046095:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744442880 : -107128965108736 : ffff9e911816ec00)
00000020:00000001:15.0:1773851887.046096:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744442880 : -107128965108736 : ffff9e911816ec00)
00000100:00000001:15.0:1773851887.046097:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851887.046099:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851887.046099:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000251d9196.
00000020:00000010:15.0:1773851887.046101:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851887.046102:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851887.046103:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851887.046103:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851887.046104:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851887.046105:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851887.046105:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851887.046105:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.046106:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851887.046108:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851887.046108:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851887.046108:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851887.046108:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851887.046109:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24978@kfi7, seq: 2289894
00000100:00000040:15.0:1773851887.046110:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac25341f : new rpc_count 1
00000100:00000001:15.0:1773851887.046110:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485595776 : -107000223955840 : ffff9eaf11a90480)
00000100:00000001:12.0:1773851887.046110:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.046111:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851887.046112:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000076b4fff5 x1858041381664256/t0(0) o400->839940cc-2a52-430b-93c5-350c47a7673a@24978@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2054-0'
00000100:00000001:15.0:1773851887.046115:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851887.046115:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851887.046116:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076b4fff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:839940cc-2a52-430b-93c5-350c47a7673a+6:39637:x1858041381664256:12345-24978@kfi7:400:default-tuolumne2054-0
00000100:00000200:15.0:1773851887.046118:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041381664256
00000020:00000001:15.0:1773851887.046118:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851887.046119:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851887.046120:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.046120:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851887.046121:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851887.046122:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851887.046122:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041381664256, found 0 last_xid 1858041381664255
00000020:00000001:15.0:1773851887.046123:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851887.046124:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851887.046124:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851887.046125:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.046126:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851887.046127:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851887.046127:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851887.046128:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab8026e0.
02000000:00000001:15.0:1773851887.046129:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.046129:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.046130:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851887.046131:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182739063392, transno 0, xid 1858041381664256
00010000:00000001:15.0:1773851887.046131:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851887.046132:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000076b4fff5 x1858041381664256/t0(0) o400->839940cc-2a52-430b-93c5-350c47a7673a@24978@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2054-0'
00010000:00000001:15.0:1773851887.046135:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851887.046136:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851887.046136:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=120 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851887.046137:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851887.046138:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b4cf54f7 refcount 3 to 24978@kfi7
00000100:00000001:15.0:1773851887.046139:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547104 : -107156126004512 : ffff9e8ac52c8ae0)
02000000:00000001:15.0:1773851887.046139:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851887.046140:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.046141:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851887.046141:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24915@kfi7
00000400:00000010:15.0:1773851887.046142:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a0412e34.
00000100:00000200:15.0:1773851887.046143:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041381664256, offset 224
00000400:00000200:15.0:1773851887.046144:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24915@kfi7
00000400:00000200:15.0:1773851887.046145:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24915@kfi7 to cpt 3
00000400:00000200:15.0:1773851887.046146:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b74c36b7 nid 24915@kfi7 refs 1
00000400:00000200:15.0:1773851887.046147:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b74c36b7 nid 24915@kfi7 refs 2
00000400:00000200:15.0:1773851887.046148:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b74c36b7 nid 24915@kfi7 refs 3
00000400:00000200:15.0:1773851887.046149:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24915@kfi7 local destination
00000400:00000200:15.0:1773851887.046150:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769873:8769873:1024:4294967295] 24915@kfi7 LPNI seq info [11295798:11295798:16:4294967295]
00000400:00000200:15.0:1773851887.046152:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b74c36b7 nid 24915@kfi7 refs 2
00000400:00000200:15.0:1773851887.046153:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24915@kfi7 to cpt 3
00000400:00000200:15.0:1773851887.046154:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24915@kfi7(24915@kfi7:24915@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851887.046156:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b74c36b7 nid 24915@kfi7 refs 3
00000800:00000200:15.0:1773851887.046157:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851887.046158:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851887.046160:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851887.046163:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fa Using peer 24915@kfi7(0x10fa)
00000800:00000200:15.0:1773851887.046166:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x10fa: rc=0
00000800:00000200:15.0:1773851887.046167:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851887.046169:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851887.046170:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b4cf54f7 refcount 2 to 24978@kfi7
00010000:00000001:15.0:1773851887.046171:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851887.046171:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.046172:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851887.046172:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000076b4fff5 x1858041381664256/t0(0) o400->839940cc-2a52-430b-93c5-350c47a7673a@24978@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2054-0'
00000100:00100000:15.0:1773851887.046175:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076b4fff5 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:839940cc-2a52-430b-93c5-350c47a7673a+6:39637:x1858041381664256:12345-24978@kfi7:400:default-tuolumne2054-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851887.046178:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24978@kfi7, seq: 2289894
00000100:00000040:15.0:1773851887.046178:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac25341f : new rpc_count 0
00000100:00000001:15.0:1773851887.046179:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851887.046180:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851887.046180:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:13.0:1773851887.046180:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fa TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851887.046181:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000020:00000010:15.0:1773851887.046181:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000251d9196.
00000400:00000200:13.0:1773851887.046181:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:15.0:1773851887.046182:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000ac25341f : new refcount 5
00000400:00000200:13.0:1773851887.046182:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24915@kfi7: PUT: OK
00000100:00000001:15.0:1773851887.046183:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851887.046183:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a0412e34
00000400:00000010:13.0:1773851887.046183:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a0412e34.
00000100:00000001:13.0:1773851887.046184:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851887.046185:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851887.046185:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b74c36b7 nid 24915@kfi7 refs 2
00000800:00000200:13.0:1773851887.046187:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 24915@kfi7(000000009af278db):0x0 lsk 4347 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fa Transaction freed
00000800:00000200:13.0:1773851887.051193:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851887.051194:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851887.051196:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851887.051199:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851887.051202:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12275@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.051207:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12275@kfi7 : PUT - for me
00000400:00000200:13.0:1773851887.051208:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12275@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.051209:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7f9af15 nid 12275@kfi7 refs 1
00000400:00000200:13.0:1773851887.051211:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12275@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.051212:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7f9af15 nid 12275@kfi7 refs 2
00000400:00000200:13.0:1773851887.051214:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a7f9af15 nid 12275@kfi7 refs 3
00000400:00000200:13.0:1773851887.051215:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12274@kfi7 to cpt 0
00000400:00000200:13.0:1773851887.051216:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12274@kfi7 of length 224 into portal 12 MB=0x69b4b56e47080
00000400:00000200:13.0:1773851887.051218:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12274@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 45360
00000800:00000200:13.0:1773851887.051220:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851887.051223:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851887.051225:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12275@kfi7: PUT: OK
00000100:00000001:13.0:1773851887.051226:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851887.051227:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851887.051228:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001836ec84.
00000100:00000040:13.0:1773851887.051229:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000001836ec84 x1859597742928000 msgsize 224
00000100:00100000:13.0:1773851887.051231:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12274@kfi7 (source: 12345-12275@kfi7)
00000100:00000001:13.0:1773851887.051232:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851887.051233:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a7f9af15 nid 12275@kfi7 refs 2
00000100:00000001:15.0:1773851887.051235:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851887.051235:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851887.051236:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851887.051237:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851887.051237:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851887.051238:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851887.051239:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597742928000
00000020:00000001:15.0:1773851887.051240:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851887.051241:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f313
00000020:00000001:15.0:1773851887.051242:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851887.051248:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002fc33641 refcount=5
00000020:00000001:15.0:1773851887.051249:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637070806841344 : -107002902710272 : ffff9eae71fe7800)
00000020:00000001:15.0:1773851887.051250:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637070806841344 : -107002902710272 : ffff9eae71fe7800)
00000100:00000001:15.0:1773851887.051251:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851887.051252:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851887.051253:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000251d9196.
00000020:00000010:15.0:1773851887.051254:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851887.051255:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851887.051256:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851887.051257:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851887.051257:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851887.051259:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851887.051259:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851887.051260:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.051261:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851887.051263:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851887.051263:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851887.051264:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851887.051264:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851887.051265:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12274@kfi7, seq: 2289895
00000100:00000040:15.0:1773851887.051266:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002fc33641 : new rpc_count 1
00000100:00000001:12.0:1773851887.051266:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.051267:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485606144 : -107000223945472 : ffff9eaf11a92d00)
00000100:00000001:12.0:1773851887.051267:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851887.051269:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001836ec84 x1859597742928000/t0(0) o400->1b01bcb1-8f63-4d66-a5e6-546b6c249c25@12274@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1241-0'
00000100:00000001:15.0:1773851887.051273:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851887.051274:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851887.051275:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001836ec84 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1b01bcb1-8f63-4d66-a5e6-546b6c249c25+5:39615:x1859597742928000:12345-12274@kfi7:400:default-tuolumne1241-0
00000100:00000200:15.0:1773851887.051280:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597742928000
00000020:00000001:15.0:1773851887.051281:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851887.051282:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851887.051282:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.051283:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851887.051284:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851887.051285:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851887.051286:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597742928000, found 0 last_xid 1859597742927999
00000020:00000001:15.0:1773851887.051287:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851887.051288:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851887.051289:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851887.051289:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.051290:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851887.051291:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851887.051292:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851887.051293:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000279fa6c4.
02000000:00000001:15.0:1773851887.051294:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.051295:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.051296:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851887.051297:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154591899, transno 0, xid 1859597742928000
00010000:00000001:15.0:1773851887.051298:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851887.051299:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001836ec84 x1859597742928000/t0(0) o400->1b01bcb1-8f63-4d66-a5e6-546b6c249c25@12274@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1241-0'
00010000:00000001:15.0:1773851887.051303:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851887.051304:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851887.051305:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=120 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851887.051307:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851887.051308:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005a998d0c refcount 3 to 12274@kfi7
00000100:00000001:15.0:1773851887.051309:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729381376 : -107155980170240 : ffff9e8acdddcc00)
02000000:00000001:15.0:1773851887.051310:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851887.051310:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.051311:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851887.051313:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12275@kfi7
00000400:00000010:15.0:1773851887.051313:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000019bef8e5.
00000100:00000200:15.0:1773851887.051315:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597742928000, offset 224
00000400:00000200:15.0:1773851887.051317:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12275@kfi7
00000400:00000200:15.0:1773851887.051318:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12275@kfi7 to cpt 3
00000400:00000200:15.0:1773851887.051320:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7f9af15 nid 12275@kfi7 refs 1
00000400:00000200:15.0:1773851887.051321:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a7f9af15 nid 12275@kfi7 refs 2
00000400:00000200:15.0:1773851887.051323:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a7f9af15 nid 12275@kfi7 refs 3
00000400:00000200:15.0:1773851887.051325:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12275@kfi7 local destination
00000400:00000200:15.0:1773851887.051327:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769874:8769874:1024:4294967295] 12275@kfi7 LPNI seq info [304311:304311:16:4294967295]
00000400:00000200:15.0:1773851887.051329:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a7f9af15 nid 12275@kfi7 refs 2
00000400:00000200:15.0:1773851887.051330:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12275@kfi7 to cpt 3
00000400:00000200:15.0:1773851887.051334:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12275@kfi7(12275@kfi7:12275@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851887.051336:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a7f9af15 nid 12275@kfi7 refs 3
00000800:00000200:15.0:1773851887.051338:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851887.051340:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851887.051343:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851887.051347:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa3f Using peer 12275@kfi7(0xa3f)
00000800:00000200:15.0:1773851887.051351:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0xa3f: rc=0
00000800:00000200:15.0:1773851887.051353:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa3f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851887.051356:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851887.051357:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005a998d0c refcount 2 to 12274@kfi7
00010000:00000001:15.0:1773851887.051358:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851887.051359:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851887.051360:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851887.051361:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001836ec84 x1859597742928000/t0(0) o400->1b01bcb1-8f63-4d66-a5e6-546b6c249c25@12274@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1241-0'
00000100:00100000:15.0:1773851887.051366:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001836ec84 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1b01bcb1-8f63-4d66-a5e6-546b6c249c25+5:39615:x1859597742928000:12345-12274@kfi7:400:default-tuolumne1241-0 Request processed in 91us (136us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851887.051368:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa3f TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851887.051371:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851887.051372:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12274@kfi7, seq: 2289895
00000400:00000200:13.0:1773851887.051372:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12275@kfi7: PUT: OK
00000100:00000040:15.0:1773851887.051373:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002fc33641 : new rpc_count 0
00000400:00000200:13.0:1773851887.051373:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000019bef8e5
00000100:00000001:15.0:1773851887.051374:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851887.051374:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:13.0:1773851887.051374:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000019bef8e5.
00000020:00000010:15.0:1773851887.051375:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000100:00000001:13.0:1773851887.051375:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851887.051375:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851887.051376:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000020:00000010:15.0:1773851887.051377:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000251d9196.
00000400:00000200:13.0:1773851887.051377:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a7f9af15 nid 12275@kfi7 refs 2
00000020:00000040:15.0:1773851887.051378:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000002fc33641 : new refcount 4
00000100:00000001:15.0:1773851887.051379:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851887.051379:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 12275@kfi7(00000000765050b1):0x0 lsk 2624 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa3f Transaction freed
00000800:00000200:2.0:1773851887.061175:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851887.061176:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851887.061178:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851887.061180:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851887.061182:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851887.061183:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 61@kfi7 : PUT - for me
00000400:00000200:2.0:1773851887.061184:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851887.061185:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:2.0:1773851887.061186:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851887.061187:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:2.0:1773851887.061188:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:2.0:1773851887.061189:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:2.0:1773851887.061190:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a87a0b480
00000400:00000200:2.0:1773851887.061191:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x7f7992401 [256] + 19408
00000800:00000200:2.0:1773851887.061193:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851887.061195:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851887.061196:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->61@kfi7: PUT: OK
00000100:00000001:2.0:1773851887.061197:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851887.061200:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:2.0:1773851887.061201:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000af2a9519.
00000100:00000040:2.0:1773851887.061202:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000af2a9519 x1859388107175040 msgsize 224
00000100:00100000:2.0:1773851887.061204:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-61@kfi7)
00000100:00000001:2.0:1773851887.061205:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851887.061206:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:2.0:1773851887.061207:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:1.0:1773851887.061207:0:1203216:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:1.0:1773851887.061207:0:1203216:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:1.0:1773851887.061208:0:1203216:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:1.0:1773851887.061208:0:1203216:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851887.061209:0:1203216:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:1.0:1773851887.061210:0:1203216:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107175040
00000020:00000001:1.0:1773851887.061210:0:1203216:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:1.0:1773851887.061211:0:1203216:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:1.0:1773851887.061211:0:1203216:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:1.0:1773851887.061212:0:1203216:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:1.0:1773851887.061213:0:1203216:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:1.0:1773851887.061214:0:1203216:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:1.0:1773851887.061215:0:1203216:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:1.0:1773851887.061216:0:1203216:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:1.0:1773851887.061216:0:1203216:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033c94936.
00000020:00000010:1.0:1773851887.061218:0:1203216:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e394f866.
00000020:00000010:1.0:1773851887.061218:0:1203216:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004280ae28.
00000100:00000040:1.0:1773851887.061220:0:1203216:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:1.0:1773851887.061220:0:1203216:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:1.0:1773851887.061221:0:1203216:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:1.0:1773851887.061222:0:1203216:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851887.061223:0:1203216:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851887.061224:0:1203216:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851887.061225:0:1203216:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851887.061225:0:1203216:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851887.061225:0:180051:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851887.061226:0:180051:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851887.061227:0:180051:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 3288272
00000100:00000001:1.0:1773851887.061228:0:1203216:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851887.061228:0:1203216:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851887.061228:0:180051:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:0.0:1773851887.061228:0:180051:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637031984532864 : -107041725018752 : ffff9ea568010d80)
00000100:00000040:0.0:1773851887.061229:0:180051:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000af2a9519 x1859388107175040/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:0.0:1773851887.061232:0:180051:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851887.061233:0:180051:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851887.061234:0:180051:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af2a9519 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_009:lustre5-MDT0000-mdtlov_UUID+5:40157:x1859388107175040:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:0.0:1773851887.061235:0:180051:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107175040
00000020:00000001:0.0:1773851887.061235:0:180051:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851887.061236:0:180051:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851887.061237:0:180051:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851887.061237:0:180051:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851887.061238:0:180051:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:0.0:1773851887.061238:0:180051:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:0.0:1773851887.061239:0:180051:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851887.061240:0:180051:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851887.061240:0:180051:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851887.061240:0:180051:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851887.061241:0:180051:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851887.061242:0:180051:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851887.061242:0:180051:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000069592f8d.
02000000:00000001:0.0:1773851887.061243:0:180051:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851887.061244:0:180051:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851887.061245:0:180051:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:0.0:1773851887.061246:0:180051:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:0.0:1773851887.061246:0:180051:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:0.0:1773851887.061247:0:180051:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 87293952 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:0.0:1773851887.061248:0:180051:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966132241 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:0.0:1773851887.061249:0:180051:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851887.061250:0:180051:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107175040
00010000:00000001:0.0:1773851887.061251:0:180051:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851887.061252:0:180051:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000af2a9519 x1859388107175040/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:614/0 lens 224/368 e 0 to 0 dl 1773851974 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:0.0:1773851887.061254:0:180051:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851887.061254:0:180051:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851887.061255:0:180051:0:(import.c:1951:at_measured()) add 1 to 00000000b7f0e4a1 time=141 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851887.061256:0:180051:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851887.061257:0:180051:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:0.0:1773851887.061257:0:180051:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:0.0:1773851887.061258:0:180051:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851887.061259:0:180051:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851887.061259:0:180051:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851887.061260:0:180051:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-61@kfi7
00000400:00000010:0.0:1773851887.061261:0:180051:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013214890.
00000100:00000200:0.0:1773851887.061261:0:180051:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107175040, offset 224
00000400:00000200:0.0:1773851887.061263:0:180051:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-61@kfi7
00000400:00000200:0.0:1773851887.061264:0:180051:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:0.0:1773851887.061265:0:180051:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:0.0:1773851887.061266:0:180051:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:0.0:1773851887.061267:0:180051:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:0.0:1773851887.061269:0:180051:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  61@kfi7 local destination
00000400:00000200:0.0:1773851887.061270:0:180051:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769875:8769875:1024:4294967295] 61@kfi7 LPNI seq info [37492106:37492106:16:4294967295]
00000400:00000200:0.0:1773851887.061271:0:180051:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:0.0:1773851887.061272:0:180051:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:0.0:1773851887.061274:0:180051:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 61@kfi7(61@kfi7:61@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851887.061275:0:180051:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000800:00000200:0.0:1773851887.061276:0:180051:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851887.061277:0:180051:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:0.0:1773851887.061279:0:180051:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851887.061281:0:180051:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f Using peer 61@kfi7(0x70f)
00000800:00000200:0.0:1773851887.061284:0:180051:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 468 bytes to peer 0x70f: rc=0
00000800:00000200:0.0:1773851887.061285:0:180051:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851887.061287:0:180051:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851887.061288:0:180051:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:0.0:1773851887.061288:0:180051:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851887.061289:0:180051:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851887.061289:0:180051:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851887.061290:0:180051:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000af2a9519 x1859388107175040/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:614/0 lens 224/368 e 0 to 0 dl 1773851974 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:0.0:1773851887.061294:0:180051:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af2a9519 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_009:lustre5-MDT0000-mdtlov_UUID+5:40157:x1859388107175040:12345-61@kfi7:41:default-yuba1-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851887.061296:0:180051:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 3288272
00000100:00000040:0.0:1773851887.061297:0:180051:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:0.0:1773851887.061298:0:180051:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851887.061299:0:180051:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851887.061300:0:180051:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e394f866.
00000020:00000010:0.0:1773851887.061301:0:180051:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004280ae28.
00000020:00000010:0.0:1773851887.061302:0:180051:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033c94936.
00000020:00000040:0.0:1773851887.061302:0:180051:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000100:00000001:0.0:1773851887.061303:0:180051:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851887.061310:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851887.061311:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851887.061312:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->61@kfi7: PUT: OK
00000400:00000200:1.0:1773851887.061313:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013214890
00000400:00000010:1.0:1773851887.061314:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013214890.
00000100:00000001:1.0:1773851887.061314:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851887.061315:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851887.061316:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:1.0:1773851887.061317:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 61@kfi7(000000005e4f9275):0x0 lsk 1808 rsk 1653 tsk 0 trmk 0 tmk 0 trr 0 tta 0x70f Transaction freed
00000800:00000200:21.0:1773851887.086818:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851887.086819:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851887.086821:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851887.086823:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851887.086825:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23905@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.086826:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23905@kfi7 : PUT - for me
00000400:00000200:21.0:1773851887.086827:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23905@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.086828:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae3996da nid 23905@kfi7 refs 1
00000400:00000200:21.0:1773851887.086829:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23905@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.086829:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae3996da nid 23905@kfi7 refs 2
00000400:00000200:21.0:1773851887.086830:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ae3996da nid 23905@kfi7 refs 3
00000400:00000200:21.0:1773851887.086831:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23904@kfi7 to cpt 2
00000400:00000200:21.0:1773851887.086832:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23904@kfi7 of length 224 into portal 12 MB=0x699e1569ca680
00000400:00000200:21.0:1773851887.086834:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23904@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 54616
00000800:00000200:21.0:1773851887.086835:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851887.086837:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.086838:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23905@kfi7: PUT: OK
00000100:00000001:21.0:1773851887.086840:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851887.086840:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851887.086841:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000065814e7b.
00000100:00000040:21.0:1773851887.086842:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000065814e7b x1858042960062080 msgsize 224
00000100:00100000:21.0:1773851887.086843:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23904@kfi7 (source: 12345-23905@kfi7)
00000100:00000001:21.0:1773851887.086844:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851887.086845:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ae3996da nid 23905@kfi7 refs 2
00000100:00000001:20.0:1773851887.086846:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851887.086846:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851887.086847:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851887.086847:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851887.086847:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851887.086848:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851887.086849:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042960062080
00000020:00000001:20.0:1773851887.086849:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851887.086850:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c38
00000020:00000001:20.0:1773851887.086850:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851887.086853:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000934d1eeb refcount=6
00000020:00000001:20.0:1773851887.086854:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743943168 : -107128965608448 : ffff9e91180f4c00)
00000020:00000001:20.0:1773851887.086855:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743943168 : -107128965608448 : ffff9e91180f4c00)
00000100:00000001:20.0:1773851887.086856:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.086857:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851887.086857:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aeeb6e1.
00000020:00000010:20.0:1773851887.086858:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.086859:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000afae15a5.
00000100:00000001:20.0:1773851887.086860:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851887.086860:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851887.086861:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851887.086862:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851887.086862:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851887.086863:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.086864:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851887.086865:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.086865:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.086865:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851887.086866:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851887.086867:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851887.086867:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23904@kfi7, seq: 1998040
00000100:00000040:20.0:1773851887.086867:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000934d1eeb : new rpc_count 1
00000100:00000001:23.0:1773851887.086868:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.086868:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956248832 : -106937753302784 : ffff9ebd9d338900)
00000100:00000040:20.0:1773851887.086869:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000065814e7b x1858042960062080/t0(0) o400->7e34ce8a-ffc3-4ec3-bcdf-1eb7eb829e2d@23904@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1984-0'
00000100:00000001:20.0:1773851887.086872:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.086872:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851887.086873:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065814e7b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:7e34ce8a-ffc3-4ec3-bcdf-1eb7eb829e2d+6:39812:x1858042960062080:12345-23904@kfi7:400:default-tuolumne1984-0
00000100:00000200:20.0:1773851887.086875:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042960062080
00000020:00000001:20.0:1773851887.086875:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851887.086876:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851887.086876:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.086877:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851887.086878:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851887.086879:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851887.086879:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042960062080, found 0 last_xid 1858042960062079
00000020:00000001:20.0:1773851887.086880:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851887.086881:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851887.086881:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851887.086882:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.086882:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851887.086883:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851887.086883:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851887.086885:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000001b967a9.
02000000:00000001:20.0:1773851887.086885:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.086886:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.086887:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851887.086887:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425807047, transno 0, xid 1858042960062080
00010000:00000001:20.0:1773851887.086888:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851887.086889:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000065814e7b x1858042960062080/t0(0) o400->7e34ce8a-ffc3-4ec3-bcdf-1eb7eb829e2d@23904@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1984-0'
00010000:00000001:20.0:1773851887.086891:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851887.086892:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851887.086892:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=120 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851887.086893:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851887.086894:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b4207736 refcount 3 to 23904@kfi7
00000100:00000001:20.0:1773851887.086895:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551675648 : -107156157875968 : ffff9e8ac3463900)
02000000:00000001:20.0:1773851887.086896:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851887.086896:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.086897:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851887.086898:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23905@kfi7
00000400:00000010:20.0:1773851887.086898:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e899d2a0.
00000100:00000200:20.0:1773851887.086899:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042960062080, offset 224
00000400:00000200:20.0:1773851887.086900:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23905@kfi7
00000400:00000200:20.0:1773851887.086901:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23905@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.086902:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ae3996da nid 23905@kfi7 refs 1
00000400:00000200:20.0:1773851887.086903:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ae3996da nid 23905@kfi7 refs 2
00000400:00000200:20.0:1773851887.086904:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ae3996da nid 23905@kfi7 refs 3
00000400:00000200:20.0:1773851887.086905:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23905@kfi7 local destination
00000400:00000200:20.0:1773851887.086906:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769876:8769876:1024:4294967295] 23905@kfi7 LPNI seq info [12507697:12507697:16:4294967295]
00000400:00000200:20.0:1773851887.086908:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ae3996da nid 23905@kfi7 refs 2
00000400:00000200:20.0:1773851887.086909:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23905@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.086911:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23905@kfi7(23905@kfi7:23905@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851887.086912:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ae3996da nid 23905@kfi7 refs 3
00000800:00000200:20.0:1773851887.086913:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851887.086915:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851887.086917:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851887.086919:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000aa3 Using peer 23905@kfi7(0x100000000000aa3)
00000800:00000200:20.0:1773851887.086922:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x100000000000aa3: rc=0
00000800:00000200:20.0:1773851887.086923:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000aa3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851887.086925:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.086926:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b4207736 refcount 2 to 23904@kfi7
00010000:00000001:20.0:1773851887.086927:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851887.086928:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.086928:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851887.086929:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000065814e7b x1858042960062080/t0(0) o400->7e34ce8a-ffc3-4ec3-bcdf-1eb7eb829e2d@23904@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1984-0'
00000100:00100000:20.0:1773851887.086932:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065814e7b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:7e34ce8a-ffc3-4ec3-bcdf-1eb7eb829e2d+6:39812:x1858042960062080:12345-23904@kfi7:400:default-tuolumne1984-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851887.086935:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23904@kfi7, seq: 1998040
00000100:00000040:20.0:1773851887.086935:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000934d1eeb : new rpc_count 0
00000100:00000001:20.0:1773851887.086936:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851887.086937:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851887.086937:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.086938:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000afae15a5.
00000020:00000010:20.0:1773851887.086939:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aeeb6e1.
00000020:00000040:20.0:1773851887.086940:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000934d1eeb : new refcount 5
00000100:00000001:20.0:1773851887.086940:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851887.086945:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000aa3 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851887.086946:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.086947:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23905@kfi7: PUT: OK
00000400:00000200:21.0:1773851887.086948:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e899d2a0
00000400:00000010:21.0:1773851887.086949:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e899d2a0.
00000100:00000001:21.0:1773851887.086949:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851887.086950:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851887.086951:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ae3996da nid 23905@kfi7 refs 2
00000800:00000200:21.0:1773851887.086952:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23905@kfi7(0000000075940674):0x0 lsk 2724 rsk 57 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000aa3 Transaction freed
00000800:00000200:21.0:1773851887.091303:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851887.091304:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851887.091305:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851887.091307:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851887.091309:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16674@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.091310:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16674@kfi7 : PUT - for me
00000400:00000200:21.0:1773851887.091311:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16674@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.091312:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068d37f53 nid 16674@kfi7 refs 1
00000400:00000200:21.0:1773851887.091313:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16674@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.091314:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068d37f53 nid 16674@kfi7 refs 2
00000400:00000200:21.0:1773851887.091315:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000068d37f53 nid 16674@kfi7 refs 3
00000400:00000200:21.0:1773851887.091316:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16866@kfi7 to cpt 0
00000400:00000200:21.0:1773851887.091317:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16866@kfi7 of length 224 into portal 12 MB=0x699e0f4fcb080
00000400:00000200:21.0:1773851887.091317:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16866@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 54840
00000800:00000200:21.0:1773851887.091319:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851887.091320:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.091321:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16674@kfi7: PUT: OK
00000100:00000001:21.0:1773851887.091321:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851887.091322:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851887.091322:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aebbb58d.
00000100:00000040:21.0:1773851887.091323:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000aebbb58d x1858041322188928 msgsize 224
00000100:00100000:21.0:1773851887.091324:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16866@kfi7 (source: 12345-16674@kfi7)
00000100:00000001:21.0:1773851887.091325:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851887.091326:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000068d37f53 nid 16674@kfi7 refs 2
00000800:00000200:21.0:1773851887.091326:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851887.091326:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851887.091327:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851887.091327:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851887.091327:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851887.091329:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851887.091329:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041322188928
00000020:00000001:20.0:1773851887.091329:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851887.091330:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926e3
00000020:00000001:20.0:1773851887.091330:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851887.091332:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c28ba40e refcount=6
00000020:00000001:20.0:1773851887.091333:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631279616 : -107123078272000 : ffff9e9276f8ec00)
00000020:00000001:20.0:1773851887.091333:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631279616 : -107123078272000 : ffff9e9276f8ec00)
00000100:00000001:20.0:1773851887.091334:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.091335:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851887.091336:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aeeb6e1.
00000020:00000010:20.0:1773851887.091336:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.091337:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000afae15a5.
00000100:00000001:20.0:1773851887.091338:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851887.091338:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851887.091339:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851887.091339:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851887.091340:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851887.091340:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.091341:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851887.091342:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.091342:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.091342:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851887.091343:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851887.091343:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16866@kfi7, seq: 1998041
00000100:00000001:23.0:1773851887.091344:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851887.091344:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.091344:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c28ba40e : new rpc_count 1
00000100:00000001:20.0:1773851887.091344:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956261504 : -106937753290112 : ffff9ebd9d33ba80)
00000100:00000040:20.0:1773851887.091345:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aebbb58d x1858041322188928/t0(0) o400->ca33e40d-5815-4e8a-ad00-f0c75b1393c7@16866@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1531-0'
00000100:00000001:20.0:1773851887.091348:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.091348:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851887.091349:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aebbb58d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ca33e40d-5815-4e8a-ad00-f0c75b1393c7+6:39699:x1858041322188928:12345-16866@kfi7:400:default-tuolumne1531-0
00000100:00000200:20.0:1773851887.091350:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041322188928
00000020:00000001:20.0:1773851887.091351:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851887.091351:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851887.091352:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.091352:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851887.091353:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851887.091354:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851887.091354:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041322188928, found 0 last_xid 1858041322188927
00000020:00000001:20.0:1773851887.091355:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851887.091355:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851887.091356:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851887.091356:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.091357:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851887.091357:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851887.091357:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851887.091358:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005048af2c.
02000000:00000001:20.0:1773851887.091359:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.091359:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.091360:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851887.091360:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044135346, transno 0, xid 1858041322188928
00010000:00000001:20.0:1773851887.091361:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851887.091362:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aebbb58d x1858041322188928/t0(0) o400->ca33e40d-5815-4e8a-ad00-f0c75b1393c7@16866@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1531-0'
00010000:00000001:20.0:1773851887.091364:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851887.091364:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851887.091365:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=120 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851887.091366:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851887.091367:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cabd8370 refcount 3 to 16866@kfi7
00000100:00000001:20.0:1773851887.091367:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002368 : -107146751549248 : ffff9e8cf3ef60c0)
02000000:00000001:20.0:1773851887.091368:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851887.091368:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.091369:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851887.091369:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16674@kfi7
00000400:00000010:20.0:1773851887.091370:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047febb4e.
00000100:00000200:20.0:1773851887.091371:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041322188928, offset 224
00000400:00000200:20.0:1773851887.091372:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16674@kfi7
00000400:00000200:20.0:1773851887.091372:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16674@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.091374:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068d37f53 nid 16674@kfi7 refs 1
00000400:00000200:20.0:1773851887.091375:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000068d37f53 nid 16674@kfi7 refs 2
00000400:00000200:20.0:1773851887.091376:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000068d37f53 nid 16674@kfi7 refs 3
00000400:00000200:20.0:1773851887.091377:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16674@kfi7 local destination
00000400:00000200:20.0:1773851887.091378:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769877:8769877:1024:4294967295] 16674@kfi7 LPNI seq info [285950:285950:16:4294967295]
00000400:00000200:20.0:1773851887.091380:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000068d37f53 nid 16674@kfi7 refs 2
00000400:00000200:20.0:1773851887.091380:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16674@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.091382:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16674@kfi7(16674@kfi7:16674@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851887.091383:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000068d37f53 nid 16674@kfi7 refs 3
00000800:00000200:20.0:1773851887.091384:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851887.091385:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851887.091387:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851887.091389:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000eb9 Using peer 16674@kfi7(0x100000000000eb9)
00000800:00000200:20.0:1773851887.091391:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x100000000000eb9: rc=0
00000800:00000200:20.0:1773851887.091393:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000eb9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851887.091394:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.091395:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cabd8370 refcount 2 to 16866@kfi7
00010000:00000001:20.0:1773851887.091395:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851887.091396:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.091396:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851887.091397:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aebbb58d x1858041322188928/t0(0) o400->ca33e40d-5815-4e8a-ad00-f0c75b1393c7@16866@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1531-0'
00000100:00100000:20.0:1773851887.091400:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aebbb58d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ca33e40d-5815-4e8a-ad00-f0c75b1393c7+6:39699:x1858041322188928:12345-16866@kfi7:400:default-tuolumne1531-0 Request processed in 51us (76us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851887.091402:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16866@kfi7, seq: 1998041
00000100:00000040:20.0:1773851887.091403:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c28ba40e : new rpc_count 0
00000100:00000001:20.0:1773851887.091403:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851887.091404:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851887.091404:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.091405:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000afae15a5.
00000020:00000010:20.0:1773851887.091406:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aeeb6e1.
00000020:00000040:20.0:1773851887.091406:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000c28ba40e : new refcount 5
00000100:00000001:20.0:1773851887.091407:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851887.091411:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000eb9 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851887.091413:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.091414:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16674@kfi7: PUT: OK
00000400:00000200:21.0:1773851887.091414:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047febb4e
00000400:00000010:21.0:1773851887.091415:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047febb4e.
00000100:00000001:21.0:1773851887.091415:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851887.091415:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851887.091416:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000068d37f53 nid 16674@kfi7 refs 2
00000800:00000200:21.0:1773851887.091417:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 16674@kfi7(000000001f29d0e2):0x0 lsk 3770 rsk 55 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000eb9 Transaction freed
00000800:00000200:21.0:1773851887.131839:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851887.131839:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851887.131840:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851887.131842:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851887.131845:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18051@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.131845:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18051@kfi7 : PUT - for me
00000400:00000200:21.0:1773851887.131846:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18051@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.131847:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f89ba938 nid 18051@kfi7 refs 1
00000400:00000200:21.0:1773851887.131848:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18051@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.131849:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f89ba938 nid 18051@kfi7 refs 2
00000400:00000200:21.0:1773851887.131850:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f89ba938 nid 18051@kfi7 refs 3
00000400:00000200:21.0:1773851887.131850:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17986@kfi7 to cpt 6
00000400:00000200:21.0:1773851887.131851:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17986@kfi7 of length 224 into portal 12 MB=0x69b823fc70040
00000400:00000200:21.0:1773851887.131852:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17986@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 55064
00000800:00000200:21.0:1773851887.131853:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851887.131854:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.131855:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18051@kfi7: PUT: OK
00000100:00000001:21.0:1773851887.131856:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851887.131856:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851887.131857:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d33935e.
00000100:00000040:21.0:1773851887.131857:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009d33935e x1859833578324032 msgsize 224
00000100:00100000:21.0:1773851887.131859:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17986@kfi7 (source: 12345-18051@kfi7)
00000100:00000001:21.0:1773851887.131859:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851887.131860:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f89ba938 nid 18051@kfi7 refs 2
00000800:00000200:21.0:1773851887.131861:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851887.131861:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851887.131861:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851887.131861:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851887.131862:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851887.131862:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851887.131863:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833578324032
00000020:00000001:20.0:1773851887.131863:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851887.131863:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875d33f5e0
00000020:00000001:20.0:1773851887.131864:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851887.131867:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b2b099fe refcount=5
00000020:00000001:20.0:1773851887.131867:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029442761728 : -107044266789888 : ffff9ea4d080b400)
00000020:00000001:20.0:1773851887.131868:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029442761728 : -107044266789888 : ffff9ea4d080b400)
00000100:00000001:20.0:1773851887.131869:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.131869:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851887.131870:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aeeb6e1.
00000020:00000010:20.0:1773851887.131870:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.131871:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000afae15a5.
00000100:00000001:20.0:1773851887.131872:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851887.131872:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851887.131872:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851887.131873:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851887.131873:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851887.131874:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.131874:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851887.131875:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851887.131876:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851887.131876:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851887.131876:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851887.131877:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17986@kfi7, seq: 1998042
00000100:00000001:23.0:1773851887.131878:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851887.131878:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.131878:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b2b099fe : new rpc_count 1
00000100:00000001:20.0:1773851887.131878:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956273024 : -106937753278592 : ffff9ebd9d33e780)
00000100:00000040:20.0:1773851887.131879:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009d33935e x1859833578324032/t0(0) o400->b90d7e3a-2d08-4d22-ac48-683306ce2c90@17986@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1624-0'
00000100:00000001:20.0:1773851887.131882:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.131882:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851887.131883:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d33935e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b90d7e3a-2d08-4d22-ac48-683306ce2c90+5:39818:x1859833578324032:12345-17986@kfi7:400:default-tuolumne1624-0
00000100:00000200:20.0:1773851887.131884:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833578324032
00000020:00000001:20.0:1773851887.131884:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851887.131885:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851887.131885:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.131886:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851887.131886:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851887.131887:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851887.131887:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833578324032, found 0 last_xid 1859833578324031
00000020:00000001:20.0:1773851887.131888:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851887.131889:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851887.131889:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851887.131889:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.131890:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851887.131890:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851887.131891:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851887.131893:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b68a6125.
02000000:00000001:20.0:1773851887.131893:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.131894:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.131894:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851887.131895:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262833020, transno 0, xid 1859833578324032
00010000:00000001:20.0:1773851887.131896:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851887.131896:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009d33935e x1859833578324032/t0(0) o400->b90d7e3a-2d08-4d22-ac48-683306ce2c90@17986@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1624-0'
00010000:00000001:20.0:1773851887.131899:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851887.131899:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851887.131900:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=120 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851887.131901:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851887.131901:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3d33ed5 refcount 3 to 17986@kfi7
00000100:00000001:20.0:1773851887.131902:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860704 : -107149578690912 : ffff9e8c4b6c9ea0)
02000000:00000001:20.0:1773851887.131903:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851887.131903:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.131904:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851887.131904:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18051@kfi7
00000400:00000010:20.0:1773851887.131905:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b0b46066.
00000100:00000200:20.0:1773851887.131905:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833578324032, offset 224
00000400:00000200:20.0:1773851887.131907:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18051@kfi7
00000400:00000200:20.0:1773851887.131907:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18051@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.131908:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f89ba938 nid 18051@kfi7 refs 1
00000400:00000200:20.0:1773851887.131909:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f89ba938 nid 18051@kfi7 refs 2
00000400:00000200:20.0:1773851887.131910:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f89ba938 nid 18051@kfi7 refs 3
00000400:00000200:20.0:1773851887.131911:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18051@kfi7 local destination
00000400:00000200:20.0:1773851887.131912:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769878:8769878:1024:4294967295] 18051@kfi7 LPNI seq info [503616:503616:16:4294967295]
00000400:00000200:20.0:1773851887.131913:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f89ba938 nid 18051@kfi7 refs 2
00000400:00000200:20.0:1773851887.131914:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18051@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.131916:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18051@kfi7(18051@kfi7:18051@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851887.131916:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f89ba938 nid 18051@kfi7 refs 3
00000800:00000200:20.0:1773851887.131918:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851887.131919:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851887.131920:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851887.131922:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1286 Using peer 18051@kfi7(0x1286)
00000800:00000200:20.0:1773851887.131926:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x1286: rc=0
00000800:00000200:20.0:1773851887.131927:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1286 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851887.131932:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.131933:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3d33ed5 refcount 2 to 17986@kfi7
00010000:00000001:20.0:1773851887.131934:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851887.131934:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.131936:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851887.131936:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d33935e x1859833578324032/t0(0) o400->b90d7e3a-2d08-4d22-ac48-683306ce2c90@17986@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1624-0'
00000100:00100000:20.0:1773851887.131939:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d33935e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b90d7e3a-2d08-4d22-ac48-683306ce2c90+5:39818:x1859833578324032:12345-17986@kfi7:400:default-tuolumne1624-0 Request processed in 57us (81us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851887.131941:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17986@kfi7, seq: 1998042
00000100:00000040:20.0:1773851887.131942:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b2b099fe : new rpc_count 0
00000100:00000001:20.0:1773851887.131943:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851887.131943:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851887.131944:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.131944:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000afae15a5.
00000020:00000010:20.0:1773851887.131945:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aeeb6e1.
00000020:00000040:20.0:1773851887.131946:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b2b099fe : new refcount 4
00000100:00000001:20.0:1773851887.131947:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851887.131951:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1286 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851887.131953:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.131954:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18051@kfi7: PUT: OK
00000400:00000200:21.0:1773851887.131954:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b0b46066
00000400:00000010:21.0:1773851887.131955:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b0b46066.
00000100:00000001:21.0:1773851887.131955:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851887.131955:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851887.131957:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f89ba938 nid 18051@kfi7 refs 2
00000800:00000200:21.0:1773851887.131958:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 18051@kfi7(00000000f2d5251f):0x0 lsk 4743 rsk 14 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1286 Transaction freed
00000800:00000200:17.0:1773851887.133783:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851887.133784:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851887.133785:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851887.133787:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851887.133789:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9427@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.133790:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9427@kfi7 : PUT - for me
00000400:00000200:17.0:1773851887.133791:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9427@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.133792:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 1
00000400:00000200:17.0:1773851887.133793:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9427@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.133794:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 2
00000400:00000200:17.0:1773851887.133794:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 3
00000400:00000200:17.0:1773851887.133795:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9426@kfi7 to cpt 1
00000400:00000200:17.0:1773851887.133796:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9426@kfi7 of length 224 into portal 12 MB=0x699e153830000
00000400:00000200:17.0:1773851887.133798:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9426@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 37136
00000800:00000200:17.0:1773851887.133799:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851887.133801:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851887.133802:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9427@kfi7: PUT: OK
00000100:00000001:17.0:1773851887.133803:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851887.133803:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851887.133804:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f67a5989.
00000100:00000040:17.0:1773851887.133805:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f67a5989 x1858042908049408 msgsize 224
00000100:00100000:17.0:1773851887.133806:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9426@kfi7 (source: 12345-9427@kfi7)
00000100:00000001:17.0:1773851887.133807:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851887.133809:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 2
00000800:00000200:17.0:1773851887.133810:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851887.133813:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851887.133813:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851887.133814:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851887.133814:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851887.133815:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851887.133816:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042908049408
00000020:00000001:17.0:1773851887.133816:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851887.133817:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9158d
00000020:00000001:17.0:1773851887.133817:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851887.133821:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8700ccf refcount=6
00000020:00000001:17.0:1773851887.133821:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241024512 : -107152468527104 : ffff9e8b9f2d3800)
00000020:00000001:17.0:1773851887.133822:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241024512 : -107152468527104 : ffff9e8b9f2d3800)
00000100:00000001:17.0:1773851887.133823:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851887.133824:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851887.133824:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851887.133825:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851887.133826:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851887.133827:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851887.133828:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851887.133828:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851887.133829:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851887.133829:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851887.133830:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.133831:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851887.133832:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851887.133832:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851887.133832:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851887.133832:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851887.133833:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9426@kfi7, seq: 2156398
00000100:00000040:17.0:1773851887.133834:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8700ccf : new rpc_count 1
00000100:00000001:17.0:1773851887.133834:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102225792 : -107041607325824 : ffff9ea56f04e780)
00000100:00000001:16.0:1773851887.133834:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851887.133835:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f67a5989 x1858042908049408/t0(0) o400->742d9d97-1f5c-4fc9-8427-a448d7a2ffe5@9426@kfi7:139/0 lens 224/0 e 0 to 0 dl 1773852254 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1077-0'
00000100:00000001:16.0:1773851887.133835:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.133841:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851887.133841:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851887.133842:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f67a5989 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:742d9d97-1f5c-4fc9-8427-a448d7a2ffe5+6:39882:x1858042908049408:12345-9426@kfi7:400:default-tuolumne1077-0
00000100:00000200:17.0:1773851887.133843:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042908049408
00000020:00000001:17.0:1773851887.133844:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851887.133845:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851887.133845:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.133846:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851887.133846:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851887.133847:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851887.133848:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042908049408, found 0 last_xid 1858042908049407
00000020:00000001:17.0:1773851887.133848:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851887.133849:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851887.133850:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851887.133850:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.133851:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851887.133851:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851887.133852:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851887.133853:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004417a97c.
02000000:00000001:17.0:1773851887.133853:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.133854:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.133854:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851887.133855:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183072461622, transno 0, xid 1858042908049408
00010000:00000001:17.0:1773851887.133856:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851887.133856:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f67a5989 x1858042908049408/t0(0) o400->742d9d97-1f5c-4fc9-8427-a448d7a2ffe5@9426@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1077-0'
00010000:00000001:17.0:1773851887.133859:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851887.133859:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851887.133860:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=120 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851887.133861:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851887.133862:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002070a02e refcount 3 to 9426@kfi7
00000100:00000001:17.0:1773851887.133863:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231614240 : -107130477937376 : ffff9e90bdeafd20)
02000000:00000001:17.0:1773851887.133864:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851887.133864:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.133865:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851887.133866:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9427@kfi7
00000400:00000010:17.0:1773851887.133866:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057d98c22.
00000100:00000200:17.0:1773851887.133867:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042908049408, offset 224
00000400:00000200:17.0:1773851887.133868:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9427@kfi7
00000400:00000200:17.0:1773851887.133869:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9427@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.133870:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 1
00000400:00000200:17.0:1773851887.133871:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 2
00000400:00000200:17.0:1773851887.133872:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 3
00000400:00000200:17.0:1773851887.133873:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9427@kfi7 local destination
00000400:00000200:17.0:1773851887.133874:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769879:8769879:1024:4294967295] 9427@kfi7 LPNI seq info [15784837:15784837:16:4294967295]
00000400:00000200:17.0:1773851887.133875:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 2
00000400:00000200:17.0:1773851887.133876:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9427@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.133878:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9427@kfi7(9427@kfi7:9427@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851887.133879:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 3
00000800:00000200:17.0:1773851887.133880:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851887.133881:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851887.133883:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851887.133885:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000062c Using peer 9427@kfi7(0x10000000000062c)
00000800:00000200:17.0:1773851887.133888:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x10000000000062c: rc=0
00000800:00000200:17.0:1773851887.133890:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000062c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851887.133892:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851887.133892:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002070a02e refcount 2 to 9426@kfi7
00010000:00000001:17.0:1773851887.133893:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851887.133894:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.133894:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851887.133895:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f67a5989 x1858042908049408/t0(0) o400->742d9d97-1f5c-4fc9-8427-a448d7a2ffe5@9426@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1077-0'
00000100:00100000:17.0:1773851887.133898:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f67a5989 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:742d9d97-1f5c-4fc9-8427-a448d7a2ffe5+6:39882:x1858042908049408:12345-9426@kfi7:400:default-tuolumne1077-0 Request processed in 56us (92us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851887.133901:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9426@kfi7, seq: 2156398
00000800:00000200:18.0:1773851887.133902:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000062c TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851887.133902:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8700ccf : new rpc_count 0
00000100:00000001:17.0:1773851887.133902:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851887.133903:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851887.133903:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000400:00000200:18.0:1773851887.133904:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851887.133904:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000400:00000200:18.0:1773851887.133905:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9427@kfi7: PUT: OK
00000020:00000010:17.0:1773851887.133905:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000400:00000200:18.0:1773851887.133906:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057d98c22
00000020:00000040:17.0:1773851887.133906:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000a8700ccf : new refcount 5
00000100:00000001:17.0:1773851887.133906:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:18.0:1773851887.133907:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057d98c22.
00000100:00000001:18.0:1773851887.133907:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851887.133908:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851887.133909:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fa6e4e95 nid 9427@kfi7 refs 2
00000800:00000200:18.0:1773851887.133910:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 9427@kfi7(000000007f1b5455):0x0 lsk 1581 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000062c Transaction freed
00000800:00000200:9.0:1773851887.248631:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.248632:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851887.248633:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851887.248636:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851887.248637:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.248639:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18579@kfi7 : PUT - for me
00000400:00000200:9.0:1773851887.248640:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.248640:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 1
00000400:00000200:9.0:1773851887.248641:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.248642:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000400:00000200:9.0:1773851887.248643:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 3
00000400:00000200:9.0:1773851887.248644:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18514@kfi7 to cpt 3
00000400:00000200:9.0:1773851887.248644:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18514@kfi7 of length 456 into portal 12 MB=0x69b4b7e6f7a80
00000400:00000200:9.0:1773851887.248646:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18514@kfi7 of length 456/456 into md 0x78146ce49 [64] + 150920
00000800:00000200:9.0:1773851887.248648:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851887.248649:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.248651:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18579@kfi7: PUT: OK
00000100:00000001:9.0:1773851887.248652:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851887.248652:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851887.248653:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001e321628.
00000100:00000040:9.0:1773851887.248654:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000001e321628 x1859598406351488 msgsize 456
00000100:00100000:9.0:1773851887.248655:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18514@kfi7 (source: 12345-18579@kfi7)
00000100:00000001:9.0:1773851887.248657:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851887.248658:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000800:00000200:9.0:1773851887.248660:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851887.248662:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851887.248663:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851887.248663:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851887.248664:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851887.248665:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851887.248665:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598406351488
00000020:00000001:9.0:1773851887.248666:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851887.248667:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81d36
00000020:00000001:9.0:1773851887.248667:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851887.248669:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b29dcde6 refcount=3760
00000020:00000001:9.0:1773851887.248669:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144186622976 : -106929522928640 : ffff9ebf87c51400)
00000020:00000001:9.0:1773851887.248670:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144186622976 : -106929522928640 : ffff9ebf87c51400)
00000100:00000001:9.0:1773851887.248671:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851887.248672:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851887.248673:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ede84d6e.
00000020:00000010:9.0:1773851887.248674:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c8fc5a75.
00000020:00000010:9.0:1773851887.248675:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008e3d6b9d.
00000100:00000001:9.0:1773851887.248675:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851887.248676:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851887.248676:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.248678:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.248679:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.248680:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851887.248680:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851887.248681:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851887.248681:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851887.248682:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18514@kfi7, seq: 406391012
00000100:00000001:9.0:1773851887.248683:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851887.248683:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b29dcde6 : new rpc_count 11
00000100:00000001:9.0:1773851887.248684:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.248684:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856895744 : -106914852655872 : ffff9ec2f22fad00)
00000100:00000040:8.0:1773851887.248685:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001e321628 x1859598406351488/t0(0) o17->58d48bdb-5878-492a-901c-b1eaffa8fbe6@18514@kfi7:614/0 lens 456/0 e 0 to 0 dl 1773851974 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1654-0'
00000100:00000001:8.0:1773851887.248688:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851887.248689:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851887.248690:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e321628 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:58d48bdb-5878-492a-901c-b1eaffa8fbe6+3760:39556:x1859598406351488:12345-18514@kfi7:17:default-tuolumne1654-0
00000100:00000200:8.0:1773851887.248691:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598406351488
00000020:00000001:8.0:1773851887.248692:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851887.248693:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851887.248694:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.248694:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851887.248695:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:8.0:1773851887.248696:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851887.248697:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598406351488, found 0 last_xid 1859598405617727
00000020:00000001:8.0:1773851887.248697:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851887.248698:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851887.248699:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851887.248700:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851887.248701:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:8.0:1773851887.248702:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851887.248702:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851887.248703:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000008b049985.
02000000:00000001:8.0:1773851887.248704:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.248705:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.248706:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:8.0:1773851887.248706:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:8.0:1773851887.248707:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:8.0:1773851887.248709:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.248709:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:8.0:1773851887.248710:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 58d48bdb-5878-492a-901c-b1eaffa8fbe6/00000000b29dcde6 free: 126633370845184 avail: 126633368748032
00000020:00000001:8.0:1773851887.248711:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:8.0:1773851887.248712:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 58d48bdb-5878-492a-901c-b1eaffa8fbe6/00000000b29dcde6 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:8.0:1773851887.248713:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:8.0:1773851887.248714:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:8.0:1773851887.248715:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 58d48bdb-5878-492a-901c-b1eaffa8fbe6/00000000b29dcde6 reports grant 1807220735 dropped 0, local 1882456063
00000020:00000001:8.0:1773851887.248716:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:8.0:1773851887.248717:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:8.0:1773851887.248717:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851887.248718:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592359, transno 0, xid 1859598406351488
00010000:00000001:8.0:1773851887.248719:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851887.248720:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001e321628 x1859598406351488/t0(0) o17->58d48bdb-5878-492a-901c-b1eaffa8fbe6@18514@kfi7:614/0 lens 456/432 e 0 to 0 dl 1773851974 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1654-0'
00010000:00000001:8.0:1773851887.248722:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851887.248723:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851887.248724:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=120 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851887.248728:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851887.248729:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006d4ea050 refcount 3 to 18514@kfi7
00000100:00000001:8.0:1773851887.248730:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298496 : -107155980253120 : ffff9e8acddc8840)
02000000:00000001:8.0:1773851887.248731:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851887.248732:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.248733:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851887.248734:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18579@kfi7
00000400:00000010:8.0:1773851887.248734:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ce37ba88.
00000100:00000200:8.0:1773851887.248735:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598406351488, offset 224
00000400:00000200:8.0:1773851887.248737:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18579@kfi7
00000400:00000200:8.0:1773851887.248738:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:8.0:1773851887.248739:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 1
00000400:00000200:8.0:1773851887.248740:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000400:00000200:8.0:1773851887.248741:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 3
00000400:00000200:8.0:1773851887.248743:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18579@kfi7 local destination
00000400:00000200:8.0:1773851887.248744:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769880:8769880:1024:4294967295] 18579@kfi7 LPNI seq info [7936756:7936756:16:4294967295]
00000400:00000200:8.0:1773851887.248746:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000400:00000200:8.0:1773851887.248746:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18579@kfi7 to cpt 2
00000400:00000200:8.0:1773851887.248748:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18579@kfi7(18579@kfi7:18579@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851887.248750:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 3
00000800:00000200:8.0:1773851887.248752:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851887.248753:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:8.0:1773851887.248755:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851887.248758:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x770 Using peer 18579@kfi7(0x770)
00000800:00000200:8.0:1773851887.248762:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 532 bytes to peer 0x770: rc=0
00000800:00000200:8.0:1773851887.248763:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x770 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851887.248765:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851887.248766:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006d4ea050 refcount 2 to 18514@kfi7
00010000:00000001:8.0:1773851887.248767:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851887.248768:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.248768:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851887.248770:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001e321628 x1859598406351488/t0(0) o17->58d48bdb-5878-492a-901c-b1eaffa8fbe6@18514@kfi7:614/0 lens 456/432 e 0 to 0 dl 1773851974 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1654-0'
00000100:00100000:8.0:1773851887.248775:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e321628 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:58d48bdb-5878-492a-901c-b1eaffa8fbe6+3760:39556:x1859598406351488:12345-18514@kfi7:17:default-tuolumne1654-0 Request processed in 85us (120us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851887.248777:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18514@kfi7, seq: 406391012
00000100:00000040:8.0:1773851887.248778:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b29dcde6 : new rpc_count 10
00000100:00000001:8.0:1773851887.248779:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851887.248779:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851887.248780:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c8fc5a75.
00000020:00000010:8.0:1773851887.248781:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008e3d6b9d.
00000020:00000010:8.0:1773851887.248782:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ede84d6e.
00000020:00000040:8.0:1773851887.248783:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b29dcde6 : new refcount 3759
00000100:00000001:8.0:1773851887.248784:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851887.248789:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x770 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851887.248791:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.248792:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18579@kfi7: PUT: OK
00000400:00000200:9.0:1773851887.248793:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ce37ba88
00000400:00000010:9.0:1773851887.248794:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ce37ba88.
00000100:00000001:9.0:1773851887.248794:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851887.248795:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851887.248796:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000033d69046 nid 18579@kfi7 refs 2
00000800:00000200:9.0:1773851887.248797:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 18579@kfi7(000000009031a91e):0x0 lsk 1905 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x770 Transaction freed
00000800:00000200:17.0:1773851887.307284:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851887.307285:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851887.307286:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851887.307288:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851887.307290:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14082@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.307292:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14082@kfi7 : PUT - for me
00000400:00000200:17.0:1773851887.307293:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14082@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.307293:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009cd5c508 nid 14082@kfi7 refs 1
00000400:00000200:17.0:1773851887.307295:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14082@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.307295:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009cd5c508 nid 14082@kfi7 refs 2
00000400:00000200:17.0:1773851887.307296:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009cd5c508 nid 14082@kfi7 refs 3
00000400:00000200:17.0:1773851887.307297:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14082@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.307298:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14082@kfi7 of length 224 into portal 12 MB=0x69bad43306d40
00000400:00000200:17.0:1773851887.307299:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14082@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 37360
00000800:00000200:17.0:1773851887.307301:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851887.307303:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851887.307304:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14082@kfi7: PUT: OK
00000100:00000001:17.0:1773851887.307305:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851887.307305:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851887.307306:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ae676a8.
00000100:00000040:17.0:1773851887.307307:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000006ae676a8 x1860018319158592 msgsize 224
00000100:00100000:17.0:1773851887.307308:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14082@kfi7 (source: 12345-14082@kfi7)
00000100:00000001:17.0:1773851887.307310:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851887.307311:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009cd5c508 nid 14082@kfi7 refs 2
00000800:00000200:17.0:1773851887.307312:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851887.307314:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851887.307315:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851887.307315:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851887.307316:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851887.307316:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851887.307317:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860018319158592
00000020:00000001:17.0:1773851887.307318:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851887.307318:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a6a83e
00000020:00000001:17.0:1773851887.307319:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851887.307320:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007e1fec04 refcount=9
00000020:00000001:17.0:1773851887.307321:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134705291264 : -106939004260352 : ffff9ebd52a37000)
00000020:00000001:17.0:1773851887.307322:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134705291264 : -106939004260352 : ffff9ebd52a37000)
00000100:00000001:17.0:1773851887.307323:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851887.307324:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851887.307324:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851887.307325:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851887.307326:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851887.307327:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851887.307327:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851887.307328:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851887.307328:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851887.307329:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851887.307329:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.307330:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851887.307331:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851887.307332:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851887.307332:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851887.307332:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851887.307333:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14082@kfi7, seq: 2156399
00000100:00000040:17.0:1773851887.307334:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007e1fec04 : new rpc_count 1
00000100:00000001:17.0:1773851887.307334:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102222336 : -107041607329280 : ffff9ea56f04da00)
00000100:00000001:16.0:1773851887.307334:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851887.307334:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851887.307335:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ae676a8 x1860018319158592/t0(0) o400->0af21a81-b617-44f7-9853-1bb9301810dc@14082@kfi7:675/0 lens 224/0 e 0 to 0 dl 1773852035 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1383-0'
00000100:00000001:17.0:1773851887.307338:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851887.307338:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851887.307339:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ae676a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0af21a81-b617-44f7-9853-1bb9301810dc+9:40871:x1860018319158592:12345-14082@kfi7:400:default-tuolumne1383-0
00000100:00000200:17.0:1773851887.307341:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860018319158592
00000020:00000001:17.0:1773851887.307341:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851887.307342:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851887.307342:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.307343:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851887.307344:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851887.307344:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851887.307345:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860018319158592, found 0 last_xid 1860018319158591
00000020:00000001:17.0:1773851887.307346:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851887.307346:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851887.307347:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851887.307348:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.307348:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851887.307349:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851887.307349:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851887.307350:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bf7821e3.
02000000:00000001:17.0:1773851887.307350:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.307351:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.307352:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851887.307352:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860018319158592
00010000:00000001:17.0:1773851887.307354:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851887.307354:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ae676a8 x1860018319158592/t0(0) o400->0af21a81-b617-44f7-9853-1bb9301810dc@14082@kfi7:675/0 lens 224/224 e 0 to 0 dl 1773852035 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1383-0'
00010000:00000001:17.0:1773851887.307357:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851887.307357:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851887.307358:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=120 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851887.307359:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851887.307360:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003ae6a158 refcount 3 to 14082@kfi7
00000100:00000001:17.0:1773851887.307361:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583546240 : -107156126005376 : ffff9e8ac52c8780)
02000000:00000001:17.0:1773851887.307361:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851887.307362:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.307363:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851887.307363:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14082@kfi7
00000400:00000010:17.0:1773851887.307364:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003fab839b.
00000100:00000200:17.0:1773851887.307365:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860018319158592, offset 224
00000400:00000200:17.0:1773851887.307366:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14082@kfi7
00000400:00000200:17.0:1773851887.307367:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14082@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.307367:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009cd5c508 nid 14082@kfi7 refs 1
00000400:00000200:17.0:1773851887.307368:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009cd5c508 nid 14082@kfi7 refs 2
00000400:00000200:17.0:1773851887.307369:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009cd5c508 nid 14082@kfi7 refs 3
00000400:00000200:17.0:1773851887.307371:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14082@kfi7 local destination
00000400:00000200:17.0:1773851887.307372:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769881:8769881:1024:4294967295] 14082@kfi7 LPNI seq info [1495502:1495502:16:4294967295]
00000400:00000200:17.0:1773851887.307373:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009cd5c508 nid 14082@kfi7 refs 2
00000400:00000200:17.0:1773851887.307374:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14082@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.307376:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14082@kfi7(14082@kfi7:14082@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851887.307377:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009cd5c508 nid 14082@kfi7 refs 3
00000800:00000200:17.0:1773851887.307378:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851887.307379:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851887.307380:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851887.307383:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000546 Using peer 14082@kfi7(0x100000000000546)
00000800:00000200:17.0:1773851887.307386:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x100000000000546: rc=0
00000800:00000200:17.0:1773851887.307387:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000546 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851887.307389:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851887.307390:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003ae6a158 refcount 2 to 14082@kfi7
00010000:00000001:17.0:1773851887.307390:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851887.307391:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.307391:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851887.307392:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ae676a8 x1860018319158592/t0(0) o400->0af21a81-b617-44f7-9853-1bb9301810dc@14082@kfi7:675/0 lens 224/224 e 0 to 0 dl 1773852035 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1383-0'
00000100:00100000:17.0:1773851887.307395:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ae676a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0af21a81-b617-44f7-9853-1bb9301810dc+9:40871:x1860018319158592:12345-14082@kfi7:400:default-tuolumne1383-0 Request processed in 56us (87us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851887.307397:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14082@kfi7, seq: 2156399
00000100:00000040:17.0:1773851887.307398:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007e1fec04 : new rpc_count 0
00000100:00000001:17.0:1773851887.307399:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851887.307399:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851887.307400:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851887.307400:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000020:00000010:17.0:1773851887.307401:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000800:00000200:18.0:1773851887.307402:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000546 TN_EVENT_TX_OK event status 0
00000020:00000040:17.0:1773851887.307402:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007e1fec04 : new refcount 8
00000100:00000001:17.0:1773851887.307403:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851887.307404:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851887.307405:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14082@kfi7: PUT: OK
00000400:00000200:18.0:1773851887.307406:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003fab839b
00000400:00000010:18.0:1773851887.307406:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003fab839b.
00000100:00000001:18.0:1773851887.307407:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851887.307408:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851887.307408:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009cd5c508 nid 14082@kfi7 refs 2
00000800:00000200:18.0:1773851887.307410:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 14082@kfi7(000000009f7972d7):0x0 lsk 1351 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000546 Transaction freed
00000800:00000200:13.0:1773851887.332683:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851887.332684:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851887.332685:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851887.332687:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851887.332689:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24051@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.332690:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24051@kfi7 : PUT - for me
00000400:00000200:13.0:1773851887.332691:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24051@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.332692:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf588735 nid 24051@kfi7 refs 1
00000400:00000200:13.0:1773851887.332693:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24051@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.332694:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf588735 nid 24051@kfi7 refs 2
00000400:00000200:13.0:1773851887.332695:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cf588735 nid 24051@kfi7 refs 3
00000400:00000200:13.0:1773851887.332695:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24050@kfi7 to cpt 0
00000400:00000200:13.0:1773851887.332696:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24050@kfi7 of length 224 into portal 12 MB=0x699e1082f2ac0
00000400:00000200:13.0:1773851887.332698:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24050@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 45584
00000800:00000200:13.0:1773851887.332699:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851887.332701:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851887.332702:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24051@kfi7: PUT: OK
00000100:00000001:13.0:1773851887.332703:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851887.332703:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851887.332704:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e94cc1c2.
00000100:00000040:13.0:1773851887.332705:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000e94cc1c2 x1858041644264128 msgsize 224
00000100:00100000:13.0:1773851887.332706:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24050@kfi7 (source: 12345-24051@kfi7)
00000100:00000001:13.0:1773851887.332707:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851887.332708:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf588735 nid 24051@kfi7 refs 2
00000100:00000001:15.0:1773851887.332709:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851887.332710:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851887.332710:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851887.332710:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851887.332711:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851887.332711:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851887.332712:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041644264128
00000020:00000001:15.0:1773851887.332713:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851887.332713:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac919e6
00000020:00000001:15.0:1773851887.332714:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851887.332717:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c864781 refcount=6
00000020:00000001:15.0:1773851887.332717:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242230784 : -107152467320832 : ffff9e8b9f3fa000)
00000020:00000001:15.0:1773851887.332718:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242230784 : -107152467320832 : ffff9e8b9f3fa000)
00000100:00000001:15.0:1773851887.332719:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851887.332720:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851887.332721:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851887.332722:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851887.332723:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003a6700ff.
00000100:00000001:15.0:1773851887.332724:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851887.332724:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851887.332727:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851887.332728:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851887.332728:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851887.332729:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851887.332729:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851887.332731:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851887.332731:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851887.332732:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851887.332732:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851887.332733:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24050@kfi7, seq: 2289896
00000100:00000001:15.0:1773851887.332734:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851887.332734:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c864781 : new rpc_count 1
00000100:00000001:15.0:1773851887.332735:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.332735:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485613056 : -107000223938560 : ffff9eaf11a94800)
00000100:00000040:12.0:1773851887.332736:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e94cc1c2 x1858041644264128/t0(0) o400->f0131d5b-9e2f-4123-92b8-546846ec620f@24050@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1977-0'
00000100:00000001:12.0:1773851887.332739:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851887.332740:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851887.332741:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e94cc1c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f0131d5b-9e2f-4123-92b8-546846ec620f+6:39651:x1858041644264128:12345-24050@kfi7:400:default-tuolumne1977-0
00000100:00000200:12.0:1773851887.332742:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041644264128
00000020:00000001:12.0:1773851887.332743:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851887.332744:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851887.332745:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.332745:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851887.332746:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851887.332747:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851887.332747:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041644264128, found 0 last_xid 1858041644264127
00000020:00000001:12.0:1773851887.332748:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851887.332749:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851887.332750:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851887.332750:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.332752:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851887.332752:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851887.332753:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851887.332754:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007d88af77.
02000000:00000001:12.0:1773851887.332754:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.332755:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.332756:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851887.332757:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260441645, transno 0, xid 1858041644264128
00010000:00000001:12.0:1773851887.332758:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851887.332758:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e94cc1c2 x1858041644264128/t0(0) o400->f0131d5b-9e2f-4123-92b8-546846ec620f@24050@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1977-0'
00010000:00000001:12.0:1773851887.332761:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851887.332761:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851887.332762:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=120 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851887.332763:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851887.332764:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b3412e71 refcount 3 to 24050@kfi7
00000100:00000001:12.0:1773851887.332765:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049568 : -107154804502048 : ffff9e8b13f111e0)
02000000:00000001:12.0:1773851887.332766:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851887.332766:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.332767:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851887.332768:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24051@kfi7
00000400:00000010:12.0:1773851887.332768:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3dfef6f.
00000100:00000200:12.0:1773851887.332769:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041644264128, offset 224
00000400:00000200:12.0:1773851887.332771:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24051@kfi7
00000400:00000200:12.0:1773851887.332772:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24051@kfi7 to cpt 3
00000400:00000200:12.0:1773851887.332773:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf588735 nid 24051@kfi7 refs 1
00000400:00000200:12.0:1773851887.332774:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cf588735 nid 24051@kfi7 refs 2
00000400:00000200:12.0:1773851887.332775:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cf588735 nid 24051@kfi7 refs 3
00000400:00000200:12.0:1773851887.332776:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24051@kfi7 local destination
00000400:00000200:12.0:1773851887.332778:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769882:8769882:1024:4294967295] 24051@kfi7 LPNI seq info [9945935:9945935:16:4294967295]
00000400:00000200:12.0:1773851887.332779:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cf588735 nid 24051@kfi7 refs 2
00000400:00000200:12.0:1773851887.332780:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24051@kfi7 to cpt 3
00000400:00000200:12.0:1773851887.332782:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24051@kfi7(24051@kfi7:24051@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851887.332783:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cf588735 nid 24051@kfi7 refs 3
00000800:00000200:12.0:1773851887.332785:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851887.332786:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851887.332788:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851887.332790:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1bf Using peer 24051@kfi7(0x1bf)
00000800:00000200:12.0:1773851887.332793:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x1bf: rc=0
00000800:00000200:12.0:1773851887.332795:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1bf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851887.332797:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851887.332798:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b3412e71 refcount 2 to 24050@kfi7
00010000:00000001:12.0:1773851887.332799:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851887.332799:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.332800:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851887.332801:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e94cc1c2 x1858041644264128/t0(0) o400->f0131d5b-9e2f-4123-92b8-546846ec620f@24050@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1977-0'
00000100:00100000:12.0:1773851887.332806:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e94cc1c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f0131d5b-9e2f-4123-92b8-546846ec620f+6:39651:x1858041644264128:12345-24050@kfi7:400:default-tuolumne1977-0 Request processed in 65us (100us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851887.332808:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24050@kfi7, seq: 2289896
00000100:00000040:12.0:1773851887.332809:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c864781 : new rpc_count 0
00000100:00000001:12.0:1773851887.332809:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851887.332810:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851887.332811:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851887.332811:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003a6700ff.
00000020:00000010:12.0:1773851887.332812:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000020:00000040:12.0:1773851887.332813:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000000c864781 : new refcount 5
00000100:00000001:12.0:1773851887.332814:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851887.332819:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1bf TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851887.332822:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851887.332823:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24051@kfi7: PUT: OK
00000400:00000200:13.0:1773851887.332823:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3dfef6f
00000400:00000010:13.0:1773851887.332824:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3dfef6f.
00000100:00000001:13.0:1773851887.332825:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851887.332825:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851887.332826:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf588735 nid 24051@kfi7 refs 2
00000800:00000200:13.0:1773851887.332828:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 24051@kfi7(00000000d23be265):0x0 lsk 448 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1bf Transaction freed
00000800:00000200:21.0:1773851887.370016:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851887.370016:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851887.370018:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851887.370019:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851887.370021:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25858@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.370022:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25858@kfi7 : PUT - for me
00000400:00000200:21.0:1773851887.370023:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25858@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.370024:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 1
00000400:00000200:21.0:1773851887.370026:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25858@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.370026:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 2
00000400:00000200:21.0:1773851887.370027:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 3
00000400:00000200:21.0:1773851887.370028:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26051@kfi7 to cpt 2
00000400:00000200:21.0:1773851887.370028:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26051@kfi7 of length 224 into portal 12 MB=0x699e121549100
00000400:00000200:21.0:1773851887.370029:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26051@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 55288
00000800:00000200:21.0:1773851887.370031:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851887.370032:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.370033:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25858@kfi7: PUT: OK
00000100:00000001:21.0:1773851887.370034:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851887.370035:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851887.370035:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bffc48d5.
00000100:00000040:21.0:1773851887.370036:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000bffc48d5 x1858042066145536 msgsize 224
00000100:00100000:21.0:1773851887.370037:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-26051@kfi7 (source: 12345-25858@kfi7)
00000100:00000001:21.0:1773851887.370038:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851887.370039:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 2
00000100:00000001:20.0:1773851887.370039:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851887.370040:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851887.370040:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851887.370040:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851887.370041:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851887.370042:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851887.370042:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042066145536
00000020:00000001:20.0:1773851887.370043:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851887.370044:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d2e
00000020:00000001:20.0:1773851887.370045:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851887.370048:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e6355fe3 refcount=6
00000020:00000001:20.0:1773851887.370049:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628511744 : -107123081039872 : ffff9e9276ceb000)
00000020:00000001:20.0:1773851887.370050:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628511744 : -107123081039872 : ffff9e9276ceb000)
00000100:00000001:20.0:1773851887.370051:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.370052:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851887.370053:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8e3d745.
00000020:00000010:20.0:1773851887.370054:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.370055:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000afae15a5.
00000100:00000001:20.0:1773851887.370056:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851887.370056:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851887.370057:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851887.370058:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851887.370058:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851887.370059:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.370060:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851887.370061:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.370061:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.370061:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851887.370062:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851887.370062:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26051@kfi7, seq: 1998043
00000100:00000001:23.0:1773851887.370063:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.370063:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e6355fe3 : new rpc_count 1
00000100:00000001:23.0:1773851887.370064:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.370064:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956269568 : -106937753282048 : ffff9ebd9d33da00)
00000100:00000040:20.0:1773851887.370065:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bffc48d5 x1858042066145536/t0(0) o400->d10ff672-fae7-4930-867b-0ba3f9ecd88b@26051@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2119-0'
00000100:00000001:20.0:1773851887.370068:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.370068:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851887.370069:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bffc48d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d10ff672-fae7-4930-867b-0ba3f9ecd88b+6:39636:x1858042066145536:12345-26051@kfi7:400:default-tuolumne2119-0
00000100:00000200:20.0:1773851887.370071:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042066145536
00000020:00000001:20.0:1773851887.370071:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851887.370072:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851887.370073:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.370073:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851887.370074:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851887.370074:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851887.370075:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042066145536, found 0 last_xid 1858042066145535
00000020:00000001:20.0:1773851887.370076:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851887.370077:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851887.370077:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851887.370077:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.370079:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851887.370079:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851887.370080:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851887.370081:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009aeeb6e1.
02000000:00000001:20.0:1773851887.370081:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.370082:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.370083:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851887.370083:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013970488, transno 0, xid 1858042066145536
00010000:00000001:20.0:1773851887.370084:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851887.370085:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bffc48d5 x1858042066145536/t0(0) o400->d10ff672-fae7-4930-867b-0ba3f9ecd88b@26051@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2119-0'
00010000:00000001:20.0:1773851887.370087:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851887.370088:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851887.370089:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=120 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851887.370090:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851887.370090:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000023f0e839 refcount 3 to 26051@kfi7
00000100:00000001:20.0:1773851887.370091:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526774144 : -107156182777472 : ffff9e8ac1ca4180)
02000000:00000001:20.0:1773851887.370092:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851887.370092:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.370093:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851887.370094:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25858@kfi7
00000400:00000010:20.0:1773851887.370095:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071e33c48.
00000100:00000200:20.0:1773851887.370095:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042066145536, offset 224
00000400:00000200:20.0:1773851887.370097:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25858@kfi7
00000400:00000200:20.0:1773851887.370098:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25858@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.370099:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 1
00000400:00000200:20.0:1773851887.370100:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 2
00000400:00000200:20.0:1773851887.370101:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 3
00000400:00000200:20.0:1773851887.370102:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25858@kfi7 local destination
00000400:00000200:20.0:1773851887.370103:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769883:8769883:1024:4294967295] 25858@kfi7 LPNI seq info [3557406:3557406:16:4294967295]
00000400:00000200:20.0:1773851887.370105:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 2
00000400:00000200:20.0:1773851887.370105:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25858@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.370107:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25858@kfi7(25858@kfi7:25858@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851887.370109:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 3
00000800:00000200:20.0:1773851887.370110:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851887.370112:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851887.370114:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851887.370116:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1191 Using peer 25858@kfi7(0x1191)
00000800:00000200:20.0:1773851887.370119:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x1191: rc=0
00000800:00000200:20.0:1773851887.370120:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851887.370122:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.370123:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000023f0e839 refcount 2 to 26051@kfi7
00010000:00000001:20.0:1773851887.370124:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851887.370124:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.370125:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851887.370126:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bffc48d5 x1858042066145536/t0(0) o400->d10ff672-fae7-4930-867b-0ba3f9ecd88b@26051@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2119-0'
00000100:00100000:20.0:1773851887.370130:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bffc48d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d10ff672-fae7-4930-867b-0ba3f9ecd88b+6:39636:x1858042066145536:12345-26051@kfi7:400:default-tuolumne2119-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851887.370132:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26051@kfi7, seq: 1998043
00000100:00000040:20.0:1773851887.370133:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e6355fe3 : new rpc_count 0
00000100:00000001:20.0:1773851887.370134:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851887.370134:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851887.370135:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.370136:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000afae15a5.
00000020:00000010:20.0:1773851887.370136:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8e3d745.
00000020:00000040:20.0:1773851887.370137:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000e6355fe3 : new refcount 5
00000100:00000001:20.0:1773851887.370138:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851887.370143:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1191 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851887.370144:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.370145:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25858@kfi7: PUT: OK
00000400:00000200:21.0:1773851887.370145:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071e33c48
00000400:00000010:21.0:1773851887.370146:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071e33c48.
00000100:00000001:21.0:1773851887.370146:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851887.370147:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851887.370147:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c4fb29c4 nid 25858@kfi7 refs 2
00000800:00000200:21.0:1773851887.370149:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 25858@kfi7(00000000edc8e4ac):0x0 lsk 4498 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1191 Transaction freed
00000800:00000200:17.0:1773851887.393033:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851887.393034:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851887.393035:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851887.393037:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851887.393039:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.393041:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.120@tcp : PUT - for me
00000400:00000200:17.0:1773851887.393042:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.393044:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851887.393045:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.120@tcp to cpt 4
00000400:00000200:17.0:1773851887.393046:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0312243 nid 172.16.70.120@tcp refs 2
00000400:00000200:17.0:1773851887.393048:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0312243 nid 172.16.70.120@tcp refs 3
00000400:00000200:17.0:1773851887.393049:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.120@tcp to cpt 4
00000400:00000200:17.0:1773851887.393050:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.120@tcp of length 224 into portal 12 MB=0x69a0e938b1640
00000400:00000200:17.0:1773851887.393051:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.120@tcp of length 224/224 into md 0x6ab01b5d1 [64] + 37584
00000800:00000200:17.0:1773851887.393053:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851887.393055:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851887.393056:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851887.393057:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851887.393057:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851887.393058:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a44d006a.
00000100:00000040:17.0:1773851887.393058:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a44d006a x1858237255849536 msgsize 224
00000100:00100000:17.0:1773851887.393060:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.120@tcp (source: 12345-172.16.70.120@tcp)
00000100:00000001:17.0:1773851887.393062:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851887.393063:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851887.393064:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851887.393066:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851887.393067:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851887.393067:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851887.393068:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851887.393069:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851887.393069:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858237255849536
00000020:00000001:17.0:1773851887.393070:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851887.393070:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930bb
00000020:00000001:17.0:1773851887.393071:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851887.393073:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000027367587 refcount=6
00000020:00000001:17.0:1773851887.393073:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745166848 : -107128964384768 : ffff9e911821f800)
00000020:00000001:17.0:1773851887.393074:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745166848 : -107128964384768 : ffff9e911821f800)
00000100:00000001:17.0:1773851887.393075:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851887.393076:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851887.393077:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851887.393077:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851887.393078:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851887.393079:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851887.393079:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851887.393080:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851887.393081:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851887.393081:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851887.393082:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.393082:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851887.393084:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851887.393084:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851887.393084:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851887.393084:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851887.393085:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.120@tcp, seq: 2156400
00000100:00000040:17.0:1773851887.393086:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000027367587 : new rpc_count 1
00000100:00000001:16.0:1773851887.393086:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.393087:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102208512 : -107041607343104 : ffff9ea56f04a400)
00000100:00000001:16.0:1773851887.393087:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851887.393088:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a44d006a x1858237255849536/t0(0) o400->470755db-daa8-4bfe-8d73-58e773838139@172.16.70.120@tcp:139/0 lens 224/0 e 0 to 0 dl 1773852254 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic20-0'
00000100:00000001:17.0:1773851887.393091:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851887.393091:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851887.393092:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a44d006a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:470755db-daa8-4bfe-8d73-58e773838139+6:50038:x1858237255849536:12345-172.16.70.120@tcp:400:default-rzslic20-0
00000100:00000200:17.0:1773851887.393094:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858237255849536
00000020:00000001:17.0:1773851887.393094:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851887.393095:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851887.393095:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.393096:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851887.393096:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851887.393097:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851887.393098:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858237255849536, found 0 last_xid 1858237255849535
00000020:00000001:17.0:1773851887.393099:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851887.393099:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851887.393100:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851887.393101:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.393101:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851887.393102:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851887.393102:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851887.393103:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000017f1c6b4.
02000000:00000001:17.0:1773851887.393103:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.393104:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.393105:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851887.393105:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858237255849536
00010000:00000001:17.0:1773851887.393106:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851887.393107:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a44d006a x1858237255849536/t0(0) o400->470755db-daa8-4bfe-8d73-58e773838139@172.16.70.120@tcp:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic20-0'
00010000:00000001:17.0:1773851887.393109:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851887.393110:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851887.393110:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=120 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851887.393111:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851887.393112:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dde233fe refcount 3 to 172.16.70.120@tcp
00000100:00000001:17.0:1773851887.393113:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636940427739904 : -107133281811712 : ffff9e9016cb4300)
02000000:00000001:17.0:1773851887.393114:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851887.393114:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851887.393115:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851887.393116:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.120@tcp
00000400:00000010:17.0:1773851887.393116:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000094b822eb.
00000100:00000200:17.0:1773851887.393117:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858237255849536, offset 224
00000400:00000200:17.0:1773851887.393118:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.120@tcp
00000400:00000200:17.0:1773851887.393119:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.120@tcp to cpt 4
00000400:00000200:17.0:1773851887.393120:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0312243 nid 172.16.70.120@tcp refs 2
00000400:00000200:17.0:1773851887.393121:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0312243 nid 172.16.70.120@tcp refs 3
00000400:00000200:17.0:1773851887.393122:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0312243 nid 172.16.70.120@tcp refs 4
00000400:00000200:17.0:1773851887.393123:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.120@tcp routed destination
00000400:00000200:17.0:1773851887.393124:0:60961:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:17.0:1773851887.393125:0:60961:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:17.0:1773851887.393127:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.120@tcp: rtr pref emtpy: 1
00000400:00000200:17.0:1773851887.393128:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:17.0:1773851887.393129:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.120@tcp: rtr pref emtpy: 1
00000400:00000200:17.0:1773851887.393130:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:17.0:1773851887.393131:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769884:8769884:1024:4294967295] 2094@kfi7 LPNI seq info [1258747016:1258747016:16:4294967295]
00000400:00000200:17.0:1773851887.393132:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851887.393133:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851887.393135:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.120@tcp(172.16.70.120@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851887.393137:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0312243 nid 172.16.70.120@tcp refs 3
00000800:00000200:17.0:1773851887.393138:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851887.393139:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851887.393141:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851887.393143:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:17.0:1773851887.393146:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:17.0:1773851887.393147:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851887.393149:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851887.393150:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dde233fe refcount 2 to 172.16.70.120@tcp
00010000:00000001:17.0:1773851887.393151:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851887.393151:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851887.393152:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851887.393153:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a44d006a x1858237255849536/t0(0) o400->470755db-daa8-4bfe-8d73-58e773838139@172.16.70.120@tcp:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic20-0'
00000100:00100000:17.0:1773851887.393156:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a44d006a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:470755db-daa8-4bfe-8d73-58e773838139+6:50038:x1858237255849536:12345-172.16.70.120@tcp:400:default-rzslic20-0 Request processed in 64us (96us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851887.393158:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851887.393158:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.120@tcp, seq: 2156400
00000100:00000040:17.0:1773851887.393159:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000027367587 : new rpc_count 0
00000400:00000200:19.0:1773851887.393160:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851887.393161:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:19.0:1773851887.393162:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000094b822eb
00000400:00000010:19.0:1773851887.393162:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000094b822eb.
00000100:00000001:17.0:1773851887.393162:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851887.393163:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851887.393163:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851887.393163:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000100:00000001:19.0:1773851887.393164:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:17.0:1773851887.393164:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000400:00000200:19.0:1773851887.393165:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:17.0:1773851887.393165:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000020:00000040:17.0:1773851887.393165:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000027367587 : new refcount 5
00000800:00000200:19.0:1773851887.393166:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000100:00000001:17.0:1773851887.393166:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851887.433731:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:8.0:1773851887.433731:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851887.433732:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851887.433732:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851887.433732:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851887.433732:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:8.0:1773851887.433732:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851887.433733:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a88e84d.
00000004:00000020:29.0:1773851887.433733:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851887.433733:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3afdabf.
00000100:00000010:28.0:1773851887.433733:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007c444e46.
00000100:00000010:8.0:1773851887.433733:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003c9ed900.
00000020:00000040:30.0:1773851887.433734:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000020:00000040:28.0:1773851887.433734:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000020:00000040:8.0:1773851887.433734:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000020:00000040:29.0:1773851887.433735:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
00000100:00000001:30.0:1773851887.433736:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851887.433736:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:28.0:1773851887.433736:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:8.0:1773851887.433736:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851887.433737:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851887.433737:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:28.0:1773851887.433737:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:8.0:1773851887.433737:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851887.433738:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851887.433738:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851887.433738:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.433738:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851887.433740:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000078bc3602.
02000000:00000010:29.0:1773851887.433740:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
02000000:00000010:28.0:1773851887.433740:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000055279eb9.
02000000:00000010:8.0:1773851887.433740:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:30.0:1773851887.433741:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433741:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851887.433741:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.433741:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433743:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851887.433743:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851887.433743:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:8.0:1773851887.433743:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851887.433744:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433744:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851887.433744:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.433744:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851887.433745:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001a88e84d] to pc [ptlrpcd_07_01+1]  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851887.433745:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e3afdabf] to pc [ptlrpcd_07_00+0]  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851887.433745:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007c444e46] to pc [ptlrpcd_07_03+3]  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851887.433745:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003c9ed900] to pc [ptlrpcd_02_03+3]  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851887.433751:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851887.433752:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:30.0:1773851887.433752:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:29.0:1773851887.433752:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851887.433752:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:10.0:1773851887.433752:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851887.433752:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851887.433752:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000017143bb9.
00000100:00000001:31.0:1773851887.433753:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851887.433753:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:29.0:1773851887.433753:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ef2b4bb2.
00080000:00000001:29.0:1773851887.433753:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637098598919168 : -106975110632448 : ffff9eb4ea87ec00)
00080000:00000010:28.0:1773851887.433753:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000053cfdc07.
00080000:00000001:28.0:1773851887.433753:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637131422907392 : -106942286644224 : ffff9ebc8efe3c00)
00000100:00000001:10.0:1773851887.433753:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851887.433753:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851887.433753:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851887.433753:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637092950002688 : -106980759548928 : ffff9eb399d44c00)
00080000:00000001:8.0:1773851887.433753:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000010:30.0:1773851887.433754:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000033ea0b36.
00080000:00000001:30.0:1773851887.433754:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636958653181952 : -107115056369664 : ffff9e94551d7000)
00080000:00000001:29.0:1773851887.433754:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851887.433754:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:8.0:1773851887.433754:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851887.433755:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851887.433755:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851887.433755:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851887.433755:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851887.433755:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:8.0:1773851887.433755:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00080000:00000001:30.0:1773851887.433756:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851887.433756:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00000004:00001000:28.0:1773851887.433756:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000004:00001000:30.0:1773851887.433757:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000004:00000010:29.0:1773851887.433757:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000082adec42.
00000004:00000010:28.0:1773851887.433757:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000aa68f11c.
00000004:00000010:8.0:1773851887.433757:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005f6fe534.
00000100:00000001:31.0:1773851887.433758:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851887.433758:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:29.0:1773851887.433758:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614161887033540ns, next at 614162887032148ns, rc = 0
00000004:00080000:28.0:1773851887.433758:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614161887033220ns, next at 614162887032098ns, rc = 0
00000100:00000001:10.0:1773851887.433758:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:8.0:1773851887.433758:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614161887033390ns, next at 614162887032037ns, rc = 0
02000000:00000001:31.0:1773851887.433759:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:29.0:1773851887.433759:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851887.433759:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851887.433759:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433759:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851887.433759:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851887.433760:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851887.433760:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851887.433760:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851887.433760:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:8.0:1773851887.433760:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851887.433761:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007c444e46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051936320:9@kfi7:13:default-yuba2-0
00000004:00000010:30.0:1773851887.433761:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000004ad0a526.
00000004:00000001:29.0:1773851887.433761:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851887.433761:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851887.433761:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851887.433762:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614161887037217ns, next at 614162887033230ns, rc = 0
00000100:00100000:10.0:1773851887.433762:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003c9ed900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051936192:2084@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851887.433763:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:30.0:1773851887.433763:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:29.0:1773851887.433763:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851887.433763:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851887.433764:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:30.0:1773851887.433764:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851887.433764:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433764:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851887.433764:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:10.0:1773851887.433764:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851887.433765:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851887.433765:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851887.433765:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:10.0:1773851887.433765:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851887.433766:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:28.0:1773851887.433766:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851887.433766:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:31.0:1773851887.433767:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000cadf7b2e.
02000000:00000010:10.0:1773851887.433767:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000086e8148e.
02000000:00000001:31.0:1773851887.433768:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851887.433768:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:29.0:1773851887.433768:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:10.0:1773851887.433768:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851887.433769:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000100:00000001:29.0:1773851887.433769:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851887.433769:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000010:31.0:1773851887.433770:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000001:30.0:1773851887.433770:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851887.433770:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:29.0:1773851887.433770:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851887.433770:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851887.433770:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000100:00000200:31.0:1773851887.433771:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936320, portal 4
00000100:00000001:30.0:1773851887.433771:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00100000:29.0:1773851887.433771:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001a88e84d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051936384:2104@kfi7:13:default-yuba2-0
00000400:00000010:10.0:1773851887.433771:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000001:31.0:1773851887.433772:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851887.433772:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324225536 : -106976385326080 : ffff9eb49e8da400)
00000100:00000040:30.0:1773851887.433772:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851887.433772:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936192, portal 4
00000100:00000001:29.0:1773851887.433773:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:29.0:1773851887.433773:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:31.0:1773851887.433774:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433774:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:29.0:1773851887.433774:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433775:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851887.433775:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851887.433775:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851887.433776:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:30.0:1773851887.433776:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851887.433776:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000098ee5cfc.
02000000:00000001:29.0:1773851887.433776:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851887.433777:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:31.0:1773851887.433777:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088e46351.
00000100:00100000:30.0:1773851887.433777:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e3afdabf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051936256:47@kfi7:13:default-yuba2-0
00000400:00000200:29.0:1773851887.433777:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000200:31.0:1773851887.433778:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936320, offset 0
00000100:00000001:30.0:1773851887.433778:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:29.0:1773851887.433778:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000843b5aa4.
00000400:00000200:31.0:1773851887.433779:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
02000000:00000001:30.0:1773851887.433779:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851887.433779:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851887.433779:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000acbff741.
00000400:00000200:31.0:1773851887.433780:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
02000000:00000001:30.0:1773851887.433780:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:29.0:1773851887.433780:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936384, portal 4
00000400:00000200:31.0:1773851887.433781:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
02000000:00000010:30.0:1773851887.433781:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001743517f.
02000000:00000001:30.0:1773851887.433781:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433781:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851887.433781:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411248000 : -106960298303616 : ffff9eb85d6a1f80)
00000400:00000200:31.0:1773851887.433782:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:31.0:1773851887.433783:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000040:29.0:1773851887.433783:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851887.433783:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:31.0:1773851887.433784:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000100:00000001:10.0:1773851887.433784:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491282816 : -107117218268800 : ffff9e93d4417980)
00000100:00000001:29.0:1773851887.433785:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851887.433785:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851887.433786:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769883, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769884, p:4294967295, g:4294967295, h:1000]
00000100:00000040:29.0:1773851887.433786:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:29.0:1773851887.433787:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000254c983a.
00000100:00000200:29.0:1773851887.433787:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936384, offset 0
00000400:00000200:31.0:1773851887.433788:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:10.0:1773851887.433788:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851887.433789:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851887.433789:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000100:00000040:10.0:1773851887.433789:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000010:10.0:1773851887.433789:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f2c89b6.
00000400:00000200:31.0:1773851887.433790:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000100:00000200:10.0:1773851887.433790:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936192, offset 0
00000400:00000200:31.0:1773851887.433791:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769885:8769885:1024:4294967295] 9@kfi7 LPNI seq info [5403013:5403013:16:4294967295]
00000400:00000200:31.0:1773851887.433792:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:10.0:1773851887.433792:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:10.0:1773851887.433793:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851887.433794:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:30.0:1773851887.433794:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:10.0:1773851887.433794:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000010:30.0:1773851887.433795:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000200:29.0:1773851887.433795:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:10.0:1773851887.433795:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851887.433796:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000400:00000010:30.0:1773851887.433796:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000400:00000200:29.0:1773851887.433796:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:10.0:1773851887.433796:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:31.0:1773851887.433797:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000200:30.0:1773851887.433797:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936256, portal 4
00000400:00000200:29.0:1773851887.433797:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:30.0:1773851887.433798:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:10.0:1773851887.433798:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000800:00000200:31.0:1773851887.433799:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:30.0:1773851887.433799:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130262223616 : -106943447328000 : ffff9ebc49cf9b00)
00000400:00000200:29.0:1773851887.433799:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000800:00000200:31.0:1773851887.433800:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:30.0:1773851887.433800:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851887.433800:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000400:00000200:10.0:1773851887.433800:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769885, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769884, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851887.433802:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769885, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769884, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851887.433802:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:31.0:1773851887.433803:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:30.0:1773851887.433803:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851887.433803:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:30.0:1773851887.433804:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000400:00000010:30.0:1773851887.433804:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013884923.
00000400:00000200:29.0:1773851887.433804:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:10.0:1773851887.433804:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000800:00000200:31.0:1773851887.433805:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000100:00000200:30.0:1773851887.433805:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936256, offset 0
00000400:00000200:29.0:1773851887.433805:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851887.433805:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769886:8769886:1024:4294967295] 2084@kfi7 LPNI seq info [5402749:5402749:16:4294967295]
00000400:00000200:30.0:1773851887.433806:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000200:29.0:1773851887.433806:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000400:00000200:29.0:1773851887.433807:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769887:8769887:1024:4294967295] 2104@kfi7 LPNI seq info [5403381:5403381:16:4294967295]
00000400:00000200:10.0:1773851887.433807:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:10.0:1773851887.433808:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:31.0:1773851887.433809:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x31e: rc=0
00000400:00000200:29.0:1773851887.433809:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:29.0:1773851887.433810:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:31.0:1773851887.433811:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851887.433811:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:10.0:1773851887.433811:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851887.433812:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000001:31.0:1773851887.433813:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433813:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851887.433813:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:29.0:1773851887.433813:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851887.433813:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000001:31.0:1773851887.433814:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851887.433814:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:29.0:1773851887.433814:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:31.0:1773851887.433815:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433815:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851887.433815:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000800:00000200:10.0:1773851887.433815:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:31.0:1773851887.433816:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851887.433816:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:10.0:1773851887.433816:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:31.0:1773851887.433817:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851887.433817:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851887.433817:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769885, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769887, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851887.433818:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851887.433818:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433819:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851887.433819:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:29.0:1773851887.433819:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851887.433819:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851887.433820:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851887.433821:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000800:00000200:10.0:1773851887.433821:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Using peer 2084@kfi7(0x2000000000000ff)
00000400:00000200:30.0:1773851887.433822:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769888:8769888:1023:4294967295] 47@kfi7 LPNI seq info [5403023:5403023:16:4294967295]
00000800:00000200:29.0:1773851887.433822:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851887.433823:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000800:00000200:31.0:1773851887.433824:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851887.433824:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:29.0:1773851887.433824:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000400:00000200:31.0:1773851887.433825:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:10.0:1773851887.433825:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000005269f40f: Posted send of 324 bytes to peer 0x2000000000000ff: rc=0
00000400:00000200:31.0:1773851887.433827:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000800:00000200:10.0:1773851887.433827:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851887.433828:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088e46351
00000400:00000010:31.0:1773851887.433828:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088e46351.
00000400:00000200:30.0:1773851887.433828:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000800:00000200:29.0:1773851887.433828:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000cc48149a: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
00000100:00000001:31.0:1773851887.433829:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:30.0:1773851887.433829:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000800:00000200:29.0:1773851887.433829:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000200:31.0:1773851887.433830:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851887.433830:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433830:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:30.0:1773851887.433831:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:29.0:1773851887.433831:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433831:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433832:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:30.0:1773851887.433832:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:29.0:1773851887.433832:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851887.433832:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851887.433833:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851887.433833:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433833:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433833:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.433834:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851887.433834:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851887.433834:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851887.433835:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851887.433835:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:29.0:1773851887.433835:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851887.433835:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851887.433836:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851887.433836:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851887.433836:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851887.433836:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851887.433836:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851887.433837:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:29.0:1773851887.433837:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851887.433837:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433837:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851887.433838:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:30.0:1773851887.433838:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 Using peer 47@kfi7(0x274)
00000100:00000001:29.0:1773851887.433838:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851887.433838:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.433839:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000800:00000200:31.0:1773851887.433840:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000400:00000200:9.0:1773851887.433840:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f2c89b6
00000400:00000010:9.0:1773851887.433840:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f2c89b6.
00000800:00000200:30.0:1773851887.433841:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000fd057322: Posted send of 324 bytes to peer 0x274: rc=0
00000100:00000001:9.0:1773851887.433841:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:31.0:1773851887.433842:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000100:00000200:9.0:1773851887.433842:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851887.433843:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851887.433844:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851887.433845:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00000001:30.0:1773851887.433845:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433845:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851887.433845:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:31.0:1773851887.433846:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000254c983a
00000400:00000010:31.0:1773851887.433846:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000254c983a.
00000100:00000001:30.0:1773851887.433846:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851887.433846:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851887.433847:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851887.433847:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433847:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:31.0:1773851887.433848:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433848:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851887.433848:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433849:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851887.433849:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851887.433849:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851887.433850:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851887.433850:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851887.433850:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851887.433850:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000040:31.0:1773851887.433851:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433851:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851887.433852:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2054@kfi7:2 -> 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000000ff Transaction freed
00000100:00000001:31.0:1773851887.433854:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851887.433854:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851887.433855:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851887.433855:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851887.433856:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:30.0:1773851887.433856:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->47@kfi7: PUT: OK
00000800:00000200:31.0:1773851887.433857:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc48149a: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Transaction freed
00000400:00000200:30.0:1773851887.433857:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013884923
00000400:00000010:30.0:1773851887.433858:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013884923.
00000100:00000001:30.0:1773851887.433858:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851887.433859:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433861:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851887.433862:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433865:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433866:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:30.0:1773851887.433867:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000800:00000200:30.0:1773851887.433868:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x274 Transaction freed
00000800:00000200:26.0:1773851887.433875:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851887.433875:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851887.433877:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851887.433877:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851887.433878:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851887.433879:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:6.0:1773851887.433880:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851887.433882:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:26.0:1773851887.433883:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2084@kfi7 : PUT - for me
00000800:00000200:6.0:1773851887.433883:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851887.433884:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:26.0:1773851887.433885:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:6.0:1773851887.433885:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:26.0:1773851887.433886:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:6.0:1773851887.433886:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000400:00000200:26.0:1773851887.433887:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:26.0:1773851887.433888:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:6.0:1773851887.433888:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:26.0:1773851887.433889:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:6.0:1773851887.433889:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000200:26.0:1773851887.433890:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b55c0
00000400:00000200:6.0:1773851887.433890:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:6.0:1773851887.433891:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:26.0:1773851887.433892:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:6.0:1773851887.433892:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:26.0:1773851887.433893:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b82cd9 [1] + 224
00000400:00000200:6.0:1773851887.433893:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:6.0:1773851887.433894:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5640
00000800:00000200:26.0:1773851887.433895:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851887.433896:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851887.433896:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:6.0:1773851887.433896:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:26.0:1773851887.433897:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851887.433897:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b31bc5 [1] + 224
00000400:00000200:26.0:1773851887.433898:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2084@kfi7: PUT: OK
00000800:00000200:21.0:1773851887.433898:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:26.0:1773851887.433900:0:2507427:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851887.433900:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851887.433900:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:6.0:1773851887.433900:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:26.0:1773851887.433901:0:2507427:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851887.433901:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:13.0:1773851887.433901:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:6.0:1773851887.433902:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.433903:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 47@kfi7 : PUT - for me
00000800:00000200:13.0:1773851887.433903:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851887.433903:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000100:00000040:26.0:1773851887.433904:0:2507427:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851887.433904:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.433904:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000001:6.0:1773851887.433904:0:2499722:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851887.433905:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:13.0:1773851887.433905:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:6.0:1773851887.433905:0:2499722:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851887.433906:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:21.0:1773851887.433907:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:13.0:1773851887.433907:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:26.0:1773851887.433908:0:2507427:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851887.433908:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:13.0:1773851887.433908:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000100:00000040:6.0:1773851887.433908:0:2499722:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:26.0:1773851887.433909:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:21.0:1773851887.433909:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5600
00000400:00000200:13.0:1773851887.433909:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:21.0:1773851887.433910:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:10.0:1773851887.433910:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:26.0:1773851887.433911:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2054@kfi7:6 <- 2084@kfi7(00000000e0ae0b95):0x0 lsk 256 rsk 4810 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:21.0:1773851887.433911:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d1875 [1] + 224
00000400:00000200:13.0:1773851887.433911:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000100:00000001:10.0:1773851887.433911:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:13.0:1773851887.433912:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000001:10.0:1773851887.433912:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851887.433912:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:6.0:1773851887.433912:0:2499722:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:21.0:1773851887.433913:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851887.433913:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000010:10.0:1773851887.433913:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:6.0:1773851887.433913:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:31.0:1773851887.433914:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851887.433914:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:10.0:1773851887.433914:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851887.433914:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:31.0:1773851887.433915:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851887.433915:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851887.433915:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:10.0:1773851887.433915:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:6.0:1773851887.433915:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851887.433916:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851887.433916:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:21.0:1773851887.433916:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->47@kfi7: PUT: OK
00000400:00000200:13.0:1773851887.433916:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5680
00000100:00000200:10.0:1773851887.433916:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851887.433917:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:13.0:1773851887.433917:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:31.0:1773851887.433918:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000400:00000010:31.0:1773851887.433918:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:31.0:1773851887.433919:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:21.0:1773851887.433919:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851887.433919:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f6c0d [1] + 224
00000100:00000200:10.0:1773851887.433919:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851887.433920:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:21.0:1773851887.433920:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851887.433921:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851887.433922:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851887.433922:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:31.0:1773851887.433923:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851887.433923:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851887.433923:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851887.433923:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851887.433923:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:13.0:1773851887.433924:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00000001:10.0:1773851887.433924:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:13.0:1773851887.433925:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:10.0:1773851887.433925:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851887.433925:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433926:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:10.0:1773851887.433926:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=120 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851887.433927:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851887.433927:0:41091:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:21.0:1773851887.433927:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:13.0:1773851887.433927:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:10.0:1773851887.433927:0:41071:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=120 v=66 (1 1 1 1)
02000000:00000001:31.0:1773851887.433928:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851887.433928:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:21.0:1773851887.433928:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:10.0:1773851887.433928:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851887.433929:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433929:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:21.0:1773851887.433929:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 47@kfi7(00000000ec4a0570):0x0 lsk 629 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851887.433929:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851887.433930:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851887.433930:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=120 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851887.433930:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:13.0:1773851887.433930:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851887.433931:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=41 v=66 (1 1 1 1)
00000400:00000001:30.0:1773851887.433931:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851887.433931:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:10.0:1773851887.433931:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851887.433931:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851887.433932:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:10.0:1773851887.433932:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:31.0:1773851887.433933:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851887.433933:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851887.433933:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:30.0:1773851887.433933:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000040:10.0:1773851887.433933:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000100:00000001:10.0:1773851887.433933:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00010000:00000001:31.0:1773851887.433934:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851887.433934:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433934:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:13.0:1773851887.433934:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851887.433934:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433935:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:30.0:1773851887.433935:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851887.433935:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000040:10.0:1773851887.433935:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851887.433936:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000100:00000001:31.0:1773851887.433936:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851887.433936:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433936:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851887.433936:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:29.0:1773851887.433937:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:13.0:1773851887.433937:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851887.433937:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:31.0:1773851887.433938:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:30.0:1773851887.433938:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:29.0:1773851887.433938:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:29.0:1773851887.433938:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000843b5aa4.
00000100:00000001:10.0:1773851887.433938:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:29.0:1773851887.433939:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000acbff741
00000100:00000001:10.0:1773851887.433939:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851887.433939:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851887.433940:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851887.433940:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:29.0:1773851887.433940:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000acbff741.
00000004:00000040:10.0:1773851887.433940:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000100:00000001:31.0:1773851887.433941:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851887.433941:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851887.433941:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851887.433941:0:41088:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:29.0:1773851887.433941:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851887.433941:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:10.0:1773851887.433941:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593610240 avail=351576796160 avail_mb=1373346860 hwm_mb=3131103 files=372189892 ffree=343353135 state=0: rc = 0
00000004:00000001:31.0:1773851887.433942:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851887.433942:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
02000000:00000001:30.0:1773851887.433942:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851887.433942:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000040:31.0:1773851887.433943:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351479988224 avail=351478687744 avail_mb=1372963624 hwm_mb=3131101 files=372073040 ffree=343242176 state=0: rc = 0
00000100:00000001:30.0:1773851887.433943:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:10.0:1773851887.433943:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593610240 free, 351576796160 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372189892 files, 343353135 free files
02000000:00000001:30.0:1773851887.433944:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851887.433944:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=120 v=66 (66 66 66 66)
00000100:00000200:29.0:1773851887.433944:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:10.0:1773851887.433944:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:31.0:1773851887.433945:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351479988224 free, 351478687744 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073040 files, 343242176 free files
00000100:00000040:10.0:1773851887.433945:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:31.0:1773851887.433946:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851887.433946:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=120 v=66 (1 1 1 1)
00000100:00000001:29.0:1773851887.433946:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:31.0:1773851887.433947:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433947:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851887.433947:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433947:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:30.0:1773851887.433948:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851887.433948:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433948:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851887.433948:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851887.433948:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00100000:10.0:1773851887.433948:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003c9ed900 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051936192:2084@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851887.433949:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:29.0:1773851887.433949:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851887.433950:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007c444e46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051936320:9@kfi7:13:default-yuba2-0
00000100:00000040:30.0:1773851887.433950:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00000001:30.0:1773851887.433950:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851887.433950:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851887.433950:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433950:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851887.433951:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:29.0:1773851887.433951:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=120 v=66 (66 66 66 66)
00000100:00000001:10.0:1773851887.433951:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851887.433952:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851887.433952:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00001000:29.0:1773851887.433952:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=120 v=66 (1 1 1 1)
00000100:00000040:10.0:1773851887.433952:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003c9ed900 x1859433051936192/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851887.433953:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851887.433953:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851887.433954:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007c444e46 x1859433051936320/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433954:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:29.0:1773851887.433954:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:29.0:1773851887.433954:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433954:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851887.433955:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851887.433955:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:10.0:1773851887.433955:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:31.0:1773851887.433956:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851887.433956:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851887.433956:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:29.0:1773851887.433956:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000001:29.0:1773851887.433956:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851887.433956:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851887.433956:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000086e8148e.
02000000:00000001:31.0:1773851887.433957:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851887.433957:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000cadf7b2e.
00000004:00000040:30.0:1773851887.433957:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851887.433957:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603934208 avail=351601571840 avail_mb=1373443640 hwm_mb=3131103 files=372190399 ffree=343363217 state=0: rc = 0
00000100:00000040:29.0:1773851887.433957:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:10.0:1773851887.433957:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851887.433957:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851887.433958:0:41071:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000020:00000001:10.0:1773851887.433958:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:31.0:1773851887.433959:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851887.433959:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000020:30.0:1773851887.433959:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603934208 free, 351601571840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190399 files, 343363217 free files
00000020:00000040:31.0:1773851887.433960:0:41091:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000020:00000001:31.0:1773851887.433960:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:29.0:1773851887.433960:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851887.433960:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000010:10.0:1773851887.433960:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:10.0:1773851887.433960:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000010:31.0:1773851887.433961:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000055279eb9.
00000004:00000001:30.0:1773851887.433961:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433961:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851887.433961:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:31.0:1773851887.433962:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851887.433962:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:30.0:1773851887.433962:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:29.0:1773851887.433962:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851887.433962:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000100:00000010:10.0:1773851887.433962:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003c9ed900.
00000100:00000010:31.0:1773851887.433963:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007c444e46.
00000004:00000040:29.0:1773851887.433963:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615845376 avail=351613224960 avail_mb=1373489160 hwm_mb=3131103 files=372043371 ffree=343374849 state=0: rc = 0
00000100:00000001:10.0:1773851887.433963:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851887.433963:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851887.433964:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851887.433964:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:30.0:1773851887.433964:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e3afdabf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051936256:47@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851887.433964:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851887.433965:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:29.0:1773851887.433965:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615845376 free, 351613224960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043371 files, 343374849 free files
00000100:00000001:10.0:1773851887.433965:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851887.433965:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433966:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851887.433966:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.433966:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851887.433966:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:29.0:1773851887.433966:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.433966:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851887.433966:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851887.433967:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851887.433967:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851887.433967:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e3afdabf x1859433051936256/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:29.0:1773851887.433967:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851887.433969:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851887.433970:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851887.433970:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001743517f.
00000100:00100000:29.0:1773851887.433970:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001a88e84d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051936384:2104@kfi7:13:default-yuba2-0
02000000:00000001:30.0:1773851887.433971:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851887.433972:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851887.433972:0:41088:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000100:00000001:29.0:1773851887.433972:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.433972:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:30.0:1773851887.433973:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851887.433973:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
00000100:00000040:29.0:1773851887.433973:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001a88e84d x1859433051936384/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:30.0:1773851887.433974:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851887.433974:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851887.433975:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e3afdabf.
00000100:00000001:30.0:1773851887.433976:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851887.433976:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851887.433976:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.433976:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851887.433976:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:30.0:1773851887.433977:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:29.0:1773851887.433977:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000098ee5cfc.
00000100:00000001:30.0:1773851887.433978:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851887.433978:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851887.433979:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851887.433979:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.433979:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851887.433979:0:41089:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000020:00000001:29.0:1773851887.433980:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851887.433980:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000078bc3602.
02000000:00000001:29.0:1773851887.433981:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851887.433981:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851887.433982:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001a88e84d.
00000100:00000001:29.0:1773851887.433982:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851887.433983:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.433983:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.433984:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851887.433984:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.433985:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851887.433985:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851887.497732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851887.497734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:5.0:1773851887.509709:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851887.509710:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851887.509711:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851887.509713:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851887.509715:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18851@kfi7 to cpt 1
00000400:00000200:5.0:1773851887.509717:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18851@kfi7 : PUT - for me
00000400:00000200:5.0:1773851887.509718:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18851@kfi7 to cpt 1
00000400:00000200:5.0:1773851887.509719:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 1
00000400:00000200:5.0:1773851887.509720:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18851@kfi7 to cpt 1
00000400:00000200:5.0:1773851887.509720:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 2
00000400:00000200:5.0:1773851887.509721:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 3
00000400:00000200:5.0:1773851887.509722:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18850@kfi7 to cpt 6
00000400:00000200:5.0:1773851887.509723:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18850@kfi7 of length 224 into portal 12 MB=0x69b0a0c529f00
00000400:00000200:5.0:1773851887.509729:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18850@kfi7 of length 224/224 into md 0x793926dc5 [64] + 157016
00000800:00000200:5.0:1773851887.509731:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851887.509733:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851887.509734:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18851@kfi7: PUT: OK
00000100:00000001:5.0:1773851887.509735:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851887.509736:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851887.509737:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed249099.
00000100:00000040:5.0:1773851887.509738:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ed249099 x1859317318983424 msgsize 224
00000100:00100000:5.0:1773851887.509740:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-18850@kfi7 (source: 12345-18851@kfi7)
00000100:00000001:5.0:1773851887.509741:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851887.509742:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 2
00000100:00000001:4.0:1773851887.509743:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851887.509743:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851887.509744:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851887.509744:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851887.509744:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851887.509745:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851887.509746:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317318983424
00000020:00000001:4.0:1773851887.509747:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851887.509747:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924c1
00000020:00000001:4.0:1773851887.509748:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851887.509749:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000646c89bc refcount=6
00000020:00000001:4.0:1773851887.509750:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630777856 : -107123078773760 : ffff9e9276f14400)
00000020:00000001:4.0:1773851887.509751:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630777856 : -107123078773760 : ffff9e9276f14400)
00000100:00000001:4.0:1773851887.509752:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851887.509752:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851887.509753:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851887.509754:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851887.509755:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851887.509756:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851887.509757:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851887.509757:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851887.509758:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851887.509759:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851887.509760:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.509761:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851887.509762:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851887.509763:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851887.509763:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851887.509763:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851887.509764:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18850@kfi7, seq: 2001968
00000100:00000001:7.0:1773851887.509765:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851887.509765:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000646c89bc : new rpc_count 1
00000100:00000001:7.0:1773851887.509766:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.509766:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108932736 : -106938600618880 : ffff9ebd6ab28480)
00000100:00000040:4.0:1773851887.509767:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed249099 x1859317318983424/t0(0) o400->126186fa-bff3-420e-af10-caacea44dc5a@18850@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1660-0'
00000100:00000001:4.0:1773851887.509770:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851887.509771:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851887.509772:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed249099 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:126186fa-bff3-420e-af10-caacea44dc5a+6:39737:x1859317318983424:12345-18850@kfi7:400:default-tuolumne1660-0
00000100:00000200:4.0:1773851887.509774:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317318983424
00000020:00000001:4.0:1773851887.509775:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851887.509775:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851887.509776:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.509777:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851887.509778:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851887.509779:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851887.509779:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317318983424, found 0 last_xid 1859317318983423
00000020:00000001:4.0:1773851887.509780:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851887.509781:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851887.509782:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851887.509782:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.509783:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851887.509784:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851887.509785:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851887.509785:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001dd2088e.
02000000:00000001:4.0:1773851887.509786:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.509787:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.509788:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851887.509788:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044160513, transno 0, xid 1859317318983424
00010000:00000001:4.0:1773851887.509789:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851887.509790:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed249099 x1859317318983424/t0(0) o400->126186fa-bff3-420e-af10-caacea44dc5a@18850@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1660-0'
00010000:00000001:4.0:1773851887.509793:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851887.509794:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851887.509794:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=119 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851887.509796:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851887.509796:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003a348937 refcount 3 to 18850@kfi7
00000100:00000001:4.0:1773851887.509797:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092334048 : -107152617217568 : ffff9e8b965061e0)
02000000:00000001:4.0:1773851887.509798:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851887.509799:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.509800:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851887.509801:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18851@kfi7
00000400:00000010:4.0:1773851887.509802:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fcac908a.
00000100:00000200:4.0:1773851887.509803:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317318983424, offset 224
00000400:00000200:4.0:1773851887.509804:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18851@kfi7
00000400:00000200:4.0:1773851887.509805:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18851@kfi7 to cpt 1
00000400:00000200:4.0:1773851887.509806:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 1
00000400:00000200:4.0:1773851887.509807:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 2
00000400:00000200:4.0:1773851887.509809:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 3
00000400:00000200:4.0:1773851887.509810:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18851@kfi7 local destination
00000400:00000200:4.0:1773851887.509811:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769889:8769889:1024:4294967295] 18851@kfi7 LPNI seq info [1237449:1237449:16:4294967295]
00000400:00000200:4.0:1773851887.509813:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 2
00000400:00000200:4.0:1773851887.509814:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18851@kfi7 to cpt 1
00000400:00000200:4.0:1773851887.509816:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18851@kfi7(18851@kfi7:18851@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851887.509817:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 3
00000800:00000200:4.0:1773851887.509819:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851887.509820:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851887.509822:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851887.509825:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b3 Using peer 18851@kfi7(0x10b3)
00000800:00000200:4.0:1773851887.509828:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x10b3: rc=0
00000800:00000200:4.0:1773851887.509829:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851887.509832:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851887.509833:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003a348937 refcount 2 to 18850@kfi7
00010000:00000001:4.0:1773851887.509834:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851887.509834:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.509835:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851887.509836:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed249099 x1859317318983424/t0(0) o400->126186fa-bff3-420e-af10-caacea44dc5a@18850@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1660-0'
00000100:00100000:4.0:1773851887.509841:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed249099 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:126186fa-bff3-420e-af10-caacea44dc5a+6:39737:x1859317318983424:12345-18850@kfi7:400:default-tuolumne1660-0 Request processed in 70us (102us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851887.509844:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18850@kfi7, seq: 2001968
00000100:00000040:4.0:1773851887.509845:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000646c89bc : new rpc_count 0
00000100:00000001:4.0:1773851887.509846:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851887.509846:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851887.509847:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851887.509848:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851887.509849:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851887.509850:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000646c89bc : new refcount 5
00000100:00000001:4.0:1773851887.509851:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851887.509856:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b3 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851887.509858:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851887.509860:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18851@kfi7: PUT: OK
00000400:00000200:5.0:1773851887.509861:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fcac908a
00000400:00000010:5.0:1773851887.509861:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fcac908a.
00000100:00000001:5.0:1773851887.509862:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851887.509863:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851887.509864:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004ab1d5f1 nid 18851@kfi7 refs 2
00000800:00000200:5.0:1773851887.509866:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 18851@kfi7(0000000003494c71):0x0 lsk 4276 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10b3 Transaction freed
00000800:00000200:1.0:1773851887.562843:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851887.562844:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:1.0:1773851887.562847:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:1.0:1773851887.562851:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21728@kfi7(0000000098c96561):0x4de version: 2; local version 2; negotiated version: 2
00000800:00000200:2.0:1773851887.562853:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851887.562854:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851887.562854:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de Using peer 21728@kfi7(0x4de)
00000800:00000200:2.0:1773851887.562856:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851887.562858:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21728@kfi7 to cpt 0
00000800:00000200:2.0:1773851887.562860:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851887.562862:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 38 bytes to peer 0x4de: rc=0
00000400:00000200:2.0:1773851887.562863:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21728@kfi7 to cpt 0
00000400:00000200:2.0:1773851887.562865:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21728@kfi7 : PUT - for me
00000800:00000200:1.0:1773851887.562865:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851887.562867:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21728@kfi7 to cpt 0
00000400:00000200:2.0:1773851887.562869:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001af1aca6 nid 21728@kfi7 refs 1
00000400:00000200:2.0:1773851887.562871:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21728@kfi7 to cpt 0
00000400:00000200:2.0:1773851887.562873:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001af1aca6 nid 21728@kfi7 refs 2
00000400:00000200:2.0:1773851887.562874:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001af1aca6 nid 21728@kfi7 refs 3
00000400:00000200:2.0:1773851887.562876:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21536@kfi7 to cpt 6
00000400:00000200:2.0:1773851887.562877:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21536@kfi7 of length 224 into portal 12 MB=0x69b0a16b33400
00000800:00000200:1.0:1773851887.562879:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851887.562880:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21536@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 44096
00000800:00000200:2.0:1773851887.562883:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851887.562884:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de Transaction freed
00000400:00000200:2.0:1773851887.562886:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851887.562888:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21728@kfi7: PUT: OK
00000100:00000001:2.0:1773851887.562890:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851887.562891:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851887.562892:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8f7d7f6.
00000100:00000040:2.0:1773851887.562893:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000e8f7d7f6 x1859317493085184 msgsize 224
00000100:00100000:2.0:1773851887.562897:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-21536@kfi7 (source: 12345-21728@kfi7)
00000100:00000001:2.0:1773851887.562899:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851887.562900:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001af1aca6 nid 21728@kfi7 refs 2
00000100:00000001:0.0:1773851887.562902:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851887.562903:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851887.562903:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851887.562904:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851887.562904:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851887.562906:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851887.562908:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317493085184
00000020:00000001:0.0:1773851887.562909:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851887.562910:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926c7
00000020:00000001:0.0:1773851887.562911:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851887.562916:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000044843963 refcount=6
00000020:00000001:0.0:1773851887.562918:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631277568 : -107123078274048 : ffff9e9276f8e400)
00000020:00000001:0.0:1773851887.562919:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631277568 : -107123078274048 : ffff9e9276f8e400)
00000100:00000001:0.0:1773851887.562921:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851887.562923:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851887.562924:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033ae8c39.
00000020:00000010:0.0:1773851887.562926:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851887.562927:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851887.562929:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851887.562930:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851887.562931:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851887.562933:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851887.562934:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851887.562935:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851887.562937:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851887.562940:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851887.562940:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851887.562941:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851887.562941:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851887.562943:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21536@kfi7, seq: 1997607
00000100:00000001:1.0:1773851887.562944:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851887.562944:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000044843963 : new rpc_count 1
00000100:00000001:1.0:1773851887.562946:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851887.562946:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637031984555904 : -107041724995712 : ffff9ea568016780)
00000100:00000040:0.0:1773851887.562948:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e8f7d7f6 x1859317493085184/t0(0) o400->d2905b84-ec00-4e29-bab0-492c371df229@21536@kfi7:139/0 lens 224/0 e 0 to 0 dl 1773852254 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1839-0'
00000100:00000001:0.0:1773851887.562954:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851887.562955:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851887.562957:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8f7d7f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:d2905b84-ec00-4e29-bab0-492c371df229+6:39567:x1859317493085184:12345-21536@kfi7:400:default-tuolumne1839-0
00000100:00000200:0.0:1773851887.562959:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317493085184
00000020:00000001:0.0:1773851887.562960:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851887.562961:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851887.562962:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851887.562963:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851887.562964:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851887.562965:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851887.562966:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317493085184, found 0 last_xid 1859317493085183
00000020:00000001:0.0:1773851887.562967:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851887.562968:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851887.562969:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851887.562969:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851887.562970:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851887.562971:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851887.562971:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851887.562972:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008448d696.
02000000:00000001:0.0:1773851887.562973:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851887.562974:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851887.562974:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851887.562975:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260708174, transno 0, xid 1859317493085184
00010000:00000001:0.0:1773851887.562976:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851887.562977:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e8f7d7f6 x1859317493085184/t0(0) o400->d2905b84-ec00-4e29-bab0-492c371df229@21536@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1839-0'
00010000:00000001:0.0:1773851887.562980:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851887.562981:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851887.562982:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=120 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851887.562983:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851887.562984:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008951a8cd refcount 3 to 21536@kfi7
00000100:00000001:0.0:1773851887.562985:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331680 : -107155410219936 : ffff9e8aefd68c60)
02000000:00000001:0.0:1773851887.562986:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851887.562986:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851887.562987:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851887.562988:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21728@kfi7
00000400:00000010:0.0:1773851887.562989:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000080b751ba.
00000100:00000200:0.0:1773851887.562990:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317493085184, offset 224
00000400:00000200:0.0:1773851887.562991:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21728@kfi7
00000400:00000200:0.0:1773851887.562992:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21728@kfi7 to cpt 0
00000400:00000200:0.0:1773851887.562993:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001af1aca6 nid 21728@kfi7 refs 1
00000400:00000200:0.0:1773851887.562994:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001af1aca6 nid 21728@kfi7 refs 2
00000400:00000200:0.0:1773851887.562996:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001af1aca6 nid 21728@kfi7 refs 3
00000400:00000200:0.0:1773851887.562997:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21728@kfi7 local destination
00000400:00000200:0.0:1773851887.562998:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769890:8769890:1024:4294967295] 21728@kfi7 LPNI seq info [248375:248375:16:4294967295]
00000400:00000200:0.0:1773851887.563000:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001af1aca6 nid 21728@kfi7 refs 2
00000400:00000200:0.0:1773851887.563001:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21728@kfi7 to cpt 0
00000400:00000200:0.0:1773851887.563003:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21728@kfi7(21728@kfi7:21728@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851887.563005:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001af1aca6 nid 21728@kfi7 refs 3
00000800:00000200:0.0:1773851887.563006:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851887.563007:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851887.563009:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851887.563012:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de Using peer 21728@kfi7(0x4de)
00000800:00000200:0.0:1773851887.563015:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x4de: rc=0
00000800:00000200:0.0:1773851887.563016:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851887.563018:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851887.563020:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008951a8cd refcount 2 to 21536@kfi7
00010000:00000001:0.0:1773851887.563020:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851887.563021:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851887.563022:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851887.563022:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8f7d7f6 x1859317493085184/t0(0) o400->d2905b84-ec00-4e29-bab0-492c371df229@21536@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1839-0'
00000100:00100000:0.0:1773851887.563027:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8f7d7f6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:d2905b84-ec00-4e29-bab0-492c371df229+6:39567:x1859317493085184:12345-21536@kfi7:400:default-tuolumne1839-0 Request processed in 72us (133us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851887.563029:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21536@kfi7, seq: 1997607
00000100:00000040:0.0:1773851887.563030:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000044843963 : new rpc_count 0
00000100:00000001:0.0:1773851887.563031:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851887.563032:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851887.563032:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851887.563033:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851887.563034:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033ae8c39.
00000020:00000040:0.0:1773851887.563034:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000044843963 : new refcount 5
00000100:00000001:0.0:1773851887.563035:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851887.563040:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851887.563042:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851887.563043:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21728@kfi7: PUT: OK
00000400:00000200:2.0:1773851887.563044:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000080b751ba
00000400:00000010:2.0:1773851887.563044:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000080b751ba.
00000100:00000001:2.0:1773851887.563045:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851887.563046:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851887.563046:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001af1aca6 nid 21728@kfi7 refs 2
00000800:00000200:2.0:1773851887.563048:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 21728@kfi7(0000000098c96561):0x0 lsk 1247 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x4de Transaction freed
00000800:00000200:29.0:1773851887.674809:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851887.674810:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851887.674812:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851887.674814:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851887.674816:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15680@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.674817:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15680@kfi7 : PUT - for me
00000400:00000200:29.0:1773851887.674818:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15680@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.674819:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000004ce9d26 nid 15680@kfi7 refs 1
00000400:00000200:29.0:1773851887.674820:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15680@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.674821:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000004ce9d26 nid 15680@kfi7 refs 2
00000400:00000200:29.0:1773851887.674822:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000004ce9d26 nid 15680@kfi7 refs 3
00000400:00000200:29.0:1773851887.674823:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15680@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.674824:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15680@kfi7 of length 224 into portal 12 MB=0x699e189dc9740
00000400:00000200:29.0:1773851887.674826:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15680@kfi7 of length 224/224 into md 0x77fe1859d [64] + 0
00000800:00000200:29.0:1773851887.674829:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851887.674831:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851887.674832:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15680@kfi7: PUT: OK
00000100:00000001:29.0:1773851887.674833:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851887.674833:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851887.674834:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a6d33b31.
00000100:00000040:29.0:1773851887.674835:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a6d33b31 x1858043819890496 msgsize 224
00000100:00100000:29.0:1773851887.674836:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15680@kfi7 (source: 12345-15680@kfi7)
00000100:00000001:29.0:1773851887.674838:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851887.674839:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000004ce9d26 nid 15680@kfi7 refs 2
00000800:00000200:29.0:1773851887.674841:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f58062bc: 2069@kfi7:7 <- 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851887.674844:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851887.674844:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851887.674845:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851887.674845:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851887.674846:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851887.674847:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043819890496
00000020:00000001:29.0:1773851887.674847:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851887.674848:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f9d
00000020:00000001:29.0:1773851887.674849:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851887.674852:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fe5177db refcount=6
00000020:00000001:29.0:1773851887.674852:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629261312 : -107123080290304 : ffff9e9276da2000)
00000020:00000001:29.0:1773851887.674853:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629261312 : -107123080290304 : ffff9e9276da2000)
00000100:00000001:29.0:1773851887.674854:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851887.674855:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851887.674856:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d23aa690.
00000020:00000010:29.0:1773851887.674857:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851887.674858:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851887.674859:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851887.674859:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851887.674860:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.674861:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851887.674862:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851887.674862:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.674863:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851887.674865:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851887.674865:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851887.674865:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851887.674865:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851887.674866:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15680@kfi7, seq: 2055573
00000100:00000001:30.0:1773851887.674867:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851887.674867:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fe5177db : new rpc_count 1
00000100:00000001:30.0:1773851887.674868:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.674868:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262245504 : -106943447306112 : ffff9ebc49cff080)
00000100:00000040:29.0:1773851887.674869:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a6d33b31 x1858043819890496/t0(0) o400->f77b8aae-5dfe-4ed4-9d18-74098978e24d@15680@kfi7:675/0 lens 224/0 e 0 to 0 dl 1773852035 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1476-0'
00000100:00000001:29.0:1773851887.674872:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851887.674872:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851887.674873:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a6d33b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f77b8aae-5dfe-4ed4-9d18-74098978e24d+6:39756:x1858043819890496:12345-15680@kfi7:400:default-tuolumne1476-0
00000100:00000200:29.0:1773851887.674874:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043819890496
00000020:00000001:29.0:1773851887.674875:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851887.674876:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851887.674876:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.674877:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851887.674878:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851887.674878:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851887.674879:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043819890496, found 0 last_xid 1858043819890495
00000020:00000001:29.0:1773851887.674880:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851887.674880:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851887.674881:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851887.674881:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.674882:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851887.674883:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851887.674883:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851887.674884:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a8d492b0.
02000000:00000001:29.0:1773851887.674885:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.674885:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.674886:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851887.674887:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182241606009, transno 0, xid 1858043819890496
00010000:00000001:29.0:1773851887.674888:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851887.674889:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a6d33b31 x1858043819890496/t0(0) o400->f77b8aae-5dfe-4ed4-9d18-74098978e24d@15680@kfi7:675/0 lens 224/224 e 0 to 0 dl 1773852035 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1476-0'
00010000:00000001:29.0:1773851887.674891:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851887.674892:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851887.674892:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=120 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851887.674893:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851887.674894:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000072ed601 refcount 3 to 15680@kfi7
00000100:00000001:29.0:1773851887.674895:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882112 : -107156296669504 : ffff9e8abb0066c0)
02000000:00000001:29.0:1773851887.674896:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851887.674896:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.674897:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851887.674898:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15680@kfi7
00000400:00000010:29.0:1773851887.674898:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000acbff741.
00000100:00000200:29.0:1773851887.674899:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043819890496, offset 224
00000400:00000200:29.0:1773851887.674900:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15680@kfi7
00000400:00000200:29.0:1773851887.674901:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15680@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.674902:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000004ce9d26 nid 15680@kfi7 refs 1
00000400:00000200:29.0:1773851887.674903:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000004ce9d26 nid 15680@kfi7 refs 2
00000400:00000200:29.0:1773851887.674904:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000004ce9d26 nid 15680@kfi7 refs 3
00000400:00000200:29.0:1773851887.674905:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15680@kfi7 local destination
00000400:00000200:29.0:1773851887.674907:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769891:8769891:1024:4294967295] 15680@kfi7 LPNI seq info [2303187:2303187:16:4294967295]
00000400:00000200:29.0:1773851887.674908:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000004ce9d26 nid 15680@kfi7 refs 2
00000400:00000200:29.0:1773851887.674909:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15680@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.674911:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15680@kfi7(15680@kfi7:15680@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851887.674912:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000004ce9d26 nid 15680@kfi7 refs 3
00000800:00000200:29.0:1773851887.674913:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851887.674914:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851887.674917:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851887.674919:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa8 Using peer 15680@kfi7(0xa8)
00000800:00000200:29.0:1773851887.674922:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f58062bc: Posted send of 324 bytes to peer 0xa8: rc=0
00000800:00000200:29.0:1773851887.674924:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851887.674926:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851887.674927:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000072ed601 refcount 2 to 15680@kfi7
00010000:00000001:29.0:1773851887.674927:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851887.674928:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.674929:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851887.674929:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a6d33b31 x1858043819890496/t0(0) o400->f77b8aae-5dfe-4ed4-9d18-74098978e24d@15680@kfi7:675/0 lens 224/224 e 0 to 0 dl 1773852035 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1476-0'
00000100:00100000:29.0:1773851887.674932:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a6d33b31 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:f77b8aae-5dfe-4ed4-9d18-74098978e24d+6:39756:x1858043819890496:12345-15680@kfi7:400:default-tuolumne1476-0 Request processed in 60us (97us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851887.674935:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15680@kfi7, seq: 2055573
00000100:00000040:29.0:1773851887.674935:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fe5177db : new rpc_count 0
00000100:00000001:29.0:1773851887.674936:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:30.0:1773851887.674937:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa8 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851887.674937:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851887.674937:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000400:00000200:30.0:1773851887.674938:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:29.0:1773851887.674938:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851887.674939:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d23aa690.
00000400:00000200:30.0:1773851887.674940:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15680@kfi7: PUT: OK
00000400:00000200:30.0:1773851887.674940:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000acbff741
00000020:00000040:29.0:1773851887.674940:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000fe5177db : new refcount 5
00000100:00000001:29.0:1773851887.674940:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:30.0:1773851887.674941:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000acbff741.
00000100:00000001:30.0:1773851887.674942:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851887.674942:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851887.674943:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000004ce9d26 nid 15680@kfi7 refs 2
00000800:00000200:30.0:1773851887.674945:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f58062bc: 2069@kfi7:7 -> 15680@kfi7(0000000065876d93):0x0 lsk 169 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa8 Transaction freed
00000800:00000200:9.0:1773851887.720146:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.720147:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851887.720150:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851887.720152:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851887.720155:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10272@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.720156:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10272@kfi7 : PUT - for me
00000400:00000200:9.0:1773851887.720157:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10272@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.720158:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e669ba9 nid 10272@kfi7 refs 1
00000400:00000200:9.0:1773851887.720159:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10272@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.720160:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e669ba9 nid 10272@kfi7 refs 2
00000400:00000200:9.0:1773851887.720161:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003e669ba9 nid 10272@kfi7 refs 3
00000400:00000200:9.0:1773851887.720162:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10465@kfi7 to cpt 0
00000400:00000200:9.0:1773851887.720163:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10465@kfi7 of length 224 into portal 12 MB=0x69b4b5c37bd40
00000400:00000200:9.0:1773851887.720165:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10465@kfi7 of length 224/224 into md 0x78146ce49 [64] + 151376
00000800:00000200:9.0:1773851887.720167:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851887.720169:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.720170:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10272@kfi7: PUT: OK
00000100:00000001:9.0:1773851887.720171:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851887.720172:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851887.720173:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000006631208.
00000100:00000040:9.0:1773851887.720174:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000006631208 x1859597832273216 msgsize 224
00000100:00100000:9.0:1773851887.720175:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10465@kfi7 (source: 12345-10272@kfi7)
00000100:00000001:9.0:1773851887.720176:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851887.720177:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003e669ba9 nid 10272@kfi7 refs 2
00000100:00000001:8.0:1773851887.720178:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851887.720179:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851887.720179:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851887.720180:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851887.720181:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.720182:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851887.720183:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597832273216
00000020:00000001:8.0:1773851887.720185:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851887.720185:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79f2f
00000020:00000001:8.0:1773851887.720187:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851887.720190:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000549590e8 refcount=5
00000020:00000001:8.0:1773851887.720191:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104478810112 : -106969230741504 : ffff9eb648fff000)
00000020:00000001:8.0:1773851887.720192:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637104478810112 : -106969230741504 : ffff9eb648fff000)
00000100:00000001:8.0:1773851887.720194:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851887.720195:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851887.720197:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eeda7a28.
00000020:00000010:8.0:1773851887.720199:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851887.720200:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851887.720202:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851887.720203:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851887.720204:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.720206:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851887.720207:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851887.720208:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.720210:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.720212:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851887.720213:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851887.720213:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851887.720213:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851887.720215:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10465@kfi7, seq: 2130833
00000100:00000001:9.0:1773851887.720217:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851887.720217:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000549590e8 : new rpc_count 1
00000100:00000001:9.0:1773851887.720218:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.720218:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856888832 : -106914852662784 : ffff9ec2f22f9200)
00000100:00000040:8.0:1773851887.720221:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000006631208 x1859597832273216/t0(0) o400->e22f308d-3d23-444f-b445-7046daf66cf5@10465@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1135-0'
00000100:00000001:8.0:1773851887.720227:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851887.720228:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851887.720229:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000006631208 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:e22f308d-3d23-444f-b445-7046daf66cf5+5:39540:x1859597832273216:12345-10465@kfi7:400:default-tuolumne1135-0
00000100:00000200:8.0:1773851887.720232:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597832273216
00000020:00000001:8.0:1773851887.720233:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851887.720234:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851887.720235:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.720237:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851887.720238:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851887.720239:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851887.720240:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597832273216, found 0 last_xid 1859597832273215
00000020:00000001:8.0:1773851887.720242:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851887.720243:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851887.720244:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851887.720245:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.720246:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851887.720248:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851887.720248:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851887.720250:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e856234f.
02000000:00000001:8.0:1773851887.720251:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.720252:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.720253:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851887.720255:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915840808, transno 0, xid 1859597832273216
00010000:00000001:8.0:1773851887.720256:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851887.720258:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000006631208 x1859597832273216/t0(0) o400->e22f308d-3d23-444f-b445-7046daf66cf5@10465@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1135-0'
00010000:00000001:8.0:1773851887.720263:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851887.720264:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851887.720265:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=120 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851887.720267:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851887.720269:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c671d741 refcount 3 to 10465@kfi7
00000100:00000001:8.0:1773851887.720271:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958004672 : -107146751546944 : ffff9e8cf3ef69c0)
02000000:00000001:8.0:1773851887.720272:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851887.720273:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.720274:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851887.720276:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10272@kfi7
00000400:00000010:8.0:1773851887.720277:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f71c7d5.
00000100:00000200:8.0:1773851887.720278:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597832273216, offset 224
00000400:00000200:8.0:1773851887.720281:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10272@kfi7
00000400:00000200:8.0:1773851887.720282:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10272@kfi7 to cpt 2
00000400:00000200:8.0:1773851887.720284:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e669ba9 nid 10272@kfi7 refs 1
00000400:00000200:8.0:1773851887.720286:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003e669ba9 nid 10272@kfi7 refs 2
00000400:00000200:8.0:1773851887.720288:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003e669ba9 nid 10272@kfi7 refs 3
00000400:00000200:8.0:1773851887.720290:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10272@kfi7 local destination
00000400:00000200:8.0:1773851887.720292:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769892:8769892:1024:4294967295] 10272@kfi7 LPNI seq info [582520:582520:16:4294967295]
00000400:00000200:8.0:1773851887.720295:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003e669ba9 nid 10272@kfi7 refs 2
00000400:00000200:8.0:1773851887.720297:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10272@kfi7 to cpt 2
00000400:00000200:8.0:1773851887.720301:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10272@kfi7(10272@kfi7:10272@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851887.720303:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003e669ba9 nid 10272@kfi7 refs 3
00000800:00000200:8.0:1773851887.720306:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851887.720308:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851887.720312:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851887.720316:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000097 Using peer 10272@kfi7(0x100000000000097)
00000800:00000200:8.0:1773851887.720322:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x100000000000097: rc=0
00000800:00000200:8.0:1773851887.720325:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000097 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851887.720328:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851887.720334:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c671d741 refcount 2 to 10465@kfi7
00010000:00000001:8.0:1773851887.720335:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851887.720336:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.720337:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851887.720338:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000006631208 x1859597832273216/t0(0) o400->e22f308d-3d23-444f-b445-7046daf66cf5@10465@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1135-0'
00000100:00100000:8.0:1773851887.720345:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000006631208 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:e22f308d-3d23-444f-b445-7046daf66cf5+5:39540:x1859597832273216:12345-10465@kfi7:400:default-tuolumne1135-0 Request processed in 116us (170us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851887.720349:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10465@kfi7, seq: 2130833
00000100:00000040:8.0:1773851887.720351:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000549590e8 : new rpc_count 0
00000100:00000001:8.0:1773851887.720352:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851887.720353:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851887.720354:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851887.720356:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851887.720357:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eeda7a28.
00000020:00000040:8.0:1773851887.720359:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000549590e8 : new refcount 4
00000100:00000001:8.0:1773851887.720360:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851887.720369:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000097 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851887.720373:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.720375:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10272@kfi7: PUT: OK
00000400:00000200:9.0:1773851887.720376:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f71c7d5
00000400:00000010:9.0:1773851887.720377:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f71c7d5.
00000100:00000001:9.0:1773851887.720378:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851887.720379:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851887.720381:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003e669ba9 nid 10272@kfi7 refs 2
00000800:00000200:9.0:1773851887.720384:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 10272@kfi7(000000009f98c2e4):0x0 lsk 152 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000097 Transaction freed
00000800:00000200:21.0:1773851887.730851:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851887.730852:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851887.730853:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851887.730855:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851887.730857:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26002@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.730858:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26002@kfi7 : PUT - for me
00000400:00000200:21.0:1773851887.730859:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26002@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.730860:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009225a09b nid 26002@kfi7 refs 1
00000400:00000200:21.0:1773851887.730861:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26002@kfi7 to cpt 5
00000400:00000200:21.0:1773851887.730862:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009225a09b nid 26002@kfi7 refs 2
00000400:00000200:21.0:1773851887.730862:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009225a09b nid 26002@kfi7 refs 3
00000400:00000200:21.0:1773851887.730863:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26003@kfi7 to cpt 0
00000400:00000200:21.0:1773851887.730864:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26003@kfi7 of length 224 into portal 12 MB=0x69b8098f984c0
00000400:00000200:21.0:1773851887.730865:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26003@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 55512
00000800:00000200:21.0:1773851887.730867:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851887.730868:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.730869:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26002@kfi7: PUT: OK
00000100:00000001:21.0:1773851887.730871:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851887.730871:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851887.730872:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004041d889.
00000100:00000040:21.0:1773851887.730873:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000004041d889 x1859826484872384 msgsize 224
00000100:00100000:21.0:1773851887.730874:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-26003@kfi7 (source: 12345-26002@kfi7)
00000100:00000001:21.0:1773851887.730875:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851887.730876:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009225a09b nid 26002@kfi7 refs 2
00000800:00000200:21.0:1773851887.730877:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851887.730877:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851887.730878:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851887.730879:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851887.730879:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851887.730880:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851887.730881:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859826484872384
00000020:00000001:20.0:1773851887.730881:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851887.730882:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f086fcb61048
00000020:00000001:20.0:1773851887.730883:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851887.730885:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b5a785d refcount=9
00000020:00000001:20.0:1773851887.730886:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636940883768320 : -107132825783296 : ffff9e9031f9b400)
00000020:00000001:20.0:1773851887.730887:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636940883768320 : -107132825783296 : ffff9e9031f9b400)
00000100:00000001:20.0:1773851887.730888:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.730889:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851887.730889:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8e3d745.
00000020:00000010:20.0:1773851887.730890:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.730891:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000afae15a5.
00000100:00000001:20.0:1773851887.730892:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851887.730892:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851887.730893:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851887.730894:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851887.730894:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851887.730895:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.730896:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851887.730897:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.730897:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851887.730897:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851887.730898:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851887.730899:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851887.730899:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26003@kfi7, seq: 1998044
00000100:00000040:20.0:1773851887.730899:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b5a785d : new rpc_count 1
00000100:00000001:23.0:1773851887.730900:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.730900:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956255744 : -106937753295872 : ffff9ebd9d33a400)
00000100:00000040:20.0:1773851887.730901:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004041d889 x1859826484872384/t0(0) o400->f64dc935-a5d2-4fbe-8996-8870b3b8534f@26003@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2118-0'
00000100:00000001:20.0:1773851887.730904:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851887.730905:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851887.730906:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004041d889 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f64dc935-a5d2-4fbe-8996-8870b3b8534f+9:39603:x1859826484872384:12345-26003@kfi7:400:default-tuolumne2118-0
00000100:00000200:20.0:1773851887.730909:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859826484872384
00000020:00000001:20.0:1773851887.730909:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851887.730910:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851887.730911:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.730911:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851887.730912:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851887.730913:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851887.730913:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859826484872384, found 0 last_xid 1859826484872383
00000020:00000001:20.0:1773851887.730914:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851887.730915:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851887.730915:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851887.730916:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.730916:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851887.730917:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851887.730918:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851887.730918:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000045d9bc17.
02000000:00000001:20.0:1773851887.730919:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.730919:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.730920:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851887.730921:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413774616, transno 0, xid 1859826484872384
00010000:00000001:20.0:1773851887.730921:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851887.730922:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004041d889 x1859826484872384/t0(0) o400->f64dc935-a5d2-4fbe-8996-8870b3b8534f@26003@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2118-0'
00010000:00000001:20.0:1773851887.730925:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851887.730925:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851887.730926:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=120 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851887.730927:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851887.730928:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000018a5f85f refcount 3 to 26003@kfi7
00000100:00000001:20.0:1773851887.730928:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572992 : -107154178978624 : ffff9e8b3939ccc0)
02000000:00000001:20.0:1773851887.730929:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851887.730930:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851887.730930:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851887.730931:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26002@kfi7
00000400:00000010:20.0:1773851887.730932:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000010ff00e2.
00000100:00000200:20.0:1773851887.730933:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859826484872384, offset 224
00000400:00000200:20.0:1773851887.730935:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26002@kfi7
00000400:00000200:20.0:1773851887.730935:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26002@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.730936:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009225a09b nid 26002@kfi7 refs 1
00000400:00000200:20.0:1773851887.730937:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009225a09b nid 26002@kfi7 refs 2
00000400:00000200:20.0:1773851887.730938:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009225a09b nid 26002@kfi7 refs 3
00000400:00000200:20.0:1773851887.730940:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26002@kfi7 local destination
00000400:00000200:20.0:1773851887.730941:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769893:8769893:1024:4294967295] 26002@kfi7 LPNI seq info [6826976:6826976:16:4294967295]
00000400:00000200:20.0:1773851887.730942:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009225a09b nid 26002@kfi7 refs 2
00000400:00000200:20.0:1773851887.730943:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26002@kfi7 to cpt 5
00000400:00000200:20.0:1773851887.730945:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26002@kfi7(26002@kfi7:26002@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851887.730946:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009225a09b nid 26002@kfi7 refs 3
00000800:00000200:20.0:1773851887.730947:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851887.730948:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851887.730950:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851887.730953:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5a6 Using peer 26002@kfi7(0x5a6)
00000800:00000200:20.0:1773851887.730955:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x5a6: rc=0
00000800:00000200:20.0:1773851887.730957:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5a6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851887.730959:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851887.730960:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000018a5f85f refcount 2 to 26003@kfi7
00010000:00000001:20.0:1773851887.730960:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851887.730961:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851887.730962:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851887.730962:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004041d889 x1859826484872384/t0(0) o400->f64dc935-a5d2-4fbe-8996-8870b3b8534f@26003@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2118-0'
00000100:00100000:20.0:1773851887.730967:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004041d889 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f64dc935-a5d2-4fbe-8996-8870b3b8534f+9:39603:x1859826484872384:12345-26003@kfi7:400:default-tuolumne2118-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851887.730969:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26003@kfi7, seq: 1998044
00000100:00000040:20.0:1773851887.730970:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b5a785d : new rpc_count 0
00000100:00000001:20.0:1773851887.730971:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851887.730972:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851887.730972:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851887.730973:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000afae15a5.
00000020:00000010:20.0:1773851887.730974:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8e3d745.
00000020:00000040:20.0:1773851887.730975:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000004b5a785d : new refcount 8
00000100:00000001:20.0:1773851887.730975:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851887.730981:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5a6 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851887.730983:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851887.730984:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26002@kfi7: PUT: OK
00000400:00000200:21.0:1773851887.730984:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000010ff00e2
00000400:00000010:21.0:1773851887.730985:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000010ff00e2.
00000100:00000001:21.0:1773851887.730985:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851887.730986:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851887.730986:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009225a09b nid 26002@kfi7 refs 2
00000800:00000200:21.0:1773851887.730988:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 26002@kfi7(00000000d6f12889):0x0 lsk 1447 rsk 39 tsk 0 trmk 0 tmk 0 trr 5 tta 0x5a6 Transaction freed
00010000:00000001:2.0:1773851887.753731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851887.753732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851887.753733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851887.753734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851887.753735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851887.753736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851887.753737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851887.753738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851887.753738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851887.753743:0:937829:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:19.0:1773851887.753743:0:937829:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:19.0:1773851887.753745:0:937829:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:11.0:1773851887.794834:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.794834:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851887.794835:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851887.794835:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851887.794836:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851887.794837:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851887.794838:0:2510946:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20595@kfi7(0000000004ee430a):0xf08 version: 2; local version 2; negotiated version: 2
00000800:00000200:11.0:1773851887.794840:0:2510946:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 Using peer 20595@kfi7(0x100000000000f08)
00000800:00000200:9.0:1773851887.794841:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:11.0:1773851887.794842:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20595@kfi7 to cpt 2
00000800:00000200:11.0:1773851887.794844:0:2510946:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 38 bytes to peer 0x100000000000f08: rc=0
00000400:00000200:9.0:1773851887.794844:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20595@kfi7 to cpt 2
00000800:00000200:11.0:1773851887.794846:0:2510946:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851887.794846:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20595@kfi7 : PUT - for me
00000400:00000200:9.0:1773851887.794847:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20595@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.794849:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 1
00000400:00000200:9.0:1773851887.794851:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20595@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.794852:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 2
00000400:00000200:9.0:1773851887.794853:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 3
00000400:00000200:9.0:1773851887.794854:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20594@kfi7 to cpt 7
00000400:00000200:9.0:1773851887.794856:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20594@kfi7 of length 456 into portal 12 MB=0x699e1825354c0
00000800:00000200:11.0:1773851887.794858:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851887.794858:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20594@kfi7 of length 456/456 into md 0x78146ce49 [64] + 151600
00000800:00000200:11.0:1773851887.794860:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b2566f3a: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 Transaction freed
00000800:00000200:9.0:1773851887.794861:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851887.794864:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.794866:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20595@kfi7: PUT: OK
00000100:00000001:9.0:1773851887.794867:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851887.794868:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851887.794870:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c1cbf64.
00000100:00000040:9.0:1773851887.794871:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004c1cbf64 x1858043693454528 msgsize 456
00000100:00100000:9.0:1773851887.794874:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20594@kfi7 (source: 12345-20595@kfi7)
00000100:00000001:9.0:1773851887.794875:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851887.794876:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 2
00000100:00000001:8.0:1773851887.794877:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851887.794877:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851887.794878:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851887.794878:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851887.794878:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.794879:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851887.794880:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043693454528
00000020:00000001:8.0:1773851887.794881:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851887.794881:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91690
00000020:00000001:8.0:1773851887.794882:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851887.794886:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005f684dd6 refcount=3833
00000020:00000001:8.0:1773851887.794887:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241256960 : -107152468294656 : ffff9e8b9f30c400)
00000020:00000001:8.0:1773851887.794888:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241256960 : -107152468294656 : ffff9e8b9f30c400)
00000100:00000001:8.0:1773851887.794889:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851887.794890:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851887.794891:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eeda7a28.
00000020:00000010:8.0:1773851887.794892:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851887.794895:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851887.794895:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851887.794896:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851887.794896:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.794897:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.794898:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.794899:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851887.794900:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851887.794901:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:8.0:1773851887.794901:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20594@kfi7, seq: 406391013
00000100:00000001:9.0:1773851887.794902:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:8.0:1773851887.794902:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005f684dd6 : new rpc_count 19
00000100:00000001:8.0:1773851887.794902:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856893440 : -106914852658176 : ffff9ec2f22fa400)
00000100:00000001:9.0:1773851887.794903:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851887.794903:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004c1cbf64 x1858043693454528/t0(0) o17->10c164be-21c2-4af7-bf32-80ca17bfc69c@20594@kfi7:675/0 lens 456/0 e 0 to 0 dl 1773852035 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1770-0'
00000100:00000001:9.0:1773851887.794904:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.794906:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851887.794906:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851887.794907:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c1cbf64 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:10c164be-21c2-4af7-bf32-80ca17bfc69c+3833:39847:x1858043693454528:12345-20594@kfi7:17:default-tuolumne1770-0
00000100:00000200:8.0:1773851887.794909:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043693454528
00000020:00000001:8.0:1773851887.794909:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851887.794910:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851887.794911:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.794911:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851887.794912:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:8.0:1773851887.794913:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851887.794913:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043693454528, found 0 last_xid 1858043692664575
00000020:00000001:8.0:1773851887.794914:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851887.794915:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851887.794915:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851887.794916:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851887.794917:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:8.0:1773851887.794917:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851887.794918:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851887.794918:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000023401374.
02000000:00000001:8.0:1773851887.794919:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.794920:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.794921:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:8.0:1773851887.794921:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:8.0:1773851887.794922:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:8.0:1773851887.794923:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.794923:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:8.0:1773851887.794924:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 10c164be-21c2-4af7-bf32-80ca17bfc69c/000000005f684dd6 free: 126633370845184 avail: 126633368748032
00000020:00000001:8.0:1773851887.794925:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:8.0:1773851887.794926:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 10c164be-21c2-4af7-bf32-80ca17bfc69c/000000005f684dd6 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:8.0:1773851887.794927:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:8.0:1773851887.794928:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:8.0:1773851887.794928:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 10c164be-21c2-4af7-bf32-80ca17bfc69c/000000005f684dd6 reports grant 1789132799 dropped 0, local 1882456063
00000020:00000001:8.0:1773851887.794929:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:8.0:1773851887.794930:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:8.0:1773851887.794930:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851887.794931:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590440, transno 0, xid 1858043693454528
00010000:00000001:8.0:1773851887.794932:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851887.794932:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004c1cbf64 x1858043693454528/t0(0) o17->10c164be-21c2-4af7-bf32-80ca17bfc69c@20594@kfi7:675/0 lens 456/432 e 0 to 0 dl 1773852035 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1770-0'
00010000:00000001:8.0:1773851887.794935:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851887.794935:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851887.794936:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=120 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851887.794937:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851887.794938:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a174029 refcount 3 to 20594@kfi7
00000100:00000001:8.0:1773851887.794939:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064992 : -107155994486624 : ffff9e8acd0358a0)
02000000:00000001:8.0:1773851887.794940:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851887.794940:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.794941:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851887.794942:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20595@kfi7
00000400:00000010:8.0:1773851887.794942:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002bb674c2.
00000100:00000200:8.0:1773851887.794943:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858043693454528, offset 224
00000400:00000200:8.0:1773851887.794945:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20595@kfi7
00000400:00000200:8.0:1773851887.794946:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20595@kfi7 to cpt 2
00000400:00000200:8.0:1773851887.794947:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 1
00000400:00000200:8.0:1773851887.794948:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 2
00000400:00000200:8.0:1773851887.794949:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 3
00000400:00000200:8.0:1773851887.794951:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20595@kfi7 local destination
00000400:00000200:8.0:1773851887.794952:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769894:8769894:1024:4294967295] 20595@kfi7 LPNI seq info [8235076:8235076:16:4294967295]
00000400:00000200:8.0:1773851887.794953:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 2
00000400:00000200:8.0:1773851887.794954:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20595@kfi7 to cpt 2
00000400:00000200:8.0:1773851887.794956:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20595@kfi7(20595@kfi7:20595@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851887.794957:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 3
00000800:00000200:8.0:1773851887.794959:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851887.794960:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:8.0:1773851887.794962:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851887.794965:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 Using peer 20595@kfi7(0x100000000000f08)
00000800:00000200:8.0:1773851887.794967:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 532 bytes to peer 0x100000000000f08: rc=0
00000800:00000200:8.0:1773851887.794969:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851887.794971:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851887.794971:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a174029 refcount 2 to 20594@kfi7
00010000:00000001:8.0:1773851887.794972:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851887.794972:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851887.794973:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851887.794974:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c1cbf64 x1858043693454528/t0(0) o17->10c164be-21c2-4af7-bf32-80ca17bfc69c@20594@kfi7:675/0 lens 456/432 e 0 to 0 dl 1773852035 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1770-0'
00000100:00100000:8.0:1773851887.794979:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c1cbf64 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:10c164be-21c2-4af7-bf32-80ca17bfc69c+3833:39847:x1858043693454528:12345-20594@kfi7:17:default-tuolumne1770-0 Request processed in 72us (107us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851887.794984:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20594@kfi7, seq: 406391013
00000100:00000040:8.0:1773851887.794984:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005f684dd6 : new rpc_count 18
00000100:00000001:8.0:1773851887.794985:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851887.794986:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851887.794986:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851887.794987:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851887.794988:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eeda7a28.
00000020:00000040:8.0:1773851887.794989:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000005f684dd6 : new refcount 3832
00000100:00000001:8.0:1773851887.794989:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851887.794995:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851887.794996:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851887.794998:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20595@kfi7: PUT: OK
00000400:00000200:11.0:1773851887.794998:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002bb674c2
00000400:00000010:11.0:1773851887.794999:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002bb674c2.
00000100:00000001:11.0:1773851887.795000:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851887.795000:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851887.795001:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000097f2e1f6 nid 20595@kfi7 refs 2
00000800:00000200:11.0:1773851887.795002:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20595@kfi7(0000000004ee430a):0x0 lsk 3849 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f08 Transaction freed
00000800:00000200:9.0:1773851887.842140:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.842141:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851887.842142:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851887.842144:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851887.842146:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26208@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.842147:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26208@kfi7 : PUT - for me
00000400:00000200:9.0:1773851887.842148:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26208@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.842149:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de1f156b nid 26208@kfi7 refs 1
00000400:00000200:9.0:1773851887.842150:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26208@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.842150:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de1f156b nid 26208@kfi7 refs 2
00000400:00000200:9.0:1773851887.842151:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de1f156b nid 26208@kfi7 refs 3
00000400:00000200:9.0:1773851887.842152:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26209@kfi7 to cpt 5
00000400:00000200:9.0:1773851887.842152:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26209@kfi7 of length 224 into portal 12 MB=0x69b4c38a0d980
00000400:00000200:9.0:1773851887.842153:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26209@kfi7 of length 224/224 into md 0x78146ce49 [64] + 152056
00000800:00000200:9.0:1773851887.842155:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851887.842156:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.842157:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26208@kfi7: PUT: OK
00000100:00000001:9.0:1773851887.842158:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851887.842159:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851887.842159:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e6971502.
00000100:00000040:9.0:1773851887.842160:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e6971502 x1859601530149248 msgsize 224
00000100:00100000:9.0:1773851887.842161:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26209@kfi7 (source: 12345-26208@kfi7)
00000100:00000001:9.0:1773851887.842162:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851887.842163:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de1f156b nid 26208@kfi7 refs 2
00000100:00000001:8.0:1773851887.842163:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851887.842164:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851887.842164:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851887.842164:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851887.842165:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.842165:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851887.842166:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601530149248
00000020:00000001:8.0:1773851887.842167:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851887.842167:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8f5e4
00000020:00000001:8.0:1773851887.842167:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851887.842170:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b9b22ad0 refcount=5
00000020:00000001:8.0:1773851887.842171:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637104769018880 : -106968940532736 : ffff9eb65a4c2c00)
00000020:00000001:8.0:1773851887.842172:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637104769018880 : -106968940532736 : ffff9eb65a4c2c00)
00000100:00000001:8.0:1773851887.842172:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851887.842173:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851887.842174:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eeda7a28.
00000020:00000010:8.0:1773851887.842174:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851887.842175:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851887.842176:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851887.842176:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851887.842176:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.842177:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851887.842178:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851887.842178:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.842179:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.842180:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851887.842181:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851887.842181:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851887.842181:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851887.842182:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26209@kfi7, seq: 2130834
00000100:00000040:9.0:1773851887.842182:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b9b22ad0 : new rpc_count 1
00000100:00000001:8.0:1773851887.842182:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.842183:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856884224 : -106914852667392 : ffff9ec2f22f8000)
00000100:00000001:8.0:1773851887.842183:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851887.842184:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e6971502 x1859601530149248/t0(0) o400->59cf3142-d3f4-4365-9aad-ce589addb979@26209@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2128-0'
00000100:00000001:9.0:1773851887.842187:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851887.842187:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851887.842188:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6971502 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:59cf3142-d3f4-4365-9aad-ce589addb979+5:39537:x1859601530149248:12345-26209@kfi7:400:default-tuolumne2128-0
00000100:00000200:9.0:1773851887.842190:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601530149248
00000020:00000001:9.0:1773851887.842190:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851887.842191:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851887.842191:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.842192:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851887.842193:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851887.842193:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851887.842194:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601530149248, found 0 last_xid 1859601530149247
00000020:00000001:9.0:1773851887.842195:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851887.842195:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851887.842196:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851887.842196:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.842197:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851887.842197:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851887.842198:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851887.842199:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ede84d6e.
02000000:00000001:9.0:1773851887.842200:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.842200:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.842201:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851887.842201:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013960288, transno 0, xid 1859601530149248
00010000:00000001:9.0:1773851887.842202:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851887.842203:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e6971502 x1859601530149248/t0(0) o400->59cf3142-d3f4-4365-9aad-ce589addb979@26209@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2128-0'
00010000:00000001:9.0:1773851887.842205:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851887.842206:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851887.842207:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=120 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851887.842208:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851887.842208:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000273b0f1e refcount 3 to 26209@kfi7
00000100:00000001:9.0:1773851887.842209:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096512 : -107139307455104 : ffff9e8eafa33d80)
02000000:00000001:9.0:1773851887.842210:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851887.842210:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.842210:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851887.842211:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26208@kfi7
00000400:00000010:9.0:1773851887.842212:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c6a04e2b.
00000100:00000200:9.0:1773851887.842213:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601530149248, offset 224
00000400:00000200:9.0:1773851887.842214:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26208@kfi7
00000400:00000200:9.0:1773851887.842215:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26208@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.842216:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de1f156b nid 26208@kfi7 refs 1
00000400:00000200:9.0:1773851887.842217:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de1f156b nid 26208@kfi7 refs 2
00000400:00000200:9.0:1773851887.842218:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de1f156b nid 26208@kfi7 refs 3
00000400:00000200:9.0:1773851887.842219:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26208@kfi7 local destination
00000400:00000200:9.0:1773851887.842220:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769895:8769895:1024:4294967295] 26208@kfi7 LPNI seq info [2472379:2472379:16:4294967295]
00000400:00000200:9.0:1773851887.842222:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000de1f156b nid 26208@kfi7 refs 2
00000400:00000200:9.0:1773851887.842222:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26208@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.842224:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26208@kfi7(26208@kfi7:26208@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851887.842225:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de1f156b nid 26208@kfi7 refs 3
00000800:00000200:9.0:1773851887.842227:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.842228:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851887.842230:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851887.842232:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e8d Using peer 26208@kfi7(0x100000000000e8d)
00000800:00000200:9.0:1773851887.842235:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x100000000000e8d: rc=0
00000800:00000200:9.0:1773851887.842237:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e8d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851887.842238:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851887.842239:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000273b0f1e refcount 2 to 26209@kfi7
00010000:00000001:9.0:1773851887.842240:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851887.842240:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.842241:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851887.842241:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e6971502 x1859601530149248/t0(0) o400->59cf3142-d3f4-4365-9aad-ce589addb979@26209@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2128-0'
00000100:00100000:9.0:1773851887.842244:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6971502 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:59cf3142-d3f4-4365-9aad-ce589addb979+5:39537:x1859601530149248:12345-26209@kfi7:400:default-tuolumne2128-0 Request processed in 56us (83us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851887.842246:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26209@kfi7, seq: 2130834
00000100:00000040:9.0:1773851887.842247:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b9b22ad0 : new rpc_count 0
00000100:00000001:9.0:1773851887.842248:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851887.842248:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851887.842249:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:9.0:1773851887.842249:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000800:00000200:10.0:1773851887.842250:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e8d TN_EVENT_TX_OK event status 0
00000020:00000010:9.0:1773851887.842250:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eeda7a28.
00000020:00000040:9.0:1773851887.842251:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000b9b22ad0 : new refcount 4
00000100:00000001:9.0:1773851887.842251:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851887.842252:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851887.842253:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26208@kfi7: PUT: OK
00000400:00000200:10.0:1773851887.842254:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c6a04e2b
00000400:00000010:10.0:1773851887.842255:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c6a04e2b.
00000100:00000001:10.0:1773851887.842255:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851887.842256:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851887.842257:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000de1f156b nid 26208@kfi7 refs 2
00000800:00000200:10.0:1773851887.842258:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 26208@kfi7(0000000055ba5daa):0x0 lsk 3726 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e8d Transaction freed
00000800:00000200:13.0:1773851887.861357:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851887.861358:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851887.861360:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851887.861364:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851887.861367:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13346@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.861369:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13346@kfi7 : PUT - for me
00000400:00000200:13.0:1773851887.861371:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13346@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.861372:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000464eb366 nid 13346@kfi7 refs 1
00000400:00000200:13.0:1773851887.861374:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13346@kfi7 to cpt 3
00000400:00000200:13.0:1773851887.861375:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000464eb366 nid 13346@kfi7 refs 2
00000400:00000200:13.0:1773851887.861377:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000464eb366 nid 13346@kfi7 refs 3
00000400:00000200:13.0:1773851887.861378:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13347@kfi7 to cpt 6
00000400:00000200:13.0:1773851887.861379:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13347@kfi7 of length 224 into portal 12 MB=0x69b0942228340
00000400:00000200:13.0:1773851887.861382:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13347@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 45808
00000800:00000200:13.0:1773851887.861385:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851887.861387:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851887.861389:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13346@kfi7: PUT: OK
00000100:00000001:13.0:1773851887.861391:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851887.861391:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851887.861393:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000048f1e8a9.
00000100:00000040:13.0:1773851887.861395:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000048f1e8a9 x1859313926832960 msgsize 224
00000100:00100000:13.0:1773851887.861398:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13347@kfi7 (source: 12345-13346@kfi7)
00000100:00000001:13.0:1773851887.861400:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851887.861401:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000464eb366 nid 13346@kfi7 refs 2
00000100:00000001:12.0:1773851887.861403:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851887.861404:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851887.861404:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851887.861406:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851887.861407:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851887.861408:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851887.861410:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313926832960
00000020:00000001:12.0:1773851887.861411:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851887.861412:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f43
00000020:00000001:12.0:1773851887.861413:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851887.861417:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000429d78ff refcount=6
00000020:00000001:12.0:1773851887.861419:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239865344 : -107152469686272 : ffff9e8b9f1b8800)
00000020:00000001:12.0:1773851887.861420:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239865344 : -107152469686272 : ffff9e8b9f1b8800)
00000100:00000001:12.0:1773851887.861422:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851887.861423:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851887.861425:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b96e46cc.
00000020:00000010:12.0:1773851887.861427:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851887.861428:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000084c0a733.
00000100:00000001:12.0:1773851887.861430:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851887.861431:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851887.861432:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851887.861434:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851887.861435:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851887.861435:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.861437:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851887.861440:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851887.861441:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851887.861441:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851887.861442:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851887.861443:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13347@kfi7, seq: 2289897
00000100:00000001:15.0:1773851887.861444:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851887.861444:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000429d78ff : new rpc_count 1
00000100:00000001:15.0:1773851887.861446:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.861446:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485598080 : -107000223953536 : ffff9eaf11a90d80)
00000100:00000040:12.0:1773851887.861448:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000048f1e8a9 x1859313926832960/t0(0) o400->37137342-fb28-475c-84aa-ec01f9457684@13347@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1323-0'
00000100:00000001:12.0:1773851887.861454:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851887.861454:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851887.861456:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048f1e8a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:37137342-fb28-475c-84aa-ec01f9457684+6:39825:x1859313926832960:12345-13347@kfi7:400:default-tuolumne1323-0
00000100:00000200:12.0:1773851887.861459:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313926832960
00000020:00000001:12.0:1773851887.861461:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851887.861462:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851887.861464:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.861465:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851887.861466:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851887.861467:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851887.861468:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313926832960, found 0 last_xid 1859313926832959
00000020:00000001:12.0:1773851887.861470:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851887.861471:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851887.861472:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851887.861473:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.861474:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851887.861475:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851887.861476:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851887.861478:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007dc04c79.
02000000:00000001:12.0:1773851887.861479:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.861480:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.861481:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851887.861483:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183245103022, transno 0, xid 1859313926832960
00010000:00000001:12.0:1773851887.861484:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851887.861486:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000048f1e8a9 x1859313926832960/t0(0) o400->37137342-fb28-475c-84aa-ec01f9457684@13347@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1323-0'
00010000:00000001:12.0:1773851887.861491:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851887.861491:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851887.861493:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=120 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851887.861495:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851887.861496:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000de879b7b refcount 3 to 13347@kfi7
00000100:00000001:12.0:1773851887.861497:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313741216 : -107139395810400 : ffff9e8eaa5f0ba0)
02000000:00000001:12.0:1773851887.861499:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851887.861500:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851887.861501:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851887.861503:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13346@kfi7
00000400:00000010:12.0:1773851887.861504:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006af2a73b.
00000100:00000200:12.0:1773851887.861506:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859313926832960, offset 224
00000400:00000200:12.0:1773851887.861509:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13346@kfi7
00000400:00000200:12.0:1773851887.861511:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13346@kfi7 to cpt 3
00000400:00000200:12.0:1773851887.861513:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000464eb366 nid 13346@kfi7 refs 1
00000400:00000200:12.0:1773851887.861515:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000464eb366 nid 13346@kfi7 refs 2
00000400:00000200:12.0:1773851887.861517:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000464eb366 nid 13346@kfi7 refs 3
00000400:00000200:12.0:1773851887.861520:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13346@kfi7 local destination
00000400:00000200:12.0:1773851887.861523:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769896:8769896:1024:4294967295] 13346@kfi7 LPNI seq info [426889:426889:16:4294967295]
00000400:00000200:12.0:1773851887.861525:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000464eb366 nid 13346@kfi7 refs 2
00000400:00000200:12.0:1773851887.861527:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13346@kfi7 to cpt 3
00000400:00000200:12.0:1773851887.861531:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13346@kfi7(13346@kfi7:13346@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851887.861533:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000464eb366 nid 13346@kfi7 refs 3
00000800:00000200:12.0:1773851887.861536:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851887.861539:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851887.861543:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851887.861547:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc7f Using peer 13346@kfi7(0xc7f)
00000800:00000200:12.0:1773851887.861553:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0xc7f: rc=0
00000800:00000200:12.0:1773851887.861556:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc7f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851887.861559:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851887.861561:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000de879b7b refcount 2 to 13347@kfi7
00010000:00000001:12.0:1773851887.861564:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851887.861565:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851887.861566:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851887.861568:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000048f1e8a9 x1859313926832960/t0(0) o400->37137342-fb28-475c-84aa-ec01f9457684@13347@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1323-0'
00000100:00100000:12.0:1773851887.861574:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048f1e8a9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:37137342-fb28-475c-84aa-ec01f9457684+6:39825:x1859313926832960:12345-13347@kfi7:400:default-tuolumne1323-0 Request processed in 119us (177us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851887.861578:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13347@kfi7, seq: 2289897
00000100:00000040:12.0:1773851887.861580:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000429d78ff : new rpc_count 0
00000100:00000001:12.0:1773851887.861581:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851887.861582:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851887.861583:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851887.861585:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000084c0a733.
00000020:00000010:12.0:1773851887.861586:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b96e46cc.
00000020:00000040:12.0:1773851887.861588:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000429d78ff : new refcount 5
00000100:00000001:12.0:1773851887.861589:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851887.861598:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc7f TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851887.861602:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851887.861604:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13346@kfi7: PUT: OK
00000400:00000200:13.0:1773851887.861605:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006af2a73b
00000400:00000010:13.0:1773851887.861606:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006af2a73b.
00000100:00000001:13.0:1773851887.861607:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851887.861607:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851887.861609:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000464eb366 nid 13346@kfi7 refs 2
00000800:00000200:13.0:1773851887.861611:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 13346@kfi7(00000000c4d17531):0x0 lsk 3200 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc7f Transaction freed
00000800:00000200:6.0:1773851887.900708:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851887.900710:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851887.900712:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851887.900716:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851887.900720:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10243@kfi7 to cpt 1
00000400:00000200:6.0:1773851887.900722:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10243@kfi7 : PUT - for me
00000400:00000200:6.0:1773851887.900724:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10243@kfi7 to cpt 1
00000400:00000200:6.0:1773851887.900731:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093a58384 nid 10243@kfi7 refs 1
00000400:00000200:6.0:1773851887.900733:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10243@kfi7 to cpt 1
00000400:00000200:6.0:1773851887.900734:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093a58384 nid 10243@kfi7 refs 2
00000400:00000200:6.0:1773851887.900736:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000093a58384 nid 10243@kfi7 refs 3
00000400:00000200:6.0:1773851887.900737:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10434@kfi7 to cpt 1
00000400:00000200:6.0:1773851887.900739:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10434@kfi7 of length 224 into portal 12 MB=0x699e12b282300
00000400:00000200:6.0:1773851887.900742:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10434@kfi7 of length 224/224 into md 0x793926dc5 [64] + 157240
00000800:00000200:6.0:1773851887.900745:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851887.900748:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851887.900750:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10243@kfi7: PUT: OK
00000100:00000001:6.0:1773851887.900752:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851887.900752:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851887.900754:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000091054246.
00000100:00000040:6.0:1773851887.900755:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000091054246 x1858042231005952 msgsize 224
00000100:00100000:6.0:1773851887.900758:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-10434@kfi7 (source: 12345-10243@kfi7)
00000100:00000001:6.0:1773851887.900759:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851887.900761:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000093a58384 nid 10243@kfi7 refs 2
00000100:00000001:4.0:1773851887.900761:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851887.900761:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851887.900762:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851887.900762:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851887.900763:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851887.900763:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851887.900764:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042231005952
00000020:00000001:4.0:1773851887.900764:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851887.900765:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91697
00000020:00000001:4.0:1773851887.900765:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851887.900766:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d9faecb5 refcount=6
00000020:00000001:4.0:1773851887.900767:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241263104 : -107152468288512 : ffff9e8b9f30dc00)
00000020:00000001:4.0:1773851887.900768:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241263104 : -107152468288512 : ffff9e8b9f30dc00)
00000100:00000001:4.0:1773851887.900769:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851887.900770:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851887.900771:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851887.900772:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851887.900772:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851887.900773:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851887.900774:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851887.900774:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851887.900775:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851887.900776:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851887.900777:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.900777:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851887.900779:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851887.900779:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851887.900780:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:4.0:1773851887.900780:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10434@kfi7, seq: 2001969
00000100:00000001:7.0:1773851887.900781:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:4.0:1773851887.900781:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d9faecb5 : new rpc_count 1
00000100:00000001:7.0:1773851887.900782:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851887.900782:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.900782:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814083072 : -107101895468544 : ffff9e976590da00)
00000100:00000040:4.0:1773851887.900783:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000091054246 x1858042231005952/t0(0) o400->4e97730e-d0b9-4c55-8e07-c07be224a7a1@10434@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1143-0'
00000100:00000001:4.0:1773851887.900785:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851887.900786:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851887.900787:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091054246 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4e97730e-d0b9-4c55-8e07-c07be224a7a1+6:39685:x1858042231005952:12345-10434@kfi7:400:default-tuolumne1143-0
00000100:00000200:4.0:1773851887.900788:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042231005952
00000020:00000001:4.0:1773851887.900789:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851887.900789:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851887.900790:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.900791:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851887.900791:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851887.900792:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851887.900792:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042231005952, found 0 last_xid 1858042231005951
00000020:00000001:4.0:1773851887.900793:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851887.900794:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851887.900794:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851887.900795:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.900796:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851887.900797:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851887.900797:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851887.900798:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002c3df5d6.
02000000:00000001:4.0:1773851887.900798:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.900799:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.900800:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851887.900800:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096696864, transno 0, xid 1858042231005952
00010000:00000001:4.0:1773851887.900802:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851887.900803:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000091054246 x1858042231005952/t0(0) o400->4e97730e-d0b9-4c55-8e07-c07be224a7a1@10434@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1143-0'
00010000:00000001:4.0:1773851887.900805:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851887.900806:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851887.900806:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=119 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851887.900807:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851887.900808:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6bd0f50 refcount 3 to 10434@kfi7
00000100:00000001:4.0:1773851887.900809:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412672 : -107145304138944 : ffff9e8d4a351b40)
02000000:00000001:4.0:1773851887.900810:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851887.900810:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851887.900811:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851887.900812:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10243@kfi7
00000400:00000010:4.0:1773851887.900813:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f42716b0.
00000100:00000200:4.0:1773851887.900813:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042231005952, offset 224
00000400:00000200:4.0:1773851887.900814:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10243@kfi7
00000400:00000200:4.0:1773851887.900815:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10243@kfi7 to cpt 1
00000400:00000200:4.0:1773851887.900816:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093a58384 nid 10243@kfi7 refs 1
00000400:00000200:4.0:1773851887.900817:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000093a58384 nid 10243@kfi7 refs 2
00000400:00000200:4.0:1773851887.900819:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000093a58384 nid 10243@kfi7 refs 3
00000400:00000200:4.0:1773851887.900820:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10243@kfi7 local destination
00000400:00000200:4.0:1773851887.900821:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769897:8769897:1024:4294967295] 10243@kfi7 LPNI seq info [449148:449148:16:4294967295]
00000400:00000200:4.0:1773851887.900822:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000093a58384 nid 10243@kfi7 refs 2
00000400:00000200:4.0:1773851887.900823:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10243@kfi7 to cpt 1
00000400:00000200:4.0:1773851887.900825:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10243@kfi7(10243@kfi7:10243@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851887.900826:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000093a58384 nid 10243@kfi7 refs 3
00000800:00000200:4.0:1773851887.900827:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851887.900828:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851887.900830:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851887.900845:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcf0 Using peer 10243@kfi7(0xcf0)
00000800:00000200:4.0:1773851887.900848:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0xcf0: rc=0
00000800:00000200:4.0:1773851887.900850:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcf0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851887.900852:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851887.900853:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6bd0f50 refcount 2 to 10434@kfi7
00010000:00000001:4.0:1773851887.900854:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851887.900854:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851887.900855:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851887.900855:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000091054246 x1858042231005952/t0(0) o400->4e97730e-d0b9-4c55-8e07-c07be224a7a1@10434@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1143-0'
00000100:00100000:4.0:1773851887.900860:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091054246 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:4e97730e-d0b9-4c55-8e07-c07be224a7a1+6:39685:x1858042231005952:12345-10434@kfi7:400:default-tuolumne1143-0 Request processed in 74us (104us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851887.900862:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10434@kfi7, seq: 2001969
00000100:00000040:4.0:1773851887.900863:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d9faecb5 : new rpc_count 0
00000100:00000001:4.0:1773851887.900863:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851887.900864:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851887.900865:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851887.900865:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851887.900866:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851887.900867:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000d9faecb5 : new refcount 5
00000100:00000001:4.0:1773851887.900868:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851887.900874:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcf0 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851887.900877:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851887.900879:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10243@kfi7: PUT: OK
00000400:00000200:5.0:1773851887.900880:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f42716b0
00000400:00000010:5.0:1773851887.900881:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f42716b0.
00000100:00000001:5.0:1773851887.900882:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851887.900883:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851887.900884:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000093a58384 nid 10243@kfi7 refs 2
00000800:00000200:5.0:1773851887.900887:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 10243@kfi7(00000000a0bb9608):0x0 lsk 3313 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0xcf0 Transaction freed
00000800:00000200:10.0:1773851887.927283:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851887.927284:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851887.927284:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.927285:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851887.927286:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851887.927287:0:2464469:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22946@kfi7(00000000a4e7e905):0x853 version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851887.927287:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851887.927289:0:2464469:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 Using peer 22946@kfi7(0x853)
00000400:00000200:10.0:1773851887.927291:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22946@kfi7 to cpt 2
00000800:00000200:9.0:1773851887.927292:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:10.0:1773851887.927293:0:2464469:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000348da31e: Posted send of 38 bytes to peer 0x853: rc=0
00000800:00000200:10.0:1773851887.927295:0:2464469:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851887.927295:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22946@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.927297:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22946@kfi7 : PUT - for me
00000400:00000200:9.0:1773851887.927298:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22946@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.927300:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c49a1abc nid 22946@kfi7 refs 1
00000400:00000200:9.0:1773851887.927302:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22946@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.927303:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c49a1abc nid 22946@kfi7 refs 2
00000400:00000200:9.0:1773851887.927304:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c49a1abc nid 22946@kfi7 refs 3
00000400:00000200:9.0:1773851887.927306:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22946@kfi7 to cpt 2
00000800:00000200:10.0:1773851887.927307:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851887.927307:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22946@kfi7 of length 224 into portal 12 MB=0x69b8239b66180
00000400:00000200:9.0:1773851887.927309:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22946@kfi7 of length 224/224 into md 0x78146ce49 [64] + 152280
00000800:00000200:10.0:1773851887.927312:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 Transaction freed
00000800:00000200:9.0:1773851887.927312:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851887.927315:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851887.927317:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22946@kfi7: PUT: OK
00000100:00000001:9.0:1773851887.927318:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851887.927319:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851887.927320:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000691a9424.
00000100:00000040:9.0:1773851887.927321:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000691a9424 x1859833476571520 msgsize 224
00000100:00100000:9.0:1773851887.927324:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22946@kfi7 (source: 12345-22946@kfi7)
00000100:00000001:9.0:1773851887.927326:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851887.927328:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c49a1abc nid 22946@kfi7 refs 2
00000800:00000200:9.0:1773851887.927330:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851887.927335:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851887.927336:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851887.927337:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851887.927337:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851887.927339:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851887.927340:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833476571520
00000020:00000001:9.0:1773851887.927341:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851887.927343:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875ef7561a
00000020:00000001:9.0:1773851887.927344:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851887.927347:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fcfa66b7 refcount=5
00000020:00000001:9.0:1773851887.927348:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637099154560000 : -106974554991616 : ffff9eb50ba65400)
00000020:00000001:9.0:1773851887.927349:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637099154560000 : -106974554991616 : ffff9eb50ba65400)
00000100:00000001:9.0:1773851887.927351:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851887.927352:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851887.927355:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aae1527.
00000020:00000010:9.0:1773851887.927357:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851887.927358:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f2d33498.
00000100:00000001:9.0:1773851887.927359:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851887.927360:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851887.927361:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.927362:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851887.927363:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851887.927364:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.927366:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.927368:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851887.927368:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851887.927368:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851887.927369:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851887.927370:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22946@kfi7, seq: 2130835
00000100:00000040:9.0:1773851887.927371:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fcfa66b7 : new rpc_count 1
00000100:00000001:8.0:1773851887.927371:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.927372:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856914176 : -106914852637440 : ffff9ec2f22ff500)
00000100:00000001:8.0:1773851887.927373:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851887.927374:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000691a9424 x1859833476571520/t0(0) o400->2840eaab-6453-4c8e-88f6-54fee69319d1@22946@kfi7:614/0 lens 224/0 e 0 to 0 dl 1773851974 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1916-0'
00000100:00000001:9.0:1773851887.927379:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851887.927379:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851887.927381:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000691a9424 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:2840eaab-6453-4c8e-88f6-54fee69319d1+5:39636:x1859833476571520:12345-22946@kfi7:400:default-tuolumne1916-0
00000100:00000200:9.0:1773851887.927383:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833476571520
00000020:00000001:9.0:1773851887.927384:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851887.927385:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851887.927386:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.927387:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851887.927388:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851887.927390:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851887.927391:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833476571520, found 0 last_xid 1859833476571519
00000020:00000001:9.0:1773851887.927392:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851887.927393:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851887.927394:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851887.927395:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.927396:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851887.927397:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851887.927397:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851887.927398:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009264c441.
02000000:00000001:9.0:1773851887.927400:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.927401:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.927402:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851887.927403:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413759686, transno 0, xid 1859833476571520
00010000:00000001:9.0:1773851887.927404:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851887.927405:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000691a9424 x1859833476571520/t0(0) o400->2840eaab-6453-4c8e-88f6-54fee69319d1@22946@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1916-0'
00010000:00000001:9.0:1773851887.927410:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851887.927410:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851887.927412:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=120 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851887.927413:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851887.927414:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000079df737b refcount 3 to 22946@kfi7
00000100:00000001:9.0:1773851887.927416:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551674688 : -107156157876928 : ffff9e8ac3463540)
02000000:00000001:9.0:1773851887.927417:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851887.927418:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.927419:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851887.927420:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22946@kfi7
00000400:00000010:9.0:1773851887.927421:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a665d1ec.
00000100:00000200:9.0:1773851887.927422:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833476571520, offset 224
00000400:00000200:9.0:1773851887.927424:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22946@kfi7
00000400:00000200:9.0:1773851887.927426:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22946@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.927427:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c49a1abc nid 22946@kfi7 refs 1
00000400:00000200:9.0:1773851887.927428:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c49a1abc nid 22946@kfi7 refs 2
00000400:00000200:9.0:1773851887.927431:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c49a1abc nid 22946@kfi7 refs 3
00000400:00000200:9.0:1773851887.927433:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22946@kfi7 local destination
00000400:00000200:9.0:1773851887.927435:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769898:8769898:1024:4294967295] 22946@kfi7 LPNI seq info [169567:169567:16:4294967295]
00000400:00000200:9.0:1773851887.927438:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c49a1abc nid 22946@kfi7 refs 2
00000400:00000200:9.0:1773851887.927439:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22946@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.927443:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22946@kfi7(22946@kfi7:22946@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851887.927445:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c49a1abc nid 22946@kfi7 refs 3
00000800:00000200:9.0:1773851887.927447:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.927448:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851887.927452:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851887.927456:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 Using peer 22946@kfi7(0x853)
00000800:00000200:9.0:1773851887.927460:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x853: rc=0
00000800:00000200:9.0:1773851887.927463:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851887.927466:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851887.927467:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000079df737b refcount 2 to 22946@kfi7
00010000:00000001:9.0:1773851887.927469:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851887.927469:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851887.927470:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851887.927472:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000691a9424 x1859833476571520/t0(0) o400->2840eaab-6453-4c8e-88f6-54fee69319d1@22946@kfi7:614/0 lens 224/224 e 0 to 0 dl 1773851974 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1916-0'
00000800:00000200:10.0:1773851887.927475:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851887.927477:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:9.0:1773851887.927477:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000691a9424 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:2840eaab-6453-4c8e-88f6-54fee69319d1+5:39636:x1859833476571520:12345-22946@kfi7:400:default-tuolumne1916-0 Request processed in 97us (154us total) trans 0 rc 0/0
00000400:00000200:10.0:1773851887.927478:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22946@kfi7: PUT: OK
00000400:00000200:10.0:1773851887.927479:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a665d1ec
00000400:00000010:10.0:1773851887.927480:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a665d1ec.
00000100:00000001:10.0:1773851887.927480:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851887.927481:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851887.927481:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c49a1abc nid 22946@kfi7 refs 2
00000100:00100000:9.0:1773851887.927481:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22946@kfi7, seq: 2130835
00000100:00000040:9.0:1773851887.927482:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fcfa66b7 : new rpc_count 0
00000800:00000200:10.0:1773851887.927483:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 22946@kfi7(00000000a4e7e905):0x0 lsk 2132 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x853 Transaction freed
00000100:00000001:9.0:1773851887.927483:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851887.927485:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851887.927486:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851887.927487:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f2d33498.
00000020:00000010:9.0:1773851887.927488:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aae1527.
00000020:00000040:9.0:1773851887.927490:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000fcfa66b7 : new refcount 4
00000100:00000001:9.0:1773851887.927491:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851887.945730:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851887.945730:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:11.0:1773851887.945731:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:10.0:1773851887.945731:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c0304258.
00000004:00000020:11.0:1773851887.945732:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851887.945732:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a9a6f7d.
00000020:00000040:10.0:1773851887.945732:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000001:10.0:1773851887.945732:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:11.0:1773851887.945733:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
02000000:00000001:10.0:1773851887.945733:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:11.0:1773851887.945734:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851887.945734:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851887.945734:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851887.945735:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851887.945735:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000060c86190.
02000000:00000010:11.0:1773851887.945736:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001b3f89b7.
00000100:00000001:10.0:1773851887.945736:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851887.945737:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851887.945737:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851887.945737:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851887.945738:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.945738:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851887.945739:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002a9a6f7d] to pc [ptlrpcd_02_01+1]  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851887.945739:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c0304258] to pc [ptlrpcd_02_00+0]  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:11.0:1773851887.945743:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851887.945743:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.945745:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851887.945745:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851887.945746:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851887.945746:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851887.945746:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851887.945747:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:9.0:1773851887.945748:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851887.945748:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851887.945753:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851887.945753:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.945753:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851887.945754:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851887.945755:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851887.945756:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.945756:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:9.0:1773851887.945757:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c0304258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051936448:12@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851887.945757:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851887.945758:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a9a6f7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051936512:42@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851887.945760:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851887.945761:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:8.0:1773851887.945761:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851887.945761:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851887.945762:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.945762:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851887.945763:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851887.945763:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851887.945764:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000706fe3df.
02000000:00000010:8.0:1773851887.945765:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008f1b9b08.
02000000:00000001:9.0:1773851887.945766:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.945766:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851887.945767:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:9.0:1773851887.945768:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000400:00000200:8.0:1773851887.945769:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:9.0:1773851887.945770:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000049d02807.
00000400:00000010:8.0:1773851887.945770:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000200:9.0:1773851887.945771:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936448, portal 4
00000400:00000010:8.0:1773851887.945771:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006188a4b8.
00000100:00000001:9.0:1773851887.945772:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851887.945773:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087767936 : -106944621783680 : ffff9ebc03ced580)
00000100:00000200:8.0:1773851887.945773:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936512, portal 4
00000100:00000001:8.0:1773851887.945774:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851887.945774:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446609920 : -106937262941696 : ffff9ebdba6dda00)
00000100:00000040:9.0:1773851887.945775:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851887.945777:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851887.945779:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851887.945780:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:9.0:1773851887.945781:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007ae4cb00.
00000100:00000001:8.0:1773851887.945781:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:9.0:1773851887.945782:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936448, offset 0
00000100:00000040:8.0:1773851887.945782:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:8.0:1773851887.945783:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4057092.
00000400:00000200:9.0:1773851887.945784:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:9.0:1773851887.945786:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000200:8.0:1773851887.945786:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936512, offset 0
00000400:00000200:9.0:1773851887.945788:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:8.0:1773851887.945788:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:9.0:1773851887.945789:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851887.945791:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851887.945792:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000400:00000200:9.0:1773851887.945795:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769898, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769895, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851887.945799:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851887.945800:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851887.945802:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000400:00000200:9.0:1773851887.945803:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769899:8769899:1024:4294967295] 12@kfi7 LPNI seq info [5403461:5403461:16:4294967295]
00000400:00000200:9.0:1773851887.945806:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851887.945807:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.945810:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851887.945812:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:9.0:1773851887.945814:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:8.0:1773851887.945814:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851887.945815:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000800:00000200:9.0:1773851887.945816:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:8.0:1773851887.945817:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:8.0:1773851887.945819:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000800:00000200:9.0:1773851887.945820:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:8.0:1773851887.945821:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:8.0:1773851887.945823:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769898, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769899, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851887.945824:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Using peer 12@kfi7(0x200000000000473)
00000400:00000200:8.0:1773851887.945827:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:9.0:1773851887.945828:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x200000000000473: rc=0
00000400:00000200:8.0:1773851887.945828:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:9.0:1773851887.945830:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:8.0:1773851887.945830:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:8.0:1773851887.945831:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769900:8769900:1024:4294967295] 42@kfi7 LPNI seq info [5404902:5404902:16:4294967295]
00000100:00000001:9.0:1773851887.945834:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.945834:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:8.0:1773851887.945834:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:8.0:1773851887.945835:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000001:9.0:1773851887.945836:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.945837:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.945838:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.945840:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851887.945841:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:8.0:1773851887.945841:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000100:00000001:9.0:1773851887.945842:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851887.945843:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:8.0:1773851887.945843:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000100:00000001:9.0:1773851887.945844:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.945845:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851887.945851:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_EVENT_TX_OK event status 0
00000800:00000200:8.0:1773851887.945851:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:10.0:1773851887.945852:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851887.945853:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000800:00000200:8.0:1773851887.945853:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851887.945854:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007ae4cb00
00000400:00000010:10.0:1773851887.945854:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007ae4cb00.
00000100:00000001:10.0:1773851887.945856:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851887.945857:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851887.945857:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:10.0:1773851887.945859:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851887.945860:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851887.945861:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000100:00000001:10.0:1773851887.945862:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.945863:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851887.945864:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:10.0:1773851887.945865:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Transaction freed
00000800:00000200:8.0:1773851887.945866:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x17b: rc=0
00000800:00000200:8.0:1773851887.945868:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851887.945871:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.945872:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851887.945873:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.945876:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.945877:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.945879:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851887.945879:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851887.945881:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851887.945881:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:10.0:1773851887.945887:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851887.945888:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851887.945888:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851887.945889:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851887.945890:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:10.0:1773851887.945890:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4057092
00000800:00000200:9.0:1773851887.945890:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:8.0:1773851887.945890:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851887.945891:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4057092.
00000100:00000001:10.0:1773851887.945891:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851887.945892:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851887.945892:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851887.945894:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851887.945895:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851887.945895:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:10.0:1773851887.945897:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851887.945898:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851887.945898:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851887.945898:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:10.0:1773851887.945900:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000400:00000200:9.0:1773851887.945900:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:9.0:1773851887.945902:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.945903:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851887.945904:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.945905:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851887.945907:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851887.945908:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.945909:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b56c0
00000400:00000200:9.0:1773851887.945911:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851887.945913:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781698749 [1] + 224
00000800:00000200:25.0:1773851887.945915:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:9.0:1773851887.945916:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851887.945917:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851887.945918:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851887.945918:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851887.945920:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851887.945920:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851887.945922:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851887.945923:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000200:9.0:1773851887.945923:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851887.945924:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851887.945925:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851887.945926:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851887.945927:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851887.945927:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:25.0:1773851887.945928:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000100:00000040:9.0:1773851887.945928:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851887.945930:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851887.945931:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5700
00000400:00000200:25.0:1773851887.945932:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851887.945934:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b82cf9 [1] + 224
00000100:00000001:9.0:1773851887.945934:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851887.945935:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:25.0:1773851887.945936:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851887.945938:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851887.945938:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:25.0:1773851887.945939:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851887.945941:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851887.945942:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851887.945942:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851887.945943:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:25.0:1773851887.945944:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:9.0:1773851887.945944:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851887.945945:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851887.945946:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000400:00000200:9.0:1773851887.945947:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000049d02807
00000100:00000001:25.0:1773851887.945948:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:9.0:1773851887.945948:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000049d02807.
00000400:00000200:25.0:1773851887.945949:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:9.0:1773851887.945949:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:25.0:1773851887.945950:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000200:9.0:1773851887.945950:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851887.945951:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851887.945952:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:8.0:1773851887.945953:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851887.945953:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:9.0:1773851887.945955:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:8.0:1773851887.945955:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:8.0:1773851887.945956:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006188a4b8
00000400:00000010:8.0:1773851887.945956:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006188a4b8.
00000100:00000001:8.0:1773851887.945958:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:9.0:1773851887.945959:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:8.0:1773851887.945959:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851887.945960:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.945961:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851887.945962:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851887.945963:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851887.945963:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851887.945964:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851887.945965:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851887.945966:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=120 v=66 (66 66 66 66)
00000100:00001000:9.0:1773851887.945968:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=120 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851887.945968:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851887.945969:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.945970:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851887.945970:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851887.945970:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851887.945971:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.945971:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:9.0:1773851887.945972:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851887.945972:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851887.945973:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851887.945973:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851887.945974:0:41069:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=120 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851887.945975:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851887.945975:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:9.0:1773851887.945976:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:8.0:1773851887.945976:0:41069:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=120 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851887.945977:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.945978:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:9.0:1773851887.945979:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851887.945979:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851887.945980:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851887.945980:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.945982:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851887.945982:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000001:9.0:1773851887.945983:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851887.945983:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851887.945984:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851887.945984:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851887.945985:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851887.945987:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851887.945988:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851887.945989:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851887.945991:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541508096 avail=351539410944 avail_mb=1373200824 hwm_mb=3131101 files=372136587 ffree=343302254 state=0: rc = 0
00000004:00000020:9.0:1773851887.945994:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541508096 free, 351539410944 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136587 files, 343302254 free files
00000004:00000001:9.0:1773851887.945997:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851887.945998:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851887.946001:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00100000:9.0:1773851887.946003:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c0304258 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051936448:12@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851887.946003:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851887.946003:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851887.946004:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851887.946005:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:8.0:1773851887.946005:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851887.946006:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:8.0:1773851887.946006:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351378981888 avail=351376022528 avail_mb=1372562588 hwm_mb=3131103 files=372018989 ffree=343143537 state=0: rc = 0
00000100:00000040:9.0:1773851887.946007:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c0304258 x1859433051936448/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:8.0:1773851887.946010:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351378981888 free, 351376022528 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372018989 files, 343143537 free files
00000100:00000001:9.0:1773851887.946012:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851887.946012:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:8.0:1773851887.946012:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851887.946013:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000706fe3df.
00000100:00000040:8.0:1773851887.946014:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:9.0:1773851887.946015:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851887.946015:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851887.946016:0:41068:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:9.0:1773851887.946017:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851887.946018:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000060c86190.
02000000:00000001:9.0:1773851887.946019:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00100000:8.0:1773851887.946019:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a9a6f7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051936512:42@kfi7:13:default-yuba2-0
02000000:00000001:9.0:1773851887.946021:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851887.946021:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c0304258.
00000100:00000001:8.0:1773851887.946022:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851887.946023:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851887.946023:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.946023:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851887.946024:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:8.0:1773851887.946024:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002a9a6f7d x1859433051936512/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852040 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851887.946026:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851887.946026:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851887.946027:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851887.946028:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.946028:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851887.946029:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851887.946030:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008f1b9b08.
02000000:00000001:8.0:1773851887.946031:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851887.946032:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851887.946033:0:41069:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:8.0:1773851887.946034:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851887.946034:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001b3f89b7.
02000000:00000001:8.0:1773851887.946036:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851887.946037:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851887.946037:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a9a6f7d.
00000100:00000001:8.0:1773851887.946039:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851887.946039:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.946040:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851887.946041:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851887.946043:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851887.946044:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851887.946044:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851887.971293:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851887.971294:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851887.971295:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851887.971297:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851887.971299:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12577@kfi7 to cpt 6
00000400:00000200:25.0:1773851887.971300:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12577@kfi7 : PUT - for me
00000400:00000200:25.0:1773851887.971301:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12577@kfi7 to cpt 6
00000400:00000200:25.0:1773851887.971302:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a7fc60c nid 12577@kfi7 refs 1
00000400:00000200:25.0:1773851887.971302:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12577@kfi7 to cpt 6
00000400:00000200:25.0:1773851887.971303:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a7fc60c nid 12577@kfi7 refs 2
00000400:00000200:25.0:1773851887.971304:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001a7fc60c nid 12577@kfi7 refs 3
00000400:00000200:25.0:1773851887.971305:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12768@kfi7 to cpt 5
00000400:00000200:25.0:1773851887.971306:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12768@kfi7 of length 224 into portal 12 MB=0x699e0ef5df5c0
00000400:00000200:25.0:1773851887.971307:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12768@kfi7 of length 224/224 into md 0x16159c9699 [64] + 30856
00000800:00000200:25.0:1773851887.971309:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851887.971311:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851887.971312:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12577@kfi7: PUT: OK
00000100:00000001:25.0:1773851887.971313:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851887.971313:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851887.971314:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a4cdf1f4.
00000100:00000040:25.0:1773851887.971315:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000a4cdf1f4 x1858041227900352 msgsize 224
00000100:00100000:25.0:1773851887.971316:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12768@kfi7 (source: 12345-12577@kfi7)
00000100:00000001:25.0:1773851887.971317:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851887.971318:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001a7fc60c nid 12577@kfi7 refs 2
00000100:00000001:26.0:1773851887.971319:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851887.971319:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851887.971319:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851887.971320:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851887.971320:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851887.971321:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851887.971322:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041227900352
00000020:00000001:26.0:1773851887.971323:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851887.971324:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926b2
00000020:00000001:26.0:1773851887.971324:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851887.971325:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f4021564 refcount=6
00000020:00000001:26.0:1773851887.971326:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631276544 : -107123078275072 : ffff9e9276f8e000)
00000020:00000001:26.0:1773851887.971327:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631276544 : -107123078275072 : ffff9e9276f8e000)
00000100:00000001:26.0:1773851887.971328:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851887.971328:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851887.971329:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd5c6346.
00000020:00000010:26.0:1773851887.971330:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851887.971331:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000001:26.0:1773851887.971332:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851887.971333:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851887.971333:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851887.971334:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851887.971335:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851887.971335:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851887.971336:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851887.971337:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851887.971338:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851887.971338:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851887.971338:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851887.971339:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12768@kfi7, seq: 2025157
00000100:00000001:27.0:1773851887.971340:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851887.971340:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f4021564 : new rpc_count 1
00000100:00000001:27.0:1773851887.971341:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851887.971341:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252448896 : -106967457102720 : ffff9eb6b2b78480)
00000100:00000040:26.0:1773851887.971342:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a4cdf1f4 x1858041227900352/t0(0) o400->80a3cfeb-04e1-466a-96e8-c730c5fc47d8@12768@kfi7:137/0 lens 224/0 e 0 to 0 dl 1773852252 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1279-0'
00000100:00000001:26.0:1773851887.971344:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851887.971345:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851887.971346:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a4cdf1f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:80a3cfeb-04e1-466a-96e8-c730c5fc47d8+6:39859:x1858041227900352:12345-12768@kfi7:400:default-tuolumne1279-0
00000100:00000200:26.0:1773851887.971347:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041227900352
00000020:00000001:26.0:1773851887.971348:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851887.971349:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851887.971349:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851887.971350:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851887.971351:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851887.971352:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851887.971353:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041227900352, found 0 last_xid 1858041227900351
00000020:00000001:26.0:1773851887.971353:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851887.971354:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851887.971355:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851887.971355:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851887.971356:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851887.971356:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851887.971357:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851887.971358:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000087bd9fcb.
02000000:00000001:26.0:1773851887.971358:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851887.971359:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851887.971360:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851887.971360:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695531, transno 0, xid 1858041227900352
00010000:00000001:26.0:1773851887.971361:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851887.971362:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a4cdf1f4 x1858041227900352/t0(0) o400->80a3cfeb-04e1-466a-96e8-c730c5fc47d8@12768@kfi7:137/0 lens 224/224 e 0 to 0 dl 1773852252 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1279-0'
00010000:00000001:26.0:1773851887.971364:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851887.971365:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851887.971366:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=120 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851887.971367:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851887.971368:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dcf66f99 refcount 3 to 12768@kfi7
00000100:00000001:26.0:1773851887.971368:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108224 : -107156354443392 : ffff9e8ab78ed780)
02000000:00000001:26.0:1773851887.971369:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851887.971370:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851887.971370:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851887.971371:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12577@kfi7
00000400:00000010:26.0:1773851887.971372:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009b6134f.
00000100:00000200:26.0:1773851887.971373:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041227900352, offset 224
00000400:00000200:26.0:1773851887.971374:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12577@kfi7
00000400:00000200:26.0:1773851887.971375:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12577@kfi7 to cpt 6
00000400:00000200:26.0:1773851887.971376:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001a7fc60c nid 12577@kfi7 refs 1
00000400:00000200:26.0:1773851887.971377:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001a7fc60c nid 12577@kfi7 refs 2
00000400:00000200:26.0:1773851887.971380:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001a7fc60c nid 12577@kfi7 refs 3
00000400:00000200:26.0:1773851887.971381:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12577@kfi7 local destination
00000400:00000200:26.0:1773851887.971382:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769901:8769901:1024:4294967295] 12577@kfi7 LPNI seq info [9388899:9388899:16:4294967295]
00000400:00000200:26.0:1773851887.971384:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001a7fc60c nid 12577@kfi7 refs 2
00000400:00000200:26.0:1773851887.971384:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12577@kfi7 to cpt 6
00000400:00000200:26.0:1773851887.971387:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12577@kfi7(12577@kfi7:12577@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851887.971388:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001a7fc60c nid 12577@kfi7 refs 3
00000800:00000200:26.0:1773851887.971389:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851887.971390:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851887.971392:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851887.971394:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x940 Using peer 12577@kfi7(0x940)
00000800:00000200:26.0:1773851887.971397:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 324 bytes to peer 0x940: rc=0
00000800:00000200:26.0:1773851887.971398:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x940 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851887.971400:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851887.971401:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dcf66f99 refcount 2 to 12768@kfi7
00010000:00000001:26.0:1773851887.971402:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851887.971402:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851887.971403:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851887.971403:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a4cdf1f4 x1858041227900352/t0(0) o400->80a3cfeb-04e1-466a-96e8-c730c5fc47d8@12768@kfi7:137/0 lens 224/224 e 0 to 0 dl 1773852252 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1279-0'
00000100:00100000:26.0:1773851887.971407:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a4cdf1f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:80a3cfeb-04e1-466a-96e8-c730c5fc47d8+6:39859:x1858041227900352:12345-12768@kfi7:400:default-tuolumne1279-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851887.971409:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12768@kfi7, seq: 2025157
00000800:00000200:25.0:1773851887.971409:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x940 TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851887.971410:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f4021564 : new rpc_count 0
00000100:00000001:26.0:1773851887.971410:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851887.971411:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851887.971412:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851887.971412:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851887.971412:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12577@kfi7: PUT: OK
00000020:00000010:26.0:1773851887.971413:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000400:00000200:25.0:1773851887.971413:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009b6134f
00000400:00000010:25.0:1773851887.971413:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009b6134f.
00000020:00000010:26.0:1773851887.971414:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd5c6346.
00000100:00000001:25.0:1773851887.971414:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:26.0:1773851887.971415:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000f4021564 : new refcount 5
00000100:00000001:26.0:1773851887.971415:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851887.971415:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851887.971416:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001a7fc60c nid 12577@kfi7 refs 2
00000800:00000200:25.0:1773851887.971417:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 12577@kfi7(000000000467404f):0x0 lsk 2369 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x940 Transaction freed
00000800:00000200:29.0:1773851887.989305:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851887.989306:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851887.989307:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851887.989309:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851887.989312:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13939@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.989313:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13939@kfi7 : PUT - for me
00000400:00000200:29.0:1773851887.989314:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13939@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.989315:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000565e2817 nid 13939@kfi7 refs 1
00000400:00000200:29.0:1773851887.989317:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13939@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.989318:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000565e2817 nid 13939@kfi7 refs 2
00000400:00000200:29.0:1773851887.989319:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000565e2817 nid 13939@kfi7 refs 3
00000400:00000200:29.0:1773851887.989320:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14003@kfi7 to cpt 3
00000400:00000200:29.0:1773851887.989320:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14003@kfi7 of length 224 into portal 12 MB=0x699e10e0259c0
00000400:00000200:29.0:1773851887.989322:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14003@kfi7 of length 224/224 into md 0x77fe1859d [64] + 224
00000800:00000200:29.0:1773851887.989323:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851887.989325:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851887.989326:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13939@kfi7: PUT: OK
00000100:00000001:29.0:1773851887.989327:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851887.989328:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851887.989329:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066f616b8.
00000100:00000040:29.0:1773851887.989329:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000066f616b8 x1858041741990336 msgsize 224
00000100:00100000:29.0:1773851887.989331:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-14003@kfi7 (source: 12345-13939@kfi7)
00000100:00000001:29.0:1773851887.989332:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851887.989333:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000565e2817 nid 13939@kfi7 refs 2
00000800:00000200:29.0:1773851887.989335:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851887.989337:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851887.989338:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851887.989339:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851887.989339:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851887.989340:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851887.989340:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041741990336
00000020:00000001:29.0:1773851887.989341:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851887.989342:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b2f
00000020:00000001:29.0:1773851887.989342:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851887.989346:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dc7b3a67 refcount=6
00000020:00000001:29.0:1773851887.989347:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628035584 : -107123081516032 : ffff9e9276c76c00)
00000020:00000001:29.0:1773851887.989347:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628035584 : -107123081516032 : ffff9e9276c76c00)
00000100:00000001:29.0:1773851887.989348:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851887.989349:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851887.989350:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d23aa690.
00000020:00000010:29.0:1773851887.989351:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851887.989351:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851887.989352:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851887.989353:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:29.0:1773851887.989353:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851887.989354:0:60533:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:29.0:1773851887.989355:0:60533:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:29.0:1773851887.989355:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.989356:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851887.989357:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851887.989357:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851887.989358:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:29.0:1773851887.989358:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851887.989359:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14003@kfi7, seq: 2055574
00000100:00000040:29.0:1773851887.989359:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dc7b3a67 : new rpc_count 1
00000100:00000001:30.0:1773851887.989360:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851887.989360:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.989360:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262242048 : -106943447309568 : ffff9ebc49cfe300)
00000100:00000040:29.0:1773851887.989361:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066f616b8 x1858041741990336/t0(0) o400->86902d32-060c-4700-906c-f3faf9c31602@14003@kfi7:675/0 lens 224/0 e 0 to 0 dl 1773852035 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1354-0'
00000100:00000001:29.0:1773851887.989364:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851887.989364:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851887.989365:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066f616b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:86902d32-060c-4700-906c-f3faf9c31602+6:39698:x1858041741990336:12345-14003@kfi7:400:default-tuolumne1354-0
00000100:00000200:29.0:1773851887.989367:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041741990336
00000020:00000001:29.0:1773851887.989367:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851887.989368:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851887.989368:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.989369:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851887.989369:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:29.0:1773851887.989370:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851887.989372:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041741990336, found 0 last_xid 1858041741990335
00000020:00000001:29.0:1773851887.989372:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851887.989373:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851887.989373:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851887.989374:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.989374:0:60533:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:29.0:1773851887.989375:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851887.989376:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851887.989376:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000620d152c.
02000000:00000001:29.0:1773851887.989377:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.989377:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.989378:0:60533:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:29.0:1773851887.989379:0:60533:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597928, transno 0, xid 1858041741990336
00010000:00000001:29.0:1773851887.989379:0:60533:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:29.0:1773851887.989380:0:60533:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066f616b8 x1858041741990336/t0(0) o400->86902d32-060c-4700-906c-f3faf9c31602@14003@kfi7:675/0 lens 224/224 e 0 to 0 dl 1773852035 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1354-0'
00010000:00000001:29.0:1773851887.989382:0:60533:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:29.0:1773851887.989383:0:60533:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851887.989384:0:60533:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=120 v=115 (1 1 1 115)
00000100:00000001:29.0:1773851887.989384:0:60533:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:29.0:1773851887.989385:0:60533:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002641ed42 refcount 3 to 14003@kfi7
00000100:00000001:29.0:1773851887.989386:0:60533:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155488 : -107139310396128 : ffff9e8eaf765d20)
02000000:00000001:29.0:1773851887.989387:0:60533:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:29.0:1773851887.989387:0:60533:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851887.989388:0:60533:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851887.989388:0:60533:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13939@kfi7
00000400:00000010:29.0:1773851887.989389:0:60533:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052b8dd85.
00000100:00000200:29.0:1773851887.989390:0:60533:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041741990336, offset 224
00000400:00000200:29.0:1773851887.989391:0:60533:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13939@kfi7
00000400:00000200:29.0:1773851887.989391:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13939@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.989392:0:60533:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000565e2817 nid 13939@kfi7 refs 1
00000400:00000200:29.0:1773851887.989393:0:60533:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000565e2817 nid 13939@kfi7 refs 2
00000400:00000200:29.0:1773851887.989394:0:60533:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000565e2817 nid 13939@kfi7 refs 3
00000400:00000200:29.0:1773851887.989395:0:60533:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13939@kfi7 local destination
00000400:00000200:29.0:1773851887.989398:0:60533:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769902:8769902:1024:4294967295] 13939@kfi7 LPNI seq info [4991592:4991592:16:4294967295]
00000400:00000200:29.0:1773851887.989399:0:60533:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000565e2817 nid 13939@kfi7 refs 2
00000400:00000200:29.0:1773851887.989400:0:60533:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13939@kfi7 to cpt 7
00000400:00000200:29.0:1773851887.989402:0:60533:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13939@kfi7(13939@kfi7:13939@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851887.989403:0:60533:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000565e2817 nid 13939@kfi7 refs 3
00000800:00000200:29.0:1773851887.989405:0:60533:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851887.989406:0:60533:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851887.989408:0:60533:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:29.0:1773851887.989410:0:60533:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000acc Using peer 13939@kfi7(0x100000000000acc)
00000800:00000200:29.0:1773851887.989413:0:60533:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 324 bytes to peer 0x100000000000acc: rc=0
00000800:00000200:29.0:1773851887.989415:0:60533:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000acc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851887.989417:0:60533:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851887.989417:0:60533:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002641ed42 refcount 2 to 14003@kfi7
00010000:00000001:29.0:1773851887.989418:0:60533:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:29.0:1773851887.989419:0:60533:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851887.989419:0:60533:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:29.0:1773851887.989420:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066f616b8 x1858041741990336/t0(0) o400->86902d32-060c-4700-906c-f3faf9c31602@14003@kfi7:675/0 lens 224/224 e 0 to 0 dl 1773852035 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1354-0'
00000100:00100000:29.0:1773851887.989423:0:60533:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066f616b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:86902d32-060c-4700-906c-f3faf9c31602+6:39698:x1858041741990336:12345-14003@kfi7:400:default-tuolumne1354-0 Request processed in 58us (93us total) trans 0 rc 0/0
00000100:00100000:29.0:1773851887.989425:0:60533:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14003@kfi7, seq: 2055574
00000100:00000040:29.0:1773851887.989425:0:60533:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dc7b3a67 : new rpc_count 0
00000100:00000001:29.0:1773851887.989426:0:60533:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851887.989427:0:60533:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:29.0:1773851887.989427:0:60533:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b56bd111.
00000800:00000200:30.0:1773851887.989428:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000acc TN_EVENT_TX_OK event status 0
00000020:00000010:29.0:1773851887.989428:0:60533:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000009c6a3c4.
00000020:00000010:29.0:1773851887.989429:0:60533:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d23aa690.
00000020:00000040:29.0:1773851887.989429:0:60533:0:(genops.c:882:class_export_put()) PUTting export 00000000dc7b3a67 : new refcount 5
00000400:00000200:30.0:1773851887.989430:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851887.989430:0:60533:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851887.989431:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13939@kfi7: PUT: OK
00000400:00000200:30.0:1773851887.989432:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052b8dd85
00000400:00000010:30.0:1773851887.989432:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052b8dd85.
00000100:00000001:30.0:1773851887.989433:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851887.989433:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851887.989434:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000565e2817 nid 13939@kfi7 refs 2
00000800:00000200:30.0:1773851887.989436:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b83ff6e: 2054@kfi7:7 -> 13939@kfi7(00000000caf0cac7):0x0 lsk 2765 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000acc Transaction freed
00000800:00000200:17.0:1773851888.015261:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851888.015262:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851888.015264:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851888.015268:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851888.015271:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19072@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.015273:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19072@kfi7 : PUT - for me
00000400:00000200:17.0:1773851888.015275:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19072@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.015277:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ad927ac nid 19072@kfi7 refs 1
00000400:00000200:17.0:1773851888.015278:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19072@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.015279:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ad927ac nid 19072@kfi7 refs 2
00000400:00000200:17.0:1773851888.015281:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007ad927ac nid 19072@kfi7 refs 3
00000400:00000200:17.0:1773851888.015282:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19009@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.015284:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19009@kfi7 of length 224 into portal 12 MB=0x69b4bb6662480
00000400:00000200:17.0:1773851888.015286:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19009@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 37808
00000800:00000200:17.0:1773851888.015290:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851888.015293:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851888.015295:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19072@kfi7: PUT: OK
00000100:00000001:17.0:1773851888.015296:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851888.015297:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851888.015298:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e5ffe9b6.
00000100:00000040:17.0:1773851888.015299:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000e5ffe9b6 x1859599345263744 msgsize 224
00000100:00100000:17.0:1773851888.015302:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19009@kfi7 (source: 12345-19072@kfi7)
00000100:00000001:17.0:1773851888.015305:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851888.015307:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007ad927ac nid 19072@kfi7 refs 2
00000800:00000200:17.0:1773851888.015309:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851888.015313:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851888.015314:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851888.015315:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851888.015316:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851888.015317:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851888.015318:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599345263744
00000020:00000001:17.0:1773851888.015319:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851888.015320:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82f11
00000020:00000001:17.0:1773851888.015321:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851888.015325:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b8a5275 refcount=5
00000020:00000001:17.0:1773851888.015326:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143370938368 : -106930338613248 : ffff9ebf5726b800)
00000020:00000001:17.0:1773851888.015327:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143370938368 : -106930338613248 : ffff9ebf5726b800)
00000100:00000001:17.0:1773851888.015329:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851888.015330:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851888.015331:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851888.015332:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851888.015333:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851888.015335:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851888.015335:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851888.015336:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851888.015338:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851888.015339:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851888.015339:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.015341:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851888.015343:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851888.015343:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851888.015344:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851888.015344:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851888.015345:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19009@kfi7, seq: 2156401
00000100:00000040:17.0:1773851888.015347:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b8a5275 : new rpc_count 1
00000100:00000001:16.0:1773851888.015347:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.015348:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102203904 : -107041607347712 : ffff9ea56f049200)
00000100:00000001:16.0:1773851888.015348:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851888.015350:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e5ffe9b6 x1859599345263744/t0(0) o400->2e62b8cc-176d-448f-962f-e71b84938299@19009@kfi7:140/0 lens 224/0 e 0 to 0 dl 1773852255 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1684-0'
00000100:00000001:17.0:1773851888.015355:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851888.015356:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851888.015357:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e5ffe9b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e62b8cc-176d-448f-962f-e71b84938299+5:39748:x1859599345263744:12345-19009@kfi7:400:default-tuolumne1684-0
00000100:00000200:17.0:1773851888.015359:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599345263744
00000020:00000001:17.0:1773851888.015360:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851888.015361:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851888.015362:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.015363:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851888.015364:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851888.015365:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851888.015366:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599345263744, found 0 last_xid 1859599345263743
00000020:00000001:17.0:1773851888.015367:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851888.015369:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851888.015369:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851888.015370:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.015371:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851888.015372:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851888.015373:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851888.015374:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000570880ef.
02000000:00000001:17.0:1773851888.015375:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.015376:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.015377:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851888.015378:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182726223333, transno 0, xid 1859599345263744
00010000:00000001:17.0:1773851888.015379:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851888.015380:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e5ffe9b6 x1859599345263744/t0(0) o400->2e62b8cc-176d-448f-962f-e71b84938299@19009@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1684-0'
00010000:00000001:17.0:1773851888.015385:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851888.015385:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851888.015387:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=121 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851888.015388:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851888.015390:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000431ad6f1 refcount 3 to 19009@kfi7
00000100:00000001:17.0:1773851888.015391:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095776128 : -107152613775488 : ffff9e8b9684e780)
02000000:00000001:17.0:1773851888.015393:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851888.015393:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.015394:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851888.015396:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19072@kfi7
00000400:00000010:17.0:1773851888.015397:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081e4cca7.
00000100:00000200:17.0:1773851888.015398:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599345263744, offset 224
00000400:00000200:17.0:1773851888.015400:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19072@kfi7
00000400:00000200:17.0:1773851888.015401:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19072@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.015403:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ad927ac nid 19072@kfi7 refs 1
00000400:00000200:17.0:1773851888.015404:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007ad927ac nid 19072@kfi7 refs 2
00000400:00000200:17.0:1773851888.015406:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007ad927ac nid 19072@kfi7 refs 3
00000400:00000200:17.0:1773851888.015408:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19072@kfi7 local destination
00000400:00000200:17.0:1773851888.015410:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769903:8769903:1024:4294967295] 19072@kfi7 LPNI seq info [5471425:5471425:16:4294967295]
00000400:00000200:17.0:1773851888.015412:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007ad927ac nid 19072@kfi7 refs 2
00000400:00000200:17.0:1773851888.015413:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19072@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.015417:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19072@kfi7(19072@kfi7:19072@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851888.015419:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007ad927ac nid 19072@kfi7 refs 3
00000800:00000200:17.0:1773851888.015421:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851888.015422:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851888.015426:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851888.015430:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b8 Using peer 19072@kfi7(0x1000000000007b8)
00000800:00000200:17.0:1773851888.015434:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x1000000000007b8: rc=0
00000800:00000200:17.0:1773851888.015437:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851888.015440:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851888.015441:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000431ad6f1 refcount 2 to 19009@kfi7
00010000:00000001:17.0:1773851888.015442:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851888.015444:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.015445:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851888.015446:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e5ffe9b6 x1859599345263744/t0(0) o400->2e62b8cc-176d-448f-962f-e71b84938299@19009@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1684-0'
00000800:00000200:19.0:1773851888.015451:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b8 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851888.015451:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e5ffe9b6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e62b8cc-176d-448f-962f-e71b84938299+5:39748:x1859599345263744:12345-19009@kfi7:400:default-tuolumne1684-0 Request processed in 95us (151us total) trans 0 rc 0/0
00000400:00000200:19.0:1773851888.015452:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851888.015453:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19072@kfi7: PUT: OK
00000400:00000200:19.0:1773851888.015454:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081e4cca7
00000400:00000010:19.0:1773851888.015454:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081e4cca7.
00000100:00000001:19.0:1773851888.015455:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851888.015455:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:17.0:1773851888.015455:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19009@kfi7, seq: 2156401
00000400:00000200:19.0:1773851888.015456:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007ad927ac nid 19072@kfi7 refs 2
00000100:00000040:17.0:1773851888.015456:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b8a5275 : new rpc_count 0
00000800:00000200:19.0:1773851888.015457:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 19072@kfi7(00000000e006ead7):0x0 lsk 1977 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b8 Transaction freed
00000100:00000001:17.0:1773851888.015458:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851888.015459:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851888.015460:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851888.015461:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000020:00000010:17.0:1773851888.015462:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000020:00000040:17.0:1773851888.015463:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000004b8a5275 : new refcount 4
00000100:00000001:17.0:1773851888.015465:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851888.065931:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.065932:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851888.065933:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851888.065936:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851888.065938:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15872@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.065939:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15872@kfi7 : PUT - for me
00000400:00000200:9.0:1773851888.065941:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15872@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.065942:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048bd3142 nid 15872@kfi7 refs 1
00000400:00000200:9.0:1773851888.065943:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15872@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.065944:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048bd3142 nid 15872@kfi7 refs 2
00000400:00000200:9.0:1773851888.065945:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000048bd3142 nid 15872@kfi7 refs 3
00000400:00000200:9.0:1773851888.065946:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15873@kfi7 to cpt 5
00000400:00000200:9.0:1773851888.065947:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15873@kfi7 of length 224 into portal 12 MB=0x69b4b5ee94b80
00000400:00000200:9.0:1773851888.065949:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15873@kfi7 of length 224/224 into md 0x78146ce49 [64] + 152504
00000800:00000200:9.0:1773851888.065951:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851888.065953:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.065954:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15872@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.065955:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851888.065955:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851888.065956:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a51f295.
00000100:00000040:9.0:1773851888.065957:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000002a51f295 x1859597877463936 msgsize 224
00000100:00100000:9.0:1773851888.065959:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-15873@kfi7 (source: 12345-15872@kfi7)
00000100:00000001:9.0:1773851888.065960:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851888.065961:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000048bd3142 nid 15872@kfi7 refs 2
00000800:00000200:9.0:1773851888.065963:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851888.065966:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851888.065967:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851888.065967:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851888.065968:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851888.065969:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851888.065970:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597877463936
00000020:00000001:9.0:1773851888.065971:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851888.065971:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e246a153c
00000020:00000001:9.0:1773851888.065972:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851888.065975:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000759ed1d4 refcount=626
00000020:00000001:9.0:1773851888.065976:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637140170479616 : -106933539072000 : ffff9ebe98639800)
00000020:00000001:9.0:1773851888.065977:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637140170479616 : -106933539072000 : ffff9ebe98639800)
00000100:00000001:9.0:1773851888.065978:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851888.065979:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851888.065980:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aae1527.
00000020:00000010:9.0:1773851888.065981:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851888.065982:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f2d33498.
00000100:00000001:9.0:1773851888.065983:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851888.065984:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851888.065985:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.065986:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851888.065986:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851888.065987:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.065988:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.065989:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851888.065990:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851888.065990:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851888.065990:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851888.065991:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15873@kfi7, seq: 2130836
00000100:00000040:9.0:1773851888.065992:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000759ed1d4 : new rpc_count 15
00000100:00000001:8.0:1773851888.065992:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.065993:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856892288 : -106914852659328 : ffff9ec2f22f9f80)
00000100:00000001:8.0:1773851888.065993:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851888.065994:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002a51f295 x1859597877463936/t0(0) o400->122166f5-6483-4cb3-a21b-391a806cb4c1@15873@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1491-0'
00000100:00000001:9.0:1773851888.065997:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851888.065998:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851888.065999:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a51f295 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:122166f5-6483-4cb3-a21b-391a806cb4c1+626:39523:x1859597877463936:12345-15873@kfi7:400:default-tuolumne1491-0
00000100:00000200:9.0:1773851888.066000:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597877463936
00000020:00000001:9.0:1773851888.066001:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851888.066002:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851888.066003:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.066004:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851888.066005:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851888.066006:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851888.066006:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597877463936, found 0 last_xid 1859597871454655
00000020:00000001:9.0:1773851888.066007:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851888.066008:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851888.066009:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851888.066009:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.066010:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851888.066011:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851888.066011:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851888.066013:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000007af79d4.
02000000:00000001:9.0:1773851888.066013:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.066014:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.066015:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851888.066016:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578054, transno 0, xid 1859597877463936
00010000:00000001:9.0:1773851888.066017:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851888.066018:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002a51f295 x1859597877463936/t0(0) o400->122166f5-6483-4cb3-a21b-391a806cb4c1@15873@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1491-0'
00010000:00000001:9.0:1773851888.066020:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851888.066021:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851888.066022:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=121 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851888.066023:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851888.066024:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000076456127 refcount 3 to 15873@kfi7
00000100:00000001:9.0:1773851888.066025:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451712 : -107146752099904 : ffff9e8cf3e6f9c0)
02000000:00000001:9.0:1773851888.066026:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851888.066027:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.066027:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851888.066028:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15872@kfi7
00000400:00000010:9.0:1773851888.066029:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000049d02807.
00000100:00000200:9.0:1773851888.066030:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597877463936, offset 224
00000400:00000200:9.0:1773851888.066031:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15872@kfi7
00000400:00000200:9.0:1773851888.066032:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15872@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.066033:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048bd3142 nid 15872@kfi7 refs 1
00000400:00000200:9.0:1773851888.066034:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000048bd3142 nid 15872@kfi7 refs 2
00000400:00000200:9.0:1773851888.066035:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000048bd3142 nid 15872@kfi7 refs 3
00000400:00000200:9.0:1773851888.066037:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15872@kfi7 local destination
00000400:00000200:9.0:1773851888.066038:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769904:8769904:1024:4294967295] 15872@kfi7 LPNI seq info [479669:479669:16:4294967295]
00000400:00000200:9.0:1773851888.066040:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000048bd3142 nid 15872@kfi7 refs 2
00000400:00000200:9.0:1773851888.066041:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15872@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.066043:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15872@kfi7(15872@kfi7:15872@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851888.066044:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000048bd3142 nid 15872@kfi7 refs 3
00000800:00000200:9.0:1773851888.066045:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.066047:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851888.066049:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851888.066051:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2c2 Using peer 15872@kfi7(0x2c2)
00000800:00000200:9.0:1773851888.066055:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x2c2: rc=0
00000800:00000200:9.0:1773851888.066056:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2c2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851888.066059:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851888.066060:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000076456127 refcount 2 to 15873@kfi7
00010000:00000001:9.0:1773851888.066061:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851888.066061:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.066062:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851888.066063:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a51f295 x1859597877463936/t0(0) o400->122166f5-6483-4cb3-a21b-391a806cb4c1@15873@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1491-0'
00000100:00100000:9.0:1773851888.066066:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a51f295 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:122166f5-6483-4cb3-a21b-391a806cb4c1+626:39523:x1859597877463936:12345-15873@kfi7:400:default-tuolumne1491-0 Request processed in 68us (108us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851888.066068:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15873@kfi7, seq: 2130836
00000800:00000200:10.0:1773851888.066070:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2c2 TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851888.066070:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000759ed1d4 : new rpc_count 14
00000100:00000001:9.0:1773851888.066070:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851888.066071:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851888.066072:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851888.066072:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f2d33498.
00000400:00000200:10.0:1773851888.066073:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851888.066073:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aae1527.
00000020:00000040:9.0:1773851888.066074:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000759ed1d4 : new refcount 625
00000400:00000200:10.0:1773851888.066075:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15872@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.066075:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851888.066076:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000049d02807
00000400:00000010:10.0:1773851888.066078:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000049d02807.
00000100:00000001:10.0:1773851888.066079:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851888.066080:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851888.066081:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000048bd3142 nid 15872@kfi7 refs 2
00000800:00000200:10.0:1773851888.066084:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2069@kfi7:2 -> 15872@kfi7(0000000087806def):0x0 lsk 707 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2c2 Transaction freed
00000800:00000200:5.0:1773851888.106805:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851888.106806:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851888.106808:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851888.106811:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851888.106814:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25747@kfi7 to cpt 1
00000400:00000200:5.0:1773851888.106816:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25747@kfi7 : PUT - for me
00000400:00000200:5.0:1773851888.106818:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25747@kfi7 to cpt 1
00000400:00000200:5.0:1773851888.106819:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1281dc1 nid 25747@kfi7 refs 1
00000400:00000200:5.0:1773851888.106820:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25747@kfi7 to cpt 1
00000400:00000200:5.0:1773851888.106822:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1281dc1 nid 25747@kfi7 refs 2
00000400:00000200:5.0:1773851888.106823:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b1281dc1 nid 25747@kfi7 refs 3
00000400:00000200:5.0:1773851888.106824:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25682@kfi7 to cpt 3
00000400:00000200:5.0:1773851888.106826:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25682@kfi7 of length 224 into portal 12 MB=0x69b4c37c4ddc0
00000400:00000200:5.0:1773851888.106828:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25682@kfi7 of length 224/224 into md 0x793926dc5 [64] + 157464
00000800:00000200:5.0:1773851888.106830:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851888.106833:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851888.106834:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25747@kfi7: PUT: OK
00000100:00000001:5.0:1773851888.106836:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851888.106836:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851888.106838:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dbaf8060.
00000100:00000040:5.0:1773851888.106839:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000dbaf8060 x1859601515732416 msgsize 224
00000100:00100000:5.0:1773851888.106841:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25682@kfi7 (source: 12345-25747@kfi7)
00000100:00000001:5.0:1773851888.106843:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851888.106844:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1281dc1 nid 25747@kfi7 refs 2
00000100:00000001:4.0:1773851888.106845:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851888.106846:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851888.106846:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851888.106847:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851888.106848:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851888.106849:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851888.106850:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601515732416
00000020:00000001:4.0:1773851888.106851:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851888.106852:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff87e27
00000020:00000001:4.0:1773851888.106853:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851888.106856:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007c50a768 refcount=5
00000020:00000001:4.0:1773851888.106857:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637124388622336 : -106949320929280 : ffff9ebaebb79000)
00000020:00000001:4.0:1773851888.106858:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637124388622336 : -106949320929280 : ffff9ebaebb79000)
00000100:00000001:4.0:1773851888.106860:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851888.106861:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851888.106862:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851888.106864:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851888.106865:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851888.106866:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851888.106867:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851888.106868:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851888.106869:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851888.106870:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851888.106871:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.106872:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851888.106875:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851888.106875:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851888.106875:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851888.106876:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851888.106877:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25682@kfi7, seq: 2001970
00000100:00000001:7.0:1773851888.106879:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851888.106879:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007c50a768 : new rpc_count 1
00000100:00000001:7.0:1773851888.106880:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.106880:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108935040 : -106938600616576 : ffff9ebd6ab28d80)
00000100:00000040:4.0:1773851888.106882:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dbaf8060 x1859601515732416/t0(0) o400->62a8ae7e-f74f-4370-b482-aaeb7a16216f@25682@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2102-0'
00000100:00000001:4.0:1773851888.106887:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851888.106888:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851888.106890:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbaf8060 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:62a8ae7e-f74f-4370-b482-aaeb7a16216f+5:39738:x1859601515732416:12345-25682@kfi7:400:default-tuolumne2102-0
00000100:00000200:4.0:1773851888.106892:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601515732416
00000020:00000001:4.0:1773851888.106893:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851888.106895:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851888.106896:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851888.106897:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851888.106898:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851888.106900:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851888.106901:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601515732416, found 0 last_xid 1859601515732415
00000020:00000001:4.0:1773851888.106902:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851888.106904:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851888.106904:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851888.106905:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851888.106906:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851888.106907:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851888.106908:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851888.106910:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000026bacc4f.
02000000:00000001:4.0:1773851888.106911:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.106912:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851888.106913:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851888.106914:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154617301, transno 0, xid 1859601515732416
00010000:00000001:4.0:1773851888.106916:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851888.106917:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dbaf8060 x1859601515732416/t0(0) o400->62a8ae7e-f74f-4370-b482-aaeb7a16216f@25682@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2102-0'
00010000:00000001:4.0:1773851888.106922:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851888.106923:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851888.106924:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=120 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851888.106926:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851888.106927:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000020e57d9f refcount 3 to 25682@kfi7
00000100:00000001:4.0:1773851888.106928:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621408 : -107151221930208 : ffff9e8be97ac720)
02000000:00000001:4.0:1773851888.106930:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851888.106931:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.106932:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851888.106933:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25747@kfi7
00000400:00000010:4.0:1773851888.106934:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007d52025f.
00000100:00000200:4.0:1773851888.106936:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601515732416, offset 224
00000400:00000200:4.0:1773851888.106938:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25747@kfi7
00000400:00000200:4.0:1773851888.106940:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25747@kfi7 to cpt 1
00000400:00000200:4.0:1773851888.106941:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b1281dc1 nid 25747@kfi7 refs 1
00000400:00000200:4.0:1773851888.106943:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b1281dc1 nid 25747@kfi7 refs 2
00000400:00000200:4.0:1773851888.106945:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b1281dc1 nid 25747@kfi7 refs 3
00000400:00000200:4.0:1773851888.106950:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25747@kfi7 local destination
00000400:00000200:4.0:1773851888.106952:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769905:8769905:1024:4294967295] 25747@kfi7 LPNI seq info [1098071:1098071:16:4294967295]
00000400:00000200:4.0:1773851888.106955:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b1281dc1 nid 25747@kfi7 refs 2
00000400:00000200:4.0:1773851888.106956:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25747@kfi7 to cpt 1
00000400:00000200:4.0:1773851888.106960:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25747@kfi7(25747@kfi7:25747@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851888.106962:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b1281dc1 nid 25747@kfi7 refs 3
00000800:00000200:4.0:1773851888.106965:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851888.106967:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851888.106970:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851888.106975:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x584 Using peer 25747@kfi7(0x584)
00000800:00000200:4.0:1773851888.106980:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x584: rc=0
00000800:00000200:4.0:1773851888.106982:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x584 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851888.106986:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851888.106987:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000020e57d9f refcount 2 to 25682@kfi7
00010000:00000001:4.0:1773851888.106991:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851888.106992:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851888.106993:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851888.106994:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dbaf8060 x1859601515732416/t0(0) o400->62a8ae7e-f74f-4370-b482-aaeb7a16216f@25682@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2102-0'
00000100:00100000:4.0:1773851888.107000:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbaf8060 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:62a8ae7e-f74f-4370-b482-aaeb7a16216f+5:39738:x1859601515732416:12345-25682@kfi7:400:default-tuolumne2102-0 Request processed in 111us (159us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851888.107004:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25682@kfi7, seq: 2001970
00000100:00000040:4.0:1773851888.107005:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007c50a768 : new rpc_count 0
00000100:00000001:4.0:1773851888.107006:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851888.107007:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851888.107009:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851888.107011:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000020:00000010:4.0:1773851888.107013:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851888.107014:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000007c50a768 : new refcount 4
00000100:00000001:4.0:1773851888.107015:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851888.107024:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x584 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851888.107027:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851888.107028:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25747@kfi7: PUT: OK
00000400:00000200:5.0:1773851888.107029:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007d52025f
00000400:00000010:5.0:1773851888.107030:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007d52025f.
00000100:00000001:5.0:1773851888.107031:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851888.107032:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851888.107033:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b1281dc1 nid 25747@kfi7 refs 2
00000800:00000200:5.0:1773851888.107035:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 25747@kfi7(0000000083c60f89):0x0 lsk 1413 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x584 Transaction freed
00000800:00000200:13.0:1773851888.143440:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851888.143441:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851888.143443:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851888.143447:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851888.143449:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.143451:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18938@kfi7 : PUT - for me
00000400:00000200:13.0:1773851888.143453:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.143454:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 1
00000400:00000200:13.0:1773851888.143456:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.143457:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000400:00000200:13.0:1773851888.143459:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 3
00000400:00000200:13.0:1773851888.143460:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.143461:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18938@kfi7 of length 224 into portal 12 MB=0x699de8c295a80
00000400:00000200:13.0:1773851888.143464:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18938@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 46032
00000800:00000200:13.0:1773851888.143467:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851888.143470:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851888.143471:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18938@kfi7: PUT: OK
00000100:00000001:13.0:1773851888.143473:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851888.143473:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851888.143475:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000045ea6c0.
00000100:00000040:13.0:1773851888.143476:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000045ea6c0 x1858030973573760 msgsize 224
00000100:00100000:13.0:1773851888.143478:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18938@kfi7 (source: 12345-18938@kfi7)
00000100:00000001:13.0:1773851888.143480:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851888.143481:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000100:00000001:12.0:1773851888.143482:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851888.143483:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851888.143483:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851888.143484:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851888.143485:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851888.143486:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851888.143487:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030973573760
00000020:00000001:12.0:1773851888.143488:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851888.143489:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f97
00000020:00000001:12.0:1773851888.143490:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851888.143493:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000811274a3 refcount=6
00000020:00000001:12.0:1773851888.143494:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239874560 : -107152469677056 : ffff9e8b9f1bac00)
00000020:00000001:12.0:1773851888.143496:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239874560 : -107152469677056 : ffff9e8b9f1bac00)
00000100:00000001:12.0:1773851888.143497:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.143498:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851888.143499:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b96e46cc.
00000020:00000010:12.0:1773851888.143501:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.143502:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000084c0a733.
00000100:00000001:12.0:1773851888.143504:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851888.143504:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851888.143505:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851888.143507:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851888.143508:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851888.143508:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.143510:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851888.143512:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851888.143512:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851888.143513:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851888.143513:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851888.143514:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18938@kfi7, seq: 2289898
00000100:00000040:12.0:1773851888.143516:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000811274a3 : new rpc_count 1
00000100:00000001:15.0:1773851888.143517:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.143517:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485596928 : -107000223954688 : ffff9eaf11a90900)
00000100:00000001:15.0:1773851888.143518:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851888.143519:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000045ea6c0 x1858030973573760/t0(0) o400->b1efae4e-7af1-48b3-9521-3b03264efe6e@18938@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne242-0'
00000100:00000001:12.0:1773851888.143523:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.143524:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851888.143525:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000045ea6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:b1efae4e-7af1-48b3-9521-3b03264efe6e+6:47794:x1858030973573760:12345-18938@kfi7:400:default-tuolumne242-0
00000100:00000200:12.0:1773851888.143527:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030973573760
00000020:00000001:12.0:1773851888.143528:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851888.143529:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851888.143530:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.143532:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851888.143532:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851888.143534:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851888.143534:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030973573760, found 0 last_xid 1858030973573759
00000020:00000001:12.0:1773851888.143536:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851888.143537:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851888.143537:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851888.143538:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.143539:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851888.143540:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851888.143541:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851888.143542:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a541a644.
02000000:00000001:12.0:1773851888.143543:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.143544:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.143545:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851888.143546:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030973573760
00010000:00000001:12.0:1773851888.143548:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851888.143549:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000045ea6c0 x1858030973573760/t0(0) o400->b1efae4e-7af1-48b3-9521-3b03264efe6e@18938@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne242-0'
00010000:00000001:12.0:1773851888.143553:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851888.143554:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851888.143556:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=121 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851888.143558:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851888.143559:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000092f393d4 refcount 5 to 18938@kfi7
00000100:00000001:12.0:1773851888.143560:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150976 : -107154898400640 : ffff9e8b0e584a80)
02000000:00000001:12.0:1773851888.143561:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851888.143562:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.143563:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851888.143564:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18938@kfi7
00000400:00000010:12.0:1773851888.143565:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f51b28f0.
00000100:00000200:12.0:1773851888.143566:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030973573760, offset 224
00000400:00000200:12.0:1773851888.143569:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18938@kfi7
00000400:00000200:12.0:1773851888.143570:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.143571:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 1
00000400:00000200:12.0:1773851888.143573:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000400:00000200:12.0:1773851888.143575:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 3
00000400:00000200:12.0:1773851888.143577:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18938@kfi7 local destination
00000400:00000200:12.0:1773851888.143579:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769906:8769906:1024:4294967295] 18938@kfi7 LPNI seq info [24413:24413:16:4294967295]
00000400:00000200:12.0:1773851888.143581:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000400:00000200:12.0:1773851888.143582:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.143585:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18938@kfi7(18938@kfi7:18938@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851888.143587:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 3
00000800:00000200:12.0:1773851888.143590:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851888.143592:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851888.143595:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851888.143599:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007c8 Using peer 18938@kfi7(0x1000000000007c8)
00000800:00000200:12.0:1773851888.143603:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x1000000000007c8: rc=0
00000800:00000200:12.0:1773851888.143606:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007c8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851888.143613:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851888.143616:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000092f393d4 refcount 4 to 18938@kfi7
00010000:00000001:12.0:1773851888.143618:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851888.143618:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.143619:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851888.143620:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000045ea6c0 x1858030973573760/t0(0) o400->b1efae4e-7af1-48b3-9521-3b03264efe6e@18938@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne242-0'
00000100:00100000:12.0:1773851888.143626:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000045ea6c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:b1efae4e-7af1-48b3-9521-3b03264efe6e+6:47794:x1858030973573760:12345-18938@kfi7:400:default-tuolumne242-0 Request processed in 101us (149us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851888.143630:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18938@kfi7, seq: 2289898
00000100:00000040:12.0:1773851888.143631:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000811274a3 : new rpc_count 0
00000100:00000001:12.0:1773851888.143632:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851888.143633:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851888.143634:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.143635:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000084c0a733.
00000020:00000010:12.0:1773851888.143636:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b96e46cc.
00000020:00000040:12.0:1773851888.143638:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000811274a3 : new refcount 5
00000100:00000001:12.0:1773851888.143639:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851888.143648:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007c8 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851888.143650:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851888.143652:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18938@kfi7: PUT: OK
00000400:00000200:13.0:1773851888.143653:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f51b28f0
00000400:00000010:13.0:1773851888.143654:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f51b28f0.
00000100:00000001:13.0:1773851888.143655:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851888.143656:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851888.143657:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000800:00000200:13.0:1773851888.143660:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 18938@kfi7(000000004097f492):0x0 lsk 1993 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007c8 Transaction freed
00000800:00000200:13.0:1773851888.143998:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851888.143999:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851888.144001:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851888.144005:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851888.144008:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.144010:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18938@kfi7 : PUT - for me
00000400:00000200:13.0:1773851888.144012:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.144014:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 1
00000400:00000200:13.0:1773851888.144015:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.144017:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000400:00000200:13.0:1773851888.144018:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 3
00000400:00000200:13.0:1773851888.144020:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.144021:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18938@kfi7 of length 224 into portal 12 MB=0x699de8c296240
00000400:00000200:13.0:1773851888.144023:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18938@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 46256
00000800:00000200:13.0:1773851888.144026:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851888.144029:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851888.144031:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18938@kfi7: PUT: OK
00000100:00000001:13.0:1773851888.144032:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851888.144033:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851888.144034:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000075bbd2ea.
00000100:00000040:13.0:1773851888.144036:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000075bbd2ea x1858030973575744 msgsize 224
00000100:00100000:13.0:1773851888.144038:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18938@kfi7 (source: 12345-18938@kfi7)
00000100:00000001:13.0:1773851888.144040:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851888.144041:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000100:00000001:12.0:1773851888.144043:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851888.144043:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851888.144044:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851888.144044:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851888.144045:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851888.144046:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851888.144047:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030973575744
00000020:00000001:12.0:1773851888.144048:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851888.144049:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91206
00000020:00000001:12.0:1773851888.144050:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851888.144056:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e894f49f refcount=6
00000020:00000001:12.0:1773851888.144057:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240522752 : -107152469028864 : ffff9e8b9f259000)
00000020:00000001:12.0:1773851888.144059:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240522752 : -107152469028864 : ffff9e8b9f259000)
00000100:00000001:12.0:1773851888.144060:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.144062:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851888.144063:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b96e46cc.
00000020:00000010:12.0:1773851888.144064:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.144066:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000084c0a733.
00000100:00000001:12.0:1773851888.144067:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851888.144068:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851888.144069:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851888.144070:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851888.144071:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851888.144071:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.144073:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851888.144075:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851888.144075:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851888.144076:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851888.144076:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851888.144077:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18938@kfi7, seq: 2289899
00000100:00000001:15.0:1773851888.144078:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851888.144078:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e894f49f : new rpc_count 1
00000100:00000001:15.0:1773851888.144079:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.144079:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485609600 : -107000223942016 : ffff9eaf11a93a80)
00000100:00000040:12.0:1773851888.144081:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000075bbd2ea x1858030973575744/t0(0) o400->9d380e6c-81f0-4026-9a4b-2e15e7ff6367@18938@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne242-0'
00000100:00000001:12.0:1773851888.144086:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.144087:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851888.144089:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000075bbd2ea pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9d380e6c-81f0-4026-9a4b-2e15e7ff6367+6:47793:x1858030973575744:12345-18938@kfi7:400:default-tuolumne242-0
00000100:00000200:12.0:1773851888.144091:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030973575744
00000020:00000001:12.0:1773851888.144092:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851888.144093:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851888.144094:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.144094:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851888.144095:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851888.144097:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851888.144097:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030973575744, found 0 last_xid 1858030973575743
00000020:00000001:12.0:1773851888.144098:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851888.144099:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851888.144100:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851888.144101:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.144102:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851888.144103:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851888.144103:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851888.144104:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d7a378ed.
02000000:00000001:12.0:1773851888.144105:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.144106:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.144106:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851888.144107:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768237, transno 0, xid 1858030973575744
00010000:00000001:12.0:1773851888.144108:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851888.144109:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000075bbd2ea x1858030973575744/t0(0) o400->9d380e6c-81f0-4026-9a4b-2e15e7ff6367@18938@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne242-0'
00010000:00000001:12.0:1773851888.144111:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851888.144112:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851888.144112:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=121 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851888.144114:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851888.144114:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000092f393d4 refcount 5 to 18938@kfi7
00000100:00000001:12.0:1773851888.144115:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150976 : -107154898400640 : ffff9e8b0e584a80)
02000000:00000001:12.0:1773851888.144116:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851888.144116:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.144117:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851888.144118:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18938@kfi7
00000400:00000010:12.0:1773851888.144118:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009bd347e2.
00000100:00000200:12.0:1773851888.144119:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030973575744, offset 224
00000400:00000200:12.0:1773851888.144120:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18938@kfi7
00000400:00000200:12.0:1773851888.144121:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.144122:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 1
00000400:00000200:12.0:1773851888.144123:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000400:00000200:12.0:1773851888.144124:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 3
00000400:00000200:12.0:1773851888.144125:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18938@kfi7 local destination
00000400:00000200:12.0:1773851888.144126:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769907:8769907:1024:4294967295] 18938@kfi7 LPNI seq info [24414:24414:16:4294967295]
00000400:00000200:12.0:1773851888.144128:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000400:00000200:12.0:1773851888.144129:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18938@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.144131:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18938@kfi7(18938@kfi7:18938@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851888.144133:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 3
00000800:00000200:12.0:1773851888.144135:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851888.144136:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851888.144138:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851888.144141:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x258 Using peer 18938@kfi7(0x258)
00000800:00000200:12.0:1773851888.144144:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x258: rc=0
00000800:00000200:12.0:1773851888.144145:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x258 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851888.144147:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851888.144148:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000092f393d4 refcount 4 to 18938@kfi7
00010000:00000001:12.0:1773851888.144149:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851888.144149:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.144150:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851888.144150:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000075bbd2ea x1858030973575744/t0(0) o400->9d380e6c-81f0-4026-9a4b-2e15e7ff6367@18938@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne242-0'
00000100:00100000:12.0:1773851888.144154:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000075bbd2ea pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9d380e6c-81f0-4026-9a4b-2e15e7ff6367+6:47793:x1858030973575744:12345-18938@kfi7:400:default-tuolumne242-0 Request processed in 67us (118us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851888.144156:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18938@kfi7, seq: 2289899
00000100:00000040:12.0:1773851888.144157:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e894f49f : new rpc_count 0
00000100:00000001:12.0:1773851888.144158:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851888.144158:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851888.144159:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.144159:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000084c0a733.
00000020:00000010:12.0:1773851888.144160:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b96e46cc.
00000020:00000040:12.0:1773851888.144161:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000e894f49f : new refcount 5
00000100:00000001:12.0:1773851888.144161:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851888.144166:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x258 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851888.144168:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851888.144169:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18938@kfi7: PUT: OK
00000400:00000200:13.0:1773851888.144169:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009bd347e2
00000400:00000010:13.0:1773851888.144170:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009bd347e2.
00000100:00000001:13.0:1773851888.144170:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851888.144171:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851888.144172:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000026fb346b nid 18938@kfi7 refs 2
00000800:00000200:13.0:1773851888.144173:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 18938@kfi7(00000000a0029750):0x0 lsk 601 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x258 Transaction freed
00000800:00000200:9.0:1773851888.290194:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.290194:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851888.290196:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851888.290198:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851888.290200:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25632@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.290201:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25632@kfi7 : PUT - for me
00000400:00000200:9.0:1773851888.290202:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25632@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.290203:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d8cd758 nid 25632@kfi7 refs 1
00000400:00000200:9.0:1773851888.290204:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25632@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.290204:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d8cd758 nid 25632@kfi7 refs 2
00000400:00000200:9.0:1773851888.290205:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003d8cd758 nid 25632@kfi7 refs 3
00000400:00000200:9.0:1773851888.290206:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25824@kfi7 to cpt 5
00000400:00000200:9.0:1773851888.290207:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25824@kfi7 of length 224 into portal 12 MB=0x699e1051d4a40
00000400:00000200:9.0:1773851888.290208:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25824@kfi7 of length 224/224 into md 0x78146ce49 [64] + 152728
00000800:00000200:9.0:1773851888.290210:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851888.290211:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.290212:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25632@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.290214:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851888.290214:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851888.290215:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004dd921d6.
00000100:00000040:9.0:1773851888.290216:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004dd921d6 x1858041592760896 msgsize 224
00000100:00100000:9.0:1773851888.290218:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-25824@kfi7 (source: 12345-25632@kfi7)
00000100:00000001:9.0:1773851888.290219:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851888.290220:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003d8cd758 nid 25632@kfi7 refs 2
00000800:00000200:9.0:1773851888.290221:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851888.290224:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851888.290224:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851888.290225:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851888.290225:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851888.290226:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851888.290227:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041592760896
00000020:00000001:9.0:1773851888.290227:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851888.290228:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a87
00000020:00000001:9.0:1773851888.290228:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851888.290232:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000da025baa refcount=6
00000020:00000001:9.0:1773851888.290233:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627750912 : -107123081800704 : ffff9e9276c31400)
00000020:00000001:9.0:1773851888.290234:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627750912 : -107123081800704 : ffff9e9276c31400)
00000100:00000001:9.0:1773851888.290235:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851888.290235:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851888.290236:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aae1527.
00000020:00000010:9.0:1773851888.290237:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851888.290238:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f2d33498.
00000100:00000001:9.0:1773851888.290239:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851888.290239:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851888.290240:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.290241:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851888.290241:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851888.290242:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.290242:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.290244:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851888.290244:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851888.290244:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851888.290244:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851888.290245:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25824@kfi7, seq: 2130837
00000100:00000040:9.0:1773851888.290246:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000da025baa : new rpc_count 1
00000100:00000001:9.0:1773851888.290246:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856908416 : -106914852643200 : ffff9ec2f22fde80)
00000100:00000001:8.0:1773851888.290246:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851888.290247:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004dd921d6 x1858041592760896/t0(0) o400->22d41fc8-9944-44f9-9942-f3aac2cb18f3@25824@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2095-0'
00000100:00000001:8.0:1773851888.290247:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.290260:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851888.290261:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851888.290262:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004dd921d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:22d41fc8-9944-44f9-9942-f3aac2cb18f3+6:39814:x1858041592760896:12345-25824@kfi7:400:default-tuolumne2095-0
00000100:00000200:9.0:1773851888.290263:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041592760896
00000020:00000001:9.0:1773851888.290264:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851888.290264:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851888.290265:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.290266:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851888.290266:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851888.290267:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851888.290267:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041592760896, found 0 last_xid 1858041592760895
00000020:00000001:9.0:1773851888.290268:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851888.290269:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851888.290270:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851888.290270:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.290271:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851888.290271:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851888.290272:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851888.290273:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057d245f8.
02000000:00000001:9.0:1773851888.290274:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.290274:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.290275:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851888.290275:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183066174174, transno 0, xid 1858041592760896
00010000:00000001:9.0:1773851888.290276:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851888.290277:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004dd921d6 x1858041592760896/t0(0) o400->22d41fc8-9944-44f9-9942-f3aac2cb18f3@25824@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2095-0'
00010000:00000001:9.0:1773851888.290279:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851888.290280:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851888.290281:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=121 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851888.290282:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851888.290282:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a43cd1a2 refcount 3 to 25824@kfi7
00000100:00000001:9.0:1773851888.290283:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449408 : -107146752102208 : ffff9e8cf3e6f0c0)
02000000:00000001:9.0:1773851888.290284:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851888.290285:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.290285:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851888.290286:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25632@kfi7
00000400:00000010:9.0:1773851888.290287:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d17d55e6.
00000100:00000200:9.0:1773851888.290287:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041592760896, offset 224
00000400:00000200:9.0:1773851888.290289:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25632@kfi7
00000400:00000200:9.0:1773851888.290289:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25632@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.290290:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003d8cd758 nid 25632@kfi7 refs 1
00000400:00000200:9.0:1773851888.290291:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003d8cd758 nid 25632@kfi7 refs 2
00000400:00000200:9.0:1773851888.290292:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003d8cd758 nid 25632@kfi7 refs 3
00000400:00000200:9.0:1773851888.290293:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25632@kfi7 local destination
00000400:00000200:9.0:1773851888.290294:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769908:8769908:1024:4294967295] 25632@kfi7 LPNI seq info [7227406:7227406:16:4294967295]
00000400:00000200:9.0:1773851888.290295:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003d8cd758 nid 25632@kfi7 refs 2
00000400:00000200:9.0:1773851888.290296:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25632@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.290298:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25632@kfi7(25632@kfi7:25632@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851888.290299:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003d8cd758 nid 25632@kfi7 refs 3
00000800:00000200:9.0:1773851888.290300:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.290301:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851888.290303:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851888.290305:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d6f Using peer 25632@kfi7(0x100000000000d6f)
00000800:00000200:9.0:1773851888.290308:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x100000000000d6f: rc=0
00000800:00000200:9.0:1773851888.290309:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d6f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851888.290311:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851888.290312:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a43cd1a2 refcount 2 to 25824@kfi7
00010000:00000001:9.0:1773851888.290313:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851888.290313:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851888.290314:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851888.290314:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004dd921d6 x1858041592760896/t0(0) o400->22d41fc8-9944-44f9-9942-f3aac2cb18f3@25824@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2095-0'
00000100:00100000:9.0:1773851888.290318:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004dd921d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:22d41fc8-9944-44f9-9942-f3aac2cb18f3+6:39814:x1858041592760896:12345-25824@kfi7:400:default-tuolumne2095-0 Request processed in 56us (101us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851888.290320:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25824@kfi7, seq: 2130837
00000100:00000040:9.0:1773851888.290321:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000da025baa : new rpc_count 0
00000100:00000001:9.0:1773851888.290322:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851888.290322:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:10.0:1773851888.290323:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d6f TN_EVENT_TX_OK event status 0
00000020:00000010:9.0:1773851888.290323:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851888.290324:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f2d33498.
00000020:00000010:9.0:1773851888.290324:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aae1527.
00000400:00000200:10.0:1773851888.290325:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:9.0:1773851888.290325:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000da025baa : new refcount 5
00000400:00000200:10.0:1773851888.290326:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25632@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.290326:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851888.290327:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d17d55e6
00000400:00000010:10.0:1773851888.290327:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d17d55e6.
00000100:00000001:10.0:1773851888.290328:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851888.290328:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851888.290329:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003d8cd758 nid 25632@kfi7 refs 2
00000800:00000200:10.0:1773851888.290330:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 25632@kfi7(0000000063385408):0x0 lsk 3440 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d6f Transaction freed
00000800:00000200:17.0:1773851888.293520:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851888.293521:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851888.293522:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851888.293524:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851888.293527:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14658@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.293528:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14658@kfi7 : PUT - for me
00000400:00000200:17.0:1773851888.293529:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14658@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.293530:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008857b66c nid 14658@kfi7 refs 1
00000400:00000200:17.0:1773851888.293531:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14658@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.293531:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008857b66c nid 14658@kfi7 refs 2
00000400:00000200:17.0:1773851888.293532:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008857b66c nid 14658@kfi7 refs 3
00000400:00000200:17.0:1773851888.293533:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14658@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.293534:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14658@kfi7 of length 224 into portal 12 MB=0x69b4ba9eb8d40
00000400:00000200:17.0:1773851888.293536:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14658@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 38032
00000800:00000200:17.0:1773851888.293538:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851888.293539:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851888.293540:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14658@kfi7: PUT: OK
00000100:00000001:17.0:1773851888.293541:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851888.293542:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851888.293543:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000460522cd.
00000100:00000040:17.0:1773851888.293543:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000460522cd x1859599135903040 msgsize 224
00000100:00100000:17.0:1773851888.293545:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14658@kfi7 (source: 12345-14658@kfi7)
00000100:00000001:17.0:1773851888.293546:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851888.293547:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008857b66c nid 14658@kfi7 refs 2
00000800:00000200:17.0:1773851888.293548:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851888.293551:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851888.293551:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851888.293552:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851888.293552:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851888.293553:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851888.293554:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599135903040
00000020:00000001:17.0:1773851888.293554:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851888.293555:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f7d5
00000020:00000001:17.0:1773851888.293555:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851888.293557:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000034a59a4 refcount=5
00000020:00000001:17.0:1773851888.293558:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144155558912 : -106929553992704 : ffff9ebf85eb1400)
00000020:00000001:17.0:1773851888.293559:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144155558912 : -106929553992704 : ffff9ebf85eb1400)
00000100:00000001:17.0:1773851888.293559:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851888.293560:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851888.293561:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851888.293562:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851888.293562:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851888.293563:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851888.293564:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851888.293564:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851888.293565:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851888.293565:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851888.293566:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.293567:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851888.293568:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851888.293568:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851888.293568:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851888.293568:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851888.293569:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14658@kfi7, seq: 2156402
00000100:00000040:17.0:1773851888.293570:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000034a59a4 : new rpc_count 1
00000100:00000001:16.0:1773851888.293570:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.293571:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102209664 : -107041607341952 : ffff9ea56f04a880)
00000100:00000001:16.0:1773851888.293571:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851888.293572:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000460522cd x1859599135903040/t0(0) o400->94bcc57a-59d9-4920-a964-c60d9057d692@14658@kfi7:109/0 lens 224/0 e 0 to 0 dl 1773852224 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1416-0'
00000100:00000001:17.0:1773851888.293574:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851888.293575:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851888.293576:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000460522cd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:94bcc57a-59d9-4920-a964-c60d9057d692+5:39590:x1859599135903040:12345-14658@kfi7:400:default-tuolumne1416-0
00000100:00000200:17.0:1773851888.293577:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599135903040
00000020:00000001:17.0:1773851888.293578:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851888.293578:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851888.293579:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.293579:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851888.293580:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851888.293581:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851888.293581:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599135903040, found 0 last_xid 1859599135903039
00000020:00000001:17.0:1773851888.293582:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851888.293583:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851888.293583:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851888.293584:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.293584:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851888.293585:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851888.293585:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851888.293586:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b657bf5a.
02000000:00000001:17.0:1773851888.293586:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.293587:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.293588:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851888.293588:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182610462482, transno 0, xid 1859599135903040
00010000:00000001:17.0:1773851888.293589:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851888.293590:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000460522cd x1859599135903040/t0(0) o400->94bcc57a-59d9-4920-a964-c60d9057d692@14658@kfi7:109/0 lens 224/224 e 0 to 0 dl 1773852224 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1416-0'
00010000:00000001:17.0:1773851888.293592:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851888.293593:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851888.293594:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=121 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851888.293595:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851888.293595:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002830120c refcount 3 to 14658@kfi7
00000100:00000001:17.0:1773851888.293596:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583949824 : -107156125601792 : ffff9e8ac532b000)
02000000:00000001:17.0:1773851888.293597:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851888.293597:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.293598:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851888.293599:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14658@kfi7
00000400:00000010:17.0:1773851888.293599:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012f08013.
00000100:00000200:17.0:1773851888.293600:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599135903040, offset 224
00000400:00000200:17.0:1773851888.293601:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14658@kfi7
00000400:00000200:17.0:1773851888.293602:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14658@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.293603:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008857b66c nid 14658@kfi7 refs 1
00000400:00000200:17.0:1773851888.293604:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008857b66c nid 14658@kfi7 refs 2
00000400:00000200:17.0:1773851888.293605:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008857b66c nid 14658@kfi7 refs 3
00000400:00000200:17.0:1773851888.293606:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14658@kfi7 local destination
00000400:00000200:17.0:1773851888.293607:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769909:8769909:1024:4294967295] 14658@kfi7 LPNI seq info [10311331:10311331:16:4294967295]
00000400:00000200:17.0:1773851888.293608:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008857b66c nid 14658@kfi7 refs 2
00000400:00000200:17.0:1773851888.293609:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14658@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.293610:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14658@kfi7(14658@kfi7:14658@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851888.293611:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008857b66c nid 14658@kfi7 refs 3
00000800:00000200:17.0:1773851888.293613:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851888.293614:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851888.293615:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851888.293619:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x8e4 Using peer 14658@kfi7(0x8e4)
00000800:00000200:17.0:1773851888.293622:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x8e4: rc=0
00000800:00000200:17.0:1773851888.293623:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x8e4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851888.293626:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851888.293626:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002830120c refcount 2 to 14658@kfi7
00010000:00000001:17.0:1773851888.293627:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851888.293627:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.293628:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851888.293629:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000460522cd x1859599135903040/t0(0) o400->94bcc57a-59d9-4920-a964-c60d9057d692@14658@kfi7:109/0 lens 224/224 e 0 to 0 dl 1773852224 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1416-0'
00000100:00100000:17.0:1773851888.293632:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000460522cd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:94bcc57a-59d9-4920-a964-c60d9057d692+5:39590:x1859599135903040:12345-14658@kfi7:400:default-tuolumne1416-0 Request processed in 56us (87us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851888.293634:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14658@kfi7, seq: 2156402
00000800:00000200:18.0:1773851888.293635:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x8e4 TN_EVENT_TX_OK event status 0
00000100:00000040:17.0:1773851888.293635:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000034a59a4 : new rpc_count 0
00000100:00000001:17.0:1773851888.293635:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851888.293636:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851888.293636:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000400:00000200:18.0:1773851888.293637:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851888.293637:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000400:00000200:18.0:1773851888.293638:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14658@kfi7: PUT: OK
00000400:00000200:18.0:1773851888.293638:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012f08013
00000020:00000010:17.0:1773851888.293638:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000400:00000010:18.0:1773851888.293639:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012f08013.
00000020:00000040:17.0:1773851888.293639:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000034a59a4 : new refcount 4
00000100:00000001:17.0:1773851888.293639:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851888.293640:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851888.293640:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851888.293641:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008857b66c nid 14658@kfi7 refs 2
00000800:00000200:18.0:1773851888.293642:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 14658@kfi7(00000000513a3275):0x0 lsk 2277 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x8e4 Transaction freed
00000800:00000200:21.0:1773851888.350071:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851888.350072:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851888.350073:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851888.350075:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851888.350077:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21473@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.350078:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21473@kfi7 : PUT - for me
00000400:00000200:21.0:1773851888.350078:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21473@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.350080:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 1
00000400:00000200:21.0:1773851888.350081:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21473@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.350082:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 2
00000400:00000200:21.0:1773851888.350082:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 3
00000400:00000200:21.0:1773851888.350083:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21280@kfi7 to cpt 0
00000400:00000200:21.0:1773851888.350084:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21280@kfi7 of length 224 into portal 12 MB=0x699e106941400
00000400:00000200:21.0:1773851888.350085:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21280@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 55736
00000800:00000200:21.0:1773851888.350087:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851888.350088:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851888.350089:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21473@kfi7: PUT: OK
00000100:00000001:21.0:1773851888.350090:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851888.350090:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851888.350091:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e97ef21e.
00000100:00000040:21.0:1773851888.350092:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e97ef21e x1858041617323008 msgsize 224
00000100:00100000:21.0:1773851888.350093:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21280@kfi7 (source: 12345-21473@kfi7)
00000100:00000001:21.0:1773851888.350094:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851888.350095:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 2
00000100:00000001:20.0:1773851888.350095:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851888.350096:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851888.350096:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851888.350096:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851888.350096:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851888.350097:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851888.350098:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041617323008
00000020:00000001:20.0:1773851888.350098:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851888.350099:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929d0
00000020:00000001:20.0:1773851888.350100:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851888.350103:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a32a30fb refcount=6
00000020:00000001:20.0:1773851888.350103:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743194624 : -107128966356992 : ffff9e911803e000)
00000020:00000001:20.0:1773851888.350104:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743194624 : -107128966356992 : ffff9e911803e000)
00000100:00000001:20.0:1773851888.350105:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851888.350106:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851888.350107:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002332f203.
00000020:00000010:20.0:1773851888.350108:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851888.350108:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000afae15a5.
00000100:00000001:20.0:1773851888.350109:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851888.350109:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851888.350110:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851888.350111:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851888.350111:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851888.350112:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851888.350113:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851888.350114:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851888.350114:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851888.350115:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851888.350115:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851888.350116:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21280@kfi7, seq: 1998045
00000100:00000040:23.0:1773851888.350117:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a32a30fb : new rpc_count 1
00000100:00000001:20.0:1773851888.350117:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851888.350118:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956251136 : -106937753300480 : ffff9ebd9d339200)
00000100:00000001:20.0:1773851888.350118:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851888.350119:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e97ef21e x1858041617323008/t0(0) o400->55c9ff1a-2f9a-47c1-880f-2b8efffa2216@21280@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1823-0'
00000100:00000001:23.0:1773851888.350122:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851888.350122:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851888.350123:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e97ef21e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:55c9ff1a-2f9a-47c1-880f-2b8efffa2216+6:39708:x1858041617323008:12345-21280@kfi7:400:default-tuolumne1823-0
00000100:00000200:23.0:1773851888.350125:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041617323008
00000020:00000001:23.0:1773851888.350126:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851888.350126:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851888.350127:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.350128:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851888.350128:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851888.350129:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851888.350129:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041617323008, found 0 last_xid 1858041617323007
00000020:00000001:23.0:1773851888.350130:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851888.350131:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851888.350131:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851888.350132:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.350132:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851888.350133:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851888.350133:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851888.350134:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000058dbbd5e.
02000000:00000001:23.0:1773851888.350135:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851888.350135:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.350136:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851888.350137:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182575315056, transno 0, xid 1858041617323008
00010000:00000001:23.0:1773851888.350137:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851888.350138:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e97ef21e x1858041617323008/t0(0) o400->55c9ff1a-2f9a-47c1-880f-2b8efffa2216@21280@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1823-0'
00010000:00000001:23.0:1773851888.350141:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851888.350141:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851888.350142:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=121 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851888.350143:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851888.350144:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f7920353 refcount 3 to 21280@kfi7
00000100:00000001:23.0:1773851888.350144:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049376 : -107154804502240 : ffff9e8b13f11120)
02000000:00000001:23.0:1773851888.350145:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851888.350145:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851888.350146:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851888.350147:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21473@kfi7
00000400:00000010:23.0:1773851888.350148:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d767c6.
00000100:00000200:23.0:1773851888.350148:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041617323008, offset 224
00000400:00000200:23.0:1773851888.350150:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21473@kfi7
00000400:00000200:23.0:1773851888.350151:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21473@kfi7 to cpt 5
00000400:00000200:23.0:1773851888.350152:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 1
00000400:00000200:23.0:1773851888.350153:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 2
00000400:00000200:23.0:1773851888.350154:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 3
00000400:00000200:23.0:1773851888.350155:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21473@kfi7 local destination
00000400:00000200:23.0:1773851888.350156:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769910:8769910:1024:4294967295] 21473@kfi7 LPNI seq info [641226:641226:16:4294967295]
00000400:00000200:23.0:1773851888.350158:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 2
00000400:00000200:23.0:1773851888.350158:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21473@kfi7 to cpt 5
00000400:00000200:23.0:1773851888.350160:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21473@kfi7(21473@kfi7:21473@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851888.350162:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 3
00000800:00000200:23.0:1773851888.350163:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851888.350164:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851888.350166:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851888.350169:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbff Using peer 21473@kfi7(0xbff)
00000800:00000200:23.0:1773851888.350172:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0xbff: rc=0
00000800:00000200:23.0:1773851888.350173:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851888.350175:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851888.350176:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f7920353 refcount 2 to 21280@kfi7
00010000:00000001:23.0:1773851888.350177:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851888.350177:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.350178:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851888.350179:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e97ef21e x1858041617323008/t0(0) o400->55c9ff1a-2f9a-47c1-880f-2b8efffa2216@21280@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1823-0'
00000100:00100000:23.0:1773851888.350181:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e97ef21e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:55c9ff1a-2f9a-47c1-880f-2b8efffa2216+6:39708:x1858041617323008:12345-21280@kfi7:400:default-tuolumne1823-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851888.350184:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21280@kfi7, seq: 1998045
00000100:00000040:23.0:1773851888.350185:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a32a30fb : new rpc_count 0
00000100:00000001:23.0:1773851888.350186:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851888.350186:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:21.0:1773851888.350186:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbff TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851888.350187:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000400:00000200:21.0:1773851888.350187:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851888.350188:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000afae15a5.
00000020:00000010:23.0:1773851888.350188:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002332f203.
00000400:00000200:21.0:1773851888.350188:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21473@kfi7: PUT: OK
00000020:00000040:23.0:1773851888.350189:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000a32a30fb : new refcount 5
00000400:00000200:21.0:1773851888.350189:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d767c6
00000400:00000010:21.0:1773851888.350189:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d767c6.
00000100:00000001:21.0:1773851888.350189:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851888.350190:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851888.350190:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851888.350191:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006f7bc1f2 nid 21473@kfi7 refs 2
00000800:00000200:21.0:1773851888.350192:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 21473@kfi7(0000000023f2f671):0x0 lsk 3072 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbff Transaction freed
00000800:00000200:1.0:1773851888.351242:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851888.351244:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851888.351247:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851888.351250:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851888.351254:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25393@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.351256:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25393@kfi7 : PUT - for me
00000400:00000200:1.0:1773851888.351258:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25393@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.351259:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 1
00000400:00000200:1.0:1773851888.351261:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25393@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.351262:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 2
00000400:00000200:1.0:1773851888.351263:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 3
00000400:00000200:1.0:1773851888.351265:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25392@kfi7 to cpt 5
00000400:00000200:1.0:1773851888.351267:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25392@kfi7 of length 224 into portal 12 MB=0x69b1716aeaec0
00000400:00000200:1.0:1773851888.351269:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25392@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 44320
00000800:00000200:1.0:1773851888.351272:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851888.351275:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.351277:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25393@kfi7: PUT: OK
00000100:00000001:1.0:1773851888.351278:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851888.351279:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851888.351281:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003140a2d3.
00000100:00000040:1.0:1773851888.351282:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000003140a2d3 x1859373327363776 msgsize 224
00000100:00100000:1.0:1773851888.351284:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25392@kfi7 (source: 12345-25393@kfi7)
00000100:00000001:1.0:1773851888.351286:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851888.351287:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 2
00000100:00000001:0.0:1773851888.351287:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851888.351288:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851888.351288:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851888.351289:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851888.351289:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851888.351290:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00100000:0.0:1773851888.351290:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373327363776
00000020:00000001:0.0:1773851888.351291:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851888.351291:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912c3
00000020:00000001:0.0:1773851888.351292:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851888.351293:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f6a71883 refcount=6
00000020:00000001:0.0:1773851888.351294:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716194304 : -107155993357312 : ffff9e8acd149400)
00000020:00000001:0.0:1773851888.351295:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716194304 : -107155993357312 : ffff9e8acd149400)
00000100:00000001:0.0:1773851888.351295:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.351297:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851888.351297:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033ae8c39.
00000020:00000010:0.0:1773851888.351298:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.351300:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851888.351301:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851888.351301:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851888.351301:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.351302:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851888.351303:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851888.351303:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.351304:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.351305:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851888.351306:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851888.351307:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851888.351307:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25392@kfi7, seq: 1997608
00000100:00000040:0.0:1773851888.351307:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f6a71883 : new rpc_count 1
00000100:00000001:1.0:1773851888.351308:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851888.351308:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112249472 : -106950597302144 : ffff9eba9fa3a880)
00000100:00000001:1.0:1773851888.351309:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851888.351309:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003140a2d3 x1859373327363776/t0(0) o400->0c51b4f4-701a-443e-81c9-06e4504edcd3@25392@kfi7:528/0 lens 224/0 e 0 to 0 dl 1773852643 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2077-0'
00000100:00000001:1.0:1773851888.351310:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.351311:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.351311:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851888.351312:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003140a2d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0c51b4f4-701a-443e-81c9-06e4504edcd3+6:39873:x1859373327363776:12345-25392@kfi7:400:default-tuolumne2077-0
00000100:00000200:0.0:1773851888.351314:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373327363776
00000020:00000001:0.0:1773851888.351314:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851888.351315:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851888.351315:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.351316:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851888.351316:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851888.351317:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851888.351318:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373327363776, found 0 last_xid 1859373327363775
00000020:00000001:0.0:1773851888.351319:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851888.351319:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851888.351320:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851888.351321:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.351321:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851888.351322:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851888.351322:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851888.351323:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ce9c9c6a.
02000000:00000001:0.0:1773851888.351324:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.351325:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.351326:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851888.351326:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104960471, transno 0, xid 1859373327363776
00010000:00000001:0.0:1773851888.351327:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851888.351328:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003140a2d3 x1859373327363776/t0(0) o400->0c51b4f4-701a-443e-81c9-06e4504edcd3@25392@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2077-0'
00010000:00000001:0.0:1773851888.351330:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851888.351331:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851888.351332:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=121 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851888.351333:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851888.351334:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000099fd4e56 refcount 3 to 25392@kfi7
00000100:00000001:0.0:1773851888.351334:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999948832 : -107156709602784 : ffff9e8aa2638a20)
02000000:00000001:0.0:1773851888.351335:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851888.351336:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.351336:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851888.351338:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25393@kfi7
00000400:00000010:0.0:1773851888.351338:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bcd8159c.
00000100:00000200:0.0:1773851888.351339:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373327363776, offset 224
00000400:00000200:0.0:1773851888.351341:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25393@kfi7
00000400:00000200:0.0:1773851888.351342:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25393@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.351342:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 1
00000400:00000200:0.0:1773851888.351344:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 2
00000400:00000200:0.0:1773851888.351345:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 3
00000400:00000200:0.0:1773851888.351346:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25393@kfi7 local destination
00000400:00000200:0.0:1773851888.351347:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769911:8769911:1024:4294967295] 25393@kfi7 LPNI seq info [593003:593003:16:4294967295]
00000400:00000200:0.0:1773851888.351349:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 2
00000400:00000200:0.0:1773851888.351350:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25393@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.351352:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25393@kfi7(25393@kfi7:25393@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851888.351354:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 3
00000800:00000200:0.0:1773851888.351355:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851888.351356:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851888.351359:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851888.351361:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc3d Using peer 25393@kfi7(0xc3d)
00000800:00000200:0.0:1773851888.351364:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0xc3d: rc=0
00000800:00000200:0.0:1773851888.351366:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc3d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851888.351368:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851888.351369:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000099fd4e56 refcount 2 to 25392@kfi7
00010000:00000001:0.0:1773851888.351369:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851888.351370:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.351371:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851888.351371:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003140a2d3 x1859373327363776/t0(0) o400->0c51b4f4-701a-443e-81c9-06e4504edcd3@25392@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2077-0'
00000100:00100000:0.0:1773851888.351377:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003140a2d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:0c51b4f4-701a-443e-81c9-06e4504edcd3+6:39873:x1859373327363776:12345-25392@kfi7:400:default-tuolumne2077-0 Request processed in 64us (94us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851888.351379:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25392@kfi7, seq: 1997608
00000100:00000040:0.0:1773851888.351380:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f6a71883 : new rpc_count 0
00000100:00000001:0.0:1773851888.351381:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851888.351381:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851888.351382:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.351383:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851888.351384:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033ae8c39.
00000020:00000040:0.0:1773851888.351384:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000f6a71883 : new refcount 5
00000100:00000001:0.0:1773851888.351385:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851888.351394:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc3d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851888.351397:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.351399:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25393@kfi7: PUT: OK
00000400:00000200:1.0:1773851888.351400:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bcd8159c
00000400:00000010:1.0:1773851888.351401:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bcd8159c.
00000100:00000001:1.0:1773851888.351403:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851888.351403:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851888.351405:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3f26bb2 nid 25393@kfi7 refs 2
00000800:00000200:1.0:1773851888.351408:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 25393@kfi7(00000000d94baefd):0x0 lsk 3134 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc3d Transaction freed
00000800:00000200:9.0:1773851888.417562:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.417563:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851888.417566:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851888.417570:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851888.417573:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.417576:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.22@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851888.417578:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.417580:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851888.417582:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.22@o2ib60 to cpt 7
00000400:00000200:9.0:1773851888.417584:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 2
00000400:00000200:9.0:1773851888.417586:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094d5a1fa nid 192.168.128.22@o2ib60 refs 3
00000400:00000200:9.0:1773851888.417588:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.22@o2ib60 to cpt 7
00000400:00000200:9.0:1773851888.417591:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.22@o2ib60 of length 2528 into portal 12 MB=0x69b193278aa00
00000400:00000200:9.0:1773851888.417594:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.22@o2ib60 of length 2528/2528 into md 0x77fe1859d [64] + 448
00000800:00000200:9.0:1773851888.417600:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851888.417603:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.417605:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.417607:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851888.417608:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851888.417609:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004878e5d3.
00000100:00000040:9.0:1773851888.417610:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004878e5d3 x1859382383520256 msgsize 2528
00000100:00100000:9.0:1773851888.417614:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.22@o2ib60 (source: 12345-192.168.128.22@o2ib60)
00000100:00000001:9.0:1773851888.417617:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851888.417618:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851888.417620:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851888.417621:0:60533:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:29.0:1773851888.417622:0:60533:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:29.0:1773851888.417623:0:60533:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851888.417624:0:60533:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851888.417625:0:60533:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851888.417626:0:60533:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859382383520256
00000020:00000001:29.0:1773851888.417627:0:60533:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:29.0:1773851888.417628:0:60533:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae625ad
00000020:00000001:29.0:1773851888.417629:0:60533:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:29.0:1773851888.417631:0:60533:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000043ba3412 refcount=859
00000020:00000001:29.0:1773851888.417632:0:60533:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928631480320 : -107145078071296 : ffff9e8d57aea000)
00000020:00000001:29.0:1773851888.417634:0:60533:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928631480320 : -107145078071296 : ffff9e8d57aea000)
00000100:00000001:29.0:1773851888.417636:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851888.417637:0:60533:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:29.0:1773851888.417638:0:60533:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000cedc0027.
00000020:00000010:29.0:1773851888.417639:0:60533:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b56bd111.
00000020:00000010:29.0:1773851888.417641:0:60533:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000009c6a3c4.
00000100:00000001:29.0:1773851888.417642:0:60533:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:29.0:1773851888.417643:0:60533:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:29.0:1773851888.417645:0:60533:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:29.0:1773851888.417646:0:60533:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.417647:0:60533:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.417649:0:60533:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.417651:0:60533:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851888.417654:0:60533:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851888.417655:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:29.0:1773851888.417655:0:60533:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851888.417656:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:29.0:1773851888.417657:0:60533:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.22@o2ib60, seq: 364304985
00000100:00000001:30.0:1773851888.417659:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851888.417659:0:60533:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000043ba3412 : new rpc_count 2
00000100:00000001:30.0:1773851888.417660:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.417660:0:60533:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856911872 : -106914852639744 : ffff9ec2f22fec00)
00000100:00000040:29.0:1773851888.417663:0:60533:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004878e5d3 x1859382383520256/t0(0) o101->107bb794-15dd-432e-83be-a15ea9179233@192.168.128.22@o2ib60:676/0 lens 2528/0 e 0 to 0 dl 1773852036 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-matrix22-68915'
00000100:00000001:29.0:1773851888.417669:0:60533:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:29.0:1773851888.417670:0:60533:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:29.0:1773851888.417672:0:60533:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004878e5d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_012:107bb794-15dd-432e-83be-a15ea9179233+859:3559169:x1859382383520256:12345-192.168.128.22@o2ib60:101:default-matrix22-68915
00000100:00000200:29.0:1773851888.417675:0:60533:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859382383520256
00000020:00000001:29.0:1773851888.417676:0:60533:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:29.0:1773851888.417677:0:60533:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:29.0:1773851888.417678:0:60533:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851888.417680:0:60533:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:29.0:1773851888.417680:0:60533:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:29.0:1773851888.417682:0:60533:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:29.0:1773851888.417683:0:60533:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859382383520256, found 0 last_xid 1859382383185087
00000020:00000001:29.0:1773851888.417684:0:60533:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:29.0:1773851888.417686:0:60533:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:29.0:1773851888.417687:0:60533:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:29.0:1773851888.417688:0:60533:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851888.417689:0:60533:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:29.0:1773851888.417691:0:60533:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:29.0:1773851888.417692:0:60533:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:29.0:1773851888.417693:0:60533:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:29.0:1773851888.417694:0:60533:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851888.417699:0:60533:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:29.0:1773851888.417703:0:60533:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000590c6ea3 count: 5
00010000:00000001:29.0:1773851888.417705:0:60533:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:29.0:1773851888.417707:0:60533:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:29.0:1773851888.417709:0:60533:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000040cab34e.
00000020:00000001:29.0:1773851888.417711:0:60533:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:29.0:1773851888.417712:0:60533:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000040cab34e with handle 0x21b6f08f07a6adb6 to hash
00000020:00000001:29.0:1773851888.417714:0:60533:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:29.0:1773851888.417714:0:60533:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00000010:29.0:1773851888.417717:0:60533:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000099a5eed5.
00010000:00000001:29.0:1773851888.417719:0:60533:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637136586731328 : -106937122820288 : ffff9ebdc2c7ef40)
00010000:00010000:29.0:1773851888.417721:0:60533:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000040cab34e/0x21b6f08f07a6adb6 lrc: 2/0,0 mode: --/CR res: [0x240028ab3:0x93de:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe424a1b0f344ad69 expref: -99 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:29.0:1773851888.417734:0:60533:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000590c6ea3 count: 5
00010000:00000040:29.0:1773851888.417736:0:60533:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000043ba3412 : new locks_count 854
00000020:00000040:29.0:1773851888.417737:0:60533:0:(genops.c:871:class_export_get()) GET export 0000000043ba3412 refcount=860
00010000:00000001:29.0:1773851888.417741:0:60533:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:29.0:1773851888.417742:0:60533:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:29.0:1773851888.417745:0:60533:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:29.0:1773851888.417746:0:60533:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:29.0:1773851888.417747:0:60533:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.417749:0:60533:0:(mdt_handler.c:4756:mdt_intent_open()) Process entered
00000004:00000002:29.0:1773851888.417751:0:60533:0:(mdt_handler.c:3007:mdt_reint_opcode()) @@@ reint opt = 6  req@000000004878e5d3 x1859382383520256/t0(0) o101->107bb794-15dd-432e-83be-a15ea9179233@192.168.128.22@o2ib60:676/0 lens 2528/0 e 0 to 0 dl 1773852036 ref 1 fl Interpret:/0/ffffffff rc 0/-1 job:'default-matrix22-68915'
00000004:00000001:29.0:1773851888.417757:0:60533:0:(mdt_handler.c:2906:mdt_reint_internal()) Process entered
00000004:00000001:29.0:1773851888.417758:0:60533:0:(mdt_lib.c:1846:mdt_reint_unpack()) Process entered
00000004:00000001:29.0:1773851888.417759:0:60533:0:(mdt_lib.c:1649:mdt_open_unpack()) Process entered
00000001:00000001:29.0:1773851888.417762:0:60533:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851888.417763:0:60533:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.417764:0:60533:0:(mdt_lib.c:1727:mdt_open_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.417765:0:60533:0:(mdt_lib.c:1856:mdt_reint_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.417767:0:60533:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:29.0:1773851888.417768:0:60533:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:29.0:1773851888.417769:0:60533:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:29.0:1773851888.417769:0:60533:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:29.0:1773851888.417771:0:60533:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5560 at 00000000068afee8.
02000000:00000001:29.0:1773851888.417772:0:60533:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.417773:0:60533:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.417775:0:60533:0:(mdt_lib.c:578:old_init_ucred_reint()) Process entered
00000001:00000001:29.0:1773851888.417776:0:60533:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851888.417776:0:60533:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:29.0:1773851888.417778:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851888.417779:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=68915 : 68915 : 10d33)
00000001:00000001:29.0:1773851888.417780:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851888.417781:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=68915 : 68915 : 10d33)
02000000:00000001:29.0:1773851888.417784:0:60533:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000010:29.0:1773851888.417786:0:60533:0:(upcall_cache.c:46:alloc_entry()) alloc '(entry)': 112 at 000000007c5024af (tot 253200883).
00000004:00000001:29.0:1773851888.417789:0:60533:0:(mdt_identity.c:82:mdt_identity_do_upcall()) Process entered
00000004:00000040:29.0:1773851888.417790:0:60533:0:(mdt_identity.c:87:mdt_identity_do_upcall()) The upcall is: '/usr/sbin/l_getidentity'
00000004:00080000:29.0:1773851888.417956:0:60533:0:(mdt_identity.c:116:mdt_identity_do_upcall()) lustre5-MDT0001: invoked upcall /usr/sbin/l_getidentity lustre5-MDT0001 68915, time 164us
00000004:00000001:29.0:1773851888.417958:0:60533:0:(mdt_identity.c:119:mdt_identity_do_upcall()) Process leaving
00000800:00000200:29.0:1773851888.420071:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851888.420072:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851888.420073:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851888.420075:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851888.420077:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9072@kfi7 to cpt 7
00000400:00000200:29.0:1773851888.420079:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9072@kfi7 : PUT - for me
00000400:00000200:29.0:1773851888.420080:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9072@kfi7 to cpt 7
00000400:00000200:29.0:1773851888.420080:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ddc28f5 nid 9072@kfi7 refs 1
00000400:00000200:29.0:1773851888.420082:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9072@kfi7 to cpt 7
00000400:00000200:29.0:1773851888.420083:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ddc28f5 nid 9072@kfi7 refs 2
00000400:00000200:29.0:1773851888.420084:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ddc28f5 nid 9072@kfi7 refs 3
00000400:00000200:29.0:1773851888.420084:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9136@kfi7 to cpt 3
00000400:00000200:29.0:1773851888.420086:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9136@kfi7 of length 224 into portal 12 MB=0x69b464f8ea380
00000400:00000200:29.0:1773851888.420087:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9136@kfi7 of length 224/224 into md 0x77fe1859d [64] + 2976
00000800:00000200:29.0:1773851888.420089:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851888.420091:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851888.420092:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9072@kfi7: PUT: OK
00000100:00000001:29.0:1773851888.420093:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851888.420093:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851888.420094:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003d556355.
00000100:00000040:29.0:1773851888.420095:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000003d556355 x1859576145027968 msgsize 224
00000100:00100000:29.0:1773851888.420097:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-9136@kfi7 (source: 12345-9072@kfi7)
00000100:00000001:29.0:1773851888.420098:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:30.0:1773851888.420099:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851888.420099:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ddc28f5 nid 9072@kfi7 refs 2
02000000:00000001:30.0:1773851888.420100:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851888.420100:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851888.420100:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851888.420101:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851888.420101:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851888.420102:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576145027968
00000020:00000001:30.0:1773851888.420103:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851888.420103:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc1623c8a
00000020:00000001:30.0:1773851888.420104:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851888.420109:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d3b10aa3 refcount=5
00000020:00000001:30.0:1773851888.420109:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637155429986304 : -106918279565312 : ffff9ec225ed3000)
00000020:00000001:30.0:1773851888.420110:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637155429986304 : -106918279565312 : ffff9ec225ed3000)
00000100:00000001:30.0:1773851888.420111:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851888.420112:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851888.420112:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851888.420113:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851888.420114:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000700a46f0.
00000100:00000001:30.0:1773851888.420115:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851888.420116:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851888.420117:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.420118:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851888.420118:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851888.420119:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.420120:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.420121:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851888.420122:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851888.420123:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9136@kfi7, seq: 2055575
00000100:00000040:30.0:1773851888.420123:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d3b10aa3 : new rpc_count 1
00000100:00000001:30.0:1773851888.420124:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262219008 : -106943447332608 : ffff9ebc49cf8900)
00000100:00000040:30.0:1773851888.420125:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003d556355 x1859576145027968/t0(0) o400->d2f94a46-ab3b-44ed-a3b6-8badc4e8bb2c@9136@kfi7:676/0 lens 224/0 e 0 to 0 dl 1773852036 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1054-0'
00000100:00000001:30.0:1773851888.420128:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851888.420129:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851888.420130:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003d556355 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:d2f94a46-ab3b-44ed-a3b6-8badc4e8bb2c+5:39675:x1859576145027968:12345-9136@kfi7:400:default-tuolumne1054-0
00000100:00000200:30.0:1773851888.420131:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576145027968
00000020:00000001:30.0:1773851888.420132:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851888.420133:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851888.420134:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851888.420134:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851888.420135:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851888.420136:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851888.420136:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576145027968, found 0 last_xid 1859576145027967
00000020:00000001:30.0:1773851888.420137:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851888.420138:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851888.420138:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851888.420139:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851888.420139:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851888.420140:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851888.420140:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851888.420141:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000061212b89.
02000000:00000001:30.0:1773851888.420142:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.420142:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851888.420143:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851888.420143:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183187234425, transno 0, xid 1859576145027968
00010000:00000001:30.0:1773851888.420144:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851888.420146:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003d556355 x1859576145027968/t0(0) o400->d2f94a46-ab3b-44ed-a3b6-8badc4e8bb2c@9136@kfi7:676/0 lens 224/224 e 0 to 0 dl 1773852036 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1054-0'
00010000:00000001:30.0:1773851888.420148:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851888.420149:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851888.420150:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=121 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851888.420151:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851888.420152:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ec925308 refcount 3 to 9136@kfi7
00000100:00000001:30.0:1773851888.420152:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150496 : -107154898401120 : ffff9e8b0e5848a0)
02000000:00000001:30.0:1773851888.420153:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851888.420154:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.420155:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851888.420156:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9072@kfi7
00000400:00000010:30.0:1773851888.420156:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00000200:30.0:1773851888.420157:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576145027968, offset 224
00000400:00000200:30.0:1773851888.420159:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9072@kfi7
00000400:00000200:30.0:1773851888.420160:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9072@kfi7 to cpt 7
00000400:00000200:30.0:1773851888.420161:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ddc28f5 nid 9072@kfi7 refs 1
00000400:00000200:30.0:1773851888.420162:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ddc28f5 nid 9072@kfi7 refs 2
00000400:00000200:30.0:1773851888.420163:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ddc28f5 nid 9072@kfi7 refs 3
00000400:00000200:30.0:1773851888.420165:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9072@kfi7 local destination
00000400:00000200:30.0:1773851888.420166:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769912:8769912:1024:4294967295] 9072@kfi7 LPNI seq info [4794733:4794733:16:4294967295]
00000400:00000200:30.0:1773851888.420168:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ddc28f5 nid 9072@kfi7 refs 2
00000400:00000200:30.0:1773851888.420169:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9072@kfi7 to cpt 7
00000400:00000200:30.0:1773851888.420171:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9072@kfi7(9072@kfi7:9072@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851888.420172:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ddc28f5 nid 9072@kfi7 refs 3
00000800:00000200:30.0:1773851888.420173:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851888.420175:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851888.420177:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851888.420180:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e03 Using peer 9072@kfi7(0x100000000000e03)
00000800:00000200:30.0:1773851888.420183:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000fd057322: Posted send of 324 bytes to peer 0x100000000000e03: rc=0
00000800:00000200:30.0:1773851888.420184:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e03 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851888.420186:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851888.420187:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ec925308 refcount 2 to 9136@kfi7
00010000:00000001:30.0:1773851888.420188:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851888.420189:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851888.420189:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851888.420190:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003d556355 x1859576145027968/t0(0) o400->d2f94a46-ab3b-44ed-a3b6-8badc4e8bb2c@9136@kfi7:676/0 lens 224/224 e 0 to 0 dl 1773852036 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1054-0'
00000100:00100000:30.0:1773851888.420193:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003d556355 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:d2f94a46-ab3b-44ed-a3b6-8badc4e8bb2c+5:39675:x1859576145027968:12345-9136@kfi7:400:default-tuolumne1054-0 Request processed in 64us (97us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851888.420196:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9136@kfi7, seq: 2055575
00000800:00000200:29.0:1773851888.420196:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e03 TN_EVENT_TX_OK event status 0
00000100:00000040:30.0:1773851888.420197:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d3b10aa3 : new rpc_count 0
00000100:00000001:30.0:1773851888.420198:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851888.420198:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851888.420198:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851888.420199:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851888.420199:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9072@kfi7: PUT: OK
00000020:00000010:30.0:1773851888.420200:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000700a46f0.
00000400:00000200:29.0:1773851888.420200:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000020:00000010:30.0:1773851888.420201:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000400:00000010:29.0:1773851888.420201:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000020:00000040:30.0:1773851888.420202:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000d3b10aa3 : new refcount 4
00000100:00000001:30.0:1773851888.420202:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851888.420202:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851888.420202:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851888.420203:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ddc28f5 nid 9072@kfi7 refs 2
00000800:00000200:29.0:1773851888.420205:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 9072@kfi7(0000000059f26545):0x0 lsk 3588 rsk 11 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e03 Transaction freed
00000004:00000010:3.0:1773851888.421227:0:2515881:0:(mdt_lproc.c:355:lprocfs_identity_info_seq_write()) kmalloced '(param)': 1048 at 0000000076a53b1e.
00000004:00000010:3.0:1773851888.421229:0:2515881:0:(mdt_lproc.c:388:lprocfs_identity_info_seq_write()) kfreed 'param': 1048 at 0000000076a53b1e.
00000004:00000010:3.0:1773851888.421230:0:2515881:0:(mdt_lproc.c:355:lprocfs_identity_info_seq_write()) kmalloced '(param)': 1068 at 0000000076a53b1e.
02000000:00000001:3.0:1773851888.421231:0:2515881:0:(upcall_cache.c:300:upcall_cache_downcall()) Process entered
00000004:00000001:3.0:1773851888.421232:0:2515881:0:(mdt_identity.c:135:mdt_identity_parse_downcall()) Process entered
00000004:00001000:3.0:1773851888.421233:0:2515881:0:(mdt_identity.c:183:mdt_identity_parse_downcall()) parse mdt identity@0000000096333d5a: 68915:68915, ngroups 5, nperms 0
00000004:00000001:3.0:1773851888.421234:0:2515881:0:(mdt_identity.c:186:mdt_identity_parse_downcall()) Process leaving (rc=0 : 0 : 0)
02000000:00001000:3.0:1773851888.421235:0:2515881:0:(upcall_cache.c:351:upcall_cache_downcall()) lustre5-MDT0001: created upcall cache entry 000000007c5024af for key 68915
02000000:00000001:3.0:1773851888.421237:0:2515881:0:(upcall_cache.c:362:upcall_cache_downcall()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:3.0:1773851888.421238:0:2515881:0:(mdt_lproc.c:400:lprocfs_identity_info_seq_write()) kfreed 'param': 1068 at 0000000076a53b1e.
02000000:00000001:29.0:1773851888.421240:0:60533:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637107796940416 : -106965912611200 : ffff9eb70ec69680)
00000004:00000001:29.0:1773851888.421242:0:60533:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:29.0:1773851888.421242:0:60533:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:29.0:1773851888.421243:0:60533:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851888.421243:0:60533:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421244:0:60533:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:29.0:1773851888.421244:0:60533:0:(mdt_lib.c:599:old_init_ucred_reint()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421246:0:60533:0:(mdt_internal.h:1182:mdt_check_resent()) Process entered
00000004:00000001:29.0:1773851888.421246:0:60533:0:(mdt_internal.h:1200:mdt_check_resent()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421247:0:60533:0:(mdt_reint.c:3241:mdt_reint_rec()) Process entered
00000004:00000001:29.0:1773851888.421249:0:60533:0:(mdt_open.c:1361:mdt_reint_open()) Process entered
00000004:00000002:29.0:1773851888.421249:0:60533:0:(mdt_open.c:1390:mdt_reint_open()) I am going to open [0x240028ab3:0x93de:0x0]/(->[0x240028ab3:0x93fd:0x0]) cr_flag=0100240200001 mode=0100000 msg_flag=0x0
00000004:00000001:29.0:1773851888.421252:0:60533:0:(mdt_open.c:1081:mdt_open_by_fid_lock()) Process entered
00000004:00000001:29.0:1773851888.421253:0:60533:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:29.0:1773851888.421253:0:60533:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028ab3:0x93fd:0x0]
00000020:00000001:29.0:1773851888.421254:0:60533:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:29.0:1773851888.421257:0:60533:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636993826108968 : -107079883442648 : ffff9e9c8595b628)
00000004:00000001:29.0:1773851888.421258:0:60533:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636993826108880 : -107079883442736 : ffff9e9c8595b5d0)
00000004:00000001:29.0:1773851888.421259:0:60533:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:29.0:1773851888.421261:0:60533:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:29.0:1773851888.421276:0:60533:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421277:0:60533:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:29.0:1773851888.421279:0:60533:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:29.0:1773851888.421282:0:60533:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:29.0:1773851888.421284:0:60533:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:29.0:1773851888.421285:0:60533:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:29.0:1773851888.421286:0:60533:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:29.0:1773851888.421287:0:60533:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:29.0:1773851888.421288:0:60533:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421289:0:60533:0:(mdt_open.c:783:mdt_object_open_lock()) Process entered
00000004:00000002:29.0:1773851888.421290:0:60533:0:(mdt_open.c:875:mdt_object_open_lock()) normal open:[0x240028ab3:0x93fd:0x0] lease count: 0, lm: 16
00000004:00000002:29.0:1773851888.421292:0:60533:0:(mdt_open.c:898:mdt_object_open_lock()) lustre5-MDT0001: Requested bits lock:[0x240028ab3:0x93fd:0x0], ibits = 0x0/0x0, open_flags = 0100240200001, try_layout = 0 : rc = 0
00000004:00000001:29.0:1773851888.421293:0:60533:0:(mdt_open.c:963:mdt_object_open_lock()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:29.0:1773851888.421294:0:60533:0:(mdt_open.c:966:mdt_object_open_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421295:0:60533:0:(mdt_open.c:529:mdt_finish_open()) Process entered
00000001:00000001:29.0:1773851888.421296:0:60533:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851888.421297:0:60533:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:29.0:1773851888.421297:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851888.421298:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=68915 : 68915 : 10d33)
00000001:00000001:29.0:1773851888.421298:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851888.421299:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=68915 : 68915 : 10d33)
00000001:00000001:29.0:1773851888.421299:0:60533:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:29.0:1773851888.421299:0:60533:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:29.0:1773851888.421300:0:60533:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x240028ab3:0x93fd:0x0]: nlink=3, mode=40700, valid=0x1100000000002f8f
00000004:00200000:29.0:1773851888.421301:0:60533:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x240028ab3:0x93fd:0x0]: returning size 37888
00000001:00000001:29.0:1773851888.421302:0:60533:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:29.0:1773851888.421302:0:60533:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421304:0:60533:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:29.0:1773851888.421304:0:60533:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:29.0:1773851888.421305:0:60533:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:29.0:1773851888.421305:0:60533:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:29.0:1773851888.421306:0:60533:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:29.0:1773851888.421307:0:60533:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:29.0:1773851888.421307:0:60533:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:29.0:1773851888.421308:0:60533:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421309:0:60533:0:(mdt_open.c:353:mdt_mfd_open()) Process entered
00000004:00000002:29.0:1773851888.421309:0:60533:0:(mdt_open.c:378:mdt_mfd_open()) after open, ma_valid bit = 0x1 lmm_size = 0
00000004:00000001:29.0:1773851888.421311:0:60533:0:(mdd_object.c:3303:mdd_open()) Process entered
00000004:00000001:29.0:1773851888.421313:0:60533:0:(mdd_object.c:3253:mdd_open_sanity_check()) Process entered
00000004:00000001:29.0:1773851888.421314:0:60533:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:29.0:1773851888.421314:0:60533:0:(mdd_permission.c:262:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421315:0:60533:0:(mdd_object.c:3289:mdd_open_sanity_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851888.421316:0:60533:0:(mdd_object.c:3321:mdd_open()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:29.0:1773851888.421317:0:60533:0:(mdt_open.c:56:mdt_mfd_new()) Process entered
00000004:00000010:29.0:1773851888.421318:0:60533:0:(mdt_open.c:58:mdt_mfd_new()) kmalloced '(mfd)': 112 at 000000000f21d37b.
00000020:00000001:29.0:1773851888.421319:0:60533:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:29.0:1773851888.421319:0:60533:0:(lustre_handles.c:97:class_handle_hash()) added object 000000000f21d37b with handle 0x21b6f08f07a6adbd to hash
00000020:00000001:29.0:1773851888.421320:0:60533:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00000004:00000001:29.0:1773851888.421321:0:60533:0:(mdt_open.c:67:mdt_mfd_new()) Process leaving (rc=18446637161093383808 : -106912616167808 : ffff9ec3777dc680)
00000004:00000001:29.0:1773851888.421322:0:60533:0:(mdt_internal.h:655:mdt_object_get()) Process entered
00000004:00000001:29.0:1773851888.421323:0:60533:0:(mdt_internal.h:657:mdt_object_get()) Process leaving
00000004:00002000:29.0:1773851888.421323:0:60533:0:(mdt_open.c:300:mdt_mfd_set_mode()) [0x240028ab3:0x93fd:0x0] Change mfd open_flags 0 -> 0100240200001.
00000004:00000001:29.0:1773851888.421325:0:60533:0:(mdt_open.c:201:mdt_empty_transno()) Process entered
00080000:00000001:29.0:1773851888.421326:0:60533:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:29.0:1773851888.421326:0:60533:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000098ee5cfc.
00080000:00000001:29.0:1773851888.421327:0:60533:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637139631879168 : -106934077672448 : ffff9ebe78493400)
00080000:00000001:29.0:1773851888.421328:0:60533:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851888.421331:0:60533:0:(osd_io.c:178:osd_declare_write()) Process entered
00000001:00000001:29.0:1773851888.421339:0:60533:0:(osd_quota.c:530:osd_declare_quota()) Process entered
00080000:00000001:29.0:1773851888.421340:0:60533:0:(osd_io.c:243:osd_declare_write()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851888.432844:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.432845:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851888.432846:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851888.432848:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851888.432850:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19024@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.432851:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19024@kfi7 : PUT - for me
00000400:00000200:9.0:1773851888.432852:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19024@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.432853:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087d59c25 nid 19024@kfi7 refs 1
00000400:00000200:9.0:1773851888.432855:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19024@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.432855:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087d59c25 nid 19024@kfi7 refs 2
00000400:00000200:9.0:1773851888.432856:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000087d59c25 nid 19024@kfi7 refs 3
00000400:00000200:9.0:1773851888.432857:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19089@kfi7 to cpt 0
00000400:00000200:9.0:1773851888.432858:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19089@kfi7 of length 224 into portal 12 MB=0x69b4b95160e80
00000400:00000200:9.0:1773851888.432859:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19089@kfi7 of length 224/224 into md 0x78146ce49 [64] + 152952
00000800:00000200:9.0:1773851888.432861:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851888.432864:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.432865:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19024@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.432866:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851888.432867:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851888.432868:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006cb4cd82.
00000100:00000040:9.0:1773851888.432869:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006cb4cd82 x1859598786367104 msgsize 224
00000100:00100000:9.0:1773851888.432870:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-19089@kfi7 (source: 12345-19024@kfi7)
00000100:00000001:9.0:1773851888.432871:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851888.432872:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000087d59c25 nid 19024@kfi7 refs 2
00000800:00000200:9.0:1773851888.432874:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851888.432876:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851888.432877:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851888.432877:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851888.432878:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851888.432878:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851888.432879:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598786367104
00000020:00000001:9.0:1773851888.432880:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851888.432880:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e70cc5
00000020:00000001:9.0:1773851888.432881:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851888.432883:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000059b1eb8f refcount=5
00000020:00000001:9.0:1773851888.432883:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128110983168 : -106945598568448 : ffff9ebbc9964800)
00000020:00000001:9.0:1773851888.432884:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128110983168 : -106945598568448 : ffff9ebbc9964800)
00000100:00000001:9.0:1773851888.432885:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851888.432886:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851888.432887:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009aae1527.
00000020:00000010:9.0:1773851888.432888:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851888.432889:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f2d33498.
00000100:00000001:9.0:1773851888.432889:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851888.432890:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851888.432890:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.432891:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851888.432892:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851888.432893:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.432894:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.432895:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851888.432895:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851888.432895:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851888.432895:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851888.432897:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19089@kfi7, seq: 2130838
00000100:00000040:8.0:1773851888.432897:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000059b1eb8f : new rpc_count 1
00000100:00000001:9.0:1773851888.432898:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.432898:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.432898:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856891136 : -106914852660480 : ffff9ec2f22f9b00)
00000100:00000040:8.0:1773851888.432900:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006cb4cd82 x1859598786367104/t0(0) o400->7035b4c5-e320-423e-bb42-85bdcfac3eb7@19089@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1682-0'
00000100:00000001:8.0:1773851888.432902:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851888.432903:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851888.432904:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006cb4cd82 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7035b4c5-e320-423e-bb42-85bdcfac3eb7+5:39498:x1859598786367104:12345-19089@kfi7:400:default-tuolumne1682-0
00000100:00000200:8.0:1773851888.432905:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598786367104
00000020:00000001:8.0:1773851888.432906:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851888.432907:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851888.432908:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.432909:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851888.432909:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851888.432910:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851888.432911:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598786367104, found 0 last_xid 1859598786367103
00000020:00000001:8.0:1773851888.432912:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851888.432912:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851888.432913:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851888.432914:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.432915:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851888.432915:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851888.432916:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851888.432917:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d9cf553a.
02000000:00000001:8.0:1773851888.432918:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.432918:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.432919:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851888.432920:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182344070408, transno 0, xid 1859598786367104
00010000:00000001:8.0:1773851888.432921:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851888.432921:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006cb4cd82 x1859598786367104/t0(0) o400->7035b4c5-e320-423e-bb42-85bdcfac3eb7@19089@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1682-0'
00010000:00000001:8.0:1773851888.432924:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851888.432925:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851888.432925:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=121 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851888.432926:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851888.432927:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b6a637e refcount 3 to 19089@kfi7
00000100:00000001:8.0:1773851888.432928:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994448736 : -107149715102880 : ffff9e8c434b2360)
02000000:00000001:8.0:1773851888.432929:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851888.432929:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.432930:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851888.432931:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19024@kfi7
00000400:00000010:8.0:1773851888.432932:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006188a4b8.
00000100:00000200:8.0:1773851888.432933:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598786367104, offset 224
00000400:00000200:8.0:1773851888.432934:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19024@kfi7
00000400:00000200:8.0:1773851888.432935:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19024@kfi7 to cpt 2
00000400:00000200:8.0:1773851888.432936:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000087d59c25 nid 19024@kfi7 refs 1
00000400:00000200:8.0:1773851888.432937:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000087d59c25 nid 19024@kfi7 refs 2
00000400:00000200:8.0:1773851888.432938:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000087d59c25 nid 19024@kfi7 refs 3
00000400:00000200:8.0:1773851888.432939:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19024@kfi7 local destination
00000400:00000200:8.0:1773851888.432941:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769913:8769913:1024:4294967295] 19024@kfi7 LPNI seq info [17248853:17248853:16:4294967295]
00000400:00000200:8.0:1773851888.432942:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000087d59c25 nid 19024@kfi7 refs 2
00000400:00000200:8.0:1773851888.432943:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19024@kfi7 to cpt 2
00000400:00000200:8.0:1773851888.432945:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19024@kfi7(19024@kfi7:19024@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851888.432947:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000087d59c25 nid 19024@kfi7 refs 3
00000800:00000200:8.0:1773851888.432948:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851888.432949:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851888.432951:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851888.432954:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008e2 Using peer 19024@kfi7(0x1000000000008e2)
00000800:00000200:8.0:1773851888.432957:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x1000000000008e2: rc=0
00000800:00000200:8.0:1773851888.432958:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851888.432961:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851888.432961:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b6a637e refcount 2 to 19089@kfi7
00010000:00000001:8.0:1773851888.432962:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851888.432963:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.432964:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851888.432964:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006cb4cd82 x1859598786367104/t0(0) o400->7035b4c5-e320-423e-bb42-85bdcfac3eb7@19089@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1682-0'
00000100:00100000:8.0:1773851888.432969:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006cb4cd82 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7035b4c5-e320-423e-bb42-85bdcfac3eb7+5:39498:x1859598786367104:12345-19089@kfi7:400:default-tuolumne1682-0 Request processed in 65us (99us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851888.432971:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19089@kfi7, seq: 2130838
00000100:00000040:8.0:1773851888.432972:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000059b1eb8f : new rpc_count 0
00000100:00000001:8.0:1773851888.432973:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851888.432974:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851888.432974:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:8.0:1773851888.432975:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f2d33498.
00000020:00000010:8.0:1773851888.432976:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009aae1527.
00000020:00000040:8.0:1773851888.432977:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000059b1eb8f : new refcount 4
00000100:00000001:8.0:1773851888.432978:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851888.432983:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008e2 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851888.432984:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.432986:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19024@kfi7: PUT: OK
00000400:00000200:9.0:1773851888.432986:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006188a4b8
00000400:00000010:9.0:1773851888.432987:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006188a4b8.
00000100:00000001:9.0:1773851888.432988:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851888.432988:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851888.432989:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000087d59c25 nid 19024@kfi7 refs 2
00000800:00000200:9.0:1773851888.432990:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 19024@kfi7(00000000af0d221e):0x0 lsk 2275 rsk 23 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000008e2 Transaction freed
00000800:00000200:21.0:1773851888.448771:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851888.448772:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851888.448773:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851888.448775:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851888.448776:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.448778:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000400:00000200:21.0:1773851888.448779:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.448779:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:21.0:1773851888.448780:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.448781:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:21.0:1773851888.448781:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:21.0:1773851888.448782:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.448783:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 224 into portal 12 MB=0x699e109784a40
00000400:00000200:21.0:1773851888.448784:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-47@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 55960
00000800:00000200:21.0:1773851888.448786:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851888.448787:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851888.448788:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000100:00000001:21.0:1773851888.448789:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851888.448790:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851888.448790:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005eea9d64.
00000100:00000040:21.0:1773851888.448791:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005eea9d64 x1858041665833536 msgsize 224
00000100:00100000:21.0:1773851888.448792:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-47@kfi7 (source: 12345-47@kfi7)
00000100:00000001:21.0:1773851888.448793:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851888.448794:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:23.0:1773851888.448795:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851888.448795:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851888.448795:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851888.448796:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851888.448796:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851888.448797:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851888.448798:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041665833536
00000020:00000001:23.0:1773851888.448798:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851888.448799:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793accc273
00000020:00000001:23.0:1773851888.448800:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851888.448804:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b323de80 refcount=5
00000020:00000001:23.0:1773851888.448805:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921295092736 : -107152414458880 : ffff9e8ba2663c00)
00000020:00000001:23.0:1773851888.448806:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921295092736 : -107152414458880 : ffff9e8ba2663c00)
00000100:00000001:23.0:1773851888.448806:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851888.448807:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851888.448808:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a6c8ed98.
00000020:00000010:23.0:1773851888.448809:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851888.448810:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851888.448811:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851888.448811:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851888.448812:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851888.448813:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851888.448813:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851888.448814:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851888.448815:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851888.448816:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851888.448816:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851888.448816:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851888.448816:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851888.448817:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-47@kfi7, seq: 1998046
00000100:00000040:23.0:1773851888.448819:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b323de80 : new rpc_count 1
00000100:00000001:23.0:1773851888.448819:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135956262656 : -106937753288960 : ffff9ebd9d33bf00)
00000100:00000001:20.0:1773851888.448819:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851888.448820:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851888.448821:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005eea9d64 x1858041665833536/t0(0) o400->lustre5-MDT0001-lwp-OST0015_UUID@47@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba122-0'
00000100:00000001:23.0:1773851888.448823:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851888.448824:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851888.448825:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eea9d64 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0015_UUID+5:272692:x1858041665833536:12345-47@kfi7:400:default-yuba122-0
00000100:00000200:23.0:1773851888.448826:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041665833536
00000020:00000001:23.0:1773851888.448827:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851888.448828:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851888.448828:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.448829:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851888.448829:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851888.448830:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:23.0:1773851888.448831:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851888.448831:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851888.448832:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851888.448832:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.448833:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851888.448834:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851888.448834:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851888.448835:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000001a7477f.
02000000:00000001:23.0:1773851888.448835:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851888.448836:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.448837:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851888.448838:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041665833536
00010000:00000001:23.0:1773851888.448838:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851888.448839:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005eea9d64 x1858041665833536/t0(0) o400->lustre5-MDT0001-lwp-OST0015_UUID@47@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba122-0'
00010000:00000001:23.0:1773851888.448842:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851888.448842:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851888.448843:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=121 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851888.448844:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851888.448845:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000db5f5b81 refcount 7 to 47@kfi7
00000100:00000001:23.0:1773851888.448846:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449312 : -107146752102304 : ffff9e8cf3e6f060)
02000000:00000001:23.0:1773851888.448847:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851888.448847:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851888.448848:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851888.448849:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000400:00000010:23.0:1773851888.448849:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008506b019.
00000100:00000200:23.0:1773851888.448850:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041665833536, offset 224
00000400:00000200:23.0:1773851888.448851:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000200:23.0:1773851888.448852:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:23.0:1773851888.448853:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:23.0:1773851888.448854:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:23.0:1773851888.448855:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:23.0:1773851888.448857:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  47@kfi7 local destination
00000400:00000200:23.0:1773851888.448858:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769914:8769914:1024:4294967295] 47@kfi7 LPNI seq info [5403024:5403024:16:4294967295]
00000400:00000200:23.0:1773851888.448859:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:23.0:1773851888.448860:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:23.0:1773851888.448862:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851888.448863:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000800:00000200:23.0:1773851888.448865:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851888.448866:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851888.448868:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851888.448870:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000800:00000200:23.0:1773851888.448873:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000800:00000200:23.0:1773851888.448875:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851888.448877:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851888.448877:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000db5f5b81 refcount 6 to 47@kfi7
00010000:00000001:23.0:1773851888.448878:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851888.448879:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851888.448880:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851888.448880:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005eea9d64 x1858041665833536/t0(0) o400->lustre5-MDT0001-lwp-OST0015_UUID@47@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba122-0'
00000100:00100000:23.0:1773851888.448883:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eea9d64 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0015_UUID+5:272692:x1858041665833536:12345-47@kfi7:400:default-yuba122-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851888.448885:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851888.448886:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-47@kfi7, seq: 1998046
00000100:00000040:23.0:1773851888.448886:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b323de80 : new rpc_count 0
00000400:00000200:21.0:1773851888.448886:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851888.448887:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851888.448887:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000100:00000001:23.0:1773851888.448888:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851888.448888:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851888.448888:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008506b019
00000400:00000010:21.0:1773851888.448888:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008506b019.
00000020:00000010:23.0:1773851888.448889:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000100:00000001:21.0:1773851888.448889:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851888.448889:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851888.448890:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a6c8ed98.
00000400:00000200:21.0:1773851888.448890:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000020:00000040:23.0:1773851888.448891:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000b323de80 : new refcount 4
00000800:00000200:21.0:1773851888.448891:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000027b Transaction freed
00000100:00000001:23.0:1773851888.448892:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851888.457730:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:9.0:1773851888.457731:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:5.0:1773851888.457731:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851888.457732:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:9.0:1773851888.457732:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000689bc844.
00000020:00000040:9.0:1773851888.457732:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000004:00000001:7.0:1773851888.457732:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851888.457732:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:31.0:1773851888.457733:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851888.457733:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851888.457733:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:9.0:1773851888.457733:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:7.0:1773851888.457733:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:5.0:1773851888.457733:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000472f885.
00000020:00000040:5.0:1773851888.457733:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
00000004:00000020:31.0:1773851888.457734:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851888.457734:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851888.457734:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fb9196ac.
02000000:00000001:9.0:1773851888.457734:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:9.0:1773851888.457734:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:7.0:1773851888.457734:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f71c1f0.
00000100:00000001:5.0:1773851888.457734:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:31.0:1773851888.457735:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d6a92c0.
00000100:00000010:30.0:1773851888.457735:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000074adcffb.
02000000:00000010:9.0:1773851888.457735:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
00000020:00000040:7.0:1773851888.457735:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000001:7.0:1773851888.457735:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:6.0:1773851888.457735:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
02000000:00000001:5.0:1773851888.457735:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:31.0:1773851888.457736:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000020:00000040:30.0:1773851888.457736:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000040:10.0:1773851888.457736:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000100:00000001:9.0:1773851888.457736:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:6.0:1773851888.457736:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:5.0:1773851888.457736:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851888.457737:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851888.457737:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851888.457737:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:9.0:1773851888.457737:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:7.0:1773851888.457737:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851888.457737:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:6.0:1773851888.457737:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ae5d597.
02000000:00000010:5.0:1773851888.457737:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ef164abb.
02000000:00000001:31.0:1773851888.457738:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:31.0:1773851888.457738:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851888.457738:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851888.457738:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:9.0:1773851888.457738:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851888.457738:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000de2ed169.
00000020:00000040:6.0:1773851888.457738:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000100:00000001:5.0:1773851888.457738:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851888.457739:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b789a785.
00000100:00000040:9.0:1773851888.457739:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000689bc844] to pc [ptlrpcd_02_02+2]  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851888.457739:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457739:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851888.457739:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851888.457739:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851888.457740:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851888.457740:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851888.457740:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457740:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851888.457740:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000040:5.0:1773851888.457740:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000472f885] to pc [ptlrpcd_01_02+2]  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851888.457741:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:7.0:1773851888.457741:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007f71c1f0] to pc [ptlrpcd_01_03+3]  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851888.457741:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:31.0:1773851888.457742:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851888.457742:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a8444578.
02000000:00000010:10.0:1773851888.457742:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006db6fddb.
02000000:00000001:6.0:1773851888.457742:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851888.457743:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000009d6a92c0] to pc [ptlrpcd_07_02+2]  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851888.457743:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.457744:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851888.457744:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000010:6.0:1773851888.457744:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569142ac.
00000100:00000001:30.0:1773851888.457745:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851888.457745:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000010:9.0:1773851888.457745:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000706fe3df.
00000100:00000001:8.0:1773851888.457745:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:7.0:1773851888.457745:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851888.457745:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:11.0:1773851888.457746:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851888.457746:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851888.457746:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636934421083136 : -107139288468480 : ffff9e8eb0c4f400)
00080000:00000001:9.0:1773851888.457746:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:8.0:1773851888.457746:0:41071:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000001:7.0:1773851888.457746:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851888.457746:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:5.0:1773851888.457746:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bd258f76.
00000100:00000001:4.0:1773851888.457746:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851888.457746:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851888.457747:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851888.457747:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851888.457747:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fb9196ac] to pc [ptlrpcd_02_03+3]  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851888.457747:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851888.457747:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851888.457747:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851888.457747:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637021733248000 : -107051976303616 : ffff9ea304fadc00)
00000100:00000001:4.0:1773851888.457747:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:31.0:1773851888.457748:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:9.0:1773851888.457748:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:9.0:1773851888.457748:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:8.0:1773851888.457748:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851888.457748:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851888.457748:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851888.457748:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:5.0:1773851888.457748:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:4.0:1773851888.457748:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:31.0:1773851888.457749:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000cadf7b2e.
00080000:00000001:31.0:1773851888.457749:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637126019577856 : -106947689973760 : ffff9ebb4cedf800)
00000100:00000040:30.0:1773851888.457749:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000074adcffb] to pc [ptlrpcd_07_03+3]  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851888.457749:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851888.457749:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851888.457749:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851888.457750:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851888.457750:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000010:9.0:1773851888.457750:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000025cd27ec.
00000004:00080000:9.0:1773851888.457750:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614162911026084ns, next at 614163911024752ns, rc = 0
00000100:00000001:8.0:1773851888.457750:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:7.0:1773851888.457750:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851888.457750:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851888.457750:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851888.457750:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000100:00000001:4.0:1773851888.457750:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851888.457751:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851888.457751:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:8.0:1773851888.457751:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851888.457751:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851888.457751:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005ae5d597] to pc [ptlrpcd_01_00+0]  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:5.0:1773851888.457751:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000005e76f10.
00000100:00000001:4.0:1773851888.457751:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851888.457752:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:9.0:1773851888.457752:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851888.457752:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851888.457752:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851888.457752:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614162911027417ns, next at 614163911026395ns, rc = 0
02000000:00000001:4.0:1773851888.457752:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851888.457752:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851888.457753:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:28.0:1773851888.457753:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851888.457753:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:9.0:1773851888.457753:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851888.457753:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051936704:2074@kfi7:41:default-yuba2-0
00080000:00000001:5.0:1773851888.457753:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:4.0:1773851888.457753:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000472f885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051936640:2061@kfi7:13:default-yuba2-0
00080000:00000001:31.0:1773851888.457754:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:31.0:1773851888.457754:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:8.0:1773851888.457754:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851888.457754:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457754:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:5.0:1773851888.457754:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851888.457754:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457754:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000010:31.0:1773851888.457755:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ba0f8e39.
00000004:00000001:30.0:1773851888.457755:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:10.0:1773851888.457755:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000086e8148e.
02000000:00000001:8.0:1773851888.457755:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851888.457755:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851888.457755:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851888.457755:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851888.457755:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:31.0:1773851888.457756:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614162911031494ns, next at 614163911030362ns, rc = 0
00000100:00000001:11.0:1773851888.457756:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:10.0:1773851888.457756:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130399912960 : -106943309638656 : ffff9ebc52049400)
02000000:00000001:8.0:1773851888.457756:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851888.457756:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:4.0:1773851888.457756:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:31.0:1773851888.457757:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:11.0:1773851888.457757:0:41070:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [3->2]
00000100:00100000:8.0:1773851888.457757:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000689bc844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051936576:2060@kfi7:13:default-yuba2-0
02000000:00000010:7.0:1773851888.457757:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006b18bdd4.
02000000:00000010:4.0:1773851888.457757:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f3d94c91.
00080000:00000001:31.0:1773851888.457758:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851888.457758:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.457758:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851888.457758:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851888.457758:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851888.457758:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:10.0:1773851888.457758:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:8.0:1773851888.457758:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851888.457758:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851888.457758:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.457759:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:28.0:1773851888.457759:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851888.457759:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:7.0:1773851888.457759:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000010:7.0:1773851888.457759:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000100:00000001:5.0:1773851888.457759:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851888.457759:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:29.0:1773851888.457760:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851888.457760:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:10.0:1773851888.457760:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851888.457760:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851888.457760:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:7.0:1773851888.457760:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000004:00000001:6.0:1773851888.457760:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851888.457760:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:4.0:1773851888.457760:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000010:4.0:1773851888.457760:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
02000000:00000001:28.0:1773851888.457761:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:11.0:1773851888.457761:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:8.0:1773851888.457761:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008f1b9b08.
00000100:00000040:5.0:1773851888.457761:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851888.457761:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000970b84f9.
02000000:00000001:28.0:1773851888.457762:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851888.457762:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851888.457762:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00001000:10.0:1773851888.457762:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
02000000:00000001:8.0:1773851888.457762:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851888.457762:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936704, portal 4
00000100:00000001:7.0:1773851888.457762:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:4.0:1773851888.457762:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936640, portal 4
00000100:00000001:29.0:1773851888.457763:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851888.457763:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:10.0:1773851888.457763:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006de6b1a8.
00000400:00000200:8.0:1773851888.457763:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000010:8.0:1773851888.457763:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000001:7.0:1773851888.457763:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309147776 : -106994400403840 : ffff9eb06cc55e80)
00000100:00000001:5.0:1773851888.457763:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851888.457763:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851888.457763:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637135108945408 : -106938600606208 : ffff9ebd6ab2b600)
00000100:00000001:29.0:1773851888.457764:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851888.457764:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051936768:60@kfi7:13:default-yuba2-0
00000400:00000010:8.0:1773851888.457764:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000017f9c5c1.
00000100:00000040:7.0:1773851888.457764:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851888.457764:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851888.457764:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851888.457765:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851888.457765:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851888.457765:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:10.0:1773851888.457765:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614162911040020ns, next at 614163911038107ns, rc = 0
02000000:00000001:5.0:1773851888.457765:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:29.0:1773851888.457766:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074adcffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051936896:13@kfi7:41:default-yuba2-0
00000100:00000001:28.0:1773851888.457766:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:10.0:1773851888.457766:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000200:8.0:1773851888.457766:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936576, portal 4
00000100:00000001:8.0:1773851888.457766:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:5.0:1773851888.457766:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851888.457767:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:8.0:1773851888.457767:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637158856910720 : -106914852640896 : ffff9ec2f22fe780)
00000100:00000001:7.0:1773851888.457767:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851888.457767:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:5.0:1773851888.457767:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ae5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051936960:36@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851888.457767:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:29.0:1773851888.457768:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851888.457768:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851888.457768:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851888.457768:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851888.457768:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851888.457768:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:4.0:1773851888.457768:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:4.0:1773851888.457768:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cb2a5541.
02000000:00000001:29.0:1773851888.457769:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851888.457769:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851888.457769:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:28.0:1773851888.457769:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:11.0:1773851888.457769:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:10.0:1773851888.457769:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851888.457769:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851888.457769:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851888.457769:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936640, offset 0
02000000:00000010:29.0:1773851888.457770:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000007871486c.
00000100:00000001:11.0:1773851888.457770:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.457770:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851888.457770:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:7.0:1773851888.457770:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
02000000:00000001:5.0:1773851888.457770:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851888.457771:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851888.457771:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a72a513e.
00000100:00000040:8.0:1773851888.457771:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
02000000:00000010:5.0:1773851888.457771:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000cb154169.
00000400:00000200:4.0:1773851888.457771:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:29.0:1773851888.457772:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
02000000:00000001:28.0:1773851888.457772:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851888.457772:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:8.0:1773851888.457772:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000516de938.
00000100:00000200:7.0:1773851888.457772:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051936704, offset 0
02000000:00000001:5.0:1773851888.457772:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851888.457772:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000010:29.0:1773851888.457773:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000843b5aa4.
02000000:00000001:11.0:1773851888.457773:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851888.457773:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936576, offset 0
00000400:00000200:7.0:1773851888.457773:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000010:29.0:1773851888.457774:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ecffec9b.
00000400:00000200:28.0:1773851888.457774:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00100000:11.0:1773851888.457774:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb9196ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051936832:37@kfi7:13:default-yuba2-0
00000400:00000200:8.0:1773851888.457774:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000200:4.0:1773851888.457774:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000100:00000200:29.0:1773851888.457775:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936896, portal 4
00000400:00000010:28.0:1773851888.457775:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000200:8.0:1773851888.457775:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:4.0:1773851888.457775:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:29.0:1773851888.457776:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851888.457776:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411241088 : -106960298310528 : ffff9eb85d6a0480)
00000400:00000010:28.0:1773851888.457776:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f52a267c.
00000100:00000001:11.0:1773851888.457776:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:8.0:1773851888.457776:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:4.0:1773851888.457776:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:4.0:1773851888.457777:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000100:00000040:29.0:1773851888.457778:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:28.0:1773851888.457778:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936768, portal 4
02000000:00000001:11.0:1773851888.457778:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851888.457778:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851888.457778:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:28.0:1773851888.457779:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:8.0:1773851888.457779:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:4.0:1773851888.457779:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769911, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769914, p:4294967295, g:4294967295, h:1000]
00000100:00000001:28.0:1773851888.457780:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999063552 : -107038710488064 : ffff9ea61baf2400)
02000000:00000001:11.0:1773851888.457780:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:8.0:1773851888.457780:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000100:00000001:29.0:1773851888.457781:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851888.457781:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000040:29.0:1773851888.457782:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:29.0:1773851888.457782:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089b548b8.
00000100:00000040:28.0:1773851888.457782:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:11.0:1773851888.457782:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000004dd1490.
00000400:00000200:8.0:1773851888.457782:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769911, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769914, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851888.457782:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000200:29.0:1773851888.457783:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051936896, offset 0
02000000:00000001:11.0:1773851888.457783:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851888.457783:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000400:00000200:8.0:1773851888.457784:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851888.457784:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769915:8769915:1024:4294967295] 2061@kfi7 LPNI seq info [5403464:5403464:16:4294967295]
00000400:00000200:29.0:1773851888.457785:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:8.0:1773851888.457785:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851888.457785:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:29.0:1773851888.457786:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:8.0:1773851888.457786:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000400:00000200:29.0:1773851888.457787:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000001:28.0:1773851888.457787:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851888.457787:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769916:8769916:1024:4294967295] 2060@kfi7 LPNI seq info [5404998:5404998:16:4294967295]
00000400:00000200:5.0:1773851888.457787:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:4.0:1773851888.457787:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851888.457788:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000040:28.0:1773851888.457788:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000400:00000200:7.0:1773851888.457788:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000010:5.0:1773851888.457788:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000573cf79c.
00000400:00000200:29.0:1773851888.457789:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000010:28.0:1773851888.457789:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000048f1f202.
00000400:00000200:8.0:1773851888.457789:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:8.0:1773851888.457789:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:7.0:1773851888.457789:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000010:5.0:1773851888.457789:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000690e571.
00000400:00000200:29.0:1773851888.457790:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000100:00000200:28.0:1773851888.457790:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936768, offset 0
00000400:00000200:7.0:1773851888.457790:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000200:5.0:1773851888.457790:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936960, portal 4
00000400:00000200:11.0:1773851888.457791:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:8.0:1773851888.457791:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000100:00000001:5.0:1773851888.457791:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:29.0:1773851888.457792:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769915, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769916, p:4294967295, g:4294967295, h:1000]
00000400:00000010:11.0:1773851888.457792:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000400:00000200:7.0:1773851888.457792:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000100:00000001:5.0:1773851888.457792:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814073856 : -107101895477760 : ffff9e976590b600)
00000400:00000200:28.0:1773851888.457793:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:8.0:1773851888.457793:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:7.0:1773851888.457793:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000100:00000040:5.0:1773851888.457793:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851888.457794:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000010:11.0:1773851888.457794:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2b33615.
00000400:00000200:29.0:1773851888.457795:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851888.457795:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:7.0:1773851888.457795:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769915, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769916, p:4294967295, g:4294967295, h:1000]
00000100:00000001:5.0:1773851888.457795:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:29.0:1773851888.457796:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000200:11.0:1773851888.457796:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051936832, portal 4
00000800:00000200:8.0:1773851888.457796:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851888.457796:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851888.457797:0:41091:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133323, 23133321]
00000400:00000200:7.0:1773851888.457797:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000100:00000040:5.0:1773851888.457797:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000010:5.0:1773851888.457797:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
00000100:00000001:11.0:1773851888.457798:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851888.457798:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087762176 : -106944621789440 : ffff9ebc03cebf00)
00000400:00000200:7.0:1773851888.457798:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000200:5.0:1773851888.457798:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936960, offset 0
00000400:00000200:29.0:1773851888.457799:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000800:00000200:8.0:1773851888.457799:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851888.457799:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425174, 23425173]
00000400:00000200:5.0:1773851888.457799:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:29.0:1773851888.457800:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769917:8769917:1024:4294967295] 13@kfi7 LPNI seq info [23133324:23133324:16:4294967295]
00000100:00000040:11.0:1773851888.457801:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:8.0:1773851888.457801:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Using peer 2060@kfi7(0x2000000000001c1)
00000400:00000200:7.0:1773851888.457801:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000400:00000200:29.0:1773851888.457802:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:7.0:1773851888.457802:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769918:8769918:1024:4294967295] 2081@kfi7 LPNI seq info [23425175:23425175:16:4294967295]
00000400:00000200:29.0:1773851888.457803:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000800:00000200:8.0:1773851888.457804:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x2000000000001c1: rc=0
00000400:00000200:7.0:1773851888.457804:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000100:00000001:11.0:1773851888.457805:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851888.457805:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000040:11.0:1773851888.457806:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000800:00000200:8.0:1773851888.457806:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851888.457806:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:5.0:1773851888.457806:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000010:11.0:1773851888.457807:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1dd5303.
00000400:00000200:5.0:1773851888.457807:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:29.0:1773851888.457808:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000100:00000200:11.0:1773851888.457808:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051936832, offset 0
00000100:00000001:8.0:1773851888.457808:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851888.457808:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851888.457809:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851888.457809:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851888.457809:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:4.0:1773851888.457809:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:29.0:1773851888.457810:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000100:00000001:8.0:1773851888.457810:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.457810:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851888.457810:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000400:00000200:28.0:1773851888.457811:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:11.0:1773851888.457811:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000400:00000200:5.0:1773851888.457811:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769918, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769916, p:4294967295, g:4294967295, h:1000]
00000800:00000200:4.0:1773851888.457811:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:29.0:1773851888.457812:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851888.457812:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:11.0:1773851888.457812:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:4.0:1773851888.457812:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:29.0:1773851888.457813:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851888.457813:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851888.457813:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:7.0:1773851888.457813:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851888.457813:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851888.457814:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851888.457814:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:7.0:1773851888.457814:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:5.0:1773851888.457814:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851888.457814:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000800:00000200:4.0:1773851888.457814:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851888.457815:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:5.0:1773851888.457815:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769919:8769919:1023:4294967295] 36@kfi7 LPNI seq info [5403971:5403971:16:4294967295]
00000800:00000200:29.0:1773851888.457816:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851888.457816:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000800:00000200:7.0:1773851888.457816:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851888.457816:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:7.0:1773851888.457817:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851888.457817:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:4.0:1773851888.457817:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000400:00000200:28.0:1773851888.457818:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:11.0:1773851888.457818:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:8.0:1773851888.457818:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851888.457819:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:9.0:1773851888.457819:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851888.457819:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851888.457819:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:11.0:1773851888.457820:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000400:00000200:9.0:1773851888.457820:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851888.457820:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000800:00000200:4.0:1773851888.457820:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x19b: rc=0
00000400:00000200:28.0:1773851888.457821:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8769918, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769919, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851888.457821:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:4.0:1773851888.457821:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851888.457822:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000400:00000200:9.0:1773851888.457822:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000516de938
00000800:00000200:7.0:1773851888.457822:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Using peer 2081@kfi7(0x270)
00000800:00000200:29.0:1773851888.457823:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x102: rc=0
00000400:00000200:11.0:1773851888.457823:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8769918, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769919, p:4294967295, g:4294967295, h:1000]
00000400:00000010:9.0:1773851888.457823:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000516de938.
00000800:00000200:5.0:1773851888.457823:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:4.0:1773851888.457823:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457823:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:5.0:1773851888.457824:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:4.0:1773851888.457824:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851888.457825:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851888.457825:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:7.0:1773851888.457825:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x270: rc=0
00000100:00000001:4.0:1773851888.457825:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851888.457826:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:7.0:1773851888.457826:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:5.0:1773851888.457826:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:29.0:1773851888.457827:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851888.457827:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:4.0:1773851888.457827:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851888.457828:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851888.457828:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851888.457828:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:11.0:1773851888.457828:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:4.0:1773851888.457828:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851888.457829:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.457829:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:5.0:1773851888.457829:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000100:00000001:4.0:1773851888.457829:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851888.457830:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851888.457830:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769920:8769920:1022:4294967295] 60@kfi7 LPNI seq info [5404312:5404312:16:4294967295]
00000400:00000200:11.0:1773851888.457830:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000100:00000200:9.0:1773851888.457830:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851888.457830:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457830:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851888.457830:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851888.457830:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851888.457831:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851888.457831:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:11.0:1773851888.457831:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769921:8769921:1022:4294967295] 37@kfi7 LPNI seq info [5403398:5403398:16:4294967295]
00000100:00000001:7.0:1773851888.457831:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.457832:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851888.457832:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851888.457832:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851888.457832:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000100:00000001:29.0:1773851888.457833:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851888.457833:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851888.457833:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851888.457833:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851888.457834:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851888.457834:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:7.0:1773851888.457834:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851888.457834:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:5.0:1773851888.457834:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:28.0:1773851888.457835:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851888.457835:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:9.0:1773851888.457835:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.457835:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:7.0:1773851888.457835:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851888.457835:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851888.457835:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457836:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851888.457836:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851888.457836:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851888.457837:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:9.0:1773851888.457837:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:7.0:1773851888.457837:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851888.457837:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851888.457837:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457837:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851888.457838:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851888.457838:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851888.457839:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Transaction freed
00000100:00000001:5.0:1773851888.457839:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851888.457839:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851888.457840:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851888.457840:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851888.457840:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851888.457841:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851888.457841:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851888.457841:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851888.457842:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:28.0:1773851888.457843:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851888.457843:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851888.457843:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000400:00000200:6.0:1773851888.457843:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000400:00000200:7.0:1773851888.457844:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000400:00000200:11.0:1773851888.457845:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000010:7.0:1773851888.457845:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000100:00000001:7.0:1773851888.457845:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:28.0:1773851888.457846:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000200:7.0:1773851888.457846:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851888.457846:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cb2a5541
00000400:00000010:6.0:1773851888.457846:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cb2a5541.
00000100:00000001:6.0:1773851888.457847:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:11.0:1773851888.457848:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:7.0:1773851888.457849:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:6.0:1773851888.457849:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:11.0:1773851888.457850:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:7.0:1773851888.457850:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851888.457851:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851888.457852:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851888.457853:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457853:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851888.457854:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 TN_EVENT_TX_OK event status 0
00000800:00000200:11.0:1773851888.457854:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851888.457854:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:6.0:1773851888.457854:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851888.457854:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:5.0:1773851888.457854:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00000800:00000200:28.0:1773851888.457855:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000040:6.0:1773851888.457855:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:5.0:1773851888.457855:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
00000100:00000001:5.0:1773851888.457855:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851888.457856:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:5.0:1773851888.457856:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851888.457857:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000800:00000200:7.0:1773851888.457857:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Transaction freed
00000400:00000200:29.0:1773851888.457858:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089b548b8
00000800:00000200:28.0:1773851888.457858:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851888.457858:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Using peer 37@kfi7(0x2000000000001a4)
00000100:00000001:5.0:1773851888.457858:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:29.0:1773851888.457859:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089b548b8.
00000100:00000001:6.0:1773851888.457859:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851888.457859:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851888.457860:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:6.0:1773851888.457860:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:29.0:1773851888.457861:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851888.457861:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851888.457861:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851888.457862:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:5.0:1773851888.457862:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:29.0:1773851888.457863:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:28.0:1773851888.457863:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851888.457863:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x2000000000001a4: rc=0
00000100:00000040:29.0:1773851888.457864:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:18.0:1773851888.457864:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:6.0:1773851888.457864:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000800:00000200:5.0:1773851888.457864:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:18.0:1773851888.457865:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851888.457866:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851888.457867:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851888.457867:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:29.0:1773851888.457868:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:28.0:1773851888.457868:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Using peer 60@kfi7(0x2000000000001dc)
00000400:00000200:29.0:1773851888.457869:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:18.0:1773851888.457869:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:11.0:1773851888.457869:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851888.457870:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851888.457871:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 7 tta 0x102 Transaction freed
00000400:00000200:18.0:1773851888.457871:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:11.0:1773851888.457871:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851888.457872:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2060@kfi7 : PUT - for me
00000100:00000001:11.0:1773851888.457872:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851888.457873:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:18.0:1773851888.457874:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000100:00000001:11.0:1773851888.457874:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851888.457875:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:21.0:1773851888.457876:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:18.0:1773851888.457876:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:21.0:1773851888.457877:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:18.0:1773851888.457877:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:19.0:1773851888.457878:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:18.0:1773851888.457878:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:31.0:1773851888.457879:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:19.0:1773851888.457879:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:18.0:1773851888.457879:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5740
00000800:00000200:9.0:1773851888.457879:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 TN_EVENT_TX_OK event status 0
00000800:00000200:31.0:1773851888.457880:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:28.0:1773851888.457880:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x2000000000001dc: rc=0
00000800:00000200:21.0:1773851888.457880:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851888.457880:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:19.0:1773851888.457881:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851888.457881:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:31.0:1773851888.457882:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:28.0:1773851888.457882:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851888.457882:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f1dd1 [1] + 224
00000400:00000200:9.0:1773851888.457882:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000400:00000200:9.0:1773851888.457882:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1dd5303
00000800:00000200:19.0:1773851888.457883:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000010:9.0:1773851888.457883:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1dd5303.
00000800:00000200:31.0:1773851888.457884:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851888.457884:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:9.0:1773851888.457884:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:19.0:1773851888.457885:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:18.0:1773851888.457885:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:9.0:1773851888.457885:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851888.457886:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:19.0:1773851888.457886:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000400:00000200:31.0:1773851888.457887:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:28.0:1773851888.457887:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:21.0:1773851888.457887:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:19.0:1773851888.457887:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:18.0:1773851888.457887:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851888.457888:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:18.0:1773851888.457888:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000400:00000200:31.0:1773851888.457889:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000400:00000200:21.0:1773851888.457889:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:19.0:1773851888.457889:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:18.0:1773851888.457889:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:31.0:1773851888.457890:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:28.0:1773851888.457890:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:19.0:1773851888.457890:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000200:18.0:1773851888.457890:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851888.457890:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:31.0:1773851888.457891:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:21.0:1773851888.457891:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:19.0:1773851888.457891:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000040:9.0:1773851888.457891:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851888.457892:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851888.457892:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:31.0:1773851888.457893:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:28.0:1773851888.457893:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851888.457893:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:9.0:1773851888.457893:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851888.457894:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:21.0:1773851888.457894:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:19.0:1773851888.457894:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b58c0
00000100:00000040:18.0:1773851888.457894:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851888.457894:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:31.0:1773851888.457895:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:28.0:1773851888.457895:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851888.457895:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:19.0:1773851888.457895:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:21.0:1773851888.457896:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:19.0:1773851888.457896:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f1df1 [1] + 224
00000100:00000001:28.0:1773851888.457897:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:21.0:1773851888.457897:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:9.0:1773851888.457897:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:28.0:1773851888.457898:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:18.0:1773851888.457898:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:31.0:1773851888.457899:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:21.0:1773851888.457899:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:19.0:1773851888.457899:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851888.457899:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:9.0:1773851888.457899:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001a4 Transaction freed
00000400:00000200:31.0:1773851888.457900:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5780
00000400:00000200:19.0:1773851888.457900:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851888.457900:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851888.457901:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:21.0:1773851888.457901:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b57c0
00000800:00000200:18.0:1773851888.457901:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851888.457901:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:19.0:1773851888.457902:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000001:8.0:1773851888.457902:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851888.457902:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:31.0:1773851888.457903:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x78008185d [1] + 224
00000100:00000001:28.0:1773851888.457903:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851888.457903:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000010:8.0:1773851888.457903:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000800:00000200:29.0:1773851888.457904:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_EVENT_TX_OK event status 0
00000400:00000200:8.0:1773851888.457904:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000017f9c5c1
00000100:00000001:28.0:1773851888.457905:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851888.457905:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000017f9c5c1.
00000100:00000001:8.0:1773851888.457905:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:31.0:1773851888.457906:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851888.457906:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851888.457906:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78008183d [1] + 224
00000100:00000001:19.0:1773851888.457906:0:2464491:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:31.0:1773851888.457907:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851888.457907:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000100:00000200:19.0:1773851888.457907:0:2464491:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851888.457907:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851888.457908:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000048f1f202
00000400:00000200:31.0:1773851888.457909:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000400:00000010:29.0:1773851888.457909:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000048f1f202.
00000100:00000001:29.0:1773851888.457909:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:21.0:1773851888.457909:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:8.0:1773851888.457909:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851888.457910:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851888.457910:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851888.457911:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851888.457911:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:19.0:1773851888.457911:0:2464491:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851888.457912:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851888.457912:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851888.457913:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:21.0:1773851888.457913:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000001:8.0:1773851888.457913:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851888.457913:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:29.0:1773851888.457914:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:19.0:1773851888.457914:0:2464491:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851888.457914:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:21.0:1773851888.457915:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:19.0:1773851888.457915:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:8.0:1773851888.457915:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851888.457915:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.457916:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:21.0:1773851888.457916:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851888.457916:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=121 v=66 (66 66 66 66)
00000100:00000040:31.0:1773851888.457917:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851888.457917:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851888.457917:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:19.0:1773851888.457917:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000024734d67: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00001000:8.0:1773851888.457917:0:41071:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=121 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851888.457917:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851888.457917:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851888.457918:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000001:5.0:1773851888.457918:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:29.0:1773851888.457919:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Transaction freed
00000100:00000001:8.0:1773851888.457919:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851888.457919:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851888.457919:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:5.0:1773851888.457919:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851888.457920:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000010:5.0:1773851888.457920:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000573cf79c.
00000400:00000200:5.0:1773851888.457920:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000690e571
00000100:00000001:31.0:1773851888.457921:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:21.0:1773851888.457921:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851888.457921:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000001:8.0:1773851888.457921:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:5.0:1773851888.457921:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000690e571.
00000100:00000001:5.0:1773851888.457921:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:31.0:1773851888.457922:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:8.0:1773851888.457922:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851888.457922:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851888.457923:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000040:8.0:1773851888.457923:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851888.457923:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851888.457923:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:31.0:1773851888.457924:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:30.0:1773851888.457924:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:8.0:1773851888.457925:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000001:4.0:1773851888.457925:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851888.457925:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851888.457926:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851888.457926:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:4.0:1773851888.457926:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000800:00000200:30.0:1773851888.457927:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:21.0:1773851888.457927:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:8.0:1773851888.457927:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:4.0:1773851888.457927:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000970b84f9
00000400:00000010:4.0:1773851888.457927:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000970b84f9.
00000004:00000040:8.0:1773851888.457928:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000100:00000001:4.0:1773851888.457928:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851888.457929:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000004:00000040:8.0:1773851888.457929:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504315392 avail=351502164992 avail_mb=1373055332 hwm_mb=3131103 files=372056140 ffree=343265933 state=0: rc = 0
00000100:00000001:7.0:1773851888.457929:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851888.457929:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:5.0:1773851888.457929:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851888.457929:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:7.0:1773851888.457930:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851888.457930:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:21.0:1773851888.457931:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000004:00000020:8.0:1773851888.457931:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504315392 free, 351502164992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056140 files, 343265933 free files
00000400:00000010:7.0:1773851888.457931:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000100:00000001:5.0:1773851888.457931:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:30.0:1773851888.457932:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000004:00000001:8.0:1773851888.457932:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851888.457932:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000100:00000001:5.0:1773851888.457932:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851888.457932:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:4.0:1773851888.457932:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851888.457933:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:7.0:1773851888.457933:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:7.0:1773851888.457933:0:41067:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:5.0:1773851888.457933:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851888.457933:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851888.457934:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457934:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:21.0:1773851888.457935:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000100:00000200:7.0:1773851888.457935:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:5.0:1773851888.457935:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457935:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:8.0:1773851888.457936:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000689bc844 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051936576:2060@kfi7:13:default-yuba2-0
00000100:00001000:5.0:1773851888.457936:0:41064:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=121 v=66 (66 66 66 66)
00000100:00000001:4.0:1773851888.457936:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851888.457936:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851888.457936:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851888.457937:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00001000:5.0:1773851888.457937:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=121 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851888.457937:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851888.457937:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851888.457938:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851888.457938:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851888.457938:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:7.0:1773851888.457938:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851888.457938:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851888.457938:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851888.457938:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=121 v=66 (66 66 66 66)
00000400:00000200:30.0:1773851888.457939:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:22.0:1773851888.457939:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000040:8.0:1773851888.457939:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000689bc844 x1859433051936576/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:5.0:1773851888.457939:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851888.457939:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851888.457939:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=121 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851888.457940:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851888.457940:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851888.457940:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:4.0:1773851888.457940:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851888.457940:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851888.457941:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 37@kfi7 : PUT - for me
00000800:00000200:22.0:1773851888.457941:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:7.0:1773851888.457941:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851888.457941:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851888.457941:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:5.0:1773851888.457941:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:5.0:1773851888.457941:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851888.457941:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851888.457941:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851888.457941:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851888.457942:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:8.0:1773851888.457942:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851888.457942:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851888.457942:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851888.457942:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851888.457942:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851888.457942:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:30.0:1773851888.457943:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
02000000:00000010:8.0:1773851888.457943:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008f1b9b08.
00000100:00001000:7.0:1773851888.457943:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=121 v=66 (66 66 66 66)
00000100:00000040:4.0:1773851888.457943:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:4.0:1773851888.457943:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:30.0:1773851888.457944:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000800:00000200:22.0:1773851888.457944:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:8.0:1773851888.457944:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851888.457944:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000100:00001000:7.0:1773851888.457944:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=121 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851888.457944:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851888.457945:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000020:00000040:8.0:1773851888.457945:0:41071:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000100:00000001:7.0:1773851888.457945:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851888.457945:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851888.457945:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:4.0:1773851888.457945:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:30.0:1773851888.457946:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000020:00000001:8.0:1773851888.457946:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851888.457946:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000100:00000001:7.0:1773851888.457946:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851888.457946:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:5.0:1773851888.457946:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851888.457947:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
02000000:00000001:8.0:1773851888.457947:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851888.457947:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00010000:00000001:7.0:1773851888.457947:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457947:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000001:5.0:1773851888.457947:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851888.457947:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000100:00000001:4.0:1773851888.457947:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851888.457948:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000800:00000200:22.0:1773851888.457948:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851888.457948:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000010:8.0:1773851888.457948:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000689bc844.
00000100:00000040:7.0:1773851888.457948:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00000001:7.0:1773851888.457948:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000040:5.0:1773851888.457948:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500128256 avail=351498081280 avail_mb=1373039380 hwm_mb=3131103 files=372097679 ffree=343261844 state=0: rc = 0
00000400:00000200:30.0:1773851888.457949:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:8.0:1773851888.457949:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851888.457949:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851888.457949:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457949:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851888.457949:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851888.457949:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:21.0:1773851888.457950:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000001:8.0:1773851888.457950:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851888.457950:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:5.0:1773851888.457950:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500128256 free, 351498081280 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097679 files, 343261844 free files
00000004:00000040:4.0:1773851888.457950:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000400:00000200:30.0:1773851888.457951:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:21.0:1773851888.457951:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:8.0:1773851888.457951:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851888.457951:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851888.457951:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851888.457951:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399725568 free=351492705280 avail=351490295808 avail_mb=1373008968 hwm_mb=3131103 files=372077961 ffree=343254595 state=0: rc = 0
00000400:00000200:21.0:1773851888.457952:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:8.0:1773851888.457952:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851888.457952:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.457952:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:5.0:1773851888.457952:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:4.0:1773851888.457952:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399725568 blocks, 351492705280 free, 351490295808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372077961 files, 343254595 free files
00000400:00000200:30.0:1773851888.457953:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5840
00000100:00000001:7.0:1773851888.457953:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851888.457953:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851888.457954:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000004:00000001:7.0:1773851888.457954:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:7.0:1773851888.457954:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223648 blocks, 31250857024 free, 31250820608 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121376 files, 2868731015 free files
00000004:00000001:4.0:1773851888.457954:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851888.457955:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000040:4.0:1773851888.457955:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:22.0:1773851888.457956:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000004:00000001:7.0:1773851888.457956:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851888.457957:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000040:7.0:1773851888.457957:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:30.0:1773851888.457958:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x7800818bd [1] + 224
00000400:00000200:22.0:1773851888.457958:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 60@kfi7 : PUT - for me
00000100:00100000:5.0:1773851888.457958:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ae5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051936960:36@kfi7:13:default-yuba2-0
00000100:00100000:4.0:1773851888.457958:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000472f885 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051936640:2061@kfi7:13:default-yuba2-0
00000400:00000200:21.0:1773851888.457959:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5880
00000100:00000001:5.0:1773851888.457959:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851888.457959:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:22.0:1773851888.457960:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:5.0:1773851888.457960:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851888.457960:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:22.0:1773851888.457961:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000100:00000040:5.0:1773851888.457961:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005ae5d597 x1859433051936960/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:4.0:1773851888.457961:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000472f885 x1859433051936640/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:30.0:1773851888.457962:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00100000:7.0:1773851888.457962:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051936704:2074@kfi7:41:default-yuba2-0
00000400:00000200:22.0:1773851888.457963:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:5.0:1773851888.457963:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851888.457963:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:4.0:1773851888.457963:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851888.457963:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:22.0:1773851888.457964:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:7.0:1773851888.457964:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851888.457964:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:5.0:1773851888.457964:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000cb154169.
02000000:00000010:4.0:1773851888.457964:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f3d94c91.
00000400:00000200:30.0:1773851888.457965:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851888.457965:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000100:00000040:7.0:1773851888.457965:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007f71c1f0 x1859433051936704/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:5.0:1773851888.457965:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:4.0:1773851888.457965:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851888.457966:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851888.457966:0:41064:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000020:00000001:4.0:1773851888.457966:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851888.457966:0:41066:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000400:00000200:30.0:1773851888.457967:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->37@kfi7: PUT: OK
00000400:00000200:21.0:1773851888.457967:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000020:00000001:5.0:1773851888.457967:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851888.457967:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569142ac.
00000020:00000001:4.0:1773851888.457967:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851888.457967:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ef164abb.
00000400:00000200:22.0:1773851888.457968:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:7.0:1773851888.457968:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851888.457968:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851888.457968:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006b18bdd4.
02000000:00000001:5.0:1773851888.457968:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851888.457968:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:4.0:1773851888.457968:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851888.457968:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:30.0:1773851888.457969:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851888.457969:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d18f5 [1] + 224
00000100:00000010:5.0:1773851888.457969:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005ae5d597.
00000100:00000010:4.0:1773851888.457969:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000472f885.
00000400:00000200:22.0:1773851888.457970:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5800
02000000:00000001:7.0:1773851888.457970:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851888.457970:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851888.457970:0:41067:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000001:5.0:1773851888.457970:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851888.457970:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851888.457970:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851888.457970:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:30.0:1773851888.457971:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:22.0:1773851888.457971:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000020:00000001:7.0:1773851888.457971:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851888.457971:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000de2ed169.
00000100:00000001:5.0:1773851888.457971:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851888.457971:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851888.457971:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851888.457971:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:21.0:1773851888.457972:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:7.0:1773851888.457972:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:5.0:1773851888.457972:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851888.457972:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851888.457972:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457972:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:22.0:1773851888.457973:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d1915 [1] + 224
02000000:00000001:7.0:1773851888.457973:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851888.457973:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f71c1f0.
00000100:00000001:5.0:1773851888.457973:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.457973:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851888.457974:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851888.457974:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851888.457974:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851888.457974:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851888.457975:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851888.457975:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851888.457976:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851888.457976:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000100:00000001:7.0:1773851888.457976:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851888.457976:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851888.457977:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:21.0:1773851888.457977:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851888.457979:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:22.0:1773851888.457980:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851888.457983:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:22.0:1773851888.457983:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000100:00000040:21.0:1773851888.457983:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:22.0:1773851888.457984:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851888.457985:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000200:22.0:1773851888.457986:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851888.457986:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:30.0:1773851888.457987:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 37@kfi7(000000008b15eeb6):0x0 lsk 421 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851888.457987:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:21.0:1773851888.457989:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:11.0:1773851888.457989:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851888.457989:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851888.457990:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:21.0:1773851888.457990:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:29.0:1773851888.457991:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:22.0:1773851888.457991:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:11.0:1773851888.457991:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000001:29.0:1773851888.457992:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851888.457992:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:21.0:1773851888.457992:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:11.0:1773851888.457992:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2b33615
00000400:00000010:29.0:1773851888.457993:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000843b5aa4.
00000400:00000010:11.0:1773851888.457993:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2b33615.
00000400:00000200:29.0:1773851888.457994:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ecffec9b
00000100:00000001:11.0:1773851888.457994:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:29.0:1773851888.457995:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ecffec9b.
00000100:00000200:11.0:1773851888.457995:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851888.457996:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851888.457997:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:22.0:1773851888.457997:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:22.0:1773851888.457999:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000200:29.0:1773851888.458000:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851888.458000:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851888.458001:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:11.0:1773851888.458001:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851888.458002:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:28.0:1773851888.458002:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:22.0:1773851888.458002:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851888.458003:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:28.0:1773851888.458003:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851888.458004:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851888.458004:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:28.0:1773851888.458004:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000001:29.0:1773851888.458005:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851888.458005:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851888.458005:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f52a267c
00000100:00000001:11.0:1773851888.458005:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:29.0:1773851888.458006:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:28.0:1773851888.458006:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f52a267c.
00000100:00000001:11.0:1773851888.458006:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:29.0:1773851888.458007:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=121 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851888.458007:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851888.458007:0:41070:0:(client.c:1428:after_reply()) Process entered
00000100:00001000:29.0:1773851888.458008:0:41091:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=121 v=66 (1 1 1 1)
02000000:00000001:11.0:1773851888.458008:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851888.458009:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:28.0:1773851888.458009:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851888.458009:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851888.458009:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.458010:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851888.458011:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:29.0:1773851888.458011:0:41091:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851888.458011:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.458012:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00001000:11.0:1773851888.458012:0:41070:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=121 v=66 (66 66 66 66)
00000100:00000040:29.0:1773851888.458013:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000100:00000001:29.0:1773851888.458013:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851888.458014:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851888.458014:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:11.0:1773851888.458014:0:41070:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=121 v=66 (1 1 1 1)
00000100:00000040:29.0:1773851888.458015:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851888.458016:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851888.458017:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851888.458018:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851888.458018:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.458019:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:29.0:1773851888.458019:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851888.458019:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:11.0:1773851888.458019:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:29.0:1773851888.458020:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097088 blocks, 31192442880 free, 31192392640 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238663 files, 2962368232 free files
00000100:00000001:28.0:1773851888.458020:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:11.0:1773851888.458020:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851888.458021:0:41090:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:11.0:1773851888.458021:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000001:29.0:1773851888.458022:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851888.458022:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:11.0:1773851888.458022:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000040:29.0:1773851888.458023:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851888.458023:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851888.458023:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851888.458023:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851888.458024:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851888.458025:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851888.458025:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:29.0:1773851888.458026:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074adcffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051936896:13@kfi7:41:default-yuba2-0
00000100:00000001:29.0:1773851888.458027:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:28.0:1773851888.458027:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=121 v=66 (66 66 66 66)
00000100:00000001:29.0:1773851888.458028:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851888.458029:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000074adcffb x1859433051936896/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:28.0:1773851888.458029:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=121 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851888.458030:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851888.458031:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:28.0:1773851888.458031:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851888.458031:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:29.0:1773851888.458032:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:28.0:1773851888.458032:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851888.458032:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:29.0:1773851888.458033:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000007871486c.
00010000:00000001:28.0:1773851888.458033:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000001:11.0:1773851888.458033:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:29.0:1773851888.458034:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851888.458034:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00010000:00000001:28.0:1773851888.458034:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:11.0:1773851888.458034:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000020:00000040:29.0:1773851888.458035:0:41091:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:28.0:1773851888.458035:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000040:11.0:1773851888.458035:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690078208 avail=351687670784 avail_mb=1373779964 hwm_mb=3131103 files=372231120 ffree=343447342 state=0: rc = 0
00000020:00000001:29.0:1773851888.458036:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851888.458036:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a8444578.
00000100:00000040:28.0:1773851888.458036:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
02000000:00000001:29.0:1773851888.458037:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851888.458038:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851888.458038:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000074adcffb.
00000100:00000001:28.0:1773851888.458038:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851888.458038:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.458039:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851888.458039:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:11.0:1773851888.458039:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690078208 free, 351687670784 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231120 files, 343447342 free files
00000100:00000001:29.0:1773851888.458040:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:28.0:1773851888.458040:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851888.458041:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851888.458041:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.458042:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851888.458042:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851888.458042:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851888.458043:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851888.458045:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851888.458046:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851888.458047:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851888.458048:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00100000:11.0:1773851888.458048:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb9196ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051936832:37@kfi7:13:default-yuba2-0
00000004:00000040:28.0:1773851888.458049:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000004:00000040:28.0:1773851888.458050:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351179264 avail=351348304896 avail_mb=1372454316 hwm_mb=3131103 files=372083978 ffree=343116386 state=0: rc = 0
00000100:00000001:11.0:1773851888.458051:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851888.458052:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851888.458053:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fb9196ac x1859433051936832/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:28.0:1773851888.458054:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351179264 free, 351348304896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372083978 files, 343116386 free files
00000004:00000001:28.0:1773851888.458056:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851888.458058:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851888.458058:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851888.458059:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:11.0:1773851888.458060:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000004dd1490.
02000000:00000001:11.0:1773851888.458062:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851888.458062:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000100:00100000:28.0:1773851888.458063:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051936768:60@kfi7:13:default-yuba2-0
00000020:00000040:11.0:1773851888.458063:0:41070:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000020:00000001:11.0:1773851888.458064:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851888.458066:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006db6fddb.
02000000:00000001:11.0:1773851888.458068:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851888.458068:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:28.0:1773851888.458069:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:11.0:1773851888.458069:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb9196ac.
00000100:00000001:28.0:1773851888.458070:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851888.458071:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000009d6a92c0 x1859433051936768/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851888.458071:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851888.458071:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851888.458072:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851888.458074:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851888.458074:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851888.458075:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851888.458076:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:11.0:1773851888.458076:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851888.458077:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851888.458078:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a72a513e.
02000000:00000001:28.0:1773851888.458080:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851888.458080:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851888.458081:0:41090:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000020:00000001:28.0:1773851888.458082:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851888.458083:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b789a785.
02000000:00000001:28.0:1773851888.458085:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851888.458086:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851888.458086:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d6a92c0.
00000100:00000001:28.0:1773851888.458088:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851888.458089:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851888.458090:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851888.458092:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851888.458092:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851888.458093:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851888.458094:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851888.496005:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851888.496007:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851888.496007:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851888.496008:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851888.496010:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851888.496010:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10720@kfi7(0000000095d739f7):0xa05 version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851888.496012:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851888.496012:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 Using peer 10720@kfi7(0xa05)
00000400:00000200:13.0:1773851888.496014:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10720@kfi7 to cpt 3
00000800:00000200:14.0:1773851888.496016:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851888.496016:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0xa05: rc=0
00000800:00000200:13.0:1773851888.496017:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851888.496019:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10720@kfi7 to cpt 3
00000400:00000200:14.0:1773851888.496021:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10720@kfi7 : PUT - for me
00000400:00000200:14.0:1773851888.496023:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10720@kfi7 to cpt 3
00000400:00000200:14.0:1773851888.496025:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080b71d3c nid 10720@kfi7 refs 1
00000400:00000200:14.0:1773851888.496027:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10720@kfi7 to cpt 3
00000400:00000200:14.0:1773851888.496028:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080b71d3c nid 10720@kfi7 refs 2
00000400:00000200:14.0:1773851888.496029:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000080b71d3c nid 10720@kfi7 refs 3
00000800:00000200:13.0:1773851888.496030:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851888.496031:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10721@kfi7 to cpt 6
00000400:00000200:14.0:1773851888.496032:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10721@kfi7 of length 456 into portal 12 MB=0x699e198308a40
00000800:00000200:13.0:1773851888.496032:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 Transaction freed
00000400:00000200:14.0:1773851888.496035:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10721@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 46480
00000800:00000200:14.0:1773851888.496038:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851888.496041:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851888.496043:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10720@kfi7: PUT: OK
00000100:00000001:14.0:1773851888.496045:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851888.496046:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851888.496047:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a85cd4fb.
00000100:00000040:14.0:1773851888.496048:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000a85cd4fb x1858044060273216 msgsize 456
00000100:00100000:14.0:1773851888.496051:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-10721@kfi7 (source: 12345-10720@kfi7)
00000100:00000001:14.0:1773851888.496053:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851888.496054:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000080b71d3c nid 10720@kfi7 refs 2
00000100:00000001:12.0:1773851888.496056:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851888.496057:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ba933e94: 2069@kfi7:3 <- 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851888.496057:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851888.496061:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851888.496062:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851888.496063:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851888.496064:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044060273216
00000020:00000001:12.0:1773851888.496065:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851888.496066:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916f2
00000020:00000001:12.0:1773851888.496067:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851888.496071:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000022bb46e0 refcount=6
00000020:00000001:12.0:1773851888.496072:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241493504 : -107152468058112 : ffff9e8b9f346000)
00000020:00000001:12.0:1773851888.496074:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241493504 : -107152468058112 : ffff9e8b9f346000)
00000100:00000001:12.0:1773851888.496075:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.496076:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851888.496078:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000380f7712.
00000020:00000010:12.0:1773851888.496079:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.496081:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000084c0a733.
00000100:00000001:12.0:1773851888.496082:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851888.496083:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851888.496084:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.496086:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.496087:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851888.496090:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851888.496090:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851888.496090:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851888.496091:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851888.496092:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10721@kfi7, seq: 411190554
00000100:00000001:15.0:1773851888.496094:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851888.496094:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000022bb46e0 : new rpc_count 1
00000100:00000001:15.0:1773851888.496095:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.496095:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562701824 : -106978146849792 : ffff9eb4358eec00)
00000100:00000040:12.0:1773851888.496097:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a85cd4fb x1858044060273216/t0(0) o17->ba762573-67dc-4610-8e27-c68165dbcb36@10721@kfi7:615/0 lens 456/0 e 0 to 0 dl 1773851975 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1151-0'
00000100:00000001:12.0:1773851888.496102:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.496103:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851888.496104:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a85cd4fb pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ba762573-67dc-4610-8e27-c68165dbcb36+6:39817:x1858044060273216:12345-10721@kfi7:17:default-tuolumne1151-0
00000100:00000200:12.0:1773851888.496107:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044060273216
00000020:00000001:12.0:1773851888.496108:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851888.496110:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851888.496111:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.496112:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851888.496113:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:12.0:1773851888.496114:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851888.496116:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044060273216, found 0 last_xid 1858044060273215
00000020:00000001:12.0:1773851888.496117:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851888.496118:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851888.496119:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851888.496120:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851888.496121:0:60487:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:12.0:1773851888.496122:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851888.496123:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851888.496124:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000001e613f2a.
02000000:00000001:12.0:1773851888.496125:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.496126:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.496128:0:60487:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:12.0:1773851888.496129:0:60487:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:12.0:1773851888.496130:0:60487:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:12.0:1773851888.496133:0:60487:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.496134:0:60487:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:12.0:1773851888.496135:0:60487:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli ba762573-67dc-4610-8e27-c68165dbcb36/0000000022bb46e0 free: 126633370845184 avail: 126633368748032
00000020:00000001:12.0:1773851888.496137:0:60487:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:12.0:1773851888.496138:0:60487:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli ba762573-67dc-4610-8e27-c68165dbcb36/0000000022bb46e0 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:12.0:1773851888.496140:0:60487:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:12.0:1773851888.496142:0:60487:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:12.0:1773851888.496142:0:60487:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli ba762573-67dc-4610-8e27-c68165dbcb36/0000000022bb46e0 reports grant 1811677183 dropped 0, local 1878786047
00000020:00000001:12.0:1773851888.496144:0:60487:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:12.0:1773851888.496145:0:60487:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:12.0:1773851888.496146:0:60487:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851888.496147:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035379703, transno 0, xid 1858044060273216
00010000:00000001:12.0:1773851888.496148:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851888.496150:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a85cd4fb x1858044060273216/t0(0) o17->ba762573-67dc-4610-8e27-c68165dbcb36@10721@kfi7:615/0 lens 456/432 e 0 to 0 dl 1773851975 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1151-0'
00010000:00000001:12.0:1773851888.496155:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851888.496156:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851888.496157:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=121 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851888.496159:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851888.496160:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000256cc443 refcount 3 to 10721@kfi7
00000100:00000001:12.0:1773851888.496161:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336928 : -107152617214688 : ffff9e8b96506d20)
02000000:00000001:12.0:1773851888.496162:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851888.496163:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.496164:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851888.496165:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10720@kfi7
00000400:00000010:12.0:1773851888.496166:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000464fc1d9.
00000100:00000200:12.0:1773851888.496168:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858044060273216, offset 224
00000400:00000200:12.0:1773851888.496170:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10720@kfi7
00000400:00000200:12.0:1773851888.496171:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10720@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.496173:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000080b71d3c nid 10720@kfi7 refs 1
00000400:00000200:12.0:1773851888.496174:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000080b71d3c nid 10720@kfi7 refs 2
00000400:00000200:12.0:1773851888.496176:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000080b71d3c nid 10720@kfi7 refs 3
00000400:00000200:12.0:1773851888.496178:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10720@kfi7 local destination
00000400:00000200:12.0:1773851888.496181:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769922:8769922:1024:4294967295] 10720@kfi7 LPNI seq info [215582:215582:16:4294967295]
00000400:00000200:12.0:1773851888.496183:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000080b71d3c nid 10720@kfi7 refs 2
00000400:00000200:12.0:1773851888.496185:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10720@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.496188:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10720@kfi7(10720@kfi7:10720@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851888.496190:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000080b71d3c nid 10720@kfi7 refs 3
00000800:00000200:12.0:1773851888.496193:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851888.496195:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:12.0:1773851888.496199:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851888.496202:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 Using peer 10720@kfi7(0xa05)
00000800:00000200:12.0:1773851888.496210:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 532 bytes to peer 0xa05: rc=0
00000800:00000200:12.0:1773851888.496213:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851888.496216:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851888.496218:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000256cc443 refcount 2 to 10721@kfi7
00010000:00000001:12.0:1773851888.496221:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851888.496222:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.496223:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851888.496224:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a85cd4fb x1858044060273216/t0(0) o17->ba762573-67dc-4610-8e27-c68165dbcb36@10721@kfi7:615/0 lens 456/432 e 0 to 0 dl 1773851975 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1151-0'
00000100:00100000:12.0:1773851888.496230:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a85cd4fb pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ba762573-67dc-4610-8e27-c68165dbcb36+6:39817:x1858044060273216:12345-10721@kfi7:17:default-tuolumne1151-0 Request processed in 127us (180us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851888.496234:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10721@kfi7, seq: 411190554
00000100:00000040:12.0:1773851888.496235:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000022bb46e0 : new rpc_count 0
00000100:00000001:12.0:1773851888.496236:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851888.496237:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851888.496238:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.496239:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000084c0a733.
00000020:00000010:12.0:1773851888.496241:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000380f7712.
00000020:00000040:12.0:1773851888.496242:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000022bb46e0 : new refcount 5
00000100:00000001:12.0:1773851888.496243:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851888.496249:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851888.496251:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851888.496252:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10720@kfi7: PUT: OK
00000400:00000200:13.0:1773851888.496253:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000464fc1d9
00000400:00000010:13.0:1773851888.496253:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000464fc1d9.
00000100:00000001:13.0:1773851888.496254:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851888.496254:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851888.496255:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000080b71d3c nid 10720@kfi7 refs 2
00000800:00000200:13.0:1773851888.496257:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 10720@kfi7(0000000095d739f7):0x0 lsk 2566 rsk 53 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa05 Transaction freed
00000800:00000200:17.0:1773851888.511183:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851888.511184:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851888.511185:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851888.511188:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851888.511190:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18323@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.511192:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18323@kfi7 : PUT - for me
00000400:00000200:17.0:1773851888.511192:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18323@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.511193:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009818308c nid 18323@kfi7 refs 1
00000400:00000200:17.0:1773851888.511194:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18323@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.511195:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009818308c nid 18323@kfi7 refs 2
00000400:00000200:17.0:1773851888.511196:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009818308c nid 18323@kfi7 refs 3
00000400:00000200:17.0:1773851888.511196:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18323@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.511198:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18323@kfi7 of length 224 into portal 12 MB=0x69b81a4ef21c0
00000400:00000200:17.0:1773851888.511199:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18323@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 38256
00000800:00000200:17.0:1773851888.511201:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851888.511203:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851888.511204:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18323@kfi7: PUT: OK
00000100:00000001:17.0:1773851888.511205:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851888.511206:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851888.511207:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000018a9b63.
00000100:00000040:17.0:1773851888.511207:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000018a9b63 x1859830980485568 msgsize 224
00000100:00100000:17.0:1773851888.511209:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18323@kfi7 (source: 12345-18323@kfi7)
00000100:00000001:17.0:1773851888.511211:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851888.511211:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009818308c nid 18323@kfi7 refs 2
00000800:00000200:17.0:1773851888.511213:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000767aee6e: 2054@kfi7:4 <- 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851888.511216:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851888.511216:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851888.511217:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851888.511217:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851888.511218:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851888.511219:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830980485568
00000020:00000001:17.0:1773851888.511219:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851888.511220:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce65099
00000020:00000001:17.0:1773851888.511220:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851888.511222:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000891c5e19 refcount=5
00000020:00000001:17.0:1773851888.511223:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165280985088 : -106908428566528 : ffff9ec471178000)
00000020:00000001:17.0:1773851888.511224:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165280985088 : -106908428566528 : ffff9ec471178000)
00000100:00000001:17.0:1773851888.511225:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851888.511226:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851888.511226:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851888.511227:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851888.511228:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851888.511229:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851888.511229:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851888.511230:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851888.511231:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851888.511231:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851888.511232:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.511233:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851888.511234:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851888.511234:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851888.511235:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18323@kfi7, seq: 2156403
00000100:00000001:16.0:1773851888.511235:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:17.0:1773851888.511236:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000891c5e19 : new rpc_count 1
00000100:00000001:16.0:1773851888.511236:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851888.511236:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.511237:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637032102216576 : -107041607335040 : ffff9ea56f04c380)
00000100:00000040:17.0:1773851888.511238:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000018a9b63 x1859830980485568/t0(0) o400->37b3ff43-006b-446c-bdc7-77abca47afef@18323@kfi7:140/0 lens 224/0 e 0 to 0 dl 1773852255 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1638-0'
00000100:00000001:16.0:1773851888.511238:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.511241:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851888.511241:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851888.511242:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000018a9b63 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:37b3ff43-006b-446c-bdc7-77abca47afef+5:39487:x1859830980485568:12345-18323@kfi7:400:default-tuolumne1638-0
00000100:00000200:17.0:1773851888.511243:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830980485568
00000020:00000001:17.0:1773851888.511244:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851888.511244:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851888.511245:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.511246:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851888.511246:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851888.511247:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851888.511247:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830980485568, found 0 last_xid 1859830980485567
00000020:00000001:17.0:1773851888.511248:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851888.511249:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851888.511250:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851888.511250:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.511251:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851888.511252:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851888.511252:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851888.511253:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aa456668.
02000000:00000001:17.0:1773851888.511253:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.511254:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.511254:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851888.511255:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262832437, transno 0, xid 1859830980485568
00010000:00000001:17.0:1773851888.511256:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851888.511257:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000018a9b63 x1859830980485568/t0(0) o400->37b3ff43-006b-446c-bdc7-77abca47afef@18323@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1638-0'
00010000:00000001:17.0:1773851888.511259:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851888.511259:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851888.511260:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=121 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851888.511261:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851888.511262:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000a8d0ede refcount 3 to 18323@kfi7
00000100:00000001:17.0:1773851888.511262:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583951360 : -107156125600256 : ffff9e8ac532b600)
02000000:00000001:17.0:1773851888.511263:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851888.511264:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851888.511264:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851888.511265:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18323@kfi7
00000400:00000010:17.0:1773851888.511266:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2680273.
00000100:00000200:17.0:1773851888.511267:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830980485568, offset 224
00000400:00000200:17.0:1773851888.511268:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18323@kfi7
00000400:00000200:17.0:1773851888.511269:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18323@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.511269:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009818308c nid 18323@kfi7 refs 1
00000400:00000200:17.0:1773851888.511270:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009818308c nid 18323@kfi7 refs 2
00000400:00000200:17.0:1773851888.511271:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009818308c nid 18323@kfi7 refs 3
00000400:00000200:17.0:1773851888.511272:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18323@kfi7 local destination
00000400:00000200:17.0:1773851888.511273:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769923:8769923:1024:4294967295] 18323@kfi7 LPNI seq info [1349021:1349021:16:4294967295]
00000400:00000200:17.0:1773851888.511274:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009818308c nid 18323@kfi7 refs 2
00000400:00000200:17.0:1773851888.511276:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18323@kfi7 to cpt 4
00000400:00000200:17.0:1773851888.511278:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18323@kfi7(18323@kfi7:18323@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851888.511279:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009818308c nid 18323@kfi7 refs 3
00000800:00000200:17.0:1773851888.511280:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851888.511281:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851888.511283:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851888.511285:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000007e Using peer 18323@kfi7(0x10000000000007e)
00000800:00000200:17.0:1773851888.511288:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x10000000000007e: rc=0
00000800:00000200:17.0:1773851888.511289:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000007e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851888.511292:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851888.511292:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000a8d0ede refcount 2 to 18323@kfi7
00010000:00000001:17.0:1773851888.511293:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851888.511294:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851888.511294:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851888.511295:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000018a9b63 x1859830980485568/t0(0) o400->37b3ff43-006b-446c-bdc7-77abca47afef@18323@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1638-0'
00000100:00100000:17.0:1773851888.511298:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000018a9b63 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:37b3ff43-006b-446c-bdc7-77abca47afef+5:39487:x1859830980485568:12345-18323@kfi7:400:default-tuolumne1638-0 Request processed in 56us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851888.511300:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18323@kfi7, seq: 2156403
00000100:00000040:17.0:1773851888.511301:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000891c5e19 : new rpc_count 0
00000100:00000001:17.0:1773851888.511301:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851888.511302:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851888.511303:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851888.511303:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000800:00000200:19.0:1773851888.511304:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000007e TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851888.511304:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000400:00000200:19.0:1773851888.511305:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:17.0:1773851888.511305:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000891c5e19 : new refcount 4
00000400:00000200:19.0:1773851888.511306:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18323@kfi7: PUT: OK
00000100:00000001:17.0:1773851888.511306:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851888.511307:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2680273
00000400:00000010:19.0:1773851888.511307:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2680273.
00000100:00000001:19.0:1773851888.511308:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851888.511308:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:19.0:1773851888.511309:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009818308c nid 18323@kfi7 refs 2
00000800:00000200:19.0:1773851888.511310:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 18323@kfi7(000000005cb35fb8):0x0 lsk 127 rsk 20 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000007e Transaction freed
00000400:00000200:29.0:1773851888.521734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851888.521735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:6.0:1773851888.552638:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851888.552639:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851888.552640:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851888.552642:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851888.552644:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24930@kfi7 to cpt 1
00000400:00000200:6.0:1773851888.552645:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24930@kfi7 : PUT - for me
00000400:00000200:6.0:1773851888.552646:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24930@kfi7 to cpt 1
00000400:00000200:6.0:1773851888.552648:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000070723c53 nid 24930@kfi7 refs 1
00000400:00000200:6.0:1773851888.552648:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24930@kfi7 to cpt 1
00000400:00000200:6.0:1773851888.552649:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000070723c53 nid 24930@kfi7 refs 2
00000400:00000200:6.0:1773851888.552650:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000070723c53 nid 24930@kfi7 refs 3
00000400:00000200:6.0:1773851888.552651:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24995@kfi7 to cpt 0
00000400:00000200:6.0:1773851888.552651:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24995@kfi7 of length 224 into portal 12 MB=0x69b4c3b6dc600
00000400:00000200:6.0:1773851888.552653:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24995@kfi7 of length 224/224 into md 0x793926dc5 [64] + 157688
00000800:00000200:6.0:1773851888.552655:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851888.552656:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851888.552657:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24930@kfi7: PUT: OK
00000100:00000001:6.0:1773851888.552658:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851888.552659:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851888.552659:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a0a8a955.
00000100:00000040:6.0:1773851888.552660:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000a0a8a955 x1859601577133568 msgsize 224
00000100:00100000:6.0:1773851888.552661:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-24995@kfi7 (source: 12345-24930@kfi7)
00000100:00000001:6.0:1773851888.552662:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851888.552663:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000070723c53 nid 24930@kfi7 refs 2
00000800:00000200:6.0:1773851888.552665:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851888.552665:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851888.552666:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851888.552667:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851888.552668:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851888.552669:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851888.552670:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601577133568
00000020:00000001:4.0:1773851888.552671:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851888.552672:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7efb1
00000020:00000001:4.0:1773851888.552673:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851888.552675:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000721b702f refcount=5
00000020:00000001:4.0:1773851888.552676:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111110080512 : -106962599471104 : ffff9eb7d4411800)
00000020:00000001:4.0:1773851888.552678:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111110080512 : -106962599471104 : ffff9eb7d4411800)
00000100:00000001:4.0:1773851888.552679:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851888.552680:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851888.552681:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851888.552683:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851888.552684:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000cfda0f80.
00000100:00000001:4.0:1773851888.552686:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851888.552686:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851888.552687:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851888.552689:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851888.552690:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851888.552690:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.552692:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851888.552693:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851888.552694:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851888.552694:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851888.552695:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24995@kfi7, seq: 2001971
00000100:00000001:4.0:1773851888.552695:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851888.552696:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000721b702f : new rpc_count 1
00000100:00000001:7.0:1773851888.552697:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814076160 : -107101895475456 : ffff9e976590bf00)
00000100:00000001:4.0:1773851888.552697:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851888.552698:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851888.552699:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a0a8a955 x1859601577133568/t0(0) o400->52615d22-6a9f-4663-9ae0-c27db4cf72ad@24995@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2044-0'
00000100:00000001:7.0:1773851888.552701:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851888.552702:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851888.552703:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a0a8a955 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:52615d22-6a9f-4663-9ae0-c27db4cf72ad+5:39541:x1859601577133568:12345-24995@kfi7:400:default-tuolumne2044-0
00000100:00000200:7.0:1773851888.552704:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601577133568
00000020:00000001:7.0:1773851888.552705:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851888.552706:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851888.552707:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851888.552707:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851888.552708:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851888.552709:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851888.552710:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601577133568, found 0 last_xid 1859601577133567
00000020:00000001:7.0:1773851888.552711:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851888.552712:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851888.552712:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851888.552713:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851888.552714:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851888.552714:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851888.552715:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851888.552716:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c08e338e.
02000000:00000001:7.0:1773851888.552717:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.552717:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851888.552718:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851888.552719:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183045371527, transno 0, xid 1859601577133568
00010000:00000001:7.0:1773851888.552720:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851888.552721:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a0a8a955 x1859601577133568/t0(0) o400->52615d22-6a9f-4663-9ae0-c27db4cf72ad@24995@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2044-0'
00010000:00000001:7.0:1773851888.552724:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851888.552724:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851888.552729:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=120 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851888.552730:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851888.552731:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005be4ac3f refcount 3 to 24995@kfi7
00000100:00000001:7.0:1773851888.552732:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379360 : -107155980172256 : ffff9e8acdddc420)
02000000:00000001:7.0:1773851888.552733:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851888.552733:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851888.552734:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851888.552735:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24930@kfi7
00000400:00000010:7.0:1773851888.552736:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000100:00000200:7.0:1773851888.552737:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601577133568, offset 224
00000400:00000200:7.0:1773851888.552739:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24930@kfi7
00000400:00000200:7.0:1773851888.552740:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24930@kfi7 to cpt 1
00000400:00000200:7.0:1773851888.552741:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000070723c53 nid 24930@kfi7 refs 1
00000400:00000200:7.0:1773851888.552742:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000070723c53 nid 24930@kfi7 refs 2
00000400:00000200:7.0:1773851888.552743:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000070723c53 nid 24930@kfi7 refs 3
00000400:00000200:7.0:1773851888.552745:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24930@kfi7 local destination
00000400:00000200:7.0:1773851888.552746:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769924:8769924:1024:4294967295] 24930@kfi7 LPNI seq info [458310:458310:16:4294967295]
00000400:00000200:7.0:1773851888.552748:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000070723c53 nid 24930@kfi7 refs 2
00000400:00000200:7.0:1773851888.552749:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24930@kfi7 to cpt 1
00000400:00000200:7.0:1773851888.552751:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24930@kfi7(24930@kfi7:24930@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851888.552752:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000070723c53 nid 24930@kfi7 refs 3
00000800:00000200:7.0:1773851888.552754:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851888.552755:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851888.552758:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851888.552761:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd4a Using peer 24930@kfi7(0xd4a)
00000800:00000200:7.0:1773851888.552764:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0xd4a: rc=0
00000800:00000200:7.0:1773851888.552765:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd4a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851888.552768:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851888.552769:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005be4ac3f refcount 2 to 24995@kfi7
00010000:00000001:7.0:1773851888.552770:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851888.552770:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851888.552771:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851888.552772:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a0a8a955 x1859601577133568/t0(0) o400->52615d22-6a9f-4663-9ae0-c27db4cf72ad@24995@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2044-0'
00000100:00100000:7.0:1773851888.552780:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a0a8a955 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:52615d22-6a9f-4663-9ae0-c27db4cf72ad+5:39541:x1859601577133568:12345-24995@kfi7:400:default-tuolumne2044-0 Request processed in 77us (118us total) trans 0 rc 0/0
00000800:00000200:6.0:1773851888.552780:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd4a TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851888.552782:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851888.552783:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24995@kfi7, seq: 2001971
00000400:00000200:6.0:1773851888.552783:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24930@kfi7: PUT: OK
00000100:00000040:7.0:1773851888.552784:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000721b702f : new rpc_count 0
00000400:00000200:6.0:1773851888.552784:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000100:00000001:7.0:1773851888.552785:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851888.552785:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:6.0:1773851888.552785:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000020:00000010:7.0:1773851888.552786:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000100:00000001:6.0:1773851888.552786:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851888.552786:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851888.552787:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000cfda0f80.
00000400:00000200:6.0:1773851888.552787:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000070723c53 nid 24930@kfi7 refs 2
00000020:00000010:7.0:1773851888.552788:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:7.0:1773851888.552789:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000721b702f : new refcount 4
00000800:00000200:6.0:1773851888.552789:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 24930@kfi7(00000000ea5e30c2):0x0 lsk 3403 rsk 15 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd4a Transaction freed
00000100:00000001:7.0:1773851888.552790:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851888.594402:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851888.594403:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851888.594404:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851888.594406:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851888.594408:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26243@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.594409:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26243@kfi7 : PUT - for me
00000400:00000200:21.0:1773851888.594410:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26243@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.594411:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000283f87b8 nid 26243@kfi7 refs 1
00000400:00000200:21.0:1773851888.594412:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26243@kfi7 to cpt 5
00000400:00000200:21.0:1773851888.594412:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000283f87b8 nid 26243@kfi7 refs 2
00000400:00000200:21.0:1773851888.594413:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000283f87b8 nid 26243@kfi7 refs 3
00000400:00000200:21.0:1773851888.594414:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26179@kfi7 to cpt 2
00000400:00000200:21.0:1773851888.594415:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26179@kfi7 of length 224 into portal 12 MB=0x69baaab6eb2c0
00000400:00000200:21.0:1773851888.594416:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26179@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 56184
00000800:00000200:21.0:1773851888.594417:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851888.594419:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851888.594419:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26243@kfi7: PUT: OK
00000100:00000001:21.0:1773851888.594420:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851888.594421:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851888.594422:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a10aafeb.
00000100:00000040:21.0:1773851888.594423:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000a10aafeb x1860007183168192 msgsize 224
00000100:00100000:21.0:1773851888.594424:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-26179@kfi7 (source: 12345-26243@kfi7)
00000100:00000001:21.0:1773851888.594425:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851888.594426:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000283f87b8 nid 26243@kfi7 refs 2
00000100:00000001:23.0:1773851888.594427:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851888.594427:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851888.594427:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851888.594428:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851888.594428:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851888.594429:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851888.594430:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860007183168192
00000020:00000001:23.0:1773851888.594430:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851888.594431:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08efa17913d
00000020:00000001:23.0:1773851888.594431:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851888.594434:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c6830ba6 refcount=8
00000020:00000001:23.0:1773851888.594434:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637027425992704 : -107046283558912 : ffff9ea4584b4000)
00000020:00000001:23.0:1773851888.594435:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637027425992704 : -107046283558912 : ffff9ea4584b4000)
00000100:00000001:23.0:1773851888.594436:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851888.594437:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851888.594438:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a6c8ed98.
00000020:00000010:23.0:1773851888.594439:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851888.594440:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851888.594441:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851888.594441:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851888.594442:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851888.594443:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851888.594443:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851888.594444:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851888.594444:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851888.594446:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851888.594446:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851888.594446:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851888.594446:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851888.594447:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26179@kfi7, seq: 1998047
00000100:00000001:23.0:1773851888.594448:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851888.594448:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c6830ba6 : new rpc_count 1
00000100:00000001:23.0:1773851888.594449:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851888.594449:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102026012160 : -106971683539456 : ffff9eb5b6cd3600)
00000100:00000040:20.0:1773851888.594450:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a10aafeb x1860007183168192/t0(0) o400->93e22793-4b1f-4c68-876a-0e22efffba17@26179@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2136-0'
00000100:00000001:20.0:1773851888.594453:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851888.594454:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851888.594455:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a10aafeb pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:93e22793-4b1f-4c68-876a-0e22efffba17+8:39775:x1860007183168192:12345-26179@kfi7:400:default-tuolumne2136-0
00000100:00000200:20.0:1773851888.594456:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860007183168192
00000020:00000001:20.0:1773851888.594457:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851888.594458:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851888.594458:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851888.594459:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851888.594459:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851888.594460:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851888.594461:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860007183168192, found 0 last_xid 1860007183168191
00000020:00000001:20.0:1773851888.594462:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851888.594462:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851888.594463:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851888.594463:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851888.594464:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851888.594465:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851888.594465:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851888.594466:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002332f203.
02000000:00000001:20.0:1773851888.594467:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851888.594467:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851888.594468:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851888.594469:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260714816, transno 0, xid 1860007183168192
00010000:00000001:20.0:1773851888.594470:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851888.594471:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a10aafeb x1860007183168192/t0(0) o400->93e22793-4b1f-4c68-876a-0e22efffba17@26179@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2136-0'
00010000:00000001:20.0:1773851888.594473:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851888.594474:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851888.594474:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=121 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851888.594475:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851888.594476:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005d5f6424 refcount 3 to 26179@kfi7
00000100:00000001:20.0:1773851888.594477:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582560 : -107154806969056 : ffff9e8b13cb6d20)
02000000:00000001:20.0:1773851888.594478:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851888.594479:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851888.594479:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851888.594480:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26243@kfi7
00000400:00000010:20.0:1773851888.594481:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000058a6614e.
00000100:00000200:20.0:1773851888.594482:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860007183168192, offset 224
00000400:00000200:20.0:1773851888.594483:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26243@kfi7
00000400:00000200:20.0:1773851888.594484:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26243@kfi7 to cpt 5
00000400:00000200:20.0:1773851888.594484:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000283f87b8 nid 26243@kfi7 refs 1
00000400:00000200:20.0:1773851888.594486:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000283f87b8 nid 26243@kfi7 refs 2
00000400:00000200:20.0:1773851888.594487:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000283f87b8 nid 26243@kfi7 refs 3
00000400:00000200:20.0:1773851888.594488:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26243@kfi7 local destination
00000400:00000200:20.0:1773851888.594489:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769925:8769925:1024:4294967295] 26243@kfi7 LPNI seq info [14614534:14614534:16:4294967295]
00000400:00000200:20.0:1773851888.594491:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000283f87b8 nid 26243@kfi7 refs 2
00000400:00000200:20.0:1773851888.594492:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26243@kfi7 to cpt 5
00000400:00000200:20.0:1773851888.594493:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26243@kfi7(26243@kfi7:26243@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851888.594494:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000283f87b8 nid 26243@kfi7 refs 3
00000800:00000200:20.0:1773851888.594496:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851888.594497:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851888.594499:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851888.594501:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ed9 Using peer 26243@kfi7(0x100000000000ed9)
00000800:00000200:20.0:1773851888.594504:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x100000000000ed9: rc=0
00000800:00000200:20.0:1773851888.594506:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ed9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851888.594508:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851888.594509:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005d5f6424 refcount 2 to 26179@kfi7
00010000:00000001:20.0:1773851888.594509:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851888.594510:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851888.594511:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851888.594511:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a10aafeb x1860007183168192/t0(0) o400->93e22793-4b1f-4c68-876a-0e22efffba17@26179@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2136-0'
00000100:00100000:20.0:1773851888.594515:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a10aafeb pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:93e22793-4b1f-4c68-876a-0e22efffba17+8:39775:x1860007183168192:12345-26179@kfi7:400:default-tuolumne2136-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851888.594517:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26179@kfi7, seq: 1998047
00000100:00000040:20.0:1773851888.594518:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c6830ba6 : new rpc_count 0
00000100:00000001:20.0:1773851888.594518:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851888.594519:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851888.594520:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851888.594520:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:20.0:1773851888.594521:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a6c8ed98.
00000020:00000040:20.0:1773851888.594522:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000c6830ba6 : new refcount 7
00000100:00000001:20.0:1773851888.594523:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851888.594528:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ed9 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851888.594529:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851888.594530:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26243@kfi7: PUT: OK
00000400:00000200:21.0:1773851888.594531:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000058a6614e
00000400:00000010:21.0:1773851888.594531:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000058a6614e.
00000100:00000001:21.0:1773851888.594532:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851888.594532:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851888.594533:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000283f87b8 nid 26243@kfi7 refs 2
00000800:00000200:21.0:1773851888.594534:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 26243@kfi7(00000000c45c51d9):0x0 lsk 3802 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ed9 Transaction freed
00000800:00000200:25.0:1773851888.607780:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851888.607781:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851888.607781:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851888.607782:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851888.607783:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851888.607783:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851888.607785:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851888.607785:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9954@kfi7(0000000018b07d91):0x97 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851888.607786:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 Using peer 9954@kfi7(0x97)
00000400:00000200:26.0:1773851888.607787:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9954@kfi7 to cpt 6
00000400:00000200:26.0:1773851888.607788:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9954@kfi7 : PUT - for me
00000400:00000200:25.0:1773851888.607788:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9954@kfi7 to cpt 6
00000400:00000200:26.0:1773851888.607789:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9954@kfi7 to cpt 6
00000400:00000200:26.0:1773851888.607790:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2b32313 nid 9954@kfi7 refs 1
00000800:00000200:25.0:1773851888.607790:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 38 bytes to peer 0x97: rc=0
00000400:00000200:26.0:1773851888.607791:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9954@kfi7 to cpt 6
00000800:00000200:25.0:1773851888.607791:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851888.607792:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2b32313 nid 9954@kfi7 refs 2
00000400:00000200:26.0:1773851888.607792:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2b32313 nid 9954@kfi7 refs 3
00000400:00000200:26.0:1773851888.607793:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9763@kfi7 to cpt 7
00000400:00000200:26.0:1773851888.607794:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9763@kfi7 of length 224 into portal 12 MB=0x69b4b609646c0
00000400:00000200:26.0:1773851888.607796:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9763@kfi7 of length 224/224 into md 0x16159c9699 [64] + 31080
00000800:00000200:26.0:1773851888.607798:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851888.607799:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851888.607800:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9954@kfi7: PUT: OK
00000100:00000001:26.0:1773851888.607801:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851888.607802:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851888.607803:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ff83cf3b.
00000100:00000040:26.0:1773851888.607803:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000ff83cf3b x1859597905577664 msgsize 224
00000800:00000200:25.0:1773851888.607804:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 TN_EVENT_TX_OK event status 0
00000100:00100000:26.0:1773851888.607805:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9763@kfi7 (source: 12345-9954@kfi7)
00000100:00000001:26.0:1773851888.607806:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:25.0:1773851888.607806:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007d5570ed: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 Transaction freed
00000400:00000200:26.0:1773851888.607808:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2b32313 nid 9954@kfi7 refs 2
00000800:00000200:26.0:1773851888.607809:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bb1c0c9f: 2069@kfi7:6 <- 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851888.607811:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851888.607811:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851888.607812:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851888.607812:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851888.607813:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851888.607814:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597905577664
00000020:00000001:25.0:1773851888.607815:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851888.607815:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79a0b
00000020:00000001:25.0:1773851888.607816:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851888.607820:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007942adff refcount=5
00000020:00000001:25.0:1773851888.607820:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637040582499328 : -107033127052288 : ffff9ea7687b9c00)
00000020:00000001:25.0:1773851888.607821:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637040582499328 : -107033127052288 : ffff9ea7687b9c00)
00000100:00000001:25.0:1773851888.607822:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851888.607823:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851888.607824:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fc844a13.
00000020:00000010:25.0:1773851888.607825:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851888.607826:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004371f0ec.
00000100:00000001:25.0:1773851888.607827:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851888.607827:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851888.607828:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851888.607829:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851888.607830:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851888.607830:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.607831:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851888.607832:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851888.607833:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851888.607834:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:25.0:1773851888.607834:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9763@kfi7, seq: 2025158
00000100:00000001:27.0:1773851888.607835:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:25.0:1773851888.607835:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007942adff : new rpc_count 1
00000100:00000001:27.0:1773851888.607836:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.607836:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144347088512 : -106929362463104 : ffff9ebf91559680)
00000100:00000001:27.0:1773851888.607837:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851888.607837:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ff83cf3b x1859597905577664/t0(0) o400->8f3969dd-69d8-4264-8034-92654648207e@9763@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1099-0'
00000100:00000001:25.0:1773851888.607840:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851888.607840:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851888.607841:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff83cf3b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:8f3969dd-69d8-4264-8034-92654648207e+5:39665:x1859597905577664:12345-9763@kfi7:400:default-tuolumne1099-0
00000100:00000200:25.0:1773851888.607842:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597905577664
00000020:00000001:25.0:1773851888.607843:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851888.607844:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851888.607844:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.607845:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851888.607846:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851888.607847:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851888.607847:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597905577664, found 0 last_xid 1859597905577663
00000020:00000001:25.0:1773851888.607848:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851888.607849:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851888.607849:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851888.607850:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.607851:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851888.607851:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851888.607852:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851888.607853:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001f9e30f1.
02000000:00000001:25.0:1773851888.607853:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.607854:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.607855:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851888.607855:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035357054, transno 0, xid 1859597905577664
00010000:00000001:25.0:1773851888.607856:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851888.607857:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ff83cf3b x1859597905577664/t0(0) o400->8f3969dd-69d8-4264-8034-92654648207e@9763@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1099-0'
00010000:00000001:25.0:1773851888.607859:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851888.607860:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851888.607861:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=121 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851888.607862:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851888.607863:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d023b864 refcount 3 to 9763@kfi7
00000100:00000001:25.0:1773851888.607864:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412884224 : -107156296667392 : ffff9e8abb006f00)
02000000:00000001:25.0:1773851888.607865:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851888.607866:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.607866:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851888.607867:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9954@kfi7
00000400:00000010:25.0:1773851888.607868:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028f72f4c.
00000100:00000200:25.0:1773851888.607869:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597905577664, offset 224
00000400:00000200:25.0:1773851888.607870:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9954@kfi7
00000400:00000200:25.0:1773851888.607871:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9954@kfi7 to cpt 6
00000400:00000200:25.0:1773851888.607872:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2b32313 nid 9954@kfi7 refs 1
00000400:00000200:25.0:1773851888.607873:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2b32313 nid 9954@kfi7 refs 2
00000400:00000200:25.0:1773851888.607874:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2b32313 nid 9954@kfi7 refs 3
00000400:00000200:25.0:1773851888.607876:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9954@kfi7 local destination
00000400:00000200:25.0:1773851888.607877:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769926:8769926:1024:4294967295] 9954@kfi7 LPNI seq info [315827:315827:16:4294967295]
00000400:00000200:25.0:1773851888.607878:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b2b32313 nid 9954@kfi7 refs 2
00000400:00000200:25.0:1773851888.607879:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9954@kfi7 to cpt 6
00000400:00000200:25.0:1773851888.607881:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9954@kfi7(9954@kfi7:9954@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851888.607882:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2b32313 nid 9954@kfi7 refs 3
00000800:00000200:25.0:1773851888.607884:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851888.607885:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851888.607887:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851888.607889:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 Using peer 9954@kfi7(0x97)
00000800:00000200:25.0:1773851888.607892:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007d5570ed: Posted send of 324 bytes to peer 0x97: rc=0
00000800:00000200:25.0:1773851888.607894:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851888.607896:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851888.607897:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d023b864 refcount 2 to 9763@kfi7
00010000:00000001:25.0:1773851888.607897:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851888.607898:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.607899:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851888.607899:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ff83cf3b x1859597905577664/t0(0) o400->8f3969dd-69d8-4264-8034-92654648207e@9763@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1099-0'
00000100:00100000:25.0:1773851888.607903:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff83cf3b pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:8f3969dd-69d8-4264-8034-92654648207e+5:39665:x1859597905577664:12345-9763@kfi7:400:default-tuolumne1099-0 Request processed in 62us (98us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851888.607905:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9763@kfi7, seq: 2025158
00000100:00000040:25.0:1773851888.607906:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007942adff : new rpc_count 0
00000100:00000001:25.0:1773851888.607907:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851888.607908:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:27.0:1773851888.607909:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 TN_EVENT_TX_OK event status 0
00000020:00000010:25.0:1773851888.607909:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851888.607909:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004371f0ec.
00000400:00000200:27.0:1773851888.607910:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851888.607910:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fc844a13.
00000400:00000200:27.0:1773851888.607911:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9954@kfi7: PUT: OK
00000020:00000040:25.0:1773851888.607911:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000007942adff : new refcount 4
00000400:00000200:27.0:1773851888.607912:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028f72f4c
00000100:00000001:25.0:1773851888.607912:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:27.0:1773851888.607913:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028f72f4c.
00000100:00000001:27.0:1773851888.607914:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851888.607914:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851888.607915:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2b32313 nid 9954@kfi7 refs 2
00000800:00000200:27.0:1773851888.607917:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007d5570ed: 2069@kfi7:6 -> 9954@kfi7(0000000018b07d91):0x0 lsk 152 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x97 Transaction freed
00000800:00000200:1.0:1773851888.671167:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851888.671168:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851888.671169:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851888.671171:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851888.671173:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13345@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.671175:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13345@kfi7 : PUT - for me
00000400:00000200:1.0:1773851888.671176:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13345@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.671176:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000037281dc6 nid 13345@kfi7 refs 1
00000400:00000200:1.0:1773851888.671177:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13345@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.671178:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000037281dc6 nid 13345@kfi7 refs 2
00000400:00000200:1.0:1773851888.671179:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000037281dc6 nid 13345@kfi7 refs 3
00000400:00000200:1.0:1773851888.671180:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13344@kfi7 to cpt 5
00000400:00000200:1.0:1773851888.671181:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13344@kfi7 of length 224 into portal 12 MB=0x699e114fc28c0
00000400:00000200:1.0:1773851888.671182:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13344@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 44544
00000800:00000200:1.0:1773851888.671184:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851888.671186:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.671187:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13345@kfi7: PUT: OK
00000100:00000001:1.0:1773851888.671188:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851888.671189:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851888.671190:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a99160eb.
00000100:00000040:1.0:1773851888.671190:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a99160eb x1858041859025088 msgsize 224
00000100:00100000:1.0:1773851888.671192:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-13344@kfi7 (source: 12345-13345@kfi7)
00000100:00000001:1.0:1773851888.671193:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851888.671194:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000037281dc6 nid 13345@kfi7 refs 2
00000100:00000001:0.0:1773851888.671195:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851888.671195:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851888.671196:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851888.671196:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851888.671196:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851888.671197:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851888.671198:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041859025088
00000020:00000001:0.0:1773851888.671198:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851888.671199:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b83
00000020:00000001:0.0:1773851888.671199:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851888.671201:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000020d74cb6 refcount=6
00000020:00000001:0.0:1773851888.671202:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628009984 : -107123081541632 : ffff9e9276c70800)
00000020:00000001:0.0:1773851888.671203:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628009984 : -107123081541632 : ffff9e9276c70800)
00000100:00000001:0.0:1773851888.671204:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.671205:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851888.671205:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033ae8c39.
00000020:00000010:0.0:1773851888.671206:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.671207:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851888.671207:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851888.671208:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851888.671208:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.671209:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851888.671210:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851888.671210:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.671211:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.671212:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851888.671213:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851888.671213:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851888.671213:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851888.671214:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851888.671214:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13344@kfi7, seq: 1997609
00000100:00000040:0.0:1773851888.671214:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000020d74cb6 : new rpc_count 1
00000100:00000001:1.0:1773851888.671215:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.671215:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112259840 : -106950597291776 : ffff9eba9fa3d100)
00000100:00000040:0.0:1773851888.671216:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a99160eb x1858041859025088/t0(0) o400->43ab2b44-42a7-488e-b186-ae60a81d7651@13344@kfi7:528/0 lens 224/0 e 0 to 0 dl 1773852643 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1327-0'
00000100:00000001:0.0:1773851888.671218:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.671218:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851888.671219:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a99160eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:43ab2b44-42a7-488e-b186-ae60a81d7651+6:39715:x1858041859025088:12345-13344@kfi7:400:default-tuolumne1327-0
00000100:00000200:0.0:1773851888.671221:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041859025088
00000020:00000001:0.0:1773851888.671221:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851888.671222:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851888.671222:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.671223:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851888.671223:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851888.671224:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851888.671225:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041859025088, found 0 last_xid 1858041859025087
00000020:00000001:0.0:1773851888.671225:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851888.671226:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851888.671226:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851888.671227:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.671227:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851888.671228:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851888.671228:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851888.671229:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000069f9f783.
02000000:00000001:0.0:1773851888.671230:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.671230:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.671231:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851888.671231:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182894343083, transno 0, xid 1858041859025088
00010000:00000001:0.0:1773851888.671232:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851888.671233:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a99160eb x1858041859025088/t0(0) o400->43ab2b44-42a7-488e-b186-ae60a81d7651@13344@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1327-0'
00010000:00000001:0.0:1773851888.671235:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851888.671235:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851888.671236:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=121 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851888.671237:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851888.671237:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e75c4ef4 refcount 3 to 13344@kfi7
00000100:00000001:0.0:1773851888.671238:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451328 : -107146752100288 : ffff9e8cf3e6f840)
02000000:00000001:0.0:1773851888.671239:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851888.671239:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.671240:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851888.671241:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13345@kfi7
00000400:00000010:0.0:1773851888.671241:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ee348cea.
00000100:00000200:0.0:1773851888.671242:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041859025088, offset 224
00000400:00000200:0.0:1773851888.671243:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13345@kfi7
00000400:00000200:0.0:1773851888.671244:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13345@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.671245:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000037281dc6 nid 13345@kfi7 refs 1
00000400:00000200:0.0:1773851888.671246:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000037281dc6 nid 13345@kfi7 refs 2
00000400:00000200:0.0:1773851888.671247:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000037281dc6 nid 13345@kfi7 refs 3
00000400:00000200:0.0:1773851888.671248:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13345@kfi7 local destination
00000400:00000200:0.0:1773851888.671249:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769927:8769927:1024:4294967295] 13345@kfi7 LPNI seq info [1491470:1491470:16:4294967295]
00000400:00000200:0.0:1773851888.671250:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000037281dc6 nid 13345@kfi7 refs 2
00000400:00000200:0.0:1773851888.671251:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13345@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.671253:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13345@kfi7(13345@kfi7:13345@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851888.671254:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000037281dc6 nid 13345@kfi7 refs 3
00000800:00000200:0.0:1773851888.671255:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851888.671256:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851888.671258:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851888.671260:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007c0 Using peer 13345@kfi7(0x1000000000007c0)
00000800:00000200:0.0:1773851888.671262:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x1000000000007c0: rc=0
00000800:00000200:0.0:1773851888.671263:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851888.671265:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851888.671266:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e75c4ef4 refcount 2 to 13344@kfi7
00010000:00000001:0.0:1773851888.671267:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851888.671267:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.671268:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851888.671268:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a99160eb x1858041859025088/t0(0) o400->43ab2b44-42a7-488e-b186-ae60a81d7651@13344@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1327-0'
00000100:00100000:0.0:1773851888.671271:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a99160eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:43ab2b44-42a7-488e-b186-ae60a81d7651+6:39715:x1858041859025088:12345-13344@kfi7:400:default-tuolumne1327-0 Request processed in 52us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851888.671274:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13344@kfi7, seq: 1997609
00000100:00000040:0.0:1773851888.671275:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000020d74cb6 : new rpc_count 0
00000100:00000001:0.0:1773851888.671276:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851888.671277:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851888.671277:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.671278:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851888.671279:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033ae8c39.
00000020:00000040:0.0:1773851888.671280:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000020d74cb6 : new refcount 5
00000100:00000001:0.0:1773851888.671281:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851888.671286:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007c0 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851888.671288:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.671289:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13345@kfi7: PUT: OK
00000400:00000200:1.0:1773851888.671290:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ee348cea
00000400:00000010:1.0:1773851888.671290:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ee348cea.
00000100:00000001:1.0:1773851888.671291:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851888.671292:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851888.671293:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000037281dc6 nid 13345@kfi7 refs 2
00000800:00000200:1.0:1773851888.671294:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 13345@kfi7(0000000050231b58):0x0 lsk 1985 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007c0 Transaction freed
00000800:00000200:25.0:1773851888.686903:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851888.686904:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851888.686905:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851888.686907:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851888.686909:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23489@kfi7 to cpt 6
00000400:00000200:25.0:1773851888.686911:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23489@kfi7 : PUT - for me
00000400:00000200:25.0:1773851888.686912:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23489@kfi7 to cpt 6
00000400:00000200:25.0:1773851888.686912:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b9cb3893 nid 23489@kfi7 refs 1
00000400:00000200:25.0:1773851888.686913:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23489@kfi7 to cpt 6
00000400:00000200:25.0:1773851888.686914:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b9cb3893 nid 23489@kfi7 refs 2
00000400:00000200:25.0:1773851888.686915:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b9cb3893 nid 23489@kfi7 refs 3
00000400:00000200:25.0:1773851888.686916:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23488@kfi7 to cpt 3
00000400:00000200:25.0:1773851888.686917:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23488@kfi7 of length 224 into portal 12 MB=0x69b0950c7b4c0
00000400:00000200:25.0:1773851888.686918:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23488@kfi7 of length 224/224 into md 0x16159c9699 [64] + 31304
00000800:00000200:25.0:1773851888.686920:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851888.686922:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851888.686923:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23489@kfi7: PUT: OK
00000100:00000001:25.0:1773851888.686924:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851888.686925:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851888.686926:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c1798041.
00000100:00000040:25.0:1773851888.686926:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c1798041 x1859314172540096 msgsize 224
00000100:00100000:25.0:1773851888.686928:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-23488@kfi7 (source: 12345-23489@kfi7)
00000100:00000001:25.0:1773851888.686929:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851888.686930:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b9cb3893 nid 23489@kfi7 refs 2
00000800:00000200:25.0:1773851888.686931:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000016005f0: 2054@kfi7:6 <- 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851888.686934:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851888.686934:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851888.686935:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851888.686935:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851888.686936:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851888.686937:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314172540096
00000020:00000001:25.0:1773851888.686937:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851888.686938:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d7a
00000020:00000001:25.0:1773851888.686938:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851888.686940:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e8dd83f4 refcount=6
00000020:00000001:25.0:1773851888.686941:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744419328 : -107128965132288 : ffff9e9118169000)
00000020:00000001:25.0:1773851888.686942:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744419328 : -107128965132288 : ffff9e9118169000)
00000100:00000001:25.0:1773851888.686943:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851888.686944:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851888.686944:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fc844a13.
00000020:00000010:25.0:1773851888.686945:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851888.686946:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004371f0ec.
00000100:00000001:25.0:1773851888.686947:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851888.686948:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851888.686948:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851888.686949:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851888.686950:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851888.686951:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.686952:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851888.686953:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851888.686953:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851888.686953:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851888.686954:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851888.686955:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23488@kfi7, seq: 2025159
00000100:00000001:27.0:1773851888.686956:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851888.686956:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851888.686956:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e8dd83f4 : new rpc_count 1
00000100:00000001:25.0:1773851888.686956:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252467328 : -106967457084288 : ffff9eb6b2b7cc80)
00000100:00000040:25.0:1773851888.686957:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c1798041 x1859314172540096/t0(0) o400->128ed54c-3803-4570-8754-39c6ea10671e@23488@kfi7:138/0 lens 224/0 e 0 to 0 dl 1773852253 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1955-0'
00000100:00000001:25.0:1773851888.686960:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851888.686960:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851888.686961:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c1798041 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:128ed54c-3803-4570-8754-39c6ea10671e+6:39739:x1859314172540096:12345-23488@kfi7:400:default-tuolumne1955-0
00000100:00000200:25.0:1773851888.686963:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314172540096
00000020:00000001:25.0:1773851888.686963:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851888.686964:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851888.686964:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.686965:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851888.686966:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851888.686966:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851888.686967:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314172540096, found 0 last_xid 1859314172540095
00000020:00000001:25.0:1773851888.686968:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851888.686969:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851888.686969:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851888.686970:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.686970:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851888.686971:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851888.686971:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851888.686972:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008bc13d96.
02000000:00000001:25.0:1773851888.686973:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.686973:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.686974:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851888.686975:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182034730027, transno 0, xid 1859314172540096
00010000:00000001:25.0:1773851888.686975:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851888.686977:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c1798041 x1859314172540096/t0(0) o400->128ed54c-3803-4570-8754-39c6ea10671e@23488@kfi7:138/0 lens 224/224 e 0 to 0 dl 1773852253 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1955-0'
00010000:00000001:25.0:1773851888.686979:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851888.686980:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851888.686981:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=121 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851888.686982:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851888.686983:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000bafe253 refcount 3 to 23488@kfi7
00000100:00000001:25.0:1773851888.686983:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015835168 : -107152693716448 : ffff9e8b91c11a20)
02000000:00000001:25.0:1773851888.686984:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851888.686985:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.686985:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851888.686986:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23489@kfi7
00000400:00000010:25.0:1773851888.686987:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bde8fa7d.
00000100:00000200:25.0:1773851888.686988:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314172540096, offset 224
00000400:00000200:25.0:1773851888.686989:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23489@kfi7
00000400:00000200:25.0:1773851888.686990:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23489@kfi7 to cpt 6
00000400:00000200:25.0:1773851888.686991:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b9cb3893 nid 23489@kfi7 refs 1
00000400:00000200:25.0:1773851888.686992:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b9cb3893 nid 23489@kfi7 refs 2
00000400:00000200:25.0:1773851888.686993:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b9cb3893 nid 23489@kfi7 refs 3
00000400:00000200:25.0:1773851888.686994:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23489@kfi7 local destination
00000400:00000200:25.0:1773851888.686995:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769928:8769928:1024:4294967295] 23489@kfi7 LPNI seq info [134777:134777:16:4294967295]
00000400:00000200:25.0:1773851888.686997:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b9cb3893 nid 23489@kfi7 refs 2
00000400:00000200:25.0:1773851888.686998:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23489@kfi7 to cpt 6
00000400:00000200:25.0:1773851888.687000:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23489@kfi7(23489@kfi7:23489@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851888.687001:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b9cb3893 nid 23489@kfi7 refs 3
00000800:00000200:25.0:1773851888.687002:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851888.687003:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851888.687005:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851888.687007:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003f9 Using peer 23489@kfi7(0x1000000000003f9)
00000800:00000200:25.0:1773851888.687011:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000016005f0: Posted send of 324 bytes to peer 0x1000000000003f9: rc=0
00000800:00000200:25.0:1773851888.687013:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003f9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851888.687015:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851888.687016:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000bafe253 refcount 2 to 23488@kfi7
00010000:00000001:25.0:1773851888.687017:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851888.687017:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851888.687018:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851888.687019:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c1798041 x1859314172540096/t0(0) o400->128ed54c-3803-4570-8754-39c6ea10671e@23488@kfi7:138/0 lens 224/224 e 0 to 0 dl 1773852253 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1955-0'
00000100:00100000:25.0:1773851888.687022:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c1798041 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:128ed54c-3803-4570-8754-39c6ea10671e+6:39739:x1859314172540096:12345-23488@kfi7:400:default-tuolumne1955-0 Request processed in 61us (95us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851888.687024:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23488@kfi7, seq: 2025159
00000800:00000200:27.0:1773851888.687025:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003f9 TN_EVENT_TX_OK event status 0
00000100:00000040:25.0:1773851888.687025:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e8dd83f4 : new rpc_count 0
00000400:00000200:27.0:1773851888.687026:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:25.0:1773851888.687026:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851888.687026:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:27.0:1773851888.687027:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23489@kfi7: PUT: OK
00000020:00000010:25.0:1773851888.687027:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000400:00000200:27.0:1773851888.687028:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bde8fa7d
00000020:00000010:25.0:1773851888.687028:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004371f0ec.
00000400:00000010:27.0:1773851888.687029:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bde8fa7d.
00000100:00000001:27.0:1773851888.687029:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:25.0:1773851888.687029:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fc844a13.
00000020:00000040:25.0:1773851888.687029:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000e8dd83f4 : new refcount 5
00000100:00000001:27.0:1773851888.687030:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851888.687030:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b9cb3893 nid 23489@kfi7 refs 2
00000100:00000001:25.0:1773851888.687030:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:27.0:1773851888.687032:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000016005f0: 2054@kfi7:6 -> 23489@kfi7(0000000043e4adf0):0x0 lsk 1018 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003f9 Transaction freed
00000800:00000200:9.0:1773851888.770269:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.770270:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851888.770272:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851888.770274:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851888.770277:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12259@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.770278:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12259@kfi7 : PUT - for me
00000400:00000200:9.0:1773851888.770279:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12259@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.770280:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000903b125e nid 12259@kfi7 refs 1
00000400:00000200:9.0:1773851888.770282:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12259@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.770282:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000903b125e nid 12259@kfi7 refs 2
00000400:00000200:9.0:1773851888.770283:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000903b125e nid 12259@kfi7 refs 3
00000400:00000200:9.0:1773851888.770285:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12259@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.770286:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12259@kfi7 of length 224 into portal 12 MB=0x69b4b568e0200
00000400:00000200:9.0:1773851888.770287:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12259@kfi7 of length 224/224 into md 0x78146ce49 [64] + 153176
00000800:00000200:9.0:1773851888.770289:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851888.770291:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.770292:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12259@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.770293:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851888.770294:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851888.770295:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000de7f8b62.
00000100:00000040:9.0:1773851888.770298:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000de7f8b62 x1859597737263616 msgsize 224
00000100:00100000:9.0:1773851888.770300:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-12259@kfi7 (source: 12345-12259@kfi7)
00000100:00000001:9.0:1773851888.770301:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851888.770302:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000903b125e nid 12259@kfi7 refs 2
00000100:00000001:8.0:1773851888.770303:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851888.770303:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851888.770304:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851888.770304:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851888.770305:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851888.770306:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851888.770307:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597737263616
00000020:00000001:8.0:1773851888.770308:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851888.770308:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7a112
00000020:00000001:8.0:1773851888.770309:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851888.770311:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000065fe77eb refcount=5
00000020:00000001:8.0:1773851888.770312:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108661985280 : -106965047566336 : ffff9eb742562000)
00000020:00000001:8.0:1773851888.770313:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108661985280 : -106965047566336 : ffff9eb742562000)
00000100:00000001:8.0:1773851888.770314:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851888.770314:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851888.770315:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000339c92f7.
00000020:00000010:8.0:1773851888.770317:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851888.770317:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851888.770318:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851888.770319:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851888.770319:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851888.770320:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851888.770321:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851888.770321:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.770322:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.770324:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851888.770324:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851888.770324:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851888.770324:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851888.770325:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12259@kfi7, seq: 2130839
00000100:00000001:9.0:1773851888.770326:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851888.770326:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000065fe77eb : new rpc_count 1
00000100:00000001:9.0:1773851888.770327:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.770327:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856907264 : -106914852644352 : ffff9ec2f22fda00)
00000100:00000040:8.0:1773851888.770328:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000de7f8b62 x1859597737263616/t0(0) o400->80c218f9-29ed-435d-b67a-dfcb472036be@12259@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1243-0'
00000100:00000001:8.0:1773851888.770331:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851888.770331:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851888.770332:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de7f8b62 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:80c218f9-29ed-435d-b67a-dfcb472036be+5:39567:x1859597737263616:12345-12259@kfi7:400:default-tuolumne1243-0
00000100:00000200:8.0:1773851888.770333:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597737263616
00000020:00000001:8.0:1773851888.770338:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851888.770338:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851888.770339:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.770340:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851888.770340:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851888.770341:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851888.770342:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597737263616, found 0 last_xid 1859597737263615
00000020:00000001:8.0:1773851888.770343:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851888.770343:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851888.770344:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851888.770344:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.770345:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851888.770345:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851888.770346:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851888.770347:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eeda7a28.
02000000:00000001:8.0:1773851888.770347:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.770348:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.770349:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851888.770349:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692127, transno 0, xid 1859597737263616
00010000:00000001:8.0:1773851888.770350:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851888.770351:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000de7f8b62 x1859597737263616/t0(0) o400->80c218f9-29ed-435d-b67a-dfcb472036be@12259@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1243-0'
00010000:00000001:8.0:1773851888.770353:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851888.770353:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851888.770354:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=121 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851888.770355:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851888.770356:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000693a07 refcount 3 to 12259@kfi7
00000100:00000001:8.0:1773851888.770357:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274738720 : -107155434812896 : ffff9e8aee5f4a20)
02000000:00000001:8.0:1773851888.770358:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851888.770358:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.770359:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851888.770360:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12259@kfi7
00000400:00000010:8.0:1773851888.770360:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000017f9c5c1.
00000100:00000200:8.0:1773851888.770361:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597737263616, offset 224
00000400:00000200:8.0:1773851888.770363:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12259@kfi7
00000400:00000200:8.0:1773851888.770364:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12259@kfi7 to cpt 2
00000400:00000200:8.0:1773851888.770365:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000903b125e nid 12259@kfi7 refs 1
00000400:00000200:8.0:1773851888.770366:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000903b125e nid 12259@kfi7 refs 2
00000400:00000200:8.0:1773851888.770367:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000903b125e nid 12259@kfi7 refs 3
00000400:00000200:8.0:1773851888.770368:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12259@kfi7 local destination
00000400:00000200:8.0:1773851888.770369:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769929:8769929:1024:4294967295] 12259@kfi7 LPNI seq info [223335:223335:16:4294967295]
00000400:00000200:8.0:1773851888.770371:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000903b125e nid 12259@kfi7 refs 2
00000400:00000200:8.0:1773851888.770372:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12259@kfi7 to cpt 2
00000400:00000200:8.0:1773851888.770373:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12259@kfi7(12259@kfi7:12259@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851888.770375:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000903b125e nid 12259@kfi7 refs 3
00000800:00000200:8.0:1773851888.770376:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851888.770377:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851888.770379:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851888.770381:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x865 Using peer 12259@kfi7(0x865)
00000800:00000200:8.0:1773851888.770384:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x865: rc=0
00000800:00000200:8.0:1773851888.770386:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x865 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851888.770388:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851888.770388:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000693a07 refcount 2 to 12259@kfi7
00010000:00000001:8.0:1773851888.770389:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851888.770390:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.770390:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851888.770391:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000de7f8b62 x1859597737263616/t0(0) o400->80c218f9-29ed-435d-b67a-dfcb472036be@12259@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1243-0'
00000100:00100000:8.0:1773851888.770395:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de7f8b62 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:80c218f9-29ed-435d-b67a-dfcb472036be+5:39567:x1859597737263616:12345-12259@kfi7:400:default-tuolumne1243-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851888.770397:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12259@kfi7, seq: 2130839
00000100:00000040:8.0:1773851888.770399:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000065fe77eb : new rpc_count 0
00000100:00000001:8.0:1773851888.770399:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851888.770400:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851888.770401:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851888.770401:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851888.770402:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000339c92f7.
00000020:00000040:8.0:1773851888.770403:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000065fe77eb : new refcount 4
00000100:00000001:8.0:1773851888.770404:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851888.770408:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x865 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851888.770410:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.770411:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12259@kfi7: PUT: OK
00000400:00000200:9.0:1773851888.770412:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000017f9c5c1
00000400:00000010:9.0:1773851888.770413:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000017f9c5c1.
00000100:00000001:9.0:1773851888.770413:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851888.770414:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851888.770415:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000903b125e nid 12259@kfi7 refs 2
00000800:00000200:9.0:1773851888.770416:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 12259@kfi7(00000000261653c4):0x0 lsk 2150 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x865 Transaction freed
00010000:00000001:2.0:1773851888.777731:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851888.777733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851888.777734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851888.777736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851888.777737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851888.777738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851888.777739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851888.777740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851888.777740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851888.777743:0:937830:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851888.777744:0:937830:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851888.777744:0:937830:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:2.0:1773851888.799254:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851888.799255:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851888.799256:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851888.799259:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851888.799261:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9889@kfi7 to cpt 0
00000400:00000200:2.0:1773851888.799262:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9889@kfi7 : PUT - for me
00000400:00000200:2.0:1773851888.799263:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9889@kfi7 to cpt 0
00000400:00000200:2.0:1773851888.799264:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004da4eac9 nid 9889@kfi7 refs 1
00000400:00000200:2.0:1773851888.799265:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9889@kfi7 to cpt 0
00000400:00000200:2.0:1773851888.799265:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004da4eac9 nid 9889@kfi7 refs 2
00000400:00000200:2.0:1773851888.799266:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004da4eac9 nid 9889@kfi7 refs 3
00000400:00000200:2.0:1773851888.799267:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9889@kfi7 to cpt 0
00000400:00000200:2.0:1773851888.799268:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9889@kfi7 of length 224 into portal 12 MB=0x699e0a5ce2600
00000400:00000200:2.0:1773851888.799270:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9889@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 44768
00000800:00000200:2.0:1773851888.799271:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851888.799273:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851888.799274:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9889@kfi7: PUT: OK
00000100:00000001:2.0:1773851888.799275:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851888.799276:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851888.799277:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce3b5dd9.
00000100:00000040:2.0:1773851888.799278:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000ce3b5dd9 x1858039993738752 msgsize 224
00000100:00100000:2.0:1773851888.799279:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-9889@kfi7 (source: 12345-9889@kfi7)
00000100:00000001:2.0:1773851888.799280:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851888.799281:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004da4eac9 nid 9889@kfi7 refs 2
00000800:00000200:2.0:1773851888.799282:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004991649e: 2069@kfi7:0 <- 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851888.799282:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851888.799282:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851888.799283:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851888.799283:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851888.799284:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851888.799285:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039993738752
00000020:00000001:0.0:1773851888.799286:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851888.799286:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9159b
00000020:00000001:0.0:1773851888.799287:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851888.799289:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000df3c3bd2 refcount=6
00000020:00000001:0.0:1773851888.799289:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241011200 : -107152468540416 : ffff9e8b9f2d0400)
00000020:00000001:0.0:1773851888.799290:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241011200 : -107152468540416 : ffff9e8b9f2d0400)
00000100:00000001:0.0:1773851888.799291:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.799292:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851888.799293:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033ae8c39.
00000020:00000010:0.0:1773851888.799294:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.799295:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851888.799295:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851888.799296:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851888.799296:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.799297:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851888.799298:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851888.799298:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.799299:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.799300:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851888.799301:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851888.799301:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851888.799301:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851888.799302:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851888.799302:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9889@kfi7, seq: 1997610
00000100:00000040:0.0:1773851888.799302:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000df3c3bd2 : new rpc_count 1
00000100:00000001:1.0:1773851888.799303:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.799303:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637031984540928 : -107041725010688 : ffff9ea568012d00)
00000100:00000040:0.0:1773851888.799305:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ce3b5dd9 x1858039993738752/t0(0) o400->71405191-bc67-446e-9f69-506f42125a7a@9889@kfi7:528/0 lens 224/0 e 0 to 0 dl 1773852643 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1104-0'
00000100:00000001:0.0:1773851888.799307:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.799308:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851888.799309:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce3b5dd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:71405191-bc67-446e-9f69-506f42125a7a+6:39691:x1858039993738752:12345-9889@kfi7:400:default-tuolumne1104-0
00000100:00000200:0.0:1773851888.799310:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039993738752
00000020:00000001:0.0:1773851888.799311:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851888.799312:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851888.799312:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.799313:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851888.799313:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851888.799314:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851888.799315:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039993738752, found 0 last_xid 1858039993738751
00000020:00000001:0.0:1773851888.799315:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851888.799316:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851888.799317:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851888.799317:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.799318:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851888.799318:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851888.799319:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851888.799320:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ad06efbf.
02000000:00000001:0.0:1773851888.799321:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.799321:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.799322:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851888.799323:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182769522565, transno 0, xid 1858039993738752
00010000:00000001:0.0:1773851888.799323:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851888.799324:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ce3b5dd9 x1858039993738752/t0(0) o400->71405191-bc67-446e-9f69-506f42125a7a@9889@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1104-0'
00010000:00000001:0.0:1773851888.799327:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851888.799327:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851888.799328:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=121 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851888.799329:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851888.799330:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000663968d6 refcount 3 to 9889@kfi7
00000100:00000001:0.0:1773851888.799331:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441408 : -107146751110208 : ffff9e8cf3f613c0)
02000000:00000001:0.0:1773851888.799332:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851888.799332:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.799333:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851888.799334:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9889@kfi7
00000400:00000010:0.0:1773851888.799335:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af09dc10.
00000100:00000200:0.0:1773851888.799335:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039993738752, offset 224
00000400:00000200:0.0:1773851888.799337:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9889@kfi7
00000400:00000200:0.0:1773851888.799338:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9889@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.799338:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004da4eac9 nid 9889@kfi7 refs 1
00000400:00000200:0.0:1773851888.799340:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004da4eac9 nid 9889@kfi7 refs 2
00000400:00000200:0.0:1773851888.799341:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004da4eac9 nid 9889@kfi7 refs 3
00000400:00000200:0.0:1773851888.799342:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9889@kfi7 local destination
00000400:00000200:0.0:1773851888.799343:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769930:8769930:1024:4294967295] 9889@kfi7 LPNI seq info [566814:566814:16:4294967295]
00000400:00000200:0.0:1773851888.799345:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004da4eac9 nid 9889@kfi7 refs 2
00000400:00000200:0.0:1773851888.799346:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9889@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.799347:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9889@kfi7(9889@kfi7:9889@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851888.799349:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004da4eac9 nid 9889@kfi7 refs 3
00000800:00000200:0.0:1773851888.799350:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851888.799351:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851888.799353:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851888.799355:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x37b Using peer 9889@kfi7(0x37b)
00000800:00000200:0.0:1773851888.799357:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x37b: rc=0
00000800:00000200:0.0:1773851888.799359:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x37b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851888.799360:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851888.799364:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000663968d6 refcount 2 to 9889@kfi7
00010000:00000001:0.0:1773851888.799364:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851888.799365:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.799366:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851888.799366:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce3b5dd9 x1858039993738752/t0(0) o400->71405191-bc67-446e-9f69-506f42125a7a@9889@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1104-0'
00000100:00100000:0.0:1773851888.799371:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce3b5dd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:71405191-bc67-446e-9f69-506f42125a7a+6:39691:x1858039993738752:12345-9889@kfi7:400:default-tuolumne1104-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851888.799373:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9889@kfi7, seq: 1997610
00000100:00000040:0.0:1773851888.799374:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000df3c3bd2 : new rpc_count 0
00000100:00000001:0.0:1773851888.799375:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851888.799375:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851888.799376:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.799376:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851888.799377:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033ae8c39.
00000020:00000040:0.0:1773851888.799378:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000df3c3bd2 : new refcount 5
00000100:00000001:0.0:1773851888.799379:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851888.799384:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x37b TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851888.799385:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.799387:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9889@kfi7: PUT: OK
00000400:00000200:1.0:1773851888.799387:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af09dc10
00000400:00000010:1.0:1773851888.799388:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af09dc10.
00000100:00000001:1.0:1773851888.799389:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851888.799390:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851888.799391:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004da4eac9 nid 9889@kfi7 refs 2
00000800:00000200:1.0:1773851888.799392:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9889@kfi7(000000009f902852):0x0 lsk 892 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x37b Transaction freed
00000800:00000200:1.0:1773851888.807424:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851888.807425:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851888.807427:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851888.807430:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851888.807433:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.807435:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:1.0:1773851888.807437:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.807438:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:1.0:1773851888.807439:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.807440:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:1.0:1773851888.807441:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:1.0:1773851888.807443:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.807444:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 224 into portal 12 MB=0x699e0eb484e00
00000400:00000200:1.0:1773851888.807446:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-6@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 44992
00000800:00000200:1.0:1773851888.807449:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851888.807451:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.807453:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:1.0:1773851888.807454:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851888.807455:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851888.807456:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b3dd86f.
00000100:00000040:1.0:1773851888.807457:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000005b3dd86f x1858041159372288 msgsize 224
00000100:00100000:1.0:1773851888.807459:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-6@kfi7 (source: 12345-6@kfi7)
00000100:00000001:1.0:1773851888.807461:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851888.807462:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000001:0.0:1773851888.807463:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851888.807464:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851888.807465:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851888.807465:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851888.807465:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851888.807466:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851888.807467:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041159372288
00000020:00000001:0.0:1773851888.807468:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851888.807469:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793aca2bb8
00000020:00000001:0.0:1773851888.807470:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851888.807472:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006f9ad001 refcount=5
00000020:00000001:0.0:1773851888.807473:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636930085196800 : -107143624354816 : ffff9e8dae549400)
00000020:00000001:0.0:1773851888.807474:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636930085196800 : -107143624354816 : ffff9e8dae549400)
00000100:00000001:0.0:1773851888.807475:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.807476:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851888.807477:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000033ae8c39.
00000020:00000010:0.0:1773851888.807478:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.807480:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851888.807481:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851888.807482:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851888.807482:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.807484:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851888.807484:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851888.807485:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.807486:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851888.807488:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851888.807489:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851888.807489:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851888.807490:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851888.807490:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-6@kfi7, seq: 1997611
00000100:00000001:1.0:1773851888.807491:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851888.807491:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006f9ad001 : new rpc_count 1
00000100:00000001:1.0:1773851888.807492:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.807492:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112266752 : -106950597284864 : ffff9eba9fa3ec00)
00000100:00000040:0.0:1773851888.807494:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005b3dd86f x1858041159372288/t0(0) o400->lustre5-MDT0001-lwp-OST0017_UUID@6@kfi7:528/0 lens 224/0 e 0 to 0 dl 1773852643 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba124-0'
00000100:00000001:0.0:1773851888.807498:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851888.807499:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851888.807500:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b3dd86f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre5-MDT0001-lwp-OST0017_UUID+5:272665:x1858041159372288:12345-6@kfi7:400:default-yuba124-0
00000100:00000200:0.0:1773851888.807502:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041159372288
00000020:00000001:0.0:1773851888.807503:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851888.807504:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851888.807505:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.807506:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851888.807506:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851888.807508:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:0.0:1773851888.807509:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851888.807509:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851888.807510:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851888.807511:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.807512:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851888.807512:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851888.807513:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851888.807515:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000045305c18.
02000000:00000001:0.0:1773851888.807516:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.807518:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.807518:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851888.807519:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041159372288
00010000:00000001:0.0:1773851888.807521:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851888.807522:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005b3dd86f x1858041159372288/t0(0) o400->lustre5-MDT0001-lwp-OST0017_UUID@6@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba124-0'
00010000:00000001:0.0:1773851888.807526:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851888.807527:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851888.807528:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=121 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851888.807529:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851888.807530:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a973cf2f refcount 7 to 6@kfi7
00000100:00000001:0.0:1773851888.807531:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729380896 : -107155980170720 : ffff9e8acdddca20)
02000000:00000001:0.0:1773851888.807532:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851888.807533:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851888.807534:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851888.807535:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:0.0:1773851888.807536:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003e3aad49.
00000100:00000200:0.0:1773851888.807537:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041159372288, offset 224
00000400:00000200:0.0:1773851888.807539:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000400:00000200:0.0:1773851888.807541:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.807542:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:0.0:1773851888.807543:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:0.0:1773851888.807545:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:0.0:1773851888.807547:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  6@kfi7 local destination
00000400:00000200:0.0:1773851888.807549:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769931:8769931:1024:4294967295] 6@kfi7 LPNI seq info [5405035:5405035:16:4294967295]
00000400:00000200:0.0:1773851888.807551:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:0.0:1773851888.807553:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:0.0:1773851888.807556:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851888.807558:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000800:00000200:0.0:1773851888.807561:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851888.807562:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851888.807566:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851888.807570:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000800:00000200:0.0:1773851888.807575:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000800:00000200:0.0:1773851888.807577:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851888.807580:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851888.807582:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a973cf2f refcount 6 to 6@kfi7
00010000:00000001:0.0:1773851888.807583:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851888.807584:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851888.807587:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851888.807588:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b3dd86f x1858041159372288/t0(0) o400->lustre5-MDT0001-lwp-OST0017_UUID@6@kfi7:528/0 lens 224/224 e 0 to 0 dl 1773852643 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba124-0'
00000100:00100000:0.0:1773851888.807593:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b3dd86f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre5-MDT0001-lwp-OST0017_UUID+5:272665:x1858041159372288:12345-6@kfi7:400:default-yuba124-0 Request processed in 94us (135us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851888.807596:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-6@kfi7, seq: 1997611
00000100:00000040:0.0:1773851888.807598:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006f9ad001 : new rpc_count 0
00000100:00000001:0.0:1773851888.807599:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851888.807599:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851888.807600:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851888.807601:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851888.807603:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000033ae8c39.
00000020:00000040:0.0:1773851888.807604:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000006f9ad001 : new refcount 4
00000100:00000001:0.0:1773851888.807605:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851888.807612:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851888.807615:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.807617:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000400:00000200:1.0:1773851888.807618:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003e3aad49
00000400:00000010:1.0:1773851888.807619:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003e3aad49.
00000100:00000001:1.0:1773851888.807620:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851888.807620:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851888.807621:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:1.0:1773851888.807624:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000053d Transaction freed
00000800:00000200:9.0:1773851888.812301:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851888.812301:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851888.812302:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851888.812304:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851888.812306:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22370@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.812308:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22370@kfi7 : PUT - for me
00000400:00000200:9.0:1773851888.812309:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22370@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.812309:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db88b5d7 nid 22370@kfi7 refs 1
00000400:00000200:9.0:1773851888.812311:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22370@kfi7 to cpt 2
00000400:00000200:9.0:1773851888.812311:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db88b5d7 nid 22370@kfi7 refs 2
00000400:00000200:9.0:1773851888.812313:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db88b5d7 nid 22370@kfi7 refs 3
00000400:00000200:9.0:1773851888.812313:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22371@kfi7 to cpt 5
00000400:00000200:9.0:1773851888.812314:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22371@kfi7 of length 224 into portal 12 MB=0x699e1b5343c40
00000400:00000200:9.0:1773851888.812315:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22371@kfi7 of length 224/224 into md 0x78146ce49 [64] + 153400
00000800:00000200:9.0:1773851888.812317:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851888.812319:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.812320:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22370@kfi7: PUT: OK
00000100:00000001:9.0:1773851888.812321:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851888.812321:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851888.812322:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061b0adcc.
00000100:00000040:9.0:1773851888.812322:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000061b0adcc x1858044547054656 msgsize 224
00000100:00100000:9.0:1773851888.812324:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22371@kfi7 (source: 12345-22370@kfi7)
00000100:00000001:9.0:1773851888.812325:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851888.812326:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db88b5d7 nid 22370@kfi7 refs 2
00000100:00000001:8.0:1773851888.812326:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851888.812327:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2069@kfi7:2 <- 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851888.812327:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851888.812327:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851888.812328:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851888.812328:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851888.812329:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044547054656
00000020:00000001:8.0:1773851888.812330:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851888.812330:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929c2
00000020:00000001:8.0:1773851888.812331:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851888.812334:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fea917bd refcount=6
00000020:00000001:8.0:1773851888.812334:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743180288 : -107128966371328 : ffff9e911803a800)
00000020:00000001:8.0:1773851888.812335:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743180288 : -107128966371328 : ffff9e911803a800)
00000100:00000001:8.0:1773851888.812336:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851888.812337:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851888.812338:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000339c92f7.
00000020:00000010:8.0:1773851888.812338:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851888.812339:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851888.812340:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851888.812340:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851888.812341:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851888.812342:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851888.812343:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851888.812343:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.812344:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851888.812345:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851888.812345:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851888.812346:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851888.812346:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851888.812346:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22371@kfi7, seq: 2130840
00000100:00000001:9.0:1773851888.812348:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851888.812348:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851888.812348:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fea917bd : new rpc_count 1
00000100:00000001:8.0:1773851888.812348:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856899200 : -106914852652416 : ffff9ec2f22fba80)
00000100:00000040:8.0:1773851888.812349:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000061b0adcc x1858044547054656/t0(0) o400->1315454d-fbc4-48d3-b732-525d05f309f8@22371@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1884-0'
00000100:00000001:8.0:1773851888.812352:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851888.812352:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851888.812353:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061b0adcc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1315454d-fbc4-48d3-b732-525d05f309f8+6:39642:x1858044547054656:12345-22371@kfi7:400:default-tuolumne1884-0
00000100:00000200:8.0:1773851888.812355:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044547054656
00000020:00000001:8.0:1773851888.812355:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851888.812356:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851888.812356:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.812357:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851888.812357:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851888.812358:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851888.812359:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044547054656, found 0 last_xid 1858044547054655
00000020:00000001:8.0:1773851888.812359:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851888.812360:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851888.812361:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851888.812361:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.812362:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851888.812362:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851888.812363:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851888.812363:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e602d741.
02000000:00000001:8.0:1773851888.812364:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.812364:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.812365:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851888.812366:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044145140, transno 0, xid 1858044547054656
00010000:00000001:8.0:1773851888.812366:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851888.812367:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000061b0adcc x1858044547054656/t0(0) o400->1315454d-fbc4-48d3-b732-525d05f309f8@22371@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1884-0'
00010000:00000001:8.0:1773851888.812370:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851888.812370:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851888.812372:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=121 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851888.812373:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851888.812373:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b8b84d82 refcount 3 to 22371@kfi7
00000100:00000001:8.0:1773851888.812375:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450848 : -107146752100768 : ffff9e8cf3e6f660)
02000000:00000001:8.0:1773851888.812375:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851888.812376:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851888.812376:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851888.812377:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22370@kfi7
00000400:00000010:8.0:1773851888.812378:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc2dfd46.
00000100:00000200:8.0:1773851888.812379:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044547054656, offset 224
00000400:00000200:8.0:1773851888.812380:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22370@kfi7
00000400:00000200:8.0:1773851888.812381:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22370@kfi7 to cpt 2
00000400:00000200:8.0:1773851888.812382:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db88b5d7 nid 22370@kfi7 refs 1
00000400:00000200:8.0:1773851888.812383:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db88b5d7 nid 22370@kfi7 refs 2
00000400:00000200:8.0:1773851888.812384:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db88b5d7 nid 22370@kfi7 refs 3
00000400:00000200:8.0:1773851888.812385:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22370@kfi7 local destination
00000400:00000200:8.0:1773851888.812386:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769932:8769932:1024:4294967295] 22370@kfi7 LPNI seq info [161785:161785:16:4294967295]
00000400:00000200:8.0:1773851888.812387:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db88b5d7 nid 22370@kfi7 refs 2
00000400:00000200:8.0:1773851888.812388:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22370@kfi7 to cpt 2
00000400:00000200:8.0:1773851888.812390:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22370@kfi7(22370@kfi7:22370@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851888.812391:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db88b5d7 nid 22370@kfi7 refs 3
00000800:00000200:8.0:1773851888.812393:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851888.812394:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851888.812396:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851888.812398:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe64 Using peer 22370@kfi7(0xe64)
00000800:00000200:8.0:1773851888.812401:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0xe64: rc=0
00000800:00000200:8.0:1773851888.812403:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe64 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851888.812407:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851888.812408:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b8b84d82 refcount 2 to 22371@kfi7
00010000:00000001:8.0:1773851888.812408:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851888.812409:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851888.812410:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851888.812412:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061b0adcc x1858044547054656/t0(0) o400->1315454d-fbc4-48d3-b732-525d05f309f8@22371@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1884-0'
00000100:00100000:8.0:1773851888.812415:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061b0adcc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1315454d-fbc4-48d3-b732-525d05f309f8+6:39642:x1858044547054656:12345-22371@kfi7:400:default-tuolumne1884-0 Request processed in 62us (91us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851888.812417:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22371@kfi7, seq: 2130840
00000100:00000040:8.0:1773851888.812418:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fea917bd : new rpc_count 0
00000100:00000001:8.0:1773851888.812419:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851888.812419:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851888.812420:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851888.812421:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851888.812422:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000339c92f7.
00000020:00000040:8.0:1773851888.812423:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000fea917bd : new refcount 5
00000100:00000001:8.0:1773851888.812423:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851888.812428:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe64 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851888.812430:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851888.812431:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22370@kfi7: PUT: OK
00000400:00000200:9.0:1773851888.812432:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc2dfd46
00000400:00000010:9.0:1773851888.812432:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc2dfd46.
00000100:00000001:9.0:1773851888.812433:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851888.812433:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851888.812434:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db88b5d7 nid 22370@kfi7 refs 2
00000800:00000200:9.0:1773851888.812435:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22370@kfi7(00000000362e056c):0x0 lsk 3685 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe64 Transaction freed
00000800:00000200:13.0:1773851888.887064:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851888.887065:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851888.887066:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851888.887068:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851888.887070:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26368@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.887072:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26368@kfi7 : PUT - for me
00000400:00000200:13.0:1773851888.887072:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26368@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.887074:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007100fb84 nid 26368@kfi7 refs 1
00000400:00000200:13.0:1773851888.887076:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26368@kfi7 to cpt 3
00000400:00000200:13.0:1773851888.887076:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007100fb84 nid 26368@kfi7 refs 2
00000400:00000200:13.0:1773851888.887077:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007100fb84 nid 26368@kfi7 refs 3
00000400:00000200:13.0:1773851888.887078:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26369@kfi7 to cpt 6
00000400:00000200:13.0:1773851888.887079:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26369@kfi7 of length 224 into portal 12 MB=0x69b2e65795200
00000400:00000200:13.0:1773851888.887080:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26369@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 46936
00000800:00000200:13.0:1773851888.887082:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851888.887083:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851888.887085:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26368@kfi7: PUT: OK
00000100:00000001:13.0:1773851888.887086:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851888.887086:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851888.887087:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f3007ed9.
00000100:00000040:13.0:1773851888.887088:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000f3007ed9 x1859473433514496 msgsize 224
00000100:00100000:13.0:1773851888.887089:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-26369@kfi7 (source: 12345-26368@kfi7)
00000100:00000001:13.0:1773851888.887090:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851888.887091:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007100fb84 nid 26368@kfi7 refs 2
00000800:00000200:13.0:1773851888.887092:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851888.887092:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851888.887092:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851888.887093:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851888.887093:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851888.887094:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851888.887095:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859473433514496
00000020:00000001:12.0:1773851888.887095:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851888.887096:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c9b8f0fac
00000020:00000001:12.0:1773851888.887097:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851888.887101:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b2160692 refcount=5
00000020:00000001:12.0:1773851888.887102:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106222291968 : -106967487259648 : ffff9eb6b0eb5c00)
00000020:00000001:12.0:1773851888.887103:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106222291968 : -106967487259648 : ffff9eb6b0eb5c00)
00000100:00000001:12.0:1773851888.887105:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.887105:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851888.887106:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000380f7712.
00000020:00000010:12.0:1773851888.887107:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.887108:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000084c0a733.
00000100:00000001:12.0:1773851888.887109:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851888.887109:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851888.887110:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851888.887111:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851888.887111:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851888.887112:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.887113:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851888.887114:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851888.887114:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851888.887115:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851888.887115:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851888.887116:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26369@kfi7, seq: 2289900
00000100:00000040:12.0:1773851888.887116:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b2160692 : new rpc_count 1
00000100:00000001:15.0:1773851888.887117:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851888.887117:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.887117:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485621120 : -107000223930496 : ffff9eaf11a96780)
00000100:00000040:12.0:1773851888.887118:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f3007ed9 x1859473433514496/t0(0) o400->a34b7826-062a-4b40-a7d9-c4f1cbad18ac@26369@kfi7:615/0 lens 224/0 e 0 to 0 dl 1773851975 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2147-0'
00000100:00000001:12.0:1773851888.887121:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851888.887122:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851888.887123:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3007ed9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a34b7826-062a-4b40-a7d9-c4f1cbad18ac+5:39654:x1859473433514496:12345-26369@kfi7:400:default-tuolumne2147-0
00000100:00000200:12.0:1773851888.887124:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859473433514496
00000020:00000001:12.0:1773851888.887125:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851888.887125:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851888.887126:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.887127:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851888.887127:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851888.887128:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851888.887129:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859473433514496, found 0 last_xid 1859473433514495
00000020:00000001:12.0:1773851888.887129:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851888.887131:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851888.887131:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851888.887132:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.887132:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851888.887133:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851888.887133:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851888.887134:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b96e46cc.
02000000:00000001:12.0:1773851888.887135:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.887135:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.887136:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851888.887137:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183082989267, transno 0, xid 1859473433514496
00010000:00000001:12.0:1773851888.887138:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851888.887138:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f3007ed9 x1859473433514496/t0(0) o400->a34b7826-062a-4b40-a7d9-c4f1cbad18ac@26369@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2147-0'
00010000:00000001:12.0:1773851888.887141:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851888.887141:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851888.887142:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=121 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851888.887143:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851888.887144:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001ba2746e refcount 3 to 26369@kfi7
00000100:00000001:12.0:1773851888.887145:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366320576 : -107142343231040 : ffff9e8dfab0f9c0)
02000000:00000001:12.0:1773851888.887145:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851888.887146:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851888.887147:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851888.887147:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26368@kfi7
00000400:00000010:12.0:1773851888.887148:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003df794fb.
00000100:00000200:12.0:1773851888.887149:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859473433514496, offset 224
00000400:00000200:12.0:1773851888.887150:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26368@kfi7
00000400:00000200:12.0:1773851888.887151:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26368@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.887152:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007100fb84 nid 26368@kfi7 refs 1
00000400:00000200:12.0:1773851888.887153:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007100fb84 nid 26368@kfi7 refs 2
00000400:00000200:12.0:1773851888.887154:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007100fb84 nid 26368@kfi7 refs 3
00000400:00000200:12.0:1773851888.887155:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26368@kfi7 local destination
00000400:00000200:12.0:1773851888.887156:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769933:8769933:1024:4294967295] 26368@kfi7 LPNI seq info [43965:43965:16:4294967295]
00000400:00000200:12.0:1773851888.887158:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007100fb84 nid 26368@kfi7 refs 2
00000400:00000200:12.0:1773851888.887160:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26368@kfi7 to cpt 3
00000400:00000200:12.0:1773851888.887162:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26368@kfi7(26368@kfi7:26368@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851888.887163:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007100fb84 nid 26368@kfi7 refs 3
00000800:00000200:12.0:1773851888.887164:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851888.887165:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851888.887168:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851888.887170:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x58e Using peer 26368@kfi7(0x58e)
00000800:00000200:12.0:1773851888.887173:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x58e: rc=0
00000800:00000200:12.0:1773851888.887174:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x58e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851888.887176:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851888.887177:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001ba2746e refcount 2 to 26369@kfi7
00010000:00000001:12.0:1773851888.887178:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851888.887178:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851888.887179:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851888.887180:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f3007ed9 x1859473433514496/t0(0) o400->a34b7826-062a-4b40-a7d9-c4f1cbad18ac@26369@kfi7:615/0 lens 224/224 e 0 to 0 dl 1773851975 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2147-0'
00000100:00100000:12.0:1773851888.887185:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3007ed9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:a34b7826-062a-4b40-a7d9-c4f1cbad18ac+5:39654:x1859473433514496:12345-26369@kfi7:400:default-tuolumne2147-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851888.887187:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26369@kfi7, seq: 2289900
00000100:00000040:12.0:1773851888.887188:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b2160692 : new rpc_count 0
00000100:00000001:12.0:1773851888.887188:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851888.887189:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851888.887190:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851888.887190:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000084c0a733.
00000020:00000010:12.0:1773851888.887191:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000380f7712.
00000020:00000040:12.0:1773851888.887192:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000b2160692 : new refcount 4
00000100:00000001:12.0:1773851888.887192:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851888.887198:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x58e TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851888.887199:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851888.887200:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26368@kfi7: PUT: OK
00000400:00000200:13.0:1773851888.887201:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003df794fb
00000400:00000010:13.0:1773851888.887201:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003df794fb.
00000100:00000001:13.0:1773851888.887202:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851888.887202:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851888.887203:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007100fb84 nid 26368@kfi7 refs 2
00000800:00000200:13.0:1773851888.887204:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 26368@kfi7(000000006d27c924):0x0 lsk 1423 rsk 19 tsk 0 trmk 0 tmk 0 trr 3 tta 0x58e Transaction freed
00000004:00000001:29.0:1773851888.969732:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851888.969732:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:25.0:1773851888.969732:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:29.0:1773851888.969733:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce548e2b.
00000004:00000020:25.0:1773851888.969733:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:29.0:1773851888.969734:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000100:00000010:25.0:1773851888.969734:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c641515d.
00000100:00000001:29.0:1773851888.969735:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:25.0:1773851888.969735:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
02000000:00000001:29.0:1773851888.969736:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851888.969736:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851888.969737:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:25.0:1773851888.969737:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851888.969738:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851888.969738:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:29.0:1773851888.969739:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:25.0:1773851888.969739:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.969740:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851888.969740:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000014a6e7aa.
00000100:00000040:29.0:1773851888.969741:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ce548e2b] to pc [ptlrpcd_07_00+0]  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851888.969742:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851888.969743:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851888.969745:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969746:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851888.969746:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:29.0:1773851888.969746:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851888.969747:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:29.0:1773851888.969747:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000007871486c.
00000100:00000040:25.0:1773851888.969747:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c641515d] to pc [ptlrpcd_06_00+0]  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851888.969748:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851888.969748:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637002482421760 : -107071227129856 : ffff9e9e898a9000)
00000100:00000001:31.0:1773851888.969749:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851888.969749:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851888.969749:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851888.969750:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969751:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851888.969751:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851888.969751:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
02000000:00000001:30.0:1773851888.969752:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:29.0:1773851888.969752:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009b0d95cc.
00000004:00080000:29.0:1773851888.969752:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614163423028047ns, next at 614164423026874ns, rc = 0
02000000:00000001:30.0:1773851888.969753:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851888.969753:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:30.0:1773851888.969754:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce548e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051937024:2090@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851888.969754:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851888.969754:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:25.0:1773851888.969754:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851888.969755:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:29.0:1773851888.969755:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851888.969755:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851888.969755:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851888.969755:0:41084:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:30.0:1773851888.969756:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:27.0:1773851888.969756:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851888.969756:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:25.0:1773851888.969756:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f74b0cda.
02000000:00000001:30.0:1773851888.969757:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851888.969757:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:25.0:1773851888.969757:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130207111168 : -106943502440448 : ffff9ebc4686a800)
02000000:00000010:30.0:1773851888.969758:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008738247e.
00080000:00000001:25.0:1773851888.969758:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:30.0:1773851888.969759:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851888.969759:0:41084:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000200:30.0:1773851888.969760:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:26.0:1773851888.969760:0:41084:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851888.969760:0:41084:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:25.0:1773851888.969760:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851888.969761:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
02000000:00000001:26.0:1773851888.969761:0:41084:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:25.0:1773851888.969761:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000400:00000010:30.0:1773851888.969762:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013884923.
00000100:00100000:26.0:1773851888.969762:0:41084:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c641515d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051937088:2068@kfi7:13:default-yuba2-0
00000004:00000010:25.0:1773851888.969762:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b83608d2.
00000100:00000200:30.0:1773851888.969763:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937024, portal 4
00000100:00000001:26.0:1773851888.969763:0:41084:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851888.969764:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851888.969764:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130262231680 : -106943447319936 : ffff9ebc49cfba80)
02000000:00000001:26.0:1773851888.969764:0:41084:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:26.0:1773851888.969764:0:41084:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:25.0:1773851888.969764:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614163423039147ns, next at 614164423037454ns, rc = 0
02000000:00000001:26.0:1773851888.969765:0:41084:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:25.0:1773851888.969765:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:30.0:1773851888.969766:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:26.0:1773851888.969766:0:41084:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000513e7f5d.
02000000:00000001:26.0:1773851888.969766:0:41084:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851888.969766:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851888.969767:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969768:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:26.0:1773851888.969768:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000010:26.0:1773851888.969768:0:41084:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f00e36c9.
00000100:00000040:30.0:1773851888.969769:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:26.0:1773851888.969769:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005872c184.
00000400:00000010:30.0:1773851888.969770:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000008a5c228.
00000100:00000200:26.0:1773851888.969770:0:41084:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937088, portal 4
00000100:00000200:30.0:1773851888.969771:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937024, offset 0
00000100:00000001:26.0:1773851888.969771:0:41084:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:30.0:1773851888.969772:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000100:00000001:26.0:1773851888.969772:0:41084:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637106252451200 : -106967457100416 : ffff9eb6b2b78d80)
00000100:00000040:26.0:1773851888.969773:0:41084:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851888.969774:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:30.0:1773851888.969775:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:30.0:1773851888.969776:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:26.0:1773851888.969776:0:41084:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851888.969777:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000040:26.0:1773851888.969777:0:41084:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:26.0:1773851888.969777:0:41084:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006063c4f0.
00000400:00000200:30.0:1773851888.969778:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000100:00000200:26.0:1773851888.969778:0:41084:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937088, offset 0
00000400:00000200:26.0:1773851888.969779:0:41084:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:30.0:1773851888.969780:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769933, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769931, p:4294967295, g:4294967295, h:1000]
00000400:00000200:26.0:1773851888.969780:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:26.0:1773851888.969781:0:41084:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:30.0:1773851888.969782:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851888.969783:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851888.969783:0:41084:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851888.969784:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:26.0:1773851888.969784:0:41084:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851888.969785:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769934:8769934:1024:4294967295] 2090@kfi7 LPNI seq info [5404254:5404254:16:4294967295]
00000400:00000200:26.0:1773851888.969785:0:41084:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:26.0:1773851888.969787:0:41084:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769933, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769934, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851888.969788:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:30.0:1773851888.969789:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:26.0:1773851888.969789:0:41084:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:26.0:1773851888.969790:0:41084:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851888.969791:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851888.969791:0:41084:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:26.0:1773851888.969792:0:41084:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769935:8769935:1024:4294967295] 2068@kfi7 LPNI seq info [5403702:5403702:16:4294967295]
00000400:00000200:30.0:1773851888.969793:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:26.0:1773851888.969793:0:41084:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:30.0:1773851888.969794:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:26.0:1773851888.969795:0:41084:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:30.0:1773851888.969796:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:26.0:1773851888.969797:0:41084:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000800:00000200:30.0:1773851888.969798:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:26.0:1773851888.969798:0:41084:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:26.0:1773851888.969800:0:41084:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:30.0:1773851888.969801:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f Using peer 2090@kfi7(0x20000000000002f)
00000800:00000200:26.0:1773851888.969802:0:41084:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851888.969804:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bc942d61: Posted send of 324 bytes to peer 0x20000000000002f: rc=0
00000800:00000200:26.0:1773851888.969804:0:41084:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851888.969806:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:26.0:1773851888.969807:0:41084:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Using peer 2068@kfi7(0x62f)
00000100:00000001:30.0:1773851888.969808:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969809:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851888.969809:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969810:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969810:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.969811:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:26.0:1773851888.969811:0:41084:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0x62f: rc=0
00000100:00000001:30.0:1773851888.969812:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851888.969813:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851888.969813:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:26.0:1773851888.969813:0:41084:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851888.969814:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969814:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851888.969815:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851888.969815:0:41084:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851888.969815:0:41084:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851888.969816:0:41084:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851888.969817:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851888.969817:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851888.969818:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2090@kfi7: PUT: OK
00000100:00000001:26.0:1773851888.969818:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851888.969819:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000008a5c228
00000100:00000001:26.0:1773851888.969819:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851888.969819:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000010:29.0:1773851888.969820:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000008a5c228.
00000100:00000001:29.0:1773851888.969820:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:26.0:1773851888.969820:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:29.0:1773851888.969821:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851888.969821:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851888.969821:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851888.969822:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.969824:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851888.969824:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:27.0:1773851888.969824:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851888.969826:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851888.969827:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851888.969827:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:27.0:1773851888.969827:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000400:00000200:29.0:1773851888.969828:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851888.969828:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006063c4f0
00000400:00000010:27.0:1773851888.969828:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006063c4f0.
00000100:00000001:27.0:1773851888.969829:0:2464256:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851888.969830:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000002f Transaction freed
00000100:00000200:27.0:1773851888.969830:0:2464256:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851888.969833:0:2464256:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:27.0:1773851888.969834:0:2464256:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851888.969836:0:2464256:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851888.969836:0:2464256:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:27.0:1773851888.969837:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:27.0:1773851888.969839:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Transaction freed
00000800:00000200:22.0:1773851888.969853:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851888.969854:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851888.969855:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851888.969857:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851888.969859:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851888.969860:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:22.0:1773851888.969861:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851888.969862:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:22.0:1773851888.969863:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851888.969863:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:22.0:1773851888.969864:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:22.0:1773851888.969865:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851888.969866:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5940
00000800:00000200:1.0:1773851888.969866:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:22.0:1773851888.969867:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:1.0:1773851888.969867:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:22.0:1773851888.969868:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d1955 [1] + 224
00000800:00000200:1.0:1773851888.969868:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851888.969870:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851888.969870:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851888.969872:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851888.969872:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:22.0:1773851888.969873:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000400:00000200:1.0:1773851888.969874:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2090@kfi7 : PUT - for me
00000100:00000001:22.0:1773851888.969875:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851888.969875:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.969875:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000100:00000200:22.0:1773851888.969876:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851888.969877:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.969877:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851888.969878:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000040:22.0:1773851888.969879:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851888.969879:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851888.969881:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5900
00000400:00000200:1.0:1773851888.969882:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:22.0:1773851888.969883:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:22.0:1773851888.969884:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:1.0:1773851888.969884:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71e0a1 [1] + 224
00000100:00000001:26.0:1773851888.969885:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851888.969885:0:41084:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:22.0:1773851888.969885:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:26.0:1773851888.969886:0:41084:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:26.0:1773851888.969886:0:41084:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:1.0:1773851888.969886:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:26.0:1773851888.969887:0:41084:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f00e36c9.
00000400:00000200:26.0:1773851888.969888:0:41084:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005872c184
00000400:00000200:1.0:1773851888.969888:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:26.0:1773851888.969889:0:41084:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005872c184.
00000400:00000200:1.0:1773851888.969889:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2090@kfi7: PUT: OK
00000100:00000001:26.0:1773851888.969890:0:41084:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:1.0:1773851888.969890:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:26.0:1773851888.969891:0:41084:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:1.0:1773851888.969891:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:26.0:1773851888.969894:0:41084:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851888.969894:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851888.969896:0:41084:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851888.969897:0:41084:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851888.969897:0:41084:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:26.0:1773851888.969898:0:41084:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:1.0:1773851888.969898:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851888.969899:0:41084:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851888.969899:0:41084:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851888.969899:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851888.969900:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:26.0:1773851888.969900:0:41084:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969901:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:26.0:1773851888.969901:0:41084:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=121 v=66 (66 66 66 66)
00000800:00000200:1.0:1773851888.969901:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2090@kfi7(0000000095f1d953):0x0 lsk 48 rsk 4790 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851888.969902:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851888.969902:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:26.0:1773851888.969902:0:41084:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=121 v=66 (1 1 1 1)
00000400:00000010:30.0:1773851888.969903:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:26.0:1773851888.969903:0:41084:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:26.0:1773851888.969903:0:41084:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851888.969904:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013884923
00010000:00000001:26.0:1773851888.969904:0:41084:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:26.0:1773851888.969904:0:41084:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851888.969905:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013884923.
00000100:00000001:26.0:1773851888.969905:0:41084:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851888.969906:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:30.0:1773851888.969906:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:26.0:1773851888.969906:0:41084:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:26.0:1773851888.969906:0:41084:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851888.969907:0:41084:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851888.969908:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:30.0:1773851888.969910:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851888.969910:0:41084:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851888.969911:0:41084:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851888.969912:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851888.969912:0:41084:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.969913:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.969913:0:41088:0:(client.c:1428:after_reply()) Process entered
00000004:00000001:26.0:1773851888.969913:0:41084:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:30.0:1773851888.969914:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851888.969914:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000040:26.0:1773851888.969914:0:41084:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:26.0:1773851888.969914:0:41084:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350959016960 avail=350956941312 avail_mb=1370925552 hwm_mb=3131103 files=371563972 ffree=342733415 state=0: rc = 0
00000100:00000001:30.0:1773851888.969915:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851888.969916:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:26.0:1773851888.969916:0:41084:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350959016960 free, 350956941312 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371563972 files, 342733415 free files
00000100:00001000:30.0:1773851888.969917:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=121 v=66 (66 66 66 66)
00000100:00001000:30.0:1773851888.969918:0:41088:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=121 v=66 (1 1 1 1)
00000004:00000001:26.0:1773851888.969918:0:41084:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969919:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851888.969919:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851888.969919:0:41084:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:30.0:1773851888.969920:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851888.969920:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969921:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851888.969922:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00100000:26.0:1773851888.969922:0:41084:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c641515d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_00:lustre5-MDT0001-mdtlov_UUID:41084:1859433051937088:2068@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851888.969923:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851888.969923:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851888.969924:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851888.969924:0:41084:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851888.969924:0:41084:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851888.969925:0:41084:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c641515d x1859433051937088/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851888.969927:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851888.969927:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851888.969928:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851888.969928:0:41084:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:26.0:1773851888.969928:0:41084:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:30.0:1773851888.969929:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851888.969929:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
02000000:00000010:26.0:1773851888.969929:0:41084:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000513e7f5d.
00000004:00000040:30.0:1773851888.969930:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351388919808 avail=351386260480 avail_mb=1372602580 hwm_mb=3131103 files=372018983 ffree=343153242 state=0: rc = 0
02000000:00000001:26.0:1773851888.969930:0:41084:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851888.969930:0:41084:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851888.969931:0:41084:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:26.0:1773851888.969931:0:41084:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000020:30.0:1773851888.969932:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351388919808 free, 351386260480 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372018983 files, 343153242 free files
02000000:00000010:26.0:1773851888.969932:0:41084:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000014a6e7aa.
00000004:00000001:30.0:1773851888.969933:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851888.969933:0:41084:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851888.969933:0:41084:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:30.0:1773851888.969934:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:26.0:1773851888.969934:0:41084:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c641515d.
00000100:00000001:26.0:1773851888.969935:0:41084:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851888.969935:0:41084:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851888.969936:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851888.969936:0:41084:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851888.969937:0:41084:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851888.969937:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851888.969938:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851888.969940:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce548e2b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051937024:2090@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851888.969942:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.969943:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851888.969943:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ce548e2b x1859433051937024/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852041 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851888.969946:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851888.969946:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851888.969947:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008738247e.
02000000:00000001:30.0:1773851888.969948:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851888.969949:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851888.969949:0:41088:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000001:30.0:1773851888.969950:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851888.969950:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
02000000:00000001:30.0:1773851888.969951:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851888.969952:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851888.969952:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce548e2b.
00000100:00000001:30.0:1773851888.969953:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851888.969953:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.969954:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851888.969955:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851888.969955:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851888.969956:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851888.969956:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851889.093999:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851889.094000:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851889.094001:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851889.094003:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851889.094005:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21498@kfi7 to cpt 2
00000400:00000200:9.0:1773851889.094007:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21498@kfi7 : PUT - for me
00000400:00000200:9.0:1773851889.094007:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21498@kfi7 to cpt 2
00000400:00000200:9.0:1773851889.094008:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d47d7c0c nid 21498@kfi7 refs 1
00000400:00000200:9.0:1773851889.094009:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21498@kfi7 to cpt 2
00000400:00000200:9.0:1773851889.094010:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d47d7c0c nid 21498@kfi7 refs 2
00000400:00000200:9.0:1773851889.094011:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d47d7c0c nid 21498@kfi7 refs 3
00000400:00000200:9.0:1773851889.094012:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21498@kfi7 to cpt 2
00000400:00000200:9.0:1773851889.094013:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21498@kfi7 of length 224 into portal 12 MB=0x699de8dc154c0
00000400:00000200:9.0:1773851889.094014:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21498@kfi7 of length 224/224 into md 0x78146ce49 [64] + 153624
00000800:00000200:9.0:1773851889.094015:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851889.094017:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851889.094018:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21498@kfi7: PUT: OK
00000100:00000001:9.0:1773851889.094019:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851889.094019:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851889.094020:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a18ef87a.
00000100:00000040:9.0:1773851889.094021:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000a18ef87a x1858031000310976 msgsize 224
00000100:00100000:9.0:1773851889.094023:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21498@kfi7 (source: 12345-21498@kfi7)
00000100:00000001:9.0:1773851889.094024:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851889.094025:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d47d7c0c nid 21498@kfi7 refs 2
00000100:00000001:8.0:1773851889.094025:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851889.094026:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851889.094026:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851889.094026:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851889.094027:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851889.094028:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851889.094028:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031000310976
00000020:00000001:8.0:1773851889.094029:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851889.094029:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9123e
00000020:00000001:8.0:1773851889.094030:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851889.094034:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e3c315dc refcount=6
00000020:00000001:8.0:1773851889.094035:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240530944 : -107152469020672 : ffff9e8b9f25b000)
00000020:00000001:8.0:1773851889.094036:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240530944 : -107152469020672 : ffff9e8b9f25b000)
00000100:00000001:8.0:1773851889.094037:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851889.094038:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851889.094039:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000339c92f7.
00000020:00000010:8.0:1773851889.094040:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851889.094041:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851889.094042:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851889.094042:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851889.094043:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851889.094044:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851889.094044:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851889.094045:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.094046:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851889.094047:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851889.094047:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851889.094047:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851889.094047:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851889.094048:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21498@kfi7, seq: 2130841
00000100:00000001:9.0:1773851889.094049:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851889.094049:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851889.094049:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e3c315dc : new rpc_count 1
00000100:00000001:8.0:1773851889.094049:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856902656 : -106914852648960 : ffff9ec2f22fc800)
00000100:00000040:8.0:1773851889.094051:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a18ef87a x1858031000310976/t0(0) o400->90fe9134-a0ae-4bc1-becc-61a6c1a1183f@21498@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne252-0'
00000100:00000001:8.0:1773851889.094053:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851889.094054:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851889.094055:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a18ef87a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:90fe9134-a0ae-4bc1-becc-61a6c1a1183f+6:47788:x1858031000310976:12345-21498@kfi7:400:default-tuolumne252-0
00000100:00000200:8.0:1773851889.094056:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031000310976
00000020:00000001:8.0:1773851889.094057:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851889.094058:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851889.094058:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851889.094059:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851889.094060:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851889.094061:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851889.094061:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031000310976, found 0 last_xid 1858031000310975
00000020:00000001:8.0:1773851889.094062:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851889.094063:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851889.094063:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851889.094063:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851889.094065:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851889.094065:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851889.094066:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851889.094066:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002e308d77.
02000000:00000001:8.0:1773851889.094067:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.094068:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851889.094068:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851889.094069:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768087, transno 0, xid 1858031000310976
00010000:00000001:8.0:1773851889.094070:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851889.094071:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a18ef87a x1858031000310976/t0(0) o400->90fe9134-a0ae-4bc1-becc-61a6c1a1183f@21498@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne252-0'
00010000:00000001:8.0:1773851889.094073:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851889.094074:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851889.094074:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=122 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851889.094075:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851889.094076:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d045e12c refcount 5 to 21498@kfi7
00000100:00000001:8.0:1773851889.094077:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810484928 : -107154899066688 : ffff9e8b0e4e20c0)
02000000:00000001:8.0:1773851889.094078:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851889.094078:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.094079:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851889.094079:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21498@kfi7
00000400:00000010:8.0:1773851889.094080:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000b6b4cce.
00000100:00000200:8.0:1773851889.094081:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031000310976, offset 224
00000400:00000200:8.0:1773851889.094082:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21498@kfi7
00000400:00000200:8.0:1773851889.094083:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21498@kfi7 to cpt 2
00000400:00000200:8.0:1773851889.094084:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d47d7c0c nid 21498@kfi7 refs 1
00000400:00000200:8.0:1773851889.094085:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d47d7c0c nid 21498@kfi7 refs 2
00000400:00000200:8.0:1773851889.094086:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d47d7c0c nid 21498@kfi7 refs 3
00000400:00000200:8.0:1773851889.094087:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21498@kfi7 local destination
00000400:00000200:8.0:1773851889.094088:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769936:8769936:1024:4294967295] 21498@kfi7 LPNI seq info [28063:28063:16:4294967295]
00000400:00000200:8.0:1773851889.094089:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d47d7c0c nid 21498@kfi7 refs 2
00000400:00000200:8.0:1773851889.094090:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21498@kfi7 to cpt 2
00000400:00000200:8.0:1773851889.094092:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21498@kfi7(21498@kfi7:21498@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851889.094094:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d47d7c0c nid 21498@kfi7 refs 3
00000800:00000200:8.0:1773851889.094095:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851889.094096:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851889.094098:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851889.094101:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000833 Using peer 21498@kfi7(0x100000000000833)
00000800:00000200:8.0:1773851889.094104:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x100000000000833: rc=0
00000800:00000200:8.0:1773851889.094105:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000833 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851889.094107:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851889.094108:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d045e12c refcount 4 to 21498@kfi7
00010000:00000001:8.0:1773851889.094109:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851889.094109:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851889.094110:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851889.094111:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a18ef87a x1858031000310976/t0(0) o400->90fe9134-a0ae-4bc1-becc-61a6c1a1183f@21498@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne252-0'
00000100:00100000:8.0:1773851889.094115:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a18ef87a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:90fe9134-a0ae-4bc1-becc-61a6c1a1183f+6:47788:x1858031000310976:12345-21498@kfi7:400:default-tuolumne252-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851889.094117:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21498@kfi7, seq: 2130841
00000100:00000040:8.0:1773851889.094118:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e3c315dc : new rpc_count 0
00000100:00000001:8.0:1773851889.094118:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851889.094119:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851889.094120:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851889.094120:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851889.094121:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000339c92f7.
00000020:00000040:8.0:1773851889.094122:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e3c315dc : new refcount 5
00000100:00000001:8.0:1773851889.094123:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851889.094128:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000833 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851889.094129:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851889.094130:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21498@kfi7: PUT: OK
00000400:00000200:9.0:1773851889.094131:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000b6b4cce
00000400:00000010:9.0:1773851889.094132:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000b6b4cce.
00000100:00000001:9.0:1773851889.094133:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851889.094133:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851889.094134:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d47d7c0c nid 21498@kfi7 refs 2
00000800:00000200:9.0:1773851889.094135:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 21498@kfi7(0000000034595fe4):0x0 lsk 2100 rsk 92 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000833 Transaction freed
00000800:00000200:25.0:1773851889.100575:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851889.100576:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851889.100577:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851889.100579:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851889.100581:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16787@kfi7 to cpt 6
00000400:00000200:25.0:1773851889.100582:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16787@kfi7 : PUT - for me
00000400:00000200:25.0:1773851889.100583:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16787@kfi7 to cpt 6
00000400:00000200:25.0:1773851889.100584:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000234e0b3e nid 16787@kfi7 refs 1
00000400:00000200:25.0:1773851889.100585:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16787@kfi7 to cpt 6
00000400:00000200:25.0:1773851889.100585:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000234e0b3e nid 16787@kfi7 refs 2
00000400:00000200:25.0:1773851889.100586:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000234e0b3e nid 16787@kfi7 refs 3
00000400:00000200:25.0:1773851889.100587:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16786@kfi7 to cpt 3
00000400:00000200:25.0:1773851889.100588:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16786@kfi7 of length 224 into portal 12 MB=0x69b4b57f86ec0
00000400:00000200:25.0:1773851889.100590:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16786@kfi7 of length 224/224 into md 0x16159c9699 [64] + 31528
00000800:00000200:25.0:1773851889.100591:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851889.100595:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851889.100596:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16787@kfi7: PUT: OK
00000100:00000001:25.0:1773851889.100597:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851889.100598:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851889.100599:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f745d488.
00000100:00000040:25.0:1773851889.100599:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000f745d488 x1859597761015488 msgsize 224
00000100:00100000:25.0:1773851889.100601:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16786@kfi7 (source: 12345-16787@kfi7)
00000100:00000001:25.0:1773851889.100603:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851889.100604:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000234e0b3e nid 16787@kfi7 refs 2
00000800:00000200:25.0:1773851889.100605:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2054@kfi7:6 <- 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851889.100608:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851889.100608:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851889.100609:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851889.100609:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851889.100610:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851889.100611:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597761015488
00000020:00000001:25.0:1773851889.100612:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851889.100612:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81c95
00000020:00000001:25.0:1773851889.100613:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851889.100614:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000094115897 refcount=5
00000020:00000001:25.0:1773851889.100615:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637118784700416 : -106954924851200 : ffff9eb99db28000)
00000020:00000001:25.0:1773851889.100615:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637118784700416 : -106954924851200 : ffff9eb99db28000)
00000100:00000001:25.0:1773851889.100617:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851889.100617:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851889.100618:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000fc844a13.
00000020:00000010:25.0:1773851889.100619:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851889.100620:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004371f0ec.
00000100:00000001:25.0:1773851889.100621:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851889.100621:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851889.100622:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851889.100623:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851889.100623:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851889.100624:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851889.100625:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851889.100626:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851889.100626:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851889.100627:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851889.100627:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851889.100628:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16786@kfi7, seq: 2025160
00000100:00000040:27.0:1773851889.100629:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000094115897 : new rpc_count 1
00000100:00000001:27.0:1773851889.100629:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252461568 : -106967457090048 : ffff9eb6b2b7b600)
00000100:00000001:25.0:1773851889.100629:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851889.100630:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851889.100631:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f745d488 x1859597761015488/t0(0) o400->afe29a32-7bf3-4bab-bd33-4f41363ef608@16786@kfi7:139/0 lens 224/0 e 0 to 0 dl 1773852254 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1542-0'
00000100:00000001:27.0:1773851889.100633:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851889.100634:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851889.100635:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f745d488 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:afe29a32-7bf3-4bab-bd33-4f41363ef608+5:39546:x1859597761015488:12345-16786@kfi7:400:default-tuolumne1542-0
00000100:00000200:27.0:1773851889.100636:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597761015488
00000020:00000001:27.0:1773851889.100636:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851889.100637:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851889.100638:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.100638:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851889.100639:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851889.100639:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851889.100640:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597761015488, found 0 last_xid 1859597761015487
00000020:00000001:27.0:1773851889.100641:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851889.100642:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851889.100642:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851889.100643:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.100643:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851889.100644:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851889.100644:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851889.100645:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000da599c12.
02000000:00000001:27.0:1773851889.100646:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.100646:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.100647:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851889.100648:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044156003, transno 0, xid 1859597761015488
00010000:00000001:27.0:1773851889.100648:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851889.100649:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f745d488 x1859597761015488/t0(0) o400->afe29a32-7bf3-4bab-bd33-4f41363ef608@16786@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1542-0'
00010000:00000001:27.0:1773851889.100651:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851889.100652:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851889.100653:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=122 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851889.100654:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851889.100654:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000057b83474 refcount 3 to 16786@kfi7
00000100:00000001:27.0:1773851889.100655:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642470816 : -107157067080800 : ffff9e8a8d14dba0)
02000000:00000001:27.0:1773851889.100656:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851889.100656:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.100657:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851889.100658:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16787@kfi7
00000400:00000010:27.0:1773851889.100658:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eacefcf8.
00000100:00000200:27.0:1773851889.100659:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597761015488, offset 224
00000400:00000200:27.0:1773851889.100661:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16787@kfi7
00000400:00000200:27.0:1773851889.100661:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16787@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.100662:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000234e0b3e nid 16787@kfi7 refs 1
00000400:00000200:27.0:1773851889.100663:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000234e0b3e nid 16787@kfi7 refs 2
00000400:00000200:27.0:1773851889.100664:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000234e0b3e nid 16787@kfi7 refs 3
00000400:00000200:27.0:1773851889.100665:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16787@kfi7 local destination
00000400:00000200:27.0:1773851889.100667:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769937:8769937:1024:4294967295] 16787@kfi7 LPNI seq info [674139:674139:16:4294967295]
00000400:00000200:27.0:1773851889.100668:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000234e0b3e nid 16787@kfi7 refs 2
00000400:00000200:27.0:1773851889.100669:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16787@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.100671:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16787@kfi7(16787@kfi7:16787@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851889.100672:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000234e0b3e nid 16787@kfi7 refs 3
00000800:00000200:27.0:1773851889.100673:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851889.100675:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851889.100676:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851889.100678:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b7c Using peer 16787@kfi7(0x100000000000b7c)
00000800:00000200:27.0:1773851889.100682:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x100000000000b7c: rc=0
00000800:00000200:27.0:1773851889.100683:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b7c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851889.100685:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851889.100686:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000057b83474 refcount 2 to 16786@kfi7
00010000:00000001:27.0:1773851889.100687:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851889.100687:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.100688:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851889.100688:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f745d488 x1859597761015488/t0(0) o400->afe29a32-7bf3-4bab-bd33-4f41363ef608@16786@kfi7:139/0 lens 224/224 e 0 to 0 dl 1773852254 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1542-0'
00000100:00100000:27.0:1773851889.100691:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f745d488 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:afe29a32-7bf3-4bab-bd33-4f41363ef608+5:39546:x1859597761015488:12345-16786@kfi7:400:default-tuolumne1542-0 Request processed in 57us (91us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851889.100694:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16786@kfi7, seq: 2025160
00000100:00000040:27.0:1773851889.100695:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000094115897 : new rpc_count 0
00000800:00000200:25.0:1773851889.100695:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b7c TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851889.100696:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851889.100697:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851889.100697:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000400:00000200:25.0:1773851889.100697:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851889.100698:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004371f0ec.
00000400:00000200:25.0:1773851889.100698:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16787@kfi7: PUT: OK
00000020:00000010:27.0:1773851889.100699:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000fc844a13.
00000400:00000200:25.0:1773851889.100699:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eacefcf8
00000400:00000010:25.0:1773851889.100699:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eacefcf8.
00000020:00000040:27.0:1773851889.100700:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000094115897 : new refcount 4
00000100:00000001:25.0:1773851889.100700:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851889.100700:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:27.0:1773851889.100701:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851889.100701:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000234e0b3e nid 16787@kfi7 refs 2
00000800:00000200:25.0:1773851889.100703:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 16787@kfi7(000000004c483e9f):0x0 lsk 2941 rsk 15 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b7c Transaction freed
00000800:00000200:29.0:1773851889.128674:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851889.128675:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851889.128676:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851889.128679:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851889.128683:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12224@kfi7 to cpt 7
00000400:00000200:29.0:1773851889.128684:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12224@kfi7 : PUT - for me
00000400:00000200:29.0:1773851889.128685:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12224@kfi7 to cpt 7
00000400:00000200:29.0:1773851889.128686:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd5db042 nid 12224@kfi7 refs 1
00000400:00000200:29.0:1773851889.128687:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12224@kfi7 to cpt 7
00000400:00000200:29.0:1773851889.128688:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd5db042 nid 12224@kfi7 refs 2
00000400:00000200:29.0:1773851889.128689:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cd5db042 nid 12224@kfi7 refs 3
00000400:00000200:29.0:1773851889.128690:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12225@kfi7 to cpt 2
00000400:00000200:29.0:1773851889.128691:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12225@kfi7 of length 224 into portal 12 MB=0x69b4b8341edc0
00000400:00000200:29.0:1773851889.128693:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12225@kfi7 of length 224/224 into md 0x77fe1859d [64] + 3200
00000800:00000200:29.0:1773851889.128695:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851889.128696:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851889.128697:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12224@kfi7: PUT: OK
00000100:00000001:29.0:1773851889.128698:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851889.128699:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851889.128700:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc9da4f0.
00000100:00000040:29.0:1773851889.128700:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000bc9da4f0 x1859598487252416 msgsize 224
00000100:00100000:29.0:1773851889.128702:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12225@kfi7 (source: 12345-12224@kfi7)
00000100:00000001:29.0:1773851889.128703:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851889.128704:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cd5db042 nid 12224@kfi7 refs 2
00000100:00000001:30.0:1773851889.128705:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851889.128705:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851889.128705:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851889.128706:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851889.128706:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851889.128707:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851889.128708:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598487252416
00000020:00000001:30.0:1773851889.128708:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851889.128709:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ec2f
00000020:00000001:30.0:1773851889.128709:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851889.128714:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000070d405dd refcount=5
00000020:00000001:30.0:1773851889.128714:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959017490432 : -107114692061184 : ffff9e946ad45800)
00000020:00000001:30.0:1773851889.128717:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959017490432 : -107114692061184 : ffff9e946ad45800)
00000100:00000001:30.0:1773851889.128718:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851889.128719:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851889.128720:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851889.128721:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851889.128721:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000700a46f0.
00000100:00000001:30.0:1773851889.128722:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851889.128723:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851889.128723:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851889.128727:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851889.128728:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851889.128728:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851889.128729:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851889.128730:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851889.128731:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851889.128731:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851889.128731:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851889.128732:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12225@kfi7, seq: 2055576
00000100:00000001:31.0:1773851889.128733:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851889.128733:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000070d405dd : new rpc_count 1
00000100:00000001:30.0:1773851889.128733:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262243200 : -106943447308416 : ffff9ebc49cfe780)
00000100:00000001:31.0:1773851889.128734:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851889.128734:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc9da4f0 x1859598487252416/t0(0) o400->c47b4da3-5fcf-4e75-8760-eff4fc53d6a1@12225@kfi7:677/0 lens 224/0 e 0 to 0 dl 1773852037 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1251-0'
00000100:00000001:30.0:1773851889.128737:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851889.128738:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851889.128738:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc9da4f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:c47b4da3-5fcf-4e75-8760-eff4fc53d6a1+5:39554:x1859598487252416:12345-12225@kfi7:400:default-tuolumne1251-0
00000100:00000200:30.0:1773851889.128740:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598487252416
00000020:00000001:30.0:1773851889.128741:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851889.128741:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851889.128742:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851889.128743:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851889.128743:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851889.128744:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851889.128745:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598487252416, found 0 last_xid 1859598487252415
00000020:00000001:30.0:1773851889.128746:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851889.128747:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851889.128748:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851889.128748:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851889.128749:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851889.128750:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851889.128750:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851889.128751:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005cf69b62.
02000000:00000001:30.0:1773851889.128752:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851889.128752:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851889.128753:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851889.128754:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154592765, transno 0, xid 1859598487252416
00010000:00000001:30.0:1773851889.128754:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851889.128755:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc9da4f0 x1859598487252416/t0(0) o400->c47b4da3-5fcf-4e75-8760-eff4fc53d6a1@12225@kfi7:677/0 lens 224/224 e 0 to 0 dl 1773852037 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1251-0'
00010000:00000001:30.0:1773851889.128758:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851889.128758:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851889.128759:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=122 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851889.128760:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851889.128761:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000427b1b08 refcount 3 to 12225@kfi7
00000100:00000001:30.0:1773851889.128762:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810485696 : -107154899065920 : ffff9e8b0e4e23c0)
02000000:00000001:30.0:1773851889.128763:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851889.128763:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851889.128764:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851889.128765:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12224@kfi7
00000400:00000010:30.0:1773851889.128766:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013884923.
00000100:00000200:30.0:1773851889.128766:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598487252416, offset 224
00000400:00000200:30.0:1773851889.128768:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12224@kfi7
00000400:00000200:30.0:1773851889.128769:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12224@kfi7 to cpt 7
00000400:00000200:30.0:1773851889.128769:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cd5db042 nid 12224@kfi7 refs 1
00000400:00000200:30.0:1773851889.128770:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cd5db042 nid 12224@kfi7 refs 2
00000400:00000200:30.0:1773851889.128771:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cd5db042 nid 12224@kfi7 refs 3
00000400:00000200:30.0:1773851889.128773:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12224@kfi7 local destination
00000400:00000200:30.0:1773851889.128774:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769938:8769938:1024:4294967295] 12224@kfi7 LPNI seq info [17597295:17597295:16:4294967295]
00000400:00000200:30.0:1773851889.128775:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cd5db042 nid 12224@kfi7 refs 2
00000400:00000200:30.0:1773851889.128777:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12224@kfi7 to cpt 7
00000400:00000200:30.0:1773851889.128778:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12224@kfi7(12224@kfi7:12224@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851889.128780:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cd5db042 nid 12224@kfi7 refs 3
00000800:00000200:30.0:1773851889.128781:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851889.128782:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851889.128784:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851889.128787:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f87 Using peer 12224@kfi7(0x100000000000f87)
00000800:00000200:30.0:1773851889.128790:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bc942d61: Posted send of 324 bytes to peer 0x100000000000f87: rc=0
00000800:00000200:30.0:1773851889.128791:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f87 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851889.128793:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851889.128794:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000427b1b08 refcount 2 to 12225@kfi7
00010000:00000001:30.0:1773851889.128795:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851889.128795:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851889.128796:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851889.128797:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc9da4f0 x1859598487252416/t0(0) o400->c47b4da3-5fcf-4e75-8760-eff4fc53d6a1@12225@kfi7:677/0 lens 224/224 e 0 to 0 dl 1773852037 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1251-0'
00000100:00100000:30.0:1773851889.128800:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc9da4f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:c47b4da3-5fcf-4e75-8760-eff4fc53d6a1+5:39554:x1859598487252416:12345-12225@kfi7:400:default-tuolumne1251-0 Request processed in 62us (98us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851889.128802:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12225@kfi7, seq: 2055576
00000100:00000040:30.0:1773851889.128803:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000070d405dd : new rpc_count 0
00000800:00000200:29.0:1773851889.128803:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f87 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851889.128804:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851889.128804:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851889.128805:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851889.128805:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851889.128806:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000700a46f0.
00000020:00000010:30.0:1773851889.128806:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000400:00000200:29.0:1773851889.128806:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12224@kfi7: PUT: OK
00000020:00000040:30.0:1773851889.128807:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000070d405dd : new refcount 4
00000400:00000200:29.0:1773851889.128807:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013884923
00000400:00000010:29.0:1773851889.128807:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013884923.
00000100:00000001:30.0:1773851889.128808:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851889.128808:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851889.128809:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851889.128810:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cd5db042 nid 12224@kfi7 refs 2
00000800:00000200:29.0:1773851889.128811:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 12224@kfi7(00000000fcae658e):0x0 lsk 3976 rsk 39 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f87 Transaction freed
00000800:00000200:18.0:1773851889.168363:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851889.168363:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851889.168365:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851889.168366:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851889.168368:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26418@kfi7 to cpt 4
00000400:00000200:18.0:1773851889.168370:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26418@kfi7 : PUT - for me
00000400:00000200:18.0:1773851889.168370:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26418@kfi7 to cpt 4
00000400:00000200:18.0:1773851889.168372:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 1
00000400:00000200:18.0:1773851889.168373:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26418@kfi7 to cpt 4
00000400:00000200:18.0:1773851889.168373:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 2
00000400:00000200:18.0:1773851889.168374:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 3
00000400:00000200:18.0:1773851889.168375:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26418@kfi7 to cpt 4
00000400:00000200:18.0:1773851889.168376:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26418@kfi7 of length 224 into portal 12 MB=0x69b4c4e4e2540
00000400:00000200:18.0:1773851889.168377:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26418@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 38480
00000800:00000200:18.0:1773851889.168379:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851889.168382:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851889.168383:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26418@kfi7: PUT: OK
00000100:00000001:18.0:1773851889.168384:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851889.168384:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851889.168386:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e7712479.
00000100:00000040:18.0:1773851889.168387:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000e7712479 x1859601893827904 msgsize 224
00000100:00100000:18.0:1773851889.168388:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-26418@kfi7 (source: 12345-26418@kfi7)
00000100:00000001:18.0:1773851889.168390:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851889.168390:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 2
00000100:00000001:17.0:1773851889.168391:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851889.168391:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851889.168392:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851889.168392:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851889.168392:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851889.168393:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851889.168394:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601893827904
00000020:00000001:17.0:1773851889.168394:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851889.168395:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7fc99
00000020:00000001:17.0:1773851889.168396:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851889.168400:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004cf855cf refcount=10
00000020:00000001:17.0:1773851889.168401:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636933594090496 : -107140115461120 : ffff9e8e7f7a0c00)
00000020:00000001:17.0:1773851889.168402:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636933594090496 : -107140115461120 : ffff9e8e7f7a0c00)
00000100:00000001:17.0:1773851889.168403:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851889.168404:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851889.168404:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851889.168405:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851889.168406:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851889.168407:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851889.168407:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851889.168408:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851889.168409:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851889.168409:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851889.168409:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851889.168411:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851889.168412:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851889.168412:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851889.168413:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851889.168413:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851889.168414:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26418@kfi7, seq: 2156404
00000100:00000040:17.0:1773851889.168414:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004cf855cf : new rpc_count 3
00000100:00000001:16.0:1773851889.168414:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851889.168415:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134795801728 : -106938913749888 : ffff9ebd58088480)
00000100:00000001:16.0:1773851889.168415:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851889.168416:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e7712479 x1859601893827904/t0(0) o400->10e8c037-c48a-4902-bf55-717087ee6aea@26418@kfi7:677/0 lens 224/0 e 0 to 0 dl 1773852037 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2137-0'
00000100:00000001:17.0:1773851889.168419:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851889.168419:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851889.168421:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7712479 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:10e8c037-c48a-4902-bf55-717087ee6aea+10:39731:x1859601893827904:12345-26418@kfi7:400:default-tuolumne2137-0
00000100:00000200:17.0:1773851889.168422:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601893827904
00000020:00000001:17.0:1773851889.168423:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851889.168423:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851889.168424:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851889.168424:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851889.168425:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851889.168426:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851889.168426:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601893827904, found 0 last_xid 1859601893251903
00000020:00000001:17.0:1773851889.168427:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851889.168428:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851889.168428:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851889.168429:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851889.168429:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851889.168430:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851889.168431:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851889.168431:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009d196d35.
02000000:00000001:17.0:1773851889.168432:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851889.168432:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851889.168433:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851889.168434:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263711422, transno 0, xid 1859601893827904
00010000:00000001:17.0:1773851889.168435:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851889.168435:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e7712479 x1859601893827904/t0(0) o400->10e8c037-c48a-4902-bf55-717087ee6aea@26418@kfi7:677/0 lens 224/224 e 0 to 0 dl 1773852037 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2137-0'
00010000:00000001:17.0:1773851889.168438:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851889.168438:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851889.168439:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=122 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851889.168440:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851889.168441:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000afa0e7bb refcount 3 to 26418@kfi7
00000100:00000001:17.0:1773851889.168441:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095774304 : -107152613777312 : ffff9e8b9684e060)
02000000:00000001:17.0:1773851889.168442:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851889.168443:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851889.168443:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851889.168445:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26418@kfi7
00000400:00000010:17.0:1773851889.168445:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c4dc638.
00000100:00000200:17.0:1773851889.168446:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601893827904, offset 224
00000400:00000200:17.0:1773851889.168447:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26418@kfi7
00000400:00000200:17.0:1773851889.168448:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26418@kfi7 to cpt 4
00000400:00000200:17.0:1773851889.168449:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 1
00000400:00000200:17.0:1773851889.168450:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 2
00000400:00000200:17.0:1773851889.168451:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 3
00000400:00000200:17.0:1773851889.168452:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26418@kfi7 local destination
00000400:00000200:17.0:1773851889.168453:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769939:8769939:1024:4294967295] 26418@kfi7 LPNI seq info [11397146:11397146:16:4294967295]
00000400:00000200:17.0:1773851889.168455:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 2
00000400:00000200:17.0:1773851889.168455:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26418@kfi7 to cpt 4
00000400:00000200:17.0:1773851889.168457:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26418@kfi7(26418@kfi7:26418@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851889.168458:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 3
00000800:00000200:17.0:1773851889.168459:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851889.168460:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851889.168463:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851889.168465:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x99d Using peer 26418@kfi7(0x99d)
00000800:00000200:17.0:1773851889.168468:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x99d: rc=0
00000800:00000200:17.0:1773851889.168469:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x99d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851889.168471:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851889.168472:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000afa0e7bb refcount 2 to 26418@kfi7
00010000:00000001:17.0:1773851889.168473:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851889.168473:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851889.168474:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851889.168474:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e7712479 x1859601893827904/t0(0) o400->10e8c037-c48a-4902-bf55-717087ee6aea@26418@kfi7:677/0 lens 224/224 e 0 to 0 dl 1773852037 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2137-0'
00000100:00100000:17.0:1773851889.168481:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7712479 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:10e8c037-c48a-4902-bf55-717087ee6aea+10:39731:x1859601893827904:12345-26418@kfi7:400:default-tuolumne2137-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851889.168482:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x99d TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851889.168483:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851889.168484:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26418@kfi7: PUT: OK
00000100:00100000:17.0:1773851889.168484:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26418@kfi7, seq: 2156404
00000100:00000040:17.0:1773851889.168484:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004cf855cf : new rpc_count 2
00000400:00000200:18.0:1773851889.168485:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c4dc638
00000400:00000010:18.0:1773851889.168485:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c4dc638.
00000100:00000001:17.0:1773851889.168485:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:18.0:1773851889.168486:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851889.168486:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851889.168486:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851889.168486:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000400:00000200:18.0:1773851889.168487:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000de8eb2d7 nid 26418@kfi7 refs 2
00000020:00000010:17.0:1773851889.168487:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000800:00000200:18.0:1773851889.168488:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 26418@kfi7(00000000bc8503e7):0x0 lsk 2462 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x99d Transaction freed
00000020:00000010:17.0:1773851889.168488:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000020:00000040:17.0:1773851889.168488:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000004cf855cf : new refcount 9
00000100:00000001:17.0:1773851889.168489:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:30.0:1773851889.175081:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851889.175082:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851889.175108:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851889.175109:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851889.175135:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851889.175135:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851889.175160:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851889.175161:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851889.175326:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000a709584c (tot 253201139).
00000400:00000010:30.0:1773851889.175328:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000a709584c (tot 253200883).
00000800:00000200:17.0:1773851889.242826:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851889.242827:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851889.242828:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851889.242830:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851889.242832:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:17.0:1773851889.242833:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21169@kfi7 : PUT - for me
00000400:00000200:17.0:1773851889.242834:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:17.0:1773851889.242834:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 1
00000400:00000200:17.0:1773851889.242835:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:17.0:1773851889.242836:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000400:00000200:17.0:1773851889.242837:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 3
00000400:00000200:17.0:1773851889.242837:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21104@kfi7 to cpt 6
00000400:00000200:17.0:1773851889.242838:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21104@kfi7 of length 224 into portal 12 MB=0x69b0a1bb734c0
00000400:00000200:17.0:1773851889.242839:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21104@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 38704
00000800:00000200:17.0:1773851889.242841:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851889.242842:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851889.242844:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21169@kfi7: PUT: OK
00000100:00000001:17.0:1773851889.242845:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851889.242845:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851889.242847:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f9b8fb5.
00000100:00000040:17.0:1773851889.242847:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002f9b8fb5 x1859317577233600 msgsize 224
00000100:00100000:17.0:1773851889.242848:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21104@kfi7 (source: 12345-21169@kfi7)
00000100:00000001:17.0:1773851889.242850:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851889.242851:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000800:00000200:17.0:1773851889.242852:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851889.242854:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851889.242854:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851889.242855:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851889.242855:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851889.242856:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851889.242856:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317577233600
00000020:00000001:17.0:1773851889.242857:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851889.242857:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92523
00000020:00000001:17.0:1773851889.242857:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851889.242860:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000188efae1 refcount=6
00000020:00000001:17.0:1773851889.242861:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630771712 : -107123078779904 : ffff9e9276f12c00)
00000020:00000001:17.0:1773851889.242861:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630771712 : -107123078779904 : ffff9e9276f12c00)
00000100:00000001:17.0:1773851889.242862:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851889.242863:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851889.242864:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2700f24.
00000020:00000010:17.0:1773851889.242864:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851889.242865:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002047e138.
00000100:00000001:17.0:1773851889.242865:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851889.242866:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851889.242866:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851889.242867:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851889.242867:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851889.242868:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851889.242868:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851889.242869:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851889.242870:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851889.242870:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851889.242870:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851889.242871:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21104@kfi7, seq: 2156405
00000100:00000001:17.0:1773851889.242872:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851889.242872:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000188efae1 : new rpc_count 1
00000100:00000001:17.0:1773851889.242873:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851889.242873:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636922407244032 : -107151302307584 : ffff9e8be4b05100)
00000100:00000040:16.0:1773851889.242874:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f9b8fb5 x1859317577233600/t0(0) o400->7c963afa-3af4-4d84-b4a0-65657dc97aea@21104@kfi7:141/0 lens 224/0 e 0 to 0 dl 1773852256 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1806-0'
00000100:00000001:16.0:1773851889.242877:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851889.242877:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851889.242878:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f9b8fb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:7c963afa-3af4-4d84-b4a0-65657dc97aea+6:39730:x1859317577233600:12345-21104@kfi7:400:default-tuolumne1806-0
00000100:00000200:16.0:1773851889.242880:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317577233600
00000020:00000001:16.0:1773851889.242880:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851889.242881:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851889.242882:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.242882:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851889.242883:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851889.242884:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851889.242884:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317577233600, found 0 last_xid 1859317577233599
00000020:00000001:16.0:1773851889.242885:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851889.242885:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851889.242886:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851889.242886:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.242887:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851889.242887:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851889.242888:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851889.242889:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000060477f49.
02000000:00000001:16.0:1773851889.242889:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851889.242890:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.242890:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851889.242891:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096673405, transno 0, xid 1859317577233600
00010000:00000001:16.0:1773851889.242892:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851889.242893:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f9b8fb5 x1859317577233600/t0(0) o400->7c963afa-3af4-4d84-b4a0-65657dc97aea@21104@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1806-0'
00010000:00000001:16.0:1773851889.242895:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851889.242896:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851889.242896:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=122 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851889.242897:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851889.242898:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000088756bad refcount 5 to 21104@kfi7
00000100:00000001:16.0:1773851889.242899:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092337312 : -107152617214304 : ffff9e8b96506ea0)
02000000:00000001:16.0:1773851889.242900:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851889.242900:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851889.242901:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851889.242902:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21169@kfi7
00000400:00000010:16.0:1773851889.242902:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000080265a65.
00000100:00000200:16.0:1773851889.242903:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317577233600, offset 224
00000400:00000200:16.0:1773851889.242905:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21169@kfi7
00000400:00000200:16.0:1773851889.242905:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:16.0:1773851889.242906:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 1
00000400:00000200:16.0:1773851889.242907:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000400:00000200:16.0:1773851889.242909:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 3
00000400:00000200:16.0:1773851889.242910:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21169@kfi7 local destination
00000400:00000200:16.0:1773851889.242911:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769940:8769940:1024:4294967295] 21169@kfi7 LPNI seq info [386269:386269:16:4294967295]
00000400:00000200:16.0:1773851889.242913:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000400:00000200:16.0:1773851889.242914:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21169@kfi7 to cpt 4
00000400:00000200:16.0:1773851889.242916:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21169@kfi7(21169@kfi7:21169@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851889.242917:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 3
00000800:00000200:16.0:1773851889.242918:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851889.242919:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851889.242921:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851889.242923:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x310 Using peer 21169@kfi7(0x310)
00000800:00000200:16.0:1773851889.242926:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x310: rc=0
00000800:00000200:16.0:1773851889.242927:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x310 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851889.242929:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851889.242930:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000088756bad refcount 4 to 21104@kfi7
00010000:00000001:16.0:1773851889.242931:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851889.242931:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.242931:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851889.242932:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f9b8fb5 x1859317577233600/t0(0) o400->7c963afa-3af4-4d84-b4a0-65657dc97aea@21104@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1806-0'
00000100:00100000:16.0:1773851889.242937:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f9b8fb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:7c963afa-3af4-4d84-b4a0-65657dc97aea+6:39730:x1859317577233600:12345-21104@kfi7:400:default-tuolumne1806-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851889.242939:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21104@kfi7, seq: 2156405
00000100:00000040:16.0:1773851889.242940:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000188efae1 : new rpc_count 0
00000100:00000001:16.0:1773851889.242940:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851889.242942:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851889.242942:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:16.0:1773851889.242943:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002047e138.
00000020:00000010:16.0:1773851889.242944:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2700f24.
00000020:00000040:16.0:1773851889.242944:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000188efae1 : new refcount 5
00000100:00000001:16.0:1773851889.242945:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851889.242950:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x310 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851889.242951:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851889.242952:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21169@kfi7: PUT: OK
00000400:00000200:17.0:1773851889.242953:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000080265a65
00000400:00000010:17.0:1773851889.242954:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000080265a65.
00000100:00000001:17.0:1773851889.242954:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851889.242954:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851889.242955:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006c039dc3 nid 21169@kfi7 refs 2
00000800:00000200:17.0:1773851889.242956:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 21169@kfi7(000000008b63c8ce):0x0 lsk 785 rsk 43 tsk 0 trmk 0 tmk 0 trr 4 tta 0x310 Transaction freed
00000800:00000200:21.0:1773851889.269145:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851889.269146:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851889.269147:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851889.269149:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851889.269151:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24434@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.269152:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24434@kfi7 : PUT - for me
00000400:00000200:21.0:1773851889.269153:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24434@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.269154:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093806db7 nid 24434@kfi7 refs 1
00000400:00000200:21.0:1773851889.269155:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24434@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.269155:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093806db7 nid 24434@kfi7 refs 2
00000400:00000200:21.0:1773851889.269156:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000093806db7 nid 24434@kfi7 refs 3
00000400:00000200:21.0:1773851889.269157:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24498@kfi7 to cpt 1
00000400:00000200:21.0:1773851889.269157:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24498@kfi7 of length 224 into portal 12 MB=0x69b4b58a9ac00
00000400:00000200:21.0:1773851889.269159:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24498@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 56408
00000800:00000200:21.0:1773851889.269161:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851889.269162:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.269163:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24434@kfi7: PUT: OK
00000100:00000001:21.0:1773851889.269164:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851889.269164:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851889.269165:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001ef81a82.
00000100:00000040:21.0:1773851889.269166:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000001ef81a82 x1859597772631040 msgsize 224
00000100:00100000:21.0:1773851889.269167:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24498@kfi7 (source: 12345-24434@kfi7)
00000100:00000001:21.0:1773851889.269168:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851889.269169:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000093806db7 nid 24434@kfi7 refs 2
00000100:00000001:20.0:1773851889.269169:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851889.269170:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851889.269171:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851889.269171:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851889.269171:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851889.269172:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851889.269173:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597772631040
00000020:00000001:20.0:1773851889.269174:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851889.269174:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e71833
00000020:00000001:20.0:1773851889.269175:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851889.269178:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f626dd2a refcount=5
00000020:00000001:20.0:1773851889.269179:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637147335146496 : -106926374405120 : ffff9ec0436fbc00)
00000020:00000001:20.0:1773851889.269180:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637147335146496 : -106926374405120 : ffff9ec0436fbc00)
00000100:00000001:20.0:1773851889.269181:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.269182:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851889.269183:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8e3d745.
00000020:00000010:20.0:1773851889.269184:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.269184:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000045a8637c.
00000100:00000001:20.0:1773851889.269185:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851889.269186:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851889.269186:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.269187:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851889.269188:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851889.269188:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.269189:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.269190:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851889.269191:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851889.269191:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851889.269191:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851889.269192:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24498@kfi7, seq: 1998048
00000100:00000040:20.0:1773851889.269192:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f626dd2a : new rpc_count 1
00000100:00000001:23.0:1773851889.269193:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851889.269193:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.269193:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102026007552 : -106971683544064 : ffff9eb5b6cd2400)
00000100:00000040:20.0:1773851889.269195:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001ef81a82 x1859597772631040/t0(0) o400->224b9cab-65c9-4ba4-a94b-24bf844e5e27@24498@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2010-0'
00000100:00000001:20.0:1773851889.269197:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.269198:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851889.269199:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001ef81a82 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:224b9cab-65c9-4ba4-a94b-24bf844e5e27+5:39462:x1859597772631040:12345-24498@kfi7:400:default-tuolumne2010-0
00000100:00000200:20.0:1773851889.269200:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597772631040
00000020:00000001:20.0:1773851889.269201:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851889.269202:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851889.269202:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.269203:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851889.269203:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851889.269204:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851889.269205:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597772631040, found 0 last_xid 1859597772631039
00000020:00000001:20.0:1773851889.269206:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851889.269206:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851889.269207:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851889.269207:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.269208:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851889.269208:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851889.269209:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851889.269210:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003eeddd7a.
02000000:00000001:20.0:1773851889.269210:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.269211:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.269212:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851889.269212:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181817001733, transno 0, xid 1859597772631040
00010000:00000001:20.0:1773851889.269213:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851889.269214:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001ef81a82 x1859597772631040/t0(0) o400->224b9cab-65c9-4ba4-a94b-24bf844e5e27@24498@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2010-0'
00010000:00000001:20.0:1773851889.269216:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851889.269217:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851889.269217:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=122 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851889.269218:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851889.269219:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ca8cf652 refcount 3 to 24498@kfi7
00000100:00000001:20.0:1773851889.269219:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232980768 : -107130476570848 : ffff9e90bdffd720)
02000000:00000001:20.0:1773851889.269220:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851889.269221:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.269221:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851889.269222:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24434@kfi7
00000400:00000010:20.0:1773851889.269223:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c8549bb.
00000100:00000200:20.0:1773851889.269224:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597772631040, offset 224
00000400:00000200:20.0:1773851889.269225:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24434@kfi7
00000400:00000200:20.0:1773851889.269226:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24434@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.269227:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093806db7 nid 24434@kfi7 refs 1
00000400:00000200:20.0:1773851889.269228:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000093806db7 nid 24434@kfi7 refs 2
00000400:00000200:20.0:1773851889.269229:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000093806db7 nid 24434@kfi7 refs 3
00000400:00000200:20.0:1773851889.269230:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24434@kfi7 local destination
00000400:00000200:20.0:1773851889.269231:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769941:8769941:1024:4294967295] 24434@kfi7 LPNI seq info [172380:172380:16:4294967295]
00000400:00000200:20.0:1773851889.269233:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000093806db7 nid 24434@kfi7 refs 2
00000400:00000200:20.0:1773851889.269233:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24434@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.269235:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24434@kfi7(24434@kfi7:24434@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851889.269236:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000093806db7 nid 24434@kfi7 refs 3
00000800:00000200:20.0:1773851889.269237:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851889.269238:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851889.269240:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851889.269242:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000039c Using peer 24434@kfi7(0x10000000000039c)
00000800:00000200:20.0:1773851889.269245:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x10000000000039c: rc=0
00000800:00000200:20.0:1773851889.269247:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000039c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851889.269249:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851889.269249:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ca8cf652 refcount 2 to 24498@kfi7
00010000:00000001:20.0:1773851889.269250:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851889.269250:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.269251:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851889.269252:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001ef81a82 x1859597772631040/t0(0) o400->224b9cab-65c9-4ba4-a94b-24bf844e5e27@24498@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2010-0'
00000100:00100000:20.0:1773851889.269255:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001ef81a82 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:224b9cab-65c9-4ba4-a94b-24bf844e5e27+5:39462:x1859597772631040:12345-24498@kfi7:400:default-tuolumne2010-0 Request processed in 57us (89us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851889.269257:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24498@kfi7, seq: 1998048
00000100:00000040:20.0:1773851889.269258:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f626dd2a : new rpc_count 0
00000100:00000001:20.0:1773851889.269259:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851889.269259:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851889.269260:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.269261:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000045a8637c.
00000020:00000010:20.0:1773851889.269261:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8e3d745.
00000020:00000040:20.0:1773851889.269262:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000f626dd2a : new refcount 4
00000100:00000001:20.0:1773851889.269263:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851889.269267:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000039c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851889.269268:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.269269:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24434@kfi7: PUT: OK
00000400:00000200:21.0:1773851889.269270:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c8549bb
00000400:00000010:21.0:1773851889.269270:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c8549bb.
00000100:00000001:21.0:1773851889.269271:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851889.269271:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851889.269272:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000093806db7 nid 24434@kfi7 refs 2
00000800:00000200:21.0:1773851889.269273:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 24434@kfi7(0000000043c61ade):0x0 lsk 925 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000039c Transaction freed
00000800:00000200:21.0:1773851889.333421:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851889.333422:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851889.333424:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851889.333427:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851889.333429:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25811@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.333431:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25811@kfi7 : PUT - for me
00000400:00000200:21.0:1773851889.333432:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25811@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.333434:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000022758346 nid 25811@kfi7 refs 1
00000400:00000200:21.0:1773851889.333435:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25811@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.333436:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000022758346 nid 25811@kfi7 refs 2
00000400:00000200:21.0:1773851889.333437:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000022758346 nid 25811@kfi7 refs 3
00000400:00000200:21.0:1773851889.333439:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25811@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.333440:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25811@kfi7 of length 224 into portal 12 MB=0x699e169edbdc0
00000400:00000200:21.0:1773851889.333441:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25811@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 56632
00000800:00000200:21.0:1773851889.333444:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851889.333446:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.333448:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25811@kfi7: PUT: OK
00000100:00000001:21.0:1773851889.333450:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851889.333450:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851889.333451:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3ffacad.
00000100:00000040:21.0:1773851889.333452:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e3ffacad x1858043284143552 msgsize 224
00000100:00100000:21.0:1773851889.333454:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25811@kfi7 (source: 12345-25811@kfi7)
00000100:00000001:21.0:1773851889.333455:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851889.333457:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000022758346 nid 25811@kfi7 refs 2
00000100:00000001:20.0:1773851889.333458:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851889.333458:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851889.333459:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851889.333459:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851889.333460:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851889.333461:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851889.333462:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043284143552
00000020:00000001:20.0:1773851889.333463:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851889.333463:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9239b
00000020:00000001:20.0:1773851889.333464:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851889.333467:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000974a2df refcount=10
00000020:00000001:20.0:1773851889.333468:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630268928 : -107123079282688 : ffff9e9276e98000)
00000020:00000001:20.0:1773851889.333469:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630268928 : -107123079282688 : ffff9e9276e98000)
00000100:00000001:20.0:1773851889.333470:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.333472:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851889.333472:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8e3d745.
00000020:00000010:20.0:1773851889.333473:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.333474:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000045a8637c.
00000100:00000001:20.0:1773851889.333476:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851889.333476:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851889.333477:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.333478:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851889.333479:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851889.333479:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.333480:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.333482:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851889.333483:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851889.333483:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851889.333484:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851889.333484:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25811@kfi7, seq: 1998049
00000100:00000001:23.0:1773851889.333486:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851889.333486:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000974a2df : new rpc_count 1
00000100:00000001:23.0:1773851889.333487:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.333487:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102026022528 : -106971683529088 : ffff9eb5b6cd5e80)
00000100:00000040:20.0:1773851889.333489:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3ffacad x1858043284143552/t0(0) o400->f30348cb-ea09-4689-9f3e-618ac1b892e1@25811@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2101-0'
00000100:00000001:20.0:1773851889.333493:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.333494:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851889.333495:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3ffacad pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f30348cb-ea09-4689-9f3e-618ac1b892e1+10:39687:x1858043284143552:12345-25811@kfi7:400:default-tuolumne2101-0
00000100:00000200:20.0:1773851889.333497:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043284143552
00000020:00000001:20.0:1773851889.333498:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851889.333499:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851889.333500:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.333501:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851889.333501:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851889.333502:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851889.333503:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043284143552, found 0 last_xid 1858043284143551
00000020:00000001:20.0:1773851889.333504:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851889.333505:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851889.333506:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851889.333506:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.333507:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851889.333508:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851889.333509:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851889.333510:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e6c9c8de.
02000000:00000001:20.0:1773851889.333511:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.333512:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.333513:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851889.333514:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181308863161, transno 0, xid 1858043284143552
00010000:00000001:20.0:1773851889.333515:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851889.333516:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3ffacad x1858043284143552/t0(0) o400->f30348cb-ea09-4689-9f3e-618ac1b892e1@25811@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2101-0'
00010000:00000001:20.0:1773851889.333520:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851889.333520:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851889.333525:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=122 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851889.333526:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851889.333527:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000025828fa3 refcount 3 to 25811@kfi7
00000100:00000001:20.0:1773851889.333528:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024704 : -107156745526912 : ffff9e8aa03f6180)
02000000:00000001:20.0:1773851889.333529:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851889.333530:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.333531:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851889.333532:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25811@kfi7
00000400:00000010:20.0:1773851889.333533:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c0360258.
00000100:00000200:20.0:1773851889.333534:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043284143552, offset 224
00000400:00000200:20.0:1773851889.333536:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25811@kfi7
00000400:00000200:20.0:1773851889.333537:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25811@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.333538:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000022758346 nid 25811@kfi7 refs 1
00000400:00000200:20.0:1773851889.333540:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000022758346 nid 25811@kfi7 refs 2
00000400:00000200:20.0:1773851889.333542:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000022758346 nid 25811@kfi7 refs 3
00000400:00000200:20.0:1773851889.333543:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25811@kfi7 local destination
00000400:00000200:20.0:1773851889.333545:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769942:8769942:1024:4294967295] 25811@kfi7 LPNI seq info [1390583:1390583:16:4294967295]
00000400:00000200:20.0:1773851889.333547:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000022758346 nid 25811@kfi7 refs 2
00000400:00000200:20.0:1773851889.333549:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25811@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.333552:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25811@kfi7(25811@kfi7:25811@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851889.333554:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000022758346 nid 25811@kfi7 refs 3
00000800:00000200:20.0:1773851889.333556:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851889.333557:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851889.333560:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851889.333564:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x929 Using peer 25811@kfi7(0x929)
00000800:00000200:20.0:1773851889.333568:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x929: rc=0
00000800:00000200:20.0:1773851889.333570:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x929 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851889.333576:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851889.333580:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000025828fa3 refcount 2 to 25811@kfi7
00010000:00000001:20.0:1773851889.333581:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851889.333582:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.333582:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851889.333584:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3ffacad x1858043284143552/t0(0) o400->f30348cb-ea09-4689-9f3e-618ac1b892e1@25811@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2101-0'
00000100:00100000:20.0:1773851889.333589:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3ffacad pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f30348cb-ea09-4689-9f3e-618ac1b892e1+10:39687:x1858043284143552:12345-25811@kfi7:400:default-tuolumne2101-0 Request processed in 95us (135us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851889.333593:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25811@kfi7, seq: 1998049
00000100:00000040:20.0:1773851889.333594:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000974a2df : new rpc_count 0
00000100:00000001:20.0:1773851889.333595:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851889.333595:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851889.333596:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.333597:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000045a8637c.
00000020:00000010:20.0:1773851889.333599:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8e3d745.
00000020:00000040:20.0:1773851889.333600:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000000974a2df : new refcount 9
00000100:00000001:20.0:1773851889.333601:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851889.333609:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x929 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851889.333612:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.333613:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25811@kfi7: PUT: OK
00000400:00000200:21.0:1773851889.333614:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c0360258
00000400:00000010:21.0:1773851889.333615:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c0360258.
00000100:00000001:21.0:1773851889.333616:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851889.333616:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851889.333618:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000022758346 nid 25811@kfi7 refs 2
00000800:00000200:21.0:1773851889.333620:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 25811@kfi7(0000000035f7eab5):0x0 lsk 2346 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x929 Transaction freed
00000800:00000200:5.0:1773851889.443739:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851889.443740:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851889.443741:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851889.443744:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851889.443746:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25362@kfi7 to cpt 1
00000400:00000200:5.0:1773851889.443747:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25362@kfi7 : PUT - for me
00000400:00000200:5.0:1773851889.443748:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25362@kfi7 to cpt 1
00000400:00000200:5.0:1773851889.443749:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000736d0b36 nid 25362@kfi7 refs 1
00000400:00000200:5.0:1773851889.443750:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25362@kfi7 to cpt 1
00000400:00000200:5.0:1773851889.443751:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000736d0b36 nid 25362@kfi7 refs 2
00000400:00000200:5.0:1773851889.443751:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000736d0b36 nid 25362@kfi7 refs 3
00000400:00000200:5.0:1773851889.443752:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25554@kfi7 to cpt 4
00000400:00000200:5.0:1773851889.443753:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25554@kfi7 of length 224 into portal 12 MB=0x699e0971ba9c0
00000400:00000200:5.0:1773851889.443755:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25554@kfi7 of length 224/224 into md 0x793926dc5 [64] + 157912
00000800:00000200:5.0:1773851889.443757:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851889.443758:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851889.443759:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25362@kfi7: PUT: OK
00000100:00000001:5.0:1773851889.443760:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851889.443761:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851889.443762:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004727a36e.
00000100:00000040:5.0:1773851889.443762:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000004727a36e x1858039747160512 msgsize 224
00000100:00100000:5.0:1773851889.443764:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25554@kfi7 (source: 12345-25362@kfi7)
00000100:00000001:5.0:1773851889.443765:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851889.443765:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000736d0b36 nid 25362@kfi7 refs 2
00000100:00000001:7.0:1773851889.443766:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851889.443767:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851889.443767:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851889.443767:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851889.443768:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851889.443769:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851889.443770:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039747160512
00000020:00000001:7.0:1773851889.443770:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851889.443771:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c1d
00000020:00000001:7.0:1773851889.443771:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851889.443774:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000000c8f9bf refcount=6
00000020:00000001:7.0:1773851889.443774:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628271104 : -107123081280512 : ffff9e9276cb0400)
00000020:00000001:7.0:1773851889.443775:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628271104 : -107123081280512 : ffff9e9276cb0400)
00000100:00000001:7.0:1773851889.443777:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.443777:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851889.443778:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c19ce0d6.
00000020:00000010:7.0:1773851889.443779:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851889.443780:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000482fd989.
00000100:00000001:7.0:1773851889.443781:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851889.443781:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851889.443782:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.443783:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851889.443784:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851889.443785:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.443786:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.443787:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851889.443787:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851889.443787:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851889.443787:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851889.443788:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25554@kfi7, seq: 2001972
00000100:00000040:7.0:1773851889.443789:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000000c8f9bf : new rpc_count 1
00000100:00000001:4.0:1773851889.443789:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.443790:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108950016 : -106938600601600 : ffff9ebd6ab2c800)
00000100:00000001:4.0:1773851889.443790:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.443791:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004727a36e x1858039747160512/t0(0) o400->d8f6c143-c32d-4e88-9436-3b55010e9bd8@25554@kfi7:677/0 lens 224/0 e 0 to 0 dl 1773852037 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2085-0'
00000100:00000001:7.0:1773851889.443794:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.443794:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851889.443795:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004727a36e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d8f6c143-c32d-4e88-9436-3b55010e9bd8+6:39832:x1858039747160512:12345-25554@kfi7:400:default-tuolumne2085-0
00000100:00000200:7.0:1773851889.443797:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039747160512
00000020:00000001:7.0:1773851889.443797:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851889.443798:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851889.443799:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.443799:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851889.443800:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851889.443800:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851889.443801:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039747160512, found 0 last_xid 1858039747160511
00000020:00000001:7.0:1773851889.443802:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851889.443802:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851889.443803:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851889.443803:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.443804:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851889.443805:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851889.443805:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851889.443806:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2584423.
02000000:00000001:7.0:1773851889.443807:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.443807:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.443808:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851889.443808:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106669514, transno 0, xid 1858039747160512
00010000:00000001:7.0:1773851889.443810:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851889.443810:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004727a36e x1858039747160512/t0(0) o400->d8f6c143-c32d-4e88-9436-3b55010e9bd8@25554@kfi7:677/0 lens 224/224 e 0 to 0 dl 1773852037 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2085-0'
00010000:00000001:7.0:1773851889.443813:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851889.443813:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851889.443814:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=121 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851889.443815:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851889.443816:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000583f6568 refcount 3 to 25554@kfi7
00000100:00000001:7.0:1773851889.443816:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583951744 : -107156125599872 : ffff9e8ac532b780)
02000000:00000001:7.0:1773851889.443817:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851889.443818:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.443818:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851889.443819:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25362@kfi7
00000400:00000010:7.0:1773851889.443820:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000100:00000200:7.0:1773851889.443821:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039747160512, offset 224
00000400:00000200:7.0:1773851889.443823:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25362@kfi7
00000400:00000200:7.0:1773851889.443823:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25362@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.443824:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000736d0b36 nid 25362@kfi7 refs 1
00000400:00000200:7.0:1773851889.443825:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000736d0b36 nid 25362@kfi7 refs 2
00000400:00000200:7.0:1773851889.443827:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000736d0b36 nid 25362@kfi7 refs 3
00000400:00000200:7.0:1773851889.443828:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25362@kfi7 local destination
00000400:00000200:7.0:1773851889.443829:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769943:8769943:1024:4294967295] 25362@kfi7 LPNI seq info [367643:367643:16:4294967295]
00000400:00000200:7.0:1773851889.443830:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000736d0b36 nid 25362@kfi7 refs 2
00000400:00000200:7.0:1773851889.443831:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25362@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.443833:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25362@kfi7(25362@kfi7:25362@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851889.443834:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000736d0b36 nid 25362@kfi7 refs 3
00000800:00000200:7.0:1773851889.443835:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851889.443836:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851889.443839:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851889.443852:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x8f2 Using peer 25362@kfi7(0x8f2)
00000800:00000200:7.0:1773851889.443855:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x8f2: rc=0
00000800:00000200:7.0:1773851889.443857:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x8f2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851889.443859:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.443860:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000583f6568 refcount 2 to 25554@kfi7
00010000:00000001:7.0:1773851889.443861:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851889.443861:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.443862:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851889.443862:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004727a36e x1858039747160512/t0(0) o400->d8f6c143-c32d-4e88-9436-3b55010e9bd8@25554@kfi7:677/0 lens 224/224 e 0 to 0 dl 1773852037 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2085-0'
00000100:00100000:7.0:1773851889.443865:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004727a36e pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d8f6c143-c32d-4e88-9436-3b55010e9bd8+6:39832:x1858039747160512:12345-25554@kfi7:400:default-tuolumne2085-0 Request processed in 70us (102us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851889.443867:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25554@kfi7, seq: 2001972
00000100:00000040:7.0:1773851889.443869:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000000c8f9bf : new rpc_count 0
00000800:00000200:5.0:1773851889.443869:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x8f2 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851889.443870:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851889.443870:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851889.443870:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851889.443871:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851889.443871:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000482fd989.
00000400:00000200:5.0:1773851889.443871:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25362@kfi7: PUT: OK
00000020:00000010:7.0:1773851889.443872:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c19ce0d6.
00000400:00000200:5.0:1773851889.443872:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000020:00000040:7.0:1773851889.443873:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000000c8f9bf : new refcount 5
00000400:00000010:5.0:1773851889.443873:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000100:00000001:5.0:1773851889.443873:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851889.443874:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851889.443874:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851889.443874:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000736d0b36 nid 25362@kfi7 refs 2
00000800:00000200:5.0:1773851889.443876:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 25362@kfi7(0000000023f91300):0x0 lsk 2291 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x8f2 Transaction freed
00000800:00000200:13.0:1773851889.461984:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851889.461985:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851889.461987:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851889.461988:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851889.461990:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21441@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.461992:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21441@kfi7 : PUT - for me
00000400:00000200:13.0:1773851889.461993:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21441@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.461993:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000721d6226 nid 21441@kfi7 refs 1
00000400:00000200:13.0:1773851889.461995:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21441@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.461995:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000721d6226 nid 21441@kfi7 refs 2
00000400:00000200:13.0:1773851889.461996:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000721d6226 nid 21441@kfi7 refs 3
00000400:00000200:13.0:1773851889.461997:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21248@kfi7 to cpt 6
00000400:00000200:13.0:1773851889.461998:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21248@kfi7 of length 224 into portal 12 MB=0x69b0a55db5680
00000400:00000200:13.0:1773851889.461999:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21248@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 47160
00000800:00000200:13.0:1773851889.462001:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851889.462003:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851889.462003:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21441@kfi7: PUT: OK
00000100:00000001:13.0:1773851889.462005:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851889.462005:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851889.462006:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007c4e62b9.
00000100:00000040:13.0:1773851889.462007:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000007c4e62b9 x1859318552680064 msgsize 224
00000100:00100000:13.0:1773851889.462008:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21248@kfi7 (source: 12345-21441@kfi7)
00000100:00000001:13.0:1773851889.462009:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851889.462010:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000721d6226 nid 21441@kfi7 refs 2
00000100:00000001:12.0:1773851889.462011:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851889.462012:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851889.462012:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851889.462012:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851889.462013:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851889.462014:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851889.462014:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318552680064
00000020:00000001:12.0:1773851889.462015:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851889.462015:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925c4
00000020:00000001:12.0:1773851889.462016:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851889.462019:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007edacb48 refcount=6
00000020:00000001:12.0:1773851889.462019:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631015424 : -107123078536192 : ffff9e9276f4e400)
00000020:00000001:12.0:1773851889.462020:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631015424 : -107123078536192 : ffff9e9276f4e400)
00000100:00000001:12.0:1773851889.462021:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851889.462022:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851889.462022:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000380f7712.
00000020:00000010:12.0:1773851889.462023:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851889.462024:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000084c0a733.
00000100:00000001:12.0:1773851889.462025:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851889.462026:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851889.462026:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851889.462027:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851889.462028:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851889.462028:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851889.462029:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851889.462030:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851889.462031:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851889.462031:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851889.462031:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851889.462032:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21248@kfi7, seq: 2289901
00000100:00000040:15.0:1773851889.462033:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007edacb48 : new rpc_count 1
00000100:00000001:12.0:1773851889.462033:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.462034:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485618816 : -107000223932800 : ffff9eaf11a95e80)
00000100:00000001:12.0:1773851889.462034:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.462036:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007c4e62b9 x1859318552680064/t0(0) o400->64235977-0365-4d89-8d76-ad62c2d4db07@21248@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1827-0'
00000100:00000001:15.0:1773851889.462038:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851889.462039:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851889.462040:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c4e62b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:64235977-0365-4d89-8d76-ad62c2d4db07+6:39520:x1859318552680064:12345-21248@kfi7:400:default-tuolumne1827-0
00000100:00000200:15.0:1773851889.462043:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318552680064
00000020:00000001:15.0:1773851889.462044:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851889.462045:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851889.462046:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.462046:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851889.462047:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851889.462048:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851889.462048:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318552680064, found 0 last_xid 1859318552680063
00000020:00000001:15.0:1773851889.462049:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851889.462050:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851889.462050:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851889.462051:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.462052:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851889.462052:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851889.462053:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851889.462054:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003ad429d5.
02000000:00000001:15.0:1773851889.462054:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.462055:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.462056:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851889.462057:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183069465575, transno 0, xid 1859318552680064
00010000:00000001:15.0:1773851889.462057:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851889.462058:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007c4e62b9 x1859318552680064/t0(0) o400->64235977-0365-4d89-8d76-ad62c2d4db07@21248@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1827-0'
00010000:00000001:15.0:1773851889.462061:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851889.462061:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851889.462062:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=122 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851889.462063:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851889.462064:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d73441c refcount 3 to 21248@kfi7
00000100:00000001:15.0:1773851889.462065:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330048 : -107155410221568 : ffff9e8aefd68600)
02000000:00000001:15.0:1773851889.462066:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851889.462066:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.462067:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851889.462068:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21441@kfi7
00000400:00000010:15.0:1773851889.462068:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c01d933.
00000100:00000200:15.0:1773851889.462070:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318552680064, offset 224
00000400:00000200:15.0:1773851889.462072:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21441@kfi7
00000400:00000200:15.0:1773851889.462072:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21441@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.462073:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000721d6226 nid 21441@kfi7 refs 1
00000400:00000200:15.0:1773851889.462074:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000721d6226 nid 21441@kfi7 refs 2
00000400:00000200:15.0:1773851889.462075:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000721d6226 nid 21441@kfi7 refs 3
00000400:00000200:15.0:1773851889.462077:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21441@kfi7 local destination
00000400:00000200:15.0:1773851889.462078:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769944:8769944:1024:4294967295] 21441@kfi7 LPNI seq info [2319015:2319015:16:4294967295]
00000400:00000200:15.0:1773851889.462080:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000721d6226 nid 21441@kfi7 refs 2
00000400:00000200:15.0:1773851889.462081:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21441@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.462083:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21441@kfi7(21441@kfi7:21441@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851889.462084:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000721d6226 nid 21441@kfi7 refs 3
00000800:00000200:15.0:1773851889.462086:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851889.462087:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851889.462089:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851889.462091:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000424 Using peer 21441@kfi7(0x100000000000424)
00000800:00000200:15.0:1773851889.462094:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x100000000000424: rc=0
00000800:00000200:15.0:1773851889.462095:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000424 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851889.462097:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.462098:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d73441c refcount 2 to 21248@kfi7
00010000:00000001:15.0:1773851889.462099:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851889.462099:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.462100:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851889.462101:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007c4e62b9 x1859318552680064/t0(0) o400->64235977-0365-4d89-8d76-ad62c2d4db07@21248@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1827-0'
00000100:00100000:15.0:1773851889.462104:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c4e62b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:64235977-0365-4d89-8d76-ad62c2d4db07+6:39520:x1859318552680064:12345-21248@kfi7:400:default-tuolumne1827-0 Request processed in 64us (96us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851889.462107:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21248@kfi7, seq: 2289901
00000100:00000040:15.0:1773851889.462107:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007edacb48 : new rpc_count 0
00000100:00000001:15.0:1773851889.462108:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851889.462108:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000424 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851889.462109:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851889.462109:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:15.0:1773851889.462110:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000084c0a733.
00000020:00000010:15.0:1773851889.462111:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000380f7712.
00000400:00000200:13.0:1773851889.462111:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:15.0:1773851889.462112:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000007edacb48 : new refcount 5
00000400:00000200:13.0:1773851889.462112:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21441@kfi7: PUT: OK
00000100:00000001:15.0:1773851889.462113:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851889.462113:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c01d933
00000400:00000010:13.0:1773851889.462113:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c01d933.
00000100:00000001:13.0:1773851889.462114:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851889.462114:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851889.462115:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000721d6226 nid 21441@kfi7 refs 2
00000800:00000200:13.0:1773851889.462117:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 21441@kfi7(00000000777f40c4):0x0 lsk 1061 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000424 Transaction freed
00000004:00000001:15.0:1773851889.481729:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851889.481729:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851889.481729:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:15.0:1773851889.481730:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:15.0:1773851889.481730:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000449d3970.
00000004:00000020:11.0:1773851889.481730:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851889.481730:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:15.0:1773851889.481731:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000100:00000010:11.0:1773851889.481731:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f835ac3e.
00000100:00000010:10.0:1773851889.481731:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d81f2c2f.
00000100:00000001:15.0:1773851889.481732:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:11.0:1773851889.481732:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000020:00000040:10.0:1773851889.481732:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000004:00000001:3.0:1773851889.481732:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:3.0:1773851889.481732:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:15.0:1773851889.481733:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:11.0:1773851889.481733:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851889.481733:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:3.0:1773851889.481733:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8f0219f.
02000000:00000001:15.0:1773851889.481734:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851889.481734:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851889.481734:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851889.481734:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851889.481734:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:3.0:1773851889.481734:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
02000000:00000010:15.0:1773851889.481735:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d5b4e425.
02000000:00000010:11.0:1773851889.481735:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001b3f89b7.
00000100:00000001:3.0:1773851889.481735:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:15.0:1773851889.481736:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851889.481736:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851889.481736:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001614bd7e.
00000100:00000001:10.0:1773851889.481736:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851889.481736:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:3.0:1773851889.481736:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.481737:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851889.481737:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:15.0:1773851889.481738:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851889.481738:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851889.481738:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851889.481738:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851889.481738:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e32664fe.
00000100:00000040:15.0:1773851889.481739:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000449d3970] to pc [ptlrpcd_03_01+1]  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:11.0:1773851889.481739:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f835ac3e] to pc [ptlrpcd_02_01+1]  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851889.481739:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d81f2c2f] to pc [ptlrpcd_02_00+0]  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851889.481739:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851889.481740:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851889.481740:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851889.481742:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d8f0219f] to pc [ptlrpcd_00_01+1]  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851889.481743:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851889.481743:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:15.0:1773851889.481744:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:11.0:1773851889.481744:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000004dd1490.
00080000:00000010:10.0:1773851889.481744:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000002dff5484.
00000100:00000001:9.0:1773851889.481744:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851889.481744:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:15.0:1773851889.481745:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000014b0fec5.
00000100:00000001:14.0:1773851889.481745:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851889.481745:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851889.481745:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851889.481745:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851889.481745:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637072007033856 : -107001702517760 : ffff9eaeb987f400)
00080000:00000001:11.0:1773851889.481745:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851889.481745:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636961345251328 : -107112364300288 : ffff9e94f5932800)
00000100:00000001:9.0:1773851889.481745:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851889.481745:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:15.0:1773851889.481746:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637131732563968 : -106941976987648 : ffff9ebca1733800)
00000100:00000001:14.0:1773851889.481746:0:41073:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:10.0:1773851889.481746:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851889.481746:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851889.481746:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851889.481746:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851889.481746:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:15.0:1773851889.481747:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:14.0:1773851889.481747:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:10.0:1773851889.481747:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00080000:00000001:3.0:1773851889.481747:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:2.0:1773851889.481747:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:15.0:1773851889.481748:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851889.481748:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:10.0:1773851889.481748:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000035c06c7c.
00000004:00080000:10.0:1773851889.481748:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614163935024009ns, next at 614164935023157ns, rc = 0
00000100:00000040:8.0:1773851889.481748:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:3.0:1773851889.481748:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000058e70729.
00000100:00000001:2.0:1773851889.481748:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:0.0:1773851889.481748:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:15.0:1773851889.481749:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00000004:00001000:11.0:1773851889.481749:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000100:00000001:9.0:1773851889.481749:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:3.0:1773851889.481749:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636984694965248 : -107089014586368 : ffff9e9a65538400)
00000100:00000001:2.0:1773851889.481749:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:0.0:1773851889.481749:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:15.0:1773851889.481750:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ef286500.
00000004:00000010:11.0:1773851889.481750:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000031579c93.
00080000:00000001:10.0:1773851889.481750:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851889.481750:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851889.481750:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481750:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:3.0:1773851889.481750:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:2.0:1773851889.481750:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:15.0:1773851889.481751:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614163935026413ns, next at 614164935025321ns, rc = 0
00000100:00000001:14.0:1773851889.481751:0:41073:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:11.0:1773851889.481751:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614163935026153ns, next at 614164935025101ns, rc = 0
00000004:00000001:10.0:1773851889.481751:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851889.481751:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851889.481751:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481751:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851889.481751:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851889.481752:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:14.0:1773851889.481752:0:41073:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851889.481752:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:11.0:1773851889.481752:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851889.481752:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d81f2c2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051937216:31@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851889.481752:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:3.0:1773851889.481752:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
02000000:00000001:14.0:1773851889.481753:0:41073:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:14.0:1773851889.481753:0:41073:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851889.481753:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851889.481753:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851889.481753:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f835ac3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051937280:6@kfi7:13:default-yuba2-0
00000004:00000010:3.0:1773851889.481753:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001ae7d361.
00000100:00000001:2.0:1773851889.481753:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851889.481753:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851889.481754:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851889.481754:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851889.481754:0:41073:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000449d3970 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051937152:54@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851889.481754:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851889.481754:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00080000:3.0:1773851889.481754:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614163935029790ns, next at 614164935028617ns, rc = 0
02000000:00000001:2.0:1773851889.481754:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851889.481755:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851889.481755:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:8.0:1773851889.481755:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851889.481755:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:3.0:1773851889.481755:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:2.0:1773851889.481755:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851889.481756:0:41073:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:14.0:1773851889.481756:0:41073:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851889.481756:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851889.481756:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:3.0:1773851889.481756:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851889.481756:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051937344:2095@kfi7:13:default-yuba2-0
02000000:00000001:14.0:1773851889.481757:0:41073:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851889.481757:0:41073:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851889.481757:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006107aa26.
02000000:00000001:9.0:1773851889.481757:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851889.481757:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008f1b9b08.
02000000:00000001:8.0:1773851889.481757:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851889.481757:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851889.481757:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:14.0:1773851889.481758:0:41073:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
00000400:00000200:8.0:1773851889.481758:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
02000000:00000001:2.0:1773851889.481758:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:2.0:1773851889.481758:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851889.481759:0:41073:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851889.481759:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:8.0:1773851889.481759:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
02000000:00000001:2.0:1773851889.481759:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:14.0:1773851889.481760:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000010:9.0:1773851889.481760:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000400:00000010:9.0:1773851889.481760:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000087a60580.
00000400:00000010:8.0:1773851889.481760:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2abdf16.
02000000:00000010:2.0:1773851889.481760:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f82e5278.
00000400:00000010:14.0:1773851889.481761:0:41073:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000100:00000200:9.0:1773851889.481761:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937216, portal 4
00000100:00000200:8.0:1773851889.481761:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937280, portal 4
02000000:00000001:2.0:1773851889.481761:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:14.0:1773851889.481762:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000100:00000001:9.0:1773851889.481762:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851889.481762:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087774848 : -106944621776768 : ffff9ebc03cef080)
00000100:00000001:8.0:1773851889.481762:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851889.481762:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446590336 : -106937262961280 : ffff9ebdba6d8d80)
00000400:00000200:2.0:1773851889.481762:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000010:2.0:1773851889.481762:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000100:00000200:14.0:1773851889.481763:0:41073:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937152, portal 4
00000100:00000001:14.0:1773851889.481763:0:41073:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:2.0:1773851889.481763:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000757d75ef.
00000100:00000001:14.0:1773851889.481764:0:41073:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860201088 : -107049849350528 : ffff9ea383c19680)
00000100:00000040:9.0:1773851889.481764:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851889.481764:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:2.0:1773851889.481765:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937344, portal 4
00000100:00000001:2.0:1773851889.481765:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:14.0:1773851889.481766:0:41073:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851889.481766:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:2.0:1773851889.481766:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288722048 : -106964420829568 : ffff9eb767b15e80)
00000100:00000001:9.0:1773851889.481767:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851889.481767:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000100:00000040:2.0:1773851889.481767:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851889.481768:0:41073:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851889.481768:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:8.0:1773851889.481768:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6b06622.
00000100:00000040:14.0:1773851889.481769:0:41073:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000010:9.0:1773851889.481769:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000339f7b19.
00000100:00000200:9.0:1773851889.481769:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937216, offset 0
00000100:00000200:8.0:1773851889.481769:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937280, offset 0
00000400:00000010:14.0:1773851889.481770:0:41073:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a48130e9.
00000100:00000200:14.0:1773851889.481770:0:41073:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937152, offset 0
00000400:00000200:8.0:1773851889.481770:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000100:00000001:2.0:1773851889.481770:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851889.481771:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000400:00000200:8.0:1773851889.481771:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000040:2.0:1773851889.481771:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000200:14.0:1773851889.481772:0:41073:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:8.0:1773851889.481772:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000010:2.0:1773851889.481772:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c5db55c.
00000400:00000200:14.0:1773851889.481773:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851889.481773:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000200:2.0:1773851889.481773:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937344, offset 0
00000400:00000200:14.0:1773851889.481774:0:41073:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:14.0:1773851889.481775:0:41073:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:8.0:1773851889.481775:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:2.0:1773851889.481775:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:14.0:1773851889.481776:0:41073:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851889.481776:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000200:2.0:1773851889.481776:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851889.481777:0:41073:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:2.0:1773851889.481777:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:14.0:1773851889.481778:0:41073:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769943, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769944, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851889.481778:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769943, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769944, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851889.481778:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:2.0:1773851889.481779:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:8.0:1773851889.481780:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:14.0:1773851889.481781:0:41073:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851889.481781:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851889.481781:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:14.0:1773851889.481782:0:41073:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851889.481782:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:2.0:1773851889.481782:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769943, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769944, p:4294967295, g:4294967295, h:1000]
00000400:00000200:14.0:1773851889.481783:0:41073:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:8.0:1773851889.481783:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769945:8769945:1024:4294967295] 6@kfi7 LPNI seq info [5405036:5405036:16:4294967295]
00000400:00000200:14.0:1773851889.481784:0:41073:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769946:8769946:1024:4294967295] 54@kfi7 LPNI seq info [5403926:5403926:16:4294967295]
00000400:00000200:2.0:1773851889.481784:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:14.0:1773851889.481785:0:41073:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:8.0:1773851889.481785:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:2.0:1773851889.481785:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:14.0:1773851889.481786:0:41073:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851889.481786:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851889.481786:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:9.0:1773851889.481787:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:9.0:1773851889.481788:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:2.0:1773851889.481788:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769947:8769947:1024:4294967295] 2095@kfi7 LPNI seq info [5406047:5406047:16:4294967295]
00000400:00000200:14.0:1773851889.481789:0:41073:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851889.481789:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851889.481789:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:14.0:1773851889.481790:0:41073:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:2.0:1773851889.481790:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:9.0:1773851889.481791:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:14.0:1773851889.481792:0:41073:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851889.481792:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000800:00000200:14.0:1773851889.481793:0:41073:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851889.481794:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8769946, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769947, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851889.481794:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851889.481794:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851889.481795:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000800:00000200:14.0:1773851889.481796:0:41073:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851889.481796:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:2.0:1773851889.481796:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:9.0:1773851889.481797:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851889.481797:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851889.481798:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000800:00000200:8.0:1773851889.481798:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851889.481798:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:14.0:1773851889.481799:0:41073:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b Using peer 54@kfi7(0x33b)
00000400:00000200:9.0:1773851889.481799:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769948:8769948:1023:4294967295] 31@kfi7 LPNI seq info [5403622:5403622:16:4294967295]
00000800:00000200:2.0:1773851889.481799:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851889.481800:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:9.0:1773851889.481801:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:8.0:1773851889.481801:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851889.481802:0:41073:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ba933e94: Posted send of 324 bytes to peer 0x33b: rc=0
00000800:00000200:2.0:1773851889.481802:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851889.481803:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Using peer 6@kfi7(0x54b)
00000800:00000200:14.0:1773851889.481804:0:41073:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851889.481804:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851889.481805:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:2.0:1773851889.481805:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Using peer 2095@kfi7(0x2000000000005b3)
00000100:00000001:14.0:1773851889.481806:0:41073:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851889.481806:0:41073:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:8.0:1773851889.481806:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x54b: rc=0
00000100:00000001:14.0:1773851889.481807:0:41073:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851889.481807:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:14.0:1773851889.481808:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851889.481808:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851889.481808:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:2.0:1773851889.481808:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004991649e: Posted send of 324 bytes to peer 0x2000000000005b3: rc=0
00000100:00000001:14.0:1773851889.481809:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851889.481809:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851889.481810:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:14.0:1773851889.481810:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851889.481810:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851889.481811:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851889.481811:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851889.481811:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851889.481811:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851889.481812:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:14.0:1773851889.481812:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481812:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851889.481812:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851889.481812:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851889.481813:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851889.481813:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Using peer 31@kfi7(0x200000000000560)
00000100:00000001:8.0:1773851889.481813:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851889.481813:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481814:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851889.481814:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481815:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851889.481815:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851889.481816:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851889.481816:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x200000000000560: rc=0
00000100:00000001:2.0:1773851889.481816:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851889.481817:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851889.481817:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851889.481817:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851889.481817:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851889.481818:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851889.481818:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851889.481818:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851889.481818:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851889.481819:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->54@kfi7: PUT: OK
00000100:00000001:2.0:1773851889.481819:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851889.481820:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a48130e9
00000400:00000010:13.0:1773851889.481820:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a48130e9.
00000100:00000001:13.0:1773851889.481821:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:1.0:1773851889.481821:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_EVENT_TX_OK event status 0
00000100:00000200:13.0:1773851889.481822:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851889.481822:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851889.481822:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:10.0:1773851889.481823:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851889.481823:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481823:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851889.481823:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851889.481824:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851889.481824:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851889.481824:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851889.481824:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000100:00000001:13.0:1773851889.481825:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:10.0:1773851889.481825:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851889.481825:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:1.0:1773851889.481825:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c5db55c
00000400:00000010:1.0:1773851889.481825:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c5db55c.
00000100:00000040:13.0:1773851889.481826:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851889.481826:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000100:00000001:9.0:1773851889.481826:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851889.481826:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851889.481826:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:10.0:1773851889.481827:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6b06622
00000400:00000010:10.0:1773851889.481827:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6b06622.
00000100:00000001:9.0:1773851889.481827:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851889.481827:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851889.481827:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851889.481828:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851889.481828:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851889.481828:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851889.481829:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:10.0:1773851889.481829:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851889.481830:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:1.0:1773851889.481830:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:1.0:1773851889.481831:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851889.481832:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ba933e94: 2069@kfi7:3 -> 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x33b Transaction freed
00000100:00000001:10.0:1773851889.481832:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851889.481833:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851889.481833:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851889.481834:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:11.0:1773851889.481835:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851889.481835:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851889.481835:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:11.0:1773851889.481836:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851889.481836:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851889.481837:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:1.0:1773851889.481837:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Transaction freed
00000400:00000200:11.0:1773851889.481838:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000400:00000200:11.0:1773851889.481838:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000339f7b19
00000400:00000010:11.0:1773851889.481839:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000339f7b19.
00000800:00000200:10.0:1773851889.481839:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Transaction freed
00000100:00000001:11.0:1773851889.481840:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:11.0:1773851889.481841:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851889.481843:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851889.481844:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851889.481847:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851889.481847:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851889.481848:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:11.0:1773851889.481850:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2054@kfi7:2 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000560 Transaction freed
00000800:00000200:13.0:1773851889.481851:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851889.481852:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851889.481853:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851889.481854:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851889.481855:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851889.481855:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851889.481855:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:29.0:1773851889.481856:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851889.481856:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851889.481858:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851889.481859:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851889.481859:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.481860:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000200:29.0:1773851889.481861:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851889.481861:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:1.0:1773851889.481861:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851889.481862:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:29.0:1773851889.481863:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:13.0:1773851889.481863:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851889.481863:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851889.481864:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:1.0:1773851889.481864:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:29.0:1773851889.481865:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:13.0:1773851889.481865:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:1.0:1773851889.481865:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851889.481866:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:1.0:1773851889.481866:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:29.0:1773851889.481867:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851889.481867:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:29.0:1773851889.481868:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:13.0:1773851889.481868:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5980
00000400:00000200:1.0:1773851889.481868:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:1.0:1773851889.481869:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:29.0:1773851889.481870:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:13.0:1773851889.481870:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:1.0:1773851889.481870:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:29.0:1773851889.481871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851889.481871:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f6ced [1] + 224
00000400:00000200:1.0:1773851889.481871:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851889.481872:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5a40
00000800:00000200:17.0:1773851889.481872:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:29.0:1773851889.481873:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:17.0:1773851889.481873:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851889.481873:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851889.481873:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5a00
00000800:00000200:17.0:1773851889.481874:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851889.481874:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851889.481874:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851889.481876:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78008191d [1] + 224
00000800:00000200:17.0:1773851889.481876:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851889.481876:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->54@kfi7: PUT: OK
00000400:00000200:1.0:1773851889.481876:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71e0c1 [1] + 224
00000100:00000001:13.0:1773851889.481877:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:13.0:1773851889.481878:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851889.481878:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851889.481879:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851889.481879:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:29.0:1773851889.481880:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851889.481880:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:1.0:1773851889.481880:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851889.481881:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000040:13.0:1773851889.481881:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851889.481882:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000400:00000200:17.0:1773851889.481882:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:1.0:1773851889.481882:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000100:00000001:29.0:1773851889.481883:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851889.481883:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851889.481883:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:1.0:1773851889.481883:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851889.481884:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851889.481884:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851889.481884:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:17.0:1773851889.481885:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000100:00000001:14.0:1773851889.481885:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:1.0:1773851889.481885:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851889.481886:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:14.0:1773851889.481886:0:41073:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:14.0:1773851889.481886:0:41073:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:13.0:1773851889.481886:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 54@kfi7(00000000af85fb80):0x0 lsk 828 rsk 4790 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851889.481887:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b59c0
00000400:00000001:14.0:1773851889.481887:0:41073:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:14.0:1773851889.481887:0:41073:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000100:00000040:1.0:1773851889.481887:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851889.481888:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851889.481888:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:14.0:1773851889.481888:0:41073:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
00000400:00000200:17.0:1773851889.481889:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f1e71 [1] + 224
00000400:00000010:14.0:1773851889.481889:0:41073:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000100:00000001:14.0:1773851889.481890:0:41073:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:17.0:1773851889.481891:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:14.0:1773851889.481891:0:41073:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851889.481891:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851889.481892:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851889.481892:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:29.0:1773851889.481893:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:8.0:1773851889.481893:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851889.481893:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:1.0:1773851889.481893:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000200:14.0:1773851889.481894:0:41073:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:8.0:1773851889.481894:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:2.0:1773851889.481894:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851889.481894:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851889.481895:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851889.481895:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:8.0:1773851889.481895:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:2.0:1773851889.481895:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:17.0:1773851889.481896:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000100:00000001:14.0:1773851889.481896:0:41073:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000001:2.0:1773851889.481896:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:17.0:1773851889.481897:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:14.0:1773851889.481897:0:41073:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851889.481897:0:41073:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:8.0:1773851889.481897:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:8.0:1773851889.481897:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2abdf16
00000400:00000010:2.0:1773851889.481897:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000100:00000200:17.0:1773851889.481898:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:14.0:1773851889.481898:0:41073:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:14.0:1773851889.481898:0:41073:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:8.0:1773851889.481898:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2abdf16.
00000400:00000200:2.0:1773851889.481898:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000757d75ef
00000400:00000010:2.0:1773851889.481898:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000757d75ef.
00000100:00000001:14.0:1773851889.481899:0:41073:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481899:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:2.0:1773851889.481899:0:41061:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:14.0:1773851889.481900:0:41073:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851889.481900:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851889.481901:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:14.0:1773851889.481901:0:41073:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=122 v=66 (66 66 66 66)
00000100:00000200:2.0:1773851889.481901:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:14.0:1773851889.481902:0:41073:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=122 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851889.481903:0:41073:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:14.0:1773851889.481903:0:41073:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:14.0:1773851889.481904:0:41073:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:14.0:1773851889.481904:0:41073:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851889.481904:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:2.0:1773851889.481904:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851889.481905:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851889.481905:0:41073:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:17.0:1773851889.481906:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000040:14.0:1773851889.481906:0:41073:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:14.0:1773851889.481906:0:41073:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851889.481906:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851889.481906:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:17.0:1773851889.481907:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851889.481907:0:41073:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851889.481907:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851889.481907:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851889.481907:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851889.481907:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851889.481907:0:41061:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:14.0:1773851889.481908:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:9.0:1773851889.481908:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851889.481908:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851889.481908:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:2.0:1773851889.481908:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:2.0:1773851889.481908:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000001:9.0:1773851889.481909:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851889.481909:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000100:00000001:8.0:1773851889.481909:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851889.481909:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851889.481909:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851889.481910:0:41073:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851889.481910:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000087a60580
02000000:00000001:8.0:1773851889.481910:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851889.481910:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851889.481911:0:41073:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000010:9.0:1773851889.481911:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000087a60580.
00000100:00001000:8.0:1773851889.481911:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=122 v=66 (66 66 66 66)
00000100:00001000:2.0:1773851889.481911:0:41061:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=122 v=66 (66 66 66 66)
00000100:00000001:14.0:1773851889.481912:0:41073:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:14.0:1773851889.481912:0:41073:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851889.481912:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851889.481912:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:14.0:1773851889.481913:0:41073:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000100:00001000:8.0:1773851889.481913:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=37 v=66 (1 1 1 1)
00000100:00001000:2.0:1773851889.481913:0:41061:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=122 v=66 (1 1 1 1)
00000004:00000040:14.0:1773851889.481914:0:41073:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524016128 avail=351521288192 avail_mb=1373130032 hwm_mb=3131103 files=372113770 ffree=343285172 state=0: rc = 0
00000100:00000001:8.0:1773851889.481914:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851889.481914:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851889.481914:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851889.481914:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851889.481915:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:8.0:1773851889.481915:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:2.0:1773851889.481915:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:14.0:1773851889.481916:0:41073:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524016128 free, 351521288192 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113770 files, 343285172 free files
00010000:00000001:8.0:1773851889.481916:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.481916:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:14.0:1773851889.481917:0:41073:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481917:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851889.481917:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000001:2.0:1773851889.481917:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851889.481918:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851889.481918:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851889.481918:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:2.0:1773851889.481918:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000040:14.0:1773851889.481919:0:41073:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851889.481919:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851889.481919:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851889.481919:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851889.481919:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:2.0:1773851889.481919:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851889.481920:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:8.0:1773851889.481920:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:2.0:1773851889.481920:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851889.481921:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851889.481922:0:41073:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000449d3970 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_01:lustre5-MDT0001-mdtlov_UUID:41073:1859433051937152:54@kfi7:13:default-yuba2-0
02000000:00000001:9.0:1773851889.481922:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851889.481922:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=122 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851889.481922:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851889.481923:0:41073:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:9.0:1773851889.481923:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=122 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851889.481923:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:14.0:1773851889.481924:0:41073:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:14.0:1773851889.481924:0:41073:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000449d3970 x1859433051937152/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851889.481924:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851889.481925:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851889.481925:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851889.481925:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851889.481925:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00010000:00000001:9.0:1773851889.481926:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851889.481926:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:8.0:1773851889.481926:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420232704 avail=351417786368 avail_mb=1372725728 hwm_mb=3131103 files=372008904 ffree=343183821 state=0: rc = 0
00000100:00000001:14.0:1773851889.481927:0:41073:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:14.0:1773851889.481927:0:41073:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:14.0:1773851889.481928:0:41073:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
00000100:00000001:9.0:1773851889.481928:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851889.481928:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000004:00000020:8.0:1773851889.481928:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420232704 free, 351417786368 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372008904 files, 343183821 free files
02000000:00000001:14.0:1773851889.481929:0:41073:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:14.0:1773851889.481929:0:41073:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:9.0:1773851889.481929:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851889.481929:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:14.0:1773851889.481930:0:41073:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000020:00000001:14.0:1773851889.481930:0:41073:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:9.0:1773851889.481930:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:8.0:1773851889.481930:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851889.481930:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:14.0:1773851889.481931:0:41073:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d5b4e425.
02000000:00000001:14.0:1773851889.481932:0:41073:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:14.0:1773851889.481932:0:41073:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:9.0:1773851889.481932:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000010:14.0:1773851889.481933:0:41073:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000449d3970.
00000100:00000001:9.0:1773851889.481933:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00100000:8.0:1773851889.481933:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f835ac3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051937280:6@kfi7:13:default-yuba2-0
00000100:00000001:14.0:1773851889.481934:0:41073:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:14.0:1773851889.481934:0:41073:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851889.481934:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851889.481934:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:8.0:1773851889.481934:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851889.481934:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851889.481934:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:14.0:1773851889.481935:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:9.0:1773851889.481935:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000100:00000001:8.0:1773851889.481935:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:2.0:1773851889.481935:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851889.481936:0:41073:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:14.0:1773851889.481936:0:41073:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:9.0:1773851889.481936:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666622464 avail=351645423616 avail_mb=1373614936 hwm_mb=3131103 files=372237777 ffree=343424436 state=0: rc = 0
00000100:00000040:8.0:1773851889.481936:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f835ac3e x1859433051937280/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:2.0:1773851889.481936:0:41061:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:2.0:1773851889.481936:0:41061:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000100:00000001:14.0:1773851889.481937:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851889.481937:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:9.0:1773851889.481937:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666622464 free, 351645423616 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237777 files, 343424436 free files
00000004:00000040:2.0:1773851889.481937:0:41061:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449354240 avail=351446807552 avail_mb=1372839092 hwm_mb=3131103 files=372160945 ffree=343212260 state=0: rc = 0
00000100:00000001:8.0:1773851889.481938:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851889.481938:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:9.0:1773851889.481939:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851889.481939:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008f1b9b08.
00000004:00000020:2.0:1773851889.481939:0:41061:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449354240 free, 351446807552 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160945 files, 343212260 free files
00000100:00000040:9.0:1773851889.481940:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:8.0:1773851889.481940:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000001:2.0:1773851889.481940:0:41061:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851889.481941:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851889.481941:0:41069:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000100:00000040:2.0:1773851889.481941:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851889.481942:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d81f2c2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051937216:31@kfi7:13:default-yuba2-0
00000020:00000001:8.0:1773851889.481942:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851889.481942:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001b3f89b7.
02000000:00000001:8.0:1773851889.481943:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:9.0:1773851889.481944:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851889.481944:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851889.481944:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f835ac3e.
00000100:00100000:2.0:1773851889.481944:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051937344:2095@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851889.481945:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851889.481945:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:9.0:1773851889.481946:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d81f2c2f x1859433051937216/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851889.481946:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851889.481946:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851889.481946:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851889.481947:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851889.481947:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851889.481948:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851889.481948:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:8.0:1773851889.481948:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851889.481948:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:2.0:1773851889.481948:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d8f0219f x1859433051937344/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:9.0:1773851889.481949:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006107aa26.
00000100:00000001:8.0:1773851889.481949:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851889.481950:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851889.481950:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851889.481950:0:41068:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:2.0:1773851889.481950:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:9.0:1773851889.481951:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:2.0:1773851889.481951:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851889.481952:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001614bd7e.
02000000:00000001:9.0:1773851889.481952:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000010:2.0:1773851889.481952:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f82e5278.
02000000:00000001:9.0:1773851889.481953:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:2.0:1773851889.481953:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:2.0:1773851889.481953:0:41061:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000010:9.0:1773851889.481954:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d81f2c2f.
00000020:00000040:2.0:1773851889.481954:0:41061:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000020:00000001:2.0:1773851889.481954:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:9.0:1773851889.481955:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851889.481955:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851889.481955:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:2.0:1773851889.481955:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e32664fe.
00000100:00000001:9.0:1773851889.481956:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851889.481956:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851889.481956:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:2.0:1773851889.481956:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:9.0:1773851889.481957:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851889.481957:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:2.0:1773851889.481957:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8f0219f.
00000100:00000001:2.0:1773851889.481958:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851889.481959:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851889.481959:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851889.481960:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851889.481962:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851889.481962:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851889.481962:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851889.528774:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851889.528775:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851889.528776:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851889.528778:0:2464256:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21201@kfi7(00000000370ee441):0x4d7 version: 2; local version 2; negotiated version: 2
00000800:00000200:27.0:1773851889.528780:0:2464256:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 Using peer 21201@kfi7(0x4d7)
00000400:00000200:27.0:1773851889.528783:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21201@kfi7 to cpt 6
00000800:00000200:27.0:1773851889.528785:0:2464256:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000005690846: Posted send of 38 bytes to peer 0x4d7: rc=0
00000800:00000200:27.0:1773851889.528787:0:2464256:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:27.0:1773851889.528801:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851889.528802:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851889.528803:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851889.528803:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 TN_EVENT_TX_OK event status 0
00000800:00000200:27.0:1773851889.528806:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851889.528807:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 Transaction freed
00000400:00000200:27.0:1773851889.528808:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21201@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.528809:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21201@kfi7 : PUT - for me
00000400:00000200:27.0:1773851889.528811:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21201@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.528812:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005aed0553 nid 21201@kfi7 refs 1
00000400:00000200:27.0:1773851889.528814:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21201@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.528815:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005aed0553 nid 21201@kfi7 refs 2
00000400:00000200:27.0:1773851889.528816:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005aed0553 nid 21201@kfi7 refs 3
00000400:00000200:27.0:1773851889.528817:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21201@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.528818:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21201@kfi7 of length 224 into portal 12 MB=0x69b095f5deac0
00000400:00000200:27.0:1773851889.528820:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21201@kfi7 of length 224/224 into md 0x16159c9699 [64] + 31752
00000800:00000200:27.0:1773851889.528822:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851889.528824:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851889.528826:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21201@kfi7: PUT: OK
00000100:00000001:27.0:1773851889.528827:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851889.528828:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851889.528830:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000099a9d79f.
00000100:00000040:27.0:1773851889.528830:0:2464256:0:(events.c:358:request_in_callback()) incoming req@0000000099a9d79f x1859314417265344 msgsize 224
00000100:00100000:27.0:1773851889.528832:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-21201@kfi7 (source: 12345-21201@kfi7)
00000100:00000001:27.0:1773851889.528833:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851889.528834:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005aed0553 nid 21201@kfi7 refs 2
00000800:00000200:27.0:1773851889.528836:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007a0ad8d8: 2069@kfi7:6 <- 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851889.528839:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851889.528840:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851889.528840:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851889.528841:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851889.528842:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851889.528843:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314417265344
00000020:00000001:27.0:1773851889.528843:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851889.528844:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f88
00000020:00000001:27.0:1773851889.528845:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851889.528849:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000751732e5 refcount=6
00000020:00000001:27.0:1773851889.528849:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629278720 : -107123080272896 : ffff9e9276da6400)
00000020:00000001:27.0:1773851889.528850:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629278720 : -107123080272896 : ffff9e9276da6400)
00000100:00000001:27.0:1773851889.528851:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851889.528852:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851889.528852:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0454dd1.
00000020:00000010:27.0:1773851889.528854:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851889.528855:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcd1148b.
00000100:00000001:27.0:1773851889.528856:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851889.528856:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851889.528857:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851889.528858:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851889.528858:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851889.528859:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.528860:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851889.528861:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851889.528862:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851889.528863:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21201@kfi7, seq: 2025161
00000100:00000001:25.0:1773851889.528863:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851889.528863:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851889.528864:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000751732e5 : new rpc_count 1
00000100:00000001:27.0:1773851889.528864:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998395136 : -107053711156480 : ffff9ea29d931b00)
00000100:00000001:25.0:1773851889.528864:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851889.528865:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851889.528866:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000099a9d79f x1859314417265344/t0(0) o400->b5ebe54b-ab1c-455f-be55-c18de047f6a5@21201@kfi7:529/0 lens 224/0 e 0 to 0 dl 1773852644 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1809-0'
00000100:00000001:27.0:1773851889.528868:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851889.528868:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851889.528869:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099a9d79f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b5ebe54b-ab1c-455f-be55-c18de047f6a5+6:39683:x1859314417265344:12345-21201@kfi7:400:default-tuolumne1809-0
00000100:00000200:27.0:1773851889.528870:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314417265344
00000020:00000001:27.0:1773851889.528871:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851889.528871:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851889.528872:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.528873:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851889.528873:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851889.528874:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851889.528874:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314417265344, found 0 last_xid 1859314417265343
00000020:00000001:27.0:1773851889.528875:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851889.528876:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851889.528876:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851889.528877:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.528877:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851889.528878:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851889.528878:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851889.528879:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000029e4ca65.
02000000:00000001:27.0:1773851889.528880:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.528880:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.528881:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851889.528882:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698812, transno 0, xid 1859314417265344
00010000:00000001:27.0:1773851889.528882:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851889.528883:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000099a9d79f x1859314417265344/t0(0) o400->b5ebe54b-ab1c-455f-be55-c18de047f6a5@21201@kfi7:529/0 lens 224/224 e 0 to 0 dl 1773852644 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1809-0'
00010000:00000001:27.0:1773851889.528885:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851889.528886:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851889.528887:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=122 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851889.528888:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851889.528889:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3441f77 refcount 3 to 21201@kfi7
00000100:00000001:27.0:1773851889.528889:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366320672 : -107142343230944 : ffff9e8dfab0fa20)
02000000:00000001:27.0:1773851889.528890:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851889.528890:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.528891:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851889.528892:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21201@kfi7
00000400:00000010:27.0:1773851889.528892:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098be1f67.
00000100:00000200:27.0:1773851889.528893:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314417265344, offset 224
00000400:00000200:27.0:1773851889.528894:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21201@kfi7
00000400:00000200:27.0:1773851889.528895:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21201@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.528895:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005aed0553 nid 21201@kfi7 refs 1
00000400:00000200:27.0:1773851889.528896:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005aed0553 nid 21201@kfi7 refs 2
00000400:00000200:27.0:1773851889.528897:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005aed0553 nid 21201@kfi7 refs 3
00000400:00000200:27.0:1773851889.528898:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21201@kfi7 local destination
00000400:00000200:27.0:1773851889.528900:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769949:8769949:1024:4294967295] 21201@kfi7 LPNI seq info [171170:171170:16:4294967295]
00000400:00000200:27.0:1773851889.528901:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005aed0553 nid 21201@kfi7 refs 2
00000400:00000200:27.0:1773851889.528902:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21201@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.528903:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21201@kfi7(21201@kfi7:21201@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851889.528905:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005aed0553 nid 21201@kfi7 refs 3
00000800:00000200:27.0:1773851889.528906:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851889.528907:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851889.528908:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851889.528911:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 Using peer 21201@kfi7(0x4d7)
00000800:00000200:27.0:1773851889.528913:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x4d7: rc=0
00000800:00000200:27.0:1773851889.528914:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851889.528916:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851889.528917:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3441f77 refcount 2 to 21201@kfi7
00010000:00000001:27.0:1773851889.528918:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851889.528918:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.528919:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851889.528919:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000099a9d79f x1859314417265344/t0(0) o400->b5ebe54b-ab1c-455f-be55-c18de047f6a5@21201@kfi7:529/0 lens 224/224 e 0 to 0 dl 1773852644 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1809-0'
00000100:00100000:27.0:1773851889.528922:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099a9d79f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b5ebe54b-ab1c-455f-be55-c18de047f6a5+6:39683:x1859314417265344:12345-21201@kfi7:400:default-tuolumne1809-0 Request processed in 53us (91us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851889.528924:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21201@kfi7, seq: 2025161
00000100:00000040:27.0:1773851889.528925:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000751732e5 : new rpc_count 0
00000100:00000001:27.0:1773851889.528925:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851889.528926:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851889.528926:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851889.528927:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcd1148b.
00000020:00000010:27.0:1773851889.528928:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0454dd1.
00000020:00000040:27.0:1773851889.528929:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000751732e5 : new refcount 5
00000100:00000001:27.0:1773851889.528929:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851889.528929:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851889.528932:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851889.528934:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21201@kfi7: PUT: OK
00000400:00000200:25.0:1773851889.528935:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098be1f67
00000400:00000010:25.0:1773851889.528936:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098be1f67.
00000100:00000001:25.0:1773851889.528937:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851889.528938:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851889.528940:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005aed0553 nid 21201@kfi7 refs 2
00000800:00000200:25.0:1773851889.528942:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 21201@kfi7(00000000370ee441):0x0 lsk 1240 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4d7 Transaction freed
00000400:00000200:29.0:1773851889.545732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851889.545734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851889.556372:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851889.556373:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851889.556374:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851889.556376:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851889.556378:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.556379:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12027@kfi7 : PUT - for me
00000400:00000200:21.0:1773851889.556380:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.556380:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 1
00000400:00000200:21.0:1773851889.556381:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.556382:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000400:00000200:21.0:1773851889.556383:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 3
00000400:00000200:21.0:1773851889.556384:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12026@kfi7 to cpt 2
00000400:00000200:21.0:1773851889.556384:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12026@kfi7 of length 224 into portal 12 MB=0x699de8d95e9c0
00000400:00000200:21.0:1773851889.556386:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12026@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 56856
00000800:00000200:21.0:1773851889.556387:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851889.556388:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.556389:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12027@kfi7: PUT: OK
00000100:00000001:21.0:1773851889.556390:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851889.556390:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851889.556391:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002c20b0b2.
00000100:00000040:21.0:1773851889.556392:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002c20b0b2 x1858030997465536 msgsize 224
00000100:00100000:21.0:1773851889.556393:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12026@kfi7 (source: 12345-12027@kfi7)
00000100:00000001:21.0:1773851889.556394:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851889.556395:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000100:00000001:20.0:1773851889.556395:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851889.556396:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851889.556396:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851889.556396:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851889.556397:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851889.556397:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851889.556398:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030997465536
00000020:00000001:20.0:1773851889.556399:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851889.556399:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91046
00000020:00000001:20.0:1773851889.556400:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851889.556402:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000078f25f1f refcount=6
00000020:00000001:20.0:1773851889.556403:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240122368 : -107152469429248 : ffff9e8b9f1f7400)
00000020:00000001:20.0:1773851889.556404:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240122368 : -107152469429248 : ffff9e8b9f1f7400)
00000100:00000001:20.0:1773851889.556405:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.556406:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851889.556407:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8e3d745.
00000020:00000010:20.0:1773851889.556408:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.556409:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000045a8637c.
00000100:00000001:20.0:1773851889.556409:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851889.556410:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851889.556410:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.556411:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851889.556412:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851889.556412:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556413:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.556414:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851889.556414:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851889.556415:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851889.556415:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851889.556415:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12026@kfi7, seq: 1998050
00000100:00000001:23.0:1773851889.556416:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851889.556416:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000078f25f1f : new rpc_count 1
00000100:00000001:23.0:1773851889.556417:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556417:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102026005248 : -106971683546368 : ffff9eb5b6cd1b00)
00000100:00000040:20.0:1773851889.556418:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002c20b0b2 x1858030997465536/t0(0) o400->60efa257-d258-4e83-8d85-c64949c4a26c@12026@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne215-0'
00000100:00000001:20.0:1773851889.556420:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.556421:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851889.556422:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002c20b0b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:60efa257-d258-4e83-8d85-c64949c4a26c+6:47814:x1858030997465536:12345-12026@kfi7:400:default-tuolumne215-0
00000100:00000200:20.0:1773851889.556423:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030997465536
00000020:00000001:20.0:1773851889.556424:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851889.556424:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851889.556425:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556425:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851889.556426:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851889.556427:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851889.556428:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030997465536, found 0 last_xid 1858030997465535
00000020:00000001:20.0:1773851889.556428:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851889.556429:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851889.556429:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851889.556430:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556431:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851889.556432:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851889.556432:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851889.556433:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003de3ca7f.
02000000:00000001:20.0:1773851889.556433:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556434:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556434:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851889.556435:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030997465536
00010000:00000001:20.0:1773851889.556436:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851889.556437:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002c20b0b2 x1858030997465536/t0(0) o400->60efa257-d258-4e83-8d85-c64949c4a26c@12026@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne215-0'
00010000:00000001:20.0:1773851889.556439:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851889.556439:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851889.556440:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=122 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851889.556441:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851889.556442:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008728dc53 refcount 5 to 12026@kfi7
00000100:00000001:20.0:1773851889.556442:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579680 : -107154806971936 : ffff9e8b13cb61e0)
02000000:00000001:20.0:1773851889.556443:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851889.556444:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556444:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851889.556445:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12027@kfi7
00000400:00000010:20.0:1773851889.556446:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009c43daff.
00000100:00000200:20.0:1773851889.556446:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030997465536, offset 224
00000400:00000200:20.0:1773851889.556448:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12027@kfi7
00000400:00000200:20.0:1773851889.556448:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.556449:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 1
00000400:00000200:20.0:1773851889.556450:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000400:00000200:20.0:1773851889.556451:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 3
00000400:00000200:20.0:1773851889.556453:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12027@kfi7 local destination
00000400:00000200:20.0:1773851889.556454:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769950:8769950:1024:4294967295] 12027@kfi7 LPNI seq info [24457:24457:16:4294967295]
00000400:00000200:20.0:1773851889.556455:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000400:00000200:20.0:1773851889.556456:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.556458:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12027@kfi7(12027@kfi7:12027@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851889.556460:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 3
00000800:00000200:20.0:1773851889.556461:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851889.556462:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851889.556464:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851889.556467:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000282 Using peer 12027@kfi7(0x100000000000282)
00000800:00000200:20.0:1773851889.556469:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0x100000000000282: rc=0
00000800:00000200:20.0:1773851889.556470:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000282 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851889.556472:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851889.556473:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008728dc53 refcount 4 to 12026@kfi7
00010000:00000001:20.0:1773851889.556474:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851889.556474:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556475:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851889.556476:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002c20b0b2 x1858030997465536/t0(0) o400->60efa257-d258-4e83-8d85-c64949c4a26c@12026@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne215-0'
00000100:00100000:20.0:1773851889.556479:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002c20b0b2 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:60efa257-d258-4e83-8d85-c64949c4a26c+6:47814:x1858030997465536:12345-12026@kfi7:400:default-tuolumne215-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851889.556481:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12026@kfi7, seq: 1998050
00000100:00000040:20.0:1773851889.556482:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000078f25f1f : new rpc_count 0
00000100:00000001:20.0:1773851889.556483:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851889.556483:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851889.556484:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.556484:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000045a8637c.
00000020:00000010:20.0:1773851889.556485:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8e3d745.
00000020:00000040:20.0:1773851889.556486:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000078f25f1f : new refcount 5
00000100:00000001:20.0:1773851889.556487:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851889.556491:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000282 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851889.556492:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.556493:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12027@kfi7: PUT: OK
00000400:00000200:21.0:1773851889.556494:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009c43daff
00000400:00000010:21.0:1773851889.556494:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009c43daff.
00000100:00000001:21.0:1773851889.556495:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851889.556495:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851889.556496:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000800:00000200:21.0:1773851889.556497:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 12027@kfi7(0000000045f95f28):0x0 lsk 643 rsk 133 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000282 Transaction freed
00000800:00000200:21.0:1773851889.556722:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851889.556723:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851889.556724:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851889.556733:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851889.556735:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.556736:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12027@kfi7 : PUT - for me
00000400:00000200:21.0:1773851889.556737:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.556738:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 1
00000400:00000200:21.0:1773851889.556739:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.556740:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000400:00000200:21.0:1773851889.556741:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 3
00000400:00000200:21.0:1773851889.556742:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12026@kfi7 to cpt 2
00000400:00000200:21.0:1773851889.556743:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12026@kfi7 of length 224 into portal 12 MB=0x699de8d95f180
00000400:00000200:21.0:1773851889.556744:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12026@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 57080
00000800:00000200:21.0:1773851889.556746:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851889.556749:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.556751:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12027@kfi7: PUT: OK
00000100:00000001:21.0:1773851889.556752:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851889.556752:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851889.556754:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000012800407.
00000100:00000040:21.0:1773851889.556755:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000012800407 x1858030997467520 msgsize 224
00000100:00100000:21.0:1773851889.556757:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12026@kfi7 (source: 12345-12027@kfi7)
00000100:00000001:21.0:1773851889.556758:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851889.556760:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000100:00000001:20.0:1773851889.556761:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851889.556762:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2069@kfi7:5 <- 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851889.556763:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851889.556763:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851889.556764:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851889.556765:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851889.556766:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030997467520
00000020:00000001:20.0:1773851889.556767:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851889.556767:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911ea
00000020:00000001:20.0:1773851889.556768:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851889.556773:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dc08d180 refcount=6
00000020:00000001:20.0:1773851889.556774:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240537088 : -107152469014528 : ffff9e8b9f25c800)
00000020:00000001:20.0:1773851889.556775:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240537088 : -107152469014528 : ffff9e8b9f25c800)
00000100:00000001:20.0:1773851889.556776:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.556777:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851889.556778:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8e3d745.
00000020:00000010:20.0:1773851889.556779:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.556780:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000045a8637c.
00000100:00000001:20.0:1773851889.556781:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851889.556782:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851889.556783:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.556784:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851889.556785:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851889.556785:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556787:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851889.556789:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851889.556789:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851889.556790:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851889.556791:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851889.556791:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12026@kfi7, seq: 1998051
00000100:00000001:23.0:1773851889.556792:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851889.556792:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dc08d180 : new rpc_count 1
00000100:00000001:23.0:1773851889.556793:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556793:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102026008704 : -106971683542912 : ffff9eb5b6cd2880)
00000100:00000040:20.0:1773851889.556795:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000012800407 x1858030997467520/t0(0) o400->0f12ad97-dc72-47fb-b7d5-9ebcf600708a@12026@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne215-0'
00000100:00000001:20.0:1773851889.556800:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.556800:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851889.556802:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012800407 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0f12ad97-dc72-47fb-b7d5-9ebcf600708a+6:47812:x1858030997467520:12345-12026@kfi7:400:default-tuolumne215-0
00000100:00000200:20.0:1773851889.556808:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030997467520
00000020:00000001:20.0:1773851889.556809:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851889.556810:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851889.556811:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556812:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851889.556812:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851889.556814:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851889.556815:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030997467520, found 0 last_xid 1858030997467519
00000020:00000001:20.0:1773851889.556816:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851889.556817:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851889.556818:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851889.556819:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556820:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851889.556821:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851889.556821:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851889.556823:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fdb48c5d.
02000000:00000001:20.0:1773851889.556824:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556825:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556826:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851889.556827:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768214, transno 0, xid 1858030997467520
00010000:00000001:20.0:1773851889.556828:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851889.556830:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000012800407 x1858030997467520/t0(0) o400->0f12ad97-dc72-47fb-b7d5-9ebcf600708a@12026@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne215-0'
00010000:00000001:20.0:1773851889.556834:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851889.556835:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851889.556836:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=122 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851889.556838:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851889.556839:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008728dc53 refcount 5 to 12026@kfi7
00000100:00000001:20.0:1773851889.556840:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579680 : -107154806971936 : ffff9e8b13cb61e0)
02000000:00000001:20.0:1773851889.556841:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851889.556842:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.556843:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851889.556844:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12027@kfi7
00000400:00000010:20.0:1773851889.556845:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052968703.
00000100:00000200:20.0:1773851889.556847:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030997467520, offset 224
00000400:00000200:20.0:1773851889.556849:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12027@kfi7
00000400:00000200:20.0:1773851889.556851:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.556852:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 1
00000400:00000200:20.0:1773851889.556853:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000400:00000200:20.0:1773851889.556855:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 3
00000400:00000200:20.0:1773851889.556857:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12027@kfi7 local destination
00000400:00000200:20.0:1773851889.556859:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769951:8769951:1024:4294967295] 12027@kfi7 LPNI seq info [24458:24458:16:4294967295]
00000400:00000200:20.0:1773851889.556862:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000400:00000200:20.0:1773851889.556863:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12027@kfi7 to cpt 5
00000400:00000200:20.0:1773851889.556866:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12027@kfi7(12027@kfi7:12027@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851889.556869:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 3
00000800:00000200:20.0:1773851889.556871:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851889.556873:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851889.556876:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851889.556880:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x27f Using peer 12027@kfi7(0x27f)
00000800:00000200:20.0:1773851889.556885:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x27f: rc=0
00000800:00000200:20.0:1773851889.556887:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x27f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851889.556890:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851889.556891:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008728dc53 refcount 4 to 12026@kfi7
00010000:00000001:20.0:1773851889.556892:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851889.556893:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851889.556894:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851889.556897:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000012800407 x1858030997467520/t0(0) o400->0f12ad97-dc72-47fb-b7d5-9ebcf600708a@12026@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne215-0'
00000100:00100000:20.0:1773851889.556902:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012800407 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:0f12ad97-dc72-47fb-b7d5-9ebcf600708a+6:47812:x1858030997467520:12345-12026@kfi7:400:default-tuolumne215-0 Request processed in 101us (146us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851889.556906:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12026@kfi7, seq: 1998051
00000100:00000040:20.0:1773851889.556907:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dc08d180 : new rpc_count 0
00000100:00000001:20.0:1773851889.556908:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851889.556908:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851889.556909:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.556910:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000045a8637c.
00000020:00000010:20.0:1773851889.556911:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8e3d745.
00000020:00000040:20.0:1773851889.556912:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000dc08d180 : new refcount 5
00000100:00000001:20.0:1773851889.556914:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851889.556921:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x27f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851889.556923:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851889.556925:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12027@kfi7: PUT: OK
00000400:00000200:21.0:1773851889.556926:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052968703
00000400:00000010:21.0:1773851889.556927:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052968703.
00000100:00000001:21.0:1773851889.556928:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851889.556929:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851889.556930:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b923dd7 nid 12027@kfi7 refs 2
00000800:00000200:21.0:1773851889.556932:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 12027@kfi7(00000000f75d2469):0x0 lsk 640 rsk 134 tsk 0 trmk 0 tmk 0 trr 5 tta 0x27f Transaction freed
00000800:00000200:5.0:1773851889.614562:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851889.614563:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851889.614565:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851889.614567:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851889.614568:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18288@kfi7 to cpt 1
00000400:00000200:5.0:1773851889.614570:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18288@kfi7 : PUT - for me
00000400:00000200:5.0:1773851889.614570:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18288@kfi7 to cpt 1
00000400:00000200:5.0:1773851889.614571:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daecf0fe nid 18288@kfi7 refs 1
00000400:00000200:5.0:1773851889.614572:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18288@kfi7 to cpt 1
00000400:00000200:5.0:1773851889.614572:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daecf0fe nid 18288@kfi7 refs 2
00000400:00000200:5.0:1773851889.614573:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000daecf0fe nid 18288@kfi7 refs 3
00000400:00000200:5.0:1773851889.614574:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18353@kfi7 to cpt 7
00000400:00000200:5.0:1773851889.614575:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18353@kfi7 of length 224 into portal 12 MB=0x699e15844eec0
00000400:00000200:5.0:1773851889.614576:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18353@kfi7 of length 224/224 into md 0x793926dc5 [64] + 158136
00000800:00000200:5.0:1773851889.614577:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851889.614579:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851889.614580:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18288@kfi7: PUT: OK
00000100:00000001:5.0:1773851889.614580:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851889.614581:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851889.614582:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000472f885.
00000100:00000040:5.0:1773851889.614582:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000000472f885 x1858042987867840 msgsize 224
00000100:00100000:5.0:1773851889.614584:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-18353@kfi7 (source: 12345-18288@kfi7)
00000100:00000001:5.0:1773851889.614584:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851889.614585:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000daecf0fe nid 18288@kfi7 refs 2
00000100:00000001:7.0:1773851889.614586:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851889.614586:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851889.614586:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851889.614587:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851889.614587:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851889.614588:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851889.614589:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042987867840
00000020:00000001:7.0:1773851889.614589:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851889.614590:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92355
00000020:00000001:7.0:1773851889.614591:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851889.614593:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003be1a322 refcount=6
00000020:00000001:7.0:1773851889.614593:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630294528 : -107123079257088 : ffff9e9276e9e400)
00000020:00000001:7.0:1773851889.614594:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630294528 : -107123079257088 : ffff9e9276e9e400)
00000100:00000001:7.0:1773851889.614595:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.614596:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851889.614597:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c19ce0d6.
00000020:00000010:7.0:1773851889.614598:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851889.614599:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000482fd989.
00000100:00000001:7.0:1773851889.614599:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851889.614600:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851889.614600:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.614601:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851889.614602:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851889.614602:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.614603:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.614604:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851889.614605:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851889.614605:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851889.614605:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851889.614606:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18353@kfi7, seq: 2001973
00000100:00000040:7.0:1773851889.614607:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003be1a322 : new rpc_count 1
00000100:00000001:7.0:1773851889.614607:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108945408 : -106938600606208 : ffff9ebd6ab2b600)
00000100:00000001:4.0:1773851889.614607:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.614608:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000472f885 x1858042987867840/t0(0) o400->822f34ac-b6a5-4d44-93ce-2c8db47c0f44@18353@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1630-0'
00000100:00000001:4.0:1773851889.614608:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.614611:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.614612:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851889.614612:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000472f885 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:822f34ac-b6a5-4d44-93ce-2c8db47c0f44+6:39629:x1858042987867840:12345-18353@kfi7:400:default-tuolumne1630-0
00000100:00000200:7.0:1773851889.614614:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042987867840
00000020:00000001:7.0:1773851889.614614:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851889.614615:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851889.614616:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.614616:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851889.614617:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851889.614618:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851889.614619:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042987867840, found 0 last_xid 1858042987867839
00000020:00000001:7.0:1773851889.614619:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851889.614620:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851889.614621:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851889.614621:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.614622:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851889.614622:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851889.614623:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851889.614625:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000053f35385.
02000000:00000001:7.0:1773851889.614625:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.614626:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.614627:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851889.614627:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260631626, transno 0, xid 1858042987867840
00010000:00000001:7.0:1773851889.614628:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851889.614629:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000472f885 x1858042987867840/t0(0) o400->822f34ac-b6a5-4d44-93ce-2c8db47c0f44@18353@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1630-0'
00010000:00000001:7.0:1773851889.614631:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851889.614632:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851889.614633:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=121 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851889.614634:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851889.614634:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000af565548 refcount 3 to 18353@kfi7
00000100:00000001:7.0:1773851889.614635:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214016 : -107155106337600 : ffff9e8b01f36cc0)
02000000:00000001:7.0:1773851889.614636:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851889.614637:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.614637:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851889.614638:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18288@kfi7
00000400:00000010:7.0:1773851889.614639:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a17c530.
00000100:00000200:7.0:1773851889.614640:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042987867840, offset 224
00000400:00000200:7.0:1773851889.614641:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18288@kfi7
00000400:00000200:7.0:1773851889.614641:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18288@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.614642:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daecf0fe nid 18288@kfi7 refs 1
00000400:00000200:7.0:1773851889.614643:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000daecf0fe nid 18288@kfi7 refs 2
00000400:00000200:7.0:1773851889.614644:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000daecf0fe nid 18288@kfi7 refs 3
00000400:00000200:7.0:1773851889.614646:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18288@kfi7 local destination
00000400:00000200:7.0:1773851889.614647:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769952:8769952:1024:4294967295] 18288@kfi7 LPNI seq info [1227883:1227883:16:4294967295]
00000400:00000200:7.0:1773851889.614649:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000daecf0fe nid 18288@kfi7 refs 2
00000400:00000200:7.0:1773851889.614650:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18288@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.614651:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18288@kfi7(18288@kfi7:18288@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851889.614653:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000daecf0fe nid 18288@kfi7 refs 3
00000800:00000200:7.0:1773851889.614654:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851889.614655:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851889.614657:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851889.614659:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000015a Using peer 18288@kfi7(0x10000000000015a)
00000800:00000200:7.0:1773851889.614662:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x10000000000015a: rc=0
00000800:00000200:7.0:1773851889.614664:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000015a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851889.614666:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.614667:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000af565548 refcount 2 to 18353@kfi7
00010000:00000001:7.0:1773851889.614667:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851889.614668:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.614668:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851889.614669:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000472f885 x1858042987867840/t0(0) o400->822f34ac-b6a5-4d44-93ce-2c8db47c0f44@18353@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1630-0'
00000100:00100000:7.0:1773851889.614672:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000472f885 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:822f34ac-b6a5-4d44-93ce-2c8db47c0f44+6:39629:x1858042987867840:12345-18353@kfi7:400:default-tuolumne1630-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851889.614674:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18353@kfi7, seq: 2001973
00000100:00000040:7.0:1773851889.614675:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003be1a322 : new rpc_count 0
00000100:00000001:7.0:1773851889.614676:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851889.614676:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000015a TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851889.614677:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851889.614677:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851889.614678:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851889.614678:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000482fd989.
00000400:00000200:5.0:1773851889.614678:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18288@kfi7: PUT: OK
00000020:00000010:7.0:1773851889.614679:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c19ce0d6.
00000400:00000200:5.0:1773851889.614679:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a17c530
00000400:00000010:5.0:1773851889.614679:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a17c530.
00000020:00000040:7.0:1773851889.614680:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000003be1a322 : new refcount 5
00000100:00000001:5.0:1773851889.614680:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851889.614680:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851889.614681:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851889.614681:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000daecf0fe nid 18288@kfi7 refs 2
00000800:00000200:5.0:1773851889.614682:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18288@kfi7(0000000051d1a6b9):0x0 lsk 347 rsk 56 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000015a Transaction freed
00000800:00000200:1.0:1773851889.631097:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851889.631098:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851889.631100:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851889.631104:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851889.631106:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23906@kfi7 to cpt 0
00000400:00000200:1.0:1773851889.631107:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23906@kfi7 : PUT - for me
00000400:00000200:1.0:1773851889.631108:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23906@kfi7 to cpt 0
00000400:00000200:1.0:1773851889.631109:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091c96965 nid 23906@kfi7 refs 1
00000400:00000200:1.0:1773851889.631110:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23906@kfi7 to cpt 0
00000400:00000200:1.0:1773851889.631110:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091c96965 nid 23906@kfi7 refs 2
00000400:00000200:1.0:1773851889.631111:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000091c96965 nid 23906@kfi7 refs 3
00000400:00000200:1.0:1773851889.631112:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23906@kfi7 to cpt 0
00000400:00000200:1.0:1773851889.631113:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23906@kfi7 of length 224 into portal 12 MB=0x69b4b60923540
00000400:00000200:1.0:1773851889.631115:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23906@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 45216
00000800:00000200:1.0:1773851889.631116:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851889.631118:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851889.631119:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23906@kfi7: PUT: OK
00000100:00000001:1.0:1773851889.631120:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851889.631121:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851889.631122:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036058095.
00000100:00000040:1.0:1773851889.631122:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000036058095 x1859597905311040 msgsize 224
00000100:00100000:1.0:1773851889.631124:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-23906@kfi7 (source: 12345-23906@kfi7)
00000100:00000001:1.0:1773851889.631125:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851889.631126:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000091c96965 nid 23906@kfi7 refs 2
00000100:00000001:0.0:1773851889.631126:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851889.631127:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851889.631127:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851889.631127:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851889.631128:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851889.631129:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851889.631129:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597905311040
00000020:00000001:0.0:1773851889.631131:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851889.631131:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24376c81
00000020:00000001:0.0:1773851889.631132:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851889.631134:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000976214dc refcount=5
00000020:00000001:0.0:1773851889.631134:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157768960000 : -106915940591616 : ffff9ec2b1571800)
00000020:00000001:0.0:1773851889.631135:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157768960000 : -106915940591616 : ffff9ec2b1571800)
00000100:00000001:0.0:1773851889.631136:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851889.631137:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851889.631138:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007b1df777.
00000020:00000010:0.0:1773851889.631139:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851889.631140:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851889.631140:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851889.631141:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851889.631141:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851889.631142:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851889.631142:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851889.631143:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851889.631144:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851889.631145:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851889.631145:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851889.631145:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851889.631146:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851889.631147:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851889.631147:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23906@kfi7, seq: 1997612
00000100:00000040:0.0:1773851889.631147:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000976214dc : new rpc_count 1
00000100:00000001:1.0:1773851889.631148:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851889.631148:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112246016 : -106950597305600 : ffff9eba9fa39b00)
00000100:00000040:0.0:1773851889.631149:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036058095 x1859597905311040/t0(0) o400->baf5c224-2e63-4c77-9c96-f08f064ead61@23906@kfi7:529/0 lens 224/0 e 0 to 0 dl 1773852644 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1980-0'
00000100:00000001:0.0:1773851889.631152:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851889.631152:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851889.631153:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036058095 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:baf5c224-2e63-4c77-9c96-f08f064ead61+5:39540:x1859597905311040:12345-23906@kfi7:400:default-tuolumne1980-0
00000100:00000200:0.0:1773851889.631154:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597905311040
00000020:00000001:0.0:1773851889.631155:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851889.631155:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851889.631156:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851889.631157:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851889.631158:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851889.631159:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851889.631159:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597905311040, found 0 last_xid 1859597905311039
00000020:00000001:0.0:1773851889.631160:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851889.631161:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851889.631161:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851889.631162:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851889.631162:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851889.631163:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851889.631163:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851889.631164:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000033ae8c39.
02000000:00000001:0.0:1773851889.631165:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851889.631165:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851889.631166:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851889.631167:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260723465, transno 0, xid 1859597905311040
00010000:00000001:0.0:1773851889.631167:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851889.631168:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036058095 x1859597905311040/t0(0) o400->baf5c224-2e63-4c77-9c96-f08f064ead61@23906@kfi7:529/0 lens 224/224 e 0 to 0 dl 1773852644 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1980-0'
00010000:00000001:0.0:1773851889.631171:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851889.631171:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851889.631172:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=122 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851889.631173:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851889.631174:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000603683bc refcount 3 to 23906@kfi7
00000100:00000001:0.0:1773851889.631175:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850077376 : -107143859474240 : ffff9e8da050f0c0)
02000000:00000001:0.0:1773851889.631175:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851889.631176:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851889.631177:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851889.631178:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23906@kfi7
00000400:00000010:0.0:1773851889.631178:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050d1fed3.
00000100:00000200:0.0:1773851889.631180:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597905311040, offset 224
00000400:00000200:0.0:1773851889.631181:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23906@kfi7
00000400:00000200:0.0:1773851889.631182:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23906@kfi7 to cpt 0
00000400:00000200:0.0:1773851889.631183:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000091c96965 nid 23906@kfi7 refs 1
00000400:00000200:0.0:1773851889.631184:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000091c96965 nid 23906@kfi7 refs 2
00000400:00000200:0.0:1773851889.631186:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000091c96965 nid 23906@kfi7 refs 3
00000400:00000200:0.0:1773851889.631188:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23906@kfi7 local destination
00000400:00000200:0.0:1773851889.631189:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769953:8769953:1024:4294967295] 23906@kfi7 LPNI seq info [101522:101522:16:4294967295]
00000400:00000200:0.0:1773851889.631190:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000091c96965 nid 23906@kfi7 refs 2
00000400:00000200:0.0:1773851889.631191:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23906@kfi7 to cpt 0
00000400:00000200:0.0:1773851889.631193:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23906@kfi7(23906@kfi7:23906@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851889.631195:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000091c96965 nid 23906@kfi7 refs 3
00000800:00000200:0.0:1773851889.631196:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851889.631197:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851889.631199:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851889.631201:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x66b Using peer 23906@kfi7(0x66b)
00000800:00000200:0.0:1773851889.631204:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x66b: rc=0
00000800:00000200:0.0:1773851889.631205:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x66b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851889.631207:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851889.631208:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000603683bc refcount 2 to 23906@kfi7
00010000:00000001:0.0:1773851889.631209:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851889.631209:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851889.631210:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851889.631210:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036058095 x1859597905311040/t0(0) o400->baf5c224-2e63-4c77-9c96-f08f064ead61@23906@kfi7:529/0 lens 224/224 e 0 to 0 dl 1773852644 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1980-0'
00000100:00100000:0.0:1773851889.631215:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036058095 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:baf5c224-2e63-4c77-9c96-f08f064ead61+5:39540:x1859597905311040:12345-23906@kfi7:400:default-tuolumne1980-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851889.631217:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23906@kfi7, seq: 1997612
00000100:00000040:0.0:1773851889.631218:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000976214dc : new rpc_count 0
00000100:00000001:0.0:1773851889.631219:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851889.631219:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851889.631220:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851889.631221:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851889.631222:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007b1df777.
00000020:00000040:0.0:1773851889.631223:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000976214dc : new refcount 4
00000100:00000001:0.0:1773851889.631223:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851889.631229:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x66b TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851889.631231:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851889.631232:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23906@kfi7: PUT: OK
00000400:00000200:1.0:1773851889.631233:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050d1fed3
00000400:00000010:1.0:1773851889.631234:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050d1fed3.
00000100:00000001:1.0:1773851889.631235:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851889.631235:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851889.631236:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000091c96965 nid 23906@kfi7 refs 2
00000800:00000200:1.0:1773851889.631237:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 23906@kfi7(00000000f5e97446):0x0 lsk 1644 rsk 12 tsk 0 trmk 0 tmk 0 trr 0 tta 0x66b Transaction freed
00000800:00000200:22.0:1773851889.707680:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851889.707680:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851889.707681:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851889.707681:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851889.707682:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851889.707682:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851889.707684:0:2456945:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14496@kfi7(0000000011414484):0x100d version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851889.707684:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:22.0:1773851889.707686:0:2456945:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d Using peer 14496@kfi7(0x10000000000100d)
00000400:00000200:21.0:1773851889.707686:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14496@kfi7 to cpt 5
00000400:00000200:22.0:1773851889.707687:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14496@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.707687:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14496@kfi7 : PUT - for me
00000400:00000200:21.0:1773851889.707688:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14496@kfi7 to cpt 5
00000800:00000200:22.0:1773851889.707690:0:2456945:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 38 bytes to peer 0x10000000000100d: rc=0
00000400:00000200:21.0:1773851889.707690:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 1
00000800:00000200:22.0:1773851889.707691:0:2456945:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:21.0:1773851889.707691:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14496@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.707692:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 2
00000400:00000200:21.0:1773851889.707693:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 3
00000400:00000200:21.0:1773851889.707693:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14433@kfi7 to cpt 5
00000400:00000200:21.0:1773851889.707694:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14433@kfi7 of length 456 into portal 12 MB=0x69b4bbc3cc5c0
00000400:00000200:21.0:1773851889.707695:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14433@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 57304
00000800:00000200:21.0:1773851889.707699:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851889.707700:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:22.0:1773851889.707701:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851889.707701:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14496@kfi7: PUT: OK
00000100:00000001:21.0:1773851889.707702:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851889.707702:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:22.0:1773851889.707703:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d Transaction freed
00000100:00000010:21.0:1773851889.707703:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000afa8934c.
00000100:00000040:21.0:1773851889.707704:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000afa8934c x1859599443215808 msgsize 456
00000100:00100000:21.0:1773851889.707705:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14433@kfi7 (source: 12345-14496@kfi7)
00000100:00000001:21.0:1773851889.707706:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851889.707707:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 2
00000100:00000001:20.0:1773851889.707708:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851889.707708:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851889.707709:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851889.707709:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851889.707709:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851889.707710:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851889.707711:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599443215808
00000020:00000001:20.0:1773851889.707711:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851889.707711:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f0b2
00000020:00000001:20.0:1773851889.707712:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851889.707715:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bca3293 refcount=1789
00000020:00000001:20.0:1773851889.707716:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106844115968 : -106966865435648 : ffff9eb6d5fba400)
00000020:00000001:20.0:1773851889.707717:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106844115968 : -106966865435648 : ffff9eb6d5fba400)
00000100:00000001:20.0:1773851889.707718:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851889.707719:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851889.707719:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b8e3d745.
00000020:00000010:20.0:1773851889.707720:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851889.707721:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000045a8637c.
00000100:00000001:20.0:1773851889.707722:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851889.707723:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851889.707723:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.707724:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851889.707729:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851889.707730:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851889.707730:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851889.707731:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851889.707731:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851889.707732:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14433@kfi7, seq: 335333149
00000100:00000040:23.0:1773851889.707733:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bca3293 : new rpc_count 8
00000100:00000001:20.0:1773851889.707733:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851889.707734:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637102026020224 : -106971683531392 : ffff9eb5b6cd5580)
00000100:00000001:20.0:1773851889.707734:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851889.707735:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000afa8934c x1859599443215808/t0(0) o17->442b5631-f9b5-4e09-aea2-9e4c3575429b@14433@kfi7:616/0 lens 456/0 e 0 to 0 dl 1773851976 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1392-0'
00000100:00000001:23.0:1773851889.707738:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851889.707738:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851889.707739:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000afa8934c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:442b5631-f9b5-4e09-aea2-9e4c3575429b+1789:39710:x1859599443215808:12345-14433@kfi7:17:default-tuolumne1392-0
00000100:00000200:23.0:1773851889.707741:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599443215808
00000020:00000001:23.0:1773851889.707742:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851889.707742:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851889.707743:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851889.707744:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851889.707745:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:23.0:1773851889.707745:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851889.707746:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599443215808, found 0 last_xid 1859599442511039
00000020:00000001:23.0:1773851889.707747:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851889.707748:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851889.707748:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851889.707749:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851889.707750:0:60934:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:23.0:1773851889.707751:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851889.707751:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851889.707752:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000031993e72.
02000000:00000001:23.0:1773851889.707753:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851889.707754:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851889.707755:0:60934:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:23.0:1773851889.707755:0:60934:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:23.0:1773851889.707756:0:60934:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:23.0:1773851889.707758:0:60934:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851889.707758:0:60934:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:23.0:1773851889.707759:0:60934:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 442b5631-f9b5-4e09-aea2-9e4c3575429b/000000005bca3293 free: 126633370845184 avail: 126633368748032
00000020:00000001:23.0:1773851889.707760:0:60934:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:23.0:1773851889.707761:0:60934:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 442b5631-f9b5-4e09-aea2-9e4c3575429b/000000005bca3293 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:23.0:1773851889.707762:0:60934:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:23.0:1773851889.707763:0:60934:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:23.0:1773851889.707764:0:60934:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 442b5631-f9b5-4e09-aea2-9e4c3575429b/000000005bca3293 reports grant 1810890751 dropped 0, local 1882193919
00000020:00000001:23.0:1773851889.707765:0:60934:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:23.0:1773851889.707766:0:60934:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:23.0:1773851889.707767:0:60934:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851889.707768:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264587071, transno 0, xid 1859599443215808
00010000:00000001:23.0:1773851889.707768:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851889.707769:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000afa8934c x1859599443215808/t0(0) o17->442b5631-f9b5-4e09-aea2-9e4c3575429b@14433@kfi7:616/0 lens 456/432 e 0 to 0 dl 1773851976 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1392-0'
00010000:00000001:23.0:1773851889.707772:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851889.707772:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851889.707773:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=122 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851889.707774:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851889.707775:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000173b00a3 refcount 3 to 14433@kfi7
00000100:00000001:23.0:1773851889.707776:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108128 : -107156354443488 : ffff9e8ab78ed720)
02000000:00000001:23.0:1773851889.707776:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851889.707777:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851889.707778:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851889.707778:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14496@kfi7
00000400:00000010:23.0:1773851889.707779:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc3746cb.
00000100:00000200:23.0:1773851889.707780:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859599443215808, offset 224
00000400:00000200:23.0:1773851889.707781:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14496@kfi7
00000400:00000200:23.0:1773851889.707782:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14496@kfi7 to cpt 5
00000400:00000200:23.0:1773851889.707783:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 1
00000400:00000200:23.0:1773851889.707784:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 2
00000400:00000200:23.0:1773851889.707785:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 3
00000400:00000200:23.0:1773851889.707786:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14496@kfi7 local destination
00000400:00000200:23.0:1773851889.707788:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769954:8769954:1024:4294967295] 14496@kfi7 LPNI seq info [28229323:28229323:16:4294967295]
00000400:00000200:23.0:1773851889.707789:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 2
00000400:00000200:23.0:1773851889.707790:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14496@kfi7 to cpt 5
00000400:00000200:23.0:1773851889.707792:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14496@kfi7(14496@kfi7:14496@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851889.707793:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 3
00000800:00000200:23.0:1773851889.707794:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851889.707795:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:23.0:1773851889.707799:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851889.707802:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d Using peer 14496@kfi7(0x10000000000100d)
00000800:00000200:23.0:1773851889.707805:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000003a94a903: Posted send of 532 bytes to peer 0x10000000000100d: rc=0
00000800:00000200:23.0:1773851889.707806:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851889.707808:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851889.707809:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000173b00a3 refcount 2 to 14433@kfi7
00010000:00000001:23.0:1773851889.707810:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851889.707810:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851889.707811:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851889.707812:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000afa8934c x1859599443215808/t0(0) o17->442b5631-f9b5-4e09-aea2-9e4c3575429b@14433@kfi7:616/0 lens 456/432 e 0 to 0 dl 1773851976 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1392-0'
00000100:00100000:23.0:1773851889.707815:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000afa8934c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:442b5631-f9b5-4e09-aea2-9e4c3575429b+1789:39710:x1859599443215808:12345-14433@kfi7:17:default-tuolumne1392-0 Request processed in 76us (110us total) trans 0 rc 0/0
00000800:00000200:22.0:1773851889.707816:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851889.707817:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14433@kfi7, seq: 335333149
00000400:00000200:22.0:1773851889.707817:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:23.0:1773851889.707818:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bca3293 : new rpc_count 7
00000100:00000001:23.0:1773851889.707819:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851889.707819:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:22.0:1773851889.707819:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14496@kfi7: PUT: OK
00000400:00000200:22.0:1773851889.707819:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc3746cb
00000020:00000010:23.0:1773851889.707820:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000400:00000010:22.0:1773851889.707820:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc3746cb.
00000020:00000010:23.0:1773851889.707821:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000045a8637c.
00000100:00000001:22.0:1773851889.707821:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851889.707821:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:23.0:1773851889.707822:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b8e3d745.
00000020:00000040:23.0:1773851889.707823:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000005bca3293 : new refcount 1788
00000100:00000001:23.0:1773851889.707823:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:22.0:1773851889.707823:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb2d55d9 nid 14496@kfi7 refs 2
00000800:00000200:22.0:1773851889.707824:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2054@kfi7:5 -> 14496@kfi7(0000000011414484):0x0 lsk 4110 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000100d Transaction freed
00000800:00000200:13.0:1773851889.749354:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851889.749355:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851889.749356:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851889.749358:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16833@kfi7(000000008f6d3f66):0x127f version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851889.749359:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851889.749359:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f Using peer 16833@kfi7(0x10000000000127f)
00000800:00000200:14.0:1773851889.749360:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851889.749361:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851889.749362:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16833@kfi7 to cpt 3
00000800:00000200:14.0:1773851889.749363:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851889.749364:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x10000000000127f: rc=0
00000400:00000200:14.0:1773851889.749365:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16833@kfi7 to cpt 3
00000800:00000200:13.0:1773851889.749365:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851889.749366:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16833@kfi7 : PUT - for me
00000400:00000200:14.0:1773851889.749367:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16833@kfi7 to cpt 3
00000400:00000200:14.0:1773851889.749371:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005001e81b nid 16833@kfi7 refs 1
00000400:00000200:14.0:1773851889.749373:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16833@kfi7 to cpt 3
00000400:00000200:14.0:1773851889.749373:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005001e81b nid 16833@kfi7 refs 2
00000400:00000200:14.0:1773851889.749374:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005001e81b nid 16833@kfi7 refs 3
00000400:00000200:14.0:1773851889.749375:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16832@kfi7 to cpt 0
00000400:00000200:14.0:1773851889.749376:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16832@kfi7 of length 456 into portal 12 MB=0x69bacb7925540
00000800:00000200:13.0:1773851889.749376:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851889.749378:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16832@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 47384
00000800:00000200:13.0:1773851889.749379:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f Transaction freed
00000800:00000200:14.0:1773851889.749380:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851889.749381:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851889.749383:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16833@kfi7: PUT: OK
00000100:00000001:14.0:1773851889.749384:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851889.749384:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851889.749385:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f50166b8.
00000100:00000040:14.0:1773851889.749386:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000f50166b8 x1860015976764736 msgsize 456
00000100:00100000:14.0:1773851889.749388:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-16832@kfi7 (source: 12345-16833@kfi7)
00000100:00000001:14.0:1773851889.749389:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851889.749390:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005001e81b nid 16833@kfi7 refs 2
00000100:00000001:15.0:1773851889.749391:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851889.749391:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851889.749391:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851889.749392:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851889.749392:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851889.749393:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851889.749394:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860015976764736
00000020:00000001:15.0:1773851889.749395:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851889.749395:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a59f87
00000020:00000001:15.0:1773851889.749396:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851889.749397:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000159c6112 refcount=9
00000020:00000001:15.0:1773851889.749398:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636931172183040 : -107142537368576 : ffff9e8def1eac00)
00000020:00000001:15.0:1773851889.749399:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636931172183040 : -107142537368576 : ffff9e8def1eac00)
00000100:00000001:15.0:1773851889.749400:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851889.749401:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851889.749402:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851889.749403:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851889.749404:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851889.749405:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851889.749405:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851889.749406:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.749407:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.749408:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851889.749409:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851889.749410:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851889.749410:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851889.749410:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851889.749411:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16832@kfi7, seq: 411190555
00000100:00000040:15.0:1773851889.749412:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000159c6112 : new rpc_count 1
00000100:00000001:12.0:1773851889.749412:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.749413:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562697216 : -106978146854400 : ffff9eb4358eda00)
00000100:00000001:12.0:1773851889.749413:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.749414:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f50166b8 x1860015976764736/t0(0) o17->a16a2833-6ecd-400f-aadc-6aa5fd4dc37a@16832@kfi7:529/0 lens 456/0 e 0 to 0 dl 1773852644 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1539-0'
00000100:00000001:15.0:1773851889.749417:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851889.749418:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851889.749419:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f50166b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:a16a2833-6ecd-400f-aadc-6aa5fd4dc37a+9:59216:x1860015976764736:12345-16832@kfi7:17:default-tuolumne1539-0
00000100:00000200:15.0:1773851889.749421:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860015976764736
00000020:00000001:15.0:1773851889.749422:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851889.749422:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851889.749423:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.749424:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851889.749424:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:15.0:1773851889.749425:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851889.749426:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860015976764736, found 0 last_xid 1860015976764735
00000020:00000001:15.0:1773851889.749427:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851889.749427:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851889.749428:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851889.749429:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851889.749429:0:60824:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:15.0:1773851889.749430:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851889.749431:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851889.749431:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000e5e1a7c6.
02000000:00000001:15.0:1773851889.749432:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.749433:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.749434:0:60824:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:15.0:1773851889.749434:0:60824:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:15.0:1773851889.749435:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851889.749437:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.749438:0:60824:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:15.0:1773851889.749438:0:60824:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli a16a2833-6ecd-400f-aadc-6aa5fd4dc37a/00000000159c6112 free: 126633370845184 avail: 126633368748032
00000020:00000001:15.0:1773851889.749440:0:60824:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:15.0:1773851889.749440:0:60824:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli a16a2833-6ecd-400f-aadc-6aa5fd4dc37a/00000000159c6112 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:15.0:1773851889.749441:0:60824:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:15.0:1773851889.749443:0:60824:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:15.0:1773851889.749443:0:60824:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli a16a2833-6ecd-400f-aadc-6aa5fd4dc37a/00000000159c6112 reports grant 2359296 dropped 0, local 3407872
00000020:00000001:15.0:1773851889.749444:0:60824:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:15.0:1773851889.749445:0:60824:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:15.0:1773851889.749445:0:60824:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851889.749446:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860015976764736
00010000:00000001:15.0:1773851889.749447:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851889.749448:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f50166b8 x1860015976764736/t0(0) o17->a16a2833-6ecd-400f-aadc-6aa5fd4dc37a@16832@kfi7:529/0 lens 456/432 e 0 to 0 dl 1773852644 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1539-0'
00010000:00000001:15.0:1773851889.749450:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851889.749451:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851889.749452:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=122 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851889.749453:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851889.749453:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000031b1120 refcount 3 to 16832@kfi7
00000100:00000001:15.0:1773851889.749454:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636983281363584 : -107090428188032 : ffff9e9a1111aa80)
02000000:00000001:15.0:1773851889.749455:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851889.749456:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.749456:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851889.749457:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16833@kfi7
00000400:00000010:15.0:1773851889.749458:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034ed0079.
00000100:00000200:15.0:1773851889.749458:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1860015976764736, offset 224
00000400:00000200:15.0:1773851889.749460:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16833@kfi7
00000400:00000200:15.0:1773851889.749461:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16833@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.749462:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005001e81b nid 16833@kfi7 refs 1
00000400:00000200:15.0:1773851889.749463:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005001e81b nid 16833@kfi7 refs 2
00000400:00000200:15.0:1773851889.749464:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005001e81b nid 16833@kfi7 refs 3
00000400:00000200:15.0:1773851889.749465:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16833@kfi7 local destination
00000400:00000200:15.0:1773851889.749466:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769955:8769955:1024:4294967295] 16833@kfi7 LPNI seq info [5660:5660:16:4294967295]
00000400:00000200:15.0:1773851889.749468:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005001e81b nid 16833@kfi7 refs 2
00000400:00000200:15.0:1773851889.749469:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16833@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.749471:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16833@kfi7(16833@kfi7:16833@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851889.749472:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005001e81b nid 16833@kfi7 refs 3
00000800:00000200:15.0:1773851889.749473:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851889.749474:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:15.0:1773851889.749477:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851889.749479:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f Using peer 16833@kfi7(0x10000000000127f)
00000800:00000200:15.0:1773851889.749482:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 532 bytes to peer 0x10000000000127f: rc=0
00000800:00000200:15.0:1773851889.749484:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851889.749486:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.749487:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000031b1120 refcount 2 to 16832@kfi7
00010000:00000001:15.0:1773851889.749487:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851889.749488:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.749488:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851889.749489:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f50166b8 x1860015976764736/t0(0) o17->a16a2833-6ecd-400f-aadc-6aa5fd4dc37a@16832@kfi7:529/0 lens 456/432 e 0 to 0 dl 1773852644 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1539-0'
00000100:00100000:15.0:1773851889.749492:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f50166b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:a16a2833-6ecd-400f-aadc-6aa5fd4dc37a+9:59216:x1860015976764736:12345-16832@kfi7:17:default-tuolumne1539-0 Request processed in 74us (105us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851889.749494:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16832@kfi7, seq: 411190555
00000100:00000040:15.0:1773851889.749495:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000159c6112 : new rpc_count 0
00000800:00000200:13.0:1773851889.749495:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851889.749496:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851889.749497:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851889.749497:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851889.749497:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851889.749498:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000400:00000200:13.0:1773851889.749498:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16833@kfi7: PUT: OK
00000400:00000200:13.0:1773851889.749498:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034ed0079
00000020:00000010:15.0:1773851889.749499:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000400:00000010:13.0:1773851889.749499:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034ed0079.
00000020:00000040:15.0:1773851889.749500:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000159c6112 : new refcount 8
00000100:00000001:13.0:1773851889.749500:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851889.749500:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851889.749501:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851889.749501:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005001e81b nid 16833@kfi7 refs 2
00000800:00000200:13.0:1773851889.749502:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 16833@kfi7(000000008f6d3f66):0x0 lsk 4736 rsk 14 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000127f Transaction freed
00000800:00000200:25.0:1773851889.789125:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851889.789126:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851889.789128:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851889.789130:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851889.789132:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9171@kfi7 to cpt 6
00000400:00000200:25.0:1773851889.789134:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9171@kfi7 : PUT - for me
00000400:00000200:25.0:1773851889.789135:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9171@kfi7 to cpt 6
00000400:00000200:25.0:1773851889.789136:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 1
00000400:00000200:25.0:1773851889.789137:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9171@kfi7 to cpt 6
00000400:00000200:25.0:1773851889.789138:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 2
00000400:00000200:25.0:1773851889.789139:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 3
00000400:00000200:25.0:1773851889.789140:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8979@kfi7 to cpt 3
00000400:00000200:25.0:1773851889.789141:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8979@kfi7 of length 456 into portal 12 MB=0x699e42a5da7c0
00000400:00000200:25.0:1773851889.789143:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8979@kfi7 of length 456/456 into md 0x16159c9699 [64] + 31976
00000800:00000200:25.0:1773851889.789145:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851889.789147:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851889.789148:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9171@kfi7: PUT: OK
00000100:00000001:25.0:1773851889.789149:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851889.789150:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851889.789151:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000459a734d.
00000100:00000040:25.0:1773851889.789152:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000459a734d x1858055102638016 msgsize 456
00000100:00100000:25.0:1773851889.789153:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8979@kfi7 (source: 12345-9171@kfi7)
00000100:00000001:25.0:1773851889.789155:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851889.789156:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 2
00000100:00000001:27.0:1773851889.789157:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851889.789157:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851889.789157:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851889.789158:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851889.789158:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851889.789159:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851889.789160:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858055102638016
00000020:00000001:27.0:1773851889.789161:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851889.789161:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9298a
00000020:00000001:27.0:1773851889.789162:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851889.789166:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002eda4eb7 refcount=126
00000020:00000001:27.0:1773851889.789167:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743189504 : -107128966362112 : ffff9e911803cc00)
00000020:00000001:27.0:1773851889.789168:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743189504 : -107128966362112 : ffff9e911803cc00)
00000100:00000001:27.0:1773851889.789169:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851889.789170:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851889.789171:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000095a8ac67.
00000020:00000010:27.0:1773851889.789172:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851889.789172:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcd1148b.
00000100:00000001:27.0:1773851889.789173:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851889.789174:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851889.789174:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.789176:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.789177:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851889.789178:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851889.789178:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851889.789179:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851889.789179:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851889.789180:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8979@kfi7, seq: 1451911038
00000100:00000040:27.0:1773851889.789181:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002eda4eb7 : new rpc_count 2
00000100:00000001:27.0:1773851889.789181:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252466176 : -106967457085440 : ffff9eb6b2b7c800)
00000100:00000001:25.0:1773851889.789181:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851889.789182:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000459a734d x1858055102638016/t0(0) o17->407b5661-aeac-4193-94ec-3d90f24ca73d@8979@kfi7:616/0 lens 456/0 e 0 to 0 dl 1773851976 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1061-0'
00000100:00000001:25.0:1773851889.789182:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.789185:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851889.789185:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851889.789187:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000459a734d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:407b5661-aeac-4193-94ec-3d90f24ca73d+126:39841:x1858055102638016:12345-8979@kfi7:17:default-tuolumne1061-0
00000100:00000200:27.0:1773851889.789188:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858055102638016
00000020:00000001:27.0:1773851889.789188:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851889.789189:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851889.789190:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.789191:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851889.789191:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:27.0:1773851889.789192:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851889.789192:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858055102638016, found 0 last_xid 1858054990582783
00000020:00000001:27.0:1773851889.789193:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851889.789194:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851889.789194:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851889.789195:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851889.789195:0:41182:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:27.0:1773851889.789197:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851889.789197:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851889.789198:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000e21ef6b5.
02000000:00000001:27.0:1773851889.789198:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.789199:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.789200:0:41182:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:27.0:1773851889.789200:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:27.0:1773851889.789201:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:27.0:1773851889.789203:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.789203:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:27.0:1773851889.789204:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 407b5661-aeac-4193-94ec-3d90f24ca73d/000000002eda4eb7 free: 126633370845184 avail: 126633368748032
00000020:00000001:27.0:1773851889.789205:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:27.0:1773851889.789205:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 407b5661-aeac-4193-94ec-3d90f24ca73d/000000002eda4eb7 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:27.0:1773851889.789207:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:27.0:1773851889.789207:0:41182:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:27.0:1773851889.789208:0:41182:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 407b5661-aeac-4193-94ec-3d90f24ca73d/000000002eda4eb7 reports grant 1814298623 dropped 0, local 1882456063
00000020:00000001:27.0:1773851889.789209:0:41182:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:27.0:1773851889.789209:0:41182:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:27.0:1773851889.789210:0:41182:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851889.789210:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263981246, transno 0, xid 1858055102638016
00010000:00000001:27.0:1773851889.789211:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851889.789212:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000459a734d x1858055102638016/t0(0) o17->407b5661-aeac-4193-94ec-3d90f24ca73d@8979@kfi7:616/0 lens 456/432 e 0 to 0 dl 1773851976 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1061-0'
00010000:00000001:27.0:1773851889.789214:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851889.789215:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851889.789215:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=122 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851889.789217:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851889.789217:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c920e272 refcount 3 to 8979@kfi7
00000100:00000001:27.0:1773851889.789218:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642469184 : -107157067082432 : ffff9e8a8d14d540)
02000000:00000001:27.0:1773851889.789219:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851889.789219:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851889.789220:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851889.789221:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9171@kfi7
00000400:00000010:27.0:1773851889.789222:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001c61fb44.
00000100:00000200:27.0:1773851889.789223:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858055102638016, offset 224
00000400:00000200:27.0:1773851889.789224:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9171@kfi7
00000400:00000200:27.0:1773851889.789225:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9171@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.789226:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 1
00000400:00000200:27.0:1773851889.789227:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 2
00000400:00000200:27.0:1773851889.789228:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 3
00000400:00000200:27.0:1773851889.789229:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9171@kfi7 local destination
00000400:00000200:27.0:1773851889.789231:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769956:8769956:1024:4294967295] 9171@kfi7 LPNI seq info [8043924:8043924:16:4294967295]
00000400:00000200:27.0:1773851889.789232:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 2
00000400:00000200:27.0:1773851889.789233:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9171@kfi7 to cpt 6
00000400:00000200:27.0:1773851889.789235:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9171@kfi7(9171@kfi7:9171@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851889.789236:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 3
00000800:00000200:27.0:1773851889.789237:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851889.789238:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:27.0:1773851889.789240:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851889.789243:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd1a Using peer 9171@kfi7(0xd1a)
00000800:00000200:27.0:1773851889.789246:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 532 bytes to peer 0xd1a: rc=0
00000800:00000200:27.0:1773851889.789247:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd1a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851889.789249:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851889.789250:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c920e272 refcount 2 to 8979@kfi7
00010000:00000001:27.0:1773851889.789251:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851889.789251:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851889.789252:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851889.789252:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000459a734d x1858055102638016/t0(0) o17->407b5661-aeac-4193-94ec-3d90f24ca73d@8979@kfi7:616/0 lens 456/432 e 0 to 0 dl 1773851976 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1061-0'
00000100:00100000:27.0:1773851889.789255:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000459a734d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:407b5661-aeac-4193-94ec-3d90f24ca73d+126:39841:x1858055102638016:12345-8979@kfi7:17:default-tuolumne1061-0 Request processed in 69us (103us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851889.789258:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8979@kfi7, seq: 1451911038
00000100:00000040:27.0:1773851889.789259:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002eda4eb7 : new rpc_count 1
00000800:00000200:25.0:1773851889.789259:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd1a TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851889.789260:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851889.789260:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851889.789261:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851889.789261:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851889.789262:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcd1148b.
00000400:00000200:25.0:1773851889.789262:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9171@kfi7: PUT: OK
00000020:00000010:27.0:1773851889.789263:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000095a8ac67.
00000020:00000040:27.0:1773851889.789263:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002eda4eb7 : new refcount 125
00000400:00000200:25.0:1773851889.789263:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001c61fb44
00000400:00000010:25.0:1773851889.789263:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001c61fb44.
00000100:00000001:27.0:1773851889.789264:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851889.789264:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851889.789264:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851889.789265:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb3fb6ea nid 9171@kfi7 refs 2
00000800:00000200:25.0:1773851889.789267:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 9171@kfi7(00000000794b99f3):0x0 lsk 3355 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd1a Transaction freed
00000800:00000200:13.0:1773851889.800585:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851889.800586:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851889.800588:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851889.800591:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851889.800593:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20577@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.800595:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20577@kfi7 : PUT - for me
00000400:00000200:13.0:1773851889.800596:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20577@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.800597:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1be71d3 nid 20577@kfi7 refs 1
00000400:00000200:13.0:1773851889.800599:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20577@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.800599:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1be71d3 nid 20577@kfi7 refs 2
00000400:00000200:13.0:1773851889.800601:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f1be71d3 nid 20577@kfi7 refs 3
00000400:00000200:13.0:1773851889.800602:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20577@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.800603:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20577@kfi7 of length 224 into portal 12 MB=0x699e1df22f240
00000400:00000200:13.0:1773851889.800604:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20577@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 47840
00000800:00000200:13.0:1773851889.800606:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851889.800608:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851889.800609:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20577@kfi7: PUT: OK
00000100:00000001:13.0:1773851889.800610:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851889.800611:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851889.800612:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003e59b425.
00000100:00000040:13.0:1773851889.800612:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003e59b425 x1858045250564672 msgsize 224
00000100:00100000:13.0:1773851889.800614:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20577@kfi7 (source: 12345-20577@kfi7)
00000100:00000001:13.0:1773851889.800615:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851889.800616:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851889.800616:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f1be71d3 nid 20577@kfi7 refs 2
02000000:00000001:15.0:1773851889.800617:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851889.800617:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851889.800617:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851889.800618:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851889.800618:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851889.800619:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858045250564672
00000020:00000001:15.0:1773851889.800620:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851889.800620:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d1a
00000020:00000001:15.0:1773851889.800621:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851889.800625:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000822022bf refcount=6
00000020:00000001:15.0:1773851889.800625:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395731456 : -107136313820160 : ffff9e8f62127c00)
00000020:00000001:15.0:1773851889.800626:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395731456 : -107136313820160 : ffff9e8f62127c00)
00000100:00000001:15.0:1773851889.800627:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851889.800628:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851889.800628:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851889.800629:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851889.800630:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851889.800631:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851889.800632:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851889.800632:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851889.800633:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851889.800634:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851889.800634:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.800635:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851889.800636:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851889.800637:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851889.800637:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20577@kfi7, seq: 2289902
00000100:00000001:12.0:1773851889.800637:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:15.0:1773851889.800638:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000822022bf : new rpc_count 1
00000100:00000001:12.0:1773851889.800638:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851889.800639:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485594624 : -107000223956992 : ffff9eaf11a90000)
00000100:00000001:12.0:1773851889.800639:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.800640:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003e59b425 x1858045250564672/t0(0) o400->d259da1b-7589-445d-b8ea-3aaf28706c5a@20577@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1776-0'
00000100:00000001:12.0:1773851889.800640:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.800643:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851889.800643:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851889.800644:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003e59b425 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:d259da1b-7589-445d-b8ea-3aaf28706c5a+6:39760:x1858045250564672:12345-20577@kfi7:400:default-tuolumne1776-0
00000100:00000200:15.0:1773851889.800646:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858045250564672
00000020:00000001:15.0:1773851889.800646:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851889.800647:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851889.800648:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.800649:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851889.800649:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851889.800650:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851889.800651:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858045250564672, found 0 last_xid 1858045250564671
00000020:00000001:15.0:1773851889.800652:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851889.800653:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851889.800653:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851889.800653:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.800654:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851889.800655:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851889.800655:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851889.800656:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000251d9196.
02000000:00000001:15.0:1773851889.800656:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.800657:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.800658:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851889.800658:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044151731, transno 0, xid 1858045250564672
00010000:00000001:15.0:1773851889.800659:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851889.800660:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003e59b425 x1858045250564672/t0(0) o400->d259da1b-7589-445d-b8ea-3aaf28706c5a@20577@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1776-0'
00010000:00000001:15.0:1773851889.800662:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851889.800663:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851889.800663:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=122 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851889.800664:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851889.800665:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e7fca417 refcount 3 to 20577@kfi7
00000100:00000001:15.0:1773851889.800666:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155008 : -107139310396608 : ffff9e8eaf765b40)
02000000:00000001:15.0:1773851889.800667:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851889.800667:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.800668:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851889.800668:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20577@kfi7
00000400:00000010:15.0:1773851889.800669:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e35829f1.
00000100:00000200:15.0:1773851889.800670:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858045250564672, offset 224
00000400:00000200:15.0:1773851889.800671:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20577@kfi7
00000400:00000200:15.0:1773851889.800672:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20577@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.800673:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1be71d3 nid 20577@kfi7 refs 1
00000400:00000200:15.0:1773851889.800674:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f1be71d3 nid 20577@kfi7 refs 2
00000400:00000200:15.0:1773851889.800675:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f1be71d3 nid 20577@kfi7 refs 3
00000400:00000200:15.0:1773851889.800676:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20577@kfi7 local destination
00000400:00000200:15.0:1773851889.800678:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769957:8769957:1024:4294967295] 20577@kfi7 LPNI seq info [16787712:16787712:16:4294967295]
00000400:00000200:15.0:1773851889.800679:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f1be71d3 nid 20577@kfi7 refs 2
00000400:00000200:15.0:1773851889.800680:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20577@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.800682:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20577@kfi7(20577@kfi7:20577@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851889.800683:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f1be71d3 nid 20577@kfi7 refs 3
00000800:00000200:15.0:1773851889.800684:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851889.800686:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851889.800688:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851889.800690:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb6 Using peer 20577@kfi7(0xb6)
00000800:00000200:15.0:1773851889.800693:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0xb6: rc=0
00000800:00000200:15.0:1773851889.800694:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851889.800696:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.800697:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e7fca417 refcount 2 to 20577@kfi7
00010000:00000001:15.0:1773851889.800698:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851889.800698:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.800699:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851889.800700:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003e59b425 x1858045250564672/t0(0) o400->d259da1b-7589-445d-b8ea-3aaf28706c5a@20577@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1776-0'
00000100:00100000:15.0:1773851889.800702:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003e59b425 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:d259da1b-7589-445d-b8ea-3aaf28706c5a+6:39760:x1858045250564672:12345-20577@kfi7:400:default-tuolumne1776-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851889.800705:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20577@kfi7, seq: 2289902
00000100:00000040:15.0:1773851889.800705:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000822022bf : new rpc_count 0
00000100:00000001:15.0:1773851889.800706:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851889.800706:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb6 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851889.800707:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851889.800708:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851889.800708:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000400:00000200:13.0:1773851889.800708:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851889.800709:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000400:00000200:13.0:1773851889.800709:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20577@kfi7: PUT: OK
00000020:00000040:15.0:1773851889.800710:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000822022bf : new refcount 5
00000400:00000200:13.0:1773851889.800710:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e35829f1
00000400:00000010:13.0:1773851889.800710:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e35829f1.
00000100:00000001:15.0:1773851889.800711:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851889.800711:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851889.800711:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851889.800712:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f1be71d3 nid 20577@kfi7 refs 2
00000800:00000200:13.0:1773851889.800713:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 20577@kfi7(000000006e9b9b6c):0x0 lsk 183 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb6 Transaction freed
00010000:00000001:2.0:1773851889.801732:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801732:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801736:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851889.801736:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851889.801737:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801737:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851889.801738:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801738:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801739:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801740:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851889.801740:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851889.801740:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801741:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851889.801741:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801742:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801742:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801743:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851889.801743:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851889.801744:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801744:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851889.801745:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801745:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801746:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851889.801746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851889.801747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851889.801750:0:937838:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851889.801751:0:937838:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851889.801752:0:937838:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:6.0:1773851889.843869:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851889.843869:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851889.843870:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851889.843871:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851889.843871:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851889.843872:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851889.843873:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9722@kfi7(000000008fa1131b):0x2a4 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851889.843874:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 Using peer 9722@kfi7(0x1000000000002a4)
00000800:00000200:6.0:1773851889.843875:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851889.843876:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:6.0:1773851889.843877:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:6.0:1773851889.843878:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9722@kfi7 : PUT - for me
00000800:00000200:5.0:1773851889.843878:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 38 bytes to peer 0x1000000000002a4: rc=0
00000400:00000200:6.0:1773851889.843879:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:6.0:1773851889.843880:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 1
00000800:00000200:5.0:1773851889.843880:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851889.843882:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:6.0:1773851889.843883:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000400:00000200:6.0:1773851889.843884:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 3
00000400:00000200:6.0:1773851889.843885:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9723@kfi7 to cpt 4
00000400:00000200:6.0:1773851889.843886:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9723@kfi7 of length 224 into portal 12 MB=0x699de8439aac0
00000400:00000200:6.0:1773851889.843888:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9723@kfi7 of length 224/224 into md 0x793926dc5 [64] + 158360
00000800:00000200:6.0:1773851889.843890:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851889.843892:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851889.843893:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9722@kfi7: PUT: OK
00000800:00000200:5.0:1773851889.843893:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851889.843894:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851889.843894:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851889.843895:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cd156083.
00000100:00000040:6.0:1773851889.843895:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000cd156083 x1858030840425152 msgsize 224
00000800:00000200:5.0:1773851889.843895:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 Transaction freed
00000100:00100000:6.0:1773851889.843897:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-9723@kfi7 (source: 12345-9722@kfi7)
00000100:00000001:6.0:1773851889.843898:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851889.843899:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000100:00000001:7.0:1773851889.843900:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851889.843900:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000e8b9920: 2054@kfi7:1 <- 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851889.843901:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851889.843902:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851889.843902:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851889.843904:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851889.843905:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030840425152
00000020:00000001:7.0:1773851889.843905:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851889.843906:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91023
00000020:00000001:7.0:1773851889.843907:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851889.843910:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009c172af6 refcount=6
00000020:00000001:7.0:1773851889.843911:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240116224 : -107152469435392 : ffff9e8b9f1f5c00)
00000020:00000001:7.0:1773851889.843912:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240116224 : -107152469435392 : ffff9e8b9f1f5c00)
00000100:00000001:7.0:1773851889.843913:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.843914:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851889.843915:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002b9ec664.
00000020:00000010:7.0:1773851889.843916:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851889.843917:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000482fd989.
00000100:00000001:7.0:1773851889.843918:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851889.843918:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851889.843919:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.843920:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851889.843921:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851889.843921:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.843922:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.843924:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851889.843924:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851889.843925:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851889.843925:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851889.843926:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9723@kfi7, seq: 2001974
00000100:00000040:7.0:1773851889.843927:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009c172af6 : new rpc_count 1
00000100:00000001:7.0:1773851889.843927:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814087680 : -107101895463936 : ffff9e976590ec00)
00000100:00000001:4.0:1773851889.843927:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.843928:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.843929:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cd156083 x1858030840425152/t0(0) o400->6dba9efc-c063-48e5-8828-c7e55f93cfa6@9723@kfi7:141/0 lens 224/0 e 0 to 0 dl 1773852256 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne206-0'
00000100:00000001:7.0:1773851889.843932:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.843933:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851889.843934:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cd156083 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6dba9efc-c063-48e5-8828-c7e55f93cfa6+6:47751:x1858030840425152:12345-9723@kfi7:400:default-tuolumne206-0
00000100:00000200:7.0:1773851889.843935:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030840425152
00000020:00000001:7.0:1773851889.843936:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851889.843937:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851889.843938:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.843938:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851889.843939:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851889.843940:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851889.843940:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030840425152, found 0 last_xid 1858030840425151
00000020:00000001:7.0:1773851889.843941:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851889.843942:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851889.843942:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851889.843943:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.843944:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851889.843945:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851889.843945:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851889.843946:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000011aeeed5.
02000000:00000001:7.0:1773851889.843946:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.843947:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.843948:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851889.843948:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030840425152
00010000:00000001:7.0:1773851889.843949:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851889.843950:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cd156083 x1858030840425152/t0(0) o400->6dba9efc-c063-48e5-8828-c7e55f93cfa6@9723@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne206-0'
00010000:00000001:7.0:1773851889.843952:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851889.843953:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851889.843953:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=121 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851889.843955:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851889.843955:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000042346904 refcount 5 to 9723@kfi7
00000100:00000001:7.0:1773851889.843956:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370153152 : -107145339398464 : ffff9e8d481b16c0)
02000000:00000001:7.0:1773851889.843957:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851889.843958:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.843958:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851889.843959:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9722@kfi7
00000400:00000010:7.0:1773851889.843960:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c46149c8.
00000100:00000200:7.0:1773851889.843961:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030840425152, offset 224
00000400:00000200:7.0:1773851889.843963:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9722@kfi7
00000400:00000200:7.0:1773851889.843964:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.843965:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 1
00000400:00000200:7.0:1773851889.843966:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000400:00000200:7.0:1773851889.843967:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 3
00000400:00000200:7.0:1773851889.843968:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9722@kfi7 local destination
00000400:00000200:7.0:1773851889.843970:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769958:8769958:1024:4294967295] 9722@kfi7 LPNI seq info [24436:24436:16:4294967295]
00000400:00000200:7.0:1773851889.843971:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000400:00000200:7.0:1773851889.843972:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.843974:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9722@kfi7(9722@kfi7:9722@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851889.843976:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 3
00000800:00000200:7.0:1773851889.843977:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851889.843979:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851889.843981:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851889.843984:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 Using peer 9722@kfi7(0x1000000000002a4)
00000800:00000200:7.0:1773851889.843987:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x1000000000002a4: rc=0
00000800:00000200:7.0:1773851889.843989:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851889.843991:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.843992:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000042346904 refcount 4 to 9723@kfi7
00010000:00000001:7.0:1773851889.843992:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851889.843993:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.843994:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851889.843994:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cd156083 x1858030840425152/t0(0) o400->6dba9efc-c063-48e5-8828-c7e55f93cfa6@9723@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne206-0'
00000100:00100000:7.0:1773851889.843998:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cd156083 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6dba9efc-c063-48e5-8828-c7e55f93cfa6+6:47751:x1858030840425152:12345-9723@kfi7:400:default-tuolumne206-0 Request processed in 64us (101us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851889.844000:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9723@kfi7, seq: 2001974
00000800:00000200:5.0:1773851889.844000:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851889.844001:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009c172af6 : new rpc_count 0
00000100:00000001:7.0:1773851889.844002:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851889.844002:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851889.844003:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851889.844003:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000200:5.0:1773851889.844003:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9722@kfi7: PUT: OK
00000400:00000200:5.0:1773851889.844003:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c46149c8
00000020:00000010:7.0:1773851889.844004:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000482fd989.
00000400:00000010:5.0:1773851889.844004:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c46149c8.
00000100:00000001:5.0:1773851889.844004:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851889.844005:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002b9ec664.
00000100:00000001:5.0:1773851889.844005:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:7.0:1773851889.844006:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009c172af6 : new refcount 5
00000400:00000200:5.0:1773851889.844006:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000100:00000001:7.0:1773851889.844007:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851889.844007:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 9722@kfi7(000000008fa1131b):0x0 lsk 677 rsk 88 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000002a4 Transaction freed
00000800:00000200:6.0:1773851889.844231:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851889.844231:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851889.844232:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851889.844232:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851889.844233:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851889.844233:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851889.844234:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9722@kfi7(000000001534b06e):0x2a4 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851889.844236:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 Using peer 9722@kfi7(0x2a4)
00000800:00000200:6.0:1773851889.844238:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851889.844240:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:6.0:1773851889.844241:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000800:00000200:5.0:1773851889.844242:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 38 bytes to peer 0x2a4: rc=0
00000400:00000200:6.0:1773851889.844243:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9722@kfi7 : PUT - for me
00000800:00000200:5.0:1773851889.844244:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851889.844245:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:6.0:1773851889.844246:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 1
00000400:00000200:6.0:1773851889.844248:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:6.0:1773851889.844249:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000400:00000200:6.0:1773851889.844250:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 3
00000400:00000200:6.0:1773851889.844252:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9723@kfi7 to cpt 4
00000400:00000200:6.0:1773851889.844253:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9723@kfi7 of length 224 into portal 12 MB=0x699de8439b340
00000800:00000200:7.0:1773851889.844255:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851889.844256:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9723@kfi7 of length 224/224 into md 0x793926dc5 [64] + 158584
00000800:00000200:7.0:1773851889.844258:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 Transaction freed
00000800:00000200:6.0:1773851889.844258:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851889.844261:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851889.844263:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9722@kfi7: PUT: OK
00000100:00000001:6.0:1773851889.844264:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851889.844265:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851889.844266:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000055e2cb0c.
00000100:00000040:6.0:1773851889.844267:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000055e2cb0c x1858030840427328 msgsize 224
00000100:00100000:6.0:1773851889.844269:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-9723@kfi7 (source: 12345-9722@kfi7)
00000100:00000001:6.0:1773851889.844270:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851889.844272:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851889.844272:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:6.0:1773851889.844272:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000100:00000001:7.0:1773851889.844273:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851889.844273:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851889.844274:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851889.844274:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030840427328
00000800:00000200:6.0:1773851889.844274:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000e8b9920: 2069@kfi7:1 <- 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000020:00000001:7.0:1773851889.844275:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851889.844275:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9138e
00000020:00000001:7.0:1773851889.844276:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851889.844280:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8837bb0 refcount=6
00000020:00000001:7.0:1773851889.844281:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169316352 : -107127540235264 : ffff9e916d04c400)
00000020:00000001:7.0:1773851889.844281:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169316352 : -107127540235264 : ffff9e916d04c400)
00000100:00000001:7.0:1773851889.844282:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.844283:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851889.844284:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002b9ec664.
00000020:00000010:7.0:1773851889.844284:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851889.844285:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000482fd989.
00000100:00000001:7.0:1773851889.844286:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851889.844286:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851889.844286:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.844287:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851889.844288:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851889.844288:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.844289:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.844290:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851889.844290:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851889.844290:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851889.844291:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9723@kfi7, seq: 2001975
00000100:00000001:4.0:1773851889.844291:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851889.844292:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8837bb0 : new rpc_count 1
00000100:00000001:7.0:1773851889.844292:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814068096 : -107101895483520 : ffff9e9765909f80)
00000100:00000001:4.0:1773851889.844292:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.844292:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.844293:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000055e2cb0c x1858030840427328/t0(0) o400->ca749369-224e-4926-a22d-7374de930e80@9723@kfi7:141/0 lens 224/0 e 0 to 0 dl 1773852256 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne206-0'
00000100:00000001:7.0:1773851889.844296:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851889.844296:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851889.844297:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055e2cb0c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ca749369-224e-4926-a22d-7374de930e80+6:47753:x1858030840427328:12345-9723@kfi7:400:default-tuolumne206-0
00000100:00000200:7.0:1773851889.844298:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030840427328
00000020:00000001:7.0:1773851889.844299:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851889.844299:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851889.844300:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.844301:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851889.844301:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851889.844302:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851889.844302:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030840427328, found 0 last_xid 1858030840427327
00000020:00000001:7.0:1773851889.844303:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851889.844304:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851889.844304:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851889.844304:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.844305:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851889.844306:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851889.844306:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851889.844307:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c19ce0d6.
02000000:00000001:7.0:1773851889.844308:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.844308:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.844309:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851889.844309:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767473, transno 0, xid 1858030840427328
00010000:00000001:7.0:1773851889.844310:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851889.844311:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000055e2cb0c x1858030840427328/t0(0) o400->ca749369-224e-4926-a22d-7374de930e80@9723@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne206-0'
00010000:00000001:7.0:1773851889.844313:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851889.844313:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851889.844314:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=121 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851889.844315:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851889.844316:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000042346904 refcount 5 to 9723@kfi7
00000100:00000001:7.0:1773851889.844316:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370153152 : -107145339398464 : ffff9e8d481b16c0)
02000000:00000001:7.0:1773851889.844317:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851889.844317:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.844318:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851889.844319:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9722@kfi7
00000400:00000010:7.0:1773851889.844319:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c74d75.
00000100:00000200:7.0:1773851889.844320:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030840427328, offset 224
00000400:00000200:7.0:1773851889.844321:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9722@kfi7
00000400:00000200:7.0:1773851889.844322:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.844323:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 1
00000400:00000200:7.0:1773851889.844323:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000400:00000200:7.0:1773851889.844324:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 3
00000400:00000200:7.0:1773851889.844325:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9722@kfi7 local destination
00000400:00000200:7.0:1773851889.844327:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769959:8769959:1024:4294967295] 9722@kfi7 LPNI seq info [24437:24437:16:4294967295]
00000400:00000200:7.0:1773851889.844328:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000400:00000200:7.0:1773851889.844329:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9722@kfi7 to cpt 1
00000400:00000200:7.0:1773851889.844330:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9722@kfi7(9722@kfi7:9722@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851889.844332:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 3
00000800:00000200:7.0:1773851889.844333:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851889.844334:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851889.844336:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851889.844338:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 Using peer 9722@kfi7(0x2a4)
00000800:00000200:7.0:1773851889.844340:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x2a4: rc=0
00000800:00000200:7.0:1773851889.844342:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851889.844344:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.844345:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000042346904 refcount 4 to 9723@kfi7
00010000:00000001:7.0:1773851889.844345:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851889.844345:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851889.844346:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851889.844347:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000055e2cb0c x1858030840427328/t0(0) o400->ca749369-224e-4926-a22d-7374de930e80@9723@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne206-0'
00000100:00100000:7.0:1773851889.844350:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055e2cb0c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ca749369-224e-4926-a22d-7374de930e80+6:47753:x1858030840427328:12345-9723@kfi7:400:default-tuolumne206-0 Request processed in 53us (82us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851889.844351:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9723@kfi7, seq: 2001975
00000100:00000040:7.0:1773851889.844352:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8837bb0 : new rpc_count 0
00000100:00000001:7.0:1773851889.844353:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851889.844353:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851889.844354:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851889.844354:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000482fd989.
00000020:00000010:7.0:1773851889.844355:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002b9ec664.
00000800:00000200:5.0:1773851889.844355:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 TN_EVENT_TX_OK event status 0
00000020:00000040:7.0:1773851889.844356:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000a8837bb0 : new refcount 5
00000100:00000001:7.0:1773851889.844356:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851889.844357:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851889.844359:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9722@kfi7: PUT: OK
00000400:00000200:5.0:1773851889.844360:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c74d75
00000400:00000010:5.0:1773851889.844361:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c74d75.
00000100:00000001:5.0:1773851889.844362:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851889.844362:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851889.844363:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007ac46f7f nid 9722@kfi7 refs 2
00000800:00000200:5.0:1773851889.844366:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 9722@kfi7(000000001534b06e):0x0 lsk 677 rsk 89 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2a4 Transaction freed
00000800:00000200:13.0:1773851889.864818:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851889.864819:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851889.864820:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851889.864822:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851889.864825:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20611@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.864826:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20611@kfi7 : PUT - for me
00000400:00000200:13.0:1773851889.864827:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20611@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.864828:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000010f6c25 nid 20611@kfi7 refs 1
00000400:00000200:13.0:1773851889.864829:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20611@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.864830:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000010f6c25 nid 20611@kfi7 refs 2
00000400:00000200:13.0:1773851889.864831:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000010f6c25 nid 20611@kfi7 refs 3
00000400:00000200:13.0:1773851889.864831:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20546@kfi7 to cpt 5
00000400:00000200:13.0:1773851889.864832:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20546@kfi7 of length 224 into portal 12 MB=0x699e0eb7ce8c0
00000400:00000200:13.0:1773851889.864833:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20546@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 48064
00000800:00000200:13.0:1773851889.864835:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851889.864836:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851889.864837:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20611@kfi7: PUT: OK
00000100:00000001:13.0:1773851889.864838:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851889.864838:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851889.864839:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000196bf969.
00000100:00000040:13.0:1773851889.864840:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000196bf969 x1858041162819776 msgsize 224
00000100:00100000:13.0:1773851889.864841:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20546@kfi7 (source: 12345-20611@kfi7)
00000100:00000001:13.0:1773851889.864842:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851889.864843:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851889.864843:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:13.0:1773851889.864843:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000010f6c25 nid 20611@kfi7 refs 2
00000100:00000001:15.0:1773851889.864844:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851889.864844:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851889.864844:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851889.864845:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851889.864846:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041162819776
00000020:00000001:15.0:1773851889.864847:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851889.864847:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d98
00000020:00000001:15.0:1773851889.864848:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851889.864851:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000018b0368 refcount=6
00000020:00000001:15.0:1773851889.864852:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239471104 : -107152470080512 : ffff9e8b9f158400)
00000020:00000001:15.0:1773851889.864853:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239471104 : -107152470080512 : ffff9e8b9f158400)
00000100:00000001:15.0:1773851889.864854:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851889.864854:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851889.864855:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851889.864856:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851889.864857:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851889.864858:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851889.864858:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851889.864859:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851889.864860:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851889.864860:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851889.864860:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.864861:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851889.864862:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851889.864863:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851889.864863:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851889.864863:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851889.864864:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20546@kfi7, seq: 2289903
00000100:00000040:15.0:1773851889.864865:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000018b0368 : new rpc_count 1
00000100:00000001:15.0:1773851889.864865:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485608448 : -107000223943168 : ffff9eaf11a93600)
00000100:00000001:12.0:1773851889.864865:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851889.864865:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.864867:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000196bf969 x1858041162819776/t0(0) o400->a2811288-529b-4160-9340-cd72e422c4c9@20546@kfi7:616/0 lens 224/0 e 0 to 0 dl 1773851976 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1784-0'
00000100:00000001:15.0:1773851889.864870:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851889.864870:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851889.864871:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000196bf969 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:a2811288-529b-4160-9340-cd72e422c4c9+6:39643:x1858041162819776:12345-20546@kfi7:400:default-tuolumne1784-0
00000100:00000200:15.0:1773851889.864872:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041162819776
00000020:00000001:15.0:1773851889.864873:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851889.864874:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851889.864874:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.864875:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851889.864875:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851889.864876:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851889.864877:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041162819776, found 0 last_xid 1858041162819775
00000020:00000001:15.0:1773851889.864878:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851889.864878:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851889.864879:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851889.864879:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.864880:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851889.864880:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851889.864881:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851889.864883:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002bec6d22.
02000000:00000001:15.0:1773851889.864883:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.864884:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.864885:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851889.864885:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104961709, transno 0, xid 1858041162819776
00010000:00000001:15.0:1773851889.864886:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851889.864887:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000196bf969 x1858041162819776/t0(0) o400->a2811288-529b-4160-9340-cd72e422c4c9@20546@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1784-0'
00010000:00000001:15.0:1773851889.864889:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851889.864890:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851889.864890:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=122 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851889.864891:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851889.864892:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007bed07d3 refcount 3 to 20546@kfi7
00000100:00000001:15.0:1773851889.864893:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106976 : -107156354444640 : ffff9e8ab78ed2a0)
02000000:00000001:15.0:1773851889.864894:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851889.864894:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851889.864895:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851889.864896:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20611@kfi7
00000400:00000010:15.0:1773851889.864897:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001650250b.
00000100:00000200:15.0:1773851889.864897:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041162819776, offset 224
00000400:00000200:15.0:1773851889.864899:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20611@kfi7
00000400:00000200:15.0:1773851889.864900:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20611@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.864900:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000010f6c25 nid 20611@kfi7 refs 1
00000400:00000200:15.0:1773851889.864901:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000010f6c25 nid 20611@kfi7 refs 2
00000400:00000200:15.0:1773851889.864902:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000010f6c25 nid 20611@kfi7 refs 3
00000400:00000200:15.0:1773851889.864904:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20611@kfi7 local destination
00000400:00000200:15.0:1773851889.864905:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769960:8769960:1024:4294967295] 20611@kfi7 LPNI seq info [9738916:9738916:16:4294967295]
00000400:00000200:15.0:1773851889.864906:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000010f6c25 nid 20611@kfi7 refs 2
00000400:00000200:15.0:1773851889.864907:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20611@kfi7 to cpt 3
00000400:00000200:15.0:1773851889.864909:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20611@kfi7(20611@kfi7:20611@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851889.864910:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000010f6c25 nid 20611@kfi7 refs 3
00000800:00000200:15.0:1773851889.864911:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851889.864913:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851889.864915:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851889.864917:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aa6 Using peer 20611@kfi7(0x100000000000aa6)
00000800:00000200:15.0:1773851889.864920:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0x100000000000aa6: rc=0
00000800:00000200:15.0:1773851889.864922:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aa6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851889.864924:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851889.864924:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007bed07d3 refcount 2 to 20546@kfi7
00010000:00000001:15.0:1773851889.864925:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851889.864926:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851889.864926:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851889.864927:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000196bf969 x1858041162819776/t0(0) o400->a2811288-529b-4160-9340-cd72e422c4c9@20546@kfi7:616/0 lens 224/224 e 0 to 0 dl 1773851976 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1784-0'
00000100:00100000:15.0:1773851889.864930:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000196bf969 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:a2811288-529b-4160-9340-cd72e422c4c9+6:39643:x1858041162819776:12345-20546@kfi7:400:default-tuolumne1784-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851889.864933:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20546@kfi7, seq: 2289903
00000100:00000040:15.0:1773851889.864933:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000018b0368 : new rpc_count 0
00000100:00000001:15.0:1773851889.864934:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851889.864934:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:14.0:1773851889.864934:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aa6 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851889.864935:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851889.864936:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000400:00000200:14.0:1773851889.864936:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851889.864937:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000020:00000040:15.0:1773851889.864937:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000018b0368 : new refcount 5
00000400:00000200:14.0:1773851889.864937:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20611@kfi7: PUT: OK
00000100:00000001:15.0:1773851889.864938:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851889.864938:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001650250b
00000400:00000010:14.0:1773851889.864938:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001650250b.
00000100:00000001:14.0:1773851889.864939:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851889.864939:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851889.864940:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000010f6c25 nid 20611@kfi7 refs 2
00000800:00000200:14.0:1773851889.864942:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20611@kfi7(00000000d7c587f6):0x0 lsk 2727 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000aa6 Transaction freed
00000800:00000200:9.0:1773851889.943889:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851889.943890:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851889.943892:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851889.943894:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851889.943896:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851889.943898:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.19@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851889.943899:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851889.943900:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851889.943901:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.19@o2ib60 to cpt 4
00000400:00000200:9.0:1773851889.943903:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076a02100 nid 192.168.128.19@o2ib60 refs 2
00000400:00000200:9.0:1773851889.943904:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076a02100 nid 192.168.128.19@o2ib60 refs 3
00000400:00000200:9.0:1773851889.943905:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.19@o2ib60 to cpt 4
00000400:00000200:9.0:1773851889.943906:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.19@o2ib60 of length 224 into portal 12 MB=0x69b175fb60780
00000400:00000200:9.0:1773851889.943908:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.19@o2ib60 of length 224/224 into md 0x6ab01b5d1 [64] + 38928
00000800:00000200:9.0:1773851889.943911:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851889.943913:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851889.943914:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851889.943916:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851889.943916:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851889.943917:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000945bfabd.
00000100:00000040:9.0:1773851889.943918:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000945bfabd x1859374552582016 msgsize 224
00000100:00100000:9.0:1773851889.943920:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.19@o2ib60 (source: 12345-192.168.128.19@o2ib60)
00000100:00000001:9.0:1773851889.943922:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851889.943924:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851889.943925:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851889.943927:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851889.943928:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851889.943929:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851889.943929:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851889.943931:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851889.943932:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374552582016
00000020:00000001:16.0:1773851889.943933:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851889.943934:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793aeaf3ed
00000020:00000001:16.0:1773851889.943935:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851889.943937:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000038d3c43 refcount=6
00000020:00000001:16.0:1773851889.943938:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636922799845376 : -107150909706240 : ffff9e8bfc16f000)
00000020:00000001:16.0:1773851889.943940:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636922799845376 : -107150909706240 : ffff9e8bfc16f000)
00000100:00000001:16.0:1773851889.943941:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851889.943942:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851889.943945:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ea3653dd.
00000020:00000010:16.0:1773851889.943947:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851889.943949:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000096f6d53.
00000100:00000001:16.0:1773851889.943950:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851889.943951:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851889.943952:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851889.943954:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851889.943955:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851889.943955:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851889.943957:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851889.943959:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851889.943960:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851889.943962:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:16.0:1773851889.943963:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.19@o2ib60, seq: 2156406
00000100:00000001:17.0:1773851889.943964:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:16.0:1773851889.943964:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000038d3c43 : new rpc_count 2
00000100:00000001:17.0:1773851889.943965:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851889.943965:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856896896 : -106914852654720 : ffff9ec2f22fb180)
00000100:00000001:17.0:1773851889.943966:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851889.943968:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000945bfabd x1859374552582016/t0(0) o400->faa6f058-18bf-4aa8-8f1f-4e766f478c44@192.168.128.19@o2ib60:141/0 lens 224/0 e 0 to 0 dl 1773852256 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix19-0'
00000100:00000001:16.0:1773851889.943973:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851889.943974:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851889.943976:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000945bfabd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:faa6f058-18bf-4aa8-8f1f-4e766f478c44+6:39865:x1859374552582016:12345-192.168.128.19@o2ib60:400:default-matrix19-0
00000100:00000200:16.0:1773851889.943978:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374552582016
00000020:00000001:16.0:1773851889.943980:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851889.943981:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851889.943982:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.943983:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851889.943984:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851889.943985:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851889.943986:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374552582016, found 0 last_xid 1859374551991807
00000020:00000001:16.0:1773851889.943987:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851889.943989:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851889.943989:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851889.943990:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.943991:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851889.943992:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851889.943993:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851889.943995:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000008d25f8a.
02000000:00000001:16.0:1773851889.943996:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851889.943997:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.943998:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851889.943999:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183076344442, transno 0, xid 1859374552582016
00010000:00000001:16.0:1773851889.944001:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851889.944002:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000945bfabd x1859374552582016/t0(0) o400->faa6f058-18bf-4aa8-8f1f-4e766f478c44@192.168.128.19@o2ib60:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix19-0'
00010000:00000001:16.0:1773851889.944007:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851889.944008:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851889.944009:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=122 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851889.944011:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851889.944013:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d972f6b refcount 3 to 192.168.128.19@o2ib60
00000100:00000001:16.0:1773851889.944015:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516704 : -107156126034912 : ffff9e8ac52c1420)
02000000:00000001:16.0:1773851889.944016:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851889.944017:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851889.944018:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851889.944019:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.19@o2ib60
00000400:00000010:16.0:1773851889.944020:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e45fdf1d.
00000100:00000200:16.0:1773851889.944022:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374552582016, offset 224
00000400:00000200:16.0:1773851889.944025:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.19@o2ib60
00000400:00000200:16.0:1773851889.944027:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.19@o2ib60 to cpt 4
00000400:00000200:16.0:1773851889.944029:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076a02100 nid 192.168.128.19@o2ib60 refs 2
00000400:00000200:16.0:1773851889.944031:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076a02100 nid 192.168.128.19@o2ib60 refs 3
00000400:00000200:16.0:1773851889.944033:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076a02100 nid 192.168.128.19@o2ib60 refs 4
00000400:00000200:16.0:1773851889.944036:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.19@o2ib60 routed destination
00000400:00000200:16.0:1773851889.944038:0:61039:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:16.0:1773851889.944039:0:61039:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:16.0:1773851889.944041:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.19@o2ib60: rtr pref emtpy: 1
00000400:00000200:16.0:1773851889.944043:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:16.0:1773851889.944045:0:61039:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.19@o2ib60: rtr pref emtpy: 1
00000400:00000200:16.0:1773851889.944046:0:61039:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:16.0:1773851889.944048:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769961:8769961:1024:4294967295] 2094@kfi7 LPNI seq info [1258747017:1258747017:16:4294967295]
00000400:00000200:16.0:1773851889.944051:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:16.0:1773851889.944052:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:16.0:1773851889.944056:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.19@o2ib60(192.168.128.19@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851889.944058:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076a02100 nid 192.168.128.19@o2ib60 refs 3
00000800:00000200:16.0:1773851889.944061:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851889.944062:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851889.944066:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851889.944070:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:16.0:1773851889.944076:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:16.0:1773851889.944078:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851889.944081:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851889.944083:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d972f6b refcount 2 to 192.168.128.19@o2ib60
00010000:00000001:16.0:1773851889.944087:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851889.944088:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851889.944089:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851889.944090:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000945bfabd x1859374552582016/t0(0) o400->faa6f058-18bf-4aa8-8f1f-4e766f478c44@192.168.128.19@o2ib60:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix19-0'
00000100:00100000:16.0:1773851889.944096:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000945bfabd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:faa6f058-18bf-4aa8-8f1f-4e766f478c44+6:39865:x1859374552582016:12345-192.168.128.19@o2ib60:400:default-matrix19-0 Request processed in 121us (177us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851889.944100:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.19@o2ib60, seq: 2156406
00000100:00000040:16.0:1773851889.944102:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000038d3c43 : new rpc_count 1
00000100:00000001:16.0:1773851889.944103:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851889.944104:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851889.944105:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851889.944106:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000096f6d53.
00000020:00000010:16.0:1773851889.944108:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ea3653dd.
00000020:00000040:16.0:1773851889.944109:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000038d3c43 : new refcount 5
00000100:00000001:16.0:1773851889.944111:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851889.944121:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851889.944125:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851889.944127:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:17.0:1773851889.944129:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e45fdf1d
00000400:00000010:17.0:1773851889.944130:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e45fdf1d.
00000100:00000001:17.0:1773851889.944131:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851889.944132:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851889.944134:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851889.944137:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000004:00000001:7.0:1773851889.993731:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:5.0:1773851889.993731:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851889.993731:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:4.0:1773851889.993731:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851889.993732:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851889.993732:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851889.993732:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f71c1f0.
00000100:00000010:5.0:1773851889.993732:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5ea564b.
00000004:00000020:4.0:1773851889.993732:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851889.993733:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:5.0:1773851889.993733:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000100:00000010:4.0:1773851889.993733:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ece8016.
00000020:00000040:7.0:1773851889.993734:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:5.0:1773851889.993734:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851889.993734:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:4.0:1773851889.993734:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000010:30.0:1773851889.993735:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ab2e2c82.
00000100:00000001:7.0:1773851889.993735:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851889.993735:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851889.993735:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851889.993735:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993735:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851889.993735:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:7.0:1773851889.993736:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000de2ed169.
02000000:00000010:5.0:1773851889.993736:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b255b11b.
02000000:00000001:4.0:1773851889.993736:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:30.0:1773851889.993737:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000100:00000001:7.0:1773851889.993737:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851889.993737:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851889.993737:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000022c33118.
00000100:00000001:30.0:1773851889.993738:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:7.0:1773851889.993738:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851889.993738:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851889.993738:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851889.993739:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:7.0:1773851889.993739:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851889.993739:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993739:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851889.993739:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.993740:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007f71c1f0] to pc [ptlrpcd_01_02+2]  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851889.993740:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c5ea564b] to pc [ptlrpcd_01_01+1]  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851889.993740:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005ece8016] to pc [ptlrpcd_01_03+3]  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851889.993741:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851889.993742:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a709584c.
00000100:00000001:30.0:1773851889.993744:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993744:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851889.993744:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:7.0:1773851889.993745:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993745:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:5.0:1773851889.993745:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000cb154169.
00000004:00000001:4.0:1773851889.993745:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851889.993746:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851889.993746:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851889.993746:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:6.0:1773851889.993746:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851889.993746:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637122129881088 : -106951579670528 : ffff9eba6515e800)
00080000:00000001:5.0:1773851889.993746:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851889.993747:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993747:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851889.993747:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851889.993747:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851889.993748:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:5.0:1773851889.993748:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000100:00000001:4.0:1773851889.993748:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851889.993749:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:5.0:1773851889.993749:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009e84a220.
00000004:00080000:5.0:1773851889.993749:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614164447024780ns, next at 614165447024018ns, rc = 0
00000100:00000001:4.0:1773851889.993749:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851889.993750:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ab2e2c82] to pc [ptlrpcd_07_01+1]  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851889.993750:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851889.993750:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993750:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851889.993750:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851889.993751:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851889.993751:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:5.0:1773851889.993751:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851889.993751:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993751:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851889.993751:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851889.993751:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:7.0:1773851889.993752:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851889.993752:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051937472:7@kfi7:41:default-yuba2-0
02000000:00000001:6.0:1773851889.993752:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851889.993752:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:6.0:1773851889.993753:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c5ea564b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051937408:3@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851889.993754:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851889.993754:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:6.0:1773851889.993754:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851889.993754:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851889.993755:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851889.993755:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:6.0:1773851889.993755:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993755:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851889.993755:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851889.993756:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006b18bdd4.
02000000:00000001:6.0:1773851889.993756:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:6.0:1773851889.993756:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000041b69c20.
02000000:00000001:4.0:1773851889.993756:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851889.993756:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851889.993757:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851889.993757:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851889.993757:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ece8016 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051937536:2098@kfi7:41:default-yuba2-0
00080000:00000001:30.0:1773851889.993758:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000400:00000200:7.0:1773851889.993758:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000010:7.0:1773851889.993758:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000200:6.0:1773851889.993758:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:31.0:1773851889.993759:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:7.0:1773851889.993759:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
00000400:00000010:6.0:1773851889.993759:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:31.0:1773851889.993760:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:30.0:1773851889.993760:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008738247e.
00000100:00000200:7.0:1773851889.993760:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937472, portal 4
00000400:00000010:6.0:1773851889.993760:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047456fe2.
00000100:00000001:4.0:1773851889.993760:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851889.993761:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851889.993761:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637144932353024 : -106928777198592 : ffff9ebfb4380400)
00000100:00000001:28.0:1773851889.993761:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851889.993761:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:6.0:1773851889.993761:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937408, portal 4
02000000:00000001:4.0:1773851889.993761:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851889.993761:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851889.993762:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993762:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309147776 : -106994400403840 : ffff9eb06cc55e80)
00000100:00000001:6.0:1773851889.993762:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851889.993762:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637135108944256 : -106938600607360 : ffff9ebd6ab2b180)
02000000:00000001:4.0:1773851889.993762:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:31.0:1773851889.993763:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851889.993763:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:7.0:1773851889.993763:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851889.993763:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:4.0:1773851889.993763:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f3d94c91.
02000000:00000001:4.0:1773851889.993764:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851889.993765:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993765:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851889.993765:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:4.0:1773851889.993765:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000004:00001000:30.0:1773851889.993766:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00000040:7.0:1773851889.993766:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000100:00000001:6.0:1773851889.993766:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851889.993766:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000010:4.0:1773851889.993766:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000970b84f9.
00000100:00000001:31.0:1773851889.993767:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:30.0:1773851889.993767:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000092662217.
00000400:00000010:7.0:1773851889.993767:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012526ad9.
00000100:00000200:7.0:1773851889.993767:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051937472, offset 0
00000400:00000010:6.0:1773851889.993767:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c906ec4e.
00000100:00000200:6.0:1773851889.993767:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937408, offset 0
00000100:00000200:4.0:1773851889.993767:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937536, portal 4
00000100:00000001:31.0:1773851889.993768:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993768:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851889.993768:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528694912 : -106978180856704 : ffff9eb433880480)
02000000:00000001:31.0:1773851889.993769:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:30.0:1773851889.993769:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614164447044056ns, next at 614165447042283ns, rc = 0
00000400:00000200:7.0:1773851889.993769:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:7.0:1773851889.993769:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
02000000:00000001:31.0:1773851889.993770:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851889.993770:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:7.0:1773851889.993770:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:6.0:1773851889.993770:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000100:00000040:4.0:1773851889.993770:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851889.993771:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00100000:31.0:1773851889.993772:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ab2e2c82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051937600:2080@kfi7:13:default-yuba2-0
00080000:00000001:30.0:1773851889.993772:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993772:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000004:00000001:30.0:1773851889.993773:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851889.993773:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000040:4.0:1773851889.993773:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:4.0:1773851889.993773:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000092a2acd5.
00000100:00000001:31.0:1773851889.993774:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:7.0:1773851889.993774:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000100:00000200:4.0:1773851889.993774:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051937536, offset 0
02000000:00000001:31.0:1773851889.993775:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:7.0:1773851889.993775:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769959, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769961, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851889.993775:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
02000000:00000001:31.0:1773851889.993776:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851889.993777:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:7.0:1773851889.993777:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
02000000:00000010:31.0:1773851889.993778:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bb1c2bcd.
00000400:00000200:7.0:1773851889.993778:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
02000000:00000001:31.0:1773851889.993779:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851889.993779:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851889.993780:0:41066:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340070, 17340068]
00000400:00000200:31.0:1773851889.993781:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851889.993781:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000400:00000010:31.0:1773851889.993782:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000400:00000200:7.0:1773851889.993782:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769962:8769962:1024:4294967295] 7@kfi7 LPNI seq info [17340071:17340071:16:4294967295]
00000400:00000010:31.0:1773851889.993783:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000400:00000200:7.0:1773851889.993784:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000200:31.0:1773851889.993785:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937600, portal 4
00000400:00000200:7.0:1773851889.993785:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:6.0:1773851889.993785:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:31.0:1773851889.993786:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:6.0:1773851889.993786:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:7.0:1773851889.993787:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851889.993787:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:31.0:1773851889.993788:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411243392 : -106960298308224 : ffff9eb85d6a0d80)
00000400:00000200:7.0:1773851889.993788:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:6.0:1773851889.993789:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000040:31.0:1773851889.993790:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:7.0:1773851889.993790:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:6.0:1773851889.993790:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000800:00000200:7.0:1773851889.993791:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851889.993791:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769962, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769961, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851889.993793:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851889.993793:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:31.0:1773851889.993794:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:6.0:1773851889.993794:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:31.0:1773851889.993795:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000200:6.0:1773851889.993795:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000400:00000010:31.0:1773851889.993796:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000088e46351.
00000800:00000200:7.0:1773851889.993796:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Using peer 7@kfi7(0x11b1)
00000400:00000200:6.0:1773851889.993796:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769963:8769963:1024:4294967295] 3@kfi7 LPNI seq info [5406225:5406225:16:4294967295]
00000100:00000200:31.0:1773851889.993797:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937600, offset 0
00000800:00000200:7.0:1773851889.993798:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x11b1: rc=0
00000400:00000200:6.0:1773851889.993798:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:6.0:1773851889.993799:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:31.0:1773851889.993800:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000800:00000200:7.0:1773851889.993800:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851889.993800:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:4.0:1773851889.993801:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000100:00000001:7.0:1773851889.993802:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993802:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851889.993802:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851889.993802:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:7.0:1773851889.993803:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851889.993803:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:4.0:1773851889.993803:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:31.0:1773851889.993804:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:7.0:1773851889.993804:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993804:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851889.993804:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000800:00000200:6.0:1773851889.993805:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:31.0:1773851889.993806:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000100:00000001:7.0:1773851889.993806:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851889.993806:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:6.0:1773851889.993806:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851889.993806:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769962, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769963, p:4294967295, g:4294967295, h:1000]
00000100:00000001:7.0:1773851889.993807:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851889.993807:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:31.0:1773851889.993808:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:7.0:1773851889.993808:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993808:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851889.993809:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851889.993809:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851889.993810:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:4.0:1773851889.993810:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000800:00000200:6.0:1773851889.993811:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Using peer 3@kfi7(0x2000000000003b5)
00000400:00000200:4.0:1773851889.993811:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851889.993812:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:4.0:1773851889.993812:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346209, 20346210]
00000400:00000200:31.0:1773851889.993814:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8769962, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8769963, p:4294967295, g:4294967295, h:1000]
00000800:00000200:6.0:1773851889.993814:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000e8b9920: Posted send of 324 bytes to peer 0x2000000000003b5: rc=0
00000400:00000200:4.0:1773851889.993814:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000800:00000200:6.0:1773851889.993815:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851889.993815:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769964:8769964:1023:4294967295] 2105@kfi7 LPNI seq info [20346211:20346211:16:4294967295]
00000400:00000200:31.0:1773851889.993817:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851889.993818:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:6.0:1773851889.993818:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993818:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851889.993818:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000100:00000001:6.0:1773851889.993819:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993819:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851889.993819:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:31.0:1773851889.993820:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000100:00000001:6.0:1773851889.993820:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851889.993821:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769965:8769965:1023:4294967295] 2080@kfi7 LPNI seq info [5404395:5404395:16:4294967295]
00000100:00000001:6.0:1773851889.993821:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851889.993821:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:4.0:1773851889.993821:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000100:00000001:6.0:1773851889.993822:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851889.993822:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:4.0:1773851889.993822:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:6.0:1773851889.993823:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993823:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851889.993824:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:31.0:1773851889.993825:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:5.0:1773851889.993828:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000800:00000200:7.0:1773851889.993829:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 TN_EVENT_TX_OK event status 0
00000800:00000200:4.0:1773851889.993829:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:31.0:1773851889.993830:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851889.993830:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851889.993830:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000800:00000200:4.0:1773851889.993830:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851889.993831:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851889.993831:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012526ad9
00000400:00000200:31.0:1773851889.993832:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851889.993832:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000400:00000010:5.0:1773851889.993832:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012526ad9.
00000100:00000001:5.0:1773851889.993832:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:4.0:1773851889.993832:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851889.993833:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c906ec4e
00000400:00000010:7.0:1773851889.993833:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c906ec4e.
00000100:00000200:5.0:1773851889.993833:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851889.993834:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:31.0:1773851889.993835:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000200:7.0:1773851889.993835:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851889.993835:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000100:00000001:5.0:1773851889.993836:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851889.993836:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851889.993837:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:7.0:1773851889.993837:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851889.993838:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851889.993838:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x4c6: rc=0
00000100:00000001:5.0:1773851889.993839:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851889.993839:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:4.0:1773851889.993839:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:31.0:1773851889.993840:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:7.0:1773851889.993840:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993840:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851889.993840:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:7.0:1773851889.993841:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:5.0:1773851889.993841:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Transaction freed
00000100:00000001:4.0:1773851889.993841:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993842:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:7.0:1773851889.993843:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000003b5 Transaction freed
00000100:00000001:4.0:1773851889.993843:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993843:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851889.993844:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000100:00000001:4.0:1773851889.993844:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851889.993846:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851889.993846:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851889.993847:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851889.993847:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:31.0:1773851889.993849:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000800:00000200:5.0:1773851889.993851:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851889.993851:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993851:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851889.993853:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851889.993856:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851889.993856:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851889.993857:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851889.993857:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:5.0:1773851889.993857:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000092a2acd5
00000100:00000001:31.0:1773851889.993858:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851889.993858:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000092a2acd5.
00000100:00000001:5.0:1773851889.993858:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:31.0:1773851889.993859:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851889.993859:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851889.993860:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851889.993861:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000001:5.0:1773851889.993861:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851889.993862:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:13.0:1773851889.993862:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:5.0:1773851889.993862:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851889.993863:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:13.0:1773851889.993863:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851889.993864:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851889.993864:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851889.993864:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851889.993865:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851889.993865:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851889.993865:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851889.993865:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:31.0:1773851889.993866:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851889.993866:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851889.993866:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Transaction freed
00000400:00000200:13.0:1773851889.993867:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:29.0:1773851889.993868:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:30.0:1773851889.993869:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851889.993869:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000800:00000200:29.0:1773851889.993870:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:30.0:1773851889.993871:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000400:00000200:13.0:1773851889.993871:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.993872:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:13.0:1773851889.993872:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:30.0:1773851889.993873:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000088e46351
00000800:00000200:29.0:1773851889.993873:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851889.993873:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000010:30.0:1773851889.993874:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000088e46351.
00000400:00000200:13.0:1773851889.993874:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:30.0:1773851889.993875:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:13.0:1773851889.993875:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.993875:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5ac0
00000100:00000200:30.0:1773851889.993877:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851889.993877:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851889.993877:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851889.993878:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f6d8d [1] + 224
00000800:00000200:13.0:1773851889.993880:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851889.993881:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:13.0:1773851889.993881:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851889.993882:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851889.993883:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851889.993883:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:13.0:1773851889.993883:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000001:13.0:1773851889.993884:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:26.0:1773851889.993885:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000200:13.0:1773851889.993885:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851889.993886:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:26.0:1773851889.993886:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851889.993887:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851889.993887:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000001:30.0:1773851889.993888:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:26.0:1773851889.993888:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:13.0:1773851889.993888:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851889.993889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:30.0:1773851889.993890:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:26.0:1773851889.993890:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851889.993891:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:29.0:1773851889.993892:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:26.0:1773851889.993892:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000100:00000001:13.0:1773851889.993892:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851889.993893:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:30.0:1773851889.993894:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Transaction freed
00000400:00000200:29.0:1773851889.993894:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:26.0:1773851889.993894:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000100:00000001:7.0:1773851889.993894:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:26.0:1773851889.993895:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:13.0:1773851889.993895:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851889.993895:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851889.993896:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5a80
00000400:00000200:26.0:1773851889.993896:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000001:7.0:1773851889.993896:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851889.993896:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:26.0:1773851889.993897:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000010:7.0:1773851889.993897:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:29.0:1773851889.993898:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:26.0:1773851889.993898:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:7.0:1773851889.993898:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000400:00000010:7.0:1773851889.993898:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000400:00000200:26.0:1773851889.993899:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000100:00000001:7.0:1773851889.993899:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851889.993900:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78008193d [1] + 224
00000400:00000200:26.0:1773851889.993900:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000200:7.0:1773851889.993900:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:26.0:1773851889.993901:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5b00
00000400:00000200:26.0:1773851889.993902:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000200:7.0:1773851889.993903:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851889.993904:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851889.993904:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b31d45 [1] + 224
00000100:00000001:7.0:1773851889.993905:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851889.993905:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851889.993906:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851889.993906:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851889.993906:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:29.0:1773851889.993907:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:10.0:1773851889.993907:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:7.0:1773851889.993907:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851889.993907:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851889.993908:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:10.0:1773851889.993908:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
02000000:00000001:7.0:1773851889.993908:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851889.993909:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:7.0:1773851889.993909:0:41066:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=148 v=66 (66 66 66 66)
00000400:00000200:29.0:1773851889.993910:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->3@kfi7: PUT: OK
00000400:00000200:26.0:1773851889.993910:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00001000:7.0:1773851889.993910:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=154 v=66 (1 1 1 1)
00000100:00000001:26.0:1773851889.993911:0:2507427:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851889.993911:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851889.993911:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851889.993912:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:26.0:1773851889.993912:0:2507427:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:10.0:1773851889.993912:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00010000:00000001:7.0:1773851889.993912:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851889.993912:0:41066:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993913:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:29.0:1773851889.993914:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851889.993914:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000040:7.0:1773851889.993914:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:7.0:1773851889.993914:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851889.993914:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851889.993915:0:2507427:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851889.993916:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000100:00000040:7.0:1773851889.993916:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:10.0:1773851889.993917:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:7.0:1773851889.993918:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:29.0:1773851889.993919:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851889.993919:0:2507427:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851889.993919:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000100:00000001:7.0:1773851889.993919:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851889.993919:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851889.993920:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:10.0:1773851889.993920:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000004:00000001:7.0:1773851889.993920:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:10.0:1773851889.993921:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000004:00000020:7.0:1773851889.993921:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031776 blocks, 31536854176 free, 31536815840 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425554 files, 2779493251 free files
00000100:00000001:4.0:1773851889.993921:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:26.0:1773851889.993922:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:10.0:1773851889.993922:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000004:00000001:7.0:1773851889.993922:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993922:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:10.0:1773851889.993923:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000040:7.0:1773851889.993923:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:4.0:1773851889.993923:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851889.993923:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:10.0:1773851889.993924:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5b40
00000400:00000010:4.0:1773851889.993924:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000100:00000001:29.0:1773851889.993925:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851889.993925:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:4.0:1773851889.993925:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000970b84f9
00000400:00000010:4.0:1773851889.993925:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000970b84f9.
00000100:00100000:7.0:1773851889.993926:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051937472:7@kfi7:41:default-yuba2-0
00000100:00000001:4.0:1773851889.993926:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:10.0:1773851889.993927:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x7816988e9 [1] + 224
00000100:00000001:7.0:1773851889.993927:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851889.993927:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:4.0:1773851889.993927:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851889.993928:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:7.0:1773851889.993928:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851889.993928:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:7.0:1773851889.993929:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007f71c1f0 x1859433051937472/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:6.0:1773851889.993929:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851889.993929:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:29.0:1773851889.993930:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 3@kfi7(000000005530d80c):0x0 lsk 950 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:10.0:1773851889.993930:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:6.0:1773851889.993930:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000100:00000001:7.0:1773851889.993931:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851889.993931:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:6.0:1773851889.993931:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047456fe2
00000100:00000200:4.0:1773851889.993931:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851889.993932:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000010:7.0:1773851889.993932:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006b18bdd4.
00000400:00000010:6.0:1773851889.993932:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047456fe2.
00000100:00000001:6.0:1773851889.993932:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:10.0:1773851889.993933:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
02000000:00000001:7.0:1773851889.993933:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000200:6.0:1773851889.993933:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851889.993933:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000020:00000001:7.0:1773851889.993934:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851889.993934:0:41066:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:4.0:1773851889.993934:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851889.993934:0:41067:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:10.0:1773851889.993935:0:2464469:0:(events.c:103:reply_in_callback()) Process entered
00000020:00000001:7.0:1773851889.993935:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851889.993935:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000de2ed169.
02000000:00000001:4.0:1773851889.993935:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851889.993935:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:10.0:1773851889.993936:0:2464469:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851889.993936:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000200:6.0:1773851889.993936:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851889.993936:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851889.993936:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851889.993937:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851889.993937:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f71c1f0.
00000100:00001000:4.0:1773851889.993937:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=122 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851889.993938:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851889.993938:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851889.993938:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:10.0:1773851889.993939:0:2464469:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851889.993939:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851889.993939:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851889.993939:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851889.993939:0:41065:0:(client.c:1428:after_reply()) Process entered
00000100:00001000:4.0:1773851889.993939:0:41067:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=122 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851889.993940:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993940:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:6.0:1773851889.993940:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851889.993940:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851889.993940:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851889.993940:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851889.993941:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993941:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851889.993941:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851889.993941:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851889.993941:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851889.993942:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=122 v=66 (66 66 66 66)
00000100:00000001:4.0:1773851889.993942:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851889.993942:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:4.0:1773851889.993943:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851889.993943:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851889.993944:0:2464469:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:6.0:1773851889.993944:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=122 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851889.993944:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:4.0:1773851889.993944:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:10.0:1773851889.993945:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:6.0:1773851889.993945:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851889.993945:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000800:00000200:10.0:1773851889.993946:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00010000:00000001:6.0:1773851889.993946:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851889.993947:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851889.993947:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851889.993947:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851889.993947:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:4.0:1773851889.993947:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851889.993947:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851889.993948:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851889.993948:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993948:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851889.993948:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000001:31.0:1773851889.993949:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851889.993949:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:6.0:1773851889.993949:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:4.0:1773851889.993949:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33735999968 blocks, 31354645888 free, 31354596800 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064140 files, 2870603566 free files
00000400:00000010:31.0:1773851889.993950:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:31.0:1773851889.993951:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000004:00000001:4.0:1773851889.993951:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851889.993952:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:6.0:1773851889.993952:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851889.993952:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:4.0:1773851889.993952:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851889.993953:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851889.993953:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851889.993953:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:6.0:1773851889.993954:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000100:00000200:31.0:1773851889.993955:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:6.0:1773851889.993955:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353604096 avail=351351227392 avail_mb=1372465732 hwm_mb=3131101 files=372083216 ffree=343118754 state=0: rc = 0
00000100:00100000:4.0:1773851889.993955:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ece8016 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051937536:2098@kfi7:41:default-yuba2-0
00000004:00000020:6.0:1773851889.993957:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353604096 free, 351351227392 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083216 files, 343118754 free files
00000100:00000001:4.0:1773851889.993957:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851889.993958:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993958:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851889.993958:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005ece8016 x1859433051937536/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:6.0:1773851889.993959:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:31.0:1773851889.993960:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851889.993961:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851889.993961:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851889.993962:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f3d94c91.
02000000:00000001:4.0:1773851889.993963:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851889.993963:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851889.993963:0:41067:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:31.0:1773851889.993964:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851889.993964:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851889.993964:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851889.993964:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000022c33118.
00000100:00000001:31.0:1773851889.993965:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00100000:6.0:1773851889.993965:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c5ea564b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051937408:3@kfi7:13:default-yuba2-0
02000000:00000001:4.0:1773851889.993965:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851889.993966:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:4.0:1773851889.993966:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851889.993966:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005ece8016.
00000100:00000001:31.0:1773851889.993967:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851889.993967:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851889.993967:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851889.993967:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851889.993967:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851889.993968:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851889.993968:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c5ea564b x1859433051937408/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851889.993968:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851889.993968:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:31.0:1773851889.993969:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993969:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851889.993969:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:31.0:1773851889.993970:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=122 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851889.993970:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:4.0:1773851889.993970:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851889.993971:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851889.993971:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000041b69c20.
00000100:00001000:31.0:1773851889.993972:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=122 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851889.993973:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:6.0:1773851889.993973:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851889.993973:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851889.993973:0:41065:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000100:00000001:31.0:1773851889.993974:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851889.993974:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851889.993974:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b255b11b.
02000000:00000001:6.0:1773851889.993975:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00010000:00000001:31.0:1773851889.993976:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:6.0:1773851889.993976:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851889.993976:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c5ea564b.
00010000:00000001:31.0:1773851889.993977:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851889.993977:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851889.993978:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:6.0:1773851889.993978:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851889.993978:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851889.993979:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00000001:6.0:1773851889.993979:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851889.993979:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851889.993980:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851889.993980:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851889.993980:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851889.993981:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851889.993982:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851889.993986:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851889.993988:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851889.993989:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851889.993990:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851889.993991:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851889.993992:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510612992 avail=351508044800 avail_mb=1373078300 hwm_mb=3131103 files=372095693 ffree=343272083 state=0: rc = 0
00000004:00000020:31.0:1773851889.993995:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510612992 free, 351508044800 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095693 files, 343272083 free files
00000004:00000001:31.0:1773851889.993997:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851889.993999:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851889.994003:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ab2e2c82 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051937600:2080@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851889.994006:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851889.994007:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851889.994008:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ab2e2c82 x1859433051937600/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852042 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851889.994012:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851889.994013:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851889.994014:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bb1c2bcd.
02000000:00000001:31.0:1773851889.994016:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851889.994016:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851889.994017:0:41089:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000020:00000001:31.0:1773851889.994018:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851889.994020:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a709584c.
02000000:00000001:31.0:1773851889.994021:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851889.994021:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851889.994022:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ab2e2c82.
00000100:00000001:31.0:1773851889.994023:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851889.994024:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851889.994025:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851889.994026:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851889.994027:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851889.994028:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851889.994028:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851890.009850:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851890.009851:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851890.009852:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851890.009854:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851890.009856:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10561@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.009857:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10561@kfi7 : PUT - for me
00000400:00000200:21.0:1773851890.009858:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10561@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.009859:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026467b44 nid 10561@kfi7 refs 1
00000400:00000200:21.0:1773851890.009860:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10561@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.009861:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026467b44 nid 10561@kfi7 refs 2
00000400:00000200:21.0:1773851890.009862:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000026467b44 nid 10561@kfi7 refs 3
00000400:00000200:21.0:1773851890.009863:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10624@kfi7 to cpt 6
00000400:00000200:21.0:1773851890.009864:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10624@kfi7 of length 224 into portal 12 MB=0x69b4bd1000fc0
00000400:00000200:21.0:1773851890.009865:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10624@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 57760
00000800:00000200:21.0:1773851890.009867:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851890.009868:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.009869:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10561@kfi7: PUT: OK
00000100:00000001:21.0:1773851890.009870:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851890.009870:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851890.009872:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000573988ab.
00000100:00000040:21.0:1773851890.009872:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000573988ab x1859599791558592 msgsize 224
00000100:00100000:21.0:1773851890.009874:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-10624@kfi7 (source: 12345-10561@kfi7)
00000100:00000001:21.0:1773851890.009875:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851890.009876:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000026467b44 nid 10561@kfi7 refs 2
00000100:00000001:23.0:1773851890.009877:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851890.009877:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851890.009877:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851890.009878:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851890.009878:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851890.009879:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851890.009881:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599791558592
00000020:00000001:23.0:1773851890.009882:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851890.009882:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24528709
00000020:00000001:23.0:1773851890.009883:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851890.009887:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d127d333 refcount=5
00000020:00000001:23.0:1773851890.009888:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126238872576 : -106947470679040 : ffff9ebb5a002400)
00000020:00000001:23.0:1773851890.009889:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126238872576 : -106947470679040 : ffff9ebb5a002400)
00000100:00000001:23.0:1773851890.009890:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851890.009890:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851890.009892:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a6c8ed98.
00000020:00000010:23.0:1773851890.009893:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851890.009894:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851890.009895:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851890.009895:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851890.009896:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851890.009897:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851890.009898:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851890.009898:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851890.009900:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851890.009901:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851890.009901:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851890.009902:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851890.009902:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851890.009903:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10624@kfi7, seq: 1998052
00000100:00000001:23.0:1773851890.009904:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851890.009904:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.009904:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d127d333 : new rpc_count 1
00000100:00000001:20.0:1773851890.009905:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667738752 : -106956041812864 : ffff9eb95b1f0480)
00000100:00000040:20.0:1773851890.009906:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000573988ab x1859599791558592/t0(0) o400->23c1de7d-cbe8-4f2d-89ae-7d1118aa6281@10624@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1156-0'
00000100:00000001:20.0:1773851890.009909:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.009909:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851890.009910:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000573988ab pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:23c1de7d-cbe8-4f2d-89ae-7d1118aa6281+5:39707:x1859599791558592:12345-10624@kfi7:400:default-tuolumne1156-0
00000100:00000200:20.0:1773851890.009912:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599791558592
00000020:00000001:20.0:1773851890.009912:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851890.009913:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851890.009913:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.009914:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851890.009915:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851890.009916:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851890.009916:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599791558592, found 0 last_xid 1859599791558591
00000020:00000001:20.0:1773851890.009917:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851890.009917:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851890.009918:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851890.009919:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.009919:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851890.009920:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851890.009920:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851890.009921:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b8e3d745.
02000000:00000001:20.0:1773851890.009922:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.009922:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.009923:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851890.009924:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253967358, transno 0, xid 1859599791558592
00010000:00000001:20.0:1773851890.009925:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851890.009926:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000573988ab x1859599791558592/t0(0) o400->23c1de7d-cbe8-4f2d-89ae-7d1118aa6281@10624@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1156-0'
00010000:00000001:20.0:1773851890.009928:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851890.009929:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851890.009930:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=123 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851890.009931:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851890.009932:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000096cd21f4 refcount 3 to 10624@kfi7
00000100:00000001:20.0:1773851890.009932:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858880 : -107149578692736 : ffff9e8c4b6c9780)
02000000:00000001:20.0:1773851890.009933:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851890.009934:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.009934:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851890.009935:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10561@kfi7
00000400:00000010:20.0:1773851890.009936:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005e4e6e2f.
00000100:00000200:20.0:1773851890.009936:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599791558592, offset 224
00000400:00000200:20.0:1773851890.009938:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10561@kfi7
00000400:00000200:20.0:1773851890.009939:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10561@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.009939:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000026467b44 nid 10561@kfi7 refs 1
00000400:00000200:20.0:1773851890.009940:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000026467b44 nid 10561@kfi7 refs 2
00000400:00000200:20.0:1773851890.009941:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000026467b44 nid 10561@kfi7 refs 3
00000400:00000200:20.0:1773851890.009942:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10561@kfi7 local destination
00000400:00000200:20.0:1773851890.009944:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769966:8769966:1024:4294967295] 10561@kfi7 LPNI seq info [10602492:10602492:16:4294967295]
00000400:00000200:20.0:1773851890.009945:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000026467b44 nid 10561@kfi7 refs 2
00000400:00000200:20.0:1773851890.009946:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10561@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.009948:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10561@kfi7(10561@kfi7:10561@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851890.009949:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000026467b44 nid 10561@kfi7 refs 3
00000800:00000200:20.0:1773851890.009950:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851890.009951:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851890.009954:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851890.009958:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009f9 Using peer 10561@kfi7(0x1000000000009f9)
00000800:00000200:20.0:1773851890.009961:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x1000000000009f9: rc=0
00000800:00000200:20.0:1773851890.009963:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009f9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851890.009965:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.009966:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000096cd21f4 refcount 2 to 10624@kfi7
00010000:00000001:20.0:1773851890.009966:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851890.009967:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.009967:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851890.009968:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000573988ab x1859599791558592/t0(0) o400->23c1de7d-cbe8-4f2d-89ae-7d1118aa6281@10624@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1156-0'
00000100:00100000:20.0:1773851890.009972:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000573988ab pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:23c1de7d-cbe8-4f2d-89ae-7d1118aa6281+5:39707:x1859599791558592:12345-10624@kfi7:400:default-tuolumne1156-0 Request processed in 62us (98us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851890.009974:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10624@kfi7, seq: 1998052
00000100:00000040:20.0:1773851890.009974:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d127d333 : new rpc_count 0
00000100:00000001:20.0:1773851890.009975:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851890.009976:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851890.009976:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851890.009977:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:20.0:1773851890.009978:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a6c8ed98.
00000020:00000040:20.0:1773851890.009979:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000d127d333 : new refcount 4
00000100:00000001:20.0:1773851890.009979:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851890.009984:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009f9 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851890.009986:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.009987:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10561@kfi7: PUT: OK
00000400:00000200:21.0:1773851890.009988:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005e4e6e2f
00000400:00000010:21.0:1773851890.009988:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005e4e6e2f.
00000100:00000001:21.0:1773851890.009989:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851890.009989:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851890.009990:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000026467b44 nid 10561@kfi7 refs 2
00000800:00000200:21.0:1773851890.009991:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 10561@kfi7(0000000028aea74b):0x0 lsk 2554 rsk 10 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009f9 Transaction freed
00000800:00000200:21.0:1773851890.016787:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851890.016788:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851890.016789:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851890.016791:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15619@kfi7(000000003fafd04f):0x99a version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851890.016793:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a Using peer 15619@kfi7(0x10000000000099a)
00000400:00000200:21.0:1773851890.016794:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000800:00000200:21.0:1773851890.016796:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000005960eee7: Posted send of 38 bytes to peer 0x10000000000099a: rc=0
00000800:00000200:21.0:1773851890.016798:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:22.0:1773851890.016809:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a TN_EVENT_TX_OK event status 0
00000800:00000200:22.0:1773851890.016812:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005960eee7: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a Transaction freed
00000800:00000200:21.0:1773851890.016846:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851890.016847:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851890.016848:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851890.016850:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851890.016851:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.016852:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15619@kfi7 : PUT - for me
00000400:00000200:21.0:1773851890.016853:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.016854:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2a652c3 nid 15619@kfi7 refs 1
00000400:00000200:21.0:1773851890.016855:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.016856:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2a652c3 nid 15619@kfi7 refs 2
00000400:00000200:21.0:1773851890.016857:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c2a652c3 nid 15619@kfi7 refs 3
00000400:00000200:21.0:1773851890.016858:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.016858:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15619@kfi7 of length 456 into portal 12 MB=0x69b4b9e6638c0
00000400:00000200:21.0:1773851890.016859:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15619@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 57984
00000800:00000200:21.0:1773851890.016862:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851890.016863:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.016864:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15619@kfi7: PUT: OK
00000100:00000001:21.0:1773851890.016865:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851890.016865:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851890.016866:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006e34792a.
00000100:00000040:21.0:1773851890.016867:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006e34792a x1859598942615744 msgsize 456
00000100:00100000:21.0:1773851890.016868:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-15619@kfi7 (source: 12345-15619@kfi7)
00000100:00000001:21.0:1773851890.016869:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851890.016870:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c2a652c3 nid 15619@kfi7 refs 2
00000800:00000200:21.0:1773851890.016871:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851890.016871:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851890.016871:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851890.016871:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851890.016872:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851890.016872:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851890.016873:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598942615744
00000020:00000001:20.0:1773851890.016873:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851890.016874:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d816f3
00000020:00000001:20.0:1773851890.016875:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851890.016877:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002da34f3f refcount=612
00000020:00000001:20.0:1773851890.016878:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139351546880 : -106934358004736 : ffff9ebe6793ac00)
00000020:00000001:20.0:1773851890.016879:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139351546880 : -106934358004736 : ffff9ebe6793ac00)
00000100:00000001:20.0:1773851890.016880:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.016880:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851890.016882:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851890.016883:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851890.016884:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee24a6ca.
00000100:00000001:20.0:1773851890.016884:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851890.016885:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851890.016885:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.016886:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.016887:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851890.016888:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851890.016888:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851890.016889:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851890.016889:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851890.016889:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15619@kfi7, seq: 335333150
00000100:00000001:23.0:1773851890.016890:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.016890:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002da34f3f : new rpc_count 3
00000100:00000001:20.0:1773851890.016890:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667757184 : -106956041794432 : ffff9eb95b1f4c80)
00000100:00000001:23.0:1773851890.016891:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.016891:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006e34792a x1859598942615744/t0(0) o17->deec8167-560d-484b-8611-2c460a2db78b@15619@kfi7:617/0 lens 456/0 e 0 to 0 dl 1773851977 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1479-0'
00000100:00000001:20.0:1773851890.016894:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.016894:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851890.016895:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e34792a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:deec8167-560d-484b-8611-2c460a2db78b+612:39555:x1859598942615744:12345-15619@kfi7:17:default-tuolumne1479-0
00000100:00000200:20.0:1773851890.016896:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598942615744
00000020:00000001:20.0:1773851890.016897:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851890.016897:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851890.016898:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.016898:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851890.016899:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:20.0:1773851890.016899:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851890.016900:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598942615744, found 0 last_xid 1859598925326527
00000020:00000001:20.0:1773851890.016901:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851890.016902:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851890.016902:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851890.016902:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851890.016903:0:61145:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:20.0:1773851890.016904:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851890.016904:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851890.016905:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000254805f7.
02000000:00000001:20.0:1773851890.016906:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.016906:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.016907:0:61145:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:20.0:1773851890.016908:0:61145:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:20.0:1773851890.016909:0:61145:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:20.0:1773851890.016910:0:61145:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.016911:0:61145:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:20.0:1773851890.016912:0:61145:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli deec8167-560d-484b-8611-2c460a2db78b/000000002da34f3f free: 126633370845184 avail: 126633368748032
00000020:00000001:20.0:1773851890.016913:0:61145:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:20.0:1773851890.016913:0:61145:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli deec8167-560d-484b-8611-2c460a2db78b/000000002da34f3f avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:20.0:1773851890.016915:0:61145:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:20.0:1773851890.016916:0:61145:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:20.0:1773851890.016916:0:61145:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli deec8167-560d-484b-8611-2c460a2db78b/000000002da34f3f reports grant 1808007167 dropped 0, local 1882456063
00000020:00000001:20.0:1773851890.016917:0:61145:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:20.0:1773851890.016918:0:61145:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:20.0:1773851890.016918:0:61145:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851890.016919:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593780, transno 0, xid 1859598942615744
00010000:00000001:20.0:1773851890.016919:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851890.016920:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006e34792a x1859598942615744/t0(0) o17->deec8167-560d-484b-8611-2c460a2db78b@15619@kfi7:617/0 lens 456/432 e 0 to 0 dl 1773851977 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1479-0'
00010000:00000001:20.0:1773851890.016922:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851890.016923:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851890.016923:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=123 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851890.016924:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851890.016925:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b8759961 refcount 3 to 15619@kfi7
00000100:00000001:20.0:1773851890.016926:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024608 : -107156745527008 : ffff9e8aa03f6120)
02000000:00000001:20.0:1773851890.016927:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851890.016927:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.016928:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851890.016928:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15619@kfi7
00000400:00000010:20.0:1773851890.016929:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005e4e6e2f.
00000100:00000200:20.0:1773851890.016930:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598942615744, offset 224
00000400:00000200:20.0:1773851890.016931:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15619@kfi7
00000400:00000200:20.0:1773851890.016932:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.016932:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c2a652c3 nid 15619@kfi7 refs 1
00000400:00000200:20.0:1773851890.016933:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c2a652c3 nid 15619@kfi7 refs 2
00000400:00000200:20.0:1773851890.016934:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c2a652c3 nid 15619@kfi7 refs 3
00000400:00000200:20.0:1773851890.016935:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15619@kfi7 local destination
00000400:00000200:20.0:1773851890.016937:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769967:8769967:1024:4294967295] 15619@kfi7 LPNI seq info [3661790:3661790:16:4294967295]
00000400:00000200:20.0:1773851890.016938:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c2a652c3 nid 15619@kfi7 refs 2
00000400:00000200:20.0:1773851890.016938:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15619@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.016940:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15619@kfi7(15619@kfi7:15619@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851890.016941:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c2a652c3 nid 15619@kfi7 refs 3
00000800:00000200:20.0:1773851890.016943:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851890.016944:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:20.0:1773851890.016945:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851890.016947:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a Using peer 15619@kfi7(0x10000000000099a)
00000800:00000200:20.0:1773851890.016950:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 532 bytes to peer 0x10000000000099a: rc=0
00000800:00000200:20.0:1773851890.016951:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851890.016952:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.016953:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b8759961 refcount 2 to 15619@kfi7
00010000:00000001:20.0:1773851890.016954:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851890.016955:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.016955:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851890.016956:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006e34792a x1859598942615744/t0(0) o17->deec8167-560d-484b-8611-2c460a2db78b@15619@kfi7:617/0 lens 456/432 e 0 to 0 dl 1773851977 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1479-0'
00000100:00100000:20.0:1773851890.016959:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e34792a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:deec8167-560d-484b-8611-2c460a2db78b+612:39555:x1859598942615744:12345-15619@kfi7:17:default-tuolumne1479-0 Request processed in 64us (91us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851890.016962:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15619@kfi7, seq: 335333150
00000100:00000040:20.0:1773851890.016962:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002da34f3f : new rpc_count 2
00000100:00000001:20.0:1773851890.016963:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851890.016963:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851890.016964:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851890.016964:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee24a6ca.
00000020:00000010:20.0:1773851890.016965:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000020:00000040:20.0:1773851890.016966:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000002da34f3f : new refcount 611
00000100:00000001:20.0:1773851890.016967:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851890.016971:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851890.016972:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851890.016974:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15619@kfi7: PUT: OK
00000400:00000200:22.0:1773851890.016974:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005e4e6e2f
00000400:00000010:22.0:1773851890.016975:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005e4e6e2f.
00000100:00000001:22.0:1773851890.016976:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851890.016976:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851890.016977:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c2a652c3 nid 15619@kfi7 refs 2
00000800:00000200:22.0:1773851890.016978:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 15619@kfi7(000000003fafd04f):0x0 lsk 2459 rsk 12 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000099a Transaction freed
00000800:00000200:17.0:1773851890.019599:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851890.019600:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851890.019601:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851890.019603:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851890.019607:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.019609:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:17.0:1773851890.019610:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.019610:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851890.019612:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.019612:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851890.019613:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851890.019614:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:17.0:1773851890.019615:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e35e80
00000400:00000200:17.0:1773851890.019617:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 39152
00000800:00000200:17.0:1773851890.019619:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851890.019621:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.019622:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000100:00000001:17.0:1773851890.019623:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851890.019623:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851890.019624:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003c10bbc4.
00000100:00000040:17.0:1773851890.019625:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000003c10bbc4 x1859316187618944 msgsize 224
00000100:00100000:17.0:1773851890.019627:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:17.0:1773851890.019628:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851890.019629:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000100:00000001:16.0:1773851890.019629:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851890.019630:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851890.019630:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851890.019630:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851890.019631:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851890.019631:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851890.019632:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187618944
00000020:00000001:16.0:1773851890.019633:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851890.019633:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:16.0:1773851890.019634:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851890.019635:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:16.0:1773851890.019636:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:16.0:1773851890.019637:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:16.0:1773851890.019638:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851890.019639:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851890.019639:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ea3653dd.
00000020:00000010:16.0:1773851890.019640:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851890.019641:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000096f6d53.
00000100:00000001:16.0:1773851890.019642:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851890.019642:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851890.019643:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851890.019644:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851890.019644:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851890.019645:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.019646:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851890.019647:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851890.019647:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851890.019647:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851890.019647:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851890.019649:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851890.019649:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156407
00000100:00000040:16.0:1773851890.019649:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:17.0:1773851890.019650:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.019650:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636922407254400 : -107151302297216 : ffff9e8be4b07980)
00000100:00000040:16.0:1773851890.019651:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003c10bbc4 x1859316187618944/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:173/0 lens 224/0 e 0 to 0 dl 1773852288 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:16.0:1773851890.019654:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851890.019654:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851890.019655:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c10bbc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39685:x1859316187618944:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:16.0:1773851890.019657:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187618944
00000020:00000001:16.0:1773851890.019657:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851890.019658:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851890.019658:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.019659:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851890.019659:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851890.019660:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851890.019661:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187618944, found 0 last_xid 1859316186815935
00000020:00000001:16.0:1773851890.019662:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851890.019663:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851890.019663:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851890.019664:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.019665:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851890.019665:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851890.019666:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851890.019667:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004d8af1a1.
02000000:00000001:16.0:1773851890.019667:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.019668:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.019668:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851890.019669:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187618944
00010000:00000001:16.0:1773851890.019670:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851890.019671:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003c10bbc4 x1859316187618944/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:173/0 lens 224/224 e 0 to 0 dl 1773852288 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:16.0:1773851890.019673:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851890.019674:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851890.019674:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=123 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851890.019675:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851890.019676:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:16.0:1773851890.019677:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:16.0:1773851890.019678:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851890.019678:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.019679:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851890.019680:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:16.0:1773851890.019680:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b181d0b9.
00000100:00000200:16.0:1773851890.019681:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187618944, offset 224
00000400:00000200:16.0:1773851890.019682:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:16.0:1773851890.019683:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:16.0:1773851890.019684:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:16.0:1773851890.019685:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:16.0:1773851890.019686:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:16.0:1773851890.019688:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:16.0:1773851890.019689:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769968:8769968:1024:4294967295] 20881@kfi7 LPNI seq info [16890555:16890555:16:4294967295]
00000400:00000200:16.0:1773851890.019690:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:16.0:1773851890.019691:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:16.0:1773851890.019693:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851890.019694:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:16.0:1773851890.019695:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851890.019696:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851890.019699:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851890.019701:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Using peer 20881@kfi7(0x6b5)
00000800:00000200:16.0:1773851890.019704:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x6b5: rc=0
00000800:00000200:16.0:1773851890.019705:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851890.019707:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.019708:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:16.0:1773851890.019709:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851890.019709:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.019710:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851890.019711:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003c10bbc4 x1859316187618944/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:173/0 lens 224/224 e 0 to 0 dl 1773852288 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000100:00100000:16.0:1773851890.019715:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c10bbc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39685:x1859316187618944:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851890.019717:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156407
00000100:00000040:16.0:1773851890.019718:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000100:00000001:16.0:1773851890.019719:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851890.019719:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851890.019720:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851890.019720:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000096f6d53.
00000020:00000010:16.0:1773851890.019721:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ea3653dd.
00000020:00000040:16.0:1773851890.019722:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:16.0:1773851890.019723:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851890.019732:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851890.019733:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.019734:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000400:00000200:17.0:1773851890.019735:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b181d0b9
00000400:00000010:17.0:1773851890.019736:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b181d0b9.
00000100:00000001:17.0:1773851890.019737:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851890.019737:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851890.019738:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:17.0:1773851890.019740:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Transaction freed
00000800:00000200:25.0:1773851890.027484:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851890.027485:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851890.027487:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851890.027489:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851890.027491:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12017@kfi7 to cpt 6
00000400:00000200:25.0:1773851890.027492:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12017@kfi7 : PUT - for me
00000400:00000200:25.0:1773851890.027493:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12017@kfi7 to cpt 6
00000400:00000200:25.0:1773851890.027494:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000931e9b7f nid 12017@kfi7 refs 1
00000400:00000200:25.0:1773851890.027494:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12017@kfi7 to cpt 6
00000400:00000200:25.0:1773851890.027495:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000931e9b7f nid 12017@kfi7 refs 2
00000400:00000200:25.0:1773851890.027496:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000931e9b7f nid 12017@kfi7 refs 3
00000400:00000200:25.0:1773851890.027497:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12016@kfi7 to cpt 3
00000400:00000200:25.0:1773851890.027498:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12016@kfi7 of length 224 into portal 12 MB=0x69b4b5986df40
00000400:00000200:25.0:1773851890.027499:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12016@kfi7 of length 224/224 into md 0x16159c9699 [64] + 32432
00000800:00000200:25.0:1773851890.027501:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851890.027503:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851890.027504:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12017@kfi7: PUT: OK
00000100:00000001:25.0:1773851890.027505:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851890.027505:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851890.027506:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ca4b0ba5.
00000100:00000040:25.0:1773851890.027507:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ca4b0ba5 x1859597787127616 msgsize 224
00000100:00100000:25.0:1773851890.027508:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12016@kfi7 (source: 12345-12017@kfi7)
00000100:00000001:25.0:1773851890.027509:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851890.027510:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000931e9b7f nid 12017@kfi7 refs 2
00000100:00000001:27.0:1773851890.027511:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851890.027511:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851890.027511:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b172e83: 2069@kfi7:6 <- 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851890.027512:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851890.027512:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851890.027513:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851890.027513:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597787127616
00000020:00000001:27.0:1773851890.027514:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851890.027514:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d77fcb
00000020:00000001:27.0:1773851890.027515:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851890.027517:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003cd69e26 refcount=5
00000020:00000001:27.0:1773851890.027518:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126385736704 : -106947323814912 : ffff9ebb62c11c00)
00000020:00000001:27.0:1773851890.027519:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126385736704 : -106947323814912 : ffff9ebb62c11c00)
00000100:00000001:27.0:1773851890.027519:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851890.027520:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851890.027521:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000095a8ac67.
00000020:00000010:27.0:1773851890.027522:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851890.027522:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcd1148b.
00000100:00000001:27.0:1773851890.027523:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851890.027523:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851890.027524:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851890.027525:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851890.027525:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851890.027526:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851890.027527:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851890.027528:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851890.027529:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851890.027530:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:25.0:1773851890.027530:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12016@kfi7, seq: 2025162
00000100:00000040:25.0:1773851890.027530:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003cd69e26 : new rpc_count 1
00000100:00000001:27.0:1773851890.027531:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851890.027531:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851890.027531:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252475392 : -106967457076224 : ffff9eb6b2b7ec00)
00000100:00000001:27.0:1773851890.027532:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851890.027532:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ca4b0ba5 x1859597787127616/t0(0) o400->4439b82b-88bd-420f-9e2b-9e962cca2902@12016@kfi7:140/0 lens 224/0 e 0 to 0 dl 1773852255 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1229-0'
00000100:00000001:25.0:1773851890.027535:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851890.027535:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851890.027536:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca4b0ba5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4439b82b-88bd-420f-9e2b-9e962cca2902+5:39541:x1859597787127616:12345-12016@kfi7:400:default-tuolumne1229-0
00000100:00000200:25.0:1773851890.027538:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597787127616
00000020:00000001:25.0:1773851890.027538:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851890.027539:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851890.027539:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851890.027540:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851890.027541:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851890.027541:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851890.027542:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597787127616, found 0 last_xid 1859597787127615
00000020:00000001:25.0:1773851890.027543:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851890.027543:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851890.027544:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851890.027544:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851890.027547:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851890.027548:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851890.027548:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851890.027549:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fc844a13.
02000000:00000001:25.0:1773851890.027550:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851890.027550:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851890.027551:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851890.027552:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256841450, transno 0, xid 1859597787127616
00010000:00000001:25.0:1773851890.027552:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851890.027553:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ca4b0ba5 x1859597787127616/t0(0) o400->4439b82b-88bd-420f-9e2b-9e962cca2902@12016@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1229-0'
00010000:00000001:25.0:1773851890.027555:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851890.027556:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851890.027557:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=123 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851890.027558:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851890.027558:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000007109646 refcount 3 to 12016@kfi7
00000100:00000001:25.0:1773851890.027559:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729297152 : -107155980254464 : ffff9e8acddc8300)
02000000:00000001:25.0:1773851890.027560:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851890.027560:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851890.027561:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851890.027561:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12017@kfi7
00000400:00000010:25.0:1773851890.027562:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005dc5d812.
00000100:00000200:25.0:1773851890.027563:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597787127616, offset 224
00000400:00000200:25.0:1773851890.027564:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12017@kfi7
00000400:00000200:25.0:1773851890.027565:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12017@kfi7 to cpt 6
00000400:00000200:25.0:1773851890.027566:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000931e9b7f nid 12017@kfi7 refs 1
00000400:00000200:25.0:1773851890.027567:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000931e9b7f nid 12017@kfi7 refs 2
00000400:00000200:25.0:1773851890.027568:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000931e9b7f nid 12017@kfi7 refs 3
00000400:00000200:25.0:1773851890.027569:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12017@kfi7 local destination
00000400:00000200:25.0:1773851890.027570:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769969:8769969:1024:4294967295] 12017@kfi7 LPNI seq info [570367:570367:16:4294967295]
00000400:00000200:25.0:1773851890.027571:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000931e9b7f nid 12017@kfi7 refs 2
00000400:00000200:25.0:1773851890.027572:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12017@kfi7 to cpt 6
00000400:00000200:25.0:1773851890.027574:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12017@kfi7(12017@kfi7:12017@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851890.027575:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000931e9b7f nid 12017@kfi7 refs 3
00000800:00000200:25.0:1773851890.027577:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851890.027578:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851890.027580:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851890.027582:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0xacc Using peer 12017@kfi7(0xacc)
00000800:00000200:25.0:1773851890.027586:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000009b172e83: Posted send of 324 bytes to peer 0xacc: rc=0
00000800:00000200:25.0:1773851890.027587:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0xacc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851890.027589:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851890.027590:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000007109646 refcount 2 to 12016@kfi7
00010000:00000001:25.0:1773851890.027591:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851890.027591:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851890.027592:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851890.027593:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ca4b0ba5 x1859597787127616/t0(0) o400->4439b82b-88bd-420f-9e2b-9e962cca2902@12016@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1229-0'
00000100:00100000:25.0:1773851890.027596:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca4b0ba5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4439b82b-88bd-420f-9e2b-9e962cca2902+5:39541:x1859597787127616:12345-12016@kfi7:400:default-tuolumne1229-0 Request processed in 60us (89us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851890.027599:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12016@kfi7, seq: 2025162
00000100:00000040:25.0:1773851890.027599:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003cd69e26 : new rpc_count 0
00000800:00000200:26.0:1773851890.027600:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0xacc TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851890.027600:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851890.027600:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851890.027601:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:26.0:1773851890.027602:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851890.027602:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcd1148b.
00000020:00000010:25.0:1773851890.027603:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000095a8ac67.
00000020:00000040:25.0:1773851890.027603:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000003cd69e26 : new refcount 4
00000400:00000200:26.0:1773851890.027604:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12017@kfi7: PUT: OK
00000400:00000200:26.0:1773851890.027604:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005dc5d812
00000100:00000001:25.0:1773851890.027604:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:26.0:1773851890.027605:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005dc5d812.
00000100:00000001:26.0:1773851890.027606:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851890.027606:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851890.027607:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000931e9b7f nid 12017@kfi7 refs 2
00000800:00000200:26.0:1773851890.027608:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b172e83: 2069@kfi7:6 -> 12017@kfi7(00000000ab737c1b):0x0 lsk 2765 rsk 20 tsk 0 trmk 0 tmk 0 trr 6 tta 0xacc Transaction freed
00000800:00000200:29.0:1773851890.029755:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851890.029756:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851890.029757:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851890.029760:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851890.029762:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20992@kfi7 to cpt 7
00000400:00000200:29.0:1773851890.029763:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20992@kfi7 : PUT - for me
00000400:00000200:29.0:1773851890.029764:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20992@kfi7 to cpt 7
00000400:00000200:29.0:1773851890.029766:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003507e8e8 nid 20992@kfi7 refs 1
00000400:00000200:29.0:1773851890.029767:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20992@kfi7 to cpt 7
00000400:00000200:29.0:1773851890.029768:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003507e8e8 nid 20992@kfi7 refs 2
00000400:00000200:29.0:1773851890.029769:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003507e8e8 nid 20992@kfi7 refs 3
00000400:00000200:29.0:1773851890.029770:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21184@kfi7 to cpt 2
00000400:00000200:29.0:1773851890.029771:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21184@kfi7 of length 456 into portal 12 MB=0x69b0aaa9cd540
00000400:00000200:29.0:1773851890.029772:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21184@kfi7 of length 456/456 into md 0x77fe1859d [64] + 3424
00000800:00000200:29.0:1773851890.029774:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851890.029776:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851890.029777:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20992@kfi7: PUT: OK
00000100:00000001:29.0:1773851890.029778:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851890.029779:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851890.029780:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f75b7c6e.
00000100:00000040:29.0:1773851890.029781:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f75b7c6e x1859319974647104 msgsize 456
00000100:00100000:29.0:1773851890.029782:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21184@kfi7 (source: 12345-20992@kfi7)
00000100:00000001:29.0:1773851890.029784:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851890.029785:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003507e8e8 nid 20992@kfi7 refs 2
00000800:00000200:29.0:1773851890.029786:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851890.029787:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851890.029788:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851890.029789:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851890.029790:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851890.029792:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851890.029793:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319974647104
00000020:00000001:30.0:1773851890.029795:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851890.029795:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92562
00000020:00000001:30.0:1773851890.029797:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851890.029802:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b03a3aed refcount=775
00000020:00000001:30.0:1773851890.029803:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630778880 : -107123078772736 : ffff9e9276f14800)
00000020:00000001:30.0:1773851890.029805:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630778880 : -107123078772736 : ffff9e9276f14800)
00000100:00000001:30.0:1773851890.029806:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851890.029807:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851890.029809:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f029511a.
00000020:00000010:30.0:1773851890.029811:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851890.029812:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000700a46f0.
00000100:00000001:30.0:1773851890.029814:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851890.029815:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851890.029816:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.029818:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.029820:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851890.029823:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851890.029823:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851890.029824:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851890.029824:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851890.029826:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21184@kfi7, seq: 364304986
00000100:00000040:30.0:1773851890.029827:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b03a3aed : new rpc_count 3
00000100:00000001:31.0:1773851890.029828:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.029829:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.029829:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262239744 : -106943447311872 : ffff9ebc49cfda00)
00000100:00000040:30.0:1773851890.029831:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f75b7c6e x1859319974647104/t0(0) o17->defbcc6c-3580-43a4-950c-b09516f54ec8@21184@kfi7:617/0 lens 456/0 e 0 to 0 dl 1773851977 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1811-0'
00000100:00000001:30.0:1773851890.029836:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851890.029837:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851890.029838:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f75b7c6e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:defbcc6c-3580-43a4-950c-b09516f54ec8+775:39682:x1859319974647104:12345-21184@kfi7:17:default-tuolumne1811-0
00000100:00000200:30.0:1773851890.029841:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319974647104
00000020:00000001:30.0:1773851890.029842:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851890.029844:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851890.029845:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.029846:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851890.029847:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:30.0:1773851890.029849:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851890.029850:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319974647104, found 0 last_xid 1859319829991935
00000020:00000001:30.0:1773851890.029851:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851890.029852:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851890.029853:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851890.029854:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851890.029855:0:42267:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:30.0:1773851890.029857:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851890.029858:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851890.029860:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000001743517f.
02000000:00000001:30.0:1773851890.029861:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.029862:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.029864:0:42267:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:30.0:1773851890.029865:0:42267:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:30.0:1773851890.029866:0:42267:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851890.029869:0:42267:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.029870:0:42267:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:30.0:1773851890.029871:0:42267:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli defbcc6c-3580-43a4-950c-b09516f54ec8/00000000b03a3aed free: 126633370845184 avail: 126633368748032
00000020:00000001:30.0:1773851890.029873:0:42267:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:30.0:1773851890.029874:0:42267:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli defbcc6c-3580-43a4-950c-b09516f54ec8/00000000b03a3aed avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:30.0:1773851890.029876:0:42267:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:30.0:1773851890.029878:0:42267:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:30.0:1773851890.029879:0:42267:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli defbcc6c-3580-43a4-950c-b09516f54ec8/00000000b03a3aed reports grant 1802502143 dropped 0, local 1882456063
00000020:00000001:30.0:1773851890.029881:0:42267:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:30.0:1773851890.029882:0:42267:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:30.0:1773851890.029882:0:42267:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851890.029884:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584171, transno 0, xid 1859319974647104
00010000:00000001:30.0:1773851890.029885:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851890.029887:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f75b7c6e x1859319974647104/t0(0) o17->defbcc6c-3580-43a4-950c-b09516f54ec8@21184@kfi7:617/0 lens 456/432 e 0 to 0 dl 1773851977 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1811-0'
00010000:00000001:30.0:1773851890.029892:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851890.029892:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851890.029894:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=123 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851890.029896:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851890.029897:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000059e1f25a refcount 3 to 21184@kfi7
00000100:00000001:30.0:1773851890.029899:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551673440 : -107156157878176 : ffff9e8ac3463060)
02000000:00000001:30.0:1773851890.029900:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851890.029901:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.029902:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851890.029904:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20992@kfi7
00000400:00000010:30.0:1773851890.029905:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003651c096.
00000100:00000200:30.0:1773851890.029907:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859319974647104, offset 224
00000400:00000200:30.0:1773851890.029910:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20992@kfi7
00000400:00000200:30.0:1773851890.029912:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20992@kfi7 to cpt 7
00000400:00000200:30.0:1773851890.029914:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003507e8e8 nid 20992@kfi7 refs 1
00000400:00000200:30.0:1773851890.029916:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003507e8e8 nid 20992@kfi7 refs 2
00000400:00000200:30.0:1773851890.029918:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003507e8e8 nid 20992@kfi7 refs 3
00000400:00000200:30.0:1773851890.029921:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20992@kfi7 local destination
00000400:00000200:30.0:1773851890.029923:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769970:8769970:1024:4294967295] 20992@kfi7 LPNI seq info [7244200:7244200:16:4294967295]
00000400:00000200:30.0:1773851890.029926:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003507e8e8 nid 20992@kfi7 refs 2
00000400:00000200:30.0:1773851890.029927:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20992@kfi7 to cpt 7
00000400:00000200:30.0:1773851890.029931:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20992@kfi7(20992@kfi7:20992@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851890.029933:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003507e8e8 nid 20992@kfi7 refs 3
00000800:00000200:30.0:1773851890.029936:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851890.029938:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:30.0:1773851890.029942:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851890.029946:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002f8 Using peer 20992@kfi7(0x1000000000002f8)
00000800:00000200:30.0:1773851890.029952:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000fd057322: Posted send of 532 bytes to peer 0x1000000000002f8: rc=0
00000800:00000200:30.0:1773851890.029955:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002f8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851890.029958:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851890.029959:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000059e1f25a refcount 2 to 21184@kfi7
00010000:00000001:30.0:1773851890.029961:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851890.029961:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.029963:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851890.029964:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f75b7c6e x1859319974647104/t0(0) o17->defbcc6c-3580-43a4-950c-b09516f54ec8@21184@kfi7:617/0 lens 456/432 e 0 to 0 dl 1773851977 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1811-0'
00000800:00000200:29.0:1773851890.029968:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002f8 TN_EVENT_TX_OK event status 0
00000100:00100000:30.0:1773851890.029969:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f75b7c6e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:defbcc6c-3580-43a4-950c-b09516f54ec8+775:39682:x1859319974647104:12345-21184@kfi7:17:default-tuolumne1811-0 Request processed in 132us (187us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851890.029970:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851890.029971:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20992@kfi7: PUT: OK
00000400:00000200:29.0:1773851890.029971:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003651c096
00000400:00000010:29.0:1773851890.029972:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003651c096.
00000100:00000001:29.0:1773851890.029973:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851890.029973:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:30.0:1773851890.029974:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21184@kfi7, seq: 364304986
00000400:00000200:29.0:1773851890.029974:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003507e8e8 nid 20992@kfi7 refs 2
00000800:00000200:29.0:1773851890.029975:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 20992@kfi7(0000000099c5fb79):0x0 lsk 761 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002f8 Transaction freed
00000100:00000040:30.0:1773851890.029976:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b03a3aed : new rpc_count 2
00000100:00000001:30.0:1773851890.029978:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851890.029979:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851890.029980:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851890.029981:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000700a46f0.
00000020:00000010:30.0:1773851890.029983:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f029511a.
00000020:00000040:30.0:1773851890.029984:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000b03a3aed : new refcount 774
00000100:00000001:30.0:1773851890.029986:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851890.075982:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851890.075984:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851890.075986:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851890.075989:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851890.075993:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.075994:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 60@kfi7 : PUT - for me
00000400:00000200:21.0:1773851890.075996:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.075997:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:21.0:1773851890.075999:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.076000:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:21.0:1773851890.076001:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:21.0:1773851890.076005:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.076007:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 224 into portal 12 MB=0x699e0de290140
00000400:00000200:21.0:1773851890.076009:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-60@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 58440
00000800:00000200:21.0:1773851890.076012:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851890.076014:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.076016:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000100:00000001:21.0:1773851890.076018:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851890.076018:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851890.076019:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000030e11240.
00000100:00000040:21.0:1773851890.076021:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000030e11240 x1858040939217216 msgsize 224
00000100:00100000:21.0:1773851890.076023:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-60@kfi7 (source: 12345-60@kfi7)
00000100:00000001:21.0:1773851890.076024:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851890.076026:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:20.0:1773851890.076026:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851890.076026:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851890.076027:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851890.076027:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851890.076028:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851890.076028:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851890.076029:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040939217216
00000020:00000001:20.0:1773851890.076029:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851890.076030:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acc93fe
00000020:00000001:20.0:1773851890.076030:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851890.076034:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dccd7276 refcount=5
00000020:00000001:20.0:1773851890.076034:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950643302400 : -107123066249216 : ffff9e9277b06000)
00000020:00000001:20.0:1773851890.076035:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950643302400 : -107123066249216 : ffff9e9277b06000)
00000100:00000001:20.0:1773851890.076036:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.076037:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851890.076037:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851890.076038:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851890.076039:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee24a6ca.
00000100:00000001:20.0:1773851890.076040:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851890.076041:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851890.076041:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851890.076042:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851890.076043:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851890.076043:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.076044:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851890.076046:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851890.076046:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851890.076047:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851890.076047:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851890.076047:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-60@kfi7, seq: 1998053
00000100:00000001:23.0:1773851890.076048:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.076048:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dccd7276 : new rpc_count 1
00000100:00000001:23.0:1773851890.076049:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.076049:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667741056 : -106956041810560 : ffff9eb95b1f0d80)
00000100:00000040:20.0:1773851890.076050:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000030e11240 x1858040939217216/t0(0) o400->lustre5-MDT0001-lwp-OST0005_UUID@60@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba106-0'
00000100:00000001:20.0:1773851890.076052:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.076053:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851890.076054:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030e11240 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:lustre5-MDT0001-lwp-OST0005_UUID+5:272681:x1858040939217216:12345-60@kfi7:400:default-yuba106-0
00000100:00000200:20.0:1773851890.076056:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040939217216
00000020:00000001:20.0:1773851890.076057:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851890.076057:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851890.076058:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.076059:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851890.076059:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851890.076060:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851890.076061:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851890.076062:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851890.076062:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851890.076063:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.076063:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851890.076064:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851890.076065:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851890.076065:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b48189b.
02000000:00000001:20.0:1773851890.076066:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.076067:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.076069:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851890.076070:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858040939217216
00010000:00000001:20.0:1773851890.076071:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851890.076072:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000030e11240 x1858040939217216/t0(0) o400->lustre5-MDT0001-lwp-OST0005_UUID@60@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba106-0'
00010000:00000001:20.0:1773851890.076074:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851890.076074:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851890.076075:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=123 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851890.076076:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851890.076077:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000049f6553b refcount 7 to 60@kfi7
00000100:00000001:20.0:1773851890.076078:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094400 : -107139307457216 : ffff9e8eafa33540)
02000000:00000001:20.0:1773851890.076078:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851890.076079:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.076079:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851890.076080:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000400:00000010:20.0:1773851890.076081:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000052968703.
00000100:00000200:20.0:1773851890.076082:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040939217216, offset 224
00000400:00000200:20.0:1773851890.076083:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:20.0:1773851890.076084:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.076085:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:20.0:1773851890.076086:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:20.0:1773851890.076087:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:20.0:1773851890.076089:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  60@kfi7 local destination
00000400:00000200:20.0:1773851890.076090:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769971:8769971:1024:4294967295] 60@kfi7 LPNI seq info [5404313:5404313:16:4294967295]
00000400:00000200:20.0:1773851890.076091:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:20.0:1773851890.076092:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.076094:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851890.076095:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000800:00000200:20.0:1773851890.076097:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851890.076098:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851890.076100:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851890.076102:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e2 Using peer 60@kfi7(0x1e2)
00000800:00000200:20.0:1773851890.076105:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x1e2: rc=0
00000800:00000200:20.0:1773851890.076107:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851890.076109:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.076110:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000049f6553b refcount 6 to 60@kfi7
00010000:00000001:20.0:1773851890.076110:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851890.076111:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.076111:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851890.076112:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000030e11240 x1858040939217216/t0(0) o400->lustre5-MDT0001-lwp-OST0005_UUID@60@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba106-0'
00000100:00100000:20.0:1773851890.076117:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030e11240 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:lustre5-MDT0001-lwp-OST0005_UUID+5:272681:x1858040939217216:12345-60@kfi7:400:default-yuba106-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851890.076119:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-60@kfi7, seq: 1998053
00000100:00000040:20.0:1773851890.076120:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dccd7276 : new rpc_count 0
00000100:00000001:20.0:1773851890.076120:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851890.076121:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851890.076122:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851890.076122:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee24a6ca.
00000020:00000010:20.0:1773851890.076123:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000020:00000040:20.0:1773851890.076124:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000dccd7276 : new refcount 4
00000100:00000001:20.0:1773851890.076125:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851890.076131:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e2 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851890.076134:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.076136:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000400:00000200:21.0:1773851890.076137:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000052968703
00000400:00000010:21.0:1773851890.076138:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000052968703.
00000100:00000001:21.0:1773851890.076139:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851890.076140:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851890.076141:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:21.0:1773851890.076144:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1e2 Transaction freed
00000800:00000200:10.0:1773851890.338358:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851890.338359:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851890.338361:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851890.338363:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851890.338365:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.338366:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15610@kfi7 : PUT - for me
00000400:00000200:10.0:1773851890.338367:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.338368:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 1
00000400:00000200:10.0:1773851890.338369:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.338370:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000400:00000200:10.0:1773851890.338371:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 3
00000400:00000200:10.0:1773851890.338372:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15611@kfi7 to cpt 5
00000400:00000200:10.0:1773851890.338373:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15611@kfi7 of length 224 into portal 12 MB=0x699de8c4b7280
00000400:00000200:10.0:1773851890.338374:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15611@kfi7 of length 224/224 into md 0x78146ce49 [64] + 153848
00000800:00000200:10.0:1773851890.338376:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851890.338378:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851890.338379:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15610@kfi7: PUT: OK
00000100:00000001:10.0:1773851890.338381:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851890.338381:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851890.338382:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000009002bec.
00000100:00000040:10.0:1773851890.338383:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000009002bec x1858030975808128 msgsize 224
00000100:00100000:10.0:1773851890.338385:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-15611@kfi7 (source: 12345-15610@kfi7)
00000100:00000001:10.0:1773851890.338386:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851890.338387:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000100:00000001:8.0:1773851890.338388:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851890.338389:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851890.338389:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851890.338390:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851890.338390:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851890.338391:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851890.338392:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030975808128
00000020:00000001:8.0:1773851890.338393:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851890.338394:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91007
00000020:00000001:8.0:1773851890.338395:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851890.338397:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000080940669 refcount=6
00000020:00000001:8.0:1773851890.338397:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240093696 : -107152469457920 : ffff9e8b9f1f0400)
00000020:00000001:8.0:1773851890.338398:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240093696 : -107152469457920 : ffff9e8b9f1f0400)
00000100:00000001:8.0:1773851890.338399:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851890.338400:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851890.338401:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000339c92f7.
00000020:00000010:8.0:1773851890.338402:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851890.338403:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851890.338404:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851890.338404:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851890.338405:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851890.338406:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851890.338406:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851890.338407:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.338408:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851890.338409:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851890.338410:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851890.338411:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15611@kfi7, seq: 2130842
00000100:00000001:9.0:1773851890.338412:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:8.0:1773851890.338412:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000080940669 : new rpc_count 1
00000100:00000001:9.0:1773851890.338413:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851890.338413:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087761024 : -106944621790592 : ffff9ebc03ceba80)
00000100:00000001:9.0:1773851890.338414:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851890.338414:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000009002bec x1858030975808128/t0(0) o400->1f0cae5c-0483-4207-81f3-5e4114223c35@15611@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne229-0'
00000100:00000001:9.0:1773851890.338415:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.338416:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851890.338417:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851890.338418:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000009002bec pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1f0cae5c-0483-4207-81f3-5e4114223c35+6:47847:x1858030975808128:12345-15611@kfi7:400:default-tuolumne229-0
00000100:00000200:8.0:1773851890.338419:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030975808128
00000020:00000001:8.0:1773851890.338420:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851890.338421:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851890.338421:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338422:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851890.338423:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851890.338424:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851890.338425:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030975808128, found 0 last_xid 1858030975808127
00000020:00000001:8.0:1773851890.338426:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851890.338426:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851890.338427:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851890.338428:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338429:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851890.338429:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851890.338430:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851890.338431:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002eec3ec2.
02000000:00000001:8.0:1773851890.338431:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.338432:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338433:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851890.338433:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030975808128
00010000:00000001:8.0:1773851890.338434:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851890.338435:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000009002bec x1858030975808128/t0(0) o400->1f0cae5c-0483-4207-81f3-5e4114223c35@15611@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne229-0'
00010000:00000001:8.0:1773851890.338438:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851890.338438:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851890.338439:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=123 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851890.338440:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851890.338441:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000834ea769 refcount 5 to 15611@kfi7
00000100:00000001:8.0:1773851890.338442:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451904 : -107146752099712 : ffff9e8cf3e6fa80)
02000000:00000001:8.0:1773851890.338443:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851890.338444:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.338444:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851890.338445:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15610@kfi7
00000400:00000010:8.0:1773851890.338446:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2abdf16.
00000100:00000200:8.0:1773851890.338447:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030975808128, offset 224
00000400:00000200:8.0:1773851890.338448:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15610@kfi7
00000400:00000200:8.0:1773851890.338449:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:8.0:1773851890.338450:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 1
00000400:00000200:8.0:1773851890.338451:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000400:00000200:8.0:1773851890.338452:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 3
00000400:00000200:8.0:1773851890.338454:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15610@kfi7 local destination
00000400:00000200:8.0:1773851890.338455:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769972:8769972:1024:4294967295] 15610@kfi7 LPNI seq info [24385:24385:16:4294967295]
00000400:00000200:8.0:1773851890.338457:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000400:00000200:8.0:1773851890.338457:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:8.0:1773851890.338460:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15610@kfi7(15610@kfi7:15610@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851890.338461:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 3
00000800:00000200:8.0:1773851890.338462:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851890.338463:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851890.338465:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851890.338468:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000002a3 Using peer 15610@kfi7(0x1000000000002a3)
00000800:00000200:8.0:1773851890.338471:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x1000000000002a3: rc=0
00000800:00000200:8.0:1773851890.338472:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000002a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851890.338474:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851890.338475:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000834ea769 refcount 4 to 15611@kfi7
00010000:00000001:8.0:1773851890.338476:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851890.338476:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338477:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851890.338478:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000009002bec x1858030975808128/t0(0) o400->1f0cae5c-0483-4207-81f3-5e4114223c35@15611@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne229-0'
00000100:00100000:8.0:1773851890.338482:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000009002bec pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1f0cae5c-0483-4207-81f3-5e4114223c35+6:47847:x1858030975808128:12345-15611@kfi7:400:default-tuolumne229-0 Request processed in 65us (98us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851890.338484:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15611@kfi7, seq: 2130842
00000100:00000040:8.0:1773851890.338485:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000080940669 : new rpc_count 0
00000100:00000001:8.0:1773851890.338486:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851890.338487:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851890.338489:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851890.338490:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851890.338491:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000339c92f7.
00000020:00000040:8.0:1773851890.338492:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000080940669 : new refcount 5
00000100:00000001:8.0:1773851890.338492:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851890.338498:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000002a3 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851890.338499:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851890.338500:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15610@kfi7: PUT: OK
00000400:00000200:10.0:1773851890.338501:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2abdf16
00000400:00000010:10.0:1773851890.338502:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2abdf16.
00000100:00000001:10.0:1773851890.338503:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851890.338503:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851890.338504:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000800:00000200:10.0:1773851890.338506:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 15610@kfi7(000000004cca7ddb):0x0 lsk 676 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000002a3 Transaction freed
00000800:00000200:10.0:1773851890.338700:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851890.338701:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851890.338702:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851890.338704:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851890.338706:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.338707:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15610@kfi7 : PUT - for me
00000400:00000200:10.0:1773851890.338708:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.338708:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 1
00000400:00000200:10.0:1773851890.338709:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.338710:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000400:00000200:10.0:1773851890.338711:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 3
00000400:00000200:10.0:1773851890.338712:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15611@kfi7 to cpt 5
00000400:00000200:10.0:1773851890.338712:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15611@kfi7 of length 224 into portal 12 MB=0x699de8c4b7b00
00000400:00000200:10.0:1773851890.338713:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15611@kfi7 of length 224/224 into md 0x78146ce49 [64] + 154072
00000800:00000200:10.0:1773851890.338715:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851890.338717:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851890.338718:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15610@kfi7: PUT: OK
00000100:00000001:10.0:1773851890.338719:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851890.338719:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851890.338720:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008121a610.
00000100:00000040:10.0:1773851890.338720:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000008121a610 x1858030975810304 msgsize 224
00000100:00100000:10.0:1773851890.338722:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-15611@kfi7 (source: 12345-15610@kfi7)
00000100:00000001:10.0:1773851890.338723:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851890.338724:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000100:00000001:8.0:1773851890.338724:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851890.338725:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851890.338725:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851890.338729:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851890.338729:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851890.338729:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851890.338730:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030975810304
00000020:00000001:8.0:1773851890.338730:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851890.338731:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91111
00000020:00000001:8.0:1773851890.338731:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851890.338734:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006e19edfb refcount=6
00000020:00000001:8.0:1773851890.338735:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240326144 : -107152469225472 : ffff9e8b9f229000)
00000020:00000001:8.0:1773851890.338735:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240326144 : -107152469225472 : ffff9e8b9f229000)
00000100:00000001:8.0:1773851890.338736:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851890.338737:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851890.338738:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000339c92f7.
00000020:00000010:8.0:1773851890.338738:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851890.338739:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851890.338740:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851890.338740:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851890.338740:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851890.338741:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851890.338742:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851890.338742:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.338743:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851890.338744:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851890.338744:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851890.338745:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15611@kfi7, seq: 2130843
00000100:00000040:8.0:1773851890.338746:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006e19edfb : new rpc_count 1
00000100:00000001:8.0:1773851890.338746:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087746048 : -106944621805568 : ffff9ebc03ce8000)
00000100:00000040:8.0:1773851890.338747:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008121a610 x1858030975810304/t0(0) o400->834e87a7-d005-4763-b887-76752340d3ef@15611@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne229-0'
00000100:00000001:8.0:1773851890.338750:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851890.338751:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851890.338752:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008121a610 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:834e87a7-d005-4763-b887-76752340d3ef+6:47850:x1858030975810304:12345-15611@kfi7:400:default-tuolumne229-0
00000100:00000200:8.0:1773851890.338753:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030975810304
00000020:00000001:8.0:1773851890.338753:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851890.338754:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851890.338754:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338755:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851890.338755:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851890.338756:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851890.338756:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030975810304, found 0 last_xid 1858030975810303
00000020:00000001:8.0:1773851890.338757:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851890.338758:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851890.338758:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851890.338759:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338760:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851890.338760:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851890.338761:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851890.338762:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f90d8293.
02000000:00000001:8.0:1773851890.338762:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.338763:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338763:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851890.338764:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768033, transno 0, xid 1858030975810304
00010000:00000001:8.0:1773851890.338764:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851890.338765:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008121a610 x1858030975810304/t0(0) o400->834e87a7-d005-4763-b887-76752340d3ef@15611@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne229-0'
00010000:00000001:8.0:1773851890.338767:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851890.338768:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851890.338768:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=123 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851890.338769:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851890.338770:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000834ea769 refcount 5 to 15611@kfi7
00000100:00000001:8.0:1773851890.338770:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957451904 : -107146752099712 : ffff9e8cf3e6fa80)
02000000:00000001:8.0:1773851890.338772:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851890.338772:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.338773:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851890.338774:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15610@kfi7
00000400:00000010:8.0:1773851890.338774:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3e9aeb1.
00000100:00000200:8.0:1773851890.338775:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030975810304, offset 224
00000400:00000200:8.0:1773851890.338776:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15610@kfi7
00000400:00000200:8.0:1773851890.338777:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:8.0:1773851890.338778:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 1
00000400:00000200:8.0:1773851890.338778:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000400:00000200:8.0:1773851890.338780:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 3
00000400:00000200:8.0:1773851890.338781:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15610@kfi7 local destination
00000400:00000200:8.0:1773851890.338782:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769973:8769973:1024:4294967295] 15610@kfi7 LPNI seq info [24386:24386:16:4294967295]
00000400:00000200:8.0:1773851890.338783:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000400:00000200:8.0:1773851890.338784:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15610@kfi7 to cpt 2
00000400:00000200:8.0:1773851890.338786:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15610@kfi7(15610@kfi7:15610@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851890.338787:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 3
00000800:00000200:8.0:1773851890.338788:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851890.338789:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851890.338791:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851890.338793:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2a3 Using peer 15610@kfi7(0x2a3)
00000800:00000200:8.0:1773851890.338796:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x2a3: rc=0
00000800:00000200:8.0:1773851890.338797:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851890.338799:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851890.338800:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000834ea769 refcount 4 to 15611@kfi7
00010000:00000001:8.0:1773851890.338801:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851890.338801:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.338802:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851890.338803:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008121a610 x1858030975810304/t0(0) o400->834e87a7-d005-4763-b887-76752340d3ef@15611@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne229-0'
00000100:00100000:8.0:1773851890.338806:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008121a610 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:834e87a7-d005-4763-b887-76752340d3ef+6:47850:x1858030975810304:12345-15611@kfi7:400:default-tuolumne229-0 Request processed in 55us (84us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851890.338809:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15611@kfi7, seq: 2130843
00000100:00000040:8.0:1773851890.338810:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006e19edfb : new rpc_count 0
00000100:00000001:8.0:1773851890.338811:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851890.338811:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851890.338811:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851890.338812:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851890.338813:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000339c92f7.
00000020:00000040:8.0:1773851890.338813:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000006e19edfb : new refcount 5
00000100:00000001:8.0:1773851890.338814:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851890.338819:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2a3 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851890.338820:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851890.338821:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15610@kfi7: PUT: OK
00000400:00000200:10.0:1773851890.338822:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3e9aeb1
00000400:00000010:10.0:1773851890.338822:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3e9aeb1.
00000100:00000001:10.0:1773851890.338823:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851890.338823:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851890.338824:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042e3c656 nid 15610@kfi7 refs 2
00000800:00000200:10.0:1773851890.338825:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 15610@kfi7(000000005ea03526):0x0 lsk 676 rsk 88 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2a3 Transaction freed
00000800:00000200:17.0:1773851890.410211:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851890.410212:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851890.410215:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851890.410219:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851890.410223:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.410225:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22266@kfi7 : PUT - for me
00000400:00000200:17.0:1773851890.410227:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.410228:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 1
00000400:00000200:17.0:1773851890.410230:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.410231:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000400:00000200:17.0:1773851890.410233:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 3
00000400:00000200:17.0:1773851890.410235:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.410236:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22266@kfi7 of length 224 into portal 12 MB=0x699de8d0afac0
00000400:00000200:17.0:1773851890.410239:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22266@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 39376
00000800:00000200:17.0:1773851890.410242:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851890.410245:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.410247:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22266@kfi7: PUT: OK
00000100:00000001:17.0:1773851890.410249:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851890.410250:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851890.410252:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b7f6aee8.
00000100:00000040:17.0:1773851890.410253:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000b7f6aee8 x1858030988360384 msgsize 224
00000100:00100000:17.0:1773851890.410256:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22266@kfi7 (source: 12345-22266@kfi7)
00000100:00000001:17.0:1773851890.410259:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851890.410260:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000100:00000001:16.0:1773851890.410262:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851890.410263:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2069@kfi7:4 <- 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851890.410264:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851890.410264:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851890.410265:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851890.410267:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851890.410268:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030988360384
00000020:00000001:16.0:1773851890.410270:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851890.410271:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912ae
00000020:00000001:16.0:1773851890.410272:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851890.410275:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000ce3e864 refcount=6
00000020:00000001:16.0:1773851890.410277:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716197376 : -107155993354240 : ffff9e8acd14a000)
00000020:00000001:16.0:1773851890.410279:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716197376 : -107155993354240 : ffff9e8acd14a000)
00000100:00000001:16.0:1773851890.410280:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851890.410282:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851890.410283:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ea3653dd.
00000020:00000010:16.0:1773851890.410285:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851890.410286:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000096f6d53.
00000100:00000001:16.0:1773851890.410288:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851890.410289:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851890.410290:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851890.410292:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851890.410293:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851890.410293:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.410295:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851890.410298:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851890.410298:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851890.410299:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851890.410299:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851890.410301:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22266@kfi7, seq: 2156408
00000100:00000001:17.0:1773851890.410302:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.410302:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000ce3e864 : new rpc_count 1
00000100:00000001:16.0:1773851890.410303:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968771584 : -106974740780032 : ffff9eb500936c00)
00000100:00000001:17.0:1773851890.410304:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.410306:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b7f6aee8 x1858030988360384/t0(0) o400->342477c9-0c6d-4683-860c-89c5961d8c63@22266@kfi7:530/0 lens 224/0 e 0 to 0 dl 1773852645 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne255-0'
00000100:00000001:16.0:1773851890.410311:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851890.410312:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851890.410314:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b7f6aee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:342477c9-0c6d-4683-860c-89c5961d8c63+6:47673:x1858030988360384:12345-22266@kfi7:400:default-tuolumne255-0
00000100:00000200:16.0:1773851890.410317:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030988360384
00000020:00000001:16.0:1773851890.410318:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851890.410319:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851890.410321:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.410322:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851890.410323:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851890.410324:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851890.410325:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030988360384, found 0 last_xid 1858030988360383
00000020:00000001:16.0:1773851890.410326:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851890.410327:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851890.410328:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851890.410329:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.410330:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851890.410331:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851890.410332:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851890.410333:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a8d4e603.
02000000:00000001:16.0:1773851890.410334:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.410335:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.410335:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851890.410336:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768323, transno 0, xid 1858030988360384
00010000:00000001:16.0:1773851890.410337:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851890.410338:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b7f6aee8 x1858030988360384/t0(0) o400->342477c9-0c6d-4683-860c-89c5961d8c63@22266@kfi7:530/0 lens 224/224 e 0 to 0 dl 1773852645 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne255-0'
00010000:00000001:16.0:1773851890.410341:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851890.410342:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851890.410343:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=123 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851890.410344:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851890.410345:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b1bb0ffd refcount 5 to 22266@kfi7
00000100:00000001:16.0:1773851890.410346:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363995008 : -107142345556608 : ffff9e8dfa8d7d80)
02000000:00000001:16.0:1773851890.410347:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851890.410348:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.410349:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851890.410350:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22266@kfi7
00000400:00000010:16.0:1773851890.410350:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c89dd537.
00000100:00000200:16.0:1773851890.410351:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030988360384, offset 224
00000400:00000200:16.0:1773851890.410353:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22266@kfi7
00000400:00000200:16.0:1773851890.410354:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:16.0:1773851890.410355:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 1
00000400:00000200:16.0:1773851890.410356:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000400:00000200:16.0:1773851890.410358:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 3
00000400:00000200:16.0:1773851890.410359:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22266@kfi7 local destination
00000400:00000200:16.0:1773851890.410361:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769974:8769974:1024:4294967295] 22266@kfi7 LPNI seq info [28028:28028:16:4294967295]
00000400:00000200:16.0:1773851890.410362:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000400:00000200:16.0:1773851890.410363:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:16.0:1773851890.410365:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22266@kfi7(22266@kfi7:22266@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851890.410367:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 3
00000800:00000200:16.0:1773851890.410369:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851890.410370:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851890.410372:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851890.410375:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b3 Using peer 22266@kfi7(0x5b3)
00000800:00000200:16.0:1773851890.410378:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x5b3: rc=0
00000800:00000200:16.0:1773851890.410380:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851890.410382:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.410383:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b1bb0ffd refcount 4 to 22266@kfi7
00010000:00000001:16.0:1773851890.410384:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851890.410385:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.410385:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851890.410386:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b7f6aee8 x1858030988360384/t0(0) o400->342477c9-0c6d-4683-860c-89c5961d8c63@22266@kfi7:530/0 lens 224/224 e 0 to 0 dl 1773852645 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne255-0'
00000100:00100000:16.0:1773851890.410394:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b7f6aee8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:342477c9-0c6d-4683-860c-89c5961d8c63+6:47673:x1858030988360384:12345-22266@kfi7:400:default-tuolumne255-0 Request processed in 82us (140us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851890.410397:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22266@kfi7, seq: 2156408
00000100:00000040:16.0:1773851890.410398:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000ce3e864 : new rpc_count 0
00000100:00000001:16.0:1773851890.410399:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851890.410399:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851890.410400:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851890.410401:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000096f6d53.
00000020:00000010:16.0:1773851890.410402:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ea3653dd.
00000020:00000040:16.0:1773851890.410403:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000000ce3e864 : new refcount 5
00000100:00000001:16.0:1773851890.410403:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851890.410409:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b3 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851890.410411:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.410412:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22266@kfi7: PUT: OK
00000400:00000200:17.0:1773851890.410413:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c89dd537
00000400:00000010:17.0:1773851890.410414:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c89dd537.
00000100:00000001:17.0:1773851890.410415:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851890.410415:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851890.410416:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d3363d30 nid 22266@kfi7 refs 2
00000800:00000200:17.0:1773851890.410418:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2069@kfi7:4 -> 22266@kfi7(0000000052069ed0):0x0 lsk 1460 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b3 Transaction freed
00000800:00000200:9.0:1773851890.425988:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851890.425989:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851890.425991:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851890.425993:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851890.425995:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21794@kfi7 to cpt 2
00000400:00000200:9.0:1773851890.425996:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21794@kfi7 : PUT - for me
00000400:00000200:9.0:1773851890.425997:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21794@kfi7 to cpt 2
00000400:00000200:9.0:1773851890.425998:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bd8fb77 nid 21794@kfi7 refs 1
00000400:00000200:9.0:1773851890.425999:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21794@kfi7 to cpt 2
00000400:00000200:9.0:1773851890.426000:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bd8fb77 nid 21794@kfi7 refs 2
00000400:00000200:9.0:1773851890.426001:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007bd8fb77 nid 21794@kfi7 refs 3
00000400:00000200:9.0:1773851890.426002:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21987@kfi7 to cpt 0
00000400:00000200:9.0:1773851890.426003:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21987@kfi7 of length 224 into portal 12 MB=0x699e1386490c0
00000400:00000200:9.0:1773851890.426004:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21987@kfi7 of length 224/224 into md 0x78146ce49 [64] + 154296
00000800:00000200:9.0:1773851890.426006:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851890.426008:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851890.426009:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21794@kfi7: PUT: OK
00000100:00000001:9.0:1773851890.426010:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851890.426010:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851890.426011:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000208acd37.
00000100:00000040:9.0:1773851890.426012:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000208acd37 x1858042453070016 msgsize 224
00000100:00100000:9.0:1773851890.426014:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21987@kfi7 (source: 12345-21794@kfi7)
00000100:00000001:9.0:1773851890.426015:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851890.426016:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007bd8fb77 nid 21794@kfi7 refs 2
00000100:00000001:8.0:1773851890.426016:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851890.426017:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851890.426017:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851890.426017:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851890.426018:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851890.426019:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851890.426020:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042453070016
00000020:00000001:8.0:1773851890.426020:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851890.426020:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac928e9
00000020:00000001:8.0:1773851890.426021:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851890.426024:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001e77b9c1 refcount=6
00000020:00000001:8.0:1773851890.426025:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742955008 : -107128966596608 : ffff9e9118003800)
00000020:00000001:8.0:1773851890.426026:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742955008 : -107128966596608 : ffff9e9118003800)
00000100:00000001:8.0:1773851890.426027:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851890.426027:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851890.426028:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000339c92f7.
00000020:00000010:8.0:1773851890.426029:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851890.426030:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851890.426031:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851890.426031:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851890.426032:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851890.426033:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851890.426033:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851890.426034:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.426035:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851890.426036:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851890.426036:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851890.426037:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851890.426037:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851890.426038:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851890.426038:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21987@kfi7, seq: 2130844
00000100:00000040:8.0:1773851890.426038:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001e77b9c1 : new rpc_count 1
00000100:00000001:9.0:1773851890.426039:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.426039:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856906112 : -106914852645504 : ffff9ec2f22fd580)
00000100:00000040:8.0:1773851890.426040:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000208acd37 x1858042453070016/t0(0) o400->403e22ae-e09e-4f96-be6f-b0a24e6103ea@21987@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1851-0'
00000100:00000001:8.0:1773851890.426043:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851890.426043:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851890.426044:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000208acd37 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:403e22ae-e09e-4f96-be6f-b0a24e6103ea+6:39820:x1858042453070016:12345-21987@kfi7:400:default-tuolumne1851-0
00000100:00000200:8.0:1773851890.426046:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042453070016
00000020:00000001:8.0:1773851890.426046:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851890.426047:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851890.426048:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.426049:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851890.426049:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851890.426050:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851890.426050:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042453070016, found 0 last_xid 1858042453070015
00000020:00000001:8.0:1773851890.426051:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851890.426052:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851890.426053:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851890.426053:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.426054:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851890.426054:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851890.426055:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851890.426056:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000531fe3fc.
02000000:00000001:8.0:1773851890.426057:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.426057:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.426059:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851890.426059:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044110940, transno 0, xid 1858042453070016
00010000:00000001:8.0:1773851890.426060:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851890.426061:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000208acd37 x1858042453070016/t0(0) o400->403e22ae-e09e-4f96-be6f-b0a24e6103ea@21987@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1851-0'
00010000:00000001:8.0:1773851890.426063:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851890.426064:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851890.426065:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=123 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851890.426066:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851890.426066:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036a66fab refcount 3 to 21987@kfi7
00000100:00000001:8.0:1773851890.426067:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050720 : -107154804500896 : ffff9e8b13f11660)
02000000:00000001:8.0:1773851890.426068:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851890.426068:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.426069:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851890.426070:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21794@kfi7
00000400:00000010:8.0:1773851890.426070:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042ed2e1b.
00000100:00000200:8.0:1773851890.426071:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042453070016, offset 224
00000400:00000200:8.0:1773851890.426073:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21794@kfi7
00000400:00000200:8.0:1773851890.426074:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21794@kfi7 to cpt 2
00000400:00000200:8.0:1773851890.426075:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bd8fb77 nid 21794@kfi7 refs 1
00000400:00000200:8.0:1773851890.426076:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007bd8fb77 nid 21794@kfi7 refs 2
00000400:00000200:8.0:1773851890.426077:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007bd8fb77 nid 21794@kfi7 refs 3
00000400:00000200:8.0:1773851890.426078:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21794@kfi7 local destination
00000400:00000200:8.0:1773851890.426079:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769975:8769975:1024:4294967295] 21794@kfi7 LPNI seq info [377923:377923:16:4294967295]
00000400:00000200:8.0:1773851890.426080:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007bd8fb77 nid 21794@kfi7 refs 2
00000400:00000200:8.0:1773851890.426081:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21794@kfi7 to cpt 2
00000400:00000200:8.0:1773851890.426083:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21794@kfi7(21794@kfi7:21794@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851890.426084:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007bd8fb77 nid 21794@kfi7 refs 3
00000800:00000200:8.0:1773851890.426086:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851890.426087:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851890.426089:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851890.426092:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7f Using peer 21794@kfi7(0xe7f)
00000800:00000200:8.0:1773851890.426094:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0xe7f: rc=0
00000800:00000200:8.0:1773851890.426096:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851890.426098:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851890.426099:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036a66fab refcount 2 to 21987@kfi7
00010000:00000001:8.0:1773851890.426100:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851890.426100:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851890.426101:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851890.426101:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000208acd37 x1858042453070016/t0(0) o400->403e22ae-e09e-4f96-be6f-b0a24e6103ea@21987@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1851-0'
00000100:00100000:8.0:1773851890.426106:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000208acd37 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:403e22ae-e09e-4f96-be6f-b0a24e6103ea+6:39820:x1858042453070016:12345-21987@kfi7:400:default-tuolumne1851-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851890.426108:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21987@kfi7, seq: 2130844
00000100:00000040:8.0:1773851890.426109:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001e77b9c1 : new rpc_count 0
00000100:00000001:8.0:1773851890.426109:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851890.426110:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851890.426111:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851890.426111:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851890.426112:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000339c92f7.
00000020:00000040:8.0:1773851890.426113:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000001e77b9c1 : new refcount 5
00000100:00000001:8.0:1773851890.426113:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851890.426118:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7f TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851890.426120:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851890.426121:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21794@kfi7: PUT: OK
00000400:00000200:9.0:1773851890.426122:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042ed2e1b
00000400:00000010:9.0:1773851890.426123:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042ed2e1b.
00000100:00000001:9.0:1773851890.426124:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851890.426124:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851890.426125:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007bd8fb77 nid 21794@kfi7 refs 2
00000800:00000200:9.0:1773851890.426127:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 21794@kfi7(00000000b684682a):0x0 lsk 3712 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7f Transaction freed
00000800:00000200:18.0:1773851890.505173:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851890.505174:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851890.505175:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851890.505177:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851890.505178:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9490@kfi7 to cpt 4
00000400:00000200:18.0:1773851890.505179:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9490@kfi7 : PUT - for me
00000400:00000200:18.0:1773851890.505180:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9490@kfi7 to cpt 4
00000400:00000200:18.0:1773851890.505181:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f923ff3 nid 9490@kfi7 refs 1
00000400:00000200:18.0:1773851890.505182:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9490@kfi7 to cpt 4
00000400:00000200:18.0:1773851890.505183:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f923ff3 nid 9490@kfi7 refs 2
00000400:00000200:18.0:1773851890.505184:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004f923ff3 nid 9490@kfi7 refs 3
00000400:00000200:18.0:1773851890.505184:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9682@kfi7 to cpt 7
00000400:00000200:18.0:1773851890.505185:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9682@kfi7 of length 224 into portal 12 MB=0x69aa079d6aac0
00000400:00000200:18.0:1773851890.505187:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9682@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 39600
00000800:00000200:18.0:1773851890.505189:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851890.505190:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851890.505191:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9490@kfi7: PUT: OK
00000100:00000001:18.0:1773851890.505192:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851890.505193:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851890.505194:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000106c7788.
00000100:00000040:18.0:1773851890.505194:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000106c7788 x1858863889820352 msgsize 224
00000100:00100000:18.0:1773851890.505196:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-9682@kfi7 (source: 12345-9490@kfi7)
00000100:00000001:18.0:1773851890.505197:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851890.505198:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004f923ff3 nid 9490@kfi7 refs 2
00000100:00000001:16.0:1773851890.505198:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851890.505199:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851890.505199:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851890.505200:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851890.505200:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851890.505201:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851890.505202:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863889820352
00000020:00000001:16.0:1773851890.505202:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851890.505203:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9120d
00000020:00000001:16.0:1773851890.505203:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851890.505205:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f3aeda3c refcount=6
00000020:00000001:16.0:1773851890.505206:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240519680 : -107152469031936 : ffff9e8b9f258400)
00000020:00000001:16.0:1773851890.505207:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240519680 : -107152469031936 : ffff9e8b9f258400)
00000100:00000001:16.0:1773851890.505208:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851890.505209:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851890.505209:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005f7e8414.
00000020:00000010:16.0:1773851890.505211:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851890.505212:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000096f6d53.
00000100:00000001:16.0:1773851890.505212:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851890.505213:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851890.505213:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851890.505214:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851890.505215:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851890.505215:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.505217:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851890.505218:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851890.505218:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851890.505219:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:16.0:1773851890.505219:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9682@kfi7, seq: 2156409
00000100:00000001:17.0:1773851890.505220:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:16.0:1773851890.505220:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f3aeda3c : new rpc_count 1
00000100:00000001:17.0:1773851890.505221:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.505221:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058610001152 : -107015099550464 : ffff9eab9b017500)
00000100:00000001:17.0:1773851890.505222:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.505222:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000106c7788 x1858863889820352/t0(0) o400->1203e31c-b4b2-4090-8867-46b06dfc8f4e@9682@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1093-0'
00000100:00000001:16.0:1773851890.505225:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851890.505225:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851890.505226:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000106c7788 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1203e31c-b4b2-4090-8867-46b06dfc8f4e+6:38991:x1858863889820352:12345-9682@kfi7:400:default-tuolumne1093-0
00000100:00000200:16.0:1773851890.505228:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863889820352
00000020:00000001:16.0:1773851890.505228:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851890.505229:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851890.505230:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.505230:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851890.505231:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851890.505232:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851890.505232:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863889820352, found 0 last_xid 1858863889820351
00000020:00000001:16.0:1773851890.505233:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851890.505234:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851890.505234:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851890.505235:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.505235:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851890.505236:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851890.505237:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851890.505237:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000651b485a.
02000000:00000001:16.0:1773851890.505238:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.505239:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.505239:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851890.505240:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475272760, transno 0, xid 1858863889820352
00010000:00000001:16.0:1773851890.505241:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851890.505242:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000106c7788 x1858863889820352/t0(0) o400->1203e31c-b4b2-4090-8867-46b06dfc8f4e@9682@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1093-0'
00010000:00000001:16.0:1773851890.505244:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851890.505245:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851890.505246:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=123 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851890.505247:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851890.505247:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006214d0d0 refcount 3 to 9682@kfi7
00000100:00000001:16.0:1773851890.505248:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065184 : -107155994486432 : ffff9e8acd035960)
02000000:00000001:16.0:1773851890.505249:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851890.505249:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.505250:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851890.505251:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9490@kfi7
00000400:00000010:16.0:1773851890.505252:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cbd52aa0.
00000100:00000200:16.0:1773851890.505252:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863889820352, offset 224
00000400:00000200:16.0:1773851890.505254:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9490@kfi7
00000400:00000200:16.0:1773851890.505254:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9490@kfi7 to cpt 4
00000400:00000200:16.0:1773851890.505255:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f923ff3 nid 9490@kfi7 refs 1
00000400:00000200:16.0:1773851890.505256:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004f923ff3 nid 9490@kfi7 refs 2
00000400:00000200:16.0:1773851890.505258:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004f923ff3 nid 9490@kfi7 refs 3
00000400:00000200:16.0:1773851890.505259:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9490@kfi7 local destination
00000400:00000200:16.0:1773851890.505260:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769976:8769976:1024:4294967295] 9490@kfi7 LPNI seq info [17410:17410:16:4294967295]
00000400:00000200:16.0:1773851890.505262:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004f923ff3 nid 9490@kfi7 refs 2
00000400:00000200:16.0:1773851890.505262:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9490@kfi7 to cpt 4
00000400:00000200:16.0:1773851890.505264:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9490@kfi7(9490@kfi7:9490@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851890.505265:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004f923ff3 nid 9490@kfi7 refs 3
00000800:00000200:16.0:1773851890.505267:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851890.505268:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851890.505270:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851890.505272:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000190 Using peer 9490@kfi7(0x100000000000190)
00000800:00000200:16.0:1773851890.505275:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x100000000000190: rc=0
00000800:00000200:16.0:1773851890.505277:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000190 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851890.505279:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.505280:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006214d0d0 refcount 2 to 9682@kfi7
00010000:00000001:16.0:1773851890.505281:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851890.505281:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.505282:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851890.505283:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000106c7788 x1858863889820352/t0(0) o400->1203e31c-b4b2-4090-8867-46b06dfc8f4e@9682@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1093-0'
00000100:00100000:16.0:1773851890.505287:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000106c7788 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:1203e31c-b4b2-4090-8867-46b06dfc8f4e+6:38991:x1858863889820352:12345-9682@kfi7:400:default-tuolumne1093-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851890.505290:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9682@kfi7, seq: 2156409
00000100:00000040:16.0:1773851890.505291:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f3aeda3c : new rpc_count 0
00000100:00000001:16.0:1773851890.505291:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851890.505292:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851890.505293:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851890.505293:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000096f6d53.
00000020:00000010:16.0:1773851890.505294:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005f7e8414.
00000020:00000040:16.0:1773851890.505295:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000f3aeda3c : new refcount 5
00000100:00000001:16.0:1773851890.505296:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851890.505301:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000190 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851890.505302:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851890.505303:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9490@kfi7: PUT: OK
00000400:00000200:18.0:1773851890.505304:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cbd52aa0
00000400:00000010:18.0:1773851890.505304:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cbd52aa0.
00000100:00000001:18.0:1773851890.505305:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851890.505305:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851890.505306:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004f923ff3 nid 9490@kfi7 refs 2
00000800:00000200:18.0:1773851890.505308:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 9490@kfi7(0000000086f2d041):0x0 lsk 401 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000190 Transaction freed
00000004:00000001:8.0:1773851890.505732:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851890.505732:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851890.505733:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:6.0:1773851890.505733:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:4.0:1773851890.505733:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:16.0:1773851890.505734:0:61342:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000100:00000010:8.0:1773851890.505734:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec171328.
00000100:00000010:6.0:1773851890.505734:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000562ee10a.
00000004:00000020:4.0:1773851890.505734:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:4.0:1773851890.505734:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ece8016.
00000004:00000001:0.0:1773851890.505734:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:0.0:1773851890.505734:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851890.505735:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851890.505735:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:8.0:1773851890.505735:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
00000020:00000040:4.0:1773851890.505735:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000100:00000010:0.0:1773851890.505735:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc6defe8.
00000100:00000010:29.0:1773851890.505736:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005aed8c46.
00000100:00000001:8.0:1773851890.505736:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:6.0:1773851890.505736:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000020:00000040:29.0:1773851890.505737:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000004:00000001:28.0:1773851890.505737:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
02000000:00000001:8.0:1773851890.505737:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851890.505737:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851890.505737:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851890.505737:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851890.505737:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:0.0:1773851890.505737:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000100:00000001:29.0:1773851890.505738:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:28.0:1773851890.505738:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:6.0:1773851890.505738:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851890.505738:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.505738:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851890.505739:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:28.0:1773851890.505739:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000057c38d87.
02000000:00000001:8.0:1773851890.505739:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851890.505739:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000c0831f5b.
02000000:00000010:4.0:1773851890.505739:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000022c33118.
02000000:00000001:0.0:1773851890.505739:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851890.505740:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:28.0:1773851890.505740:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000100:00000001:6.0:1773851890.505740:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.505740:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851890.505740:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851890.505741:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:8.0:1773851890.505741:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:6.0:1773851890.505741:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851890.505741:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:29.0:1773851890.505742:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
02000000:00000001:28.0:1773851890.505742:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851890.505742:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851890.505742:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.505742:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851890.505742:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d8f54850.
00000100:00000001:29.0:1773851890.505743:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851890.505743:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.505743:0:61342:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +356s
00000100:00000001:8.0:1773851890.505743:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:4.0:1773851890.505743:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005ece8016] to pc [ptlrpcd_01_00+0]  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851890.505743:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851890.505744:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:28.0:1773851890.505744:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000055279eb9.
00000100:00001000:16.0:1773851890.505744:0:61342:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000100:00000001:8.0:1773851890.505744:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851890.505744:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000562ee10a] to pc [ptlrpcd_01_01+1]  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851890.505744:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851890.505745:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851890.505745:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851890.505745:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ec171328] to pc [ptlrpcd_02_02+2]  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851890.505745:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851890.505746:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005aed8c46] to pc [ptlrpcd_07_02+2]  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851890.505746:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:16.0:1773851890.505746:0:61342:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000001:28.0:1773851890.505747:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851890.505747:0:61342:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -158s) for 163+30  req@000000006cd58f25 x1859602589898304/t0(0) o49->2be967ae-f4b5-4e09-8b0b-2a9c638f7ec7@22579@kfi7:535/0 lens 480/0 e 3 to 0 dl 1773851895 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111561828695040'
00000100:00000040:0.0:1773851890.505747:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000cc6defe8] to pc [ptlrpcd_00_02+2]  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851890.505748:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000057c38d87] to pc [ptlrpcd_07_03+3]  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851890.505748:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:4.0:1773851890.505748:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851890.505749:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:6.0:1773851890.505749:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000041b69c20.
00000100:00000001:5.0:1773851890.505749:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851890.505749:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:4.0:1773851890.505749:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f3d94c91.
00000100:00000001:11.0:1773851890.505750:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:8.0:1773851890.505750:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851890.505750:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851890.505750:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851890.505750:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636959997221888 : -107113712329728 : ffff9e94a539dc00)
00000100:00000001:5.0:1773851890.505750:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:4.0:1773851890.505750:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637104660042752 : -106969049508864 : ffff9eb653cd5400)
00000004:00000001:29.0:1773851890.505751:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505751:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851890.505751:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851890.505751:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008f1b9b08.
00080000:00000001:8.0:1773851890.505751:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637000503778304 : -107073205773312 : ffff9e9e139adc00)
00000100:00000040:7.0:1773851890.505751:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851890.505751:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:5.0:1773851890.505751:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:4.0:1773851890.505751:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000001:0.0:1773851890.505751:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505752:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851890.505752:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:10.0:1773851890.505752:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851890.505752:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851890.505752:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505753:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851890.505753:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:30.0:1773851890.505753:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:28.0:1773851890.505753:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00001000:16.0:1773851890.505753:0:61342:0:(import.c:1951:at_measured()) add 188 to 00000000e41c26a6 time=144 v=163 (163 0 0 0)
00000100:00000040:11.0:1773851890.505753:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851890.505753:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851890.505753:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:6.0:1773851890.505753:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00000004:00000010:6.0:1773851890.505753:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001393a471.
00000100:00000001:5.0:1773851890.505753:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:4.0:1773851890.505753:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000100:00000001:2.0:1773851890.505753:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851890.505753:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:31.0:1773851890.505754:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851890.505754:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:28.0:1773851890.505754:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a72a513e.
00080000:00000001:28.0:1773851890.505754:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637121304805376 : -106952404746240 : ffff9eba33e84000)
00000100:00001000:16.0:1773851890.505754:0:61342:0:(import.c:2016:at_measured()) AT 00000000e41c26a6 change: old=163 new=188 delta=25 (val=188) hist 188 0 0 0
00080000:00000001:8.0:1773851890.505754:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:8.0:1773851890.505754:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000100:00000001:7.0:1773851890.505754:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851890.505754:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:6.0:1773851890.505754:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614164959029956ns, next at 614165959028764ns, rc = 0
00000100:00000001:5.0:1773851890.505754:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851890.505754:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:4.0:1773851890.505754:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b2ad7610.
00000004:00080000:4.0:1773851890.505754:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614164959030027ns, next at 614165959028894ns, rc = 0
00000100:00000001:2.0:1773851890.505754:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851890.505754:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851890.505754:0:41062:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:30.0:1773851890.505755:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851890.505755:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000010:8.0:1773851890.505755:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001616f815.
02000000:00000001:7.0:1773851890.505755:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851890.505755:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851890.505755:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:8.0:1773851890.505756:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614164959031710ns, next at 614165959030558ns, rc = 0
00000100:00100000:7.0:1773851890.505756:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000562ee10a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051937728:46@kfi7:13:default-yuba2-0
00080000:00000001:6.0:1773851890.505756:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851890.505756:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ece8016 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051937664:2085@kfi7:13:default-yuba2-0
00080000:00000001:4.0:1773851890.505756:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:4.0:1773851890.505756:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851890.505756:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851890.505757:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:30.0:1773851890.505757:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851890.505757:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851890.505757:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000100:00000010:16.0:1773851890.505757:0:61342:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000caa5ad98.
00000100:00000001:11.0:1773851890.505757:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:8.0:1773851890.505757:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:7.0:1773851890.505757:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:6.0:1773851890.505757:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505757:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:4.0:1773851890.505757:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505758:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:28.0:1773851890.505758:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f23318d1.
00000100:00000001:11.0:1773851890.505758:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851890.505758:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851890.505758:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851890.505758:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851890.505758:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851890.505758:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851890.505759:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:28.0:1773851890.505759:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614164959034325ns, next at 614165959033363ns, rc = 0
00000100:00000010:16.0:1773851890.505759:0:61342:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 480 at 000000005f7e8414.
02000000:00000001:11.0:1773851890.505759:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000001:8.0:1773851890.505759:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851890.505759:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:5.0:1773851890.505759:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:1.0:1773851890.505759:0:41062:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:31.0:1773851890.505760:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851890.505760:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000020:00000001:16.0:1773851890.505760:0:61342:0:(genops.c:802:class_conn2export()) Process entered
02000000:00000001:11.0:1773851890.505760:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851890.505760:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006b18bdd4.
02000000:00000010:5.0:1773851890.505760:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000074d75e84.
00000100:00000001:1.0:1773851890.505760:0:41062:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851890.505761:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000057c38d87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051937984:2065@kfi7:13:default-yuba2-0
00080000:00000001:28.0:1773851890.505761:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851890.505761:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:16.0:1773851890.505761:0:61342:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7abc5
00000020:00000001:16.0:1773851890.505761:0:61342:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00100000:11.0:1773851890.505761:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec171328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051937792:2055@kfi7:13:default-yuba2-0
02000000:00000001:7.0:1773851890.505761:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851890.505761:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851890.505761:0:41062:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:30.0:1773851890.505762:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000200:7.0:1773851890.505762:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000010:7.0:1773851890.505762:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
02000000:00000001:1.0:1773851890.505762:0:41062:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505763:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851890.505763:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:30.0:1773851890.505763:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:16.0:1773851890.505763:0:61342:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ce28a53c refcount=407
00000100:00000001:11.0:1773851890.505763:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:7.0:1773851890.505763:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
00000400:00000200:5.0:1773851890.505763:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000010:5.0:1773851890.505763:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000573cf79c.
00000100:00100000:1.0:1773851890.505763:0:41062:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051937920:2057@kfi7:13:default-yuba2-0
02000000:00000001:31.0:1773851890.505764:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851890.505764:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:11.0:1773851890.505764:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851890.505764:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851890.505764:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937728, portal 4
00000400:00000010:5.0:1773851890.505764:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000690e571.
00000100:00000001:1.0:1773851890.505764:0:41062:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:31.0:1773851890.505765:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bb1c2bcd.
02000000:00000001:30.0:1773851890.505765:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000020:00000001:16.0:1773851890.505765:0:61342:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119298217984 : -106954411333632 : ffff9eb9bc4e2800)
02000000:00000001:11.0:1773851890.505765:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:7.0:1773851890.505765:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851890.505765:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814066944 : -107101895484672 : ffff9e9765909b00)
00000100:00000200:5.0:1773851890.505765:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937664, portal 4
02000000:00000001:1.0:1773851890.505765:0:41062:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851890.505766:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851890.505766:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851890.505766:0:61342:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119298217984 : -106954411333632 : ffff9eb9bc4e2800)
02000000:00000010:11.0:1773851890.505766:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000076e9752.
00000100:00000040:7.0:1773851890.505766:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851890.505766:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851890.505766:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528694912 : -106978180856704 : ffff9eb433880480)
02000000:00000001:1.0:1773851890.505766:0:41062:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:1.0:1773851890.505766:0:41062:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:31.0:1773851890.505767:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00100000:30.0:1773851890.505767:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005aed8c46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051937856:2056@kfi7:13:default-yuba2-0
00000100:00000040:16.0:1773851890.505767:0:61342:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 00000000ce28a53c : new rpc_count 9
02000000:00000001:11.0:1773851890.505767:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851890.505767:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851890.505768:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000400:00000010:31.0:1773851890.505768:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000001:16.0:1773851890.505768:0:61342:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:11.0:1773851890.505768:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
02000000:00000010:1.0:1773851890.505768:0:41062:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000cc9e4dfe.
00000100:00000200:31.0:1773851890.505769:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937984, portal 4
02000000:00000001:16.0:1773851890.505769:0:61342:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000001:7.0:1773851890.505769:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:1.0:1773851890.505769:0:41062:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505770:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851890.505770:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:16.0:1773851890.505770:0:61342:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a73103fc.
00000400:00000010:11.0:1773851890.505770:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000100:00000040:7.0:1773851890.505770:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000010:7.0:1773851890.505770:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000232fbe3.
00000100:00000001:5.0:1773851890.505770:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851890.505770:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000200:1.0:1773851890.505770:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:31.0:1773851890.505771:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324234752 : -106976385316864 : ffff9eb49e8dc800)
02000000:00000001:30.0:1773851890.505771:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:16.0:1773851890.505771:0:61342:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.505771:0:61342:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851890.505771:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2b33615.
00000100:00000200:7.0:1773851890.505771:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937728, offset 0
00000400:00000010:5.0:1773851890.505771:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b029fb74.
00000400:00000010:1.0:1773851890.505771:0:41062:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000031c34675.
00000100:00000040:31.0:1773851890.505772:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851890.505772:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851890.505772:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937792, portal 4
00000400:00000200:7.0:1773851890.505772:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000010:1.0:1773851890.505772:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d5fbcac.
02000000:00000001:30.0:1773851890.505773:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00010000:00000001:16.0:1773851890.505773:0:61342:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851890.505773:0:61342:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505773:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851890.505773:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491264384 : -107117218287232 : ffff9e93d4413180)
00000400:00000200:7.0:1773851890.505773:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000200:5.0:1773851890.505773:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937664, offset 0
00000100:00000200:1.0:1773851890.505773:0:41062:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937920, portal 4
00000100:00000001:16.0:1773851890.505774:0:61342:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000400:00000200:7.0:1773851890.505774:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:7.0:1773851890.505774:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:5.0:1773851890.505774:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000100:00000001:1.0:1773851890.505774:0:41062:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:1.0:1773851890.505774:0:41062:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203078272 : -107102506473344 : ffff9e974125a880)
00000100:00000001:31.0:1773851890.505775:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851890.505775:0:61342:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ff5c9ebe refcount 3 to 22579@kfi7
00000100:00000040:11.0:1773851890.505775:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851890.505776:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000010:31.0:1773851890.505776:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004e2b8359.
02000000:00000010:30.0:1773851890.505776:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f1ad06fd.
00000100:00000001:16.0:1773851890.505776:0:61342:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703744 : -107156155847872 : ffff9e8ac3652b40)
00000400:00000200:7.0:1773851890.505776:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000040:1.0:1773851890.505776:0:41062:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851890.505777:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937984, offset 0
02000000:00000001:30.0:1773851890.505777:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505777:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851890.505777:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
02000000:00000001:16.0:1773851890.505778:0:61342:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000040:11.0:1773851890.505778:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000200:31.0:1773851890.505779:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000400:00000200:30.0:1773851890.505779:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
02000000:00000001:16.0:1773851890.505779:0:61342:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:11.0:1773851890.505779:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ed9687dd.
00000400:00000200:7.0:1773851890.505779:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769975, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769976, p:4294967295, g:4294967295, h:1000]
00000100:00000001:1.0:1773851890.505779:0:41062:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851890.505780:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000010:30.0:1773851890.505780:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000001:16.0:1773851890.505780:0:61342:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:11.0:1773851890.505780:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937792, offset 0
00000400:00000200:7.0:1773851890.505780:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000040:1.0:1773851890.505780:0:41062:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000200:31.0:1773851890.505781:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000010:30.0:1773851890.505781:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000007302f25.
00000100:00000040:16.0:1773851890.505781:0:61342:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22771@kfi7
00000400:00000200:11.0:1773851890.505781:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:7.0:1773851890.505781:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000010:1.0:1773851890.505781:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001634e401.
00000400:00000200:31.0:1773851890.505782:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000010:16.0:1773851890.505782:0:61342:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006524e557.
00000400:00000200:11.0:1773851890.505782:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851890.505782:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000100:00000200:1.0:1773851890.505782:0:41062:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937920, offset 0
00000400:00000200:31.0:1773851890.505783:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000200:30.0:1773851890.505783:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051937856, portal 4
00000400:00000200:11.0:1773851890.505783:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:7.0:1773851890.505783:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769977:8769977:1024:4294967295] 46@kfi7 LPNI seq info [5403863:5403863:16:4294967295]
00000400:00000200:31.0:1773851890.505784:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000100:00000200:16.0:1773851890.505784:0:61342:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602589898304, offset 0
00000400:00000200:11.0:1773851890.505784:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:1.0:1773851890.505784:0:41062:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000100:00000001:30.0:1773851890.505785:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851890.505785:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130262225920 : -106943447325696 : ffff9ebc49cfa400)
00000400:00000200:7.0:1773851890.505785:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:7.0:1773851890.505785:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:1.0:1773851890.505785:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:31.0:1773851890.505786:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769977, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769976, p:4294967295, g:4294967295, h:1000]
00000400:00000200:16.0:1773851890.505786:0:61342:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22771@kfi7
00000400:00000200:11.0:1773851890.505786:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:5.0:1773851890.505786:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851890.505786:0:41062:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:11.0:1773851890.505787:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:1.0:1773851890.505787:0:41062:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851890.505788:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000040:30.0:1773851890.505788:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:16.0:1773851890.505788:0:61342:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000400:00000200:5.0:1773851890.505788:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:31.0:1773851890.505789:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851890.505789:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769977, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769976, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851890.505789:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:1.0:1773851890.505789:0:41062:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:31.0:1773851890.505790:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000400:00000200:16.0:1773851890.505790:0:61342:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 1
00000400:00000200:5.0:1773851890.505790:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851890.505790:0:41062:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:16.0:1773851890.505791:0:61342:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:11.0:1773851890.505791:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:5.0:1773851890.505791:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000400:00000200:31.0:1773851890.505792:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769978:8769978:1024:4294967295] 2065@kfi7 LPNI seq info [5402833:5402833:16:4294967295]
00000100:00000001:30.0:1773851890.505792:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:11.0:1773851890.505792:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:1.0:1773851890.505792:0:41062:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769977, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769978, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851890.505793:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:16.0:1773851890.505793:0:61342:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 3
00000400:00000200:11.0:1773851890.505793:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000200:5.0:1773851890.505793:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769977, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769978, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851890.505794:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000040:30.0:1773851890.505794:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000200:11.0:1773851890.505794:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769979:8769979:1024:4294967295] 2055@kfi7 LPNI seq info [5404674:5404674:16:4294967295]
00000400:00000200:16.0:1773851890.505795:0:61342:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22771@kfi7 local destination
00000400:00000200:5.0:1773851890.505795:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:1.0:1773851890.505795:0:41062:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000010:30.0:1773851890.505796:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ab75faba.
00000400:00000200:11.0:1773851890.505796:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:5.0:1773851890.505796:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:1.0:1773851890.505796:0:41062:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000200:30.0:1773851890.505797:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051937856, offset 0
00000400:00000200:11.0:1773851890.505797:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:5.0:1773851890.505797:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:1.0:1773851890.505797:0:41062:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:16.0:1773851890.505798:0:61342:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769980:8769980:1024:4294967295] 22771@kfi7 LPNI seq info [3370902:3370902:16:4294967295]
00000400:00000200:30.0:1773851890.505799:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000200:5.0:1773851890.505799:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769982:8769982:1023:4294967295] 2085@kfi7 LPNI seq info [5403244:5403244:16:4294967295]
00000400:00000200:1.0:1773851890.505799:0:41062:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769982:8769982:1023:4294967295] 2057@kfi7 LPNI seq info [5404111:5404111:16:4294967295]
00000400:00000200:30.0:1773851890.505801:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:16.0:1773851890.505801:0:61342:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:11.0:1773851890.505801:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851890.505801:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851890.505801:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:1.0:1773851890.505801:0:41062:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:11.0:1773851890.505802:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:7.0:1773851890.505802:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:5.0:1773851890.505802:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:1.0:1773851890.505802:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:30.0:1773851890.505803:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:16.0:1773851890.505803:0:61342:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22771@kfi7 to cpt 4
00000800:00000200:7.0:1773851890.505803:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:30.0:1773851890.505804:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:11.0:1773851890.505804:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:7.0:1773851890.505805:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851890.505805:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000800:00000200:11.0:1773851890.505806:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851890.505807:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:5.0:1773851890.505807:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:1.0:1773851890.505807:0:41062:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000800:00000200:7.0:1773851890.505808:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851890.505808:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:1.0:1773851890.505808:0:41062:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:30.0:1773851890.505809:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000400:00000200:16.0:1773851890.505809:0:61342:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22771@kfi7(22771@kfi7:22771@kfi7) <?> : PUT try# 0
00000800:00000200:11.0:1773851890.505809:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851890.505809:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851890.505810:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000800:00000200:1.0:1773851890.505810:0:41062:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:16.0:1773851890.505811:0:61342:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 3
00000400:00000200:30.0:1773851890.505812:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8769982, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8769980, p:4294967295, g:4294967295, h:1000]
00000800:00000200:5.0:1773851890.505812:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:1.0:1773851890.505812:0:41062:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851890.505813:0:61342:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:7.0:1773851890.505813:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x3df: rc=0
00000800:00000200:11.0:1773851890.505814:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000400:00000200:31.0:1773851890.505815:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000800:00000200:16.0:1773851890.505815:0:61342:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851890.505815:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:5.0:1773851890.505815:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Using peer 2085@kfi7(0x113)
00000800:00000200:1.0:1773851890.505815:0:41062:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851890.505816:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851890.505817:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:30.0:1773851890.505817:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:11.0:1773851890.505817:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000100:00000001:7.0:1773851890.505817:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851890.505817:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:1.0:1773851890.505817:0:41062:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000400:00000200:30.0:1773851890.505818:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000100:00000001:7.0:1773851890.505818:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851890.505818:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x113: rc=0
00000800:00000200:31.0:1773851890.505819:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:16.0:1773851890.505819:0:61342:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851890.505819:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851890.505819:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851890.505819:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851890.505820:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851890.505820:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769983:8769983:1021:4294967295] 2056@kfi7 LPNI seq info [5402404:5402404:16:4294967295]
00000100:00000001:7.0:1773851890.505820:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:5.0:1773851890.505820:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851890.505821:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851890.505821:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851890.505821:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851890.505821:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851890.505821:0:41062:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 324 bytes to peer 0x295: rc=0
00000100:00000001:11.0:1773851890.505822:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851890.505822:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851890.505822:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505822:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851890.505822:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851890.505823:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851890.505823:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:16.0:1773851890.505823:0:61342:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 Using peer 22771@kfi7(0x100000000000e21)
00000100:00000001:11.0:1773851890.505823:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851890.505823:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505823:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505823:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851890.505823:0:41062:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851890.505824:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:11.0:1773851890.505824:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505824:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851890.505824:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:31.0:1773851890.505825:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000100:00000001:11.0:1773851890.505825:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851890.505825:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851890.505825:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851890.505825:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851890.505825:0:41062:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851890.505825:0:41062:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851890.505826:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851890.505826:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505826:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851890.505826:0:41062:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505827:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851890.505827:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851890.505827:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851890.505827:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851890.505828:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000400:00000200:30.0:1773851890.505828:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000800:00000200:16.0:1773851890.505828:0:61342:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x100000000000e21: rc=0
00000100:00000001:11.0:1773851890.505828:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851890.505828:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851890.505828:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851890.505828:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851890.505829:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851890.505829:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:30.0:1773851890.505830:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000800:00000200:10.0:1773851890.505830:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851890.505830:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:1.0:1773851890.505830:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:1.0:1773851890.505830:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:31.0:1773851890.505831:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:16.0:1773851890.505831:0:61342:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851890.505831:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851890.505831:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000400:00000200:6.0:1773851890.505831:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000001:1.0:1773851890.505831:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851890.505831:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851890.505832:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b029fb74
00000400:00000010:7.0:1773851890.505832:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b029fb74.
00000100:00000001:1.0:1773851890.505832:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505833:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505833:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:30.0:1773851890.505833:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:10.0:1773851890.505833:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:7.0:1773851890.505833:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:6.0:1773851890.505833:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000232fbe3
00000400:00000010:6.0:1773851890.505833:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000232fbe3.
00000100:00000001:31.0:1773851890.505834:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.505834:0:61342:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851890.505834:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ed9687dd
00000400:00000010:10.0:1773851890.505834:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ed9687dd.
00000100:00000200:7.0:1773851890.505834:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851890.505834:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:31.0:1773851890.505835:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505835:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851890.505835:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:10.0:1773851890.505835:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851890.505835:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851890.505835:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851890.505836:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000200:10.0:1773851890.505836:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851890.505836:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851890.505837:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851890.505837:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:7.0:1773851890.505837:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851890.505837:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:1.0:1773851890.505837:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851890.505838:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851890.505838:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851890.505838:0:61342:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ff5c9ebe refcount 2 to 22579@kfi7
00000100:00000040:6.0:1773851890.505838:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851890.505838:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000100:00000001:31.0:1773851890.505839:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851890.505839:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000040:16.0:1773851890.505839:0:61342:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 00000000ce28a53c : new rpc_count 8
00000100:00000001:10.0:1773851890.505839:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851890.505839:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851890.505839:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001634e401
00000800:00000200:29.0:1773851890.505840:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000020:00000040:16.0:1773851890.505840:0:61342:0:(genops.c:882:class_export_put()) PUTting export 00000000ce28a53c : new refcount 406
00000100:00000040:10.0:1773851890.505840:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851890.505840:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:6.0:1773851890.505840:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:1.0:1773851890.505840:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001634e401.
00000100:00000001:1.0:1773851890.505840:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000010:16.0:1773851890.505841:0:61342:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 480 at 000000005f7e8414.
00000400:00000200:7.0:1773851890.505841:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:6.0:1773851890.505841:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:1.0:1773851890.505841:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851890.505842:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000010:16.0:1773851890.505842:0:61342:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000caa5ad98.
00000100:00000001:10.0:1773851890.505842:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851890.505842:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:30.0:1773851890.505843:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000400:00000200:29.0:1773851890.505843:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000001:16.0:1773851890.505843:0:61342:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851890.505843:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:7.0:1773851890.505843:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Transaction freed
00000800:00000200:6.0:1773851890.505843:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000400:00000200:29.0:1773851890.505844:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004e2b8359
00000400:00000010:29.0:1773851890.505844:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004e2b8359.
00000400:00000200:10.0:1773851890.505844:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:1.0:1773851890.505844:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851890.505845:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000040:16.0:1773851890.505845:0:61342:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +25s
00000800:00000200:10.0:1773851890.505845:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Transaction freed
00000100:00000040:1.0:1773851890.505845:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851890.505846:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:16.0:1773851890.505846:0:61342:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851890.505848:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bfd826e8: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000100:00000001:1.0:1773851890.505848:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851890.505849:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851890.505849:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851890.505849:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:30.0:1773851890.505850:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:1.0:1773851890.505850:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:1.0:1773851890.505851:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cc4d90e2: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000100:00000001:29.0:1773851890.505852:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851890.505852:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851890.505853:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:17.0:1773851890.505853:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851890.505854:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.505855:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851890.505855:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Transaction freed
00000400:00000200:17.0:1773851890.505855:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851890.505856:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851890.505856:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22771@kfi7: PUT: OK
00000400:00000200:17.0:1773851890.505857:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006524e557
00000400:00000010:17.0:1773851890.505857:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006524e557.
00000100:00000001:30.0:1773851890.505858:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.505858:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:17.0:1773851890.505859:0:2511435:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:17.0:1773851890.505859:0:2511435:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000a73103fc.
02000000:00000001:17.0:1773851890.505860:0:2511435:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000800:00000200:31.0:1773851890.505861:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851890.505861:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851890.505861:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851890.505862:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c7fc7bdd nid 22771@kfi7 refs 2
00000400:00000200:31.0:1773851890.505863:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851890.505863:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:17.0:1773851890.505863:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2054@kfi7:4 -> 22771@kfi7(00000000579d3b28):0x0 lsk 3618 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000e21 Transaction freed
00000400:00000200:31.0:1773851890.505864:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000100:00000001:30.0:1773851890.505864:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:31.0:1773851890.505865:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ab75faba
00000100:00000001:30.0:1773851890.505865:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:31.0:1773851890.505866:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ab75faba.
00000100:00000001:31.0:1773851890.505866:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851890.505866:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851890.505866:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851890.505866:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000200:31.0:1773851890.505867:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851890.505867:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851890.505867:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851890.505868:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:6.0:1773851890.505868:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851890.505869:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851890.505870:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851890.505870:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851890.505870:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851890.505870:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851890.505870:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:21.0:1773851890.505871:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851890.505871:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851890.505871:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851890.505872:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851890.505872:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851890.505873:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505873:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:21.0:1773851890.505873:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851890.505873:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:31.0:1773851890.505874:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:13.0:1773851890.505874:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:10.0:1773851890.505875:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851890.505875:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2085@kfi7 : PUT - for me
00000800:00000200:31.0:1773851890.505876:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Transaction freed
00000400:00000200:13.0:1773851890.505876:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:6.0:1773851890.505876:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:21.0:1773851890.505877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:10.0:1773851890.505877:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:6.0:1773851890.505877:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:13.0:1773851890.505878:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000200:6.0:1773851890.505878:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:21.0:1773851890.505879:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:13.0:1773851890.505879:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:10.0:1773851890.505879:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000400:00000200:6.0:1773851890.505879:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:21.0:1773851890.505880:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:13.0:1773851890.505880:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:10.0:1773851890.505880:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:6.0:1773851890.505880:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:21.0:1773851890.505881:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:10.0:1773851890.505881:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:6.0:1773851890.505881:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:21.0:1773851890.505883:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:13.0:1773851890.505883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:10.0:1773851890.505883:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:6.0:1773851890.505883:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5b80
00000400:00000200:21.0:1773851890.505884:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:13.0:1773851890.505884:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:10.0:1773851890.505884:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:6.0:1773851890.505884:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:21.0:1773851890.505885:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:13.0:1773851890.505885:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:10.0:1773851890.505885:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:6.0:1773851890.505885:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b31dc5 [1] + 224
00000800:00000200:17.0:1773851890.505886:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:13.0:1773851890.505886:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:10.0:1773851890.505886:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:21.0:1773851890.505887:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:17.0:1773851890.505887:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851890.505887:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5c80
00000400:00000200:21.0:1773851890.505888:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5c00
00000400:00000200:13.0:1773851890.505888:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:10.0:1773851890.505888:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5bc0
00000800:00000200:6.0:1773851890.505888:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851890.505889:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851890.505889:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:6.0:1773851890.505889:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.505890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:13.0:1773851890.505890:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f6dad [1] + 224
00000400:00000200:21.0:1773851890.505891:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d1a75 [1] + 224
00000800:00000200:17.0:1773851890.505891:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851890.505891:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781698969 [1] + 224
00000400:00000200:6.0:1773851890.505891:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000800:00000200:13.0:1773851890.505892:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851890.505892:0:2499722:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:6.0:1773851890.505892:0:2499722:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851890.505892:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851890.505893:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851890.505894:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851890.505894:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851890.505894:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:10.0:1773851890.505894:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851890.505894:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851890.505895:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:13.0:1773851890.505895:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000100:00000040:6.0:1773851890.505895:0:2499722:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851890.505896:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.505896:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:13.0:1773851890.505896:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:10.0:1773851890.505896:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.505897:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000400:00000200:17.0:1773851890.505897:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:10.0:1773851890.505897:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000800:00000200:1.0:1773851890.505897:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:21.0:1773851890.505898:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851890.505898:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000200:13.0:1773851890.505898:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851890.505899:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:10.0:1773851890.505899:0:2464469:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851890.505899:0:2499722:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851890.505899:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000200:21.0:1773851890.505900:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851890.505900:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000200:10.0:1773851890.505900:0:2464469:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851890.505900:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:5.0:1773851890.505900:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:17.0:1773851890.505901:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000040:13.0:1773851890.505901:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851890.505901:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:5.0:1773851890.505901:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:1.0:1773851890.505901:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:17.0:1773851890.505902:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5cc0
00000800:00000200:6.0:1773851890.505902:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:5.0:1773851890.505902:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:5.0:1773851890.505902:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000573cf79c.
00000400:00000200:1.0:1773851890.505902:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000040:21.0:1773851890.505903:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851890.505903:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000040:10.0:1773851890.505903:0:2464469:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851890.505903:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000690e571
00000400:00000010:5.0:1773851890.505903:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000690e571.
00000100:00000001:5.0:1773851890.505904:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851890.505904:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:17.0:1773851890.505905:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f1f11 [1] + 224
00000100:00000001:13.0:1773851890.505905:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:5.0:1773851890.505905:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851890.505905:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:13.0:1773851890.505906:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:1.0:1773851890.505906:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:21.0:1773851890.505907:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:17.0:1773851890.505907:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851890.505907:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851890.505907:0:2464469:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851890.505907:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000001:0.0:1773851890.505907:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:17.0:1773851890.505908:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851890.505908:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000200:5.0:1773851890.505908:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851890.505908:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:0.0:1773851890.505908:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851890.505909:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:11.0:1773851890.505909:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:10.0:1773851890.505909:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851890.505909:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851890.505909:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851890.505909:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5c40
00000400:00000001:0.0:1773851890.505909:0:41062:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:21.0:1773851890.505910:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851890.505910:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000001:11.0:1773851890.505910:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851890.505910:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851890.505910:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:5.0:1773851890.505910:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851890.505910:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851890.505910:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000001:0.0:1773851890.505910:0:41062:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:17.0:1773851890.505911:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:11.0:1773851890.505911:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:11.0:1773851890.505911:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851890.505911:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851890.505911:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000100:00000001:5.0:1773851890.505911:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851890.505911:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:0.0:1773851890.505911:0:41062:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000031c34675.
00000400:00000010:11.0:1773851890.505912:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000010:7.0:1773851890.505912:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000100:00000001:5.0:1773851890.505912:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851890.505912:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851890.505912:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71e141 [1] + 224
00000400:00000200:0.0:1773851890.505912:0:41062:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d5fbcac
00000400:00000010:0.0:1773851890.505912:0:41062:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d5fbcac.
00000100:00000200:17.0:1773851890.505913:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851890.505913:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2b33615
00000400:00000010:11.0:1773851890.505913:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2b33615.
00000100:00000001:7.0:1773851890.505913:0:41065:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:5.0:1773851890.505913:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.505913:0:41062:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851890.505914:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851890.505914:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:5.0:1773851890.505914:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=123 v=66 (66 66 66 66)
00000800:00000200:1.0:1773851890.505914:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:11.0:1773851890.505915:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:5.0:1773851890.505915:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=123 v=66 (1 1 1 1)
00000100:00000200:0.0:1773851890.505915:0:41062:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851890.505916:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851890.505916:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851890.505916:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851890.505916:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851890.505916:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:5.0:1773851890.505917:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:1.0:1773851890.505917:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000100:00000200:11.0:1773851890.505918:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851890.505918:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00010000:00000001:5.0:1773851890.505918:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505918:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:0.0:1773851890.505918:0:41062:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851890.505919:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851890.505919:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851890.505919:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:5.0:1773851890.505919:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000001:5.0:1773851890.505919:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:1.0:1773851890.505919:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:17.0:1773851890.505920:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851890.505920:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851890.505920:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851890.505920:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505920:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851890.505920:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851890.505920:0:41062:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851890.505921:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:11.0:1773851890.505921:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851890.505921:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851890.505921:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851890.505921:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=123 v=66 (66 66 66 66)
00000100:00000040:5.0:1773851890.505921:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851890.505922:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851890.505922:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:17.0:1773851890.505922:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851890.505922:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:11.0:1773851890.505922:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:7.0:1773851890.505922:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=123 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851890.505922:0:41062:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851890.505922:0:41062:0:(client.c:1428:after_reply()) Process entered
00000400:00000001:31.0:1773851890.505923:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:11.0:1773851890.505923:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851890.505923:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851890.505923:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505923:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:1.0:1773851890.505923:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:0.0:1773851890.505923:0:41062:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:0.0:1773851890.505923:0:41062:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000001:31.0:1773851890.505924:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:11.0:1773851890.505924:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851890.505924:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851890.505924:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505924:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851890.505924:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851890.505924:0:41062:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851890.505925:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:31.0:1773851890.505925:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000100:00001000:11.0:1773851890.505925:0:41070:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=123 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851890.505925:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851890.505925:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000004:00000001:5.0:1773851890.505925:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:0.0:1773851890.505925:0:41062:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851890.505926:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00001000:11.0:1773851890.505926:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=123 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851890.505926:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851890.505926:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:5.0:1773851890.505926:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000004:00000040:5.0:1773851890.505926:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351465977856 avail=351462800384 avail_mb=1372901564 hwm_mb=3131103 files=372062752 ffree=343228494 state=0: rc = 0
00000100:00001000:0.0:1773851890.505926:0:41062:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=123 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851890.505927:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851890.505927:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:7.0:1773851890.505927:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:1.0:1773851890.505927:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:0.0:1773851890.505927:0:41062:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=123 v=66 (1 1 1 1)
00000100:00000200:31.0:1773851890.505928:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851890.505928:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:11.0:1773851890.505928:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:5.0:1773851890.505928:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351465977856 free, 351462800384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062752 files, 343228494 free files
00000400:00000200:1.0:1773851890.505928:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:0.0:1773851890.505928:0:41062:0:(client.c:1349:ptlrpc_check_status()) Process entered
00010000:00000001:11.0:1773851890.505929:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505929:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851890.505929:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851890.505929:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000001:5.0:1773851890.505929:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.505929:0:41062:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851890.505930:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851890.505930:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851890.505930:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:11.0:1773851890.505930:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:11.0:1773851890.505930:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851890.505930:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851890.505930:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:5.0:1773851890.505930:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:1.0:1773851890.505930:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00010000:00000001:0.0:1773851890.505930:0:41062:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:0.0:1773851890.505930:0:41062:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505931:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:7.0:1773851890.505931:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000100:00000001:0.0:1773851890.505931:0:41062:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:30.0:1773851890.505932:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:11.0:1773851890.505932:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:7.0:1773851890.505932:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351488995328 avail=351486022656 avail_mb=1372992276 hwm_mb=3131103 files=372066684 ffree=343250972 state=0: rc = 0
00000100:00000040:0.0:1773851890.505932:0:41062:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00000001:0.0:1773851890.505932:0:41062:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851890.505933:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851890.505933:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:30.0:1773851890.505933:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000020:7.0:1773851890.505933:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351488995328 free, 351486022656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066684 files, 343250972 free files
00000100:00100000:5.0:1773851890.505933:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ece8016 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051937664:2085@kfi7:13:default-yuba2-0
00000100:00000001:0.0:1773851890.505933:0:41062:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851890.505934:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851890.505934:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:30.0:1773851890.505934:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:11.0:1773851890.505934:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851890.505934:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:0.0:1773851890.505934:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851890.505935:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:30.0:1773851890.505935:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000007302f25
00000100:00000001:11.0:1773851890.505935:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851890.505935:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851890.505935:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505935:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851890.505935:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005ece8016 x1859433051937664/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851890.505936:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851890.505936:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851890.505936:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000007302f25.
00000004:00000001:11.0:1773851890.505936:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:7.0:1773851890.505936:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:31.0:1773851890.505937:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=123 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851890.505937:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000040:11.0:1773851890.505937:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00000001:0.0:1773851890.505937:0:41062:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:31.0:1773851890.505938:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=123 v=66 (1 1 1 1)
00000004:00000040:11.0:1773851890.505938:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382736896 avail=351380642816 avail_mb=1372580636 hwm_mb=3131101 files=371978635 ffree=343147204 state=0: rc = 0
00000100:00100000:7.0:1773851890.505938:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000562ee10a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051937728:46@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851890.505938:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851890.505938:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:0.0:1773851890.505938:0:41062:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851890.505938:0:41062:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851890.505939:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:30.0:1773851890.505939:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:11.0:1773851890.505939:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382736896 free, 351380642816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978635 files, 343147204 free files
00000100:00000001:7.0:1773851890.505939:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:5.0:1773851890.505939:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000074d75e84.
00000004:00000001:0.0:1773851890.505939:0:41062:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851890.505940:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851890.505940:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851890.505940:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:5.0:1773851890.505940:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851890.505940:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000040:0.0:1773851890.505940:0:41062:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000004:00000040:0.0:1773851890.505940:0:41062:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406493696 avail=351404179456 avail_mb=1372672576 hwm_mb=3131103 files=372127129 ffree=343170404 state=0: rc = 0
00010000:00000001:31.0:1773851890.505941:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851890.505941:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851890.505941:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000562ee10a x1859433051937728/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:5.0:1773851890.505941:0:41064:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000020:00000001:5.0:1773851890.505941:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:31.0:1773851890.505942:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851890.505942:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000040:11.0:1773851890.505942:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:5.0:1773851890.505942:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000022c33118.
00000004:00000020:0.0:1773851890.505942:0:41062:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406493696 free, 351404179456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127129 files, 343170404 free files
00000100:00000001:31.0:1773851890.505943:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851890.505943:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851890.505943:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851890.505943:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851890.505943:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006b18bdd4.
02000000:00000001:5.0:1773851890.505943:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851890.505943:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:31.0:1773851890.505944:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:30.0:1773851890.505944:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851890.505944:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000010:5.0:1773851890.505944:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005ece8016.
00000004:00000001:0.0:1773851890.505944:0:41062:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851890.505945:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec171328 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051937792:2055@kfi7:13:default-yuba2-0
00000020:00000001:7.0:1773851890.505945:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851890.505945:0:41065:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000100:00000001:5.0:1773851890.505945:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851890.505945:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851890.505945:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:0.0:1773851890.505945:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851890.505946:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851890.505946:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:7.0:1773851890.505946:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851890.505946:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000c0831f5b.
00000100:00000001:5.0:1773851890.505946:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851890.505947:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:11.0:1773851890.505947:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ec171328 x1859433051937792/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851890.505947:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851890.505947:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851890.505947:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000562ee10a.
00000100:00000001:5.0:1773851890.505947:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851890.505947:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851890.505947:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851890.505947:0:41062:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051937920:2057@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851890.505948:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851890.505948:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851890.505948:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851890.505948:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851890.505948:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851890.505949:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851890.505949:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000100:00000001:30.0:1773851890.505949:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851890.505949:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851890.505949:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851890.505949:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.505949:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:31.0:1773851890.505950:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464025088 avail=351458249728 avail_mb=1372883788 hwm_mb=3131101 files=372064701 ffree=343226587 state=0: rc = 0
00000100:00000001:30.0:1773851890.505950:0:41090:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:11.0:1773851890.505950:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851890.505950:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851890.505950:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851890.505950:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.505950:0:41062:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:30.0:1773851890.505951:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851890.505951:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000010:11.0:1773851890.505951:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000076e9752.
00000100:00000040:0.0:1773851890.505951:0:41062:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000cc6defe8 x1859433051937920/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:31.0:1773851890.505952:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464025088 free, 351458249728 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064701 files, 343226587 free files
00000100:00000001:30.0:1773851890.505952:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851890.505952:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851890.505953:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:11.0:1773851890.505953:0:41070:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000100:00000001:0.0:1773851890.505953:0:41062:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000001:31.0:1773851890.505954:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851890.505954:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851890.505954:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851890.505954:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:0.0:1773851890.505954:0:41062:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:0.0:1773851890.505954:0:41062:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000cc9e4dfe.
00000100:00000040:31.0:1773851890.505955:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:30.0:1773851890.505955:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=123 v=66 (66 66 66 66)
02000000:00000001:11.0:1773851890.505955:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851890.505956:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851890.505956:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec171328.
02000000:00000001:0.0:1773851890.505956:0:41062:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:0.0:1773851890.505956:0:41062:0:(genops.c:1101:class_import_put()) Process entered
00000100:00100000:31.0:1773851890.505957:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000057c38d87 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051937984:2065@kfi7:13:default-yuba2-0
00000100:00001000:30.0:1773851890.505957:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=123 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851890.505957:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851890.505957:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:0.0:1773851890.505957:0:41062:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000020:00000001:0.0:1773851890.505957:0:41062:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:11.0:1773851890.505958:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:0.0:1773851890.505958:0:41062:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d8f54850.
00000100:00000001:31.0:1773851890.505959:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851890.505959:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851890.505959:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851890.505959:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851890.505959:0:41062:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:31.0:1773851890.505960:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851890.505960:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000057c38d87 x1859433051937984/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851890.505960:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851890.505960:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851890.505960:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851890.505960:0:41062:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:0.0:1773851890.505960:0:41062:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc6defe8.
00010000:00000001:30.0:1773851890.505961:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851890.505961:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.505961:0:41062:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:0.0:1773851890.505962:0:41062:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851890.505962:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851890.505963:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851890.505963:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:30.0:1773851890.505963:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:0.0:1773851890.505963:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:31.0:1773851890.505964:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bb1c2bcd.
00000100:00000040:30.0:1773851890.505964:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:0.0:1773851890.505964:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851890.505965:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851890.505965:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851890.505965:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.505965:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851890.505965:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851890.505966:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851890.505966:0:41091:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000020:00000001:31.0:1773851890.505967:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851890.505967:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000055279eb9.
02000000:00000001:31.0:1773851890.505968:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:30.0:1773851890.505968:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851890.505969:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851890.505969:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000057c38d87.
00000100:00000001:31.0:1773851890.505970:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851890.505970:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851890.505971:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851890.505972:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851890.505972:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.505972:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851890.505973:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851890.505973:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.505973:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851890.505974:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851890.505975:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851890.505976:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000004:00000040:30.0:1773851890.505977:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545831424 avail=351536184320 avail_mb=1373188220 hwm_mb=3131103 files=372116395 ffree=343306476 state=0: rc = 0
00000004:00000020:30.0:1773851890.505980:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545831424 free, 351536184320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116395 files, 343306476 free files
00000004:00000001:30.0:1773851890.505983:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851890.505985:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:30.0:1773851890.505990:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005aed8c46 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051937856:2056@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851890.505992:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851890.505993:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851890.505995:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005aed8c46 x1859433051937856/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852043 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851890.505999:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851890.505999:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851890.506000:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f1ad06fd.
02000000:00000001:30.0:1773851890.506002:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851890.506003:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851890.506003:0:41090:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000020:00000001:30.0:1773851890.506004:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851890.506005:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
02000000:00000001:30.0:1773851890.506006:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851890.506007:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851890.506008:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005aed8c46.
00000100:00000001:30.0:1773851890.506009:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851890.506010:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851890.506011:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851890.506013:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851890.506013:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.506014:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851890.506015:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851890.529225:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851890.529226:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851890.529227:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851890.529229:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851890.529230:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25025@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.529232:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25025@kfi7 : PUT - for me
00000400:00000200:13.0:1773851890.529232:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25025@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.529234:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b759f4ee nid 25025@kfi7 refs 1
00000400:00000200:13.0:1773851890.529235:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25025@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.529236:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b759f4ee nid 25025@kfi7 refs 2
00000400:00000200:13.0:1773851890.529236:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b759f4ee nid 25025@kfi7 refs 3
00000400:00000200:13.0:1773851890.529237:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25025@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.529238:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25025@kfi7 of length 224 into portal 12 MB=0x69b190b46c140
00000400:00000200:13.0:1773851890.529239:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25025@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 48288
00000800:00000200:13.0:1773851890.529241:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851890.529242:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851890.529244:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25025@kfi7: PUT: OK
00000100:00000001:13.0:1773851890.529244:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851890.529245:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851890.529246:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059357960.
00000100:00000040:13.0:1773851890.529246:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000059357960 x1859381725937984 msgsize 224
00000100:00100000:13.0:1773851890.529248:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25025@kfi7 (source: 12345-25025@kfi7)
00000100:00000001:13.0:1773851890.529249:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851890.529250:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b759f4ee nid 25025@kfi7 refs 2
00000100:00000001:15.0:1773851890.529251:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851890.529251:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851890.529251:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851890.529252:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851890.529252:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851890.529253:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851890.529254:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381725937984
00000020:00000001:15.0:1773851890.529255:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851890.529256:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079683e42f2
00000020:00000001:15.0:1773851890.529256:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851890.529259:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005718862f refcount=5
00000020:00000001:15.0:1773851890.529260:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636954770132992 : -107118939418624 : ffff9e936daad000)
00000020:00000001:15.0:1773851890.529261:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636954770132992 : -107118939418624 : ffff9e936daad000)
00000100:00000001:15.0:1773851890.529262:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851890.529263:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851890.529263:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851890.529265:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851890.529265:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851890.529267:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851890.529267:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851890.529268:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851890.529269:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851890.529269:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851890.529270:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.529271:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851890.529272:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851890.529273:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851890.529273:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851890.529273:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851890.529274:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25025@kfi7, seq: 2289904
00000100:00000040:15.0:1773851890.529275:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005718862f : new rpc_count 1
00000100:00000001:12.0:1773851890.529275:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.529276:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485615360 : -107000223936256 : ffff9eaf11a95100)
00000100:00000001:12.0:1773851890.529276:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851890.529277:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000059357960 x1859381725937984/t0(0) o400->38a10b50-a22c-4856-ad18-e4488ec8eb47@25025@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2051-0'
00000100:00000001:15.0:1773851890.529280:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851890.529280:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851890.529281:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059357960 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:38a10b50-a22c-4856-ad18-e4488ec8eb47+5:39832:x1859381725937984:12345-25025@kfi7:400:default-tuolumne2051-0
00000100:00000200:15.0:1773851890.529282:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381725937984
00000020:00000001:15.0:1773851890.529283:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851890.529284:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851890.529285:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.529285:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851890.529286:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851890.529286:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851890.529287:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381725937984, found 0 last_xid 1859381725937983
00000020:00000001:15.0:1773851890.529288:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851890.529289:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851890.529289:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851890.529290:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.529290:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851890.529291:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851890.529292:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851890.529293:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000589d0161.
02000000:00000001:15.0:1773851890.529293:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.529295:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.529296:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851890.529296:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676018016, transno 0, xid 1859381725937984
00010000:00000001:15.0:1773851890.529297:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851890.529298:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000059357960 x1859381725937984/t0(0) o400->38a10b50-a22c-4856-ad18-e4488ec8eb47@25025@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2051-0'
00010000:00000001:15.0:1773851890.529301:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851890.529301:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851890.529302:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=123 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851890.529303:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851890.529304:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009eae01a4 refcount 3 to 25025@kfi7
00000100:00000001:15.0:1773851890.529305:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902778784 : -107154806772832 : ffff9e8b13ce6ba0)
02000000:00000001:15.0:1773851890.529306:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851890.529306:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.529307:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851890.529308:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25025@kfi7
00000400:00000010:15.0:1773851890.529309:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039cd6bfe.
00000100:00000200:15.0:1773851890.529310:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859381725937984, offset 224
00000400:00000200:15.0:1773851890.529311:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25025@kfi7
00000400:00000200:15.0:1773851890.529312:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25025@kfi7 to cpt 3
00000400:00000200:15.0:1773851890.529313:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b759f4ee nid 25025@kfi7 refs 1
00000400:00000200:15.0:1773851890.529315:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b759f4ee nid 25025@kfi7 refs 2
00000400:00000200:15.0:1773851890.529316:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b759f4ee nid 25025@kfi7 refs 3
00000400:00000200:15.0:1773851890.529317:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25025@kfi7 local destination
00000400:00000200:15.0:1773851890.529318:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769984:8769984:1024:4294967295] 25025@kfi7 LPNI seq info [218615:218615:16:4294967295]
00000400:00000200:15.0:1773851890.529320:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b759f4ee nid 25025@kfi7 refs 2
00000400:00000200:15.0:1773851890.529320:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25025@kfi7 to cpt 3
00000400:00000200:15.0:1773851890.529322:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25025@kfi7(25025@kfi7:25025@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851890.529323:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b759f4ee nid 25025@kfi7 refs 3
00000800:00000200:15.0:1773851890.529325:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851890.529326:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851890.529331:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851890.529334:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9de Using peer 25025@kfi7(0x9de)
00000800:00000200:15.0:1773851890.529337:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x9de: rc=0
00000800:00000200:15.0:1773851890.529339:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851890.529341:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851890.529342:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009eae01a4 refcount 2 to 25025@kfi7
00010000:00000001:15.0:1773851890.529343:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851890.529343:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.529344:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851890.529344:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059357960 x1859381725937984/t0(0) o400->38a10b50-a22c-4856-ad18-e4488ec8eb47@25025@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2051-0'
00000100:00100000:15.0:1773851890.529348:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059357960 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:38a10b50-a22c-4856-ad18-e4488ec8eb47+5:39832:x1859381725937984:12345-25025@kfi7:400:default-tuolumne2051-0 Request processed in 67us (100us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851890.529351:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25025@kfi7, seq: 2289904
00000100:00000040:15.0:1773851890.529351:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005718862f : new rpc_count 0
00000100:00000001:15.0:1773851890.529352:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851890.529352:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9de TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851890.529353:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851890.529353:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851890.529353:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851890.529354:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000400:00000200:13.0:1773851890.529354:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25025@kfi7: PUT: OK
00000020:00000010:15.0:1773851890.529355:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000400:00000200:13.0:1773851890.529355:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039cd6bfe
00000020:00000040:15.0:1773851890.529356:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000005718862f : new refcount 4
00000400:00000010:13.0:1773851890.529356:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039cd6bfe.
00000100:00000001:13.0:1773851890.529356:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851890.529357:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851890.529357:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851890.529358:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b759f4ee nid 25025@kfi7 refs 2
00000800:00000200:13.0:1773851890.529359:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 25025@kfi7(00000000a5fefe97):0x0 lsk 2527 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9de Transaction freed
00000400:00000200:29.0:1773851890.569734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851890.569737:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851890.570884:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851890.570885:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851890.570886:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851890.570888:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851890.570892:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19648@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.570894:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19648@kfi7 : PUT - for me
00000400:00000200:21.0:1773851890.570894:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19648@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.570895:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da441f55 nid 19648@kfi7 refs 1
00000400:00000200:21.0:1773851890.570896:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19648@kfi7 to cpt 5
00000400:00000200:21.0:1773851890.570897:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da441f55 nid 19648@kfi7 refs 2
00000400:00000200:21.0:1773851890.570898:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000da441f55 nid 19648@kfi7 refs 3
00000400:00000200:21.0:1773851890.570899:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19649@kfi7 to cpt 0
00000400:00000200:21.0:1773851890.570900:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19649@kfi7 of length 224 into portal 12 MB=0x69b4bb6306a80
00000400:00000200:21.0:1773851890.570901:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19649@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 58664
00000800:00000200:21.0:1773851890.570903:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851890.570904:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.570905:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19648@kfi7: PUT: OK
00000100:00000001:21.0:1773851890.570906:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851890.570907:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851890.570908:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b926ac7.
00000100:00000040:21.0:1773851890.570908:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005b926ac7 x1859599341742720 msgsize 224
00000100:00100000:21.0:1773851890.570910:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-19649@kfi7 (source: 12345-19648@kfi7)
00000100:00000001:21.0:1773851890.570911:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851890.570912:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000da441f55 nid 19648@kfi7 refs 2
00000100:00000001:20.0:1773851890.570912:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851890.570913:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851890.570913:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851890.570913:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851890.570914:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851890.570915:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851890.570916:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599341742720
00000020:00000001:20.0:1773851890.570916:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851890.570917:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3894ca72
00000020:00000001:20.0:1773851890.570917:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851890.570921:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d6af0060 refcount=765
00000020:00000001:20.0:1773851890.570922:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135696446464 : -106938013105152 : ffff9ebd8db74400)
00000020:00000001:20.0:1773851890.570923:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637135696446464 : -106938013105152 : ffff9ebd8db74400)
00000100:00000001:20.0:1773851890.570924:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.570925:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851890.570925:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e14bbbb6.
00000020:00000010:20.0:1773851890.570926:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851890.570927:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee24a6ca.
00000100:00000001:20.0:1773851890.570928:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851890.570928:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851890.570929:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851890.570930:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851890.570930:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851890.570931:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.570932:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851890.570933:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851890.570933:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851890.570933:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851890.570934:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851890.570935:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851890.570935:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19649@kfi7, seq: 1998054
00000100:00000040:20.0:1773851890.570935:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d6af0060 : new rpc_count 9
00000100:00000001:23.0:1773851890.570936:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.570936:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667750272 : -106956041801344 : ffff9eb95b1f3180)
00000100:00000040:20.0:1773851890.570937:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005b926ac7 x1859599341742720/t0(0) o400->285fe4b9-e0a6-475c-9d5e-6c1748ab64c6@19649@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1715-0'
00000100:00000001:20.0:1773851890.570940:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.570940:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851890.570941:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b926ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:285fe4b9-e0a6-475c-9d5e-6c1748ab64c6+765:39744:x1859599341742720:12345-19649@kfi7:400:default-tuolumne1715-0
00000100:00000200:20.0:1773851890.570942:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599341742720
00000020:00000001:20.0:1773851890.570943:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851890.570944:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851890.570944:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.570945:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851890.570946:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851890.570946:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851890.570947:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599341742720, found 0 last_xid 1859599306977279
00000020:00000001:20.0:1773851890.570948:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851890.570949:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851890.570949:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851890.570950:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.570950:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851890.570951:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851890.570952:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851890.570952:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c221c2bd.
02000000:00000001:20.0:1773851890.570953:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.570953:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.570954:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851890.570955:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590427, transno 0, xid 1859599341742720
00010000:00000001:20.0:1773851890.570955:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851890.570956:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005b926ac7 x1859599341742720/t0(0) o400->285fe4b9-e0a6-475c-9d5e-6c1748ab64c6@19649@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1715-0'
00010000:00000001:20.0:1773851890.570959:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851890.570959:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851890.570960:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=123 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851890.570961:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851890.570962:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e59bd90 refcount 3 to 19649@kfi7
00000100:00000001:20.0:1773851890.570962:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729380032 : -107155980171584 : ffff9e8acdddc6c0)
02000000:00000001:20.0:1773851890.570963:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851890.570963:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.570964:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851890.570965:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19648@kfi7
00000400:00000010:20.0:1773851890.570965:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009c43daff.
00000100:00000200:20.0:1773851890.570966:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599341742720, offset 224
00000400:00000200:20.0:1773851890.570968:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19648@kfi7
00000400:00000200:20.0:1773851890.570968:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19648@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.570969:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da441f55 nid 19648@kfi7 refs 1
00000400:00000200:20.0:1773851890.570971:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000da441f55 nid 19648@kfi7 refs 2
00000400:00000200:20.0:1773851890.570972:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000da441f55 nid 19648@kfi7 refs 3
00000400:00000200:20.0:1773851890.570973:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19648@kfi7 local destination
00000400:00000200:20.0:1773851890.570975:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769985:8769985:1024:4294967295] 19648@kfi7 LPNI seq info [4205286:4205286:16:4294967295]
00000400:00000200:20.0:1773851890.570976:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000da441f55 nid 19648@kfi7 refs 2
00000400:00000200:20.0:1773851890.570977:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19648@kfi7 to cpt 5
00000400:00000200:20.0:1773851890.570979:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19648@kfi7(19648@kfi7:19648@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851890.570980:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000da441f55 nid 19648@kfi7 refs 3
00000800:00000200:20.0:1773851890.570982:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851890.570983:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851890.570985:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851890.570987:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x657 Using peer 19648@kfi7(0x657)
00000800:00000200:20.0:1773851890.570990:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0x657: rc=0
00000800:00000200:20.0:1773851890.570992:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x657 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851890.570994:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851890.570995:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e59bd90 refcount 2 to 19649@kfi7
00010000:00000001:20.0:1773851890.570995:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851890.570996:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851890.570996:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851890.570997:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b926ac7 x1859599341742720/t0(0) o400->285fe4b9-e0a6-475c-9d5e-6c1748ab64c6@19649@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1715-0'
00000100:00100000:20.0:1773851890.571002:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b926ac7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:285fe4b9-e0a6-475c-9d5e-6c1748ab64c6+765:39744:x1859599341742720:12345-19649@kfi7:400:default-tuolumne1715-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851890.571004:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19649@kfi7, seq: 1998054
00000100:00000040:20.0:1773851890.571005:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d6af0060 : new rpc_count 8
00000100:00000001:20.0:1773851890.571005:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851890.571006:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851890.571007:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851890.571007:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee24a6ca.
00000020:00000010:20.0:1773851890.571009:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e14bbbb6.
00000020:00000040:20.0:1773851890.571009:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000d6af0060 : new refcount 764
00000100:00000001:20.0:1773851890.571010:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851890.571016:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x657 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851890.571018:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851890.571019:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19648@kfi7: PUT: OK
00000400:00000200:21.0:1773851890.571020:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009c43daff
00000400:00000010:21.0:1773851890.571021:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009c43daff.
00000100:00000001:21.0:1773851890.571021:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851890.571022:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851890.571023:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000da441f55 nid 19648@kfi7 refs 2
00000800:00000200:21.0:1773851890.571024:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 19648@kfi7(0000000080ca1fe4):0x0 lsk 1624 rsk 20 tsk 0 trmk 0 tmk 0 trr 5 tta 0x657 Transaction freed
00000800:00000200:6.0:1773851890.632370:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851890.632370:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851890.632371:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851890.632371:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851890.632373:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851890.632373:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851890.632375:0:2499722:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20579@kfi7(000000001e6b3151):0x5ed version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851890.632375:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851890.632377:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20579@kfi7 to cpt 1
00000800:00000200:6.0:1773851890.632378:0:2499722:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed Using peer 20579@kfi7(0x5ed)
00000400:00000200:5.0:1773851890.632378:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20579@kfi7 : PUT - for me
00000400:00000200:5.0:1773851890.632379:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20579@kfi7 to cpt 1
00000400:00000200:5.0:1773851890.632380:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c836c6ca nid 20579@kfi7 refs 1
00000400:00000200:5.0:1773851890.632381:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20579@kfi7 to cpt 1
00000400:00000200:5.0:1773851890.632382:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c836c6ca nid 20579@kfi7 refs 2
00000400:00000200:5.0:1773851890.632383:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c836c6ca nid 20579@kfi7 refs 3
00000400:00000200:6.0:1773851890.632384:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20579@kfi7 to cpt 1
00000400:00000200:5.0:1773851890.632384:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20642@kfi7 to cpt 2
00000800:00000200:6.0:1773851890.632386:0:2499722:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 38 bytes to peer 0x5ed: rc=0
00000400:00000200:5.0:1773851890.632386:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20642@kfi7 of length 456 into portal 12 MB=0x699e15deea940
00000800:00000200:6.0:1773851890.632387:0:2499722:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:5.0:1773851890.632387:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20642@kfi7 of length 456/456 into md 0x793926dc5 [64] + 158808
00000800:00000200:5.0:1773851890.632389:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851890.632391:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851890.632392:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20579@kfi7: PUT: OK
00000100:00000001:5.0:1773851890.632393:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851890.632394:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851890.632395:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000adffc73b.
00000100:00000040:5.0:1773851890.632396:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000adffc73b x1858043082877248 msgsize 456
00000100:00100000:5.0:1773851890.632397:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20642@kfi7 (source: 12345-20579@kfi7)
00000800:00000200:6.0:1773851890.632399:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851890.632399:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851890.632400:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c836c6ca nid 20579@kfi7 refs 2
00000800:00000200:6.0:1773851890.632401:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed Transaction freed
00000100:00000001:4.0:1773851890.632401:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851890.632402:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851890.632402:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851890.632402:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851890.632403:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851890.632404:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851890.632404:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043082877248
00000020:00000001:4.0:1773851890.632405:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851890.632405:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92339
00000020:00000001:4.0:1773851890.632406:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851890.632409:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007256f1bb refcount=631
00000020:00000001:4.0:1773851890.632410:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630295552 : -107123079256064 : ffff9e9276e9e800)
00000020:00000001:4.0:1773851890.632410:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630295552 : -107123079256064 : ffff9e9276e9e800)
00000100:00000001:4.0:1773851890.632412:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851890.632412:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851890.632413:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851890.632415:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851890.632416:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ab5100b2.
00000100:00000001:4.0:1773851890.632417:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851890.632417:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851890.632418:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.632419:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.632420:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851890.632422:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851890.632422:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851890.632422:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851890.632423:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851890.632424:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20642@kfi7, seq: 371100848
00000100:00000001:7.0:1773851890.632425:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851890.632425:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007256f1bb : new rpc_count 10
00000100:00000001:7.0:1773851890.632426:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.632426:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108954624 : -106938600596992 : ffff9ebd6ab2da00)
00000100:00000040:4.0:1773851890.632427:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000adffc73b x1858043082877248/t0(0) o17->c04f0787-7df2-4df9-9a2b-817efb3a3a03@20642@kfi7:171/0 lens 456/0 e 0 to 0 dl 1773852286 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1772-0'
00000100:00000001:4.0:1773851890.632430:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851890.632430:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851890.632431:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000adffc73b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:c04f0787-7df2-4df9-9a2b-817efb3a3a03+631:39621:x1858043082877248:12345-20642@kfi7:17:default-tuolumne1772-0
00000100:00000200:4.0:1773851890.632433:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043082877248
00000020:00000001:4.0:1773851890.632434:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851890.632434:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851890.632435:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.632436:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851890.632436:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:4.0:1773851890.632437:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851890.632438:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043082877248, found 0 last_xid 1858043034847679
00000020:00000001:4.0:1773851890.632439:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851890.632439:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851890.632440:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851890.632441:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851890.632441:0:60963:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:4.0:1773851890.632442:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851890.632443:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851890.632444:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000002207837c.
02000000:00000001:4.0:1773851890.632445:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.632445:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.632446:0:60963:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:4.0:1773851890.632447:0:60963:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:4.0:1773851890.632447:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:4.0:1773851890.632449:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.632450:0:60963:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:4.0:1773851890.632450:0:60963:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli c04f0787-7df2-4df9-9a2b-817efb3a3a03/000000007256f1bb free: 126633370845184 avail: 126633368748032
00000020:00000001:4.0:1773851890.632451:0:60963:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:4.0:1773851890.632453:0:60963:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli c04f0787-7df2-4df9-9a2b-817efb3a3a03/000000007256f1bb avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:4.0:1773851890.632454:0:60963:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:4.0:1773851890.632455:0:60963:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:4.0:1773851890.632455:0:60963:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli c04f0787-7df2-4df9-9a2b-817efb3a3a03/000000007256f1bb reports grant 1800929279 dropped 0, local 1882456063
00000020:00000001:4.0:1773851890.632456:0:60963:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:4.0:1773851890.632457:0:60963:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:4.0:1773851890.632457:0:60963:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851890.632458:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581372, transno 0, xid 1858043082877248
00010000:00000001:4.0:1773851890.632459:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851890.632460:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000adffc73b x1858043082877248/t0(0) o17->c04f0787-7df2-4df9-9a2b-817efb3a3a03@20642@kfi7:171/0 lens 456/432 e 0 to 0 dl 1773852286 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1772-0'
00010000:00000001:4.0:1773851890.632463:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851890.632463:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851890.632464:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=122 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851890.632465:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851890.632466:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000043f8a262 refcount 3 to 20642@kfi7
00000100:00000001:4.0:1773851890.632467:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959055520 : -107146750496096 : ffff9e8cf3ff72a0)
02000000:00000001:4.0:1773851890.632468:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851890.632468:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.632469:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851890.632470:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20579@kfi7
00000400:00000010:4.0:1773851890.632470:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000970b84f9.
00000100:00000200:4.0:1773851890.632471:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858043082877248, offset 224
00000400:00000200:4.0:1773851890.632473:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20579@kfi7
00000400:00000200:4.0:1773851890.632474:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20579@kfi7 to cpt 1
00000400:00000200:4.0:1773851890.632474:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c836c6ca nid 20579@kfi7 refs 1
00000400:00000200:4.0:1773851890.632476:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c836c6ca nid 20579@kfi7 refs 2
00000400:00000200:4.0:1773851890.632477:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c836c6ca nid 20579@kfi7 refs 3
00000400:00000200:4.0:1773851890.632478:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20579@kfi7 local destination
00000400:00000200:4.0:1773851890.632480:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769986:8769986:1024:4294967295] 20579@kfi7 LPNI seq info [9853553:9853553:16:4294967295]
00000400:00000200:4.0:1773851890.632481:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c836c6ca nid 20579@kfi7 refs 2
00000400:00000200:4.0:1773851890.632483:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20579@kfi7 to cpt 1
00000400:00000200:4.0:1773851890.632485:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20579@kfi7(20579@kfi7:20579@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851890.632486:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c836c6ca nid 20579@kfi7 refs 3
00000800:00000200:4.0:1773851890.632487:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851890.632489:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:4.0:1773851890.632491:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851890.632493:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed Using peer 20579@kfi7(0x5ed)
00000800:00000200:4.0:1773851890.632496:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 532 bytes to peer 0x5ed: rc=0
00000800:00000200:4.0:1773851890.632497:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851890.632499:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851890.632500:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000043f8a262 refcount 2 to 20642@kfi7
00010000:00000001:4.0:1773851890.632501:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851890.632502:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.632502:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851890.632503:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000adffc73b x1858043082877248/t0(0) o17->c04f0787-7df2-4df9-9a2b-817efb3a3a03@20642@kfi7:171/0 lens 456/432 e 0 to 0 dl 1773852286 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1772-0'
00000100:00100000:4.0:1773851890.632508:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000adffc73b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:c04f0787-7df2-4df9-9a2b-817efb3a3a03+631:39621:x1858043082877248:12345-20642@kfi7:17:default-tuolumne1772-0 Request processed in 77us (111us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851890.632510:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20642@kfi7, seq: 371100848
00000100:00000040:4.0:1773851890.632510:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007256f1bb : new rpc_count 9
00000100:00000001:4.0:1773851890.632511:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851890.632512:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851890.632513:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851890.632513:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ab5100b2.
00000020:00000010:4.0:1773851890.632514:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851890.632515:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000007256f1bb : new refcount 630
00000100:00000001:4.0:1773851890.632516:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851890.632521:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851890.632522:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851890.632523:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20579@kfi7: PUT: OK
00000400:00000200:5.0:1773851890.632524:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000970b84f9
00000400:00000010:5.0:1773851890.632524:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000970b84f9.
00000100:00000001:5.0:1773851890.632525:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851890.632525:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851890.632526:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c836c6ca nid 20579@kfi7 refs 2
00000800:00000200:5.0:1773851890.632528:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 20579@kfi7(000000001e6b3151):0x0 lsk 1518 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5ed Transaction freed
00000800:00000200:13.0:1773851890.650194:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851890.650195:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851890.650196:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851890.650198:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851890.650200:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20865@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.650201:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20865@kfi7 : PUT - for me
00000400:00000200:13.0:1773851890.650202:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20865@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.650203:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000baffe85d nid 20865@kfi7 refs 1
00000400:00000200:13.0:1773851890.650204:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20865@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.650204:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000baffe85d nid 20865@kfi7 refs 2
00000400:00000200:13.0:1773851890.650205:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000baffe85d nid 20865@kfi7 refs 3
00000400:00000200:13.0:1773851890.650206:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20864@kfi7 to cpt 0
00000400:00000200:13.0:1773851890.650207:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20864@kfi7 of length 224 into portal 12 MB=0x69b09af8e6180
00000400:00000200:13.0:1773851890.650208:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20864@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 48512
00000800:00000200:13.0:1773851890.650209:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851890.650211:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851890.650211:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20865@kfi7: PUT: OK
00000100:00000001:13.0:1773851890.650212:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851890.650213:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851890.650213:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009f562c59.
00000100:00000040:13.0:1773851890.650214:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009f562c59 x1859315762618752 msgsize 224
00000100:00100000:13.0:1773851890.650215:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20864@kfi7 (source: 12345-20865@kfi7)
00000100:00000001:13.0:1773851890.650216:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851890.650217:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000baffe85d nid 20865@kfi7 refs 2
00000100:00000001:15.0:1773851890.650218:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851890.650218:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851890.650218:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851890.650219:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851890.650219:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851890.650220:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851890.650221:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315762618752
00000020:00000001:15.0:1773851890.650222:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851890.650223:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92768
00000020:00000001:15.0:1773851890.650223:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851890.650227:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000036b32f76 refcount=6
00000020:00000001:15.0:1773851890.650227:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631502848 : -107123078048768 : ffff9e9276fc5400)
00000020:00000001:15.0:1773851890.650228:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631502848 : -107123078048768 : ffff9e9276fc5400)
00000100:00000001:15.0:1773851890.650230:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851890.650231:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851890.650231:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851890.650232:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851890.650233:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851890.650234:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851890.650234:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851890.650235:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851890.650236:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851890.650236:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851890.650237:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.650237:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851890.650239:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851890.650239:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851890.650239:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851890.650240:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20864@kfi7, seq: 2289905
00000100:00000001:12.0:1773851890.650240:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851890.650241:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000036b32f76 : new rpc_count 1
00000100:00000001:12.0:1773851890.650241:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.650242:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485602688 : -107000223948928 : ffff9eaf11a91f80)
00000100:00000001:12.0:1773851890.650242:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851890.650243:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009f562c59 x1859315762618752/t0(0) o400->f2ace1b5-0037-4b41-8112-e1083e73f796@20864@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1796-0'
00000100:00000001:15.0:1773851890.650246:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851890.650246:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851890.650248:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f562c59 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f2ace1b5-0037-4b41-8112-e1083e73f796+6:39760:x1859315762618752:12345-20864@kfi7:400:default-tuolumne1796-0
00000100:00000200:15.0:1773851890.650249:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315762618752
00000020:00000001:15.0:1773851890.650250:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851890.650250:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851890.650251:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.650252:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851890.650252:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851890.650253:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851890.650254:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315762618752, found 0 last_xid 1859315762618751
00000020:00000001:15.0:1773851890.650255:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851890.650255:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851890.650256:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851890.650256:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.650257:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851890.650258:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851890.650258:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851890.650259:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b78cbc0e.
02000000:00000001:15.0:1773851890.650260:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.650260:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.650261:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851890.650262:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686861, transno 0, xid 1859315762618752
00010000:00000001:15.0:1773851890.650263:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851890.650264:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009f562c59 x1859315762618752/t0(0) o400->f2ace1b5-0037-4b41-8112-e1083e73f796@20864@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1796-0'
00010000:00000001:15.0:1773851890.650266:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851890.650266:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851890.650267:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=123 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851890.650268:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851890.650269:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b02e814f refcount 3 to 20864@kfi7
00000100:00000001:15.0:1773851890.650270:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050432 : -107154804501184 : ffff9e8b13f11540)
02000000:00000001:15.0:1773851890.650271:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851890.650271:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.650272:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851890.650273:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20865@kfi7
00000400:00000010:15.0:1773851890.650273:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fd79a325.
00000100:00000200:15.0:1773851890.650274:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315762618752, offset 224
00000400:00000200:15.0:1773851890.650275:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20865@kfi7
00000400:00000200:15.0:1773851890.650276:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20865@kfi7 to cpt 3
00000400:00000200:15.0:1773851890.650277:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000baffe85d nid 20865@kfi7 refs 1
00000400:00000200:15.0:1773851890.650278:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000baffe85d nid 20865@kfi7 refs 2
00000400:00000200:15.0:1773851890.650280:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000baffe85d nid 20865@kfi7 refs 3
00000400:00000200:15.0:1773851890.650281:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20865@kfi7 local destination
00000400:00000200:15.0:1773851890.650283:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769987:8769987:1024:4294967295] 20865@kfi7 LPNI seq info [1379811:1379811:16:4294967295]
00000400:00000200:15.0:1773851890.650284:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000baffe85d nid 20865@kfi7 refs 2
00000400:00000200:15.0:1773851890.650285:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20865@kfi7 to cpt 3
00000400:00000200:15.0:1773851890.650287:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20865@kfi7(20865@kfi7:20865@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851890.650288:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000baffe85d nid 20865@kfi7 refs 3
00000800:00000200:15.0:1773851890.650290:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851890.650291:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851890.650293:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851890.650295:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0xdbc Using peer 20865@kfi7(0xdbc)
00000800:00000200:15.0:1773851890.650298:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0xdbc: rc=0
00000800:00000200:15.0:1773851890.650300:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0xdbc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851890.650302:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851890.650303:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b02e814f refcount 2 to 20864@kfi7
00010000:00000001:15.0:1773851890.650303:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851890.650304:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.650304:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851890.650305:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009f562c59 x1859315762618752/t0(0) o400->f2ace1b5-0037-4b41-8112-e1083e73f796@20864@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1796-0'
00000100:00100000:15.0:1773851890.650308:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f562c59 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:f2ace1b5-0037-4b41-8112-e1083e73f796+6:39760:x1859315762618752:12345-20864@kfi7:400:default-tuolumne1796-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851890.650310:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20864@kfi7, seq: 2289905
00000100:00000040:15.0:1773851890.650311:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000036b32f76 : new rpc_count 0
00000800:00000200:13.0:1773851890.650311:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0xdbc TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851890.650312:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851890.650313:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851890.650313:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851890.650313:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851890.650313:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20865@kfi7: PUT: OK
00000020:00000010:15.0:1773851890.650314:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000400:00000200:13.0:1773851890.650314:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fd79a325
00000020:00000010:15.0:1773851890.650315:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000400:00000010:13.0:1773851890.650315:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fd79a325.
00000100:00000001:13.0:1773851890.650315:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:15.0:1773851890.650316:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000036b32f76 : new refcount 5
00000100:00000001:15.0:1773851890.650316:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851890.650316:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851890.650316:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000baffe85d nid 20865@kfi7 refs 2
00000800:00000200:13.0:1773851890.650318:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2069@kfi7:3 -> 20865@kfi7(000000002ab2aaf0):0x0 lsk 3517 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0xdbc Transaction freed
00000800:00000200:17.0:1773851890.715353:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851890.715354:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851890.715356:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851890.715360:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851890.715363:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.715365:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.30@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851890.715367:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.715368:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851890.715370:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.30@o2ib60 to cpt 7
00000400:00000200:17.0:1773851890.715373:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001656502f nid 192.168.128.30@o2ib60 refs 2
00000400:00000200:17.0:1773851890.715375:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001656502f nid 192.168.128.30@o2ib60 refs 3
00000400:00000200:17.0:1773851890.715377:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.30@o2ib60 to cpt 7
00000400:00000200:17.0:1773851890.715379:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.30@o2ib60 of length 224 into portal 12 MB=0x69b2ea9464fc0
00000400:00000200:17.0:1773851890.715382:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.30@o2ib60 of length 224/224 into md 0x77fe1859d [64] + 3880
00000800:00000200:17.0:1773851890.715385:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851890.715387:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.715389:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851890.715391:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851890.715392:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851890.715393:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f4cb4fb9.
00000100:00000040:17.0:1773851890.715394:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f4cb4fb9 x1859474571022272 msgsize 224
00000100:00100000:17.0:1773851890.715397:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.30@o2ib60 (source: 12345-192.168.128.30@o2ib60)
00000100:00000001:17.0:1773851890.715400:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851890.715401:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:30.0:1773851890.715402:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851890.715403:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:30.0:1773851890.715404:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851890.715404:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851890.715405:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851890.715405:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851890.715406:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859474571022272
00000020:00000001:30.0:1773851890.715407:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851890.715407:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c5f4c8c99
00000020:00000001:30.0:1773851890.715408:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851890.715412:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000016dbd833 refcount=60342
00000020:00000001:30.0:1773851890.715413:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119964090368 : -106953745461248 : ffff9eb9e3fe9000)
00000020:00000001:30.0:1773851890.715414:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119964090368 : -106953745461248 : ffff9eb9e3fe9000)
00000100:00000001:30.0:1773851890.715415:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851890.715416:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851890.715416:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f029511a.
00000020:00000010:30.0:1773851890.715417:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851890.715418:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000700a46f0.
00000100:00000001:30.0:1773851890.715419:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851890.715420:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851890.715420:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851890.715422:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851890.715422:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851890.715422:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.715424:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851890.715425:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851890.715426:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851890.715426:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851890.715426:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851890.715427:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.30@o2ib60, seq: 2055577
00000100:00000001:31.0:1773851890.715428:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851890.715428:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000016dbd833 : new rpc_count 8
00000100:00000001:31.0:1773851890.715429:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.715429:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968764672 : -106974740786944 : ffff9eb500935100)
00000100:00000040:30.0:1773851890.715431:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f4cb4fb9 x1859474571022272/t0(0) o400->b25f32ff-1100-4bf9-a6ba-ec2e65117e7d@192.168.128.30@o2ib60:678/0 lens 224/0 e 0 to 0 dl 1773852038 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix30-0'
00000100:00000001:30.0:1773851890.715437:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851890.715437:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851890.715438:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4cb4fb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:b25f32ff-1100-4bf9-a6ba-ec2e65117e7d+60342:39928:x1859474571022272:12345-192.168.128.30@o2ib60:400:default-matrix30-0
00000100:00000200:30.0:1773851890.715440:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859474571022272
00000020:00000001:30.0:1773851890.715441:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851890.715441:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851890.715442:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.715443:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851890.715443:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851890.715444:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851890.715445:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859474571022272, found 0 last_xid 1859474567663487
00000020:00000001:30.0:1773851890.715446:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851890.715447:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851890.715447:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851890.715448:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.715449:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851890.715449:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851890.715450:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851890.715451:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057a12859.
02000000:00000001:30.0:1773851890.715451:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.715452:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.715453:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851890.715453:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264423138, transno 0, xid 1859474571022272
00010000:00000001:30.0:1773851890.715454:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851890.715455:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f4cb4fb9 x1859474571022272/t0(0) o400->b25f32ff-1100-4bf9-a6ba-ec2e65117e7d@192.168.128.30@o2ib60:678/0 lens 224/224 e 0 to 0 dl 1773852038 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix30-0'
00010000:00000001:30.0:1773851890.715458:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851890.715458:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851890.715459:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=123 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851890.715460:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851890.715461:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3ab2c81 refcount 3 to 192.168.128.30@o2ib60
00000100:00000001:30.0:1773851890.715462:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064320 : -107155994487296 : ffff9e8acd035600)
02000000:00000001:30.0:1773851890.715464:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851890.715464:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851890.715465:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851890.715466:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.30@o2ib60
00000400:00000010:30.0:1773851890.715467:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000007302f25.
00000100:00000200:30.0:1773851890.715468:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859474571022272, offset 224
00000400:00000200:30.0:1773851890.715470:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.30@o2ib60
00000400:00000200:30.0:1773851890.715471:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.30@o2ib60 to cpt 7
00000400:00000200:30.0:1773851890.715473:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001656502f nid 192.168.128.30@o2ib60 refs 2
00000400:00000200:30.0:1773851890.715475:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001656502f nid 192.168.128.30@o2ib60 refs 3
00000400:00000200:30.0:1773851890.715477:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001656502f nid 192.168.128.30@o2ib60 refs 4
00000400:00000200:30.0:1773851890.715478:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.30@o2ib60 routed destination
00000400:00000200:30.0:1773851890.715479:0:42267:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:30.0:1773851890.715480:0:42267:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:30.0:1773851890.715482:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.30@o2ib60: rtr pref emtpy: 1
00000400:00000200:30.0:1773851890.715483:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:30.0:1773851890.715484:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.30@o2ib60: rtr pref emtpy: 1
00000400:00000200:30.0:1773851890.715485:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:30.0:1773851890.715486:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769988:8769988:1024:4294967295] 17@kfi7 LPNI seq info [1250891917:1250891917:16:4294967295]
00000400:00000200:30.0:1773851890.715487:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:30.0:1773851890.715488:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:30.0:1773851890.715491:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.30@o2ib60(192.168.128.30@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851890.715492:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001656502f nid 192.168.128.30@o2ib60 refs 3
00000800:00000200:30.0:1773851890.715494:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851890.715496:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851890.715498:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851890.715500:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:30.0:1773851890.715503:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:30.0:1773851890.715507:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851890.715509:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851890.715510:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3ab2c81 refcount 2 to 192.168.128.30@o2ib60
00010000:00000001:30.0:1773851890.715511:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851890.715512:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851890.715512:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851890.715513:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f4cb4fb9 x1859474571022272/t0(0) o400->b25f32ff-1100-4bf9-a6ba-ec2e65117e7d@192.168.128.30@o2ib60:678/0 lens 224/224 e 0 to 0 dl 1773852038 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix30-0'
00000100:00100000:30.0:1773851890.715517:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4cb4fb9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:b25f32ff-1100-4bf9-a6ba-ec2e65117e7d+60342:39928:x1859474571022272:12345-192.168.128.30@o2ib60:400:default-matrix30-0 Request processed in 79us (122us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851890.715518:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00100000:30.0:1773851890.715519:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.30@o2ib60, seq: 2055577
00000100:00000040:30.0:1773851890.715520:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000016dbd833 : new rpc_count 7
00000400:00000200:29.0:1773851890.715520:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851890.715521:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851890.715521:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:30.0:1773851890.715522:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851890.715522:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851890.715522:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000007302f25
00000400:00000010:29.0:1773851890.715522:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000007302f25.
00000020:00000010:30.0:1773851890.715523:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000700a46f0.
00000100:00000001:29.0:1773851890.715523:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851890.715523:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:30.0:1773851890.715524:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f029511a.
00000400:00000200:29.0:1773851890.715524:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000040:30.0:1773851890.715525:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000016dbd833 : new refcount 60341
00000100:00000001:30.0:1773851890.715525:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851890.715525:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2054@kfi7:7 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000001a Transaction freed
00000800:00000200:2.0:1773851890.740661:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851890.740663:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851890.740665:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851890.740669:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851890.740672:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8546@kfi7 to cpt 0
00000400:00000200:2.0:1773851890.740674:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8546@kfi7 : PUT - for me
00000400:00000200:2.0:1773851890.740676:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8546@kfi7 to cpt 0
00000400:00000200:2.0:1773851890.740677:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c7b0748 nid 8546@kfi7 refs 1
00000400:00000200:2.0:1773851890.740679:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8546@kfi7 to cpt 0
00000400:00000200:2.0:1773851890.740680:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c7b0748 nid 8546@kfi7 refs 2
00000400:00000200:2.0:1773851890.740682:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000c7b0748 nid 8546@kfi7 refs 3
00000400:00000200:2.0:1773851890.740683:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8610@kfi7 to cpt 3
00000400:00000200:2.0:1773851890.740685:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8610@kfi7 of length 224 into portal 12 MB=0x69b176e1ed3c0
00000400:00000200:2.0:1773851890.740688:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8610@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 45440
00000800:00000200:2.0:1773851890.740691:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851890.740694:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851890.740696:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8546@kfi7: PUT: OK
00000100:00000001:2.0:1773851890.740698:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851890.740698:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851890.740700:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000793845b9.
00000100:00000040:2.0:1773851890.740701:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000793845b9 x1859374794331072 msgsize 224
00000100:00100000:2.0:1773851890.740704:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-8610@kfi7 (source: 12345-8546@kfi7)
00000100:00000001:2.0:1773851890.740705:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851890.740707:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000c7b0748 nid 8546@kfi7 refs 2
00000100:00000001:0.0:1773851890.740707:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851890.740708:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851890.740709:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851890.740709:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851890.740710:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851890.740710:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851890.740711:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374794331072
00000020:00000001:0.0:1773851890.740711:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851890.740712:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae12405
00000020:00000001:0.0:1773851890.740713:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851890.740715:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000094978b04 refcount=7
00000020:00000001:0.0:1773851890.740715:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946308153344 : -107127401398272 : ffff9e91754b4000)
00000020:00000001:0.0:1773851890.740716:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946308153344 : -107127401398272 : ffff9e91754b4000)
00000100:00000001:0.0:1773851890.740717:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851890.740718:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851890.740719:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd570b8d.
00000020:00000010:0.0:1773851890.740720:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851890.740721:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851890.740722:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851890.740722:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851890.740723:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851890.740728:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851890.740728:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851890.740729:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.740730:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851890.740731:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851890.740732:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851890.740733:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851890.740733:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8610@kfi7, seq: 1997613
00000100:00000001:1.0:1773851890.740734:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851890.740734:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000094978b04 : new rpc_count 2
00000100:00000001:1.0:1773851890.740735:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.740735:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637031984548992 : -107041725002624 : ffff9ea568014c80)
00000100:00000040:0.0:1773851890.740736:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000793845b9 x1859374794331072/t0(0) o400->994dd6c9-b11f-4def-8a14-256357a8f779@8610@kfi7:530/0 lens 224/0 e 0 to 0 dl 1773852645 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1020-0'
00000100:00000001:1.0:1773851890.740737:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.740739:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851890.740739:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851890.740740:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000793845b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:994dd6c9-b11f-4def-8a14-256357a8f779+7:39694:x1859374794331072:12345-8610@kfi7:400:default-tuolumne1020-0
00000100:00000200:0.0:1773851890.740742:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374794331072
00000020:00000001:0.0:1773851890.740743:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851890.740744:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851890.740745:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.740746:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851890.740746:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851890.740747:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851890.740748:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374794331072, found 0 last_xid 1859374793908991
00000020:00000001:0.0:1773851890.740749:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851890.740750:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851890.740750:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851890.740751:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.740752:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851890.740752:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851890.740753:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851890.740754:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000042ac942b.
02000000:00000001:0.0:1773851890.740754:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.740755:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.740756:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851890.740757:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183174397148, transno 0, xid 1859374794331072
00010000:00000001:0.0:1773851890.740757:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851890.740758:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000793845b9 x1859374794331072/t0(0) o400->994dd6c9-b11f-4def-8a14-256357a8f779@8610@kfi7:530/0 lens 224/224 e 0 to 0 dl 1773852645 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1020-0'
00010000:00000001:0.0:1773851890.740761:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851890.740761:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851890.740762:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=123 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851890.740763:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851890.740764:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000916487ff refcount 3 to 8610@kfi7
00000100:00000001:0.0:1773851890.740765:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153184 : -107139310398432 : ffff9e8eaf765420)
02000000:00000001:0.0:1773851890.740766:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851890.740766:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.740767:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851890.740768:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8546@kfi7
00000400:00000010:0.0:1773851890.740769:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b7cd9ccd.
00000100:00000200:0.0:1773851890.740770:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374794331072, offset 224
00000400:00000200:0.0:1773851890.740771:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8546@kfi7
00000400:00000200:0.0:1773851890.740772:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8546@kfi7 to cpt 0
00000400:00000200:0.0:1773851890.740773:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c7b0748 nid 8546@kfi7 refs 1
00000400:00000200:0.0:1773851890.740775:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000c7b0748 nid 8546@kfi7 refs 2
00000400:00000200:0.0:1773851890.740776:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000c7b0748 nid 8546@kfi7 refs 3
00000400:00000200:0.0:1773851890.740777:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8546@kfi7 local destination
00000400:00000200:0.0:1773851890.740779:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769989:8769989:1024:4294967295] 8546@kfi7 LPNI seq info [8353828:8353828:16:4294967295]
00000400:00000200:0.0:1773851890.740780:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000c7b0748 nid 8546@kfi7 refs 2
00000400:00000200:0.0:1773851890.740781:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8546@kfi7 to cpt 0
00000400:00000200:0.0:1773851890.740783:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8546@kfi7(8546@kfi7:8546@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851890.740785:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000c7b0748 nid 8546@kfi7 refs 3
00000800:00000200:0.0:1773851890.740786:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851890.740788:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851890.740790:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851890.740793:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa7 Using peer 8546@kfi7(0xa7)
00000800:00000200:0.0:1773851890.740796:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0xa7: rc=0
00000800:00000200:0.0:1773851890.740797:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851890.740799:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851890.740800:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000916487ff refcount 2 to 8610@kfi7
00010000:00000001:0.0:1773851890.740801:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851890.740801:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.740802:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851890.740802:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000793845b9 x1859374794331072/t0(0) o400->994dd6c9-b11f-4def-8a14-256357a8f779@8610@kfi7:530/0 lens 224/224 e 0 to 0 dl 1773852645 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1020-0'
00000100:00100000:0.0:1773851890.740806:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000793845b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:994dd6c9-b11f-4def-8a14-256357a8f779+7:39694:x1859374794331072:12345-8610@kfi7:400:default-tuolumne1020-0 Request processed in 67us (104us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851890.740809:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8610@kfi7, seq: 1997613
00000100:00000040:0.0:1773851890.740809:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000094978b04 : new rpc_count 1
00000100:00000001:0.0:1773851890.740810:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851890.740811:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851890.740811:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851890.740812:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851890.740813:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd570b8d.
00000020:00000040:0.0:1773851890.740813:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000094978b04 : new refcount 6
00000100:00000001:0.0:1773851890.740814:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851890.740823:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa7 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851890.740826:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851890.740828:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8546@kfi7: PUT: OK
00000400:00000200:1.0:1773851890.740829:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b7cd9ccd
00000400:00000010:1.0:1773851890.740830:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b7cd9ccd.
00000100:00000001:1.0:1773851890.740831:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851890.740833:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851890.740835:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000c7b0748 nid 8546@kfi7 refs 2
00000800:00000200:1.0:1773851890.740837:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2069@kfi7:0 -> 8546@kfi7(00000000c64472a8):0x0 lsk 168 rsk 25 tsk 0 trmk 0 tmk 0 trr 0 tta 0xa7 Transaction freed
00000800:00000200:10.0:1773851890.770237:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851890.770237:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851890.770239:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851890.770241:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851890.770243:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8497@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.770244:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8497@kfi7 : PUT - for me
00000400:00000200:10.0:1773851890.770245:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8497@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.770246:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000030e754ac nid 8497@kfi7 refs 1
00000400:00000200:10.0:1773851890.770247:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8497@kfi7 to cpt 2
00000400:00000200:10.0:1773851890.770248:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000030e754ac nid 8497@kfi7 refs 2
00000400:00000200:10.0:1773851890.770249:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000030e754ac nid 8497@kfi7 refs 3
00000400:00000200:10.0:1773851890.770250:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8689@kfi7 to cpt 5
00000400:00000200:10.0:1773851890.770251:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8689@kfi7 of length 224 into portal 12 MB=0x69b95a59fc480
00000400:00000200:10.0:1773851890.770252:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8689@kfi7 of length 224/224 into md 0x78146ce49 [64] + 154520
00000800:00000200:10.0:1773851890.770254:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851890.770255:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851890.770257:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8497@kfi7: PUT: OK
00000100:00000001:10.0:1773851890.770258:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851890.770258:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851890.770259:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ab8250d3.
00000100:00000040:10.0:1773851890.770260:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000ab8250d3 x1859916891407488 msgsize 224
00000100:00100000:10.0:1773851890.770262:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-8689@kfi7 (source: 12345-8497@kfi7)
00000100:00000001:10.0:1773851890.770263:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851890.770264:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000030e754ac nid 8497@kfi7 refs 2
00000800:00000200:10.0:1773851890.770265:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851890.770265:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851890.770265:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851890.770266:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851890.770266:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851890.770267:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851890.770268:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859916891407488
00000020:00000001:8.0:1773851890.770269:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851890.770269:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b64984255
00000020:00000001:8.0:1773851890.770270:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851890.770272:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000390dd9d3 refcount=7
00000020:00000001:8.0:1773851890.770273:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637039584921600 : -107034124630016 : ffff9ea72d05c800)
00000020:00000001:8.0:1773851890.770274:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637039584921600 : -107034124630016 : ffff9ea72d05c800)
00000100:00000001:8.0:1773851890.770275:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851890.770276:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851890.770277:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000339c92f7.
00000020:00000010:8.0:1773851890.770278:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851890.770279:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851890.770280:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851890.770281:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851890.770282:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851890.770283:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851890.770283:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851890.770284:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.770284:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851890.770286:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851890.770286:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851890.770287:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851890.770287:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851890.770288:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8689@kfi7, seq: 2130845
00000100:00000040:9.0:1773851890.770288:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000390dd9d3 : new rpc_count 2
00000100:00000001:9.0:1773851890.770289:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087748352 : -106944621803264 : ffff9ebc03ce8900)
00000100:00000001:8.0:1773851890.770289:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851890.770289:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851890.770291:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ab8250d3 x1859916891407488/t0(0) o400->8c8b6816-3a70-4aca-88f8-774e19b438cf@8689@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1021-0'
00000100:00000001:9.0:1773851890.770294:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851890.770294:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851890.770295:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab8250d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8c8b6816-3a70-4aca-88f8-774e19b438cf+7:39791:x1859916891407488:12345-8689@kfi7:400:default-tuolumne1021-0
00000100:00000200:9.0:1773851890.770296:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859916891407488
00000020:00000001:9.0:1773851890.770298:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851890.770298:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851890.770299:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851890.770300:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851890.770300:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851890.770301:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851890.770302:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859916891407488, found 0 last_xid 1859916891026303
00000020:00000001:9.0:1773851890.770303:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851890.770303:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851890.770304:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851890.770304:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851890.770305:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851890.770306:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851890.770306:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851890.770307:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009aae1527.
02000000:00000001:9.0:1773851890.770308:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851890.770308:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851890.770309:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851890.770310:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183143569963, transno 0, xid 1859916891407488
00010000:00000001:9.0:1773851890.770311:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851890.770311:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ab8250d3 x1859916891407488/t0(0) o400->8c8b6816-3a70-4aca-88f8-774e19b438cf@8689@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1021-0'
00010000:00000001:9.0:1773851890.770314:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851890.770314:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851890.770315:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=123 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851890.770316:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851890.770317:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000fea0ffc refcount 3 to 8689@kfi7
00000100:00000001:9.0:1773851890.770318:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956271776 : -107146753279840 : ffff9e8cf3d4f8a0)
02000000:00000001:9.0:1773851890.770319:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851890.770319:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851890.770320:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851890.770321:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8497@kfi7
00000400:00000010:9.0:1773851890.770321:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000087a60580.
00000100:00000200:9.0:1773851890.770322:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859916891407488, offset 224
00000400:00000200:9.0:1773851890.770324:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8497@kfi7
00000400:00000200:9.0:1773851890.770325:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8497@kfi7 to cpt 2
00000400:00000200:9.0:1773851890.770326:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000030e754ac nid 8497@kfi7 refs 1
00000400:00000200:9.0:1773851890.770327:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000030e754ac nid 8497@kfi7 refs 2
00000400:00000200:9.0:1773851890.770328:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000030e754ac nid 8497@kfi7 refs 3
00000400:00000200:9.0:1773851890.770330:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8497@kfi7 local destination
00000400:00000200:9.0:1773851890.770331:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769990:8769990:1024:4294967295] 8497@kfi7 LPNI seq info [3982411:3982411:16:4294967295]
00000400:00000200:9.0:1773851890.770333:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000030e754ac nid 8497@kfi7 refs 2
00000400:00000200:9.0:1773851890.770333:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8497@kfi7 to cpt 2
00000400:00000200:9.0:1773851890.770335:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8497@kfi7(8497@kfi7:8497@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851890.770336:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000030e754ac nid 8497@kfi7 refs 3
00000800:00000200:9.0:1773851890.770338:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851890.770339:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851890.770341:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851890.770343:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d51 Using peer 8497@kfi7(0x100000000000d51)
00000800:00000200:9.0:1773851890.770346:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x100000000000d51: rc=0
00000800:00000200:9.0:1773851890.770348:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d51 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851890.770350:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851890.770351:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000fea0ffc refcount 2 to 8689@kfi7
00010000:00000001:9.0:1773851890.770352:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851890.770352:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851890.770353:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851890.770353:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ab8250d3 x1859916891407488/t0(0) o400->8c8b6816-3a70-4aca-88f8-774e19b438cf@8689@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1021-0'
00000100:00100000:9.0:1773851890.770357:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab8250d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:8c8b6816-3a70-4aca-88f8-774e19b438cf+7:39791:x1859916891407488:12345-8689@kfi7:400:default-tuolumne1021-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851890.770361:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8689@kfi7, seq: 2130845
00000800:00000200:10.0:1773851890.770362:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d51 TN_EVENT_TX_OK event status 0
00000100:00000040:9.0:1773851890.770362:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000390dd9d3 : new rpc_count 1
00000100:00000001:9.0:1773851890.770363:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851890.770363:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851890.770364:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:9.0:1773851890.770364:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000400:00000200:10.0:1773851890.770365:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8497@kfi7: PUT: OK
00000020:00000010:9.0:1773851890.770365:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000400:00000200:10.0:1773851890.770366:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000087a60580
00000400:00000010:10.0:1773851890.770366:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000087a60580.
00000020:00000010:9.0:1773851890.770366:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000339c92f7.
00000100:00000001:10.0:1773851890.770367:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851890.770367:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:9.0:1773851890.770367:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000390dd9d3 : new refcount 6
00000100:00000001:9.0:1773851890.770367:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851890.770368:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000030e754ac nid 8497@kfi7 refs 2
00000800:00000200:10.0:1773851890.770370:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2054@kfi7:2 -> 8497@kfi7(00000000c66ebd7a):0x0 lsk 3410 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d51 Transaction freed
00010000:00000001:2.0:1773851890.825729:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825729:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851890.825730:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851890.825732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851890.825733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851890.825734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851890.825735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851890.825736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851890.825737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851890.825737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.825743:0:41153:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:4.0:1773851890.825744:0:41153:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:4.0:1773851890.825745:0:41153:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:23.0:1773851890.860172:0:2495434:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851890.860174:0:2495434:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:23.0:1773851890.860175:0:2495434:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:23.0:1773851890.860179:0:2495434:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:23.0:1773851890.860181:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24227@kfi7 to cpt 5
00000400:00000200:23.0:1773851890.860183:0:2495434:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24227@kfi7 : PUT - for me
00000400:00000200:23.0:1773851890.860184:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24227@kfi7 to cpt 5
00000400:00000200:23.0:1773851890.860186:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000946b7ad4 nid 24227@kfi7 refs 1
00000400:00000200:23.0:1773851890.860187:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24227@kfi7 to cpt 5
00000400:00000200:23.0:1773851890.860188:0:2495434:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000946b7ad4 nid 24227@kfi7 refs 2
00000400:00000200:23.0:1773851890.860189:0:2495434:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000946b7ad4 nid 24227@kfi7 refs 3
00000400:00000200:23.0:1773851890.860191:0:2495434:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24162@kfi7 to cpt 6
00000400:00000200:23.0:1773851890.860192:0:2495434:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24162@kfi7 of length 224 into portal 12 MB=0x699e17d9fb1c0
00000400:00000200:23.0:1773851890.860194:0:2495434:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24162@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 58888
00000800:00000200:23.0:1773851890.860197:0:2495434:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:23.0:1773851890.860199:0:2495434:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:23.0:1773851890.860200:0:2495434:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24227@kfi7: PUT: OK
00000100:00000001:23.0:1773851890.860202:0:2495434:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:23.0:1773851890.860202:0:2495434:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:23.0:1773851890.860203:0:2495434:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001581d6d0.
00000100:00000040:23.0:1773851890.860204:0:2495434:0:(events.c:358:request_in_callback()) incoming req@000000001581d6d0 x1858043614572992 msgsize 224
00000100:00100000:23.0:1773851890.860205:0:2495434:0:(events.c:361:request_in_callback()) peer: 12345-24162@kfi7 (source: 12345-24227@kfi7)
00000100:00000001:23.0:1773851890.860207:0:2495434:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:23.0:1773851890.860208:0:2495434:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000946b7ad4 nid 24227@kfi7 refs 2
00000100:00000001:20.0:1773851890.860208:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:23.0:1773851890.860209:0:2495434:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006caa26ea: 2069@kfi7:5 <- 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851890.860209:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851890.860209:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851890.860210:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851890.860211:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851890.860212:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043614572992
00000020:00000001:20.0:1773851890.860212:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851890.860213:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d2f
00000020:00000001:20.0:1773851890.860214:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851890.860219:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a000f48 refcount=6
00000020:00000001:20.0:1773851890.860219:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239482368 : -107152470069248 : ffff9e8b9f15b000)
00000020:00000001:20.0:1773851890.860220:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239482368 : -107152470069248 : ffff9e8b9f15b000)
00000100:00000001:20.0:1773851890.860222:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851890.860223:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851890.860223:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e14bbbb6.
00000020:00000010:20.0:1773851890.860224:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851890.860225:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ee24a6ca.
00000100:00000001:20.0:1773851890.860226:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851890.860227:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851890.860227:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851890.860229:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851890.860229:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851890.860230:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.860231:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851890.860232:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851890.860232:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851890.860233:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851890.860233:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851890.860234:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24162@kfi7, seq: 1998055
00000100:00000040:23.0:1773851890.860235:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a000f48 : new rpc_count 1
00000100:00000001:20.0:1773851890.860235:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851890.860235:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851890.860236:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133285637888 : -106940423913728 : ffff9ebcfe053f00)
00000100:00000040:23.0:1773851890.860237:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001581d6d0 x1858043614572992/t0(0) o400->cbdfefe2-1831-4d41-9971-5cfba8048d51@24162@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1996-0'
00000100:00000001:23.0:1773851890.860240:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851890.860241:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851890.860242:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001581d6d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:cbdfefe2-1831-4d41-9971-5cfba8048d51+6:39822:x1858043614572992:12345-24162@kfi7:400:default-tuolumne1996-0
00000100:00000200:23.0:1773851890.860244:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043614572992
00000020:00000001:23.0:1773851890.860245:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851890.860245:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851890.860246:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851890.860247:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851890.860247:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851890.860248:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851890.860249:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043614572992, found 0 last_xid 1858043614572991
00000020:00000001:23.0:1773851890.860250:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851890.860251:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851890.860251:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851890.860252:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851890.860252:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851890.860253:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851890.860254:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851890.860254:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a6c8ed98.
02000000:00000001:23.0:1773851890.860255:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851890.860256:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851890.860257:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851890.860257:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183047170147, transno 0, xid 1858043614572992
00010000:00000001:23.0:1773851890.860258:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851890.860259:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001581d6d0 x1858043614572992/t0(0) o400->cbdfefe2-1831-4d41-9971-5cfba8048d51@24162@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1996-0'
00010000:00000001:23.0:1773851890.860262:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851890.860262:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851890.860263:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=123 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851890.860265:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851890.860265:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e5f35743 refcount 3 to 24162@kfi7
00000100:00000001:23.0:1773851890.860266:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419264 : -107156724132352 : ffff9e8aa185d600)
02000000:00000001:23.0:1773851890.860267:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851890.860267:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851890.860268:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851890.860269:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24227@kfi7
00000400:00000010:23.0:1773851890.860269:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000403003e5.
00000100:00000200:23.0:1773851890.860270:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043614572992, offset 224
00000400:00000200:23.0:1773851890.860272:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24227@kfi7
00000400:00000200:23.0:1773851890.860273:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24227@kfi7 to cpt 5
00000400:00000200:23.0:1773851890.860273:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000946b7ad4 nid 24227@kfi7 refs 1
00000400:00000200:23.0:1773851890.860274:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000946b7ad4 nid 24227@kfi7 refs 2
00000400:00000200:23.0:1773851890.860276:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000946b7ad4 nid 24227@kfi7 refs 3
00000400:00000200:23.0:1773851890.860277:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24227@kfi7 local destination
00000400:00000200:23.0:1773851890.860278:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769991:8769991:1024:4294967295] 24227@kfi7 LPNI seq info [10149606:10149606:16:4294967295]
00000400:00000200:23.0:1773851890.860280:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000946b7ad4 nid 24227@kfi7 refs 2
00000400:00000200:23.0:1773851890.860281:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24227@kfi7 to cpt 5
00000400:00000200:23.0:1773851890.860282:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24227@kfi7(24227@kfi7:24227@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851890.860284:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000946b7ad4 nid 24227@kfi7 refs 3
00000800:00000200:23.0:1773851890.860285:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851890.860286:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851890.860289:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851890.860291:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x66 Using peer 24227@kfi7(0x66)
00000800:00000200:23.0:1773851890.860295:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x66: rc=0
00000800:00000200:23.0:1773851890.860296:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x66 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851890.860299:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851890.860300:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e5f35743 refcount 2 to 24162@kfi7
00010000:00000001:23.0:1773851890.860300:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851890.860301:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851890.860302:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851890.860302:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001581d6d0 x1858043614572992/t0(0) o400->cbdfefe2-1831-4d41-9971-5cfba8048d51@24162@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1996-0'
00000100:00100000:23.0:1773851890.860306:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001581d6d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:cbdfefe2-1831-4d41-9971-5cfba8048d51+6:39822:x1858043614572992:12345-24162@kfi7:400:default-tuolumne1996-0 Request processed in 64us (101us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851890.860308:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24162@kfi7, seq: 1998055
00000100:00000040:23.0:1773851890.860309:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a000f48 : new rpc_count 0
00000100:00000001:23.0:1773851890.860309:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851890.860310:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851890.860311:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000800:00000200:21.0:1773851890.860311:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x66 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851890.860312:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ee24a6ca.
00000020:00000010:23.0:1773851890.860313:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e14bbbb6.
00000020:00000040:23.0:1773851890.860313:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009a000f48 : new refcount 5
00000400:00000200:21.0:1773851890.860313:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851890.860314:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851890.860315:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24227@kfi7: PUT: OK
00000400:00000200:21.0:1773851890.860317:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000403003e5
00000400:00000010:21.0:1773851890.860317:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000403003e5.
00000100:00000001:21.0:1773851890.860319:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851890.860319:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851890.860321:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000946b7ad4 nid 24227@kfi7 refs 2
00000800:00000200:21.0:1773851890.860323:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2069@kfi7:5 -> 24227@kfi7(0000000060f3b13d):0x0 lsk 103 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x66 Transaction freed
00000800:00000200:17.0:1773851890.917855:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851890.917857:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851890.917859:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851890.917862:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851890.917865:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15603@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.917867:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15603@kfi7 : PUT - for me
00000400:00000200:17.0:1773851890.917868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15603@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.917869:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c31d9504 nid 15603@kfi7 refs 1
00000400:00000200:17.0:1773851890.917871:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15603@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.917872:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c31d9504 nid 15603@kfi7 refs 2
00000400:00000200:17.0:1773851890.917873:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c31d9504 nid 15603@kfi7 refs 3
00000400:00000200:17.0:1773851890.917875:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15411@kfi7 to cpt 1
00000400:00000200:17.0:1773851890.917876:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15411@kfi7 of length 224 into portal 12 MB=0x69b4b5cfc6e00
00000400:00000200:17.0:1773851890.917878:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15411@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 39824
00000800:00000200:17.0:1773851890.917880:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851890.917883:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.917884:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15603@kfi7: PUT: OK
00000100:00000001:17.0:1773851890.917886:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851890.917886:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851890.917887:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000df9e5aaf.
00000100:00000040:17.0:1773851890.917888:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000df9e5aaf x1859597845163520 msgsize 224
00000100:00100000:17.0:1773851890.917891:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15411@kfi7 (source: 12345-15603@kfi7)
00000100:00000001:17.0:1773851890.917892:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851890.917893:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c31d9504 nid 15603@kfi7 refs 2
00000100:00000001:16.0:1773851890.917895:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851890.917896:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851890.917897:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851890.917898:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851890.917899:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851890.917900:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851890.917901:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597845163520
00000020:00000001:16.0:1773851890.917903:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851890.917903:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fe9d
00000020:00000001:16.0:1773851890.917904:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851890.917908:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7716c89 refcount=5
00000020:00000001:16.0:1773851890.917910:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113575203840 : -106960134347776 : ffff9eb8672fe400)
00000020:00000001:16.0:1773851890.917912:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113575203840 : -106960134347776 : ffff9eb8672fe400)
00000100:00000001:16.0:1773851890.917913:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851890.917914:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851890.917916:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005f7e8414.
00000020:00000010:16.0:1773851890.917917:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851890.917919:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000096f6d53.
00000100:00000001:16.0:1773851890.917921:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851890.917921:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851890.917922:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851890.917924:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851890.917925:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851890.917926:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851890.917927:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851890.917930:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851890.917930:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851890.917931:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851890.917931:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851890.917933:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15411@kfi7, seq: 2156410
00000100:00000040:17.0:1773851890.917934:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7716c89 : new rpc_count 1
00000100:00000001:16.0:1773851890.917934:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.917935:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968750848 : -106974740800768 : ffff9eb500931b00)
00000100:00000001:16.0:1773851890.917935:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851890.917937:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000df9e5aaf x1859597845163520/t0(0) o400->c456c522-3774-42c0-ab18-c6e2c8d27199@15411@kfi7:140/0 lens 224/0 e 0 to 0 dl 1773852255 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1449-0'
00000100:00000001:17.0:1773851890.917942:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851890.917942:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851890.917944:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000df9e5aaf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c456c522-3774-42c0-ab18-c6e2c8d27199+5:39662:x1859597845163520:12345-15411@kfi7:400:default-tuolumne1449-0
00000100:00000200:17.0:1773851890.917946:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597845163520
00000020:00000001:17.0:1773851890.917947:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851890.917948:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851890.917949:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.917951:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851890.917951:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851890.917953:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851890.917954:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597845163520, found 0 last_xid 1859597845163519
00000020:00000001:17.0:1773851890.917955:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851890.917956:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851890.917957:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851890.917957:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.917958:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851890.917960:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851890.917960:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851890.917962:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c2700f24.
02000000:00000001:17.0:1773851890.917963:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.917964:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.917965:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851890.917966:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035366991, transno 0, xid 1859597845163520
00010000:00000001:17.0:1773851890.917967:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851890.917968:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000df9e5aaf x1859597845163520/t0(0) o400->c456c522-3774-42c0-ab18-c6e2c8d27199@15411@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1449-0'
00010000:00000001:17.0:1773851890.917972:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851890.917973:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851890.917974:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=123 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851890.917977:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851890.917978:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f44b7aad refcount 3 to 15411@kfi7
00000100:00000001:17.0:1773851890.917979:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981728 : -107130476569888 : ffff9e90bdffdae0)
02000000:00000001:17.0:1773851890.917980:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851890.917981:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.917982:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851890.917983:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15603@kfi7
00000400:00000010:17.0:1773851890.917984:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c441fca1.
00000100:00000200:17.0:1773851890.917985:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597845163520, offset 224
00000400:00000200:17.0:1773851890.917988:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15603@kfi7
00000400:00000200:17.0:1773851890.917989:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15603@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.917990:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c31d9504 nid 15603@kfi7 refs 1
00000400:00000200:17.0:1773851890.917992:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c31d9504 nid 15603@kfi7 refs 2
00000400:00000200:17.0:1773851890.917994:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c31d9504 nid 15603@kfi7 refs 3
00000400:00000200:17.0:1773851890.917996:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15603@kfi7 local destination
00000400:00000200:17.0:1773851890.917998:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769992:8769992:1024:4294967295] 15603@kfi7 LPNI seq info [831143:831143:16:4294967295]
00000400:00000200:17.0:1773851890.918000:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c31d9504 nid 15603@kfi7 refs 2
00000400:00000200:17.0:1773851890.918001:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15603@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.918005:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15603@kfi7(15603@kfi7:15603@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851890.918006:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c31d9504 nid 15603@kfi7 refs 3
00000800:00000200:17.0:1773851890.918008:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851890.918010:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851890.918014:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851890.918017:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b7e Using peer 15603@kfi7(0x100000000000b7e)
00000800:00000200:17.0:1773851890.918023:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x100000000000b7e: rc=0
00000800:00000200:17.0:1773851890.918025:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b7e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851890.918028:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851890.918030:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f44b7aad refcount 2 to 15411@kfi7
00010000:00000001:17.0:1773851890.918031:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851890.918032:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.918033:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851890.918034:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000df9e5aaf x1859597845163520/t0(0) o400->c456c522-3774-42c0-ab18-c6e2c8d27199@15411@kfi7:140/0 lens 224/224 e 0 to 0 dl 1773852255 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1449-0'
00000100:00100000:17.0:1773851890.918039:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000df9e5aaf pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c456c522-3774-42c0-ab18-c6e2c8d27199+5:39662:x1859597845163520:12345-15411@kfi7:400:default-tuolumne1449-0 Request processed in 96us (149us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851890.918041:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b7e TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851890.918043:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15411@kfi7, seq: 2156410
00000100:00000040:17.0:1773851890.918044:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7716c89 : new rpc_count 0
00000400:00000200:18.0:1773851890.918046:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851890.918046:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851890.918046:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851890.918047:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000400:00000200:18.0:1773851890.918048:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15603@kfi7: PUT: OK
00000400:00000200:18.0:1773851890.918049:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c441fca1
00000020:00000010:17.0:1773851890.918049:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000096f6d53.
00000400:00000010:18.0:1773851890.918050:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c441fca1.
00000020:00000010:17.0:1773851890.918050:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005f7e8414.
00000100:00000001:18.0:1773851890.918051:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:17.0:1773851890.918051:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000a7716c89 : new refcount 4
00000100:00000001:18.0:1773851890.918052:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851890.918052:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851890.918053:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c31d9504 nid 15603@kfi7 refs 2
00000800:00000200:18.0:1773851890.918055:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15603@kfi7(000000001ee6bd6c):0x0 lsk 2943 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000b7e Transaction freed
00000800:00000200:1.0:1773851890.918425:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851890.918426:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851890.918427:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851890.918429:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851890.918431:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19937@kfi7 to cpt 0
00000400:00000200:1.0:1773851890.918432:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19937@kfi7 : PUT - for me
00000400:00000200:1.0:1773851890.918433:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19937@kfi7 to cpt 0
00000400:00000200:1.0:1773851890.918434:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000117235f4 nid 19937@kfi7 refs 1
00000400:00000200:1.0:1773851890.918435:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19937@kfi7 to cpt 0
00000400:00000200:1.0:1773851890.918436:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000117235f4 nid 19937@kfi7 refs 2
00000400:00000200:1.0:1773851890.918436:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000117235f4 nid 19937@kfi7 refs 3
00000400:00000200:1.0:1773851890.918437:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19745@kfi7 to cpt 5
00000400:00000200:1.0:1773851890.918438:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19745@kfi7 of length 224 into portal 12 MB=0x699e1af3b4fc0
00000400:00000200:1.0:1773851890.918440:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19745@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 45664
00000800:00000200:1.0:1773851890.918441:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851890.918443:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851890.918444:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19937@kfi7: PUT: OK
00000100:00000001:1.0:1773851890.918445:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851890.918446:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851890.918447:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003b046b06.
00000100:00000040:1.0:1773851890.918447:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000003b046b06 x1858044446855104 msgsize 224
00000100:00100000:1.0:1773851890.918449:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-19745@kfi7 (source: 12345-19937@kfi7)
00000100:00000001:1.0:1773851890.918450:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851890.918451:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000117235f4 nid 19937@kfi7 refs 2
00000100:00000001:0.0:1773851890.918452:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851890.918452:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851890.918453:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851890.918453:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851890.918453:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851890.918454:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851890.918455:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044446855104
00000020:00000001:0.0:1773851890.918456:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851890.918456:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925a8
00000020:00000001:0.0:1773851890.918457:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851890.918459:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001b132dd0 refcount=6
00000020:00000001:0.0:1773851890.918459:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631016448 : -107123078535168 : ffff9e9276f4e800)
00000020:00000001:0.0:1773851890.918460:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631016448 : -107123078535168 : ffff9e9276f4e800)
00000100:00000001:0.0:1773851890.918461:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851890.918462:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851890.918462:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd570b8d.
00000020:00000010:0.0:1773851890.918463:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851890.918464:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851890.918465:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851890.918465:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851890.918466:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851890.918466:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851890.918467:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851890.918467:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.918468:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851890.918469:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851890.918470:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851890.918470:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851890.918470:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851890.918471:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19745@kfi7, seq: 1997614
00000100:00000040:0.0:1773851890.918471:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001b132dd0 : new rpc_count 1
00000100:00000001:1.0:1773851890.918472:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851890.918472:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.918472:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112250624 : -106950597300992 : ffff9eba9fa3ad00)
00000100:00000040:0.0:1773851890.918473:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003b046b06 x1858044446855104/t0(0) o400->32001649-2061-4758-98ae-35ef0c23bd65@19745@kfi7:530/0 lens 224/0 e 0 to 0 dl 1773852645 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1727-0'
00000100:00000001:0.0:1773851890.918475:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851890.918476:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851890.918477:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003b046b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:32001649-2061-4758-98ae-35ef0c23bd65+6:39674:x1858044446855104:12345-19745@kfi7:400:default-tuolumne1727-0
00000100:00000200:0.0:1773851890.918478:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044446855104
00000020:00000001:0.0:1773851890.918478:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851890.918479:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851890.918480:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.918480:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851890.918481:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851890.918481:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851890.918482:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044446855104, found 0 last_xid 1858044446855103
00000020:00000001:0.0:1773851890.918482:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851890.918483:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851890.918483:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851890.918484:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.918485:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851890.918485:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851890.918485:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851890.918486:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b1cce025.
02000000:00000001:0.0:1773851890.918487:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.918487:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.918488:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851890.918488:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262827533, transno 0, xid 1858044446855104
00010000:00000001:0.0:1773851890.918489:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851890.918490:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003b046b06 x1858044446855104/t0(0) o400->32001649-2061-4758-98ae-35ef0c23bd65@19745@kfi7:530/0 lens 224/224 e 0 to 0 dl 1773852645 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1727-0'
00010000:00000001:0.0:1773851890.918492:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851890.918492:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851890.918493:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=123 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851890.918494:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851890.918495:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000043816f45 refcount 3 to 19745@kfi7
00000100:00000001:0.0:1773851890.918495:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109376 : -107156354442240 : ffff9e8ab78edc00)
02000000:00000001:0.0:1773851890.918496:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851890.918496:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851890.918497:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851890.918498:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19937@kfi7
00000400:00000010:0.0:1773851890.918498:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079ba0077.
00000100:00000200:0.0:1773851890.918499:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044446855104, offset 224
00000400:00000200:0.0:1773851890.918500:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19937@kfi7
00000400:00000200:0.0:1773851890.918501:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19937@kfi7 to cpt 0
00000400:00000200:0.0:1773851890.918502:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000117235f4 nid 19937@kfi7 refs 1
00000400:00000200:0.0:1773851890.918505:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000117235f4 nid 19937@kfi7 refs 2
00000400:00000200:0.0:1773851890.918505:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000117235f4 nid 19937@kfi7 refs 3
00000400:00000200:0.0:1773851890.918507:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19937@kfi7 local destination
00000400:00000200:0.0:1773851890.918508:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769993:8769993:1024:4294967295] 19937@kfi7 LPNI seq info [5685237:5685237:16:4294967295]
00000400:00000200:0.0:1773851890.918509:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000117235f4 nid 19937@kfi7 refs 2
00000400:00000200:0.0:1773851890.918510:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19937@kfi7 to cpt 0
00000400:00000200:0.0:1773851890.918511:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19937@kfi7(19937@kfi7:19937@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851890.918513:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000117235f4 nid 19937@kfi7 refs 3
00000800:00000200:0.0:1773851890.918514:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851890.918515:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851890.918516:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851890.918518:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79 Using peer 19937@kfi7(0x79)
00000800:00000200:0.0:1773851890.918521:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x79: rc=0
00000800:00000200:0.0:1773851890.918522:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851890.918524:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851890.918525:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000043816f45 refcount 2 to 19745@kfi7
00010000:00000001:0.0:1773851890.918525:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851890.918526:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851890.918526:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851890.918527:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003b046b06 x1858044446855104/t0(0) o400->32001649-2061-4758-98ae-35ef0c23bd65@19745@kfi7:530/0 lens 224/224 e 0 to 0 dl 1773852645 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1727-0'
00000100:00100000:0.0:1773851890.918531:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003b046b06 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:32001649-2061-4758-98ae-35ef0c23bd65+6:39674:x1858044446855104:12345-19745@kfi7:400:default-tuolumne1727-0 Request processed in 53us (81us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851890.918533:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19745@kfi7, seq: 1997614
00000100:00000040:0.0:1773851890.918534:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001b132dd0 : new rpc_count 0
00000100:00000001:0.0:1773851890.918535:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851890.918535:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851890.918536:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851890.918536:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851890.918537:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd570b8d.
00000020:00000040:0.0:1773851890.918538:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000001b132dd0 : new refcount 5
00000100:00000001:0.0:1773851890.918538:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851890.918543:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851890.918545:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851890.918546:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19937@kfi7: PUT: OK
00000400:00000200:1.0:1773851890.918547:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079ba0077
00000400:00000010:1.0:1773851890.918547:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079ba0077.
00000100:00000001:1.0:1773851890.918548:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851890.918549:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851890.918550:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000117235f4 nid 19937@kfi7 refs 2
00000800:00000200:1.0:1773851890.918551:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 19937@kfi7(0000000065b25e16):0x0 lsk 122 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x79 Transaction freed
00000800:00000200:13.0:1773851890.937807:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851890.937808:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851890.937809:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851890.937810:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851890.937812:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26593@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.937813:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26593@kfi7 : PUT - for me
00000400:00000200:13.0:1773851890.937814:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26593@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.937815:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ad901e10 nid 26593@kfi7 refs 1
00000400:00000200:13.0:1773851890.937816:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26593@kfi7 to cpt 3
00000400:00000200:13.0:1773851890.937817:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ad901e10 nid 26593@kfi7 refs 2
00000400:00000200:13.0:1773851890.937817:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ad901e10 nid 26593@kfi7 refs 3
00000400:00000200:13.0:1773851890.937818:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26401@kfi7 to cpt 0
00000400:00000200:13.0:1773851890.937819:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26401@kfi7 of length 224 into portal 12 MB=0x699e164ad8dc0
00000400:00000200:13.0:1773851890.937820:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26401@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 48736
00000800:00000200:13.0:1773851890.937822:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851890.937823:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851890.937824:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26593@kfi7: PUT: OK
00000100:00000001:13.0:1773851890.937825:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851890.937825:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851890.937826:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b980bba7.
00000100:00000040:13.0:1773851890.937826:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000b980bba7 x1858043196050880 msgsize 224
00000100:00100000:13.0:1773851890.937828:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-26401@kfi7 (source: 12345-26593@kfi7)
00000100:00000001:13.0:1773851890.937828:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851890.937829:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ad901e10 nid 26593@kfi7 refs 2
00000100:00000001:15.0:1773851890.937830:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851890.937831:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851890.937831:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851890.937831:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851890.937832:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851890.937833:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851890.937833:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043196050880
00000020:00000001:15.0:1773851890.937834:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851890.937834:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91738
00000020:00000001:15.0:1773851890.937835:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851890.937838:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d61f67a2 refcount=737
00000020:00000001:15.0:1773851890.937839:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241491456 : -107152468060160 : ffff9e8b9f345800)
00000020:00000001:15.0:1773851890.937840:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241491456 : -107152468060160 : ffff9e8b9f345800)
00000100:00000001:15.0:1773851890.937841:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851890.937842:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851890.937842:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851890.937843:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851890.937844:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851890.937845:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851890.937846:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851890.937846:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851890.937847:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851890.937847:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851890.937848:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.937849:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851890.937850:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851890.937850:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851890.937850:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851890.937851:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26401@kfi7, seq: 2289906
00000100:00000001:12.0:1773851890.937851:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851890.937852:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d61f67a2 : new rpc_count 12
00000100:00000001:12.0:1773851890.937852:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.937853:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485619968 : -107000223931648 : ffff9eaf11a96300)
00000100:00000001:12.0:1773851890.937853:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851890.937855:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b980bba7 x1858043196050880/t0(0) o400->4042a235-a60a-403f-b811-96c454acd7e5@26401@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2143-0'
00000100:00000001:15.0:1773851890.937857:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851890.937858:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851890.937859:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b980bba7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4042a235-a60a-403f-b811-96c454acd7e5+737:39832:x1858043196050880:12345-26401@kfi7:400:default-tuolumne2143-0
00000100:00000200:15.0:1773851890.937860:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043196050880
00000020:00000001:15.0:1773851890.937861:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851890.937861:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851890.937862:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.937863:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851890.937863:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851890.937864:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851890.937865:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043196050880, found 0 last_xid 1858043189324415
00000020:00000001:15.0:1773851890.937865:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851890.937866:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851890.937866:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851890.937867:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.937867:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851890.937868:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851890.937869:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851890.937869:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a90fafc3.
02000000:00000001:15.0:1773851890.937870:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.937871:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.937871:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851890.937872:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589781, transno 0, xid 1858043196050880
00010000:00000001:15.0:1773851890.937873:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851890.937874:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b980bba7 x1858043196050880/t0(0) o400->4042a235-a60a-403f-b811-96c454acd7e5@26401@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2143-0'
00010000:00000001:15.0:1773851890.937876:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851890.937876:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851890.937877:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=123 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851890.937878:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851890.937879:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000783e076f refcount 3 to 26401@kfi7
00000100:00000001:15.0:1773851890.937880:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050624 : -107154804500992 : ffff9e8b13f11600)
02000000:00000001:15.0:1773851890.937881:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851890.937881:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851890.937882:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851890.937883:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26593@kfi7
00000400:00000010:15.0:1773851890.937883:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022f323c7.
00000100:00000200:15.0:1773851890.937884:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043196050880, offset 224
00000400:00000200:15.0:1773851890.937886:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26593@kfi7
00000400:00000200:15.0:1773851890.937887:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26593@kfi7 to cpt 3
00000400:00000200:15.0:1773851890.937888:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ad901e10 nid 26593@kfi7 refs 1
00000400:00000200:15.0:1773851890.937889:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ad901e10 nid 26593@kfi7 refs 2
00000400:00000200:15.0:1773851890.937890:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ad901e10 nid 26593@kfi7 refs 3
00000400:00000200:15.0:1773851890.937891:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26593@kfi7 local destination
00000400:00000200:15.0:1773851890.937892:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769994:8769994:1024:4294967295] 26593@kfi7 LPNI seq info [2019137:2019137:16:4294967295]
00000400:00000200:15.0:1773851890.937893:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ad901e10 nid 26593@kfi7 refs 2
00000400:00000200:15.0:1773851890.937894:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26593@kfi7 to cpt 3
00000400:00000200:15.0:1773851890.937896:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26593@kfi7(26593@kfi7:26593@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851890.937898:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ad901e10 nid 26593@kfi7 refs 3
00000800:00000200:15.0:1773851890.937899:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851890.937900:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851890.937902:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851890.937904:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26d Using peer 26593@kfi7(0x26d)
00000800:00000200:15.0:1773851890.937907:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x26d: rc=0
00000800:00000200:15.0:1773851890.937909:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851890.937911:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851890.937912:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000783e076f refcount 2 to 26401@kfi7
00010000:00000001:15.0:1773851890.937913:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851890.937913:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851890.937914:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851890.937915:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b980bba7 x1858043196050880/t0(0) o400->4042a235-a60a-403f-b811-96c454acd7e5@26401@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2143-0'
00000100:00100000:15.0:1773851890.937918:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b980bba7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4042a235-a60a-403f-b811-96c454acd7e5+737:39832:x1858043196050880:12345-26401@kfi7:400:default-tuolumne2143-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851890.937920:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26401@kfi7, seq: 2289906
00000100:00000040:15.0:1773851890.937921:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d61f67a2 : new rpc_count 11
00000800:00000200:13.0:1773851890.937921:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26d TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851890.937922:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851890.937922:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851890.937922:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851890.937923:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851890.937923:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26593@kfi7: PUT: OK
00000020:00000010:15.0:1773851890.937924:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000400:00000200:13.0:1773851890.937924:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022f323c7
00000400:00000010:13.0:1773851890.937924:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022f323c7.
00000020:00000010:15.0:1773851890.937925:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000020:00000040:15.0:1773851890.937925:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000d61f67a2 : new refcount 736
00000100:00000001:13.0:1773851890.937925:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851890.937925:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851890.937926:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851890.937926:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ad901e10 nid 26593@kfi7 refs 2
00000800:00000200:13.0:1773851890.937927:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 26593@kfi7(00000000b835e619):0x0 lsk 622 rsk 45 tsk 0 trmk 0 tmk 0 trr 3 tta 0x26d Transaction freed
00000800:00000200:17.0:1773851890.946365:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851890.946366:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851890.946367:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851890.946369:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851890.946371:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12689@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.946372:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12689@kfi7 : PUT - for me
00000400:00000200:17.0:1773851890.946373:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12689@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.946373:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a07d919 nid 12689@kfi7 refs 1
00000400:00000200:17.0:1773851890.946374:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12689@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.946375:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a07d919 nid 12689@kfi7 refs 2
00000400:00000200:17.0:1773851890.946375:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003a07d919 nid 12689@kfi7 refs 3
00000400:00000200:17.0:1773851890.946376:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12624@kfi7 to cpt 5
00000400:00000200:17.0:1773851890.946377:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12624@kfi7 of length 224 into portal 12 MB=0x69b0a157c3b00
00000400:00000200:17.0:1773851890.946379:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12624@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 40048
00000800:00000200:17.0:1773851890.946380:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851890.946382:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851890.946383:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12689@kfi7: PUT: OK
00000100:00000001:17.0:1773851890.946384:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851890.946384:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851890.946385:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000304a7289.
00000100:00000040:17.0:1773851890.946386:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000304a7289 x1859317472705280 msgsize 224
00000100:00100000:17.0:1773851890.946387:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12624@kfi7 (source: 12345-12689@kfi7)
00000100:00000001:17.0:1773851890.946389:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851890.946390:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003a07d919 nid 12689@kfi7 refs 2
00000800:00000200:17.0:1773851890.946391:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851890.946394:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851890.946394:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851890.946395:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851890.946395:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851890.946396:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851890.946397:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317472705280
00000020:00000001:17.0:1773851890.946398:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851890.946398:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91793
00000020:00000001:17.0:1773851890.946399:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851890.946401:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008c27f7bf refcount=39
00000020:00000001:17.0:1773851890.946402:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241476096 : -107152468075520 : ffff9e8b9f341c00)
00000020:00000001:17.0:1773851890.946403:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241476096 : -107152468075520 : ffff9e8b9f341c00)
00000100:00000001:17.0:1773851890.946404:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851890.946404:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851890.946405:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000455b6f1c.
00000020:00000010:17.0:1773851890.946407:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851890.946407:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851890.946408:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851890.946409:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851890.946410:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851890.946411:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851890.946411:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851890.946412:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.946413:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851890.946414:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851890.946415:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851890.946415:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12624@kfi7, seq: 2156411
00000100:00000001:16.0:1773851890.946415:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:17.0:1773851890.946416:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008c27f7bf : new rpc_count 3
00000100:00000001:16.0:1773851890.946416:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851890.946417:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968765824 : -106974740785792 : ffff9eb500935580)
00000100:00000001:16.0:1773851890.946417:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851890.946418:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000304a7289 x1859317472705280/t0(0) o400->0aaaf0ae-3adf-4768-9796-e92833be9b18@12624@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1282-0'
00000100:00000001:16.0:1773851890.946418:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.946421:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851890.946421:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851890.946422:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000304a7289 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0aaaf0ae-3adf-4768-9796-e92833be9b18+39:39670:x1859317472705280:12345-12624@kfi7:400:default-tuolumne1282-0
00000100:00000200:17.0:1773851890.946423:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317472705280
00000020:00000001:17.0:1773851890.946424:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851890.946425:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851890.946425:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.946426:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851890.946427:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851890.946427:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851890.946428:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317472705280, found 0 last_xid 1859317472143359
00000020:00000001:17.0:1773851890.946429:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851890.946429:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851890.946430:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851890.946430:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.946431:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851890.946432:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851890.946432:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851890.946433:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a80eb343.
02000000:00000001:17.0:1773851890.946434:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.946434:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.946435:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851890.946436:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584376, transno 0, xid 1859317472705280
00010000:00000001:17.0:1773851890.946436:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851890.946437:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000304a7289 x1859317472705280/t0(0) o400->0aaaf0ae-3adf-4768-9796-e92833be9b18@12624@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1282-0'
00010000:00000001:17.0:1773851890.946439:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851890.946440:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851890.946440:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=123 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851890.946441:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851890.946442:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000095f94620 refcount 3 to 12624@kfi7
00000100:00000001:17.0:1773851890.946443:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026624 : -107156745524992 : ffff9e8aa03f6900)
02000000:00000001:17.0:1773851890.946443:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851890.946444:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851890.946444:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851890.946445:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12689@kfi7
00000400:00000010:17.0:1773851890.946446:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df4ad511.
00000100:00000200:17.0:1773851890.946446:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317472705280, offset 224
00000400:00000200:17.0:1773851890.946447:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12689@kfi7
00000400:00000200:17.0:1773851890.946448:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12689@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.946449:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a07d919 nid 12689@kfi7 refs 1
00000400:00000200:17.0:1773851890.946450:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003a07d919 nid 12689@kfi7 refs 2
00000400:00000200:17.0:1773851890.946451:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003a07d919 nid 12689@kfi7 refs 3
00000400:00000200:17.0:1773851890.946452:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12689@kfi7 local destination
00000400:00000200:17.0:1773851890.946453:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769995:8769995:1024:4294967295] 12689@kfi7 LPNI seq info [1750806:1750806:16:4294967295]
00000400:00000200:17.0:1773851890.946454:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003a07d919 nid 12689@kfi7 refs 2
00000400:00000200:17.0:1773851890.946455:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12689@kfi7 to cpt 4
00000400:00000200:17.0:1773851890.946456:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12689@kfi7(12689@kfi7:12689@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851890.946457:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003a07d919 nid 12689@kfi7 refs 3
00000800:00000200:17.0:1773851890.946458:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851890.946459:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851890.946463:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851890.946465:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000de0 Using peer 12689@kfi7(0x100000000000de0)
00000800:00000200:17.0:1773851890.946468:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x100000000000de0: rc=0
00000800:00000200:17.0:1773851890.946469:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000de0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851890.946471:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851890.946471:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000095f94620 refcount 2 to 12624@kfi7
00010000:00000001:17.0:1773851890.946472:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851890.946473:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851890.946473:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851890.946474:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000304a7289 x1859317472705280/t0(0) o400->0aaaf0ae-3adf-4768-9796-e92833be9b18@12624@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1282-0'
00000100:00100000:17.0:1773851890.946477:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000304a7289 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0aaaf0ae-3adf-4768-9796-e92833be9b18+39:39670:x1859317472705280:12345-12624@kfi7:400:default-tuolumne1282-0 Request processed in 55us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851890.946479:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12624@kfi7, seq: 2156411
00000100:00000040:17.0:1773851890.946480:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008c27f7bf : new rpc_count 2
00000100:00000001:17.0:1773851890.946480:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851890.946481:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851890.946481:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851890.946482:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000800:00000200:18.0:1773851890.946483:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000de0 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851890.946483:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000455b6f1c.
00000020:00000040:17.0:1773851890.946483:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000008c27f7bf : new refcount 38
00000400:00000200:18.0:1773851890.946484:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851890.946484:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851890.946485:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12689@kfi7: PUT: OK
00000400:00000200:18.0:1773851890.946486:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df4ad511
00000400:00000010:18.0:1773851890.946486:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df4ad511.
00000100:00000001:18.0:1773851890.946487:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851890.946487:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851890.946488:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003a07d919 nid 12689@kfi7 refs 2
00000800:00000200:18.0:1773851890.946489:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2054@kfi7:4 -> 12689@kfi7(000000009ab0d612):0x0 lsk 3553 rsk 48 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000de0 Transaction freed
00000800:00000200:5.0:1773851890.999230:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851890.999232:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851890.999234:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851890.999237:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851890.999240:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19665@kfi7 to cpt 1
00000400:00000200:5.0:1773851890.999242:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19665@kfi7 : PUT - for me
00000400:00000200:5.0:1773851890.999244:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19665@kfi7 to cpt 1
00000400:00000200:5.0:1773851890.999245:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c09f3d4 nid 19665@kfi7 refs 1
00000400:00000200:5.0:1773851890.999247:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19665@kfi7 to cpt 1
00000400:00000200:5.0:1773851890.999248:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c09f3d4 nid 19665@kfi7 refs 2
00000400:00000200:5.0:1773851890.999249:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002c09f3d4 nid 19665@kfi7 refs 3
00000400:00000200:5.0:1773851890.999251:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19665@kfi7 to cpt 1
00000400:00000200:5.0:1773851890.999253:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19665@kfi7 of length 224 into portal 12 MB=0x69b0a50162ac0
00000400:00000200:5.0:1773851890.999255:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19665@kfi7 of length 224/224 into md 0x793926dc5 [64] + 159264
00000800:00000200:5.0:1773851890.999258:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851890.999261:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851890.999263:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19665@kfi7: PUT: OK
00000100:00000001:5.0:1773851890.999264:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851890.999265:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851890.999266:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e62e4afc.
00000100:00000040:5.0:1773851890.999268:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e62e4afc x1859318455872192 msgsize 224
00000100:00100000:5.0:1773851890.999270:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19665@kfi7 (source: 12345-19665@kfi7)
00000100:00000001:5.0:1773851890.999272:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851890.999273:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002c09f3d4 nid 19665@kfi7 refs 2
00000100:00000001:4.0:1773851890.999273:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851890.999274:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851890.999275:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851890.999275:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851890.999276:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851890.999276:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851890.999277:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318455872192
00000020:00000001:4.0:1773851890.999277:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851890.999278:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92221
00000020:00000001:4.0:1773851890.999278:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851890.999280:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000d4f4de5 refcount=6
00000020:00000001:4.0:1773851890.999280:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630029312 : -107123079522304 : ffff9e9276e5d800)
00000020:00000001:4.0:1773851890.999281:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630029312 : -107123079522304 : ffff9e9276e5d800)
00000100:00000001:4.0:1773851890.999282:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851890.999283:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851890.999284:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851890.999285:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851890.999286:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ab5100b2.
00000100:00000001:4.0:1773851890.999287:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851890.999287:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851890.999288:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851890.999289:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851890.999289:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851890.999290:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.999291:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851890.999292:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851890.999292:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851890.999293:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:4.0:1773851890.999293:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19665@kfi7, seq: 2001976
00000100:00000001:7.0:1773851890.999294:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:4.0:1773851890.999294:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000d4f4de5 : new rpc_count 1
00000100:00000001:7.0:1773851890.999295:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.999295:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108952320 : -106938600599296 : ffff9ebd6ab2d100)
00000100:00000001:7.0:1773851890.999296:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851890.999296:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e62e4afc x1859318455872192/t0(0) o400->bb13b55d-f7b5-4ff3-a9cd-1ff0dab2150f@19665@kfi7:617/0 lens 224/0 e 0 to 0 dl 1773851977 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1713-0'
00000100:00000001:4.0:1773851890.999302:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851890.999303:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851890.999304:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e62e4afc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bb13b55d-f7b5-4ff3-a9cd-1ff0dab2150f+6:39619:x1859318455872192:12345-19665@kfi7:400:default-tuolumne1713-0
00000100:00000200:4.0:1773851890.999305:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318455872192
00000020:00000001:4.0:1773851890.999306:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851890.999306:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851890.999307:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.999308:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851890.999308:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851890.999309:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851890.999310:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318455872192, found 0 last_xid 1859318455872191
00000020:00000001:4.0:1773851890.999310:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851890.999311:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851890.999312:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851890.999312:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.999313:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851890.999314:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851890.999314:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851890.999315:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aaf8e0b0.
02000000:00000001:4.0:1773851890.999316:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.999317:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.999318:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851890.999318:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098826806, transno 0, xid 1859318455872192
00010000:00000001:4.0:1773851890.999319:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851890.999320:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e62e4afc x1859318455872192/t0(0) o400->bb13b55d-f7b5-4ff3-a9cd-1ff0dab2150f@19665@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1713-0'
00010000:00000001:4.0:1773851890.999323:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851890.999323:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851890.999324:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=122 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851890.999325:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851890.999326:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b96eae83 refcount 3 to 19665@kfi7
00000100:00000001:4.0:1773851890.999327:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703648 : -107156155847968 : ffff9e8ac3652ae0)
02000000:00000001:4.0:1773851890.999329:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851890.999330:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851890.999330:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851890.999331:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19665@kfi7
00000400:00000010:4.0:1773851890.999332:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000615c4c0e.
00000100:00000200:4.0:1773851890.999333:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318455872192, offset 224
00000400:00000200:4.0:1773851890.999334:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19665@kfi7
00000400:00000200:4.0:1773851890.999335:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19665@kfi7 to cpt 1
00000400:00000200:4.0:1773851890.999336:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c09f3d4 nid 19665@kfi7 refs 1
00000400:00000200:4.0:1773851890.999337:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002c09f3d4 nid 19665@kfi7 refs 2
00000400:00000200:4.0:1773851890.999338:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002c09f3d4 nid 19665@kfi7 refs 3
00000400:00000200:4.0:1773851890.999340:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19665@kfi7 local destination
00000400:00000200:4.0:1773851890.999341:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8769996:8769996:1024:4294967295] 19665@kfi7 LPNI seq info [13513763:13513763:16:4294967295]
00000400:00000200:4.0:1773851890.999342:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002c09f3d4 nid 19665@kfi7 refs 2
00000400:00000200:4.0:1773851890.999343:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19665@kfi7 to cpt 1
00000400:00000200:4.0:1773851890.999345:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19665@kfi7(19665@kfi7:19665@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851890.999347:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002c09f3d4 nid 19665@kfi7 refs 3
00000800:00000200:4.0:1773851890.999348:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851890.999349:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851890.999351:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851890.999353:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008a4 Using peer 19665@kfi7(0x1000000000008a4)
00000800:00000200:4.0:1773851890.999356:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x1000000000008a4: rc=0
00000800:00000200:4.0:1773851890.999358:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851890.999360:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851890.999361:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b96eae83 refcount 2 to 19665@kfi7
00010000:00000001:4.0:1773851890.999362:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851890.999366:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851890.999367:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851890.999368:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e62e4afc x1859318455872192/t0(0) o400->bb13b55d-f7b5-4ff3-a9cd-1ff0dab2150f@19665@kfi7:617/0 lens 224/224 e 0 to 0 dl 1773851977 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1713-0'
00000100:00100000:4.0:1773851890.999371:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e62e4afc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:bb13b55d-f7b5-4ff3-a9cd-1ff0dab2150f+6:39619:x1859318455872192:12345-19665@kfi7:400:default-tuolumne1713-0 Request processed in 68us (102us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851890.999374:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19665@kfi7, seq: 2001976
00000100:00000040:4.0:1773851890.999375:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000d4f4de5 : new rpc_count 0
00000100:00000001:4.0:1773851890.999376:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851890.999376:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851890.999377:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851890.999377:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ab5100b2.
00000020:00000010:4.0:1773851890.999378:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000020:00000040:4.0:1773851890.999379:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000000d4f4de5 : new refcount 5
00000100:00000001:4.0:1773851890.999380:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851890.999388:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008a4 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851890.999391:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851890.999393:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19665@kfi7: PUT: OK
00000400:00000200:5.0:1773851890.999394:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000615c4c0e
00000400:00000010:5.0:1773851890.999395:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000615c4c0e.
00000100:00000001:5.0:1773851890.999396:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851890.999397:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851890.999399:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002c09f3d4 nid 19665@kfi7 refs 2
00000800:00000200:5.0:1773851890.999401:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2054@kfi7:1 -> 19665@kfi7(00000000fe4c52b8):0x0 lsk 2213 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000008a4 Transaction freed
00000004:00000001:6.0:1773851891.017732:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851891.017733:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851891.017734:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000078d0b7f7.
00000020:00000040:6.0:1773851891.017736:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851891.017737:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851891.017738:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851891.017739:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851891.017741:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000078f43d8e.
00000100:00000001:6.0:1773851891.017742:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851891.017744:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851891.017745:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851891.017747:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000078d0b7f7] to pc [ptlrpcd_01_02+2]  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851891.017753:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851891.017754:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851891.017754:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851891.017755:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:6.0:1773851891.017755:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e34db377.
00000100:00000001:4.0:1773851891.017755:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.017756:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851891.017756:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637098124845056 : -106975584706560 : ffff9eb4ce462000)
00000100:00000040:7.0:1773851891.017757:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851891.017758:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:6.0:1773851891.017759:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851891.017761:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000100:00000001:7.0:1773851891.017762:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:6.0:1773851891.017762:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000575f7d41.
00000100:00000001:7.0:1773851891.017763:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851891.017763:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614165471038544ns, next at 614166471037082ns, rc = 0
02000000:00000001:7.0:1773851891.017764:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851891.017765:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851891.017765:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:7.0:1773851891.017766:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000078d0b7f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051938048:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851891.017768:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:6.0:1773851891.017768:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851891.017769:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:6.0:1773851891.017769:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851891.017770:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851891.017771:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851891.017772:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006b18bdd4.
02000000:00000001:7.0:1773851891.017773:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851891.017774:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:7.0:1773851891.017775:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:7.0:1773851891.017777:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
00000100:00000200:7.0:1773851891.017778:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938048, portal 4
00000100:00000001:7.0:1773851891.017779:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851891.017780:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814091136 : -107101895460480 : ffff9e976590f980)
00000100:00000040:7.0:1773851891.017782:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851891.017786:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851891.017787:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:7.0:1773851891.017788:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036a990bc.
00000100:00000200:7.0:1773851891.017789:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938048, offset 0
00000400:00000200:7.0:1773851891.017792:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:7.0:1773851891.017793:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851891.017795:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:7.0:1773851891.017796:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851891.017798:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:7.0:1773851891.017800:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:7.0:1773851891.017802:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8769994, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8769996, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851891.017806:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851891.017807:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851891.017809:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:7.0:1773851891.017810:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769997:8769997:1024:4294967295] 16@kfi7 LPNI seq info [5403820:5403820:16:4294967295]
00000400:00000200:7.0:1773851891.017812:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851891.017814:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851891.017817:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851891.017819:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:7.0:1773851891.017821:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851891.017823:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851891.017827:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851891.017830:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Using peer 16@kfi7(0x15d)
00000800:00000200:7.0:1773851891.017835:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x15d: rc=0
00000800:00000200:7.0:1773851891.017838:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851891.017841:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.017842:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851891.017843:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.017844:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.017845:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.017846:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851891.017847:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851891.017848:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851891.017849:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851891.017850:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.017850:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851891.017851:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851891.017853:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851891.017855:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000400:00000200:5.0:1773851891.017856:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036a990bc
00000400:00000010:5.0:1773851891.017857:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036a990bc.
00000100:00000001:5.0:1773851891.017858:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851891.017860:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851891.017865:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851891.017866:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851891.017871:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851891.017872:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851891.017874:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:5.0:1773851891.017876:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Transaction freed
00000800:00000200:29.0:1773851891.017898:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851891.017899:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851891.017901:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851891.017904:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851891.017907:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.017909:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851891.017911:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.017912:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851891.017914:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.017915:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851891.017917:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851891.017918:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.017919:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5d00
00000400:00000200:29.0:1773851891.017921:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.017923:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x7800819fd [1] + 224
00000800:00000200:29.0:1773851891.017927:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851891.017930:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851891.017931:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851891.017933:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851891.017935:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851891.017939:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851891.017945:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851891.017947:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:7.0:1773851891.017948:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851891.017949:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851891.017949:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851891.017950:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851891.017951:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851891.017952:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851891.017953:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000400:00000010:7.0:1773851891.017953:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000100:00000001:7.0:1773851891.017954:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851891.017956:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851891.017961:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851891.017965:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851891.017966:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.017966:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851891.017967:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851891.017968:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851891.017969:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851891.017970:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851891.017971:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=124 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851891.017973:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=124 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851891.017974:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851891.017975:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851891.017976:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851891.017977:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.017978:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851891.017979:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:7.0:1773851891.017980:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851891.017981:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851891.017982:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851891.017986:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851891.017988:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851891.017989:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851891.017990:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851891.017991:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851891.017992:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482180608 avail=351481153536 avail_mb=1372973256 hwm_mb=3131103 files=372097084 ffree=343244317 state=0: rc = 0
00000004:00000020:7.0:1773851891.017995:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482180608 free, 351481153536 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097084 files, 343244317 free files
00000004:00000001:7.0:1773851891.017997:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851891.017999:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851891.018003:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000078d0b7f7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051938048:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851891.018005:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.018006:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851891.018007:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000078d0b7f7 x1859433051938048/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851891.018012:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851891.018012:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851891.018013:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006b18bdd4.
02000000:00000001:7.0:1773851891.018015:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851891.018016:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851891.018016:0:41066:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:7.0:1773851891.018017:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851891.018018:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000078f43d8e.
02000000:00000001:7.0:1773851891.018019:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851891.018020:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851891.018021:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000078d0b7f7.
00000100:00000001:7.0:1773851891.018022:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851891.018022:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.018023:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.018024:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851891.018025:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.018026:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851891.018026:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851891.044877:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851891.044877:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851891.044878:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851891.044878:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851891.044879:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851891.044879:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851891.044881:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851891.044881:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16123@kfi7(00000000e652069a):0x9a7 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851891.044882:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 Using peer 16123@kfi7(0x9a7)
00000400:00000200:6.0:1773851891.044883:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16123@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.044884:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16123@kfi7 : PUT - for me
00000400:00000200:5.0:1773851891.044884:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16123@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.044885:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16123@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.044886:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4c34f80 nid 16123@kfi7 refs 1
00000800:00000200:5.0:1773851891.044886:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 38 bytes to peer 0x9a7: rc=0
00000400:00000200:6.0:1773851891.044887:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16123@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.044887:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4c34f80 nid 16123@kfi7 refs 2
00000800:00000200:5.0:1773851891.044887:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851891.044888:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b4c34f80 nid 16123@kfi7 refs 3
00000400:00000200:6.0:1773851891.044889:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16122@kfi7 to cpt 6
00000400:00000200:6.0:1773851891.044890:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16122@kfi7 of length 440 into portal 12 MB=0x699de8bf411c0
00000400:00000200:6.0:1773851891.044891:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16122@kfi7 of length 440/440 into md 0x793926dc5 [64] + 159488
00000800:00000200:6.0:1773851891.044893:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851891.044895:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851891.044896:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16123@kfi7: PUT: OK
00000100:00000001:6.0:1773851891.044897:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851891.044897:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851891.044898:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c8d445a8.
00000100:00000040:6.0:1773851891.044898:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000c8d445a8 x1858030970081728 msgsize 440
00000100:00100000:6.0:1773851891.044900:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-16122@kfi7 (source: 12345-16123@kfi7)
00000100:00000001:6.0:1773851891.044900:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:5.0:1773851891.044900:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851891.044901:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b4c34f80 nid 16123@kfi7 refs 2
00000800:00000200:5.0:1773851891.044902:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 Transaction freed
00000800:00000200:6.0:1773851891.044903:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851891.044904:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851891.044904:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851891.044905:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851891.044906:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851891.044907:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851891.044908:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030970081728
00000020:00000001:4.0:1773851891.044909:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851891.044909:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9116c
00000020:00000001:4.0:1773851891.044910:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851891.044914:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e8353c94 refcount=6
00000020:00000001:4.0:1773851891.044915:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240323072 : -107152469228544 : ffff9e8b9f228400)
00000020:00000001:4.0:1773851891.044916:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240323072 : -107152469228544 : ffff9e8b9f228400)
00000100:00000001:4.0:1773851891.044918:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851891.044919:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851891.044920:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000953d1c38.
00000020:00000010:4.0:1773851891.044921:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851891.044923:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ab5100b2.
00000100:00000001:4.0:1773851891.044924:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851891.044925:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851891.044925:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.044927:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.044928:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.044930:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851891.044930:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851891.044930:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851891.044931:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16122@kfi7, seq: 371100849
00000100:00000001:4.0:1773851891.044931:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851891.044932:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e8353c94 : new rpc_count 1
00000100:00000001:7.0:1773851891.044932:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814078464 : -107101895473152 : ffff9e976590c800)
00000100:00000001:4.0:1773851891.044932:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851891.044933:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c8d445a8 x1858030970081728/t0(0) o41->058ed54d-94e8-4aa8-9e9f-c73e630431d8@16122@kfi7:141/0 lens 440/0 e 0 to 0 dl 1773852256 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne231-0'
00000100:00000001:4.0:1773851891.044933:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.044936:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851891.044936:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851891.044937:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c8d445a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:058ed54d-94e8-4aa8-9e9f-c73e630431d8+6:1809148:x1858030970081728:12345-16122@kfi7:41:default-tuolumne231-0
00000100:00000200:7.0:1773851891.044938:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030970081728
00000020:00000001:7.0:1773851891.044939:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851891.044939:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851891.044940:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851891.044940:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851891.044941:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:7.0:1773851891.044941:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851891.044942:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030970081728, found 0 last_xid 1858030970081727
00000020:00000001:7.0:1773851891.044942:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851891.044943:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851891.044943:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851891.044944:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.044944:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851891.044945:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851891.044945:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000006b18bdd4.
02000000:00000001:7.0:1773851891.044946:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.044946:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044947:0:61015:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:7.0:1773851891.044947:0:61015:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:7.0:1773851891.044948:0:61015:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044949:0:61015:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:7.0:1773851891.044949:0:61015:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851891.044951:0:61015:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044951:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851891.044953:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044954:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851891.044954:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044954:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851891.044955:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044955:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851891.044955:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044956:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851891.044956:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044957:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044957:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500128256 free, 351498081280 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097679 files, 343261844 free files
00000004:00000001:7.0:1773851891.044958:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044959:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044959:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504315392 free, 351502164992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056140 files, 343265933 free files
00000004:00000001:7.0:1773851891.044960:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044961:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044961:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690078208 free, 351687670784 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231120 files, 343447342 free files
00000004:00000001:7.0:1773851891.044962:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044963:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044963:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382736896 free, 351380642816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978635 files, 343147204 free files
00000004:00000001:7.0:1773851891.044964:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044964:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044965:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350959016960 free, 350956941312 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563972 files, 342733415 free files
00000004:00000001:7.0:1773851891.044966:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044966:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044967:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351179264 free, 351348304896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372083978 files, 343116386 free files
00000004:00000001:7.0:1773851891.044968:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044968:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044968:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482180608 free, 351481153536 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097084 files, 343244317 free files
00000004:00000001:7.0:1773851891.044969:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044970:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044971:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449354240 free, 351446807552 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160945 files, 343212260 free files
00000004:00000001:7.0:1773851891.044972:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044972:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044972:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353604096 free, 351351227392 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083216 files, 343118754 free files
00000004:00000001:7.0:1773851891.044973:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044974:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044974:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388919808 free, 351386260480 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372018983 files, 343153242 free files
00000004:00000001:7.0:1773851891.044975:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044975:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044976:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406493696 free, 351404179456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127129 files, 343170404 free files
00000004:00000001:7.0:1773851891.044977:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044977:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044977:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378981888 free, 351376022528 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372018989 files, 343143537 free files
00000004:00000001:7.0:1773851891.044978:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044979:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044979:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351465977856 free, 351462800384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062752 files, 343228494 free files
00000004:00000001:7.0:1773851891.044980:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044980:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044981:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351488995328 free, 351486022656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066684 files, 343250972 free files
00000004:00000001:7.0:1773851891.044981:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044982:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044982:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492705280 free, 351490295808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372077961 files, 343254595 free files
00000004:00000001:7.0:1773851891.044983:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044983:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044984:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524016128 free, 351521288192 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113770 files, 343285172 free files
00000004:00000001:7.0:1773851891.044985:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044985:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044986:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510612992 free, 351508044800 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095693 files, 343272083 free files
00000004:00000001:7.0:1773851891.044987:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044987:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044988:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541508096 free, 351539410944 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136587 files, 343302254 free files
00000004:00000001:7.0:1773851891.044989:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044989:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044990:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470656512 free, 351461533696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064445 files, 343233063 free files
00000004:00000001:7.0:1773851891.044991:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044991:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044991:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666622464 free, 351645423616 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237777 files, 343424436 free files
00000004:00000001:7.0:1773851891.044992:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044993:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044993:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545831424 free, 351536184320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116395 files, 343306476 free files
00000004:00000001:7.0:1773851891.044994:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044995:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044995:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603934208 free, 351601571840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190399 files, 343363217 free files
00000004:00000001:7.0:1773851891.044996:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044997:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044997:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615845376 free, 351613224960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043371 files, 343374849 free files
00000004:00000001:7.0:1773851891.044998:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.044998:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.044999:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420232704 free, 351417786368 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008904 files, 343183821 free files
00000004:00000001:7.0:1773851891.045000:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.045000:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.045000:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409096704 free, 351407031296 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011237 files, 343172946 free files
00000004:00000001:7.0:1773851891.045001:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.045002:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.045003:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351479988224 free, 351478687744 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073040 files, 343242176 free files
00000004:00000001:7.0:1773851891.045004:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.045004:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.045004:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593610240 free, 351576796160 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189892 files, 343353135 free files
00000004:00000001:7.0:1773851891.045005:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.045006:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851891.045006:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464025088 free, 351458249728 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064701 files, 343226587 free files
00000004:00000001:7.0:1773851891.045007:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.045008:0:61015:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.045008:0:61015:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:7.0:1773851891.045009:0:61015:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 154140672 granted 1839581985855 pending 396361728 free 40309312093945856 avail 40308834211725312
00000004:00000020:7.0:1773851891.045010:0:61015:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841140647936 free, 9841023843072 avail; 10969024762 objects: 9610488914 free; state 100
00000020:00000001:7.0:1773851891.045012:0:61015:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:7.0:1773851891.045014:0:61015:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851891.045015:0:61015:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851891.045016:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768349, transno 0, xid 1858030970081728
00010000:00000001:7.0:1773851891.045016:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851891.045017:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c8d445a8 x1858030970081728/t0(0) o41->058ed54d-94e8-4aa8-9e9f-c73e630431d8@16122@kfi7:141/0 lens 440/368 e 0 to 0 dl 1773852256 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne231-0'
00010000:00000001:7.0:1773851891.045019:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851891.045020:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851891.045020:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=123 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851891.045021:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851891.045021:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008d96cbb9 refcount 5 to 16122@kfi7
00000100:00000001:7.0:1773851891.045022:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329184 : -107155410222432 : ffff9e8aefd682a0)
02000000:00000001:7.0:1773851891.045023:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851891.045023:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.045023:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851891.045024:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16123@kfi7
00000400:00000010:7.0:1773851891.045025:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
00000100:00000200:7.0:1773851891.045025:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030970081728, offset 224
00000400:00000200:7.0:1773851891.045027:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16123@kfi7
00000400:00000200:7.0:1773851891.045028:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16123@kfi7 to cpt 1
00000400:00000200:7.0:1773851891.045028:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b4c34f80 nid 16123@kfi7 refs 1
00000400:00000200:7.0:1773851891.045029:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b4c34f80 nid 16123@kfi7 refs 2
00000400:00000200:7.0:1773851891.045030:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b4c34f80 nid 16123@kfi7 refs 3
00000400:00000200:7.0:1773851891.045031:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16123@kfi7 local destination
00000400:00000200:7.0:1773851891.045033:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769998:8769998:1024:4294967295] 16123@kfi7 LPNI seq info [28019:28019:16:4294967295]
00000400:00000200:7.0:1773851891.045034:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b4c34f80 nid 16123@kfi7 refs 2
00000400:00000200:7.0:1773851891.045035:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16123@kfi7 to cpt 1
00000400:00000200:7.0:1773851891.045037:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16123@kfi7(16123@kfi7:16123@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851891.045038:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b4c34f80 nid 16123@kfi7 refs 3
00000800:00000200:7.0:1773851891.045039:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851891.045040:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:7.0:1773851891.045042:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851891.045044:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 Using peer 16123@kfi7(0x9a7)
00000800:00000200:7.0:1773851891.045047:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 468 bytes to peer 0x9a7: rc=0
00000800:00000200:7.0:1773851891.045048:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851891.045050:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851891.045050:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008d96cbb9 refcount 4 to 16122@kfi7
00010000:00000001:7.0:1773851891.045051:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851891.045051:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851891.045052:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851891.045053:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c8d445a8 x1858030970081728/t0(0) o41->058ed54d-94e8-4aa8-9e9f-c73e630431d8@16122@kfi7:141/0 lens 440/368 e 0 to 0 dl 1773852256 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne231-0'
00000100:00100000:7.0:1773851891.045056:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c8d445a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:058ed54d-94e8-4aa8-9e9f-c73e630431d8+6:1809148:x1858030970081728:12345-16122@kfi7:41:default-tuolumne231-0 Request processed in 119us (156us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851891.045060:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16122@kfi7, seq: 371100849
00000800:00000200:5.0:1773851891.045060:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851891.045061:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e8353c94 : new rpc_count 0
00000100:00000001:7.0:1773851891.045062:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851891.045062:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851891.045062:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851891.045063:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000400:00000200:5.0:1773851891.045063:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16123@kfi7: PUT: OK
00000020:00000010:7.0:1773851891.045064:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ab5100b2.
00000020:00000010:7.0:1773851891.045064:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000953d1c38.
00000400:00000200:5.0:1773851891.045064:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000400:00000010:5.0:1773851891.045064:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000020:00000040:7.0:1773851891.045065:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e8353c94 : new refcount 5
00000100:00000001:5.0:1773851891.045065:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:7.0:1773851891.045066:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851891.045066:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851891.045067:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b4c34f80 nid 16123@kfi7 refs 2
00000800:00000200:5.0:1773851891.045068:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 16123@kfi7(00000000e652069a):0x0 lsk 2472 rsk 82 tsk 0 trmk 0 tmk 0 trr 1 tta 0x9a7 Transaction freed
00000800:00000200:14.0:1773851891.152953:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851891.152954:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851891.152955:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851891.152957:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851891.152959:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24483@kfi7 to cpt 3
00000400:00000200:14.0:1773851891.152960:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24483@kfi7 : PUT - for me
00000400:00000200:14.0:1773851891.152961:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24483@kfi7 to cpt 3
00000400:00000200:14.0:1773851891.152962:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee0626b7 nid 24483@kfi7 refs 1
00000400:00000200:14.0:1773851891.152963:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24483@kfi7 to cpt 3
00000400:00000200:14.0:1773851891.152964:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee0626b7 nid 24483@kfi7 refs 2
00000400:00000200:14.0:1773851891.152965:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee0626b7 nid 24483@kfi7 refs 3
00000400:00000200:14.0:1773851891.152966:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24419@kfi7 to cpt 7
00000400:00000200:14.0:1773851891.152967:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24419@kfi7 of length 224 into portal 12 MB=0x69b4b922b1e00
00000400:00000200:14.0:1773851891.152968:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24419@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 48960
00000800:00000200:14.0:1773851891.152970:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851891.152971:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851891.152972:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24483@kfi7: PUT: OK
00000100:00000001:14.0:1773851891.152973:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851891.152974:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851891.152975:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003cd1ca2a.
00000100:00000040:14.0:1773851891.152976:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000003cd1ca2a x1859598737415680 msgsize 224
00000100:00100000:14.0:1773851891.152977:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-24419@kfi7 (source: 12345-24483@kfi7)
00000100:00000001:14.0:1773851891.152978:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851891.152978:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee0626b7 nid 24483@kfi7 refs 2
00000100:00000001:15.0:1773851891.152979:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851891.152980:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851891.152980:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:14.0:1773851891.152980:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851891.152981:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851891.152982:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851891.152982:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598737415680
00000020:00000001:15.0:1773851891.152983:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851891.152983:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24381cf4
00000020:00000001:15.0:1773851891.152984:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851891.152989:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000aeaf67d0 refcount=5
00000020:00000001:15.0:1773851891.152990:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950462952448 : -107123246599168 : ffff9e926cf07400)
00000020:00000001:15.0:1773851891.152991:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950462952448 : -107123246599168 : ffff9e926cf07400)
00000100:00000001:15.0:1773851891.152992:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851891.152993:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851891.152993:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c74abe31.
00000020:00000010:15.0:1773851891.152994:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851891.152995:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851891.152997:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851891.152997:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851891.152998:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851891.152999:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851891.152999:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851891.153000:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851891.153000:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851891.153002:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851891.153002:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851891.153002:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851891.153002:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851891.153004:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24419@kfi7, seq: 2289907
00000100:00000001:15.0:1773851891.153005:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851891.153005:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851891.153005:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000aeaf67d0 : new rpc_count 1
00000100:00000001:12.0:1773851891.153005:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637095562700672 : -106978146850944 : ffff9eb4358ee780)
00000100:00000040:12.0:1773851891.153007:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003cd1ca2a x1859598737415680/t0(0) o400->725aabbb-5911-4f7f-a146-bc788a2af914@24419@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2012-0'
00000100:00000001:12.0:1773851891.153010:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851891.153011:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851891.153011:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cd1ca2a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:725aabbb-5911-4f7f-a146-bc788a2af914+5:39520:x1859598737415680:12345-24419@kfi7:400:default-tuolumne2012-0
00000100:00000200:12.0:1773851891.153013:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598737415680
00000020:00000001:12.0:1773851891.153013:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851891.153014:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851891.153015:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.153016:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851891.153016:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851891.153017:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851891.153018:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598737415680, found 0 last_xid 1859598737415679
00000020:00000001:12.0:1773851891.153019:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851891.153019:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851891.153020:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851891.153020:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.153021:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851891.153022:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851891.153022:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851891.153023:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e22acc4.
02000000:00000001:12.0:1773851891.153024:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.153025:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.153026:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851891.153027:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253097822, transno 0, xid 1859598737415680
00010000:00000001:12.0:1773851891.153028:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851891.153028:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003cd1ca2a x1859598737415680/t0(0) o400->725aabbb-5911-4f7f-a146-bc788a2af914@24419@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2012-0'
00010000:00000001:12.0:1773851891.153031:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851891.153032:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851891.153032:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=124 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851891.153034:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851891.153034:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000082752323 refcount 3 to 24419@kfi7
00000100:00000001:12.0:1773851891.153035:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231804928 : -107130477746688 : ffff9e90bdede600)
02000000:00000001:12.0:1773851891.153036:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851891.153037:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.153038:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851891.153038:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24483@kfi7
00000400:00000010:12.0:1773851891.153039:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a2534e29.
00000100:00000200:12.0:1773851891.153040:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598737415680, offset 224
00000400:00000200:12.0:1773851891.153042:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24483@kfi7
00000400:00000200:12.0:1773851891.153043:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24483@kfi7 to cpt 3
00000400:00000200:12.0:1773851891.153044:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee0626b7 nid 24483@kfi7 refs 1
00000400:00000200:12.0:1773851891.153045:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee0626b7 nid 24483@kfi7 refs 2
00000400:00000200:12.0:1773851891.153047:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee0626b7 nid 24483@kfi7 refs 3
00000400:00000200:12.0:1773851891.153049:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24483@kfi7 local destination
00000400:00000200:12.0:1773851891.153050:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8769999:8769999:1024:4294967295] 24483@kfi7 LPNI seq info [9882689:9882689:16:4294967295]
00000400:00000200:12.0:1773851891.153051:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee0626b7 nid 24483@kfi7 refs 2
00000400:00000200:12.0:1773851891.153052:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24483@kfi7 to cpt 3
00000400:00000200:12.0:1773851891.153054:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24483@kfi7(24483@kfi7:24483@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851891.153055:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee0626b7 nid 24483@kfi7 refs 3
00000800:00000200:12.0:1773851891.153057:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851891.153058:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851891.153060:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851891.153063:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fe Using peer 24483@kfi7(0x10fe)
00000800:00000200:12.0:1773851891.153066:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x10fe: rc=0
00000800:00000200:12.0:1773851891.153067:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851891.153069:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851891.153070:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000082752323 refcount 2 to 24419@kfi7
00010000:00000001:12.0:1773851891.153071:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851891.153071:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.153072:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851891.153072:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003cd1ca2a x1859598737415680/t0(0) o400->725aabbb-5911-4f7f-a146-bc788a2af914@24419@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2012-0'
00000100:00100000:12.0:1773851891.153077:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cd1ca2a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:725aabbb-5911-4f7f-a146-bc788a2af914+5:39520:x1859598737415680:12345-24419@kfi7:400:default-tuolumne2012-0 Request processed in 66us (100us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851891.153079:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24419@kfi7, seq: 2289907
00000100:00000040:12.0:1773851891.153080:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000aeaf67d0 : new rpc_count 0
00000100:00000001:12.0:1773851891.153080:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851891.153081:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851891.153082:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851891.153083:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000020:00000010:12.0:1773851891.153083:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c74abe31.
00000020:00000040:12.0:1773851891.153084:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000aeaf67d0 : new refcount 4
00000100:00000001:12.0:1773851891.153085:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851891.153090:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fe TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851891.153092:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851891.153093:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24483@kfi7: PUT: OK
00000400:00000200:14.0:1773851891.153094:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a2534e29
00000400:00000010:14.0:1773851891.153095:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a2534e29.
00000100:00000001:14.0:1773851891.153096:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851891.153096:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851891.153097:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee0626b7 nid 24483@kfi7 refs 2
00000800:00000200:14.0:1773851891.153098:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24483@kfi7(000000002e532aad):0x0 lsk 4351 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10fe Transaction freed
00000800:00000200:5.0:1773851891.161885:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851891.161887:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851891.161889:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851891.161893:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851891.161897:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23634@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.161899:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23634@kfi7 : PUT - for me
00000400:00000200:5.0:1773851891.161901:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23634@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.161902:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000653c4d3e nid 23634@kfi7 refs 1
00000400:00000200:5.0:1773851891.161904:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23634@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.161905:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000653c4d3e nid 23634@kfi7 refs 2
00000400:00000200:5.0:1773851891.161907:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000653c4d3e nid 23634@kfi7 refs 3
00000400:00000200:5.0:1773851891.161909:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23634@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.161910:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23634@kfi7 of length 224 into portal 12 MB=0x69aefd0f7a400
00000400:00000200:5.0:1773851891.161913:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23634@kfi7 of length 224/224 into md 0x793926dc5 [64] + 159928
00000800:00000200:5.0:1773851891.161916:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851891.161919:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851891.161921:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23634@kfi7: PUT: OK
00000100:00000001:5.0:1773851891.161923:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851891.161924:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851891.161925:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5ea564b.
00000100:00000040:5.0:1773851891.161927:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000c5ea564b x1859204654015488 msgsize 224
00000100:00100000:5.0:1773851891.161930:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23634@kfi7 (source: 12345-23634@kfi7)
00000100:00000001:5.0:1773851891.161931:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851891.161933:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000653c4d3e nid 23634@kfi7 refs 2
00000100:00000001:7.0:1773851891.161934:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851891.161935:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851891.161935:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851891.161936:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851891.161937:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851891.161939:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851891.161941:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859204654015488
00000020:00000001:7.0:1773851891.161942:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851891.161943:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92347
00000020:00000001:7.0:1773851891.161944:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851891.161948:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c209b5db refcount=8
00000020:00000001:7.0:1773851891.161950:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630272000 : -107123079279616 : ffff9e9276e98c00)
00000020:00000001:7.0:1773851891.161952:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630272000 : -107123079279616 : ffff9e9276e98c00)
00000100:00000001:7.0:1773851891.161953:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851891.161955:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851891.161956:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000002b9ec664.
00000020:00000010:7.0:1773851891.161958:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851891.161960:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000482fd989.
00000100:00000001:7.0:1773851891.161962:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851891.161963:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851891.161964:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.161966:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851891.161967:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851891.161967:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.161970:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.161973:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851891.161973:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851891.161974:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851891.161974:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851891.161976:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23634@kfi7, seq: 2001977
00000100:00000001:7.0:1773851891.161977:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851891.161977:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c209b5db : new rpc_count 1
00000100:00000001:7.0:1773851891.161978:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.161978:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637135108944256 : -106938600607360 : ffff9ebd6ab2b180)
00000100:00000040:4.0:1773851891.161981:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c5ea564b x1859204654015488/t0(0) o400->e2e2438e-0a2b-491c-8685-902ac744059c@23634@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1974-0'
00000100:00000001:4.0:1773851891.161986:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851891.161987:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851891.161988:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5ea564b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e2e2438e-0a2b-491c-8685-902ac744059c+8:39525:x1859204654015488:12345-23634@kfi7:400:default-tuolumne1974-0
00000100:00000200:4.0:1773851891.161991:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859204654015488
00000020:00000001:4.0:1773851891.161992:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851891.161993:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851891.161994:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.161995:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851891.161996:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851891.161997:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851891.161998:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859204654015488, found 0 last_xid 1859204654015487
00000020:00000001:4.0:1773851891.161999:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851891.162000:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851891.162001:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851891.162002:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.162004:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851891.162005:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851891.162006:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851891.162007:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000953d1c38.
02000000:00000001:4.0:1773851891.162008:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.162009:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.162010:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851891.162011:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044160748, transno 0, xid 1859204654015488
00010000:00000001:4.0:1773851891.162013:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851891.162014:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c5ea564b x1859204654015488/t0(0) o400->e2e2438e-0a2b-491c-8685-902ac744059c@23634@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1974-0'
00010000:00000001:4.0:1773851891.162018:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851891.162019:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851891.162020:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=123 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851891.162022:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851891.162023:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000084029349 refcount 3 to 23634@kfi7
00000100:00000001:4.0:1773851891.162024:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740762272 : -107153968789344 : ffff9e8b45c108a0)
02000000:00000001:4.0:1773851891.162025:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851891.162026:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.162027:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851891.162029:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23634@kfi7
00000400:00000010:4.0:1773851891.162029:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d5c2697.
00000100:00000200:4.0:1773851891.162031:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859204654015488, offset 224
00000400:00000200:4.0:1773851891.162033:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23634@kfi7
00000400:00000200:4.0:1773851891.162034:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23634@kfi7 to cpt 1
00000400:00000200:4.0:1773851891.162036:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000653c4d3e nid 23634@kfi7 refs 1
00000400:00000200:4.0:1773851891.162038:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000653c4d3e nid 23634@kfi7 refs 2
00000400:00000200:4.0:1773851891.162039:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000653c4d3e nid 23634@kfi7 refs 3
00000400:00000200:4.0:1773851891.162041:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23634@kfi7 local destination
00000400:00000200:4.0:1773851891.162043:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770000:8770000:1024:4294967295] 23634@kfi7 LPNI seq info [9697683:9697683:16:4294967295]
00000400:00000200:4.0:1773851891.162046:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000653c4d3e nid 23634@kfi7 refs 2
00000400:00000200:4.0:1773851891.162047:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23634@kfi7 to cpt 1
00000400:00000200:4.0:1773851891.162051:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23634@kfi7(23634@kfi7:23634@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851891.162053:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000653c4d3e nid 23634@kfi7 refs 3
00000800:00000200:4.0:1773851891.162055:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851891.162057:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851891.162061:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851891.162065:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a0 Using peer 23634@kfi7(0x1000000000004a0)
00000800:00000200:4.0:1773851891.162069:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x1000000000004a0: rc=0
00000800:00000200:4.0:1773851891.162071:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851891.162074:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851891.162076:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000084029349 refcount 2 to 23634@kfi7
00010000:00000001:4.0:1773851891.162077:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851891.162080:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.162081:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851891.162082:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5ea564b x1859204654015488/t0(0) o400->e2e2438e-0a2b-491c-8685-902ac744059c@23634@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1974-0'
00000100:00100000:4.0:1773851891.162087:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5ea564b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e2e2438e-0a2b-491c-8685-902ac744059c+8:39525:x1859204654015488:12345-23634@kfi7:400:default-tuolumne1974-0 Request processed in 100us (159us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851891.162091:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23634@kfi7, seq: 2001977
00000100:00000040:4.0:1773851891.162092:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c209b5db : new rpc_count 0
00000100:00000001:4.0:1773851891.162093:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851891.162094:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851891.162095:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:4.0:1773851891.162096:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000482fd989.
00000020:00000010:4.0:1773851891.162098:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000002b9ec664.
00000020:00000040:4.0:1773851891.162099:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000c209b5db : new refcount 7
00000100:00000001:4.0:1773851891.162101:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851891.162108:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a0 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851891.162111:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851891.162112:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23634@kfi7: PUT: OK
00000400:00000200:5.0:1773851891.162114:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d5c2697
00000400:00000010:5.0:1773851891.162115:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d5c2697.
00000100:00000001:5.0:1773851891.162116:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851891.162116:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851891.162118:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000653c4d3e nid 23634@kfi7 refs 2
00000800:00000200:5.0:1773851891.162120:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 23634@kfi7(00000000242226f8):0x0 lsk 1185 rsk 52 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000004a0 Transaction freed
00000800:00000200:13.0:1773851891.260463:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851891.260464:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851891.260466:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851891.260469:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851891.260472:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22064@kfi7 to cpt 3
00000400:00000200:13.0:1773851891.260474:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22064@kfi7 : PUT - for me
00000400:00000200:13.0:1773851891.260475:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22064@kfi7 to cpt 3
00000400:00000200:13.0:1773851891.260476:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078215e45 nid 22064@kfi7 refs 1
00000400:00000200:13.0:1773851891.260478:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22064@kfi7 to cpt 3
00000400:00000200:13.0:1773851891.260479:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078215e45 nid 22064@kfi7 refs 2
00000400:00000200:13.0:1773851891.260481:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000078215e45 nid 22064@kfi7 refs 3
00000400:00000200:13.0:1773851891.260482:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22256@kfi7 to cpt 6
00000400:00000200:13.0:1773851891.260483:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22256@kfi7 of length 224 into portal 12 MB=0x69b4c386140c0
00000400:00000200:13.0:1773851891.260485:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22256@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 49184
00000800:00000200:13.0:1773851891.260488:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851891.260490:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851891.260492:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22064@kfi7: PUT: OK
00000100:00000001:13.0:1773851891.260494:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851891.260494:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851891.260496:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bf534c56.
00000100:00000040:13.0:1773851891.260497:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000bf534c56 x1859601525981376 msgsize 224
00000100:00100000:13.0:1773851891.260499:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22256@kfi7 (source: 12345-22064@kfi7)
00000100:00000001:13.0:1773851891.260500:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851891.260502:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000078215e45 nid 22064@kfi7 refs 2
00000100:00000001:12.0:1773851891.260503:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851891.260504:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851891.260504:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851891.260505:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851891.260506:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851891.260507:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851891.260508:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601525981376
00000020:00000001:12.0:1773851891.260509:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851891.260510:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff80e6d
00000020:00000001:12.0:1773851891.260511:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851891.260517:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ff84cb35 refcount=5
00000020:00000001:12.0:1773851891.260518:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130564880384 : -106943144671232 : ffff9ebc5bd9c800)
00000020:00000001:12.0:1773851891.260520:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130564880384 : -106943144671232 : ffff9ebc5bd9c800)
00000100:00000001:12.0:1773851891.260521:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851891.260522:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851891.260523:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000380f7712.
00000020:00000010:12.0:1773851891.260525:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851891.260526:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000028d2b47d.
00000100:00000001:12.0:1773851891.260528:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851891.260528:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851891.260529:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851891.260531:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851891.260532:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851891.260533:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.260534:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851891.260536:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851891.260536:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851891.260537:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851891.260537:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851891.260538:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22256@kfi7, seq: 2289908
00000100:00000040:12.0:1773851891.260539:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ff84cb35 : new rpc_count 1
00000100:00000001:15.0:1773851891.260540:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.260540:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485624576 : -107000223927040 : ffff9eaf11a97500)
00000100:00000001:15.0:1773851891.260541:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851891.260543:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bf534c56 x1859601525981376/t0(0) o400->3d6b933b-9e2d-479a-9bdc-3a42036cd768@22256@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1869-0'
00000100:00000001:12.0:1773851891.260547:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851891.260548:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851891.260549:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bf534c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3d6b933b-9e2d-479a-9bdc-3a42036cd768+5:39532:x1859601525981376:12345-22256@kfi7:400:default-tuolumne1869-0
00000100:00000200:12.0:1773851891.260551:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601525981376
00000020:00000001:12.0:1773851891.260552:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851891.260553:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851891.260554:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.260555:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851891.260556:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851891.260557:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851891.260558:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601525981376, found 0 last_xid 1859601525981375
00000020:00000001:12.0:1773851891.260559:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851891.260560:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851891.260561:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851891.260562:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.260563:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851891.260563:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851891.260564:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851891.260566:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c1a31404.
02000000:00000001:12.0:1773851891.260567:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.260568:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.260569:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851891.260570:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182174458665, transno 0, xid 1859601525981376
00010000:00000001:12.0:1773851891.260571:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851891.260572:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bf534c56 x1859601525981376/t0(0) o400->3d6b933b-9e2d-479a-9bdc-3a42036cd768@22256@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1869-0'
00010000:00000001:12.0:1773851891.260576:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851891.260577:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851891.260578:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=124 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851891.260580:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851891.260581:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007858c391 refcount 3 to 22256@kfi7
00000100:00000001:12.0:1773851891.260582:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130859264 : -107149578692352 : ffff9e8c4b6c9900)
02000000:00000001:12.0:1773851891.260583:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851891.260584:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.260585:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851891.260586:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22064@kfi7
00000400:00000010:12.0:1773851891.260587:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f25aa5d2.
00000100:00000200:12.0:1773851891.260588:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601525981376, offset 224
00000400:00000200:12.0:1773851891.260590:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22064@kfi7
00000400:00000200:12.0:1773851891.260592:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22064@kfi7 to cpt 3
00000400:00000200:12.0:1773851891.260593:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078215e45 nid 22064@kfi7 refs 1
00000400:00000200:12.0:1773851891.260595:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000078215e45 nid 22064@kfi7 refs 2
00000400:00000200:12.0:1773851891.260596:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000078215e45 nid 22064@kfi7 refs 3
00000400:00000200:12.0:1773851891.260598:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22064@kfi7 local destination
00000400:00000200:12.0:1773851891.260600:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770001:8770001:1024:4294967295] 22064@kfi7 LPNI seq info [192716:192716:16:4294967295]
00000400:00000200:12.0:1773851891.260603:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000078215e45 nid 22064@kfi7 refs 2
00000400:00000200:12.0:1773851891.260604:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22064@kfi7 to cpt 3
00000400:00000200:12.0:1773851891.260607:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22064@kfi7(22064@kfi7:22064@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851891.260609:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000078215e45 nid 22064@kfi7 refs 3
00000800:00000200:12.0:1773851891.260611:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851891.260613:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851891.260616:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851891.260620:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf18 Using peer 22064@kfi7(0xf18)
00000800:00000200:12.0:1773851891.260624:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0xf18: rc=0
00000800:00000200:12.0:1773851891.260626:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf18 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851891.260629:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851891.260631:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007858c391 refcount 2 to 22256@kfi7
00010000:00000001:12.0:1773851891.260632:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851891.260633:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.260636:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851891.260637:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bf534c56 x1859601525981376/t0(0) o400->3d6b933b-9e2d-479a-9bdc-3a42036cd768@22256@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1869-0'
00000100:00100000:12.0:1773851891.260642:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bf534c56 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3d6b933b-9e2d-479a-9bdc-3a42036cd768+5:39532:x1859601525981376:12345-22256@kfi7:400:default-tuolumne1869-0 Request processed in 93us (144us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851891.260645:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22256@kfi7, seq: 2289908
00000100:00000040:12.0:1773851891.260646:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ff84cb35 : new rpc_count 0
00000100:00000001:12.0:1773851891.260647:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851891.260648:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851891.260649:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851891.260650:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000028d2b47d.
00000020:00000010:12.0:1773851891.260652:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000380f7712.
00000020:00000040:12.0:1773851891.260653:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000ff84cb35 : new refcount 4
00000100:00000001:12.0:1773851891.260654:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851891.260661:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf18 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851891.260664:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851891.260665:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22064@kfi7: PUT: OK
00000400:00000200:13.0:1773851891.260666:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f25aa5d2
00000400:00000010:13.0:1773851891.260667:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f25aa5d2.
00000100:00000001:13.0:1773851891.260668:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851891.260669:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851891.260671:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000078215e45 nid 22064@kfi7 refs 2
00000800:00000200:13.0:1773851891.260673:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 22064@kfi7(00000000d5b061b1):0x0 lsk 3865 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf18 Transaction freed
00000800:00000200:21.0:1773851891.282734:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851891.282735:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851891.282737:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851891.282738:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851891.282740:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23248@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.282741:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23248@kfi7 : PUT - for me
00000400:00000200:21.0:1773851891.282742:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23248@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.282744:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec58f67e nid 23248@kfi7 refs 1
00000400:00000200:21.0:1773851891.282745:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23248@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.282746:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec58f67e nid 23248@kfi7 refs 2
00000400:00000200:21.0:1773851891.282747:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ec58f67e nid 23248@kfi7 refs 3
00000400:00000200:21.0:1773851891.282748:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23056@kfi7 to cpt 2
00000400:00000200:21.0:1773851891.282749:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23056@kfi7 of length 224 into portal 12 MB=0x69b19000586c0
00000400:00000200:21.0:1773851891.282750:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23056@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 59112
00000800:00000200:21.0:1773851891.282752:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851891.282755:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851891.282756:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23248@kfi7: PUT: OK
00000100:00000001:21.0:1773851891.282757:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851891.282758:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851891.282759:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ddd92b5.
00000100:00000040:21.0:1773851891.282759:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002ddd92b5 x1859381537113792 msgsize 224
00000100:00100000:21.0:1773851891.282761:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23056@kfi7 (source: 12345-23248@kfi7)
00000100:00000001:21.0:1773851891.282762:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851891.282763:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec58f67e nid 23248@kfi7 refs 2
00000100:00000001:23.0:1773851891.282765:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851891.282765:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851891.282766:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851891.282767:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851891.282768:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851891.282769:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851891.282770:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381537113792
00000020:00000001:23.0:1773851891.282771:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851891.282772:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079678c8126
00000020:00000001:23.0:1773851891.282773:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851891.282778:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000022fd7b38 refcount=5
00000020:00000001:23.0:1773851891.282779:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029441531904 : -107044268019712 : ffff9ea4d06df000)
00000020:00000001:23.0:1773851891.282780:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029441531904 : -107044268019712 : ffff9ea4d06df000)
00000100:00000001:23.0:1773851891.282782:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851891.282783:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851891.282785:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c7a1431d.
00000020:00000010:23.0:1773851891.282787:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851891.282789:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000050a1410f.
00000100:00000001:23.0:1773851891.282791:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851891.282791:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851891.282792:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851891.282794:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851891.282794:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851891.282795:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851891.282797:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851891.282798:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851891.282798:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851891.282799:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851891.282799:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851891.282800:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23056@kfi7, seq: 1998056
00000100:00000001:23.0:1773851891.282801:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851891.282801:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000022fd7b38 : new rpc_count 1
00000100:00000001:23.0:1773851891.282802:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.282802:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667753728 : -106956041797888 : ffff9eb95b1f3f00)
00000100:00000040:20.0:1773851891.282804:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002ddd92b5 x1859381537113792/t0(0) o400->75536f66-7e78-48ab-b59e-c58c80f15cbb@23056@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1937-0'
00000100:00000001:20.0:1773851891.282806:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.282807:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851891.282808:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ddd92b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:75536f66-7e78-48ab-b59e-c58c80f15cbb+5:39726:x1859381537113792:12345-23056@kfi7:400:default-tuolumne1937-0
00000100:00000200:20.0:1773851891.282809:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381537113792
00000020:00000001:20.0:1773851891.282810:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851891.282810:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851891.282811:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.282812:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851891.282812:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851891.282813:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851891.282814:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381537113792, found 0 last_xid 1859381537113791
00000020:00000001:20.0:1773851891.282814:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851891.282815:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851891.282816:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851891.282816:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.282817:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851891.282817:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851891.282818:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851891.282819:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e14bbbb6.
02000000:00000001:20.0:1773851891.282819:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.282820:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.282821:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851891.282821:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182426466455, transno 0, xid 1859381537113792
00010000:00000001:20.0:1773851891.282822:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851891.282823:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002ddd92b5 x1859381537113792/t0(0) o400->75536f66-7e78-48ab-b59e-c58c80f15cbb@23056@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1937-0'
00010000:00000001:20.0:1773851891.282825:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851891.282826:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851891.282826:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=124 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851891.282828:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851891.282829:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000093cf7e96 refcount 3 to 23056@kfi7
00000100:00000001:20.0:1773851891.282830:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133600 : -107146658418016 : ffff9e8cf97c72a0)
02000000:00000001:20.0:1773851891.282831:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851891.282832:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.282832:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851891.282833:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23248@kfi7
00000400:00000010:20.0:1773851891.282834:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c0360258.
00000100:00000200:20.0:1773851891.282834:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859381537113792, offset 224
00000400:00000200:20.0:1773851891.282835:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23248@kfi7
00000400:00000200:20.0:1773851891.282836:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23248@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.282837:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec58f67e nid 23248@kfi7 refs 1
00000400:00000200:20.0:1773851891.282838:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ec58f67e nid 23248@kfi7 refs 2
00000400:00000200:20.0:1773851891.282839:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ec58f67e nid 23248@kfi7 refs 3
00000400:00000200:20.0:1773851891.282840:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23248@kfi7 local destination
00000400:00000200:20.0:1773851891.282842:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770002:8770002:1024:4294967295] 23248@kfi7 LPNI seq info [538640:538640:16:4294967295]
00000400:00000200:20.0:1773851891.282843:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ec58f67e nid 23248@kfi7 refs 2
00000400:00000200:20.0:1773851891.282844:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23248@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.282846:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23248@kfi7(23248@kfi7:23248@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851891.282847:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ec58f67e nid 23248@kfi7 refs 3
00000800:00000200:20.0:1773851891.282848:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851891.282849:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851891.282851:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851891.282854:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e6b Using peer 23248@kfi7(0x100000000000e6b)
00000800:00000200:20.0:1773851891.282857:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x100000000000e6b: rc=0
00000800:00000200:20.0:1773851891.282858:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e6b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851891.282860:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851891.282862:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000093cf7e96 refcount 2 to 23056@kfi7
00010000:00000001:20.0:1773851891.282863:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851891.282863:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.282864:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851891.282865:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002ddd92b5 x1859381537113792/t0(0) o400->75536f66-7e78-48ab-b59e-c58c80f15cbb@23056@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1937-0'
00000100:00100000:20.0:1773851891.282868:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ddd92b5 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:75536f66-7e78-48ab-b59e-c58c80f15cbb+5:39726:x1859381537113792:12345-23056@kfi7:400:default-tuolumne1937-0 Request processed in 61us (108us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851891.282870:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23056@kfi7, seq: 1998056
00000100:00000040:20.0:1773851891.282871:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000022fd7b38 : new rpc_count 0
00000100:00000001:20.0:1773851891.282872:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851891.282873:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851891.282873:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851891.282874:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000050a1410f.
00000020:00000010:20.0:1773851891.282875:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c7a1431d.
00000020:00000040:20.0:1773851891.282875:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000022fd7b38 : new refcount 4
00000100:00000001:20.0:1773851891.282876:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851891.282881:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e6b TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851891.282883:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851891.282884:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23248@kfi7: PUT: OK
00000400:00000200:21.0:1773851891.282884:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c0360258
00000400:00000010:21.0:1773851891.282885:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c0360258.
00000100:00000001:21.0:1773851891.282886:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851891.282886:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851891.282887:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec58f67e nid 23248@kfi7 refs 2
00000800:00000200:21.0:1773851891.282889:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 23248@kfi7(0000000043f3d8b1):0x0 lsk 3692 rsk 18 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000e6b Transaction freed
00000800:00000200:5.0:1773851891.301990:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851891.301990:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851891.301992:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851891.301994:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851891.301997:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.301998:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2085@kfi7 : PUT - for me
00000400:00000200:5.0:1773851891.301999:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.302000:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:5.0:1773851891.302001:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.302002:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:5.0:1773851891.302003:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:5.0:1773851891.302004:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851891.302005:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 224 into portal 12 MB=0x699e15c680280
00000400:00000200:5.0:1773851891.302007:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2085@kfi7 of length 224/224 into md 0x793926dc5 [64] + 160152
00000800:00000200:5.0:1773851891.302008:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851891.302010:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851891.302012:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000100:00000001:5.0:1773851891.302023:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851891.302024:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851891.302026:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a2cce4c3.
00000100:00000040:5.0:1773851891.302027:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000a2cce4c3 x1858043057275520 msgsize 224
00000100:00100000:5.0:1773851891.302028:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-2085@kfi7 (source: 12345-2085@kfi7)
00000100:00000001:5.0:1773851891.302029:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851891.302030:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:4.0:1773851891.302031:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851891.302032:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851891.302032:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851891.302033:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851891.302034:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851891.302034:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851891.302035:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043057275520
00000020:00000001:4.0:1773851891.302036:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851891.302037:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acbc6c7
00000020:00000001:4.0:1773851891.302037:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851891.302039:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a0c5e05 refcount=5
00000020:00000001:4.0:1773851891.302040:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636924251028480 : -107149458523136 : ffff9e8c52963c00)
00000020:00000001:4.0:1773851891.302041:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636924251028480 : -107149458523136 : ffff9e8c52963c00)
00000100:00000001:4.0:1773851891.302042:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851891.302043:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851891.302045:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000013b74ccb.
00000020:00000010:4.0:1773851891.302046:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851891.302047:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002747847d.
00000100:00000001:4.0:1773851891.302048:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851891.302049:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851891.302049:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851891.302050:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851891.302051:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851891.302051:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.302052:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851891.302054:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851891.302054:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851891.302054:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851891.302055:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851891.302056:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2085@kfi7, seq: 2001978
00000100:00000040:4.0:1773851891.302056:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a0c5e05 : new rpc_count 1
00000100:00000001:7.0:1773851891.302057:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851891.302057:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.302057:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636972731699712 : -107100977851904 : ffff9e979c429200)
00000100:00000040:4.0:1773851891.302058:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a2cce4c3 x1858043057275520/t0(0) o400->lustre5-MDT0001-lwp-OST000c_UUID@2085@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba113-0'
00000100:00000001:4.0:1773851891.302062:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851891.302062:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851891.302063:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a2cce4c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:lustre5-MDT0001-lwp-OST000c_UUID+5:272680:x1858043057275520:12345-2085@kfi7:400:default-yuba113-0
00000100:00000200:4.0:1773851891.302067:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043057275520
00000020:00000001:4.0:1773851891.302068:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851891.302068:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851891.302069:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.302070:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851891.302070:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851891.302071:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:4.0:1773851891.302072:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851891.302073:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851891.302073:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851891.302074:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.302075:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851891.302075:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851891.302076:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851891.302077:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009639c8bc.
02000000:00000001:4.0:1773851891.302077:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.302078:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.302079:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851891.302079:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858043057275520
00010000:00000001:4.0:1773851891.302080:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851891.302081:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a2cce4c3 x1858043057275520/t0(0) o400->lustre5-MDT0001-lwp-OST000c_UUID@2085@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba113-0'
00010000:00000001:4.0:1773851891.302084:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851891.302084:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851891.302085:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=123 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851891.302086:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851891.302087:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d7f92499 refcount 7 to 2085@kfi7
00000100:00000001:4.0:1773851891.302087:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413248 : -107145304138368 : ffff9e8d4a351d80)
02000000:00000001:4.0:1773851891.302088:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851891.302089:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.302090:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851891.302091:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000400:00000010:4.0:1773851891.302091:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a851431c.
00000100:00000200:4.0:1773851891.302092:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043057275520, offset 224
00000400:00000200:4.0:1773851891.302094:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000400:00000200:4.0:1773851891.302094:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:4.0:1773851891.302095:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:4.0:1773851891.302097:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:4.0:1773851891.302098:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:4.0:1773851891.302099:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2085@kfi7 local destination
00000400:00000200:4.0:1773851891.302100:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770003:8770003:1024:4294967295] 2085@kfi7 LPNI seq info [5403245:5403245:16:4294967295]
00000400:00000200:4.0:1773851891.302102:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:4.0:1773851891.302102:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:4.0:1773851891.302104:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851891.302106:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000800:00000200:4.0:1773851891.302107:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851891.302108:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851891.302110:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851891.302112:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Using peer 2085@kfi7(0x200000000000110)
00000800:00000200:4.0:1773851891.302115:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x200000000000110: rc=0
00000800:00000200:4.0:1773851891.302117:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851891.302119:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851891.302119:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d7f92499 refcount 6 to 2085@kfi7
00010000:00000001:4.0:1773851891.302120:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851891.302121:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.302121:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851891.302123:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a2cce4c3 x1858043057275520/t0(0) o400->lustre5-MDT0001-lwp-OST000c_UUID@2085@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba113-0'
00000100:00100000:4.0:1773851891.302126:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a2cce4c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:lustre5-MDT0001-lwp-OST000c_UUID+5:272680:x1858043057275520:12345-2085@kfi7:400:default-yuba113-0 Request processed in 64us (99us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851891.302131:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2085@kfi7, seq: 2001978
00000100:00000040:4.0:1773851891.302132:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a0c5e05 : new rpc_count 0
00000100:00000001:4.0:1773851891.302132:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851891.302133:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851891.302133:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851891.302134:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002747847d.
00000020:00000010:4.0:1773851891.302135:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000013b74ccb.
00000020:00000040:4.0:1773851891.302136:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009a0c5e05 : new refcount 4
00000100:00000001:4.0:1773851891.302137:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851891.302141:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851891.302143:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851891.302144:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2085@kfi7: PUT: OK
00000400:00000200:5.0:1773851891.302145:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a851431c
00000400:00000010:5.0:1773851891.302145:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a851431c.
00000100:00000001:5.0:1773851891.302146:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851891.302146:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851891.302147:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:5.0:1773851891.302149:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 2085@kfi7(00000000266767bb):0x0 lsk 273 rsk 4786 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000110 Transaction freed
00000800:00000200:13.0:1773851891.316231:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851891.316232:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851891.316234:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851891.316237:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851891.316240:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11440@kfi7 to cpt 3
00000400:00000200:13.0:1773851891.316242:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11440@kfi7 : PUT - for me
00000400:00000200:13.0:1773851891.316243:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11440@kfi7 to cpt 3
00000400:00000200:13.0:1773851891.316245:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 1
00000400:00000200:13.0:1773851891.316247:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11440@kfi7 to cpt 3
00000400:00000200:13.0:1773851891.316248:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 2
00000400:00000200:13.0:1773851891.316250:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 3
00000400:00000200:13.0:1773851891.316251:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11376@kfi7 to cpt 0
00000400:00000200:13.0:1773851891.316252:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11376@kfi7 of length 224 into portal 12 MB=0x69b09693f1f80
00000400:00000200:13.0:1773851891.316254:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11376@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 49408
00000800:00000200:13.0:1773851891.316257:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851891.316259:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851891.316261:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11440@kfi7: PUT: OK
00000100:00000001:13.0:1773851891.316262:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851891.316263:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851891.316264:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003eba1127.
00000100:00000040:13.0:1773851891.316265:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003eba1127 x1859314583019392 msgsize 224
00000100:00100000:13.0:1773851891.316267:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-11376@kfi7 (source: 12345-11440@kfi7)
00000100:00000001:13.0:1773851891.316269:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851891.316270:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 2
00000100:00000001:12.0:1773851891.316271:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851891.316272:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851891.316272:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851891.316273:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851891.316273:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851891.316275:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851891.316276:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314583019392
00000020:00000001:12.0:1773851891.316277:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851891.316277:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a79
00000020:00000001:12.0:1773851891.316278:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851891.316282:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000002ad68c8 refcount=6
00000020:00000001:12.0:1773851891.316283:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627773440 : -107123081778176 : ffff9e9276c36c00)
00000020:00000001:12.0:1773851891.316285:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627773440 : -107123081778176 : ffff9e9276c36c00)
00000100:00000001:12.0:1773851891.316286:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851891.316287:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851891.316288:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057ada156.
00000020:00000010:12.0:1773851891.316290:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851891.316291:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000028d2b47d.
00000100:00000001:12.0:1773851891.316293:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851891.316294:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851891.316294:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851891.316296:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851891.316297:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851891.316297:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.316299:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851891.316301:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851891.316301:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851891.316302:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851891.316302:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851891.316303:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11376@kfi7, seq: 2289909
00000100:00000001:15.0:1773851891.316305:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851891.316305:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000002ad68c8 : new rpc_count 1
00000100:00000001:15.0:1773851891.316306:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.316306:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485610752 : -107000223940864 : ffff9eaf11a93f00)
00000100:00000040:12.0:1773851891.316307:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003eba1127 x1859314583019392/t0(0) o400->e868050a-1641-4a31-8cf8-38a1ff60145d@11376@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1198-0'
00000100:00000001:12.0:1773851891.316312:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851891.316312:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851891.316314:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003eba1127 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e868050a-1641-4a31-8cf8-38a1ff60145d+6:40051:x1859314583019392:12345-11376@kfi7:400:default-tuolumne1198-0
00000100:00000200:12.0:1773851891.316316:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314583019392
00000020:00000001:12.0:1773851891.316317:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851891.316318:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851891.316319:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.316320:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851891.316320:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851891.316321:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851891.316322:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314583019392, found 0 last_xid 1859314583019391
00000020:00000001:12.0:1773851891.316323:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851891.316325:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851891.316325:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851891.316326:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.316327:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851891.316328:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851891.316329:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851891.316330:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000080148709.
02000000:00000001:12.0:1773851891.316331:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.316332:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.316333:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851891.316334:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684854, transno 0, xid 1859314583019392
00010000:00000001:12.0:1773851891.316335:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851891.316337:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003eba1127 x1859314583019392/t0(0) o400->e868050a-1641-4a31-8cf8-38a1ff60145d@11376@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1198-0'
00010000:00000001:12.0:1773851891.316340:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851891.316341:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851891.316342:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=124 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851891.316344:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851891.316345:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000357aabb2 refcount 3 to 11376@kfi7
00000100:00000001:12.0:1773851891.316346:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002176 : -107146751549440 : ffff9e8cf3ef6000)
02000000:00000001:12.0:1773851891.316347:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851891.316348:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851891.316349:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851891.316350:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11440@kfi7
00000400:00000010:12.0:1773851891.316351:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009fd0199.
00000100:00000200:12.0:1773851891.316353:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314583019392, offset 224
00000400:00000200:12.0:1773851891.316355:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11440@kfi7
00000400:00000200:12.0:1773851891.316356:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11440@kfi7 to cpt 3
00000400:00000200:12.0:1773851891.316358:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 1
00000400:00000200:12.0:1773851891.316359:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 2
00000400:00000200:12.0:1773851891.316361:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 3
00000400:00000200:12.0:1773851891.316363:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11440@kfi7 local destination
00000400:00000200:12.0:1773851891.316365:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770004:8770004:1024:4294967295] 11440@kfi7 LPNI seq info [900472:900472:16:4294967295]
00000400:00000200:12.0:1773851891.316367:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 2
00000400:00000200:12.0:1773851891.316368:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11440@kfi7 to cpt 3
00000400:00000200:12.0:1773851891.316372:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11440@kfi7(11440@kfi7:11440@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851891.316374:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 3
00000800:00000200:12.0:1773851891.316376:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851891.316377:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851891.316381:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851891.316385:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x59 Using peer 11440@kfi7(0x59)
00000800:00000200:12.0:1773851891.316389:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x59: rc=0
00000800:00000200:12.0:1773851891.316391:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x59 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851891.316394:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851891.316396:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000357aabb2 refcount 2 to 11376@kfi7
00010000:00000001:12.0:1773851891.316397:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851891.316397:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851891.316401:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851891.316402:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003eba1127 x1859314583019392/t0(0) o400->e868050a-1641-4a31-8cf8-38a1ff60145d@11376@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1198-0'
00000100:00100000:12.0:1773851891.316407:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003eba1127 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:e868050a-1641-4a31-8cf8-38a1ff60145d+6:40051:x1859314583019392:12345-11376@kfi7:400:default-tuolumne1198-0 Request processed in 94us (140us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851891.316410:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11376@kfi7, seq: 2289909
00000100:00000040:12.0:1773851891.316411:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000002ad68c8 : new rpc_count 0
00000100:00000001:12.0:1773851891.316412:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851891.316413:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851891.316414:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851891.316415:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000028d2b47d.
00000020:00000010:12.0:1773851891.316416:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057ada156.
00000020:00000040:12.0:1773851891.316418:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000002ad68c8 : new refcount 5
00000100:00000001:12.0:1773851891.316419:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851891.316426:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x59 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851891.316429:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851891.316430:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11440@kfi7: PUT: OK
00000400:00000200:13.0:1773851891.316431:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009fd0199
00000400:00000010:13.0:1773851891.316432:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009fd0199.
00000100:00000001:13.0:1773851891.316433:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851891.316434:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851891.316435:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003bd6b6f2 nid 11440@kfi7 refs 2
00000800:00000200:13.0:1773851891.316437:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 11440@kfi7(00000000930c49d8):0x0 lsk 90 rsk 55 tsk 0 trmk 0 tmk 0 trr 3 tta 0x59 Transaction freed
00000800:00000200:9.0:1773851891.403914:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.403915:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.403916:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.403919:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851891.403921:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12322@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.403922:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12322@kfi7 : PUT - for me
00000400:00000200:9.0:1773851891.403923:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12322@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.403924:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8bbace nid 12322@kfi7 refs 1
00000400:00000200:9.0:1773851891.403925:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12322@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.403926:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8bbace nid 12322@kfi7 refs 2
00000400:00000200:9.0:1773851891.403927:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ea8bbace nid 12322@kfi7 refs 3
00000400:00000200:9.0:1773851891.403928:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12514@kfi7 to cpt 5
00000400:00000200:9.0:1773851891.403929:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12514@kfi7 of length 224 into portal 12 MB=0x69b4b5bf2c8c0
00000400:00000200:9.0:1773851891.403930:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12514@kfi7 of length 224/224 into md 0x78146ce49 [64] + 154744
00000800:00000200:9.0:1773851891.403932:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851891.403934:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.403935:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12322@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.403937:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851891.403938:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851891.403939:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000827df06a.
00000100:00000040:9.0:1773851891.403940:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000827df06a x1859597827754176 msgsize 224
00000100:00100000:9.0:1773851891.403941:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-12514@kfi7 (source: 12345-12322@kfi7)
00000100:00000001:9.0:1773851891.403943:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851891.403945:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea8bbace nid 12322@kfi7 refs 2
00000800:00000200:9.0:1773851891.403947:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851891.403950:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851891.403951:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851891.403951:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851891.403952:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851891.403953:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851891.403954:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597827754176
00000020:00000001:9.0:1773851891.403954:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851891.403955:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eecf
00000020:00000001:9.0:1773851891.403955:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851891.403958:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000049bcf5ae refcount=5
00000020:00000001:9.0:1773851891.403959:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962295300096 : -107111414251520 : ffff9e952e33c000)
00000020:00000001:9.0:1773851891.403960:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636962295300096 : -107111414251520 : ffff9e952e33c000)
00000100:00000001:9.0:1773851891.403961:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851891.403962:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851891.403962:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000321b48d7.
00000020:00000010:9.0:1773851891.403964:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851891.403964:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004f49bd4a.
00000100:00000001:9.0:1773851891.403965:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851891.403966:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851891.403967:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.403968:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851891.403968:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851891.403969:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.403970:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.403971:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851891.403971:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851891.403972:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851891.403972:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851891.403973:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12514@kfi7, seq: 2130846
00000100:00000040:9.0:1773851891.403974:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000049bcf5ae : new rpc_count 1
00000100:00000001:8.0:1773851891.403974:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.403975:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856885376 : -106914852666240 : ffff9ec2f22f8480)
00000100:00000001:8.0:1773851891.403975:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851891.403976:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000827df06a x1859597827754176/t0(0) o400->54d90e32-c571-4b1f-b499-b707fd5c7587@12514@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1259-0'
00000100:00000001:9.0:1773851891.403979:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851891.403979:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851891.403980:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000827df06a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:54d90e32-c571-4b1f-b499-b707fd5c7587+5:39562:x1859597827754176:12345-12514@kfi7:400:default-tuolumne1259-0
00000100:00000200:9.0:1773851891.403982:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597827754176
00000020:00000001:9.0:1773851891.403983:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851891.403983:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851891.403984:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.403985:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851891.403985:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851891.403986:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851891.403987:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597827754176, found 0 last_xid 1859597827754175
00000020:00000001:9.0:1773851891.403988:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851891.403988:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851891.403989:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851891.403989:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.403990:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851891.403991:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851891.403991:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851891.403993:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ecd095f5.
02000000:00000001:9.0:1773851891.403993:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.403994:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.403995:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851891.403996:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256841452, transno 0, xid 1859597827754176
00010000:00000001:9.0:1773851891.403996:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851891.403997:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000827df06a x1859597827754176/t0(0) o400->54d90e32-c571-4b1f-b499-b707fd5c7587@12514@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1259-0'
00010000:00000001:9.0:1773851891.404000:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851891.404001:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851891.404002:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=124 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851891.404003:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851891.404004:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e7c2cb6c refcount 3 to 12514@kfi7
00000100:00000001:9.0:1773851891.404005:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957449792 : -107146752101824 : ffff9e8cf3e6f240)
02000000:00000001:9.0:1773851891.404006:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851891.404006:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.404007:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851891.404008:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12322@kfi7
00000400:00000010:9.0:1773851891.404009:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000451e99c3.
00000100:00000200:9.0:1773851891.404010:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597827754176, offset 224
00000400:00000200:9.0:1773851891.404011:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12322@kfi7
00000400:00000200:9.0:1773851891.404012:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12322@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.404013:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8bbace nid 12322@kfi7 refs 1
00000400:00000200:9.0:1773851891.404014:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ea8bbace nid 12322@kfi7 refs 2
00000400:00000200:9.0:1773851891.404015:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ea8bbace nid 12322@kfi7 refs 3
00000400:00000200:9.0:1773851891.404016:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12322@kfi7 local destination
00000400:00000200:9.0:1773851891.404017:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770005:8770005:1024:4294967295] 12322@kfi7 LPNI seq info [935278:935278:16:4294967295]
00000400:00000200:9.0:1773851891.404019:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ea8bbace nid 12322@kfi7 refs 2
00000400:00000200:9.0:1773851891.404020:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12322@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.404021:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12322@kfi7(12322@kfi7:12322@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851891.404023:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ea8bbace nid 12322@kfi7 refs 3
00000800:00000200:9.0:1773851891.404024:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.404025:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851891.404027:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851891.404030:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000256 Using peer 12322@kfi7(0x100000000000256)
00000800:00000200:9.0:1773851891.404033:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x100000000000256: rc=0
00000800:00000200:9.0:1773851891.404034:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000256 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851891.404041:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851891.404042:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e7c2cb6c refcount 2 to 12514@kfi7
00010000:00000001:9.0:1773851891.404043:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851891.404044:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.404044:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851891.404045:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000827df06a x1859597827754176/t0(0) o400->54d90e32-c571-4b1f-b499-b707fd5c7587@12514@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1259-0'
00000100:00100000:9.0:1773851891.404049:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000827df06a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:54d90e32-c571-4b1f-b499-b707fd5c7587+5:39562:x1859597827754176:12345-12514@kfi7:400:default-tuolumne1259-0 Request processed in 69us (108us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851891.404050:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000256 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851891.404051:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12514@kfi7, seq: 2130846
00000400:00000200:10.0:1773851891.404052:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:9.0:1773851891.404052:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000049bcf5ae : new rpc_count 0
00000100:00000001:9.0:1773851891.404053:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851891.404054:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12322@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.404054:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851891.404054:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851891.404055:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004f49bd4a.
00000400:00000200:10.0:1773851891.404056:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000451e99c3
00000400:00000010:10.0:1773851891.404056:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000451e99c3.
00000020:00000010:9.0:1773851891.404056:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000321b48d7.
00000100:00000001:10.0:1773851891.404057:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:9.0:1773851891.404057:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000049bcf5ae : new refcount 4
00000100:00000001:9.0:1773851891.404057:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851891.404058:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851891.404059:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea8bbace nid 12322@kfi7 refs 2
00000800:00000200:10.0:1773851891.404062:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 12322@kfi7(00000000fb617944):0x0 lsk 599 rsk 12 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000256 Transaction freed
00000800:00000200:6.0:1773851891.434833:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851891.434834:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851891.434835:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851891.434837:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851891.434839:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.434840:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:6.0:1773851891.434841:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.434842:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:6.0:1773851891.434843:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.434844:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851891.434845:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:6.0:1773851891.434845:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.434846:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed44d680
00000400:00000200:6.0:1773851891.434848:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x793844545 [256] + 7856
00000800:00000200:6.0:1773851891.434849:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851891.434851:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851891.434852:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000100:00000001:6.0:1773851891.434853:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851891.434853:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:6.0:1773851891.434854:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070b5fd45.
00000100:00000040:6.0:1773851891.434855:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000070b5fd45 x1858062667536000 msgsize 224
00000100:00100000:6.0:1773851891.434856:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2098@kfi7)
00000100:00000001:6.0:1773851891.434858:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851891.434859:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:6.0:1773851891.434860:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851891.434863:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851891.434863:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851891.434864:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851891.434864:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851891.434866:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851891.434867:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667536000
00000020:00000001:6.0:1773851891.434867:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851891.434868:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:6.0:1773851891.434869:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851891.434870:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:6.0:1773851891.434871:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:6.0:1773851891.434872:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:6.0:1773851891.434873:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851891.434873:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851891.434874:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851891.434875:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851891.434876:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851891.434877:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851891.434878:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851891.434878:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851891.434879:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851891.434880:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851891.434881:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851891.434882:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851891.434883:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851891.434883:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851891.434883:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851891.434884:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 18314086
00000100:00000040:6.0:1773851891.434885:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:5.0:1773851891.434885:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851891.434886:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814063488 : -107101895488128 : ffff9e9765908d80)
00000100:00000001:5.0:1773851891.434886:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851891.434887:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000070b5fd45 x1858062667536000/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:6.0:1773851891.434889:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851891.434890:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851891.434891:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070b5fd45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667536000:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:6.0:1773851891.434892:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667536000
00000020:00000001:6.0:1773851891.434893:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851891.434893:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851891.434894:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851891.434895:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851891.434896:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851891.434897:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851891.434897:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851891.434898:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851891.434898:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851891.434899:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851891.434900:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851891.434900:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851891.434901:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000001d6727ea.
02000000:00000001:6.0:1773851891.434902:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851891.434903:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851891.434903:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851891.434904:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851891.434904:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851891.434905:0:1537125:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:6.0:1773851891.434906:0:1537125:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851891.434906:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 154140672 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851891.434907:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966131731 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851891.434908:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851891.434909:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667536000
00010000:00000001:6.0:1773851891.434910:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851891.434911:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000070b5fd45 x1858062667536000/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:6.0:1773851891.434913:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851891.434914:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851891.434915:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=120 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851891.434916:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851891.434917:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:6.0:1773851891.434917:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:6.0:1773851891.434918:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851891.434919:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851891.434920:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851891.434920:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:6.0:1773851891.434922:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047456fe2.
00000100:00000200:6.0:1773851891.434922:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667536000, offset 224
00000400:00000200:6.0:1773851891.434924:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:6.0:1773851891.434925:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.434925:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:6.0:1773851891.434926:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851891.434928:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:6.0:1773851891.434929:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2098@kfi7 local destination
00000400:00000200:6.0:1773851891.434930:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770006:8770006:1024:4294967295] 2098@kfi7 LPNI seq info [20346212:20346212:16:4294967295]
00000400:00000200:6.0:1773851891.434932:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851891.434932:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.434934:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851891.434935:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:6.0:1773851891.434936:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851891.434937:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851891.434940:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851891.434942:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Using peer 2098@kfi7(0x2000000000004bc)
00000800:00000200:6.0:1773851891.434945:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 468 bytes to peer 0x2000000000004bc: rc=0
00000800:00000200:6.0:1773851891.434946:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851891.434948:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851891.434949:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:6.0:1773851891.434950:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851891.434950:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851891.434951:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851891.434951:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000070b5fd45 x1858062667536000/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000800:00000200:5.0:1773851891.434956:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851891.434957:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851891.434958:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000400:00000200:5.0:1773851891.434959:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047456fe2
00000400:00000010:5.0:1773851891.434960:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047456fe2.
00000100:00000001:5.0:1773851891.434960:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851891.434961:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851891.434962:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:5.0:1773851891.434963:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Transaction freed
00000100:00100000:6.0:1773851891.434967:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070b5fd45 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667536000:12345-2098@kfi7:41:default-yuba6-0 Request processed in 77us (111us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851891.434969:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 18314086
00000100:00000040:6.0:1773851891.434970:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:6.0:1773851891.434971:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851891.434972:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851891.434972:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:6.0:1773851891.434973:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000020:00000010:6.0:1773851891.434974:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000020:00000040:6.0:1773851891.434975:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:6.0:1773851891.434975:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851891.501043:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851891.501043:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851891.501044:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851891.501044:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851891.501046:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851891.501046:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851891.501049:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851891.501049:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11312@kfi7(00000000a52a98ef):0x6a8 version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851891.501052:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000800:00000200:17.0:1773851891.501053:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 Using peer 11312@kfi7(0x6a8)
00000400:00000200:18.0:1773851891.501054:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11312@kfi7 : PUT - for me
00000400:00000200:18.0:1773851891.501055:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000400:00000200:18.0:1773851891.501058:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c754fd99 nid 11312@kfi7 refs 1
00000400:00000200:18.0:1773851891.501060:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000400:00000200:18.0:1773851891.501061:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c754fd99 nid 11312@kfi7 refs 2
00000400:00000200:18.0:1773851891.501063:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c754fd99 nid 11312@kfi7 refs 3
00000400:00000200:17.0:1773851891.501064:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000400:00000200:18.0:1773851891.501065:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000400:00000200:18.0:1773851891.501067:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11312@kfi7 of length 456 into portal 12 MB=0x69b09f8b4cc80
00000800:00000200:17.0:1773851891.501067:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x6a8: rc=0
00000400:00000200:18.0:1773851891.501069:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11312@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 40272
00000800:00000200:17.0:1773851891.501069:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:18.0:1773851891.501072:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851891.501075:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851891.501077:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11312@kfi7: PUT: OK
00000100:00000001:18.0:1773851891.501078:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851891.501079:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851891.501080:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac32f532.
00000100:00000040:18.0:1773851891.501081:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000ac32f532 x1859316989873280 msgsize 456
00000800:00000200:17.0:1773851891.501083:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851891.501084:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-11312@kfi7 (source: 12345-11312@kfi7)
00000100:00000001:18.0:1773851891.501086:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851891.501087:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 Transaction freed
00000400:00000200:18.0:1773851891.501088:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c754fd99 nid 11312@kfi7 refs 2
00000800:00000200:18.0:1773851891.501090:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851891.501091:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851891.501091:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851891.501092:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851891.501093:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851891.501095:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851891.501096:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316989873280
00000020:00000001:19.0:1773851891.501097:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851891.501098:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f25
00000020:00000001:19.0:1773851891.501099:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851891.501103:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fb49f329 refcount=2189
00000020:00000001:19.0:1773851891.501104:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744667136 : -107128964884480 : ffff9e91181a5800)
00000020:00000001:19.0:1773851891.501105:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744667136 : -107128964884480 : ffff9e91181a5800)
00000100:00000001:19.0:1773851891.501108:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851891.501109:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851891.501110:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851891.501112:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851891.501114:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851891.501115:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851891.501116:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851891.501117:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.501119:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.501121:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851891.501124:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851891.501124:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851891.501125:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851891.501125:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851891.501127:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11312@kfi7, seq: 323103291
00000100:00000040:19.0:1773851891.501128:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fb49f329 : new rpc_count 8
00000100:00000001:16.0:1773851891.501128:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.501129:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609997696 : -107015099553920 : ffff9eab9b016780)
00000100:00000001:16.0:1773851891.501129:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851891.501131:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ac32f532 x1859316989873280/t0(0) o17->4aab4d56-804a-4f56-9252-987d17ee7f99@11312@kfi7:679/0 lens 456/0 e 0 to 0 dl 1773852039 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1197-0'
00000100:00000001:19.0:1773851891.501136:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851891.501137:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851891.501138:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac32f532 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4aab4d56-804a-4f56-9252-987d17ee7f99+2189:39798:x1859316989873280:12345-11312@kfi7:17:default-tuolumne1197-0
00000100:00000200:19.0:1773851891.501141:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316989873280
00000020:00000001:19.0:1773851891.501142:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851891.501143:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851891.501144:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.501145:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851891.501146:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:19.0:1773851891.501148:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851891.501148:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316989873280, found 0 last_xid 1859316989179903
00000020:00000001:19.0:1773851891.501150:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851891.501151:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851891.501152:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851891.501153:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851891.501154:0:60961:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:19.0:1773851891.501156:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851891.501157:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851891.501158:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000001ae1ab4a.
02000000:00000001:19.0:1773851891.501159:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.501160:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.501162:0:60961:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:19.0:1773851891.501163:0:60961:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:19.0:1773851891.501164:0:60961:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:19.0:1773851891.501167:0:60961:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.501168:0:60961:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:19.0:1773851891.501169:0:60961:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 4aab4d56-804a-4f56-9252-987d17ee7f99/00000000fb49f329 free: 126633370845184 avail: 126633368748032
00000020:00000001:19.0:1773851891.501171:0:60961:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:19.0:1773851891.501172:0:60961:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 4aab4d56-804a-4f56-9252-987d17ee7f99/00000000fb49f329 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:19.0:1773851891.501174:0:60961:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:19.0:1773851891.501175:0:60961:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:19.0:1773851891.501176:0:60961:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 4aab4d56-804a-4f56-9252-987d17ee7f99/00000000fb49f329 reports grant 1798569983 dropped 0, local 1866727423
00000020:00000001:19.0:1773851891.501178:0:60961:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:19.0:1773851891.501179:0:60961:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:19.0:1773851891.501179:0:60961:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851891.501180:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593489, transno 0, xid 1859316989873280
00010000:00000001:19.0:1773851891.501182:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851891.501183:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ac32f532 x1859316989873280/t0(0) o17->4aab4d56-804a-4f56-9252-987d17ee7f99@11312@kfi7:679/0 lens 456/432 e 0 to 0 dl 1773852039 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1197-0'
00010000:00000001:19.0:1773851891.501187:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851891.501188:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851891.501190:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=124 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851891.501192:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851891.501193:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000071f74d6b refcount 3 to 11312@kfi7
00000100:00000001:19.0:1773851891.501194:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333472 : -107155408218144 : ffff9e8aeff517e0)
02000000:00000001:19.0:1773851891.501195:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851891.501196:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.501197:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851891.501199:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11312@kfi7
00000400:00000010:19.0:1773851891.501200:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d7fd7892.
00000100:00000200:19.0:1773851891.501202:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859316989873280, offset 224
00000400:00000200:19.0:1773851891.501204:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11312@kfi7
00000400:00000200:19.0:1773851891.501206:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000400:00000200:19.0:1773851891.501207:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c754fd99 nid 11312@kfi7 refs 1
00000400:00000200:19.0:1773851891.501209:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c754fd99 nid 11312@kfi7 refs 2
00000400:00000200:19.0:1773851891.501211:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c754fd99 nid 11312@kfi7 refs 3
00000400:00000200:19.0:1773851891.501213:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11312@kfi7 local destination
00000400:00000200:19.0:1773851891.501216:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770007:8770007:1024:4294967295] 11312@kfi7 LPNI seq info [22618631:22618631:16:4294967295]
00000400:00000200:19.0:1773851891.501218:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c754fd99 nid 11312@kfi7 refs 2
00000400:00000200:19.0:1773851891.501220:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11312@kfi7 to cpt 4
00000400:00000200:19.0:1773851891.501223:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11312@kfi7(11312@kfi7:11312@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851891.501225:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c754fd99 nid 11312@kfi7 refs 3
00000800:00000200:19.0:1773851891.501228:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851891.501230:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:19.0:1773851891.501234:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851891.501239:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 Using peer 11312@kfi7(0x6a8)
00000800:00000200:19.0:1773851891.501244:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000024734d67: Posted send of 532 bytes to peer 0x6a8: rc=0
00000800:00000200:19.0:1773851891.501247:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851891.501251:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851891.501252:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000071f74d6b refcount 2 to 11312@kfi7
00010000:00000001:19.0:1773851891.501253:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851891.501254:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.501255:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851891.501257:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac32f532 x1859316989873280/t0(0) o17->4aab4d56-804a-4f56-9252-987d17ee7f99@11312@kfi7:679/0 lens 456/432 e 0 to 0 dl 1773852039 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1197-0'
00000800:00000200:17.0:1773851891.501261:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851891.501263:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851891.501265:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11312@kfi7: PUT: OK
00000400:00000200:17.0:1773851891.501266:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d7fd7892
00000100:00100000:19.0:1773851891.501267:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac32f532 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4aab4d56-804a-4f56-9252-987d17ee7f99+2189:39798:x1859316989873280:12345-11312@kfi7:17:default-tuolumne1197-0 Request processed in 130us (184us total) trans 0 rc 0/0
00000400:00000010:17.0:1773851891.501267:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d7fd7892.
00000100:00000001:17.0:1773851891.501269:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851891.501269:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851891.501271:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c754fd99 nid 11312@kfi7 refs 2
00000100:00100000:19.0:1773851891.501272:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11312@kfi7, seq: 323103291
00000100:00000040:19.0:1773851891.501274:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fb49f329 : new rpc_count 7
00000800:00000200:17.0:1773851891.501274:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 11312@kfi7(00000000a52a98ef):0x0 lsk 1705 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6a8 Transaction freed
00000100:00000001:19.0:1773851891.501275:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851891.501276:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851891.501277:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851891.501279:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000020:00000010:19.0:1773851891.501280:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000020:00000040:19.0:1773851891.501282:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000fb49f329 : new refcount 2188
00000100:00000001:19.0:1773851891.501283:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851891.502864:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.502865:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.502866:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.502868:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851891.502870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8400@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.502872:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8400@kfi7 : PUT - for me
00000400:00000200:9.0:1773851891.502873:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8400@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.502874:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099376227 nid 8400@kfi7 refs 1
00000400:00000200:9.0:1773851891.502875:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8400@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.502875:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099376227 nid 8400@kfi7 refs 2
00000400:00000200:9.0:1773851891.502876:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000099376227 nid 8400@kfi7 refs 3
00000400:00000200:9.0:1773851891.502878:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8400@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.502879:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8400@kfi7 of length 224 into portal 12 MB=0x69bad05920280
00000400:00000200:9.0:1773851891.502880:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8400@kfi7 of length 224/224 into md 0x78146ce49 [64] + 154968
00000800:00000200:9.0:1773851891.502882:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851891.502883:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.502884:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8400@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.502886:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851891.502886:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851891.502887:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006ca84438.
00000100:00000040:9.0:1773851891.502888:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006ca84438 x1860017285366400 msgsize 224
00000100:00100000:9.0:1773851891.502889:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8400@kfi7 (source: 12345-8400@kfi7)
00000100:00000001:9.0:1773851891.502891:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851891.502892:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000099376227 nid 8400@kfi7 refs 2
00000800:00000200:9.0:1773851891.502893:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851891.502896:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851891.502896:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851891.502897:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851891.502897:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851891.502898:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851891.502899:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860017285366400
00000020:00000001:9.0:1773851891.502899:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851891.502900:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a66ce8
00000020:00000001:9.0:1773851891.502900:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851891.502901:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000edbd84fa refcount=9
00000020:00000001:9.0:1773851891.502902:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928126326784 : -107145583224832 : ffff9e8d39929800)
00000020:00000001:9.0:1773851891.502903:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928126326784 : -107145583224832 : ffff9e8d39929800)
00000100:00000001:9.0:1773851891.502904:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851891.502904:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851891.502905:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000321b48d7.
00000020:00000010:9.0:1773851891.502906:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851891.502907:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004f49bd4a.
00000100:00000001:9.0:1773851891.502908:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851891.502909:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851891.502909:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.502910:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851891.502910:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851891.502911:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.502912:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.502913:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851891.502913:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851891.502913:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851891.502914:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851891.502915:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8400@kfi7, seq: 2130847
00000100:00000040:9.0:1773851891.502915:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000edbd84fa : new rpc_count 2
00000100:00000001:8.0:1773851891.502915:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.502916:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856889984 : -106914852661632 : ffff9ec2f22f9680)
00000100:00000001:8.0:1773851891.502916:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851891.502917:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006ca84438 x1860017285366400/t0(0) o400->a1bc71a2-80a7-4ced-92e6-68efc9cc6b6b@8400@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1009-0'
00000100:00000001:9.0:1773851891.502920:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851891.502920:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851891.502921:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006ca84438 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a1bc71a2-80a7-4ced-92e6-68efc9cc6b6b+9:39499:x1860017285366400:12345-8400@kfi7:400:default-tuolumne1009-0
00000100:00000200:9.0:1773851891.502922:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860017285366400
00000020:00000001:9.0:1773851891.502923:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851891.502924:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851891.502924:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.502925:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851891.502925:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851891.502926:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851891.502927:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860017285366400, found 0 last_xid 1860017285363967
00000020:00000001:9.0:1773851891.502927:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851891.502928:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851891.502929:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851891.502929:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.502930:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851891.502930:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851891.502931:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851891.502932:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2428430.
02000000:00000001:9.0:1773851891.502933:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.502934:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.502934:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851891.502935:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860017285366400
00010000:00000001:9.0:1773851891.502936:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851891.502937:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006ca84438 x1860017285366400/t0(0) o400->a1bc71a2-80a7-4ced-92e6-68efc9cc6b6b@8400@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1009-0'
00010000:00000001:9.0:1773851891.502939:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851891.502940:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851891.502940:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=124 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851891.502941:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851891.502942:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003849f242 refcount 5 to 8400@kfi7
00000100:00000001:9.0:1773851891.502943:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637033135931872 : -107040573619744 : ffff9ea5aca201e0)
02000000:00000001:9.0:1773851891.502944:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851891.502944:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.502945:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851891.502946:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8400@kfi7
00000400:00000010:9.0:1773851891.502946:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f232fba1.
00000100:00000200:9.0:1773851891.502947:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860017285366400, offset 224
00000400:00000200:9.0:1773851891.502948:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8400@kfi7
00000400:00000200:9.0:1773851891.502949:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8400@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.502950:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099376227 nid 8400@kfi7 refs 1
00000400:00000200:9.0:1773851891.502951:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000099376227 nid 8400@kfi7 refs 2
00000400:00000200:9.0:1773851891.502952:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000099376227 nid 8400@kfi7 refs 3
00000400:00000200:9.0:1773851891.502953:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8400@kfi7 local destination
00000400:00000200:9.0:1773851891.502954:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770008:8770008:1024:4294967295] 8400@kfi7 LPNI seq info [2451226:2451226:16:4294967295]
00000400:00000200:9.0:1773851891.502956:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000099376227 nid 8400@kfi7 refs 2
00000400:00000200:9.0:1773851891.502957:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8400@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.502958:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8400@kfi7(8400@kfi7:8400@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851891.502960:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000099376227 nid 8400@kfi7 refs 3
00000800:00000200:9.0:1773851891.502961:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.502962:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851891.502965:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851891.502967:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x126f Using peer 8400@kfi7(0x126f)
00000800:00000200:9.0:1773851891.502970:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000438708cd: Posted send of 324 bytes to peer 0x126f: rc=0
00000800:00000200:9.0:1773851891.502971:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x126f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851891.502973:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851891.502974:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003849f242 refcount 4 to 8400@kfi7
00010000:00000001:9.0:1773851891.502975:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851891.502975:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851891.502976:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851891.502977:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006ca84438 x1860017285366400/t0(0) o400->a1bc71a2-80a7-4ced-92e6-68efc9cc6b6b@8400@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1009-0'
00000100:00100000:9.0:1773851891.502980:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006ca84438 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:a1bc71a2-80a7-4ced-92e6-68efc9cc6b6b+9:39499:x1860017285366400:12345-8400@kfi7:400:default-tuolumne1009-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851891.502982:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8400@kfi7, seq: 2130847
00000100:00000040:9.0:1773851891.502983:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000edbd84fa : new rpc_count 1
00000100:00000001:9.0:1773851891.502983:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:10.0:1773851891.502984:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x126f TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851891.502984:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851891.502984:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851891.502985:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004f49bd4a.
00000020:00000010:9.0:1773851891.502986:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000321b48d7.
00000020:00000040:9.0:1773851891.502987:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000edbd84fa : new refcount 8
00000100:00000001:9.0:1773851891.502987:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851891.502988:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851891.502989:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8400@kfi7: PUT: OK
00000400:00000200:10.0:1773851891.502990:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f232fba1
00000400:00000010:10.0:1773851891.502991:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f232fba1.
00000100:00000001:10.0:1773851891.502991:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851891.502992:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851891.502993:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000099376227 nid 8400@kfi7 refs 2
00000800:00000200:10.0:1773851891.502994:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000438708cd: 2069@kfi7:2 -> 8400@kfi7(00000000489098bb):0x0 lsk 4720 rsk 15 tsk 0 trmk 0 tmk 0 trr 2 tta 0x126f Transaction freed
00000004:00000001:11.0:1773851891.529732:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851891.529732:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851891.529733:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000eca030e.
00000020:00000040:11.0:1773851891.529734:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851891.529735:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851891.529736:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851891.529736:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851891.529737:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000545d49bf.
00000100:00000001:11.0:1773851891.529738:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851891.529739:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851891.529740:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851891.529741:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000eca030e] to pc [ptlrpcd_02_03+3]  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851891.529745:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:10.0:1773851891.529745:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:11.0:1773851891.529746:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000076e9752.
00000100:00000001:10.0:1773851891.529746:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851891.529746:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851891.529746:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851891.529747:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637009397669888 : -107064311881728 : ffff9ea025b8e000)
00000100:00000040:10.0:1773851891.529747:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851891.529747:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851891.529748:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:11.0:1773851891.529749:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851891.529750:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000004:00000010:11.0:1773851891.529750:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000e979022e.
00000100:00000001:10.0:1773851891.529750:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851891.529750:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:11.0:1773851891.529751:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614165983027040ns, next at 614166983025598ns, rc = 0
02000000:00000001:10.0:1773851891.529751:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:10.0:1773851891.529752:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851891.529753:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:10.0:1773851891.529753:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000eca030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051938112:2075@kfi7:13:default-yuba2-0
00080000:00000001:11.0:1773851891.529754:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851891.529754:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851891.529754:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851891.529755:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851891.529755:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851891.529756:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:10.0:1773851891.529757:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000026cc010.
02000000:00000001:10.0:1773851891.529758:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851891.529759:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:10.0:1773851891.529759:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000400:00000010:10.0:1773851891.529760:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000200:10.0:1773851891.529761:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938112, portal 4
00000100:00000001:10.0:1773851891.529762:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851891.529763:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446615680 : -106937262935936 : ffff9ebdba6df080)
00000100:00000040:10.0:1773851891.529764:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851891.529769:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851891.529769:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:10.0:1773851891.529770:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004753271e.
00000100:00000200:10.0:1773851891.529770:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938112, offset 0
00000400:00000200:10.0:1773851891.529772:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:10.0:1773851891.529773:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851891.529774:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:10.0:1773851891.529775:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851891.529776:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:10.0:1773851891.529777:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:10.0:1773851891.529778:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770008, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770006, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851891.529780:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:10.0:1773851891.529781:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851891.529782:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:10.0:1773851891.529783:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770009:8770009:1024:4294967295] 2075@kfi7 LPNI seq info [5403915:5403915:16:4294967295]
00000400:00000200:10.0:1773851891.529784:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851891.529785:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851891.529787:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851891.529788:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:10.0:1773851891.529789:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851891.529790:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851891.529793:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851891.529795:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Using peer 2075@kfi7(0x2000000000004de)
00000800:00000200:10.0:1773851891.529799:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000348da31e: Posted send of 324 bytes to peer 0x2000000000004de: rc=0
00000800:00000200:10.0:1773851891.529800:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851891.529806:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851891.529807:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851891.529808:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851891.529808:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851891.529809:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851891.529810:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:9.0:1773851891.529810:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851891.529811:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851891.529811:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851891.529811:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851891.529812:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851891.529812:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851891.529812:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.529814:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000400:00000200:9.0:1773851891.529815:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004753271e
00000400:00000010:9.0:1773851891.529815:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004753271e.
00000100:00000001:9.0:1773851891.529816:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851891.529817:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851891.529819:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851891.529820:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851891.529823:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.529823:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851891.529824:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851891.529826:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2054@kfi7:2 -> 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000004de Transaction freed
00000800:00000200:9.0:1773851891.529878:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.529879:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.529880:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.529882:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851891.529884:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.529885:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851891.529886:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.529887:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851891.529888:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.529888:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851891.529889:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851891.529890:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.529891:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5d40
00000400:00000200:9.0:1773851891.529892:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.529892:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781698a09 [1] + 224
00000800:00000200:9.0:1773851891.529894:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851891.529896:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.529897:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.529898:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851891.529899:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851891.529902:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851891.529904:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851891.529905:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000100:00000001:10.0:1773851891.529906:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851891.529906:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:10.0:1773851891.529907:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851891.529907:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:9.0:1773851891.529907:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2075@kfi7(000000005408e3e6):0x0 lsk 1247 rsk 4793 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000010:10.0:1773851891.529908:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:10.0:1773851891.529909:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851891.529909:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851891.529910:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851891.529911:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851891.529913:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851891.529916:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851891.529916:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851891.529917:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851891.529917:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851891.529918:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851891.529918:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851891.529919:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851891.529920:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=124 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851891.529921:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=124 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851891.529922:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851891.529923:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851891.529923:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851891.529924:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851891.529925:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851891.529926:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:10.0:1773851891.529926:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851891.529927:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851891.529927:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851891.529930:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851891.529931:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851891.529931:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851891.529932:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851891.529933:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851891.529934:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470631936 avail=351461548032 avail_mb=1372896672 hwm_mb=3131103 files=372064411 ffree=343233039 state=0: rc = 0
00000004:00000020:10.0:1773851891.529935:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470631936 free, 351461548032 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064411 files, 343233039 free files
00000004:00000001:10.0:1773851891.529937:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851891.529938:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851891.529941:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000eca030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051938112:2075@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851891.529942:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851891.529943:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851891.529943:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000eca030e x1859433051938112/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852044 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851891.529945:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851891.529946:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851891.529947:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000026cc010.
02000000:00000001:10.0:1773851891.529947:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851891.529948:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851891.529948:0:41071:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:10.0:1773851891.529949:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851891.529950:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000545d49bf.
02000000:00000001:10.0:1773851891.529951:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851891.529952:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851891.529952:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000eca030e.
00000100:00000001:10.0:1773851891.529953:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851891.529953:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851891.529954:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851891.529954:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851891.529955:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851891.529955:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851891.529955:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851891.555597:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851891.555597:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851891.555599:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851891.555599:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851891.555600:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851891.555601:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851891.555604:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851891.555604:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20817@kfi7(00000000e92ed16a):0x280 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851891.555606:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 Using peer 20817@kfi7(0x100000000000280)
00000400:00000200:6.0:1773851891.555607:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20817@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.555609:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20817@kfi7 : PUT - for me
00000400:00000200:5.0:1773851891.555609:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20817@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.555611:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20817@kfi7 to cpt 1
00000800:00000200:5.0:1773851891.555612:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 38 bytes to peer 0x100000000000280: rc=0
00000400:00000200:6.0:1773851891.555613:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005930ecd nid 20817@kfi7 refs 1
00000800:00000200:5.0:1773851891.555614:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851891.555615:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20817@kfi7 to cpt 1
00000400:00000200:6.0:1773851891.555617:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005930ecd nid 20817@kfi7 refs 2
00000400:00000200:6.0:1773851891.555618:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000005930ecd nid 20817@kfi7 refs 3
00000400:00000200:6.0:1773851891.555620:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:6.0:1773851891.555621:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 456 into portal 12 MB=0x69b09c8e35f40
00000400:00000200:6.0:1773851891.555624:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 456/456 into md 0x793926dc5 [64] + 160376
00000800:00000200:6.0:1773851891.555627:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000235b3e16: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851891.555627:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851891.555630:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851891.555631:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 Transaction freed
00000400:00000200:6.0:1773851891.555632:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20817@kfi7: PUT: OK
00000100:00000001:6.0:1773851891.555634:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851891.555634:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851891.555636:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000072969909.
00000100:00000040:6.0:1773851891.555637:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000072969909 x1859316187619136 msgsize 456
00000100:00100000:6.0:1773851891.555639:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20817@kfi7)
00000100:00000001:6.0:1773851891.555641:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851891.555642:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000005930ecd nid 20817@kfi7 refs 2
00000100:00000001:4.0:1773851891.555643:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851891.555643:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851891.555644:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851891.555644:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851891.555645:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000235b3e16: 2054@kfi7:1 <- 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851891.555645:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851891.555646:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187619136
00000020:00000001:4.0:1773851891.555646:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851891.555647:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:4.0:1773851891.555647:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851891.555651:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:4.0:1773851891.555651:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:4.0:1773851891.555652:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:4.0:1773851891.555653:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851891.555654:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851891.555654:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dbc2712d.
00000020:00000010:4.0:1773851891.555655:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851891.555656:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002747847d.
00000100:00000001:4.0:1773851891.555657:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851891.555658:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851891.555658:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.555659:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.555660:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851891.555661:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851891.555662:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851891.555663:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851891.555664:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851891.555664:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 371100850
00000100:00000040:4.0:1773851891.555664:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:7.0:1773851891.555665:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.555665:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814088832 : -107101895462784 : ffff9e976590f080)
00000100:00000001:7.0:1773851891.555666:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851891.555666:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000072969909 x1859316187619136/t0(0) o17->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:206/0 lens 456/0 e 0 to 0 dl 1773852321 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:4.0:1773851891.555669:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851891.555669:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851891.555670:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000072969909 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39672:x1859316187619136:12345-20816@kfi7:17:default-tuolumne1794-0
00000100:00000200:4.0:1773851891.555672:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187619136
00000020:00000001:4.0:1773851891.555672:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851891.555673:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851891.555674:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.555674:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851891.555675:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:4.0:1773851891.555675:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851891.555676:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187619136, found 0 last_xid 1859316186815935
00000020:00000001:4.0:1773851891.555677:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851891.555678:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851891.555678:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851891.555679:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851891.555680:0:60963:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:4.0:1773851891.555680:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851891.555681:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851891.555682:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000040cd01e0.
02000000:00000001:4.0:1773851891.555683:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.555683:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.555684:0:60963:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:4.0:1773851891.555685:0:60963:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:4.0:1773851891.555685:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:4.0:1773851891.555687:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.555688:0:60963:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:4.0:1773851891.555688:0:60963:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 4fb1135c-80e8-4fba-bd27-a7d8cb531077/0000000081bf6b5a free: 126633370845184 avail: 126633368748032
00000020:00000001:4.0:1773851891.555689:0:60963:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:4.0:1773851891.555691:0:60963:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 4fb1135c-80e8-4fba-bd27-a7d8cb531077/0000000081bf6b5a avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:4.0:1773851891.555692:0:60963:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:4.0:1773851891.555693:0:60963:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:4.0:1773851891.555693:0:60963:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 4fb1135c-80e8-4fba-bd27-a7d8cb531077/0000000081bf6b5a reports grant 1791492095 dropped 0, local 1882456063
00000020:00000001:4.0:1773851891.555694:0:60963:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:4.0:1773851891.555695:0:60963:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:4.0:1773851891.555696:0:60963:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851891.555696:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187619136
00010000:00000001:4.0:1773851891.555697:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851891.555698:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000072969909 x1859316187619136/t0(0) o17->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:206/0 lens 456/432 e 0 to 0 dl 1773852321 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:4.0:1773851891.555700:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851891.555701:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851891.555702:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=123 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851891.555703:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851891.555703:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:4.0:1773851891.555704:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:4.0:1773851891.555705:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851891.555706:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851891.555706:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851891.555707:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20817@kfi7
00000400:00000010:4.0:1773851891.555708:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6473a15.
00000100:00000200:4.0:1773851891.555708:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859316187619136, offset 224
00000400:00000200:4.0:1773851891.555710:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20817@kfi7
00000400:00000200:4.0:1773851891.555711:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20817@kfi7 to cpt 1
00000400:00000200:4.0:1773851891.555711:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000005930ecd nid 20817@kfi7 refs 1
00000400:00000200:4.0:1773851891.555712:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000005930ecd nid 20817@kfi7 refs 2
00000400:00000200:4.0:1773851891.555714:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000005930ecd nid 20817@kfi7 refs 3
00000400:00000200:4.0:1773851891.555715:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20817@kfi7 local destination
00000400:00000200:4.0:1773851891.555716:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770010:8770010:1024:4294967295] 20817@kfi7 LPNI seq info [16890556:16890556:16:4294967295]
00000400:00000200:4.0:1773851891.555717:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000005930ecd nid 20817@kfi7 refs 2
00000400:00000200:4.0:1773851891.555718:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20817@kfi7 to cpt 1
00000400:00000200:4.0:1773851891.555720:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20817@kfi7(20817@kfi7:20817@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851891.555722:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000005930ecd nid 20817@kfi7 refs 3
00000800:00000200:4.0:1773851891.555723:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851891.555724:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:4.0:1773851891.555731:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851891.555733:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 Using peer 20817@kfi7(0x100000000000280)
00000800:00000200:4.0:1773851891.555736:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 532 bytes to peer 0x100000000000280: rc=0
00000800:00000200:4.0:1773851891.555737:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851891.555739:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851891.555740:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:4.0:1773851891.555741:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851891.555741:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851891.555742:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851891.555743:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000072969909 x1859316187619136/t0(0) o17->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:206/0 lens 456/432 e 0 to 0 dl 1773852321 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000100:00100000:4.0:1773851891.555747:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000072969909 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39672:x1859316187619136:12345-20816@kfi7:17:default-tuolumne1794-0 Request processed in 77us (109us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851891.555750:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 371100850
00000100:00000040:4.0:1773851891.555750:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000100:00000001:4.0:1773851891.555751:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851891.555752:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851891.555752:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851891.555753:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002747847d.
00000020:00000010:4.0:1773851891.555754:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dbc2712d.
00000020:00000040:4.0:1773851891.555755:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:4.0:1773851891.555756:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851891.555762:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851891.555765:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851891.555767:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20817@kfi7: PUT: OK
00000400:00000200:5.0:1773851891.555768:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6473a15
00000400:00000010:5.0:1773851891.555769:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6473a15.
00000100:00000001:5.0:1773851891.555770:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851891.555771:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851891.555772:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000005930ecd nid 20817@kfi7 refs 2
00000800:00000200:5.0:1773851891.555774:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 20817@kfi7(00000000e92ed16a):0x0 lsk 641 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000280 Transaction freed
00000400:00000200:29.0:1773851891.593731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851891.593732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:9.0:1773851891.644806:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.644807:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.644809:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.644814:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851891.644817:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22896@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.644819:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22896@kfi7 : PUT - for me
00000400:00000200:9.0:1773851891.644821:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22896@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.644822:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006786cd86 nid 22896@kfi7 refs 1
00000400:00000200:9.0:1773851891.644824:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22896@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.644825:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006786cd86 nid 22896@kfi7 refs 2
00000400:00000200:9.0:1773851891.644827:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006786cd86 nid 22896@kfi7 refs 3
00000400:00000200:9.0:1773851891.644828:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22896@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.644830:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22896@kfi7 of length 224 into portal 12 MB=0x699e1167e5640
00000400:00000200:9.0:1773851891.644832:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22896@kfi7 of length 224/224 into md 0x78146ce49 [64] + 155192
00000800:00000200:9.0:1773851891.644835:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851891.644838:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.644840:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22896@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.644842:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851891.644842:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851891.644844:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006187d064.
00000100:00000040:9.0:1773851891.644845:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006187d064 x1858041884333632 msgsize 224
00000100:00100000:9.0:1773851891.644848:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22896@kfi7 (source: 12345-22896@kfi7)
00000100:00000001:9.0:1773851891.644850:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851891.644851:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006786cd86 nid 22896@kfi7 refs 2
00000800:00000200:9.0:1773851891.644853:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851891.644857:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:9.0:1773851891.644858:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851891.644859:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851891.644860:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851891.644861:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851891.644862:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041884333632
00000020:00000001:9.0:1773851891.644863:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851891.644864:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918ea
00000020:00000001:9.0:1773851891.644865:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851891.644868:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008eeb8226 refcount=6
00000020:00000001:9.0:1773851891.644869:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241972736 : -107152467578880 : ffff9e8b9f3bb000)
00000020:00000001:9.0:1773851891.644871:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241972736 : -107152467578880 : ffff9e8b9f3bb000)
00000100:00000001:9.0:1773851891.644873:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851891.644874:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851891.644875:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000321b48d7.
00000020:00000010:9.0:1773851891.644876:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000acd22e99.
00000020:00000010:9.0:1773851891.644877:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004f49bd4a.
00000100:00000001:9.0:1773851891.644879:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851891.644879:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851891.644880:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.644882:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851891.644882:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851891.644883:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851891.644884:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.644886:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851891.644887:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851891.644888:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851891.644888:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851891.644890:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22896@kfi7, seq: 2130848
00000100:00000001:9.0:1773851891.644891:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851891.644891:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008eeb8226 : new rpc_count 1
00000100:00000001:9.0:1773851891.644892:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.644892:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856913024 : -106914852638592 : ffff9ec2f22ff080)
00000100:00000040:8.0:1773851891.644895:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006187d064 x1858041884333632/t0(0) o400->6c6c0268-62b0-4201-92cb-c68fd059e104@22896@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1918-0'
00000100:00000001:8.0:1773851891.644900:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.644900:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851891.644902:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006187d064 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:6c6c0268-62b0-4201-92cb-c68fd059e104+6:39850:x1858041884333632:12345-22896@kfi7:400:default-tuolumne1918-0
00000100:00000200:8.0:1773851891.644904:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041884333632
00000020:00000001:8.0:1773851891.644905:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851891.644906:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851891.644907:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.644908:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851891.644909:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851891.644912:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851891.644913:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041884333632, found 0 last_xid 1858041884333631
00000020:00000001:8.0:1773851891.644914:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851891.644915:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851891.644916:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851891.644917:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.644918:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851891.644919:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851891.644920:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851891.644921:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000339c92f7.
02000000:00000001:8.0:1773851891.644923:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.644924:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.644925:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851891.644926:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182429144023, transno 0, xid 1858041884333632
00010000:00000001:8.0:1773851891.644927:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851891.644928:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006187d064 x1858041884333632/t0(0) o400->6c6c0268-62b0-4201-92cb-c68fd059e104@22896@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1918-0'
00010000:00000001:8.0:1773851891.644933:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851891.644934:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851891.644935:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=124 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851891.644937:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851891.644938:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000066e34541 refcount 3 to 22896@kfi7
00000100:00000001:8.0:1773851891.644939:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579968 : -107154806971648 : ffff9e8b13cb6300)
02000000:00000001:8.0:1773851891.644940:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851891.644941:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.644942:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851891.644944:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22896@kfi7
00000400:00000010:8.0:1773851891.644945:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
00000100:00000200:8.0:1773851891.644946:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041884333632, offset 224
00000400:00000200:8.0:1773851891.644949:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22896@kfi7
00000400:00000200:8.0:1773851891.644950:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22896@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.644952:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006786cd86 nid 22896@kfi7 refs 1
00000400:00000200:8.0:1773851891.644954:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006786cd86 nid 22896@kfi7 refs 2
00000400:00000200:8.0:1773851891.644956:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006786cd86 nid 22896@kfi7 refs 3
00000400:00000200:8.0:1773851891.644958:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22896@kfi7 local destination
00000400:00000200:8.0:1773851891.644961:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770011:8770011:1024:4294967295] 22896@kfi7 LPNI seq info [10944534:10944534:16:4294967295]
00000400:00000200:8.0:1773851891.644963:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006786cd86 nid 22896@kfi7 refs 2
00000400:00000200:8.0:1773851891.644964:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22896@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.644968:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22896@kfi7(22896@kfi7:22896@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851891.644970:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006786cd86 nid 22896@kfi7 refs 3
00000800:00000200:8.0:1773851891.644972:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851891.644974:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851891.644978:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851891.644982:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x982 Using peer 22896@kfi7(0x982)
00000800:00000200:8.0:1773851891.644987:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x982: rc=0
00000800:00000200:8.0:1773851891.644989:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x982 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851891.644992:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851891.644993:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000066e34541 refcount 2 to 22896@kfi7
00010000:00000001:8.0:1773851891.644995:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851891.644995:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.644998:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851891.645000:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006187d064 x1858041884333632/t0(0) o400->6c6c0268-62b0-4201-92cb-c68fd059e104@22896@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1918-0'
00000100:00100000:8.0:1773851891.645005:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006187d064 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:6c6c0268-62b0-4201-92cb-c68fd059e104+6:39850:x1858041884333632:12345-22896@kfi7:400:default-tuolumne1918-0 Request processed in 104us (159us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851891.645009:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22896@kfi7, seq: 2130848
00000100:00000040:8.0:1773851891.645010:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008eeb8226 : new rpc_count 0
00000100:00000001:8.0:1773851891.645011:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851891.645012:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851891.645014:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000acd22e99.
00000020:00000010:8.0:1773851891.645015:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004f49bd4a.
00000020:00000010:8.0:1773851891.645017:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000321b48d7.
00000020:00000040:8.0:1773851891.645018:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000008eeb8226 : new refcount 5
00000100:00000001:8.0:1773851891.645020:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851891.645028:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x982 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851891.645031:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.645033:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22896@kfi7: PUT: OK
00000400:00000200:9.0:1773851891.645034:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000400:00000010:9.0:1773851891.645035:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000100:00000001:9.0:1773851891.645036:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851891.645036:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851891.645038:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006786cd86 nid 22896@kfi7 refs 2
00000800:00000200:9.0:1773851891.645040:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22896@kfi7(000000007f152444):0x0 lsk 2435 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x982 Transaction freed
00000800:00000200:29.0:1773851891.646512:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851891.646513:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851891.646514:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851891.646516:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851891.646518:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16706@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.646519:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16706@kfi7 : PUT - for me
00000400:00000200:29.0:1773851891.646520:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16706@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.646521:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068da8f0f nid 16706@kfi7 refs 1
00000400:00000200:29.0:1773851891.646523:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16706@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.646523:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068da8f0f nid 16706@kfi7 refs 2
00000400:00000200:29.0:1773851891.646524:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000068da8f0f nid 16706@kfi7 refs 3
00000400:00000200:29.0:1773851891.646525:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16706@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.646526:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16706@kfi7 of length 224 into portal 12 MB=0x69b4b5f0f5140
00000400:00000200:29.0:1773851891.646527:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16706@kfi7 of length 224/224 into md 0x77fe1859d [64] + 4104
00000800:00000200:29.0:1773851891.646529:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851891.646531:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851891.646531:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16706@kfi7: PUT: OK
00000100:00000001:29.0:1773851891.646532:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851891.646533:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851891.646534:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c5141292.
00000100:00000040:29.0:1773851891.646534:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000c5141292 x1859597879955776 msgsize 224
00000100:00100000:29.0:1773851891.646536:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16706@kfi7 (source: 12345-16706@kfi7)
00000100:00000001:29.0:1773851891.646537:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851891.646537:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000068da8f0f nid 16706@kfi7 refs 2
00000100:00000001:30.0:1773851891.646538:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851891.646539:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851891.646539:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851891.646539:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851891.646540:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851891.646541:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851891.646541:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597879955776
00000020:00000001:30.0:1773851891.646542:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851891.646543:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d823e9
00000020:00000001:30.0:1773851891.646543:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851891.646548:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d56a71c1 refcount=689
00000020:00000001:30.0:1773851891.646548:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165079530496 : -106908630021120 : ffff9ec465158c00)
00000020:00000001:30.0:1773851891.646549:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165079530496 : -106908630021120 : ffff9ec465158c00)
00000100:00000001:30.0:1773851891.646561:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851891.646561:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851891.646562:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f029511a.
00000020:00000010:30.0:1773851891.646563:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851891.646564:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000700a46f0.
00000100:00000001:30.0:1773851891.646565:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851891.646565:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851891.646566:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851891.646567:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851891.646567:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851891.646568:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851891.646569:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851891.646570:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851891.646570:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851891.646571:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851891.646571:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851891.646572:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16706@kfi7, seq: 2055578
00000100:00000040:31.0:1773851891.646573:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d56a71c1 : new rpc_count 13
00000100:00000001:30.0:1773851891.646573:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.646574:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262221312 : -106943447330304 : ffff9ebc49cf9200)
00000100:00000001:30.0:1773851891.646574:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851891.646576:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c5141292 x1859597879955776/t0(0) o400->1ce70c7d-3d69-42af-9ef7-6aba2ebceb36@16706@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1544-0'
00000100:00000001:31.0:1773851891.646579:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851891.646579:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851891.646580:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c5141292 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:1ce70c7d-3d69-42af-9ef7-6aba2ebceb36+689:39547:x1859597879955776:12345-16706@kfi7:400:default-tuolumne1544-0
00000100:00000200:31.0:1773851891.646582:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597879955776
00000020:00000001:31.0:1773851891.646583:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851891.646583:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851891.646584:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.646585:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851891.646585:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851891.646586:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851891.646587:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597879955776, found 0 last_xid 1859597872291647
00000020:00000001:31.0:1773851891.646588:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851891.646589:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851891.646589:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851891.646590:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.646590:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851891.646591:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851891.646592:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851891.646593:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fe4b474d.
02000000:00000001:31.0:1773851891.646593:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.646594:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.646595:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851891.646595:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264580573, transno 0, xid 1859597879955776
00010000:00000001:31.0:1773851891.646596:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851891.646597:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c5141292 x1859597879955776/t0(0) o400->1ce70c7d-3d69-42af-9ef7-6aba2ebceb36@16706@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1544-0'
00010000:00000001:31.0:1773851891.646600:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851891.646601:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851891.646602:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=124 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851891.646603:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851891.646603:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000009b38c81 refcount 3 to 16706@kfi7
00000100:00000001:31.0:1773851891.646604:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869933632 : -107137839617984 : ffff9e8f0720a840)
02000000:00000001:31.0:1773851891.646605:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851891.646606:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.646606:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851891.646607:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16706@kfi7
00000400:00000010:31.0:1773851891.646608:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000057fc3a68.
00000100:00000200:31.0:1773851891.646609:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597879955776, offset 224
00000400:00000200:31.0:1773851891.646610:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16706@kfi7
00000400:00000200:31.0:1773851891.646611:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16706@kfi7 to cpt 7
00000400:00000200:31.0:1773851891.646612:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068da8f0f nid 16706@kfi7 refs 1
00000400:00000200:31.0:1773851891.646614:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000068da8f0f nid 16706@kfi7 refs 2
00000400:00000200:31.0:1773851891.646615:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000068da8f0f nid 16706@kfi7 refs 3
00000400:00000200:31.0:1773851891.646616:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16706@kfi7 local destination
00000400:00000200:31.0:1773851891.646617:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770012:8770012:1024:4294967295] 16706@kfi7 LPNI seq info [922205:922205:16:4294967295]
00000400:00000200:31.0:1773851891.646619:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000068da8f0f nid 16706@kfi7 refs 2
00000400:00000200:31.0:1773851891.646619:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16706@kfi7 to cpt 7
00000400:00000200:31.0:1773851891.646621:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16706@kfi7(16706@kfi7:16706@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851891.646622:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000068da8f0f nid 16706@kfi7 refs 3
00000800:00000200:31.0:1773851891.646624:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851891.646625:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851891.646627:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851891.646630:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8b8 Using peer 16706@kfi7(0x8b8)
00000800:00000200:31.0:1773851891.646633:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x8b8: rc=0
00000800:00000200:31.0:1773851891.646634:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8b8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851891.646638:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851891.646639:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000009b38c81 refcount 2 to 16706@kfi7
00010000:00000001:31.0:1773851891.646640:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851891.646640:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.646641:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851891.646641:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c5141292 x1859597879955776/t0(0) o400->1ce70c7d-3d69-42af-9ef7-6aba2ebceb36@16706@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1544-0'
00000100:00100000:31.0:1773851891.646645:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c5141292 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:1ce70c7d-3d69-42af-9ef7-6aba2ebceb36+689:39547:x1859597879955776:12345-16706@kfi7:400:default-tuolumne1544-0 Request processed in 65us (109us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851891.646646:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8b8 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851891.646647:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851891.646648:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16706@kfi7, seq: 2055578
00000100:00000040:31.0:1773851891.646648:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d56a71c1 : new rpc_count 12
00000400:00000200:29.0:1773851891.646648:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16706@kfi7: PUT: OK
00000100:00000001:31.0:1773851891.646649:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851891.646649:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000057fc3a68
00000400:00000010:29.0:1773851891.646649:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000057fc3a68.
00000100:00000001:31.0:1773851891.646650:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:29.0:1773851891.646650:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851891.646650:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851891.646651:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:31.0:1773851891.646651:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000700a46f0.
00000400:00000200:29.0:1773851891.646651:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000068da8f0f nid 16706@kfi7 refs 2
00000020:00000010:31.0:1773851891.646652:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f029511a.
00000800:00000200:29.0:1773851891.646652:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 16706@kfi7(00000000a6cc712e):0x0 lsk 2233 rsk 34 tsk 0 trmk 0 tmk 0 trr 7 tta 0x8b8 Transaction freed
00000020:00000040:31.0:1773851891.646653:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000d56a71c1 : new refcount 688
00000100:00000001:31.0:1773851891.646654:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851891.654144:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851891.654144:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851891.654145:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851891.654145:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851891.654147:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851891.654147:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851891.654149:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851891.654149:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12546@kfi7(000000004c388dea):0xdaf version: 2; local version 2; negotiated version: 2
00000400:00000200:30.0:1773851891.654151:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12546@kfi7 to cpt 7
00000800:00000200:29.0:1773851891.654151:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf Using peer 12546@kfi7(0x100000000000daf)
00000400:00000200:30.0:1773851891.654152:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12546@kfi7 : PUT - for me
00000400:00000200:30.0:1773851891.654153:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12546@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.654153:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12546@kfi7 to cpt 7
00000400:00000200:30.0:1773851891.654155:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f24753a4 nid 12546@kfi7 refs 1
00000800:00000200:29.0:1773851891.654155:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 38 bytes to peer 0x100000000000daf: rc=0
00000400:00000200:30.0:1773851891.654156:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12546@kfi7 to cpt 7
00000400:00000200:30.0:1773851891.654157:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f24753a4 nid 12546@kfi7 refs 2
00000800:00000200:29.0:1773851891.654157:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851891.654158:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f24753a4 nid 12546@kfi7 refs 3
00000400:00000200:30.0:1773851891.654159:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12739@kfi7 to cpt 5
00000400:00000200:30.0:1773851891.654160:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12739@kfi7 of length 224 into portal 12 MB=0x699e1b840dc80
00000400:00000200:30.0:1773851891.654162:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12739@kfi7 of length 224/224 into md 0x77fe1859d [64] + 4328
00000800:00000200:30.0:1773851891.654164:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851891.654166:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851891.654167:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12546@kfi7: PUT: OK
00000100:00000001:30.0:1773851891.654168:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:29.0:1773851891.654168:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf TN_EVENT_TX_OK event status 0
00000100:00000200:30.0:1773851891.654169:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851891.654170:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d622a758.
00000100:00000040:30.0:1773851891.654170:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000d622a758 x1858044598213760 msgsize 224
00000800:00000200:29.0:1773851891.654171:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf Transaction freed
00000100:00100000:30.0:1773851891.654172:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-12739@kfi7 (source: 12345-12546@kfi7)
00000100:00000001:30.0:1773851891.654173:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851891.654174:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:30.0:1773851891.654174:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f24753a4 nid 12546@kfi7 refs 2
02000000:00000001:31.0:1773851891.654175:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851891.654175:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851891.654176:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851891.654176:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851891.654176:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00100000:31.0:1773851891.654177:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044598213760
00000020:00000001:31.0:1773851891.654178:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851891.654178:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ff8
00000020:00000001:31.0:1773851891.654179:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851891.654182:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000057c8fd88 refcount=6
00000020:00000001:31.0:1773851891.654183:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629255168 : -107123080296448 : ffff9e9276da0800)
00000020:00000001:31.0:1773851891.654184:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629255168 : -107123080296448 : ffff9e9276da0800)
00000100:00000001:31.0:1773851891.654185:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851891.654187:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851891.654187:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001c4eb1a9.
00000020:00000010:31.0:1773851891.654188:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851891.654189:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851891.654190:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851891.654191:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851891.654191:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851891.654192:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851891.654193:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851891.654193:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.654194:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851891.654195:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851891.654195:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851891.654195:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851891.654196:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12739@kfi7, seq: 2055579
00000100:00000001:30.0:1773851891.654196:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851891.654197:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000057c8fd88 : new rpc_count 1
00000100:00000001:31.0:1773851891.654197:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411262976 : -106960298288640 : ffff9eb85d6a5a00)
00000100:00000001:30.0:1773851891.654197:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851891.654197:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851891.654198:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d622a758 x1858044598213760/t0(0) o400->3f357f72-e768-4372-b91e-c9677b15f13b@12739@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1287-0'
00000100:00000001:31.0:1773851891.654201:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851891.654201:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851891.654202:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d622a758 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:3f357f72-e768-4372-b91e-c9677b15f13b+6:39636:x1858044598213760:12345-12739@kfi7:400:default-tuolumne1287-0
00000100:00000200:31.0:1773851891.654204:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044598213760
00000020:00000001:31.0:1773851891.654204:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851891.654205:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851891.654205:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.654206:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851891.654206:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851891.654207:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851891.654207:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044598213760, found 0 last_xid 1858044598213759
00000020:00000001:31.0:1773851891.654208:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851891.654208:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851891.654209:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851891.654209:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.654210:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851891.654211:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851891.654211:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851891.654212:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d4b2a38b.
02000000:00000001:31.0:1773851891.654212:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.654213:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.654213:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851891.654214:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154592922, transno 0, xid 1858044598213760
00010000:00000001:31.0:1773851891.654215:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851891.654215:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d622a758 x1858044598213760/t0(0) o400->3f357f72-e768-4372-b91e-c9677b15f13b@12739@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1287-0'
00010000:00000001:31.0:1773851891.654218:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851891.654218:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851891.654219:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=124 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851891.654220:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851891.654220:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009a49faa3 refcount 3 to 12739@kfi7
00000100:00000001:31.0:1773851891.654221:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107648 : -107156354443968 : ffff9e8ab78ed540)
02000000:00000001:31.0:1773851891.654222:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851891.654222:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.654222:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851891.654223:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12546@kfi7
00000400:00000010:31.0:1773851891.654224:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025a37126.
00000100:00000200:31.0:1773851891.654225:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044598213760, offset 224
00000400:00000200:31.0:1773851891.654226:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12546@kfi7
00000400:00000200:31.0:1773851891.654227:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12546@kfi7 to cpt 7
00000400:00000200:31.0:1773851891.654228:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f24753a4 nid 12546@kfi7 refs 1
00000400:00000200:31.0:1773851891.654229:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f24753a4 nid 12546@kfi7 refs 2
00000400:00000200:31.0:1773851891.654230:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f24753a4 nid 12546@kfi7 refs 3
00000400:00000200:31.0:1773851891.654231:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12546@kfi7 local destination
00000400:00000200:31.0:1773851891.654232:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770013:8770013:1024:4294967295] 12546@kfi7 LPNI seq info [9131621:9131621:16:4294967295]
00000400:00000200:31.0:1773851891.654234:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f24753a4 nid 12546@kfi7 refs 2
00000400:00000200:31.0:1773851891.654234:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12546@kfi7 to cpt 7
00000400:00000200:31.0:1773851891.654236:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12546@kfi7(12546@kfi7:12546@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851891.654240:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f24753a4 nid 12546@kfi7 refs 3
00000800:00000200:31.0:1773851891.654242:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851891.654242:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851891.654244:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851891.654246:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf Using peer 12546@kfi7(0x100000000000daf)
00000800:00000200:31.0:1773851891.654249:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x100000000000daf: rc=0
00000800:00000200:31.0:1773851891.654251:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851891.654252:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851891.654253:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009a49faa3 refcount 2 to 12739@kfi7
00010000:00000001:31.0:1773851891.654254:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851891.654254:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.654255:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851891.654255:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d622a758 x1858044598213760/t0(0) o400->3f357f72-e768-4372-b91e-c9677b15f13b@12739@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1287-0'
00000100:00100000:31.0:1773851891.654258:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d622a758 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:3f357f72-e768-4372-b91e-c9677b15f13b+6:39636:x1858044598213760:12345-12739@kfi7:400:default-tuolumne1287-0 Request processed in 56us (87us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851891.654260:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12739@kfi7, seq: 2055579
00000100:00000040:31.0:1773851891.654261:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000057c8fd88 : new rpc_count 0
00000100:00000001:31.0:1773851891.654261:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851891.654262:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851891.654262:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000800:00000200:29.0:1773851891.654262:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851891.654263:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851891.654263:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001c4eb1a9.
00000020:00000040:31.0:1773851891.654264:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000057c8fd88 : new refcount 5
00000400:00000200:29.0:1773851891.654264:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851891.654265:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851891.654265:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12546@kfi7: PUT: OK
00000400:00000200:29.0:1773851891.654266:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025a37126
00000400:00000010:29.0:1773851891.654266:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025a37126.
00000100:00000001:29.0:1773851891.654267:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851891.654267:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851891.654268:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f24753a4 nid 12546@kfi7 refs 2
00000800:00000200:29.0:1773851891.654269:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 12546@kfi7(000000004c388dea):0x0 lsk 3504 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000daf Transaction freed
00000800:00000200:25.0:1773851891.656183:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851891.656184:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851891.656185:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851891.656187:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851891.656189:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.656190:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851891.656191:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.656192:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851891.656193:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.656193:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851891.656194:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851891.656195:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851891.656196:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a860c1240
00000400:00000200:25.0:1773851891.656198:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 14736
00000800:00000200:25.0:1773851891.656200:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851891.656202:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851891.656203:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851891.656204:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851891.656205:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851891.656205:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000451e57e9.
00000100:00000040:25.0:1773851891.656206:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000451e57e9 x1859388080656960 msgsize 224
00000100:00100000:25.0:1773851891.656208:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851891.656209:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851891.656210:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851891.656211:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f6d78ee2: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851891.656211:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851891.656212:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851891.656212:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851891.656213:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851891.656214:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851891.656215:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080656960
00000020:00000001:24.0:1773851891.656216:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851891.656216:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:24.0:1773851891.656217:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851891.656218:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:24.0:1773851891.656219:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:24.0:1773851891.656220:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:24.0:1773851891.656221:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851891.656222:0:1537164:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851891.656222:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008edcd5fb.
00000020:00000010:24.0:1773851891.656224:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851891.656224:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006d9633e1.
00000100:00000040:24.0:1773851891.656226:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851891.656227:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851891.656228:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851891.656228:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851891.656229:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851891.656230:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851891.656232:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851891.656232:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851891.656233:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851891.656233:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851891.656234:0:1691804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799988
00000100:00000040:25.0:1773851891.656235:0:1691804:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:25.0:1773851891.656235:0:1691804:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252468480 : -106967457083136 : ffff9eb6b2b7d100)
00000100:00000001:24.0:1773851891.656235:0:1537164:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851891.656235:0:1537164:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851891.656237:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000451e57e9 x1859388080656960/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:25.0:1773851891.656240:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851891.656241:0:1691804:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851891.656242:0:1691804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000451e57e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080656960:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:25.0:1773851891.656243:0:1691804:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080656960
00000020:00000001:25.0:1773851891.656244:0:1691804:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851891.656244:0:1691804:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851891.656245:0:1691804:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851891.656245:0:1691804:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851891.656246:0:1691804:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:25.0:1773851891.656246:0:1691804:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:25.0:1773851891.656247:0:1691804:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851891.656247:0:1691804:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851891.656248:0:1691804:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851891.656248:0:1691804:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851891.656249:0:1691804:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851891.656249:0:1691804:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851891.656251:0:1691804:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000404a9a7d.
02000000:00000001:25.0:1773851891.656252:0:1691804:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851891.656252:0:1691804:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851891.656253:0:1691804:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:25.0:1773851891.656254:0:1691804:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:25.0:1773851891.656255:0:1691804:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851891.656256:0:1691804:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:25.0:1773851891.656258:0:1691804:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:25.0:1773851891.656259:0:1691804:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 176947200 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:25.0:1773851891.656260:0:1691804:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966131557 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:25.0:1773851891.656262:0:1691804:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851891.656262:0:1691804:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080656960
00010000:00000001:25.0:1773851891.656263:0:1691804:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851891.656264:0:1691804:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000451e57e9 x1859388080656960/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:25.0:1773851891.656269:0:1691804:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851891.656269:0:1691804:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851891.656270:0:1691804:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=18 v=66 (1 1 1 1)
00000100:00000001:25.0:1773851891.656271:0:1691804:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851891.656272:0:1691804:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:25.0:1773851891.656273:0:1691804:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:25.0:1773851891.656274:0:1691804:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851891.656274:0:1691804:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851891.656275:0:1691804:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851891.656276:0:1691804:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:25.0:1773851891.656276:0:1691804:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000003902c6b.
00000100:00000200:25.0:1773851891.656277:0:1691804:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080656960, offset 224
00000400:00000200:25.0:1773851891.656278:0:1691804:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:25.0:1773851891.656280:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.656280:0:1691804:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851891.656281:0:1691804:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851891.656282:0:1691804:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851891.656284:0:1691804:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:25.0:1773851891.656285:0:1691804:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770014:8770014:1024:4294967295] 8@kfi7 LPNI seq info [17340072:17340072:16:4294967295]
00000400:00000200:25.0:1773851891.656287:0:1691804:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851891.656287:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.656290:0:1691804:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851891.656291:0:1691804:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:25.0:1773851891.656292:0:1691804:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851891.656293:0:1691804:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:25.0:1773851891.656295:0:1691804:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851891.656298:0:1691804:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000800:00000200:25.0:1773851891.656301:0:1691804:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000f6d78ee2: Posted send of 468 bytes to peer 0x200000000001191: rc=0
00000800:00000200:25.0:1773851891.656303:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851891.656305:0:1691804:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851891.656306:0:1691804:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:25.0:1773851891.656307:0:1691804:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851891.656307:0:1691804:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851891.656308:0:1691804:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851891.656309:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000451e57e9 x1859388080656960/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:25.0:1773851891.656312:0:1691804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000451e57e9 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38113:x1859388080656960:12345-7@kfi7:41:default-yuba5-0 Request processed in 71us (105us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851891.656314:0:1691804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799988
00000100:00000040:25.0:1773851891.656315:0:1691804:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000800:00000200:27.0:1773851891.656316:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851891.656316:0:1691804:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851891.656317:0:1691804:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851891.656317:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000400:00000200:27.0:1773851891.656318:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851891.656318:0:1691804:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006d9633e1.
00000400:00000200:27.0:1773851891.656319:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000020:00000010:25.0:1773851891.656319:0:1691804:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008edcd5fb.
00000400:00000200:27.0:1773851891.656320:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000003902c6b
00000020:00000040:25.0:1773851891.656320:0:1691804:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:25.0:1773851891.656320:0:1691804:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:27.0:1773851891.656321:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000003902c6b.
00000100:00000001:27.0:1773851891.656322:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851891.656322:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851891.656323:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:27.0:1773851891.656325:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f6d78ee2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Transaction freed
00000800:00000200:21.0:1773851891.729625:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851891.729626:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851891.729627:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851891.729629:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851891.729631:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.729632:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:21.0:1773851891.729633:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.729634:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:21.0:1773851891.729635:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.729635:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:21.0:1773851891.729636:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851891.729637:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.729638:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c98b680
00000400:00000200:21.0:1773851891.729640:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 7656
00000800:00000200:21.0:1773851891.729642:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851891.729643:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851891.729644:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000100:00000001:21.0:1773851891.729645:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851891.729646:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851891.729647:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b3da9be2.
00000100:00000040:21.0:1773851891.729647:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000b3da9be2 x1858065609045632 msgsize 224
00000100:00100000:21.0:1773851891.729649:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-13@kfi7)
00000100:00000001:21.0:1773851891.729650:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851891.729651:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:21.0:1773851891.729652:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851891.729652:0:1537152:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851891.729652:0:1537152:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851891.729653:0:1537152:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851891.729653:0:1537152:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851891.729654:0:1537152:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851891.729655:0:1537152:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065609045632
00000020:00000001:20.0:1773851891.729656:0:1537152:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851891.729656:0:1537152:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:20.0:1773851891.729657:0:1537152:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851891.729657:0:1537152:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:20.0:1773851891.729658:0:1537152:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:20.0:1773851891.729659:0:1537152:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:20.0:1773851891.729660:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.729661:0:1537152:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851891.729661:0:1537152:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851891.729662:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851891.729664:0:1537152:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003c2cbb40.
00000100:00000040:20.0:1773851891.729665:0:1537152:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:20.0:1773851891.729666:0:1537152:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851891.729666:0:1537152:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851891.729667:0:1537152:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.729668:0:1537152:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.729669:0:1537152:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851891.729670:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851891.729671:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851891.729671:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851891.729672:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851891.729672:0:1537152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 3084762
00000100:00000040:20.0:1773851891.729672:0:1537152:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:22.0:1773851891.729673:0:1537183:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851891.729673:0:1537183:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.729673:0:1537152:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667737600 : -106956041814016 : ffff9eb95b1f0000)
00000100:00000040:20.0:1773851891.729674:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b3da9be2 x1858065609045632/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:20.0:1773851891.729677:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.729677:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851891.729678:0:1537152:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3da9be2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065609045632:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:20.0:1773851891.729679:0:1537152:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065609045632
00000020:00000001:20.0:1773851891.729680:0:1537152:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851891.729681:0:1537152:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851891.729681:0:1537152:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.729682:0:1537152:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851891.729682:0:1537152:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:20.0:1773851891.729683:0:1537152:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851891.729684:0:1537152:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851891.729684:0:1537152:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851891.729685:0:1537152:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851891.729685:0:1537152:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.729686:0:1537152:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851891.729687:0:1537152:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851891.729688:0:1537152:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000070757af.
02000000:00000001:20.0:1773851891.729689:0:1537152:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.729690:0:1537152:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851891.729691:0:1537152:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:20.0:1773851891.729692:0:1537152:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:20.0:1773851891.729692:0:1537152:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:20.0:1773851891.729693:0:1537152:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 176947200 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:20.0:1773851891.729694:0:1537152:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966131557 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:20.0:1773851891.729696:0:1537152:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851891.729697:0:1537152:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065609045632
00010000:00000001:20.0:1773851891.729698:0:1537152:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851891.729699:0:1537152:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b3da9be2 x1858065609045632/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:20.0:1773851891.729702:0:1537152:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851891.729702:0:1537152:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851891.729703:0:1537152:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=115 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851891.729704:0:1537152:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851891.729705:0:1537152:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:20.0:1773851891.729706:0:1537152:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:20.0:1773851891.729707:0:1537152:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851891.729707:0:1537152:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.729708:0:1537152:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851891.729709:0:1537152:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:20.0:1773851891.729710:0:1537152:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c8549bb.
00000100:00000200:20.0:1773851891.729710:0:1537152:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065609045632, offset 224
00000400:00000200:20.0:1773851891.729712:0:1537152:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:20.0:1773851891.729713:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.729714:0:1537152:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:20.0:1773851891.729715:0:1537152:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851891.729717:0:1537152:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:20.0:1773851891.729718:0:1537152:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13@kfi7 local destination
00000400:00000200:20.0:1773851891.729719:0:1537152:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770015:8770015:1024:4294967295] 13@kfi7 LPNI seq info [23133325:23133325:16:4294967295]
00000400:00000200:20.0:1773851891.729721:0:1537152:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851891.729722:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.729728:0:1537152:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851891.729729:0:1537152:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:20.0:1773851891.729732:0:1537152:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851891.729733:0:1537152:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:20.0:1773851891.729736:0:1537152:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851891.729739:0:1537152:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c Using peer 13@kfi7(0x20000000000095c)
00000800:00000200:20.0:1773851891.729743:0:1537152:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 468 bytes to peer 0x20000000000095c: rc=0
00000800:00000200:20.0:1773851891.729746:0:1537152:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851891.729750:0:1537152:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851891.729752:0:1537152:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:20.0:1773851891.729753:0:1537152:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851891.729754:0:1537152:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.729755:0:1537152:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851891.729757:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b3da9be2 x1858065609045632/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:20.0:1773851891.729763:0:1537152:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3da9be2 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52336:x1858065609045632:12345-13@kfi7:41:default-yuba3-0 Request processed in 84us (114us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851891.729767:0:1537152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 3084762
00000100:00000040:20.0:1773851891.729768:0:1537152:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000100:00000001:20.0:1773851891.729770:0:1537152:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851891.729771:0:1537152:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851891.729772:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851891.729773:0:1537152:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003c2cbb40.
00000020:00000010:20.0:1773851891.729775:0:1537152:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000020:00000040:20.0:1773851891.729776:0:1537152:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:20.0:1773851891.729777:0:1537152:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851891.729784:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851891.729786:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851891.729787:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13@kfi7: PUT: OK
00000400:00000200:21.0:1773851891.729788:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c8549bb
00000400:00000010:21.0:1773851891.729789:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c8549bb.
00000100:00000001:21.0:1773851891.729789:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851891.729790:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851891.729791:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:21.0:1773851891.729792:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 13@kfi7(0000000021b1a14a):0x0 lsk 2397 rsk 4801 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000095c Transaction freed
00000800:00000200:21.0:1773851891.788232:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851891.788233:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851891.788236:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851891.788239:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851891.788242:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9600@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.788244:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9600@kfi7 : PUT - for me
00000400:00000200:21.0:1773851891.788246:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9600@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.788247:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f1c76d4 nid 9600@kfi7 refs 1
00000400:00000200:21.0:1773851891.788248:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9600@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.788249:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f1c76d4 nid 9600@kfi7 refs 2
00000400:00000200:21.0:1773851891.788251:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002f1c76d4 nid 9600@kfi7 refs 3
00000400:00000200:21.0:1773851891.788252:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9536@kfi7 to cpt 1
00000400:00000200:21.0:1773851891.788253:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9536@kfi7 of length 224 into portal 12 MB=0x69a8a0fdecb80
00000400:00000200:21.0:1773851891.788255:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9536@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 59336
00000800:00000200:21.0:1773851891.788258:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851891.788260:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851891.788262:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9600@kfi7: PUT: OK
00000100:00000001:21.0:1773851891.788263:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851891.788264:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851891.788265:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000014ba5466.
00000100:00000040:21.0:1773851891.788266:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000014ba5466 x1858767622687616 msgsize 224
00000100:00100000:21.0:1773851891.788268:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9536@kfi7 (source: 12345-9600@kfi7)
00000100:00000001:21.0:1773851891.788270:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851891.788271:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002f1c76d4 nid 9600@kfi7 refs 2
00000100:00000001:20.0:1773851891.788272:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851891.788273:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851891.788273:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851891.788274:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851891.788286:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851891.788287:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851891.788288:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858767622687616
00000020:00000001:20.0:1773851891.788289:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851891.788290:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92179
00000020:00000001:20.0:1773851891.788291:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851891.788295:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003648d384 refcount=6
00000020:00000001:20.0:1773851891.788296:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629764096 : -107123079787520 : ffff9e9276e1cc00)
00000020:00000001:20.0:1773851891.788297:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629764096 : -107123079787520 : ffff9e9276e1cc00)
00000100:00000001:20.0:1773851891.788298:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.788299:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851891.788300:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851891.788301:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851891.788302:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003c2cbb40.
00000100:00000001:20.0:1773851891.788303:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851891.788304:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851891.788305:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851891.788306:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851891.788307:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851891.788307:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.788309:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851891.788311:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851891.788311:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851891.788312:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851891.788312:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851891.788313:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9536@kfi7, seq: 1998057
00000100:00000001:23.0:1773851891.788314:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851891.788314:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003648d384 : new rpc_count 1
00000100:00000001:23.0:1773851891.788315:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.788315:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667767552 : -106956041784064 : ffff9eb95b1f7500)
00000100:00000040:20.0:1773851891.788317:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000014ba5466 x1858767622687616/t0(0) o400->8771cab1-fffd-45c4-b5e7-6d921694dbc1@9536@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1092-0'
00000100:00000001:20.0:1773851891.788321:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.788322:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851891.788323:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014ba5466 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:8771cab1-fffd-45c4-b5e7-6d921694dbc1+6:39423:x1858767622687616:12345-9536@kfi7:400:default-tuolumne1092-0
00000100:00000200:20.0:1773851891.788325:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858767622687616
00000020:00000001:20.0:1773851891.788327:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851891.788327:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851891.788328:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.788329:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851891.788330:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851891.788331:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851891.788332:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858767622687616, found 0 last_xid 1858767622687615
00000020:00000001:20.0:1773851891.788333:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851891.788334:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851891.788335:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851891.788335:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.788336:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851891.788337:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851891.788338:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851891.788339:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009ce89197.
02000000:00000001:20.0:1773851891.788340:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.788341:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.788342:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851891.788343:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530874, transno 0, xid 1858767622687616
00010000:00000001:20.0:1773851891.788344:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851891.788345:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000014ba5466 x1858767622687616/t0(0) o400->8771cab1-fffd-45c4-b5e7-6d921694dbc1@9536@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1092-0'
00010000:00000001:20.0:1773851891.788349:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851891.788350:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851891.788351:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=124 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851891.788353:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851891.788354:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aa2d5485 refcount 3 to 9536@kfi7
00000100:00000001:20.0:1773851891.788355:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703456 : -107156155848160 : ffff9e8ac3652a20)
02000000:00000001:20.0:1773851891.788356:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851891.788357:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.788357:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851891.788359:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9600@kfi7
00000400:00000010:20.0:1773851891.788360:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000058a6614e.
00000100:00000200:20.0:1773851891.788361:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858767622687616, offset 224
00000400:00000200:20.0:1773851891.788363:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9600@kfi7
00000400:00000200:20.0:1773851891.788365:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9600@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.788367:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f1c76d4 nid 9600@kfi7 refs 1
00000400:00000200:20.0:1773851891.788369:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002f1c76d4 nid 9600@kfi7 refs 2
00000400:00000200:20.0:1773851891.788371:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002f1c76d4 nid 9600@kfi7 refs 3
00000400:00000200:20.0:1773851891.788372:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9600@kfi7 local destination
00000400:00000200:20.0:1773851891.788374:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770016:8770016:1024:4294967295] 9600@kfi7 LPNI seq info [17545:17545:16:4294967295]
00000400:00000200:20.0:1773851891.788377:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002f1c76d4 nid 9600@kfi7 refs 2
00000400:00000200:20.0:1773851891.788378:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9600@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.788381:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9600@kfi7(9600@kfi7:9600@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851891.788383:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002f1c76d4 nid 9600@kfi7 refs 3
00000800:00000200:20.0:1773851891.788385:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851891.788386:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851891.788390:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851891.788393:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8c4 Using peer 9600@kfi7(0x8c4)
00000800:00000200:20.0:1773851891.788398:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x8c4: rc=0
00000800:00000200:20.0:1773851891.788400:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851891.788403:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851891.788405:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aa2d5485 refcount 2 to 9536@kfi7
00010000:00000001:20.0:1773851891.788406:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851891.788409:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.788409:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851891.788411:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000014ba5466 x1858767622687616/t0(0) o400->8771cab1-fffd-45c4-b5e7-6d921694dbc1@9536@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1092-0'
00000100:00100000:20.0:1773851891.788416:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014ba5466 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:8771cab1-fffd-45c4-b5e7-6d921694dbc1+6:39423:x1858767622687616:12345-9536@kfi7:400:default-tuolumne1092-0 Request processed in 94us (149us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851891.788419:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9536@kfi7, seq: 1998057
00000100:00000040:20.0:1773851891.788421:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003648d384 : new rpc_count 0
00000100:00000001:20.0:1773851891.788422:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851891.788422:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851891.788423:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851891.788424:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003c2cbb40.
00000020:00000010:20.0:1773851891.788425:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000020:00000040:20.0:1773851891.788426:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000003648d384 : new refcount 5
00000100:00000001:20.0:1773851891.788428:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851891.788436:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8c4 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851891.788438:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851891.788440:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9600@kfi7: PUT: OK
00000400:00000200:21.0:1773851891.788441:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000058a6614e
00000400:00000010:21.0:1773851891.788443:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000058a6614e.
00000100:00000001:21.0:1773851891.788444:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851891.788444:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851891.788446:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002f1c76d4 nid 9600@kfi7 refs 2
00000800:00000200:21.0:1773851891.788448:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9600@kfi7(00000000dbffcc00):0x0 lsk 2245 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x8c4 Transaction freed
00010000:00000001:2.0:1773851891.849730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849730:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851891.849731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851891.849732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851891.849733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851891.849733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851891.849735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851891.849736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851891.849737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851891.849737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851891.849742:0:937837:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:30.0:1773851891.849743:0:937837:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:30.0:1773851891.849744:0:937837:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851891.867141:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851891.867142:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851891.867143:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851891.867146:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851891.867148:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13072@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.867149:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13072@kfi7 : PUT - for me
00000400:00000200:25.0:1773851891.867150:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13072@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.867151:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002d24a5a nid 13072@kfi7 refs 1
00000400:00000200:25.0:1773851891.867152:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13072@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.867153:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002d24a5a nid 13072@kfi7 refs 2
00000400:00000200:25.0:1773851891.867154:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000002d24a5a nid 13072@kfi7 refs 3
00000400:00000200:25.0:1773851891.867155:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13073@kfi7 to cpt 1
00000400:00000200:25.0:1773851891.867156:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13073@kfi7 of length 224 into portal 12 MB=0x699e0a180fd00
00000400:00000200:25.0:1773851891.867157:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13073@kfi7 of length 224/224 into md 0x16159c9699 [64] + 32656
00000800:00000200:25.0:1773851891.867160:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851891.867161:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851891.867162:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13072@kfi7: PUT: OK
00000100:00000001:25.0:1773851891.867163:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851891.867164:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851891.867165:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d41aea2a.
00000100:00000040:25.0:1773851891.867165:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000d41aea2a x1858039921573120 msgsize 224
00000100:00100000:25.0:1773851891.867167:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-13073@kfi7 (source: 12345-13072@kfi7)
00000100:00000001:25.0:1773851891.867169:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851891.867170:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000002d24a5a nid 13072@kfi7 refs 2
00000800:00000200:25.0:1773851891.867171:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000055b583f: 2054@kfi7:6 <- 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851891.867174:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851891.867175:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851891.867175:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851891.867176:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851891.867177:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851891.867178:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039921573120
00000020:00000001:25.0:1773851891.867178:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851891.867179:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b44
00000020:00000001:25.0:1773851891.867179:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851891.867181:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000760c814f refcount=6
00000020:00000001:25.0:1773851891.867181:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628030464 : -107123081521152 : ffff9e9276c75800)
00000020:00000001:25.0:1773851891.867182:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628030464 : -107123081521152 : ffff9e9276c75800)
00000100:00000001:25.0:1773851891.867183:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851891.867184:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851891.867185:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d39d7b35.
00000020:00000010:25.0:1773851891.867186:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851891.867187:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f0e565fc.
00000100:00000001:25.0:1773851891.867188:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851891.867188:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851891.867189:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851891.867190:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851891.867190:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851891.867190:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851891.867191:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851891.867192:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851891.867193:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851891.867193:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851891.867193:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851891.867194:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13073@kfi7, seq: 2025163
00000100:00000001:27.0:1773851891.867195:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851891.867195:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851891.867195:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000760c814f : new rpc_count 1
00000100:00000001:25.0:1773851891.867195:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252454656 : -106967457096960 : ffff9eb6b2b79b00)
00000100:00000040:25.0:1773851891.867196:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d41aea2a x1858039921573120/t0(0) o400->96a4d73e-670e-43b5-8ca3-47bbb800014c@13073@kfi7:141/0 lens 224/0 e 0 to 0 dl 1773852256 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1313-0'
00000100:00000001:25.0:1773851891.867198:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851891.867199:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851891.867200:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d41aea2a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:96a4d73e-670e-43b5-8ca3-47bbb800014c+6:39839:x1858039921573120:12345-13073@kfi7:400:default-tuolumne1313-0
00000100:00000200:25.0:1773851891.867201:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039921573120
00000020:00000001:25.0:1773851891.867201:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851891.867202:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851891.867202:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851891.867203:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851891.867203:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851891.867204:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851891.867205:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039921573120, found 0 last_xid 1858039921573119
00000020:00000001:25.0:1773851891.867205:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851891.867206:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851891.867206:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851891.867207:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851891.867207:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851891.867208:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851891.867209:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851891.867209:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000064211812.
02000000:00000001:25.0:1773851891.867210:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851891.867211:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851891.867211:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851891.867212:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183248430793, transno 0, xid 1858039921573120
00010000:00000001:25.0:1773851891.867213:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851891.867213:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d41aea2a x1858039921573120/t0(0) o400->96a4d73e-670e-43b5-8ca3-47bbb800014c@13073@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1313-0'
00010000:00000001:25.0:1773851891.867216:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851891.867216:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851891.867217:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=124 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851891.867218:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851891.867218:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002fe068b7 refcount 3 to 13073@kfi7
00000100:00000001:25.0:1773851891.867219:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704032 : -107156155847584 : ffff9e8ac3652c60)
02000000:00000001:25.0:1773851891.867220:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851891.867220:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851891.867221:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851891.867221:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13072@kfi7
00000400:00000010:25.0:1773851891.867222:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000971be53b.
00000100:00000200:25.0:1773851891.867223:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039921573120, offset 224
00000400:00000200:25.0:1773851891.867224:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13072@kfi7
00000400:00000200:25.0:1773851891.867225:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13072@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.867226:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002d24a5a nid 13072@kfi7 refs 1
00000400:00000200:25.0:1773851891.867226:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000002d24a5a nid 13072@kfi7 refs 2
00000400:00000200:25.0:1773851891.867227:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000002d24a5a nid 13072@kfi7 refs 3
00000400:00000200:25.0:1773851891.867228:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13072@kfi7 local destination
00000400:00000200:25.0:1773851891.867229:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770017:8770017:1024:4294967295] 13072@kfi7 LPNI seq info [452326:452326:16:4294967295]
00000400:00000200:25.0:1773851891.867231:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000002d24a5a nid 13072@kfi7 refs 2
00000400:00000200:25.0:1773851891.867231:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13072@kfi7 to cpt 6
00000400:00000200:25.0:1773851891.867233:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13072@kfi7(13072@kfi7:13072@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851891.867234:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000002d24a5a nid 13072@kfi7 refs 3
00000800:00000200:25.0:1773851891.867236:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851891.867237:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851891.867239:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851891.867241:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000604 Using peer 13072@kfi7(0x100000000000604)
00000800:00000200:25.0:1773851891.867243:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000055b583f: Posted send of 324 bytes to peer 0x100000000000604: rc=0
00000800:00000200:25.0:1773851891.867245:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000604 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851891.867246:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851891.867247:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002fe068b7 refcount 2 to 13073@kfi7
00010000:00000001:25.0:1773851891.867248:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851891.867248:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851891.867249:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851891.867249:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d41aea2a x1858039921573120/t0(0) o400->96a4d73e-670e-43b5-8ca3-47bbb800014c@13073@kfi7:141/0 lens 224/224 e 0 to 0 dl 1773852256 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1313-0'
00000100:00100000:25.0:1773851891.867252:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d41aea2a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:96a4d73e-670e-43b5-8ca3-47bbb800014c+6:39839:x1858039921573120:12345-13073@kfi7:400:default-tuolumne1313-0 Request processed in 53us (86us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851891.867254:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13073@kfi7, seq: 2025163
00000100:00000040:25.0:1773851891.867255:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000760c814f : new rpc_count 0
00000100:00000001:25.0:1773851891.867255:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851891.867256:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851891.867256:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851891.867257:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f0e565fc.
00000020:00000010:25.0:1773851891.867257:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d39d7b35.
00000020:00000040:25.0:1773851891.867258:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000760c814f : new refcount 5
00000800:00000200:27.0:1773851891.867259:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000604 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851891.867259:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851891.867260:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851891.867262:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13072@kfi7: PUT: OK
00000400:00000200:27.0:1773851891.867262:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000971be53b
00000400:00000010:27.0:1773851891.867263:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000971be53b.
00000100:00000001:27.0:1773851891.867263:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851891.867264:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851891.867265:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000002d24a5a nid 13072@kfi7 refs 2
00000800:00000200:27.0:1773851891.867266:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000055b583f: 2054@kfi7:6 -> 13072@kfi7(00000000da4c404d):0x0 lsk 1541 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000604 Transaction freed
00000800:00000200:9.0:1773851891.868483:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.868484:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.868485:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.868487:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851891.868489:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.868490:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8442@kfi7 : PUT - for me
00000400:00000200:9.0:1773851891.868491:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.868491:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 1
00000400:00000200:9.0:1773851891.868493:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.868493:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000400:00000200:9.0:1773851891.868494:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 3
00000400:00000200:9.0:1773851891.868495:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.868496:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8442@kfi7 of length 224 into portal 12 MB=0x699de84357e80
00000400:00000200:9.0:1773851891.868497:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8442@kfi7 of length 224/224 into md 0x78146ce49 [64] + 155416
00000800:00000200:9.0:1773851891.868499:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851891.868501:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.868503:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8442@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.868504:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851891.868504:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851891.868505:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000689bc844.
00000100:00000040:9.0:1773851891.868506:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000689bc844 x1858030840151680 msgsize 224
00000100:00100000:9.0:1773851891.868507:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8442@kfi7 (source: 12345-8442@kfi7)
00000100:00000001:9.0:1773851891.868508:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851891.868509:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000800:00000200:9.0:1773851891.868510:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851891.868510:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851891.868510:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851891.868511:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851891.868511:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851891.868512:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851891.868513:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030840151680
00000020:00000001:8.0:1773851891.868513:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851891.868514:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91070
00000020:00000001:8.0:1773851891.868514:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851891.868518:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009e4697a5 refcount=6
00000020:00000001:8.0:1773851891.868518:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240118272 : -107152469433344 : ffff9e8b9f1f6400)
00000020:00000001:8.0:1773851891.868519:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240118272 : -107152469433344 : ffff9e8b9f1f6400)
00000100:00000001:8.0:1773851891.868520:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.868521:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851891.868522:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007b77abdd.
00000020:00000010:8.0:1773851891.868523:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.868524:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851891.868525:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851891.868525:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851891.868526:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851891.868527:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851891.868527:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851891.868528:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.868529:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.868530:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851891.868530:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851891.868530:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851891.868531:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851891.868532:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851891.868532:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8442@kfi7, seq: 2130849
00000100:00000040:8.0:1773851891.868532:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009e4697a5 : new rpc_count 1
00000100:00000001:9.0:1773851891.868533:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.868533:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856910720 : -106914852640896 : ffff9ec2f22fe780)
00000100:00000040:8.0:1773851891.868534:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000689bc844 x1858030840151680/t0(0) o400->c15fe267-d2db-4f2d-87d7-e81a0417cab2@8442@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne201-0'
00000100:00000001:8.0:1773851891.868537:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.868537:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851891.868538:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000689bc844 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:c15fe267-d2db-4f2d-87d7-e81a0417cab2+6:50128:x1858030840151680:12345-8442@kfi7:400:default-tuolumne201-0
00000100:00000200:8.0:1773851891.868540:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030840151680
00000020:00000001:8.0:1773851891.868540:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851891.868541:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851891.868541:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.868542:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851891.868543:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851891.868543:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851891.868544:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030840151680, found 0 last_xid 1858030840151679
00000020:00000001:8.0:1773851891.868545:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851891.868545:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851891.868546:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851891.868546:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.868547:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851891.868548:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851891.868548:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851891.868549:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a914f7c8.
02000000:00000001:8.0:1773851891.868550:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.868550:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.868551:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851891.868552:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030840151680
00010000:00000001:8.0:1773851891.868553:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851891.868553:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000689bc844 x1858030840151680/t0(0) o400->c15fe267-d2db-4f2d-87d7-e81a0417cab2@8442@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne201-0'
00010000:00000001:8.0:1773851891.868556:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851891.868556:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851891.868557:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=124 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851891.868558:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851891.868559:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ecf3b8b6 refcount 5 to 8442@kfi7
00000100:00000001:8.0:1773851891.868559:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582464 : -107154806969152 : ffff9e8b13cb6cc0)
02000000:00000001:8.0:1773851891.868560:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851891.868561:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.868562:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851891.868562:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8442@kfi7
00000400:00000010:8.0:1773851891.868563:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a9fe4d78.
00000100:00000200:8.0:1773851891.868564:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030840151680, offset 224
00000400:00000200:8.0:1773851891.868565:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8442@kfi7
00000400:00000200:8.0:1773851891.868566:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.868566:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 1
00000400:00000200:8.0:1773851891.868568:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000400:00000200:8.0:1773851891.868569:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 3
00000400:00000200:8.0:1773851891.868570:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8442@kfi7 local destination
00000400:00000200:8.0:1773851891.868571:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770018:8770018:1024:4294967295] 8442@kfi7 LPNI seq info [24396:24396:16:4294967295]
00000400:00000200:8.0:1773851891.868572:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000400:00000200:8.0:1773851891.868573:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.868575:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8442@kfi7(8442@kfi7:8442@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851891.868576:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 3
00000800:00000200:8.0:1773851891.868577:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851891.868578:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851891.868581:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851891.868583:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000011d Using peer 8442@kfi7(0x10000000000011d)
00000800:00000200:8.0:1773851891.868586:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x10000000000011d: rc=0
00000800:00000200:8.0:1773851891.868587:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000011d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851891.868589:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851891.868590:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ecf3b8b6 refcount 4 to 8442@kfi7
00010000:00000001:8.0:1773851891.868591:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851891.868592:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.868592:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851891.868593:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000689bc844 x1858030840151680/t0(0) o400->c15fe267-d2db-4f2d-87d7-e81a0417cab2@8442@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne201-0'
00000100:00100000:8.0:1773851891.868598:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000689bc844 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:c15fe267-d2db-4f2d-87d7-e81a0417cab2+6:50128:x1858030840151680:12345-8442@kfi7:400:default-tuolumne201-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851891.868600:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8442@kfi7, seq: 2130849
00000100:00000040:8.0:1773851891.868601:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009e4697a5 : new rpc_count 0
00000100:00000001:8.0:1773851891.868602:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851891.868602:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851891.868603:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.868604:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851891.868605:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007b77abdd.
00000020:00000040:8.0:1773851891.868606:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000009e4697a5 : new refcount 5
00000100:00000001:8.0:1773851891.868606:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851891.868611:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000011d TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851891.868613:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.868614:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8442@kfi7: PUT: OK
00000400:00000200:9.0:1773851891.868614:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a9fe4d78
00000400:00000010:9.0:1773851891.868615:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a9fe4d78.
00000100:00000001:9.0:1773851891.868616:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851891.868616:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851891.868617:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000800:00000200:9.0:1773851891.868618:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 8442@kfi7(000000005b2327a0):0x0 lsk 286 rsk 249 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000011d Transaction freed
00000800:00000200:9.0:1773851891.869034:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.869034:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.869036:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.869037:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851891.869039:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.869040:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8442@kfi7 : PUT - for me
00000400:00000200:9.0:1773851891.869041:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.869043:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 1
00000400:00000200:9.0:1773851891.869043:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.869044:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000400:00000200:9.0:1773851891.869045:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 3
00000400:00000200:9.0:1773851891.869046:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.869046:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8442@kfi7 of length 224 into portal 12 MB=0x699de84358740
00000400:00000200:9.0:1773851891.869047:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8442@kfi7 of length 224/224 into md 0x78146ce49 [64] + 155640
00000800:00000200:9.0:1773851891.869049:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851891.869050:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.869051:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8442@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.869052:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851891.869052:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851891.869053:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000797edcb0.
00000100:00000040:9.0:1773851891.869054:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000797edcb0 x1858030840153920 msgsize 224
00000100:00100000:9.0:1773851891.869055:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-8442@kfi7 (source: 12345-8442@kfi7)
00000100:00000001:9.0:1773851891.869056:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851891.869057:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000800:00000200:9.0:1773851891.869058:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851891.869058:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851891.869058:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851891.869058:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851891.869059:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851891.869059:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851891.869060:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030840153920
00000020:00000001:8.0:1773851891.869061:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851891.869061:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91317
00000020:00000001:8.0:1773851891.869062:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851891.869065:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c284101d refcount=6
00000020:00000001:8.0:1773851891.869065:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716212736 : -107155993338880 : ffff9e8acd14dc00)
00000020:00000001:8.0:1773851891.869066:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716212736 : -107155993338880 : ffff9e8acd14dc00)
00000100:00000001:8.0:1773851891.869067:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.869067:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851891.869068:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851891.869068:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.869069:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851891.869070:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851891.869073:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851891.869073:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851891.869074:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851891.869074:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851891.869075:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.869075:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851891.869076:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851891.869077:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851891.869077:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851891.869077:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851891.869078:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851891.869078:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8442@kfi7, seq: 2130850
00000100:00000040:8.0:1773851891.869078:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c284101d : new rpc_count 1
00000100:00000001:9.0:1773851891.869079:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.869079:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637158856915328 : -106914852636288 : ffff9ec2f22ff980)
00000100:00000040:8.0:1773851891.869080:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000797edcb0 x1858030840153920/t0(0) o400->13e6ac88-7bec-4b8f-a7e2-955634256f7f@8442@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne201-0'
00000100:00000001:8.0:1773851891.869082:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.869083:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851891.869084:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000797edcb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:13e6ac88-7bec-4b8f-a7e2-955634256f7f+6:50099:x1858030840153920:12345-8442@kfi7:400:default-tuolumne201-0
00000100:00000200:8.0:1773851891.869085:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030840153920
00000020:00000001:8.0:1773851891.869086:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851891.869086:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851891.869087:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.869087:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851891.869087:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851891.869088:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851891.869089:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030840153920, found 0 last_xid 1858030840153919
00000020:00000001:8.0:1773851891.869089:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851891.869090:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851891.869090:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851891.869091:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.869091:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851891.869092:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851891.869092:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851891.869093:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008578dd44.
02000000:00000001:8.0:1773851891.869093:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.869094:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.869095:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851891.869095:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768344, transno 0, xid 1858030840153920
00010000:00000001:8.0:1773851891.869096:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851891.869097:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000797edcb0 x1858030840153920/t0(0) o400->13e6ac88-7bec-4b8f-a7e2-955634256f7f@8442@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne201-0'
00010000:00000001:8.0:1773851891.869099:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851891.869100:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851891.869100:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=124 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851891.869101:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851891.869102:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ecf3b8b6 refcount 5 to 8442@kfi7
00000100:00000001:8.0:1773851891.869102:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582464 : -107154806969152 : ffff9e8b13cb6cc0)
02000000:00000001:8.0:1773851891.869103:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851891.869103:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.869104:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851891.869105:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8442@kfi7
00000400:00000010:8.0:1773851891.869105:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000369ff48e.
00000100:00000200:8.0:1773851891.869106:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030840153920, offset 224
00000400:00000200:8.0:1773851891.869107:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8442@kfi7
00000400:00000200:8.0:1773851891.869108:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.869108:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 1
00000400:00000200:8.0:1773851891.869109:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000400:00000200:8.0:1773851891.869110:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 3
00000400:00000200:8.0:1773851891.869111:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8442@kfi7 local destination
00000400:00000200:8.0:1773851891.869113:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770019:8770019:1024:4294967295] 8442@kfi7 LPNI seq info [24397:24397:16:4294967295]
00000400:00000200:8.0:1773851891.869114:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000400:00000200:8.0:1773851891.869114:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8442@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.869116:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8442@kfi7(8442@kfi7:8442@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851891.869117:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 3
00000800:00000200:8.0:1773851891.869118:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851891.869119:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851891.869123:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851891.869125:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x626 Using peer 8442@kfi7(0x626)
00000800:00000200:8.0:1773851891.869128:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x626: rc=0
00000800:00000200:8.0:1773851891.869129:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x626 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851891.869131:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851891.869131:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ecf3b8b6 refcount 4 to 8442@kfi7
00010000:00000001:8.0:1773851891.869132:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851891.869132:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.869133:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851891.869134:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000797edcb0 x1858030840153920/t0(0) o400->13e6ac88-7bec-4b8f-a7e2-955634256f7f@8442@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne201-0'
00000100:00100000:8.0:1773851891.869136:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000797edcb0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:13e6ac88-7bec-4b8f-a7e2-955634256f7f+6:50099:x1858030840153920:12345-8442@kfi7:400:default-tuolumne201-0 Request processed in 53us (82us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851891.869140:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8442@kfi7, seq: 2130850
00000100:00000040:8.0:1773851891.869140:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c284101d : new rpc_count 0
00000100:00000001:8.0:1773851891.869141:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851891.869141:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851891.869142:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.869142:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851891.869143:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851891.869143:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c284101d : new refcount 5
00000100:00000001:8.0:1773851891.869144:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851891.869148:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x626 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851891.869150:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.869151:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8442@kfi7: PUT: OK
00000400:00000200:9.0:1773851891.869152:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000369ff48e
00000400:00000010:9.0:1773851891.869152:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000369ff48e.
00000100:00000001:9.0:1773851891.869153:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851891.869153:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851891.869154:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b6553883 nid 8442@kfi7 refs 2
00000800:00000200:9.0:1773851891.869156:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8442@kfi7(0000000074db14cb):0x0 lsk 1575 rsk 250 tsk 0 trmk 0 tmk 0 trr 2 tta 0x626 Transaction freed
00000800:00000200:21.0:1773851891.885458:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851891.885459:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851891.885460:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851891.885462:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851891.885464:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12467@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.885465:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12467@kfi7 : PUT - for me
00000400:00000200:21.0:1773851891.885466:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12467@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.885466:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003993798d nid 12467@kfi7 refs 1
00000400:00000200:21.0:1773851891.885468:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12467@kfi7 to cpt 5
00000400:00000200:21.0:1773851891.885468:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003993798d nid 12467@kfi7 refs 2
00000400:00000200:21.0:1773851891.885469:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003993798d nid 12467@kfi7 refs 3
00000400:00000200:21.0:1773851891.885470:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12403@kfi7 to cpt 2
00000400:00000200:21.0:1773851891.885471:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12403@kfi7 of length 224 into portal 12 MB=0x69b4b5a4a3f80
00000400:00000200:21.0:1773851891.885472:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12403@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 59560
00000800:00000200:21.0:1773851891.885474:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851891.885475:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851891.885476:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12467@kfi7: PUT: OK
00000100:00000001:21.0:1773851891.885477:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851891.885478:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851891.885479:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000be074af3.
00000100:00000040:21.0:1773851891.885479:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000be074af3 x1859597799931776 msgsize 224
00000100:00100000:21.0:1773851891.885480:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-12403@kfi7 (source: 12345-12467@kfi7)
00000100:00000001:21.0:1773851891.885481:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851891.885483:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003993798d nid 12467@kfi7 refs 2
00000100:00000001:20.0:1773851891.885483:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851891.885483:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851891.885484:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851891.885484:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851891.885484:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851891.885485:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851891.885486:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597799931776
00000020:00000001:20.0:1773851891.885486:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851891.885487:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f590
00000020:00000001:20.0:1773851891.885487:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851891.885491:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c8975f08 refcount=5
00000020:00000001:20.0:1773851891.885492:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636962295291904 : -107111414259712 : ffff9e952e33a000)
00000020:00000001:20.0:1773851891.885493:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636962295291904 : -107111414259712 : ffff9e952e33a000)
00000100:00000001:20.0:1773851891.885494:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.885495:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851891.885495:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851891.885496:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851891.885497:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003c2cbb40.
00000100:00000001:20.0:1773851891.885498:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851891.885498:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851891.885499:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851891.885500:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851891.885500:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851891.885501:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.885501:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851891.885503:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851891.885503:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851891.885503:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851891.885503:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851891.885504:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12403@kfi7, seq: 1998058
00000100:00000040:23.0:1773851891.885505:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c8975f08 : new rpc_count 1
00000100:00000001:20.0:1773851891.885505:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851891.885506:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667745664 : -106956041805952 : ffff9eb95b1f1f80)
00000100:00000040:23.0:1773851891.885507:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000be074af3 x1859597799931776/t0(0) o400->57e48e91-efd0-45b1-9755-70b59dfa2576@12403@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1258-0'
00000100:00000001:20.0:1773851891.885508:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851891.885510:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851891.885511:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851891.885512:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be074af3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:57e48e91-efd0-45b1-9755-70b59dfa2576+5:39509:x1859597799931776:12345-12403@kfi7:400:default-tuolumne1258-0
00000100:00000200:23.0:1773851891.885513:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597799931776
00000020:00000001:23.0:1773851891.885514:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851891.885514:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851891.885515:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851891.885516:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851891.885516:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851891.885517:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851891.885518:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597799931776, found 0 last_xid 1859597799931775
00000020:00000001:23.0:1773851891.885519:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851891.885519:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851891.885520:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851891.885521:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851891.885521:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851891.885522:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851891.885523:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851891.885523:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f24578ef.
02000000:00000001:23.0:1773851891.885524:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851891.885524:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851891.885525:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851891.885526:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691968, transno 0, xid 1859597799931776
00010000:00000001:23.0:1773851891.885527:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851891.885528:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000be074af3 x1859597799931776/t0(0) o400->57e48e91-efd0-45b1-9755-70b59dfa2576@12403@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1258-0'
00010000:00000001:23.0:1773851891.885530:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851891.885530:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851891.885531:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=124 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851891.885532:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851891.885533:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cec98d66 refcount 3 to 12403@kfi7
00000100:00000001:23.0:1773851891.885533:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810488288 : -107154899063328 : ffff9e8b0e4e2de0)
02000000:00000001:23.0:1773851891.885534:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851891.885535:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851891.885535:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851891.885536:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12467@kfi7
00000400:00000010:23.0:1773851891.885537:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003279a6c9.
00000100:00000200:23.0:1773851891.885538:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597799931776, offset 224
00000400:00000200:23.0:1773851891.885539:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12467@kfi7
00000400:00000200:23.0:1773851891.885540:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12467@kfi7 to cpt 5
00000400:00000200:23.0:1773851891.885540:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003993798d nid 12467@kfi7 refs 1
00000400:00000200:23.0:1773851891.885542:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003993798d nid 12467@kfi7 refs 2
00000400:00000200:23.0:1773851891.885543:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003993798d nid 12467@kfi7 refs 3
00000400:00000200:23.0:1773851891.885544:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12467@kfi7 local destination
00000400:00000200:23.0:1773851891.885546:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770020:8770020:1024:4294967295] 12467@kfi7 LPNI seq info [6339730:6339730:16:4294967295]
00000400:00000200:23.0:1773851891.885547:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003993798d nid 12467@kfi7 refs 2
00000400:00000200:23.0:1773851891.885548:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12467@kfi7 to cpt 5
00000400:00000200:23.0:1773851891.885550:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12467@kfi7(12467@kfi7:12467@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851891.885551:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003993798d nid 12467@kfi7 refs 3
00000800:00000200:23.0:1773851891.885553:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851891.885554:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851891.885556:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851891.885559:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf68 Using peer 12467@kfi7(0xf68)
00000800:00000200:23.0:1773851891.885562:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0xf68: rc=0
00000800:00000200:23.0:1773851891.885563:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf68 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851891.885565:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851891.885566:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cec98d66 refcount 2 to 12403@kfi7
00010000:00000001:23.0:1773851891.885567:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851891.885568:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851891.885568:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851891.885569:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000be074af3 x1859597799931776/t0(0) o400->57e48e91-efd0-45b1-9755-70b59dfa2576@12403@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1258-0'
00000100:00100000:23.0:1773851891.885572:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be074af3 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:57e48e91-efd0-45b1-9755-70b59dfa2576+5:39509:x1859597799931776:12345-12403@kfi7:400:default-tuolumne1258-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851891.885574:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12403@kfi7, seq: 1998058
00000100:00000040:23.0:1773851891.885575:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c8975f08 : new rpc_count 0
00000800:00000200:21.0:1773851891.885575:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf68 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851891.885576:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851891.885576:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851891.885577:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000400:00000200:21.0:1773851891.885577:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851891.885578:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003c2cbb40.
00000400:00000200:21.0:1773851891.885578:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12467@kfi7: PUT: OK
00000400:00000200:21.0:1773851891.885578:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003279a6c9
00000020:00000010:23.0:1773851891.885579:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000400:00000010:21.0:1773851891.885579:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003279a6c9.
00000020:00000040:23.0:1773851891.885580:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000c8975f08 : new refcount 4
00000100:00000001:21.0:1773851891.885580:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851891.885580:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851891.885581:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851891.885581:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003993798d nid 12467@kfi7 refs 2
00000800:00000200:21.0:1773851891.885582:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 12467@kfi7(000000001b7415f6):0x0 lsk 3945 rsk 11 tsk 0 trmk 0 tmk 0 trr 5 tta 0xf68 Transaction freed
00000800:00000200:9.0:1773851891.906380:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.906381:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.906383:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.906385:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851891.906387:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22912@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.906388:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22912@kfi7 : PUT - for me
00000400:00000200:9.0:1773851891.906388:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22912@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.906389:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d58219e0 nid 22912@kfi7 refs 1
00000400:00000200:9.0:1773851891.906390:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22912@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.906391:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d58219e0 nid 22912@kfi7 refs 2
00000400:00000200:9.0:1773851891.906392:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d58219e0 nid 22912@kfi7 refs 3
00000400:00000200:9.0:1773851891.906393:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22849@kfi7 to cpt 2
00000400:00000200:9.0:1773851891.906393:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22849@kfi7 of length 224 into portal 12 MB=0x699e0dc320280
00000400:00000200:9.0:1773851891.906395:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22849@kfi7 of length 224/224 into md 0x78146ce49 [64] + 155864
00000800:00000200:9.0:1773851891.906396:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851891.906398:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.906399:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22912@kfi7: PUT: OK
00000100:00000001:9.0:1773851891.906399:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851891.906400:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851891.906402:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e84bddd2.
00000100:00000040:9.0:1773851891.906403:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e84bddd2 x1858040906252928 msgsize 224
00000100:00100000:9.0:1773851891.906404:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22849@kfi7 (source: 12345-22912@kfi7)
00000100:00000001:9.0:1773851891.906405:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851891.906405:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d58219e0 nid 22912@kfi7 refs 2
00000100:00000001:8.0:1773851891.906406:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851891.906407:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851891.906407:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851891.906408:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851891.906408:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851891.906409:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851891.906410:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040906252928
00000020:00000001:8.0:1773851891.906411:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851891.906411:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a95
00000020:00000001:8.0:1773851891.906412:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851891.906415:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b2c6693 refcount=6
00000020:00000001:8.0:1773851891.906416:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627764224 : -107123081787392 : ffff9e9276c34800)
00000020:00000001:8.0:1773851891.906417:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627764224 : -107123081787392 : ffff9e9276c34800)
00000100:00000001:8.0:1773851891.906418:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.906419:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851891.906420:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851891.906421:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.906422:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851891.906423:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851891.906423:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851891.906423:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851891.906424:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851891.906425:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851891.906425:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.906426:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851891.906427:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851891.906428:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851891.906428:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851891.906429:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851891.906429:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22849@kfi7, seq: 2130851
00000100:00000001:9.0:1773851891.906430:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851891.906430:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b2c6693 : new rpc_count 1
00000100:00000001:9.0:1773851891.906431:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.906431:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637088406815616 : -106985302736000 : ffff9eb28b08c380)
00000100:00000040:8.0:1773851891.906432:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e84bddd2 x1858040906252928/t0(0) o400->effe209c-305f-4fb9-911d-3e5f720ea19d@22849@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1924-0'
00000100:00000001:8.0:1773851891.906435:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.906435:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851891.906436:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e84bddd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:effe209c-305f-4fb9-911d-3e5f720ea19d+6:39678:x1858040906252928:12345-22849@kfi7:400:default-tuolumne1924-0
00000100:00000200:8.0:1773851891.906437:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040906252928
00000020:00000001:8.0:1773851891.906438:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851891.906438:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851891.906439:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.906441:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851891.906441:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851891.906442:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851891.906443:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040906252928, found 0 last_xid 1858040906252927
00000020:00000001:8.0:1773851891.906443:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851891.906444:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851891.906445:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851891.906445:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.906446:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851891.906446:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851891.906447:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851891.906447:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b188a376.
02000000:00000001:8.0:1773851891.906448:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.906449:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.906449:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851891.906450:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262831128, transno 0, xid 1858040906252928
00010000:00000001:8.0:1773851891.906451:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851891.906452:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e84bddd2 x1858040906252928/t0(0) o400->effe209c-305f-4fb9-911d-3e5f720ea19d@22849@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1924-0'
00010000:00000001:8.0:1773851891.906454:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851891.906455:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851891.906455:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=124 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851891.906457:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851891.906457:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eea3d146 refcount 3 to 22849@kfi7
00000100:00000001:8.0:1773851891.906458:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579584 : -107154806972032 : ffff9e8b13cb6180)
02000000:00000001:8.0:1773851891.906459:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851891.906460:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.906460:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851891.906461:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22912@kfi7
00000400:00000010:8.0:1773851891.906462:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c20ed36.
00000100:00000200:8.0:1773851891.906462:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040906252928, offset 224
00000400:00000200:8.0:1773851891.906463:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22912@kfi7
00000400:00000200:8.0:1773851891.906464:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22912@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.906465:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d58219e0 nid 22912@kfi7 refs 1
00000400:00000200:8.0:1773851891.906466:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d58219e0 nid 22912@kfi7 refs 2
00000400:00000200:8.0:1773851891.906468:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d58219e0 nid 22912@kfi7 refs 3
00000400:00000200:8.0:1773851891.906469:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22912@kfi7 local destination
00000400:00000200:8.0:1773851891.906471:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770021:8770021:1024:4294967295] 22912@kfi7 LPNI seq info [426765:426765:16:4294967295]
00000400:00000200:8.0:1773851891.906472:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d58219e0 nid 22912@kfi7 refs 2
00000400:00000200:8.0:1773851891.906473:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22912@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.906475:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22912@kfi7(22912@kfi7:22912@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851891.906476:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d58219e0 nid 22912@kfi7 refs 3
00000800:00000200:8.0:1773851891.906477:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851891.906478:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851891.906480:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851891.906482:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe6d Using peer 22912@kfi7(0xe6d)
00000800:00000200:8.0:1773851891.906485:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0xe6d: rc=0
00000800:00000200:8.0:1773851891.906486:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe6d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851891.906488:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851891.906489:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eea3d146 refcount 2 to 22849@kfi7
00010000:00000001:8.0:1773851891.906489:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851891.906490:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.906491:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851891.906491:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e84bddd2 x1858040906252928/t0(0) o400->effe209c-305f-4fb9-911d-3e5f720ea19d@22849@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1924-0'
00000100:00100000:8.0:1773851891.906496:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e84bddd2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:effe209c-305f-4fb9-911d-3e5f720ea19d+6:39678:x1858040906252928:12345-22849@kfi7:400:default-tuolumne1924-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851891.906498:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22849@kfi7, seq: 2130851
00000100:00000040:8.0:1773851891.906499:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b2c6693 : new rpc_count 0
00000100:00000001:8.0:1773851891.906499:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851891.906501:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851891.906501:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.906502:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851891.906503:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851891.906504:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000003b2c6693 : new refcount 5
00000100:00000001:8.0:1773851891.906504:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851891.906509:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe6d TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851891.906510:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.906511:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22912@kfi7: PUT: OK
00000400:00000200:9.0:1773851891.906512:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c20ed36
00000400:00000010:9.0:1773851891.906513:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c20ed36.
00000100:00000001:9.0:1773851891.906513:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851891.906514:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851891.906515:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d58219e0 nid 22912@kfi7 refs 2
00000800:00000200:9.0:1773851891.906516:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 22912@kfi7(0000000063e2537b):0x0 lsk 3694 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe6d Transaction freed
00000800:00000200:29.0:1773851891.912158:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851891.912160:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851891.912162:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851891.912166:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851891.912173:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11394@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.912175:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11394@kfi7 : PUT - for me
00000400:00000200:29.0:1773851891.912177:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11394@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.912180:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b1a04a nid 11394@kfi7 refs 1
00000400:00000200:29.0:1773851891.912182:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11394@kfi7 to cpt 7
00000400:00000200:29.0:1773851891.912183:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b1a04a nid 11394@kfi7 refs 2
00000400:00000200:29.0:1773851891.912185:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000098b1a04a nid 11394@kfi7 refs 3
00000400:00000200:29.0:1773851891.912186:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11330@kfi7 to cpt 3
00000400:00000200:29.0:1773851891.912188:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11330@kfi7 of length 224 into portal 12 MB=0x69b09ed4175c0
00000400:00000200:29.0:1773851891.912191:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11330@kfi7 of length 224/224 into md 0x77fe1859d [64] + 4552
00000800:00000200:29.0:1773851891.912194:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851891.912197:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851891.912199:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11394@kfi7: PUT: OK
00000100:00000001:29.0:1773851891.912201:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851891.912202:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851891.912203:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000083e9bcbb.
00000100:00000040:29.0:1773851891.912204:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000083e9bcbb x1859316797765056 msgsize 224
00000100:00100000:29.0:1773851891.912207:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11330@kfi7 (source: 12345-11394@kfi7)
00000100:00000001:29.0:1773851891.912209:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851891.912211:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000098b1a04a nid 11394@kfi7 refs 2
00000100:00000001:31.0:1773851891.912212:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851891.912213:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851891.912214:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851891.912215:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851891.912216:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851891.912217:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851891.912219:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316797765056
00000020:00000001:31.0:1773851891.912220:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851891.912221:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91475
00000020:00000001:31.0:1773851891.912222:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851891.912225:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a49475e refcount=6
00000020:00000001:31.0:1773851891.912227:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240801280 : -107152468750336 : ffff9e8b9f29d000)
00000020:00000001:31.0:1773851891.912228:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240801280 : -107152468750336 : ffff9e8b9f29d000)
00000100:00000001:31.0:1773851891.912230:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851891.912231:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851891.912232:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001c4eb1a9.
00000020:00000010:31.0:1773851891.912234:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851891.912235:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851891.912237:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851891.912238:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851891.912239:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851891.912241:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851891.912241:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851891.912242:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.912244:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851891.912246:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851891.912247:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851891.912247:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851891.912247:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851891.912249:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11330@kfi7, seq: 2055580
00000100:00000040:31.0:1773851891.912250:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a49475e : new rpc_count 1
00000100:00000001:30.0:1773851891.912250:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851891.912251:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.912252:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262246656 : -106943447304960 : ffff9ebc49cff500)
00000100:00000040:31.0:1773851891.912254:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000083e9bcbb x1859316797765056/t0(0) o400->c4be55e9-1a89-4840-85a5-32f40b993b2a@11330@kfi7:679/0 lens 224/0 e 0 to 0 dl 1773852039 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1208-0'
00000100:00000001:31.0:1773851891.912259:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851891.912260:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851891.912261:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083e9bcbb pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:c4be55e9-1a89-4840-85a5-32f40b993b2a+6:39794:x1859316797765056:12345-11330@kfi7:400:default-tuolumne1208-0
00000100:00000200:31.0:1773851891.912266:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316797765056
00000020:00000001:31.0:1773851891.912268:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851891.912269:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851891.912269:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.912270:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851891.912271:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851891.912273:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851891.912273:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316797765056, found 0 last_xid 1859316797765055
00000020:00000001:31.0:1773851891.912275:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851891.912276:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851891.912276:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851891.912277:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.912278:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851891.912278:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851891.912279:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851891.912280:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0660696.
02000000:00000001:31.0:1773851891.912280:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.912281:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.912282:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851891.912283:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035403222, transno 0, xid 1859316797765056
00010000:00000001:31.0:1773851891.912284:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851891.912285:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000083e9bcbb x1859316797765056/t0(0) o400->c4be55e9-1a89-4840-85a5-32f40b993b2a@11330@kfi7:679/0 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1208-0'
00010000:00000001:31.0:1773851891.912288:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851891.912288:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851891.912289:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=124 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851891.912290:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851891.912291:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000083940fc1 refcount 3 to 11330@kfi7
00000100:00000001:31.0:1773851891.912292:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487623520 : -107151221928096 : ffff9e8be97acf60)
02000000:00000001:31.0:1773851891.912293:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851891.912293:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851891.912294:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851891.912295:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11394@kfi7
00000400:00000010:31.0:1773851891.912296:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001af55591.
00000100:00000200:31.0:1773851891.912297:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316797765056, offset 224
00000400:00000200:31.0:1773851891.912299:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11394@kfi7
00000400:00000200:31.0:1773851891.912300:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11394@kfi7 to cpt 7
00000400:00000200:31.0:1773851891.912301:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000098b1a04a nid 11394@kfi7 refs 1
00000400:00000200:31.0:1773851891.912302:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000098b1a04a nid 11394@kfi7 refs 2
00000400:00000200:31.0:1773851891.912303:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000098b1a04a nid 11394@kfi7 refs 3
00000400:00000200:31.0:1773851891.912305:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11394@kfi7 local destination
00000400:00000200:31.0:1773851891.912306:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770022:8770022:1024:4294967295] 11394@kfi7 LPNI seq info [812085:812085:16:4294967295]
00000400:00000200:31.0:1773851891.912307:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000098b1a04a nid 11394@kfi7 refs 2
00000400:00000200:31.0:1773851891.912308:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11394@kfi7 to cpt 7
00000400:00000200:31.0:1773851891.912311:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11394@kfi7(11394@kfi7:11394@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851891.912312:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000098b1a04a nid 11394@kfi7 refs 3
00000800:00000200:31.0:1773851891.912314:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851891.912315:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851891.912317:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851891.912320:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c9e Using peer 11394@kfi7(0x100000000000c9e)
00000800:00000200:31.0:1773851891.912323:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x100000000000c9e: rc=0
00000800:00000200:31.0:1773851891.912324:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c9e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851891.912326:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851891.912327:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000083940fc1 refcount 2 to 11330@kfi7
00010000:00000001:31.0:1773851891.912328:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851891.912328:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851891.912329:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851891.912329:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000083e9bcbb x1859316797765056/t0(0) o400->c4be55e9-1a89-4840-85a5-32f40b993b2a@11330@kfi7:679/0 lens 224/224 e 0 to 0 dl 1773852039 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1208-0'
00000100:00100000:31.0:1773851891.912332:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083e9bcbb pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:c4be55e9-1a89-4840-85a5-32f40b993b2a+6:39794:x1859316797765056:12345-11330@kfi7:400:default-tuolumne1208-0 Request processed in 72us (127us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851891.912335:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11330@kfi7, seq: 2055580
00000100:00000040:31.0:1773851891.912336:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a49475e : new rpc_count 0
00000100:00000001:31.0:1773851891.912336:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851891.912337:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851891.912337:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000800:00000200:29.0:1773851891.912337:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c9e TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851891.912338:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851891.912338:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851891.912339:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001c4eb1a9.
00000400:00000200:29.0:1773851891.912339:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11394@kfi7: PUT: OK
00000020:00000040:31.0:1773851891.912340:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000009a49475e : new refcount 5
00000100:00000001:31.0:1773851891.912340:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851891.912340:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001af55591
00000400:00000010:29.0:1773851891.912341:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001af55591.
00000100:00000001:29.0:1773851891.912341:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851891.912342:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851891.912343:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000098b1a04a nid 11394@kfi7 refs 2
00000800:00000200:29.0:1773851891.912344:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11394@kfi7(000000005e606395):0x0 lsk 3231 rsk 69 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000c9e Transaction freed
00000800:00000200:10.0:1773851891.947622:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851891.947622:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851891.947623:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851891.947623:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851891.947624:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851891.947624:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851891.947626:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851891.947626:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 23472@kfi7(00000000b608a12f):0x4c9 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851891.947628:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23472@kfi7 to cpt 2
00000800:00000200:9.0:1773851891.947628:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 Using peer 23472@kfi7(0x4c9)
00000400:00000200:9.0:1773851891.947629:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23472@kfi7 to cpt 2
00000400:00000200:10.0:1773851891.947630:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23472@kfi7 : PUT - for me
00000400:00000200:10.0:1773851891.947631:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23472@kfi7 to cpt 2
00000400:00000200:10.0:1773851891.947631:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c288d0b0 nid 23472@kfi7 refs 1
00000800:00000200:9.0:1773851891.947631:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000022757302: Posted send of 38 bytes to peer 0x4c9: rc=0
00000400:00000200:10.0:1773851891.947633:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23472@kfi7 to cpt 2
00000800:00000200:9.0:1773851891.947633:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851891.947634:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c288d0b0 nid 23472@kfi7 refs 2
00000400:00000200:10.0:1773851891.947635:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c288d0b0 nid 23472@kfi7 refs 3
00000400:00000200:10.0:1773851891.947635:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23473@kfi7 to cpt 5
00000400:00000200:10.0:1773851891.947636:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23473@kfi7 of length 224 into portal 12 MB=0x699e11596fdc0
00000400:00000200:10.0:1773851891.947638:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23473@kfi7 of length 224/224 into md 0x78146ce49 [64] + 156088
00000800:00000200:10.0:1773851891.947639:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851891.947641:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851891.947642:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23472@kfi7: PUT: OK
00000100:00000001:10.0:1773851891.947643:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851891.947644:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851891.947644:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 TN_EVENT_TX_OK event status 0
00000100:00000010:10.0:1773851891.947645:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004ae68162.
00000100:00000040:10.0:1773851891.947646:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000004ae68162 x1858041869172160 msgsize 224
00000800:00000200:9.0:1773851891.947646:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 Transaction freed
00000100:00100000:10.0:1773851891.947647:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-23473@kfi7 (source: 12345-23472@kfi7)
00000100:00000001:10.0:1773851891.947648:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851891.947649:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c288d0b0 nid 23472@kfi7 refs 2
00000800:00000200:10.0:1773851891.947650:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851891.947650:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851891.947650:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851891.947651:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851891.947652:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851891.947652:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851891.947653:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041869172160
00000020:00000001:8.0:1773851891.947654:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851891.947654:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9274c
00000020:00000001:8.0:1773851891.947655:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851891.947659:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000097373438 refcount=6
00000020:00000001:8.0:1773851891.947660:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631271424 : -107123078280192 : ffff9e9276f8cc00)
00000020:00000001:8.0:1773851891.947661:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631271424 : -107123078280192 : ffff9e9276f8cc00)
00000100:00000001:8.0:1773851891.947662:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.947663:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851891.947663:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851891.947664:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.947665:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851891.947666:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851891.947666:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851891.947667:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851891.947668:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851891.947669:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851891.947669:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.947670:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851891.947671:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851891.947671:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851891.947672:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851891.947672:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851891.947673:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851891.947673:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23473@kfi7, seq: 2130852
00000100:00000040:8.0:1773851891.947673:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000097373438 : new rpc_count 1
00000100:00000001:9.0:1773851891.947674:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.947674:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087754112 : -106944621797504 : ffff9ebc03ce9f80)
00000100:00000040:8.0:1773851891.947676:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004ae68162 x1858041869172160/t0(0) o400->6a88070b-0209-4507-aeee-995a10def615@23473@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1950-0'
00000100:00000001:8.0:1773851891.947679:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851891.947679:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851891.947680:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ae68162 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:6a88070b-0209-4507-aeee-995a10def615+6:39797:x1858041869172160:12345-23473@kfi7:400:default-tuolumne1950-0
00000100:00000200:8.0:1773851891.947682:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041869172160
00000020:00000001:8.0:1773851891.947682:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851891.947683:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851891.947684:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.947684:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851891.947685:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851891.947686:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851891.947686:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041869172160, found 0 last_xid 1858041869172159
00000020:00000001:8.0:1773851891.947687:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851891.947688:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851891.947688:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851891.947689:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.947689:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851891.947690:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851891.947690:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851891.947691:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eeaa333e.
02000000:00000001:8.0:1773851891.947692:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.947693:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.947693:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851891.947694:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044167628, transno 0, xid 1858041869172160
00010000:00000001:8.0:1773851891.947695:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851891.947696:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004ae68162 x1858041869172160/t0(0) o400->6a88070b-0209-4507-aeee-995a10def615@23473@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1950-0'
00010000:00000001:8.0:1773851891.947698:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851891.947698:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851891.947699:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=124 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851891.947700:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851891.947701:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b137b18b refcount 3 to 23473@kfi7
00000100:00000001:8.0:1773851891.947702:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026528 : -107156745525088 : ffff9e8aa03f68a0)
02000000:00000001:8.0:1773851891.947703:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851891.947703:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851891.947704:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851891.947704:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23472@kfi7
00000400:00000010:8.0:1773851891.947705:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc809cf6.
00000100:00000200:8.0:1773851891.947706:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041869172160, offset 224
00000400:00000200:8.0:1773851891.947707:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23472@kfi7
00000400:00000200:8.0:1773851891.947708:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23472@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.947708:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c288d0b0 nid 23472@kfi7 refs 1
00000400:00000200:8.0:1773851891.947709:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c288d0b0 nid 23472@kfi7 refs 2
00000400:00000200:8.0:1773851891.947710:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c288d0b0 nid 23472@kfi7 refs 3
00000400:00000200:8.0:1773851891.947711:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23472@kfi7 local destination
00000400:00000200:8.0:1773851891.947713:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770023:8770023:1024:4294967295] 23472@kfi7 LPNI seq info [12002130:12002130:16:4294967295]
00000400:00000200:8.0:1773851891.947714:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c288d0b0 nid 23472@kfi7 refs 2
00000400:00000200:8.0:1773851891.947715:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23472@kfi7 to cpt 2
00000400:00000200:8.0:1773851891.947717:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23472@kfi7(23472@kfi7:23472@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851891.947718:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c288d0b0 nid 23472@kfi7 refs 3
00000800:00000200:8.0:1773851891.947719:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851891.947720:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851891.947722:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851891.947724:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 Using peer 23472@kfi7(0x4c9)
00000800:00000200:8.0:1773851891.947730:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x4c9: rc=0
00000800:00000200:8.0:1773851891.947731:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851891.947733:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851891.947734:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b137b18b refcount 2 to 23473@kfi7
00010000:00000001:8.0:1773851891.947735:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851891.947735:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851891.947736:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851891.947737:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004ae68162 x1858041869172160/t0(0) o400->6a88070b-0209-4507-aeee-995a10def615@23473@kfi7:618/0 lens 224/224 e 0 to 0 dl 1773851978 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1950-0'
00000100:00100000:8.0:1773851891.947741:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ae68162 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:6a88070b-0209-4507-aeee-995a10def615+6:39797:x1858041869172160:12345-23473@kfi7:400:default-tuolumne1950-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851891.947744:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23473@kfi7, seq: 2130852
00000100:00000040:8.0:1773851891.947745:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000097373438 : new rpc_count 0
00000100:00000001:8.0:1773851891.947745:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851891.947746:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851891.947746:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851891.947747:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851891.947748:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851891.947749:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000097373438 : new refcount 5
00000100:00000001:8.0:1773851891.947750:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851891.947754:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851891.947756:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851891.947757:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23472@kfi7: PUT: OK
00000400:00000200:9.0:1773851891.947757:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc809cf6
00000400:00000010:9.0:1773851891.947758:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc809cf6.
00000100:00000001:9.0:1773851891.947759:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851891.947759:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851891.947760:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c288d0b0 nid 23472@kfi7 refs 2
00000800:00000200:9.0:1773851891.947762:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23472@kfi7(00000000b608a12f):0x0 lsk 1226 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c9 Transaction freed
00000800:00000200:17.0:1773851891.965834:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851891.965835:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851891.965836:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851891.965838:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851891.965840:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18928@kfi7 to cpt 4
00000400:00000200:17.0:1773851891.965841:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18928@kfi7 : PUT - for me
00000400:00000200:17.0:1773851891.965842:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18928@kfi7 to cpt 4
00000400:00000200:17.0:1773851891.965842:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a10505d2 nid 18928@kfi7 refs 1
00000400:00000200:17.0:1773851891.965843:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18928@kfi7 to cpt 4
00000400:00000200:17.0:1773851891.965847:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a10505d2 nid 18928@kfi7 refs 2
00000400:00000200:17.0:1773851891.965848:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a10505d2 nid 18928@kfi7 refs 3
00000400:00000200:17.0:1773851891.965848:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18929@kfi7 to cpt 7
00000400:00000200:17.0:1773851891.965849:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18929@kfi7 of length 224 into portal 12 MB=0x69b4b64a85840
00000400:00000200:17.0:1773851891.965850:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18929@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 40728
00000800:00000200:17.0:1773851891.965852:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851891.965854:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851891.965854:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18928@kfi7: PUT: OK
00000100:00000001:17.0:1773851891.965855:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851891.965856:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851891.965857:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000170ee750.
00000100:00000040:17.0:1773851891.965857:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000170ee750 x1859597973870656 msgsize 224
00000100:00100000:17.0:1773851891.965859:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18929@kfi7 (source: 12345-18928@kfi7)
00000100:00000001:17.0:1773851891.965860:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851891.965860:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a10505d2 nid 18928@kfi7 refs 2
00000100:00000001:19.0:1773851891.965861:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851891.965862:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851891.965862:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851891.965862:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851891.965863:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851891.965864:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851891.965865:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597973870656
00000020:00000001:19.0:1773851891.965865:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851891.965866:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23ed2793
00000020:00000001:19.0:1773851891.965866:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851891.965868:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000048c86941 refcount=5
00000020:00000001:19.0:1773851891.965868:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637089129416704 : -106984580134912 : ffff9eb2b61ac800)
00000020:00000001:19.0:1773851891.965869:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637089129416704 : -106984580134912 : ffff9eb2b61ac800)
00000100:00000001:19.0:1773851891.965870:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851891.965871:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851891.965872:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851891.965873:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851891.965874:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851891.965875:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851891.965875:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851891.965876:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851891.965877:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851891.965877:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851891.965878:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.965879:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851891.965880:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851891.965880:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851891.965880:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851891.965880:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851891.965881:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18929@kfi7, seq: 2156412
00000100:00000040:19.0:1773851891.965882:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000048c86941 : new rpc_count 1
00000100:00000001:16.0:1773851891.965882:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.965883:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968762368 : -106974740789248 : ffff9eb500934800)
00000100:00000001:16.0:1773851891.965883:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851891.965884:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000170ee750 x1859597973870656/t0(0) o400->8c0aa40b-07cf-4cf3-9a54-74ee0e3db425@18929@kfi7:143/0 lens 224/0 e 0 to 0 dl 1773852258 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1661-0'
00000100:00000001:19.0:1773851891.965886:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851891.965887:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851891.965887:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000170ee750 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8c0aa40b-07cf-4cf3-9a54-74ee0e3db425+5:39700:x1859597973870656:12345-18929@kfi7:400:default-tuolumne1661-0
00000100:00000200:19.0:1773851891.965889:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597973870656
00000020:00000001:19.0:1773851891.965889:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851891.965890:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851891.965890:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.965891:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851891.965891:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851891.965892:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851891.965893:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597973870656, found 0 last_xid 1859597973870655
00000020:00000001:19.0:1773851891.965893:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851891.965894:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851891.965894:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851891.965895:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.965896:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851891.965896:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851891.965897:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851891.965897:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7291b04.
02000000:00000001:19.0:1773851891.965898:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.965898:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.965899:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851891.965900:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260594488, transno 0, xid 1859597973870656
00010000:00000001:19.0:1773851891.965901:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851891.965902:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000170ee750 x1859597973870656/t0(0) o400->8c0aa40b-07cf-4cf3-9a54-74ee0e3db425@18929@kfi7:143/0 lens 224/224 e 0 to 0 dl 1773852258 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1661-0'
00010000:00000001:19.0:1773851891.965904:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851891.965904:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851891.965905:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=124 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851891.965906:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851891.965907:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005b8f6260 refcount 3 to 18929@kfi7
00000100:00000001:19.0:1773851891.965907:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269760 : -107152618281856 : ffff9e8b96402480)
02000000:00000001:19.0:1773851891.965908:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851891.965909:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851891.965909:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851891.965910:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18928@kfi7
00000400:00000010:19.0:1773851891.965910:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000851767a5.
00000100:00000200:19.0:1773851891.965911:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597973870656, offset 224
00000400:00000200:19.0:1773851891.965912:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18928@kfi7
00000400:00000200:19.0:1773851891.965913:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18928@kfi7 to cpt 4
00000400:00000200:19.0:1773851891.965914:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a10505d2 nid 18928@kfi7 refs 1
00000400:00000200:19.0:1773851891.965915:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a10505d2 nid 18928@kfi7 refs 2
00000400:00000200:19.0:1773851891.965916:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a10505d2 nid 18928@kfi7 refs 3
00000400:00000200:19.0:1773851891.965917:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18928@kfi7 local destination
00000400:00000200:19.0:1773851891.965918:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770024:8770024:1024:4294967295] 18928@kfi7 LPNI seq info [1298120:1298120:16:4294967295]
00000400:00000200:19.0:1773851891.965920:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a10505d2 nid 18928@kfi7 refs 2
00000400:00000200:19.0:1773851891.965920:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18928@kfi7 to cpt 4
00000400:00000200:19.0:1773851891.965922:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18928@kfi7(18928@kfi7:18928@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851891.965923:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a10505d2 nid 18928@kfi7 refs 3
00000800:00000200:19.0:1773851891.965924:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851891.965925:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851891.965927:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851891.965931:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000f06 Using peer 18928@kfi7(0x100000000000f06)
00000800:00000200:19.0:1773851891.965934:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0x100000000000f06: rc=0
00000800:00000200:19.0:1773851891.965935:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000f06 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851891.965937:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851891.965938:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005b8f6260 refcount 2 to 18929@kfi7
00010000:00000001:19.0:1773851891.965938:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851891.965939:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851891.965939:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851891.965940:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000170ee750 x1859597973870656/t0(0) o400->8c0aa40b-07cf-4cf3-9a54-74ee0e3db425@18929@kfi7:143/0 lens 224/224 e 0 to 0 dl 1773852258 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1661-0'
00000100:00100000:19.0:1773851891.965943:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000170ee750 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8c0aa40b-07cf-4cf3-9a54-74ee0e3db425+5:39700:x1859597973870656:12345-18929@kfi7:400:default-tuolumne1661-0 Request processed in 55us (84us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851891.965945:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18929@kfi7, seq: 2156412
00000100:00000040:19.0:1773851891.965946:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000048c86941 : new rpc_count 0
00000100:00000001:19.0:1773851891.965946:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851891.965947:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851891.965947:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851891.965947:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000f06 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851891.965948:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000400:00000200:17.0:1773851891.965948:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851891.965949:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000020:00000040:19.0:1773851891.965949:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000048c86941 : new refcount 4
00000400:00000200:17.0:1773851891.965949:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18928@kfi7: PUT: OK
00000100:00000001:19.0:1773851891.965950:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851891.965950:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000851767a5
00000400:00000010:17.0:1773851891.965950:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000851767a5.
00000100:00000001:17.0:1773851891.965951:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851891.965951:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851891.965952:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a10505d2 nid 18928@kfi7 refs 2
00000800:00000200:17.0:1773851891.965953:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2054@kfi7:4 -> 18928@kfi7(00000000431b2fe8):0x0 lsk 3847 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000f06 Transaction freed
00000800:00000200:22.0:1773851891.982889:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851891.982890:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851891.982892:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851891.982894:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851891.982896:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851891.982897:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:22.0:1773851891.982898:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851891.982899:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:22.0:1773851891.982900:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851891.982901:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:22.0:1773851891.982902:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:22.0:1773851891.982902:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:22.0:1773851891.982903:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee26540
00000400:00000200:22.0:1773851891.982905:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 7880
00000800:00000200:22.0:1773851891.982908:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851891.982909:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851891.982910:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000100:00000001:22.0:1773851891.982911:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851891.982911:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:22.0:1773851891.982913:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1eaf750.
00000100:00000040:22.0:1773851891.982913:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000e1eaf750 x1858059204977984 msgsize 224
00000100:00100000:22.0:1773851891.982915:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2081@kfi7)
00000100:00000001:22.0:1773851891.982916:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851891.982917:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:20.0:1773851891.982917:0:1537152:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:22.0:1773851891.982918:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851891.982918:0:1537152:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851891.982918:0:1537152:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851891.982919:0:1537152:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851891.982920:0:1537152:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851891.982920:0:1537152:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204977984
00000020:00000001:20.0:1773851891.982921:0:1537152:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851891.982921:0:1537152:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:20.0:1773851891.982922:0:1537152:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851891.982923:0:1537152:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:20.0:1773851891.982924:0:1537152:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:20.0:1773851891.982925:0:1537152:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:20.0:1773851891.982926:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.982926:0:1537152:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851891.982927:0:1537152:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851891.982928:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851891.982929:0:1537152:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000032ef7456.
00000100:00000040:20.0:1773851891.982930:0:1537152:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:20.0:1773851891.982930:0:1537152:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851891.982931:0:1537152:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851891.982931:0:1537152:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.982932:0:1537152:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.982933:0:1537152:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851891.982934:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851891.982935:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851891.982935:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851891.982935:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851891.982936:0:1537152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 3084763
00000100:00000040:20.0:1773851891.982936:0:1537152:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:22.0:1773851891.982937:0:1537183:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:22.0:1773851891.982937:0:1537183:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.982937:0:1537152:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382198144 : -106946327353472 : ffff9ebb9e25e780)
00000100:00000040:20.0:1773851891.982938:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e1eaf750 x1858059204977984/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:618/0 lens 224/0 e 0 to 0 dl 1773851978 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:20.0:1773851891.982941:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851891.982941:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851891.982942:0:1537152:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1eaf750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204977984:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:20.0:1773851891.982944:0:1537152:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204977984
00000020:00000001:20.0:1773851891.982945:0:1537152:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851891.982945:0:1537152:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851891.982946:0:1537152:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.982946:0:1537152:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851891.982947:0:1537152:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:20.0:1773851891.982948:0:1537152:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851891.982948:0:1537152:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851891.982949:0:1537152:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851891.982949:0:1537152:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851891.982950:0:1537152:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.982951:0:1537152:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851891.982951:0:1537152:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851891.982952:0:1537152:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000086d11916.
02000000:00000001:20.0:1773851891.982953:0:1537152:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.982953:0:1537152:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851891.982954:0:1537152:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:20.0:1773851891.982954:0:1537152:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:20.0:1773851891.982955:0:1537152:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:20.0:1773851891.982955:0:1537152:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 176947200 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:20.0:1773851891.982956:0:1537152:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966131557 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:20.0:1773851891.982958:0:1537152:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851891.982958:0:1537152:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204977984
00010000:00000001:20.0:1773851891.982959:0:1537152:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851891.982960:0:1537152:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e1eaf750 x1858059204977984/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:20.0:1773851891.982962:0:1537152:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851891.982963:0:1537152:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851891.982963:0:1537152:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=115 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851891.982965:0:1537152:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851891.982965:0:1537152:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:20.0:1773851891.982966:0:1537152:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:20.0:1773851891.982967:0:1537152:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851891.982968:0:1537152:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851891.982968:0:1537152:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851891.982969:0:1537152:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2081@kfi7
00000400:00000010:20.0:1773851891.982970:0:1537152:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000010ff00e2.
00000100:00000200:20.0:1773851891.982970:0:1537152:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204977984, offset 224
00000400:00000200:20.0:1773851891.982972:0:1537152:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2081@kfi7
00000400:00000200:20.0:1773851891.982972:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.982973:0:1537152:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:20.0:1773851891.982974:0:1537152:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:20.0:1773851891.982975:0:1537152:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:20.0:1773851891.982976:0:1537152:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2081@kfi7 local destination
00000400:00000200:20.0:1773851891.982978:0:1537152:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770025:8770025:1024:4294967295] 2081@kfi7 LPNI seq info [23425176:23425176:16:4294967295]
00000400:00000200:20.0:1773851891.982979:0:1537152:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:20.0:1773851891.982980:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:20.0:1773851891.982981:0:1537152:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2081@kfi7(2081@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851891.982983:0:1537152:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000800:00000200:20.0:1773851891.982984:0:1537152:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851891.982985:0:1537152:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:20.0:1773851891.982987:0:1537152:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851891.982989:0:1537152:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 Using peer 2081@kfi7(0x200000000000275)
00000800:00000200:20.0:1773851891.982992:0:1537152:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 468 bytes to peer 0x200000000000275: rc=0
00000800:00000200:20.0:1773851891.982993:0:1537152:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851891.982995:0:1537152:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851891.982996:0:1537152:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:20.0:1773851891.982997:0:1537152:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851891.982997:0:1537152:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851891.982998:0:1537152:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851891.983000:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1eaf750 x1858059204977984/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:618/0 lens 224/368 e 0 to 0 dl 1773851978 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:20.0:1773851891.983003:0:1537152:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1eaf750 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059204977984:12345-2074@kfi7:41:default-yuba4-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851891.983005:0:1537152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 3084763
00000100:00000040:20.0:1773851891.983006:0:1537152:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:20.0:1773851891.983007:0:1537152:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851891.983008:0:1537152:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851891.983008:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851891.983009:0:1537152:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000032ef7456.
00000020:00000010:20.0:1773851891.983010:0:1537152:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000020:00000040:20.0:1773851891.983010:0:1537152:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:20.0:1773851891.983011:0:1537152:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851891.983016:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851891.983017:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851891.983018:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000400:00000200:22.0:1773851891.983019:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000010ff00e2
00000400:00000010:22.0:1773851891.983020:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000010ff00e2.
00000100:00000001:22.0:1773851891.983020:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851891.983021:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851891.983022:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:22.0:1773851891.983023:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 Transaction freed
00000004:00000001:7.0:1773851892.041731:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851892.041732:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851892.041733:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f71c1f0.
00000020:00000040:7.0:1773851892.041735:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851892.041736:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851892.041737:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851892.041738:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851892.041740:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000de2ed169.
00000100:00000001:7.0:1773851892.041742:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.041743:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851892.041744:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.041746:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007f71c1f0] to pc [ptlrpcd_01_03+3]  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851892.041754:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851892.041754:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851892.041755:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851892.041755:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851892.041755:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:7.0:1773851892.041756:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000014138aa3.
00000100:00000001:5.0:1773851892.041756:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851892.041756:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851892.041758:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637000892841984 : -107072816709632 : ffff9e9e2acb8000)
00080000:00000001:7.0:1773851892.041759:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851892.041759:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851892.041759:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851892.041760:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:7.0:1773851892.041761:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851892.041761:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851892.041761:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051938176:2099@kfi7:13:default-yuba2-0
00000004:00001000:7.0:1773851892.041762:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000100:00000001:4.0:1773851892.041763:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851892.041763:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000010:7.0:1773851892.041764:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002bb715ca.
02000000:00000001:4.0:1773851892.041764:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:7.0:1773851892.041765:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614166495040795ns, next at 614167495038911ns, rc = 0
02000000:00000001:4.0:1773851892.041765:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:7.0:1773851892.041767:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000010:4.0:1773851892.041767:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e54f7a48.
02000000:00000001:4.0:1773851892.041767:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851892.041769:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:4.0:1773851892.041769:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00080000:00000001:7.0:1773851892.041770:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:4.0:1773851892.041770:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f5d265c4.
00000004:00000001:7.0:1773851892.041771:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851892.041771:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938176, portal 4
00000100:00000001:4.0:1773851892.041772:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851892.041773:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309147776 : -106994400403840 : ffff9eb06cc55e80)
00000100:00000040:4.0:1773851892.041774:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851892.041776:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851892.041777:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:4.0:1773851892.041778:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d6fd271.
00000100:00000200:4.0:1773851892.041778:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938176, offset 0
00000400:00000200:4.0:1773851892.041780:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:4.0:1773851892.041781:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851892.041782:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:4.0:1773851892.041783:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851892.041784:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:4.0:1773851892.041786:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:4.0:1773851892.041788:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770023, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770025, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851892.041790:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851892.041791:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851892.041792:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:4.0:1773851892.041793:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770026:8770026:1024:4294967295] 2099@kfi7 LPNI seq info [5403436:5403436:16:4294967295]
00000400:00000200:4.0:1773851892.041794:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:4.0:1773851892.041795:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:4.0:1773851892.041797:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851892.041799:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:4.0:1773851892.041800:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851892.041802:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851892.041804:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851892.041806:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Using peer 2099@kfi7(0x2c1)
00000800:00000200:4.0:1773851892.041809:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x2c1: rc=0
00000800:00000200:4.0:1773851892.041811:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851892.041813:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.041814:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851892.041815:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.041815:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.041816:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.041819:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851892.041819:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851892.041820:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851892.041820:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851892.041824:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851892.041824:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.041824:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851892.041826:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851892.041827:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851892.041828:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d6fd271
00000400:00000010:5.0:1773851892.041828:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d6fd271.
00000100:00000001:5.0:1773851892.041829:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851892.041830:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851892.041833:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851892.041834:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851892.041836:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851892.041837:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851892.041838:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851892.041839:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Transaction freed
00000800:00000200:17.0:1773851892.041872:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851892.041873:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851892.041874:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851892.041877:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851892.041878:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.041879:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851892.041880:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.041881:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851892.041882:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.041882:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851892.041883:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851892.041884:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.041885:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5d80
00000400:00000200:17.0:1773851892.041886:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.041887:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f1fd1 [1] + 224
00000800:00000200:17.0:1773851892.041889:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851892.041891:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851892.041892:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851892.041893:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851892.041894:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851892.041897:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851892.041900:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851892.041901:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:17.0:1773851892.041902:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851892.041902:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851892.041903:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:4.0:1773851892.041904:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851892.041904:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851892.041905:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851892.041906:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f5d265c4
00000400:00000010:4.0:1773851892.041907:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f5d265c4.
00000100:00000001:4.0:1773851892.041907:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851892.041908:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851892.041911:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851892.041914:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851892.041914:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.041915:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851892.041915:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851892.041916:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851892.041916:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851892.041917:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851892.041918:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=125 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851892.041919:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=125 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851892.041920:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851892.041921:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851892.041921:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851892.041922:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.041923:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851892.041923:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:4.0:1773851892.041924:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851892.041924:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851892.041925:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851892.041927:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851892.041928:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851892.041929:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851892.041929:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851892.041930:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851892.041931:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409081344 avail=351407090688 avail_mb=1372683948 hwm_mb=3131101 files=372011194 ffree=343172931 state=0: rc = 0
00000004:00000020:4.0:1773851892.041933:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409081344 free, 351407090688 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011194 files, 343172931 free files
00000004:00000001:4.0:1773851892.041935:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851892.041936:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851892.041939:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007f71c1f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051938176:2099@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851892.041940:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.041941:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851892.041942:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007f71c1f0 x1859433051938176/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851892.041944:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851892.041944:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851892.041945:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e54f7a48.
02000000:00000001:4.0:1773851892.041946:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851892.041947:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851892.041947:0:41067:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:4.0:1773851892.041948:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851892.041948:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000de2ed169.
02000000:00000001:4.0:1773851892.041949:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851892.041950:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851892.041950:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007f71c1f0.
00000100:00000001:4.0:1773851892.041951:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851892.041951:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.041952:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.041952:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851892.041953:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.041953:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851892.041954:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851892.080107:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851892.080108:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851892.080110:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851892.080113:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851892.080117:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26048@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.080119:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26048@kfi7 : PUT - for me
00000400:00000200:5.0:1773851892.080120:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26048@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.080122:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cd2a855 nid 26048@kfi7 refs 1
00000400:00000200:5.0:1773851892.080124:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26048@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.080125:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cd2a855 nid 26048@kfi7 refs 2
00000400:00000200:5.0:1773851892.080126:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001cd2a855 nid 26048@kfi7 refs 3
00000400:00000200:5.0:1773851892.080128:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25857@kfi7 to cpt 2
00000400:00000200:5.0:1773851892.080129:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25857@kfi7 of length 224 into portal 12 MB=0x699e1589eed40
00000400:00000200:5.0:1773851892.080132:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25857@kfi7 of length 224/224 into md 0x793926dc5 [64] + 160832
00000800:00000200:5.0:1773851892.080135:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851892.080140:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851892.080142:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26048@kfi7: PUT: OK
00000100:00000001:5.0:1773851892.080144:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851892.080144:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851892.080146:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f8e85270.
00000100:00000040:5.0:1773851892.080147:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000f8e85270 x1858042993765696 msgsize 224
00000100:00100000:5.0:1773851892.080150:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25857@kfi7 (source: 12345-26048@kfi7)
00000100:00000001:5.0:1773851892.080152:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851892.080153:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001cd2a855 nid 26048@kfi7 refs 2
00000100:00000001:4.0:1773851892.080154:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851892.080155:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851892.080156:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851892.080156:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851892.080157:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851892.080158:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851892.080160:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042993765696
00000020:00000001:4.0:1773851892.080161:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851892.080162:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9173f
00000020:00000001:4.0:1773851892.080163:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851892.080166:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000641dedc1 refcount=10
00000020:00000001:4.0:1773851892.080167:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241487360 : -107152468064256 : ffff9e8b9f344800)
00000020:00000001:4.0:1773851892.080168:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241487360 : -107152468064256 : ffff9e8b9f344800)
00000100:00000001:4.0:1773851892.080169:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851892.080170:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851892.080171:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dbc2712d.
00000020:00000010:4.0:1773851892.080173:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851892.080174:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002747847d.
00000100:00000001:4.0:1773851892.080177:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851892.080177:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851892.080178:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.080180:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851892.080181:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851892.080181:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.080183:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.080185:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851892.080186:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851892.080186:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851892.080186:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851892.080188:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25857@kfi7, seq: 2001979
00000100:00000040:4.0:1773851892.080189:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000641dedc1 : new rpc_count 1
00000100:00000001:7.0:1773851892.080190:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.080190:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637064997314432 : -107008712237184 : ffff9ead17b81f80)
00000100:00000001:7.0:1773851892.080191:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851892.080192:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f8e85270 x1858042993765696/t0(0) o400->baccdf4e-4de5-4940-99b1-2123b10f8269@25857@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2115-0'
00000100:00000001:4.0:1773851892.080197:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851892.080197:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851892.080199:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f8e85270 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:baccdf4e-4de5-4940-99b1-2123b10f8269+10:39658:x1858042993765696:12345-25857@kfi7:400:default-tuolumne2115-0
00000100:00000200:4.0:1773851892.080201:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042993765696
00000020:00000001:4.0:1773851892.080202:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851892.080203:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851892.080208:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851892.080209:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851892.080209:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851892.080211:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851892.080212:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042993765696, found 0 last_xid 1858042993765695
00000020:00000001:4.0:1773851892.080213:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851892.080214:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851892.080215:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851892.080216:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851892.080217:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851892.080218:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851892.080219:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851892.080220:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000371b83f3.
02000000:00000001:4.0:1773851892.080221:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.080222:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851892.080223:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851892.080224:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260613537, transno 0, xid 1858042993765696
00010000:00000001:4.0:1773851892.080226:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851892.080227:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f8e85270 x1858042993765696/t0(0) o400->baccdf4e-4de5-4940-99b1-2123b10f8269@25857@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2115-0'
00010000:00000001:4.0:1773851892.080231:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851892.080232:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851892.080233:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=124 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851892.080235:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851892.080236:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e449fc24 refcount 3 to 25857@kfi7
00000100:00000001:4.0:1773851892.080237:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451712 : -107149715099904 : ffff9e8c434b2f00)
02000000:00000001:4.0:1773851892.080239:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851892.080239:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.080240:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851892.080242:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26048@kfi7
00000400:00000010:4.0:1773851892.080243:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f5d265c4.
00000100:00000200:4.0:1773851892.080244:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042993765696, offset 224
00000400:00000200:4.0:1773851892.080246:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26048@kfi7
00000400:00000200:4.0:1773851892.080248:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26048@kfi7 to cpt 1
00000400:00000200:4.0:1773851892.080249:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cd2a855 nid 26048@kfi7 refs 1
00000400:00000200:4.0:1773851892.080251:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001cd2a855 nid 26048@kfi7 refs 2
00000400:00000200:4.0:1773851892.080253:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001cd2a855 nid 26048@kfi7 refs 3
00000400:00000200:4.0:1773851892.080255:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26048@kfi7 local destination
00000400:00000200:4.0:1773851892.080257:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770027:8770027:1024:4294967295] 26048@kfi7 LPNI seq info [186951:186951:16:4294967295]
00000400:00000200:4.0:1773851892.080259:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001cd2a855 nid 26048@kfi7 refs 2
00000400:00000200:4.0:1773851892.080260:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26048@kfi7 to cpt 1
00000400:00000200:4.0:1773851892.080263:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26048@kfi7(26048@kfi7:26048@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851892.080265:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001cd2a855 nid 26048@kfi7 refs 3
00000800:00000200:4.0:1773851892.080268:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851892.080269:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851892.080273:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851892.080276:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd99 Using peer 26048@kfi7(0xd99)
00000800:00000200:4.0:1773851892.080281:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0xd99: rc=0
00000800:00000200:4.0:1773851892.080283:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd99 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851892.080286:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851892.080287:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e449fc24 refcount 2 to 25857@kfi7
00010000:00000001:4.0:1773851892.080288:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851892.080289:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851892.080292:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851892.080293:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f8e85270 x1858042993765696/t0(0) o400->baccdf4e-4de5-4940-99b1-2123b10f8269@25857@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2115-0'
00000100:00100000:4.0:1773851892.080298:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f8e85270 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:baccdf4e-4de5-4940-99b1-2123b10f8269+10:39658:x1858042993765696:12345-25857@kfi7:400:default-tuolumne2115-0 Request processed in 100us (150us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851892.080302:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25857@kfi7, seq: 2001979
00000100:00000040:4.0:1773851892.080303:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000641dedc1 : new rpc_count 0
00000100:00000001:4.0:1773851892.080305:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851892.080306:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851892.080307:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851892.080308:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002747847d.
00000020:00000010:4.0:1773851892.080310:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dbc2712d.
00000020:00000040:4.0:1773851892.080311:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000641dedc1 : new refcount 9
00000100:00000001:4.0:1773851892.080312:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851892.080320:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd99 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851892.080322:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851892.080324:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26048@kfi7: PUT: OK
00000400:00000200:5.0:1773851892.080325:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f5d265c4
00000400:00000010:5.0:1773851892.080326:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f5d265c4.
00000100:00000001:5.0:1773851892.080327:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851892.080327:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851892.080329:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001cd2a855 nid 26048@kfi7 refs 2
00000800:00000200:5.0:1773851892.080331:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 26048@kfi7(00000000b1aa576a):0x0 lsk 3482 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd99 Transaction freed
00000800:00000200:21.0:1773851892.094187:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851892.094188:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851892.094189:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851892.094191:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851892.094193:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19360@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.094194:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19360@kfi7 : PUT - for me
00000400:00000200:21.0:1773851892.094194:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19360@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.094195:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002955561a nid 19360@kfi7 refs 1
00000400:00000200:21.0:1773851892.094197:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19360@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.094197:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002955561a nid 19360@kfi7 refs 2
00000400:00000200:21.0:1773851892.094198:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002955561a nid 19360@kfi7 refs 3
00000400:00000200:21.0:1773851892.094199:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19360@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.094200:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19360@kfi7 of length 224 into portal 12 MB=0x699e0f14e4e00
00000400:00000200:21.0:1773851892.094201:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19360@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 59784
00000800:00000200:21.0:1773851892.094203:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851892.094206:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.094207:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19360@kfi7: PUT: OK
00000100:00000001:21.0:1773851892.094208:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851892.094208:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851892.094209:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fd85439e.
00000100:00000040:21.0:1773851892.094210:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000fd85439e x1858041260428800 msgsize 224
00000100:00100000:21.0:1773851892.094211:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-19360@kfi7 (source: 12345-19360@kfi7)
00000100:00000001:21.0:1773851892.094212:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851892.094213:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002955561a nid 19360@kfi7 refs 2
00000100:00000001:23.0:1773851892.094214:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851892.094214:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851892.094214:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851892.094215:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851892.094215:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851892.094216:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851892.094217:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041260428800
00000020:00000001:23.0:1773851892.094218:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851892.094218:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9250e
00000020:00000001:23.0:1773851892.094219:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851892.094221:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bae36e7b refcount=7
00000020:00000001:23.0:1773851892.094222:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630787072 : -107123078764544 : ffff9e9276f16800)
00000020:00000001:23.0:1773851892.094223:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630787072 : -107123078764544 : ffff9e9276f16800)
00000100:00000001:23.0:1773851892.094224:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851892.094225:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851892.094225:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000d6a466b.
00000020:00000010:23.0:1773851892.094226:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851892.094227:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851892.094228:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851892.094228:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851892.094229:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.094230:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851892.094230:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851892.094231:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.094232:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.094233:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851892.094233:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851892.094233:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851892.094234:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19360@kfi7, seq: 1998059
00000100:00000001:20.0:1773851892.094234:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851892.094235:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bae36e7b : new rpc_count 1
00000100:00000001:20.0:1773851892.094235:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.094236:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117667749120 : -106956041802496 : ffff9eb95b1f2d00)
00000100:00000001:20.0:1773851892.094236:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851892.094237:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fd85439e x1858041260428800/t0(0) o400->4f4ebf62-fc76-48b9-828c-5077580e0bb5@19360@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1696-0'
00000100:00000001:23.0:1773851892.094242:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851892.094243:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851892.094244:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fd85439e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4f4ebf62-fc76-48b9-828c-5077580e0bb5+7:39616:x1858041260428800:12345-19360@kfi7:400:default-tuolumne1696-0
00000100:00000200:23.0:1773851892.094245:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041260428800
00000020:00000001:23.0:1773851892.094246:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851892.094246:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851892.094247:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.094248:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851892.094248:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851892.094249:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851892.094250:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041260428800, found 0 last_xid 1858041260428799
00000020:00000001:23.0:1773851892.094251:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851892.094252:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851892.094252:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851892.094252:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.094253:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851892.094254:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851892.094255:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851892.094255:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000ae3b07a.
02000000:00000001:23.0:1773851892.094256:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.094257:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.094257:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851892.094258:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260407007, transno 0, xid 1858041260428800
00010000:00000001:23.0:1773851892.094259:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851892.094260:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fd85439e x1858041260428800/t0(0) o400->4f4ebf62-fc76-48b9-828c-5077580e0bb5@19360@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1696-0'
00010000:00000001:23.0:1773851892.094262:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851892.094262:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851892.094263:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=125 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851892.094264:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851892.094265:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000287441d2 refcount 3 to 19360@kfi7
00000100:00000001:23.0:1773851892.094266:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964028256 : -107156745523360 : ffff9e8aa03f6f60)
02000000:00000001:23.0:1773851892.094267:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851892.094267:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.094268:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851892.094269:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19360@kfi7
00000400:00000010:23.0:1773851892.094269:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000598e4ceb.
00000100:00000200:23.0:1773851892.094270:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041260428800, offset 224
00000400:00000200:23.0:1773851892.094271:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19360@kfi7
00000400:00000200:23.0:1773851892.094272:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19360@kfi7 to cpt 5
00000400:00000200:23.0:1773851892.094273:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002955561a nid 19360@kfi7 refs 1
00000400:00000200:23.0:1773851892.094274:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002955561a nid 19360@kfi7 refs 2
00000400:00000200:23.0:1773851892.094275:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002955561a nid 19360@kfi7 refs 3
00000400:00000200:23.0:1773851892.094276:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19360@kfi7 local destination
00000400:00000200:23.0:1773851892.094277:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770028:8770028:1024:4294967295] 19360@kfi7 LPNI seq info [1660398:1660398:16:4294967295]
00000400:00000200:23.0:1773851892.094278:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002955561a nid 19360@kfi7 refs 2
00000400:00000200:23.0:1773851892.094279:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19360@kfi7 to cpt 5
00000400:00000200:23.0:1773851892.094281:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19360@kfi7(19360@kfi7:19360@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851892.094282:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002955561a nid 19360@kfi7 refs 3
00000800:00000200:23.0:1773851892.094283:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851892.094284:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851892.094287:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851892.094289:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000996 Using peer 19360@kfi7(0x100000000000996)
00000800:00000200:23.0:1773851892.094292:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x100000000000996: rc=0
00000800:00000200:23.0:1773851892.094293:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000996 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851892.094295:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851892.094296:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000287441d2 refcount 2 to 19360@kfi7
00010000:00000001:23.0:1773851892.094297:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851892.094298:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.094298:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851892.094299:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fd85439e x1858041260428800/t0(0) o400->4f4ebf62-fc76-48b9-828c-5077580e0bb5@19360@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1696-0'
00000100:00100000:23.0:1773851892.094302:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fd85439e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4f4ebf62-fc76-48b9-828c-5077580e0bb5+7:39616:x1858041260428800:12345-19360@kfi7:400:default-tuolumne1696-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851892.094304:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19360@kfi7, seq: 1998059
00000800:00000200:22.0:1773851892.094304:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000996 TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851892.094305:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bae36e7b : new rpc_count 0
00000400:00000200:22.0:1773851892.094305:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851892.094306:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851892.094306:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:22.0:1773851892.094306:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19360@kfi7: PUT: OK
00000020:00000010:23.0:1773851892.094307:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851892.094307:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000400:00000200:22.0:1773851892.094307:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000598e4ceb
00000400:00000010:22.0:1773851892.094307:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000598e4ceb.
00000020:00000010:23.0:1773851892.094308:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000d6a466b.
00000100:00000001:22.0:1773851892.094308:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851892.094308:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:23.0:1773851892.094309:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000bae36e7b : new refcount 6
00000400:00000200:22.0:1773851892.094309:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002955561a nid 19360@kfi7 refs 2
00000100:00000001:23.0:1773851892.094310:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851892.094310:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 19360@kfi7(0000000019575d3a):0x0 lsk 2455 rsk 52 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000996 Transaction freed
00000800:00000200:21.0:1773851892.115211:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851892.115212:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851892.115213:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851892.115215:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851892.115217:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10896@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.115218:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10896@kfi7 : PUT - for me
00000400:00000200:21.0:1773851892.115219:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10896@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.115220:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066add54e nid 10896@kfi7 refs 1
00000400:00000200:21.0:1773851892.115221:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10896@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.115222:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066add54e nid 10896@kfi7 refs 2
00000400:00000200:21.0:1773851892.115222:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000066add54e nid 10896@kfi7 refs 3
00000400:00000200:21.0:1773851892.115223:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10833@kfi7 to cpt 4
00000400:00000200:21.0:1773851892.115224:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10833@kfi7 of length 224 into portal 12 MB=0x699e12e043000
00000400:00000200:21.0:1773851892.115225:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10833@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 60008
00000800:00000200:21.0:1773851892.115227:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851892.115228:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.115229:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10896@kfi7: PUT: OK
00000100:00000001:21.0:1773851892.115231:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851892.115231:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851892.115233:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000061ea7d1f.
00000100:00000040:21.0:1773851892.115233:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000061ea7d1f x1858042278981632 msgsize 224
00000100:00100000:21.0:1773851892.115235:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-10833@kfi7 (source: 12345-10896@kfi7)
00000100:00000001:21.0:1773851892.115235:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851892.115236:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000066add54e nid 10896@kfi7 refs 2
00000100:00000001:23.0:1773851892.115237:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851892.115237:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851892.115238:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851892.115238:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851892.115238:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851892.115239:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851892.115239:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042278981632
00000020:00000001:23.0:1773851892.115240:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851892.115240:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917a8
00000020:00000001:23.0:1773851892.115241:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851892.115244:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a3068c0 refcount=6
00000020:00000001:23.0:1773851892.115244:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241761792 : -107152467789824 : ffff9e8b9f387800)
00000020:00000001:23.0:1773851892.115245:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241761792 : -107152467789824 : ffff9e8b9f387800)
00000100:00000001:23.0:1773851892.115246:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851892.115247:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851892.115247:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000d6a466b.
00000020:00000010:23.0:1773851892.115248:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851892.115248:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851892.115249:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851892.115250:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851892.115250:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.115251:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851892.115251:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851892.115252:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.115252:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.115253:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851892.115254:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851892.115254:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851892.115254:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851892.115255:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10833@kfi7, seq: 1998060
00000100:00000040:23.0:1773851892.115255:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a3068c0 : new rpc_count 1
00000100:00000001:20.0:1773851892.115255:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.115256:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134769007872 : -106938940543744 : ffff9ebd566fad00)
00000100:00000001:20.0:1773851892.115256:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851892.115257:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000061ea7d1f x1858042278981632/t0(0) o400->a95501f9-3a0f-4dd3-8635-e2f60adfbfb7@10833@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1170-0'
00000100:00000001:23.0:1773851892.115260:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851892.115260:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851892.115261:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000061ea7d1f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:a95501f9-3a0f-4dd3-8635-e2f60adfbfb7+6:39745:x1858042278981632:12345-10833@kfi7:400:default-tuolumne1170-0
00000100:00000200:23.0:1773851892.115262:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042278981632
00000020:00000001:23.0:1773851892.115263:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851892.115263:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851892.115264:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.115264:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851892.115264:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851892.115265:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851892.115266:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042278981632, found 0 last_xid 1858042278981631
00000020:00000001:23.0:1773851892.115266:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851892.115267:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851892.115267:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851892.115268:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.115268:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851892.115268:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851892.115269:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851892.115269:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c7a1431d.
02000000:00000001:23.0:1773851892.115270:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.115271:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.115272:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851892.115272:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183155514118, transno 0, xid 1858042278981632
00010000:00000001:23.0:1773851892.115273:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851892.115274:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000061ea7d1f x1858042278981632/t0(0) o400->a95501f9-3a0f-4dd3-8635-e2f60adfbfb7@10833@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1170-0'
00010000:00000001:23.0:1773851892.115276:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851892.115276:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851892.115277:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=125 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851892.115278:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851892.115278:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000428a26e2 refcount 3 to 10833@kfi7
00000100:00000001:23.0:1773851892.115279:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516992 : -107156126034624 : ffff9e8ac52c1540)
02000000:00000001:23.0:1773851892.115280:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851892.115280:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.115281:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851892.115281:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10896@kfi7
00000400:00000010:23.0:1773851892.115282:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a342ba58.
00000100:00000200:23.0:1773851892.115282:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042278981632, offset 224
00000400:00000200:23.0:1773851892.115284:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10896@kfi7
00000400:00000200:23.0:1773851892.115284:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10896@kfi7 to cpt 5
00000400:00000200:23.0:1773851892.115285:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000066add54e nid 10896@kfi7 refs 1
00000400:00000200:23.0:1773851892.115286:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000066add54e nid 10896@kfi7 refs 2
00000400:00000200:23.0:1773851892.115287:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000066add54e nid 10896@kfi7 refs 3
00000400:00000200:23.0:1773851892.115288:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10896@kfi7 local destination
00000400:00000200:23.0:1773851892.115289:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770029:8770029:1024:4294967295] 10896@kfi7 LPNI seq info [397251:397251:16:4294967295]
00000400:00000200:23.0:1773851892.115291:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000066add54e nid 10896@kfi7 refs 2
00000400:00000200:23.0:1773851892.115291:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10896@kfi7 to cpt 5
00000400:00000200:23.0:1773851892.115293:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10896@kfi7(10896@kfi7:10896@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851892.115294:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000066add54e nid 10896@kfi7 refs 3
00000800:00000200:23.0:1773851892.115295:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851892.115296:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851892.115300:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851892.115302:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1df Using peer 10896@kfi7(0x1df)
00000800:00000200:23.0:1773851892.115305:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x1df: rc=0
00000800:00000200:23.0:1773851892.115307:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851892.115308:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851892.115309:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000428a26e2 refcount 2 to 10833@kfi7
00010000:00000001:23.0:1773851892.115310:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851892.115310:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.115310:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851892.115311:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000061ea7d1f x1858042278981632/t0(0) o400->a95501f9-3a0f-4dd3-8635-e2f60adfbfb7@10833@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1170-0'
00000100:00100000:23.0:1773851892.115314:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000061ea7d1f pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:a95501f9-3a0f-4dd3-8635-e2f60adfbfb7+6:39745:x1858042278981632:12345-10833@kfi7:400:default-tuolumne1170-0 Request processed in 53us (80us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851892.115316:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10833@kfi7, seq: 1998060
00000100:00000040:23.0:1773851892.115317:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a3068c0 : new rpc_count 0
00000100:00000001:23.0:1773851892.115317:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851892.115318:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851892.115318:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851892.115319:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:23.0:1773851892.115319:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000d6a466b.
00000800:00000200:21.0:1773851892.115319:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1df TN_EVENT_TX_OK event status 0
00000020:00000040:23.0:1773851892.115320:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000001a3068c0 : new refcount 5
00000100:00000001:23.0:1773851892.115320:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851892.115320:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.115321:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10896@kfi7: PUT: OK
00000400:00000200:21.0:1773851892.115322:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a342ba58
00000400:00000010:21.0:1773851892.115322:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a342ba58.
00000100:00000001:21.0:1773851892.115323:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851892.115323:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851892.115324:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000066add54e nid 10896@kfi7 refs 2
00000800:00000200:21.0:1773851892.115325:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2069@kfi7:5 -> 10896@kfi7(0000000012f0c1b1):0x0 lsk 480 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1df Transaction freed
00000800:00000200:9.0:1773851892.163219:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.163220:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.163221:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.163223:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.163225:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.163226:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24315@kfi7 : PUT - for me
00000400:00000200:9.0:1773851892.163227:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.163227:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 1
00000400:00000200:9.0:1773851892.163228:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.163229:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000400:00000200:9.0:1773851892.163230:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 3
00000400:00000200:9.0:1773851892.163231:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24314@kfi7 to cpt 7
00000400:00000200:9.0:1773851892.163232:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24314@kfi7 of length 224 into portal 12 MB=0x699de8da75e40
00000400:00000200:9.0:1773851892.163233:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24314@kfi7 of length 224/224 into md 0x78146ce49 [64] + 156312
00000800:00000200:9.0:1773851892.163234:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.163236:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.163237:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24315@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.163238:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.163239:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.163240:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d2a6b649.
00000100:00000040:9.0:1773851892.163241:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d2a6b649 x1858030998609472 msgsize 224
00000100:00100000:9.0:1773851892.163242:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24314@kfi7 (source: 12345-24315@kfi7)
00000100:00000001:9.0:1773851892.163243:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.163244:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000800:00000200:9.0:1773851892.163245:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851892.163245:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851892.163245:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851892.163246:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851892.163246:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851892.163247:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.163248:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030998609472
00000020:00000001:8.0:1773851892.163248:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851892.163249:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910f5
00000020:00000001:8.0:1773851892.163249:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851892.163252:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003064afd6 refcount=6
00000020:00000001:8.0:1773851892.163253:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240322048 : -107152469229568 : ffff9e8b9f228000)
00000020:00000001:8.0:1773851892.163254:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240322048 : -107152469229568 : ffff9e8b9f228000)
00000100:00000001:8.0:1773851892.163255:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.163256:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851892.163256:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851892.163257:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.163258:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851892.163259:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851892.163260:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851892.163260:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.163262:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851892.163262:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851892.163262:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163263:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.163264:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.163265:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.163265:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851892.163265:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851892.163266:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24314@kfi7, seq: 2130853
00000100:00000040:8.0:1773851892.163266:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003064afd6 : new rpc_count 1
00000100:00000001:9.0:1773851892.163267:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851892.163267:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163267:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637045190991744 : -107028518559872 : ffff9ea87b2b9f80)
00000100:00000040:8.0:1773851892.163269:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d2a6b649 x1858030998609472/t0(0) o400->00aa8bbd-4724-45b6-8a0b-43ed13670c72@24314@kfi7:680/0 lens 224/0 e 0 to 0 dl 1773852040 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne263-0'
00000100:00000001:8.0:1773851892.163271:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.163272:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851892.163273:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d2a6b649 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:00aa8bbd-4724-45b6-8a0b-43ed13670c72+6:47825:x1858030998609472:12345-24314@kfi7:400:default-tuolumne263-0
00000100:00000200:8.0:1773851892.163274:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030998609472
00000020:00000001:8.0:1773851892.163275:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851892.163275:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851892.163276:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163277:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851892.163277:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851892.163278:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851892.163279:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030998609472, found 0 last_xid 1858030998609471
00000020:00000001:8.0:1773851892.163279:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851892.163280:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851892.163280:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851892.163281:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163282:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851892.163282:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851892.163283:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851892.163284:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007ecf9bd7.
02000000:00000001:8.0:1773851892.163285:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163285:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163286:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851892.163287:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030998609472
00010000:00000001:8.0:1773851892.163288:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851892.163288:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d2a6b649 x1858030998609472/t0(0) o400->00aa8bbd-4724-45b6-8a0b-43ed13670c72@24314@kfi7:680/0 lens 224/224 e 0 to 0 dl 1773852040 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne263-0'
00010000:00000001:8.0:1773851892.163291:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851892.163291:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851892.163292:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=125 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851892.163293:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851892.163294:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e0937111 refcount 5 to 24314@kfi7
00000100:00000001:8.0:1773851892.163295:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272352 : -107152618279264 : ffff9e8b96402ea0)
02000000:00000001:8.0:1773851892.163295:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851892.163296:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163297:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851892.163297:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24315@kfi7
00000400:00000010:8.0:1773851892.163298:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000100:00000200:8.0:1773851892.163299:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030998609472, offset 224
00000400:00000200:8.0:1773851892.163300:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24315@kfi7
00000400:00000200:8.0:1773851892.163301:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.163301:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 1
00000400:00000200:8.0:1773851892.163302:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000400:00000200:8.0:1773851892.163303:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 3
00000400:00000200:8.0:1773851892.163305:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24315@kfi7 local destination
00000400:00000200:8.0:1773851892.163306:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770030:8770030:1024:4294967295] 24315@kfi7 LPNI seq info [24433:24433:16:4294967295]
00000400:00000200:8.0:1773851892.163307:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000400:00000200:8.0:1773851892.163308:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.163309:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24315@kfi7(24315@kfi7:24315@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851892.163311:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 3
00000800:00000200:8.0:1773851892.163312:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851892.163313:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851892.163316:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851892.163318:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x354 Using peer 24315@kfi7(0x354)
00000800:00000200:8.0:1773851892.163321:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x354: rc=0
00000800:00000200:8.0:1773851892.163323:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x354 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851892.163325:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.163326:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e0937111 refcount 4 to 24314@kfi7
00010000:00000001:8.0:1773851892.163326:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851892.163327:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163327:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851892.163328:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d2a6b649 x1858030998609472/t0(0) o400->00aa8bbd-4724-45b6-8a0b-43ed13670c72@24314@kfi7:680/0 lens 224/224 e 0 to 0 dl 1773852040 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne263-0'
00000100:00100000:8.0:1773851892.163332:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d2a6b649 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:00aa8bbd-4724-45b6-8a0b-43ed13670c72+6:47825:x1858030998609472:12345-24314@kfi7:400:default-tuolumne263-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851892.163335:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24314@kfi7, seq: 2130853
00000100:00000040:8.0:1773851892.163335:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003064afd6 : new rpc_count 0
00000100:00000001:8.0:1773851892.163336:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851892.163336:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851892.163337:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.163338:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851892.163339:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851892.163339:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000003064afd6 : new refcount 5
00000100:00000001:8.0:1773851892.163340:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.163344:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x354 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851892.163346:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.163347:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24315@kfi7: PUT: OK
00000400:00000200:9.0:1773851892.163348:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000010:9.0:1773851892.163348:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000100:00000001:9.0:1773851892.163349:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851892.163350:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.163350:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000800:00000200:9.0:1773851892.163352:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 24315@kfi7(0000000084d9272b):0x0 lsk 853 rsk 86 tsk 0 trmk 0 tmk 0 trr 2 tta 0x354 Transaction freed
00000800:00000200:9.0:1773851892.163738:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.163738:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.163739:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.163741:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.163743:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.163744:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24315@kfi7 : PUT - for me
00000400:00000200:9.0:1773851892.163745:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.163745:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 1
00000400:00000200:9.0:1773851892.163746:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.163748:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000400:00000200:9.0:1773851892.163749:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 3
00000400:00000200:9.0:1773851892.163750:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24314@kfi7 to cpt 7
00000400:00000200:9.0:1773851892.163751:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24314@kfi7 of length 224 into portal 12 MB=0x699de8da766c0
00000400:00000200:9.0:1773851892.163752:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24314@kfi7 of length 224/224 into md 0x78146ce49 [64] + 156536
00000800:00000200:9.0:1773851892.163753:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.163755:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.163755:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24315@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.163756:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.163757:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.163757:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d39dd7e0.
00000100:00000040:9.0:1773851892.163758:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d39dd7e0 x1858030998611648 msgsize 224
00000100:00100000:9.0:1773851892.163759:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24314@kfi7 (source: 12345-24315@kfi7)
00000100:00000001:9.0:1773851892.163760:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.163761:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000100:00000001:8.0:1773851892.163761:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851892.163762:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851892.163762:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851892.163762:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851892.163763:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851892.163763:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.163764:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030998611648
00000020:00000001:8.0:1773851892.163765:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851892.163765:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91364
00000020:00000001:8.0:1773851892.163766:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851892.163769:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000762e1682 refcount=6
00000020:00000001:8.0:1773851892.163770:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169313280 : -107127540238336 : ffff9e916d04b800)
00000020:00000001:8.0:1773851892.163770:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169313280 : -107127540238336 : ffff9e916d04b800)
00000100:00000001:8.0:1773851892.163771:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.163772:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851892.163772:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851892.163773:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.163773:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851892.163774:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851892.163775:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851892.163775:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.163776:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851892.163776:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851892.163776:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163777:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.163778:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.163779:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.163779:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851892.163779:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851892.163779:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24314@kfi7, seq: 2130854
00000100:00000001:9.0:1773851892.163780:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.163780:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000762e1682 : new rpc_count 1
00000100:00000001:9.0:1773851892.163781:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163781:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637045190990592 : -107028518561024 : ffff9ea87b2b9b00)
00000100:00000040:8.0:1773851892.163782:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d39dd7e0 x1858030998611648/t0(0) o400->1480c4a5-3b36-4da9-a986-7d3b4ee196d1@24314@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne263-0'
00000100:00000001:8.0:1773851892.163785:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.163785:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851892.163786:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d39dd7e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1480c4a5-3b36-4da9-a986-7d3b4ee196d1+6:47827:x1858030998611648:12345-24314@kfi7:400:default-tuolumne263-0
00000100:00000200:8.0:1773851892.163787:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030998611648
00000020:00000001:8.0:1773851892.163788:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851892.163788:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851892.163789:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163790:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851892.163790:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851892.163791:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851892.163791:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030998611648, found 0 last_xid 1858030998611647
00000020:00000001:8.0:1773851892.163792:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851892.163792:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851892.163793:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851892.163793:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163794:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851892.163794:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851892.163795:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851892.163795:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000495ce121.
02000000:00000001:8.0:1773851892.163796:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163796:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163797:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851892.163797:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030998611648
00010000:00000001:8.0:1773851892.163798:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851892.163799:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d39dd7e0 x1858030998611648/t0(0) o400->1480c4a5-3b36-4da9-a986-7d3b4ee196d1@24314@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne263-0'
00010000:00000001:8.0:1773851892.163801:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851892.163801:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851892.163802:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=125 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851892.163803:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851892.163803:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e0937111 refcount 5 to 24314@kfi7
00000100:00000001:8.0:1773851892.163804:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272352 : -107152618279264 : ffff9e8b96402ea0)
02000000:00000001:8.0:1773851892.163804:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851892.163805:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.163805:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851892.163806:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24315@kfi7
00000400:00000010:8.0:1773851892.163806:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bae78c35.
00000100:00000200:8.0:1773851892.163807:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030998611648, offset 224
00000400:00000200:8.0:1773851892.163808:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24315@kfi7
00000400:00000200:8.0:1773851892.163809:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.163809:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 1
00000400:00000200:8.0:1773851892.163810:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000400:00000200:8.0:1773851892.163812:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 3
00000400:00000200:8.0:1773851892.163813:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24315@kfi7 local destination
00000400:00000200:8.0:1773851892.163815:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770031:8770031:1024:4294967295] 24315@kfi7 LPNI seq info [24434:24434:16:4294967295]
00000400:00000200:8.0:1773851892.163816:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000400:00000200:8.0:1773851892.163817:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24315@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.163818:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24315@kfi7(24315@kfi7:24315@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851892.163819:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 3
00000800:00000200:8.0:1773851892.163821:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851892.163821:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851892.163823:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851892.163825:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ff Using peer 24315@kfi7(0x1000000000009ff)
00000800:00000200:8.0:1773851892.163828:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x1000000000009ff: rc=0
00000800:00000200:8.0:1773851892.163829:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851892.163831:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.163832:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e0937111 refcount 4 to 24314@kfi7
00010000:00000001:8.0:1773851892.163833:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851892.163833:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.163834:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851892.163834:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d39dd7e0 x1858030998611648/t0(0) o400->1480c4a5-3b36-4da9-a986-7d3b4ee196d1@24314@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne263-0'
00000100:00100000:8.0:1773851892.163838:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d39dd7e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1480c4a5-3b36-4da9-a986-7d3b4ee196d1+6:47827:x1858030998611648:12345-24314@kfi7:400:default-tuolumne263-0 Request processed in 51us (78us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851892.163840:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24314@kfi7, seq: 2130854
00000100:00000040:8.0:1773851892.163841:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000762e1682 : new rpc_count 0
00000100:00000001:8.0:1773851892.163842:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851892.163845:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851892.163845:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.163846:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851892.163846:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851892.163847:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000762e1682 : new refcount 5
00000100:00000001:8.0:1773851892.163848:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.163852:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ff TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851892.163854:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.163855:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24315@kfi7: PUT: OK
00000400:00000200:9.0:1773851892.163855:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bae78c35
00000400:00000010:9.0:1773851892.163856:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bae78c35.
00000100:00000001:9.0:1773851892.163856:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851892.163857:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.163858:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004707bedf nid 24315@kfi7 refs 2
00000800:00000200:9.0:1773851892.163859:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 24315@kfi7(00000000d52f8bbf):0x0 lsk 2560 rsk 85 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009ff Transaction freed
00000800:00000200:1.0:1773851892.181176:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851892.181178:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851892.181180:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851892.181183:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851892.181187:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:1.0:1773851892.181189:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 61@kfi7 : PUT - for me
00000400:00000200:1.0:1773851892.181191:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:1.0:1773851892.181192:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:1.0:1773851892.181194:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:1.0:1773851892.181195:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:1.0:1773851892.181196:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:1.0:1773851892.181198:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:1.0:1773851892.181199:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a87a15b80
00000400:00000200:1.0:1773851892.181202:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x7f7992401 [256] + 19632
00000800:00000200:1.0:1773851892.181205:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851892.181209:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851892.181210:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000100:00000001:1.0:1773851892.181212:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851892.181213:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:1.0:1773851892.181214:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e6323f98.
00000100:00000040:1.0:1773851892.181215:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000e6323f98 x1859388107217792 msgsize 224
00000100:00100000:1.0:1773851892.181218:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-61@kfi7)
00000100:00000001:1.0:1773851892.181220:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851892.181221:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:0.0:1773851892.181222:0:180051:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851892.181223:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851892.181223:0:180051:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851892.181224:0:180051:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851892.181225:0:180051:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851892.181226:0:180051:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851892.181227:0:180051:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107217792
00000020:00000001:0.0:1773851892.181228:0:180051:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851892.181228:0:180051:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:0.0:1773851892.181229:0:180051:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851892.181231:0:180051:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:0.0:1773851892.181232:0:180051:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:0.0:1773851892.181233:0:180051:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:0.0:1773851892.181235:0:180051:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851892.181236:0:180051:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851892.181237:0:180051:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd570b8d.
00000020:00000010:0.0:1773851892.181238:0:180051:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851892.181239:0:180051:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000040:0.0:1773851892.181241:0:180051:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:0.0:1773851892.181242:0:180051:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851892.181243:0:180051:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851892.181243:0:180051:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.181245:0:180051:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.181247:0:180051:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851892.181249:0:1203216:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851892.181249:0:180051:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851892.181249:0:180051:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851892.181250:0:1203216:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851892.181251:0:180051:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 3288273
00000100:00000001:1.0:1773851892.181252:0:1203216:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851892.181252:0:180051:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:1.0:1773851892.181253:0:1203216:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.181253:0:180051:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112264448 : -106950597287168 : ffff9eba9fa3e300)
00000100:00000040:0.0:1773851892.181255:0:180051:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e6323f98 x1859388107217792/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:0.0:1773851892.181260:0:180051:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851892.181260:0:180051:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851892.181262:0:180051:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e6323f98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_009:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388107217792:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:0.0:1773851892.181264:0:180051:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107217792
00000020:00000001:0.0:1773851892.181265:0:180051:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851892.181266:0:180051:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851892.181267:0:180051:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851892.181268:0:180051:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851892.181268:0:180051:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:0.0:1773851892.181270:0:180051:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:0.0:1773851892.181270:0:180051:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851892.181271:0:180051:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851892.181272:0:180051:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851892.181273:0:180051:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.181274:0:180051:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851892.181275:0:180051:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851892.181276:0:180051:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000006d5caef2.
02000000:00000001:0.0:1773851892.181277:0:180051:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.181278:0:180051:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851892.181280:0:180051:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:0.0:1773851892.181280:0:180051:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:0.0:1773851892.181281:0:180051:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:0.0:1773851892.181283:0:180051:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 176947200 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:0.0:1773851892.181284:0:180051:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966131557 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:0.0:1773851892.181287:0:180051:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851892.181288:0:180051:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107217792
00010000:00000001:0.0:1773851892.181289:0:180051:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851892.181290:0:180051:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e6323f98 x1859388107217792/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:619/0 lens 224/368 e 0 to 0 dl 1773851979 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:0.0:1773851892.181294:0:180051:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851892.181295:0:180051:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851892.181296:0:180051:0:(import.c:1951:at_measured()) add 1 to 00000000b7f0e4a1 time=146 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851892.181298:0:180051:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851892.181299:0:180051:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:0.0:1773851892.181300:0:180051:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:0.0:1773851892.181301:0:180051:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851892.181302:0:180051:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.181303:0:180051:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851892.181304:0:180051:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-61@kfi7
00000400:00000010:0.0:1773851892.181305:0:180051:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a92b0d66.
00000100:00000200:0.0:1773851892.181306:0:180051:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107217792, offset 224
00000400:00000200:0.0:1773851892.181309:0:180051:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-61@kfi7
00000400:00000200:0.0:1773851892.181310:0:180051:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:0.0:1773851892.181311:0:180051:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:0.0:1773851892.181313:0:180051:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:0.0:1773851892.181314:0:180051:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:0.0:1773851892.181316:0:180051:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  61@kfi7 local destination
00000400:00000200:0.0:1773851892.181318:0:180051:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770032:8770032:1024:4294967295] 61@kfi7 LPNI seq info [37492107:37492107:16:4294967295]
00000400:00000200:0.0:1773851892.181321:0:180051:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:0.0:1773851892.181322:0:180051:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:0.0:1773851892.181325:0:180051:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 61@kfi7(61@kfi7:61@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851892.181327:0:180051:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000800:00000200:0.0:1773851892.181329:0:180051:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851892.181331:0:180051:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:0.0:1773851892.181334:0:180051:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851892.181338:0:180051:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e Using peer 61@kfi7(0x20000000000081e)
00000800:00000200:0.0:1773851892.181342:0:180051:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 468 bytes to peer 0x20000000000081e: rc=0
00000800:00000200:0.0:1773851892.181345:0:180051:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851892.181351:0:180051:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851892.181352:0:180051:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:0.0:1773851892.181355:0:180051:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851892.181356:0:180051:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851892.181357:0:180051:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851892.181358:0:180051:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e6323f98 x1859388107217792/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:619/0 lens 224/368 e 0 to 0 dl 1773851979 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:0.0:1773851892.181363:0:180051:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e6323f98 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_009:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388107217792:12345-61@kfi7:41:default-yuba1-0 Request processed in 102us (147us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851892.181367:0:180051:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 3288273
00000100:00000040:0.0:1773851892.181369:0:180051:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:0.0:1773851892.181370:0:180051:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851892.181370:0:180051:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851892.181371:0:180051:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851892.181372:0:180051:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851892.181374:0:180051:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd570b8d.
00000020:00000040:0.0:1773851892.181375:0:180051:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000100:00000001:0.0:1773851892.181376:0:180051:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851892.181385:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851892.181388:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851892.181390:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000400:00000200:1.0:1773851892.181391:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a92b0d66
00000400:00000010:1.0:1773851892.181392:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a92b0d66.
00000100:00000001:1.0:1773851892.181393:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851892.181394:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851892.181395:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000800:00000200:1.0:1773851892.181398:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e Transaction freed
00000800:00000200:5.0:1773851892.185941:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851892.185942:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851892.185943:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851892.185945:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851892.185947:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17136@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.185948:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17136@kfi7 : PUT - for me
00000400:00000200:5.0:1773851892.185949:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17136@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.185950:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000efe7069d nid 17136@kfi7 refs 1
00000400:00000200:5.0:1773851892.185951:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17136@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.185952:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000efe7069d nid 17136@kfi7 refs 2
00000400:00000200:5.0:1773851892.185953:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000efe7069d nid 17136@kfi7 refs 3
00000400:00000200:5.0:1773851892.185954:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17137@kfi7 to cpt 4
00000400:00000200:5.0:1773851892.185955:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17137@kfi7 of length 224 into portal 12 MB=0x69b4b5bdf4b80
00000400:00000200:5.0:1773851892.185956:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17137@kfi7 of length 224/224 into md 0x793926dc5 [64] + 161056
00000800:00000200:5.0:1773851892.185958:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851892.185960:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851892.185961:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17136@kfi7: PUT: OK
00000100:00000001:5.0:1773851892.185961:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851892.185962:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851892.185964:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008e9e46cb.
00000100:00000040:5.0:1773851892.185965:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008e9e46cb x1859597826476928 msgsize 224
00000100:00100000:5.0:1773851892.185966:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-17137@kfi7 (source: 12345-17136@kfi7)
00000100:00000001:5.0:1773851892.185967:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851892.185968:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000efe7069d nid 17136@kfi7 refs 2
00000100:00000001:4.0:1773851892.185968:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851892.185969:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851892.185969:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851892.185969:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851892.185970:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851892.185971:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851892.185971:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597826476928
00000020:00000001:4.0:1773851892.185972:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851892.185972:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82302
00000020:00000001:4.0:1773851892.185973:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851892.185975:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000058cf5dbd refcount=5
00000020:00000001:4.0:1773851892.185975:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637149806705664 : -106923902845952 : ffff9ec0d6c0bc00)
00000020:00000001:4.0:1773851892.185976:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637149806705664 : -106923902845952 : ffff9ec0d6c0bc00)
00000100:00000001:4.0:1773851892.185977:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851892.185978:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851892.185979:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dbc2712d.
00000020:00000010:4.0:1773851892.185980:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851892.185980:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002747847d.
00000100:00000001:4.0:1773851892.185981:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851892.185981:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851892.185982:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851892.185983:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851892.185983:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851892.185984:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.185985:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851892.185986:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851892.185986:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851892.185987:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851892.185987:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851892.185988:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17137@kfi7, seq: 2001980
00000100:00000040:7.0:1773851892.185988:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000058cf5dbd : new rpc_count 1
00000100:00000001:7.0:1773851892.185989:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637088268868096 : -106985440683520 : ffff9eb282cfda00)
00000100:00000001:4.0:1773851892.185989:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.185989:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.185990:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008e9e46cb x1859597826476928/t0(0) o400->3c075cee-5042-4d75-8cc2-5061e83c6b51@17137@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1549-0'
00000100:00000001:7.0:1773851892.185993:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851892.185994:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851892.185995:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008e9e46cb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3c075cee-5042-4d75-8cc2-5061e83c6b51+5:39747:x1859597826476928:12345-17137@kfi7:400:default-tuolumne1549-0
00000100:00000200:7.0:1773851892.185996:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597826476928
00000020:00000001:7.0:1773851892.185997:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851892.185997:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851892.185998:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.185999:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851892.185999:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851892.186000:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851892.186000:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597826476928, found 0 last_xid 1859597826476927
00000020:00000001:7.0:1773851892.186001:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851892.186002:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851892.186003:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851892.186003:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.186004:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851892.186004:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851892.186005:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851892.186006:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002b9ec664.
02000000:00000001:7.0:1773851892.186007:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.186008:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.186008:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851892.186009:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256058160, transno 0, xid 1859597826476928
00010000:00000001:7.0:1773851892.186010:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851892.186010:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008e9e46cb x1859597826476928/t0(0) o400->3c075cee-5042-4d75-8cc2-5061e83c6b51@17137@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1549-0'
00010000:00000001:7.0:1773851892.186013:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851892.186013:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851892.186014:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=124 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851892.186015:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851892.186016:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000047891883 refcount 3 to 17137@kfi7
00000100:00000001:7.0:1773851892.186017:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518336 : -107156126033280 : ffff9e8ac52c1a80)
02000000:00000001:7.0:1773851892.186017:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851892.186018:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.186019:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851892.186019:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17136@kfi7
00000400:00000010:7.0:1773851892.186020:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000068cc9555.
00000100:00000200:7.0:1773851892.186021:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597826476928, offset 224
00000400:00000200:7.0:1773851892.186022:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17136@kfi7
00000400:00000200:7.0:1773851892.186023:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17136@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.186024:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000efe7069d nid 17136@kfi7 refs 1
00000400:00000200:7.0:1773851892.186025:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000efe7069d nid 17136@kfi7 refs 2
00000400:00000200:7.0:1773851892.186026:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000efe7069d nid 17136@kfi7 refs 3
00000400:00000200:7.0:1773851892.186027:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17136@kfi7 local destination
00000400:00000200:7.0:1773851892.186028:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770033:8770033:1024:4294967295] 17136@kfi7 LPNI seq info [218792:218792:16:4294967295]
00000400:00000200:7.0:1773851892.186030:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000efe7069d nid 17136@kfi7 refs 2
00000400:00000200:7.0:1773851892.186030:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17136@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.186032:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17136@kfi7(17136@kfi7:17136@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851892.186034:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000efe7069d nid 17136@kfi7 refs 3
00000800:00000200:7.0:1773851892.186035:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851892.186036:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851892.186040:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851892.186043:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1ae Using peer 17136@kfi7(0x1ae)
00000800:00000200:7.0:1773851892.186045:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x1ae: rc=0
00000800:00000200:7.0:1773851892.186047:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1ae TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851892.186049:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.186050:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000047891883 refcount 2 to 17137@kfi7
00010000:00000001:7.0:1773851892.186050:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851892.186051:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.186051:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851892.186052:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008e9e46cb x1859597826476928/t0(0) o400->3c075cee-5042-4d75-8cc2-5061e83c6b51@17137@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1549-0'
00000100:00100000:7.0:1773851892.186055:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008e9e46cb pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3c075cee-5042-4d75-8cc2-5061e83c6b51+5:39747:x1859597826476928:12345-17137@kfi7:400:default-tuolumne1549-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851892.186058:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17137@kfi7, seq: 2001980
00000800:00000200:5.0:1773851892.186058:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1ae TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851892.186059:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000058cf5dbd : new rpc_count 0
00000100:00000001:7.0:1773851892.186060:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851892.186060:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851892.186060:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851892.186061:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:7.0:1773851892.186061:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002747847d.
00000400:00000200:5.0:1773851892.186061:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17136@kfi7: PUT: OK
00000020:00000010:7.0:1773851892.186062:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dbc2712d.
00000400:00000200:5.0:1773851892.186062:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000068cc9555
00000400:00000010:5.0:1773851892.186062:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000068cc9555.
00000020:00000040:7.0:1773851892.186063:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000058cf5dbd : new refcount 4
00000100:00000001:5.0:1773851892.186063:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851892.186063:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851892.186064:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851892.186064:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000efe7069d nid 17136@kfi7 refs 2
00000800:00000200:5.0:1773851892.186066:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 17136@kfi7(00000000093d161e):0x0 lsk 431 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1ae Transaction freed
00000800:00000200:27.0:1773851892.230153:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851892.230154:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851892.230156:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:27.0:1773851892.230157:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851892.230160:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21777@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.230161:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21777@kfi7 : PUT - for me
00000400:00000200:27.0:1773851892.230162:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21777@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.230163:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a02afd0 nid 21777@kfi7 refs 1
00000400:00000200:27.0:1773851892.230163:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21777@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.230164:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a02afd0 nid 21777@kfi7 refs 2
00000400:00000200:27.0:1773851892.230165:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003a02afd0 nid 21777@kfi7 refs 3
00000400:00000200:27.0:1773851892.230166:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21969@kfi7 to cpt 1
00000400:00000200:27.0:1773851892.230167:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21969@kfi7 of length 224 into portal 12 MB=0x69aef43947780
00000400:00000200:27.0:1773851892.230168:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21969@kfi7 of length 224/224 into md 0x16159c9699 [64] + 32880
00000800:00000200:27.0:1773851892.230171:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851892.230172:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851892.230173:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21777@kfi7: PUT: OK
00000100:00000001:27.0:1773851892.230174:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851892.230175:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851892.230176:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b135396e.
00000100:00000040:27.0:1773851892.230176:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000b135396e x1859202281928576 msgsize 224
00000100:00100000:27.0:1773851892.230178:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-21969@kfi7 (source: 12345-21777@kfi7)
00000100:00000001:27.0:1773851892.230179:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851892.230180:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003a02afd0 nid 21777@kfi7 refs 2
00000100:00000001:25.0:1773851892.230180:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851892.230180:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:27.0:1773851892.230181:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002f3c3f5d: 2069@kfi7:6 <- 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851892.230181:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851892.230182:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851892.230183:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851892.230183:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859202281928576
00000020:00000001:25.0:1773851892.230184:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851892.230184:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918ab
00000020:00000001:25.0:1773851892.230185:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851892.230186:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c39a23a1 refcount=155
00000020:00000001:25.0:1773851892.230187:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241977856 : -107152467573760 : ffff9e8b9f3bc400)
00000020:00000001:25.0:1773851892.230187:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241977856 : -107152467573760 : ffff9e8b9f3bc400)
00000100:00000001:25.0:1773851892.230188:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851892.230189:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851892.230190:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d39d7b35.
00000020:00000010:25.0:1773851892.230191:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851892.230192:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f0e565fc.
00000100:00000001:25.0:1773851892.230192:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851892.230193:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851892.230193:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851892.230194:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851892.230195:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851892.230195:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.230196:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.230197:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851892.230197:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851892.230197:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851892.230198:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851892.230198:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21969@kfi7, seq: 2025164
00000100:00000001:27.0:1773851892.230199:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851892.230199:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c39a23a1 : new rpc_count 8
00000100:00000001:27.0:1773851892.230200:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.230200:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998404352 : -107053711147264 : ffff9ea29d933f00)
00000100:00000040:25.0:1773851892.230201:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b135396e x1859202281928576/t0(0) o400->1611c72a-44a8-46ec-9b45-d69e6df8c18b@21969@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1857-0'
00000100:00000001:25.0:1773851892.230203:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851892.230203:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851892.230204:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b135396e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:1611c72a-44a8-46ec-9b45-d69e6df8c18b+155:39839:x1859202281928576:12345-21969@kfi7:400:default-tuolumne1857-0
00000100:00000200:25.0:1773851892.230205:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859202281928576
00000020:00000001:25.0:1773851892.230206:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851892.230207:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851892.230207:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851892.230208:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851892.230209:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851892.230209:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851892.230210:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859202281928576, found 0 last_xid 1859202281267647
00000020:00000001:25.0:1773851892.230210:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851892.230211:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851892.230211:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851892.230212:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851892.230212:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851892.230213:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851892.230213:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851892.230214:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002035df90.
02000000:00000001:25.0:1773851892.230215:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.230215:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851892.230216:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851892.230216:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264587303, transno 0, xid 1859202281928576
00010000:00000001:25.0:1773851892.230217:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851892.230218:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b135396e x1859202281928576/t0(0) o400->1611c72a-44a8-46ec-9b45-d69e6df8c18b@21969@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1857-0'
00010000:00000001:25.0:1773851892.230220:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851892.230221:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851892.230221:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=125 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851892.230222:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851892.230223:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b27adae7 refcount 3 to 21969@kfi7
00000100:00000001:25.0:1773851892.230223:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231614048 : -107130477937568 : ffff9e90bdeafc60)
02000000:00000001:25.0:1773851892.230224:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851892.230224:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.230225:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851892.230226:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21777@kfi7
00000400:00000010:25.0:1773851892.230226:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000019f8c817.
00000100:00000200:25.0:1773851892.230227:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859202281928576, offset 224
00000400:00000200:25.0:1773851892.230228:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21777@kfi7
00000400:00000200:25.0:1773851892.230229:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21777@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.230230:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003a02afd0 nid 21777@kfi7 refs 1
00000400:00000200:25.0:1773851892.230231:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003a02afd0 nid 21777@kfi7 refs 2
00000400:00000200:25.0:1773851892.230232:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003a02afd0 nid 21777@kfi7 refs 3
00000400:00000200:25.0:1773851892.230233:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21777@kfi7 local destination
00000400:00000200:25.0:1773851892.230234:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770034:8770034:1024:4294967295] 21777@kfi7 LPNI seq info [1677272:1677272:16:4294967295]
00000400:00000200:25.0:1773851892.230235:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003a02afd0 nid 21777@kfi7 refs 2
00000400:00000200:25.0:1773851892.230236:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21777@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.230238:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21777@kfi7(21777@kfi7:21777@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851892.230239:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003a02afd0 nid 21777@kfi7 refs 3
00000800:00000200:25.0:1773851892.230240:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851892.230241:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851892.230243:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851892.230245:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1172 Using peer 21777@kfi7(0x1172)
00000800:00000200:25.0:1773851892.230247:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 324 bytes to peer 0x1172: rc=0
00000800:00000200:25.0:1773851892.230248:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1172 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851892.230250:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851892.230251:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b27adae7 refcount 2 to 21969@kfi7
00010000:00000001:25.0:1773851892.230252:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851892.230252:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851892.230253:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851892.230253:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b135396e x1859202281928576/t0(0) o400->1611c72a-44a8-46ec-9b45-d69e6df8c18b@21969@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1857-0'
00000100:00100000:25.0:1773851892.230256:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b135396e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:1611c72a-44a8-46ec-9b45-d69e6df8c18b+155:39839:x1859202281928576:12345-21969@kfi7:400:default-tuolumne1857-0 Request processed in 52us (79us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851892.230258:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21969@kfi7, seq: 2025164
00000100:00000040:25.0:1773851892.230259:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c39a23a1 : new rpc_count 7
00000100:00000001:25.0:1773851892.230260:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:27.0:1773851892.230261:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1172 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851892.230261:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851892.230261:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000400:00000200:27.0:1773851892.230262:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:25.0:1773851892.230262:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f0e565fc.
00000020:00000010:25.0:1773851892.230262:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d39d7b35.
00000400:00000200:27.0:1773851892.230263:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21777@kfi7: PUT: OK
00000020:00000040:25.0:1773851892.230263:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000c39a23a1 : new refcount 154
00000100:00000001:25.0:1773851892.230264:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851892.230265:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000019f8c817
00000400:00000010:27.0:1773851892.230265:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000019f8c817.
00000100:00000001:27.0:1773851892.230266:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851892.230266:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851892.230267:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003a02afd0 nid 21777@kfi7 refs 2
00000800:00000200:27.0:1773851892.230268:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aaa7c3d1: 2069@kfi7:6 -> 21777@kfi7(000000002aa37ec1):0x0 lsk 4467 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1172 Transaction freed
00000800:00000200:9.0:1773851892.238494:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.238494:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.238496:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.238498:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.238500:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.238501:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851892.238502:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.238502:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851892.238503:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.238504:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851892.238505:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851892.238506:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.238507:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 224 into portal 12 MB=0x699e0e5d286c0
00000400:00000200:9.0:1773851892.238508:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2075@kfi7 of length 224/224 into md 0x78146ce49 [64] + 156760
00000800:00000200:9.0:1773851892.238510:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.238511:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.238512:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.238513:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.238514:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.238514:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000012ae301c.
00000100:00000040:9.0:1773851892.238515:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000012ae301c x1858041067767488 msgsize 224
00000100:00100000:9.0:1773851892.238517:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-2075@kfi7 (source: 12345-2075@kfi7)
00000100:00000001:9.0:1773851892.238517:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.238518:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000100:00000001:8.0:1773851892.238519:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851892.238520:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851892.238520:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851892.238520:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851892.238521:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851892.238522:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.238522:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041067767488
00000020:00000001:8.0:1773851892.238523:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851892.238523:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793aca7ffe
00000020:00000001:8.0:1773851892.238524:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851892.238527:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000089166117 refcount=5
00000020:00000001:8.0:1773851892.238528:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636925686341632 : -107148023209984 : ffff9e8ca8236000)
00000020:00000001:8.0:1773851892.238529:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636925686341632 : -107148023209984 : ffff9e8ca8236000)
00000100:00000001:8.0:1773851892.238529:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.238530:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851892.238531:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851892.238532:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.238533:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851892.238533:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851892.238534:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851892.238534:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.238535:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851892.238536:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851892.238536:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.238537:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851892.238538:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851892.238538:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.238539:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851892.238539:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851892.238540:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.238540:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2075@kfi7, seq: 2130855
00000100:00000040:8.0:1773851892.238540:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000089166117 : new rpc_count 1
00000100:00000001:9.0:1773851892.238541:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.238541:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637045191014784 : -107028518536832 : ffff9ea87b2bf980)
00000100:00000040:8.0:1773851892.238543:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000012ae301c x1858041067767488/t0(0) o400->lustre5-MDT0001-lwp-OST0012_UUID@2075@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba119-0'
00000100:00000001:8.0:1773851892.238545:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.238546:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851892.238546:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000012ae301c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:lustre5-MDT0001-lwp-OST0012_UUID+5:272544:x1858041067767488:12345-2075@kfi7:400:default-yuba119-0
00000100:00000200:8.0:1773851892.238548:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041067767488
00000020:00000001:8.0:1773851892.238548:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851892.238549:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851892.238550:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.238550:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851892.238551:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851892.238552:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:8.0:1773851892.238552:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851892.238553:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851892.238553:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851892.238554:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.238555:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851892.238555:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851892.238556:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851892.238556:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000000be19ac.
02000000:00000001:8.0:1773851892.238557:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.238557:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.238558:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851892.238559:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041067767488
00010000:00000001:8.0:1773851892.238560:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851892.238561:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000012ae301c x1858041067767488/t0(0) o400->lustre5-MDT0001-lwp-OST0012_UUID@2075@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba119-0'
00010000:00000001:8.0:1773851892.238563:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851892.238564:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851892.238564:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=125 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851892.238566:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851892.238566:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d638f545 refcount 7 to 2075@kfi7
00000100:00000001:8.0:1773851892.238567:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551676416 : -107156157875200 : ffff9e8ac3463c00)
02000000:00000001:8.0:1773851892.238568:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851892.238569:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.238570:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851892.238570:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:8.0:1773851892.238571:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b95ec19a.
00000100:00000200:8.0:1773851892.238572:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041067767488, offset 224
00000400:00000200:8.0:1773851892.238573:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:8.0:1773851892.238574:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.238574:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:8.0:1773851892.238575:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:8.0:1773851892.238576:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:8.0:1773851892.238577:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2075@kfi7 local destination
00000400:00000200:8.0:1773851892.238579:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770035:8770035:1024:4294967295] 2075@kfi7 LPNI seq info [5403916:5403916:16:4294967295]
00000400:00000200:8.0:1773851892.238580:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:8.0:1773851892.238581:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.238582:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851892.238584:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:8.0:1773851892.238585:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851892.238586:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851892.238588:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851892.238590:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Using peer 2075@kfi7(0x4e8)
00000800:00000200:8.0:1773851892.238593:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x4e8: rc=0
00000800:00000200:8.0:1773851892.238594:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851892.238596:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.238597:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d638f545 refcount 6 to 2075@kfi7
00010000:00000001:8.0:1773851892.238598:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851892.238598:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.238601:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851892.238601:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000012ae301c x1858041067767488/t0(0) o400->lustre5-MDT0001-lwp-OST0012_UUID@2075@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba119-0'
00000100:00100000:8.0:1773851892.238604:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000012ae301c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:lustre5-MDT0001-lwp-OST0012_UUID+5:272544:x1858041067767488:12345-2075@kfi7:400:default-yuba119-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851892.238606:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2075@kfi7, seq: 2130855
00000100:00000040:8.0:1773851892.238607:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000089166117 : new rpc_count 0
00000100:00000001:8.0:1773851892.238608:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851892.238608:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851892.238609:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.238610:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851892.238610:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851892.238611:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000089166117 : new refcount 4
00000100:00000001:8.0:1773851892.238612:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.238616:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851892.238618:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.238619:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000400:00000200:9.0:1773851892.238620:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b95ec19a
00000400:00000010:9.0:1773851892.238620:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b95ec19a.
00000100:00000001:9.0:1773851892.238621:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851892.238621:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.238622:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851892.238623:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Transaction freed
00000800:00000200:25.0:1773851892.264511:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851892.264511:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851892.264513:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851892.264515:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851892.264516:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12386@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.264517:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12386@kfi7 : PUT - for me
00000400:00000200:25.0:1773851892.264518:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12386@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.264519:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005360f195 nid 12386@kfi7 refs 1
00000400:00000200:25.0:1773851892.264520:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12386@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.264520:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005360f195 nid 12386@kfi7 refs 2
00000400:00000200:25.0:1773851892.264521:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005360f195 nid 12386@kfi7 refs 3
00000400:00000200:25.0:1773851892.264522:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12386@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.264523:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12386@kfi7 of length 224 into portal 12 MB=0x69b4b5e247980
00000400:00000200:25.0:1773851892.264524:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12386@kfi7 of length 224/224 into md 0x16159c9699 [64] + 33104
00000800:00000200:25.0:1773851892.264526:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851892.264527:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851892.264528:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12386@kfi7: PUT: OK
00000100:00000001:25.0:1773851892.264529:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851892.264529:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851892.264530:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c641515d.
00000100:00000040:25.0:1773851892.264531:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000c641515d x1859597864565120 msgsize 224
00000100:00100000:25.0:1773851892.264533:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12386@kfi7 (source: 12345-12386@kfi7)
00000100:00000001:25.0:1773851892.264534:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851892.264535:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005360f195 nid 12386@kfi7 refs 2
00000800:00000200:25.0:1773851892.264537:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851892.264539:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851892.264540:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851892.264540:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851892.264541:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851892.264542:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851892.264542:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597864565120
00000020:00000001:25.0:1773851892.264543:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851892.264544:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fe57
00000020:00000001:25.0:1773851892.264544:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851892.264546:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b8477639 refcount=5
00000020:00000001:25.0:1773851892.264547:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161058319360 : -106912651232256 : ffff9ec37566bc00)
00000020:00000001:25.0:1773851892.264548:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161058319360 : -106912651232256 : ffff9ec37566bc00)
00000100:00000001:25.0:1773851892.264549:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851892.264550:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851892.264550:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000039e27847.
00000020:00000010:25.0:1773851892.264552:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851892.264552:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f0e565fc.
00000100:00000001:25.0:1773851892.264553:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851892.264554:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851892.264554:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851892.264555:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:25.0:1773851892.264556:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:25.0:1773851892.264556:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.264557:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.264558:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851892.264558:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851892.264559:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851892.264559:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851892.264560:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12386@kfi7, seq: 2025165
00000100:00000040:27.0:1773851892.264561:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b8477639 : new rpc_count 1
00000100:00000001:27.0:1773851892.264561:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252451200 : -106967457100416 : ffff9eb6b2b78d80)
00000100:00000001:25.0:1773851892.264561:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.264561:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.264562:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c641515d x1859597864565120/t0(0) o400->e5885237-3909-4ac0-96e2-14b917c16b51@12386@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1260-0'
00000100:00000001:27.0:1773851892.264565:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.264565:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851892.264566:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c641515d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e5885237-3909-4ac0-96e2-14b917c16b51+5:39581:x1859597864565120:12345-12386@kfi7:400:default-tuolumne1260-0
00000100:00000200:27.0:1773851892.264567:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597864565120
00000020:00000001:27.0:1773851892.264568:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851892.264569:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851892.264569:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.264570:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851892.264570:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851892.264571:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851892.264571:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597864565120, found 0 last_xid 1859597864565119
00000020:00000001:27.0:1773851892.264572:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851892.264573:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851892.264573:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851892.264574:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.264574:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851892.264575:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851892.264575:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851892.264576:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000095a8ac67.
02000000:00000001:27.0:1773851892.264577:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.264578:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.264578:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851892.264579:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096696614, transno 0, xid 1859597864565120
00010000:00000001:27.0:1773851892.264580:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851892.264580:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c641515d x1859597864565120/t0(0) o400->e5885237-3909-4ac0-96e2-14b917c16b51@12386@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1260-0'
00010000:00000001:27.0:1773851892.264583:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851892.264583:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851892.264584:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=125 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851892.264585:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851892.264585:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b78b0dbb refcount 3 to 12386@kfi7
00000100:00000001:27.0:1773851892.264586:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130859168 : -107149578692448 : ffff9e8c4b6c98a0)
02000000:00000001:27.0:1773851892.264587:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851892.264587:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.264588:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851892.264588:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12386@kfi7
00000400:00000010:27.0:1773851892.264589:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da133026.
00000100:00000200:27.0:1773851892.264590:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597864565120, offset 224
00000400:00000200:27.0:1773851892.264591:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12386@kfi7
00000400:00000200:27.0:1773851892.264592:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12386@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.264593:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005360f195 nid 12386@kfi7 refs 1
00000400:00000200:27.0:1773851892.264594:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005360f195 nid 12386@kfi7 refs 2
00000400:00000200:27.0:1773851892.264595:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005360f195 nid 12386@kfi7 refs 3
00000400:00000200:27.0:1773851892.264596:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12386@kfi7 local destination
00000400:00000200:27.0:1773851892.264597:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770036:8770036:1024:4294967295] 12386@kfi7 LPNI seq info [374494:374494:16:4294967295]
00000400:00000200:27.0:1773851892.264598:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005360f195 nid 12386@kfi7 refs 2
00000400:00000200:27.0:1773851892.264599:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12386@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.264601:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12386@kfi7(12386@kfi7:12386@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851892.264602:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005360f195 nid 12386@kfi7 refs 3
00000800:00000200:27.0:1773851892.264603:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851892.264604:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851892.264606:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851892.264608:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x907 Using peer 12386@kfi7(0x907)
00000800:00000200:27.0:1773851892.264611:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x907: rc=0
00000800:00000200:27.0:1773851892.264612:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x907 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851892.264614:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.264615:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b78b0dbb refcount 2 to 12386@kfi7
00010000:00000001:27.0:1773851892.264616:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851892.264616:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.264617:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851892.264617:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c641515d x1859597864565120/t0(0) o400->e5885237-3909-4ac0-96e2-14b917c16b51@12386@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1260-0'
00000100:00100000:27.0:1773851892.264620:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c641515d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e5885237-3909-4ac0-96e2-14b917c16b51+5:39581:x1859597864565120:12345-12386@kfi7:400:default-tuolumne1260-0 Request processed in 54us (88us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851892.264622:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12386@kfi7, seq: 2025165
00000100:00000040:27.0:1773851892.264623:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b8477639 : new rpc_count 0
00000100:00000001:27.0:1773851892.264624:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851892.264624:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851892.264624:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x907 TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851892.264625:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:27.0:1773851892.264625:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f0e565fc.
00000020:00000010:27.0:1773851892.264626:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000039e27847.
00000020:00000040:27.0:1773851892.264627:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000b8477639 : new refcount 4
00000100:00000001:27.0:1773851892.264628:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851892.264628:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851892.264629:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12386@kfi7: PUT: OK
00000400:00000200:25.0:1773851892.264630:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da133026
00000400:00000010:25.0:1773851892.264630:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da133026.
00000100:00000001:25.0:1773851892.264631:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851892.264631:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851892.264632:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005360f195 nid 12386@kfi7 refs 2
00000800:00000200:25.0:1773851892.264634:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 12386@kfi7(000000008c08a56a):0x0 lsk 2312 rsk 40 tsk 0 trmk 0 tmk 0 trr 6 tta 0x907 Transaction freed
00000800:00000200:25.0:1773851892.266060:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851892.266060:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851892.266062:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851892.266064:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851892.266065:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22641@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.266067:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22641@kfi7 : PUT - for me
00000400:00000200:25.0:1773851892.266067:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22641@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.266068:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df3767a5 nid 22641@kfi7 refs 1
00000400:00000200:25.0:1773851892.266069:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22641@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.266069:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df3767a5 nid 22641@kfi7 refs 2
00000400:00000200:25.0:1773851892.266070:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000df3767a5 nid 22641@kfi7 refs 3
00000400:00000200:25.0:1773851892.266071:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22705@kfi7 to cpt 2
00000400:00000200:25.0:1773851892.266072:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22705@kfi7 of length 224 into portal 12 MB=0x699e14c3f2880
00000400:00000200:25.0:1773851892.266073:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22705@kfi7 of length 224/224 into md 0x16159c9699 [64] + 33328
00000800:00000200:25.0:1773851892.266075:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851892.266076:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851892.266077:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22641@kfi7: PUT: OK
00000100:00000001:25.0:1773851892.266078:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851892.266078:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851892.266079:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000180d3c9f.
00000100:00000040:25.0:1773851892.266080:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000180d3c9f x1858042786162816 msgsize 224
00000100:00100000:25.0:1773851892.266081:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22705@kfi7 (source: 12345-22641@kfi7)
00000100:00000001:25.0:1773851892.266082:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851892.266083:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851892.266083:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000df3767a5 nid 22641@kfi7 refs 2
02000000:00000001:27.0:1773851892.266084:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851892.266084:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851892.266084:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851892.266084:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851892.266085:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851892.266086:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042786162816
00000020:00000001:27.0:1773851892.266086:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851892.266087:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9204c
00000020:00000001:27.0:1773851892.266087:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851892.266089:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e1274596 refcount=6
00000020:00000001:27.0:1773851892.266089:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629279744 : -107123080271872 : ffff9e9276da6800)
00000020:00000001:27.0:1773851892.266090:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629279744 : -107123080271872 : ffff9e9276da6800)
00000100:00000001:27.0:1773851892.266091:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.266092:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851892.266092:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0454dd1.
00000020:00000010:27.0:1773851892.266093:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.266093:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851892.266094:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851892.266094:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851892.266095:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.266095:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851892.266096:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851892.266096:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.266097:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.266098:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851892.266098:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851892.266098:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851892.266099:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22705@kfi7, seq: 2025166
00000100:00000001:25.0:1773851892.266099:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851892.266100:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e1274596 : new rpc_count 1
00000100:00000001:27.0:1773851892.266100:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106252459264 : -106967457092352 : ffff9eb6b2b7ad00)
00000100:00000001:25.0:1773851892.266100:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.266100:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.266101:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000180d3c9f x1858042786162816/t0(0) o400->e6b8f102-d037-4a55-a360-eeca5675b76c@22705@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1902-0'
00000100:00000001:27.0:1773851892.266103:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.266104:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851892.266104:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000180d3c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e6b8f102-d037-4a55-a360-eeca5675b76c+6:39865:x1858042786162816:12345-22705@kfi7:400:default-tuolumne1902-0
00000100:00000200:27.0:1773851892.266105:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042786162816
00000020:00000001:27.0:1773851892.266106:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851892.266106:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851892.266107:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.266107:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851892.266108:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851892.266108:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851892.266109:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042786162816, found 0 last_xid 1858042786162815
00000020:00000001:27.0:1773851892.266109:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851892.266110:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851892.266110:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851892.266110:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.266111:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851892.266111:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851892.266111:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851892.266112:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b7eb6906.
02000000:00000001:27.0:1773851892.266113:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.266113:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.266114:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851892.266114:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098910982, transno 0, xid 1858042786162816
00010000:00000001:27.0:1773851892.266115:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851892.266115:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000180d3c9f x1858042786162816/t0(0) o400->e6b8f102-d037-4a55-a360-eeca5675b76c@22705@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1902-0'
00010000:00000001:27.0:1773851892.266117:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851892.266118:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851892.266118:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=125 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851892.266119:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851892.266120:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fedb57c3 refcount 3 to 22705@kfi7
00000100:00000001:27.0:1773851892.266120:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959055616 : -107146750496000 : ffff9e8cf3ff7300)
02000000:00000001:27.0:1773851892.266121:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851892.266121:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.266121:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851892.266122:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22641@kfi7
00000400:00000010:27.0:1773851892.266122:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003ce2d312.
00000100:00000200:27.0:1773851892.266123:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042786162816, offset 224
00000400:00000200:27.0:1773851892.266124:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22641@kfi7
00000400:00000200:27.0:1773851892.266125:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22641@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.266125:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df3767a5 nid 22641@kfi7 refs 1
00000400:00000200:27.0:1773851892.266126:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000df3767a5 nid 22641@kfi7 refs 2
00000400:00000200:27.0:1773851892.266127:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000df3767a5 nid 22641@kfi7 refs 3
00000400:00000200:27.0:1773851892.266128:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22641@kfi7 local destination
00000400:00000200:27.0:1773851892.266129:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770037:8770037:1024:4294967295] 22641@kfi7 LPNI seq info [145396:145396:16:4294967295]
00000400:00000200:27.0:1773851892.266130:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000df3767a5 nid 22641@kfi7 refs 2
00000400:00000200:27.0:1773851892.266131:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22641@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.266133:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22641@kfi7(22641@kfi7:22641@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851892.266134:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000df3767a5 nid 22641@kfi7 refs 3
00000800:00000200:27.0:1773851892.266135:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851892.266136:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851892.266137:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851892.266139:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdab Using peer 22641@kfi7(0xdab)
00000800:00000200:27.0:1773851892.266141:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0xdab: rc=0
00000800:00000200:27.0:1773851892.266142:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdab TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851892.266144:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.266144:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fedb57c3 refcount 2 to 22705@kfi7
00010000:00000001:27.0:1773851892.266145:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851892.266145:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.266146:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851892.266146:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000180d3c9f x1858042786162816/t0(0) o400->e6b8f102-d037-4a55-a360-eeca5675b76c@22705@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1902-0'
00000100:00100000:27.0:1773851892.266149:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000180d3c9f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e6b8f102-d037-4a55-a360-eeca5675b76c+6:39865:x1858042786162816:12345-22705@kfi7:400:default-tuolumne1902-0 Request processed in 45us (68us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851892.266150:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22705@kfi7, seq: 2025166
00000100:00000040:27.0:1773851892.266151:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e1274596 : new rpc_count 0
00000100:00000001:27.0:1773851892.266151:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851892.266152:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851892.266152:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.266153:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000020:00000010:27.0:1773851892.266154:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0454dd1.
00000020:00000040:27.0:1773851892.266154:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000e1274596 : new refcount 5
00000100:00000001:27.0:1773851892.266155:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851892.266155:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdab TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851892.266156:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851892.266158:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22641@kfi7: PUT: OK
00000400:00000200:25.0:1773851892.266158:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003ce2d312
00000400:00000010:25.0:1773851892.266159:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003ce2d312.
00000100:00000001:25.0:1773851892.266159:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851892.266160:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851892.266161:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000df3767a5 nid 22641@kfi7 refs 2
00000800:00000200:25.0:1773851892.266162:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 22641@kfi7(00000000317cd813):0x0 lsk 3500 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xdab Transaction freed
00000800:00000200:9.0:1773851892.347920:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.347921:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.347923:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.347925:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.347928:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.347929:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21315@kfi7 : PUT - for me
00000400:00000200:9.0:1773851892.347930:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.347931:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000015962ac9 nid 21315@kfi7 refs 1
00000400:00000200:9.0:1773851892.347933:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.347933:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000015962ac9 nid 21315@kfi7 refs 2
00000400:00000200:9.0:1773851892.347934:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000015962ac9 nid 21315@kfi7 refs 3
00000400:00000200:9.0:1773851892.347935:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21315@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.347936:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21315@kfi7 of length 224 into portal 12 MB=0x699e0f9091a40
00000400:00000200:9.0:1773851892.347938:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21315@kfi7 of length 224/224 into md 0x78146ce49 [64] + 156984
00000800:00000200:9.0:1773851892.347940:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.347942:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.347943:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21315@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.347944:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.347945:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.347946:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000f178292.
00000100:00000040:9.0:1773851892.347947:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000000f178292 x1858041390111296 msgsize 224
00000100:00100000:9.0:1773851892.347949:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21315@kfi7 (source: 12345-21315@kfi7)
00000100:00000001:9.0:1773851892.347950:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.347951:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000015962ac9 nid 21315@kfi7 refs 2
00000100:00000001:8.0:1773851892.347952:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851892.347953:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851892.347953:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851892.347953:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851892.347954:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851892.347955:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.347956:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041390111296
00000020:00000001:8.0:1773851892.347956:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851892.347957:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92864
00000020:00000001:8.0:1773851892.347957:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851892.347960:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f6f7c1f2 refcount=6
00000020:00000001:8.0:1773851892.347961:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742949888 : -107128966601728 : ffff9e9118002400)
00000020:00000001:8.0:1773851892.347962:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742949888 : -107128966601728 : ffff9e9118002400)
00000100:00000001:8.0:1773851892.347963:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.347964:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851892.347965:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851892.347966:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.347967:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851892.347968:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851892.347968:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851892.347970:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.347971:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851892.347971:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851892.347972:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.347973:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.347974:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.347975:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.347975:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851892.347975:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851892.347976:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21315@kfi7, seq: 2130856
00000100:00000001:9.0:1773851892.347977:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.347977:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f6f7c1f2 : new rpc_count 1
00000100:00000001:9.0:1773851892.347978:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.347978:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637110750384640 : -106962959166976 : ffff9eb7bed09200)
00000100:00000040:8.0:1773851892.347979:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000f178292 x1858041390111296/t0(0) o400->f4cba281-72fb-4bac-bd6c-229c929c77a8@21315@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1832-0'
00000100:00000001:8.0:1773851892.347983:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.347983:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851892.347984:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000f178292 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:f4cba281-72fb-4bac-bd6c-229c929c77a8+6:39626:x1858041390111296:12345-21315@kfi7:400:default-tuolumne1832-0
00000100:00000200:8.0:1773851892.347986:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041390111296
00000020:00000001:8.0:1773851892.347986:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851892.347987:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851892.347988:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.347989:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851892.347989:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851892.347990:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851892.347991:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041390111296, found 0 last_xid 1858041390111295
00000020:00000001:8.0:1773851892.347992:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851892.347993:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851892.347993:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851892.347994:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.347995:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851892.347996:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851892.347996:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851892.347997:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cc46118f.
02000000:00000001:8.0:1773851892.347998:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.347999:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.348000:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851892.348001:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105043045, transno 0, xid 1858041390111296
00010000:00000001:8.0:1773851892.348002:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851892.348003:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000f178292 x1858041390111296/t0(0) o400->f4cba281-72fb-4bac-bd6c-229c929c77a8@21315@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1832-0'
00010000:00000001:8.0:1773851892.348006:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851892.348007:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851892.348007:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=125 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851892.348009:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851892.348009:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a4a0f852 refcount 3 to 21315@kfi7
00000100:00000001:8.0:1773851892.348010:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899612000 : -107146809939616 : ffff9e8cf0746960)
02000000:00000001:8.0:1773851892.348011:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851892.348012:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.348012:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851892.348013:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21315@kfi7
00000400:00000010:8.0:1773851892.348014:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028d4f432.
00000100:00000200:8.0:1773851892.348015:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041390111296, offset 224
00000400:00000200:8.0:1773851892.348017:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21315@kfi7
00000400:00000200:8.0:1773851892.348018:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21315@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.348018:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000015962ac9 nid 21315@kfi7 refs 1
00000400:00000200:8.0:1773851892.348020:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000015962ac9 nid 21315@kfi7 refs 2
00000400:00000200:8.0:1773851892.348021:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000015962ac9 nid 21315@kfi7 refs 3
00000400:00000200:8.0:1773851892.348022:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21315@kfi7 local destination
00000400:00000200:8.0:1773851892.348024:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770038:8770038:1024:4294967295] 21315@kfi7 LPNI seq info [5240288:5240288:16:4294967295]
00000400:00000200:8.0:1773851892.348026:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000015962ac9 nid 21315@kfi7 refs 2
00000400:00000200:8.0:1773851892.348027:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21315@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.348029:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21315@kfi7(21315@kfi7:21315@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851892.348030:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000015962ac9 nid 21315@kfi7 refs 3
00000800:00000200:8.0:1773851892.348032:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851892.348033:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851892.348035:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851892.348038:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x625 Using peer 21315@kfi7(0x625)
00000800:00000200:8.0:1773851892.348042:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x625: rc=0
00000800:00000200:8.0:1773851892.348044:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x625 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851892.348046:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.348047:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a4a0f852 refcount 2 to 21315@kfi7
00010000:00000001:8.0:1773851892.348048:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851892.348048:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.348049:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851892.348050:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000f178292 x1858041390111296/t0(0) o400->f4cba281-72fb-4bac-bd6c-229c929c77a8@21315@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1832-0'
00000100:00100000:8.0:1773851892.348055:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000f178292 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:f4cba281-72fb-4bac-bd6c-229c929c77a8+6:39626:x1858041390111296:12345-21315@kfi7:400:default-tuolumne1832-0 Request processed in 71us (106us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851892.348058:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21315@kfi7, seq: 2130856
00000100:00000040:8.0:1773851892.348058:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f6f7c1f2 : new rpc_count 0
00000100:00000001:8.0:1773851892.348059:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851892.348060:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851892.348061:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.348061:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851892.348063:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851892.348063:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f6f7c1f2 : new refcount 5
00000100:00000001:8.0:1773851892.348064:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.348070:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x625 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851892.348071:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.348073:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21315@kfi7: PUT: OK
00000400:00000200:9.0:1773851892.348074:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028d4f432
00000400:00000010:9.0:1773851892.348074:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028d4f432.
00000100:00000001:9.0:1773851892.348075:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851892.348076:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.348077:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000015962ac9 nid 21315@kfi7 refs 2
00000800:00000200:9.0:1773851892.348078:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 21315@kfi7(000000005bdc45c8):0x0 lsk 1574 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x625 Transaction freed
00000800:00000200:25.0:1773851892.371744:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851892.371745:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851892.371747:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851892.371751:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851892.371754:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12928@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.371756:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12928@kfi7 : PUT - for me
00000400:00000200:25.0:1773851892.371758:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12928@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.371759:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfde30b1 nid 12928@kfi7 refs 1
00000400:00000200:25.0:1773851892.371760:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12928@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.371764:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfde30b1 nid 12928@kfi7 refs 2
00000400:00000200:25.0:1773851892.371765:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfde30b1 nid 12928@kfi7 refs 3
00000400:00000200:25.0:1773851892.371767:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12928@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.371768:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12928@kfi7 of length 224 into portal 12 MB=0x69b4b7e4863c0
00000400:00000200:25.0:1773851892.371770:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12928@kfi7 of length 224/224 into md 0x16159c9699 [64] + 33552
00000800:00000200:25.0:1773851892.371773:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851892.371776:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851892.371778:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12928@kfi7: PUT: OK
00000100:00000001:25.0:1773851892.371780:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851892.371780:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851892.371782:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000022e1103c.
00000100:00000040:25.0:1773851892.371783:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000022e1103c x1859598403789760 msgsize 224
00000100:00100000:25.0:1773851892.371786:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-12928@kfi7 (source: 12345-12928@kfi7)
00000100:00000001:25.0:1773851892.371788:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851892.371789:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851892.371790:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851892.371790:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:25.0:1773851892.371790:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfde30b1 nid 12928@kfi7 refs 2
00000100:00000001:27.0:1773851892.371791:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851892.371792:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851892.371792:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598403789760
00000800:00000200:25.0:1773851892.371792:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000001:27.0:1773851892.371793:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851892.371793:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79a90
00000020:00000001:27.0:1773851892.371794:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851892.371796:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000069158456 refcount=5
00000020:00000001:27.0:1773851892.371797:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637040582498304 : -107033127053312 : ffff9ea7687b9800)
00000020:00000001:27.0:1773851892.371797:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637040582498304 : -107033127053312 : ffff9ea7687b9800)
00000100:00000001:27.0:1773851892.371798:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.371799:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851892.371799:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000330439b1.
00000020:00000010:27.0:1773851892.371800:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.371801:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851892.371802:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851892.371802:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851892.371803:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.371803:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851892.371804:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851892.371804:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.371805:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.371806:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851892.371807:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851892.371808:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12928@kfi7, seq: 2025167
00000100:00000040:27.0:1773851892.371808:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000069158456 : new rpc_count 1
00000100:00000001:25.0:1773851892.371808:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851892.371808:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851892.371809:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106565007360 : -106967144544256 : ffff9eb6c558c800)
00000100:00000001:25.0:1773851892.371809:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.371810:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000022e1103c x1859598403789760/t0(0) o400->2af7b32f-34da-446d-a819-86226e0abd5d@12928@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1300-0'
00000100:00000001:25.0:1773851892.371810:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.371812:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.371813:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851892.371813:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022e1103c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2af7b32f-34da-446d-a819-86226e0abd5d+5:39489:x1859598403789760:12345-12928@kfi7:400:default-tuolumne1300-0
00000100:00000200:27.0:1773851892.371814:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598403789760
00000020:00000001:27.0:1773851892.371815:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851892.371816:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851892.371816:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.371817:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851892.371817:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851892.371818:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851892.371818:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598403789760, found 0 last_xid 1859598403789759
00000020:00000001:27.0:1773851892.371819:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851892.371820:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851892.371820:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851892.371821:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.371821:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851892.371822:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851892.371822:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851892.371823:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000870438eb.
02000000:00000001:27.0:1773851892.371823:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.371824:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.371825:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851892.371825:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690309, transno 0, xid 1859598403789760
00010000:00000001:27.0:1773851892.371826:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851892.371827:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000022e1103c x1859598403789760/t0(0) o400->2af7b32f-34da-446d-a819-86226e0abd5d@12928@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1300-0'
00010000:00000001:27.0:1773851892.371829:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851892.371829:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851892.371830:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=125 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851892.371831:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851892.371832:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003b8984ef refcount 3 to 12928@kfi7
00000100:00000001:27.0:1773851892.371832:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858208 : -107149578693408 : ffff9e8c4b6c94e0)
02000000:00000001:27.0:1773851892.371833:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851892.371834:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.371835:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851892.371835:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12928@kfi7
00000400:00000010:27.0:1773851892.371836:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009801fd0c.
00000100:00000200:27.0:1773851892.371837:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598403789760, offset 224
00000400:00000200:27.0:1773851892.371838:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12928@kfi7
00000400:00000200:27.0:1773851892.371839:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12928@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.371840:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfde30b1 nid 12928@kfi7 refs 1
00000400:00000200:27.0:1773851892.371841:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfde30b1 nid 12928@kfi7 refs 2
00000400:00000200:27.0:1773851892.371842:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfde30b1 nid 12928@kfi7 refs 3
00000400:00000200:27.0:1773851892.371843:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12928@kfi7 local destination
00000400:00000200:27.0:1773851892.371845:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770039:8770039:1024:4294967295] 12928@kfi7 LPNI seq info [7590813:7590813:16:4294967295]
00000400:00000200:27.0:1773851892.371846:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfde30b1 nid 12928@kfi7 refs 2
00000400:00000200:27.0:1773851892.371847:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12928@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.371849:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12928@kfi7(12928@kfi7:12928@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851892.371851:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfde30b1 nid 12928@kfi7 refs 3
00000800:00000200:27.0:1773851892.371852:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851892.371853:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851892.371855:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851892.371858:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000023e Using peer 12928@kfi7(0x10000000000023e)
00000800:00000200:27.0:1773851892.371861:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x10000000000023e: rc=0
00000800:00000200:27.0:1773851892.371862:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000023e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851892.371864:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.371866:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003b8984ef refcount 2 to 12928@kfi7
00010000:00000001:27.0:1773851892.371866:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851892.371867:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.371868:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851892.371868:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000022e1103c x1859598403789760/t0(0) o400->2af7b32f-34da-446d-a819-86226e0abd5d@12928@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1300-0'
00000100:00100000:27.0:1773851892.371871:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022e1103c pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2af7b32f-34da-446d-a819-86226e0abd5d+5:39489:x1859598403789760:12345-12928@kfi7:400:default-tuolumne1300-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851892.371874:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12928@kfi7, seq: 2025167
00000100:00000040:27.0:1773851892.371875:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000069158456 : new rpc_count 0
00000100:00000001:27.0:1773851892.371876:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851892.371876:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851892.371876:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000023e TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851892.371877:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.371877:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000020:00000010:27.0:1773851892.371878:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000330439b1.
00000020:00000040:27.0:1773851892.371879:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000069158456 : new refcount 4
00000400:00000200:25.0:1773851892.371879:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851892.371880:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851892.371881:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12928@kfi7: PUT: OK
00000400:00000200:25.0:1773851892.371882:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009801fd0c
00000400:00000010:25.0:1773851892.371883:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009801fd0c.
00000100:00000001:25.0:1773851892.371884:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851892.371885:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851892.371886:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfde30b1 nid 12928@kfi7 refs 2
00000800:00000200:25.0:1773851892.371889:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 12928@kfi7(00000000e61b1df8):0x0 lsk 575 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000023e Transaction freed
00000800:00000200:25.0:1773851892.373143:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851892.373144:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851892.373145:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851892.373147:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851892.373149:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18672@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.373150:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18672@kfi7 : PUT - for me
00000400:00000200:25.0:1773851892.373151:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18672@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.373152:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007065c33e nid 18672@kfi7 refs 1
00000400:00000200:25.0:1773851892.373153:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18672@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.373153:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007065c33e nid 18672@kfi7 refs 2
00000400:00000200:25.0:1773851892.373154:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007065c33e nid 18672@kfi7 refs 3
00000400:00000200:25.0:1773851892.373155:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18673@kfi7 to cpt 1
00000400:00000200:25.0:1773851892.373156:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18673@kfi7 of length 224 into portal 12 MB=0x69b09a24be900
00000400:00000200:25.0:1773851892.373157:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18673@kfi7 of length 224/224 into md 0x16159c9699 [64] + 33776
00000800:00000200:25.0:1773851892.373158:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851892.373160:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851892.373161:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18672@kfi7: PUT: OK
00000100:00000001:25.0:1773851892.373162:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851892.373162:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851892.373163:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a295403a.
00000100:00000040:25.0:1773851892.373164:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000a295403a x1859315540158720 msgsize 224
00000100:00100000:25.0:1773851892.373165:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-18673@kfi7 (source: 12345-18672@kfi7)
00000100:00000001:25.0:1773851892.373166:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851892.373167:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851892.373167:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007065c33e nid 18672@kfi7 refs 2
02000000:00000001:27.0:1773851892.373168:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851892.373168:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851892.373168:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851892.373168:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851892.373169:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851892.373170:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315540158720
00000020:00000001:27.0:1773851892.373170:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851892.373170:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c15
00000020:00000001:27.0:1773851892.373171:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851892.373172:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003d8ddea8 refcount=6
00000020:00000001:27.0:1773851892.373173:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743954432 : -107128965597184 : ffff9e91180f7800)
00000020:00000001:27.0:1773851892.373174:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743954432 : -107128965597184 : ffff9e91180f7800)
00000100:00000001:27.0:1773851892.373175:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.373176:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851892.373176:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000330439b1.
00000020:00000010:27.0:1773851892.373176:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.373177:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851892.373178:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851892.373178:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851892.373179:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.373179:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851892.373180:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851892.373180:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.373181:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.373182:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851892.373182:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851892.373182:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851892.373183:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18673@kfi7, seq: 2025168
00000100:00000001:25.0:1773851892.373183:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851892.373184:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003d8ddea8 : new rpc_count 1
00000100:00000001:27.0:1773851892.373184:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106565010816 : -106967144540800 : ffff9eb6c558d580)
00000100:00000001:25.0:1773851892.373184:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851892.373184:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.373185:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a295403a x1859315540158720/t0(0) o400->32c090f1-02e3-4c89-aaf2-9325f8d42b2c@18673@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1645-0'
00000100:00000001:27.0:1773851892.373188:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.373188:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851892.373189:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a295403a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:32c090f1-02e3-4c89-aaf2-9325f8d42b2c+6:39623:x1859315540158720:12345-18673@kfi7:400:default-tuolumne1645-0
00000100:00000200:27.0:1773851892.373190:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315540158720
00000020:00000001:27.0:1773851892.373191:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851892.373191:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851892.373192:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.373192:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851892.373192:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851892.373193:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851892.373193:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315540158720, found 0 last_xid 1859315540158719
00000020:00000001:27.0:1773851892.373194:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851892.373194:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851892.373194:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851892.373195:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.373195:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851892.373196:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851892.373196:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851892.373197:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fa751755.
02000000:00000001:27.0:1773851892.373197:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.373198:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.373198:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851892.373199:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260574513, transno 0, xid 1859315540158720
00010000:00000001:27.0:1773851892.373199:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851892.373200:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a295403a x1859315540158720/t0(0) o400->32c090f1-02e3-4c89-aaf2-9325f8d42b2c@18673@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1645-0'
00010000:00000001:27.0:1773851892.373202:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851892.373203:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851892.373203:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=125 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851892.373204:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851892.373205:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a6d145a1 refcount 3 to 18673@kfi7
00000100:00000001:27.0:1773851892.373206:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411712 : -107145304139904 : ffff9e8d4a351780)
02000000:00000001:27.0:1773851892.373206:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851892.373207:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.373207:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851892.373208:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18672@kfi7
00000400:00000010:27.0:1773851892.373208:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f075750.
00000100:00000200:27.0:1773851892.373209:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315540158720, offset 224
00000400:00000200:27.0:1773851892.373210:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18672@kfi7
00000400:00000200:27.0:1773851892.373211:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18672@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.373211:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007065c33e nid 18672@kfi7 refs 1
00000400:00000200:27.0:1773851892.373212:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007065c33e nid 18672@kfi7 refs 2
00000400:00000200:27.0:1773851892.373213:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007065c33e nid 18672@kfi7 refs 3
00000400:00000200:27.0:1773851892.373214:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18672@kfi7 local destination
00000400:00000200:27.0:1773851892.373216:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770040:8770040:1024:4294967295] 18672@kfi7 LPNI seq info [6346836:6346836:16:4294967295]
00000400:00000200:27.0:1773851892.373217:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007065c33e nid 18672@kfi7 refs 2
00000400:00000200:27.0:1773851892.373218:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18672@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.373219:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18672@kfi7(18672@kfi7:18672@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851892.373220:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007065c33e nid 18672@kfi7 refs 3
00000800:00000200:27.0:1773851892.373222:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851892.373223:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851892.373225:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851892.373227:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000106f Using peer 18672@kfi7(0x10000000000106f)
00000800:00000200:27.0:1773851892.373229:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0x10000000000106f: rc=0
00000800:00000200:27.0:1773851892.373230:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000106f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851892.373232:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.373233:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a6d145a1 refcount 2 to 18673@kfi7
00010000:00000001:27.0:1773851892.373233:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851892.373234:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.373234:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851892.373235:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a295403a x1859315540158720/t0(0) o400->32c090f1-02e3-4c89-aaf2-9325f8d42b2c@18673@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1645-0'
00000100:00100000:27.0:1773851892.373238:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a295403a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:32c090f1-02e3-4c89-aaf2-9325f8d42b2c+6:39623:x1859315540158720:12345-18673@kfi7:400:default-tuolumne1645-0 Request processed in 50us (74us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851892.373240:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18673@kfi7, seq: 2025168
00000100:00000040:27.0:1773851892.373240:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003d8ddea8 : new rpc_count 0
00000100:00000001:27.0:1773851892.373241:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851892.373241:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851892.373241:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000106f TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851892.373242:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.373242:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000020:00000010:27.0:1773851892.373243:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000330439b1.
00000400:00000200:25.0:1773851892.373243:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:27.0:1773851892.373244:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000003d8ddea8 : new refcount 5
00000100:00000001:27.0:1773851892.373244:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851892.373244:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18672@kfi7: PUT: OK
00000400:00000200:25.0:1773851892.373245:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f075750
00000400:00000010:25.0:1773851892.373245:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f075750.
00000100:00000001:25.0:1773851892.373246:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851892.373246:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851892.373247:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007065c33e nid 18672@kfi7 refs 2
00000800:00000200:25.0:1773851892.373248:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 18672@kfi7(000000008192490a):0x0 lsk 4208 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000106f Transaction freed
00000800:00000200:22.0:1773851892.490311:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851892.490311:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851892.490312:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851892.490312:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851892.490313:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851892.490313:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851892.490315:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851892.490315:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 24256@kfi7(000000003d7c2c6e):0xb94 version: 2; local version 2; negotiated version: 2
00000400:00000200:22.0:1773851892.490317:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24256@kfi7 to cpt 5
00000800:00000200:21.0:1773851892.490317:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 Using peer 24256@kfi7(0x100000000000b94)
00000400:00000200:22.0:1773851892.490318:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24256@kfi7 : PUT - for me
00000400:00000200:22.0:1773851892.490319:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24256@kfi7 to cpt 5
00000400:00000200:22.0:1773851892.490320:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032383ac9 nid 24256@kfi7 refs 1
00000400:00000200:22.0:1773851892.490322:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24256@kfi7 to cpt 5
00000400:00000200:22.0:1773851892.490322:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032383ac9 nid 24256@kfi7 refs 2
00000400:00000200:22.0:1773851892.490323:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000032383ac9 nid 24256@kfi7 refs 3
00000400:00000200:21.0:1773851892.490324:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24256@kfi7 to cpt 5
00000400:00000200:22.0:1773851892.490325:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24064@kfi7 to cpt 3
00000400:00000200:22.0:1773851892.490326:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24064@kfi7 of length 224 into portal 12 MB=0x69b4c654b3700
00000800:00000200:21.0:1773851892.490326:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0x100000000000b94: rc=0
00000400:00000200:22.0:1773851892.490327:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24064@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 60232
00000800:00000200:21.0:1773851892.490328:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:22.0:1773851892.490329:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851892.490331:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851892.490332:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24256@kfi7: PUT: OK
00000100:00000001:22.0:1773851892.490334:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851892.490334:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851892.490335:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000534b283b.
00000100:00000040:22.0:1773851892.490336:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000534b283b x1859602279511808 msgsize 224
00000100:00100000:22.0:1773851892.490337:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-24064@kfi7 (source: 12345-24256@kfi7)
00000100:00000001:22.0:1773851892.490339:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:21.0:1773851892.490339:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851892.490340:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000032383ac9 nid 24256@kfi7 refs 2
00000800:00000200:22.0:1773851892.490341:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851892.490341:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851892.490342:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 Transaction freed
02000000:00000001:20.0:1773851892.490342:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851892.490342:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851892.490343:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851892.490343:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851892.490344:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602279511808
00000020:00000001:20.0:1773851892.490345:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851892.490345:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff83820
00000020:00000001:20.0:1773851892.490346:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851892.490351:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000027e1f64a refcount=5
00000020:00000001:20.0:1773851892.490351:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142714514432 : -106930995037184 : ffff9ebf30067c00)
00000020:00000001:20.0:1773851892.490352:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142714514432 : -106930995037184 : ffff9ebf30067c00)
00000100:00000001:20.0:1773851892.490353:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851892.490355:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851892.490355:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851892.490356:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851892.490357:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000032ef7456.
00000100:00000001:20.0:1773851892.490358:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851892.490358:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851892.490359:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851892.490360:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851892.490360:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851892.490361:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.490362:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.490364:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851892.490364:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851892.490364:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851892.490364:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851892.490365:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24064@kfi7, seq: 1998061
00000100:00000001:23.0:1773851892.490366:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.490366:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851892.490366:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000027e1f64a : new rpc_count 1
00000100:00000001:20.0:1773851892.490366:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382172800 : -106946327378816 : ffff9ebb9e258480)
00000100:00000040:20.0:1773851892.490368:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000534b283b x1859602279511808/t0(0) o400->0cd27b50-0f04-4785-887e-3bafdfcd9b29@24064@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2003-0'
00000100:00000001:20.0:1773851892.490370:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851892.490371:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851892.490371:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000534b283b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0cd27b50-0f04-4785-887e-3bafdfcd9b29+5:39595:x1859602279511808:12345-24064@kfi7:400:default-tuolumne2003-0
00000100:00000200:20.0:1773851892.490373:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602279511808
00000020:00000001:20.0:1773851892.490374:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851892.490374:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851892.490375:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.490375:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851892.490376:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851892.490377:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851892.490377:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602279511808, found 0 last_xid 1859602279511807
00000020:00000001:20.0:1773851892.490378:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851892.490379:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851892.490379:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851892.490380:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.490381:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851892.490381:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851892.490382:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851892.490383:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009497f4c9.
02000000:00000001:20.0:1773851892.490384:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.490384:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.490385:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851892.490386:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046920699, transno 0, xid 1859602279511808
00010000:00000001:20.0:1773851892.490386:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851892.490387:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000534b283b x1859602279511808/t0(0) o400->0cd27b50-0f04-4785-887e-3bafdfcd9b29@24064@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2003-0'
00010000:00000001:20.0:1773851892.490389:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851892.490390:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851892.490391:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=125 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851892.490392:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851892.490392:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000032e06a6 refcount 3 to 24064@kfi7
00000100:00000001:20.0:1773851892.490393:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151456 : -107154898400160 : ffff9e8b0e584c60)
02000000:00000001:20.0:1773851892.490394:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851892.490394:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.490395:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851892.490396:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24256@kfi7
00000400:00000010:20.0:1773851892.490396:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071e33c48.
00000100:00000200:20.0:1773851892.490397:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602279511808, offset 224
00000400:00000200:20.0:1773851892.490398:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24256@kfi7
00000400:00000200:20.0:1773851892.490399:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24256@kfi7 to cpt 5
00000400:00000200:20.0:1773851892.490400:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032383ac9 nid 24256@kfi7 refs 1
00000400:00000200:20.0:1773851892.490401:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000032383ac9 nid 24256@kfi7 refs 2
00000400:00000200:20.0:1773851892.490402:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000032383ac9 nid 24256@kfi7 refs 3
00000400:00000200:20.0:1773851892.490403:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24256@kfi7 local destination
00000400:00000200:20.0:1773851892.490404:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770041:8770041:1024:4294967295] 24256@kfi7 LPNI seq info [16169331:16169331:16:4294967295]
00000400:00000200:20.0:1773851892.490405:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000032383ac9 nid 24256@kfi7 refs 2
00000400:00000200:20.0:1773851892.490406:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24256@kfi7 to cpt 5
00000400:00000200:20.0:1773851892.490408:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24256@kfi7(24256@kfi7:24256@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851892.490410:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000032383ac9 nid 24256@kfi7 refs 3
00000800:00000200:20.0:1773851892.490411:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851892.490412:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851892.490414:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851892.490416:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 Using peer 24256@kfi7(0x100000000000b94)
00000800:00000200:20.0:1773851892.490419:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x100000000000b94: rc=0
00000800:00000200:20.0:1773851892.490420:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851892.490422:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851892.490423:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000032e06a6 refcount 2 to 24064@kfi7
00010000:00000001:20.0:1773851892.490424:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851892.490425:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.490425:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851892.490426:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000534b283b x1859602279511808/t0(0) o400->0cd27b50-0f04-4785-887e-3bafdfcd9b29@24064@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2003-0'
00000100:00100000:20.0:1773851892.490429:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000534b283b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0cd27b50-0f04-4785-887e-3bafdfcd9b29+5:39595:x1859602279511808:12345-24064@kfi7:400:default-tuolumne2003-0 Request processed in 58us (93us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851892.490431:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24064@kfi7, seq: 1998061
00000100:00000040:20.0:1773851892.490432:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000027e1f64a : new rpc_count 0
00000100:00000001:20.0:1773851892.490433:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851892.490433:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851892.490434:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851892.490435:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000032ef7456.
00000020:00000010:20.0:1773851892.490435:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000020:00000040:20.0:1773851892.490436:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000027e1f64a : new refcount 4
00000100:00000001:20.0:1773851892.490437:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851892.490441:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851892.490443:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.490444:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24256@kfi7: PUT: OK
00000400:00000200:21.0:1773851892.490445:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071e33c48
00000400:00000010:21.0:1773851892.490445:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071e33c48.
00000100:00000001:21.0:1773851892.490446:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851892.490446:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851892.490447:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000032383ac9 nid 24256@kfi7 refs 2
00000800:00000200:21.0:1773851892.490448:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 24256@kfi7(000000003d7c2c6e):0x0 lsk 2965 rsk 23 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000b94 Transaction freed
00000800:00000200:17.0:1773851892.506169:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851892.506170:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851892.506171:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851892.506173:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851892.506175:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.506176:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.9@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851892.506177:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.506178:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851892.506179:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.9@o2ib60 to cpt 2
00000400:00000200:17.0:1773851892.506180:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ad550c7 nid 192.168.128.9@o2ib60 refs 2
00000400:00000200:17.0:1773851892.506181:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009ad550c7 nid 192.168.128.9@o2ib60 refs 3
00000400:00000200:17.0:1773851892.506182:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.9@o2ib60 to cpt 2
00000400:00000200:17.0:1773851892.506183:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.9@o2ib60 of length 224 into portal 12 MB=0x69b21330961c0
00000400:00000200:17.0:1773851892.506185:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.9@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 157208
00000800:00000200:17.0:1773851892.506187:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851892.506188:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851892.506189:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851892.506190:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851892.506190:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851892.506191:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007ad78787.
00000100:00000040:17.0:1773851892.506192:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000007ad78787 x1859416752742848 msgsize 224
00000100:00100000:17.0:1773851892.506193:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.9@o2ib60 (source: 12345-192.168.128.9@o2ib60)
00000100:00000001:17.0:1773851892.506195:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851892.506196:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851892.506198:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851892.506199:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851892.506199:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851892.506200:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851892.506200:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851892.506201:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.506202:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859416752742848
00000020:00000001:8.0:1773851892.506202:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851892.506203:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ae68
00000020:00000001:8.0:1773851892.506214:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851892.506217:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071e7bd18 refcount=5
00000020:00000001:8.0:1773851892.506217:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113217482752 : -106960492068864 : ffff9eb851dd8000)
00000020:00000001:8.0:1773851892.506218:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113217482752 : -106960492068864 : ffff9eb851dd8000)
00000100:00000001:8.0:1773851892.506219:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.506220:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851892.506221:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851892.506222:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.506223:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851892.506224:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851892.506224:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851892.506225:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.506226:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851892.506226:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851892.506227:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.506228:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.506229:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.506230:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851892.506230:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851892.506231:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851892.506231:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.9@o2ib60, seq: 2130857
00000100:00000001:9.0:1773851892.506232:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.506232:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071e7bd18 : new rpc_count 1
00000100:00000001:9.0:1773851892.506233:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.506233:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968772736 : -106974740778880 : ffff9eb500937080)
00000100:00000040:8.0:1773851892.506234:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007ad78787 x1859416752742848/t0(0) o400->77105f48-5024-49c8-a247-e34f5335b676@192.168.128.9@o2ib60:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix9-0'
00000100:00000001:8.0:1773851892.506237:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.506238:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851892.506239:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007ad78787 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:77105f48-5024-49c8-a247-e34f5335b676+5:40073:x1859416752742848:12345-192.168.128.9@o2ib60:400:default-matrix9-0
00000100:00000200:8.0:1773851892.506240:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859416752742848
00000020:00000001:8.0:1773851892.506241:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851892.506241:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851892.506242:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.506243:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851892.506243:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851892.506245:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851892.506245:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859416752742848, found 0 last_xid 1859416752742847
00000020:00000001:8.0:1773851892.506246:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851892.506247:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851892.506247:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851892.506248:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.506248:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851892.506249:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851892.506249:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851892.506250:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001eb41acf.
02000000:00000001:8.0:1773851892.506250:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.506251:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.506252:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851892.506252:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183133131840, transno 0, xid 1859416752742848
00010000:00000001:8.0:1773851892.506253:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851892.506254:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007ad78787 x1859416752742848/t0(0) o400->77105f48-5024-49c8-a247-e34f5335b676@192.168.128.9@o2ib60:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix9-0'
00010000:00000001:8.0:1773851892.506256:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851892.506257:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851892.506257:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=125 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851892.506258:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851892.506259:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002b53945c refcount 3 to 192.168.128.9@o2ib60
00000100:00000001:8.0:1773851892.506260:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274736416 : -107155434815200 : ffff9e8aee5f4120)
02000000:00000001:8.0:1773851892.506261:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851892.506261:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.506262:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851892.506263:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.9@o2ib60
00000400:00000010:8.0:1773851892.506264:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e5dfdd1.
00000100:00000200:8.0:1773851892.506264:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859416752742848, offset 224
00000400:00000200:8.0:1773851892.506266:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.9@o2ib60
00000400:00000200:8.0:1773851892.506267:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.9@o2ib60 to cpt 2
00000400:00000200:8.0:1773851892.506268:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ad550c7 nid 192.168.128.9@o2ib60 refs 2
00000400:00000200:8.0:1773851892.506269:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009ad550c7 nid 192.168.128.9@o2ib60 refs 3
00000400:00000200:8.0:1773851892.506270:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009ad550c7 nid 192.168.128.9@o2ib60 refs 4
00000400:00000200:8.0:1773851892.506272:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.9@o2ib60 routed destination
00000400:00000200:8.0:1773851892.506273:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:8.0:1773851892.506275:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:8.0:1773851892.506276:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.9@o2ib60: rtr pref emtpy: 1
00000400:00000200:8.0:1773851892.506278:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:8.0:1773851892.506278:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.9@o2ib60: rtr pref emtpy: 1
00000400:00000200:8.0:1773851892.506279:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:8.0:1773851892.506280:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770042:8770042:1024:4294967295] 2094@kfi7 LPNI seq info [1258747018:1258747018:16:4294967295]
00000400:00000200:8.0:1773851892.506282:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:8.0:1773851892.506282:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:8.0:1773851892.506285:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.9@o2ib60(192.168.128.9@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851892.506286:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009ad550c7 nid 192.168.128.9@o2ib60 refs 3
00000800:00000200:8.0:1773851892.506288:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851892.506289:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851892.506291:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851892.506293:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:8.0:1773851892.506296:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:8.0:1773851892.506297:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851892.506299:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.506300:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002b53945c refcount 2 to 192.168.128.9@o2ib60
00010000:00000001:8.0:1773851892.506301:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851892.506301:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.506302:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851892.506304:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007ad78787 x1859416752742848/t0(0) o400->77105f48-5024-49c8-a247-e34f5335b676@192.168.128.9@o2ib60:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix9-0'
00000100:00100000:8.0:1773851892.506307:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007ad78787 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:77105f48-5024-49c8-a247-e34f5335b676+5:40073:x1859416752742848:12345-192.168.128.9@o2ib60:400:default-matrix9-0 Request processed in 69us (115us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851892.506311:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.9@o2ib60, seq: 2130857
00000100:00000040:8.0:1773851892.506311:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071e7bd18 : new rpc_count 0
00000100:00000001:8.0:1773851892.506312:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851892.506313:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851892.506313:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.506314:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851892.506315:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851892.506316:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000071e7bd18 : new refcount 4
00000100:00000001:8.0:1773851892.506316:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.506321:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851892.506323:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.506324:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:9.0:1773851892.506325:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e5dfdd1
00000400:00000010:9.0:1773851892.506326:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e5dfdd1.
00000100:00000001:9.0:1773851892.506326:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851892.506327:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.506328:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:9.0:1773851892.506329:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Transaction freed
00000800:00000200:9.0:1773851892.530052:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.530053:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.530055:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.530059:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.530062:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.530064:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.116@tcp : PUT - for me
00000400:00000200:9.0:1773851892.530066:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.530067:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851892.530069:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.116@tcp to cpt 0
00000400:00000200:9.0:1773851892.530071:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bafcd780 nid 172.16.70.116@tcp refs 2
00000400:00000200:9.0:1773851892.530073:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bafcd780 nid 172.16.70.116@tcp refs 3
00000400:00000200:9.0:1773851892.530075:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.116@tcp to cpt 0
00000400:00000200:9.0:1773851892.530077:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.116@tcp of length 224 into portal 12 MB=0x69a0e7da56240
00000400:00000200:9.0:1773851892.530079:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.116@tcp of length 224/224 into md 0x7fb56e801 [64] + 45888
00000800:00000200:9.0:1773851892.530083:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.530085:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.530087:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.530089:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.530090:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.530092:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000080d0324.
00000100:00000040:9.0:1773851892.530093:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000080d0324 x1858236888474176 msgsize 224
00000100:00100000:9.0:1773851892.530096:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.116@tcp (source: 12345-172.16.70.116@tcp)
00000100:00000001:9.0:1773851892.530099:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.530100:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:0.0:1773851892.530102:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851892.530103:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851892.530103:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851892.530104:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851892.530105:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851892.530106:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851892.530107:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858236888474176
00000020:00000001:0.0:1773851892.530108:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851892.530108:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9307c
00000020:00000001:0.0:1773851892.530109:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851892.530112:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bc7f1ac refcount=6
00000020:00000001:0.0:1773851892.530113:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745149440 : -107128964402176 : ffff9e911821b400)
00000020:00000001:0.0:1773851892.530114:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745149440 : -107128964402176 : ffff9e911821b400)
00000100:00000001:0.0:1773851892.530116:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851892.530117:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851892.530118:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd570b8d.
00000020:00000010:0.0:1773851892.530120:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851892.530121:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851892.530123:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851892.530123:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851892.530124:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851892.530126:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851892.530127:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851892.530127:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.530129:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851892.530131:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851892.530132:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851892.530132:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851892.530133:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851892.530134:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.116@tcp, seq: 1997615
00000100:00000001:1.0:1773851892.530135:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851892.530135:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bc7f1ac : new rpc_count 1
00000100:00000001:1.0:1773851892.530136:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.530136:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637017541455104 : -107056168096512 : ffff9ea20b212d00)
00000100:00000040:0.0:1773851892.530138:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000080d0324 x1858236888474176/t0(0) o400->587515d3-37c5-4ec8-9a7a-9c07dbb2d46f@172.16.70.116@tcp:532/0 lens 224/0 e 0 to 0 dl 1773852647 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic16-0'
00000100:00000001:0.0:1773851892.530143:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851892.530143:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851892.530145:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000080d0324 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:587515d3-37c5-4ec8-9a7a-9c07dbb2d46f+6:50045:x1858236888474176:12345-172.16.70.116@tcp:400:default-rzslic16-0
00000100:00000200:0.0:1773851892.530147:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858236888474176
00000020:00000001:0.0:1773851892.530148:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851892.530149:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851892.530150:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851892.530151:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851892.530152:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851892.530153:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851892.530154:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858236888474176, found 0 last_xid 1858236888474175
00000020:00000001:0.0:1773851892.530155:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851892.530156:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851892.530157:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851892.530158:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851892.530160:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851892.530161:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851892.530162:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851892.530163:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007b1df777.
02000000:00000001:0.0:1773851892.530164:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.530165:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851892.530166:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851892.530166:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858236888474176
00010000:00000001:0.0:1773851892.530168:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851892.530169:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000080d0324 x1858236888474176/t0(0) o400->587515d3-37c5-4ec8-9a7a-9c07dbb2d46f@172.16.70.116@tcp:532/0 lens 224/224 e 0 to 0 dl 1773852647 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic16-0'
00010000:00000001:0.0:1773851892.530173:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851892.530174:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851892.530175:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=125 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851892.530177:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851892.530178:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f46589fd refcount 3 to 172.16.70.116@tcp
00000100:00000001:0.0:1773851892.530179:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545858880 : -107154163692736 : ffff9e8b3a230b40)
02000000:00000001:0.0:1773851892.530180:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851892.530181:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851892.530182:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851892.530183:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.116@tcp
00000400:00000010:0.0:1773851892.530184:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e89b889f.
00000100:00000200:0.0:1773851892.530185:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858236888474176, offset 224
00000400:00000200:0.0:1773851892.530188:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.116@tcp
00000400:00000200:0.0:1773851892.530189:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.116@tcp to cpt 0
00000400:00000200:0.0:1773851892.530191:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bafcd780 nid 172.16.70.116@tcp refs 2
00000400:00000200:0.0:1773851892.530193:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bafcd780 nid 172.16.70.116@tcp refs 3
00000400:00000200:0.0:1773851892.530195:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bafcd780 nid 172.16.70.116@tcp refs 4
00000400:00000200:0.0:1773851892.530197:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.116@tcp routed destination
00000400:00000200:0.0:1773851892.530198:0:42868:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:0.0:1773851892.530200:0:42868:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:0.0:1773851892.530202:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.116@tcp: rtr pref emtpy: 1
00000400:00000200:0.0:1773851892.530204:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:0.0:1773851892.530207:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.116@tcp: rtr pref emtpy: 1
00000400:00000200:0.0:1773851892.530208:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:0.0:1773851892.530211:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770043:8770043:1024:4294967295] 17@kfi7 LPNI seq info [1250891918:1250891918:16:4294967295]
00000400:00000200:0.0:1773851892.530213:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:0.0:1773851892.530215:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:0.0:1773851892.530219:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.116@tcp(172.16.70.116@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851892.530222:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bafcd780 nid 172.16.70.116@tcp refs 3
00000800:00000200:0.0:1773851892.530225:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851892.530227:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851892.530231:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851892.530236:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:0.0:1773851892.530241:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:0.0:1773851892.530243:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851892.530247:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851892.530248:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f46589fd refcount 2 to 172.16.70.116@tcp
00010000:00000001:0.0:1773851892.530252:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851892.530253:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851892.530254:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851892.530256:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000080d0324 x1858236888474176/t0(0) o400->587515d3-37c5-4ec8-9a7a-9c07dbb2d46f@172.16.70.116@tcp:532/0 lens 224/224 e 0 to 0 dl 1773852647 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic16-0'
00000100:00100000:0.0:1773851892.530262:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000080d0324 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:587515d3-37c5-4ec8-9a7a-9c07dbb2d46f+6:50045:x1858236888474176:12345-172.16.70.116@tcp:400:default-rzslic16-0 Request processed in 117us (167us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851892.530267:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.116@tcp, seq: 1997615
00000100:00000040:0.0:1773851892.530268:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bc7f1ac : new rpc_count 0
00000100:00000001:0.0:1773851892.530269:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851892.530270:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851892.530271:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851892.530273:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851892.530274:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd570b8d.
00000020:00000040:0.0:1773851892.530276:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000005bc7f1ac : new refcount 5
00000100:00000001:0.0:1773851892.530277:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851892.530286:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851892.530289:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851892.530292:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:1.0:1773851892.530293:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e89b889f
00000400:00000010:1.0:1773851892.530294:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e89b889f.
00000100:00000001:1.0:1773851892.530295:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851892.530296:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851892.530298:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:1.0:1773851892.530300:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Transaction freed
00000004:00000001:8.0:1773851892.553731:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851892.553732:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851892.553732:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000148d1fa7.
00000004:00000001:28.0:1773851892.553733:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:8.0:1773851892.553733:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000004:00000020:28.0:1773851892.553734:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:8.0:1773851892.553734:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:30.0:1773851892.553735:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:29.0:1773851892.553735:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:28.0:1773851892.553735:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a1c0c858.
02000000:00000001:8.0:1773851892.553735:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:8.0:1773851892.553735:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:30.0:1773851892.553736:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:29.0:1773851892.553736:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000010:8.0:1773851892.553736:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000010:30.0:1773851892.553737:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad40347c.
00000100:00000010:29.0:1773851892.553737:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000064cb65c2.
00000020:00000040:28.0:1773851892.553737:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000100:00000001:8.0:1773851892.553737:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:30.0:1773851892.553738:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000020:00000040:29.0:1773851892.553738:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
00000100:00000001:28.0:1773851892.553738:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:8.0:1773851892.553738:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851892.553739:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851892.553739:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851892.553739:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.553740:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851892.553740:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851892.553740:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851892.553740:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851892.553741:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:8.0:1773851892.553741:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000148d1fa7] to pc [ptlrpcd_02_00+0]  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851892.553742:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851892.553742:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
02000000:00000010:28.0:1773851892.553742:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000061a31c4e.
02000000:00000010:30.0:1773851892.553743:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006dbfd28d.
00000100:00000001:29.0:1773851892.553743:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851892.553743:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.553745:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.553745:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851892.553745:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:8.0:1773851892.553745:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851892.553746:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851892.553746:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851892.553746:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851892.553746:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851892.553746:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851892.553747:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851892.553747:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000064cb65c2] to pc [ptlrpcd_07_00+0]  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851892.553747:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:8.0:1773851892.553747:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003e8bde64.
00080000:00000001:8.0:1773851892.553747:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637000503755776 : -107073205795840 : ffff9e9e139a8400)
00000100:00000040:28.0:1773851892.553748:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a1c0c858] to pc [ptlrpcd_07_01+1]  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851892.553748:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851892.553748:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851892.553748:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851892.553748:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:30.0:1773851892.553749:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ad40347c] to pc [ptlrpcd_07_02+2]  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851892.553749:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:8.0:1773851892.553750:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00000100:00000001:9.0:1773851892.553751:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851892.553751:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851892.553751:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005bcf9716.
02000000:00000001:9.0:1773851892.553752:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:8.0:1773851892.553752:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614167007027540ns, next at 614168007026448ns, rc = 0
02000000:00000001:9.0:1773851892.553753:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851892.553753:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:29.0:1773851892.553754:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851892.553754:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00100000:9.0:1773851892.553754:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000148d1fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051938240:2084@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851892.553755:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851892.553755:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.553756:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:29.0:1773851892.553756:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000fe205af8.
00080000:00000010:28.0:1773851892.553756:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000097689a4f.
00000100:00000001:9.0:1773851892.553756:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851892.553756:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:31.0:1773851892.553757:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:29.0:1773851892.553757:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637152461743104 : -106921247808512 : ffff9ec175016400)
00080000:00000001:28.0:1773851892.553757:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637075937667072 : -106997771884544 : ffff9eafa3d0a800)
02000000:00000001:9.0:1773851892.553757:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.553758:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851892.553758:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:9.0:1773851892.553758:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851892.553758:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006107aa26.
00080000:00000001:29.0:1773851892.553759:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:9.0:1773851892.553759:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851892.553760:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851892.553760:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851892.553760:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851892.553760:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00080000:00000001:29.0:1773851892.553761:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851892.553761:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000400:00000010:9.0:1773851892.553761:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00080000:00000010:30.0:1773851892.553762:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f1ad06fd.
00000004:00001000:29.0:1773851892.553762:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00000004:00000010:28.0:1773851892.553762:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000e6300591.
00000400:00000010:9.0:1773851892.553762:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000016999e1e.
00080000:00000001:30.0:1773851892.553763:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637041088273408 : -107032621278208 : ffff9ea786a11c00)
00000004:00000010:29.0:1773851892.553763:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000002eb7af1e.
00000004:00080000:28.0:1773851892.553763:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614167007038360ns, next at 614168007037048ns, rc = 0
00000100:00000200:9.0:1773851892.553763:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938240, portal 4
00000100:00000001:31.0:1773851892.553764:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:30.0:1773851892.553764:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00080000:29.0:1773851892.553764:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614167007039583ns, next at 614168007038090ns, rc = 0
00000100:00000001:9.0:1773851892.553764:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851892.553765:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851892.553765:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:9.0:1773851892.553765:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491252864 : -107117218298752 : ffff9e93d4410480)
02000000:00000001:31.0:1773851892.553766:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851892.553766:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851892.553766:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851892.553766:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851892.553766:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851892.553767:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851892.553767:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00080000:00000001:29.0:1773851892.553767:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851892.553767:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851892.553768:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851892.553768:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00100000:31.0:1773851892.553769:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000064cb65c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051938304:47@kfi7:13:default-yuba2-0
00000004:00000010:30.0:1773851892.553769:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007ee17ad2.
00000100:00000040:9.0:1773851892.553769:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000004:00080000:30.0:1773851892.553770:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614167007045414ns, next at 614168007043861ns, rc = 0
00000400:00000010:9.0:1773851892.553770:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000100:00000001:31.0:1773851892.553771:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:30.0:1773851892.553771:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000200:9.0:1773851892.553771:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938240, offset 0
02000000:00000001:31.0:1773851892.553772:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:9.0:1773851892.553772:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
02000000:00000001:31.0:1773851892.553773:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851892.553773:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851892.553773:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
02000000:00000001:31.0:1773851892.553774:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000001:30.0:1773851892.553774:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851892.553774:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851892.553774:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
02000000:00000010:31.0:1773851892.553775:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bb1c2bcd.
00000100:00000001:29.0:1773851892.553775:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:28.0:1773851892.553775:0:41091:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
02000000:00000001:31.0:1773851892.553776:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.553776:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851892.553776:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851892.553776:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851892.553777:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:30.0:1773851892.553777:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851892.553777:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:9.0:1773851892.553777:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000010:31.0:1773851892.553778:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000100:00000001:30.0:1773851892.553778:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851892.553778:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851892.553778:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851892.553779:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851892.553779:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000010:31.0:1773851892.553780:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002000cf5e.
00000100:00000001:28.0:1773851892.553780:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:31.0:1773851892.553781:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938304, portal 4
00000100:00000001:28.0:1773851892.553781:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851892.553781:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:9.0:1773851892.553781:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770038, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770043, p:4294967295, g:4294967295, h:1000]
00000100:00000001:29.0:1773851892.553782:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851892.553783:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851892.553783:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130262224768 : -106943447326848 : ffff9ebc49cf9f80)
00000100:00000001:29.0:1773851892.553783:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851892.553783:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851892.553783:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851892.553784:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
02000000:00000001:29.0:1773851892.553785:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:9.0:1773851892.553785:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000100:00000040:31.0:1773851892.553786:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851892.553786:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851892.553786:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770044:8770044:1024:4294967295] 2084@kfi7 LPNI seq info [5402750:5402750:16:4294967295]
00000100:00100000:29.0:1773851892.553787:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a1c0c858 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051938368:9@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851892.553787:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000200:9.0:1773851892.553787:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:28.0:1773851892.553788:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.553789:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851892.553789:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000200:9.0:1773851892.553789:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:31.0:1773851892.553790:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:29.0:1773851892.553790:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851892.553790:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851892.553791:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851892.553791:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ad40347c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051938432:2104@kfi7:13:default-yuba2-0
00000100:00000040:31.0:1773851892.553792:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
02000000:00000001:29.0:1773851892.553792:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:9.0:1773851892.553792:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000400:00000010:31.0:1773851892.553793:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000eb85f77.
02000000:00000010:29.0:1773851892.553793:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000077b2db51.
00000100:00000001:28.0:1773851892.553793:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:9.0:1773851892.553793:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000200:31.0:1773851892.553794:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938304, offset 0
02000000:00000001:29.0:1773851892.553794:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851892.553794:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851892.553795:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851892.553795:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:31.0:1773851892.553796:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000200:29.0:1773851892.553796:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
02000000:00000001:28.0:1773851892.553796:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000800:00000200:9.0:1773851892.553796:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000010:29.0:1773851892.553797:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000843b5aa4.
00000400:00000200:31.0:1773851892.553798:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000010:29.0:1773851892.553798:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ecffec9b.
02000000:00000010:28.0:1773851892.553798:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006d31c239.
00000400:00000200:31.0:1773851892.553799:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
02000000:00000001:28.0:1773851892.553799:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851892.553799:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:29.0:1773851892.553800:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938368, portal 4
00000400:00000200:31.0:1773851892.553801:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:29.0:1773851892.553801:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000800:00000200:9.0:1773851892.553801:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Using peer 2084@kfi7(0x103)
00000100:00000001:29.0:1773851892.553802:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324232448 : -106976385319168 : ffff9eb49e8dbf00)
00000400:00000200:31.0:1773851892.553803:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:31.0:1773851892.553804:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000100:00000040:29.0:1773851892.553804:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851892.553804:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x103: rc=0
00000800:00000200:9.0:1773851892.553806:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851892.553807:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770044, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770043, p:4294967295, g:4294967295, h:1000]
00000100:00000001:29.0:1773851892.553808:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:9.0:1773851892.553808:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851892.553808:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:29.0:1773851892.553809:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000100:00000001:9.0:1773851892.553809:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851892.553810:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000010:29.0:1773851892.553810:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089b548b8.
00000100:00000001:9.0:1773851892.553810:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851892.553811:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000200:29.0:1773851892.553811:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938368, offset 0
00000100:00000001:9.0:1773851892.553811:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851892.553812:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000100:00000001:9.0:1773851892.553812:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851892.553812:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851892.553813:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000100:00000001:9.0:1773851892.553813:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:31.0:1773851892.553814:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770045:8770045:1024:4294967295] 47@kfi7 LPNI seq info [5403025:5403025:16:4294967295]
00000100:00000001:9.0:1773851892.553815:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851892.553815:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851892.553815:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851892.553816:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:31.0:1773851892.553817:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:9.0:1773851892.553818:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_EVENT_TX_OK event status 0
00000400:00000200:28.0:1773851892.553819:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:29.0:1773851892.553820:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:28.0:1773851892.553820:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000200:9.0:1773851892.553820:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851892.553821:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851892.553821:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000400:00000200:29.0:1773851892.553822:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000010:28.0:1773851892.553822:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f52a267c.
00000400:00000200:9.0:1773851892.553822:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000400:00000200:31.0:1773851892.553823:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:29.0:1773851892.553823:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000010:9.0:1773851892.553823:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:9.0:1773851892.553823:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:28.0:1773851892.553824:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938432, portal 4
00000100:00000200:9.0:1773851892.553824:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:31.0:1773851892.553825:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:29.0:1773851892.553825:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:28.0:1773851892.553825:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851892.553825:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411245696 : -106960298305920 : ffff9eb85d6a1680)
00000800:00000200:31.0:1773851892.553827:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851892.553827:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000100:00000040:28.0:1773851892.553827:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851892.553827:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851892.553828:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851892.553830:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770044, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770045, p:4294967295, g:4294967295, h:1000]
00000100:00000001:9.0:1773851892.553830:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851892.553831:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:28.0:1773851892.553831:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:9.0:1773851892.553831:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.553832:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:29.0:1773851892.553833:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000040:28.0:1773851892.553833:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000200:29.0:1773851892.553834:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000010:28.0:1773851892.553834:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc38e5ee.
00000800:00000200:9.0:1773851892.553834:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Transaction freed
00000800:00000200:31.0:1773851892.553835:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000100:00000200:28.0:1773851892.553835:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938432, offset 0
00000400:00000200:29.0:1773851892.553836:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000400:00000200:29.0:1773851892.553838:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770046:8770046:1024:4294967295] 9@kfi7 LPNI seq info [5403014:5403014:16:4294967295]
00000400:00000200:28.0:1773851892.553838:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000800:00000200:31.0:1773851892.553840:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000800:00000200:31.0:1773851892.553842:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851892.553842:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:29.0:1773851892.553843:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:28.0:1773851892.553845:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:28.0:1773851892.553846:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:29.0:1773851892.553847:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000100:00000001:31.0:1773851892.553848:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.553849:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851892.553849:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:31.0:1773851892.553850:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851892.553850:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:31.0:1773851892.553852:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851892.553852:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851892.553852:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:31.0:1773851892.553853:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.553854:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:29.0:1773851892.553854:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851892.553854:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000100:00000001:31.0:1773851892.553855:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:25.0:1773851892.553855:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:31.0:1773851892.553856:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:25.0:1773851892.553856:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:31.0:1773851892.553857:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851892.553857:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851892.553857:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770046, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770045, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851892.553858:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851892.553858:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851892.553858:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:28.0:1773851892.553860:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:25.0:1773851892.553860:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851892.553862:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000400:00000200:28.0:1773851892.553862:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:25.0:1773851892.553862:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:28.0:1773851892.553863:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000400:00000200:25.0:1773851892.553863:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2084@kfi7 : PUT - for me
00000400:00000200:25.0:1773851892.553864:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:28.0:1773851892.553865:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770047:8770047:1023:4294967295] 2104@kfi7 LPNI seq info [5403382:5403382:16:4294967295]
00000400:00000200:25.0:1773851892.553865:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:25.0:1773851892.553866:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:29.0:1773851892.553867:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x31e: rc=0
00000400:00000200:28.0:1773851892.553867:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:25.0:1773851892.553867:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:25.0:1773851892.553868:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:28.0:1773851892.553869:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:25.0:1773851892.553869:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:29.0:1773851892.553870:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:25.0:1773851892.553870:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5dc0
00000400:00000200:25.0:1773851892.553871:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851892.553872:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b82ef9 [1] + 224
00000100:00000001:29.0:1773851892.553873:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.553874:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:28.0:1773851892.553874:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000800:00000200:25.0:1773851892.553874:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:29.0:1773851892.553875:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.553876:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851892.553876:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:25.0:1773851892.553876:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851892.553877:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851892.553878:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000001:29.0:1773851892.553879:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:25.0:1773851892.553879:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851892.553880:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000200:25.0:1773851892.553880:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851892.553881:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851892.553881:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851892.553882:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.553883:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851892.553883:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851892.553886:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:29.0:1773851892.553887:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000800:00000200:28.0:1773851892.553887:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:25.0:1773851892.553887:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:25.0:1773851892.553888:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000800:00000200:28.0:1773851892.553889:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851892.553889:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851892.553889:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:30.0:1773851892.553890:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851892.553890:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:9.0:1773851892.553890:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:29.0:1773851892.553891:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000400:00000001:9.0:1773851892.553891:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851892.553892:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000eb85f77
00000400:00000010:9.0:1773851892.553892:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000400:00000200:30.0:1773851892.553893:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:28.0:1773851892.553893:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851892.553893:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000016999e1e
00000400:00000010:9.0:1773851892.553893:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000016999e1e.
00000400:00000010:29.0:1773851892.553894:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000eb85f77.
00000100:00000001:9.0:1773851892.553894:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851892.553895:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000100:00000001:29.0:1773851892.553895:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851892.553895:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851892.553896:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089b548b8
00000100:00000200:29.0:1773851892.553896:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851892.553897:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089b548b8.
00000800:00000200:28.0:1773851892.553897:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000100:00000200:9.0:1773851892.553898:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851892.553899:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851892.553900:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851892.553901:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851892.553901:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851892.553901:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851892.553902:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:29.0:1773851892.553903:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851892.553903:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
02000000:00000001:9.0:1773851892.553903:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851892.553903:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851892.553904:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.553905:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:28.0:1773851892.553905:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
02000000:00000001:9.0:1773851892.553905:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851892.553906:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:9.0:1773851892.553906:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=125 v=66 (66 66 66 66)
00000100:00000001:29.0:1773851892.553907:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851892.553907:0:41068:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=125 v=66 (1 1 1 1)
00000100:00000001:29.0:1773851892.553908:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:28.0:1773851892.553908:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851892.553908:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:29.0:1773851892.553909:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:9.0:1773851892.553909:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851892.553909:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851892.553910:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851892.553910:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.553911:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851892.553911:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000100:00000001:28.0:1773851892.553911:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851892.553911:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851892.553911:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000400:00000200:30.0:1773851892.553912:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:9.0:1773851892.553912:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851892.553912:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851892.553913:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851892.553914:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851892.553914:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:30.0:1773851892.553915:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000100:00000001:28.0:1773851892.553916:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851892.553918:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851892.553919:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851892.553919:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851892.553920:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851892.553921:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851892.553921:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593655296 avail=351576848384 avail_mb=1373347064 hwm_mb=3131103 files=372189919 ffree=343353179 state=0: rc = 0
00000004:00000020:9.0:1773851892.553923:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593655296 free, 351576848384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372189919 files, 343353179 free files
00000800:00000200:29.0:1773851892.553924:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000004:00000001:9.0:1773851892.553925:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851892.553926:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:9.0:1773851892.553926:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:5.0:1773851892.553926:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851892.553927:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851892.553928:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000400:00000200:29.0:1773851892.553929:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc38e5ee
00000100:00100000:9.0:1773851892.553929:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000148d1fa7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051938240:2084@kfi7:13:default-yuba2-0
00000400:00000010:29.0:1773851892.553930:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc38e5ee.
00000100:00000001:9.0:1773851892.553930:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851892.553930:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:29.0:1773851892.553931:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851892.553931:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:29.0:1773851892.553932:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851892.553932:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000148d1fa7 x1859433051938240/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:5.0:1773851892.553933:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:29.0:1773851892.553936:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851892.553936:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:9.0:1773851892.553937:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:29.0:1773851892.553938:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851892.553938:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000200:5.0:1773851892.553938:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
02000000:00000010:9.0:1773851892.553939:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006107aa26.
02000000:00000001:9.0:1773851892.553940:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000400:00000200:5.0:1773851892.553940:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:29.0:1773851892.553941:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851892.553941:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851892.553941:0:41068:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000400:00000200:5.0:1773851892.553941:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000001:29.0:1773851892.553942:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000020:00000001:9.0:1773851892.553942:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851892.553942:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:9.0:1773851892.553943:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000200:5.0:1773851892.553943:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:29.0:1773851892.553944:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
02000000:00000001:9.0:1773851892.553944:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851892.553944:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000148d1fa7.
00000400:00000200:5.0:1773851892.553944:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:9.0:1773851892.553945:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000800:00000200:29.0:1773851892.553946:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Transaction freed
00000100:00000001:9.0:1773851892.553946:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851892.553946:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851892.553946:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:5.0:1773851892.553948:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:9.0:1773851892.553949:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851892.553949:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851892.553949:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5e40
00000100:00000001:9.0:1773851892.553950:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851892.553950:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851892.553951:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.553953:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b31f85 [1] + 224
00000800:00000200:5.0:1773851892.553957:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851892.553959:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851892.553960:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851892.553960:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851892.553962:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851892.553962:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000100:00000001:5.0:1773851892.553964:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851892.553965:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:5.0:1773851892.553965:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851892.553969:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.553970:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000100:00000040:5.0:1773851892.553971:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851892.553972:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.553973:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:13.0:1773851892.553975:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.553976:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:13.0:1773851892.553977:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000001:5.0:1773851892.553977:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851892.553978:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:29.0:1773851892.553979:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851892.553979:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:29.0:1773851892.553980:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:13.0:1773851892.553980:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5e80
00000800:00000200:5.0:1773851892.553981:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:29.0:1773851892.553982:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851892.553982:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:13.0:1773851892.553982:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000010:29.0:1773851892.553984:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000843b5aa4.
00000400:00000200:13.0:1773851892.553984:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f6e8d [1] + 224
00000400:00000200:29.0:1773851892.553985:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ecffec9b
00000400:00000010:29.0:1773851892.553985:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ecffec9b.
00000100:00000001:29.0:1773851892.553986:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851892.553987:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:29.0:1773851892.553988:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851892.553989:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.553991:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000100:00000200:29.0:1773851892.553993:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851892.553993:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:13.0:1773851892.553995:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851892.553997:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851892.553997:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851892.553999:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851892.553999:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:13.0:1773851892.553999:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851892.554000:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851892.554001:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851892.554002:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851892.554004:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=125 v=66 (66 66 66 66)
00000100:00000001:13.0:1773851892.554005:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:29.0:1773851892.554006:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=46 v=66 (1 1 1 1)
00000400:00000200:13.0:1773851892.554007:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:29.0:1773851892.554008:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851892.554008:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851892.554009:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851892.554009:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851892.554009:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:13.0:1773851892.554009:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00010000:00000001:29.0:1773851892.554010:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:28.0:1773851892.554011:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:29.0:1773851892.554012:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851892.554012:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000400:00000001:28.0:1773851892.554012:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851892.554013:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:28.0:1773851892.554013:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000001:29.0:1773851892.554014:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851892.554014:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f52a267c
00000400:00000010:28.0:1773851892.554015:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f52a267c.
00000100:00000040:29.0:1773851892.554016:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851892.554016:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:28.0:1773851892.554017:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851892.554020:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851892.554021:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851892.554022:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:28.0:1773851892.554022:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:29.0:1773851892.554023:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851892.554024:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000004:00000040:29.0:1773851892.554026:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480020992 avail=351478733824 avail_mb=1372963804 hwm_mb=3131101 files=372073052 ffree=343242208 state=0: rc = 0
00000100:00000001:28.0:1773851892.554026:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851892.554027:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851892.554028:0:41091:0:(client.c:1428:after_reply()) Process entered
00000004:00000020:29.0:1773851892.554029:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480020992 free, 351478733824 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073052 files, 343242208 free files
02000000:00000001:28.0:1773851892.554029:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851892.554029:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851892.554030:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851892.554031:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851892.554032:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851892.554033:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:28.0:1773851892.554033:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=125 v=66 (66 66 66 66)
00000100:00001000:28.0:1773851892.554035:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=125 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851892.554036:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851892.554037:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851892.554038:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a1c0c858 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051938368:9@kfi7:13:default-yuba2-0
00010000:00000001:28.0:1773851892.554038:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:28.0:1773851892.554039:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.554040:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851892.554040:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:29.0:1773851892.554041:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851892.554041:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000040:29.0:1773851892.554042:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a1c0c858 x1859433051938368/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851892.554042:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851892.554043:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851892.554044:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851892.554046:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851892.554047:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851892.554048:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000077b2db51.
00000100:00000001:28.0:1773851892.554048:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851892.554049:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:29.0:1773851892.554050:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851892.554050:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851892.554050:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:29.0:1773851892.554051:0:41089:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000004:00000001:28.0:1773851892.554051:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000001:29.0:1773851892.554052:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851892.554053:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000061a31c4e.
00000004:00000040:28.0:1773851892.554053:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
02000000:00000001:29.0:1773851892.554054:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000040:28.0:1773851892.554054:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615818752 avail=351613224960 avail_mb=1373489160 hwm_mb=3131103 files=372043334 ffree=343374823 state=0: rc = 0
02000000:00000001:29.0:1773851892.554055:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851892.554056:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a1c0c858.
00000100:00000001:29.0:1773851892.554057:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851892.554057:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:28.0:1773851892.554057:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615818752 free, 351613224960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043334 files, 343374823 free files
00000100:00000001:29.0:1773851892.554058:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851892.554059:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.554060:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851892.554060:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851892.554061:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:28.0:1773851892.554061:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851892.554062:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851892.554065:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ad40347c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051938432:2104@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851892.554068:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851892.554069:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851892.554070:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ad40347c x1859433051938432/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851892.554074:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851892.554075:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851892.554075:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006d31c239.
02000000:00000001:28.0:1773851892.554077:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851892.554078:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851892.554078:0:41091:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000020:00000001:28.0:1773851892.554079:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851892.554080:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006dbfd28d.
02000000:00000001:28.0:1773851892.554081:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851892.554082:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851892.554083:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ad40347c.
00000100:00000001:28.0:1773851892.554084:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851892.554085:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851892.554086:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851892.554087:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851892.554087:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851892.554088:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851892.554089:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851892.554688:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851892.554688:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851892.554690:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851892.554692:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851892.554693:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.554695:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000400:00000200:21.0:1773851892.554696:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.554696:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:21.0:1773851892.554697:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.554698:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:21.0:1773851892.554699:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:21.0:1773851892.554700:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.554701:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5e00
00000400:00000200:21.0:1773851892.554702:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.554703:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d1bd5 [1] + 224
00000800:00000200:21.0:1773851892.554705:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851892.554707:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.554708:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000100:00000001:21.0:1773851892.554710:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851892.554711:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851892.554713:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851892.554717:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851892.554718:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:31.0:1773851892.554719:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851892.554719:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851892.554719:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851892.554720:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851892.554721:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851892.554721:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:31.0:1773851892.554722:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002000cf5e
00000400:00000010:31.0:1773851892.554722:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002000cf5e.
00000100:00000001:31.0:1773851892.554723:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:31.0:1773851892.554724:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851892.554730:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851892.554732:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851892.554733:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.554733:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851892.554734:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851892.554734:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851892.554735:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851892.554735:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851892.554736:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=125 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851892.554737:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=125 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851892.554738:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851892.554739:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851892.554739:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851892.554740:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.554741:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851892.554741:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00000001:31.0:1773851892.554742:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851892.554742:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851892.554743:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851892.554745:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851892.554746:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851892.554746:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851892.554747:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851892.554748:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851892.554748:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603970048 avail=351601693696 avail_mb=1373444116 hwm_mb=3131103 files=372190402 ffree=343363252 state=0: rc = 0
00000004:00000020:31.0:1773851892.554750:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603970048 free, 351601693696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190402 files, 343363252 free files
00000004:00000001:31.0:1773851892.554752:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851892.554753:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851892.554755:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000064cb65c2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051938304:47@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851892.554757:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.554758:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851892.554758:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000064cb65c2 x1859433051938304/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852045 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851892.554760:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851892.554761:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851892.554761:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bb1c2bcd.
02000000:00000001:31.0:1773851892.554762:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851892.554762:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851892.554763:0:41088:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000020:00000001:31.0:1773851892.554764:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851892.554764:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
02000000:00000001:31.0:1773851892.554765:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851892.554766:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851892.554766:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000064cb65c2.
00000100:00000001:31.0:1773851892.554767:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851892.554767:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.554768:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.554769:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851892.554769:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.554769:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851892.554770:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851892.559161:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851892.559161:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851892.559162:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851892.559164:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851892.559166:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23363@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.559167:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23363@kfi7 : PUT - for me
00000400:00000200:21.0:1773851892.559168:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23363@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.559169:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5721c8c nid 23363@kfi7 refs 1
00000400:00000200:21.0:1773851892.559170:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23363@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.559171:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5721c8c nid 23363@kfi7 refs 2
00000400:00000200:21.0:1773851892.559172:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f5721c8c nid 23363@kfi7 refs 3
00000400:00000200:21.0:1773851892.559173:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23362@kfi7 to cpt 2
00000400:00000200:21.0:1773851892.559173:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23362@kfi7 of length 224 into portal 12 MB=0x69b0a2333da00
00000400:00000200:21.0:1773851892.559175:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23362@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 60456
00000800:00000200:21.0:1773851892.559176:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851892.559178:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.559179:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23363@kfi7: PUT: OK
00000100:00000001:21.0:1773851892.559180:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851892.559180:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851892.559181:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f58b8666.
00000100:00000040:21.0:1773851892.559182:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000f58b8666 x1859317702842880 msgsize 224
00000100:00100000:21.0:1773851892.559184:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23362@kfi7 (source: 12345-23363@kfi7)
00000100:00000001:21.0:1773851892.559184:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851892.559185:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f5721c8c nid 23363@kfi7 refs 2
00000100:00000001:20.0:1773851892.559186:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851892.559187:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851892.559187:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851892.559188:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851892.559188:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851892.559189:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851892.559190:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317702842880
00000020:00000001:20.0:1773851892.559191:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851892.559191:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b51
00000020:00000001:20.0:1773851892.559192:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851892.559196:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003d42b715 refcount=6
00000020:00000001:20.0:1773851892.559197:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743689216 : -107128965862400 : ffff9e91180b6c00)
00000020:00000001:20.0:1773851892.559198:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743689216 : -107128965862400 : ffff9e91180b6c00)
00000100:00000001:20.0:1773851892.559199:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851892.559199:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851892.559200:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851892.559201:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851892.559202:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000032ef7456.
00000100:00000001:20.0:1773851892.559203:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851892.559203:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851892.559204:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851892.559205:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851892.559206:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851892.559206:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.559207:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.559208:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851892.559208:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851892.559209:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851892.559209:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851892.559210:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23362@kfi7, seq: 1998062
00000100:00000001:23.0:1773851892.559211:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851892.559211:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003d42b715 : new rpc_count 1
00000100:00000001:23.0:1773851892.559212:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.559212:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134769009024 : -106938940542592 : ffff9ebd566fb180)
00000100:00000040:20.0:1773851892.559213:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f58b8666 x1859317702842880/t0(0) o400->b2dd9c80-227b-4b98-8326-c624d19a563a@23362@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1960-0'
00000100:00000001:20.0:1773851892.559215:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851892.559216:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851892.559217:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f58b8666 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b2dd9c80-227b-4b98-8326-c624d19a563a+6:39544:x1859317702842880:12345-23362@kfi7:400:default-tuolumne1960-0
00000100:00000200:20.0:1773851892.559220:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317702842880
00000020:00000001:20.0:1773851892.559221:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851892.559221:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851892.559222:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.559223:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851892.559223:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851892.559224:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851892.559225:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317702842880, found 0 last_xid 1859317702842879
00000020:00000001:20.0:1773851892.559226:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851892.559227:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851892.559227:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851892.559228:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.559228:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851892.559229:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851892.559230:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851892.559231:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c6c2f2d2.
02000000:00000001:20.0:1773851892.559232:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.559232:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.559233:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851892.559234:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044129238, transno 0, xid 1859317702842880
00010000:00000001:20.0:1773851892.559235:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851892.559235:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f58b8666 x1859317702842880/t0(0) o400->b2dd9c80-227b-4b98-8326-c624d19a563a@23362@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1960-0'
00010000:00000001:20.0:1773851892.559238:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851892.559238:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851892.559239:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=125 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851892.559240:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851892.559241:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d62b98f0 refcount 3 to 23362@kfi7
00000100:00000001:20.0:1773851892.559242:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551676224 : -107156157875392 : ffff9e8ac3463b40)
02000000:00000001:20.0:1773851892.559243:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851892.559243:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.559244:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851892.559245:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23363@kfi7
00000400:00000010:20.0:1773851892.559245:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b0b46066.
00000100:00000200:20.0:1773851892.559247:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317702842880, offset 224
00000400:00000200:20.0:1773851892.559248:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23363@kfi7
00000400:00000200:20.0:1773851892.559249:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23363@kfi7 to cpt 5
00000400:00000200:20.0:1773851892.559250:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5721c8c nid 23363@kfi7 refs 1
00000400:00000200:20.0:1773851892.559251:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f5721c8c nid 23363@kfi7 refs 2
00000400:00000200:20.0:1773851892.559253:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f5721c8c nid 23363@kfi7 refs 3
00000400:00000200:20.0:1773851892.559254:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23363@kfi7 local destination
00000400:00000200:20.0:1773851892.559255:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770048:8770048:1024:4294967295] 23363@kfi7 LPNI seq info [432847:432847:16:4294967295]
00000400:00000200:20.0:1773851892.559257:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f5721c8c nid 23363@kfi7 refs 2
00000400:00000200:20.0:1773851892.559257:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23363@kfi7 to cpt 5
00000400:00000200:20.0:1773851892.559259:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23363@kfi7(23363@kfi7:23363@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851892.559261:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f5721c8c nid 23363@kfi7 refs 3
00000800:00000200:20.0:1773851892.559262:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851892.559263:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851892.559265:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851892.559268:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb33 Using peer 23363@kfi7(0xb33)
00000800:00000200:20.0:1773851892.559271:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0xb33: rc=0
00000800:00000200:20.0:1773851892.559272:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb33 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851892.559274:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851892.559275:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d62b98f0 refcount 2 to 23362@kfi7
00010000:00000001:20.0:1773851892.559276:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851892.559276:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.559277:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851892.559278:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f58b8666 x1859317702842880/t0(0) o400->b2dd9c80-227b-4b98-8326-c624d19a563a@23362@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1960-0'
00000100:00100000:20.0:1773851892.559282:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f58b8666 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b2dd9c80-227b-4b98-8326-c624d19a563a+6:39544:x1859317702842880:12345-23362@kfi7:400:default-tuolumne1960-0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851892.559285:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23362@kfi7, seq: 1998062
00000100:00000040:20.0:1773851892.559286:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003d42b715 : new rpc_count 0
00000100:00000001:20.0:1773851892.559287:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851892.559287:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851892.559288:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851892.559289:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000032ef7456.
00000020:00000010:20.0:1773851892.559290:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000020:00000040:20.0:1773851892.559290:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000003d42b715 : new refcount 5
00000100:00000001:20.0:1773851892.559291:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851892.559296:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb33 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851892.559298:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.559299:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23363@kfi7: PUT: OK
00000400:00000200:21.0:1773851892.559300:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b0b46066
00000400:00000010:21.0:1773851892.559300:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b0b46066.
00000100:00000001:21.0:1773851892.559301:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851892.559302:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851892.559302:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f5721c8c nid 23363@kfi7 refs 2
00000800:00000200:21.0:1773851892.559304:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 23363@kfi7(000000009c94c598):0x0 lsk 2868 rsk 47 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb33 Transaction freed
00000800:00000200:17.0:1773851892.581977:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851892.581978:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851892.581979:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851892.581979:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851892.581981:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851892.581981:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851892.581984:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851892.581984:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15938@kfi7(00000000693a7e19):0x5b2 version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851892.581987:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000800:00000200:17.0:1773851892.581987:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 Using peer 15938@kfi7(0x5b2)
00000400:00000200:18.0:1773851892.581989:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15938@kfi7 : PUT - for me
00000400:00000200:18.0:1773851892.581991:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:18.0:1773851892.581992:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 1
00000400:00000200:18.0:1773851892.581994:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:18.0:1773851892.581995:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000400:00000200:18.0:1773851892.581997:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 3
00000400:00000200:17.0:1773851892.581998:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:18.0:1773851892.581999:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16002@kfi7 to cpt 7
00000400:00000200:18.0:1773851892.582001:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16002@kfi7 of length 456 into portal 12 MB=0x69b4b78f03780
00000800:00000200:17.0:1773851892.582001:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x5b2: rc=0
00000400:00000200:18.0:1773851892.582003:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16002@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 40952
00000800:00000200:17.0:1773851892.582003:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:18.0:1773851892.582006:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851892.582009:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851892.582010:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15938@kfi7: PUT: OK
00000100:00000001:18.0:1773851892.582012:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851892.582012:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851892.582014:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004eca501c.
00000100:00000040:18.0:1773851892.582015:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000004eca501c x1859598314125184 msgsize 456
00000100:00100000:18.0:1773851892.582017:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-16002@kfi7 (source: 12345-15938@kfi7)
00000800:00000200:19.0:1773851892.582019:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851892.582019:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851892.582021:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000100:00000001:17.0:1773851892.582022:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851892.582022:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:19.0:1773851892.582023:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 Transaction freed
00000800:00000200:18.0:1773851892.582023:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851892.582023:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851892.582024:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851892.582025:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851892.582026:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598314125184
00000020:00000001:17.0:1773851892.582027:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851892.582028:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d816ec
00000020:00000001:17.0:1773851892.582029:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851892.582030:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d2bd243c refcount=4330
00000020:00000001:17.0:1773851892.582031:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110101426176 : -106963608125440 : ffff9eb798224000)
00000020:00000001:17.0:1773851892.582032:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110101426176 : -106963608125440 : ffff9eb798224000)
00000100:00000001:17.0:1773851892.582034:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851892.582035:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851892.582036:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000455b6f1c.
00000020:00000010:17.0:1773851892.582037:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851892.582039:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851892.582040:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851892.582041:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851892.582042:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.582043:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.582045:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851892.582047:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851892.582047:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851892.582048:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851892.582048:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851892.582049:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16002@kfi7, seq: 323103292
00000100:00000040:17.0:1773851892.582051:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d2bd243c : new rpc_count 22
00000100:00000001:16.0:1773851892.582051:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.582052:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609988480 : -107015099563136 : ffff9eab9b014380)
00000100:00000001:16.0:1773851892.582052:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851892.582054:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004eca501c x1859598314125184/t0(0) o17->cb351f9e-4d35-44da-826f-555f023ed859@16002@kfi7:175/0 lens 456/0 e 0 to 0 dl 1773852290 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1496-0'
00000100:00000001:17.0:1773851892.582059:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851892.582060:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851892.582061:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004eca501c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cb351f9e-4d35-44da-826f-555f023ed859+4330:39554:x1859598314125184:12345-16002@kfi7:17:default-tuolumne1496-0
00000100:00000200:17.0:1773851892.582063:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598314125184
00000020:00000001:17.0:1773851892.582064:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851892.582065:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851892.582066:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.582067:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851892.582068:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:17.0:1773851892.582069:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851892.582070:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598314125184, found 0 last_xid 1859598313386943
00000020:00000001:17.0:1773851892.582071:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851892.582072:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851892.582073:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851892.582074:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:17.0:1773851892.582075:0:60961:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:17.0:1773851892.582076:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851892.582077:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851892.582079:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000003bcf62b1.
02000000:00000001:17.0:1773851892.582080:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.582081:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.582082:0:60961:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:17.0:1773851892.582083:0:60961:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:17.0:1773851892.582084:0:60961:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:17.0:1773851892.582087:0:60961:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.582088:0:60961:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:17.0:1773851892.582089:0:60961:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli cb351f9e-4d35-44da-826f-555f023ed859/00000000d2bd243c free: 126633370845184 avail: 126633368748032
00000020:00000001:17.0:1773851892.582091:0:60961:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:17.0:1773851892.582092:0:60961:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli cb351f9e-4d35-44da-826f-555f023ed859/00000000d2bd243c avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:17.0:1773851892.582094:0:60961:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:17.0:1773851892.582095:0:60961:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:17.0:1773851892.582097:0:60961:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli cb351f9e-4d35-44da-826f-555f023ed859/00000000d2bd243c reports grant 1797783551 dropped 0, local 1882456063
00000020:00000001:17.0:1773851892.582099:0:60961:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:17.0:1773851892.582099:0:60961:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:17.0:1773851892.582100:0:60961:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851892.582101:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586029, transno 0, xid 1859598314125184
00010000:00000001:17.0:1773851892.582103:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851892.582104:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004eca501c x1859598314125184/t0(0) o17->cb351f9e-4d35-44da-826f-555f023ed859@16002@kfi7:175/0 lens 456/432 e 0 to 0 dl 1773852290 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1496-0'
00010000:00000001:17.0:1773851892.582108:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851892.582109:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851892.582110:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=125 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851892.582112:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851892.582113:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000071723241 refcount 3 to 16002@kfi7
00000100:00000001:17.0:1773851892.582115:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869933536 : -107137839618080 : ffff9e8f0720a7e0)
02000000:00000001:17.0:1773851892.582116:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851892.582117:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.582118:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851892.582119:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15938@kfi7
00000400:00000010:17.0:1773851892.582120:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d429eef8.
00000100:00000200:17.0:1773851892.582122:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598314125184, offset 224
00000400:00000200:17.0:1773851892.582124:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15938@kfi7
00000400:00000200:17.0:1773851892.582125:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.582127:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 1
00000400:00000200:17.0:1773851892.582128:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000400:00000200:17.0:1773851892.582130:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 3
00000400:00000200:17.0:1773851892.582132:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15938@kfi7 local destination
00000400:00000200:17.0:1773851892.582135:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770049:8770049:1024:4294967295] 15938@kfi7 LPNI seq info [7281081:7281081:16:4294967295]
00000400:00000200:17.0:1773851892.582137:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000400:00000200:17.0:1773851892.582138:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15938@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.582141:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15938@kfi7(15938@kfi7:15938@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851892.582143:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 3
00000800:00000200:17.0:1773851892.582145:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851892.582147:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:17.0:1773851892.582151:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851892.582154:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 Using peer 15938@kfi7(0x5b2)
00000800:00000200:17.0:1773851892.582159:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 532 bytes to peer 0x5b2: rc=0
00000800:00000200:17.0:1773851892.582161:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851892.582164:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851892.582166:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000071723241 refcount 2 to 16002@kfi7
00010000:00000001:17.0:1773851892.582167:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851892.582168:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.582169:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851892.582170:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004eca501c x1859598314125184/t0(0) o17->cb351f9e-4d35-44da-826f-555f023ed859@16002@kfi7:175/0 lens 456/432 e 0 to 0 dl 1773852290 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1496-0'
00000100:00100000:17.0:1773851892.582175:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004eca501c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:cb351f9e-4d35-44da-826f-555f023ed859+4330:39554:x1859598314125184:12345-16002@kfi7:17:default-tuolumne1496-0 Request processed in 115us (159us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851892.582176:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851892.582179:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:17.0:1773851892.582179:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16002@kfi7, seq: 323103292
00000400:00000200:18.0:1773851892.582180:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15938@kfi7: PUT: OK
00000100:00000040:17.0:1773851892.582180:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d2bd243c : new rpc_count 21
00000400:00000200:18.0:1773851892.582182:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d429eef8
00000100:00000001:17.0:1773851892.582182:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851892.582182:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:18.0:1773851892.582183:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d429eef8.
00000020:00000010:17.0:1773851892.582183:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000100:00000001:18.0:1773851892.582184:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:17.0:1773851892.582184:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000100:00000001:18.0:1773851892.582185:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851892.582186:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000073f480fe nid 15938@kfi7 refs 2
00000020:00000010:17.0:1773851892.582186:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000455b6f1c.
00000020:00000040:17.0:1773851892.582187:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000d2bd243c : new refcount 4329
00000800:00000200:18.0:1773851892.582188:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2069@kfi7:4 -> 15938@kfi7(00000000693a7e19):0x0 lsk 1459 rsk 18 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5b2 Transaction freed
00000100:00000001:17.0:1773851892.582188:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.588896:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.588897:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.588898:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.588900:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.588902:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.588903:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.119@tcp : PUT - for me
00000400:00000200:9.0:1773851892.588904:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.588905:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851892.588907:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.119@tcp to cpt 3
00000400:00000200:9.0:1773851892.588908:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001fe12d60 nid 172.16.70.119@tcp refs 2
00000400:00000200:9.0:1773851892.588909:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001fe12d60 nid 172.16.70.119@tcp refs 3
00000400:00000200:9.0:1773851892.588910:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.119@tcp to cpt 3
00000400:00000200:9.0:1773851892.588911:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.119@tcp of length 224 into portal 12 MB=0x69a0ee3468600
00000400:00000200:9.0:1773851892.588912:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.119@tcp of length 224/224 into md 0x82a36e8ed [64] + 49632
00000800:00000200:9.0:1773851892.588915:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.588917:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.588918:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.588919:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.588919:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.588920:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e41d50d3.
00000100:00000040:9.0:1773851892.588921:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e41d50d3 x1858238593533440 msgsize 224
00000100:00100000:9.0:1773851892.588922:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.119@tcp (source: 12345-172.16.70.119@tcp)
00000100:00000001:9.0:1773851892.588924:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.588925:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851892.588926:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851892.588927:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851892.588928:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851892.588928:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851892.588929:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851892.588930:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851892.588930:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858238593533440
00000020:00000001:12.0:1773851892.588932:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851892.588932:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93091
00000020:00000001:12.0:1773851892.588933:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851892.588936:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006ec76d24 refcount=6
00000020:00000001:12.0:1773851892.588936:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745154560 : -107128964397056 : ffff9e911821c800)
00000020:00000001:12.0:1773851892.588937:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745154560 : -107128964397056 : ffff9e911821c800)
00000100:00000001:12.0:1773851892.588938:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851892.588939:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851892.588939:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057ada156.
00000020:00000010:12.0:1773851892.588940:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851892.588941:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000028d2b47d.
00000100:00000001:12.0:1773851892.588942:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851892.588943:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851892.588943:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851892.588944:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851892.588945:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851892.588945:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.588946:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851892.588948:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851892.588948:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851892.588948:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851892.588949:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851892.588949:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.119@tcp, seq: 2289910
00000100:00000001:15.0:1773851892.588950:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851892.588950:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006ec76d24 : new rpc_count 1
00000100:00000001:15.0:1773851892.588951:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.588951:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637017541453952 : -107056168097664 : ffff9ea20b212880)
00000100:00000040:12.0:1773851892.588953:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e41d50d3 x1858238593533440/t0(0) o400->63804388-2fb2-4818-9b96-17c9f775cfc8@172.16.70.119@tcp:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic19-0'
00000100:00000001:12.0:1773851892.588955:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851892.588956:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851892.588957:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e41d50d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:63804388-2fb2-4818-9b96-17c9f775cfc8+6:50025:x1858238593533440:12345-172.16.70.119@tcp:400:default-rzslic19-0
00000100:00000200:12.0:1773851892.588958:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858238593533440
00000020:00000001:12.0:1773851892.588958:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851892.588959:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851892.588960:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.588961:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851892.588961:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851892.588962:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851892.588963:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858238593533440, found 0 last_xid 1858238593533439
00000020:00000001:12.0:1773851892.588963:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851892.588964:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851892.588964:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851892.588965:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.588965:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851892.588966:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851892.588966:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851892.588967:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000380f7712.
02000000:00000001:12.0:1773851892.588968:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.588968:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.588969:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851892.588970:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858238593533440
00010000:00000001:12.0:1773851892.588970:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851892.588971:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e41d50d3 x1858238593533440/t0(0) o400->63804388-2fb2-4818-9b96-17c9f775cfc8@172.16.70.119@tcp:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic19-0'
00010000:00000001:12.0:1773851892.588973:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851892.588974:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851892.588974:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=125 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851892.588975:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851892.588976:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a4e3416c refcount 3 to 172.16.70.119@tcp
00000100:00000001:12.0:1773851892.588977:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717421632 : -107155992129984 : ffff9e8acd274e40)
02000000:00000001:12.0:1773851892.588977:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851892.588978:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.588979:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851892.588979:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.119@tcp
00000400:00000010:12.0:1773851892.588980:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018d1ad92.
00000100:00000200:12.0:1773851892.588981:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858238593533440, offset 224
00000400:00000200:12.0:1773851892.588983:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.119@tcp
00000400:00000200:12.0:1773851892.588984:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.119@tcp to cpt 3
00000400:00000200:12.0:1773851892.588985:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001fe12d60 nid 172.16.70.119@tcp refs 2
00000400:00000200:12.0:1773851892.588986:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001fe12d60 nid 172.16.70.119@tcp refs 3
00000400:00000200:12.0:1773851892.588989:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001fe12d60 nid 172.16.70.119@tcp refs 4
00000400:00000200:12.0:1773851892.588990:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.119@tcp routed destination
00000400:00000200:12.0:1773851892.588991:0:60487:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:12.0:1773851892.588993:0:60487:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:12.0:1773851892.588994:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.119@tcp: rtr pref emtpy: 1
00000400:00000200:12.0:1773851892.588995:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:12.0:1773851892.588996:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.119@tcp: rtr pref emtpy: 1
00000400:00000200:12.0:1773851892.588997:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:12.0:1773851892.588998:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770050:8770050:1024:4294967295] 2094@kfi7 LPNI seq info [1258747019:1258747019:16:4294967295]
00000400:00000200:12.0:1773851892.589000:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:12.0:1773851892.589001:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:12.0:1773851892.589004:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.119@tcp(172.16.70.119@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851892.589005:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001fe12d60 nid 172.16.70.119@tcp refs 3
00000800:00000200:12.0:1773851892.589006:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851892.589008:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851892.589010:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851892.589012:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:12.0:1773851892.589015:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:12.0:1773851892.589017:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851892.589018:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851892.589019:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a4e3416c refcount 2 to 172.16.70.119@tcp
00010000:00000001:12.0:1773851892.589020:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851892.589020:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.589021:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851892.589023:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e41d50d3 x1858238593533440/t0(0) o400->63804388-2fb2-4818-9b96-17c9f775cfc8@172.16.70.119@tcp:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic19-0'
00000100:00100000:12.0:1773851892.589029:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e41d50d3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:63804388-2fb2-4818-9b96-17c9f775cfc8+6:50025:x1858238593533440:12345-172.16.70.119@tcp:400:default-rzslic19-0 Request processed in 73us (107us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851892.589031:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.119@tcp, seq: 2289910
00000100:00000040:12.0:1773851892.589032:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006ec76d24 : new rpc_count 0
00000100:00000001:12.0:1773851892.589033:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851892.589033:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851892.589034:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851892.589034:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000028d2b47d.
00000020:00000010:12.0:1773851892.589035:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057ada156.
00000020:00000040:12.0:1773851892.589036:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000006ec76d24 : new refcount 5
00000100:00000001:12.0:1773851892.589037:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851892.589043:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851892.589045:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.589046:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:13.0:1773851892.589046:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018d1ad92
00000400:00000010:13.0:1773851892.589047:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018d1ad92.
00000100:00000001:13.0:1773851892.589047:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851892.589048:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851892.589049:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:13.0:1773851892.589051:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00000800:00000200:13.0:1773851892.598633:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851892.598635:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851892.598637:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851892.598641:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851892.598644:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10864@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.598647:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10864@kfi7 : PUT - for me
00000400:00000200:13.0:1773851892.598648:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10864@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.598650:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9e9f68d nid 10864@kfi7 refs 1
00000400:00000200:13.0:1773851892.598652:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10864@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.598653:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9e9f68d nid 10864@kfi7 refs 2
00000400:00000200:13.0:1773851892.598655:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a9e9f68d nid 10864@kfi7 refs 3
00000400:00000200:13.0:1773851892.598657:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10864@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.598658:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10864@kfi7 of length 224 into portal 12 MB=0x699e1162f33c0
00000400:00000200:13.0:1773851892.598661:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10864@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 49856
00000800:00000200:13.0:1773851892.598664:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851892.598667:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.598669:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10864@kfi7: PUT: OK
00000100:00000001:13.0:1773851892.598671:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851892.598671:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851892.598673:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000844e2603.
00000100:00000040:13.0:1773851892.598674:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000844e2603 x1858041879147456 msgsize 224
00000100:00100000:13.0:1773851892.598677:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10864@kfi7 (source: 12345-10864@kfi7)
00000100:00000001:13.0:1773851892.598678:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851892.598680:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9e9f68d nid 10864@kfi7 refs 2
00000100:00000001:12.0:1773851892.598681:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851892.598682:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851892.598682:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851892.598683:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851892.598683:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851892.598685:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851892.598686:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041879147456
00000020:00000001:12.0:1773851892.598687:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851892.598687:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a2b
00000020:00000001:12.0:1773851892.598688:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851892.598693:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000aba16b87 refcount=6
00000020:00000001:12.0:1773851892.598694:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743443456 : -107128966108160 : ffff9e911807ac00)
00000020:00000001:12.0:1773851892.598695:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743443456 : -107128966108160 : ffff9e911807ac00)
00000100:00000001:12.0:1773851892.598697:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851892.598698:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851892.598699:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057ada156.
00000020:00000010:12.0:1773851892.598701:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851892.598702:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000028d2b47d.
00000100:00000001:12.0:1773851892.598703:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851892.598704:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851892.598705:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851892.598706:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851892.598707:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851892.598708:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.598709:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851892.598711:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851892.598712:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851892.598712:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851892.598713:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851892.598714:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10864@kfi7, seq: 2289911
00000100:00000001:15.0:1773851892.598715:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851892.598715:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000aba16b87 : new rpc_count 1
00000100:00000001:15.0:1773851892.598716:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.598716:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485623424 : -107000223928192 : ffff9eaf11a97080)
00000100:00000040:12.0:1773851892.598719:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000844e2603 x1858041879147456/t0(0) o400->20e3e889-b942-47f6-9fdd-42a7e97cfd0f@10864@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1166-0'
00000100:00000001:12.0:1773851892.598724:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851892.598731:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851892.598733:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000844e2603 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:20e3e889-b942-47f6-9fdd-42a7e97cfd0f+6:39676:x1858041879147456:12345-10864@kfi7:400:default-tuolumne1166-0
00000100:00000200:12.0:1773851892.598735:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041879147456
00000020:00000001:12.0:1773851892.598736:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851892.598737:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851892.598738:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.598739:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851892.598740:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851892.598741:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851892.598742:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041879147456, found 0 last_xid 1858041879147455
00000020:00000001:12.0:1773851892.598743:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851892.598744:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851892.598745:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851892.598746:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.598747:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851892.598748:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851892.598748:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851892.598750:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004c0a9826.
02000000:00000001:12.0:1773851892.598751:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.598752:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.598753:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851892.598754:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692842, transno 0, xid 1858041879147456
00010000:00000001:12.0:1773851892.598756:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851892.598758:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000844e2603 x1858041879147456/t0(0) o400->20e3e889-b942-47f6-9fdd-42a7e97cfd0f@10864@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1166-0'
00010000:00000001:12.0:1773851892.598762:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851892.598763:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851892.598764:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=125 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851892.598766:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851892.598767:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ad051637 refcount 3 to 10864@kfi7
00000100:00000001:12.0:1773851892.598768:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902776960 : -107154806774656 : ffff9e8b13ce6480)
02000000:00000001:12.0:1773851892.598770:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851892.598770:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.598771:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851892.598773:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10864@kfi7
00000400:00000010:12.0:1773851892.598774:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009203df6c.
00000100:00000200:12.0:1773851892.598775:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041879147456, offset 224
00000400:00000200:12.0:1773851892.598777:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10864@kfi7
00000400:00000200:12.0:1773851892.598779:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10864@kfi7 to cpt 3
00000400:00000200:12.0:1773851892.598780:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a9e9f68d nid 10864@kfi7 refs 1
00000400:00000200:12.0:1773851892.598782:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a9e9f68d nid 10864@kfi7 refs 2
00000400:00000200:12.0:1773851892.598784:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a9e9f68d nid 10864@kfi7 refs 3
00000400:00000200:12.0:1773851892.598786:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10864@kfi7 local destination
00000400:00000200:12.0:1773851892.598788:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770051:8770051:1024:4294967295] 10864@kfi7 LPNI seq info [8478290:8478290:16:4294967295]
00000400:00000200:12.0:1773851892.598791:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a9e9f68d nid 10864@kfi7 refs 2
00000400:00000200:12.0:1773851892.598792:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10864@kfi7 to cpt 3
00000400:00000200:12.0:1773851892.598796:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10864@kfi7(10864@kfi7:10864@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851892.598798:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a9e9f68d nid 10864@kfi7 refs 3
00000800:00000200:12.0:1773851892.598800:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851892.598802:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851892.598806:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851892.598813:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008ce Using peer 10864@kfi7(0x1000000000008ce)
00000800:00000200:12.0:1773851892.598818:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0x1000000000008ce: rc=0
00000800:00000200:12.0:1773851892.598821:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851892.598824:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851892.598826:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ad051637 refcount 2 to 10864@kfi7
00010000:00000001:12.0:1773851892.598829:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851892.598829:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.598830:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851892.598832:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000844e2603 x1858041879147456/t0(0) o400->20e3e889-b942-47f6-9fdd-42a7e97cfd0f@10864@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1166-0'
00000100:00100000:12.0:1773851892.598837:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000844e2603 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:20e3e889-b942-47f6-9fdd-42a7e97cfd0f+6:39676:x1858041879147456:12345-10864@kfi7:400:default-tuolumne1166-0 Request processed in 112us (162us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851892.598841:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10864@kfi7, seq: 2289911
00000100:00000040:12.0:1773851892.598843:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000aba16b87 : new rpc_count 0
00000100:00000001:12.0:1773851892.598844:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851892.598844:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851892.598845:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851892.598846:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000028d2b47d.
00000020:00000010:12.0:1773851892.598848:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057ada156.
00000020:00000040:12.0:1773851892.598849:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000aba16b87 : new refcount 5
00000100:00000001:12.0:1773851892.598850:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851892.598858:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008ce TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851892.598862:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.598863:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10864@kfi7: PUT: OK
00000400:00000200:13.0:1773851892.598865:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009203df6c
00000400:00000010:13.0:1773851892.598866:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009203df6c.
00000100:00000001:13.0:1773851892.598867:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851892.598868:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851892.598869:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a9e9f68d nid 10864@kfi7 refs 2
00000800:00000200:13.0:1773851892.598871:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 10864@kfi7(00000000f0efe46d):0x0 lsk 2255 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000008ce Transaction freed
00000400:00000200:29.0:1773851892.617733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851892.617734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851892.645455:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851892.645455:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851892.645457:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851892.645459:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851892.645460:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10307@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.645462:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10307@kfi7 : PUT - for me
00000400:00000200:21.0:1773851892.645463:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10307@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.645463:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d673597f nid 10307@kfi7 refs 1
00000400:00000200:21.0:1773851892.645465:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10307@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.645465:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d673597f nid 10307@kfi7 refs 2
00000400:00000200:21.0:1773851892.645467:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d673597f nid 10307@kfi7 refs 3
00000400:00000200:21.0:1773851892.645467:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10306@kfi7 to cpt 2
00000400:00000200:21.0:1773851892.645468:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10306@kfi7 of length 224 into portal 12 MB=0x69b823467a840
00000400:00000200:21.0:1773851892.645470:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10306@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 60680
00000800:00000200:21.0:1773851892.645471:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851892.645473:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.645474:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10307@kfi7: PUT: OK
00000100:00000001:21.0:1773851892.645475:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851892.645475:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851892.645476:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002826a21a.
00000100:00000040:21.0:1773851892.645477:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002826a21a x1859833387526208 msgsize 224
00000100:00100000:21.0:1773851892.645478:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-10306@kfi7 (source: 12345-10307@kfi7)
00000100:00000001:21.0:1773851892.645479:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851892.645480:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d673597f nid 10307@kfi7 refs 2
00000100:00000001:20.0:1773851892.645481:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851892.645481:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851892.645482:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851892.645482:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851892.645482:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851892.645483:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851892.645484:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833387526208
00000020:00000001:20.0:1773851892.645484:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851892.645485:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c17dcd5
00000020:00000001:20.0:1773851892.645486:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851892.645488:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fd59f792 refcount=5
00000020:00000001:20.0:1773851892.645489:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637155608502272 : -106918101049344 : ffff9ec230912000)
00000020:00000001:20.0:1773851892.645490:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637155608502272 : -106918101049344 : ffff9ec230912000)
00000100:00000001:20.0:1773851892.645491:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851892.645492:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851892.645492:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008f096863.
00000020:00000010:20.0:1773851892.645493:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851892.645494:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000032ef7456.
00000100:00000001:20.0:1773851892.645495:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851892.645495:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851892.645496:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851892.645497:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851892.645497:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851892.645498:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.645499:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.645500:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851892.645500:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851892.645501:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851892.645501:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851892.645502:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10306@kfi7, seq: 1998063
00000100:00000040:23.0:1773851892.645502:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fd59f792 : new rpc_count 1
00000100:00000001:23.0:1773851892.645503:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134769024000 : -106938940527616 : ffff9ebd566fec00)
00000100:00000001:20.0:1773851892.645503:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.645503:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851892.645505:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002826a21a x1859833387526208/t0(0) o400->790af1c7-48a0-46e7-90b3-21fe0d5f337a@10306@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1144-0'
00000100:00000001:23.0:1773851892.645508:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851892.645508:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851892.645509:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002826a21a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:790af1c7-48a0-46e7-90b3-21fe0d5f337a+5:39882:x1859833387526208:12345-10306@kfi7:400:default-tuolumne1144-0
00000100:00000200:23.0:1773851892.645511:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833387526208
00000020:00000001:23.0:1773851892.645511:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851892.645512:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851892.645513:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.645513:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851892.645514:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851892.645515:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851892.645515:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833387526208, found 0 last_xid 1859833387526207
00000020:00000001:23.0:1773851892.645516:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851892.645517:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851892.645517:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851892.645518:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.645519:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851892.645519:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851892.645520:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851892.645520:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000d6a466b.
02000000:00000001:23.0:1773851892.645521:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.645522:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.645522:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851892.645523:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684112, transno 0, xid 1859833387526208
00010000:00000001:23.0:1773851892.645524:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851892.645526:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002826a21a x1859833387526208/t0(0) o400->790af1c7-48a0-46e7-90b3-21fe0d5f337a@10306@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1144-0'
00010000:00000001:23.0:1773851892.645529:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851892.645529:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851892.645530:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=125 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851892.645531:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851892.645532:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000687293e0 refcount 3 to 10306@kfi7
00000100:00000001:23.0:1773851892.645532:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810488576 : -107154899063040 : ffff9e8b0e4e2f00)
02000000:00000001:23.0:1773851892.645533:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851892.645534:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.645535:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851892.645535:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10307@kfi7
00000400:00000010:23.0:1773851892.645536:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000571e5f64.
00000100:00000200:23.0:1773851892.645536:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833387526208, offset 224
00000400:00000200:23.0:1773851892.645538:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10307@kfi7
00000400:00000200:23.0:1773851892.645539:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10307@kfi7 to cpt 5
00000400:00000200:23.0:1773851892.645539:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d673597f nid 10307@kfi7 refs 1
00000400:00000200:23.0:1773851892.645540:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d673597f nid 10307@kfi7 refs 2
00000400:00000200:23.0:1773851892.645541:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d673597f nid 10307@kfi7 refs 3
00000400:00000200:23.0:1773851892.645542:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10307@kfi7 local destination
00000400:00000200:23.0:1773851892.645544:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770052:8770052:1024:4294967295] 10307@kfi7 LPNI seq info [7240332:7240332:16:4294967295]
00000400:00000200:23.0:1773851892.645545:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d673597f nid 10307@kfi7 refs 2
00000400:00000200:23.0:1773851892.645546:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10307@kfi7 to cpt 5
00000400:00000200:23.0:1773851892.645548:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10307@kfi7(10307@kfi7:10307@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851892.645549:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d673597f nid 10307@kfi7 refs 3
00000800:00000200:23.0:1773851892.645550:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851892.645551:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851892.645553:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851892.645556:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xae Using peer 10307@kfi7(0xae)
00000800:00000200:23.0:1773851892.645568:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0xae: rc=0
00000800:00000200:23.0:1773851892.645570:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xae TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851892.645572:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851892.645573:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000687293e0 refcount 2 to 10306@kfi7
00010000:00000001:23.0:1773851892.645573:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851892.645574:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851892.645574:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851892.645575:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002826a21a x1859833387526208/t0(0) o400->790af1c7-48a0-46e7-90b3-21fe0d5f337a@10306@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1144-0'
00000100:00100000:23.0:1773851892.645578:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002826a21a pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:790af1c7-48a0-46e7-90b3-21fe0d5f337a+5:39882:x1859833387526208:12345-10306@kfi7:400:default-tuolumne1144-0 Request processed in 70us (101us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851892.645581:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10306@kfi7, seq: 1998063
00000100:00000040:23.0:1773851892.645582:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fd59f792 : new rpc_count 0
00000800:00000200:21.0:1773851892.645582:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xae TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851892.645583:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851892.645583:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851892.645583:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851892.645584:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:23.0:1773851892.645584:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000032ef7456.
00000400:00000200:21.0:1773851892.645584:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10307@kfi7: PUT: OK
00000020:00000010:23.0:1773851892.645585:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008f096863.
00000400:00000200:21.0:1773851892.645585:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000571e5f64
00000020:00000040:23.0:1773851892.645586:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000fd59f792 : new refcount 4
00000400:00000010:21.0:1773851892.645586:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000571e5f64.
00000100:00000001:21.0:1773851892.645586:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851892.645587:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851892.645587:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851892.645588:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d673597f nid 10307@kfi7 refs 2
00000800:00000200:21.0:1773851892.645589:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 10307@kfi7(00000000940423cc):0x0 lsk 175 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xae Transaction freed
00000800:00000200:26.0:1773851892.651898:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851892.651899:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851892.651900:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851892.651902:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851892.651904:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10530@kfi7 to cpt 6
00000400:00000200:26.0:1773851892.651905:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10530@kfi7 : PUT - for me
00000400:00000200:26.0:1773851892.651906:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10530@kfi7 to cpt 6
00000400:00000200:26.0:1773851892.651907:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000012d0e85 nid 10530@kfi7 refs 1
00000400:00000200:26.0:1773851892.651908:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10530@kfi7 to cpt 6
00000400:00000200:26.0:1773851892.651908:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000012d0e85 nid 10530@kfi7 refs 2
00000400:00000200:26.0:1773851892.651909:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000012d0e85 nid 10530@kfi7 refs 3
00000400:00000200:26.0:1773851892.651910:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10722@kfi7 to cpt 1
00000400:00000200:26.0:1773851892.651911:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10722@kfi7 of length 224 into portal 12 MB=0x69b4b555d20c0
00000400:00000200:26.0:1773851892.651913:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10722@kfi7 of length 224/224 into md 0x16159c9699 [64] + 34000
00000800:00000200:26.0:1773851892.651914:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851892.651916:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851892.651917:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10530@kfi7: PUT: OK
00000100:00000001:26.0:1773851892.651918:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851892.651918:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851892.651920:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000463a550a.
00000100:00000040:26.0:1773851892.651920:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000463a550a x1859597717283008 msgsize 224
00000100:00100000:26.0:1773851892.651924:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-10722@kfi7 (source: 12345-10530@kfi7)
00000100:00000001:26.0:1773851892.651925:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851892.651926:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:26.0:1773851892.651926:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000012d0e85 nid 10530@kfi7 refs 2
02000000:00000001:27.0:1773851892.651927:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851892.651927:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851892.651928:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851892.651928:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2069@kfi7:6 <- 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851892.651930:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851892.651930:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597717283008
00000020:00000001:27.0:1773851892.651931:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851892.651931:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7829c
00000020:00000001:27.0:1773851892.651932:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851892.651934:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ab084f71 refcount=5
00000020:00000001:27.0:1773851892.651935:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636920812357632 : -107152897193984 : ffff9e8b85a04800)
00000020:00000001:27.0:1773851892.651936:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636920812357632 : -107152897193984 : ffff9e8b85a04800)
00000100:00000001:27.0:1773851892.651937:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.651937:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851892.651938:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000330439b1.
00000020:00000010:27.0:1773851892.651939:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.651940:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851892.651941:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851892.651941:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851892.651942:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.651943:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851892.651943:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851892.651943:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.651944:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851892.651945:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851892.651946:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851892.651947:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10722@kfi7, seq: 2025169
00000100:00000001:25.0:1773851892.651947:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851892.651947:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851892.651948:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ab084f71 : new rpc_count 1
00000100:00000001:27.0:1773851892.651948:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144347098880 : -106929362452736 : ffff9ebf9155bf00)
00000100:00000001:25.0:1773851892.651948:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.651949:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000463a550a x1859597717283008/t0(0) o400->7ea3b870-5585-4b42-bf89-94557e4108a8@10722@kfi7:142/0 lens 224/0 e 0 to 0 dl 1773852257 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1147-0'
00000100:00000001:25.0:1773851892.651949:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.651952:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851892.651952:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851892.651953:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000463a550a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7ea3b870-5585-4b42-bf89-94557e4108a8+5:39770:x1859597717283008:12345-10722@kfi7:400:default-tuolumne1147-0
00000100:00000200:27.0:1773851892.651954:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597717283008
00000020:00000001:27.0:1773851892.651955:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851892.651956:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851892.651956:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.651957:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851892.651958:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851892.651958:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851892.651959:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597717283008, found 0 last_xid 1859597717283007
00000020:00000001:27.0:1773851892.651960:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851892.651960:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851892.651961:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851892.651961:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.651962:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851892.651962:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851892.651963:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851892.651963:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a0454dd1.
02000000:00000001:27.0:1773851892.651964:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.651965:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.651965:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851892.651966:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096683324, transno 0, xid 1859597717283008
00010000:00000001:27.0:1773851892.651967:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851892.651967:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000463a550a x1859597717283008/t0(0) o400->7ea3b870-5585-4b42-bf89-94557e4108a8@10722@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1147-0'
00010000:00000001:27.0:1773851892.651970:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851892.651970:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851892.651971:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=125 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851892.651972:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851892.651973:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000db55c299 refcount 3 to 10722@kfi7
00000100:00000001:27.0:1773851892.651973:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231610880 : -107130477940736 : ffff9e90bdeaf000)
02000000:00000001:27.0:1773851892.651974:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851892.651974:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851892.651975:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851892.651976:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10530@kfi7
00000400:00000010:27.0:1773851892.651976:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e26c5908.
00000100:00000200:27.0:1773851892.651977:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597717283008, offset 224
00000400:00000200:27.0:1773851892.651979:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10530@kfi7
00000400:00000200:27.0:1773851892.651979:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10530@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.651980:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000012d0e85 nid 10530@kfi7 refs 1
00000400:00000200:27.0:1773851892.651981:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000012d0e85 nid 10530@kfi7 refs 2
00000400:00000200:27.0:1773851892.651982:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000012d0e85 nid 10530@kfi7 refs 3
00000400:00000200:27.0:1773851892.651983:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10530@kfi7 local destination
00000400:00000200:27.0:1773851892.651984:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770053:8770053:1024:4294967295] 10530@kfi7 LPNI seq info [3082203:3082203:16:4294967295]
00000400:00000200:27.0:1773851892.651986:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000012d0e85 nid 10530@kfi7 refs 2
00000400:00000200:27.0:1773851892.651986:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10530@kfi7 to cpt 6
00000400:00000200:27.0:1773851892.651988:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10530@kfi7(10530@kfi7:10530@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851892.651989:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000012d0e85 nid 10530@kfi7 refs 3
00000800:00000200:27.0:1773851892.651991:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851892.651992:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851892.651994:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851892.651996:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0xefc Using peer 10530@kfi7(0xefc)
00000800:00000200:27.0:1773851892.651999:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0xefc: rc=0
00000800:00000200:27.0:1773851892.652000:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0xefc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851892.652002:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851892.652003:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000db55c299 refcount 2 to 10722@kfi7
00010000:00000001:27.0:1773851892.652004:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851892.652004:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851892.652005:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851892.652006:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000463a550a x1859597717283008/t0(0) o400->7ea3b870-5585-4b42-bf89-94557e4108a8@10722@kfi7:142/0 lens 224/224 e 0 to 0 dl 1773852257 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1147-0'
00000100:00100000:27.0:1773851892.652009:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000463a550a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:7ea3b870-5585-4b42-bf89-94557e4108a8+5:39770:x1859597717283008:12345-10722@kfi7:400:default-tuolumne1147-0 Request processed in 56us (87us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851892.652011:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10722@kfi7, seq: 2025169
00000100:00000040:27.0:1773851892.652012:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ab084f71 : new rpc_count 0
00000800:00000200:26.0:1773851892.652012:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0xefc TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851892.652013:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851892.652013:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851892.652014:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851892.652014:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000400:00000200:26.0:1773851892.652014:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851892.652015:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000330439b1.
00000400:00000200:26.0:1773851892.652015:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10530@kfi7: PUT: OK
00000020:00000040:27.0:1773851892.652016:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000ab084f71 : new refcount 4
00000400:00000200:26.0:1773851892.652016:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e26c5908
00000400:00000010:26.0:1773851892.652016:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e26c5908.
00000100:00000001:27.0:1773851892.652017:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851892.652017:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851892.652017:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851892.652018:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000012d0e85 nid 10530@kfi7 refs 2
00000800:00000200:26.0:1773851892.652019:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2069@kfi7:6 -> 10530@kfi7(0000000023021c70):0x0 lsk 3837 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0xefc Transaction freed
00000800:00000200:9.0:1773851892.686918:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.686919:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.686920:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.686922:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.686924:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.686925:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.50@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851892.686926:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.686927:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851892.686928:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.50@o2ib60 to cpt 3
00000400:00000200:9.0:1773851892.686930:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d80f603d nid 192.168.128.50@o2ib60 refs 2
00000400:00000200:9.0:1773851892.686931:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d80f603d nid 192.168.128.50@o2ib60 refs 3
00000400:00000200:9.0:1773851892.686932:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.50@o2ib60 to cpt 3
00000400:00000200:9.0:1773851892.686933:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.50@o2ib60 of length 224 into portal 12 MB=0x69b2d1d84fb80
00000400:00000200:9.0:1773851892.686935:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.50@o2ib60 of length 224/224 into md 0x82a36e8ed [64] + 50080
00000800:00000200:9.0:1773851892.686936:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.686940:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.686941:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.686942:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.686942:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.686943:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000077994549.
00000100:00000040:9.0:1773851892.686944:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000077994549 x1859467931351936 msgsize 224
00000100:00100000:9.0:1773851892.686946:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.50@o2ib60 (source: 12345-192.168.128.50@o2ib60)
00000100:00000001:9.0:1773851892.686947:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.686948:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851892.686949:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851892.686950:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851892.686951:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851892.686951:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851892.686952:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851892.686952:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851892.686953:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859467931351936
00000020:00000001:12.0:1773851892.686953:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851892.686954:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c5f4c8920
00000020:00000001:12.0:1773851892.686955:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851892.686959:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006ed411ea refcount=123207
00000020:00000001:12.0:1773851892.686960:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637069834819584 : -107003874732032 : ffff9eae380e9800)
00000020:00000001:12.0:1773851892.686960:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637069834819584 : -107003874732032 : ffff9eae380e9800)
00000100:00000001:12.0:1773851892.686961:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851892.686962:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851892.686963:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057ada156.
00000020:00000010:12.0:1773851892.686964:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851892.686965:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000028d2b47d.
00000100:00000001:12.0:1773851892.686966:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851892.686966:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851892.686966:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851892.686967:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851892.686968:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851892.686968:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.686969:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851892.686970:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851892.686971:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851892.686971:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851892.686971:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851892.686972:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.50@o2ib60, seq: 2289912
00000100:00000001:15.0:1773851892.686973:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851892.686973:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006ed411ea : new rpc_count 8
00000100:00000001:15.0:1773851892.686974:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.686974:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609060480 : -107064100491136 : ffff9ea032527080)
00000100:00000040:12.0:1773851892.686975:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000077994549 x1859467931351936/t0(0) o400->dcd0bcb5-7767-40f9-a2bc-ec30e5896d84@192.168.128.50@o2ib60:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix50-0'
00000100:00000001:12.0:1773851892.686978:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851892.686978:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851892.686979:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000077994549 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:dcd0bcb5-7767-40f9-a2bc-ec30e5896d84+123207:39958:x1859467931351936:12345-192.168.128.50@o2ib60:400:default-matrix50-0
00000100:00000200:12.0:1773851892.686980:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859467931351936
00000020:00000001:12.0:1773851892.686981:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851892.686982:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851892.686982:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.686983:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851892.686983:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851892.686984:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851892.686985:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859467931351936, found 0 last_xid 1859467928147519
00000020:00000001:12.0:1773851892.686986:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851892.686986:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851892.686987:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851892.686987:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.686988:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851892.686988:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851892.686989:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851892.686989:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007e105882.
02000000:00000001:12.0:1773851892.686990:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.686991:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.686991:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851892.686992:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263990957, transno 0, xid 1859467931351936
00010000:00000001:12.0:1773851892.686993:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851892.686994:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000077994549 x1859467931351936/t0(0) o400->dcd0bcb5-7767-40f9-a2bc-ec30e5896d84@192.168.128.50@o2ib60:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix50-0'
00010000:00000001:12.0:1773851892.686996:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851892.686996:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851892.686997:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=125 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851892.686998:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851892.686998:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d151e809 refcount 3 to 192.168.128.50@o2ib60
00000100:00000001:12.0:1773851892.686999:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299264 : -107155980252352 : ffff9e8acddc8b40)
02000000:00000001:12.0:1773851892.687000:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851892.687000:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.687001:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851892.687002:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.50@o2ib60
00000400:00000010:12.0:1773851892.687003:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000dde699a.
00000100:00000200:12.0:1773851892.687003:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859467931351936, offset 224
00000400:00000200:12.0:1773851892.687005:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.50@o2ib60
00000400:00000200:12.0:1773851892.687006:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.50@o2ib60 to cpt 3
00000400:00000200:12.0:1773851892.687008:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d80f603d nid 192.168.128.50@o2ib60 refs 2
00000400:00000200:12.0:1773851892.687009:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d80f603d nid 192.168.128.50@o2ib60 refs 3
00000400:00000200:12.0:1773851892.687010:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d80f603d nid 192.168.128.50@o2ib60 refs 4
00000400:00000200:12.0:1773851892.687012:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.50@o2ib60 routed destination
00000400:00000200:12.0:1773851892.687013:0:60487:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:12.0:1773851892.687013:0:60487:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:12.0:1773851892.687015:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.50@o2ib60: rtr pref emtpy: 1
00000400:00000200:12.0:1773851892.687016:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:12.0:1773851892.687017:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.50@o2ib60: rtr pref emtpy: 1
00000400:00000200:12.0:1773851892.687017:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:12.0:1773851892.687018:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770054:8770054:1024:4294967295] 17@kfi7 LPNI seq info [1250891919:1250891919:16:4294967295]
00000400:00000200:12.0:1773851892.687020:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:12.0:1773851892.687020:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:12.0:1773851892.687023:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.50@o2ib60(192.168.128.50@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851892.687025:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d80f603d nid 192.168.128.50@o2ib60 refs 3
00000800:00000200:12.0:1773851892.687026:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851892.687027:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851892.687029:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851892.687031:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:12.0:1773851892.687034:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:12.0:1773851892.687035:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851892.687037:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851892.687038:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d151e809 refcount 2 to 192.168.128.50@o2ib60
00010000:00000001:12.0:1773851892.687038:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851892.687039:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851892.687039:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851892.687040:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000077994549 x1859467931351936/t0(0) o400->dcd0bcb5-7767-40f9-a2bc-ec30e5896d84@192.168.128.50@o2ib60:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix50-0'
00000100:00100000:12.0:1773851892.687044:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000077994549 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:dcd0bcb5-7767-40f9-a2bc-ec30e5896d84+123207:39958:x1859467931351936:12345-192.168.128.50@o2ib60:400:default-matrix50-0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851892.687048:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.50@o2ib60, seq: 2289912
00000100:00000040:12.0:1773851892.687049:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006ed411ea : new rpc_count 7
00000100:00000001:12.0:1773851892.687049:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851892.687050:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851892.687050:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851892.687051:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000028d2b47d.
00000020:00000010:12.0:1773851892.687052:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057ada156.
00000020:00000040:12.0:1773851892.687053:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000006ed411ea : new refcount 123206
00000100:00000001:12.0:1773851892.687053:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851892.687059:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851892.687061:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.687062:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:13.0:1773851892.687063:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000dde699a
00000400:00000010:13.0:1773851892.687063:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000dde699a.
00000100:00000001:13.0:1773851892.687064:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851892.687064:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851892.687065:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:13.0:1773851892.687066:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000800:00000200:9.0:1773851892.713162:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.713163:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.713165:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.713169:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.713172:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15762@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.713174:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15762@kfi7 : PUT - for me
00000400:00000200:9.0:1773851892.713175:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15762@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.713177:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006649ae3 nid 15762@kfi7 refs 1
00000400:00000200:9.0:1773851892.713179:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15762@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.713180:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006649ae3 nid 15762@kfi7 refs 2
00000400:00000200:9.0:1773851892.713181:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000006649ae3 nid 15762@kfi7 refs 3
00000400:00000200:9.0:1773851892.713183:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15698@kfi7 to cpt 6
00000400:00000200:9.0:1773851892.713184:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15698@kfi7 of length 224 into portal 12 MB=0x69b4b8b400440
00000400:00000200:9.0:1773851892.713187:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15698@kfi7 of length 224/224 into md 0x78146ce49 [64] + 157432
00000800:00000200:9.0:1773851892.713189:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.713192:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.713194:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15762@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.713196:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.713197:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.713198:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004d88bb8d.
00000100:00000040:9.0:1773851892.713199:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004d88bb8d x1859598621344832 msgsize 224
00000100:00100000:9.0:1773851892.713202:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-15698@kfi7 (source: 12345-15762@kfi7)
00000100:00000001:9.0:1773851892.713203:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.713204:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000006649ae3 nid 15762@kfi7 refs 2
00000100:00000001:8.0:1773851892.713205:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851892.713205:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851892.713206:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851892.713206:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851892.713206:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851892.713207:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.713208:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598621344832
00000020:00000001:8.0:1773851892.713208:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851892.713209:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d801ec
00000020:00000001:8.0:1773851892.713209:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851892.713213:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003a7dfb93 refcount=52
00000020:00000001:8.0:1773851892.713213:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136006996992 : -106937702554624 : ffff9ebda039e400)
00000020:00000001:8.0:1773851892.713214:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136006996992 : -106937702554624 : ffff9ebda039e400)
00000100:00000001:8.0:1773851892.713215:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.713216:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851892.713216:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851892.713217:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.713218:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851892.713219:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851892.713219:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851892.713220:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.713221:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851892.713221:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851892.713222:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.713222:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.713224:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851892.713224:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851892.713225:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:8.0:1773851892.713225:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15698@kfi7, seq: 2130858
00000100:00000001:9.0:1773851892.713226:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:8.0:1773851892.713226:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003a7dfb93 : new rpc_count 2
00000100:00000001:9.0:1773851892.713227:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.713227:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609057024 : -107064100494592 : ffff9ea032526300)
00000100:00000001:9.0:1773851892.713228:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.713228:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004d88bb8d x1859598621344832/t0(0) o400->5478d6d5-3931-49e6-ba59-2f4ac28c9d8d@15698@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1478-0'
00000100:00000001:8.0:1773851892.713230:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.713231:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851892.713232:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004d88bb8d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:5478d6d5-3931-49e6-ba59-2f4ac28c9d8d+52:39694:x1859598621344832:12345-15698@kfi7:400:default-tuolumne1478-0
00000100:00000200:8.0:1773851892.713234:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598621344832
00000020:00000001:8.0:1773851892.713234:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851892.713235:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851892.713235:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.713236:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851892.713237:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851892.713238:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851892.713238:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598621344832, found 0 last_xid 1859598614891263
00000020:00000001:8.0:1773851892.713239:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851892.713239:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851892.713240:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851892.713240:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.713241:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851892.713242:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851892.713242:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851892.713243:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b65bb1af.
02000000:00000001:8.0:1773851892.713243:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.713244:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.713245:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851892.713245:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183253207298, transno 0, xid 1859598621344832
00010000:00000001:8.0:1773851892.713246:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851892.713246:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004d88bb8d x1859598621344832/t0(0) o400->5478d6d5-3931-49e6-ba59-2f4ac28c9d8d@15698@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1478-0'
00010000:00000001:8.0:1773851892.713249:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851892.713249:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851892.713250:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=125 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851892.713251:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851892.713252:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000acf38c24 refcount 3 to 15698@kfi7
00000100:00000001:8.0:1773851892.713252:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330912 : -107155410220704 : ffff9e8aefd68960)
02000000:00000001:8.0:1773851892.713253:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851892.713254:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.713255:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851892.713256:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15762@kfi7
00000400:00000010:8.0:1773851892.713256:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009e5dfdd1.
00000100:00000200:8.0:1773851892.713257:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598621344832, offset 224
00000400:00000200:8.0:1773851892.713258:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15762@kfi7
00000400:00000200:8.0:1773851892.713259:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15762@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.713260:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006649ae3 nid 15762@kfi7 refs 1
00000400:00000200:8.0:1773851892.713261:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000006649ae3 nid 15762@kfi7 refs 2
00000400:00000200:8.0:1773851892.713263:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000006649ae3 nid 15762@kfi7 refs 3
00000400:00000200:8.0:1773851892.713264:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15762@kfi7 local destination
00000400:00000200:8.0:1773851892.713265:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770055:8770055:1024:4294967295] 15762@kfi7 LPNI seq info [2455724:2455724:16:4294967295]
00000400:00000200:8.0:1773851892.713267:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000006649ae3 nid 15762@kfi7 refs 2
00000400:00000200:8.0:1773851892.713267:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15762@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.713269:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15762@kfi7(15762@kfi7:15762@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851892.713270:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000006649ae3 nid 15762@kfi7 refs 3
00000800:00000200:8.0:1773851892.713271:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851892.713272:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851892.713275:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851892.713277:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e1f Using peer 15762@kfi7(0x100000000000e1f)
00000800:00000200:8.0:1773851892.713280:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x100000000000e1f: rc=0
00000800:00000200:8.0:1773851892.713281:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e1f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851892.713283:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.713284:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000acf38c24 refcount 2 to 15698@kfi7
00010000:00000001:8.0:1773851892.713285:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851892.713285:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.713286:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851892.713286:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004d88bb8d x1859598621344832/t0(0) o400->5478d6d5-3931-49e6-ba59-2f4ac28c9d8d@15698@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1478-0'
00000100:00100000:8.0:1773851892.713291:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004d88bb8d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:5478d6d5-3931-49e6-ba59-2f4ac28c9d8d+52:39694:x1859598621344832:12345-15698@kfi7:400:default-tuolumne1478-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851892.713294:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15698@kfi7, seq: 2130858
00000100:00000040:8.0:1773851892.713294:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003a7dfb93 : new rpc_count 1
00000100:00000001:8.0:1773851892.713295:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851892.713296:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851892.713296:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.713297:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851892.713298:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851892.713298:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000003a7dfb93 : new refcount 51
00000100:00000001:8.0:1773851892.713299:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.713305:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e1f TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851892.713308:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.713310:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15762@kfi7: PUT: OK
00000400:00000200:9.0:1773851892.713311:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009e5dfdd1
00000400:00000010:9.0:1773851892.713312:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009e5dfdd1.
00000100:00000001:9.0:1773851892.713313:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851892.713314:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.713315:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000006649ae3 nid 15762@kfi7 refs 2
00000800:00000200:9.0:1773851892.713317:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 15762@kfi7(000000002aaa43de):0x0 lsk 3616 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e1f Transaction freed
00000800:00000200:6.0:1773851892.713845:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851892.713845:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851892.713847:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851892.713849:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851892.713851:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21283@kfi7 to cpt 1
00000400:00000200:6.0:1773851892.713852:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21283@kfi7 : PUT - for me
00000400:00000200:6.0:1773851892.713853:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21283@kfi7 to cpt 1
00000400:00000200:6.0:1773851892.713854:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029f16882 nid 21283@kfi7 refs 1
00000400:00000200:6.0:1773851892.713855:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21283@kfi7 to cpt 1
00000400:00000200:6.0:1773851892.713856:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029f16882 nid 21283@kfi7 refs 2
00000400:00000200:6.0:1773851892.713857:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000029f16882 nid 21283@kfi7 refs 3
00000400:00000200:6.0:1773851892.713857:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21282@kfi7 to cpt 6
00000400:00000200:6.0:1773851892.713858:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21282@kfi7 of length 224 into portal 12 MB=0x699e11a0b1b80
00000400:00000200:6.0:1773851892.713860:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21282@kfi7 of length 224/224 into md 0x793926dc5 [64] + 161280
00000800:00000200:6.0:1773851892.713862:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851892.713863:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851892.713864:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21283@kfi7: PUT: OK
00000100:00000001:6.0:1773851892.713865:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851892.713866:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851892.713868:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000078d0b7f7.
00000100:00000040:6.0:1773851892.713869:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000078d0b7f7 x1858041943890816 msgsize 224
00000100:00100000:6.0:1773851892.713870:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-21282@kfi7 (source: 12345-21283@kfi7)
00000100:00000001:6.0:1773851892.713871:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851892.713872:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851892.713872:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000029f16882 nid 21283@kfi7 refs 2
02000000:00000001:7.0:1773851892.713873:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851892.713873:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851892.713873:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851892.713874:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851892.713875:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851892.713876:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041943890816
00000020:00000001:7.0:1773851892.713877:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851892.713878:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92817
00000020:00000001:7.0:1773851892.713878:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851892.713881:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004171764d refcount=6
00000020:00000001:7.0:1773851892.713881:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631485440 : -107123078066176 : ffff9e9276fc1000)
00000020:00000001:7.0:1773851892.713882:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631485440 : -107123078066176 : ffff9e9276fc1000)
00000100:00000001:7.0:1773851892.713884:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851892.713885:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851892.713885:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004638b300.
00000020:00000010:7.0:1773851892.713886:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851892.713887:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851892.713888:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851892.713888:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851892.713889:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851892.713890:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851892.713890:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851892.713891:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.713892:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851892.713893:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851892.713893:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851892.713894:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851892.713894:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851892.713895:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21282@kfi7, seq: 2001981
00000100:00000040:7.0:1773851892.713895:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004171764d : new rpc_count 1
00000100:00000001:4.0:1773851892.713895:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.713896:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814091136 : -107101895460480 : ffff9e976590f980)
00000100:00000001:4.0:1773851892.713896:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.713897:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000078d0b7f7 x1858041943890816/t0(0) o400->1247187f-c155-4d08-b54c-18f51391d268@21282@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1819-0'
00000100:00000001:7.0:1773851892.713900:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851892.713901:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851892.713902:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000078d0b7f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1247187f-c155-4d08-b54c-18f51391d268+6:39650:x1858041943890816:12345-21282@kfi7:400:default-tuolumne1819-0
00000100:00000200:7.0:1773851892.713903:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041943890816
00000020:00000001:7.0:1773851892.713904:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851892.713904:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851892.713905:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.713917:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851892.713917:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851892.713918:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851892.713919:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041943890816, found 0 last_xid 1858041943890815
00000020:00000001:7.0:1773851892.713919:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851892.713920:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851892.713921:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851892.713921:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.713922:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851892.713922:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851892.713923:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851892.713923:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c610ea46.
02000000:00000001:7.0:1773851892.713924:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.713925:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.713925:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851892.713926:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044163323, transno 0, xid 1858041943890816
00010000:00000001:7.0:1773851892.713927:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851892.713928:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000078d0b7f7 x1858041943890816/t0(0) o400->1247187f-c155-4d08-b54c-18f51391d268@21282@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1819-0'
00010000:00000001:7.0:1773851892.713930:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851892.713930:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851892.713931:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=124 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851892.713932:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851892.713933:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f56db2fe refcount 3 to 21282@kfi7
00000100:00000001:7.0:1773851892.713933:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331008 : -107155410220608 : ffff9e8aefd689c0)
02000000:00000001:7.0:1773851892.713934:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851892.713935:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.713935:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851892.713936:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21283@kfi7
00000400:00000010:7.0:1773851892.713937:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000100:00000200:7.0:1773851892.713938:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041943890816, offset 224
00000400:00000200:7.0:1773851892.713940:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21283@kfi7
00000400:00000200:7.0:1773851892.713940:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21283@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.713941:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029f16882 nid 21283@kfi7 refs 1
00000400:00000200:7.0:1773851892.713942:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000029f16882 nid 21283@kfi7 refs 2
00000400:00000200:7.0:1773851892.713944:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000029f16882 nid 21283@kfi7 refs 3
00000400:00000200:7.0:1773851892.713945:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21283@kfi7 local destination
00000400:00000200:7.0:1773851892.713946:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770056:8770056:1024:4294967295] 21283@kfi7 LPNI seq info [12559583:12559583:16:4294967295]
00000400:00000200:7.0:1773851892.713948:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000029f16882 nid 21283@kfi7 refs 2
00000400:00000200:7.0:1773851892.713948:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21283@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.713951:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21283@kfi7(21283@kfi7:21283@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851892.713952:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000029f16882 nid 21283@kfi7 refs 3
00000800:00000200:7.0:1773851892.713953:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851892.713954:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851892.713956:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851892.713958:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf9f Using peer 21283@kfi7(0xf9f)
00000800:00000200:7.0:1773851892.713961:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0xf9f: rc=0
00000800:00000200:7.0:1773851892.713962:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf9f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851892.713964:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.713965:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f56db2fe refcount 2 to 21282@kfi7
00010000:00000001:7.0:1773851892.713966:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851892.713966:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.713967:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851892.713968:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000078d0b7f7 x1858041943890816/t0(0) o400->1247187f-c155-4d08-b54c-18f51391d268@21282@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1819-0'
00000100:00100000:7.0:1773851892.713971:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000078d0b7f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1247187f-c155-4d08-b54c-18f51391d268+6:39650:x1858041943890816:12345-21282@kfi7:400:default-tuolumne1819-0 Request processed in 69us (101us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851892.713974:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21282@kfi7, seq: 2001981
00000100:00000040:7.0:1773851892.713974:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004171764d : new rpc_count 0
00000800:00000200:5.0:1773851892.713974:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf9f TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851892.713975:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851892.713975:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851892.713976:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851892.713976:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000200:5.0:1773851892.713976:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21283@kfi7: PUT: OK
00000020:00000010:7.0:1773851892.713977:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000020:00000010:7.0:1773851892.713978:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004638b300.
00000020:00000040:7.0:1773851892.713978:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000004171764d : new refcount 5
00000400:00000200:5.0:1773851892.713978:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000010:5.0:1773851892.713978:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000100:00000001:7.0:1773851892.713979:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851892.713979:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851892.713979:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851892.713980:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000029f16882 nid 21283@kfi7 refs 2
00000800:00000200:5.0:1773851892.713981:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 21283@kfi7(000000006702553f):0x0 lsk 4000 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0xf9f Transaction freed
00000800:00000200:5.0:1773851892.749736:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851892.749737:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851892.749739:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851892.749743:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851892.749746:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.749748:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25595@kfi7 : PUT - for me
00000400:00000200:5.0:1773851892.749750:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.749751:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 1
00000400:00000200:5.0:1773851892.749753:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.749754:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000400:00000200:5.0:1773851892.749756:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 3
00000400:00000200:5.0:1773851892.749757:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:5.0:1773851892.749759:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25595@kfi7 of length 224 into portal 12 MB=0x699df74098e80
00000400:00000200:5.0:1773851892.749761:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25595@kfi7 of length 224/224 into md 0x793926dc5 [64] + 161504
00000800:00000200:5.0:1773851892.749764:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851892.749767:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851892.749769:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25595@kfi7: PUT: OK
00000100:00000001:5.0:1773851892.749770:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851892.749771:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851892.749771:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008aa264ee.
00000100:00000040:5.0:1773851892.749772:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008aa264ee x1858034863804032 msgsize 224
00000100:00100000:5.0:1773851892.749774:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25595@kfi7 (source: 12345-25595@kfi7)
00000100:00000001:5.0:1773851892.749775:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851892.749776:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000100:00000001:7.0:1773851892.749777:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851892.749777:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851892.749777:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851892.749778:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851892.749778:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851892.749779:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851892.749780:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858034863804032
00000020:00000001:7.0:1773851892.749780:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851892.749781:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912fb
00000020:00000001:7.0:1773851892.749781:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851892.749783:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e4c6e9bb refcount=6
00000020:00000001:7.0:1773851892.749784:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716219904 : -107155993331712 : ffff9e8acd14f800)
00000020:00000001:7.0:1773851892.749785:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716219904 : -107155993331712 : ffff9e8acd14f800)
00000100:00000001:7.0:1773851892.749786:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851892.749787:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851892.749787:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004638b300.
00000020:00000010:7.0:1773851892.749788:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851892.749789:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851892.749790:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851892.749790:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851892.749791:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851892.749792:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851892.749792:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851892.749793:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.749793:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851892.749794:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851892.749795:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851892.749795:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851892.749796:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25595@kfi7, seq: 2001982
00000100:00000001:4.0:1773851892.749796:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851892.749797:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e4c6e9bb : new rpc_count 1
00000100:00000001:7.0:1773851892.749797:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637006074698240 : -107067634853376 : ffff9e9f5fa85a00)
00000100:00000001:4.0:1773851892.749797:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.749797:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.749799:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008aa264ee x1858034863804032/t0(0) o400->74cf30ef-7e3d-44cb-96e8-9af3aaa700f8@25595@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne268-0'
00000100:00000001:7.0:1773851892.749802:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851892.749802:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851892.749803:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008aa264ee pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:74cf30ef-7e3d-44cb-96e8-9af3aaa700f8+6:41979:x1858034863804032:12345-25595@kfi7:400:default-tuolumne268-0
00000100:00000200:7.0:1773851892.749805:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858034863804032
00000020:00000001:7.0:1773851892.749805:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851892.749806:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851892.749806:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.749807:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851892.749807:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851892.749809:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851892.749809:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858034863804032, found 0 last_xid 1858034863804031
00000020:00000001:7.0:1773851892.749810:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851892.749811:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851892.749811:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851892.749811:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.749812:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851892.749813:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851892.749813:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851892.749814:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000037b11586.
02000000:00000001:7.0:1773851892.749814:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.749815:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.749816:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851892.749816:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858034863804032
00010000:00000001:7.0:1773851892.749817:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851892.749818:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008aa264ee x1858034863804032/t0(0) o400->74cf30ef-7e3d-44cb-96e8-9af3aaa700f8@25595@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne268-0'
00010000:00000001:7.0:1773851892.749821:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851892.749821:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851892.749822:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=124 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851892.749823:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851892.749826:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000be4a1a4d refcount 5 to 25595@kfi7
00000100:00000001:7.0:1773851892.749826:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931325661760 : -107142383889856 : ffff9e8df8449240)
02000000:00000001:7.0:1773851892.749827:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851892.749827:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.749828:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851892.749829:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25595@kfi7
00000400:00000010:7.0:1773851892.749830:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df522108.
00000100:00000200:7.0:1773851892.749830:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858034863804032, offset 224
00000400:00000200:7.0:1773851892.749832:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25595@kfi7
00000400:00000200:7.0:1773851892.749833:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.749833:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 1
00000400:00000200:7.0:1773851892.749834:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000400:00000200:7.0:1773851892.749836:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 3
00000400:00000200:7.0:1773851892.749837:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25595@kfi7 local destination
00000400:00000200:7.0:1773851892.749839:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770057:8770057:1024:4294967295] 25595@kfi7 LPNI seq info [28052:28052:16:4294967295]
00000400:00000200:7.0:1773851892.749840:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000400:00000200:7.0:1773851892.749841:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25595@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.749843:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25595@kfi7(25595@kfi7:25595@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851892.749844:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 3
00000800:00000200:7.0:1773851892.749845:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851892.749846:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851892.749848:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851892.749850:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4e7 Using peer 25595@kfi7(0x4e7)
00000800:00000200:7.0:1773851892.749853:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x4e7: rc=0
00000800:00000200:7.0:1773851892.749854:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851892.749856:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.749856:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000be4a1a4d refcount 4 to 25595@kfi7
00010000:00000001:7.0:1773851892.749857:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851892.749857:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.749858:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851892.749859:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008aa264ee x1858034863804032/t0(0) o400->74cf30ef-7e3d-44cb-96e8-9af3aaa700f8@25595@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne268-0'
00000100:00100000:7.0:1773851892.749861:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008aa264ee pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:74cf30ef-7e3d-44cb-96e8-9af3aaa700f8+6:41979:x1858034863804032:12345-25595@kfi7:400:default-tuolumne268-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851892.749864:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25595@kfi7, seq: 2001982
00000100:00000040:7.0:1773851892.749864:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e4c6e9bb : new rpc_count 0
00000100:00000001:7.0:1773851892.749865:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851892.749866:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851892.749866:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000800:00000200:5.0:1773851892.749866:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4e7 TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851892.749867:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000020:00000010:7.0:1773851892.749867:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004638b300.
00000400:00000200:5.0:1773851892.749867:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:7.0:1773851892.749868:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000e4c6e9bb : new refcount 5
00000100:00000001:7.0:1773851892.749868:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851892.749869:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25595@kfi7: PUT: OK
00000400:00000200:5.0:1773851892.749869:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df522108
00000400:00000010:5.0:1773851892.749870:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df522108.
00000100:00000001:5.0:1773851892.749870:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851892.749871:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851892.749871:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008fa623e6 nid 25595@kfi7 refs 2
00000800:00000200:5.0:1773851892.749872:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 25595@kfi7(000000006ac2d1b8):0x0 lsk 1256 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4e7 Transaction freed
00000800:00000200:21.0:1773851892.804970:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851892.804971:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851892.804972:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851892.804974:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851892.804977:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10176@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.804978:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10176@kfi7 : PUT - for me
00000400:00000200:21.0:1773851892.804979:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10176@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.804980:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008d82e94 nid 10176@kfi7 refs 1
00000400:00000200:21.0:1773851892.804981:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10176@kfi7 to cpt 5
00000400:00000200:21.0:1773851892.804981:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008d82e94 nid 10176@kfi7 refs 2
00000400:00000200:21.0:1773851892.804982:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000008d82e94 nid 10176@kfi7 refs 3
00000400:00000200:21.0:1773851892.804983:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9984@kfi7 to cpt 2
00000400:00000200:21.0:1773851892.804984:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9984@kfi7 of length 224 into portal 12 MB=0x69b4b58da2b00
00000400:00000200:21.0:1773851892.804985:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9984@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 60904
00000800:00000200:21.0:1773851892.804987:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851892.804988:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.804989:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10176@kfi7: PUT: OK
00000100:00000001:21.0:1773851892.804990:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851892.804990:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851892.804991:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000028119431.
00000100:00000040:21.0:1773851892.804992:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000028119431 x1859597775809280 msgsize 224
00000100:00100000:21.0:1773851892.804993:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9984@kfi7 (source: 12345-10176@kfi7)
00000100:00000001:21.0:1773851892.804994:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851892.804995:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000008d82e94 nid 10176@kfi7 refs 2
00000100:00000001:23.0:1773851892.804996:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851892.804996:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851892.804997:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851892.804997:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851892.804997:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851892.804998:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851892.804999:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597775809280
00000020:00000001:23.0:1773851892.805000:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851892.805000:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d781bc
00000020:00000001:23.0:1773851892.805001:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851892.805003:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000be77b92f refcount=5
00000020:00000001:23.0:1773851892.805004:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117170336768 : -106956539214848 : ffff9eb93d794400)
00000020:00000001:23.0:1773851892.805005:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117170336768 : -106956539214848 : ffff9eb93d794400)
00000100:00000001:23.0:1773851892.805006:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851892.805007:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851892.805008:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c9c7cb10.
00000020:00000010:23.0:1773851892.805009:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851892.805010:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d02c65ee.
00000100:00000001:23.0:1773851892.805011:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851892.805011:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851892.805012:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.805013:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851892.805013:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851892.805013:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851892.805014:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851892.805015:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851892.805016:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851892.805016:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851892.805016:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851892.805017:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9984@kfi7, seq: 1998064
00000100:00000001:23.0:1773851892.805018:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851892.805018:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000be77b92f : new rpc_count 1
00000100:00000001:23.0:1773851892.805019:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.805019:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134769011328 : -106938940540288 : ffff9ebd566fba80)
00000100:00000040:20.0:1773851892.805020:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000028119431 x1859597775809280/t0(0) o400->5b3df6b3-9966-46a6-8830-068e34a8d498@9984@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1123-0'
00000100:00000001:20.0:1773851892.805023:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851892.805023:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851892.805024:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028119431 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:5b3df6b3-9966-46a6-8830-068e34a8d498+5:39726:x1859597775809280:12345-9984@kfi7:400:default-tuolumne1123-0
00000100:00000200:20.0:1773851892.805026:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597775809280
00000020:00000001:20.0:1773851892.805026:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851892.805027:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851892.805027:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.805028:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851892.805029:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851892.805029:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851892.805030:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597775809280, found 0 last_xid 1859597775809279
00000020:00000001:20.0:1773851892.805031:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851892.805031:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851892.805032:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851892.805032:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.805033:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851892.805034:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851892.805034:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851892.805035:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008f096863.
02000000:00000001:20.0:1773851892.805036:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.805036:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.805037:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851892.805038:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096701926, transno 0, xid 1859597775809280
00010000:00000001:20.0:1773851892.805039:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851892.805040:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000028119431 x1859597775809280/t0(0) o400->5b3df6b3-9966-46a6-8830-068e34a8d498@9984@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1123-0'
00010000:00000001:20.0:1773851892.805042:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851892.805043:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851892.805043:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=125 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851892.805045:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851892.805045:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000005eb838a refcount 3 to 9984@kfi7
00000100:00000001:20.0:1773851892.805046:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581792 : -107154806969824 : ffff9e8b13cb6a20)
02000000:00000001:20.0:1773851892.805047:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851892.805048:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851892.805048:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851892.805049:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10176@kfi7
00000400:00000010:20.0:1773851892.805050:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047febb4e.
00000100:00000200:20.0:1773851892.805051:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597775809280, offset 224
00000400:00000200:20.0:1773851892.805052:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10176@kfi7
00000400:00000200:20.0:1773851892.805053:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10176@kfi7 to cpt 5
00000400:00000200:20.0:1773851892.805054:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008d82e94 nid 10176@kfi7 refs 1
00000400:00000200:20.0:1773851892.805055:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000008d82e94 nid 10176@kfi7 refs 2
00000400:00000200:20.0:1773851892.805056:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000008d82e94 nid 10176@kfi7 refs 3
00000400:00000200:20.0:1773851892.805057:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10176@kfi7 local destination
00000400:00000200:20.0:1773851892.805058:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770058:8770058:1024:4294967295] 10176@kfi7 LPNI seq info [930958:930958:16:4294967295]
00000400:00000200:20.0:1773851892.805060:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000008d82e94 nid 10176@kfi7 refs 2
00000400:00000200:20.0:1773851892.805061:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10176@kfi7 to cpt 5
00000400:00000200:20.0:1773851892.805062:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10176@kfi7(10176@kfi7:10176@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851892.805064:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000008d82e94 nid 10176@kfi7 refs 3
00000800:00000200:20.0:1773851892.805065:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851892.805066:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851892.805068:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851892.805071:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000660 Using peer 10176@kfi7(0x100000000000660)
00000800:00000200:20.0:1773851892.805074:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x100000000000660: rc=0
00000800:00000200:20.0:1773851892.805076:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000660 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851892.805078:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851892.805079:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000005eb838a refcount 2 to 9984@kfi7
00010000:00000001:20.0:1773851892.805079:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851892.805080:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851892.805081:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851892.805081:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000028119431 x1859597775809280/t0(0) o400->5b3df6b3-9966-46a6-8830-068e34a8d498@9984@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1123-0'
00000100:00100000:20.0:1773851892.805085:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028119431 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:5b3df6b3-9966-46a6-8830-068e34a8d498+5:39726:x1859597775809280:12345-9984@kfi7:400:default-tuolumne1123-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851892.805087:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9984@kfi7, seq: 1998064
00000100:00000040:20.0:1773851892.805088:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000be77b92f : new rpc_count 0
00000100:00000001:20.0:1773851892.805088:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851892.805089:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851892.805089:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851892.805090:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d02c65ee.
00000020:00000010:20.0:1773851892.805091:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c9c7cb10.
00000020:00000040:20.0:1773851892.805092:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000be77b92f : new refcount 4
00000100:00000001:20.0:1773851892.805092:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851892.805097:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000660 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851892.805099:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851892.805100:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10176@kfi7: PUT: OK
00000400:00000200:21.0:1773851892.805101:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047febb4e
00000400:00000010:21.0:1773851892.805101:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047febb4e.
00000100:00000001:21.0:1773851892.805102:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851892.805102:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851892.805106:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000008d82e94 nid 10176@kfi7 refs 2
00000800:00000200:21.0:1773851892.805107:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 10176@kfi7(0000000076ccac55):0x0 lsk 1633 rsk 13 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000660 Transaction freed
00010000:00000001:2.0:1773851892.873734:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873735:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851892.873736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851892.873738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851892.873740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851892.873741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851892.873744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851892.873746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851892.873747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851892.873748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.873754:0:849256:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:8.0:1773851892.873756:0:849256:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:8.0:1773851892.873757:0:849256:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:30.0:1773851892.878195:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851892.878196:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851892.878198:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2069@kfi7:7 <- 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851892.878201:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2069@kfi7:7 <- 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851892.878203:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.878204:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17659@kfi7 : PUT - for me
00000400:00000200:30.0:1773851892.878205:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.878206:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 1
00000400:00000200:30.0:1773851892.878207:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.878208:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000400:00000200:30.0:1773851892.878209:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 3
00000400:00000200:30.0:1773851892.878210:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17658@kfi7 to cpt 4
00000400:00000200:30.0:1773851892.878211:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17658@kfi7 of length 224 into portal 12 MB=0x699de87cb5b40
00000400:00000200:30.0:1773851892.878212:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17658@kfi7 of length 224/224 into md 0x77fe1859d [64] + 4776
00000800:00000200:30.0:1773851892.878214:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000030498a96: 2069@kfi7:7 <- 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851892.878216:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851892.878217:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17659@kfi7: PUT: OK
00000100:00000001:30.0:1773851892.878218:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851892.878218:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851892.878219:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000068f044d7.
00000100:00000040:30.0:1773851892.878220:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000068f044d7 x1858030900304704 msgsize 224
00000100:00100000:30.0:1773851892.878221:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-17658@kfi7 (source: 12345-17659@kfi7)
00000100:00000001:30.0:1773851892.878222:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851892.878223:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000100:00000001:31.0:1773851892.878224:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851892.878224:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851892.878225:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851892.878225:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851892.878225:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000030498a96: 2069@kfi7:7 <- 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851892.878226:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851892.878227:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030900304704
00000020:00000001:31.0:1773851892.878228:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851892.878228:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9104d
00000020:00000001:31.0:1773851892.878229:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851892.878232:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000023dcfa3e refcount=6
00000020:00000001:31.0:1773851892.878233:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240104960 : -107152469446656 : ffff9e8b9f1f3000)
00000020:00000001:31.0:1773851892.878234:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240104960 : -107152469446656 : ffff9e8b9f1f3000)
00000100:00000001:31.0:1773851892.878235:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851892.878236:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851892.878236:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001c4eb1a9.
00000020:00000010:31.0:1773851892.878237:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851892.878238:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851892.878239:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851892.878240:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851892.878240:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.878241:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851892.878242:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851892.878242:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.878243:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.878244:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851892.878245:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851892.878245:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851892.878245:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851892.878246:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17658@kfi7, seq: 2055581
00000100:00000040:31.0:1773851892.878247:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000023dcfa3e : new rpc_count 1
00000100:00000001:30.0:1773851892.878247:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.878248:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411266432 : -106960298285184 : ffff9eb85d6a6780)
00000100:00000001:30.0:1773851892.878248:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851892.878249:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000068f044d7 x1858030900304704/t0(0) o400->d1e61995-be63-41ac-bc6c-67235ea6305d@17658@kfi7:680/0 lens 224/0 e 0 to 0 dl 1773852040 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne237-0'
00000100:00000001:31.0:1773851892.878252:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851892.878252:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851892.878253:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068f044d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:d1e61995-be63-41ac-bc6c-67235ea6305d+6:47398:x1858030900304704:12345-17658@kfi7:400:default-tuolumne237-0
00000100:00000200:31.0:1773851892.878254:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030900304704
00000020:00000001:31.0:1773851892.878255:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851892.878256:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851892.878256:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878257:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851892.878258:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851892.878258:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851892.878259:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030900304704, found 0 last_xid 1858030900304703
00000020:00000001:31.0:1773851892.878260:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851892.878260:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851892.878261:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851892.878261:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878262:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851892.878262:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851892.878263:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851892.878264:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b0bf80b5.
02000000:00000001:31.0:1773851892.878264:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.878265:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878265:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851892.878266:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030900304704
00010000:00000001:31.0:1773851892.878267:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851892.878268:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000068f044d7 x1858030900304704/t0(0) o400->d1e61995-be63-41ac-bc6c-67235ea6305d@17658@kfi7:680/0 lens 224/224 e 0 to 0 dl 1773852040 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne237-0'
00010000:00000001:31.0:1773851892.878270:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851892.878271:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851892.878272:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=125 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851892.878273:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851892.878274:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007f36bef5 refcount 5 to 17658@kfi7
00000100:00000001:31.0:1773851892.878275:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993280 : -107142345558336 : ffff9e8dfa8d76c0)
02000000:00000001:31.0:1773851892.878276:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851892.878276:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.878277:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851892.878278:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17659@kfi7
00000400:00000010:31.0:1773851892.878278:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002000cf5e.
00000100:00000200:31.0:1773851892.878279:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030900304704, offset 224
00000400:00000200:31.0:1773851892.878280:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17659@kfi7
00000400:00000200:31.0:1773851892.878281:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:31.0:1773851892.878282:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 1
00000400:00000200:31.0:1773851892.878283:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000400:00000200:31.0:1773851892.878284:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 3
00000400:00000200:31.0:1773851892.878285:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17659@kfi7 local destination
00000400:00000200:31.0:1773851892.878286:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770059:8770059:1024:4294967295] 17659@kfi7 LPNI seq info [24419:24419:16:4294967295]
00000400:00000200:31.0:1773851892.878288:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000400:00000200:31.0:1773851892.878288:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:31.0:1773851892.878290:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17659@kfi7(17659@kfi7:17659@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851892.878292:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 3
00000800:00000200:31.0:1773851892.878293:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851892.878294:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851892.878296:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851892.878298:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bb Using peer 17659@kfi7(0x3bb)
00000800:00000200:31.0:1773851892.878302:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x3bb: rc=0
00000800:00000200:31.0:1773851892.878303:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851892.878305:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851892.878307:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007f36bef5 refcount 4 to 17658@kfi7
00010000:00000001:31.0:1773851892.878307:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851892.878308:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878308:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851892.878309:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000068f044d7 x1858030900304704/t0(0) o400->d1e61995-be63-41ac-bc6c-67235ea6305d@17658@kfi7:680/0 lens 224/224 e 0 to 0 dl 1773852040 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne237-0'
00000100:00100000:31.0:1773851892.878312:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068f044d7 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:d1e61995-be63-41ac-bc6c-67235ea6305d+6:47398:x1858030900304704:12345-17658@kfi7:400:default-tuolumne237-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851892.878314:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17658@kfi7, seq: 2055581
00000100:00000040:31.0:1773851892.878315:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000023dcfa3e : new rpc_count 0
00000800:00000200:29.0:1773851892.878315:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bb TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851892.878316:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851892.878316:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851892.878317:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851892.878317:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851892.878318:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851892.878318:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17659@kfi7: PUT: OK
00000400:00000200:29.0:1773851892.878318:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002000cf5e
00000020:00000010:31.0:1773851892.878319:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001c4eb1a9.
00000020:00000040:31.0:1773851892.878319:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000023dcfa3e : new refcount 5
00000400:00000010:29.0:1773851892.878319:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002000cf5e.
00000100:00000001:29.0:1773851892.878319:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851892.878320:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851892.878320:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851892.878321:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000800:00000200:29.0:1773851892.878323:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 17659@kfi7(000000008b9aa17c):0x0 lsk 956 rsk 85 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bb Transaction freed
00000800:00000200:29.0:1773851892.878431:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851892.878432:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851892.878433:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851892.878435:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851892.878437:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:29.0:1773851892.878438:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17659@kfi7 : PUT - for me
00000400:00000200:29.0:1773851892.878439:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:29.0:1773851892.878439:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 1
00000400:00000200:29.0:1773851892.878440:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:29.0:1773851892.878441:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000400:00000200:29.0:1773851892.878441:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 3
00000400:00000200:29.0:1773851892.878442:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17658@kfi7 to cpt 4
00000400:00000200:29.0:1773851892.878443:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17658@kfi7 of length 224 into portal 12 MB=0x699de87cb6300
00000400:00000200:29.0:1773851892.878444:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17658@kfi7 of length 224/224 into md 0x77fe1859d [64] + 5000
00000800:00000200:29.0:1773851892.878446:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851892.878447:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851892.878448:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17659@kfi7: PUT: OK
00000100:00000001:29.0:1773851892.878449:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851892.878449:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851892.878450:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000555a762b.
00000100:00000040:29.0:1773851892.878450:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000555a762b x1858030900306688 msgsize 224
00000100:00100000:29.0:1773851892.878452:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-17658@kfi7 (source: 12345-17659@kfi7)
00000100:00000001:29.0:1773851892.878453:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851892.878453:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000100:00000001:31.0:1773851892.878454:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851892.878455:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851892.878455:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851892.878455:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851892.878456:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851892.878457:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851892.878457:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030900306688
00000020:00000001:31.0:1773851892.878457:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851892.878458:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912d8
00000020:00000001:31.0:1773851892.878458:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851892.878460:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007138273a refcount=6
00000020:00000001:31.0:1773851892.878461:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716220928 : -107155993330688 : ffff9e8acd14fc00)
00000020:00000001:31.0:1773851892.878461:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716220928 : -107155993330688 : ffff9e8acd14fc00)
00000100:00000001:31.0:1773851892.878462:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851892.878463:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851892.878463:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047470845.
00000020:00000010:31.0:1773851892.878464:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851892.878465:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851892.878466:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851892.878466:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851892.878466:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.878467:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851892.878468:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851892.878468:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.878469:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.878470:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851892.878470:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851892.878470:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851892.878471:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17658@kfi7, seq: 2055582
00000100:00000040:31.0:1773851892.878471:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007138273a : new rpc_count 1
00000100:00000001:30.0:1773851892.878471:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851892.878472:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262217856 : -106943447333760 : ffff9ebc49cf8480)
00000100:00000001:30.0:1773851892.878472:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.878472:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851892.878473:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000555a762b x1858030900306688/t0(0) o400->a93238d1-1778-40d9-a54b-81a2c7b276c6@17658@kfi7:144/0 lens 224/0 e 0 to 0 dl 1773852259 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne237-0'
00000100:00000001:31.0:1773851892.878476:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851892.878476:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851892.878477:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000555a762b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:a93238d1-1778-40d9-a54b-81a2c7b276c6+6:47436:x1858030900306688:12345-17658@kfi7:400:default-tuolumne237-0
00000100:00000200:31.0:1773851892.878478:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030900306688
00000020:00000001:31.0:1773851892.878479:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851892.878479:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851892.878480:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878480:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851892.878481:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851892.878481:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851892.878482:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030900306688, found 0 last_xid 1858030900306687
00000020:00000001:31.0:1773851892.878483:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851892.878483:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851892.878483:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851892.878484:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878484:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851892.878485:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851892.878485:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851892.878486:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000055961172.
02000000:00000001:31.0:1773851892.878487:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.878487:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878488:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851892.878488:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767595, transno 0, xid 1858030900306688
00010000:00000001:31.0:1773851892.878489:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851892.878490:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000555a762b x1858030900306688/t0(0) o400->a93238d1-1778-40d9-a54b-81a2c7b276c6@17658@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne237-0'
00010000:00000001:31.0:1773851892.878492:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851892.878492:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851892.878493:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=125 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851892.878494:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851892.878495:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007f36bef5 refcount 5 to 17658@kfi7
00000100:00000001:31.0:1773851892.878495:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363993280 : -107142345558336 : ffff9e8dfa8d76c0)
02000000:00000001:31.0:1773851892.878496:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851892.878496:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.878497:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851892.878497:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17659@kfi7
00000400:00000010:31.0:1773851892.878498:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defdea60.
00000100:00000200:31.0:1773851892.878498:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030900306688, offset 224
00000400:00000200:31.0:1773851892.878500:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17659@kfi7
00000400:00000200:31.0:1773851892.878500:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:31.0:1773851892.878501:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 1
00000400:00000200:31.0:1773851892.878502:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000400:00000200:31.0:1773851892.878503:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 3
00000400:00000200:31.0:1773851892.878504:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17659@kfi7 local destination
00000400:00000200:31.0:1773851892.878505:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770060:8770060:1024:4294967295] 17659@kfi7 LPNI seq info [24420:24420:16:4294967295]
00000400:00000200:31.0:1773851892.878506:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000400:00000200:31.0:1773851892.878507:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17659@kfi7 to cpt 7
00000400:00000200:31.0:1773851892.878509:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17659@kfi7(17659@kfi7:17659@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851892.878510:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 3
00000800:00000200:31.0:1773851892.878511:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851892.878512:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851892.878514:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851892.878516:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000003b6 Using peer 17659@kfi7(0x1000000000003b6)
00000800:00000200:31.0:1773851892.878519:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x1000000000003b6: rc=0
00000800:00000200:31.0:1773851892.878521:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000003b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851892.878522:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851892.878523:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007f36bef5 refcount 4 to 17658@kfi7
00010000:00000001:31.0:1773851892.878524:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851892.878524:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851892.878524:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851892.878525:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000555a762b x1858030900306688/t0(0) o400->a93238d1-1778-40d9-a54b-81a2c7b276c6@17658@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne237-0'
00000100:00100000:31.0:1773851892.878528:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000555a762b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:a93238d1-1778-40d9-a54b-81a2c7b276c6+6:47436:x1858030900306688:12345-17658@kfi7:400:default-tuolumne237-0 Request processed in 51us (77us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851892.878530:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17658@kfi7, seq: 2055582
00000100:00000040:31.0:1773851892.878530:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007138273a : new rpc_count 0
00000100:00000001:31.0:1773851892.878531:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851892.878531:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851892.878532:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851892.878532:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000800:00000200:29.0:1773851892.878532:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000003b6 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851892.878533:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047470845.
00000020:00000040:31.0:1773851892.878533:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000007138273a : new refcount 5
00000100:00000001:31.0:1773851892.878534:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851892.878534:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851892.878535:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17659@kfi7: PUT: OK
00000400:00000200:29.0:1773851892.878535:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defdea60
00000400:00000010:29.0:1773851892.878535:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defdea60.
00000100:00000001:29.0:1773851892.878536:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851892.878536:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851892.878537:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a196e1a nid 17659@kfi7 refs 2
00000800:00000200:29.0:1773851892.878538:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 17659@kfi7(000000001e80a11b):0x0 lsk 951 rsk 84 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000003b6 Transaction freed
00000800:00000200:9.0:1773851892.880114:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851892.880116:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851892.880117:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851892.880120:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851892.880122:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13953@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.880124:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13953@kfi7 : PUT - for me
00000400:00000200:9.0:1773851892.880125:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13953@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.880126:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016173024 nid 13953@kfi7 refs 1
00000400:00000200:9.0:1773851892.880127:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13953@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.880128:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016173024 nid 13953@kfi7 refs 2
00000400:00000200:9.0:1773851892.880129:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000016173024 nid 13953@kfi7 refs 3
00000400:00000200:9.0:1773851892.880130:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13953@kfi7 to cpt 2
00000400:00000200:9.0:1773851892.880131:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13953@kfi7 of length 224 into portal 12 MB=0x69b4b56269780
00000400:00000200:9.0:1773851892.880132:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13953@kfi7 of length 224/224 into md 0x78146ce49 [64] + 157656
00000800:00000200:9.0:1773851892.880134:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851892.880136:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.880137:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13953@kfi7: PUT: OK
00000100:00000001:9.0:1773851892.880138:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851892.880139:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851892.880139:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eea4b40c.
00000100:00000040:9.0:1773851892.880140:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000eea4b40c x1859597730486144 msgsize 224
00000100:00100000:9.0:1773851892.880142:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13953@kfi7 (source: 12345-13953@kfi7)
00000100:00000001:9.0:1773851892.880142:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851892.880143:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000016173024 nid 13953@kfi7 refs 2
00000100:00000001:8.0:1773851892.880144:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851892.880145:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851892.880145:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851892.880145:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851892.880146:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851892.880146:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.880147:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597730486144
00000020:00000001:8.0:1773851892.880148:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851892.880148:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7b325
00000020:00000001:8.0:1773851892.880149:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851892.880151:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000afee95c2 refcount=5
00000020:00000001:8.0:1773851892.880151:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637156230018048 : -106917479533568 : ffff9ec2559cb400)
00000020:00000001:8.0:1773851892.880152:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637156230018048 : -106917479533568 : ffff9ec2559cb400)
00000100:00000001:8.0:1773851892.880153:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.880154:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851892.880154:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851892.880155:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.880157:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851892.880158:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851892.880158:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851892.880159:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.880160:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851892.880160:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851892.880161:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.880162:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851892.880163:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.880164:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851892.880164:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851892.880164:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851892.880165:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851892.880165:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13953@kfi7, seq: 2130859
00000100:00000040:8.0:1773851892.880165:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000afee95c2 : new rpc_count 1
00000100:00000001:9.0:1773851892.880166:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.880166:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609033984 : -107064100517632 : ffff9ea032520900)
00000100:00000040:8.0:1773851892.880167:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eea4b40c x1859597730486144/t0(0) o400->2615a3e5-c7d3-4842-8bce-042bfa6de95a@13953@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1364-0'
00000100:00000001:8.0:1773851892.880170:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851892.880170:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851892.880171:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eea4b40c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2615a3e5-c7d3-4842-8bce-042bfa6de95a+5:39697:x1859597730486144:12345-13953@kfi7:400:default-tuolumne1364-0
00000100:00000200:8.0:1773851892.880173:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597730486144
00000020:00000001:8.0:1773851892.880173:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851892.880174:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851892.880175:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.880175:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851892.880176:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851892.880177:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851892.880178:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597730486144, found 0 last_xid 1859597730486143
00000020:00000001:8.0:1773851892.880178:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851892.880179:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851892.880180:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851892.880180:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.880181:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851892.880181:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851892.880182:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851892.880183:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000176a83f0.
02000000:00000001:8.0:1773851892.880183:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.880184:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.880185:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851892.880185:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688770, transno 0, xid 1859597730486144
00010000:00000001:8.0:1773851892.880186:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851892.880187:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eea4b40c x1859597730486144/t0(0) o400->2615a3e5-c7d3-4842-8bce-042bfa6de95a@13953@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1364-0'
00010000:00000001:8.0:1773851892.880189:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851892.880190:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851892.880190:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=125 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851892.880191:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851892.880192:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cede7489 refcount 3 to 13953@kfi7
00000100:00000001:8.0:1773851892.880193:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526774912 : -107156182776704 : ffff9e8ac1ca4480)
02000000:00000001:8.0:1773851892.880194:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851892.880194:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851892.880195:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851892.880196:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13953@kfi7
00000400:00000010:8.0:1773851892.880196:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028d4f432.
00000100:00000200:8.0:1773851892.880197:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597730486144, offset 224
00000400:00000200:8.0:1773851892.880198:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13953@kfi7
00000400:00000200:8.0:1773851892.880199:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13953@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.880200:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016173024 nid 13953@kfi7 refs 1
00000400:00000200:8.0:1773851892.880201:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000016173024 nid 13953@kfi7 refs 2
00000400:00000200:8.0:1773851892.880202:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000016173024 nid 13953@kfi7 refs 3
00000400:00000200:8.0:1773851892.880203:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13953@kfi7 local destination
00000400:00000200:8.0:1773851892.880205:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770061:8770061:1024:4294967295] 13953@kfi7 LPNI seq info [248082:248082:16:4294967295]
00000400:00000200:8.0:1773851892.880206:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000016173024 nid 13953@kfi7 refs 2
00000400:00000200:8.0:1773851892.880207:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13953@kfi7 to cpt 2
00000400:00000200:8.0:1773851892.880209:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13953@kfi7(13953@kfi7:13953@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851892.880210:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000016173024 nid 13953@kfi7 refs 3
00000800:00000200:8.0:1773851892.880211:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851892.880212:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851892.880218:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851892.880221:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000515 Using peer 13953@kfi7(0x100000000000515)
00000800:00000200:8.0:1773851892.880224:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x100000000000515: rc=0
00000800:00000200:8.0:1773851892.880226:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000515 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851892.880228:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851892.880229:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cede7489 refcount 2 to 13953@kfi7
00010000:00000001:8.0:1773851892.880230:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851892.880230:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851892.880231:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851892.880232:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eea4b40c x1859597730486144/t0(0) o400->2615a3e5-c7d3-4842-8bce-042bfa6de95a@13953@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1364-0'
00000100:00100000:8.0:1773851892.880237:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eea4b40c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2615a3e5-c7d3-4842-8bce-042bfa6de95a+5:39697:x1859597730486144:12345-13953@kfi7:400:default-tuolumne1364-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851892.880239:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13953@kfi7, seq: 2130859
00000100:00000040:8.0:1773851892.880240:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000afee95c2 : new rpc_count 0
00000100:00000001:8.0:1773851892.880241:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851892.880241:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851892.880242:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851892.880243:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851892.880244:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851892.880244:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000afee95c2 : new refcount 4
00000100:00000001:8.0:1773851892.880245:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851892.880250:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000515 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851892.880252:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851892.880253:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13953@kfi7: PUT: OK
00000400:00000200:9.0:1773851892.880254:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028d4f432
00000400:00000010:9.0:1773851892.880254:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028d4f432.
00000100:00000001:9.0:1773851892.880255:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851892.880256:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851892.880257:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000016173024 nid 13953@kfi7 refs 2
00000800:00000200:9.0:1773851892.880259:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 13953@kfi7(00000000f22b8504):0x0 lsk 1302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000515 Transaction freed
00000800:00000200:30.0:1773851892.933175:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851892.933177:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851892.933178:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851892.933180:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851892.933182:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25042@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.933183:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25042@kfi7 : PUT - for me
00000400:00000200:30.0:1773851892.933184:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25042@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.933185:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ecf6b534 nid 25042@kfi7 refs 1
00000400:00000200:30.0:1773851892.933187:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25042@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.933187:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ecf6b534 nid 25042@kfi7 refs 2
00000400:00000200:30.0:1773851892.933188:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ecf6b534 nid 25042@kfi7 refs 3
00000400:00000200:30.0:1773851892.933189:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25042@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.933190:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25042@kfi7 of length 224 into portal 12 MB=0x69b4b95717d00
00000400:00000200:30.0:1773851892.933191:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25042@kfi7 of length 224/224 into md 0x77fe1859d [64] + 5224
00000800:00000200:30.0:1773851892.933193:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851892.933195:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851892.933196:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25042@kfi7: PUT: OK
00000100:00000001:30.0:1773851892.933197:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851892.933197:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851892.933198:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a34f5681.
00000100:00000040:30.0:1773851892.933199:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000a34f5681 x1859598792359168 msgsize 224
00000100:00100000:30.0:1773851892.933200:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-25042@kfi7 (source: 12345-25042@kfi7)
00000100:00000001:30.0:1773851892.933201:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851892.933202:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ecf6b534 nid 25042@kfi7 refs 2
00000100:00000001:31.0:1773851892.933204:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851892.933204:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000030498a96: 2054@kfi7:7 <- 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851892.933205:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851892.933206:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851892.933206:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851892.933208:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851892.933209:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598792359168
00000020:00000001:31.0:1773851892.933210:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851892.933211:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3896bf38
00000020:00000001:31.0:1773851892.933212:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851892.933218:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a4f1523b refcount=5
00000020:00000001:31.0:1773851892.933220:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636974790351872 : -107098919199744 : ffff9e9816f71c00)
00000020:00000001:31.0:1773851892.933221:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636974790351872 : -107098919199744 : ffff9e9816f71c00)
00000100:00000001:31.0:1773851892.933222:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851892.933223:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851892.933224:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000047470845.
00000020:00000010:31.0:1773851892.933226:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851892.933227:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851892.933229:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851892.933229:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851892.933230:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.933232:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851892.933232:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851892.933233:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851892.933235:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851892.933236:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851892.933236:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851892.933237:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851892.933237:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851892.933238:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25042@kfi7, seq: 2055583
00000100:00000001:31.0:1773851892.933239:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851892.933239:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a4f1523b : new rpc_count 1
00000100:00000001:31.0:1773851892.933240:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.933240:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411249152 : -106960298302464 : ffff9eb85d6a2400)
00000100:00000040:30.0:1773851892.933241:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a34f5681 x1859598792359168/t0(0) o400->77b326b9-c32c-42b2-ac80-280d5074e4a3@25042@kfi7:680/0 lens 224/0 e 0 to 0 dl 1773852040 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2053-0'
00000100:00000001:30.0:1773851892.933244:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851892.933244:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851892.933245:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a34f5681 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:77b326b9-c32c-42b2-ac80-280d5074e4a3+5:39565:x1859598792359168:12345-25042@kfi7:400:default-tuolumne2053-0
00000100:00000200:30.0:1773851892.933247:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598792359168
00000020:00000001:30.0:1773851892.933248:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851892.933248:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851892.933249:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851892.933250:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851892.933251:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851892.933251:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851892.933252:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598792359168, found 0 last_xid 1859598792359167
00000020:00000001:30.0:1773851892.933253:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851892.933254:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851892.933254:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851892.933255:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851892.933256:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851892.933256:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851892.933257:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851892.933258:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ccb6addf.
02000000:00000001:30.0:1773851892.933258:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.933259:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851892.933260:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851892.933260:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014386171, transno 0, xid 1859598792359168
00010000:00000001:30.0:1773851892.933261:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851892.933262:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a34f5681 x1859598792359168/t0(0) o400->77b326b9-c32c-42b2-ac80-280d5074e4a3@25042@kfi7:680/0 lens 224/224 e 0 to 0 dl 1773852040 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2053-0'
00010000:00000001:30.0:1773851892.933265:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851892.933266:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851892.933266:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=125 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851892.933267:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851892.933268:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001cefc9fd refcount 3 to 25042@kfi7
00000100:00000001:30.0:1773851892.933269:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272256 : -107152618279360 : ffff9e8b96402e40)
02000000:00000001:30.0:1773851892.933270:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851892.933270:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851892.933271:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851892.933272:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25042@kfi7
00000400:00000010:30.0:1773851892.933272:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000007302f25.
00000100:00000200:30.0:1773851892.933273:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598792359168, offset 224
00000400:00000200:30.0:1773851892.933275:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25042@kfi7
00000400:00000200:30.0:1773851892.933276:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25042@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.933276:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ecf6b534 nid 25042@kfi7 refs 1
00000400:00000200:30.0:1773851892.933277:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ecf6b534 nid 25042@kfi7 refs 2
00000400:00000200:30.0:1773851892.933278:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ecf6b534 nid 25042@kfi7 refs 3
00000400:00000200:30.0:1773851892.933280:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25042@kfi7 local destination
00000400:00000200:30.0:1773851892.933281:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770062:8770062:1024:4294967295] 25042@kfi7 LPNI seq info [4646452:4646452:16:4294967295]
00000400:00000200:30.0:1773851892.933282:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ecf6b534 nid 25042@kfi7 refs 2
00000400:00000200:30.0:1773851892.933283:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25042@kfi7 to cpt 7
00000400:00000200:30.0:1773851892.933285:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25042@kfi7(25042@kfi7:25042@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851892.933286:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ecf6b534 nid 25042@kfi7 refs 3
00000800:00000200:30.0:1773851892.933287:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851892.933289:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851892.933291:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851892.933293:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000467 Using peer 25042@kfi7(0x100000000000467)
00000800:00000200:30.0:1773851892.933296:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000030498a96: Posted send of 324 bytes to peer 0x100000000000467: rc=0
00000800:00000200:30.0:1773851892.933298:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000467 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851892.933300:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851892.933301:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001cefc9fd refcount 2 to 25042@kfi7
00010000:00000001:30.0:1773851892.933302:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851892.933303:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851892.933303:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851892.933304:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a34f5681 x1859598792359168/t0(0) o400->77b326b9-c32c-42b2-ac80-280d5074e4a3@25042@kfi7:680/0 lens 224/224 e 0 to 0 dl 1773852040 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2053-0'
00000100:00100000:30.0:1773851892.933307:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a34f5681 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:77b326b9-c32c-42b2-ac80-280d5074e4a3+5:39565:x1859598792359168:12345-25042@kfi7:400:default-tuolumne2053-0 Request processed in 62us (107us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851892.933310:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25042@kfi7, seq: 2055583
00000100:00000040:30.0:1773851892.933311:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a4f1523b : new rpc_count 0
00000100:00000001:30.0:1773851892.933311:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851892.933312:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851892.933313:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:30.0:1773851892.933313:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000800:00000200:29.0:1773851892.933313:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000467 TN_EVENT_TX_OK event status 0
00000020:00000010:30.0:1773851892.933314:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000047470845.
00000020:00000040:30.0:1773851892.933315:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000a4f1523b : new refcount 4
00000100:00000001:30.0:1773851892.933316:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851892.933316:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851892.933317:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25042@kfi7: PUT: OK
00000400:00000200:29.0:1773851892.933318:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000007302f25
00000400:00000010:29.0:1773851892.933319:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000007302f25.
00000100:00000001:29.0:1773851892.933320:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851892.933321:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851892.933322:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ecf6b534 nid 25042@kfi7 refs 2
00000800:00000200:29.0:1773851892.933325:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 25042@kfi7(00000000f1fb7e4b):0x0 lsk 1128 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000467 Transaction freed
00000800:00000200:6.0:1773851892.958920:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851892.958921:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851892.958922:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851892.958924:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851892.958926:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25697@kfi7 to cpt 1
00000400:00000200:6.0:1773851892.958928:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25697@kfi7 : PUT - for me
00000400:00000200:6.0:1773851892.958929:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25697@kfi7 to cpt 1
00000400:00000200:6.0:1773851892.958929:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe6af82d nid 25697@kfi7 refs 1
00000400:00000200:6.0:1773851892.958930:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25697@kfi7 to cpt 1
00000400:00000200:6.0:1773851892.958931:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe6af82d nid 25697@kfi7 refs 2
00000400:00000200:6.0:1773851892.958932:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fe6af82d nid 25697@kfi7 refs 3
00000400:00000200:6.0:1773851892.958933:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25697@kfi7 to cpt 1
00000400:00000200:6.0:1773851892.958934:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25697@kfi7 of length 224 into portal 12 MB=0x69b4c3a570c00
00000400:00000200:6.0:1773851892.958935:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25697@kfi7 of length 224/224 into md 0x793926dc5 [64] + 161728
00000800:00000200:6.0:1773851892.958937:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851892.958939:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851892.958940:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25697@kfi7: PUT: OK
00000100:00000001:6.0:1773851892.958941:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851892.958942:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851892.958943:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000562ee10a.
00000100:00000040:6.0:1773851892.958943:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000562ee10a x1859601558866944 msgsize 224
00000100:00100000:6.0:1773851892.958945:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-25697@kfi7 (source: 12345-25697@kfi7)
00000100:00000001:6.0:1773851892.958947:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851892.958948:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851892.958948:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fe6af82d nid 25697@kfi7 refs 2
02000000:00000001:7.0:1773851892.958949:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851892.958949:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851892.958949:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000235b3e16: 2069@kfi7:1 <- 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851892.958950:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851892.958951:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851892.958951:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601558866944
00000020:00000001:7.0:1773851892.958952:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851892.958952:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e62d22a1c
00000020:00000001:7.0:1773851892.958953:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851892.958955:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003c9faf10 refcount=9
00000020:00000001:7.0:1773851892.958956:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121281668096 : -106952427883520 : ffff9eba32873400)
00000020:00000001:7.0:1773851892.958957:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121281668096 : -106952427883520 : ffff9eba32873400)
00000100:00000001:7.0:1773851892.958958:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851892.958959:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851892.958960:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004638b300.
00000020:00000010:7.0:1773851892.958961:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851892.958961:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851892.958962:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851892.958963:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851892.958963:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851892.958964:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851892.958965:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851892.958965:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.958966:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851892.958967:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851892.958967:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851892.958968:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851892.958968:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851892.958969:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25697@kfi7, seq: 2001983
00000100:00000040:7.0:1773851892.958969:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003c9faf10 : new rpc_count 1
00000100:00000001:7.0:1773851892.958970:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814066944 : -107101895484672 : ffff9e9765909b00)
00000100:00000001:4.0:1773851892.958970:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851892.958970:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.958971:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000562ee10a x1859601558866944/t0(0) o400->190cfc70-adc6-47fc-a2a6-4405ac504a45@25697@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2096-0'
00000100:00000001:7.0:1773851892.958974:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851892.958974:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851892.958975:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000562ee10a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:190cfc70-adc6-47fc-a2a6-4405ac504a45+9:39751:x1859601558866944:12345-25697@kfi7:400:default-tuolumne2096-0
00000100:00000200:7.0:1773851892.958977:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601558866944
00000020:00000001:7.0:1773851892.958977:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851892.958978:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851892.958979:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.958979:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851892.958980:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851892.958981:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851892.958981:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601558866944, found 0 last_xid 1859601558866943
00000020:00000001:7.0:1773851892.958982:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851892.958983:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851892.958983:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851892.958984:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.958984:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851892.958985:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851892.958985:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851892.958986:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b45d736f.
02000000:00000001:7.0:1773851892.958987:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.958987:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.958988:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851892.958989:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260456253, transno 0, xid 1859601558866944
00010000:00000001:7.0:1773851892.958989:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851892.958990:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000562ee10a x1859601558866944/t0(0) o400->190cfc70-adc6-47fc-a2a6-4405ac504a45@25697@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2096-0'
00010000:00000001:7.0:1773851892.958992:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851892.958993:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851892.958994:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=124 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851892.958994:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851892.958995:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013885819 refcount 3 to 25697@kfi7
00000100:00000001:7.0:1773851892.958996:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231610240 : -107130477941376 : ffff9e90bdeaed80)
02000000:00000001:7.0:1773851892.958997:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851892.958997:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851892.958998:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851892.958999:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25697@kfi7
00000400:00000010:7.0:1773851892.958999:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034f580d9.
00000100:00000200:7.0:1773851892.959000:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601558866944, offset 224
00000400:00000200:7.0:1773851892.959001:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25697@kfi7
00000400:00000200:7.0:1773851892.959002:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25697@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.959003:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fe6af82d nid 25697@kfi7 refs 1
00000400:00000200:7.0:1773851892.959004:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fe6af82d nid 25697@kfi7 refs 2
00000400:00000200:7.0:1773851892.959006:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fe6af82d nid 25697@kfi7 refs 3
00000400:00000200:7.0:1773851892.959007:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25697@kfi7 local destination
00000400:00000200:7.0:1773851892.959008:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770063:8770063:1024:4294967295] 25697@kfi7 LPNI seq info [222182:222182:16:4294967295]
00000400:00000200:7.0:1773851892.959009:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fe6af82d nid 25697@kfi7 refs 2
00000400:00000200:7.0:1773851892.959010:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25697@kfi7 to cpt 1
00000400:00000200:7.0:1773851892.959013:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25697@kfi7(25697@kfi7:25697@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851892.959014:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fe6af82d nid 25697@kfi7 refs 3
00000800:00000200:7.0:1773851892.959015:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851892.959016:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851892.959019:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851892.959021:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7c4 Using peer 25697@kfi7(0x7c4)
00000800:00000200:7.0:1773851892.959024:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x7c4: rc=0
00000800:00000200:7.0:1773851892.959026:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851892.959028:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851892.959029:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013885819 refcount 2 to 25697@kfi7
00010000:00000001:7.0:1773851892.959029:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851892.959030:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851892.959030:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851892.959031:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000562ee10a x1859601558866944/t0(0) o400->190cfc70-adc6-47fc-a2a6-4405ac504a45@25697@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2096-0'
00000100:00100000:7.0:1773851892.959034:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000562ee10a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:190cfc70-adc6-47fc-a2a6-4405ac504a45+9:39751:x1859601558866944:12345-25697@kfi7:400:default-tuolumne2096-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851892.959037:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25697@kfi7, seq: 2001983
00000100:00000040:7.0:1773851892.959038:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003c9faf10 : new rpc_count 0
00000800:00000200:6.0:1773851892.959038:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7c4 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851892.959039:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851892.959039:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851892.959040:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851892.959040:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:6.0:1773851892.959040:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851892.959041:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004638b300.
00000400:00000200:6.0:1773851892.959041:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25697@kfi7: PUT: OK
00000020:00000040:7.0:1773851892.959042:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000003c9faf10 : new refcount 8
00000400:00000200:6.0:1773851892.959042:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034f580d9
00000100:00000001:7.0:1773851892.959043:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851892.959043:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034f580d9.
00000100:00000001:6.0:1773851892.959043:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851892.959044:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851892.959045:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fe6af82d nid 25697@kfi7 refs 2
00000800:00000200:6.0:1773851892.959046:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 25697@kfi7(00000000cf1d61f6):0x0 lsk 1989 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x7c4 Transaction freed
00000800:00000200:13.0:1773851892.974658:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851892.974658:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851892.974660:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851892.974662:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851892.974664:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.974665:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22522@kfi7 : PUT - for me
00000400:00000200:13.0:1773851892.974666:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.974666:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 1
00000400:00000200:13.0:1773851892.974668:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.974669:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000400:00000200:13.0:1773851892.974670:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 3
00000400:00000200:13.0:1773851892.974671:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22523@kfi7 to cpt 6
00000400:00000200:13.0:1773851892.974671:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22523@kfi7 of length 224 into portal 12 MB=0x699de8c096b00
00000400:00000200:13.0:1773851892.974673:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22523@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 50304
00000800:00000200:13.0:1773851892.974675:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851892.974677:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.974678:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22522@kfi7: PUT: OK
00000100:00000001:13.0:1773851892.974679:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851892.974679:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851892.974680:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000862431e4.
00000100:00000040:13.0:1773851892.974681:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000862431e4 x1858030971480832 msgsize 224
00000100:00100000:13.0:1773851892.974683:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22523@kfi7 (source: 12345-22522@kfi7)
00000100:00000001:13.0:1773851892.974684:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851892.974685:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000800:00000200:13.0:1773851892.974686:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851892.974686:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851892.974687:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851892.974688:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851892.974689:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851892.974690:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851892.974692:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030971480832
00000020:00000001:12.0:1773851892.974693:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851892.974693:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91093
00000020:00000001:12.0:1773851892.974694:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851892.974702:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000293b6a23 refcount=6
00000020:00000001:12.0:1773851892.974704:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240124416 : -107152469427200 : ffff9e8b9f1f7c00)
00000020:00000001:12.0:1773851892.974705:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240124416 : -107152469427200 : ffff9e8b9f1f7c00)
00000100:00000001:12.0:1773851892.974706:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851892.974708:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851892.974709:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000057ada156.
00000020:00000010:12.0:1773851892.974711:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851892.974712:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000028d2b47d.
00000100:00000001:12.0:1773851892.974714:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851892.974714:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851892.974715:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851892.974717:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851892.974718:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851892.974718:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.974720:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851892.974722:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851892.974722:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851892.974723:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22523@kfi7, seq: 2289913
00000100:00000001:12.0:1773851892.974723:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851892.974723:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851892.974724:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000293b6a23 : new rpc_count 1
00000100:00000001:12.0:1773851892.974724:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.974727:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485600384 : -107000223951232 : ffff9eaf11a91680)
00000100:00000001:12.0:1773851892.974729:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851892.974730:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000862431e4 x1858030971480832/t0(0) o400->9452187a-0cb4-427a-9290-dba0ec33c99c@22523@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne256-0'
00000100:00000001:15.0:1773851892.974732:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851892.974733:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851892.974734:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000862431e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:9452187a-0cb4-427a-9290-dba0ec33c99c+6:47820:x1858030971480832:12345-22523@kfi7:400:default-tuolumne256-0
00000100:00000200:15.0:1773851892.974736:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030971480832
00000020:00000001:15.0:1773851892.974736:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851892.974737:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851892.974738:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.974738:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851892.974739:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851892.974739:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851892.974740:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030971480832, found 0 last_xid 1858030971480831
00000020:00000001:15.0:1773851892.974741:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851892.974742:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851892.974742:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851892.974743:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.974743:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851892.974744:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851892.974745:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851892.974745:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c74abe31.
02000000:00000001:15.0:1773851892.974746:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.974747:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.974748:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851892.974748:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030971480832
00010000:00000001:15.0:1773851892.974749:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851892.974750:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000862431e4 x1858030971480832/t0(0) o400->9452187a-0cb4-427a-9290-dba0ec33c99c@22523@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne256-0'
00010000:00000001:15.0:1773851892.974752:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851892.974753:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851892.974754:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=125 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851892.974755:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851892.974756:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ae846ee2 refcount 5 to 22523@kfi7
00000100:00000001:15.0:1773851892.974756:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420224 : -107156724131392 : ffff9e8aa185d9c0)
02000000:00000001:15.0:1773851892.974757:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851892.974758:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.974758:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851892.974759:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22522@kfi7
00000400:00000010:15.0:1773851892.974760:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dbadbd2e.
00000100:00000200:15.0:1773851892.974761:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030971480832, offset 224
00000400:00000200:15.0:1773851892.974763:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22522@kfi7
00000400:00000200:15.0:1773851892.974763:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:15.0:1773851892.974764:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 1
00000400:00000200:15.0:1773851892.974765:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000400:00000200:15.0:1773851892.974767:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 3
00000400:00000200:15.0:1773851892.974768:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22522@kfi7 local destination
00000400:00000200:15.0:1773851892.974769:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770064:8770064:1024:4294967295] 22522@kfi7 LPNI seq info [24407:24407:16:4294967295]
00000400:00000200:15.0:1773851892.974771:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000400:00000200:15.0:1773851892.974771:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:15.0:1773851892.974774:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22522@kfi7(22522@kfi7:22522@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851892.974775:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 3
00000800:00000200:15.0:1773851892.974776:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851892.974778:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851892.974780:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851892.974782:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000187 Using peer 22522@kfi7(0x100000000000187)
00000800:00000200:15.0:1773851892.974785:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x100000000000187: rc=0
00000800:00000200:15.0:1773851892.974787:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000187 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851892.974789:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851892.974791:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ae846ee2 refcount 4 to 22523@kfi7
00010000:00000001:15.0:1773851892.974791:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851892.974792:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.974793:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851892.974793:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000862431e4 x1858030971480832/t0(0) o400->9452187a-0cb4-427a-9290-dba0ec33c99c@22523@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne256-0'
00000100:00100000:15.0:1773851892.974796:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000862431e4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:9452187a-0cb4-427a-9290-dba0ec33c99c+6:47820:x1858030971480832:12345-22523@kfi7:400:default-tuolumne256-0 Request processed in 63us (114us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851892.974799:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22523@kfi7, seq: 2289913
00000100:00000040:15.0:1773851892.974799:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000293b6a23 : new rpc_count 0
00000100:00000001:15.0:1773851892.974800:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851892.974800:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000187 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851892.974801:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851892.974802:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:15.0:1773851892.974802:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000028d2b47d.
00000400:00000200:13.0:1773851892.974802:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851892.974803:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000057ada156.
00000400:00000200:13.0:1773851892.974803:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22522@kfi7: PUT: OK
00000020:00000040:15.0:1773851892.974804:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000293b6a23 : new refcount 5
00000400:00000200:13.0:1773851892.974804:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dbadbd2e
00000100:00000001:15.0:1773851892.974805:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851892.974805:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dbadbd2e.
00000100:00000001:13.0:1773851892.974805:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851892.974805:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851892.974806:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000800:00000200:13.0:1773851892.974808:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 22522@kfi7(00000000c30aad68):0x0 lsk 392 rsk 89 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000187 Transaction freed
00000800:00000200:13.0:1773851892.975325:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851892.975326:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851892.975328:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851892.975330:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851892.975332:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.975333:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22522@kfi7 : PUT - for me
00000400:00000200:13.0:1773851892.975334:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.975334:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 1
00000400:00000200:13.0:1773851892.975335:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.975336:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000400:00000200:13.0:1773851892.975337:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 3
00000400:00000200:13.0:1773851892.975337:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22523@kfi7 to cpt 6
00000400:00000200:13.0:1773851892.975338:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22523@kfi7 of length 224 into portal 12 MB=0x699de8c0972c0
00000400:00000200:13.0:1773851892.975339:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22523@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 50528
00000800:00000200:13.0:1773851892.975341:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851892.975342:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.975343:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22522@kfi7: PUT: OK
00000100:00000001:13.0:1773851892.975344:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851892.975345:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851892.975345:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004489d4d0.
00000100:00000040:13.0:1773851892.975346:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000004489d4d0 x1858030971482816 msgsize 224
00000100:00100000:13.0:1773851892.975347:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22523@kfi7 (source: 12345-22522@kfi7)
00000100:00000001:13.0:1773851892.975348:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851892.975349:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851892.975349:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
02000000:00000001:15.0:1773851892.975350:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851892.975350:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851892.975351:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851892.975351:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851892.975352:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851892.975353:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030971482816
00000020:00000001:15.0:1773851892.975353:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851892.975354:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e47
00000020:00000001:15.0:1773851892.975354:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851892.975360:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a77c55f refcount=6
00000020:00000001:15.0:1773851892.975361:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239652352 : -107152469899264 : ffff9e8b9f184800)
00000020:00000001:15.0:1773851892.975362:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239652352 : -107152469899264 : ffff9e8b9f184800)
00000100:00000001:15.0:1773851892.975362:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851892.975363:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851892.975364:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eae3db6f.
00000020:00000010:15.0:1773851892.975364:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851892.975365:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851892.975366:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851892.975367:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851892.975367:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851892.975368:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851892.975369:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851892.975369:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.975370:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851892.975371:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851892.975371:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851892.975371:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851892.975372:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22523@kfi7, seq: 2289914
00000100:00000001:12.0:1773851892.975372:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851892.975373:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a77c55f : new rpc_count 1
00000100:00000001:15.0:1773851892.975373:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485603840 : -107000223947776 : ffff9eaf11a92400)
00000100:00000001:12.0:1773851892.975373:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851892.975373:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851892.975374:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004489d4d0 x1858030971482816/t0(0) o400->ea6e8e0c-ad8a-4941-9d99-4f14520b2ac4@22523@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne256-0'
00000100:00000001:15.0:1773851892.975377:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851892.975377:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851892.975378:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004489d4d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ea6e8e0c-ad8a-4941-9d99-4f14520b2ac4+6:47819:x1858030971482816:12345-22523@kfi7:400:default-tuolumne256-0
00000100:00000200:15.0:1773851892.975379:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030971482816
00000020:00000001:15.0:1773851892.975380:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851892.975380:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851892.975381:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.975381:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851892.975382:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851892.975383:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851892.975383:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030971482816, found 0 last_xid 1858030971482815
00000020:00000001:15.0:1773851892.975384:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851892.975384:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851892.975385:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851892.975385:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.975386:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851892.975386:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851892.975387:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851892.975389:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000471bcb6.
02000000:00000001:15.0:1773851892.975389:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.975390:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.975390:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851892.975391:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768041, transno 0, xid 1858030971482816
00010000:00000001:15.0:1773851892.975391:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851892.975392:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004489d4d0 x1858030971482816/t0(0) o400->ea6e8e0c-ad8a-4941-9d99-4f14520b2ac4@22523@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne256-0'
00010000:00000001:15.0:1773851892.975394:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851892.975395:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851892.975395:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=125 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851892.975396:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851892.975397:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ae846ee2 refcount 5 to 22523@kfi7
00000100:00000001:15.0:1773851892.975397:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420224 : -107156724131392 : ffff9e8aa185d9c0)
02000000:00000001:15.0:1773851892.975398:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851892.975398:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.975399:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851892.975400:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22522@kfi7
00000400:00000010:15.0:1773851892.975400:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008af5e37b.
00000100:00000200:15.0:1773851892.975401:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030971482816, offset 224
00000400:00000200:15.0:1773851892.975402:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22522@kfi7
00000400:00000200:15.0:1773851892.975403:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:15.0:1773851892.975404:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 1
00000400:00000200:15.0:1773851892.975404:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000400:00000200:15.0:1773851892.975405:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 3
00000400:00000200:15.0:1773851892.975406:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22522@kfi7 local destination
00000400:00000200:15.0:1773851892.975408:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770065:8770065:1024:4294967295] 22522@kfi7 LPNI seq info [24408:24408:16:4294967295]
00000400:00000200:15.0:1773851892.975409:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000400:00000200:15.0:1773851892.975410:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22522@kfi7 to cpt 3
00000400:00000200:15.0:1773851892.975412:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22522@kfi7(22522@kfi7:22522@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851892.975413:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 3
00000800:00000200:15.0:1773851892.975414:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851892.975415:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851892.975417:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851892.975419:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x180 Using peer 22522@kfi7(0x180)
00000800:00000200:15.0:1773851892.975422:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x180: rc=0
00000800:00000200:15.0:1773851892.975423:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x180 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851892.975425:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851892.975426:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ae846ee2 refcount 4 to 22523@kfi7
00010000:00000001:15.0:1773851892.975426:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851892.975427:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.975427:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851892.975428:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004489d4d0 x1858030971482816/t0(0) o400->ea6e8e0c-ad8a-4941-9d99-4f14520b2ac4@22523@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne256-0'
00000100:00100000:15.0:1773851892.975430:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004489d4d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:ea6e8e0c-ad8a-4941-9d99-4f14520b2ac4+6:47819:x1858030971482816:12345-22523@kfi7:400:default-tuolumne256-0 Request processed in 53us (84us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851892.975433:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22523@kfi7, seq: 2289914
00000100:00000040:15.0:1773851892.975433:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a77c55f : new rpc_count 0
00000100:00000001:15.0:1773851892.975434:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851892.975434:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851892.975435:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851892.975435:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000800:00000200:13.0:1773851892.975435:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x180 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851892.975436:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eae3db6f.
00000020:00000040:15.0:1773851892.975437:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000001a77c55f : new refcount 5
00000100:00000001:15.0:1773851892.975437:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851892.975437:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.975438:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22522@kfi7: PUT: OK
00000400:00000200:13.0:1773851892.975439:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008af5e37b
00000400:00000010:13.0:1773851892.975440:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008af5e37b.
00000100:00000001:13.0:1773851892.975440:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851892.975441:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851892.975442:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb8653d3 nid 22522@kfi7 refs 2
00000800:00000200:13.0:1773851892.975443:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 22522@kfi7(000000001a97b4f0):0x0 lsk 385 rsk 88 tsk 0 trmk 0 tmk 0 trr 3 tta 0x180 Transaction freed
00000800:00000200:17.0:1773851892.990691:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851892.990692:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851892.990694:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851892.990701:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851892.990704:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.990706:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23546@kfi7 : PUT - for me
00000400:00000200:17.0:1773851892.990708:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.990709:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:17.0:1773851892.990711:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.990712:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:17.0:1773851892.990714:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:17.0:1773851892.990716:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.990717:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23546@kfi7 of length 224 into portal 12 MB=0x699de8c5a9680
00000400:00000200:17.0:1773851892.990719:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23546@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 41408
00000800:00000200:17.0:1773851892.990722:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851892.990732:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851892.990734:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23546@kfi7: PUT: OK
00000100:00000001:17.0:1773851892.990736:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851892.990736:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851892.990738:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a3567501.
00000100:00000040:17.0:1773851892.990739:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a3567501 x1858030976800384 msgsize 224
00000100:00100000:17.0:1773851892.990741:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-23546@kfi7 (source: 12345-23546@kfi7)
00000100:00000001:17.0:1773851892.990743:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851892.990745:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000800:00000200:17.0:1773851892.990747:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2069@kfi7:4 <- 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851892.990761:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851892.990762:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851892.990763:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851892.990763:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851892.990765:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851892.990766:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976800384
00000020:00000001:17.0:1773851892.990767:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851892.990768:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f90
00000020:00000001:17.0:1773851892.990769:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851892.990771:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000187f9747 refcount=6
00000020:00000001:17.0:1773851892.990772:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239866368 : -107152469685248 : ffff9e8b9f1b8c00)
00000020:00000001:17.0:1773851892.990774:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239866368 : -107152469685248 : ffff9e8b9f1b8c00)
00000100:00000001:17.0:1773851892.990775:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851892.990776:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851892.990777:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000455b6f1c.
00000020:00000010:17.0:1773851892.990779:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851892.990780:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851892.990781:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851892.990782:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851892.990783:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851892.990784:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851892.990785:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851892.990786:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.990787:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851892.990789:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851892.990790:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851892.990790:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851892.990790:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851892.990791:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23546@kfi7, seq: 2156413
00000100:00000040:17.0:1773851892.990792:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000187f9747 : new rpc_count 1
00000100:00000001:16.0:1773851892.990792:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.990793:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968769280 : -106974740782336 : ffff9eb500936300)
00000100:00000001:16.0:1773851892.990794:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851892.990795:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a3567501 x1858030976800384/t0(0) o400->f83d0353-aeb7-4630-9f36-c327d0c5209d@23546@kfi7:144/0 lens 224/0 e 0 to 0 dl 1773852259 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne260-0'
00000100:00000001:17.0:1773851892.990800:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851892.990801:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851892.990802:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3567501 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:f83d0353-aeb7-4630-9f36-c327d0c5209d+6:47932:x1858030976800384:12345-23546@kfi7:400:default-tuolumne260-0
00000100:00000200:17.0:1773851892.990804:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976800384
00000020:00000001:17.0:1773851892.990805:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851892.990806:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851892.990807:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.990808:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851892.990810:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851892.990811:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851892.990812:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976800384, found 0 last_xid 1858030976800383
00000020:00000001:17.0:1773851892.990813:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851892.990814:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851892.990814:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851892.990815:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.990816:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851892.990817:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851892.990818:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851892.990820:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006bd1fb6d.
02000000:00000001:17.0:1773851892.990821:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.990822:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.990823:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851892.990824:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030976800384
00010000:00000001:17.0:1773851892.990825:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851892.990826:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a3567501 x1858030976800384/t0(0) o400->f83d0353-aeb7-4630-9f36-c327d0c5209d@23546@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00010000:00000001:17.0:1773851892.990830:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851892.990831:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851892.990832:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=125 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851892.990834:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851892.990835:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000099c32eae refcount 5 to 23546@kfi7
00000100:00000001:17.0:1773851892.990836:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992800 : -107142345558816 : ffff9e8dfa8d74e0)
02000000:00000001:17.0:1773851892.990837:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851892.990838:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.990839:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851892.990840:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23546@kfi7
00000400:00000010:17.0:1773851892.990841:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000079b3bb7.
00000100:00000200:17.0:1773851892.990842:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976800384, offset 224
00000400:00000200:17.0:1773851892.990845:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23546@kfi7
00000400:00000200:17.0:1773851892.990846:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.990847:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:17.0:1773851892.990849:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:17.0:1773851892.990851:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:17.0:1773851892.990852:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23546@kfi7 local destination
00000400:00000200:17.0:1773851892.990854:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770066:8770066:1024:4294967295] 23546@kfi7 LPNI seq info [24417:24417:16:4294967295]
00000400:00000200:17.0:1773851892.990857:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:17.0:1773851892.990858:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.990861:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23546@kfi7(23546@kfi7:23546@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851892.990863:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000800:00000200:17.0:1773851892.990864:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851892.990866:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851892.990869:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851892.990873:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 Using peer 23546@kfi7(0x184)
00000800:00000200:17.0:1773851892.990877:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x184: rc=0
00000800:00000200:17.0:1773851892.990879:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851892.990882:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851892.990884:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000099c32eae refcount 4 to 23546@kfi7
00010000:00000001:17.0:1773851892.990885:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851892.990885:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.990886:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851892.990887:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a3567501 x1858030976800384/t0(0) o400->f83d0353-aeb7-4630-9f36-c327d0c5209d@23546@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00000100:00100000:17.0:1773851892.990892:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3567501 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:f83d0353-aeb7-4630-9f36-c327d0c5209d+6:47932:x1858030976800384:12345-23546@kfi7:400:default-tuolumne260-0 Request processed in 91us (152us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851892.990895:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851892.990896:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23546@kfi7, seq: 2156413
00000100:00000040:17.0:1773851892.990897:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000187f9747 : new rpc_count 0
00000400:00000200:18.0:1773851892.990898:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851892.990898:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851892.990899:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23546@kfi7: PUT: OK
00000100:00000001:17.0:1773851892.990899:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851892.990900:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000400:00000200:18.0:1773851892.990901:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000079b3bb7
00000020:00000010:17.0:1773851892.990901:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000400:00000010:18.0:1773851892.990902:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000079b3bb7.
00000020:00000010:17.0:1773851892.990902:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000455b6f1c.
00000100:00000001:18.0:1773851892.990903:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851892.990904:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:17.0:1773851892.990904:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000187f9747 : new refcount 5
00000400:00000200:18.0:1773851892.990905:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000100:00000001:17.0:1773851892.990905:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851892.990907:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2069@kfi7:4 -> 23546@kfi7(0000000087a7a903):0x0 lsk 389 rsk 91 tsk 0 trmk 0 tmk 0 trr 4 tta 0x184 Transaction freed
00000800:00000200:18.0:1773851892.991080:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851892.991081:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851892.991083:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851892.991086:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851892.991089:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851892.991090:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23546@kfi7 : PUT - for me
00000400:00000200:18.0:1773851892.991092:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851892.991093:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:18.0:1773851892.991095:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851892.991095:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:18.0:1773851892.991097:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:18.0:1773851892.991098:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:18.0:1773851892.991099:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23546@kfi7 of length 224 into portal 12 MB=0x699de8c5a9f00
00000400:00000200:18.0:1773851892.991101:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23546@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 41632
00000800:00000200:18.0:1773851892.991104:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851892.991106:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851892.991108:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23546@kfi7: PUT: OK
00000100:00000001:18.0:1773851892.991109:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851892.991109:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851892.991110:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001dc01b5a.
00000100:00000040:18.0:1773851892.991111:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001dc01b5a x1858030976802560 msgsize 224
00000100:00100000:18.0:1773851892.991114:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-23546@kfi7 (source: 12345-23546@kfi7)
00000100:00000001:18.0:1773851892.991115:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851892.991116:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000800:00000200:18.0:1773851892.991118:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851892.991118:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851892.991118:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851892.991119:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851892.991120:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851892.991121:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851892.991122:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976802560
00000020:00000001:17.0:1773851892.991123:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851892.991124:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911b2
00000020:00000001:17.0:1773851892.991124:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851892.991126:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000054d37d52 refcount=6
00000020:00000001:17.0:1773851892.991128:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240524800 : -107152469026816 : ffff9e8b9f259800)
00000020:00000001:17.0:1773851892.991129:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240524800 : -107152469026816 : ffff9e8b9f259800)
00000100:00000001:17.0:1773851892.991130:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851892.991131:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851892.991132:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000455b6f1c.
00000020:00000010:17.0:1773851892.991133:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851892.991134:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851892.991136:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851892.991136:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851892.991137:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851892.991138:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851892.991139:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851892.991140:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.991141:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851892.991143:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851892.991144:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851892.991144:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851892.991145:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23546@kfi7, seq: 2156414
00000100:00000001:16.0:1773851892.991145:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851892.991147:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000054d37d52 : new rpc_count 1
00000100:00000001:16.0:1773851892.991147:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.991148:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609990784 : -107015099560832 : ffff9eab9b014c80)
00000100:00000001:16.0:1773851892.991148:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851892.991150:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001dc01b5a x1858030976802560/t0(0) o400->0e359517-5439-415d-800b-f4100739af6b@23546@kfi7:144/0 lens 224/0 e 0 to 0 dl 1773852259 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne260-0'
00000100:00000001:17.0:1773851892.991155:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851892.991156:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851892.991157:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001dc01b5a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0e359517-5439-415d-800b-f4100739af6b+6:47933:x1858030976802560:12345-23546@kfi7:400:default-tuolumne260-0
00000100:00000200:17.0:1773851892.991159:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976802560
00000020:00000001:17.0:1773851892.991160:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851892.991161:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851892.991162:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.991163:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851892.991164:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851892.991165:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851892.991166:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976802560, found 0 last_xid 1858030976802559
00000020:00000001:17.0:1773851892.991167:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851892.991168:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851892.991169:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851892.991169:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.991170:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851892.991171:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851892.991172:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851892.991173:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000554592a1.
02000000:00000001:17.0:1773851892.991174:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.991175:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.991176:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851892.991177:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768321, transno 0, xid 1858030976802560
00010000:00000001:17.0:1773851892.991178:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851892.991180:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001dc01b5a x1858030976802560/t0(0) o400->0e359517-5439-415d-800b-f4100739af6b@23546@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00010000:00000001:17.0:1773851892.991184:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851892.991185:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851892.991186:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=125 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851892.991188:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851892.991190:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000099c32eae refcount 5 to 23546@kfi7
00000100:00000001:17.0:1773851892.991191:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992800 : -107142345558816 : ffff9e8dfa8d74e0)
02000000:00000001:17.0:1773851892.991192:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851892.991193:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851892.991194:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851892.991195:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23546@kfi7
00000400:00000010:17.0:1773851892.991195:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000043bc2cef.
00000100:00000200:17.0:1773851892.991197:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976802560, offset 224
00000400:00000200:17.0:1773851892.991199:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23546@kfi7
00000400:00000200:17.0:1773851892.991200:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.991201:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 1
00000400:00000200:17.0:1773851892.991202:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:17.0:1773851892.991204:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000400:00000200:17.0:1773851892.991205:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23546@kfi7 local destination
00000400:00000200:17.0:1773851892.991207:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770067:8770067:1024:4294967295] 23546@kfi7 LPNI seq info [24418:24418:16:4294967295]
00000400:00000200:17.0:1773851892.991208:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000400:00000200:17.0:1773851892.991209:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23546@kfi7 to cpt 4
00000400:00000200:17.0:1773851892.991211:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23546@kfi7(23546@kfi7:23546@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851892.991212:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 3
00000800:00000200:17.0:1773851892.991214:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851892.991215:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851892.991217:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851892.991219:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a Using peer 23546@kfi7(0x10000000000018a)
00000800:00000200:17.0:1773851892.991222:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x10000000000018a: rc=0
00000800:00000200:17.0:1773851892.991223:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851892.991225:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851892.991227:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000099c32eae refcount 4 to 23546@kfi7
00010000:00000001:17.0:1773851892.991227:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851892.991228:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851892.991228:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851892.991229:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001dc01b5a x1858030976802560/t0(0) o400->0e359517-5439-415d-800b-f4100739af6b@23546@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne260-0'
00000100:00100000:17.0:1773851892.991232:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001dc01b5a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:0e359517-5439-415d-800b-f4100739af6b+6:47933:x1858030976802560:12345-23546@kfi7:400:default-tuolumne260-0 Request processed in 76us (120us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851892.991234:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23546@kfi7, seq: 2156414
00000100:00000040:17.0:1773851892.991235:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000054d37d52 : new rpc_count 0
00000100:00000001:17.0:1773851892.991236:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851892.991236:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851892.991236:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000800:00000200:18.0:1773851892.991237:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851892.991237:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000400:00000200:18.0:1773851892.991238:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851892.991238:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000455b6f1c.
00000020:00000040:17.0:1773851892.991238:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000054d37d52 : new refcount 5
00000400:00000200:18.0:1773851892.991239:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23546@kfi7: PUT: OK
00000100:00000001:17.0:1773851892.991239:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851892.991240:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000043bc2cef
00000400:00000010:18.0:1773851892.991240:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000043bc2cef.
00000100:00000001:18.0:1773851892.991240:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851892.991241:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851892.991242:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d780691c nid 23546@kfi7 refs 2
00000800:00000200:18.0:1773851892.991243:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 23546@kfi7(000000002a502962):0x0 lsk 395 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000018a Transaction freed
00000800:00000200:13.0:1773851892.994578:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851892.994580:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851892.994581:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851892.994583:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851892.994585:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9089@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.994586:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9089@kfi7 : PUT - for me
00000400:00000200:13.0:1773851892.994587:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9089@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.994587:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2db7394 nid 9089@kfi7 refs 1
00000400:00000200:13.0:1773851892.994588:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9089@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.994589:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2db7394 nid 9089@kfi7 refs 2
00000400:00000200:13.0:1773851892.994590:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d2db7394 nid 9089@kfi7 refs 3
00000400:00000200:13.0:1773851892.994591:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9089@kfi7 to cpt 3
00000400:00000200:13.0:1773851892.994592:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9089@kfi7 of length 224 into portal 12 MB=0x699e28c056380
00000400:00000200:13.0:1773851892.994593:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9089@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 50752
00000800:00000200:13.0:1773851892.994595:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851892.994596:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851892.994597:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9089@kfi7: PUT: OK
00000100:00000001:13.0:1773851892.994598:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851892.994599:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851892.994600:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002e2d0b5a.
00000100:00000040:13.0:1773851892.994600:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000002e2d0b5a x1858048151085952 msgsize 224
00000100:00100000:13.0:1773851892.994602:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9089@kfi7 (source: 12345-9089@kfi7)
00000100:00000001:13.0:1773851892.994603:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851892.994604:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851892.994604:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d2db7394 nid 9089@kfi7 refs 2
02000000:00000001:15.0:1773851892.994605:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851892.994605:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851892.994605:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851892.994606:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851892.994607:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851892.994608:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858048151085952
00000020:00000001:15.0:1773851892.994608:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851892.994609:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912bc
00000020:00000001:15.0:1773851892.994610:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851892.994614:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000099d0743a refcount=7
00000020:00000001:15.0:1773851892.994615:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716202496 : -107155993349120 : ffff9e8acd14b400)
00000020:00000001:15.0:1773851892.994615:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716202496 : -107155993349120 : ffff9e8acd14b400)
00000100:00000001:15.0:1773851892.994616:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851892.994617:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851892.994618:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008c779a05.
00000020:00000010:15.0:1773851892.994619:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851892.994620:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851892.994621:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851892.994621:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851892.994622:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851892.994623:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851892.994623:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851892.994623:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.994624:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851892.994625:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851892.994626:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851892.994626:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851892.994626:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851892.994627:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9089@kfi7, seq: 2289915
00000100:00000040:15.0:1773851892.994628:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000099d0743a : new rpc_count 2
00000100:00000001:12.0:1773851892.994628:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.994629:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485614208 : -107000223937408 : ffff9eaf11a94c80)
00000100:00000001:12.0:1773851892.994629:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851892.994630:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002e2d0b5a x1858048151085952/t0(0) o400->39fbe3bc-efde-4d80-a4a0-1d91e2f05a53@9089@kfi7:619/0 lens 224/0 e 0 to 0 dl 1773851979 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1060-0'
00000100:00000001:15.0:1773851892.994633:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851892.994633:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851892.994634:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e2d0b5a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:39fbe3bc-efde-4d80-a4a0-1d91e2f05a53+7:39729:x1858048151085952:12345-9089@kfi7:400:default-tuolumne1060-0
00000100:00000200:15.0:1773851892.994636:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858048151085952
00000020:00000001:15.0:1773851892.994636:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851892.994637:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851892.994638:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.994639:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851892.994639:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851892.994640:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851892.994641:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858048151085952, found 0 last_xid 1858048150881983
00000020:00000001:15.0:1773851892.994642:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851892.994642:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851892.994643:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851892.994643:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.994644:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851892.994644:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851892.994645:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851892.994646:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eae3db6f.
02000000:00000001:15.0:1773851892.994646:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.994647:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.994648:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851892.994648:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182767912274, transno 0, xid 1858048151085952
00010000:00000001:15.0:1773851892.994649:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851892.994650:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002e2d0b5a x1858048151085952/t0(0) o400->39fbe3bc-efde-4d80-a4a0-1d91e2f05a53@9089@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1060-0'
00010000:00000001:15.0:1773851892.994652:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851892.994653:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851892.994653:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=125 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851892.994654:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851892.994655:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006cce2e2c refcount 3 to 9089@kfi7
00000100:00000001:15.0:1773851892.994656:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154144 : -107139310397472 : ffff9e8eaf7657e0)
02000000:00000001:15.0:1773851892.994657:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851892.994657:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851892.994658:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851892.994659:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9089@kfi7
00000400:00000010:15.0:1773851892.994659:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5868b8.
00000100:00000200:15.0:1773851892.994660:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858048151085952, offset 224
00000400:00000200:15.0:1773851892.994662:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9089@kfi7
00000400:00000200:15.0:1773851892.994662:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9089@kfi7 to cpt 3
00000400:00000200:15.0:1773851892.994663:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d2db7394 nid 9089@kfi7 refs 1
00000400:00000200:15.0:1773851892.994666:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d2db7394 nid 9089@kfi7 refs 2
00000400:00000200:15.0:1773851892.994667:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d2db7394 nid 9089@kfi7 refs 3
00000400:00000200:15.0:1773851892.994669:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9089@kfi7 local destination
00000400:00000200:15.0:1773851892.994670:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770068:8770068:1024:4294967295] 9089@kfi7 LPNI seq info [22703804:22703804:16:4294967295]
00000400:00000200:15.0:1773851892.994671:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d2db7394 nid 9089@kfi7 refs 2
00000400:00000200:15.0:1773851892.994672:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9089@kfi7 to cpt 3
00000400:00000200:15.0:1773851892.994674:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9089@kfi7(9089@kfi7:9089@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851892.994675:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d2db7394 nid 9089@kfi7 refs 3
00000800:00000200:15.0:1773851892.994677:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851892.994678:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851892.994680:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851892.994682:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3cb Using peer 9089@kfi7(0x3cb)
00000800:00000200:15.0:1773851892.994685:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x3cb: rc=0
00000800:00000200:15.0:1773851892.994687:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851892.994688:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851892.994689:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006cce2e2c refcount 2 to 9089@kfi7
00010000:00000001:15.0:1773851892.994690:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851892.994691:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851892.994691:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851892.994692:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002e2d0b5a x1858048151085952/t0(0) o400->39fbe3bc-efde-4d80-a4a0-1d91e2f05a53@9089@kfi7:619/0 lens 224/224 e 0 to 0 dl 1773851979 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1060-0'
00000100:00100000:15.0:1773851892.994695:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e2d0b5a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:39fbe3bc-efde-4d80-a4a0-1d91e2f05a53+7:39729:x1858048151085952:12345-9089@kfi7:400:default-tuolumne1060-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851892.994698:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9089@kfi7, seq: 2289915
00000100:00000040:15.0:1773851892.994698:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000099d0743a : new rpc_count 1
00000800:00000200:13.0:1773851892.994699:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3cb TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851892.994700:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851892.994700:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851892.994700:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851892.994701:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851892.994702:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:15.0:1773851892.994702:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008c779a05.
00000400:00000200:13.0:1773851892.994702:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9089@kfi7: PUT: OK
00000020:00000040:15.0:1773851892.994703:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000099d0743a : new refcount 6
00000400:00000200:13.0:1773851892.994703:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5868b8
00000400:00000010:13.0:1773851892.994703:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5868b8.
00000100:00000001:15.0:1773851892.994704:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851892.994704:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851892.994704:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851892.994705:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d2db7394 nid 9089@kfi7 refs 2
00000800:00000200:13.0:1773851892.994707:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 9089@kfi7(000000003b0c5f2f):0x0 lsk 972 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x3cb Transaction freed
00000004:00000001:11.0:1773851893.065730:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851893.065731:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851893.065731:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001753dd84.
00000004:00000001:10.0:1773851893.065731:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:11.0:1773851893.065732:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000004:00000020:10.0:1773851893.065732:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:11.0:1773851893.065733:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851893.065733:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:10.0:1773851893.065733:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000037d69b00.
02000000:00000001:11.0:1773851893.065734:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851893.065734:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
02000000:00000010:11.0:1773851893.065735:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004ecafcc4.
00000100:00000001:11.0:1773851893.065736:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.065736:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851893.065736:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851893.065736:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:11.0:1773851893.065737:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851893.065737:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851893.065738:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001753dd84] to pc [ptlrpcd_02_01+1]  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:10.0:1773851893.065739:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001614bd7e.
00000100:00000001:10.0:1773851893.065741:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851893.065742:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851893.065742:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851893.065743:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065744:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851893.065744:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:10.0:1773851893.065745:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000037d69b00] to pc [ptlrpcd_02_02+2]  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851893.065745:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065745:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851893.065745:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:8.0:1773851893.065746:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:10.0:1773851893.065752:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065752:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851893.065752:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851893.065752:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065753:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851893.065753:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:8.0:1773851893.065753:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:11.0:1773851893.065754:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851893.065754:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851893.065754:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851893.065754:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851893.065755:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001753dd84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051938496:42@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851893.065756:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:9.0:1773851893.065757:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851893.065757:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851893.065757:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851893.065757:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851893.065758:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851893.065758:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:9.0:1773851893.065759:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851893.065759:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000098c0e011.
00000100:00100000:9.0:1773851893.065760:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051938560:12@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851893.065760:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065761:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851893.065761:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:8.0:1773851893.065761:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:8.0:1773851893.065761:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
02000000:00000001:9.0:1773851893.065762:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851893.065762:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:8.0:1773851893.065762:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b95ec19a.
02000000:00000010:9.0:1773851893.065763:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006107aa26.
02000000:00000001:9.0:1773851893.065764:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851893.065764:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938496, portal 4
00000100:00000001:8.0:1773851893.065764:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:9.0:1773851893.065765:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:9.0:1773851893.065765:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000100:00000001:8.0:1773851893.065765:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446606464 : -106937262945152 : ffff9ebdba6dcc80)
00000400:00000010:9.0:1773851893.065766:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000016999e1e.
00000100:00000040:8.0:1773851893.065766:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851893.065767:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938560, portal 4
00000100:00000001:9.0:1773851893.065768:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851893.065768:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087763328 : -106944621788288 : ffff9ebc03cec380)
00000100:00000040:9.0:1773851893.065769:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.065769:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851893.065770:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:8.0:1773851893.065770:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bae78c35.
00000100:00000200:8.0:1773851893.065771:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938496, offset 0
00000100:00000001:9.0:1773851893.065772:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851893.065772:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000100:00000040:9.0:1773851893.065773:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:9.0:1773851893.065773:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000400:00000200:8.0:1773851893.065773:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000100:00000200:9.0:1773851893.065774:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938560, offset 0
00000400:00000200:8.0:1773851893.065774:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:9.0:1773851893.065775:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:8.0:1773851893.065775:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:8.0:1773851893.065777:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:8.0:1773851893.065778:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:8.0:1773851893.065779:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770068, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770067, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851893.065782:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851893.065783:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851893.065784:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:8.0:1773851893.065785:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770069:8770069:1024:4294967295] 42@kfi7 LPNI seq info [5404903:5404903:16:4294967295]
00000400:00000200:8.0:1773851893.065786:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:8.0:1773851893.065787:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851893.065788:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.065789:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:8.0:1773851893.065789:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851893.065790:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851893.065791:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:8.0:1773851893.065791:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:9.0:1773851893.065792:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000800:00000200:8.0:1773851893.065792:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851893.065793:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770068, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770069, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851893.065794:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851893.065795:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851893.065796:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851893.065796:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851893.065797:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000400:00000200:9.0:1773851893.065798:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770070:8770070:1024:4294967295] 12@kfi7 LPNI seq info [5403462:5403462:16:4294967295]
00000800:00000200:8.0:1773851893.065798:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Using peer 42@kfi7(0x200000000000183)
00000400:00000200:9.0:1773851893.065799:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851893.065800:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:8.0:1773851893.065802:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x200000000000183: rc=0
00000400:00000200:9.0:1773851893.065803:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851893.065803:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851893.065804:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000800:00000200:9.0:1773851893.065805:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851893.065805:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851893.065806:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851893.065806:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851893.065807:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065808:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065808:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851893.065809:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851893.065809:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:9.0:1773851893.065811:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Using peer 12@kfi7(0x47e)
00000100:00000001:8.0:1773851893.065811:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851893.065812:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851893.065813:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851893.065814:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x47e: rc=0
00000800:00000200:9.0:1773851893.065815:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851893.065816:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065817:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065817:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851893.065818:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851893.065818:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851893.065818:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065819:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065819:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:11.0:1773851893.065820:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851893.065820:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:11.0:1773851893.065821:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000100:00000001:9.0:1773851893.065821:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851893.065821:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:11.0:1773851893.065822:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bae78c35
00000400:00000010:11.0:1773851893.065822:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bae78c35.
00000100:00000001:9.0:1773851893.065822:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851893.065823:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851893.065823:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065823:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851893.065824:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851893.065826:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851893.065827:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851893.065828:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851893.065829:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851893.065829:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851893.065830:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851893.065830:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000400:00000200:11.0:1773851893.065831:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851893.065831:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000400:00000010:9.0:1773851893.065832:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:9.0:1773851893.065832:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:11.0:1773851893.065833:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Transaction freed
00000100:00000200:9.0:1773851893.065833:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851893.065835:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851893.065836:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851893.065838:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065839:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851893.065839:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:9.0:1773851893.065841:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Transaction freed
00000800:00000200:25.0:1773851893.065857:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851893.065858:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851893.065859:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851893.065861:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851893.065863:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.065865:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 42@kfi7 : PUT - for me
00000800:00000200:9.0:1773851893.065865:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:25.0:1773851893.065866:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000800:00000200:9.0:1773851893.065866:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851893.065867:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000800:00000200:9.0:1773851893.065867:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851893.065868:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.065868:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:25.0:1773851893.065870:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000800:00000200:9.0:1773851893.065870:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851893.065871:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.065872:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5ec0
00000400:00000200:9.0:1773851893.065872:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:25.0:1773851893.065873:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851893.065873:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:25.0:1773851893.065874:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b82f39 [1] + 224
00000400:00000200:9.0:1773851893.065874:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.065875:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851893.065876:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:25.0:1773851893.065877:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851893.065877:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851893.065878:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:25.0:1773851893.065879:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851893.065879:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:25.0:1773851893.065880:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000400:00000200:9.0:1773851893.065880:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5f00
00000100:00000001:25.0:1773851893.065881:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851893.065881:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000200:25.0:1773851893.065883:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851893.065883:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781698be9 [1] + 224
00000800:00000200:9.0:1773851893.065885:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:25.0:1773851893.065886:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851893.065886:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851893.065887:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851893.065888:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851893.065889:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851893.065890:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:25.0:1773851893.065891:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:8.0:1773851893.065891:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:25.0:1773851893.065892:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000040:9.0:1773851893.065892:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.065892:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:8.0:1773851893.065893:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851893.065893:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851893.065894:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000100:00000001:9.0:1773851893.065895:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:8.0:1773851893.065895:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b95ec19a
00000400:00000200:9.0:1773851893.065896:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000010:8.0:1773851893.065896:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b95ec19a.
00000100:00000001:8.0:1773851893.065896:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:9.0:1773851893.065897:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000200:8.0:1773851893.065897:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851893.065900:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851893.065900:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:8.0:1773851893.065900:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:9.0:1773851893.065901:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851893.065901:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851893.065901:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000400:00000200:9.0:1773851893.065902:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000016999e1e
00000400:00000010:9.0:1773851893.065902:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000016999e1e.
00000100:00000001:9.0:1773851893.065903:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851893.065903:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.065903:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851893.065904:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.065904:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851893.065905:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851893.065905:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:9.0:1773851893.065906:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.065906:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851893.065907:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065908:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:8.0:1773851893.065908:0:41069:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=126 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851893.065909:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851893.065909:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851893.065909:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:8.0:1773851893.065909:0:41069:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=126 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851893.065910:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851893.065910:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065910:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851893.065910:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851893.065911:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:9.0:1773851893.065912:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851893.065912:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=126 v=66 (66 66 66 66)
00010000:00000001:8.0:1773851893.065912:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065913:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851893.065913:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00001000:9.0:1773851893.065914:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=126 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851893.065914:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851893.065914:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065915:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851893.065915:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851893.065915:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:8.0:1773851893.065915:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:9.0:1773851893.065916:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065917:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851893.065917:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:9.0:1773851893.065918:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851893.065918:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065918:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:9.0:1773851893.065919:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.065919:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851893.065919:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851893.065920:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851893.065921:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:8.0:1773851893.065921:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851893.065921:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351378973696 avail=351376034816 avail_mb=1372562636 hwm_mb=3131103 files=372018968 ffree=343143529 state=0: rc = 0
00000100:00000001:9.0:1773851893.065922:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851893.065922:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851893.065923:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851893.065923:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000020:8.0:1773851893.065923:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351378973696 free, 351376034816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372018968 files, 343143529 free files
00000004:00000040:9.0:1773851893.065924:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541509120 avail=351539542016 avail_mb=1373201336 hwm_mb=3131101 files=372136560 ffree=343302255 state=0: rc = 0
00000004:00000001:8.0:1773851893.065925:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:9.0:1773851893.065926:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541509120 free, 351539542016 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136560 files, 343302255 free files
00000100:00000040:8.0:1773851893.065926:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851893.065927:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851893.065928:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:8.0:1773851893.065929:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001753dd84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051938496:42@kfi7:13:default-yuba2-0
00000100:00100000:9.0:1773851893.065930:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051938560:12@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851893.065930:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.065931:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851893.065932:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851893.065932:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851893.065932:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001753dd84 x1859433051938496/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:9.0:1773851893.065933:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000037d69b00 x1859433051938560/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.065934:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:9.0:1773851893.065935:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851893.065935:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851893.065935:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000098c0e011.
02000000:00000001:9.0:1773851893.065936:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851893.065937:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006107aa26.
02000000:00000001:8.0:1773851893.065937:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851893.065937:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851893.065937:0:41069:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
02000000:00000001:9.0:1773851893.065938:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851893.065938:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851893.065938:0:41070:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:8.0:1773851893.065938:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:9.0:1773851893.065939:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851893.065939:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004ecafcc4.
02000000:00000010:9.0:1773851893.065940:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001614bd7e.
02000000:00000001:9.0:1773851893.065940:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851893.065940:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851893.065940:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851893.065940:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001753dd84.
02000000:00000001:9.0:1773851893.065941:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851893.065941:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037d69b00.
00000100:00000001:8.0:1773851893.065941:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851893.065942:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851893.065942:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851893.065942:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.065942:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.065942:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851893.065943:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851893.065943:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851893.065943:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065944:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.065944:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851893.065944:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.065944:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851893.065944:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851893.079513:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851893.079514:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851893.079516:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851893.079520:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851893.079523:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18048@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.079525:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18048@kfi7 : PUT - for me
00000400:00000200:13.0:1773851893.079526:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18048@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.079529:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003851274b nid 18048@kfi7 refs 1
00000400:00000200:13.0:1773851893.079531:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18048@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.079532:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003851274b nid 18048@kfi7 refs 2
00000400:00000200:13.0:1773851893.079533:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003851274b nid 18048@kfi7 refs 3
00000400:00000200:13.0:1773851893.079535:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18049@kfi7 to cpt 6
00000400:00000200:13.0:1773851893.079536:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18049@kfi7 of length 224 into portal 12 MB=0x69b81db6b92c0
00000400:00000200:13.0:1773851893.079538:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18049@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 50976
00000800:00000200:13.0:1773851893.079541:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851893.079543:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851893.079548:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18048@kfi7: PUT: OK
00000100:00000001:13.0:1773851893.079549:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851893.079550:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851893.079551:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ea6af247.
00000100:00000040:13.0:1773851893.079552:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ea6af247 x1859831894610624 msgsize 224
00000100:00100000:13.0:1773851893.079554:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18049@kfi7 (source: 12345-18048@kfi7)
00000100:00000001:13.0:1773851893.079556:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851893.079557:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003851274b nid 18048@kfi7 refs 2
00000100:00000001:15.0:1773851893.079559:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851893.079559:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851893.079559:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851893.079560:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851893.079561:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851893.079562:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851893.079564:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831894610624
00000020:00000001:15.0:1773851893.079564:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851893.079565:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce50f3a
00000020:00000001:15.0:1773851893.079566:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851893.079570:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004717a594 refcount=5
00000020:00000001:15.0:1773851893.079572:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119264013312 : -106954445538304 : ffff9eb9ba443c00)
00000020:00000001:15.0:1773851893.079573:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119264013312 : -106954445538304 : ffff9eb9ba443c00)
00000100:00000001:15.0:1773851893.079574:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.079575:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851893.079576:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008c779a05.
00000020:00000010:15.0:1773851893.079577:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851893.079578:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851893.079580:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851893.079580:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851893.079581:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.079582:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851893.079583:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851893.079584:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.079585:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.079587:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851893.079588:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851893.079588:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851893.079588:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851893.079589:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18049@kfi7, seq: 2289916
00000100:00000040:15.0:1773851893.079590:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004717a594 : new rpc_count 1
00000100:00000001:12.0:1773851893.079590:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851893.079591:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.079592:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485611904 : -107000223939712 : ffff9eaf11a94380)
00000100:00000040:15.0:1773851893.079594:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ea6af247 x1859831894610624/t0(0) o400->368f7854-d2ab-4f73-bcdb-68d87303703c@18049@kfi7:620/0 lens 224/0 e 0 to 0 dl 1773851980 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1620-0'
00000100:00000001:15.0:1773851893.079598:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.079599:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851893.079600:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ea6af247 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:368f7854-d2ab-4f73-bcdb-68d87303703c+5:39649:x1859831894610624:12345-18049@kfi7:400:default-tuolumne1620-0
00000100:00000200:15.0:1773851893.079602:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831894610624
00000020:00000001:15.0:1773851893.079603:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851893.079604:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851893.079605:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.079606:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851893.079606:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851893.079608:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851893.079608:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831894610624, found 0 last_xid 1859831894610623
00000020:00000001:15.0:1773851893.079609:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851893.079610:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851893.079611:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851893.079612:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.079613:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851893.079613:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851893.079614:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851893.079617:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fe3ef258.
02000000:00000001:15.0:1773851893.079618:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.079618:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.079619:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851893.079620:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260603556, transno 0, xid 1859831894610624
00010000:00000001:15.0:1773851893.079622:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851893.079623:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ea6af247 x1859831894610624/t0(0) o400->368f7854-d2ab-4f73-bcdb-68d87303703c@18049@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1620-0'
00010000:00000001:15.0:1773851893.079627:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851893.079627:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851893.079629:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=126 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851893.079631:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851893.079632:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f093b37b refcount 3 to 18049@kfi7
00000100:00000001:15.0:1773851893.079633:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336064 : -107152617215552 : ffff9e8b965069c0)
02000000:00000001:15.0:1773851893.079634:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851893.079635:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.079636:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851893.079637:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18048@kfi7
00000400:00000010:15.0:1773851893.079638:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5868b8.
00000100:00000200:15.0:1773851893.079639:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831894610624, offset 224
00000400:00000200:15.0:1773851893.079641:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18048@kfi7
00000400:00000200:15.0:1773851893.079643:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18048@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.079644:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003851274b nid 18048@kfi7 refs 1
00000400:00000200:15.0:1773851893.079646:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003851274b nid 18048@kfi7 refs 2
00000400:00000200:15.0:1773851893.079647:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003851274b nid 18048@kfi7 refs 3
00000400:00000200:15.0:1773851893.079649:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18048@kfi7 local destination
00000400:00000200:15.0:1773851893.079651:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770071:8770071:1024:4294967295] 18048@kfi7 LPNI seq info [11997074:11997074:16:4294967295]
00000400:00000200:15.0:1773851893.079654:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003851274b nid 18048@kfi7 refs 2
00000400:00000200:15.0:1773851893.079655:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18048@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.079658:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18048@kfi7(18048@kfi7:18048@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851893.079660:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003851274b nid 18048@kfi7 refs 3
00000800:00000200:15.0:1773851893.079662:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851893.079664:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851893.079667:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851893.079671:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c00 Using peer 18048@kfi7(0x100000000000c00)
00000800:00000200:15.0:1773851893.079676:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x100000000000c00: rc=0
00000800:00000200:15.0:1773851893.079678:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c00 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851893.079681:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851893.079683:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f093b37b refcount 2 to 18049@kfi7
00010000:00000001:15.0:1773851893.079684:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851893.079684:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.079685:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851893.079686:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ea6af247 x1859831894610624/t0(0) o400->368f7854-d2ab-4f73-bcdb-68d87303703c@18049@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1620-0'
00000100:00100000:15.0:1773851893.079691:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ea6af247 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:368f7854-d2ab-4f73-bcdb-68d87303703c+5:39649:x1859831894610624:12345-18049@kfi7:400:default-tuolumne1620-0 Request processed in 92us (138us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851893.079692:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c00 TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851893.079694:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18049@kfi7, seq: 2289916
00000400:00000200:13.0:1773851893.079695:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:15.0:1773851893.079696:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004717a594 : new rpc_count 0
00000100:00000001:15.0:1773851893.079697:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851893.079697:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851893.079697:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18048@kfi7: PUT: OK
00000020:00000010:15.0:1773851893.079698:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851893.079698:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5868b8
00000020:00000010:15.0:1773851893.079699:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000400:00000010:13.0:1773851893.079699:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5868b8.
00000100:00000001:13.0:1773851893.079700:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851893.079701:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008c779a05.
00000020:00000040:15.0:1773851893.079701:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000004717a594 : new refcount 4
00000100:00000001:13.0:1773851893.079701:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851893.079702:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851893.079702:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003851274b nid 18048@kfi7 refs 2
00000800:00000200:13.0:1773851893.079704:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 18048@kfi7(000000001b89e218):0x0 lsk 3073 rsk 8 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c00 Transaction freed
00000800:00000200:3.0:1773851893.122819:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851893.122821:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851893.122824:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851893.122829:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851893.122833:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:3.0:1773851893.122835:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:3.0:1773851893.122838:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:3.0:1773851893.122839:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:3.0:1773851893.122841:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:3.0:1773851893.122842:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:3.0:1773851893.122844:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:3.0:1773851893.122845:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:3.0:1773851893.122847:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 224 into portal 12 MB=0x699e0e9441440
00000400:00000200:3.0:1773851893.122850:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2090@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 46112
00000800:00000200:3.0:1773851893.122854:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851893.122857:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851893.122859:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000100:00000001:3.0:1773851893.122861:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851893.122862:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851893.122863:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000086b1f0ba.
00000100:00000040:3.0:1773851893.122865:0:2506738:0:(events.c:358:request_in_callback()) incoming req@0000000086b1f0ba x1858041125540928 msgsize 224
00000100:00100000:3.0:1773851893.122867:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-2090@kfi7 (source: 12345-2090@kfi7)
00000100:00000001:3.0:1773851893.122869:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:0.0:1773851893.122870:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:3.0:1773851893.122871:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
02000000:00000001:0.0:1773851893.122871:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851893.122871:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851893.122872:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851893.122872:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851893.122873:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041125540928
00000020:00000001:0.0:1773851893.122874:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851893.122874:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb772e
00000020:00000001:0.0:1773851893.122874:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:3.0:1773851893.122875:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000020:00000040:0.0:1773851893.122876:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f6881e1d refcount=5
00000020:00000001:0.0:1773851893.122877:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937473289216 : -107136236262400 : ffff9e8f66b1ec00)
00000020:00000001:0.0:1773851893.122878:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937473289216 : -107136236262400 : ffff9e8f66b1ec00)
00000100:00000001:0.0:1773851893.122879:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851893.122879:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851893.122880:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd570b8d.
00000020:00000010:0.0:1773851893.122881:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851893.122882:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851893.122883:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851893.122883:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851893.122883:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851893.122884:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851893.122885:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851893.122885:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.122886:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851893.122887:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851893.122888:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851893.122889:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851893.122889:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851893.122889:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2090@kfi7, seq: 1997616
00000100:00000040:0.0:1773851893.122889:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f6881e1d : new rpc_count 1
00000100:00000001:1.0:1773851893.122890:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.122890:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288716288 : -106964420835328 : ffff9eb767b14800)
00000100:00000001:1.0:1773851893.122891:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851893.122891:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000086b1f0ba x1858041125540928/t0(0) o400->lustre5-MDT0001-lwp-OST0009_UUID@2090@kfi7:533/0 lens 224/0 e 0 to 0 dl 1773852648 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba110-0'
00000100:00000001:0.0:1773851893.122894:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851893.122894:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851893.122895:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086b1f0ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre5-MDT0001-lwp-OST0009_UUID+5:272682:x1858041125540928:12345-2090@kfi7:400:default-yuba110-0
00000100:00000200:0.0:1773851893.122896:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041125540928
00000020:00000001:0.0:1773851893.122897:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851893.122897:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851893.122898:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.122898:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851893.122899:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851893.122899:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:0.0:1773851893.122900:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851893.122901:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851893.122901:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851893.122902:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.122902:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851893.122903:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851893.122903:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851893.122904:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004e7d1cae.
02000000:00000001:0.0:1773851893.122905:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.122906:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.122906:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851893.122907:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041125540928
00010000:00000001:0.0:1773851893.122907:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851893.122908:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000086b1f0ba x1858041125540928/t0(0) o400->lustre5-MDT0001-lwp-OST0009_UUID@2090@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba110-0'
00010000:00000001:0.0:1773851893.122910:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851893.122911:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851893.122911:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=126 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851893.122912:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851893.122913:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007f2ef8ca refcount 7 to 2090@kfi7
00000100:00000001:0.0:1773851893.122914:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002848 : -107146751548768 : ffff9e8cf3ef62a0)
02000000:00000001:0.0:1773851893.122915:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851893.122915:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.122916:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851893.122917:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:0.0:1773851893.122917:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a3358ad2.
00000100:00000200:0.0:1773851893.122918:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041125540928, offset 224
00000400:00000200:0.0:1773851893.122919:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000400:00000200:0.0:1773851893.122920:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:0.0:1773851893.122921:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:0.0:1773851893.122922:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:0.0:1773851893.122923:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:0.0:1773851893.122924:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2090@kfi7 local destination
00000400:00000200:0.0:1773851893.122925:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770072:8770072:1024:4294967295] 2090@kfi7 LPNI seq info [5404255:5404255:16:4294967295]
00000400:00000200:0.0:1773851893.122926:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:0.0:1773851893.122927:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:0.0:1773851893.122929:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851893.122930:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:0.0:1773851893.122931:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851893.122932:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851893.122934:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851893.122936:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16 Using peer 2090@kfi7(0x16)
00000800:00000200:0.0:1773851893.122939:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:0.0:1773851893.122940:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851893.122942:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851893.122943:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007f2ef8ca refcount 6 to 2090@kfi7
00010000:00000001:0.0:1773851893.122943:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851893.122944:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.122945:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851893.122945:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000086b1f0ba x1858041125540928/t0(0) o400->lustre5-MDT0001-lwp-OST0009_UUID@2090@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba110-0'
00000100:00100000:0.0:1773851893.122950:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086b1f0ba pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre5-MDT0001-lwp-OST0009_UUID+5:272682:x1858041125540928:12345-2090@kfi7:400:default-yuba110-0 Request processed in 55us (84us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851893.122952:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2090@kfi7, seq: 1997616
00000100:00000040:0.0:1773851893.122952:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f6881e1d : new rpc_count 0
00000100:00000001:0.0:1773851893.122953:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851893.122954:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851893.122954:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851893.122955:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851893.122955:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd570b8d.
00000020:00000040:0.0:1773851893.122956:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000f6881e1d : new refcount 4
00000100:00000001:0.0:1773851893.122957:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851893.122964:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851893.122967:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851893.122969:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:1.0:1773851893.122970:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a3358ad2
00000400:00000010:1.0:1773851893.122971:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a3358ad2.
00000100:00000001:1.0:1773851893.122972:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851893.122973:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851893.122974:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000800:00000200:1.0:1773851893.122977:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x16 Transaction freed
00000800:00000200:9.0:1773851893.127188:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851893.127189:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851893.127191:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851893.127193:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851893.127195:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10450@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.127196:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10450@kfi7 : PUT - for me
00000400:00000200:9.0:1773851893.127197:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10450@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.127198:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb21e957 nid 10450@kfi7 refs 1
00000400:00000200:9.0:1773851893.127200:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10450@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.127200:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb21e957 nid 10450@kfi7 refs 2
00000400:00000200:9.0:1773851893.127201:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb21e957 nid 10450@kfi7 refs 3
00000400:00000200:9.0:1773851893.127202:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10259@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.127203:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10259@kfi7 of length 224 into portal 12 MB=0x699e1a76d50c0
00000400:00000200:9.0:1773851893.127204:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10259@kfi7 of length 224/224 into md 0x78146ce49 [64] + 157880
00000800:00000200:9.0:1773851893.127206:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851893.127211:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851893.127212:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10450@kfi7: PUT: OK
00000100:00000001:9.0:1773851893.127213:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851893.127213:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851893.127214:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d393d330.
00000100:00000040:9.0:1773851893.127215:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d393d330 x1858044315914432 msgsize 224
00000100:00100000:9.0:1773851893.127216:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10259@kfi7 (source: 12345-10450@kfi7)
00000100:00000001:9.0:1773851893.127217:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851893.127218:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb21e957 nid 10450@kfi7 refs 2
00000100:00000001:8.0:1773851893.127218:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851893.127219:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2069@kfi7:2 <- 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851893.127219:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851893.127220:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851893.127220:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851893.127221:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851893.127222:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044315914432
00000020:00000001:8.0:1773851893.127222:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851893.127223:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac915a9
00000020:00000001:8.0:1773851893.127224:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851893.127227:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007fc40578 refcount=363
00000020:00000001:8.0:1773851893.127228:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241014272 : -107152468537344 : ffff9e8b9f2d1000)
00000020:00000001:8.0:1773851893.127229:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241014272 : -107152468537344 : ffff9e8b9f2d1000)
00000100:00000001:8.0:1773851893.127230:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851893.127231:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851893.127231:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851893.127232:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851893.127233:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851893.127234:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851893.127235:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851893.127235:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.127236:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851893.127237:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851893.127237:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.127238:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851893.127239:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851893.127239:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851893.127240:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851893.127240:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851893.127240:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10259@kfi7, seq: 2130860
00000100:00000001:9.0:1773851893.127241:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851893.127241:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007fc40578 : new rpc_count 7
00000100:00000001:9.0:1773851893.127242:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.127242:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609058176 : -107064100493440 : ffff9ea032526780)
00000100:00000040:8.0:1773851893.127243:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d393d330 x1858044315914432/t0(0) o400->34811429-c6b2-421e-b235-07cda588e89d@10259@kfi7:681/0 lens 224/0 e 0 to 0 dl 1773852041 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1141-0'
00000100:00000001:8.0:1773851893.127246:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851893.127246:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851893.127247:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d393d330 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:34811429-c6b2-421e-b235-07cda588e89d+363:39689:x1858044315914432:12345-10259@kfi7:400:default-tuolumne1141-0
00000100:00000200:8.0:1773851893.127248:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044315914432
00000020:00000001:8.0:1773851893.127249:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851893.127250:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851893.127250:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.127251:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851893.127252:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851893.127252:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851893.127253:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044315914432, found 0 last_xid 1858044266998783
00000020:00000001:8.0:1773851893.127254:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851893.127255:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851893.127255:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851893.127256:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.127257:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851893.127257:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851893.127258:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851893.127258:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000adf38abe.
02000000:00000001:8.0:1773851893.127259:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.127260:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.127260:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851893.127261:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590323, transno 0, xid 1858044315914432
00010000:00000001:8.0:1773851893.127262:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851893.127262:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d393d330 x1858044315914432/t0(0) o400->34811429-c6b2-421e-b235-07cda588e89d@10259@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1141-0'
00010000:00000001:8.0:1773851893.127265:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851893.127265:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851893.127266:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=126 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851893.127267:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851893.127268:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b01af907 refcount 3 to 10259@kfi7
00000100:00000001:8.0:1773851893.127268:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959057344 : -107146750494272 : ffff9e8cf3ff79c0)
02000000:00000001:8.0:1773851893.127269:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851893.127270:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.127270:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851893.127271:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10450@kfi7
00000400:00000010:8.0:1773851893.127272:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b95ec19a.
00000100:00000200:8.0:1773851893.127272:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044315914432, offset 224
00000400:00000200:8.0:1773851893.127274:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10450@kfi7
00000400:00000200:8.0:1773851893.127274:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10450@kfi7 to cpt 2
00000400:00000200:8.0:1773851893.127275:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb21e957 nid 10450@kfi7 refs 1
00000400:00000200:8.0:1773851893.127276:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb21e957 nid 10450@kfi7 refs 2
00000400:00000200:8.0:1773851893.127277:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb21e957 nid 10450@kfi7 refs 3
00000400:00000200:8.0:1773851893.127278:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10450@kfi7 local destination
00000400:00000200:8.0:1773851893.127280:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770073:8770073:1024:4294967295] 10450@kfi7 LPNI seq info [12723183:12723183:16:4294967295]
00000400:00000200:8.0:1773851893.127282:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb21e957 nid 10450@kfi7 refs 2
00000400:00000200:8.0:1773851893.127282:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10450@kfi7 to cpt 2
00000400:00000200:8.0:1773851893.127284:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10450@kfi7(10450@kfi7:10450@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851893.127285:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb21e957 nid 10450@kfi7 refs 3
00000800:00000200:8.0:1773851893.127287:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851893.127288:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851893.127290:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851893.127292:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x82e Using peer 10450@kfi7(0x82e)
00000800:00000200:8.0:1773851893.127295:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x82e: rc=0
00000800:00000200:8.0:1773851893.127296:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x82e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851893.127298:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851893.127299:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b01af907 refcount 2 to 10259@kfi7
00010000:00000001:8.0:1773851893.127300:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851893.127300:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.127301:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851893.127301:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d393d330 x1858044315914432/t0(0) o400->34811429-c6b2-421e-b235-07cda588e89d@10259@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1141-0'
00000100:00100000:8.0:1773851893.127306:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d393d330 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:34811429-c6b2-421e-b235-07cda588e89d+363:39689:x1858044315914432:12345-10259@kfi7:400:default-tuolumne1141-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851893.127308:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10259@kfi7, seq: 2130860
00000100:00000040:8.0:1773851893.127309:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007fc40578 : new rpc_count 6
00000100:00000001:8.0:1773851893.127309:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851893.127310:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851893.127311:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851893.127311:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851893.127312:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851893.127313:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000007fc40578 : new refcount 362
00000100:00000001:8.0:1773851893.127314:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851893.127318:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x82e TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851893.127320:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851893.127321:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10450@kfi7: PUT: OK
00000400:00000200:9.0:1773851893.127322:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b95ec19a
00000400:00000010:9.0:1773851893.127322:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b95ec19a.
00000100:00000001:9.0:1773851893.127323:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851893.127323:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851893.127324:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb21e957 nid 10450@kfi7 refs 2
00000800:00000200:9.0:1773851893.127325:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 10450@kfi7(00000000c875ff98):0x0 lsk 2095 rsk 46 tsk 0 trmk 0 tmk 0 trr 2 tta 0x82e Transaction freed
00000800:00000200:21.0:1773851893.135298:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851893.135299:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851893.135300:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851893.135302:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851893.135304:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18368@kfi7 to cpt 5
00000400:00000200:21.0:1773851893.135305:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18368@kfi7 : PUT - for me
00000400:00000200:21.0:1773851893.135306:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18368@kfi7 to cpt 5
00000400:00000200:21.0:1773851893.135307:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f84ae537 nid 18368@kfi7 refs 1
00000400:00000200:21.0:1773851893.135309:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18368@kfi7 to cpt 5
00000400:00000200:21.0:1773851893.135309:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f84ae537 nid 18368@kfi7 refs 2
00000400:00000200:21.0:1773851893.135310:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f84ae537 nid 18368@kfi7 refs 3
00000400:00000200:21.0:1773851893.135311:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18176@kfi7 to cpt 3
00000400:00000200:21.0:1773851893.135312:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18176@kfi7 of length 224 into portal 12 MB=0x69b16eb104e80
00000400:00000200:21.0:1773851893.135313:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18176@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 61128
00000800:00000200:21.0:1773851893.135315:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851893.135317:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851893.135318:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18368@kfi7: PUT: OK
00000100:00000001:21.0:1773851893.135319:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851893.135319:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851893.135320:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e931bb34.
00000100:00000040:21.0:1773851893.135321:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e931bb34 x1859372595564160 msgsize 224
00000100:00100000:21.0:1773851893.135323:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18176@kfi7 (source: 12345-18368@kfi7)
00000100:00000001:21.0:1773851893.135324:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851893.135325:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f84ae537 nid 18368@kfi7 refs 2
00000800:00000200:21.0:1773851893.135327:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851893.135327:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851893.135327:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851893.135328:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851893.135329:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851893.135330:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851893.135331:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372595564160
00000020:00000001:20.0:1773851893.135332:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851893.135333:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793afc7f69
00000020:00000001:20.0:1773851893.135335:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851893.135339:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000078e413f1 refcount=5
00000020:00000001:20.0:1773851893.135340:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917895492608 : -107155814059008 : ffff9e8ad7c47400)
00000020:00000001:20.0:1773851893.135341:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917895492608 : -107155814059008 : ffff9e8ad7c47400)
00000100:00000001:20.0:1773851893.135342:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851893.135343:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851893.135346:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006f78f015.
00000020:00000010:20.0:1773851893.135347:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851893.135349:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000504ff2e8.
00000100:00000001:20.0:1773851893.135350:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851893.135351:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851893.135352:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851893.135353:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851893.135354:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851893.135355:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.135356:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851893.135358:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851893.135358:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851893.135358:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851893.135359:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18176@kfi7, seq: 1998065
00000100:00000001:20.0:1773851893.135359:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851893.135360:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000078e413f1 : new rpc_count 1
00000100:00000001:20.0:1773851893.135360:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851893.135361:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134769021696 : -106938940529920 : ffff9ebd566fe300)
00000100:00000001:20.0:1773851893.135361:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851893.135362:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e931bb34 x1859372595564160/t0(0) o400->d9a84af4-5936-4c01-a9fe-3ba6eacdaf2d@18176@kfi7:533/0 lens 224/0 e 0 to 0 dl 1773852648 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1635-0'
00000100:00000001:23.0:1773851893.135365:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851893.135365:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851893.135367:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e931bb34 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d9a84af4-5936-4c01-a9fe-3ba6eacdaf2d+5:39863:x1859372595564160:12345-18176@kfi7:400:default-tuolumne1635-0
00000100:00000200:23.0:1773851893.135368:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372595564160
00000020:00000001:23.0:1773851893.135369:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851893.135369:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851893.135370:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851893.135371:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851893.135372:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851893.135372:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851893.135373:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372595564160, found 0 last_xid 1859372595564159
00000020:00000001:23.0:1773851893.135374:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851893.135374:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851893.135375:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851893.135375:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851893.135376:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851893.135377:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851893.135377:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851893.135378:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c9c7cb10.
02000000:00000001:23.0:1773851893.135378:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851893.135379:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851893.135380:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851893.135380:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044130922, transno 0, xid 1859372595564160
00010000:00000001:23.0:1773851893.135381:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851893.135382:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e931bb34 x1859372595564160/t0(0) o400->d9a84af4-5936-4c01-a9fe-3ba6eacdaf2d@18176@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1635-0'
00010000:00000001:23.0:1773851893.135384:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851893.135385:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851893.135385:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=126 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851893.135386:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851893.135387:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000042e72d62 refcount 3 to 18176@kfi7
00000100:00000001:23.0:1773851893.135388:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642468608 : -107157067083008 : ffff9e8a8d14d300)
02000000:00000001:23.0:1773851893.135389:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851893.135389:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851893.135390:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851893.135391:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18368@kfi7
00000400:00000010:23.0:1773851893.135392:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c56f69f.
00000100:00000200:23.0:1773851893.135392:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372595564160, offset 224
00000400:00000200:23.0:1773851893.135394:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18368@kfi7
00000400:00000200:23.0:1773851893.135394:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18368@kfi7 to cpt 5
00000400:00000200:23.0:1773851893.135395:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f84ae537 nid 18368@kfi7 refs 1
00000400:00000200:23.0:1773851893.135396:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f84ae537 nid 18368@kfi7 refs 2
00000400:00000200:23.0:1773851893.135398:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f84ae537 nid 18368@kfi7 refs 3
00000400:00000200:23.0:1773851893.135399:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18368@kfi7 local destination
00000400:00000200:23.0:1773851893.135400:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770074:8770074:1024:4294967295] 18368@kfi7 LPNI seq info [115430:115430:16:4294967295]
00000400:00000200:23.0:1773851893.135402:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f84ae537 nid 18368@kfi7 refs 2
00000400:00000200:23.0:1773851893.135402:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18368@kfi7 to cpt 5
00000400:00000200:23.0:1773851893.135405:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18368@kfi7(18368@kfi7:18368@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851893.135406:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f84ae537 nid 18368@kfi7 refs 3
00000800:00000200:23.0:1773851893.135407:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851893.135409:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851893.135411:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851893.135413:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011a4 Using peer 18368@kfi7(0x1000000000011a4)
00000800:00000200:23.0:1773851893.135417:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x1000000000011a4: rc=0
00000800:00000200:23.0:1773851893.135419:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851893.135421:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851893.135422:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000042e72d62 refcount 2 to 18176@kfi7
00010000:00000001:23.0:1773851893.135423:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851893.135423:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851893.135424:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851893.135425:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e931bb34 x1859372595564160/t0(0) o400->d9a84af4-5936-4c01-a9fe-3ba6eacdaf2d@18176@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1635-0'
00000100:00100000:23.0:1773851893.135428:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e931bb34 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d9a84af4-5936-4c01-a9fe-3ba6eacdaf2d+5:39863:x1859372595564160:12345-18176@kfi7:400:default-tuolumne1635-0 Request processed in 63us (106us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851893.135432:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18176@kfi7, seq: 1998065
00000100:00000040:23.0:1773851893.135432:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000078e413f1 : new rpc_count 0
00000800:00000200:21.0:1773851893.135432:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011a4 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851893.135434:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851893.135434:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851893.135435:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851893.135435:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:23.0:1773851893.135436:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000504ff2e8.
00000400:00000200:21.0:1773851893.135436:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18368@kfi7: PUT: OK
00000400:00000200:21.0:1773851893.135436:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c56f69f
00000020:00000010:23.0:1773851893.135437:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006f78f015.
00000400:00000010:21.0:1773851893.135437:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c56f69f.
00000020:00000040:23.0:1773851893.135438:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000078e413f1 : new refcount 4
00000100:00000001:21.0:1773851893.135438:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851893.135439:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851893.135439:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851893.135440:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f84ae537 nid 18368@kfi7 refs 2
00000800:00000200:21.0:1773851893.135441:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 18368@kfi7(00000000a32e25d3):0x0 lsk 4517 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011a4 Transaction freed
00000800:00000200:21.0:1773851893.150912:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851893.150914:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851893.150916:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851893.150919:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851893.150922:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21219@kfi7 to cpt 5
00000400:00000200:21.0:1773851893.150924:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21219@kfi7 : PUT - for me
00000400:00000200:21.0:1773851893.150925:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21219@kfi7 to cpt 5
00000400:00000200:21.0:1773851893.150927:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000047415291 nid 21219@kfi7 refs 1
00000400:00000200:21.0:1773851893.150928:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21219@kfi7 to cpt 5
00000400:00000200:21.0:1773851893.150929:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000047415291 nid 21219@kfi7 refs 2
00000400:00000200:21.0:1773851893.150931:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000047415291 nid 21219@kfi7 refs 3
00000400:00000200:21.0:1773851893.150932:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21026@kfi7 to cpt 7
00000400:00000200:21.0:1773851893.150934:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21026@kfi7 of length 224 into portal 12 MB=0x699e2473095c0
00000400:00000200:21.0:1773851893.150936:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21026@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 61352
00000800:00000200:21.0:1773851893.150938:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851893.150941:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851893.150943:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21219@kfi7: PUT: OK
00000100:00000001:21.0:1773851893.150944:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851893.150945:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851893.150947:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000043b9ebde.
00000100:00000040:21.0:1773851893.150948:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000043b9ebde x1858046996288960 msgsize 224
00000100:00100000:21.0:1773851893.150950:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21026@kfi7 (source: 12345-21219@kfi7)
00000100:00000001:21.0:1773851893.150952:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851893.150953:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000047415291 nid 21219@kfi7 refs 2
00000100:00000001:23.0:1773851893.150954:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851893.150955:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851893.150956:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851893.150956:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851893.150956:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851893.150957:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851893.150959:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858046996288960
00000020:00000001:23.0:1773851893.150959:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851893.150960:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92799
00000020:00000001:23.0:1773851893.150961:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851893.150964:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f91fc47 refcount=6
00000020:00000001:23.0:1773851893.150965:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631505920 : -107123078045696 : ffff9e9276fc6000)
00000020:00000001:23.0:1773851893.150967:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631505920 : -107123078045696 : ffff9e9276fc6000)
00000100:00000001:23.0:1773851893.150968:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851893.150969:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851893.150970:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007594cbb6.
00000020:00000010:23.0:1773851893.150972:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851893.150973:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851893.150974:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851893.150975:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851893.150975:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851893.150977:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851893.150978:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851893.150978:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851893.150980:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851893.150981:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851893.150981:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851893.150981:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851893.150982:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851893.150982:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21026@kfi7, seq: 1998066
00000100:00000001:23.0:1773851893.150983:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851893.150983:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f91fc47 : new rpc_count 1
00000100:00000001:23.0:1773851893.150984:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.150984:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701983616 : -106936007568000 : ffff9ebe05415580)
00000100:00000040:20.0:1773851893.150985:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000043b9ebde x1858046996288960/t0(0) o400->7a6ff70c-d650-42b5-acba-9cea94e68613@21026@kfi7:681/0 lens 224/0 e 0 to 0 dl 1773852041 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1803-0'
00000100:00000001:20.0:1773851893.150988:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851893.150988:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851893.150989:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043b9ebde pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:7a6ff70c-d650-42b5-acba-9cea94e68613+6:39623:x1858046996288960:12345-21026@kfi7:400:default-tuolumne1803-0
00000100:00000200:20.0:1773851893.150990:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858046996288960
00000020:00000001:20.0:1773851893.150991:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851893.150992:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851893.150992:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.150993:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851893.150993:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851893.150994:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851893.150994:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858046996288960, found 0 last_xid 1858046996288959
00000020:00000001:20.0:1773851893.150995:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851893.150996:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851893.150996:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851893.150997:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.150997:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851893.150998:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851893.150998:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851893.150999:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000763d5c4d.
02000000:00000001:20.0:1773851893.150999:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.151000:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.151000:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851893.151001:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044103990, transno 0, xid 1858046996288960
00010000:00000001:20.0:1773851893.151001:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851893.151002:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000043b9ebde x1858046996288960/t0(0) o400->7a6ff70c-d650-42b5-acba-9cea94e68613@21026@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1803-0'
00010000:00000001:20.0:1773851893.151004:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851893.151005:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851893.151006:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=126 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851893.151006:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851893.151007:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001484d316 refcount 3 to 21026@kfi7
00000100:00000001:20.0:1773851893.151008:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065472 : -107155994486144 : ffff9e8acd035a80)
02000000:00000001:20.0:1773851893.151009:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851893.151009:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.151010:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851893.151010:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21219@kfi7
00000400:00000010:20.0:1773851893.151011:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e899d2a0.
00000100:00000200:20.0:1773851893.151012:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858046996288960, offset 224
00000400:00000200:20.0:1773851893.151013:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21219@kfi7
00000400:00000200:20.0:1773851893.151014:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21219@kfi7 to cpt 5
00000400:00000200:20.0:1773851893.151017:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000047415291 nid 21219@kfi7 refs 1
00000400:00000200:20.0:1773851893.151018:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000047415291 nid 21219@kfi7 refs 2
00000400:00000200:20.0:1773851893.151019:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000047415291 nid 21219@kfi7 refs 3
00000400:00000200:20.0:1773851893.151020:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21219@kfi7 local destination
00000400:00000200:20.0:1773851893.151022:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770075:8770075:1024:4294967295] 21219@kfi7 LPNI seq info [787256:787256:16:4294967295]
00000400:00000200:20.0:1773851893.151023:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000047415291 nid 21219@kfi7 refs 2
00000400:00000200:20.0:1773851893.151024:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21219@kfi7 to cpt 5
00000400:00000200:20.0:1773851893.151025:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21219@kfi7(21219@kfi7:21219@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851893.151027:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000047415291 nid 21219@kfi7 refs 3
00000800:00000200:20.0:1773851893.151028:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851893.151029:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851893.151031:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851893.151033:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x103f Using peer 21219@kfi7(0x103f)
00000800:00000200:20.0:1773851893.151036:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x103f: rc=0
00000800:00000200:20.0:1773851893.151037:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x103f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851893.151039:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851893.151040:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001484d316 refcount 2 to 21026@kfi7
00010000:00000001:20.0:1773851893.151041:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851893.151041:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.151042:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851893.151042:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000043b9ebde x1858046996288960/t0(0) o400->7a6ff70c-d650-42b5-acba-9cea94e68613@21026@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1803-0'
00000100:00100000:20.0:1773851893.151047:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043b9ebde pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:7a6ff70c-d650-42b5-acba-9cea94e68613+6:39623:x1858046996288960:12345-21026@kfi7:400:default-tuolumne1803-0 Request processed in 58us (98us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851893.151049:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21026@kfi7, seq: 1998066
00000100:00000040:20.0:1773851893.151050:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f91fc47 : new rpc_count 0
00000100:00000001:20.0:1773851893.151050:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851893.151051:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851893.151051:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000020:00000010:20.0:1773851893.151052:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:20.0:1773851893.151053:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007594cbb6.
00000020:00000040:20.0:1773851893.151054:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000003f91fc47 : new refcount 5
00000100:00000001:20.0:1773851893.151055:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851893.151062:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x103f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851893.151065:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851893.151066:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21219@kfi7: PUT: OK
00000400:00000200:21.0:1773851893.151067:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e899d2a0
00000400:00000010:21.0:1773851893.151068:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e899d2a0.
00000100:00000001:21.0:1773851893.151069:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851893.151070:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851893.151071:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000047415291 nid 21219@kfi7 refs 2
00000800:00000200:21.0:1773851893.151074:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 21219@kfi7(00000000ce218ffd):0x0 lsk 4160 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x103f Transaction freed
00000800:00000200:1.0:1773851893.272734:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851893.272736:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851893.272738:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851893.272742:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851893.272746:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18115@kfi7 to cpt 0
00000400:00000200:1.0:1773851893.272748:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18115@kfi7 : PUT - for me
00000400:00000200:1.0:1773851893.272750:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18115@kfi7 to cpt 0
00000400:00000200:1.0:1773851893.272751:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000036c7df13 nid 18115@kfi7 refs 1
00000400:00000200:1.0:1773851893.272753:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18115@kfi7 to cpt 0
00000400:00000200:1.0:1773851893.272758:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000036c7df13 nid 18115@kfi7 refs 2
00000400:00000200:1.0:1773851893.272759:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000036c7df13 nid 18115@kfi7 refs 3
00000400:00000200:1.0:1773851893.272761:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18115@kfi7 to cpt 0
00000400:00000200:1.0:1773851893.272763:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18115@kfi7 of length 224 into portal 12 MB=0x699e0f92616c0
00000400:00000200:1.0:1773851893.272766:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18115@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 46336
00000800:00000200:1.0:1773851893.272769:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851893.272772:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851893.272774:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18115@kfi7: PUT: OK
00000100:00000001:1.0:1773851893.272776:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851893.272777:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851893.272778:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a8a52ad4.
00000100:00000040:1.0:1773851893.272780:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000a8a52ad4 x1858041392010944 msgsize 224
00000100:00100000:1.0:1773851893.272783:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-18115@kfi7 (source: 12345-18115@kfi7)
00000100:00000001:1.0:1773851893.272785:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851893.272786:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000036c7df13 nid 18115@kfi7 refs 2
00000100:00000001:0.0:1773851893.272787:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851893.272787:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851893.272788:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851893.272788:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851893.272789:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851893.272789:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851893.272790:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041392010944
00000020:00000001:0.0:1773851893.272791:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851893.272791:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9231d
00000020:00000001:0.0:1773851893.272792:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851893.272794:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ade621c4 refcount=6
00000020:00000001:0.0:1773851893.272795:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630278144 : -107123079273472 : ffff9e9276e9a400)
00000020:00000001:0.0:1773851893.272795:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630278144 : -107123079273472 : ffff9e9276e9a400)
00000100:00000001:0.0:1773851893.272796:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851893.272798:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851893.272798:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d04e4c51.
00000020:00000010:0.0:1773851893.272799:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851893.272800:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851893.272801:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851893.272802:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851893.272803:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851893.272804:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851893.272805:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851893.272805:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.272806:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851893.272808:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851893.272808:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851893.272809:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851893.272810:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851893.272810:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18115@kfi7, seq: 1997617
00000100:00000001:1.0:1773851893.272811:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851893.272811:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ade621c4 : new rpc_count 1
00000100:00000001:1.0:1773851893.272812:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.272812:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112270208 : -106950597281408 : ffff9eba9fa3f980)
00000100:00000040:0.0:1773851893.272813:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a8a52ad4 x1858041392010944/t0(0) o400->f8e10319-b7b2-4d50-b528-2f3ba799f79b@18115@kfi7:533/0 lens 224/0 e 0 to 0 dl 1773852648 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1623-0'
00000100:00000001:0.0:1773851893.272816:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851893.272817:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851893.272818:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a8a52ad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f8e10319-b7b2-4d50-b528-2f3ba799f79b+6:39675:x1858041392010944:12345-18115@kfi7:400:default-tuolumne1623-0
00000100:00000200:0.0:1773851893.272820:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041392010944
00000020:00000001:0.0:1773851893.272821:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851893.272822:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851893.272822:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.272823:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851893.272824:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851893.272825:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851893.272825:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041392010944, found 0 last_xid 1858041392010943
00000020:00000001:0.0:1773851893.272827:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851893.272827:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851893.272828:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851893.272829:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.272830:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851893.272830:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851893.272831:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851893.272831:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd570b8d.
02000000:00000001:0.0:1773851893.272832:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.272833:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.272834:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851893.272835:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262839593, transno 0, xid 1858041392010944
00010000:00000001:0.0:1773851893.272836:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851893.272837:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a8a52ad4 x1858041392010944/t0(0) o400->f8e10319-b7b2-4d50-b528-2f3ba799f79b@18115@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1623-0'
00010000:00000001:0.0:1773851893.272840:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851893.272841:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851893.272841:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=126 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851893.272843:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851893.272844:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aaa987c2 refcount 3 to 18115@kfi7
00000100:00000001:0.0:1773851893.272845:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051584 : -107154804500032 : ffff9e8b13f119c0)
02000000:00000001:0.0:1773851893.272846:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851893.272846:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.272847:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851893.272848:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18115@kfi7
00000400:00000010:0.0:1773851893.272849:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000009e6d8.
00000100:00000200:0.0:1773851893.272850:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041392010944, offset 224
00000400:00000200:0.0:1773851893.272851:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18115@kfi7
00000400:00000200:0.0:1773851893.272852:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18115@kfi7 to cpt 0
00000400:00000200:0.0:1773851893.272853:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000036c7df13 nid 18115@kfi7 refs 1
00000400:00000200:0.0:1773851893.272854:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000036c7df13 nid 18115@kfi7 refs 2
00000400:00000200:0.0:1773851893.272856:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000036c7df13 nid 18115@kfi7 refs 3
00000400:00000200:0.0:1773851893.272857:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18115@kfi7 local destination
00000400:00000200:0.0:1773851893.272859:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770076:8770076:1024:4294967295] 18115@kfi7 LPNI seq info [212026:212026:16:4294967295]
00000400:00000200:0.0:1773851893.272860:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000036c7df13 nid 18115@kfi7 refs 2
00000400:00000200:0.0:1773851893.272861:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18115@kfi7 to cpt 0
00000400:00000200:0.0:1773851893.272863:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18115@kfi7(18115@kfi7:18115@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851893.272865:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000036c7df13 nid 18115@kfi7 refs 3
00000800:00000200:0.0:1773851893.272866:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851893.272868:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851893.272870:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851893.272873:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000002d2 Using peer 18115@kfi7(0x1000000000002d2)
00000800:00000200:0.0:1773851893.272877:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x1000000000002d2: rc=0
00000800:00000200:0.0:1773851893.272879:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000002d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851893.272881:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851893.272883:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aaa987c2 refcount 2 to 18115@kfi7
00010000:00000001:0.0:1773851893.272883:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851893.272884:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.272885:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851893.272886:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a8a52ad4 x1858041392010944/t0(0) o400->f8e10319-b7b2-4d50-b528-2f3ba799f79b@18115@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1623-0'
00000100:00100000:0.0:1773851893.272891:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a8a52ad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f8e10319-b7b2-4d50-b528-2f3ba799f79b+6:39675:x1858041392010944:12345-18115@kfi7:400:default-tuolumne1623-0 Request processed in 73us (110us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851893.272893:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18115@kfi7, seq: 1997617
00000100:00000040:0.0:1773851893.272894:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ade621c4 : new rpc_count 0
00000100:00000001:0.0:1773851893.272895:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851893.272895:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851893.272896:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851893.272896:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851893.272897:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d04e4c51.
00000020:00000040:0.0:1773851893.272898:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000ade621c4 : new refcount 5
00000100:00000001:0.0:1773851893.272899:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851893.272906:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000002d2 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851893.272909:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851893.272910:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18115@kfi7: PUT: OK
00000400:00000200:1.0:1773851893.272912:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000009e6d8
00000400:00000010:1.0:1773851893.272913:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000009e6d8.
00000100:00000001:1.0:1773851893.272914:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851893.272915:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851893.272916:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000036c7df13 nid 18115@kfi7 refs 2
00000800:00000200:1.0:1773851893.272918:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 18115@kfi7(000000000391360a):0x0 lsk 723 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000002d2 Transaction freed
00000800:00000200:3.0:1773851893.302112:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851893.302113:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851893.302114:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851893.302116:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851893.302118:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13811@kfi7 to cpt 0
00000400:00000200:3.0:1773851893.302120:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13811@kfi7 : PUT - for me
00000400:00000200:3.0:1773851893.302121:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13811@kfi7 to cpt 0
00000400:00000200:3.0:1773851893.302121:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002655dab4 nid 13811@kfi7 refs 1
00000400:00000200:3.0:1773851893.302122:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13811@kfi7 to cpt 0
00000400:00000200:3.0:1773851893.302123:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002655dab4 nid 13811@kfi7 refs 2
00000400:00000200:3.0:1773851893.302124:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002655dab4 nid 13811@kfi7 refs 3
00000400:00000200:3.0:1773851893.302124:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13618@kfi7 to cpt 3
00000400:00000200:3.0:1773851893.302125:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13618@kfi7 of length 224 into portal 12 MB=0x69b0a067b47c0
00000400:00000200:3.0:1773851893.302127:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13618@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 46560
00000800:00000200:3.0:1773851893.302128:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851893.302130:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851893.302131:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13811@kfi7: PUT: OK
00000100:00000001:3.0:1773851893.302132:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851893.302133:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851893.302134:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004bf45d08.
00000100:00000040:3.0:1773851893.302134:0:2506738:0:(events.c:358:request_in_callback()) incoming req@000000004bf45d08 x1859317220984768 msgsize 224
00000100:00100000:3.0:1773851893.302136:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-13618@kfi7 (source: 12345-13811@kfi7)
00000100:00000001:3.0:1773851893.302137:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851893.302138:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002655dab4 nid 13811@kfi7 refs 2
00000100:00000001:0.0:1773851893.302138:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:3.0:1773851893.302139:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2069@kfi7:0 <- 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851893.302139:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851893.302139:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851893.302139:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851893.302140:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851893.302140:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317220984768
00000020:00000001:0.0:1773851893.302141:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851893.302141:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91850
00000020:00000001:0.0:1773851893.302142:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851893.302143:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000073759d36 refcount=6
00000020:00000001:0.0:1773851893.302144:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241736192 : -107152467815424 : ffff9e8b9f381400)
00000020:00000001:0.0:1773851893.302144:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241736192 : -107152467815424 : ffff9e8b9f381400)
00000100:00000001:0.0:1773851893.302145:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851893.302146:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851893.302147:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d04e4c51.
00000020:00000010:0.0:1773851893.302147:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851893.302148:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851893.302149:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851893.302149:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851893.302149:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851893.302150:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851893.302150:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851893.302151:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.302152:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851893.302153:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851893.302153:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851893.302154:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851893.302154:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851893.302154:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13618@kfi7, seq: 1997618
00000100:00000001:1.0:1773851893.302155:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851893.302155:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851893.302155:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000073759d36 : new rpc_count 1
00000100:00000001:0.0:1773851893.302155:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288701312 : -106964420850304 : ffff9eb767b10d80)
00000100:00000040:0.0:1773851893.302156:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004bf45d08 x1859317220984768/t0(0) o400->c7bf4e24-f961-457f-b9b2-162a72964755@13618@kfi7:533/0 lens 224/0 e 0 to 0 dl 1773852648 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1337-0'
00000100:00000001:0.0:1773851893.302159:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851893.302159:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851893.302160:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004bf45d08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c7bf4e24-f961-457f-b9b2-162a72964755+6:39664:x1859317220984768:12345-13618@kfi7:400:default-tuolumne1337-0
00000100:00000200:0.0:1773851893.302162:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317220984768
00000020:00000001:0.0:1773851893.302162:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851893.302163:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851893.302163:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.302164:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851893.302164:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851893.302165:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851893.302165:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317220984768, found 0 last_xid 1859317220984767
00000020:00000001:0.0:1773851893.302166:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851893.302166:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851893.302167:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851893.302167:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.302167:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851893.302168:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851893.302168:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851893.302170:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006bdbe068.
02000000:00000001:0.0:1773851893.302171:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.302171:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.302171:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851893.302172:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183245103021, transno 0, xid 1859317220984768
00010000:00000001:0.0:1773851893.302172:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851893.302173:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004bf45d08 x1859317220984768/t0(0) o400->c7bf4e24-f961-457f-b9b2-162a72964755@13618@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1337-0'
00010000:00000001:0.0:1773851893.302175:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851893.302175:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851893.302176:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=126 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851893.302177:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851893.302177:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000be648be2 refcount 3 to 13618@kfi7
00000100:00000001:0.0:1773851893.302178:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729299456 : -107155980252160 : ffff9e8acddc8c00)
02000000:00000001:0.0:1773851893.302178:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851893.302179:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851893.302179:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851893.302180:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13811@kfi7
00000400:00000010:0.0:1773851893.302180:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005abdc8a1.
00000100:00000200:0.0:1773851893.302181:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317220984768, offset 224
00000400:00000200:0.0:1773851893.302182:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13811@kfi7
00000400:00000200:0.0:1773851893.302182:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13811@kfi7 to cpt 0
00000400:00000200:0.0:1773851893.302183:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002655dab4 nid 13811@kfi7 refs 1
00000400:00000200:0.0:1773851893.302184:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002655dab4 nid 13811@kfi7 refs 2
00000400:00000200:0.0:1773851893.302185:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002655dab4 nid 13811@kfi7 refs 3
00000400:00000200:0.0:1773851893.302187:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13811@kfi7 local destination
00000400:00000200:0.0:1773851893.302189:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770077:8770077:1024:4294967295] 13811@kfi7 LPNI seq info [969915:969915:16:4294967295]
00000400:00000200:0.0:1773851893.302190:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002655dab4 nid 13811@kfi7 refs 2
00000400:00000200:0.0:1773851893.302190:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13811@kfi7 to cpt 0
00000400:00000200:0.0:1773851893.302192:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13811@kfi7(13811@kfi7:13811@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851893.302193:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002655dab4 nid 13811@kfi7 refs 3
00000800:00000200:0.0:1773851893.302194:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851893.302195:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851893.302197:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851893.302199:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9f2 Using peer 13811@kfi7(0x9f2)
00000800:00000200:0.0:1773851893.302201:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x9f2: rc=0
00000800:00000200:0.0:1773851893.302202:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9f2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851893.302204:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851893.302204:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000be648be2 refcount 2 to 13618@kfi7
00010000:00000001:0.0:1773851893.302205:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851893.302205:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851893.302206:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851893.302206:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004bf45d08 x1859317220984768/t0(0) o400->c7bf4e24-f961-457f-b9b2-162a72964755@13618@kfi7:533/0 lens 224/224 e 0 to 0 dl 1773852648 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1337-0'
00000100:00100000:0.0:1773851893.302208:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004bf45d08 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c7bf4e24-f961-457f-b9b2-162a72964755+6:39664:x1859317220984768:12345-13618@kfi7:400:default-tuolumne1337-0 Request processed in 49us (73us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851893.302212:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13618@kfi7, seq: 1997618
00000100:00000040:0.0:1773851893.302212:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000073759d36 : new rpc_count 0
00000100:00000001:0.0:1773851893.302213:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851893.302213:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851893.302214:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851893.302214:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851893.302215:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d04e4c51.
00000020:00000040:0.0:1773851893.302215:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000073759d36 : new refcount 5
00000100:00000001:0.0:1773851893.302216:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851893.302220:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9f2 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851893.302222:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851893.302223:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13811@kfi7: PUT: OK
00000400:00000200:1.0:1773851893.302224:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005abdc8a1
00000400:00000010:1.0:1773851893.302224:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005abdc8a1.
00000100:00000001:1.0:1773851893.302225:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851893.302225:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851893.302226:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002655dab4 nid 13811@kfi7 refs 2
00000800:00000200:1.0:1773851893.302228:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 13811@kfi7(00000000320f878d):0x0 lsk 2547 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x9f2 Transaction freed
00000800:00000200:25.0:1773851893.362259:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851893.362260:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851893.362261:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851893.362263:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851893.362265:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23395@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.362267:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23395@kfi7 : PUT - for me
00000400:00000200:25.0:1773851893.362267:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23395@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.362268:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d1725bb nid 23395@kfi7 refs 1
00000400:00000200:25.0:1773851893.362269:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23395@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.362270:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d1725bb nid 23395@kfi7 refs 2
00000400:00000200:25.0:1773851893.362271:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009d1725bb nid 23395@kfi7 refs 3
00000400:00000200:25.0:1773851893.362272:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23395@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.362273:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23395@kfi7 of length 224 into portal 12 MB=0x699e0bfaa3040
00000400:00000200:25.0:1773851893.362274:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23395@kfi7 of length 224/224 into md 0x16159c9699 [64] + 34224
00000800:00000200:25.0:1773851893.362276:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851893.362278:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851893.362279:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23395@kfi7: PUT: OK
00000100:00000001:25.0:1773851893.362280:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851893.362281:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851893.362282:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ae9e690e.
00000100:00000040:25.0:1773851893.362283:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ae9e690e x1858040427589696 msgsize 224
00000100:00100000:25.0:1773851893.362284:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-23395@kfi7 (source: 12345-23395@kfi7)
00000100:00000001:25.0:1773851893.362285:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851893.362286:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009d1725bb nid 23395@kfi7 refs 2
00000100:00000001:27.0:1773851893.362287:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851893.362287:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851893.362288:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851893.362288:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851893.362288:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851893.362289:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851893.362290:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040427589696
00000020:00000001:27.0:1773851893.362290:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851893.362291:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9257e
00000020:00000001:27.0:1773851893.362292:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851893.362294:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000059dd39ca refcount=6
00000020:00000001:27.0:1773851893.362294:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630775808 : -107123078775808 : ffff9e9276f13c00)
00000020:00000001:27.0:1773851893.362295:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630775808 : -107123078775808 : ffff9e9276f13c00)
00000100:00000001:27.0:1773851893.362296:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851893.362297:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851893.362298:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000330439b1.
00000020:00000010:27.0:1773851893.362299:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851893.362299:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851893.362300:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851893.362301:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851893.362301:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851893.362302:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851893.362303:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851893.362303:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851893.362304:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851893.362305:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851893.362305:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851893.362306:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851893.362306:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851893.362307:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23395@kfi7, seq: 2025170
00000100:00000040:27.0:1773851893.362309:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000059dd39ca : new rpc_count 1
00000100:00000001:27.0:1773851893.362309:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106564998144 : -106967144553472 : ffff9eb6c558a400)
00000100:00000001:25.0:1773851893.362309:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851893.362309:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851893.362311:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ae9e690e x1858040427589696/t0(0) o400->14021293-e42a-462e-8b3a-23080197102c@23395@kfi7:143/0 lens 224/0 e 0 to 0 dl 1773852258 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1948-0'
00000100:00000001:27.0:1773851893.362313:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851893.362314:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851893.362315:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae9e690e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:14021293-e42a-462e-8b3a-23080197102c+6:39675:x1858040427589696:12345-23395@kfi7:400:default-tuolumne1948-0
00000100:00000200:27.0:1773851893.362316:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040427589696
00000020:00000001:27.0:1773851893.362317:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851893.362317:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851893.362318:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.362319:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851893.362319:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851893.362320:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851893.362320:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040427589696, found 0 last_xid 1858040427589695
00000020:00000001:27.0:1773851893.362321:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851893.362322:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851893.362322:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851893.362323:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.362324:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851893.362324:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851893.362325:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851893.362326:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000005b73b1a.
02000000:00000001:27.0:1773851893.362327:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851893.362328:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.362328:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851893.362329:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254004602, transno 0, xid 1858040427589696
00010000:00000001:27.0:1773851893.362330:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851893.362331:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ae9e690e x1858040427589696/t0(0) o400->14021293-e42a-462e-8b3a-23080197102c@23395@kfi7:143/0 lens 224/224 e 0 to 0 dl 1773852258 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1948-0'
00010000:00000001:27.0:1773851893.362333:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851893.362334:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851893.362337:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=126 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851893.362338:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851893.362339:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000487a9e78 refcount 3 to 23395@kfi7
00000100:00000001:27.0:1773851893.362340:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130858784 : -107149578692832 : ffff9e8c4b6c9720)
02000000:00000001:27.0:1773851893.362340:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851893.362341:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851893.362342:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851893.362342:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23395@kfi7
00000400:00000010:27.0:1773851893.362343:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000927ebb96.
00000100:00000200:27.0:1773851893.362344:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040427589696, offset 224
00000400:00000200:27.0:1773851893.362345:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23395@kfi7
00000400:00000200:27.0:1773851893.362347:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23395@kfi7 to cpt 6
00000400:00000200:27.0:1773851893.362348:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009d1725bb nid 23395@kfi7 refs 1
00000400:00000200:27.0:1773851893.362349:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009d1725bb nid 23395@kfi7 refs 2
00000400:00000200:27.0:1773851893.362350:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009d1725bb nid 23395@kfi7 refs 3
00000400:00000200:27.0:1773851893.362351:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23395@kfi7 local destination
00000400:00000200:27.0:1773851893.362352:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770078:8770078:1024:4294967295] 23395@kfi7 LPNI seq info [972939:972939:16:4294967295]
00000400:00000200:27.0:1773851893.362353:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009d1725bb nid 23395@kfi7 refs 2
00000400:00000200:27.0:1773851893.362354:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23395@kfi7 to cpt 6
00000400:00000200:27.0:1773851893.362356:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23395@kfi7(23395@kfi7:23395@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851893.362357:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009d1725bb nid 23395@kfi7 refs 3
00000800:00000200:27.0:1773851893.362358:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851893.362359:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851893.362361:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851893.362363:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000902 Using peer 23395@kfi7(0x100000000000902)
00000800:00000200:27.0:1773851893.362366:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x100000000000902: rc=0
00000800:00000200:27.0:1773851893.362368:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000902 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851893.362372:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851893.362373:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000487a9e78 refcount 2 to 23395@kfi7
00010000:00000001:27.0:1773851893.362374:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851893.362374:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.362375:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851893.362376:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ae9e690e x1858040427589696/t0(0) o400->14021293-e42a-462e-8b3a-23080197102c@23395@kfi7:143/0 lens 224/224 e 0 to 0 dl 1773852258 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1948-0'
00000100:00100000:27.0:1773851893.362379:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae9e690e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:14021293-e42a-462e-8b3a-23080197102c+6:39675:x1858040427589696:12345-23395@kfi7:400:default-tuolumne1948-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851893.362379:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000902 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851893.362381:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:27.0:1773851893.362382:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23395@kfi7, seq: 2025170
00000400:00000200:25.0:1773851893.362382:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23395@kfi7: PUT: OK
00000100:00000040:27.0:1773851893.362383:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000059dd39ca : new rpc_count 0
00000400:00000200:25.0:1773851893.362383:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000927ebb96
00000100:00000001:27.0:1773851893.362384:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851893.362384:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:25.0:1773851893.362384:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000927ebb96.
00000020:00000010:27.0:1773851893.362385:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851893.362385:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000100:00000001:25.0:1773851893.362385:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851893.362385:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851893.362386:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000330439b1.
00000400:00000200:25.0:1773851893.362386:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009d1725bb nid 23395@kfi7 refs 2
00000020:00000040:27.0:1773851893.362387:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000059dd39ca : new refcount 5
00000800:00000200:25.0:1773851893.362387:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2054@kfi7:6 -> 23395@kfi7(00000000084cb344):0x0 lsk 2307 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000902 Transaction freed
00000100:00000001:27.0:1773851893.362388:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851893.448482:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851893.448483:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851893.448483:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851893.448483:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851893.448485:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851893.448485:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851893.448487:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851893.448487:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16019@kfi7(00000000f48e1b65):0x322 version: 2; local version 2; negotiated version: 2
00000800:00000200:13.0:1773851893.448488:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 Using peer 16019@kfi7(0x322)
00000400:00000200:14.0:1773851893.448489:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16019@kfi7 to cpt 3
00000400:00000200:14.0:1773851893.448490:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16019@kfi7 : PUT - for me
00000400:00000200:13.0:1773851893.448490:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16019@kfi7 to cpt 3
00000400:00000200:14.0:1773851893.448491:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16019@kfi7 to cpt 3
00000400:00000200:14.0:1773851893.448492:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fdce8d0d nid 16019@kfi7 refs 1
00000800:00000200:13.0:1773851893.448493:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x322: rc=0
00000400:00000200:14.0:1773851893.448494:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16019@kfi7 to cpt 3
00000400:00000200:14.0:1773851893.448494:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fdce8d0d nid 16019@kfi7 refs 2
00000800:00000200:13.0:1773851893.448494:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851893.448495:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fdce8d0d nid 16019@kfi7 refs 3
00000400:00000200:14.0:1773851893.448496:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16019@kfi7 to cpt 3
00000400:00000200:14.0:1773851893.448497:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16019@kfi7 of length 456 into portal 12 MB=0x69b4b98cf5980
00000400:00000200:14.0:1773851893.448498:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16019@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 51200
00000800:00000200:14.0:1773851893.448500:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851893.448502:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851893.448504:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16019@kfi7: PUT: OK
00000100:00000001:14.0:1773851893.448505:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851893.448505:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851893.448506:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042c2206e.
00000800:00000200:13.0:1773851893.448506:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 TN_EVENT_TX_OK event status 0
00000100:00000040:14.0:1773851893.448507:0:2514739:0:(events.c:358:request_in_callback()) incoming req@0000000042c2206e x1859598848842112 msgsize 456
00000100:00100000:14.0:1773851893.448508:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-16019@kfi7 (source: 12345-16019@kfi7)
00000800:00000200:13.0:1773851893.448509:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 Transaction freed
00000100:00000001:14.0:1773851893.448510:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851893.448511:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fdce8d0d nid 16019@kfi7 refs 2
00000100:00000001:15.0:1773851893.448512:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851893.448513:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851893.448513:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:14.0:1773851893.448513:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851893.448514:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851893.448515:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851893.448515:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598848842112
00000020:00000001:15.0:1773851893.448516:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851893.448516:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389397c9
00000020:00000001:15.0:1773851893.448517:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851893.448521:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f12d051e refcount=5
00000020:00000001:15.0:1773851893.448521:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637152985743360 : -106920723808256 : ffff9ec1943d0000)
00000020:00000001:15.0:1773851893.448522:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637152985743360 : -106920723808256 : ffff9ec1943d0000)
00000100:00000001:15.0:1773851893.448523:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.448524:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851893.448525:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000aa96597.
00000020:00000010:15.0:1773851893.448526:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851893.448527:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851893.448528:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851893.448529:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851893.448529:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.448530:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.448531:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.448532:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851893.448533:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851893.448533:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851893.448533:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851893.448534:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16019@kfi7, seq: 411190556
00000100:00000040:15.0:1773851893.448535:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f12d051e : new rpc_count 1
00000100:00000001:12.0:1773851893.448535:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.448536:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637097085022592 : -106976624529024 : ffff9eb4904bb180)
00000100:00000001:12.0:1773851893.448536:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851893.448537:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042c2206e x1859598848842112/t0(0) o17->6388fc17-eef3-44d9-8abb-9e3b21b2ef11@16019@kfi7:620/0 lens 456/0 e 0 to 0 dl 1773851980 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1494-0'
00000100:00000001:15.0:1773851893.448539:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.448540:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851893.448541:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042c2206e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6388fc17-eef3-44d9-8abb-9e3b21b2ef11+5:39570:x1859598848842112:12345-16019@kfi7:17:default-tuolumne1494-0
00000100:00000200:15.0:1773851893.448542:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598848842112
00000020:00000001:15.0:1773851893.448543:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851893.448543:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851893.448544:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.448545:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851893.448545:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:15.0:1773851893.448546:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851893.448547:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598848842112, found 0 last_xid 1859598848842111
00000020:00000001:15.0:1773851893.448548:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851893.448549:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851893.448549:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851893.448550:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851893.448550:0:60824:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:15.0:1773851893.448551:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851893.448552:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851893.448553:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000113ca595.
02000000:00000001:15.0:1773851893.448553:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.448555:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.448555:0:60824:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:15.0:1773851893.448556:0:60824:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:15.0:1773851893.448557:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851893.448558:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.448559:0:60824:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:15.0:1773851893.448560:0:60824:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 6388fc17-eef3-44d9-8abb-9e3b21b2ef11/00000000f12d051e free: 126633370845184 avail: 126633368748032
00000020:00000001:15.0:1773851893.448561:0:60824:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:15.0:1773851893.448561:0:60824:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 6388fc17-eef3-44d9-8abb-9e3b21b2ef11/00000000f12d051e avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:15.0:1773851893.448563:0:60824:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:15.0:1773851893.448564:0:60824:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:15.0:1773851893.448564:0:60824:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 6388fc17-eef3-44d9-8abb-9e3b21b2ef11/00000000f12d051e reports grant 728236031 dropped 0, local 796393471
00000020:00000001:15.0:1773851893.448566:0:60824:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:15.0:1773851893.448566:0:60824:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:15.0:1773851893.448567:0:60824:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851893.448567:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044144934, transno 0, xid 1859598848842112
00010000:00000001:15.0:1773851893.448568:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851893.448569:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042c2206e x1859598848842112/t0(0) o17->6388fc17-eef3-44d9-8abb-9e3b21b2ef11@16019@kfi7:620/0 lens 456/432 e 0 to 0 dl 1773851980 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1494-0'
00010000:00000001:15.0:1773851893.448571:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851893.448572:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851893.448573:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=126 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851893.448574:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851893.448575:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b3e08706 refcount 3 to 16019@kfi7
00000100:00000001:15.0:1773851893.448575:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811152032 : -107154898399584 : ffff9e8b0e584ea0)
02000000:00000001:15.0:1773851893.448576:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851893.448577:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.448577:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851893.448578:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16019@kfi7
00000400:00000010:15.0:1773851893.448579:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008af5e37b.
00000100:00000200:15.0:1773851893.448580:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598848842112, offset 224
00000400:00000200:15.0:1773851893.448581:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16019@kfi7
00000400:00000200:15.0:1773851893.448583:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16019@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.448584:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fdce8d0d nid 16019@kfi7 refs 1
00000400:00000200:15.0:1773851893.448585:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fdce8d0d nid 16019@kfi7 refs 2
00000400:00000200:15.0:1773851893.448586:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fdce8d0d nid 16019@kfi7 refs 3
00000400:00000200:15.0:1773851893.448588:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16019@kfi7 local destination
00000400:00000200:15.0:1773851893.448589:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770079:8770079:1024:4294967295] 16019@kfi7 LPNI seq info [697411:697411:16:4294967295]
00000400:00000200:15.0:1773851893.448590:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fdce8d0d nid 16019@kfi7 refs 2
00000400:00000200:15.0:1773851893.448591:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16019@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.448593:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16019@kfi7(16019@kfi7:16019@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851893.448594:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fdce8d0d nid 16019@kfi7 refs 3
00000800:00000200:15.0:1773851893.448595:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851893.448597:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:15.0:1773851893.448599:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851893.448601:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 Using peer 16019@kfi7(0x322)
00000800:00000200:15.0:1773851893.448604:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 532 bytes to peer 0x322: rc=0
00000800:00000200:15.0:1773851893.448605:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851893.448607:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851893.448608:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b3e08706 refcount 2 to 16019@kfi7
00010000:00000001:15.0:1773851893.448609:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851893.448609:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.448610:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851893.448610:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042c2206e x1859598848842112/t0(0) o17->6388fc17-eef3-44d9-8abb-9e3b21b2ef11@16019@kfi7:620/0 lens 456/432 e 0 to 0 dl 1773851980 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1494-0'
00000100:00100000:15.0:1773851893.448613:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042c2206e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6388fc17-eef3-44d9-8abb-9e3b21b2ef11+5:39570:x1859598848842112:12345-16019@kfi7:17:default-tuolumne1494-0 Request processed in 73us (106us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851893.448616:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16019@kfi7, seq: 411190556
00000100:00000040:15.0:1773851893.448617:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f12d051e : new rpc_count 0
00000800:00000200:13.0:1773851893.448617:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851893.448618:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851893.448618:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851893.448619:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851893.448619:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851893.448619:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16019@kfi7: PUT: OK
00000020:00000010:15.0:1773851893.448620:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000400:00000200:13.0:1773851893.448620:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008af5e37b
00000020:00000010:15.0:1773851893.448621:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000aa96597.
00000020:00000040:15.0:1773851893.448621:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000f12d051e : new refcount 4
00000400:00000010:13.0:1773851893.448621:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008af5e37b.
00000100:00000001:13.0:1773851893.448621:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851893.448622:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851893.448622:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851893.448622:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fdce8d0d nid 16019@kfi7 refs 2
00000800:00000200:13.0:1773851893.448624:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 16019@kfi7(00000000f48e1b65):0x0 lsk 803 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x322 Transaction freed
00000800:00000200:17.0:1773851893.472234:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.472235:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851893.472238:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851893.472242:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851893.472245:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12019@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.472248:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12019@kfi7 : PUT - for me
00000400:00000200:17.0:1773851893.472249:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12019@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.472251:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2c56d3c nid 12019@kfi7 refs 1
00000400:00000200:17.0:1773851893.472253:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12019@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.472254:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2c56d3c nid 12019@kfi7 refs 2
00000400:00000200:17.0:1773851893.472255:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2c56d3c nid 12019@kfi7 refs 3
00000400:00000200:17.0:1773851893.472257:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12019@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.472260:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12019@kfi7 of length 224 into portal 12 MB=0x69b4b59bda240
00000400:00000200:17.0:1773851893.472262:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12019@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 41856
00000800:00000200:17.0:1773851893.472266:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851893.472269:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851893.472271:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12019@kfi7: PUT: OK
00000100:00000001:17.0:1773851893.472273:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851893.472274:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851893.472276:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005eb2f6a2.
00000100:00000040:17.0:1773851893.472277:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000005eb2f6a2 x1859597790716480 msgsize 224
00000100:00100000:17.0:1773851893.472280:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12019@kfi7 (source: 12345-12019@kfi7)
00000100:00000001:17.0:1773851893.472282:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851893.472284:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2c56d3c nid 12019@kfi7 refs 2
00000800:00000200:17.0:1773851893.472287:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851893.472292:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851893.472293:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851893.472294:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851893.472295:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851893.472296:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851893.472298:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597790716480
00000020:00000001:17.0:1773851893.472299:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851893.472299:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d784d3
00000020:00000001:17.0:1773851893.472300:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851893.472304:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000daf56161 refcount=5
00000020:00000001:17.0:1773851893.472306:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637081201422336 : -106992508129280 : ffff9eb0dd8f3000)
00000020:00000001:17.0:1773851893.472307:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637081201422336 : -106992508129280 : ffff9eb0dd8f3000)
00000100:00000001:17.0:1773851893.472309:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851893.472310:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851893.472311:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000455b6f1c.
00000020:00000010:17.0:1773851893.472313:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851893.472314:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851893.472316:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851893.472318:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851893.472319:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851893.472320:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851893.472321:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851893.472322:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.472324:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851893.472326:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851893.472326:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851893.472327:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851893.472327:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851893.472329:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12019@kfi7, seq: 2156415
00000100:00000040:17.0:1773851893.472330:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000daf56161 : new rpc_count 1
00000100:00000001:16.0:1773851893.472330:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.472332:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968770432 : -106974740781184 : ffff9eb500936780)
00000100:00000001:16.0:1773851893.472332:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851893.472334:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005eb2f6a2 x1859597790716480/t0(0) o400->9ee1fa88-3f04-4fac-a75e-1855ba790885@12019@kfi7:145/0 lens 224/0 e 0 to 0 dl 1773852260 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1225-0'
00000100:00000001:17.0:1773851893.472339:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851893.472340:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851893.472342:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005eb2f6a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:9ee1fa88-3f04-4fac-a75e-1855ba790885+5:39642:x1859597790716480:12345-12019@kfi7:400:default-tuolumne1225-0
00000100:00000200:17.0:1773851893.472344:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597790716480
00000020:00000001:17.0:1773851893.472345:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851893.472346:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851893.472347:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.472349:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851893.472349:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851893.472351:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851893.472352:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597790716480, found 0 last_xid 1859597790716479
00000020:00000001:17.0:1773851893.472353:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851893.472355:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851893.472356:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851893.472357:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.472358:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851893.472359:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851893.472360:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851893.472361:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab511341.
02000000:00000001:17.0:1773851893.472362:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.472364:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.472366:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851893.472367:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256977047, transno 0, xid 1859597790716480
00010000:00000001:17.0:1773851893.472369:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851893.472370:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005eb2f6a2 x1859597790716480/t0(0) o400->9ee1fa88-3f04-4fac-a75e-1855ba790885@12019@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1225-0'
00010000:00000001:17.0:1773851893.472375:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851893.472376:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851893.472377:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=126 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851893.472380:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851893.472381:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000062b4e6a9 refcount 3 to 12019@kfi7
00000100:00000001:17.0:1773851893.472382:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363994240 : -107142345557376 : ffff9e8dfa8d7a80)
02000000:00000001:17.0:1773851893.472384:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851893.472385:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.472386:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851893.472387:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12019@kfi7
00000400:00000010:17.0:1773851893.472388:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000af69d68e.
00000100:00000200:17.0:1773851893.472390:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597790716480, offset 224
00000400:00000200:17.0:1773851893.472392:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12019@kfi7
00000400:00000200:17.0:1773851893.472394:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12019@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.472395:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2c56d3c nid 12019@kfi7 refs 1
00000400:00000200:17.0:1773851893.472397:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2c56d3c nid 12019@kfi7 refs 2
00000400:00000200:17.0:1773851893.472399:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2c56d3c nid 12019@kfi7 refs 3
00000400:00000200:17.0:1773851893.472401:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12019@kfi7 local destination
00000400:00000200:17.0:1773851893.472403:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770080:8770080:1024:4294967295] 12019@kfi7 LPNI seq info [430140:430140:16:4294967295]
00000400:00000200:17.0:1773851893.472406:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b2c56d3c nid 12019@kfi7 refs 2
00000400:00000200:17.0:1773851893.472407:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12019@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.472411:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12019@kfi7(12019@kfi7:12019@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851893.472413:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2c56d3c nid 12019@kfi7 refs 3
00000800:00000200:17.0:1773851893.472415:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.472417:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851893.472426:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851893.472431:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x454 Using peer 12019@kfi7(0x454)
00000800:00000200:17.0:1773851893.472436:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 324 bytes to peer 0x454: rc=0
00000800:00000200:17.0:1773851893.472439:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x454 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851893.472442:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851893.472444:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000062b4e6a9 refcount 2 to 12019@kfi7
00010000:00000001:17.0:1773851893.472445:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851893.472446:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.472448:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851893.472449:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005eb2f6a2 x1859597790716480/t0(0) o400->9ee1fa88-3f04-4fac-a75e-1855ba790885@12019@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1225-0'
00000800:00000200:18.0:1773851893.472455:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x454 TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851893.472455:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005eb2f6a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:9ee1fa88-3f04-4fac-a75e-1855ba790885+5:39642:x1859597790716480:12345-12019@kfi7:400:default-tuolumne1225-0 Request processed in 114us (176us total) trans 0 rc 0/0
00000400:00000200:18.0:1773851893.472457:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851893.472458:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12019@kfi7: PUT: OK
00000400:00000200:18.0:1773851893.472459:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000af69d68e
00000100:00100000:17.0:1773851893.472459:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12019@kfi7, seq: 2156415
00000400:00000010:18.0:1773851893.472460:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000af69d68e.
00000100:00000040:17.0:1773851893.472460:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000daf56161 : new rpc_count 0
00000100:00000001:18.0:1773851893.472461:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851893.472461:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:17.0:1773851893.472461:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:18.0:1773851893.472462:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2c56d3c nid 12019@kfi7 refs 2
00000100:00000001:17.0:1773851893.472462:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851893.472463:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000800:00000200:18.0:1773851893.472464:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000aee891f1: 2069@kfi7:4 -> 12019@kfi7(0000000052056448):0x0 lsk 1109 rsk 23 tsk 0 trmk 0 tmk 0 trr 4 tta 0x454 Transaction freed
00000020:00000010:17.0:1773851893.472464:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000020:00000010:17.0:1773851893.472465:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000455b6f1c.
00000020:00000040:17.0:1773851893.472466:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000daf56161 : new refcount 4
00000100:00000001:17.0:1773851893.472467:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851893.480069:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.480070:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851893.480072:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851893.480076:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851893.480080:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.480083:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.38@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851893.480085:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.480086:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851893.480089:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.38@o2ib60 to cpt 7
00000400:00000200:17.0:1773851893.480092:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d5d2e77c nid 192.168.128.38@o2ib60 refs 2
00000400:00000200:17.0:1773851893.480094:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d5d2e77c nid 192.168.128.38@o2ib60 refs 3
00000400:00000200:17.0:1773851893.480096:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.38@o2ib60 to cpt 7
00000400:00000200:17.0:1773851893.480098:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.38@o2ib60 of length 224 into portal 12 MB=0x69b236a2afb80
00000400:00000200:17.0:1773851893.480101:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.38@o2ib60 of length 224/224 into md 0x77fe1859d [64] + 5448
00000800:00000200:17.0:1773851893.480105:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851893.480108:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851893.480110:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851893.480112:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851893.480113:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851893.480114:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001307011c.
00000100:00000040:17.0:1773851893.480115:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001307011c x1859426267626368 msgsize 224
00000100:00100000:17.0:1773851893.480119:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.38@o2ib60 (source: 12345-192.168.128.38@o2ib60)
00000100:00000001:17.0:1773851893.480122:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851893.480123:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:30.0:1773851893.480125:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851893.480126:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851893.480126:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851893.480127:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851893.480127:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851893.480128:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851893.480129:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859426267626368
00000020:00000001:30.0:1773851893.480130:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851893.480131:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2cee53
00000020:00000001:30.0:1773851893.480131:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851893.480135:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dbb69208 refcount=5
00000020:00000001:30.0:1773851893.480136:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120113829888 : -106953595721728 : ffff9eb9eceb6800)
00000020:00000001:30.0:1773851893.480137:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637120113829888 : -106953595721728 : ffff9eb9eceb6800)
00000100:00000001:30.0:1773851893.480139:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.480141:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851893.480142:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006392c63e.
00000020:00000010:30.0:1773851893.480143:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.480144:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000818b6cb1.
00000100:00000001:30.0:1773851893.480145:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851893.480146:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851893.480147:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.480148:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851893.480149:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851893.480150:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.480152:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851893.480154:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851893.480154:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851893.480154:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851893.480155:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851893.480156:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.38@o2ib60, seq: 2055584
00000100:00000001:31.0:1773851893.480158:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.480158:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dbb69208 : new rpc_count 1
00000100:00000001:31.0:1773851893.480159:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.480159:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968766976 : -106974740784640 : ffff9eb500935a00)
00000100:00000040:30.0:1773851893.480161:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001307011c x1859426267626368/t0(0) o400->1dd5bb33-9ed6-4e85-9fdd-f28d6387dc31@192.168.128.38@o2ib60:681/0 lens 224/0 e 0 to 0 dl 1773852041 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix38-0'
00000100:00000001:30.0:1773851893.480167:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.480167:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851893.480170:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001307011c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:1dd5bb33-9ed6-4e85-9fdd-f28d6387dc31+5:40204:x1859426267626368:12345-192.168.128.38@o2ib60:400:default-matrix38-0
00000100:00000200:30.0:1773851893.480172:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859426267626368
00000020:00000001:30.0:1773851893.480174:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851893.480175:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851893.480176:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.480177:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851893.480178:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851893.480180:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851893.480181:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859426267626368, found 0 last_xid 1859426267626367
00000020:00000001:30.0:1773851893.480182:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851893.480184:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851893.480184:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851893.480186:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.480188:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851893.480189:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851893.480189:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851893.480190:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000707f835a.
02000000:00000001:30.0:1773851893.480192:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.480193:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.480194:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851893.480195:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183076525198, transno 0, xid 1859426267626368
00010000:00000001:30.0:1773851893.480197:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851893.480199:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001307011c x1859426267626368/t0(0) o400->1dd5bb33-9ed6-4e85-9fdd-f28d6387dc31@192.168.128.38@o2ib60:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix38-0'
00010000:00000001:30.0:1773851893.480204:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851893.480205:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851893.480206:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=126 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851893.480208:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851893.480210:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002713d438 refcount 3 to 192.168.128.38@o2ib60
00000100:00000001:30.0:1773851893.480212:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412880768 : -107156296670848 : ffff9e8abb006180)
02000000:00000001:30.0:1773851893.480213:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851893.480214:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.480215:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851893.480217:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.38@o2ib60
00000400:00000010:30.0:1773851893.480219:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ab75faba.
00000100:00000200:30.0:1773851893.480220:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859426267626368, offset 224
00000400:00000200:30.0:1773851893.480223:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.38@o2ib60
00000400:00000200:30.0:1773851893.480226:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.38@o2ib60 to cpt 7
00000400:00000200:30.0:1773851893.480229:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d5d2e77c nid 192.168.128.38@o2ib60 refs 2
00000400:00000200:30.0:1773851893.480231:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d5d2e77c nid 192.168.128.38@o2ib60 refs 3
00000400:00000200:30.0:1773851893.480234:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d5d2e77c nid 192.168.128.38@o2ib60 refs 4
00000400:00000200:30.0:1773851893.480237:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.38@o2ib60 routed destination
00000400:00000200:30.0:1773851893.480239:0:42267:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:30.0:1773851893.480240:0:42267:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:30.0:1773851893.480243:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.38@o2ib60: rtr pref emtpy: 1
00000400:00000200:30.0:1773851893.480246:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:30.0:1773851893.480248:0:42267:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.38@o2ib60: rtr pref emtpy: 1
00000400:00000200:30.0:1773851893.480249:0:42267:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:30.0:1773851893.480251:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770081:8770081:1024:4294967295] 2094@kfi7 LPNI seq info [1258747020:1258747020:16:4294967295]
00000400:00000200:30.0:1773851893.480254:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:30.0:1773851893.480256:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:30.0:1773851893.480261:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.38@o2ib60(192.168.128.38@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851893.480264:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d5d2e77c nid 192.168.128.38@o2ib60 refs 3
00000800:00000200:30.0:1773851893.480267:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851893.480270:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851893.480274:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851893.480278:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:30.0:1773851893.480284:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000c05b04ad: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:30.0:1773851893.480287:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851893.480290:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.480292:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002713d438 refcount 2 to 192.168.128.38@o2ib60
00010000:00000001:30.0:1773851893.480293:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851893.480294:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.480295:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851893.480296:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001307011c x1859426267626368/t0(0) o400->1dd5bb33-9ed6-4e85-9fdd-f28d6387dc31@192.168.128.38@o2ib60:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix38-0'
00000800:00000200:29.0:1773851893.480301:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:30.0:1773851893.480302:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001307011c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:1dd5bb33-9ed6-4e85-9fdd-f28d6387dc31+5:40204:x1859426267626368:12345-192.168.128.38@o2ib60:400:default-matrix38-0 Request processed in 133us (185us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851893.480303:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851893.480305:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00100000:30.0:1773851893.480306:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.38@o2ib60, seq: 2055584
00000400:00000200:29.0:1773851893.480306:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ab75faba
00000100:00000040:30.0:1773851893.480307:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dbb69208 : new rpc_count 0
00000400:00000010:29.0:1773851893.480307:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ab75faba.
00000100:00000001:29.0:1773851893.480308:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851893.480309:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851893.480309:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:30.0:1773851893.480310:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851893.480310:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:30.0:1773851893.480311:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.480312:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000818b6cb1.
00000020:00000010:30.0:1773851893.480313:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006392c63e.
00000800:00000200:29.0:1773851893.480313:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Transaction freed
00000020:00000040:30.0:1773851893.480315:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000dbb69208 : new refcount 4
00000100:00000001:30.0:1773851893.480316:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851893.501195:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851893.501196:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851893.501197:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851893.501201:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851893.501204:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13728@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.501206:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13728@kfi7 : PUT - for me
00000400:00000200:13.0:1773851893.501207:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13728@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.501209:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002f69e87 nid 13728@kfi7 refs 1
00000400:00000200:13.0:1773851893.501212:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13728@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.501213:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002f69e87 nid 13728@kfi7 refs 2
00000400:00000200:13.0:1773851893.501215:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000002f69e87 nid 13728@kfi7 refs 3
00000400:00000200:13.0:1773851893.501216:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13729@kfi7 to cpt 6
00000400:00000200:13.0:1773851893.501218:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13729@kfi7 of length 224 into portal 12 MB=0x69b4ba0c02780
00000400:00000200:13.0:1773851893.501221:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13729@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 51656
00000800:00000200:13.0:1773851893.501225:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851893.501228:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851893.501230:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13728@kfi7: PUT: OK
00000100:00000001:13.0:1773851893.501232:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851893.501233:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851893.501234:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dca20be4.
00000100:00000040:13.0:1773851893.501235:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000dca20be4 x1859598982064000 msgsize 224
00000100:00100000:13.0:1773851893.501238:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13729@kfi7 (source: 12345-13728@kfi7)
00000100:00000001:13.0:1773851893.501240:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851893.501241:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000002f69e87 nid 13728@kfi7 refs 2
00000100:00000001:15.0:1773851893.501243:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851893.501244:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851893.501244:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851893.501245:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851893.501246:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851893.501247:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851893.501248:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598982064000
00000020:00000001:15.0:1773851893.501249:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851893.501250:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d78941
00000020:00000001:15.0:1773851893.501251:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851893.501257:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d9901ddb refcount=5
00000020:00000001:15.0:1773851893.501258:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636920812340224 : -107152897211392 : ffff9e8b85a00400)
00000020:00000001:15.0:1773851893.501259:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636920812340224 : -107152897211392 : ffff9e8b85a00400)
00000100:00000001:15.0:1773851893.501261:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.501263:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851893.501264:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000aa96597.
00000020:00000010:15.0:1773851893.501266:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851893.501267:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851893.501269:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851893.501269:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851893.501270:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.501272:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851893.501273:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851893.501274:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.501276:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.501278:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851893.501279:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851893.501279:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851893.501279:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851893.501281:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13729@kfi7, seq: 2289917
00000100:00000040:15.0:1773851893.501283:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d9901ddb : new rpc_count 1
00000100:00000001:12.0:1773851893.501283:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.501284:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637073485617664 : -107000223933952 : ffff9eaf11a95a00)
00000100:00000001:12.0:1773851893.501285:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851893.501287:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dca20be4 x1859598982064000/t0(0) o400->da928cf4-0735-4fde-9f64-c619e68beb36@13729@kfi7:620/0 lens 224/0 e 0 to 0 dl 1773851980 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1344-0'
00000100:00000001:15.0:1773851893.501292:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.501293:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851893.501295:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dca20be4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:da928cf4-0735-4fde-9f64-c619e68beb36+5:39647:x1859598982064000:12345-13729@kfi7:400:default-tuolumne1344-0
00000100:00000200:15.0:1773851893.501297:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598982064000
00000020:00000001:15.0:1773851893.501298:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851893.501299:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851893.501300:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.501302:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851893.501303:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851893.501304:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851893.501305:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598982064000, found 0 last_xid 1859598982063999
00000020:00000001:15.0:1773851893.501307:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851893.501308:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851893.501309:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851893.501309:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.501311:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851893.501312:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851893.501313:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851893.501314:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008c779a05.
02000000:00000001:15.0:1773851893.501315:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.501316:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.501317:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851893.501318:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597421, transno 0, xid 1859598982064000
00010000:00000001:15.0:1773851893.501320:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851893.501321:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dca20be4 x1859598982064000/t0(0) o400->da928cf4-0735-4fde-9f64-c619e68beb36@13729@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1344-0'
00010000:00000001:15.0:1773851893.501326:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851893.501327:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851893.501329:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=126 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851893.501331:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851893.501332:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006ad935e0 refcount 3 to 13729@kfi7
00000100:00000001:15.0:1773851893.501334:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643690368 : -107157065861248 : ffff9e8a8d277780)
02000000:00000001:15.0:1773851893.501335:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851893.501336:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.501337:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851893.501339:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13728@kfi7
00000400:00000010:15.0:1773851893.501340:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dbadbd2e.
00000100:00000200:15.0:1773851893.501341:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598982064000, offset 224
00000400:00000200:15.0:1773851893.501344:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13728@kfi7
00000400:00000200:15.0:1773851893.501345:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13728@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.501347:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000002f69e87 nid 13728@kfi7 refs 1
00000400:00000200:15.0:1773851893.501349:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000002f69e87 nid 13728@kfi7 refs 2
00000400:00000200:15.0:1773851893.501351:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000002f69e87 nid 13728@kfi7 refs 3
00000400:00000200:15.0:1773851893.501353:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13728@kfi7 local destination
00000400:00000200:15.0:1773851893.501356:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770082:8770082:1024:4294967295] 13728@kfi7 LPNI seq info [15932860:15932860:16:4294967295]
00000400:00000200:15.0:1773851893.501358:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000002f69e87 nid 13728@kfi7 refs 2
00000400:00000200:15.0:1773851893.501359:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13728@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.501363:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13728@kfi7(13728@kfi7:13728@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851893.501365:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000002f69e87 nid 13728@kfi7 refs 3
00000800:00000200:15.0:1773851893.501368:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851893.501370:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851893.501374:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851893.501378:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe67 Using peer 13728@kfi7(0xe67)
00000800:00000200:15.0:1773851893.501383:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0xe67: rc=0
00000800:00000200:15.0:1773851893.501385:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe67 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851893.501404:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851893.501405:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe67 TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851893.501406:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006ad935e0 refcount 2 to 13729@kfi7
00010000:00000001:15.0:1773851893.501407:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851893.501408:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851893.501408:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:15.0:1773851893.501409:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851893.501410:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dca20be4 x1859598982064000/t0(0) o400->da928cf4-0735-4fde-9f64-c619e68beb36@13729@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1344-0'
00000400:00000200:13.0:1773851893.501410:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13728@kfi7: PUT: OK
00000400:00000200:13.0:1773851893.501411:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dbadbd2e
00000400:00000010:13.0:1773851893.501412:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dbadbd2e.
00000100:00000001:13.0:1773851893.501413:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851893.501414:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:15.0:1773851893.501415:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dca20be4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:da928cf4-0735-4fde-9f64-c619e68beb36+5:39647:x1859598982064000:12345-13729@kfi7:400:default-tuolumne1344-0 Request processed in 122us (179us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851893.501415:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000002f69e87 nid 13728@kfi7 refs 2
00000800:00000200:13.0:1773851893.501418:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 13728@kfi7(00000000ef1d4b62):0x0 lsk 3688 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe67 Transaction freed
00000100:00100000:15.0:1773851893.501419:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13729@kfi7, seq: 2289917
00000100:00000040:15.0:1773851893.501421:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d9901ddb : new rpc_count 0
00000100:00000001:15.0:1773851893.501422:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851893.501423:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851893.501424:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851893.501425:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:15.0:1773851893.501426:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000aa96597.
00000020:00000040:15.0:1773851893.501428:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000d9901ddb : new refcount 4
00000100:00000001:15.0:1773851893.501429:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851893.521881:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.521881:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851893.521883:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851893.521885:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851893.521887:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19056@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.521888:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19056@kfi7 : PUT - for me
00000400:00000200:17.0:1773851893.521889:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19056@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.521890:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ddc84fe nid 19056@kfi7 refs 1
00000400:00000200:17.0:1773851893.521892:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19056@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.521892:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ddc84fe nid 19056@kfi7 refs 2
00000400:00000200:17.0:1773851893.521893:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ddc84fe nid 19056@kfi7 refs 3
00000400:00000200:17.0:1773851893.521894:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19120@kfi7 to cpt 7
00000400:00000200:17.0:1773851893.521895:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19120@kfi7 of length 224 into portal 12 MB=0x699e1138d4940
00000400:00000200:17.0:1773851893.521896:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19120@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 42080
00000800:00000200:17.0:1773851893.521898:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851893.521900:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851893.521901:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19056@kfi7: PUT: OK
00000100:00000001:17.0:1773851893.521902:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851893.521902:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851893.521903:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000076e27592.
00000100:00000040:17.0:1773851893.521904:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000076e27592 x1858041834981696 msgsize 224
00000100:00100000:17.0:1773851893.521905:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19120@kfi7 (source: 12345-19056@kfi7)
00000100:00000001:17.0:1773851893.521907:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851893.521908:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ddc84fe nid 19056@kfi7 refs 2
00000800:00000200:17.0:1773851893.521909:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851893.521912:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851893.521912:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851893.521913:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851893.521913:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851893.521914:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851893.521915:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041834981696
00000020:00000001:17.0:1773851893.521915:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851893.521916:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925bd
00000020:00000001:17.0:1773851893.521916:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851893.521918:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000003d16cfa refcount=6
00000020:00000001:17.0:1773851893.521919:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631001088 : -107123078550528 : ffff9e9276f4ac00)
00000020:00000001:17.0:1773851893.521920:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631001088 : -107123078550528 : ffff9e9276f4ac00)
00000100:00000001:17.0:1773851893.521921:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851893.521922:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851893.521923:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007767c329.
00000020:00000010:17.0:1773851893.521924:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851893.521925:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851893.521925:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851893.521926:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851893.521926:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851893.521927:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851893.521928:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851893.521928:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.521929:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851893.521930:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851893.521930:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851893.521931:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851893.521931:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851893.521932:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19120@kfi7, seq: 2156416
00000100:00000040:17.0:1773851893.521932:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000003d16cfa : new rpc_count 1
00000100:00000001:16.0:1773851893.521932:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.521933:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968753152 : -106974740798464 : ffff9eb500932400)
00000100:00000001:16.0:1773851893.521933:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851893.521934:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000076e27592 x1858041834981696/t0(0) o400->67fa2fd2-59ce-49b1-aee1-d32f59bffd0f@19120@kfi7:145/0 lens 224/0 e 0 to 0 dl 1773852260 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1678-0'
00000100:00000001:17.0:1773851893.521937:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851893.521938:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851893.521938:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000076e27592 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:67fa2fd2-59ce-49b1-aee1-d32f59bffd0f+6:39807:x1858041834981696:12345-19120@kfi7:400:default-tuolumne1678-0
00000100:00000200:17.0:1773851893.521940:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041834981696
00000020:00000001:17.0:1773851893.521940:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851893.521941:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851893.521942:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.521942:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851893.521943:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851893.521944:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851893.521944:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041834981696, found 0 last_xid 1858041834981695
00000020:00000001:17.0:1773851893.521945:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851893.521946:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851893.521947:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851893.521947:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.521948:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851893.521948:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851893.521949:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851893.521949:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000455b6f1c.
02000000:00000001:17.0:1773851893.521950:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.521951:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.521952:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851893.521952:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691060, transno 0, xid 1858041834981696
00010000:00000001:17.0:1773851893.521953:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851893.521954:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000076e27592 x1858041834981696/t0(0) o400->67fa2fd2-59ce-49b1-aee1-d32f59bffd0f@19120@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1678-0'
00010000:00000001:17.0:1773851893.521956:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851893.521957:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851893.521957:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=126 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851893.521958:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851893.521959:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000040e04382 refcount 3 to 19120@kfi7
00000100:00000001:17.0:1773851893.521960:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066528 : -107155994485088 : ffff9e8acd035ea0)
02000000:00000001:17.0:1773851893.521960:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851893.521961:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.521962:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851893.521963:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19056@kfi7
00000400:00000010:17.0:1773851893.521963:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000427a4ed2.
00000100:00000200:17.0:1773851893.521964:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041834981696, offset 224
00000400:00000200:17.0:1773851893.521965:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19056@kfi7
00000400:00000200:17.0:1773851893.521966:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19056@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.521966:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ddc84fe nid 19056@kfi7 refs 1
00000400:00000200:17.0:1773851893.521967:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ddc84fe nid 19056@kfi7 refs 2
00000400:00000200:17.0:1773851893.521968:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ddc84fe nid 19056@kfi7 refs 3
00000400:00000200:17.0:1773851893.521969:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19056@kfi7 local destination
00000400:00000200:17.0:1773851893.521970:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770083:8770083:1024:4294967295] 19056@kfi7 LPNI seq info [17251200:17251200:16:4294967295]
00000400:00000200:17.0:1773851893.521972:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ddc84fe nid 19056@kfi7 refs 2
00000400:00000200:17.0:1773851893.521973:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19056@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.521975:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19056@kfi7(19056@kfi7:19056@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851893.521976:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ddc84fe nid 19056@kfi7 refs 3
00000800:00000200:17.0:1773851893.521977:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.521978:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851893.521980:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851893.521982:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfc3 Using peer 19056@kfi7(0xfc3)
00000800:00000200:17.0:1773851893.521985:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0xfc3: rc=0
00000800:00000200:17.0:1773851893.521986:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfc3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851893.521988:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851893.521989:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000040e04382 refcount 2 to 19120@kfi7
00010000:00000001:17.0:1773851893.521990:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851893.521990:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851893.521991:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851893.521991:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000076e27592 x1858041834981696/t0(0) o400->67fa2fd2-59ce-49b1-aee1-d32f59bffd0f@19120@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1678-0'
00000100:00100000:17.0:1773851893.521994:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000076e27592 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:67fa2fd2-59ce-49b1-aee1-d32f59bffd0f+6:39807:x1858041834981696:12345-19120@kfi7:400:default-tuolumne1678-0 Request processed in 56us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851893.521997:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19120@kfi7, seq: 2156416
00000100:00000040:17.0:1773851893.521997:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000003d16cfa : new rpc_count 0
00000100:00000001:17.0:1773851893.521998:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:18.0:1773851893.521999:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfc3 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851893.521999:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851893.521999:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000400:00000200:18.0:1773851893.522000:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851893.522000:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000400:00000200:18.0:1773851893.522001:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19056@kfi7: PUT: OK
00000400:00000200:18.0:1773851893.522001:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000427a4ed2
00000020:00000010:17.0:1773851893.522001:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007767c329.
00000020:00000040:17.0:1773851893.522001:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000003d16cfa : new refcount 5
00000400:00000010:18.0:1773851893.522002:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000427a4ed2.
00000100:00000001:18.0:1773851893.522002:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851893.522002:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851893.522003:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851893.522004:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ddc84fe nid 19056@kfi7 refs 2
00000800:00000200:18.0:1773851893.522005:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2069@kfi7:4 -> 19056@kfi7(00000000540983d4):0x0 lsk 4036 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0xfc3 Transaction freed
00000800:00000200:9.0:1773851893.525694:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851893.525695:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851893.525696:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851893.525698:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851893.525700:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.525702:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.110@tcp : PUT - for me
00000400:00000200:9.0:1773851893.525703:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851893.525704:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851893.525705:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.110@tcp to cpt 2
00000400:00000200:9.0:1773851893.525707:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045e39ae8 nid 172.16.70.110@tcp refs 2
00000400:00000200:9.0:1773851893.525708:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000045e39ae8 nid 172.16.70.110@tcp refs 3
00000400:00000200:9.0:1773851893.525709:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.110@tcp to cpt 2
00000400:00000200:9.0:1773851893.525710:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.110@tcp of length 224 into portal 12 MB=0x69a0e8291d200
00000400:00000200:9.0:1773851893.525711:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.110@tcp of length 224/224 into md 0x78146ce49 [64] + 158104
00000800:00000200:9.0:1773851893.525714:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851893.525715:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851893.525716:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851893.525717:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851893.525717:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851893.525718:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000af09cd8a.
00000100:00000040:9.0:1773851893.525719:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000af09cd8a x1858236971078144 msgsize 224
00000100:00100000:9.0:1773851893.525721:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.110@tcp (source: 12345-172.16.70.110@tcp)
00000100:00000001:9.0:1773851893.525722:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851893.525723:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:8.0:1773851893.525724:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851893.525724:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851893.525725:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851893.525728:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851893.525728:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851893.525729:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851893.525730:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858236971078144
00000020:00000001:8.0:1773851893.525730:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851893.525731:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930b4
00000020:00000001:8.0:1773851893.525732:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851893.525734:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eacf1950 refcount=6
00000020:00000001:8.0:1773851893.525735:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745137152 : -107128964414464 : ffff9e9118218400)
00000020:00000001:8.0:1773851893.525736:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745137152 : -107128964414464 : ffff9e9118218400)
00000100:00000001:8.0:1773851893.525737:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851893.525737:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851893.525738:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851893.525739:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851893.525740:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851893.525741:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851893.525741:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851893.525742:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.525742:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851893.525743:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851893.525743:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.525744:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.525745:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851893.525746:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851893.525746:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851893.525746:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851893.525747:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.110@tcp, seq: 2130861
00000100:00000001:9.0:1773851893.525748:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851893.525748:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eacf1950 : new rpc_count 1
00000100:00000001:9.0:1773851893.525749:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.525749:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609048960 : -107064100502656 : ffff9ea032524380)
00000100:00000040:8.0:1773851893.525750:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000af09cd8a x1858236971078144/t0(0) o400->2b54685c-10ba-44a1-b217-9152d596312f@172.16.70.110@tcp:620/0 lens 224/0 e 0 to 0 dl 1773851980 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic10-0'
00000100:00000001:8.0:1773851893.525753:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851893.525753:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851893.525755:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af09cd8a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2b54685c-10ba-44a1-b217-9152d596312f+6:50059:x1858236971078144:12345-172.16.70.110@tcp:400:default-rzslic10-0
00000100:00000200:8.0:1773851893.525756:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858236971078144
00000020:00000001:8.0:1773851893.525757:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851893.525757:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851893.525758:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.525759:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851893.525759:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851893.525760:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851893.525761:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858236971078144, found 0 last_xid 1858236971078143
00000020:00000001:8.0:1773851893.525761:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851893.525762:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851893.525763:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851893.525763:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.525764:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851893.525764:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851893.525765:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851893.525766:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000633e3307.
02000000:00000001:8.0:1773851893.525766:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.525767:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.525768:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851893.525768:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858236971078144
00010000:00000001:8.0:1773851893.525769:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851893.525770:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000af09cd8a x1858236971078144/t0(0) o400->2b54685c-10ba-44a1-b217-9152d596312f@172.16.70.110@tcp:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic10-0'
00010000:00000001:8.0:1773851893.525772:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851893.525772:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851893.525773:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=126 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851893.525774:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851893.525775:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007fdf00d1 refcount 3 to 172.16.70.110@tcp
00000100:00000001:8.0:1773851893.525776:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133216 : -107146658418400 : ffff9e8cf97c7120)
02000000:00000001:8.0:1773851893.525777:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851893.525777:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.525778:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851893.525779:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.110@tcp
00000400:00000010:8.0:1773851893.525780:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e471020a.
00000100:00000200:8.0:1773851893.525781:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858236971078144, offset 224
00000400:00000200:8.0:1773851893.525782:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.110@tcp
00000400:00000200:8.0:1773851893.525783:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.110@tcp to cpt 2
00000400:00000200:8.0:1773851893.525784:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045e39ae8 nid 172.16.70.110@tcp refs 2
00000400:00000200:8.0:1773851893.525785:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000045e39ae8 nid 172.16.70.110@tcp refs 3
00000400:00000200:8.0:1773851893.525786:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000045e39ae8 nid 172.16.70.110@tcp refs 4
00000400:00000200:8.0:1773851893.525788:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.110@tcp routed destination
00000400:00000200:8.0:1773851893.525789:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:8.0:1773851893.525790:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:8.0:1773851893.525792:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.110@tcp: rtr pref emtpy: 1
00000400:00000200:8.0:1773851893.525792:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:8.0:1773851893.525793:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.110@tcp: rtr pref emtpy: 1
00000400:00000200:8.0:1773851893.525794:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:8.0:1773851893.525795:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770084:8770084:1024:4294967295] 17@kfi7 LPNI seq info [1250891920:1250891920:16:4294967295]
00000400:00000200:8.0:1773851893.525797:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:8.0:1773851893.525798:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:8.0:1773851893.525800:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.110@tcp(172.16.70.110@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851893.525801:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000045e39ae8 nid 172.16.70.110@tcp refs 3
00000800:00000200:8.0:1773851893.525803:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851893.525804:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851893.525806:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851893.525808:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:8.0:1773851893.525811:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:8.0:1773851893.525813:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851893.525816:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851893.525817:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007fdf00d1 refcount 2 to 172.16.70.110@tcp
00010000:00000001:8.0:1773851893.525817:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851893.525818:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.525819:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851893.525819:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000af09cd8a x1858236971078144/t0(0) o400->2b54685c-10ba-44a1-b217-9152d596312f@172.16.70.110@tcp:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic10-0'
00000100:00100000:8.0:1773851893.525824:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af09cd8a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:2b54685c-10ba-44a1-b217-9152d596312f+6:50059:x1858236971078144:12345-172.16.70.110@tcp:400:default-rzslic10-0 Request processed in 70us (104us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851893.525826:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.110@tcp, seq: 2130861
00000100:00000040:8.0:1773851893.525827:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eacf1950 : new rpc_count 0
00000100:00000001:8.0:1773851893.525828:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851893.525828:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851893.525829:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851893.525830:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851893.525831:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851893.525831:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000eacf1950 : new refcount 5
00000100:00000001:8.0:1773851893.525832:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851893.525837:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851893.525838:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851893.525839:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:9.0:1773851893.525840:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e471020a
00000400:00000010:9.0:1773851893.525841:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e471020a.
00000100:00000001:9.0:1773851893.525842:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851893.525843:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851893.525843:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851893.525845:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000004:00000001:30.0:1773851893.577730:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851893.577730:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:31.0:1773851893.577731:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851893.577731:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851893.577731:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851893.577731:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000037d69b00.
00000004:00000001:9.0:1773851893.577731:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851893.577732:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:31.0:1773851893.577732:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000055bd4bee.
00000100:00000010:30.0:1773851893.577732:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000085ab5bae.
00000020:00000040:10.0:1773851893.577732:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000004:00000020:9.0:1773851893.577732:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:7.0:1773851893.577732:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851893.577732:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:31.0:1773851893.577733:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000020:00000040:30.0:1773851893.577733:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:10.0:1773851893.577733:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851893.577733:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851893.577733:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:9.0:1773851893.577733:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000273570b.
00000004:00000020:7.0:1773851893.577733:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851893.577733:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed033681.
00000004:00000020:6.0:1773851893.577733:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851893.577733:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ae5d597.
00000004:00000001:5.0:1773851893.577733:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:31.0:1773851893.577734:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851893.577734:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:10.0:1773851893.577734:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006db6fddb.
00000020:00000040:9.0:1773851893.577734:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000020:00000040:7.0:1773851893.577734:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851893.577734:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000004:00000020:5.0:1773851893.577734:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:5.0:1773851893.577734:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000019216c95.
02000000:00000001:31.0:1773851893.577735:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:31.0:1773851893.577735:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851893.577735:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851893.577735:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851893.577735:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851893.577735:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851893.577735:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:7.0:1773851893.577735:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851893.577735:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:5.0:1773851893.577735:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
02000000:00000010:30.0:1773851893.577736:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ce3b9347.
00000100:00000001:10.0:1773851893.577736:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851893.577736:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851893.577736:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:5.0:1773851893.577736:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:31.0:1773851893.577737:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003ff69e5e.
00000100:00000001:30.0:1773851893.577737:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851893.577737:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000037d69b00] to pc [ptlrpcd_02_03+3]  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:9.0:1773851893.577737:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851893.577737:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851893.577737:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851893.577737:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851893.577737:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851893.577737:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851893.577738:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.577738:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:9.0:1773851893.577738:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000010:6.0:1773851893.577738:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000075c954ba.
00000100:00000001:31.0:1773851893.577739:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:31.0:1773851893.577739:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.577739:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.577739:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851893.577739:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e26c1bf7.
00000100:00000001:7.0:1773851893.577739:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577739:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851893.577739:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e7717c48.
00000100:00000040:31.0:1773851893.577740:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000055bd4bee] to pc [ptlrpcd_07_00+0]  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851893.577740:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000085ab5bae] to pc [ptlrpcd_07_03+3]  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851893.577740:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577741:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851893.577741:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:10.0:1773851893.577741:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851893.577741:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851893.577741:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851893.577741:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851893.577741:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851893.577742:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:10.0:1773851893.577742:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000026cc010.
00000100:00000001:9.0:1773851893.577742:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577742:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851893.577742:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577742:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851893.577742:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851893.577743:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851893.577743:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637106877196288 : -106966832355328 : ffff9eb6d7f46800)
00000100:00000040:9.0:1773851893.577743:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000273570b] to pc [ptlrpcd_02_00+0]  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.577743:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851893.577743:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ed033681] to pc [ptlrpcd_01_00+0]  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851893.577743:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005ae5d597] to pc [ptlrpcd_01_01+1]  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851893.577743:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000019216c95] to pc [ptlrpcd_01_02+2]  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:30.0:1773851893.577744:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851893.577744:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:31.0:1773851893.577745:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:28.0:1773851893.577745:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851893.577745:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:10.0:1773851893.577745:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:31.0:1773851893.577746:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bb1c2bcd.
00000100:00000001:28.0:1773851893.577746:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851893.577746:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851893.577746:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:10.0:1773851893.577746:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00080000:00000001:31.0:1773851893.577747:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637067096729600 : -107006612822016 : ffff9ead94daa800)
00000100:00000001:29.0:1773851893.577747:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851893.577747:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:11.0:1773851893.577747:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:11.0:1773851893.577747:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:10.0:1773851893.577747:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000058146cda.
00000004:00000001:7.0:1773851893.577747:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851893.577747:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851893.577748:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:29.0:1773851893.577748:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:28.0:1773851893.577748:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:11.0:1773851893.577748:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051938624:37@kfi7:13:default-yuba2-0
00000004:00080000:10.0:1773851893.577748:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614168031023383ns, next at 614169031022241ns, rc = 0
00000100:00000001:8.0:1773851893.577748:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851893.577748:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:29.0:1773851893.577749:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851893.577749:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:9.0:1773851893.577749:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851893.577749:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851893.577749:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851893.577750:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:11.0:1773851893.577750:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:10.0:1773851893.577750:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851893.577750:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:9.0:1773851893.577750:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006107aa26.
00080000:00000010:5.0:1773851893.577750:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000047e77d44.
00080000:00000001:5.0:1773851893.577750:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637044932472832 : -107028777078784 : ffff9ea86bc2f000)
00080000:00000001:31.0:1773851893.577751:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:31.0:1773851893.577751:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:29.0:1773851893.577751:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851893.577751:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851893.577751:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851893.577751:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851893.577751:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:9.0:1773851893.577751:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636941404291072 : -107132305260544 : ffff9e9051004000)
00000100:00000040:8.0:1773851893.577751:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851893.577751:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851893.577751:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:4.0:1773851893.577751:0:41067:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000004:00000010:31.0:1773851893.577752:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000019654b41.
00000100:00000001:29.0:1773851893.577752:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851893.577752:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851893.577752:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851893.577752:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851893.577752:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000042acc974.
00080000:00000001:9.0:1773851893.577752:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851893.577752:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851893.577752:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851893.577752:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851893.577752:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00080000:31.0:1773851893.577753:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614168031028653ns, next at 614169031027551ns, rc = 0
02000000:00000001:29.0:1773851893.577753:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851893.577753:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851893.577753:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577753:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:7.0:1773851893.577753:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851893.577753:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851893.577753:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851893.577753:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851893.577753:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:31.0:1773851893.577754:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:29.0:1773851893.577754:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000055bd4bee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051938752:60@kfi7:13:default-yuba2-0
00000100:00100000:28.0:1773851893.577754:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085ab5bae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051938688:13@kfi7:41:default-yuba2-0
00000400:00000200:11.0:1773851893.577754:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000010:11.0:1773851893.577754:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000100:00000001:10.0:1773851893.577754:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:9.0:1773851893.577754:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:8.0:1773851893.577754:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577754:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:5.0:1773851893.577754:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000100:00000001:4.0:1773851893.577754:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851893.577754:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:31.0:1773851893.577755:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851893.577755:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:28.0:1773851893.577755:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851893.577755:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:11.0:1773851893.577755:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2b33615.
00000100:00000001:10.0:1773851893.577755:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:9.0:1773851893.577755:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a0575928.
02000000:00000001:8.0:1773851893.577755:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851893.577755:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577755:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851893.577755:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:5.0:1773851893.577755:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b500212a.
00000100:00000001:4.0:1773851893.577755:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851893.577755:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000001:31.0:1773851893.577756:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851893.577756:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851893.577756:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851893.577756:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:11.0:1773851893.577756:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938624, portal 4
00000004:00080000:9.0:1773851893.577756:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614168031031518ns, next at 614169031030306ns, rc = 0
00000100:00100000:8.0:1773851893.577756:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000273570b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051938816:2060@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851893.577756:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851893.577756:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851893.577756:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:5.0:1773851893.577756:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614168031031869ns, next at 614169031030416ns, rc = 0
00000100:00000040:4.0:1773851893.577756:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851893.577757:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:29.0:1773851893.577757:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000077b2db51.
02000000:00000001:28.0:1773851893.577757:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:28.0:1773851893.577757:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006d31c239.
00000100:00000001:11.0:1773851893.577757:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:11.0:1773851893.577757:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087763328 : -106944621788288 : ffff9ebc03cec380)
00080000:00000001:9.0:1773851893.577757:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851893.577757:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851893.577758:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851893.577758:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851893.577758:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:9.0:1773851893.577758:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577758:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851893.577758:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851893.577758:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:5.0:1773851893.577758:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851893.577759:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000004:00000001:9.0:1773851893.577759:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851893.577759:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851893.577759:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851893.577759:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051938944:2074@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851893.577759:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851893.577759:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851893.577759:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851893.577759:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851893.577759:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851893.577760:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000010:28.0:1773851893.577760:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
02000000:00000001:8.0:1773851893.577760:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851893.577760:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000098c0e011.
00000100:00000001:7.0:1773851893.577760:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851893.577760:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851893.577760:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851893.577760:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851893.577761:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851893.577761:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851893.577761:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000843b5aa4.
00000400:00000010:29.0:1773851893.577761:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ecffec9b.
00000400:00000010:28.0:1773851893.577761:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f52a267c.
00000100:00000001:11.0:1773851893.577761:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:8.0:1773851893.577761:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851893.577761:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851893.577761:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851893.577761:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851893.577761:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019216c95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051939008:2061@kfi7:13:default-yuba2-0
00000100:00000200:29.0:1773851893.577762:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938752, portal 4
00000100:00000200:28.0:1773851893.577762:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938688, portal 4
00000100:00000040:11.0:1773851893.577762:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000400:00000010:11.0:1773851893.577762:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000110e0a3f.
00000400:00000200:8.0:1773851893.577762:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000010:8.0:1773851893.577762:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
02000000:00000001:7.0:1773851893.577762:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:6.0:1773851893.577762:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005ae5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051938880:36@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851893.577763:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851893.577763:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999065856 : -107038710485760 : ffff9ea61baf2d00)
00000100:00000001:28.0:1773851893.577763:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:11.0:1773851893.577763:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938624, offset 0
00000400:00000010:8.0:1773851893.577763:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc809cf6.
00000100:00000001:6.0:1773851893.577763:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851893.577763:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:4.0:1773851893.577763:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851893.577763:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:28.0:1773851893.577764:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411259520 : -106960298292096 : ffff9eb85d6a4c80)
00000400:00000200:11.0:1773851893.577764:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
02000000:00000010:7.0:1773851893.577764:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006f21a4d8.
02000000:00000001:6.0:1773851893.577764:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851893.577764:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:4.0:1773851893.577764:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851893.577765:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851893.577765:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851893.577765:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851893.577765:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851893.577765:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000200:8.0:1773851893.577765:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938816, portal 4
02000000:00000001:7.0:1773851893.577765:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851893.577765:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851893.577765:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e54f7a48.
00000400:00000200:11.0:1773851893.577766:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000100:00000001:8.0:1773851893.577766:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851893.577766:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637009609044352 : -107064100507264 : ffff9ea032523180)
00000400:00000200:7.0:1773851893.577766:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
02000000:00000010:6.0:1773851893.577766:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001c35e9b8.
02000000:00000001:6.0:1773851893.577766:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851893.577766:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851893.577767:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851893.577767:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851893.577767:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:7.0:1773851893.577767:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000200:4.0:1773851893.577767:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:29.0:1773851893.577768:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000100:00000040:28.0:1773851893.577768:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000200:11.0:1773851893.577768:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000010:7.0:1773851893.577768:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000400:00000200:6.0:1773851893.577768:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:6.0:1773851893.577768:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000400:00000010:4.0:1773851893.577768:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000010:4.0:1773851893.577768:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5f4f73.
00000400:00000010:29.0:1773851893.577769:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8cfb79.
00000400:00000010:28.0:1773851893.577769:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f11aa4e7.
00000400:00000200:11.0:1773851893.577769:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000200:7.0:1773851893.577769:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938944, portal 4
00000400:00000010:6.0:1773851893.577769:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f75391c.
00000100:00000200:28.0:1773851893.577770:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051938688, offset 0
00000400:00000200:11.0:1773851893.577770:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000100:00000001:8.0:1773851893.577770:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851893.577770:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000100:00000001:7.0:1773851893.577770:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851893.577770:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309139712 : -106994400411904 : ffff9eb06cc53f00)
00000100:00000200:6.0:1773851893.577770:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051938880, portal 4
00000100:00000200:29.0:1773851893.577771:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938752, offset 0
00000400:00000010:8.0:1773851893.577771:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c20ed36.
00000100:00000040:7.0:1773851893.577771:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851893.577771:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851893.577771:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971814073856 : -107101895477760 : ffff9e976590b600)
00000400:00000200:11.0:1773851893.577772:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770083, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770084, p:4294967295, g:4294967295, h:1000]
00000100:00000200:8.0:1773851893.577772:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938816, offset 0
00000100:00000200:4.0:1773851893.577772:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939008, portal 4
00000100:00000001:4.0:1773851893.577772:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:28.0:1773851893.577773:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:8.0:1773851893.577773:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000100:00000040:6.0:1773851893.577773:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851893.577773:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637006074680960 : -107067634870656 : ffff9e9f5fa81680)
00000400:00000200:29.0:1773851893.577774:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:28.0:1773851893.577774:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:11.0:1773851893.577774:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:7.0:1773851893.577774:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851893.577774:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:28.0:1773851893.577775:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:11.0:1773851893.577775:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:7.0:1773851893.577775:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000100:00000001:6.0:1773851893.577775:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:28.0:1773851893.577776:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:11.0:1773851893.577776:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000010:7.0:1773851893.577776:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
00000100:00000040:6.0:1773851893.577776:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000100:00000001:4.0:1773851893.577776:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:11.0:1773851893.577777:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770085:8770085:1024:4294967295] 37@kfi7 LPNI seq info [5403399:5403399:16:4294967295]
00000100:00000200:7.0:1773851893.577777:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051938944, offset 0
00000400:00000010:6.0:1773851893.577777:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c9c32447.
00000100:00000200:6.0:1773851893.577777:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051938880, offset 0
00000100:00000040:4.0:1773851893.577777:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:4.0:1773851893.577777:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000645e16b0.
00000400:00000200:28.0:1773851893.577778:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:7.0:1773851893.577778:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:28.0:1773851893.577779:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:11.0:1773851893.577779:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:7.0:1773851893.577779:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000200:4.0:1773851893.577779:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939008, offset 0
00000400:00000200:11.0:1773851893.577780:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851893.577780:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:6.0:1773851893.577780:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:28.0:1773851893.577781:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770085, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770084, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851893.577781:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:4.0:1773851893.577781:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000200:8.0:1773851893.577782:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:7.0:1773851893.577782:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:8.0:1773851893.577783:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:7.0:1773851893.577783:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851893.577784:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851893.577784:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:28.0:1773851893.577785:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851893.577785:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851893.577786:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851893.577786:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000400:00000200:7.0:1773851893.577786:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770085, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770084, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851893.577787:0:41091:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133323, 23133325]
00000400:00000200:8.0:1773851893.577788:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770085, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770084, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851893.577789:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 30@kfi7
00000400:00000200:7.0:1773851893.577789:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:28.0:1773851893.577790:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770086:8770086:1024:4294967295] 30@kfi7 LPNI seq info [23133326:23133326:16:4294967295]
00000400:00000200:8.0:1773851893.577790:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851893.577790:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851893.577791:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851893.577791:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851893.577792:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:8.0:1773851893.577792:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000400:00000200:7.0:1773851893.577792:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425174, 23425176]
00000400:00000200:28.0:1773851893.577793:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:8.0:1773851893.577793:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770087:8770087:1024:4294967295] 2060@kfi7 LPNI seq info [5404999:5404999:16:4294967295]
00000400:00000200:29.0:1773851893.577794:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:7.0:1773851893.577794:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2074@kfi7
00000400:00000200:29.0:1773851893.577795:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:8.0:1773851893.577795:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:7.0:1773851893.577795:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770088:8770088:1024:4294967295] 2074@kfi7 LPNI seq info [23425177:23425177:16:4294967295]
00000400:00000200:29.0:1773851893.577796:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:8.0:1773851893.577796:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:29.0:1773851893.577797:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:7.0:1773851893.577797:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:7.0:1773851893.577798:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.577799:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:8.0:1773851893.577799:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851893.577799:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:29.0:1773851893.577800:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770087, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770088, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851893.577800:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:6.0:1773851893.577800:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:6.0:1773851893.577801:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:6.0:1773851893.577802:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:29.0:1773851893.577803:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851893.577803:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851893.577803:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:6.0:1773851893.577803:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000400:00000200:29.0:1773851893.577804:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000800:00000200:8.0:1773851893.577804:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851893.577805:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770087, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770088, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851893.577806:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770089:8770089:1024:4294967295] 60@kfi7 LPNI seq info [5404314:5404314:16:4294967295]
00000800:00000200:8.0:1773851893.577806:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851893.577807:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:6.0:1773851893.577807:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851893.577808:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851893.577809:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:8.0:1773851893.577809:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Using peer 2060@kfi7(0x1c0)
00000400:00000200:6.0:1773851893.577809:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000400:00000200:6.0:1773851893.577811:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770090:8770090:1023:4294967295] 36@kfi7 LPNI seq info [5403972:5403972:16:4294967295]
00000400:00000200:29.0:1773851893.577812:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851893.577812:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x1c0: rc=0
00000400:00000200:6.0:1773851893.577812:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:11.0:1773851893.577813:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851893.577813:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851893.577813:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:29.0:1773851893.577814:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:11.0:1773851893.577814:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000800:00000200:29.0:1773851893.577815:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:8.0:1773851893.577815:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851893.577815:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:4.0:1773851893.577815:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000800:00000200:11.0:1773851893.577816:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851893.577816:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851893.577816:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851893.577816:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000800:00000200:29.0:1773851893.577817:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851893.577817:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851893.577817:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:11.0:1773851893.577818:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851893.577818:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:4.0:1773851893.577818:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000800:00000200:29.0:1773851893.577819:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851893.577819:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851893.577819:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000800:00000200:11.0:1773851893.577820:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851893.577820:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851893.577820:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:7.0:1773851893.577820:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000800:00000200:6.0:1773851893.577820:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:8.0:1773851893.577821:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:7.0:1773851893.577821:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:6.0:1773851893.577821:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851893.577821:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8770087, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8770090, p:4294967295, g:4294967295, h:1000]
00000800:00000200:29.0:1773851893.577822:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Using peer 60@kfi7(0x2000000000001dc)
00000100:00000001:8.0:1773851893.577822:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:11.0:1773851893.577823:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000800:00000200:7.0:1773851893.577823:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851893.577823:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:7.0:1773851893.577824:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851893.577824:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851893.577824:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851893.577824:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000800:00000200:29.0:1773851893.577826:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0x2000000000001dc: rc=0
00000800:00000200:9.0:1773851893.577826:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851893.577826:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577826:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851893.577826:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851893.577826:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770091:8770091:1022:4294967295] 2061@kfi7 LPNI seq info [5403465:5403465:16:4294967295]
00000800:00000200:11.0:1773851893.577827:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x1a3: rc=0
00000800:00000200:6.0:1773851893.577827:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000400:00000200:4.0:1773851893.577827:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:29.0:1773851893.577828:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851893.577828:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:4.0:1773851893.577828:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000800:00000200:11.0:1773851893.577829:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851893.577829:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000800:00000200:7.0:1773851893.577829:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e Using peer 2074@kfi7(0x20000000000097e)
00000100:00000001:29.0:1773851893.577830:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851893.577830:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c20ed36
00000800:00000200:6.0:1773851893.577830:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000235b3e16: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000100:00000001:29.0:1773851893.577831:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851893.577831:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577831:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577831:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000010:9.0:1773851893.577831:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c20ed36.
00000100:00000001:9.0:1773851893.577831:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:29.0:1773851893.577832:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577832:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851893.577832:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851893.577832:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851893.577832:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000100:00000001:29.0:1773851893.577833:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851893.577833:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 30@kfi7(13@kfi7:30@kfi7) <?> : PUT try# 0
00000100:00000001:11.0:1773851893.577833:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577833:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851893.577833:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:29.0:1773851893.577834:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851893.577834:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:7.0:1773851893.577834:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x20000000000097e: rc=0
00000100:00000001:6.0:1773851893.577834:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851893.577834:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:29.0:1773851893.577835:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851893.577835:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:28.0:1773851893.577835:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:11.0:1773851893.577835:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851893.577835:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851893.577835:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851893.577835:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851893.577835:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851893.577836:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577836:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851893.577836:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:9.0:1773851893.577836:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:7.0:1773851893.577836:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851893.577836:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851893.577836:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:29.0:1773851893.577837:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577837:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577837:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851893.577838:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.577838:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851893.577838:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:6.0:1773851893.577838:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:10.0:1773851893.577839:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851893.577839:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577839:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:9.0:1773851893.577840:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:7.0:1773851893.577840:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851893.577840:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577840:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851893.577840:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851893.577840:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851893.577840:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851893.577841:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:10.0:1773851893.577841:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851893.577841:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1c0 Transaction freed
00000100:00000001:7.0:1773851893.577841:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.577841:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851893.577841:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851893.577842:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851893.577842:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:28.0:1773851893.577843:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851893.577843:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:10.0:1773851893.577843:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000110e0a3f
00000100:00000001:7.0:1773851893.577843:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851893.577843:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:4.0:1773851893.577843:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Using peer 2061@kfi7(0x19b)
00000400:00000200:30.0:1773851893.577844:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:10.0:1773851893.577844:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000110e0a3f.
00000100:00000001:10.0:1773851893.577844:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:7.0:1773851893.577844:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851893.577844:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851893.577845:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000100:00000200:10.0:1773851893.577845:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851893.577845:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851893.577846:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8cfb79
00000800:00000200:28.0:1773851893.577846:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000010:30.0:1773851893.577847:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8cfb79.
00000100:00000001:30.0:1773851893.577848:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:10.0:1773851893.577848:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851893.577848:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851893.577849:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851893.577849:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000800:00000200:5.0:1773851893.577850:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000800:00000200:4.0:1773851893.577850:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x19b: rc=0
00000100:00000001:30.0:1773851893.577851:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:10.0:1773851893.577851:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851893.577851:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:6.0:1773851893.577851:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e TN_EVENT_TX_OK event status 0
00000100:00000040:30.0:1773851893.577852:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851893.577852:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x2000000000000fe: rc=0
00000400:00000200:6.0:1773851893.577852:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851893.577852:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851893.577852:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851893.577853:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:5.0:1773851893.577853:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:5.0:1773851893.577853:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c9c32447
00000100:00000001:30.0:1773851893.577854:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851893.577854:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:10.0:1773851893.577854:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000400:00000200:6.0:1773851893.577854:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000400:00000010:5.0:1773851893.577854:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c9c32447.
00000100:00000001:4.0:1773851893.577854:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.577855:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851893.577855:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
00000100:00000001:5.0:1773851893.577855:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:4.0:1773851893.577855:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851893.577855:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851893.577856:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:28.0:1773851893.577856:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851893.577856:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000100:00000001:6.0:1773851893.577856:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851893.577856:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851893.577856:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851893.577857:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:6.0:1773851893.577857:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851893.577858:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2054@kfi7:7 -> 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000001dc Transaction freed
00000100:00000001:28.0:1773851893.577858:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851893.577858:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851893.577858:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851893.577859:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851893.577859:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851893.577860:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851893.577860:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851893.577861:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851893.577862:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851893.577862:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851893.577862:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851893.577862:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:28.0:1773851893.577863:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851893.577863:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:7.0:1773851893.577863:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851893.577863:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577863:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851893.577864:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:5.0:1773851893.577864:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:17.0:1773851893.577865:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:5.0:1773851893.577865:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:17.0:1773851893.577866:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:7.0:1773851893.577866:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851893.577866:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2054@kfi7:1 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000097e Transaction freed
00000800:00000200:17.0:1773851893.577867:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851893.577867:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000800:00000200:29.0:1773851893.577868:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851893.577868:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851893.577868:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851893.577868:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000645e16b0
00000400:00000010:7.0:1773851893.577868:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000645e16b0.
00000100:00000001:7.0:1773851893.577869:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851893.577870:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851893.577870:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:7.0:1773851893.577870:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851893.577871:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000400:00000200:17.0:1773851893.577871:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:29.0:1773851893.577872:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f11aa4e7
00000100:00000001:7.0:1773851893.577872:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000010:29.0:1773851893.577873:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f11aa4e7.
00000400:00000200:17.0:1773851893.577873:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2060@kfi7 : PUT - for me
00000100:00000040:7.0:1773851893.577873:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851893.577874:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:17.0:1773851893.577874:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000200:29.0:1773851893.577875:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851893.577875:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:17.0:1773851893.577876:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.577876:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:7.0:1773851893.577876:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851893.577877:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:29.0:1773851893.577877:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:17.0:1773851893.577877:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000100:00000001:7.0:1773851893.577877:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:30.0:1773851893.577878:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:29.0:1773851893.577878:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851893.577878:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:7.0:1773851893.577878:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:30.0:1773851893.577879:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851893.577880:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6000
00000800:00000200:7.0:1773851893.577880:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 1 tta 0x19b Transaction freed
00000100:00000001:29.0:1773851893.577881:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851893.577881:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:18.0:1773851893.577881:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:17.0:1773851893.577881:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:30.0:1773851893.577882:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851893.577882:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:18.0:1773851893.577882:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851893.577882:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f2091 [1] + 224
00000800:00000200:18.0:1773851893.577883:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851893.577884:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000000fe Transaction freed
00000800:00000200:17.0:1773851893.577884:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851893.577885:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851893.577886:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851893.577887:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.577887:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2060@kfi7: PUT: OK
00000400:00000200:18.0:1773851893.577888:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000100:00000001:17.0:1773851893.577888:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851893.577889:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:18.0:1773851893.577889:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000200:17.0:1773851893.577889:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851893.577890:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000400:00000200:18.0:1773851893.577890:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:18.0:1773851893.577891:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:30.0:1773851893.577892:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:21.0:1773851893.577892:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:18.0:1773851893.577892:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000040:17.0:1773851893.577892:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851893.577893:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000800:00000200:21.0:1773851893.577893:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:18.0:1773851893.577893:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:30.0:1773851893.577894:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:29.0:1773851893.577894:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:21.0:1773851893.577894:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851893.577894:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:30.0:1773851893.577895:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000800:00000200:29.0:1773851893.577895:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:18.0:1773851893.577895:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6040
00000400:00000200:30.0:1773851893.577896:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000800:00000200:29.0:1773851893.577896:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851893.577896:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:17.0:1773851893.577896:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:30.0:1773851893.577897:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:21.0:1773851893.577897:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851893.577897:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f20b1 [1] + 224
00000100:00000001:8.0:1773851893.577898:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851893.577899:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5f40
00000800:00000200:29.0:1773851893.577899:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851893.577899:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:18.0:1773851893.577899:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851893.577899:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000001:8.0:1773851893.577899:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851893.577900:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000001:8.0:1773851893.577900:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851893.577900:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851893.577901:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851893.577901:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 60@kfi7 : PUT - for me
00000400:00000200:18.0:1773851893.577901:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851893.577901:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 2060@kfi7(00000000e32ff4e0):0x0 lsk 449 rsk 4790 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000010:8.0:1773851893.577901:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:30.0:1773851893.577902:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x780081b5d [1] + 224
00000400:00000200:29.0:1773851893.577902:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2074@kfi7 : PUT - for me
00000400:00000200:21.0:1773851893.577902:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:18.0:1773851893.577902:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:8.0:1773851893.577902:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc809cf6
00000400:00000200:29.0:1773851893.577903:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851893.577903:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000010:8.0:1773851893.577903:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc809cf6.
00000800:00000200:30.0:1773851893.577904:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851893.577904:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:18.0:1773851893.577904:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851893.577904:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851893.577905:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:21.0:1773851893.577905:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000200:18.0:1773851893.577905:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851893.577905:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851893.577906:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851893.577906:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851893.577906:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:30.0:1773851893.577907:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:29.0:1773851893.577907:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:30.0:1773851893.577908:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851893.577908:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000100:00000040:18.0:1773851893.577908:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851893.577908:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:30.0:1773851893.577909:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851893.577909:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:5.0:1773851893.577909:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:29.0:1773851893.577910:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6080
00000400:00000200:21.0:1773851893.577910:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:8.0:1773851893.577910:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:5.0:1773851893.577910:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851893.577911:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:21.0:1773851893.577911:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5fc0
00000100:00000001:8.0:1773851893.577911:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.577911:0:41068:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:5.0:1773851893.577911:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:30.0:1773851893.577912:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851893.577912:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x780081b7d [1] + 224
00000400:00000200:21.0:1773851893.577912:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:18.0:1773851893.577912:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:8.0:1773851893.577912:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851893.577912:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:18.0:1773851893.577913:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:8.0:1773851893.577913:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851893.577913:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851893.577914:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:21.0:1773851893.577914:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d1cb5 [1] + 224
00000100:00001000:8.0:1773851893.577914:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=126 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851893.577914:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:5.0:1773851893.577914:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:31.0:1773851893.577915:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851893.577915:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851893.577915:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00001000:8.0:1773851893.577915:0:41068:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=126 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851893.577915:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851893.577916:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:21.0:1773851893.577916:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:8.0:1773851893.577916:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000001:6.0:1773851893.577916:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851893.577916:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851893.577916:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000800:00000200:31.0:1773851893.577917:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851893.577917:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:29.0:1773851893.577917:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851893.577917:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851893.577917:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851893.577917:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851893.577917:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:5.0:1773851893.577917:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:29.0:1773851893.577918:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000400:00000200:21.0:1773851893.577918:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851893.577918:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851893.577918:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851893.577918:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:6.0:1773851893.577918:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f75391c
00000400:00000010:6.0:1773851893.577918:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f75391c.
00000400:00000200:5.0:1773851893.577918:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000800:00000200:31.0:1773851893.577919:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:29.0:1773851893.577919:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851893.577919:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->60@kfi7: PUT: OK
00000400:00000001:11.0:1773851893.577919:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:8.0:1773851893.577919:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000001:8.0:1773851893.577919:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851893.577919:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851893.577919:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000800:00000200:30.0:1773851893.577920:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000200:29.0:1773851893.577920:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851893.577920:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:11.0:1773851893.577920:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:8.0:1773851893.577920:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851893.577920:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000010:11.0:1773851893.577921:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000400:00000200:11.0:1773851893.577921:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2b33615
00000100:00000040:8.0:1773851893.577921:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:6.0:1773851893.577921:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851893.577922:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000200:21.0:1773851893.577922:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:11.0:1773851893.577922:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2b33615.
00000400:00000200:5.0:1773851893.577922:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:31.0:1773851893.577923:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2061@kfi7 : PUT - for me
00000100:00000001:11.0:1773851893.577923:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851893.577923:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851893.577923:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:31.0:1773851893.577924:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:29.0:1773851893.577924:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:11.0:1773851893.577924:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.577924:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851893.577924:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:6.0:1773851893.577924:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851893.577924:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:31.0:1773851893.577925:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000100:00000040:21.0:1773851893.577925:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:8.0:1773851893.577925:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:5.0:1773851893.577925:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b5f80
00000004:00000040:8.0:1773851893.577926:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851893.577926:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504314368 avail=351502162944 avail_mb=1373055324 hwm_mb=3131103 files=372056119 ffree=343265932 state=0: rc = 0
00000100:00000001:6.0:1773851893.577926:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:31.0:1773851893.577927:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000200:11.0:1773851893.577927:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851893.577927:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851893.577927:0:41065:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:5.0:1773851893.577927:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:31.0:1773851893.577928:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000001:29.0:1773851893.577928:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000020:8.0:1773851893.577928:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504314368 free, 351502162944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056119 files, 343265932 free files
02000000:00000001:6.0:1773851893.577928:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851893.577928:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:5.0:1773851893.577928:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d1c95 [1] + 224
00000400:00000200:31.0:1773851893.577929:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:21.0:1773851893.577929:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851893.577929:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851893.577929:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851893.577929:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851893.577930:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:11.0:1773851893.577930:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851893.577930:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000001:8.0:1773851893.577930:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.577930:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851893.577930:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:6.0:1773851893.577930:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851893.577931:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:11.0:1773851893.577931:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851893.577931:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851893.577931:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:7.0:1773851893.577931:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00001000:6.0:1773851893.577931:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=126 v=66 (66 66 66 66)
00000800:00000200:5.0:1773851893.577931:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851893.577932:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:30.0:1773851893.577932:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851893.577932:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851893.577932:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 60@kfi7(00000000030c766a):0x0 lsk 477 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851893.577932:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:7.0:1773851893.577932:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:6.0:1773851893.577932:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=126 v=66 (1 1 1 1)
00000400:00000200:5.0:1773851893.577932:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851893.577933:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b60c0
00000400:00000001:30.0:1773851893.577933:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:29.0:1773851893.577933:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00001000:11.0:1773851893.577933:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=126 v=66 (66 66 66 66)
00000400:00000010:7.0:1773851893.577933:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851893.577933:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000100:00000001:6.0:1773851893.577933:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851893.577933:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851893.577933:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000400:00000200:31.0:1773851893.577934:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000001:30.0:1773851893.577934:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:11.0:1773851893.577934:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=126 v=66 (1 1 1 1)
00000100:00100000:8.0:1773851893.577934:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000273570b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051938816:2060@kfi7:13:default-yuba2-0
00000400:00000010:7.0:1773851893.577934:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00010000:00000001:6.0:1773851893.577934:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000010:30.0:1773851893.577935:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000843b5aa4.
00000400:00000200:30.0:1773851893.577935:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ecffec9b
00000100:00000001:11.0:1773851893.577935:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:11.0:1773851893.577935:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577935:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851893.577935:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:6.0:1773851893.577935:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851893.577936:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x780081bdd [1] + 224
00000400:00000010:30.0:1773851893.577936:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ecffec9b.
00010000:00000001:11.0:1773851893.577936:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:11.0:1773851893.577936:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577936:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:7.0:1773851893.577936:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851893.577936:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851893.577936:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:30.0:1773851893.577937:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851893.577937:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:11.0:1773851893.577937:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000100:00000040:8.0:1773851893.577937:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000273570b x1859433051938816/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851893.577937:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851893.577937:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851893.577937:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:30.0:1773851893.577938:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851893.577938:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851893.577938:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851893.577938:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:31.0:1773851893.577939:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:11.0:1773851893.577939:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.577939:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:7.0:1773851893.577939:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851893.577939:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851893.577940:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:8.0:1773851893.577940:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000200:30.0:1773851893.577941:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:8.0:1773851893.577941:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000098c0e011.
00000100:00000001:6.0:1773851893.577941:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:31.0:1773851893.577942:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2061@kfi7: PUT: OK
00000100:00000001:11.0:1773851893.577942:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:8.0:1773851893.577942:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851893.577942:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:7.0:1773851893.577942:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851893.577942:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851893.577942:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851893.577942:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:5.0:1773851893.577942:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851893.577943:0:2465875:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:11.0:1773851893.577943:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851893.577943:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:8.0:1773851893.577943:0:41068:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000100:00000001:7.0:1773851893.577943:0:41064:0:(client.c:1428:after_reply()) Process entered
00000004:00000001:6.0:1773851893.577943:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:31.0:1773851893.577944:0:2465875:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851893.577944:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851893.577944:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:11.0:1773851893.577944:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:11.0:1773851893.577944:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000020:00000001:8.0:1773851893.577944:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851893.577944:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
02000000:00000001:7.0:1773851893.577944:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851893.577944:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000040:6.0:1773851893.577944:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000100:00000001:30.0:1773851893.577945:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851893.577945:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000040:11.0:1773851893.577945:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690095616 avail=351687687168 avail_mb=1373780028 hwm_mb=3131103 files=372231121 ffree=343447359 state=0: rc = 0
02000000:00000001:8.0:1773851893.577945:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851893.577945:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:7.0:1773851893.577945:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:6.0:1773851893.577945:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500129280 avail=351498067968 avail_mb=1373039328 hwm_mb=3131103 files=372097665 ffree=343261845 state=0: rc = 0
00000100:00000001:30.0:1773851893.577946:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000010:8.0:1773851893.577946:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000273570b.
02000000:00000001:7.0:1773851893.577946:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851893.577946:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=126 v=66 (66 66 66 66)
00000100:00000001:5.0:1773851893.577946:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:31.0:1773851893.577947:0:2465875:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851893.577947:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851893.577947:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851893.577947:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000020:11.0:1773851893.577947:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690095616 free, 351687687168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231121 files, 343447359 free files
00000100:00000001:8.0:1773851893.577947:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851893.577947:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:7.0:1773851893.577947:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=126 v=66 (1 1 1 1)
00000004:00000020:6.0:1773851893.577947:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500129280 free, 351498067968 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097665 files, 343261845 free files
00000400:00000200:5.0:1773851893.577947:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00001000:30.0:1773851893.577948:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=126 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851893.577948:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851893.577948:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.577948:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851893.577948:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:6.0:1773851893.577948:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851893.577948:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:28.0:1773851893.577949:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851893.577949:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000001:11.0:1773851893.577949:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577949:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.577949:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851893.577949:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851893.577950:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=126 v=66 (1 1 1 1)
00000400:00000010:28.0:1773851893.577950:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000040:11.0:1773851893.577950:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851893.577950:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851893.577950:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851893.577950:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851893.577950:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851893.577951:0:2465875:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851893.577951:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851893.577951:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851893.577951:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f52a267c
00000400:00000010:28.0:1773851893.577951:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f52a267c.
00000100:00000001:7.0:1773851893.577951:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851893.577951:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000400:00000200:31.0:1773851893.577952:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00010000:00000001:30.0:1773851893.577952:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851893.577952:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851893.577952:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851893.577952:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851893.577952:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005ae5d597 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051938880:36@kfi7:13:default-yuba2-0
00010000:00000001:30.0:1773851893.577953:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851893.577953:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:11.0:1773851893.577953:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051938624:37@kfi7:13:default-yuba2-0
00000100:00000040:7.0:1773851893.577953:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851893.577953:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851893.577953:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:31.0:1773851893.577954:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003c4a6e41: 2069@kfi7:7 <- 2061@kfi7(00000000fee2c94c):0x0 lsk 412 rsk 4790 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851893.577954:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851893.577954:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000100:00000001:11.0:1773851893.577954:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851893.577954:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000001:4.0:1773851893.577954:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:30.0:1773851893.577955:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851893.577955:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577955:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851893.577955:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000001:4.0:1773851893.577955:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:30.0:1773851893.577956:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:28.0:1773851893.577956:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:11.0:1773851893.577956:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000037d69b00 x1859433051938624/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851893.577956:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:6.0:1773851893.577956:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005ae5d597 x1859433051938880/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:4.0:1773851893.577956:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851893.577956:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5f4f73
00000100:00000001:7.0:1773851893.577957:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851893.577957:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:4.0:1773851893.577957:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5f4f73.
00000100:00000001:30.0:1773851893.577958:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851893.577958:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851893.577958:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851893.577958:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:11.0:1773851893.577958:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:7.0:1773851893.577958:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851893.577958:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:30.0:1773851893.577959:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851893.577959:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851893.577959:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000010:11.0:1773851893.577959:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000042acc974.
00000004:00000020:7.0:1773851893.577959:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223648 blocks, 31250856704 free, 31250833920 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121343 files, 2868730986 free files
00000100:00000001:6.0:1773851893.577959:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851893.577959:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000200:4.0:1773851893.577959:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851893.577960:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851893.577960:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851893.577960:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851893.577960:0:41071:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:6.0:1773851893.577960:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001c35e9b8.
00000100:00000001:30.0:1773851893.577961:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:28.0:1773851893.577961:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:11.0:1773851893.577961:0:41071:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000020:00000001:11.0:1773851893.577961:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851893.577961:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006db6fddb.
00000004:00000001:7.0:1773851893.577961:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851893.577961:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851893.577961:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000001:30.0:1773851893.577962:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851893.577962:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000100:00001000:28.0:1773851893.577962:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=126 v=66 (66 66 66 66)
02000000:00000001:11.0:1773851893.577962:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:7.0:1773851893.577962:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:6.0:1773851893.577962:0:41065:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000020:00000001:6.0:1773851893.577962:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000200:4.0:1773851893.577962:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:30.0:1773851893.577963:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351175168 avail=351348398080 avail_mb=1372454680 hwm_mb=3131103 files=372083944 ffree=343116382 state=0: rc = 0
00000100:00001000:28.0:1773851893.577963:0:41091:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=126 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851893.577963:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:11.0:1773851893.577963:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851893.577963:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037d69b00.
02000000:00000010:6.0:1773851893.577963:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000075c954ba.
00000100:00000001:28.0:1773851893.577964:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:28.0:1773851893.577964:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:11.0:1773851893.577964:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851893.577964:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:6.0:1773851893.577964:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:4.0:1773851893.577964:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000020:30.0:1773851893.577965:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351175168 free, 351348398080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372083944 files, 343116382 free files
00010000:00000001:28.0:1773851893.577965:0:41091:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577965:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851893.577965:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:6.0:1773851893.577965:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851893.577965:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005ae5d597.
00000100:00000001:4.0:1773851893.577965:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851893.577966:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851893.577966:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000100:00000001:11.0:1773851893.577966:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851893.577966:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851893.577966:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577966:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851893.577966:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851893.577966:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000001:30.0:1773851893.577967:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851893.577967:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851893.577967:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851893.577967:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051938944:2074@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851893.577967:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851893.577967:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851893.577967:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851893.577967:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.577968:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851893.577968:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851893.577968:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:4.0:1773851893.577968:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.577969:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851893.577969:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851893.577969:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:4.0:1773851893.577969:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=126 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851893.577970:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851893.577970:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851893.577970:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851893.577970:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=126 v=66 (1 1 1 1)
00000100:00100000:30.0:1773851893.577971:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000055bd4bee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051938752:60@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851893.577971:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851893.577971:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851893.577971:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ed033681 x1859433051938944/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851893.577971:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851893.577972:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851893.577972:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851893.577972:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851893.577972:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851893.577973:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000020:28.0:1773851893.577973:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735097024 blocks, 31192442400 free, 31192399072 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238606 files, 2962368186 free files
00000100:00000001:7.0:1773851893.577973:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00010000:00000001:4.0:1773851893.577973:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.577974:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000055bd4bee x1859433051938752/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851893.577974:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851893.577974:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006f21a4d8.
00000100:00000001:4.0:1773851893.577974:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851893.577974:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000004:00000001:28.0:1773851893.577975:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851893.577975:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:30.0:1773851893.577976:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:28.0:1773851893.577976:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851893.577976:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851893.577976:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851893.577976:0:41064:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000100:00000001:4.0:1773851893.577976:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851893.577977:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851893.577977:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000077b2db51.
00000020:00000001:7.0:1773851893.577977:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851893.577977:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e26c1bf7.
00000100:00000040:4.0:1773851893.577977:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851893.577978:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851893.577979:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851893.577979:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851893.577979:0:41088:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00100000:28.0:1773851893.577979:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085ab5bae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051938688:13@kfi7:41:default-yuba2-0
02000000:00000001:7.0:1773851893.577979:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851893.577979:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed033681.
00000100:00000001:4.0:1773851893.577979:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000001:30.0:1773851893.577980:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851893.577980:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851893.577980:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851893.577980:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000010:30.0:1773851893.577981:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003ff69e5e.
00000100:00000001:28.0:1773851893.577981:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851893.577981:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851893.577981:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851893.577981:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851893.577981:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:30.0:1773851893.577982:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:28.0:1773851893.577982:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000085ab5bae x1859433051938688/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851893.577982:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851893.577982:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.577982:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000040:4.0:1773851893.577982:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
02000000:00000001:30.0:1773851893.577983:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851893.577983:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000055bd4bee.
00000100:00000001:7.0:1773851893.577983:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:4.0:1773851893.577983:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399725568 free=351492738048 avail=351490311168 avail_mb=1373009028 hwm_mb=3131103 files=372077981 ffree=343254627 state=0: rc = 0
00000100:00000001:30.0:1773851893.577984:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851893.577984:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:30.0:1773851893.577985:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.577985:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:28.0:1773851893.577985:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851893.577985:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006d31c239.
00000004:00000020:4.0:1773851893.577985:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399725568 blocks, 351492738048 free, 351490311168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372077981 files, 343254627 free files
00000100:00000001:30.0:1773851893.577986:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:28.0:1773851893.577986:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000001:4.0:1773851893.577986:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.577987:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.577987:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000001:28.0:1773851893.577987:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851893.577987:0:41091:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000040:4.0:1773851893.577987:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851893.577988:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851893.577988:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851893.577988:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ce3b9347.
02000000:00000001:28.0:1773851893.577989:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851893.577989:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851893.577990:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000085ab5bae.
00000100:00100000:4.0:1773851893.577990:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019216c95 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051939008:2061@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851893.577991:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851893.577991:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851893.577991:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851893.577992:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851893.577992:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851893.577992:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851893.577992:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851893.577993:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851893.577993:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851893.577993:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000019216c95 x1859433051939008/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852046 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851893.577995:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851893.577996:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851893.577997:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e54f7a48.
02000000:00000001:4.0:1773851893.577998:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851893.577998:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851893.577999:0:41067:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000020:00000001:4.0:1773851893.578000:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851893.578000:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e7717c48.
02000000:00000001:4.0:1773851893.578001:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851893.578001:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851893.578002:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019216c95.
00000100:00000001:4.0:1773851893.578003:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851893.578004:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851893.578005:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851893.578006:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851893.578006:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851893.578007:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851893.578007:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851893.582419:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851893.582419:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851893.582420:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851893.582420:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851893.582421:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851893.582421:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851893.582423:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11680@kfi7(0000000049301422):0xd2a version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851893.582424:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851893.582425:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a Using peer 11680@kfi7(0xd2a)
00000400:00000200:6.0:1773851893.582426:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11680@kfi7 to cpt 1
00000400:00000200:6.0:1773851893.582427:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11680@kfi7 : PUT - for me
00000400:00000200:5.0:1773851893.582427:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11680@kfi7 to cpt 1
00000400:00000200:6.0:1773851893.582428:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11680@kfi7 to cpt 1
00000400:00000200:6.0:1773851893.582429:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000941b9b13 nid 11680@kfi7 refs 1
00000800:00000200:5.0:1773851893.582429:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 38 bytes to peer 0xd2a: rc=0
00000400:00000200:6.0:1773851893.582430:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11680@kfi7 to cpt 1
00000800:00000200:5.0:1773851893.582430:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851893.582431:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000941b9b13 nid 11680@kfi7 refs 2
00000400:00000200:6.0:1773851893.582432:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000941b9b13 nid 11680@kfi7 refs 3
00000400:00000200:6.0:1773851893.582433:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11681@kfi7 to cpt 4
00000400:00000200:6.0:1773851893.582434:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11681@kfi7 of length 224 into portal 12 MB=0x699e0d24e1740
00000400:00000200:6.0:1773851893.582436:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11681@kfi7 of length 224/224 into md 0x793926dc5 [64] + 161952
00000800:00000200:6.0:1773851893.582438:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851893.582439:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851893.582441:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11680@kfi7: PUT: OK
00000100:00000001:6.0:1773851893.582442:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851893.582442:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:5.0:1773851893.582442:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a TN_EVENT_TX_OK event status 0
00000100:00000010:6.0:1773851893.582443:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005ae5d597.
00000100:00000040:6.0:1773851893.582444:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000005ae5d597 x1858040740321088 msgsize 224
00000100:00100000:6.0:1773851893.582445:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-11681@kfi7 (source: 12345-11680@kfi7)
00000800:00000200:5.0:1773851893.582445:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a Transaction freed
00000100:00000001:6.0:1773851893.582447:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851893.582448:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851893.582448:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000941b9b13 nid 11680@kfi7 refs 2
02000000:00000001:7.0:1773851893.582449:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851893.582449:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851893.582449:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851893.582450:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851893.582450:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851893.582451:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040740321088
00000020:00000001:7.0:1773851893.582452:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851893.582452:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91896
00000020:00000001:7.0:1773851893.582453:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851893.582454:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ea1a88b8 refcount=6
00000020:00000001:7.0:1773851893.582455:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241991168 : -107152467560448 : ffff9e8b9f3bf800)
00000020:00000001:7.0:1773851893.582456:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241991168 : -107152467560448 : ffff9e8b9f3bf800)
00000100:00000001:7.0:1773851893.582458:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851893.582458:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851893.582459:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004638b300.
00000020:00000010:7.0:1773851893.582460:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851893.582461:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851893.582462:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851893.582462:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851893.582463:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851893.582464:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851893.582464:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851893.582465:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.582466:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851893.582467:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851893.582467:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851893.582468:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851893.582468:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851893.582469:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11681@kfi7, seq: 2001984
00000100:00000040:7.0:1773851893.582469:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ea1a88b8 : new rpc_count 1
00000100:00000001:4.0:1773851893.582469:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.582470:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636971814073856 : -107101895477760 : ffff9e976590b600)
00000100:00000001:4.0:1773851893.582470:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851893.582471:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005ae5d597 x1858040740321088/t0(0) o400->d379063c-85d7-4db6-a2ab-a5dc3c94b70e@11681@kfi7:620/0 lens 224/0 e 0 to 0 dl 1773851980 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1216-0'
00000100:00000001:7.0:1773851893.582474:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851893.582474:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851893.582476:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005ae5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:d379063c-85d7-4db6-a2ab-a5dc3c94b70e+6:39652:x1858040740321088:12345-11681@kfi7:400:default-tuolumne1216-0
00000100:00000200:7.0:1773851893.582477:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040740321088
00000020:00000001:7.0:1773851893.582478:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851893.582478:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851893.582479:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.582479:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851893.582480:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851893.582481:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851893.582481:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040740321088, found 0 last_xid 1858040740321087
00000020:00000001:7.0:1773851893.582482:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851893.582483:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851893.582484:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851893.582484:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.582485:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851893.582486:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851893.582486:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851893.582487:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000951fdc9f.
02000000:00000001:7.0:1773851893.582488:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.582489:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.582490:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851893.582490:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035343917, transno 0, xid 1858040740321088
00010000:00000001:7.0:1773851893.582491:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851893.582492:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005ae5d597 x1858040740321088/t0(0) o400->d379063c-85d7-4db6-a2ab-a5dc3c94b70e@11681@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1216-0'
00010000:00000001:7.0:1773851893.582494:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851893.582495:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851893.582495:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=125 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851893.582496:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851893.582497:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d05998f0 refcount 3 to 11681@kfi7
00000100:00000001:7.0:1773851893.582498:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583515744 : -107156126035872 : ffff9e8ac52c1060)
02000000:00000001:7.0:1773851893.582499:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851893.582499:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.582500:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851893.582501:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11680@kfi7
00000400:00000010:7.0:1773851893.582501:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000100:00000200:7.0:1773851893.582502:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040740321088, offset 224
00000400:00000200:7.0:1773851893.582503:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11680@kfi7
00000400:00000200:7.0:1773851893.582504:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11680@kfi7 to cpt 1
00000400:00000200:7.0:1773851893.582505:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000941b9b13 nid 11680@kfi7 refs 1
00000400:00000200:7.0:1773851893.582506:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000941b9b13 nid 11680@kfi7 refs 2
00000400:00000200:7.0:1773851893.582507:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000941b9b13 nid 11680@kfi7 refs 3
00000400:00000200:7.0:1773851893.582508:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11680@kfi7 local destination
00000400:00000200:7.0:1773851893.582509:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770092:8770092:1024:4294967295] 11680@kfi7 LPNI seq info [662526:662526:16:4294967295]
00000400:00000200:7.0:1773851893.582511:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000941b9b13 nid 11680@kfi7 refs 2
00000400:00000200:7.0:1773851893.582512:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11680@kfi7 to cpt 1
00000400:00000200:7.0:1773851893.582514:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11680@kfi7(11680@kfi7:11680@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851893.582515:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000941b9b13 nid 11680@kfi7 refs 3
00000800:00000200:7.0:1773851893.582516:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851893.582517:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851893.582520:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851893.582522:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a Using peer 11680@kfi7(0xd2a)
00000800:00000200:7.0:1773851893.582525:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0xd2a: rc=0
00000800:00000200:7.0:1773851893.582526:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851893.582528:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851893.582529:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d05998f0 refcount 2 to 11681@kfi7
00010000:00000001:7.0:1773851893.582530:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851893.582530:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.582531:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851893.582531:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005ae5d597 x1858040740321088/t0(0) o400->d379063c-85d7-4db6-a2ab-a5dc3c94b70e@11681@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1216-0'
00000100:00100000:7.0:1773851893.582534:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005ae5d597 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:d379063c-85d7-4db6-a2ab-a5dc3c94b70e+6:39652:x1858040740321088:12345-11681@kfi7:400:default-tuolumne1216-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851893.582537:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11681@kfi7, seq: 2001984
00000800:00000200:5.0:1773851893.582537:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851893.582538:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ea1a88b8 : new rpc_count 0
00000100:00000001:7.0:1773851893.582538:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851893.582539:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851893.582539:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851893.582540:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851893.582540:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:5.0:1773851893.582540:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11680@kfi7: PUT: OK
00000020:00000010:7.0:1773851893.582541:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004638b300.
00000400:00000200:5.0:1773851893.582541:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000400:00000010:5.0:1773851893.582541:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000020:00000040:7.0:1773851893.582542:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000ea1a88b8 : new refcount 5
00000100:00000001:7.0:1773851893.582542:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851893.582542:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851893.582542:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851893.582543:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000941b9b13 nid 11680@kfi7 refs 2
00000800:00000200:5.0:1773851893.582545:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 11680@kfi7(0000000049301422):0x0 lsk 3371 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0xd2a Transaction freed
00000800:00000200:29.0:1773851893.600018:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851893.600019:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851893.600021:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851893.600025:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851893.600028:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600030:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25851@kfi7 : PUT - for me
00000400:00000200:29.0:1773851893.600032:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600034:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 1
00000400:00000200:29.0:1773851893.600035:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600037:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000400:00000200:29.0:1773851893.600038:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 3
00000400:00000200:29.0:1773851893.600040:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600041:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25851@kfi7 of length 224 into portal 12 MB=0x699de7f15b540
00000400:00000200:29.0:1773851893.600043:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25851@kfi7 of length 224/224 into md 0x77fe1859d [64] + 5672
00000800:00000200:29.0:1773851893.600046:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851893.600063:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851893.600064:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25851@kfi7: PUT: OK
00000100:00000001:29.0:1773851893.600066:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851893.600067:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851893.600068:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f64deb1e.
00000100:00000040:29.0:1773851893.600069:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f64deb1e x1858030754182464 msgsize 224
00000100:00100000:29.0:1773851893.600072:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25851@kfi7 (source: 12345-25851@kfi7)
00000100:00000001:29.0:1773851893.600073:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851893.600075:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000100:00000001:30.0:1773851893.600076:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851893.600077:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:30.0:1773851893.600078:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851893.600079:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851893.600080:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851893.600081:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851893.600082:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030754182464
00000020:00000001:30.0:1773851893.600083:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851893.600084:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910a8
00000020:00000001:30.0:1773851893.600085:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851893.600090:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000023f84825 refcount=6
00000020:00000001:30.0:1773851893.600091:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240348672 : -107152469202944 : ffff9e8b9f22e800)
00000020:00000001:30.0:1773851893.600092:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240348672 : -107152469202944 : ffff9e8b9f22e800)
00000100:00000001:30.0:1773851893.600094:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.600095:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851893.600096:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006392c63e.
00000020:00000010:30.0:1773851893.600098:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.600099:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000818b6cb1.
00000100:00000001:30.0:1773851893.600101:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851893.600101:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851893.600102:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.600104:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851893.600105:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851893.600105:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.600107:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.600109:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851893.600110:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851893.600110:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851893.600110:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851893.600111:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25851@kfi7, seq: 2055585
00000100:00000001:31.0:1773851893.600113:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.600113:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000023f84825 : new rpc_count 1
00000100:00000001:31.0:1773851893.600114:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.600114:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262236288 : -106943447315328 : ffff9ebc49cfcc80)
00000100:00000040:30.0:1773851893.600116:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f64deb1e x1858030754182464/t0(0) o400->2e177b91-c1ea-4ec8-a01d-a1c28f8dee0e@25851@kfi7:681/0 lens 224/0 e 0 to 0 dl 1773852041 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne269-0'
00000100:00000001:30.0:1773851893.600120:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.600121:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851893.600123:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f64deb1e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:2e177b91-c1ea-4ec8-a01d-a1c28f8dee0e+6:47708:x1858030754182464:12345-25851@kfi7:400:default-tuolumne269-0
00000100:00000200:30.0:1773851893.600127:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030754182464
00000020:00000001:30.0:1773851893.600128:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851893.600129:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851893.600130:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600132:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851893.600132:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851893.600134:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851893.600135:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030754182464, found 0 last_xid 1858030754182463
00000020:00000001:30.0:1773851893.600136:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851893.600137:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851893.600138:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851893.600139:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600140:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851893.600141:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851893.600142:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851893.600143:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000423d54ff.
02000000:00000001:30.0:1773851893.600144:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.600145:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600146:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851893.600147:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030754182464
00010000:00000001:30.0:1773851893.600149:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851893.600150:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f64deb1e x1858030754182464/t0(0) o400->2e177b91-c1ea-4ec8-a01d-a1c28f8dee0e@25851@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne269-0'
00010000:00000001:30.0:1773851893.600155:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851893.600155:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851893.600156:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=126 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851893.600158:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851893.600159:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ddb60a69 refcount 5 to 25851@kfi7
00000100:00000001:30.0:1773851893.600161:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212864 : -107155106338752 : ffff9e8b01f36840)
02000000:00000001:30.0:1773851893.600162:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851893.600163:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.600164:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851893.600165:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25851@kfi7
00000400:00000010:30.0:1773851893.600166:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003651c096.
00000100:00000200:30.0:1773851893.600168:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030754182464, offset 224
00000400:00000200:30.0:1773851893.600170:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25851@kfi7
00000400:00000200:30.0:1773851893.600172:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.600173:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 1
00000400:00000200:30.0:1773851893.600174:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000400:00000200:30.0:1773851893.600176:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 3
00000400:00000200:30.0:1773851893.600178:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25851@kfi7 local destination
00000400:00000200:30.0:1773851893.600180:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770093:8770093:1024:4294967295] 25851@kfi7 LPNI seq info [24411:24411:16:4294967295]
00000400:00000200:30.0:1773851893.600183:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000400:00000200:30.0:1773851893.600184:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.600187:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25851@kfi7(25851@kfi7:25851@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851893.600190:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 3
00000800:00000200:30.0:1773851893.600192:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851893.600193:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851893.600197:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851893.600201:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001cd Using peer 25851@kfi7(0x1000000000001cd)
00000800:00000200:30.0:1773851893.600206:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000b68a0a1e: Posted send of 324 bytes to peer 0x1000000000001cd: rc=0
00000800:00000200:30.0:1773851893.600208:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001cd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851893.600212:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.600213:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ddb60a69 refcount 4 to 25851@kfi7
00010000:00000001:30.0:1773851893.600214:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851893.600215:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600216:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851893.600217:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f64deb1e x1858030754182464/t0(0) o400->2e177b91-c1ea-4ec8-a01d-a1c28f8dee0e@25851@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne269-0'
00000100:00100000:30.0:1773851893.600223:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f64deb1e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:2e177b91-c1ea-4ec8-a01d-a1c28f8dee0e+6:47708:x1858030754182464:12345-25851@kfi7:400:default-tuolumne269-0 Request processed in 101us (152us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851893.600223:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001cd TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851893.600225:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:30.0:1773851893.600227:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25851@kfi7, seq: 2055585
00000400:00000200:29.0:1773851893.600227:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25851@kfi7: PUT: OK
00000100:00000040:30.0:1773851893.600229:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000023f84825 : new rpc_count 0
00000400:00000200:29.0:1773851893.600229:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003651c096
00000400:00000010:29.0:1773851893.600229:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003651c096.
00000100:00000001:30.0:1773851893.600230:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851893.600231:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:29.0:1773851893.600231:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851893.600231:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:30.0:1773851893.600232:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.600233:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000818b6cb1.
00000400:00000200:29.0:1773851893.600233:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000020:00000010:30.0:1773851893.600234:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006392c63e.
00000800:00000200:29.0:1773851893.600235:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 25851@kfi7(00000000f27d32e4):0x0 lsk 462 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001cd Transaction freed
00000020:00000040:30.0:1773851893.600236:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000023f84825 : new refcount 5
00000100:00000001:30.0:1773851893.600237:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851893.600787:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851893.600787:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851893.600789:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851893.600790:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851893.600792:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600793:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25851@kfi7 : PUT - for me
00000400:00000200:29.0:1773851893.600794:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600795:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 1
00000400:00000200:29.0:1773851893.600796:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600797:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000400:00000200:29.0:1773851893.600798:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 3
00000400:00000200:29.0:1773851893.600799:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.600800:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25851@kfi7 of length 224 into portal 12 MB=0x699de7f15bdc0
00000400:00000200:29.0:1773851893.600801:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25851@kfi7 of length 224/224 into md 0x77fe1859d [64] + 5896
00000800:00000200:29.0:1773851893.600802:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851893.600804:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851893.600805:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25851@kfi7: PUT: OK
00000100:00000001:29.0:1773851893.600806:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851893.600806:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851893.600807:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006b31d744.
00000100:00000040:29.0:1773851893.600808:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000006b31d744 x1858030754184640 msgsize 224
00000100:00100000:29.0:1773851893.600809:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25851@kfi7 (source: 12345-25851@kfi7)
00000100:00000001:29.0:1773851893.600810:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:30.0:1773851893.600811:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851893.600811:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
02000000:00000001:30.0:1773851893.600812:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851893.600812:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851893.600812:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851893.600812:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:30.0:1773851893.600813:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851893.600814:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030754184640
00000020:00000001:30.0:1773851893.600814:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851893.600814:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91222
00000020:00000001:30.0:1773851893.600815:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851893.600818:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d55e634c refcount=6
00000020:00000001:30.0:1773851893.600819:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240542208 : -107152469009408 : ffff9e8b9f25dc00)
00000020:00000001:30.0:1773851893.600819:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240542208 : -107152469009408 : ffff9e8b9f25dc00)
00000100:00000001:30.0:1773851893.600820:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.600821:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851893.600821:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006392c63e.
00000020:00000010:30.0:1773851893.600822:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.600823:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000818b6cb1.
00000100:00000001:30.0:1773851893.600824:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851893.600824:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851893.600824:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.600825:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851893.600825:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851893.600826:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.600826:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851893.600828:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851893.600828:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851893.600828:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851893.600828:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851893.600829:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25851@kfi7, seq: 2055586
00000100:00000001:31.0:1773851893.600830:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851893.600830:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.600830:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d55e634c : new rpc_count 1
00000100:00000001:30.0:1773851893.600830:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262220160 : -106943447331456 : ffff9ebc49cf8d80)
00000100:00000040:30.0:1773851893.600831:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006b31d744 x1858030754184640/t0(0) o400->b2736900-c613-47c9-a91b-a9327caccab9@25851@kfi7:681/0 lens 224/0 e 0 to 0 dl 1773852041 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne269-0'
00000100:00000001:30.0:1773851893.600834:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.600834:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851893.600835:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006b31d744 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:b2736900-c613-47c9-a91b-a9327caccab9+6:47710:x1858030754184640:12345-25851@kfi7:400:default-tuolumne269-0
00000100:00000200:30.0:1773851893.600836:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030754184640
00000020:00000001:30.0:1773851893.600837:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851893.600837:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851893.600838:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600839:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851893.600839:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851893.600840:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851893.600840:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030754184640, found 0 last_xid 1858030754184639
00000020:00000001:30.0:1773851893.600841:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851893.600841:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851893.600842:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851893.600842:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600843:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851893.600843:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851893.600843:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851893.600844:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aae44987.
02000000:00000001:30.0:1773851893.600844:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.600845:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600845:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851893.600846:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768335, transno 0, xid 1858030754184640
00010000:00000001:30.0:1773851893.600847:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851893.600847:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006b31d744 x1858030754184640/t0(0) o400->b2736900-c613-47c9-a91b-a9327caccab9@25851@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne269-0'
00010000:00000001:30.0:1773851893.600852:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851893.600853:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851893.600853:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=126 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851893.600854:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851893.600855:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ddb60a69 refcount 5 to 25851@kfi7
00000100:00000001:30.0:1773851893.600856:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212864 : -107155106338752 : ffff9e8b01f36840)
02000000:00000001:30.0:1773851893.600856:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851893.600856:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.600857:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851893.600858:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25851@kfi7
00000400:00000010:30.0:1773851893.600858:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000013884923.
00000100:00000200:30.0:1773851893.600859:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030754184640, offset 224
00000400:00000200:30.0:1773851893.600860:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25851@kfi7
00000400:00000200:30.0:1773851893.600861:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.600862:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 1
00000400:00000200:30.0:1773851893.600863:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000400:00000200:30.0:1773851893.600864:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 3
00000400:00000200:30.0:1773851893.600865:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25851@kfi7 local destination
00000400:00000200:30.0:1773851893.600866:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770094:8770094:1024:4294967295] 25851@kfi7 LPNI seq info [24412:24412:16:4294967295]
00000400:00000200:30.0:1773851893.600867:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000400:00000200:30.0:1773851893.600868:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25851@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.600870:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25851@kfi7(25851@kfi7:25851@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851893.600871:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 3
00000800:00000200:30.0:1773851893.600873:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851893.600874:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851893.600875:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851893.600878:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d2 Using peer 25851@kfi7(0x1d2)
00000800:00000200:30.0:1773851893.600883:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b68a0a1e: Posted send of 324 bytes to peer 0x1d2: rc=0
00000800:00000200:30.0:1773851893.600884:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851893.600886:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.600887:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ddb60a69 refcount 4 to 25851@kfi7
00010000:00000001:30.0:1773851893.600887:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851893.600888:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.600888:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851893.600889:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006b31d744 x1858030754184640/t0(0) o400->b2736900-c613-47c9-a91b-a9327caccab9@25851@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne269-0'
00000100:00100000:30.0:1773851893.600892:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006b31d744 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:b2736900-c613-47c9-a91b-a9327caccab9+6:47710:x1858030754184640:12345-25851@kfi7:400:default-tuolumne269-0 Request processed in 57us (83us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851893.600894:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25851@kfi7, seq: 2055586
00000100:00000040:30.0:1773851893.600894:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d55e634c : new rpc_count 0
00000100:00000001:30.0:1773851893.600896:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851893.600896:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851893.600896:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000800:00000200:29.0:1773851893.600896:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d2 TN_EVENT_TX_OK event status 0
00000020:00000010:30.0:1773851893.600897:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000818b6cb1.
00000400:00000200:29.0:1773851893.600897:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851893.600898:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006392c63e.
00000020:00000040:30.0:1773851893.600898:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000d55e634c : new refcount 5
00000400:00000200:29.0:1773851893.600898:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25851@kfi7: PUT: OK
00000100:00000001:30.0:1773851893.600899:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851893.600899:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000013884923
00000400:00000010:29.0:1773851893.600899:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000013884923.
00000100:00000001:29.0:1773851893.600900:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851893.600900:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851893.600901:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000065d0b6fe nid 25851@kfi7 refs 2
00000800:00000200:29.0:1773851893.600902:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 25851@kfi7(000000004b323c65):0x0 lsk 467 rsk 87 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d2 Transaction freed
00000800:00000200:17.0:1773851893.605133:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.605135:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851893.605136:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851893.605138:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851893.605140:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.605141:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.117@tcp : PUT - for me
00000400:00000200:17.0:1773851893.605142:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851893.605143:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851893.605144:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.117@tcp to cpt 1
00000400:00000200:17.0:1773851893.605145:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bfb324c4 nid 172.16.70.117@tcp refs 2
00000400:00000200:17.0:1773851893.605146:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bfb324c4 nid 172.16.70.117@tcp refs 3
00000400:00000200:17.0:1773851893.605147:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.117@tcp to cpt 1
00000400:00000200:17.0:1773851893.605148:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.117@tcp of length 224 into portal 12 MB=0x69a0e7db26c00
00000400:00000200:17.0:1773851893.605150:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.117@tcp of length 224/224 into md 0x793926dc5 [64] + 162176
00000800:00000200:17.0:1773851893.605152:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851893.605153:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851893.605154:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851893.605155:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851893.605156:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851893.605157:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000095d29b28.
00000100:00000040:17.0:1773851893.605157:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000095d29b28 x1858236889328640 msgsize 224
00000100:00100000:17.0:1773851893.605159:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.117@tcp (source: 12345-172.16.70.117@tcp)
00000100:00000001:17.0:1773851893.605161:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851893.605162:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851893.605163:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851893.605164:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851893.605164:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851893.605165:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851893.605165:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851893.605166:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851893.605167:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858236889328640
00000020:00000001:7.0:1773851893.605168:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851893.605168:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93098
00000020:00000001:7.0:1773851893.605169:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851893.605171:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000070c687cb refcount=6
00000020:00000001:7.0:1773851893.605171:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745167872 : -107128964383744 : ffff9e911821fc00)
00000020:00000001:7.0:1773851893.605172:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745167872 : -107128964383744 : ffff9e911821fc00)
00000100:00000001:7.0:1773851893.605173:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851893.605174:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851893.605175:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004638b300.
00000020:00000010:7.0:1773851893.605176:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851893.605177:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851893.605177:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851893.605178:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851893.605178:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851893.605179:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851893.605180:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851893.605180:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.605181:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851893.605182:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851893.605183:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851893.605183:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851893.605183:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851893.605184:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.117@tcp, seq: 2001985
00000100:00000040:7.0:1773851893.605185:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000070c687cb : new rpc_count 1
00000100:00000001:4.0:1773851893.605185:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.605186:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968748544 : -106974740803072 : ffff9eb500931200)
00000100:00000001:4.0:1773851893.605186:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851893.605187:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000095d29b28 x1858236889328640/t0(0) o400->e66b2567-9d15-4a7b-8a05-06ea4fdb33b7@172.16.70.117@tcp:620/0 lens 224/0 e 0 to 0 dl 1773851980 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic17-0'
00000100:00000001:7.0:1773851893.605190:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851893.605190:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851893.605191:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095d29b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:e66b2567-9d15-4a7b-8a05-06ea4fdb33b7+6:50099:x1858236889328640:12345-172.16.70.117@tcp:400:default-rzslic17-0
00000100:00000200:7.0:1773851893.605193:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858236889328640
00000020:00000001:7.0:1773851893.605194:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851893.605195:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851893.605195:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.605196:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851893.605197:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851893.605197:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851893.605198:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858236889328640, found 0 last_xid 1858236889328639
00000020:00000001:7.0:1773851893.605199:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851893.605199:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851893.605200:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851893.605200:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.605201:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851893.605202:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851893.605202:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851893.605204:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b8c5d0d5.
02000000:00000001:7.0:1773851893.605205:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.605205:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.605206:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851893.605207:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858236889328640
00010000:00000001:7.0:1773851893.605207:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851893.605208:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000095d29b28 x1858236889328640/t0(0) o400->e66b2567-9d15-4a7b-8a05-06ea4fdb33b7@172.16.70.117@tcp:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic17-0'
00010000:00000001:7.0:1773851893.605211:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851893.605211:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851893.605212:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=125 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851893.605213:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851893.605214:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003ee13c4d refcount 3 to 172.16.70.117@tcp
00000100:00000001:7.0:1773851893.605214:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918265466528 : -107155444085088 : ffff9e8aedd1cea0)
02000000:00000001:7.0:1773851893.605215:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851893.605216:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851893.605216:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851893.605217:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.117@tcp
00000400:00000010:7.0:1773851893.605218:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c448bd40.
00000100:00000200:7.0:1773851893.605219:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858236889328640, offset 224
00000400:00000200:7.0:1773851893.605221:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.117@tcp
00000400:00000200:7.0:1773851893.605222:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.117@tcp to cpt 1
00000400:00000200:7.0:1773851893.605223:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bfb324c4 nid 172.16.70.117@tcp refs 2
00000400:00000200:7.0:1773851893.605224:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bfb324c4 nid 172.16.70.117@tcp refs 3
00000400:00000200:7.0:1773851893.605225:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bfb324c4 nid 172.16.70.117@tcp refs 4
00000400:00000200:7.0:1773851893.605226:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.117@tcp routed destination
00000400:00000200:7.0:1773851893.605228:0:61015:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851893.605229:0:61015:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:7.0:1773851893.605230:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.117@tcp: rtr pref emtpy: 1
00000400:00000200:7.0:1773851893.605231:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851893.605232:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.117@tcp: rtr pref emtpy: 1
00000400:00000200:7.0:1773851893.605233:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851893.605234:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770095:8770095:1024:4294967295] 2094@kfi7 LPNI seq info [1258747021:1258747021:16:4294967295]
00000400:00000200:7.0:1773851893.605236:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:7.0:1773851893.605237:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:7.0:1773851893.605241:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.117@tcp(172.16.70.117@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851893.605242:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bfb324c4 nid 172.16.70.117@tcp refs 3
00000800:00000200:7.0:1773851893.605244:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851893.605246:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851893.605248:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851893.605251:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:7.0:1773851893.605255:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:7.0:1773851893.605257:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851893.605259:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851893.605262:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003ee13c4d refcount 2 to 172.16.70.117@tcp
00010000:00000001:7.0:1773851893.605263:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851893.605264:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851893.605264:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851893.605265:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000095d29b28 x1858236889328640/t0(0) o400->e66b2567-9d15-4a7b-8a05-06ea4fdb33b7@172.16.70.117@tcp:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic17-0'
00000800:00000200:5.0:1773851893.605268:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851893.605270:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095d29b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:e66b2567-9d15-4a7b-8a05-06ea4fdb33b7+6:50099:x1858236889328640:12345-172.16.70.117@tcp:400:default-rzslic17-0 Request processed in 79us (111us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851893.605270:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851893.605271:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:5.0:1773851893.605272:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c448bd40
00000100:00100000:7.0:1773851893.605273:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.117@tcp, seq: 2001985
00000400:00000010:5.0:1773851893.605273:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c448bd40.
00000100:00000040:7.0:1773851893.605274:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000070c687cb : new rpc_count 0
00000100:00000001:7.0:1773851893.605274:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851893.605274:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851893.605274:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851893.605275:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851893.605276:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000400:00000200:5.0:1773851893.605276:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000020:00000010:7.0:1773851893.605277:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000800:00000200:5.0:1773851893.605277:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Transaction freed
00000020:00000010:7.0:1773851893.605278:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004638b300.
00000020:00000040:7.0:1773851893.605278:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000070c687cb : new refcount 5
00000100:00000001:7.0:1773851893.605279:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851893.620485:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851893.620486:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851893.620489:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851893.620493:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851893.620496:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17473@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.620499:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17473@kfi7 : PUT - for me
00000400:00000200:25.0:1773851893.620500:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17473@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.620503:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000099e76f4 nid 17473@kfi7 refs 1
00000400:00000200:25.0:1773851893.620504:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17473@kfi7 to cpt 6
00000400:00000200:25.0:1773851893.620506:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000099e76f4 nid 17473@kfi7 refs 2
00000400:00000200:25.0:1773851893.620507:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000099e76f4 nid 17473@kfi7 refs 3
00000400:00000200:25.0:1773851893.620509:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17472@kfi7 to cpt 3
00000400:00000200:25.0:1773851893.620510:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17472@kfi7 of length 224 into portal 12 MB=0x69b190bf48940
00000400:00000200:25.0:1773851893.620512:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17472@kfi7 of length 224/224 into md 0x16159c9699 [64] + 34448
00000800:00000200:25.0:1773851893.620515:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851893.620518:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851893.620520:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17473@kfi7: PUT: OK
00000100:00000001:25.0:1773851893.620521:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851893.620522:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851893.620523:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3d7da97.
00000100:00000040:25.0:1773851893.620524:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000e3d7da97 x1859381737326912 msgsize 224
00000100:00100000:25.0:1773851893.620526:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-17472@kfi7 (source: 12345-17473@kfi7)
00000100:00000001:25.0:1773851893.620528:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851893.620529:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000099e76f4 nid 17473@kfi7 refs 2
00000100:00000001:27.0:1773851893.620530:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851893.620531:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851893.620532:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851893.620532:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851893.620533:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851893.620534:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851893.620535:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381737326912
00000020:00000001:27.0:1773851893.620536:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851893.620536:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079676a5d6e
00000020:00000001:27.0:1773851893.620537:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851893.620540:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006a5accf refcount=5
00000020:00000001:27.0:1773851893.620542:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921815397376 : -107151894154240 : ffff9e8bc1697400)
00000020:00000001:27.0:1773851893.620543:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921815397376 : -107151894154240 : ffff9e8bc1697400)
00000100:00000001:27.0:1773851893.620544:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851893.620546:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851893.620547:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000330439b1.
00000020:00000010:27.0:1773851893.620549:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851893.620550:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851893.620552:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851893.620552:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851893.620553:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851893.620554:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851893.620555:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851893.620556:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851893.620557:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851893.620559:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851893.620559:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851893.620560:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851893.620560:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851893.620562:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17472@kfi7, seq: 2025171
00000100:00000040:27.0:1773851893.620563:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006a5accf : new rpc_count 1
00000100:00000001:25.0:1773851893.620563:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851893.620564:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106565015424 : -106967144536192 : ffff9eb6c558e780)
00000100:00000001:25.0:1773851893.620564:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851893.620566:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3d7da97 x1859381737326912/t0(0) o400->2f0e8310-f2f1-4e75-a0c1-fce1fbfc91e3@17472@kfi7:143/0 lens 224/0 e 0 to 0 dl 1773852258 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1588-0'
00000100:00000001:27.0:1773851893.620570:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851893.620571:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851893.620572:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3d7da97 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2f0e8310-f2f1-4e75-a0c1-fce1fbfc91e3+5:39915:x1859381737326912:12345-17472@kfi7:400:default-tuolumne1588-0
00000100:00000200:27.0:1773851893.620574:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381737326912
00000020:00000001:27.0:1773851893.620575:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851893.620576:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851893.620577:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.620578:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851893.620579:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851893.620580:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851893.620581:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381737326912, found 0 last_xid 1859381737326911
00000020:00000001:27.0:1773851893.620583:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851893.620584:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851893.620585:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851893.620585:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.620587:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851893.620588:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851893.620588:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851893.620590:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b90ec519.
02000000:00000001:27.0:1773851893.620591:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851893.620592:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.620593:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851893.620594:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183019968406, transno 0, xid 1859381737326912
00010000:00000001:27.0:1773851893.620595:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851893.620596:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3d7da97 x1859381737326912/t0(0) o400->2f0e8310-f2f1-4e75-a0c1-fce1fbfc91e3@17472@kfi7:143/0 lens 224/224 e 0 to 0 dl 1773852258 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1588-0'
00010000:00000001:27.0:1773851893.620601:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851893.620601:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851893.620602:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=126 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851893.620604:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851893.620605:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b942293d refcount 3 to 17472@kfi7
00000100:00000001:27.0:1773851893.620606:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902776576 : -107154806775040 : ffff9e8b13ce6300)
02000000:00000001:27.0:1773851893.620608:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851893.620608:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851893.620609:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851893.620611:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17473@kfi7
00000400:00000010:27.0:1773851893.620612:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aa68e447.
00000100:00000200:27.0:1773851893.620613:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859381737326912, offset 224
00000400:00000200:27.0:1773851893.620615:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17473@kfi7
00000400:00000200:27.0:1773851893.620616:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17473@kfi7 to cpt 6
00000400:00000200:27.0:1773851893.620618:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000099e76f4 nid 17473@kfi7 refs 1
00000400:00000200:27.0:1773851893.620620:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000099e76f4 nid 17473@kfi7 refs 2
00000400:00000200:27.0:1773851893.620622:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000099e76f4 nid 17473@kfi7 refs 3
00000400:00000200:27.0:1773851893.620624:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17473@kfi7 local destination
00000400:00000200:27.0:1773851893.620626:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770096:8770096:1024:4294967295] 17473@kfi7 LPNI seq info [936875:936875:16:4294967295]
00000400:00000200:27.0:1773851893.620628:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000099e76f4 nid 17473@kfi7 refs 2
00000400:00000200:27.0:1773851893.620630:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17473@kfi7 to cpt 6
00000400:00000200:27.0:1773851893.620633:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17473@kfi7(17473@kfi7:17473@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851893.620635:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000099e76f4 nid 17473@kfi7 refs 3
00000800:00000200:27.0:1773851893.620637:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851893.620639:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851893.620642:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851893.620646:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x56d Using peer 17473@kfi7(0x56d)
00000800:00000200:27.0:1773851893.620650:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0x56d: rc=0
00000800:00000200:27.0:1773851893.620653:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x56d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851893.620656:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851893.620657:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b942293d refcount 2 to 17472@kfi7
00010000:00000001:27.0:1773851893.620659:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851893.620659:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851893.620660:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851893.620661:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3d7da97 x1859381737326912/t0(0) o400->2f0e8310-f2f1-4e75-a0c1-fce1fbfc91e3@17472@kfi7:143/0 lens 224/224 e 0 to 0 dl 1773852258 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1588-0'
00000100:00100000:27.0:1773851893.620667:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3d7da97 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:2f0e8310-f2f1-4e75-a0c1-fce1fbfc91e3+5:39915:x1859381737326912:12345-17472@kfi7:400:default-tuolumne1588-0 Request processed in 95us (141us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851893.620667:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x56d TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851893.620670:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17472@kfi7, seq: 2025171
00000400:00000200:25.0:1773851893.620670:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851893.620671:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17473@kfi7: PUT: OK
00000100:00000040:27.0:1773851893.620672:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006a5accf : new rpc_count 0
00000400:00000200:25.0:1773851893.620672:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aa68e447
00000100:00000001:27.0:1773851893.620673:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:25.0:1773851893.620673:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aa68e447.
00000100:00000001:27.0:1773851893.620674:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:25.0:1773851893.620674:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:27.0:1773851893.620675:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000100:00000001:25.0:1773851893.620675:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851893.620676:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000400:00000200:25.0:1773851893.620676:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000099e76f4 nid 17473@kfi7 refs 2
00000020:00000010:27.0:1773851893.620677:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000330439b1.
00000020:00000040:27.0:1773851893.620678:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000006a5accf : new refcount 4
00000100:00000001:27.0:1773851893.620679:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851893.620680:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2069@kfi7:6 -> 17473@kfi7(00000000c68e154b):0x0 lsk 1390 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x56d Transaction freed
00000400:00000200:29.0:1773851893.641732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851893.641735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:11.0:1773851893.671038:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851893.671038:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851893.671039:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851893.671039:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:11.0:1773851893.671041:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ffa6bc9d: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851893.671041:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:11.0:1773851893.671043:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ffa6bc9d: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:10.0:1773851893.671043:0:2464469:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22048@kfi7(0000000024c86284):0xd19 version: 2; local version 2; negotiated version: 2
00000400:00000200:11.0:1773851893.671045:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22048@kfi7 to cpt 2
00000800:00000200:10.0:1773851893.671045:0:2464469:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 Using peer 22048@kfi7(0x100000000000d19)
00000400:00000200:11.0:1773851893.671046:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22048@kfi7 : PUT - for me
00000400:00000200:10.0:1773851893.671047:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22048@kfi7 to cpt 2
00000400:00000200:11.0:1773851893.671048:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22048@kfi7 to cpt 2
00000400:00000200:11.0:1773851893.671049:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000763539a4 nid 22048@kfi7 refs 1
00000800:00000200:10.0:1773851893.671049:0:2464469:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d35a17e8: Posted send of 38 bytes to peer 0x100000000000d19: rc=0
00000400:00000200:11.0:1773851893.671050:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22048@kfi7 to cpt 2
00000400:00000200:11.0:1773851893.671051:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000763539a4 nid 22048@kfi7 refs 2
00000800:00000200:10.0:1773851893.671051:0:2464469:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:11.0:1773851893.671052:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000763539a4 nid 22048@kfi7 refs 3
00000400:00000200:11.0:1773851893.671053:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22241@kfi7 to cpt 0
00000400:00000200:11.0:1773851893.671054:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22241@kfi7 of length 456 into portal 12 MB=0x69b4b6113e000
00000400:00000200:11.0:1773851893.671056:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22241@kfi7 of length 456/456 into md 0x78146ce49 [64] + 158328
00000800:00000200:11.0:1773851893.671058:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ffa6bc9d: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851893.671060:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851893.671061:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22048@kfi7: PUT: OK
00000100:00000001:11.0:1773851893.671062:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851893.671063:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:11.0:1773851893.671063:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b6b1d255.
00000800:00000200:10.0:1773851893.671063:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851893.671064:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000b6b1d255 x1859597913808896 msgsize 456
00000100:00100000:11.0:1773851893.671065:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-22241@kfi7 (source: 12345-22048@kfi7)
00000800:00000200:10.0:1773851893.671065:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 Transaction freed
00000100:00000001:11.0:1773851893.671066:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:11.0:1773851893.671067:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000763539a4 nid 22048@kfi7 refs 2
00000100:00000001:8.0:1773851893.671068:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851893.671068:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:11.0:1773851893.671069:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ffa6bc9d: 2054@kfi7:2 <- 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851893.671069:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851893.671070:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851893.671070:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851893.671071:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597913808896
00000020:00000001:8.0:1773851893.671072:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851893.671072:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2431bb7e
00000020:00000001:8.0:1773851893.671073:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851893.671075:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b0242d3 refcount=71
00000020:00000001:8.0:1773851893.671076:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637065660675072 : -107008048876544 : ffff9ead3f423400)
00000020:00000001:8.0:1773851893.671076:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637065660675072 : -107008048876544 : ffff9ead3f423400)
00000100:00000001:8.0:1773851893.671077:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851893.671078:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851893.671079:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851893.671080:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851893.671081:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851893.671082:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851893.671082:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851893.671083:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.671084:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.671085:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851893.671086:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851893.671086:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851893.671087:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22241@kfi7, seq: 406391014
00000100:00000001:9.0:1773851893.671088:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851893.671088:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:8.0:1773851893.671088:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b0242d3 : new rpc_count 4
00000100:00000001:9.0:1773851893.671089:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.671089:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136446600704 : -106937262950912 : ffff9ebdba6db600)
00000100:00000001:9.0:1773851893.671090:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851893.671090:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b6b1d255 x1859597913808896/t0(0) o17->14b4eaeb-c743-40a6-933a-619c988afe22@22241@kfi7:620/0 lens 456/0 e 0 to 0 dl 1773851980 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1871-0'
00000100:00000001:8.0:1773851893.671092:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851893.671093:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851893.671094:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6b1d255 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:14b4eaeb-c743-40a6-933a-619c988afe22+71:39695:x1859597913808896:12345-22241@kfi7:17:default-tuolumne1871-0
00000100:00000200:8.0:1773851893.671095:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597913808896
00000020:00000001:8.0:1773851893.671096:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851893.671096:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851893.671097:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.671098:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851893.671098:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:8.0:1773851893.671099:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851893.671100:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597913808896, found 0 last_xid 1859597913236159
00000020:00000001:8.0:1773851893.671100:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851893.671101:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851893.671102:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851893.671102:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851893.671103:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:8.0:1773851893.671104:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851893.671104:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851893.671105:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000098c0e011.
02000000:00000001:8.0:1773851893.671106:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.671106:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.671107:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:8.0:1773851893.671108:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:8.0:1773851893.671108:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:8.0:1773851893.671110:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.671111:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:8.0:1773851893.671111:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 14b4eaeb-c743-40a6-933a-619c988afe22/000000004b0242d3 free: 126633370845184 avail: 126633368748032
00000020:00000001:8.0:1773851893.671112:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:8.0:1773851893.671113:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 14b4eaeb-c743-40a6-933a-619c988afe22/000000004b0242d3 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:8.0:1773851893.671114:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:8.0:1773851893.671115:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:8.0:1773851893.671116:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 14b4eaeb-c743-40a6-933a-619c988afe22/000000004b0242d3 reports grant 1810890751 dropped 0, local 1880621055
00000020:00000001:8.0:1773851893.671117:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:8.0:1773851893.671118:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:8.0:1773851893.671118:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851893.671119:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590766, transno 0, xid 1859597913808896
00010000:00000001:8.0:1773851893.671119:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851893.671120:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b6b1d255 x1859597913808896/t0(0) o17->14b4eaeb-c743-40a6-933a-619c988afe22@22241@kfi7:620/0 lens 456/432 e 0 to 0 dl 1773851980 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1871-0'
00010000:00000001:8.0:1773851893.671123:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851893.671123:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851893.671124:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=126 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851893.671125:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851893.671126:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004e926e56 refcount 3 to 22241@kfi7
00000100:00000001:8.0:1773851893.671127:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049088 : -107154804502528 : ffff9e8b13f11000)
02000000:00000001:8.0:1773851893.671128:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851893.671128:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851893.671129:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851893.671130:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22048@kfi7
00000400:00000010:8.0:1773851893.671130:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc809cf6.
00000100:00000200:8.0:1773851893.671131:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859597913808896, offset 224
00000400:00000200:8.0:1773851893.671132:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22048@kfi7
00000400:00000200:8.0:1773851893.671134:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22048@kfi7 to cpt 2
00000400:00000200:8.0:1773851893.671135:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000763539a4 nid 22048@kfi7 refs 1
00000400:00000200:8.0:1773851893.671136:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000763539a4 nid 22048@kfi7 refs 2
00000400:00000200:8.0:1773851893.671137:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000763539a4 nid 22048@kfi7 refs 3
00000400:00000200:8.0:1773851893.671138:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22048@kfi7 local destination
00000400:00000200:8.0:1773851893.671140:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770097:8770097:1024:4294967295] 22048@kfi7 LPNI seq info [780189:780189:16:4294967295]
00000400:00000200:8.0:1773851893.671141:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000763539a4 nid 22048@kfi7 refs 2
00000400:00000200:8.0:1773851893.671142:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22048@kfi7 to cpt 2
00000400:00000200:8.0:1773851893.671144:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22048@kfi7(22048@kfi7:22048@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851893.671146:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000763539a4 nid 22048@kfi7 refs 3
00000800:00000200:8.0:1773851893.671147:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851893.671148:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:8.0:1773851893.671150:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851893.671153:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 Using peer 22048@kfi7(0x100000000000d19)
00000800:00000200:8.0:1773851893.671155:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000039182e44: Posted send of 532 bytes to peer 0x100000000000d19: rc=0
00000800:00000200:8.0:1773851893.671157:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851893.671159:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851893.671160:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004e926e56 refcount 2 to 22241@kfi7
00010000:00000001:8.0:1773851893.671160:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851893.671161:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851893.671161:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851893.671162:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b6b1d255 x1859597913808896/t0(0) o17->14b4eaeb-c743-40a6-933a-619c988afe22@22241@kfi7:620/0 lens 456/432 e 0 to 0 dl 1773851980 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1871-0'
00000100:00100000:8.0:1773851893.671167:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6b1d255 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:14b4eaeb-c743-40a6-933a-619c988afe22+71:39695:x1859597913808896:12345-22241@kfi7:17:default-tuolumne1871-0 Request processed in 73us (102us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851893.671171:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22241@kfi7, seq: 406391014
00000100:00000040:8.0:1773851893.671172:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b0242d3 : new rpc_count 3
00000100:00000001:8.0:1773851893.671173:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851893.671173:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851893.671174:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851893.671175:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851893.671176:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000020:00000040:8.0:1773851893.671177:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004b0242d3 : new refcount 70
00000100:00000001:8.0:1773851893.671177:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851893.671182:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851893.671184:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851893.671185:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22048@kfi7: PUT: OK
00000400:00000200:10.0:1773851893.671186:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc809cf6
00000400:00000010:10.0:1773851893.671186:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc809cf6.
00000100:00000001:10.0:1773851893.671187:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851893.671187:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851893.671188:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000763539a4 nid 22048@kfi7 refs 2
00000800:00000200:10.0:1773851893.671190:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2054@kfi7:2 -> 22048@kfi7(0000000024c86284):0x0 lsk 3354 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000d19 Transaction freed
00000800:00000200:13.0:1773851893.781761:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851893.781762:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851893.781763:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851893.781765:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851893.781767:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22098@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.781768:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22098@kfi7 : PUT - for me
00000400:00000200:13.0:1773851893.781769:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22098@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.781772:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca75c475 nid 22098@kfi7 refs 1
00000400:00000200:13.0:1773851893.781773:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22098@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.781773:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca75c475 nid 22098@kfi7 refs 2
00000400:00000200:13.0:1773851893.781774:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ca75c475 nid 22098@kfi7 refs 3
00000400:00000200:13.0:1773851893.781775:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22099@kfi7 to cpt 6
00000400:00000200:13.0:1773851893.781776:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22099@kfi7 of length 224 into portal 12 MB=0x69b4b90b2ca00
00000400:00000200:13.0:1773851893.781777:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22099@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 51880
00000800:00000200:13.0:1773851893.781779:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851893.781780:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851893.781781:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22098@kfi7: PUT: OK
00000100:00000001:13.0:1773851893.781782:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851893.781783:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851893.781784:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000022ac85c6.
00000100:00000040:13.0:1773851893.781785:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000022ac85c6 x1859598712752640 msgsize 224
00000100:00100000:13.0:1773851893.781787:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-22099@kfi7 (source: 12345-22098@kfi7)
00000100:00000001:13.0:1773851893.781787:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851893.781788:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca75c475 nid 22098@kfi7 refs 2
00000100:00000001:15.0:1773851893.781789:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851893.781790:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851893.781790:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851893.781790:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851893.781791:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851893.781791:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851893.781792:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598712752640
00000020:00000001:15.0:1773851893.781793:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851893.781793:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24325b74
00000020:00000001:15.0:1773851893.781794:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851893.781798:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005979e969 refcount=8
00000020:00000001:15.0:1773851893.781799:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636973471034368 : -107100238517248 : ffff9e97c853ec00)
00000020:00000001:15.0:1773851893.781800:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636973471034368 : -107100238517248 : ffff9e97c853ec00)
00000100:00000001:15.0:1773851893.781801:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.781802:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851893.781803:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000aa96597.
00000020:00000010:15.0:1773851893.781804:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851893.781805:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851893.781806:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851893.781806:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851893.781807:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.781808:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851893.781808:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851893.781809:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.781810:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.781811:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851893.781812:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851893.781813:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22099@kfi7, seq: 2289918
00000100:00000040:15.0:1773851893.781813:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005979e969 : new rpc_count 1
00000100:00000001:12.0:1773851893.781813:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851893.781813:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851893.781814:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637024468622976 : -107049240928640 : ffff9ea3a8055e80)
00000100:00000001:12.0:1773851893.781814:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851893.781815:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000022ac85c6 x1859598712752640/t0(0) o400->791f1007-45da-4506-a42b-ea289c0c9895@22099@kfi7:620/0 lens 224/0 e 0 to 0 dl 1773851980 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1878-0'
00000100:00000001:12.0:1773851893.781816:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.781818:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.781818:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851893.781819:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000022ac85c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:791f1007-45da-4506-a42b-ea289c0c9895+8:39704:x1859598712752640:12345-22099@kfi7:400:default-tuolumne1878-0
00000100:00000200:15.0:1773851893.781821:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598712752640
00000020:00000001:15.0:1773851893.781821:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851893.781822:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851893.781823:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.781823:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851893.781824:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851893.781825:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851893.781825:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598712752640, found 0 last_xid 1859598712752639
00000020:00000001:15.0:1773851893.781826:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851893.781827:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851893.781827:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851893.781828:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.781829:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851893.781830:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851893.781830:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851893.781831:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000faa29602.
02000000:00000001:15.0:1773851893.781832:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.781832:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.781833:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851893.781834:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182337389202, transno 0, xid 1859598712752640
00010000:00000001:15.0:1773851893.781835:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851893.781836:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000022ac85c6 x1859598712752640/t0(0) o400->791f1007-45da-4506-a42b-ea289c0c9895@22099@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1878-0'
00010000:00000001:15.0:1773851893.781838:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851893.781838:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851893.781839:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=126 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851893.781840:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851893.781841:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eb20ebae refcount 3 to 22099@kfi7
00000100:00000001:15.0:1773851893.781842:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985418208 : -107156724133408 : ffff9e8aa185d1e0)
02000000:00000001:15.0:1773851893.781842:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851893.781843:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.781844:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851893.781844:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22098@kfi7
00000400:00000010:15.0:1773851893.781845:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022f323c7.
00000100:00000200:15.0:1773851893.781846:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598712752640, offset 224
00000400:00000200:15.0:1773851893.781847:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22098@kfi7
00000400:00000200:15.0:1773851893.781848:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22098@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.781849:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca75c475 nid 22098@kfi7 refs 1
00000400:00000200:15.0:1773851893.781850:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ca75c475 nid 22098@kfi7 refs 2
00000400:00000200:15.0:1773851893.781851:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ca75c475 nid 22098@kfi7 refs 3
00000400:00000200:15.0:1773851893.781852:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22098@kfi7 local destination
00000400:00000200:15.0:1773851893.781854:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770098:8770098:1024:4294967295] 22098@kfi7 LPNI seq info [10365934:10365934:16:4294967295]
00000400:00000200:15.0:1773851893.781855:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ca75c475 nid 22098@kfi7 refs 2
00000400:00000200:15.0:1773851893.781856:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22098@kfi7 to cpt 3
00000400:00000200:15.0:1773851893.781858:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22098@kfi7(22098@kfi7:22098@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851893.781859:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ca75c475 nid 22098@kfi7 refs 3
00000800:00000200:15.0:1773851893.781861:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851893.781862:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851893.781864:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851893.781866:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf6b Using peer 22098@kfi7(0xf6b)
00000800:00000200:15.0:1773851893.781869:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0xf6b: rc=0
00000800:00000200:15.0:1773851893.781870:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf6b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851893.781872:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851893.781873:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eb20ebae refcount 2 to 22099@kfi7
00010000:00000001:15.0:1773851893.781874:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851893.781874:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851893.781875:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851893.781876:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000022ac85c6 x1859598712752640/t0(0) o400->791f1007-45da-4506-a42b-ea289c0c9895@22099@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1878-0'
00000100:00100000:15.0:1773851893.781879:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000022ac85c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:791f1007-45da-4506-a42b-ea289c0c9895+8:39704:x1859598712752640:12345-22099@kfi7:400:default-tuolumne1878-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851893.781881:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22099@kfi7, seq: 2289918
00000100:00000040:15.0:1773851893.781881:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005979e969 : new rpc_count 0
00000100:00000001:15.0:1773851893.781882:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851893.781883:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851893.781883:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851893.781884:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000800:00000200:13.0:1773851893.781884:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf6b TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851893.781885:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000aa96597.
00000020:00000040:15.0:1773851893.781885:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000005979e969 : new refcount 7
00000400:00000200:13.0:1773851893.781885:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851893.781886:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851893.781886:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22098@kfi7: PUT: OK
00000400:00000200:13.0:1773851893.781887:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022f323c7
00000400:00000010:13.0:1773851893.781887:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022f323c7.
00000100:00000001:13.0:1773851893.781888:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851893.781889:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851893.781889:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca75c475 nid 22098@kfi7 refs 2
00000800:00000200:13.0:1773851893.781891:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 22098@kfi7(000000005c9141ef):0x0 lsk 3948 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf6b Transaction freed
00000800:00000200:22.0:1773851893.829252:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851893.829252:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851893.829253:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851893.829253:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851893.829255:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851893.829255:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851893.829258:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13315@kfi7(000000000f01c936):0xd79 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851893.829259:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851893.829261:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 Using peer 13315@kfi7(0x100000000000d79)
00000400:00000200:22.0:1773851893.829262:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13315@kfi7 to cpt 5
00000400:00000200:22.0:1773851893.829264:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13315@kfi7 : PUT - for me
00000400:00000200:21.0:1773851893.829264:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13315@kfi7 to cpt 5
00000400:00000200:22.0:1773851893.829266:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13315@kfi7 to cpt 5
00000400:00000200:22.0:1773851893.829267:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0cec0ce nid 13315@kfi7 refs 1
00000800:00000200:21.0:1773851893.829267:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0x100000000000d79: rc=0
00000400:00000200:22.0:1773851893.829268:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13315@kfi7 to cpt 5
00000400:00000200:22.0:1773851893.829269:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0cec0ce nid 13315@kfi7 refs 2
00000800:00000200:21.0:1773851893.829270:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851893.829271:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f0cec0ce nid 13315@kfi7 refs 3
00000400:00000200:22.0:1773851893.829272:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13314@kfi7 to cpt 2
00000400:00000200:22.0:1773851893.829274:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13314@kfi7 of length 456 into portal 12 MB=0x69b4bae0e9b00
00000400:00000200:22.0:1773851893.829276:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13314@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 61576
00000800:00000200:22.0:1773851893.829280:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851893.829282:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851893.829283:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851893.829284:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13315@kfi7: PUT: OK
00000100:00000001:22.0:1773851893.829285:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851893.829286:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851893.829287:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a998c0a7.
00000100:00000040:22.0:1773851893.829289:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000a998c0a7 x1859599205309184 msgsize 456
00000800:00000200:21.0:1773851893.829290:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 Transaction freed
00000100:00100000:22.0:1773851893.829291:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-13314@kfi7 (source: 12345-13315@kfi7)
00000100:00000001:22.0:1773851893.829293:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851893.829295:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0cec0ce nid 13315@kfi7 refs 2
00000100:00000001:20.0:1773851893.829296:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851893.829296:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851893.829297:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851893.829297:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851893.829298:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851893.829299:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851893.829301:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599205309184
00000020:00000001:20.0:1773851893.829302:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851893.829302:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7c3b7
00000020:00000001:20.0:1773851893.829303:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851893.829307:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000068497a5a refcount=5
00000020:00000001:20.0:1773851893.829308:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136154928128 : -106937554623488 : ffff9ebda90b2400)
00000020:00000001:20.0:1773851893.829309:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136154928128 : -106937554623488 : ffff9ebda90b2400)
00000100:00000001:20.0:1773851893.829311:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851893.829312:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851893.829313:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851893.829315:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851893.829316:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851893.829318:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851893.829318:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851893.829319:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.829321:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.829323:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851893.829325:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851893.829325:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851893.829326:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851893.829326:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851893.829327:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13314@kfi7, seq: 335333151
00000100:00000001:23.0:1773851893.829329:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851893.829329:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000068497a5a : new rpc_count 1
00000100:00000001:23.0:1773851893.829330:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.829331:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382201600 : -106946327350016 : ffff9ebb9e25f500)
00000100:00000040:20.0:1773851893.829332:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a998c0a7 x1859599205309184/t0(0) o17->3fbec2db-beb8-4aac-8f6e-c6796fb249f1@13314@kfi7:620/0 lens 456/0 e 0 to 0 dl 1773851980 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1335-0'
00000100:00000001:20.0:1773851893.829337:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851893.829338:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851893.829339:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a998c0a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:3fbec2db-beb8-4aac-8f6e-c6796fb249f1+5:39687:x1859599205309184:12345-13314@kfi7:17:default-tuolumne1335-0
00000100:00000200:20.0:1773851893.829341:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599205309184
00000020:00000001:20.0:1773851893.829342:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851893.829343:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851893.829344:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.829345:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851893.829346:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:20.0:1773851893.829347:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851893.829348:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599205309184, found 0 last_xid 1859599205309183
00000020:00000001:20.0:1773851893.829349:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851893.829350:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851893.829351:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851893.829352:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851893.829353:0:60934:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:20.0:1773851893.829355:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851893.829355:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851893.829357:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000897f1544.
02000000:00000001:20.0:1773851893.829358:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.829359:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.829360:0:60934:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:20.0:1773851893.829361:0:60934:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:20.0:1773851893.829362:0:60934:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:20.0:1773851893.829364:0:60934:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.829365:0:60934:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:20.0:1773851893.829367:0:60934:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 3fbec2db-beb8-4aac-8f6e-c6796fb249f1/0000000068497a5a free: 126633370845184 avail: 126633368748032
00000020:00000001:20.0:1773851893.829368:0:60934:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:20.0:1773851893.829369:0:60934:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 3fbec2db-beb8-4aac-8f6e-c6796fb249f1/0000000068497a5a avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:20.0:1773851893.829374:0:60934:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:20.0:1773851893.829375:0:60934:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:20.0:1773851893.829376:0:60934:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 3fbec2db-beb8-4aac-8f6e-c6796fb249f1/0000000068497a5a reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:20.0:1773851893.829378:0:60934:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:20.0:1773851893.829379:0:60934:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:20.0:1773851893.829380:0:60934:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851893.829381:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595212, transno 0, xid 1859599205309184
00010000:00000001:20.0:1773851893.829382:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851893.829383:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a998c0a7 x1859599205309184/t0(0) o17->3fbec2db-beb8-4aac-8f6e-c6796fb249f1@13314@kfi7:620/0 lens 456/432 e 0 to 0 dl 1773851980 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1335-0'
00010000:00000001:20.0:1773851893.829388:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851893.829389:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851893.829390:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=126 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851893.829392:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851893.829393:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000048a25e30 refcount 3 to 13314@kfi7
00000100:00000001:20.0:1773851893.829394:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810487040 : -107154899064576 : ffff9e8b0e4e2900)
02000000:00000001:20.0:1773851893.829396:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851893.829396:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851893.829397:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851893.829399:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13315@kfi7
00000400:00000010:20.0:1773851893.829400:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008110c84f.
00000100:00000200:20.0:1773851893.829401:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859599205309184, offset 224
00000400:00000200:20.0:1773851893.829403:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13315@kfi7
00000400:00000200:20.0:1773851893.829405:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13315@kfi7 to cpt 5
00000400:00000200:20.0:1773851893.829406:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0cec0ce nid 13315@kfi7 refs 1
00000400:00000200:20.0:1773851893.829408:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f0cec0ce nid 13315@kfi7 refs 2
00000400:00000200:20.0:1773851893.829409:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f0cec0ce nid 13315@kfi7 refs 3
00000400:00000200:20.0:1773851893.829411:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13315@kfi7 local destination
00000400:00000200:20.0:1773851893.829414:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770099:8770099:1024:4294967295] 13315@kfi7 LPNI seq info [16027142:16027142:16:4294967295]
00000400:00000200:20.0:1773851893.829416:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f0cec0ce nid 13315@kfi7 refs 2
00000400:00000200:20.0:1773851893.829417:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13315@kfi7 to cpt 5
00000400:00000200:20.0:1773851893.829422:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13315@kfi7(13315@kfi7:13315@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851893.829424:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f0cec0ce nid 13315@kfi7 refs 3
00000800:00000200:20.0:1773851893.829426:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851893.829428:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:20.0:1773851893.829431:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851893.829435:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 Using peer 13315@kfi7(0x100000000000d79)
00000800:00000200:20.0:1773851893.829440:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 532 bytes to peer 0x100000000000d79: rc=0
00000800:00000200:20.0:1773851893.829442:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851893.829445:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851893.829447:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000048a25e30 refcount 2 to 13314@kfi7
00010000:00000001:20.0:1773851893.829449:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851893.829449:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851893.829450:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851893.829451:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a998c0a7 x1859599205309184/t0(0) o17->3fbec2db-beb8-4aac-8f6e-c6796fb249f1@13314@kfi7:620/0 lens 456/432 e 0 to 0 dl 1773851980 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1335-0'
00000100:00100000:20.0:1773851893.829457:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a998c0a7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:3fbec2db-beb8-4aac-8f6e-c6796fb249f1+5:39687:x1859599205309184:12345-13314@kfi7:17:default-tuolumne1335-0 Request processed in 119us (166us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851893.829461:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13314@kfi7, seq: 335333151
00000100:00000040:20.0:1773851893.829462:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000068497a5a : new rpc_count 0
00000100:00000001:20.0:1773851893.829463:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851893.829464:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851893.829465:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851893.829466:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851893.829468:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851893.829469:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000068497a5a : new refcount 4
00000100:00000001:20.0:1773851893.829470:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851893.829478:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851893.829481:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851893.829483:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13315@kfi7: PUT: OK
00000400:00000200:21.0:1773851893.829484:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008110c84f
00000400:00000010:21.0:1773851893.829485:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008110c84f.
00000100:00000001:21.0:1773851893.829486:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851893.829487:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851893.829488:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0cec0ce nid 13315@kfi7 refs 2
00000800:00000200:21.0:1773851893.829491:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 13315@kfi7(000000000f01c936):0x0 lsk 3450 rsk 3 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000d79 Transaction freed
00000800:00000200:18.0:1773851893.879314:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.879314:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851893.879315:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851893.879316:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851893.879316:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851893.879317:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851893.879319:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851893.879319:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8961@kfi7(000000006b28ba8c):0xe7d version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851893.879320:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000800:00000200:17.0:1773851893.879321:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d Using peer 8961@kfi7(0xe7d)
00000400:00000200:18.0:1773851893.879322:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8961@kfi7 : PUT - for me
00000400:00000200:18.0:1773851893.879323:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:18.0:1773851893.879323:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 1
00000400:00000200:18.0:1773851893.879324:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:18.0:1773851893.879325:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000400:00000200:18.0:1773851893.879326:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 3
00000400:00000200:18.0:1773851893.879327:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9153@kfi7 to cpt 7
00000400:00000200:17.0:1773851893.879327:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:18.0:1773851893.879328:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9153@kfi7 of length 224 into portal 12 MB=0x69b4b8dcbcdc0
00000400:00000200:18.0:1773851893.879329:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9153@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 42304
00000800:00000200:17.0:1773851893.879329:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 38 bytes to peer 0xe7d: rc=0
00000800:00000200:17.0:1773851893.879330:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:18.0:1773851893.879331:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851893.879333:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851893.879333:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8961@kfi7: PUT: OK
00000100:00000001:18.0:1773851893.879334:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851893.879335:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851893.879335:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f19367ba.
00000100:00000040:18.0:1773851893.879336:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000f19367ba x1859598664060352 msgsize 224
00000100:00100000:18.0:1773851893.879337:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-9153@kfi7 (source: 12345-8961@kfi7)
00000100:00000001:18.0:1773851893.879338:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851893.879339:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000800:00000200:18.0:1773851893.879340:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851893.879340:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851893.879340:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851893.879341:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851893.879341:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:19.0:1773851893.879342:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d TN_EVENT_TX_OK event status 0
02000000:00000001:17.0:1773851893.879342:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851893.879343:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598664060352
00000020:00000001:17.0:1773851893.879343:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851893.879344:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e75232
00000020:00000001:17.0:1773851893.879344:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:19.0:1773851893.879345:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2069@kfi7:4 <- 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d Transaction freed
00000020:00000040:17.0:1773851893.879346:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d87046e refcount=896
00000020:00000001:17.0:1773851893.879347:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637088971267072 : -106984738284544 : ffff9eb2acad9c00)
00000020:00000001:17.0:1773851893.879348:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637088971267072 : -106984738284544 : ffff9eb2acad9c00)
00000100:00000001:17.0:1773851893.879349:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851893.879349:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851893.879350:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007767c329.
00000020:00000010:17.0:1773851893.879351:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000108c5a02.
00000020:00000010:17.0:1773851893.879352:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851893.879353:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851893.879353:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851893.879354:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851893.879355:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851893.879355:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851893.879355:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851893.879356:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851893.879358:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851893.879358:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851893.879358:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:17.0:1773851893.879359:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851893.879360:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9153@kfi7, seq: 2156417
00000100:00000001:17.0:1773851893.879361:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851893.879361:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d87046e : new rpc_count 8
00000100:00000001:17.0:1773851893.879362:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851893.879362:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609985024 : -107015099566592 : ffff9eab9b013600)
00000100:00000040:16.0:1773851893.879363:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f19367ba x1859598664060352/t0(0) o400->33595bfa-18fd-4e98-9eac-e7a741968d24@9153@kfi7:145/0 lens 224/0 e 0 to 0 dl 1773852260 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1059-0'
00000100:00000001:16.0:1773851893.879366:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851893.879366:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851893.879368:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f19367ba pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:33595bfa-18fd-4e98-9eac-e7a741968d24+896:39509:x1859598664060352:12345-9153@kfi7:400:default-tuolumne1059-0
00000100:00000200:16.0:1773851893.879369:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598664060352
00000020:00000001:16.0:1773851893.879370:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851893.879371:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851893.879371:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851893.879372:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851893.879373:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851893.879373:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851893.879374:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598664060352, found 0 last_xid 1859598587483263
00000020:00000001:16.0:1773851893.879375:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851893.879376:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851893.879377:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851893.879378:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851893.879378:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851893.879379:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851893.879380:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851893.879380:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005f7e8414.
02000000:00000001:16.0:1773851893.879381:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851893.879382:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851893.879382:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851893.879383:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581127, transno 0, xid 1859598664060352
00010000:00000001:16.0:1773851893.879384:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851893.879385:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f19367ba x1859598664060352/t0(0) o400->33595bfa-18fd-4e98-9eac-e7a741968d24@9153@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1059-0'
00010000:00000001:16.0:1773851893.879387:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851893.879388:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851893.879389:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=126 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851893.879390:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851893.879391:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e92afb3 refcount 3 to 9153@kfi7
00000100:00000001:16.0:1773851893.879392:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065664 : -107155994485952 : ffff9e8acd035b40)
02000000:00000001:16.0:1773851893.879392:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851893.879393:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851893.879394:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851893.879395:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8961@kfi7
00000400:00000010:16.0:1773851893.879395:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da0f7c1f.
00000100:00000200:16.0:1773851893.879397:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598664060352, offset 224
00000400:00000200:16.0:1773851893.879398:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8961@kfi7
00000400:00000200:16.0:1773851893.879399:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:16.0:1773851893.879400:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 1
00000400:00000200:16.0:1773851893.879401:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000400:00000200:16.0:1773851893.879402:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 3
00000400:00000200:16.0:1773851893.879403:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8961@kfi7 local destination
00000400:00000200:16.0:1773851893.879405:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770100:8770100:1024:4294967295] 8961@kfi7 LPNI seq info [2156336:2156336:16:4294967295]
00000400:00000200:16.0:1773851893.879406:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000400:00000200:16.0:1773851893.879407:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8961@kfi7 to cpt 4
00000400:00000200:16.0:1773851893.879409:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8961@kfi7(8961@kfi7:8961@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851893.879410:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 3
00000800:00000200:16.0:1773851893.879412:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851893.879413:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851893.879415:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851893.879418:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d Using peer 8961@kfi7(0xe7d)
00000800:00000200:16.0:1773851893.879421:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0xe7d: rc=0
00000800:00000200:16.0:1773851893.879422:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851893.879424:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851893.879425:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e92afb3 refcount 2 to 9153@kfi7
00010000:00000001:16.0:1773851893.879426:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851893.879426:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851893.879427:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851893.879428:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f19367ba x1859598664060352/t0(0) o400->33595bfa-18fd-4e98-9eac-e7a741968d24@9153@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1059-0'
00000100:00100000:16.0:1773851893.879433:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f19367ba pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:33595bfa-18fd-4e98-9eac-e7a741968d24+896:39509:x1859598664060352:12345-9153@kfi7:400:default-tuolumne1059-0 Request processed in 66us (96us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851893.879435:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9153@kfi7, seq: 2156417
00000100:00000040:16.0:1773851893.879436:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d87046e : new rpc_count 7
00000100:00000001:16.0:1773851893.879437:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851893.879437:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851893.879438:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000108c5a02.
00000020:00000010:16.0:1773851893.879439:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000020:00000010:16.0:1773851893.879440:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007767c329.
00000020:00000040:16.0:1773851893.879440:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000002d87046e : new refcount 895
00000100:00000001:16.0:1773851893.879441:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851893.879447:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851893.879448:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851893.879449:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8961@kfi7: PUT: OK
00000400:00000200:17.0:1773851893.879450:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da0f7c1f
00000400:00000010:17.0:1773851893.879451:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da0f7c1f.
00000100:00000001:17.0:1773851893.879451:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851893.879452:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851893.879453:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000019adb0a6 nid 8961@kfi7 refs 2
00000800:00000200:17.0:1773851893.879454:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2069@kfi7:4 -> 8961@kfi7(000000006b28ba8c):0x0 lsk 3710 rsk 9 tsk 0 trmk 0 tmk 0 trr 4 tta 0xe7d Transaction freed
00010000:00000001:2.0:1773851893.897730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851893.897732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851893.897733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851893.897734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851893.897735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851893.897736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851893.897737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851893.897738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851893.897738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:1.0:1773851893.897742:0:937833:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:1.0:1773851893.897743:0:937833:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:1.0:1773851893.897743:0:937833:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:13.0:1773851893.953129:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851893.953130:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851893.953132:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851893.953134:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851893.953136:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8898@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.953138:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8898@kfi7 : PUT - for me
00000400:00000200:13.0:1773851893.953138:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8898@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.953139:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f61be60 nid 8898@kfi7 refs 1
00000400:00000200:13.0:1773851893.953141:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8898@kfi7 to cpt 3
00000400:00000200:13.0:1773851893.953141:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f61be60 nid 8898@kfi7 refs 2
00000400:00000200:13.0:1773851893.953143:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002f61be60 nid 8898@kfi7 refs 3
00000400:00000200:13.0:1773851893.953143:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8706@kfi7 to cpt 1
00000400:00000200:13.0:1773851893.953144:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8706@kfi7 of length 224 into portal 12 MB=0x69b4bfa37be00
00000400:00000200:13.0:1773851893.953146:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8706@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 52104
00000800:00000200:13.0:1773851893.953148:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851893.953150:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851893.953151:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8898@kfi7: PUT: OK
00000100:00000001:13.0:1773851893.953152:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851893.953152:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851893.953153:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a75adf17.
00000100:00000040:13.0:1773851893.953154:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000a75adf17 x1859600483073536 msgsize 224
00000100:00100000:13.0:1773851893.953155:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8706@kfi7 (source: 12345-8898@kfi7)
00000100:00000001:13.0:1773851893.953156:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851893.953157:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002f61be60 nid 8898@kfi7 refs 2
00000100:00000001:15.0:1773851893.953159:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851893.953159:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851893.953160:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851893.953161:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851893.953162:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851893.953163:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851893.953165:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600483073536
00000020:00000001:15.0:1773851893.953166:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851893.953166:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d84317
00000020:00000001:15.0:1773851893.953167:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851893.953172:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000012392ed6 refcount=7
00000020:00000001:15.0:1773851893.953174:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139714719744 : -106933994831872 : ffff9ebe7d394000)
00000020:00000001:15.0:1773851893.953175:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139714719744 : -106933994831872 : ffff9ebe7d394000)
00000100:00000001:15.0:1773851893.953177:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851893.953178:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851893.953179:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000057e36ed.
00000020:00000010:15.0:1773851893.953181:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851893.953182:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851893.953184:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851893.953184:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851893.953185:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851893.953187:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851893.953187:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851893.953188:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851893.953190:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851893.953191:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851893.953192:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851893.953192:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851893.953192:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851893.953193:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8706@kfi7, seq: 2289919
00000100:00000040:12.0:1773851893.953194:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000012392ed6 : new rpc_count 1
00000100:00000001:15.0:1773851893.953195:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851893.953195:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637024468627584 : -107049240924032 : ffff9ea3a8057080)
00000100:00000001:15.0:1773851893.953196:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851893.953197:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a75adf17 x1859600483073536/t0(0) o400->628a76fd-d25b-407b-9110-dfdaf88879f9@8706@kfi7:620/0 lens 224/0 e 0 to 0 dl 1773851980 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1047-0'
00000100:00000001:12.0:1773851893.953204:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851893.953204:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851893.953205:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a75adf17 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:628a76fd-d25b-407b-9110-dfdaf88879f9+7:39508:x1859600483073536:12345-8706@kfi7:400:default-tuolumne1047-0
00000100:00000200:12.0:1773851893.953207:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600483073536
00000020:00000001:12.0:1773851893.953208:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851893.953208:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851893.953209:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851893.953210:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851893.953211:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851893.953212:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851893.953212:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600483073536, found 0 last_xid 1859600483073535
00000020:00000001:12.0:1773851893.953213:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851893.953214:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851893.953215:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851893.953215:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851893.953216:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851893.953217:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851893.953217:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851893.953218:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057ada156.
02000000:00000001:12.0:1773851893.953219:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851893.953220:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851893.953220:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851893.953221:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859600483073536
00010000:00000001:12.0:1773851893.953222:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851893.953223:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a75adf17 x1859600483073536/t0(0) o400->628a76fd-d25b-407b-9110-dfdaf88879f9@8706@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1047-0'
00010000:00000001:12.0:1773851893.953226:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851893.953226:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851893.953227:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=126 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851893.953228:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851893.953229:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000017e72a9 refcount 3 to 8706@kfi7
00000100:00000001:12.0:1773851893.953230:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918327303264 : -107155382248352 : ffff9e8af1815c60)
02000000:00000001:12.0:1773851893.953232:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851893.953232:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851893.953233:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851893.953234:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8898@kfi7
00000400:00000010:12.0:1773851893.953235:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df1f761c.
00000100:00000200:12.0:1773851893.953236:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600483073536, offset 224
00000400:00000200:12.0:1773851893.953237:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8898@kfi7
00000400:00000200:12.0:1773851893.953239:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8898@kfi7 to cpt 3
00000400:00000200:12.0:1773851893.953239:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002f61be60 nid 8898@kfi7 refs 1
00000400:00000200:12.0:1773851893.953241:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002f61be60 nid 8898@kfi7 refs 2
00000400:00000200:12.0:1773851893.953242:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002f61be60 nid 8898@kfi7 refs 3
00000400:00000200:12.0:1773851893.953243:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8898@kfi7 local destination
00000400:00000200:12.0:1773851893.953244:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770101:8770101:1024:4294967295] 8898@kfi7 LPNI seq info [19493:19493:16:4294967295]
00000400:00000200:12.0:1773851893.953246:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002f61be60 nid 8898@kfi7 refs 2
00000400:00000200:12.0:1773851893.953247:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8898@kfi7 to cpt 3
00000400:00000200:12.0:1773851893.953249:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8898@kfi7(8898@kfi7:8898@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851893.953250:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002f61be60 nid 8898@kfi7 refs 3
00000800:00000200:12.0:1773851893.953252:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851893.953253:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851893.953255:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851893.953258:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005a3 Using peer 8898@kfi7(0x1000000000005a3)
00000800:00000200:12.0:1773851893.953261:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0x1000000000005a3: rc=0
00000800:00000200:12.0:1773851893.953263:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851893.953265:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851893.953266:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000017e72a9 refcount 2 to 8706@kfi7
00010000:00000001:12.0:1773851893.953267:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851893.953268:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851893.953268:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851893.953269:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a75adf17 x1859600483073536/t0(0) o400->628a76fd-d25b-407b-9110-dfdaf88879f9@8706@kfi7:620/0 lens 224/224 e 0 to 0 dl 1773851980 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1047-0'
00000100:00100000:12.0:1773851893.953274:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a75adf17 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:628a76fd-d25b-407b-9110-dfdaf88879f9+7:39508:x1859600483073536:12345-8706@kfi7:400:default-tuolumne1047-0 Request processed in 69us (119us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851893.953276:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8706@kfi7, seq: 2289919
00000100:00000040:12.0:1773851893.953277:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000012392ed6 : new rpc_count 0
00000100:00000001:12.0:1773851893.953278:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851893.953279:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851893.953279:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851893.953280:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:12.0:1773851893.953281:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000057e36ed.
00000020:00000040:12.0:1773851893.953282:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000012392ed6 : new refcount 6
00000100:00000001:12.0:1773851893.953283:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851893.953289:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005a3 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851893.953291:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851893.953292:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8898@kfi7: PUT: OK
00000400:00000200:13.0:1773851893.953294:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df1f761c
00000400:00000010:13.0:1773851893.953294:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df1f761c.
00000100:00000001:13.0:1773851893.953295:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851893.953296:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851893.953297:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002f61be60 nid 8898@kfi7 refs 2
00000800:00000200:13.0:1773851893.953298:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 8898@kfi7(00000000d90a87eb):0x0 lsk 1444 rsk 40 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000005a3 Transaction freed
00000800:00000200:29.0:1773851893.958023:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851893.958024:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851893.958026:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851893.958028:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851893.958031:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.958032:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9297@kfi7 : PUT - for me
00000400:00000200:29.0:1773851893.958033:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.958034:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 1
00000400:00000200:29.0:1773851893.958035:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.958036:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000400:00000200:29.0:1773851893.958037:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 3
00000400:00000200:29.0:1773851893.958038:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.958039:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9297@kfi7 of length 224 into portal 12 MB=0x699e172088380
00000400:00000200:29.0:1773851893.958041:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9297@kfi7 of length 224/224 into md 0x77fe1859d [64] + 6120
00000800:00000200:29.0:1773851893.958043:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851893.958045:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851893.958046:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9297@kfi7: PUT: OK
00000100:00000001:29.0:1773851893.958047:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851893.958048:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851893.958049:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005386cc9d.
00000100:00000040:29.0:1773851893.958050:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000005386cc9d x1858043420115840 msgsize 224
00000100:00100000:29.0:1773851893.958052:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-9297@kfi7 (source: 12345-9297@kfi7)
00000100:00000001:29.0:1773851893.958053:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851893.958054:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000100:00000001:30.0:1773851893.958055:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851893.958055:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851893.958055:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851893.958056:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851893.958056:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851893.958057:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851893.958058:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043420115840
00000020:00000001:30.0:1773851893.958059:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851893.958059:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9164a
00000020:00000001:30.0:1773851893.958060:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851893.958064:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cd1be348 refcount=1208
00000020:00000001:30.0:1773851893.958065:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241262080 : -107152468289536 : ffff9e8b9f30d800)
00000020:00000001:30.0:1773851893.958066:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241262080 : -107152468289536 : ffff9e8b9f30d800)
00000100:00000001:30.0:1773851893.958067:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.958068:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851893.958069:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006392c63e.
00000020:00000010:30.0:1773851893.958070:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.958071:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000818b6cb1.
00000100:00000001:30.0:1773851893.958072:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851893.958073:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851893.958073:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.958075:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851893.958075:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851893.958076:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.958077:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.958078:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851893.958079:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851893.958079:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851893.958079:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851893.958080:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9297@kfi7, seq: 2055587
00000100:00000001:31.0:1773851893.958081:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851893.958081:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.958081:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cd1be348 : new rpc_count 15
00000100:00000001:30.0:1773851893.958081:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262230528 : -106943447321088 : ffff9ebc49cfb600)
00000100:00000040:30.0:1773851893.958083:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005386cc9d x1858043420115840/t0(0) o400->a871cb5b-5147-4743-a621-894b5cc44762@9297@kfi7:681/0 lens 224/0 e 0 to 0 dl 1773852041 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1074-0'
00000100:00000001:30.0:1773851893.958086:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.958087:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851893.958088:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005386cc9d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:a871cb5b-5147-4743-a621-894b5cc44762+1208:39820:x1858043420115840:12345-9297@kfi7:400:default-tuolumne1074-0
00000100:00000200:30.0:1773851893.958090:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043420115840
00000020:00000001:30.0:1773851893.958091:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851893.958091:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851893.958092:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.958093:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851893.958094:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851893.958095:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851893.958095:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043420115840, found 0 last_xid 1858043412959743
00000020:00000001:30.0:1773851893.958096:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851893.958098:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851893.958099:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851893.958099:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.958100:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851893.958101:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851893.958102:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851893.958102:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007af973a9.
02000000:00000001:30.0:1773851893.958103:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.958104:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.958105:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851893.958105:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581362, transno 0, xid 1858043420115840
00010000:00000001:30.0:1773851893.958106:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851893.958107:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005386cc9d x1858043420115840/t0(0) o400->a871cb5b-5147-4743-a621-894b5cc44762@9297@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1074-0'
00010000:00000001:30.0:1773851893.958110:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851893.958111:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851893.958112:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=126 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851893.958113:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851893.958114:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f587cd0e refcount 3 to 9297@kfi7
00000100:00000001:30.0:1773851893.958115:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064608 : -107155994487008 : ffff9e8acd035720)
02000000:00000001:30.0:1773851893.958116:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851893.958116:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.958117:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851893.958118:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9297@kfi7
00000400:00000010:30.0:1773851893.958119:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000008a5c228.
00000100:00000200:30.0:1773851893.958120:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043420115840, offset 224
00000400:00000200:30.0:1773851893.958121:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9297@kfi7
00000400:00000200:30.0:1773851893.958122:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.958123:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 1
00000400:00000200:30.0:1773851893.958124:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000400:00000200:30.0:1773851893.958126:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 3
00000400:00000200:30.0:1773851893.958128:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9297@kfi7 local destination
00000400:00000200:30.0:1773851893.958129:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770102:8770102:1024:4294967295] 9297@kfi7 LPNI seq info [9440471:9440471:16:4294967295]
00000400:00000200:30.0:1773851893.958131:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000400:00000200:30.0:1773851893.958133:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9297@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.958135:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9297@kfi7(9297@kfi7:9297@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851893.958137:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 3
00000800:00000200:30.0:1773851893.958138:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851893.958140:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851893.958142:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851893.958145:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x69a Using peer 9297@kfi7(0x69a)
00000800:00000200:30.0:1773851893.958148:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000c05b04ad: Posted send of 324 bytes to peer 0x69a: rc=0
00000800:00000200:30.0:1773851893.958150:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x69a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851893.958152:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.958153:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f587cd0e refcount 2 to 9297@kfi7
00010000:00000001:30.0:1773851893.958154:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851893.958154:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.958155:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851893.958155:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005386cc9d x1858043420115840/t0(0) o400->a871cb5b-5147-4743-a621-894b5cc44762@9297@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1074-0'
00000100:00100000:30.0:1773851893.958159:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005386cc9d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:a871cb5b-5147-4743-a621-894b5cc44762+1208:39820:x1858043420115840:12345-9297@kfi7:400:default-tuolumne1074-0 Request processed in 71us (108us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851893.958161:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9297@kfi7, seq: 2055587
00000100:00000040:30.0:1773851893.958162:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cd1be348 : new rpc_count 14
00000800:00000200:29.0:1773851893.958162:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x69a TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851893.958163:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851893.958164:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851893.958164:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851893.958164:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851893.958165:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000818b6cb1.
00000400:00000200:29.0:1773851893.958165:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9297@kfi7: PUT: OK
00000020:00000010:30.0:1773851893.958166:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006392c63e.
00000020:00000040:30.0:1773851893.958166:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000cd1be348 : new refcount 1207
00000400:00000200:29.0:1773851893.958166:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000008a5c228
00000400:00000010:29.0:1773851893.958166:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000008a5c228.
00000100:00000001:30.0:1773851893.958167:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851893.958167:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851893.958168:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851893.958168:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfedf8d8 nid 9297@kfi7 refs 2
00000800:00000200:29.0:1773851893.958170:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2069@kfi7:7 -> 9297@kfi7(0000000075014fdf):0x0 lsk 1691 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x69a Transaction freed
00000800:00000200:29.0:1773851893.999043:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851893.999044:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851893.999045:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851893.999047:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851893.999049:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10352@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.999050:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10352@kfi7 : PUT - for me
00000400:00000200:29.0:1773851893.999051:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10352@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.999054:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b416ba62 nid 10352@kfi7 refs 1
00000400:00000200:29.0:1773851893.999055:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10352@kfi7 to cpt 7
00000400:00000200:29.0:1773851893.999055:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b416ba62 nid 10352@kfi7 refs 2
00000400:00000200:29.0:1773851893.999056:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b416ba62 nid 10352@kfi7 refs 3
00000400:00000200:29.0:1773851893.999057:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10416@kfi7 to cpt 2
00000400:00000200:29.0:1773851893.999058:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10416@kfi7 of length 224 into portal 12 MB=0x69b4b570b4800
00000400:00000200:29.0:1773851893.999059:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10416@kfi7 of length 224/224 into md 0x77fe1859d [64] + 6344
00000800:00000200:29.0:1773851893.999060:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851893.999062:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851893.999063:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10352@kfi7: PUT: OK
00000100:00000001:29.0:1773851893.999063:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851893.999064:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851893.999064:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000778d9d72.
00000100:00000040:29.0:1773851893.999065:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000778d9d72 x1859597745473536 msgsize 224
00000100:00100000:29.0:1773851893.999067:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-10416@kfi7 (source: 12345-10352@kfi7)
00000100:00000001:29.0:1773851893.999068:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851893.999069:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b416ba62 nid 10352@kfi7 refs 2
00000100:00000001:30.0:1773851893.999070:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851893.999070:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851893.999070:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851893.999070:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851893.999071:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851893.999071:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851893.999072:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597745473536
00000020:00000001:30.0:1773851893.999072:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851893.999073:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d78be1
00000020:00000001:30.0:1773851893.999073:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851893.999077:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a0566eb2 refcount=5
00000020:00000001:30.0:1773851893.999078:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637141385606144 : -106932323945472 : ffff9ebee0d0f400)
00000020:00000001:30.0:1773851893.999079:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637141385606144 : -106932323945472 : ffff9ebee0d0f400)
00000100:00000001:30.0:1773851893.999080:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.999081:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851893.999081:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006392c63e.
00000020:00000010:30.0:1773851893.999082:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.999083:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000818b6cb1.
00000100:00000001:30.0:1773851893.999083:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851893.999084:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851893.999084:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851893.999085:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851893.999085:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851893.999086:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.999087:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851893.999088:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851893.999088:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851893.999088:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851893.999088:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851893.999089:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10416@kfi7, seq: 2055588
00000100:00000001:31.0:1773851893.999090:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851893.999090:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.999090:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a0566eb2 : new rpc_count 1
00000100:00000001:30.0:1773851893.999090:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262235136 : -106943447316480 : ffff9ebc49cfc800)
00000100:00000040:30.0:1773851893.999091:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000778d9d72 x1859597745473536/t0(0) o400->6865b3de-8986-41ba-ae28-5c6fbf9f836a@10416@kfi7:681/0 lens 224/0 e 0 to 0 dl 1773852041 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1134-0'
00000100:00000001:30.0:1773851893.999094:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851893.999095:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851893.999096:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000778d9d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6865b3de-8986-41ba-ae28-5c6fbf9f836a+5:39478:x1859597745473536:12345-10416@kfi7:400:default-tuolumne1134-0
00000100:00000200:30.0:1773851893.999097:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597745473536
00000020:00000001:30.0:1773851893.999098:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851893.999098:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851893.999099:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.999100:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851893.999100:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851893.999101:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851893.999101:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597745473536, found 0 last_xid 1859597745473535
00000020:00000001:30.0:1773851893.999102:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851893.999102:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851893.999103:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851893.999103:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.999104:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851893.999104:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851893.999104:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851893.999105:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c4f0577e.
02000000:00000001:30.0:1773851893.999105:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.999106:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.999106:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851893.999107:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181931402040, transno 0, xid 1859597745473536
00010000:00000001:30.0:1773851893.999108:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851893.999108:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000778d9d72 x1859597745473536/t0(0) o400->6865b3de-8986-41ba-ae28-5c6fbf9f836a@10416@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1134-0'
00010000:00000001:30.0:1773851893.999111:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851893.999111:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851893.999112:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=126 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851893.999113:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851893.999113:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e25b6d73 refcount 3 to 10416@kfi7
00000100:00000001:30.0:1773851893.999114:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526775776 : -107156182775840 : ffff9e8ac1ca47e0)
02000000:00000001:30.0:1773851893.999115:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851893.999115:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851893.999115:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851893.999116:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10352@kfi7
00000400:00000010:30.0:1773851893.999117:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f582648.
00000100:00000200:30.0:1773851893.999118:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597745473536, offset 224
00000400:00000200:30.0:1773851893.999119:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10352@kfi7
00000400:00000200:30.0:1773851893.999120:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10352@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.999121:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b416ba62 nid 10352@kfi7 refs 1
00000400:00000200:30.0:1773851893.999121:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b416ba62 nid 10352@kfi7 refs 2
00000400:00000200:30.0:1773851893.999123:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b416ba62 nid 10352@kfi7 refs 3
00000400:00000200:30.0:1773851893.999124:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10352@kfi7 local destination
00000400:00000200:30.0:1773851893.999125:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770103:8770103:1024:4294967295] 10352@kfi7 LPNI seq info [805426:805426:16:4294967295]
00000400:00000200:30.0:1773851893.999126:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b416ba62 nid 10352@kfi7 refs 2
00000400:00000200:30.0:1773851893.999127:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10352@kfi7 to cpt 7
00000400:00000200:30.0:1773851893.999129:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10352@kfi7(10352@kfi7:10352@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851893.999130:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b416ba62 nid 10352@kfi7 refs 3
00000800:00000200:30.0:1773851893.999132:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851893.999132:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851893.999134:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851893.999136:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe0 Using peer 10352@kfi7(0xe0)
00000800:00000200:30.0:1773851893.999139:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 0000000030498a96: Posted send of 324 bytes to peer 0xe0: rc=0
00000800:00000200:30.0:1773851893.999140:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851893.999142:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851893.999143:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e25b6d73 refcount 2 to 10416@kfi7
00010000:00000001:30.0:1773851893.999143:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851893.999144:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851893.999144:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851893.999145:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000778d9d72 x1859597745473536/t0(0) o400->6865b3de-8986-41ba-ae28-5c6fbf9f836a@10416@kfi7:681/0 lens 224/224 e 0 to 0 dl 1773852041 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1134-0'
00000100:00100000:30.0:1773851893.999148:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000778d9d72 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:6865b3de-8986-41ba-ae28-5c6fbf9f836a+5:39478:x1859597745473536:12345-10416@kfi7:400:default-tuolumne1134-0 Request processed in 53us (82us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851893.999150:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10416@kfi7, seq: 2055588
00000100:00000040:30.0:1773851893.999151:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a0566eb2 : new rpc_count 0
00000100:00000001:30.0:1773851893.999152:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851893.999152:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851893.999152:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe0 TN_EVENT_TX_OK event status 0
00000020:00000010:30.0:1773851893.999153:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851893.999153:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000818b6cb1.
00000020:00000010:30.0:1773851893.999154:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006392c63e.
00000020:00000040:30.0:1773851893.999154:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000a0566eb2 : new refcount 4
00000400:00000200:29.0:1773851893.999154:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851893.999155:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851893.999155:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10352@kfi7: PUT: OK
00000400:00000200:29.0:1773851893.999155:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f582648
00000400:00000010:29.0:1773851893.999156:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f582648.
00000100:00000001:29.0:1773851893.999156:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851893.999157:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851893.999157:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b416ba62 nid 10352@kfi7 refs 2
00000800:00000200:29.0:1773851893.999158:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2069@kfi7:7 -> 10352@kfi7(0000000077534b0f):0x0 lsk 225 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0xe0 Transaction freed
00000800:00000200:13.0:1773851894.088610:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851894.088611:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851894.088612:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851894.088614:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851894.088616:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.088617:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000200:13.0:1773851894.088618:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.088619:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:13.0:1773851894.088620:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.088620:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:13.0:1773851894.088621:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:13.0:1773851894.088622:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.088623:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 224 into portal 12 MB=0x699e0f6f87bc0
00000400:00000200:13.0:1773851894.088624:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-54@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 52328
00000800:00000200:13.0:1773851894.088626:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851894.088627:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.088628:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000100:00000001:13.0:1773851894.088629:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851894.088630:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851894.088631:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8936f85.
00000100:00000040:13.0:1773851894.088631:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000d8936f85 x1858041355467712 msgsize 224
00000100:00100000:13.0:1773851894.088633:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-54@kfi7 (source: 12345-54@kfi7)
00000100:00000001:13.0:1773851894.088634:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851894.088635:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:12.0:1773851894.088635:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851894.088636:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851894.088636:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851894.088636:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851894.088637:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.088638:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.088638:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041355467712
00000020:00000001:12.0:1773851894.088639:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851894.088639:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acd4e96
00000020:00000001:12.0:1773851894.088640:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.088642:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cdfbaf9e refcount=5
00000020:00000001:12.0:1773851894.088643:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636927194141696 : -107146515409920 : ffff9e8d02029400)
00000020:00000001:12.0:1773851894.088644:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636927194141696 : -107146515409920 : ffff9e8d02029400)
00000100:00000001:12.0:1773851894.088645:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.088646:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851894.088647:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000557b870b.
00000020:00000010:12.0:1773851894.088648:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.088649:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065d9b02b.
00000100:00000001:12.0:1773851894.088650:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851894.088651:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851894.088652:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.088653:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851894.088653:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851894.088654:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.088655:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.088656:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851894.088656:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851894.088657:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.088658:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851894.088658:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-54@kfi7, seq: 2289920
00000100:00000040:12.0:1773851894.088658:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cdfbaf9e : new rpc_count 1
00000100:00000001:15.0:1773851894.088659:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.088659:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637024468617216 : -107049240934400 : ffff9ea3a8054800)
00000100:00000001:15.0:1773851894.088660:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.088660:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d8936f85 x1858041355467712/t0(0) o400->lustre5-MDT0001-lwp-OST000f_UUID@54@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba116-0'
00000100:00000001:12.0:1773851894.088663:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.088664:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851894.088665:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8936f85 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:lustre5-MDT0001-lwp-OST000f_UUID+5:272703:x1858041355467712:12345-54@kfi7:400:default-yuba116-0
00000100:00000200:12.0:1773851894.088666:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041355467712
00000020:00000001:12.0:1773851894.088667:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851894.088667:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851894.088668:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.088669:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851894.088669:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851894.088670:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:12.0:1773851894.088671:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851894.088672:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851894.088672:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851894.088673:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.088673:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851894.088674:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851894.088674:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851894.088675:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001f13c9e1.
02000000:00000001:12.0:1773851894.088676:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.088676:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.088677:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851894.088678:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041355467712
00010000:00000001:12.0:1773851894.088679:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851894.088680:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d8936f85 x1858041355467712/t0(0) o400->lustre5-MDT0001-lwp-OST000f_UUID@54@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba116-0'
00010000:00000001:12.0:1773851894.088683:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851894.088683:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851894.088684:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851894.088685:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851894.088686:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008bf65cfb refcount 7 to 54@kfi7
00000100:00000001:12.0:1773851894.088687:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149440 : -107154898402176 : ffff9e8b0e584480)
02000000:00000001:12.0:1773851894.088688:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851894.088688:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.088689:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851894.088690:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000010:12.0:1773851894.088690:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f7dab02.
00000100:00000200:12.0:1773851894.088691:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041355467712, offset 224
00000400:00000200:12.0:1773851894.088693:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:12.0:1773851894.088694:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.088694:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:12.0:1773851894.088695:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:12.0:1773851894.088697:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:12.0:1773851894.088698:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  54@kfi7 local destination
00000400:00000200:12.0:1773851894.088699:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770104:8770104:1024:4294967295] 54@kfi7 LPNI seq info [5403927:5403927:16:4294967295]
00000400:00000200:12.0:1773851894.088700:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:12.0:1773851894.088701:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.088703:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851894.088704:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000800:00000200:12.0:1773851894.088705:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851894.088707:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851894.088709:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851894.088713:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000800:00000200:12.0:1773851894.088715:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000800:00000200:12.0:1773851894.088717:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851894.088719:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.088720:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008bf65cfb refcount 6 to 54@kfi7
00010000:00000001:12.0:1773851894.088721:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851894.088721:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.088722:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851894.088724:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8936f85 x1858041355467712/t0(0) o400->lustre5-MDT0001-lwp-OST000f_UUID@54@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba116-0'
00000100:00100000:12.0:1773851894.088731:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8936f85 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:lustre5-MDT0001-lwp-OST000f_UUID+5:272703:x1858041355467712:12345-54@kfi7:400:default-yuba116-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851894.088733:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-54@kfi7, seq: 2289920
00000100:00000040:12.0:1773851894.088734:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cdfbaf9e : new rpc_count 0
00000100:00000001:12.0:1773851894.088735:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851894.088735:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851894.088736:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.088736:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065d9b02b.
00000020:00000010:12.0:1773851894.088737:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000557b870b.
00000020:00000040:12.0:1773851894.088738:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000cdfbaf9e : new refcount 4
00000100:00000001:12.0:1773851894.088739:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851894.088745:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851894.088747:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851894.088748:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:14.0:1773851894.088749:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f7dab02
00000400:00000010:14.0:1773851894.088749:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f7dab02.
00000100:00000001:14.0:1773851894.088750:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851894.088751:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851894.088751:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000800:00000200:14.0:1773851894.088753:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000004:00000001:25.0:1773851894.089731:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:29.0:1773851894.089732:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851894.089732:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:25.0:1773851894.089732:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851894.089733:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009a83a4ee.
00000100:00000010:25.0:1773851894.089733:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b73f47df.
00000020:00000040:29.0:1773851894.089734:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000020:00000040:25.0:1773851894.089734:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000100:00000001:29.0:1773851894.089735:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:25.0:1773851894.089735:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851894.089736:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:25.0:1773851894.089736:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851894.089737:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851894.089737:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851894.089738:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:29.0:1773851894.089739:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851894.089739:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000294dbfa2.
00000100:00000001:29.0:1773851894.089740:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851894.089740:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851894.089741:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851894.089741:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851894.089742:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851894.089743:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000009a83a4ee] to pc [ptlrpcd_07_01+1]  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851894.089743:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b73f47df] to pc [ptlrpcd_06_01+1]  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851894.089746:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:29.0:1773851894.089747:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000077b2db51.
00080000:00000001:25.0:1773851894.089747:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851894.089748:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851894.089748:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851894.089748:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851894.089748:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851894.089748:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636993887994880 : -107079821556736 : ffff9e9c89460400)
00000100:00000001:27.0:1773851894.089748:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851894.089748:0:41084:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:25.0:1773851894.089748:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f33ed81a.
00000100:00000001:31.0:1773851894.089749:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851894.089749:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:27.0:1773851894.089749:0:41085:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851894.089749:0:41084:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851894.089749:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637141814052864 : -106931895498752 : ffff9ebefa5a8800)
00000100:00000040:31.0:1773851894.089750:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851894.089750:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089750:0:41085:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:25.0:1773851894.089750:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:27.0:1773851894.089751:0:41085:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:25.0:1773851894.089751:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851894.089752:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000004:00001000:25.0:1773851894.089752:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000100:00000001:31.0:1773851894.089753:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851894.089753:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:29.0:1773851894.089753:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000bb14be4f.
00000100:00000001:27.0:1773851894.089753:0:41085:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:25.0:1773851894.089753:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000019849f26.
02000000:00000001:31.0:1773851894.089754:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:29.0:1773851894.089754:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614168543029122ns, next at 614169543028030ns, rc = 0
00000100:00000001:27.0:1773851894.089754:0:41085:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:25.0:1773851894.089754:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614168543029472ns, next at 614169543028200ns, rc = 0
02000000:00000001:31.0:1773851894.089755:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851894.089755:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:27.0:1773851894.089755:0:41085:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:27.0:1773851894.089755:0:41085:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851894.089755:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:31.0:1773851894.089756:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009a83a4ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051939072:2090@kfi7:13:default-yuba2-0
00080000:00000001:29.0:1773851894.089756:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851894.089756:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851894.089756:0:41085:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b73f47df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_01:lustre5-MDT0001-mdtlov_UUID:41085:1859433051939136:2068@kfi7:13:default-yuba2-0
00080000:00000001:25.0:1773851894.089756:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089757:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:25.0:1773851894.089757:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851894.089758:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851894.089758:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089758:0:41085:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:27.0:1773851894.089758:0:41085:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851894.089759:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:27.0:1773851894.089759:0:41085:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851894.089760:0:41085:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:27.0:1773851894.089760:0:41085:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000ac1b785e.
02000000:00000010:31.0:1773851894.089761:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000409ff7c5.
02000000:00000001:27.0:1773851894.089761:0:41085:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851894.089762:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851894.089763:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:31.0:1773851894.089763:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000400:00000200:27.0:1773851894.089763:0:41085:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000010:31.0:1773851894.089764:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000811703b3.
00000400:00000010:27.0:1773851894.089764:0:41085:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000052625ffc.
00000400:00000010:27.0:1773851894.089765:0:41085:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cea3c950.
00000100:00000200:31.0:1773851894.089766:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939072, portal 4
00000100:00000200:27.0:1773851894.089766:0:41085:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939136, portal 4
00000100:00000001:31.0:1773851894.089767:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851894.089767:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130262244352 : -106943447307264 : ffff9ebc49cfec00)
00000100:00000001:27.0:1773851894.089767:0:41085:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:27.0:1773851894.089767:0:41085:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637106564994688 : -106967144556928 : ffff9eb6c5589680)
00000100:00000040:31.0:1773851894.089769:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:27.0:1773851894.089769:0:41085:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851894.089771:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:27.0:1773851894.089771:0:41085:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851894.089772:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:31.0:1773851894.089773:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007bba7902.
00000100:00000040:27.0:1773851894.089773:0:41085:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:27.0:1773851894.089773:0:41085:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c1ed4bea.
00000100:00000200:31.0:1773851894.089774:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939072, offset 0
00000100:00000200:27.0:1773851894.089774:0:41085:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939136, offset 0
00000400:00000200:31.0:1773851894.089775:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000400:00000200:31.0:1773851894.089776:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851894.089776:0:41085:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:31.0:1773851894.089777:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:27.0:1773851894.089777:0:41085:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851894.089778:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851894.089778:0:41085:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:27.0:1773851894.089779:0:41085:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:31.0:1773851894.089780:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:31.0:1773851894.089781:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000400:00000200:27.0:1773851894.089781:0:41085:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:27.0:1773851894.089782:0:41085:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:31.0:1773851894.089783:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770103, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770104, p:4294967295, g:4294967295, h:1000]
00000400:00000200:27.0:1773851894.089784:0:41085:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770103, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770104, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851894.089785:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851894.089786:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:27.0:1773851894.089786:0:41085:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851894.089787:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:27.0:1773851894.089787:0:41085:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851894.089788:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770105:8770105:1024:4294967295] 2090@kfi7 LPNI seq info [5404256:5404256:16:4294967295]
00000400:00000200:27.0:1773851894.089788:0:41085:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000400:00000200:27.0:1773851894.089789:0:41085:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770106:8770106:1024:4294967295] 2068@kfi7 LPNI seq info [5403703:5403703:16:4294967295]
00000400:00000200:31.0:1773851894.089790:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:31.0:1773851894.089791:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851894.089791:0:41085:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:27.0:1773851894.089792:0:41085:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851894.089793:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851894.089794:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:27.0:1773851894.089795:0:41085:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000800:00000200:31.0:1773851894.089796:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:27.0:1773851894.089796:0:41085:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:31.0:1773851894.089797:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851894.089798:0:41085:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:31.0:1773851894.089799:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851894.089799:0:41085:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851894.089801:0:41085:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851894.089802:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000800:00000200:27.0:1773851894.089804:0:41085:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Using peer 2068@kfi7(0x62f)
00000800:00000200:31.0:1773851894.089805:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:31.0:1773851894.089807:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:27.0:1773851894.089807:0:41085:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x62f: rc=0
00000800:00000200:27.0:1773851894.089808:0:41085:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851894.089809:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089809:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851894.089810:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089810:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089810:0:41085:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089811:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.089811:0:41085:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851894.089812:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851894.089812:0:41085:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089813:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851894.089813:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851894.089813:0:41085:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089813:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851894.089814:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851894.089814:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089815:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089815:0:41085:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851894.089815:0:41085:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:27.0:1773851894.089816:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851894.089816:0:41085:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851894.089817:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851894.089817:0:41085:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089818:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851894.089818:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851894.089819:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851894.089820:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:25.0:1773851894.089820:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851894.089821:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007bba7902
00000400:00000010:29.0:1773851894.089821:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007bba7902.
00000400:00000200:25.0:1773851894.089821:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000100:00000001:29.0:1773851894.089822:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851894.089822:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851894.089822:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c1ed4bea
00000400:00000010:25.0:1773851894.089822:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c1ed4bea.
00000100:00000001:25.0:1773851894.089823:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:25.0:1773851894.089824:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851894.089825:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851894.089826:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851894.089827:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851894.089828:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851894.089828:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851894.089829:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851894.089830:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:25.0:1773851894.089830:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851894.089831:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000100:00000001:25.0:1773851894.089831:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.089832:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:25.0:1773851894.089833:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 6 tta 0x62f Transaction freed
00000800:00000200:1.0:1773851894.089852:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.089853:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.089854:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.089857:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.089859:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.089860:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.089861:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.089862:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000800:00000200:21.0:1773851894.089863:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:1.0:1773851894.089863:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851894.089864:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:1.0:1773851894.089864:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851894.089865:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:21.0:1773851894.089866:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.089866:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851894.089868:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.089868:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6100
00000400:00000200:21.0:1773851894.089870:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851894.089870:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.089871:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71e241 [1] + 224
00000400:00000200:21.0:1773851894.089872:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:21.0:1773851894.089873:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:1.0:1773851894.089873:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851894.089874:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:21.0:1773851894.089875:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:1.0:1773851894.089875:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.089876:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:21.0:1773851894.089876:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:1.0:1773851894.089876:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:21.0:1773851894.089877:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.089878:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6140
00000100:00000001:1.0:1773851894.089878:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851894.089879:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000200:1.0:1773851894.089879:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851894.089881:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d1cf5 [1] + 224
00000100:00000040:1.0:1773851894.089882:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851894.089883:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851894.089885:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.089886:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2068@kfi7: PUT: OK
00000100:00000001:21.0:1773851894.089887:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:1.0:1773851894.089887:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:21.0:1773851894.089888:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851894.089888:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:31.0:1773851894.089889:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851894.089889:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:1.0:1773851894.089890:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:31.0:1773851894.089891:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851894.089891:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851894.089892:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:31.0:1773851894.089892:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000811703b3
00000100:00000040:21.0:1773851894.089892:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851894.089893:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000811703b3.
00000100:00000001:31.0:1773851894.089894:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:31.0:1773851894.089895:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851894.089895:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851894.089896:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:27.0:1773851894.089897:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:31.0:1773851894.089898:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851894.089898:0:41085:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851894.089898:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2068@kfi7(00000000a5e09b58):0x0 lsk 1584 rsk 4793 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:27.0:1773851894.089899:0:41085:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:27.0:1773851894.089900:0:41085:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851894.089901:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851894.089901:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:27.0:1773851894.089901:0:41085:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000052625ffc.
00000400:00000200:27.0:1773851894.089901:0:41085:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cea3c950
00000100:00000001:31.0:1773851894.089902:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851894.089902:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000010:27.0:1773851894.089902:0:41085:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cea3c950.
00000100:00000001:31.0:1773851894.089903:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851894.089903:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089903:0:41085:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:31.0:1773851894.089904:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:27.0:1773851894.089904:0:41085:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851894.089905:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=127 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851894.089906:0:41089:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=127 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851894.089907:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:27.0:1773851894.089907:0:41085:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851894.089908:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851894.089908:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851894.089909:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089909:0:41085:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851894.089910:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851894.089910:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:27.0:1773851894.089910:0:41085:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851894.089911:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851894.089911:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089911:0:41085:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:27.0:1773851894.089911:0:41085:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:31.0:1773851894.089912:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:27.0:1773851894.089912:0:41085:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851894.089912:0:41085:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851894.089913:0:41085:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851894.089914:0:41085:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=127 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851894.089915:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:27.0:1773851894.089915:0:41085:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=127 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851894.089916:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851894.089916:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.089916:0:41085:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:27.0:1773851894.089916:0:41085:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851894.089917:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00010000:00000001:27.0:1773851894.089917:0:41085:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000040:31.0:1773851894.089918:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851894.089918:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351388963840 avail=351386269696 avail_mb=1372602616 hwm_mb=3131103 files=372019008 ffree=343153285 state=0: rc = 0
00010000:00000001:27.0:1773851894.089918:0:41085:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.089919:0:41085:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:27.0:1773851894.089919:0:41085:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:27.0:1773851894.089920:0:41085:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:27.0:1773851894.089920:0:41085:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851894.089921:0:41085:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:27.0:1773851894.089924:0:41085:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:27.0:1773851894.089925:0:41085:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:27.0:1773851894.089925:0:41085:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:27.0:1773851894.089926:0:41085:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:27.0:1773851894.089926:0:41085:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:27.0:1773851894.089927:0:41085:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350958951424 avail=350956868608 avail_mb=1370925268 hwm_mb=3131103 files=371563891 ffree=342733351 state=0: rc = 0
00000004:00000020:27.0:1773851894.089930:0:41085:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350958951424 free, 350956868608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371563891 files, 342733351 free files
00000004:00000020:31.0:1773851894.089932:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351388963840 free, 351386269696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019008 files, 343153285 free files
00000004:00000001:27.0:1773851894.089932:0:41085:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851894.089933:0:41085:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:31.0:1773851894.089934:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851894.089935:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:27.0:1773851894.089936:0:41085:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b73f47df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_01:lustre5-MDT0001-mdtlov_UUID:41085:1859433051939136:2068@kfi7:13:default-yuba2-0
00000100:00000001:27.0:1773851894.089937:0:41085:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:31.0:1773851894.089938:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009a83a4ee pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051939072:2090@kfi7:13:default-yuba2-0
00000100:00000001:27.0:1773851894.089938:0:41085:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:27.0:1773851894.089939:0:41085:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b73f47df x1859433051939136/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851894.089940:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851894.089940:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851894.089941:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000009a83a4ee x1859433051939072/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:27.0:1773851894.089941:0:41085:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:27.0:1773851894.089942:0:41085:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:27.0:1773851894.089942:0:41085:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000ac1b785e.
02000000:00000001:27.0:1773851894.089943:0:41085:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:31.0:1773851894.089944:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851894.089944:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:27.0:1773851894.089944:0:41085:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:27.0:1773851894.089944:0:41085:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
02000000:00000010:31.0:1773851894.089945:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000409ff7c5.
00000020:00000001:27.0:1773851894.089945:0:41085:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:27.0:1773851894.089945:0:41085:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000294dbfa2.
02000000:00000001:31.0:1773851894.089946:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851894.089946:0:41089:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:27.0:1773851894.089946:0:41085:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000040:31.0:1773851894.089947:0:41089:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
02000000:00000001:27.0:1773851894.089947:0:41085:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:31.0:1773851894.089948:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851894.089948:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000100:00000010:27.0:1773851894.089948:0:41085:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b73f47df.
00000100:00000001:27.0:1773851894.089948:0:41085:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:31.0:1773851894.089949:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:27.0:1773851894.089949:0:41085:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.089949:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851894.089950:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851894.089950:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009a83a4ee.
00000100:00000001:27.0:1773851894.089950:0:41085:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851894.089950:0:41085:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089951:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851894.089951:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.089951:0:41085:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851894.089951:0:41085:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089952:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851894.089953:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851894.089953:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851894.089954:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851894.089954:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851894.108850:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851894.108851:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851894.108852:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851894.108854:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851894.108856:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18771@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.108857:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18771@kfi7 : PUT - for me
00000400:00000200:21.0:1773851894.108858:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18771@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.108860:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009dab54b1 nid 18771@kfi7 refs 1
00000400:00000200:21.0:1773851894.108861:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18771@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.108862:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009dab54b1 nid 18771@kfi7 refs 2
00000400:00000200:21.0:1773851894.108863:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009dab54b1 nid 18771@kfi7 refs 3
00000400:00000200:21.0:1773851894.108863:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18770@kfi7 to cpt 2
00000400:00000200:21.0:1773851894.108864:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18770@kfi7 of length 224 into portal 12 MB=0x69b81a8120680
00000400:00000200:21.0:1773851894.108865:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18770@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 62032
00000800:00000200:21.0:1773851894.108867:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851894.108868:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.108870:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18771@kfi7: PUT: OK
00000100:00000001:21.0:1773851894.108871:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851894.108872:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851894.108873:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000079480601.
00000100:00000040:21.0:1773851894.108874:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000079480601 x1859831033104000 msgsize 224
00000100:00100000:21.0:1773851894.108875:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18770@kfi7 (source: 12345-18771@kfi7)
00000100:00000001:21.0:1773851894.108876:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851894.108877:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009dab54b1 nid 18771@kfi7 refs 2
00000100:00000001:20.0:1773851894.108878:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851894.108879:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851894.108879:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851894.108879:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851894.108880:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851894.108881:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851894.108881:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831033104000
00000020:00000001:20.0:1773851894.108882:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851894.108882:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce4b441
00000020:00000001:20.0:1773851894.108883:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851894.108887:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000331b0454 refcount=5
00000020:00000001:20.0:1773851894.108887:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106840923136 : -106966868628480 : ffff9eb6d5caec00)
00000020:00000001:20.0:1773851894.108888:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106840923136 : -106966868628480 : ffff9eb6d5caec00)
00000100:00000001:20.0:1773851894.108889:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851894.108890:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851894.108891:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851894.108892:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851894.108893:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851894.108894:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851894.108894:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851894.108895:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.108896:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851894.108896:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851894.108897:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.108898:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.108899:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851894.108900:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851894.108900:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851894.108900:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851894.108901:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18770@kfi7, seq: 1998067
00000100:00000040:20.0:1773851894.108901:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000331b0454 : new rpc_count 1
00000100:00000001:23.0:1773851894.108902:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851894.108902:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.108902:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701990528 : -106936007561088 : ffff9ebe05417080)
00000100:00000040:20.0:1773851894.108903:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000079480601 x1859831033104000/t0(0) o400->4f727e67-990b-4b41-87dd-88538c4a514f@18770@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1670-0'
00000100:00000001:20.0:1773851894.108906:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851894.108907:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851894.108908:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079480601 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4f727e67-990b-4b41-87dd-88538c4a514f+5:39438:x1859831033104000:12345-18770@kfi7:400:default-tuolumne1670-0
00000100:00000200:20.0:1773851894.108910:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831033104000
00000020:00000001:20.0:1773851894.108910:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851894.108911:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851894.108912:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.108912:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851894.108913:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851894.108914:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851894.108914:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831033104000, found 0 last_xid 1859831033103999
00000020:00000001:20.0:1773851894.108915:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851894.108916:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851894.108916:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851894.108917:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.108918:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851894.108918:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851894.108919:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851894.108920:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007a3162e7.
02000000:00000001:20.0:1773851894.108920:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.108921:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.108921:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851894.108922:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260655899, transno 0, xid 1859831033104000
00010000:00000001:20.0:1773851894.108923:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851894.108924:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000079480601 x1859831033104000/t0(0) o400->4f727e67-990b-4b41-87dd-88538c4a514f@18770@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1670-0'
00010000:00000001:20.0:1773851894.108926:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851894.108926:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851894.108927:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=127 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851894.108928:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851894.108929:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e31b4cf1 refcount 3 to 18770@kfi7
00000100:00000001:20.0:1773851894.108930:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810488192 : -107154899063424 : ffff9e8b0e4e2d80)
02000000:00000001:20.0:1773851894.108930:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851894.108931:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.108932:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851894.108932:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18771@kfi7
00000400:00000010:20.0:1773851894.108933:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e022745.
00000100:00000200:20.0:1773851894.108935:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831033104000, offset 224
00000400:00000200:20.0:1773851894.108936:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18771@kfi7
00000400:00000200:20.0:1773851894.108937:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18771@kfi7 to cpt 5
00000400:00000200:20.0:1773851894.108938:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009dab54b1 nid 18771@kfi7 refs 1
00000400:00000200:20.0:1773851894.108939:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009dab54b1 nid 18771@kfi7 refs 2
00000400:00000200:20.0:1773851894.108940:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009dab54b1 nid 18771@kfi7 refs 3
00000400:00000200:20.0:1773851894.108941:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18771@kfi7 local destination
00000400:00000200:20.0:1773851894.108942:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770107:8770107:1024:4294967295] 18771@kfi7 LPNI seq info [9181960:9181960:16:4294967295]
00000400:00000200:20.0:1773851894.108944:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009dab54b1 nid 18771@kfi7 refs 2
00000400:00000200:20.0:1773851894.108945:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18771@kfi7 to cpt 5
00000400:00000200:20.0:1773851894.108947:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18771@kfi7(18771@kfi7:18771@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851894.108948:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009dab54b1 nid 18771@kfi7 refs 3
00000800:00000200:20.0:1773851894.108949:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851894.108950:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851894.108952:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851894.108954:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000642 Using peer 18771@kfi7(0x100000000000642)
00000800:00000200:20.0:1773851894.108957:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x100000000000642: rc=0
00000800:00000200:20.0:1773851894.108959:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000642 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851894.108961:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851894.108962:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e31b4cf1 refcount 2 to 18770@kfi7
00010000:00000001:20.0:1773851894.108963:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851894.108963:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.108964:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851894.108964:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000079480601 x1859831033104000/t0(0) o400->4f727e67-990b-4b41-87dd-88538c4a514f@18770@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1670-0'
00000100:00100000:20.0:1773851894.108968:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079480601 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:4f727e67-990b-4b41-87dd-88538c4a514f+5:39438:x1859831033104000:12345-18770@kfi7:400:default-tuolumne1670-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851894.108970:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18770@kfi7, seq: 1998067
00000100:00000040:20.0:1773851894.108971:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000331b0454 : new rpc_count 0
00000100:00000001:20.0:1773851894.108972:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851894.108973:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851894.108973:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851894.108974:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851894.108975:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851894.108975:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000331b0454 : new refcount 4
00000100:00000001:20.0:1773851894.108976:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851894.108981:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000642 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851894.108982:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.108984:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18771@kfi7: PUT: OK
00000400:00000200:21.0:1773851894.108984:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e022745
00000400:00000010:21.0:1773851894.108985:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e022745.
00000100:00000001:21.0:1773851894.108985:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851894.108986:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851894.108987:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009dab54b1 nid 18771@kfi7 refs 2
00000800:00000200:21.0:1773851894.108988:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 18771@kfi7(00000000e514445a):0x0 lsk 1603 rsk 41 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000642 Transaction freed
00080000:00000001:30.0:1773851894.175761:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851894.175763:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851894.175789:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851894.175789:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851894.175815:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851894.175815:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851894.175841:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851894.175841:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851894.175999:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000ce3b9347 (tot 253201139).
00000400:00000010:30.0:1773851894.176001:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000ce3b9347 (tot 253200883).
00000800:00000200:29.0:1773851894.176360:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851894.176361:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851894.176362:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851894.176364:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851894.176366:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:29.0:1773851894.176367:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26338@kfi7 : PUT - for me
00000400:00000200:29.0:1773851894.176368:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:29.0:1773851894.176369:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 1
00000400:00000200:29.0:1773851894.176371:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:29.0:1773851894.176371:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000400:00000200:29.0:1773851894.176372:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 3
00000400:00000200:29.0:1773851894.176373:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26339@kfi7 to cpt 2
00000400:00000200:29.0:1773851894.176374:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26339@kfi7 of length 224 into portal 12 MB=0x69b4c983d4740
00000400:00000200:29.0:1773851894.176375:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26339@kfi7 of length 224/224 into md 0x77fe1859d [64] + 6568
00000800:00000200:29.0:1773851894.176377:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851894.176379:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851894.176380:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26338@kfi7: PUT: OK
00000100:00000001:29.0:1773851894.176381:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851894.176381:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851894.176382:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009270d01d.
00000100:00000040:29.0:1773851894.176383:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000009270d01d x1859603134236480 msgsize 224
00000100:00100000:29.0:1773851894.176384:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26339@kfi7 (source: 12345-26338@kfi7)
00000100:00000001:29.0:1773851894.176385:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851894.176386:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000100:00000001:30.0:1773851894.176387:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851894.176387:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851894.176387:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851894.176388:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851894.176388:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851894.176389:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851894.176390:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603134236480
00000020:00000001:30.0:1773851894.176391:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851894.176392:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8ad98
00000020:00000001:30.0:1773851894.176392:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851894.176395:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d50c132c refcount=326
00000020:00000001:30.0:1773851894.176396:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123859012608 : -106949850539008 : ffff9ebacc265c00)
00000020:00000001:30.0:1773851894.176397:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123859012608 : -106949850539008 : ffff9ebacc265c00)
00000100:00000001:30.0:1773851894.176398:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851894.176399:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851894.176400:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ed3b313.
00000020:00000010:30.0:1773851894.176402:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851894.176402:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000818b6cb1.
00000100:00000001:30.0:1773851894.176403:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851894.176404:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851894.176405:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851894.176406:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851894.176406:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851894.176407:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851894.176408:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851894.176410:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851894.176410:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851894.176411:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851894.176412:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851894.176412:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26339@kfi7, seq: 2055589
00000100:00000001:31.0:1773851894.176413:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851894.176413:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d50c132c : new rpc_count 3
00000100:00000001:30.0:1773851894.176413:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262237440 : -106943447314176 : ffff9ebc49cfd100)
00000100:00000001:31.0:1773851894.176414:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851894.176415:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009270d01d x1859603134236480/t0(0) o400->fdd24a38-47c3-4c58-b1b4-7859bf98b5b5@26339@kfi7:682/0 lens 224/0 e 0 to 0 dl 1773852042 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2123-0'
00000100:00000001:30.0:1773851894.176418:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851894.176418:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851894.176420:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009270d01d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:fdd24a38-47c3-4c58-b1b4-7859bf98b5b5+326:39648:x1859603134236480:12345-26339@kfi7:400:default-tuolumne2123-0
00000100:00000200:30.0:1773851894.176421:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603134236480
00000020:00000001:30.0:1773851894.176422:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851894.176423:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851894.176423:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851894.176424:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851894.176425:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851894.176426:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851894.176426:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603134236480, found 0 last_xid 1859603072330111
00000020:00000001:30.0:1773851894.176427:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851894.176428:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851894.176428:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851894.176429:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851894.176433:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851894.176434:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851894.176434:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851894.176435:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002ea6482c.
02000000:00000001:30.0:1773851894.176436:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851894.176437:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851894.176437:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851894.176438:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263898747, transno 0, xid 1859603134236480
00010000:00000001:30.0:1773851894.176439:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851894.176440:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009270d01d x1859603134236480/t0(0) o400->fdd24a38-47c3-4c58-b1b4-7859bf98b5b5@26339@kfi7:682/0 lens 224/224 e 0 to 0 dl 1773852042 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2123-0'
00010000:00000001:30.0:1773851894.176444:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851894.176444:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851894.176445:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=127 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851894.176446:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851894.176447:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000390ef8b refcount 3 to 26339@kfi7
00000100:00000001:30.0:1773851894.176448:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526776352 : -107156182775264 : ffff9e8ac1ca4a20)
02000000:00000001:30.0:1773851894.176449:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851894.176450:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851894.176450:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851894.176451:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26338@kfi7
00000400:00000010:30.0:1773851894.176452:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000086f5fbd7.
00000100:00000200:30.0:1773851894.176453:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859603134236480, offset 224
00000400:00000200:30.0:1773851894.176455:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26338@kfi7
00000400:00000200:30.0:1773851894.176456:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:30.0:1773851894.176457:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 1
00000400:00000200:30.0:1773851894.176459:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000400:00000200:30.0:1773851894.176460:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 3
00000400:00000200:30.0:1773851894.176462:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26338@kfi7 local destination
00000400:00000200:30.0:1773851894.176463:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770108:8770108:1024:4294967295] 26338@kfi7 LPNI seq info [16184845:16184845:16:4294967295]
00000400:00000200:30.0:1773851894.176465:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000400:00000200:30.0:1773851894.176465:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:30.0:1773851894.176467:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26338@kfi7(26338@kfi7:26338@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851894.176469:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 3
00000800:00000200:30.0:1773851894.176471:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851894.176472:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851894.176474:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851894.176477:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x509 Using peer 26338@kfi7(0x509)
00000800:00000200:30.0:1773851894.176480:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x509: rc=0
00000800:00000200:30.0:1773851894.176481:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x509 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851894.176484:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851894.176485:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000390ef8b refcount 2 to 26339@kfi7
00010000:00000001:30.0:1773851894.176486:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851894.176486:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851894.176487:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851894.176488:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009270d01d x1859603134236480/t0(0) o400->fdd24a38-47c3-4c58-b1b4-7859bf98b5b5@26339@kfi7:682/0 lens 224/224 e 0 to 0 dl 1773852042 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2123-0'
00000100:00100000:30.0:1773851894.176491:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009270d01d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:fdd24a38-47c3-4c58-b1b4-7859bf98b5b5+326:39648:x1859603134236480:12345-26339@kfi7:400:default-tuolumne2123-0 Request processed in 72us (107us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851894.176493:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26339@kfi7, seq: 2055589
00000800:00000200:29.0:1773851894.176493:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x509 TN_EVENT_TX_OK event status 0
00000100:00000040:30.0:1773851894.176494:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d50c132c : new rpc_count 2
00000100:00000001:30.0:1773851894.176495:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851894.176495:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851894.176496:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851894.176496:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851894.176496:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26338@kfi7: PUT: OK
00000020:00000010:30.0:1773851894.176497:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000818b6cb1.
00000400:00000200:29.0:1773851894.176497:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000086f5fbd7
00000400:00000010:29.0:1773851894.176497:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000086f5fbd7.
00000020:00000010:30.0:1773851894.176498:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ed3b313.
00000100:00000001:29.0:1773851894.176498:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851894.176498:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:30.0:1773851894.176499:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000d50c132c : new refcount 325
00000100:00000001:30.0:1773851894.176499:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851894.176499:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000800:00000200:29.0:1773851894.176501:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 26338@kfi7(0000000010ae86f3):0x0 lsk 1290 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x509 Transaction freed
00000800:00000200:9.0:1773851894.187801:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851894.187802:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851894.187803:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851894.187805:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851894.187807:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.187809:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.153@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851894.187810:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.187811:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851894.187812:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851894.187813:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000400:00000200:9.0:1773851894.187815:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000400:00000200:9.0:1773851894.187816:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851894.187817:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.153@o2ib600 of length 224 into portal 12 MB=0x69a04689c9800
00000400:00000200:9.0:1773851894.187819:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.153@o2ib600 of length 224/224 into md 0x78146ce49 [64] + 158784
00000800:00000200:9.0:1773851894.187832:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851894.187833:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851894.187834:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851894.187835:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851894.187836:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851894.187837:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000048bc074b.
00000100:00000040:9.0:1773851894.187837:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000048bc074b x1858193585903616 msgsize 224
00000100:00100000:9.0:1773851894.187839:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.153@o2ib600 (source: 12345-172.19.3.153@o2ib600)
00000100:00000001:9.0:1773851894.187840:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851894.187841:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:8.0:1773851894.187842:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851894.187842:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851894.187843:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851894.187843:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851894.187843:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851894.187844:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851894.187845:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858193585903616
00000020:00000001:8.0:1773851894.187846:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851894.187846:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91524
00000020:00000001:8.0:1773851894.187847:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851894.187849:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fff65982 refcount=908
00000020:00000001:8.0:1773851894.187850:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000020:00000001:8.0:1773851894.187851:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241036800 : -107152468514816 : ffff9e8b9f2d6800)
00000100:00000001:8.0:1773851894.187851:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851894.187852:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851894.187853:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000eb2d3ab9.
00000020:00000010:8.0:1773851894.187854:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851894.187855:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851894.187856:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851894.187856:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851894.187857:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851894.187858:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851894.187858:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851894.187859:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.187859:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851894.187861:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851894.187862:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851894.187863:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.153@o2ib600, seq: 2130862
00000100:00000040:9.0:1773851894.187863:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fff65982 : new rpc_count 4
00000100:00000001:9.0:1773851894.187864:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609037440 : -107064100514176 : ffff9ea032521680)
00000100:00000040:9.0:1773851894.187866:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000048bc074b x1858193585903616/t0(0) o400->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic3-0'
00000100:00000001:9.0:1773851894.187869:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851894.187869:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851894.187870:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048bc074b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:14649e2c-1f67-4358-8208-20db0ccc3581+908:26502:x1858193585903616:12345-172.19.3.153@o2ib600:400:login-oslic3-0
00000100:00000200:9.0:1773851894.187872:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858193585903616
00000020:00000001:9.0:1773851894.187872:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851894.187873:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851894.187874:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851894.187874:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851894.187875:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851894.187876:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851894.187877:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858193585903616, found 0 last_xid 1858191889868287
00000020:00000001:9.0:1773851894.187878:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851894.187878:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851894.187879:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851894.187880:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851894.187880:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851894.187881:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851894.187882:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851894.187882:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000321b48d7.
02000000:00000001:9.0:1773851894.187883:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.187884:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851894.187884:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851894.187885:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263991371, transno 0, xid 1858193585903616
00010000:00000001:9.0:1773851894.187886:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851894.187887:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000048bc074b x1858193585903616/t0(0) o400->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic3-0'
00010000:00000001:9.0:1773851894.187889:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851894.187890:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851894.187891:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=127 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851894.187892:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851894.187893:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d98fecdb refcount 3 to 172.19.3.153@o2ib600
00000100:00000001:9.0:1773851894.187893:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935868094912 : -107137841456704 : ffff9e8f070499c0)
02000000:00000001:9.0:1773851894.187894:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851894.187895:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.187895:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851894.187896:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.153@o2ib600
00000400:00000010:9.0:1773851894.187897:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000016999e1e.
00000100:00000200:9.0:1773851894.187898:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858193585903616, offset 224
00000400:00000200:9.0:1773851894.187899:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.153@o2ib600
00000400:00000200:9.0:1773851894.187900:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.153@o2ib600 to cpt 2
00000400:00000200:9.0:1773851894.187901:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 2
00000400:00000200:9.0:1773851894.187903:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000400:00000200:9.0:1773851894.187904:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 4
00000400:00000200:9.0:1773851894.187905:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.153@o2ib600 routed destination
00000400:00000200:9.0:1773851894.187907:0:60898:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:9.0:1773851894.187908:0:60898:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:9.0:1773851894.187909:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.153@o2ib600: rtr pref emtpy: 1
00000400:00000200:9.0:1773851894.187910:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:9.0:1773851894.187911:0:60898:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.153@o2ib600: rtr pref emtpy: 1
00000400:00000200:9.0:1773851894.187912:0:60898:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:9.0:1773851894.187913:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770109:8770109:1024:4294967295] 17@kfi7 LPNI seq info [1250891921:1250891921:16:4294967295]
00000400:00000200:9.0:1773851894.187914:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851894.187915:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.187917:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.153@o2ib600(172.19.3.153@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851894.187919:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001b8a60d0 nid 172.19.3.153@o2ib600 refs 3
00000800:00000200:9.0:1773851894.187920:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851894.187921:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851894.187923:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851894.187926:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:9.0:1773851894.187929:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:9.0:1773851894.187930:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851894.187932:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851894.187933:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d98fecdb refcount 2 to 172.19.3.153@o2ib600
00010000:00000001:9.0:1773851894.187934:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851894.187935:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851894.187935:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851894.187936:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000048bc074b x1858193585903616/t0(0) o400->14649e2c-1f67-4358-8208-20db0ccc3581@172.19.3.153@o2ib600:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic3-0'
00000100:00100000:9.0:1773851894.187940:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048bc074b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:14649e2c-1f67-4358-8208-20db0ccc3581+908:26502:x1858193585903616:12345-172.19.3.153@o2ib600:400:login-oslic3-0 Request processed in 70us (101us total) trans 0 rc 0/0
00000800:00000200:10.0:1773851894.187943:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851894.187945:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:9.0:1773851894.187945:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.153@o2ib600, seq: 2130862
00000100:00000040:9.0:1773851894.187945:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fff65982 : new rpc_count 3
00000400:00000200:10.0:1773851894.187946:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851894.187946:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851894.187947:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000016999e1e
00000400:00000010:10.0:1773851894.187947:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000016999e1e.
00000100:00000001:9.0:1773851894.187947:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851894.187948:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:9.0:1773851894.187948:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:9.0:1773851894.187948:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000100:00000001:10.0:1773851894.187949:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:9.0:1773851894.187949:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000eb2d3ab9.
00000400:00000200:10.0:1773851894.187950:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000040:9.0:1773851894.187950:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000fff65982 : new refcount 907
00000800:00000200:10.0:1773851894.187951:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000100:00000001:9.0:1773851894.187951:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851894.266110:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851894.266110:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851894.266111:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851894.266111:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851894.266113:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851894.266113:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851894.266115:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851894.266115:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11458@kfi7(00000000f61f8dc9):0x147 version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851894.266116:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 Using peer 11458@kfi7(0x100000000000147)
00000400:00000200:10.0:1773851894.266117:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11458@kfi7 to cpt 2
00000400:00000200:10.0:1773851894.266118:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11458@kfi7 : PUT - for me
00000400:00000200:10.0:1773851894.266119:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11458@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.266119:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11458@kfi7 to cpt 2
00000400:00000200:10.0:1773851894.266120:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc433450 nid 11458@kfi7 refs 1
00000800:00000200:9.0:1773851894.266120:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x100000000000147: rc=0
00000400:00000200:10.0:1773851894.266121:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11458@kfi7 to cpt 2
00000400:00000200:10.0:1773851894.266122:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc433450 nid 11458@kfi7 refs 2
00000800:00000200:9.0:1773851894.266122:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851894.266123:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fc433450 nid 11458@kfi7 refs 3
00000400:00000200:10.0:1773851894.266124:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11458@kfi7 to cpt 2
00000400:00000200:10.0:1773851894.266125:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11458@kfi7 of length 224 into portal 12 MB=0x69b44270ead80
00000400:00000200:10.0:1773851894.266126:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11458@kfi7 of length 224/224 into md 0x78146ce49 [64] + 159008
00000800:00000200:10.0:1773851894.266128:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851894.266130:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851894.266131:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11458@kfi7: PUT: OK
00000100:00000001:10.0:1773851894.266132:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851894.266132:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851894.266133:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d81f2c2f.
00000100:00000040:10.0:1773851894.266133:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000d81f2c2f x1859566875618688 msgsize 224
00000800:00000200:9.0:1773851894.266133:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851894.266135:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-11458@kfi7 (source: 12345-11458@kfi7)
00000100:00000001:10.0:1773851894.266136:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851894.266136:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 Transaction freed
00000400:00000200:10.0:1773851894.266137:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fc433450 nid 11458@kfi7 refs 2
00000800:00000200:10.0:1773851894.266138:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2054@kfi7:2 <- 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851894.266138:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851894.266138:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851894.266139:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851894.266139:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851894.266140:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851894.266140:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859566875618688
00000020:00000001:8.0:1773851894.266141:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851894.266141:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07d911e46db
00000020:00000001:8.0:1773851894.266142:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851894.266144:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029d86cf8 refcount=5
00000020:00000001:8.0:1773851894.266145:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098907381760 : -106974802169856 : ffff9eb4fceab000)
00000020:00000001:8.0:1773851894.266146:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098907381760 : -106974802169856 : ffff9eb4fceab000)
00000100:00000001:8.0:1773851894.266147:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851894.266147:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851894.266148:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7e7683.
00000020:00000010:8.0:1773851894.266149:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851894.266149:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f524493c.
00000100:00000001:8.0:1773851894.266150:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851894.266150:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851894.266151:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851894.266152:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851894.266152:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851894.266152:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.266153:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851894.266154:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851894.266155:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851894.266156:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851894.266156:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851894.266156:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11458@kfi7, seq: 2130863
00000100:00000001:11.0:1773851894.266157:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851894.266157:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000029d86cf8 : new rpc_count 1
00000100:00000001:8.0:1773851894.266157:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087774848 : -106944621776768 : ffff9ebc03cef080)
00000100:00000001:11.0:1773851894.266158:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851894.266158:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d81f2c2f x1859566875618688/t0(0) o400->719d6ea4-57e1-4e6f-a12b-ef3dca31323f@11458@kfi7:682/0 lens 224/0 e 0 to 0 dl 1773852042 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1207-0'
00000100:00000001:8.0:1773851894.266161:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851894.266162:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851894.266163:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d81f2c2f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:719d6ea4-57e1-4e6f-a12b-ef3dca31323f+5:39573:x1859566875618688:12345-11458@kfi7:400:default-tuolumne1207-0
00000100:00000200:8.0:1773851894.266164:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859566875618688
00000020:00000001:8.0:1773851894.266165:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851894.266166:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851894.266166:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.266167:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851894.266167:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851894.266168:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851894.266168:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859566875618688, found 0 last_xid 1859566875618687
00000020:00000001:8.0:1773851894.266169:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851894.266170:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851894.266170:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851894.266171:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.266171:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851894.266172:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851894.266172:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851894.266173:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000067bd3551.
02000000:00000001:8.0:1773851894.266173:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.266174:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.266174:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851894.266175:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035383457, transno 0, xid 1859566875618688
00010000:00000001:8.0:1773851894.266176:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851894.266177:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d81f2c2f x1859566875618688/t0(0) o400->719d6ea4-57e1-4e6f-a12b-ef3dca31323f@11458@kfi7:682/0 lens 224/224 e 0 to 0 dl 1773852042 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1207-0'
00010000:00000001:8.0:1773851894.266179:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851894.266179:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851894.266180:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=127 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851894.266181:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851894.266182:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f788b486 refcount 3 to 11458@kfi7
00000100:00000001:8.0:1773851894.266182:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899612192 : -107146809939424 : ffff9e8cf0746a20)
02000000:00000001:8.0:1773851894.266183:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851894.266183:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.266184:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851894.266185:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11458@kfi7
00000400:00000010:8.0:1773851894.266185:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000369ff48e.
00000100:00000200:8.0:1773851894.266186:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859566875618688, offset 224
00000400:00000200:8.0:1773851894.266188:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11458@kfi7
00000400:00000200:8.0:1773851894.266189:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11458@kfi7 to cpt 2
00000400:00000200:8.0:1773851894.266190:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fc433450 nid 11458@kfi7 refs 1
00000400:00000200:8.0:1773851894.266191:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fc433450 nid 11458@kfi7 refs 2
00000400:00000200:8.0:1773851894.266192:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fc433450 nid 11458@kfi7 refs 3
00000400:00000200:8.0:1773851894.266193:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11458@kfi7 local destination
00000400:00000200:8.0:1773851894.266194:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770110:8770110:1024:4294967295] 11458@kfi7 LPNI seq info [1275410:1275410:16:4294967295]
00000400:00000200:8.0:1773851894.266196:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fc433450 nid 11458@kfi7 refs 2
00000400:00000200:8.0:1773851894.266196:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11458@kfi7 to cpt 2
00000400:00000200:8.0:1773851894.266198:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11458@kfi7(11458@kfi7:11458@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851894.266199:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fc433450 nid 11458@kfi7 refs 3
00000800:00000200:8.0:1773851894.266200:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851894.266201:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851894.266203:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851894.266205:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 Using peer 11458@kfi7(0x100000000000147)
00000800:00000200:8.0:1773851894.266208:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x100000000000147: rc=0
00000800:00000200:8.0:1773851894.266209:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851894.266211:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851894.266212:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f788b486 refcount 2 to 11458@kfi7
00010000:00000001:8.0:1773851894.266212:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851894.266213:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.266213:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851894.266214:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d81f2c2f x1859566875618688/t0(0) o400->719d6ea4-57e1-4e6f-a12b-ef3dca31323f@11458@kfi7:682/0 lens 224/224 e 0 to 0 dl 1773852042 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1207-0'
00000100:00100000:8.0:1773851894.266218:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d81f2c2f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:719d6ea4-57e1-4e6f-a12b-ef3dca31323f+5:39573:x1859566875618688:12345-11458@kfi7:400:default-tuolumne1207-0 Request processed in 56us (84us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851894.266220:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11458@kfi7, seq: 2130863
00000100:00000040:8.0:1773851894.266221:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000029d86cf8 : new rpc_count 0
00000100:00000001:8.0:1773851894.266222:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851894.266222:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851894.266223:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851894.266224:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f524493c.
00000020:00000010:8.0:1773851894.266224:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7e7683.
00000020:00000040:8.0:1773851894.266225:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000029d86cf8 : new refcount 4
00000100:00000001:8.0:1773851894.266225:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851894.266230:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851894.266232:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851894.266233:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11458@kfi7: PUT: OK
00000400:00000200:9.0:1773851894.266233:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000369ff48e
00000400:00000010:9.0:1773851894.266234:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000369ff48e.
00000100:00000001:9.0:1773851894.266235:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851894.266235:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851894.266236:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fc433450 nid 11458@kfi7 refs 2
00000800:00000200:9.0:1773851894.266237:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 11458@kfi7(00000000f61f8dc9):0x0 lsk 328 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000147 Transaction freed
00000800:00000200:1.0:1773851894.316194:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.316195:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.316197:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.316199:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.316201:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22576@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.316202:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22576@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.316203:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22576@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.316204:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8b94b63 nid 22576@kfi7 refs 1
00000400:00000200:1.0:1773851894.316205:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22576@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.316205:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8b94b63 nid 22576@kfi7 refs 2
00000400:00000200:1.0:1773851894.316206:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d8b94b63 nid 22576@kfi7 refs 3
00000400:00000200:1.0:1773851894.316207:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22768@kfi7 to cpt 2
00000400:00000200:1.0:1773851894.316208:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22768@kfi7 of length 224 into portal 12 MB=0x699e0d5062000
00000400:00000200:1.0:1773851894.316210:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22768@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 46784
00000800:00000200:1.0:1773851894.316212:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.316214:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.316215:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22576@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.316216:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.316216:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.316217:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000065ba01fe.
00000100:00000040:1.0:1773851894.316218:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000065ba01fe x1858040785936384 msgsize 224
00000100:00100000:1.0:1773851894.316220:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22768@kfi7 (source: 12345-22576@kfi7)
00000100:00000001:1.0:1773851894.316221:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.316222:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d8b94b63 nid 22576@kfi7 refs 2
00000100:00000001:0.0:1773851894.316222:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851894.316223:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851894.316223:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.316223:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.316224:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.316225:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.316225:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040785936384
00000020:00000001:0.0:1773851894.316226:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.316226:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a40
00000020:00000001:0.0:1773851894.316227:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.316228:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076c770a8 refcount=6
00000020:00000001:0.0:1773851894.316229:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743438336 : -107128966113280 : ffff9e9118079800)
00000020:00000001:0.0:1773851894.316229:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743438336 : -107128966113280 : ffff9e9118079800)
00000100:00000001:0.0:1773851894.316230:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.316231:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.316232:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000077195a6.
00000020:00000010:0.0:1773851894.316233:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.316234:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851894.316234:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.316235:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851894.316235:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.316236:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851894.316237:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851894.316237:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.316238:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.316239:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.316239:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851894.316240:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851894.316240:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.316240:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22768@kfi7, seq: 1997619
00000100:00000001:1.0:1773851894.316241:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.316241:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000076c770a8 : new rpc_count 1
00000100:00000001:1.0:1773851894.316242:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.316242:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112262144 : -106950597289472 : ffff9eba9fa3da00)
00000100:00000040:0.0:1773851894.316243:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000065ba01fe x1858040785936384/t0(0) o400->cbb78d31-a2f3-4a0a-89eb-0f46100916ad@22768@kfi7:534/0 lens 224/0 e 0 to 0 dl 1773852649 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1901-0'
00000100:00000001:0.0:1773851894.316245:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.316246:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.316246:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065ba01fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:cbb78d31-a2f3-4a0a-89eb-0f46100916ad+6:39689:x1858040785936384:12345-22768@kfi7:400:default-tuolumne1901-0
00000100:00000200:0.0:1773851894.316248:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040785936384
00000020:00000001:0.0:1773851894.316248:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.316249:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.316249:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.316250:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.316250:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851894.316251:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.316251:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040785936384, found 0 last_xid 1858040785936383
00000020:00000001:0.0:1773851894.316252:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.316253:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.316253:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.316253:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.316254:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851894.316255:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.316255:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.316256:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d04e4c51.
02000000:00000001:0.0:1773851894.316256:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.316257:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.316257:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.316258:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689853, transno 0, xid 1858040785936384
00010000:00000001:0.0:1773851894.316258:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851894.316259:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000065ba01fe x1858040785936384/t0(0) o400->cbb78d31-a2f3-4a0a-89eb-0f46100916ad@22768@kfi7:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1901-0'
00010000:00000001:0.0:1773851894.316261:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.316262:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.316262:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851894.316263:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.316264:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001a9fcfd7 refcount 3 to 22768@kfi7
00000100:00000001:0.0:1773851894.316264:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551673344 : -107156157878272 : ffff9e8ac3463000)
02000000:00000001:0.0:1773851894.316265:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.316266:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.316266:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.316267:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22576@kfi7
00000400:00000010:0.0:1773851894.316267:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024fe8e76.
00000100:00000200:0.0:1773851894.316268:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040785936384, offset 224
00000400:00000200:0.0:1773851894.316270:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22576@kfi7
00000400:00000200:0.0:1773851894.316270:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22576@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.316271:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d8b94b63 nid 22576@kfi7 refs 1
00000400:00000200:0.0:1773851894.316272:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d8b94b63 nid 22576@kfi7 refs 2
00000400:00000200:0.0:1773851894.316273:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d8b94b63 nid 22576@kfi7 refs 3
00000400:00000200:0.0:1773851894.316274:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22576@kfi7 local destination
00000400:00000200:0.0:1773851894.316275:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770111:8770111:1024:4294967295] 22576@kfi7 LPNI seq info [7262627:7262627:16:4294967295]
00000400:00000200:0.0:1773851894.316277:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d8b94b63 nid 22576@kfi7 refs 2
00000400:00000200:0.0:1773851894.316277:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22576@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.316279:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22576@kfi7(22576@kfi7:22576@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.316280:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d8b94b63 nid 22576@kfi7 refs 3
00000800:00000200:0.0:1773851894.316282:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.316283:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851894.316284:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.316286:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fb5 Using peer 22576@kfi7(0x100000000000fb5)
00000800:00000200:0.0:1773851894.316289:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x100000000000fb5: rc=0
00000800:00000200:0.0:1773851894.316290:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fb5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.316292:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.316293:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001a9fcfd7 refcount 2 to 22768@kfi7
00010000:00000001:0.0:1773851894.316293:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.316294:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.316294:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.316295:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000065ba01fe x1858040785936384/t0(0) o400->cbb78d31-a2f3-4a0a-89eb-0f46100916ad@22768@kfi7:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1901-0'
00000100:00100000:0.0:1773851894.316299:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065ba01fe pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:cbb78d31-a2f3-4a0a-89eb-0f46100916ad+6:39689:x1858040785936384:12345-22768@kfi7:400:default-tuolumne1901-0 Request processed in 51us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.316301:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22768@kfi7, seq: 1997619
00000100:00000040:0.0:1773851894.316302:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000076c770a8 : new rpc_count 0
00000100:00000001:0.0:1773851894.316302:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.316303:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.316303:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.316304:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851894.316305:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000077195a6.
00000020:00000040:0.0:1773851894.316305:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000076c770a8 : new refcount 5
00000100:00000001:0.0:1773851894.316306:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851894.316312:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fb5 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.316313:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.316314:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22576@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.316315:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024fe8e76
00000400:00000010:1.0:1773851894.316316:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024fe8e76.
00000100:00000001:1.0:1773851894.316316:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.316317:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.316318:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d8b94b63 nid 22576@kfi7 refs 2
00000800:00000200:1.0:1773851894.316319:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 22576@kfi7(000000002503d181):0x0 lsk 4022 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000fb5 Transaction freed
00000800:00000200:1.0:1773851894.319535:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.319536:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.319537:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.319544:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.319547:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12960@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.319549:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12960@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.319550:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12960@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.319551:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001276a40c nid 12960@kfi7 refs 1
00000400:00000200:1.0:1773851894.319553:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12960@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.319554:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001276a40c nid 12960@kfi7 refs 2
00000400:00000200:1.0:1773851894.319556:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001276a40c nid 12960@kfi7 refs 3
00000400:00000200:1.0:1773851894.319557:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12960@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.319558:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12960@kfi7 of length 224 into portal 12 MB=0x69b0a258db080
00000400:00000200:1.0:1773851894.319560:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12960@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 47008
00000800:00000200:1.0:1773851894.319563:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.319565:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.319567:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12960@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.319568:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.319569:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.319570:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000abbc7064.
00000100:00000040:1.0:1773851894.319571:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000abbc7064 x1859317742284928 msgsize 224
00000100:00100000:1.0:1773851894.319573:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-12960@kfi7 (source: 12345-12960@kfi7)
00000100:00000001:1.0:1773851894.319574:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.319576:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001276a40c nid 12960@kfi7 refs 2
00000100:00000001:0.0:1773851894.319577:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851894.319578:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851894.319578:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.319578:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.319579:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.319580:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.319581:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317742284928
00000020:00000001:0.0:1773851894.319581:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.319582:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917f5
00000020:00000001:0.0:1773851894.319583:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.319584:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009f455601 refcount=6
00000020:00000001:0.0:1773851894.319586:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241760768 : -107152467790848 : ffff9e8b9f387400)
00000020:00000001:0.0:1773851894.319587:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241760768 : -107152467790848 : ffff9e8b9f387400)
00000100:00000001:0.0:1773851894.319588:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.319589:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.319590:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000077195a6.
00000020:00000010:0.0:1773851894.319591:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.319591:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851894.319593:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.319595:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851894.319595:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.319597:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851894.319597:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851894.319598:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.319599:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.319601:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851894.319602:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.319602:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851894.319603:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.319603:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12960@kfi7, seq: 1997620
00000100:00000040:0.0:1773851894.319604:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009f455601 : new rpc_count 1
00000100:00000001:1.0:1773851894.319605:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851894.319606:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.319606:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112240256 : -106950597311360 : ffff9eba9fa38480)
00000100:00000040:0.0:1773851894.319608:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000abbc7064 x1859317742284928/t0(0) o400->20105cd2-9255-4637-a130-ad9a480eb320@12960@kfi7:534/0 lens 224/0 e 0 to 0 dl 1773852649 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1296-0'
00000100:00000001:0.0:1773851894.319613:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.319614:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.319616:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abbc7064 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:20105cd2-9255-4637-a130-ad9a480eb320+6:39727:x1859317742284928:12345-12960@kfi7:400:default-tuolumne1296-0
00000100:00000200:0.0:1773851894.319618:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317742284928
00000020:00000001:0.0:1773851894.319619:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.319620:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.319621:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.319622:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.319623:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851894.319624:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.319625:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317742284928, found 0 last_xid 1859317742284927
00000020:00000001:0.0:1773851894.319626:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.319627:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.319628:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.319629:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.319630:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851894.319631:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.319631:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.319633:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002f29cc80.
02000000:00000001:0.0:1773851894.319634:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.319636:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.319637:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.319638:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096697321, transno 0, xid 1859317742284928
00010000:00000001:0.0:1773851894.319639:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851894.319641:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000abbc7064 x1859317742284928/t0(0) o400->20105cd2-9255-4637-a130-ad9a480eb320@12960@kfi7:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1296-0'
00010000:00000001:0.0:1773851894.319646:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.319646:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.319647:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851894.319649:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.319650:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001310edfe refcount 3 to 12960@kfi7
00000100:00000001:0.0:1773851894.319652:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958443040 : -107146751108576 : ffff9e8cf3f61a20)
02000000:00000001:0.0:1773851894.319653:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.319654:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.319655:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.319656:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12960@kfi7
00000400:00000010:0.0:1773851894.319657:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000485e1abd.
00000100:00000200:0.0:1773851894.319659:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317742284928, offset 224
00000400:00000200:0.0:1773851894.319661:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12960@kfi7
00000400:00000200:0.0:1773851894.319663:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12960@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.319664:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001276a40c nid 12960@kfi7 refs 1
00000400:00000200:0.0:1773851894.319666:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001276a40c nid 12960@kfi7 refs 2
00000400:00000200:0.0:1773851894.319668:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001276a40c nid 12960@kfi7 refs 3
00000400:00000200:0.0:1773851894.319670:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12960@kfi7 local destination
00000400:00000200:0.0:1773851894.319673:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770112:8770112:1024:4294967295] 12960@kfi7 LPNI seq info [9565438:9565438:16:4294967295]
00000400:00000200:0.0:1773851894.319675:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001276a40c nid 12960@kfi7 refs 2
00000400:00000200:0.0:1773851894.319677:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12960@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.319680:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12960@kfi7(12960@kfi7:12960@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.319683:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001276a40c nid 12960@kfi7 refs 3
00000800:00000200:0.0:1773851894.319685:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.319687:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851894.319695:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.319699:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x6cf Using peer 12960@kfi7(0x6cf)
00000800:00000200:0.0:1773851894.319704:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x6cf: rc=0
00000800:00000200:0.0:1773851894.319707:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x6cf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.319710:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.319711:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001310edfe refcount 2 to 12960@kfi7
00010000:00000001:0.0:1773851894.319712:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.319713:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.319715:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.319716:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000abbc7064 x1859317742284928/t0(0) o400->20105cd2-9255-4637-a130-ad9a480eb320@12960@kfi7:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1296-0'
00000100:00100000:0.0:1773851894.319720:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abbc7064 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:20105cd2-9255-4637-a130-ad9a480eb320+6:39727:x1859317742284928:12345-12960@kfi7:400:default-tuolumne1296-0 Request processed in 106us (148us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.319723:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12960@kfi7, seq: 1997620
00000100:00000040:0.0:1773851894.319724:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009f455601 : new rpc_count 0
00000100:00000001:0.0:1773851894.319730:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.319730:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.319731:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.319732:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851894.319732:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000077195a6.
00000020:00000040:0.0:1773851894.319733:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000009f455601 : new refcount 5
00000100:00000001:0.0:1773851894.319734:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851894.319739:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x6cf TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.319741:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.319744:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12960@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.319745:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000485e1abd
00000400:00000010:1.0:1773851894.319745:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000485e1abd.
00000100:00000001:1.0:1773851894.319746:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.319746:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.319747:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001276a40c nid 12960@kfi7 refs 2
00000800:00000200:1.0:1773851894.319749:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 12960@kfi7(00000000918d4f2e):0x0 lsk 1744 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x6cf Transaction freed
00000800:00000200:5.0:1773851894.335926:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.335927:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851894.335928:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851894.335930:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851894.335933:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18385@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.335934:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18385@kfi7 : PUT - for me
00000400:00000200:5.0:1773851894.335936:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18385@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.335937:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cae3039 nid 18385@kfi7 refs 1
00000400:00000200:5.0:1773851894.335938:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18385@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.335938:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cae3039 nid 18385@kfi7 refs 2
00000400:00000200:5.0:1773851894.335939:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001cae3039 nid 18385@kfi7 refs 3
00000400:00000200:5.0:1773851894.335940:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18193@kfi7 to cpt 6
00000400:00000200:5.0:1773851894.335941:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18193@kfi7 of length 224 into portal 12 MB=0x69b4b6db43d00
00000400:00000200:5.0:1773851894.335942:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18193@kfi7 of length 224/224 into md 0x793926dc5 [64] + 162400
00000800:00000200:5.0:1773851894.335944:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851894.335946:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851894.335946:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18385@kfi7: PUT: OK
00000100:00000001:5.0:1773851894.335947:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851894.335948:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851894.335949:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000026a451d0.
00000100:00000040:5.0:1773851894.335949:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000026a451d0 x1859598125645056 msgsize 224
00000100:00100000:5.0:1773851894.335951:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-18193@kfi7 (source: 12345-18385@kfi7)
00000100:00000001:5.0:1773851894.335952:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851894.335953:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001cae3039 nid 18385@kfi7 refs 2
00000100:00000001:7.0:1773851894.335954:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851894.335954:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851894.335954:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851894.335955:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851894.335955:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851894.335956:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851894.335957:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598125645056
00000020:00000001:7.0:1773851894.335957:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851894.335958:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e70f96
00000020:00000001:7.0:1773851894.335958:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851894.335960:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000479176c3 refcount=5
00000020:00000001:7.0:1773851894.335961:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120733499392 : -106952976052224 : ffff9eba11dad000)
00000020:00000001:7.0:1773851894.335962:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637120733499392 : -106952976052224 : ffff9eba11dad000)
00000100:00000001:7.0:1773851894.335963:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851894.335964:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851894.335965:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004638b300.
00000020:00000010:7.0:1773851894.335965:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851894.335967:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851894.335968:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851894.335968:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851894.335969:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851894.335969:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851894.335970:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851894.335970:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851894.335971:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851894.335972:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851894.335973:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851894.335973:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851894.335973:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851894.335974:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18193@kfi7, seq: 2001986
00000100:00000040:7.0:1773851894.335974:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000479176c3 : new rpc_count 1
00000100:00000001:4.0:1773851894.335974:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851894.335975:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637006074691328 : -107067634860288 : ffff9e9f5fa83f00)
00000100:00000001:4.0:1773851894.335975:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851894.335976:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000026a451d0 x1859598125645056/t0(0) o400->1b460e21-28c5-49e8-bd4f-eeca8f6cb20b@18193@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1633-0'
00000100:00000001:7.0:1773851894.335979:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851894.335979:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851894.335980:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026a451d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1b460e21-28c5-49e8-bd4f-eeca8f6cb20b+5:39479:x1859598125645056:12345-18193@kfi7:400:default-tuolumne1633-0
00000100:00000200:7.0:1773851894.335982:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598125645056
00000020:00000001:7.0:1773851894.335982:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851894.335983:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851894.335983:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851894.335984:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851894.335984:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851894.335985:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851894.335986:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598125645056, found 0 last_xid 1859598125645055
00000020:00000001:7.0:1773851894.335987:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851894.335987:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851894.335988:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851894.335988:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851894.335989:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851894.335989:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851894.335990:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851894.335991:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000336895e7.
02000000:00000001:7.0:1773851894.335991:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851894.335992:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851894.335993:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851894.335993:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260598280, transno 0, xid 1859598125645056
00010000:00000001:7.0:1773851894.335994:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851894.335995:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000026a451d0 x1859598125645056/t0(0) o400->1b460e21-28c5-49e8-bd4f-eeca8f6cb20b@18193@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1633-0'
00010000:00000001:7.0:1773851894.335997:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851894.335997:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851894.335998:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=126 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851894.335999:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851894.336000:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000796c8fad refcount 3 to 18193@kfi7
00000100:00000001:7.0:1773851894.336000:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331392 : -107155410220224 : ffff9e8aefd68b40)
02000000:00000001:7.0:1773851894.336001:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851894.336002:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851894.336003:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851894.336003:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18385@kfi7
00000400:00000010:7.0:1773851894.336004:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d794ea.
00000100:00000200:7.0:1773851894.336005:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598125645056, offset 224
00000400:00000200:7.0:1773851894.336006:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18385@kfi7
00000400:00000200:7.0:1773851894.336007:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18385@kfi7 to cpt 1
00000400:00000200:7.0:1773851894.336008:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001cae3039 nid 18385@kfi7 refs 1
00000400:00000200:7.0:1773851894.336009:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001cae3039 nid 18385@kfi7 refs 2
00000400:00000200:7.0:1773851894.336010:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001cae3039 nid 18385@kfi7 refs 3
00000400:00000200:7.0:1773851894.336011:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18385@kfi7 local destination
00000400:00000200:7.0:1773851894.336012:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770113:8770113:1024:4294967295] 18385@kfi7 LPNI seq info [144063:144063:16:4294967295]
00000400:00000200:7.0:1773851894.336014:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001cae3039 nid 18385@kfi7 refs 2
00000400:00000200:7.0:1773851894.336014:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18385@kfi7 to cpt 1
00000400:00000200:7.0:1773851894.336016:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18385@kfi7(18385@kfi7:18385@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851894.336018:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001cae3039 nid 18385@kfi7 refs 3
00000800:00000200:7.0:1773851894.336019:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851894.336020:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851894.336022:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851894.336024:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000db1 Using peer 18385@kfi7(0x100000000000db1)
00000800:00000200:7.0:1773851894.336027:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x100000000000db1: rc=0
00000800:00000200:7.0:1773851894.336028:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000db1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851894.336030:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851894.336031:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000796c8fad refcount 2 to 18193@kfi7
00010000:00000001:7.0:1773851894.336031:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851894.336032:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851894.336033:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851894.336033:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000026a451d0 x1859598125645056/t0(0) o400->1b460e21-28c5-49e8-bd4f-eeca8f6cb20b@18193@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1633-0'
00000100:00100000:7.0:1773851894.336036:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026a451d0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:1b460e21-28c5-49e8-bd4f-eeca8f6cb20b+5:39479:x1859598125645056:12345-18193@kfi7:400:default-tuolumne1633-0 Request processed in 56us (86us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851894.336038:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18193@kfi7, seq: 2001986
00000100:00000040:7.0:1773851894.336039:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000479176c3 : new rpc_count 0
00000100:00000001:7.0:1773851894.336040:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851894.336040:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000db1 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851894.336041:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851894.336041:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851894.336042:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000400:00000200:5.0:1773851894.336042:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851894.336043:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004638b300.
00000020:00000040:7.0:1773851894.336043:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000479176c3 : new refcount 4
00000400:00000200:5.0:1773851894.336043:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18385@kfi7: PUT: OK
00000100:00000001:7.0:1773851894.336044:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851894.336044:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d794ea
00000400:00000010:5.0:1773851894.336044:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d794ea.
00000100:00000001:5.0:1773851894.336045:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851894.336045:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851894.336046:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001cae3039 nid 18385@kfi7 refs 2
00000800:00000200:5.0:1773851894.336047:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 18385@kfi7(00000000d79d6708):0x0 lsk 3506 rsk 38 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000db1 Transaction freed
00000800:00000200:9.0:1773851894.338045:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851894.338046:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851894.338047:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851894.338049:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851894.338051:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13136@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.338052:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13136@kfi7 : PUT - for me
00000400:00000200:9.0:1773851894.338053:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13136@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.338054:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009414bde9 nid 13136@kfi7 refs 1
00000400:00000200:9.0:1773851894.338055:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13136@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.338056:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009414bde9 nid 13136@kfi7 refs 2
00000400:00000200:9.0:1773851894.338057:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009414bde9 nid 13136@kfi7 refs 3
00000400:00000200:9.0:1773851894.338058:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13136@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.338059:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13136@kfi7 of length 224 into portal 12 MB=0x699e123236dc0
00000400:00000200:9.0:1773851894.338060:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13136@kfi7 of length 224/224 into md 0x78146ce49 [64] + 159232
00000800:00000200:9.0:1773851894.338062:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851894.338063:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851894.338064:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13136@kfi7: PUT: OK
00000100:00000001:9.0:1773851894.338065:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851894.338066:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851894.338067:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002db9dc7d.
00000100:00000040:9.0:1773851894.338067:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000002db9dc7d x1858042096479680 msgsize 224
00000100:00100000:9.0:1773851894.338069:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-13136@kfi7 (source: 12345-13136@kfi7)
00000100:00000001:9.0:1773851894.338070:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851894.338072:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009414bde9 nid 13136@kfi7 refs 2
00000100:00000001:8.0:1773851894.338072:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851894.338072:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851894.338073:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851894.338073:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851894.338073:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851894.338074:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851894.338075:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042096479680
00000020:00000001:8.0:1773851894.338075:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851894.338076:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b4b
00000020:00000001:8.0:1773851894.338076:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851894.338079:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ec0b0cc7 refcount=6
00000020:00000001:8.0:1773851894.338080:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628026368 : -107123081525248 : ffff9e9276c74800)
00000020:00000001:8.0:1773851894.338081:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628026368 : -107123081525248 : ffff9e9276c74800)
00000100:00000001:8.0:1773851894.338082:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851894.338083:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851894.338083:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7e7683.
00000020:00000010:8.0:1773851894.338084:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851894.338085:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f524493c.
00000100:00000001:8.0:1773851894.338086:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851894.338086:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851894.338086:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851894.338087:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851894.338088:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851894.338088:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.338089:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851894.338091:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851894.338091:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851894.338091:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851894.338092:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851894.338092:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13136@kfi7, seq: 2130864
00000100:00000001:11.0:1773851894.338093:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851894.338093:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ec0b0cc7 : new rpc_count 1
00000100:00000001:11.0:1773851894.338094:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.338094:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609047808 : -107064100503808 : ffff9ea032523f00)
00000100:00000040:8.0:1773851894.338095:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002db9dc7d x1858042096479680/t0(0) o400->9135072f-576c-470d-831a-2b821d66c422@13136@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1314-0'
00000100:00000001:8.0:1773851894.338098:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851894.338098:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851894.338099:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002db9dc7d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9135072f-576c-470d-831a-2b821d66c422+6:39697:x1858042096479680:12345-13136@kfi7:400:default-tuolumne1314-0
00000100:00000200:8.0:1773851894.338100:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042096479680
00000020:00000001:8.0:1773851894.338101:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851894.338102:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851894.338102:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.338103:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851894.338103:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851894.338104:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851894.338105:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042096479680, found 0 last_xid 1858042096479679
00000020:00000001:8.0:1773851894.338106:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851894.338106:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851894.338107:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851894.338107:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.338108:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851894.338109:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851894.338109:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851894.338110:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005ae86d43.
02000000:00000001:8.0:1773851894.338110:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.338111:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.338112:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851894.338112:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096704094, transno 0, xid 1858042096479680
00010000:00000001:8.0:1773851894.338113:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851894.338114:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002db9dc7d x1858042096479680/t0(0) o400->9135072f-576c-470d-831a-2b821d66c422@13136@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1314-0'
00010000:00000001:8.0:1773851894.338120:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851894.338120:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851894.338121:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=127 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851894.338122:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851894.338123:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009acc18c2 refcount 3 to 13136@kfi7
00000100:00000001:8.0:1773851894.338124:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581120 : -107154806970496 : ffff9e8b13cb6780)
02000000:00000001:8.0:1773851894.338125:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851894.338125:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.338126:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851894.338127:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13136@kfi7
00000400:00000010:8.0:1773851894.338127:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a9fe4d78.
00000100:00000200:8.0:1773851894.338128:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042096479680, offset 224
00000400:00000200:8.0:1773851894.338130:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13136@kfi7
00000400:00000200:8.0:1773851894.338131:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13136@kfi7 to cpt 2
00000400:00000200:8.0:1773851894.338131:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009414bde9 nid 13136@kfi7 refs 1
00000400:00000200:8.0:1773851894.338132:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009414bde9 nid 13136@kfi7 refs 2
00000400:00000200:8.0:1773851894.338133:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009414bde9 nid 13136@kfi7 refs 3
00000400:00000200:8.0:1773851894.338134:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13136@kfi7 local destination
00000400:00000200:8.0:1773851894.338136:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770114:8770114:1024:4294967295] 13136@kfi7 LPNI seq info [9046026:9046026:16:4294967295]
00000400:00000200:8.0:1773851894.338137:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009414bde9 nid 13136@kfi7 refs 2
00000400:00000200:8.0:1773851894.338138:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13136@kfi7 to cpt 2
00000400:00000200:8.0:1773851894.338140:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13136@kfi7(13136@kfi7:13136@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851894.338141:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009414bde9 nid 13136@kfi7 refs 3
00000800:00000200:8.0:1773851894.338142:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851894.338143:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851894.338145:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851894.338148:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c Using peer 13136@kfi7(0x4c)
00000800:00000200:8.0:1773851894.338152:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0x4c: rc=0
00000800:00000200:8.0:1773851894.338154:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851894.338156:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851894.338157:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009acc18c2 refcount 2 to 13136@kfi7
00010000:00000001:8.0:1773851894.338157:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851894.338158:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851894.338158:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851894.338159:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002db9dc7d x1858042096479680/t0(0) o400->9135072f-576c-470d-831a-2b821d66c422@13136@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1314-0'
00000100:00100000:8.0:1773851894.338163:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002db9dc7d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:9135072f-576c-470d-831a-2b821d66c422+6:39697:x1858042096479680:12345-13136@kfi7:400:default-tuolumne1314-0 Request processed in 63us (93us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851894.338165:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13136@kfi7, seq: 2130864
00000100:00000040:8.0:1773851894.338166:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ec0b0cc7 : new rpc_count 0
00000100:00000001:8.0:1773851894.338167:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851894.338167:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851894.338168:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851894.338169:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f524493c.
00000020:00000010:8.0:1773851894.338170:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7e7683.
00000020:00000040:8.0:1773851894.338170:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000ec0b0cc7 : new refcount 5
00000100:00000001:8.0:1773851894.338171:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851894.338179:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851894.338180:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851894.338182:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13136@kfi7: PUT: OK
00000400:00000200:9.0:1773851894.338183:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a9fe4d78
00000400:00000010:9.0:1773851894.338183:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a9fe4d78.
00000100:00000001:9.0:1773851894.338184:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851894.338184:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851894.338185:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009414bde9 nid 13136@kfi7 refs 2
00000800:00000200:9.0:1773851894.338187:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 13136@kfi7(0000000043789542):0x0 lsk 77 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c Transaction freed
00000800:00000200:6.0:1773851894.425509:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.425509:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851894.425510:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851894.425510:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851894.425512:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851894.425512:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851894.425515:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18563@kfi7(0000000075924a9c):0xeda version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851894.425516:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851894.425518:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda Using peer 18563@kfi7(0xeda)
00000400:00000200:6.0:1773851894.425519:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18563@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.425521:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18563@kfi7 : PUT - for me
00000400:00000200:5.0:1773851894.425521:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18563@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.425523:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18563@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.425524:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 1
00000800:00000200:5.0:1773851894.425524:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 38 bytes to peer 0xeda: rc=0
00000400:00000200:6.0:1773851894.425526:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18563@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.425527:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 2
00000800:00000200:5.0:1773851894.425527:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851894.425529:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 3
00000400:00000200:6.0:1773851894.425530:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18499@kfi7 to cpt 6
00000400:00000200:6.0:1773851894.425532:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18499@kfi7 of length 224 into portal 12 MB=0x69b094a2b8880
00000400:00000200:6.0:1773851894.425534:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18499@kfi7 of length 224/224 into md 0x793926dc5 [64] + 162624
00000800:00000200:6.0:1773851894.425537:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851894.425539:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851894.425540:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851894.425541:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18563@kfi7: PUT: OK
00000100:00000001:6.0:1773851894.425543:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:5.0:1773851894.425543:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda Transaction freed
00000100:00000200:6.0:1773851894.425544:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851894.425547:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d98707a2.
00000100:00000040:6.0:1773851894.425548:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000d98707a2 x1859314061641856 msgsize 224
00000100:00100000:6.0:1773851894.425550:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-18499@kfi7 (source: 12345-18563@kfi7)
00000100:00000001:6.0:1773851894.425552:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:7.0:1773851894.425554:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:6.0:1773851894.425554:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 2
02000000:00000001:7.0:1773851894.425555:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851894.425556:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851894.425557:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851894.425557:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851894.425558:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851894.425560:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314061641856
00000020:00000001:7.0:1773851894.425561:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851894.425561:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9163c
00000020:00000001:7.0:1773851894.425562:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851894.425567:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e829fdc1 refcount=6
00000020:00000001:7.0:1773851894.425568:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241252864 : -107152468298752 : ffff9e8b9f30b400)
00000020:00000001:7.0:1773851894.425569:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241252864 : -107152468298752 : ffff9e8b9f30b400)
00000100:00000001:7.0:1773851894.425571:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851894.425572:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851894.425573:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004638b300.
00000020:00000010:7.0:1773851894.425575:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851894.425576:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c2d2ee11.
00000100:00000001:7.0:1773851894.425577:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851894.425578:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851894.425579:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851894.425580:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851894.425581:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851894.425582:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851894.425583:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851894.425585:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851894.425585:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851894.425585:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851894.425586:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851894.425586:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18499@kfi7, seq: 2001987
00000100:00000001:7.0:1773851894.425587:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851894.425587:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e829fdc1 : new rpc_count 1
00000100:00000001:7.0:1773851894.425588:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851894.425588:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637162331508096 : -106911378043520 : ffff9ec3c14a0d80)
00000100:00000040:4.0:1773851894.425589:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d98707a2 x1859314061641856/t0(0) o400->ed7cfec2-7768-433d-b8fb-6fc09418988e@18499@kfi7:144/0 lens 224/0 e 0 to 0 dl 1773852259 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1656-0'
00000100:00000001:4.0:1773851894.425592:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851894.425592:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851894.425593:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d98707a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ed7cfec2-7768-433d-b8fb-6fc09418988e+6:39613:x1859314061641856:12345-18499@kfi7:400:default-tuolumne1656-0
00000100:00000200:4.0:1773851894.425595:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314061641856
00000020:00000001:4.0:1773851894.425595:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851894.425596:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851894.425597:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.425597:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851894.425598:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851894.425599:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851894.425600:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314061641856, found 0 last_xid 1859314061641855
00000020:00000001:4.0:1773851894.425601:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851894.425601:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851894.425602:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851894.425602:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.425603:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851894.425604:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851894.425604:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851894.425605:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a49a3bb4.
02000000:00000001:4.0:1773851894.425606:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851894.425607:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.425607:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851894.425608:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044166562, transno 0, xid 1859314061641856
00010000:00000001:4.0:1773851894.425609:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851894.425610:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d98707a2 x1859314061641856/t0(0) o400->ed7cfec2-7768-433d-b8fb-6fc09418988e@18499@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1656-0'
00010000:00000001:4.0:1773851894.425612:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851894.425612:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851894.425613:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=126 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851894.425614:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851894.425615:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbcf8e32 refcount 3 to 18499@kfi7
00000100:00000001:4.0:1773851894.425616:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419552 : -107156724132064 : ffff9e8aa185d720)
02000000:00000001:4.0:1773851894.425617:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851894.425617:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851894.425618:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851894.425619:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18563@kfi7
00000400:00000010:4.0:1773851894.425619:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5f4f73.
00000100:00000200:4.0:1773851894.425620:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314061641856, offset 224
00000400:00000200:4.0:1773851894.425622:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18563@kfi7
00000400:00000200:4.0:1773851894.425623:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18563@kfi7 to cpt 1
00000400:00000200:4.0:1773851894.425624:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 1
00000400:00000200:4.0:1773851894.425625:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 2
00000400:00000200:4.0:1773851894.425627:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 3
00000400:00000200:4.0:1773851894.425628:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18563@kfi7 local destination
00000400:00000200:4.0:1773851894.425629:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770115:8770115:1024:4294967295] 18563@kfi7 LPNI seq info [228716:228716:16:4294967295]
00000400:00000200:4.0:1773851894.425630:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 2
00000400:00000200:4.0:1773851894.425631:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18563@kfi7 to cpt 1
00000400:00000200:4.0:1773851894.425633:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18563@kfi7(18563@kfi7:18563@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851894.425635:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 3
00000800:00000200:4.0:1773851894.425636:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851894.425637:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851894.425639:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851894.425641:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda Using peer 18563@kfi7(0xeda)
00000800:00000200:4.0:1773851894.425644:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0xeda: rc=0
00000800:00000200:4.0:1773851894.425645:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851894.425647:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851894.425648:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbcf8e32 refcount 2 to 18499@kfi7
00010000:00000001:4.0:1773851894.425649:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851894.425649:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.425650:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851894.425651:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d98707a2 x1859314061641856/t0(0) o400->ed7cfec2-7768-433d-b8fb-6fc09418988e@18499@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1656-0'
00000100:00100000:4.0:1773851894.425655:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d98707a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:ed7cfec2-7768-433d-b8fb-6fc09418988e+6:39613:x1859314061641856:12345-18499@kfi7:400:default-tuolumne1656-0 Request processed in 63us (107us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851894.425658:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18499@kfi7, seq: 2001987
00000100:00000040:4.0:1773851894.425659:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e829fdc1 : new rpc_count 0
00000100:00000001:4.0:1773851894.425659:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851894.425661:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851894.425661:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:4.0:1773851894.425662:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c2d2ee11.
00000020:00000010:4.0:1773851894.425663:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004638b300.
00000020:00000040:4.0:1773851894.425664:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000e829fdc1 : new refcount 5
00000100:00000001:4.0:1773851894.425664:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851894.425671:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851894.425673:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851894.425675:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18563@kfi7: PUT: OK
00000400:00000200:5.0:1773851894.425676:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5f4f73
00000400:00000010:5.0:1773851894.425677:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5f4f73.
00000100:00000001:5.0:1773851894.425678:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851894.425679:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851894.425680:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8a21fe8 nid 18563@kfi7 refs 2
00000800:00000200:5.0:1773851894.425683:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 18563@kfi7(0000000075924a9c):0x0 lsk 3803 rsk 45 tsk 0 trmk 0 tmk 0 trr 1 tta 0xeda Transaction freed
00000800:00000200:25.0:1773851894.439654:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.439655:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.439656:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.439658:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851894.439660:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9281@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.439661:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9281@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.439662:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9281@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.439663:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7b52ebf nid 9281@kfi7 refs 1
00000400:00000200:25.0:1773851894.439664:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9281@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.439664:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7b52ebf nid 9281@kfi7 refs 2
00000400:00000200:25.0:1773851894.439665:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b7b52ebf nid 9281@kfi7 refs 3
00000400:00000200:25.0:1773851894.439666:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9344@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.439667:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9344@kfi7 of length 224 into portal 12 MB=0x699e691783840
00000400:00000200:25.0:1773851894.439668:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9344@kfi7 of length 224/224 into md 0x16159c9699 [64] + 34672
00000800:00000200:25.0:1773851894.439670:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851894.439672:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.439673:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9281@kfi7: PUT: OK
00000100:00000001:25.0:1773851894.439674:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851894.439674:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851894.439685:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b73f47df.
00000100:00000040:25.0:1773851894.439685:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b73f47df x1858065422366784 msgsize 224
00000100:00100000:25.0:1773851894.439686:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9344@kfi7 (source: 12345-9281@kfi7)
00000100:00000001:25.0:1773851894.439687:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851894.439688:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7b52ebf nid 9281@kfi7 refs 2
00000100:00000001:27.0:1773851894.439689:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851894.439690:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851894.439690:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851894.439690:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851894.439691:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851894.439691:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851894.439692:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065422366784
00000020:00000001:27.0:1773851894.439693:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851894.439694:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91501
00000020:00000001:27.0:1773851894.439695:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851894.439696:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006acd59c0 refcount=6
00000020:00000001:27.0:1773851894.439697:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241030656 : -107152468520960 : ffff9e8b9f2d5000)
00000020:00000001:27.0:1773851894.439698:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241030656 : -107152468520960 : ffff9e8b9f2d5000)
00000100:00000001:27.0:1773851894.439699:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851894.439700:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851894.439700:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000330439b1.
00000020:00000010:27.0:1773851894.439702:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851894.439702:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851894.439703:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851894.439704:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851894.439704:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.439705:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851894.439706:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851894.439706:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.439707:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.439708:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851894.439709:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851894.439709:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851894.439709:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851894.439710:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9344@kfi7, seq: 2025172
00000100:00000040:27.0:1773851894.439711:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006acd59c0 : new rpc_count 1
00000100:00000001:25.0:1773851894.439711:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.439712:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637106564994688 : -106967144556928 : ffff9eb6c5589680)
00000100:00000001:25.0:1773851894.439712:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851894.439713:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b73f47df x1858065422366784/t0(0) o400->eac801c0-52f7-464a-9cc4-6414e3fd693e@9344@kfi7:144/0 lens 224/0 e 0 to 0 dl 1773852259 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1076-0'
00000100:00000001:27.0:1773851894.439716:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851894.439716:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851894.439717:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b73f47df pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:eac801c0-52f7-464a-9cc4-6414e3fd693e+6:39696:x1858065422366784:12345-9344@kfi7:400:default-tuolumne1076-0
00000100:00000200:27.0:1773851894.439718:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065422366784
00000020:00000001:27.0:1773851894.439719:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851894.439720:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851894.439720:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851894.439721:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851894.439722:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851894.439723:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851894.439723:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858065422366784, found 0 last_xid 1858065422366783
00000020:00000001:27.0:1773851894.439724:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851894.439729:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851894.439729:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851894.439730:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851894.439731:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851894.439731:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851894.439732:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851894.439733:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ab733463.
02000000:00000001:27.0:1773851894.439733:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.439734:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851894.439735:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851894.439735:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183258172993, transno 0, xid 1858065422366784
00010000:00000001:27.0:1773851894.439736:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851894.439737:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b73f47df x1858065422366784/t0(0) o400->eac801c0-52f7-464a-9cc4-6414e3fd693e@9344@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1076-0'
00010000:00000001:27.0:1773851894.439740:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851894.439740:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851894.439741:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=127 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851894.439742:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851894.439743:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000084b194ff refcount 3 to 9344@kfi7
00000100:00000001:27.0:1773851894.439744:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130859744 : -107149578691872 : ffff9e8c4b6c9ae0)
02000000:00000001:27.0:1773851894.439744:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851894.439745:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.439746:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851894.439747:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9281@kfi7
00000400:00000010:27.0:1773851894.439747:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cea3c950.
00000100:00000200:27.0:1773851894.439748:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858065422366784, offset 224
00000400:00000200:27.0:1773851894.439749:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9281@kfi7
00000400:00000200:27.0:1773851894.439750:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9281@kfi7 to cpt 6
00000400:00000200:27.0:1773851894.439751:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7b52ebf nid 9281@kfi7 refs 1
00000400:00000200:27.0:1773851894.439753:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b7b52ebf nid 9281@kfi7 refs 2
00000400:00000200:27.0:1773851894.439754:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b7b52ebf nid 9281@kfi7 refs 3
00000400:00000200:27.0:1773851894.439755:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9281@kfi7 local destination
00000400:00000200:27.0:1773851894.439757:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770116:8770116:1024:4294967295] 9281@kfi7 LPNI seq info [244014:244014:16:4294967295]
00000400:00000200:27.0:1773851894.439758:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b7b52ebf nid 9281@kfi7 refs 2
00000400:00000200:27.0:1773851894.439759:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9281@kfi7 to cpt 6
00000400:00000200:27.0:1773851894.439761:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9281@kfi7(9281@kfi7:9281@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851894.439762:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b7b52ebf nid 9281@kfi7 refs 3
00000800:00000200:27.0:1773851894.439763:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851894.439764:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851894.439766:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851894.439768:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b11 Using peer 9281@kfi7(0x100000000000b11)
00000800:00000200:27.0:1773851894.439771:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0x100000000000b11: rc=0
00000800:00000200:27.0:1773851894.439773:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b11 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851894.439775:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851894.439776:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000084b194ff refcount 2 to 9344@kfi7
00010000:00000001:27.0:1773851894.439776:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851894.439777:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851894.439778:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851894.439778:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b73f47df x1858065422366784/t0(0) o400->eac801c0-52f7-464a-9cc4-6414e3fd693e@9344@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1076-0'
00000100:00100000:27.0:1773851894.439781:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b73f47df pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:eac801c0-52f7-464a-9cc4-6414e3fd693e+6:39696:x1858065422366784:12345-9344@kfi7:400:default-tuolumne1076-0 Request processed in 64us (95us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851894.439783:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9344@kfi7, seq: 2025172
00000100:00000040:27.0:1773851894.439784:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006acd59c0 : new rpc_count 0
00000100:00000001:27.0:1773851894.439785:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851894.439785:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b11 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851894.439786:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851894.439786:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851894.439786:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851894.439787:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000400:00000200:25.0:1773851894.439787:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9281@kfi7: PUT: OK
00000020:00000010:27.0:1773851894.439788:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000330439b1.
00000400:00000200:25.0:1773851894.439788:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cea3c950
00000020:00000040:27.0:1773851894.439789:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000006acd59c0 : new refcount 5
00000100:00000001:27.0:1773851894.439789:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851894.439789:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cea3c950.
00000100:00000001:25.0:1773851894.439790:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.439790:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.439791:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7b52ebf nid 9281@kfi7 refs 2
00000800:00000200:25.0:1773851894.439792:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2054@kfi7:6 -> 9281@kfi7(000000009e0c802b):0x0 lsk 2834 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000b11 Transaction freed
00000800:00000200:25.0:1773851894.468180:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.468181:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.468182:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.468184:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851894.468186:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21426@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.468187:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21426@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.468188:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21426@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.468188:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 1
00000400:00000200:25.0:1773851894.468190:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21426@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.468191:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 2
00000400:00000200:25.0:1773851894.468192:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 3
00000400:00000200:25.0:1773851894.468193:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21426@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.468194:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21426@kfi7 of length 224 into portal 12 MB=0x699e34bc1acc0
00000400:00000200:25.0:1773851894.468195:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21426@kfi7 of length 224/224 into md 0x16159c9699 [64] + 34896
00000800:00000200:25.0:1773851894.468197:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851894.468198:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.468199:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21426@kfi7: PUT: OK
00000100:00000001:25.0:1773851894.468200:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851894.468200:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851894.468202:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f72b8945.
00000100:00000040:25.0:1773851894.468202:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000f72b8945 x1858051367873728 msgsize 224
00000100:00100000:25.0:1773851894.468203:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-21426@kfi7 (source: 12345-21426@kfi7)
00000100:00000001:25.0:1773851894.468205:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851894.468205:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 2
00000800:00000200:25.0:1773851894.468206:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851894.468207:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851894.468208:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851894.468209:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851894.468209:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851894.468210:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851894.468211:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858051367873728
00000020:00000001:27.0:1773851894.468212:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851894.468213:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac919ca
00000020:00000001:27.0:1773851894.468214:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851894.468219:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074d2db97 refcount=6
00000020:00000001:27.0:1773851894.468220:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242233856 : -107152467317760 : ffff9e8b9f3fac00)
00000020:00000001:27.0:1773851894.468221:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242233856 : -107152467317760 : ffff9e8b9f3fac00)
00000100:00000001:27.0:1773851894.468223:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851894.468224:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851894.468225:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009d10f841.
00000020:00000010:27.0:1773851894.468226:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851894.468227:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000837f9711.
00000100:00000001:27.0:1773851894.468228:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851894.468229:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851894.468230:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.468231:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851894.468232:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851894.468232:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851894.468233:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851894.468235:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851894.468235:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851894.468235:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851894.468236:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:25.0:1773851894.468236:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21426@kfi7, seq: 2025173
00000100:00000001:27.0:1773851894.468237:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851894.468237:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074d2db97 : new rpc_count 1
00000100:00000001:27.0:1773851894.468238:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851894.468238:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780439552 : -106994929112064 : ffff9eb04d41ec00)
00000100:00000040:25.0:1773851894.468239:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f72b8945 x1858051367873728/t0(0) o400->a9f0e637-5cd2-4995-9134-be37ce2a7daa@21426@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1818-0'
00000100:00000001:25.0:1773851894.468242:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851894.468242:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851894.468243:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f72b8945 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:a9f0e637-5cd2-4995-9134-be37ce2a7daa+6:39848:x1858051367873728:12345-21426@kfi7:400:default-tuolumne1818-0
00000100:00000200:25.0:1773851894.468244:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858051367873728
00000020:00000001:25.0:1773851894.468245:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851894.468246:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851894.468247:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851894.468247:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851894.468248:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:25.0:1773851894.468248:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:25.0:1773851894.468249:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858051367873728, found 0 last_xid 1858051367873727
00000020:00000001:25.0:1773851894.468250:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851894.468250:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851894.468251:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851894.468251:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851894.468252:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:25.0:1773851894.468252:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851894.468253:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851894.468253:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000039e27847.
02000000:00000001:25.0:1773851894.468254:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851894.468254:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851894.468255:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851894.468255:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044172877, transno 0, xid 1858051367873728
00010000:00000001:25.0:1773851894.468256:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851894.468257:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f72b8945 x1858051367873728/t0(0) o400->a9f0e637-5cd2-4995-9134-be37ce2a7daa@21426@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1818-0'
00010000:00000001:25.0:1773851894.468259:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851894.468260:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851894.468260:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=127 v=313 (313 212 1 1)
00000100:00000001:25.0:1773851894.468261:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851894.468262:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000af509d4b refcount 3 to 21426@kfi7
00000100:00000001:25.0:1773851894.468263:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330624 : -107155410220992 : ffff9e8aefd68840)
02000000:00000001:25.0:1773851894.468263:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851894.468264:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851894.468265:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851894.468265:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21426@kfi7
00000400:00000010:25.0:1773851894.468266:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007af4f389.
00000100:00000200:25.0:1773851894.468267:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858051367873728, offset 224
00000400:00000200:25.0:1773851894.468268:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21426@kfi7
00000400:00000200:25.0:1773851894.468269:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21426@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.468269:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 1
00000400:00000200:25.0:1773851894.468270:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 2
00000400:00000200:25.0:1773851894.468271:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 3
00000400:00000200:25.0:1773851894.468272:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21426@kfi7 local destination
00000400:00000200:25.0:1773851894.468274:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770117:8770117:1024:4294967295] 21426@kfi7 LPNI seq info [7241247:7241247:16:4294967295]
00000400:00000200:25.0:1773851894.468275:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 2
00000400:00000200:25.0:1773851894.468276:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21426@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.468277:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21426@kfi7(21426@kfi7:21426@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851894.468278:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 3
00000800:00000200:25.0:1773851894.468279:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.468280:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:25.0:1773851894.468282:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851894.468284:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000639 Using peer 21426@kfi7(0x100000000000639)
00000800:00000200:25.0:1773851894.468287:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000878f9def: Posted send of 324 bytes to peer 0x100000000000639: rc=0
00000800:00000200:25.0:1773851894.468289:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000639 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851894.468290:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851894.468291:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000af509d4b refcount 2 to 21426@kfi7
00010000:00000001:25.0:1773851894.468292:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851894.468292:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851894.468293:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851894.468293:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f72b8945 x1858051367873728/t0(0) o400->a9f0e637-5cd2-4995-9134-be37ce2a7daa@21426@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1818-0'
00000100:00100000:25.0:1773851894.468296:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f72b8945 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:a9f0e637-5cd2-4995-9134-be37ce2a7daa+6:39848:x1858051367873728:12345-21426@kfi7:400:default-tuolumne1818-0 Request processed in 53us (93us total) trans 0 rc 0/0
00000100:00100000:25.0:1773851894.468298:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21426@kfi7, seq: 2025173
00000100:00000040:25.0:1773851894.468299:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074d2db97 : new rpc_count 0
00000100:00000001:25.0:1773851894.468300:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851894.468300:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851894.468300:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:25.0:1773851894.468301:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000837f9711.
00000020:00000010:25.0:1773851894.468302:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009d10f841.
00000020:00000040:25.0:1773851894.468303:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000074d2db97 : new refcount 5
00000100:00000001:25.0:1773851894.468303:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851894.468304:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000639 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851894.468307:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851894.468308:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21426@kfi7: PUT: OK
00000400:00000200:26.0:1773851894.468310:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007af4f389
00000400:00000010:26.0:1773851894.468310:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007af4f389.
00000100:00000001:26.0:1773851894.468312:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851894.468312:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851894.468313:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007bf9ee8 nid 21426@kfi7 refs 2
00000800:00000200:26.0:1773851894.468316:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 21426@kfi7(000000009e9917fc):0x0 lsk 1594 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000639 Transaction freed
00000800:00000200:17.0:1773851894.492539:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851894.492540:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851894.492541:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851894.492544:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851894.492546:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10977@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.492547:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10977@kfi7 : PUT - for me
00000400:00000200:17.0:1773851894.492548:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10977@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.492549:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000597d0815 nid 10977@kfi7 refs 1
00000400:00000200:17.0:1773851894.492550:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10977@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.492551:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000597d0815 nid 10977@kfi7 refs 2
00000400:00000200:17.0:1773851894.492551:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000597d0815 nid 10977@kfi7 refs 3
00000400:00000200:17.0:1773851894.492552:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10785@kfi7 to cpt 2
00000400:00000200:17.0:1773851894.492553:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10785@kfi7 of length 224 into portal 12 MB=0x699e1ce9a7800
00000400:00000200:17.0:1773851894.492555:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10785@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 42528
00000800:00000200:17.0:1773851894.492557:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851894.492558:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851894.492560:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10977@kfi7: PUT: OK
00000100:00000001:17.0:1773851894.492561:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851894.492562:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851894.492563:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000048674586.
00000100:00000040:17.0:1773851894.492563:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000048674586 x1858044973185024 msgsize 224
00000100:00100000:17.0:1773851894.492565:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-10785@kfi7 (source: 12345-10977@kfi7)
00000100:00000001:17.0:1773851894.492566:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851894.492567:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000597d0815 nid 10977@kfi7 refs 2
00000100:00000001:16.0:1773851894.492568:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851894.492568:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851894.492569:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851894.492569:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851894.492569:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851894.492570:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851894.492571:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044973185024
00000020:00000001:16.0:1773851894.492571:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851894.492572:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91754
00000020:00000001:16.0:1773851894.492573:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851894.492575:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000cc37fd1 refcount=6
00000020:00000001:16.0:1773851894.492575:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241483264 : -107152468068352 : ffff9e8b9f343800)
00000020:00000001:16.0:1773851894.492576:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241483264 : -107152468068352 : ffff9e8b9f343800)
00000100:00000001:16.0:1773851894.492577:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851894.492578:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851894.492579:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a73103fc.
00000020:00000010:16.0:1773851894.492580:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851894.492581:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000016f94b72.
00000100:00000001:16.0:1773851894.492582:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851894.492582:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851894.492583:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851894.492584:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851894.492584:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851894.492585:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.492586:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851894.492587:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851894.492587:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851894.492588:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851894.492588:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851894.492589:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10785@kfi7, seq: 2156418
00000100:00000001:17.0:1773851894.492590:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851894.492590:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851894.492590:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000cc37fd1 : new rpc_count 1
00000100:00000001:16.0:1773851894.492591:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968755456 : -106974740796160 : ffff9eb500932d00)
00000100:00000040:16.0:1773851894.492592:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000048674586 x1858044973185024/t0(0) o400->053c3594-8b76-4d55-8e97-9f2f4a2e92d5@10785@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1167-0'
00000100:00000001:16.0:1773851894.492594:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851894.492595:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851894.492596:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000048674586 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:053c3594-8b76-4d55-8e97-9f2f4a2e92d5+6:39867:x1858044973185024:12345-10785@kfi7:400:default-tuolumne1167-0
00000100:00000200:16.0:1773851894.492598:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044973185024
00000020:00000001:16.0:1773851894.492599:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851894.492599:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851894.492600:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.492600:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851894.492601:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851894.492602:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851894.492602:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044973185024, found 0 last_xid 1858044973185023
00000020:00000001:16.0:1773851894.492603:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851894.492604:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851894.492604:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851894.492605:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.492606:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851894.492606:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851894.492607:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851894.492608:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea3653dd.
02000000:00000001:16.0:1773851894.492608:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.492609:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.492609:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851894.492610:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690492, transno 0, xid 1858044973185024
00010000:00000001:16.0:1773851894.492611:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851894.492612:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000048674586 x1858044973185024/t0(0) o400->053c3594-8b76-4d55-8e97-9f2f4a2e92d5@10785@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1167-0'
00010000:00000001:16.0:1773851894.492614:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851894.492615:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851894.492616:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=127 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851894.492617:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851894.492618:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cce5b07a refcount 3 to 10785@kfi7
00000100:00000001:16.0:1773851894.492618:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611328 : -107146809940288 : ffff9e8cf07466c0)
02000000:00000001:16.0:1773851894.492619:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851894.492620:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.492620:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851894.492621:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10977@kfi7
00000400:00000010:16.0:1773851894.492622:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001fe92b14.
00000100:00000200:16.0:1773851894.492623:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044973185024, offset 224
00000400:00000200:16.0:1773851894.492624:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10977@kfi7
00000400:00000200:16.0:1773851894.492625:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10977@kfi7 to cpt 4
00000400:00000200:16.0:1773851894.492626:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000597d0815 nid 10977@kfi7 refs 1
00000400:00000200:16.0:1773851894.492627:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000597d0815 nid 10977@kfi7 refs 2
00000400:00000200:16.0:1773851894.492628:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000597d0815 nid 10977@kfi7 refs 3
00000400:00000200:16.0:1773851894.492630:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10977@kfi7 local destination
00000400:00000200:16.0:1773851894.492631:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770118:8770118:1024:4294967295] 10977@kfi7 LPNI seq info [233002:233002:16:4294967295]
00000400:00000200:16.0:1773851894.492632:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000597d0815 nid 10977@kfi7 refs 2
00000400:00000200:16.0:1773851894.492633:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10977@kfi7 to cpt 4
00000400:00000200:16.0:1773851894.492635:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10977@kfi7(10977@kfi7:10977@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851894.492636:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000597d0815 nid 10977@kfi7 refs 3
00000800:00000200:16.0:1773851894.492638:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851894.492639:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851894.492641:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851894.492643:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001069 Using peer 10977@kfi7(0x100000000001069)
00000800:00000200:16.0:1773851894.492646:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x100000000001069: rc=0
00000800:00000200:16.0:1773851894.492647:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001069 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851894.492649:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851894.492650:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cce5b07a refcount 2 to 10785@kfi7
00010000:00000001:16.0:1773851894.492651:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851894.492651:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.492652:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851894.492652:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000048674586 x1858044973185024/t0(0) o400->053c3594-8b76-4d55-8e97-9f2f4a2e92d5@10785@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1167-0'
00000100:00100000:16.0:1773851894.492657:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000048674586 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:053c3594-8b76-4d55-8e97-9f2f4a2e92d5+6:39867:x1858044973185024:12345-10785@kfi7:400:default-tuolumne1167-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851894.492660:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10785@kfi7, seq: 2156418
00000100:00000040:16.0:1773851894.492660:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000cc37fd1 : new rpc_count 0
00000100:00000001:16.0:1773851894.492661:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851894.492662:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851894.492662:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851894.492663:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000016f94b72.
00000020:00000010:16.0:1773851894.492664:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a73103fc.
00000020:00000040:16.0:1773851894.492665:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000000cc37fd1 : new refcount 5
00000100:00000001:16.0:1773851894.492666:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851894.492671:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001069 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851894.492673:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851894.492674:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10977@kfi7: PUT: OK
00000400:00000200:17.0:1773851894.492675:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001fe92b14
00000400:00000010:17.0:1773851894.492676:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001fe92b14.
00000100:00000001:17.0:1773851894.492676:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851894.492677:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851894.492678:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000597d0815 nid 10977@kfi7 refs 2
00000800:00000200:17.0:1773851894.492679:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 10977@kfi7(000000009f8eeb26):0x0 lsk 4202 rsk 58 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001069 Transaction freed
00000800:00000200:17.0:1773851894.497889:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851894.497890:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851894.497891:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851894.497893:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851894.497895:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22339@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.497896:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22339@kfi7 : PUT - for me
00000400:00000200:17.0:1773851894.497897:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22339@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.497898:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 1
00000400:00000200:17.0:1773851894.497899:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22339@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.497899:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 2
00000400:00000200:17.0:1773851894.497900:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 3
00000400:00000200:17.0:1773851894.497901:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22403@kfi7 to cpt 7
00000400:00000200:17.0:1773851894.497901:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22403@kfi7 of length 224 into portal 12 MB=0x69b4c622fd080
00000400:00000200:17.0:1773851894.497902:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22403@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 42752
00000800:00000200:17.0:1773851894.497904:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851894.497905:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851894.497906:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22339@kfi7: PUT: OK
00000100:00000001:17.0:1773851894.497907:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851894.497907:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851894.497908:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad4cabcd.
00000100:00000040:17.0:1773851894.497909:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000ad4cabcd x1859602227384448 msgsize 224
00000100:00100000:17.0:1773851894.497910:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22403@kfi7 (source: 12345-22339@kfi7)
00000100:00000001:17.0:1773851894.497911:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851894.497911:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 2
00000800:00000200:17.0:1773851894.497912:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000049bf3717: 2054@kfi7:4 <- 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851894.497912:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851894.497912:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851894.497913:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851894.497913:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851894.497914:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851894.497914:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602227384448
00000020:00000001:16.0:1773851894.497915:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851894.497915:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7faa8
00000020:00000001:16.0:1773851894.497916:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851894.497918:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055e70f6e refcount=5
00000020:00000001:16.0:1773851894.497919:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637110386551808 : -106963322999808 : ffff9eb7a920ec00)
00000020:00000001:16.0:1773851894.497919:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637110386551808 : -106963322999808 : ffff9eb7a920ec00)
00000100:00000001:16.0:1773851894.497920:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851894.497921:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851894.497921:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a73103fc.
00000020:00000010:16.0:1773851894.497922:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851894.497923:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000016f94b72.
00000100:00000001:16.0:1773851894.497923:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851894.497924:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851894.497924:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851894.497925:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851894.497925:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851894.497925:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.497926:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851894.497928:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851894.497928:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851894.497928:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851894.497928:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851894.497929:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22403@kfi7, seq: 2156419
00000100:00000040:17.0:1773851894.497930:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055e70f6e : new rpc_count 1
00000100:00000001:17.0:1773851894.497930:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968754304 : -106974740797312 : ffff9eb500932880)
00000100:00000001:16.0:1773851894.497930:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.497930:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851894.497932:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad4cabcd x1859602227384448/t0(0) o400->b59c7718-d46d-4637-bbcd-7d39cb9d65b5@22403@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1896-0'
00000100:00000001:17.0:1773851894.497934:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851894.497935:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851894.497936:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad4cabcd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b59c7718-d46d-4637-bbcd-7d39cb9d65b5+5:39694:x1859602227384448:12345-22403@kfi7:400:default-tuolumne1896-0
00000100:00000200:17.0:1773851894.497937:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602227384448
00000020:00000001:17.0:1773851894.497938:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851894.497938:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851894.497939:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.497939:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851894.497940:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851894.497940:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851894.497941:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602227384448, found 0 last_xid 1859602227384447
00000020:00000001:17.0:1773851894.497941:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851894.497942:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851894.497942:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851894.497943:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.497943:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851894.497944:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851894.497944:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851894.497945:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007767c329.
02000000:00000001:17.0:1773851894.497945:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851894.497946:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.497946:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851894.497947:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260491156, transno 0, xid 1859602227384448
00010000:00000001:17.0:1773851894.497948:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851894.497948:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad4cabcd x1859602227384448/t0(0) o400->b59c7718-d46d-4637-bbcd-7d39cb9d65b5@22403@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1896-0'
00010000:00000001:17.0:1773851894.497951:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851894.497951:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851894.497952:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=127 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851894.497953:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851894.497954:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d018e449 refcount 3 to 22403@kfi7
00000100:00000001:17.0:1773851894.497954:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063168 : -107155994488448 : ffff9e8acd035180)
02000000:00000001:17.0:1773851894.497955:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851894.497955:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851894.497956:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851894.497957:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22339@kfi7
00000400:00000010:17.0:1773851894.497958:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fff506eb.
00000100:00000200:17.0:1773851894.497959:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602227384448, offset 224
00000400:00000200:17.0:1773851894.497960:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22339@kfi7
00000400:00000200:17.0:1773851894.497961:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22339@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.497962:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 1
00000400:00000200:17.0:1773851894.497963:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 2
00000400:00000200:17.0:1773851894.497965:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 3
00000400:00000200:17.0:1773851894.497967:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22339@kfi7 local destination
00000400:00000200:17.0:1773851894.497969:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770119:8770119:1024:4294967295] 22339@kfi7 LPNI seq info [7229197:7229197:16:4294967295]
00000400:00000200:17.0:1773851894.497971:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 2
00000400:00000200:17.0:1773851894.497972:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22339@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.497975:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22339@kfi7(22339@kfi7:22339@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851894.497976:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 3
00000800:00000200:17.0:1773851894.497978:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851894.497980:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851894.497983:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851894.497987:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000739 Using peer 22339@kfi7(0x100000000000739)
00000800:00000200:17.0:1773851894.497991:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049bf3717: Posted send of 324 bytes to peer 0x100000000000739: rc=0
00000800:00000200:17.0:1773851894.497994:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000739 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851894.497997:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851894.497998:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d018e449 refcount 2 to 22403@kfi7
00010000:00000001:17.0:1773851894.497999:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851894.497999:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.498000:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851894.498001:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad4cabcd x1859602227384448/t0(0) o400->b59c7718-d46d-4637-bbcd-7d39cb9d65b5@22403@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1896-0'
00000100:00100000:17.0:1773851894.498006:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad4cabcd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:b59c7718-d46d-4637-bbcd-7d39cb9d65b5+5:39694:x1859602227384448:12345-22403@kfi7:400:default-tuolumne1896-0 Request processed in 71us (96us total) trans 0 rc 0/0
00000800:00000200:18.0:1773851894.498007:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000739 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851894.498010:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:17.0:1773851894.498011:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22403@kfi7, seq: 2156419
00000400:00000200:18.0:1773851894.498012:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22339@kfi7: PUT: OK
00000100:00000040:17.0:1773851894.498012:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055e70f6e : new rpc_count 0
00000400:00000200:18.0:1773851894.498013:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fff506eb
00000100:00000001:17.0:1773851894.498013:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:18.0:1773851894.498014:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fff506eb.
00000100:00000001:17.0:1773851894.498014:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:18.0:1773851894.498015:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851894.498015:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:17.0:1773851894.498015:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:17.0:1773851894.498016:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000016f94b72.
00000400:00000200:18.0:1773851894.498017:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bb64e7a5 nid 22339@kfi7 refs 2
00000020:00000010:17.0:1773851894.498018:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a73103fc.
00000800:00000200:18.0:1773851894.498019:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049bf3717: 2054@kfi7:4 -> 22339@kfi7(000000008b4ea3cc):0x0 lsk 1850 rsk 42 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000739 Transaction freed
00000020:00000040:17.0:1773851894.498019:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000055e70f6e : new refcount 4
00000100:00000001:17.0:1773851894.498021:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851894.563695:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.563696:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851894.563698:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851894.563701:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12785@kfi7(00000000db192683):0x55b version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851894.563703:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.563703:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b Using peer 12785@kfi7(0x10000000000055b)
00000800:00000200:6.0:1773851894.563704:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:6.0:1773851894.563706:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851894.563709:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851894.563709:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12785@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.563712:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12785@kfi7 to cpt 1
00000800:00000200:5.0:1773851894.563712:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 38 bytes to peer 0x10000000000055b: rc=0
00000400:00000200:6.0:1773851894.563714:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12785@kfi7 : PUT - for me
00000800:00000200:5.0:1773851894.563714:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851894.563716:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12785@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.563717:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000835a04f nid 12785@kfi7 refs 1
00000400:00000200:6.0:1773851894.563719:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12785@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.563720:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000835a04f nid 12785@kfi7 refs 2
00000400:00000200:6.0:1773851894.563722:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000835a04f nid 12785@kfi7 refs 3
00000400:00000200:6.0:1773851894.563723:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12785@kfi7 to cpt 1
00000800:00000200:5.0:1773851894.563729:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851894.563731:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12785@kfi7 of length 224 into portal 12 MB=0x69b4b77772e00
00000800:00000200:5.0:1773851894.563732:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b Transaction freed
00000400:00000200:6.0:1773851894.563733:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12785@kfi7 of length 224/224 into md 0x793926dc5 [64] + 162848
00000800:00000200:6.0:1773851894.563736:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851894.563739:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851894.563740:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12785@kfi7: PUT: OK
00000100:00000001:6.0:1773851894.563742:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851894.563742:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851894.563744:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ca6aeeb8.
00000100:00000040:6.0:1773851894.563745:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000ca6aeeb8 x1859598289415680 msgsize 224
00000100:00100000:6.0:1773851894.563748:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-12785@kfi7 (source: 12345-12785@kfi7)
00000100:00000001:6.0:1773851894.563749:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851894.563751:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000835a04f nid 12785@kfi7 refs 2
00000100:00000001:4.0:1773851894.563752:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851894.563753:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2054@kfi7:1 <- 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851894.563753:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851894.563754:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851894.563755:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851894.563756:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851894.563757:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598289415680
00000020:00000001:4.0:1773851894.563758:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851894.563759:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f589
00000020:00000001:4.0:1773851894.563760:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851894.563763:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000166ca528 refcount=5
00000020:00000001:4.0:1773851894.563764:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107201504256 : -106966508047360 : ffff9eb6eb48f400)
00000020:00000001:4.0:1773851894.563765:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107201504256 : -106966508047360 : ffff9eb6eb48f400)
00000100:00000001:4.0:1773851894.563766:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851894.563767:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851894.563769:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851894.563770:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851894.563772:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000031fbcfde.
00000100:00000001:4.0:1773851894.563774:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851894.563774:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851894.563775:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851894.563777:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851894.563778:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851894.563779:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851894.563780:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851894.563782:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851894.563783:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851894.563783:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851894.563783:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851894.563784:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12785@kfi7, seq: 2001988
00000100:00000001:7.0:1773851894.563786:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851894.563786:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000166ca528 : new rpc_count 1
00000100:00000001:7.0:1773851894.563787:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851894.563787:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637025359412992 : -107048350138624 : ffff9ea3dd1dbf00)
00000100:00000040:4.0:1773851894.563790:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ca6aeeb8 x1859598289415680/t0(0) o400->329beea3-e54b-4b26-8ddd-05e21537092e@12785@kfi7:144/0 lens 224/0 e 0 to 0 dl 1773852259 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1277-0'
00000100:00000001:4.0:1773851894.563794:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851894.563795:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851894.563796:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca6aeeb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:329beea3-e54b-4b26-8ddd-05e21537092e+5:39539:x1859598289415680:12345-12785@kfi7:400:default-tuolumne1277-0
00000100:00000200:4.0:1773851894.563799:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598289415680
00000020:00000001:4.0:1773851894.563799:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851894.563800:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851894.563801:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.563803:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851894.563803:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851894.563805:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851894.563806:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598289415680, found 0 last_xid 1859598289415679
00000020:00000001:4.0:1773851894.563807:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851894.563808:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851894.563809:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851894.563809:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.563810:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851894.563811:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851894.563812:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851894.563813:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fc8ecc17.
02000000:00000001:4.0:1773851894.563814:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851894.563815:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.563816:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851894.563817:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096703692, transno 0, xid 1859598289415680
00010000:00000001:4.0:1773851894.563818:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851894.563819:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ca6aeeb8 x1859598289415680/t0(0) o400->329beea3-e54b-4b26-8ddd-05e21537092e@12785@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1277-0'
00010000:00000001:4.0:1773851894.563823:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851894.563824:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851894.563825:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=126 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851894.563827:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851894.563829:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000019d92b3a refcount 3 to 12785@kfi7
00000100:00000001:4.0:1773851894.563830:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704416 : -107156155847200 : ffff9e8ac3652de0)
02000000:00000001:4.0:1773851894.563831:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851894.563832:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851894.563833:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851894.563834:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12785@kfi7
00000400:00000010:4.0:1773851894.563835:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000062ec508f.
00000100:00000200:4.0:1773851894.563837:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598289415680, offset 224
00000400:00000200:4.0:1773851894.563839:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12785@kfi7
00000400:00000200:4.0:1773851894.563840:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12785@kfi7 to cpt 1
00000400:00000200:4.0:1773851894.563842:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000835a04f nid 12785@kfi7 refs 1
00000400:00000200:4.0:1773851894.563844:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000835a04f nid 12785@kfi7 refs 2
00000400:00000200:4.0:1773851894.563845:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000835a04f nid 12785@kfi7 refs 3
00000400:00000200:4.0:1773851894.563847:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12785@kfi7 local destination
00000400:00000200:4.0:1773851894.563849:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770120:8770120:1024:4294967295] 12785@kfi7 LPNI seq info [6130768:6130768:16:4294967295]
00000400:00000200:4.0:1773851894.563851:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000835a04f nid 12785@kfi7 refs 2
00000400:00000200:4.0:1773851894.563853:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12785@kfi7 to cpt 1
00000400:00000200:4.0:1773851894.563856:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12785@kfi7(12785@kfi7:12785@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851894.563858:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000835a04f nid 12785@kfi7 refs 3
00000800:00000200:4.0:1773851894.563860:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851894.563862:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851894.563865:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851894.563869:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b Using peer 12785@kfi7(0x10000000000055b)
00000800:00000200:4.0:1773851894.563873:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x10000000000055b: rc=0
00000800:00000200:4.0:1773851894.563876:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851894.563879:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851894.563881:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000019d92b3a refcount 2 to 12785@kfi7
00010000:00000001:4.0:1773851894.563884:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851894.563885:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851894.563886:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851894.563887:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ca6aeeb8 x1859598289415680/t0(0) o400->329beea3-e54b-4b26-8ddd-05e21537092e@12785@kfi7:144/0 lens 224/224 e 0 to 0 dl 1773852259 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1277-0'
00000100:00100000:4.0:1773851894.563892:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca6aeeb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:329beea3-e54b-4b26-8ddd-05e21537092e+5:39539:x1859598289415680:12345-12785@kfi7:400:default-tuolumne1277-0 Request processed in 97us (145us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851894.563895:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12785@kfi7, seq: 2001988
00000100:00000040:4.0:1773851894.563896:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000166ca528 : new rpc_count 0
00000100:00000001:4.0:1773851894.563898:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851894.563899:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851894.563899:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851894.563900:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000031fbcfde.
00000020:00000010:4.0:1773851894.563902:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000020:00000040:4.0:1773851894.563903:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000166ca528 : new refcount 4
00000100:00000001:4.0:1773851894.563904:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851894.563911:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851894.563914:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851894.563916:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12785@kfi7: PUT: OK
00000400:00000200:5.0:1773851894.563917:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000062ec508f
00000400:00000010:5.0:1773851894.563918:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000062ec508f.
00000100:00000001:5.0:1773851894.563919:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851894.563919:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851894.563921:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000835a04f nid 12785@kfi7 refs 2
00000800:00000200:5.0:1773851894.563923:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2054@kfi7:1 -> 12785@kfi7(00000000db192683):0x0 lsk 1372 rsk 25 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000055b Transaction freed
00000004:00000001:10.0:1773851894.601732:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:3.0:1773851894.601732:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851894.601733:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851894.601733:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:15.0:1773851894.601734:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851894.601734:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:3.0:1773851894.601734:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:3.0:1773851894.601734:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f14d14e1.
00000004:00000020:15.0:1773851894.601735:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851894.601735:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001753dd84.
00000100:00000010:10.0:1773851894.601735:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fb9196ac.
00000020:00000040:11.0:1773851894.601736:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000020:00000040:10.0:1773851894.601736:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000020:00000040:3.0:1773851894.601736:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000100:00000010:15.0:1773851894.601737:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000449d3970.
00000100:00000001:3.0:1773851894.601737:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:15.0:1773851894.601738:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:11.0:1773851894.601738:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851894.601738:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:3.0:1773851894.601738:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851894.601739:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851894.601739:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:3.0:1773851894.601739:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.601740:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851894.601740:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851894.601740:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851894.601740:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000193cdc37.
02000000:00000010:11.0:1773851894.601741:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000073bbffc.
02000000:00000010:10.0:1773851894.601741:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000060c86190.
00000100:00000001:3.0:1773851894.601741:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851894.601742:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:3.0:1773851894.601742:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:15.0:1773851894.601743:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851894.601743:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851894.601743:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851894.601743:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:15.0:1773851894.601744:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d0c54e26.
00000100:00000001:11.0:1773851894.601744:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851894.601744:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851894.601745:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851894.601745:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f14d14e1] to pc [ptlrpcd_00_03+3]  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:15.0:1773851894.601746:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851894.601746:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851894.601747:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fb9196ac] to pc [ptlrpcd_02_01+1]  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:15.0:1773851894.601748:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:11.0:1773851894.601748:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001753dd84] to pc [ptlrpcd_02_02+2]  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:15.0:1773851894.601749:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851894.601750:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:2.0:1773851894.601750:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:15.0:1773851894.601751:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000449d3970] to pc [ptlrpcd_03_02+2]  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:3.0:1773851894.601751:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000004aeb8f1.
00000100:00000001:2.0:1773851894.601751:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:3.0:1773851894.601752:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637102153205760 : -106971556345856 : ffff9eb5be620800)
00000100:00000001:2.0:1773851894.601752:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:0.0:1773851894.601752:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851894.601752:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851894.601753:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:2.0:1773851894.601753:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851894.601755:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851894.601755:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851894.601755:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:3.0:1773851894.601755:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:11.0:1773851894.601756:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000042acc974.
00080000:00000010:10.0:1773851894.601756:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d4e306cf.
00000100:00000001:9.0:1773851894.601756:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851894.601756:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851894.601756:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00001000:3.0:1773851894.601756:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000100:00000001:2.0:1773851894.601756:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851894.601756:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851894.601757:0:41068:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000004:00000010:3.0:1773851894.601757:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000002f4b5cc.
02000000:00000001:2.0:1773851894.601757:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:11.0:1773851894.601758:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637027871606784 : -107045837944832 : ffff9ea472dac800)
00080000:00000001:10.0:1773851894.601758:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637053623511040 : -107020086040576 : ffff9eaa71c9a800)
00000100:00000001:9.0:1773851894.601758:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:8.0:1773851894.601758:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:3.0:1773851894.601758:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614169055033429ns, next at 614170055032056ns, rc = 0
02000000:00000001:2.0:1773851894.601758:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851894.601759:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851894.601759:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851894.601759:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851894.601759:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851894.601759:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:3.0:1773851894.601759:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:2.0:1773851894.601759:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f14d14e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051939200:2095@kfi7:13:default-yuba2-0
00080000:00000010:15.0:1773851894.601760:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000407cc744.
00000100:00000001:9.0:1773851894.601760:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851894.601760:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851894.601760:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:3.0:1773851894.601760:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601760:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:14.0:1773851894.601761:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851894.601761:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851894.601761:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851894.601761:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601761:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851894.601761:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851894.601761:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.601761:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:2.0:1773851894.601761:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851894.601762:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637136858265600 : -106936851286016 : ffff9ebdd2f73800)
00000100:00000001:14.0:1773851894.601762:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.601762:0:41074:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00001000:11.0:1773851894.601762:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00001000:10.0:1773851894.601762:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00000100:00000040:9.0:1773851894.601762:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851894.601762:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851894.601762:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.601762:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:15.0:1773851894.601763:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:12.0:1773851894.601763:0:41074:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000004:00000010:11.0:1773851894.601763:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000070476366.
00000004:00000010:10.0:1773851894.601763:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f8e42777.
00000004:00080000:11.0:1773851894.601764:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614169055039710ns, next at 614170055038148ns, rc = 0
00000004:00080000:10.0:1773851894.601764:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614169055039771ns, next at 614170055038238ns, rc = 0
00000100:00100000:8.0:1773851894.601764:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001753dd84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051939264:6@kfi7:13:default-yuba2-0
02000000:00000010:2.0:1773851894.601764:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f82e5278.
02000000:00000001:2.0:1773851894.601764:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601765:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851894.601765:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601765:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:2.0:1773851894.601765:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000040:12.0:1773851894.601766:0:41074:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851894.601766:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851894.601766:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:9.0:1773851894.601766:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851894.601766:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851894.601766:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:2.0:1773851894.601766:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00080000:00000001:11.0:1773851894.601767:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851894.601767:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851894.601767:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fb9196ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051939328:31@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851894.601767:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851894.601767:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:2.0:1773851894.601767:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000757d75ef.
00000004:00000001:11.0:1773851894.601768:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851894.601768:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:2.0:1773851894.601768:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939200, portal 4
00080000:00000001:15.0:1773851894.601769:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601769:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851894.601769:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851894.601769:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851894.601769:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b6e4f22d.
00000100:00000001:2.0:1773851894.601769:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000004:00001000:15.0:1773851894.601770:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
02000000:00000001:9.0:1773851894.601770:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851894.601770:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601770:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288715136 : -106964420836480 : ffff9eb767b14380)
00000004:00000010:15.0:1773851894.601771:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009716a5ec.
00000100:00000001:12.0:1773851894.601771:0:41074:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000010:9.0:1773851894.601771:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000016f65810.
02000000:00000001:9.0:1773851894.601771:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851894.601771:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000010:8.0:1773851894.601771:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000040:2.0:1773851894.601771:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851894.601772:0:41074:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851894.601772:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:8.0:1773851894.601772:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
00000004:00080000:15.0:1773851894.601773:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614169055048026ns, next at 614170055046163ns, rc = 0
02000000:00000001:12.0:1773851894.601773:0:41074:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:9.0:1773851894.601773:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00080000:00000001:15.0:1773851894.601774:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000010:9.0:1773851894.601774:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000100:00000200:8.0:1773851894.601774:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939264, portal 4
00000100:00000001:8.0:1773851894.601774:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851894.601774:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:10.0:1773851894.601775:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:9.0:1773851894.601775:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939328, portal 4
00000100:00000001:8.0:1773851894.601775:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446606464 : -106937262945152 : ffff9ebdba6dcc80)
00000100:00000040:2.0:1773851894.601775:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000010:2.0:1773851894.601775:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000059add96a.
00080000:00000001:15.0:1773851894.601776:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851894.601776:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601776:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851894.601776:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087762176 : -106944621789440 : ffff9ebc03cebf00)
00000100:00000040:8.0:1773851894.601776:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:2.0:1773851894.601776:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939200, offset 0
00000004:00000001:15.0:1773851894.601777:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851894.601777:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:12.0:1773851894.601778:0:41074:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601778:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:2.0:1773851894.601778:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000100:00000001:9.0:1773851894.601779:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851894.601779:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000200:2.0:1773851894.601779:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00100000:12.0:1773851894.601780:0:41074:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000449d3970 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_02:lustre5-MDT0001-mdtlov_UUID:41074:1859433051939392:54@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851894.601780:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:9.0:1773851894.601780:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:8.0:1773851894.601780:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000042ed2e1b.
00000100:00000200:8.0:1773851894.601780:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939264, offset 0
00000400:00000200:2.0:1773851894.601780:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000100:00000001:10.0:1773851894.601781:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851894.601781:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e30a1d2d.
00000100:00000200:9.0:1773851894.601781:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939328, offset 0
00000400:00000200:2.0:1773851894.601781:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:12.0:1773851894.601782:0:41074:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:8.0:1773851894.601782:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000400:00000200:2.0:1773851894.601782:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
02000000:00000001:12.0:1773851894.601783:0:41074:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:9.0:1773851894.601783:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000400:00000200:8.0:1773851894.601783:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.601783:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
02000000:00000001:12.0:1773851894.601784:0:41074:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851894.601784:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
02000000:00000001:12.0:1773851894.601785:0:41074:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:8.0:1773851894.601785:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:2.0:1773851894.601785:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770115, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770120, p:4294967295, g:4294967295, h:1000]
02000000:00000010:12.0:1773851894.601786:0:41074:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d347d281.
00000400:00000200:8.0:1773851894.601786:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
02000000:00000001:12.0:1773851894.601787:0:41074:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851894.601787:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000200:2.0:1773851894.601787:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:2.0:1773851894.601788:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:12.0:1773851894.601789:0:41074:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851894.601789:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770115, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770120, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851894.601789:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000010:12.0:1773851894.601790:0:41074:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000001259ac8.
00000400:00000200:2.0:1773851894.601790:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770121:8770121:1024:4294967295] 2095@kfi7 LPNI seq info [5406048:5406048:16:4294967295]
00000400:00000200:8.0:1773851894.601791:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:8.0:1773851894.601791:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000010:12.0:1773851894.601792:0:41074:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e652fce.
00000400:00000200:8.0:1773851894.601792:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:2.0:1773851894.601792:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000200:12.0:1773851894.601793:0:41074:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939392, portal 4
00000400:00000200:8.0:1773851894.601793:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770122:8770122:1024:4294967295] 6@kfi7 LPNI seq info [5405037:5405037:16:4294967295]
00000400:00000200:2.0:1773851894.601793:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:12.0:1773851894.601795:0:41074:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:12.0:1773851894.601795:0:41074:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860201088 : -107049849350528 : ffff9ea383c19680)
00000400:00000200:8.0:1773851894.601795:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:9.0:1773851894.601796:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:8.0:1773851894.601796:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.601796:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851894.601797:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:2.0:1773851894.601797:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000100:00000040:12.0:1773851894.601798:0:41074:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851894.601798:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851894.601799:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:2.0:1773851894.601799:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:9.0:1773851894.601800:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:8.0:1773851894.601800:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000800:00000200:2.0:1773851894.601800:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851894.601801:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000800:00000200:8.0:1773851894.601801:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:12.0:1773851894.601802:0:41074:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851894.601802:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770121, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770122, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851894.601802:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000040:12.0:1773851894.601803:0:41074:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000800:00000200:2.0:1773851894.601803:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000010:12.0:1773851894.601804:0:41074:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000781064e3.
00000100:00000200:12.0:1773851894.601805:0:41074:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939392, offset 0
00000400:00000200:9.0:1773851894.601805:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:9.0:1773851894.601805:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851894.601805:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851894.601806:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000800:00000200:2.0:1773851894.601806:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Using peer 2095@kfi7(0x5c0)
00000400:00000200:9.0:1773851894.601807:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770123:8770123:1023:4294967295] 31@kfi7 LPNI seq info [5403623:5403623:16:4294967295]
00000800:00000200:8.0:1773851894.601807:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000400:00000200:12.0:1773851894.601808:0:41074:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:9.0:1773851894.601808:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:12.0:1773851894.601809:0:41074:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851894.601809:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:8.0:1773851894.601810:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000800:00000200:2.0:1773851894.601810:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000e8d7e86a: Posted send of 324 bytes to peer 0x5c0: rc=0
00000400:00000200:12.0:1773851894.601811:0:41074:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:9.0:1773851894.601811:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000800:00000200:2.0:1773851894.601811:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:12.0:1773851894.601812:0:41074:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851894.601812:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:8.0:1773851894.601812:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851894.601813:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851894.601814:0:41074:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000800:00000200:9.0:1773851894.601814:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851894.601814:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851894.601814:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601814:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851894.601815:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851894.601815:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601815:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851894.601816:0:41074:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000800:00000200:9.0:1773851894.601816:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:2.0:1773851894.601816:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601817:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601817:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.601817:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:12.0:1773851894.601818:0:41074:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8770123, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770122, p:4294967295, g:4294967295, h:1000]
00000100:00000001:8.0:1773851894.601818:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:9.0:1773851894.601819:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Using peer 31@kfi7(0x56e)
00000100:00000001:2.0:1773851894.601819:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851894.601819:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851894.601820:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851894.601821:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:2.0:1773851894.601821:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851894.601821:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851894.601822:0:41074:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:9.0:1773851894.601822:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x56e: rc=0
00000100:00000001:8.0:1773851894.601822:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851894.601822:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851894.601822:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851894.601824:0:41074:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:9.0:1773851894.601824:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:3.0:1773851894.601824:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 TN_EVENT_TX_OK event status 0
00000400:00000200:12.0:1773851894.601825:0:41074:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000100:00000001:9.0:1773851894.601826:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601826:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:3.0:1773851894.601826:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:12.0:1773851894.601827:0:41074:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770124:8770124:1023:4294967295] 54@kfi7 LPNI seq info [5403928:5403928:16:4294967295]
00000100:00000001:9.0:1773851894.601827:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601828:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601828:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601828:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:3.0:1773851894.601828:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:12.0:1773851894.601829:0:41074:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:8.0:1773851894.601829:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:3.0:1773851894.601829:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000059add96a
00000800:00000200:10.0:1773851894.601830:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000400:00000010:3.0:1773851894.601830:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000059add96a.
00000100:00000001:3.0:1773851894.601830:0:2506738:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:12.0:1773851894.601832:0:41074:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000200:3.0:1773851894.601832:0:2506738:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851894.601833:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:12.0:1773851894.601835:0:41074:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851894.601835:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000100:00000001:3.0:1773851894.601835:0:2506738:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:10.0:1773851894.601836:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000042ed2e1b
00000800:00000200:9.0:1773851894.601836:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_EVENT_TX_OK event status 0
00000100:00000040:3.0:1773851894.601836:0:2506738:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:10.0:1773851894.601837:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000042ed2e1b.
00000400:00000200:12.0:1773851894.601838:0:41074:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851894.601838:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851894.601839:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:9.0:1773851894.601839:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:3.0:1773851894.601839:0:2506738:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:12.0:1773851894.601840:0:41074:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000200:10.0:1773851894.601840:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851894.601840:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e30a1d2d
00000400:00000010:9.0:1773851894.601840:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e30a1d2d.
00000100:00000001:3.0:1773851894.601840:0:2506738:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851894.601841:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:3.0:1773851894.601841:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000800:00000200:12.0:1773851894.601842:0:41074:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000200:9.0:1773851894.601842:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:3.0:1773851894.601842:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 0 tta 0x5c0 Transaction freed
00000100:00000001:9.0:1773851894.601844:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:10.0:1773851894.601845:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851894.601845:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:12.0:1773851894.601846:0:41074:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000040:10.0:1773851894.601846:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851894.601848:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601848:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851894.601849:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:12.0:1773851894.601850:0:41074:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000100:00000001:10.0:1773851894.601850:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851894.601851:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:9.0:1773851894.601851:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Transaction freed
00000400:00000200:10.0:1773851894.601853:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:12.0:1773851894.601855:0:41074:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000800:00000200:10.0:1773851894.601855:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Transaction freed
00000800:00000200:12.0:1773851894.601858:0:41074:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851894.601861:0:41074:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.601862:0:41074:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:12.0:1773851894.601863:0:41074:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851894.601866:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:12.0:1773851894.601867:0:41074:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851894.601868:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:12.0:1773851894.601868:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851894.601870:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:12.0:1773851894.601870:0:41074:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:12.0:1773851894.601871:0:41074:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:12.0:1773851894.601872:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851894.601873:0:41074:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851894.601874:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:2.0:1773851894.601874:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.601875:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851894.601876:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851894.601877:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:29.0:1773851894.601879:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2095@kfi7 : PUT - for me
00000800:00000200:2.0:1773851894.601879:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851894.601880:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000100:00000001:12.0:1773851894.601880:0:41074:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851894.601881:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:12.0:1773851894.601881:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851894.601881:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851894.601882:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:13.0:1773851894.601882:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.601883:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:2.0:1773851894.601883:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:29.0:1773851894.601884:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851894.601884:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000781064e3
00000400:00000010:13.0:1773851894.601884:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000781064e3.
00000400:00000200:2.0:1773851894.601884:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851894.601885:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:13.0:1773851894.601885:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:2.0:1773851894.601885:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000100:00000200:13.0:1773851894.601886:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851894.601887:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000800:00000200:17.0:1773851894.601887:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000400:00000200:2.0:1773851894.601887:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.601887:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:17.0:1773851894.601888:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:2.0:1773851894.601888:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:29.0:1773851894.601889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:13.0:1773851894.601889:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:17.0:1773851894.601890:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:13.0:1773851894.601890:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851894.601890:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:29.0:1773851894.601891:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6180
00000400:00000200:2.0:1773851894.601891:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b61c0
00000800:00000200:17.0:1773851894.601892:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:13.0:1773851894.601892:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851894.601893:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:13.0:1773851894.601893:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:2.0:1773851894.601893:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:17.0:1773851894.601894:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:13.0:1773851894.601894:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:29.0:1773851894.601895:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x780081cbd [1] + 224
00000400:00000200:17.0:1773851894.601895:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:2.0:1773851894.601895:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71e2a1 [1] + 224
00000800:00000200:13.0:1773851894.601896:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000400:00000200:17.0:1773851894.601897:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:29.0:1773851894.601898:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851894.601898:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000800:00000200:2.0:1773851894.601898:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851894.601899:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.601900:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851894.601900:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851894.601901:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851894.601901:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:2.0:1773851894.601901:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000400:00000200:17.0:1773851894.601902:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:2.0:1773851894.601902:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851894.601903:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2095@kfi7: PUT: OK
00000400:00000200:17.0:1773851894.601903:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6200
00000400:00000200:17.0:1773851894.601904:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000200:2.0:1773851894.601904:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851894.601905:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851894.601906:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f2131 [1] + 224
00000100:00000200:29.0:1773851894.601907:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851894.601907:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000040:2.0:1773851894.601907:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851894.601908:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851894.601908:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851894.601909:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851894.601910:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:29.0:1773851894.601911:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851894.601911:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:2.0:1773851894.601911:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:13.0:1773851894.601912:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851894.601912:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000001:17.0:1773851894.601913:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851894.601913:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851894.601913:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:13.0:1773851894.601914:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:2.0:1773851894.601914:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000200:17.0:1773851894.601915:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851894.601915:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000001:8.0:1773851894.601915:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851894.601915:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:13.0:1773851894.601916:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000010:8.0:1773851894.601916:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000100:00000001:29.0:1773851894.601917:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851894.601917:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:8.0:1773851894.601917:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000400:00000010:8.0:1773851894.601917:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000100:00000040:17.0:1773851894.601918:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851894.601918:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.601918:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:8.0:1773851894.601918:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851894.601919:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:13.0:1773851894.601919:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000100:00000200:8.0:1773851894.601919:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.601919:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851894.601920:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851894.601921:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2095@kfi7(000000009e466280):0x0 lsk 1473 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851894.601921:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851894.601921:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000001:2.0:1773851894.601921:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:2.0:1773851894.601921:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:17.0:1773851894.601922:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:13.0:1773851894.601922:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6240
00000100:00000200:8.0:1773851894.601922:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:2.0:1773851894.601922:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000400:00000200:13.0:1773851894.601923:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:9.0:1773851894.601923:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:2.0:1773851894.601923:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000757d75ef
00000800:00000200:17.0:1773851894.601924:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851894.601924:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f702d [1] + 224
00000100:00000001:9.0:1773851894.601924:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:2.0:1773851894.601924:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000757d75ef.
00000400:00000001:9.0:1773851894.601925:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851894.601925:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:2.0:1773851894.601925:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851894.601926:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:9.0:1773851894.601926:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000100:00000200:2.0:1773851894.601926:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851894.601927:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000100:00000001:8.0:1773851894.601927:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851894.601927:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851894.601928:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:9.0:1773851894.601928:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:9.0:1773851894.601928:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851894.601928:0:41070:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:13.0:1773851894.601929:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000100:00000200:9.0:1773851894.601929:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851894.601929:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851894.601929:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:2.0:1773851894.601929:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851894.601930:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851894.601930:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851894.601930:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:13.0:1773851894.601931:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851894.601931:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=127 v=66 (66 66 66 66)
00000100:00000001:2.0:1773851894.601931:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:9.0:1773851894.601932:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:8.0:1773851894.601932:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=42 v=66 (1 1 1 1)
00000100:00000001:2.0:1773851894.601932:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851894.601933:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851894.601933:0:41063:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:2.0:1773851894.601933:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:13.0:1773851894.601934:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851894.601934:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601934:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851894.601934:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601935:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851894.601935:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851894.601935:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851894.601935:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601936:0:41068:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851894.601936:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851894.601936:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:2.0:1773851894.601936:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851894.601936:0:41063:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=127 v=66 (66 66 66 66)
00000100:00000001:13.0:1773851894.601937:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851894.601937:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:9.0:1773851894.601937:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851894.601937:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851894.601937:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000001:8.0:1773851894.601937:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851894.601937:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851894.601938:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851894.601938:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=127 v=66 (1 1 1 1)
00000800:00000200:13.0:1773851894.601939:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851894.601939:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:9.0:1773851894.601939:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=127 v=66 (66 66 66 66)
00000100:00000040:8.0:1773851894.601939:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.601939:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:2.0:1773851894.601939:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.601940:0:41074:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:9.0:1773851894.601940:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=127 v=66 (1 1 1 1)
00010000:00000001:2.0:1773851894.601940:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:2.0:1773851894.601940:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:12.0:1773851894.601941:0:41074:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:9.0:1773851894.601941:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851894.601941:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851894.601941:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:12.0:1773851894.601942:0:41074:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:9.0:1773851894.601942:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851894.601942:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851894.601942:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:2.0:1773851894.601942:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000001:2.0:1773851894.601942:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:12.0:1773851894.601943:0:41074:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000001259ac8.
00010000:00000001:9.0:1773851894.601943:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601943:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851894.601943:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:2.0:1773851894.601943:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851894.601944:0:41074:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e652fce
00000100:00000001:9.0:1773851894.601944:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851894.601944:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000004:00000040:8.0:1773851894.601944:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000100:00000040:2.0:1773851894.601944:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:12.0:1773851894.601945:0:41074:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e652fce.
00000100:00000001:9.0:1773851894.601945:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851894.601945:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:8.0:1773851894.601945:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420222464 avail=351417744384 avail_mb=1372725564 hwm_mb=3131103 files=372008873 ffree=343183811 state=0: rc = 0
00000100:00000001:12.0:1773851894.601946:0:41074:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:2.0:1773851894.601946:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:12.0:1773851894.601947:0:41074:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851894.601947:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:8.0:1773851894.601947:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420222464 free, 351417744384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372008873 files, 343183811 free files
00000100:00000001:2.0:1773851894.601948:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851894.601948:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851894.601949:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000001:8.0:1773851894.601949:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.601949:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:2.0:1773851894.601949:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851894.601950:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851894.601950:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:8.0:1773851894.601950:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:2.0:1773851894.601950:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449345024 avail=351446775808 avail_mb=1372838968 hwm_mb=3131103 files=372160923 ffree=343212251 state=0: rc = 0
00000004:00000001:9.0:1773851894.601951:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851894.601952:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000004:00000020:2.0:1773851894.601952:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449345024 free, 351446775808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160923 files, 343212251 free files
00000004:00000040:9.0:1773851894.601953:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666633728 avail=351645446144 avail_mb=1373615024 hwm_mb=3131103 files=372237768 ffree=343424447 state=0: rc = 0
00000100:00100000:8.0:1773851894.601953:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001753dd84 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051939264:6@kfi7:13:default-yuba2-0
00000004:00000001:2.0:1773851894.601953:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:9.0:1773851894.601955:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666633728 free, 351645446144 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237768 files, 343424447 free files
00000100:00000040:2.0:1773851894.601955:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:9.0:1773851894.601956:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601956:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:12.0:1773851894.601957:0:41074:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851894.601957:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00100000:2.0:1773851894.601957:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f14d14e1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051939200:2095@kfi7:13:default-yuba2-0
00000100:00000040:9.0:1773851894.601958:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851894.601958:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001753dd84 x1859433051939264/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.601959:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:9.0:1773851894.601960:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fb9196ac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051939328:31@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851894.601960:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:2.0:1773851894.601960:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:12.0:1773851894.601961:0:41074:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:8.0:1773851894.601961:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:2.0:1773851894.601961:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f14d14e1 x1859433051939200/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:12.0:1773851894.601962:0:41074:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851894.601962:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:8.0:1773851894.601962:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b6e4f22d.
00000100:00000001:12.0:1773851894.601963:0:41074:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:9.0:1773851894.601963:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:8.0:1773851894.601963:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:12.0:1773851894.601964:0:41074:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:9.0:1773851894.601964:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fb9196ac x1859433051939328/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:8.0:1773851894.601964:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851894.601964:0:41070:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000100:00000001:2.0:1773851894.601964:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:2.0:1773851894.601964:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:12.0:1773851894.601965:0:41074:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:8.0:1773851894.601965:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851894.601965:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000073bbffc.
02000000:00000010:2.0:1773851894.601965:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f82e5278.
00000100:00000001:12.0:1773851894.601966:0:41074:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601966:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851894.601966:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:8.0:1773851894.601966:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:2.0:1773851894.601966:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:12.0:1773851894.601967:0:41074:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:9.0:1773851894.601967:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000016f65810.
02000000:00000001:8.0:1773851894.601967:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851894.601967:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001753dd84.
00000020:00000001:2.0:1773851894.601967:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851894.601967:0:41063:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
02000000:00000001:9.0:1773851894.601968:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:8.0:1773851894.601968:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851894.601968:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851894.601968:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:12.0:1773851894.601969:0:41074:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=127 v=66 (66 66 66 66)
00000020:00000001:9.0:1773851894.601969:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851894.601969:0:41068:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:8.0:1773851894.601969:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:2.0:1773851894.601969:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000193cdc37.
02000000:00000001:2.0:1773851894.601969:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:9.0:1773851894.601970:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851894.601970:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000060c86190.
00000100:00000001:8.0:1773851894.601970:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:2.0:1773851894.601970:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851894.601970:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f14d14e1.
00000100:00001000:12.0:1773851894.601971:0:41074:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=127 v=66 (1 1 1 1)
02000000:00000001:9.0:1773851894.601971:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851894.601971:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.601971:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851894.601971:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:9.0:1773851894.601972:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851894.601972:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fb9196ac.
00000100:00000001:8.0:1773851894.601972:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601972:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.601972:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.601973:0:41074:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851894.601973:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851894.601973:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:12.0:1773851894.601974:0:41074:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601974:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851894.601974:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.601974:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601974:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00010000:00000001:12.0:1773851894.601975:0:41074:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:9.0:1773851894.601975:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851894.601975:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.601975:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.601976:0:41074:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851894.601976:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851894.601976:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.601977:0:41074:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:12.0:1773851894.601978:0:41074:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:12.0:1773851894.601979:0:41074:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:12.0:1773851894.601980:0:41074:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.601982:0:41074:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:12.0:1773851894.601986:0:41074:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:12.0:1773851894.601987:0:41074:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:12.0:1773851894.601988:0:41074:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:12.0:1773851894.601989:0:41074:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:12.0:1773851894.601991:0:41074:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000004:00000040:12.0:1773851894.601992:0:41074:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524023296 avail=351521284096 avail_mb=1373130016 hwm_mb=3131103 files=372113755 ffree=343285179 state=0: rc = 0
00000004:00000020:12.0:1773851894.601996:0:41074:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524023296 free, 351521284096 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113755 files, 343285179 free files
00000004:00000001:12.0:1773851894.601999:0:41074:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.602000:0:41074:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:12.0:1773851894.602011:0:41074:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000449d3970 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_02:lustre5-MDT0001-mdtlov_UUID:41074:1859433051939392:54@kfi7:13:default-yuba2-0
00000100:00000001:12.0:1773851894.602014:0:41074:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.602015:0:41074:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:12.0:1773851894.602016:0:41074:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000449d3970 x1859433051939392/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:12.0:1773851894.602021:0:41074:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:12.0:1773851894.602022:0:41074:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:12.0:1773851894.602023:0:41074:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d347d281.
02000000:00000001:12.0:1773851894.602024:0:41074:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:12.0:1773851894.602025:0:41074:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:12.0:1773851894.602026:0:41074:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000020:00000001:12.0:1773851894.602027:0:41074:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:12.0:1773851894.602028:0:41074:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d0c54e26.
02000000:00000001:12.0:1773851894.602029:0:41074:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:12.0:1773851894.602030:0:41074:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:12.0:1773851894.602031:0:41074:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000449d3970.
00000100:00000001:12.0:1773851894.602032:0:41074:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:12.0:1773851894.602033:0:41074:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.602034:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.602035:0:41074:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:12.0:1773851894.602036:0:41074:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.602037:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851894.602038:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851894.644198:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851894.644199:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851894.644200:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851894.644201:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851894.644203:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11987@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.644204:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11987@kfi7 : PUT - for me
00000400:00000200:13.0:1773851894.644205:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11987@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.644206:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d42f1e64 nid 11987@kfi7 refs 1
00000400:00000200:13.0:1773851894.644207:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11987@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.644208:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d42f1e64 nid 11987@kfi7 refs 2
00000400:00000200:13.0:1773851894.644209:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d42f1e64 nid 11987@kfi7 refs 3
00000400:00000200:13.0:1773851894.644209:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11987@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.644211:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11987@kfi7 of length 224 into portal 12 MB=0x699e0ffb0f140
00000400:00000200:13.0:1773851894.644212:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11987@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 52552
00000800:00000200:13.0:1773851894.644214:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851894.644215:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.644216:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11987@kfi7: PUT: OK
00000100:00000001:13.0:1773851894.644217:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851894.644217:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851894.644218:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000695f9f4a.
00000100:00000040:13.0:1773851894.644219:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000695f9f4a x1858041501774144 msgsize 224
00000100:00100000:13.0:1773851894.644220:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-11987@kfi7 (source: 12345-11987@kfi7)
00000100:00000001:13.0:1773851894.644221:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851894.644222:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d42f1e64 nid 11987@kfi7 refs 2
00000800:00000200:13.0:1773851894.644223:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851894.644224:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851894.644225:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851894.644225:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851894.644226:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.644226:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.644227:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041501774144
00000020:00000001:12.0:1773851894.644228:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851894.644228:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b66
00000020:00000001:12.0:1773851894.644229:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.644234:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000041859e3b refcount=6
00000020:00000001:12.0:1773851894.644235:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743684096 : -107128965867520 : ffff9e91180b5800)
00000020:00000001:12.0:1773851894.644236:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743684096 : -107128965867520 : ffff9e91180b5800)
00000100:00000001:12.0:1773851894.644238:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.644238:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851894.644239:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000557b870b.
00000020:00000010:12.0:1773851894.644240:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.644241:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065d9b02b.
00000100:00000001:12.0:1773851894.644242:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851894.644242:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851894.644243:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.644244:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851894.644245:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851894.644245:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.644246:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.644247:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.644248:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.644248:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851894.644248:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851894.644249:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11987@kfi7, seq: 2289921
00000100:00000001:15.0:1773851894.644250:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.644250:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.644250:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000041859e3b : new rpc_count 1
00000100:00000001:12.0:1773851894.644250:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637024468626432 : -107049240925184 : ffff9ea3a8056c00)
00000100:00000040:12.0:1773851894.644252:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000695f9f4a x1858041501774144/t0(0) o400->bcb5c122-bd90-4236-9f17-bcca37b374f9@11987@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1237-0'
00000100:00000001:12.0:1773851894.644254:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.644255:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851894.644256:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000695f9f4a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bcb5c122-bd90-4236-9f17-bcca37b374f9+6:39570:x1858041501774144:12345-11987@kfi7:400:default-tuolumne1237-0
00000100:00000200:12.0:1773851894.644257:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041501774144
00000020:00000001:12.0:1773851894.644258:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851894.644259:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851894.644259:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.644260:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851894.644260:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851894.644261:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851894.644262:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041501774144, found 0 last_xid 1858041501774143
00000020:00000001:12.0:1773851894.644263:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851894.644265:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851894.644265:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851894.644266:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.644266:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851894.644267:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851894.644268:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851894.644270:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000451bda9c.
02000000:00000001:12.0:1773851894.644270:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.644271:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.644272:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851894.644272:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698032, transno 0, xid 1858041501774144
00010000:00000001:12.0:1773851894.644273:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851894.644274:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000695f9f4a x1858041501774144/t0(0) o400->bcb5c122-bd90-4236-9f17-bcca37b374f9@11987@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1237-0'
00010000:00000001:12.0:1773851894.644276:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851894.644277:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851894.644278:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851894.644279:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851894.644280:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000076defca refcount 3 to 11987@kfi7
00000100:00000001:12.0:1773851894.644281:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642468896 : -107157067082720 : ffff9e8a8d14d420)
02000000:00000001:12.0:1773851894.644281:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851894.644282:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.644283:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851894.644283:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11987@kfi7
00000400:00000010:12.0:1773851894.644284:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e652fce.
00000100:00000200:12.0:1773851894.644285:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041501774144, offset 224
00000400:00000200:12.0:1773851894.644286:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11987@kfi7
00000400:00000200:12.0:1773851894.644287:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11987@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.644288:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d42f1e64 nid 11987@kfi7 refs 1
00000400:00000200:12.0:1773851894.644289:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d42f1e64 nid 11987@kfi7 refs 2
00000400:00000200:12.0:1773851894.644290:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d42f1e64 nid 11987@kfi7 refs 3
00000400:00000200:12.0:1773851894.644291:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11987@kfi7 local destination
00000400:00000200:12.0:1773851894.644292:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770125:8770125:1024:4294967295] 11987@kfi7 LPNI seq info [628645:628645:16:4294967295]
00000400:00000200:12.0:1773851894.644293:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d42f1e64 nid 11987@kfi7 refs 2
00000400:00000200:12.0:1773851894.644295:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11987@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.644298:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11987@kfi7(11987@kfi7:11987@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851894.644300:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d42f1e64 nid 11987@kfi7 refs 3
00000800:00000200:12.0:1773851894.644303:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851894.644304:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851894.644308:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851894.644312:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x65b Using peer 11987@kfi7(0x65b)
00000800:00000200:12.0:1773851894.644317:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0x65b: rc=0
00000800:00000200:12.0:1773851894.644319:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x65b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851894.644323:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.644325:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000076defca refcount 2 to 11987@kfi7
00010000:00000001:12.0:1773851894.644326:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851894.644329:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.644330:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851894.644332:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000695f9f4a x1858041501774144/t0(0) o400->bcb5c122-bd90-4236-9f17-bcca37b374f9@11987@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1237-0'
00000100:00100000:12.0:1773851894.644338:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000695f9f4a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bcb5c122-bd90-4236-9f17-bcca37b374f9+6:39570:x1858041501774144:12345-11987@kfi7:400:default-tuolumne1237-0 Request processed in 82us (118us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851894.644342:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11987@kfi7, seq: 2289921
00000100:00000040:12.0:1773851894.644343:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000041859e3b : new rpc_count 0
00000100:00000001:12.0:1773851894.644345:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851894.644346:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851894.644347:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.644348:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065d9b02b.
00000020:00000010:12.0:1773851894.644350:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000557b870b.
00000020:00000040:12.0:1773851894.644351:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000041859e3b : new refcount 5
00000100:00000001:12.0:1773851894.644352:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851894.644360:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x65b TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851894.644362:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851894.644363:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11987@kfi7: PUT: OK
00000400:00000200:14.0:1773851894.644363:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e652fce
00000400:00000010:14.0:1773851894.644364:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e652fce.
00000100:00000001:14.0:1773851894.644364:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851894.644365:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851894.644366:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d42f1e64 nid 11987@kfi7 refs 2
00000800:00000200:14.0:1773851894.644367:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 11987@kfi7(00000000f5882c12):0x0 lsk 1628 rsk 50 tsk 0 trmk 0 tmk 0 trr 3 tta 0x65b Transaction freed
00000400:00000200:29.0:1773851894.665733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851894.665734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851894.735673:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851894.735674:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851894.735674:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851894.735675:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851894.735676:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851894.735677:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851894.735677:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19266@kfi7(0000000084bf79a0):0x9d0 version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851894.735679:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 Using peer 19266@kfi7(0x1000000000009d0)
00000800:00000200:22.0:1773851894.735681:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851894.735681:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19266@kfi7 to cpt 5
00000800:00000200:21.0:1773851894.735683:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0x1000000000009d0: rc=0
00000400:00000200:22.0:1773851894.735684:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19266@kfi7 to cpt 5
00000800:00000200:21.0:1773851894.735685:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851894.735686:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19266@kfi7 : PUT - for me
00000400:00000200:22.0:1773851894.735688:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19266@kfi7 to cpt 5
00000400:00000200:22.0:1773851894.735689:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000901de7ce nid 19266@kfi7 refs 1
00000400:00000200:22.0:1773851894.735691:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19266@kfi7 to cpt 5
00000400:00000200:22.0:1773851894.735692:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000901de7ce nid 19266@kfi7 refs 2
00000400:00000200:22.0:1773851894.735693:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000901de7ce nid 19266@kfi7 refs 3
00000400:00000200:22.0:1773851894.735695:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19266@kfi7 to cpt 5
00000400:00000200:22.0:1773851894.735696:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19266@kfi7 of length 224 into portal 12 MB=0x69b4bcb070f00
00000800:00000200:21.0:1773851894.735697:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851894.735698:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19266@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 62256
00000800:00000200:21.0:1773851894.735700:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 Transaction freed
00000800:00000200:22.0:1773851894.735701:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851894.735704:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851894.735705:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19266@kfi7: PUT: OK
00000100:00000001:22.0:1773851894.735707:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851894.735707:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851894.735709:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b9facafd.
00000100:00000040:22.0:1773851894.735710:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000b9facafd x1859599691353856 msgsize 224
00000100:00100000:22.0:1773851894.735712:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-19266@kfi7 (source: 12345-19266@kfi7)
00000100:00000001:22.0:1773851894.735714:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851894.735716:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000901de7ce nid 19266@kfi7 refs 2
00000100:00000001:20.0:1773851894.735716:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851894.735717:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851894.735718:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851894.735718:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851894.735719:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851894.735720:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851894.735721:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599691353856
00000020:00000001:20.0:1773851894.735722:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851894.735723:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2437c130
00000020:00000001:20.0:1773851894.735724:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851894.735735:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076dd26ab refcount=5
00000020:00000001:20.0:1773851894.735736:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637138918221824 : -106934791329792 : ffff9ebe4dbfa800)
00000020:00000001:20.0:1773851894.735737:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637138918221824 : -106934791329792 : ffff9ebe4dbfa800)
00000100:00000001:20.0:1773851894.735738:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851894.735739:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851894.735740:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851894.735742:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851894.735743:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851894.735744:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851894.735745:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851894.735746:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.735747:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851894.735748:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851894.735748:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.735750:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.735753:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851894.735754:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851894.735754:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851894.735755:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851894.735755:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19266@kfi7, seq: 1998068
00000100:00000001:23.0:1773851894.735757:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851894.735757:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000076dd26ab : new rpc_count 1
00000100:00000001:23.0:1773851894.735758:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.735758:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382171648 : -106946327379968 : ffff9ebb9e258000)
00000100:00000040:20.0:1773851894.735760:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b9facafd x1859599691353856/t0(0) o400->2ca123aa-0663-4acf-bc8c-7e5e8dd72e17@19266@kfi7:534/0 lens 224/0 e 0 to 0 dl 1773852649 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1704-0'
00000100:00000001:20.0:1773851894.735764:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851894.735765:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851894.735766:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b9facafd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:2ca123aa-0663-4acf-bc8c-7e5e8dd72e17+5:39714:x1859599691353856:12345-19266@kfi7:400:default-tuolumne1704-0
00000100:00000200:20.0:1773851894.735769:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599691353856
00000020:00000001:20.0:1773851894.735770:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851894.735771:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851894.735772:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.735773:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851894.735773:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851894.735775:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851894.735776:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599691353856, found 0 last_xid 1859599691353855
00000020:00000001:20.0:1773851894.735777:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851894.735778:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851894.735779:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851894.735780:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.735781:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851894.735782:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851894.735783:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851894.735784:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e8738f91.
02000000:00000001:20.0:1773851894.735785:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.735786:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.735787:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851894.735788:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689515, transno 0, xid 1859599691353856
00010000:00000001:20.0:1773851894.735789:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851894.735790:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b9facafd x1859599691353856/t0(0) o400->2ca123aa-0663-4acf-bc8c-7e5e8dd72e17@19266@kfi7:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1704-0'
00010000:00000001:20.0:1773851894.735800:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851894.735801:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851894.735802:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=127 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851894.735804:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851894.735805:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000babe954f refcount 3 to 19266@kfi7
00000100:00000001:20.0:1773851894.735806:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926956272640 : -107146753278976 : ffff9e8cf3d4fc00)
02000000:00000001:20.0:1773851894.735808:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851894.735809:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.735810:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851894.735811:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19266@kfi7
00000400:00000010:20.0:1773851894.735812:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f21c7ec.
00000100:00000200:20.0:1773851894.735814:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599691353856, offset 224
00000400:00000200:20.0:1773851894.735816:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19266@kfi7
00000400:00000200:20.0:1773851894.735817:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19266@kfi7 to cpt 5
00000400:00000200:20.0:1773851894.735819:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000901de7ce nid 19266@kfi7 refs 1
00000400:00000200:20.0:1773851894.735820:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000901de7ce nid 19266@kfi7 refs 2
00000400:00000200:20.0:1773851894.735822:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000901de7ce nid 19266@kfi7 refs 3
00000400:00000200:20.0:1773851894.735824:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19266@kfi7 local destination
00000400:00000200:20.0:1773851894.735826:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770126:8770126:1024:4294967295] 19266@kfi7 LPNI seq info [18715021:18715021:16:4294967295]
00000400:00000200:20.0:1773851894.735829:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000901de7ce nid 19266@kfi7 refs 2
00000400:00000200:20.0:1773851894.735830:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19266@kfi7 to cpt 5
00000400:00000200:20.0:1773851894.735834:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19266@kfi7(19266@kfi7:19266@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851894.735836:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000901de7ce nid 19266@kfi7 refs 3
00000800:00000200:20.0:1773851894.735838:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851894.735840:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851894.735844:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851894.735847:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 Using peer 19266@kfi7(0x1000000000009d0)
00000800:00000200:20.0:1773851894.735855:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x1000000000009d0: rc=0
00000800:00000200:20.0:1773851894.735857:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851894.735861:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851894.735862:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000babe954f refcount 2 to 19266@kfi7
00010000:00000001:20.0:1773851894.735864:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851894.735865:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.735866:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851894.735867:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b9facafd x1859599691353856/t0(0) o400->2ca123aa-0663-4acf-bc8c-7e5e8dd72e17@19266@kfi7:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1704-0'
00000100:00100000:20.0:1773851894.735873:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b9facafd pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:2ca123aa-0663-4acf-bc8c-7e5e8dd72e17+5:39714:x1859599691353856:12345-19266@kfi7:400:default-tuolumne1704-0 Request processed in 107us (162us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851894.735877:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19266@kfi7, seq: 1998068
00000100:00000040:20.0:1773851894.735878:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000076dd26ab : new rpc_count 0
00000100:00000001:20.0:1773851894.735879:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851894.735880:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851894.735881:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851894.735882:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851894.735883:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851894.735884:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000076dd26ab : new refcount 4
00000100:00000001:20.0:1773851894.735885:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851894.735891:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851894.735893:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.735894:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19266@kfi7: PUT: OK
00000400:00000200:21.0:1773851894.735895:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f21c7ec
00000400:00000010:21.0:1773851894.735895:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f21c7ec.
00000100:00000001:21.0:1773851894.735896:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851894.735897:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851894.735898:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000901de7ce nid 19266@kfi7 refs 2
00000800:00000200:21.0:1773851894.735899:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 19266@kfi7(0000000084bf79a0):0x0 lsk 2513 rsk 40 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000009d0 Transaction freed
00000800:00000200:2.0:1773851894.738796:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.738796:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.738797:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.738797:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851894.738798:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.738799:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:2.0:1773851894.738801:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851894.738801:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8211@kfi7(00000000f617f3f0):0x880 version: 2; local version 2; negotiated version: 2
00000400:00000200:2.0:1773851894.738803:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000800:00000200:1.0:1773851894.738803:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Using peer 8211@kfi7(0x880)
00000400:00000200:2.0:1773851894.738804:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8211@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.738805:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.738806:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.738807:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000800:00000200:1.0:1773851894.738807:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 38 bytes to peer 0x880: rc=0
00000400:00000200:2.0:1773851894.738808:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.738809:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:1.0:1773851894.738809:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851894.738810:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:2.0:1773851894.738811:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.738812:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 576 into portal 12 MB=0x69b175f72e040
00000400:00000200:2.0:1773851894.738814:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8211@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 47232
00000800:00000200:2.0:1773851894.738815:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851894.738819:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851894.738820:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000800:00000200:1.0:1773851894.738820:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851894.738821:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851894.738822:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851894.738823:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c33a0bf.
00000100:00000040:2.0:1773851894.738823:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000001c33a0bf x1859374548181056 msgsize 576
00000800:00000200:1.0:1773851894.738823:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Transaction freed
00000100:00100000:2.0:1773851894.738825:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8211@kfi7)
00000100:00000001:2.0:1773851894.738826:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851894.738827:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000100:00000001:0.0:1773851894.738828:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.738828:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:2.0:1773851894.738829:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851894.738829:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.738829:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.738831:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.738831:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548181056
00000020:00000001:0.0:1773851894.738832:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.738833:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:0.0:1773851894.738833:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.738834:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=9
00000020:00000001:0.0:1773851894.738835:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:0.0:1773851894.738836:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:0.0:1773851894.738837:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.738838:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.738838:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008a3a78d9.
00000020:00000010:0.0:1773851894.738840:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.738841:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851894.738841:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.738842:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:0.0:1773851894.738843:0:42868:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:0.0:1773851894.738843:0:42868:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.738844:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.738845:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.738846:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851894.738847:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.738847:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:1.0:1773851894.738848:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.738848:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.738849:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 408701482
00000100:00000001:1.0:1773851894.738850:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.738850:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:1.0:1773851894.738851:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.738851:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637031984536320 : -107041725015296 : ffff9ea568011b00)
00000100:00000040:0.0:1773851894.738852:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c33a0bf x1859374548181056/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 576/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1013-0'
00000100:00000001:0.0:1773851894.738855:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.738855:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.738856:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c33a0bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3f7a09dd-93e3-48df-8594-85e44391fba9+9:2511627:x1859374548181056:12345-8211@kfi7:101:default-tuolumne1013-0
00000100:00000200:0.0:1773851894.738858:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548181056
00000020:00000001:0.0:1773851894.738859:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.738860:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.738860:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.738861:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.738862:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:0.0:1773851894.738862:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.738863:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374548181056, found 0 last_xid 1859374548181055
00000020:00000001:0.0:1773851894.738864:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.738865:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.738865:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.738866:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.738866:0:42868:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:0.0:1773851894.738867:0:42868:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:0.0:1773851894.738867:0:42868:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:0.0:1773851894.738868:0:42868:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:0.0:1773851894.738869:0:42868:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.738871:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.738872:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.738873:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.738874:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.738875:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000d243d8b7.
00000020:00000001:0.0:1773851894.738875:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.738876:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000d243d8b7 with handle 0x21b6f08f07a6adc4 to hash
00000020:00000001:0.0:1773851894.738877:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.738877:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000010:0.0:1773851894.738878:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a43c5c3d.
00010000:00000001:0.0:1773851894.738879:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00010000:0.0:1773851894.738880:0:42868:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000d243d8b7/0x21b6f08f07a6adc4 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70aa1f42a86477c1 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738883:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:0.0:1773851894.738884:0:42868:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000003ec9ddea : new locks_count 4
00000020:00000040:0.0:1773851894.738885:0:42868:0:(genops.c:871:class_export_get()) GET export 000000003ec9ddea refcount=10
00010000:00000001:0.0:1773851894.738887:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:0.0:1773851894.738888:0:42868:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:0.0:1773851894.738889:0:42868:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:0.0:1773851894.738890:0:42868:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:0.0:1773851894.738890:0:42868:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:0.0:1773851894.738891:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851894.738891:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:0.0:1773851894.738893:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851894.738893:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:0.0:1773851894.738894:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:0.0:1773851894.738895:0:42868:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.738896:0:42868:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:0.0:1773851894.738897:0:42868:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:0.0:1773851894.738897:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.738898:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.738899:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000f7f23880.
02000000:00000001:0.0:1773851894.738900:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.738901:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.738901:0:42868:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.738902:0:42868:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:0.0:1773851894.738903:0:42868:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:0.0:1773851894.738903:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.738904:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.738905:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.738905:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.738906:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.738906:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.738907:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.738908:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.738908:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.738908:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.738909:0:42868:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:0.0:1773851894.738910:0:42868:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:0.0:1773851894.738911:0:42868:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:0.0:1773851894.738911:0:42868:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.738912:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.738912:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.738913:0:42868:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:0.0:1773851894.738914:0:42868:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.738915:0:42868:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:0.0:1773851894.738915:0:42868:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 000000009dcfa312
00000004:00000001:0.0:1773851894.738916:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:0.0:1773851894.738917:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:0.0:1773851894.738918:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.738918:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.738919:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.738920:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.738920:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.738921:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000fb94df81.
00000020:00000001:0.0:1773851894.738922:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.738922:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000fb94df81 with handle 0x21b6f08f07a6adcb to hash
00000020:00000001:0.0:1773851894.738923:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.738923:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000010:0.0:1773851894.738924:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000084fdee8.
00010000:00000001:0.0:1773851894.738925:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000001:0.0:1773851894.738925:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.738926:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.738927:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb94df81/0x21b6f08f07a6adcb lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738929:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.738930:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.738931:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.738931:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.738932:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.738933:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.738933:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.738934:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.738935:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.738935:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.738936:0:42868:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.738936:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.738937:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 195
00010000:00000040:0.0:1773851894.738938:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:0.0:1773851894.738939:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738942:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738943:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738945:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738947:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738949:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738950:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738953:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738954:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738956:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738957:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738959:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738960:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738962:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738963:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738968:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738969:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738972:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738973:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738975:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738976:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738979:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738979:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738982:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738983:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738985:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738986:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738988:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738990:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738992:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738993:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738996:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.738998:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.738999:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739001:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739003:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739004:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739007:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739008:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739010:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739012:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739014:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739015:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739017:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739018:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739020:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739021:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739024:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739025:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739027:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739028:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739031:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739032:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 10 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739034:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739035:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739037:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739038:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739040:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739041:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739043:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739044:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739046:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739047:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739050:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739051:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739053:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739055:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739057:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739058:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739060:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739061:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739063:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739064:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739066:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739067:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739069:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739070:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739072:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739073:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739086:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739087:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739089:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739090:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739092:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739093:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739095:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739096:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739099:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739100:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739102:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739103:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739105:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739106:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739108:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739109:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739114:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739116:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739117:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739119:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739121:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739123:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739125:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739126:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739128:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739129:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739131:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739132:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739135:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739136:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739138:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739139:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739141:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739142:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739144:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739145:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739147:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739148:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739150:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739151:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739153:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739154:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739156:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739157:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739159:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739160:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739162:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739163:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739166:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739167:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739169:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739170:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739172:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739173:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739175:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739176:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739178:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739179:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739181:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739182:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739184:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739185:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739187:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739188:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739191:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739192:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739194:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739195:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739197:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739198:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739200:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739201:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739203:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739205:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739207:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739207:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739210:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739210:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739213:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739213:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739216:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739217:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739219:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739221:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739223:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739224:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739226:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739227:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739230:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739230:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739232:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739233:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739236:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739237:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739239:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739240:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739243:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739244:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739246:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739247:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739249:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739250:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739252:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739253:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739255:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739256:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739258:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739259:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739261:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739262:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739264:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739265:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739268:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739269:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739271:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739272:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739274:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739275:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739277:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739278:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739280:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739281:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739283:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739284:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739286:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739287:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739289:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739290:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739293:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739294:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739296:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739297:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739299:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739301:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739303:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739304:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739306:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739307:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739309:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739310:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739312:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739313:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739315:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739316:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739319:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739321:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739322:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739323:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739326:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739327:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739329:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739329:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739331:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739333:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739335:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739336:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739338:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739339:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739341:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739342:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739344:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739345:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739347:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739349:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739351:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739352:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739354:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739355:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739358:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739359:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739361:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739362:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739364:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739365:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739367:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739368:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739372:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739373:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739375:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739376:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739378:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739379:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739381:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739382:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739384:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739385:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739387:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739389:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739391:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739392:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739394:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739395:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739398:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739399:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739401:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739402:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739405:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739406:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739408:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739409:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739411:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739412:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739414:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739415:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739418:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739418:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739421:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739422:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739424:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739425:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739427:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739428:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739430:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739431:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739433:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739434:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739436:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739437:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739439:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739440:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739443:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739444:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739446:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739447:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739450:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739451:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739453:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739454:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739457:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739458:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739460:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739461:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739463:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739464:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739466:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739467:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739469:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739470:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739472:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739473:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739477:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739478:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739480:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739480:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739483:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739484:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739486:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739487:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739489:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739490:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739492:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739493:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739495:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739496:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739498:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739499:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739502:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739503:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739505:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739506:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739508:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739509:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739512:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739512:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739515:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739515:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739517:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739518:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739521:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739522:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739524:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739525:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739531:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739532:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739534:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739535:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739537:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739538:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739540:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739541:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739543:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739544:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739546:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739547:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739550:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739551:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739553:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739554:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739557:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739558:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739560:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739561:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739563:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739564:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739566:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739567:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739569:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739570:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739572:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739573:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739575:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739577:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739579:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739580:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739582:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739583:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739585:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:0.0:1773851894.739586:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb94df81/0x21b6f08f07a6adcb lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739588:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.739589:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.739590:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.739590:0:42868:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739591:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.739591:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.739592:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739593:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.739594:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.739594:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.739595:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb94df81/0x21b6f08f07a6adcb lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739598:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.739598:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.739598:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739599:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.739599:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.739600:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.739600:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fb94df81 refcount=3
00000020:00000001:0.0:1773851894.739601:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000001:0.0:1773851894.739602:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000001:0.0:1773851894.739602:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739603:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.739604:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.739604:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.739605:0:42868:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:0.0:1773851894.739606:0:42868:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:0.0:1773851894.739607:0:42868:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:0.0:1773851894.739614:0:42868:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.739615:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851894.739616:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.739616:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.739617:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739618:0:42868:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739619:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739620:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851894.739620:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.739620:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.739621:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739622:0:42868:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739622:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:0.0:1773851894.739623:0:42868:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:0.0:1773851894.739624:0:42868:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.739625:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.739625:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.739626:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.739626:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.739626:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.739627:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:0.0:1773851894.739627:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.739628:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:0.0:1773851894.739628:0:42868:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:0.0:1773851894.739630:0:42868:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:0.0:1773851894.739630:0:42868:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:0.0:1773851894.739631:0:42868:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:0.0:1773851894.739632:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.739632:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.739633:0:42868:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:0.0:1773851894.739634:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851894.739634:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.739635:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.739635:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739636:0:42868:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739636:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.739637:0:42868:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.739638:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:0.0:1773851894.739641:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.739642:0:42868:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.739644:0:42868:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739644:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.739645:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.739645:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fb94df81 refcount=3
00000020:00000001:0.0:1773851894.739646:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000001:0.0:1773851894.739647:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00000004:00000040:0.0:1773851894.739647:0:42868:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000003ec9ddea : new locks_count 5
00000020:00000040:0.0:1773851894.739648:0:42868:0:(genops.c:871:class_export_get()) GET export 000000003ec9ddea refcount=11
00010000:00000001:0.0:1773851894.739649:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739649:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.739649:0:42868:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.739650:0:42868:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:0.0:1773851894.739651:0:42868:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:0.0:1773851894.739651:0:42868:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:0.0:1773851894.739652:0:42868:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:0.0:1773851894.739652:0:42868:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:0.0:1773851894.739653:0:42868:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:0.0:1773851894.739653:0:42868:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:0.0:1773851894.739654:0:42868:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.739655:0:42868:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.739656:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:0.0:1773851894.739657:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:0.0:1773851894.739658:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851894.739658:0:42868:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:0.0:1773851894.739659:0:42868:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:0.0:1773851894.739660:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.739660:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739661:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.739661:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.739661:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.739662:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d243d8b7 with handle 0x21b6f08f07a6adc4 from hash
00010000:00000001:0.0:1773851894.739663:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.739663:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739664:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.739664:0:42868:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:0.0:1773851894.739665:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.739665:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d243d8b7/0x21b6f08f07a6adc4 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477c1 expref: 11 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739667:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739668:0:42868:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003ec9ddea : new locks_count 4
00000020:00000040:0.0:1773851894.739669:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 10
00010000:00000010:0.0:1773851894.739669:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a43c5c3d.
00010000:00000040:0.0:1773851894.739670:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.739671:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.739671:0:42868:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739672:0:42868:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:0.0:1773851894.739673:0:42868:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb94df81/0x21b6f08f07a6adcb lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477c1 expref: 10 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.739675:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.739676:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.739677:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.739677:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:0.0:1773851894.739678:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:0.0:1773851894.739679:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.739680:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739681:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.739681:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739682:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.739682:0:42868:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000fb94df81, rc 0)
00000020:00000001:0.0:1773851894.739683:0:42868:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.739684:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183038203122, transno 0, xid 1859374548181056
00010000:00000001:0.0:1773851894.739685:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851894.739685:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c33a0bf x1859374548181056/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00010000:00000001:0.0:1773851894.739688:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.739689:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.739689:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851894.739690:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.739691:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:0.0:1773851894.739692:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:0.0:1773851894.739693:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.739693:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.739694:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.739695:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8211@kfi7
00000400:00000010:0.0:1773851894.739695:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c2d69e3.
00000100:00000200:0.0:1773851894.739696:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859374548181056, offset 224
00000400:00000200:0.0:1773851894.739698:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8211@kfi7
00000400:00000200:0.0:1773851894.739699:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.739699:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:0.0:1773851894.739701:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:0.0:1773851894.739702:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:0.0:1773851894.739703:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8211@kfi7 local destination
00000400:00000200:0.0:1773851894.739704:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770127:8770127:1024:4294967295] 8211@kfi7 LPNI seq info [7629404:7629404:16:4294967295]
00000400:00000200:0.0:1773851894.739706:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:0.0:1773851894.739706:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.739708:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8211@kfi7(8211@kfi7:8211@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.739709:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000800:00000200:0.0:1773851894.739711:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.739712:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:0.0:1773851894.739715:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.739718:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Using peer 8211@kfi7(0x880)
00000800:00000200:0.0:1773851894.739720:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 740 bytes to peer 0x880: rc=0
00000800:00000200:0.0:1773851894.739722:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.739724:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.739732:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:0.0:1773851894.739733:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.739733:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.739734:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.739735:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c33a0bf x1859374548181056/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00000100:00100000:0.0:1773851894.739738:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c33a0bf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3f7a09dd-93e3-48df-8594-85e44391fba9+10:2511627:x1859374548181056:12345-8211@kfi7:101:default-tuolumne1013-0 Request processed in 882us (914us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.739740:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 408701482
00000100:00000040:0.0:1773851894.739741:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
00000100:00000001:0.0:1773851894.739742:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.739742:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.739743:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.739744:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851894.739745:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008a3a78d9.
00000020:00000040:0.0:1773851894.739745:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 9
00000100:00000001:0.0:1773851894.739746:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851894.739752:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.739754:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.739755:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.739756:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c2d69e3
00000400:00000010:1.0:1773851894.739756:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c2d69e3.
00000100:00000001:1.0:1773851894.739758:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.739758:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.739759:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:1.0:1773851894.739761:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Transaction freed
00000800:00000200:1.0:1773851894.739864:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.739865:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.739866:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.739868:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.739869:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.739871:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8402@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.739872:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.739872:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 1
00000400:00000200:1.0:1773851894.739873:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.739874:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000400:00000200:1.0:1773851894.739875:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000400:00000200:1.0:1773851894.739875:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.739876:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 328 into portal 17 MB=0x69b175f72e0c0
00000400:00000200:1.0:1773851894.739878:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8211@kfi7 of length 328/328 into md 0x7fb60e481 [2] + 328
00000800:00000200:1.0:1773851894.739880:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.739881:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.739882:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8402@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.739883:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.739884:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:1.0:1773851894.739885:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8111a0e.
00000100:00000040:1.0:1773851894.739885:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000e8111a0e x1859374548181184 msgsize 328
00000100:00100000:1.0:1773851894.739887:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8402@kfi7)
00000100:00000001:1.0:1773851894.739888:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.739889:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000100:00000001:0.0:1773851894.739890:0:61144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.739890:0:61144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851894.739891:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851894.739891:0:61144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.739891:0:61144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.739892:0:61144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.739893:0:61144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548181184
00000020:00000001:0.0:1773851894.739894:0:61144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.739894:0:61144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:0.0:1773851894.739895:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.739896:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=10
00000020:00000001:0.0:1773851894.739896:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:0.0:1773851894.739897:0:61144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:0.0:1773851894.739898:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.739898:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.739898:0:61144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008a3a78d9.
00000020:00000010:0.0:1773851894.739899:0:61144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.739900:0:61144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000040:0.0:1773851894.739901:0:61144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:0.0:1773851894.739901:0:61144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.739902:0:61144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:0.0:1773851894.739902:0:61144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:0.0:1773851894.739903:0:61144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739904:0:61144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:0.0:1773851894.739904:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.739905:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.739905:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fb94df81 refcount=3
00000800:00000200:29.0:1773851894.739906:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000020:00000001:0.0:1773851894.739906:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000001:0.0:1773851894.739906:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00000800:00000200:29.0:1773851894.739907:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00010000:00000001:0.0:1773851894.739907:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739907:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.739908:0:61144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.739908:0:61144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851894.739909:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:0.0:1773851894.739909:0:61144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.739910:0:61144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851894.739911:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:0.0:1773851894.739911:0:61144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.739912:0:61144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000400:00000200:29.0:1773851894.739913:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:3.0:1773851894.739913:0:82951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851894.739913:0:82951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.739913:0:61144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 45419464
00000100:00000001:3.0:1773851894.739914:0:82951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851894.739914:0:82951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.739914:0:61144:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:0.0:1773851894.739914:0:61144:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112256384 : -106950597295232 : ffff9eba9fa3c380)
00000400:00000200:29.0:1773851894.739915:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2074@kfi7 : PUT - for me
00000100:00000040:0.0:1773851894.739915:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e8111a0e x1859374548181184/t0(0) o103->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000400:00000200:29.0:1773851894.739916:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851894.739917:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851894.739917:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851894.739918:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851894.739919:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000100:00000001:0.0:1773851894.739919:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.739919:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:29.0:1773851894.739920:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00100000:0.0:1773851894.739920:0:61144:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8111a0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3f7a09dd-93e3-48df-8594-85e44391fba9+10:39750:x1859374548181184:12345-8211@kfi7:103:
00000400:00000200:29.0:1773851894.739921:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 328 into portal 24 MB=0x699e51ee27b80
00000400:00000200:29.0:1773851894.739922:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 328/328 into md 0x77ec58b3d [256] + 21672
00000100:00000200:0.0:1773851894.739922:0:61144:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548181184
00010000:00000001:0.0:1773851894.739922:0:61144:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:0.0:1773851894.739923:0:61144:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:0.0:1773851894.739923:0:61144:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000800:00000200:29.0:1773851894.739924:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:0.0:1773851894.739924:0:61144:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.739924:0:61144:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:29.0:1773851894.739925:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000010:0.0:1773851894.739925:0:61144:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f0d46a9b.
00000400:00000200:29.0:1773851894.739926:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2074@kfi7: PUT: OK
02000000:00000001:0.0:1773851894.739926:0:61144:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.739926:0:61144:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851894.739927:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851894.739927:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00010000:00000001:0.0:1773851894.739927:0:61144:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00000100:00000010:29.0:1773851894.739928:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009a83a4ee.
00010000:00010000:0.0:1773851894.739928:0:61144:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:0.0:1773851894.739928:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000100:00000040:29.0:1773851894.739929:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000009a83a4ee x1858059204983680 msgsize 328
00000020:00000001:0.0:1773851894.739929:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.739929:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000fb94df81 refcount=3
00000020:00000001:0.0:1773851894.739930:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00000100:00100000:29.0:1773851894.739931:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2074@kfi7)
00000100:00000001:29.0:1773851894.739931:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000001:0.0:1773851894.739931:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000040:0.0:1773851894.739931:0:61144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00000400:00000200:29.0:1773851894.739932:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000004:00000001:0.0:1773851894.739932:0:61144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000100:00000001:28.0:1773851894.739933:0:41218:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00010000:00000001:0.0:1773851894.739933:0:61144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000800:00000200:29.0:1773851894.739934:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851894.739934:0:41218:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000020:00000001:0.0:1773851894.739934:0:61144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.739934:0:61144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00000100:00000001:28.0:1773851894.739935:0:41218:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851894.739935:0:41218:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739935:0:61144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.739935:0:61144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851894.739936:0:41218:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739936:0:61144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00000100:00100000:28.0:1773851894.739937:0:41218:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204983680
00010000:00000001:0.0:1773851894.739937:0:61144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.739937:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739937:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:28.0:1773851894.739938:0:41218:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851894.739938:0:41218:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00010000:00000001:0.0:1773851894.739938:0:61144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.739938:0:61144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.739939:0:61144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000fb94df81 with handle 0x21b6f08f07a6adcb from hash
00000020:00000001:28.0:1773851894.739940:0:41218:0:(lustre_handles.c:133:class_handle2object()) Process entered
00010000:00000001:0.0:1773851894.739940:0:61144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00000020:00000040:28.0:1773851894.739941:0:41218:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00010000:00000001:0.0:1773851894.739941:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.739941:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000020:00000001:28.0:1773851894.739942:0:41218:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00010000:00000001:0.0:1773851894.739942:0:61144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.739942:0:61144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00000020:00000001:28.0:1773851894.739943:0:41218:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00010000:00000001:0.0:1773851894.739943:0:61144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739943:0:61144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00000100:00000001:28.0:1773851894.739944:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00010000:00000001:0.0:1773851894.739944:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:28.0:1773851894.739945:0:41218:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851894.739945:0:41218:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00010000:00010000:0.0:1773851894.739945:0:61144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb94df81/0x21b6f08f07a6adcb lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477c1 expref: 10 pid: 42868 timeout: 0 lvb_type: 0
00000020:00000010:28.0:1773851894.739947:0:41218:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851894.739947:0:41218:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00010000:00000040:0.0:1773851894.739947:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.739948:0:61144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003ec9ddea : new locks_count 3
00000020:00000040:0.0:1773851894.739948:0:61144:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 9
00000100:00000040:28.0:1773851894.739949:0:41218:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:28.0:1773851894.739949:0:41218:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00010000:00000010:0.0:1773851894.739949:0:61144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000084fdee8.
00000100:00000001:28.0:1773851894.739950:0:41218:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851894.739950:0:41218:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.739950:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.739950:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:28.0:1773851894.739951:0:41218:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739951:0:61144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.739951:0:61144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.739952:0:61144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00000100:00000001:28.0:1773851894.739953:0:41218:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.739953:0:61144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.739953:0:61144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851894.739954:0:157090:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851894.739954:0:41218:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00010000:00000001:0.0:1773851894.739954:0:61144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:0.0:1773851894.739954:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00000100:00000001:28.0:1773851894.739955:0:41218:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00010000:00010000:0.0:1773851894.739955:0:61144:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:0.0:1773851894.739955:0:61144:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851894.739956:0:157090:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851894.739956:0:41218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 6571514
00010000:00000001:0.0:1773851894.739956:0:61144:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:30.0:1773851894.739957:0:157090:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851894.739957:0:41218:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00010000:00000001:0.0:1773851894.739957:0:61144:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.739957:0:61144:0:(import.c:1951:at_measured()) add 1 to 00000000fe6e7196 time=148 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851894.739958:0:157090:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851894.739958:0:41218:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262244352 : -106943447307264 : ffff9ebc49cfec00)
00000100:00000001:0.0:1773851894.739958:0:61144:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851894.739959:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009a83a4ee x1858059204983680/t0(0) o1000->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000040:0.0:1773851894.739959:0:61144:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:0.0:1773851894.739960:0:61144:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:0.0:1773851894.739960:0:61144:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.739961:0:61144:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.739961:0:61144:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851894.739962:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851894.739962:0:41218:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000040:0.0:1773851894.739962:0:61144:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8402@kfi7
00000100:00100000:28.0:1773851894.739963:0:41218:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a83a4ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:196734:x1858059204983680:12345-2074@kfi7:1000:default-yuba4-0
00000400:00000010:0.0:1773851894.739963:0:61144:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d94499d6.
00000100:00000200:0.0:1773851894.739964:0:61144:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859374548181184, offset 224
00000100:00000200:28.0:1773851894.739965:0:41218:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204983680
00000020:00000001:28.0:1773851894.739965:0:41218:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851894.739966:0:41218:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:0.0:1773851894.739966:0:61144:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8402@kfi7
00000020:00000001:28.0:1773851894.739967:0:41218:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851894.739967:0:41218:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:0.0:1773851894.739967:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.739967:0:61144:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 1
00000020:00000001:28.0:1773851894.739968:0:41218:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667521856 : -1042029760 : ffffffffc1e3e340)
00000400:00000200:0.0:1773851894.739968:0:61144:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000020:00000001:28.0:1773851894.739969:0:41218:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:28.0:1773851894.739970:0:41218:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:0.0:1773851894.739970:0:61144:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000020:00000001:28.0:1773851894.739971:0:41218:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000400:00000200:0.0:1773851894.739971:0:61144:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8402@kfi7 local destination
00000020:00000001:28.0:1773851894.739972:0:41218:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:0.0:1773851894.739972:0:61144:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770128:8770128:1024:4294967295] 8402@kfi7 LPNI seq info [7629405:7629405:16:4294967295]
00000020:00000001:28.0:1773851894.739973:0:41218:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:0.0:1773851894.739973:0:61144:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000020:00000001:28.0:1773851894.739974:0:41218:0:(out_handler.c:970:out_handle()) Process entered
00000400:00000200:0.0:1773851894.739974:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000020:00000010:28.0:1773851894.739975:0:41218:0:(out_handler.c:993:out_handle()) kmalloced '(update_bufs)': 8 at 00000000927ace4f.
00000100:00000001:28.0:1773851894.739976:0:41218:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:0.0:1773851894.739976:0:61144:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8402@kfi7(8402@kfi7:8402@kfi7) <?> : PUT try# 0
02000000:00000001:28.0:1773851894.739977:0:41218:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:0.0:1773851894.739977:0:61144:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000800:00000200:0.0:1773851894.739978:0:61144:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
02000000:00000010:28.0:1773851894.739979:0:41218:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 4576 at 000000007e03cf99.
00000800:00000200:0.0:1773851894.739979:0:61144:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
02000000:00000001:28.0:1773851894.739980:0:41218:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851894.739981:0:41218:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:0.0:1773851894.739981:0:61144:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000020:00000001:28.0:1773851894.739982:0:41218:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:28.0:1773851894.739983:0:41218:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000800:00000200:0.0:1773851894.739983:0:61144:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f Using peer 8402@kfi7(0x10000000000052f)
00000020:00000001:28.0:1773851894.739984:0:41218:0:(out_handler.c:356:out_index_lookup()) Process entered
00080000:00000001:28.0:1773851894.739986:0:41218:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00000800:00000200:0.0:1773851894.739986:0:61144:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x10000000000052f: rc=0
00000800:00000200:0.0:1773851894.739987:0:61144:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.739989:0:61144:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.739990:0:61144:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:0.0:1773851894.739991:0:61144:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.739991:0:61144:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.739992:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8111a0e x1859374548181184/t0(0) o103->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00080000:00000001:28.0:1773851894.739996:0:41218:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:28.0:1773851894.739997:0:41218:0:(osd_index.c:965:osd_remote_fid()) Process entered
00000100:00100000:0.0:1773851894.739997:0:61144:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8111a0e pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3f7a09dd-93e3-48df-8594-85e44391fba9+9:39750:x1859374548181184:12345-8211@kfi7:103: Request processed in 77us (110us total) trans 0 rc 0/0
00080000:00000001:28.0:1773851894.739998:0:41218:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:28.0:1773851894.739999:0:41218:0:(fld_handler.c:211:fld_local_lookup()) Process entered
00000100:00100000:0.0:1773851894.739999:0:61144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 45419464
80000000:00000001:28.0:1773851894.740000:0:41218:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
00000100:00000040:0.0:1773851894.740000:0:61144:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
80000000:00000001:28.0:1773851894.740001:0:41218:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.740001:0:61144:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.740001:0:61144:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
80000000:00000001:28.0:1773851894.740002:0:41218:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851894.740002:0:41218:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:0.0:1773851894.740002:0:61144:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00080000:00000001:28.0:1773851894.740003:0:41218:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:0.0:1773851894.740003:0:61144:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000040:28.0:1773851894.740004:0:41218:0:(out_handler.c:389:out_index_lookup()) lookup [0x24001b599:0x10e2:0x0] slingshotmon get [0x2800256ea:0x3d:0x0] rc 1
00000020:00000010:0.0:1773851894.740004:0:61144:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008a3a78d9.
00000020:00000040:0.0:1773851894.740004:0:61144:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 8
00000020:00000040:28.0:1773851894.740005:0:41218:0:(out_handler.c:393:out_index_lookup()) lustre5-MDT0001: insert lookup reply 00000000f9f00ac5 index 0: rc = 1
00000100:00000001:0.0:1773851894.740005:0:61144:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851894.740006:0:41218:0:(out_handler.c:398:out_index_lookup()) Process leaving (rc=1 : 1 : 1)
00000020:00000002:28.0:1773851894.740008:0:41218:0:(lu_object.c:224:lu_object_put()) Add 000000003fbfefe6/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000020:00000010:28.0:1773851894.740009:0:41218:0:(out_handler.c:1241:out_handle()) kfreed 'update_bufs': 8 at 00000000927ace4f.
00000020:00000001:28.0:1773851894.740010:0:41218:0:(out_handler.c:1247:out_handle()) Process leaving (rc=1 : 1 : 1)
00010000:00000040:28.0:1773851894.740010:0:41218:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204983680
00000800:00000200:1.0:1773851894.740010:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f TN_EVENT_TX_OK event status 0
00010000:00000001:28.0:1773851894.740011:0:41218:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000400:00000200:1.0:1773851894.740011:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000200:28.0:1773851894.740012:0:41218:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009a83a4ee x1858059204983680/t0(0) o1000->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/0 job:'default-yuba4-0'
00000400:00000200:1.0:1773851894.740013:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8402@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.740013:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d94499d6
00000400:00000010:1.0:1773851894.740014:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d94499d6.
00000100:00000001:1.0:1773851894.740014:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00010000:00000001:28.0:1773851894.740015:0:41218:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:1.0:1773851894.740015:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.740015:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00010000:00000001:28.0:1773851894.740016:0:41218:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851894.740017:0:41218:0:(import.c:1951:at_measured()) add 1 to 00000000f04ba3b2 time=148 v=66 (1 1 1 1)
00000800:00000200:1.0:1773851894.740017:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f Transaction freed
00000100:00000001:28.0:1773851894.740018:0:41218:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851894.740019:0:41218:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:28.0:1773851894.740019:0:41218:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:28.0:1773851894.740020:0:41218:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851894.740021:0:41218:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851894.740021:0:41218:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851894.740022:0:41218:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:28.0:1773851894.740023:0:41218:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000e0205a8f (tot 253201035).
00000100:00000200:28.0:1773851894.740025:0:41218:0:(niobuf.c:86:ptl_send_buf()) Sending 4320 bytes to portal 4, xid 1858059204983680, offset 224
00000400:00000200:28.0:1773851894.740027:0:41218:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:28.0:1773851894.740028:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851894.740029:0:41218:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:28.0:1773851894.740030:0:41218:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851894.740031:0:41218:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851894.740032:0:41218:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851894.740034:0:41218:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770129:8770129:1024:4294967295] 2074@kfi7 LPNI seq info [23425178:23425178:16:4294967295]
00000400:00000200:28.0:1773851894.740035:0:41218:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851894.740036:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851894.740038:0:41218:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851894.740040:0:41218:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:28.0:1773851894.740042:0:41218:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 1 allocated
00000800:00000200:28.0:1773851894.740043:0:41218:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:28.0:1773851894.740046:0:41218:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:28.0:1773851894.740054:0:41218:0:(kfilnd_ep.c:374:kfilnd_ep_post_tagged_recv()) 2069@kfi7:7 Transaction ID 00000000752ebe64: Posted tagged recv of 4320 bytes (2 frags) with tag 0x7a90001: rc=0
00000800:00000200:28.0:1773851894.740055:0:41218:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_TAGGED_RECV_POSTED state change
00000800:00000200:28.0:1773851894.740058:0:41218:0:(kfilnd_tn.c:603:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:28.0:1773851894.740061:0:41218:0:(kfilnd_tn.c:610:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x7a8 Using peer 2074@kfi7(0x7a8)
00000800:00000200:28.0:1773851894.740064:0:41218:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 110 bytes to peer 0x7a8: rc=0
00000800:00000200:28.0:1773851894.740065:0:41218:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x7a8 TN_STATE_TAGGED_RECV_POSTED -> TN_STATE_WAIT_COMP state change
00000100:00000001:28.0:1773851894.740068:0:41218:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851894.740069:0:41218:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:28.0:1773851894.740070:0:41218:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851894.740072:0:41218:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851894.740072:0:41218:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851894.740073:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009a83a4ee x1858059204983680/t0(0) o1000->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/1 job:'default-yuba4-0'
00000100:00100000:28.0:1773851894.740076:0:41218:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a83a4ee pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:196734:x1858059204983680:12345-2074@kfi7:1000:default-yuba4-0 Request processed in 114us (146us total) trans 0 rc 1/1
00000100:00100000:28.0:1773851894.740079:0:41218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 6571514
00000100:00000040:28.0:1773851894.740080:0:41218:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:28.0:1773851894.740081:0:41218:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851894.740081:0:41218:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851894.740082:0:41218:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851894.740083:0:41218:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851894.740084:0:41218:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851894.740085:0:41218:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:28.0:1773851894.740086:0:41218:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851894.740092:0:2467684:0:(kfilnd_tn.c:1127:kfilnd_tn_state_wait_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x7a8 TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851894.740094:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x7a8 TN_STATE_WAIT_COMP -> TN_STATE_WAIT_TAG_COMP state change
00000800:00000200:31.0:1773851894.740099:0:2465875:0:(kfilnd_tn.c:1307:kfilnd_tn_state_wait_tag_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x7a8 TN_EVENT_TAG_RX_OK event status 0
00000400:00000200:31.0:1773851894.740102:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851894.740103:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2074@kfi7: PUT: OK
00000400:00000200:31.0:1773851894.740104:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e0205a8f
00000400:00000010:31.0:1773851894.740105:0:2465875:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000e0205a8f (tot 253200883).
00000100:00000001:31.0:1773851894.740105:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851894.740106:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851894.740107:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:31.0:1773851894.740109:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_BULK_PUT_REQ TN 00000000752ebe64: 2069@kfi7:7 -> 2074@kfi7(000000002bcf6b7f):0x0 lsk 1961 rsk 4795 tsk 0 trmk 0 tmk 1 trr 7 tta 0x7a8 Transaction freed
00000800:00000200:1.0:1773851894.740170:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.740171:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.740173:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.740175:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.740176:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.740178:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8211@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.740179:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.740179:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:1.0:1773851894.740180:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.740181:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:1.0:1773851894.740182:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:1.0:1773851894.740182:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.740183:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 584 into portal 12 MB=0x69b175f72e180
00000400:00000200:1.0:1773851894.740184:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8211@kfi7 of length 584/584 into md 0x7fb56e801 [64] + 47808
00000800:00000200:1.0:1773851894.740186:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.740187:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.740189:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.740190:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.740191:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.740192:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003fb57726.
00000100:00000040:1.0:1773851894.740192:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000003fb57726 x1859374548181376 msgsize 584
00000100:00100000:1.0:1773851894.740194:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8211@kfi7)
00000100:00000001:1.0:1773851894.740195:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.740196:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000100:00000001:0.0:1773851894.740196:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.740196:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851894.740197:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851894.740197:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.740198:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.740198:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.740199:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548181376
00000020:00000001:0.0:1773851894.740200:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.740200:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:0.0:1773851894.740201:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.740201:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=9
00000020:00000001:0.0:1773851894.740202:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:0.0:1773851894.740203:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:0.0:1773851894.740204:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.740204:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.740205:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008a3a78d9.
00000020:00000010:0.0:1773851894.740206:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.740207:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851894.740207:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.740208:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:0.0:1773851894.740208:0:42868:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:0.0:1773851894.740209:0:42868:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.740209:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.740210:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.740212:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.740213:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.740214:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.740214:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.740214:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.740215:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 408701483
00000100:00000001:2.0:1773851894.740216:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.740216:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:0.0:1773851894.740216:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637123112243712 : -106950597307904 : ffff9eba9fa39200)
00000100:00000001:2.0:1773851894.740217:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.740217:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003fb57726 x1859374548181376/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 584/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1013-0'
00000100:00000001:0.0:1773851894.740220:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.740220:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.740221:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fb57726 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3f7a09dd-93e3-48df-8594-85e44391fba9+9:2511627:x1859374548181376:12345-8211@kfi7:101:default-tuolumne1013-0
00000100:00000200:0.0:1773851894.740223:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548181376
00000020:00000001:0.0:1773851894.740223:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.740224:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.740225:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.740225:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.740226:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:0.0:1773851894.740227:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.740227:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374548181376, found 0 last_xid 1859374548181375
00000020:00000001:0.0:1773851894.740228:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.740229:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.740229:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.740230:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.740230:0:42868:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:0.0:1773851894.740231:0:42868:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:0.0:1773851894.740231:0:42868:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:0.0:1773851894.740232:0:42868:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:0.0:1773851894.740232:0:42868:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.740233:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.740234:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.740234:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.740235:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.740236:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000ec279978.
00000020:00000001:0.0:1773851894.740236:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.740238:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000ec279978 with handle 0x21b6f08f07a6add2 to hash
00000020:00000001:0.0:1773851894.740238:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.740238:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00000010:0.0:1773851894.740239:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000084fdee8.
00010000:00000001:0.0:1773851894.740240:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00010000:0.0:1773851894.740241:0:42868:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6add2 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70aa1f42a86477c8 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740243:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:0.0:1773851894.740243:0:42868:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000003ec9ddea : new locks_count 4
00000020:00000040:0.0:1773851894.740244:0:42868:0:(genops.c:871:class_export_get()) GET export 000000003ec9ddea refcount=10
00010000:00000001:0.0:1773851894.740245:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:0.0:1773851894.740245:0:42868:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:0.0:1773851894.740246:0:42868:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:0.0:1773851894.740247:0:42868:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:0.0:1773851894.740247:0:42868:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:0.0:1773851894.740247:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851894.740248:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:0.0:1773851894.740248:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851894.740249:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:0.0:1773851894.740250:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:0.0:1773851894.740251:0:42868:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740251:0:42868:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:0.0:1773851894.740252:0:42868:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:0.0:1773851894.740252:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.740253:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.740255:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000ea0201f0.
02000000:00000001:0.0:1773851894.740256:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.740256:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740257:0:42868:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740258:0:42868:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:0.0:1773851894.740258:0:42868:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:0.0:1773851894.740259:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.740259:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.740260:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.740260:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.740261:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.740261:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.740262:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.740262:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.740263:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.740263:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.740264:0:42868:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:0.0:1773851894.740264:0:42868:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:0.0:1773851894.740265:0:42868:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:0.0:1773851894.740265:0:42868:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.740266:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.740266:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740267:0:42868:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:0.0:1773851894.740267:0:42868:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740268:0:42868:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:0.0:1773851894.740269:0:42868:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 000000009c587f3b
00000004:00000001:0.0:1773851894.740270:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:0.0:1773851894.740270:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:0.0:1773851894.740271:0:42868:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:0.0:1773851894.740271:0:42868:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:0.0:1773851894.740272:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.740272:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.740273:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.740273:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.740274:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.740275:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000097d489dd.
00000020:00000001:0.0:1773851894.740275:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.740276:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000097d489dd with handle 0x21b6f08f07a6add9 to hash
00000020:00000001:0.0:1773851894.740276:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.740277:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000010:0.0:1773851894.740277:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a43c5c3d.
00010000:00000001:0.0:1773851894.740278:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.740279:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.740282:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.740282:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740285:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.740285:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.740286:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.740286:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.740287:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.740287:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740288:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.740288:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740289:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.740289:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.740290:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.740290:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.740291:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 195
00010000:00000040:0.0:1773851894.740292:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:0.0:1773851894.740292:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740295:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740296:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740298:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740299:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740301:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740302:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740304:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740306:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740308:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740309:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740311:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740311:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740314:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740314:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740317:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740317:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740319:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740320:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740322:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740323:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740325:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740326:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740328:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740329:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740331:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740332:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740334:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740335:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740337:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740338:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740340:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740341:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740343:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740344:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740346:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740347:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740349:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740350:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740352:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740353:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740355:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740356:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740358:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740358:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740361:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740362:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740364:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740364:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740366:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740367:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740369:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740370:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 10 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740372:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740373:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740375:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740376:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740378:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740379:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740381:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740381:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740383:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740384:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740386:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740387:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740389:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740390:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740392:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740392:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740395:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740396:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740398:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740399:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740401:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740402:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740404:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740404:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740407:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740407:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740410:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740410:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740412:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740413:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740415:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740416:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740418:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740419:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740421:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740422:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740424:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740425:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740427:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740427:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740430:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740430:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740432:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740433:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740435:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740436:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740438:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740439:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740441:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740441:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740444:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740445:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740447:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740448:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740450:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740451:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740453:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740454:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740456:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740457:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740459:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740460:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740462:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740462:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740465:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740466:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740467:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740469:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740471:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740472:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740474:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740475:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740477:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740478:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740480:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740481:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740483:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740484:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740486:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740487:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740489:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740490:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740492:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740493:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740495:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740495:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740497:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740498:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740500:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740501:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740503:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740504:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740506:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740507:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740509:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740510:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740512:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740513:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740515:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740516:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740518:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740519:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740521:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740522:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740524:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740525:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740527:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740528:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740530:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740530:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740533:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740534:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740536:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740537:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740539:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740540:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740542:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740543:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740545:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740546:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740548:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740548:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740551:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740552:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740554:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740554:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740557:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740557:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740560:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740560:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740562:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740563:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740565:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740566:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740568:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740569:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740572:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740572:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740575:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740575:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740578:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740578:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740580:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740581:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740583:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740584:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740586:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740588:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740590:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740590:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740592:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740593:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740595:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740596:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740598:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740599:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740601:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740602:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740604:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740605:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740607:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740607:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740609:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740610:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740612:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740613:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740615:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740616:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740618:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740619:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740621:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740622:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740624:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740624:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740627:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740627:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740629:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740630:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740632:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740634:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740636:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740636:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740638:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740639:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740642:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740642:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740645:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740645:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740647:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740648:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740650:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740650:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740653:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740653:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740655:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740659:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740661:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740662:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740664:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740664:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740667:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740668:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740670:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740671:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740673:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740673:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740676:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740676:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740679:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740679:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740681:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740683:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740685:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740686:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740688:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740689:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740691:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740692:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740694:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740695:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740697:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740698:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740700:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740701:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740703:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740704:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740706:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740707:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740709:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740710:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740712:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740713:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740716:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740716:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740719:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740719:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740721:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740722:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740724:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740728:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740731:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740732:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740734:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740735:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740737:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740738:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740740:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740740:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740743:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740743:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740745:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740746:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740748:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740749:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740750:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740751:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740753:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740754:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740756:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740757:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740759:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740760:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740762:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740763:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740765:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740766:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740768:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740769:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740771:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740772:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740774:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740774:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740776:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740777:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740780:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740781:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740783:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740784:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740786:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740786:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740789:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740790:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740792:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740793:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740795:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740796:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740798:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740798:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740800:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740801:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740803:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740805:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740807:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740807:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740809:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740810:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740812:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740813:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740815:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740816:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740818:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740818:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740821:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740821:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740823:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740824:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740826:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740828:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740830:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740830:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740832:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740833:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740835:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740836:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740838:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740839:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740841:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740842:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740844:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740845:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740847:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740847:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740849:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740851:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740853:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740854:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740856:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740856:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740859:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740860:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740862:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.740863:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740865:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:0.0:1773851894.740865:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740867:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.740868:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.740868:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.740869:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.740869:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.740870:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740870:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.740871:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.740871:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.740872:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.740873:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740875:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.740876:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.740876:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.740876:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.740877:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.740877:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:0.0:1773851894.740879:0:42868:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000003f515ee2.
00010000:00000010:0.0:1773851894.740880:0:42868:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 000000008403d443.
00010000:00000001:0.0:1773851894.740881:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.740881:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000008ce5b96.
00000020:00000001:0.0:1773851894.740882:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.740883:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000008ce5b96 with handle 0x21b6f08f07a6ade0 to hash
00000020:00000001:0.0:1773851894.740884:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.740884:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000010:0.0:1773851894.740885:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000ae9033dc.
00010000:00000001:0.0:1773851894.740886:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.740887:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.740887:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.740888:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740890:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.740890:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.740891:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.740891:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.740892:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.740892:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740893:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.740893:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740894:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.740894:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.740895:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.740895:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.740895:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (000000003f515ee2) refcount = 1
00010000:00010000:0.0:1773851894.740897:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740899:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.740899:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.740900:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.740900:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.740901:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.740901:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740901:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.740902:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.740903:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.740903:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.740904:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740906:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.740906:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.740907:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.740907:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.740907:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.740908:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.740908:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=3
00000020:00000001:0.0:1773851894.740909:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.740909:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.740910:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.740910:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.740911:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740912:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740913:0:42868:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:0.0:1773851894.740916:0:42868:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:0.0:1773851894.740917:0:42868:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:0.0:1773851894.740918:0:42868:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:0.0:1773851894.740919:0:42868:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:0.0:1773851894.740924:0:42868:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:0.0:1773851894.740925:0:42868:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:0.0:1773851894.740925:0:42868:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:0.0:1773851894.740926:0:42868:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:0.0:1773851894.740926:0:42868:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:0.0:1773851894.740927:0:42868:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:0.0:1773851894.740928:0:42868:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:0.0:1773851894.740929:0:42868:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:0.0:1773851894.740929:0:42868:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:0.0:1773851894.740930:0:42868:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740931:0:42868:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.740931:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851894.740931:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:0.0:1773851894.740932:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851894.740933:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:0.0:1773851894.740934:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:0.0:1773851894.740935:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:0.0:1773851894.740935:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:0.0:1773851894.740936:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.740936:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.740937:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.740937:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.740938:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.740938:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000c346e481.
00000020:00000001:0.0:1773851894.740939:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.740940:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000c346e481 with handle 0x21b6f08f07a6ade7 to hash
00000020:00000001:0.0:1773851894.740941:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.740941:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000010:0.0:1773851894.740942:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000000abc935f.
00010000:00000001:0.0:1773851894.740943:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.740943:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.740944:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.740944:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ade7 lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 230 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740947:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.740948:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.740949:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.740949:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.740949:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.740950:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740951:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.740951:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.740952:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.740952:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.740952:0:42868:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.740953:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.740953:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 229
00010000:00000040:0.0:1773851894.740954:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:0.0:1773851894.740955:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740957:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740958:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740960:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740961:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740963:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740964:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740966:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740967:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740972:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740973:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740975:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740976:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740978:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740979:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740981:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740982:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740984:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740985:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740988:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740988:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740990:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740991:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.740993:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.740994:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741008:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741009:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741011:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741012:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741014:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741015:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741017:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741018:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741020:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741021:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741023:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741024:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741026:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741026:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741029:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741029:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741035:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741036:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741038:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741039:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 10 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741041:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741042:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741044:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741044:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741046:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741047:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741049:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741050:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741053:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741053:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741056:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741056:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741063:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741063:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741066:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741066:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741069:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741069:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741072:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741072:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741074:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741075:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741078:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741078:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741081:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741081:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741083:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741084:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741087:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741088:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741091:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741092:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741094:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741095:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741097:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741097:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741099:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741100:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741102:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741103:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741105:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741106:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741108:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741109:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741114:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741115:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741117:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741118:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741119:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741120:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741123:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741123:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741125:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741126:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741129:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741129:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741131:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741132:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741134:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741135:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741138:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741139:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741140:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741141:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741144:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741144:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741146:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741147:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741149:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741151:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741153:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741154:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741156:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741157:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741159:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741160:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741163:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741164:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741166:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741168:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741170:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741171:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741173:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741174:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741176:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741177:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741179:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741179:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741182:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741182:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741184:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741185:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741188:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741189:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741191:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741192:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741194:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741195:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741197:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741197:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741200:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741201:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741203:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741204:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741206:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741207:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741209:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741210:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741213:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741214:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741215:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741216:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741218:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741220:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741222:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741222:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741224:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741225:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741227:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741229:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741231:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741232:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741234:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741235:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741238:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741239:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741240:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741241:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741244:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741244:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741246:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741247:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741249:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741250:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741252:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741253:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741255:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741256:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741258:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741259:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741262:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741263:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741265:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741266:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741268:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741269:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741271:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741272:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741274:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741275:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741277:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741278:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741280:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741281:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741283:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741284:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741287:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741288:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741290:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741291:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741293:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741295:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741297:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741298:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741300:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741301:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741303:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741304:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741306:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741307:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741309:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741310:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741312:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741314:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741316:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741316:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741319:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741320:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741321:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741322:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741324:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741325:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741327:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741328:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741330:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741331:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741333:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741335:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741339:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741340:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741342:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741343:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741345:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741346:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741348:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741349:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741351:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741352:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741354:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741355:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741357:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741358:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741360:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741360:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741363:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741364:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741366:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741367:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741369:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741370:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741372:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741373:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741375:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741376:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741378:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741379:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741382:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741382:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741384:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741385:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741388:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741390:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741391:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741392:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741394:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741395:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741397:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741398:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741400:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741401:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741403:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741404:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741406:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741407:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741409:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741410:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741413:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741414:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741416:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741417:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741419:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741420:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741422:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741423:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741425:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741426:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741428:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741430:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741432:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741432:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741434:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741435:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741438:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741439:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741441:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741442:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741445:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741445:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741447:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741448:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741450:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741451:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741453:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741454:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741456:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741457:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741459:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741460:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741465:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741466:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741468:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741469:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741471:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741472:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741474:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741475:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741477:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741477:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741480:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741481:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741483:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741484:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741486:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741486:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741490:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741490:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741492:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741494:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741496:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741497:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741499:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741500:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741502:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741503:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741505:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741506:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741508:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741509:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741511:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741512:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741515:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741516:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741518:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741518:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741520:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741521:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741523:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741524:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741526:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741527:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741529:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741530:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741532:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741533:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741535:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741535:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741538:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741539:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741541:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741543:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741545:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741546:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741548:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741549:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741551:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741551:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741554:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741555:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741557:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741558:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741560:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741561:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741563:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741564:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741566:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741567:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741569:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741570:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741572:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741573:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741575:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741576:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741578:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741579:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741581:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741582:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741584:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741585:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741588:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741589:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741591:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741592:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741594:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741595:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741597:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741598:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741600:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741600:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741603:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741603:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741606:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741607:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741609:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741609:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741613:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741614:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741616:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741617:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741619:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741620:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741622:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741623:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741625:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741626:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741628:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741629:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741631:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741632:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741634:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741635:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741637:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741639:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741640:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741642:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741644:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741645:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741647:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741648:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741650:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741651:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741653:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741654:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741656:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741657:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741659:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741660:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741663:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741664:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741666:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741667:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741669:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741670:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741672:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741673:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741674:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741675:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741678:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741679:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741680:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.741681:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741683:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00010000:0.0:1773851894.741684:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ade7 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741686:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.741687:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.741688:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.741688:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741688:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.741689:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.741689:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741690:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.741690:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.741691:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.741692:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ade7 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741694:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.741694:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.741695:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741695:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741695:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.741696:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.741696:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c346e481 refcount=3
00000020:00000001:0.0:1773851894.741697:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.741698:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.741698:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741699:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.741699:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.741701:0:42868:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:0.0:1773851894.741701:0:42868:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:0.0:1773851894.741702:0:42868:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.741703:0:42868:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.741704:0:42868:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:0.0:1773851894.741704:0:42868:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:0.0:1773851894.741705:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:0.0:1773851894.741706:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.741707:0:42868:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741708:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.741708:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.741709:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c346e481 refcount=3
00000020:00000001:0.0:1773851894.741709:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.741710:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00000004:00010000:0.0:1773851894.741711:0:42868:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ade7 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741713:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.741713:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741714:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.741714:0:42868:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:0.0:1773851894.741714:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:0.0:1773851894.741715:0:42868:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:0.0:1773851894.741716:0:42868:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:0.0:1773851894.741716:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:0.0:1773851894.741717:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851894.741717:0:42868:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:0.0:1773851894.741718:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:0.0:1773851894.741718:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.741719:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.741719:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:0.0:1773851894.741719:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.741720:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.741721:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:0.0:1773851894.741722:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741724:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.741724:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741726:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.741727:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741732:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.741732:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.741733:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741733:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:0.0:1773851894.741734:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741736:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:0.0:1773851894.741737:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000097d489dd already unused, calling callback (000000001690cbe4)
00000004:00000001:0.0:1773851894.741738:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.741739:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:0.0:1773851894.741739:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741741:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.741742:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:0.0:1773851894.741742:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.741743:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.741743:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=4
00000020:00000001:0.0:1773851894.741744:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.741744:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.741745:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:0.0:1773851894.741746:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741748:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.741749:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:0.0:1773851894.741749:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:0.0:1773851894.741749:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741750:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851894.741750:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.741751:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.741752:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.741752:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000097d489dd with handle 0x21b6f08f07a6add9 from hash
00010000:00000001:0.0:1773851894.741753:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.741754:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741754:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741754:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.741755:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.741755:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741755:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851894.741756:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.741756:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.741757:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:0.0:1773851894.741757:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:0.0:1773851894.741758:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.741759:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741759:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.741760:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:0.0:1773851894.741761:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741761:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741761:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741762:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.741763:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.741763:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741765:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.741766:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741766:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741767:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:0.0:1773851894.741767:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:0.0:1773851894.741768:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.741768:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6add9 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741770:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000010:0.0:1773851894.741771:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a43c5c3d.
00010000:00000040:0.0:1773851894.741772:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.741773:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.741773:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:0.0:1773851894.741774:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:0.0:1773851894.741774:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.741774:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.741775:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=3
00000020:00000001:0.0:1773851894.741775:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.741776:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.741776:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:0.0:1773851894.741777:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741779:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.741780:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741780:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.741780:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741783:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.741783:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.741784:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741784:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:0.0:1773851894.741785:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741787:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00010000:0.0:1773851894.741787:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000008ce5b96 already unused, calling callback (000000001690cbe4)
00000004:00000001:0.0:1773851894.741788:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.741788:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:0.0:1773851894.741789:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741793:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.741794:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:0.0:1773851894.741794:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.741795:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.741795:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=4
00000020:00000001:0.0:1773851894.741796:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.741796:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.741797:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:0.0:1773851894.741797:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741799:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.741800:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:0.0:1773851894.741801:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:0.0:1773851894.741801:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741801:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851894.741802:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.741802:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.741803:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.741803:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000008ce5b96 with handle 0x21b6f08f07a6ade0 from hash
00010000:00000001:0.0:1773851894.741804:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.741804:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741805:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741805:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.741805:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.741806:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741806:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851894.741807:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.741807:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.741807:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (000000003f515ee2)
00010000:00010000:0.0:1773851894.741808:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:0.0:1773851894.741809:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.741810:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741810:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.741811:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:0.0:1773851894.741812:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741812:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741812:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741813:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.741814:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.741814:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741816:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.741817:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741817:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741817:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:0.0:1773851894.741818:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:0.0:1773851894.741818:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.741818:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ade0 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741821:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000010:0.0:1773851894.741821:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000ae9033dc.
00010000:00000040:0.0:1773851894.741822:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 0
00010000:00000010:0.0:1773851894.741823:0:42868:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 000000008403d443.
00010000:00000001:0.0:1773851894.741823:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.741824:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:0.0:1773851894.741824:0:42868:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:0.0:1773851894.741825:0:42868:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:0.0:1773851894.741825:0:42868:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:0.0:1773851894.741825:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.741826:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.741826:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c346e481 refcount=3
00000020:00000001:0.0:1773851894.741827:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.741827:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00000004:00000040:0.0:1773851894.741828:0:42868:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000003ec9ddea : new locks_count 5
00000020:00000040:0.0:1773851894.741831:0:42868:0:(genops.c:871:class_export_get()) GET export 000000003ec9ddea refcount=11
00010000:00000001:0.0:1773851894.741832:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741832:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.741833:0:42868:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.741833:0:42868:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:0.0:1773851894.741834:0:42868:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:0.0:1773851894.741834:0:42868:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:0.0:1773851894.741835:0:42868:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:0.0:1773851894.741835:0:42868:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:0.0:1773851894.741835:0:42868:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:0.0:1773851894.741836:0:42868:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:0.0:1773851894.741837:0:42868:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.741837:0:42868:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.741838:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:0.0:1773851894.741838:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:0.0:1773851894.741839:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851894.741839:0:42868:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:0.0:1773851894.741840:0:42868:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:0.0:1773851894.741840:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.741841:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741841:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741842:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.741842:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.741843:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000ec279978 with handle 0x21b6f08f07a6add2 from hash
00010000:00000001:0.0:1773851894.741843:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.741844:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741844:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741844:0:42868:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:0.0:1773851894.741845:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.741845:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6add2 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 195 type: IBT gid 0 flags: 0x44000000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477c8 expref: 11 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741847:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:0.0:1773851894.741848:0:42868:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003ec9ddea : new locks_count 4
00000020:00000040:0.0:1773851894.741849:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 10
00010000:00000010:0.0:1773851894.741849:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000084fdee8.
00010000:00000040:0.0:1773851894.741850:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00010000:00000001:0.0:1773851894.741851:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.741851:0:42868:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741852:0:42868:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:0.0:1773851894.741853:0:42868:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ade7 lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477c8 expref: 10 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.741855:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.741856:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.741857:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.741857:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:0.0:1773851894.741858:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:0.0:1773851894.741858:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.741859:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.741859:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.741860:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.741860:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.741860:0:42868:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000c346e481, rc 0)
00000020:00000001:0.0:1773851894.741861:0:42868:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.741862:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183038203122, transno 0, xid 1859374548181376
00010000:00000001:0.0:1773851894.741863:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851894.741863:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003fb57726 x1859374548181376/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 584/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00010000:00000001:0.0:1773851894.741866:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.741867:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.741867:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851894.741868:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.741869:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:0.0:1773851894.741870:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:0.0:1773851894.741871:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.741871:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.741872:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.741873:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8211@kfi7
00000400:00000010:0.0:1773851894.741874:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f597ead9.
00000100:00000200:0.0:1773851894.741875:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859374548181376, offset 224
00000400:00000200:0.0:1773851894.741876:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8211@kfi7
00000400:00000200:0.0:1773851894.741877:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.741878:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:0.0:1773851894.741879:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:0.0:1773851894.741880:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:0.0:1773851894.741881:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8211@kfi7 local destination
00000400:00000200:0.0:1773851894.741883:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770130:8770130:1024:4294967295] 8211@kfi7 LPNI seq info [7629406:7629406:16:4294967295]
00000400:00000200:0.0:1773851894.741884:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:0.0:1773851894.741885:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.741887:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8211@kfi7(8211@kfi7:8211@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.741888:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000800:00000200:0.0:1773851894.741890:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.741891:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:0.0:1773851894.741893:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.741895:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Using peer 8211@kfi7(0x880)
00000800:00000200:0.0:1773851894.741898:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 740 bytes to peer 0x880: rc=0
00000800:00000200:0.0:1773851894.741899:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.741901:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.741902:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:0.0:1773851894.741902:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.741903:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.741904:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.741904:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003fb57726 x1859374548181376/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 584/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00000100:00100000:0.0:1773851894.741909:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fb57726 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3f7a09dd-93e3-48df-8594-85e44391fba9+10:2511627:x1859374548181376:12345-8211@kfi7:101:default-tuolumne1013-0 Request processed in 1688us (1716us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.741912:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 408701483
00000100:00000040:0.0:1773851894.741913:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
00000100:00000001:0.0:1773851894.741914:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.741915:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.741915:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.741916:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851894.741917:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008a3a78d9.
00000020:00000040:0.0:1773851894.741917:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 9
00000100:00000001:0.0:1773851894.741918:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851894.741924:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851894.741926:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851894.741927:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000400:00000200:2.0:1773851894.741928:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f597ead9
00000400:00000010:2.0:1773851894.741928:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f597ead9.
00000100:00000001:2.0:1773851894.741929:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851894.741930:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851894.741931:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:2.0:1773851894.741932:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Transaction freed
00000800:00000200:2.0:1773851894.742087:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.742087:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.742088:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.742088:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851894.742089:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.742089:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:1.0:1773851894.742091:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8211@kfi7(0000000016671e20):0x883 version: 2; local version 2; negotiated version: 2
00000800:00000200:2.0:1773851894.742092:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851894.742093:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000800:00000200:1.0:1773851894.742093:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 Using peer 8211@kfi7(0x100000000000883)
00000400:00000200:2.0:1773851894.742097:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8211@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.742097:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.742098:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.742099:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000800:00000200:1.0:1773851894.742099:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 38 bytes to peer 0x100000000000883: rc=0
00000400:00000200:2.0:1773851894.742100:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.742101:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:1.0:1773851894.742101:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851894.742102:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:2.0:1773851894.742103:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.742104:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 328 into portal 17 MB=0x69b175f72e200
00000400:00000200:2.0:1773851894.742105:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8211@kfi7 of length 328/328 into md 0x7fb60e481 [2] + 656
00000800:00000200:2.0:1773851894.742107:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851894.742108:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851894.742109:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8211@kfi7: PUT: OK
00000100:00000001:2.0:1773851894.742110:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851894.742110:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:2.0:1773851894.742111:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001d9d58ce.
00000100:00000040:2.0:1773851894.742112:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000001d9d58ce x1859374548181504 msgsize 328
00000800:00000200:1.0:1773851894.742112:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851894.742113:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8211@kfi7)
00000100:00000001:2.0:1773851894.742114:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851894.742115:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:1.0:1773851894.742115:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 Transaction freed
00000100:00000001:0.0:1773851894.742115:0:61144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851894.742116:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851894.742116:0:61144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.742116:0:61144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.742116:0:61144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.742117:0:61144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.742118:0:61144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548181504
00000020:00000001:0.0:1773851894.742118:0:61144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.742119:0:61144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:0.0:1773851894.742119:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.742120:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=10
00000020:00000001:0.0:1773851894.742121:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:0.0:1773851894.742122:0:61144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:0.0:1773851894.742123:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.742123:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.742123:0:61144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008a3a78d9.
00000020:00000010:0.0:1773851894.742124:0:61144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008403d443.
00000020:00000010:0.0:1773851894.742125:0:61144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000040:0.0:1773851894.742126:0:61144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:0.0:1773851894.742126:0:61144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.742127:0:61144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:0.0:1773851894.742127:0:61144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:0.0:1773851894.742127:0:61144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.742128:0:61144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:0.0:1773851894.742129:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.742129:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.742130:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c346e481 refcount=3
00000020:00000001:0.0:1773851894.742130:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.742131:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.742132:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.742132:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.742133:0:61144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742133:0:61144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742134:0:61144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742135:0:61144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.742136:0:61144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851894.742137:0:82951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851894.742137:0:82951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.742137:0:61144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.742138:0:61144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 45419465
00000100:00000001:3.0:1773851894.742139:0:82951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.742139:0:61144:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:0.0:1773851894.742139:0:61144:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637031984534016 : -107041725017600 : ffff9ea568011200)
00000100:00000001:3.0:1773851894.742140:0:82951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.742140:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001d9d58ce x1859374548181504/t0(0) o103->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:0.0:1773851894.742143:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.742144:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.742144:0:61144:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001d9d58ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3f7a09dd-93e3-48df-8594-85e44391fba9+10:39751:x1859374548181504:12345-8211@kfi7:103:
00000100:00000200:0.0:1773851894.742146:0:61144:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548181504
00010000:00000001:0.0:1773851894.742146:0:61144:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:0.0:1773851894.742147:0:61144:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:0.0:1773851894.742147:0:61144:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:0.0:1773851894.742148:0:61144:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.742148:0:61144:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.742149:0:61144:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b306880e.
02000000:00000001:0.0:1773851894.742150:0:61144:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742150:0:61144:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.742151:0:61144:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:0.0:1773851894.742151:0:61144:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:0.0:1773851894.742152:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.742152:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.742153:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c346e481 refcount=3
00000020:00000001:0.0:1773851894.742154:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000001:0.0:1773851894.742155:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000040:0.0:1773851894.742155:0:61144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 230
00000004:00000001:0.0:1773851894.742156:0:61144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:0.0:1773851894.742156:0:61144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:0.0:1773851894.742157:0:61144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.742157:0:61144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.742158:0:61144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.742158:0:61144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.742159:0:61144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851894.742159:0:61144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.742160:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.742160:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.742160:0:61144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.742161:0:61144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.742161:0:61144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c346e481 with handle 0x21b6f08f07a6ade7 from hash
00010000:00000001:0.0:1773851894.742162:0:61144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.742162:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.742163:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.742163:0:61144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.742163:0:61144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.742164:0:61144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.742164:0:61144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851894.742165:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.742165:0:61144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ade7 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 231 type: IBT gid 0 flags: 0x44a01000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477c8 expref: 10 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.742168:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00010000:00000040:0.0:1773851894.742168:0:61144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003ec9ddea : new locks_count 3
00000020:00000040:0.0:1773851894.742169:0:61144:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 9
00010000:00000010:0.0:1773851894.742169:0:61144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000000abc935f.
00010000:00000040:0.0:1773851894.742170:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.742171:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.742171:0:61144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.742172:0:61144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.742172:0:61144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:0.0:1773851894.742173:0:61144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.742174:0:61144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.742174:0:61144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:0.0:1773851894.742174:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00010000:0.0:1773851894.742175:0:61144:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:0.0:1773851894.742176:0:61144:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.742176:0:61144:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.742177:0:61144:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.742177:0:61144:0:(import.c:1951:at_measured()) add 1 to 00000000fe6e7196 time=148 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851894.742178:0:61144:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.742179:0:61144:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:0.0:1773851894.742179:0:61144:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:0.0:1773851894.742180:0:61144:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.742180:0:61144:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742181:0:61144:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.742182:0:61144:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8211@kfi7
00000400:00000010:0.0:1773851894.742182:0:61144:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a494ee40.
00000100:00000200:0.0:1773851894.742183:0:61144:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859374548181504, offset 224
00000400:00000200:0.0:1773851894.742184:0:61144:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8211@kfi7
00000400:00000200:0.0:1773851894.742185:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.742186:0:61144:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:0.0:1773851894.742187:0:61144:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:0.0:1773851894.742188:0:61144:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:0.0:1773851894.742189:0:61144:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8211@kfi7 local destination
00000400:00000200:0.0:1773851894.742190:0:61144:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770131:8770131:1024:4294967295] 8211@kfi7 LPNI seq info [7629407:7629407:16:4294967295]
00000400:00000200:0.0:1773851894.742191:0:61144:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:0.0:1773851894.742192:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.742193:0:61144:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8211@kfi7(8211@kfi7:8211@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.742194:0:61144:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000800:00000200:0.0:1773851894.742196:0:61144:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.742197:0:61144:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851894.742199:0:61144:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.742201:0:61144:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 Using peer 8211@kfi7(0x100000000000883)
00000800:00000200:0.0:1773851894.742204:0:61144:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x100000000000883: rc=0
00000800:00000200:0.0:1773851894.742206:0:61144:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.742208:0:61144:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.742208:0:61144:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:0.0:1773851894.742209:0:61144:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.742209:0:61144:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.742210:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001d9d58ce x1859374548181504/t0(0) o103->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:0.0:1773851894.742215:0:61144:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001d9d58ce pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3f7a09dd-93e3-48df-8594-85e44391fba9+9:39751:x1859374548181504:12345-8211@kfi7:103: Request processed in 71us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.742217:0:61144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 45419465
00000100:00000040:0.0:1773851894.742217:0:61144:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
00000100:00000001:0.0:1773851894.742218:0:61144:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.742218:0:61144:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.742219:0:61144:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008403d443.
00000020:00000010:0.0:1773851894.742220:0:61144:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000020:00000010:0.0:1773851894.742220:0:61144:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008a3a78d9.
00000020:00000040:0.0:1773851894.742221:0:61144:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 8
00000100:00000001:0.0:1773851894.742222:0:61144:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851894.742226:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.742228:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.742229:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8211@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.742230:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a494ee40
00000400:00000010:1.0:1773851894.742230:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a494ee40.
00000100:00000001:1.0:1773851894.742231:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.742232:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.742232:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:1.0:1773851894.742233:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 Transaction freed
00000800:00000200:1.0:1773851894.742503:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.742503:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.742504:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.742506:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.742508:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.742509:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8211@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.742510:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.742511:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:1.0:1773851894.742511:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.742512:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:1.0:1773851894.742513:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:1.0:1773851894.742514:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.742514:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 512 into portal 12 MB=0x69b175f72e400
00000400:00000200:1.0:1773851894.742516:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8211@kfi7 of length 512/512 into md 0x7fb56e801 [64] + 48392
00000800:00000200:1.0:1773851894.742517:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.742519:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.742520:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.742521:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.742521:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.742523:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000be2b7b53.
00000100:00000040:1.0:1773851894.742524:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000be2b7b53 x1859374548182016 msgsize 512
00000100:00100000:1.0:1773851894.742525:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8211@kfi7)
00000100:00000001:1.0:1773851894.742526:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.742527:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000100:00000001:0.0:1773851894.742527:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.742527:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851894.742528:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851894.742528:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.742528:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.742529:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.742531:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548182016
00000020:00000001:0.0:1773851894.742531:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.742532:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:0.0:1773851894.742532:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.742533:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=9
00000020:00000001:0.0:1773851894.742533:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:0.0:1773851894.742534:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:0.0:1773851894.742535:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.742535:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.742536:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008a3a78d9.
00000020:00000010:0.0:1773851894.742536:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008403d443.
00000020:00000010:0.0:1773851894.742538:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007f5c4f0d.
00000100:00000001:0.0:1773851894.742539:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.742539:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851894.742540:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742541:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742542:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.742543:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.742544:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851894.742545:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 408701484
00000100:00000040:2.0:1773851894.742545:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:2.0:1773851894.742546:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637067106994176 : -107006602557440 : ffff9ead95774800)
00000800:00000200:1.0:1773851894.742546:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000040:2.0:1773851894.742547:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000be2b7b53 x1859374548182016/t0(0) o36->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 512/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1013-0'
00000800:00000200:1.0:1773851894.742547:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.742548:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.742549:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:2.0:1773851894.742550:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851894.742550:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:1.0:1773851894.742551:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000100:00100000:2.0:1773851894.742552:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be2b7b53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3f7a09dd-93e3-48df-8594-85e44391fba9+9:2511627:x1859374548182016:12345-8211@kfi7:36:default-tuolumne1013-0
00000400:00000200:1.0:1773851894.742552:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8211@kfi7 : PUT - for me
00000100:00000200:2.0:1773851894.742553:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548182016
00000400:00000200:1.0:1773851894.742553:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000020:00000001:2.0:1773851894.742554:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851894.742554:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:1.0:1773851894.742554:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:1.0:1773851894.742554:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000020:00000001:2.0:1773851894.742555:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851894.742555:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000020:00000001:2.0:1773851894.742556:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851894.742556:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658704 : -1035892912 : ffffffffc2418750)
00000400:00000200:1.0:1773851894.742556:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:1.0:1773851894.742556:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000020:00000001:2.0:1773851894.742557:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000400:00000200:1.0:1773851894.742557:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 224 into portal 12 MB=0x69b175f72e380
00000001:00000001:2.0:1773851894.742558:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374548182016, found 0 last_xid 1859374548181887
00000020:00000001:2.0:1773851894.742558:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851894.742558:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8211@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 48904
00000020:00000001:2.0:1773851894.742559:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851894.742559:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000800:00000200:1.0:1773851894.742559:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:2.0:1773851894.742560:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742561:0:60951:0:(mdt_handler.c:3040:mdt_reint()) Process entered
00000400:00000200:1.0:1773851894.742561:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000002:2.0:1773851894.742562:0:60951:0:(mdt_handler.c:3007:mdt_reint_opcode()) @@@ reint opt = 2  req@00000000be2b7b53 x1859374548182016/t0(0) o36->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 512/0 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/ffffffff rc 0/-1 job:'default-tuolumne1013-0'
00000400:00000200:1.0:1773851894.742562:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8211@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.742562:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.742563:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.742564:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036f32c51.
00000100:00000040:1.0:1773851894.742564:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000036f32c51 x1859374548181888 msgsize 224
00000004:00000001:2.0:1773851894.742565:0:60951:0:(mdt_handler.c:2906:mdt_reint_internal()) Process entered
00000100:00100000:1.0:1773851894.742565:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8211@kfi7)
00000004:00000001:2.0:1773851894.742566:0:60951:0:(mdt_lib.c:1846:mdt_reint_unpack()) Process entered
00000100:00000001:1.0:1773851894.742566:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000004:00000001:2.0:1773851894.742567:0:60951:0:(mdt_lib.c:1303:mdt_create_unpack()) Process entered
00000400:00000200:1.0:1773851894.742567:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000100:00000001:0.0:1773851894.742567:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851894.742568:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851894.742568:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.742568:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000001:00000001:2.0:1773851894.742569:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.742569:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742569:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.742569:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742570:0:60951:0:(mdt_lib.c:1213:mdt_dlmreq_unpack()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.742570:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548181888
00000020:00000001:0.0:1773851894.742570:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000004:00000001:2.0:1773851894.742571:0:60951:0:(mdt_lib.c:1379:mdt_create_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742571:0:60951:0:(mdt_lib.c:1856:mdt_reint_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.742571:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:0.0:1773851894.742571:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000004:00000001:2.0:1773851894.742572:0:60951:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:2.0:1773851894.742572:0:60951:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000020:00000040:0.0:1773851894.742572:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=10
00000020:00000001:0.0:1773851894.742572:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:2.0:1773851894.742573:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851894.742573:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000001:0.0:1773851894.742573:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
02000000:00000010:2.0:1773851894.742574:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 704 at 00000000f82e5278.
02000000:00000001:2.0:1773851894.742574:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742574:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.742574:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.742574:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000100:00000001:2.0:1773851894.742575:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:0.0:1773851894.742575:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000004:00000001:2.0:1773851894.742576:0:60951:0:(mdt_lib.c:578:old_init_ucred_reint()) Process entered
00000001:00000001:2.0:1773851894.742576:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000020:00000010:0.0:1773851894.742576:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000001:00000001:2.0:1773851894.742577:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.742577:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000100:00000001:0.0:1773851894.742577:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.742577:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000001:00000001:2.0:1773851894.742578:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742578:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742578:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.742579:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.742579:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.742580:0:60951:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
00000100:00000001:0.0:1773851894.742580:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:2.0:1773851894.742581:0:60951:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:2.0:1773851894.742581:0:60951:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000100:00000001:0.0:1773851894.742581:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.742581:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000004:00000001:2.0:1773851894.742582:0:60951:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.742582:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000100:00000001:1.0:1773851894.742582:0:61122:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851894.742582:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 408701485
00000001:00000001:2.0:1773851894.742583:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742583:0:60951:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:2.0:1773851894.742583:0:60951:0:(mdt_lib.c:599:old_init_ucred_reint()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.742583:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 2
00000100:00000001:0.0:1773851894.742583:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125525720192 : -106948183831424 : ffff9ebb2f7e4c80)
00000004:00000001:2.0:1773851894.742584:0:60951:0:(mdt_internal.h:1182:mdt_check_resent()) Process entered
00000100:00000001:1.0:1773851894.742584:0:61122:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:1.0:1773851894.742584:0:61122:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.742584:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036f32c51 x1859374548181888/t0(0) o41->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 224/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1013-0'
00000004:00000001:2.0:1773851894.742585:0:60951:0:(mdt_internal.h:1200:mdt_check_resent()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851894.742585:0:61122:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742586:0:60951:0:(mdt_reint.c:3241:mdt_reint_rec()) Process entered
00000004:00000001:2.0:1773851894.742587:0:60951:0:(mdt_reint.c:1049:mdt_reint_create()) Process entered
00000100:00000001:0.0:1773851894.742587:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.742587:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00010000:00000001:2.0:1773851894.742588:0:60951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:2.0:1773851894.742588:0:60951:0:(ldlm_lockd.c:1710:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.742588:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036f32c51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3f7a09dd-93e3-48df-8594-85e44391fba9+10:39768:x1859374548181888:12345-8211@kfi7:41:default-tuolumne1013-0
00000004:00000001:2.0:1773851894.742589:0:60951:0:(mdt_reint.c:511:mdt_create()) Process entered
00000100:00000200:0.0:1773851894.742589:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548181888
00000004:00000002:2.0:1773851894.742590:0:60951:0:(mdt_reint.c:514:mdt_create()) @@@ Create (tuolumne->[0x240028690:0xba5b:0x0]) in [0x2800256ea:0x3e:0x0]  req@00000000be2b7b53 x1859374548182016/t0(0) o36->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 512/448 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00000020:00000001:0.0:1773851894.742590:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.742590:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.742591:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.742591:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.742592:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000004:00000001:2.0:1773851894.742593:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000020:00000001:0.0:1773851894.742593:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.742593:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374548181888, found 0 last_xid 1859374548181887
00000004:00000040:2.0:1773851894.742594:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3e:0x0]
00000020:00000001:2.0:1773851894.742594:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851894.742594:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.742594:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.742595:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.742595:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.742596:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637104550728376 : -106969158823240 : ffff9eb64d4952b8)
00000004:00000001:2.0:1773851894.742596:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637104550728288 : -106969158823328 : ffff9eb64d495260)
00000100:00000001:0.0:1773851894.742596:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.742596:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.742597:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000f44a76cc.
02000000:00000001:0.0:1773851894.742597:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742598:0:60951:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000100:00000001:0.0:1773851894.742598:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742599:0:60951:0:(osp_object.c:581:osp_attr_get()) Process entered
00000004:00000001:0.0:1773851894.742599:0:42868:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:2.0:1773851894.742600:0:60951:0:(osp_object.c:593:osp_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742600:0:60951:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:0.0:1773851894.742600:0:42868:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:0.0:1773851894.742600:0:42868:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:2.0:1773851894.742601:0:60951:0:(mdd_dir.c:96:__mdd_lookup()) lustre5-MDD0001: Object [0x2800256ea:0x3e:0x0] located on remote server
00080000:00000001:0.0:1773851894.742601:0:42868:0:(osd_handler.c:559:osd_statfs()) Process entered
00000004:00000001:2.0:1773851894.742602:0:60951:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:2.0:1773851894.742602:0:60951:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742603:0:60951:0:(osp_md_object.c:476:osp_md_index_lookup()) Process entered
00080000:00000001:0.0:1773851894.742603:0:42868:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:0.0:1773851894.742603:0:42868:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 195035136 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:0.0:1773851894.742604:0:42868:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966131419 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000010:2.0:1773851894.742605:0:60951:0:(osp_trans.c:185:osp_update_request_create()) kmalloced '(our)': 120 at 00000000c1bdad60.
00000004:00000010:2.0:1773851894.742606:0:60951:0:(osp_trans.c:117:osp_object_update_request_create()) kmalloced '(ours)': 32 at 000000008f32ed9d.
00000020:00000001:0.0:1773851894.742606:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:0.0:1773851894.742607:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:2.0:1773851894.742608:0:60951:0:(osp_trans.c:128:osp_object_update_request_create()) kmalloced '(ourq)': 4096 at 000000000e3be57f.
00000004:00000001:0.0:1773851894.742608:0:42868:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.742608:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183038203122, transno 0, xid 1859374548181888
00000020:00000001:2.0:1773851894.742609:0:60951:0:(out_lib.c:157:out_update_pack()) Process entered
00010000:00000001:0.0:1773851894.742609:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000020:00000001:2.0:1773851894.742610:0:60951:0:(out_lib.c:171:out_update_pack()) Process leaving (rc=0 : 0 : 0)
00010000:00000200:0.0:1773851894.742610:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036f32c51 x1859374548181888/t0(0) o41->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 224/368 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00000004:00000001:2.0:1773851894.742611:0:60951:0:(osp_trans.c:477:osp_remote_sync()) Process entered
00000004:00000001:2.0:1773851894.742612:0:60951:0:(osp_trans.c:355:osp_prep_update_req()) Process entered
00000004:00000040:2.0:1773851894.742612:0:60951:0:(osp_trans.c:265:object_update_request_dump()) i = 0 fid = [0x2800256ea:0x3e:0x0] op = lookup params = 1 batchid = 0 size = 64 repsize 256
00010000:00000001:0.0:1773851894.742612:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.742613:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:2.0:1773851894.742614:0:60951:0:(osp_trans.c:271:object_update_request_dump()) updates = 000000000e3be57f magic = bdde0002 count = 1 size = 64
00000100:00001000:0.0:1773851894.742614:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000010:2.0:1773851894.742615:0:60951:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fefe46eb.
00000100:00000001:0.0:1773851894.742615:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.742615:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000020:00000040:2.0:1773851894.742616:0:60951:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:0.0:1773851894.742616:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
00000100:00000001:2.0:1773851894.742617:0:60951:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:2.0:1773851894.742617:0:60951:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:0.0:1773851894.742617:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.742617:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742617:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:2.0:1773851894.742618:0:60951:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.742618:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8211@kfi7
02000000:00000010:2.0:1773851894.742619:0:60951:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000ef7ccc6d.
00000400:00000010:0.0:1773851894.742619:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004dfb4d66.
00000100:00000200:0.0:1773851894.742619:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1859374548181888, offset 224
00000100:00000001:2.0:1773851894.742620:0:60951:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:0.0:1773851894.742620:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8211@kfi7
00000004:00000001:2.0:1773851894.742621:0:60951:0:(osp_trans.c:322:osp_prep_inline_update_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:0.0:1773851894.742621:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000004:00000001:2.0:1773851894.742622:0:60951:0:(osp_trans.c:399:osp_prep_update_req()) Process leaving via out_req (rc=0 : 0 : 0x0)
00000400:00000200:0.0:1773851894.742622:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000004:00000001:2.0:1773851894.742623:0:60951:0:(osp_trans.c:454:osp_prep_update_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:0.0:1773851894.742623:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000100:00000001:2.0:1773851894.742624:0:60951:0:(client.c:3060:ptlrpc_queue_wait()) Process entered
00000100:00000001:2.0:1773851894.742624:0:60951:0:(client.c:1049:ptlrpc_prep_set()) Process entered
00000400:00000200:0.0:1773851894.742624:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:0.0:1773851894.742625:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8211@kfi7 local destination
00000100:00000010:2.0:1773851894.742626:0:60951:0:(client.c:1051:ptlrpc_prep_set()) kmalloced '(set)': 112 at 00000000d178eb61.
00000100:00000001:2.0:1773851894.742626:0:60951:0:(client.c:1066:ptlrpc_prep_set()) Process leaving (rc=18446637099621893632 : -106974087657984 : ffff9eb527814600)
00000400:00000200:0.0:1773851894.742626:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770132:8770132:1024:4294967295] 8211@kfi7 LPNI seq info [7629408:7629408:16:4294967295]
00000100:00000001:2.0:1773851894.742627:0:60951:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851894.742627:0:60951:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637126454166400 : -106947255385216 : ffff9ebb66d54380)
00000400:00000200:0.0:1773851894.742627:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000100:00000001:2.0:1773851894.742628:0:60951:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000400:00000200:0.0:1773851894.742628:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000100:00000001:2.0:1773851894.742629:0:60951:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.742630:0:60951:0:(client.c:2473:ptlrpc_set_wait()) Process entered
00000100:00000001:2.0:1773851894.742630:0:60951:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000200:0.0:1773851894.742630:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8211@kfi7(8211@kfi7:8211@kfi7) <?> : PUT try# 0
00000100:00000040:2.0:1773851894.742631:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 0 ref 2 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:0.0:1773851894.742631:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000800:00000200:0.0:1773851894.742632:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.742633:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000100:00000001:2.0:1773851894.742634:0:60951:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851894.742634:0:60951:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.742635:0:60951:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:2.0:1773851894.742635:0:60951:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:0.0:1773851894.742635:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00100000:2.0:1773851894.742636:0:60951:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fefe46eb pname:cluuid:pid:xid:nid:opc:job mdt00_056:lustre5-MDT0001-mdtlov_UUID:60951:1859433051939456:13@kfi7:1000:default-yuba2-0
00000800:00000200:0.0:1773851894.742637:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 Using peer 8211@kfi7(0x100000000000883)
00000100:00000001:2.0:1773851894.742638:0:60951:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:2.0:1773851894.742639:0:60951:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:2.0:1773851894.742639:0:60951:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.742640:0:60951:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000800:00000200:0.0:1773851894.742640:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 468 bytes to peer 0x100000000000883: rc=0
00000800:00000200:0.0:1773851894.742641:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
02000000:00000010:2.0:1773851894.742642:0:60951:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 8192 at 000000009c137bbf.
02000000:00000001:2.0:1773851894.742642:0:60951:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.742642:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851894.742643:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000040:0.0:1773851894.742643:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00000400:00000010:2.0:1773851894.742644:0:60951:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00010000:00000001:0.0:1773851894.742644:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.742644:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.742644:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.742645:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036f32c51 x1859374548181888/t0(0) o41->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 224/368 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00000400:00000010:2.0:1773851894.742646:0:60951:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000a531d2a9 (tot 253201035).
00000100:00000200:2.0:1773851894.742647:0:60951:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 8192 bytes, xid 1859433051939456, portal 4
00000100:00000001:2.0:1773851894.742648:0:60951:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851894.742648:0:60951:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637126454166400 : -106947255385216 : ffff9ebb66d54380)
00000100:00100000:0.0:1773851894.742648:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036f32c51 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:3f7a09dd-93e3-48df-8594-85e44391fba9+10:39768:x1859374548181888:12345-8211@kfi7:41:default-tuolumne1013-0 Request processed in 60us (83us total) trans 0 rc 0/0
00000100:00000040:2.0:1773851894.742650:0:60951:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:0.0:1773851894.742651:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 408701485
00000100:00000001:2.0:1773851894.742652:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.742652:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 1
00000100:00000040:2.0:1773851894.742653:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000100:00000001:0.0:1773851894.742653:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.742653:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.742653:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000400:00000010:2.0:1773851894.742654:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000757d75ef.
00000100:00000200:2.0:1773851894.742654:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 328 bytes to portal 24, xid 1859433051939456, offset 0
00000020:00000010:0.0:1773851894.742654:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000400:00000200:2.0:1773851894.742655:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000020:00000010:0.0:1773851894.742655:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000400:00000200:2.0:1773851894.742656:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000020:00000040:0.0:1773851894.742656:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 9
00000400:00000200:2.0:1773851894.742657:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000001:0.0:1773851894.742657:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:2.0:1773851894.742658:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:2.0:1773851894.742659:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:2.0:1773851894.742660:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:2.0:1773851894.742661:0:60951:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770130, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770132, p:4294967295, g:4294967295, h:1000]
00000800:00000200:1.0:1773851894.742662:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851894.742663:0:60951:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:1.0:1773851894.742663:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851894.742664:0:60951:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851894.742664:0:60951:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:1.0:1773851894.742664:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8211@kfi7: PUT: OK
00000400:00000200:2.0:1773851894.742665:0:60951:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133326, 23133325]
00000400:00000200:1.0:1773851894.742665:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004dfb4d66
00000400:00000010:1.0:1773851894.742665:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004dfb4d66.
00000100:00000001:1.0:1773851894.742666:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.742666:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851894.742667:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000400:00000200:2.0:1773851894.742668:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770133:8770133:1024:4294967295] 13@kfi7 LPNI seq info [23133327:23133327:16:4294967295]
00000400:00000200:2.0:1773851894.742669:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:2.0:1773851894.742670:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:1.0:1773851894.742671:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:2.0:1773851894.742672:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000800:00000200:1.0:1773851894.742672:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 8211@kfi7(0000000016671e20):0x0 lsk 2180 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000883 Transaction freed
00000400:00000200:2.0:1773851894.742673:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:2.0:1773851894.742675:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.742676:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 328 bytes in 1 frags
00000800:00000200:2.0:1773851894.742678:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851894.742680:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:2.0:1773851894.742684:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000dae7d744: Posted send of 428 bytes to peer 0x102: rc=0
00000800:00000200:2.0:1773851894.742685:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851894.742687:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.742688:0:60951:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851894.742689:0:60951:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.742689:0:60951:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851894.742690:0:60951:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00100000:2.0:1773851894.742691:0:60951:0:(client.c:2500:ptlrpc_set_wait()) set 00000000d178eb61 going to sleep for 87 seconds
00000100:00000001:2.0:1773851894.742691:0:60951:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851894.742692:0:60951:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851894.742696:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.742698:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.742699:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.742699:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000757d75ef
00000400:00000010:1.0:1773851894.742700:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000757d75ef.
00000100:00000001:1.0:1773851894.742701:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:1.0:1773851894.742701:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851894.742704:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:1.0:1773851894.742705:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 2  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 3 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851894.742708:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851894.742708:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.742709:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:1.0:1773851894.742710:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 0 tta 0x102 Transaction freed
00000800:00000200:21.0:1773851894.742744:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851894.742745:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000800:00000200:21.0:1773851894.742746:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851894.742748:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851894.742751:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.742752:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:21.0:1773851894.742753:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.742754:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:21.0:1773851894.742755:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.742755:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:21.0:1773851894.742756:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851894.742757:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.742758:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 4320 into portal 4 MB=0x69b24fe8b6280
00000400:00000200:21.0:1773851894.742759:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851894.742761:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 4320/4320 into md 0x6a34d1d55 [2] + 224
00000800:00000200:21.0:1773851894.742763:0:2494373:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:21.0:1773851894.742766:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000800:00000200:21.0:1773851894.742768:0:2494373:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:21.0:1773851894.742777:0:2494373:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:5 TN 0000000063ddb849: Posted read of 4320 bytes in 2 frags kp 13@kfi7(00000000db68253b) rma_iov.key 314703873: rc=0
00000800:00000200:21.0:1773851894.742779:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000800:00000200:21.0:1773851894.742797:0:2494373:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 TN_EVENT_TAG_TX_OK event status 0
00000400:00000200:21.0:1773851894.742799:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.742800:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000100:00000001:21.0:1773851894.742801:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851894.742802:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851894.742805:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=4320 offset=224 replen=4320  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851894.742809:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851894.742810:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:21.0:1773851894.742812:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 Transaction freed
00000100:00000001:2.0:1773851894.742812:0:60951:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:2.0:1773851894.742813:0:60951:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:2.0:1773851894.742813:0:60951:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:2.0:1773851894.742814:0:60951:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000400:00000200:2.0:1773851894.742815:0:60951:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a531d2a9
00000400:00000010:2.0:1773851894.742815:0:60951:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000a531d2a9 (tot 253200883).
00000100:00000001:2.0:1773851894.742817:0:60951:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:2.0:1773851894.742817:0:60951:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:2.0:1773851894.742820:0:60951:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.742823:0:60951:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851894.742824:0:60951:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.742824:0:60951:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:2.0:1773851894.742825:0:60951:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:2.0:1773851894.742825:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851894.742826:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.742826:0:60951:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851894.742827:0:60951:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=127 v=66 (66 66 66 66)
00000100:00001000:2.0:1773851894.742828:0:60951:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=127 v=66 (1 1 1 1)
00000100:00000001:2.0:1773851894.742829:0:60951:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:2.0:1773851894.742830:0:60951:0:(client.c:1366:ptlrpc_check_status()) @@@ check status: rc = 1  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQU/0/0 rc 0/1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.742832:0:60951:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.742833:0:60951:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:2.0:1773851894.742834:0:60951:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000100:00000001:2.0:1773851894.742834:0:60951:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:2.0:1773851894.742835:0:60951:0:(client.c:1614:after_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:2.0:1773851894.742835:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.742838:0:60951:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=1 : 1 : 0x1)
00000100:00000001:2.0:1773851894.742839:0:60951:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:2.0:1773851894.742839:0:60951:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:2.0:1773851894.742840:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Interpret:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00100000:2.0:1773851894.742842:0:60951:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fefe46eb pname:cluuid:pid:xid:nid:opc:job mdt00_056:lustre5-MDT0001-mdtlov_UUID:60951:1859433051939456:13@kfi7:1000:default-yuba2-0
00000100:00000001:2.0:1773851894.742844:0:60951:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.742844:0:60951:0:(client.c:2564:ptlrpc_set_wait()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.742845:0:60951:0:(client.c:1109:ptlrpc_set_destroy()) Process entered
00000100:00000001:2.0:1773851894.742846:0:60951:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:2.0:1773851894.742846:0:60951:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Complete:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.742848:0:60951:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:2.0:1773851894.742849:0:60951:0:(ptlrpc_internal.h:359:ptlrpc_reqset_put()) kfreed 'set': 112 at 00000000d178eb61.
00000100:00000001:2.0:1773851894.742850:0:60951:0:(client.c:1146:ptlrpc_set_destroy()) Process leaving
00000100:00000001:2.0:1773851894.742851:0:60951:0:(client.c:3079:ptlrpc_queue_wait()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851894.742852:0:60951:0:(osp_trans.c:495:osp_remote_sync()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851894.742853:0:60951:0:(osp_md_object.c:532:osp_md_index_lookup()) Process leaving via out (rc=1 : 1 : 0x1)
00000100:00000001:2.0:1773851894.742854:0:60951:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:2.0:1773851894.742855:0:60951:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fefe46eb x1859433051939456/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851894.742857:0:60951:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:2.0:1773851894.742858:0:60951:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:2.0:1773851894.742858:0:60951:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 8192 at 000000009c137bbf.
02000000:00000001:2.0:1773851894.742860:0:60951:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:2.0:1773851894.742860:0:60951:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851894.742860:0:60951:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000001:2.0:1773851894.742861:0:60951:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:2.0:1773851894.742861:0:60951:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at 00000000ef7ccc6d.
02000000:00000001:2.0:1773851894.742862:0:60951:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:2.0:1773851894.742863:0:60951:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851894.742863:0:60951:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fefe46eb.
00000100:00000001:2.0:1773851894.742864:0:60951:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851894.742864:0:60951:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000010:2.0:1773851894.742865:0:60951:0:(osp_trans.c:215:osp_update_request_destroy()) kfreed 'ours->ours_req': 4096 at 000000000e3be57f.
00000004:00000010:2.0:1773851894.742866:0:60951:0:(osp_trans.c:216:osp_update_request_destroy()) kfreed 'ours': 32 at 000000008f32ed9d.
00000004:00000010:2.0:1773851894.742867:0:60951:0:(osp_trans.c:243:osp_update_request_destroy()) kfreed 'our': 120 at 00000000c1bdad60.
00000004:00000001:2.0:1773851894.742867:0:60951:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742868:0:60951:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742869:0:60951:0:(mdt_reint.c:581:mdt_create()) Process leaving via put_parent (rc=18446744073709551599 : -17 : 0xffffffffffffffef)
00000004:00000001:2.0:1773851894.742870:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:2.0:1773851894.742871:0:60951:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:2.0:1773851894.742871:0:60951:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:2.0:1773851894.742872:0:60951:0:(lu_object.c:224:lu_object_put()) Add 00000000292282c7/00000000caceecbf to site lru. bkt: 000000006869a0d3
00000004:00000001:2.0:1773851894.742873:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851894.742873:0:60951:0:(mdt_reint.c:1087:mdt_reint_create()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000004:00000001:2.0:1773851894.742874:0:60951:0:(mdt_reint.c:3254:mdt_reint_rec()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000004:00000001:2.0:1773851894.742875:0:60951:0:(mdt_handler.c:2976:mdt_reint_internal()) Process leaving
02000000:00000001:2.0:1773851894.742876:0:60951:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:2.0:1773851894.742876:0:60951:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:2.0:1773851894.742877:0:60951:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:2.0:1773851894.742877:0:60951:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:2.0:1773851894.742878:0:60951:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:2.0:1773851894.742878:0:60951:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:2.0:1773851894.742879:0:60951:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.742879:0:60951:0:(mdt_handler.c:3056:mdt_reint()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00010000:00000040:2.0:1773851894.742880:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183038203122, transno 0, xid 1859374548182016
00010000:00000001:2.0:1773851894.742881:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851894.742882:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000be2b7b53 x1859374548182016/t0(0) o36->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 512/448 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc -17/0 job:'default-tuolumne1013-0'
00010000:00000001:2.0:1773851894.742884:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851894.742885:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851894.742885:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851894.742886:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851894.742887:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:2.0:1773851894.742888:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:2.0:1773851894.742888:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851894.742889:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.742889:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851894.742890:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8211@kfi7
00000400:00000010:2.0:1773851894.742890:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cd77425f.
00000100:00000200:2.0:1773851894.742891:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 448 bytes to portal 10, xid 1859374548182016, offset 224
00000400:00000200:2.0:1773851894.742892:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8211@kfi7
00000400:00000200:2.0:1773851894.742893:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.742894:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:2.0:1773851894.742895:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:2.0:1773851894.742896:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:2.0:1773851894.742896:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8211@kfi7 local destination
00000400:00000200:2.0:1773851894.742898:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770134:8770134:1024:4294967295] 8211@kfi7 LPNI seq info [7629409:7629409:16:4294967295]
00000400:00000200:2.0:1773851894.742899:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:2.0:1773851894.742900:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.742902:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8211@kfi7(8211@kfi7:8211@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851894.742903:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000800:00000200:2.0:1773851894.742905:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.742906:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 448 bytes in 1 frags
00000800:00000200:2.0:1773851894.742908:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851894.742910:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Using peer 8211@kfi7(0x880)
00000800:00000200:2.0:1773851894.742913:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000894f0236: Posted send of 548 bytes to peer 0x880: rc=0
00000800:00000200:2.0:1773851894.742914:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851894.742916:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851894.742917:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:2.0:1773851894.742917:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851894.742918:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.742918:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851894.742919:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000be2b7b53 x1859374548182016/t0(0) o36->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 512/448 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc -17/-17 job:'default-tuolumne1013-0'
00000100:00100000:2.0:1773851894.742922:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be2b7b53 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3f7a09dd-93e3-48df-8594-85e44391fba9+9:2511627:x1859374548182016:12345-8211@kfi7:36:default-tuolumne1013-0 Request processed in 371us (398us total) trans 0 rc -17/-17
00000100:00100000:2.0:1773851894.742924:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 408701484
00000100:00000040:2.0:1773851894.742925:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
00000100:00000001:2.0:1773851894.742925:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851894.742926:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851894.742927:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008403d443.
00000020:00000010:2.0:1773851894.742927:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007f5c4f0d.
00000800:00000200:1.0:1773851894.742927:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_EVENT_TX_OK event status 0
00000020:00000010:2.0:1773851894.742928:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008a3a78d9.
00000400:00000200:1.0:1773851894.742928:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:2.0:1773851894.742929:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 8
00000100:00000001:2.0:1773851894.742929:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851894.742930:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.742931:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cd77425f
00000400:00000010:1.0:1773851894.742931:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cd77425f.
00000100:00000001:1.0:1773851894.742932:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.742932:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.742933:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:1.0:1773851894.742934:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Transaction freed
00000800:00000200:1.0:1773851894.743498:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.743499:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.743500:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.743502:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.743504:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.743506:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8211@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.743506:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.743507:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:1.0:1773851894.743508:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.743509:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:1.0:1773851894.743510:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:1.0:1773851894.743510:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.743511:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 576 into portal 12 MB=0x69b175f72e600
00000400:00000200:1.0:1773851894.743512:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8211@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 49128
00000800:00000200:1.0:1773851894.743514:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.743516:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.743517:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.743518:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.743518:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.743519:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aca48d4f.
00000100:00000040:1.0:1773851894.743519:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000aca48d4f x1859374548182528 msgsize 576
00000100:00100000:1.0:1773851894.743521:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8211@kfi7)
00000100:00000001:1.0:1773851894.743522:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:2.0:1773851894.743523:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:1.0:1773851894.743523:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
02000000:00000001:2.0:1773851894.743524:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851894.743524:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851894.743524:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851894.743525:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.743526:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851894.743527:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548182528
00000020:00000001:2.0:1773851894.743527:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851894.743528:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:2.0:1773851894.743528:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851894.743529:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=9
00000020:00000001:2.0:1773851894.743530:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:2.0:1773851894.743531:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:2.0:1773851894.743531:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851894.743532:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851894.743532:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7ccc6d.
00000020:00000010:2.0:1773851894.743533:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851894.743534:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a912de76.
00000100:00000001:2.0:1773851894.743534:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851894.743535:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:2.0:1773851894.743535:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:2.0:1773851894.743536:0:60951:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.743536:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.743537:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.743538:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.743539:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.743539:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.743540:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.743540:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851894.743541:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 408701486
00000100:00000040:2.0:1773851894.743541:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:0.0:1773851894.743541:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.743542:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125525723648 : -106948183827968 : ffff9ebb2f7e5a00)
00000100:00000001:0.0:1773851894.743542:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851894.743543:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aca48d4f x1859374548182528/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 576/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1013-0'
00000100:00000001:2.0:1773851894.743545:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851894.743546:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851894.743546:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aca48d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3f7a09dd-93e3-48df-8594-85e44391fba9+9:2511627:x1859374548182528:12345-8211@kfi7:101:default-tuolumne1013-0
00000100:00000200:2.0:1773851894.743548:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548182528
00000020:00000001:2.0:1773851894.743548:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851894.743549:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851894.743549:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.743550:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851894.743550:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:2.0:1773851894.743551:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851894.743552:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374548182528, found 0 last_xid 1859374548182527
00000020:00000001:2.0:1773851894.743552:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851894.743553:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851894.743553:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851894.743554:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.743554:0:60951:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:2.0:1773851894.743555:0:60951:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:2.0:1773851894.743555:0:60951:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:2.0:1773851894.743556:0:60951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:2.0:1773851894.743556:0:60951:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.743557:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851894.743558:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 194
00010000:00000001:2.0:1773851894.743559:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851894.743560:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851894.743561:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000009d396318.
00000020:00000001:2.0:1773851894.743561:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851894.743562:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 000000009d396318 with handle 0x21b6f08f07a6adee to hash
00000020:00000001:2.0:1773851894.743563:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851894.743563:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000010:2.0:1773851894.743564:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000795a147f.
00010000:00000001:2.0:1773851894.743564:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00010000:2.0:1773851894.743565:0:60951:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6adee lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x70aa1f42a86477f2 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743568:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000040:2.0:1773851894.743569:0:60951:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000003ec9ddea : new locks_count 4
00000020:00000040:2.0:1773851894.743569:0:60951:0:(genops.c:871:class_export_get()) GET export 000000003ec9ddea refcount=10
00010000:00000001:2.0:1773851894.743571:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:2.0:1773851894.743572:0:60951:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:2.0:1773851894.743573:0:60951:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:2.0:1773851894.743573:0:60951:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:2.0:1773851894.743573:0:60951:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:2.0:1773851894.743574:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851894.743574:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:2.0:1773851894.743575:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:2.0:1773851894.743576:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:2.0:1773851894.743576:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:2.0:1773851894.743577:0:60951:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.743578:0:60951:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:2.0:1773851894.743578:0:60951:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:2.0:1773851894.743579:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851894.743579:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851894.743580:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 000000009c137bbf.
02000000:00000001:2.0:1773851894.743580:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.743581:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.743581:0:60951:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.743582:0:60951:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:2.0:1773851894.743582:0:60951:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:2.0:1773851894.743583:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.743583:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.743584:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.743584:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.743585:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.743585:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.743586:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.743586:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.743586:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.743587:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.743587:0:60951:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:2.0:1773851894.743588:0:60951:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:2.0:1773851894.743589:0:60951:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:2.0:1773851894.743589:0:60951:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.743589:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.743590:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.743590:0:60951:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:2.0:1773851894.743591:0:60951:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.743592:0:60951:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:2.0:1773851894.743592:0:60951:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 0000000042de18f7
00000004:00000001:2.0:1773851894.743593:0:60951:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:2.0:1773851894.743594:0:60951:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:2.0:1773851894.743594:0:60951:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851894.743594:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851894.743595:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00010000:00000001:2.0:1773851894.743595:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851894.743596:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851894.743596:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000b2fd8ebc.
00000020:00000001:2.0:1773851894.743597:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851894.743597:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000b2fd8ebc with handle 0x21b6f08f07a6adf5 to hash
00000020:00000001:2.0:1773851894.743598:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851894.743598:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000010:2.0:1773851894.743599:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000026012d57.
00010000:00000001:2.0:1773851894.743600:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851894.743600:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851894.743601:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851894.743602:0:60951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6adf5 lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743604:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:2.0:1773851894.743605:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851894.743605:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851894.743606:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851894.743606:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851894.743607:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.743608:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851894.743608:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.743609:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851894.743609:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851894.743610:0:60951:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851894.743610:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851894.743611:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 195
00010000:00000040:2.0:1773851894.743612:0:60951:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851894.743613:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743615:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743616:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743619:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743620:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743622:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743623:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743625:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743626:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743628:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743629:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743631:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743632:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743635:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743635:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743641:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743642:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743644:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743644:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743647:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743647:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743649:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743650:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743652:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743653:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743655:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743656:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743658:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743659:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743661:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743661:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743667:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743668:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743669:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743670:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743672:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743673:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743675:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743676:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743678:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743679:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743681:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743682:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743684:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743685:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 10 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743687:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743688:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 7 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743691:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743692:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743694:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743695:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743697:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743698:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743700:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743701:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743703:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743703:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743705:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743706:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743708:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743709:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743711:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743712:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743715:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743716:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743718:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743719:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743721:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743722:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743724:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743729:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743730:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743731:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743733:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743734:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743736:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743737:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743739:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743740:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743743:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743743:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743745:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743746:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743748:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743750:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743752:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743752:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743754:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743755:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743758:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743758:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743760:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743761:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743763:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743764:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743767:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743768:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743770:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743771:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743773:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743773:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743775:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743776:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743778:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743779:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743781:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743782:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743784:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743785:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743787:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743788:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743792:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743792:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743794:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743795:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743797:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743798:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743800:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743801:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743803:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743804:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743806:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743807:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743809:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743810:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743812:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743813:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743817:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743818:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743820:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743821:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743823:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743824:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743826:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743827:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743829:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743830:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743832:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743833:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743835:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743836:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743838:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743839:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743842:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743843:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743845:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743846:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743848:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743849:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743851:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743852:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743854:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743855:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743857:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743858:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743860:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743860:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743862:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743863:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743866:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743867:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743869:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743870:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743872:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743873:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743875:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743876:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743879:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743879:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743881:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743882:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743884:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743885:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743887:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743888:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743891:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743892:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743894:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743895:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743897:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743898:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743900:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743900:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743902:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743903:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743905:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743906:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743908:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743909:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743911:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743912:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743915:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743916:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743918:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743918:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743920:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743922:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743924:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743924:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743926:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743927:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743930:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743931:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743933:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743934:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743936:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743937:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743940:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743941:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743943:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743944:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743946:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743947:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743949:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743950:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743951:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743952:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743954:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743955:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743957:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743958:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743960:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743961:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743964:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743965:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743967:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743968:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743970:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743971:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743973:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743973:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743975:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743976:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743978:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743979:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743981:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743982:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743984:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743985:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743988:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743990:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743992:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743992:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743994:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743996:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.743998:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.743999:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744001:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744002:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744004:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744005:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744007:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744008:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744010:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744011:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744015:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744015:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744017:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744018:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744020:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744021:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744023:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744023:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744025:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744026:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744028:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744029:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744031:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744032:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744034:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744034:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744037:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744038:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744040:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744041:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744043:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744044:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744046:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744046:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744048:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744049:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744051:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744052:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744054:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744055:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744057:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744058:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744063:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744064:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744066:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744067:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744069:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744070:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744072:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744073:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744075:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744076:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744078:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744079:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744081:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744082:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744084:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744085:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744088:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744089:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744091:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744092:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744093:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744094:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744096:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744097:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744099:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744100:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744102:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744103:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744105:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744106:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744108:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744108:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744112:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744113:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744115:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744116:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744118:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744118:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744120:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744121:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744123:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744125:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744127:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744128:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744130:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744130:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744133:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744134:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744137:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744138:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744140:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744141:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744143:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744144:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744145:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744146:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744149:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744149:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744151:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744153:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744155:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744155:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744157:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744158:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744162:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744163:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744165:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744166:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744168:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744168:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744170:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744171:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744174:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744175:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744177:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744177:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744180:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744181:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744183:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744183:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744186:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744188:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744190:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744191:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744193:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744194:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744196:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744197:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744199:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744200:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744202:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744203:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744205:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744206:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744208:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744209:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744212:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744213:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744214:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00010000:2.0:1773851894.744215:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6adf5 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744217:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:2.0:1773851894.744218:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851894.744219:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.744219:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.744220:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851894.744220:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.744221:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.744221:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851894.744222:0:60951:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851894.744222:0:60951:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851894.744223:0:60951:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6adf5 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744225:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:2.0:1773851894.744226:0:60951:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851894.744226:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.744226:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.744227:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851894.744227:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851894.744228:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2fd8ebc refcount=3
00000020:00000001:2.0:1773851894.744228:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851894.744229:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851894.744230:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.744230:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851894.744231:0:60951:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.744231:0:60951:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.744232:0:60951:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:2.0:1773851894.744233:0:60951:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:2.0:1773851894.744234:0:60951:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:2.0:1773851894.744239:0:60951:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.744240:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851894.744240:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.744241:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.744242:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744243:0:60951:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744243:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744244:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851894.744245:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.744245:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.744245:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744246:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744247:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:2.0:1773851894.744247:0:60951:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:2.0:1773851894.744248:0:60951:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.744249:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.744249:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.744250:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.744250:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.744251:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.744251:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:2.0:1773851894.744251:0:60951:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:2.0:1773851894.744253:0:60951:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:2.0:1773851894.744253:0:60951:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:2.0:1773851894.744254:0:60951:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:2.0:1773851894.744255:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.744255:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.744256:0:60951:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:2.0:1773851894.744256:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851894.744256:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.744257:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.744258:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744258:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744259:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.744260:0:60951:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.744261:0:60951:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:2.0:1773851894.744262:0:60951:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.744263:0:60951:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.744265:0:60951:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.744266:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851894.744266:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851894.744266:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2fd8ebc refcount=3
00000020:00000001:2.0:1773851894.744267:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:2.0:1773851894.744268:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00000004:00000040:2.0:1773851894.744268:0:60951:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000003ec9ddea : new locks_count 5
00000020:00000040:2.0:1773851894.744269:0:60951:0:(genops.c:871:class_export_get()) GET export 000000003ec9ddea refcount=11
00010000:00000001:2.0:1773851894.744270:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.744270:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851894.744270:0:60951:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851894.744271:0:60951:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:2.0:1773851894.744272:0:60951:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:2.0:1773851894.744272:0:60951:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:2.0:1773851894.744273:0:60951:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:2.0:1773851894.744273:0:60951:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:2.0:1773851894.744273:0:60951:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:2.0:1773851894.744274:0:60951:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:2.0:1773851894.744275:0:60951:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.744275:0:60951:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851894.744276:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:2.0:1773851894.744276:0:60951:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:2.0:1773851894.744277:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851894.744277:0:60951:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:2.0:1773851894.744278:0:60951:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:2.0:1773851894.744278:0:60951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851894.744279:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.744280:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.744280:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851894.744280:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851894.744281:0:60951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000009d396318 with handle 0x21b6f08f07a6adee from hash
00010000:00000001:2.0:1773851894.744282:0:60951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851894.744282:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.744282:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.744283:0:60951:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:2.0:1773851894.744283:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851894.744284:0:60951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6adee lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477f2 expref: 11 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744286:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:2.0:1773851894.744286:0:60951:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003ec9ddea : new locks_count 4
00000020:00000040:2.0:1773851894.744287:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 10
00010000:00000010:2.0:1773851894.744288:0:60951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000795a147f.
00010000:00000040:2.0:1773851894.744288:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:2.0:1773851894.744289:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.744289:0:60951:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.744290:0:60951:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:2.0:1773851894.744291:0:60951:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6adf5 lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477f2 expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.744293:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:2.0:1773851894.744294:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851894.744294:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851894.744294:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:2.0:1773851894.744295:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:2.0:1773851894.744296:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.744297:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.744297:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851894.744297:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.744298:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851894.744298:0:60951:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000b2fd8ebc, rc 0)
00000020:00000001:2.0:1773851894.744299:0:60951:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851894.744300:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183038203122, transno 0, xid 1859374548182528
00010000:00000001:2.0:1773851894.744301:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851894.744302:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aca48d4f x1859374548182528/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00010000:00000001:2.0:1773851894.744304:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851894.744305:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851894.744306:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851894.744307:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851894.744307:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:2.0:1773851894.744308:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:2.0:1773851894.744308:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851894.744309:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.744309:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851894.744310:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8211@kfi7
00000400:00000010:2.0:1773851894.744311:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002097cdda.
00000100:00000200:2.0:1773851894.744311:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859374548182528, offset 224
00000400:00000200:2.0:1773851894.744313:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8211@kfi7
00000400:00000200:2.0:1773851894.744313:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.744314:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 1
00000400:00000200:2.0:1773851894.744315:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:2.0:1773851894.744316:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000400:00000200:2.0:1773851894.744317:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8211@kfi7 local destination
00000400:00000200:2.0:1773851894.744318:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770135:8770135:1024:4294967295] 8211@kfi7 LPNI seq info [7629410:7629410:16:4294967295]
00000400:00000200:2.0:1773851894.744319:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000400:00000200:2.0:1773851894.744320:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.744322:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8211@kfi7(8211@kfi7:8211@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851894.744323:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 3
00000800:00000200:2.0:1773851894.744324:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.744325:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:2.0:1773851894.744328:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851894.744330:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Using peer 8211@kfi7(0x880)
00000800:00000200:2.0:1773851894.744333:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000894f0236: Posted send of 740 bytes to peer 0x880: rc=0
00000800:00000200:2.0:1773851894.744335:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851894.744336:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851894.744337:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:2.0:1773851894.744337:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851894.744338:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.744338:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851894.744339:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aca48d4f x1859374548182528/t0(0) o101->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1013-0'
00000100:00100000:2.0:1773851894.744342:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aca48d4f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:3f7a09dd-93e3-48df-8594-85e44391fba9+10:2511627:x1859374548182528:12345-8211@kfi7:101:default-tuolumne1013-0 Request processed in 796us (822us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851894.744344:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 408701486
00000100:00000040:2.0:1773851894.744345:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
00000100:00000001:2.0:1773851894.744346:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851894.744346:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851894.744347:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851894.744347:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a912de76.
00000020:00000010:2.0:1773851894.744348:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7ccc6d.
00000800:00000200:1.0:1773851894.744348:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 TN_EVENT_TX_OK event status 0
00000020:00000040:2.0:1773851894.744349:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 9
00000100:00000001:2.0:1773851894.744349:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851894.744350:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.744350:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8211@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.744351:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002097cdda
00000400:00000010:1.0:1773851894.744352:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002097cdda.
00000100:00000001:1.0:1773851894.744352:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.744353:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.744353:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001da8f848 nid 8211@kfi7 refs 2
00000800:00000200:1.0:1773851894.744354:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000894f0236: 2069@kfi7:0 -> 8211@kfi7(00000000f617f3f0):0x0 lsk 2177 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x880 Transaction freed
00000800:00000200:1.0:1773851894.744475:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.744476:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.744477:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.744479:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.744480:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.744481:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8402@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.744482:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.744483:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 1
00000400:00000200:1.0:1773851894.744483:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.744484:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000400:00000200:1.0:1773851894.744485:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000400:00000200:1.0:1773851894.744486:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8211@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.744486:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8211@kfi7 of length 328 into portal 17 MB=0x69b175f72e680
00000400:00000200:1.0:1773851894.744487:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8211@kfi7 of length 328/328 into md 0x7fb60e481 [2] + 984
00000800:00000200:1.0:1773851894.744489:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.744491:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.744492:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8402@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.744493:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.744494:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:1.0:1773851894.744494:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003fd3da61.
00000100:00000040:1.0:1773851894.744495:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000003fd3da61 x1859374548182656 msgsize 328
00000100:00100000:1.0:1773851894.744496:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8211@kfi7 (source: 12345-8402@kfi7)
00000100:00000001:1.0:1773851894.744496:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.744497:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000800:00000200:1.0:1773851894.744498:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851894.744498:0:61144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.744498:0:61144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.744498:0:61144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.744499:0:61144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.744500:0:61144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.744501:0:61144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374548182656
00000020:00000001:0.0:1773851894.744501:0:61144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.744502:0:61144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90d4b
00000020:00000001:0.0:1773851894.744502:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.744503:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003ec9ddea refcount=10
00000020:00000001:0.0:1773851894.744503:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000020:00000001:0.0:1773851894.744504:0:61144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239481344 : -107152470070272 : ffff9e8b9f15ac00)
00000100:00000001:0.0:1773851894.744505:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.744505:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.744506:0:61144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851894.744507:0:61144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.744507:0:61144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000040:0.0:1773851894.744508:0:61144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:0.0:1773851894.744508:0:61144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.744509:0:61144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:0.0:1773851894.744509:0:61144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:0.0:1773851894.744510:0:61144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.744511:0:61144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:0.0:1773851894.744511:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.744511:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.744512:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2fd8ebc refcount=3
00000020:00000001:0.0:1773851894.744512:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:0.0:1773851894.744513:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:0.0:1773851894.744514:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.744514:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.744515:0:61144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.744515:0:61144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.744516:0:61144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.744517:0:61144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.744518:0:61144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851894.744519:0:82951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851894.744519:0:82951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.744519:0:61144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:3.0:1773851894.744520:0:82951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.744520:0:61144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8211@kfi7, seq: 45419466
00000100:00000040:0.0:1773851894.744520:0:61144:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003ec9ddea : new rpc_count 1
00000100:00000001:3.0:1773851894.744521:0:82951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.744521:0:61144:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637125525730560 : -106948183821056 : ffff9ebb2f7e7500)
00000100:00000040:0.0:1773851894.744522:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003fd3da61 x1859374548182656/t0(0) o103->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:0.0:1773851894.744524:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.744525:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.744525:0:61144:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003fd3da61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3f7a09dd-93e3-48df-8594-85e44391fba9+10:39753:x1859374548182656:12345-8211@kfi7:103:
00000100:00000200:0.0:1773851894.744527:0:61144:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374548182656
00010000:00000001:0.0:1773851894.744527:0:61144:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:0.0:1773851894.744527:0:61144:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:0.0:1773851894.744528:0:61144:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:0.0:1773851894.744528:0:61144:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.744529:0:61144:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.744529:0:61144:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000143688d9.
02000000:00000001:0.0:1773851894.744530:0:61144:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.744531:0:61144:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.744531:0:61144:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:0.0:1773851894.744531:0:61144:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:0.0:1773851894.744532:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.744532:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.744533:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000b2fd8ebc refcount=3
00000020:00000001:0.0:1773851894.744533:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000001:0.0:1773851894.744534:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951961664 : -106906757589952 : ffff9ec4d4b09440)
00010000:00000040:0.0:1773851894.744535:0:61144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00000004:00000001:0.0:1773851894.744535:0:61144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:0.0:1773851894.744535:0:61144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:0.0:1773851894.744537:0:61144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.744537:0:61144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.744537:0:61144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.744538:0:61144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.744539:0:61144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851894.744539:0:61144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.744540:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.744540:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.744541:0:61144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.744541:0:61144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.744542:0:61144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000b2fd8ebc with handle 0x21b6f08f07a6adf5 from hash
00010000:00000001:0.0:1773851894.744543:0:61144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.744543:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.744543:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.744544:0:61144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.744544:0:61144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.744544:0:61144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.744545:0:61144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851894.744545:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.744546:0:61144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2fd8ebc/0x21b6f08f07a6adf5 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86477f2 expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.744549:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.744549:0:61144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003ec9ddea : new locks_count 3
00000020:00000040:0.0:1773851894.744550:0:61144:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 9
00010000:00000010:0.0:1773851894.744550:0:61144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000026012d57.
00010000:00000040:0.0:1773851894.744551:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:0.0:1773851894.744551:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.744552:0:61144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.744552:0:61144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.744553:0:61144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:0.0:1773851894.744554:0:61144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.744554:0:61144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.744555:0:61144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:0.0:1773851894.744555:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00010000:0.0:1773851894.744556:0:61144:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:0.0:1773851894.744557:0:61144:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.744558:0:61144:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.744558:0:61144:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.744559:0:61144:0:(import.c:1951:at_measured()) add 1 to 00000000fe6e7196 time=148 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851894.744560:0:61144:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.744560:0:61144:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bbc37fc0 refcount 3 to 8211@kfi7
00000100:00000001:0.0:1773851894.744561:0:61144:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530572320 : -107154178979296 : ffff9e8b3939ca20)
02000000:00000001:0.0:1773851894.744561:0:61144:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.744562:0:61144:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.744562:0:61144:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.744563:0:61144:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8402@kfi7
00000400:00000010:0.0:1773851894.744563:0:61144:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000487f5112.
00000100:00000200:0.0:1773851894.744564:0:61144:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859374548182656, offset 224
00000400:00000200:0.0:1773851894.744565:0:61144:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8402@kfi7
00000400:00000200:0.0:1773851894.744566:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.744566:0:61144:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 1
00000400:00000200:0.0:1773851894.744567:0:61144:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000400:00000200:0.0:1773851894.744568:0:61144:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000400:00000200:0.0:1773851894.744569:0:61144:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8402@kfi7 local destination
00000400:00000200:0.0:1773851894.744571:0:61144:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770136:8770136:1024:4294967295] 8402@kfi7 LPNI seq info [7629411:7629411:16:4294967295]
00000400:00000200:0.0:1773851894.744572:0:61144:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000400:00000200:0.0:1773851894.744572:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8402@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.744574:0:61144:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8402@kfi7(8402@kfi7:8402@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.744575:0:61144:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 3
00000800:00000200:0.0:1773851894.744576:0:61144:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.744577:0:61144:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851894.744579:0:61144:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.744581:0:61144:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f Using peer 8402@kfi7(0x10000000000052f)
00000800:00000200:0.0:1773851894.744584:0:61144:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x10000000000052f: rc=0
00000800:00000200:0.0:1773851894.744588:0:61144:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.744590:0:61144:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.744591:0:61144:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bbc37fc0 refcount 2 to 8211@kfi7
00010000:00000001:0.0:1773851894.744591:0:61144:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.744592:0:61144:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.744594:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003fd3da61 x1859374548182656/t0(0) o103->3f7a09dd-93e3-48df-8594-85e44391fba9@8211@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:0.0:1773851894.744597:0:61144:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003fd3da61 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:3f7a09dd-93e3-48df-8594-85e44391fba9+9:39753:x1859374548182656:12345-8211@kfi7:103: Request processed in 72us (101us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.744599:0:61144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8211@kfi7, seq: 45419466
00000100:00000040:0.0:1773851894.744600:0:61144:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003ec9ddea : new rpc_count 0
00000100:00000001:0.0:1773851894.744600:0:61144:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.744601:0:61144:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.744601:0:61144:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.744602:0:61144:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851894.744602:0:61144:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851894.744603:0:61144:0:(genops.c:882:class_export_put()) PUTting export 000000003ec9ddea : new refcount 8
00000100:00000001:0.0:1773851894.744604:0:61144:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851894.744609:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851894.744610:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851894.744611:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8402@kfi7: PUT: OK
00000400:00000200:2.0:1773851894.744612:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000487f5112
00000400:00000010:2.0:1773851894.744612:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000487f5112.
00000100:00000001:2.0:1773851894.744613:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851894.744614:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851894.744615:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007750f90 nid 8402@kfi7 refs 2
00000800:00000200:2.0:1773851894.744616:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 8402@kfi7(00000000fa268acc):0x0 lsk 1328 rsk 46 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000052f Transaction freed
00010000:00000010:0.1:1773851894.745727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d243d8b7.
00010000:00000010:2.1F:1773851894.749727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000009d396318.
00010000:00000010:0.1:1773851894.749727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000fb94df81.
00010000:00000010:0.1:1773851894.749728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000097d489dd.
00010000:00000010:0.1:1773851894.749729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000003f515ee2.
00010000:00000010:0.1:1773851894.749730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000008ce5b96.
00010000:00000010:0.1:1773851894.749731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000ec279978.
00010000:00000010:0.1:1773851894.749731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c346e481.
00010000:00000010:0.1:1773851894.753728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000b2fd8ebc.
00000800:00000200:9.0:1773851894.766646:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851894.766647:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851894.766648:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851894.766651:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851894.766653:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10403@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.766654:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10403@kfi7 : PUT - for me
00000400:00000200:9.0:1773851894.766655:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10403@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.766656:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000550264aa nid 10403@kfi7 refs 1
00000400:00000200:9.0:1773851894.766657:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10403@kfi7 to cpt 2
00000400:00000200:9.0:1773851894.766658:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000550264aa nid 10403@kfi7 refs 2
00000400:00000200:9.0:1773851894.766659:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000550264aa nid 10403@kfi7 refs 3
00000400:00000200:9.0:1773851894.766660:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10339@kfi7 to cpt 7
00000400:00000200:9.0:1773851894.766660:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10339@kfi7 of length 224 into portal 12 MB=0x69b80b4256fc0
00000400:00000200:9.0:1773851894.766662:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10339@kfi7 of length 224/224 into md 0x78146ce49 [64] + 159456
00000800:00000200:9.0:1773851894.766664:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851894.766665:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851894.766666:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10403@kfi7: PUT: OK
00000100:00000001:9.0:1773851894.766667:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851894.766668:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851894.766669:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000887840d2.
00000100:00000040:9.0:1773851894.766669:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000887840d2 x1859826940735424 msgsize 224
00000100:00100000:9.0:1773851894.766671:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10339@kfi7 (source: 12345-10403@kfi7)
00000100:00000001:9.0:1773851894.766672:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851894.766673:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000550264aa nid 10403@kfi7 refs 2
00000800:00000200:9.0:1773851894.766674:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851894.766675:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851894.766676:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851894.766677:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851894.766677:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851894.766679:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851894.766680:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859826940735424
00000020:00000001:8.0:1773851894.766681:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851894.766682:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f086fcb66107
00000020:00000001:8.0:1773851894.766683:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851894.766687:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000039c8e7d3 refcount=5
00000020:00000001:8.0:1773851894.766689:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636978827701248 : -107094881850368 : ffff9e99079c2c00)
00000020:00000001:8.0:1773851894.766690:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636978827701248 : -107094881850368 : ffff9e99079c2c00)
00000100:00000001:8.0:1773851894.766692:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851894.766693:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851894.766694:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7e7683.
00000020:00000010:8.0:1773851894.766696:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851894.766697:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f524493c.
00000100:00000001:8.0:1773851894.766699:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851894.766700:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851894.766701:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851894.766702:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851894.766703:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851894.766704:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.766706:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851894.766707:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851894.766708:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851894.766708:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851894.766708:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851894.766709:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10339@kfi7, seq: 2130865
00000100:00000040:11.0:1773851894.766710:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000039c8e7d3 : new rpc_count 1
00000100:00000001:11.0:1773851894.766710:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609061632 : -107064100489984 : ffff9ea032527500)
00000100:00000001:8.0:1773851894.766710:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851894.766711:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851894.766712:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000887840d2 x1859826940735424/t0(0) o400->63373cbf-5abf-433e-991e-7d454c8488e8@10339@kfi7:682/0 lens 224/0 e 0 to 0 dl 1773852042 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1132-0'
00000100:00000001:11.0:1773851894.766717:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851894.766718:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851894.766719:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000887840d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:63373cbf-5abf-433e-991e-7d454c8488e8+5:39571:x1859826940735424:12345-10339@kfi7:400:default-tuolumne1132-0
00000100:00000200:11.0:1773851894.766720:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859826940735424
00000020:00000001:11.0:1773851894.766721:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851894.766721:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851894.766722:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851894.766723:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851894.766723:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851894.766724:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851894.766729:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859826940735424, found 0 last_xid 1859826940735423
00000020:00000001:11.0:1773851894.766729:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851894.766730:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851894.766730:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851894.766731:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851894.766732:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851894.766732:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851894.766733:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851894.766733:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e17f60bc.
02000000:00000001:11.0:1773851894.766734:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851894.766735:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851894.766735:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851894.766736:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691703, transno 0, xid 1859826940735424
00010000:00000001:11.0:1773851894.766737:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851894.766737:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000887840d2 x1859826940735424/t0(0) o400->63373cbf-5abf-433e-991e-7d454c8488e8@10339@kfi7:682/0 lens 224/224 e 0 to 0 dl 1773852042 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1132-0'
00010000:00000001:11.0:1773851894.766740:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851894.766740:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851894.766741:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=127 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851894.766742:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851894.766743:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000083b2df2d refcount 3 to 10339@kfi7
00000100:00000001:11.0:1773851894.766743:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212576 : -107155106339040 : ffff9e8b01f36720)
02000000:00000001:11.0:1773851894.766744:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851894.766745:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851894.766745:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851894.766746:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10403@kfi7
00000400:00000010:11.0:1773851894.766747:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2b33615.
00000100:00000200:11.0:1773851894.766747:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859826940735424, offset 224
00000400:00000200:11.0:1773851894.766749:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10403@kfi7
00000400:00000200:11.0:1773851894.766750:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10403@kfi7 to cpt 2
00000400:00000200:11.0:1773851894.766750:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000550264aa nid 10403@kfi7 refs 1
00000400:00000200:11.0:1773851894.766751:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000550264aa nid 10403@kfi7 refs 2
00000400:00000200:11.0:1773851894.766752:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000550264aa nid 10403@kfi7 refs 3
00000400:00000200:11.0:1773851894.766754:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10403@kfi7 local destination
00000400:00000200:11.0:1773851894.766755:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770137:8770137:1024:4294967295] 10403@kfi7 LPNI seq info [535290:535290:16:4294967295]
00000400:00000200:11.0:1773851894.766756:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000550264aa nid 10403@kfi7 refs 2
00000400:00000200:11.0:1773851894.766757:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10403@kfi7 to cpt 2
00000400:00000200:11.0:1773851894.766759:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10403@kfi7(10403@kfi7:10403@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851894.766760:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000550264aa nid 10403@kfi7 refs 3
00000800:00000200:11.0:1773851894.766762:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851894.766763:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851894.766765:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851894.766767:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf30 Using peer 10403@kfi7(0xf30)
00000800:00000200:11.0:1773851894.766770:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0xf30: rc=0
00000800:00000200:11.0:1773851894.766771:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf30 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851894.766773:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851894.766774:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000083b2df2d refcount 2 to 10339@kfi7
00010000:00000001:11.0:1773851894.766774:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851894.766775:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851894.766775:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851894.766776:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000887840d2 x1859826940735424/t0(0) o400->63373cbf-5abf-433e-991e-7d454c8488e8@10339@kfi7:682/0 lens 224/224 e 0 to 0 dl 1773852042 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1132-0'
00000100:00100000:11.0:1773851894.766779:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000887840d2 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:63373cbf-5abf-433e-991e-7d454c8488e8+5:39571:x1859826940735424:12345-10339@kfi7:400:default-tuolumne1132-0 Request processed in 61us (108us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851894.766781:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10339@kfi7, seq: 2130865
00000100:00000040:11.0:1773851894.766782:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000039c8e7d3 : new rpc_count 0
00000100:00000001:11.0:1773851894.766783:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851894.766783:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851894.766784:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:11.0:1773851894.766785:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f524493c.
00000800:00000200:9.0:1773851894.766785:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf30 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851894.766786:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7e7683.
00000020:00000040:11.0:1773851894.766786:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000039c8e7d3 : new refcount 4
00000100:00000001:11.0:1773851894.766787:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851894.766787:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851894.766788:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10403@kfi7: PUT: OK
00000400:00000200:9.0:1773851894.766788:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2b33615
00000400:00000010:9.0:1773851894.766789:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2b33615.
00000100:00000001:9.0:1773851894.766790:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851894.766790:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851894.766791:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000550264aa nid 10403@kfi7 refs 2
00000800:00000200:9.0:1773851894.766793:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 10403@kfi7(00000000c289e90b):0x0 lsk 3889 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf30 Transaction freed
00000800:00000200:17.0:1773851894.779048:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851894.779049:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851894.779050:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851894.779052:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851894.779054:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24512@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.779055:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24512@kfi7 : PUT - for me
00000400:00000200:17.0:1773851894.779056:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24512@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.779057:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923cd255 nid 24512@kfi7 refs 1
00000400:00000200:17.0:1773851894.779058:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24512@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.779058:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923cd255 nid 24512@kfi7 refs 2
00000400:00000200:17.0:1773851894.779059:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923cd255 nid 24512@kfi7 refs 3
00000400:00000200:17.0:1773851894.779060:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24320@kfi7 to cpt 1
00000400:00000200:17.0:1773851894.779061:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24320@kfi7 of length 224 into portal 12 MB=0x699e1953ae640
00000400:00000200:17.0:1773851894.779062:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24320@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 42976
00000800:00000200:17.0:1773851894.779064:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851894.779066:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851894.779067:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24512@kfi7: PUT: OK
00000100:00000001:17.0:1773851894.779068:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851894.779068:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851894.779070:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bfac1a4d.
00000100:00000040:17.0:1773851894.779071:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bfac1a4d x1858044010620480 msgsize 224
00000100:00100000:17.0:1773851894.779072:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-24320@kfi7 (source: 12345-24512@kfi7)
00000100:00000001:17.0:1773851894.779074:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851894.779075:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923cd255 nid 24512@kfi7 refs 2
00000800:00000200:17.0:1773851894.779076:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a67d66ae: 2054@kfi7:4 <- 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851894.779079:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851894.779079:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851894.779080:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851894.779080:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851894.779081:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851894.779082:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044010620480
00000020:00000001:17.0:1773851894.779082:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851894.779083:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ab7
00000020:00000001:17.0:1773851894.779084:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851894.779086:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000012c1c193 refcount=6
00000020:00000001:17.0:1773851894.779086:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743451648 : -107128966099968 : ffff9e911807cc00)
00000020:00000001:17.0:1773851894.779087:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743451648 : -107128966099968 : ffff9e911807cc00)
00000100:00000001:17.0:1773851894.779088:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851894.779089:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851894.779090:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005b4be0ac.
00000020:00000010:17.0:1773851894.779091:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851894.779092:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851894.779093:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851894.779093:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851894.779094:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851894.779095:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851894.779095:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851894.779096:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851894.779097:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851894.779098:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851894.779098:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851894.779098:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:17.0:1773851894.779099:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24320@kfi7, seq: 2156420
00000100:00000001:16.0:1773851894.779099:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:17.0:1773851894.779100:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000012c1c193 : new rpc_count 1
00000100:00000001:16.0:1773851894.779100:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851894.779101:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968756608 : -106974740795008 : ffff9eb500933180)
00000100:00000001:16.0:1773851894.779101:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851894.779102:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bfac1a4d x1858044010620480/t0(0) o400->83e66b7d-cb8f-49d7-b2d2-fa87907d8e4b@24320@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2019-0'
00000100:00000001:17.0:1773851894.779105:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851894.779105:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851894.779107:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfac1a4d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:83e66b7d-cb8f-49d7-b2d2-fa87907d8e4b+6:39647:x1858044010620480:12345-24320@kfi7:400:default-tuolumne2019-0
00000100:00000200:17.0:1773851894.779108:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044010620480
00000020:00000001:17.0:1773851894.779109:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851894.779109:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851894.779110:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.779111:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851894.779111:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851894.779112:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851894.779113:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044010620480, found 0 last_xid 1858044010620479
00000020:00000001:17.0:1773851894.779113:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851894.779114:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851894.779115:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851894.779115:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.779116:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851894.779116:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851894.779117:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851894.779118:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000034c98aa0.
02000000:00000001:17.0:1773851894.779118:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851894.779119:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.779120:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851894.779120:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044160140, transno 0, xid 1858044010620480
00010000:00000001:17.0:1773851894.779121:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851894.779122:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bfac1a4d x1858044010620480/t0(0) o400->83e66b7d-cb8f-49d7-b2d2-fa87907d8e4b@24320@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2019-0'
00010000:00000001:17.0:1773851894.779124:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851894.779125:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851894.779126:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=127 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851894.779130:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851894.779131:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000053dc094 refcount 3 to 24320@kfi7
00000100:00000001:17.0:1773851894.779131:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702976 : -107156155848640 : ffff9e8ac3652840)
02000000:00000001:17.0:1773851894.779132:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851894.779133:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851894.779133:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851894.779134:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24512@kfi7
00000400:00000010:17.0:1773851894.779135:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089702b40.
00000100:00000200:17.0:1773851894.779136:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044010620480, offset 224
00000400:00000200:17.0:1773851894.779137:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24512@kfi7
00000400:00000200:17.0:1773851894.779138:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24512@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.779139:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923cd255 nid 24512@kfi7 refs 1
00000400:00000200:17.0:1773851894.779139:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923cd255 nid 24512@kfi7 refs 2
00000400:00000200:17.0:1773851894.779141:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923cd255 nid 24512@kfi7 refs 3
00000400:00000200:17.0:1773851894.779142:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24512@kfi7 local destination
00000400:00000200:17.0:1773851894.779143:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770138:8770138:1024:4294967295] 24512@kfi7 LPNI seq info [8511949:8511949:16:4294967295]
00000400:00000200:17.0:1773851894.779144:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923cd255 nid 24512@kfi7 refs 2
00000400:00000200:17.0:1773851894.779145:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24512@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.779147:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24512@kfi7(24512@kfi7:24512@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851894.779148:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923cd255 nid 24512@kfi7 refs 3
00000800:00000200:17.0:1773851894.779149:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851894.779150:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851894.779152:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851894.779154:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fce Using peer 24512@kfi7(0x100000000000fce)
00000800:00000200:17.0:1773851894.779157:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000a67d66ae: Posted send of 324 bytes to peer 0x100000000000fce: rc=0
00000800:00000200:17.0:1773851894.779159:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851894.779162:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851894.779163:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000053dc094 refcount 2 to 24320@kfi7
00010000:00000001:17.0:1773851894.779164:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851894.779164:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851894.779165:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851894.779166:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bfac1a4d x1858044010620480/t0(0) o400->83e66b7d-cb8f-49d7-b2d2-fa87907d8e4b@24320@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2019-0'
00000100:00100000:17.0:1773851894.779169:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfac1a4d pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:83e66b7d-cb8f-49d7-b2d2-fa87907d8e4b+6:39647:x1858044010620480:12345-24320@kfi7:400:default-tuolumne2019-0 Request processed in 63us (97us total) trans 0 rc 0/0
00000800:00000200:19.0:1773851894.779171:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fce TN_EVENT_TX_OK event status 0
00000100:00100000:17.0:1773851894.779171:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24320@kfi7, seq: 2156420
00000100:00000040:17.0:1773851894.779172:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000012c1c193 : new rpc_count 0
00000100:00000001:17.0:1773851894.779172:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:19.0:1773851894.779173:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851894.779173:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851894.779173:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:19.0:1773851894.779174:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24512@kfi7: PUT: OK
00000020:00000010:17.0:1773851894.779174:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000400:00000200:19.0:1773851894.779175:0:2464491:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089702b40
00000400:00000010:19.0:1773851894.779175:0:2464491:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089702b40.
00000020:00000010:17.0:1773851894.779175:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005b4be0ac.
00000100:00000001:19.0:1773851894.779176:0:2464491:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851894.779176:0:2464491:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:17.0:1773851894.779176:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000012c1c193 : new refcount 5
00000100:00000001:17.0:1773851894.779176:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851894.779177:0:2464491:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923cd255 nid 24512@kfi7 refs 2
00000800:00000200:19.0:1773851894.779179:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a67d66ae: 2054@kfi7:4 -> 24512@kfi7(00000000a4ffc09c):0x0 lsk 4047 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fce Transaction freed
00000800:00000200:1.0:1773851894.785116:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.785117:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.785118:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.785120:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.785122:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.785123:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8643@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.785124:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.785125:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:1.0:1773851894.785125:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.785126:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:1.0:1773851894.785127:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:1.0:1773851894.785128:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8642@kfi7 to cpt 5
00000400:00000200:1.0:1773851894.785129:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8642@kfi7 of length 576 into portal 12 MB=0x69b2fcca1f3c0
00000400:00000200:1.0:1773851894.785130:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8642@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 49704
00000800:00000200:1.0:1773851894.785131:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.785133:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.785134:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8643@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.785135:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.785136:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.785137:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007aa8e956.
00000100:00000040:1.0:1773851894.785138:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007aa8e956 x1859479459197888 msgsize 576
00000100:00100000:1.0:1773851894.785139:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8642@kfi7 (source: 12345-8643@kfi7)
00000100:00000001:1.0:1773851894.785140:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.785141:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000800:00000200:1.0:1773851894.785142:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851894.785143:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851894.785144:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851894.785145:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851894.785146:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.785147:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851894.785149:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479459197888
00000020:00000001:2.0:1773851894.785150:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851894.785150:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2dc17
00000020:00000001:2.0:1773851894.785151:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851894.785154:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c985270 refcount=8
00000020:00000001:2.0:1773851894.785155:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000020:00000001:2.0:1773851894.785156:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000100:00000001:2.0:1773851894.785158:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851894.785159:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851894.785160:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7ccc6d.
00000020:00000010:2.0:1773851894.785162:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851894.785163:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a912de76.
00000100:00000001:2.0:1773851894.785165:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851894.785166:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:2.0:1773851894.785166:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:2.0:1773851894.785167:0:60951:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.785168:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.785170:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.785172:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.785174:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.785175:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.785175:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.785175:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851894.785177:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8642@kfi7, seq: 408701487
00000100:00000040:2.0:1773851894.785178:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c985270 : new rpc_count 1
00000100:00000001:0.0:1773851894.785178:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.785179:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052761216 : -106991656790400 : ffff9eb1104d9680)
00000100:00000001:0.0:1773851894.785179:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851894.785181:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007aa8e956 x1859479459197888/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 576/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1031-0'
00000100:00000001:2.0:1773851894.785187:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851894.785188:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851894.785189:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007aa8e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:1699123:x1859479459197888:12345-8642@kfi7:101:default-tuolumne1031-0
00000100:00000200:2.0:1773851894.785192:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479459197888
00000020:00000001:2.0:1773851894.785193:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851894.785194:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851894.785195:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.785196:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851894.785197:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:2.0:1773851894.785199:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851894.785200:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479459197888, found 0 last_xid 1859479459197887
00000020:00000001:2.0:1773851894.785201:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851894.785202:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851894.785203:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851894.785204:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.785206:0:60951:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:2.0:1773851894.785206:0:60951:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:2.0:1773851894.785207:0:60951:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:2.0:1773851894.785208:0:60951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:2.0:1773851894.785209:0:60951:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.785212:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851894.785213:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 194
00010000:00000001:2.0:1773851894.785214:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851894.785215:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851894.785216:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000009d396318.
00000020:00000001:2.0:1773851894.785217:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851894.785218:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 000000009d396318 with handle 0x21b6f08f07a6adfc to hash
00000020:00000001:2.0:1773851894.785219:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851894.785220:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00000010:2.0:1773851894.785221:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000795a147f.
00010000:00000001:2.0:1773851894.785222:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637166951958784 : -106906757592832 : ffff9ec4d4b08900)
00010000:00010000:2.0:1773851894.785224:0:60951:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6adfc lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea34c370deef0e3c expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785229:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:2.0:1773851894.785230:0:60951:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000000c985270 : new locks_count 4
00000020:00000040:2.0:1773851894.785231:0:60951:0:(genops.c:871:class_export_get()) GET export 000000000c985270 refcount=9
00010000:00000001:2.0:1773851894.785234:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:2.0:1773851894.785234:0:60951:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:2.0:1773851894.785236:0:60951:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:2.0:1773851894.785237:0:60951:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:2.0:1773851894.785237:0:60951:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:2.0:1773851894.785238:0:60951:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:2.0:1773851894.785239:0:60951:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:2.0:1773851894.785240:0:60951:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:2.0:1773851894.785241:0:60951:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:2.0:1773851894.785242:0:60951:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:2.0:1773851894.785243:0:60951:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.785245:0:60951:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:2.0:1773851894.785245:0:60951:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:2.0:1773851894.785246:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851894.785247:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851894.785250:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 0000000009af60f7.
02000000:00000001:2.0:1773851894.785251:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.785252:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.785253:0:60951:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.785254:0:60951:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:2.0:1773851894.785255:0:60951:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:2.0:1773851894.785255:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.785256:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.785257:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.785258:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.785259:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.785260:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.785260:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.785261:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.785262:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.785262:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.785267:0:60951:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:2.0:1773851894.785268:0:60951:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:2.0:1773851894.785269:0:60951:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:2.0:1773851894.785270:0:60951:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.785271:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.785272:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.785273:0:60951:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:2.0:1773851894.785273:0:60951:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.785274:0:60951:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:2.0:1773851894.785275:0:60951:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 0000000061f8a73a
00000004:00000001:2.0:1773851894.785276:0:60951:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:2.0:1773851894.785277:0:60951:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:2.0:1773851894.785278:0:60951:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:2.0:1773851894.785279:0:60951:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:2.0:1773851894.785280:0:60951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:2.0:1773851894.785281:0:60951:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851894.785282:0:60951:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:2.0:1773851894.785283:0:60951:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000820c7d0d.
00000020:00000001:2.0:1773851894.785284:0:60951:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:2.0:1773851894.785285:0:60951:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000820c7d0d with handle 0x21b6f08f07a6ae03 to hash
00000020:00000001:2.0:1773851894.785286:0:60951:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:2.0:1773851894.785287:0:60951:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000010:2.0:1773851894.785288:0:60951:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a1f16a1c.
00010000:00000001:2.0:1773851894.785289:0:60951:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000001:2.0:1773851894.785291:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851894.785292:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851894.785293:0:60951:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000820c7d0d/0x21b6f08f07a6ae03 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785297:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:2.0:1773851894.785298:0:60951:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:2.0:1773851894.785299:0:60951:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:2.0:1773851894.785300:0:60951:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:2.0:1773851894.785301:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851894.785302:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.785303:0:60951:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:2.0:1773851894.785304:0:60951:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.785305:0:60951:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:2.0:1773851894.785306:0:60951:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:2.0:1773851894.785307:0:60951:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:2.0:1773851894.785307:0:60951:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:2.0:1773851894.785308:0:60951:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 195
00010000:00000040:2.0:1773851894.785310:0:60951:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:2.0:1773851894.785312:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785316:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785318:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785322:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785324:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785328:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785329:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785333:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785334:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785338:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785340:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785343:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785345:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785349:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785351:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785354:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785356:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785360:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785361:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785365:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785366:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785370:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785371:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785375:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785377:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785381:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785383:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785386:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785388:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785392:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785393:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785397:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785398:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785402:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785404:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785407:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785408:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785412:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785413:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785417:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785418:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785422:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785423:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785427:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785439:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785443:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785444:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785447:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785449:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785452:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785454:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785457:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785459:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785462:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785464:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785467:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785469:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785473:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785474:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785478:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785481:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785485:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785486:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785490:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785492:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785496:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785497:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785501:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785503:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785507:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785508:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785513:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785514:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785518:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785520:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785524:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785526:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785530:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785531:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785535:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785537:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785541:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785542:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785546:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785548:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785552:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785553:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785555:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785556:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785559:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785560:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785563:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785564:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785567:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785568:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785570:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785571:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785574:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785575:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785577:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785578:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785581:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785582:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785584:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785585:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785588:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785589:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785591:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785593:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785596:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785597:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785600:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785601:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785603:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785604:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785607:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785608:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785610:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785611:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785613:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785614:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785617:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785618:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785620:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785622:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785625:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785626:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785629:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785630:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785632:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785633:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785636:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785637:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785639:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785640:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785642:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785643:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785646:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785647:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785649:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785651:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785653:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785654:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785657:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785658:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785660:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785661:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785664:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785664:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785667:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785668:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785670:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785671:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785673:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785674:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785677:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785678:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785680:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785681:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785683:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785684:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785686:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785687:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785689:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785689:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785691:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785692:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785694:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785695:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785697:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785698:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785700:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785701:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785703:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785704:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785706:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785707:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785709:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785710:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785712:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785712:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785715:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785715:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785717:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785718:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785720:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785721:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785723:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785727:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785729:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785730:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785732:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785733:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785735:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785736:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785738:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785739:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785741:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785742:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785744:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785745:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785747:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785748:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785750:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785751:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785753:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785754:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785756:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785757:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785759:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785760:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785762:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785763:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785765:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785766:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785768:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785769:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785771:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785772:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785774:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785775:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785777:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785778:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785780:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785781:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785783:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785784:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785786:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785786:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785788:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785789:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785791:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785792:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785794:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785795:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785797:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785798:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785801:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785801:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785803:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785804:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785806:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785807:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785809:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785809:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785812:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785812:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785814:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785815:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785817:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785818:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785820:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785821:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785823:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785824:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785826:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785827:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785829:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785830:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785832:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785833:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785835:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785835:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785837:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785838:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785840:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785841:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785843:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785844:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785847:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785848:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785850:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785851:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785853:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785854:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785856:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785856:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785859:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785859:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785861:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785862:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785864:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785865:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785867:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785870:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785872:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785873:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785875:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785876:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785878:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785879:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785881:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785882:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785884:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785885:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785887:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785888:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785890:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785890:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785892:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785894:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785896:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785897:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785899:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785900:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785903:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785903:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785906:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785906:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785909:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785910:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785911:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785912:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785914:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785915:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785917:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785919:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785921:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785921:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785923:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785924:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785926:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785927:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785929:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785930:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785932:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785932:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785934:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785935:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785937:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785938:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785940:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785941:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785943:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785944:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785946:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785947:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785949:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785950:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785952:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785953:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785955:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785955:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785958:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785958:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785960:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785961:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785963:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785964:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785966:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785967:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785969:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785970:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785972:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785973:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785975:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785975:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785977:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785978:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785980:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785981:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785983:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785984:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785986:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785986:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785989:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785990:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785992:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785992:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785995:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785995:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.785997:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.785998:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786000:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.786001:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786003:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.786003:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786005:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.786006:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786008:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.786009:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786011:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.786012:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786014:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.786015:0:60951:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786017:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:2.0:1773851894.786018:0:60951:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000820c7d0d/0x21b6f08f07a6ae03 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786020:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:2.0:1773851894.786020:0:60951:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:2.0:1773851894.786021:0:60951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.786021:0:60951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.786022:0:60951:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:2.0:1773851894.786022:0:60951:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.786023:0:60951:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.786023:0:60951:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:2.0:1773851894.786024:0:60951:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:2.0:1773851894.786024:0:60951:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:2.0:1773851894.786025:0:60951:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000820c7d0d/0x21b6f08f07a6ae03 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786027:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:2.0:1773851894.786028:0:60951:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:2.0:1773851894.786028:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.786029:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.786029:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851894.786029:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851894.786030:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000820c7d0d refcount=3
00000020:00000001:2.0:1773851894.786031:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000001:2.0:1773851894.786031:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000001:2.0:1773851894.786032:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.786033:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851894.786033:0:60951:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.786033:0:60951:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.786034:0:60951:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:2.0:1773851894.786035:0:60951:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:2.0:1773851894.786036:0:60951:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:2.0:1773851894.786038:0:60951:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.786039:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851894.786039:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.786040:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.786041:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786042:0:60951:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786042:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786043:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851894.786043:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.786044:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.786044:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786045:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786045:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:2.0:1773851894.786046:0:60951:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:2.0:1773851894.786047:0:60951:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.786047:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.786048:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.786048:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.786049:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:2.0:1773851894.786049:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.786050:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:2.0:1773851894.786050:0:60951:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:2.0:1773851894.786051:0:60951:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:2.0:1773851894.786051:0:60951:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:2.0:1773851894.786052:0:60951:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:2.0:1773851894.786053:0:60951:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:2.0:1773851894.786054:0:60951:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:2.0:1773851894.786054:0:60951:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:2.0:1773851894.786055:0:60951:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.786055:0:60951:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:2.0:1773851894.786056:0:60951:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:2.0:1773851894.786056:0:60951:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.786056:0:60951:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:2.0:1773851894.786057:0:60951:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786057:0:60951:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786058:0:60951:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:2.0:1773851894.786058:0:60951:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.786060:0:60951:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:2.0:1773851894.786062:0:60951:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.786063:0:60951:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.786064:0:60951:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.786065:0:60951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:2.0:1773851894.786065:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851894.786066:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000820c7d0d refcount=3
00000020:00000001:2.0:1773851894.786066:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000001:2.0:1773851894.786067:0:60951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00000004:00000040:2.0:1773851894.786068:0:60951:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000000c985270 : new locks_count 5
00000020:00000040:2.0:1773851894.786068:0:60951:0:(genops.c:871:class_export_get()) GET export 000000000c985270 refcount=10
00010000:00000001:2.0:1773851894.786069:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.786069:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:2.0:1773851894.786070:0:60951:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851894.786070:0:60951:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:2.0:1773851894.786071:0:60951:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:2.0:1773851894.786071:0:60951:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:2.0:1773851894.786072:0:60951:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:2.0:1773851894.786072:0:60951:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:2.0:1773851894.786072:0:60951:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:2.0:1773851894.786073:0:60951:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:2.0:1773851894.786073:0:60951:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851894.786074:0:60951:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:2.0:1773851894.786075:0:60951:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:2.0:1773851894.786075:0:60951:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:2.0:1773851894.786076:0:60951:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:2.0:1773851894.786076:0:60951:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:2.0:1773851894.786077:0:60951:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:2.0:1773851894.786078:0:60951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:2.0:1773851894.786078:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.786078:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.786079:0:60951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:2.0:1773851894.786079:0:60951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:2.0:1773851894.786080:0:60951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000009d396318 with handle 0x21b6f08f07a6adfc from hash
00010000:00000001:2.0:1773851894.786081:0:60951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:2.0:1773851894.786081:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.786081:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.786082:0:60951:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:2.0:1773851894.786082:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:2.0:1773851894.786082:0:60951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000009d396318/0x21b6f08f07a6adfc lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e3c expref: 10 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786085:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:2.0:1773851894.786085:0:60951:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000000c985270 : new locks_count 4
00000020:00000040:2.0:1773851894.786086:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 9
00010000:00000010:2.0:1773851894.786086:0:60951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000795a147f.
00010000:00000040:2.0:1773851894.786087:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:2.0:1773851894.786088:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851894.786088:0:60951:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.786089:0:60951:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:2.0:1773851894.786090:0:60951:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000820c7d0d/0x21b6f08f07a6ae03 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e3c expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:2.0:1773851894.786092:0:60951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:2.0:1773851894.786093:0:60951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:2.0:1773851894.786093:0:60951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:2.0:1773851894.786094:0:60951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:2.0:1773851894.786094:0:60951:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:2.0:1773851894.786095:0:60951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851894.786096:0:60951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.786097:0:60951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:2.0:1773851894.786097:0:60951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851894.786098:0:60951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:2.0:1773851894.786098:0:60951:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000820c7d0d, rc 0)
00000020:00000001:2.0:1773851894.786098:0:60951:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851894.786099:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183033875552, transno 0, xid 1859479459197888
00010000:00000001:2.0:1773851894.786100:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851894.786101:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007aa8e956 x1859479459197888/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1031-0'
00010000:00000001:2.0:1773851894.786103:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851894.786104:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851894.786105:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851894.786106:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851894.786107:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0e27e8d refcount 3 to 8642@kfi7
00000100:00000001:2.0:1773851894.786107:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636920560355392 : -107153149196224 : ffff9e8b769b0840)
02000000:00000001:2.0:1773851894.786108:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851894.786109:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.786109:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851894.786110:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8643@kfi7
00000400:00000010:2.0:1773851894.786111:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009ab20781.
00000100:00000200:2.0:1773851894.786112:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859479459197888, offset 224
00000400:00000200:2.0:1773851894.786113:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8643@kfi7
00000400:00000200:2.0:1773851894.786114:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.786115:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:2.0:1773851894.786116:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:2.0:1773851894.786117:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:2.0:1773851894.786118:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8643@kfi7 local destination
00000400:00000200:2.0:1773851894.786120:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770139:8770139:1024:4294967295] 8643@kfi7 LPNI seq info [4079472:4079472:16:4294967295]
00000400:00000200:2.0:1773851894.786121:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:2.0:1773851894.786122:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.786124:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8643@kfi7(8643@kfi7:8643@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851894.786126:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000800:00000200:2.0:1773851894.786127:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.786128:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:2.0:1773851894.786130:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851894.786133:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 Using peer 8643@kfi7(0x1265)
00000800:00000200:2.0:1773851894.786136:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000dae7d744: Posted send of 740 bytes to peer 0x1265: rc=0
00000800:00000200:2.0:1773851894.786137:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851894.786139:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851894.786140:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0e27e8d refcount 2 to 8642@kfi7
00010000:00000001:2.0:1773851894.786141:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851894.786142:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851894.786143:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851894.786143:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007aa8e956 x1859479459197888/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1031-0'
00000100:00100000:2.0:1773851894.786147:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007aa8e956 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:bc54700d-6af9-4c11-bc5c-79acaed48f9a+9:1699123:x1859479459197888:12345-8642@kfi7:101:default-tuolumne1031-0 Request processed in 959us (1008us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851894.786149:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8642@kfi7, seq: 408701487
00000100:00000040:2.0:1773851894.786150:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c985270 : new rpc_count 0
00000800:00000200:1.0:1773851894.786150:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851894.786151:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851894.786151:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851894.786152:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c1bdad60.
00000400:00000200:1.0:1773851894.786152:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:2.0:1773851894.786153:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a912de76.
00000020:00000010:2.0:1773851894.786153:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7ccc6d.
00000400:00000200:1.0:1773851894.786153:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8643@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.786153:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009ab20781
00000020:00000040:2.0:1773851894.786154:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 8
00000400:00000010:1.0:1773851894.786154:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009ab20781.
00000100:00000001:1.0:1773851894.786154:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851894.786155:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851894.786155:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.786156:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000800:00000200:1.0:1773851894.786157:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 Transaction freed
00000800:00000200:26.0:1773851894.786276:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.786276:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851894.786277:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.786277:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851894.786278:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.786278:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851894.786280:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851894.786280:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8451@kfi7(00000000e6c67797):0x1267 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851894.786282:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Using peer 8451@kfi7(0x100000000001267)
00000400:00000200:26.0:1773851894.786283:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.786284:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8451@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.786284:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.786285:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000800:00000200:25.0:1773851894.786285:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000878f9def: Posted send of 38 bytes to peer 0x100000000001267: rc=0
00000400:00000200:26.0:1773851894.786287:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 1
00000800:00000200:25.0:1773851894.786287:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851894.786288:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.786288:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000400:00000200:26.0:1773851894.786289:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000400:00000200:26.0:1773851894.786290:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8642@kfi7 to cpt 5
00000400:00000200:26.0:1773851894.786291:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8642@kfi7 of length 328 into portal 17 MB=0x69b2fcca1f440
00000400:00000200:26.0:1773851894.786293:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8642@kfi7 of length 328/328 into md 0x1615af82d9 [2] + 336
00000800:00000200:26.0:1773851894.786295:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851894.786296:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851894.786297:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8451@kfi7: PUT: OK
00000100:00000001:26.0:1773851894.786298:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:25.0:1773851894.786298:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_EVENT_TX_OK event status 0
00000100:00000200:26.0:1773851894.786299:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:26.0:1773851894.786300:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e9ed9423.
00000100:00000040:26.0:1773851894.786301:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000e9ed9423 x1859479459198016 msgsize 328
00000800:00000200:25.0:1773851894.786301:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Transaction freed
00000100:00100000:26.0:1773851894.786302:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-8642@kfi7 (source: 12345-8451@kfi7)
00000100:00000001:26.0:1773851894.786304:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851894.786305:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000800:00000200:26.0:1773851894.786306:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000034381e9b: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851894.786310:0:533719:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851894.786311:0:533719:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851894.786311:0:533719:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851894.786312:0:533719:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851894.786313:0:533719:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851894.786314:0:533719:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479459198016
00000020:00000001:26.0:1773851894.786314:0:533719:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851894.786315:0:533719:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2dc17
00000020:00000001:26.0:1773851894.786315:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.786321:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c985270 refcount=9
00000020:00000001:26.0:1773851894.786322:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000020:00000001:26.0:1773851894.786323:0:533719:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000100:00000001:26.0:1773851894.786324:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851894.786324:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851894.786325:0:533719:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bd5c6346.
00000020:00000010:26.0:1773851894.786326:0:533719:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851894.786327:0:533719:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000040:26.0:1773851894.786328:0:533719:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:26.0:1773851894.786329:0:533719:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851894.786330:0:533719:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:26.0:1773851894.786330:0:533719:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:26.0:1773851894.786331:0:533719:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786332:0:533719:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:26.0:1773851894.786332:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.786333:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.786334:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000820c7d0d refcount=3
00000020:00000001:26.0:1773851894.786334:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000001:26.0:1773851894.786335:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000001:26.0:1773851894.786336:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.786337:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.786337:0:533719:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.786338:0:533719:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.786339:0:533719:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.786341:0:533719:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851894.786343:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851894.786343:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851894.786343:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851894.786344:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851894.786345:0:533719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8642@kfi7, seq: 105589644
00000100:00000040:26.0:1773851894.786345:0:533719:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c985270 : new rpc_count 1
00000100:00000001:24.0:1773851894.786345:0:184027:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.786346:0:533719:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144347104640 : -106929362446976 : ffff9ebf9155d580)
00000100:00000001:24.0:1773851894.786346:0:184027:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851894.786346:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.786346:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:26.0:1773851894.786348:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e9ed9423 x1859479459198016/t0(0) o103->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000800:00000200:5.0:1773851894.786348:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:26.0:1773851894.786350:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:5.0:1773851894.786350:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:26.0:1773851894.786351:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851894.786352:0:533719:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ed9423 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:bc54700d-6af9-4c11-bc5c-79acaed48f9a+9:40032:x1859479459198016:12345-8642@kfi7:103:
00000400:00000200:5.0:1773851894.786352:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.786353:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000100:00000200:26.0:1773851894.786354:0:533719:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479459198016
00000400:00000200:5.0:1773851894.786354:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00010000:00000001:26.0:1773851894.786355:0:533719:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:26.0:1773851894.786355:0:533719:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00000400:00000200:5.0:1773851894.786355:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00010000:00000001:26.0:1773851894.786356:0:533719:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000400:00000200:5.0:1773851894.786356:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.786356:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000001:26.0:1773851894.786357:0:533719:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851894.786358:0:533719:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:5.0:1773851894.786358:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
02000000:00000010:26.0:1773851894.786359:0:533719:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000138f387f.
02000000:00000001:26.0:1773851894.786359:0:533719:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851894.786359:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:26.0:1773851894.786360:0:533719:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786360:0:533719:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00000400:00000200:5.0:1773851894.786360:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 328 into portal 24 MB=0x699e69c992980
00010000:00010000:26.0:1773851894.786361:0:533719:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000400:00000200:5.0:1773851894.786361:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 328/328 into md 0x793844545 [256] + 8080
00010000:00000001:26.0:1773851894.786362:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.786362:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.786362:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000820c7d0d refcount=3
00000020:00000001:26.0:1773851894.786363:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00000800:00000200:5.0:1773851894.786363:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:26.0:1773851894.786364:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637166951966848 : -106906757584768 : ffff9ec4d4b0a880)
00010000:00000040:26.0:1773851894.786365:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00000400:00000200:5.0:1773851894.786365:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000001:26.0:1773851894.786366:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851894.786366:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000400:00000200:5.0:1773851894.786366:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000020:00000001:26.0:1773851894.786367:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851894.786367:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00000100:00000001:5.0:1773851894.786367:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851894.786367:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00010000:00000001:26.0:1773851894.786368:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:5.0:1773851894.786368:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000019216c95.
00000020:00000001:26.0:1773851894.786369:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851894.786369:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000019216c95 x1858065609075072 msgsize 328
00010000:00000001:26.0:1773851894.786370:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851894.786371:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00000100:00100000:5.0:1773851894.786371:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00010000:00000001:26.0:1773851894.786372:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:5.0:1773851894.786372:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000001:26.0:1773851894.786373:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.786373:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00000100:00000001:6.0:1773851894.786373:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851894.786373:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00010000:00000001:26.0:1773851894.786374:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851894.786374:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000820c7d0d with handle 0x21b6f08f07a6ae03 from hash
02000000:00000001:6.0:1773851894.786374:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851894.786374:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00010000:00000001:26.0:1773851894.786375:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00000100:00000001:6.0:1773851894.786375:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851894.786375:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786376:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.786376:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
02000000:00000001:6.0:1773851894.786376:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786377:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00000100:00100000:6.0:1773851894.786377:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065609075072
00000020:00000001:6.0:1773851894.786377:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00010000:00000001:26.0:1773851894.786378:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851894.786378:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:6.0:1773851894.786378:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00010000:00000001:26.0:1773851894.786379:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851894.786379:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000020:00000001:6.0:1773851894.786379:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851894.786379:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00010000:00010000:26.0:1773851894.786380:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000820c7d0d/0x21b6f08f07a6ae03 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e3c expref: 9 pid: 60951 timeout: 0 lvb_type: 0
00000020:00000001:6.0:1773851894.786380:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:6.0:1773851894.786381:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:6.0:1773851894.786382:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851894.786382:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00010000:00000040:26.0:1773851894.786383:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00000020:00000010:6.0:1773851894.786383:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00010000:00000040:26.0:1773851894.786384:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000000c985270 : new locks_count 3
00000020:00000010:6.0:1773851894.786384:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000040:26.0:1773851894.786385:0:533719:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 8
00000020:00000010:6.0:1773851894.786385:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00010000:00000010:26.0:1773851894.786386:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a1f16a1c.
00000100:00000040:6.0:1773851894.786386:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00010000:00000040:26.0:1773851894.786387:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:26.0:1773851894.786387:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:6.0:1773851894.786387:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851894.786387:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:26.0:1773851894.786388:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00000100:00000001:6.0:1773851894.786388:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786389:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851894.786389:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00000100:00000001:6.0:1773851894.786389:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.786389:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.786390:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.786391:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.786391:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851894.786391:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851894.786391:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00010000:00000001:26.0:1773851894.786392:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851894.786392:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00000100:00000001:5.0:1773851894.786392:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00010000:00010000:26.0:1773851894.786393:0:533719:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00100000:6.0:1773851894.786393:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314087
00000100:00000040:6.0:1773851894.786393:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:5.0:1773851894.786393:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786394:0:533719:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851894.786394:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637006074680960 : -107067634870656 : ffff9e9f5fa81680)
00000100:00000001:5.0:1773851894.786394:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786395:0:533719:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000040:6.0:1773851894.786395:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000019216c95 x1858065609075072/t0(0) o1000->lustre5-MDT0002-mdtlov_UUID@13@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00010000:00000001:26.0:1773851894.786396:0:533719:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851894.786396:0:533719:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=148 v=66 (1 1 0 1)
00000100:00000001:26.0:1773851894.786397:0:533719:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851894.786398:0:533719:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0e27e8d refcount 3 to 8642@kfi7
00000100:00000001:6.0:1773851894.786398:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851894.786398:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:26.0:1773851894.786399:0:533719:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636920560355392 : -107153149196224 : ffff9e8b769b0840)
00000100:00100000:6.0:1773851894.786399:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019216c95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:295212:x1858065609075072:12345-13@kfi7:1000:default-yuba3-0
02000000:00000001:26.0:1773851894.786400:0:533719:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851894.786401:0:533719:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.786401:0:533719:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:6.0:1773851894.786401:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065609075072
00000100:00000040:26.0:1773851894.786402:0:533719:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8451@kfi7
00000020:00000001:6.0:1773851894.786402:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851894.786402:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000010:26.0:1773851894.786403:0:533719:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005872c184.
00000020:00000001:6.0:1773851894.786403:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851894.786403:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000200:26.0:1773851894.786404:0:533719:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859479459198016, offset 224
00000020:00000001:6.0:1773851894.786404:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667521856 : -1042029760 : ffffffffc1e3e340)
00000020:00000001:6.0:1773851894.786405:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851894.786405:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851894.786406:0:533719:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8451@kfi7
00000020:00000001:6.0:1773851894.786406:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851894.786406:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:26.0:1773851894.786407:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000020:00000001:6.0:1773851894.786407:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851894.786408:0:533719:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 1
00000020:00000001:6.0:1773851894.786408:0:1537125:0:(out_handler.c:970:out_handle()) Process entered
00000400:00000200:26.0:1773851894.786409:0:533719:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000020:00000010:6.0:1773851894.786409:0:1537125:0:(out_handler.c:993:out_handle()) kmalloced '(update_bufs)': 8 at 00000000dcc7d040.
00000400:00000200:26.0:1773851894.786410:0:533719:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000100:00000001:6.0:1773851894.786410:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:26.0:1773851894.786411:0:533719:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8451@kfi7 local destination
02000000:00000001:6.0:1773851894.786411:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:26.0:1773851894.786412:0:533719:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770140:8770140:1024:4294967295] 8451@kfi7 LPNI seq info [4079473:4079473:16:4294967295]
02000000:00000010:6.0:1773851894.786412:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 4576 at 00000000b262a405.
02000000:00000001:6.0:1773851894.786413:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.786413:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851894.786414:0:533719:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000020:00000001:6.0:1773851894.786414:0:1537125:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000400:00000200:26.0:1773851894.786415:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000020:00000001:6.0:1773851894.786416:0:1537125:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000400:00000200:26.0:1773851894.786417:0:533719:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8451@kfi7(8451@kfi7:8451@kfi7) <?> : PUT try# 0
00000020:00000001:6.0:1773851894.786417:0:1537125:0:(out_handler.c:356:out_index_lookup()) Process entered
00000400:00000200:26.0:1773851894.786418:0:533719:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00080000:00000001:6.0:1773851894.786418:0:1537125:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00000800:00000200:26.0:1773851894.786419:0:533719:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851894.786421:0:533719:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851894.786423:0:533719:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851894.786425:0:533719:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Using peer 8451@kfi7(0x100000000001267)
00080000:00000001:6.0:1773851894.786426:0:1537125:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:6.0:1773851894.786427:0:1537125:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:6.0:1773851894.786427:0:1537125:0:(osd_index.c:945:osd_seq_exists()) Process entered
00000800:00000200:26.0:1773851894.786428:0:533719:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x100000000001267: rc=0
80000000:00000001:6.0:1773851894.786428:0:1537125:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:6.0:1773851894.786428:0:1537125:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:6.0:1773851894.786429:0:1537125:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851894.786430:0:533719:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
80000000:00000001:6.0:1773851894.786430:0:1537125:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851894.786431:0:1537125:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851894.786431:0:1537125:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851894.786432:0:533719:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:6.0:1773851894.786432:0:1537125:0:(out_handler.c:389:out_index_lookup()) lookup [0x24001b599:0x10e2:0x0] slingshotmon get [0x2800256ea:0x3d:0x0] rc 1
00000100:00000040:26.0:1773851894.786433:0:533719:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0e27e8d refcount 2 to 8642@kfi7
00010000:00000001:26.0:1773851894.786433:0:533719:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.786434:0:533719:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:6.0:1773851894.786434:0:1537125:0:(out_handler.c:393:out_index_lookup()) lustre5-MDT0001: insert lookup reply 00000000d4d6af56 index 0: rc = 1
00000100:00000040:26.0:1773851894.786435:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e9ed9423 x1859479459198016/t0(0) o103->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000020:00000001:6.0:1773851894.786435:0:1537125:0:(out_handler.c:398:out_index_lookup()) Process leaving (rc=1 : 1 : 1)
00000020:00000002:6.0:1773851894.786436:0:1537125:0:(lu_object.c:224:lu_object_put()) Add 000000003fbfefe6/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000020:00000010:6.0:1773851894.786437:0:1537125:0:(out_handler.c:1241:out_handle()) kfreed 'update_bufs': 8 at 00000000dcc7d040.
00000100:00100000:26.0:1773851894.786438:0:533719:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ed9423 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:40032:x1859479459198016:12345-8642@kfi7:103: Request processed in 87us (136us total) trans 0 rc 0/0
00000020:00000001:6.0:1773851894.786438:0:1537125:0:(out_handler.c:1247:out_handle()) Process leaving (rc=1 : 1 : 1)
00010000:00000040:6.0:1773851894.786439:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065609075072
00010000:00000001:6.0:1773851894.786440:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000800:00000200:25.0:1773851894.786441:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_EVENT_TX_OK event status 0
00010000:00000200:6.0:1773851894.786441:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000019216c95 x1858065609075072/t0(0) o1000->lustre5-MDT0002-mdtlov_UUID@13@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/0 job:'default-yuba3-0'
00000100:00100000:26.0:1773851894.786443:0:533719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8642@kfi7, seq: 105589644
00000100:00000040:26.0:1773851894.786443:0:533719:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c985270 : new rpc_count 0
00000400:00000200:25.0:1773851894.786443:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851894.786444:0:533719:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851894.786444:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8451@kfi7: PUT: OK
00010000:00000001:6.0:1773851894.786444:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851894.786444:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.786445:0:533719:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851894.786445:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005872c184
00000400:00000010:25.0:1773851894.786445:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005872c184.
00000100:00001000:6.0:1773851894.786445:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=123 v=66 (1 1 1 1)
00000020:00000010:26.0:1773851894.786446:0:533719:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851894.786446:0:533719:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000100:00000001:25.0:1773851894.786446:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.786446:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:6.0:1773851894.786446:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000020:00000010:26.0:1773851894.786447:0:533719:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bd5c6346.
00000400:00000200:25.0:1773851894.786447:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000100:00000040:6.0:1773851894.786447:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000020:00000040:26.0:1773851894.786448:0:533719:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 7
00000100:00000001:6.0:1773851894.786448:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:6.0:1773851894.786448:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000001:26.0:1773851894.786449:0:533719:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851894.786449:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Transaction freed
02000000:00000001:6.0:1773851894.786449:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.786449:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851894.786450:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000400:00000010:6.0:1773851894.786451:0:1537125:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 000000009c866d7e (tot 253201035).
00000100:00000200:6.0:1773851894.786452:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 4320 bytes to portal 4, xid 1858065609075072, offset 224
00000400:00000200:6.0:1773851894.786453:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000400:00000200:6.0:1773851894.786455:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.786455:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:6.0:1773851894.786457:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851894.786458:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:6.0:1773851894.786459:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  30@kfi7 local destination
00000400:00000200:6.0:1773851894.786460:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770141:8770141:1024:4294967295] 30@kfi7 LPNI seq info [23133328:23133328:16:4294967295]
00000400:00000200:6.0:1773851894.786462:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851894.786463:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.786464:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851894.786465:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000800:00000200:6.0:1773851894.786467:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 1 allocated
00000800:00000200:6.0:1773851894.786469:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:6.0:1773851894.786472:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:6.0:1773851894.786479:0:1537125:0:(kfilnd_ep.c:374:kfilnd_ep_post_tagged_recv()) 2054@kfi7:1 Transaction ID 00000000618b435b: Posted tagged recv of 4320 bytes (2 frags) with tag 0xff0001: rc=0
00000800:00000200:6.0:1773851894.786481:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_TAGGED_RECV_POSTED state change
00000800:00000200:6.0:1773851894.786483:0:1537125:0:(kfilnd_tn.c:603:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:6.0:1773851894.786486:0:1537125:0:(kfilnd_tn.c:610:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000800:00000200:6.0:1773851894.786489:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000618b435b: Posted send of 110 bytes to peer 0x2000000000000fe: rc=0
00000800:00000200:6.0:1773851894.786491:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_STATE_TAGGED_RECV_POSTED -> TN_STATE_WAIT_COMP state change
00000100:00000001:6.0:1773851894.786493:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851894.786493:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:6.0:1773851894.786494:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851894.786495:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851894.786496:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851894.786498:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000019216c95 x1858065609075072/t0(0) o1000->lustre5-MDT0002-mdtlov_UUID@13@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/1 job:'default-yuba3-0'
00000100:00100000:6.0:1773851894.786504:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019216c95 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:295212:x1858065609075072:12345-13@kfi7:1000:default-yuba3-0 Request processed in 104us (133us total) trans 0 rc 1/1
00000800:00000200:5.0:1773851894.786504:0:2507993:0:(kfilnd_tn.c:1127:kfilnd_tn_state_wait_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851894.786508:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314087
00000100:00000040:6.0:1773851894.786509:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000800:00000200:5.0:1773851894.786509:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_STATE_WAIT_COMP -> TN_STATE_WAIT_TAG_COMP state change
00000100:00000001:6.0:1773851894.786511:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851894.786511:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851894.786513:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:6.0:1773851894.786514:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000020:00000010:6.0:1773851894.786515:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000020:00000040:6.0:1773851894.786517:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:6.0:1773851894.786518:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851894.786526:0:2507993:0:(kfilnd_tn.c:1307:kfilnd_tn_state_wait_tag_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_EVENT_TAG_RX_OK event status 0
00000400:00000200:5.0:1773851894.786529:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851894.786530:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000400:00000200:5.0:1773851894.786532:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009c866d7e
00000400:00000010:5.0:1773851894.786532:0:2507993:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 000000009c866d7e (tot 253200883).
00000100:00000001:5.0:1773851894.786534:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851894.786536:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851894.786537:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851894.786540:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe Transaction freed
00000800:00000200:1.0:1773851894.786627:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.786628:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.786629:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.786631:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.786632:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.786633:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8643@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.786634:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.786635:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:1.0:1773851894.786636:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.786636:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:1.0:1773851894.786637:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:1.0:1773851894.786640:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8642@kfi7 to cpt 5
00000400:00000200:1.0:1773851894.786641:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8642@kfi7 of length 584 into portal 12 MB=0x69b2fcca1f540
00000400:00000200:1.0:1773851894.786642:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8642@kfi7 of length 584/584 into md 0x7fb56e801 [64] + 50280
00000800:00000200:1.0:1773851894.786644:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.786646:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.786647:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8643@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.786648:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.786648:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851894.786649:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005dd52e78.
00000100:00000040:1.0:1773851894.786650:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000005dd52e78 x1859479459198272 msgsize 584
00000100:00100000:1.0:1773851894.786651:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8642@kfi7 (source: 12345-8643@kfi7)
00000100:00000001:1.0:1773851894.786652:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.786653:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000100:00000001:2.0:1773851894.786654:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851894.786654:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851894.786654:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851894.786655:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851894.786655:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851894.786656:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851894.786657:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479459198272
00000020:00000001:2.0:1773851894.786658:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851894.786658:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2dc17
00000020:00000001:2.0:1773851894.786659:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851894.786660:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c985270 refcount=8
00000020:00000001:2.0:1773851894.786660:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000020:00000001:2.0:1773851894.786661:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000100:00000001:2.0:1773851894.786662:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851894.786663:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851894.786663:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7ccc6d.
00000020:00000010:2.0:1773851894.786664:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c1bdad60.
00000020:00000010:2.0:1773851894.786665:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a912de76.
00000100:00000001:2.0:1773851894.786666:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851894.786667:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:2.0:1773851894.786667:0:60951:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:2.0:1773851894.786667:0:60951:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.786668:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.786669:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.786670:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.786671:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.786671:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.786672:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.786672:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.786673:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8642@kfi7, seq: 408701488
00000100:00000040:0.0:1773851894.786673:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c985270 : new rpc_count 1
00000100:00000001:2.0:1773851894.786674:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851894.786674:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.786674:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052781952 : -106991656769664 : ffff9eb1104de780)
00000100:00000040:0.0:1773851894.786676:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005dd52e78 x1859479459198272/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 584/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1031-0'
00000100:00000001:0.0:1773851894.786678:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.786680:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.786680:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005dd52e78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:1699123:x1859479459198272:12345-8642@kfi7:101:default-tuolumne1031-0
00000100:00000200:0.0:1773851894.786682:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479459198272
00000020:00000001:0.0:1773851894.786683:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.786683:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.786684:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.786685:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.786685:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:0.0:1773851894.786686:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.786686:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479459198272, found 0 last_xid 1859479459198271
00000020:00000001:0.0:1773851894.786687:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.786688:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.786688:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.786689:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.786690:0:42868:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:0.0:1773851894.786690:0:42868:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:0.0:1773851894.786691:0:42868:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:0.0:1773851894.786691:0:42868:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:0.0:1773851894.786692:0:42868:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.786693:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.786694:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.786695:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.786695:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.786696:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000c346e481.
00000020:00000001:0.0:1773851894.786697:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.786697:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000c346e481 with handle 0x21b6f08f07a6ae0a to hash
00000020:00000001:0.0:1773851894.786698:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.786698:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00000010:0.0:1773851894.786699:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000000abc935f.
00010000:00000001:0.0:1773851894.786700:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637112833137984 : -106960876413632 : ffff9eb83af4dd40)
00010000:00010000:0.0:1773851894.786701:0:42868:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ae0a lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea34c370deef0e43 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786706:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:0.0:1773851894.786707:0:42868:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000000c985270 : new locks_count 4
00000020:00000040:0.0:1773851894.786708:0:42868:0:(genops.c:871:class_export_get()) GET export 000000000c985270 refcount=9
00010000:00000001:0.0:1773851894.786710:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:0.0:1773851894.786710:0:42868:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:0.0:1773851894.786711:0:42868:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:0.0:1773851894.786711:0:42868:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:0.0:1773851894.786712:0:42868:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:0.0:1773851894.786712:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851894.786713:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:0.0:1773851894.786714:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851894.786715:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:0.0:1773851894.786715:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:0.0:1773851894.786716:0:42868:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.786717:0:42868:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:0.0:1773851894.786718:0:42868:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:0.0:1773851894.786718:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.786719:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.786720:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 0000000070ae367a.
02000000:00000001:0.0:1773851894.786721:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.786721:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.786722:0:42868:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.786723:0:42868:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:0.0:1773851894.786723:0:42868:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:0.0:1773851894.786723:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.786724:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.786727:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.786727:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.786728:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.786728:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.786728:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.786729:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.786730:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.786730:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.786731:0:42868:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:0.0:1773851894.786732:0:42868:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:0.0:1773851894.786733:0:42868:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:0.0:1773851894.786733:0:42868:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.786734:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.786734:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.786735:0:42868:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:0.0:1773851894.786735:0:42868:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.786736:0:42868:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:0.0:1773851894.786736:0:42868:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 00000000a703d4d4
00000004:00000001:0.0:1773851894.786737:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:0.0:1773851894.786738:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:0.0:1773851894.786739:0:42868:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:0.0:1773851894.786739:0:42868:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:0.0:1773851894.786740:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.786740:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.786740:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.786741:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.786742:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.786742:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000ec279978.
00000020:00000001:0.0:1773851894.786743:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.786743:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000ec279978 with handle 0x21b6f08f07a6ae11 to hash
00000020:00000001:0.0:1773851894.786744:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.786744:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00000010:0.0:1773851894.786745:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000084fdee8.
00010000:00000001:0.0:1773851894.786746:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00000001:0.0:1773851894.786747:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.786747:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.786748:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786750:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.786751:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.786751:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.786752:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.786753:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.786753:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.786754:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.786754:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.786755:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.786756:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.786756:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.786756:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.786757:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 195
00010000:00000040:0.0:1773851894.786758:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:0.0:1773851894.786759:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786761:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786762:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786764:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786765:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786767:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786768:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786770:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786771:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786773:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786774:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786779:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786780:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786781:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786783:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786785:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786786:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786788:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786789:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786791:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786791:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786793:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786794:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786796:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786797:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786799:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786800:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786803:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786804:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786806:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786807:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786809:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786810:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786812:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786813:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786815:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786816:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786818:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786819:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786821:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786822:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786824:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786824:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786827:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786828:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786830:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786830:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786833:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786834:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786836:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786836:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786838:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786839:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786841:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786842:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786844:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786844:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786846:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786847:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786850:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786851:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786853:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786854:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786856:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786857:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786859:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786860:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786862:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786862:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786864:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786865:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786867:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786868:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786870:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786870:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786874:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786875:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786877:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786877:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786880:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786881:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786882:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786883:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786885:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786886:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786888:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786888:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786890:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786891:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786893:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786894:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786897:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786898:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786900:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786901:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786904:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786904:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786906:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786907:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786909:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786910:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786912:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786913:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786915:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786915:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786918:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786919:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786922:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786923:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786925:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786925:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786927:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786928:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786930:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786931:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786934:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786934:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786936:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786937:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786939:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786940:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786942:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786943:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786946:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786947:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786948:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786949:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786951:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786952:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786954:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786955:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786957:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786958:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786960:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786961:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786963:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786964:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786966:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786966:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786980:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786981:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786982:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786983:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786985:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786986:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786988:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786989:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786991:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786992:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786994:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786995:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786997:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.786997:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.786999:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787000:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787003:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787004:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787006:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787007:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787009:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787009:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787012:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787012:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787014:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787015:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787017:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787018:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787020:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787021:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787023:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787024:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787027:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787028:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787030:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787031:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787033:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787033:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787035:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787036:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787038:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787039:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787041:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787042:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787044:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787044:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787046:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787047:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787051:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787052:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787054:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787055:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787056:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787057:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787059:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787060:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787062:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787063:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787065:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787066:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787068:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787068:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787070:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787071:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787074:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787075:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787077:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787078:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787080:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787081:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787083:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787084:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787086:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787087:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787089:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787089:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787091:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787092:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787094:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787095:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787098:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787099:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787101:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787102:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787104:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787105:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787107:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787108:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787110:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787111:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787113:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787113:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787116:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787116:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787118:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787119:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787122:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787123:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787125:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787126:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787128:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787129:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787131:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787132:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787134:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787135:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787137:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787137:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787139:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787140:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787142:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787143:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787146:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787147:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787149:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787149:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787152:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787152:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787154:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787155:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787157:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787158:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787160:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787160:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787162:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787163:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787165:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787166:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787168:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787169:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787171:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787172:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787174:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787175:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787177:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787178:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787180:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787181:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787183:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787183:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787185:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787186:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787188:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787189:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787192:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787193:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787195:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787196:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787198:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787199:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787201:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787201:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787203:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787204:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787206:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787207:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787209:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787210:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787212:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787212:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787215:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787217:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787218:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787219:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787221:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787222:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787224:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787225:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787227:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787228:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787230:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787231:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787233:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787233:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787236:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787236:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787239:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787241:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787242:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787243:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787245:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787246:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787248:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787249:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787251:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787252:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787254:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787254:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787256:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787257:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787259:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787260:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787263:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787264:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787266:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787266:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787268:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787269:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787271:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787272:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787274:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787275:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787277:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787278:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787280:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787280:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787282:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787283:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787287:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787287:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787289:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787290:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787292:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787293:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787295:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787296:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787298:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787299:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787301:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787301:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787303:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787304:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787306:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787307:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787311:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787312:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787314:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787314:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787316:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787317:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787319:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787320:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787322:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787323:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787325:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787326:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787328:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787328:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787330:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787331:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787334:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787335:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787337:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787338:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787340:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:0.0:1773851894.787341:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787343:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:0.0:1773851894.787343:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787346:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.787346:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.787347:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.787347:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.787348:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.787348:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.787349:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.787349:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.787350:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.787350:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.787351:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787353:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.787354:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.787354:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.787355:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.787355:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.787356:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:0.0:1773851894.787356:0:42868:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000003f515ee2.
00010000:00000010:0.0:1773851894.787357:0:42868:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000758ace2b.
00010000:00000001:0.0:1773851894.787358:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.787359:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000008ce5b96.
00000020:00000001:0.0:1773851894.787359:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.787360:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000008ce5b96 with handle 0x21b6f08f07a6ae18 to hash
00000020:00000001:0.0:1773851894.787360:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.787361:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000010:0.0:1773851894.787361:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000ae9033dc.
00010000:00000001:0.0:1773851894.787362:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.787363:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.787363:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.787364:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787366:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.787366:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.787367:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.787367:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.787368:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.787368:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.787369:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.787369:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.787370:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.787370:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.787370:0:42868:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.787371:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.787371:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (000000003f515ee2) refcount = 1
00010000:00010000:0.0:1773851894.787372:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787376:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.787377:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.787377:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.787378:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.787378:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.787378:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.787379:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.787379:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.787380:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.787380:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.787381:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787383:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.787384:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.787384:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.787385:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.787385:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.787386:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.787386:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=3
00000020:00000001:0.0:1773851894.787386:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.787387:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.787388:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.787388:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.787389:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.787389:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.787390:0:42868:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:0.0:1773851894.787393:0:42868:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:0.0:1773851894.787394:0:42868:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:0.0:1773851894.787394:0:42868:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:0.0:1773851894.787395:0:42868:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:0.0:1773851894.787398:0:42868:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:0.0:1773851894.787399:0:42868:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:0.0:1773851894.787400:0:42868:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:0.0:1773851894.787400:0:42868:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:0.0:1773851894.787401:0:42868:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:0.0:1773851894.787402:0:42868:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:0.0:1773851894.787402:0:42868:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:0.0:1773851894.787403:0:42868:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:0.0:1773851894.787403:0:42868:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:0.0:1773851894.787404:0:42868:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.787405:0:42868:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.787405:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851894.787405:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:0.0:1773851894.787406:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851894.787407:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:0.0:1773851894.787407:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:0.0:1773851894.787408:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:0.0:1773851894.787408:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:0.0:1773851894.787409:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.787409:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.787410:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.787410:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.787411:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.787411:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000097d489dd.
00000020:00000001:0.0:1773851894.787412:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.787413:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000097d489dd with handle 0x21b6f08f07a6ae1f to hash
00000020:00000001:0.0:1773851894.787413:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.787413:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000010:0.0:1773851894.787414:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000a43c5c3d.
00010000:00000001:0.0:1773851894.787415:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.787416:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.787416:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.787417:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6ae1f lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 230 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787419:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.787419:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.787422:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.787422:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.787423:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.787423:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.787424:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.787424:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.787425:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.787425:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.787425:0:42868:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.787426:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.787426:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 229
00010000:00000040:0.0:1773851894.787427:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:0.0:1773851894.787428:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787430:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787431:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787432:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787433:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787435:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787436:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787438:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787439:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787441:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787442:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787446:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787447:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787449:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787450:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787452:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787452:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787455:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787455:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787457:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787458:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787460:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787461:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787463:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787464:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787466:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787466:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787470:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787471:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787473:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787474:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787476:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787476:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787479:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787479:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787481:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787482:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787484:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787485:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787487:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787488:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787490:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787490:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787495:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787496:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787498:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787499:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787502:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787502:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787505:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787506:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787508:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787509:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787511:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787512:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787514:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787514:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787517:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787517:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787522:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787524:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787526:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787527:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787530:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787531:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787533:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787534:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787536:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787537:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787539:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787540:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787543:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787543:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787546:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787547:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787550:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787551:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787554:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787554:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787557:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787557:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787560:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787560:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787562:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787563:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787565:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787566:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787568:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787569:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787571:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787571:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787576:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787577:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787579:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787580:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787582:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787583:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787585:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787586:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787588:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787589:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787591:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787592:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787594:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787594:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787596:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787597:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787600:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787601:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787603:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787604:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787607:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787607:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787609:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787610:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787612:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787613:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787615:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787616:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787618:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787619:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787621:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787622:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787625:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787626:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787628:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787629:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787631:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787632:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787634:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787635:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787637:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787637:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787639:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787640:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787642:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787643:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787645:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787645:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787649:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787650:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787652:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787653:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787655:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787656:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787658:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787658:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787661:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787661:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787663:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787664:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787666:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787667:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787669:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787670:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787673:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787674:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787676:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787677:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787679:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787680:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787682:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787682:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787684:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787685:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787687:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787688:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787690:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787691:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787693:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787693:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787696:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787697:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787699:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787700:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787702:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787703:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787705:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787706:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787708:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787708:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787710:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787711:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787713:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787714:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787716:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787717:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787720:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787721:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787723:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787724:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787728:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787729:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787731:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787732:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787734:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787735:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787737:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787738:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787740:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787740:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787743:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787743:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787746:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787747:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787749:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787750:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787752:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787753:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787754:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787755:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787757:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787758:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787760:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787761:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787763:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787763:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787765:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787766:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787769:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787770:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787772:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787773:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787775:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787776:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787779:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787779:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787781:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787782:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787784:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787785:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787787:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787788:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787790:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787791:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 9 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787796:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787797:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787799:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787800:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787802:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787802:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787805:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787805:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787807:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787808:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787810:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787811:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787813:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787814:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787816:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787816:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787821:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787822:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787824:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787825:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787827:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787828:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787830:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787831:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787833:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787834:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787836:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787837:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787839:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787839:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787841:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787842:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787846:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787847:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787849:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787849:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787852:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787853:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787854:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787855:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787857:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787858:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787860:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787861:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787863:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787864:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787866:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787867:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787870:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787871:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787873:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787874:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787876:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787877:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787879:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787880:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787882:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787882:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787885:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787885:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787888:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787888:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787890:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787891:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787894:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787895:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787897:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787897:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787900:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787901:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787903:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787903:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787905:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787906:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787908:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787909:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787911:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787911:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787913:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787914:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787916:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787917:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787919:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787920:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787922:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787923:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787925:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787925:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787927:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787928:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787930:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787931:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787933:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787934:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787935:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787936:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787940:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787941:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787943:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787944:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787946:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787947:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787949:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787949:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787951:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787952:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787954:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787955:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787957:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787959:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787961:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787961:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787964:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787965:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787967:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787968:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787970:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787971:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787973:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787974:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787975:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787976:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787978:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787979:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787981:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787982:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787984:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787984:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787988:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787989:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787991:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787992:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787994:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787995:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.787997:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.787998:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788000:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788000:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788002:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788003:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788005:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788006:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788008:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788009:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788012:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788012:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788014:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788015:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788017:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788018:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788020:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788021:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788023:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788024:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788026:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788027:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788029:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788030:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788032:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788033:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788036:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788036:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788038:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788039:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788041:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788042:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788044:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788045:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788047:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788047:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788049:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788050:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788052:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788053:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788055:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788056:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788059:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788060:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788062:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788063:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788065:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788066:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788068:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788069:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788071:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788072:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788074:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788075:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788077:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788078:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788080:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788081:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788083:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788084:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788086:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788087:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788089:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788090:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788092:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788092:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788094:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788095:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788097:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788098:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788100:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788101:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788103:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788103:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788106:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788107:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788109:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788110:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788112:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788113:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788114:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788115:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788117:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788118:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788120:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:0.0:1773851894.788121:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788123:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00010000:0.0:1773851894.788123:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6ae1f lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788125:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.788126:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.788127:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.788128:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788128:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.788129:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.788129:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788130:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.788131:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.788131:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.788132:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6ae1f lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788134:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.788134:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.788135:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788135:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788135:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.788136:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.788136:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:0.0:1773851894.788137:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.788137:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.788138:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788139:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.788139:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.788140:0:42868:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:0.0:1773851894.788140:0:42868:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:0.0:1773851894.788141:0:42868:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.788141:0:42868:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.788142:0:42868:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:0.0:1773851894.788142:0:42868:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:0.0:1773851894.788143:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:0.0:1773851894.788145:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.788145:0:42868:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788146:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.788147:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.788147:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:0.0:1773851894.788148:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.788149:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00000004:00010000:0.0:1773851894.788150:0:42868:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6ae1f lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788152:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.788153:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788153:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.788153:0:42868:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:0.0:1773851894.788154:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:0.0:1773851894.788154:0:42868:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:0.0:1773851894.788155:0:42868:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:0.0:1773851894.788155:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:0.0:1773851894.788156:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851894.788156:0:42868:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:0.0:1773851894.788157:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:0.0:1773851894.788157:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.788158:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.788158:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ec279978 refcount=3
00000020:00000001:0.0:1773851894.788159:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00000001:0.0:1773851894.788159:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00000001:0.0:1773851894.788160:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:0.0:1773851894.788161:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788163:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.788163:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788164:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.788164:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788166:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.788167:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.788167:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788168:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:0.0:1773851894.788169:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788171:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:0.0:1773851894.788172:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000ec279978 already unused, calling callback (000000001690cbe4)
00000004:00000001:0.0:1773851894.788173:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.788173:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:0.0:1773851894.788174:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788176:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.788176:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:0.0:1773851894.788177:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.788177:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.788178:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ec279978 refcount=4
00000020:00000001:0.0:1773851894.788178:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00000001:0.0:1773851894.788179:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509333184 : -106909200218432 : ffff9ec4431906c0)
00010000:00000001:0.0:1773851894.788179:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:0.0:1773851894.788180:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788182:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.788183:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:0.0:1773851894.788183:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:0.0:1773851894.788184:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788185:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851894.788185:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.788185:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.788186:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.788186:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000ec279978 with handle 0x21b6f08f07a6ae11 from hash
00010000:00000001:0.0:1773851894.788187:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.788188:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788188:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788188:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.788190:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.788191:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788192:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851894.788192:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.788193:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.788193:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:0.0:1773851894.788195:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:0.0:1773851894.788195:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.788196:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788197:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.788197:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:0.0:1773851894.788198:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788198:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788199:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788199:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.788200:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.788200:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788203:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:0.0:1773851894.788203:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788204:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788204:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:0.0:1773851894.788204:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:0.0:1773851894.788205:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.788205:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec279978/0x21b6f08f07a6ae11 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788207:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000010:0.0:1773851894.788208:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000084fdee8.
00010000:00000040:0.0:1773851894.788209:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:0.0:1773851894.788209:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.788210:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:0.0:1773851894.788210:0:42868:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:0.0:1773851894.788210:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.788211:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.788212:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=3
00000020:00000001:0.0:1773851894.788212:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.788213:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.788214:0:42868:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:0.0:1773851894.788214:0:42868:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788216:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.788217:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788217:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.788217:0:42868:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788219:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.788220:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.788220:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788221:0:42868:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:0.0:1773851894.788221:0:42868:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788223:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00010000:0.0:1773851894.788224:0:42868:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000008ce5b96 already unused, calling callback (000000001690cbe4)
00000004:00000001:0.0:1773851894.788225:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.788225:0:42868:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:0.0:1773851894.788225:0:42868:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788228:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.788228:0:42868:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:0.0:1773851894.788228:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.788229:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.788229:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000008ce5b96 refcount=4
00000020:00000001:0.0:1773851894.788230:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.788231:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342976 : -106909200208640 : ffff9ec443192d00)
00010000:00000001:0.0:1773851894.788232:0:42868:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:0.0:1773851894.788232:0:42868:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788234:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.788235:0:42868:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:0.0:1773851894.788235:0:42868:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:0.0:1773851894.788235:0:42868:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788236:0:42868:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851894.788236:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.788237:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.788237:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.788238:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000008ce5b96 with handle 0x21b6f08f07a6ae18 from hash
00010000:00000001:0.0:1773851894.788238:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.788239:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788239:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788239:0:42868:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.788240:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.788240:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788241:0:42868:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851894.788241:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.788241:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.788242:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (000000003f515ee2)
00010000:00010000:0.0:1773851894.788243:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:0.0:1773851894.788243:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.788244:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788244:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.788244:0:42868:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:0.0:1773851894.788245:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788246:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788246:0:42868:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788246:0:42868:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.788247:0:42868:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.788248:0:42868:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788250:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000001:0.0:1773851894.788251:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788251:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788252:0:42868:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:0.0:1773851894.788252:0:42868:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:0.0:1773851894.788253:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.788253:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000008ce5b96/0x21b6f08f07a6ae18 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788255:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 1
00010000:00000010:0.0:1773851894.788256:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000ae9033dc.
00010000:00000040:0.0:1773851894.788256:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003f515ee2 count: 0
00010000:00000010:0.0:1773851894.788257:0:42868:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000758ace2b.
00010000:00000001:0.0:1773851894.788258:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.788258:0:42868:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:0.0:1773851894.788258:0:42868:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:0.0:1773851894.788259:0:42868:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:0.0:1773851894.788259:0:42868:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:0.0:1773851894.788260:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.788260:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.788260:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:0.0:1773851894.788261:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:0.0:1773851894.788262:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00000004:00000040:0.0:1773851894.788262:0:42868:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000000c985270 : new locks_count 5
00000020:00000040:0.0:1773851894.788263:0:42868:0:(genops.c:871:class_export_get()) GET export 000000000c985270 refcount=10
00010000:00000001:0.0:1773851894.788264:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788264:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.788265:0:42868:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.788265:0:42868:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:0.0:1773851894.788266:0:42868:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:0.0:1773851894.788266:0:42868:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:0.0:1773851894.788267:0:42868:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:0.0:1773851894.788267:0:42868:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:0.0:1773851894.788268:0:42868:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:0.0:1773851894.788268:0:42868:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:0.0:1773851894.788269:0:42868:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.788270:0:42868:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.788271:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:0.0:1773851894.788271:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:0.0:1773851894.788271:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851894.788272:0:42868:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:0.0:1773851894.788273:0:42868:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:0.0:1773851894.788273:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.788274:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788274:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788274:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.788275:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.788275:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c346e481 with handle 0x21b6f08f07a6ae0a from hash
00010000:00000001:0.0:1773851894.788276:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.788277:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788277:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788277:0:42868:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:0.0:1773851894.788278:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.788278:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c346e481/0x21b6f08f07a6ae0a lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 195 type: IBT gid 0 flags: 0x44000000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e43 expref: 10 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788280:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:0.0:1773851894.788281:0:42868:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000000c985270 : new locks_count 4
00000020:00000040:0.0:1773851894.788282:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 9
00010000:00000010:0.0:1773851894.788282:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000000abc935f.
00010000:00000040:0.0:1773851894.788283:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00010000:00000001:0.0:1773851894.788284:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.788284:0:42868:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788285:0:42868:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:0.0:1773851894.788285:0:42868:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6ae1f lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e43 expref: 9 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.788288:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.788289:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.788289:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.788290:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:0.0:1773851894.788290:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:0.0:1773851894.788291:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.788291:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.788292:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.788292:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.788293:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.788293:0:42868:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000097d489dd, rc 0)
00000020:00000001:0.0:1773851894.788294:0:42868:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.788294:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183033875552, transno 0, xid 1859479459198272
00010000:00000001:0.0:1773851894.788295:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851894.788296:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005dd52e78 x1859479459198272/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 584/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1031-0'
00010000:00000001:0.0:1773851894.788298:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.788299:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.788300:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851894.788301:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.788302:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0e27e8d refcount 3 to 8642@kfi7
00000100:00000001:0.0:1773851894.788302:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636920560355392 : -107153149196224 : ffff9e8b769b0840)
02000000:00000001:0.0:1773851894.788303:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.788304:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.788305:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.788305:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8643@kfi7
00000400:00000010:0.0:1773851894.788306:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028349810.
00000100:00000200:0.0:1773851894.788307:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859479459198272, offset 224
00000400:00000200:0.0:1773851894.788309:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8643@kfi7
00000400:00000200:0.0:1773851894.788310:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.788310:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:0.0:1773851894.788311:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:0.0:1773851894.788312:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:0.0:1773851894.788314:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8643@kfi7 local destination
00000400:00000200:0.0:1773851894.788316:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770142:8770142:1024:4294967295] 8643@kfi7 LPNI seq info [4079474:4079474:16:4294967295]
00000400:00000200:0.0:1773851894.788317:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:0.0:1773851894.788318:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.788320:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8643@kfi7(8643@kfi7:8643@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.788321:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000800:00000200:0.0:1773851894.788323:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.788324:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:0.0:1773851894.788326:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.788328:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 Using peer 8643@kfi7(0x1265)
00000800:00000200:0.0:1773851894.788331:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 740 bytes to peer 0x1265: rc=0
00000800:00000200:0.0:1773851894.788332:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.788334:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.788335:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0e27e8d refcount 2 to 8642@kfi7
00010000:00000001:0.0:1773851894.788336:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.788336:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.788337:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.788338:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005dd52e78 x1859479459198272/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 584/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1031-0'
00000100:00100000:0.0:1773851894.788342:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005dd52e78 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bc54700d-6af9-4c11-bc5c-79acaed48f9a+9:1699123:x1859479459198272:12345-8642@kfi7:101:default-tuolumne1031-0 Request processed in 1663us (1692us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.788345:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8642@kfi7, seq: 408701488
00000100:00000040:0.0:1773851894.788346:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c985270 : new rpc_count 0
00000100:00000001:0.0:1773851894.788347:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.788347:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.788348:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c1bdad60.
00000020:00000010:0.0:1773851894.788349:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a912de76.
00000020:00000010:0.0:1773851894.788350:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7ccc6d.
00000020:00000040:0.0:1773851894.788351:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 8
00000100:00000001:0.0:1773851894.788352:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851894.788357:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.788359:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.788360:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8643@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.788360:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028349810
00000400:00000010:1.0:1773851894.788361:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028349810.
00000100:00000001:1.0:1773851894.788362:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.788362:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.788363:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000800:00000200:1.0:1773851894.788364:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 Transaction freed
00000800:00000200:25.0:1773851894.788446:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.788447:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.788448:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.788450:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851894.788452:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.788453:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8451@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.788454:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.788455:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 1
00000400:00000200:25.0:1773851894.788456:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.788457:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000400:00000200:25.0:1773851894.788457:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000400:00000200:25.0:1773851894.788458:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8642@kfi7 to cpt 5
00000400:00000200:25.0:1773851894.788459:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8642@kfi7 of length 328 into portal 17 MB=0x69b2fcca1f5c0
00000400:00000200:25.0:1773851894.788460:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8642@kfi7 of length 328/328 into md 0x1615af82d9 [2] + 664
00000800:00000200:25.0:1773851894.788462:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851894.788464:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.788465:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8451@kfi7: PUT: OK
00000100:00000001:25.0:1773851894.788466:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851894.788466:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:25.0:1773851894.788467:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000432424dd.
00000100:00000040:25.0:1773851894.788467:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000432424dd x1859479459198400 msgsize 328
00000100:00100000:25.0:1773851894.788469:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8642@kfi7 (source: 12345-8451@kfi7)
00000100:00000001:25.0:1773851894.788470:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851894.788470:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000100:00000001:26.0:1773851894.788471:0:533719:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851894.788472:0:533719:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851894.788472:0:533719:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851894.788472:0:533719:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851894.788472:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851894.788473:0:533719:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851894.788474:0:533719:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479459198400
00000020:00000001:26.0:1773851894.788475:0:533719:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851894.788475:0:533719:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2dc17
00000020:00000001:26.0:1773851894.788476:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.788477:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c985270 refcount=9
00000020:00000001:26.0:1773851894.788478:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000020:00000001:26.0:1773851894.788479:0:533719:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000100:00000001:26.0:1773851894.788480:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851894.788480:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851894.788481:0:533719:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000024e5a498.
00000020:00000010:26.0:1773851894.788482:0:533719:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851894.788483:0:533719:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000040:26.0:1773851894.788484:0:533719:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:26.0:1773851894.788485:0:533719:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851894.788485:0:533719:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:26.0:1773851894.788485:0:533719:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:26.0:1773851894.788486:0:533719:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.788486:0:533719:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:26.0:1773851894.788487:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.788488:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.788489:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:26.0:1773851894.788490:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:26.0:1773851894.788490:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:26.0:1773851894.788491:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.788492:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.788492:0:533719:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.788493:0:533719:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.788494:0:533719:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.788495:0:533719:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851894.788496:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851894.788496:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851894.788497:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851894.788497:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851894.788498:0:533719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8642@kfi7, seq: 105589645
00000100:00000040:26.0:1773851894.788498:0:533719:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c985270 : new rpc_count 1
00000100:00000001:26.0:1773851894.788499:0:533719:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780425728 : -106994929125888 : ffff9eb04d41b600)
00000100:00000001:24.0:1773851894.788499:0:184027:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.788499:0:184027:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.788500:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000432424dd x1859479459198400/t0(0) o103->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:26.0:1773851894.788504:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851894.788504:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851894.788505:0:533719:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000432424dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:bc54700d-6af9-4c11-bc5c-79acaed48f9a+9:40033:x1859479459198400:12345-8642@kfi7:103:
00000100:00000200:26.0:1773851894.788507:0:533719:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479459198400
00010000:00000001:26.0:1773851894.788507:0:533719:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:26.0:1773851894.788508:0:533719:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:26.0:1773851894.788508:0:533719:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:26.0:1773851894.788509:0:533719:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851894.788510:0:533719:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851894.788510:0:533719:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000cfab79b9.
02000000:00000001:26.0:1773851894.788511:0:533719:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.788512:0:533719:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.788513:0:533719:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:26.0:1773851894.788513:0:533719:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:26.0:1773851894.788514:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.788514:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.788515:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000097d489dd refcount=3
00000020:00000001:26.0:1773851894.788516:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000001:26.0:1773851894.788517:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509345856 : -106909200205760 : ffff9ec443193840)
00010000:00000040:26.0:1773851894.788518:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 230
00000004:00000001:26.0:1773851894.788518:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851894.788519:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851894.788520:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851894.788520:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851894.788521:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851894.788521:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.788523:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851894.788523:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851894.788524:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.788525:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.788525:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851894.788526:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851894.788527:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000097d489dd with handle 0x21b6f08f07a6ae1f from hash
00010000:00000001:26.0:1773851894.788528:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851894.788528:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.788529:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.788529:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851894.788530:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851894.788530:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.788531:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851894.788532:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851894.788532:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000097d489dd/0x21b6f08f07a6ae1f lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 231 type: IBT gid 0 flags: 0x44a01000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e43 expref: 9 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851894.788536:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00010000:00000040:26.0:1773851894.788537:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000000c985270 : new locks_count 3
00000020:00000040:26.0:1773851894.788538:0:533719:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 8
00010000:00000010:26.0:1773851894.788538:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a43c5c3d.
00010000:00000040:26.0:1773851894.788540:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851894.788540:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.788541:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851894.788542:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851894.788543:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:26.0:1773851894.788544:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.788545:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.788545:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851894.788546:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00010000:26.0:1773851894.788547:0:533719:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:26.0:1773851894.788547:0:533719:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.788548:0:533719:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851894.788549:0:533719:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851894.788549:0:533719:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=148 v=66 (1 1 0 1)
00000100:00000001:26.0:1773851894.788551:0:533719:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851894.788551:0:533719:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0e27e8d refcount 3 to 8642@kfi7
00000100:00000001:26.0:1773851894.788552:0:533719:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636920560355392 : -107153149196224 : ffff9e8b769b0840)
02000000:00000001:26.0:1773851894.788553:0:533719:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851894.788554:0:533719:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.788555:0:533719:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851894.788555:0:533719:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8451@kfi7
00000400:00000010:26.0:1773851894.788556:0:533719:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091cf471c.
00000100:00000200:26.0:1773851894.788557:0:533719:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859479459198400, offset 224
00000400:00000200:26.0:1773851894.788559:0:533719:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8451@kfi7
00000400:00000200:26.0:1773851894.788559:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.788560:0:533719:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 1
00000400:00000200:26.0:1773851894.788562:0:533719:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000400:00000200:26.0:1773851894.788563:0:533719:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000400:00000200:26.0:1773851894.788564:0:533719:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8451@kfi7 local destination
00000400:00000200:26.0:1773851894.788566:0:533719:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770143:8770143:1024:4294967295] 8451@kfi7 LPNI seq info [4079475:4079475:16:4294967295]
00000400:00000200:26.0:1773851894.788568:0:533719:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000400:00000200:26.0:1773851894.788568:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.788571:0:533719:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8451@kfi7(8451@kfi7:8451@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851894.788572:0:533719:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000800:00000200:26.0:1773851894.788574:0:533719:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851894.788575:0:533719:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851894.788578:0:533719:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851894.788581:0:533719:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Using peer 8451@kfi7(0x100000000001267)
00000800:00000200:26.0:1773851894.788584:0:533719:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0x100000000001267: rc=0
00000800:00000200:26.0:1773851894.788586:0:533719:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851894.788588:0:533719:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.788589:0:533719:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0e27e8d refcount 2 to 8642@kfi7
00010000:00000001:26.0:1773851894.788590:0:533719:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.788591:0:533719:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.788592:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000432424dd x1859479459198400/t0(0) o103->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:26.0:1773851894.788595:0:533719:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000432424dd pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:40033:x1859479459198400:12345-8642@kfi7:103: Request processed in 91us (127us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851894.788598:0:533719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8642@kfi7, seq: 105589645
00000100:00000040:26.0:1773851894.788599:0:533719:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c985270 : new rpc_count 0
00000800:00000200:25.0:1773851894.788599:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851894.788600:0:533719:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851894.788600:0:533719:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851894.788601:0:533719:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851894.788601:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851894.788602:0:533719:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000020:00000010:26.0:1773851894.788603:0:533719:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000024e5a498.
00000400:00000200:25.0:1773851894.788603:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8451@kfi7: PUT: OK
00000400:00000200:25.0:1773851894.788603:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091cf471c
00000020:00000040:26.0:1773851894.788604:0:533719:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 7
00000400:00000010:25.0:1773851894.788604:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091cf471c.
00000100:00000001:26.0:1773851894.788605:0:533719:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851894.788605:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.788605:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.788606:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000800:00000200:25.0:1773851894.788608:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Transaction freed
00000800:00000200:2.0:1773851894.789781:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851894.789782:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851894.789783:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851894.789785:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851894.789787:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.789788:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8643@kfi7 : PUT - for me
00000400:00000200:2.0:1773851894.789789:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.789791:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:2.0:1773851894.789791:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:2.0:1773851894.789792:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:2.0:1773851894.789793:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:2.0:1773851894.789794:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8642@kfi7 to cpt 5
00000400:00000200:2.0:1773851894.789795:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8642@kfi7 of length 576 into portal 12 MB=0x69b2fcca1f9c0
00000400:00000200:2.0:1773851894.789796:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8642@kfi7 of length 576/576 into md 0x7fb56e801 [64] + 50864
00000800:00000200:2.0:1773851894.789798:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851894.789800:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851894.789801:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8643@kfi7: PUT: OK
00000100:00000001:2.0:1773851894.789802:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851894.789803:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851894.789803:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fefe46eb.
00000100:00000040:2.0:1773851894.789804:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000fefe46eb x1859479459199424 msgsize 576
00000100:00100000:2.0:1773851894.789806:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-8642@kfi7 (source: 12345-8643@kfi7)
00000100:00000001:2.0:1773851894.789807:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851894.789808:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000100:00000001:0.0:1773851894.789808:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.789808:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:2.0:1773851894.789809:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851894.789809:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.789810:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.789811:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.789811:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479459199424
00000020:00000001:0.0:1773851894.789812:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.789813:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2dc17
00000020:00000001:0.0:1773851894.789813:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.789814:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c985270 refcount=8
00000020:00000001:0.0:1773851894.789815:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000020:00000001:0.0:1773851894.789816:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000100:00000001:0.0:1773851894.789817:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.789817:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.789818:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851894.789819:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.789820:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851894.789821:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.789821:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:0.0:1773851894.789821:0:42868:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:0.0:1773851894.789822:0:42868:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.789822:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.789824:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.789825:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851894.789826:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.789826:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.789826:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.789826:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.789827:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8642@kfi7, seq: 408701489
00000100:00000001:2.0:1773851894.789828:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.789828:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c985270 : new rpc_count 1
00000100:00000001:2.0:1773851894.789829:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.789829:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637126454166400 : -106947255385216 : ffff9ebb66d54380)
00000100:00000040:0.0:1773851894.789830:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fefe46eb x1859479459199424/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 576/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1031-0'
00000100:00000001:0.0:1773851894.789835:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.789836:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.789836:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fefe46eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:1699123:x1859479459199424:12345-8642@kfi7:101:default-tuolumne1031-0
00000100:00000200:0.0:1773851894.789838:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479459199424
00000020:00000001:0.0:1773851894.789838:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.789839:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.789839:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.789840:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.789840:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:0.0:1773851894.789841:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.789841:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479459199424, found 0 last_xid 1859479459199423
00000020:00000001:0.0:1773851894.789842:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.789843:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.789843:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.789844:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.789845:0:42868:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:0.0:1773851894.789845:0:42868:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:0.0:1773851894.789845:0:42868:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:0.0:1773851894.789846:0:42868:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:0.0:1773851894.789846:0:42868:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.789848:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.789849:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 194
00010000:00000001:0.0:1773851894.789849:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.789850:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.789850:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000fb94df81.
00000020:00000001:0.0:1773851894.789851:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.789852:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000fb94df81 with handle 0x21b6f08f07a6ae26 to hash
00000020:00000001:0.0:1773851894.789852:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.789852:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00000010:0.0:1773851894.789853:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000ae9033dc.
00010000:00000001:0.0:1773851894.789854:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509332032 : -106909200219584 : ffff9ec443190240)
00010000:00010000:0.0:1773851894.789855:0:42868:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb94df81/0x21b6f08f07a6ae26 lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xea34c370deef0e6d expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789857:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000040:0.0:1773851894.789858:0:42868:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000000c985270 : new locks_count 4
00000020:00000040:0.0:1773851894.789859:0:42868:0:(genops.c:871:class_export_get()) GET export 000000000c985270 refcount=9
00010000:00000001:0.0:1773851894.789861:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:0.0:1773851894.789861:0:42868:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:0.0:1773851894.789862:0:42868:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:0.0:1773851894.789862:0:42868:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:0.0:1773851894.789862:0:42868:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:0.0:1773851894.789863:0:42868:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:0.0:1773851894.789863:0:42868:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:0.0:1773851894.789864:0:42868:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:0.0:1773851894.789864:0:42868:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:0.0:1773851894.789865:0:42868:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:0.0:1773851894.789866:0:42868:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.789866:0:42868:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:0.0:1773851894.789867:0:42868:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:0.0:1773851894.789867:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.789868:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.789869:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000cbe00570.
02000000:00000001:0.0:1773851894.789870:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.789870:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.789871:0:42868:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.789872:0:42868:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:0.0:1773851894.789872:0:42868:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:0.0:1773851894.789872:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.789873:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.789873:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.789874:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.789874:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.789875:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.789875:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.789876:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.789876:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.789876:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.789877:0:42868:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:0.0:1773851894.789878:0:42868:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:0.0:1773851894.789879:0:42868:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:0.0:1773851894.789879:0:42868:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.789880:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.789880:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.789881:0:42868:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:0.0:1773851894.789881:0:42868:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.789882:0:42868:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:0.0:1773851894.789882:0:42868:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 00000000d64aced4
00000004:00000001:0.0:1773851894.789883:0:42868:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:0.0:1773851894.789883:0:42868:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:0.0:1773851894.789884:0:42868:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:0.0:1773851894.789884:0:42868:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:0.0:1773851894.789885:0:42868:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00010000:00000001:0.0:1773851894.789885:0:42868:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.789886:0:42868:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:0.0:1773851894.789886:0:42868:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000d243d8b7.
00000020:00000001:0.0:1773851894.789887:0:42868:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:0.0:1773851894.789887:0:42868:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000d243d8b7 with handle 0x21b6f08f07a6ae2d to hash
00000020:00000001:0.0:1773851894.789888:0:42868:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:0.0:1773851894.789888:0:42868:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000010:0.0:1773851894.789889:0:42868:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000084fdee8.
00010000:00000001:0.0:1773851894.789890:0:42868:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000001:0.0:1773851894.789891:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.789891:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.789892:0:42868:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000d243d8b7/0x21b6f08f07a6ae2d lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789894:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:0.0:1773851894.789895:0:42868:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:0.0:1773851894.789896:0:42868:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:0.0:1773851894.789896:0:42868:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:0.0:1773851894.789896:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.789897:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.789898:0:42868:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:0.0:1773851894.789898:0:42868:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.789899:0:42868:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:0.0:1773851894.789899:0:42868:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:0.0:1773851894.789900:0:42868:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:0.0:1773851894.789900:0:42868:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:0.0:1773851894.789900:0:42868:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 195
00010000:00000040:0.0:1773851894.789901:0:42868:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:0.0:1773851894.789902:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789904:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789905:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789907:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789908:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789910:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789911:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789913:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789914:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789916:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789917:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789919:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789931:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789933:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789934:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789936:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789937:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789939:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789940:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789942:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789943:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789945:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789946:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789948:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789949:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789951:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789952:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789954:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789955:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789958:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789958:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789961:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789961:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789964:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789964:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789967:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789967:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789970:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789970:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789973:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789973:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789976:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789976:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789978:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789980:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789982:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789983:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 7 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789985:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789985:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789988:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789988:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789990:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789991:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789993:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789994:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789996:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.789997:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.789999:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790000:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790002:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790004:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790006:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790007:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790009:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790010:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790012:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790013:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790015:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790016:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790018:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790019:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790021:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790021:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790024:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790024:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790026:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790028:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790030:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790031:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790033:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790034:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790036:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790037:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790039:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790040:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790042:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790043:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790045:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790045:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790048:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790048:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790050:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790053:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790055:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790056:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790058:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790059:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790061:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790062:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790064:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790064:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790066:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790067:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790069:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790070:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790072:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790073:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790075:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790077:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790079:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790079:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790082:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790083:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790085:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790085:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790088:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790088:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790090:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790091:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790093:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790094:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790096:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790097:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790099:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790100:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790102:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790103:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790105:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790106:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790108:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790109:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790111:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790112:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790114:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790115:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790117:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790118:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790120:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790120:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790122:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790124:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790126:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790126:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790129:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790129:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790131:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790132:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790134:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790135:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790137:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790138:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790140:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790141:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790143:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790143:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790145:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790147:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790149:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790150:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790152:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790153:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790155:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790155:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790158:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790158:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790161:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790161:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790164:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790164:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790166:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790167:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790169:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790170:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790172:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790173:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790175:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790176:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790178:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790179:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790181:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790182:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790184:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790185:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790187:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790188:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790190:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790190:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790192:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790194:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790196:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790197:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790199:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790199:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790202:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790202:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790204:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790205:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790207:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790208:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790210:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790211:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790213:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790214:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790216:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790217:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790219:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790220:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790222:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790223:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790225:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790226:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790228:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790229:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790231:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790232:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 9 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790234:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790234:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790236:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790237:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790239:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790241:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790243:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790244:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790246:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790247:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790249:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790250:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790252:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790253:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790255:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790256:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790258:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790259:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790261:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790262:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790264:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790265:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790268:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790268:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790271:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790271:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790274:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790274:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790277:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790277:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790279:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790280:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790282:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790283:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790285:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790286:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790287:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790289:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790291:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790292:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790294:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790294:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790297:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790298:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790299:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790300:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790302:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790303:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790305:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790305:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790308:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790308:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790310:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790311:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790313:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790314:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790316:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790317:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790319:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790320:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790322:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790322:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790324:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790325:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790327:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790328:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790330:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790331:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790333:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790334:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790337:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790337:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790339:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790340:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790343:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790343:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790345:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790346:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790348:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790349:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790351:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790352:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790354:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790355:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790357:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790358:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790360:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790361:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790363:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790364:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790366:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790367:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790369:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790370:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790372:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790373:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790375:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790376:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790378:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790379:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790381:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790382:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790384:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790385:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790387:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790388:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790390:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790391:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790393:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790394:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790396:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790397:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790399:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790400:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790402:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790403:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790405:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790406:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790408:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790409:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790411:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790412:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790414:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790415:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790417:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790418:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790420:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790421:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790423:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790424:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790426:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790426:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790428:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790430:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790432:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790433:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790435:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790435:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790438:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790438:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790441:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790441:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790443:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790444:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790446:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790447:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790449:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790450:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790452:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790453:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790455:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790455:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790457:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790458:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790461:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790461:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790463:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790464:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790466:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790467:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790469:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790469:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790472:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790472:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790474:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790477:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790479:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790480:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790482:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790483:0:42868:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790485:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00010000:0.0:1773851894.790485:0:42868:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000d243d8b7/0x21b6f08f07a6ae2d lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790487:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:0.0:1773851894.790488:0:42868:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:0.0:1773851894.790489:0:42868:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.790489:0:42868:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.790490:0:42868:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:0.0:1773851894.790490:0:42868:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.790491:0:42868:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.790491:0:42868:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:0.0:1773851894.790492:0:42868:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:0.0:1773851894.790492:0:42868:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851894.790493:0:42868:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000d243d8b7/0x21b6f08f07a6ae2d lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790495:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:0.0:1773851894.790496:0:42868:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:0.0:1773851894.790496:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.790497:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.790497:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.790498:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.790499:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d243d8b7 refcount=3
00000020:00000001:0.0:1773851894.790499:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000001:0.0:1773851894.790500:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000001:0.0:1773851894.790501:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.790501:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.790501:0:42868:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.790502:0:42868:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.790503:0:42868:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:0.0:1773851894.790504:0:42868:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:0.0:1773851894.790504:0:42868:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:0.0:1773851894.790506:0:42868:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.790507:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851894.790508:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.790508:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.790509:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790509:0:42868:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790510:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790511:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851894.790511:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.790512:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.790512:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790513:0:42868:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790513:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:0.0:1773851894.790514:0:42868:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:0.0:1773851894.790515:0:42868:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.790515:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.790516:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.790516:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.790517:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:0.0:1773851894.790517:0:42868:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:0.0:1773851894.790518:0:42868:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:0.0:1773851894.790518:0:42868:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:0.0:1773851894.790519:0:42868:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:0.0:1773851894.790520:0:42868:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:0.0:1773851894.790520:0:42868:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:0.0:1773851894.790522:0:42868:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:0.0:1773851894.790522:0:42868:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.790522:0:42868:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:0.0:1773851894.790523:0:42868:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:0.0:1773851894.790523:0:42868:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.790524:0:42868:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:0.0:1773851894.790524:0:42868:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790525:0:42868:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790525:0:42868:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:0.0:1773851894.790526:0:42868:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.790526:0:42868:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:0.0:1773851894.790527:0:42868:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.790528:0:42868:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.790530:0:42868:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.790530:0:42868:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.790531:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.790531:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d243d8b7 refcount=3
00000020:00000001:0.0:1773851894.790532:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000001:0.0:1773851894.790532:0:42868:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00000004:00000040:0.0:1773851894.790533:0:42868:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000000c985270 : new locks_count 5
00000020:00000040:0.0:1773851894.790533:0:42868:0:(genops.c:871:class_export_get()) GET export 000000000c985270 refcount=10
00010000:00000001:0.0:1773851894.790534:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.790535:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:0.0:1773851894.790535:0:42868:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.790535:0:42868:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:0.0:1773851894.790536:0:42868:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:0.0:1773851894.790536:0:42868:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:0.0:1773851894.790537:0:42868:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:0.0:1773851894.790537:0:42868:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:0.0:1773851894.790537:0:42868:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:0.0:1773851894.790538:0:42868:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:0.0:1773851894.790539:0:42868:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851894.790539:0:42868:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:0.0:1773851894.790540:0:42868:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:0.0:1773851894.790540:0:42868:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:0.0:1773851894.790541:0:42868:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:0.0:1773851894.790541:0:42868:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:0.0:1773851894.790542:0:42868:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:0.0:1773851894.790543:0:42868:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.790543:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.790544:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.790544:0:42868:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.790544:0:42868:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.790545:0:42868:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000fb94df81 with handle 0x21b6f08f07a6ae26 from hash
00010000:00000001:0.0:1773851894.790546:0:42868:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.790546:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.790547:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.790547:0:42868:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:0.0:1773851894.790547:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.790548:0:42868:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb94df81/0x21b6f08f07a6ae26 lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e6d expref: 10 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790550:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:0.0:1773851894.790551:0:42868:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000000c985270 : new locks_count 4
00000020:00000040:0.0:1773851894.790552:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 9
00010000:00000010:0.0:1773851894.790553:0:42868:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000ae9033dc.
00010000:00000040:0.0:1773851894.790553:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:0.0:1773851894.790554:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.790554:0:42868:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.790555:0:42868:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:0.0:1773851894.790556:0:42868:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000d243d8b7/0x21b6f08f07a6ae2d lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e6d expref: 9 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.790558:0:42868:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:0.0:1773851894.790559:0:42868:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.790559:0:42868:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.790560:0:42868:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:0.0:1773851894.790561:0:42868:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:0.0:1773851894.790561:0:42868:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.790562:0:42868:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.790563:0:42868:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:0.0:1773851894.790564:0:42868:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.790564:0:42868:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:0.0:1773851894.790564:0:42868:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000d243d8b7, rc 0)
00000020:00000001:0.0:1773851894.790565:0:42868:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.790566:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183033875552, transno 0, xid 1859479459199424
00010000:00000001:0.0:1773851894.790567:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851894.790568:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fefe46eb x1859479459199424/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1031-0'
00010000:00000001:0.0:1773851894.790570:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.790571:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.790571:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851894.790572:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.790573:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0e27e8d refcount 3 to 8642@kfi7
00000100:00000001:0.0:1773851894.790574:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636920560355392 : -107153149196224 : ffff9e8b769b0840)
02000000:00000001:0.0:1773851894.790575:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.790575:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.790576:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.790577:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8643@kfi7
00000400:00000010:0.0:1773851894.790578:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007a35718f.
00000100:00000200:0.0:1773851894.790578:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859479459199424, offset 224
00000400:00000200:0.0:1773851894.790580:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8643@kfi7
00000400:00000200:0.0:1773851894.790581:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.790581:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 1
00000400:00000200:0.0:1773851894.790582:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:0.0:1773851894.790583:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000400:00000200:0.0:1773851894.790584:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8643@kfi7 local destination
00000400:00000200:0.0:1773851894.790586:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770144:8770144:1024:4294967295] 8643@kfi7 LPNI seq info [4079476:4079476:16:4294967295]
00000400:00000200:0.0:1773851894.790587:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000400:00000200:0.0:1773851894.790588:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8643@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.790590:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8643@kfi7(8643@kfi7:8643@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.790591:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 3
00000800:00000200:0.0:1773851894.790593:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.790594:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:0.0:1773851894.790596:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.790599:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 Using peer 8643@kfi7(0x1265)
00000800:00000200:0.0:1773851894.790601:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 740 bytes to peer 0x1265: rc=0
00000800:00000200:0.0:1773851894.790603:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.790605:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.790606:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0e27e8d refcount 2 to 8642@kfi7
00010000:00000001:0.0:1773851894.790606:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.790607:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.790607:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.790608:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fefe46eb x1859479459199424/t0(0) o101->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1031-0'
00000100:00100000:0.0:1773851894.790613:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fefe46eb pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:bc54700d-6af9-4c11-bc5c-79acaed48f9a+9:1699123:x1859479459199424:12345-8642@kfi7:101:default-tuolumne1031-0 Request processed in 776us (808us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.790615:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8642@kfi7, seq: 408701489
00000100:00000040:0.0:1773851894.790616:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c985270 : new rpc_count 0
00000100:00000001:0.0:1773851894.790617:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.790617:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.790618:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.790618:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851894.790619:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851894.790620:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 8
00000100:00000001:0.0:1773851894.790621:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851894.790626:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851894.790628:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851894.790629:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8643@kfi7: PUT: OK
00000400:00000200:2.0:1773851894.790629:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007a35718f
00000400:00000010:2.0:1773851894.790630:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007a35718f.
00000100:00000001:2.0:1773851894.790631:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851894.790631:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851894.790632:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ce1f865 nid 8643@kfi7 refs 2
00000800:00000200:2.0:1773851894.790634:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2069@kfi7:0 -> 8643@kfi7(00000000fee3cb27):0x0 lsk 4710 rsk 4 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1265 Transaction freed
00000800:00000200:25.0:1773851894.790710:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.790710:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.790711:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.790713:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851894.790715:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.790716:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8451@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.790717:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.790718:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 1
00000400:00000200:25.0:1773851894.790718:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.790719:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000400:00000200:25.0:1773851894.790720:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000400:00000200:25.0:1773851894.790721:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8642@kfi7 to cpt 5
00000400:00000200:25.0:1773851894.790722:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8642@kfi7 of length 328 into portal 17 MB=0x69b2fcca1fa40
00000400:00000200:25.0:1773851894.790723:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8642@kfi7 of length 328/328 into md 0x1615af82d9 [2] + 992
00000800:00000200:25.0:1773851894.790724:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851894.790730:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.790730:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8451@kfi7: PUT: OK
00000100:00000001:25.0:1773851894.790732:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851894.790732:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:25.0:1773851894.790735:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8381a57.
00000100:00000040:25.0:1773851894.790736:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b8381a57 x1859479459199552 msgsize 328
00000100:00100000:25.0:1773851894.790737:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8642@kfi7 (source: 12345-8451@kfi7)
00000100:00000001:25.0:1773851894.790739:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851894.790739:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000100:00000001:26.0:1773851894.790740:0:533719:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851894.790740:0:533719:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851894.790740:0:533719:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851894.790741:0:533719:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851894.790741:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851894.790742:0:533719:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851894.790743:0:533719:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479459199552
00000020:00000001:26.0:1773851894.790743:0:533719:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851894.790744:0:533719:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2dc17
00000020:00000001:26.0:1773851894.790745:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.790745:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000c985270 refcount=9
00000020:00000001:26.0:1773851894.790746:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000020:00000001:26.0:1773851894.790747:0:533719:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106247794688 : -106967461756928 : ffff9eb6b2708000)
00000100:00000001:26.0:1773851894.790748:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851894.790748:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851894.790749:0:533719:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000024e5a498.
00000020:00000010:26.0:1773851894.790750:0:533719:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851894.790751:0:533719:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000040:26.0:1773851894.790752:0:533719:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:26.0:1773851894.790753:0:533719:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851894.790753:0:533719:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:26.0:1773851894.790753:0:533719:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:26.0:1773851894.790754:0:533719:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.790754:0:533719:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:26.0:1773851894.790755:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.790755:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.790756:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d243d8b7 refcount=3
00000020:00000001:26.0:1773851894.790757:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000001:26.0:1773851894.790757:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000001:26.0:1773851894.790758:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.790759:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.790759:0:533719:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.790760:0:533719:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.790760:0:533719:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.790761:0:533719:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851894.790763:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851894.790763:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851894.790763:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851894.790763:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851894.790764:0:533719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8642@kfi7, seq: 105589646
00000100:00000040:26.0:1773851894.790765:0:533719:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000c985270 : new rpc_count 1
00000100:00000001:24.0:1773851894.790765:0:184027:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.790766:0:533719:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780437248 : -106994929114368 : ffff9eb04d41e300)
00000100:00000001:24.0:1773851894.790766:0:184027:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.790767:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b8381a57 x1859479459199552/t0(0) o103->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:26.0:1773851894.790770:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851894.790770:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851894.790771:0:533719:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8381a57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:bc54700d-6af9-4c11-bc5c-79acaed48f9a+9:40033:x1859479459199552:12345-8642@kfi7:103:
00000100:00000200:26.0:1773851894.790773:0:533719:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479459199552
00010000:00000001:26.0:1773851894.790773:0:533719:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:26.0:1773851894.790773:0:533719:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:26.0:1773851894.790774:0:533719:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:26.0:1773851894.790774:0:533719:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851894.790775:0:533719:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851894.790776:0:533719:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f991f47b.
02000000:00000001:26.0:1773851894.790776:0:533719:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.790777:0:533719:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.790777:0:533719:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:26.0:1773851894.790778:0:533719:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:26.0:1773851894.790778:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.790779:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.790779:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d243d8b7 refcount=3
00000020:00000001:26.0:1773851894.790780:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000001:26.0:1773851894.790780:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637164509342400 : -106909200209216 : ffff9ec443192ac0)
00010000:00000040:26.0:1773851894.790781:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00000004:00000001:26.0:1773851894.790782:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851894.790782:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851894.790782:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851894.790783:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851894.790783:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851894.790784:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.790785:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851894.790785:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851894.790786:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.790787:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.790787:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851894.790788:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851894.790789:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d243d8b7 with handle 0x21b6f08f07a6ae2d from hash
00010000:00000001:26.0:1773851894.790790:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851894.790790:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.790791:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.790791:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851894.790792:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851894.790792:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.790793:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851894.790793:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851894.790794:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d243d8b7/0x21b6f08f07a6ae2d lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8642@kfi7 remote: 0xea34c370deef0e6d expref: 9 pid: 42868 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851894.790796:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851894.790797:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000000c985270 : new locks_count 3
00000020:00000040:26.0:1773851894.790798:0:533719:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 8
00010000:00000010:26.0:1773851894.790799:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000084fdee8.
00010000:00000040:26.0:1773851894.790799:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:26.0:1773851894.790800:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.790800:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851894.790801:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851894.790802:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:26.0:1773851894.790802:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.790803:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.790804:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851894.790804:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00010000:26.0:1773851894.790805:0:533719:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:26.0:1773851894.790805:0:533719:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.790806:0:533719:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851894.790807:0:533719:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851894.790807:0:533719:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=148 v=66 (1 1 0 1)
00000100:00000001:26.0:1773851894.790808:0:533719:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851894.790809:0:533719:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f0e27e8d refcount 3 to 8642@kfi7
00000100:00000001:26.0:1773851894.790810:0:533719:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636920560355392 : -107153149196224 : ffff9e8b769b0840)
02000000:00000001:26.0:1773851894.790811:0:533719:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851894.790812:0:533719:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.790812:0:533719:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851894.790813:0:533719:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8451@kfi7
00000400:00000010:26.0:1773851894.790814:0:533719:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000091cf471c.
00000100:00000200:26.0:1773851894.790815:0:533719:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859479459199552, offset 224
00000400:00000200:26.0:1773851894.790816:0:533719:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8451@kfi7
00000400:00000200:26.0:1773851894.790817:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.790818:0:533719:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 1
00000400:00000200:26.0:1773851894.790818:0:533719:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000400:00000200:26.0:1773851894.790820:0:533719:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000400:00000200:26.0:1773851894.790821:0:533719:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8451@kfi7 local destination
00000400:00000200:26.0:1773851894.790822:0:533719:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770145:8770145:1024:4294967295] 8451@kfi7 LPNI seq info [4079477:4079477:16:4294967295]
00000400:00000200:26.0:1773851894.790824:0:533719:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000400:00000200:26.0:1773851894.790824:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8451@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.790826:0:533719:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8451@kfi7(8451@kfi7:8451@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851894.790827:0:533719:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 3
00000800:00000200:26.0:1773851894.790829:0:533719:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851894.790830:0:533719:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851894.790832:0:533719:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851894.790834:0:533719:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Using peer 8451@kfi7(0x100000000001267)
00000800:00000200:26.0:1773851894.790836:0:533719:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x100000000001267: rc=0
00000800:00000200:26.0:1773851894.790838:0:533719:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851894.790839:0:533719:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.790840:0:533719:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f0e27e8d refcount 2 to 8642@kfi7
00010000:00000001:26.0:1773851894.790841:0:533719:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.790841:0:533719:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.790842:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8381a57 x1859479459199552/t0(0) o103->bc54700d-6af9-4c11-bc5c-79acaed48f9a@8642@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:26.0:1773851894.790846:0:533719:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8381a57 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:bc54700d-6af9-4c11-bc5c-79acaed48f9a+8:40033:x1859479459199552:12345-8642@kfi7:103: Request processed in 75us (109us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851894.790848:0:533719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8642@kfi7, seq: 105589646
00000100:00000040:26.0:1773851894.790848:0:533719:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000c985270 : new rpc_count 0
00000100:00000001:26.0:1773851894.790849:0:533719:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851894.790850:0:533719:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851894.790850:0:533719:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000800:00000200:25.0:1773851894.790850:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851894.790851:0:533719:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000400:00000200:25.0:1773851894.790851:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851894.790852:0:533719:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000024e5a498.
00000400:00000200:25.0:1773851894.790852:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8451@kfi7: PUT: OK
00000020:00000040:26.0:1773851894.790853:0:533719:0:(genops.c:882:class_export_put()) PUTting export 000000000c985270 : new refcount 7
00000100:00000001:26.0:1773851894.790853:0:533719:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851894.790853:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000091cf471c
00000400:00000010:25.0:1773851894.790853:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000091cf471c.
00000100:00000001:25.0:1773851894.790854:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.790855:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.790855:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000da45a27a nid 8451@kfi7 refs 2
00000800:00000200:25.0:1773851894.790857:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 8451@kfi7(00000000e6c67797):0x0 lsk 4712 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001267 Transaction freed
00010000:00000010:26.1:1773851894.795727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000820c7d0d.
00010000:00000010:2.1:1773851894.795727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000009d396318.
00010000:00000010:26.1:1773851894.799728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000097d489dd.
00010000:00000010:0.1:1773851894.799728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000ec279978.
00010000:00000010:0.1:1773851894.799729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000003f515ee2.
00010000:00000010:0.1:1773851894.799730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000008ce5b96.
00010000:00000010:0.1:1773851894.799730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c346e481.
00010000:00000010:26.1:1773851894.803727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d243d8b7.
00010000:00000010:0.1:1773851894.803728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000fb94df81.
00000800:00000200:17.0:1773851894.853529:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851894.853530:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851894.853532:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851894.853534:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851894.853536:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.853537:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.39@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851894.853538:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.853539:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851894.853540:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:17.0:1773851894.853541:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:17.0:1773851894.853543:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:17.0:1773851894.853544:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:17.0:1773851894.853546:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.39@o2ib60 of length 224 into portal 12 MB=0x69b220e967f80
00000400:00000200:17.0:1773851894.853547:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.39@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 51440
00000800:00000200:17.0:1773851894.853549:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851894.853551:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851894.853552:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851894.853553:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851894.853553:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851894.853554:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a378d022.
00000100:00000040:17.0:1773851894.853555:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a378d022 x1859420436201344 msgsize 224
00000100:00100000:17.0:1773851894.853557:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.39@o2ib60 (source: 12345-192.168.128.39@o2ib60)
00000100:00000001:17.0:1773851894.853559:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851894.853560:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851894.853561:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851894.853562:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.853563:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.853563:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.853564:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.853565:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.853566:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859420436201344
00000020:00000001:0.0:1773851894.853567:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.853567:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ab51
00000020:00000001:0.0:1773851894.853568:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.853569:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000187322e6 refcount=125617
00000020:00000001:0.0:1773851894.853570:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000020:00000001:0.0:1773851894.853571:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000100:00000001:0.0:1773851894.853571:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.853572:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.853573:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851894.853574:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.853575:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000001:0.0:1773851894.853576:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.853576:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851894.853577:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.853578:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851894.853578:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851894.853579:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.853580:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.853581:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851894.853582:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.853582:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851894.853583:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851894.853583:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.39@o2ib60, seq: 1997621
00000100:00000001:2.0:1773851894.853584:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.853584:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000187322e6 : new rpc_count 9
00000100:00000001:2.0:1773851894.853585:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.853585:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968749696 : -106974740801920 : ffff9eb500931680)
00000100:00000040:0.0:1773851894.853586:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a378d022 x1859420436201344/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:534/0 lens 224/0 e 0 to 0 dl 1773852649 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix39-0'
00000100:00000001:0.0:1773851894.853589:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.853589:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.853591:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a378d022 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40557:x1859420436201344:12345-192.168.128.39@o2ib60:400:default-matrix39-0
00000100:00000200:0.0:1773851894.853592:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859420436201344
00000020:00000001:0.0:1773851894.853593:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851894.853594:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851894.853598:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.853598:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851894.853599:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851894.853599:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851894.853600:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859420436201344, found 0 last_xid 1859420408095423
00000020:00000001:0.0:1773851894.853601:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851894.853601:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851894.853601:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851894.853602:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.853603:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851894.853603:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.853604:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.853605:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008a3a78d9.
02000000:00000001:0.0:1773851894.853605:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.853606:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.853607:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851894.853608:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593807, transno 0, xid 1859420436201344
00010000:00000001:0.0:1773851894.853608:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851894.853609:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a378d022 x1859420436201344/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00010000:00000001:0.0:1773851894.853611:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.853612:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.853613:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=127 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851894.853614:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.853615:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b587bdf refcount 3 to 192.168.128.39@o2ib60
00000100:00000001:0.0:1773851894.853615:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441792 : -107146751109824 : ffff9e8cf3f61540)
02000000:00000001:0.0:1773851894.853616:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.853617:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.853618:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.853619:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.39@o2ib60
00000400:00000010:0.0:1773851894.853619:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ccec3e81.
00000100:00000200:0.0:1773851894.853620:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859420436201344, offset 224
00000400:00000200:0.0:1773851894.853622:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.39@o2ib60
00000400:00000200:0.0:1773851894.853623:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:0.0:1773851894.853625:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:0.0:1773851894.853626:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:0.0:1773851894.853627:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 4
00000400:00000200:0.0:1773851894.853629:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.39@o2ib60 routed destination
00000400:00000200:0.0:1773851894.853630:0:42868:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:0.0:1773851894.853631:0:42868:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:0.0:1773851894.853634:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:0.0:1773851894.853636:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:0.0:1773851894.853637:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:0.0:1773851894.853639:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:0.0:1773851894.853640:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770146:8770146:1024:4294967295] 17@kfi7 LPNI seq info [1250891922:1250891922:16:4294967295]
00000400:00000200:0.0:1773851894.853643:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:0.0:1773851894.853644:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:0.0:1773851894.853648:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.39@o2ib60(192.168.128.39@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.853651:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000800:00000200:0.0:1773851894.853653:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.853655:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851894.853659:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.853663:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:0.0:1773851894.853668:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:0.0:1773851894.853670:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.853673:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.853675:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b587bdf refcount 2 to 192.168.128.39@o2ib60
00010000:00000001:0.0:1773851894.853678:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851894.853680:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.853681:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851894.853682:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a378d022 x1859420436201344/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:534/0 lens 224/224 e 0 to 0 dl 1773852649 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00000100:00100000:0.0:1773851894.853689:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a378d022 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40557:x1859420436201344:12345-192.168.128.39@o2ib60:400:default-matrix39-0 Request processed in 98us (132us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.853694:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.39@o2ib60, seq: 1997621
00000100:00000040:0.0:1773851894.853695:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000187322e6 : new rpc_count 8
00000100:00000001:0.0:1773851894.853697:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.853698:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.853699:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.853700:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851894.853702:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851894.853703:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000187322e6 : new refcount 125616
00000100:00000001:0.0:1773851894.853704:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851894.853714:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.853717:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.853718:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.853720:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ccec3e81
00000400:00000010:1.0:1773851894.853721:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ccec3e81.
00000100:00000001:1.0:1773851894.853722:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.853723:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.853728:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:1.0:1773851894.853731:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Transaction freed
00000800:00000200:18.0:1773851894.885826:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851894.885826:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851894.885827:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851894.885827:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851894.885829:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851894.885829:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851894.885831:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851894.885831:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 14498@kfi7(0000000059cf43cc):0x8d2 version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851894.885833:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000800:00000200:17.0:1773851894.885833:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 Using peer 14498@kfi7(0x1000000000008d2)
00000400:00000200:18.0:1773851894.885835:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14498@kfi7 : PUT - for me
00000400:00000200:18.0:1773851894.885836:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.885836:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000400:00000200:18.0:1773851894.885837:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f481b6ec nid 14498@kfi7 refs 1
00000800:00000200:17.0:1773851894.885838:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 38 bytes to peer 0x1000000000008d2: rc=0
00000400:00000200:18.0:1773851894.885839:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000400:00000200:18.0:1773851894.885839:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f481b6ec nid 14498@kfi7 refs 2
00000800:00000200:17.0:1773851894.885839:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851894.885840:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f481b6ec nid 14498@kfi7 refs 3
00000400:00000200:18.0:1773851894.885841:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000400:00000200:18.0:1773851894.885842:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14498@kfi7 of length 456 into portal 12 MB=0x69b4be0cbb1c0
00000400:00000200:18.0:1773851894.885844:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14498@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 43200
00000800:00000200:18.0:1773851894.885846:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851894.885847:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851894.885848:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14498@kfi7: PUT: OK
00000100:00000001:18.0:1773851894.885849:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851894.885850:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851894.885850:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a53f8ba.
00000100:00000040:18.0:1773851894.885851:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000002a53f8ba x1859600056562112 msgsize 456
00000800:00000200:17.0:1773851894.885851:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851894.885853:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-14498@kfi7 (source: 12345-14498@kfi7)
00000100:00000001:18.0:1773851894.885854:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851894.885855:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f481b6ec nid 14498@kfi7 refs 2
00000100:00000001:19.0:1773851894.885856:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851894.885856:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000800:00000200:17.0:1773851894.885856:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 Transaction freed
02000000:00000001:19.0:1773851894.885857:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851894.885857:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851894.885858:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851894.885859:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851894.885860:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600056562112
00000020:00000001:19.0:1773851894.885860:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851894.885861:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f868
00000020:00000001:19.0:1773851894.885862:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851894.885865:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cd3dbdb1 refcount=3832
00000020:00000001:19.0:1773851894.885865:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125217116160 : -106948492435456 : ffff9ebb1d196000)
00000020:00000001:19.0:1773851894.885866:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125217116160 : -106948492435456 : ffff9ebb1d196000)
00000100:00000001:19.0:1773851894.885867:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851894.885868:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851894.885869:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fb2f5f8.
00000020:00000010:19.0:1773851894.885870:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851894.885871:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a9ee9a28.
00000100:00000001:19.0:1773851894.885872:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851894.885872:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851894.885873:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851894.885874:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851894.885875:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851894.885877:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851894.885877:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851894.885877:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851894.885877:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851894.885879:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14498@kfi7, seq: 323103293
00000100:00000040:16.0:1773851894.885879:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cd3dbdb1 : new rpc_count 25
00000100:00000001:19.0:1773851894.885880:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851894.885880:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.885880:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609991936 : -107015099559680 : ffff9eab9b015100)
00000100:00000040:16.0:1773851894.885882:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002a53f8ba x1859600056562112/t0(0) o17->e0617463-9db6-45c9-902a-014b15fdc2fe@14498@kfi7:621/0 lens 456/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1388-0'
00000100:00000001:16.0:1773851894.885884:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851894.885885:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851894.885886:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002a53f8ba pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e0617463-9db6-45c9-902a-014b15fdc2fe+3832:39612:x1859600056562112:12345-14498@kfi7:17:default-tuolumne1388-0
00000100:00000200:16.0:1773851894.885887:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600056562112
00000020:00000001:16.0:1773851894.885888:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851894.885889:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851894.885889:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.885890:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851894.885891:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:16.0:1773851894.885891:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851894.885892:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600056562112, found 0 last_xid 1859600055848447
00000020:00000001:16.0:1773851894.885893:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851894.885893:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851894.885894:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851894.885894:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:16.0:1773851894.885895:0:61039:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:16.0:1773851894.885896:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851894.885897:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851894.885898:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000006df6f7fb.
02000000:00000001:16.0:1773851894.885899:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.885899:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.885900:0:61039:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:16.0:1773851894.885901:0:61039:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:16.0:1773851894.885902:0:61039:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:16.0:1773851894.885903:0:61039:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.885904:0:61039:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:16.0:1773851894.885905:0:61039:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli e0617463-9db6-45c9-902a-014b15fdc2fe/00000000cd3dbdb1 free: 126633370845184 avail: 126633368748032
00000020:00000001:16.0:1773851894.885906:0:61039:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:16.0:1773851894.885906:0:61039:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli e0617463-9db6-45c9-902a-014b15fdc2fe/00000000cd3dbdb1 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:16.0:1773851894.885908:0:61039:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:16.0:1773851894.885908:0:61039:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:16.0:1773851894.885909:0:61039:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli e0617463-9db6-45c9-902a-014b15fdc2fe/00000000cd3dbdb1 reports grant 1796997119 dropped 0, local 1882456063
00000020:00000001:16.0:1773851894.885910:0:61039:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:16.0:1773851894.885911:0:61039:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:16.0:1773851894.885911:0:61039:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851894.885912:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593890, transno 0, xid 1859600056562112
00010000:00000001:16.0:1773851894.885913:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851894.885914:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002a53f8ba x1859600056562112/t0(0) o17->e0617463-9db6-45c9-902a-014b15fdc2fe@14498@kfi7:621/0 lens 456/432 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1388-0'
00010000:00000001:16.0:1773851894.885916:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851894.885917:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851894.885917:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=127 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851894.885918:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851894.885919:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000861b221c refcount 3 to 14498@kfi7
00000100:00000001:16.0:1773851894.885920:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333664 : -107155408217952 : ffff9e8aeff518a0)
02000000:00000001:16.0:1773851894.885921:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851894.885921:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851894.885922:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851894.885923:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14498@kfi7
00000400:00000010:16.0:1773851894.885924:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d67f7133.
00000100:00000200:16.0:1773851894.885924:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859600056562112, offset 224
00000400:00000200:16.0:1773851894.885926:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14498@kfi7
00000400:00000200:16.0:1773851894.885927:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000400:00000200:16.0:1773851894.885928:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f481b6ec nid 14498@kfi7 refs 1
00000400:00000200:16.0:1773851894.885929:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f481b6ec nid 14498@kfi7 refs 2
00000400:00000200:16.0:1773851894.885931:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f481b6ec nid 14498@kfi7 refs 3
00000400:00000200:16.0:1773851894.885932:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14498@kfi7 local destination
00000400:00000200:16.0:1773851894.885933:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770147:8770147:1024:4294967295] 14498@kfi7 LPNI seq info [14359370:14359370:16:4294967295]
00000400:00000200:16.0:1773851894.885934:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f481b6ec nid 14498@kfi7 refs 2
00000400:00000200:16.0:1773851894.885935:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14498@kfi7 to cpt 4
00000400:00000200:16.0:1773851894.885937:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14498@kfi7(14498@kfi7:14498@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851894.885938:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f481b6ec nid 14498@kfi7 refs 3
00000800:00000200:16.0:1773851894.885940:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851894.885941:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:16.0:1773851894.885943:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851894.885945:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 Using peer 14498@kfi7(0x1000000000008d2)
00000800:00000200:16.0:1773851894.885948:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009aebe925: Posted send of 532 bytes to peer 0x1000000000008d2: rc=0
00000800:00000200:16.0:1773851894.885950:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851894.885952:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851894.885953:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000861b221c refcount 2 to 14498@kfi7
00010000:00000001:16.0:1773851894.885953:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851894.885954:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.885954:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851894.885955:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a53f8ba x1859600056562112/t0(0) o17->e0617463-9db6-45c9-902a-014b15fdc2fe@14498@kfi7:621/0 lens 456/432 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1388-0'
00000100:00100000:16.0:1773851894.885959:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002a53f8ba pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e0617463-9db6-45c9-902a-014b15fdc2fe+3832:39612:x1859600056562112:12345-14498@kfi7:17:default-tuolumne1388-0 Request processed in 74us (107us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851894.885962:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14498@kfi7, seq: 323103293
00000100:00000040:16.0:1773851894.885963:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cd3dbdb1 : new rpc_count 24
00000100:00000001:16.0:1773851894.885964:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851894.885965:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851894.885965:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:16.0:1773851894.885966:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a9ee9a28.
00000020:00000010:16.0:1773851894.885967:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fb2f5f8.
00000020:00000040:16.0:1773851894.885968:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000cd3dbdb1 : new refcount 3831
00000100:00000001:16.0:1773851894.885968:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851894.885973:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851894.885975:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851894.885976:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14498@kfi7: PUT: OK
00000400:00000200:17.0:1773851894.885977:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d67f7133
00000400:00000010:17.0:1773851894.885977:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d67f7133.
00000100:00000001:17.0:1773851894.885978:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851894.885978:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851894.885979:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f481b6ec nid 14498@kfi7 refs 2
00000800:00000200:17.0:1773851894.885980:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2054@kfi7:4 -> 14498@kfi7(0000000059cf43cc):0x0 lsk 2259 rsk 19 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008d2 Transaction freed
00000800:00000200:26.0:1773851894.907987:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.907987:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851894.907988:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.907988:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851894.907990:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.907990:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851894.907992:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851894.907992:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8658@kfi7(0000000015b25e06):0x127c version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851894.907993:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Using peer 8658@kfi7(0x10000000000127c)
00000400:00000200:26.0:1773851894.907994:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.907995:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8658@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.907995:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.907996:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.907997:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000800:00000200:25.0:1773851894.907997:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000878f9def: Posted send of 38 bytes to peer 0x10000000000127c: rc=0
00000400:00000200:26.0:1773851894.907998:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.907998:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000800:00000200:25.0:1773851894.907998:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851894.907999:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:26.0:1773851894.908000:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.908001:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8658@kfi7 of length 576 into portal 12 MB=0x69b2fd4bf5a00
00000400:00000200:26.0:1773851894.908003:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8658@kfi7 of length 576/576 into md 0x16159c9699 [64] + 35120
00000800:00000200:26.0:1773851894.908005:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851894.908007:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851894.908009:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8658@kfi7: PUT: OK
00000100:00000001:26.0:1773851894.908010:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851894.908011:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851894.908011:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_EVENT_TX_OK event status 0
00000100:00000010:26.0:1773851894.908012:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000099fb56c2.
00000100:00000040:26.0:1773851894.908012:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000099fb56c2 x1859479595342336 msgsize 576
00000800:00000200:25.0:1773851894.908013:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Transaction freed
00000100:00100000:26.0:1773851894.908014:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-8658@kfi7 (source: 12345-8658@kfi7)
00000100:00000001:26.0:1773851894.908015:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851894.908016:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000100:00000001:24.0:1773851894.908017:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851894.908017:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851894.908018:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851894.908018:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851894.908018:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851894.908019:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851894.908020:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479595342336
00000020:00000001:24.0:1773851894.908020:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851894.908021:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2fc9a
00000020:00000001:24.0:1773851894.908021:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.908022:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef161c6c refcount=8
00000020:00000001:24.0:1773851894.908023:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000020:00000001:24.0:1773851894.908024:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000100:00000001:24.0:1773851894.908025:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851894.908025:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851894.908026:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008edcd5fb.
00000020:00000010:24.0:1773851894.908027:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851894.908028:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e24711f.
00000100:00000001:24.0:1773851894.908029:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851894.908029:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:24.0:1773851894.908030:0:60973:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:24.0:1773851894.908030:0:60973:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.908031:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.908032:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.908033:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851894.908034:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851894.908034:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851894.908036:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:24.0:1773851894.908036:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8658@kfi7, seq: 1451911039
00000100:00000040:24.0:1773851894.908036:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef161c6c : new rpc_count 1
00000100:00000001:27.0:1773851894.908037:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851894.908037:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144347111552 : -106929362440064 : ffff9ebf9155f080)
00000100:00000001:27.0:1773851894.908038:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851894.908038:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000099fb56c2 x1859479595342336/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:144/0 lens 576/0 e 0 to 0 dl 1773852259 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1029-0'
00000100:00000001:27.0:1773851894.908039:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.908041:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851894.908042:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851894.908043:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000099fb56c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:2067503:x1859479595342336:12345-8658@kfi7:101:default-tuolumne1029-0
00000100:00000200:24.0:1773851894.908044:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479595342336
00000020:00000001:24.0:1773851894.908045:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851894.908045:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851894.908046:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.908047:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851894.908047:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:24.0:1773851894.908048:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851894.908049:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479595342336, found 0 last_xid 1859479595342335
00000020:00000001:24.0:1773851894.908049:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851894.908050:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851894.908051:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851894.908051:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.908052:0:60973:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:24.0:1773851894.908052:0:60973:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:24.0:1773851894.908053:0:60973:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:24.0:1773851894.908053:0:60973:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:24.0:1773851894.908054:0:60973:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.908057:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851894.908058:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 194
00010000:00000001:24.0:1773851894.908059:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.908059:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.908060:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000002127fc97.
00000020:00000001:24.0:1773851894.908061:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.908062:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000002127fc97 with handle 0x21b6f08f07a6ae34 to hash
00000020:00000001:24.0:1773851894.908062:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.908063:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637115981074368 : -106957728477248 : ffff9eb8f6968fc0)
00010000:00000010:24.0:1773851894.908064:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000003a8b4b11.
00010000:00000001:24.0:1773851894.908065:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637115981074368 : -106957728477248 : ffff9eb8f6968fc0)
00010000:00010000:24.0:1773851894.908065:0:60973:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000002127fc97/0x21b6f08f07a6ae34 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b0aff8279d4641f expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908068:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:24.0:1773851894.908069:0:60973:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ef161c6c : new locks_count 4
00000020:00000040:24.0:1773851894.908069:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000ef161c6c refcount=9
00010000:00000001:24.0:1773851894.908071:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:24.0:1773851894.908071:0:60973:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:24.0:1773851894.908073:0:60973:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:24.0:1773851894.908073:0:60973:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:24.0:1773851894.908074:0:60973:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:24.0:1773851894.908074:0:60973:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:24.0:1773851894.908074:0:60973:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:24.0:1773851894.908075:0:60973:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:24.0:1773851894.908077:0:60973:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:24.0:1773851894.908077:0:60973:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:24.0:1773851894.908078:0:60973:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908079:0:60973:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:24.0:1773851894.908079:0:60973:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:24.0:1773851894.908080:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851894.908080:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851894.908082:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 0000000082f6daba.
02000000:00000001:24.0:1773851894.908083:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.908083:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908084:0:60973:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908084:0:60973:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:24.0:1773851894.908085:0:60973:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:24.0:1773851894.908086:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.908086:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908087:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.908087:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908088:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.908088:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908089:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.908089:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908089:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.908089:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851894.908090:0:60973:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:24.0:1773851894.908091:0:60973:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:24.0:1773851894.908092:0:60973:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:24.0:1773851894.908092:0:60973:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908093:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.908093:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908094:0:60973:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:24.0:1773851894.908094:0:60973:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908095:0:60973:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:24.0:1773851894.908095:0:60973:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 000000001c852c43
00000004:00000001:24.0:1773851894.908096:0:60973:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:24.0:1773851894.908097:0:60973:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:24.0:1773851894.908097:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851894.908098:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851894.908098:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.908099:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.908099:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.908100:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000005ba4d8aa.
00000020:00000001:24.0:1773851894.908100:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.908101:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000005ba4d8aa with handle 0x21b6f08f07a6ae3b to hash
00000020:00000001:24.0:1773851894.908101:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.908102:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000010:24.0:1773851894.908102:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000034f8f89b.
00010000:00000001:24.0:1773851894.908103:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851894.908103:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.908104:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.908105:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6ae3b lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908107:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.908108:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851894.908108:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851894.908109:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851894.908109:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.908110:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.908111:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.908111:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.908112:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851894.908112:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851894.908113:0:60973:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851894.908113:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851894.908114:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 195
00010000:00000040:24.0:1773851894.908115:0:60973:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:24.0:1773851894.908116:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908119:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908120:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908122:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908123:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908125:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908127:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908128:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908130:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908132:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908134:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908136:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908137:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908139:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908140:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908142:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908144:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908145:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908147:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908149:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908150:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908152:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908153:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908155:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908156:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908158:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908159:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908161:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908162:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908164:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908165:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908167:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908168:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908170:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908172:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908173:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908174:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908176:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908178:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908179:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908181:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908183:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908185:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908186:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908188:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908189:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908190:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908192:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908193:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908195:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908197:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908198:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908200:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908201:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908203:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908204:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908206:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908208:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908209:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908211:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908212:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908214:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908215:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908217:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908218:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908220:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908221:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908222:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908224:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908225:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908227:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908228:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908230:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908233:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908235:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908237:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908238:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908239:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908240:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908242:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908243:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908245:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908247:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908248:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908250:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908252:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908253:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908255:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908256:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908258:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908259:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908261:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908262:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908264:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908265:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908267:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908269:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908270:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908271:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908273:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908274:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908276:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908278:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908279:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908281:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908283:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908284:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908286:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908287:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908289:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908290:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908291:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908292:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908294:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908295:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908297:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908298:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908300:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908301:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908303:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908304:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908306:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908307:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908309:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908310:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908312:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908313:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908315:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908316:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908318:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908319:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908321:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908322:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908324:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908325:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908326:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908327:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908330:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908331:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908333:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908334:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908335:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908337:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908338:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908339:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908341:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908342:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908344:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908345:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908347:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908348:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908349:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908351:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908353:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908354:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908356:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908357:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908359:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908360:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908362:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908363:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908365:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908366:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908368:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908369:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908371:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908372:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908374:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908375:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908377:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908379:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908381:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908382:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908384:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908385:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908387:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908389:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908391:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908392:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908394:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908396:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908398:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908399:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908401:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908403:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908405:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908406:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908408:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908410:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908412:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908413:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908415:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908417:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908419:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908421:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908423:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908424:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908427:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908428:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908430:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908431:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908433:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908435:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908437:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908438:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908440:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908442:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908444:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908446:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908448:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908449:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908451:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908452:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908454:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908455:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908457:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908458:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908460:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908462:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908464:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908465:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908468:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908469:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 9 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908471:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908473:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908475:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908476:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908478:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908480:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908482:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908483:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908486:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908487:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908489:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908490:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908492:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908494:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908496:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908497:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908499:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908501:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908503:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908505:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908507:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908508:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908511:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908512:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908514:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908516:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908518:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908520:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908521:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908523:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908525:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908527:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908529:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908530:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908532:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908534:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908536:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908537:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908539:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908540:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908542:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908544:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908546:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908547:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908549:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908551:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908553:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908554:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908556:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908558:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908560:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908562:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908564:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908565:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908567:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908568:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908570:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908571:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908574:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908575:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908577:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908578:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908580:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908582:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908584:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908585:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908587:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908589:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908591:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908592:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908594:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908595:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908598:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908599:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908602:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908603:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908605:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908606:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908609:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908610:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908612:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908613:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908615:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908617:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908619:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908620:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908622:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908624:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908626:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908627:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908630:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908631:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908633:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908634:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908637:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908638:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908640:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908641:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908643:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908645:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908647:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908648:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908650:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908652:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908654:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908655:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908658:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908660:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908662:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908663:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908665:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908666:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908668:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908670:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908672:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908674:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908676:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908677:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908679:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908681:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908683:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908684:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908687:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908688:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908690:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908691:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908693:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908695:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908697:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908698:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908700:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908701:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908703:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908705:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908707:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908708:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908710:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908711:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908713:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908715:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908717:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908718:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908720:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908722:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908724:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908729:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908731:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908732:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908734:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908736:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908738:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908739:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908741:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908743:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908745:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908747:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908749:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908750:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908752:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908754:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908756:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908757:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908759:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:24.0:1773851894.908759:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6ae3b lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908762:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.908762:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851894.908763:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851894.908763:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.908764:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851894.908764:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.908765:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.908766:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.908767:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851894.908767:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.908768:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6ae3b lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908771:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.908771:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851894.908772:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.908772:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.908773:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.908773:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.908773:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005ba4d8aa refcount=3
00000020:00000001:24.0:1773851894.908774:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851894.908775:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851894.908775:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.908776:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.908776:0:60973:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908777:0:60973:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908778:0:60973:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:24.0:1773851894.908779:0:60973:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:24.0:1773851894.908780:0:60973:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:24.0:1773851894.908788:0:60973:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908789:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851894.908790:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.908790:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.908792:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908793:0:60973:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908794:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908794:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851894.908795:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.908795:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.908795:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908796:0:60973:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908797:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:24.0:1773851894.908798:0:60973:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:24.0:1773851894.908798:0:60973:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908799:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.908800:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908801:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.908801:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.908802:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.908802:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:24.0:1773851894.908803:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.908803:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:24.0:1773851894.908804:0:60973:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:24.0:1773851894.908805:0:60973:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:24.0:1773851894.908806:0:60973:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:24.0:1773851894.908807:0:60973:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:24.0:1773851894.908807:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.908808:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908808:0:60973:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:24.0:1773851894.908809:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851894.908809:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.908810:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.908810:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908811:0:60973:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908811:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.908812:0:60973:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.908813:0:60973:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000010:24.0:1773851894.908815:0:60973:0:(lprocfs_status.c:1166:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 960 at 0000000072b77241 (tot 253201843).
00000020:00000001:24.0:1773851894.908817:0:60973:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908817:0:60973:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908820:0:60973:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.908820:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.908821:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.908821:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005ba4d8aa refcount=3
00000020:00000001:24.0:1773851894.908822:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:24.0:1773851894.908822:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00000004:00000040:24.0:1773851894.908823:0:60973:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000ef161c6c : new locks_count 5
00000020:00000040:24.0:1773851894.908824:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000ef161c6c refcount=10
00010000:00000001:24.0:1773851894.908825:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.908825:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.908826:0:60973:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851894.908827:0:60973:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:24.0:1773851894.908827:0:60973:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:24.0:1773851894.908828:0:60973:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:24.0:1773851894.908828:0:60973:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:24.0:1773851894.908829:0:60973:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:24.0:1773851894.908829:0:60973:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:24.0:1773851894.908830:0:60973:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:24.0:1773851894.908831:0:60973:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.908832:0:60973:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851894.908832:0:60973:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:24.0:1773851894.908833:0:60973:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:24.0:1773851894.908834:0:60973:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:24.0:1773851894.908835:0:60973:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:24.0:1773851894.908836:0:60973:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:24.0:1773851894.908836:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851894.908837:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.908837:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.908838:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.908838:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851894.908839:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000002127fc97 with handle 0x21b6f08f07a6ae34 from hash
00010000:00000001:24.0:1773851894.908840:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851894.908840:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.908840:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.908840:0:60973:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:24.0:1773851894.908841:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851894.908841:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000002127fc97/0x21b6f08f07a6ae34 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4641f expref: 10 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908844:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.908844:0:60973:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ef161c6c : new locks_count 4
00000020:00000040:24.0:1773851894.908845:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 9
00010000:00000010:24.0:1773851894.908846:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003a8b4b11.
00010000:00000040:24.0:1773851894.908847:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:24.0:1773851894.908847:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.908847:0:60973:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.908858:0:60973:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:24.0:1773851894.908859:0:60973:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6ae3b lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4641f expref: 9 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.908861:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:24.0:1773851894.908862:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851894.908863:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851894.908863:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:24.0:1773851894.908864:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:24.0:1773851894.908865:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.908865:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.908866:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851894.908867:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.908867:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851894.908867:0:60973:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005ba4d8aa, rc 0)
00000020:00000001:24.0:1773851894.908868:0:60973:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851894.908869:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106902121, transno 0, xid 1859479595342336
00010000:00000001:24.0:1773851894.908870:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851894.908871:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000099fb56c2 x1859479595342336/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:144/0 lens 576/640 e 0 to 0 dl 1773852259 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1029-0'
00010000:00000001:24.0:1773851894.908874:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851894.908874:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851894.908875:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=127 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851894.908876:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851894.908877:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d208fb4 refcount 3 to 8658@kfi7
00000100:00000001:24.0:1773851894.908878:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637098420265536 : -106975289286080 : ffff9eb4dfe1e240)
02000000:00000001:24.0:1773851894.908879:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851894.908879:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.908880:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851894.908881:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8658@kfi7
00000400:00000010:24.0:1773851894.908882:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c389395c.
00000100:00000200:24.0:1773851894.908883:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859479595342336, offset 224
00000400:00000200:24.0:1773851894.908885:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8658@kfi7
00000400:00000200:24.0:1773851894.908886:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:24.0:1773851894.908888:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000400:00000200:24.0:1773851894.908889:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:24.0:1773851894.908890:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:24.0:1773851894.908891:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8658@kfi7 local destination
00000400:00000200:24.0:1773851894.908892:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770148:8770148:1024:4294967295] 8658@kfi7 LPNI seq info [4888389:4888389:16:4294967295]
00000400:00000200:24.0:1773851894.908894:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:24.0:1773851894.908895:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:24.0:1773851894.908897:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8658@kfi7(8658@kfi7:8658@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851894.908898:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000800:00000200:24.0:1773851894.908900:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851894.908901:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:24.0:1773851894.908904:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851894.908906:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Using peer 8658@kfi7(0x10000000000127c)
00000800:00000200:24.0:1773851894.908909:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 740 bytes to peer 0x10000000000127c: rc=0
00000800:00000200:24.0:1773851894.908911:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851894.908913:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851894.908914:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d208fb4 refcount 2 to 8658@kfi7
00010000:00000001:24.0:1773851894.908915:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851894.908915:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.908916:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851894.908917:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000099fb56c2 x1859479595342336/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:144/0 lens 576/640 e 0 to 0 dl 1773852259 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1029-0'
00000100:00100000:24.0:1773851894.908922:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000099fb56c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:94bc7d8e-6987-4a1b-8756-91253d59cad1+9:2067503:x1859479595342336:12345-8658@kfi7:101:default-tuolumne1029-0 Request processed in 880us (909us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851894.908925:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8658@kfi7, seq: 1451911039
00000100:00000040:24.0:1773851894.908926:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef161c6c : new rpc_count 0
00000100:00000001:24.0:1773851894.908927:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851894.908928:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851894.908928:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851894.908929:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e24711f.
00000020:00000010:24.0:1773851894.908930:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008edcd5fb.
00000020:00000040:24.0:1773851894.908931:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 8
00000100:00000001:24.0:1773851894.908932:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851894.908937:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851894.908938:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.908939:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8658@kfi7: PUT: OK
00000400:00000200:25.0:1773851894.908940:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c389395c
00000400:00000010:25.0:1773851894.908941:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c389395c.
00000100:00000001:25.0:1773851894.908941:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.908942:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.908943:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000800:00000200:25.0:1773851894.908944:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Transaction freed
00000800:00000200:6.0:1773851894.909029:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.909029:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851894.909030:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851894.909030:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851894.909031:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851894.909031:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851894.909034:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851894.909034:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8659@kfi7(000000004751cfe3):0x1278 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851894.909035:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 Using peer 8659@kfi7(0x1278)
00000400:00000200:6.0:1773851894.909036:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.909037:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8659@kfi7 : PUT - for me
00000400:00000200:5.0:1773851894.909037:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.909038:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.909039:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 1
00000800:00000200:5.0:1773851894.909039:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 38 bytes to peer 0x1278: rc=0
00000800:00000200:5.0:1773851894.909040:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851894.909041:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.909042:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000400:00000200:6.0:1773851894.909043:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 3
00000400:00000200:6.0:1773851894.909044:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:6.0:1773851894.909045:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8658@kfi7 of length 328 into portal 17 MB=0x69b2fd4bf5a80
00000400:00000200:6.0:1773851894.909047:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8658@kfi7 of length 328/328 into md 0x7939ffee5 [2] + 1552
00000800:00000200:6.0:1773851894.909049:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851894.909051:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851894.909052:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8659@kfi7: PUT: OK
00000100:00000001:6.0:1773851894.909054:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851894.909054:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000800:00000200:5.0:1773851894.909054:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 TN_EVENT_TX_OK event status 0
00000100:00000010:6.0:1773851894.909055:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c57e563d.
00000100:00000040:6.0:1773851894.909056:0:2499722:0:(events.c:358:request_in_callback()) incoming req@00000000c57e563d x1859479595342464 msgsize 328
00000800:00000200:5.0:1773851894.909056:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 Transaction freed
00000100:00100000:6.0:1773851894.909058:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-8658@kfi7 (source: 12345-8659@kfi7)
00000100:00000001:6.0:1773851894.909060:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851894.909060:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000800:00000200:6.0:1773851894.909062:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000618b435b: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851894.909062:0:61161:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851894.909063:0:61161:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851894.909064:0:61161:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851894.909064:0:61161:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851894.909065:0:61161:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851894.909066:0:61161:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479595342464
00000020:00000001:5.0:1773851894.909067:0:61161:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851894.909067:0:61161:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2fc9a
00000020:00000001:5.0:1773851894.909068:0:61161:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851894.909071:0:61161:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef161c6c refcount=9
00000020:00000001:5.0:1773851894.909071:0:61161:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000020:00000001:5.0:1773851894.909072:0:61161:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000100:00000001:5.0:1773851894.909073:0:61161:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851894.909075:0:61161:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851894.909076:0:61161:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000037a7757e.
00000020:00000010:5.0:1773851894.909077:0:61161:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851894.909078:0:61161:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a694bc33.
00000100:00000040:5.0:1773851894.909079:0:61161:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:5.0:1773851894.909080:0:61161:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851894.909080:0:61161:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:5.0:1773851894.909081:0:61161:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:5.0:1773851894.909082:0:61161:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.909083:0:61161:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:5.0:1773851894.909083:0:61161:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:5.0:1773851894.909084:0:61161:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851894.909085:0:61161:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005ba4d8aa refcount=3
00000020:00000001:5.0:1773851894.909085:0:61161:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:5.0:1773851894.909086:0:61161:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00010000:00000001:5.0:1773851894.909087:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851894.909087:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:5.0:1773851894.909088:0:61161:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.909089:0:61161:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.909090:0:61161:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.909091:0:61161:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851894.909093:0:61161:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851894.909093:0:61161:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851894.909094:0:61161:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8658@kfi7, seq: 43812577
00000100:00000001:7.0:1773851894.909095:0:82918:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:5.0:1773851894.909095:0:61161:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef161c6c : new rpc_count 1
00000100:00000001:7.0:1773851894.909096:0:82918:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851894.909096:0:82918:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.909096:0:61161:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637025359396864 : -107048350154752 : ffff9ea3dd1d8000)
00000100:00000040:5.0:1773851894.909097:0:61161:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c57e563d x1859479595342464/t0(0) o103->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:7.0:1773851894.909098:0:82918:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.909100:0:61161:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851894.909100:0:61161:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000800:00000200:25.0:1773851894.909101:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00100000:5.0:1773851894.909101:0:61161:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c57e563d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn01_004:94bc7d8e-6987-4a1b-8756-91253d59cad1+9:39963:x1859479595342464:12345-8658@kfi7:103:
00000800:00000200:25.0:1773851894.909102:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.909103:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:5.0:1773851894.909103:0:61161:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479595342464
00010000:00000001:5.0:1773851894.909103:0:61161:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:5.0:1773851894.909104:0:61161:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00000800:00000200:25.0:1773851894.909105:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00010000:00000001:5.0:1773851894.909105:0:61161:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:5.0:1773851894.909106:0:61161:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:25.0:1773851894.909107:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
02000000:00000001:5.0:1773851894.909107:0:61161:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851894.909108:0:61161:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b011310e.
02000000:00000001:5.0:1773851894.909108:0:61161:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851894.909109:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.909109:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000100:00000001:5.0:1773851894.909109:0:61161:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851894.909110:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00010000:00000001:5.0:1773851894.909110:0:61161:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00000400:00000200:25.0:1773851894.909111:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00010000:00010000:5.0:1773851894.909111:0:61161:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:5.0:1773851894.909111:0:61161:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000400:00000200:25.0:1773851894.909112:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000020:00000001:5.0:1773851894.909112:0:61161:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851894.909112:0:61161:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000005ba4d8aa refcount=3
00000020:00000001:5.0:1773851894.909112:0:61161:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00000400:00000200:25.0:1773851894.909113:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851894.909113:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00010000:00000001:5.0:1773851894.909113:0:61161:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637074421343808 : -106999288207808 : ffff9eaf496f6640)
00000400:00000200:25.0:1773851894.909114:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 328 into portal 24 MB=0x69b1a860c9940
00010000:00000040:5.0:1773851894.909114:0:61161:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00000004:00000001:5.0:1773851894.909115:0:61161:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00000400:00000200:25.0:1773851894.909116:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 328/328 into md 0x160dfce379 [256] + 14960
00010000:00000001:5.0:1773851894.909116:0:61161:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:5.0:1773851894.909117:0:61161:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00000800:00000200:25.0:1773851894.909118:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:5.0:1773851894.909118:0:61161:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:5.0:1773851894.909118:0:61161:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851894.909119:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:5.0:1773851894.909119:0:61161:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851894.909120:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00010000:00000001:5.0:1773851894.909121:0:61161:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:5.0:1773851894.909121:0:61161:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00000100:00000001:25.0:1773851894.909122:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851894.909122:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851894.909123:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f0f5fbbf.
00010000:00000001:5.0:1773851894.909123:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851894.909123:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000040:25.0:1773851894.909124:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000f0f5fbbf x1859388080691520 msgsize 328
00010000:00000001:5.0:1773851894.909124:0:61161:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:5.0:1773851894.909124:0:61161:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851894.909125:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000020:00000040:5.0:1773851894.909125:0:61161:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000005ba4d8aa with handle 0x21b6f08f07a6ae3b from hash
00000100:00000001:25.0:1773851894.909126:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000001:5.0:1773851894.909126:0:61161:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:5.0:1773851894.909126:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000400:00000200:25.0:1773851894.909127:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00010000:00000001:5.0:1773851894.909127:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:5.0:1773851894.909127:0:61161:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00000800:00000200:25.0:1773851894.909128:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00010000:00000001:5.0:1773851894.909128:0:61161:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:5.0:1773851894.909129:0:61161:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.909129:0:61161:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:5.0:1773851894.909130:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:25.0:1773851894.909131:0:1691804:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00010000:00010000:5.0:1773851894.909131:0:61161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000005ba4d8aa/0x21b6f08f07a6ae3b lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4641f expref: 9 pid: 60973 timeout: 0 lvb_type: 0
02000000:00000001:25.0:1773851894.909132:0:1691804:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851894.909132:0:1691804:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851894.909133:0:1691804:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851894.909134:0:1691804:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851894.909134:0:1691804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080691520
00010000:00000040:5.0:1773851894.909134:0:61161:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00000020:00000001:25.0:1773851894.909135:0:1691804:0:(genops.c:802:class_conn2export()) Process entered
00010000:00000040:5.0:1773851894.909135:0:61161:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ef161c6c : new locks_count 3
00000020:00000040:25.0:1773851894.909136:0:1691804:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:25.0:1773851894.909136:0:1691804:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851894.909136:0:61161:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 8
00000020:00000040:25.0:1773851894.909137:0:1691804:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00010000:00000010:5.0:1773851894.909137:0:61161:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000034f8f89b.
00000020:00000001:25.0:1773851894.909138:0:1691804:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00010000:00000040:5.0:1773851894.909138:0:61161:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00000020:00000001:25.0:1773851894.909139:0:1691804:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00010000:00000001:5.0:1773851894.909139:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:5.0:1773851894.909139:0:61161:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00000100:00000001:25.0:1773851894.909140:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851894.909140:0:1691804:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00010000:00000001:5.0:1773851894.909140:0:61161:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:5.0:1773851894.909140:0:61161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00000020:00000010:25.0:1773851894.909141:0:1691804:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d39d7b35.
00000020:00000010:25.0:1773851894.909142:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00010000:00000001:5.0:1773851894.909142:0:61161:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:25.0:1773851894.909143:0:1691804:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005924beeb.
00010000:00000001:5.0:1773851894.909143:0:61161:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.909143:0:61161:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00000100:00000040:25.0:1773851894.909144:0:1691804:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00010000:00000040:5.0:1773851894.909144:0:61161:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00010000:00010000:5.0:1773851894.909144:0:61161:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00000100:00000001:25.0:1773851894.909145:0:1691804:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00010000:00000001:5.0:1773851894.909145:0:61161:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851894.909146:0:1691804:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851894.909146:0:1691804:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.909146:0:61161:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:25.0:1773851894.909147:0:1691804:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.909147:0:61161:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851894.909148:0:1691804:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:5.0:1773851894.909148:0:61161:0:(import.c:1951:at_measured()) add 1 to 0000000099aaac99 time=148 v=66 (1 1 0 1)
00000100:00000001:25.0:1773851894.909149:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851894.909149:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851894.909149:0:61161:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851894.909149:0:61161:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d208fb4 refcount 3 to 8658@kfi7
00000100:00000001:25.0:1773851894.909150:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851894.909150:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851894.909150:0:61161:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637098420265536 : -106975289286080 : ffff9eb4dfe1e240)
00000100:00100000:25.0:1773851894.909151:0:1691804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799989
02000000:00000001:5.0:1773851894.909151:0:61161:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000040:25.0:1773851894.909152:0:1691804:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:24.0:1773851894.909152:0:1537164:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851894.909152:0:61161:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851894.909153:0:1691804:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780426880 : -106994929124736 : ffff9eb04d41ba80)
00000100:00000001:24.0:1773851894.909153:0:1537164:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.909153:0:61161:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851894.909154:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f0f5fbbf x1859388080691520/t0(0) o1000->lustre5-MDT0004-mdtlov_UUID@7@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000040:5.0:1773851894.909154:0:61161:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8659@kfi7
00000400:00000010:5.0:1773851894.909154:0:61161:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000690e571.
00000100:00000200:5.0:1773851894.909155:0:61161:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859479595342464, offset 224
00000100:00000001:25.0:1773851894.909157:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851894.909157:0:1691804:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:5.0:1773851894.909157:0:61161:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8659@kfi7
00000100:00100000:25.0:1773851894.909158:0:1691804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f0f5fbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:127549:x1859388080691520:12345-7@kfi7:1000:default-yuba5-0
00000400:00000200:5.0:1773851894.909158:0:61161:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000100:00000200:25.0:1773851894.909159:0:1691804:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080691520
00000400:00000200:5.0:1773851894.909159:0:61161:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 1
00000020:00000001:25.0:1773851894.909160:0:1691804:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851894.909160:0:1691804:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:5.0:1773851894.909160:0:61161:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000020:00000001:25.0:1773851894.909161:0:1691804:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851894.909161:0:1691804:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851894.909162:0:1691804:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667521856 : -1042029760 : ffffffffc1e3e340)
00000020:00000001:25.0:1773851894.909162:0:1691804:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000400:00000200:5.0:1773851894.909162:0:61161:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 3
00000020:00000001:25.0:1773851894.909163:0:1691804:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851894.909163:0:1691804:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000400:00000200:5.0:1773851894.909163:0:61161:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8659@kfi7 local destination
00000020:00000001:25.0:1773851894.909164:0:1691804:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851894.909164:0:1691804:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851894.909165:0:1691804:0:(out_handler.c:970:out_handle()) Process entered
00000400:00000200:5.0:1773851894.909165:0:61161:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770149:8770149:1024:4294967295] 8659@kfi7 LPNI seq info [4888390:4888390:16:4294967295]
00000020:00000010:25.0:1773851894.909166:0:1691804:0:(out_handler.c:993:out_handle()) kmalloced '(update_bufs)': 8 at 000000002d7248d2.
00000400:00000200:5.0:1773851894.909166:0:61161:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000100:00000001:25.0:1773851894.909167:0:1691804:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:5.0:1773851894.909167:0:61161:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
02000000:00000001:25.0:1773851894.909168:0:1691804:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851894.909169:0:1691804:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 4576 at 00000000e560427f.
02000000:00000001:25.0:1773851894.909169:0:1691804:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851894.909170:0:1691804:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851894.909170:0:61161:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8659@kfi7(8659@kfi7:8659@kfi7) <?> : PUT try# 0
00000020:00000001:25.0:1773851894.909171:0:1691804:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000400:00000200:5.0:1773851894.909171:0:61161:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 3
00000020:00000001:25.0:1773851894.909172:0:1691804:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000020:00000001:25.0:1773851894.909173:0:1691804:0:(out_handler.c:356:out_index_lookup()) Process entered
00080000:00000001:25.0:1773851894.909173:0:1691804:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00000800:00000200:5.0:1773851894.909173:0:61161:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.909174:0:61161:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851894.909176:0:61161:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851894.909178:0:61161:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 Using peer 8659@kfi7(0x1278)
00080000:00000001:25.0:1773851894.909180:0:1691804:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:25.0:1773851894.909181:0:1691804:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:25.0:1773851894.909181:0:1691804:0:(osd_index.c:945:osd_seq_exists()) Process entered
00000800:00000200:5.0:1773851894.909181:0:61161:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x1278: rc=0
80000000:00000001:25.0:1773851894.909182:0:1691804:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:25.0:1773851894.909183:0:1691804:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
00000800:00000200:5.0:1773851894.909183:0:61161:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
80000000:00000001:25.0:1773851894.909184:0:1691804:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:25.0:1773851894.909184:0:1691804:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851894.909185:0:1691804:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.909185:0:61161:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851894.909185:0:61161:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d208fb4 refcount 2 to 8658@kfi7
00080000:00000001:25.0:1773851894.909186:0:1691804:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:25.0:1773851894.909186:0:1691804:0:(out_handler.c:389:out_index_lookup()) lookup [0x24001b599:0x10e2:0x0] slingshotmon get [0x2800256ea:0x3d:0x0] rc 1
00010000:00000001:5.0:1773851894.909186:0:61161:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.909187:0:61161:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:25.0:1773851894.909188:0:1691804:0:(out_handler.c:393:out_index_lookup()) lustre5-MDT0001: insert lookup reply 000000009553be0a index 0: rc = 1
00000100:00000040:5.0:1773851894.909188:0:61161:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c57e563d x1859479595342464/t0(0) o103->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000020:00000001:25.0:1773851894.909189:0:1691804:0:(out_handler.c:398:out_index_lookup()) Process leaving (rc=1 : 1 : 1)
00000020:00000002:25.0:1773851894.909189:0:1691804:0:(lu_object.c:224:lu_object_put()) Add 000000003fbfefe6/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000020:00000010:25.0:1773851894.909190:0:1691804:0:(out_handler.c:1241:out_handle()) kfreed 'update_bufs': 8 at 000000002d7248d2.
00000020:00000001:25.0:1773851894.909191:0:1691804:0:(out_handler.c:1247:out_handle()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:5.0:1773851894.909191:0:61161:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c57e563d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn01_004:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:39963:x1859479595342464:12345-8658@kfi7:103: Request processed in 90us (134us total) trans 0 rc 0/0
00010000:00000040:25.0:1773851894.909192:0:1691804:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080691520
00010000:00000001:25.0:1773851894.909193:0:1691804:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851894.909194:0:1691804:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f0f5fbbf x1859388080691520/t0(0) o1000->lustre5-MDT0004-mdtlov_UUID@7@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/0 job:'default-yuba5-0'
00000100:00100000:5.0:1773851894.909194:0:61161:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8658@kfi7, seq: 43812577
00000100:00000040:5.0:1773851894.909195:0:61161:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef161c6c : new rpc_count 0
00010000:00000001:25.0:1773851894.909196:0:1691804:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:5.0:1773851894.909196:0:61161:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851894.909196:0:61161:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00000001:25.0:1773851894.909197:0:1691804:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:5.0:1773851894.909197:0:61161:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000100:00001000:25.0:1773851894.909198:0:1691804:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=21 v=66 (1 1 1 1)
00000800:00000200:6.0:1773851894.909198:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 TN_EVENT_TX_OK event status 0
00000020:00000010:5.0:1773851894.909198:0:61161:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a694bc33.
00000100:00000001:25.0:1773851894.909199:0:1691804:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851894.909199:0:1691804:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:25.0:1773851894.909200:0:1691804:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
00000020:00000010:5.0:1773851894.909200:0:61161:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000037a7757e.
00000020:00000040:5.0:1773851894.909200:0:61161:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 7
02000000:00000001:25.0:1773851894.909201:0:1691804:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851894.909201:0:1691804:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851894.909201:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851894.909201:0:61161:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851894.909202:0:1691804:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:6.0:1773851894.909202:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8659@kfi7: PUT: OK
00000100:00000040:25.0:1773851894.909203:0:1691804:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000200:6.0:1773851894.909203:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000690e571
00000400:00000010:25.0:1773851894.909204:0:1691804:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000eea138e6 (tot 253201995).
00000100:00000200:25.0:1773851894.909204:0:1691804:0:(niobuf.c:86:ptl_send_buf()) Sending 4320 bytes to portal 4, xid 1859388080691520, offset 224
00000400:00000010:6.0:1773851894.909204:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000690e571.
00000100:00000001:6.0:1773851894.909204:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851894.909205:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.909206:0:1691804:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:6.0:1773851894.909206:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000400:00000200:25.0:1773851894.909207:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.909207:0:1691804:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851894.909208:0:1691804:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:6.0:1773851894.909208:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 Transaction freed
00000400:00000200:25.0:1773851894.909209:0:1691804:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851894.909210:0:1691804:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:25.0:1773851894.909212:0:1691804:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770150:8770150:1024:4294967295] 8@kfi7 LPNI seq info [17340073:17340073:16:4294967295]
00000400:00000200:25.0:1773851894.909214:0:1691804:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851894.909215:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.909216:0:1691804:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851894.909217:0:1691804:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:25.0:1773851894.909219:0:1691804:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 1 allocated
00000800:00000200:25.0:1773851894.909221:0:1691804:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:25.0:1773851894.909223:0:1691804:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:25.0:1773851894.909228:0:1691804:0:(kfilnd_ep.c:374:kfilnd_ep_post_tagged_recv()) 2069@kfi7:6 Transaction ID 00000000878f9def: Posted tagged recv of 4320 bytes (2 frags) with tag 0x11a50001: rc=0
00000800:00000200:25.0:1773851894.909230:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_TAGGED_RECV_POSTED state change
00000800:00000200:25.0:1773851894.909232:0:1691804:0:(kfilnd_tn.c:603:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:25.0:1773851894.909235:0:1691804:0:(kfilnd_tn.c:610:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x11a4 Using peer 8@kfi7(0x11a4)
00000800:00000200:25.0:1773851894.909238:0:1691804:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000878f9def: Posted send of 110 bytes to peer 0x11a4: rc=0
00000800:00000200:25.0:1773851894.909239:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x11a4 TN_STATE_TAGGED_RECV_POSTED -> TN_STATE_WAIT_COMP state change
00000100:00000001:25.0:1773851894.909241:0:1691804:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851894.909242:0:1691804:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:25.0:1773851894.909242:0:1691804:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851894.909243:0:1691804:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851894.909243:0:1691804:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851894.909244:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f0f5fbbf x1859388080691520/t0(0) o1000->lustre5-MDT0004-mdtlov_UUID@7@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/1 job:'default-yuba5-0'
00000100:00100000:25.0:1773851894.909247:0:1691804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f0f5fbbf pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:127549:x1859388080691520:12345-7@kfi7:1000:default-yuba5-0 Request processed in 90us (122us total) trans 0 rc 1/1
00000100:00100000:25.0:1773851894.909250:0:1691804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799989
00000100:00000040:25.0:1773851894.909251:0:1691804:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:25.0:1773851894.909251:0:1691804:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:26.0:1773851894.909252:0:2507427:0:(kfilnd_tn.c:1127:kfilnd_tn_state_wait_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x11a4 TN_EVENT_TX_OK event status 0
00000100:00000001:25.0:1773851894.909252:0:1691804:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851894.909253:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000800:00000200:26.0:1773851894.909254:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x11a4 TN_STATE_WAIT_COMP -> TN_STATE_WAIT_TAG_COMP state change
00000020:00000010:25.0:1773851894.909254:0:1691804:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005924beeb.
00000020:00000010:25.0:1773851894.909254:0:1691804:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d39d7b35.
00000020:00000040:25.0:1773851894.909255:0:1691804:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:25.0:1773851894.909256:0:1691804:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851894.909272:0:2494371:0:(kfilnd_tn.c:1307:kfilnd_tn_state_wait_tag_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x11a4 TN_EVENT_TAG_RX_OK event status 0
00000400:00000200:25.0:1773851894.909274:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.909275:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8@kfi7: PUT: OK
00000400:00000200:25.0:1773851894.909276:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eea138e6
00000400:00000010:25.0:1773851894.909277:0:2494371:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000eea138e6 (tot 253201843).
00000100:00000001:25.0:1773851894.909277:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.909278:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.909279:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851894.909280:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_BULK_PUT_REQ TN 00000000878f9def: 2069@kfi7:6 -> 8@kfi7(00000000196d02dd):0x0 lsk 4517 rsk 765 tsk 0 trmk 0 tmk 1 trr 6 tta 0x11a4 Transaction freed
00000800:00000200:25.0:1773851894.909398:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.909399:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.909400:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.909401:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851894.909403:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.909404:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8658@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.909405:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.909406:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000400:00000200:25.0:1773851894.909407:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.909408:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:25.0:1773851894.909408:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:25.0:1773851894.909409:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.909411:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8658@kfi7 of length 584 into portal 12 MB=0x69b2fd4bf5b80
00000400:00000200:25.0:1773851894.909412:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8658@kfi7 of length 584/584 into md 0x16159c9699 [64] + 35696
00000800:00000200:25.0:1773851894.909413:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851894.909415:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.909416:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8658@kfi7: PUT: OK
00000100:00000001:25.0:1773851894.909417:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851894.909417:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851894.909418:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003ab0ccb2.
00000100:00000040:25.0:1773851894.909418:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000003ab0ccb2 x1859479595342720 msgsize 584
00000100:00100000:25.0:1773851894.909419:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8658@kfi7 (source: 12345-8658@kfi7)
00000100:00000001:25.0:1773851894.909420:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851894.909421:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000100:00000001:24.0:1773851894.909421:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851894.909422:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851894.909422:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851894.909422:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851894.909422:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851894.909423:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851894.909424:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479595342720
00000020:00000001:24.0:1773851894.909424:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851894.909425:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2fc9a
00000020:00000001:24.0:1773851894.909425:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.909426:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef161c6c refcount=8
00000020:00000001:24.0:1773851894.909427:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000020:00000001:24.0:1773851894.909427:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000100:00000001:24.0:1773851894.909428:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851894.909429:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851894.909429:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008edcd5fb.
00000020:00000010:24.0:1773851894.909430:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851894.909431:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e24711f.
00000100:00000001:24.0:1773851894.909431:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851894.909432:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:24.0:1773851894.909432:0:60973:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:24.0:1773851894.909432:0:60973:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.909433:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.909434:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.909435:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851894.909436:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851894.909437:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851894.909437:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851894.909437:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851894.909438:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851894.909438:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8658@kfi7, seq: 1451911040
00000100:00000040:24.0:1773851894.909438:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef161c6c : new rpc_count 1
00000100:00000001:27.0:1773851894.909439:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.909439:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780414208 : -106994929137408 : ffff9eb04d418900)
00000100:00000040:24.0:1773851894.909440:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003ab0ccb2 x1859479595342720/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:175/0 lens 584/0 e 0 to 0 dl 1773852290 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1029-0'
00000100:00000001:24.0:1773851894.909443:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851894.909443:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851894.909444:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ab0ccb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:2067503:x1859479595342720:12345-8658@kfi7:101:default-tuolumne1029-0
00000100:00000200:24.0:1773851894.909445:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479595342720
00000020:00000001:24.0:1773851894.909446:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851894.909447:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851894.909447:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.909448:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851894.909448:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:24.0:1773851894.909449:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851894.909449:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479595342720, found 0 last_xid 1859479595342719
00000020:00000001:24.0:1773851894.909450:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851894.909451:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851894.909451:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851894.909452:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.909453:0:60973:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:24.0:1773851894.909453:0:60973:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:24.0:1773851894.909453:0:60973:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:24.0:1773851894.909454:0:60973:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:24.0:1773851894.909454:0:60973:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.909456:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851894.909456:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 194
00010000:00000001:24.0:1773851894.909457:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.909458:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.909458:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000001e96caf9.
00000020:00000001:24.0:1773851894.909460:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.909460:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000001e96caf9 with handle 0x21b6f08f07a6ae42 to hash
00000020:00000001:24.0:1773851894.909461:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.909461:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00000010:24.0:1773851894.909462:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000003a8b4b11.
00010000:00000001:24.0:1773851894.909463:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637055153497088 : -107018556054528 : ffff9eaaccfb6400)
00010000:00010000:24.0:1773851894.909463:0:60973:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6ae42 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b0aff8279d46426 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909466:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:24.0:1773851894.909466:0:60973:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ef161c6c : new locks_count 4
00000020:00000040:24.0:1773851894.909467:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000ef161c6c refcount=9
00010000:00000001:24.0:1773851894.909468:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:24.0:1773851894.909469:0:60973:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:24.0:1773851894.909469:0:60973:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:24.0:1773851894.909470:0:60973:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:24.0:1773851894.909470:0:60973:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:24.0:1773851894.909470:0:60973:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:24.0:1773851894.909471:0:60973:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:24.0:1773851894.909471:0:60973:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:24.0:1773851894.909472:0:60973:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:24.0:1773851894.909473:0:60973:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:24.0:1773851894.909473:0:60973:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.909474:0:60973:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:24.0:1773851894.909474:0:60973:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:24.0:1773851894.909475:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851894.909475:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851894.909476:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 000000007aa6ae5c.
02000000:00000001:24.0:1773851894.909477:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.909477:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.909478:0:60973:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.909478:0:60973:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:24.0:1773851894.909479:0:60973:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:24.0:1773851894.909479:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.909480:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.909480:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.909481:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.909481:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.909482:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.909482:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.909482:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.909483:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.909483:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851894.909484:0:60973:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:24.0:1773851894.909484:0:60973:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:24.0:1773851894.909485:0:60973:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:24.0:1773851894.909485:0:60973:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.909486:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.909486:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.909487:0:60973:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:24.0:1773851894.909487:0:60973:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.909488:0:60973:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:24.0:1773851894.909489:0:60973:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 000000000d7a2df8
00000004:00000001:24.0:1773851894.909490:0:60973:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:24.0:1773851894.909490:0:60973:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:24.0:1773851894.909491:0:60973:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:24.0:1773851894.909491:0:60973:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:24.0:1773851894.909491:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851894.909492:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851894.909492:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.909493:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.909493:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.909495:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000007c467a4b.
00000020:00000001:24.0:1773851894.909495:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.909496:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000007c467a4b with handle 0x21b6f08f07a6ae49 to hash
00000020:00000001:24.0:1773851894.909496:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.909497:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637161065308032 : -106912644243584 : ffff9ec375d15f80)
00010000:00000010:24.0:1773851894.909497:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000644b2a52.
00010000:00000001:24.0:1773851894.909498:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637161065308032 : -106912644243584 : ffff9ec375d15f80)
00010000:00000001:24.0:1773851894.909499:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.909500:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.909500:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909503:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.909503:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851894.909504:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851894.909504:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851894.909505:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.909505:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.909506:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.909506:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.909507:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851894.909507:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851894.909508:0:60973:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851894.909508:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851894.909509:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 195
00010000:00000040:24.0:1773851894.909510:0:60973:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:24.0:1773851894.909511:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909513:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909514:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909516:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909517:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909519:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909520:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909523:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909523:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909526:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909526:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909529:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909529:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909531:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909532:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909534:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909535:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909537:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909538:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909540:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909541:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909543:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909544:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909546:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909547:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909549:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909550:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909552:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909552:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909555:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909556:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909558:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909559:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909561:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909562:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909564:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909565:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909566:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909567:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909570:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909573:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909575:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909576:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909578:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909579:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909581:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909582:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909584:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909585:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909587:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909588:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909590:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909591:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909593:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909594:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909596:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909597:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909599:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909600:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909602:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909602:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909605:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909605:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909607:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909608:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909610:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909611:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909613:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909614:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909616:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909617:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909619:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909620:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909622:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909623:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909625:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909626:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909628:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909629:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909631:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909632:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909634:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909635:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909637:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909638:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909640:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909641:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909643:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909644:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909646:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909647:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909649:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909650:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909653:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909653:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909655:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909656:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909658:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909659:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909661:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909662:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909664:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909665:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909667:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909668:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909670:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909671:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909673:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909673:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909675:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909676:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909678:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909679:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909681:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909682:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909684:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909685:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909687:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909687:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909690:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909691:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909693:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909693:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909695:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909696:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909698:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909699:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909701:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909702:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909704:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909705:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909707:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909707:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909709:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909710:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909712:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909714:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909716:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909717:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909719:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909719:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909722:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909723:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909730:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909730:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909733:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909733:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909735:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909736:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909738:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909739:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909741:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909742:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909744:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909745:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909747:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909748:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909750:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909751:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909753:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909754:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909756:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909757:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909759:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909760:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909762:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909763:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909764:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909765:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909767:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909768:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909770:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909771:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909773:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909774:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909776:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909777:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909779:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909780:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909782:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909783:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909785:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909786:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909788:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909789:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909791:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909792:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909794:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909794:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909797:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909797:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909800:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909800:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909802:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909803:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909805:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909806:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909808:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909808:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909810:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909812:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909814:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909815:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909817:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909817:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909820:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909821:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909823:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909824:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909826:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909827:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909829:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909830:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909832:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909833:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909835:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909837:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909839:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909840:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909842:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909842:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909844:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909845:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 9 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909847:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909848:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909850:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909851:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909853:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909854:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909856:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909857:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909859:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909860:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909862:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909863:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909865:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909866:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909869:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909869:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909871:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909872:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909874:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909875:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909877:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909877:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909879:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909880:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909882:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909884:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909886:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909887:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909889:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909889:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909892:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909892:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909895:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909895:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909897:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909898:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909900:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909901:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909903:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909904:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909906:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909907:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909909:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909910:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909912:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909912:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909915:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909916:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909918:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909919:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909921:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909922:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909924:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909925:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909927:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909927:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909929:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909931:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909933:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909934:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909936:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909937:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909939:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909940:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909942:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909943:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909945:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909946:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909948:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909949:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909951:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909952:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909954:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909957:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909959:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909960:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909962:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909963:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909965:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909966:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909968:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909969:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909971:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909972:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909974:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909975:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909977:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909978:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909980:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909981:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909983:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909984:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909986:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909987:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909989:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909990:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909992:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909993:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909995:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909996:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.909998:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.909998:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910000:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910001:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910003:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910005:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910007:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910007:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910010:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910011:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910013:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910013:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910016:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910016:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910018:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910019:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910021:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910022:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910024:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910025:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910027:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910028:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910030:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910031:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910033:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910033:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910035:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910036:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910038:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910039:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910041:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910042:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910044:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910044:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910046:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910047:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910049:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910050:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910053:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910053:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910055:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910056:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910059:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910059:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910061:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910062:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910064:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910065:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910067:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910068:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910070:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910071:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910073:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910074:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910076:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910076:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910078:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910079:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910082:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910082:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910084:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:24.0:1773851894.910085:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910087:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:24.0:1773851894.910088:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910090:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.910091:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851894.910091:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851894.910092:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.910092:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851894.910093:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.910093:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.910094:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.910094:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851894.910095:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.910096:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910098:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.910099:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851894.910100:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.910100:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.910100:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851894.910101:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:24.0:1773851894.910102:0:60973:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000dc0dc02c.
00010000:00000010:24.0:1773851894.910103:0:60973:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000c826f230.
00010000:00000001:24.0:1773851894.910104:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.910105:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000000477ffb5.
00000020:00000001:24.0:1773851894.910106:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.910106:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000000477ffb5 with handle 0x21b6f08f07a6ae50 to hash
00000020:00000001:24.0:1773851894.910107:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.910107:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000010:24.0:1773851894.910108:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000001a3f9e68.
00010000:00000001:24.0:1773851894.910109:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000001:24.0:1773851894.910110:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.910110:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.910111:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910113:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.910113:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851894.910114:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851894.910114:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851894.910115:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.910115:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.910116:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.910116:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.910117:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851894.910117:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851894.910118:0:60973:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851894.910118:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851894.910119:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (00000000dc0dc02c) refcount = 1
00010000:00010000:24.0:1773851894.910120:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910122:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.910122:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851894.910123:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851894.910123:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.910124:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851894.910124:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.910125:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.910125:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.910126:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851894.910126:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.910127:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910129:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.910130:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851894.910130:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.910130:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.910131:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.910131:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.910132:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000477ffb5 refcount=3
00000020:00000001:24.0:1773851894.910132:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000001:24.0:1773851894.910133:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000001:24.0:1773851894.910134:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.910134:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.910134:0:60973:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910135:0:60973:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910136:0:60973:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:24.0:1773851894.910138:0:60973:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:24.0:1773851894.910139:0:60973:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:24.0:1773851894.910140:0:60973:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851894.910140:0:60973:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:24.0:1773851894.910143:0:60973:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:24.0:1773851894.910144:0:60973:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:24.0:1773851894.910144:0:60973:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:24.0:1773851894.910145:0:60973:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:24.0:1773851894.910145:0:60973:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:24.0:1773851894.910146:0:60973:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:24.0:1773851894.910146:0:60973:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851894.910147:0:60973:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851894.910147:0:60973:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:24.0:1773851894.910148:0:60973:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910149:0:60973:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910149:0:60973:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:24.0:1773851894.910150:0:60973:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:24.0:1773851894.910150:0:60973:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:24.0:1773851894.910151:0:60973:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:24.0:1773851894.910152:0:60973:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:24.0:1773851894.910153:0:60973:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:24.0:1773851894.910153:0:60973:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:24.0:1773851894.910154:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851894.910154:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851894.910155:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 229
00010000:00000001:24.0:1773851894.910155:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.910156:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.910157:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000009b252ed3.
00000020:00000001:24.0:1773851894.910157:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.910158:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000009b252ed3 with handle 0x21b6f08f07a6ae57 to hash
00000020:00000001:24.0:1773851894.910159:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.910159:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000010:24.0:1773851894.910160:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c8f3e963.
00010000:00000001:24.0:1773851894.910160:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:24.0:1773851894.910161:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.910162:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.910162:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000009b252ed3/0x21b6f08f07a6ae57 lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 230 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910165:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:24.0:1773851894.910166:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851894.910166:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851894.910166:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851894.910167:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.910167:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.910168:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.910168:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.910169:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851894.910169:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851894.910170:0:60973:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851894.910170:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851894.910170:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 229
00010000:00000040:24.0:1773851894.910171:0:60973:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:24.0:1773851894.910172:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910174:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910175:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910177:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910178:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910181:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910183:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910185:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910186:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910191:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910192:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910194:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910195:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910197:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910198:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910201:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910202:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910204:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910205:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910207:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910208:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910210:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910211:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910213:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910215:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910219:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910220:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910223:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910224:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910226:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910227:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910229:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910230:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910232:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910234:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910236:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910237:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910239:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910240:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910242:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910243:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910247:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910248:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910250:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910252:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910254:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910255:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910257:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910258:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910260:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910261:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910264:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910265:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910267:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910269:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910271:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910272:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910277:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910278:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910280:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910281:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910283:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910284:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910287:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910288:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910290:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910291:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910293:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910294:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910297:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910298:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910300:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910301:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910303:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910304:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910306:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910308:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910310:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910310:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910312:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910313:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910315:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910316:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910318:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910320:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910322:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910323:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910325:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910326:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910330:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910332:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910334:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910335:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910337:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910338:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910340:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910341:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910343:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910344:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910347:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910348:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910350:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910351:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910353:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910354:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910357:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910358:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910360:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910362:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910364:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910365:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910367:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910368:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910369:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910371:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910373:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910374:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910376:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910377:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910379:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910380:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910383:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910384:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910386:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910387:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910390:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910391:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910393:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910394:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910396:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910397:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910400:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910401:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910403:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910404:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910406:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910407:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910409:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910410:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910412:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910413:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910416:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910417:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910419:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910420:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910422:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910423:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910425:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910426:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910428:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910429:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910431:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910432:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910435:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910436:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910438:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910439:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910441:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910442:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910445:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910445:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910448:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910449:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910451:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910452:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910454:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910455:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910457:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910458:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910461:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910462:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910463:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910465:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910467:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910468:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910470:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910470:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910472:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910474:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910476:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910477:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910479:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910480:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910482:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910482:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910485:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910486:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910488:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910489:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910491:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910493:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910494:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910495:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910497:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910498:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910500:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910502:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910504:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910505:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910507:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910508:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910511:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910512:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910514:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910515:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910517:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910519:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910520:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910521:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910523:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910524:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910526:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910528:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910530:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910530:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910532:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910533:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910535:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910536:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910538:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910539:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910542:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910543:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910545:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910546:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 9 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910548:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910549:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910551:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910552:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910554:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910555:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910557:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910558:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910562:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910563:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910565:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910566:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910568:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910570:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910572:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910573:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910575:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910577:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910579:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910580:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910582:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910583:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910585:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910586:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910589:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910590:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910592:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910593:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910595:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910597:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910599:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910600:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910602:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910603:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910605:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910607:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910609:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910610:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910612:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910613:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910615:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910617:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910618:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910620:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910622:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910623:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910625:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910626:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910628:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910629:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910632:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910633:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910635:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910637:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910639:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910640:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910642:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910644:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910646:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910647:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910649:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910651:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910652:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910654:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910656:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910657:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910660:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910661:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910663:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910664:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910666:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910667:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910669:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910670:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910672:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910674:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910676:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910677:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910679:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910680:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910682:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910683:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910685:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910686:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910688:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910690:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910692:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910693:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910696:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910697:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910699:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910701:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910703:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910704:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910706:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910707:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910710:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910711:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910713:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910715:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910717:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910718:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910721:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910722:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910729:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910730:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910733:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910734:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910737:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910738:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910740:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910742:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910744:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910746:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910748:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910750:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910752:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910754:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910756:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910758:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910761:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910762:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910764:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910765:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910768:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910769:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910772:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910773:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910775:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910777:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910779:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910780:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910783:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910784:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910786:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910788:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910792:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910793:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910796:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910797:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910800:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910801:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910803:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910805:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910807:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910809:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910811:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910812:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910815:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910816:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910819:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910820:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910823:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910824:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910826:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910827:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910830:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910831:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910834:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910835:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910837:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910839:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910841:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910842:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910845:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910846:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910848:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910849:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910852:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910853:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910856:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910858:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910860:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910862:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910864:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910865:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910868:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910869:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910872:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910873:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910875:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910877:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910879:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910881:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910884:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910885:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910887:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910888:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910891:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910892:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910894:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910895:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910897:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910898:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910900:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910901:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910903:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910905:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910907:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910907:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910910:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910912:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910914:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910915:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910917:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910918:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910920:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910922:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910924:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910925:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910927:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910928:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910930:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910932:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910934:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910935:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910937:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910938:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910940:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910942:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910944:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910945:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910947:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910948:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910950:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910951:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910953:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910955:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910957:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:24.0:1773851894.910958:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910960:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00010000:24.0:1773851894.910961:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000009b252ed3/0x21b6f08f07a6ae57 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910972:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:24.0:1773851894.910973:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851894.910973:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851894.910974:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.910974:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851894.910975:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.910975:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.910976:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.910976:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851894.910977:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.910977:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000009b252ed3/0x21b6f08f07a6ae57 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910980:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:24.0:1773851894.910980:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851894.910980:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.910981:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.910981:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.910982:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.910982:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009b252ed3 refcount=3
00000020:00000001:24.0:1773851894.910982:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:24.0:1773851894.910983:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:24.0:1773851894.910984:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.910985:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.910985:0:60973:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910987:0:60973:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:24.0:1773851894.910988:0:60973:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:24.0:1773851894.910989:0:60973:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910990:0:60973:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910991:0:60973:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:24.0:1773851894.910991:0:60973:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:24.0:1773851894.910992:0:60973:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:24.0:1773851894.910993:0:60973:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.910994:0:60973:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.910995:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.910995:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.910996:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009b252ed3 refcount=3
00000020:00000001:24.0:1773851894.910996:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:24.0:1773851894.910997:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00000004:00010000:24.0:1773851894.910998:0:60973:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 000000009b252ed3/0x21b6f08f07a6ae57 lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.910999:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:24.0:1773851894.911000:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911001:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.911001:0:60973:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:24.0:1773851894.911001:0:60973:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:24.0:1773851894.911002:0:60973:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:24.0:1773851894.911003:0:60973:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:24.0:1773851894.911004:0:60973:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:24.0:1773851894.911004:0:60973:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:24.0:1773851894.911005:0:60973:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:24.0:1773851894.911005:0:60973:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:24.0:1773851894.911006:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.911006:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.911006:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007c467a4b refcount=3
00000020:00000001:24.0:1773851894.911007:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065308032 : -106912644243584 : ffff9ec375d15f80)
00010000:00000001:24.0:1773851894.911007:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065308032 : -106912644243584 : ffff9ec375d15f80)
00010000:00000001:24.0:1773851894.911008:0:60973:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:24.0:1773851894.911009:0:60973:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911011:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.911012:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911012:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851894.911012:0:60973:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911017:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.911018:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.911018:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911019:0:60973:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:24.0:1773851894.911020:0:60973:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911022:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:24.0:1773851894.911022:0:60973:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000007c467a4b already unused, calling callback (000000001690cbe4)
00000004:00000001:24.0:1773851894.911023:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:24.0:1773851894.911024:0:60973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:24.0:1773851894.911024:0:60973:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911027:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.911027:0:60973:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:24.0:1773851894.911028:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.911028:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.911028:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007c467a4b refcount=4
00000020:00000001:24.0:1773851894.911029:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065308032 : -106912644243584 : ffff9ec375d15f80)
00010000:00000001:24.0:1773851894.911030:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065308032 : -106912644243584 : ffff9ec375d15f80)
00010000:00000001:24.0:1773851894.911030:0:60973:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:24.0:1773851894.911031:0:60973:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911033:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.911034:0:60973:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:24.0:1773851894.911034:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:24.0:1773851894.911035:0:60973:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911035:0:60973:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:24.0:1773851894.911036:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851894.911037:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.911038:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851894.911038:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000007c467a4b with handle 0x21b6f08f07a6ae49 from hash
00010000:00000001:24.0:1773851894.911039:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851894.911040:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911040:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911040:0:60973:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:24.0:1773851894.911041:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851894.911041:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911042:0:60973:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:24.0:1773851894.911042:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851894.911043:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851894.911044:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:24.0:1773851894.911045:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:24.0:1773851894.911045:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.911046:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911047:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851894.911047:0:60973:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:24.0:1773851894.911048:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911049:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911049:0:60973:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911050:0:60973:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.911050:0:60973:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.911051:0:60973:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911053:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:24.0:1773851894.911054:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911054:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911054:0:60973:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:24.0:1773851894.911055:0:60973:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:24.0:1773851894.911055:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851894.911056:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000007c467a4b/0x21b6f08f07a6ae49 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911058:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000010:24.0:1773851894.911059:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000644b2a52.
00010000:00000040:24.0:1773851894.911060:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:24.0:1773851894.911060:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.911061:0:60973:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:24.0:1773851894.911061:0:60973:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:24.0:1773851894.911062:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.911062:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.911062:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000477ffb5 refcount=3
00000020:00000001:24.0:1773851894.911063:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000001:24.0:1773851894.911064:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000001:24.0:1773851894.911064:0:60973:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:24.0:1773851894.911065:0:60973:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911067:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.911067:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911068:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851894.911068:0:60973:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911070:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.911071:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.911071:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911072:0:60973:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:24.0:1773851894.911072:0:60973:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911074:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00010000:24.0:1773851894.911075:0:60973:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000000477ffb5 already unused, calling callback (000000001690cbe4)
00000004:00000001:24.0:1773851894.911076:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:24.0:1773851894.911076:0:60973:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:24.0:1773851894.911077:0:60973:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911081:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.911081:0:60973:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:24.0:1773851894.911082:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.911082:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.911082:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000477ffb5 refcount=4
00000020:00000001:24.0:1773851894.911083:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000001:24.0:1773851894.911083:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065306304 : -106912644245312 : ffff9ec375d158c0)
00010000:00000001:24.0:1773851894.911084:0:60973:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:24.0:1773851894.911084:0:60973:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911086:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.911087:0:60973:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:24.0:1773851894.911087:0:60973:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:24.0:1773851894.911088:0:60973:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911089:0:60973:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:24.0:1773851894.911089:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851894.911089:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.911090:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851894.911090:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000000477ffb5 with handle 0x21b6f08f07a6ae50 from hash
00010000:00000001:24.0:1773851894.911091:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851894.911091:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911091:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911092:0:60973:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:24.0:1773851894.911092:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851894.911092:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911093:0:60973:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:24.0:1773851894.911093:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851894.911094:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851894.911094:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (00000000dc0dc02c)
00010000:00010000:24.0:1773851894.911095:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:24.0:1773851894.911095:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.911096:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911097:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851894.911097:0:60973:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:24.0:1773851894.911098:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911098:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911098:0:60973:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911099:0:60973:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.911100:0:60973:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.911100:0:60973:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911102:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000001:24.0:1773851894.911103:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911103:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911103:0:60973:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:24.0:1773851894.911104:0:60973:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:24.0:1773851894.911104:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851894.911105:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000000477ffb5/0x21b6f08f07a6ae50 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911107:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 1
00010000:00000010:24.0:1773851894.911107:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000001a3f9e68.
00010000:00000040:24.0:1773851894.911108:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000dc0dc02c count: 0
00010000:00000010:24.0:1773851894.911109:0:60973:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000c826f230.
00010000:00000001:24.0:1773851894.911109:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.911110:0:60973:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:24.0:1773851894.911110:0:60973:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:24.0:1773851894.911111:0:60973:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:24.0:1773851894.911111:0:60973:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:24.0:1773851894.911111:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.911112:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.911112:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009b252ed3 refcount=3
00000020:00000001:24.0:1773851894.911113:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:24.0:1773851894.911113:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00000004:00000040:24.0:1773851894.911114:0:60973:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000ef161c6c : new locks_count 5
00000020:00000040:24.0:1773851894.911115:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000ef161c6c refcount=10
00010000:00000001:24.0:1773851894.911116:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911116:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.911117:0:60973:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851894.911117:0:60973:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:24.0:1773851894.911118:0:60973:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:24.0:1773851894.911118:0:60973:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:24.0:1773851894.911118:0:60973:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:24.0:1773851894.911119:0:60973:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:24.0:1773851894.911119:0:60973:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:24.0:1773851894.911120:0:60973:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:24.0:1773851894.911120:0:60973:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.911121:0:60973:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851894.911122:0:60973:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:24.0:1773851894.911122:0:60973:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:24.0:1773851894.911123:0:60973:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:24.0:1773851894.911123:0:60973:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:24.0:1773851894.911124:0:60973:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:24.0:1773851894.911124:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851894.911124:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911125:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911125:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.911126:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851894.911126:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000001e96caf9 with handle 0x21b6f08f07a6ae42 from hash
00010000:00000001:24.0:1773851894.911127:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851894.911127:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911127:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911128:0:60973:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:24.0:1773851894.911128:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851894.911129:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000001e96caf9/0x21b6f08f07a6ae42 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 195 type: IBT gid 0 flags: 0x44000000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46426 expref: 10 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911131:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:24.0:1773851894.911132:0:60973:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ef161c6c : new locks_count 4
00000020:00000040:24.0:1773851894.911132:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 9
00010000:00000010:24.0:1773851894.911133:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003a8b4b11.
00010000:00000040:24.0:1773851894.911134:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00010000:00000001:24.0:1773851894.911135:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.911135:0:60973:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911136:0:60973:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:24.0:1773851894.911137:0:60973:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000009b252ed3/0x21b6f08f07a6ae57 lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46426 expref: 9 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.911139:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:24.0:1773851894.911139:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851894.911140:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851894.911140:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:24.0:1773851894.911141:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:24.0:1773851894.911141:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.911142:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.911142:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851894.911143:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.911143:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851894.911143:0:60973:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000009b252ed3, rc 0)
00000020:00000001:24.0:1773851894.911144:0:60973:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851894.911145:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106902121, transno 0, xid 1859479595342720
00010000:00000001:24.0:1773851894.911145:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851894.911146:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003ab0ccb2 x1859479595342720/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:175/0 lens 584/640 e 0 to 0 dl 1773852290 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1029-0'
00010000:00000001:24.0:1773851894.911149:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851894.911149:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851894.911150:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=127 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851894.911151:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851894.911152:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d208fb4 refcount 3 to 8658@kfi7
00000100:00000001:24.0:1773851894.911152:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637098420265536 : -106975289286080 : ffff9eb4dfe1e240)
02000000:00000001:24.0:1773851894.911153:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851894.911154:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.911154:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851894.911155:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8658@kfi7
00000400:00000010:24.0:1773851894.911156:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c143d7e9.
00000100:00000200:24.0:1773851894.911157:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859479595342720, offset 224
00000400:00000200:24.0:1773851894.911158:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8658@kfi7
00000400:00000200:24.0:1773851894.911159:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:24.0:1773851894.911160:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000400:00000200:24.0:1773851894.911161:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:24.0:1773851894.911162:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:24.0:1773851894.911163:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8658@kfi7 local destination
00000400:00000200:24.0:1773851894.911164:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770151:8770151:1024:4294967295] 8658@kfi7 LPNI seq info [4888391:4888391:16:4294967295]
00000400:00000200:24.0:1773851894.911165:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:24.0:1773851894.911166:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:24.0:1773851894.911168:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8658@kfi7(8658@kfi7:8658@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851894.911169:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000800:00000200:24.0:1773851894.911171:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851894.911172:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:24.0:1773851894.911174:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851894.911176:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Using peer 8658@kfi7(0x10000000000127c)
00000800:00000200:24.0:1773851894.911179:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 740 bytes to peer 0x10000000000127c: rc=0
00000800:00000200:24.0:1773851894.911181:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851894.911182:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851894.911183:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d208fb4 refcount 2 to 8658@kfi7
00010000:00000001:24.0:1773851894.911184:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851894.911184:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.911185:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851894.911185:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003ab0ccb2 x1859479595342720/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:175/0 lens 584/640 e 0 to 0 dl 1773852290 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1029-0'
00000100:00100000:24.0:1773851894.911190:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ab0ccb2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:94bc7d8e-6987-4a1b-8756-91253d59cad1+9:2067503:x1859479595342720:12345-8658@kfi7:101:default-tuolumne1029-0 Request processed in 1746us (1771us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851894.911193:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8658@kfi7, seq: 1451911040
00000100:00000040:24.0:1773851894.911194:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef161c6c : new rpc_count 0
00000100:00000001:24.0:1773851894.911195:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851894.911195:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851894.911196:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001f8916c2.
00000020:00000010:24.0:1773851894.911196:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e24711f.
00000020:00000010:24.0:1773851894.911197:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008edcd5fb.
00000020:00000040:24.0:1773851894.911198:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 8
00000100:00000001:24.0:1773851894.911199:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851894.911204:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851894.911206:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.911207:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8658@kfi7: PUT: OK
00000400:00000200:25.0:1773851894.911208:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c143d7e9
00000400:00000010:25.0:1773851894.911208:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c143d7e9.
00000100:00000001:25.0:1773851894.911209:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.911209:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.911210:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000800:00000200:25.0:1773851894.911211:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Transaction freed
00000800:00000200:25.0:1773851894.911283:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.911284:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851894.911285:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.911286:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851894.911288:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8467@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.911290:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8467@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.911291:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8467@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.911292:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fc61c55 nid 8467@kfi7 refs 1
00000400:00000200:25.0:1773851894.911293:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8467@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.911293:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fc61c55 nid 8467@kfi7 refs 2
00000400:00000200:25.0:1773851894.911294:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002fc61c55 nid 8467@kfi7 refs 3
00000400:00000200:25.0:1773851894.911295:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.911296:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8658@kfi7 of length 328 into portal 17 MB=0x69b2fd4bf5c00
00000400:00000200:25.0:1773851894.911296:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8658@kfi7 of length 328/328 into md 0x1615af82d9 [2] + 1320
00000800:00000200:25.0:1773851894.911298:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851894.911299:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.911301:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8467@kfi7: PUT: OK
00000100:00000001:25.0:1773851894.911301:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851894.911302:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:25.0:1773851894.911302:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ae922ff1.
00000100:00000040:25.0:1773851894.911303:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ae922ff1 x1859479595342848 msgsize 328
00000100:00100000:25.0:1773851894.911304:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8658@kfi7 (source: 12345-8467@kfi7)
00000100:00000001:25.0:1773851894.911305:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851894.911306:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002fc61c55 nid 8467@kfi7 refs 2
00000100:00000001:26.0:1773851894.911307:0:533719:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851894.911307:0:533719:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851894.911307:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851894.911308:0:533719:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851894.911308:0:533719:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851894.911309:0:533719:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851894.911309:0:533719:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479595342848
00000020:00000001:26.0:1773851894.911310:0:533719:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851894.911310:0:533719:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2fc9a
00000020:00000001:26.0:1773851894.911311:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.911311:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef161c6c refcount=9
00000020:00000001:26.0:1773851894.911312:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000020:00000001:26.0:1773851894.911313:0:533719:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000100:00000001:26.0:1773851894.911314:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851894.911314:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851894.911314:0:533719:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000024e5a498.
00000020:00000010:26.0:1773851894.911315:0:533719:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851894.911316:0:533719:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000040:26.0:1773851894.911317:0:533719:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:26.0:1773851894.911317:0:533719:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851894.911318:0:533719:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:26.0:1773851894.911318:0:533719:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:26.0:1773851894.911319:0:533719:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.911320:0:533719:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:26.0:1773851894.911321:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.911321:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.911321:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009b252ed3 refcount=3
00000020:00000001:26.0:1773851894.911322:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:26.0:1773851894.911323:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:26.0:1773851894.911324:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.911324:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.911324:0:533719:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.911325:0:533719:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.911326:0:533719:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.911327:0:533719:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851894.911328:0:533719:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851894.911328:0:533719:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851894.911328:0:184027:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851894.911328:0:184027:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851894.911329:0:533719:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8658@kfi7, seq: 105589647
00000100:00000040:26.0:1773851894.911330:0:533719:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef161c6c : new rpc_count 1
00000100:00000001:26.0:1773851894.911330:0:533719:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780434944 : -106994929116672 : ffff9eb04d41da00)
00000100:00000001:24.0:1773851894.911330:0:184027:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.911331:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ae922ff1 x1859479595342848/t0(0) o103->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:24.0:1773851894.911331:0:184027:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.911334:0:533719:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851894.911334:0:533719:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851894.911335:0:533719:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ae922ff1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:94bc7d8e-6987-4a1b-8756-91253d59cad1+9:39964:x1859479595342848:12345-8658@kfi7:103:
00000100:00000200:26.0:1773851894.911336:0:533719:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479595342848
00010000:00000001:26.0:1773851894.911337:0:533719:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:26.0:1773851894.911337:0:533719:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:26.0:1773851894.911338:0:533719:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:26.0:1773851894.911338:0:533719:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851894.911339:0:533719:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851894.911339:0:533719:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002d5e9b6f.
02000000:00000001:26.0:1773851894.911340:0:533719:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.911340:0:533719:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.911350:0:533719:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:26.0:1773851894.911351:0:533719:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:26.0:1773851894.911351:0:533719:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851894.911352:0:533719:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851894.911352:0:533719:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009b252ed3 refcount=3
00000020:00000001:26.0:1773851894.911353:0:533719:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000001:26.0:1773851894.911353:0:533719:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065305152 : -106912644246464 : ffff9ec375d15440)
00010000:00000040:26.0:1773851894.911354:0:533719:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 230
00000004:00000001:26.0:1773851894.911355:0:533719:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:26.0:1773851894.911355:0:533719:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:26.0:1773851894.911356:0:533719:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851894.911356:0:533719:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:26.0:1773851894.911357:0:533719:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851894.911358:0:533719:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.911358:0:533719:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851894.911359:0:533719:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851894.911359:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.911360:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.911360:0:533719:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851894.911360:0:533719:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851894.911361:0:533719:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000009b252ed3 with handle 0x21b6f08f07a6ae57 from hash
00010000:00000001:26.0:1773851894.911362:0:533719:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851894.911362:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851894.911363:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.911363:0:533719:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851894.911363:0:533719:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851894.911364:0:533719:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.911364:0:533719:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851894.911365:0:533719:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851894.911365:0:533719:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000009b252ed3/0x21b6f08f07a6ae57 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 231 type: IBT gid 0 flags: 0x44a01000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46426 expref: 9 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851894.911368:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00010000:00000040:26.0:1773851894.911368:0:533719:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ef161c6c : new locks_count 3
00000020:00000040:26.0:1773851894.911369:0:533719:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 8
00010000:00000010:26.0:1773851894.911370:0:533719:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c8f3e963.
00010000:00000040:26.0:1773851894.911370:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851894.911371:0:533719:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851894.911371:0:533719:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851894.911372:0:533719:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851894.911372:0:533719:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:26.0:1773851894.911373:0:533719:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.911374:0:533719:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.911374:0:533719:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:26.0:1773851894.911375:0:533719:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00010000:26.0:1773851894.911375:0:533719:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:26.0:1773851894.911376:0:533719:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851894.911377:0:533719:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851894.911377:0:533719:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851894.911378:0:533719:0:(import.c:1951:at_measured()) add 1 to 00000000c6879252 time=148 v=66 (1 1 0 1)
00000100:00000001:26.0:1773851894.911378:0:533719:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851894.911379:0:533719:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d208fb4 refcount 3 to 8658@kfi7
00000100:00000001:26.0:1773851894.911380:0:533719:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637098420265536 : -106975289286080 : ffff9eb4dfe1e240)
02000000:00000001:26.0:1773851894.911380:0:533719:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851894.911381:0:533719:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851894.911381:0:533719:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851894.911382:0:533719:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8467@kfi7
00000400:00000010:26.0:1773851894.911382:0:533719:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005872c184.
00000100:00000200:26.0:1773851894.911383:0:533719:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859479595342848, offset 224
00000400:00000200:26.0:1773851894.911384:0:533719:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8467@kfi7
00000400:00000200:26.0:1773851894.911385:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8467@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.911385:0:533719:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fc61c55 nid 8467@kfi7 refs 1
00000400:00000200:26.0:1773851894.911386:0:533719:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002fc61c55 nid 8467@kfi7 refs 2
00000400:00000200:26.0:1773851894.911387:0:533719:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002fc61c55 nid 8467@kfi7 refs 3
00000400:00000200:26.0:1773851894.911388:0:533719:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8467@kfi7 local destination
00000400:00000200:26.0:1773851894.911389:0:533719:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770152:8770152:1024:4294967295] 8467@kfi7 LPNI seq info [4888392:4888392:16:4294967295]
00000400:00000200:26.0:1773851894.911390:0:533719:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002fc61c55 nid 8467@kfi7 refs 2
00000400:00000200:26.0:1773851894.911391:0:533719:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8467@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.911393:0:533719:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8467@kfi7(8467@kfi7:8467@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851894.911394:0:533719:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002fc61c55 nid 8467@kfi7 refs 3
00000800:00000200:26.0:1773851894.911396:0:533719:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851894.911397:0:533719:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851894.911399:0:533719:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851894.911401:0:533719:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x126b Using peer 8467@kfi7(0x126b)
00000800:00000200:26.0:1773851894.911404:0:533719:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x126b: rc=0
00000800:00000200:26.0:1773851894.911405:0:533719:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x126b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851894.911407:0:533719:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.911408:0:533719:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d208fb4 refcount 2 to 8658@kfi7
00010000:00000001:26.0:1773851894.911408:0:533719:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851894.911409:0:533719:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851894.911410:0:533719:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ae922ff1 x1859479595342848/t0(0) o103->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:26.0:1773851894.911413:0:533719:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ae922ff1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn06_021:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:39964:x1859479595342848:12345-8658@kfi7:103: Request processed in 78us (109us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851894.911415:0:533719:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8658@kfi7, seq: 105589647
00000100:00000040:26.0:1773851894.911415:0:533719:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef161c6c : new rpc_count 0
00000100:00000001:26.0:1773851894.911416:0:533719:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851894.911417:0:533719:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851894.911417:0:533719:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000800:00000200:25.0:1773851894.911417:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x126b TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851894.911418:0:533719:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000020:00000010:26.0:1773851894.911418:0:533719:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000024e5a498.
00000400:00000200:25.0:1773851894.911418:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:26.0:1773851894.911419:0:533719:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 7
00000100:00000001:26.0:1773851894.911419:0:533719:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851894.911419:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8467@kfi7: PUT: OK
00000400:00000200:25.0:1773851894.911420:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005872c184
00000400:00000010:25.0:1773851894.911420:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005872c184.
00000100:00000001:25.0:1773851894.911421:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.911421:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.911422:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002fc61c55 nid 8467@kfi7 refs 2
00000800:00000200:25.0:1773851894.911423:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 8467@kfi7(0000000041934f9a):0x0 lsk 4716 rsk 13 tsk 0 trmk 0 tmk 0 trr 6 tta 0x126b Transaction freed
00000800:00000200:26.0:1773851894.912706:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851894.912706:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851894.912708:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851894.912710:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851894.912712:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.912713:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8658@kfi7 : PUT - for me
00000400:00000200:26.0:1773851894.912713:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.912714:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000400:00000200:26.0:1773851894.912715:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.912715:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:26.0:1773851894.912716:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:26.0:1773851894.912717:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:26.0:1773851894.912718:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8658@kfi7 of length 576 into portal 12 MB=0x69b2fd4bf6040
00000400:00000200:26.0:1773851894.912719:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8658@kfi7 of length 576/576 into md 0x16159c9699 [64] + 36280
00000800:00000200:26.0:1773851894.912721:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851894.912722:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851894.912723:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8658@kfi7: PUT: OK
00000100:00000001:26.0:1773851894.912724:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851894.912724:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851894.912727:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eeb2e962.
00000100:00000040:26.0:1773851894.912728:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000eeb2e962 x1859479595343936 msgsize 576
00000100:00100000:26.0:1773851894.912729:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-8658@kfi7 (source: 12345-8658@kfi7)
00000100:00000001:26.0:1773851894.912730:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851894.912731:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000100:00000001:24.0:1773851894.912731:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851894.912731:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851894.912732:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851894.912732:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851894.912732:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851894.912733:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851894.912734:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479595343936
00000020:00000001:24.0:1773851894.912734:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851894.912734:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2fc9a
00000020:00000001:24.0:1773851894.912735:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.912735:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef161c6c refcount=8
00000020:00000001:24.0:1773851894.912736:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000020:00000001:24.0:1773851894.912737:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000100:00000001:24.0:1773851894.912737:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851894.912738:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851894.912739:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851894.912739:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851894.912740:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e24711f.
00000100:00000001:24.0:1773851894.912741:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851894.912741:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:24.0:1773851894.912742:0:60973:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:24.0:1773851894.912744:0:60973:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.912745:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.912746:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.912747:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851894.912748:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851894.912748:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851894.912749:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851894.912749:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851894.912749:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8658@kfi7, seq: 1451911041
00000100:00000001:27.0:1773851894.912750:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851894.912750:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef161c6c : new rpc_count 1
00000100:00000001:24.0:1773851894.912750:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637144347108096 : -106929362443520 : ffff9ebf9155e300)
00000100:00000001:27.0:1773851894.912751:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851894.912751:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eeb2e962 x1859479595343936/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:175/0 lens 576/0 e 0 to 0 dl 1773852290 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1029-0'
00000100:00000001:24.0:1773851894.912754:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851894.912754:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851894.912755:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eeb2e962 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:2067503:x1859479595343936:12345-8658@kfi7:101:default-tuolumne1029-0
00000100:00000200:24.0:1773851894.912757:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479595343936
00000020:00000001:24.0:1773851894.912757:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851894.912758:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851894.912758:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.912759:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851894.912759:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:24.0:1773851894.912760:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851894.912760:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859479595343936, found 0 last_xid 1859479595343935
00000020:00000001:24.0:1773851894.912761:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851894.912762:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851894.912762:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851894.912763:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.912763:0:60973:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:24.0:1773851894.912764:0:60973:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:24.0:1773851894.912764:0:60973:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:24.0:1773851894.912764:0:60973:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:24.0:1773851894.912765:0:60973:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.912766:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851894.912767:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 194
00010000:00000001:24.0:1773851894.912768:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.912769:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.912769:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000043cf542e.
00000020:00000001:24.0:1773851894.912770:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.912771:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000043cf542e with handle 0x21b6f08f07a6ae5e to hash
00000020:00000001:24.0:1773851894.912771:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.912772:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637161065302848 : -106912644248768 : ffff9ec375d14b40)
00010000:00000010:24.0:1773851894.912772:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000003a8b4b11.
00010000:00000001:24.0:1773851894.912773:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637161065302848 : -106912644248768 : ffff9ec375d14b40)
00010000:00010000:24.0:1773851894.912774:0:60973:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000043cf542e/0x21b6f08f07a6ae5e lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x7b0aff8279d46450 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912776:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000040:24.0:1773851894.912777:0:60973:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000ef161c6c : new locks_count 4
00000020:00000040:24.0:1773851894.912777:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000ef161c6c refcount=9
00010000:00000001:24.0:1773851894.912778:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:24.0:1773851894.912779:0:60973:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:24.0:1773851894.912779:0:60973:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:24.0:1773851894.912780:0:60973:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:24.0:1773851894.912780:0:60973:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:24.0:1773851894.912781:0:60973:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:24.0:1773851894.912781:0:60973:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:24.0:1773851894.912782:0:60973:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:24.0:1773851894.912783:0:60973:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:24.0:1773851894.912784:0:60973:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:24.0:1773851894.912785:0:60973:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.912786:0:60973:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:24.0:1773851894.912786:0:60973:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:24.0:1773851894.912786:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851894.912787:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851894.912789:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000ab9bace3.
02000000:00000001:24.0:1773851894.912789:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.912790:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.912791:0:60973:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.912792:0:60973:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:24.0:1773851894.912792:0:60973:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:24.0:1773851894.912793:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.912793:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.912794:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.912794:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.912795:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.912795:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.912796:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.912796:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.912796:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.912797:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851894.912797:0:60973:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:24.0:1773851894.912798:0:60973:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:24.0:1773851894.912798:0:60973:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:24.0:1773851894.912799:0:60973:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.912799:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.912800:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.912800:0:60973:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:24.0:1773851894.912801:0:60973:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.912801:0:60973:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:24.0:1773851894.912802:0:60973:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 000000003ddc9c41
00000004:00000001:24.0:1773851894.912803:0:60973:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:24.0:1773851894.912803:0:60973:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:24.0:1773851894.912803:0:60973:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:24.0:1773851894.912804:0:60973:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:24.0:1773851894.912804:0:60973:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00010000:00000001:24.0:1773851894.912805:0:60973:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.912805:0:60973:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:24.0:1773851894.912806:0:60973:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000002090aaec.
00000020:00000001:24.0:1773851894.912807:0:60973:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:24.0:1773851894.912807:0:60973:0:(lustre_handles.c:97:class_handle_hash()) added object 000000002090aaec with handle 0x21b6f08f07a6ae65 to hash
00000020:00000001:24.0:1773851894.912808:0:60973:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:24.0:1773851894.912808:0:60973:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000010:24.0:1773851894.912809:0:60973:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000001a3f9e68.
00010000:00000001:24.0:1773851894.912809:0:60973:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000001:24.0:1773851894.912811:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.912811:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.912812:0:60973:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000002090aaec/0x21b6f08f07a6ae65 lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912814:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:24.0:1773851894.912815:0:60973:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:24.0:1773851894.912815:0:60973:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:24.0:1773851894.912815:0:60973:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:24.0:1773851894.912816:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.912817:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.912817:0:60973:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:24.0:1773851894.912818:0:60973:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.912818:0:60973:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:24.0:1773851894.912819:0:60973:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:24.0:1773851894.912819:0:60973:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:24.0:1773851894.912819:0:60973:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:24.0:1773851894.912820:0:60973:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 195
00010000:00000040:24.0:1773851894.912821:0:60973:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:24.0:1773851894.912822:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912824:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912825:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912827:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912828:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912830:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912831:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912836:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912837:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912839:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912840:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912842:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912843:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912845:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912846:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912848:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912849:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912851:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912852:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912854:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912856:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912858:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912859:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912861:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912862:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912864:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912865:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912867:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912868:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912870:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912871:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912873:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912874:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912876:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912877:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912879:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912880:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912882:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912883:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912886:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912887:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912889:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912890:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912892:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912893:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912895:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912896:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 7 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912898:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912899:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912901:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912902:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912905:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912905:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912907:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912908:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912911:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912912:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912914:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912915:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912917:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912918:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912920:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912921:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912923:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912924:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912926:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912927:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912929:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912930:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912932:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912934:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912936:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912937:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912939:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912940:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912942:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912943:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912945:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912946:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912948:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912949:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912951:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912952:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912954:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912955:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912957:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912958:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912960:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912961:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912963:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912964:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 6 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912966:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912967:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912969:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912970:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912972:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912973:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912975:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912976:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912978:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912979:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912981:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912982:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912984:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912985:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912987:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912988:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912990:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912991:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912993:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912994:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.912996:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.912998:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913000:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913000:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913003:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913004:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913006:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913007:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913009:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913010:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913012:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913013:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913015:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913016:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913018:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913019:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913021:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913022:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913024:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913025:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913027:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913028:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913030:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913031:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913034:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913035:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913037:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913038:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913040:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913041:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913043:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913044:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913046:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913047:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913049:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913050:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913052:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913053:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913055:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913056:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913059:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913060:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913062:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913063:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913065:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913066:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913068:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913069:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913071:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913071:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913073:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913075:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913076:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913077:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913079:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913080:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913083:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913084:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913086:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913087:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913089:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913090:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913092:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913093:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913095:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913096:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913098:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913099:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913101:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913102:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913104:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913105:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913107:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913108:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913110:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913111:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913113:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913114:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913116:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913117:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913119:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913120:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913122:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913123:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913125:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913126:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913128:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913129:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913131:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913132:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913134:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913135:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913137:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913139:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 9 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913140:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913141:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913143:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913144:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913147:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913147:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913149:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913151:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913153:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913154:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913157:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913158:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913159:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913161:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913163:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913164:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913166:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913167:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913169:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913170:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913172:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913173:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913175:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913176:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913178:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913180:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913182:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913183:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913185:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913187:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913189:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913190:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913192:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913193:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913195:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913196:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913198:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913199:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913202:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913203:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913205:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913206:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913208:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913209:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913211:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913212:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913214:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913216:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913218:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913219:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913221:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913222:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913224:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913225:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913227:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913229:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913231:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913232:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913234:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913235:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913237:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913238:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913240:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913241:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913243:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913244:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913246:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913248:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913250:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913251:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913253:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913254:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913256:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913257:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913259:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913260:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913262:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913263:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913265:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913266:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913268:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913269:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913271:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913272:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913274:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913275:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913277:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913278:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913280:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913281:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913284:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913285:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913287:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913288:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913290:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913291:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913293:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913294:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913296:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913297:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913299:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913300:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913302:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913303:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913305:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913307:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913309:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913310:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913312:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913313:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913315:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913316:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913318:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913319:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913321:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913322:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913324:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913326:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913328:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913329:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913331:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913332:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913334:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913335:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913337:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913338:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913341:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913342:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913344:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913345:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913347:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913348:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913351:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913352:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913353:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913355:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913357:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913358:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913360:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913361:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913363:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913364:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913366:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913367:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913369:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913370:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913372:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913374:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913376:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913377:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913379:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913380:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913382:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913383:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913385:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913387:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913389:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913390:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913392:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913393:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913394:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913395:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913397:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913399:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913401:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913402:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913404:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913405:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913407:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913408:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913410:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913411:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913413:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913414:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913416:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913417:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913419:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913420:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913422:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913423:0:60973:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913425:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00010000:24.0:1773851894.913425:0:60973:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000002090aaec/0x21b6f08f07a6ae65 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913428:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:24.0:1773851894.913428:0:60973:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:24.0:1773851894.913428:0:60973:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:24.0:1773851894.913429:0:60973:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.913429:0:60973:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:24.0:1773851894.913430:0:60973:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.913430:0:60973:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.913431:0:60973:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:24.0:1773851894.913432:0:60973:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:24.0:1773851894.913432:0:60973:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:24.0:1773851894.913433:0:60973:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000002090aaec/0x21b6f08f07a6ae65 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913435:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:24.0:1773851894.913436:0:60973:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:24.0:1773851894.913436:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.913436:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.913437:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.913437:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.913438:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002090aaec refcount=3
00000020:00000001:24.0:1773851894.913438:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000001:24.0:1773851894.913439:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000001:24.0:1773851894.913440:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.913440:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.913440:0:60973:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.913441:0:60973:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.913442:0:60973:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:24.0:1773851894.913443:0:60973:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:24.0:1773851894.913443:0:60973:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:24.0:1773851894.913450:0:60973:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.913451:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851894.913452:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.913452:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.913453:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913454:0:60973:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913454:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913455:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851894.913456:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.913456:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.913456:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913457:0:60973:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913458:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:24.0:1773851894.913459:0:60973:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:24.0:1773851894.913459:0:60973:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.913460:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.913460:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.913461:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.913461:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851894.913462:0:60973:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:24.0:1773851894.913462:0:60973:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:24.0:1773851894.913463:0:60973:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:24.0:1773851894.913463:0:60973:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:24.0:1773851894.913464:0:60973:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:24.0:1773851894.913465:0:60973:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:24.0:1773851894.913465:0:60973:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:24.0:1773851894.913466:0:60973:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.913466:0:60973:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:24.0:1773851894.913467:0:60973:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:24.0:1773851894.913467:0:60973:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.913467:0:60973:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:24.0:1773851894.913468:0:60973:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913468:0:60973:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913469:0:60973:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:24.0:1773851894.913469:0:60973:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.913470:0:60973:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:24.0:1773851894.913471:0:60973:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.913472:0:60973:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.913473:0:60973:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.913474:0:60973:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:24.0:1773851894.913474:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851894.913475:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002090aaec refcount=3
00000020:00000001:24.0:1773851894.913475:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000001:24.0:1773851894.913476:0:60973:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00000004:00000040:24.0:1773851894.913476:0:60973:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000ef161c6c : new locks_count 5
00000020:00000040:24.0:1773851894.913477:0:60973:0:(genops.c:871:class_export_get()) GET export 00000000ef161c6c refcount=10
00010000:00000001:24.0:1773851894.913478:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.913479:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:24.0:1773851894.913479:0:60973:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851894.913480:0:60973:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:24.0:1773851894.913480:0:60973:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:24.0:1773851894.913480:0:60973:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:24.0:1773851894.913481:0:60973:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:24.0:1773851894.913481:0:60973:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:24.0:1773851894.913482:0:60973:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:24.0:1773851894.913482:0:60973:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:24.0:1773851894.913483:0:60973:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851894.913483:0:60973:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:24.0:1773851894.913484:0:60973:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:24.0:1773851894.913484:0:60973:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:24.0:1773851894.913485:0:60973:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:24.0:1773851894.913485:0:60973:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:24.0:1773851894.913486:0:60973:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:24.0:1773851894.913486:0:60973:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:24.0:1773851894.913487:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.913487:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.913487:0:60973:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:24.0:1773851894.913488:0:60973:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851894.913488:0:60973:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000043cf542e with handle 0x21b6f08f07a6ae5e from hash
00010000:00000001:24.0:1773851894.913489:0:60973:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:24.0:1773851894.913489:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.913490:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.913490:0:60973:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:24.0:1773851894.913490:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:24.0:1773851894.913491:0:60973:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000043cf542e/0x21b6f08f07a6ae5e lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46450 expref: 10 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913493:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:24.0:1773851894.913493:0:60973:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ef161c6c : new locks_count 4
00000020:00000040:24.0:1773851894.913494:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 9
00010000:00000010:24.0:1773851894.913494:0:60973:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000003a8b4b11.
00010000:00000040:24.0:1773851894.913495:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:24.0:1773851894.913495:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:24.0:1773851894.913496:0:60973:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.913497:0:60973:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:24.0:1773851894.913498:0:60973:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000002090aaec/0x21b6f08f07a6ae65 lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46450 expref: 9 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:24.0:1773851894.913500:0:60973:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:24.0:1773851894.913501:0:60973:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:24.0:1773851894.913501:0:60973:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:24.0:1773851894.913501:0:60973:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:24.0:1773851894.913502:0:60973:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:24.0:1773851894.913503:0:60973:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:24.0:1773851894.913503:0:60973:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:24.0:1773851894.913504:0:60973:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:24.0:1773851894.913504:0:60973:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:24.0:1773851894.913504:0:60973:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:24.0:1773851894.913505:0:60973:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000002090aaec, rc 0)
00000020:00000001:24.0:1773851894.913505:0:60973:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851894.913506:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106902121, transno 0, xid 1859479595343936
00010000:00000001:24.0:1773851894.913507:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851894.913507:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eeb2e962 x1859479595343936/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:175/0 lens 576/640 e 0 to 0 dl 1773852290 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1029-0'
00010000:00000001:24.0:1773851894.913510:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851894.913510:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851894.913511:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=127 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851894.913512:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851894.913513:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d208fb4 refcount 3 to 8658@kfi7
00000100:00000001:24.0:1773851894.913513:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637098420265536 : -106975289286080 : ffff9eb4dfe1e240)
02000000:00000001:24.0:1773851894.913514:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851894.913514:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851894.913515:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851894.913515:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8658@kfi7
00000400:00000010:24.0:1773851894.913516:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000773be3f9.
00000100:00000200:24.0:1773851894.913517:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859479595343936, offset 224
00000400:00000200:24.0:1773851894.913518:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8658@kfi7
00000400:00000200:24.0:1773851894.913519:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:24.0:1773851894.913519:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 1
00000400:00000200:24.0:1773851894.913520:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:24.0:1773851894.913521:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000400:00000200:24.0:1773851894.913522:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8658@kfi7 local destination
00000400:00000200:24.0:1773851894.913524:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770153:8770153:1024:4294967295] 8658@kfi7 LPNI seq info [4888393:4888393:16:4294967295]
00000400:00000200:24.0:1773851894.913525:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000400:00000200:24.0:1773851894.913525:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:24.0:1773851894.913527:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8658@kfi7(8658@kfi7:8658@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851894.913528:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 3
00000800:00000200:24.0:1773851894.913530:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851894.913531:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:24.0:1773851894.913533:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851894.913535:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Using peer 8658@kfi7(0x10000000000127c)
00000800:00000200:24.0:1773851894.913537:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 740 bytes to peer 0x10000000000127c: rc=0
00000800:00000200:24.0:1773851894.913539:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851894.913540:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851894.913541:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d208fb4 refcount 2 to 8658@kfi7
00010000:00000001:24.0:1773851894.913541:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851894.913542:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851894.913542:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851894.913543:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eeb2e962 x1859479595343936/t0(0) o101->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:175/0 lens 576/640 e 0 to 0 dl 1773852290 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1029-0'
00000100:00100000:24.0:1773851894.913547:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eeb2e962 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:94bc7d8e-6987-4a1b-8756-91253d59cad1+9:2067503:x1859479595343936:12345-8658@kfi7:101:default-tuolumne1029-0 Request processed in 791us (817us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851894.913553:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8658@kfi7, seq: 1451911041
00000100:00000040:24.0:1773851894.913554:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef161c6c : new rpc_count 0
00000100:00000001:24.0:1773851894.913554:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851894.913555:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851894.913555:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851894.913556:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e24711f.
00000020:00000010:24.0:1773851894.913557:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851894.913557:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 8
00000100:00000001:24.0:1773851894.913558:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851894.913563:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851894.913564:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.913565:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8658@kfi7: PUT: OK
00000400:00000200:25.0:1773851894.913566:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000773be3f9
00000400:00000010:25.0:1773851894.913566:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000773be3f9.
00000100:00000001:25.0:1773851894.913567:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851894.913567:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851894.913568:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a528f67 nid 8658@kfi7 refs 2
00000800:00000200:25.0:1773851894.913569:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 8658@kfi7(0000000015b25e06):0x0 lsk 4733 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000127c Transaction freed
00000800:00000200:5.0:1773851894.913658:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.913659:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851894.913660:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851894.913662:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851894.913664:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.913665:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8659@kfi7 : PUT - for me
00000400:00000200:5.0:1773851894.913666:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.913666:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 1
00000400:00000200:5.0:1773851894.913668:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.913668:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000400:00000200:5.0:1773851894.913669:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 3
00000400:00000200:5.0:1773851894.913670:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8658@kfi7 to cpt 6
00000400:00000200:5.0:1773851894.913671:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8658@kfi7 of length 328 into portal 17 MB=0x69b2fd4bf60c0
00000400:00000200:5.0:1773851894.913672:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8658@kfi7 of length 328/328 into md 0x7939ffee5 [2] + 1880
00000400:00000010:5.0:1773851894.913673:0:2507993:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000006eac6272.
00000400:00000200:5.0:1773851894.913674:0:2507993:0:(lib-md.c:64:lnet_md_unlink()) Queueing unlink of md 00000000f0027043
00000800:00000200:5.0:1773851894.913675:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851894.913677:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851894.913678:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8659@kfi7: PUT: OK
00000400:00000200:5.0:1773851894.913679:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f0027043
00000400:00000010:5.0:1773851894.913680:0:2507993:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000f0027043 (tot 253201691).
00000100:00000001:5.0:1773851894.913681:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851894.913681:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000040:5.0:1773851894.913682:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000098c27eff x1859479595344064 msgsize 328
00000100:00100000:5.0:1773851894.913684:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-8658@kfi7 (source: 12345-8659@kfi7)
00000100:00000040:5.0:1773851894.913685:0:2507993:0:(events.c:370:request_in_callback()) Buffer complete: 63 buffers still posted
00000100:00000001:5.0:1773851894.913687:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851894.913688:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000800:00000200:5.0:1773851894.913689:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dc7a9b7e: 2069@kfi7:1 <- 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851894.913692:0:61161:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:5.0:1773851894.913692:0:61161:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:5.0:1773851894.913693:0:61161:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851894.913693:0:61161:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851894.913694:0:61161:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851894.913695:0:61161:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859479595344064
00000020:00000001:5.0:1773851894.913696:0:61161:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:5.0:1773851894.913696:0:61161:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae2fc9a
00000020:00000001:5.0:1773851894.913697:0:61161:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851894.913698:0:61161:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef161c6c refcount=9
00000020:00000001:5.0:1773851894.913698:0:61161:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000020:00000001:5.0:1773851894.913699:0:61161:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637068597066752 : -107005112484864 : ffff9eadee47fc00)
00000100:00000001:5.0:1773851894.913700:0:61161:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851894.913700:0:61161:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:5.0:1773851894.913701:0:61161:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000037a7757e.
00000020:00000010:5.0:1773851894.913702:0:61161:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851894.913703:0:61161:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a694bc33.
00000100:00000040:5.0:1773851894.913704:0:61161:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:5.0:1773851894.913705:0:61161:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:5.0:1773851894.913705:0:61161:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:5.0:1773851894.913706:0:61161:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:5.0:1773851894.913706:0:61161:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.913707:0:61161:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:5.0:1773851894.913708:0:61161:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:5.0:1773851894.913708:0:61161:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851894.913709:0:61161:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002090aaec refcount=3
00000020:00000001:5.0:1773851894.913709:0:61161:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000001:5.0:1773851894.913710:0:61161:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000001:5.0:1773851894.913711:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851894.913712:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:5.0:1773851894.913712:0:61161:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.913713:0:61161:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.913714:0:61161:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.913715:0:61161:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851894.913716:0:61161:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851894.913717:0:61161:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851894.913718:0:82918:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851894.913718:0:82918:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:5.0:1773851894.913718:0:61161:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8658@kfi7, seq: 43812578
00000100:00000001:7.0:1773851894.913719:0:82918:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851894.913719:0:61161:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef161c6c : new rpc_count 1
00000100:00000001:5.0:1773851894.913719:0:61161:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114584191056 : -106959125360560 : ffff9eb8a353d050)
00000100:00000001:7.0:1773851894.913720:0:82918:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851894.913720:0:61161:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000098c27eff x1859479595344064/t0(0) o103->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:5.0:1773851894.913723:0:61161:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:5.0:1773851894.913723:0:61161:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:5.0:1773851894.913727:0:61161:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098c27eff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn01_004:94bc7d8e-6987-4a1b-8756-91253d59cad1+9:39962:x1859479595344064:12345-8658@kfi7:103:
00000100:00000200:5.0:1773851894.913729:0:61161:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859479595344064
00010000:00000001:5.0:1773851894.913729:0:61161:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:5.0:1773851894.913730:0:61161:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:5.0:1773851894.913730:0:61161:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:5.0:1773851894.913731:0:61161:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851894.913732:0:61161:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851894.913732:0:61161:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eff00cf0.
02000000:00000001:5.0:1773851894.913733:0:61161:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.913734:0:61161:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.913734:0:61161:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:5.0:1773851894.913735:0:61161:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:5.0:1773851894.913736:0:61161:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:5.0:1773851894.913736:0:61161:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:5.0:1773851894.913736:0:61161:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000002090aaec refcount=3
00000020:00000001:5.0:1773851894.913737:0:61161:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000001:5.0:1773851894.913737:0:61161:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637161065313216 : -106912644238400 : ffff9ec375d173c0)
00010000:00000040:5.0:1773851894.913738:0:61161:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00000004:00000001:5.0:1773851894.913739:0:61161:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:5.0:1773851894.913740:0:61161:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:5.0:1773851894.913740:0:61161:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:5.0:1773851894.913741:0:61161:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:5.0:1773851894.913742:0:61161:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851894.913742:0:61161:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.913744:0:61161:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:5.0:1773851894.913744:0:61161:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:5.0:1773851894.913745:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851894.913745:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:5.0:1773851894.913746:0:61161:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:5.0:1773851894.913747:0:61161:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:5.0:1773851894.913747:0:61161:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000002090aaec with handle 0x21b6f08f07a6ae65 from hash
00010000:00000001:5.0:1773851894.913748:0:61161:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:5.0:1773851894.913748:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:5.0:1773851894.913749:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:5.0:1773851894.913749:0:61161:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:5.0:1773851894.913750:0:61161:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:5.0:1773851894.913751:0:61161:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.913751:0:61161:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:5.0:1773851894.913752:0:61161:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:5.0:1773851894.913752:0:61161:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000002090aaec/0x21b6f08f07a6ae65 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46450 expref: 9 pid: 60973 timeout: 0 lvb_type: 0
00010000:00000040:5.0:1773851894.913755:0:61161:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:5.0:1773851894.913756:0:61161:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000ef161c6c : new locks_count 3
00000020:00000040:5.0:1773851894.913757:0:61161:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 8
00010000:00000010:5.0:1773851894.913758:0:61161:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000001a3f9e68.
00010000:00000040:5.0:1773851894.913759:0:61161:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:5.0:1773851894.913759:0:61161:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:5.0:1773851894.913760:0:61161:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:5.0:1773851894.913760:0:61161:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:5.0:1773851894.913761:0:61161:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:5.0:1773851894.913762:0:61161:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:5.0:1773851894.913763:0:61161:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.913763:0:61161:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:5.0:1773851894.913764:0:61161:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00010000:5.0:1773851894.913764:0:61161:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:5.0:1773851894.913765:0:61161:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:5.0:1773851894.913766:0:61161:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:5.0:1773851894.913766:0:61161:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851894.913767:0:61161:0:(import.c:1951:at_measured()) add 1 to 0000000099aaac99 time=148 v=66 (1 1 0 1)
00000100:00000001:5.0:1773851894.913768:0:61161:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:5.0:1773851894.913769:0:61161:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d208fb4 refcount 3 to 8658@kfi7
00000100:00000001:5.0:1773851894.913770:0:61161:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637098420265536 : -106975289286080 : ffff9eb4dfe1e240)
02000000:00000001:5.0:1773851894.913770:0:61161:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:5.0:1773851894.913771:0:61161:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.913772:0:61161:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851894.913772:0:61161:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8659@kfi7
00000400:00000010:5.0:1773851894.913773:0:61161:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036e7f712.
00000100:00000200:5.0:1773851894.913774:0:61161:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859479595344064, offset 224
00000400:00000200:5.0:1773851894.913775:0:61161:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8659@kfi7
00000400:00000200:5.0:1773851894.913776:0:61161:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.913777:0:61161:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 1
00000400:00000200:5.0:1773851894.913778:0:61161:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000400:00000200:5.0:1773851894.913779:0:61161:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 3
00000400:00000200:5.0:1773851894.913780:0:61161:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8659@kfi7 local destination
00000400:00000200:5.0:1773851894.913781:0:61161:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770154:8770154:1024:4294967295] 8659@kfi7 LPNI seq info [4888394:4888394:16:4294967295]
00000400:00000200:5.0:1773851894.913782:0:61161:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009202b8fd nid 8659@kfi7 refs 2
00000400:00000200:5.0:1773851894.913783:0:61161:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8659@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.913785:0:61161:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8659@kfi7(8659@kfi7:8659@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851894.913786:0:61161:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 3
00000800:00000200:5.0:1773851894.913787:0:61161:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.913788:0:61161:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851894.913790:0:61161:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851894.913792:0:61161:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 Using peer 8659@kfi7(0x1278)
00000800:00000200:5.0:1773851894.913795:0:61161:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dc7a9b7e: Posted send of 324 bytes to peer 0x1278: rc=0
00000800:00000200:5.0:1773851894.913797:0:61161:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851894.913799:0:61161:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851894.913799:0:61161:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d208fb4 refcount 2 to 8658@kfi7
00010000:00000001:5.0:1773851894.913800:0:61161:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851894.913801:0:61161:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851894.913802:0:61161:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098c27eff x1859479595344064/t0(0) o103->94bc7d8e-6987-4a1b-8756-91253d59cad1@8658@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:5.0:1773851894.913804:0:61161:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098c27eff pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn01_004:94bc7d8e-6987-4a1b-8756-91253d59cad1+8:39962:x1859479595344064:12345-8658@kfi7:103: Request processed in 80us (121us total) trans 0 rc 0/0
00000100:00100000:5.0:1773851894.913807:0:61161:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8658@kfi7, seq: 43812578
00000100:00000040:5.0:1773851894.913808:0:61161:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef161c6c : new rpc_count 0
00000800:00000200:6.0:1773851894.913809:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851894.913809:0:61161:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851894.913809:0:61161:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:5.0:1773851894.913810:0:61161:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000b49a87ff.
00000020:00000010:5.0:1773851894.913810:0:61161:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a694bc33.
00000400:00000200:6.0:1773851894.913811:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:5.0:1773851894.913811:0:61161:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000037a7757e.
00000400:00000200:6.0:1773851894.913812:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8659@kfi7: PUT: OK
00000400:00000200:6.0:1773851894.913812:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036e7f712
00000020:00000040:5.0:1773851894.913812:0:61161:0:(genops.c:882:class_export_put()) PUTting export 00000000ef161c6c : new refcount 7
00000400:00000010:6.0:1773851894.913813:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036e7f712.
02000000:00000001:5.0:1773851894.913813:0:61161:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000100:00000001:6.0:1773851894.913814:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:6.0:1773851894.913814:0:2499722:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:5.0:1773851894.913814:0:61161:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000b011310e.
02000000:00000010:6.0:1773851894.913815:0:2499722:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000eff00cf0.
02000000:00000001:6.0:1773851894.913815:0:2499722:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
02000000:00000001:5.0:1773851894.913815:0:61161:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:5.0:1773851894.913815:0:61161:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c57e563d.
00000100:00000001:6.0:1773851894.913816:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851894.913816:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009202b8fd nid 8659@kfi7 refs 2
02000000:00000001:5.0:1773851894.913816:0:61161:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:5.0:1773851894.913816:0:61161:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000008fa7fdd9.
02000000:00000001:5.0:1773851894.913817:0:61161:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:5.0:1773851894.913817:0:61161:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e45689cc.
00000800:00000200:6.0:1773851894.913818:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dc7a9b7e: 2069@kfi7:1 -> 8659@kfi7(000000004751cfe3):0x0 lsk 4729 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1278 Transaction freed
02000000:00000001:5.0:1773851894.913818:0:61161:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:5.0:1773851894.913819:0:61161:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000002ab05221.
02000000:00000001:5.0:1773851894.913820:0:61161:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:5.0:1773851894.913820:0:61161:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000020055302.
02000000:00000001:5.0:1773851894.913821:0:61161:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:5.0:1773851894.913822:0:61161:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000cedd41eb.
02000000:00000001:5.0:1773851894.913822:0:61161:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:5.0:1773851894.913823:0:61161:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a36c5049.
02000000:00000001:5.0:1773851894.913824:0:61161:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
02000000:00000010:5.0:1773851894.913824:0:61161:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 000000009e388e08.
02000000:00000001:5.0:1773851894.913825:0:61161:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000010:5.0:1773851894.913826:0:61161:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000062aa50d4.
00000100:00000001:5.0:1773851894.913827:0:61161:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:5.0:1773851894.913828:0:61161:0:(niobuf.c:993:ptlrpc_register_rqbd()) ldlm_canceld: registering portal 17
00000400:00000010:5.0:1773851894.913829:0:61161:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000573cf79c.
00000400:00000010:5.0:1773851894.913830:0:61161:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000939c3023 (tot 253201843).
00010000:00000010:24.1:1773851894.918727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000002127fc97.
00010000:00000010:5.1:1773851894.918727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000005ba4d8aa.
00010000:00000001:2.0:1773851894.921737:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921738:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.921740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.921742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.921744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.921746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.921748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921749:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.921750:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921751:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851894.921753:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851894.921753:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851894.921758:0:937834:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851894.921759:0:937834:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851894.921760:0:937834:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00010000:00000010:26.1:1773851894.926727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000009b252ed3.
00010000:00000010:24.1:1773851894.926727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000007c467a4b.
00010000:00000010:24.1:1773851894.926728:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000dc0dc02c.
00010000:00000010:24.1:1773851894.926729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000000477ffb5.
00010000:00000010:24.1:1773851894.926729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000001e96caf9.
00010000:00000010:5.1:1773851894.930727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000002090aaec.
00010000:00000010:24.1:1773851894.930728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000043cf542e.
00000800:00000200:15.0:1773851894.931446:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851894.931446:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851894.931447:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851894.931447:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:15.0:1773851894.931448:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851894.931448:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:15.0:1773851894.931450:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851894.931450:0:2514739:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8691@kfi7(000000007196ff34):0x1271 version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851894.931452:0:2514739:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 Using peer 8691@kfi7(0x100000000001271)
00000400:00000200:15.0:1773851894.931453:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:15.0:1773851894.931454:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8691@kfi7 : PUT - for me
00000400:00000200:14.0:1773851894.931455:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:15.0:1773851894.931456:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:15.0:1773851894.931457:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000800:00000200:14.0:1773851894.931457:0:2514739:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000c8e2b965: Posted send of 38 bytes to peer 0x100000000001271: rc=0
00000400:00000200:15.0:1773851894.931458:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000800:00000200:14.0:1773851894.931458:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:15.0:1773851894.931460:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:15.0:1773851894.931460:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000400:00000200:15.0:1773851894.931462:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:15.0:1773851894.931463:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 576 into portal 12 MB=0x69b3003488b80
00000400:00000200:15.0:1773851894.931464:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8691@kfi7 of length 576/576 into md 0x82a36e8ed [64] + 52776
00000800:00000200:15.0:1773851894.931467:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851894.931469:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851894.931470:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8691@kfi7: PUT: OK
00000100:00000001:15.0:1773851894.931471:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851894.931471:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:14.0:1773851894.931471:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 TN_EVENT_TX_OK event status 0
00000100:00000010:15.0:1773851894.931473:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000373f1cb1.
00000100:00000040:15.0:1773851894.931473:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000373f1cb1 x1859480376085376 msgsize 576
00000800:00000200:14.0:1773851894.931474:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 Transaction freed
00000100:00100000:15.0:1773851894.931475:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8691@kfi7)
00000100:00000001:15.0:1773851894.931476:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851894.931477:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000100:00000001:12.0:1773851894.931478:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851894.931478:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:15.0:1773851894.931479:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851894.931479:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851894.931479:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.931480:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.931481:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376085376
00000020:00000001:12.0:1773851894.931481:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851894.931482:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000020:00000001:12.0:1773851894.931482:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.931486:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=7
00000020:00000001:12.0:1773851894.931487:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000020:00000001:12.0:1773851894.931488:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000100:00000001:12.0:1773851894.931489:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.931490:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851894.931490:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b340e1ba.
00000020:00000010:12.0:1773851894.931491:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.931492:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065d9b02b.
00000100:00000001:12.0:1773851894.931493:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851894.931494:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:12.0:1773851894.931494:0:60487:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:12.0:1773851894.931495:0:60487:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.931495:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.931496:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.931497:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851894.931499:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.931499:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851894.931499:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851894.931499:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851894.931500:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 411190557
00000100:00000001:15.0:1773851894.931501:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.931501:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 1
00000100:00000001:15.0:1773851894.931502:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.931502:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860202240 : -107049849349376 : ffff9ea383c19b00)
00000100:00000040:12.0:1773851894.931503:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000373f1cb1 x1859480376085376/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:534/0 lens 576/0 e 0 to 0 dl 1773852649 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1017-0'
00000100:00000001:12.0:1773851894.931506:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.931506:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851894.931507:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000373f1cb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+7:1723140:x1859480376085376:12345-8691@kfi7:101:default-tuolumne1017-0
00000100:00000200:12.0:1773851894.931509:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376085376
00000020:00000001:12.0:1773851894.931510:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851894.931510:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851894.931511:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.931512:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851894.931512:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:12.0:1773851894.931513:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851894.931514:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859480376085376, found 0 last_xid 1859480376085375
00000020:00000001:12.0:1773851894.931514:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851894.931515:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851894.931516:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851894.931516:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.931517:0:60487:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:12.0:1773851894.931518:0:60487:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:12.0:1773851894.931518:0:60487:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:12.0:1773851894.931519:0:60487:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:12.0:1773851894.931519:0:60487:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.931522:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851894.931525:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 194
00010000:00000001:12.0:1773851894.931525:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.931526:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.931527:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000006d91247b.
00000020:00000001:12.0:1773851894.931529:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.931530:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 000000006d91247b with handle 0x21b6f08f07a6ae6c to hash
00000020:00000001:12.0:1773851894.931530:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.931531:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538928576 : -107107170623040 : ffff9e962b2461c0)
00010000:00000010:12.0:1773851894.931532:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c8eb859f.
00010000:00000001:12.0:1773851894.931533:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538928576 : -107107170623040 : ffff9e962b2461c0)
00010000:00010000:12.0:1773851894.931534:0:60487:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000006d91247b/0x21b6f08f07a6ae6c lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe67d5cc0bfa92ec5 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931537:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000040:12.0:1773851894.931539:0:60487:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000025f0c678 : new locks_count 3
00000020:00000040:12.0:1773851894.931540:0:60487:0:(genops.c:871:class_export_get()) GET export 0000000025f0c678 refcount=8
00010000:00000001:12.0:1773851894.931542:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:12.0:1773851894.931542:0:60487:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:12.0:1773851894.931544:0:60487:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:12.0:1773851894.931544:0:60487:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:12.0:1773851894.931545:0:60487:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:12.0:1773851894.931546:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851894.931546:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:12.0:1773851894.931547:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851894.931549:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:12.0:1773851894.931550:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:12.0:1773851894.931550:0:60487:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.931552:0:60487:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:12.0:1773851894.931553:0:60487:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:12.0:1773851894.931553:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851894.931554:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851894.931556:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 000000008eec058f.
02000000:00000001:12.0:1773851894.931556:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.931557:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.931557:0:60487:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.931559:0:60487:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:12.0:1773851894.931560:0:60487:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:12.0:1773851894.931560:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.931561:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.931562:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.931562:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.931563:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.931563:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.931564:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.931564:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.931565:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.931565:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.931567:0:60487:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:12.0:1773851894.931568:0:60487:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:12.0:1773851894.931569:0:60487:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:12.0:1773851894.931571:0:60487:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.931571:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.931572:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.931572:0:60487:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:12.0:1773851894.931573:0:60487:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.931574:0:60487:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:12.0:1773851894.931575:0:60487:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 000000007cbc2b2a
00000004:00000001:12.0:1773851894.931576:0:60487:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:12.0:1773851894.931577:0:60487:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:12.0:1773851894.931578:0:60487:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:12.0:1773851894.931578:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851894.931579:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:12.0:1773851894.931579:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.931580:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.931581:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000007f430c34.
00000020:00000001:12.0:1773851894.931582:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.931583:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 000000007f430c34 with handle 0x21b6f08f07a6ae73 to hash
00000020:00000001:12.0:1773851894.931583:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.931584:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538921664 : -107107170629952 : ffff9e962b2446c0)
00010000:00000010:12.0:1773851894.931584:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000009b550415.
00010000:00000001:12.0:1773851894.931585:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538921664 : -107107170629952 : ffff9e962b2446c0)
00010000:00000001:12.0:1773851894.931586:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.931587:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.931587:0:60487:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000007f430c34/0x21b6f08f07a6ae73 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931590:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:12.0:1773851894.931591:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:12.0:1773851894.931591:0:60487:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:12.0:1773851894.931592:0:60487:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:12.0:1773851894.931593:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.931594:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.931594:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.931595:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.931596:0:60487:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:12.0:1773851894.931597:0:60487:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:12.0:1773851894.931598:0:60487:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:12.0:1773851894.931598:0:60487:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:12.0:1773851894.931599:0:60487:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 195
00010000:00000040:12.0:1773851894.931600:0:60487:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:12.0:1773851894.931602:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931604:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931606:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931609:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931611:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931613:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931615:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931617:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931619:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931621:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931623:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931625:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931627:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931632:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931634:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931635:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931637:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931639:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931641:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931643:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931645:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931647:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931648:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931650:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931652:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931654:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931656:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931658:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931660:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931663:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931664:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931666:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931668:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931670:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931671:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931673:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931675:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931677:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931678:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931681:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931682:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931684:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931687:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931689:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931690:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931693:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931695:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931697:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931698:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931700:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931702:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931704:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931706:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931708:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931709:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931712:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931713:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931715:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931716:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931718:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931719:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931722:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931724:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931730:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931731:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931733:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931735:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931737:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931738:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931740:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931742:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931744:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931745:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931747:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931749:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931751:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931753:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931757:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931759:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931761:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931762:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931764:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931766:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931768:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931769:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931771:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931772:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931775:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931776:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931778:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931780:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931782:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931784:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931787:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931788:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931790:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931791:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931794:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931795:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931797:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931799:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931800:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931802:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931804:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931806:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931808:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931809:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931811:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931813:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931815:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931817:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931819:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931820:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931822:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931824:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931826:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931827:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931829:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931831:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931833:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931834:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931836:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931838:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931840:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931842:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931845:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931846:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931848:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931850:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931852:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931853:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931855:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931857:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931859:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931860:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931863:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931864:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931867:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931868:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931870:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931871:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931874:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931875:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931877:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931879:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931881:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931882:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931885:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931886:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931888:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931890:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931892:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931893:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931895:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931896:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931898:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931900:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931902:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931904:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931906:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931907:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931909:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931910:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931912:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931914:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931916:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931918:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931919:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931921:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931923:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931924:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931927:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931928:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931931:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931932:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931934:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931936:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931938:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931940:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931942:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931943:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931945:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931947:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931949:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931951:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931953:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931954:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931956:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931958:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931960:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931962:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931964:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931965:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931968:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931969:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931971:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931972:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931975:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931976:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931978:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931979:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931982:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931983:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931985:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931986:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931989:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931991:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931993:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931994:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.931996:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.931998:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932000:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932001:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932003:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932004:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932006:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932008:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932010:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932012:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932014:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932015:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932018:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932019:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932021:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932023:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932025:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932027:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932029:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932030:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932032:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932033:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932036:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932037:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932039:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932040:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932043:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932044:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932047:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932048:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932050:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932051:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932053:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932055:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932057:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932059:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932061:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932063:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932065:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932066:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932068:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932069:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932072:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932073:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932076:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932077:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932079:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932080:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932082:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932084:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932086:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932087:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932089:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932091:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932093:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932094:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932096:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932098:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932100:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932101:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932104:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932106:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932108:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932110:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932112:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932113:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932115:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932117:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932119:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932120:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932122:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932123:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932125:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932127:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932129:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932131:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932133:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932135:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932137:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932138:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932140:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932142:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932144:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932145:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932147:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932148:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932150:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932152:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932154:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932155:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932158:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932159:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932162:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932163:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932165:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932167:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932169:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932170:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932172:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932173:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932176:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932177:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932179:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932181:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932183:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932184:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932186:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932187:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932190:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932191:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932193:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932195:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932197:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932198:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932200:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932202:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932204:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932206:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932208:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932209:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932212:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932213:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932215:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932217:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932220:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932221:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932223:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932224:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932227:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932228:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932230:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932232:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932234:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932235:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932237:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932239:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932241:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932242:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932244:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932246:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932250:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932251:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932253:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932254:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932256:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932258:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932260:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932262:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932264:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932266:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932268:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932269:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932271:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932272:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932275:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932276:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932279:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932280:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932282:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932283:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932286:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932287:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932289:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932291:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932293:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932294:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932296:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932298:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932300:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932301:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932303:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932305:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932307:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932308:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932310:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932311:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932313:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00010000:12.0:1773851894.932314:0:60487:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000007f430c34/0x21b6f08f07a6ae73 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932316:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:12.0:1773851894.932317:0:60487:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:12.0:1773851894.932318:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851894.932319:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.932320:0:60487:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:12.0:1773851894.932320:0:60487:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.932321:0:60487:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.932321:0:60487:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.932322:0:60487:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:12.0:1773851894.932323:0:60487:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.932324:0:60487:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000007f430c34/0x21b6f08f07a6ae73 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932326:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:12.0:1773851894.932327:0:60487:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:12.0:1773851894.932328:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.932328:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.932329:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.932329:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.932330:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007f430c34 refcount=3
00000020:00000001:12.0:1773851894.932331:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538921664 : -107107170629952 : ffff9e962b2446c0)
00010000:00000001:12.0:1773851894.932332:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538921664 : -107107170629952 : ffff9e962b2446c0)
00010000:00000001:12.0:1773851894.932332:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.932333:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.932333:0:60487:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.932334:0:60487:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.932335:0:60487:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:12.0:1773851894.932337:0:60487:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:12.0:1773851894.932338:0:60487:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:12.0:1773851894.932353:0:60487:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.932354:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851894.932355:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.932355:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.932357:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932358:0:60487:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932359:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932360:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851894.932361:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.932361:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.932361:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932362:0:60487:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932363:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:12.0:1773851894.932363:0:60487:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:12.0:1773851894.932364:0:60487:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.932365:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.932366:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.932366:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.932367:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.932367:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.932367:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:12.0:1773851894.932368:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.932369:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:12.0:1773851894.932369:0:60487:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:12.0:1773851894.932370:0:60487:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:12.0:1773851894.932372:0:60487:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:12.0:1773851894.932373:0:60487:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:12.0:1773851894.932374:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.932374:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.932375:0:60487:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:12.0:1773851894.932376:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851894.932376:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.932377:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.932377:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932378:0:60487:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932379:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.932379:0:60487:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.932380:0:60487:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000010:12.0:1773851894.932384:0:60487:0:(lprocfs_status.c:1166:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 960 at 00000000d347d281 (tot 253202803).
00000020:00000001:12.0:1773851894.932385:0:60487:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.932386:0:60487:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.932389:0:60487:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.932390:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.932390:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.932391:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007f430c34 refcount=3
00000020:00000001:12.0:1773851894.932391:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538921664 : -107107170629952 : ffff9e962b2446c0)
00010000:00000001:12.0:1773851894.932392:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538921664 : -107107170629952 : ffff9e962b2446c0)
00000004:00000040:12.0:1773851894.932393:0:60487:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 0000000025f0c678 : new locks_count 4
00000020:00000040:12.0:1773851894.932394:0:60487:0:(genops.c:871:class_export_get()) GET export 0000000025f0c678 refcount=9
00010000:00000001:12.0:1773851894.932395:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.932395:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.932396:0:60487:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:12.0:1773851894.932397:0:60487:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:12.0:1773851894.932397:0:60487:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:12.0:1773851894.932398:0:60487:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:12.0:1773851894.932398:0:60487:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:12.0:1773851894.932399:0:60487:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:12.0:1773851894.932400:0:60487:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:12.0:1773851894.932400:0:60487:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:12.0:1773851894.932402:0:60487:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.932402:0:60487:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:12.0:1773851894.932404:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:12.0:1773851894.932405:0:60487:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:12.0:1773851894.932406:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:12.0:1773851894.932407:0:60487:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:12.0:1773851894.932407:0:60487:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:12.0:1773851894.932408:0:60487:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851894.932409:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.932409:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.932410:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.932410:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851894.932411:0:60487:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006d91247b with handle 0x21b6f08f07a6ae6c from hash
00010000:00000001:12.0:1773851894.932412:0:60487:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851894.932412:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.932413:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.932413:0:60487:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:12.0:1773851894.932413:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851894.932414:0:60487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006d91247b/0x21b6f08f07a6ae6c lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ec5 expref: 9 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932416:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.932417:0:60487:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000025f0c678 : new locks_count 3
00000020:00000040:12.0:1773851894.932418:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 8
00010000:00000010:12.0:1773851894.932419:0:60487:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c8eb859f.
00010000:00000040:12.0:1773851894.932420:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:12.0:1773851894.932420:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.932421:0:60487:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.932422:0:60487:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:12.0:1773851894.932423:0:60487:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000007f430c34/0x21b6f08f07a6ae73 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ec5 expref: 8 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.932425:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:12.0:1773851894.932426:0:60487:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851894.932427:0:60487:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851894.932427:0:60487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:12.0:1773851894.932429:0:60487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:12.0:1773851894.932430:0:60487:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.932431:0:60487:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.932432:0:60487:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:12.0:1773851894.932432:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.932432:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:12.0:1773851894.932433:0:60487:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007f430c34, rc 0)
00000020:00000001:12.0:1773851894.932434:0:60487:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851894.932435:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252788990, transno 0, xid 1859480376085376
00010000:00000001:12.0:1773851894.932436:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851894.932436:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000373f1cb1 x1859480376085376/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00010000:00000001:12.0:1773851894.932439:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851894.932440:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851894.932440:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851894.932442:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851894.932443:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:12.0:1773851894.932443:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
02000000:00000001:12.0:1773851894.932444:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851894.932445:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.932445:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851894.932446:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8691@kfi7
00000400:00000010:12.0:1773851894.932447:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090c520ee.
00000100:00000200:12.0:1773851894.932448:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859480376085376, offset 224
00000400:00000200:12.0:1773851894.932449:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8691@kfi7
00000400:00000200:12.0:1773851894.932450:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.932451:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000400:00000200:12.0:1773851894.932452:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:12.0:1773851894.932453:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000400:00000200:12.0:1773851894.932454:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8691@kfi7 local destination
00000400:00000200:12.0:1773851894.932456:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770155:8770155:1024:4294967295] 8691@kfi7 LPNI seq info [2577512:2577512:16:4294967295]
00000400:00000200:12.0:1773851894.932457:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:12.0:1773851894.932458:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.932460:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8691@kfi7(8691@kfi7:8691@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851894.932462:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000800:00000200:12.0:1773851894.932463:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851894.932465:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:12.0:1773851894.932467:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851894.932469:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 Using peer 8691@kfi7(0x100000000001271)
00000800:00000200:12.0:1773851894.932472:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 740 bytes to peer 0x100000000001271: rc=0
00000800:00000200:12.0:1773851894.932473:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851894.932476:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.932476:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00010000:00000001:12.0:1773851894.932477:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851894.932478:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.932478:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851894.932479:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000373f1cb1 x1859480376085376/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:534/0 lens 576/640 e 0 to 0 dl 1773852649 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00000100:00100000:12.0:1773851894.932484:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000373f1cb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+8:1723140:x1859480376085376:12345-8691@kfi7:101:default-tuolumne1017-0 Request processed in 978us (1010us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851894.932487:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 411190557
00000100:00000040:12.0:1773851894.932487:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 0
00000100:00000001:12.0:1773851894.932488:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851894.932489:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851894.932489:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.932490:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065d9b02b.
00000020:00000010:12.0:1773851894.932491:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b340e1ba.
00000020:00000040:12.0:1773851894.932492:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 7
00000100:00000001:12.0:1773851894.932493:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851894.932498:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851894.932500:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.932501:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8691@kfi7: PUT: OK
00000400:00000200:13.0:1773851894.932502:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090c520ee
00000400:00000010:13.0:1773851894.932502:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090c520ee.
00000100:00000001:13.0:1773851894.932503:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851894.932504:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851894.932505:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000800:00000200:13.0:1773851894.932506:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8691@kfi7(000000007196ff34):0x0 lsk 4722 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001271 Transaction freed
00000800:00000200:5.0:1773851894.932676:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851894.932677:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851894.932678:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851894.932680:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851894.932682:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.932683:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:5.0:1773851894.932684:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.932685:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:5.0:1773851894.932686:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.932686:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851894.932687:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:5.0:1773851894.932688:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851894.932689:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 328 into portal 24 MB=0x699e5ed452080
00000400:00000200:5.0:1773851894.932690:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 328/328 into md 0x793844545 [256] + 8408
00000800:00000200:5.0:1773851894.932692:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851894.932694:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851894.932694:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2098@kfi7: PUT: OK
00000100:00000001:5.0:1773851894.932696:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851894.932696:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851894.932697:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000062aa50d4.
00000100:00000040:5.0:1773851894.932697:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000062aa50d4 x1858062667554944 msgsize 328
00000100:00100000:5.0:1773851894.932699:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2098@kfi7)
00000100:00000001:5.0:1773851894.932700:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851894.932701:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:6.0:1773851894.932702:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851894.932702:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851894.932703:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851894.932703:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851894.932703:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:6.0:1773851894.932704:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851894.932705:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667554944
00000020:00000001:6.0:1773851894.932706:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851894.932706:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:6.0:1773851894.932707:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851894.932708:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:6.0:1773851894.932708:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:6.0:1773851894.932709:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:6.0:1773851894.932710:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851894.932711:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851894.932712:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000be250a4f.
00000020:00000010:6.0:1773851894.932713:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851894.932714:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851894.932715:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851894.932715:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851894.932716:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851894.932716:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.932717:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.932718:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851894.932719:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851894.932719:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851894.932720:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851894.932720:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851894.932721:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 18314088
00000100:00000040:6.0:1773851894.932722:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:6.0:1773851894.932722:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637165942116864 : -106907767434752 : ffff9ec4987f9200)
00000100:00000001:5.0:1773851894.932722:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851894.932722:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851894.932724:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000062aa50d4 x1858062667554944/t0(0) o1000->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:6.0:1773851894.932731:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851894.932731:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851894.932732:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000062aa50d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:246384:x1858062667554944:12345-2098@kfi7:1000:default-yuba6-0
00000100:00000200:6.0:1773851894.932734:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667554944
00000020:00000001:6.0:1773851894.932734:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851894.932735:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851894.932735:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851894.932736:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851894.932736:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667521856 : -1042029760 : ffffffffc1e3e340)
00000020:00000001:6.0:1773851894.932737:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851894.932738:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851894.932738:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851894.932739:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851894.932739:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851894.932740:0:1537125:0:(out_handler.c:970:out_handle()) Process entered
00000020:00000010:6.0:1773851894.932741:0:1537125:0:(out_handler.c:993:out_handle()) kmalloced '(update_bufs)': 8 at 00000000dcc7d040.
00000100:00000001:6.0:1773851894.932742:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851894.932742:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851894.932744:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 4576 at 000000005b55b2c0.
02000000:00000001:6.0:1773851894.932744:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.932745:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851894.932746:0:1537125:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:6.0:1773851894.932746:0:1537125:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000020:00000001:6.0:1773851894.932747:0:1537125:0:(out_handler.c:356:out_index_lookup()) Process entered
00080000:00000001:6.0:1773851894.932748:0:1537125:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:6.0:1773851894.932752:0:1537125:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:6.0:1773851894.932753:0:1537125:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:6.0:1773851894.932753:0:1537125:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:6.0:1773851894.932754:0:1537125:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:6.0:1773851894.932754:0:1537125:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:6.0:1773851894.932755:0:1537125:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:6.0:1773851894.932755:0:1537125:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851894.932756:0:1537125:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851894.932757:0:1537125:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:6.0:1773851894.932757:0:1537125:0:(out_handler.c:389:out_index_lookup()) lookup [0x24001b599:0x10e2:0x0] slingshotmon get [0x2800256ea:0x3d:0x0] rc 1
00000020:00000040:6.0:1773851894.932758:0:1537125:0:(out_handler.c:393:out_index_lookup()) lustre5-MDT0001: insert lookup reply 000000009f20237f index 0: rc = 1
00000020:00000001:6.0:1773851894.932759:0:1537125:0:(out_handler.c:398:out_index_lookup()) Process leaving (rc=1 : 1 : 1)
00000020:00000002:6.0:1773851894.932760:0:1537125:0:(lu_object.c:224:lu_object_put()) Add 000000003fbfefe6/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000020:00000010:6.0:1773851894.932761:0:1537125:0:(out_handler.c:1241:out_handle()) kfreed 'update_bufs': 8 at 00000000dcc7d040.
00000020:00000001:6.0:1773851894.932762:0:1537125:0:(out_handler.c:1247:out_handle()) Process leaving (rc=1 : 1 : 1)
00010000:00000040:6.0:1773851894.932763:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667554944
00010000:00000001:6.0:1773851894.932764:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851894.932765:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000062aa50d4 x1858062667554944/t0(0) o1000->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/0 job:'default-yuba6-0'
00010000:00000001:6.0:1773851894.932767:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851894.932768:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851894.932768:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=123 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851894.932769:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851894.932770:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:6.0:1773851894.932771:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:6.0:1773851894.932772:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851894.932772:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851894.932773:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851894.932774:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:6.0:1773851894.932775:0:1537125:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000f425cdb8 (tot 253202955).
00000100:00000200:6.0:1773851894.932775:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 4320 bytes to portal 4, xid 1858062667554944, offset 224
00000400:00000200:6.0:1773851894.932777:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:6.0:1773851894.932778:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.932778:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:6.0:1773851894.932779:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851894.932781:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:6.0:1773851894.932782:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2098@kfi7 local destination
00000400:00000200:6.0:1773851894.932783:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770156:8770156:1024:4294967295] 2098@kfi7 LPNI seq info [20346213:20346213:16:4294967295]
00000400:00000200:6.0:1773851894.932785:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851894.932785:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851894.932787:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851894.932788:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:6.0:1773851894.932790:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 1 allocated
00000800:00000200:6.0:1773851894.932791:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:6.0:1773851894.932793:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:6.0:1773851894.932797:0:1537125:0:(kfilnd_ep.c:374:kfilnd_ep_post_tagged_recv()) 2069@kfi7:1 Transaction ID 00000000618b435b: Posted tagged recv of 4320 bytes (2 frags) with tag 0x4c80001: rc=0
00000800:00000200:6.0:1773851894.932799:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_TAGGED_RECV_POSTED state change
00000800:00000200:6.0:1773851894.932801:0:1537125:0:(kfilnd_tn.c:603:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_EVENT_INIT_BULK event status 0
00000800:00000200:6.0:1773851894.932803:0:1537125:0:(kfilnd_tn.c:610:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x4c7 Using peer 2098@kfi7(0x4c7)
00000800:00000200:6.0:1773851894.932806:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000618b435b: Posted send of 110 bytes to peer 0x4c7: rc=0
00000800:00000200:6.0:1773851894.932808:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x4c7 TN_STATE_TAGGED_RECV_POSTED -> TN_STATE_WAIT_COMP state change
00000100:00000001:6.0:1773851894.932810:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851894.932811:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:6.0:1773851894.932812:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851894.932812:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851894.932813:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851894.932814:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000062aa50d4 x1858062667554944/t0(0) o1000->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:621/0 lens 328/4320 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 1/1 job:'default-yuba6-0'
00000100:00100000:6.0:1773851894.932817:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000062aa50d4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:246384:x1858062667554944:12345-2098@kfi7:1000:default-yuba6-0 Request processed in 85us (118us total) trans 0 rc 1/1
00000800:00000200:5.0:1773851894.932817:0:2507993:0:(kfilnd_tn.c:1127:kfilnd_tn_state_wait_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x4c7 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851894.932819:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 18314088
00000800:00000200:5.0:1773851894.932819:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x4c7 TN_STATE_WAIT_COMP -> TN_STATE_WAIT_TAG_COMP state change
00000100:00000040:6.0:1773851894.932820:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:6.0:1773851894.932821:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851894.932821:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851894.932822:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:6.0:1773851894.932822:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000020:00000010:6.0:1773851894.932823:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000be250a4f.
00000020:00000040:6.0:1773851894.932824:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:6.0:1773851894.932824:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851894.932839:0:2507993:0:(kfilnd_tn.c:1307:kfilnd_tn_state_wait_tag_comp()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x4c7 TN_EVENT_TAG_RX_OK event status 0
00000400:00000200:5.0:1773851894.932841:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851894.932842:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2098@kfi7: PUT: OK
00000400:00000200:5.0:1773851894.932843:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f425cdb8
00000400:00000010:5.0:1773851894.932843:0:2507993:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000f425cdb8 (tot 253202803).
00000100:00000001:5.0:1773851894.932844:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851894.932845:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851894.932846:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:5.0:1773851894.932847:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_BULK_PUT_REQ TN 00000000618b435b: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 1 trr 1 tta 0x4c7 Transaction freed
00000800:00000200:14.0:1773851894.932930:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851894.932930:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851894.932930:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851894.932930:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851894.932932:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851894.932932:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851894.932933:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8691@kfi7(000000008681b45a):0x125a version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851894.932934:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851894.932935:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Using peer 8691@kfi7(0x125a)
00000400:00000200:14.0:1773851894.932936:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:14.0:1773851894.932937:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8691@kfi7 : PUT - for me
00000400:00000200:13.0:1773851894.932937:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:14.0:1773851894.932938:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:14.0:1773851894.932939:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000400:00000200:14.0:1773851894.932939:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000800:00000200:13.0:1773851894.932939:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x125a: rc=0
00000400:00000200:14.0:1773851894.932940:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000800:00000200:13.0:1773851894.932940:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851894.932941:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000400:00000200:14.0:1773851894.932942:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:14.0:1773851894.932943:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 584 into portal 12 MB=0x69b3003488cc0
00000400:00000200:14.0:1773851894.932944:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8691@kfi7 of length 584/584 into md 0x82a36e8ed [64] + 53352
00000800:00000200:14.0:1773851894.932946:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851894.932948:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851894.932949:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8691@kfi7: PUT: OK
00000100:00000001:14.0:1773851894.932950:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851894.932951:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851894.932952:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b16a3d8.
00000800:00000200:13.0:1773851894.932952:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_EVENT_TX_OK event status 0
00000100:00000040:14.0:1773851894.932953:0:2514739:0:(events.c:358:request_in_callback()) incoming req@000000002b16a3d8 x1859480376085696 msgsize 584
00000100:00100000:14.0:1773851894.932954:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8691@kfi7)
00000800:00000200:13.0:1773851894.932954:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Transaction freed
00000100:00000001:14.0:1773851894.932955:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851894.932956:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000100:00000001:12.0:1773851894.932956:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:14.0:1773851894.932958:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851894.932958:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851894.932958:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851894.932959:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.932960:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.932960:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376085696
00000020:00000001:12.0:1773851894.932961:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851894.932961:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000020:00000001:12.0:1773851894.932962:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.932963:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=8
00000020:00000001:12.0:1773851894.932963:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000020:00000001:12.0:1773851894.932964:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000100:00000001:12.0:1773851894.932965:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.932966:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851894.932966:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b340e1ba.
00000020:00000010:12.0:1773851894.932967:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.932968:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065d9b02b.
00000100:00000001:12.0:1773851894.932969:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851894.932969:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:12.0:1773851894.932970:0:60487:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:12.0:1773851894.932970:0:60487:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.932971:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.932972:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.932973:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851894.932974:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851894.932974:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851894.932974:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851894.932975:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851894.932975:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 411190558
00000100:00000001:15.0:1773851894.932976:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.932976:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 1
00000100:00000001:15.0:1773851894.932977:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.932977:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637097085020288 : -106976624531328 : ffff9eb4904ba880)
00000100:00000040:12.0:1773851894.932978:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002b16a3d8 x1859480376085696/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 584/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1017-0'
00000100:00000001:12.0:1773851894.932981:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.932981:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851894.932982:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002b16a3d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+8:1723140:x1859480376085696:12345-8691@kfi7:101:default-tuolumne1017-0
00000100:00000200:12.0:1773851894.932985:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376085696
00000020:00000001:12.0:1773851894.932986:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851894.932986:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851894.932987:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.932988:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851894.932988:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:12.0:1773851894.932989:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851894.932989:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859480376085696, found 0 last_xid 1859480376085695
00000020:00000001:12.0:1773851894.932990:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851894.932991:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851894.932991:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851894.932992:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.932993:0:60487:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:12.0:1773851894.932993:0:60487:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:12.0:1773851894.932993:0:60487:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:12.0:1773851894.932994:0:60487:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:12.0:1773851894.932994:0:60487:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.932996:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851894.932996:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:12.0:1773851894.932997:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.932997:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.932998:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000ef31445b.
00000020:00000001:12.0:1773851894.932999:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.932999:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000ef31445b with handle 0x21b6f08f07a6ae7a to hash
00000020:00000001:12.0:1773851894.933000:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.933000:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538923392 : -107107170628224 : ffff9e962b244d80)
00010000:00000010:12.0:1773851894.933001:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c8eb859f.
00010000:00000001:12.0:1773851894.933002:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538923392 : -107107170628224 : ffff9e962b244d80)
00010000:00010000:12.0:1773851894.933002:0:60487:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef31445b/0x21b6f08f07a6ae7a lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe67d5cc0bfa92ecc expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933005:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.933006:0:60487:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000025f0c678 : new locks_count 4
00000020:00000040:12.0:1773851894.933007:0:60487:0:(genops.c:871:class_export_get()) GET export 0000000025f0c678 refcount=9
00010000:00000001:12.0:1773851894.933008:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:12.0:1773851894.933008:0:60487:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:12.0:1773851894.933009:0:60487:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:12.0:1773851894.933009:0:60487:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:12.0:1773851894.933010:0:60487:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:12.0:1773851894.933010:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851894.933011:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:12.0:1773851894.933011:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851894.933012:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:12.0:1773851894.933013:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:12.0:1773851894.933013:0:60487:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933014:0:60487:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:12.0:1773851894.933014:0:60487:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:12.0:1773851894.933015:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851894.933015:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851894.933017:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000cd3f2799.
02000000:00000001:12.0:1773851894.933017:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.933018:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933018:0:60487:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933019:0:60487:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:12.0:1773851894.933019:0:60487:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:12.0:1773851894.933020:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.933020:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.933021:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.933021:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.933022:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.933022:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.933023:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.933023:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.933023:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.933024:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.933024:0:60487:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:12.0:1773851894.933025:0:60487:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:12.0:1773851894.933026:0:60487:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:12.0:1773851894.933026:0:60487:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.933027:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.933027:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933028:0:60487:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:12.0:1773851894.933028:0:60487:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933029:0:60487:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:12.0:1773851894.933030:0:60487:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 000000002ec78b62
00000004:00000001:12.0:1773851894.933032:0:60487:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:12.0:1773851894.933032:0:60487:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:12.0:1773851894.933033:0:60487:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:12.0:1773851894.933034:0:60487:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:12.0:1773851894.933034:0:60487:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:12.0:1773851894.933035:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851894.933035:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.933036:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.933037:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.933037:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000035a07647.
00000020:00000001:12.0:1773851894.933038:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.933038:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000035a07647 with handle 0x21b6f08f07a6ae81 to hash
00000020:00000001:12.0:1773851894.933039:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.933040:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538930880 : -107107170620736 : ffff9e962b246ac0)
00010000:00000010:12.0:1773851894.933040:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000016c96650.
00010000:00000001:12.0:1773851894.933041:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538930880 : -107107170620736 : ffff9e962b246ac0)
00010000:00000001:12.0:1773851894.933042:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.933042:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.933043:0:60487:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 197 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933046:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.933046:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:12.0:1773851894.933047:0:60487:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:12.0:1773851894.933047:0:60487:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:12.0:1773851894.933048:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.933048:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933049:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.933050:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933051:0:60487:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:12.0:1773851894.933051:0:60487:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:12.0:1773851894.933051:0:60487:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:12.0:1773851894.933052:0:60487:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:12.0:1773851894.933052:0:60487:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 196
00010000:00000040:12.0:1773851894.933053:0:60487:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:12.0:1773851894.933054:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933057:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933058:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933060:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933061:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933063:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933064:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f430c34/0x21b6f08f07a6ae73 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ec5 expref: 9 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933066:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933067:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933069:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933069:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933072:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933072:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933078:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933078:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933081:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933082:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933084:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933085:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933087:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933088:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933090:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933090:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933093:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933093:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933096:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933097:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933099:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933100:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933103:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933104:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933106:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933107:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933109:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933110:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933112:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933113:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933115:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933116:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933118:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933119:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933121:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933121:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933124:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933124:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933127:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933128:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933130:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933130:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933133:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933134:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933136:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933136:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933138:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933139:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933141:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933142:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933144:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933145:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933147:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933148:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933152:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933153:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933155:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933156:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933158:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933159:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933161:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933161:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933163:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933164:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933166:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933167:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933169:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933170:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933172:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933172:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933175:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933176:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933178:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933179:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933181:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933182:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933184:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933185:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933187:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933188:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933190:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933190:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933193:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933193:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933196:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933196:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933199:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933200:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933202:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933203:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933205:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933206:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 8 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933208:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933209:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933210:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933211:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933213:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933214:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933216:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933217:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933219:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933219:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933222:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933223:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933224:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933225:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933227:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933228:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933230:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933231:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933233:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933234:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933236:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933236:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933238:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933239:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933241:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933242:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933245:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933246:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933248:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933249:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933251:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933252:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933255:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933255:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933258:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933259:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933261:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933261:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933264:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933265:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933267:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933267:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933270:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933271:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933273:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933273:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933276:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933277:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933279:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933280:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933282:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933283:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933285:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933285:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933288:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933288:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933291:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933291:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933294:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933295:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933296:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933297:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933300:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933300:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933302:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933303:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933305:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933306:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933308:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933308:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933311:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933311:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933313:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933314:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933317:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933317:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933319:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933320:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933322:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933323:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933325:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933325:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933328:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933328:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933330:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933331:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933333:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933334:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933336:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933336:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933340:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933341:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933343:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933343:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933345:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933346:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933348:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933349:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933351:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933352:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933354:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933355:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933357:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933358:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933360:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933360:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933363:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933364:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933365:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933366:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933368:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933369:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933371:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933372:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933374:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933375:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933377:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933377:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933379:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933380:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933382:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933383:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933385:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933386:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933388:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933389:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933391:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933392:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933394:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933395:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933397:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933398:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933400:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933400:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933402:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933403:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933405:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933406:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933409:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933410:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933412:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933412:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933414:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933415:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933417:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933418:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933420:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933421:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933423:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933423:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933425:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933426:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933428:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933429:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933432:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933433:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933435:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933436:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933438:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933438:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933440:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933441:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933443:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933444:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933446:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933447:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933449:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933450:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933452:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933453:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933456:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933457:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933459:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933460:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933462:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933463:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933465:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933465:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933468:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933469:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933471:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933471:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933474:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933474:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933477:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933477:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933480:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933481:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933483:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933484:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933486:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933487:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933489:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933490:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933492:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933493:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933494:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933495:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933497:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933498:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933500:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933501:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933504:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933505:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933507:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933508:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933510:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933511:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933512:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933513:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933515:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933516:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933518:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933519:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933521:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933522:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933524:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933525:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933528:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933529:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933531:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933532:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933534:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933535:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933537:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933538:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933540:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933541:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933543:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933543:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933546:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933546:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933548:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933549:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933552:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933553:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933555:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933556:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933558:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933559:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933561:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933562:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933564:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933565:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933567:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933568:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933570:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933571:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933573:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933573:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933578:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933579:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933581:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933581:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933583:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933584:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933586:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933587:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933589:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933590:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933592:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933593:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933595:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933595:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933598:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933598:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933602:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933603:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933605:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933605:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933607:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933608:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933610:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933611:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933613:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933614:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933616:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933617:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933619:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933620:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933622:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933623:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933626:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933626:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933628:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933629:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933631:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:12.0:1773851894.933632:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933634:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00010000:12.0:1773851894.933635:0:60487:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933637:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.933638:0:60487:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:12.0:1773851894.933638:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851894.933639:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.933639:0:60487:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:12.0:1773851894.933640:0:60487:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933640:0:60487:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.933641:0:60487:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.933641:0:60487:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:12.0:1773851894.933642:0:60487:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.933642:0:60487:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933644:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.933645:0:60487:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:12.0:1773851894.933646:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.933646:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.933647:0:60487:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:12.0:1773851894.933647:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:12.0:1773851894.933648:0:60487:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000008bae770f.
00010000:00000010:12.0:1773851894.933649:0:60487:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 0000000050e21959.
00010000:00000001:12.0:1773851894.933650:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.933651:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000639f6827.
00000020:00000001:12.0:1773851894.933652:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.933652:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000639f6827 with handle 0x21b6f08f07a6ae88 to hash
00000020:00000001:12.0:1773851894.933653:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.933653:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000010:12.0:1773851894.933654:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000004a41aab1.
00010000:00000001:12.0:1773851894.933654:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000001:12.0:1773851894.933655:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.933656:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.933656:0:60487:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933658:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.933659:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:12.0:1773851894.933659:0:60487:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:12.0:1773851894.933660:0:60487:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:12.0:1773851894.933660:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.933661:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933661:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.933662:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933662:0:60487:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:12.0:1773851894.933663:0:60487:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:12.0:1773851894.933663:0:60487:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:12.0:1773851894.933663:0:60487:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:12.0:1773851894.933664:0:60487:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (000000008bae770f) refcount = 1
00010000:00010000:12.0:1773851894.933665:0:60487:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933669:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.933670:0:60487:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:12.0:1773851894.933670:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851894.933671:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.933671:0:60487:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:12.0:1773851894.933671:0:60487:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933672:0:60487:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.933672:0:60487:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.933673:0:60487:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:12.0:1773851894.933674:0:60487:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.933674:0:60487:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933676:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.933677:0:60487:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:12.0:1773851894.933677:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.933678:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.933678:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.933678:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.933679:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000639f6827 refcount=3
00000020:00000001:12.0:1773851894.933679:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000001:12.0:1773851894.933680:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000001:12.0:1773851894.933681:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.933681:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.933681:0:60487:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933682:0:60487:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933683:0:60487:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:12.0:1773851894.933687:0:60487:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:12.0:1773851894.933688:0:60487:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:12.0:1773851894.933688:0:60487:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:12.0:1773851894.933690:0:60487:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:12.0:1773851894.933698:0:60487:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:12.0:1773851894.933699:0:60487:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:12.0:1773851894.933700:0:60487:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:12.0:1773851894.933701:0:60487:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:12.0:1773851894.933702:0:60487:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:12.0:1773851894.933703:0:60487:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:12.0:1773851894.933704:0:60487:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:12.0:1773851894.933705:0:60487:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:12.0:1773851894.933706:0:60487:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:12.0:1773851894.933706:0:60487:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933707:0:60487:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.933708:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851894.933708:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:12.0:1773851894.933709:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851894.933710:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:12.0:1773851894.933711:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:12.0:1773851894.933711:0:60487:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:12.0:1773851894.933712:0:60487:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:12.0:1773851894.933712:0:60487:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:12.0:1773851894.933713:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851894.933714:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 229
00010000:00000001:12.0:1773851894.933714:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.933715:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.933716:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000078b8bd6e.
00000020:00000001:12.0:1773851894.933716:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.933717:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000078b8bd6e with handle 0x21b6f08f07a6ae8f to hash
00000020:00000001:12.0:1773851894.933718:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.933718:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000010:12.0:1773851894.933719:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c188b5e7.
00010000:00000001:12.0:1773851894.933720:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:12.0:1773851894.933720:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.933721:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.933721:0:60487:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000078b8bd6e/0x21b6f08f07a6ae8f lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 230 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933724:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:12.0:1773851894.933727:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:12.0:1773851894.933728:0:60487:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:12.0:1773851894.933728:0:60487:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:12.0:1773851894.933729:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.933729:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933730:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.933730:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.933731:0:60487:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:12.0:1773851894.933732:0:60487:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:12.0:1773851894.933732:0:60487:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:12.0:1773851894.933732:0:60487:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:12.0:1773851894.933733:0:60487:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 229
00010000:00000040:12.0:1773851894.933734:0:60487:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:12.0:1773851894.933735:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933737:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933738:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933740:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933741:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933743:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933744:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933746:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933748:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933750:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933751:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933756:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933757:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933759:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933760:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933762:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933764:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933766:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933767:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933769:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933771:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933773:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933774:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933776:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933777:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933779:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933780:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933784:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933786:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933788:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933789:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933791:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933792:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933794:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933795:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933797:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933798:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933801:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933802:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933804:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933805:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933807:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933808:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933813:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933814:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933816:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933817:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933819:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933820:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933822:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933824:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933825:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933827:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933829:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933830:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933832:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933833:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933835:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933836:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933841:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933842:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933844:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933845:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933847:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933848:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933851:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933852:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933854:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933855:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933857:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933858:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933860:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933861:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933863:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933864:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933867:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933869:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933871:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933872:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933874:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933876:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933878:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933879:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933881:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933882:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933885:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933886:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933888:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933889:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933891:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933892:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 9 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933897:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933899:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933901:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933902:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933905:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933906:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933908:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933909:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933911:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933912:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933914:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933915:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933918:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933919:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933921:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933922:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933925:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933925:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933927:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933929:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933931:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933932:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933934:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933935:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933938:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933939:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933941:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933942:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933944:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933945:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933948:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933949:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933951:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933952:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933954:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933955:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933958:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933959:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933961:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933962:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933964:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933965:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933967:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933968:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933970:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933971:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933973:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933973:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933976:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933977:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933979:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933981:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933983:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933984:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933986:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933987:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933989:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933990:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933992:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933993:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933995:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.933996:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.933999:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934000:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934002:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934003:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934006:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934007:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934009:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934010:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934012:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934013:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934015:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934016:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934019:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934020:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934022:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934023:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934025:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934026:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934029:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934030:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934032:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934033:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934035:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934037:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934039:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934040:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934042:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934043:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934045:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934046:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934048:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934049:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934051:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934052:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934056:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934057:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934059:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934061:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934063:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934064:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934066:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934067:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934069:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934070:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934072:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934074:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934076:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934077:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934079:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934080:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934083:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934084:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934086:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934087:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934090:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934091:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934092:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934094:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934096:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934097:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934099:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934100:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934102:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934103:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934105:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934106:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934109:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934110:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934113:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934114:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934116:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934117:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934119:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934121:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934123:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934124:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934126:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934127:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934129:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934130:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934132:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934133:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934138:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934140:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934142:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934143:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934145:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934146:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934149:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934150:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934152:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934153:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934156:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934156:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934159:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934159:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934161:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934162:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934165:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934167:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934168:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934170:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934172:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934174:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934175:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934177:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934179:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934180:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934182:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934183:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934185:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934186:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934188:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934190:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934193:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934194:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934196:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934197:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934199:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934201:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934202:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934204:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934206:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934207:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934209:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934210:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934212:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934213:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934215:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934216:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934219:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934220:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934222:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934224:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934226:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934228:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934230:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934231:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934233:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934234:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934236:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934237:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934239:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934240:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934242:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934243:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934246:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934247:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934249:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934250:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934252:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934254:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934256:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934257:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934259:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934260:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934262:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934264:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934266:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934268:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934269:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934271:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934274:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934275:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934277:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934278:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934281:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934282:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934284:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934285:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934287:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934288:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934291:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934292:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934294:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934295:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934297:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934298:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934301:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934302:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934304:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934305:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934307:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934309:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934311:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934312:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934314:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934315:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934318:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934319:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934321:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934323:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934325:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934326:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934329:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934330:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934332:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934334:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934336:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934337:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934339:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934340:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934342:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934343:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934345:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934346:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934348:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934349:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934351:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934352:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934355:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934356:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934358:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934359:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934361:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934362:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934364:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934365:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934367:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934369:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934371:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934372:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934374:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934375:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934377:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934378:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934381:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934382:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934384:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934385:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934388:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934389:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934391:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934392:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934394:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934395:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934397:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934398:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934400:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934401:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934403:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934405:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934408:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934408:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934410:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934412:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934414:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934415:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934417:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934418:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934420:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934421:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934424:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934425:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934427:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934428:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934430:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934431:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934434:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934435:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934437:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934438:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934441:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934442:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934444:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934445:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934447:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934448:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934450:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934452:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934454:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934454:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934456:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934458:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934460:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934462:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934464:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934465:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934468:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934469:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934471:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934472:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934475:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934476:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934478:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934479:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934481:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934482:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934484:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934485:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934488:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934489:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934491:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934492:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934494:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934496:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934498:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934499:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934501:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934502:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934504:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:12.0:1773851894.934505:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934507:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00010000:12.0:1773851894.934507:0:60487:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000078b8bd6e/0x21b6f08f07a6ae8f lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934509:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:12.0:1773851894.934510:0:60487:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:12.0:1773851894.934511:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851894.934512:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934512:0:60487:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:12.0:1773851894.934513:0:60487:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.934513:0:60487:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934514:0:60487:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.934514:0:60487:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:12.0:1773851894.934515:0:60487:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.934515:0:60487:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000078b8bd6e/0x21b6f08f07a6ae8f lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934517:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:12.0:1773851894.934518:0:60487:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:12.0:1773851894.934518:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934519:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934519:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.934520:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.934520:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000078b8bd6e refcount=3
00000020:00000001:12.0:1773851894.934520:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:12.0:1773851894.934521:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:12.0:1773851894.934522:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934522:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.934523:0:60487:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.934525:0:60487:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:12.0:1773851894.934526:0:60487:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:12.0:1773851894.934527:0:60487:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.934528:0:60487:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.934528:0:60487:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:12.0:1773851894.934529:0:60487:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:12.0:1773851894.934530:0:60487:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:12.0:1773851894.934531:0:60487:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.934531:0:60487:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934532:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.934533:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.934533:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000078b8bd6e refcount=3
00000020:00000001:12.0:1773851894.934533:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:12.0:1773851894.934535:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00000004:00010000:12.0:1773851894.934536:0:60487:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 0000000078b8bd6e/0x21b6f08f07a6ae8f lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934538:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:12.0:1773851894.934539:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934539:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.934540:0:60487:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:12.0:1773851894.934540:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:12.0:1773851894.934541:0:60487:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:12.0:1773851894.934542:0:60487:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:12.0:1773851894.934542:0:60487:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:12.0:1773851894.934543:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:12.0:1773851894.934544:0:60487:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:12.0:1773851894.934545:0:60487:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:12.0:1773851894.934545:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.934545:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.934546:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000035a07647 refcount=3
00000020:00000001:12.0:1773851894.934546:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538930880 : -107107170620736 : ffff9e962b246ac0)
00010000:00000001:12.0:1773851894.934547:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538930880 : -107107170620736 : ffff9e962b246ac0)
00010000:00000001:12.0:1773851894.934548:0:60487:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:12.0:1773851894.934549:0:60487:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934551:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.934552:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934552:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:12.0:1773851894.934552:0:60487:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934555:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.934556:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.934556:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934557:0:60487:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:12.0:1773851894.934558:0:60487:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934561:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00010000:12.0:1773851894.934561:0:60487:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000035a07647 already unused, calling callback (000000001690cbe4)
00000004:00000001:12.0:1773851894.934563:0:60487:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851894.934563:0:60487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:12.0:1773851894.934564:0:60487:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934566:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.934567:0:60487:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:12.0:1773851894.934568:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.934568:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.934569:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000035a07647 refcount=4
00000020:00000001:12.0:1773851894.934569:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538930880 : -107107170620736 : ffff9e962b246ac0)
00010000:00000001:12.0:1773851894.934570:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538930880 : -107107170620736 : ffff9e962b246ac0)
00010000:00000001:12.0:1773851894.934571:0:60487:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:12.0:1773851894.934571:0:60487:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934573:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.934574:0:60487:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:12.0:1773851894.934575:0:60487:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:12.0:1773851894.934575:0:60487:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934576:0:60487:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851894.934576:0:60487:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851894.934577:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.934577:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851894.934578:0:60487:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000035a07647 with handle 0x21b6f08f07a6ae81 from hash
00010000:00000001:12.0:1773851894.934578:0:60487:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851894.934578:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934579:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934579:0:60487:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851894.934580:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851894.934581:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934581:0:60487:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851894.934582:0:60487:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851894.934582:0:60487:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851894.934583:0:60487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:12.0:1773851894.934584:0:60487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:12.0:1773851894.934584:0:60487:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.934585:0:60487:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934586:0:60487:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:12.0:1773851894.934586:0:60487:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:12.0:1773851894.934587:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934587:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934588:0:60487:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934589:0:60487:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.934589:0:60487:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.934590:0:60487:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934592:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:12.0:1773851894.934593:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934593:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934594:0:60487:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:12.0:1773851894.934594:0:60487:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:12.0:1773851894.934595:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851894.934595:0:60487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000035a07647/0x21b6f08f07a6ae81 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934598:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000010:12.0:1773851894.934598:0:60487:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000016c96650.
00010000:00000040:12.0:1773851894.934599:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:12.0:1773851894.934600:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.934600:0:60487:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:12.0:1773851894.934600:0:60487:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:12.0:1773851894.934601:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.934601:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.934602:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000639f6827 refcount=3
00000020:00000001:12.0:1773851894.934602:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000001:12.0:1773851894.934603:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000001:12.0:1773851894.934604:0:60487:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:12.0:1773851894.934604:0:60487:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934606:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.934607:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934607:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:12.0:1773851894.934607:0:60487:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934609:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.934610:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.934610:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934611:0:60487:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:12.0:1773851894.934611:0:60487:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934613:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00010000:12.0:1773851894.934614:0:60487:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000639f6827 already unused, calling callback (000000001690cbe4)
00000004:00000001:12.0:1773851894.934614:0:60487:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851894.934615:0:60487:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:12.0:1773851894.934615:0:60487:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934617:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.934618:0:60487:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:12.0:1773851894.934618:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.934618:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.934619:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000639f6827 refcount=4
00000020:00000001:12.0:1773851894.934619:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000001:12.0:1773851894.934620:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538934912 : -107107170616704 : ffff9e962b247a80)
00010000:00000001:12.0:1773851894.934621:0:60487:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:12.0:1773851894.934622:0:60487:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934624:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.934624:0:60487:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:12.0:1773851894.934625:0:60487:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:12.0:1773851894.934625:0:60487:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934626:0:60487:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851894.934626:0:60487:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851894.934627:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.934627:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851894.934627:0:60487:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000639f6827 with handle 0x21b6f08f07a6ae88 from hash
00010000:00000001:12.0:1773851894.934628:0:60487:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851894.934629:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934629:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934629:0:60487:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851894.934630:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851894.934630:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934631:0:60487:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851894.934631:0:60487:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851894.934631:0:60487:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851894.934632:0:60487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (000000008bae770f)
00010000:00010000:12.0:1773851894.934633:0:60487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:12.0:1773851894.934633:0:60487:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.934634:0:60487:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934634:0:60487:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:12.0:1773851894.934635:0:60487:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:12.0:1773851894.934635:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934636:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934636:0:60487:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934637:0:60487:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.934637:0:60487:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.934638:0:60487:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934641:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000001:12.0:1773851894.934642:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934642:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934642:0:60487:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:12.0:1773851894.934643:0:60487:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:12.0:1773851894.934643:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851894.934644:0:60487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000639f6827/0x21b6f08f07a6ae88 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934646:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 1
00010000:00000010:12.0:1773851894.934646:0:60487:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000004a41aab1.
00010000:00000040:12.0:1773851894.934647:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008bae770f count: 0
00010000:00000010:12.0:1773851894.934648:0:60487:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 0000000050e21959.
00010000:00000001:12.0:1773851894.934649:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.934649:0:60487:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:12.0:1773851894.934649:0:60487:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:12.0:1773851894.934650:0:60487:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:12.0:1773851894.934650:0:60487:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:12.0:1773851894.934651:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.934651:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.934652:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000078b8bd6e refcount=3
00000020:00000001:12.0:1773851894.934652:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:12.0:1773851894.934653:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00000004:00000040:12.0:1773851894.934654:0:60487:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 0000000025f0c678 : new locks_count 5
00000020:00000040:12.0:1773851894.934654:0:60487:0:(genops.c:871:class_export_get()) GET export 0000000025f0c678 refcount=10
00010000:00000001:12.0:1773851894.934655:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934655:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.934656:0:60487:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:12.0:1773851894.934656:0:60487:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:12.0:1773851894.934657:0:60487:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:12.0:1773851894.934657:0:60487:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:12.0:1773851894.934658:0:60487:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:12.0:1773851894.934658:0:60487:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:12.0:1773851894.934659:0:60487:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:12.0:1773851894.934659:0:60487:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:12.0:1773851894.934660:0:60487:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.934661:0:60487:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:12.0:1773851894.934662:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:12.0:1773851894.934662:0:60487:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:12.0:1773851894.934663:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:12.0:1773851894.934663:0:60487:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:12.0:1773851894.934664:0:60487:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:12.0:1773851894.934664:0:60487:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851894.934665:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934665:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934665:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.934666:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851894.934666:0:60487:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000ef31445b with handle 0x21b6f08f07a6ae7a from hash
00010000:00000001:12.0:1773851894.934667:0:60487:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851894.934667:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934668:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934668:0:60487:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:12.0:1773851894.934668:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851894.934669:0:60487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef31445b/0x21b6f08f07a6ae7a lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ecc expref: 10 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934671:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:12.0:1773851894.934672:0:60487:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000025f0c678 : new locks_count 4
00000020:00000040:12.0:1773851894.934672:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 9
00010000:00000010:12.0:1773851894.934673:0:60487:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c8eb859f.
00010000:00000040:12.0:1773851894.934673:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:12.0:1773851894.934674:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.934674:0:60487:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934675:0:60487:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:12.0:1773851894.934676:0:60487:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 0000000078b8bd6e/0x21b6f08f07a6ae8f lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ecc expref: 9 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.934678:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:12.0:1773851894.934679:0:60487:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851894.934680:0:60487:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851894.934680:0:60487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:12.0:1773851894.934681:0:60487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:12.0:1773851894.934682:0:60487:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.934682:0:60487:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.934683:0:60487:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:12.0:1773851894.934683:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.934683:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:12.0:1773851894.934684:0:60487:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000078b8bd6e, rc 0)
00000020:00000001:12.0:1773851894.934684:0:60487:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851894.934685:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252788990, transno 0, xid 1859480376085696
00010000:00000001:12.0:1773851894.934686:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851894.934687:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002b16a3d8 x1859480376085696/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 584/640 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00010000:00000001:12.0:1773851894.934689:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851894.934690:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851894.934690:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851894.934691:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851894.934692:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:12.0:1773851894.934693:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
02000000:00000001:12.0:1773851894.934694:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851894.934694:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.934695:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851894.934696:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8691@kfi7
00000400:00000010:12.0:1773851894.934697:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d873db14.
00000100:00000200:12.0:1773851894.934697:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859480376085696, offset 224
00000400:00000200:12.0:1773851894.934699:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8691@kfi7
00000400:00000200:12.0:1773851894.934700:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.934701:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000400:00000200:12.0:1773851894.934702:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:12.0:1773851894.934703:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000400:00000200:12.0:1773851894.934704:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8691@kfi7 local destination
00000400:00000200:12.0:1773851894.934705:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770157:8770157:1024:4294967295] 8691@kfi7 LPNI seq info [2577513:2577513:16:4294967295]
00000400:00000200:12.0:1773851894.934708:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:12.0:1773851894.934708:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.934711:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8691@kfi7(8691@kfi7:8691@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851894.934712:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000800:00000200:12.0:1773851894.934713:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851894.934715:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:12.0:1773851894.934717:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851894.934719:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Using peer 8691@kfi7(0x125a)
00000800:00000200:12.0:1773851894.934722:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 740 bytes to peer 0x125a: rc=0
00000800:00000200:12.0:1773851894.934724:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851894.934728:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.934729:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00010000:00000001:12.0:1773851894.934729:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851894.934730:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.934731:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851894.934733:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002b16a3d8 x1859480376085696/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 584/640 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00000100:00100000:12.0:1773851894.934736:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002b16a3d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+9:1723140:x1859480376085696:12345-8691@kfi7:101:default-tuolumne1017-0 Request processed in 1755us (1783us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851894.934739:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 411190558
00000100:00000040:12.0:1773851894.934739:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 0
00000100:00000001:12.0:1773851894.934740:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851894.934741:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851894.934741:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.934742:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065d9b02b.
00000020:00000010:12.0:1773851894.934743:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b340e1ba.
00000020:00000040:12.0:1773851894.934744:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 8
00000100:00000001:12.0:1773851894.934745:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851894.934750:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851894.934752:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.934753:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8691@kfi7: PUT: OK
00000400:00000200:13.0:1773851894.934753:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d873db14
00000400:00000010:13.0:1773851894.934754:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d873db14.
00000100:00000001:13.0:1773851894.934755:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851894.934755:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851894.934756:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000800:00000200:13.0:1773851894.934757:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Transaction freed
00000800:00000200:3.0:1773851894.934837:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.934837:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851894.934839:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.934839:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:1.0:1773851894.934841:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:3.0:1773851894.934842:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.934845:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8690@kfi7(00000000b0060b71):0x1276 version: 2; local version 2; negotiated version: 2
00000800:00000200:3.0:1773851894.934846:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:1.0:1773851894.934848:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 Using peer 8690@kfi7(0x100000000001276)
00000400:00000200:3.0:1773851894.934850:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.934851:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:3.0:1773851894.934852:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8690@kfi7 : PUT - for me
00000400:00000200:3.0:1773851894.934854:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000800:00000200:1.0:1773851894.934855:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 38 bytes to peer 0x100000000001276: rc=0
00000400:00000200:3.0:1773851894.934856:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 1
00000800:00000200:1.0:1773851894.934857:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:3.0:1773851894.934858:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:3.0:1773851894.934859:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000400:00000200:3.0:1773851894.934861:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 3
00000400:00000200:3.0:1773851894.934864:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:3.0:1773851894.934866:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 328 into portal 17 MB=0x69b3003488d40
00000400:00000200:3.0:1773851894.934869:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8691@kfi7 of length 328/328 into md 0x7fb60e481 [2] + 1312
00000800:00000200:1.0:1773851894.934871:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 TN_EVENT_TX_OK event status 0
00000800:00000200:3.0:1773851894.934873:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.934875:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 Transaction freed
00000400:00000200:3.0:1773851894.934876:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851894.934878:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8690@kfi7: PUT: OK
00000100:00000001:3.0:1773851894.934880:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851894.934880:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:3.0:1773851894.934882:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f14d14e1.
00000100:00000040:3.0:1773851894.934883:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000f14d14e1 x1859480376085824 msgsize 328
00000100:00100000:3.0:1773851894.934886:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8690@kfi7)
00000100:00000001:3.0:1773851894.934888:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851894.934890:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000100:00000001:0.0:1773851894.934890:0:61144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851894.934890:0:61144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.934891:0:61144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.934891:0:61144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:3.0:1773851894.934892:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008f915b04: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851894.934892:0:61144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.934893:0:61144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376085824
00000020:00000001:0.0:1773851894.934894:0:61144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.934894:0:61144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000020:00000001:0.0:1773851894.934895:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.934897:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=9
00000020:00000001:0.0:1773851894.934898:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000020:00000001:0.0:1773851894.934899:0:61144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000100:00000001:0.0:1773851894.934900:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.934901:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.934901:0:61144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851894.934903:0:61144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.934904:0:61144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000040:0.0:1773851894.934905:0:61144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:0.0:1773851894.934906:0:61144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.934907:0:61144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:0.0:1773851894.934908:0:61144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:0.0:1773851894.934908:0:61144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.934909:0:61144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:0.0:1773851894.934910:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.934910:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.934911:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000078b8bd6e refcount=3
00000020:00000001:0.0:1773851894.934912:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:0.0:1773851894.934913:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:0.0:1773851894.934914:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.934914:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.934915:0:61144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.934916:0:61144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.934917:0:61144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.934918:0:61144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851894.934920:0:61144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.934920:0:61144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:3.0:1773851894.934921:0:82951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851894.934921:0:61144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 45419467
00000100:00000001:3.0:1773851894.934922:0:82951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851894.934922:0:61144:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 1
00000100:00000001:3.0:1773851894.934923:0:82951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.934923:0:61144:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288715136 : -106964420836480 : ffff9eb767b14380)
00000100:00000001:3.0:1773851894.934924:0:82951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.934924:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f14d14e1 x1859480376085824/t0(0) o103->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:0.0:1773851894.934928:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.934928:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851894.934929:0:61144:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f14d14e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+9:40138:x1859480376085824:12345-8691@kfi7:103:
00000100:00000200:0.0:1773851894.934931:0:61144:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376085824
00010000:00000001:0.0:1773851894.934931:0:61144:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:0.0:1773851894.934932:0:61144:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:0.0:1773851894.934933:0:61144:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:0.0:1773851894.934934:0:61144:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851894.934934:0:61144:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851894.934935:0:61144:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000077195a6.
02000000:00000001:0.0:1773851894.934936:0:61144:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.934938:0:61144:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.934939:0:61144:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:0.0:1773851894.934939:0:61144:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:0.0:1773851894.934940:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.934940:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.934941:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000078b8bd6e refcount=3
00000020:00000001:0.0:1773851894.934942:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000001:0.0:1773851894.934943:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538932608 : -107107170619008 : ffff9e962b247180)
00010000:00000040:0.0:1773851894.934944:0:61144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 230
00000004:00000001:0.0:1773851894.934945:0:61144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:0.0:1773851894.934945:0:61144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:0.0:1773851894.934946:0:61144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.934947:0:61144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:0.0:1773851894.934947:0:61144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851894.934948:0:61144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.934949:0:61144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:0.0:1773851894.934950:0:61144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:0.0:1773851894.934952:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.934952:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.934953:0:61144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:0.0:1773851894.934953:0:61144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851894.934954:0:61144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000078b8bd6e with handle 0x21b6f08f07a6ae8f from hash
00010000:00000001:0.0:1773851894.934955:0:61144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:0.0:1773851894.934956:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.934956:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.934957:0:61144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:0.0:1773851894.934957:0:61144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:0.0:1773851894.934958:0:61144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.934959:0:61144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:0.0:1773851894.934959:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:0.0:1773851894.934960:0:61144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000078b8bd6e/0x21b6f08f07a6ae8f lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 231 type: IBT gid 0 flags: 0x44a01000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ecc expref: 9 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:0.0:1773851894.934963:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00010000:00000040:0.0:1773851894.934964:0:61144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000025f0c678 : new locks_count 3
00000020:00000040:0.0:1773851894.934965:0:61144:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 8
00010000:00000010:0.0:1773851894.934966:0:61144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c188b5e7.
00010000:00000040:0.0:1773851894.934968:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:0.0:1773851894.934968:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.934969:0:61144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:0.0:1773851894.934970:0:61144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:0.0:1773851894.934970:0:61144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:0.0:1773851894.934971:0:61144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.934972:0:61144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.934973:0:61144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:0.0:1773851894.934974:0:61144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00010000:0.0:1773851894.934974:0:61144:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:0.0:1773851894.934975:0:61144:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851894.934976:0:61144:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851894.934977:0:61144:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851894.934977:0:61144:0:(import.c:1951:at_measured()) add 1 to 00000000fe6e7196 time=148 v=66 (1 1 1 1)
00000100:00000001:0.0:1773851894.934979:0:61144:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851894.934980:0:61144:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:0.0:1773851894.934980:0:61144:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
02000000:00000001:0.0:1773851894.934981:0:61144:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851894.934982:0:61144:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.934982:0:61144:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851894.934983:0:61144:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8690@kfi7
00000400:00000010:0.0:1773851894.934984:0:61144:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c05e23f.
00000100:00000200:0.0:1773851894.934985:0:61144:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859480376085824, offset 224
00000400:00000200:0.0:1773851894.934986:0:61144:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8690@kfi7
00000400:00000200:0.0:1773851894.934987:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.934988:0:61144:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 1
00000400:00000200:0.0:1773851894.934989:0:61144:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000400:00000200:0.0:1773851894.934990:0:61144:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 3
00000400:00000200:0.0:1773851894.934991:0:61144:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8690@kfi7 local destination
00000400:00000200:0.0:1773851894.934993:0:61144:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770158:8770158:1024:4294967295] 8690@kfi7 LPNI seq info [2577514:2577514:16:4294967295]
00000400:00000200:0.0:1773851894.934994:0:61144:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000400:00000200:0.0:1773851894.934995:0:61144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:0.0:1773851894.934997:0:61144:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8690@kfi7(8690@kfi7:8690@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851894.934998:0:61144:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 3
00000800:00000200:0.0:1773851894.935000:0:61144:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851894.935001:0:61144:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851894.935004:0:61144:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851894.935006:0:61144:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 Using peer 8690@kfi7(0x100000000001276)
00000800:00000200:0.0:1773851894.935009:0:61144:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x100000000001276: rc=0
00000800:00000200:0.0:1773851894.935010:0:61144:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851894.935012:0:61144:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.935013:0:61144:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00010000:00000001:0.0:1773851894.935014:0:61144:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.935014:0:61144:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851894.935015:0:61144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f14d14e1 x1859480376085824/t0(0) o103->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:0.0:1773851894.935020:0:61144:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f14d14e1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_005:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+8:40138:x1859480376085824:12345-8691@kfi7:103: Request processed in 91us (135us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851894.935022:0:61144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 45419467
00000100:00000040:0.0:1773851894.935022:0:61144:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 0
00000100:00000001:0.0:1773851894.935023:0:61144:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851894.935024:0:61144:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851894.935024:0:61144:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.935025:0:61144:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000020:00000010:0.0:1773851894.935026:0:61144:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851894.935026:0:61144:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 7
00000100:00000001:0.0:1773851894.935027:0:61144:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851894.935033:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851894.935036:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.935038:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8690@kfi7: PUT: OK
00000400:00000200:1.0:1773851894.935039:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c05e23f
00000400:00000010:1.0:1773851894.935040:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c05e23f.
00000100:00000001:1.0:1773851894.935041:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.935042:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.935043:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000800:00000200:1.0:1773851894.935045:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 Transaction freed
00000800:00000200:13.0:1773851894.935942:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851894.935943:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851894.935944:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851894.935946:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851894.935948:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.935949:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8691@kfi7 : PUT - for me
00000400:00000200:13.0:1773851894.935951:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.935951:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000400:00000200:13.0:1773851894.935952:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000800:00000200:21.0:1773851894.935953:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:13.0:1773851894.935953:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000800:00000200:22.0:1773851894.935954:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851894.935954:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:13.0:1773851894.935954:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000800:00000200:21.0:1773851894.935955:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851894.935956:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851894.935956:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000800:00000200:22.0:1773851894.935957:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851894.935957:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8498@kfi7(000000008e3a4827):0x125e version: 2; local version 2; negotiated version: 2
00000400:00000200:13.0:1773851894.935957:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 224 into portal 12 MB=0x69b30034890c0
00000400:00000200:13.0:1773851894.935958:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8691@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 53936
00000800:00000200:21.0:1773851894.935959:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e Using peer 8498@kfi7(0x10000000000125e)
00000800:00000200:13.0:1773851894.935960:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851894.935961:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851894.935962:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.935963:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8498@kfi7 to cpt 5
00000400:00000200:13.0:1773851894.935963:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8691@kfi7: PUT: OK
00000400:00000200:22.0:1773851894.935964:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8498@kfi7 to cpt 5
00000100:00000001:13.0:1773851894.935964:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851894.935964:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:21.0:1773851894.935965:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0x10000000000125e: rc=0
00000100:00000010:13.0:1773851894.935965:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fcb453de.
00000400:00000200:22.0:1773851894.935966:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8498@kfi7 : PUT - for me
00000100:00000040:13.0:1773851894.935966:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000fcb453de x1859480376086720 msgsize 224
00000800:00000200:21.0:1773851894.935967:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00100000:13.0:1773851894.935967:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8691@kfi7)
00000400:00000200:22.0:1773851894.935968:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8498@kfi7 to cpt 5
00000100:00000001:13.0:1773851894.935968:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851894.935969:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002970edd0 nid 8498@kfi7 refs 1
00000400:00000200:13.0:1773851894.935969:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000100:00000001:12.0:1773851894.935969:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851894.935970:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:22.0:1773851894.935971:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8498@kfi7 to cpt 5
00000800:00000200:13.0:1773851894.935971:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851894.935971:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851894.935971:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851894.935972:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002970edd0 nid 8498@kfi7 refs 2
02000000:00000001:12.0:1773851894.935972:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.935973:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376086720
00000020:00000001:12.0:1773851894.935973:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000400:00000200:22.0:1773851894.935974:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002970edd0 nid 8498@kfi7 refs 3
00000020:00000040:12.0:1773851894.935974:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000020:00000001:12.0:1773851894.935974:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:22.0:1773851894.935975:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000020:00000040:12.0:1773851894.935975:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=8
00000020:00000001:12.0:1773851894.935976:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000400:00000200:22.0:1773851894.935977:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 512 into portal 12 MB=0x69b3003489140
00000800:00000200:21.0:1773851894.935977:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e TN_EVENT_TX_OK event status 0
00000020:00000001:12.0:1773851894.935977:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000100:00000001:12.0:1773851894.935978:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.935978:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:22.0:1773851894.935979:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8691@kfi7 of length 512/512 into md 0x6a32cacf5 [64] + 62480
00000800:00000200:21.0:1773851894.935979:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e Transaction freed
00000020:00000010:12.0:1773851894.935979:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000557b870b.
00000020:00000010:12.0:1773851894.935980:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.935981:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065d9b02b.
00000800:00000200:22.0:1773851894.935982:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:12.0:1773851894.935982:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851894.935982:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851894.935983:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851894.935984:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:12.0:1773851894.935984:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.935985:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:22.0:1773851894.935986:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8498@kfi7: PUT: OK
00000100:00000001:15.0:1773851894.935986:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.935986:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851894.935986:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851894.935986:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851894.935987:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00100000:12.0:1773851894.935987:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 411190559
00000100:00000200:22.0:1773851894.935988:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000001:15.0:1773851894.935988:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.935988:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 1
00000100:00000010:22.0:1773851894.935989:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f4fa2cc.
00000100:00000001:15.0:1773851894.935989:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.935989:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637024468629888 : -107049240921728 : ffff9ea3a8057980)
00000100:00000040:22.0:1773851894.935990:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000008f4fa2cc x1859480376086848 msgsize 512
00000100:00000040:12.0:1773851894.935990:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fcb453de x1859480376086720/t0(0) o41->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1017-0'
00000100:00100000:22.0:1773851894.935993:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8498@kfi7)
00000100:00000001:12.0:1773851894.935993:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.935993:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851894.935994:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fcb453de pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+8:40132:x1859480376086720:12345-8691@kfi7:41:default-tuolumne1017-0
00000100:00000001:22.0:1773851894.935995:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851894.935996:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002970edd0 nid 8498@kfi7 refs 2
00000100:00000001:20.0:1773851894.935996:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851894.935996:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000200:12.0:1773851894.935996:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376086720
00000020:00000001:12.0:1773851894.935996:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000100:00000001:20.0:1773851894.935997:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851894.935997:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.935997:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851894.935997:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851894.935998:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851894.935998:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.935998:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851894.935998:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000100:00100000:20.0:1773851894.935999:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376086848
00000020:00000001:12.0:1773851894.935999:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851894.936000:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851894.936000:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000001:00000001:12.0:1773851894.936000:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859480376086720, found 0 last_xid 1859480376086719
00000020:00000001:12.0:1773851894.936000:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851894.936001:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000001:12.0:1773851894.936001:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851894.936001:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851894.936002:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936002:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851894.936003:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000020:00000040:20.0:1773851894.936004:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=9
02000000:00000010:12.0:1773851894.936004:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000051681c30.
00000020:00000001:20.0:1773851894.936005:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
02000000:00000001:12.0:1773851894.936005:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936005:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.936006:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000004:00000001:12.0:1773851894.936006:0:60487:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000100:00000001:20.0:1773851894.936007:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851894.936007:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000004:00000001:12.0:1773851894.936007:0:60487:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:12.0:1773851894.936007:0:60487:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:20.0:1773851894.936008:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000004:00000024:12.0:1773851894.936008:0:60487:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 212336640 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000020:00000010:20.0:1773851894.936009:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b697ec8.
00000004:00000020:12.0:1773851894.936009:0:60487:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966131287 avail; 3492774874 objects: 3200325324 free; state 0
00000020:00000010:20.0:1773851894.936010:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851894.936011:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851894.936011:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000001:12.0:1773851894.936011:0:60487:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000100:00000001:20.0:1773851894.936012:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.936012:0:60487:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.936012:0:60487:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936013:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851894.936013:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252788990, transno 0, xid 1859480376086720
00000100:00000001:20.0:1773851894.936014:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.936014:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000100:00000001:20.0:1773851894.936015:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851894.936015:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00010000:00000200:12.0:1773851894.936015:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fcb453de x1859480376086720/t0(0) o41->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 224/368 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00000100:00100000:20.0:1773851894.936016:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 335333152
00000100:00000001:23.0:1773851894.936017:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851894.936017:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:20.0:1773851894.936017:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 2
00010000:00000001:12.0:1773851894.936017:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000100:00000001:23.0:1773851894.936018:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936018:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382191232 : -106946327360384 : ffff9ebb9e25cc80)
00010000:00000001:12.0:1773851894.936018:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851894.936018:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000100:00000040:20.0:1773851894.936019:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008f4fa2cc x1859480376086848/t0(0) o36->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 512/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1017-0'
00000100:00000001:23.0:1773851894.936020:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936020:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851894.936020:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:12.0:1773851894.936021:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
00000100:00000001:20.0:1773851894.936022:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851894.936022:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
02000000:00000001:12.0:1773851894.936022:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851894.936022:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851894.936023:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f4fa2cc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+9:1723140:x1859480376086848:12345-8691@kfi7:36:default-tuolumne1017-0
00000100:00000001:12.0:1773851894.936023:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851894.936024:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8691@kfi7
00000400:00000010:12.0:1773851894.936024:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e559f001.
00000100:00000200:20.0:1773851894.936025:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376086848
00000100:00000200:12.0:1773851894.936025:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1859480376086720, offset 224
00000020:00000001:20.0:1773851894.936026:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851894.936026:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:12.0:1773851894.936026:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8691@kfi7
00000020:00000001:20.0:1773851894.936027:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.936027:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:12.0:1773851894.936027:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000020:00000001:20.0:1773851894.936028:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658704 : -1035892912 : ffffffffc2418750)
00000400:00000200:12.0:1773851894.936028:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000020:00000001:20.0:1773851894.936029:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000400:00000200:12.0:1773851894.936029:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000001:00000001:20.0:1773851894.936030:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859480376086848, found 0 last_xid 1859480376086719
00000400:00000200:12.0:1773851894.936030:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000020:00000001:20.0:1773851894.936031:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:12.0:1773851894.936031:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8691@kfi7 local destination
00000020:00000001:20.0:1773851894.936032:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851894.936032:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000400:00000200:12.0:1773851894.936032:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770159:8770159:1024:4294967295] 8691@kfi7 LPNI seq info [2577515:2577515:16:4294967295]
00000020:00000001:20.0:1773851894.936033:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936034:0:60934:0:(mdt_handler.c:3040:mdt_reint()) Process entered
00000400:00000200:12.0:1773851894.936034:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:12.0:1773851894.936035:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000004:00000002:20.0:1773851894.936036:0:60934:0:(mdt_handler.c:3007:mdt_reint_opcode()) @@@ reint opt = 2  req@000000008f4fa2cc x1859480376086848/t0(0) o36->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 512/0 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/ffffffff rc 0/-1 job:'default-tuolumne1017-0'
00000400:00000200:12.0:1773851894.936036:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8691@kfi7(8691@kfi7:8691@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851894.936037:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000004:00000001:20.0:1773851894.936039:0:60934:0:(mdt_handler.c:2906:mdt_reint_internal()) Process entered
00000800:00000200:12.0:1773851894.936039:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000004:00000001:20.0:1773851894.936040:0:60934:0:(mdt_lib.c:1846:mdt_reint_unpack()) Process entered
00000800:00000200:12.0:1773851894.936040:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000004:00000001:20.0:1773851894.936041:0:60934:0:(mdt_lib.c:1303:mdt_create_unpack()) Process entered
00000800:00000200:12.0:1773851894.936042:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000001:00000001:20.0:1773851894.936043:0:60934:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:20.0:1773851894.936043:0:60934:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:12.0:1773851894.936044:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Using peer 8691@kfi7(0x125a)
00000004:00000001:20.0:1773851894.936045:0:60934:0:(mdt_lib.c:1213:mdt_dlmreq_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936045:0:60934:0:(mdt_lib.c:1379:mdt_create_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936046:0:60934:0:(mdt_lib.c:1856:mdt_reint_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936046:0:60934:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:20.0:1773851894.936047:0:60934:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000800:00000200:12.0:1773851894.936047:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 468 bytes to peer 0x125a: rc=0
00000100:00000001:20.0:1773851894.936048:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851894.936048:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851894.936049:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 704 at 00000000c0a250f6.
00000800:00000200:12.0:1773851894.936049:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
02000000:00000001:20.0:1773851894.936050:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936050:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936051:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936052:0:60934:0:(mdt_lib.c:578:old_init_ucred_reint()) Process entered
00000001:00000001:20.0:1773851894.936052:0:60934:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:20.0:1773851894.936052:0:60934:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.936052:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00000001:00000001:20.0:1773851894.936053:0:60934:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00010000:00000001:12.0:1773851894.936053:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851894.936053:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:20.0:1773851894.936054:0:60934:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:20.0:1773851894.936054:0:60934:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000020:00000001:12.0:1773851894.936054:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851894.936054:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fcb453de x1859480376086720/t0(0) o41->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 224/368 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00000001:00000001:20.0:1773851894.936055:0:60934:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851894.936056:0:60934:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:20.0:1773851894.936058:0:60934:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:20.0:1773851894.936059:0:60934:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:20.0:1773851894.936059:0:60934:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.936059:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fcb453de pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+9:40132:x1859480376086720:12345-8691@kfi7:41:default-tuolumne1017-0 Request processed in 65us (92us total) trans 0 rc 0/0
00000001:00000001:20.0:1773851894.936060:0:60934:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:20.0:1773851894.936061:0:60934:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936061:0:60934:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000100:00100000:12.0:1773851894.936061:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 411190559
00000004:00000001:20.0:1773851894.936062:0:60934:0:(mdt_lib.c:599:old_init_ucred_reint()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.936062:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 1
00000100:00000001:12.0:1773851894.936062:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000004:00000001:20.0:1773851894.936063:0:60934:0:(mdt_internal.h:1182:mdt_check_resent()) Process entered
00000100:00000001:12.0:1773851894.936063:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000004:00000001:20.0:1773851894.936064:0:60934:0:(mdt_internal.h:1200:mdt_check_resent()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:12.0:1773851894.936064:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000004:00000001:20.0:1773851894.936065:0:60934:0:(mdt_reint.c:3241:mdt_reint_rec()) Process entered
00000020:00000010:12.0:1773851894.936065:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065d9b02b.
00000004:00000001:20.0:1773851894.936066:0:60934:0:(mdt_reint.c:1049:mdt_reint_create()) Process entered
00000020:00000010:12.0:1773851894.936066:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000557b870b.
00000020:00000040:12.0:1773851894.936066:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 8
00010000:00000001:20.0:1773851894.936067:0:60934:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00000100:00000001:12.0:1773851894.936067:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:20.0:1773851894.936068:0:60934:0:(ldlm_lockd.c:1710:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936069:0:60934:0:(mdt_reint.c:511:mdt_create()) Process entered
00000004:00000002:20.0:1773851894.936070:0:60934:0:(mdt_reint.c:514:mdt_create()) @@@ Create (20260318->[0x2400287fd:0x3c41:0x0]) in [0x340019763:0x1:0x0]  req@000000008f4fa2cc x1859480376086848/t0(0) o36->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 512/448 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00000800:00000200:13.0:1773851894.936072:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_EVENT_TX_OK event status 0
00000004:00000001:20.0:1773851894.936074:0:60934:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:20.0:1773851894.936074:0:60934:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x340019763:0x1:0x0]
00000400:00000200:13.0:1773851894.936074:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:20.0:1773851894.936075:0:60934:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000400:00000200:13.0:1773851894.936075:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8691@kfi7: PUT: OK
00000400:00000200:13.0:1773851894.936075:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e559f001
00000400:00000010:13.0:1773851894.936076:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e559f001.
00000100:00000001:13.0:1773851894.936077:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851894.936077:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851894.936078:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000020:00000001:20.0:1773851894.936079:0:60934:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637098057188760 : -106975652362856 : ffff9eb4ca3dc598)
00000004:00000001:20.0:1773851894.936079:0:60934:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637098057188672 : -106975652362944 : ffff9eb4ca3dc540)
00000800:00000200:13.0:1773851894.936079:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Transaction freed
00000004:00000001:20.0:1773851894.936082:0:60934:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:20.0:1773851894.936084:0:60934:0:(osp_object.c:581:osp_attr_get()) Process entered
00000004:00000001:20.0:1773851894.936085:0:60934:0:(osp_object.c:593:osp_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936086:0:60934:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000040:20.0:1773851894.936087:0:60934:0:(mdd_dir.c:96:__mdd_lookup()) lustre5-MDD0001: Object [0x340019763:0x1:0x0] located on remote server
00000004:00000001:20.0:1773851894.936088:0:60934:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:20.0:1773851894.936089:0:60934:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936090:0:60934:0:(osp_md_object.c:476:osp_md_index_lookup()) Process entered
00000004:00000010:20.0:1773851894.936092:0:60934:0:(osp_trans.c:185:osp_update_request_create()) kmalloced '(our)': 120 at 00000000e9120fe6.
00000004:00000010:20.0:1773851894.936093:0:60934:0:(osp_trans.c:117:osp_object_update_request_create()) kmalloced '(ours)': 32 at 0000000070c2d983.
00000004:00000010:20.0:1773851894.936095:0:60934:0:(osp_trans.c:128:osp_object_update_request_create()) kmalloced '(ourq)': 4096 at 000000009aba7aa3.
00000020:00000001:20.0:1773851894.936096:0:60934:0:(out_lib.c:157:out_update_pack()) Process entered
00000020:00000001:20.0:1773851894.936097:0:60934:0:(out_lib.c:171:out_update_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936098:0:60934:0:(osp_trans.c:477:osp_remote_sync()) Process entered
00000004:00000001:20.0:1773851894.936099:0:60934:0:(osp_trans.c:355:osp_prep_update_req()) Process entered
00000004:00000040:20.0:1773851894.936100:0:60934:0:(osp_trans.c:265:object_update_request_dump()) i = 0 fid = [0x340019763:0x1:0x0] op = lookup params = 1 batchid = 0 size = 64 repsize 256
00000004:00000040:20.0:1773851894.936101:0:60934:0:(osp_trans.c:271:object_update_request_dump()) updates = 000000009aba7aa3 magic = bdde0002 count = 1 size = 64
00000100:00000010:20.0:1773851894.936103:0:60934:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009b7021bb.
00000020:00000040:20.0:1773851894.936104:0:60934:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:20.0:1773851894.936105:0:60934:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:20.0:1773851894.936106:0:60934:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:20.0:1773851894.936109:0:60934:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:20.0:1773851894.936110:0:60934:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 0000000002a6aa57.
00000100:00000001:20.0:1773851894.936112:0:60934:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936113:0:60934:0:(osp_trans.c:322:osp_prep_inline_update_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936113:0:60934:0:(osp_trans.c:399:osp_prep_update_req()) Process leaving via out_req (rc=0 : 0 : 0x0)
00000004:00000001:20.0:1773851894.936114:0:60934:0:(osp_trans.c:454:osp_prep_update_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936115:0:60934:0:(client.c:3060:ptlrpc_queue_wait()) Process entered
00000100:00000001:20.0:1773851894.936116:0:60934:0:(client.c:1049:ptlrpc_prep_set()) Process entered
00000100:00000010:20.0:1773851894.936118:0:60934:0:(client.c:1051:ptlrpc_prep_set()) kmalloced '(set)': 112 at 00000000a73bb9ac.
00000100:00000001:20.0:1773851894.936118:0:60934:0:(client.c:1066:ptlrpc_prep_set()) Process leaving (rc=18446637127359944704 : -106946349606912 : ffff9ebb9cd25800)
00000100:00000001:20.0:1773851894.936119:0:60934:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:20.0:1773851894.936120:0:60934:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637116137290368 : -106957572261248 : ffff9eb8ffe63a80)
00000100:00000001:20.0:1773851894.936121:0:60934:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:20.0:1773851894.936123:0:60934:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936123:0:60934:0:(client.c:2473:ptlrpc_set_wait()) Process entered
00000100:00000001:20.0:1773851894.936124:0:60934:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:20.0:1773851894.936126:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 0 ref 2 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:20.0:1773851894.936129:0:60934:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:20.0:1773851894.936130:0:60934:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851894.936131:0:60934:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:20.0:1773851894.936132:0:60934:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851894.936133:0:60934:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009b7021bb pname:cluuid:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-mdtlov_UUID:60934:1859433051939520:2098@kfi7:1000:default-yuba2-0
00000100:00000001:20.0:1773851894.936135:0:60934:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:20.0:1773851894.936136:0:60934:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:20.0:1773851894.936137:0:60934:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851894.936138:0:60934:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:20.0:1773851894.936139:0:60934:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 8192 at 0000000011e4e363.
02000000:00000001:20.0:1773851894.936140:0:60934:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:20.0:1773851894.936141:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:20.0:1773851894.936142:0:60934:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000002cc815b.
00000400:00000010:20.0:1773851894.936144:0:60934:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000bc86f6ba (tot 253202955).
00000100:00000200:20.0:1773851894.936145:0:60934:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 8192 bytes, xid 1859433051939520, portal 4
00000100:00000001:20.0:1773851894.936146:0:60934:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:20.0:1773851894.936146:0:60934:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637116137290368 : -106957572261248 : ffff9eb8ffe63a80)
00000100:00000040:20.0:1773851894.936149:0:60934:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:20.0:1773851894.936152:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851894.936152:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:20.0:1773851894.936153:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dac508ec.
00000100:00000200:20.0:1773851894.936154:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 328 bytes to portal 24, xid 1859433051939520, offset 0
00000400:00000200:20.0:1773851894.936155:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:20.0:1773851894.936156:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:20.0:1773851894.936158:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:20.0:1773851894.936159:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:20.0:1773851894.936160:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:20.0:1773851894.936161:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000400:00000200:20.0:1773851894.936163:0:60934:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770159, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770158, p:4294967295, g:4294967295, h:1000]
00000400:00000200:20.0:1773851894.936165:0:60934:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:20.0:1773851894.936166:0:60934:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:20.0:1773851894.936167:0:60934:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:20.0:1773851894.936168:0:60934:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346213, 20346211]
00000400:00000200:20.0:1773851894.936170:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000400:00000200:20.0:1773851894.936171:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770160:8770160:1024:4294967295] 2105@kfi7 LPNI seq info [20346214:20346214:16:4294967295]
00000400:00000200:20.0:1773851894.936173:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:20.0:1773851894.936173:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:20.0:1773851894.936176:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851894.936177:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:20.0:1773851894.936179:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851894.936180:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 328 bytes in 1 frags
00000800:00000200:20.0:1773851894.936182:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851894.936184:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000800:00000200:20.0:1773851894.936189:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 428 bytes to peer 0x20000000000085c: rc=0
00000800:00000200:20.0:1773851894.936191:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000085c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851894.936193:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936194:0:60934:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:20.0:1773851894.936195:0:60934:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936196:0:60934:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:20.0:1773851894.936196:0:60934:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00100000:20.0:1773851894.936197:0:60934:0:(client.c:2500:ptlrpc_set_wait()) set 00000000a73bb9ac going to sleep for 87 seconds
00000100:00000001:20.0:1773851894.936198:0:60934:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851894.936203:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000085c TN_EVENT_TX_OK event status 0
00000100:00000001:20.0:1773851894.936203:0:60934:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851894.936205:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.936206:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000400:00000200:21.0:1773851894.936207:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dac508ec
00000400:00000010:21.0:1773851894.936208:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dac508ec.
00000100:00000001:21.0:1773851894.936208:0:2494373:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:21.0:1773851894.936209:0:2494373:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851894.936213:0:2494373:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:21.0:1773851894.936214:0:2494373:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 2  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 3 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851894.936216:0:2494373:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851894.936217:0:2494373:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851894.936218:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:21.0:1773851894.936220:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000085c Transaction freed
00000800:00000200:25.0:1773851894.936251:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851894.936252:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000800:00000200:25.0:1773851894.936253:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851894.936255:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851894.936257:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.936258:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:25.0:1773851894.936259:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.936260:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:25.0:1773851894.936260:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851894.936261:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851894.936262:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:25.0:1773851894.936263:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851894.936264:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 4320 into portal 4 MB=0x69b24fe8b62c0
00000400:00000200:25.0:1773851894.936265:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851894.936266:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 4320/4320 into md 0x793b321a5 [2] + 224
00000800:00000200:25.0:1773851894.936268:0:2494371:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 4798 trmk 1 tmk 0 trr 2 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:25.0:1773851894.936270:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 4798 trmk 1 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000800:00000200:25.0:1773851894.936273:0:2494371:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 4798 trmk 1 tmk 0 trr 2 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000800:00000200:25.0:1773851894.936277:0:2494371:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2054@kfi7:6 TN 00000000878f9def: Posted read of 4320 bytes in 2 frags kp 2105@kfi7(00000000967e7897) rma_iov.key 314441729: rc=0
00000800:00000200:25.0:1773851894.936278:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 4798 trmk 1 tmk 0 trr 2 tta 0x20000000000085c TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000800:00000200:25.0:1773851894.936292:0:2494371:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 4798 trmk 1 tmk 0 trr 2 tta 0x20000000000085c TN_EVENT_TAG_TX_OK event status 0
00000400:00000200:25.0:1773851894.936294:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851894.936294:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851894.936296:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851894.936297:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851894.936300:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=4320 offset=224 replen=4320  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851894.936304:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:25.0:1773851894.936305:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:20.0:1773851894.936306:0:60934:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:25.0:1773851894.936307:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 4798 trmk 1 tmk 0 trr 2 tta 0x20000000000085c Transaction freed
00000400:00000001:20.0:1773851894.936308:0:60934:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:20.0:1773851894.936308:0:60934:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:20.0:1773851894.936309:0:60934:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000002cc815b.
00000400:00000200:20.0:1773851894.936310:0:60934:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc86f6ba
00000400:00000010:20.0:1773851894.936311:0:60934:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000bc86f6ba (tot 253202803).
00000100:00000001:20.0:1773851894.936312:0:60934:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:20.0:1773851894.936313:0:60934:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:20.0:1773851894.936317:0:60934:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:20.0:1773851894.936319:0:60934:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:20.0:1773851894.936320:0:60934:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.936321:0:60934:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:20.0:1773851894.936322:0:60934:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:20.0:1773851894.936322:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851894.936323:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851894.936323:0:60934:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851894.936325:0:60934:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=127 v=66 (66 66 66 66)
00000100:00001000:20.0:1773851894.936326:0:60934:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=127 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851894.936327:0:60934:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:20.0:1773851894.936328:0:60934:0:(client.c:1366:ptlrpc_check_status()) @@@ check status: rc = 1  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQU/0/0 rc 0/1 job:'default-yuba2-0'
00000100:00000001:20.0:1773851894.936333:0:60934:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.936334:0:60934:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:20.0:1773851894.936335:0:60934:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:20.0:1773851894.936336:0:60934:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:20.0:1773851894.936337:0:60934:0:(client.c:1614:after_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:20.0:1773851894.936338:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Rpc:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:20.0:1773851894.936341:0:60934:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=1 : 1 : 0x1)
00000100:00000001:20.0:1773851894.936342:0:60934:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:20.0:1773851894.936342:0:60934:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:20.0:1773851894.936343:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Interpret:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00100000:20.0:1773851894.936346:0:60934:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009b7021bb pname:cluuid:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-mdtlov_UUID:60934:1859433051939520:2098@kfi7:1000:default-yuba2-0
00000100:00000001:20.0:1773851894.936348:0:60934:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.936348:0:60934:0:(client.c:2564:ptlrpc_set_wait()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851894.936349:0:60934:0:(client.c:1109:ptlrpc_set_destroy()) Process entered
00000100:00000001:20.0:1773851894.936350:0:60934:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:20.0:1773851894.936350:0:60934:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 2 fl Complete:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:20.0:1773851894.936353:0:60934:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:20.0:1773851894.936354:0:60934:0:(ptlrpc_internal.h:359:ptlrpc_reqset_put()) kfreed 'set': 112 at 00000000a73bb9ac.
00000100:00000001:20.0:1773851894.936354:0:60934:0:(client.c:1146:ptlrpc_set_destroy()) Process leaving
00000100:00000001:20.0:1773851894.936355:0:60934:0:(client.c:3079:ptlrpc_queue_wait()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:20.0:1773851894.936355:0:60934:0:(osp_trans.c:495:osp_remote_sync()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:20.0:1773851894.936357:0:60934:0:(osp_md_object.c:532:osp_md_index_lookup()) Process leaving via out (rc=1 : 1 : 0x1)
00000100:00000001:20.0:1773851894.936357:0:60934:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:20.0:1773851894.936358:0:60934:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000009b7021bb x1859433051939520/t0(0) o1000->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852047 ref 1 fl Complete:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:20.0:1773851894.936360:0:60934:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:20.0:1773851894.936361:0:60934:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:20.0:1773851894.936362:0:60934:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 8192 at 0000000011e4e363.
02000000:00000001:20.0:1773851894.936363:0:60934:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:20.0:1773851894.936364:0:60934:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:20.0:1773851894.936364:0:60934:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000020:00000001:20.0:1773851894.936365:0:60934:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:20.0:1773851894.936366:0:60934:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at 0000000002a6aa57.
02000000:00000001:20.0:1773851894.936367:0:60934:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:20.0:1773851894.936368:0:60934:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:20.0:1773851894.936368:0:60934:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009b7021bb.
00000100:00000001:20.0:1773851894.936369:0:60934:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:20.0:1773851894.936370:0:60934:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000010:20.0:1773851894.936370:0:60934:0:(osp_trans.c:215:osp_update_request_destroy()) kfreed 'ours->ours_req': 4096 at 000000009aba7aa3.
00000004:00000010:20.0:1773851894.936371:0:60934:0:(osp_trans.c:216:osp_update_request_destroy()) kfreed 'ours': 32 at 0000000070c2d983.
00000004:00000010:20.0:1773851894.936372:0:60934:0:(osp_trans.c:243:osp_update_request_destroy()) kfreed 'our': 120 at 00000000e9120fe6.
00000004:00000001:20.0:1773851894.936373:0:60934:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936373:0:60934:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936374:0:60934:0:(mdt_reint.c:581:mdt_create()) Process leaving via put_parent (rc=18446744073709551599 : -17 : 0xffffffffffffffef)
00000004:00000001:20.0:1773851894.936376:0:60934:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:20.0:1773851894.936377:0:60934:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:20.0:1773851894.936378:0:60934:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:20.0:1773851894.936379:0:60934:0:(lu_object.c:224:lu_object_put()) Add 0000000055996b9b/0000000088b94fdb to site lru. bkt: 00000000b48ed962
00000004:00000001:20.0:1773851894.936380:0:60934:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:20.0:1773851894.936380:0:60934:0:(mdt_reint.c:1087:mdt_reint_create()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000004:00000001:20.0:1773851894.936381:0:60934:0:(mdt_reint.c:3254:mdt_reint_rec()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000004:00000001:20.0:1773851894.936382:0:60934:0:(mdt_handler.c:2976:mdt_reint_internal()) Process leaving
02000000:00000001:20.0:1773851894.936383:0:60934:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:20.0:1773851894.936384:0:60934:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:20.0:1773851894.936384:0:60934:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:20.0:1773851894.936385:0:60934:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:20.0:1773851894.936386:0:60934:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:20.0:1773851894.936386:0:60934:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:20.0:1773851894.936387:0:60934:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851894.936388:0:60934:0:(mdt_handler.c:3056:mdt_reint()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00010000:00000040:20.0:1773851894.936389:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252788990, transno 0, xid 1859480376086848
00010000:00000001:20.0:1773851894.936389:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851894.936390:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008f4fa2cc x1859480376086848/t0(0) o36->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 512/448 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc -17/0 job:'default-tuolumne1017-0'
00010000:00000001:20.0:1773851894.936395:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851894.936395:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851894.936396:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=127 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851894.936397:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851894.936398:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:20.0:1773851894.936399:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
02000000:00000001:20.0:1773851894.936400:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851894.936401:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851894.936401:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851894.936402:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8498@kfi7
00000400:00000010:20.0:1773851894.936402:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c6360cc6.
00000100:00000200:20.0:1773851894.936403:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 448 bytes to portal 10, xid 1859480376086848, offset 224
00000400:00000200:20.0:1773851894.936405:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8498@kfi7
00000400:00000200:20.0:1773851894.936406:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8498@kfi7 to cpt 5
00000400:00000200:20.0:1773851894.936407:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002970edd0 nid 8498@kfi7 refs 1
00000400:00000200:20.0:1773851894.936408:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002970edd0 nid 8498@kfi7 refs 2
00000400:00000200:20.0:1773851894.936409:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002970edd0 nid 8498@kfi7 refs 3
00000400:00000200:20.0:1773851894.936410:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8498@kfi7 local destination
00000400:00000200:20.0:1773851894.936411:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770161:8770161:1024:4294967295] 8498@kfi7 LPNI seq info [2577516:2577516:16:4294967295]
00000400:00000200:20.0:1773851894.936413:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002970edd0 nid 8498@kfi7 refs 2
00000400:00000200:20.0:1773851894.936414:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8498@kfi7 to cpt 5
00000400:00000200:20.0:1773851894.936415:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8498@kfi7(8498@kfi7:8498@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851894.936416:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002970edd0 nid 8498@kfi7 refs 3
00000800:00000200:20.0:1773851894.936418:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851894.936419:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 448 bytes in 1 frags
00000800:00000200:20.0:1773851894.936421:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851894.936423:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e Using peer 8498@kfi7(0x10000000000125e)
00000800:00000200:20.0:1773851894.936428:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006987bf51: Posted send of 548 bytes to peer 0x10000000000125e: rc=0
00000800:00000200:20.0:1773851894.936429:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851894.936431:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851894.936432:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00010000:00000001:20.0:1773851894.936432:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851894.936433:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851894.936434:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851894.936434:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f4fa2cc x1859480376086848/t0(0) o36->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 512/448 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc -17/-17 job:'default-tuolumne1017-0'
00000100:00100000:20.0:1773851894.936438:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f4fa2cc pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+8:1723140:x1859480376086848:12345-8691@kfi7:36:default-tuolumne1017-0 Request processed in 415us (447us total) trans 0 rc -17/-17
00000100:00100000:20.0:1773851894.936441:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 335333152
00000100:00000040:20.0:1773851894.936441:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 0
00000100:00000001:20.0:1773851894.936442:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851894.936443:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851894.936443:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b697ec8.
00000020:00000010:20.0:1773851894.936444:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851894.936445:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851894.936446:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 7
00000100:00000001:20.0:1773851894.936446:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851894.936451:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851894.936453:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851894.936454:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8498@kfi7: PUT: OK
00000400:00000200:21.0:1773851894.936455:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c6360cc6
00000400:00000010:21.0:1773851894.936456:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c6360cc6.
00000100:00000001:21.0:1773851894.936456:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851894.936457:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851894.936458:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002970edd0 nid 8498@kfi7 refs 2
00000800:00000200:21.0:1773851894.936459:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 8498@kfi7(000000008e3a4827):0x0 lsk 4703 rsk 33 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000125e Transaction freed
00000800:00000200:13.0:1773851894.936627:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851894.936628:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851894.936629:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851894.936631:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851894.936635:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.936636:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8691@kfi7 : PUT - for me
00000400:00000200:13.0:1773851894.936636:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.936637:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000400:00000200:13.0:1773851894.936638:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.936639:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:13.0:1773851894.936640:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000400:00000200:13.0:1773851894.936640:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.936641:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 576 into portal 12 MB=0x69b30034891c0
00000400:00000200:13.0:1773851894.936642:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8691@kfi7 of length 576/576 into md 0x82a36e8ed [64] + 54160
00000800:00000200:13.0:1773851894.936644:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851894.936646:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.936647:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8691@kfi7: PUT: OK
00000100:00000001:13.0:1773851894.936648:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851894.936648:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851894.936649:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006408e041.
00000100:00000040:13.0:1773851894.936650:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000006408e041 x1859480376086976 msgsize 576
00000100:00100000:13.0:1773851894.936652:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8691@kfi7)
00000100:00000001:13.0:1773851894.936653:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851894.936654:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000100:00000001:12.0:1773851894.936654:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851894.936654:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851894.936655:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851894.936655:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851894.936655:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.936656:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.936657:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376086976
00000020:00000001:12.0:1773851894.936657:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851894.936658:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000020:00000001:12.0:1773851894.936658:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.936659:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=8
00000020:00000001:12.0:1773851894.936660:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000020:00000001:12.0:1773851894.936660:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000100:00000001:12.0:1773851894.936661:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.936662:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851894.936662:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000557b870b.
00000020:00000010:12.0:1773851894.936663:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.936665:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065d9b02b.
00000100:00000001:12.0:1773851894.936666:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851894.936666:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:12.0:1773851894.936666:0:60487:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:12.0:1773851894.936667:0:60487:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936667:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936668:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936669:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851894.936670:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.936671:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.936671:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851894.936671:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851894.936672:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 411190560
00000100:00000040:12.0:1773851894.936672:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 1
00000100:00000001:15.0:1773851894.936673:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.936673:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936673:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637024468614912 : -107049240936704 : ffff9ea3a8053f00)
00000100:00000040:12.0:1773851894.936674:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006408e041 x1859480376086976/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 576/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1017-0'
00000100:00000001:12.0:1773851894.936677:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.936677:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851894.936678:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006408e041 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+8:1723140:x1859480376086976:12345-8691@kfi7:101:default-tuolumne1017-0
00000100:00000200:12.0:1773851894.936679:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376086976
00000020:00000001:12.0:1773851894.936680:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851894.936681:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851894.936681:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.936682:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851894.936683:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:12.0:1773851894.936683:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851894.936684:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859480376086976, found 0 last_xid 1859480376086975
00000020:00000001:12.0:1773851894.936685:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851894.936685:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851894.936686:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851894.936686:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.936687:0:60487:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:12.0:1773851894.936688:0:60487:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:12.0:1773851894.936688:0:60487:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:12.0:1773851894.936691:0:60487:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:12.0:1773851894.936691:0:60487:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.936693:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851894.936694:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 194
00010000:00000001:12.0:1773851894.936695:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.936696:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.936696:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000004a2ebf97.
00000020:00000001:12.0:1773851894.936697:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.936697:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 000000004a2ebf97 with handle 0x21b6f08f07a6ae96 to hash
00000020:00000001:12.0:1773851894.936698:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.936698:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538926848 : -107107170624768 : ffff9e962b245b00)
00010000:00000010:12.0:1773851894.936699:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c8eb859f.
00010000:00000001:12.0:1773851894.936700:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538926848 : -107107170624768 : ffff9e962b245b00)
00010000:00010000:12.0:1773851894.936700:0:60487:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2ebf97/0x21b6f08f07a6ae96 lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xe67d5cc0bfa92ef6 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936703:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000040:12.0:1773851894.936704:0:60487:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 0000000025f0c678 : new locks_count 4
00000020:00000040:12.0:1773851894.936704:0:60487:0:(genops.c:871:class_export_get()) GET export 0000000025f0c678 refcount=9
00010000:00000001:12.0:1773851894.936705:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:12.0:1773851894.936706:0:60487:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:12.0:1773851894.936706:0:60487:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:12.0:1773851894.936707:0:60487:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:12.0:1773851894.936707:0:60487:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:12.0:1773851894.936708:0:60487:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:12.0:1773851894.936708:0:60487:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:12.0:1773851894.936709:0:60487:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:12.0:1773851894.936710:0:60487:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:12.0:1773851894.936711:0:60487:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:12.0:1773851894.936711:0:60487:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.936712:0:60487:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:12.0:1773851894.936713:0:60487:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:12.0:1773851894.936713:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851894.936714:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851894.936716:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000ecd14173.
02000000:00000001:12.0:1773851894.936717:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.936717:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.936718:0:60487:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.936718:0:60487:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:12.0:1773851894.936719:0:60487:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:12.0:1773851894.936719:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.936720:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.936720:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.936721:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.936721:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.936722:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.936722:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.936723:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.936723:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.936723:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.936724:0:60487:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:12.0:1773851894.936728:0:60487:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:12.0:1773851894.936729:0:60487:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:12.0:1773851894.936729:0:60487:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.936730:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.936730:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.936731:0:60487:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:12.0:1773851894.936731:0:60487:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.936732:0:60487:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:12.0:1773851894.936732:0:60487:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 00000000de841a18
00000004:00000001:12.0:1773851894.936733:0:60487:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:12.0:1773851894.936733:0:60487:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:12.0:1773851894.936734:0:60487:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:12.0:1773851894.936734:0:60487:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:12.0:1773851894.936735:0:60487:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00010000:00000001:12.0:1773851894.936735:0:60487:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.936736:0:60487:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:12.0:1773851894.936736:0:60487:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000007e90e1ea.
00000020:00000001:12.0:1773851894.936737:0:60487:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:12.0:1773851894.936737:0:60487:0:(lustre_handles.c:97:class_handle_hash()) added object 000000007e90e1ea with handle 0x21b6f08f07a6ae9d to hash
00000020:00000001:12.0:1773851894.936738:0:60487:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:12.0:1773851894.936739:0:60487:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000010:12.0:1773851894.936739:0:60487:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000004a41aab1.
00010000:00000001:12.0:1773851894.936740:0:60487:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000001:12.0:1773851894.936741:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.936742:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.936742:0:60487:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000007e90e1ea/0x21b6f08f07a6ae9d lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936745:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:12.0:1773851894.936745:0:60487:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:12.0:1773851894.936746:0:60487:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:12.0:1773851894.936746:0:60487:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:12.0:1773851894.936747:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.936747:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.936748:0:60487:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:12.0:1773851894.936748:0:60487:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.936749:0:60487:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:12.0:1773851894.936749:0:60487:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:12.0:1773851894.936750:0:60487:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:12.0:1773851894.936750:0:60487:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:12.0:1773851894.936751:0:60487:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 195
00010000:00000040:12.0:1773851894.936752:0:60487:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:12.0:1773851894.936753:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936755:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936756:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936758:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936759:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936761:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936763:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936765:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936766:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936768:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936769:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936771:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936772:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936774:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936775:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936778:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936778:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936781:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936782:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936784:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936785:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936787:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936789:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936791:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936792:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936794:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936795:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936797:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936798:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936799:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936800:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936802:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936804:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936806:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936807:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936809:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936810:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936812:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936814:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936816:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936816:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936818:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936819:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936822:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936823:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936824:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936825:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 7 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936827:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936828:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936830:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936831:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936833:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936834:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936836:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936838:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936840:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936841:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936843:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936844:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936846:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936847:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936848:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936850:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936852:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936853:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936855:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936856:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936858:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936859:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936861:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936862:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936864:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936865:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936867:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936868:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936871:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936871:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936874:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936875:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936877:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936878:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936880:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936881:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936883:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936884:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936886:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936887:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936889:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936890:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936892:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936894:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 9 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936896:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936896:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936898:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936899:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936901:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936902:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936904:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936905:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936907:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936908:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936910:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936911:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936913:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936914:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936916:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936918:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936920:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936921:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936923:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936924:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936926:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936927:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936929:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936930:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936932:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936933:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936935:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936936:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936938:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936939:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936941:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936942:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936944:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936945:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936947:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936948:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936950:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936951:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936953:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936954:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936956:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936957:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936959:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936960:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936962:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936963:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936965:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936967:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936969:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936970:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936972:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936973:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936975:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936976:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936978:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936979:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936981:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936982:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936984:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936986:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936988:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936989:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936991:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936992:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936994:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936995:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.936997:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.936998:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937000:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937001:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937003:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937004:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937006:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937007:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937009:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937011:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937013:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937014:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937016:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937017:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937019:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937020:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937022:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937022:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937025:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937026:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937028:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937029:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937030:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937032:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937034:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937035:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937037:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937038:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937040:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937041:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937044:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937045:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937047:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937048:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937050:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937051:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937053:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937054:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937056:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937057:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937059:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937061:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937063:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937064:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937066:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937067:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937069:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937070:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937072:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937073:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937075:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937076:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937078:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937079:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937081:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937082:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 8 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937084:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937085:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937087:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937088:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937090:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937091:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937093:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937094:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937096:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937097:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937099:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937100:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937102:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937103:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937105:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937106:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937108:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937110:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937112:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937113:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937115:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937116:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937119:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937119:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937122:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937122:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937124:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937125:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937128:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937129:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937131:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937132:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937134:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937136:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937138:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937139:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937141:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937142:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937144:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937145:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937147:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937148:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937150:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937151:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937153:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937155:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937157:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937158:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937160:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937161:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937163:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937165:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937167:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937168:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937170:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937171:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937173:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937174:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937176:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937177:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937179:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937180:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937182:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937183:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937185:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937189:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937191:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937192:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937194:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937195:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937197:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937198:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937200:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937201:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937203:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937204:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937205:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937206:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937208:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937210:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937211:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937213:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937215:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937216:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937218:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937220:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937222:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937223:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937225:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937226:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937228:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937229:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937231:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937233:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937235:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937236:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937238:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937239:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937241:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937242:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937244:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937245:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937247:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937248:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937250:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937251:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937253:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937254:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937256:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937257:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937259:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937260:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937262:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937263:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937265:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937266:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937268:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937269:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937272:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937272:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937275:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937276:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937278:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937278:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937281:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937282:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937284:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937285:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937286:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937288:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937290:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937291:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937293:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937294:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937296:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937297:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937299:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937300:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937302:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937303:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937305:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937306:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937308:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937309:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937311:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937313:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937315:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937316:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937318:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937319:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937321:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937322:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937324:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937325:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937327:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937328:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937330:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937331:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937333:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937334:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937336:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937346:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937347:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937348:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937350:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937352:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937354:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937354:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937357:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937357:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937360:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937360:0:60487:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937362:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00010000:12.0:1773851894.937363:0:60487:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000007e90e1ea/0x21b6f08f07a6ae9d lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937365:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:12.0:1773851894.937365:0:60487:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:12.0:1773851894.937366:0:60487:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851894.937367:0:60487:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.937367:0:60487:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:12.0:1773851894.937367:0:60487:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.937368:0:60487:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.937369:0:60487:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851894.937370:0:60487:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:12.0:1773851894.937370:0:60487:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:12.0:1773851894.937371:0:60487:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000007e90e1ea/0x21b6f08f07a6ae9d lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937373:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:12.0:1773851894.937373:0:60487:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:12.0:1773851894.937374:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.937374:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.937375:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.937376:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.937376:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007e90e1ea refcount=3
00000020:00000001:12.0:1773851894.937377:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000001:12.0:1773851894.937378:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000001:12.0:1773851894.937378:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.937378:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.937379:0:60487:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.937379:0:60487:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.937380:0:60487:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:12.0:1773851894.937381:0:60487:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:12.0:1773851894.937381:0:60487:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:12.0:1773851894.937388:0:60487:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.937389:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851894.937389:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.937390:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.937391:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937392:0:60487:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937393:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937393:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851894.937394:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.937394:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.937394:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937395:0:60487:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937396:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:12.0:1773851894.937396:0:60487:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:12.0:1773851894.937397:0:60487:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.937398:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.937398:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.937399:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.937399:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:12.0:1773851894.937399:0:60487:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:12.0:1773851894.937400:0:60487:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:12.0:1773851894.937400:0:60487:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:12.0:1773851894.937401:0:60487:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:12.0:1773851894.937402:0:60487:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:12.0:1773851894.937402:0:60487:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:12.0:1773851894.937403:0:60487:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:12.0:1773851894.937403:0:60487:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.937404:0:60487:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:12.0:1773851894.937404:0:60487:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:12.0:1773851894.937405:0:60487:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.937405:0:60487:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:12.0:1773851894.937405:0:60487:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937406:0:60487:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937407:0:60487:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:12.0:1773851894.937407:0:60487:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.937408:0:60487:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:12.0:1773851894.937409:0:60487:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.937409:0:60487:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.937411:0:60487:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.937412:0:60487:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851894.937412:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.937412:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007e90e1ea refcount=3
00000020:00000001:12.0:1773851894.937413:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000001:12.0:1773851894.937414:0:60487:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00000004:00000040:12.0:1773851894.937414:0:60487:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 0000000025f0c678 : new locks_count 5
00000020:00000040:12.0:1773851894.937415:0:60487:0:(genops.c:871:class_export_get()) GET export 0000000025f0c678 refcount=10
00010000:00000001:12.0:1773851894.937416:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.937416:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:12.0:1773851894.937416:0:60487:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:12.0:1773851894.937417:0:60487:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:12.0:1773851894.937417:0:60487:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:12.0:1773851894.937418:0:60487:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:12.0:1773851894.937418:0:60487:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:12.0:1773851894.937419:0:60487:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:12.0:1773851894.937419:0:60487:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:12.0:1773851894.937420:0:60487:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:12.0:1773851894.937421:0:60487:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851894.937421:0:60487:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:12.0:1773851894.937422:0:60487:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:12.0:1773851894.937423:0:60487:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:12.0:1773851894.937423:0:60487:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:12.0:1773851894.937424:0:60487:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:12.0:1773851894.937424:0:60487:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:12.0:1773851894.937425:0:60487:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851894.937425:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.937425:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.937426:0:60487:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851894.937426:0:60487:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851894.937427:0:60487:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000004a2ebf97 with handle 0x21b6f08f07a6ae96 from hash
00010000:00000001:12.0:1773851894.937427:0:60487:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851894.937428:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.937428:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.937429:0:60487:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:12.0:1773851894.937429:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851894.937429:0:60487:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2ebf97/0x21b6f08f07a6ae96 lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ef6 expref: 10 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937432:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851894.937432:0:60487:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000025f0c678 : new locks_count 4
00000020:00000040:12.0:1773851894.937433:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 9
00010000:00000010:12.0:1773851894.937434:0:60487:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000c8eb859f.
00010000:00000040:12.0:1773851894.937434:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:12.0:1773851894.937436:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851894.937436:0:60487:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.937437:0:60487:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:12.0:1773851894.937437:0:60487:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000007e90e1ea/0x21b6f08f07a6ae9d lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ef6 expref: 9 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851894.937439:0:60487:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:12.0:1773851894.937440:0:60487:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851894.937441:0:60487:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851894.937441:0:60487:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:12.0:1773851894.937442:0:60487:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:12.0:1773851894.937443:0:60487:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851894.937443:0:60487:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851894.937444:0:60487:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:12.0:1773851894.937445:0:60487:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851894.937445:0:60487:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:12.0:1773851894.937445:0:60487:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000007e90e1ea, rc 0)
00000020:00000001:12.0:1773851894.937446:0:60487:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851894.937446:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252788990, transno 0, xid 1859480376086976
00010000:00000001:12.0:1773851894.937447:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851894.937448:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006408e041 x1859480376086976/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 576/640 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00010000:00000001:12.0:1773851894.937450:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851894.937451:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851894.937451:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851894.937452:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851894.937453:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:12.0:1773851894.937454:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
02000000:00000001:12.0:1773851894.937455:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851894.937455:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.937456:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851894.937457:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8691@kfi7
00000400:00000010:12.0:1773851894.937457:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1f39afe.
00000100:00000200:12.0:1773851894.937458:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859480376086976, offset 224
00000400:00000200:12.0:1773851894.937460:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8691@kfi7
00000400:00000200:12.0:1773851894.937461:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.937461:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 1
00000400:00000200:12.0:1773851894.937462:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:12.0:1773851894.937463:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000400:00000200:12.0:1773851894.937464:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8691@kfi7 local destination
00000400:00000200:12.0:1773851894.937466:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770162:8770162:1024:4294967295] 8691@kfi7 LPNI seq info [2577517:2577517:16:4294967295]
00000400:00000200:12.0:1773851894.937467:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000400:00000200:12.0:1773851894.937468:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:12.0:1773851894.937469:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8691@kfi7(8691@kfi7:8691@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851894.937470:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 3
00000800:00000200:12.0:1773851894.937472:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851894.937473:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:12.0:1773851894.937475:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851894.937477:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Using peer 8691@kfi7(0x125a)
00000800:00000200:12.0:1773851894.937480:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 740 bytes to peer 0x125a: rc=0
00000800:00000200:12.0:1773851894.937482:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851894.937484:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851894.937485:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00010000:00000001:12.0:1773851894.937485:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851894.937486:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851894.937486:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851894.937487:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006408e041 x1859480376086976/t0(0) o101->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 576/640 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1017-0'
00000100:00100000:12.0:1773851894.937492:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006408e041 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+9:1723140:x1859480376086976:12345-8691@kfi7:101:default-tuolumne1017-0 Request processed in 814us (841us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851894.937496:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 411190560
00000100:00000040:12.0:1773851894.937496:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 0
00000100:00000001:12.0:1773851894.937497:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851894.937498:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851894.937498:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.937499:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065d9b02b.
00000020:00000010:12.0:1773851894.937500:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000557b870b.
00000020:00000040:12.0:1773851894.937500:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 8
00000100:00000001:12.0:1773851894.937501:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851894.937506:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851894.937508:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.937509:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8691@kfi7: PUT: OK
00000400:00000200:13.0:1773851894.937509:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1f39afe
00000400:00000010:13.0:1773851894.937510:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1f39afe.
00000100:00000001:13.0:1773851894.937510:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851894.937511:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851894.937511:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dcf34b13 nid 8691@kfi7 refs 2
00000800:00000200:13.0:1773851894.937513:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 8691@kfi7(000000008681b45a):0x0 lsk 4699 rsk 1 tsk 0 trmk 0 tmk 0 trr 3 tta 0x125a Transaction freed
00000800:00000200:1.0:1773851894.937573:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851894.937575:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851894.937576:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851894.937579:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851894.937581:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.937582:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8690@kfi7 : PUT - for me
00000400:00000200:1.0:1773851894.937583:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.937584:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 1
00000400:00000200:1.0:1773851894.937584:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:1.0:1773851894.937585:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000400:00000200:1.0:1773851894.937586:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 3
00000400:00000200:1.0:1773851894.937587:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8691@kfi7 to cpt 3
00000400:00000200:1.0:1773851894.937587:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8691@kfi7 of length 328 into portal 17 MB=0x69b3003489240
00000400:00000200:1.0:1773851894.937589:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8691@kfi7 of length 328/328 into md 0x7fb60e481 [2] + 1640
00000800:00000200:1.0:1773851894.937590:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851894.937592:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851894.937593:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8690@kfi7: PUT: OK
00000100:00000001:1.0:1773851894.937594:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851894.937595:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:1.0:1773851894.937596:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c9b862a3.
00000100:00000040:1.0:1773851894.937596:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000c9b862a3 x1859480376087104 msgsize 328
00000100:00100000:1.0:1773851894.937598:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-8691@kfi7 (source: 12345-8690@kfi7)
00000100:00000001:1.0:1773851894.937599:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851894.937599:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000100:00000001:0.0:1773851894.937600:0:61144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851894.937601:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851894.937601:0:61144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851894.937601:0:61144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851894.937602:0:61144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851894.937603:0:61144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851894.937603:0:61144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859480376087104
00000020:00000001:0.0:1773851894.937604:0:61144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851894.937605:0:61144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cbae273bf
00000020:00000001:0.0:1773851894.937605:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.937606:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000025f0c678 refcount=9
00000020:00000001:0.0:1773851894.937607:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000020:00000001:0.0:1773851894.937607:0:61144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637056290673664 : -107017418877952 : ffff9eab10c35400)
00000100:00000001:0.0:1773851894.937608:0:61144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851894.937609:0:61144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851894.937609:0:61144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851894.937610:0:61144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851894.937611:0:61144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000dcff0605.
00000100:00000040:0.0:1773851894.937612:0:61144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:0.0:1773851894.937613:0:61144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851894.937613:0:61144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:0.0:1773851894.937613:0:61144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:0.0:1773851894.937614:0:61144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851894.937614:0:61144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:0.0:1773851894.937615:0:61144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:0.0:1773851894.937615:0:61144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851894.937616:0:61144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007e90e1ea refcount=3
00000020:00000001:0.0:1773851894.937617:0:61144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000001:0.0:1773851894.937617:0:61144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000001:0.0:1773851894.937618:0:61144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:0.0:1773851894.937619:0:61144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:0.0:1773851894.937619:0:61144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.937620:0:61144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.937621:0:61144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.937621:0:61144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:3.0:1773851894.937623:0:82951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:3.0:1773851894.937623:0:82951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851894.937623:0:61144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851894.937623:0:61144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:3.0:1773851894.937624:0:82951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8691@kfi7, seq: 45419468
00000100:00000040:3.0:1773851894.937625:0:82951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000025f0c678 : new rpc_count 1
00000100:00000001:3.0:1773851894.937626:0:82951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052777344 : -106991656774272 : ffff9eb1104dd580)
00000100:00000001:0.0:1773851894.937626:0:61144:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851894.937626:0:61144:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851894.937628:0:82951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c9b862a3 x1859480376087104/t0(0) o103->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 328/0 e 0 to 0 dl 1773851981 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:3.0:1773851894.937631:0:82951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:3.0:1773851894.937631:0:82951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:3.0:1773851894.937632:0:82951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c9b862a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+9:40137:x1859480376087104:12345-8691@kfi7:103:
00000100:00000200:3.0:1773851894.937634:0:82951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859480376087104
00010000:00000001:3.0:1773851894.937637:0:82951:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:3.0:1773851894.937637:0:82951:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:3.0:1773851894.937638:0:82951:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:3.0:1773851894.937638:0:82951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:3.0:1773851894.937639:0:82951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:3.0:1773851894.937640:0:82951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003b06ca1b.
02000000:00000001:3.0:1773851894.937640:0:82951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851894.937641:0:82951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:3.0:1773851894.937642:0:82951:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:3.0:1773851894.937642:0:82951:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:3.0:1773851894.937643:0:82951:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:3.0:1773851894.937643:0:82951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:3.0:1773851894.937644:0:82951:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000007e90e1ea refcount=3
00000020:00000001:3.0:1773851894.937644:0:82951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000001:3.0:1773851894.937645:0:82951:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636966538925696 : -107107170625920 : ffff9e962b245680)
00010000:00000040:3.0:1773851894.937646:0:82951:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00000004:00000001:3.0:1773851894.937646:0:82951:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:3.0:1773851894.937647:0:82951:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:3.0:1773851894.937647:0:82951:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:3.0:1773851894.937648:0:82951:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:3.0:1773851894.937648:0:82951:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851894.937649:0:82951:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:3.0:1773851894.937650:0:82951:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:3.0:1773851894.937650:0:82951:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:3.0:1773851894.937651:0:82951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:3.0:1773851894.937652:0:82951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:3.0:1773851894.937652:0:82951:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:3.0:1773851894.937653:0:82951:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:3.0:1773851894.937653:0:82951:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000007e90e1ea with handle 0x21b6f08f07a6ae9d from hash
00010000:00000001:3.0:1773851894.937654:0:82951:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:3.0:1773851894.937654:0:82951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:3.0:1773851894.937655:0:82951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:3.0:1773851894.937655:0:82951:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:3.0:1773851894.937656:0:82951:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:3.0:1773851894.937656:0:82951:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:3.0:1773851894.937657:0:82951:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:3.0:1773851894.937657:0:82951:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:3.0:1773851894.937658:0:82951:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000007e90e1ea/0x21b6f08f07a6ae9d lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ef6 expref: 9 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:3.0:1773851894.937661:0:82951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:3.0:1773851894.937662:0:82951:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 0000000025f0c678 : new locks_count 3
00000020:00000040:3.0:1773851894.937662:0:82951:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 8
00010000:00000010:3.0:1773851894.937663:0:82951:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000004a41aab1.
00010000:00000040:3.0:1773851894.937664:0:82951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:3.0:1773851894.937664:0:82951:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:3.0:1773851894.937665:0:82951:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:3.0:1773851894.937665:0:82951:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:3.0:1773851894.937666:0:82951:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:3.0:1773851894.937667:0:82951:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:3.0:1773851894.937668:0:82951:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:3.0:1773851894.937668:0:82951:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:3.0:1773851894.937669:0:82951:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00010000:3.0:1773851894.937669:0:82951:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:3.0:1773851894.937670:0:82951:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:3.0:1773851894.937670:0:82951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:3.0:1773851894.937671:0:82951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:3.0:1773851894.937672:0:82951:0:(import.c:1951:at_measured()) add 1 to 00000000fe6e7196 time=148 v=66 (1 1 1 1)
00000100:00000001:3.0:1773851894.937673:0:82951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:3.0:1773851894.937673:0:82951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cba99e09 refcount 3 to 8691@kfi7
00000100:00000001:3.0:1773851894.937674:0:82951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637103991251424 : -106969718300192 : ffff9eb62bf061e0)
02000000:00000001:3.0:1773851894.937675:0:82951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:3.0:1773851894.937675:0:82951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851894.937676:0:82951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:3.0:1773851894.937677:0:82951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8690@kfi7
00000400:00000010:3.0:1773851894.937677:0:82951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006aa38b71.
00000100:00000200:3.0:1773851894.937678:0:82951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859480376087104, offset 224
00000400:00000200:3.0:1773851894.937680:0:82951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8690@kfi7
00000400:00000200:3.0:1773851894.937681:0:82951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:3.0:1773851894.937681:0:82951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 1
00000400:00000200:3.0:1773851894.937682:0:82951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000400:00000200:3.0:1773851894.937684:0:82951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 3
00000400:00000200:3.0:1773851894.937685:0:82951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8690@kfi7 local destination
00000400:00000200:3.0:1773851894.937687:0:82951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770163:8770163:1024:4294967295] 8690@kfi7 LPNI seq info [2577518:2577518:16:4294967295]
00000400:00000200:3.0:1773851894.937688:0:82951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000400:00000200:3.0:1773851894.937689:0:82951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8690@kfi7 to cpt 0
00000400:00000200:3.0:1773851894.937691:0:82951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8690@kfi7(8690@kfi7:8690@kfi7) <?> : PUT try# 0
00000400:00000200:3.0:1773851894.937692:0:82951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 3
00000800:00000200:3.0:1773851894.937693:0:82951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851894.937694:0:82951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008f915b04: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:3.0:1773851894.937696:0:82951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008f915b04: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:3.0:1773851894.937698:0:82951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008f915b04: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 Using peer 8690@kfi7(0x100000000001276)
00000800:00000200:3.0:1773851894.937702:0:82951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000008f915b04: Posted send of 324 bytes to peer 0x100000000001276: rc=0
00000800:00000200:3.0:1773851894.937703:0:82951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008f915b04: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:3.0:1773851894.937705:0:82951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851894.937706:0:82951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cba99e09 refcount 2 to 8691@kfi7
00010000:00000001:3.0:1773851894.937706:0:82951:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:3.0:1773851894.937707:0:82951:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851894.937707:0:82951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c9b862a3 x1859480376087104/t0(0) o103->f50b67a8-dcff-4bc4-ad0e-e2700b643de4@8691@kfi7:621/0 lens 328/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:3.0:1773851894.937710:0:82951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c9b862a3 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_016:f50b67a8-dcff-4bc4-ad0e-e2700b643de4+8:40137:x1859480376087104:12345-8691@kfi7:103: Request processed in 79us (113us total) trans 0 rc 0/0
00000100:00100000:3.0:1773851894.937713:0:82951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8691@kfi7, seq: 45419468
00000100:00000040:3.0:1773851894.937714:0:82951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000025f0c678 : new rpc_count 0
00000100:00000001:3.0:1773851894.937714:0:82951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:3.0:1773851894.937715:0:82951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:1.0:1773851894.937715:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008f915b04: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 TN_EVENT_TX_OK event status 0
00000020:00000010:3.0:1773851894.937716:0:82951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:3.0:1773851894.937717:0:82951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000dcff0605.
00000400:00000200:1.0:1773851894.937717:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:3.0:1773851894.937718:0:82951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:3.0:1773851894.937718:0:82951:0:(genops.c:882:class_export_put()) PUTting export 0000000025f0c678 : new refcount 7
00000400:00000200:1.0:1773851894.937718:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8690@kfi7: PUT: OK
00000100:00000001:3.0:1773851894.937719:0:82951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851894.937720:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006aa38b71
00000400:00000010:1.0:1773851894.937720:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006aa38b71.
00000100:00000001:1.0:1773851894.937721:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851894.937721:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851894.937722:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d467ee26 nid 8690@kfi7 refs 2
00000800:00000200:1.0:1773851894.937723:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008f915b04: 2054@kfi7:0 -> 8690@kfi7(00000000b0060b71):0x0 lsk 4727 rsk 20 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001276 Transaction freed
00010000:00000010:12.1:1773851894.937728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006d91247b.
00010000:00000010:12.1:1773851894.941727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000035a07647.
00010000:00000010:12.1:1773851894.941728:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000008bae770f.
00010000:00000010:12.1:1773851894.941729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000639f6827.
00010000:00000010:12.1:1773851894.941729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000ef31445b.
00010000:00000010:0.1:1773851894.942727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000078b8bd6e.
00010000:00000010:12.1:1773851894.945728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000004a2ebf97.
00010000:00000010:3.1F:1773851894.945728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000007e90e1ea.
00000800:00000200:13.0:1773851894.946262:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851894.946263:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851894.946264:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851894.946266:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851894.946267:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11665@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.946268:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11665@kfi7 : PUT - for me
00000400:00000200:13.0:1773851894.946269:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11665@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.946270:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008cc6e3ff nid 11665@kfi7 refs 1
00000400:00000200:13.0:1773851894.946271:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11665@kfi7 to cpt 3
00000400:00000200:13.0:1773851894.946271:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008cc6e3ff nid 11665@kfi7 refs 2
00000400:00000200:13.0:1773851894.946272:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008cc6e3ff nid 11665@kfi7 refs 3
00000400:00000200:13.0:1773851894.946273:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11601@kfi7 to cpt 7
00000400:00000200:13.0:1773851894.946274:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11601@kfi7 of length 224 into portal 12 MB=0x69b476e360080
00000400:00000200:13.0:1773851894.946275:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11601@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 54736
00000800:00000200:13.0:1773851894.946277:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851894.946278:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851894.946279:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11665@kfi7: PUT: OK
00000100:00000001:13.0:1773851894.946280:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851894.946280:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851894.946282:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003287398f.
00000100:00000040:13.0:1773851894.946283:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003287398f x1859580954280064 msgsize 224
00000100:00100000:13.0:1773851894.946284:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-11601@kfi7 (source: 12345-11665@kfi7)
00000100:00000001:13.0:1773851894.946285:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851894.946286:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008cc6e3ff nid 11665@kfi7 refs 2
00000800:00000200:13.0:1773851894.946287:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851894.946287:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851894.946287:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851894.946288:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851894.946288:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851894.946289:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851894.946289:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580954280064
00000020:00000001:12.0:1773851894.946290:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851894.946290:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc4589a2
00000020:00000001:12.0:1773851894.946291:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851894.946295:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b8efabcf refcount=777
00000020:00000001:12.0:1773851894.946296:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636942140959744 : -107131568591872 : ffff9e907ce8ec00)
00000020:00000001:12.0:1773851894.946297:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636942140959744 : -107131568591872 : ffff9e907ce8ec00)
00000100:00000001:12.0:1773851894.946298:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851894.946298:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851894.946299:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000557b870b.
00000020:00000010:12.0:1773851894.946300:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000042e721f3.
00000020:00000010:12.0:1773851894.946301:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000065d9b02b.
00000100:00000001:12.0:1773851894.946301:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851894.946302:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851894.946302:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851894.946303:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000001:12.0:1773851894.946303:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000800:00000200:17.0:1773851894.946304:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:12.0:1773851894.946304:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851894.946304:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851894.946305:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:12.0:1773851894.946305:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851894.946307:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:15.0:1773851894.946307:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.946307:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851894.946307:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851894.946307:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851894.946308:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11601@kfi7, seq: 2289922
00000400:00000200:17.0:1773851894.946309:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000100:00000040:15.0:1773851894.946309:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b8efabcf : new rpc_count 10
00000100:00000001:12.0:1773851894.946309:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851894.946310:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11600@kfi7 : PUT - for me
00000100:00000001:15.0:1773851894.946310:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636935733937280 : -107137975614336 : ffff9e8eff058480)
00000100:00000001:12.0:1773851894.946310:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851894.946311:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000100:00000040:15.0:1773851894.946311:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003287398f x1859580954280064/t0(0) o400->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1218-0'
00000400:00000200:17.0:1773851894.946312:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 1
00000400:00000200:17.0:1773851894.946314:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:17.0:1773851894.946314:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000100:00000001:15.0:1773851894.946314:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:17.0:1773851894.946315:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 3
00000100:00000001:15.0:1773851894.946315:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:17.0:1773851894.946316:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11601@kfi7 to cpt 7
00000100:00100000:15.0:1773851894.946316:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003287398f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb+777:39633:x1859580954280064:12345-11601@kfi7:400:default-tuolumne1218-0
00000400:00000200:17.0:1773851894.946317:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11601@kfi7 of length 456 into portal 12 MB=0x69b476e3600c0
00000100:00000200:15.0:1773851894.946317:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580954280064
00000020:00000001:15.0:1773851894.946318:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851894.946318:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:17.0:1773851894.946319:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11601@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 43656
00000020:00000001:15.0:1773851894.946319:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851894.946320:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851894.946320:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000800:00000200:17.0:1773851894.946321:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:15.0:1773851894.946321:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851894.946321:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580954280064, found 0 last_xid 1859580937482943
00000020:00000001:15.0:1773851894.946322:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851894.946323:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851894.946323:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851894.946323:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851894.946324:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000001:15.0:1773851894.946324:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000400:00000200:17.0:1773851894.946325:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11600@kfi7: PUT: OK
00000100:00000001:15.0:1773851894.946325:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851894.946325:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000001:17.0:1773851894.946326:0:2511435:0:(events.c:307:request_in_callback()) Process entered
02000000:00000010:15.0:1773851894.946326:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000de612b28.
02000000:00000001:15.0:1773851894.946326:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:17.0:1773851894.946327:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000001:15.0:1773851894.946327:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:17.0:1773851894.946328:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001c48d1f1.
00000020:00000001:15.0:1773851894.946328:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851894.946329:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000001c48d1f1 x1859580954280128 msgsize 456
00010000:00000040:15.0:1773851894.946329:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593122, transno 0, xid 1859580954280064
00010000:00000001:15.0:1773851894.946329:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851894.946330:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003287398f x1859580954280064/t0(0) o400->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1218-0'
00000100:00100000:17.0:1773851894.946331:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-11601@kfi7 (source: 12345-11600@kfi7)
00000100:00000001:17.0:1773851894.946332:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851894.946333:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000100:00000001:16.0:1773851894.946333:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851894.946334:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851894.946334:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851894.946334:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851894.946335:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851894.946336:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:15.0:1773851894.946336:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851894.946336:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851894.946337:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580954280128
00000020:00000001:16.0:1773851894.946337:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000100:00001000:15.0:1773851894.946337:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000020:00000040:16.0:1773851894.946338:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc4589a2
00000020:00000001:16.0:1773851894.946338:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:15.0:1773851894.946338:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851894.946339:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c7543625 refcount 3 to 11601@kfi7
00000020:00000040:16.0:1773851894.946340:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b8efabcf refcount=778
00000100:00000001:15.0:1773851894.946340:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882880 : -107156296668736 : ffff9e8abb0069c0)
00000020:00000001:16.0:1773851894.946341:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636942140959744 : -107131568591872 : ffff9e907ce8ec00)
02000000:00000001:15.0:1773851894.946341:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851894.946341:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851894.946342:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636942140959744 : -107131568591872 : ffff9e907ce8ec00)
00000100:00000001:15.0:1773851894.946342:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:16.0:1773851894.946343:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851894.946343:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000040:15.0:1773851894.946343:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11665@kfi7
00000020:00000010:16.0:1773851894.946344:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a73103fc.
00000400:00000010:15.0:1773851894.946344:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fd79a325.
00000020:00000010:16.0:1773851894.946345:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000100:00000200:15.0:1773851894.946345:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580954280064, offset 224
00000020:00000010:16.0:1773851894.946346:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d9c254e.
00000400:00000200:15.0:1773851894.946346:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11665@kfi7
00000100:00000001:16.0:1773851894.946347:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851894.946347:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:15.0:1773851894.946347:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11665@kfi7 to cpt 3
00000100:00000001:16.0:1773851894.946348:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851894.946348:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008cc6e3ff nid 11665@kfi7 refs 1
00000100:00000001:16.0:1773851894.946349:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851894.946349:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008cc6e3ff nid 11665@kfi7 refs 2
00000100:00000001:16.0:1773851894.946350:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851894.946350:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008cc6e3ff nid 11665@kfi7 refs 3
00000100:00000001:16.0:1773851894.946351:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000400:00000200:15.0:1773851894.946351:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11665@kfi7 local destination
00000100:00000001:19.0:1773851894.946352:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851894.946352:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851894.946352:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000400:00000200:15.0:1773851894.946352:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770164:8770164:1024:4294967295] 11665@kfi7 LPNI seq info [6514307:6514307:16:4294967295]
00000100:00100000:19.0:1773851894.946353:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11601@kfi7, seq: 323103294
00000100:00000040:19.0:1773851894.946354:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b8efabcf : new rpc_count 11
00000100:00000001:16.0:1773851894.946354:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851894.946354:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008cc6e3ff nid 11665@kfi7 refs 2
00000100:00000001:19.0:1773851894.946355:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968775040 : -106974740776576 : ffff9eb500937980)
00000100:00000001:16.0:1773851894.946355:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:15.0:1773851894.946355:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11665@kfi7 to cpt 3
00000100:00000040:19.0:1773851894.946356:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001c48d1f1 x1859580954280128/t0(0) o17->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:146/0 lens 456/0 e 0 to 0 dl 1773852261 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1218-0'
00000400:00000200:15.0:1773851894.946357:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11665@kfi7(11665@kfi7:11665@kfi7) <?> : PUT try# 0
00000100:00000001:19.0:1773851894.946358:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851894.946358:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:15.0:1773851894.946358:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008cc6e3ff nid 11665@kfi7 refs 3
00000100:00100000:19.0:1773851894.946359:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001c48d1f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb+778:39634:x1859580954280128:12345-11601@kfi7:17:default-tuolumne1218-0
00000800:00000200:15.0:1773851894.946359:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851894.946360:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000200:19.0:1773851894.946361:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580954280128
00000020:00000001:19.0:1773851894.946361:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851894.946362:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851894.946362:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851894.946362:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000020:00000001:19.0:1773851894.946363:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851894.946363:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:19.0:1773851894.946364:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851894.946365:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580954280128, found 0 last_xid 1859580937482943
00000020:00000001:19.0:1773851894.946365:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851894.946365:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e26 Using peer 11665@kfi7(0x100000000000e26)
00000020:00000001:19.0:1773851894.946366:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851894.946366:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851894.946367:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851894.946367:0:60961:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:19.0:1773851894.946368:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851894.946369:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851894.946369:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000a0f71015.
02000000:00000001:19.0:1773851894.946370:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851894.946370:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x100000000000e26: rc=0
00000100:00000001:19.0:1773851894.946371:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851894.946371:0:60961:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000800:00000200:15.0:1773851894.946371:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e26 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000020:00000001:19.0:1773851894.946372:0:60961:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:19.0:1773851894.946373:0:60961:0:(osd_handler.c:559:osd_statfs()) Process entered
00000100:00000001:15.0:1773851894.946373:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:19.0:1773851894.946374:0:60961:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851894.946374:0:60961:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:15.0:1773851894.946374:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c7543625 refcount 2 to 11601@kfi7
00000020:00000020:19.0:1773851894.946375:0:60961:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb/00000000b8efabcf free: 126633370845184 avail: 126633368748032
00000020:00000001:19.0:1773851894.946375:0:60961:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00010000:00000001:15.0:1773851894.946375:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851894.946375:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:19.0:1773851894.946376:0:60961:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb/00000000b8efabcf avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:15.0:1773851894.946376:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851894.946376:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003287398f x1859580954280064/t0(0) o400->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1218-0'
00000020:00000001:19.0:1773851894.946377:0:60961:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:19.0:1773851894.946377:0:60961:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:19.0:1773851894.946378:0:60961:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb/00000000b8efabcf reports grant 1806434303 dropped 0, local 1882456063
00000020:00000001:19.0:1773851894.946378:0:60961:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:19.0:1773851894.946379:0:60961:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:19.0:1773851894.946379:0:60961:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851894.946379:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003287398f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb+778:39633:x1859580954280064:12345-11601@kfi7:400:default-tuolumne1218-0 Request processed in 64us (95us total) trans 0 rc 0/0
00010000:00000040:19.0:1773851894.946380:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593122, transno 0, xid 1859580954280128
00010000:00000001:19.0:1773851894.946381:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851894.946382:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001c48d1f1 x1859580954280128/t0(0) o17->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:146/0 lens 456/432 e 0 to 0 dl 1773852261 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1218-0'
00000100:00100000:15.0:1773851894.946382:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11601@kfi7, seq: 2289922
00000100:00000040:15.0:1773851894.946382:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b8efabcf : new rpc_count 10
00000100:00000001:15.0:1773851894.946383:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851894.946383:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e26 TN_EVENT_TX_OK event status 0
00010000:00000001:19.0:1773851894.946384:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851894.946384:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.946384:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00001000:19.0:1773851894.946385:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=127 v=340 (340 214 1 1)
00000020:00000010:15.0:1773851894.946385:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000042e721f3.
00000020:00000010:15.0:1773851894.946385:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000065d9b02b.
00000400:00000200:13.0:1773851894.946385:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851894.946386:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000020:00000010:15.0:1773851894.946386:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000557b870b.
00000400:00000200:13.0:1773851894.946386:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11665@kfi7: PUT: OK
00000100:00000040:19.0:1773851894.946387:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c7543625 refcount 3 to 11601@kfi7
00000100:00000001:19.0:1773851894.946387:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412882880 : -107156296668736 : ffff9e8abb0069c0)
00000020:00000040:15.0:1773851894.946387:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000b8efabcf : new refcount 777
00000400:00000200:13.0:1773851894.946387:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fd79a325
00000400:00000010:13.0:1773851894.946387:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fd79a325.
02000000:00000001:19.0:1773851894.946388:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851894.946388:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.946388:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851894.946388:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851894.946388:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:19.0:1773851894.946389:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:13.0:1773851894.946389:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008cc6e3ff nid 11665@kfi7 refs 2
00000100:00000040:19.0:1773851894.946390:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11600@kfi7
00000400:00000010:19.0:1773851894.946390:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2381311.
00000100:00000200:19.0:1773851894.946391:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859580954280128, offset 224
00000800:00000200:13.0:1773851894.946391:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 11665@kfi7(00000000e18c0688):0x0 lsk 3623 rsk 13 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e26 Transaction freed
00000400:00000200:19.0:1773851894.946392:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11600@kfi7
00000400:00000200:19.0:1773851894.946393:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:19.0:1773851894.946394:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 1
00000400:00000200:19.0:1773851894.946395:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000400:00000200:19.0:1773851894.946397:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 3
00000400:00000200:19.0:1773851894.946398:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11600@kfi7 local destination
00000400:00000200:19.0:1773851894.946399:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770165:8770165:1024:4294967295] 11600@kfi7 LPNI seq info [6514308:6514308:16:4294967295]
00000400:00000200:19.0:1773851894.946400:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000400:00000200:19.0:1773851894.946401:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11600@kfi7 to cpt 4
00000400:00000200:19.0:1773851894.946403:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11600@kfi7(11600@kfi7:11600@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851894.946404:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 3
00000800:00000200:19.0:1773851894.946405:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851894.946406:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:19.0:1773851894.946408:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851894.946410:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 Using peer 11600@kfi7(0x75)
00000800:00000200:19.0:1773851894.946413:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049addc73: Posted send of 532 bytes to peer 0x75: rc=0
00000800:00000200:19.0:1773851894.946414:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851894.946416:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851894.946417:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c7543625 refcount 2 to 11601@kfi7
00010000:00000001:19.0:1773851894.946418:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851894.946418:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851894.946419:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851894.946419:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001c48d1f1 x1859580954280128/t0(0) o17->7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb@11601@kfi7:146/0 lens 456/432 e 0 to 0 dl 1773852261 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1218-0'
00000100:00100000:19.0:1773851894.946422:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001c48d1f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7efd6f9e-31d2-4fc1-a1de-2a56a5f864eb+777:39634:x1859580954280128:12345-11601@kfi7:17:default-tuolumne1218-0 Request processed in 63us (92us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851894.946425:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11601@kfi7, seq: 323103294
00000100:00000040:19.0:1773851894.946425:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b8efabcf : new rpc_count 9
00000100:00000001:19.0:1773851894.946426:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851894.946426:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851894.946427:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000800:00000200:17.0:1773851894.946427:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851894.946428:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d9c254e.
00000020:00000010:19.0:1773851894.946429:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a73103fc.
00000020:00000040:19.0:1773851894.946429:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000b8efabcf : new refcount 776
00000400:00000200:17.0:1773851894.946429:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851894.946430:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851894.946430:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11600@kfi7: PUT: OK
00000400:00000200:17.0:1773851894.946431:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2381311
00000400:00000010:17.0:1773851894.946432:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2381311.
00000100:00000001:17.0:1773851894.946433:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851894.946433:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851894.946434:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000228d35a5 nid 11600@kfi7 refs 2
00000800:00000200:17.0:1773851894.946435:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 11600@kfi7(00000000555ec46a):0x0 lsk 118 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x75 Transaction freed
00000800:00000200:14.0:1773851894.956810:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851894.956811:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851894.956812:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851894.956815:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851894.956817:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16689@kfi7 to cpt 3
00000400:00000200:14.0:1773851894.956818:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16689@kfi7 : PUT - for me
00000400:00000200:14.0:1773851894.956819:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16689@kfi7 to cpt 3
00000400:00000200:14.0:1773851894.956821:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001392ccd9 nid 16689@kfi7 refs 1
00000400:00000200:14.0:1773851894.956822:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16689@kfi7 to cpt 3
00000400:00000200:14.0:1773851894.956823:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001392ccd9 nid 16689@kfi7 refs 2
00000400:00000200:14.0:1773851894.956824:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001392ccd9 nid 16689@kfi7 refs 3
00000400:00000200:14.0:1773851894.956825:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16880@kfi7 to cpt 2
00000400:00000200:14.0:1773851894.956826:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16880@kfi7 of length 224 into portal 12 MB=0x69b4b54d1ef40
00000400:00000200:14.0:1773851894.956828:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16880@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 54960
00000800:00000200:14.0:1773851894.956830:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851894.956832:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851894.956833:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16689@kfi7: PUT: OK
00000100:00000001:14.0:1773851894.956834:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851894.956835:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851894.956836:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000043e42d0c.
00000100:00000040:14.0:1773851894.956836:0:2514739:0:(events.c:358:request_in_callback()) incoming req@0000000043e42d0c x1859597708160832 msgsize 224
00000100:00100000:14.0:1773851894.956838:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-16880@kfi7 (source: 12345-16689@kfi7)
00000100:00000001:14.0:1773851894.956840:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851894.956841:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001392ccd9 nid 16689@kfi7 refs 2
00000100:00000001:15.0:1773851894.956842:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851894.956842:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851894.956842:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851894.956843:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851894.956844:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851894.956845:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851894.956845:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597708160832
00000020:00000001:15.0:1773851894.956846:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851894.956847:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7f80d
00000020:00000001:15.0:1773851894.956848:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851894.956852:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b7f650e0 refcount=5
00000020:00000001:15.0:1773851894.956853:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077500896256 : -106996208655360 : ffff9eb000fda400)
00000020:00000001:15.0:1773851894.956854:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637077500896256 : -106996208655360 : ffff9eb000fda400)
00000100:00000001:15.0:1773851894.956855:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851894.956856:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851894.956857:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000057e36ed.
00000020:00000010:15.0:1773851894.956858:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851894.956859:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851894.956861:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851894.956861:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851894.956862:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851894.956863:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851894.956863:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851894.956864:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.956865:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851894.956866:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851894.956866:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851894.956867:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851894.956867:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851894.956868:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16880@kfi7, seq: 2289923
00000100:00000040:15.0:1773851894.956869:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b7f650e0 : new rpc_count 1
00000100:00000001:15.0:1773851894.956869:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637097085031808 : -106976624519808 : ffff9eb4904bd580)
00000100:00000001:12.0:1773851894.956869:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851894.956869:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851894.956871:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000043e42d0c x1859597708160832/t0(0) o400->12434a32-aa4c-402e-bce3-3faaff6e6a14@16880@kfi7:621/0 lens 224/0 e 0 to 0 dl 1773851981 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1533-0'
00000100:00000001:15.0:1773851894.956874:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851894.956875:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851894.956875:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000043e42d0c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:12434a32-aa4c-402e-bce3-3faaff6e6a14+5:39580:x1859597708160832:12345-16880@kfi7:400:default-tuolumne1533-0
00000100:00000200:15.0:1773851894.956877:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597708160832
00000020:00000001:15.0:1773851894.956878:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851894.956878:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851894.956879:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851894.956880:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851894.956881:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851894.956881:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851894.956882:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597708160832, found 0 last_xid 1859597708160831
00000020:00000001:15.0:1773851894.956883:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851894.956884:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851894.956885:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851894.956885:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851894.956886:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851894.956887:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851894.956887:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851894.956888:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000aa96597.
02000000:00000001:15.0:1773851894.956889:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.956890:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851894.956890:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851894.956891:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044163942, transno 0, xid 1859597708160832
00010000:00000001:15.0:1773851894.956892:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851894.956893:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000043e42d0c x1859597708160832/t0(0) o400->12434a32-aa4c-402e-bce3-3faaff6e6a14@16880@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1533-0'
00010000:00000001:15.0:1773851894.956896:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851894.956896:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851894.956897:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=127 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851894.956898:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851894.956899:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fa967dc4 refcount 3 to 16880@kfi7
00000100:00000001:15.0:1773851894.956900:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133696 : -107146658417920 : ffff9e8cf97c7300)
02000000:00000001:15.0:1773851894.956901:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851894.956901:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851894.956902:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851894.956903:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16689@kfi7
00000400:00000010:15.0:1773851894.956904:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039cd6bfe.
00000100:00000200:15.0:1773851894.956905:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597708160832, offset 224
00000400:00000200:15.0:1773851894.956906:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16689@kfi7
00000400:00000200:15.0:1773851894.956907:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16689@kfi7 to cpt 3
00000400:00000200:15.0:1773851894.956908:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001392ccd9 nid 16689@kfi7 refs 1
00000400:00000200:15.0:1773851894.956909:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001392ccd9 nid 16689@kfi7 refs 2
00000400:00000200:15.0:1773851894.956910:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001392ccd9 nid 16689@kfi7 refs 3
00000400:00000200:15.0:1773851894.956911:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16689@kfi7 local destination
00000400:00000200:15.0:1773851894.956913:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770166:8770166:1024:4294967295] 16689@kfi7 LPNI seq info [7998753:7998753:16:4294967295]
00000400:00000200:15.0:1773851894.956916:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001392ccd9 nid 16689@kfi7 refs 2
00000400:00000200:15.0:1773851894.956916:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16689@kfi7 to cpt 3
00000400:00000200:15.0:1773851894.956919:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16689@kfi7(16689@kfi7:16689@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851894.956920:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001392ccd9 nid 16689@kfi7 refs 3
00000800:00000200:15.0:1773851894.956921:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851894.956923:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851894.956925:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851894.956928:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11da Using peer 16689@kfi7(0x11da)
00000800:00000200:15.0:1773851894.956931:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 324 bytes to peer 0x11da: rc=0
00000800:00000200:15.0:1773851894.956933:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11da TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851894.956935:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851894.956936:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fa967dc4 refcount 2 to 16880@kfi7
00010000:00000001:15.0:1773851894.956936:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851894.956937:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851894.956938:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851894.956939:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000043e42d0c x1859597708160832/t0(0) o400->12434a32-aa4c-402e-bce3-3faaff6e6a14@16880@kfi7:621/0 lens 224/224 e 0 to 0 dl 1773851981 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1533-0'
00000100:00100000:15.0:1773851894.956942:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000043e42d0c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:12434a32-aa4c-402e-bce3-3faaff6e6a14+5:39580:x1859597708160832:12345-16880@kfi7:400:default-tuolumne1533-0 Request processed in 67us (105us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851894.956944:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16880@kfi7, seq: 2289923
00000100:00000040:15.0:1773851894.956945:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b7f650e0 : new rpc_count 0
00000800:00000200:13.0:1773851894.956945:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11da TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851894.956946:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851894.956947:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851894.956947:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851894.956947:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851894.956948:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000400:00000200:13.0:1773851894.956948:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16689@kfi7: PUT: OK
00000020:00000010:15.0:1773851894.956949:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000057e36ed.
00000400:00000200:13.0:1773851894.956949:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039cd6bfe
00000400:00000010:13.0:1773851894.956950:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039cd6bfe.
00000100:00000001:13.0:1773851894.956950:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:15.0:1773851894.956951:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000b7f650e0 : new refcount 4
00000100:00000001:15.0:1773851894.956951:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851894.956951:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851894.956952:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001392ccd9 nid 16689@kfi7 refs 2
00000800:00000200:13.0:1773851894.956953:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2069@kfi7:3 -> 16689@kfi7(0000000009870005):0x0 lsk 4571 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x11da Transaction freed
00000800:00000200:13.0:1773851895.019278:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.019279:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851895.019279:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851895.019281:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851895.019283:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.019284:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23441@kfi7 : PUT - for me
00000400:00000200:13.0:1773851895.019284:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.019285:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 1
00000400:00000200:13.0:1773851895.019287:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.019287:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000400:00000200:13.0:1773851895.019289:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 3
00000400:00000200:13.0:1773851895.019290:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23376@kfi7 to cpt 4
00000400:00000200:13.0:1773851895.019290:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23376@kfi7 of length 224 into portal 12 MB=0x69b4685a87740
00000400:00000200:13.0:1773851895.019291:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23376@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 55184
00000800:00000200:13.0:1773851895.019293:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851895.019294:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851895.019295:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23441@kfi7: PUT: OK
00000100:00000001:13.0:1773851895.019296:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851895.019296:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851895.019297:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eed60e26.
00000100:00000040:13.0:1773851895.019297:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000eed60e26 x1859577052690240 msgsize 224
00000100:00100000:13.0:1773851895.019299:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-23376@kfi7 (source: 12345-23441@kfi7)
00000100:00000001:13.0:1773851895.019300:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851895.019300:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000100:00000001:15.0:1773851895.019301:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851895.019301:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851895.019301:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851895.019302:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851895.019302:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851895.019303:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851895.019303:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859577052690240
00000020:00000001:15.0:1773851895.019304:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.019304:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc30c4be3
00000020:00000001:15.0:1773851895.019305:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.019308:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000de198f0 refcount=5
00000020:00000001:15.0:1773851895.019309:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134069762048 : -106939639789568 : ffff9ebd2cc20800)
00000020:00000001:15.0:1773851895.019309:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134069762048 : -106939639789568 : ffff9ebd2cc20800)
00000100:00000001:15.0:1773851895.019310:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.019311:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.019311:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000057e36ed.
00000020:00000010:15.0:1773851895.019312:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.019312:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.019313:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.019313:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.019314:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.019314:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851895.019315:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851895.019315:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.019316:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.019317:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.019317:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.019317:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851895.019318:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23376@kfi7, seq: 2289924
00000100:00000001:12.0:1773851895.019318:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851895.019319:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000de198f0 : new rpc_count 1
00000100:00000001:15.0:1773851895.019319:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636935733960320 : -107137975591296 : ffff9e8eff05de80)
00000100:00000001:12.0:1773851895.019319:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851895.019319:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.019320:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eed60e26 x1859577052690240/t0(0) o400->5736ac83-ccd2-4b57-95fa-2fc26c0acc04@23376@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1954-0'
00000100:00000001:15.0:1773851895.019323:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.019324:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.019324:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eed60e26 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:5736ac83-ccd2-4b57-95fa-2fc26c0acc04+5:39685:x1859577052690240:12345-23376@kfi7:400:default-tuolumne1954-0
00000100:00000200:15.0:1773851895.019326:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859577052690240
00000020:00000001:15.0:1773851895.019326:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.019327:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.019327:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.019328:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.019328:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851895.019329:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.019329:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859577052690240, found 0 last_xid 1859577052690239
00000020:00000001:15.0:1773851895.019330:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.019330:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.019331:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.019331:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.019332:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851895.019332:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.019332:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.019333:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000064085ccb.
02000000:00000001:15.0:1773851895.019334:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.019334:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.019335:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.019335:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044159089, transno 0, xid 1859577052690240
00010000:00000001:15.0:1773851895.019336:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.019337:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eed60e26 x1859577052690240/t0(0) o400->5736ac83-ccd2-4b57-95fa-2fc26c0acc04@23376@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1954-0'
00010000:00000001:15.0:1773851895.019339:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.019339:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.019340:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.019341:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.019341:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000079e18a6f refcount 3 to 23376@kfi7
00000100:00000001:15.0:1773851895.019342:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363995392 : -107142345556224 : ffff9e8dfa8d7f00)
02000000:00000001:15.0:1773851895.019343:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.019343:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.019344:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.019344:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23441@kfi7
00000400:00000010:15.0:1773851895.019345:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001650250b.
00000100:00000200:15.0:1773851895.019346:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859577052690240, offset 224
00000400:00000200:15.0:1773851895.019347:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23441@kfi7
00000400:00000200:15.0:1773851895.019348:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.019349:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 1
00000400:00000200:15.0:1773851895.019350:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000400:00000200:15.0:1773851895.019351:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 3
00000400:00000200:15.0:1773851895.019352:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23441@kfi7 local destination
00000400:00000200:15.0:1773851895.019353:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770167:8770167:1024:4294967295] 23441@kfi7 LPNI seq info [21811744:21811744:16:4294967295]
00000400:00000200:15.0:1773851895.019354:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000400:00000200:15.0:1773851895.019355:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.019357:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23441@kfi7(23441@kfi7:23441@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.019358:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 3
00000800:00000200:15.0:1773851895.019359:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.019360:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851895.019361:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.019363:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe39 Using peer 23441@kfi7(0xe39)
00000800:00000200:15.0:1773851895.019366:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 324 bytes to peer 0xe39: rc=0
00000800:00000200:15.0:1773851895.019367:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe39 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.019369:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.019369:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000079e18a6f refcount 2 to 23376@kfi7
00010000:00000001:15.0:1773851895.019370:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.019370:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.019371:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.019371:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eed60e26 x1859577052690240/t0(0) o400->5736ac83-ccd2-4b57-95fa-2fc26c0acc04@23376@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1954-0'
00000100:00100000:15.0:1773851895.019374:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eed60e26 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:5736ac83-ccd2-4b57-95fa-2fc26c0acc04+5:39685:x1859577052690240:12345-23376@kfi7:400:default-tuolumne1954-0 Request processed in 51us (76us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851895.019376:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23376@kfi7, seq: 2289924
00000100:00000040:15.0:1773851895.019377:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000de198f0 : new rpc_count 0
00000100:00000001:15.0:1773851895.019377:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851895.019378:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851895.019378:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.019379:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000800:00000200:13.0:1773851895.019379:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe39 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851895.019380:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000057e36ed.
00000020:00000040:15.0:1773851895.019380:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000000de198f0 : new refcount 4
00000100:00000001:15.0:1773851895.019381:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851895.019381:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851895.019381:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23441@kfi7: PUT: OK
00000400:00000200:13.0:1773851895.019382:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001650250b
00000400:00000010:13.0:1773851895.019382:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001650250b.
00000100:00000001:13.0:1773851895.019383:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851895.019383:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851895.019384:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000800:00000200:13.0:1773851895.019385:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2069@kfi7:3 -> 23441@kfi7(0000000006a13bd4):0x0 lsk 3642 rsk 26 tsk 0 trmk 0 tmk 0 trr 3 tta 0xe39 Transaction freed
00000800:00000200:22.0:1773851895.032472:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851895.032472:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851895.032473:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851895.032473:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851895.032475:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851895.032475:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851895.032476:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11985@kfi7(0000000069af517a):0x12f version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851895.032477:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851895.032478:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11985@kfi7 to cpt 5
00000800:00000200:21.0:1773851895.032478:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f Using peer 11985@kfi7(0x12f)
00000400:00000200:22.0:1773851895.032479:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11985@kfi7 : PUT - for me
00000400:00000200:21.0:1773851895.032480:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11985@kfi7 to cpt 5
00000400:00000200:22.0:1773851895.032481:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11985@kfi7 to cpt 5
00000400:00000200:22.0:1773851895.032482:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2811733 nid 11985@kfi7 refs 1
00000800:00000200:21.0:1773851895.032482:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0x12f: rc=0
00000400:00000200:22.0:1773851895.032483:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11985@kfi7 to cpt 5
00000400:00000200:22.0:1773851895.032483:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2811733 nid 11985@kfi7 refs 2
00000800:00000200:21.0:1773851895.032483:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851895.032484:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a2811733 nid 11985@kfi7 refs 3
00000400:00000200:22.0:1773851895.032485:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11792@kfi7 to cpt 7
00000400:00000200:22.0:1773851895.032486:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11792@kfi7 of length 456 into portal 12 MB=0x69b4c3ade61c0
00000400:00000200:22.0:1773851895.032487:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11792@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 62992
00000800:00000200:22.0:1773851895.032489:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851895.032490:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851895.032491:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11985@kfi7: PUT: OK
00000100:00000001:22.0:1773851895.032492:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851895.032492:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851895.032493:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000714eda6.
00000100:00000040:22.0:1773851895.032494:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000000714eda6 x1859601567736256 msgsize 456
00000100:00100000:22.0:1773851895.032495:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-11792@kfi7 (source: 12345-11985@kfi7)
00000100:00000001:22.0:1773851895.032496:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:21.0:1773851895.032496:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851895.032497:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2811733 nid 11985@kfi7 refs 2
00000800:00000200:21.0:1773851895.032498:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f Transaction freed
00000100:00000001:20.0:1773851895.032498:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851895.032498:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851895.032499:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851895.032499:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851895.032499:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851895.032500:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851895.032501:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601567736256
00000020:00000001:20.0:1773851895.032502:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851895.032502:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7ed57
00000020:00000001:20.0:1773851895.032503:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851895.032506:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000367174e4 refcount=5
00000020:00000001:20.0:1773851895.032507:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098251043840 : -106975458507776 : ffff9eb4d5cbc400)
00000020:00000001:20.0:1773851895.032508:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098251043840 : -106975458507776 : ffff9eb4d5cbc400)
00000100:00000001:20.0:1773851895.032509:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.032511:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851895.032511:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851895.032512:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.032513:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851895.032514:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851895.032514:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851895.032515:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.032516:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.032517:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851895.032518:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851895.032518:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851895.032519:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851895.032519:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851895.032520:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11792@kfi7, seq: 335333153
00000100:00000001:23.0:1773851895.032521:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.032521:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000367174e4 : new rpc_count 1
00000100:00000001:23.0:1773851895.032522:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.032522:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382175104 : -106946327376512 : ffff9ebb9e258d80)
00000100:00000040:20.0:1773851895.032523:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000714eda6 x1859601567736256/t0(0) o17->d1947575-a800-4ee0-8cf0-50468cd8fe58@11792@kfi7:622/0 lens 456/0 e 0 to 0 dl 1773851982 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1233-0'
00000100:00000001:20.0:1773851895.032526:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.032526:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851895.032527:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000714eda6 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:d1947575-a800-4ee0-8cf0-50468cd8fe58+5:39470:x1859601567736256:12345-11792@kfi7:17:default-tuolumne1233-0
00000100:00000200:20.0:1773851895.032529:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601567736256
00000020:00000001:20.0:1773851895.032529:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851895.032530:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851895.032531:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.032531:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851895.032532:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:20.0:1773851895.032533:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851895.032533:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601567736256, found 0 last_xid 1859601567736255
00000020:00000001:20.0:1773851895.032534:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851895.032536:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851895.032536:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851895.032537:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851895.032537:0:60934:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:20.0:1773851895.032538:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851895.032539:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851895.032540:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000010a14be4.
02000000:00000001:20.0:1773851895.032541:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.032542:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.032542:0:60934:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:20.0:1773851895.032543:0:60934:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:20.0:1773851895.032544:0:60934:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:20.0:1773851895.032545:0:60934:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.032545:0:60934:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:20.0:1773851895.032546:0:60934:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli d1947575-a800-4ee0-8cf0-50468cd8fe58/00000000367174e4 free: 126633370845184 avail: 126633368748032
00000020:00000001:20.0:1773851895.032547:0:60934:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:20.0:1773851895.032548:0:60934:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli d1947575-a800-4ee0-8cf0-50468cd8fe58/00000000367174e4 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:20.0:1773851895.032549:0:60934:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:20.0:1773851895.032550:0:60934:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:20.0:1773851895.032551:0:60934:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli d1947575-a800-4ee0-8cf0-50468cd8fe58/00000000367174e4 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:20.0:1773851895.032552:0:60934:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:20.0:1773851895.032552:0:60934:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:20.0:1773851895.032553:0:60934:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851895.032554:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690944142, transno 0, xid 1859601567736256
00010000:00000001:20.0:1773851895.032555:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851895.032555:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000714eda6 x1859601567736256/t0(0) o17->d1947575-a800-4ee0-8cf0-50468cd8fe58@11792@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1233-0'
00010000:00000001:20.0:1773851895.032558:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851895.032558:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851895.032559:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=128 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851895.032560:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851895.032561:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000001cd29e7 refcount 3 to 11792@kfi7
00000100:00000001:20.0:1773851895.032562:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064416 : -107155994487200 : ffff9e8acd035660)
02000000:00000001:20.0:1773851895.032563:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851895.032563:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.032564:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851895.032565:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11985@kfi7
00000400:00000010:20.0:1773851895.032565:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6c83aab.
00000100:00000200:20.0:1773851895.032566:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859601567736256, offset 224
00000400:00000200:20.0:1773851895.032567:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11985@kfi7
00000400:00000200:20.0:1773851895.032568:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11985@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.032569:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a2811733 nid 11985@kfi7 refs 1
00000400:00000200:20.0:1773851895.032570:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a2811733 nid 11985@kfi7 refs 2
00000400:00000200:20.0:1773851895.032572:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a2811733 nid 11985@kfi7 refs 3
00000400:00000200:20.0:1773851895.032573:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11985@kfi7 local destination
00000400:00000200:20.0:1773851895.032574:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770168:8770168:1024:4294967295] 11985@kfi7 LPNI seq info [206040:206040:16:4294967295]
00000400:00000200:20.0:1773851895.032575:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a2811733 nid 11985@kfi7 refs 2
00000400:00000200:20.0:1773851895.032576:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11985@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.032578:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11985@kfi7(11985@kfi7:11985@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851895.032579:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a2811733 nid 11985@kfi7 refs 3
00000800:00000200:20.0:1773851895.032580:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851895.032581:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:20.0:1773851895.032584:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851895.032586:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f Using peer 11985@kfi7(0x12f)
00000800:00000200:20.0:1773851895.032589:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 532 bytes to peer 0x12f: rc=0
00000800:00000200:20.0:1773851895.032590:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851895.032592:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.032593:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000001cd29e7 refcount 2 to 11792@kfi7
00010000:00000001:20.0:1773851895.032594:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851895.032595:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.032596:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851895.032598:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000714eda6 x1859601567736256/t0(0) o17->d1947575-a800-4ee0-8cf0-50468cd8fe58@11792@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1233-0'
00000100:00100000:20.0:1773851895.032601:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000714eda6 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:d1947575-a800-4ee0-8cf0-50468cd8fe58+5:39470:x1859601567736256:12345-11792@kfi7:17:default-tuolumne1233-0 Request processed in 74us (106us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851895.032604:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11792@kfi7, seq: 335333153
00000100:00000040:20.0:1773851895.032604:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000367174e4 : new rpc_count 0
00000100:00000001:20.0:1773851895.032605:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851895.032606:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851895.032606:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.032607:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851895.032608:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851895.032609:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000367174e4 : new refcount 4
00000100:00000001:20.0:1773851895.032609:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851895.032614:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851895.032615:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851895.032616:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11985@kfi7: PUT: OK
00000400:00000200:21.0:1773851895.032617:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6c83aab
00000400:00000010:21.0:1773851895.032618:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6c83aab.
00000100:00000001:21.0:1773851895.032618:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851895.032619:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851895.032620:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a2811733 nid 11985@kfi7 refs 2
00000800:00000200:21.0:1773851895.032621:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 11985@kfi7(0000000069af517a):0x0 lsk 304 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x12f Transaction freed
00000800:00000200:29.0:1773851895.037668:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851895.037670:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.037672:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851895.037675:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851895.037678:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.037680:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21746@kfi7 : PUT - for me
00000400:00000200:29.0:1773851895.037682:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.037684:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:29.0:1773851895.037686:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.037687:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:29.0:1773851895.037689:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:29.0:1773851895.037690:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21747@kfi7 to cpt 3
00000400:00000200:29.0:1773851895.037692:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21747@kfi7 of length 456 into portal 12 MB=0x69b0a32ab3400
00000400:00000200:29.0:1773851895.037694:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21747@kfi7 of length 456/456 into md 0x77fe1859d [64] + 6792
00000800:00000200:29.0:1773851895.037697:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851895.037700:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.037702:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21746@kfi7: PUT: OK
00000100:00000001:29.0:1773851895.037703:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851895.037704:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851895.037705:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000064cb65c2.
00000100:00000040:29.0:1773851895.037706:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000064cb65c2 x1859317962322944 msgsize 456
00000100:00100000:29.0:1773851895.037708:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21747@kfi7 (source: 12345-21746@kfi7)
00000100:00000001:29.0:1773851895.037710:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851895.037711:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000100:00000001:30.0:1773851895.037713:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851895.037714:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851895.037714:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851895.037715:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851895.037716:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851895.037717:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851895.037719:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317962322944
00000020:00000001:30.0:1773851895.037720:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851895.037721:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92673
00000020:00000001:30.0:1773851895.037722:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851895.037729:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000060c5b0bb refcount=3988
00000020:00000001:30.0:1773851895.037730:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631019520 : -107123078532096 : ffff9e9276f4f400)
00000020:00000001:30.0:1773851895.037732:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631019520 : -107123078532096 : ffff9e9276f4f400)
00000100:00000001:30.0:1773851895.037733:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851895.037734:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851895.037736:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ed3b313.
00000020:00000010:30.0:1773851895.037737:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851895.037738:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000818b6cb1.
00000100:00000001:30.0:1773851895.037740:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851895.037741:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851895.037742:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.037743:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.037745:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.037748:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851895.037748:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851895.037749:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851895.037749:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851895.037751:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21747@kfi7, seq: 364304987
00000100:00000040:31.0:1773851895.037752:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000060c5b0bb : new rpc_count 15
00000100:00000001:30.0:1773851895.037752:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.037753:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262224768 : -106943447326848 : ffff9ebc49cf9f80)
00000100:00000001:30.0:1773851895.037753:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.037756:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000064cb65c2 x1859317962322944/t0(0) o17->95e70f61-2824-45d5-9988-29f0ada81397@21747@kfi7:683/0 lens 456/0 e 0 to 0 dl 1773852043 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1833-0'
00000100:00000001:31.0:1773851895.037761:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.037761:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851895.037763:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000064cb65c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:95e70f61-2824-45d5-9988-29f0ada81397+3988:39900:x1859317962322944:12345-21747@kfi7:17:default-tuolumne1833-0
00000100:00000200:31.0:1773851895.037765:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317962322944
00000020:00000001:31.0:1773851895.037766:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851895.037767:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851895.037769:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.037770:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851895.037771:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:31.0:1773851895.037772:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851895.037773:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317962322944, found 0 last_xid 1859317960987775
00000020:00000001:31.0:1773851895.037774:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851895.037776:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851895.037776:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851895.037777:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851895.037779:0:60677:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:31.0:1773851895.037780:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851895.037781:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851895.037782:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000409ff7c5.
02000000:00000001:31.0:1773851895.037783:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.037784:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.037786:0:60677:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:31.0:1773851895.037787:0:60677:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:31.0:1773851895.037788:0:60677:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851895.037790:0:60677:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.037791:0:60677:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:31.0:1773851895.037792:0:60677:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 95e70f61-2824-45d5-9988-29f0ada81397/0000000060c5b0bb free: 126633370845184 avail: 126633368748032
00000020:00000001:31.0:1773851895.037794:0:60677:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:31.0:1773851895.037795:0:60677:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 95e70f61-2824-45d5-9988-29f0ada81397/0000000060c5b0bb avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:31.0:1773851895.037797:0:60677:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:31.0:1773851895.037799:0:60677:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:31.0:1773851895.037800:0:60677:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 95e70f61-2824-45d5-9988-29f0ada81397/0000000060c5b0bb reports grant 1788346367 dropped 0, local 1882456063
00000020:00000001:31.0:1773851895.037802:0:60677:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:31.0:1773851895.037803:0:60677:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:31.0:1773851895.037803:0:60677:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851895.037805:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593573, transno 0, xid 1859317962322944
00010000:00000001:31.0:1773851895.037806:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851895.037807:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000064cb65c2 x1859317962322944/t0(0) o17->95e70f61-2824-45d5-9988-29f0ada81397@21747@kfi7:683/0 lens 456/432 e 0 to 0 dl 1773852043 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1833-0'
00010000:00000001:31.0:1773851895.037811:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851895.037812:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851895.037814:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=128 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851895.037815:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851895.037816:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6c586e9 refcount 5 to 21747@kfi7
00000100:00000001:31.0:1773851895.037818:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154816 : -107139310396800 : ffff9e8eaf765a80)
02000000:00000001:31.0:1773851895.037819:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851895.037820:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.037821:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851895.037823:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21746@kfi7
00000400:00000010:31.0:1773851895.037824:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000811703b3.
00000100:00000200:31.0:1773851895.037825:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859317962322944, offset 224
00000400:00000200:31.0:1773851895.037828:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21746@kfi7
00000400:00000200:31.0:1773851895.037829:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.037830:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:31.0:1773851895.037832:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:31.0:1773851895.037834:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:31.0:1773851895.037836:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21746@kfi7 local destination
00000400:00000200:31.0:1773851895.037838:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770169:8770169:1024:4294967295] 21746@kfi7 LPNI seq info [5226828:5226828:16:4294967295]
00000400:00000200:31.0:1773851895.037840:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:31.0:1773851895.037841:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.037845:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21746@kfi7(21746@kfi7:21746@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851895.037847:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000800:00000200:31.0:1773851895.037849:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851895.037851:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:31.0:1773851895.037855:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851895.037858:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 Using peer 21746@kfi7(0x100000000000017)
00000800:00000200:31.0:1773851895.037863:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 532 bytes to peer 0x100000000000017: rc=0
00000800:00000200:31.0:1773851895.037865:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851895.037868:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.037870:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6c586e9 refcount 4 to 21747@kfi7
00010000:00000001:31.0:1773851895.037871:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851895.037872:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.037873:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851895.037874:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000064cb65c2 x1859317962322944/t0(0) o17->95e70f61-2824-45d5-9988-29f0ada81397@21747@kfi7:683/0 lens 456/432 e 0 to 0 dl 1773852043 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1833-0'
00000800:00000200:29.0:1773851895.037879:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851895.037883:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000064cb65c2 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:95e70f61-2824-45d5-9988-29f0ada81397+3988:39900:x1859317962322944:12345-21747@kfi7:17:default-tuolumne1833-0 Request processed in 122us (176us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851895.037883:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.037885:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21746@kfi7: PUT: OK
00000400:00000200:29.0:1773851895.037886:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000811703b3
00000100:00100000:31.0:1773851895.037887:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21747@kfi7, seq: 364304987
00000400:00000010:29.0:1773851895.037887:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000811703b3.
00000100:00000001:29.0:1773851895.037888:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000040:31.0:1773851895.037889:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000060c5b0bb : new rpc_count 14
00000100:00000001:29.0:1773851895.037889:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851895.037890:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851895.037890:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000100:00000001:31.0:1773851895.037891:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851895.037891:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000800:00000200:29.0:1773851895.037892:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 21746@kfi7(000000008ae08ec8):0x0 lsk 24 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000017 Transaction freed
00000020:00000010:31.0:1773851895.037893:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000818b6cb1.
00000020:00000010:31.0:1773851895.037894:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ed3b313.
00000020:00000040:31.0:1773851895.037895:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000060c5b0bb : new refcount 3987
00000100:00000001:31.0:1773851895.037896:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851895.050134:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851895.050135:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851895.050136:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851895.050138:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851895.050140:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20096@kfi7 to cpt 6
00000400:00000200:25.0:1773851895.050141:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20096@kfi7 : PUT - for me
00000400:00000200:25.0:1773851895.050142:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20096@kfi7 to cpt 6
00000400:00000200:25.0:1773851895.050142:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018165226 nid 20096@kfi7 refs 1
00000400:00000200:25.0:1773851895.050143:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20096@kfi7 to cpt 6
00000400:00000200:25.0:1773851895.050144:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018165226 nid 20096@kfi7 refs 2
00000400:00000200:25.0:1773851895.050145:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018165226 nid 20096@kfi7 refs 3
00000400:00000200:25.0:1773851895.050146:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20033@kfi7 to cpt 5
00000400:00000200:25.0:1773851895.050147:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20033@kfi7 of length 224 into portal 12 MB=0x69b097d699380
00000400:00000200:25.0:1773851895.050148:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20033@kfi7 of length 224/224 into md 0x16159c9699 [64] + 36856
00000800:00000200:25.0:1773851895.050150:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851895.050152:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851895.050152:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20096@kfi7: PUT: OK
00000100:00000001:25.0:1773851895.050153:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851895.050154:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851895.050155:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000030cd578a.
00000100:00000040:25.0:1773851895.050155:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000030cd578a x1859314921345920 msgsize 224
00000100:00100000:25.0:1773851895.050157:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20033@kfi7 (source: 12345-20096@kfi7)
00000100:00000001:25.0:1773851895.050158:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851895.050159:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018165226 nid 20096@kfi7 refs 2
00000800:00000200:25.0:1773851895.050160:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851895.050161:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851895.050162:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851895.050163:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851895.050163:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851895.050165:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851895.050166:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314921345920
00000020:00000001:24.0:1773851895.050167:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851895.050168:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bdd
00000020:00000001:24.0:1773851895.050169:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851895.050172:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003d102bdf refcount=6
00000020:00000001:24.0:1773851895.050173:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743928832 : -107128965622784 : ffff9e91180f1400)
00000020:00000001:24.0:1773851895.050174:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743928832 : -107128965622784 : ffff9e91180f1400)
00000100:00000001:24.0:1773851895.050176:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851895.050177:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851895.050178:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851895.050180:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851895.050181:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e24711f.
00000100:00000001:24.0:1773851895.050183:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851895.050183:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851895.050184:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851895.050186:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851895.050187:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851895.050188:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851895.050189:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851895.050191:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851895.050191:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851895.050192:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20033@kfi7, seq: 2025174
00000100:00000001:24.0:1773851895.050192:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:27.0:1773851895.050193:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003d102bdf : new rpc_count 1
00000100:00000001:24.0:1773851895.050193:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851895.050193:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.050194:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780430336 : -106994929121280 : ffff9eb04d41c800)
00000100:00000001:24.0:1773851895.050194:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.050195:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000030cd578a x1859314921345920/t0(0) o400->30813568-cab8-4089-bf98-03a8ffd4d0ce@20033@kfi7:145/0 lens 224/0 e 0 to 0 dl 1773852260 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1748-0'
00000100:00000001:27.0:1773851895.050197:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851895.050198:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851895.050199:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030cd578a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:30813568-cab8-4089-bf98-03a8ffd4d0ce+6:39626:x1859314921345920:12345-20033@kfi7:400:default-tuolumne1748-0
00000100:00000200:27.0:1773851895.050200:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314921345920
00000020:00000001:27.0:1773851895.050201:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851895.050201:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851895.050202:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.050203:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851895.050203:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851895.050204:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851895.050205:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314921345920, found 0 last_xid 1859314921345919
00000020:00000001:27.0:1773851895.050205:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851895.050206:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851895.050206:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851895.050207:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.050208:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851895.050209:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851895.050209:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851895.050210:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009d10f841.
02000000:00000001:27.0:1773851895.050211:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.050211:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.050212:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851895.050213:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096680660, transno 0, xid 1859314921345920
00010000:00000001:27.0:1773851895.050213:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851895.050214:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000030cd578a x1859314921345920/t0(0) o400->30813568-cab8-4089-bf98-03a8ffd4d0ce@20033@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1748-0'
00010000:00000001:27.0:1773851895.050216:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851895.050217:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851895.050218:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=128 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851895.050219:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851895.050219:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f989add0 refcount 3 to 20033@kfi7
00000100:00000001:27.0:1773851895.050220:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096800 : -107139307454816 : ffff9e8eafa33ea0)
02000000:00000001:27.0:1773851895.050221:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851895.050221:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.050222:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851895.050223:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20096@kfi7
00000400:00000010:27.0:1773851895.050223:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cea3c950.
00000100:00000200:27.0:1773851895.050224:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314921345920, offset 224
00000400:00000200:27.0:1773851895.050226:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20096@kfi7
00000400:00000200:27.0:1773851895.050226:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20096@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.050227:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018165226 nid 20096@kfi7 refs 1
00000400:00000200:27.0:1773851895.050228:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018165226 nid 20096@kfi7 refs 2
00000400:00000200:27.0:1773851895.050229:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018165226 nid 20096@kfi7 refs 3
00000400:00000200:27.0:1773851895.050230:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20096@kfi7 local destination
00000400:00000200:27.0:1773851895.050231:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770170:8770170:1024:4294967295] 20096@kfi7 LPNI seq info [6511217:6511217:16:4294967295]
00000400:00000200:27.0:1773851895.050233:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018165226 nid 20096@kfi7 refs 2
00000400:00000200:27.0:1773851895.050233:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20096@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.050235:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20096@kfi7(20096@kfi7:20096@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851895.050237:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018165226 nid 20096@kfi7 refs 3
00000800:00000200:27.0:1773851895.050238:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851895.050239:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851895.050241:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851895.050243:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1cb Using peer 20096@kfi7(0x1cb)
00000800:00000200:27.0:1773851895.050246:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x1cb: rc=0
00000800:00000200:27.0:1773851895.050248:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851895.050250:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.050251:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f989add0 refcount 2 to 20033@kfi7
00010000:00000001:27.0:1773851895.050251:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851895.050252:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.050253:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851895.050253:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000030cd578a x1859314921345920/t0(0) o400->30813568-cab8-4089-bf98-03a8ffd4d0ce@20033@kfi7:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1748-0'
00000100:00100000:27.0:1773851895.050256:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030cd578a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:30813568-cab8-4089-bf98-03a8ffd4d0ce+6:39626:x1859314921345920:12345-20033@kfi7:400:default-tuolumne1748-0 Request processed in 58us (100us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851895.050258:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20033@kfi7, seq: 2025174
00000100:00000040:27.0:1773851895.050259:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003d102bdf : new rpc_count 0
00000100:00000001:27.0:1773851895.050260:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851895.050260:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851895.050261:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000800:00000200:25.0:1773851895.050261:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1cb TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851895.050262:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e24711f.
00000020:00000010:27.0:1773851895.050263:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:27.0:1773851895.050263:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000003d102bdf : new refcount 5
00000400:00000200:25.0:1773851895.050263:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851895.050264:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851895.050264:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20096@kfi7: PUT: OK
00000400:00000200:25.0:1773851895.050265:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cea3c950
00000400:00000010:25.0:1773851895.050265:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cea3c950.
00000100:00000001:25.0:1773851895.050266:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851895.050266:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851895.050267:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018165226 nid 20096@kfi7 refs 2
00000800:00000200:25.0:1773851895.050268:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2069@kfi7:6 -> 20096@kfi7(00000000031e3e7e):0x0 lsk 460 rsk 45 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1cb Transaction freed
00000800:00000200:25.0:1773851895.093571:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851895.093572:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851895.093573:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851895.093575:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851895.093577:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19075@kfi7 to cpt 6
00000400:00000200:25.0:1773851895.093578:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19075@kfi7 : PUT - for me
00000400:00000200:25.0:1773851895.093579:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19075@kfi7 to cpt 6
00000400:00000200:25.0:1773851895.093579:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf9dd455 nid 19075@kfi7 refs 1
00000400:00000200:25.0:1773851895.093580:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19075@kfi7 to cpt 6
00000400:00000200:25.0:1773851895.093581:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf9dd455 nid 19075@kfi7 refs 2
00000400:00000200:25.0:1773851895.093582:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cf9dd455 nid 19075@kfi7 refs 3
00000400:00000200:25.0:1773851895.093583:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19075@kfi7 to cpt 6
00000400:00000200:25.0:1773851895.093583:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19075@kfi7 of length 224 into portal 12 MB=0x69b4b7cd3ca00
00000400:00000200:25.0:1773851895.093584:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19075@kfi7 of length 224/224 into md 0x16159c9699 [64] + 37080
00000800:00000200:25.0:1773851895.093586:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851895.093587:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851895.093588:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19075@kfi7: PUT: OK
00000100:00000001:25.0:1773851895.093589:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851895.093589:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851895.093590:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000052f38db3.
00000100:00000040:25.0:1773851895.093590:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000052f38db3 x1859598379371008 msgsize 224
00000100:00100000:25.0:1773851895.093591:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19075@kfi7 (source: 12345-19075@kfi7)
00000100:00000001:25.0:1773851895.093592:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851895.093593:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf9dd455 nid 19075@kfi7 refs 2
00000100:00000001:27.0:1773851895.093594:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851895.093594:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851895.093594:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851895.093596:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851895.093597:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851895.093597:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851895.093598:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598379371008
00000020:00000001:27.0:1773851895.093599:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851895.093599:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e71b58
00000020:00000001:27.0:1773851895.093599:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851895.093603:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000681d51ed refcount=5
00000020:00000001:27.0:1773851895.093604:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125516037120 : -106948193514496 : ffff9ebb2eea8c00)
00000020:00000001:27.0:1773851895.093604:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125516037120 : -106948193514496 : ffff9ebb2eea8c00)
00000100:00000001:27.0:1773851895.093605:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851895.093606:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851895.093607:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000330439b1.
00000020:00000010:27.0:1773851895.093607:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851895.093608:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009d0a58f3.
00000100:00000001:27.0:1773851895.093609:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851895.093609:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851895.093610:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851895.093611:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851895.093611:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851895.093611:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.093612:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851895.093613:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851895.093613:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851895.093614:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19075@kfi7, seq: 2025175
00000100:00000001:24.0:1773851895.093614:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851895.093614:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851895.093615:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000681d51ed : new rpc_count 1
00000100:00000001:27.0:1773851895.093615:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780438400 : -106994929113216 : ffff9eb04d41e780)
00000100:00000001:24.0:1773851895.093615:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851895.093615:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.093616:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000052f38db3 x1859598379371008/t0(0) o400->0f46b9fa-4246-43d9-888b-1f8ff3bf0f1e@19075@kfi7:683/0 lens 224/0 e 0 to 0 dl 1773852043 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1688-0'
00000100:00000001:27.0:1773851895.093619:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851895.093619:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851895.093620:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000052f38db3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:0f46b9fa-4246-43d9-888b-1f8ff3bf0f1e+5:39446:x1859598379371008:12345-19075@kfi7:400:default-tuolumne1688-0
00000100:00000200:27.0:1773851895.093621:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598379371008
00000020:00000001:27.0:1773851895.093622:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851895.093623:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851895.093623:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.093624:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851895.093624:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851895.093625:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851895.093625:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598379371008, found 0 last_xid 1859598379371007
00000020:00000001:27.0:1773851895.093626:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851895.093626:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851895.093627:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851895.093627:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.093628:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851895.093628:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851895.093629:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851895.093629:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c8f07db1.
02000000:00000001:27.0:1773851895.093630:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.093630:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.093631:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851895.093631:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182344037377, transno 0, xid 1859598379371008
00010000:00000001:27.0:1773851895.093632:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851895.093633:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000052f38db3 x1859598379371008/t0(0) o400->0f46b9fa-4246-43d9-888b-1f8ff3bf0f1e@19075@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1688-0'
00010000:00000001:27.0:1773851895.093635:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851895.093635:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851895.093636:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=128 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851895.093636:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851895.093637:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4606813 refcount 3 to 19075@kfi7
00000100:00000001:27.0:1773851895.093638:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313741600 : -107139395810016 : ffff9e8eaa5f0d20)
02000000:00000001:27.0:1773851895.093638:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851895.093639:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.093639:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851895.093640:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19075@kfi7
00000400:00000010:27.0:1773851895.093640:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c1ed4bea.
00000100:00000200:27.0:1773851895.093641:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598379371008, offset 224
00000400:00000200:27.0:1773851895.093642:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19075@kfi7
00000400:00000200:27.0:1773851895.093643:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19075@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.093644:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cf9dd455 nid 19075@kfi7 refs 1
00000400:00000200:27.0:1773851895.093644:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cf9dd455 nid 19075@kfi7 refs 2
00000400:00000200:27.0:1773851895.093645:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cf9dd455 nid 19075@kfi7 refs 3
00000400:00000200:27.0:1773851895.093646:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19075@kfi7 local destination
00000400:00000200:27.0:1773851895.093648:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770171:8770171:1024:4294967295] 19075@kfi7 LPNI seq info [14656489:14656489:16:4294967295]
00000400:00000200:27.0:1773851895.093649:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cf9dd455 nid 19075@kfi7 refs 2
00000400:00000200:27.0:1773851895.093650:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19075@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.093651:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19075@kfi7(19075@kfi7:19075@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851895.093653:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cf9dd455 nid 19075@kfi7 refs 3
00000800:00000200:27.0:1773851895.093654:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851895.093655:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851895.093656:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851895.093658:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x99e Using peer 19075@kfi7(0x99e)
00000800:00000200:27.0:1773851895.093661:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000005690846: Posted send of 324 bytes to peer 0x99e: rc=0
00000800:00000200:27.0:1773851895.093662:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x99e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851895.093664:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.093665:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4606813 refcount 2 to 19075@kfi7
00010000:00000001:27.0:1773851895.093665:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851895.093666:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.093666:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851895.093667:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000052f38db3 x1859598379371008/t0(0) o400->0f46b9fa-4246-43d9-888b-1f8ff3bf0f1e@19075@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1688-0'
00000100:00100000:27.0:1773851895.093670:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000052f38db3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:0f46b9fa-4246-43d9-888b-1f8ff3bf0f1e+5:39446:x1859598379371008:12345-19075@kfi7:400:default-tuolumne1688-0 Request processed in 50us (79us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851895.093672:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19075@kfi7, seq: 2025175
00000100:00000040:27.0:1773851895.093673:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000681d51ed : new rpc_count 0
00000100:00000001:27.0:1773851895.093673:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851895.093674:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851895.093674:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000800:00000200:25.0:1773851895.093674:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x99e TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851895.093675:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009d0a58f3.
00000020:00000010:27.0:1773851895.093675:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000330439b1.
00000400:00000200:25.0:1773851895.093675:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:27.0:1773851895.093676:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000681d51ed : new refcount 4
00000100:00000001:27.0:1773851895.093676:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851895.093676:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19075@kfi7: PUT: OK
00000400:00000200:25.0:1773851895.093677:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c1ed4bea
00000400:00000010:25.0:1773851895.093677:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c1ed4bea.
00000100:00000001:25.0:1773851895.093679:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851895.093679:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851895.093680:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cf9dd455 nid 19075@kfi7 refs 2
00000800:00000200:25.0:1773851895.093681:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 19075@kfi7(000000003b120c97):0x0 lsk 2463 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x99e Transaction freed
00000800:00000200:17.0:1773851895.111743:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851895.111744:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851895.111746:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851895.111750:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851895.111753:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.111755:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:17.0:1773851895.111757:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.111758:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:17.0:1773851895.111760:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.111761:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:17.0:1773851895.111763:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:17.0:1773851895.111764:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.111766:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 224 into portal 12 MB=0x699fe2e0ddf00
00000400:00000200:17.0:1773851895.111768:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-31@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 44112
00000800:00000200:17.0:1773851895.111771:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851895.111773:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851895.111775:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000100:00000001:17.0:1773851895.111777:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851895.111777:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851895.111778:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bb654ea1.
00000100:00000040:17.0:1773851895.111779:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bb654ea1 x1858166833667840 msgsize 224
00000100:00100000:17.0:1773851895.111782:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-31@kfi7 (source: 12345-31@kfi7)
00000100:00000001:17.0:1773851895.111784:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851895.111785:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000001:19.0:1773851895.111786:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851895.111787:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851895.111787:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851895.111788:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851895.111789:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851895.111790:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851895.111791:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858166833667840
00000020:00000001:19.0:1773851895.111792:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851895.111793:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb3223
00000020:00000001:19.0:1773851895.111794:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851895.111796:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009b1f9b2f refcount=5
00000020:00000001:19.0:1773851895.111797:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928644834304 : -107145064717312 : ffff9e8d587a6400)
00000020:00000001:19.0:1773851895.111799:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928644834304 : -107145064717312 : ffff9e8d587a6400)
00000100:00000001:19.0:1773851895.111800:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851895.111801:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851895.111802:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d118fe66.
00000020:00000010:19.0:1773851895.111804:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851895.111805:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851895.111806:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851895.111807:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851895.111808:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851895.111809:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851895.111810:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851895.111811:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851895.111812:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851895.111814:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851895.111814:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851895.111814:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851895.111814:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851895.111815:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-31@kfi7, seq: 2156421
00000100:00000040:16.0:1773851895.111816:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009b1f9b2f : new rpc_count 1
00000100:00000001:19.0:1773851895.111817:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.111817:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968760064 : -106974740791552 : ffff9eb500933f00)
00000100:00000001:19.0:1773851895.111818:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851895.111818:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bb654ea1 x1858166833667840/t0(0) o400->lustre5-MDT0001-lwp-OST0013_UUID@31@kfi7:147/0 lens 224/0 e 0 to 0 dl 1773852262 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba120-0'
00000100:00000001:16.0:1773851895.111821:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851895.111822:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851895.111823:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bb654ea1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:lustre5-MDT0001-lwp-OST0013_UUID+5:272669:x1858166833667840:12345-31@kfi7:400:default-yuba120-0
00000100:00000200:16.0:1773851895.111824:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858166833667840
00000020:00000001:16.0:1773851895.111825:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851895.111826:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851895.111826:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.111827:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851895.111828:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851895.111828:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:16.0:1773851895.111829:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851895.111830:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851895.111830:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851895.111831:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.111831:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851895.111832:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851895.111833:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851895.111833:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a73103fc.
02000000:00000001:16.0:1773851895.111834:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.111835:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.111835:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851895.111836:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858166833667840
00010000:00000001:16.0:1773851895.111837:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851895.111838:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bb654ea1 x1858166833667840/t0(0) o400->lustre5-MDT0001-lwp-OST0013_UUID@31@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba120-0'
00010000:00000001:16.0:1773851895.111841:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851895.111842:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851895.111842:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=128 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851895.111843:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851895.111844:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009f11e541 refcount 7 to 31@kfi7
00000100:00000001:16.0:1773851895.111845:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547296 : -107156126004320 : ffff9e8ac52c8ba0)
02000000:00000001:16.0:1773851895.111846:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851895.111847:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.111847:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851895.111848:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:16.0:1773851895.111849:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000053015df3.
00000100:00000200:16.0:1773851895.111850:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858166833667840, offset 224
00000400:00000200:16.0:1773851895.111851:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000400:00000200:16.0:1773851895.111852:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:16.0:1773851895.111853:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:16.0:1773851895.111854:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:16.0:1773851895.111855:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:16.0:1773851895.111856:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  31@kfi7 local destination
00000400:00000200:16.0:1773851895.111858:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770172:8770172:1024:4294967295] 31@kfi7 LPNI seq info [5403624:5403624:16:4294967295]
00000400:00000200:16.0:1773851895.111859:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:16.0:1773851895.111860:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:16.0:1773851895.111862:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851895.111864:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:16.0:1773851895.111865:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851895.111866:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851895.111869:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851895.111871:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x200000000000560 Using peer 31@kfi7(0x200000000000560)
00000800:00000200:16.0:1773851895.111874:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 324 bytes to peer 0x200000000000560: rc=0
00000800:00000200:16.0:1773851895.111876:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x200000000000560 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851895.111878:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851895.111879:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009f11e541 refcount 6 to 31@kfi7
00010000:00000001:16.0:1773851895.111880:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851895.111880:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.111881:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851895.111882:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bb654ea1 x1858166833667840/t0(0) o400->lustre5-MDT0001-lwp-OST0013_UUID@31@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba120-0'
00000100:00100000:16.0:1773851895.111887:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bb654ea1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:lustre5-MDT0001-lwp-OST0013_UUID+5:272669:x1858166833667840:12345-31@kfi7:400:default-yuba120-0 Request processed in 64us (106us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851895.111889:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-31@kfi7, seq: 2156421
00000100:00000040:16.0:1773851895.111890:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009b1f9b2f : new rpc_count 0
00000100:00000001:16.0:1773851895.111891:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851895.111891:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851895.111892:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:16.0:1773851895.111892:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000020:00000010:16.0:1773851895.111893:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d118fe66.
00000020:00000040:16.0:1773851895.111894:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000009b1f9b2f : new refcount 4
00000100:00000001:16.0:1773851895.111895:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851895.111901:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x200000000000560 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851895.111904:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851895.111906:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->31@kfi7: PUT: OK
00000400:00000200:17.0:1773851895.111907:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000053015df3
00000400:00000010:17.0:1773851895.111908:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000053015df3.
00000100:00000001:17.0:1773851895.111909:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851895.111910:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851895.111911:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:17.0:1773851895.111913:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 31@kfi7(0000000020f230ed):0x0 lsk 1377 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x200000000000560 Transaction freed
00000004:00000001:30.0:1773851895.113731:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851895.113731:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851895.113731:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:5.0:1773851895.113731:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:4.0:1773851895.113731:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851895.113732:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:5.0:1773851895.113732:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:4.0:1773851895.113732:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851895.113733:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b87c4f9.
00000100:00000010:7.0:1773851895.113733:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed033681.
00000100:00000010:5.0:1773851895.113733:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e45689cc.
00000100:00000010:4.0:1773851895.113733:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e1bcef3.
00000020:00000040:30.0:1773851895.113734:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000020:00000040:7.0:1773851895.113734:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000040:5.0:1773851895.113734:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000020:00000040:4.0:1773851895.113734:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:30.0:1773851895.113735:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:7.0:1773851895.113735:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851895.113735:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:5.0:1773851895.113735:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:5.0:1773851895.113735:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851895.113735:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851895.113735:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851895.113736:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851895.113736:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851895.113736:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.113736:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851895.113737:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e26c1bf7.
02000000:00000010:5.0:1773851895.113737:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e7717c48.
02000000:00000010:4.0:1773851895.113737:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000869d922.
02000000:00000001:30.0:1773851895.113738:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113738:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.113738:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.113738:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851895.113739:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ce3b9347.
00000100:00000001:7.0:1773851895.113739:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851895.113739:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851895.113739:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851895.113740:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113740:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.113740:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.113740:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.113741:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851895.113741:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851895.113741:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ed033681] to pc [ptlrpcd_01_00+0]  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851895.113741:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e45689cc] to pc [ptlrpcd_01_01+1]  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851895.113741:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005e1bcef3] to pc [ptlrpcd_01_03+3]  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851895.113743:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002b87c4f9] to pc [ptlrpcd_07_02+2]  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851895.113745:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851895.113745:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:6.0:1773851895.113746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851895.113746:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:5.0:1773851895.113746:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000074d75e84.
00000004:00000001:4.0:1773851895.113746:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851895.113747:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851895.113747:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851895.113747:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851895.113747:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851895.113747:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851895.113747:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637036816973824 : -107036892577792 : ffff9ea6880a4000)
00000100:00000001:4.0:1773851895.113747:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851895.113748:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:7.0:1773851895.113748:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851895.113748:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851895.113748:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851895.113748:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851895.113749:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851895.113749:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:30.0:1773851895.113749:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000001bf49d91.
00080000:00000001:30.0:1773851895.113749:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637030879291392 : -107042830260224 : ffff9ea526206800)
00000100:00000001:28.0:1773851895.113749:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851895.113749:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851895.113750:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:28.0:1773851895.113750:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.113750:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851895.113751:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851895.113751:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113751:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851895.113751:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851895.113751:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851895.113751:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851895.113751:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851895.113752:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
02000000:00000001:7.0:1773851895.113752:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851895.113752:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:5.0:1773851895.113752:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000004:00000010:30.0:1773851895.113753:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000cb9f3ab4.
02000000:00000001:7.0:1773851895.113753:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851895.113753:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:5.0:1773851895.113753:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c99cf954.
00000100:00000001:4.0:1773851895.113753:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851895.113753:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113754:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851895.113754:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:30.0:1773851895.113754:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614169567030062ns, next at 614170567028639ns, rc = 0
00000100:00100000:7.0:1773851895.113754:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051939584:7@kfi7:41:default-yuba2-0
00000100:00100000:6.0:1773851895.113754:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e45689cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051939648:3@kfi7:13:default-yuba2-0
00000004:00080000:5.0:1773851895.113754:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614169567029400ns, next at 614170567028118ns, rc = 0
02000000:00000001:4.0:1773851895.113754:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851895.113754:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.113755:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:31.0:1773851895.113755:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113755:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:6.0:1773851895.113755:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:5.0:1773851895.113755:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:4.0:1773851895.113755:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e1bcef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051939712:2098@kfi7:41:default-yuba2-0
00000100:00100000:31.0:1773851895.113756:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002b87c4f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051939776:2080@kfi7:13:default-yuba2-0
00080000:00000001:30.0:1773851895.113756:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851895.113756:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851895.113756:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851895.113756:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851895.113756:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851895.113756:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851895.113756:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.113756:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:30.0:1773851895.113757:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851895.113757:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851895.113757:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851895.113757:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006f21a4d8.
02000000:00000001:6.0:1773851895.113757:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:6.0:1773851895.113757:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001c35e9b8.
02000000:00000001:4.0:1773851895.113757:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851895.113757:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113758:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851895.113758:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851895.113758:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851895.113758:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.113758:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851895.113758:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e54f7a48.
02000000:00000001:31.0:1773851895.113759:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.113759:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:7.0:1773851895.113759:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
02000000:00000001:4.0:1773851895.113759:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:31.0:1773851895.113760:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000004599461.
00000400:00000010:7.0:1773851895.113760:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000200:6.0:1773851895.113760:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
02000000:00000001:31.0:1773851895.113761:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851895.113761:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000400:00000010:6.0:1773851895.113761:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000400:00000010:6.0:1773851895.113761:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f75391c.
00000400:00000200:4.0:1773851895.113761:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:4.0:1773851895.113761:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000200:31.0:1773851895.113762:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000200:7.0:1773851895.113762:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939584, portal 4
00000400:00000010:4.0:1773851895.113762:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a0b1f78.
00000400:00000010:31.0:1773851895.113763:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000100:00000001:7.0:1773851895.113763:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:6.0:1773851895.113763:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939648, portal 4
00000100:00000001:6.0:1773851895.113763:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:4.0:1773851895.113763:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939712, portal 4
00000400:00000010:31.0:1773851895.113764:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fab8ac69.
00000100:00000001:7.0:1773851895.113764:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309139712 : -106994400411904 : ffff9eb06cc53f00)
00000100:00000001:6.0:1773851895.113764:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636993527813760 : -107080181737856 : ffff9e9c73ce1680)
00000100:00000001:4.0:1773851895.113764:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851895.113764:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528723712 : -106978180827904 : ffff9eb433887500)
00000100:00000200:31.0:1773851895.113765:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939776, portal 4
00000100:00000040:7.0:1773851895.113765:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851895.113765:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851895.113765:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.113766:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851895.113767:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411250304 : -106960298301312 : ffff9eb85d6a2880)
00000100:00000001:7.0:1773851895.113767:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851895.113767:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:4.0:1773851895.113767:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851895.113768:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000100:00000040:31.0:1773851895.113769:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851895.113769:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:7.0:1773851895.113769:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
00000400:00000010:6.0:1773851895.113769:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d995f188.
00000100:00000200:7.0:1773851895.113770:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051939584, offset 0
00000100:00000200:6.0:1773851895.113770:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939648, offset 0
00000100:00000040:4.0:1773851895.113770:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:4.0:1773851895.113770:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009ae139dd.
00000400:00000200:6.0:1773851895.113771:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000100:00000001:31.0:1773851895.113772:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851895.113772:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000200:6.0:1773851895.113772:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000040:31.0:1773851895.113773:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000200:6.0:1773851895.113773:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000100:00000200:4.0:1773851895.113773:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051939712, offset 0
00000400:00000010:31.0:1773851895.113774:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f9abbdbd.
00000100:00000200:31.0:1773851895.113774:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939776, offset 0
00000400:00000200:6.0:1773851895.113774:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:4.0:1773851895.113774:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:6.0:1773851895.113775:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:31.0:1773851895.113776:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:31.0:1773851895.113777:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851895.113777:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000400:00000200:31.0:1773851895.113778:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:6.0:1773851895.113778:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770171, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770172, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851895.113779:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:6.0:1773851895.113780:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851895.113781:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:6.0:1773851895.113781:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851895.113782:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:6.0:1773851895.113782:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000400:00000200:31.0:1773851895.113784:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770173, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770172, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851895.113784:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770173:8770173:1024:4294967295] 3@kfi7 LPNI seq info [5406226:5406226:16:4294967295]
00000400:00000200:6.0:1773851895.113785:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:31.0:1773851895.113786:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851895.113786:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.113787:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851895.113787:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:31.0:1773851895.113788:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:7.0:1773851895.113788:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:31.0:1773851895.113789:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770174:8770174:1024:4294967295] 2080@kfi7 LPNI seq info [5404396:5404396:16:4294967295]
00000400:00000200:7.0:1773851895.113789:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:31.0:1773851895.113790:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:31.0:1773851895.113791:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851895.113791:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:7.0:1773851895.113792:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000400:00000200:7.0:1773851895.113794:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770173, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770174, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851895.113795:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851895.113795:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851895.113796:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851895.113796:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851895.113797:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851895.113797:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:31.0:1773851895.113798:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:6.0:1773851895.113798:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:7.0:1773851895.113799:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:31.0:1773851895.113800:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851895.113800:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340073, 17340071]
00000800:00000200:6.0:1773851895.113800:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851895.113801:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000800:00000200:31.0:1773851895.113803:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851895.113803:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770175:8770175:1023:4294967295] 7@kfi7 LPNI seq info [17340074:17340074:16:4294967295]
00000800:00000200:6.0:1773851895.113803:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:7.0:1773851895.113804:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:31.0:1773851895.113805:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000400:00000200:7.0:1773851895.113805:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:6.0:1773851895.113806:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Using peer 3@kfi7(0x3b9)
00000400:00000200:4.0:1773851895.113806:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:7.0:1773851895.113807:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851895.113807:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:4.0:1773851895.113808:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:31.0:1773851895.113809:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000400:00000200:7.0:1773851895.113809:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000800:00000200:6.0:1773851895.113809:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000235b3e16: Posted send of 324 bytes to peer 0x3b9: rc=0
00000800:00000200:7.0:1773851895.113810:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851895.113810:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:31.0:1773851895.113811:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851895.113811:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851895.113811:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000800:00000200:7.0:1773851895.113812:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851895.113812:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8770175, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770174, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851895.113813:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851895.113813:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113814:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:7.0:1773851895.113814:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:6.0:1773851895.113814:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851895.113814:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:31.0:1773851895.113815:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851895.113815:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851895.113815:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851895.113816:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851895.113816:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Using peer 7@kfi7(0x11b1)
00000100:00000001:6.0:1773851895.113816:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851895.113816:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851895.113817:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851895.113817:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851895.113817:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346213, 20346214]
00000100:00000001:31.0:1773851895.113818:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851895.113818:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851895.113819:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851895.113819:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851895.113819:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851895.113820:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851895.113820:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851895.113820:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:4.0:1773851895.113820:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2098@kfi7
00000100:00000001:31.0:1773851895.113821:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113821:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851895.113821:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000800:00000200:7.0:1773851895.113821:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x11b1: rc=0
00000100:00000001:6.0:1773851895.113821:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851895.113821:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770176:8770176:1023:4294967295] 2098@kfi7 LPNI seq info [20346215:20346215:16:4294967295]
00000800:00000200:7.0:1773851895.113822:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851895.113822:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851895.113823:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:4.0:1773851895.113823:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:4.0:1773851895.113823:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:30.0:1773851895.113824:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000100:00000001:6.0:1773851895.113824:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851895.113825:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f9abbdbd
00000100:00000001:7.0:1773851895.113825:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113825:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851895.113825:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851895.113826:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f9abbdbd.
00000100:00000001:30.0:1773851895.113826:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:7.0:1773851895.113826:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851895.113826:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000100:00000200:30.0:1773851895.113827:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851895.113827:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113827:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:4.0:1773851895.113827:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000100:00000001:7.0:1773851895.113828:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851895.113829:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851895.113829:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851895.113830:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851895.113830:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851895.113830:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851895.113831:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851895.113831:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.113833:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:4.0:1773851895.113833:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:30.0:1773851895.113834:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:7.0:1773851895.113834:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851895.113834:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_EVENT_TX_OK event status 0
00000800:00000200:4.0:1773851895.113834:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851895.113835:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851895.113835:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.113835:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.113836:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000400:00000200:7.0:1773851895.113837:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000400:00000200:5.0:1773851895.113837:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d995f188
00000800:00000200:4.0:1773851895.113837:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851895.113838:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Transaction freed
00000400:00000010:5.0:1773851895.113838:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d995f188.
00000400:00000200:7.0:1773851895.113839:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000400:00000010:7.0:1773851895.113839:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000100:00000001:5.0:1773851895.113839:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:4.0:1773851895.113839:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Using peer 2098@kfi7(0x2000000000004bc)
00000100:00000001:7.0:1773851895.113840:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:7.0:1773851895.113840:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851895.113840:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851895.113842:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:4.0:1773851895.113842:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x2000000000004bc: rc=0
00000100:00000001:7.0:1773851895.113843:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851895.113843:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851895.113843:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:7.0:1773851895.113844:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851895.113845:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.113845:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.113846:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851895.113846:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851895.113846:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113847:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113847:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851895.113847:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:4.0:1773851895.113847:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851895.113848:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:4.0:1773851895.113848:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.113848:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:7.0:1773851895.113849:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Transaction freed
00000800:00000200:5.0:1773851895.113849:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000235b3e16: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Transaction freed
00000100:00000001:4.0:1773851895.113849:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:9.0:1773851895.113850:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:4.0:1773851895.113851:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851895.113851:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851895.113852:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.113853:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:9.0:1773851895.113853:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851895.113854:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.113856:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851895.113856:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:6.0:1773851895.113857:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851895.113858:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851895.113858:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851895.113858:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:4.0:1773851895.113858:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.113858:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851895.113859:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:29.0:1773851895.113860:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851895.113860:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851895.113860:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000400:00000200:6.0:1773851895.113860:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009ae139dd
00000400:00000200:9.0:1773851895.113861:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000010:6.0:1773851895.113861:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009ae139dd.
00000400:00000200:29.0:1773851895.113862:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:9.0:1773851895.113862:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:6.0:1773851895.113862:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851895.113862:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851895.113863:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851895.113863:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:29.0:1773851895.113864:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:9.0:1773851895.113864:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:29.0:1773851895.113865:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:9.0:1773851895.113865:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:6.0:1773851895.113865:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851895.113866:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:9.0:1773851895.113866:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b63c0
00000100:00000040:6.0:1773851895.113866:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851895.113867:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:9.0:1773851895.113867:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:29.0:1773851895.113868:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.113869:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6340
00000400:00000200:9.0:1773851895.113869:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781698da9 [1] + 224
00000100:00000001:6.0:1773851895.113870:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851895.113871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:9.0:1773851895.113871:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851895.113871:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851895.113872:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x780081d1d [1] + 224
00000800:00000200:13.0:1773851895.113872:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000400:00000200:6.0:1773851895.113872:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000800:00000200:13.0:1773851895.113873:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851895.113873:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851895.113873:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Transaction freed
00000800:00000200:29.0:1773851895.113874:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851895.113874:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851895.113874:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000100:00000001:9.0:1773851895.113875:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851895.113876:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851895.113876:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:9.0:1773851895.113876:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851895.113877:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000800:00000200:5.0:1773851895.113877:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:29.0:1773851895.113878:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851895.113879:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851895.113879:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000040:9.0:1773851895.113879:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851895.113879:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851895.113880:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000800:00000200:5.0:1773851895.113880:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851895.113881:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.113882:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000800:00000200:5.0:1773851895.113882:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:29.0:1773851895.113883:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851895.113883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:9.0:1773851895.113883:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851895.113884:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:9.0:1773851895.113884:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:5.0:1773851895.113884:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:31.0:1773851895.113885:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:13.0:1773851895.113885:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:31.0:1773851895.113886:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:13.0:1773851895.113886:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:9.0:1773851895.113886:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:5.0:1773851895.113886:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000001:31.0:1773851895.113887:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851895.113887:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851895.113887:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851895.113887:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6300
00000400:00000200:5.0:1773851895.113887:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:31.0:1773851895.113888:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:29.0:1773851895.113888:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:13.0:1773851895.113888:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:6.0:1773851895.113888:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851895.113888:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:31.0:1773851895.113889:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fab8ac69
00000400:00000010:31.0:1773851895.113889:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fab8ac69.
00000800:00000200:29.0:1773851895.113889:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851895.113889:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f716d [1] + 224
00000100:00000001:6.0:1773851895.113889:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851895.113889:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:31.0:1773851895.113890:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:6.0:1773851895.113890:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:5.0:1773851895.113890:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000200:31.0:1773851895.113891:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851895.113891:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:6.0:1773851895.113891:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851895.113891:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000010:6.0:1773851895.113892:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851895.113892:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f75391c
00000400:00000200:5.0:1773851895.113892:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:13.0:1773851895.113893:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:6.0:1773851895.113893:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f75391c.
00000400:00000200:5.0:1773851895.113893:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6380
00000100:00000200:31.0:1773851895.113894:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851895.113894:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000001:6.0:1773851895.113894:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:6.0:1773851895.113894:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851895.113894:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:13.0:1773851895.113895:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851895.113895:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b321c5 [1] + 224
00000100:00000001:31.0:1773851895.113896:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:13.0:1773851895.113896:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.113897:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.113897:0:41090:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:6.0:1773851895.113897:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851895.113897:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:31.0:1773851895.113898:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851895.113898:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851895.113899:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:13.0:1773851895.113899:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851895.113899:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:31.0:1773851895.113900:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851895.113900:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=128 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851895.113900:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851895.113900:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851895.113900:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000100:00000001:6.0:1773851895.113901:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851895.113901:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851895.113901:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:31.0:1773851895.113902:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=128 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851895.113902:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:5.0:1773851895.113902:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.113903:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851895.113903:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851895.113903:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851895.113903:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851895.113903:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851895.113904:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:13.0:1773851895.113904:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:7.0:1773851895.113904:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:6.0:1773851895.113904:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=128 v=66 (66 66 66 66)
00010000:00000001:31.0:1773851895.113905:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851895.113905:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851895.113905:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:6.0:1773851895.113905:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=128 v=66 (1 1 1 1)
00000100:00000040:5.0:1773851895.113905:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.113906:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851895.113906:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000400:00000001:7.0:1773851895.113906:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:6.0:1773851895.113906:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851895.113907:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851895.113907:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:7.0:1773851895.113907:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851895.113907:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000100:00000001:6.0:1773851895.113907:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851895.113907:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:5.0:1773851895.113907:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:31.0:1773851895.113908:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:7.0:1773851895.113908:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00010000:00000001:6.0:1773851895.113908:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851895.113908:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000010:7.0:1773851895.113909:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:7.0:1773851895.113909:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:6.0:1773851895.113909:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851895.113909:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:4.0:1773851895.113909:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851895.113909:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851895.113910:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851895.113910:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851895.113910:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:4.0:1773851895.113910:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851895.113910:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851895.113910:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000100:00000001:31.0:1773851895.113911:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:7.0:1773851895.113911:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851895.113911:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:4.0:1773851895.113911:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a0b1f78
00000100:00000001:31.0:1773851895.113912:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851895.113912:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:4.0:1773851895.113912:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a0b1f78.
00000100:00000001:4.0:1773851895.113912:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:31.0:1773851895.113913:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:7.0:1773851895.113913:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851895.113913:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:31.0:1773851895.113914:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851895.113914:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510653952 avail=351508038656 avail_mb=1373078276 hwm_mb=3131103 files=372095714 ffree=343272123 state=0: rc = 0
00000100:00000001:6.0:1773851895.113914:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851895.113915:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000200:4.0:1773851895.113915:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:31.0:1773851895.113916:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510653952 free, 351508038656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095714 files, 343272123 free files
00000100:00000001:7.0:1773851895.113916:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851895.113916:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851895.113916:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.113917:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851895.113917:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851895.113917:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000001:6.0:1773851895.113917:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:6.0:1773851895.113917:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000004:00000001:31.0:1773851895.113918:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113918:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:6.0:1773851895.113918:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353588736 avail=351351202816 avail_mb=1372465636 hwm_mb=3131101 files=372083184 ffree=343118739 state=0: rc = 0
00000100:00000001:4.0:1773851895.113918:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851895.113918:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851895.113919:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:7.0:1773851895.113919:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851895.113919:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=154 v=66 (66 66 66 66)
00000100:00000001:4.0:1773851895.113919:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851895.113919:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:7.0:1773851895.113920:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=10 v=66 (1 1 1 1)
00000004:00000020:6.0:1773851895.113920:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353588736 free, 351351202816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083184 files, 343118739 free files
00000100:00000001:4.0:1773851895.113920:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851895.113920:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113921:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:6.0:1773851895.113921:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.113921:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851895.113921:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=128 v=66 (66 66 66 66)
00000100:00100000:31.0:1773851895.113922:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002b87c4f9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051939776:2080@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851895.113922:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851895.113922:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:6.0:1773851895.113922:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:4.0:1773851895.113922:0:41067:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=128 v=66 (1 1 1 1)
00010000:00000001:7.0:1773851895.113923:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113924:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.113924:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851895.113924:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851895.113924:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:4.0:1773851895.113924:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851895.113924:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.113925:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002b87c4f9 x1859433051939776/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851895.113925:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851895.113925:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851895.113925:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e45689cc pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051939648:3@kfi7:13:default-yuba2-0
00010000:00000001:4.0:1773851895.113925:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851895.113925:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851895.113926:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851895.113926:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851895.113926:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:6.0:1773851895.113927:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851895.113927:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851895.113927:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851895.113927:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113928:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851895.113928:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851895.113928:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:6.0:1773851895.113928:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e45689cc x1859433051939648/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:4.0:1773851895.113928:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:31.0:1773851895.113929:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000004599461.
00000100:00000001:7.0:1773851895.113929:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851895.113929:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851895.113930:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851895.113930:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000001:7.0:1773851895.113930:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851895.113930:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000040:31.0:1773851895.113931:0:41090:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000020:00000001:31.0:1773851895.113931:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000020:7.0:1773851895.113931:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031808 blocks, 31536853632 free, 31536802816 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425506 files, 2779493203 free files
00000100:00000001:6.0:1773851895.113931:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851895.113931:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:4.0:1773851895.113931:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851895.113931:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:31.0:1773851895.113932:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ce3b9347.
00000004:00000001:7.0:1773851895.113932:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851895.113932:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001c35e9b8.
00000004:00000001:4.0:1773851895.113932:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:4.0:1773851895.113932:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33735999968 blocks, 31354646176 free, 31354601312 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064160 files, 2870603592 free files
02000000:00000001:31.0:1773851895.113933:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851895.113933:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:31.0:1773851895.113934:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851895.113934:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002b87c4f9.
00000100:00000040:7.0:1773851895.113934:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:6.0:1773851895.113934:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851895.113934:0:41065:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000100:00000001:31.0:1773851895.113935:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000020:00000001:6.0:1773851895.113935:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851895.113935:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e7717c48.
00000100:00000001:31.0:1773851895.113936:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.113936:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:7.0:1773851895.113936:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051939584:7@kfi7:41:default-yuba2-0
02000000:00000001:6.0:1773851895.113936:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000001:4.0:1773851895.113936:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113937:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:6.0:1773851895.113937:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851895.113937:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e45689cc.
00000100:00000040:4.0:1773851895.113937:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.113938:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.113938:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851895.113938:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113938:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.113938:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851895.113938:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000040:7.0:1773851895.113939:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ed033681 x1859433051939584/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851895.113939:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851895.113939:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:4.0:1773851895.113939:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e1bcef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051939712:2098@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851895.113940:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851895.113940:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.113941:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851895.113941:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:4.0:1773851895.113941:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851895.113941:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005e1bcef3 x1859433051939712/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:7.0:1773851895.113942:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006f21a4d8.
00000100:00000001:6.0:1773851895.113942:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851895.113942:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:7.0:1773851895.113943:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851895.113943:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851895.113943:0:41064:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000001:6.0:1773851895.113943:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851895.113944:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851895.113944:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e26c1bf7.
00000100:00000001:4.0:1773851895.113944:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851895.113944:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:7.0:1773851895.113945:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000010:4.0:1773851895.113945:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e54f7a48.
02000000:00000001:4.0:1773851895.113945:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:7.0:1773851895.113946:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851895.113946:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed033681.
00000020:00000001:4.0:1773851895.113946:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851895.113946:0:41067:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:7.0:1773851895.113947:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851895.113947:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851895.113947:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851895.113947:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000869d922.
00000100:00000001:7.0:1773851895.113948:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.113948:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:4.0:1773851895.113948:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851895.113948:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851895.113948:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e1bcef3.
00000100:00000001:7.0:1773851895.113949:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.113949:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851895.113949:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851895.113949:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.113950:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.113950:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.113951:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851895.113951:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.113952:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851895.113952:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851895.125031:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.125032:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851895.125033:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851895.125035:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851895.125036:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.125038:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20946@kfi7 : PUT - for me
00000400:00000200:13.0:1773851895.125039:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.125040:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 1
00000400:00000200:13.0:1773851895.125041:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.125042:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000400:00000200:13.0:1773851895.125043:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 3
00000400:00000200:13.0:1773851895.125043:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20754@kfi7 to cpt 0
00000400:00000200:13.0:1773851895.125044:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20754@kfi7 of length 456 into portal 12 MB=0x69b4c5ccb33c0
00000400:00000200:13.0:1773851895.125045:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20754@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 55408
00000800:00000200:13.0:1773851895.125047:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851895.125048:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851895.125049:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20946@kfi7: PUT: OK
00000100:00000001:13.0:1773851895.125050:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851895.125051:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851895.125052:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001f67a5f4.
00000100:00000040:13.0:1773851895.125052:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000001f67a5f4 x1859602136904640 msgsize 456
00000100:00100000:13.0:1773851895.125054:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20754@kfi7 (source: 12345-20946@kfi7)
00000100:00000001:13.0:1773851895.125055:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851895.125056:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851895.125056:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
02000000:00000001:15.0:1773851895.125057:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851895.125057:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851895.125057:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851895.125058:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851895.125059:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851895.125060:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602136904640
00000020:00000001:15.0:1773851895.125060:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.125061:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e62dab381
00000020:00000001:15.0:1773851895.125061:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.125066:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ecd9af3e refcount=3468
00000020:00000001:15.0:1773851895.125067:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636940889160704 : -107132820390912 : ffff9e90324bfc00)
00000020:00000001:15.0:1773851895.125068:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636940889160704 : -107132820390912 : ffff9e90324bfc00)
00000100:00000001:15.0:1773851895.125069:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.125070:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.125070:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000057e36ed.
00000020:00000010:15.0:1773851895.125071:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.125072:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.125073:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.125074:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.125074:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.125075:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.125077:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.125078:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.125078:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.125078:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851895.125078:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851895.125079:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20754@kfi7, seq: 411190561
00000100:00000040:15.0:1773851895.125080:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ecd9af3e : new rpc_count 8
00000100:00000001:12.0:1773851895.125080:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.125081:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636950415873664 : -107123293677952 : ffff9e926a221680)
00000100:00000001:12.0:1773851895.125081:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.125082:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001f67a5f4 x1859602136904640/t0(0) o17->6eb2aa37-6a67-4af8-9d80-735dc4a16d05@20754@kfi7:622/0 lens 456/0 e 0 to 0 dl 1773851982 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1797-0'
00000100:00000001:15.0:1773851895.125085:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.125085:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.125086:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001f67a5f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6eb2aa37-6a67-4af8-9d80-735dc4a16d05+3468:39479:x1859602136904640:12345-20754@kfi7:17:default-tuolumne1797-0
00000100:00000200:15.0:1773851895.125087:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602136904640
00000020:00000001:15.0:1773851895.125088:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.125089:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.125089:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.125090:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.125091:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:15.0:1773851895.125091:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.125092:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602136904640, found 0 last_xid 1859602136174079
00000020:00000001:15.0:1773851895.125093:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.125093:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.125094:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.125094:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.125095:0:60824:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:15.0:1773851895.125096:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.125097:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.125099:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000043404919.
02000000:00000001:15.0:1773851895.125099:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.125100:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.125101:0:60824:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:15.0:1773851895.125101:0:60824:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:15.0:1773851895.125102:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851895.125103:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.125105:0:60824:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:15.0:1773851895.125106:0:60824:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 6eb2aa37-6a67-4af8-9d80-735dc4a16d05/00000000ecd9af3e free: 126633370845184 avail: 126633368748032
00000020:00000001:15.0:1773851895.125107:0:60824:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:15.0:1773851895.125107:0:60824:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 6eb2aa37-6a67-4af8-9d80-735dc4a16d05/00000000ecd9af3e avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:15.0:1773851895.125109:0:60824:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:15.0:1773851895.125110:0:60824:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:15.0:1773851895.125110:0:60824:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 6eb2aa37-6a67-4af8-9d80-735dc4a16d05/00000000ecd9af3e reports grant 1781268479 dropped 0, local 1882456063
00000020:00000001:15.0:1773851895.125111:0:60824:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:15.0:1773851895.125112:0:60824:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:15.0:1773851895.125112:0:60824:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.125113:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583932, transno 0, xid 1859602136904640
00010000:00000001:15.0:1773851895.125114:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.125114:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001f67a5f4 x1859602136904640/t0(0) o17->6eb2aa37-6a67-4af8-9d80-735dc4a16d05@20754@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1797-0'
00010000:00000001:15.0:1773851895.125117:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.125117:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.125118:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.125119:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.125120:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005bea2bdf refcount 3 to 20754@kfi7
00000100:00000001:15.0:1773851895.125121:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003136 : -107146751548480 : ffff9e8cf3ef63c0)
02000000:00000001:15.0:1773851895.125122:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.125122:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.125123:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.125124:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20946@kfi7
00000400:00000010:15.0:1773851895.125124:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e35829f1.
00000100:00000200:15.0:1773851895.125125:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859602136904640, offset 224
00000400:00000200:15.0:1773851895.125126:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20946@kfi7
00000400:00000200:15.0:1773851895.125127:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.125128:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 1
00000400:00000200:15.0:1773851895.125129:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000400:00000200:15.0:1773851895.125130:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 3
00000400:00000200:15.0:1773851895.125132:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20946@kfi7 local destination
00000400:00000200:15.0:1773851895.125133:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770177:8770177:1024:4294967295] 20946@kfi7 LPNI seq info [12875361:12875361:16:4294967295]
00000400:00000200:15.0:1773851895.125135:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000400:00000200:15.0:1773851895.125136:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20946@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.125137:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20946@kfi7(20946@kfi7:20946@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.125138:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 3
00000800:00000200:15.0:1773851895.125140:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.125141:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:15.0:1773851895.125143:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.125145:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000102e Using peer 20946@kfi7(0x10000000000102e)
00000800:00000200:15.0:1773851895.125148:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000016e422b2: Posted send of 532 bytes to peer 0x10000000000102e: rc=0
00000800:00000200:15.0:1773851895.125149:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000102e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.125151:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.125152:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005bea2bdf refcount 2 to 20754@kfi7
00010000:00000001:15.0:1773851895.125153:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.125153:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.125154:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.125155:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001f67a5f4 x1859602136904640/t0(0) o17->6eb2aa37-6a67-4af8-9d80-735dc4a16d05@20754@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1797-0'
00000100:00100000:15.0:1773851895.125158:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001f67a5f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:6eb2aa37-6a67-4af8-9d80-735dc4a16d05+3468:39479:x1859602136904640:12345-20754@kfi7:17:default-tuolumne1797-0 Request processed in 72us (104us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851895.125160:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20754@kfi7, seq: 411190561
00000100:00000040:15.0:1773851895.125161:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ecd9af3e : new rpc_count 7
00000100:00000001:15.0:1773851895.125162:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851895.125162:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851895.125162:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000102e TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851895.125163:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.125164:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000400:00000200:13.0:1773851895.125164:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851895.125165:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000057e36ed.
00000400:00000200:13.0:1773851895.125165:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20946@kfi7: PUT: OK
00000020:00000040:15.0:1773851895.125166:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000ecd9af3e : new refcount 3467
00000400:00000200:13.0:1773851895.125166:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e35829f1
00000400:00000010:13.0:1773851895.125166:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e35829f1.
00000100:00000001:15.0:1773851895.125167:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851895.125167:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851895.125168:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851895.125169:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000003e1e69 nid 20946@kfi7 refs 2
00000800:00000200:13.0:1773851895.125170:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000016e422b2: 2054@kfi7:3 -> 20946@kfi7(00000000c1682c0b):0x0 lsk 4143 rsk 35 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000102e Transaction freed
00000800:00000200:14.0:1773851895.157141:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.157141:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851895.157142:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851895.157142:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:14.0:1773851895.157144:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851895.157144:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851895.157147:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851895.157147:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8699@kfi7(00000000731048bf):0x1ca version: 2; local version 2; negotiated version: 2
00000400:00000200:14.0:1773851895.157150:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8699@kfi7 to cpt 3
00000800:00000200:13.0:1773851895.157150:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca Using peer 8699@kfi7(0x1000000000001ca)
00000400:00000200:14.0:1773851895.157152:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8699@kfi7 : PUT - for me
00000400:00000200:13.0:1773851895.157153:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8699@kfi7 to cpt 3
00000400:00000200:14.0:1773851895.157154:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8699@kfi7 to cpt 3
00000400:00000200:14.0:1773851895.157155:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dff563da nid 8699@kfi7 refs 1
00000800:00000200:13.0:1773851895.157155:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x1000000000001ca: rc=0
00000400:00000200:14.0:1773851895.157157:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8699@kfi7 to cpt 3
00000400:00000200:14.0:1773851895.157158:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dff563da nid 8699@kfi7 refs 2
00000800:00000200:13.0:1773851895.157158:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851895.157159:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dff563da nid 8699@kfi7 refs 3
00000400:00000200:14.0:1773851895.157161:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8698@kfi7 to cpt 0
00000400:00000200:14.0:1773851895.157162:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8698@kfi7 of length 440 into portal 12 MB=0x699df02cfc3c0
00000400:00000200:14.0:1773851895.157164:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8698@kfi7 of length 440/440 into md 0x82a36e8ed [64] + 55864
00000800:00000200:14.0:1773851895.157167:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851895.157170:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851895.157171:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8699@kfi7: PUT: OK
00000100:00000001:14.0:1773851895.157172:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:14.0:1773851895.157173:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:13.0:1773851895.157173:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca TN_EVENT_TX_OK event status 0
00000100:00000010:14.0:1773851895.157174:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a1aea4cc.
00000100:00000040:14.0:1773851895.157175:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000a1aea4cc x1858032964191168 msgsize 440
00000800:00000200:13.0:1773851895.157176:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca Transaction freed
00000100:00100000:14.0:1773851895.157177:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-8698@kfi7 (source: 12345-8699@kfi7)
00000100:00000001:14.0:1773851895.157179:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851895.157180:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dff563da nid 8699@kfi7 refs 2
00000100:00000001:15.0:1773851895.157182:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851895.157182:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:14.0:1773851895.157182:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851895.157183:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851895.157184:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851895.157185:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851895.157186:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858032964191168
00000020:00000001:15.0:1773851895.157187:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.157187:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91150
00000020:00000001:15.0:1773851895.157188:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.157191:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de46831c refcount=6
00000020:00000001:15.0:1773851895.157192:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240334336 : -107152469217280 : ffff9e8b9f22b000)
00000020:00000001:15.0:1773851895.157193:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240334336 : -107152469217280 : ffff9e8b9f22b000)
00000100:00000001:15.0:1773851895.157195:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.157196:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.157196:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000057e36ed.
00000020:00000010:15.0:1773851895.157197:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.157198:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.157200:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.157200:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.157201:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.157202:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.157204:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.157205:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.157206:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.157206:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851895.157207:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8698@kfi7, seq: 411190562
00000100:00000001:12.0:1773851895.157207:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851895.157208:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de46831c : new rpc_count 1
00000100:00000001:15.0:1773851895.157209:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637008771902464 : -107064937649152 : ffff9ea0006c6c00)
00000100:00000001:12.0:1773851895.157209:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851895.157210:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.157211:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a1aea4cc x1858032964191168/t0(0) o41->35cfa77e-79ff-484e-b35e-113984beb068@8698@kfi7:535/0 lens 440/0 e 0 to 0 dl 1773852650 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne202-0'
00000100:00000001:15.0:1773851895.157222:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.157223:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.157224:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1aea4cc pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:35cfa77e-79ff-484e-b35e-113984beb068+6:118159:x1858032964191168:12345-8698@kfi7:41:default-tuolumne202-0
00000100:00000200:15.0:1773851895.157226:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858032964191168
00000020:00000001:15.0:1773851895.157227:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.157228:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.157229:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.157230:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.157230:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:15.0:1773851895.157232:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.157233:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858032964191168, found 0 last_xid 1858032964191167
00000020:00000001:15.0:1773851895.157234:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.157235:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.157236:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.157236:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.157237:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.157238:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.157240:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000f39d7431.
02000000:00000001:15.0:1773851895.157241:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.157242:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157243:0:60824:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:15.0:1773851895.157244:0:60824:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:15.0:1773851895.157245:0:60824:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157247:0:60824:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:15.0:1773851895.157248:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851895.157249:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157250:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851895.157251:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157252:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851895.157253:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157254:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851895.157254:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157255:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851895.157256:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157257:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:15.0:1773851895.157258:0:60824:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157259:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157260:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500129280 free, 351498067968 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097665 files, 343261845 free files
00000004:00000001:15.0:1773851895.157263:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157264:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157265:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504314368 free, 351502162944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056119 files, 343265932 free files
00000004:00000001:15.0:1773851895.157267:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157268:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157268:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690095616 free, 351687687168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231121 files, 343447359 free files
00000004:00000001:15.0:1773851895.157270:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157271:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157272:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382736896 free, 351380642816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978635 files, 343147204 free files
00000004:00000001:15.0:1773851895.157274:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157275:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157276:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958951424 free, 350956868608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563891 files, 342733351 free files
00000004:00000001:15.0:1773851895.157278:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157279:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157280:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351175168 free, 351348398080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372083944 files, 343116382 free files
00000004:00000001:15.0:1773851895.157281:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157282:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157283:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482180608 free, 351481153536 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097084 files, 343244317 free files
00000004:00000001:15.0:1773851895.157285:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157286:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157286:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449345024 free, 351446775808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160923 files, 343212251 free files
00000004:00000001:15.0:1773851895.157288:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157289:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157290:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353588736 free, 351351202816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083184 files, 343118739 free files
00000004:00000001:15.0:1773851895.157292:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157293:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157294:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388963840 free, 351386269696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019008 files, 343153285 free files
00000004:00000001:15.0:1773851895.157296:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157297:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157297:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406493696 free, 351404179456 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127129 files, 343170404 free files
00000004:00000001:15.0:1773851895.157299:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157300:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157301:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378973696 free, 351376034816 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372018968 files, 343143529 free files
00000004:00000001:15.0:1773851895.157303:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157304:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157304:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351465977856 free, 351462800384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062752 files, 343228494 free files
00000004:00000001:15.0:1773851895.157306:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157307:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157308:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351488995328 free, 351486022656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066684 files, 343250972 free files
00000004:00000001:15.0:1773851895.157310:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157310:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157311:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492738048 free, 351490311168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372077981 files, 343254627 free files
00000004:00000001:15.0:1773851895.157313:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157314:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157314:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524023296 free, 351521284096 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113755 files, 343285179 free files
00000004:00000001:15.0:1773851895.157316:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157317:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157318:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510653952 free, 351508038656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095714 files, 343272123 free files
00000004:00000001:15.0:1773851895.157320:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157321:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157322:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541509120 free, 351539542016 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136560 files, 343302255 free files
00000004:00000001:15.0:1773851895.157324:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157325:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157326:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470631936 free, 351461548032 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064411 files, 343233039 free files
00000004:00000001:15.0:1773851895.157328:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157329:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157329:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666633728 free, 351645446144 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237768 files, 343424447 free files
00000004:00000001:15.0:1773851895.157331:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157332:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157333:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545831424 free, 351536184320 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116395 files, 343306476 free files
00000004:00000001:15.0:1773851895.157335:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157336:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157336:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603970048 free, 351601693696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190402 files, 343363252 free files
00000004:00000001:15.0:1773851895.157338:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157339:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157340:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615818752 free, 351613224960 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043334 files, 343374823 free files
00000004:00000001:15.0:1773851895.157342:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157343:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157343:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420222464 free, 351417744384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008873 files, 343183811 free files
00000004:00000001:15.0:1773851895.157345:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157346:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157347:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409081344 free, 351407090688 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011194 files, 343172931 free files
00000004:00000001:15.0:1773851895.157348:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157350:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157350:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480020992 free, 351478733824 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073052 files, 343242208 free files
00000004:00000001:15.0:1773851895.157352:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157353:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157354:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593655296 free, 351576848384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189919 files, 343353179 free files
00000004:00000001:15.0:1773851895.157355:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157356:0:60824:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:15.0:1773851895.157357:0:60824:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464025088 free, 351458249728 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064701 files, 343226587 free files
00000004:00000001:15.0:1773851895.157358:0:60824:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157359:0:60824:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157360:0:60824:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:15.0:1773851895.157361:0:60824:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 279183360 granted 1839581985855 pending 396361728 free 40309312458850304 avail 40308835839115264
00000004:00000020:15.0:1773851895.157363:0:60824:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841140737024 free, 9841024209856 avail; 10969024828 objects: 9610489001 free; state 100
00000020:00000001:15.0:1773851895.157365:0:60824:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:15.0:1773851895.157368:0:60824:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.157369:0:60824:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.157370:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 172263803199, transno 0, xid 1858032964191168
00010000:00000001:15.0:1773851895.157370:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.157371:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a1aea4cc x1858032964191168/t0(0) o41->35cfa77e-79ff-484e-b35e-113984beb068@8698@kfi7:535/0 lens 440/368 e 0 to 0 dl 1773852650 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne202-0'
00010000:00000001:15.0:1773851895.157374:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.157374:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.157375:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.157376:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.157377:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dc59ba28 refcount 5 to 8698@kfi7
00000100:00000001:15.0:1773851895.157377:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905049760 : -107154804501856 : ffff9e8b13f112a0)
02000000:00000001:15.0:1773851895.157378:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.157378:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.157379:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.157379:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8699@kfi7
00000400:00000010:15.0:1773851895.157380:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034ed0079.
00000100:00000200:15.0:1773851895.157381:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858032964191168, offset 224
00000400:00000200:15.0:1773851895.157382:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8699@kfi7
00000400:00000200:15.0:1773851895.157382:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8699@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.157383:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dff563da nid 8699@kfi7 refs 1
00000400:00000200:15.0:1773851895.157384:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dff563da nid 8699@kfi7 refs 2
00000400:00000200:15.0:1773851895.157385:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dff563da nid 8699@kfi7 refs 3
00000400:00000200:15.0:1773851895.157386:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8699@kfi7 local destination
00000400:00000200:15.0:1773851895.157387:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770178:8770178:1024:4294967295] 8699@kfi7 LPNI seq info [27979:27979:16:4294967295]
00000400:00000200:15.0:1773851895.157389:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dff563da nid 8699@kfi7 refs 2
00000400:00000200:15.0:1773851895.157389:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8699@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.157391:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8699@kfi7(8699@kfi7:8699@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.157392:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dff563da nid 8699@kfi7 refs 3
00000800:00000200:15.0:1773851895.157393:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.157394:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:15.0:1773851895.157396:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.157398:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca Using peer 8699@kfi7(0x1000000000001ca)
00000800:00000200:15.0:1773851895.157401:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000008cd44c55: Posted send of 468 bytes to peer 0x1000000000001ca: rc=0
00000800:00000200:15.0:1773851895.157402:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.157403:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.157404:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dc59ba28 refcount 4 to 8698@kfi7
00010000:00000001:15.0:1773851895.157404:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.157405:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.157405:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.157406:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a1aea4cc x1858032964191168/t0(0) o41->35cfa77e-79ff-484e-b35e-113984beb068@8698@kfi7:535/0 lens 440/368 e 0 to 0 dl 1773852650 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne202-0'
00000100:00100000:15.0:1773851895.157409:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1aea4cc pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:35cfa77e-79ff-484e-b35e-113984beb068+6:118159:x1858032964191168:12345-8698@kfi7:41:default-tuolumne202-0 Request processed in 186us (233us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851895.157411:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8698@kfi7, seq: 411190562
00000100:00000040:15.0:1773851895.157411:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de46831c : new rpc_count 0
00000100:00000001:15.0:1773851895.157412:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851895.157412:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851895.157413:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.157414:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:15.0:1773851895.157414:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000057e36ed.
00000800:00000200:13.0:1773851895.157414:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca TN_EVENT_TX_OK event status 0
00000020:00000040:15.0:1773851895.157415:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000de46831c : new refcount 5
00000100:00000001:15.0:1773851895.157415:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851895.157415:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851895.157416:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8699@kfi7: PUT: OK
00000400:00000200:13.0:1773851895.157417:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034ed0079
00000400:00000010:13.0:1773851895.157417:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034ed0079.
00000100:00000001:13.0:1773851895.157417:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851895.157418:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851895.157418:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dff563da nid 8699@kfi7 refs 2
00000800:00000200:13.0:1773851895.157419:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008cd44c55: 2054@kfi7:3 -> 8699@kfi7(00000000731048bf):0x0 lsk 459 rsk 231 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000001ca Transaction freed
00000800:00000200:9.0:1773851895.162458:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851895.162460:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851895.162463:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851895.162467:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851895.162470:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15139@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.162472:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15139@kfi7 : PUT - for me
00000400:00000200:9.0:1773851895.162473:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15139@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.162475:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003111fc3a nid 15139@kfi7 refs 1
00000400:00000200:9.0:1773851895.162476:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15139@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.162477:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003111fc3a nid 15139@kfi7 refs 2
00000400:00000200:9.0:1773851895.162479:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003111fc3a nid 15139@kfi7 refs 3
00000400:00000200:9.0:1773851895.162480:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15138@kfi7 to cpt 7
00000400:00000200:9.0:1773851895.162482:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15138@kfi7 of length 224 into portal 12 MB=0x69b4bc7ada440
00000400:00000200:9.0:1773851895.162484:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15138@kfi7 of length 224/224 into md 0x78146ce49 [64] + 159680
00000800:00000200:9.0:1773851895.162486:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851895.162489:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851895.162491:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15139@kfi7: PUT: OK
00000100:00000001:9.0:1773851895.162492:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851895.162493:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851895.162494:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b21aff5c.
00000100:00000040:9.0:1773851895.162495:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000b21aff5c x1859599635162176 msgsize 224
00000100:00100000:9.0:1773851895.162498:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-15138@kfi7 (source: 12345-15139@kfi7)
00000100:00000001:9.0:1773851895.162499:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851895.162500:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003111fc3a nid 15139@kfi7 refs 2
00000100:00000001:11.0:1773851895.162502:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851895.162503:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851895.162503:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851895.162504:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851895.162505:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851895.162507:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851895.162508:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599635162176
00000020:00000001:11.0:1773851895.162509:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851895.162510:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8102b
00000020:00000001:11.0:1773851895.162511:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851895.162515:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e1e869d0 refcount=5
00000020:00000001:11.0:1773851895.162516:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637084839006208 : -106988870545408 : ffff9eb1b6605000)
00000020:00000001:11.0:1773851895.162518:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637084839006208 : -106988870545408 : ffff9eb1b6605000)
00000100:00000001:11.0:1773851895.162520:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.162521:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851895.162523:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000575f5ace.
00000020:00000010:11.0:1773851895.162524:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851895.162526:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851895.162528:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851895.162529:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851895.162532:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851895.162534:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851895.162535:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851895.162536:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.162537:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851895.162540:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851895.162540:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851895.162541:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851895.162541:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851895.162542:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15138@kfi7, seq: 2130866
00000100:00000040:11.0:1773851895.162543:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e1e869d0 : new rpc_count 1
00000100:00000001:8.0:1773851895.162544:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.162545:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609039744 : -107064100511872 : ffff9ea032521f80)
00000100:00000001:8.0:1773851895.162545:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.162546:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b21aff5c x1859599635162176/t0(0) o400->9b2b209f-f0f5-4861-93c5-b11af2e449e6@15138@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1435-0'
00000100:00000001:11.0:1773851895.162551:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.162552:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851895.162553:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b21aff5c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9b2b209f-f0f5-4861-93c5-b11af2e449e6+5:39636:x1859599635162176:12345-15138@kfi7:400:default-tuolumne1435-0
00000100:00000200:11.0:1773851895.162556:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599635162176
00000020:00000001:11.0:1773851895.162557:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851895.162558:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851895.162559:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.162560:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851895.162561:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851895.162562:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851895.162563:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599635162176, found 0 last_xid 1859599635162175
00000020:00000001:11.0:1773851895.162564:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851895.162565:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851895.162566:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851895.162567:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.162568:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851895.162569:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851895.162569:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851895.162571:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000df386630.
02000000:00000001:11.0:1773851895.162572:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.162573:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.162574:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851895.162575:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154597592, transno 0, xid 1859599635162176
00010000:00000001:11.0:1773851895.162577:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851895.162578:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b21aff5c x1859599635162176/t0(0) o400->9b2b209f-f0f5-4861-93c5-b11af2e449e6@15138@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1435-0'
00010000:00000001:11.0:1773851895.162582:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851895.162583:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851895.162584:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=128 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851895.162586:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851895.162587:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d7f62fa refcount 3 to 15138@kfi7
00000100:00000001:11.0:1773851895.162589:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603213728 : -107155106337888 : ffff9e8b01f36ba0)
02000000:00000001:11.0:1773851895.162590:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851895.162591:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.162592:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851895.162593:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15139@kfi7
00000400:00000010:11.0:1773851895.162594:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a4a49aeb.
00000100:00000200:11.0:1773851895.162596:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599635162176, offset 224
00000400:00000200:11.0:1773851895.162598:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15139@kfi7
00000400:00000200:11.0:1773851895.162600:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15139@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.162602:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003111fc3a nid 15139@kfi7 refs 1
00000400:00000200:11.0:1773851895.162603:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003111fc3a nid 15139@kfi7 refs 2
00000400:00000200:11.0:1773851895.162605:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003111fc3a nid 15139@kfi7 refs 3
00000400:00000200:11.0:1773851895.162607:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15139@kfi7 local destination
00000400:00000200:11.0:1773851895.162610:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770179:8770179:1024:4294967295] 15139@kfi7 LPNI seq info [21994571:21994571:16:4294967295]
00000400:00000200:11.0:1773851895.162612:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003111fc3a nid 15139@kfi7 refs 2
00000400:00000200:11.0:1773851895.162614:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15139@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.162617:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15139@kfi7(15139@kfi7:15139@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851895.162619:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003111fc3a nid 15139@kfi7 refs 3
00000800:00000200:11.0:1773851895.162621:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851895.162623:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851895.162627:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851895.162631:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe8c Using peer 15139@kfi7(0xe8c)
00000800:00000200:11.0:1773851895.162636:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0xe8c: rc=0
00000800:00000200:11.0:1773851895.162638:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe8c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851895.162642:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.162643:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d7f62fa refcount 2 to 15138@kfi7
00010000:00000001:11.0:1773851895.162644:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851895.162645:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.162646:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851895.162647:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b21aff5c x1859599635162176/t0(0) o400->9b2b209f-f0f5-4861-93c5-b11af2e449e6@15138@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1435-0'
00000100:00100000:11.0:1773851895.162653:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b21aff5c pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9b2b209f-f0f5-4861-93c5-b11af2e449e6+5:39636:x1859599635162176:12345-15138@kfi7:400:default-tuolumne1435-0 Request processed in 100us (156us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851895.162653:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe8c TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851895.162656:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851895.162657:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15138@kfi7, seq: 2130866
00000100:00000040:11.0:1773851895.162658:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e1e869d0 : new rpc_count 0
00000400:00000200:9.0:1773851895.162658:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15139@kfi7: PUT: OK
00000100:00000001:11.0:1773851895.162659:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851895.162659:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a4a49aeb
00000100:00000001:11.0:1773851895.162660:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851895.162661:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851895.162662:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000400:00000010:9.0:1773851895.162663:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a4a49aeb.
00000020:00000010:11.0:1773851895.162664:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000575f5ace.
00000100:00000001:9.0:1773851895.162664:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:11.0:1773851895.162665:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e1e869d0 : new refcount 4
00000100:00000001:9.0:1773851895.162665:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:11.0:1773851895.162666:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851895.162666:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003111fc3a nid 15139@kfi7 refs 2
00000800:00000200:9.0:1773851895.162669:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 15139@kfi7(00000000b8b0103d):0x0 lsk 3725 rsk 43 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe8c Transaction freed
00000800:00000200:21.0:1773851895.166092:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851895.166094:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851895.166096:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851895.166100:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851895.166103:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21088@kfi7 to cpt 5
00000400:00000200:21.0:1773851895.166105:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21088@kfi7 : PUT - for me
00000400:00000200:21.0:1773851895.166106:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21088@kfi7 to cpt 5
00000400:00000200:21.0:1773851895.166108:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c5b0294 nid 21088@kfi7 refs 1
00000400:00000200:21.0:1773851895.166110:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21088@kfi7 to cpt 5
00000400:00000200:21.0:1773851895.166111:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c5b0294 nid 21088@kfi7 refs 2
00000400:00000200:21.0:1773851895.166113:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002c5b0294 nid 21088@kfi7 refs 3
00000400:00000200:21.0:1773851895.166114:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21153@kfi7 to cpt 3
00000400:00000200:21.0:1773851895.166115:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21153@kfi7 of length 224 into portal 12 MB=0x69b1ccdf8b680
00000400:00000200:21.0:1773851895.166118:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21153@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 63448
00000800:00000200:21.0:1773851895.166121:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851895.166124:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851895.166125:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21088@kfi7: PUT: OK
00000100:00000001:21.0:1773851895.166127:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851895.166128:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851895.166129:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f06301f4.
00000100:00000040:21.0:1773851895.166131:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000f06301f4 x1859397877282432 msgsize 224
00000100:00100000:21.0:1773851895.166133:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21153@kfi7 (source: 12345-21088@kfi7)
00000100:00000001:21.0:1773851895.166135:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851895.166136:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002c5b0294 nid 21088@kfi7 refs 2
00000100:00000001:20.0:1773851895.166137:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851895.166138:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851895.166138:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851895.166139:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851895.166140:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851895.166141:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851895.166142:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859397877282432
00000020:00000001:20.0:1773851895.166143:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851895.166144:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07a539717f6
00000020:00000001:20.0:1773851895.166145:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851895.166148:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fc2f4dd7 refcount=8
00000020:00000001:20.0:1773851895.166149:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636980069539840 : -107093640011776 : ffff9e9951a12000)
00000020:00000001:20.0:1773851895.166150:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636980069539840 : -107093640011776 : ffff9e9951a12000)
00000100:00000001:20.0:1773851895.166152:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.166153:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851895.166154:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851895.166156:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.166157:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851895.166159:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851895.166159:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851895.166160:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851895.166162:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851895.166163:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851895.166164:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.166165:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851895.166167:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851895.166168:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851895.166168:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851895.166168:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851895.166170:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21153@kfi7, seq: 1998069
00000100:00000001:23.0:1773851895.166171:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.166171:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fc2f4dd7 : new rpc_count 2
00000100:00000001:23.0:1773851895.166172:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.166172:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701975552 : -106936007576064 : ffff9ebe05413600)
00000100:00000040:20.0:1773851895.166174:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f06301f4 x1859397877282432/t0(0) o400->03a2a88e-3158-4bde-aa9c-a45d25771d33@21153@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1808-0'
00000100:00000001:20.0:1773851895.166178:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.166179:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851895.166180:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f06301f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:03a2a88e-3158-4bde-aa9c-a45d25771d33+8:39877:x1859397877282432:12345-21153@kfi7:400:default-tuolumne1808-0
00000100:00000200:20.0:1773851895.166183:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859397877282432
00000020:00000001:20.0:1773851895.166184:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851895.166185:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851895.166186:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.166187:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851895.166188:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851895.166190:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851895.166191:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859397877282432, found 0 last_xid 1859397862346303
00000020:00000001:20.0:1773851895.166192:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851895.166194:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851895.166195:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851895.166196:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.166197:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851895.166198:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851895.166199:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851895.166200:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000002a6aa57.
02000000:00000001:20.0:1773851895.166201:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.166202:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.166204:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851895.166205:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183041522312, transno 0, xid 1859397877282432
00010000:00000001:20.0:1773851895.166207:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851895.166208:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f06301f4 x1859397877282432/t0(0) o400->03a2a88e-3158-4bde-aa9c-a45d25771d33@21153@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1808-0'
00010000:00000001:20.0:1773851895.166213:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851895.166214:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851895.166215:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=128 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851895.166217:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851895.166218:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000431fc875 refcount 3 to 21153@kfi7
00000100:00000001:20.0:1773851895.166220:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487619776 : -107151221931840 : ffff9e8be97ac0c0)
02000000:00000001:20.0:1773851895.166221:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851895.166222:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.166223:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851895.166225:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21088@kfi7
00000400:00000010:20.0:1773851895.166226:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000046fff747.
00000100:00000200:20.0:1773851895.166227:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859397877282432, offset 224
00000400:00000200:20.0:1773851895.166230:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21088@kfi7
00000400:00000200:20.0:1773851895.166231:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21088@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.166233:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c5b0294 nid 21088@kfi7 refs 1
00000400:00000200:20.0:1773851895.166235:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002c5b0294 nid 21088@kfi7 refs 2
00000400:00000200:20.0:1773851895.166237:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002c5b0294 nid 21088@kfi7 refs 3
00000400:00000200:20.0:1773851895.166239:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21088@kfi7 local destination
00000400:00000200:20.0:1773851895.166241:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770180:8770180:1024:4294967295] 21088@kfi7 LPNI seq info [689130:689130:16:4294967295]
00000400:00000200:20.0:1773851895.166244:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002c5b0294 nid 21088@kfi7 refs 2
00000400:00000200:20.0:1773851895.166245:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21088@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.166249:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21088@kfi7(21088@kfi7:21088@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851895.166251:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002c5b0294 nid 21088@kfi7 refs 3
00000800:00000200:20.0:1773851895.166254:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851895.166256:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851895.166260:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851895.166264:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a67 Using peer 21088@kfi7(0x100000000000a67)
00000800:00000200:20.0:1773851895.166270:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x100000000000a67: rc=0
00000800:00000200:20.0:1773851895.166273:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a67 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851895.166277:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.166278:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000431fc875 refcount 2 to 21153@kfi7
00010000:00000001:20.0:1773851895.166280:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851895.166281:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.166282:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851895.166284:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f06301f4 x1859397877282432/t0(0) o400->03a2a88e-3158-4bde-aa9c-a45d25771d33@21153@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1808-0'
00000100:00100000:20.0:1773851895.166290:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f06301f4 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:03a2a88e-3158-4bde-aa9c-a45d25771d33+8:39877:x1859397877282432:12345-21153@kfi7:400:default-tuolumne1808-0 Request processed in 110us (158us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851895.166294:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21153@kfi7, seq: 1998069
00000100:00000040:20.0:1773851895.166296:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fc2f4dd7 : new rpc_count 1
00000100:00000001:20.0:1773851895.166297:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851895.166298:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851895.166299:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.166300:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851895.166302:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851895.166303:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000fc2f4dd7 : new refcount 7
00000100:00000001:20.0:1773851895.166304:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851895.166312:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a67 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851895.166315:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851895.166317:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21088@kfi7: PUT: OK
00000400:00000200:21.0:1773851895.166319:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000046fff747
00000400:00000010:21.0:1773851895.166320:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000046fff747.
00000100:00000001:21.0:1773851895.166321:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851895.166322:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851895.166323:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002c5b0294 nid 21088@kfi7 refs 2
00000800:00000200:21.0:1773851895.166325:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 21088@kfi7(00000000e80dfebe):0x0 lsk 2664 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000a67 Transaction freed
00000800:00000200:13.0:1773851895.212387:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.212389:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851895.212391:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851895.212395:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851895.212399:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14545@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.212402:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14545@kfi7 : PUT - for me
00000400:00000200:13.0:1773851895.212403:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14545@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.212406:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dbc97a64 nid 14545@kfi7 refs 1
00000400:00000200:13.0:1773851895.212408:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14545@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.212409:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dbc97a64 nid 14545@kfi7 refs 2
00000400:00000200:13.0:1773851895.212411:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dbc97a64 nid 14545@kfi7 refs 3
00000400:00000200:13.0:1773851895.212412:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14545@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.212414:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14545@kfi7 of length 224 into portal 12 MB=0x69b4b7c50e7c0
00000400:00000200:13.0:1773851895.212416:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14545@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 56304
00000800:00000200:13.0:1773851895.212419:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851895.212422:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851895.212424:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14545@kfi7: PUT: OK
00000100:00000001:13.0:1773851895.212426:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851895.212426:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851895.212428:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000068435085.
00000100:00000040:13.0:1773851895.212429:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000068435085 x1859598370793408 msgsize 224
00000100:00100000:13.0:1773851895.212432:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14545@kfi7 (source: 12345-14545@kfi7)
00000100:00000001:13.0:1773851895.212433:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851895.212435:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dbc97a64 nid 14545@kfi7 refs 2
00000100:00000001:15.0:1773851895.212436:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851895.212437:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851895.212437:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851895.212438:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851895.212439:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851895.212441:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851895.212442:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598370793408
00000020:00000001:15.0:1773851895.212443:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.212444:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d805b2
00000020:00000001:15.0:1773851895.212445:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.212451:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f8e4c0c1 refcount=5
00000020:00000001:15.0:1773851895.212452:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132986777600 : -106940722774016 : ffff9ebcec350000)
00000020:00000001:15.0:1773851895.212454:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132986777600 : -106940722774016 : ffff9ebcec350000)
00000100:00000001:15.0:1773851895.212455:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.212457:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.212458:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000057e36ed.
00000020:00000010:15.0:1773851895.212460:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.212461:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.212463:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.212463:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.212464:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.212466:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851895.212467:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851895.212468:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.212469:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.212470:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.212471:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.212471:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851895.212472:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14545@kfi7, seq: 2289925
00000100:00000001:12.0:1773851895.212472:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851895.212473:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f8e4c0c1 : new rpc_count 1
00000100:00000001:12.0:1773851895.212473:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.212474:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636950415899008 : -107123293652608 : ffff9e926a227980)
00000100:00000001:12.0:1773851895.212474:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.212476:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000068435085 x1859598370793408/t0(0) o400->011b6d11-1cf4-4807-b746-50f13c4ce538@14545@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1393-0'
00000100:00000001:15.0:1773851895.212479:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.212480:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.212481:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068435085 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:011b6d11-1cf4-4807-b746-50f13c4ce538+5:39562:x1859598370793408:12345-14545@kfi7:400:default-tuolumne1393-0
00000100:00000200:15.0:1773851895.212482:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598370793408
00000020:00000001:15.0:1773851895.212483:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.212484:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.212484:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.212485:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.212486:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851895.212487:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.212487:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598370793408, found 0 last_xid 1859598370793407
00000020:00000001:15.0:1773851895.212488:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.212489:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.212490:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.212490:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.212491:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851895.212492:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.212492:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.212493:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d92f899c.
02000000:00000001:15.0:1773851895.212494:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.212495:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.212495:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.212496:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698956, transno 0, xid 1859598370793408
00010000:00000001:15.0:1773851895.212497:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.212498:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000068435085 x1859598370793408/t0(0) o400->011b6d11-1cf4-4807-b746-50f13c4ce538@14545@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1393-0'
00010000:00000001:15.0:1773851895.212501:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.212502:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.212502:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.212504:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.212504:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c28213b7 refcount 3 to 14545@kfi7
00000100:00000001:15.0:1773851895.212505:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487619872 : -107151221931744 : ffff9e8be97ac120)
02000000:00000001:15.0:1773851895.212507:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.212507:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.212508:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.212509:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14545@kfi7
00000400:00000010:15.0:1773851895.212509:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c01d933.
00000100:00000200:15.0:1773851895.212510:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598370793408, offset 224
00000400:00000200:15.0:1773851895.212512:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14545@kfi7
00000400:00000200:15.0:1773851895.212513:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14545@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.212514:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dbc97a64 nid 14545@kfi7 refs 1
00000400:00000200:15.0:1773851895.212515:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dbc97a64 nid 14545@kfi7 refs 2
00000400:00000200:15.0:1773851895.212516:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dbc97a64 nid 14545@kfi7 refs 3
00000400:00000200:15.0:1773851895.212517:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14545@kfi7 local destination
00000400:00000200:15.0:1773851895.212519:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770181:8770181:1024:4294967295] 14545@kfi7 LPNI seq info [7066521:7066521:16:4294967295]
00000400:00000200:15.0:1773851895.212520:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dbc97a64 nid 14545@kfi7 refs 2
00000400:00000200:15.0:1773851895.212521:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14545@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.212523:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14545@kfi7(14545@kfi7:14545@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.212524:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dbc97a64 nid 14545@kfi7 refs 3
00000800:00000200:15.0:1773851895.212525:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.212526:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851895.212528:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.212530:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000064b Using peer 14545@kfi7(0x10000000000064b)
00000800:00000200:15.0:1773851895.212533:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007bd95d26: Posted send of 324 bytes to peer 0x10000000000064b: rc=0
00000800:00000200:15.0:1773851895.212534:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000064b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.212536:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.212537:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c28213b7 refcount 2 to 14545@kfi7
00010000:00000001:15.0:1773851895.212538:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.212539:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.212539:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.212540:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000068435085 x1859598370793408/t0(0) o400->011b6d11-1cf4-4807-b746-50f13c4ce538@14545@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1393-0'
00000100:00100000:15.0:1773851895.212543:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068435085 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:011b6d11-1cf4-4807-b746-50f13c4ce538+5:39562:x1859598370793408:12345-14545@kfi7:400:default-tuolumne1393-0 Request processed in 63us (113us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851895.212545:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000064b TN_EVENT_TX_OK event status 0
00000100:00100000:15.0:1773851895.212546:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14545@kfi7, seq: 2289925
00000100:00000040:15.0:1773851895.212546:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f8e4c0c1 : new rpc_count 0
00000400:00000200:13.0:1773851895.212546:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851895.212547:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851895.212547:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851895.212548:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851895.212548:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14545@kfi7: PUT: OK
00000400:00000200:13.0:1773851895.212548:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c01d933
00000020:00000010:15.0:1773851895.212549:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:15.0:1773851895.212549:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000057e36ed.
00000400:00000010:13.0:1773851895.212549:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c01d933.
00000100:00000001:13.0:1773851895.212549:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:15.0:1773851895.212550:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000f8e4c0c1 : new refcount 4
00000100:00000001:13.0:1773851895.212550:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851895.212551:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851895.212551:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dbc97a64 nid 14545@kfi7 refs 2
00000800:00000200:13.0:1773851895.212552:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007bd95d26: 2054@kfi7:3 -> 14545@kfi7(000000002b012d38):0x0 lsk 1612 rsk 41 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000064b Transaction freed
00000800:00000200:22.0:1773851895.238059:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851895.238060:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851895.238062:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851895.238064:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851895.238065:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21499@kfi7 to cpt 5
00000400:00000200:22.0:1773851895.238066:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21499@kfi7 : PUT - for me
00000400:00000200:22.0:1773851895.238067:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21499@kfi7 to cpt 5
00000400:00000200:22.0:1773851895.238068:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc12a825 nid 21499@kfi7 refs 1
00000400:00000200:22.0:1773851895.238069:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21499@kfi7 to cpt 5
00000400:00000200:22.0:1773851895.238069:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc12a825 nid 21499@kfi7 refs 2
00000400:00000200:22.0:1773851895.238070:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dc12a825 nid 21499@kfi7 refs 3
00000400:00000200:22.0:1773851895.238071:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21498@kfi7 to cpt 2
00000400:00000200:22.0:1773851895.238071:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21498@kfi7 of length 224 into portal 12 MB=0x699de8dc15900
00000400:00000200:22.0:1773851895.238073:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21498@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 63672
00000800:00000200:22.0:1773851895.238074:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851895.238076:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851895.238077:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21499@kfi7: PUT: OK
00000100:00000001:22.0:1773851895.238077:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851895.238078:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851895.238079:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a290d913.
00000100:00000040:22.0:1773851895.238079:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000a290d913 x1858031000312064 msgsize 224
00000100:00100000:22.0:1773851895.238080:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-21498@kfi7 (source: 12345-21499@kfi7)
00000100:00000001:22.0:1773851895.238081:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851895.238082:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc12a825 nid 21499@kfi7 refs 2
00000800:00000200:22.0:1773851895.238083:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851895.238083:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851895.238083:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851895.238084:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851895.238084:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851895.238085:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851895.238086:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031000312064
00000020:00000001:20.0:1773851895.238086:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851895.238087:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910e7
00000020:00000001:20.0:1773851895.238088:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851895.238091:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000da7abc71 refcount=6
00000020:00000001:20.0:1773851895.238092:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240344576 : -107152469207040 : ffff9e8b9f22d800)
00000020:00000001:20.0:1773851895.238093:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240344576 : -107152469207040 : ffff9e8b9f22d800)
00000100:00000001:20.0:1773851895.238094:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.238095:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851895.238095:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851895.238096:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.238097:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851895.238098:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851895.238098:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851895.238099:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851895.238099:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851895.238100:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851895.238100:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.238101:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851895.238102:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851895.238103:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851895.238103:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851895.238103:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851895.238104:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21498@kfi7, seq: 1998070
00000100:00000001:23.0:1773851895.238105:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851895.238105:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.238105:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000da7abc71 : new rpc_count 1
00000100:00000001:20.0:1773851895.238105:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382196992 : -106946327354624 : ffff9ebb9e25e300)
00000100:00000040:20.0:1773851895.238106:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a290d913 x1858031000312064/t0(0) o400->517c084d-4973-4764-8584-0af1469db95a@21498@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne252-0'
00000100:00000001:20.0:1773851895.238109:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.238109:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851895.238111:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a290d913 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:517c084d-4973-4764-8584-0af1469db95a+6:47805:x1858031000312064:12345-21498@kfi7:400:default-tuolumne252-0
00000100:00000200:20.0:1773851895.238112:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031000312064
00000020:00000001:20.0:1773851895.238113:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851895.238113:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851895.238114:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.238115:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851895.238115:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851895.238116:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851895.238117:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031000312064, found 0 last_xid 1858031000312063
00000020:00000001:20.0:1773851895.238118:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851895.238119:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851895.238119:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851895.238119:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.238120:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851895.238121:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851895.238121:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851895.238122:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aacbc4ef.
02000000:00000001:20.0:1773851895.238122:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.238123:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.238123:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851895.238124:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858031000312064
00010000:00000001:20.0:1773851895.238125:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851895.238125:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a290d913 x1858031000312064/t0(0) o400->517c084d-4973-4764-8584-0af1469db95a@21498@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne252-0'
00010000:00000001:20.0:1773851895.238128:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851895.238128:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851895.238129:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=128 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851895.238130:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851895.238131:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d045e12c refcount 5 to 21498@kfi7
00000100:00000001:20.0:1773851895.238131:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810484928 : -107154899066688 : ffff9e8b0e4e20c0)
02000000:00000001:20.0:1773851895.238132:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851895.238133:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.238133:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851895.238134:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21499@kfi7
00000400:00000010:20.0:1773851895.238135:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000056b73a04.
00000100:00000200:20.0:1773851895.238136:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858031000312064, offset 224
00000400:00000200:20.0:1773851895.238137:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21499@kfi7
00000400:00000200:20.0:1773851895.238138:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21499@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.238138:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dc12a825 nid 21499@kfi7 refs 1
00000400:00000200:20.0:1773851895.238139:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dc12a825 nid 21499@kfi7 refs 2
00000400:00000200:20.0:1773851895.238140:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dc12a825 nid 21499@kfi7 refs 3
00000400:00000200:20.0:1773851895.238142:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21499@kfi7 local destination
00000400:00000200:20.0:1773851895.238143:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770182:8770182:1024:4294967295] 21499@kfi7 LPNI seq info [28064:28064:16:4294967295]
00000400:00000200:20.0:1773851895.238144:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dc12a825 nid 21499@kfi7 refs 2
00000400:00000200:20.0:1773851895.238145:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21499@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.238147:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21499@kfi7(21499@kfi7:21499@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851895.238148:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dc12a825 nid 21499@kfi7 refs 3
00000800:00000200:20.0:1773851895.238150:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851895.238151:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851895.238153:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851895.238155:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x831 Using peer 21499@kfi7(0x831)
00000800:00000200:20.0:1773851895.238158:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x831: rc=0
00000800:00000200:20.0:1773851895.238159:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x831 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851895.238161:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.238162:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d045e12c refcount 4 to 21498@kfi7
00010000:00000001:20.0:1773851895.238162:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851895.238163:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.238164:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851895.238164:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a290d913 x1858031000312064/t0(0) o400->517c084d-4973-4764-8584-0af1469db95a@21498@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne252-0'
00000100:00100000:20.0:1773851895.238169:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a290d913 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:517c084d-4973-4764-8584-0af1469db95a+6:47805:x1858031000312064:12345-21498@kfi7:400:default-tuolumne252-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851895.238171:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21498@kfi7, seq: 1998070
00000100:00000040:20.0:1773851895.238172:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000da7abc71 : new rpc_count 0
00000100:00000001:20.0:1773851895.238172:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851895.238173:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851895.238174:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.238174:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851895.238176:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851895.238176:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000da7abc71 : new refcount 5
00000100:00000001:20.0:1773851895.238177:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851895.238182:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x831 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851895.238183:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851895.238184:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21499@kfi7: PUT: OK
00000400:00000200:21.0:1773851895.238185:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000056b73a04
00000400:00000010:21.0:1773851895.238186:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000056b73a04.
00000100:00000001:21.0:1773851895.238186:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851895.238187:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851895.238188:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dc12a825 nid 21499@kfi7 refs 2
00000800:00000200:21.0:1773851895.238189:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 21499@kfi7(00000000b332c5f3):0x0 lsk 2098 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x831 Transaction freed
00000800:00000200:13.0:1773851895.273388:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.273389:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:13.0:1773851895.273391:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:14.0:1773851895.273392:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.273392:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8992@kfi7(00000000ccdb766f):0x445 version: 2; local version 2; negotiated version: 2
00000800:00000200:14.0:1773851895.273393:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851895.273393:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 Using peer 8992@kfi7(0x100000000000445)
00000800:00000200:14.0:1773851895.273394:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851895.273395:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000800:00000200:14.0:1773851895.273396:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851895.273397:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000391fbc73: Posted send of 38 bytes to peer 0x100000000000445: rc=0
00000400:00000200:14.0:1773851895.273398:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000800:00000200:13.0:1773851895.273398:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:14.0:1773851895.273399:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8992@kfi7 : PUT - for me
00000400:00000200:14.0:1773851895.273400:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000400:00000200:14.0:1773851895.273400:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d7e2c45c nid 8992@kfi7 refs 1
00000400:00000200:14.0:1773851895.273402:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000400:00000200:14.0:1773851895.273402:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d7e2c45c nid 8992@kfi7 refs 2
00000400:00000200:14.0:1773851895.273403:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d7e2c45c nid 8992@kfi7 refs 3
00000400:00000200:14.0:1773851895.273404:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000400:00000200:14.0:1773851895.273405:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8992@kfi7 of length 224 into portal 12 MB=0x699e16d095d00
00000400:00000200:14.0:1773851895.273406:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8992@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 56528
00000800:00000200:14.0:1773851895.273408:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851895.273409:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:15.0:1773851895.273410:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851895.273410:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8992@kfi7: PUT: OK
00000100:00000001:14.0:1773851895.273411:0:2514739:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:15.0:1773851895.273412:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000391fbc73: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 Transaction freed
00000100:00000200:14.0:1773851895.273412:0:2514739:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:14.0:1773851895.273412:0:2514739:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b6c1fb22.
00000100:00000040:14.0:1773851895.273413:0:2514739:0:(events.c:358:request_in_callback()) incoming req@00000000b6c1fb22 x1858043336285440 msgsize 224
00000100:00100000:14.0:1773851895.273415:0:2514739:0:(events.c:361:request_in_callback()) peer: 12345-8992@kfi7 (source: 12345-8992@kfi7)
00000100:00000001:14.0:1773851895.273416:0:2514739:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:14.0:1773851895.273416:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d7e2c45c nid 8992@kfi7 refs 2
00000100:00000001:15.0:1773851895.273417:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851895.273417:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851895.273418:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851895.273418:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851895.273418:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851895.273419:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851895.273420:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043336285440
00000020:00000001:15.0:1773851895.273421:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.273421:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91c78
00000020:00000001:15.0:1773851895.273421:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.273426:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bcc24655 refcount=779
00000020:00000001:15.0:1773851895.273426:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628282368 : -107123081269248 : ffff9e9276cb3000)
00000020:00000001:15.0:1773851895.273427:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628282368 : -107123081269248 : ffff9e9276cb3000)
00000100:00000001:15.0:1773851895.273428:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.273429:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.273430:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007e7073c5.
00000020:00000010:15.0:1773851895.273431:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.273432:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.273433:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.273433:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.273434:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.273435:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851895.273435:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851895.273435:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.273436:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.273438:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.273438:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.273438:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851895.273438:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851895.273439:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8992@kfi7, seq: 2289926
00000100:00000040:15.0:1773851895.273440:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bcc24655 : new rpc_count 3
00000100:00000001:15.0:1773851895.273440:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637008771882880 : -107064937668736 : ffff9ea0006c1f80)
00000100:00000001:12.0:1773851895.273440:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851895.273440:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.273441:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b6c1fb22 x1858043336285440/t0(0) o400->561e8f84-6e6b-423f-abef-0c029a806187@8992@kfi7:535/0 lens 224/0 e 0 to 0 dl 1773852650 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1055-0'
00000100:00000001:15.0:1773851895.273444:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.273444:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.273445:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6c1fb22 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:561e8f84-6e6b-423f-abef-0c029a806187+779:39827:x1858043336285440:12345-8992@kfi7:400:default-tuolumne1055-0
00000100:00000200:15.0:1773851895.273447:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043336285440
00000020:00000001:15.0:1773851895.273447:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.273448:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.273449:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.273449:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.273450:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851895.273450:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.273451:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043336285440, found 0 last_xid 1858043246397247
00000020:00000001:15.0:1773851895.273452:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.273452:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.273453:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.273453:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.273454:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851895.273455:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.273455:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.273456:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000057e36ed.
02000000:00000001:15.0:1773851895.273457:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.273457:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.273458:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.273459:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264575056, transno 0, xid 1858043336285440
00010000:00000001:15.0:1773851895.273459:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.273460:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b6c1fb22 x1858043336285440/t0(0) o400->561e8f84-6e6b-423f-abef-0c029a806187@8992@kfi7:535/0 lens 224/224 e 0 to 0 dl 1773852650 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1055-0'
00010000:00000001:15.0:1773851895.273462:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.273463:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.273464:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.273465:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.273465:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001079cee5 refcount 3 to 8992@kfi7
00000100:00000001:15.0:1773851895.273466:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015833920 : -107152693717696 : ffff9e8b91c11540)
02000000:00000001:15.0:1773851895.273467:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.273467:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.273468:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.273468:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8992@kfi7
00000400:00000010:15.0:1773851895.273469:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000019bef8e5.
00000100:00000200:15.0:1773851895.273470:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043336285440, offset 224
00000400:00000200:15.0:1773851895.273471:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8992@kfi7
00000400:00000200:15.0:1773851895.273472:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.273472:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d7e2c45c nid 8992@kfi7 refs 1
00000400:00000200:15.0:1773851895.273474:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d7e2c45c nid 8992@kfi7 refs 2
00000400:00000200:15.0:1773851895.273475:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d7e2c45c nid 8992@kfi7 refs 3
00000400:00000200:15.0:1773851895.273476:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8992@kfi7 local destination
00000400:00000200:15.0:1773851895.273477:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770183:8770183:1024:4294967295] 8992@kfi7 LPNI seq info [880525:880525:16:4294967295]
00000400:00000200:15.0:1773851895.273478:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d7e2c45c nid 8992@kfi7 refs 2
00000400:00000200:15.0:1773851895.273479:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8992@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.273481:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8992@kfi7(8992@kfi7:8992@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.273483:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d7e2c45c nid 8992@kfi7 refs 3
00000800:00000200:15.0:1773851895.273484:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.273485:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851895.273487:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.273489:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 Using peer 8992@kfi7(0x100000000000445)
00000800:00000200:15.0:1773851895.273492:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x100000000000445: rc=0
00000800:00000200:15.0:1773851895.273493:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.273495:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.273496:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001079cee5 refcount 2 to 8992@kfi7
00010000:00000001:15.0:1773851895.273497:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.273497:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.273498:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.273499:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b6c1fb22 x1858043336285440/t0(0) o400->561e8f84-6e6b-423f-abef-0c029a806187@8992@kfi7:535/0 lens 224/224 e 0 to 0 dl 1773852650 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1055-0'
00000100:00100000:15.0:1773851895.273502:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6c1fb22 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:561e8f84-6e6b-423f-abef-0c029a806187+779:39827:x1858043336285440:12345-8992@kfi7:400:default-tuolumne1055-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851895.273504:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8992@kfi7, seq: 2289926
00000100:00000040:15.0:1773851895.273505:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bcc24655 : new rpc_count 2
00000800:00000200:14.0:1773851895.273505:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851895.273506:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851895.273506:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851895.273507:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.273508:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:15.0:1773851895.273508:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007e7073c5.
00000020:00000040:15.0:1773851895.273509:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000bcc24655 : new refcount 778
00000400:00000200:14.0:1773851895.273509:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851895.273510:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:14.0:1773851895.273510:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8992@kfi7: PUT: OK
00000400:00000200:14.0:1773851895.273510:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000019bef8e5
00000400:00000010:14.0:1773851895.273511:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000019bef8e5.
00000100:00000001:14.0:1773851895.273512:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851895.273512:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851895.273513:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d7e2c45c nid 8992@kfi7 refs 2
00000800:00000200:14.0:1773851895.273514:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2054@kfi7:3 -> 8992@kfi7(00000000ccdb766f):0x0 lsk 1094 rsk 57 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000445 Transaction freed
00000800:00000200:29.0:1773851895.300901:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851895.300902:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.300905:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851895.300908:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851895.300911:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25699@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.300913:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25699@kfi7 : PUT - for me
00000400:00000200:29.0:1773851895.300915:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25699@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.300916:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1d57752 nid 25699@kfi7 refs 1
00000400:00000200:29.0:1773851895.300918:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25699@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.300919:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1d57752 nid 25699@kfi7 refs 2
00000400:00000200:29.0:1773851895.300921:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e1d57752 nid 25699@kfi7 refs 3
00000400:00000200:29.0:1773851895.300922:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25763@kfi7 to cpt 2
00000400:00000200:29.0:1773851895.300924:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25763@kfi7 of length 224 into portal 12 MB=0x699e0d4d04800
00000400:00000200:29.0:1773851895.300926:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25763@kfi7 of length 224/224 into md 0x77fe1859d [64] + 7248
00000800:00000200:29.0:1773851895.300929:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851895.300931:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.300933:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25699@kfi7: PUT: OK
00000100:00000001:29.0:1773851895.300934:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851895.300935:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851895.300936:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005aed8c46.
00000100:00000040:29.0:1773851895.300937:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000005aed8c46 x1858040782407680 msgsize 224
00000100:00100000:29.0:1773851895.300940:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25763@kfi7 (source: 12345-25699@kfi7)
00000100:00000001:29.0:1773851895.300942:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851895.300943:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1d57752 nid 25699@kfi7 refs 2
00000100:00000001:31.0:1773851895.300944:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851895.300945:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851895.300945:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851895.300946:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851895.300947:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.300948:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851895.300950:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040782407680
00000020:00000001:31.0:1773851895.300951:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851895.300951:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91421
00000020:00000001:31.0:1773851895.300952:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851895.300957:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006994c19 refcount=6
00000020:00000001:31.0:1773851895.300958:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240795136 : -107152468756480 : ffff9e8b9f29b800)
00000020:00000001:31.0:1773851895.300959:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240795136 : -107152468756480 : ffff9e8b9f29b800)
00000100:00000001:31.0:1773851895.300961:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.300962:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851895.300963:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851895.300965:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.300966:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851895.300968:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851895.300968:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851895.300969:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.300971:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851895.300972:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851895.300973:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.300974:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.300976:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851895.300977:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851895.300978:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851895.300978:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851895.300979:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25763@kfi7, seq: 2055590
00000100:00000040:31.0:1773851895.300981:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006994c19 : new rpc_count 1
00000100:00000001:30.0:1773851895.300981:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.300982:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262225920 : -106943447325696 : ffff9ebc49cfa400)
00000100:00000001:30.0:1773851895.300982:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.300984:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005aed8c46 x1858040782407680/t0(0) o400->c31e69db-e162-43b8-a9cf-919ff04463b9@25763@kfi7:683/0 lens 224/0 e 0 to 0 dl 1773852043 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2092-0'
00000100:00000001:31.0:1773851895.300988:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.300989:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851895.300990:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005aed8c46 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:c31e69db-e162-43b8-a9cf-919ff04463b9+6:39814:x1858040782407680:12345-25763@kfi7:400:default-tuolumne2092-0
00000100:00000200:31.0:1773851895.300993:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040782407680
00000020:00000001:31.0:1773851895.300994:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851895.300995:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851895.300996:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.300997:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851895.300998:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851895.300999:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851895.301000:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040782407680, found 0 last_xid 1858040782407679
00000020:00000001:31.0:1773851895.301002:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851895.301003:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851895.301004:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851895.301004:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.301006:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851895.301006:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851895.301007:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851895.301008:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000047470845.
02000000:00000001:31.0:1773851895.301009:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.301011:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.301012:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851895.301013:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595496, transno 0, xid 1858040782407680
00010000:00000001:31.0:1773851895.301014:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851895.301016:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005aed8c46 x1858040782407680/t0(0) o400->c31e69db-e162-43b8-a9cf-919ff04463b9@25763@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2092-0'
00010000:00000001:31.0:1773851895.301020:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851895.301022:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851895.301023:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=128 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851895.301025:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851895.301026:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c3a44598 refcount 3 to 25763@kfi7
00000100:00000001:31.0:1773851895.301027:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133984 : -107146658417632 : ffff9e8cf97c7420)
02000000:00000001:31.0:1773851895.301028:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851895.301029:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.301030:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851895.301031:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25699@kfi7
00000400:00000010:31.0:1773851895.301032:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fab8ac69.
00000100:00000200:31.0:1773851895.301034:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040782407680, offset 224
00000400:00000200:31.0:1773851895.301036:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25699@kfi7
00000400:00000200:31.0:1773851895.301037:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25699@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.301039:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1d57752 nid 25699@kfi7 refs 1
00000400:00000200:31.0:1773851895.301040:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e1d57752 nid 25699@kfi7 refs 2
00000400:00000200:31.0:1773851895.301042:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e1d57752 nid 25699@kfi7 refs 3
00000400:00000200:31.0:1773851895.301044:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25699@kfi7 local destination
00000400:00000200:31.0:1773851895.301046:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770184:8770184:1024:4294967295] 25699@kfi7 LPNI seq info [2423954:2423954:16:4294967295]
00000400:00000200:31.0:1773851895.301048:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e1d57752 nid 25699@kfi7 refs 2
00000400:00000200:31.0:1773851895.301050:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25699@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.301053:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25699@kfi7(25699@kfi7:25699@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851895.301055:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e1d57752 nid 25699@kfi7 refs 3
00000800:00000200:31.0:1773851895.301057:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851895.301059:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851895.301062:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851895.301066:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001ea Using peer 25699@kfi7(0x1000000000001ea)
00000800:00000200:31.0:1773851895.301071:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x1000000000001ea: rc=0
00000800:00000200:31.0:1773851895.301073:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001ea TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851895.301076:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.301078:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c3a44598 refcount 2 to 25763@kfi7
00010000:00000001:31.0:1773851895.301079:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851895.301080:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.301081:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851895.301082:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005aed8c46 x1858040782407680/t0(0) o400->c31e69db-e162-43b8-a9cf-919ff04463b9@25763@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2092-0'
00000100:00100000:31.0:1773851895.301087:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005aed8c46 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:c31e69db-e162-43b8-a9cf-919ff04463b9+6:39814:x1858040782407680:12345-25763@kfi7:400:default-tuolumne2092-0 Request processed in 98us (149us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851895.301087:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001ea TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851895.301090:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.301091:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25699@kfi7: PUT: OK
00000100:00100000:31.0:1773851895.301092:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25763@kfi7, seq: 2055590
00000400:00000200:29.0:1773851895.301092:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fab8ac69
00000100:00000040:31.0:1773851895.301093:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006994c19 : new rpc_count 0
00000100:00000001:31.0:1773851895.301094:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:29.0:1773851895.301094:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fab8ac69.
00000100:00000001:31.0:1773851895.301095:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:29.0:1773851895.301095:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851895.301095:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851895.301096:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.301097:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000200:29.0:1773851895.301097:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1d57752 nid 25699@kfi7 refs 2
00000020:00000010:31.0:1773851895.301098:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000020:00000040:31.0:1773851895.301099:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000006994c19 : new refcount 5
00000800:00000200:29.0:1773851895.301099:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 25699@kfi7(00000000be0dbe50):0x0 lsk 491 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000001ea Transaction freed
00000100:00000001:31.0:1773851895.301100:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851895.326871:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851895.326872:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.326874:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851895.326877:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851895.326880:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.326882:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19395@kfi7 : PUT - for me
00000400:00000200:29.0:1773851895.326883:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.326885:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 1
00000400:00000200:29.0:1773851895.326887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.326888:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:29.0:1773851895.326889:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000400:00000200:29.0:1773851895.326891:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19394@kfi7 to cpt 4
00000400:00000200:29.0:1773851895.326892:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19394@kfi7 of length 224 into portal 12 MB=0x69b097c92afc0
00000400:00000200:29.0:1773851895.326894:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19394@kfi7 of length 224/224 into md 0x77fe1859d [64] + 7472
00000800:00000200:29.0:1773851895.326897:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851895.326899:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.326901:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19395@kfi7: PUT: OK
00000100:00000001:29.0:1773851895.326902:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851895.326903:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851895.326904:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce548e2b.
00000100:00000040:29.0:1773851895.326905:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ce548e2b x1859314907262912 msgsize 224
00000100:00100000:29.0:1773851895.326907:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19394@kfi7 (source: 12345-19395@kfi7)
00000100:00000001:29.0:1773851895.326908:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851895.326910:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000100:00000001:31.0:1773851895.326911:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851895.326912:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851895.326912:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851895.326912:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851895.326913:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.326914:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851895.326915:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314907262912
00000020:00000001:31.0:1773851895.326916:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851895.326916:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c4d
00000020:00000001:31.0:1773851895.326917:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851895.326922:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eccb7df6 refcount=6
00000020:00000001:31.0:1773851895.326923:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743945216 : -107128965606400 : ffff9e91180f5400)
00000020:00000001:31.0:1773851895.326924:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743945216 : -107128965606400 : ffff9e91180f5400)
00000100:00000001:31.0:1773851895.326926:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.326928:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851895.326929:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851895.326930:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.326931:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851895.326932:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851895.326933:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851895.326934:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.326935:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851895.326936:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851895.326936:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.326938:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.326939:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851895.326940:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851895.326940:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851895.326941:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19394@kfi7, seq: 2055591
00000100:00000001:30.0:1773851895.326941:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851895.326942:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eccb7df6 : new rpc_count 1
00000100:00000001:30.0:1773851895.326942:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.326943:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262231680 : -106943447319936 : ffff9ebc49cfba80)
00000100:00000001:30.0:1773851895.326943:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.326945:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ce548e2b x1859314907262912/t0(0) o400->67c43a80-88b3-4f02-9cae-8e23142e67d4@19394@kfi7:683/0 lens 224/0 e 0 to 0 dl 1773852043 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1703-0'
00000100:00000001:31.0:1773851895.326950:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.326950:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851895.326952:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce548e2b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:67c43a80-88b3-4f02-9cae-8e23142e67d4+6:39961:x1859314907262912:12345-19394@kfi7:400:default-tuolumne1703-0
00000100:00000200:31.0:1773851895.326954:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314907262912
00000020:00000001:31.0:1773851895.326955:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851895.326955:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851895.326956:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.326957:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851895.326958:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851895.326959:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851895.326960:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314907262912, found 0 last_xid 1859314907262911
00000020:00000001:31.0:1773851895.326961:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851895.326962:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851895.326962:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851895.326963:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.326964:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851895.326965:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851895.326966:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851895.326967:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001c4eb1a9.
02000000:00000001:31.0:1773851895.326968:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.326968:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.326969:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851895.326970:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314907262912
00010000:00000001:31.0:1773851895.326972:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851895.326973:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ce548e2b x1859314907262912/t0(0) o400->67c43a80-88b3-4f02-9cae-8e23142e67d4@19394@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1703-0'
00010000:00000001:31.0:1773851895.326977:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851895.326978:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851895.326978:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=128 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851895.326980:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851895.326981:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e162e19 refcount 5 to 19394@kfi7
00000100:00000001:31.0:1773851895.326982:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928370152288 : -107145339399328 : ffff9e8d481b1360)
02000000:00000001:31.0:1773851895.326983:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851895.326984:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.326985:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851895.326986:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19395@kfi7
00000400:00000010:31.0:1773851895.326987:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa0db5be.
00000100:00000200:31.0:1773851895.326988:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314907262912, offset 224
00000400:00000200:31.0:1773851895.326990:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19395@kfi7
00000400:00000200:31.0:1773851895.326991:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.326993:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 1
00000400:00000200:31.0:1773851895.326994:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:31.0:1773851895.326996:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000400:00000200:31.0:1773851895.326997:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19395@kfi7 local destination
00000400:00000200:31.0:1773851895.326999:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770185:8770185:1024:4294967295] 19395@kfi7 LPNI seq info [8381840:8381840:16:4294967295]
00000400:00000200:31.0:1773851895.327001:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000400:00000200:31.0:1773851895.327002:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19395@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.327006:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19395@kfi7(19395@kfi7:19395@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851895.327008:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 3
00000800:00000200:31.0:1773851895.327011:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851895.327012:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851895.327016:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851895.327019:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc Using peer 19395@kfi7(0x5fc)
00000800:00000200:31.0:1773851895.327024:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x5fc: rc=0
00000800:00000200:31.0:1773851895.327027:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851895.327030:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.327031:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e162e19 refcount 4 to 19394@kfi7
00010000:00000001:31.0:1773851895.327032:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851895.327033:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.327034:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851895.327035:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce548e2b x1859314907262912/t0(0) o400->67c43a80-88b3-4f02-9cae-8e23142e67d4@19394@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1703-0'
00000100:00100000:31.0:1773851895.327039:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce548e2b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:67c43a80-88b3-4f02-9cae-8e23142e67d4+6:39961:x1859314907262912:12345-19394@kfi7:400:default-tuolumne1703-0 Request processed in 89us (133us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851895.327040:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851895.327043:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19394@kfi7, seq: 2055591
00000400:00000200:29.0:1773851895.327043:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:31.0:1773851895.327044:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eccb7df6 : new rpc_count 0
00000400:00000200:29.0:1773851895.327044:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19395@kfi7: PUT: OK
00000100:00000001:31.0:1773851895.327045:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851895.327045:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa0db5be
00000100:00000001:31.0:1773851895.327046:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:29.0:1773851895.327046:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa0db5be.
00000020:00000010:31.0:1773851895.327047:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000100:00000001:29.0:1773851895.327047:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:31.0:1773851895.327048:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000100:00000001:29.0:1773851895.327048:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851895.327049:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000400:00000200:29.0:1773851895.327049:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001b352432 nid 19395@kfi7 refs 2
00000020:00000040:31.0:1773851895.327050:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000eccb7df6 : new refcount 5
00000100:00000001:31.0:1773851895.327051:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851895.327051:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2069@kfi7:7 -> 19395@kfi7(00000000c5a5a45a):0x0 lsk 1533 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x5fc Transaction freed
00000800:00000200:2.0:1773851895.340698:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851895.340699:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851895.340700:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851895.340703:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851895.340705:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24689@kfi7 to cpt 0
00000400:00000200:2.0:1773851895.340706:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24689@kfi7 : PUT - for me
00000400:00000200:2.0:1773851895.340707:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24689@kfi7 to cpt 0
00000400:00000200:2.0:1773851895.340708:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029242c4c nid 24689@kfi7 refs 1
00000400:00000200:2.0:1773851895.340709:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24689@kfi7 to cpt 0
00000400:00000200:2.0:1773851895.340709:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029242c4c nid 24689@kfi7 refs 2
00000400:00000200:2.0:1773851895.340710:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000029242c4c nid 24689@kfi7 refs 3
00000400:00000200:2.0:1773851895.340712:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24689@kfi7 to cpt 0
00000400:00000200:2.0:1773851895.340713:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24689@kfi7 of length 224 into portal 12 MB=0x69b4c5e744f40
00000400:00000200:2.0:1773851895.340714:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24689@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 51664
00000800:00000200:2.0:1773851895.340716:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851895.340718:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851895.340719:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24689@kfi7: PUT: OK
00000100:00000001:2.0:1773851895.340720:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851895.340720:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851895.340722:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000280c0610.
00000100:00000040:2.0:1773851895.340723:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000280c0610 x1859602164764480 msgsize 224
00000100:00100000:2.0:1773851895.340724:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-24689@kfi7 (source: 12345-24689@kfi7)
00000100:00000001:2.0:1773851895.340728:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851895.340729:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000029242c4c nid 24689@kfi7 refs 2
00000800:00000200:2.0:1773851895.340730:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851895.340730:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851895.340730:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851895.340731:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851895.340731:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851895.340732:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851895.340733:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602164764480
00000020:00000001:0.0:1773851895.340733:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851895.340733:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7dd6d
00000020:00000001:0.0:1773851895.340734:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851895.340735:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c67188d2 refcount=5
00000020:00000001:0.0:1773851895.340736:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637154648667136 : -106919060884480 : ffff9ec1f75b3400)
00000020:00000001:0.0:1773851895.340736:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637154648667136 : -106919060884480 : ffff9ec1f75b3400)
00000100:00000001:0.0:1773851895.340737:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851895.340738:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851895.340739:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851895.340740:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851895.340741:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851895.340742:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851895.340742:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851895.340742:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851895.340743:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851895.340744:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851895.340744:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.340745:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851895.340746:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851895.340747:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851895.340747:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851895.340747:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851895.340748:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24689@kfi7, seq: 1997622
00000100:00000001:2.0:1773851895.340749:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851895.340749:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851895.340749:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c67188d2 : new rpc_count 1
00000100:00000001:0.0:1773851895.340750:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159877916160 : -106913831635456 : ffff9ec32f0b3600)
00000100:00000040:0.0:1773851895.340751:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000280c0610 x1859602164764480/t0(0) o400->119ddbde-bdea-4fae-aa88-2cb8591b258c@24689@kfi7:535/0 lens 224/0 e 0 to 0 dl 1773852650 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2030-0'
00000100:00000001:0.0:1773851895.340753:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851895.340756:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851895.340757:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000280c0610 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:119ddbde-bdea-4fae-aa88-2cb8591b258c+5:39549:x1859602164764480:12345-24689@kfi7:400:default-tuolumne2030-0
00000100:00000200:0.0:1773851895.340759:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602164764480
00000020:00000001:0.0:1773851895.340759:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851895.340760:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851895.340761:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.340761:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851895.340762:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851895.340763:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851895.340764:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602164764480, found 0 last_xid 1859602164764479
00000020:00000001:0.0:1773851895.340764:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851895.340765:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851895.340766:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851895.340766:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.340767:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851895.340768:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851895.340768:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851895.340770:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057ef75bb.
02000000:00000001:0.0:1773851895.340770:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.340771:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.340772:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851895.340772:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046970990, transno 0, xid 1859602164764480
00010000:00000001:0.0:1773851895.340773:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851895.340774:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000280c0610 x1859602164764480/t0(0) o400->119ddbde-bdea-4fae-aa88-2cb8591b258c@24689@kfi7:535/0 lens 224/224 e 0 to 0 dl 1773852650 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2030-0'
00010000:00000001:0.0:1773851895.340776:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851895.340777:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851895.340778:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=128 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851895.340779:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851895.340780:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ef8d930f refcount 3 to 24689@kfi7
00000100:00000001:0.0:1773851895.340780:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003424 : -107146751548192 : ffff9e8cf3ef64e0)
02000000:00000001:0.0:1773851895.340781:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851895.340782:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.340783:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851895.340784:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24689@kfi7
00000400:00000010:0.0:1773851895.340785:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008edf1d49.
00000100:00000200:0.0:1773851895.340785:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602164764480, offset 224
00000400:00000200:0.0:1773851895.340787:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24689@kfi7
00000400:00000200:0.0:1773851895.340788:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24689@kfi7 to cpt 0
00000400:00000200:0.0:1773851895.340788:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000029242c4c nid 24689@kfi7 refs 1
00000400:00000200:0.0:1773851895.340790:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000029242c4c nid 24689@kfi7 refs 2
00000400:00000200:0.0:1773851895.340791:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000029242c4c nid 24689@kfi7 refs 3
00000400:00000200:0.0:1773851895.340792:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24689@kfi7 local destination
00000400:00000200:0.0:1773851895.340793:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770186:8770186:1024:4294967295] 24689@kfi7 LPNI seq info [7128802:7128802:16:4294967295]
00000400:00000200:0.0:1773851895.340794:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000029242c4c nid 24689@kfi7 refs 2
00000400:00000200:0.0:1773851895.340795:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24689@kfi7 to cpt 0
00000400:00000200:0.0:1773851895.340797:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24689@kfi7(24689@kfi7:24689@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851895.340798:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000029242c4c nid 24689@kfi7 refs 3
00000800:00000200:0.0:1773851895.340799:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851895.340800:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851895.340802:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851895.340805:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000127 Using peer 24689@kfi7(0x100000000000127)
00000800:00000200:0.0:1773851895.340808:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x100000000000127: rc=0
00000800:00000200:0.0:1773851895.340809:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000127 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851895.340811:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851895.340812:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ef8d930f refcount 2 to 24689@kfi7
00010000:00000001:0.0:1773851895.340813:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851895.340813:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.340814:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851895.340814:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000280c0610 x1859602164764480/t0(0) o400->119ddbde-bdea-4fae-aa88-2cb8591b258c@24689@kfi7:535/0 lens 224/224 e 0 to 0 dl 1773852650 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2030-0'
00000100:00100000:0.0:1773851895.340820:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000280c0610 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:119ddbde-bdea-4fae-aa88-2cb8591b258c+5:39549:x1859602164764480:12345-24689@kfi7:400:default-tuolumne2030-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851895.340822:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24689@kfi7, seq: 1997622
00000100:00000040:0.0:1773851895.340823:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c67188d2 : new rpc_count 0
00000100:00000001:0.0:1773851895.340823:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851895.340824:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851895.340824:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851895.340825:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851895.340826:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851895.340827:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000c67188d2 : new refcount 4
00000100:00000001:0.0:1773851895.340827:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851895.340834:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000127 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851895.340836:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851895.340837:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24689@kfi7: PUT: OK
00000400:00000200:1.0:1773851895.340838:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008edf1d49
00000400:00000010:1.0:1773851895.340839:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008edf1d49.
00000100:00000001:1.0:1773851895.340839:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851895.340840:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851895.340841:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000029242c4c nid 24689@kfi7 refs 2
00000800:00000200:1.0:1773851895.340842:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24689@kfi7(000000001520a03d):0x0 lsk 296 rsk 17 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000127 Transaction freed
00000800:00000200:5.0:1773851895.359421:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851895.359422:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851895.359424:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851895.359426:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851895.359428:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22880@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.359429:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22880@kfi7 : PUT - for me
00000400:00000200:5.0:1773851895.359430:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22880@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.359431:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daf86eb3 nid 22880@kfi7 refs 1
00000400:00000200:5.0:1773851895.359432:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22880@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.359433:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daf86eb3 nid 22880@kfi7 refs 2
00000400:00000200:5.0:1773851895.359434:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000daf86eb3 nid 22880@kfi7 refs 3
00000400:00000200:5.0:1773851895.359435:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22945@kfi7 to cpt 7
00000400:00000200:5.0:1773851895.359435:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22945@kfi7 of length 224 into portal 12 MB=0x699e0aafc5740
00000400:00000200:5.0:1773851895.359437:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22945@kfi7 of length 224/224 into md 0x793926dc5 [64] + 163072
00000800:00000200:5.0:1773851895.359438:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851895.359440:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.359441:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22880@kfi7: PUT: OK
00000100:00000001:5.0:1773851895.359442:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851895.359442:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851895.359443:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e45689cc.
00000100:00000040:5.0:1773851895.359444:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e45689cc x1858040080652096 msgsize 224
00000100:00100000:5.0:1773851895.359445:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22945@kfi7 (source: 12345-22880@kfi7)
00000100:00000001:5.0:1773851895.359446:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851895.359447:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000daf86eb3 nid 22880@kfi7 refs 2
00000800:00000200:5.0:1773851895.359448:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2054@kfi7:1 <- 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851895.359448:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851895.359449:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851895.359449:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851895.359449:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.359450:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851895.359451:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040080652096
00000020:00000001:4.0:1773851895.359451:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851895.359452:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92aa9
00000020:00000001:4.0:1773851895.359453:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851895.359456:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009c4937d8 refcount=6
00000020:00000001:4.0:1773851895.359457:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743449600 : -107128966102016 : ffff9e911807c400)
00000020:00000001:4.0:1773851895.359457:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743449600 : -107128966102016 : ffff9e911807c400)
00000100:00000001:4.0:1773851895.359458:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.359459:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851895.359460:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851895.359461:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.359462:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000031fbcfde.
00000100:00000001:4.0:1773851895.359463:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851895.359463:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851895.359463:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.359464:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851895.359465:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851895.359465:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.359467:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.359468:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851895.359468:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851895.359468:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851895.359469:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851895.359469:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22945@kfi7, seq: 2001989
00000100:00000001:7.0:1773851895.359470:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.359470:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009c4937d8 : new rpc_count 1
00000100:00000001:7.0:1773851895.359471:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.359471:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636993527813760 : -107080181737856 : ffff9e9c73ce1680)
00000100:00000040:4.0:1773851895.359472:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e45689cc x1858040080652096/t0(0) o400->1f9a8d86-deed-4295-a629-766c6280a6f9@22945@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1920-0'
00000100:00000001:4.0:1773851895.359474:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.359475:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851895.359476:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e45689cc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1f9a8d86-deed-4295-a629-766c6280a6f9+6:39669:x1858040080652096:12345-22945@kfi7:400:default-tuolumne1920-0
00000100:00000200:4.0:1773851895.359477:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040080652096
00000020:00000001:4.0:1773851895.359478:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851895.359479:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851895.359479:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.359480:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851895.359480:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851895.359482:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851895.359482:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040080652096, found 0 last_xid 1858040080652095
00000020:00000001:4.0:1773851895.359483:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851895.359484:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851895.359484:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851895.359485:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.359486:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851895.359486:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851895.359487:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851895.359487:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000864340d1.
02000000:00000001:4.0:1773851895.359488:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.359489:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.359489:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851895.359490:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668657076, transno 0, xid 1858040080652096
00010000:00000001:4.0:1773851895.359490:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851895.359491:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e45689cc x1858040080652096/t0(0) o400->1f9a8d86-deed-4295-a629-766c6280a6f9@22945@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1920-0'
00010000:00000001:4.0:1773851895.359494:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851895.359494:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851895.359495:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=127 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851895.359496:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851895.359497:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fd50420e refcount 3 to 22945@kfi7
00000100:00000001:4.0:1773851895.359498:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271008 : -107152618280608 : ffff9e8b96402960)
02000000:00000001:4.0:1773851895.359499:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851895.359499:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.359500:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851895.359501:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22880@kfi7
00000400:00000010:4.0:1773851895.359501:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a0b1f78.
00000100:00000200:4.0:1773851895.359502:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040080652096, offset 224
00000400:00000200:4.0:1773851895.359503:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22880@kfi7
00000400:00000200:4.0:1773851895.359504:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22880@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.359505:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daf86eb3 nid 22880@kfi7 refs 1
00000400:00000200:4.0:1773851895.359506:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000daf86eb3 nid 22880@kfi7 refs 2
00000400:00000200:4.0:1773851895.359508:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000daf86eb3 nid 22880@kfi7 refs 3
00000400:00000200:4.0:1773851895.359510:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22880@kfi7 local destination
00000400:00000200:4.0:1773851895.359511:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770187:8770187:1024:4294967295] 22880@kfi7 LPNI seq info [92642:92642:16:4294967295]
00000400:00000200:4.0:1773851895.359512:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000daf86eb3 nid 22880@kfi7 refs 2
00000400:00000200:4.0:1773851895.359513:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22880@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.359515:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22880@kfi7(22880@kfi7:22880@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851895.359516:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000daf86eb3 nid 22880@kfi7 refs 3
00000800:00000200:4.0:1773851895.359518:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851895.359519:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851895.359521:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851895.359523:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000083d Using peer 22880@kfi7(0x10000000000083d)
00000800:00000200:4.0:1773851895.359526:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x10000000000083d: rc=0
00000800:00000200:4.0:1773851895.359527:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000083d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851895.359529:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.359530:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fd50420e refcount 2 to 22945@kfi7
00010000:00000001:4.0:1773851895.359531:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851895.359531:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.359532:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851895.359532:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e45689cc x1858040080652096/t0(0) o400->1f9a8d86-deed-4295-a629-766c6280a6f9@22945@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1920-0'
00000100:00100000:4.0:1773851895.359537:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e45689cc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1f9a8d86-deed-4295-a629-766c6280a6f9+6:39669:x1858040080652096:12345-22945@kfi7:400:default-tuolumne1920-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851895.359539:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22945@kfi7, seq: 2001989
00000100:00000040:4.0:1773851895.359539:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009c4937d8 : new rpc_count 0
00000100:00000001:4.0:1773851895.359540:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851895.359541:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851895.359542:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.359542:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000031fbcfde.
00000020:00000010:4.0:1773851895.359543:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000020:00000040:4.0:1773851895.359544:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009c4937d8 : new refcount 5
00000100:00000001:4.0:1773851895.359545:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851895.359549:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000083d TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851895.359551:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.359552:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22880@kfi7: PUT: OK
00000400:00000200:5.0:1773851895.359553:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a0b1f78
00000400:00000010:5.0:1773851895.359554:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a0b1f78.
00000100:00000001:5.0:1773851895.359555:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851895.359555:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851895.359556:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000daf86eb3 nid 22880@kfi7 refs 2
00000800:00000200:5.0:1773851895.359558:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 22880@kfi7(00000000552897e8):0x0 lsk 2110 rsk 47 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000083d Transaction freed
00000800:00000200:29.0:1773851895.507700:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851895.507701:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.507703:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851895.507705:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851895.507707:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18976@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.507708:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18976@kfi7 : PUT - for me
00000400:00000200:29.0:1773851895.507709:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18976@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.507710:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b1c21ed nid 18976@kfi7 refs 1
00000400:00000200:29.0:1773851895.507711:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18976@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.507712:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b1c21ed nid 18976@kfi7 refs 2
00000400:00000200:29.0:1773851895.507713:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004b1c21ed nid 18976@kfi7 refs 3
00000400:00000200:29.0:1773851895.507714:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19169@kfi7 to cpt 5
00000400:00000200:29.0:1773851895.507715:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19169@kfi7 of length 224 into portal 12 MB=0x69b0a7b5a1300
00000400:00000200:29.0:1773851895.507716:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19169@kfi7 of length 224/224 into md 0x77fe1859d [64] + 7696
00000800:00000200:29.0:1773851895.507718:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851895.507719:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.507720:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18976@kfi7: PUT: OK
00000100:00000001:29.0:1773851895.507721:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851895.507722:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851895.507722:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3afdabf.
00000100:00000040:29.0:1773851895.507723:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000e3afdabf x1859319181742848 msgsize 224
00000100:00100000:29.0:1773851895.507729:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19169@kfi7 (source: 12345-18976@kfi7)
00000100:00000001:29.0:1773851895.507730:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851895.507731:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851895.507731:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004b1c21ed nid 18976@kfi7 refs 2
02000000:00000001:31.0:1773851895.507732:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851895.507732:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851895.507733:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851895.507733:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.507734:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851895.507735:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859319181742848
00000020:00000001:31.0:1773851895.507736:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851895.507736:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9215d
00000020:00000001:31.0:1773851895.507737:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851895.507741:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b672c2a5 refcount=6
00000020:00000001:31.0:1773851895.507741:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629748736 : -107123079802880 : ffff9e9276e19000)
00000020:00000001:31.0:1773851895.507742:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629748736 : -107123079802880 : ffff9e9276e19000)
00000100:00000001:31.0:1773851895.507743:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.507744:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851895.507745:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005fdbb19b.
00000020:00000010:31.0:1773851895.507746:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.507746:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851895.507747:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851895.507748:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851895.507748:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.507749:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851895.507750:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851895.507750:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.507751:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.507752:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851895.507753:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851895.507753:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851895.507753:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851895.507754:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19169@kfi7, seq: 2055592
00000100:00000040:31.0:1773851895.507755:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b672c2a5 : new rpc_count 1
00000100:00000001:31.0:1773851895.507755:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262223616 : -106943447328000 : ffff9ebc49cf9b00)
00000100:00000001:30.0:1773851895.507755:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.507755:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.507757:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3afdabf x1859319181742848/t0(0) o400->8d7db97e-ceb7-45cf-9523-f4a2c6cf850c@19169@kfi7:683/0 lens 224/0 e 0 to 0 dl 1773852043 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1679-0'
00000100:00000001:31.0:1773851895.507759:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.507760:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851895.507761:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3afdabf pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:8d7db97e-ceb7-45cf-9523-f4a2c6cf850c+6:39569:x1859319181742848:12345-19169@kfi7:400:default-tuolumne1679-0
00000100:00000200:31.0:1773851895.507762:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859319181742848
00000020:00000001:31.0:1773851895.507763:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851895.507764:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851895.507764:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.507765:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851895.507766:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851895.507766:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851895.507767:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859319181742848, found 0 last_xid 1859319181742847
00000020:00000001:31.0:1773851895.507768:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851895.507768:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851895.507769:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851895.507769:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.507770:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851895.507771:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851895.507771:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851895.507772:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f5e544f0.
02000000:00000001:31.0:1773851895.507773:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.507773:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.507774:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851895.507775:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693122, transno 0, xid 1859319181742848
00010000:00000001:31.0:1773851895.507775:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851895.507776:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3afdabf x1859319181742848/t0(0) o400->8d7db97e-ceb7-45cf-9523-f4a2c6cf850c@19169@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1679-0'
00010000:00000001:31.0:1773851895.507778:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851895.507779:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851895.507780:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=128 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851895.507781:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851895.507781:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000065473755 refcount 3 to 19169@kfi7
00000100:00000001:31.0:1773851895.507782:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450368 : -107146752101248 : ffff9e8cf3e6f480)
02000000:00000001:31.0:1773851895.507783:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851895.507783:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.507784:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851895.507785:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18976@kfi7
00000400:00000010:31.0:1773851895.507786:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000030edd6e9.
00000100:00000200:31.0:1773851895.507787:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859319181742848, offset 224
00000400:00000200:31.0:1773851895.507788:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18976@kfi7
00000400:00000200:31.0:1773851895.507789:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18976@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.507790:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004b1c21ed nid 18976@kfi7 refs 1
00000400:00000200:31.0:1773851895.507791:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004b1c21ed nid 18976@kfi7 refs 2
00000400:00000200:31.0:1773851895.507792:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004b1c21ed nid 18976@kfi7 refs 3
00000400:00000200:31.0:1773851895.507793:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18976@kfi7 local destination
00000400:00000200:31.0:1773851895.507794:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770188:8770188:1024:4294967295] 18976@kfi7 LPNI seq info [16231566:16231566:16:4294967295]
00000400:00000200:31.0:1773851895.507796:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004b1c21ed nid 18976@kfi7 refs 2
00000400:00000200:31.0:1773851895.507796:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18976@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.507798:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18976@kfi7(18976@kfi7:18976@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851895.507799:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004b1c21ed nid 18976@kfi7 refs 3
00000800:00000200:31.0:1773851895.507801:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851895.507802:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851895.507803:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851895.507806:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000c9 Using peer 18976@kfi7(0x1000000000000c9)
00000800:00000200:31.0:1773851895.507808:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x1000000000000c9: rc=0
00000800:00000200:31.0:1773851895.507810:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000c9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851895.507812:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.507813:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000065473755 refcount 2 to 19169@kfi7
00010000:00000001:31.0:1773851895.507813:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851895.507814:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.507815:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851895.507816:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3afdabf x1859319181742848/t0(0) o400->8d7db97e-ceb7-45cf-9523-f4a2c6cf850c@19169@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1679-0'
00000100:00100000:31.0:1773851895.507818:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3afdabf pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:8d7db97e-ceb7-45cf-9523-f4a2c6cf850c+6:39569:x1859319181742848:12345-19169@kfi7:400:default-tuolumne1679-0 Request processed in 58us (94us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851895.507822:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000c9 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851895.507823:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851895.507824:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19169@kfi7, seq: 2055592
00000400:00000200:29.0:1773851895.507824:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18976@kfi7: PUT: OK
00000100:00000040:31.0:1773851895.507825:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b672c2a5 : new rpc_count 0
00000100:00000001:31.0:1773851895.507825:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851895.507825:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000030edd6e9
00000400:00000010:29.0:1773851895.507825:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000030edd6e9.
00000100:00000001:31.0:1773851895.507826:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:29.0:1773851895.507826:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:31.0:1773851895.507827:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.507827:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000100:00000001:29.0:1773851895.507827:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851895.507828:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005fdbb19b.
00000400:00000200:29.0:1773851895.507828:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004b1c21ed nid 18976@kfi7 refs 2
00000020:00000040:31.0:1773851895.507829:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000b672c2a5 : new refcount 5
00000800:00000200:29.0:1773851895.507829:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 18976@kfi7(000000009e8122b5):0x0 lsk 202 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000000c9 Transaction freed
00000100:00000001:31.0:1773851895.507830:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851895.548402:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.548404:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851895.548405:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851895.548407:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851895.548409:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24530@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.548410:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24530@kfi7 : PUT - for me
00000400:00000200:15.0:1773851895.548411:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24530@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.548412:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e919417 nid 24530@kfi7 refs 1
00000400:00000200:15.0:1773851895.548414:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24530@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.548414:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e919417 nid 24530@kfi7 refs 2
00000400:00000200:15.0:1773851895.548415:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003e919417 nid 24530@kfi7 refs 3
00000400:00000200:15.0:1773851895.548416:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24338@kfi7 to cpt 0
00000400:00000200:15.0:1773851895.548417:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24338@kfi7 of length 224 into portal 12 MB=0x69b7c9bd93640
00000400:00000200:15.0:1773851895.548419:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24338@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 56752
00000800:00000200:15.0:1773851895.548421:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851895.548422:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851895.548423:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24530@kfi7: PUT: OK
00000100:00000001:15.0:1773851895.548425:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851895.548425:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851895.548426:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000391be4bf.
00000100:00000040:15.0:1773851895.548426:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000391be4bf x1859809353217600 msgsize 224
00000100:00100000:15.0:1773851895.548428:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-24338@kfi7 (source: 12345-24530@kfi7)
00000100:00000001:15.0:1773851895.548429:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851895.548430:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003e919417 nid 24530@kfi7 refs 2
00000800:00000200:15.0:1773851895.548431:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000056f9fe8f: 2054@kfi7:3 <- 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851895.548434:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851895.548435:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851895.548435:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851895.548436:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851895.548437:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851895.548438:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859809353217600
00000020:00000001:15.0:1773851895.548438:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.548439:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f085d790b823
00000020:00000001:15.0:1773851895.548439:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.548443:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ed353dc7 refcount=5
00000020:00000001:15.0:1773851895.548444:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128005187584 : -106945704364032 : ffff9ebbc347f800)
00000020:00000001:15.0:1773851895.548445:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128005187584 : -106945704364032 : ffff9ebbc347f800)
00000100:00000001:15.0:1773851895.548446:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.548446:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.548447:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007e7073c5.
00000020:00000010:15.0:1773851895.548448:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.548449:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.548450:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.548450:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.548451:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.548452:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851895.548452:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851895.548452:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.548453:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.548454:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.548455:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.548455:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851895.548455:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851895.548456:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24338@kfi7, seq: 2289927
00000100:00000040:15.0:1773851895.548456:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ed353dc7 : new rpc_count 1
00000100:00000001:15.0:1773851895.548457:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860224128 : -107049849327488 : ffff9ea383c1f080)
00000100:00000001:12.0:1773851895.548457:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851895.548457:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.548459:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000391be4bf x1859809353217600/t0(0) o400->c2d30ce2-39a8-4c0b-ade3-05c5b2720fda@24338@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2021-0'
00000100:00000001:15.0:1773851895.548461:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.548461:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.548462:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000391be4bf pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c2d30ce2-39a8-4c0b-ade3-05c5b2720fda+5:39387:x1859809353217600:12345-24338@kfi7:400:default-tuolumne2021-0
00000100:00000200:15.0:1773851895.548463:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859809353217600
00000020:00000001:15.0:1773851895.548464:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.548466:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.548466:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.548467:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.548467:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851895.548468:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.548468:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859809353217600, found 0 last_xid 1859809353217599
00000020:00000001:15.0:1773851895.548469:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.548470:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.548471:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.548471:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.548472:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851895.548472:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.548473:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.548474:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e05e453e.
02000000:00000001:15.0:1773851895.548474:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.548475:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.548476:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.548476:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044148288, transno 0, xid 1859809353217600
00010000:00000001:15.0:1773851895.548477:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.548478:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000391be4bf x1859809353217600/t0(0) o400->c2d30ce2-39a8-4c0b-ade3-05c5b2720fda@24338@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2021-0'
00010000:00000001:15.0:1773851895.548480:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.548481:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.548482:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.548483:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.548483:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8867d17 refcount 3 to 24338@kfi7
00000100:00000001:15.0:1773851895.548484:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379648 : -107155980171968 : ffff9e8acdddc540)
02000000:00000001:15.0:1773851895.548485:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.548485:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.548486:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.548486:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24530@kfi7
00000400:00000010:15.0:1773851895.548487:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a0412e34.
00000100:00000200:15.0:1773851895.548488:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859809353217600, offset 224
00000400:00000200:15.0:1773851895.548489:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24530@kfi7
00000400:00000200:15.0:1773851895.548490:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24530@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.548491:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003e919417 nid 24530@kfi7 refs 1
00000400:00000200:15.0:1773851895.548492:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003e919417 nid 24530@kfi7 refs 2
00000400:00000200:15.0:1773851895.548493:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003e919417 nid 24530@kfi7 refs 3
00000400:00000200:15.0:1773851895.548494:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24530@kfi7 local destination
00000400:00000200:15.0:1773851895.548495:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770189:8770189:1024:4294967295] 24530@kfi7 LPNI seq info [18196:18196:16:4294967295]
00000400:00000200:15.0:1773851895.548497:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003e919417 nid 24530@kfi7 refs 2
00000400:00000200:15.0:1773851895.548497:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24530@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.548499:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24530@kfi7(24530@kfi7:24530@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.548500:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003e919417 nid 24530@kfi7 refs 3
00000800:00000200:15.0:1773851895.548501:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.548502:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851895.548504:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.548506:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ec2 Using peer 24530@kfi7(0x100000000000ec2)
00000800:00000200:15.0:1773851895.548509:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0x100000000000ec2: rc=0
00000800:00000200:15.0:1773851895.548511:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ec2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.548513:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.548513:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8867d17 refcount 2 to 24338@kfi7
00010000:00000001:15.0:1773851895.548514:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.548515:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.548515:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.548516:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000391be4bf x1859809353217600/t0(0) o400->c2d30ce2-39a8-4c0b-ade3-05c5b2720fda@24338@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2021-0'
00000100:00100000:15.0:1773851895.548519:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000391be4bf pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c2d30ce2-39a8-4c0b-ade3-05c5b2720fda+5:39387:x1859809353217600:12345-24338@kfi7:400:default-tuolumne2021-0 Request processed in 57us (92us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851895.548521:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24338@kfi7, seq: 2289927
00000800:00000200:13.0:1773851895.548523:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ec2 TN_EVENT_TX_OK event status 0
00000100:00000040:15.0:1773851895.548524:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ed353dc7 : new rpc_count 0
00000100:00000001:15.0:1773851895.548524:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851895.548524:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:15.0:1773851895.548525:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851895.548525:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851895.548525:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24530@kfi7: PUT: OK
00000020:00000010:15.0:1773851895.548526:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000400:00000200:13.0:1773851895.548526:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a0412e34
00000400:00000010:13.0:1773851895.548526:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a0412e34.
00000100:00000001:13.0:1773851895.548526:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:15.0:1773851895.548527:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007e7073c5.
00000100:00000001:13.0:1773851895.548527:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:15.0:1773851895.548528:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000ed353dc7 : new refcount 4
00000400:00000200:13.0:1773851895.548528:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003e919417 nid 24530@kfi7 refs 2
00000100:00000001:15.0:1773851895.548529:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851895.548529:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2054@kfi7:3 -> 24530@kfi7(000000003f0e0606):0x0 lsk 3779 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ec2 Transaction freed
00000800:00000200:13.0:1773851895.554331:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.554331:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851895.554332:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851895.554334:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851895.554336:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10995@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.554337:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10995@kfi7 : PUT - for me
00000400:00000200:13.0:1773851895.554338:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10995@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.554338:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005389c017 nid 10995@kfi7 refs 1
00000400:00000200:13.0:1773851895.554340:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10995@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.554340:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005389c017 nid 10995@kfi7 refs 2
00000400:00000200:13.0:1773851895.554341:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005389c017 nid 10995@kfi7 refs 3
00000400:00000200:13.0:1773851895.554342:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10994@kfi7 to cpt 0
00000400:00000200:13.0:1773851895.554342:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10994@kfi7 of length 224 into portal 12 MB=0x69b0a591d35c0
00000400:00000200:13.0:1773851895.554343:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10994@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 56976
00000800:00000200:13.0:1773851895.554345:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851895.554346:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851895.554347:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10995@kfi7: PUT: OK
00000100:00000001:13.0:1773851895.554348:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851895.554348:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851895.554349:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006dc06bc9.
00000100:00000040:13.0:1773851895.554349:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000006dc06bc9 x1859318607328704 msgsize 224
00000100:00100000:13.0:1773851895.554351:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10994@kfi7 (source: 12345-10995@kfi7)
00000100:00000001:13.0:1773851895.554351:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851895.554352:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005389c017 nid 10995@kfi7 refs 2
00000100:00000001:15.0:1773851895.554353:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851895.554353:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851895.554353:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851895.554354:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851895.554354:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851895.554354:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851895.554355:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318607328704
00000020:00000001:15.0:1773851895.554355:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.554356:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ebe
00000020:00000001:15.0:1773851895.554356:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.554360:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002853a8d5 refcount=6
00000020:00000001:15.0:1773851895.554361:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239658496 : -107152469893120 : ffff9e8b9f186000)
00000020:00000001:15.0:1773851895.554361:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239658496 : -107152469893120 : ffff9e8b9f186000)
00000100:00000001:15.0:1773851895.554362:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.554363:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.554363:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000464d983b.
00000020:00000010:15.0:1773851895.554364:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.554364:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.554365:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.554365:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.554366:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.554367:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851895.554367:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851895.554367:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.554368:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.554369:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.554369:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.554369:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:15.0:1773851895.554370:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10994@kfi7, seq: 2289928
00000100:00000001:12.0:1773851895.554370:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851895.554371:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002853a8d5 : new rpc_count 1
00000100:00000001:15.0:1773851895.554371:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636950415884032 : -107123293667584 : ffff9e926a223f00)
00000100:00000001:12.0:1773851895.554371:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851895.554371:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.554372:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006dc06bc9 x1859318607328704/t0(0) o400->509c04a8-ddf2-4ad6-9df0-d2020c2b8f6d@10994@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1161-0'
00000100:00000001:15.0:1773851895.554375:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.554375:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.554376:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006dc06bc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:509c04a8-ddf2-4ad6-9df0-d2020c2b8f6d+6:39741:x1859318607328704:12345-10994@kfi7:400:default-tuolumne1161-0
00000100:00000200:15.0:1773851895.554377:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318607328704
00000020:00000001:15.0:1773851895.554377:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.554378:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.554378:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.554379:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.554379:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851895.554380:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.554380:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318607328704, found 0 last_xid 1859318607328703
00000020:00000001:15.0:1773851895.554381:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.554381:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.554381:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.554382:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.554382:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851895.554383:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.554383:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.554384:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b4f6675e.
02000000:00000001:15.0:1773851895.554384:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.554385:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.554385:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.554386:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104680600, transno 0, xid 1859318607328704
00010000:00000001:15.0:1773851895.554386:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.554387:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006dc06bc9 x1859318607328704/t0(0) o400->509c04a8-ddf2-4ad6-9df0-d2020c2b8f6d@10994@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1161-0'
00010000:00000001:15.0:1773851895.554389:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.554389:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.554391:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.554392:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.554392:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000015ef765e refcount 3 to 10994@kfi7
00000100:00000001:15.0:1773851895.554393:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052352 : -107154804499264 : ffff9e8b13f11cc0)
02000000:00000001:15.0:1773851895.554393:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.554394:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.554394:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.554395:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10995@kfi7
00000400:00000010:15.0:1773851895.554395:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f009b6f1.
00000100:00000200:15.0:1773851895.554396:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318607328704, offset 224
00000400:00000200:15.0:1773851895.554397:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10995@kfi7
00000400:00000200:15.0:1773851895.554398:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10995@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.554398:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005389c017 nid 10995@kfi7 refs 1
00000400:00000200:15.0:1773851895.554399:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005389c017 nid 10995@kfi7 refs 2
00000400:00000200:15.0:1773851895.554400:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005389c017 nid 10995@kfi7 refs 3
00000400:00000200:15.0:1773851895.554401:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10995@kfi7 local destination
00000400:00000200:15.0:1773851895.554402:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770190:8770190:1024:4294967295] 10995@kfi7 LPNI seq info [22216616:22216616:16:4294967295]
00000400:00000200:15.0:1773851895.554403:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005389c017 nid 10995@kfi7 refs 2
00000400:00000200:15.0:1773851895.554404:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10995@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.554406:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10995@kfi7(10995@kfi7:10995@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.554407:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005389c017 nid 10995@kfi7 refs 3
00000800:00000200:15.0:1773851895.554408:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.554409:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851895.554411:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.554413:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x132 Using peer 10995@kfi7(0x132)
00000800:00000200:15.0:1773851895.554416:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x132: rc=0
00000800:00000200:15.0:1773851895.554417:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x132 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.554420:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.554421:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000015ef765e refcount 2 to 10994@kfi7
00010000:00000001:15.0:1773851895.554422:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.554422:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.554422:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.554423:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006dc06bc9 x1859318607328704/t0(0) o400->509c04a8-ddf2-4ad6-9df0-d2020c2b8f6d@10994@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1161-0'
00000100:00100000:15.0:1773851895.554426:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006dc06bc9 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:509c04a8-ddf2-4ad6-9df0-d2020c2b8f6d+6:39741:x1859318607328704:12345-10994@kfi7:400:default-tuolumne1161-0 Request processed in 50us (76us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851895.554428:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10994@kfi7, seq: 2289928
00000100:00000040:15.0:1773851895.554429:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002853a8d5 : new rpc_count 0
00000800:00000200:13.0:1773851895.554429:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x132 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851895.554430:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851895.554430:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851895.554430:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000400:00000200:13.0:1773851895.554430:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851895.554431:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000400:00000200:13.0:1773851895.554431:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10995@kfi7: PUT: OK
00000400:00000200:13.0:1773851895.554431:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f009b6f1
00000020:00000010:15.0:1773851895.554432:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000464d983b.
00000020:00000040:15.0:1773851895.554432:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000002853a8d5 : new refcount 5
00000400:00000010:13.0:1773851895.554432:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f009b6f1.
00000100:00000001:13.0:1773851895.554432:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851895.554432:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:15.0:1773851895.554433:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851895.554433:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005389c017 nid 10995@kfi7 refs 2
00000800:00000200:13.0:1773851895.554435:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 10995@kfi7(0000000008b9b566):0x0 lsk 307 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x132 Transaction freed
00000800:00000200:17.0:1773851895.573862:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851895.573862:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851895.573865:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851895.573867:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851895.573869:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13307@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.573870:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13307@kfi7 : PUT - for me
00000400:00000200:17.0:1773851895.573871:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13307@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.573872:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b232027 nid 13307@kfi7 refs 1
00000400:00000200:17.0:1773851895.573873:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13307@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.573873:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b232027 nid 13307@kfi7 refs 2
00000400:00000200:17.0:1773851895.573874:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003b232027 nid 13307@kfi7 refs 3
00000400:00000200:17.0:1773851895.573875:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13306@kfi7 to cpt 1
00000400:00000200:17.0:1773851895.573876:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13306@kfi7 of length 224 into portal 12 MB=0x699de8c7d79c0
00000400:00000200:17.0:1773851895.573877:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13306@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 44336
00000800:00000200:17.0:1773851895.573879:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851895.573880:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851895.573881:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13307@kfi7: PUT: OK
00000100:00000001:17.0:1773851895.573882:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851895.573883:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851895.573884:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000079b2700c.
00000100:00000040:17.0:1773851895.573885:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000079b2700c x1858030979086784 msgsize 224
00000100:00100000:17.0:1773851895.573886:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-13306@kfi7 (source: 12345-13307@kfi7)
00000100:00000001:17.0:1773851895.573887:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851895.573888:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003b232027 nid 13307@kfi7 refs 2
00000100:00000001:16.0:1773851895.573888:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851895.573889:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851895.573889:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851895.573890:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851895.573890:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851895.573891:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851895.573892:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030979086784
00000020:00000001:16.0:1773851895.573892:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851895.573893:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f9e
00000020:00000001:16.0:1773851895.573894:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851895.573896:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003bcf9e52 refcount=6
00000020:00000001:16.0:1773851895.573896:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239884800 : -107152469666816 : ffff9e8b9f1bd400)
00000020:00000001:16.0:1773851895.573897:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239884800 : -107152469666816 : ffff9e8b9f1bd400)
00000100:00000001:16.0:1773851895.573900:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851895.573901:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851895.573903:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000087d99a71.
00000020:00000010:16.0:1773851895.573904:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851895.573905:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bb62e6e.
00000100:00000001:16.0:1773851895.573906:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851895.573906:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851895.573907:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851895.573908:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851895.573908:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851895.573909:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.573910:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851895.573911:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851895.573911:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851895.573912:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851895.573912:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851895.573913:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13306@kfi7, seq: 2156422
00000100:00000001:19.0:1773851895.573914:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851895.573914:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851895.573914:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003bcf9e52 : new rpc_count 1
00000100:00000001:16.0:1773851895.573914:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968743936 : -106974740807680 : ffff9eb500930000)
00000100:00000040:16.0:1773851895.573915:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000079b2700c x1858030979086784/t0(0) o400->b58a5961-bc3e-43bb-9b64-3d7af1089c89@13306@kfi7:147/0 lens 224/0 e 0 to 0 dl 1773852262 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne220-0'
00000100:00000001:16.0:1773851895.573918:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851895.573919:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851895.573920:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079b2700c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:b58a5961-bc3e-43bb-9b64-3d7af1089c89+6:51152:x1858030979086784:12345-13306@kfi7:400:default-tuolumne220-0
00000100:00000200:16.0:1773851895.573921:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030979086784
00000020:00000001:16.0:1773851895.573922:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851895.573922:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851895.573923:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.573924:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851895.573924:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851895.573925:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851895.573926:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030979086784, found 0 last_xid 1858030979086783
00000020:00000001:16.0:1773851895.573927:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851895.573928:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851895.573928:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851895.573929:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.573930:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851895.573930:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851895.573931:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851895.573932:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004fd24d2f.
02000000:00000001:16.0:1773851895.573932:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.573933:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.573934:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851895.573934:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030979086784
00010000:00000001:16.0:1773851895.573935:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851895.573936:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000079b2700c x1858030979086784/t0(0) o400->b58a5961-bc3e-43bb-9b64-3d7af1089c89@13306@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne220-0'
00010000:00000001:16.0:1773851895.573938:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851895.573939:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851895.573940:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=128 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851895.573941:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851895.573941:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e30b5c08 refcount 5 to 13306@kfi7
00000100:00000001:16.0:1773851895.573942:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863571200 : -107154845980416 : ffff9e8b11782900)
02000000:00000001:16.0:1773851895.573943:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851895.573943:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.573944:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851895.573945:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13307@kfi7
00000400:00000010:16.0:1773851895.573946:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025c7e96e.
00000100:00000200:16.0:1773851895.573946:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030979086784, offset 224
00000400:00000200:16.0:1773851895.573948:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13307@kfi7
00000400:00000200:16.0:1773851895.573948:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13307@kfi7 to cpt 4
00000400:00000200:16.0:1773851895.573949:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003b232027 nid 13307@kfi7 refs 1
00000400:00000200:16.0:1773851895.573950:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003b232027 nid 13307@kfi7 refs 2
00000400:00000200:16.0:1773851895.573952:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003b232027 nid 13307@kfi7 refs 3
00000400:00000200:16.0:1773851895.573953:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13307@kfi7 local destination
00000400:00000200:16.0:1773851895.573954:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770191:8770191:1024:4294967295] 13307@kfi7 LPNI seq info [24429:24429:16:4294967295]
00000400:00000200:16.0:1773851895.573955:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003b232027 nid 13307@kfi7 refs 2
00000400:00000200:16.0:1773851895.573956:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13307@kfi7 to cpt 4
00000400:00000200:16.0:1773851895.573958:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13307@kfi7(13307@kfi7:13307@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851895.573959:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003b232027 nid 13307@kfi7 refs 3
00000800:00000200:16.0:1773851895.573961:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851895.573962:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851895.573964:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851895.573966:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000be7 Using peer 13307@kfi7(0x100000000000be7)
00000800:00000200:16.0:1773851895.573969:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000e09eb301: Posted send of 324 bytes to peer 0x100000000000be7: rc=0
00000800:00000200:16.0:1773851895.573971:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000be7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851895.573974:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851895.573975:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e30b5c08 refcount 4 to 13306@kfi7
00010000:00000001:16.0:1773851895.573975:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851895.573976:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851895.573977:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851895.573978:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000079b2700c x1858030979086784/t0(0) o400->b58a5961-bc3e-43bb-9b64-3d7af1089c89@13306@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne220-0'
00000100:00100000:16.0:1773851895.573983:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079b2700c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:b58a5961-bc3e-43bb-9b64-3d7af1089c89+6:51152:x1858030979086784:12345-13306@kfi7:400:default-tuolumne220-0 Request processed in 63us (97us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851895.573986:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13306@kfi7, seq: 2156422
00000100:00000040:16.0:1773851895.573987:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003bcf9e52 : new rpc_count 0
00000100:00000001:16.0:1773851895.573988:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851895.573988:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851895.573989:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851895.573990:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bb62e6e.
00000020:00000010:16.0:1773851895.573991:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000087d99a71.
00000020:00000040:16.0:1773851895.573992:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000003bcf9e52 : new refcount 5
00000100:00000001:16.0:1773851895.573994:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851895.574000:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000be7 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851895.574002:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851895.574004:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13307@kfi7: PUT: OK
00000400:00000200:17.0:1773851895.574005:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025c7e96e
00000400:00000010:17.0:1773851895.574006:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025c7e96e.
00000100:00000001:17.0:1773851895.574007:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851895.574008:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851895.574009:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003b232027 nid 13307@kfi7 refs 2
00000800:00000200:17.0:1773851895.574011:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e09eb301: 2054@kfi7:4 -> 13307@kfi7(00000000d3ef8461):0x0 lsk 3048 rsk 87 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000be7 Transaction freed
00000800:00000200:5.0:1773851895.574204:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851895.574206:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851895.574208:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851895.574212:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851895.574216:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13306@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.574218:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13306@kfi7 : PUT - for me
00000400:00000200:5.0:1773851895.574220:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13306@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.574221:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba96fa76 nid 13306@kfi7 refs 1
00000400:00000200:5.0:1773851895.574223:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13306@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.574225:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba96fa76 nid 13306@kfi7 refs 2
00000400:00000200:5.0:1773851895.574226:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ba96fa76 nid 13306@kfi7 refs 3
00000400:00000200:5.0:1773851895.574228:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13306@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.574230:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13306@kfi7 of length 224 into portal 12 MB=0x699de8c7d8240
00000400:00000200:5.0:1773851895.574232:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13306@kfi7 of length 224/224 into md 0x793926dc5 [64] + 163296
00000800:00000200:5.0:1773851895.574235:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851895.574238:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.574240:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13306@kfi7: PUT: OK
00000100:00000001:5.0:1773851895.574241:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851895.574242:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851895.574244:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000e846c0a.
00000100:00000040:5.0:1773851895.574245:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000000e846c0a x1858030979088960 msgsize 224
00000100:00100000:5.0:1773851895.574248:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13306@kfi7 (source: 12345-13306@kfi7)
00000100:00000001:5.0:1773851895.574249:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851895.574251:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba96fa76 nid 13306@kfi7 refs 2
00000100:00000001:4.0:1773851895.574251:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851895.574251:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851895.574252:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851895.574252:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.574253:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851895.574254:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000046518b99: 2069@kfi7:1 <- 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00100000:4.0:1773851895.574254:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030979088960
00000020:00000001:4.0:1773851895.574255:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851895.574255:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91356
00000020:00000001:4.0:1773851895.574256:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851895.574258:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d6d5d204 refcount=6
00000020:00000001:4.0:1773851895.574259:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169330688 : -107127540220928 : ffff9e916d04fc00)
00000020:00000001:4.0:1773851895.574260:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169330688 : -107127540220928 : ffff9e916d04fc00)
00000100:00000001:4.0:1773851895.574261:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.574262:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851895.574262:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851895.574263:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.574264:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000031fbcfde.
00000100:00000001:4.0:1773851895.574265:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851895.574265:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851895.574266:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.574267:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851895.574268:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851895.574268:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.574269:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.574270:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851895.574271:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851895.574272:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851895.574272:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851895.574272:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13306@kfi7, seq: 2001990
00000100:00000001:7.0:1773851895.574273:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.574273:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d6d5d204 : new rpc_count 1
00000100:00000001:7.0:1773851895.574274:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.574274:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637075875074560 : -106997834477056 : ffff9eafa0159200)
00000100:00000040:4.0:1773851895.574275:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000e846c0a x1858030979088960/t0(0) o400->4964239e-a709-4eaf-9bf9-e9f95d1e65a8@13306@kfi7:147/0 lens 224/0 e 0 to 0 dl 1773852262 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne220-0'
00000100:00000001:4.0:1773851895.574278:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.574278:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851895.574280:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000e846c0a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4964239e-a709-4eaf-9bf9-e9f95d1e65a8+6:51154:x1858030979088960:12345-13306@kfi7:400:default-tuolumne220-0
00000100:00000200:4.0:1773851895.574281:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030979088960
00000020:00000001:4.0:1773851895.574281:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851895.574282:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851895.574283:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.574284:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851895.574284:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851895.574285:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851895.574285:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030979088960, found 0 last_xid 1858030979088959
00000020:00000001:4.0:1773851895.574286:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851895.574287:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851895.574288:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851895.574288:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.574289:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851895.574290:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851895.574290:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851895.574291:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057572e3a.
02000000:00000001:4.0:1773851895.574291:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.574292:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.574293:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851895.574294:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768106, transno 0, xid 1858030979088960
00010000:00000001:4.0:1773851895.574294:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851895.574295:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000e846c0a x1858030979088960/t0(0) o400->4964239e-a709-4eaf-9bf9-e9f95d1e65a8@13306@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne220-0'
00010000:00000001:4.0:1773851895.574297:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851895.574298:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851895.574299:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=127 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851895.574300:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851895.574301:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e30b5c08 refcount 5 to 13306@kfi7
00000100:00000001:4.0:1773851895.574302:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863571200 : -107154845980416 : ffff9e8b11782900)
02000000:00000001:4.0:1773851895.574303:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851895.574303:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.574304:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851895.574305:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13306@kfi7
00000400:00000010:4.0:1773851895.574305:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:4.0:1773851895.574306:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030979088960, offset 224
00000400:00000200:4.0:1773851895.574307:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13306@kfi7
00000400:00000200:4.0:1773851895.574308:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13306@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.574309:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba96fa76 nid 13306@kfi7 refs 1
00000400:00000200:4.0:1773851895.574310:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ba96fa76 nid 13306@kfi7 refs 2
00000400:00000200:4.0:1773851895.574311:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ba96fa76 nid 13306@kfi7 refs 3
00000400:00000200:4.0:1773851895.574313:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13306@kfi7 local destination
00000400:00000200:4.0:1773851895.574314:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770192:8770192:1024:4294967295] 13306@kfi7 LPNI seq info [24430:24430:16:4294967295]
00000400:00000200:4.0:1773851895.574315:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ba96fa76 nid 13306@kfi7 refs 2
00000400:00000200:4.0:1773851895.574316:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13306@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.574318:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13306@kfi7(13306@kfi7:13306@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851895.574319:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ba96fa76 nid 13306@kfi7 refs 3
00000800:00000200:4.0:1773851895.574321:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851895.574322:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851895.574324:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851895.574326:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d0 Using peer 13306@kfi7(0x3d0)
00000800:00000200:4.0:1773851895.574329:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x3d0: rc=0
00000800:00000200:4.0:1773851895.574331:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851895.574332:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.574334:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e30b5c08 refcount 4 to 13306@kfi7
00010000:00000001:4.0:1773851895.574334:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851895.574335:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.574336:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851895.574337:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000e846c0a x1858030979088960/t0(0) o400->4964239e-a709-4eaf-9bf9-e9f95d1e65a8@13306@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne220-0'
00000100:00100000:4.0:1773851895.574341:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000e846c0a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:4964239e-a709-4eaf-9bf9-e9f95d1e65a8+6:51154:x1858030979088960:12345-13306@kfi7:400:default-tuolumne220-0 Request processed in 62us (95us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851895.574343:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13306@kfi7, seq: 2001990
00000100:00000040:4.0:1773851895.574344:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d6d5d204 : new rpc_count 0
00000100:00000001:4.0:1773851895.574345:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851895.574346:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851895.574346:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.574347:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000031fbcfde.
00000020:00000010:4.0:1773851895.574348:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000020:00000040:4.0:1773851895.574349:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000d6d5d204 : new refcount 5
00000100:00000001:4.0:1773851895.574349:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851895.574356:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d0 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851895.574358:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.574360:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13306@kfi7: PUT: OK
00000400:00000200:5.0:1773851895.574362:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:5.0:1773851895.574363:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:5.0:1773851895.574364:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851895.574365:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851895.574366:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba96fa76 nid 13306@kfi7 refs 2
00000800:00000200:5.0:1773851895.574368:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 13306@kfi7(0000000087a92627):0x0 lsk 977 rsk 91 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d0 Transaction freed
00000800:00000200:10.0:1773851895.576196:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851895.576196:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851895.576198:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851895.576200:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851895.576202:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:10.0:1773851895.576203:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16304@kfi7 : PUT - for me
00000400:00000200:10.0:1773851895.576204:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:10.0:1773851895.576205:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 1
00000400:00000200:10.0:1773851895.576206:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:10.0:1773851895.576206:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000400:00000200:10.0:1773851895.576207:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 3
00000400:00000200:10.0:1773851895.576208:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:10.0:1773851895.576209:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16304@kfi7 of length 224 into portal 12 MB=0x69b4b57019e00
00000400:00000200:10.0:1773851895.576210:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16304@kfi7 of length 224/224 into md 0x78146ce49 [64] + 159904
00000800:00000200:10.0:1773851895.576212:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851895.576214:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851895.576215:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16304@kfi7: PUT: OK
00000100:00000001:10.0:1773851895.576216:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851895.576217:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851895.576217:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c0304258.
00000100:00000040:10.0:1773851895.576219:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000c0304258 x1859597744840192 msgsize 224
00000100:00100000:10.0:1773851895.576221:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-16304@kfi7 (source: 12345-16304@kfi7)
00000100:00000001:10.0:1773851895.576222:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851895.576223:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:10.0:1773851895.576223:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
02000000:00000001:11.0:1773851895.576224:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851895.576224:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851895.576224:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851895.576225:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851895.576226:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851895.576226:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597744840192
00000020:00000001:11.0:1773851895.576227:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851895.576227:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80947
00000020:00000001:11.0:1773851895.576228:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851895.576231:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004de9afed refcount=5
00000020:00000001:11.0:1773851895.576232:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637101826956288 : -106971882595328 : ffff9eb5aaefdc00)
00000020:00000001:11.0:1773851895.576232:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637101826956288 : -106971882595328 : ffff9eb5aaefdc00)
00000100:00000001:11.0:1773851895.576233:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.576234:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851895.576235:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000575f5ace.
00000020:00000010:11.0:1773851895.576236:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851895.576237:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851895.576237:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851895.576238:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851895.576238:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851895.576239:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851895.576240:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851895.576240:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.576241:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851895.576242:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851895.576243:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851895.576244:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16304@kfi7, seq: 2130867
00000100:00000040:11.0:1773851895.576244:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004de9afed : new rpc_count 1
00000100:00000001:8.0:1773851895.576244:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851895.576244:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851895.576245:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087767936 : -106944621783680 : ffff9ebc03ced580)
00000100:00000001:8.0:1773851895.576245:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.576246:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c0304258 x1859597744840192/t0(0) o400->a04d15c8-374e-40b4-959e-12c9074d5bf5@16304@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1502-0'
00000100:00000001:8.0:1773851895.576247:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.576249:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.576249:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851895.576250:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c0304258 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a04d15c8-374e-40b4-959e-12c9074d5bf5+5:39563:x1859597744840192:12345-16304@kfi7:400:default-tuolumne1502-0
00000100:00000200:11.0:1773851895.576251:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597744840192
00000020:00000001:11.0:1773851895.576251:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851895.576252:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851895.576253:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.576253:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851895.576254:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851895.576255:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851895.576255:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597744840192, found 0 last_xid 1859597744840191
00000020:00000001:11.0:1773851895.576256:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851895.576257:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851895.576257:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851895.576258:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.576258:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851895.576259:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851895.576259:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851895.576260:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006fb27b47.
02000000:00000001:11.0:1773851895.576261:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.576262:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.576262:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851895.576263:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044150690, transno 0, xid 1859597744840192
00010000:00000001:11.0:1773851895.576264:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851895.576264:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c0304258 x1859597744840192/t0(0) o400->a04d15c8-374e-40b4-959e-12c9074d5bf5@16304@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1502-0'
00010000:00000001:11.0:1773851895.576267:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851895.576268:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851895.576268:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=128 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851895.576270:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851895.576270:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f2114774 refcount 3 to 16304@kfi7
00000100:00000001:11.0:1773851895.576271:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134272 : -107146658417344 : ffff9e8cf97c7540)
02000000:00000001:11.0:1773851895.576272:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851895.576272:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.576273:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851895.576274:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16304@kfi7
00000400:00000010:11.0:1773851895.576275:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090967037.
00000100:00000200:11.0:1773851895.576275:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597744840192, offset 224
00000400:00000200:11.0:1773851895.576277:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16304@kfi7
00000400:00000200:11.0:1773851895.576278:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.576278:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 1
00000400:00000200:11.0:1773851895.576280:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000400:00000200:11.0:1773851895.576281:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 3
00000400:00000200:11.0:1773851895.576282:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16304@kfi7 local destination
00000400:00000200:11.0:1773851895.576284:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770193:8770193:1024:4294967295] 16304@kfi7 LPNI seq info [263363:263363:16:4294967295]
00000400:00000200:11.0:1773851895.576285:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000400:00000200:11.0:1773851895.576286:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16304@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.576288:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16304@kfi7(16304@kfi7:16304@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851895.576289:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 3
00000800:00000200:11.0:1773851895.576290:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851895.576291:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851895.576293:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851895.576295:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17e Using peer 16304@kfi7(0x17e)
00000800:00000200:11.0:1773851895.576298:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x17e: rc=0
00000800:00000200:11.0:1773851895.576300:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851895.576302:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.576302:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f2114774 refcount 2 to 16304@kfi7
00010000:00000001:11.0:1773851895.576303:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851895.576304:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.576304:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851895.576305:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c0304258 x1859597744840192/t0(0) o400->a04d15c8-374e-40b4-959e-12c9074d5bf5@16304@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1502-0'
00000100:00100000:11.0:1773851895.576308:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c0304258 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a04d15c8-374e-40b4-959e-12c9074d5bf5+5:39563:x1859597744840192:12345-16304@kfi7:400:default-tuolumne1502-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851895.576310:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16304@kfi7, seq: 2130867
00000100:00000040:11.0:1773851895.576311:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004de9afed : new rpc_count 0
00000100:00000001:11.0:1773851895.576311:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851895.576312:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851895.576313:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000800:00000200:10.0:1773851895.576313:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17e TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851895.576314:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000020:00000010:11.0:1773851895.576315:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000575f5ace.
00000400:00000200:10.0:1773851895.576315:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:11.0:1773851895.576316:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004de9afed : new refcount 4
00000100:00000001:11.0:1773851895.576316:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851895.576316:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16304@kfi7: PUT: OK
00000400:00000200:10.0:1773851895.576317:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090967037
00000400:00000010:10.0:1773851895.576317:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090967037.
00000100:00000001:10.0:1773851895.576318:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851895.576319:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851895.576320:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a632b0ad nid 16304@kfi7 refs 2
00000800:00000200:10.0:1773851895.576321:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 16304@kfi7(0000000089ad9570):0x0 lsk 383 rsk 7 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17e Transaction freed
00000800:00000200:2.0:1773851895.586209:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851895.586210:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851895.586211:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851895.586214:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851895.586215:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23330@kfi7 to cpt 0
00000400:00000200:2.0:1773851895.586217:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23330@kfi7 : PUT - for me
00000400:00000200:2.0:1773851895.586218:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23330@kfi7 to cpt 0
00000400:00000200:2.0:1773851895.586219:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5a8523b nid 23330@kfi7 refs 1
00000400:00000200:2.0:1773851895.586220:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23330@kfi7 to cpt 0
00000400:00000200:2.0:1773851895.586221:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5a8523b nid 23330@kfi7 refs 2
00000400:00000200:2.0:1773851895.586222:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b5a8523b nid 23330@kfi7 refs 3
00000400:00000200:2.0:1773851895.586223:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23523@kfi7 to cpt 6
00000400:00000200:2.0:1773851895.586224:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23523@kfi7 of length 224 into portal 12 MB=0x69b170b6de4c0
00000400:00000200:2.0:1773851895.586225:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23523@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 51888
00000800:00000200:2.0:1773851895.586227:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851895.586229:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851895.586229:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23330@kfi7: PUT: OK
00000100:00000001:2.0:1773851895.586230:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851895.586231:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851895.586232:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005f0b031f.
00000100:00000040:2.0:1773851895.586232:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000005f0b031f x1859373138568384 msgsize 224
00000100:00100000:2.0:1773851895.586234:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-23523@kfi7 (source: 12345-23330@kfi7)
00000100:00000001:2.0:1773851895.586235:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851895.586236:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b5a8523b nid 23330@kfi7 refs 2
00000100:00000001:0.0:1773851895.586236:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851895.586237:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851895.586237:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851895.586237:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851895.586238:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851895.586239:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851895.586239:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373138568384
00000020:00000001:0.0:1773851895.586240:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851895.586240:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dad
00000020:00000001:0.0:1773851895.586241:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851895.586243:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000780e3f3 refcount=6
00000020:00000001:0.0:1773851895.586244:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239487488 : -107152470064128 : ffff9e8b9f15c400)
00000020:00000001:0.0:1773851895.586245:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239487488 : -107152470064128 : ffff9e8b9f15c400)
00000100:00000001:0.0:1773851895.586246:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851895.586247:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851895.586248:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851895.586249:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851895.586250:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851895.586250:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851895.586251:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851895.586251:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851895.586252:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851895.586253:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851895.586254:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.586255:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851895.586256:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851895.586256:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851895.586256:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851895.586257:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851895.586257:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23523@kfi7, seq: 1997623
00000100:00000001:2.0:1773851895.586258:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851895.586258:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000780e3f3 : new rpc_count 1
00000100:00000001:2.0:1773851895.586259:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.586259:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159877915008 : -106913831636608 : ffff9ec32f0b3180)
00000100:00000040:0.0:1773851895.586260:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005f0b031f x1859373138568384/t0(0) o400->30f07c02-9049-4d6f-9da1-9dd151ea1fb9@23523@kfi7:535/0 lens 224/0 e 0 to 0 dl 1773852650 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1947-0'
00000100:00000001:0.0:1773851895.586263:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851895.586263:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851895.586264:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005f0b031f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:30f07c02-9049-4d6f-9da1-9dd151ea1fb9+6:39867:x1859373138568384:12345-23523@kfi7:400:default-tuolumne1947-0
00000100:00000200:0.0:1773851895.586266:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373138568384
00000020:00000001:0.0:1773851895.586266:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851895.586267:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851895.586267:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.586268:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851895.586269:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851895.586269:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851895.586270:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373138568384, found 0 last_xid 1859373138568383
00000020:00000001:0.0:1773851895.586271:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851895.586271:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851895.586272:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851895.586272:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.586273:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851895.586274:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851895.586274:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851895.586275:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fb055bc8.
02000000:00000001:0.0:1773851895.586276:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.586277:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.586277:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851895.586278:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254004601, transno 0, xid 1859373138568384
00010000:00000001:0.0:1773851895.586279:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851895.586279:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005f0b031f x1859373138568384/t0(0) o400->30f07c02-9049-4d6f-9da1-9dd151ea1fb9@23523@kfi7:535/0 lens 224/224 e 0 to 0 dl 1773852650 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1947-0'
00010000:00000001:0.0:1773851895.586282:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851895.586282:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851895.586283:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=128 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851895.586284:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851895.586285:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d7c1bc45 refcount 3 to 23523@kfi7
00000100:00000001:0.0:1773851895.586286:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643692192 : -107157065859424 : ffff9e8a8d277ea0)
02000000:00000001:0.0:1773851895.586286:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851895.586287:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.586288:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851895.586289:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23330@kfi7
00000400:00000010:0.0:1773851895.586289:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071d311d2.
00000100:00000200:0.0:1773851895.586290:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373138568384, offset 224
00000400:00000200:0.0:1773851895.586291:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23330@kfi7
00000400:00000200:0.0:1773851895.586292:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23330@kfi7 to cpt 0
00000400:00000200:0.0:1773851895.586293:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b5a8523b nid 23330@kfi7 refs 1
00000400:00000200:0.0:1773851895.586294:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b5a8523b nid 23330@kfi7 refs 2
00000400:00000200:0.0:1773851895.586295:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b5a8523b nid 23330@kfi7 refs 3
00000400:00000200:0.0:1773851895.586296:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23330@kfi7 local destination
00000400:00000200:0.0:1773851895.586298:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770194:8770194:1024:4294967295] 23330@kfi7 LPNI seq info [706286:706286:16:4294967295]
00000400:00000200:0.0:1773851895.586299:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b5a8523b nid 23330@kfi7 refs 2
00000400:00000200:0.0:1773851895.586300:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23330@kfi7 to cpt 0
00000400:00000200:0.0:1773851895.586301:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23330@kfi7(23330@kfi7:23330@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851895.586303:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b5a8523b nid 23330@kfi7 refs 3
00000800:00000200:0.0:1773851895.586304:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851895.586305:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851895.586307:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851895.586312:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000894 Using peer 23330@kfi7(0x100000000000894)
00000800:00000200:0.0:1773851895.586314:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x100000000000894: rc=0
00000800:00000200:0.0:1773851895.586316:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000894 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851895.586318:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851895.586319:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d7c1bc45 refcount 2 to 23523@kfi7
00010000:00000001:0.0:1773851895.586320:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851895.586320:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.586321:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851895.586321:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005f0b031f x1859373138568384/t0(0) o400->30f07c02-9049-4d6f-9da1-9dd151ea1fb9@23523@kfi7:535/0 lens 224/224 e 0 to 0 dl 1773852650 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1947-0'
00000100:00100000:0.0:1773851895.586326:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005f0b031f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:30f07c02-9049-4d6f-9da1-9dd151ea1fb9+6:39867:x1859373138568384:12345-23523@kfi7:400:default-tuolumne1947-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851895.586328:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23523@kfi7, seq: 1997623
00000100:00000040:0.0:1773851895.586329:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000780e3f3 : new rpc_count 0
00000100:00000001:0.0:1773851895.586330:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851895.586330:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851895.586331:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851895.586332:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851895.586332:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851895.586333:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000780e3f3 : new refcount 5
00000100:00000001:0.0:1773851895.586334:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851895.586339:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000894 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851895.586340:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851895.586342:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23330@kfi7: PUT: OK
00000400:00000200:1.0:1773851895.586343:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071d311d2
00000400:00000010:1.0:1773851895.586343:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071d311d2.
00000100:00000001:1.0:1773851895.586344:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851895.586344:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851895.586345:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b5a8523b nid 23330@kfi7 refs 2
00000800:00000200:1.0:1773851895.586346:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 23330@kfi7(000000004b88d355):0x0 lsk 2197 rsk 13 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000894 Transaction freed
00000004:00000001:6.0:1773851895.625731:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:4.0:1773851895.625731:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851895.625732:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:4.0:1773851895.625732:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:29.0:1773851895.625733:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:28.0:1773851895.625733:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851895.625733:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:8.0:1773851895.625733:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:6.0:1773851895.625733:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a5e1f125.
00000100:00000010:4.0:1773851895.625733:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e1bcef3.
00000100:00000010:28.0:1773851895.625734:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000cfd4930.
00000004:00000020:8.0:1773851895.625734:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:6.0:1773851895.625734:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000020:00000040:4.0:1773851895.625734:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000100:00000001:4.0:1773851895.625734:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:0.0:1773851895.625734:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:0.0:1773851895.625734:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:29.0:1773851895.625735:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851895.625735:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000861b9c78.
00000100:00000001:6.0:1773851895.625735:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851895.625735:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851895.625735:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:0.0:1773851895.625735:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc6defe8.
00000100:00000010:29.0:1773851895.625736:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000035649470.
00000020:00000040:28.0:1773851895.625736:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000020:00000040:8.0:1773851895.625736:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
02000000:00000001:6.0:1773851895.625736:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.625736:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851895.625736:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
00000020:00000040:29.0:1773851895.625737:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:28.0:1773851895.625737:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851895.625737:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:6.0:1773851895.625737:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000075c954ba.
02000000:00000010:4.0:1773851895.625737:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000869d922.
00000100:00000001:29.0:1773851895.625738:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:8.0:1773851895.625738:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851895.625738:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.625738:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.625738:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:0.0:1773851895.625738:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:0.0:1773851895.625738:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851895.625739:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:28.0:1773851895.625739:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851895.625739:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:6.0:1773851895.625739:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851895.625739:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.625739:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851895.625740:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851895.625740:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004cbfdeea.
02000000:00000001:8.0:1773851895.625740:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851895.625740:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a5e1f125] to pc [ptlrpcd_01_03+3]  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851895.625740:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005e1bcef3] to pc [ptlrpcd_01_02+2]  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:0.0:1773851895.625740:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851895.625741:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
00000100:00000001:28.0:1773851895.625741:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851895.625742:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851895.625742:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000010:8.0:1773851895.625742:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
02000000:00000010:0.0:1773851895.625742:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d8f54850.
00000100:00000001:29.0:1773851895.625743:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851895.625743:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851895.625743:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.625743:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851895.625744:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851895.625744:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000cfd4930] to pc [ptlrpcd_07_03+3]  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851895.625744:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:0.0:1773851895.625744:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:29.0:1773851895.625745:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000035649470] to pc [ptlrpcd_07_00+0]  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851895.625745:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.625745:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:6.0:1773851895.625745:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:4.0:1773851895.625745:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:0.0:1773851895.625745:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.625746:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:6.0:1773851895.625746:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000001c35e9b8.
00080000:00000001:6.0:1773851895.625746:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637068452341760 : -107005257209856 : ffff9eade5a7a800)
00000100:00000001:5.0:1773851895.625746:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:4.0:1773851895.625746:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e54f7a48.
00080000:00000001:4.0:1773851895.625746:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637111612699648 : -106962096851968 : ffff9eb7f2367400)
00000100:00000040:8.0:1773851895.625747:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000861b9c78] to pc [ptlrpcd_02_03+3]  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851895.625747:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851895.625747:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851895.625747:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851895.625747:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:4.0:1773851895.625747:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:0.0:1773851895.625747:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000cc6defe8] to pc [ptlrpcd_00_00+0]  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851895.625748:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851895.625748:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851895.625748:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.625749:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:29.0:1773851895.625749:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851895.625749:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00001000:6.0:1773851895.625749:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00000100:00000040:5.0:1773851895.625749:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851895.625750:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:28.0:1773851895.625750:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006d31c239.
00000004:00000010:6.0:1773851895.625750:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006e7b7960.
00000004:00001000:4.0:1773851895.625750:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000004:00000010:4.0:1773851895.625750:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d519b7da.
00000100:00000001:31.0:1773851895.625751:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851895.625751:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851895.625751:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851895.625751:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637134227468288 : -106939482083328 : ffff9ebd36287000)
00000100:00000001:7.0:1773851895.625751:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851895.625751:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851895.625751:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614170079026023ns, next at 614171079025031ns, rc = 0
00000004:00080000:4.0:1773851895.625751:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614170079026514ns, next at 614171079025643ns, rc = 0
00000004:00000001:0.0:1773851895.625751:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.625752:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:30.0:1773851895.625752:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851895.625752:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:7.0:1773851895.625752:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:6.0:1773851895.625752:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:5.0:1773851895.625752:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851895.625752:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851895.625752:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:31.0:1773851895.625753:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851895.625753:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:7.0:1773851895.625753:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851895.625753:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851895.625753:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851895.625753:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:4.0:1773851895.625753:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851895.625753:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851895.625753:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851895.625753:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851895.625754:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851895.625754:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005e1bcef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051939840:2085@kfi7:13:default-yuba2-0
02000000:00000001:5.0:1773851895.625754:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851895.625754:0:41061:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:31.0:1773851895.625755:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851895.625755:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851895.625755:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851895.625755:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851895.625755:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851895.625755:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00100000:5.0:1773851895.625755:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a5e1f125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051939904:46@kfi7:13:default-yuba2-0
00000100:00000001:2.0:1773851895.625755:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851895.625755:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.625756:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.625756:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:30.0:1773851895.625756:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:28.0:1773851895.625756:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
00000100:00000001:10.0:1773851895.625756:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851895.625756:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:7.0:1773851895.625756:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851895.625756:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625756:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:2.0:1773851895.625756:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851895.625756:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851895.625757:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851895.625757:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:28.0:1773851895.625757:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001997fc3d.
00000004:00080000:28.0:1773851895.625757:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614170079032916ns, next at 614171079031964ns, rc = 0
00000100:00000001:10.0:1773851895.625757:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851895.625757:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851895.625757:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006c215bc8.
02000000:00000001:7.0:1773851895.625757:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:5.0:1773851895.625757:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851895.625757:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851895.625757:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851895.625757:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:31.0:1773851895.625758:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000cfd4930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051939968:2065@kfi7:13:default-yuba2-0
00000100:00100000:30.0:1773851895.625758:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000035649470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051940032:2056@kfi7:13:default-yuba2-0
00000100:00000040:10.0:1773851895.625758:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851895.625758:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851895.625758:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637052184779776 : -107021524771840 : ffff9eaa1c085c00)
02000000:00000010:7.0:1773851895.625758:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006f21a4d8.
02000000:00000001:7.0:1773851895.625758:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851895.625758:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:2.0:1773851895.625758:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:31.0:1773851895.625759:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851895.625759:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:28.0:1773851895.625759:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851895.625759:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851895.625759:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000400:00000200:7.0:1773851895.625759:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
02000000:00000010:5.0:1773851895.625759:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006d27463f.
00000100:00000040:2.0:1773851895.625759:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851895.625760:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851895.625760:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851895.625760:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851895.625760:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851895.625760:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:28.0:1773851895.625760:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851895.625760:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851895.625760:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
02000000:00000001:5.0:1773851895.625760:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.625761:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:30.0:1773851895.625761:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:29.0:1773851895.625761:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625761:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851895.625761:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:8.0:1773851895.625761:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000400:00000010:7.0:1773851895.625761:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000400:00000200:5.0:1773851895.625761:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
02000000:00000010:31.0:1773851895.625762:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000004599461.
02000000:00000001:31.0:1773851895.625762:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851895.625762:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000c00a3db3.
02000000:00000001:10.0:1773851895.625762:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:8.0:1773851895.625762:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000019aa59a6.
00000004:00080000:8.0:1773851895.625762:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614170079038036ns, next at 614171079036904ns, rc = 0
00000100:00000200:7.0:1773851895.625762:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939840, portal 4
00000100:00000001:7.0:1773851895.625762:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:5.0:1773851895.625762:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045a04335.
00000400:00000010:5.0:1773851895.625762:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000001:2.0:1773851895.625762:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851895.625762:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851895.625763:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
02000000:00000001:30.0:1773851895.625763:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851895.625763:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.625763:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528723712 : -106978180827904 : ffff9eb433887500)
02000000:00000001:2.0:1773851895.625763:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:31.0:1773851895.625764:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000400:00000200:30.0:1773851895.625764:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00100000:10.0:1773851895.625764:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000861b9c78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051940160:2055@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851895.625764:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:8.0:1773851895.625764:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851895.625764:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851895.625764:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939904, portal 4
00000100:00000001:5.0:1773851895.625764:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:2.0:1773851895.625764:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851895.625765:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e37bb3ee.
00000400:00000010:30.0:1773851895.625765:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000001:10.0:1773851895.625765:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:8.0:1773851895.625765:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851895.625765:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051940096:2057@kfi7:13:default-yuba2-0
00000100:00000200:31.0:1773851895.625766:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051939968, portal 4
00000400:00000010:30.0:1773851895.625766:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005645ee20.
02000000:00000001:10.0:1773851895.625766:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851895.625766:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.625766:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:5.0:1773851895.625766:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359400320 : -107048350151296 : ffff9ea3dd1d8d80)
00000100:00000001:31.0:1773851895.625767:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851895.625767:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324219776 : -106976385331840 : ffff9eb49e8d8d80)
00000100:00000200:30.0:1773851895.625767:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940032, portal 4
00000100:00000001:30.0:1773851895.625767:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:10.0:1773851895.625767:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:7.0:1773851895.625767:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
00000100:00000040:5.0:1773851895.625767:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851895.625767:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:2.0:1773851895.625767:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:30.0:1773851895.625768:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130262238592 : -106943447313024 : ffff9ebc49cfd580)
00000400:00000010:7.0:1773851895.625768:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
00000100:00000200:7.0:1773851895.625768:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939840, offset 0
02000000:00000001:2.0:1773851895.625768:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851895.625768:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:31.0:1773851895.625769:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851895.625769:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:10.0:1773851895.625769:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000009b6047fd.
00000100:00000001:5.0:1773851895.625769:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000010:2.0:1773851895.625769:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d3421c59.
02000000:00000001:10.0:1773851895.625770:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851895.625770:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000100:00000040:5.0:1773851895.625770:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
02000000:00000001:2.0:1773851895.625770:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.625771:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851895.625771:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851895.625771:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000010:5.0:1773851895.625771:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c5557a40.
00000400:00000200:2.0:1773851895.625771:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000040:31.0:1773851895.625772:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000100:00000001:30.0:1773851895.625772:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851895.625772:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000200:5.0:1773851895.625772:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939904, offset 0
00000400:00000010:2.0:1773851895.625772:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000818cdbab.
00000400:00000010:31.0:1773851895.625773:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000100:00000040:30.0:1773851895.625773:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000010:30.0:1773851895.625773:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004cd96fcd.
00000400:00000010:10.0:1773851895.625773:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000400:00000010:10.0:1773851895.625773:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000400:00000200:7.0:1773851895.625773:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:5.0:1773851895.625773:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000010:2.0:1773851895.625773:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bbb4b296.
00000100:00000200:31.0:1773851895.625774:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051939968, offset 0
00000100:00000200:30.0:1773851895.625774:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940032, offset 0
00000400:00000200:7.0:1773851895.625774:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000200:2.0:1773851895.625774:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940096, portal 4
00000400:00000200:31.0:1773851895.625775:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000100:00000200:10.0:1773851895.625775:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940160, portal 4
00000400:00000200:7.0:1773851895.625775:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000100:00000001:2.0:1773851895.625775:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851895.625775:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203078272 : -107102506473344 : ffff9e974125a880)
00000400:00000200:31.0:1773851895.625776:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:30.0:1773851895.625776:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000100:00000001:10.0:1773851895.625776:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851895.625776:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491257472 : -107117218294144 : ffff9e93d4411680)
00000400:00000200:31.0:1773851895.625777:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:7.0:1773851895.625777:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770193, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770194, p:4294967295, g:4294967295, h:1000]
00000100:00000040:2.0:1773851895.625777:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851895.625778:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000040:10.0:1773851895.625778:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851895.625779:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851895.625780:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000100:00000001:10.0:1773851895.625780:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851895.625780:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851895.625780:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:2.0:1773851895.625780:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000200:31.0:1773851895.625781:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000100:00000040:10.0:1773851895.625781:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000200:7.0:1773851895.625781:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000010:2.0:1773851895.625781:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ab3765ed.
00000400:00000010:10.0:1773851895.625782:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d45b4413.
00000100:00000200:2.0:1773851895.625782:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940096, offset 0
00000400:00000200:31.0:1773851895.625783:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770195, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770194, p:4294967295, g:4294967295, h:1000]
00000100:00000200:10.0:1773851895.625783:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940160, offset 0
00000400:00000200:7.0:1773851895.625783:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770195:8770195:1024:4294967295] 2085@kfi7 LPNI seq info [5403246:5403246:16:4294967295]
00000400:00000200:2.0:1773851895.625783:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:31.0:1773851895.625785:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:10.0:1773851895.625785:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:7.0:1773851895.625785:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:2.0:1773851895.625785:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:31.0:1773851895.625786:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851895.625786:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851895.625786:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:2.0:1773851895.625786:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:2.0:1773851895.625786:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851895.625787:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000400:00000200:10.0:1773851895.625787:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:31.0:1773851895.625788:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770196:8770196:1024:4294967295] 2065@kfi7 LPNI seq info [5402834:5402834:16:4294967295]
00000400:00000200:10.0:1773851895.625788:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:7.0:1773851895.625788:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851895.625788:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:10.0:1773851895.625789:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:2.0:1773851895.625789:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:31.0:1773851895.625790:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:10.0:1773851895.625790:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:7.0:1773851895.625790:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:31.0:1773851895.625791:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:7.0:1773851895.625791:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851895.625791:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:2.0:1773851895.625791:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770195, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770196, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851895.625792:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:10.0:1773851895.625792:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770195, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770196, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851895.625792:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:30.0:1773851895.625793:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000800:00000200:7.0:1773851895.625793:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:2.0:1773851895.625793:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851895.625794:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851895.625794:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:5.0:1773851895.625794:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:2.0:1773851895.625794:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851895.625795:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:10.0:1773851895.625795:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:5.0:1773851895.625795:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:2.0:1773851895.625795:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:30.0:1773851895.625796:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:10.0:1773851895.625796:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851895.625796:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851895.625797:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:30.0:1773851895.625797:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000400:00000200:10.0:1773851895.625797:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000200:5.0:1773851895.625797:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000400:00000200:2.0:1773851895.625797:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770197:8770197:1023:4294967295] 2057@kfi7 LPNI seq info [5404112:5404112:16:4294967295]
00000800:00000200:31.0:1773851895.625798:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851895.625798:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770198:8770198:1023:4294967295] 2055@kfi7 LPNI seq info [5404675:5404675:16:4294967295]
00000400:00000200:30.0:1773851895.625799:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770195, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770198, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851895.625799:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Using peer 2085@kfi7(0x113)
00000400:00000200:5.0:1773851895.625799:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770195, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770198, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851895.625799:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:31.0:1773851895.625800:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851895.625800:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:2.0:1773851895.625800:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:30.0:1773851895.625801:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:10.0:1773851895.625801:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:5.0:1773851895.625801:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851895.625802:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851895.625802:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x113: rc=0
00000400:00000200:5.0:1773851895.625802:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:31.0:1773851895.625803:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000400:00000200:5.0:1773851895.625803:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000400:00000200:30.0:1773851895.625804:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000800:00000200:7.0:1773851895.625804:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851895.625804:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851895.625805:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770199:8770199:1023:4294967295] 2056@kfi7 LPNI seq info [5402405:5402405:16:4294967295]
00000400:00000200:5.0:1773851895.625805:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770199:8770199:1023:4294967295] 46@kfi7 LPNI seq info [5403864:5403864:16:4294967295]
00000400:00000200:2.0:1773851895.625805:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000800:00000200:31.0:1773851895.625806:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000400:00000200:10.0:1773851895.625806:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851895.625806:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851895.625807:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851895.625807:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:10.0:1773851895.625807:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000100:00000001:7.0:1773851895.625807:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851895.625807:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851895.625807:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:2.0:1773851895.625807:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000001:7.0:1773851895.625808:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851895.625808:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:30.0:1773851895.625809:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:10.0:1773851895.625809:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:7.0:1773851895.625809:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851895.625809:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851895.625810:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:7.0:1773851895.625810:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851895.625810:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851895.625811:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.625811:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851895.625811:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851895.625811:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851895.625811:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000800:00000200:2.0:1773851895.625811:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:31.0:1773851895.625812:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851895.625812:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000100:00000001:7.0:1773851895.625812:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.625813:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.625813:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851895.625813:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000800:00000200:10.0:1773851895.625813:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:5.0:1773851895.625813:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000001:31.0:1773851895.625814:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851895.625814:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 Using peer 2057@kfi7(0x200000000000294)
00000100:00000001:31.0:1773851895.625815:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851895.625815:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:30.0:1773851895.625815:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:6.0:1773851895.625815:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851895.625815:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:31.0:1773851895.625816:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:30.0:1773851895.625816:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851895.625816:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851895.625817:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851895.625817:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851895.625817:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:31.0:1773851895.625818:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851895.625818:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000800:00000200:10.0:1773851895.625818:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000400:00000200:6.0:1773851895.625818:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000800:00000200:2.0:1773851895.625818:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000e8d7e86a: Posted send of 324 bytes to peer 0x200000000000294: rc=0
00000800:00000200:30.0:1773851895.625819:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851895.625819:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000400:00000010:6.0:1773851895.625819:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000800:00000200:5.0:1773851895.625819:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851895.625820:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851895.625820:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:2.0:1773851895.625820:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851895.625821:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000200:6.0:1773851895.625821:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851895.625822:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Using peer 2056@kfi7(0x204)
00000800:00000200:10.0:1773851895.625822:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d35a17e8: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000800:00000200:5.0:1773851895.625822:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000100:00000001:2.0:1773851895.625822:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851895.625822:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851895.625823:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000100:00000001:2.0:1773851895.625823:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851895.625824:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000100:00000001:29.0:1773851895.625824:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:10.0:1773851895.625824:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851895.625824:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851895.625824:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851895.625824:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851895.625825:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000bfd826e8: Posted send of 324 bytes to peer 0x204: rc=0
00000100:00000200:29.0:1773851895.625825:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851895.625825:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625826:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625826:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:5.0:1773851895.625826:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046518b99: Posted send of 324 bytes to peer 0x3df: rc=0
00000100:00000001:10.0:1773851895.625827:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851895.625827:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851895.625827:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:5.0:1773851895.625827:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851895.625828:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851895.625828:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:10.0:1773851895.625828:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625828:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851895.625828:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000040:29.0:1773851895.625829:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851895.625830:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625830:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851895.625830:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:6.0:1773851895.625830:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Transaction freed
00000100:00000001:5.0:1773851895.625830:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851895.625830:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851895.625831:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851895.625831:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625831:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851895.625831:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851895.625831:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:2.0:1773851895.625831:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851895.625832:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.625832:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851895.625832:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:10.0:1773851895.625832:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625832:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625832:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851895.625832:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00000100:00000001:30.0:1773851895.625833:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851895.625833:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:5.0:1773851895.625833:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851895.625833:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ab3765ed
00000800:00000200:29.0:1773851895.625834:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Transaction freed
00000100:00000001:5.0:1773851895.625834:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:2.0:1773851895.625834:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ab3765ed.
00000100:00000001:2.0:1773851895.625834:0:2506505:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851895.625835:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851895.625835:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:9.0:1773851895.625835:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851895.625835:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000200:2.0:1773851895.625835:0:2506505:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851895.625836:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851895.625836:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851895.625837:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851895.625837:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851895.625837:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851895.625837:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851895.625837:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851895.625838:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.625838:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851895.625838:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:5.0:1773851895.625838:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851895.625838:0:2506505:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:29.0:1773851895.625839:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851895.625839:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d45b4413
00000100:00000001:5.0:1773851895.625839:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851895.625839:0:2506505:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851895.625840:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000400:00000010:9.0:1773851895.625840:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d45b4413.
00000100:00000001:9.0:1773851895.625840:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:6.0:1773851895.625840:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851895.625841:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004cd96fcd
00000100:00000200:9.0:1773851895.625841:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851895.625841:0:2506505:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851895.625842:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004cd96fcd.
00000100:00000001:29.0:1773851895.625842:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:6.0:1773851895.625842:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851895.625842:0:2506505:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:29.0:1773851895.625843:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851895.625843:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000400:00000200:2.0:1773851895.625843:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:9.0:1773851895.625844:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:6.0:1773851895.625844:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c5557a40
00000100:00000040:9.0:1773851895.625845:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851895.625845:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c5557a40.
00000800:00000200:2.0:1773851895.625845:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 Transaction freed
00000100:00000001:29.0:1773851895.625846:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851895.625846:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851895.625846:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851895.625847:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851895.625849:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851895.625849:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851895.625850:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851895.625850:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851895.625850:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:6.0:1773851895.625850:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851895.625851:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:29.0:1773851895.625852:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:6.0:1773851895.625852:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851895.625853:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Transaction freed
00000100:00000001:6.0:1773851895.625853:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:29.0:1773851895.625854:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Transaction freed
00000400:00000200:6.0:1773851895.625854:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:5.0:1773851895.625855:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851895.625856:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046518b99: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000800:00000200:5.0:1773851895.625856:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851895.625857:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851895.625859:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851895.625860:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851895.625861:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851895.625861:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:17.0:1773851895.625862:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851895.625863:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2085@kfi7 : PUT - for me
00000800:00000200:17.0:1773851895.625864:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851895.625864:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.625865:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000400:00000200:5.0:1773851895.625865:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:17.0:1773851895.625866:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:5.0:1773851895.625866:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:17.0:1773851895.625868:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:5.0:1773851895.625868:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:17.0:1773851895.625869:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:5.0:1773851895.625869:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:17.0:1773851895.625870:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:5.0:1773851895.625870:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6400
00000400:00000200:17.0:1773851895.625871:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:5.0:1773851895.625871:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:17.0:1773851895.625872:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:17.0:1773851895.625873:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:5.0:1773851895.625873:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b32285 [1] + 224
00000400:00000200:17.0:1773851895.625874:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:21.0:1773851895.625875:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:17.0:1773851895.625875:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6480
00000800:00000200:5.0:1773851895.625875:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851895.625876:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851895.625876:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:5.0:1773851895.625876:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851895.625877:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851895.625877:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f21f1 [1] + 224
00000400:00000200:5.0:1773851895.625878:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000800:00000200:17.0:1773851895.625879:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851895.625879:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851895.625880:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000200:5.0:1773851895.625880:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851895.625881:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851895.625882:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:17.0:1773851895.625882:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000040:5.0:1773851895.625882:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851895.625883:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000100:00000001:17.0:1773851895.625883:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:9.0:1773851895.625883:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851895.625884:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851895.625884:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:21.0:1773851895.625885:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000200:17.0:1773851895.625885:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851895.625885:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:2.0:1773851895.625885:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851895.625886:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:5.0:1773851895.625886:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000800:00000200:2.0:1773851895.625886:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851895.625887:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:9.0:1773851895.625887:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851895.625887:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851895.625887:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851895.625887:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000200:21.0:1773851895.625888:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000040:17.0:1773851895.625888:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:7.0:1773851895.625888:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:2.0:1773851895.625888:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851895.625889:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:9.0:1773851895.625889:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000001:7.0:1773851895.625889:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851895.625889:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:21.0:1773851895.625890:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:7.0:1773851895.625890:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:7.0:1773851895.625890:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000400:00000200:2.0:1773851895.625890:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:21.0:1773851895.625891:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6540
00000400:00000200:9.0:1773851895.625891:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:7.0:1773851895.625891:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851895.625892:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851895.625892:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:21.0:1773851895.625893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:9.0:1773851895.625893:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000400:00000200:2.0:1773851895.625893:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:21.0:1773851895.625894:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d1e15 [1] + 224
00000100:00000001:17.0:1773851895.625894:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:13.0:1773851895.625894:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851895.625894:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:17.0:1773851895.625895:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:13.0:1773851895.625895:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:7.0:1773851895.625895:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851895.625895:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000800:00000200:13.0:1773851895.625896:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851895.625896:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000400:00000200:2.0:1773851895.625896:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:31.0:1773851895.625897:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851895.625897:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851895.625897:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851895.625897:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:9.0:1773851895.625897:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:7.0:1773851895.625897:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:2.0:1773851895.625897:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000001:31.0:1773851895.625898:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851895.625898:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:21.0:1773851895.625898:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:13.0:1773851895.625898:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851895.625898:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:7.0:1773851895.625898:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.625898:0:41066:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:2.0:1773851895.625898:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000010:31.0:1773851895.625899:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:21.0:1773851895.625899:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000400:00000200:9.0:1773851895.625899:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
02000000:00000001:7.0:1773851895.625899:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851895.625899:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:31.0:1773851895.625900:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e37bb3ee
00000400:00000010:31.0:1773851895.625900:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e37bb3ee.
00000400:00000200:9.0:1773851895.625900:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:7.0:1773851895.625900:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851895.625900:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851895.625900:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:31.0:1773851895.625901:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:21.0:1773851895.625901:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851895.625901:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851895.625901:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6440
00000100:00001000:7.0:1773851895.625901:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=128 v=66 (66 66 66 66)
00000400:00000200:2.0:1773851895.625901:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b64c0
00000100:00000200:31.0:1773851895.625902:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:21.0:1773851895.625902:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851895.625902:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2057@kfi7 : PUT - for me
00000100:00001000:7.0:1773851895.625902:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=128 v=66 (1 1 1 1)
00000400:00000200:2.0:1773851895.625902:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:13.0:1773851895.625903:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851895.625903:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:7.0:1773851895.625903:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851895.625903:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851895.625904:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:9.0:1773851895.625904:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781698e09 [1] + 224
00010000:00000001:7.0:1773851895.625904:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851895.625904:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:2.0:1773851895.625904:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71e501 [1] + 224
00000100:00000040:21.0:1773851895.625905:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851895.625905:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:7.0:1773851895.625905:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851895.625905:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000200:31.0:1773851895.625906:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851895.625906:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:9.0:1773851895.625906:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851895.625906:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851895.625906:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851895.625907:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000100:00000040:7.0:1773851895.625907:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:2.0:1773851895.625907:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851895.625908:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851895.625908:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851895.625908:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851895.625908:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851895.625909:0:41091:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:21.0:1773851895.625909:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851895.625909:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6500
00000400:00000200:2.0:1773851895.625909:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:31.0:1773851895.625910:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851895.625910:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:21.0:1773851895.625910:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:13.0:1773851895.625910:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000100:00000001:10.0:1773851895.625910:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851895.625910:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000001:7.0:1773851895.625910:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:2.0:1773851895.625910:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000100:00000001:31.0:1773851895.625911:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851895.625911:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851895.625911:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f724d [1] + 224
00000100:00000001:10.0:1773851895.625911:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851895.625911:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851895.625911:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851895.625911:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851895.625912:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:10.0:1773851895.625912:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851895.625912:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:9.0:1773851895.625912:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851895.625912:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851895.625912:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000100:00000001:2.0:1773851895.625912:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:31.0:1773851895.625913:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=128 v=66 (66 66 66 66)
00000800:00000200:13.0:1773851895.625913:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:10.0:1773851895.625913:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000004:00000040:7.0:1773851895.625913:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351465986048 avail=351462875136 avail_mb=1372901856 hwm_mb=3131103 files=372062748 ffree=343228502 state=0: rc = 0
00000100:00000200:2.0:1773851895.625913:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851895.625914:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=128 v=66 (1 1 1 1)
00000400:00000200:10.0:1773851895.625914:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851895.625914:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:31.0:1773851895.625915:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851895.625915:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851895.625915:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851895.625915:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:9.0:1773851895.625915:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:7.0:1773851895.625915:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351465986048 free, 351462875136 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062748 files, 343228502 free files
00010000:00000001:31.0:1773851895.625916:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851895.625916:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851895.625916:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00000100:00000200:10.0:1773851895.625916:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851895.625916:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851895.625916:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.625917:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:13.0:1773851895.625917:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:7.0:1773851895.625917:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851895.625918:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000200:13.0:1773851895.625918:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.625919:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851895.625919:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851895.625919:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851895.625919:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:31.0:1773851895.625920:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:9.0:1773851895.625920:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00100000:7.0:1773851895.625920:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005e1bcef3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051939840:2085@kfi7:13:default-yuba2-0
00000100:00000001:2.0:1773851895.625920:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:13.0:1773851895.625921:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851895.625921:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851895.625921:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851895.625921:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851895.625921:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:2.0:1773851895.625921:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:31.0:1773851895.625922:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851895.625922:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851895.625922:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851895.625922:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851895.625922:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000001:5.0:1773851895.625922:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:31.0:1773851895.625923:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851895.625923:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851895.625923:0:41071:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:7.0:1773851895.625923:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005e1bcef3 x1859433051939840/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:5.0:1773851895.625923:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:2.0:1773851895.625923:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851895.625924:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851895.625924:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000001:30.0:1773851895.625924:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851895.625924:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:10.0:1773851895.625924:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851895.625924:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000010:5.0:1773851895.625924:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045a04335.
00000400:00000200:5.0:1773851895.625924:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000004:00000040:31.0:1773851895.625925:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000400:00000010:30.0:1773851895.625925:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:13.0:1773851895.625925:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851895.625925:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.625925:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851895.625925:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000400:00000010:5.0:1773851895.625925:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00000001:5.0:1773851895.625925:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000040:31.0:1773851895.625926:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464032256 avail=351458236416 avail_mb=1372883736 hwm_mb=3131101 files=372064693 ffree=343226594 state=0: rc = 0
00000400:00000200:30.0:1773851895.625926:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005645ee20
00000400:00000200:13.0:1773851895.625926:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
02000000:00000001:10.0:1773851895.625926:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851895.625926:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006f21a4d8.
00000100:00000200:5.0:1773851895.625926:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:30.0:1773851895.625927:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005645ee20.
00000100:00001000:10.0:1773851895.625927:0:41071:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=128 v=66 (66 66 66 66)
02000000:00000001:7.0:1773851895.625927:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851895.625927:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000020:31.0:1773851895.625928:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464032256 free, 351458236416 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064693 files, 343226594 free files
00000100:00000001:30.0:1773851895.625928:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851895.625928:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00001000:10.0:1773851895.625928:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=128 v=66 (1 1 1 1)
00000020:00000040:7.0:1773851895.625928:0:41066:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000020:00000001:7.0:1773851895.625928:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:0.0:1773851895.625928:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:31.0:1773851895.625929:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851895.625929:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851895.625929:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851895.625929:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851895.625929:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000869d922.
02000000:00000001:7.0:1773851895.625929:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000200:5.0:1773851895.625929:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851895.625929:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:31.0:1773851895.625930:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:10.0:1773851895.625930:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:7.0:1773851895.625930:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851895.625930:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005e1bcef3.
00000400:00000001:0.0:1773851895.625930:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:0.0:1773851895.625930:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:10.0:1773851895.625931:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625931:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851895.625931:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851895.625931:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851895.625931:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:0.0:1773851895.625931:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000818cdbab.
00000100:00000200:30.0:1773851895.625932:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851895.625932:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:7.0:1773851895.625932:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851895.625932:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:0.0:1773851895.625932:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bbb4b296
00000400:00000010:0.0:1773851895.625932:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bbb4b296.
00000100:00100000:31.0:1773851895.625933:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000cfd4930 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051939968:2065@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851895.625933:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851895.625933:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851895.625933:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851895.625933:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625933:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851895.625933:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:0.0:1773851895.625933:0:41061:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851895.625934:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851895.625934:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:10.0:1773851895.625934:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851895.625934:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851895.625934:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625934:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851895.625934:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:0.0:1773851895.625934:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.625935:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851895.625935:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:5.0:1773851895.625935:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.625936:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000cfd4930 x1859433051939968/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851895.625936:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851895.625936:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:5.0:1773851895.625936:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=128 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851895.625937:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851895.625937:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625937:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851895.625937:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00001000:5.0:1773851895.625937:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=128 v=66 (1 1 1 1)
00000100:00000200:0.0:1773851895.625937:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851895.625938:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851895.625938:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625938:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851895.625938:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:5.0:1773851895.625938:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:31.0:1773851895.625939:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851895.625939:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000004599461.
00000100:00001000:30.0:1773851895.625939:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=128 v=66 (66 66 66 66)
00000004:00000040:10.0:1773851895.625939:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00000001:5.0:1773851895.625939:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851895.625939:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:31.0:1773851895.625940:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00001000:30.0:1773851895.625940:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=128 v=66 (1 1 1 1)
00000004:00000040:10.0:1773851895.625940:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382714368 avail=351380626432 avail_mb=1372580572 hwm_mb=3131101 files=371978599 ffree=343147182 state=0: rc = 0
00010000:00000001:5.0:1773851895.625940:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.625940:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:0.0:1773851895.625940:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851895.625941:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851895.625941:0:41091:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000100:00000001:30.0:1773851895.625941:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851895.625941:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:0.0:1773851895.625941:0:41061:0:(client.c:1428:after_reply()) Process entered
00000020:00000001:31.0:1773851895.625942:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:30.0:1773851895.625942:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:10.0:1773851895.625942:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382714368 free, 351380626432 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978599 files, 343147182 free files
00000100:00000040:5.0:1773851895.625942:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000001:5.0:1773851895.625942:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000001:0.0:1773851895.625942:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:0.0:1773851895.625942:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000010:31.0:1773851895.625943:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004cbfdeea.
00010000:00000001:30.0:1773851895.625943:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851895.625943:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625943:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.625943:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851895.625943:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.625944:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:30.0:1773851895.625944:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000001:10.0:1773851895.625944:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851895.625944:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:0.0:1773851895.625944:0:41061:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=128 v=66 (66 66 66 66)
02000000:00000001:31.0:1773851895.625945:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851895.625945:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000cfd4930.
00000100:00000040:30.0:1773851895.625945:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:30.0:1773851895.625945:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:10.0:1773851895.625945:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:0.0:1773851895.625945:0:41061:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=128 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851895.625946:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851895.625946:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851895.625946:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.625946:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851895.625947:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851895.625947:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851895.625947:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000861b9c78 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051940160:2055@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851895.625947:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851895.625947:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851895.625947:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.625948:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851895.625948:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625948:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:0.0:1773851895.625948:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:0.0:1773851895.625948:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.625949:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851895.625949:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851895.625949:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851895.625949:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851895.625949:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000100:00000001:0.0:1773851895.625949:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:30.0:1773851895.625950:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851895.625950:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851895.625950:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000861b9c78 x1859433051940160/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:5.0:1773851895.625950:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489068032 avail=351486036992 avail_mb=1372992332 hwm_mb=3131103 files=372066743 ffree=343251043 state=0: rc = 0
00000100:00000040:0.0:1773851895.625950:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00000001:30.0:1773851895.625951:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851895.625951:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851895.625951:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:0.0:1773851895.625951:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851895.625952:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:5.0:1773851895.625952:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489068032 free, 351486036992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066743 files, 343251043 free files
00000100:00000040:0.0:1773851895.625952:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:30.0:1773851895.625953:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000100:00000001:10.0:1773851895.625953:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851895.625953:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000040:30.0:1773851895.625954:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545833472 avail=351536191488 avail_mb=1373188248 hwm_mb=3131103 files=372116380 ffree=343306478 state=0: rc = 0
00000004:00000001:5.0:1773851895.625954:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851895.625955:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000009b6047fd.
00000100:00000040:5.0:1773851895.625955:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:0.0:1773851895.625955:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:30.0:1773851895.625956:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545833472 free, 351536191488 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116380 files, 343306478 free files
02000000:00000001:10.0:1773851895.625956:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851895.625956:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:0.0:1773851895.625956:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851895.625956:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851895.625957:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851895.625957:0:41071:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000004:00000001:0.0:1773851895.625957:0:41061:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000001:10.0:1773851895.625958:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851895.625958:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00100000:5.0:1773851895.625958:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a5e1f125 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051939904:46@kfi7:13:default-yuba2-0
00000004:00000040:0.0:1773851895.625958:0:41061:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000004:00000040:0.0:1773851895.625958:0:41061:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406502912 avail=351404106752 avail_mb=1372672292 hwm_mb=3131103 files=372127127 ffree=343170413 state=0: rc = 0
00000100:00000040:30.0:1773851895.625959:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:10.0:1773851895.625959:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851895.625959:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851895.625960:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000861b9c78.
00000100:00000001:5.0:1773851895.625960:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851895.625960:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000020:0.0:1773851895.625960:0:41061:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406502912 free, 351404106752 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127127 files, 343170413 free files
00000100:00100000:30.0:1773851895.625961:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000035649470 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051940032:2056@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851895.625961:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851895.625961:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851895.625962:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:5.0:1773851895.625962:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a5e1f125 x1859433051939904/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:0.0:1773851895.625962:0:41061:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851895.625963:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851895.625963:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:10.0:1773851895.625963:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851895.625963:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851895.625963:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851895.625964:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851895.625964:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625964:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851895.625964:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:30.0:1773851895.625965:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000035649470 x1859433051940032/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:5.0:1773851895.625965:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006d27463f.
02000000:00000001:5.0:1773851895.625966:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00100000:0.0:1773851895.625966:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051940096:2057@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851895.625967:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:5.0:1773851895.625967:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851895.625967:0:41067:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
02000000:00000001:30.0:1773851895.625968:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851895.625968:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000c00a3db3.
00000020:00000001:5.0:1773851895.625968:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:0.0:1773851895.625968:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:5.0:1773851895.625969:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000075c954ba.
02000000:00000001:5.0:1773851895.625969:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:0.0:1773851895.625969:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:0.0:1773851895.625969:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000cc6defe8 x1859433051940096/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852048 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:30.0:1773851895.625970:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851895.625970:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851895.625970:0:41088:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
02000000:00000001:5.0:1773851895.625970:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:30.0:1773851895.625971:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000010:5.0:1773851895.625971:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a5e1f125.
00000100:00000001:0.0:1773851895.625971:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:5.0:1773851895.625972:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:0.0:1773851895.625972:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851895.625973:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
00000100:00000001:5.0:1773851895.625973:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851895.625973:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:0.0:1773851895.625973:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d3421c59.
02000000:00000001:30.0:1773851895.625974:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851895.625974:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:5.0:1773851895.625974:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:0.0:1773851895.625974:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:0.0:1773851895.625974:0:41061:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000010:30.0:1773851895.625975:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000035649470.
00000100:00000001:5.0:1773851895.625975:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851895.625975:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000040:0.0:1773851895.625975:0:41061:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000100:00000001:30.0:1773851895.625976:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851895.625976:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851895.625976:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851895.625976:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:0.0:1773851895.625976:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d8f54850.
00000100:00000001:30.0:1773851895.625977:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:0.0:1773851895.625977:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:30.0:1773851895.625978:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851895.625978:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851895.625978:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:0.0:1773851895.625978:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc6defe8.
00000100:00000001:30.0:1773851895.625979:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851895.625979:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.625979:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:0.0:1773851895.625980:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851895.625980:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851895.625982:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:0.0:1773851895.625982:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851895.625983:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851895.625983:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851895.630073:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851895.630073:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851895.630073:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851895.630074:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851895.630075:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851895.630075:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851895.630077:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851895.630077:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18643@kfi7(0000000042f5e03c):0xd76 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851895.630078:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 Using peer 18643@kfi7(0xd76)
00000400:00000200:27.0:1773851895.630079:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18643@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.630080:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18643@kfi7 : PUT - for me
00000400:00000200:25.0:1773851895.630080:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18643@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.630081:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18643@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.630082:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005dd96c60 nid 18643@kfi7 refs 1
00000800:00000200:25.0:1773851895.630082:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000878f9def: Posted send of 38 bytes to peer 0xd76: rc=0
00000400:00000200:27.0:1773851895.630083:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18643@kfi7 to cpt 6
00000800:00000200:25.0:1773851895.630083:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851895.630084:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005dd96c60 nid 18643@kfi7 refs 2
00000400:00000200:27.0:1773851895.630085:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005dd96c60 nid 18643@kfi7 refs 3
00000400:00000200:27.0:1773851895.630085:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18642@kfi7 to cpt 2
00000400:00000200:27.0:1773851895.630086:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18642@kfi7 of length 456 into portal 12 MB=0x69b4c65e6ed00
00000400:00000200:27.0:1773851895.630088:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18642@kfi7 of length 456/456 into md 0x16159c9699 [64] + 37304
00000800:00000200:27.0:1773851895.630090:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851895.630092:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851895.630093:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18643@kfi7: PUT: OK
00000100:00000001:27.0:1773851895.630094:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851895.630095:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851895.630095:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 TN_EVENT_TX_OK event status 0
00000100:00000010:27.0:1773851895.630096:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000032a4fb2f.
00000100:00000040:27.0:1773851895.630097:0:2464256:0:(events.c:358:request_in_callback()) incoming req@0000000032a4fb2f x1859602289716480 msgsize 456
00000800:00000200:25.0:1773851895.630097:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 Transaction freed
00000100:00100000:27.0:1773851895.630099:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-18642@kfi7 (source: 12345-18643@kfi7)
00000100:00000001:27.0:1773851895.630100:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851895.630101:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005dd96c60 nid 18643@kfi7 refs 2
00000800:00000200:27.0:1773851895.630102:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000005690846: 2069@kfi7:6 <- 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851895.630105:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851895.630106:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851895.630106:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851895.630107:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851895.630108:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851895.630108:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602289716480
00000020:00000001:27.0:1773851895.630109:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851895.630109:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7afae
00000020:00000001:27.0:1773851895.630110:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851895.630113:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000aa7a468 refcount=2106
00000020:00000001:27.0:1773851895.630114:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637037010011136 : -107036699540480 : ffff9ea6938bc400)
00000020:00000001:27.0:1773851895.630114:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637037010011136 : -107036699540480 : ffff9ea6938bc400)
00000100:00000001:27.0:1773851895.630115:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851895.630116:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851895.630117:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bf277de5.
00000020:00000010:27.0:1773851895.630118:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851895.630119:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009d0a58f3.
00000100:00000001:27.0:1773851895.630120:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851895.630120:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851895.630120:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.630122:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.630123:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851895.630124:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851895.630124:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851895.630124:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:27.0:1773851895.630125:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18642@kfi7, seq: 1451911042
00000100:00000001:24.0:1773851895.630125:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:27.0:1773851895.630126:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000aa7a468 : new rpc_count 21
00000100:00000001:24.0:1773851895.630126:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.630127:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998388224 : -107053711163392 : ffff9ea29d930000)
00000100:00000001:24.0:1773851895.630127:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.630128:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000032a4fb2f x1859602289716480/t0(0) o17->d5d92dd5-7237-48c9-89c0-292bb907eb51@18642@kfi7:622/0 lens 456/0 e 0 to 0 dl 1773851982 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1653-0'
00000100:00000001:27.0:1773851895.630133:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851895.630134:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851895.630135:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032a4fb2f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:d5d92dd5-7237-48c9-89c0-292bb907eb51+2106:39672:x1859602289716480:12345-18642@kfi7:17:default-tuolumne1653-0
00000100:00000200:27.0:1773851895.630136:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602289716480
00000020:00000001:27.0:1773851895.630137:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851895.630137:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851895.630138:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.630139:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851895.630139:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:27.0:1773851895.630140:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851895.630140:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602289716480, found 0 last_xid 1859602288981567
00000020:00000001:27.0:1773851895.630141:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851895.630142:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851895.630142:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851895.630143:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:27.0:1773851895.630144:0:41182:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:27.0:1773851895.630144:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851895.630145:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851895.630146:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000ac1b785e.
02000000:00000001:27.0:1773851895.630146:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.630147:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.630148:0:41182:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:27.0:1773851895.630148:0:41182:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:27.0:1773851895.630149:0:41182:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:27.0:1773851895.630150:0:41182:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.630151:0:41182:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:27.0:1773851895.630152:0:41182:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli d5d92dd5-7237-48c9-89c0-292bb907eb51/000000000aa7a468 free: 126633370845184 avail: 126633368748032
00000020:00000001:27.0:1773851895.630153:0:41182:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:27.0:1773851895.630153:0:41182:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli d5d92dd5-7237-48c9-89c0-292bb907eb51/000000000aa7a468 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:27.0:1773851895.630155:0:41182:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:27.0:1773851895.630156:0:41182:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:27.0:1773851895.630156:0:41182:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli d5d92dd5-7237-48c9-89c0-292bb907eb51/000000000aa7a468 reports grant 1780482047 dropped 0, local 1882456063
00000020:00000001:27.0:1773851895.630157:0:41182:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:27.0:1773851895.630158:0:41182:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:27.0:1773851895.630158:0:41182:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851895.630159:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264577657, transno 0, xid 1859602289716480
00010000:00000001:27.0:1773851895.630160:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851895.630161:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000032a4fb2f x1859602289716480/t0(0) o17->d5d92dd5-7237-48c9-89c0-292bb907eb51@18642@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1653-0'
00010000:00000001:27.0:1773851895.630163:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851895.630164:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851895.630165:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=128 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851895.630166:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851895.630167:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006b125fea refcount 3 to 18642@kfi7
00000100:00000001:27.0:1773851895.630167:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959058496 : -107146750493120 : ffff9e8cf3ff7e40)
02000000:00000001:27.0:1773851895.630168:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851895.630169:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.630169:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851895.630170:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18643@kfi7
00000400:00000010:27.0:1773851895.630171:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aa68e447.
00000100:00000200:27.0:1773851895.630172:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859602289716480, offset 224
00000400:00000200:27.0:1773851895.630173:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18643@kfi7
00000400:00000200:27.0:1773851895.630174:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18643@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.630174:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005dd96c60 nid 18643@kfi7 refs 1
00000400:00000200:27.0:1773851895.630175:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005dd96c60 nid 18643@kfi7 refs 2
00000400:00000200:27.0:1773851895.630176:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005dd96c60 nid 18643@kfi7 refs 3
00000400:00000200:27.0:1773851895.630178:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18643@kfi7 local destination
00000400:00000200:27.0:1773851895.630179:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770200:8770200:1024:4294967295] 18643@kfi7 LPNI seq info [18139650:18139650:16:4294967295]
00000400:00000200:27.0:1773851895.630180:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005dd96c60 nid 18643@kfi7 refs 2
00000400:00000200:27.0:1773851895.630181:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18643@kfi7 to cpt 6
00000400:00000200:27.0:1773851895.630183:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18643@kfi7(18643@kfi7:18643@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851895.630184:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005dd96c60 nid 18643@kfi7 refs 3
00000800:00000200:27.0:1773851895.630185:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851895.630186:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:27.0:1773851895.630188:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851895.630191:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 Using peer 18643@kfi7(0xd76)
00000800:00000200:27.0:1773851895.630193:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000005690846: Posted send of 532 bytes to peer 0xd76: rc=0
00000800:00000200:27.0:1773851895.630195:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851895.630196:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.630197:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006b125fea refcount 2 to 18642@kfi7
00010000:00000001:27.0:1773851895.630198:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851895.630199:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.630199:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851895.630200:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000032a4fb2f x1859602289716480/t0(0) o17->d5d92dd5-7237-48c9-89c0-292bb907eb51@18642@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1653-0'
00000100:00100000:27.0:1773851895.630203:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032a4fb2f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:d5d92dd5-7237-48c9-89c0-292bb907eb51+2106:39672:x1859602289716480:12345-18642@kfi7:17:default-tuolumne1653-0 Request processed in 69us (105us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851895.630205:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18642@kfi7, seq: 1451911042
00000100:00000040:27.0:1773851895.630206:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000aa7a468 : new rpc_count 20
00000800:00000200:25.0:1773851895.630206:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851895.630207:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851895.630207:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851895.630207:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851895.630208:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851895.630208:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009d0a58f3.
00000400:00000200:25.0:1773851895.630208:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18643@kfi7: PUT: OK
00000020:00000010:27.0:1773851895.630209:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bf277de5.
00000400:00000200:25.0:1773851895.630209:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aa68e447
00000400:00000010:25.0:1773851895.630209:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aa68e447.
00000020:00000040:27.0:1773851895.630210:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000000aa7a468 : new refcount 2105
00000100:00000001:25.0:1773851895.630210:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851895.630210:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:27.0:1773851895.630211:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851895.630211:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005dd96c60 nid 18643@kfi7 refs 2
00000800:00000200:25.0:1773851895.630212:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000005690846: 2069@kfi7:6 -> 18643@kfi7(0000000042f5e03c):0x0 lsk 3447 rsk 8 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd76 Transaction freed
00000800:00000200:5.0:1773851895.647419:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851895.647421:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851895.647423:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851895.647427:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851895.647431:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15361@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.647433:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15361@kfi7 : PUT - for me
00000400:00000200:5.0:1773851895.647435:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15361@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.647436:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b84210d nid 15361@kfi7 refs 1
00000400:00000200:5.0:1773851895.647439:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15361@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.647440:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b84210d nid 15361@kfi7 refs 2
00000400:00000200:5.0:1773851895.647441:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b84210d nid 15361@kfi7 refs 3
00000400:00000200:5.0:1773851895.647443:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15361@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.647445:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15361@kfi7 of length 224 into portal 12 MB=0x69b4b5c281bc0
00000400:00000200:5.0:1773851895.647447:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15361@kfi7 of length 224/224 into md 0x793926dc5 [64] + 163520
00000800:00000200:5.0:1773851895.647450:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851895.647453:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.647455:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15361@kfi7: PUT: OK
00000100:00000001:5.0:1773851895.647456:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851895.647457:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851895.647460:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f06a3a1.
00000100:00000040:5.0:1773851895.647461:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000002f06a3a1 x1859597831248832 msgsize 224
00000100:00100000:5.0:1773851895.647463:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-15361@kfi7 (source: 12345-15361@kfi7)
00000100:00000001:5.0:1773851895.647465:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851895.647467:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009b84210d nid 15361@kfi7 refs 2
00000100:00000001:4.0:1773851895.647468:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851895.647469:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851895.647469:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851895.647470:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851895.647471:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.647472:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851895.647473:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597831248832
00000020:00000001:4.0:1773851895.647474:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851895.647475:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d803c8
00000020:00000001:4.0:1773851895.647476:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851895.647478:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000329d6171 refcount=5
00000020:00000001:4.0:1773851895.647479:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105660593152 : -106968048958464 : ffff9eb68f708400)
00000020:00000001:4.0:1773851895.647480:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105660593152 : -106968048958464 : ffff9eb68f708400)
00000100:00000001:4.0:1773851895.647482:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.647483:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851895.647484:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851895.647486:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.647487:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000031fbcfde.
00000100:00000001:4.0:1773851895.647489:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851895.647490:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851895.647490:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.647492:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851895.647493:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851895.647494:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.647495:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.647497:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851895.647498:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851895.647498:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851895.647499:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851895.647500:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15361@kfi7, seq: 2001991
00000100:00000001:7.0:1773851895.647501:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.647501:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000329d6171 : new rpc_count 1
00000100:00000001:7.0:1773851895.647502:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.647502:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114931855104 : -106958777696512 : ffff9eb8b80cbf00)
00000100:00000040:4.0:1773851895.647505:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f06a3a1 x1859597831248832/t0(0) o400->5c98344f-a956-480f-811f-d6da37a801a1@15361@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1459-0'
00000100:00000001:4.0:1773851895.647509:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.647510:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851895.647511:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f06a3a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5c98344f-a956-480f-811f-d6da37a801a1+5:39720:x1859597831248832:12345-15361@kfi7:400:default-tuolumne1459-0
00000100:00000200:4.0:1773851895.647513:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597831248832
00000020:00000001:4.0:1773851895.647514:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851895.647515:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851895.647517:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.647518:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851895.647518:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851895.647520:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851895.647521:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597831248832, found 0 last_xid 1859597831248831
00000020:00000001:4.0:1773851895.647522:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851895.647523:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851895.647523:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851895.647524:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.647525:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851895.647526:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851895.647527:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851895.647528:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003551322f.
02000000:00000001:4.0:1773851895.647529:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.647530:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.647531:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851895.647532:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915825600, transno 0, xid 1859597831248832
00010000:00000001:4.0:1773851895.647533:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851895.647535:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f06a3a1 x1859597831248832/t0(0) o400->5c98344f-a956-480f-811f-d6da37a801a1@15361@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1459-0'
00010000:00000001:4.0:1773851895.647538:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851895.647539:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851895.647540:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=127 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851895.647542:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851895.647544:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032dcd023 refcount 3 to 15361@kfi7
00000100:00000001:4.0:1773851895.647545:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704128 : -107156155847488 : ffff9e8ac3652cc0)
02000000:00000001:4.0:1773851895.647547:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851895.647547:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.647549:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851895.647550:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15361@kfi7
00000400:00000010:4.0:1773851895.647551:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000058aef11.
00000100:00000200:4.0:1773851895.647553:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597831248832, offset 224
00000400:00000200:4.0:1773851895.647555:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15361@kfi7
00000400:00000200:4.0:1773851895.647556:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15361@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.647558:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b84210d nid 15361@kfi7 refs 1
00000400:00000200:4.0:1773851895.647559:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b84210d nid 15361@kfi7 refs 2
00000400:00000200:4.0:1773851895.647561:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b84210d nid 15361@kfi7 refs 3
00000400:00000200:4.0:1773851895.647563:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15361@kfi7 local destination
00000400:00000200:4.0:1773851895.647565:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770201:8770201:1024:4294967295] 15361@kfi7 LPNI seq info [802828:802828:16:4294967295]
00000400:00000200:4.0:1773851895.647567:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009b84210d nid 15361@kfi7 refs 2
00000400:00000200:4.0:1773851895.647569:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15361@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.647572:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15361@kfi7(15361@kfi7:15361@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851895.647574:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b84210d nid 15361@kfi7 refs 3
00000800:00000200:4.0:1773851895.647576:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851895.647578:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851895.647582:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851895.647586:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000063b Using peer 15361@kfi7(0x10000000000063b)
00000800:00000200:4.0:1773851895.647590:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x10000000000063b: rc=0
00000800:00000200:4.0:1773851895.647593:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000063b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851895.647596:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.647598:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032dcd023 refcount 2 to 15361@kfi7
00010000:00000001:4.0:1773851895.647601:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851895.647602:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.647603:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851895.647604:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f06a3a1 x1859597831248832/t0(0) o400->5c98344f-a956-480f-811f-d6da37a801a1@15361@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1459-0'
00000100:00100000:4.0:1773851895.647609:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f06a3a1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5c98344f-a956-480f-811f-d6da37a801a1+5:39720:x1859597831248832:12345-15361@kfi7:400:default-tuolumne1459-0 Request processed in 99us (147us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851895.647613:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15361@kfi7, seq: 2001991
00000100:00000040:4.0:1773851895.647614:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000329d6171 : new rpc_count 0
00000100:00000001:4.0:1773851895.647616:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851895.647616:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851895.647617:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.647618:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000031fbcfde.
00000020:00000010:4.0:1773851895.647620:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000020:00000040:4.0:1773851895.647621:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000329d6171 : new refcount 4
00000100:00000001:4.0:1773851895.647622:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851895.647630:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000063b TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851895.647632:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.647634:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15361@kfi7: PUT: OK
00000400:00000200:5.0:1773851895.647636:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000058aef11
00000400:00000010:5.0:1773851895.647636:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000058aef11.
00000100:00000001:5.0:1773851895.647638:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851895.647638:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851895.647640:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009b84210d nid 15361@kfi7 refs 2
00000800:00000200:5.0:1773851895.647642:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 15361@kfi7(000000002e82da90):0x0 lsk 1596 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000063b Transaction freed
00000400:00000200:29.0:1773851895.689743:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851895.689746:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:9.0:1773851895.696968:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851895.696969:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851895.696970:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851895.696972:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851895.696974:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18867@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.696976:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18867@kfi7 : PUT - for me
00000400:00000200:9.0:1773851895.696977:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18867@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.696978:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000404a5607 nid 18867@kfi7 refs 1
00000400:00000200:9.0:1773851895.696979:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18867@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.696980:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000404a5607 nid 18867@kfi7 refs 2
00000400:00000200:9.0:1773851895.696981:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000404a5607 nid 18867@kfi7 refs 3
00000400:00000200:9.0:1773851895.696982:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18867@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.696983:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18867@kfi7 of length 224 into portal 12 MB=0x69b82e0a97040
00000400:00000200:9.0:1773851895.696984:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18867@kfi7 of length 224/224 into md 0x78146ce49 [64] + 160128
00000800:00000200:9.0:1773851895.696986:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851895.696987:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851895.696989:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18867@kfi7: PUT: OK
00000100:00000001:9.0:1773851895.696990:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851895.696990:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851895.696991:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa16f8a5.
00000100:00000040:9.0:1773851895.696992:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000aa16f8a5 x1859836277518400 msgsize 224
00000100:00100000:9.0:1773851895.696993:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18867@kfi7 (source: 12345-18867@kfi7)
00000100:00000001:9.0:1773851895.696994:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851895.696995:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000404a5607 nid 18867@kfi7 refs 2
00000100:00000001:11.0:1773851895.696996:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851895.696997:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851895.696997:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851895.696998:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851895.696998:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851895.696999:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851895.697000:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836277518400
00000020:00000001:11.0:1773851895.697001:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851895.697001:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d82202
00000020:00000001:11.0:1773851895.697002:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851895.697004:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f028fa55 refcount=7
00000020:00000001:11.0:1773851895.697005:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121214305280 : -106952495246336 : ffff9eba2e835400)
00000020:00000001:11.0:1773851895.697006:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121214305280 : -106952495246336 : ffff9eba2e835400)
00000100:00000001:11.0:1773851895.697007:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.697008:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851895.697008:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089741d53.
00000020:00000010:11.0:1773851895.697009:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851895.697010:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851895.697011:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851895.697012:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851895.697012:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851895.697014:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851895.697014:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851895.697015:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.697015:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851895.697017:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851895.697017:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851895.697017:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851895.697018:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18867@kfi7, seq: 2130868
00000100:00000001:8.0:1773851895.697018:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851895.697019:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f028fa55 : new rpc_count 1
00000100:00000001:8.0:1773851895.697019:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.697020:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609032832 : -107064100518784 : ffff9ea032520480)
00000100:00000001:8.0:1773851895.697020:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.697021:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa16f8a5 x1859836277518400/t0(0) o400->27b787e3-c755-4f07-ae96-579389ab5f0d@18867@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1658-0'
00000100:00000001:11.0:1773851895.697025:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.697025:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851895.697026:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa16f8a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:27b787e3-c755-4f07-ae96-579389ab5f0d+7:40170:x1859836277518400:12345-18867@kfi7:400:default-tuolumne1658-0
00000100:00000200:11.0:1773851895.697027:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836277518400
00000020:00000001:11.0:1773851895.697028:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851895.697029:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851895.697029:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.697030:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851895.697030:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851895.697031:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851895.697032:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836277518400, found 0 last_xid 1859836277518399
00000020:00000001:11.0:1773851895.697033:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851895.697033:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851895.697034:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851895.697034:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.697035:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851895.697036:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851895.697036:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851895.697037:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009cf0b339.
02000000:00000001:11.0:1773851895.697038:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.697038:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.697039:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851895.697040:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044171010, transno 0, xid 1859836277518400
00010000:00000001:11.0:1773851895.697041:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851895.697041:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa16f8a5 x1859836277518400/t0(0) o400->27b787e3-c755-4f07-ae96-579389ab5f0d@18867@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1658-0'
00010000:00000001:11.0:1773851895.697044:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851895.697045:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851895.697046:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=128 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851895.697047:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851895.697048:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fdd438c1 refcount 3 to 18867@kfi7
00000100:00000001:11.0:1773851895.697048:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582272 : -107154806969344 : ffff9e8b13cb6c00)
02000000:00000001:11.0:1773851895.697050:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851895.697050:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.697051:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851895.697052:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18867@kfi7
00000400:00000010:11.0:1773851895.697053:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6296e37.
00000100:00000200:11.0:1773851895.697054:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836277518400, offset 224
00000400:00000200:11.0:1773851895.697055:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18867@kfi7
00000400:00000200:11.0:1773851895.697056:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18867@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.697057:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000404a5607 nid 18867@kfi7 refs 1
00000400:00000200:11.0:1773851895.697058:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000404a5607 nid 18867@kfi7 refs 2
00000400:00000200:11.0:1773851895.697059:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000404a5607 nid 18867@kfi7 refs 3
00000400:00000200:11.0:1773851895.697061:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18867@kfi7 local destination
00000400:00000200:11.0:1773851895.697062:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770202:8770202:1024:4294967295] 18867@kfi7 LPNI seq info [560151:560151:16:4294967295]
00000400:00000200:11.0:1773851895.697064:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000404a5607 nid 18867@kfi7 refs 2
00000400:00000200:11.0:1773851895.697064:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18867@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.697066:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18867@kfi7(18867@kfi7:18867@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851895.697068:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000404a5607 nid 18867@kfi7 refs 3
00000800:00000200:11.0:1773851895.697069:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851895.697070:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851895.697072:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851895.697075:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000993 Using peer 18867@kfi7(0x100000000000993)
00000800:00000200:11.0:1773851895.697078:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x100000000000993: rc=0
00000800:00000200:11.0:1773851895.697079:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000993 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851895.697081:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.697082:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fdd438c1 refcount 2 to 18867@kfi7
00010000:00000001:11.0:1773851895.697083:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851895.697084:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.697084:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851895.697085:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa16f8a5 x1859836277518400/t0(0) o400->27b787e3-c755-4f07-ae96-579389ab5f0d@18867@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1658-0'
00000100:00100000:11.0:1773851895.697088:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa16f8a5 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:27b787e3-c755-4f07-ae96-579389ab5f0d+7:40170:x1859836277518400:12345-18867@kfi7:400:default-tuolumne1658-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851895.697091:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18867@kfi7, seq: 2130868
00000800:00000200:9.0:1773851895.697091:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000993 TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851895.697092:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f028fa55 : new rpc_count 0
00000100:00000001:11.0:1773851895.697092:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851895.697093:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851895.697093:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851895.697094:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851895.697094:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000400:00000200:9.0:1773851895.697094:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18867@kfi7: PUT: OK
00000020:00000010:11.0:1773851895.697095:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089741d53.
00000400:00000200:9.0:1773851895.697095:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6296e37
00000400:00000010:9.0:1773851895.697095:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6296e37.
00000020:00000040:11.0:1773851895.697096:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f028fa55 : new refcount 6
00000100:00000001:9.0:1773851895.697096:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851895.697097:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851895.697097:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851895.697098:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000404a5607 nid 18867@kfi7 refs 2
00000800:00000200:9.0:1773851895.697099:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 18867@kfi7(00000000bddca8a1):0x0 lsk 2452 rsk 24 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000993 Transaction freed
00000800:00000200:29.0:1773851895.713302:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851895.713303:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.713304:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851895.713306:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851895.713308:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.713309:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26338@kfi7 : PUT - for me
00000400:00000200:29.0:1773851895.713310:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.713310:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 1
00000400:00000200:29.0:1773851895.713312:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.713312:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000400:00000200:29.0:1773851895.713313:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 3
00000400:00000200:29.0:1773851895.713314:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26339@kfi7 to cpt 2
00000400:00000200:29.0:1773851895.713315:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26339@kfi7 of length 456 into portal 12 MB=0x69b4c983d6ec0
00000400:00000200:29.0:1773851895.713317:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26339@kfi7 of length 456/456 into md 0x77fe1859d [64] + 7920
00000800:00000200:29.0:1773851895.713319:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851895.713320:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.713321:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26338@kfi7: PUT: OK
00000100:00000001:29.0:1773851895.713322:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851895.713323:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851895.713323:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000035649470.
00000100:00000040:29.0:1773851895.713324:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000035649470 x1859603134246592 msgsize 456
00000100:00100000:29.0:1773851895.713326:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26339@kfi7 (source: 12345-26338@kfi7)
00000100:00000001:29.0:1773851895.713327:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851895.713327:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000100:00000001:31.0:1773851895.713328:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851895.713329:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851895.713329:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851895.713329:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851895.713330:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.713330:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851895.713331:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603134246592
00000020:00000001:31.0:1773851895.713332:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851895.713332:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8ad98
00000020:00000001:31.0:1773851895.713333:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851895.713334:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d50c132c refcount=326
00000020:00000001:31.0:1773851895.713334:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123859012608 : -106949850539008 : ffff9ebacc265c00)
00000020:00000001:31.0:1773851895.713335:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123859012608 : -106949850539008 : ffff9ebacc265c00)
00000100:00000001:31.0:1773851895.713336:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.713337:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851895.713337:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000243a822a.
00000020:00000010:31.0:1773851895.713338:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.713339:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851895.713340:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851895.713341:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851895.713341:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.713342:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.713343:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.713344:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851895.713345:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851895.713345:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851895.713345:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851895.713346:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26339@kfi7, seq: 364304988
00000100:00000040:31.0:1773851895.713347:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d50c132c : new rpc_count 3
00000100:00000001:30.0:1773851895.713347:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.713348:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130262238592 : -106943447313024 : ffff9ebc49cfd580)
00000100:00000001:30.0:1773851895.713348:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.713349:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000035649470 x1859603134246592/t0(0) o17->fdd24a38-47c3-4c58-b1b4-7859bf98b5b5@26339@kfi7:683/0 lens 456/0 e 0 to 0 dl 1773852043 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2123-0'
00000100:00000001:31.0:1773851895.713352:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.713352:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851895.713353:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000035649470 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:fdd24a38-47c3-4c58-b1b4-7859bf98b5b5+326:39651:x1859603134246592:12345-26339@kfi7:17:default-tuolumne2123-0
00000100:00000200:31.0:1773851895.713355:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603134246592
00000020:00000001:31.0:1773851895.713355:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851895.713356:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851895.713356:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.713357:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851895.713358:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:31.0:1773851895.713358:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851895.713359:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603134246592, found 0 last_xid 1859603072330111
00000020:00000001:31.0:1773851895.713360:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851895.713361:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851895.713361:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851895.713362:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851895.713362:0:60677:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:31.0:1773851895.713363:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851895.713364:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851895.713364:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000004599461.
02000000:00000001:31.0:1773851895.713365:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.713366:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.713367:0:60677:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:31.0:1773851895.713367:0:60677:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:31.0:1773851895.713368:0:60677:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851895.713369:0:60677:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.713370:0:60677:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:31.0:1773851895.713370:0:60677:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli fdd24a38-47c3-4c58-b1b4-7859bf98b5b5/00000000d50c132c free: 126633370845184 avail: 126633368748032
00000020:00000001:31.0:1773851895.713372:0:60677:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:31.0:1773851895.713372:0:60677:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli fdd24a38-47c3-4c58-b1b4-7859bf98b5b5/00000000d50c132c avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:31.0:1773851895.713373:0:60677:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:31.0:1773851895.713375:0:60677:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:31.0:1773851895.713375:0:60677:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli fdd24a38-47c3-4c58-b1b4-7859bf98b5b5/00000000d50c132c reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:31.0:1773851895.713376:0:60677:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:31.0:1773851895.713377:0:60677:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:31.0:1773851895.713377:0:60677:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851895.713378:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263898747, transno 0, xid 1859603134246592
00010000:00000001:31.0:1773851895.713379:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851895.713379:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000035649470 x1859603134246592/t0(0) o17->fdd24a38-47c3-4c58-b1b4-7859bf98b5b5@26339@kfi7:683/0 lens 456/432 e 0 to 0 dl 1773852043 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2123-0'
00010000:00000001:31.0:1773851895.713382:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851895.713382:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851895.713383:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=128 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851895.713384:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851895.713385:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000390ef8b refcount 3 to 26339@kfi7
00000100:00000001:31.0:1773851895.713385:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526776352 : -107156182775264 : ffff9e8ac1ca4a20)
02000000:00000001:31.0:1773851895.713386:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851895.713387:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.713387:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851895.713388:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26338@kfi7
00000400:00000010:31.0:1773851895.713389:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e37bb3ee.
00000100:00000200:31.0:1773851895.713390:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859603134246592, offset 224
00000400:00000200:31.0:1773851895.713391:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26338@kfi7
00000400:00000200:31.0:1773851895.713392:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.713393:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 1
00000400:00000200:31.0:1773851895.713394:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000400:00000200:31.0:1773851895.713395:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 3
00000400:00000200:31.0:1773851895.713396:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26338@kfi7 local destination
00000400:00000200:31.0:1773851895.713397:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770203:8770203:1024:4294967295] 26338@kfi7 LPNI seq info [16184846:16184846:16:4294967295]
00000400:00000200:31.0:1773851895.713399:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000400:00000200:31.0:1773851895.713399:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26338@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.713402:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26338@kfi7(26338@kfi7:26338@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851895.713403:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 3
00000800:00000200:31.0:1773851895.713405:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851895.713406:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:31.0:1773851895.713408:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851895.713410:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dac Using peer 26338@kfi7(0x100000000000dac)
00000800:00000200:31.0:1773851895.713413:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 532 bytes to peer 0x100000000000dac: rc=0
00000800:00000200:31.0:1773851895.713415:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851895.713417:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.713417:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000390ef8b refcount 2 to 26339@kfi7
00010000:00000001:31.0:1773851895.713418:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851895.713419:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.713419:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851895.713420:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000035649470 x1859603134246592/t0(0) o17->fdd24a38-47c3-4c58-b1b4-7859bf98b5b5@26339@kfi7:683/0 lens 456/432 e 0 to 0 dl 1773852043 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2123-0'
00000100:00100000:31.0:1773851895.713423:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000035649470 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:fdd24a38-47c3-4c58-b1b4-7859bf98b5b5+326:39651:x1859603134246592:12345-26339@kfi7:17:default-tuolumne2123-0 Request processed in 70us (98us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851895.713425:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26339@kfi7, seq: 364304988
00000100:00000040:31.0:1773851895.713426:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d50c132c : new rpc_count 2
00000800:00000200:29.0:1773851895.713426:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dac TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851895.713427:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851895.713427:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851895.713428:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851895.713428:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851895.713429:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851895.713429:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000243a822a.
00000400:00000200:29.0:1773851895.713429:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26338@kfi7: PUT: OK
00000020:00000040:31.0:1773851895.713430:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000d50c132c : new refcount 325
00000400:00000200:29.0:1773851895.713430:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e37bb3ee
00000100:00000001:31.0:1773851895.713431:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:29.0:1773851895.713431:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e37bb3ee.
00000100:00000001:29.0:1773851895.713431:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851895.713432:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851895.713433:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eea4c9a6 nid 26338@kfi7 refs 2
00000800:00000200:29.0:1773851895.713434:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26338@kfi7(00000000614c04ed):0x0 lsk 3501 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000dac Transaction freed
00000800:00000200:17.0:1773851895.729030:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851895.729031:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851895.729032:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851895.729034:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851895.729036:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.729037:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.37@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851895.729038:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851895.729039:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851895.729040:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.37@o2ib60 to cpt 6
00000400:00000200:17.0:1773851895.729041:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ed25c75 nid 192.168.128.37@o2ib60 refs 2
00000400:00000200:17.0:1773851895.729042:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009ed25c75 nid 192.168.128.37@o2ib60 refs 3
00000400:00000200:17.0:1773851895.729043:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.37@o2ib60 to cpt 6
00000400:00000200:17.0:1773851895.729044:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.37@o2ib60 of length 224 into portal 12 MB=0x69b24ce3604c0
00000400:00000200:17.0:1773851895.729046:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.37@o2ib60 of length 224/224 into md 0x16159c9699 [64] + 37760
00000800:00000200:17.0:1773851895.729048:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851895.729050:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851895.729051:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851895.729052:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851895.729052:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851895.729053:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000535bc183.
00000100:00000040:17.0:1773851895.729054:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000535bc183 x1859432241038528 msgsize 224
00000100:00100000:17.0:1773851895.729055:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.37@o2ib60 (source: 12345-192.168.128.37@o2ib60)
00000100:00000001:17.0:1773851895.729057:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851895.729059:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:27.0:1773851895.729060:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851895.729060:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:27.0:1773851895.729061:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851895.729061:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851895.729062:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851895.729063:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851895.729064:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859432241038528
00000020:00000001:27.0:1773851895.729064:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851895.729064:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b6b2ceed8
00000020:00000001:27.0:1773851895.729065:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851895.729067:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eb2e1e4e refcount=5
00000020:00000001:27.0:1773851895.729067:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636975664118784 : -107098045432832 : ffff9e984b0bbc00)
00000020:00000001:27.0:1773851895.729068:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636975664118784 : -107098045432832 : ffff9e984b0bbc00)
00000100:00000001:27.0:1773851895.729069:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851895.729070:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851895.729070:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bf277de5.
00000020:00000010:27.0:1773851895.729071:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851895.729072:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009d0a58f3.
00000100:00000001:27.0:1773851895.729073:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851895.729073:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851895.729074:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851895.729075:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851895.729075:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851895.729076:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.729077:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851895.729078:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851895.729078:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851895.729078:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851895.729079:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851895.729080:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.37@o2ib60, seq: 2025176
00000100:00000040:27.0:1773851895.729080:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eb2e1e4e : new rpc_count 1
00000100:00000001:24.0:1773851895.729080:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.729081:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968773888 : -106974740777728 : ffff9eb500937500)
00000100:00000001:24.0:1773851895.729081:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.729082:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000535bc183 x1859432241038528/t0(0) o400->f3962176-62d5-4ae4-a310-223675870687@192.168.128.37@o2ib60:145/0 lens 224/0 e 0 to 0 dl 1773852260 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix37-0'
00000100:00000001:27.0:1773851895.729085:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851895.729085:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851895.729086:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000535bc183 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:f3962176-62d5-4ae4-a310-223675870687+5:39979:x1859432241038528:12345-192.168.128.37@o2ib60:400:default-matrix37-0
00000100:00000200:27.0:1773851895.729087:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859432241038528
00000020:00000001:27.0:1773851895.729088:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851895.729089:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851895.729089:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.729090:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851895.729090:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851895.729091:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851895.729091:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859432241038528, found 0 last_xid 1859432241038527
00000020:00000001:27.0:1773851895.729092:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851895.729093:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851895.729093:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851895.729094:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.729094:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851895.729095:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851895.729096:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851895.729096:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000049e68859.
02000000:00000001:27.0:1773851895.729097:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.729097:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.729098:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851895.729099:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264031482, transno 0, xid 1859432241038528
00010000:00000001:27.0:1773851895.729099:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851895.729100:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000535bc183 x1859432241038528/t0(0) o400->f3962176-62d5-4ae4-a310-223675870687@192.168.128.37@o2ib60:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix37-0'
00010000:00000001:27.0:1773851895.729103:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851895.729103:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851895.729104:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=128 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851895.729105:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851895.729106:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b2e6586 refcount 3 to 192.168.128.37@o2ib60
00000100:00000001:27.0:1773851895.729106:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740256 : -107139395811360 : ffff9e8eaa5f07e0)
02000000:00000001:27.0:1773851895.729107:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851895.729108:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851895.729108:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851895.729109:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.37@o2ib60
00000400:00000010:27.0:1773851895.729110:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000927ebb96.
00000100:00000200:27.0:1773851895.729110:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859432241038528, offset 224
00000400:00000200:27.0:1773851895.729112:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.37@o2ib60
00000400:00000200:27.0:1773851895.729113:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.37@o2ib60 to cpt 6
00000400:00000200:27.0:1773851895.729115:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009ed25c75 nid 192.168.128.37@o2ib60 refs 2
00000400:00000200:27.0:1773851895.729116:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009ed25c75 nid 192.168.128.37@o2ib60 refs 3
00000400:00000200:27.0:1773851895.729117:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009ed25c75 nid 192.168.128.37@o2ib60 refs 4
00000400:00000200:27.0:1773851895.729118:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.37@o2ib60 routed destination
00000400:00000200:27.0:1773851895.729120:0:41182:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:27.0:1773851895.729121:0:41182:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:27.0:1773851895.729122:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.37@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851895.729123:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:27.0:1773851895.729124:0:41182:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.37@o2ib60: rtr pref emtpy: 1
00000400:00000200:27.0:1773851895.729125:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:27.0:1773851895.729126:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770204:8770204:1024:4294967295] 2094@kfi7 LPNI seq info [1258747022:1258747022:16:4294967295]
00000400:00000200:27.0:1773851895.729127:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:27.0:1773851895.729128:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:27.0:1773851895.729131:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.37@o2ib60(192.168.128.37@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851895.729132:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009ed25c75 nid 192.168.128.37@o2ib60 refs 3
00000800:00000200:27.0:1773851895.729133:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851895.729134:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851895.729136:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851895.729139:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:27.0:1773851895.729141:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007a0ad8d8: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:27.0:1773851895.729143:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851895.729145:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851895.729146:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b2e6586 refcount 2 to 192.168.128.37@o2ib60
00010000:00000001:27.0:1773851895.729146:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851895.729147:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851895.729148:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851895.729149:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000535bc183 x1859432241038528/t0(0) o400->f3962176-62d5-4ae4-a310-223675870687@192.168.128.37@o2ib60:145/0 lens 224/224 e 0 to 0 dl 1773852260 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix37-0'
00000100:00100000:27.0:1773851895.729152:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000535bc183 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:f3962176-62d5-4ae4-a310-223675870687+5:39979:x1859432241038528:12345-192.168.128.37@o2ib60:400:default-matrix37-0 Request processed in 66us (97us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851895.729153:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851895.729154:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.37@o2ib60, seq: 2025176
00000100:00000040:27.0:1773851895.729154:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eb2e1e4e : new rpc_count 0
00000100:00000001:27.0:1773851895.729155:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851895.729155:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851895.729156:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851895.729156:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851895.729156:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:27.0:1773851895.729157:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009d0a58f3.
00000400:00000200:25.0:1773851895.729157:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000927ebb96
00000400:00000010:25.0:1773851895.729157:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000927ebb96.
00000020:00000010:27.0:1773851895.729158:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bf277de5.
00000020:00000040:27.0:1773851895.729158:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000eb2e1e4e : new refcount 4
00000100:00000001:25.0:1773851895.729158:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851895.729158:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:27.0:1773851895.729159:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851895.729159:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:25.0:1773851895.729160:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007a0ad8d8: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Transaction freed
00000800:00000200:10.0:1773851895.768986:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851895.768986:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851895.768987:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851895.768987:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851895.768988:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851895.768988:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851895.768990:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851895.768990:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10848@kfi7(00000000ac3e1d61):0x4ad version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851895.768992:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000800:00000200:9.0:1773851895.768992:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad Using peer 10848@kfi7(0x4ad)
00000400:00000200:10.0:1773851895.768994:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10848@kfi7 : PUT - for me
00000400:00000200:9.0:1773851895.768994:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000400:00000200:10.0:1773851895.768995:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000400:00000200:10.0:1773851895.768996:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007ca530e nid 10848@kfi7 refs 1
00000800:00000200:9.0:1773851895.768996:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0x4ad: rc=0
00000400:00000200:10.0:1773851895.768997:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000800:00000200:9.0:1773851895.768997:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851895.768998:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007ca530e nid 10848@kfi7 refs 2
00000400:00000200:10.0:1773851895.768999:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007ca530e nid 10848@kfi7 refs 3
00000400:00000200:10.0:1773851895.769000:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000400:00000200:10.0:1773851895.769001:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10848@kfi7 of length 456 into portal 12 MB=0x69b09ed07b9c0
00000400:00000200:10.0:1773851895.769002:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10848@kfi7 of length 456/456 into md 0x78146ce49 [64] + 160352
00000800:00000200:10.0:1773851895.769004:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851895.769007:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851895.769008:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10848@kfi7: PUT: OK
00000100:00000001:10.0:1773851895.769010:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851895.769010:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851895.769010:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad TN_EVENT_TX_OK event status 0
00000100:00000010:10.0:1773851895.769011:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004778bde7.
00000100:00000040:10.0:1773851895.769012:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000004778bde7 x1859316793981376 msgsize 456
00000800:00000200:9.0:1773851895.769012:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad Transaction freed
00000100:00100000:10.0:1773851895.769014:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-10848@kfi7 (source: 12345-10848@kfi7)
00000100:00000001:10.0:1773851895.769014:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851895.769015:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007ca530e nid 10848@kfi7 refs 2
00000100:00000001:11.0:1773851895.769016:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851895.769016:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851895.769017:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851895.769017:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851895.769017:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851895.769018:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851895.769019:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316793981376
00000020:00000001:11.0:1773851895.769020:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851895.769020:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913b8
00000020:00000001:11.0:1773851895.769021:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851895.769026:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000047242df6 refcount=6
00000020:00000001:11.0:1773851895.769027:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169319424 : -107127540232192 : ffff9e916d04d000)
00000020:00000001:11.0:1773851895.769027:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169319424 : -107127540232192 : ffff9e916d04d000)
00000100:00000001:11.0:1773851895.769028:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.769029:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851895.769030:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089741d53.
00000020:00000010:11.0:1773851895.769031:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851895.769032:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851895.769033:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851895.769034:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851895.769034:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.769035:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.769036:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851895.769037:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851895.769038:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851895.769038:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851895.769038:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851895.769039:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10848@kfi7, seq: 406391015
00000100:00000040:11.0:1773851895.769040:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000047242df6 : new rpc_count 1
00000100:00000001:11.0:1773851895.769040:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087764480 : -106944621787136 : ffff9ebc03cec800)
00000100:00000001:8.0:1773851895.769040:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851895.769041:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.769042:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004778bde7 x1859316793981376/t0(0) o17->af813657-f44d-4bfd-ae7a-51d0a6621d79@10848@kfi7:622/0 lens 456/0 e 0 to 0 dl 1773851982 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1168-0'
00000100:00000001:11.0:1773851895.769044:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851895.769045:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851895.769046:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004778bde7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:af813657-f44d-4bfd-ae7a-51d0a6621d79+6:39728:x1859316793981376:12345-10848@kfi7:17:default-tuolumne1168-0
00000100:00000200:11.0:1773851895.769047:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316793981376
00000020:00000001:11.0:1773851895.769048:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851895.769049:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851895.769049:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.769050:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851895.769050:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:11.0:1773851895.769051:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851895.769052:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316793981376, found 0 last_xid 1859316793981375
00000020:00000001:11.0:1773851895.769053:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851895.769053:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851895.769054:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851895.769054:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851895.769055:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:11.0:1773851895.769056:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851895.769057:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851895.769058:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000077833e68.
02000000:00000001:11.0:1773851895.769058:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.769059:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.769060:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:11.0:1773851895.769061:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:11.0:1773851895.769061:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851895.769063:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.769064:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851895.769064:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli af813657-f44d-4bfd-ae7a-51d0a6621d79/0000000047242df6 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851895.769066:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851895.769066:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli af813657-f44d-4bfd-ae7a-51d0a6621d79/0000000047242df6 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851895.769067:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851895.769068:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:11.0:1773851895.769069:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli af813657-f44d-4bfd-ae7a-51d0a6621d79/0000000047242df6 reports grant 1812463615 dropped 0, local 1879572479
00000020:00000001:11.0:1773851895.769070:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:11.0:1773851895.769070:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:11.0:1773851895.769071:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851895.769072:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684744, transno 0, xid 1859316793981376
00010000:00000001:11.0:1773851895.769073:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851895.769074:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004778bde7 x1859316793981376/t0(0) o17->af813657-f44d-4bfd-ae7a-51d0a6621d79@10848@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1168-0'
00010000:00000001:11.0:1773851895.769076:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851895.769077:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851895.769077:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=128 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851895.769078:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851895.769079:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c8896b9c refcount 3 to 10848@kfi7
00000100:00000001:11.0:1773851895.769080:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274739008 : -107155434812608 : ffff9e8aee5f4b40)
02000000:00000001:11.0:1773851895.769081:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851895.769081:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851895.769082:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851895.769083:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10848@kfi7
00000400:00000010:11.0:1773851895.769083:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005f852466.
00000100:00000200:11.0:1773851895.769084:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859316793981376, offset 224
00000400:00000200:11.0:1773851895.769085:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10848@kfi7
00000400:00000200:11.0:1773851895.769086:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.769087:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007ca530e nid 10848@kfi7 refs 1
00000400:00000200:11.0:1773851895.769088:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007ca530e nid 10848@kfi7 refs 2
00000400:00000200:11.0:1773851895.769090:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007ca530e nid 10848@kfi7 refs 3
00000400:00000200:11.0:1773851895.769091:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10848@kfi7 local destination
00000400:00000200:11.0:1773851895.769093:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770205:8770205:1024:4294967295] 10848@kfi7 LPNI seq info [352671:352671:16:4294967295]
00000400:00000200:11.0:1773851895.769094:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007ca530e nid 10848@kfi7 refs 2
00000400:00000200:11.0:1773851895.769095:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10848@kfi7 to cpt 2
00000400:00000200:11.0:1773851895.769097:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10848@kfi7(10848@kfi7:10848@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851895.769098:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007ca530e nid 10848@kfi7 refs 3
00000800:00000200:11.0:1773851895.769099:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851895.769100:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:11.0:1773851895.769103:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851895.769105:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad Using peer 10848@kfi7(0x4ad)
00000800:00000200:11.0:1773851895.769108:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 532 bytes to peer 0x4ad: rc=0
00000800:00000200:11.0:1773851895.769109:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851895.769111:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851895.769112:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c8896b9c refcount 2 to 10848@kfi7
00010000:00000001:11.0:1773851895.769112:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851895.769113:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851895.769114:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851895.769114:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004778bde7 x1859316793981376/t0(0) o17->af813657-f44d-4bfd-ae7a-51d0a6621d79@10848@kfi7:622/0 lens 456/432 e 0 to 0 dl 1773851982 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1168-0'
00000100:00100000:11.0:1773851895.769117:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004778bde7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:af813657-f44d-4bfd-ae7a-51d0a6621d79+6:39728:x1859316793981376:12345-10848@kfi7:17:default-tuolumne1168-0 Request processed in 72us (105us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851895.769120:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10848@kfi7, seq: 406391015
00000100:00000040:11.0:1773851895.769120:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000047242df6 : new rpc_count 0
00000100:00000001:11.0:1773851895.769121:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851895.769122:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:9.0:1773851895.769122:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851895.769123:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851895.769123:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000400:00000200:9.0:1773851895.769123:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851895.769124:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089741d53.
00000400:00000200:9.0:1773851895.769124:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10848@kfi7: PUT: OK
00000020:00000040:11.0:1773851895.769125:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000047242df6 : new refcount 5
00000100:00000001:11.0:1773851895.769125:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851895.769125:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005f852466
00000400:00000010:9.0:1773851895.769125:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005f852466.
00000100:00000001:9.0:1773851895.769126:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851895.769127:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851895.769127:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007ca530e nid 10848@kfi7 refs 2
00000800:00000200:9.0:1773851895.769129:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 10848@kfi7(00000000ac3e1d61):0x0 lsk 1198 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4ad Transaction freed
00000800:00000200:15.0:1773851895.814111:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851895.814111:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.814112:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:15.0:1773851895.814113:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a091e2bc: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:13.0:1773851895.814113:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851895.814115:0:2513974:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21776@kfi7(0000000004ed0c84):0xc5d version: 2; local version 2; negotiated version: 2
00000800:00000200:13.0:1773851895.814115:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851895.814117:0:2513974:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a091e2bc: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d Using peer 21776@kfi7(0x100000000000c5d)
00000400:00000200:15.0:1773851895.814119:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21776@kfi7 to cpt 3
00000800:00000200:13.0:1773851895.814119:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:15.0:1773851895.814121:0:2513974:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 38 bytes to peer 0x100000000000c5d: rc=0
00000800:00000200:15.0:1773851895.814122:0:2513974:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a091e2bc: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:13.0:1773851895.814122:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21776@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.814123:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21776@kfi7 : PUT - for me
00000400:00000200:13.0:1773851895.814125:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21776@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.814126:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1d83138 nid 21776@kfi7 refs 1
00000400:00000200:13.0:1773851895.814128:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21776@kfi7 to cpt 3
00000400:00000200:13.0:1773851895.814129:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1d83138 nid 21776@kfi7 refs 2
00000400:00000200:13.0:1773851895.814131:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e1d83138 nid 21776@kfi7 refs 3
00000400:00000200:13.0:1773851895.814132:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21969@kfi7 to cpt 1
00000400:00000200:13.0:1773851895.814134:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21969@kfi7 of length 456 into portal 12 MB=0x69aef43947880
00000800:00000200:15.0:1773851895.814135:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a091e2bc: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851895.814136:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21969@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 57200
00000800:00000200:15.0:1773851895.814137:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a091e2bc: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d Transaction freed
00000800:00000200:13.0:1773851895.814138:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851895.814141:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851895.814143:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21776@kfi7: PUT: OK
00000100:00000001:13.0:1773851895.814145:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851895.814145:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851895.814147:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001e29fc0e.
00000100:00000040:13.0:1773851895.814148:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000001e29fc0e x1859202281928832 msgsize 456
00000100:00100000:13.0:1773851895.814150:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21969@kfi7 (source: 12345-21776@kfi7)
00000100:00000001:13.0:1773851895.814151:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:15.0:1773851895.814153:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851895.814153:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1d83138 nid 21776@kfi7 refs 2
02000000:00000001:15.0:1773851895.814154:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851895.814154:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851895.814154:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851895.814155:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851895.814155:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00100000:15.0:1773851895.814156:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859202281928832
00000020:00000001:15.0:1773851895.814157:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851895.814157:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918ab
00000020:00000001:15.0:1773851895.814157:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851895.814162:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c39a23a1 refcount=155
00000020:00000001:15.0:1773851895.814163:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241977856 : -107152467573760 : ffff9e8b9f3bc400)
00000020:00000001:15.0:1773851895.814163:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241977856 : -107152467573760 : ffff9e8b9f3bc400)
00000100:00000001:15.0:1773851895.814164:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.814165:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851895.814166:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000464d983b.
00000020:00000010:15.0:1773851895.814167:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851895.814167:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851895.814168:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851895.814169:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851895.814169:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.814170:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.814171:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851895.814173:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851895.814173:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851895.814174:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21969@kfi7, seq: 411190563
00000100:00000001:12.0:1773851895.814174:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:15.0:1773851895.814175:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c39a23a1 : new rpc_count 8
00000100:00000001:15.0:1773851895.814175:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636950415867904 : -107123293683712 : ffff9e926a220000)
00000100:00000001:12.0:1773851895.814176:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851895.814176:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.814177:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001e29fc0e x1859202281928832/t0(0) o17->1611c72a-44a8-46ec-9b45-d69e6df8c18b@21969@kfi7:176/0 lens 456/0 e 0 to 0 dl 1773852291 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1857-0'
00000100:00000001:12.0:1773851895.814177:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.814179:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851895.814180:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851895.814181:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e29fc0e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1611c72a-44a8-46ec-9b45-d69e6df8c18b+155:39851:x1859202281928832:12345-21969@kfi7:17:default-tuolumne1857-0
00000100:00000200:15.0:1773851895.814182:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859202281928832
00000020:00000001:15.0:1773851895.814183:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851895.814183:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851895.814184:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.814185:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851895.814186:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:15.0:1773851895.814186:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851895.814187:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859202281928832, found 0 last_xid 1859202281267647
00000020:00000001:15.0:1773851895.814188:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851895.814188:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851895.814188:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851895.814189:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:15.0:1773851895.814190:0:60824:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:15.0:1773851895.814191:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851895.814191:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851895.814192:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000b193f164.
02000000:00000001:15.0:1773851895.814193:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.814193:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.814194:0:60824:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:15.0:1773851895.814195:0:60824:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:15.0:1773851895.814195:0:60824:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:15.0:1773851895.814196:0:60824:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.814197:0:60824:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:15.0:1773851895.814198:0:60824:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 1611c72a-44a8-46ec-9b45-d69e6df8c18b/00000000c39a23a1 free: 126633370845184 avail: 126633368748032
00000020:00000001:15.0:1773851895.814199:0:60824:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:15.0:1773851895.814199:0:60824:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 1611c72a-44a8-46ec-9b45-d69e6df8c18b/00000000c39a23a1 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:15.0:1773851895.814201:0:60824:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:15.0:1773851895.814201:0:60824:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:15.0:1773851895.814202:0:60824:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 1611c72a-44a8-46ec-9b45-d69e6df8c18b/00000000c39a23a1 reports grant 1809580031 dropped 0, local 1882456063
00000020:00000001:15.0:1773851895.814203:0:60824:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:15.0:1773851895.814204:0:60824:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:15.0:1773851895.814205:0:60824:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851895.814205:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264587303, transno 0, xid 1859202281928832
00010000:00000001:15.0:1773851895.814206:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851895.814207:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001e29fc0e x1859202281928832/t0(0) o17->1611c72a-44a8-46ec-9b45-d69e6df8c18b@21969@kfi7:176/0 lens 456/432 e 0 to 0 dl 1773852291 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1857-0'
00010000:00000001:15.0:1773851895.814209:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851895.814210:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851895.814210:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=128 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851895.814211:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851895.814212:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b27adae7 refcount 3 to 21969@kfi7
00000100:00000001:15.0:1773851895.814213:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231614048 : -107130477937568 : ffff9e90bdeafc60)
02000000:00000001:15.0:1773851895.814214:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851895.814214:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851895.814215:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851895.814216:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21776@kfi7
00000400:00000010:15.0:1773851895.814216:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000077952c7.
00000100:00000200:15.0:1773851895.814217:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859202281928832, offset 224
00000400:00000200:15.0:1773851895.814219:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21776@kfi7
00000400:00000200:15.0:1773851895.814219:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21776@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.814220:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1d83138 nid 21776@kfi7 refs 1
00000400:00000200:15.0:1773851895.814221:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e1d83138 nid 21776@kfi7 refs 2
00000400:00000200:15.0:1773851895.814222:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e1d83138 nid 21776@kfi7 refs 3
00000400:00000200:15.0:1773851895.814223:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21776@kfi7 local destination
00000400:00000200:15.0:1773851895.814225:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770206:8770206:1024:4294967295] 21776@kfi7 LPNI seq info [1677273:1677273:16:4294967295]
00000400:00000200:15.0:1773851895.814226:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e1d83138 nid 21776@kfi7 refs 2
00000400:00000200:15.0:1773851895.814227:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21776@kfi7 to cpt 3
00000400:00000200:15.0:1773851895.814228:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21776@kfi7(21776@kfi7:21776@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851895.814230:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e1d83138 nid 21776@kfi7 refs 3
00000800:00000200:15.0:1773851895.814231:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851895.814232:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:15.0:1773851895.814236:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851895.814239:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d Using peer 21776@kfi7(0x100000000000c5d)
00000800:00000200:15.0:1773851895.814241:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 532 bytes to peer 0x100000000000c5d: rc=0
00000800:00000200:15.0:1773851895.814243:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851895.814245:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851895.814246:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b27adae7 refcount 2 to 21969@kfi7
00010000:00000001:15.0:1773851895.814246:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851895.814247:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851895.814247:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851895.814248:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001e29fc0e x1859202281928832/t0(0) o17->1611c72a-44a8-46ec-9b45-d69e6df8c18b@21969@kfi7:176/0 lens 456/432 e 0 to 0 dl 1773852291 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1857-0'
00000100:00100000:15.0:1773851895.814252:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e29fc0e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:1611c72a-44a8-46ec-9b45-d69e6df8c18b+155:39851:x1859202281928832:12345-21969@kfi7:17:default-tuolumne1857-0 Request processed in 71us (103us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851895.814254:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21969@kfi7, seq: 411190563
00000100:00000040:15.0:1773851895.814255:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c39a23a1 : new rpc_count 7
00000100:00000001:15.0:1773851895.814256:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851895.814257:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851895.814257:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000800:00000200:13.0:1773851895.814257:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851895.814258:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:15.0:1773851895.814259:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000464d983b.
00000400:00000200:13.0:1773851895.814259:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:15.0:1773851895.814260:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000c39a23a1 : new refcount 154
00000100:00000001:15.0:1773851895.814261:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851895.814261:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21776@kfi7: PUT: OK
00000400:00000200:13.0:1773851895.814263:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000077952c7
00000400:00000010:13.0:1773851895.814264:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000077952c7.
00000100:00000001:13.0:1773851895.814264:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851895.814265:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851895.814266:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1d83138 nid 21776@kfi7 refs 2
00000800:00000200:13.0:1773851895.814269:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2054@kfi7:3 -> 21776@kfi7(0000000004ed0c84):0x0 lsk 3166 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c5d Transaction freed
00000800:00000200:29.0:1773851895.842351:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851895.842352:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851895.842353:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851895.842355:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851895.842357:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12114@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.842359:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12114@kfi7 : PUT - for me
00000400:00000200:29.0:1773851895.842360:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12114@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.842361:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4451d3c nid 12114@kfi7 refs 1
00000400:00000200:29.0:1773851895.842362:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12114@kfi7 to cpt 7
00000400:00000200:29.0:1773851895.842363:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4451d3c nid 12114@kfi7 refs 2
00000400:00000200:29.0:1773851895.842364:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a4451d3c nid 12114@kfi7 refs 3
00000400:00000200:29.0:1773851895.842364:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12115@kfi7 to cpt 2
00000400:00000200:29.0:1773851895.842365:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12115@kfi7 of length 224 into portal 12 MB=0x69b4bbefdac00
00000400:00000200:29.0:1773851895.842367:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12115@kfi7 of length 224/224 into md 0x77fe1859d [64] + 8376
00000800:00000200:29.0:1773851895.842369:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851895.842371:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851895.842372:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12114@kfi7: PUT: OK
00000100:00000001:29.0:1773851895.842373:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851895.842373:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851895.842374:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ecebd921.
00000100:00000040:29.0:1773851895.842375:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ecebd921 x1859599489412096 msgsize 224
00000100:00100000:29.0:1773851895.842376:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12115@kfi7 (source: 12345-12114@kfi7)
00000100:00000001:29.0:1773851895.842377:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851895.842378:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851895.842378:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4451d3c nid 12114@kfi7 refs 2
02000000:00000001:31.0:1773851895.842379:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851895.842379:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851895.842379:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851895.842380:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851895.842381:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851895.842382:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599489412096
00000020:00000001:31.0:1773851895.842382:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851895.842383:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d811f2
00000020:00000001:31.0:1773851895.842383:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851895.842387:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006069fa34 refcount=5
00000020:00000001:31.0:1773851895.842388:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028635456512 : -107045074095104 : ffff9ea4a0623400)
00000020:00000001:31.0:1773851895.842388:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637028635456512 : -107045074095104 : ffff9ea4a0623400)
00000100:00000001:31.0:1773851895.842389:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.842390:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851895.842391:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000243a822a.
00000020:00000010:31.0:1773851895.842392:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.842393:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851895.842394:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851895.842394:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851895.842395:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.842396:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851895.842396:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851895.842397:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.842398:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851895.842399:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851895.842399:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851895.842400:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851895.842401:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12115@kfi7, seq: 2055593
00000100:00000040:31.0:1773851895.842401:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006069fa34 : new rpc_count 1
00000100:00000001:30.0:1773851895.842401:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851895.842402:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337967360 : -106936371584256 : ffff9ebdef8ee300)
00000100:00000001:30.0:1773851895.842402:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.842403:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ecebd921 x1859599489412096/t0(0) o400->98e0980c-924d-4509-b80b-0bf6fb1842b9@12115@kfi7:683/0 lens 224/0 e 0 to 0 dl 1773852043 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1254-0'
00000100:00000001:30.0:1773851895.842403:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.842406:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851895.842406:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851895.842407:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ecebd921 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:98e0980c-924d-4509-b80b-0bf6fb1842b9+5:39535:x1859599489412096:12345-12115@kfi7:400:default-tuolumne1254-0
00000100:00000200:31.0:1773851895.842409:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599489412096
00000020:00000001:31.0:1773851895.842409:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851895.842410:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851895.842411:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.842412:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851895.842412:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851895.842413:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851895.842413:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599489412096, found 0 last_xid 1859599489412095
00000020:00000001:31.0:1773851895.842414:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851895.842415:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851895.842415:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851895.842416:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.842417:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851895.842417:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851895.842418:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851895.842419:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d27e40ac.
02000000:00000001:31.0:1773851895.842419:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.842420:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.842420:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851895.842421:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104681087, transno 0, xid 1859599489412096
00010000:00000001:31.0:1773851895.842422:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851895.842423:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ecebd921 x1859599489412096/t0(0) o400->98e0980c-924d-4509-b80b-0bf6fb1842b9@12115@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1254-0'
00010000:00000001:31.0:1773851895.842425:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851895.842425:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851895.842426:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=128 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851895.842427:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851895.842428:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ea1d4eaa refcount 3 to 12115@kfi7
00000100:00000001:31.0:1773851895.842428:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902579872 : -107154806971744 : ffff9e8b13cb62a0)
02000000:00000001:31.0:1773851895.842429:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851895.842430:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851895.842430:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851895.842431:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12114@kfi7
00000400:00000010:31.0:1773851895.842432:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defe7a25.
00000100:00000200:31.0:1773851895.842433:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599489412096, offset 224
00000400:00000200:31.0:1773851895.842434:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12114@kfi7
00000400:00000200:31.0:1773851895.842436:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12114@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.842437:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4451d3c nid 12114@kfi7 refs 1
00000400:00000200:31.0:1773851895.842438:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a4451d3c nid 12114@kfi7 refs 2
00000400:00000200:31.0:1773851895.842439:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a4451d3c nid 12114@kfi7 refs 3
00000400:00000200:31.0:1773851895.842440:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12114@kfi7 local destination
00000400:00000200:31.0:1773851895.842441:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770207:8770207:1024:4294967295] 12114@kfi7 LPNI seq info [20686677:20686677:16:4294967295]
00000400:00000200:31.0:1773851895.842443:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a4451d3c nid 12114@kfi7 refs 2
00000400:00000200:31.0:1773851895.842443:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12114@kfi7 to cpt 7
00000400:00000200:31.0:1773851895.842445:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12114@kfi7(12114@kfi7:12114@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851895.842446:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a4451d3c nid 12114@kfi7 refs 3
00000800:00000200:31.0:1773851895.842448:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851895.842449:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851895.842451:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851895.842453:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009f4 Using peer 12114@kfi7(0x1000000000009f4)
00000800:00000200:31.0:1773851895.842456:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x1000000000009f4: rc=0
00000800:00000200:31.0:1773851895.842458:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009f4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851895.842460:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851895.842460:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ea1d4eaa refcount 2 to 12115@kfi7
00010000:00000001:31.0:1773851895.842461:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851895.842462:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851895.842462:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851895.842463:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ecebd921 x1859599489412096/t0(0) o400->98e0980c-924d-4509-b80b-0bf6fb1842b9@12115@kfi7:683/0 lens 224/224 e 0 to 0 dl 1773852043 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1254-0'
00000100:00100000:31.0:1773851895.842466:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ecebd921 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:98e0980c-924d-4509-b80b-0bf6fb1842b9+5:39535:x1859599489412096:12345-12115@kfi7:400:default-tuolumne1254-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851895.842470:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12115@kfi7, seq: 2055593
00000100:00000040:31.0:1773851895.842471:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006069fa34 : new rpc_count 0
00000800:00000200:29.0:1773851895.842471:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009f4 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851895.842472:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851895.842472:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851895.842472:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851895.842473:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851895.842474:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851895.842474:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000243a822a.
00000400:00000200:29.0:1773851895.842474:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12114@kfi7: PUT: OK
00000020:00000040:31.0:1773851895.842475:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000006069fa34 : new refcount 4
00000400:00000200:29.0:1773851895.842475:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defe7a25
00000400:00000010:29.0:1773851895.842475:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defe7a25.
00000100:00000001:31.0:1773851895.842476:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851895.842476:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851895.842477:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851895.842478:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4451d3c nid 12114@kfi7 refs 2
00000800:00000200:29.0:1773851895.842479:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 12114@kfi7(00000000c2cfb070):0x0 lsk 2549 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000009f4 Transaction freed
00000800:00000200:5.0:1773851895.880193:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851895.880194:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851895.880195:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851895.880197:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851895.880199:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21634@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.880200:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21634@kfi7 : PUT - for me
00000400:00000200:5.0:1773851895.880201:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21634@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.880202:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045b74c54 nid 21634@kfi7 refs 1
00000400:00000200:5.0:1773851895.880203:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21634@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.880203:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045b74c54 nid 21634@kfi7 refs 2
00000400:00000200:5.0:1773851895.880204:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000045b74c54 nid 21634@kfi7 refs 3
00000400:00000200:5.0:1773851895.880205:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21571@kfi7 to cpt 1
00000400:00000200:5.0:1773851895.880206:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21571@kfi7 of length 224 into portal 12 MB=0x69b0991e2dd00
00000400:00000200:5.0:1773851895.880207:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21571@kfi7 of length 224/224 into md 0x793926dc5 [64] + 163744
00000800:00000200:5.0:1773851895.880209:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851895.880211:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.880212:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21634@kfi7: PUT: OK
00000100:00000001:5.0:1773851895.880213:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851895.880213:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851895.880214:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007d305c2f.
00000100:00000040:5.0:1773851895.880215:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000007d305c2f x1859315264838912 msgsize 224
00000100:00100000:5.0:1773851895.880217:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-21571@kfi7 (source: 12345-21634@kfi7)
00000100:00000001:5.0:1773851895.880217:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851895.880218:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000045b74c54 nid 21634@kfi7 refs 2
00000800:00000200:5.0:1773851895.880219:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851895.880219:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851895.880220:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851895.880220:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851895.880220:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851895.880221:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851895.880222:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315264838912
00000020:00000001:4.0:1773851895.880223:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851895.880223:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92dc7
00000020:00000001:4.0:1773851895.880224:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851895.880225:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ecdb5410 refcount=6
00000020:00000001:4.0:1773851895.880226:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744427520 : -107128965124096 : ffff9e911816b000)
00000020:00000001:4.0:1773851895.880227:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744427520 : -107128965124096 : ffff9e911816b000)
00000100:00000001:4.0:1773851895.880228:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.880228:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851895.880229:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851895.880230:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.880232:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000031fbcfde.
00000100:00000001:4.0:1773851895.880232:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851895.880233:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851895.880233:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.880234:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851895.880235:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851895.880235:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.880236:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851895.880237:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851895.880238:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851895.880238:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851895.880238:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851895.880239:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21571@kfi7, seq: 2001992
00000100:00000040:4.0:1773851895.880239:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ecdb5410 : new rpc_count 1
00000100:00000001:7.0:1773851895.880240:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.880240:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114931862016 : -106958777689600 : ffff9eb8b80cda00)
00000100:00000001:7.0:1773851895.880241:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.880241:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007d305c2f x1859315264838912/t0(0) o400->cf246ec6-92d3-4232-b5ef-1eb8fd7026aa@21571@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1848-0'
00000100:00000001:4.0:1773851895.880244:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851895.880244:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851895.880245:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d305c2f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:cf246ec6-92d3-4232-b5ef-1eb8fd7026aa+6:39699:x1859315264838912:12345-21571@kfi7:400:default-tuolumne1848-0
00000100:00000200:4.0:1773851895.880247:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315264838912
00000020:00000001:4.0:1773851895.880247:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851895.880248:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851895.880248:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.880249:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851895.880250:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851895.880250:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851895.880251:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315264838912, found 0 last_xid 1859315264838911
00000020:00000001:4.0:1773851895.880252:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851895.880253:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851895.880253:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851895.880254:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.880254:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851895.880255:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851895.880256:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851895.880257:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f66f953d.
02000000:00000001:4.0:1773851895.880257:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.880258:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.880259:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851895.880260:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262819572, transno 0, xid 1859315264838912
00010000:00000001:4.0:1773851895.880260:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851895.880261:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007d305c2f x1859315264838912/t0(0) o400->cf246ec6-92d3-4232-b5ef-1eb8fd7026aa@21571@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1848-0'
00010000:00000001:4.0:1773851895.880263:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851895.880264:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851895.880265:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=127 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851895.880266:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851895.880266:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d52d6616 refcount 3 to 21571@kfi7
00000100:00000001:4.0:1773851895.880267:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410656 : -107145304140960 : ffff9e8d4a351360)
02000000:00000001:4.0:1773851895.880268:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851895.880268:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851895.880269:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851895.880270:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21634@kfi7
00000400:00000010:4.0:1773851895.880270:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da924145.
00000100:00000200:4.0:1773851895.880271:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315264838912, offset 224
00000400:00000200:4.0:1773851895.880273:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21634@kfi7
00000400:00000200:4.0:1773851895.880273:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21634@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.880274:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000045b74c54 nid 21634@kfi7 refs 1
00000400:00000200:4.0:1773851895.880275:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000045b74c54 nid 21634@kfi7 refs 2
00000400:00000200:4.0:1773851895.880276:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000045b74c54 nid 21634@kfi7 refs 3
00000400:00000200:4.0:1773851895.880277:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21634@kfi7 local destination
00000400:00000200:4.0:1773851895.880279:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770208:8770208:1024:4294967295] 21634@kfi7 LPNI seq info [201858:201858:16:4294967295]
00000400:00000200:4.0:1773851895.880280:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000045b74c54 nid 21634@kfi7 refs 2
00000400:00000200:4.0:1773851895.880281:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21634@kfi7 to cpt 1
00000400:00000200:4.0:1773851895.880283:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21634@kfi7(21634@kfi7:21634@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851895.880284:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000045b74c54 nid 21634@kfi7 refs 3
00000800:00000200:4.0:1773851895.880285:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851895.880287:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851895.880289:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851895.880291:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe26 Using peer 21634@kfi7(0xe26)
00000800:00000200:4.0:1773851895.880295:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0xe26: rc=0
00000800:00000200:4.0:1773851895.880296:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe26 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851895.880298:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851895.880299:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d52d6616 refcount 2 to 21571@kfi7
00010000:00000001:4.0:1773851895.880299:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851895.880300:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851895.880301:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851895.880301:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007d305c2f x1859315264838912/t0(0) o400->cf246ec6-92d3-4232-b5ef-1eb8fd7026aa@21571@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1848-0'
00000100:00100000:4.0:1773851895.880306:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d305c2f pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:cf246ec6-92d3-4232-b5ef-1eb8fd7026aa+6:39699:x1859315264838912:12345-21571@kfi7:400:default-tuolumne1848-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851895.880308:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21571@kfi7, seq: 2001992
00000100:00000040:4.0:1773851895.880308:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ecdb5410 : new rpc_count 0
00000100:00000001:4.0:1773851895.880309:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851895.880310:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851895.880310:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851895.880311:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000031fbcfde.
00000020:00000010:4.0:1773851895.880312:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000020:00000040:4.0:1773851895.880312:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000ecdb5410 : new refcount 5
00000100:00000001:4.0:1773851895.880313:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851895.880318:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe26 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851895.880319:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851895.880320:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21634@kfi7: PUT: OK
00000400:00000200:5.0:1773851895.880321:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da924145
00000400:00000010:5.0:1773851895.880321:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da924145.
00000100:00000001:5.0:1773851895.880322:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851895.880323:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851895.880323:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000045b74c54 nid 21634@kfi7 refs 2
00000800:00000200:5.0:1773851895.880325:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 21634@kfi7(0000000029548bd7):0x0 lsk 3623 rsk 49 tsk 0 trmk 0 tmk 0 trr 1 tta 0xe26 Transaction freed
00000800:00000200:9.0:1773851895.917956:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851895.917957:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851895.917958:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851895.917961:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851895.917963:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.917965:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.171@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851895.917966:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851895.917967:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851895.917968:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.171@o2ib600 to cpt 4
00000400:00000200:9.0:1773851895.917970:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 2
00000400:00000200:9.0:1773851895.917971:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 3
00000400:00000200:9.0:1773851895.917972:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.171@o2ib600 to cpt 4
00000400:00000200:9.0:1773851895.917973:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.171@o2ib600 of length 224 into portal 12 MB=0x69aeefcaae100
00000400:00000200:9.0:1773851895.917975:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.171@o2ib600 of length 224/224 into md 0x6ab01b5d1 [64] + 44560
00000800:00000200:9.0:1773851895.917977:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851895.917979:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851895.917980:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851895.917981:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851895.917982:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851895.917982:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008c2ddb9c.
00000100:00000040:9.0:1773851895.917983:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000008c2ddb9c x1859201092215040 msgsize 224
00000100:00100000:9.0:1773851895.917985:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.171@o2ib600 (source: 12345-172.19.3.171@o2ib600)
00000100:00000001:9.0:1773851895.917987:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851895.917988:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:16.0:1773851895.917990:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851895.917990:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851895.917991:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851895.917992:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851895.917992:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851895.917993:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851895.917994:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859201092215040
00000020:00000001:16.0:1773851895.917995:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851895.917995:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dfa
00000020:00000001:16.0:1773851895.917996:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851895.917998:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b1bdc74e refcount=6
00000020:00000001:16.0:1773851895.917999:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239480320 : -107152470071296 : ffff9e8b9f15a800)
00000020:00000001:16.0:1773851895.918000:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239480320 : -107152470071296 : ffff9e8b9f15a800)
00000100:00000001:16.0:1773851895.918001:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851895.918001:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851895.918002:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000087d99a71.
00000020:00000010:16.0:1773851895.918003:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851895.918004:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001bb62e6e.
00000100:00000001:16.0:1773851895.918006:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851895.918006:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851895.918007:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851895.918008:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851895.918009:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851895.918009:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.918010:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851895.918012:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851895.918012:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851895.918012:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851895.918012:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851895.918014:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.171@o2ib600, seq: 2156423
00000100:00000040:19.0:1773851895.918015:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b1bdc74e : new rpc_count 1
00000100:00000001:19.0:1773851895.918015:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609035136 : -107064100516480 : ffff9ea032520d80)
00000100:00000001:16.0:1773851895.918015:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851895.918015:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851895.918017:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008c2ddb9c x1859201092215040/t0(0) o400->c12e22a0-0329-4c15-a86e-2b2df3dfddd5@172.19.3.171@o2ib600:147/0 lens 224/0 e 0 to 0 dl 1773852262 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic21-0'
00000100:00000001:19.0:1773851895.918020:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851895.918021:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851895.918022:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c2ddb9c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c12e22a0-0329-4c15-a86e-2b2df3dfddd5+6:24881:x1859201092215040:12345-172.19.3.171@o2ib600:400:default-oslic21-0
00000100:00000200:19.0:1773851895.918023:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859201092215040
00000020:00000001:19.0:1773851895.918024:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851895.918024:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851895.918025:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851895.918026:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851895.918027:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851895.918027:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851895.918028:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859201092215040, found 0 last_xid 1859201092215039
00000020:00000001:19.0:1773851895.918029:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851895.918029:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851895.918030:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851895.918030:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851895.918031:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851895.918032:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851895.918032:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851895.918033:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000099e6b427.
02000000:00000001:19.0:1773851895.918034:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851895.918034:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851895.918035:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851895.918036:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859201092215040
00010000:00000001:19.0:1773851895.918037:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851895.918038:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008c2ddb9c x1859201092215040/t0(0) o400->c12e22a0-0329-4c15-a86e-2b2df3dfddd5@172.19.3.171@o2ib600:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic21-0'
00010000:00000001:19.0:1773851895.918040:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851895.918041:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851895.918042:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=128 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851895.918043:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851895.918044:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3f73eef refcount 3 to 172.19.3.171@o2ib600
00000100:00000001:19.0:1773851895.918045:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935868517088 : -107137841034528 : ffff9e8f070b0ae0)
02000000:00000001:19.0:1773851895.918046:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851895.918046:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851895.918047:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851895.918048:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.171@o2ib600
00000400:00000010:19.0:1773851895.918049:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000094eafa05.
00000100:00000200:19.0:1773851895.918050:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859201092215040, offset 224
00000400:00000200:19.0:1773851895.918051:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.171@o2ib600
00000400:00000200:19.0:1773851895.918052:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.171@o2ib600 to cpt 4
00000400:00000200:19.0:1773851895.918053:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 2
00000400:00000200:19.0:1773851895.918055:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 3
00000400:00000200:19.0:1773851895.918056:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 4
00000400:00000200:19.0:1773851895.918057:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.171@o2ib600 routed destination
00000400:00000200:19.0:1773851895.918058:0:60961:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:19.0:1773851895.918059:0:60961:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:19.0:1773851895.918061:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.171@o2ib600: rtr pref emtpy: 1
00000400:00000200:19.0:1773851895.918062:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:19.0:1773851895.918063:0:60961:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.171@o2ib600: rtr pref emtpy: 1
00000400:00000200:19.0:1773851895.918064:0:60961:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:19.0:1773851895.918065:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770209:8770209:1024:4294967295] 2094@kfi7 LPNI seq info [1258747023:1258747023:16:4294967295]
00000400:00000200:19.0:1773851895.918066:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:19.0:1773851895.918067:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:19.0:1773851895.918069:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.171@o2ib600(172.19.3.171@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851895.918071:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2b5f90b nid 172.19.3.171@o2ib600 refs 3
00000800:00000200:19.0:1773851895.918072:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851895.918074:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851895.918076:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851895.918078:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:19.0:1773851895.918081:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:19.0:1773851895.918082:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851895.918084:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851895.918085:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3f73eef refcount 2 to 172.19.3.171@o2ib600
00010000:00000001:19.0:1773851895.918086:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851895.918087:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851895.918088:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851895.918088:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008c2ddb9c x1859201092215040/t0(0) o400->c12e22a0-0329-4c15-a86e-2b2df3dfddd5@172.19.3.171@o2ib600:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic21-0'
00000100:00100000:19.0:1773851895.918092:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c2ddb9c pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c12e22a0-0329-4c15-a86e-2b2df3dfddd5+6:24881:x1859201092215040:12345-172.19.3.171@o2ib600:400:default-oslic21-0 Request processed in 70us (107us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851895.918093:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851895.918094:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.171@o2ib600, seq: 2156423
00000100:00000040:19.0:1773851895.918095:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b1bdc74e : new rpc_count 0
00000100:00000001:19.0:1773851895.918095:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851895.918095:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851895.918096:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851895.918096:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000400:00000200:17.0:1773851895.918096:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:19.0:1773851895.918097:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001bb62e6e.
00000400:00000200:17.0:1773851895.918097:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000094eafa05
00000020:00000010:19.0:1773851895.918098:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000087d99a71.
00000400:00000010:17.0:1773851895.918098:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000094eafa05.
00000100:00000001:17.0:1773851895.918098:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:19.0:1773851895.918099:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000b1bdc74e : new refcount 5
00000100:00000001:19.0:1773851895.918099:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851895.918099:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851895.918100:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851895.918101:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x20000000000000c Transaction freed
00000800:00000200:21.0:1773851895.927367:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851895.927369:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851895.927371:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851895.927374:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851895.927377:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8464@kfi7 to cpt 5
00000400:00000200:21.0:1773851895.927379:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8464@kfi7 : PUT - for me
00000400:00000200:21.0:1773851895.927381:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8464@kfi7 to cpt 5
00000400:00000200:21.0:1773851895.927383:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4d7766d nid 8464@kfi7 refs 1
00000400:00000200:21.0:1773851895.927385:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8464@kfi7 to cpt 5
00000400:00000200:21.0:1773851895.927386:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4d7766d nid 8464@kfi7 refs 2
00000400:00000200:21.0:1773851895.927387:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e4d7766d nid 8464@kfi7 refs 3
00000400:00000200:21.0:1773851895.927389:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8464@kfi7 to cpt 5
00000400:00000200:21.0:1773851895.927390:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8464@kfi7 of length 224 into portal 12 MB=0x699e0c1b3f780
00000400:00000200:21.0:1773851895.927392:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8464@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 63896
00000800:00000200:21.0:1773851895.927396:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851895.927399:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851895.927401:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8464@kfi7: PUT: OK
00000100:00000001:21.0:1773851895.927402:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851895.927403:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851895.927405:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e697ba6d.
00000100:00000040:21.0:1773851895.927406:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e697ba6d x1858040461784960 msgsize 224
00000100:00100000:21.0:1773851895.927409:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-8464@kfi7 (source: 12345-8464@kfi7)
00000100:00000001:21.0:1773851895.927410:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851895.927412:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e4d7766d nid 8464@kfi7 refs 2
00000100:00000001:20.0:1773851895.927413:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851895.927414:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851895.927414:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851895.927415:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851895.927416:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851895.927417:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851895.927418:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040461784960
00000020:00000001:20.0:1773851895.927419:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851895.927420:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b19
00000020:00000001:20.0:1773851895.927421:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851895.927427:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f33ee0f8 refcount=11
00000020:00000001:20.0:1773851895.927429:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743688192 : -107128965863424 : ffff9e91180b6800)
00000020:00000001:20.0:1773851895.927430:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743688192 : -107128965863424 : ffff9e91180b6800)
00000100:00000001:20.0:1773851895.927431:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.927433:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851895.927434:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851895.927435:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.927436:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851895.927438:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851895.927438:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851895.927439:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851895.927441:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851895.927441:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851895.927442:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.927444:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851895.927446:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851895.927446:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851895.927447:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851895.927447:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851895.927449:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8464@kfi7, seq: 1998071
00000100:00000001:23.0:1773851895.927450:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.927450:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f33ee0f8 : new rpc_count 2
00000100:00000001:23.0:1773851895.927451:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.927451:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701980160 : -106936007571456 : ffff9ebe05414800)
00000100:00000040:20.0:1773851895.927453:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e697ba6d x1858040461784960/t0(0) o400->9024fc76-21ae-4cf4-a0c7-74cfb5e2ee99@8464@kfi7:622/0 lens 224/0 e 0 to 0 dl 1773851982 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1025-0'
00000100:00000001:20.0:1773851895.927458:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851895.927459:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851895.927460:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e697ba6d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9024fc76-21ae-4cf4-a0c7-74cfb5e2ee99+11:39697:x1858040461784960:12345-8464@kfi7:400:default-tuolumne1025-0
00000100:00000200:20.0:1773851895.927462:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040461784960
00000020:00000001:20.0:1773851895.927463:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851895.927464:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851895.927465:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.927466:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851895.927467:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851895.927468:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851895.927469:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040461784960, found 0 last_xid 1858040461401855
00000020:00000001:20.0:1773851895.927470:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851895.927471:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851895.927472:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851895.927473:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.927474:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851895.927475:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851895.927476:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851895.927477:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006f78f015.
02000000:00000001:20.0:1773851895.927478:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.927479:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.927480:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851895.927481:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183061391985, transno 0, xid 1858040461784960
00010000:00000001:20.0:1773851895.927482:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851895.927483:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e697ba6d x1858040461784960/t0(0) o400->9024fc76-21ae-4cf4-a0c7-74cfb5e2ee99@8464@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1025-0'
00010000:00000001:20.0:1773851895.927487:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851895.927488:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851895.927489:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=128 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851895.927491:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851895.927492:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000015857c69 refcount 3 to 8464@kfi7
00000100:00000001:20.0:1773851895.927493:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109088 : -107156354442528 : ffff9e8ab78edae0)
02000000:00000001:20.0:1773851895.927495:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851895.927496:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851895.927497:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851895.927499:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8464@kfi7
00000400:00000010:20.0:1773851895.927500:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c06062.
00000100:00000200:20.0:1773851895.927501:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040461784960, offset 224
00000400:00000200:20.0:1773851895.927504:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8464@kfi7
00000400:00000200:20.0:1773851895.927505:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8464@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.927507:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e4d7766d nid 8464@kfi7 refs 1
00000400:00000200:20.0:1773851895.927509:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e4d7766d nid 8464@kfi7 refs 2
00000400:00000200:20.0:1773851895.927510:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e4d7766d nid 8464@kfi7 refs 3
00000400:00000200:20.0:1773851895.927512:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8464@kfi7 local destination
00000400:00000200:20.0:1773851895.927514:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770210:8770210:1024:4294967295] 8464@kfi7 LPNI seq info [4338912:4338912:16:4294967295]
00000400:00000200:20.0:1773851895.927517:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e4d7766d nid 8464@kfi7 refs 2
00000400:00000200:20.0:1773851895.927518:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8464@kfi7 to cpt 5
00000400:00000200:20.0:1773851895.927521:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8464@kfi7(8464@kfi7:8464@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851895.927523:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e4d7766d nid 8464@kfi7 refs 3
00000800:00000200:20.0:1773851895.927526:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851895.927528:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851895.927531:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851895.927535:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000871 Using peer 8464@kfi7(0x100000000000871)
00000800:00000200:20.0:1773851895.927541:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x100000000000871: rc=0
00000800:00000200:20.0:1773851895.927543:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000871 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851895.927546:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851895.927548:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000015857c69 refcount 2 to 8464@kfi7
00010000:00000001:20.0:1773851895.927549:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851895.927553:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851895.927554:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851895.927555:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e697ba6d x1858040461784960/t0(0) o400->9024fc76-21ae-4cf4-a0c7-74cfb5e2ee99@8464@kfi7:622/0 lens 224/224 e 0 to 0 dl 1773851982 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1025-0'
00000100:00100000:20.0:1773851895.927561:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e697ba6d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:9024fc76-21ae-4cf4-a0c7-74cfb5e2ee99+11:39697:x1858040461784960:12345-8464@kfi7:400:default-tuolumne1025-0 Request processed in 101us (153us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851895.927565:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8464@kfi7, seq: 1998071
00000100:00000040:20.0:1773851895.927566:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f33ee0f8 : new rpc_count 1
00000100:00000001:20.0:1773851895.927567:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851895.927568:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851895.927569:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851895.927570:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851895.927572:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851895.927573:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000f33ee0f8 : new refcount 10
00000100:00000001:20.0:1773851895.927574:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851895.927582:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000871 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851895.927584:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851895.927586:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8464@kfi7: PUT: OK
00000400:00000200:21.0:1773851895.927587:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c06062
00000400:00000010:21.0:1773851895.927588:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c06062.
00000100:00000001:21.0:1773851895.927589:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851895.927590:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851895.927591:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e4d7766d nid 8464@kfi7 refs 2
00000800:00000200:21.0:1773851895.927594:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 8464@kfi7(00000000f039177a):0x0 lsk 2162 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000871 Transaction freed
00010000:00000001:2.0:1773851895.945735:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945736:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851895.945737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851895.945739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851895.945740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945741:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851895.945742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851895.945744:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851895.945746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851895.945748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851895.945749:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851895.945754:0:937832:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851895.945755:0:937832:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851895.945756:0:937832:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:1.0:1773851896.036859:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851896.036860:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851896.036862:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851896.036865:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851896.036868:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.036869:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000400:00000200:1.0:1773851896.036870:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.036871:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:1.0:1773851896.036872:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.036873:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:1.0:1773851896.036874:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:1.0:1773851896.036875:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.036876:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 224 into portal 12 MB=0x699e0e993e840
00000400:00000200:1.0:1773851896.036878:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2056@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 52112
00000800:00000200:1.0:1773851896.036881:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851896.036884:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851896.036886:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000100:00000001:1.0:1773851896.036888:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851896.036888:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851896.036889:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1a44fdc.
00000100:00000040:1.0:1773851896.036891:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000f1a44fdc x1858041130772544 msgsize 224
00000100:00100000:1.0:1773851896.036894:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-2056@kfi7 (source: 12345-2056@kfi7)
00000100:00000001:1.0:1773851896.036895:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851896.036897:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:0.0:1773851896.036898:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851896.036899:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851896.036900:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851896.036900:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851896.036900:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851896.036902:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851896.036903:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041130772544
00000020:00000001:0.0:1773851896.036904:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851896.036905:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb9b93
00000020:00000001:0.0:1773851896.036906:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851896.036908:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000063b9c45f refcount=5
00000020:00000001:0.0:1773851896.036910:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636943351503872 : -107130358047744 : ffff9e90c5105c00)
00000020:00000001:0.0:1773851896.036911:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636943351503872 : -107130358047744 : ffff9e90c5105c00)
00000100:00000001:0.0:1773851896.036913:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851896.036914:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851896.036915:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851896.036917:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851896.036918:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851896.036920:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851896.036921:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851896.036922:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851896.036923:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851896.036924:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851896.036925:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.036927:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851896.036929:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851896.036930:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851896.036930:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851896.036931:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851896.036932:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2056@kfi7, seq: 1997624
00000100:00000001:2.0:1773851896.036934:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851896.036934:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000063b9c45f : new rpc_count 1
00000100:00000001:2.0:1773851896.036935:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.036935:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052762368 : -106991656789248 : ffff9eb1104d9b00)
00000100:00000040:0.0:1773851896.036937:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f1a44fdc x1858041130772544/t0(0) o400->lustre5-MDT0001-lwp-OST0014_UUID@2056@kfi7:536/0 lens 224/0 e 0 to 0 dl 1773852651 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba121-0'
00000100:00000001:0.0:1773851896.036949:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851896.036950:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851896.036952:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1a44fdc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre5-MDT0001-lwp-OST0014_UUID+5:272635:x1858041130772544:12345-2056@kfi7:400:default-yuba121-0
00000100:00000200:0.0:1773851896.036955:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041130772544
00000020:00000001:0.0:1773851896.036956:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851896.036957:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851896.036958:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.036959:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851896.036960:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851896.036962:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:0.0:1773851896.036963:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851896.036964:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851896.036965:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851896.036966:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.036968:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851896.036968:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851896.036969:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851896.036971:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e1e8998.
02000000:00000001:0.0:1773851896.036972:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.036973:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.036975:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851896.036976:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858041130772544
00010000:00000001:0.0:1773851896.036978:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851896.036979:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f1a44fdc x1858041130772544/t0(0) o400->lustre5-MDT0001-lwp-OST0014_UUID@2056@kfi7:536/0 lens 224/224 e 0 to 0 dl 1773852651 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba121-0'
00010000:00000001:0.0:1773851896.036984:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851896.036985:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851896.036987:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=129 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851896.036989:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851896.036990:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cafa7586 refcount 7 to 2056@kfi7
00000100:00000001:0.0:1773851896.036991:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051104 : -107154804500512 : ffff9e8b13f117e0)
02000000:00000001:0.0:1773851896.036993:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851896.036995:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.036997:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851896.036998:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000010:0.0:1773851896.036999:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073d1c143.
00000100:00000200:0.0:1773851896.037001:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041130772544, offset 224
00000400:00000200:0.0:1773851896.037004:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000200:0.0:1773851896.037005:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:0.0:1773851896.037007:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:0.0:1773851896.037009:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:0.0:1773851896.037011:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:0.0:1773851896.037014:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2056@kfi7 local destination
00000400:00000200:0.0:1773851896.037016:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770211:8770211:1024:4294967295] 2056@kfi7 LPNI seq info [5402406:5402406:16:4294967295]
00000400:00000200:0.0:1773851896.037019:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:0.0:1773851896.037021:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:0.0:1773851896.037025:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851896.037027:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000800:00000200:0.0:1773851896.037030:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851896.037032:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851896.037036:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851896.037041:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000800:00000200:0.0:1773851896.037046:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000800:00000200:0.0:1773851896.037049:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851896.037053:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851896.037057:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cafa7586 refcount 6 to 2056@kfi7
00010000:00000001:0.0:1773851896.037058:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851896.037059:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.037060:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851896.037063:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1a44fdc x1858041130772544/t0(0) o400->lustre5-MDT0001-lwp-OST0014_UUID@2056@kfi7:536/0 lens 224/224 e 0 to 0 dl 1773852651 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba121-0'
00000100:00100000:0.0:1773851896.037069:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1a44fdc pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:lustre5-MDT0001-lwp-OST0014_UUID+5:272635:x1858041130772544:12345-2056@kfi7:400:default-yuba121-0 Request processed in 119us (177us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851896.037074:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2056@kfi7, seq: 1997624
00000100:00000040:0.0:1773851896.037075:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000063b9c45f : new rpc_count 0
00000100:00000001:0.0:1773851896.037077:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851896.037078:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851896.037079:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851896.037080:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851896.037082:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851896.037083:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000063b9c45f : new refcount 4
00000100:00000001:0.0:1773851896.037085:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851896.037093:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851896.037096:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851896.037098:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000400:00000200:1.0:1773851896.037100:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073d1c143
00000400:00000010:1.0:1773851896.037101:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073d1c143.
00000100:00000001:1.0:1773851896.037103:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851896.037103:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851896.037105:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:1.0:1773851896.037108:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000202 Transaction freed
00000800:00000200:10.0:1773851896.078996:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851896.078997:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851896.078998:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851896.079000:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851896.079002:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12432@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.079004:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12432@kfi7 : PUT - for me
00000400:00000200:10.0:1773851896.079005:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12432@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.079005:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d288bbd8 nid 12432@kfi7 refs 1
00000400:00000200:10.0:1773851896.079007:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12432@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.079007:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d288bbd8 nid 12432@kfi7 refs 2
00000400:00000200:10.0:1773851896.079008:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d288bbd8 nid 12432@kfi7 refs 3
00000400:00000200:10.0:1773851896.079009:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12433@kfi7 to cpt 5
00000400:00000200:10.0:1773851896.079010:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12433@kfi7 of length 224 into portal 12 MB=0x69a9e32aa73c0
00000400:00000200:10.0:1773851896.079011:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12433@kfi7 of length 224/224 into md 0x78146ce49 [64] + 160808
00000800:00000200:10.0:1773851896.079013:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851896.079015:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851896.079015:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12432@kfi7: PUT: OK
00000100:00000001:10.0:1773851896.079019:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851896.079020:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851896.079020:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e11655bc.
00000100:00000040:10.0:1773851896.079021:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000e11655bc x1858854105805760 msgsize 224
00000100:00100000:10.0:1773851896.079023:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-12433@kfi7 (source: 12345-12432@kfi7)
00000100:00000001:10.0:1773851896.079024:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851896.079025:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:10.0:1773851896.079025:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d288bbd8 nid 12432@kfi7 refs 2
02000000:00000001:11.0:1773851896.079026:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851896.079026:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:10.0:1773851896.079026:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d35a17e8: 2069@kfi7:2 <- 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851896.079027:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851896.079028:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851896.079028:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858854105805760
00000020:00000001:11.0:1773851896.079029:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851896.079029:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920a0
00000020:00000001:11.0:1773851896.079030:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851896.079031:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074243f53 refcount=6
00000020:00000001:11.0:1773851896.079032:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629495808 : -107123080055808 : ffff9e9276ddb400)
00000020:00000001:11.0:1773851896.079033:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629495808 : -107123080055808 : ffff9e9276ddb400)
00000100:00000001:11.0:1773851896.079034:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851896.079034:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851896.079035:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089741d53.
00000020:00000010:11.0:1773851896.079036:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851896.079037:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851896.079038:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851896.079038:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851896.079039:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851896.079040:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851896.079040:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851896.079041:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.079042:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851896.079043:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851896.079043:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851896.079043:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851896.079043:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851896.079044:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12433@kfi7, seq: 2130869
00000100:00000040:11.0:1773851896.079045:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074243f53 : new rpc_count 1
00000100:00000001:11.0:1773851896.079045:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087776000 : -106944621775616 : ffff9ebc03cef500)
00000100:00000001:8.0:1773851896.079045:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851896.079046:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851896.079047:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e11655bc x1858854105805760/t0(0) o400->8daae5f2-7dac-4a3f-8576-3b338179f156@12433@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1266-0'
00000100:00000001:11.0:1773851896.079049:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851896.079050:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851896.079051:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e11655bc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8daae5f2-7dac-4a3f-8576-3b338179f156+6:39702:x1858854105805760:12345-12433@kfi7:400:default-tuolumne1266-0
00000100:00000200:11.0:1773851896.079052:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858854105805760
00000020:00000001:11.0:1773851896.079052:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851896.079053:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851896.079054:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.079054:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851896.079055:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851896.079056:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851896.079056:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858854105805760, found 0 last_xid 1858854105805759
00000020:00000001:11.0:1773851896.079057:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851896.079058:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851896.079058:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851896.079058:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.079059:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851896.079060:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851896.079060:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851896.079061:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000575f5ace.
02000000:00000001:11.0:1773851896.079061:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.079062:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.079063:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851896.079063:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689700, transno 0, xid 1858854105805760
00010000:00000001:11.0:1773851896.079064:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851896.079065:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e11655bc x1858854105805760/t0(0) o400->8daae5f2-7dac-4a3f-8576-3b338179f156@12433@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1266-0'
00010000:00000001:11.0:1773851896.079067:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851896.079068:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851896.079068:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=129 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851896.079069:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851896.079071:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000552e3012 refcount 3 to 12433@kfi7
00000100:00000001:11.0:1773851896.079071:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109184 : -107156354442432 : ffff9e8ab78edb40)
02000000:00000001:11.0:1773851896.079072:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851896.079073:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.079073:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851896.079074:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12432@kfi7
00000400:00000010:11.0:1773851896.079075:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000177f1aa0.
00000100:00000200:11.0:1773851896.079076:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858854105805760, offset 224
00000400:00000200:11.0:1773851896.079077:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12432@kfi7
00000400:00000200:11.0:1773851896.079078:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12432@kfi7 to cpt 2
00000400:00000200:11.0:1773851896.079079:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d288bbd8 nid 12432@kfi7 refs 1
00000400:00000200:11.0:1773851896.079080:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d288bbd8 nid 12432@kfi7 refs 2
00000400:00000200:11.0:1773851896.079081:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d288bbd8 nid 12432@kfi7 refs 3
00000400:00000200:11.0:1773851896.079082:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12432@kfi7 local destination
00000400:00000200:11.0:1773851896.079083:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770212:8770212:1024:4294967295] 12432@kfi7 LPNI seq info [15345813:15345813:16:4294967295]
00000400:00000200:11.0:1773851896.079085:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d288bbd8 nid 12432@kfi7 refs 2
00000400:00000200:11.0:1773851896.079085:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12432@kfi7 to cpt 2
00000400:00000200:11.0:1773851896.079087:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12432@kfi7(12432@kfi7:12432@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851896.079089:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d288bbd8 nid 12432@kfi7 refs 3
00000800:00000200:11.0:1773851896.079090:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851896.079091:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851896.079093:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851896.079095:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7c Using peer 12432@kfi7(0xe7c)
00000800:00000200:11.0:1773851896.079098:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0xe7c: rc=0
00000800:00000200:11.0:1773851896.079100:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851896.079102:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851896.079103:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000552e3012 refcount 2 to 12433@kfi7
00010000:00000001:11.0:1773851896.079104:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851896.079104:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.079105:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851896.079106:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e11655bc x1858854105805760/t0(0) o400->8daae5f2-7dac-4a3f-8576-3b338179f156@12433@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1266-0'
00000100:00100000:11.0:1773851896.079109:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e11655bc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8daae5f2-7dac-4a3f-8576-3b338179f156+6:39702:x1858854105805760:12345-12433@kfi7:400:default-tuolumne1266-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851896.079111:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12433@kfi7, seq: 2130869
00000100:00000040:11.0:1773851896.079112:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074243f53 : new rpc_count 0
00000800:00000200:9.0:1773851896.079112:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7c TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851896.079113:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851896.079113:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851896.079114:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851896.079114:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000400:00000200:9.0:1773851896.079114:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851896.079115:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089741d53.
00000400:00000200:9.0:1773851896.079115:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12432@kfi7: PUT: OK
00000020:00000040:11.0:1773851896.079116:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000074243f53 : new refcount 5
00000400:00000200:9.0:1773851896.079116:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000177f1aa0
00000100:00000001:11.0:1773851896.079117:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851896.079117:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000177f1aa0.
00000100:00000001:9.0:1773851896.079118:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851896.079118:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851896.079119:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d288bbd8 nid 12432@kfi7 refs 2
00000800:00000200:9.0:1773851896.079120:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 12432@kfi7(00000000e406397c):0x0 lsk 3709 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe7c Transaction freed
00000004:00000001:6.0:1773851896.137730:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851896.137731:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851896.137731:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003ae3d1a3.
00000020:00000040:6.0:1773851896.137733:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851896.137733:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851896.137734:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851896.137736:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851896.137737:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006fe63e6d.
00000100:00000001:6.0:1773851896.137738:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851896.137738:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851896.137739:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851896.137740:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000003ae3d1a3] to pc [ptlrpcd_01_00+0]  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851896.137744:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851896.137745:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851896.137745:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:6.0:1773851896.137745:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000de8c6763.
00000100:00000001:7.0:1773851896.137746:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851896.137746:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637097535288320 : -106976174263296 : ffff9eb4ab223400)
00000100:00000001:4.0:1773851896.137746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:7.0:1773851896.137747:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851896.137747:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851896.137747:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.137749:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851896.137750:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851896.137750:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851896.137751:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851896.137751:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851896.137751:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000004:00000010:6.0:1773851896.137751:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b2986763.
00000100:00100000:7.0:1773851896.137752:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000003ae3d1a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051940224:16@kfi7:13:default-yuba2-0
00000004:00080000:6.0:1773851896.137752:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614170591027686ns, next at 614171591026814ns, rc = 0
00000100:00000001:7.0:1773851896.137753:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:6.0:1773851896.137753:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:7.0:1773851896.137754:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:6.0:1773851896.137754:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851896.137754:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851896.137755:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851896.137755:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851896.137756:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006f21a4d8.
02000000:00000001:7.0:1773851896.137757:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851896.137758:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:7.0:1773851896.137758:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000400:00000010:7.0:1773851896.137759:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000100:00000200:7.0:1773851896.137760:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940224, portal 4
00000100:00000001:7.0:1773851896.137761:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851896.137762:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359410688 : -107048350140928 : ffff9ea3dd1db600)
00000100:00000040:7.0:1773851896.137763:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851896.137765:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851896.137766:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:7.0:1773851896.137766:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c57bf78.
00000100:00000200:7.0:1773851896.137767:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940224, offset 0
00000400:00000200:7.0:1773851896.137768:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:7.0:1773851896.137769:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851896.137770:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:7.0:1773851896.137771:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851896.137772:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:7.0:1773851896.137774:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:7.0:1773851896.137775:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770212, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770211, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851896.137777:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:7.0:1773851896.137778:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851896.137779:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:7.0:1773851896.137780:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770213:8770213:1024:4294967295] 16@kfi7 LPNI seq info [5403821:5403821:16:4294967295]
00000400:00000200:7.0:1773851896.137781:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851896.137782:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851896.137784:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851896.137785:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:7.0:1773851896.137787:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851896.137788:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851896.137790:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851896.137792:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Using peer 16@kfi7(0x200000000000169)
00000800:00000200:7.0:1773851896.137795:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x200000000000169: rc=0
00000800:00000200:7.0:1773851896.137796:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851896.137798:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.137799:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851896.137800:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.137800:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.137801:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.137802:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851896.137803:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851896.137803:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851896.137803:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851896.137804:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.137804:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851896.137808:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851896.137810:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851896.137811:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000400:00000200:6.0:1773851896.137812:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c57bf78
00000400:00000010:6.0:1773851896.137812:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c57bf78.
00000100:00000001:6.0:1773851896.137813:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851896.137813:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851896.137816:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851896.137817:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851896.137819:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851896.137819:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851896.137820:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:6.0:1773851896.137823:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Transaction freed
00000800:00000200:29.0:1773851896.137851:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851896.137852:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851896.137853:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851896.137855:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851896.137857:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.137858:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851896.137859:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.137860:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851896.137861:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.137861:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851896.137862:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851896.137863:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.137864:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6580
00000400:00000200:29.0:1773851896.137866:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.137867:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x780081e3d [1] + 224
00000800:00000200:29.0:1773851896.137869:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851896.137871:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851896.137872:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851896.137873:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851896.137874:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851896.137877:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851896.137881:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851896.137882:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:7.0:1773851896.137883:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851896.137884:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851896.137884:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851896.137884:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851896.137885:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851896.137885:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851896.137886:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:7.0:1773851896.137887:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000100:00000001:7.0:1773851896.137887:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851896.137888:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851896.137891:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851896.137893:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851896.137894:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.137894:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851896.137895:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851896.137895:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851896.137896:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851896.137897:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851896.137898:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=129 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851896.137899:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=129 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851896.137900:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851896.137900:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851896.137901:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851896.137901:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.137902:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851896.137902:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:7.0:1773851896.137903:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851896.137903:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.137904:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851896.137907:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851896.137907:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851896.137908:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851896.137909:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851896.137909:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851896.137911:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482217472 avail=351481148416 avail_mb=1372973236 hwm_mb=3131103 files=372097101 ffree=343244353 state=0: rc = 0
00000004:00000020:7.0:1773851896.137913:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482217472 free, 351481148416 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097101 files, 343244353 free files
00000004:00000001:7.0:1773851896.137914:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.137915:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851896.137918:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000003ae3d1a3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051940224:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851896.137919:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.137920:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851896.137920:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000003ae3d1a3 x1859433051940224/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851896.137923:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851896.137923:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851896.137924:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006f21a4d8.
02000000:00000001:7.0:1773851896.137924:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851896.137925:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851896.137925:0:41064:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:7.0:1773851896.137926:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851896.137926:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006fe63e6d.
02000000:00000001:7.0:1773851896.137927:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851896.137928:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851896.137928:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000003ae3d1a3.
00000100:00000001:7.0:1773851896.137929:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851896.137929:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.137930:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.137930:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851896.137931:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.137931:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851896.137931:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851896.145734:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851896.145735:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851896.145737:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851896.145739:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851896.145741:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20753@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.145742:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20753@kfi7 : PUT - for me
00000400:00000200:21.0:1773851896.145743:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20753@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.145745:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc83104b nid 20753@kfi7 refs 1
00000400:00000200:21.0:1773851896.145746:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20753@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.145747:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc83104b nid 20753@kfi7 refs 2
00000400:00000200:21.0:1773851896.145747:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cc83104b nid 20753@kfi7 refs 3
00000400:00000200:21.0:1773851896.145749:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20944@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.145749:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20944@kfi7 of length 224 into portal 12 MB=0x699e0d4f135c0
00000400:00000200:21.0:1773851896.145751:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20944@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 64120
00000800:00000200:21.0:1773851896.145752:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851896.145754:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851896.145755:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20753@kfi7: PUT: OK
00000100:00000001:21.0:1773851896.145756:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851896.145757:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851896.145758:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002dd7d3a8.
00000100:00000040:21.0:1773851896.145758:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002dd7d3a8 x1858040784565696 msgsize 224
00000100:00100000:21.0:1773851896.145760:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20944@kfi7 (source: 12345-20753@kfi7)
00000100:00000001:21.0:1773851896.145761:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851896.145762:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cc83104b nid 20753@kfi7 refs 2
00000100:00000001:20.0:1773851896.145762:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851896.145763:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851896.145763:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851896.145763:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851896.145764:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851896.145764:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851896.145765:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040784565696
00000020:00000001:20.0:1773851896.145766:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851896.145766:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f5e
00000020:00000001:20.0:1773851896.145767:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851896.145771:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a01df54 refcount=6
00000020:00000001:20.0:1773851896.145772:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629002240 : -107123080549376 : ffff9e9276d62c00)
00000020:00000001:20.0:1773851896.145772:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629002240 : -107123080549376 : ffff9e9276d62c00)
00000100:00000001:20.0:1773851896.145773:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851896.145774:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851896.145775:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851896.145776:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851896.145777:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851896.145778:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851896.145778:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851896.145779:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851896.145780:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851896.145780:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851896.145781:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.145782:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851896.145783:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851896.145783:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851896.145784:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851896.145784:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851896.145785:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20944@kfi7, seq: 1998072
00000100:00000040:20.0:1773851896.145785:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a01df54 : new rpc_count 1
00000100:00000001:23.0:1773851896.145786:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.145786:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.145786:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701974400 : -106936007577216 : ffff9ebe05413180)
00000100:00000040:20.0:1773851896.145788:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002dd7d3a8 x1858040784565696/t0(0) o400->71756ee5-8d73-43ab-a0c6-f65454221e2e@20944@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1793-0'
00000100:00000001:20.0:1773851896.145790:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851896.145791:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851896.145792:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002dd7d3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:71756ee5-8d73-43ab-a0c6-f65454221e2e+6:39674:x1858040784565696:12345-20944@kfi7:400:default-tuolumne1793-0
00000100:00000200:20.0:1773851896.145793:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040784565696
00000020:00000001:20.0:1773851896.145794:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851896.145794:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851896.145795:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.145796:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851896.145796:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851896.145797:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851896.145798:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040784565696, found 0 last_xid 1858040784565695
00000020:00000001:20.0:1773851896.145798:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851896.145799:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851896.145800:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851896.145800:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.145801:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851896.145801:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851896.145802:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851896.145804:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003db72a1a.
02000000:00000001:20.0:1773851896.145805:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.145806:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.145806:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851896.145807:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044171397, transno 0, xid 1858040784565696
00010000:00000001:20.0:1773851896.145808:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851896.145809:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002dd7d3a8 x1858040784565696/t0(0) o400->71756ee5-8d73-43ab-a0c6-f65454221e2e@20944@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1793-0'
00010000:00000001:20.0:1773851896.145811:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851896.145812:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851896.145812:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=129 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851896.145813:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851896.145814:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ecc6416d refcount 3 to 20944@kfi7
00000100:00000001:20.0:1773851896.145815:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916941196288 : -107156768355328 : ffff9e8a9ee30c00)
02000000:00000001:20.0:1773851896.145815:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851896.145816:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.145817:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851896.145817:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20753@kfi7
00000400:00000010:20.0:1773851896.145818:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e2f6c1a.
00000100:00000200:20.0:1773851896.145818:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040784565696, offset 224
00000400:00000200:20.0:1773851896.145820:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20753@kfi7
00000400:00000200:20.0:1773851896.145821:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20753@kfi7 to cpt 5
00000400:00000200:20.0:1773851896.145821:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cc83104b nid 20753@kfi7 refs 1
00000400:00000200:20.0:1773851896.145823:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cc83104b nid 20753@kfi7 refs 2
00000400:00000200:20.0:1773851896.145824:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cc83104b nid 20753@kfi7 refs 3
00000400:00000200:20.0:1773851896.145825:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20753@kfi7 local destination
00000400:00000200:20.0:1773851896.145826:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770214:8770214:1024:4294967295] 20753@kfi7 LPNI seq info [939131:939131:16:4294967295]
00000400:00000200:20.0:1773851896.145827:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cc83104b nid 20753@kfi7 refs 2
00000400:00000200:20.0:1773851896.145828:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20753@kfi7 to cpt 5
00000400:00000200:20.0:1773851896.145830:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20753@kfi7(20753@kfi7:20753@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851896.145831:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cc83104b nid 20753@kfi7 refs 3
00000800:00000200:20.0:1773851896.145833:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851896.145834:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851896.145838:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851896.145840:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000342 Using peer 20753@kfi7(0x100000000000342)
00000800:00000200:20.0:1773851896.145843:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x100000000000342: rc=0
00000800:00000200:20.0:1773851896.145845:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000342 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851896.145847:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851896.145848:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ecc6416d refcount 2 to 20944@kfi7
00010000:00000001:20.0:1773851896.145848:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851896.145849:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.145849:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851896.145850:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002dd7d3a8 x1858040784565696/t0(0) o400->71756ee5-8d73-43ab-a0c6-f65454221e2e@20944@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1793-0'
00000100:00100000:20.0:1773851896.145854:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002dd7d3a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:71756ee5-8d73-43ab-a0c6-f65454221e2e+6:39674:x1858040784565696:12345-20944@kfi7:400:default-tuolumne1793-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851896.145856:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20944@kfi7, seq: 1998072
00000100:00000040:20.0:1773851896.145857:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a01df54 : new rpc_count 0
00000100:00000001:20.0:1773851896.145858:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851896.145858:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851896.145859:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851896.145860:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851896.145860:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851896.145861:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009a01df54 : new refcount 5
00000100:00000001:20.0:1773851896.145862:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851896.145867:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000342 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851896.145868:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851896.145869:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20753@kfi7: PUT: OK
00000400:00000200:21.0:1773851896.145870:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e2f6c1a
00000400:00000010:21.0:1773851896.145870:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e2f6c1a.
00000100:00000001:21.0:1773851896.145871:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851896.145872:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851896.145873:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cc83104b nid 20753@kfi7 refs 2
00000800:00000200:21.0:1773851896.145874:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 20753@kfi7(00000000c62ea127):0x0 lsk 835 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000342 Transaction freed
00000800:00000200:21.0:1773851896.192722:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851896.192727:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851896.192729:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851896.192731:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851896.192733:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8257@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.192733:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8257@kfi7 : PUT - for me
00000400:00000200:21.0:1773851896.192734:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8257@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.192735:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000058096969 nid 8257@kfi7 refs 1
00000400:00000200:21.0:1773851896.192736:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8257@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.192737:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000058096969 nid 8257@kfi7 refs 2
00000400:00000200:21.0:1773851896.192738:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000058096969 nid 8257@kfi7 refs 3
00000400:00000200:21.0:1773851896.192739:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8256@kfi7 to cpt 2
00000400:00000200:21.0:1773851896.192739:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8256@kfi7 of length 224 into portal 12 MB=0x69b94eb6bd480
00000400:00000200:21.0:1773851896.192740:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8256@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 64344
00000800:00000200:21.0:1773851896.192742:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851896.192743:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851896.192744:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8257@kfi7: PUT: OK
00000100:00000001:21.0:1773851896.192745:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851896.192745:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851896.192746:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ccb2ae7e.
00000100:00000040:21.0:1773851896.192747:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ccb2ae7e x1859913767441536 msgsize 224
00000100:00100000:21.0:1773851896.192748:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-8256@kfi7 (source: 12345-8257@kfi7)
00000100:00000001:21.0:1773851896.192749:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851896.192750:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000058096969 nid 8257@kfi7 refs 2
00000800:00000200:21.0:1773851896.192752:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851896.192752:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851896.192753:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851896.192753:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851896.192754:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851896.192755:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851896.192757:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859913767441536
00000020:00000001:20.0:1773851896.192758:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851896.192758:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b4fd0df3b
00000020:00000001:20.0:1773851896.192759:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851896.192762:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000efb9d6d4 refcount=15
00000020:00000001:20.0:1773851896.192764:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636957172298752 : -107116537252864 : ffff9e93fcd8f400)
00000020:00000001:20.0:1773851896.192765:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636957172298752 : -107116537252864 : ffff9e93fcd8f400)
00000100:00000001:20.0:1773851896.192767:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851896.192768:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851896.192769:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851896.192770:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851896.192771:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000100:00000001:20.0:1773851896.192772:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851896.192773:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851896.192773:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851896.192775:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851896.192775:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851896.192776:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.192778:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851896.192779:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851896.192780:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851896.192781:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851896.192781:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851896.192782:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8256@kfi7, seq: 1998073
00000100:00000001:23.0:1773851896.192783:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851896.192783:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000efb9d6d4 : new rpc_count 2
00000100:00000001:23.0:1773851896.192784:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.192784:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701991680 : -106936007559936 : ffff9ebe05417500)
00000100:00000040:20.0:1773851896.192786:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ccb2ae7e x1859913767441536/t0(0) o400->5185891a-8005-454a-996b-8a54662acd73@8256@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1012-0'
00000100:00000001:20.0:1773851896.192791:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851896.192791:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851896.192793:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ccb2ae7e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:5185891a-8005-454a-996b-8a54662acd73+15:39562:x1859913767441536:12345-8256@kfi7:400:default-tuolumne1012-0
00000100:00000200:20.0:1773851896.192795:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859913767441536
00000020:00000001:20.0:1773851896.192796:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851896.192796:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851896.192798:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.192799:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851896.192800:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851896.192801:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851896.192802:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859913767441536, found 0 last_xid 1859913767205311
00000020:00000001:20.0:1773851896.192803:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851896.192804:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851896.192805:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851896.192806:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.192806:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851896.192807:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851896.192808:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851896.192809:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000de04de0e.
02000000:00000001:20.0:1773851896.192810:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.192811:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.192812:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851896.192813:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183152811634, transno 0, xid 1859913767441536
00010000:00000001:20.0:1773851896.192814:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851896.192815:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ccb2ae7e x1859913767441536/t0(0) o400->5185891a-8005-454a-996b-8a54662acd73@8256@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1012-0'
00010000:00000001:20.0:1773851896.192820:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851896.192821:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851896.192822:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=129 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851896.192823:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851896.192824:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001a73d5f9 refcount 3 to 8256@kfi7
00000100:00000001:20.0:1773851896.192825:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637063159175232 : -107010550376384 : ffff9eacaa285840)
02000000:00000001:20.0:1773851896.192827:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851896.192827:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.192828:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851896.192829:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8257@kfi7
00000400:00000010:20.0:1773851896.192830:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f2b7e97.
00000100:00000200:20.0:1773851896.192831:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859913767441536, offset 224
00000400:00000200:20.0:1773851896.192833:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8257@kfi7
00000400:00000200:20.0:1773851896.192835:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8257@kfi7 to cpt 5
00000400:00000200:20.0:1773851896.192836:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000058096969 nid 8257@kfi7 refs 1
00000400:00000200:20.0:1773851896.192838:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000058096969 nid 8257@kfi7 refs 2
00000400:00000200:20.0:1773851896.192840:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000058096969 nid 8257@kfi7 refs 3
00000400:00000200:20.0:1773851896.192842:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8257@kfi7 local destination
00000400:00000200:20.0:1773851896.192844:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770215:8770215:1024:4294967295] 8257@kfi7 LPNI seq info [5354552:5354552:16:4294967295]
00000400:00000200:20.0:1773851896.192846:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000058096969 nid 8257@kfi7 refs 2
00000400:00000200:20.0:1773851896.192847:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8257@kfi7 to cpt 5
00000400:00000200:20.0:1773851896.192851:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8257@kfi7(8257@kfi7:8257@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851896.192853:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000058096969 nid 8257@kfi7 refs 3
00000800:00000200:20.0:1773851896.192855:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851896.192856:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851896.192860:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851896.192864:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1274 Using peer 8257@kfi7(0x1274)
00000800:00000200:20.0:1773851896.192869:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x1274: rc=0
00000800:00000200:20.0:1773851896.192871:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1274 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851896.192874:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851896.192875:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001a73d5f9 refcount 2 to 8256@kfi7
00010000:00000001:20.0:1773851896.192876:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851896.192877:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.192878:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851896.192881:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ccb2ae7e x1859913767441536/t0(0) o400->5185891a-8005-454a-996b-8a54662acd73@8256@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1012-0'
00000100:00100000:20.0:1773851896.192886:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ccb2ae7e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:5185891a-8005-454a-996b-8a54662acd73+15:39562:x1859913767441536:12345-8256@kfi7:400:default-tuolumne1012-0 Request processed in 95us (138us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851896.192890:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8256@kfi7, seq: 1998073
00000100:00000040:20.0:1773851896.192891:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000efb9d6d4 : new rpc_count 1
00000100:00000001:20.0:1773851896.192893:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851896.192893:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851896.192894:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851896.192895:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:20.0:1773851896.192896:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851896.192897:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000efb9d6d4 : new refcount 14
00000100:00000001:20.0:1773851896.192898:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851896.192906:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1274 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851896.192907:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851896.192909:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8257@kfi7: PUT: OK
00000400:00000200:21.0:1773851896.192910:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f2b7e97
00000400:00000010:21.0:1773851896.192910:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f2b7e97.
00000100:00000001:21.0:1773851896.192911:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851896.192911:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851896.192912:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000058096969 nid 8257@kfi7 refs 2
00000800:00000200:21.0:1773851896.192914:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 8257@kfi7(000000008a94d04c):0x0 lsk 4725 rsk 8 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1274 Transaction freed
00000800:00000200:9.0:1773851896.223157:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851896.223158:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851896.223159:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851896.223162:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851896.223163:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.223165:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.118@tcp : PUT - for me
00000400:00000200:9.0:1773851896.223166:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.223167:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851896.223168:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.118@tcp to cpt 2
00000400:00000200:9.0:1773851896.223169:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 2
00000400:00000200:9.0:1773851896.223170:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 3
00000400:00000200:9.0:1773851896.223171:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.118@tcp to cpt 2
00000400:00000200:9.0:1773851896.223173:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.118@tcp of length 224 into portal 12 MB=0x69a1007e9ac80
00000400:00000200:9.0:1773851896.223174:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.118@tcp of length 224/224 into md 0x78146ce49 [64] + 161032
00000800:00000200:9.0:1773851896.223177:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851896.223179:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851896.223180:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851896.223181:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851896.223181:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851896.223182:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001b6d3396.
00000100:00000040:9.0:1773851896.223183:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000001b6d3396 x1858243503172736 msgsize 224
00000100:00100000:9.0:1773851896.223185:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.118@tcp (source: 12345-172.16.70.118@tcp)
00000100:00000001:9.0:1773851896.223187:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851896.223188:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851896.223188:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
02000000:00000001:11.0:1773851896.223189:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851896.223189:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851896.223190:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851896.223190:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851896.223191:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851896.223192:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858243503172736
00000020:00000001:11.0:1773851896.223193:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851896.223193:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930c2
00000020:00000001:11.0:1773851896.223194:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851896.223198:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000f97fd0b refcount=6
00000020:00000001:11.0:1773851896.223198:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745140224 : -107128964411392 : ffff9e9118219000)
00000020:00000001:11.0:1773851896.223199:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745140224 : -107128964411392 : ffff9e9118219000)
00000100:00000001:11.0:1773851896.223200:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851896.223201:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851896.223202:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089741d53.
00000020:00000010:11.0:1773851896.223203:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851896.223204:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851896.223207:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851896.223208:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851896.223209:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851896.223210:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851896.223210:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851896.223211:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.223211:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851896.223213:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851896.223213:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851896.223213:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851896.223213:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851896.223215:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.118@tcp, seq: 2130870
00000100:00000040:11.0:1773851896.223216:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000f97fd0b : new rpc_count 1
00000100:00000001:8.0:1773851896.223216:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.223217:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609050112 : -107064100501504 : ffff9ea032524800)
00000100:00000001:8.0:1773851896.223217:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851896.223219:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001b6d3396 x1858243503172736/t0(0) o400->5a6e43b0-e804-4dba-a1cb-afef3e141050@172.16.70.118@tcp:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic18-0'
00000100:00000001:11.0:1773851896.223222:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851896.223222:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851896.223223:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b6d3396 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:5a6e43b0-e804-4dba-a1cb-afef3e141050+6:50031:x1858243503172736:12345-172.16.70.118@tcp:400:default-rzslic18-0
00000100:00000200:11.0:1773851896.223226:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858243503172736
00000020:00000001:11.0:1773851896.223227:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851896.223228:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851896.223229:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.223230:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851896.223231:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851896.223232:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851896.223233:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858243503172736, found 0 last_xid 1858243503172735
00000020:00000001:11.0:1773851896.223235:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851896.223236:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851896.223237:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851896.223238:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.223239:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851896.223240:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851896.223241:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851896.223244:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004cdffbe0.
02000000:00000001:11.0:1773851896.223245:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.223246:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.223248:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851896.223249:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 172876330691, transno 0, xid 1858243503172736
00010000:00000001:11.0:1773851896.223250:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851896.223252:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001b6d3396 x1858243503172736/t0(0) o400->5a6e43b0-e804-4dba-a1cb-afef3e141050@172.16.70.118@tcp:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic18-0'
00010000:00000001:11.0:1773851896.223257:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851896.223258:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851896.223259:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=129 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851896.223261:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851896.223263:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a2d014b1 refcount 3 to 172.16.70.118@tcp
00000100:00000001:11.0:1773851896.223264:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918810486368 : -107154899065248 : ffff9e8b0e4e2660)
02000000:00000001:11.0:1773851896.223265:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851896.223266:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.223267:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851896.223269:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.118@tcp
00000400:00000010:11.0:1773851896.223270:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d7cd332.
00000100:00000200:11.0:1773851896.223272:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858243503172736, offset 224
00000400:00000200:11.0:1773851896.223274:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.118@tcp
00000400:00000200:11.0:1773851896.223276:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.118@tcp to cpt 2
00000400:00000200:11.0:1773851896.223278:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 2
00000400:00000200:11.0:1773851896.223280:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 3
00000400:00000200:11.0:1773851896.223282:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 4
00000400:00000200:11.0:1773851896.223284:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.118@tcp routed destination
00000400:00000200:11.0:1773851896.223287:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:11.0:1773851896.223289:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:11.0:1773851896.223291:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.118@tcp: rtr pref emtpy: 1
00000400:00000200:11.0:1773851896.223294:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:11.0:1773851896.223295:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.118@tcp: rtr pref emtpy: 1
00000400:00000200:11.0:1773851896.223297:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:11.0:1773851896.223299:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770216:8770216:1024:4294967295] 17@kfi7 LPNI seq info [1250891923:1250891923:16:4294967295]
00000400:00000200:11.0:1773851896.223305:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:11.0:1773851896.223307:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:11.0:1773851896.223311:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.118@tcp(172.16.70.118@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851896.223314:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000088e819fd nid 172.16.70.118@tcp refs 3
00000800:00000200:11.0:1773851896.223316:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851896.223318:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851896.223323:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851896.223327:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:11.0:1773851896.223333:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:11.0:1773851896.223335:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851896.223339:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851896.223341:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a2d014b1 refcount 2 to 172.16.70.118@tcp
00010000:00000001:11.0:1773851896.223342:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851896.223343:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.223344:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851896.223346:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001b6d3396 x1858243503172736/t0(0) o400->5a6e43b0-e804-4dba-a1cb-afef3e141050@172.16.70.118@tcp:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic18-0'
00000800:00000200:10.0:1773851896.223349:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851896.223351:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851896.223352:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b6d3396 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:5a6e43b0-e804-4dba-a1cb-afef3e141050+6:50031:x1858243503172736:12345-172.16.70.118@tcp:400:default-rzslic18-0 Request processed in 129us (167us total) trans 0 rc 0/0
00000400:00000200:10.0:1773851896.223352:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:10.0:1773851896.223353:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d7cd332
00000400:00000010:10.0:1773851896.223353:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d7cd332.
00000100:00000001:10.0:1773851896.223354:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851896.223355:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851896.223355:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00100000:11.0:1773851896.223357:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.118@tcp, seq: 2130870
00000800:00000200:10.0:1773851896.223357:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000100:00000040:11.0:1773851896.223359:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000f97fd0b : new rpc_count 0
00000100:00000001:11.0:1773851896.223360:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851896.223361:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851896.223362:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851896.223363:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000020:00000010:11.0:1773851896.223366:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089741d53.
00000020:00000040:11.0:1773851896.223367:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000000f97fd0b : new refcount 5
00000100:00000001:11.0:1773851896.223369:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851896.242523:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851896.242524:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851896.242525:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851896.242527:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851896.242529:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20145@kfi7 to cpt 3
00000400:00000200:13.0:1773851896.242530:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20145@kfi7 : PUT - for me
00000400:00000200:13.0:1773851896.242531:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20145@kfi7 to cpt 3
00000400:00000200:13.0:1773851896.242532:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006bc575f nid 20145@kfi7 refs 1
00000400:00000200:13.0:1773851896.242533:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20145@kfi7 to cpt 3
00000400:00000200:13.0:1773851896.242534:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006bc575f nid 20145@kfi7 refs 2
00000400:00000200:13.0:1773851896.242535:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000006bc575f nid 20145@kfi7 refs 3
00000400:00000200:13.0:1773851896.242536:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20080@kfi7 to cpt 5
00000400:00000200:13.0:1773851896.242537:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20080@kfi7 of length 224 into portal 12 MB=0x69b461a068d80
00000400:00000200:13.0:1773851896.242538:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20080@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 57656
00000800:00000200:13.0:1773851896.242539:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851896.242541:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851896.242542:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20145@kfi7: PUT: OK
00000100:00000001:13.0:1773851896.242543:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851896.242543:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851896.242544:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e3259bc.
00000100:00000040:13.0:1773851896.242545:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005e3259bc x1859575246916992 msgsize 224
00000100:00100000:13.0:1773851896.242546:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-20080@kfi7 (source: 12345-20145@kfi7)
00000100:00000001:13.0:1773851896.242547:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851896.242548:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000006bc575f nid 20145@kfi7 refs 2
00000800:00000200:13.0:1773851896.242549:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851896.242550:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851896.242551:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851896.242552:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851896.242553:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851896.242554:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851896.242556:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575246916992
00000020:00000001:15.0:1773851896.242557:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851896.242558:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc2639bd9
00000020:00000001:15.0:1773851896.242559:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851896.242564:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d7d81f7a refcount=5
00000020:00000001:15.0:1773851896.242566:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098714852352 : -106974994699264 : ffff9eb4f170ec00)
00000020:00000001:15.0:1773851896.242567:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098714852352 : -106974994699264 : ffff9eb4f170ec00)
00000100:00000001:15.0:1773851896.242569:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851896.242570:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851896.242571:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000464d983b.
00000020:00000010:15.0:1773851896.242572:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851896.242574:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000250843b2.
00000100:00000001:15.0:1773851896.242575:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851896.242576:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851896.242577:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851896.242578:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851896.242579:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851896.242580:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851896.242581:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851896.242583:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851896.242583:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851896.242583:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851896.242584:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851896.242584:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20080@kfi7, seq: 2289929
00000100:00000040:12.0:1773851896.242585:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d7d81f7a : new rpc_count 1
00000100:00000001:15.0:1773851896.242586:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.242586:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636950415896704 : -107123293654912 : ffff9e926a227080)
00000100:00000001:15.0:1773851896.242587:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851896.242588:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005e3259bc x1859575246916992/t0(0) o400->79fd30c5-62e7-4e88-bd05-f36e90cf0fdb@20080@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1742-0'
00000100:00000001:12.0:1773851896.242591:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851896.242591:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851896.242592:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e3259bc pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:79fd30c5-62e7-4e88-bd05-f36e90cf0fdb+5:39704:x1859575246916992:12345-20080@kfi7:400:default-tuolumne1742-0
00000100:00000200:12.0:1773851896.242593:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575246916992
00000020:00000001:12.0:1773851896.242594:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851896.242594:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851896.242595:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.242596:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851896.242597:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851896.242597:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851896.242598:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575246916992, found 0 last_xid 1859575246916991
00000020:00000001:12.0:1773851896.242599:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851896.242600:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851896.242600:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851896.242601:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.242601:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851896.242602:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851896.242603:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851896.242603:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000557b870b.
02000000:00000001:12.0:1773851896.242604:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.242605:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.242605:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851896.242606:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096687692, transno 0, xid 1859575246916992
00010000:00000001:12.0:1773851896.242607:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851896.242608:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005e3259bc x1859575246916992/t0(0) o400->79fd30c5-62e7-4e88-bd05-f36e90cf0fdb@20080@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1742-0'
00010000:00000001:12.0:1773851896.242610:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851896.242611:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851896.242612:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=129 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851896.242613:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851896.242613:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c30ec711 refcount 3 to 20080@kfi7
00000100:00000001:12.0:1773851896.242614:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108608 : -107156354443008 : ffff9e8ab78ed900)
02000000:00000001:12.0:1773851896.242615:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851896.242616:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.242616:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851896.242617:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20145@kfi7
00000400:00000010:12.0:1773851896.242617:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f4420963.
00000100:00000200:12.0:1773851896.242618:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575246916992, offset 224
00000400:00000200:12.0:1773851896.242620:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20145@kfi7
00000400:00000200:12.0:1773851896.242621:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20145@kfi7 to cpt 3
00000400:00000200:12.0:1773851896.242622:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000006bc575f nid 20145@kfi7 refs 1
00000400:00000200:12.0:1773851896.242623:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000006bc575f nid 20145@kfi7 refs 2
00000400:00000200:12.0:1773851896.242624:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000006bc575f nid 20145@kfi7 refs 3
00000400:00000200:12.0:1773851896.242625:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20145@kfi7 local destination
00000400:00000200:12.0:1773851896.242627:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770217:8770217:1024:4294967295] 20145@kfi7 LPNI seq info [107364:107364:16:4294967295]
00000400:00000200:12.0:1773851896.242628:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000006bc575f nid 20145@kfi7 refs 2
00000400:00000200:12.0:1773851896.242629:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20145@kfi7 to cpt 3
00000400:00000200:12.0:1773851896.242631:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20145@kfi7(20145@kfi7:20145@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851896.242632:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000006bc575f nid 20145@kfi7 refs 3
00000800:00000200:12.0:1773851896.242634:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851896.242635:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851896.242637:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851896.242642:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a35 Using peer 20145@kfi7(0x100000000000a35)
00000800:00000200:12.0:1773851896.242646:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x100000000000a35: rc=0
00000800:00000200:12.0:1773851896.242647:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a35 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851896.242649:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851896.242650:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c30ec711 refcount 2 to 20080@kfi7
00010000:00000001:12.0:1773851896.242650:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851896.242651:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.242651:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851896.242652:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e3259bc x1859575246916992/t0(0) o400->79fd30c5-62e7-4e88-bd05-f36e90cf0fdb@20080@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1742-0'
00000100:00100000:12.0:1773851896.242656:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e3259bc pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:79fd30c5-62e7-4e88-bd05-f36e90cf0fdb+5:39704:x1859575246916992:12345-20080@kfi7:400:default-tuolumne1742-0 Request processed in 65us (111us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851896.242658:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20080@kfi7, seq: 2289929
00000100:00000040:12.0:1773851896.242659:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d7d81f7a : new rpc_count 0
00000100:00000001:12.0:1773851896.242660:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851896.242660:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851896.242661:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:12.0:1773851896.242662:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000250843b2.
00000020:00000010:12.0:1773851896.242663:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000464d983b.
00000020:00000040:12.0:1773851896.242663:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000d7d81f7a : new refcount 4
00000100:00000001:12.0:1773851896.242664:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851896.242670:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a35 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851896.242672:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851896.242673:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20145@kfi7: PUT: OK
00000400:00000200:13.0:1773851896.242674:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f4420963
00000400:00000010:13.0:1773851896.242674:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f4420963.
00000100:00000001:13.0:1773851896.242674:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851896.242675:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851896.242676:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000006bc575f nid 20145@kfi7 refs 2
00000800:00000200:13.0:1773851896.242677:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 20145@kfi7(00000000cc385d8e):0x0 lsk 2614 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a35 Transaction freed
00000800:00000200:25.0:1773851896.262936:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851896.262936:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851896.262938:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851896.262940:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851896.262941:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20528@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.262943:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20528@kfi7 : PUT - for me
00000400:00000200:25.0:1773851896.262943:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20528@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.262944:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8424143 nid 20528@kfi7 refs 1
00000400:00000200:25.0:1773851896.262945:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20528@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.262946:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8424143 nid 20528@kfi7 refs 2
00000400:00000200:25.0:1773851896.262947:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b8424143 nid 20528@kfi7 refs 3
00000400:00000200:25.0:1773851896.262947:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20721@kfi7 to cpt 3
00000400:00000200:25.0:1773851896.262948:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20721@kfi7 of length 224 into portal 12 MB=0x69b2e50089080
00000400:00000200:25.0:1773851896.262949:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20721@kfi7 of length 224/224 into md 0x16159c9699 [64] + 37984
00000800:00000200:25.0:1773851896.262951:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851896.262953:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851896.262953:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20528@kfi7: PUT: OK
00000100:00000001:25.0:1773851896.262954:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851896.262955:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851896.262956:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005d5c8bc4.
00000100:00000040:25.0:1773851896.262957:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000005d5c8bc4 x1859473073803392 msgsize 224
00000100:00100000:25.0:1773851896.262958:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-20721@kfi7 (source: 12345-20528@kfi7)
00000100:00000001:25.0:1773851896.262959:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851896.262960:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8424143 nid 20528@kfi7 refs 2
00000100:00000001:27.0:1773851896.262961:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851896.262961:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851896.262961:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851896.262962:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851896.262962:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851896.262963:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851896.262964:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859473073803392
00000020:00000001:27.0:1773851896.262964:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851896.262965:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c9b8f5225
00000020:00000001:27.0:1773851896.262965:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851896.262967:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000089e1ea8d refcount=5
00000020:00000001:27.0:1773851896.262967:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109682234368 : -106964027317248 : ffff9eb77f25e400)
00000020:00000001:27.0:1773851896.262968:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637109682234368 : -106964027317248 : ffff9eb77f25e400)
00000100:00000001:27.0:1773851896.262969:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.262970:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851896.262971:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bf277de5.
00000020:00000010:27.0:1773851896.262972:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851896.262972:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009d0a58f3.
00000100:00000001:27.0:1773851896.262973:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851896.262974:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851896.262975:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.262975:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851896.262976:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851896.262976:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.262977:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.262978:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851896.262979:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851896.262979:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851896.262979:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851896.262980:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20721@kfi7, seq: 2025177
00000100:00000040:27.0:1773851896.262980:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000089e1ea8d : new rpc_count 1
00000100:00000001:24.0:1773851896.262980:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.262981:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780413056 : -106994929138560 : ffff9eb04d418480)
00000100:00000001:24.0:1773851896.262981:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851896.262982:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005d5c8bc4 x1859473073803392/t0(0) o400->e43129ba-d3d7-4ee4-b527-7c9b5d4009ea@20721@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1773-0'
00000100:00000001:27.0:1773851896.262985:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.262985:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851896.262986:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005d5c8bc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e43129ba-d3d7-4ee4-b527-7c9b5d4009ea+5:39978:x1859473073803392:12345-20721@kfi7:400:default-tuolumne1773-0
00000800:00000200:22.0:1773851896.262986:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000200:27.0:1773851896.262987:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859473073803392
00000800:00000200:22.0:1773851896.262987:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000020:00000001:27.0:1773851896.262988:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851896.262988:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000800:00000200:22.0:1773851896.262988:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:27.0:1773851896.262989:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.262989:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851896.262990:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000800:00000200:22.0:1773851896.262990:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000020:00000001:27.0:1773851896.262991:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851896.262991:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859473073803392, found 0 last_xid 1859473073803391
00000020:00000001:27.0:1773851896.262992:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851896.262992:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000400:00000200:22.0:1773851896.262992:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11569@kfi7 to cpt 5
00000020:00000001:27.0:1773851896.262993:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851896.262993:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851896.262993:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11569@kfi7 : PUT - for me
00000020:00000001:27.0:1773851896.262994:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000400:00000200:22.0:1773851896.262994:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11569@kfi7 to cpt 5
00000100:00000001:27.0:1773851896.262995:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851896.262995:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:22.0:1773851896.262995:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df5c0273 nid 11569@kfi7 refs 1
02000000:00000010:27.0:1773851896.262996:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000330439b1.
02000000:00000001:27.0:1773851896.262996:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851896.262996:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11569@kfi7 to cpt 5
00000100:00000001:27.0:1773851896.262997:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851896.262997:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df5c0273 nid 11569@kfi7 refs 2
00000020:00000001:27.0:1773851896.262998:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:22.0:1773851896.262998:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000df5c0273 nid 11569@kfi7 refs 3
00000400:00000200:22.0:1773851896.262998:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11568@kfi7 to cpt 2
00010000:00000040:27.0:1773851896.262999:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096687307, transno 0, xid 1859473073803392
00010000:00000001:27.0:1773851896.262999:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000400:00000200:22.0:1773851896.262999:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11568@kfi7 of length 224 into portal 12 MB=0x69b2e924cb780
00010000:00000200:27.0:1773851896.263000:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005d5c8bc4 x1859473073803392/t0(0) o400->e43129ba-d3d7-4ee4-b527-7c9b5d4009ea@20721@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1773-0'
00000400:00000200:22.0:1773851896.263001:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11568@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 64568
00000800:00000200:22.0:1773851896.263002:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:27.0:1773851896.263003:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851896.263003:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851896.263004:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=129 v=313 (313 212 1 1)
00000400:00000200:22.0:1773851896.263004:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:27.0:1773851896.263005:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000400:00000200:22.0:1773851896.263005:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11569@kfi7: PUT: OK
00000100:00000040:27.0:1773851896.263006:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000064fa326d refcount 3 to 20721@kfi7
00000100:00000001:27.0:1773851896.263006:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642469952 : -107157067081664 : ffff9e8a8d14d840)
00000100:00000001:22.0:1773851896.263006:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851896.263006:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
02000000:00000001:27.0:1773851896.263007:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000010:22.0:1773851896.263007:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000030614fba.
00000100:00000040:22.0:1773851896.263007:0:2456945:0:(events.c:358:request_in_callback()) incoming req@0000000030614fba x1859474185566080 msgsize 224
02000000:00000001:27.0:1773851896.263008:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.263008:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851896.263009:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20528@kfi7
00000100:00100000:22.0:1773851896.263009:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-11568@kfi7 (source: 12345-11569@kfi7)
00000400:00000010:27.0:1773851896.263010:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e26c5908.
00000100:00000001:22.0:1773851896.263010:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000200:27.0:1773851896.263011:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859473073803392, offset 224
00000400:00000200:22.0:1773851896.263011:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000df5c0273 nid 11569@kfi7 refs 2
00000400:00000200:27.0:1773851896.263012:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20528@kfi7
00000800:00000200:22.0:1773851896.263012:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:27.0:1773851896.263013:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20528@kfi7 to cpt 6
00000100:00000001:20.0:1773851896.263013:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851896.263013:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:27.0:1773851896.263014:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b8424143 nid 20528@kfi7 refs 1
00000100:00000001:20.0:1773851896.263014:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:27.0:1773851896.263015:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b8424143 nid 20528@kfi7 refs 2
00000100:00000001:20.0:1773851896.263015:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851896.263016:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b8424143 nid 20528@kfi7 refs 3
02000000:00000001:20.0:1773851896.263016:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851896.263017:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20528@kfi7 local destination
00000100:00100000:20.0:1773851896.263017:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859474185566080
00000400:00000200:27.0:1773851896.263018:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770218:8770218:1024:4294967295] 20528@kfi7 LPNI seq info [2935263:2935263:16:4294967295]
00000020:00000001:20.0:1773851896.263018:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851896.263019:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ca034c62c
00000400:00000200:27.0:1773851896.263020:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b8424143 nid 20528@kfi7 refs 2
00000400:00000200:27.0:1773851896.263020:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20528@kfi7 to cpt 6
00000020:00000001:20.0:1773851896.263020:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:27.0:1773851896.263022:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20528@kfi7(20528@kfi7:20528@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851896.263023:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b8424143 nid 20528@kfi7 refs 3
00000020:00000040:20.0:1773851896.263024:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f202422c refcount=5
00000800:00000200:27.0:1773851896.263025:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000020:00000001:20.0:1773851896.263025:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132189161472 : -106941520390144 : ffff9ebcbcaa5800)
00000800:00000200:27.0:1773851896.263026:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000020:00000001:20.0:1773851896.263027:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132189161472 : -106941520390144 : ffff9ebcbcaa5800)
00000100:00000001:20.0:1773851896.263028:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000800:00000200:27.0:1773851896.263030:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:20.0:1773851896.263030:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851896.263031:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000010bfdc01.
00000800:00000200:27.0:1773851896.263032:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b5 Using peer 20528@kfi7(0x3b5)
00000020:00000010:20.0:1773851896.263032:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851896.263033:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000252cd187.
00000800:00000200:27.0:1773851896.263035:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006faf1aef: Posted send of 324 bytes to peer 0x3b5: rc=0
00000100:00000001:20.0:1773851896.263035:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000800:00000200:27.0:1773851896.263036:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851896.263036:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851896.263037:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.263038:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.263038:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000040:27.0:1773851896.263039:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000064fa326d refcount 2 to 20721@kfi7
00010000:00000001:27.0:1773851896.263039:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000100:00000001:20.0:1773851896.263039:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000020:00000001:27.0:1773851896.263040:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.263040:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000001:20.0:1773851896.263040:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851896.263041:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005d5c8bc4 x1859473073803392/t0(0) o400->e43129ba-d3d7-4ee4-b527-7c9b5d4009ea@20721@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1773-0'
00000100:00000001:20.0:1773851896.263041:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851896.263043:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851896.263043:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851896.263043:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851896.263043:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851896.263044:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005d5c8bc4 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e43129ba-d3d7-4ee4-b527-7c9b5d4009ea+5:39978:x1859473073803392:12345-20721@kfi7:400:default-tuolumne1773-0 Request processed in 59us (86us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851896.263045:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11568@kfi7, seq: 1998074
00000100:00100000:27.0:1773851896.263046:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20721@kfi7, seq: 2025177
00000100:00000040:23.0:1773851896.263046:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f202422c : new rpc_count 1
00000100:00000001:23.0:1773851896.263046:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382187776 : -106946327363840 : ffff9ebb9e25bf00)
00000100:00000001:20.0:1773851896.263046:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851896.263047:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000089e1ea8d : new rpc_count 0
00000800:00000200:25.0:1773851896.263047:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b5 TN_EVENT_TX_OK event status 0
00000100:00000001:20.0:1773851896.263047:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.263048:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851896.263048:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000040:23.0:1773851896.263048:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000030614fba x1859474185566080/t0(0) o400->3cc35cc4-96a6-4bf8-b801-485f29ae7c00@11568@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1213-0'
00000020:00000010:27.0:1773851896.263049:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000400:00000200:25.0:1773851896.263049:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851896.263050:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009d0a58f3.
00000020:00000010:27.0:1773851896.263050:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bf277de5.
00000400:00000200:25.0:1773851896.263050:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20528@kfi7: PUT: OK
00000020:00000040:27.0:1773851896.263051:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000089e1ea8d : new refcount 4
00000400:00000200:25.0:1773851896.263051:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e26c5908
00000400:00000010:25.0:1773851896.263051:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e26c5908.
00000100:00000001:23.0:1773851896.263051:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.263052:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851896.263052:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851896.263052:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851896.263052:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:25.0:1773851896.263053:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b8424143 nid 20528@kfi7 refs 2
00000100:00100000:23.0:1773851896.263053:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030614fba pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3cc35cc4-96a6-4bf8-b801-485f29ae7c00+5:39672:x1859474185566080:12345-11568@kfi7:400:default-tuolumne1213-0
00000800:00000200:25.0:1773851896.263054:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006faf1aef: 2069@kfi7:6 -> 20528@kfi7(000000004c38af00):0x0 lsk 950 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3b5 Transaction freed
00000100:00000200:23.0:1773851896.263054:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859474185566080
00000020:00000001:23.0:1773851896.263055:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851896.263055:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851896.263056:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.263057:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851896.263057:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851896.263058:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851896.263059:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859474185566080, found 0 last_xid 1859474185566079
00000020:00000001:23.0:1773851896.263060:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851896.263060:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851896.263061:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851896.263062:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.263062:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851896.263063:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851896.263063:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851896.263064:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000219acaf.
02000000:00000001:23.0:1773851896.263065:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.263066:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.263066:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851896.263067:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035353885, transno 0, xid 1859474185566080
00010000:00000001:23.0:1773851896.263068:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851896.263069:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000030614fba x1859474185566080/t0(0) o400->3cc35cc4-96a6-4bf8-b801-485f29ae7c00@11568@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1213-0'
00010000:00000001:23.0:1773851896.263072:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851896.263073:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851896.263073:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=129 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851896.263074:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851896.263075:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000023a38cf6 refcount 3 to 11568@kfi7
00000100:00000001:23.0:1773851896.263076:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551673824 : -107156157877792 : ffff9e8ac34631e0)
02000000:00000001:23.0:1773851896.263078:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851896.263078:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.263079:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851896.263080:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11569@kfi7
00000400:00000010:23.0:1773851896.263080:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000451cdaad.
00000100:00000200:23.0:1773851896.263081:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859474185566080, offset 224
00000400:00000200:23.0:1773851896.263083:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11569@kfi7
00000400:00000200:23.0:1773851896.263084:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11569@kfi7 to cpt 5
00000400:00000200:23.0:1773851896.263085:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000df5c0273 nid 11569@kfi7 refs 1
00000400:00000200:23.0:1773851896.263086:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000df5c0273 nid 11569@kfi7 refs 2
00000400:00000200:23.0:1773851896.263087:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000df5c0273 nid 11569@kfi7 refs 3
00000400:00000200:23.0:1773851896.263089:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11569@kfi7 local destination
00000400:00000200:23.0:1773851896.263090:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770219:8770219:1024:4294967295] 11569@kfi7 LPNI seq info [2779005:2779005:16:4294967295]
00000400:00000200:23.0:1773851896.263091:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000df5c0273 nid 11569@kfi7 refs 2
00000400:00000200:23.0:1773851896.263092:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11569@kfi7 to cpt 5
00000400:00000200:23.0:1773851896.263094:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11569@kfi7(11569@kfi7:11569@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851896.263095:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000df5c0273 nid 11569@kfi7 refs 3
00000800:00000200:23.0:1773851896.263097:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851896.263098:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851896.263101:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851896.263103:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000113a Using peer 11569@kfi7(0x10000000000113a)
00000800:00000200:23.0:1773851896.263107:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x10000000000113a: rc=0
00000800:00000200:23.0:1773851896.263109:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000113a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851896.263111:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851896.263112:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000023a38cf6 refcount 2 to 11568@kfi7
00010000:00000001:23.0:1773851896.263113:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851896.263113:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.263114:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851896.263114:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000030614fba x1859474185566080/t0(0) o400->3cc35cc4-96a6-4bf8-b801-485f29ae7c00@11568@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1213-0'
00000100:00100000:23.0:1773851896.263117:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030614fba pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3cc35cc4-96a6-4bf8-b801-485f29ae7c00+5:39672:x1859474185566080:12345-11568@kfi7:400:default-tuolumne1213-0 Request processed in 65us (109us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851896.263120:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11568@kfi7, seq: 1998074
00000100:00000040:23.0:1773851896.263121:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f202422c : new rpc_count 0
00000800:00000200:21.0:1773851896.263121:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000113a TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851896.263122:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851896.263122:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851896.263123:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000400:00000200:21.0:1773851896.263123:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851896.263124:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000252cd187.
00000020:00000010:23.0:1773851896.263125:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000010bfdc01.
00000400:00000200:21.0:1773851896.263125:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11569@kfi7: PUT: OK
00000400:00000200:21.0:1773851896.263125:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000451cdaad
00000020:00000040:23.0:1773851896.263126:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000f202422c : new refcount 4
00000400:00000010:21.0:1773851896.263126:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000451cdaad.
00000100:00000001:23.0:1773851896.263127:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851896.263127:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851896.263127:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851896.263128:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000df5c0273 nid 11569@kfi7 refs 2
00000800:00000200:21.0:1773851896.263129:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 11569@kfi7(000000007f2ceecc):0x0 lsk 4411 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000113a Transaction freed
00000800:00000200:25.0:1773851896.304009:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851896.304010:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851896.304011:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851896.304013:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851896.304015:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26403@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.304016:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26403@kfi7 : PUT - for me
00000400:00000200:25.0:1773851896.304017:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26403@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.304018:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f824a73 nid 26403@kfi7 refs 1
00000400:00000200:25.0:1773851896.304019:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26403@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.304019:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f824a73 nid 26403@kfi7 refs 2
00000400:00000200:25.0:1773851896.304020:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007f824a73 nid 26403@kfi7 refs 3
00000400:00000200:25.0:1773851896.304021:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26594@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.304022:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26594@kfi7 of length 224 into portal 12 MB=0x69af07833f680
00000400:00000200:25.0:1773851896.304024:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26594@kfi7 of length 224/224 into md 0x16159c9699 [64] + 38208
00000800:00000200:25.0:1773851896.304025:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851896.304027:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851896.304028:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26403@kfi7: PUT: OK
00000100:00000001:25.0:1773851896.304029:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851896.304029:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851896.304030:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dcd9286d.
00000100:00000040:25.0:1773851896.304030:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000dcd9286d x1859207459763840 msgsize 224
00000100:00100000:25.0:1773851896.304032:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26594@kfi7 (source: 12345-26403@kfi7)
00000100:00000001:25.0:1773851896.304033:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:27.0:1773851896.304034:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851896.304034:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007f824a73 nid 26403@kfi7 refs 2
02000000:00000001:27.0:1773851896.304035:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851896.304035:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851896.304035:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2069@kfi7:6 <- 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851896.304036:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851896.304036:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851896.304037:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859207459763840
00000020:00000001:27.0:1773851896.304038:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851896.304038:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91594
00000020:00000001:27.0:1773851896.304039:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851896.304041:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000056a22fbb refcount=8
00000020:00000001:27.0:1773851896.304042:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241025536 : -107152468526080 : ffff9e8b9f2d3c00)
00000020:00000001:27.0:1773851896.304043:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241025536 : -107152468526080 : ffff9e8b9f2d3c00)
00000100:00000001:27.0:1773851896.304044:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.304045:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851896.304045:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bf277de5.
00000020:00000010:27.0:1773851896.304046:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851896.304047:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009d0a58f3.
00000100:00000001:27.0:1773851896.304048:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851896.304048:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851896.304049:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.304050:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851896.304050:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851896.304050:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.304051:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.304052:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851896.304053:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851896.304053:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851896.304053:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851896.304054:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26594@kfi7, seq: 2025178
00000100:00000040:27.0:1773851896.304055:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000056a22fbb : new rpc_count 2
00000100:00000001:27.0:1773851896.304055:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780440704 : -106994929110912 : ffff9eb04d41f080)
00000100:00000001:24.0:1773851896.304055:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.304055:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851896.304056:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dcd9286d x1859207459763840/t0(0) o400->6d42f42e-b76c-4e3f-b11e-73d248fbe8f9@26594@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2139-0'
00000100:00000001:27.0:1773851896.304059:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.304059:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851896.304060:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dcd9286d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6d42f42e-b76c-4e3f-b11e-73d248fbe8f9+8:39690:x1859207459763840:12345-26594@kfi7:400:default-tuolumne2139-0
00000100:00000200:27.0:1773851896.304061:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859207459763840
00000020:00000001:27.0:1773851896.304062:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851896.304062:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851896.304063:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.304066:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851896.304067:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851896.304067:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851896.304068:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859207459763840, found 0 last_xid 1859207458789183
00000020:00000001:27.0:1773851896.304069:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851896.304069:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851896.304070:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851896.304070:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.304071:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851896.304071:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851896.304072:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851896.304074:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000460c6d8e.
02000000:00000001:27.0:1773851896.304074:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.304075:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.304075:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851896.304076:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264557371, transno 0, xid 1859207459763840
00010000:00000001:27.0:1773851896.304077:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851896.304078:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dcd9286d x1859207459763840/t0(0) o400->6d42f42e-b76c-4e3f-b11e-73d248fbe8f9@26594@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2139-0'
00010000:00000001:27.0:1773851896.304080:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851896.304081:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851896.304081:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=129 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851896.304082:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851896.304083:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008956bf9b refcount 3 to 26594@kfi7
00000100:00000001:27.0:1773851896.304084:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739680 : -107139395811936 : ffff9e8eaa5f05a0)
02000000:00000001:27.0:1773851896.304084:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851896.304085:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.304085:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851896.304086:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26403@kfi7
00000400:00000010:27.0:1773851896.304087:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f075750.
00000100:00000200:27.0:1773851896.304087:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859207459763840, offset 224
00000400:00000200:27.0:1773851896.304088:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26403@kfi7
00000400:00000200:27.0:1773851896.304089:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26403@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.304090:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f824a73 nid 26403@kfi7 refs 1
00000400:00000200:27.0:1773851896.304091:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007f824a73 nid 26403@kfi7 refs 2
00000400:00000200:27.0:1773851896.304092:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007f824a73 nid 26403@kfi7 refs 3
00000400:00000200:27.0:1773851896.304093:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26403@kfi7 local destination
00000400:00000200:27.0:1773851896.304095:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770220:8770220:1024:4294967295] 26403@kfi7 LPNI seq info [16133318:16133318:16:4294967295]
00000400:00000200:27.0:1773851896.304096:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007f824a73 nid 26403@kfi7 refs 2
00000400:00000200:27.0:1773851896.304097:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26403@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.304099:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26403@kfi7(26403@kfi7:26403@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851896.304100:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007f824a73 nid 26403@kfi7 refs 3
00000800:00000200:27.0:1773851896.304101:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851896.304102:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851896.304105:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851896.304107:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b6 Using peer 26403@kfi7(0x6b6)
00000800:00000200:27.0:1773851896.304109:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000002f3c3f5d: Posted send of 324 bytes to peer 0x6b6: rc=0
00000800:00000200:27.0:1773851896.304111:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851896.304112:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851896.304113:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008956bf9b refcount 2 to 26594@kfi7
00010000:00000001:27.0:1773851896.304114:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851896.304114:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.304115:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851896.304115:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dcd9286d x1859207459763840/t0(0) o400->6d42f42e-b76c-4e3f-b11e-73d248fbe8f9@26594@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2139-0'
00000100:00100000:27.0:1773851896.304118:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dcd9286d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6d42f42e-b76c-4e3f-b11e-73d248fbe8f9+8:39690:x1859207459763840:12345-26594@kfi7:400:default-tuolumne2139-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851896.304120:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26594@kfi7, seq: 2025178
00000100:00000040:27.0:1773851896.304121:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000056a22fbb : new rpc_count 1
00000100:00000001:27.0:1773851896.304121:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851896.304123:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851896.304123:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000800:00000200:25.0:1773851896.304123:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b6 TN_EVENT_TX_OK event status 0
00000020:00000010:27.0:1773851896.304124:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009d0a58f3.
00000020:00000010:27.0:1773851896.304124:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bf277de5.
00000400:00000200:25.0:1773851896.304124:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:27.0:1773851896.304125:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000056a22fbb : new refcount 7
00000400:00000200:25.0:1773851896.304125:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26403@kfi7: PUT: OK
00000100:00000001:27.0:1773851896.304126:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851896.304126:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f075750
00000400:00000010:25.0:1773851896.304126:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f075750.
00000100:00000001:25.0:1773851896.304127:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851896.304127:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851896.304128:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007f824a73 nid 26403@kfi7 refs 2
00000800:00000200:25.0:1773851896.304129:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002f3c3f5d: 2069@kfi7:6 -> 26403@kfi7(00000000462a5de9):0x0 lsk 1719 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x6b6 Transaction freed
00000800:00000200:25.0:1773851896.339959:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851896.339960:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851896.339962:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:25.0:1773851896.339965:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19329@kfi7(0000000011a297bb):0xc61 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851896.339967:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 Using peer 19329@kfi7(0x100000000000c61)
00000400:00000200:25.0:1773851896.339975:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19329@kfi7 to cpt 6
00000800:00000200:25.0:1773851896.339977:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000878f9def: Posted send of 38 bytes to peer 0x100000000000c61: rc=0
00000800:00000200:25.0:1773851896.339980:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:25.0:1773851896.339994:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 TN_EVENT_TX_OK event status 0
00000800:00000200:25.0:1773851896.339997:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 Transaction freed
00000800:00000200:25.0:1773851896.340015:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851896.340016:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851896.340017:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851896.340021:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851896.340023:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19329@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.340025:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19329@kfi7 : PUT - for me
00000400:00000200:25.0:1773851896.340026:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19329@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.340027:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000844eee14 nid 19329@kfi7 refs 1
00000400:00000200:25.0:1773851896.340029:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19329@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.340030:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000844eee14 nid 19329@kfi7 refs 2
00000400:00000200:25.0:1773851896.340032:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000844eee14 nid 19329@kfi7 refs 3
00000400:00000200:25.0:1773851896.340033:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19265@kfi7 to cpt 2
00000400:00000200:25.0:1773851896.340034:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19265@kfi7 of length 224 into portal 12 MB=0x69b2e3cee5ec0
00000400:00000200:25.0:1773851896.340036:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19265@kfi7 of length 224/224 into md 0x16159c9699 [64] + 38432
00000800:00000200:25.0:1773851896.340039:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851896.340041:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851896.340042:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19329@kfi7: PUT: OK
00000100:00000001:25.0:1773851896.340044:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851896.340045:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851896.340046:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001567e80d.
00000100:00000040:25.0:1773851896.340047:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000001567e80d x1859472753319616 msgsize 224
00000100:00100000:25.0:1773851896.340049:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-19265@kfi7 (source: 12345-19329@kfi7)
00000100:00000001:25.0:1773851896.340051:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851896.340052:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000844eee14 nid 19329@kfi7 refs 2
00000100:00000001:27.0:1773851896.340053:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851896.340054:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851896.340054:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851896.340054:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851896.340055:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851896.340056:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851896.340057:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859472753319616
00000020:00000001:27.0:1773851896.340058:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851896.340058:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c9b8f12f4
00000020:00000001:27.0:1773851896.340059:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851896.340063:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000734708de refcount=5
00000020:00000001:27.0:1773851896.340064:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137657900032 : -106936051651584 : ffff9ebe02a0ac00)
00000020:00000001:27.0:1773851896.340065:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637137657900032 : -106936051651584 : ffff9ebe02a0ac00)
00000100:00000001:27.0:1773851896.340066:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.340067:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851896.340068:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bf277de5.
00000020:00000010:27.0:1773851896.340069:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851896.340070:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009d0a58f3.
00000100:00000001:27.0:1773851896.340071:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851896.340072:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851896.340072:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.340073:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851896.340074:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851896.340075:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.340076:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.340078:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851896.340078:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851896.340078:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851896.340079:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851896.340080:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19265@kfi7, seq: 2025179
00000100:00000040:27.0:1773851896.340081:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000734708de : new rpc_count 1
00000100:00000001:24.0:1773851896.340081:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.340082:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780433792 : -106994929117824 : ffff9eb04d41d580)
00000100:00000001:24.0:1773851896.340082:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851896.340084:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001567e80d x1859472753319616/t0(0) o400->6b87bff6-446b-47f4-a82f-4568da6ffd55@19265@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1700-0'
00000100:00000001:27.0:1773851896.340088:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.340089:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851896.340090:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001567e80d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6b87bff6-446b-47f4-a82f-4568da6ffd55+5:40001:x1859472753319616:12345-19265@kfi7:400:default-tuolumne1700-0
00000100:00000200:27.0:1773851896.340092:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859472753319616
00000020:00000001:27.0:1773851896.340093:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851896.340094:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851896.340095:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.340096:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851896.340096:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851896.340097:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851896.340098:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859472753319616, found 0 last_xid 1859472753319615
00000020:00000001:27.0:1773851896.340099:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851896.340100:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851896.340101:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851896.340101:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.340102:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851896.340103:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851896.340103:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851896.340105:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000095d7cea0.
02000000:00000001:27.0:1773851896.340106:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.340107:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.340108:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851896.340108:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096695342, transno 0, xid 1859472753319616
00010000:00000001:27.0:1773851896.340109:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851896.340111:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001567e80d x1859472753319616/t0(0) o400->6b87bff6-446b-47f4-a82f-4568da6ffd55@19265@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1700-0'
00010000:00000001:27.0:1773851896.340114:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851896.340115:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851896.340116:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=129 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851896.340118:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851896.340119:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006cc4066c refcount 3 to 19265@kfi7
00000100:00000001:27.0:1773851896.340120:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551673632 : -107156157877984 : ffff9e8ac3463120)
02000000:00000001:27.0:1773851896.340121:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851896.340122:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.340123:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851896.340124:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19329@kfi7
00000400:00000010:27.0:1773851896.340124:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009801fd0c.
00000100:00000200:27.0:1773851896.340126:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859472753319616, offset 224
00000400:00000200:27.0:1773851896.340127:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19329@kfi7
00000400:00000200:27.0:1773851896.340129:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19329@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.340130:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000844eee14 nid 19329@kfi7 refs 1
00000400:00000200:27.0:1773851896.340131:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000844eee14 nid 19329@kfi7 refs 2
00000400:00000200:27.0:1773851896.340133:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000844eee14 nid 19329@kfi7 refs 3
00000400:00000200:27.0:1773851896.340135:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19329@kfi7 local destination
00000400:00000200:27.0:1773851896.340137:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770221:8770221:1024:4294967295] 19329@kfi7 LPNI seq info [419286:419286:16:4294967295]
00000400:00000200:27.0:1773851896.340139:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000844eee14 nid 19329@kfi7 refs 2
00000400:00000200:27.0:1773851896.340140:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19329@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.340143:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19329@kfi7(19329@kfi7:19329@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851896.340145:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000844eee14 nid 19329@kfi7 refs 3
00000800:00000200:27.0:1773851896.340147:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851896.340149:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851896.340152:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851896.340156:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 Using peer 19329@kfi7(0x100000000000c61)
00000800:00000200:27.0:1773851896.340160:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006f13f276: Posted send of 324 bytes to peer 0x100000000000c61: rc=0
00000800:00000200:27.0:1773851896.340162:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851896.340165:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851896.340167:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006cc4066c refcount 2 to 19265@kfi7
00010000:00000001:27.0:1773851896.340168:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851896.340169:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851896.340170:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851896.340171:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001567e80d x1859472753319616/t0(0) o400->6b87bff6-446b-47f4-a82f-4568da6ffd55@19265@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1700-0'
00000100:00100000:27.0:1773851896.340175:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001567e80d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:6b87bff6-446b-47f4-a82f-4568da6ffd55+5:40001:x1859472753319616:12345-19265@kfi7:400:default-tuolumne1700-0 Request processed in 86us (127us total) trans 0 rc 0/0
00000800:00000200:25.0:1773851896.340176:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851896.340178:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19265@kfi7, seq: 2025179
00000400:00000200:25.0:1773851896.340178:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:27.0:1773851896.340179:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000734708de : new rpc_count 0
00000400:00000200:25.0:1773851896.340180:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19329@kfi7: PUT: OK
00000100:00000001:27.0:1773851896.340181:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851896.340181:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851896.340181:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009801fd0c
00000400:00000010:25.0:1773851896.340181:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009801fd0c.
00000020:00000010:27.0:1773851896.340182:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000100:00000001:25.0:1773851896.340182:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:27.0:1773851896.340183:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009d0a58f3.
00000100:00000001:25.0:1773851896.340183:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:27.0:1773851896.340184:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bf277de5.
00000400:00000200:25.0:1773851896.340184:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000844eee14 nid 19329@kfi7 refs 2
00000020:00000040:27.0:1773851896.340185:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000734708de : new refcount 4
00000100:00000001:27.0:1773851896.340186:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851896.340186:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006f13f276: 2054@kfi7:6 -> 19329@kfi7(0000000011a297bb):0x0 lsk 3170 rsk 30 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000c61 Transaction freed
00000800:00000200:6.0:1773851896.507496:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851896.507496:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851896.507497:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851896.507497:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851896.507499:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851896.507499:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851896.507501:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851896.507501:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 11345@kfi7(0000000070914713):0x52e version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851896.507502:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e Using peer 11345@kfi7(0x52e)
00000400:00000200:6.0:1773851896.507503:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11345@kfi7 to cpt 1
00000400:00000200:6.0:1773851896.507504:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11345@kfi7 : PUT - for me
00000400:00000200:5.0:1773851896.507504:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11345@kfi7 to cpt 1
00000400:00000200:6.0:1773851896.507505:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11345@kfi7 to cpt 1
00000400:00000200:6.0:1773851896.507506:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007926bef2 nid 11345@kfi7 refs 1
00000800:00000200:5.0:1773851896.507506:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 38 bytes to peer 0x52e: rc=0
00000400:00000200:6.0:1773851896.507507:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11345@kfi7 to cpt 1
00000400:00000200:6.0:1773851896.507508:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007926bef2 nid 11345@kfi7 refs 2
00000800:00000200:5.0:1773851896.507508:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851896.507509:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007926bef2 nid 11345@kfi7 refs 3
00000400:00000200:6.0:1773851896.507510:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11345@kfi7 to cpt 1
00000400:00000200:6.0:1773851896.507511:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11345@kfi7 of length 224 into portal 12 MB=0x69b472ecf26c0
00000400:00000200:6.0:1773851896.507513:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11345@kfi7 of length 224/224 into md 0x793926dc5 [64] + 163968
00000800:00000200:6.0:1773851896.507515:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851896.507517:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851896.507518:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11345@kfi7: PUT: OK
00000100:00000001:6.0:1773851896.507519:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851896.507519:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851896.507520:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009f3d6eb1.
00000800:00000200:5.0:1773851896.507520:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e TN_EVENT_TX_OK event status 0
00000100:00000040:6.0:1773851896.507521:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000009f3d6eb1 x1859579890575040 msgsize 224
00000800:00000200:5.0:1773851896.507522:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e Transaction freed
00000100:00100000:6.0:1773851896.507523:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-11345@kfi7 (source: 12345-11345@kfi7)
00000100:00000001:6.0:1773851896.507524:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851896.507525:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007926bef2 nid 11345@kfi7 refs 2
00000100:00000001:4.0:1773851896.507525:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:6.0:1773851896.507526:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851896.507526:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851896.507526:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851896.507527:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851896.507528:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851896.507529:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859579890575040
00000020:00000001:4.0:1773851896.507529:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851896.507530:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f2848
00000020:00000001:4.0:1773851896.507530:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851896.507532:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a969307b refcount=5
00000020:00000001:4.0:1773851896.507533:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092386539520 : -106981323012096 : ffff9eb3783e8800)
00000020:00000001:4.0:1773851896.507534:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637092386539520 : -106981323012096 : ffff9eb3783e8800)
00000100:00000001:4.0:1773851896.507535:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851896.507536:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851896.507536:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851896.507537:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851896.507538:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000031fbcfde.
00000100:00000001:4.0:1773851896.507539:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851896.507540:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851896.507540:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851896.507541:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851896.507542:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851896.507542:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851896.507543:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.507544:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851896.507544:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851896.507545:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851896.507545:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851896.507546:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11345@kfi7, seq: 2001993
00000100:00000040:7.0:1773851896.507547:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a969307b : new rpc_count 1
00000100:00000001:4.0:1773851896.507547:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.507548:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637025359424512 : -107048350127104 : ffff9ea3dd1dec00)
00000100:00000001:4.0:1773851896.507548:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.507549:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009f3d6eb1 x1859579890575040/t0(0) o400->30371c13-cdd3-4f29-b791-2f8d9706d240@11345@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1202-0'
00000100:00000001:7.0:1773851896.507552:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851896.507553:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851896.507554:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009f3d6eb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:30371c13-cdd3-4f29-b791-2f8d9706d240+5:39720:x1859579890575040:12345-11345@kfi7:400:default-tuolumne1202-0
00000100:00000200:7.0:1773851896.507555:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859579890575040
00000020:00000001:7.0:1773851896.507556:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851896.507557:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851896.507558:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.507558:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851896.507559:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851896.507560:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851896.507560:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859579890575040, found 0 last_xid 1859579890575039
00000020:00000001:7.0:1773851896.507561:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851896.507562:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851896.507562:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851896.507563:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.507564:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851896.507564:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851896.507565:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851896.507566:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004638b300.
02000000:00000001:7.0:1773851896.507566:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.507567:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.507568:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851896.507569:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254359120, transno 0, xid 1859579890575040
00010000:00000001:7.0:1773851896.507569:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851896.507570:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009f3d6eb1 x1859579890575040/t0(0) o400->30371c13-cdd3-4f29-b791-2f8d9706d240@11345@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1202-0'
00010000:00000001:7.0:1773851896.507573:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851896.507574:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851896.507574:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=128 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851896.507576:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851896.507577:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003ddcff4c refcount 3 to 11345@kfi7
00000100:00000001:7.0:1773851896.507578:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704512 : -107156155847104 : ffff9e8ac3652e40)
02000000:00000001:7.0:1773851896.507578:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851896.507579:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.507580:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851896.507581:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11345@kfi7
00000400:00000010:7.0:1773851896.507581:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ee237ee.
00000100:00000200:7.0:1773851896.507582:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859579890575040, offset 224
00000400:00000200:7.0:1773851896.507584:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11345@kfi7
00000400:00000200:7.0:1773851896.507584:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11345@kfi7 to cpt 1
00000400:00000200:7.0:1773851896.507585:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007926bef2 nid 11345@kfi7 refs 1
00000400:00000200:7.0:1773851896.507586:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007926bef2 nid 11345@kfi7 refs 2
00000400:00000200:7.0:1773851896.507587:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007926bef2 nid 11345@kfi7 refs 3
00000400:00000200:7.0:1773851896.507588:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11345@kfi7 local destination
00000400:00000200:7.0:1773851896.507590:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770222:8770222:1024:4294967295] 11345@kfi7 LPNI seq info [426370:426370:16:4294967295]
00000400:00000200:7.0:1773851896.507591:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007926bef2 nid 11345@kfi7 refs 2
00000400:00000200:7.0:1773851896.507592:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11345@kfi7 to cpt 1
00000400:00000200:7.0:1773851896.507594:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11345@kfi7(11345@kfi7:11345@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851896.507595:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007926bef2 nid 11345@kfi7 refs 3
00000800:00000200:7.0:1773851896.507596:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851896.507597:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851896.507600:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851896.507602:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e Using peer 11345@kfi7(0x52e)
00000800:00000200:7.0:1773851896.507605:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x52e: rc=0
00000800:00000200:7.0:1773851896.507606:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851896.507608:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.507610:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003ddcff4c refcount 2 to 11345@kfi7
00010000:00000001:7.0:1773851896.507610:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851896.507611:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.507612:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851896.507612:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009f3d6eb1 x1859579890575040/t0(0) o400->30371c13-cdd3-4f29-b791-2f8d9706d240@11345@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1202-0'
00000100:00100000:7.0:1773851896.507615:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009f3d6eb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:30371c13-cdd3-4f29-b791-2f8d9706d240+5:39720:x1859579890575040:12345-11345@kfi7:400:default-tuolumne1202-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851896.507617:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851896.507618:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11345@kfi7, seq: 2001993
00000100:00000040:7.0:1773851896.507619:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a969307b : new rpc_count 0
00000400:00000200:5.0:1773851896.507619:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851896.507620:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851896.507620:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851896.507620:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11345@kfi7: PUT: OK
00000020:00000010:7.0:1773851896.507621:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000400:00000200:5.0:1773851896.507621:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ee237ee
00000400:00000010:5.0:1773851896.507621:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ee237ee.
00000020:00000010:7.0:1773851896.507622:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000031fbcfde.
00000100:00000001:5.0:1773851896.507622:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851896.507622:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851896.507623:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000400:00000200:5.0:1773851896.507623:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007926bef2 nid 11345@kfi7 refs 2
00000020:00000040:7.0:1773851896.507624:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000a969307b : new refcount 4
00000100:00000001:7.0:1773851896.507625:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851896.507625:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 11345@kfi7(0000000070914713):0x0 lsk 1327 rsk 41 tsk 0 trmk 0 tmk 0 trr 1 tta 0x52e Transaction freed
00000800:00000200:5.0:1773851896.527164:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851896.527165:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851896.527166:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851896.527168:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851896.527170:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:5.0:1773851896.527171:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20435@kfi7 : PUT - for me
00000400:00000200:5.0:1773851896.527172:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:5.0:1773851896.527173:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 1
00000400:00000200:5.0:1773851896.527174:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:5.0:1773851896.527175:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000400:00000200:5.0:1773851896.527175:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 3
00000400:00000200:5.0:1773851896.527176:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:5.0:1773851896.527177:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20435@kfi7 of length 224 into portal 12 MB=0x69b0955aecf80
00000400:00000200:5.0:1773851896.527178:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20435@kfi7 of length 224/224 into md 0x793926dc5 [64] + 164192
00000800:00000200:5.0:1773851896.527181:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851896.527182:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851896.527183:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20435@kfi7: PUT: OK
00000100:00000001:5.0:1773851896.527184:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851896.527184:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851896.527185:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000539876ee.
00000100:00000040:5.0:1773851896.527186:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000539876ee x1859314254794624 msgsize 224
00000100:00100000:5.0:1773851896.527187:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20435@kfi7 (source: 12345-20435@kfi7)
00000100:00000001:5.0:1773851896.527188:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851896.527188:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000100:00000001:7.0:1773851896.527189:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851896.527190:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851896.527190:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851896.527191:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851896.527191:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851896.527192:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851896.527193:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314254794624
00000020:00000001:7.0:1773851896.527193:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851896.527194:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e39
00000020:00000001:7.0:1773851896.527194:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851896.527196:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003464aa03 refcount=6
00000020:00000001:7.0:1773851896.527197:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239639040 : -107152469912576 : ffff9e8b9f181400)
00000020:00000001:7.0:1773851896.527198:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239639040 : -107152469912576 : ffff9e8b9f181400)
00000100:00000001:7.0:1773851896.527199:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851896.527199:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851896.527200:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000baa61ed4.
00000020:00000010:7.0:1773851896.527201:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851896.527201:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851896.527202:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851896.527203:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851896.527203:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.527204:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851896.527204:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851896.527205:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.527206:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.527207:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851896.527207:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851896.527208:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20435@kfi7, seq: 2001994
00000100:00000001:4.0:1773851896.527208:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851896.527208:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851896.527209:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003464aa03 : new rpc_count 1
00000100:00000001:4.0:1773851896.527209:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.527210:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114931848192 : -106958777703424 : ffff9eb8b80ca400)
00000100:00000001:4.0:1773851896.527210:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.527211:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000539876ee x1859314254794624/t0(0) o400->950cd539-4e2c-457c-af8b-f72ffec61418@20435@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1765-0'
00000100:00000001:7.0:1773851896.527213:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851896.527214:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851896.527215:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000539876ee pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:950cd539-4e2c-457c-af8b-f72ffec61418+6:39818:x1859314254794624:12345-20435@kfi7:400:default-tuolumne1765-0
00000100:00000200:7.0:1773851896.527216:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314254794624
00000020:00000001:7.0:1773851896.527216:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851896.527217:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851896.527217:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.527218:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851896.527218:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851896.527219:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851896.527219:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314254794624, found 0 last_xid 1859314254794623
00000020:00000001:7.0:1773851896.527220:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851896.527220:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851896.527221:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851896.527221:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.527222:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851896.527222:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851896.527223:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851896.527224:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000df30d7c3.
02000000:00000001:7.0:1773851896.527224:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.527225:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.527225:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851896.527226:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859314254794624
00010000:00000001:7.0:1773851896.527226:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851896.527227:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000539876ee x1859314254794624/t0(0) o400->950cd539-4e2c-457c-af8b-f72ffec61418@20435@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1765-0'
00010000:00000001:7.0:1773851896.527229:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851896.527230:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851896.527230:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=128 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851896.527231:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851896.527232:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036b0aefc refcount 5 to 20435@kfi7
00000100:00000001:7.0:1773851896.527232:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931325663680 : -107142383887936 : ffff9e8df84499c0)
02000000:00000001:7.0:1773851896.527233:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851896.527233:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.527234:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851896.527235:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20435@kfi7
00000400:00000010:7.0:1773851896.527235:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9d794ea.
00000100:00000200:7.0:1773851896.527236:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314254794624, offset 224
00000400:00000200:7.0:1773851896.527237:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20435@kfi7
00000400:00000200:7.0:1773851896.527238:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:7.0:1773851896.527239:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 1
00000400:00000200:7.0:1773851896.527240:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000400:00000200:7.0:1773851896.527241:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 3
00000400:00000200:7.0:1773851896.527242:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20435@kfi7 local destination
00000400:00000200:7.0:1773851896.527243:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770223:8770223:1024:4294967295] 20435@kfi7 LPNI seq info [133134:133134:16:4294967295]
00000400:00000200:7.0:1773851896.527244:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000400:00000200:7.0:1773851896.527245:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20435@kfi7 to cpt 1
00000400:00000200:7.0:1773851896.527247:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20435@kfi7(20435@kfi7:20435@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851896.527248:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 3
00000800:00000200:7.0:1773851896.527249:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851896.527250:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851896.527252:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851896.527254:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006c0 Using peer 20435@kfi7(0x1000000000006c0)
00000800:00000200:7.0:1773851896.527258:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x1000000000006c0: rc=0
00000800:00000200:7.0:1773851896.527259:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006c0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851896.527261:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.527261:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036b0aefc refcount 4 to 20435@kfi7
00010000:00000001:7.0:1773851896.527262:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851896.527262:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.527263:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851896.527263:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000539876ee x1859314254794624/t0(0) o400->950cd539-4e2c-457c-af8b-f72ffec61418@20435@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1765-0'
00000100:00100000:7.0:1773851896.527266:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000539876ee pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:950cd539-4e2c-457c-af8b-f72ffec61418+6:39818:x1859314254794624:12345-20435@kfi7:400:default-tuolumne1765-0 Request processed in 52us (79us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851896.527268:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20435@kfi7, seq: 2001994
00000100:00000040:7.0:1773851896.527268:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003464aa03 : new rpc_count 0
00000100:00000001:7.0:1773851896.527269:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851896.527269:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851896.527270:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851896.527271:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000020:00000010:7.0:1773851896.527271:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000baa61ed4.
00000800:00000200:5.0:1773851896.527271:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006c0 TN_EVENT_TX_OK event status 0
00000020:00000040:7.0:1773851896.527272:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000003464aa03 : new refcount 5
00000100:00000001:7.0:1773851896.527272:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851896.527273:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851896.527274:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20435@kfi7: PUT: OK
00000400:00000200:5.0:1773851896.527275:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9d794ea
00000400:00000010:5.0:1773851896.527275:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9d794ea.
00000100:00000001:5.0:1773851896.527276:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851896.527276:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851896.527277:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004be370c4 nid 20435@kfi7 refs 2
00000800:00000200:5.0:1773851896.527278:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 20435@kfi7(000000006c2a74f1):0x0 lsk 1729 rsk 53 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006c0 Transaction freed
00000800:00000200:18.0:1773851896.543018:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851896.543019:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851896.543021:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851896.543023:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851896.543024:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:18.0:1773851896.543026:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12786@kfi7 : PUT - for me
00000400:00000200:18.0:1773851896.543026:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:18.0:1773851896.543028:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 1
00000400:00000200:18.0:1773851896.543029:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:18.0:1773851896.543029:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000400:00000200:18.0:1773851896.543030:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 3
00000400:00000200:18.0:1773851896.543031:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:18.0:1773851896.543032:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12786@kfi7 of length 224 into portal 12 MB=0x69b4b8106c3c0
00000400:00000200:18.0:1773851896.543033:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12786@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 44784
00000800:00000200:18.0:1773851896.543035:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851896.543036:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851896.543037:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12786@kfi7: PUT: OK
00000100:00000001:18.0:1773851896.543038:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851896.543038:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851896.543039:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3058eb1.
00000100:00000040:18.0:1773851896.543040:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000e3058eb1 x1859598449820608 msgsize 224
00000100:00100000:18.0:1773851896.543041:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-12786@kfi7 (source: 12345-12786@kfi7)
00000100:00000001:18.0:1773851896.543042:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851896.543043:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:18.0:1773851896.543043:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
02000000:00000001:19.0:1773851896.543044:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851896.543044:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:18.0:1773851896.543044:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851896.543045:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851896.543046:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851896.543046:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598449820608
00000020:00000001:19.0:1773851896.543047:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851896.543047:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e245ddf4c
00000020:00000001:19.0:1773851896.543048:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851896.543050:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005b803923 refcount=5
00000020:00000001:19.0:1773851896.543051:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132524703744 : -106941184847872 : ffff9ebcd0aa5000)
00000020:00000001:19.0:1773851896.543051:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132524703744 : -106941184847872 : ffff9ebcd0aa5000)
00000100:00000001:19.0:1773851896.543052:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851896.543053:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851896.543054:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851896.543055:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851896.543056:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c89cf037.
00000100:00000001:19.0:1773851896.543057:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851896.543057:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851896.543058:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851896.543059:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851896.543059:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851896.543060:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.543061:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851896.543062:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851896.543062:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851896.543062:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851896.543063:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851896.543064:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12786@kfi7, seq: 2156424
00000100:00000040:19.0:1773851896.543064:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005b803923 : new rpc_count 1
00000100:00000001:16.0:1773851896.543064:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.543065:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609978112 : -107015099573504 : ffff9eab9b011b00)
00000100:00000001:16.0:1773851896.543065:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851896.543066:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3058eb1 x1859598449820608/t0(0) o400->ca7d03a7-fc3b-410a-94b6-a537f5113cc8@12786@kfi7:148/0 lens 224/0 e 0 to 0 dl 1773852263 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1273-0'
00000100:00000001:19.0:1773851896.543069:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851896.543069:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851896.543071:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3058eb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ca7d03a7-fc3b-410a-94b6-a537f5113cc8+5:39676:x1859598449820608:12345-12786@kfi7:400:default-tuolumne1273-0
00000100:00000200:19.0:1773851896.543072:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598449820608
00000020:00000001:19.0:1773851896.543073:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851896.543073:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851896.543074:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.543075:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851896.543075:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851896.543076:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851896.543077:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598449820608, found 0 last_xid 1859598449820607
00000020:00000001:19.0:1773851896.543077:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851896.543078:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851896.543079:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851896.543079:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.543080:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851896.543080:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851896.543081:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851896.543082:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000799785d1.
02000000:00000001:19.0:1773851896.543082:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.543083:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.543083:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851896.543084:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691627, transno 0, xid 1859598449820608
00010000:00000001:19.0:1773851896.543085:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851896.543086:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3058eb1 x1859598449820608/t0(0) o400->ca7d03a7-fc3b-410a-94b6-a537f5113cc8@12786@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1273-0'
00010000:00000001:19.0:1773851896.543088:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851896.543089:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851896.543089:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=129 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851896.543090:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851896.543091:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dbe767d4 refcount 3 to 12786@kfi7
00000100:00000001:19.0:1773851896.543092:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547200 : -107156126004416 : ffff9e8ac52c8b40)
02000000:00000001:19.0:1773851896.543093:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851896.543093:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.543094:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851896.543095:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12786@kfi7
00000400:00000010:19.0:1773851896.543096:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a8e16822.
00000100:00000200:19.0:1773851896.543097:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598449820608, offset 224
00000400:00000200:19.0:1773851896.543098:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12786@kfi7
00000400:00000200:19.0:1773851896.543099:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:19.0:1773851896.543099:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 1
00000400:00000200:19.0:1773851896.543100:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000400:00000200:19.0:1773851896.543102:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 3
00000400:00000200:19.0:1773851896.543103:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12786@kfi7 local destination
00000400:00000200:19.0:1773851896.543104:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770224:8770224:1024:4294967295] 12786@kfi7 LPNI seq info [8011871:8011871:16:4294967295]
00000400:00000200:19.0:1773851896.543106:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000400:00000200:19.0:1773851896.543106:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12786@kfi7 to cpt 4
00000400:00000200:19.0:1773851896.543108:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12786@kfi7(12786@kfi7:12786@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851896.543110:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 3
00000800:00000200:19.0:1773851896.543111:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851896.543112:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851896.543114:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851896.543116:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x566 Using peer 12786@kfi7(0x566)
00000800:00000200:19.0:1773851896.543119:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x566: rc=0
00000800:00000200:19.0:1773851896.543120:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x566 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851896.543122:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851896.543123:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dbe767d4 refcount 2 to 12786@kfi7
00010000:00000001:19.0:1773851896.543124:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851896.543124:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.543125:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851896.543126:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3058eb1 x1859598449820608/t0(0) o400->ca7d03a7-fc3b-410a-94b6-a537f5113cc8@12786@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1273-0'
00000100:00100000:19.0:1773851896.543129:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3058eb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ca7d03a7-fc3b-410a-94b6-a537f5113cc8+5:39676:x1859598449820608:12345-12786@kfi7:400:default-tuolumne1273-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851896.543132:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12786@kfi7, seq: 2156424
00000100:00000040:19.0:1773851896.543132:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005b803923 : new rpc_count 0
00000100:00000001:19.0:1773851896.543133:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851896.543133:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x566 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851896.543134:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851896.543134:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851896.543135:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c89cf037.
00000020:00000010:19.0:1773851896.543136:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000020:00000040:19.0:1773851896.543136:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000005b803923 : new refcount 4
00000400:00000200:17.0:1773851896.543136:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851896.543137:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851896.543137:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12786@kfi7: PUT: OK
00000400:00000200:17.0:1773851896.543138:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a8e16822
00000400:00000010:17.0:1773851896.543138:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a8e16822.
00000100:00000001:17.0:1773851896.543139:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851896.543140:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851896.543141:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000097b1e4da nid 12786@kfi7 refs 2
00000800:00000200:17.0:1773851896.543142:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12786@kfi7(00000000a09a4230):0x0 lsk 1383 rsk 4 tsk 0 trmk 0 tmk 0 trr 4 tta 0x566 Transaction freed
00000800:00000200:27.0:1773851896.554837:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851896.554838:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851896.554839:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:27.0:1773851896.554842:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851896.554844:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.554845:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:27.0:1773851896.554847:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.554847:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:27.0:1773851896.554849:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.554849:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:27.0:1773851896.554850:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:27.0:1773851896.554851:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:27.0:1773851896.554852:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed456140
00000400:00000200:27.0:1773851896.554854:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x160dfce379 [256] + 15288
00000800:00000200:27.0:1773851896.554856:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851896.554858:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851896.554859:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000100:00000001:27.0:1773851896.554860:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851896.554860:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:27.0:1773851896.554861:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3f7432e.
00000100:00000040:27.0:1773851896.554862:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000e3f7432e x1858062667571520 msgsize 224
00000100:00100000:27.0:1773851896.554863:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000100:00000001:27.0:1773851896.554864:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851896.554865:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:25.0:1773851896.554866:0:1691804:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:27.0:1773851896.554867:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:25.0:1773851896.554867:0:1691804:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851896.554867:0:1691804:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851896.554868:0:1691804:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851896.554869:0:1691804:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851896.554869:0:1691804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667571520
00000020:00000001:25.0:1773851896.554870:0:1691804:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851896.554871:0:1691804:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:25.0:1773851896.554871:0:1691804:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851896.554872:0:1691804:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:25.0:1773851896.554873:0:1691804:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:25.0:1773851896.554874:0:1691804:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:25.0:1773851896.554875:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851896.554876:0:1691804:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851896.554877:0:1691804:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008d096de4.
00000020:00000010:25.0:1773851896.554878:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851896.554879:0:1691804:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005924beeb.
00000100:00000040:25.0:1773851896.554880:0:1691804:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:25.0:1773851896.554880:0:1691804:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851896.554881:0:1691804:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851896.554881:0:1691804:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851896.554882:0:1691804:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851896.554883:0:1691804:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851896.554885:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851896.554885:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851896.554885:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851896.554885:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851896.554886:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799990
00000100:00000001:25.0:1773851896.554887:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851896.554887:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:25.0:1773851896.554888:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.554888:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998396288 : -107053711155328 : ffff9ea29d931f80)
00000100:00000040:24.0:1773851896.554889:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3f7432e x1858062667571520/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:24.0:1773851896.554895:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851896.554895:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851896.554896:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f7432e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52190:x1858062667571520:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:24.0:1773851896.554897:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667571520
00000020:00000001:24.0:1773851896.554898:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851896.554899:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851896.554899:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.554900:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851896.554900:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851896.554901:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851896.554902:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851896.554902:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851896.554903:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851896.554903:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.554904:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851896.554904:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851896.554905:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000002593263c.
02000000:00000001:24.0:1773851896.554906:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.554907:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851896.554908:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851896.554908:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851896.554909:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851896.554910:0:1537164:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851896.554911:0:1537164:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851896.554912:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 317718528 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851896.554913:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966130483 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851896.554914:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851896.554915:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667571520
00010000:00000001:24.0:1773851896.554915:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851896.554916:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3f7432e x1858062667571520/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:623/0 lens 224/368 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:24.0:1773851896.554919:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851896.554920:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851896.554920:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=23 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851896.554921:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851896.554922:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:24.0:1773851896.554923:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:24.0:1773851896.554924:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851896.554924:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.554925:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851896.554926:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:24.0:1773851896.554926:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f93df7a.
00000100:00000200:24.0:1773851896.554927:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667571520, offset 224
00000400:00000200:24.0:1773851896.554928:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:24.0:1773851896.554929:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851896.554930:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:24.0:1773851896.554931:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851896.554932:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:24.0:1773851896.554933:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2105@kfi7 local destination
00000400:00000200:24.0:1773851896.554935:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770225:8770225:1024:4294967295] 2105@kfi7 LPNI seq info [20346216:20346216:16:4294967295]
00000400:00000200:24.0:1773851896.554936:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851896.554937:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851896.554939:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851896.554940:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:24.0:1773851896.554941:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851896.554943:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851896.554945:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851896.554947:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000800:00000200:24.0:1773851896.554950:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000358ab717: Posted send of 468 bytes to peer 0x4c6: rc=0
00000800:00000200:24.0:1773851896.554951:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851896.554954:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851896.554955:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:24.0:1773851896.554956:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851896.554956:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.554958:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851896.554959:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3f7432e x1858062667571520/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:623/0 lens 224/368 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:24.0:1773851896.554962:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f7432e pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52190:x1858062667571520:12345-2098@kfi7:41:default-yuba6-0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851896.554964:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799990
00000100:00000040:24.0:1773851896.554965:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:24.0:1773851896.554965:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851896.554966:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851896.554966:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851896.554967:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005924beeb.
00000020:00000010:24.0:1773851896.554968:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008d096de4.
00000020:00000040:24.0:1773851896.554969:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:24.0:1773851896.554969:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851896.554974:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851896.554975:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851896.554976:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:25.0:1773851896.554977:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f93df7a
00000400:00000010:25.0:1773851896.554978:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f93df7a.
00000100:00000001:25.0:1773851896.554978:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851896.554978:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851896.554979:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851896.554981:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x4c6 Transaction freed
00000800:00000200:21.0:1773851896.562738:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851896.562739:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851896.562740:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851896.562743:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851896.562745:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13234@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.562746:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13234@kfi7 : PUT - for me
00000400:00000200:21.0:1773851896.562747:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13234@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.562748:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046fc95f4 nid 13234@kfi7 refs 1
00000400:00000200:21.0:1773851896.562749:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13234@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.562750:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046fc95f4 nid 13234@kfi7 refs 2
00000400:00000200:21.0:1773851896.562751:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000046fc95f4 nid 13234@kfi7 refs 3
00000400:00000200:21.0:1773851896.562752:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13234@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.562753:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13234@kfi7 of length 600 into portal 12 MB=0x69b4c4c37d180
00000400:00000200:21.0:1773851896.562755:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13234@kfi7 of length 600/600 into md 0x6a32cacf5 [64] + 64792
00000800:00000200:21.0:1773851896.562757:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851896.562759:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851896.562760:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13234@kfi7: PUT: OK
00000100:00000001:21.0:1773851896.562761:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851896.562762:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851896.562762:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000da757aff.
00000100:00000040:21.0:1773851896.562763:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000da757aff x1859601858810240 msgsize 600
00000100:00100000:21.0:1773851896.562765:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13234@kfi7 (source: 12345-13234@kfi7)
00000100:00000001:21.0:1773851896.562766:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851896.562767:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851896.562767:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000046fc95f4 nid 13234@kfi7 refs 2
02000000:00000001:23.0:1773851896.562768:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851896.562768:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851896.562768:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851896.562769:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851896.562770:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851896.562770:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601858810240
00000020:00000001:23.0:1773851896.562771:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851896.562771:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78194
00000020:00000001:23.0:1773851896.562772:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.562774:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b03e6cfc refcount=602
00000020:00000001:23.0:1773851896.562774:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637124797449216 : -106948912102400 : ffff9ebb0415c400)
00000020:00000001:23.0:1773851896.562775:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637124797449216 : -106948912102400 : ffff9ebb0415c400)
00000100:00000001:23.0:1773851896.562776:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851896.562777:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851896.562778:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007594cbb6.
00000020:00000010:23.0:1773851896.562779:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000073b0d1db.
00000020:00000010:23.0:1773851896.562779:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851896.562780:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851896.562781:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:23.0:1773851896.562782:0:61145:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:23.0:1773851896.562782:0:61145:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.562783:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.562784:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.562785:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851896.562786:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851896.562787:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851896.562787:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851896.562787:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851896.562788:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13234@kfi7, seq: 335333154
00000100:00000040:23.0:1773851896.562789:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b03e6cfc : new rpc_count 13
00000100:00000001:23.0:1773851896.562789:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701976704 : -106936007574912 : ffff9ebe05413a80)
00000100:00000001:20.0:1773851896.562789:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851896.562790:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000da757aff x1859601858810240/t0(0) o101->287f02d3-54ec-4ae5-a397-7889dbda0366@13234@kfi7:623/0 lens 600/0 e 0 to 0 dl 1773851983 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833101659110505472'
00000100:00000001:20.0:1773851896.562790:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.562793:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851896.562794:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851896.562795:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da757aff pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:287f02d3-54ec-4ae5-a397-7889dbda0366+602:393870:x1859601858810240:12345-13234@kfi7:101:tuolumne-833101659110505472
00000100:00000200:23.0:1773851896.562796:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601858810240
00000020:00000001:23.0:1773851896.562797:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851896.562798:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851896.562798:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.562799:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851896.562800:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:23.0:1773851896.562801:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851896.562801:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601858810240, found 0 last_xid 1859601852485567
00000020:00000001:23.0:1773851896.562802:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851896.562803:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851896.562803:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851896.562804:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.562805:0:61145:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:23.0:1773851896.562806:0:61145:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:23.0:1773851896.562806:0:61145:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:23.0:1773851896.562807:0:61145:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:23.0:1773851896.562808:0:61145:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.562812:0:61145:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:23.0:1773851896.562815:0:61145:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000617047cc count: 35
00010000:00000001:23.0:1773851896.562816:0:61145:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851896.562817:0:61145:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:23.0:1773851896.562818:0:61145:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000004040a90b.
00000020:00000001:23.0:1773851896.562820:0:61145:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:23.0:1773851896.562821:0:61145:0:(lustre_handles.c:97:class_handle_hash()) added object 000000004040a90b with handle 0x21b6f08f07a6aea4 to hash
00000020:00000001:23.0:1773851896.562822:0:61145:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:23.0:1773851896.562822:0:61145:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158703505280 : -106915006046336 : ffff9ec2e90b1f80)
00010000:00000010:23.0:1773851896.562825:0:61145:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000d52e94aa.
00010000:00000001:23.0:1773851896.562825:0:61145:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158703505280 : -106915006046336 : ffff9ec2e90b1f80)
00010000:00010000:23.0:1773851896.562827:0:61145:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000004040a90b/0x21b6f08f07a6aea4 lrc: 2/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x0/0x0 rrc: 36 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x9f53f3a6802d01bc expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562831:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 35
00010000:00000040:23.0:1773851896.562832:0:61145:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 00000000b03e6cfc : new locks_count 531
00000020:00000040:23.0:1773851896.562833:0:61145:0:(genops.c:871:class_export_get()) GET export 00000000b03e6cfc refcount=603
00010000:00000001:23.0:1773851896.562836:0:61145:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:23.0:1773851896.562836:0:61145:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:23.0:1773851896.562838:0:61145:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:23.0:1773851896.562839:0:61145:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:23.0:1773851896.562840:0:61145:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:23.0:1773851896.562840:0:61145:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:23.0:1773851896.562841:0:61145:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240022ab1:0x10add:0x0]
00000020:00000001:23.0:1773851896.562842:0:61145:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:23.0:1773851896.562843:0:61145:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637060275857336 : -107013433694280 : ffff9eabfe4c67b8)
00000004:00000001:23.0:1773851896.562844:0:61145:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637060275857248 : -107013433694368 : ffff9eabfe4c6760)
00000004:00000001:23.0:1773851896.562844:0:61145:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.562845:0:61145:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:23.0:1773851896.562846:0:61145:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:23.0:1773851896.562847:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851896.562847:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851896.562849:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000f17c3310.
02000000:00000001:23.0:1773851896.562849:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.562850:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.562851:0:61145:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.562852:0:61145:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:23.0:1773851896.562853:0:61145:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:23.0:1773851896.562853:0:61145:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:23.0:1773851896.562854:0:61145:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:23.0:1773851896.562855:0:61145:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:23.0:1773851896.562855:0:61145:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:23.0:1773851896.562856:0:61145:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:23.0:1773851896.562856:0:61145:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:23.0:1773851896.562857:0:61145:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:23.0:1773851896.562857:0:61145:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
00000001:00000001:23.0:1773851896.562858:0:61145:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:23.0:1773851896.562858:0:61145:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=1427884 : 1427884 : 15c9ac)
02000000:00000001:23.0:1773851896.562859:0:61145:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:23.0:1773851896.562861:0:61145:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637045037292288 : -107028672259328 : ffff9ea872025b00)
00000004:00000001:23.0:1773851896.562861:0:61145:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:23.0:1773851896.562862:0:61145:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:23.0:1773851896.562863:0:61145:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:23.0:1773851896.562863:0:61145:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.562864:0:61145:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:23.0:1773851896.562864:0:61145:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.562866:0:61145:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:23.0:1773851896.562868:0:61145:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x240022ab1:0x10add:0x0]/job_1741306760_c156eb853bfa, ldlm_rep = 000000005fe3b05d
00000004:00000001:23.0:1773851896.562870:0:61145:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:23.0:1773851896.562871:0:61145:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:23.0:1773851896.562872:0:61145:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:23.0:1773851896.562873:0:61145:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:23.0:1773851896.562874:0:61145:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:23.0:1773851896.562874:0:61145:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:23.0:1773851896.562875:0:61145:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.562876:0:61145:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851896.562876:0:61145:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:23.0:1773851896.562877:0:61145:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000833b1c32.
00000020:00000001:23.0:1773851896.562878:0:61145:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:23.0:1773851896.562878:0:61145:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000833b1c32 with handle 0x21b6f08f07a6aeab to hash
00000020:00000001:23.0:1773851896.562879:0:61145:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:23.0:1773851896.562879:0:61145:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158703501824 : -106915006049792 : ffff9ec2e90b1200)
00010000:00000010:23.0:1773851896.562880:0:61145:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000004426632e.
00010000:00000001:23.0:1773851896.562881:0:61145:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158703501824 : -106915006049792 : ffff9ec2e90b1200)
00010000:00000001:23.0:1773851896.562882:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.562882:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.562883:0:61145:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 3/1,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x0/0x0 rrc: 37 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562886:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.562887:0:61145:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:23.0:1773851896.562888:0:61145:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:23.0:1773851896.562889:0:61145:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:23.0:1773851896.562890:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851896.562891:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.562892:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851896.562893:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.562894:0:61145:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:23.0:1773851896.562894:0:61145:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:23.0:1773851896.562895:0:61145:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:23.0:1773851896.562896:0:61145:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:23.0:1773851896.562896:0:61145:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240022ab1:0x10add:0x0].0x0 (00000000617047cc) refcount = 36
00010000:00000040:23.0:1773851896.562898:0:61145:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:23.0:1773851896.562899:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000928d62c2/0x21b6f08f07a40d31 lrc: 2/0,1 mode: CW/CW res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210400000020 nid: local remote: 0x0 expref: -99 pid: 60931 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562902:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562903:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c3c58638/0x21b6f08f07a6a79d lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 14656@kfi7 remote: 0xee46395ebb639eea expref: 571 pid: 61015 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562905:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562907:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000060ce70b2/0x21b6f08f07a6a145 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 20371@kfi7 remote: 0x2051c98a273b3414 expref: 363 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562909:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562910:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031c0254b/0x21b6f08f07a6a0c7 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 15873@kfi7 remote: 0xf0e50a97590c53ef expref: 625 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562913:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562914:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004edfba06/0x21b6f08f07a67df8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d651c9b2 expref: 428 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562916:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562918:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac1665/0x21b6f08f07a67ccb lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 14834@kfi7 remote: 0xf194aee929aaa453 expref: 779 pid: 61019 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562920:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562921:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e799c17b/0x21b6f08f07a67a86 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 17395@kfi7 remote: 0x3ec3da9d2e6c4e96 expref: 798 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562923:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562924:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080b23c24/0x21b6f08f07a6763b lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19649@kfi7 remote: 0xfbed7022be6d812 expref: 764 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562926:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562928:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c7224ec/0x21b6f08f07a6760a lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 16706@kfi7 remote: 0xb9d2e15427cec0c0 expref: 688 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562931:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562932:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e29003/0x21b6f08f07a66ff8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 18145@kfi7 remote: 0x94f28eec257670ba expref: 520 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562934:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562936:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000637160eb/0x21b6f08f07a66651 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 20162@kfi7 remote: 0xd8f535f7d4066ca4 expref: 687 pid: 60951 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562938:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562940:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9c695f/0x21b6f08f07a63383 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9362@kfi7 remote: 0xc5a97ef482d05c25 expref: 444 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562942:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562943:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099f84db4/0x21b6f08f07a5d5d5 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22529@kfi7 remote: 0xfcff1f2caad1d920 expref: 626 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562945:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562947:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab425ebe/0x21b6f08f07a5d51f lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9408@kfi7 remote: 0x370aeb12e4428f40 expref: 718 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562949:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562950:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b48c48a2/0x21b6f08f07a5d255 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9139@kfi7 remote: 0xfa7021092331e4ac expref: 437 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562952:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562954:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001047490d/0x21b6f08f07a5d1e5 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9fec7e77 expref: 525 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562956:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562957:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012ce9a88/0x21b6f08f07a5ae6e lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19394@kfi7 remote: 0x4a24d51c18b2b286 expref: 724 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562960:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562961:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f300433a/0x21b6f08f07a5a3e0 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9297@kfi7 remote: 0xd6f6229f11ea6e1 expref: 1207 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562963:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562964:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ebbd3d2/0x21b6f08f07a59180 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 26401@kfi7 remote: 0x4e2d8609cc3f28d9 expref: 736 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562967:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562968:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071b3552b/0x21b6f08f07a4e7d5 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 26563@kfi7 remote: 0x581d8fb696c27b8f expref: 5917 pid: 60681 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562970:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562972:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000081bb9743/0x21b6f08f07a4a79a lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6642ab expref: 468 pid: 61009 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562974:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562975:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000043f411/0x21b6f08f07a49311 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22579@kfi7 remote: 0x8bf879f20ce2a6a4 expref: 406 pid: 61040 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562977:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562979:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041129efd/0x21b6f08f07a46ee4 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22352@kfi7 remote: 0x9b15b96d92895e9e expref: 311 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562981:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562982:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ad05bc3/0x21b6f08f07a449d7 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 19683@kfi7 remote: 0x8c112039dd042c7d expref: 709 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562984:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562985:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000414cd34e/0x21b6f08f07a3f6da lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 13234@kfi7 remote: 0x9f53f3a6802bc5e3 expref: 603 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562988:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562990:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be11c013/0x21b6f08f07a286c0 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22579@kfi7 remote: 0x8bf879f20ce253f4 expref: 406 pid: 60986 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562992:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562993:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f544290/0x21b6f08efbf5fa86 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 14834@kfi7 remote: 0xf194aee929a94ac8 expref: 779 pid: 61061 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562995:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562996:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061e2aa35/0x21b6f08ef9b3fab8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 16706@kfi7 remote: 0xb9d2e15427ccae87 expref: 688 pid: 41185 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.562998:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.562999:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000023436998/0x21b6f08eecd6afe0 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 9139@kfi7 remote: 0xfa7021092330bc21 expref: 437 pid: 60731 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563002:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.563003:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9bf9b9b/0x21b6f08eecab02b7 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 22642@kfi7 remote: 0x9f98ed8a9feb2540 expref: 525 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563005:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.563006:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c6ddecc/0x21b6f08ed310b0c8 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 20162@kfi7 remote: 0xd8f535f7d404bb3e expref: 687 pid: 60549 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563008:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.563009:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ec6135d/0x21b6f08eaf2d9fa2 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 17395@kfi7 remote: 0x3ec3da9d2e69616c expref: 798 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563011:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.563012:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000965c2453/0x21b6f08e89765737 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x10/0x0 rrc: 37 type: IBT gid 0 flags: 0x40200000000000 nid: 13234@kfi7 remote: 0x9f53f3a68028e4eb expref: 603 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563017:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000040:23.0:1773851896.563018:0:61145:0:(ldlm_resource.c:1815:ldlm_resource_dump()) Waiting locks:
00010000:00000040:23.0:1773851896.563018:0:61145:0:(ldlm_resource.c:1817:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009e05b555/0x21b6f08f07a4a0af lrc: 3/1,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x12/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60742 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563020:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00010000:23.0:1773851896.563021:0:61145:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 3/1,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563023:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563024:0:61145:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:23.0:1773851896.563026:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851896.563027:0:61145:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563028:0:61145:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:23.0:1773851896.563028:0:61145:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563029:0:61145:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563029:0:61145:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851896.563031:0:61145:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:23.0:1773851896.563031:0:61145:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.563032:0:61145:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 3/1,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563034:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563035:0:61145:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:23.0:1773851896.563036:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563036:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563037:0:61145:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:23.0:1773851896.563037:0:61145:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:23.0:1773851896.563038:0:61145:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 00000000fc994730.
00010000:00000010:23.0:1773851896.563039:0:61145:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000d33e08aa.
00010000:00000001:23.0:1773851896.563040:0:61145:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:23.0:1773851896.563041:0:61145:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000003c375dc8.
00000020:00000001:23.0:1773851896.563041:0:61145:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:23.0:1773851896.563042:0:61145:0:(lustre_handles.c:97:class_handle_hash()) added object 000000003c375dc8 with handle 0x21b6f08f07a6aeb2 to hash
00000020:00000001:23.0:1773851896.563043:0:61145:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:23.0:1773851896.563043:0:61145:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000010:23.0:1773851896.563044:0:61145:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000000260a31a.
00010000:00000001:23.0:1773851896.563045:0:61145:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000001:23.0:1773851896.563046:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.563047:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.563047:0:61145:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 3/1,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563050:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563050:0:61145:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:23.0:1773851896.563051:0:61145:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:23.0:1773851896.563051:0:61145:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:23.0:1773851896.563052:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851896.563052:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563053:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851896.563053:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563054:0:61145:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:23.0:1773851896.563054:0:61145:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:23.0:1773851896.563055:0:61145:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:23.0:1773851896.563055:0:61145:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:23.0:1773851896.563055:0:61145:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240022ab1:0x10add:0x0].0x4324505 (00000000fc994730) refcount = 1
00010000:00010000:23.0:1773851896.563056:0:61145:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 3/1,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563059:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563059:0:61145:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:23.0:1773851896.563060:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851896.563060:0:61145:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563061:0:61145:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:23.0:1773851896.563061:0:61145:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563062:0:61145:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563062:0:61145:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851896.563064:0:61145:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:23.0:1773851896.563064:0:61145:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.563065:0:61145:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 3/1,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563067:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563068:0:61145:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:23.0:1773851896.563068:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563068:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563069:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563069:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563070:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003c375dc8 refcount=3
00000020:00000001:23.0:1773851896.563070:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000001:23.0:1773851896.563071:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000001:23.0:1773851896.563072:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563072:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:23.0:1773851896.563073:0:61145:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563073:0:61145:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563074:0:61145:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:23.0:1773851896.563089:0:61145:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:23.0:1773851896.563090:0:61145:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:23.0:1773851896.563090:0:61145:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:23.0:1773851896.563092:0:61145:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:23.0:1773851896.563104:0:61145:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:23.0:1773851896.563105:0:61145:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:23.0:1773851896.563105:0:61145:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:23.0:1773851896.563106:0:61145:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:23.0:1773851896.563107:0:61145:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:23.0:1773851896.563110:0:61145:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:23.0:1773851896.563111:0:61145:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:23.0:1773851896.563111:0:61145:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:23.0:1773851896.563112:0:61145:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:23.0:1773851896.563113:0:61145:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563113:0:61145:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563114:0:61145:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:23.0:1773851896.563114:0:61145:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x340021785:0x847d:0x0]
00000020:00000001:23.0:1773851896.563115:0:61145:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:23.0:1773851896.563117:0:61145:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637064264374936 : -107009445176680 : ffff9eacec085a98)
00000004:00000001:23.0:1773851896.563117:0:61145:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637064264374848 : -107009445176768 : ffff9eacec085a40)
00000004:00000001:23.0:1773851896.563118:0:61145:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:23.0:1773851896.563119:0:61145:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:23.0:1773851896.563119:0:61145:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:23.0:1773851896.563119:0:61145:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:23.0:1773851896.563121:0:61145:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000c5c69295 count: 3
00010000:00000001:23.0:1773851896.563121:0:61145:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851896.563122:0:61145:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:23.0:1773851896.563122:0:61145:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000042a6848.
00000020:00000001:23.0:1773851896.563123:0:61145:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:23.0:1773851896.563124:0:61145:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000042a6848 with handle 0x21b6f08f07a6aeb9 to hash
00000020:00000001:23.0:1773851896.563125:0:61145:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:23.0:1773851896.563125:0:61145:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00010000:00000010:23.0:1773851896.563126:0:61145:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000046ac0db6.
00010000:00000001:23.0:1773851896.563126:0:61145:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00010000:00000001:23.0:1773851896.563127:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.563128:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.563128:0:61145:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000042a6848/0x21b6f08f07a6aeb9 lrc: 3/1,0 mode: --/PR res: [0x340021785:0x847d:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563130:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c5c69295 count: 3
00010000:00000001:23.0:1773851896.563131:0:61145:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:23.0:1773851896.563131:0:61145:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:23.0:1773851896.563132:0:61145:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:23.0:1773851896.563132:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851896.563133:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563134:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851896.563134:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563135:0:61145:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:23.0:1773851896.563135:0:61145:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:23.0:1773851896.563136:0:61145:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:23.0:1773851896.563136:0:61145:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:23.0:1773851896.563136:0:61145:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x340021785:0x847d:0x0].0x0 (00000000c5c69295) refcount = 3
00010000:00000040:23.0:1773851896.563138:0:61145:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:23.0:1773851896.563139:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007336b827/0x21b6f08f07a5d312 lrc: 2/0,0 mode: PR/PR res: [0x340021785:0x847d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 26401@kfi7 remote: 0x4e2d8609cc3f4ffa expref: 736 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563141:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c5c69295 count: 3
00010000:00000040:23.0:1773851896.563142:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000664e3a65/0x21b6f08f07a4c55a lrc: 2/0,0 mode: PR/PR res: [0x340021785:0x847d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 20371@kfi7 remote: 0x2051c98a273a651d expref: 363 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563144:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c5c69295 count: 3
00010000:00010000:23.0:1773851896.563144:0:61145:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000042a6848/0x21b6f08f07a6aeb9 lrc: 3/1,0 mode: PR/PR res: [0x340021785:0x847d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563147:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c5c69295 count: 3
00010000:00000001:23.0:1773851896.563147:0:61145:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:23.0:1773851896.563148:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851896.563148:0:61145:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563149:0:61145:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:23.0:1773851896.563149:0:61145:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563149:0:61145:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563150:0:61145:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851896.563151:0:61145:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:23.0:1773851896.563151:0:61145:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.563152:0:61145:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000042a6848/0x21b6f08f07a6aeb9 lrc: 3/1,0 mode: PR/PR res: [0x340021785:0x847d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563154:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c5c69295 count: 3
00010000:00000001:23.0:1773851896.563154:0:61145:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:23.0:1773851896.563155:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563155:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563155:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563156:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563156:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000042a6848 refcount=3
00000020:00000001:23.0:1773851896.563157:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00010000:00000001:23.0:1773851896.563157:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00010000:00000001:23.0:1773851896.563158:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563159:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:23.0:1773851896.563159:0:61145:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563162:0:61145:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:23.0:1773851896.563162:0:61145:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x340021785:0x847d:0x0]
00000004:00000001:23.0:1773851896.563163:0:61145:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563164:0:61145:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563165:0:61145:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:23.0:1773851896.563166:0:61145:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:23.0:1773851896.563168:0:61145:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:23.0:1773851896.563171:0:61145:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563171:0:61145:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563172:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563173:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563173:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000042a6848 refcount=3
00000020:00000001:23.0:1773851896.563174:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00010000:00000001:23.0:1773851896.563174:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00000004:00010000:23.0:1773851896.563175:0:61145:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 00000000042a6848/0x21b6f08f07a6aeb9 lrc: 3/1,0 mode: PR/PR res: [0x340021785:0x847d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563177:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c5c69295 count: 3
00010000:00000001:23.0:1773851896.563178:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563178:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:23.0:1773851896.563179:0:61145:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:23.0:1773851896.563179:0:61145:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:23.0:1773851896.563180:0:61145:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:23.0:1773851896.563181:0:61145:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:23.0:1773851896.563181:0:61145:0:(lu_object.c:224:lu_object_put()) Add 0000000057eb5365/000000009fa0e235 to site lru. bkt: 00000000d9745097
00000004:00000001:23.0:1773851896.563182:0:61145:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:23.0:1773851896.563183:0:61145:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:23.0:1773851896.563184:0:61145:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:23.0:1773851896.563184:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563185:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563185:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000833b1c32 refcount=3
00000020:00000001:23.0:1773851896.563186:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703501824 : -106915006049792 : ffff9ec2e90b1200)
00010000:00000001:23.0:1773851896.563186:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703501824 : -106915006049792 : ffff9ec2e90b1200)
00010000:00000001:23.0:1773851896.563188:0:61145:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:23.0:1773851896.563188:0:61145:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 3/1,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563191:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563191:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563192:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:23.0:1773851896.563192:0:61145:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 2/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563194:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563195:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.563195:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563196:0:61145:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:23.0:1773851896.563196:0:61145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 3/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563199:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00010000:23.0:1773851896.563200:0:61145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 00000000833b1c32 already unused, calling callback (000000001690cbe4)
00000004:00000001:23.0:1773851896.563201:0:61145:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:23.0:1773851896.563202:0:61145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:23.0:1773851896.563203:0:61145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 3/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563205:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563206:0:61145:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:23.0:1773851896.563206:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563207:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563207:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000833b1c32 refcount=4
00000020:00000001:23.0:1773851896.563207:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703501824 : -106915006049792 : ffff9ec2e90b1200)
00010000:00000001:23.0:1773851896.563208:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703501824 : -106915006049792 : ffff9ec2e90b1200)
00010000:00000001:23.0:1773851896.563209:0:61145:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:23.0:1773851896.563210:0:61145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 4/0,0 mode: CR/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563212:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563213:0:61145:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:23.0:1773851896.563214:0:61145:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:23.0:1773851896.563214:0:61145:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563215:0:61145:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:23.0:1773851896.563216:0:61145:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:23.0:1773851896.563217:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.563217:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:23.0:1773851896.563218:0:61145:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000833b1c32 with handle 0x21b6f08f07a6aeab from hash
00010000:00000001:23.0:1773851896.563218:0:61145:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:23.0:1773851896.563219:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563219:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563220:0:61145:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:23.0:1773851896.563220:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851896.563220:0:61145:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563221:0:61145:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:23.0:1773851896.563222:0:61145:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:23.0:1773851896.563223:0:61145:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:23.0:1773851896.563224:0:61145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240022ab1:0x10add:0x0].0x0 (00000000617047cc)
00010000:00010000:23.0:1773851896.563225:0:61145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00010000:23.0:1773851896.563226:0:61145:0:(ldlm_inodebits.c:113:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre5-MDT0001_UUID lock: 000000009e05b555/0x21b6f08f07a4a0af lrc: 3/1,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x12/0x0 rrc: 37 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 60742 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563228:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563229:0:61145:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:23.0:1773851896.563229:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851896.563230:0:61145:0:(ldlm_lock.c:720:ldlm_add_ast_work_item()) Process entered
00010000:00000001:23.0:1773851896.563230:0:61145:0:(ldlm_lock.c:726:ldlm_add_ast_work_item()) Process leaving
00010000:00000001:23.0:1773851896.563231:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563231:0:61145:0:(ldlm_inodebits.c:389:ldlm_process_inodebits_lock()) Process leaving (rc=2 : 2 : 2)
00010000:00000001:23.0:1773851896.563232:0:61145:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=2 : 2 : 2)
00010000:00000001:23.0:1773851896.563233:0:61145:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563234:0:61145:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:23.0:1773851896.563235:0:61145:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:23.0:1773851896.563235:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563236:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563236:0:61145:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563237:0:61145:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563238:0:61145:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.563238:0:61145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 2/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563240:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000001:23.0:1773851896.563241:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563241:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563242:0:61145:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:23.0:1773851896.563242:0:61145:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:23.0:1773851896.563243:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:23.0:1773851896.563243:0:61145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000833b1c32/0x21b6f08f07a6aeab lrc: 0/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x2/0x0 rrc: 37 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563245:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 36
00010000:00000010:23.0:1773851896.563246:0:61145:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000004426632e.
00010000:00000040:23.0:1773851896.563247:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 35
00010000:00000001:23.0:1773851896.563247:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:23.0:1773851896.563248:0:61145:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:23.0:1773851896.563248:0:61145:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:23.0:1773851896.563248:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563249:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563249:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003c375dc8 refcount=3
00000020:00000001:23.0:1773851896.563250:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000001:23.0:1773851896.563251:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000001:23.0:1773851896.563251:0:61145:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:23.0:1773851896.563251:0:61145:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 3/1,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563254:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563254:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563255:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:23.0:1773851896.563255:0:61145:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 2/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563258:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563258:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.563258:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563259:0:61145:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:23.0:1773851896.563259:0:61145:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 3/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563262:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00010000:23.0:1773851896.563262:0:61145:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000003c375dc8 already unused, calling callback (000000001690cbe4)
00000004:00000001:23.0:1773851896.563263:0:61145:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:23.0:1773851896.563263:0:61145:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:23.0:1773851896.563264:0:61145:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 3/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563266:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563266:0:61145:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:23.0:1773851896.563267:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563267:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563267:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003c375dc8 refcount=4
00000020:00000001:23.0:1773851896.563268:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000001:23.0:1773851896.563268:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703502976 : -106915006048640 : ffff9ec2e90b1680)
00010000:00000001:23.0:1773851896.563269:0:61145:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:23.0:1773851896.563270:0:61145:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 4/0,0 mode: PR/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563271:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563272:0:61145:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:23.0:1773851896.563272:0:61145:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:23.0:1773851896.563273:0:61145:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563274:0:61145:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:23.0:1773851896.563275:0:61145:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:23.0:1773851896.563275:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.563276:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:23.0:1773851896.563276:0:61145:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000003c375dc8 with handle 0x21b6f08f07a6aeb2 from hash
00010000:00000001:23.0:1773851896.563277:0:61145:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:23.0:1773851896.563277:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563278:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563278:0:61145:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:23.0:1773851896.563278:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851896.563279:0:61145:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563279:0:61145:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:23.0:1773851896.563280:0:61145:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:23.0:1773851896.563280:0:61145:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:23.0:1773851896.563280:0:61145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240022ab1:0x10add:0x0].0x4324505 (00000000fc994730)
00010000:00010000:23.0:1773851896.563281:0:61145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:23.0:1773851896.563282:0:61145:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563283:0:61145:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563284:0:61145:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:23.0:1773851896.563284:0:61145:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:23.0:1773851896.563284:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563285:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563285:0:61145:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563286:0:61145:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563286:0:61145:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:23.0:1773851896.563287:0:61145:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 2/0,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563289:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000001:23.0:1773851896.563290:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563290:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563291:0:61145:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:23.0:1773851896.563291:0:61145:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:23.0:1773851896.563291:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:23.0:1773851896.563292:0:61145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000003c375dc8/0x21b6f08f07a6aeb2 lrc: 0/0,0 mode: --/PR res: [0x240022ab1:0x10add:0x0].0x4324505 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563297:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 1
00010000:00000010:23.0:1773851896.563298:0:61145:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000000260a31a.
00010000:00000040:23.0:1773851896.563299:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fc994730 count: 0
00010000:00000010:23.0:1773851896.563299:0:61145:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000d33e08aa.
00010000:00000001:23.0:1773851896.563301:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:23.0:1773851896.563301:0:61145:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:23.0:1773851896.563301:0:61145:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:23.0:1773851896.563302:0:61145:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:23.0:1773851896.563302:0:61145:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:23.0:1773851896.563303:0:61145:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:23.0:1773851896.563303:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.563304:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000042a6848 refcount=3
00000020:00000001:23.0:1773851896.563304:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00010000:00000001:23.0:1773851896.563305:0:61145:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637158703508160 : -106915006043456 : ffff9ec2e90b2ac0)
00000004:00000040:23.0:1773851896.563306:0:61145:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 00000000b03e6cfc : new locks_count 532
00000020:00000040:23.0:1773851896.563307:0:61145:0:(genops.c:871:class_export_get()) GET export 00000000b03e6cfc refcount=604
00010000:00000001:23.0:1773851896.563308:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563308:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:23.0:1773851896.563309:0:61145:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:23.0:1773851896.563309:0:61145:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:23.0:1773851896.563310:0:61145:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:23.0:1773851896.563311:0:61145:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:23.0:1773851896.563311:0:61145:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:23.0:1773851896.563312:0:61145:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:23.0:1773851896.563312:0:61145:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:23.0:1773851896.563313:0:61145:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:23.0:1773851896.563314:0:61145:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851896.563315:0:61145:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:23.0:1773851896.563315:0:61145:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:23.0:1773851896.563316:0:61145:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:23.0:1773851896.563316:0:61145:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:23.0:1773851896.563317:0:61145:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:23.0:1773851896.563318:0:61145:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:23.0:1773851896.563318:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563319:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563319:0:61145:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:23.0:1773851896.563320:0:61145:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:23.0:1773851896.563320:0:61145:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000004040a90b with handle 0x21b6f08f07a6aea4 from hash
00010000:00000001:23.0:1773851896.563321:0:61145:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:23.0:1773851896.563321:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563322:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563322:0:61145:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:23.0:1773851896.563322:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:23.0:1773851896.563323:0:61145:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000004040a90b/0x21b6f08f07a6aea4 lrc: 0/0,0 mode: --/CR res: [0x240022ab1:0x10add:0x0].0x0 bits 0x1/0x0 rrc: 36 type: IBT gid 0 flags: 0x44000000000000 nid: 13234@kfi7 remote: 0x9f53f3a6802d01bc expref: 604 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563325:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 35
00010000:00000040:23.0:1773851896.563326:0:61145:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000b03e6cfc : new locks_count 531
00000020:00000040:23.0:1773851896.563327:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b03e6cfc : new refcount 603
00010000:00000010:23.0:1773851896.563327:0:61145:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000d52e94aa.
00010000:00000040:23.0:1773851896.563328:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000617047cc count: 34
00010000:00000001:23.0:1773851896.563329:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:23.0:1773851896.563329:0:61145:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563330:0:61145:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:23.0:1773851896.563331:0:61145:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000042a6848/0x21b6f08f07a6aeb9 lrc: 3/0,0 mode: PR/PR res: [0x340021785:0x847d:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 13234@kfi7 remote: 0x9f53f3a6802d01bc expref: 603 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851896.563334:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000c5c69295 count: 3
00010000:00000001:23.0:1773851896.563334:0:61145:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:23.0:1773851896.563335:0:61145:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:23.0:1773851896.563335:0:61145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x340021785:0x847d:0x0].0x0 (00000000c5c69295)
00010000:00010000:23.0:1773851896.563336:0:61145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:23.0:1773851896.563337:0:61145:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851896.563338:0:61145:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851896.563338:0:61145:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:23.0:1773851896.563338:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851896.563339:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:23.0:1773851896.563339:0:61145:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000042a6848, rc 0)
00000020:00000001:23.0:1773851896.563340:0:61145:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851896.563341:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264583306, transno 0, xid 1859601858810240
00010000:00000001:23.0:1773851896.563342:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851896.563343:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000da757aff x1859601858810240/t0(0) o101->287f02d3-54ec-4ae5-a397-7889dbda0366@13234@kfi7:623/0 lens 600/640 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833101659110505472'
00010000:00000001:23.0:1773851896.563346:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851896.563346:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851896.563347:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=129 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851896.563348:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851896.563349:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0cecfe9 refcount 3 to 13234@kfi7
00000100:00000001:23.0:1773851896.563350:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094880 : -107139307456736 : ffff9e8eafa33720)
02000000:00000001:23.0:1773851896.563351:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851896.563351:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.563352:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851896.563353:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13234@kfi7
00000400:00000010:23.0:1773851896.563353:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a34f2baa.
00000100:00000200:23.0:1773851896.563354:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859601858810240, offset 224
00000400:00000200:23.0:1773851896.563355:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13234@kfi7
00000400:00000200:23.0:1773851896.563356:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13234@kfi7 to cpt 5
00000400:00000200:23.0:1773851896.563357:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046fc95f4 nid 13234@kfi7 refs 1
00000400:00000200:23.0:1773851896.563358:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000046fc95f4 nid 13234@kfi7 refs 2
00000400:00000200:23.0:1773851896.563359:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000046fc95f4 nid 13234@kfi7 refs 3
00000400:00000200:23.0:1773851896.563360:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13234@kfi7 local destination
00000400:00000200:23.0:1773851896.563362:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770226:8770226:1024:4294967295] 13234@kfi7 LPNI seq info [531409:531409:16:4294967295]
00000400:00000200:23.0:1773851896.563363:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000046fc95f4 nid 13234@kfi7 refs 2
00000400:00000200:23.0:1773851896.563364:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13234@kfi7 to cpt 5
00000400:00000200:23.0:1773851896.563366:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13234@kfi7(13234@kfi7:13234@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851896.563367:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000046fc95f4 nid 13234@kfi7 refs 3
00000800:00000200:23.0:1773851896.563368:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851896.563369:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:23.0:1773851896.563372:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851896.563375:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1bb Using peer 13234@kfi7(0x1bb)
00000800:00000200:23.0:1773851896.563378:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 740 bytes to peer 0x1bb: rc=0
00000800:00000200:23.0:1773851896.563380:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1bb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851896.563382:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851896.563382:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0cecfe9 refcount 2 to 13234@kfi7
00010000:00000001:23.0:1773851896.563383:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851896.563384:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.563384:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851896.563385:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000da757aff x1859601858810240/t0(0) o101->287f02d3-54ec-4ae5-a397-7889dbda0366@13234@kfi7:623/0 lens 600/640 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833101659110505472'
00000100:00100000:23.0:1773851896.563388:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da757aff pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:287f02d3-54ec-4ae5-a397-7889dbda0366+603:393870:x1859601858810240:12345-13234@kfi7:101:tuolumne-833101659110505472 Request processed in 594us (624us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851896.563391:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13234@kfi7, seq: 335333154
00000100:00000040:23.0:1773851896.563393:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b03e6cfc : new rpc_count 12
00000100:00000001:23.0:1773851896.563393:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851896.563393:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1bb TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851896.563394:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851896.563394:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000073b0d1db.
00000400:00000200:21.0:1773851896.563394:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851896.563395:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000400:00000200:21.0:1773851896.563395:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13234@kfi7: PUT: OK
00000020:00000010:23.0:1773851896.563396:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007594cbb6.
00000400:00000200:21.0:1773851896.563396:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a34f2baa
00000400:00000010:21.0:1773851896.563396:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a34f2baa.
00000020:00000040:23.0:1773851896.563397:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b03e6cfc : new refcount 602
00000100:00000001:23.0:1773851896.563397:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851896.563397:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851896.563397:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851896.563398:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000046fc95f4 nid 13234@kfi7 refs 2
00000800:00000200:21.0:1773851896.563400:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 13234@kfi7(000000008bcfb98f):0x0 lsk 444 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1bb Transaction freed
00000800:00000200:13.0:1773851896.566793:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851896.566794:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851896.566795:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851896.566798:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851896.566799:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18336@kfi7 to cpt 3
00000400:00000200:13.0:1773851896.566801:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18336@kfi7 : PUT - for me
00000400:00000200:13.0:1773851896.566801:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18336@kfi7 to cpt 3
00000400:00000200:13.0:1773851896.566803:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 1
00000400:00000200:13.0:1773851896.566804:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18336@kfi7 to cpt 3
00000400:00000200:13.0:1773851896.566804:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 2
00000400:00000200:13.0:1773851896.566806:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 3
00000400:00000200:13.0:1773851896.566806:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18273@kfi7 to cpt 3
00000400:00000200:13.0:1773851896.566807:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18273@kfi7 of length 224 into portal 12 MB=0x69b4b8c267440
00000400:00000200:13.0:1773851896.566808:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18273@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 57880
00000800:00000200:13.0:1773851896.566810:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851896.566813:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851896.566814:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18336@kfi7: PUT: OK
00000100:00000001:13.0:1773851896.566815:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851896.566815:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851896.566816:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000008c410f7.
00000100:00000040:13.0:1773851896.566817:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000008c410f7 x1859598636446784 msgsize 224
00000100:00100000:13.0:1773851896.566818:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18273@kfi7 (source: 12345-18336@kfi7)
00000100:00000001:13.0:1773851896.566819:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851896.566820:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 2
00000800:00000200:13.0:1773851896.566821:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851896.566821:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851896.566822:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851896.566823:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851896.566823:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851896.566825:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851896.566826:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598636446784
00000020:00000001:12.0:1773851896.566826:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851896.566827:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e544
00000020:00000001:12.0:1773851896.566828:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851896.566831:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e94b4037 refcount=5
00000020:00000001:12.0:1773851896.566832:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637096813776896 : -106976895774720 : ffff9eb48020d000)
00000020:00000001:12.0:1773851896.566833:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637096813776896 : -106976895774720 : ffff9eb48020d000)
00000100:00000001:12.0:1773851896.566834:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851896.566835:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851896.566836:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000760fdc85.
00000020:00000010:12.0:1773851896.566837:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851896.566838:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000068cea08.
00000100:00000001:12.0:1773851896.566839:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851896.566839:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851896.566840:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851896.566841:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851896.566842:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851896.566842:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.566843:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851896.566845:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851896.566846:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851896.566846:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851896.566847:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851896.566847:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18273@kfi7, seq: 2289930
00000100:00000040:12.0:1773851896.566847:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e94b4037 : new rpc_count 1
00000100:00000001:15.0:1773851896.566848:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.566848:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636950415870208 : -107123293681408 : ffff9e926a220900)
00000100:00000001:15.0:1773851896.566849:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851896.566849:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000008c410f7 x1859598636446784/t0(0) o400->bf46027b-0455-4a75-a9c5-a21ffde8baaa@18273@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1632-0'
00000100:00000001:12.0:1773851896.566852:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851896.566853:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851896.566854:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008c410f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bf46027b-0455-4a75-a9c5-a21ffde8baaa+5:39572:x1859598636446784:12345-18273@kfi7:400:default-tuolumne1632-0
00000100:00000200:12.0:1773851896.566855:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598636446784
00000020:00000001:12.0:1773851896.566855:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851896.566856:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851896.566857:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.566858:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851896.566858:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851896.566859:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851896.566860:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598636446784, found 0 last_xid 1859598636446783
00000020:00000001:12.0:1773851896.566860:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851896.566861:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851896.566861:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851896.566862:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.566863:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851896.566863:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851896.566864:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851896.566864:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b340e1ba.
02000000:00000001:12.0:1773851896.566865:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.566866:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.566866:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851896.566867:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260598457, transno 0, xid 1859598636446784
00010000:00000001:12.0:1773851896.566868:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851896.566869:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000008c410f7 x1859598636446784/t0(0) o400->bf46027b-0455-4a75-a9c5-a21ffde8baaa@18273@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1632-0'
00010000:00000001:12.0:1773851896.566871:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851896.566872:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851896.566873:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=129 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851896.566874:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851896.566874:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009d29812d refcount 3 to 18273@kfi7
00000100:00000001:12.0:1773851896.566875:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642471200 : -107157067080416 : ffff9e8a8d14dd20)
02000000:00000001:12.0:1773851896.566876:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851896.566876:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.566877:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851896.566878:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18336@kfi7
00000400:00000010:12.0:1773851896.566879:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064f2b75b.
00000100:00000200:12.0:1773851896.566880:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598636446784, offset 224
00000400:00000200:12.0:1773851896.566881:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18336@kfi7
00000400:00000200:12.0:1773851896.566883:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18336@kfi7 to cpt 3
00000400:00000200:12.0:1773851896.566884:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 1
00000400:00000200:12.0:1773851896.566885:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 2
00000400:00000200:12.0:1773851896.566886:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 3
00000400:00000200:12.0:1773851896.566887:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18336@kfi7 local destination
00000400:00000200:12.0:1773851896.566889:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770227:8770227:1024:4294967295] 18336@kfi7 LPNI seq info [8429379:8429379:16:4294967295]
00000400:00000200:12.0:1773851896.566890:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 2
00000400:00000200:12.0:1773851896.566891:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18336@kfi7 to cpt 3
00000400:00000200:12.0:1773851896.566893:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18336@kfi7(18336@kfi7:18336@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851896.566894:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 3
00000800:00000200:12.0:1773851896.566896:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851896.566897:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851896.566899:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851896.566901:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004ac Using peer 18336@kfi7(0x1000000000004ac)
00000800:00000200:12.0:1773851896.566905:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0x1000000000004ac: rc=0
00000800:00000200:12.0:1773851896.566906:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004ac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851896.566908:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851896.566909:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009d29812d refcount 2 to 18273@kfi7
00010000:00000001:12.0:1773851896.566910:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851896.566910:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.566911:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851896.566911:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000008c410f7 x1859598636446784/t0(0) o400->bf46027b-0455-4a75-a9c5-a21ffde8baaa@18273@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1632-0'
00000100:00100000:12.0:1773851896.566916:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008c410f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bf46027b-0455-4a75-a9c5-a21ffde8baaa+5:39572:x1859598636446784:12345-18273@kfi7:400:default-tuolumne1632-0 Request processed in 63us (99us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851896.566918:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18273@kfi7, seq: 2289930
00000100:00000040:12.0:1773851896.566919:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e94b4037 : new rpc_count 0
00000100:00000001:12.0:1773851896.566920:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851896.566920:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851896.566921:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851896.566922:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000068cea08.
00000020:00000010:12.0:1773851896.566923:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000760fdc85.
00000020:00000040:12.0:1773851896.566924:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000e94b4037 : new refcount 4
00000100:00000001:12.0:1773851896.566924:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851896.566930:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004ac TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851896.566932:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851896.566933:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18336@kfi7: PUT: OK
00000400:00000200:14.0:1773851896.566934:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064f2b75b
00000400:00000010:14.0:1773851896.566934:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064f2b75b.
00000100:00000001:14.0:1773851896.566935:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851896.566935:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851896.566936:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001ef3e4b4 nid 18336@kfi7 refs 2
00000800:00000200:14.0:1773851896.566938:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 18336@kfi7(000000001626eafd):0x0 lsk 1197 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000004ac Transaction freed
00010000:00000010:23.1:1773851896.568728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000833b1c32.
00010000:00000010:23.1:1773851896.568729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000fc994730.
00010000:00000010:23.1:1773851896.568730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000003c375dc8.
00010000:00000010:23.1:1773851896.568730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000004040a90b.
00000800:00000200:9.0:1773851896.570711:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851896.570712:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851896.570714:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851896.570719:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851896.570723:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.570730:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9264@kfi7 : PUT - for me
00000400:00000200:9.0:1773851896.570732:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.570733:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 1
00000400:00000200:9.0:1773851896.570735:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.570736:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000400:00000200:9.0:1773851896.570737:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 3
00000400:00000200:9.0:1773851896.570739:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.570740:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9264@kfi7 of length 224 into portal 12 MB=0x69b823405adc0
00000400:00000200:9.0:1773851896.570743:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9264@kfi7 of length 224/224 into md 0x78146ce49 [64] + 161256
00000800:00000200:9.0:1773851896.570746:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851896.570748:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851896.570750:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9264@kfi7: PUT: OK
00000100:00000001:9.0:1773851896.570752:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851896.570752:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851896.570754:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003a5799f1.
00000100:00000040:9.0:1773851896.570755:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000003a5799f1 x1859833381105088 msgsize 224
00000100:00100000:9.0:1773851896.570757:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-9264@kfi7 (source: 12345-9264@kfi7)
00000100:00000001:9.0:1773851896.570759:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851896.570760:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000100:00000001:11.0:1773851896.570761:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851896.570762:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851896.570762:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851896.570763:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851896.570764:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851896.570765:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851896.570766:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833381105088
00000020:00000001:11.0:1773851896.570767:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851896.570768:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c176764
00000020:00000001:11.0:1773851896.570769:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851896.570772:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004cf60823 refcount=5
00000020:00000001:11.0:1773851896.570773:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029411901440 : -107044297650176 : ffff9ea4cea9d000)
00000020:00000001:11.0:1773851896.570775:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029411901440 : -107044297650176 : ffff9ea4cea9d000)
00000100:00000001:11.0:1773851896.570777:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851896.570778:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851896.570779:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089741d53.
00000020:00000010:11.0:1773851896.570780:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000294d77b2.
00000020:00000010:11.0:1773851896.570781:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000042f6f3b2.
00000100:00000001:11.0:1773851896.570783:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851896.570784:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851896.570784:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851896.570786:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851896.570787:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851896.570787:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.570789:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851896.570790:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851896.570790:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851896.570791:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851896.570791:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851896.570792:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9264@kfi7, seq: 2130871
00000100:00000001:11.0:1773851896.570794:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851896.570794:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004cf60823 : new rpc_count 1
00000100:00000001:8.0:1773851896.570794:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609059328 : -107064100492288 : ffff9ea032526c00)
00000100:00000001:11.0:1773851896.570795:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851896.570796:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003a5799f1 x1859833381105088/t0(0) o400->eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960@9264@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1069-0'
00000100:00000001:8.0:1773851896.570800:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851896.570800:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851896.570801:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003a5799f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960+5:39692:x1859833381105088:12345-9264@kfi7:400:default-tuolumne1069-0
00000100:00000200:8.0:1773851896.570803:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833381105088
00000020:00000001:8.0:1773851896.570803:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851896.570804:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851896.570805:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851896.570806:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851896.570806:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851896.570807:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851896.570808:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833381105088, found 0 last_xid 1859833381105087
00000020:00000001:8.0:1773851896.570809:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851896.570810:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851896.570810:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851896.570811:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851896.570812:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851896.570812:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851896.570813:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851896.570814:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d6a33b7b.
02000000:00000001:8.0:1773851896.570814:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851896.570815:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851896.570816:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851896.570816:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413770366, transno 0, xid 1859833381105088
00010000:00000001:8.0:1773851896.570817:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851896.570818:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003a5799f1 x1859833381105088/t0(0) o400->eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960@9264@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1069-0'
00010000:00000001:8.0:1773851896.570821:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851896.570821:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851896.570822:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=129 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851896.570823:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851896.570824:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cbd0f9ff refcount 3 to 9264@kfi7
00000100:00000001:8.0:1773851896.570825:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899611904 : -107146809939712 : ffff9e8cf0746900)
02000000:00000001:8.0:1773851896.570826:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851896.570827:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851896.570828:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851896.570829:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9264@kfi7
00000400:00000010:8.0:1773851896.570830:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000308c1686.
00000100:00000200:8.0:1773851896.570831:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833381105088, offset 224
00000400:00000200:8.0:1773851896.570833:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9264@kfi7
00000400:00000200:8.0:1773851896.570834:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:8.0:1773851896.570835:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 1
00000400:00000200:8.0:1773851896.570836:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000400:00000200:8.0:1773851896.570838:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 3
00000400:00000200:8.0:1773851896.570839:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9264@kfi7 local destination
00000400:00000200:8.0:1773851896.570841:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770228:8770228:1024:4294967295] 9264@kfi7 LPNI seq info [980449:980449:16:4294967295]
00000400:00000200:8.0:1773851896.570843:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000400:00000200:8.0:1773851896.570843:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9264@kfi7 to cpt 2
00000400:00000200:8.0:1773851896.570846:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9264@kfi7(9264@kfi7:9264@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851896.570847:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 3
00000800:00000200:8.0:1773851896.570849:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851896.570850:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851896.570853:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851896.570856:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x758 Using peer 9264@kfi7(0x758)
00000800:00000200:8.0:1773851896.570860:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x758: rc=0
00000800:00000200:8.0:1773851896.570861:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x758 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851896.570864:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851896.570865:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cbd0f9ff refcount 2 to 9264@kfi7
00010000:00000001:8.0:1773851896.570866:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851896.570866:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851896.570867:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851896.570868:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003a5799f1 x1859833381105088/t0(0) o400->eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960@9264@kfi7:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1069-0'
00000100:00100000:8.0:1773851896.570874:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003a5799f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:eb9c6cb3-16f3-45ef-8fa4-d3b7fea23960+5:39692:x1859833381105088:12345-9264@kfi7:400:default-tuolumne1069-0 Request processed in 73us (118us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851896.570876:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9264@kfi7, seq: 2130871
00000100:00000040:8.0:1773851896.570877:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004cf60823 : new rpc_count 0
00000100:00000001:8.0:1773851896.570878:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851896.570879:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851896.570880:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000294d77b2.
00000020:00000010:8.0:1773851896.570881:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000042f6f3b2.
00000020:00000010:8.0:1773851896.570882:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089741d53.
00000020:00000040:8.0:1773851896.570883:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000004cf60823 : new refcount 4
00000100:00000001:8.0:1773851896.570884:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851896.570891:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x758 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851896.570894:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851896.570896:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9264@kfi7: PUT: OK
00000400:00000200:9.0:1773851896.570897:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000308c1686
00000400:00000010:9.0:1773851896.570898:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000308c1686.
00000100:00000001:9.0:1773851896.570901:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851896.570901:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851896.570903:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a09b9dcd nid 9264@kfi7 refs 2
00000800:00000200:9.0:1773851896.570906:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 9264@kfi7(00000000d51d1558):0x0 lsk 1881 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x758 Transaction freed
00000800:00000200:9.0:1773851896.589099:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851896.589099:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851896.589101:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851896.589103:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851896.589104:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.589105:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.111@tcp : PUT - for me
00000400:00000200:9.0:1773851896.589106:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.589107:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851896.589108:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.111@tcp to cpt 3
00000400:00000200:9.0:1773851896.589109:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068d9cd05 nid 172.16.70.111@tcp refs 2
00000400:00000200:9.0:1773851896.589110:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000068d9cd05 nid 172.16.70.111@tcp refs 3
00000400:00000200:9.0:1773851896.589111:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.111@tcp to cpt 3
00000400:00000200:9.0:1773851896.589112:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.111@tcp of length 224 into portal 12 MB=0x69a0e82753480
00000400:00000200:9.0:1773851896.589113:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.111@tcp of length 224/224 into md 0x82a36e8ed [64] + 58104
00000800:00000200:9.0:1773851896.589115:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851896.589117:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851896.589117:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851896.589118:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851896.589119:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851896.589120:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1441ba3.
00000100:00000040:9.0:1773851896.589120:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f1441ba3 x1858236969202816 msgsize 224
00000100:00100000:9.0:1773851896.589122:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.111@tcp (source: 12345-172.16.70.111@tcp)
00000100:00000001:9.0:1773851896.589123:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851896.589124:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:12.0:1773851896.589126:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851896.589126:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851896.589127:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851896.589127:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851896.589128:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851896.589128:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851896.589129:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858236969202816
00000020:00000001:12.0:1773851896.589130:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851896.589130:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930ad
00000020:00000001:12.0:1773851896.589131:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851896.589133:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000563c0c13 refcount=6
00000020:00000001:12.0:1773851896.589134:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745151488 : -107128964400128 : ffff9e911821bc00)
00000020:00000001:12.0:1773851896.589134:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745151488 : -107128964400128 : ffff9e911821bc00)
00000100:00000001:12.0:1773851896.589135:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851896.589136:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851896.589137:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000760fdc85.
00000020:00000010:12.0:1773851896.589138:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851896.589138:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000068cea08.
00000100:00000001:12.0:1773851896.589139:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851896.589140:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851896.589140:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851896.589141:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851896.589142:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851896.589142:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.589143:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851896.589144:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851896.589144:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851896.589145:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851896.589145:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851896.589146:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.111@tcp, seq: 2289931
00000100:00000040:12.0:1773851896.589146:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000563c0c13 : new rpc_count 1
00000100:00000001:15.0:1773851896.589147:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851896.589147:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.589147:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609055872 : -107064100495744 : ffff9ea032525e80)
00000100:00000040:12.0:1773851896.589148:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f1441ba3 x1858236969202816/t0(0) o400->0d07d78f-6b03-40db-9cb9-91ad0702def5@172.16.70.111@tcp:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-rzslic11-0'
00000100:00000001:12.0:1773851896.589151:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851896.589152:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851896.589153:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1441ba3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:0d07d78f-6b03-40db-9cb9-91ad0702def5+6:49992:x1858236969202816:12345-172.16.70.111@tcp:400:default-rzslic11-0
00000100:00000200:12.0:1773851896.589154:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858236969202816
00000020:00000001:12.0:1773851896.589155:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851896.589155:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851896.589156:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.589157:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851896.589157:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851896.589158:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851896.589158:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858236969202816, found 0 last_xid 1858236969202815
00000020:00000001:12.0:1773851896.589159:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851896.589159:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851896.589160:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851896.589160:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.589161:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851896.589161:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851896.589162:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851896.589163:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f1a580fd.
02000000:00000001:12.0:1773851896.589163:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.589164:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.589165:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851896.589165:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858236969202816
00010000:00000001:12.0:1773851896.589166:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851896.589167:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f1441ba3 x1858236969202816/t0(0) o400->0d07d78f-6b03-40db-9cb9-91ad0702def5@172.16.70.111@tcp:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic11-0'
00010000:00000001:12.0:1773851896.589169:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851896.589169:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851896.589170:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=129 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851896.589171:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851896.589172:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ea7248bf refcount 3 to 172.16.70.111@tcp
00000100:00000001:12.0:1773851896.589172:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811152128 : -107154898399488 : ffff9e8b0e584f00)
02000000:00000001:12.0:1773851896.589173:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851896.589174:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851896.589174:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851896.589175:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.111@tcp
00000400:00000010:12.0:1773851896.589176:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000072e7751.
00000100:00000200:12.0:1773851896.589177:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858236969202816, offset 224
00000400:00000200:12.0:1773851896.589178:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.111@tcp
00000400:00000200:12.0:1773851896.589179:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.111@tcp to cpt 3
00000400:00000200:12.0:1773851896.589180:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000068d9cd05 nid 172.16.70.111@tcp refs 2
00000400:00000200:12.0:1773851896.589181:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000068d9cd05 nid 172.16.70.111@tcp refs 3
00000400:00000200:12.0:1773851896.589183:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000068d9cd05 nid 172.16.70.111@tcp refs 4
00000400:00000200:12.0:1773851896.589184:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.111@tcp routed destination
00000400:00000200:12.0:1773851896.589185:0:60487:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:12.0:1773851896.589186:0:60487:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:12.0:1773851896.589187:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.111@tcp: rtr pref emtpy: 1
00000400:00000200:12.0:1773851896.589188:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:12.0:1773851896.589189:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.111@tcp: rtr pref emtpy: 1
00000400:00000200:12.0:1773851896.589190:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:12.0:1773851896.589191:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770229:8770229:1024:4294967295] 2094@kfi7 LPNI seq info [1258747024:1258747024:16:4294967295]
00000400:00000200:12.0:1773851896.589193:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:12.0:1773851896.589194:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:12.0:1773851896.589196:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.111@tcp(172.16.70.111@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851896.589198:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000068d9cd05 nid 172.16.70.111@tcp refs 3
00000800:00000200:12.0:1773851896.589199:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851896.589200:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851896.589202:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851896.589205:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:12.0:1773851896.589207:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:12.0:1773851896.589209:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851896.589211:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851896.589211:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ea7248bf refcount 2 to 172.16.70.111@tcp
00010000:00000001:12.0:1773851896.589212:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851896.589212:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851896.589215:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851896.589215:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1441ba3 x1858236969202816/t0(0) o400->0d07d78f-6b03-40db-9cb9-91ad0702def5@172.16.70.111@tcp:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-rzslic11-0'
00000100:00100000:12.0:1773851896.589218:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1441ba3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:0d07d78f-6b03-40db-9cb9-91ad0702def5+6:49992:x1858236969202816:12345-172.16.70.111@tcp:400:default-rzslic11-0 Request processed in 66us (97us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851896.589221:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.111@tcp, seq: 2289931
00000100:00000040:12.0:1773851896.589221:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000563c0c13 : new rpc_count 0
00000100:00000001:12.0:1773851896.589222:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851896.589222:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851896.589223:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851896.589224:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000068cea08.
00000020:00000010:12.0:1773851896.589224:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000760fdc85.
00000020:00000040:12.0:1773851896.589225:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000563c0c13 : new refcount 5
00000100:00000001:12.0:1773851896.589225:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851896.589231:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:15.0:1773851896.589233:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851896.589235:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:15.0:1773851896.589236:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000072e7751
00000400:00000010:15.0:1773851896.589237:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000072e7751.
00000100:00000001:15.0:1773851896.589238:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851896.589238:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851896.589239:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:15.0:1773851896.589241:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000000c Transaction freed
00000800:00000200:17.0:1773851896.627968:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851896.627969:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851896.627971:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851896.627973:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851896.627975:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12752@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.627977:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12752@kfi7 : PUT - for me
00000400:00000200:17.0:1773851896.627978:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12752@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.627979:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077edf335 nid 12752@kfi7 refs 1
00000400:00000200:17.0:1773851896.627980:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12752@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.627981:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077edf335 nid 12752@kfi7 refs 2
00000400:00000200:17.0:1773851896.627982:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000077edf335 nid 12752@kfi7 refs 3
00000400:00000200:17.0:1773851896.627983:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12753@kfi7 to cpt 7
00000400:00000200:17.0:1773851896.627984:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12753@kfi7 of length 224 into portal 12 MB=0x69b093c6bde80
00000400:00000200:17.0:1773851896.627985:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12753@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 45008
00000800:00000200:17.0:1773851896.627987:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851896.627989:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851896.627990:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12752@kfi7: PUT: OK
00000100:00000001:17.0:1773851896.627992:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851896.627992:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851896.627993:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000093230709.
00000100:00000040:17.0:1773851896.627994:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000093230709 x1859313830977152 msgsize 224
00000100:00100000:17.0:1773851896.627997:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12753@kfi7 (source: 12345-12752@kfi7)
00000100:00000001:17.0:1773851896.627999:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851896.628000:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000077edf335 nid 12752@kfi7 refs 2
00000100:00000001:19.0:1773851896.628001:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851896.628002:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851896.628003:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851896.628003:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851896.628004:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851896.628005:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851896.628006:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313830977152
00000020:00000001:19.0:1773851896.628007:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851896.628007:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c07
00000020:00000001:19.0:1773851896.628008:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851896.628012:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000076d9c569 refcount=6
00000020:00000001:19.0:1773851896.628013:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743939072 : -107128965612544 : ffff9e91180f3c00)
00000020:00000001:19.0:1773851896.628014:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743939072 : -107128965612544 : ffff9e91180f3c00)
00000100:00000001:19.0:1773851896.628016:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851896.628017:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851896.628018:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851896.628020:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851896.628021:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c89cf037.
00000100:00000001:19.0:1773851896.628023:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851896.628024:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851896.628025:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851896.628026:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851896.628027:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851896.628028:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.628030:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851896.628032:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851896.628032:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851896.628033:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851896.628033:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851896.628036:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12753@kfi7, seq: 2156425
00000100:00000001:19.0:1773851896.628038:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851896.628038:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000076d9c569 : new rpc_count 1
00000100:00000001:19.0:1773851896.628039:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.628039:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968752000 : -106974740799616 : ffff9eb500931f80)
00000100:00000040:16.0:1773851896.628042:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000093230709 x1859313830977152/t0(0) o400->6556e059-d7d1-4c0d-bbb2-61d44ef7cf3d@12753@kfi7:148/0 lens 224/0 e 0 to 0 dl 1773852263 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1281-0'
00000100:00000001:16.0:1773851896.628047:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851896.628048:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851896.628050:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093230709 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:6556e059-d7d1-4c0d-bbb2-61d44ef7cf3d+6:39647:x1859313830977152:12345-12753@kfi7:400:default-tuolumne1281-0
00000100:00000200:16.0:1773851896.628053:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313830977152
00000020:00000001:16.0:1773851896.628054:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851896.628055:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851896.628057:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.628058:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851896.628059:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851896.628060:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851896.628061:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313830977152, found 0 last_xid 1859313830977151
00000020:00000001:16.0:1773851896.628063:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851896.628064:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851896.628065:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851896.628066:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.628068:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851896.628069:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851896.628070:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851896.628071:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000087d99a71.
02000000:00000001:16.0:1773851896.628072:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.628074:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.628075:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851896.628076:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096697043, transno 0, xid 1859313830977152
00010000:00000001:16.0:1773851896.628078:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851896.628079:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000093230709 x1859313830977152/t0(0) o400->6556e059-d7d1-4c0d-bbb2-61d44ef7cf3d@12753@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1281-0'
00010000:00000001:16.0:1773851896.628085:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851896.628086:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851896.628087:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=129 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851896.628090:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851896.628091:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a769090c refcount 3 to 12753@kfi7
00000100:00000001:16.0:1773851896.628092:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269568 : -107152618282048 : ffff9e8b964023c0)
02000000:00000001:16.0:1773851896.628094:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851896.628095:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.628096:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851896.628098:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12752@kfi7
00000400:00000010:16.0:1773851896.628099:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f39207ae.
00000100:00000200:16.0:1773851896.628100:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859313830977152, offset 224
00000400:00000200:16.0:1773851896.628103:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12752@kfi7
00000400:00000200:16.0:1773851896.628105:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12752@kfi7 to cpt 4
00000400:00000200:16.0:1773851896.628107:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000077edf335 nid 12752@kfi7 refs 1
00000400:00000200:16.0:1773851896.628109:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000077edf335 nid 12752@kfi7 refs 2
00000400:00000200:16.0:1773851896.628111:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000077edf335 nid 12752@kfi7 refs 3
00000400:00000200:16.0:1773851896.628113:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12752@kfi7 local destination
00000400:00000200:16.0:1773851896.628116:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770230:8770230:1024:4294967295] 12752@kfi7 LPNI seq info [364312:364312:16:4294967295]
00000400:00000200:16.0:1773851896.628119:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000077edf335 nid 12752@kfi7 refs 2
00000400:00000200:16.0:1773851896.628120:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12752@kfi7 to cpt 4
00000400:00000200:16.0:1773851896.628125:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12752@kfi7(12752@kfi7:12752@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851896.628127:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000077edf335 nid 12752@kfi7 refs 3
00000800:00000200:16.0:1773851896.628130:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851896.628132:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851896.628137:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851896.628141:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x843 Using peer 12752@kfi7(0x843)
00000800:00000200:16.0:1773851896.628147:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009aebe925: Posted send of 324 bytes to peer 0x843: rc=0
00000800:00000200:16.0:1773851896.628150:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x843 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851896.628160:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851896.628162:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a769090c refcount 2 to 12753@kfi7
00010000:00000001:16.0:1773851896.628163:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851896.628164:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.628166:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851896.628167:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000093230709 x1859313830977152/t0(0) o400->6556e059-d7d1-4c0d-bbb2-61d44ef7cf3d@12753@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1281-0'
00000100:00100000:16.0:1773851896.628173:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093230709 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:6556e059-d7d1-4c0d-bbb2-61d44ef7cf3d+6:39647:x1859313830977152:12345-12753@kfi7:400:default-tuolumne1281-0 Request processed in 125us (178us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851896.628178:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12753@kfi7, seq: 2156425
00000100:00000040:16.0:1773851896.628179:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000076d9c569 : new rpc_count 0
00000100:00000001:16.0:1773851896.628181:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851896.628182:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851896.628183:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:16.0:1773851896.628185:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c89cf037.
00000020:00000010:16.0:1773851896.628187:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000020:00000040:16.0:1773851896.628188:0:61039:0:(genops.c:882:class_export_put()) PUTting export 0000000076d9c569 : new refcount 5
00000100:00000001:16.0:1773851896.628190:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851896.628199:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x843 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851896.628202:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851896.628204:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12752@kfi7: PUT: OK
00000400:00000200:17.0:1773851896.628205:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f39207ae
00000400:00000010:17.0:1773851896.628206:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f39207ae.
00000100:00000001:17.0:1773851896.628208:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851896.628209:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851896.628210:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000077edf335 nid 12752@kfi7 refs 2
00000800:00000200:17.0:1773851896.628213:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009aebe925: 2069@kfi7:4 -> 12752@kfi7(00000000f498f143):0x0 lsk 2116 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x843 Transaction freed
00000800:00000200:17.0:1773851896.634816:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851896.634817:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851896.634819:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851896.634822:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851896.634825:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14226@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.634826:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14226@kfi7 : PUT - for me
00000400:00000200:17.0:1773851896.634828:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14226@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.634829:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069507b08 nid 14226@kfi7 refs 1
00000400:00000200:17.0:1773851896.634830:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14226@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.634831:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069507b08 nid 14226@kfi7 refs 2
00000400:00000200:17.0:1773851896.634832:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000069507b08 nid 14226@kfi7 refs 3
00000400:00000200:17.0:1773851896.634834:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14226@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.634835:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14226@kfi7 of length 224 into portal 12 MB=0x69b4b9dcbd880
00000400:00000200:17.0:1773851896.634837:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14226@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 45232
00000800:00000200:17.0:1773851896.634839:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851896.634841:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851896.634843:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14226@kfi7: PUT: OK
00000100:00000001:17.0:1773851896.634844:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851896.634845:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851896.634846:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000028e478f5.
00000100:00000040:17.0:1773851896.634846:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000028e478f5 x1859598932498560 msgsize 224
00000100:00100000:17.0:1773851896.634849:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-14226@kfi7 (source: 12345-14226@kfi7)
00000100:00000001:17.0:1773851896.634850:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851896.634851:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000069507b08 nid 14226@kfi7 refs 2
00000100:00000001:16.0:1773851896.634852:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851896.634853:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851896.634853:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851896.634854:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851896.634854:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851896.634856:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851896.634857:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598932498560
00000020:00000001:16.0:1773851896.634858:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851896.634858:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389312e5
00000020:00000001:16.0:1773851896.634859:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851896.634862:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ed403f88 refcount=5
00000020:00000001:16.0:1773851896.634863:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637140658992128 : -106933050559488 : ffff9ebeb581b400)
00000020:00000001:16.0:1773851896.634865:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637140658992128 : -106933050559488 : ffff9ebeb581b400)
00000100:00000001:16.0:1773851896.634866:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851896.634868:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851896.634870:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6dc2e6b.
00000020:00000010:16.0:1773851896.634871:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851896.634872:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3ff1402.
00000100:00000001:16.0:1773851896.634873:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851896.634874:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851896.634874:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851896.634876:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851896.634876:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851896.634877:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.634878:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851896.634880:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851896.634880:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851896.634881:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851896.634881:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851896.634882:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14226@kfi7, seq: 2156426
00000100:00000001:19.0:1773851896.634883:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851896.634883:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ed403f88 : new rpc_count 1
00000100:00000001:19.0:1773851896.634884:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.634884:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968745088 : -106974740806528 : ffff9eb500930480)
00000100:00000040:16.0:1773851896.634886:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000028e478f5 x1859598932498560/t0(0) o400->e6535dd3-5e34-491c-95db-7528ce3725b2@14226@kfi7:148/0 lens 224/0 e 0 to 0 dl 1773852263 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1382-0'
00000100:00000001:16.0:1773851896.634891:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851896.634891:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851896.634892:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000028e478f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e6535dd3-5e34-491c-95db-7528ce3725b2+5:39451:x1859598932498560:12345-14226@kfi7:400:default-tuolumne1382-0
00000100:00000200:16.0:1773851896.634895:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598932498560
00000020:00000001:16.0:1773851896.634895:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851896.634896:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851896.634897:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.634898:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851896.634899:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851896.634900:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851896.634901:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598932498560, found 0 last_xid 1859598932498559
00000020:00000001:16.0:1773851896.634902:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851896.634903:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851896.634904:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851896.634904:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.634906:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851896.634907:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851896.634907:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851896.634909:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000069c89c55.
02000000:00000001:16.0:1773851896.634910:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.634910:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.634911:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851896.634913:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182679846896, transno 0, xid 1859598932498560
00010000:00000001:16.0:1773851896.634914:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851896.634915:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000028e478f5 x1859598932498560/t0(0) o400->e6535dd3-5e34-491c-95db-7528ce3725b2@14226@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1382-0'
00010000:00000001:16.0:1773851896.634919:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851896.634920:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851896.634921:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=129 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851896.634923:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851896.634924:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c6da129e refcount 3 to 14226@kfi7
00000100:00000001:16.0:1773851896.634925:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518144 : -107156126033472 : ffff9e8ac52c19c0)
02000000:00000001:16.0:1773851896.634926:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851896.634927:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.634927:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851896.634929:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14226@kfi7
00000400:00000010:16.0:1773851896.634929:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018de6a4d.
00000100:00000200:16.0:1773851896.634931:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598932498560, offset 224
00000400:00000200:16.0:1773851896.634933:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14226@kfi7
00000400:00000200:16.0:1773851896.634934:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14226@kfi7 to cpt 4
00000400:00000200:16.0:1773851896.634935:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069507b08 nid 14226@kfi7 refs 1
00000400:00000200:16.0:1773851896.634937:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000069507b08 nid 14226@kfi7 refs 2
00000400:00000200:16.0:1773851896.634938:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000069507b08 nid 14226@kfi7 refs 3
00000400:00000200:16.0:1773851896.634940:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14226@kfi7 local destination
00000400:00000200:16.0:1773851896.634943:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770231:8770231:1024:4294967295] 14226@kfi7 LPNI seq info [621158:621158:16:4294967295]
00000400:00000200:16.0:1773851896.634945:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000069507b08 nid 14226@kfi7 refs 2
00000400:00000200:16.0:1773851896.634946:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14226@kfi7 to cpt 4
00000400:00000200:16.0:1773851896.634949:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14226@kfi7(14226@kfi7:14226@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851896.634952:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000069507b08 nid 14226@kfi7 refs 3
00000800:00000200:16.0:1773851896.634954:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851896.634955:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851896.634959:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851896.634964:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b6 Using peer 14226@kfi7(0x1000000000007b6)
00000800:00000200:16.0:1773851896.634969:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x1000000000007b6: rc=0
00000800:00000200:16.0:1773851896.634972:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851896.634975:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851896.634976:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c6da129e refcount 2 to 14226@kfi7
00010000:00000001:16.0:1773851896.634978:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851896.634978:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851896.634979:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851896.634983:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000028e478f5 x1859598932498560/t0(0) o400->e6535dd3-5e34-491c-95db-7528ce3725b2@14226@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1382-0'
00000100:00100000:16.0:1773851896.634989:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000028e478f5 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e6535dd3-5e34-491c-95db-7528ce3725b2+5:39451:x1859598932498560:12345-14226@kfi7:400:default-tuolumne1382-0 Request processed in 97us (141us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851896.634993:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14226@kfi7, seq: 2156426
00000100:00000040:16.0:1773851896.634994:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ed403f88 : new rpc_count 0
00000100:00000001:16.0:1773851896.634995:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851896.634996:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851896.634997:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851896.634998:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3ff1402.
00000020:00000010:16.0:1773851896.635000:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6dc2e6b.
00000020:00000040:16.0:1773851896.635001:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000ed403f88 : new refcount 4
00000100:00000001:16.0:1773851896.635002:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851896.635012:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b6 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851896.635015:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851896.635017:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14226@kfi7: PUT: OK
00000400:00000200:17.0:1773851896.635018:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018de6a4d
00000400:00000010:17.0:1773851896.635019:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018de6a4d.
00000100:00000001:17.0:1773851896.635020:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851896.635021:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851896.635022:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000069507b08 nid 14226@kfi7 refs 2
00000800:00000200:17.0:1773851896.635025:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2054@kfi7:4 -> 14226@kfi7(00000000ff6de991):0x0 lsk 1975 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007b6 Transaction freed
00000004:00000001:11.0:1773851896.649732:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851896.649733:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851896.649734:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000eca030e.
00000020:00000040:11.0:1773851896.649734:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851896.649736:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851896.649737:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851896.649738:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851896.649739:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000171bdcdb.
00000100:00000001:11.0:1773851896.649740:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.649741:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851896.649741:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851896.649743:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000eca030e] to pc [ptlrpcd_02_00+0]  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851896.649747:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:11.0:1773851896.649748:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d8ae88e6.
00000100:00000001:10.0:1773851896.649748:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851896.649749:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637051287341056 : -107022422210560 : ffff9ea9e68a8800)
00000100:00100000:10.0:1773851896.649749:0:41069:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:10.0:1773851896.649749:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851896.649749:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851896.649750:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851896.649750:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851896.649751:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851896.649751:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851896.649751:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000004:00001000:11.0:1773851896.649752:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000004:00000010:11.0:1773851896.649752:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b8a509c4.
00000100:00000001:10.0:1773851896.649752:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851896.649752:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00080000:11.0:1773851896.649753:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614171103028897ns, next at 614172103027725ns, rc = 0
00000100:00000001:10.0:1773851896.649753:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:11.0:1773851896.649754:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:10.0:1773851896.649754:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851896.649755:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851896.649756:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851896.649757:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851896.649757:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851896.649758:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:10.0:1773851896.649759:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851896.649760:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000eca030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051940288:2075@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851896.649761:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851896.649762:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851896.649763:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851896.649763:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:10.0:1773851896.649765:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000009b6047fd.
02000000:00000001:10.0:1773851896.649765:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851896.649766:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:10.0:1773851896.649767:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000400:00000010:10.0:1773851896.649768:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000200:10.0:1773851896.649769:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940288, portal 4
00000100:00000001:10.0:1773851896.649770:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851896.649770:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446615680 : -106937262935936 : ffff9ebdba6df080)
00000100:00000040:10.0:1773851896.649771:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851896.649774:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851896.649775:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:10.0:1773851896.649775:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e53ad71d.
00000100:00000200:10.0:1773851896.649776:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940288, offset 0
00000400:00000200:10.0:1773851896.649778:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:10.0:1773851896.649779:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.649780:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:10.0:1773851896.649781:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851896.649782:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:10.0:1773851896.649783:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:10.0:1773851896.649784:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770230, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770231, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851896.649786:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:10.0:1773851896.649787:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851896.649788:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:10.0:1773851896.649789:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770232:8770232:1024:4294967295] 2075@kfi7 LPNI seq info [5403917:5403917:16:4294967295]
00000400:00000200:10.0:1773851896.649790:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851896.649791:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.649794:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851896.649795:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:10.0:1773851896.649797:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851896.649798:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851896.649800:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851896.649803:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Using peer 2075@kfi7(0x4e8)
00000800:00000200:10.0:1773851896.649806:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d35a17e8: Posted send of 324 bytes to peer 0x4e8: rc=0
00000800:00000200:10.0:1773851896.649808:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851896.649810:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851896.649811:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851896.649811:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851896.649812:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851896.649813:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851896.649819:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851896.649821:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851896.649822:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000400:00000200:11.0:1773851896.649823:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e53ad71d
00000400:00000010:11.0:1773851896.649824:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e53ad71d.
00000100:00000001:11.0:1773851896.649825:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:11.0:1773851896.649826:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851896.649829:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851896.649829:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851896.649832:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.649833:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851896.649834:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:11.0:1773851896.649835:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d35a17e8: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Transaction freed
00000800:00000200:10.0:1773851896.649909:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851896.649910:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851896.649912:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851896.649914:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851896.649916:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.649918:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:10.0:1773851896.649919:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.649920:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:10.0:1773851896.649920:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.649921:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851896.649922:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:10.0:1773851896.649923:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.649924:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b65c0
00000400:00000200:10.0:1773851896.649926:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851896.649927:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781698ee9 [1] + 224
00000800:00000200:10.0:1773851896.649929:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851896.649930:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851896.649931:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000100:00000001:10.0:1773851896.649933:0:2464469:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851896.649933:0:2464469:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851896.649936:0:2464469:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851896.649939:0:2464469:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:10.0:1773851896.649940:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:10.0:1773851896.649942:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851896.649944:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851896.649945:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:10.0:1773851896.649945:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851896.649946:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851896.649946:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:10.0:1773851896.649947:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851896.649947:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851896.649948:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851896.649948:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851896.649951:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851896.649953:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851896.649954:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851896.649954:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851896.649955:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851896.649955:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851896.649956:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851896.649957:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851896.649958:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=129 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851896.649959:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=129 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851896.649960:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851896.649961:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851896.649961:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851896.649962:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851896.649963:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851896.649963:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:10.0:1773851896.649964:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851896.649964:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851896.649965:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851896.649968:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851896.649968:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851896.649969:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851896.649970:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851896.649970:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851896.649971:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470702592 avail=351461712896 avail_mb=1372897316 hwm_mb=3131103 files=372064442 ffree=343233108 state=0: rc = 0
00000004:00000020:10.0:1773851896.649973:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470702592 free, 351461712896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064442 files, 343233108 free files
00000004:00000001:10.0:1773851896.649974:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851896.649975:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851896.649978:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000eca030e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051940288:2075@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851896.649979:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851896.649979:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851896.649980:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000eca030e x1859433051940288/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852049 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851896.649983:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851896.649983:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851896.649984:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000009b6047fd.
02000000:00000001:10.0:1773851896.649985:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851896.649986:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851896.649986:0:41069:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:10.0:1773851896.649987:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851896.649987:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000171bdcdb.
02000000:00000001:10.0:1773851896.649988:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851896.649989:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851896.649989:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000eca030e.
00000100:00000001:10.0:1773851896.649990:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851896.649991:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851896.649991:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851896.649992:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851896.649992:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851896.649993:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851896.649993:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851896.713735:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851896.713738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:26.0:1773851896.736125:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851896.736126:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851896.736127:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851896.736129:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851896.736131:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9425@kfi7 to cpt 6
00000400:00000200:26.0:1773851896.736133:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9425@kfi7 : PUT - for me
00000400:00000200:26.0:1773851896.736133:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9425@kfi7 to cpt 6
00000400:00000200:26.0:1773851896.736134:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba9f5903 nid 9425@kfi7 refs 1
00000400:00000200:26.0:1773851896.736135:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9425@kfi7 to cpt 6
00000400:00000200:26.0:1773851896.736136:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba9f5903 nid 9425@kfi7 refs 2
00000400:00000200:26.0:1773851896.736137:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ba9f5903 nid 9425@kfi7 refs 3
00000400:00000200:26.0:1773851896.736138:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9424@kfi7 to cpt 3
00000400:00000200:26.0:1773851896.736139:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9424@kfi7 of length 224 into portal 12 MB=0x69a85e35d2880
00000400:00000200:26.0:1773851896.736141:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9424@kfi7 of length 224/224 into md 0x16159c9699 [64] + 38656
00000800:00000200:26.0:1773851896.736143:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851896.736144:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851896.736145:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9425@kfi7: PUT: OK
00000100:00000001:26.0:1773851896.736146:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851896.736147:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851896.736148:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d673ba28.
00000100:00000040:26.0:1773851896.736149:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000d673ba28 x1858749696125056 msgsize 224
00000100:00100000:26.0:1773851896.736150:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9424@kfi7 (source: 12345-9425@kfi7)
00000100:00000001:26.0:1773851896.736151:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851896.736152:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba9f5903 nid 9425@kfi7 refs 2
00000800:00000200:26.0:1773851896.736154:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:27.0:1773851896.736155:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:27.0:1773851896.736156:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:27.0:1773851896.736157:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851896.736158:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851896.736160:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:27.0:1773851896.736161:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858749696125056
00000020:00000001:27.0:1773851896.736162:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:27.0:1773851896.736163:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91865
00000020:00000001:27.0:1773851896.736164:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:27.0:1773851896.736166:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ee59b5de refcount=8
00000020:00000001:27.0:1773851896.736167:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241762816 : -107152467788800 : ffff9e8b9f387c00)
00000020:00000001:27.0:1773851896.736168:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241762816 : -107152467788800 : ffff9e8b9f387c00)
00000100:00000001:27.0:1773851896.736170:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851896.736171:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:27.0:1773851896.736172:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008fcb74e8.
00000020:00000010:27.0:1773851896.736174:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d3c9a084.
00000020:00000010:27.0:1773851896.736175:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000009d0a58f3.
00000100:00000001:27.0:1773851896.736177:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:27.0:1773851896.736179:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:27.0:1773851896.736180:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851896.736182:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:27.0:1773851896.736183:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:27.0:1773851896.736183:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851896.736185:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851896.736187:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851896.736188:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851896.736188:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851896.736189:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851896.736189:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9424@kfi7, seq: 2025180
00000100:00000040:24.0:1773851896.736189:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ee59b5de : new rpc_count 1
00000100:00000001:27.0:1773851896.736190:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.736190:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137189191424 : -106936520360192 : ffff9ebde6b0bf00)
00000100:00000001:27.0:1773851896.736191:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851896.736191:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d673ba28 x1858749696125056/t0(0) o400->ac570c85-47a9-43e5-b335-bd4576ce9c1e@9424@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1073-0'
00000100:00000001:24.0:1773851896.736195:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851896.736195:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851896.736196:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d673ba28 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ac570c85-47a9-43e5-b335-bd4576ce9c1e+8:58147:x1858749696125056:12345-9424@kfi7:400:default-tuolumne1073-0
00000100:00000200:24.0:1773851896.736198:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858749696125056
00000020:00000001:24.0:1773851896.736199:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851896.736200:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851896.736200:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.736201:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851896.736202:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851896.736203:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851896.736203:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858749696125056, found 0 last_xid 1858749619684991
00000020:00000001:24.0:1773851896.736204:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851896.736205:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851896.736205:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851896.736206:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.736207:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851896.736208:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851896.736208:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851896.736209:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000157f1406.
02000000:00000001:24.0:1773851896.736210:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.736210:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.736211:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851896.736212:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252341488, transno 0, xid 1858749696125056
00010000:00000001:24.0:1773851896.736213:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851896.736214:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d673ba28 x1858749696125056/t0(0) o400->ac570c85-47a9-43e5-b335-bd4576ce9c1e@9424@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1073-0'
00010000:00000001:24.0:1773851896.736216:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851896.736217:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851896.736218:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=129 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851896.736219:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851896.736220:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007ec283a3 refcount 3 to 9424@kfi7
00000100:00000001:24.0:1773851896.736221:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298976 : -107155980252640 : ffff9e8acddc8a20)
02000000:00000001:24.0:1773851896.736222:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851896.736222:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.736223:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851896.736224:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9425@kfi7
00000400:00000010:24.0:1773851896.736225:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b572ac3.
00000100:00000200:24.0:1773851896.736226:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858749696125056, offset 224
00000400:00000200:24.0:1773851896.736227:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9425@kfi7
00000400:00000200:24.0:1773851896.736229:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9425@kfi7 to cpt 6
00000400:00000200:24.0:1773851896.736230:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba9f5903 nid 9425@kfi7 refs 1
00000400:00000200:24.0:1773851896.736231:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ba9f5903 nid 9425@kfi7 refs 2
00000400:00000200:24.0:1773851896.736232:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ba9f5903 nid 9425@kfi7 refs 3
00000400:00000200:24.0:1773851896.736234:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9425@kfi7 local destination
00000400:00000200:24.0:1773851896.736235:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770233:8770233:1024:4294967295] 9425@kfi7 LPNI seq info [3332013:3332013:16:4294967295]
00000400:00000200:24.0:1773851896.736237:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ba9f5903 nid 9425@kfi7 refs 2
00000400:00000200:24.0:1773851896.736237:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9425@kfi7 to cpt 6
00000400:00000200:24.0:1773851896.736240:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9425@kfi7(9425@kfi7:9425@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851896.736241:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ba9f5903 nid 9425@kfi7 refs 3
00000800:00000200:24.0:1773851896.736242:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851896.736244:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851896.736246:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851896.736249:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8ac Using peer 9425@kfi7(0x8ac)
00000800:00000200:24.0:1773851896.736252:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x8ac: rc=0
00000800:00000200:24.0:1773851896.736253:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8ac TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851896.736256:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851896.736257:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007ec283a3 refcount 2 to 9424@kfi7
00010000:00000001:24.0:1773851896.736257:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851896.736258:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.736259:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851896.736259:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d673ba28 x1858749696125056/t0(0) o400->ac570c85-47a9-43e5-b335-bd4576ce9c1e@9424@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1073-0'
00000100:00100000:24.0:1773851896.736264:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d673ba28 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:ac570c85-47a9-43e5-b335-bd4576ce9c1e+8:58147:x1858749696125056:12345-9424@kfi7:400:default-tuolumne1073-0 Request processed in 69us (114us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851896.736267:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9424@kfi7, seq: 2025180
00000100:00000040:24.0:1773851896.736268:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ee59b5de : new rpc_count 0
00000100:00000001:24.0:1773851896.736268:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851896.736269:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851896.736270:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d3c9a084.
00000020:00000010:24.0:1773851896.736271:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000009d0a58f3.
00000020:00000010:24.0:1773851896.736272:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008fcb74e8.
00000020:00000040:24.0:1773851896.736272:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ee59b5de : new refcount 7
00000100:00000001:24.0:1773851896.736273:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851896.736279:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8ac TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851896.736280:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851896.736282:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9425@kfi7: PUT: OK
00000400:00000200:25.0:1773851896.736282:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b572ac3
00000400:00000010:25.0:1773851896.736283:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b572ac3.
00000100:00000001:25.0:1773851896.736284:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851896.736284:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851896.736285:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba9f5903 nid 9425@kfi7 refs 2
00000800:00000200:25.0:1773851896.736286:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2069@kfi7:6 -> 9425@kfi7(00000000be5a7182):0x0 lsk 2221 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8ac Transaction freed
00000800:00000200:25.0:1773851896.776186:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851896.776187:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851896.776188:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851896.776190:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851896.776192:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.776193:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851896.776194:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.776195:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851896.776195:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.776196:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851896.776197:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851896.776198:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851896.776199:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a860d3f00
00000400:00000200:25.0:1773851896.776200:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 15512
00000800:00000200:25.0:1773851896.776202:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851896.776203:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851896.776204:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851896.776205:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851896.776205:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851896.776206:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000093414630.
00000100:00000040:25.0:1773851896.776206:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000093414630 x1859388080733952 msgsize 224
00000100:00100000:25.0:1773851896.776208:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851896.776208:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851896.776209:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851896.776211:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000878f9def: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851896.776211:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851896.776212:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851896.776213:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851896.776214:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851896.776215:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851896.776216:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080733952
00000020:00000001:24.0:1773851896.776217:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851896.776217:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:24.0:1773851896.776218:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851896.776219:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:24.0:1773851896.776220:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:24.0:1773851896.776222:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:24.0:1773851896.776223:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851896.776223:0:1537164:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851896.776224:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851896.776226:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851896.776227:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008e4403ff.
00000100:00000040:24.0:1773851896.776229:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851896.776230:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851896.776230:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851896.776231:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.776232:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.776234:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851896.776235:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851896.776236:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851896.776236:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:25.0:1773851896.776237:0:1691804:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799991
00000100:00000040:25.0:1773851896.776237:0:1691804:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:24.0:1773851896.776237:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851896.776237:0:1537164:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851896.776238:0:1691804:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780418816 : -106994929132800 : ffff9eb04d419b00)
00000100:00000001:24.0:1773851896.776238:0:1537164:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851896.776239:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000093414630 x1859388080733952/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:25.0:1773851896.776242:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851896.776242:0:1691804:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:25.0:1773851896.776243:0:1691804:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000093414630 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080733952:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:25.0:1773851896.776244:0:1691804:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080733952
00000020:00000001:25.0:1773851896.776245:0:1691804:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:25.0:1773851896.776245:0:1691804:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:25.0:1773851896.776246:0:1691804:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851896.776246:0:1691804:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:25.0:1773851896.776247:0:1691804:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:25.0:1773851896.776248:0:1691804:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:25.0:1773851896.776248:0:1691804:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:25.0:1773851896.776249:0:1691804:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:25.0:1773851896.776249:0:1691804:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:25.0:1773851896.776250:0:1691804:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851896.776250:0:1691804:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:25.0:1773851896.776251:0:1691804:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:25.0:1773851896.776253:0:1691804:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000d3170f1c.
02000000:00000001:25.0:1773851896.776254:0:1691804:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851896.776254:0:1691804:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:25.0:1773851896.776255:0:1691804:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:25.0:1773851896.776255:0:1691804:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:25.0:1773851896.776256:0:1691804:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:25.0:1773851896.776257:0:1691804:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 317718528 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:25.0:1773851896.776258:0:1691804:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966130483 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:25.0:1773851896.776259:0:1691804:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:25.0:1773851896.776259:0:1691804:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080733952
00010000:00000001:25.0:1773851896.776260:0:1691804:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:25.0:1773851896.776261:0:1691804:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000093414630 x1859388080733952/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:623/0 lens 224/368 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:25.0:1773851896.776263:0:1691804:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:25.0:1773851896.776265:0:1691804:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:25.0:1773851896.776265:0:1691804:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=23 v=66 (1 1 1 1)
00000100:00000001:25.0:1773851896.776266:0:1691804:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:25.0:1773851896.776267:0:1691804:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:25.0:1773851896.776267:0:1691804:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:25.0:1773851896.776268:0:1691804:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:25.0:1773851896.776268:0:1691804:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851896.776269:0:1691804:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:25.0:1773851896.776270:0:1691804:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:25.0:1773851896.776270:0:1691804:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006277e937.
00000100:00000200:25.0:1773851896.776271:0:1691804:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080733952, offset 224
00000400:00000200:25.0:1773851896.776272:0:1691804:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:25.0:1773851896.776272:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.776273:0:1691804:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851896.776274:0:1691804:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851896.776275:0:1691804:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851896.776276:0:1691804:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:25.0:1773851896.776277:0:1691804:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770234:8770234:1024:4294967295] 8@kfi7 LPNI seq info [17340075:17340075:16:4294967295]
00000400:00000200:25.0:1773851896.776278:0:1691804:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851896.776279:0:1691804:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851896.776283:0:1691804:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:25.0:1773851896.776285:0:1691804:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:25.0:1773851896.776287:0:1691804:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851896.776289:0:1691804:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:25.0:1773851896.776292:0:1691804:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:25.0:1773851896.776296:0:1691804:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000800:00000200:25.0:1773851896.776301:0:1691804:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000878f9def: Posted send of 468 bytes to peer 0x200000000001191: rc=0
00000800:00000200:25.0:1773851896.776303:0:1691804:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:25.0:1773851896.776307:0:1691804:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851896.776309:0:1691804:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:25.0:1773851896.776310:0:1691804:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:25.0:1773851896.776311:0:1691804:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:25.0:1773851896.776312:0:1691804:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:25.0:1773851896.776313:0:1691804:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000093414630 x1859388080733952/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:623/0 lens 224/368 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000800:00000200:26.0:1773851896.776316:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851896.776317:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:25.0:1773851896.776318:0:1691804:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000093414630 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_027:lustre5-MDT0004-mdtlov_UUID+5:38112:x1859388080733952:12345-7@kfi7:41:default-yuba5-0 Request processed in 75us (111us total) trans 0 rc 0/0
00000400:00000200:26.0:1773851896.776319:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000400:00000200:26.0:1773851896.776319:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006277e937
00000400:00000010:26.0:1773851896.776320:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006277e937.
00000100:00000001:26.0:1773851896.776321:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851896.776321:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851896.776322:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000100:00100000:25.0:1773851896.776322:0:1691804:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799991
00000800:00000200:26.0:1773851896.776324:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000878f9def: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Transaction freed
00000100:00000040:25.0:1773851896.776324:0:1691804:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:25.0:1773851896.776325:0:1691804:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:25.0:1773851896.776326:0:1691804:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:25.0:1773851896.776327:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:25.0:1773851896.776328:0:1691804:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008e4403ff.
00000020:00000010:25.0:1773851896.776329:0:1691804:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:25.0:1773851896.776331:0:1691804:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:25.0:1773851896.776332:0:1691804:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851896.778051:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851896.778052:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851896.778053:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851896.778055:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851896.778057:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.778059:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.24@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851896.778060:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.778060:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851896.778061:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.24@o2ib60 to cpt 1
00000400:00000200:9.0:1773851896.778064:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 2
00000400:00000200:9.0:1773851896.778065:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 3
00000400:00000200:9.0:1773851896.778066:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.24@o2ib60 to cpt 1
00000400:00000200:9.0:1773851896.778068:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.24@o2ib60 of length 456 into portal 12 MB=0x69b1d59fd0fc0
00000400:00000200:9.0:1773851896.778069:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.24@o2ib60 of length 456/456 into md 0x793926dc5 [64] + 164416
00000800:00000200:9.0:1773851896.778071:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851896.778073:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851896.778074:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851896.778075:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851896.778075:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851896.778076:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007d195074.
00000100:00000040:9.0:1773851896.778077:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000007d195074 x1859400226377664 msgsize 456
00000100:00100000:9.0:1773851896.778079:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.24@o2ib60 (source: 12345-192.168.128.24@o2ib60)
00000100:00000001:9.0:1773851896.778081:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851896.778081:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851896.778083:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851896.778084:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851896.778085:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851896.778085:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851896.778086:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851896.778087:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851896.778088:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859400226377664
00000020:00000001:7.0:1773851896.778089:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851896.778089:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0797f3f6913
00000020:00000001:7.0:1773851896.778090:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851896.778091:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d2a81213 refcount=55818
00000020:00000001:7.0:1773851896.778092:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637057575048192 : -107016134503424 : ffff9eab5d515400)
00000020:00000001:7.0:1773851896.778093:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637057575048192 : -107016134503424 : ffff9eab5d515400)
00000100:00000001:7.0:1773851896.778094:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851896.778095:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851896.778096:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000baa61ed4.
00000020:00000010:7.0:1773851896.778097:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851896.778098:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851896.778099:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851896.778100:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851896.778100:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.778101:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.778103:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851896.778104:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851896.778104:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851896.778105:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851896.778106:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.24@o2ib60, seq: 371100851
00000100:00000001:4.0:1773851896.778106:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851896.778107:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d2a81213 : new rpc_count 6
00000100:00000001:7.0:1773851896.778107:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609043200 : -107064100508416 : ffff9ea032522d00)
00000100:00000001:4.0:1773851896.778107:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851896.778107:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.778108:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007d195074 x1859400226377664/t0(0) o17->16201831-9c16-4932-a3f9-8725aef4fea9@192.168.128.24@o2ib60:623/0 lens 456/0 e 0 to 0 dl 1773851983 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-matrix24-0'
00000100:00000001:7.0:1773851896.778111:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851896.778111:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851896.778112:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d195074 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:16201831-9c16-4932-a3f9-8725aef4fea9+55818:40333:x1859400226377664:12345-192.168.128.24@o2ib60:17:default-matrix24-0
00000100:00000200:7.0:1773851896.778114:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859400226377664
00000020:00000001:7.0:1773851896.778114:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851896.778115:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851896.778115:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.778117:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851896.778117:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:7.0:1773851896.778118:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851896.778119:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859400226377664, found 0 last_xid 1859400222779455
00000020:00000001:7.0:1773851896.778120:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851896.778120:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851896.778121:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851896.778121:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851896.778122:0:61015:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:7.0:1773851896.778123:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851896.778124:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851896.778125:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000006f21a4d8.
02000000:00000001:7.0:1773851896.778125:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.778126:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.778127:0:61015:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:7.0:1773851896.778128:0:61015:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:7.0:1773851896.778128:0:61015:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851896.778130:0:61015:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.778131:0:61015:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:7.0:1773851896.778131:0:61015:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 16201831-9c16-4932-a3f9-8725aef4fea9/00000000d2a81213 free: 126633370845184 avail: 126633368748032
00000020:00000001:7.0:1773851896.778132:0:61015:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:7.0:1773851896.778133:0:61015:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 16201831-9c16-4932-a3f9-8725aef4fea9/00000000d2a81213 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:7.0:1773851896.778135:0:61015:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:7.0:1773851896.778136:0:61015:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:7.0:1773851896.778136:0:61015:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 16201831-9c16-4932-a3f9-8725aef4fea9/00000000d2a81213 reports grant 1812725759 dropped 0, local 1880883199
00000020:00000001:7.0:1773851896.778137:0:61015:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:7.0:1773851896.778138:0:61015:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:7.0:1773851896.778138:0:61015:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851896.778139:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593886, transno 0, xid 1859400226377664
00010000:00000001:7.0:1773851896.778140:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851896.778141:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007d195074 x1859400226377664/t0(0) o17->16201831-9c16-4932-a3f9-8725aef4fea9@192.168.128.24@o2ib60:623/0 lens 456/432 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-matrix24-0'
00010000:00000001:7.0:1773851896.778143:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851896.778144:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851896.778145:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=128 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851896.778146:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851896.778147:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ceff4c59 refcount 3 to 192.168.128.24@o2ib60
00000100:00000001:7.0:1773851896.778148:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553703840 : -107156155847776 : ffff9e8ac3652ba0)
02000000:00000001:7.0:1773851896.778149:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851896.778149:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851896.778150:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851896.778151:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.24@o2ib60
00000400:00000010:7.0:1773851896.778152:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c448bd40.
00000100:00000200:7.0:1773851896.778153:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859400226377664, offset 224
00000400:00000200:7.0:1773851896.778154:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.24@o2ib60
00000400:00000200:7.0:1773851896.778155:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.24@o2ib60 to cpt 1
00000400:00000200:7.0:1773851896.778157:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 2
00000400:00000200:7.0:1773851896.778158:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 3
00000400:00000200:7.0:1773851896.778159:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 4
00000400:00000200:7.0:1773851896.778160:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.24@o2ib60 routed destination
00000400:00000200:7.0:1773851896.778161:0:61015:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:7.0:1773851896.778162:0:61015:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:7.0:1773851896.778164:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.24@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851896.778165:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:7.0:1773851896.778166:0:61015:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.24@o2ib60: rtr pref emtpy: 1
00000400:00000200:7.0:1773851896.778167:0:61015:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:7.0:1773851896.778168:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770235:8770235:1024:4294967295] 17@kfi7 LPNI seq info [1250891924:1250891924:16:4294967295]
00000400:00000200:7.0:1773851896.778170:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:7.0:1773851896.778170:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:7.0:1773851896.778173:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.24@o2ib60(192.168.128.24@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851896.778174:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c73df1fc nid 192.168.128.24@o2ib60 refs 3
00000800:00000200:7.0:1773851896.778176:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851896.778177:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:7.0:1773851896.778181:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851896.778184:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:7.0:1773851896.778187:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007adb163d: Posted send of 532 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:7.0:1773851896.778189:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851896.778191:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851896.778192:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ceff4c59 refcount 2 to 192.168.128.24@o2ib60
00010000:00000001:7.0:1773851896.778193:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851896.778193:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851896.778194:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851896.778195:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007d195074 x1859400226377664/t0(0) o17->16201831-9c16-4932-a3f9-8725aef4fea9@192.168.128.24@o2ib60:623/0 lens 456/432 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-matrix24-0'
00000100:00100000:7.0:1773851896.778199:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d195074 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:16201831-9c16-4932-a3f9-8725aef4fea9+55818:40333:x1859400226377664:12345-192.168.128.24@o2ib60:17:default-matrix24-0 Request processed in 86us (120us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851896.778201:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.24@o2ib60, seq: 371100851
00000800:00000200:5.0:1773851896.778201:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851896.778202:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d2a81213 : new rpc_count 5
00000400:00000200:5.0:1773851896.778202:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851896.778203:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851896.778204:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851896.778204:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851896.778204:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:5.0:1773851896.778204:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c448bd40
00000020:00000010:7.0:1773851896.778205:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000400:00000010:5.0:1773851896.778205:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c448bd40.
00000020:00000010:7.0:1773851896.778206:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000baa61ed4.
00000100:00000001:5.0:1773851896.778206:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851896.778206:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:7.0:1773851896.778207:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000d2a81213 : new refcount 55817
00000100:00000001:7.0:1773851896.778207:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851896.778207:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:5.0:1773851896.778209:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2054@kfi7:1 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000001a Transaction freed
00000800:00000200:29.0:1773851896.792860:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851896.792862:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851896.792864:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851896.792867:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851896.792870:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11347@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.792872:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11347@kfi7 : PUT - for me
00000400:00000200:29.0:1773851896.792874:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11347@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.792876:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6144e41 nid 11347@kfi7 refs 1
00000400:00000200:29.0:1773851896.792878:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11347@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.792879:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6144e41 nid 11347@kfi7 refs 2
00000400:00000200:29.0:1773851896.792880:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6144e41 nid 11347@kfi7 refs 3
00000400:00000200:29.0:1773851896.792882:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11410@kfi7 to cpt 7
00000400:00000200:29.0:1773851896.792883:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11410@kfi7 of length 224 into portal 12 MB=0x69b09e7d4c540
00000400:00000200:29.0:1773851896.792885:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11410@kfi7 of length 224/224 into md 0x77fe1859d [64] + 8600
00000800:00000200:29.0:1773851896.792888:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851896.792891:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851896.792892:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11347@kfi7: PUT: OK
00000100:00000001:29.0:1773851896.792894:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851896.792894:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851896.792896:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001fbdbc6c.
00000100:00000040:29.0:1773851896.792897:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000001fbdbc6c x1859316706755904 msgsize 224
00000100:00100000:29.0:1773851896.792899:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11410@kfi7 (source: 12345-11347@kfi7)
00000100:00000001:29.0:1773851896.792901:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851896.792902:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6144e41 nid 11347@kfi7 refs 2
00000100:00000001:31.0:1773851896.792904:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851896.792904:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851896.792905:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851896.792906:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851896.792907:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851896.792909:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851896.792910:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316706755904
00000020:00000001:31.0:1773851896.792911:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851896.792912:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91460
00000020:00000001:31.0:1773851896.792913:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851896.792918:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000060ba4f9b refcount=6
00000020:00000001:31.0:1773851896.792919:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240787968 : -107152468763648 : ffff9e8b9f299c00)
00000020:00000001:31.0:1773851896.792921:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240787968 : -107152468763648 : ffff9e8b9f299c00)
00000100:00000001:31.0:1773851896.792923:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851896.792924:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851896.792925:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000243a822a.
00000020:00000010:31.0:1773851896.792927:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851896.792929:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851896.792931:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851896.792931:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851896.792932:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851896.792934:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851896.792935:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851896.792936:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851896.792937:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851896.792941:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851896.792941:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851896.792942:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851896.792942:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851896.792944:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11410@kfi7, seq: 2055594
00000100:00000040:31.0:1773851896.792945:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000060ba4f9b : new rpc_count 1
00000100:00000001:30.0:1773851896.792945:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851896.792946:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337954688 : -106936371596928 : ffff9ebdef8eb180)
00000100:00000001:30.0:1773851896.792947:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851896.792948:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001fbdbc6c x1859316706755904/t0(0) o400->ffd4193d-1a35-46b7-b4c5-3b4924344144@11410@kfi7:684/0 lens 224/0 e 0 to 0 dl 1773852044 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1206-0'
00000100:00000001:31.0:1773851896.792954:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851896.792954:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851896.792956:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001fbdbc6c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:ffd4193d-1a35-46b7-b4c5-3b4924344144+6:39635:x1859316706755904:12345-11410@kfi7:400:default-tuolumne1206-0
00000100:00000200:31.0:1773851896.792958:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316706755904
00000020:00000001:31.0:1773851896.792959:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851896.792960:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851896.792962:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851896.792963:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851896.792963:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851896.792965:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851896.792966:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316706755904, found 0 last_xid 1859316706755903
00000020:00000001:31.0:1773851896.792967:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851896.792968:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851896.792969:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851896.792970:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851896.792971:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851896.792972:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851896.792973:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851896.792974:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005fdbb19b.
02000000:00000001:31.0:1773851896.792975:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851896.792976:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851896.792977:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851896.792978:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035365158, transno 0, xid 1859316706755904
00010000:00000001:31.0:1773851896.792980:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851896.792981:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001fbdbc6c x1859316706755904/t0(0) o400->ffd4193d-1a35-46b7-b4c5-3b4924344144@11410@kfi7:684/0 lens 224/224 e 0 to 0 dl 1773852044 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1206-0'
00010000:00000001:31.0:1773851896.792990:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851896.792991:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851896.792993:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=129 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851896.792995:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851896.792996:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d6eadd6 refcount 3 to 11410@kfi7
00000100:00000001:31.0:1773851896.792997:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715065088 : -107155994486528 : ffff9e8acd035900)
02000000:00000001:31.0:1773851896.792999:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851896.793000:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851896.793001:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851896.793002:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11347@kfi7
00000400:00000010:31.0:1773851896.793003:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000761d5a45.
00000100:00000200:31.0:1773851896.793005:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316706755904, offset 224
00000400:00000200:31.0:1773851896.793008:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11347@kfi7
00000400:00000200:31.0:1773851896.793009:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11347@kfi7 to cpt 7
00000400:00000200:31.0:1773851896.793011:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6144e41 nid 11347@kfi7 refs 1
00000400:00000200:31.0:1773851896.793013:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6144e41 nid 11347@kfi7 refs 2
00000400:00000200:31.0:1773851896.793015:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6144e41 nid 11347@kfi7 refs 3
00000400:00000200:31.0:1773851896.793016:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11347@kfi7 local destination
00000400:00000200:31.0:1773851896.793019:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770236:8770236:1024:4294967295] 11347@kfi7 LPNI seq info [804729:804729:16:4294967295]
00000400:00000200:31.0:1773851896.793021:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6144e41 nid 11347@kfi7 refs 2
00000400:00000200:31.0:1773851896.793023:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11347@kfi7 to cpt 7
00000400:00000200:31.0:1773851896.793026:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11347@kfi7(11347@kfi7:11347@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851896.793028:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6144e41 nid 11347@kfi7 refs 3
00000800:00000200:31.0:1773851896.793031:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851896.793033:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851896.793036:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851896.793040:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000162 Using peer 11347@kfi7(0x100000000000162)
00000800:00000200:31.0:1773851896.793049:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x100000000000162: rc=0
00000800:00000200:31.0:1773851896.793051:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000162 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851896.793055:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851896.793056:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d6eadd6 refcount 2 to 11410@kfi7
00010000:00000001:31.0:1773851896.793057:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851896.793058:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851896.793059:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851896.793060:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001fbdbc6c x1859316706755904/t0(0) o400->ffd4193d-1a35-46b7-b4c5-3b4924344144@11410@kfi7:684/0 lens 224/224 e 0 to 0 dl 1773852044 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1206-0'
00000800:00000200:29.0:1773851896.793064:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000162 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851896.793065:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001fbdbc6c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:ffd4193d-1a35-46b7-b4c5-3b4924344144+6:39635:x1859316706755904:12345-11410@kfi7:400:default-tuolumne1206-0 Request processed in 111us (167us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851896.793067:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851896.793069:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11410@kfi7, seq: 2055594
00000400:00000200:29.0:1773851896.793069:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11347@kfi7: PUT: OK
00000100:00000040:31.0:1773851896.793070:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000060ba4f9b : new rpc_count 0
00000400:00000200:29.0:1773851896.793070:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000761d5a45
00000400:00000010:29.0:1773851896.793071:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000761d5a45.
00000100:00000001:31.0:1773851896.793072:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851896.793072:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:29.0:1773851896.793072:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:31.0:1773851896.793073:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000100:00000001:29.0:1773851896.793073:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851896.793074:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6144e41 nid 11347@kfi7 refs 2
00000020:00000010:31.0:1773851896.793075:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851896.793076:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000243a822a.
00000800:00000200:29.0:1773851896.793076:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 11347@kfi7(0000000044ee4b63):0x0 lsk 355 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000162 Transaction freed
00000020:00000040:31.0:1773851896.793077:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000060ba4f9b : new refcount 5
00000100:00000001:31.0:1773851896.793079:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851896.793657:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851896.793658:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851896.793660:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851896.793662:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851896.793665:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.793666:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25168@kfi7 : PUT - for me
00000400:00000200:1.0:1773851896.793667:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.793668:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 1
00000400:00000200:1.0:1773851896.793669:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.793670:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000400:00000200:1.0:1773851896.793671:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 3
00000400:00000200:1.0:1773851896.793671:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25233@kfi7 to cpt 7
00000400:00000200:1.0:1773851896.793672:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25233@kfi7 of length 456 into portal 12 MB=0x69b4c69024840
00000400:00000200:1.0:1773851896.793674:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25233@kfi7 of length 456/456 into md 0x7fb56e801 [64] + 52336
00000800:00000200:1.0:1773851896.793676:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851896.793678:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851896.793679:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25168@kfi7: PUT: OK
00000100:00000001:1.0:1773851896.793680:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851896.793680:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851896.793682:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000054d59f23.
00000100:00000040:1.0:1773851896.793682:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000054d59f23 x1859602341840960 msgsize 456
00000100:00100000:1.0:1773851896.793684:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25233@kfi7 (source: 12345-25168@kfi7)
00000100:00000001:1.0:1773851896.793685:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851896.793686:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000100:00000001:0.0:1773851896.793687:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851896.793688:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851896.793689:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851896.793689:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851896.793689:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851896.793690:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851896.793691:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602341840960
00000020:00000001:0.0:1773851896.793692:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851896.793692:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8284b
00000020:00000001:0.0:1773851896.793693:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851896.793695:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000604f4e4 refcount=4099
00000020:00000001:0.0:1773851896.793696:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637128025661440 : -106945683890176 : ffff9ebbc4806000)
00000020:00000001:0.0:1773851896.793697:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637128025661440 : -106945683890176 : ffff9ebbc4806000)
00000100:00000001:0.0:1773851896.793698:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851896.793698:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851896.793699:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851896.793701:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851896.793701:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851896.793702:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851896.793703:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851896.793704:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.793706:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.793706:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851896.793708:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851896.793708:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851896.793709:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851896.793709:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851896.793710:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25233@kfi7, seq: 408701490
00000100:00000001:2.0:1773851896.793711:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851896.793711:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851896.793711:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000604f4e4 : new rpc_count 8
00000100:00000001:0.0:1773851896.793711:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052769280 : -106991656782336 : ffff9eb1104db600)
00000100:00000040:0.0:1773851896.793712:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000054d59f23 x1859602341840960/t0(0) o17->81d8f0a6-5475-441f-8eb2-ba6da3482fdc@25233@kfi7:536/0 lens 456/0 e 0 to 0 dl 1773852651 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2066-0'
00000100:00000001:0.0:1773851896.793715:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851896.793715:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851896.793717:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000054d59f23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:81d8f0a6-5475-441f-8eb2-ba6da3482fdc+4099:39582:x1859602341840960:12345-25233@kfi7:17:default-tuolumne2066-0
00000100:00000200:0.0:1773851896.793718:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602341840960
00000020:00000001:0.0:1773851896.793719:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851896.793719:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851896.793720:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.793720:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851896.793721:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:0.0:1773851896.793722:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851896.793722:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602341840960, found 0 last_xid 1859602341101951
00000020:00000001:0.0:1773851896.793723:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851896.793724:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851896.793728:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851896.793729:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851896.793730:0:42868:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:0.0:1773851896.793731:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851896.793731:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851896.793733:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000ec016a96.
02000000:00000001:0.0:1773851896.793733:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.793734:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.793735:0:42868:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:0.0:1773851896.793735:0:42868:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:0.0:1773851896.793736:0:42868:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:0.0:1773851896.793738:0:42868:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.793739:0:42868:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:0.0:1773851896.793739:0:42868:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 81d8f0a6-5475-441f-8eb2-ba6da3482fdc/000000000604f4e4 free: 126633370845184 avail: 126633368748032
00000020:00000001:0.0:1773851896.793740:0:42868:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:0.0:1773851896.793741:0:42868:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 81d8f0a6-5475-441f-8eb2-ba6da3482fdc/000000000604f4e4 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:0.0:1773851896.793742:0:42868:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:0.0:1773851896.793743:0:42868:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:0.0:1773851896.793743:0:42868:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 81d8f0a6-5475-441f-8eb2-ba6da3482fdc/000000000604f4e4 reports grant 1803288575 dropped 0, local 1882456063
00000020:00000001:0.0:1773851896.793744:0:42868:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:0.0:1773851896.793744:0:42868:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:0.0:1773851896.793745:0:42868:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851896.793746:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593894, transno 0, xid 1859602341840960
00010000:00000001:0.0:1773851896.793746:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851896.793747:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000054d59f23 x1859602341840960/t0(0) o17->81d8f0a6-5475-441f-8eb2-ba6da3482fdc@25233@kfi7:536/0 lens 456/432 e 0 to 0 dl 1773852651 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2066-0'
00010000:00000001:0.0:1773851896.793749:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851896.793750:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851896.793751:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=129 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851896.793752:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851896.793752:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000042f5cb62 refcount 3 to 25233@kfi7
00000100:00000001:0.0:1773851896.793753:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214688 : -107155106336928 : ffff9e8b01f36f60)
02000000:00000001:0.0:1773851896.793754:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851896.793754:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.793755:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851896.793756:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25168@kfi7
00000400:00000010:0.0:1773851896.793756:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b505966b.
00000100:00000200:0.0:1773851896.793757:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859602341840960, offset 224
00000400:00000200:0.0:1773851896.793759:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25168@kfi7
00000400:00000200:0.0:1773851896.793760:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:0.0:1773851896.793760:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 1
00000400:00000200:0.0:1773851896.793762:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000400:00000200:0.0:1773851896.793763:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 3
00000400:00000200:0.0:1773851896.793764:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25168@kfi7 local destination
00000400:00000200:0.0:1773851896.793765:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770237:8770237:1024:4294967295] 25168@kfi7 LPNI seq info [9466696:9466696:16:4294967295]
00000400:00000200:0.0:1773851896.793767:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000400:00000200:0.0:1773851896.793767:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25168@kfi7 to cpt 0
00000400:00000200:0.0:1773851896.793769:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25168@kfi7(25168@kfi7:25168@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851896.793771:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 3
00000800:00000200:0.0:1773851896.793772:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851896.793773:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:0.0:1773851896.793775:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851896.793777:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001170 Using peer 25168@kfi7(0x100000000001170)
00000800:00000200:0.0:1773851896.793781:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 532 bytes to peer 0x100000000001170: rc=0
00000800:00000200:0.0:1773851896.793782:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001170 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851896.793784:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851896.793785:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000042f5cb62 refcount 2 to 25233@kfi7
00010000:00000001:0.0:1773851896.793786:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851896.793786:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.793787:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851896.793787:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000054d59f23 x1859602341840960/t0(0) o17->81d8f0a6-5475-441f-8eb2-ba6da3482fdc@25233@kfi7:536/0 lens 456/432 e 0 to 0 dl 1773852651 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2066-0'
00000100:00100000:0.0:1773851896.793792:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000054d59f23 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:81d8f0a6-5475-441f-8eb2-ba6da3482fdc+4099:39582:x1859602341840960:12345-25233@kfi7:17:default-tuolumne2066-0 Request processed in 75us (108us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851896.793794:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25233@kfi7, seq: 408701490
00000100:00000040:0.0:1773851896.793794:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000604f4e4 : new rpc_count 7
00000100:00000001:0.0:1773851896.793795:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851896.793796:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851896.793796:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851896.793797:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851896.793798:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851896.793799:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000604f4e4 : new refcount 4098
00000100:00000001:0.0:1773851896.793799:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851896.793806:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001170 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851896.793807:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851896.793809:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25168@kfi7: PUT: OK
00000400:00000200:1.0:1773851896.793809:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b505966b
00000400:00000010:1.0:1773851896.793810:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b505966b.
00000100:00000001:1.0:1773851896.793811:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851896.793811:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851896.793812:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000095d36534 nid 25168@kfi7 refs 2
00000800:00000200:1.0:1773851896.793814:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 25168@kfi7(00000000cb8a36da):0x0 lsk 4465 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001170 Transaction freed
00000800:00000200:1.0:1773851896.821002:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851896.821002:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851896.821003:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851896.821005:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851896.821007:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.821008:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18162@kfi7 : PUT - for me
00000400:00000200:1.0:1773851896.821009:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.821010:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 1
00000400:00000200:1.0:1773851896.821011:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.821011:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000400:00000200:1.0:1773851896.821012:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 3
00000400:00000200:1.0:1773851896.821013:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17971@kfi7 to cpt 0
00000400:00000200:1.0:1773851896.821014:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17971@kfi7 of length 224 into portal 12 MB=0x699e14cc43d00
00000400:00000200:1.0:1773851896.821015:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17971@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 52792
00000800:00000200:1.0:1773851896.821017:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851896.821018:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851896.821020:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18162@kfi7: PUT: OK
00000100:00000001:1.0:1773851896.821021:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851896.821021:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851896.821021:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000b413608.
00000100:00000040:1.0:1773851896.821022:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000000b413608 x1858042794884352 msgsize 224
00000100:00100000:1.0:1773851896.821023:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-17971@kfi7 (source: 12345-18162@kfi7)
00000100:00000001:1.0:1773851896.821024:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851896.821025:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000100:00000001:0.0:1773851896.821026:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851896.821026:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851896.821027:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851896.821027:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851896.821027:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851896.821027:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851896.821028:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042794884352
00000020:00000001:0.0:1773851896.821028:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851896.821029:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922ad
00000020:00000001:0.0:1773851896.821029:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851896.821031:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005ff7e049 refcount=41
00000020:00000001:0.0:1773851896.821031:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630017024 : -107123079534592 : ffff9e9276e5a800)
00000020:00000001:0.0:1773851896.821032:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630017024 : -107123079534592 : ffff9e9276e5a800)
00000100:00000001:0.0:1773851896.821033:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851896.821033:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851896.821034:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0290aac.
00000020:00000010:0.0:1773851896.821034:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851896.821035:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851896.821035:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851896.821036:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851896.821036:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851896.821037:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851896.821038:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851896.821038:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.821038:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851896.821039:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851896.821040:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851896.821040:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851896.821040:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851896.821041:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851896.821041:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17971@kfi7, seq: 1997625
00000100:00000040:0.0:1773851896.821041:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005ff7e049 : new rpc_count 3
00000100:00000001:2.0:1773851896.821042:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.821042:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052785408 : -106991656766208 : ffff9eb1104df500)
00000100:00000040:0.0:1773851896.821043:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000b413608 x1858042794884352/t0(0) o400->390a348e-44b3-4f57-ab2c-48cc379b92c3@17971@kfi7:536/0 lens 224/0 e 0 to 0 dl 1773852651 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1609-0'
00000100:00000001:0.0:1773851896.821045:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851896.821046:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851896.821047:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000b413608 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:390a348e-44b3-4f57-ab2c-48cc379b92c3+41:39812:x1858042794884352:12345-17971@kfi7:400:default-tuolumne1609-0
00000100:00000200:0.0:1773851896.821048:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042794884352
00000020:00000001:0.0:1773851896.821048:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851896.821049:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851896.821049:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.821050:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851896.821050:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851896.821051:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851896.821051:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042794884352, found 0 last_xid 1858042790836159
00000020:00000001:0.0:1773851896.821052:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851896.821052:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851896.821052:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851896.821053:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.821053:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851896.821054:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851896.821054:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851896.821056:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000135b2235.
02000000:00000001:0.0:1773851896.821056:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.821057:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.821057:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851896.821058:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183248106944, transno 0, xid 1858042794884352
00010000:00000001:0.0:1773851896.821058:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851896.821059:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000b413608 x1858042794884352/t0(0) o400->390a348e-44b3-4f57-ab2c-48cc379b92c3@17971@kfi7:536/0 lens 224/224 e 0 to 0 dl 1773852651 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1609-0'
00010000:00000001:0.0:1773851896.821061:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851896.821061:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851896.821062:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=129 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851896.821063:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851896.821064:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001a2db78e refcount 3 to 17971@kfi7
00000100:00000001:0.0:1773851896.821064:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003232 : -107146751548384 : ffff9e8cf3ef6420)
02000000:00000001:0.0:1773851896.821065:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851896.821066:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851896.821066:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851896.821067:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18162@kfi7
00000400:00000010:0.0:1773851896.821068:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b505966b.
00000100:00000200:0.0:1773851896.821069:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042794884352, offset 224
00000400:00000200:0.0:1773851896.821070:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18162@kfi7
00000400:00000200:0.0:1773851896.821071:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:0.0:1773851896.821071:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 1
00000400:00000200:0.0:1773851896.821072:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000400:00000200:0.0:1773851896.821073:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 3
00000400:00000200:0.0:1773851896.821074:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18162@kfi7 local destination
00000400:00000200:0.0:1773851896.821076:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770238:8770238:1024:4294967295] 18162@kfi7 LPNI seq info [364687:364687:16:4294967295]
00000400:00000200:0.0:1773851896.821077:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000400:00000200:0.0:1773851896.821078:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18162@kfi7 to cpt 0
00000400:00000200:0.0:1773851896.821080:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18162@kfi7(18162@kfi7:18162@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851896.821081:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 3
00000800:00000200:0.0:1773851896.821082:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851896.821083:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851896.821085:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851896.821088:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf0d Using peer 18162@kfi7(0xf0d)
00000800:00000200:0.0:1773851896.821091:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0xf0d: rc=0
00000800:00000200:0.0:1773851896.821092:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf0d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851896.821094:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851896.821095:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001a2db78e refcount 2 to 17971@kfi7
00010000:00000001:0.0:1773851896.821096:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851896.821096:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851896.821097:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851896.821097:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000b413608 x1858042794884352/t0(0) o400->390a348e-44b3-4f57-ab2c-48cc379b92c3@17971@kfi7:536/0 lens 224/224 e 0 to 0 dl 1773852651 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1609-0'
00000100:00100000:0.0:1773851896.821102:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000b413608 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:390a348e-44b3-4f57-ab2c-48cc379b92c3+41:39812:x1858042794884352:12345-17971@kfi7:400:default-tuolumne1609-0 Request processed in 56us (79us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851896.821104:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17971@kfi7, seq: 1997625
00000100:00000040:0.0:1773851896.821105:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005ff7e049 : new rpc_count 2
00000100:00000001:0.0:1773851896.821106:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851896.821106:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851896.821107:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851896.821107:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851896.821108:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0290aac.
00000020:00000040:0.0:1773851896.821109:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000005ff7e049 : new refcount 40
00000100:00000001:0.0:1773851896.821109:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851896.821115:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf0d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851896.821117:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851896.821118:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18162@kfi7: PUT: OK
00000400:00000200:1.0:1773851896.821118:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b505966b
00000400:00000010:1.0:1773851896.821119:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b505966b.
00000100:00000001:1.0:1773851896.821120:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851896.821120:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851896.821121:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000162ca6c8 nid 18162@kfi7 refs 2
00000800:00000200:1.0:1773851896.821122:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 18162@kfi7(000000005fdb2789):0x0 lsk 3854 rsk 51 tsk 0 trmk 0 tmk 0 trr 0 tta 0xf0d Transaction freed
00000800:00000200:10.0:1773851896.830435:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851896.830435:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851896.830436:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851896.830437:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851896.830438:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:9.0:1773851896.830439:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851896.830440:0:2464469:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21459@kfi7(00000000a5417ed5):0xef3 version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851896.830443:0:2464469:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 Using peer 21459@kfi7(0x100000000000ef3)
00000800:00000200:9.0:1773851896.830443:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851896.830445:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21459@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.830447:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21459@kfi7 to cpt 2
00000800:00000200:10.0:1773851896.830448:0:2464469:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000348da31e: Posted send of 38 bytes to peer 0x100000000000ef3: rc=0
00000800:00000200:10.0:1773851896.830449:0:2464469:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851896.830449:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21459@kfi7 : PUT - for me
00000400:00000200:9.0:1773851896.830451:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21459@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.830453:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2e2baef nid 21459@kfi7 refs 1
00000400:00000200:9.0:1773851896.830455:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21459@kfi7 to cpt 2
00000400:00000200:9.0:1773851896.830456:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2e2baef nid 21459@kfi7 refs 2
00000400:00000200:9.0:1773851896.830458:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2e2baef nid 21459@kfi7 refs 3
00000400:00000200:9.0:1773851896.830460:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21266@kfi7 to cpt 5
00000400:00000200:9.0:1773851896.830462:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21266@kfi7 of length 456 into portal 12 MB=0x69b0470d43540
00000400:00000200:9.0:1773851896.830464:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21266@kfi7 of length 456/456 into md 0x78146ce49 [64] + 161480
00000800:00000200:10.0:1773851896.830465:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 TN_EVENT_TX_OK event status 0
00000800:00000200:10.0:1773851896.830467:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 Transaction freed
00000800:00000200:9.0:1773851896.830468:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851896.830471:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851896.830473:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21459@kfi7: PUT: OK
00000100:00000001:9.0:1773851896.830474:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851896.830475:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851896.830476:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a112b43.
00000100:00000040:9.0:1773851896.830477:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004a112b43 x1859293235393856 msgsize 456
00000100:00100000:9.0:1773851896.830480:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21266@kfi7 (source: 12345-21459@kfi7)
00000100:00000001:9.0:1773851896.830482:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851896.830483:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2e2baef nid 21459@kfi7 refs 2
00000100:00000001:8.0:1773851896.830484:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851896.830485:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851896.830486:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851896.830486:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851896.830487:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851896.830489:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851896.830490:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859293235393856
00000020:00000001:8.0:1773851896.830491:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851896.830492:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e07
00000020:00000001:8.0:1773851896.830493:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851896.830497:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077696ad0 refcount=154
00000020:00000001:8.0:1773851896.830498:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628766720 : -107123080784896 : ffff9e9276d29400)
00000020:00000001:8.0:1773851896.830499:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628766720 : -107123080784896 : ffff9e9276d29400)
00000100:00000001:8.0:1773851896.830501:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851896.830502:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851896.830503:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7e7683.
00000020:00000010:8.0:1773851896.830505:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851896.830507:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f524493c.
00000100:00000001:8.0:1773851896.830509:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851896.830509:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851896.830511:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851896.830513:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851896.830515:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851896.830517:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851896.830517:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851896.830518:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851896.830518:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851896.830519:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21266@kfi7, seq: 406391016
00000100:00000040:11.0:1773851896.830520:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077696ad0 : new rpc_count 4
00000100:00000001:8.0:1773851896.830520:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.830521:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609046656 : -107064100504960 : ffff9ea032523a80)
00000100:00000001:8.0:1773851896.830521:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851896.830522:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a112b43 x1859293235393856/t0(0) o17->7b563c47-b54f-4bbf-9f5d-206172800050@21266@kfi7:684/0 lens 456/0 e 0 to 0 dl 1773852044 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1829-0'
00000100:00000001:11.0:1773851896.830525:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851896.830526:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851896.830527:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a112b43 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7b563c47-b54f-4bbf-9f5d-206172800050+154:39883:x1859293235393856:12345-21266@kfi7:17:default-tuolumne1829-0
00000100:00000200:11.0:1773851896.830529:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859293235393856
00000020:00000001:11.0:1773851896.830530:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851896.830530:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851896.830531:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.830532:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851896.830533:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:11.0:1773851896.830533:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851896.830534:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859293235393856, found 0 last_xid 1859293200979327
00000020:00000001:11.0:1773851896.830535:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851896.830536:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851896.830537:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851896.830538:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851896.830538:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:11.0:1773851896.830539:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851896.830540:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851896.830542:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000009366e45d.
02000000:00000001:11.0:1773851896.830542:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.830543:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.830544:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:11.0:1773851896.830546:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:11.0:1773851896.830546:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851896.830547:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.830548:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851896.830549:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7b563c47-b54f-4bbf-9f5d-206172800050/0000000077696ad0 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851896.830550:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851896.830551:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7b563c47-b54f-4bbf-9f5d-206172800050/0000000077696ad0 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851896.830552:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851896.830553:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:11.0:1773851896.830554:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 7b563c47-b54f-4bbf-9f5d-206172800050/0000000077696ad0 reports grant 1810628607 dropped 0, local 1880358911
00000020:00000001:11.0:1773851896.830554:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:11.0:1773851896.830555:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:11.0:1773851896.830555:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851896.830556:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593816, transno 0, xid 1859293235393856
00010000:00000001:11.0:1773851896.830557:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851896.830558:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a112b43 x1859293235393856/t0(0) o17->7b563c47-b54f-4bbf-9f5d-206172800050@21266@kfi7:684/0 lens 456/432 e 0 to 0 dl 1773852044 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1829-0'
00010000:00000001:11.0:1773851896.830560:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851896.830561:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851896.830561:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=129 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851896.830562:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851896.830563:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3d85de1 refcount 3 to 21266@kfi7
00000100:00000001:11.0:1773851896.830564:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964025472 : -107156745526144 : ffff9e8aa03f6480)
02000000:00000001:11.0:1773851896.830564:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851896.830565:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851896.830565:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851896.830566:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21459@kfi7
00000400:00000010:11.0:1773851896.830567:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d7cd332.
00000100:00000200:11.0:1773851896.830568:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859293235393856, offset 224
00000400:00000200:11.0:1773851896.830569:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21459@kfi7
00000400:00000200:11.0:1773851896.830570:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21459@kfi7 to cpt 2
00000400:00000200:11.0:1773851896.830571:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2e2baef nid 21459@kfi7 refs 1
00000400:00000200:11.0:1773851896.830572:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2e2baef nid 21459@kfi7 refs 2
00000400:00000200:11.0:1773851896.830573:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2e2baef nid 21459@kfi7 refs 3
00000400:00000200:11.0:1773851896.830574:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21459@kfi7 local destination
00000400:00000200:11.0:1773851896.830576:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770239:8770239:1024:4294967295] 21459@kfi7 LPNI seq info [1247031:1247031:16:4294967295]
00000400:00000200:11.0:1773851896.830577:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2e2baef nid 21459@kfi7 refs 2
00000400:00000200:11.0:1773851896.830578:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21459@kfi7 to cpt 2
00000400:00000200:11.0:1773851896.830580:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21459@kfi7(21459@kfi7:21459@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851896.830581:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2e2baef nid 21459@kfi7 refs 3
00000800:00000200:11.0:1773851896.830582:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851896.830584:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:11.0:1773851896.830586:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851896.830588:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 Using peer 21459@kfi7(0x100000000000ef3)
00000800:00000200:11.0:1773851896.830591:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 532 bytes to peer 0x100000000000ef3: rc=0
00000800:00000200:11.0:1773851896.830592:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851896.830594:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851896.830595:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3d85de1 refcount 2 to 21266@kfi7
00010000:00000001:11.0:1773851896.830596:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851896.830597:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.830597:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851896.830598:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a112b43 x1859293235393856/t0(0) o17->7b563c47-b54f-4bbf-9f5d-206172800050@21266@kfi7:684/0 lens 456/432 e 0 to 0 dl 1773852044 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1829-0'
00000100:00100000:11.0:1773851896.830601:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a112b43 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7b563c47-b54f-4bbf-9f5d-206172800050+154:39883:x1859293235393856:12345-21266@kfi7:17:default-tuolumne1829-0 Request processed in 75us (123us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851896.830604:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21266@kfi7, seq: 406391016
00000100:00000040:11.0:1773851896.830604:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077696ad0 : new rpc_count 3
00000100:00000001:11.0:1773851896.830605:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851896.830606:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:10.0:1773851896.830606:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851896.830607:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:11.0:1773851896.830607:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f524493c.
00000400:00000200:10.0:1773851896.830607:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851896.830608:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7e7683.
00000400:00000200:10.0:1773851896.830608:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21459@kfi7: PUT: OK
00000020:00000040:11.0:1773851896.830609:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000077696ad0 : new refcount 153
00000400:00000200:10.0:1773851896.830609:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d7cd332
00000100:00000001:11.0:1773851896.830610:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:10.0:1773851896.830610:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d7cd332.
00000100:00000001:10.0:1773851896.830611:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851896.830611:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851896.830612:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2e2baef nid 21459@kfi7 refs 2
00000800:00000200:10.0:1773851896.830613:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2054@kfi7:2 -> 21459@kfi7(00000000a5417ed5):0x0 lsk 3828 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000ef3 Transaction freed
00000800:00000200:17.0:1773851896.838198:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851896.838199:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851896.838200:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851896.838202:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851896.838204:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21360@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.838205:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21360@kfi7 : PUT - for me
00000400:00000200:17.0:1773851896.838206:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21360@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.838206:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001af7a38 nid 21360@kfi7 refs 1
00000400:00000200:17.0:1773851896.838208:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21360@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.838208:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001af7a38 nid 21360@kfi7 refs 2
00000400:00000200:17.0:1773851896.838209:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000001af7a38 nid 21360@kfi7 refs 3
00000400:00000200:17.0:1773851896.838210:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21361@kfi7 to cpt 7
00000400:00000200:17.0:1773851896.838210:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21361@kfi7 of length 224 into portal 12 MB=0x69b4b5fbe45c0
00000400:00000200:17.0:1773851896.838212:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21361@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 45456
00000800:00000200:17.0:1773851896.838213:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851896.838214:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851896.838215:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21360@kfi7: PUT: OK
00000100:00000001:17.0:1773851896.838216:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851896.838217:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851896.838218:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000100acec1.
00000100:00000040:17.0:1773851896.838218:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000100acec1 x1859597891421632 msgsize 224
00000100:00100000:17.0:1773851896.838219:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21361@kfi7 (source: 12345-21360@kfi7)
00000100:00000001:17.0:1773851896.838221:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851896.838222:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000001af7a38 nid 21360@kfi7 refs 2
00000100:00000001:16.0:1773851896.838222:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851896.838223:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851896.838223:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851896.838224:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851896.838224:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851896.838225:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851896.838226:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597891421632
00000020:00000001:16.0:1773851896.838226:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851896.838227:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e242d4d1c
00000020:00000001:16.0:1773851896.838227:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851896.838230:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008f5a3718 refcount=5
00000020:00000001:16.0:1773851896.838231:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637099721489408 : -106973988062208 : ffff9eb52d70fc00)
00000020:00000001:16.0:1773851896.838231:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637099721489408 : -106973988062208 : ffff9eb52d70fc00)
00000100:00000001:16.0:1773851896.838232:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851896.838233:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851896.838234:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ae1ca5c8.
00000020:00000010:16.0:1773851896.838235:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851896.838236:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d3ff1402.
00000100:00000001:16.0:1773851896.838237:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851896.838237:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851896.838238:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851896.838239:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851896.838239:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851896.838240:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851896.838241:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851896.838242:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851896.838242:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851896.838243:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851896.838243:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851896.838244:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21361@kfi7, seq: 2156427
00000100:00000040:19.0:1773851896.838244:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008f5a3718 : new rpc_count 1
00000100:00000001:16.0:1773851896.838244:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.838245:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968763520 : -106974740788096 : ffff9eb500934c80)
00000100:00000001:16.0:1773851896.838245:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851896.838246:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000100acec1 x1859597891421632/t0(0) o400->ed87a62e-07a0-474b-baf8-2662d6194099@21361@kfi7:148/0 lens 224/0 e 0 to 0 dl 1773852263 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1822-0'
00000100:00000001:19.0:1773851896.838249:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851896.838249:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851896.838250:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000100acec1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ed87a62e-07a0-474b-baf8-2662d6194099+5:39664:x1859597891421632:12345-21361@kfi7:400:default-tuolumne1822-0
00000100:00000200:19.0:1773851896.838252:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597891421632
00000020:00000001:19.0:1773851896.838252:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851896.838253:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851896.838253:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.838254:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851896.838255:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851896.838255:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851896.838256:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597891421632, found 0 last_xid 1859597891421631
00000020:00000001:19.0:1773851896.838257:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851896.838258:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851896.838258:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851896.838258:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.838259:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851896.838260:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851896.838260:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851896.838262:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009c43640a.
02000000:00000001:19.0:1773851896.838262:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.838263:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.838264:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851896.838264:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044163414, transno 0, xid 1859597891421632
00010000:00000001:19.0:1773851896.838265:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851896.838266:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000100acec1 x1859597891421632/t0(0) o400->ed87a62e-07a0-474b-baf8-2662d6194099@21361@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1822-0'
00010000:00000001:19.0:1773851896.838268:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851896.838269:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851896.838270:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=129 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851896.838271:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851896.838272:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000efac7997 refcount 3 to 21361@kfi7
00000100:00000001:19.0:1773851896.838272:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932672 : -107137839618944 : ffff9e8f0720a480)
02000000:00000001:19.0:1773851896.838273:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851896.838274:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851896.838274:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851896.838275:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21360@kfi7
00000400:00000010:19.0:1773851896.838276:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018126296.
00000100:00000200:19.0:1773851896.838276:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597891421632, offset 224
00000400:00000200:19.0:1773851896.838278:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21360@kfi7
00000400:00000200:19.0:1773851896.838278:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21360@kfi7 to cpt 4
00000400:00000200:19.0:1773851896.838279:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000001af7a38 nid 21360@kfi7 refs 1
00000400:00000200:19.0:1773851896.838280:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000001af7a38 nid 21360@kfi7 refs 2
00000400:00000200:19.0:1773851896.838282:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000001af7a38 nid 21360@kfi7 refs 3
00000400:00000200:19.0:1773851896.838283:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21360@kfi7 local destination
00000400:00000200:19.0:1773851896.838284:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770240:8770240:1024:4294967295] 21360@kfi7 LPNI seq info [6146998:6146998:16:4294967295]
00000400:00000200:19.0:1773851896.838285:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000001af7a38 nid 21360@kfi7 refs 2
00000400:00000200:19.0:1773851896.838286:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21360@kfi7 to cpt 4
00000400:00000200:19.0:1773851896.838288:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21360@kfi7(21360@kfi7:21360@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851896.838289:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000001af7a38 nid 21360@kfi7 refs 3
00000800:00000200:19.0:1773851896.838291:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851896.838293:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851896.838295:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851896.838297:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5ad Using peer 21360@kfi7(0x5ad)
00000800:00000200:19.0:1773851896.838300:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x5ad: rc=0
00000800:00000200:19.0:1773851896.838301:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5ad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851896.838303:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851896.838304:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000efac7997 refcount 2 to 21361@kfi7
00010000:00000001:19.0:1773851896.838305:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851896.838305:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851896.838306:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851896.838306:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000100acec1 x1859597891421632/t0(0) o400->ed87a62e-07a0-474b-baf8-2662d6194099@21361@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1822-0'
00000100:00100000:19.0:1773851896.838309:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000100acec1 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ed87a62e-07a0-474b-baf8-2662d6194099+5:39664:x1859597891421632:12345-21361@kfi7:400:default-tuolumne1822-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851896.838311:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21361@kfi7, seq: 2156427
00000100:00000040:19.0:1773851896.838312:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008f5a3718 : new rpc_count 0
00000100:00000001:19.0:1773851896.838313:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851896.838313:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851896.838313:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5ad TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851896.838314:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:19.0:1773851896.838314:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d3ff1402.
00000400:00000200:17.0:1773851896.838314:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851896.838315:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ae1ca5c8.
00000400:00000200:17.0:1773851896.838315:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21360@kfi7: PUT: OK
00000020:00000040:19.0:1773851896.838316:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000008f5a3718 : new refcount 4
00000400:00000200:17.0:1773851896.838316:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018126296
00000400:00000010:17.0:1773851896.838316:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018126296.
00000100:00000001:19.0:1773851896.838317:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851896.838317:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851896.838317:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851896.838318:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000001af7a38 nid 21360@kfi7 refs 2
00000800:00000200:17.0:1773851896.838319:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 21360@kfi7(00000000be9c4abe):0x0 lsk 1454 rsk 27 tsk 0 trmk 0 tmk 0 trr 4 tta 0x5ad Transaction freed
00000800:00000200:27.0:1773851896.846913:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851896.846914:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:27.0:1773851896.846915:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:27.0:1773851896.846917:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851896.846919:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8595@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.846921:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8595@kfi7 : PUT - for me
00000400:00000200:27.0:1773851896.846921:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8595@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.846922:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b45905e2 nid 8595@kfi7 refs 1
00000400:00000200:27.0:1773851896.846924:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8595@kfi7 to cpt 6
00000400:00000200:27.0:1773851896.846924:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b45905e2 nid 8595@kfi7 refs 2
00000400:00000200:27.0:1773851896.846925:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b45905e2 nid 8595@kfi7 refs 3
00000400:00000200:27.0:1773851896.846926:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8530@kfi7 to cpt 7
00000400:00000200:27.0:1773851896.846926:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8530@kfi7 of length 224 into portal 12 MB=0x69b94da7de980
00000400:00000200:27.0:1773851896.846928:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8530@kfi7 of length 224/224 into md 0x16159c9699 [64] + 38880
00000800:00000200:27.0:1773851896.846929:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851896.846931:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851896.846932:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8595@kfi7: PUT: OK
00000100:00000001:27.0:1773851896.846933:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851896.846933:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851896.846934:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc7c2ddc.
00000100:00000040:27.0:1773851896.846935:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000dc7c2ddc x1859913483413888 msgsize 224
00000100:00100000:27.0:1773851896.846936:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-8530@kfi7 (source: 12345-8595@kfi7)
00000100:00000001:27.0:1773851896.846937:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851896.846938:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b45905e2 nid 8595@kfi7 refs 2
00000100:00000001:24.0:1773851896.846938:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:27.0:1773851896.846939:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851896.846939:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851896.846939:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851896.846940:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851896.846940:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851896.846941:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859913483413888
00000020:00000001:24.0:1773851896.846942:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851896.846942:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b4fd0ddba
00000020:00000001:24.0:1773851896.846943:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851896.846945:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eeb4651f refcount=8
00000020:00000001:24.0:1773851896.846945:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637106696964096 : -106967012587520 : ffff9eb6cd364800)
00000020:00000001:24.0:1773851896.846946:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637106696964096 : -106967012587520 : ffff9eb6cd364800)
00000100:00000001:24.0:1773851896.846947:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851896.846948:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851896.846949:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851896.846950:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851896.846951:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000098ea6441.
00000100:00000001:24.0:1773851896.846951:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851896.846952:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851896.846952:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851896.846953:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851896.846954:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851896.846954:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.846955:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851896.846956:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851896.846957:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851896.846957:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851896.846957:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851896.846958:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851896.846958:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8530@kfi7, seq: 2025181
00000100:00000040:24.0:1773851896.846958:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eeb4651f : new rpc_count 1
00000100:00000001:27.0:1773851896.846959:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.846959:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998389376 : -107053711162240 : ffff9ea29d930480)
00000100:00000040:24.0:1773851896.846960:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dc7c2ddc x1859913483413888/t0(0) o400->f8273cbf-b282-418c-bfc5-50083e11ec06@8530@kfi7:146/0 lens 224/0 e 0 to 0 dl 1773852261 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1030-0'
00000100:00000001:24.0:1773851896.846963:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851896.846963:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851896.846964:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc7c2ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:f8273cbf-b282-418c-bfc5-50083e11ec06+8:39568:x1859913483413888:12345-8530@kfi7:400:default-tuolumne1030-0
00000100:00000200:24.0:1773851896.846965:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859913483413888
00000020:00000001:24.0:1773851896.846966:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851896.846967:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851896.846967:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.846968:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851896.846969:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851896.846969:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851896.846970:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859913483413888, found 0 last_xid 1859913483413887
00000020:00000001:24.0:1773851896.846971:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851896.846971:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851896.846972:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851896.846972:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.846973:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851896.846974:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851896.846974:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851896.846975:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008edcd5fb.
02000000:00000001:24.0:1773851896.846975:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.846976:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.846976:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851896.846977:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183040414637, transno 0, xid 1859913483413888
00010000:00000001:24.0:1773851896.846978:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851896.846978:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dc7c2ddc x1859913483413888/t0(0) o400->f8273cbf-b282-418c-bfc5-50083e11ec06@8530@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1030-0'
00010000:00000001:24.0:1773851896.846981:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851896.846981:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851896.846982:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=129 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851896.846983:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851896.846984:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000022b2d019 refcount 3 to 8530@kfi7
00000100:00000001:24.0:1773851896.846984:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637086949842112 : -106986759709504 : ffff9eb234311cc0)
02000000:00000001:24.0:1773851896.846985:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851896.846986:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851896.846986:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851896.846987:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8595@kfi7
00000400:00000010:24.0:1773851896.846987:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fc06c4c8.
00000100:00000200:24.0:1773851896.846989:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859913483413888, offset 224
00000400:00000200:24.0:1773851896.846990:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8595@kfi7
00000400:00000200:24.0:1773851896.846991:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8595@kfi7 to cpt 6
00000400:00000200:24.0:1773851896.846992:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b45905e2 nid 8595@kfi7 refs 1
00000400:00000200:24.0:1773851896.846993:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b45905e2 nid 8595@kfi7 refs 2
00000400:00000200:24.0:1773851896.846994:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b45905e2 nid 8595@kfi7 refs 3
00000400:00000200:24.0:1773851896.846995:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8595@kfi7 local destination
00000400:00000200:24.0:1773851896.846996:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770241:8770241:1024:4294967295] 8595@kfi7 LPNI seq info [2516658:2516658:16:4294967295]
00000400:00000200:24.0:1773851896.846997:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b45905e2 nid 8595@kfi7 refs 2
00000400:00000200:24.0:1773851896.846998:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8595@kfi7 to cpt 6
00000400:00000200:24.0:1773851896.847000:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8595@kfi7(8595@kfi7:8595@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851896.847001:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b45905e2 nid 8595@kfi7 refs 3
00000800:00000200:24.0:1773851896.847002:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851896.847003:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851896.847005:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851896.847007:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001268 Using peer 8595@kfi7(0x100000000001268)
00000800:00000200:24.0:1773851896.847010:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x100000000001268: rc=0
00000800:00000200:24.0:1773851896.847012:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001268 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851896.847014:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851896.847014:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000022b2d019 refcount 2 to 8530@kfi7
00010000:00000001:24.0:1773851896.847015:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851896.847015:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851896.847016:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851896.847017:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dc7c2ddc x1859913483413888/t0(0) o400->f8273cbf-b282-418c-bfc5-50083e11ec06@8530@kfi7:146/0 lens 224/224 e 0 to 0 dl 1773852261 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1030-0'
00000100:00100000:24.0:1773851896.847021:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc7c2ddc pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:f8273cbf-b282-418c-bfc5-50083e11ec06+8:39568:x1859913483413888:12345-8530@kfi7:400:default-tuolumne1030-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851896.847024:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8530@kfi7, seq: 2025181
00000100:00000040:24.0:1773851896.847025:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eeb4651f : new rpc_count 0
00000100:00000001:24.0:1773851896.847025:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851896.847026:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851896.847026:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851896.847027:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000098ea6441.
00000020:00000010:24.0:1773851896.847028:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851896.847028:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000eeb4651f : new refcount 7
00000100:00000001:24.0:1773851896.847029:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851896.847034:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001268 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851896.847036:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851896.847037:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8595@kfi7: PUT: OK
00000400:00000200:26.0:1773851896.847037:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fc06c4c8
00000400:00000010:26.0:1773851896.847038:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fc06c4c8.
00000100:00000001:26.0:1773851896.847039:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851896.847039:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851896.847040:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b45905e2 nid 8595@kfi7 refs 2
00000800:00000200:26.0:1773851896.847041:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 8595@kfi7(0000000007a51d9a):0x0 lsk 4713 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001268 Transaction freed
00000800:00000200:21.0:1773851896.849634:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851896.849635:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851896.849636:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851896.849638:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851896.849640:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.849642:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:21.0:1773851896.849643:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.849643:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:21.0:1773851896.849644:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.849645:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:21.0:1773851896.849646:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851896.849647:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851896.849648:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c99b440
00000400:00000200:21.0:1773851896.849649:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 8104
00000800:00000200:21.0:1773851896.849651:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851896.849653:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851896.849654:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000100:00000001:21.0:1773851896.849655:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851896.849655:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851896.849656:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005abc3cdc.
00000100:00000040:21.0:1773851896.849657:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000005abc3cdc x1858065609110592 msgsize 224
00000100:00100000:21.0:1773851896.849659:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-13@kfi7)
00000100:00000001:21.0:1773851896.849660:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851896.849661:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:20.0:1773851896.849661:0:1537152:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851896.849662:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851896.849662:0:1537152:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851896.849662:0:1537152:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851896.849663:0:1537152:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851896.849664:0:1537152:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851896.849664:0:1537152:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065609110592
00000020:00000001:20.0:1773851896.849665:0:1537152:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851896.849665:0:1537152:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:20.0:1773851896.849666:0:1537152:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851896.849667:0:1537152:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:20.0:1773851896.849667:0:1537152:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:20.0:1773851896.849668:0:1537152:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:20.0:1773851896.849669:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851896.849670:0:1537152:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851896.849671:0:1537152:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000010bfdc01.
00000020:00000010:20.0:1773851896.849672:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851896.849673:0:1537152:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b64450ab.
00000100:00000040:20.0:1773851896.849674:0:1537152:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:20.0:1773851896.849674:0:1537152:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851896.849675:0:1537152:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851896.849675:0:1537152:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.849676:0:1537152:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.849677:0:1537152:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851896.849678:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851896.849678:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851896.849679:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:22.0:1773851896.849680:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851896.849680:0:1537183:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851896.849680:0:1537152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 3084764
00000100:00000040:20.0:1773851896.849680:0:1537152:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:22.0:1773851896.849681:0:1537183:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.849681:0:1537152:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701982464 : -106936007569152 : ffff9ebe05415100)
00000100:00000040:20.0:1773851896.849682:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005abc3cdc x1858065609110592/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:20.0:1773851896.849689:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851896.849689:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851896.849690:0:1537152:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005abc3cdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065609110592:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:20.0:1773851896.849691:0:1537152:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065609110592
00000020:00000001:20.0:1773851896.849692:0:1537152:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851896.849692:0:1537152:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851896.849693:0:1537152:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.849694:0:1537152:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851896.849694:0:1537152:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:20.0:1773851896.849695:0:1537152:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851896.849696:0:1537152:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851896.849696:0:1537152:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851896.849697:0:1537152:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851896.849697:0:1537152:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.849698:0:1537152:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851896.849699:0:1537152:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851896.849699:0:1537152:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000bcc1ffe4.
02000000:00000001:20.0:1773851896.849700:0:1537152:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.849700:0:1537152:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851896.849702:0:1537152:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:20.0:1773851896.849702:0:1537152:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:20.0:1773851896.849703:0:1537152:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:20.0:1773851896.849703:0:1537152:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 330301440 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:20.0:1773851896.849704:0:1537152:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966130387 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:20.0:1773851896.849706:0:1537152:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851896.849707:0:1537152:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065609110592
00010000:00000001:20.0:1773851896.849707:0:1537152:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851896.849708:0:1537152:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005abc3cdc x1858065609110592/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:623/0 lens 224/368 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:20.0:1773851896.849710:0:1537152:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851896.849711:0:1537152:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851896.849712:0:1537152:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=120 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851896.849713:0:1537152:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851896.849714:0:1537152:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:20.0:1773851896.849715:0:1537152:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:20.0:1773851896.849716:0:1537152:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851896.849716:0:1537152:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851896.849717:0:1537152:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851896.849718:0:1537152:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:20.0:1773851896.849718:0:1537152:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c6b46a6.
00000100:00000200:20.0:1773851896.849719:0:1537152:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065609110592, offset 224
00000400:00000200:20.0:1773851896.849720:0:1537152:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:20.0:1773851896.849721:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851896.849722:0:1537152:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:20.0:1773851896.849723:0:1537152:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851896.849724:0:1537152:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:20.0:1773851896.849729:0:1537152:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13@kfi7 local destination
00000400:00000200:20.0:1773851896.849731:0:1537152:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770242:8770242:1024:4294967295] 13@kfi7 LPNI seq info [23133329:23133329:16:4294967295]
00000400:00000200:20.0:1773851896.849732:0:1537152:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851896.849733:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851896.849735:0:1537152:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851896.849736:0:1537152:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:20.0:1773851896.849737:0:1537152:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851896.849738:0:1537152:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:20.0:1773851896.849740:0:1537152:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851896.849743:0:1537152:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:20.0:1773851896.849746:0:1537152:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 468 bytes to peer 0x102: rc=0
00000800:00000200:20.0:1773851896.849747:0:1537152:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851896.849749:0:1537152:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851896.849750:0:1537152:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:20.0:1773851896.849750:0:1537152:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851896.849751:0:1537152:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851896.849752:0:1537152:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851896.849752:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005abc3cdc x1858065609110592/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:623/0 lens 224/368 e 0 to 0 dl 1773851983 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:20.0:1773851896.849757:0:1537152:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005abc3cdc pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065609110592:12345-13@kfi7:41:default-yuba3-0 Request processed in 67us (99us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851896.849759:0:1537152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 3084764
00000100:00000040:20.0:1773851896.849760:0:1537152:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000100:00000001:20.0:1773851896.849761:0:1537152:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851896.849761:0:1537152:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851896.849762:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851896.849762:0:1537152:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b64450ab.
00000020:00000010:20.0:1773851896.849763:0:1537152:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000010bfdc01.
00000020:00000040:20.0:1773851896.849764:0:1537152:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:20.0:1773851896.849765:0:1537152:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851896.849772:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851896.849774:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851896.849775:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000200:22.0:1773851896.849777:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c6b46a6
00000400:00000010:22.0:1773851896.849777:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c6b46a6.
00000100:00000001:22.0:1773851896.849778:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851896.849779:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851896.849780:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:22.0:1773851896.849782:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 Transaction freed
00000800:00000200:17.0:1773851896.951272:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851896.951273:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851896.951274:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851896.951276:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851896.951277:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.951279:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.156@o2ib600 : PUT - for me
00000400:00000200:17.0:1773851896.951279:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851896.951280:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851896.951281:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.156@o2ib600 to cpt 5
00000400:00000200:17.0:1773851896.951282:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 2
00000400:00000200:17.0:1773851896.951284:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 3
00000400:00000200:17.0:1773851896.951284:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.156@o2ib600 to cpt 5
00000400:00000200:17.0:1773851896.951285:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.156@o2ib600 of length 224 into portal 12 MB=0x699fe0e22e5c0
00000400:00000200:17.0:1773851896.951287:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.156@o2ib600 of length 224/224 into md 0x6a32cacf5 [64] + 65392
00000800:00000200:17.0:1773851896.951288:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851896.951291:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851896.951292:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851896.951293:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851896.951293:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851896.951294:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000a987102.
00000100:00000040:17.0:1773851896.951295:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000000a987102 x1858166298174912 msgsize 224
00000100:00100000:17.0:1773851896.951296:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.156@o2ib600 (source: 12345-172.19.3.156@o2ib600)
00000100:00000001:17.0:1773851896.951298:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851896.951299:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851896.951300:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851896.951302:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851896.951303:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851896.951304:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851896.951305:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851896.951306:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851896.951307:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858166298174912
00000020:00000001:23.0:1773851896.951308:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851896.951309:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91309
00000020:00000001:23.0:1773851896.951311:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851896.951314:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e6d77679 refcount=6
00000020:00000001:23.0:1773851896.951315:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716191232 : -107155993360384 : ffff9e8acd148800)
00000020:00000001:23.0:1773851896.951316:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716191232 : -107155993360384 : ffff9e8acd148800)
00000100:00000001:23.0:1773851896.951318:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851896.951319:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851896.951320:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ea5ccc04.
00000020:00000010:23.0:1773851896.951322:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851896.951323:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851896.951325:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851896.951325:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851896.951326:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851896.951328:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851896.951329:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851896.951330:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.951331:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851896.951333:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851896.951334:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851896.951334:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851896.951335:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851896.951336:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.156@o2ib600, seq: 1998075
00000100:00000040:23.0:1773851896.951338:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e6d77679 : new rpc_count 1
00000100:00000001:20.0:1773851896.951338:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.951339:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637098968747392 : -106974740804224 : ffff9eb500930d80)
00000100:00000001:20.0:1773851896.951339:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851896.951342:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000a987102 x1858166298174912/t0(0) o400->feed51c4-681e-4ef0-8d73-8fce5959d31f@172.19.3.156@o2ib600:623/0 lens 224/0 e 0 to 0 dl 1773851983 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-oslic6-0'
00000100:00000001:23.0:1773851896.951348:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851896.951348:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851896.951350:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a987102 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:feed51c4-681e-4ef0-8d73-8fce5959d31f+6:26472:x1858166298174912:12345-172.19.3.156@o2ib600:400:login-oslic6-0
00000100:00000200:23.0:1773851896.951353:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858166298174912
00000020:00000001:23.0:1773851896.951354:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851896.951355:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851896.951356:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.951357:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851896.951358:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851896.951362:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851896.951363:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858166298174912, found 0 last_xid 1858166298174911
00000020:00000001:23.0:1773851896.951364:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851896.951365:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851896.951366:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851896.951366:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.951368:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851896.951369:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851896.951369:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851896.951370:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007594cbb6.
02000000:00000001:23.0:1773851896.951371:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.951372:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.951374:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851896.951374:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182988317141, transno 0, xid 1858166298174912
00010000:00000001:23.0:1773851896.951376:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851896.951377:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000a987102 x1858166298174912/t0(0) o400->feed51c4-681e-4ef0-8d73-8fce5959d31f@172.19.3.156@o2ib600:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic6-0'
00010000:00000001:23.0:1773851896.951382:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851896.951383:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851896.951384:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=129 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851896.951386:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851896.951387:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000021d38f47 refcount 3 to 172.19.3.156@o2ib600
00000100:00000001:23.0:1773851896.951388:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999946336 : -107156709605280 : ffff9e8aa2638060)
02000000:00000001:23.0:1773851896.951390:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851896.951390:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851896.951391:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851896.951393:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.156@o2ib600
00000400:00000010:23.0:1773851896.951394:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007062c552.
00000100:00000200:23.0:1773851896.951395:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858166298174912, offset 224
00000400:00000200:23.0:1773851896.951398:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.156@o2ib600
00000400:00000200:23.0:1773851896.951400:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.156@o2ib600 to cpt 5
00000400:00000200:23.0:1773851896.951402:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 2
00000400:00000200:23.0:1773851896.951404:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 3
00000400:00000200:23.0:1773851896.951406:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 4
00000400:00000200:23.0:1773851896.951409:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.156@o2ib600 routed destination
00000400:00000200:23.0:1773851896.951412:0:61145:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:23.0:1773851896.951413:0:61145:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:23.0:1773851896.951416:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.156@o2ib600: rtr pref emtpy: 1
00000400:00000200:23.0:1773851896.951418:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:23.0:1773851896.951419:0:61145:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.156@o2ib600: rtr pref emtpy: 1
00000400:00000200:23.0:1773851896.951421:0:61145:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:23.0:1773851896.951423:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770243:8770243:1024:4294967295] 17@kfi7 LPNI seq info [1250891925:1250891925:16:4294967295]
00000400:00000200:23.0:1773851896.951425:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:23.0:1773851896.951427:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:23.0:1773851896.951431:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.156@o2ib600(172.19.3.156@o2ib600:17@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851896.951434:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000034619f nid 172.19.3.156@o2ib600 refs 3
00000800:00000200:23.0:1773851896.951436:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851896.951438:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851896.951443:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851896.951446:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:23.0:1773851896.951452:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:23.0:1773851896.951454:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851896.951457:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851896.951459:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000021d38f47 refcount 2 to 172.19.3.156@o2ib600
00010000:00000001:23.0:1773851896.951460:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851896.951461:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851896.951462:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851896.951464:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000a987102 x1858166298174912/t0(0) o400->feed51c4-681e-4ef0-8d73-8fce5959d31f@172.19.3.156@o2ib600:623/0 lens 224/224 e 0 to 0 dl 1773851983 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-oslic6-0'
00000800:00000200:21.0:1773851896.951464:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851896.951466:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851896.951467:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:21.0:1773851896.951468:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007062c552
00000400:00000010:21.0:1773851896.951468:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007062c552.
00000100:00000001:21.0:1773851896.951469:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851896.951469:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:23.0:1773851896.951470:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a987102 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:feed51c4-681e-4ef0-8d73-8fce5959d31f+6:26472:x1858166298174912:12345-172.19.3.156@o2ib600:400:login-oslic6-0 Request processed in 121us (174us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851896.951470:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:21.0:1773851896.951472:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000001a Transaction freed
00000100:00100000:23.0:1773851896.951475:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.156@o2ib600, seq: 1998075
00000100:00000040:23.0:1773851896.951476:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e6d77679 : new rpc_count 0
00000100:00000001:23.0:1773851896.951477:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851896.951478:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851896.951479:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851896.951480:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851896.951481:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ea5ccc04.
00000020:00000040:23.0:1773851896.951482:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000e6d77679 : new refcount 5
00000100:00000001:23.0:1773851896.951484:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851896.969730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969730:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969732:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851896.969732:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851896.969733:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969733:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851896.969735:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969735:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969736:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969737:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851896.969738:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851896.969738:0:2506505:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:2.0:1773851896.969739:0:2506505:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:2.0:1773851896.969739:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969740:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851896.969740:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969741:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969741:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969742:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969742:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851896.969743:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851896.969743:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969743:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851896.969744:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969744:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969745:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969746:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851896.969749:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851896.969749:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851896.969750:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969750:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851896.969751:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969751:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851896.969752:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851896.969757:0:238018:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:11.0:1773851896.969758:0:238018:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:11.0:1773851896.969759:0:238018:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:9.0:1773851897.008764:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851897.008766:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851897.008767:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851897.008770:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851897.008772:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20401@kfi7 to cpt 2
00000400:00000200:9.0:1773851897.008774:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20401@kfi7 : PUT - for me
00000400:00000200:9.0:1773851897.008775:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20401@kfi7 to cpt 2
00000400:00000200:9.0:1773851897.008776:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009cadf5ca nid 20401@kfi7 refs 1
00000400:00000200:9.0:1773851897.008777:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20401@kfi7 to cpt 2
00000400:00000200:9.0:1773851897.008778:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009cadf5ca nid 20401@kfi7 refs 2
00000400:00000200:9.0:1773851897.008779:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009cadf5ca nid 20401@kfi7 refs 3
00000400:00000200:9.0:1773851897.008781:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20337@kfi7 to cpt 6
00000400:00000200:9.0:1773851897.008782:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20337@kfi7 of length 456 into portal 12 MB=0x69b81bfd310c0
00000400:00000200:9.0:1773851897.008783:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20337@kfi7 of length 456/456 into md 0x78146ce49 [64] + 161936
00000800:00000200:9.0:1773851897.008785:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851897.008787:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851897.008789:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20401@kfi7: PUT: OK
00000100:00000001:9.0:1773851897.008790:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851897.008791:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851897.008792:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bfc02468.
00000100:00000040:9.0:1773851897.008792:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000bfc02468 x1859831431631040 msgsize 456
00000100:00100000:9.0:1773851897.008794:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20337@kfi7 (source: 12345-20401@kfi7)
00000100:00000001:9.0:1773851897.008795:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851897.008796:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009cadf5ca nid 20401@kfi7 refs 2
00000100:00000001:11.0:1773851897.008797:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851897.008797:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851897.008798:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851897.008798:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851897.008799:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851897.008800:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851897.008801:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831431631040
00000020:00000001:11.0:1773851897.008801:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851897.008802:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce631c1
00000020:00000001:11.0:1773851897.008803:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851897.008808:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b70ec961 refcount=3936
00000020:00000001:11.0:1773851897.008809:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123795911680 : -106949913639936 : ffff9ebac8638400)
00000020:00000001:11.0:1773851897.008810:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123795911680 : -106949913639936 : ffff9ebac8638400)
00000100:00000001:11.0:1773851897.008811:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851897.008812:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851897.008813:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089741d53.
00000020:00000010:11.0:1773851897.008814:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851897.008815:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005ca9a29c.
00000100:00000001:11.0:1773851897.008816:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851897.008817:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851897.008818:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.008819:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.008820:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851897.008822:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851897.008822:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851897.008823:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20337@kfi7, seq: 406391017
00000100:00000001:8.0:1773851897.008823:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851897.008824:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851897.008825:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b70ec961 : new rpc_count 18
00000100:00000001:11.0:1773851897.008825:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609042048 : -107064100509568 : ffff9ea032522880)
00000100:00000001:8.0:1773851897.008825:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.008826:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851897.008827:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bfc02468 x1859831431631040/t0(0) o17->7130084e-73c0-4912-ad5f-4a092c069c65@20337@kfi7:178/0 lens 456/0 e 0 to 0 dl 1773852293 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1758-0'
00000100:00000001:11.0:1773851897.008830:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851897.008830:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851897.008831:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bfc02468 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7130084e-73c0-4912-ad5f-4a092c069c65+3936:39482:x1859831431631040:12345-20337@kfi7:17:default-tuolumne1758-0
00000100:00000200:11.0:1773851897.008833:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831431631040
00000020:00000001:11.0:1773851897.008834:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851897.008834:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851897.008835:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.008836:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851897.008837:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:11.0:1773851897.008838:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851897.008838:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831431631040, found 0 last_xid 1859831430869055
00000020:00000001:11.0:1773851897.008839:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851897.008840:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851897.008841:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851897.008841:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851897.008842:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:11.0:1773851897.008843:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851897.008843:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851897.008845:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000005598d03b.
02000000:00000001:11.0:1773851897.008846:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.008847:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.008848:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:11.0:1773851897.008848:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:11.0:1773851897.008849:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851897.008850:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.008851:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851897.008851:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7130084e-73c0-4912-ad5f-4a092c069c65/00000000b70ec961 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851897.008852:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851897.008853:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7130084e-73c0-4912-ad5f-4a092c069c65/00000000b70ec961 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851897.008854:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851897.008855:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:11.0:1773851897.008856:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 7130084e-73c0-4912-ad5f-4a092c069c65/00000000b70ec961 reports grant 1787559935 dropped 0, local 1882456063
00000020:00000001:11.0:1773851897.008857:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:11.0:1773851897.008857:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:11.0:1773851897.008858:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851897.008859:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593304, transno 0, xid 1859831431631040
00010000:00000001:11.0:1773851897.008860:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851897.008860:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bfc02468 x1859831431631040/t0(0) o17->7130084e-73c0-4912-ad5f-4a092c069c65@20337@kfi7:178/0 lens 456/432 e 0 to 0 dl 1773852293 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1758-0'
00010000:00000001:11.0:1773851897.008863:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851897.008864:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851897.008865:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=130 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851897.008866:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851897.008867:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a24d21d5 refcount 3 to 20337@kfi7
00000100:00000001:11.0:1773851897.008868:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329376 : -107155410222240 : ffff9e8aefd68360)
02000000:00000001:11.0:1773851897.008869:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851897.008869:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.008870:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851897.008871:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20401@kfi7
00000400:00000010:11.0:1773851897.008871:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000177f1aa0.
00000100:00000200:11.0:1773851897.008872:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859831431631040, offset 224
00000400:00000200:11.0:1773851897.008874:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20401@kfi7
00000400:00000200:11.0:1773851897.008875:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20401@kfi7 to cpt 2
00000400:00000200:11.0:1773851897.008876:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009cadf5ca nid 20401@kfi7 refs 1
00000400:00000200:11.0:1773851897.008877:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009cadf5ca nid 20401@kfi7 refs 2
00000400:00000200:11.0:1773851897.008878:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009cadf5ca nid 20401@kfi7 refs 3
00000400:00000200:11.0:1773851897.008879:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20401@kfi7 local destination
00000400:00000200:11.0:1773851897.008881:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770244:8770244:1024:4294967295] 20401@kfi7 LPNI seq info [8058907:8058907:16:4294967295]
00000400:00000200:11.0:1773851897.008882:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009cadf5ca nid 20401@kfi7 refs 2
00000400:00000200:11.0:1773851897.008883:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20401@kfi7 to cpt 2
00000400:00000200:11.0:1773851897.008886:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20401@kfi7(20401@kfi7:20401@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851897.008887:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009cadf5ca nid 20401@kfi7 refs 3
00000800:00000200:11.0:1773851897.008889:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851897.008890:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:11.0:1773851897.008892:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851897.008895:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3e7 Using peer 20401@kfi7(0x3e7)
00000800:00000200:11.0:1773851897.008898:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 532 bytes to peer 0x3e7: rc=0
00000800:00000200:11.0:1773851897.008900:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3e7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851897.008902:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851897.008902:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a24d21d5 refcount 2 to 20337@kfi7
00010000:00000001:11.0:1773851897.008903:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851897.008904:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.008904:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851897.008905:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bfc02468 x1859831431631040/t0(0) o17->7130084e-73c0-4912-ad5f-4a092c069c65@20337@kfi7:178/0 lens 456/432 e 0 to 0 dl 1773852293 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1758-0'
00000100:00100000:11.0:1773851897.008908:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bfc02468 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7130084e-73c0-4912-ad5f-4a092c069c65+3936:39482:x1859831431631040:12345-20337@kfi7:17:default-tuolumne1758-0 Request processed in 77us (115us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851897.008910:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20337@kfi7, seq: 406391017
00000100:00000040:11.0:1773851897.008911:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b70ec961 : new rpc_count 17
00000100:00000001:11.0:1773851897.008912:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851897.008912:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851897.008912:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851897.008913:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005ca9a29c.
00000800:00000200:9.0:1773851897.008913:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3e7 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851897.008914:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089741d53.
00000020:00000040:11.0:1773851897.008915:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b70ec961 : new refcount 3935
00000100:00000001:11.0:1773851897.008915:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851897.008915:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851897.008916:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20401@kfi7: PUT: OK
00000400:00000200:9.0:1773851897.008917:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000177f1aa0
00000400:00000010:9.0:1773851897.008918:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000177f1aa0.
00000100:00000001:9.0:1773851897.008919:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851897.008919:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851897.008920:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009cadf5ca nid 20401@kfi7 refs 2
00000800:00000200:9.0:1773851897.008921:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2069@kfi7:2 -> 20401@kfi7(000000004a812bdc):0x0 lsk 1000 rsk 6 tsk 0 trmk 0 tmk 0 trr 2 tta 0x3e7 Transaction freed
00000800:00000200:17.0:1773851897.013452:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851897.013453:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851897.013455:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851897.013457:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851897.013459:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013460:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16891@kfi7 : PUT - for me
00000400:00000200:17.0:1773851897.013461:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013462:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 1
00000400:00000200:17.0:1773851897.013463:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013464:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000400:00000200:17.0:1773851897.013465:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 3
00000400:00000200:17.0:1773851897.013466:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013467:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16891@kfi7 of length 224 into portal 12 MB=0x699de8c50d680
00000400:00000200:17.0:1773851897.013468:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16891@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 45680
00000800:00000200:17.0:1773851897.013470:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851897.013472:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851897.013473:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16891@kfi7: PUT: OK
00000100:00000001:17.0:1773851897.013474:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851897.013475:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851897.013476:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c98c5f2a.
00000100:00000040:17.0:1773851897.013477:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000c98c5f2a x1858030976161408 msgsize 224
00000100:00100000:17.0:1773851897.013479:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16891@kfi7 (source: 12345-16891@kfi7)
00000100:00000001:17.0:1773851897.013480:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851897.013481:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851897.013481:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
02000000:00000001:19.0:1773851897.013482:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851897.013482:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851897.013482:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851897.013483:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851897.013483:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851897.013485:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976161408
00000020:00000001:19.0:1773851897.013485:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851897.013486:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9109a
00000020:00000001:19.0:1773851897.013487:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851897.013489:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a488b477 refcount=6
00000020:00000001:19.0:1773851897.013489:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240120320 : -107152469431296 : ffff9e8b9f1f6c00)
00000020:00000001:19.0:1773851897.013490:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240120320 : -107152469431296 : ffff9e8b9f1f6c00)
00000100:00000001:19.0:1773851897.013491:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851897.013492:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851897.013492:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851897.013494:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851897.013495:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bdd5777c.
00000100:00000001:19.0:1773851897.013495:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851897.013496:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851897.013496:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851897.013497:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851897.013498:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851897.013498:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.013499:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851897.013500:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851897.013500:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851897.013501:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851897.013501:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851897.013502:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16891@kfi7, seq: 2156428
00000100:00000040:19.0:1773851897.013502:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a488b477 : new rpc_count 1
00000100:00000001:19.0:1773851897.013503:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132237074560 : -106941472477056 : ffff9ebcbf857080)
00000100:00000001:16.0:1773851897.013503:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851897.013503:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851897.013504:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c98c5f2a x1858030976161408/t0(0) o400->57fc1c14-fd1e-4696-a0f9-348e558dc26d@16891@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne234-0'
00000100:00000001:19.0:1773851897.013507:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851897.013507:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851897.013508:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c98c5f2a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:57fc1c14-fd1e-4696-a0f9-348e558dc26d+6:47815:x1858030976161408:12345-16891@kfi7:400:default-tuolumne234-0
00000100:00000200:19.0:1773851897.013509:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976161408
00000020:00000001:19.0:1773851897.013510:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851897.013511:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851897.013512:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.013513:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851897.013513:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851897.013514:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851897.013515:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976161408, found 0 last_xid 1858030976161407
00000020:00000001:19.0:1773851897.013516:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851897.013516:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851897.013517:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851897.013517:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.013518:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851897.013518:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851897.013519:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851897.013519:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d118fe66.
02000000:00000001:19.0:1773851897.013520:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.013521:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.013521:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851897.013522:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030976161408
00010000:00000001:19.0:1773851897.013523:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851897.013524:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c98c5f2a x1858030976161408/t0(0) o400->57fc1c14-fd1e-4696-a0f9-348e558dc26d@16891@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne234-0'
00010000:00000001:19.0:1773851897.013526:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851897.013527:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851897.013527:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=130 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851897.013528:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851897.013529:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fcb1f92c refcount 5 to 16891@kfi7
00000100:00000001:19.0:1773851897.013530:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095775840 : -107152613775776 : ffff9e8b9684e660)
02000000:00000001:19.0:1773851897.013531:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851897.013531:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.013532:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851897.013533:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16891@kfi7
00000400:00000010:19.0:1773851897.013533:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000211a6341.
00000100:00000200:19.0:1773851897.013534:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976161408, offset 224
00000400:00000200:19.0:1773851897.013535:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16891@kfi7
00000400:00000200:19.0:1773851897.013536:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:19.0:1773851897.013537:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 1
00000400:00000200:19.0:1773851897.013540:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000400:00000200:19.0:1773851897.013541:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 3
00000400:00000200:19.0:1773851897.013542:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16891@kfi7 local destination
00000400:00000200:19.0:1773851897.013544:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770245:8770245:1024:4294967295] 16891@kfi7 LPNI seq info [24422:24422:16:4294967295]
00000400:00000200:19.0:1773851897.013545:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000400:00000200:19.0:1773851897.013546:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:19.0:1773851897.013548:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16891@kfi7(16891@kfi7:16891@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851897.013549:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 3
00000800:00000200:19.0:1773851897.013550:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851897.013551:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851897.013553:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851897.013556:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x37f Using peer 16891@kfi7(0x37f)
00000800:00000200:19.0:1773851897.013559:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x37f: rc=0
00000800:00000200:19.0:1773851897.013560:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x37f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851897.013562:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851897.013563:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fcb1f92c refcount 4 to 16891@kfi7
00010000:00000001:19.0:1773851897.013564:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851897.013564:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.013565:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851897.013566:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c98c5f2a x1858030976161408/t0(0) o400->57fc1c14-fd1e-4696-a0f9-348e558dc26d@16891@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne234-0'
00000100:00100000:19.0:1773851897.013569:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c98c5f2a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:57fc1c14-fd1e-4696-a0f9-348e558dc26d+6:47815:x1858030976161408:12345-16891@kfi7:400:default-tuolumne234-0 Request processed in 61us (90us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851897.013571:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16891@kfi7, seq: 2156428
00000800:00000200:17.0:1773851897.013571:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x37f TN_EVENT_TX_OK event status 0
00000100:00000040:19.0:1773851897.013572:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a488b477 : new rpc_count 0
00000100:00000001:19.0:1773851897.013573:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851897.013573:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851897.013574:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851897.013574:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851897.013574:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16891@kfi7: PUT: OK
00000020:00000010:19.0:1773851897.013575:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bdd5777c.
00000400:00000200:17.0:1773851897.013575:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000211a6341
00000400:00000010:17.0:1773851897.013575:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000211a6341.
00000020:00000010:19.0:1773851897.013576:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000020:00000040:19.0:1773851897.013576:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000a488b477 : new refcount 5
00000100:00000001:17.0:1773851897.013576:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851897.013576:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:19.0:1773851897.013577:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851897.013577:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000800:00000200:17.0:1773851897.013579:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 16891@kfi7(00000000c3edbc02):0x0 lsk 896 rsk 77 tsk 0 trmk 0 tmk 0 trr 4 tta 0x37f Transaction freed
00000800:00000200:17.0:1773851897.013836:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851897.013837:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851897.013839:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851897.013843:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851897.013847:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013849:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16891@kfi7 : PUT - for me
00000400:00000200:17.0:1773851897.013850:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013852:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 1
00000400:00000200:17.0:1773851897.013853:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013855:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000400:00000200:17.0:1773851897.013856:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 3
00000400:00000200:17.0:1773851897.013860:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.013862:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16891@kfi7 of length 224 into portal 12 MB=0x699de8c50df00
00000400:00000200:17.0:1773851897.013864:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16891@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 45904
00000800:00000200:17.0:1773851897.013867:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851897.013870:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851897.013872:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16891@kfi7: PUT: OK
00000100:00000001:17.0:1773851897.013873:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851897.013874:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851897.013876:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006a980a26.
00000100:00000040:17.0:1773851897.013877:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000006a980a26 x1858030976163584 msgsize 224
00000100:00100000:17.0:1773851897.013879:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16891@kfi7 (source: 12345-16891@kfi7)
00000100:00000001:17.0:1773851897.013881:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851897.013882:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000100:00000001:19.0:1773851897.013883:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851897.013884:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851897.013884:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851897.013885:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851897.013886:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851897.013887:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851897.013888:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030976163584
00000020:00000001:19.0:1773851897.013889:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851897.013889:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9121b
00000020:00000001:19.0:1773851897.013890:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851897.013893:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001b51eba2 refcount=6
00000020:00000001:19.0:1773851897.013894:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240536064 : -107152469015552 : ffff9e8b9f25c400)
00000020:00000001:19.0:1773851897.013895:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240536064 : -107152469015552 : ffff9e8b9f25c400)
00000100:00000001:19.0:1773851897.013897:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851897.013898:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851897.013899:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851897.013900:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851897.013901:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bdd5777c.
00000100:00000001:19.0:1773851897.013903:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851897.013903:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851897.013904:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851897.013906:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851897.013906:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851897.013907:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.013909:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851897.013911:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851897.013911:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851897.013911:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851897.013912:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851897.013913:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16891@kfi7, seq: 2156429
00000100:00000040:19.0:1773851897.013914:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001b51eba2 : new rpc_count 1
00000100:00000001:16.0:1773851897.013914:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.013916:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794781184 : -107029914770432 : ffff9ea827f32400)
00000100:00000001:16.0:1773851897.013916:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851897.013918:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006a980a26 x1858030976163584/t0(0) o400->1edd4296-fc7b-450e-9ff4-39f3925bc0a0@16891@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne234-0'
00000100:00000001:19.0:1773851897.013923:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851897.013923:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851897.013925:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a980a26 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1edd4296-fc7b-450e-9ff4-39f3925bc0a0+6:47817:x1858030976163584:12345-16891@kfi7:400:default-tuolumne234-0
00000100:00000200:19.0:1773851897.013927:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030976163584
00000020:00000001:19.0:1773851897.013928:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851897.013929:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851897.013930:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.013931:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851897.013932:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851897.013933:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851897.013934:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030976163584, found 0 last_xid 1858030976163583
00000020:00000001:19.0:1773851897.013935:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851897.013936:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851897.013937:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851897.013938:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.013939:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851897.013940:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851897.013941:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851897.013942:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008fb2f5f8.
02000000:00000001:19.0:1773851897.013942:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.013943:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.013944:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851897.013946:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767811, transno 0, xid 1858030976163584
00010000:00000001:19.0:1773851897.013947:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851897.013948:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006a980a26 x1858030976163584/t0(0) o400->1edd4296-fc7b-450e-9ff4-39f3925bc0a0@16891@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne234-0'
00010000:00000001:19.0:1773851897.013953:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851897.013954:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851897.013954:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=130 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851897.013957:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851897.013958:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fcb1f92c refcount 5 to 16891@kfi7
00000100:00000001:19.0:1773851897.013959:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095775840 : -107152613775776 : ffff9e8b9684e660)
02000000:00000001:19.0:1773851897.013960:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851897.013961:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.013962:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851897.013963:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16891@kfi7
00000400:00000010:19.0:1773851897.013964:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000001916757.
00000100:00000200:19.0:1773851897.013965:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030976163584, offset 224
00000400:00000200:19.0:1773851897.013967:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16891@kfi7
00000400:00000200:19.0:1773851897.013968:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:19.0:1773851897.013969:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 1
00000400:00000200:19.0:1773851897.013971:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000400:00000200:19.0:1773851897.013972:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 3
00000400:00000200:19.0:1773851897.013974:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16891@kfi7 local destination
00000400:00000200:19.0:1773851897.013976:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770246:8770246:1024:4294967295] 16891@kfi7 LPNI seq info [24423:24423:16:4294967295]
00000400:00000200:19.0:1773851897.013978:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000400:00000200:19.0:1773851897.013979:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16891@kfi7 to cpt 4
00000400:00000200:19.0:1773851897.013983:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16891@kfi7(16891@kfi7:16891@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851897.013984:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 3
00000800:00000200:19.0:1773851897.013986:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851897.013988:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851897.013991:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851897.013995:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000037a Using peer 16891@kfi7(0x10000000000037a)
00000800:00000200:19.0:1773851897.014000:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0x10000000000037a: rc=0
00000800:00000200:19.0:1773851897.014002:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000037a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851897.014005:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851897.014007:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fcb1f92c refcount 4 to 16891@kfi7
00010000:00000001:19.0:1773851897.014008:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851897.014009:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.014009:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851897.014010:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006a980a26 x1858030976163584/t0(0) o400->1edd4296-fc7b-450e-9ff4-39f3925bc0a0@16891@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne234-0'
00000100:00100000:19.0:1773851897.014015:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a980a26 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1edd4296-fc7b-450e-9ff4-39f3925bc0a0+6:47817:x1858030976163584:12345-16891@kfi7:400:default-tuolumne234-0 Request processed in 92us (137us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851897.014016:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000037a TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851897.014019:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16891@kfi7, seq: 2156429
00000400:00000200:17.0:1773851897.014019:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:19.0:1773851897.014020:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001b51eba2 : new rpc_count 0
00000400:00000200:17.0:1773851897.014020:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16891@kfi7: PUT: OK
00000100:00000001:19.0:1773851897.014021:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851897.014021:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000001916757
00000100:00000001:19.0:1773851897.014022:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851897.014022:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000010:17.0:1773851897.014022:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000001916757.
00000020:00000010:19.0:1773851897.014023:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bdd5777c.
00000100:00000001:17.0:1773851897.014023:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851897.014023:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851897.014025:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000400:00000200:17.0:1773851897.014025:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000078b13a9b nid 16891@kfi7 refs 2
00000020:00000040:19.0:1773851897.014026:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000001b51eba2 : new refcount 5
00000100:00000001:19.0:1773851897.014026:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851897.014027:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16891@kfi7(000000000f5cea5f):0x0 lsk 891 rsk 78 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000037a Transaction freed
00000800:00000200:17.0:1773851897.028625:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851897.028625:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851897.028626:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851897.028628:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851897.028630:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.028631:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9474@kfi7 : PUT - for me
00000400:00000200:17.0:1773851897.028632:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.028633:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 1
00000400:00000200:17.0:1773851897.028634:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.028634:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000400:00000200:17.0:1773851897.028635:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 3
00000400:00000200:17.0:1773851897.028636:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9666@kfi7 to cpt 6
00000400:00000200:17.0:1773851897.028636:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9666@kfi7 of length 224 into portal 12 MB=0x69aa079d4c540
00000400:00000200:17.0:1773851897.028637:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9666@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 46128
00000800:00000200:17.0:1773851897.028639:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851897.028640:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851897.028641:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9474@kfi7: PUT: OK
00000100:00000001:17.0:1773851897.028641:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851897.028641:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851897.028642:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000015282423.
00000100:00000040:17.0:1773851897.028643:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000015282423 x1858863889696064 msgsize 224
00000100:00100000:17.0:1773851897.028644:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9666@kfi7 (source: 12345-9474@kfi7)
00000100:00000001:17.0:1773851897.028644:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851897.028645:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000100:00000001:19.0:1773851897.028646:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851897.028646:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851897.028646:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851897.028647:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851897.028647:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851897.028647:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851897.028648:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863889696064
00000020:00000001:19.0:1773851897.028649:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851897.028649:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac919d1
00000020:00000001:19.0:1773851897.028649:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851897.028652:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008d1d1f5e refcount=6
00000020:00000001:19.0:1773851897.028653:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242248192 : -107152467303424 : ffff9e8b9f3fe400)
00000020:00000001:19.0:1773851897.028653:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242248192 : -107152467303424 : ffff9e8b9f3fe400)
00000100:00000001:19.0:1773851897.028654:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851897.028655:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851897.028656:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851897.028656:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851897.028657:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bdd5777c.
00000100:00000001:19.0:1773851897.028658:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851897.028658:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851897.028659:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851897.028660:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851897.028660:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851897.028660:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.028661:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851897.028662:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851897.028662:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851897.028662:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851897.028663:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9666@kfi7, seq: 2156430
00000100:00000001:16.0:1773851897.028663:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851897.028664:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008d1d1f5e : new rpc_count 1
00000100:00000001:19.0:1773851897.028664:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794784640 : -107029914766976 : ffff9ea827f33180)
00000100:00000001:16.0:1773851897.028664:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851897.028664:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851897.028665:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000015282423 x1858863889696064/t0(0) o400->680337cd-685a-4b04-a87c-a56f47e99f54@9666@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1095-0'
00000100:00000001:19.0:1773851897.028667:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851897.028668:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851897.028669:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000015282423 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:680337cd-685a-4b04-a87c-a56f47e99f54+6:39139:x1858863889696064:12345-9666@kfi7:400:default-tuolumne1095-0
00000100:00000200:19.0:1773851897.028670:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863889696064
00000020:00000001:19.0:1773851897.028670:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851897.028671:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851897.028671:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.028672:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851897.028672:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851897.028673:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851897.028673:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863889696064, found 0 last_xid 1858863889696063
00000020:00000001:19.0:1773851897.028674:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851897.028675:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851897.028675:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851897.028675:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.028676:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851897.028676:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851897.028677:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851897.028678:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e7f7db99.
02000000:00000001:19.0:1773851897.028678:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.028679:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.028679:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851897.028680:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475273173, transno 0, xid 1858863889696064
00010000:00000001:19.0:1773851897.028680:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851897.028681:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000015282423 x1858863889696064/t0(0) o400->680337cd-685a-4b04-a87c-a56f47e99f54@9666@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1095-0'
00010000:00000001:19.0:1773851897.028683:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851897.028684:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851897.028684:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=130 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851897.028685:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851897.028686:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005c6c54a2 refcount 3 to 9666@kfi7
00000100:00000001:19.0:1773851897.028686:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299330528 : -107155410221088 : ffff9e8aefd687e0)
02000000:00000001:19.0:1773851897.028687:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851897.028687:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.028688:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851897.028689:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9474@kfi7
00000400:00000010:19.0:1773851897.028689:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000059017436.
00000100:00000200:19.0:1773851897.028690:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863889696064, offset 224
00000400:00000200:19.0:1773851897.028691:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9474@kfi7
00000400:00000200:19.0:1773851897.028692:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:19.0:1773851897.028693:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 1
00000400:00000200:19.0:1773851897.028694:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000400:00000200:19.0:1773851897.028695:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 3
00000400:00000200:19.0:1773851897.028696:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9474@kfi7 local destination
00000400:00000200:19.0:1773851897.028697:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770247:8770247:1024:4294967295] 9474@kfi7 LPNI seq info [17405:17405:16:4294967295]
00000400:00000200:19.0:1773851897.028698:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000400:00000200:19.0:1773851897.028699:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9474@kfi7 to cpt 4
00000400:00000200:19.0:1773851897.028701:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9474@kfi7(9474@kfi7:9474@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851897.028702:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 3
00000800:00000200:19.0:1773851897.028703:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851897.028705:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851897.028707:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851897.028709:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fae Using peer 9474@kfi7(0x100000000000fae)
00000800:00000200:19.0:1773851897.028712:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0x100000000000fae: rc=0
00000800:00000200:19.0:1773851897.028713:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fae TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851897.028715:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851897.028716:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005c6c54a2 refcount 2 to 9666@kfi7
00010000:00000001:19.0:1773851897.028716:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851897.028717:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851897.028717:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851897.028718:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000015282423 x1858863889696064/t0(0) o400->680337cd-685a-4b04-a87c-a56f47e99f54@9666@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1095-0'
00000100:00100000:19.0:1773851897.028721:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000015282423 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:680337cd-685a-4b04-a87c-a56f47e99f54+6:39139:x1858863889696064:12345-9666@kfi7:400:default-tuolumne1095-0 Request processed in 52us (77us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851897.028723:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9666@kfi7, seq: 2156430
00000100:00000040:19.0:1773851897.028723:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008d1d1f5e : new rpc_count 0
00000100:00000001:19.0:1773851897.028724:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851897.028725:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fae TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851897.028729:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851897.028729:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851897.028730:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bdd5777c.
00000400:00000200:17.0:1773851897.028730:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851897.028731:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000020:00000040:19.0:1773851897.028731:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000008d1d1f5e : new refcount 5
00000400:00000200:17.0:1773851897.028731:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9474@kfi7: PUT: OK
00000100:00000001:19.0:1773851897.028732:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851897.028732:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000059017436
00000400:00000010:17.0:1773851897.028732:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000059017436.
00000100:00000001:17.0:1773851897.028733:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851897.028733:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851897.028734:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084920b26 nid 9474@kfi7 refs 2
00000800:00000200:17.0:1773851897.028735:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9474@kfi7(0000000099b139ba):0x0 lsk 4015 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000fae Transaction freed
00000800:00000200:6.0:1773851897.063193:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851897.063193:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851897.063194:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851897.063196:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851897.063196:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851897.063198:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851897.063200:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10290@kfi7(00000000ff86b19b):0x5f3 version: 2; local version 2; negotiated version: 2
00000800:00000200:6.0:1773851897.063202:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851897.063203:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 Using peer 10290@kfi7(0x5f3)
00000400:00000200:6.0:1773851897.063205:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10290@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.063206:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10290@kfi7 to cpt 1
00000400:00000200:6.0:1773851897.063207:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10290@kfi7 : PUT - for me
00000400:00000200:6.0:1773851897.063209:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10290@kfi7 to cpt 1
00000800:00000200:5.0:1773851897.063209:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 38 bytes to peer 0x5f3: rc=0
00000400:00000200:6.0:1773851897.063211:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0552ffb nid 10290@kfi7 refs 1
00000800:00000200:5.0:1773851897.063211:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851897.063213:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10290@kfi7 to cpt 1
00000400:00000200:6.0:1773851897.063214:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0552ffb nid 10290@kfi7 refs 2
00000400:00000200:6.0:1773851897.063216:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b0552ffb nid 10290@kfi7 refs 3
00000400:00000200:6.0:1773851897.063217:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10482@kfi7 to cpt 4
00000400:00000200:6.0:1773851897.063219:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10482@kfi7 of length 456 into portal 12 MB=0x69b4c7a0d4a00
00000400:00000200:6.0:1773851897.063221:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10482@kfi7 of length 456/456 into md 0x793926dc5 [64] + 164872
00000800:00000200:5.0:1773851897.063224:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851897.063225:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851897.063227:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851897.063227:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 Transaction freed
00000400:00000200:6.0:1773851897.063229:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10290@kfi7: PUT: OK
00000100:00000001:6.0:1773851897.063231:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851897.063231:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:6.0:1773851897.063233:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c6aaa74.
00000100:00000040:6.0:1773851897.063234:0:2499722:0:(events.c:358:request_in_callback()) incoming req@000000009c6aaa74 x1859602627774976 msgsize 456
00000100:00100000:6.0:1773851897.063237:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-10482@kfi7 (source: 12345-10290@kfi7)
00000100:00000001:6.0:1773851897.063239:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851897.063240:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0552ffb nid 10290@kfi7 refs 2
00000100:00000001:7.0:1773851897.063241:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851897.063242:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851897.063243:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:6.0:1773851897.063243:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e07369fe: 2069@kfi7:1 <- 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851897.063244:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851897.063245:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851897.063247:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602627774976
00000020:00000001:7.0:1773851897.063248:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851897.063249:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d8ba2c
00000020:00000001:7.0:1773851897.063250:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851897.063253:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bd7c80f refcount=3570
00000020:00000001:7.0:1773851897.063254:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637112454205440 : -106961255346176 : ffff9eb8245ed000)
00000020:00000001:7.0:1773851897.063256:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637112454205440 : -106961255346176 : ffff9eb8245ed000)
00000100:00000001:7.0:1773851897.063257:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851897.063258:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851897.063259:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000baa61ed4.
00000020:00000010:7.0:1773851897.063260:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851897.063262:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a32cd07d.
00000100:00000001:7.0:1773851897.063263:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851897.063264:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851897.063264:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.063266:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.063267:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851897.063269:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851897.063269:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851897.063270:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851897.063270:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851897.063271:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10482@kfi7, seq: 371100852
00000100:00000001:7.0:1773851897.063273:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851897.063273:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bd7c80f : new rpc_count 40
00000100:00000001:7.0:1773851897.063274:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851897.063274:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637025359422208 : -107048350129408 : ffff9ea3dd1de300)
00000100:00000040:4.0:1773851897.063275:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c6aaa74 x1859602627774976/t0(0) o17->62040075-c7d4-4dd3-8c36-05637e6266e1@10482@kfi7:685/0 lens 456/0 e 0 to 0 dl 1773852045 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1129-0'
00000100:00000001:4.0:1773851897.063278:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851897.063278:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851897.063279:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c6aaa74 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:62040075-c7d4-4dd3-8c36-05637e6266e1+3570:39488:x1859602627774976:12345-10482@kfi7:17:default-tuolumne1129-0
00000100:00000200:4.0:1773851897.063281:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602627774976
00000020:00000001:4.0:1773851897.063282:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851897.063282:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851897.063283:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851897.063284:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851897.063284:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:4.0:1773851897.063285:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851897.063286:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602627774976, found 0 last_xid 1859602627001279
00000020:00000001:4.0:1773851897.063287:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851897.063288:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851897.063288:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851897.063289:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851897.063290:0:60963:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:4.0:1773851897.063291:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851897.063291:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851897.063292:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000bdc2c3a2.
02000000:00000001:4.0:1773851897.063293:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851897.063294:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851897.063295:0:60963:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:4.0:1773851897.063295:0:60963:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:4.0:1773851897.063296:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:4.0:1773851897.063297:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851897.063298:0:60963:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:4.0:1773851897.063299:0:60963:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 62040075-c7d4-4dd3-8c36-05637e6266e1/000000005bd7c80f free: 126633370845184 avail: 126633368748032
00000020:00000001:4.0:1773851897.063300:0:60963:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:4.0:1773851897.063303:0:60963:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 62040075-c7d4-4dd3-8c36-05637e6266e1/000000005bd7c80f avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:4.0:1773851897.063304:0:60963:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:4.0:1773851897.063305:0:60963:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:4.0:1773851897.063305:0:60963:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 62040075-c7d4-4dd3-8c36-05637e6266e1/000000005bd7c80f reports grant 1785200639 dropped 0, local 1882456063
00000020:00000001:4.0:1773851897.063306:0:60963:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:4.0:1773851897.063307:0:60963:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:4.0:1773851897.063307:0:60963:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851897.063308:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264591865, transno 0, xid 1859602627774976
00010000:00000001:4.0:1773851897.063308:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851897.063309:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c6aaa74 x1859602627774976/t0(0) o17->62040075-c7d4-4dd3-8c36-05637e6266e1@10482@kfi7:685/0 lens 456/432 e 0 to 0 dl 1773852045 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1129-0'
00010000:00000001:4.0:1773851897.063312:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851897.063312:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851897.063313:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=129 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851897.063314:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851897.063314:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d17f0bb3 refcount 3 to 10482@kfi7
00000100:00000001:4.0:1773851897.063315:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958592 : -107156125593024 : ffff9e8ac532d240)
02000000:00000001:4.0:1773851897.063316:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851897.063317:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851897.063317:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851897.063318:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10290@kfi7
00000400:00000010:4.0:1773851897.063319:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e586845a.
00000100:00000200:4.0:1773851897.063320:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859602627774976, offset 224
00000400:00000200:4.0:1773851897.063321:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10290@kfi7
00000400:00000200:4.0:1773851897.063322:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10290@kfi7 to cpt 1
00000400:00000200:4.0:1773851897.063323:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b0552ffb nid 10290@kfi7 refs 1
00000400:00000200:4.0:1773851897.063324:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b0552ffb nid 10290@kfi7 refs 2
00000400:00000200:4.0:1773851897.063326:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b0552ffb nid 10290@kfi7 refs 3
00000400:00000200:4.0:1773851897.063327:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10290@kfi7 local destination
00000400:00000200:4.0:1773851897.063328:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770248:8770248:1024:4294967295] 10290@kfi7 LPNI seq info [12191066:12191066:16:4294967295]
00000400:00000200:4.0:1773851897.063330:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b0552ffb nid 10290@kfi7 refs 2
00000400:00000200:4.0:1773851897.063331:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10290@kfi7 to cpt 1
00000400:00000200:4.0:1773851897.063333:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10290@kfi7(10290@kfi7:10290@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851897.063334:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b0552ffb nid 10290@kfi7 refs 3
00000800:00000200:4.0:1773851897.063336:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851897.063337:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:4.0:1773851897.063339:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851897.063342:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 Using peer 10290@kfi7(0x5f3)
00000800:00000200:4.0:1773851897.063344:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046154330: Posted send of 532 bytes to peer 0x5f3: rc=0
00000800:00000200:4.0:1773851897.063346:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851897.063348:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851897.063349:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d17f0bb3 refcount 2 to 10482@kfi7
00010000:00000001:4.0:1773851897.063349:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851897.063350:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851897.063350:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851897.063351:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c6aaa74 x1859602627774976/t0(0) o17->62040075-c7d4-4dd3-8c36-05637e6266e1@10482@kfi7:685/0 lens 456/432 e 0 to 0 dl 1773852045 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1129-0'
00000100:00100000:4.0:1773851897.063356:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c6aaa74 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:62040075-c7d4-4dd3-8c36-05637e6266e1+3570:39488:x1859602627774976:12345-10482@kfi7:17:default-tuolumne1129-0 Request processed in 77us (121us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851897.063358:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10482@kfi7, seq: 371100852
00000100:00000040:4.0:1773851897.063358:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bd7c80f : new rpc_count 39
00000100:00000001:4.0:1773851897.063359:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851897.063360:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851897.063360:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:4.0:1773851897.063361:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a32cd07d.
00000020:00000010:4.0:1773851897.063362:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000baa61ed4.
00000020:00000040:4.0:1773851897.063363:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000005bd7c80f : new refcount 3569
00000100:00000001:4.0:1773851897.063364:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851897.063371:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851897.063374:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851897.063375:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10290@kfi7: PUT: OK
00000400:00000200:5.0:1773851897.063377:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e586845a
00000400:00000010:5.0:1773851897.063377:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e586845a.
00000100:00000001:5.0:1773851897.063379:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851897.063379:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851897.063380:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b0552ffb nid 10290@kfi7 refs 2
00000800:00000200:5.0:1773851897.063383:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 10290@kfi7(00000000ff86b19b):0x0 lsk 1524 rsk 14 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5f3 Transaction freed
00000800:00000200:29.0:1773851897.085238:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851897.085239:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851897.085240:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851897.085242:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851897.085244:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.085245:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21746@kfi7 : PUT - for me
00000400:00000200:29.0:1773851897.085246:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.085247:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:29.0:1773851897.085248:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.085249:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:29.0:1773851897.085249:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:29.0:1773851897.085250:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21747@kfi7 to cpt 3
00000400:00000200:29.0:1773851897.085251:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21747@kfi7 of length 224 into portal 12 MB=0x69b0a32ab3a40
00000400:00000200:29.0:1773851897.085252:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21747@kfi7 of length 224/224 into md 0x77fe1859d [64] + 8824
00000800:00000200:29.0:1773851897.085254:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851897.085256:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851897.085256:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21746@kfi7: PUT: OK
00000100:00000001:29.0:1773851897.085257:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851897.085258:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851897.085259:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005b13827c.
00000100:00000040:29.0:1773851897.085260:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000005b13827c x1859317962324544 msgsize 224
00000100:00100000:29.0:1773851897.085262:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-21747@kfi7 (source: 12345-21746@kfi7)
00000100:00000001:29.0:1773851897.085262:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851897.085263:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000100:00000001:31.0:1773851897.085265:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851897.085265:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2069@kfi7:7 <- 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851897.085266:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851897.085267:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851897.085268:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851897.085269:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851897.085270:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317962324544
00000020:00000001:31.0:1773851897.085271:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851897.085272:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9266c
00000020:00000001:31.0:1773851897.085273:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851897.085279:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007f505e46 refcount=6
00000020:00000001:31.0:1773851897.085280:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630999040 : -107123078552576 : ffff9e9276f4a400)
00000020:00000001:31.0:1773851897.085282:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630999040 : -107123078552576 : ffff9e9276f4a400)
00000100:00000001:31.0:1773851897.085284:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851897.085285:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851897.085286:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000243a822a.
00000020:00000010:31.0:1773851897.085288:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851897.085289:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851897.085291:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851897.085291:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851897.085292:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.085294:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851897.085295:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851897.085295:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.085297:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.085299:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851897.085299:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851897.085299:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851897.085300:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851897.085301:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21747@kfi7, seq: 2055595
00000100:00000001:31.0:1773851897.085302:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851897.085302:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007f505e46 : new rpc_count 1
00000100:00000001:31.0:1773851897.085303:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851897.085303:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337971968 : -106936371579648 : ffff9ebdef8ef500)
00000100:00000040:30.0:1773851897.085304:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005b13827c x1859317962324544/t0(0) o400->602458b8-9ae5-43ca-987c-12a471413e79@21747@kfi7:685/0 lens 224/0 e 0 to 0 dl 1773852045 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1833-0'
00000100:00000001:30.0:1773851897.085308:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851897.085308:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851897.085309:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005b13827c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:602458b8-9ae5-43ca-987c-12a471413e79+6:39901:x1859317962324544:12345-21747@kfi7:400:default-tuolumne1833-0
00000100:00000200:30.0:1773851897.085311:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317962324544
00000020:00000001:30.0:1773851897.085312:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851897.085312:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851897.085313:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851897.085314:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851897.085314:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851897.085315:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851897.085316:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317962324544, found 0 last_xid 1859317962324543
00000020:00000001:30.0:1773851897.085317:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851897.085318:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851897.085318:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851897.085319:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851897.085319:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851897.085320:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851897.085321:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851897.085322:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f2d1e620.
02000000:00000001:30.0:1773851897.085322:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851897.085323:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851897.085324:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851897.085325:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317962324544
00010000:00000001:30.0:1773851897.085325:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851897.085326:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005b13827c x1859317962324544/t0(0) o400->602458b8-9ae5-43ca-987c-12a471413e79@21747@kfi7:685/0 lens 224/224 e 0 to 0 dl 1773852045 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1833-0'
00010000:00000001:30.0:1773851897.085329:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851897.085330:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851897.085330:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=130 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851897.085331:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851897.085332:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d6c586e9 refcount 5 to 21747@kfi7
00000100:00000001:30.0:1773851897.085333:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154816 : -107139310396800 : ffff9e8eaf765a80)
02000000:00000001:30.0:1773851897.085334:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851897.085334:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851897.085335:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851897.085335:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21746@kfi7
00000400:00000010:30.0:1773851897.085336:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005645ee20.
00000100:00000200:30.0:1773851897.085337:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317962324544, offset 224
00000400:00000200:30.0:1773851897.085339:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21746@kfi7
00000400:00000200:30.0:1773851897.085340:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:30.0:1773851897.085341:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 1
00000400:00000200:30.0:1773851897.085342:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:30.0:1773851897.085343:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000400:00000200:30.0:1773851897.085344:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21746@kfi7 local destination
00000400:00000200:30.0:1773851897.085346:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770249:8770249:1024:4294967295] 21746@kfi7 LPNI seq info [5226829:5226829:16:4294967295]
00000400:00000200:30.0:1773851897.085347:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000400:00000200:30.0:1773851897.085348:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21746@kfi7 to cpt 7
00000400:00000200:30.0:1773851897.085350:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21746@kfi7(21746@kfi7:21746@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851897.085351:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 3
00000800:00000200:30.0:1773851897.085353:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851897.085354:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851897.085356:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851897.085359:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Using peer 21746@kfi7(0x0)
00000800:00000200:30.0:1773851897.085362:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000fd057322: Posted send of 324 bytes to peer 0x0: rc=0
00000800:00000200:30.0:1773851897.085363:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851897.085365:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851897.085366:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d6c586e9 refcount 4 to 21747@kfi7
00010000:00000001:30.0:1773851897.085366:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851897.085367:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851897.085368:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851897.085368:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005b13827c x1859317962324544/t0(0) o400->602458b8-9ae5-43ca-987c-12a471413e79@21747@kfi7:685/0 lens 224/224 e 0 to 0 dl 1773852045 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1833-0'
00000100:00100000:30.0:1773851897.085371:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005b13827c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:602458b8-9ae5-43ca-987c-12a471413e79+6:39901:x1859317962324544:12345-21747@kfi7:400:default-tuolumne1833-0 Request processed in 63us (110us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851897.085374:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21747@kfi7, seq: 2055595
00000100:00000040:30.0:1773851897.085374:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007f505e46 : new rpc_count 0
00000100:00000001:30.0:1773851897.085375:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851897.085375:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851897.085376:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851897.085376:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:30.0:1773851897.085377:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000200:29.0:1773851897.085377:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851897.085378:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000243a822a.
00000400:00000200:29.0:1773851897.085378:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21746@kfi7: PUT: OK
00000020:00000040:30.0:1773851897.085379:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000007f505e46 : new refcount 5
00000100:00000001:30.0:1773851897.085379:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851897.085379:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005645ee20
00000400:00000010:29.0:1773851897.085379:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005645ee20.
00000100:00000001:29.0:1773851897.085380:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851897.085380:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851897.085381:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b0deee3 nid 21746@kfi7 refs 2
00000800:00000200:29.0:1773851897.085382:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2069@kfi7:7 -> 21746@kfi7(00000000cd77abd0):0x0 lsk 1 rsk 45 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:29.0:1773851897.102889:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851897.102890:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851897.102891:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851897.102893:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851897.102895:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.102897:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2074@kfi7 : PUT - for me
00000400:00000200:29.0:1773851897.102898:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.102898:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:29.0:1773851897.102899:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.102900:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:29.0:1773851897.102901:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:29.0:1773851897.102902:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.102903:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee2ad40
00000400:00000200:29.0:1773851897.102905:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x77ec58b3d [256] + 22000
00000800:00000200:29.0:1773851897.102907:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851897.102909:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851897.102909:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000100:00000001:29.0:1773851897.102910:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851897.102911:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:29.0:1773851897.102911:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000da500fd4.
00000100:00000040:29.0:1773851897.102912:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000da500fd4 x1858059204996416 msgsize 224
00000100:00100000:29.0:1773851897.102914:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2074@kfi7)
00000100:00000001:29.0:1773851897.102915:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851897.102916:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851897.102917:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000804ff607: 2054@kfi7:7 <- 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851897.102917:0:41218:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851897.102918:0:41218:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851897.102919:0:41218:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851897.102919:0:41218:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851897.102920:0:41218:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851897.102921:0:41218:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059204996416
00000020:00000001:28.0:1773851897.102922:0:41218:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851897.102922:0:41218:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:28.0:1773851897.102923:0:41218:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851897.102924:0:41218:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:28.0:1773851897.102925:0:41218:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:28.0:1773851897.102926:0:41218:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:28.0:1773851897.102927:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851897.102928:0:41218:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851897.102929:0:41218:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851897.102930:0:41218:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851897.102931:0:41218:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000040:28.0:1773851897.102933:0:41218:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:28.0:1773851897.102933:0:41218:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851897.102934:0:41218:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851897.102934:0:41218:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.102935:0:41218:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.102937:0:41218:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851897.102938:0:41218:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851897.102939:0:157090:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851897.102939:0:157090:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851897.102939:0:41218:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851897.102940:0:41218:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 6571515
00000100:00000001:30.0:1773851897.102941:0:157090:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851897.102941:0:41218:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:30.0:1773851897.102942:0:157090:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.102942:0:41218:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337959296 : -106936371592320 : ffff9ebdef8ec380)
00000100:00000040:28.0:1773851897.102943:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000da500fd4 x1858059204996416/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:28.0:1773851897.102947:0:41218:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851897.102947:0:41218:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851897.102948:0:41218:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000da500fd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52356:x1858059204996416:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:28.0:1773851897.102950:0:41218:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059204996416
00000020:00000001:28.0:1773851897.102951:0:41218:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851897.102951:0:41218:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851897.102952:0:41218:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851897.102953:0:41218:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851897.102953:0:41218:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:28.0:1773851897.102954:0:41218:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:28.0:1773851897.102955:0:41218:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851897.102955:0:41218:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851897.102956:0:41218:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851897.102957:0:41218:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.102958:0:41218:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851897.102958:0:41218:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851897.102959:0:41218:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000008cdcd57f.
02000000:00000001:28.0:1773851897.102960:0:41218:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.102960:0:41218:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851897.102963:0:41218:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:28.0:1773851897.102964:0:41218:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:28.0:1773851897.102965:0:41218:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:28.0:1773851897.102967:0:41218:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 386138112 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:28.0:1773851897.102969:0:41218:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129961 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:28.0:1773851897.102971:0:41218:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851897.102973:0:41218:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059204996416
00010000:00000001:28.0:1773851897.102974:0:41218:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851897.102976:0:41218:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000da500fd4 x1858059204996416/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:624/0 lens 224/368 e 0 to 0 dl 1773851984 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:28.0:1773851897.102981:0:41218:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851897.102982:0:41218:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851897.102983:0:41218:0:(import.c:1951:at_measured()) add 1 to 00000000f04ba3b2 time=151 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851897.102986:0:41218:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851897.102987:0:41218:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:28.0:1773851897.102988:0:41218:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:28.0:1773851897.102990:0:41218:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851897.102990:0:41218:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.102992:0:41218:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851897.102993:0:41218:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:28.0:1773851897.102994:0:41218:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f52a267c.
00000100:00000200:28.0:1773851897.102996:0:41218:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059204996416, offset 224
00000400:00000200:28.0:1773851897.102999:0:41218:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:28.0:1773851897.103001:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851897.103003:0:41218:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000400:00000200:28.0:1773851897.103005:0:41218:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851897.103007:0:41218:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:28.0:1773851897.103009:0:41218:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2074@kfi7 local destination
00000400:00000200:28.0:1773851897.103012:0:41218:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770250:8770250:1024:4294967295] 2074@kfi7 LPNI seq info [23425179:23425179:16:4294967295]
00000400:00000200:28.0:1773851897.103015:0:41218:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:28.0:1773851897.103017:0:41218:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:28.0:1773851897.103021:0:41218:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2074@kfi7(2074@kfi7:2074@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851897.103024:0:41218:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:28.0:1773851897.103027:0:41218:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851897.103029:0:41218:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:28.0:1773851897.103034:0:41218:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851897.103039:0:41218:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Using peer 2074@kfi7(0x20000000000097e)
00000800:00000200:28.0:1773851897.103045:0:41218:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 468 bytes to peer 0x20000000000097e: rc=0
00000800:00000200:28.0:1773851897.103047:0:41218:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851897.103053:0:41218:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851897.103055:0:41218:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:28.0:1773851897.103056:0:41218:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851897.103057:0:41218:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851897.103058:0:41218:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851897.103059:0:41218:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000da500fd4 x1858059204996416/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:624/0 lens 224/368 e 0 to 0 dl 1773851984 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:28.0:1773851897.103064:0:41218:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000da500fd4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out07_001:lustre5-MDT0003-mdtlov_UUID+5:52356:x1858059204996416:12345-2074@kfi7:41:default-yuba4-0 Request processed in 116us (151us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851897.103068:0:41218:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 6571515
00000100:00000040:28.0:1773851897.103070:0:41218:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:28.0:1773851897.103071:0:41218:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851897.103072:0:41218:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851897.103073:0:41218:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851897.103074:0:41218:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851897.103075:0:41218:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851897.103076:0:41218:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:28.0:1773851897.103077:0:41218:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:31.0:1773851897.103085:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e TN_EVENT_TX_OK event status 0
00000400:00000200:31.0:1773851897.103087:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851897.103089:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2074@kfi7: PUT: OK
00000400:00000200:31.0:1773851897.103090:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f52a267c
00000400:00000010:31.0:1773851897.103090:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f52a267c.
00000100:00000001:31.0:1773851897.103091:0:2465875:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851897.103091:0:2465875:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:31.0:1773851897.103093:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:31.0:1773851897.103094:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2074@kfi7(00000000aeaaabcd):0x0 lsk 2431 rsk 4796 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000097e Transaction freed
00000800:00000200:1.0:1773851897.114914:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851897.114915:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851897.114917:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851897.114920:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851897.114922:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.114924:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9635@kfi7 : PUT - for me
00000400:00000200:1.0:1773851897.114925:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.114926:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 1
00000400:00000200:1.0:1773851897.114927:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.114928:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000400:00000200:1.0:1773851897.114939:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 3
00000400:00000200:1.0:1773851897.114940:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9634@kfi7 to cpt 4
00000400:00000200:1.0:1773851897.114941:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9634@kfi7 of length 224 into portal 12 MB=0x69b16e344b300
00000400:00000200:1.0:1773851897.114943:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9634@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 53016
00000800:00000200:1.0:1773851897.114945:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851897.114947:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851897.114949:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9635@kfi7: PUT: OK
00000100:00000001:1.0:1773851897.114950:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851897.114951:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851897.114952:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000938d1699.
00000100:00000040:1.0:1773851897.114954:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000938d1699 x1859372464780032 msgsize 224
00000100:00100000:1.0:1773851897.114956:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9634@kfi7 (source: 12345-9635@kfi7)
00000100:00000001:1.0:1773851897.114958:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851897.114960:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000100:00000001:0.0:1773851897.114960:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851897.114961:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851897.114961:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851897.114962:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851897.114963:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851897.114963:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851897.114964:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372464780032
00000020:00000001:0.0:1773851897.114965:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851897.114965:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92cd9
00000020:00000001:0.0:1773851897.114966:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851897.114967:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055b589d0 refcount=6
00000020:00000001:0.0:1773851897.114968:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744181760 : -107128965369856 : ffff9e911812f000)
00000020:00000001:0.0:1773851897.114969:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744181760 : -107128965369856 : ffff9e911812f000)
00000100:00000001:0.0:1773851897.114971:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851897.114972:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851897.114973:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064d0890b.
00000020:00000010:0.0:1773851897.114974:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851897.114975:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851897.114976:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851897.114977:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851897.114978:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851897.114979:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851897.114979:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851897.114980:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.114981:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851897.114982:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851897.114983:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851897.114983:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851897.114983:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851897.114984:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9634@kfi7, seq: 1997626
00000100:00000001:2.0:1773851897.114985:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851897.114985:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055b589d0 : new rpc_count 1
00000100:00000001:2.0:1773851897.114986:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.114986:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052771584 : -106991656780032 : ffff9eb1104dbf00)
00000100:00000040:0.0:1773851897.114987:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000938d1699 x1859372464780032/t0(0) o400->b3c55872-df76-4f6b-afab-454c5fab4d74@9634@kfi7:537/0 lens 224/0 e 0 to 0 dl 1773852652 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1084-0'
00000100:00000001:0.0:1773851897.114990:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851897.114990:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851897.114991:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000938d1699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b3c55872-df76-4f6b-afab-454c5fab4d74+6:39308:x1859372464780032:12345-9634@kfi7:400:default-tuolumne1084-0
00000100:00000200:0.0:1773851897.114993:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372464780032
00000020:00000001:0.0:1773851897.114994:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851897.114994:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851897.114995:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.114996:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851897.114996:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851897.114997:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851897.114998:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372464780032, found 0 last_xid 1859372464780031
00000020:00000001:0.0:1773851897.114999:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851897.114999:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851897.115000:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851897.115000:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.115001:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851897.115002:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851897.115002:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851897.115003:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a0290aac.
02000000:00000001:0.0:1773851897.115004:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.115004:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.115006:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851897.115006:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475272959, transno 0, xid 1859372464780032
00010000:00000001:0.0:1773851897.115007:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851897.115008:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000938d1699 x1859372464780032/t0(0) o400->b3c55872-df76-4f6b-afab-454c5fab4d74@9634@kfi7:537/0 lens 224/224 e 0 to 0 dl 1773852652 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1084-0'
00010000:00000001:0.0:1773851897.115011:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851897.115011:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851897.115012:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=130 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851897.115013:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851897.115014:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e0f5d3c refcount 3 to 9634@kfi7
00000100:00000001:0.0:1773851897.115015:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960032 : -107156125591584 : ffff9e8ac532d7e0)
02000000:00000001:0.0:1773851897.115015:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851897.115016:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.115017:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851897.115018:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9635@kfi7
00000400:00000010:0.0:1773851897.115018:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073d1c143.
00000100:00000200:0.0:1773851897.115019:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372464780032, offset 224
00000400:00000200:0.0:1773851897.115020:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9635@kfi7
00000400:00000200:0.0:1773851897.115021:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:0.0:1773851897.115022:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 1
00000400:00000200:0.0:1773851897.115023:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000400:00000200:0.0:1773851897.115024:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 3
00000400:00000200:0.0:1773851897.115026:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9635@kfi7 local destination
00000400:00000200:0.0:1773851897.115027:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770251:8770251:1024:4294967295] 9635@kfi7 LPNI seq info [17495:17495:16:4294967295]
00000400:00000200:0.0:1773851897.115029:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000400:00000200:0.0:1773851897.115030:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9635@kfi7 to cpt 0
00000400:00000200:0.0:1773851897.115032:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9635@kfi7(9635@kfi7:9635@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851897.115033:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 3
00000800:00000200:0.0:1773851897.115035:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851897.115036:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851897.115038:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851897.115041:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd3d Using peer 9635@kfi7(0xd3d)
00000800:00000200:0.0:1773851897.115044:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0xd3d: rc=0
00000800:00000200:0.0:1773851897.115046:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd3d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851897.115048:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851897.115049:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e0f5d3c refcount 2 to 9634@kfi7
00010000:00000001:0.0:1773851897.115050:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851897.115050:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.115051:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851897.115052:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000938d1699 x1859372464780032/t0(0) o400->b3c55872-df76-4f6b-afab-454c5fab4d74@9634@kfi7:537/0 lens 224/224 e 0 to 0 dl 1773852652 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1084-0'
00000100:00100000:0.0:1773851897.115057:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000938d1699 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b3c55872-df76-4f6b-afab-454c5fab4d74+6:39308:x1859372464780032:12345-9634@kfi7:400:default-tuolumne1084-0 Request processed in 66us (102us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851897.115059:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9634@kfi7, seq: 1997626
00000100:00000040:0.0:1773851897.115060:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055b589d0 : new rpc_count 0
00000100:00000001:0.0:1773851897.115061:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851897.115061:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851897.115062:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851897.115063:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851897.115064:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064d0890b.
00000020:00000040:0.0:1773851897.115064:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000055b589d0 : new refcount 5
00000100:00000001:0.0:1773851897.115065:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851897.115071:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd3d TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851897.115073:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851897.115075:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9635@kfi7: PUT: OK
00000400:00000200:2.0:1773851897.115076:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073d1c143
00000400:00000010:2.0:1773851897.115076:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073d1c143.
00000100:00000001:2.0:1773851897.115077:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851897.115078:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851897.115079:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f58ab7c5 nid 9635@kfi7 refs 2
00000800:00000200:2.0:1773851897.115081:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 9635@kfi7(00000000bcf22827):0x0 lsk 3390 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0xd3d Transaction freed
00000004:00000001:7.0:1773851897.161732:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851897.161733:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851897.161734:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed033681.
00000020:00000040:7.0:1773851897.161734:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851897.161735:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851897.161736:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851897.161737:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851897.161737:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000e26c1bf7.
00000100:00000001:7.0:1773851897.161738:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.161739:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851897.161740:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851897.161741:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ed033681] to pc [ptlrpcd_01_01+1]  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851897.161745:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:7.0:1773851897.161747:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000002b986af1.
00000100:00000001:5.0:1773851897.161747:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851897.161747:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:7.0:1773851897.161748:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637104107767808 : -106969601783808 : ffff9eb632e24800)
00000100:00100000:5.0:1773851897.161748:0:41064:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00000001:5.0:1773851897.161748:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851897.161748:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:7.0:1773851897.161749:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:5.0:1773851897.161749:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:7.0:1773851897.161750:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:7.0:1773851897.161750:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000100:00000001:5.0:1773851897.161750:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000004:00000010:7.0:1773851897.161751:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008cbeca10.
00000100:00000001:5.0:1773851897.161751:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851897.161751:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00080000:7.0:1773851897.161752:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614171615027534ns, next at 614172615026573ns, rc = 0
00000100:00000001:5.0:1773851897.161752:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:7.0:1773851897.161753:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000040:5.0:1773851897.161753:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:7.0:1773851897.161754:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851897.161754:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851897.161755:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851897.161756:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851897.161756:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:5.0:1773851897.161757:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851897.161758:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051940352:2099@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851897.161759:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:5.0:1773851897.161760:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851897.161760:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851897.161761:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:5.0:1773851897.161762:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006d27463f.
02000000:00000001:5.0:1773851897.161762:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851897.161763:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000010:5.0:1773851897.161764:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045a04335.
00000400:00000010:5.0:1773851897.161765:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000200:5.0:1773851897.161767:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940352, portal 4
00000100:00000001:5.0:1773851897.161767:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851897.161768:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309139712 : -106994400411904 : ffff9eb06cc53f00)
00000100:00000040:5.0:1773851897.161769:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851897.161771:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851897.161772:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:5.0:1773851897.161773:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070e61bd6.
00000100:00000200:5.0:1773851897.161773:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940352, offset 0
00000400:00000200:5.0:1773851897.161775:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:5.0:1773851897.161776:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:5.0:1773851897.161777:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:5.0:1773851897.161778:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:5.0:1773851897.161779:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:5.0:1773851897.161782:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:5.0:1773851897.161784:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770251, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770250, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851897.161786:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:5.0:1773851897.161786:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:5.0:1773851897.161787:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:5.0:1773851897.161788:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770252:8770252:1024:4294967295] 2099@kfi7 LPNI seq info [5403437:5403437:16:4294967295]
00000400:00000200:5.0:1773851897.161790:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:5.0:1773851897.161790:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:5.0:1773851897.161793:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851897.161794:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:5.0:1773851897.161795:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851897.161797:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851897.161799:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851897.161801:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Using peer 2099@kfi7(0x2000000000002c4)
00000800:00000200:5.0:1773851897.161804:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x2000000000002c4: rc=0
00000800:00000200:5.0:1773851897.161805:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:5.0:1773851897.161807:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851897.161808:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851897.161808:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851897.161809:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851897.161810:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851897.161816:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851897.161818:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851897.161819:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000400:00000200:5.0:1773851897.161820:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070e61bd6
00000400:00000010:5.0:1773851897.161821:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070e61bd6.
00000100:00000001:5.0:1773851897.161822:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851897.161823:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851897.161825:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851897.161826:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851897.161828:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851897.161829:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851897.161830:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:5.0:1773851897.161831:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2054@kfi7:1 -> 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000002c4 Transaction freed
00000800:00000200:17.0:1773851897.161853:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851897.161854:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851897.161855:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851897.161856:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851897.161858:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.161859:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851897.161860:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.161860:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851897.161861:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.161862:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851897.161863:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851897.161863:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.161864:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6600
00000400:00000200:17.0:1773851897.161865:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.161867:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f2311 [1] + 224
00000800:00000200:17.0:1773851897.161868:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851897.161870:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851897.161870:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851897.161871:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851897.161873:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851897.161875:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851897.161879:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851897.161879:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000100:00000001:5.0:1773851897.161880:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:17.0:1773851897.161881:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2099@kfi7(0000000003f90409):0x0 lsk 709 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851897.161881:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:5.0:1773851897.161882:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851897.161882:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:5.0:1773851897.161883:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045a04335.
00000400:00000200:5.0:1773851897.161884:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:5.0:1773851897.161884:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00000001:5.0:1773851897.161885:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851897.161886:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851897.161888:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851897.161891:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851897.161891:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851897.161892:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851897.161892:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851897.161893:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851897.161893:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851897.161894:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851897.161895:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=130 v=66 (66 66 66 66)
00000100:00001000:5.0:1773851897.161896:0:41064:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=130 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851897.161897:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851897.161897:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851897.161899:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851897.161899:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851897.161900:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851897.161900:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:5.0:1773851897.161901:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851897.161901:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851897.161902:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851897.161905:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851897.161906:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851897.161906:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851897.161907:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851897.161908:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:5.0:1773851897.161908:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409081344 avail=351407014912 avail_mb=1372683652 hwm_mb=3131101 files=372011194 ffree=343172931 state=0: rc = 0
00000004:00000020:5.0:1773851897.161910:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409081344 free, 351407014912 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011194 files, 343172931 free files
00000004:00000001:5.0:1773851897.161912:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851897.161913:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:5.0:1773851897.161915:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ed033681 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051940352:2099@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851897.161917:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851897.161917:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851897.161918:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ed033681 x1859433051940352/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851897.161920:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851897.161921:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851897.161921:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006d27463f.
02000000:00000001:5.0:1773851897.161923:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851897.161923:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851897.161924:0:41064:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:5.0:1773851897.161924:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851897.161925:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000e26c1bf7.
02000000:00000001:5.0:1773851897.161926:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851897.161926:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851897.161927:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ed033681.
00000100:00000001:5.0:1773851897.161928:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851897.161928:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851897.161929:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851897.161929:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851897.161930:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851897.161930:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851897.161930:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851897.267849:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851897.267850:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851897.267852:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851897.267856:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851897.267859:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26416@kfi7 to cpt 6
00000400:00000200:25.0:1773851897.267861:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26416@kfi7 : PUT - for me
00000400:00000200:25.0:1773851897.267863:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26416@kfi7 to cpt 6
00000400:00000200:25.0:1773851897.267864:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a59ccb9 nid 26416@kfi7 refs 1
00000400:00000200:25.0:1773851897.267865:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26416@kfi7 to cpt 6
00000400:00000200:25.0:1773851897.267866:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a59ccb9 nid 26416@kfi7 refs 2
00000400:00000200:25.0:1773851897.267868:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005a59ccb9 nid 26416@kfi7 refs 3
00000400:00000200:25.0:1773851897.267870:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26416@kfi7 to cpt 6
00000400:00000200:25.0:1773851897.267872:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26416@kfi7 of length 224 into portal 12 MB=0x699e0f5e4dbc0
00000400:00000200:25.0:1773851897.267874:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26416@kfi7 of length 224/224 into md 0x16159c9699 [64] + 39104
00000800:00000200:25.0:1773851897.267877:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851897.267880:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851897.267881:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26416@kfi7: PUT: OK
00000100:00000001:25.0:1773851897.267883:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851897.267883:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851897.267885:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce1f43ac.
00000100:00000040:25.0:1773851897.267886:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ce1f43ac x1858041337404352 msgsize 224
00000100:00100000:25.0:1773851897.267888:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-26416@kfi7 (source: 12345-26416@kfi7)
00000100:00000001:25.0:1773851897.267890:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851897.267891:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a59ccb9 nid 26416@kfi7 refs 2
00000100:00000001:24.0:1773851897.267891:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851897.267891:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851897.267892:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851897.267892:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851897.267893:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851897.267893:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851897.267894:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041337404352
00000020:00000001:24.0:1773851897.267894:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851897.267895:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91fe3
00000020:00000001:24.0:1773851897.267896:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851897.267897:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d99573c8 refcount=6
00000020:00000001:24.0:1773851897.267897:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629254144 : -107123080297472 : ffff9e9276da0400)
00000020:00000001:24.0:1773851897.267898:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629254144 : -107123080297472 : ffff9e9276da0400)
00000100:00000001:24.0:1773851897.267899:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851897.267899:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851897.267900:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851897.267901:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851897.267902:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000098ea6441.
00000100:00000001:24.0:1773851897.267903:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851897.267903:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851897.267904:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851897.267905:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851897.267905:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851897.267905:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.267906:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851897.267908:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851897.267908:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851897.267909:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851897.267909:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851897.267909:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26416@kfi7, seq: 2025182
00000100:00000040:24.0:1773851897.267910:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d99573c8 : new rpc_count 1
00000100:00000001:27.0:1773851897.267911:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851897.267911:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.267911:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780436096 : -106994929115520 : ffff9eb04d41de80)
00000100:00000040:24.0:1773851897.267912:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ce1f43ac x1858041337404352/t0(0) o400->feffcd09-46e6-4e6b-9f66-88ca96e305cf@26416@kfi7:147/0 lens 224/0 e 0 to 0 dl 1773852262 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2141-0'
00000100:00000001:24.0:1773851897.267914:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851897.267915:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851897.267915:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce1f43ac pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:feffcd09-46e6-4e6b-9f66-88ca96e305cf+6:39827:x1858041337404352:12345-26416@kfi7:400:default-tuolumne2141-0
00000100:00000200:24.0:1773851897.267916:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041337404352
00000020:00000001:24.0:1773851897.267917:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851897.267918:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851897.267918:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.267919:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851897.267919:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851897.267920:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851897.267921:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041337404352, found 0 last_xid 1858041337404351
00000020:00000001:24.0:1773851897.267921:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851897.267922:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851897.267922:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851897.267923:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.267924:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851897.267924:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851897.267925:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851897.267926:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008b4ce5bd.
02000000:00000001:24.0:1773851897.267926:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.267927:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.267927:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851897.267928:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182404294243, transno 0, xid 1858041337404352
00010000:00000001:24.0:1773851897.267929:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851897.267929:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ce1f43ac x1858041337404352/t0(0) o400->feffcd09-46e6-4e6b-9f66-88ca96e305cf@26416@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2141-0'
00010000:00000001:24.0:1773851897.267934:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851897.267935:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851897.267936:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=130 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851897.267937:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851897.267937:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003832fbcf refcount 3 to 26416@kfi7
00000100:00000001:24.0:1773851897.267938:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739296 : -107139395812320 : ffff9e8eaa5f0420)
02000000:00000001:24.0:1773851897.267939:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851897.267940:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.267941:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851897.267941:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26416@kfi7
00000400:00000010:24.0:1773851897.267942:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b785b029.
00000100:00000200:24.0:1773851897.267943:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041337404352, offset 224
00000400:00000200:24.0:1773851897.267944:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26416@kfi7
00000400:00000200:24.0:1773851897.267945:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26416@kfi7 to cpt 6
00000400:00000200:24.0:1773851897.267946:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a59ccb9 nid 26416@kfi7 refs 1
00000400:00000200:24.0:1773851897.267947:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005a59ccb9 nid 26416@kfi7 refs 2
00000400:00000200:24.0:1773851897.267948:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005a59ccb9 nid 26416@kfi7 refs 3
00000400:00000200:24.0:1773851897.267949:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26416@kfi7 local destination
00000400:00000200:24.0:1773851897.267950:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770253:8770253:1024:4294967295] 26416@kfi7 LPNI seq info [33139:33139:16:4294967295]
00000400:00000200:24.0:1773851897.267952:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a59ccb9 nid 26416@kfi7 refs 2
00000400:00000200:24.0:1773851897.267952:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26416@kfi7 to cpt 6
00000400:00000200:24.0:1773851897.267954:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26416@kfi7(26416@kfi7:26416@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851897.267955:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005a59ccb9 nid 26416@kfi7 refs 3
00000800:00000200:24.0:1773851897.267957:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851897.267958:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851897.267960:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851897.267962:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c4 Using peer 26416@kfi7(0x1000000000007c4)
00000800:00000200:24.0:1773851897.267967:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000358ab717: Posted send of 324 bytes to peer 0x1000000000007c4: rc=0
00000800:00000200:24.0:1773851897.267968:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851897.267970:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851897.267971:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003832fbcf refcount 2 to 26416@kfi7
00010000:00000001:24.0:1773851897.267972:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851897.267972:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.267973:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851897.267974:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce1f43ac x1858041337404352/t0(0) o400->feffcd09-46e6-4e6b-9f66-88ca96e305cf@26416@kfi7:147/0 lens 224/224 e 0 to 0 dl 1773852262 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2141-0'
00000100:00100000:24.0:1773851897.267978:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce1f43ac pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:feffcd09-46e6-4e6b-9f66-88ca96e305cf+6:39827:x1858041337404352:12345-26416@kfi7:400:default-tuolumne2141-0 Request processed in 63us (91us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851897.267980:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26416@kfi7, seq: 2025182
00000100:00000040:24.0:1773851897.267981:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d99573c8 : new rpc_count 0
00000100:00000001:24.0:1773851897.267981:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851897.267982:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851897.267982:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851897.267983:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000098ea6441.
00000020:00000010:24.0:1773851897.267984:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851897.267984:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000d99573c8 : new refcount 5
00000100:00000001:24.0:1773851897.267985:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851897.267991:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c4 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851897.267994:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851897.267996:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26416@kfi7: PUT: OK
00000400:00000200:25.0:1773851897.267997:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b785b029
00000400:00000010:25.0:1773851897.267998:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b785b029.
00000100:00000001:25.0:1773851897.267999:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851897.267999:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851897.268001:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a59ccb9 nid 26416@kfi7 refs 2
00000800:00000200:25.0:1773851897.268003:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 26416@kfi7(000000006f64b28b):0x0 lsk 1989 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000007c4 Transaction freed
00000800:00000200:5.0:1773851897.268053:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851897.268054:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851897.268055:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851897.268058:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851897.268060:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.268061:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20160@kfi7 : PUT - for me
00000400:00000200:5.0:1773851897.268062:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.268063:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 1
00000400:00000200:5.0:1773851897.268064:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.268065:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000400:00000200:5.0:1773851897.268065:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 3
00000400:00000200:5.0:1773851897.268066:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20161@kfi7 to cpt 4
00000400:00000200:5.0:1773851897.268067:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20161@kfi7 of length 224 into portal 12 MB=0x69b81c0327300
00000400:00000200:5.0:1773851897.268069:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20161@kfi7 of length 224/224 into md 0x793926dc5 [64] + 165328
00000800:00000200:5.0:1773851897.268070:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851897.268072:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851897.268073:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20160@kfi7: PUT: OK
00000100:00000001:5.0:1773851897.268074:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851897.268075:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851897.268076:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f4c5afb5.
00000100:00000040:5.0:1773851897.268077:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000f4c5afb5 x1859831437882112 msgsize 224
00000100:00100000:5.0:1773851897.268079:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-20161@kfi7 (source: 12345-20160@kfi7)
00000100:00000001:5.0:1773851897.268080:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851897.268081:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000800:00000200:5.0:1773851897.268082:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851897.268083:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851897.268084:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851897.268084:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851897.268085:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851897.268087:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851897.268088:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831437882112
00000020:00000001:4.0:1773851897.268089:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851897.268090:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce43c84
00000020:00000001:4.0:1773851897.268091:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851897.268093:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a11167e7 refcount=5
00000020:00000001:4.0:1773851897.268095:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637141258093568 : -106932451458048 : ffff9ebed9374400)
00000020:00000001:4.0:1773851897.268096:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637141258093568 : -106932451458048 : ffff9ebed9374400)
00000100:00000001:4.0:1773851897.268097:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851897.268099:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851897.268100:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851897.268101:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851897.268103:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000999666b4.
00000100:00000001:4.0:1773851897.268104:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851897.268105:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851897.268106:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851897.268108:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851897.268109:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851897.268110:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851897.268111:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851897.268113:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851897.268113:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851897.268113:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851897.268114:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851897.268115:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20161@kfi7, seq: 2001995
00000100:00000040:7.0:1773851897.268115:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a11167e7 : new rpc_count 1
00000100:00000001:7.0:1773851897.268116:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114931858560 : -106958777693056 : ffff9eb8b80ccc80)
00000100:00000001:4.0:1773851897.268116:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851897.268117:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f4c5afb5 x1859831437882112/t0(0) o400->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1747-0'
00000100:00000001:4.0:1773851897.268117:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.268119:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851897.268120:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851897.268121:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c5afb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7+5:39635:x1859831437882112:12345-20161@kfi7:400:default-tuolumne1747-0
00000100:00000200:7.0:1773851897.268122:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831437882112
00000020:00000001:7.0:1773851897.268123:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851897.268123:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851897.268124:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.268124:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851897.268125:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851897.268125:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851897.268126:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831437882112, found 0 last_xid 1859831437882111
00000020:00000001:7.0:1773851897.268127:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851897.268127:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851897.268128:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851897.268129:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.268129:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851897.268130:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851897.268130:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851897.268131:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000baa61ed4.
02000000:00000001:7.0:1773851897.268132:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.268132:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.268133:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851897.268133:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691390, transno 0, xid 1859831437882112
00010000:00000001:7.0:1773851897.268134:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851897.268135:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f4c5afb5 x1859831437882112/t0(0) o400->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1747-0'
00010000:00000001:7.0:1773851897.268137:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851897.268138:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851897.268138:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=129 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851897.268139:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851897.268140:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f7aa4622 refcount 3 to 20161@kfi7
00000100:00000001:7.0:1773851897.268140:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583515840 : -107156126035776 : ffff9e8ac52c10c0)
02000000:00000001:7.0:1773851897.268141:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851897.268141:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.268142:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851897.268143:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20160@kfi7
00000400:00000010:7.0:1773851897.268144:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064534590.
00000100:00000200:7.0:1773851897.268144:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859831437882112, offset 224
00000400:00000200:7.0:1773851897.268146:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20160@kfi7
00000400:00000200:7.0:1773851897.268147:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:7.0:1773851897.268147:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 1
00000400:00000200:7.0:1773851897.268148:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000400:00000200:7.0:1773851897.268149:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 3
00000400:00000200:7.0:1773851897.268150:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20160@kfi7 local destination
00000400:00000200:7.0:1773851897.268151:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770254:8770254:1024:4294967295] 20160@kfi7 LPNI seq info [7476287:7476287:16:4294967295]
00000400:00000200:7.0:1773851897.268153:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000400:00000200:7.0:1773851897.268153:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20160@kfi7 to cpt 1
00000400:00000200:7.0:1773851897.268155:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20160@kfi7(20160@kfi7:20160@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851897.268156:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 3
00000800:00000200:7.0:1773851897.268158:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851897.268159:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851897.268161:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851897.268163:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x23b Using peer 20160@kfi7(0x23b)
00000800:00000200:7.0:1773851897.268165:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x23b: rc=0
00000800:00000200:7.0:1773851897.268167:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x23b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851897.268169:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851897.268169:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f7aa4622 refcount 2 to 20161@kfi7
00010000:00000001:7.0:1773851897.268170:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851897.268170:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.268171:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851897.268172:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f4c5afb5 x1859831437882112/t0(0) o400->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1747-0'
00000100:00100000:7.0:1773851897.268175:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c5afb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7+5:39635:x1859831437882112:12345-20161@kfi7:400:default-tuolumne1747-0 Request processed in 54us (96us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851897.268177:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20161@kfi7, seq: 2001995
00000100:00000040:7.0:1773851897.268177:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a11167e7 : new rpc_count 0
00000100:00000001:7.0:1773851897.268178:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851897.268178:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851897.268179:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:7.0:1773851897.268180:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000999666b4.
00000020:00000010:7.0:1773851897.268180:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000800:00000200:5.0:1773851897.268180:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x23b TN_EVENT_TX_OK event status 0
00000020:00000040:7.0:1773851897.268181:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000a11167e7 : new refcount 4
00000400:00000200:5.0:1773851897.268181:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851897.268182:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851897.268182:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20160@kfi7: PUT: OK
00000400:00000200:5.0:1773851897.268183:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064534590
00000400:00000010:5.0:1773851897.268183:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064534590.
00000100:00000001:5.0:1773851897.268184:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851897.268185:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851897.268186:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000007b47e1a nid 20160@kfi7 refs 2
00000800:00000200:5.0:1773851897.268187:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 20160@kfi7(000000000c0ba8dc):0x0 lsk 572 rsk 19 tsk 0 trmk 0 tmk 0 trr 1 tta 0x23b Transaction freed
00000800:00000200:5.0:1773851897.301179:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851897.301180:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851897.301182:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851897.301185:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851897.301188:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.301190:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851897.301192:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.301193:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851897.301195:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.301196:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851897.301197:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851897.301199:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851897.301200:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a87a1d500
00000400:00000200:5.0:1773851897.301202:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 8736
00000800:00000200:5.0:1773851897.301206:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851897.301208:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851897.301210:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851897.301211:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851897.301212:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851897.301214:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001b420872.
00000100:00000040:5.0:1773851897.301215:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000001b420872 x1859388107248896 msgsize 224
00000100:00100000:5.0:1773851897.301217:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851897.301219:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851897.301220:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000100:00000001:6.0:1773851897.301222:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851897.301222:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:6.0:1773851897.301223:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851897.301224:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851897.301225:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851897.301228:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851897.301229:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107248896
00000020:00000001:6.0:1773851897.301230:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851897.301231:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:6.0:1773851897.301232:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851897.301234:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:6.0:1773851897.301235:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:6.0:1773851897.301237:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:6.0:1773851897.301238:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851897.301239:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851897.301241:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000046c5b0cb.
00000020:00000010:6.0:1773851897.301242:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851897.301244:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851897.301246:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851897.301247:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851897.301248:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851897.301249:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851897.301251:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851897.301252:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851897.301255:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851897.301256:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851897.301256:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:6.0:1773851897.301257:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314089
00000100:00000001:5.0:1773851897.301257:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:6.0:1773851897.301259:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:5.0:1773851897.301259:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851897.301260:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637114931868928 : -106958777682688 : ffff9eb8b80cf500)
00000100:00000001:5.0:1773851897.301260:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851897.301262:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001b420872 x1859388107248896/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:6.0:1773851897.301267:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851897.301268:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851897.301270:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b420872 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40156:x1859388107248896:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:6.0:1773851897.301273:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107248896
00000020:00000001:6.0:1773851897.301274:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851897.301275:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851897.301276:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851897.301277:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851897.301278:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851897.301280:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851897.301281:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851897.301282:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851897.301283:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851897.301284:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851897.301285:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851897.301286:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851897.301288:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000013eb77b4.
02000000:00000001:6.0:1773851897.301289:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851897.301290:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851897.301292:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851897.301293:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851897.301294:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851897.301296:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 386138112 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851897.301297:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129961 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851897.301300:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851897.301301:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107248896
00010000:00000001:6.0:1773851897.301303:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851897.301304:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001b420872 x1859388107248896/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:624/0 lens 224/368 e 0 to 0 dl 1773851984 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:6.0:1773851897.301309:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851897.301310:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851897.301312:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=126 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851897.301314:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851897.301315:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:6.0:1773851897.301317:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:6.0:1773851897.301318:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851897.301319:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851897.301320:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851897.301322:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:6.0:1773851897.301323:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f75391c.
00000100:00000200:6.0:1773851897.301324:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107248896, offset 224
00000400:00000200:6.0:1773851897.301328:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:6.0:1773851897.301330:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851897.301331:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:6.0:1773851897.301333:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851897.301335:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:6.0:1773851897.301338:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:6.0:1773851897.301340:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770255:8770255:1024:4294967295] 43@kfi7 LPNI seq info [37492108:37492108:16:4294967295]
00000400:00000200:6.0:1773851897.301343:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851897.301344:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851897.301348:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851897.301350:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:6.0:1773851897.301353:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851897.301355:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851897.301359:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851897.301363:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Using peer 43@kfi7(0xa02)
00000800:00000200:6.0:1773851897.301368:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e07369fe: Posted send of 468 bytes to peer 0xa02: rc=0
00000800:00000200:6.0:1773851897.301371:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851897.301375:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851897.301376:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:6.0:1773851897.301377:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851897.301378:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851897.301379:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851897.301381:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001b420872 x1859388107248896/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:624/0 lens 224/368 e 0 to 0 dl 1773851984 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000800:00000200:5.0:1773851897.301383:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851897.301384:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:6.0:1773851897.301385:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b420872 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40156:x1859388107248896:12345-61@kfi7:41:default-yuba1-0 Request processed in 117us (170us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851897.301386:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000400:00000200:5.0:1773851897.301386:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f75391c
00000400:00000010:5.0:1773851897.301387:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f75391c.
00000100:00000001:5.0:1773851897.301387:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851897.301388:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851897.301389:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851897.301390:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e07369fe: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Transaction freed
00000100:00100000:6.0:1773851897.301391:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314089
00000100:00000040:6.0:1773851897.301391:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:6.0:1773851897.301392:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851897.301393:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851897.301393:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:6.0:1773851897.301394:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000020:00000010:6.0:1773851897.301395:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000046c5b0cb.
00000020:00000040:6.0:1773851897.301396:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000100:00000001:6.0:1773851897.301397:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851897.463583:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851897.463585:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851897.463587:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851897.463591:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851897.463595:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851897.463597:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:22.0:1773851897.463599:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851897.463601:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:22.0:1773851897.463602:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851897.463604:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:22.0:1773851897.463605:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:22.0:1773851897.463607:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:22.0:1773851897.463609:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 224 into portal 12 MB=0x699e0dd1d74c0
00000400:00000200:22.0:1773851897.463612:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2068@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 65616
00000800:00000200:22.0:1773851897.463616:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851897.463619:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851897.463622:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:22.0:1773851897.463623:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851897.463624:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851897.463626:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004e0b4903.
00000100:00000040:22.0:1773851897.463627:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000004e0b4903 x1858040921683136 msgsize 224
00000100:00100000:22.0:1773851897.463630:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-2068@kfi7 (source: 12345-2068@kfi7)
00000100:00000001:22.0:1773851897.463633:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851897.463635:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:23.0:1773851897.463636:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851897.463637:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851897.463638:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:22.0:1773851897.463638:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851897.463639:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851897.463640:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851897.463642:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040921683136
00000020:00000001:23.0:1773851897.463643:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851897.463644:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acb24af
00000020:00000001:23.0:1773851897.463645:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851897.463649:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d5f9fd05 refcount=5
00000020:00000001:23.0:1773851897.463651:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636930112823296 : -107143596728320 : ffff9e8daffa2000)
00000020:00000001:23.0:1773851897.463652:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636930112823296 : -107143596728320 : ffff9e8daffa2000)
00000100:00000001:23.0:1773851897.463654:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851897.463655:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851897.463656:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ea5ccc04.
00000020:00000010:23.0:1773851897.463658:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851897.463660:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851897.463661:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851897.463662:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851897.463663:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851897.463665:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851897.463666:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851897.463667:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851897.463668:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851897.463671:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851897.463671:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851897.463672:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851897.463672:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851897.463673:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2068@kfi7, seq: 1998076
00000100:00000001:23.0:1773851897.463675:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851897.463675:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d5f9fd05 : new rpc_count 1
00000100:00000001:23.0:1773851897.463676:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851897.463676:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382186624 : -106946327364992 : ffff9ebb9e25ba80)
00000100:00000040:20.0:1773851897.463678:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004e0b4903 x1858040921683136/t0(0) o400->lustre5-MDT0001-lwp-OST0004_UUID@2068@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba105-0'
00000100:00000001:20.0:1773851897.463683:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851897.463683:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851897.463685:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e0b4903 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0004_UUID+5:272603:x1858040921683136:12345-2068@kfi7:400:default-yuba105-0
00000100:00000200:20.0:1773851897.463689:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040921683136
00000020:00000001:20.0:1773851897.463690:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851897.463691:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851897.463692:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851897.463693:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851897.463693:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851897.463694:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851897.463695:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851897.463696:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851897.463697:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851897.463698:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851897.463698:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851897.463699:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851897.463700:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851897.463701:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000010bfdc01.
02000000:00000001:20.0:1773851897.463702:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851897.463702:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851897.463703:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851897.463704:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858040921683136
00010000:00000001:20.0:1773851897.463705:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851897.463706:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004e0b4903 x1858040921683136/t0(0) o400->lustre5-MDT0001-lwp-OST0004_UUID@2068@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba105-0'
00010000:00000001:20.0:1773851897.463709:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851897.463710:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851897.463710:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=130 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851897.463712:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851897.463712:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f96f322e refcount 7 to 2068@kfi7
00000100:00000001:20.0:1773851897.463713:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096128 : -107139307455488 : ffff9e8eafa33c00)
02000000:00000001:20.0:1773851897.463714:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851897.463715:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851897.463715:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851897.463716:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:20.0:1773851897.463717:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000408d3b17.
00000100:00000200:20.0:1773851897.463717:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040921683136, offset 224
00000400:00000200:20.0:1773851897.463719:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:20.0:1773851897.463720:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:20.0:1773851897.463720:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:20.0:1773851897.463722:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:20.0:1773851897.463723:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:20.0:1773851897.463724:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2068@kfi7 local destination
00000400:00000200:20.0:1773851897.463729:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770256:8770256:1024:4294967295] 2068@kfi7 LPNI seq info [5403704:5403704:16:4294967295]
00000400:00000200:20.0:1773851897.463730:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:20.0:1773851897.463731:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:20.0:1773851897.463733:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851897.463734:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000800:00000200:20.0:1773851897.463735:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851897.463736:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851897.463739:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851897.463741:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000800:00000200:20.0:1773851897.463743:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000800:00000200:20.0:1773851897.463745:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851897.463747:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851897.463748:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f96f322e refcount 6 to 2068@kfi7
00010000:00000001:20.0:1773851897.463748:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851897.463749:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851897.463750:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851897.463750:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004e0b4903 x1858040921683136/t0(0) o400->lustre5-MDT0001-lwp-OST0004_UUID@2068@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba105-0'
00000100:00100000:20.0:1773851897.463754:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e0b4903 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0004_UUID+5:272603:x1858040921683136:12345-2068@kfi7:400:default-yuba105-0 Request processed in 70us (125us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851897.463758:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2068@kfi7, seq: 1998076
00000100:00000040:20.0:1773851897.463759:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d5f9fd05 : new rpc_count 0
00000100:00000001:20.0:1773851897.463760:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851897.463760:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851897.463761:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:20.0:1773851897.463762:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:20.0:1773851897.463763:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ea5ccc04.
00000020:00000040:20.0:1773851897.463763:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000d5f9fd05 : new refcount 4
00000100:00000001:20.0:1773851897.463764:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851897.463770:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851897.463771:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851897.463773:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000400:00000200:21.0:1773851897.463773:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000408d3b17
00000400:00000010:21.0:1773851897.463774:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000408d3b17.
00000100:00000001:21.0:1773851897.463775:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851897.463775:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851897.463776:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:21.0:1773851897.463778:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2054@kfi7:5 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000177 Transaction freed
00000800:00000200:10.0:1773851897.524522:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851897.524523:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851897.524524:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851897.524526:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851897.524528:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10081@kfi7 to cpt 2
00000400:00000200:10.0:1773851897.524529:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10081@kfi7 : PUT - for me
00000400:00000200:10.0:1773851897.524530:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10081@kfi7 to cpt 2
00000400:00000200:10.0:1773851897.524531:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000357ebb67 nid 10081@kfi7 refs 1
00000400:00000200:10.0:1773851897.524532:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10081@kfi7 to cpt 2
00000400:00000200:10.0:1773851897.524533:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000357ebb67 nid 10081@kfi7 refs 2
00000400:00000200:10.0:1773851897.524534:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000357ebb67 nid 10081@kfi7 refs 3
00000400:00000200:10.0:1773851897.524535:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10145@kfi7 to cpt 6
00000400:00000200:10.0:1773851897.524536:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10145@kfi7 of length 224 into portal 12 MB=0x699e71c063540
00000400:00000200:10.0:1773851897.524537:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10145@kfi7 of length 224/224 into md 0x78146ce49 [64] + 162392
00000800:00000200:10.0:1773851897.524539:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851897.524541:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851897.524542:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10081@kfi7: PUT: OK
00000100:00000001:10.0:1773851897.524543:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851897.524543:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851897.524545:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008c711d61.
00000100:00000040:10.0:1773851897.524545:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000008c711d61 x1858067746927936 msgsize 224
00000100:00100000:10.0:1773851897.524547:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-10145@kfi7 (source: 12345-10081@kfi7)
00000100:00000001:10.0:1773851897.524548:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851897.524549:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000357ebb67 nid 10081@kfi7 refs 2
00000800:00000200:10.0:1773851897.524551:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000348da31e: 2069@kfi7:2 <- 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851897.524552:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851897.524554:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851897.524555:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851897.524556:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851897.524558:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851897.524560:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858067746927936
00000020:00000001:11.0:1773851897.524561:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851897.524562:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91586
00000020:00000001:11.0:1773851897.524563:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851897.524567:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000084d57003 refcount=6
00000020:00000001:11.0:1773851897.524569:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241010176 : -107152468541440 : ffff9e8b9f2d0000)
00000020:00000001:11.0:1773851897.524570:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241010176 : -107152468541440 : ffff9e8b9f2d0000)
00000100:00000001:11.0:1773851897.524573:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851897.524574:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851897.524576:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000089741d53.
00000020:00000010:11.0:1773851897.524578:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000028079cd4.
00000020:00000010:11.0:1773851897.524579:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000005ca9a29c.
00000100:00000001:11.0:1773851897.524581:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851897.524582:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851897.524583:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851897.524585:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851897.524586:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851897.524587:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.524589:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851897.524591:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851897.524591:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851897.524592:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851897.524593:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851897.524593:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10145@kfi7, seq: 2130872
00000100:00000040:8.0:1773851897.524593:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000084d57003 : new rpc_count 1
00000100:00000001:11.0:1773851897.524594:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.524594:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087766784 : -106944621784832 : ffff9ebc03ced100)
00000100:00000001:11.0:1773851897.524595:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851897.524595:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008c711d61 x1858067746927936/t0(0) o400->cf9ae637-0fcb-43fe-8c1f-124fb4279909@10145@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1120-0'
00000100:00000001:8.0:1773851897.524598:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851897.524598:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851897.524600:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008c711d61 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:cf9ae637-0fcb-43fe-8c1f-124fb4279909+6:39665:x1858067746927936:12345-10145@kfi7:400:default-tuolumne1120-0
00000100:00000200:8.0:1773851897.524601:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858067746927936
00000020:00000001:8.0:1773851897.524602:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851897.524602:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851897.524603:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.524604:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851897.524605:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851897.524605:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851897.524606:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858067746927936, found 0 last_xid 1858067746927935
00000020:00000001:8.0:1773851897.524607:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851897.524607:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851897.524608:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851897.524609:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.524613:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851897.524614:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851897.524614:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851897.524615:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eb2d3ab9.
02000000:00000001:8.0:1773851897.524616:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.524616:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.524617:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851897.524618:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183097237967, transno 0, xid 1858067746927936
00010000:00000001:8.0:1773851897.524619:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851897.524620:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008c711d61 x1858067746927936/t0(0) o400->cf9ae637-0fcb-43fe-8c1f-124fb4279909@10145@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1120-0'
00010000:00000001:8.0:1773851897.524622:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851897.524622:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851897.524623:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=130 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851897.524625:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851897.524625:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004d9349ee refcount 3 to 10145@kfi7
00000100:00000001:8.0:1773851897.524626:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092335776 : -107152617215840 : ffff9e8b965068a0)
02000000:00000001:8.0:1773851897.524627:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851897.524627:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.524628:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851897.524629:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10081@kfi7
00000400:00000010:8.0:1773851897.524630:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3e9aeb1.
00000100:00000200:8.0:1773851897.524631:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858067746927936, offset 224
00000400:00000200:8.0:1773851897.524632:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10081@kfi7
00000400:00000200:8.0:1773851897.524633:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10081@kfi7 to cpt 2
00000400:00000200:8.0:1773851897.524634:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000357ebb67 nid 10081@kfi7 refs 1
00000400:00000200:8.0:1773851897.524635:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000357ebb67 nid 10081@kfi7 refs 2
00000400:00000200:8.0:1773851897.524636:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000357ebb67 nid 10081@kfi7 refs 3
00000400:00000200:8.0:1773851897.524637:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10081@kfi7 local destination
00000400:00000200:8.0:1773851897.524638:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770257:8770257:1024:4294967295] 10081@kfi7 LPNI seq info [79744755:79744755:16:4294967295]
00000400:00000200:8.0:1773851897.524640:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000357ebb67 nid 10081@kfi7 refs 2
00000400:00000200:8.0:1773851897.524640:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10081@kfi7 to cpt 2
00000400:00000200:8.0:1773851897.524642:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10081@kfi7(10081@kfi7:10081@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851897.524644:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000357ebb67 nid 10081@kfi7 refs 3
00000800:00000200:8.0:1773851897.524645:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851897.524646:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851897.524649:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851897.524651:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf1a Using peer 10081@kfi7(0xf1a)
00000800:00000200:8.0:1773851897.524654:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0xf1a: rc=0
00000800:00000200:8.0:1773851897.524655:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf1a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851897.524657:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851897.524658:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004d9349ee refcount 2 to 10145@kfi7
00010000:00000001:8.0:1773851897.524659:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851897.524660:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.524660:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851897.524661:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008c711d61 x1858067746927936/t0(0) o400->cf9ae637-0fcb-43fe-8c1f-124fb4279909@10145@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1120-0'
00000100:00100000:8.0:1773851897.524666:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008c711d61 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:cf9ae637-0fcb-43fe-8c1f-124fb4279909+6:39665:x1858067746927936:12345-10145@kfi7:400:default-tuolumne1120-0 Request processed in 67us (119us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851897.524668:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10145@kfi7, seq: 2130872
00000100:00000040:8.0:1773851897.524669:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000084d57003 : new rpc_count 0
00000100:00000001:8.0:1773851897.524669:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851897.524670:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851897.524671:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000028079cd4.
00000020:00000010:8.0:1773851897.524671:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000005ca9a29c.
00000020:00000010:8.0:1773851897.524672:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000089741d53.
00000020:00000040:8.0:1773851897.524673:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000084d57003 : new refcount 5
00000100:00000001:8.0:1773851897.524674:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851897.524679:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf1a TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851897.524681:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851897.524682:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10081@kfi7: PUT: OK
00000400:00000200:9.0:1773851897.524683:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3e9aeb1
00000400:00000010:9.0:1773851897.524684:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3e9aeb1.
00000100:00000001:9.0:1773851897.524685:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851897.524685:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851897.524686:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000357ebb67 nid 10081@kfi7 refs 2
00000800:00000200:9.0:1773851897.524688:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 10081@kfi7(0000000045589a26):0x0 lsk 3867 rsk 56 tsk 0 trmk 0 tmk 0 trr 2 tta 0xf1a Transaction freed
00000800:00000200:5.0:1773851897.660567:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851897.660568:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851897.660569:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851897.660571:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851897.660573:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.660575:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12243@kfi7 : PUT - for me
00000400:00000200:5.0:1773851897.660575:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.660576:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 1
00000400:00000200:5.0:1773851897.660577:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.660578:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000400:00000200:5.0:1773851897.660579:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 3
00000400:00000200:5.0:1773851897.660580:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12050@kfi7 to cpt 3
00000400:00000200:5.0:1773851897.660580:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12050@kfi7 of length 224 into portal 12 MB=0x69b4b56969b80
00000400:00000200:5.0:1773851897.660582:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12050@kfi7 of length 224/224 into md 0x793926dc5 [64] + 165552
00000800:00000200:5.0:1773851897.660583:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851897.660585:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851897.660586:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12243@kfi7: PUT: OK
00000100:00000001:5.0:1773851897.660587:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851897.660587:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851897.660589:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bda68ad4.
00000100:00000040:5.0:1773851897.660590:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000bda68ad4 x1859597737827200 msgsize 224
00000100:00100000:5.0:1773851897.660591:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12050@kfi7 (source: 12345-12243@kfi7)
00000100:00000001:5.0:1773851897.660592:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851897.660593:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000100:00000001:7.0:1773851897.660594:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851897.660594:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851897.660594:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851897.660595:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851897.660595:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851897.660596:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851897.660597:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597737827200
00000020:00000001:7.0:1773851897.660597:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851897.660598:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d811dd
00000020:00000001:7.0:1773851897.660598:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851897.660599:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000097261f1b refcount=5
00000020:00000001:7.0:1773851897.660600:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637097955865600 : -106975753686016 : ffff9eb4c433b400)
00000020:00000001:7.0:1773851897.660601:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637097955865600 : -106975753686016 : ffff9eb4c433b400)
00000100:00000001:7.0:1773851897.660602:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851897.660602:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851897.660604:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000050d3f139.
00000020:00000010:7.0:1773851897.660605:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851897.660605:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851897.660606:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851897.660606:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851897.660607:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851897.660608:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851897.660608:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851897.660608:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.660609:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851897.660611:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851897.660611:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851897.660612:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12050@kfi7, seq: 2001996
00000100:00000040:7.0:1773851897.660612:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000097261f1b : new rpc_count 1
00000100:00000001:4.0:1773851897.660612:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851897.660613:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636964924647296 : -107108784904320 : ffff9e95caec6780)
00000100:00000001:4.0:1773851897.660613:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851897.660613:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851897.660614:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bda68ad4 x1859597737827200/t0(0) o400->7968d425-dd8b-4e78-b9a0-41d777685fed@12050@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1253-0'
00000100:00000001:4.0:1773851897.660615:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.660616:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851897.660617:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851897.660618:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bda68ad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:7968d425-dd8b-4e78-b9a0-41d777685fed+5:39701:x1859597737827200:12345-12050@kfi7:400:default-tuolumne1253-0
00000100:00000200:7.0:1773851897.660620:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597737827200
00000020:00000001:7.0:1773851897.660621:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851897.660621:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851897.660622:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.660622:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851897.660623:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851897.660624:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851897.660624:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597737827200, found 0 last_xid 1859597737827199
00000020:00000001:7.0:1773851897.660625:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851897.660626:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851897.660626:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851897.660627:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.660627:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851897.660628:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851897.660628:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851897.660629:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000038c9351d.
02000000:00000001:7.0:1773851897.660630:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.660630:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.660631:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851897.660631:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694836, transno 0, xid 1859597737827200
00010000:00000001:7.0:1773851897.660632:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851897.660633:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bda68ad4 x1859597737827200/t0(0) o400->7968d425-dd8b-4e78-b9a0-41d777685fed@12050@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1253-0'
00010000:00000001:7.0:1773851897.660635:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851897.660636:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851897.660636:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=129 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851897.660637:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851897.660638:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000905bc2d2 refcount 3 to 12050@kfi7
00000100:00000001:7.0:1773851897.660638:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487621600 : -107151221930016 : ffff9e8be97ac7e0)
02000000:00000001:7.0:1773851897.660639:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851897.660640:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851897.660640:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851897.660641:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12243@kfi7
00000400:00000010:7.0:1773851897.660642:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000aef8b1b2.
00000100:00000200:7.0:1773851897.660645:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597737827200, offset 224
00000400:00000200:7.0:1773851897.660646:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12243@kfi7
00000400:00000200:7.0:1773851897.660647:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:7.0:1773851897.660647:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 1
00000400:00000200:7.0:1773851897.660648:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000400:00000200:7.0:1773851897.660649:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 3
00000400:00000200:7.0:1773851897.660650:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12243@kfi7 local destination
00000400:00000200:7.0:1773851897.660652:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770258:8770258:1024:4294967295] 12243@kfi7 LPNI seq info [823178:823178:16:4294967295]
00000400:00000200:7.0:1773851897.660653:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000400:00000200:7.0:1773851897.660654:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12243@kfi7 to cpt 1
00000400:00000200:7.0:1773851897.660655:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12243@kfi7(12243@kfi7:12243@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851897.660656:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 3
00000800:00000200:7.0:1773851897.660658:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851897.660659:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851897.660661:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851897.660663:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x110d Using peer 12243@kfi7(0x110d)
00000800:00000200:7.0:1773851897.660665:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x110d: rc=0
00000800:00000200:7.0:1773851897.660667:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x110d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851897.660668:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851897.660669:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000905bc2d2 refcount 2 to 12050@kfi7
00010000:00000001:7.0:1773851897.660670:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851897.660670:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851897.660671:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851897.660671:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bda68ad4 x1859597737827200/t0(0) o400->7968d425-dd8b-4e78-b9a0-41d777685fed@12050@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1253-0'
00000100:00100000:7.0:1773851897.660674:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bda68ad4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:7968d425-dd8b-4e78-b9a0-41d777685fed+5:39701:x1859597737827200:12345-12050@kfi7:400:default-tuolumne1253-0 Request processed in 57us (83us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851897.660676:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12050@kfi7, seq: 2001996
00000100:00000040:7.0:1773851897.660677:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000097261f1b : new rpc_count 0
00000100:00000001:7.0:1773851897.660677:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851897.660678:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851897.660678:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851897.660679:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000020:00000010:7.0:1773851897.660680:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000050d3f139.
00000020:00000040:7.0:1773851897.660680:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000097261f1b : new refcount 4
00000800:00000200:5.0:1773851897.660680:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x110d TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851897.660681:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851897.660681:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851897.660682:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12243@kfi7: PUT: OK
00000400:00000200:5.0:1773851897.660683:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000aef8b1b2
00000400:00000010:5.0:1773851897.660684:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000aef8b1b2.
00000100:00000001:5.0:1773851897.660684:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851897.660685:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851897.660686:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000acd6a3b1 nid 12243@kfi7 refs 2
00000800:00000200:5.0:1773851897.660687:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 12243@kfi7(00000000d90fef93):0x0 lsk 4366 rsk 6 tsk 0 trmk 0 tmk 0 trr 1 tta 0x110d Transaction freed
00000800:00000200:1.0:1773851897.664864:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851897.664865:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851897.664866:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851897.664868:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851897.664870:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10418@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.664871:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10418@kfi7 : PUT - for me
00000400:00000200:1.0:1773851897.664872:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10418@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.664874:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a55d0c0b nid 10418@kfi7 refs 1
00000400:00000200:1.0:1773851897.664875:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10418@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.664876:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a55d0c0b nid 10418@kfi7 refs 2
00000400:00000200:1.0:1773851897.664877:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a55d0c0b nid 10418@kfi7 refs 3
00000400:00000200:1.0:1773851897.664878:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10418@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.664879:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10418@kfi7 of length 224 into portal 12 MB=0x69b826e636f40
00000400:00000200:1.0:1773851897.664881:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10418@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 53240
00000800:00000200:1.0:1773851897.664883:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851897.664885:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851897.664885:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10418@kfi7: PUT: OK
00000100:00000001:1.0:1773851897.664886:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851897.664887:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851897.664888:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dddec158.
00000100:00000040:1.0:1773851897.664889:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000dddec158 x1859834360328000 msgsize 224
00000100:00100000:1.0:1773851897.664890:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-10418@kfi7 (source: 12345-10418@kfi7)
00000100:00000001:1.0:1773851897.664891:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851897.664892:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a55d0c0b nid 10418@kfi7 refs 2
00000800:00000200:1.0:1773851897.664893:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851897.664893:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851897.664893:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851897.664893:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851897.664894:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851897.664895:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851897.664895:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859834360328000
00000020:00000001:0.0:1773851897.664896:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851897.664896:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875d9deb81
00000020:00000001:0.0:1773851897.664897:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851897.664899:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074648ac7 refcount=5
00000020:00000001:0.0:1773851897.664900:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637115008843776 : -106958700707840 : ffff9eb8bca38000)
00000020:00000001:0.0:1773851897.664900:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637115008843776 : -106958700707840 : ffff9eb8bca38000)
00000100:00000001:0.0:1773851897.664901:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851897.664902:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851897.664902:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000064d0890b.
00000020:00000010:0.0:1773851897.664903:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851897.664904:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851897.664905:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851897.664905:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851897.664906:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851897.664906:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851897.664907:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851897.664907:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.664908:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851897.664909:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851897.664909:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851897.664909:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851897.664910:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851897.664911:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851897.664911:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10418@kfi7, seq: 1997627
00000100:00000040:0.0:1773851897.664911:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074648ac7 : new rpc_count 1
00000100:00000001:2.0:1773851897.664912:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.664912:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052779648 : -106991656771968 : ffff9eb1104dde80)
00000100:00000040:0.0:1773851897.664913:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dddec158 x1859834360328000/t0(0) o400->b97c394f-f734-4bda-a5d7-4e883e1989b5@10418@kfi7:537/0 lens 224/0 e 0 to 0 dl 1773852652 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1130-0'
00000100:00000001:0.0:1773851897.664915:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851897.664915:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851897.664916:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dddec158 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b97c394f-f734-4bda-a5d7-4e883e1989b5+5:39940:x1859834360328000:12345-10418@kfi7:400:default-tuolumne1130-0
00000100:00000200:0.0:1773851897.664917:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859834360328000
00000020:00000001:0.0:1773851897.664918:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851897.664918:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851897.664919:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.664920:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851897.664920:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851897.664921:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851897.664922:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859834360328000, found 0 last_xid 1859834360327999
00000020:00000001:0.0:1773851897.664922:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851897.664923:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851897.664923:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851897.664924:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.664924:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851897.664925:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851897.664925:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851897.664926:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000006845fae.
02000000:00000001:0.0:1773851897.664927:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.664927:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.664928:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851897.664928:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689102, transno 0, xid 1859834360328000
00010000:00000001:0.0:1773851897.664929:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851897.664930:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dddec158 x1859834360328000/t0(0) o400->b97c394f-f734-4bda-a5d7-4e883e1989b5@10418@kfi7:537/0 lens 224/224 e 0 to 0 dl 1773852652 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1130-0'
00010000:00000001:0.0:1773851897.664932:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851897.664932:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851897.664933:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=130 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851897.664934:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851897.664934:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009131f07e refcount 3 to 10418@kfi7
00000100:00000001:0.0:1773851897.664935:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919530573088 : -107154178978528 : ffff9e8b3939cd20)
02000000:00000001:0.0:1773851897.664936:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851897.664936:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.664937:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851897.664938:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10418@kfi7
00000400:00000010:0.0:1773851897.664938:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000071d311d2.
00000100:00000200:0.0:1773851897.664939:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859834360328000, offset 224
00000400:00000200:0.0:1773851897.664940:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10418@kfi7
00000400:00000200:0.0:1773851897.664941:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10418@kfi7 to cpt 0
00000400:00000200:0.0:1773851897.664942:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a55d0c0b nid 10418@kfi7 refs 1
00000400:00000200:0.0:1773851897.664943:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a55d0c0b nid 10418@kfi7 refs 2
00000400:00000200:0.0:1773851897.664944:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a55d0c0b nid 10418@kfi7 refs 3
00000400:00000200:0.0:1773851897.664945:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10418@kfi7 local destination
00000400:00000200:0.0:1773851897.664946:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770259:8770259:1024:4294967295] 10418@kfi7 LPNI seq info [3218186:3218186:16:4294967295]
00000400:00000200:0.0:1773851897.664948:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a55d0c0b nid 10418@kfi7 refs 2
00000400:00000200:0.0:1773851897.664948:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10418@kfi7 to cpt 0
00000400:00000200:0.0:1773851897.664950:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10418@kfi7(10418@kfi7:10418@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851897.664951:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a55d0c0b nid 10418@kfi7 refs 3
00000800:00000200:0.0:1773851897.664952:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851897.664953:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851897.664955:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851897.664957:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88e Using peer 10418@kfi7(0x88e)
00000800:00000200:0.0:1773851897.664960:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x88e: rc=0
00000800:00000200:0.0:1773851897.664961:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851897.664962:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851897.664963:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009131f07e refcount 2 to 10418@kfi7
00010000:00000001:0.0:1773851897.664964:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851897.664964:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.664965:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851897.664965:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dddec158 x1859834360328000/t0(0) o400->b97c394f-f734-4bda-a5d7-4e883e1989b5@10418@kfi7:537/0 lens 224/224 e 0 to 0 dl 1773852652 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1130-0'
00000100:00100000:0.0:1773851897.664968:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dddec158 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:b97c394f-f734-4bda-a5d7-4e883e1989b5+5:39940:x1859834360328000:12345-10418@kfi7:400:default-tuolumne1130-0 Request processed in 52us (78us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851897.664972:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10418@kfi7, seq: 1997627
00000100:00000040:0.0:1773851897.664972:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074648ac7 : new rpc_count 0
00000100:00000001:0.0:1773851897.664973:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851897.664973:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851897.664974:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851897.664975:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851897.664976:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000064d0890b.
00000020:00000040:0.0:1773851897.664976:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000074648ac7 : new refcount 4
00000100:00000001:0.0:1773851897.664977:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851897.664982:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88e TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851897.664983:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851897.664985:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10418@kfi7: PUT: OK
00000400:00000200:2.0:1773851897.664985:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000071d311d2
00000400:00000010:2.0:1773851897.664986:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000071d311d2.
00000100:00000001:2.0:1773851897.664987:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851897.664987:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851897.664988:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a55d0c0b nid 10418@kfi7 refs 2
00000800:00000200:2.0:1773851897.664990:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 10418@kfi7(000000004457736d):0x0 lsk 2191 rsk 42 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88e Transaction freed
00000004:00000001:30.0:1773851897.673731:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851897.673731:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851897.673732:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a47817b8.
00000004:00000001:28.0:1773851897.673732:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:30.0:1773851897.673733:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000004:00000001:29.0:1773851897.673733:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851897.673733:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851897.673733:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000a333d7b.
00000004:00000020:28.0:1773851897.673733:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:30.0:1773851897.673734:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851897.673734:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:29.0:1773851897.673734:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
00000100:00000010:28.0:1773851897.673734:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c6ebb3a1.
00000020:00000040:28.0:1773851897.673734:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
02000000:00000001:30.0:1773851897.673735:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673735:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851897.673735:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:28.0:1773851897.673735:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:30.0:1773851897.673736:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006dbfd28d.
02000000:00000001:29.0:1773851897.673736:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851897.673736:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:28.0:1773851897.673736:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851897.673737:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851897.673737:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000073cec333.
00000100:00000001:29.0:1773851897.673737:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851897.673737:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000037668ce6.
00000004:00000001:8.0:1773851897.673737:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000040:3.0:1773851897.673737:0:2515838:0:(pinger.c:251:ptlrpc_pinger_process_import()) lustre5-MDT0000-lwp-MDT0001_UUID->lustre5-MDT0000_UUID: level FULL/9 force 0 force_next 0 deactive 0 pingable 1 suppress 0
00000100:00000001:30.0:1773851897.673738:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851897.673738:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851897.673738:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:8.0:1773851897.673738:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:3.0:1773851897.673738:0:2515838:0:(pinger.c:136:ptlrpc_ping()) Process entered
00000100:00000001:30.0:1773851897.673739:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673739:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.673739:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851897.673739:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:8.0:1773851897.673739:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000821d3b26.
00000100:00000040:30.0:1773851897.673740:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000a47817b8] to pc [ptlrpcd_07_02+2]  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851897.673740:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000000a333d7b] to pc [ptlrpcd_07_01+1]  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851897.673740:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c6ebb3a1] to pc [ptlrpcd_07_03+3]  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000010:3.0:1773851897.673740:0:2515838:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8f0219f.
00000020:00000040:8.0:1773851897.673741:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000020:00000040:3.0:1773851897.673741:0:2515838:0:(genops.c:1094:class_import_get()) import 000000002745b77b refcount=3 obd=lustre5-MDT0000-lwp-MDT0001
00000100:00000001:8.0:1773851897.673742:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851897.673742:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:3.0:1773851897.673742:0:2515838:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:8.0:1773851897.673743:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851897.673743:0:2515838:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:3.0:1773851897.673744:0:2515838:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851897.673745:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:29.0:1773851897.673745:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:28.0:1773851897.673745:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000010:8.0:1773851897.673745:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:8.0:1773851897.673745:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851897.673745:0:2515838:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000945980ce.
00000100:00000001:31.0:1773851897.673746:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:30.0:1773851897.673746:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c00a3db3.
00080000:00000010:29.0:1773851897.673746:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000a8cabe40.
00080000:00000010:28.0:1773851897.673746:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000010d76dd6.
00000100:00000001:8.0:1773851897.673746:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851897.673746:0:2515838:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673747:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851897.673747:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851897.673747:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637133438703616 : -106940270848000 : ffff9ebd0724d800)
00080000:00000001:29.0:1773851897.673747:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636958013677568 : -107115695874048 : ffff9e942eff6000)
00080000:00000001:28.0:1773851897.673747:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636989119693824 : -107084589857792 : ffff9e9b6d0f8400)
00000100:00000001:8.0:1773851897.673747:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851897.673747:0:2515838:0:(pinger.c:151:ptlrpc_ping()) @@@ pinging lustre5-MDT0000-lwp-MDT0001_UUID->lustre5-MDT0000_UUID  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:''
00000100:00000040:31.0:1773851897.673748:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851897.673748:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851897.673748:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:28.0:1773851897.673748:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:8.0:1773851897.673748:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000821d3b26] to pc [ptlrpcd_02_01+1]  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851897.673749:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851897.673749:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00080000:00000001:29.0:1773851897.673749:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851897.673749:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
00080000:00000001:28.0:1773851897.673749:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851897.673749:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
00000004:00000010:30.0:1773851897.673750:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000762206b6.
00000004:00000010:28.0:1773851897.673750:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006fae519b.
00000100:00000001:31.0:1773851897.673751:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:30.0:1773851897.673751:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614172127026449ns, next at 614173127025487ns, rc = 0
00000004:00000010:29.0:1773851897.673751:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000080f7f697.
00000004:00080000:29.0:1773851897.673751:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614172127026880ns, next at 614173127025968ns, rc = 0
00000004:00080000:28.0:1773851897.673751:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614172127026479ns, next at 614173127025487ns, rc = 0
00000100:00000001:3.0:1773851897.673751:0:2515838:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:3.0:1773851897.673751:0:2515838:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673752:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851897.673752:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:29.0:1773851897.673752:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851897.673752:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:8.0:1773851897.673752:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:3.0:1773851897.673752:0:2515838:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d8f0219f] to pc [ptlrpcd_00_01+1]  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851897.673753:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851897.673753:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851897.673753:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851897.673753:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673753:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851897.673753:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851897.673753:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000dba14485.
02000000:00000001:31.0:1773851897.673754:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851897.673754:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851897.673754:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851897.673754:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673754:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851897.673754:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851897.673754:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851897.673754:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637052184763392 : -107021524788224 : ffff9eaa1c081c00)
00000100:00100000:31.0:1773851897.673755:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000000a333d7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051940480:47@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851897.673755:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851897.673755:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:10.0:1773851897.673755:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851897.673755:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851897.673756:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851897.673756:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673756:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851897.673756:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851897.673756:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851897.673756:0:2515838:0:(pinger.c:160:ptlrpc_ping()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851897.673757:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851897.673757:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851897.673757:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851897.673757:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00001000:8.0:1773851897.673757:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
02000000:00000001:31.0:1773851897.673758:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:28.0:1773851897.673758:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851897.673758:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851897.673758:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851897.673758:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000009fc39b51.
00000004:00080000:8.0:1773851897.673758:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614172127033973ns, next at 614173127032891ns, rc = 0
00000100:00000001:1.0:1773851897.673758:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:1.0:1773851897.673758:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.673758:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851897.673758:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000010:31.0:1773851897.673759:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004c6985fa.
00000100:00000001:28.0:1773851897.673759:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:10.0:1773851897.673759:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:8.0:1773851897.673759:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:0.0:1773851897.673759:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:31.0:1773851897.673760:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673760:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000040:28.0:1773851897.673760:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:10.0:1773851897.673760:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851897.673760:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851897.673760:0:2515838:0:(pinger.c:320:ptlrpc_pinger_main()) next wakeup in 15 (614222)
00000100:00000040:0.0:1773851897.673760:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851897.673761:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:29.0:1773851897.673761:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851897.673761:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000821d3b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051940608:2084@kfi7:13:default-yuba2-0
00000004:00000001:8.0:1773851897.673761:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851897.673762:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000400:00000010:31.0:1773851897.673762:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
02000000:00000001:29.0:1773851897.673762:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851897.673762:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673762:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851897.673762:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00100000:29.0:1773851897.673763:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000a47817b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051940416:2104@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851897.673763:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:10.0:1773851897.673763:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.673763:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:0.0:1773851897.673763:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851897.673764:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940480, portal 4
00000100:00000001:28.0:1773851897.673764:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851897.673764:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:0.0:1773851897.673764:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:31.0:1773851897.673765:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851897.673765:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637137337969664 : -106936371581952 : ffff9ebdef8eec00)
00000100:00000001:29.0:1773851897.673765:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:29.0:1773851897.673765:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851897.673765:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000010:10.0:1773851897.673765:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000009b6047fd.
02000000:00000001:10.0:1773851897.673765:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851897.673765:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851897.673766:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851897.673766:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851897.673766:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:28.0:1773851897.673766:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851897.673766:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00100000:0.0:1773851897.673766:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0000-lwp-MDT0001_UUID:41061:1859433051940672:61@kfi7:400:default-yuba2-0
00000100:00100000:28.0:1773851897.673767:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6ebb3a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051940544:9@kfi7:13:default-yuba2-0
00000400:00000010:10.0:1773851897.673767:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000100:00000001:0.0:1773851897.673767:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:29.0:1773851897.673768:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e11c4511.
00000100:00000001:28.0:1773851897.673768:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:10.0:1773851897.673768:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
02000000:00000001:0.0:1773851897.673768:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:31.0:1773851897.673769:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:29.0:1773851897.673769:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851897.673769:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851897.673769:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851897.673769:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940608, portal 4
02000000:00000001:0.0:1773851897.673769:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851897.673769:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:31.0:1773851897.673770:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000400:00000010:31.0:1773851897.673770:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c70e405.
00000400:00000200:29.0:1773851897.673770:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
02000000:00000001:28.0:1773851897.673770:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:10.0:1773851897.673770:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851897.673770:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491251712 : -107117218299904 : ffff9e93d4410000)
02000000:00000010:0.0:1773851897.673770:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 512 at 0000000006d6cf39.
00000100:00000200:31.0:1773851897.673771:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940480, offset 0
00000400:00000010:29.0:1773851897.673771:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000a4a850a3.
02000000:00000001:0.0:1773851897.673771:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851897.673772:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b9245dae.
02000000:00000010:28.0:1773851897.673772:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b825c1cb.
02000000:00000001:28.0:1773851897.673772:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851897.673772:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:0.0:1773851897.673772:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:31.0:1773851897.673773:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000100:00000200:29.0:1773851897.673773:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940416, portal 4
00000100:00000001:29.0:1773851897.673773:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:28.0:1773851897.673773:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000010:0.0:1773851897.673773:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000002a9a269c.
00000400:00000010:0.0:1773851897.673773:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008edf1d49.
00000100:00000001:29.0:1773851897.673774:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411257216 : -106960298294400 : ffff9eb85d6a4380)
00000400:00000010:28.0:1773851897.673774:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000100:00000001:10.0:1773851897.673774:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:0.0:1773851897.673774:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 512 bytes, xid 1859433051940672, portal 10
00000400:00000200:31.0:1773851897.673775:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:31.0:1773851897.673775:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000100:00000040:29.0:1773851897.673775:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851897.673775:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032756c42.
00000100:00000040:10.0:1773851897.673775:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000100:00000001:0.0:1773851897.673775:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:0.0:1773851897.673775:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288722048 : -106964420829568 : ffff9eb767b15e80)
00000400:00000010:10.0:1773851897.673776:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000093445156.
00000100:00000200:10.0:1773851897.673776:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940608, offset 0
00000400:00000200:31.0:1773851897.673777:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000200:28.0:1773851897.673777:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940544, portal 4
00000100:00000040:0.0:1773851897.673777:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851897.673778:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000001:29.0:1773851897.673778:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851897.673778:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851897.673778:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324235904 : -106976385315712 : ffff9eb49e8dcc80)
00000400:00000200:10.0:1773851897.673778:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
00000400:00000200:31.0:1773851897.673779:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000100:00000040:29.0:1773851897.673779:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:29.0:1773851897.673779:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ecffec9b.
00000400:00000200:10.0:1773851897.673779:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000200:29.0:1773851897.673780:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940416, offset 0
00000100:00000040:28.0:1773851897.673780:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851897.673780:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000100:00000001:0.0:1773851897.673780:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851897.673781:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770259, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770256, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851897.673781:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
00000400:00000200:10.0:1773851897.673781:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000040:0.0:1773851897.673781:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-61@kfi7
00000400:00000010:0.0:1773851897.673781:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008c05e23f.
00000100:00000001:28.0:1773851897.673782:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851897.673782:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000100:00000200:0.0:1773851897.673782:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 12, xid 1859433051940672, offset 0
00000400:00000200:31.0:1773851897.673783:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000040:28.0:1773851897.673783:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000200:10.0:1773851897.673783:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000200:0.0:1773851897.673783:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-61@kfi7
00000400:00000200:31.0:1773851897.673784:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000010:28.0:1773851897.673784:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e5971693.
00000400:00000200:0.0:1773851897.673784:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:31.0:1773851897.673785:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000100:00000200:28.0:1773851897.673785:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940544, offset 0
00000400:00000200:10.0:1773851897.673785:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770259, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770256, p:4294967295, g:4294967295, h:1000]
00000400:00000200:0.0:1773851897.673785:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000400:00000200:31.0:1773851897.673786:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770260:8770260:1024:4294967295] 47@kfi7 LPNI seq info [5403026:5403026:16:4294967295]
00000400:00000200:28.0:1773851897.673786:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000400:00000200:0.0:1773851897.673786:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:10.0:1773851897.673787:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:0.0:1773851897.673787:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:10.0:1773851897.673788:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:0.0:1773851897.673788:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  61@kfi7 local destination
00000400:00000200:10.0:1773851897.673789:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:31.0:1773851897.673790:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:10.0:1773851897.673790:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770261:8770261:1024:4294967295] 2084@kfi7 LPNI seq info [5402751:5402751:16:4294967295]
00000400:00000200:0.0:1773851897.673790:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770261, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770260, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851897.673791:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:29.0:1773851897.673792:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:10.0:1773851897.673792:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:0.0:1773851897.673792:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851897.673793:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:10.0:1773851897.673793:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:0.0:1773851897.673793:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:0.0:1773851897.673794:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851897.673795:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851897.673795:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:0.0:1773851897.673795:0:41061:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[43@kfi7, 61@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[37492108, 37492107]
00000400:00000200:31.0:1773851897.673796:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:29.0:1773851897.673796:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:10.0:1773851897.673796:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851897.673797:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000400:00000200:0.0:1773851897.673797:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 61@kfi7
00000800:00000200:31.0:1773851897.673798:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:10.0:1773851897.673798:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:0.0:1773851897.673798:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770262:8770262:1023:4294967295] 61@kfi7 LPNI seq info [37492109:37492109:16:4294967295]
00000800:00000200:31.0:1773851897.673799:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851897.673799:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770261, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770262, p:4294967295, g:4294967295, h:1000]
00000800:00000200:10.0:1773851897.673800:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:0.0:1773851897.673800:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:29.0:1773851897.673801:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:10.0:1773851897.673801:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:0.0:1773851897.673801:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000800:00000200:31.0:1773851897.673802:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851897.673802:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851897.673802:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000400:00000200:29.0:1773851897.673803:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770263:8770263:1023:4294967295] 2104@kfi7 LPNI seq info [5403383:5403383:16:4294967295]
00000400:00000200:0.0:1773851897.673803:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 61@kfi7(61@kfi7:61@kfi7) <?> : PUT try# 0
00000800:00000200:31.0:1773851897.673804:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000800:00000200:10.0:1773851897.673804:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:0.0:1773851897.673804:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000400:00000200:29.0:1773851897.673805:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:29.0:1773851897.673806:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000800:00000200:0.0:1773851897.673806:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:28.0:1773851897.673807:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000800:00000200:10.0:1773851897.673807:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Using peer 2084@kfi7(0x103)
00000800:00000200:0.0:1773851897.673807:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851897.673808:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000400:00000200:29.0:1773851897.673808:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851897.673808:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000800:00000200:31.0:1773851897.673809:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851897.673809:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:28.0:1773851897.673809:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:0.0:1773851897.673809:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851897.673810:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000800:00000200:10.0:1773851897.673810:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000348da31e: Posted send of 324 bytes to peer 0x103: rc=0
00000800:00000200:29.0:1773851897.673811:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851897.673811:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000800:00000200:10.0:1773851897.673811:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851897.673812:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673812:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:28.0:1773851897.673812:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8770263, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8770262, p:4294967295, g:4294967295, h:1000]
00000800:00000200:0.0:1773851897.673812:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e Using peer 61@kfi7(0x20000000000081e)
00000100:00000001:31.0:1773851897.673813:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851897.673813:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:10.0:1773851897.673813:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673814:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673814:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851897.673814:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:10.0:1773851897.673814:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851897.673815:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:10.0:1773851897.673815:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673815:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:0.0:1773851897.673815:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x20000000000081e: rc=0
00000100:00000001:31.0:1773851897.673816:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851897.673816:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:28.0:1773851897.673816:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:10.0:1773851897.673816:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:0.0:1773851897.673816:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851897.673817:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851897.673817:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851897.673817:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Using peer 2104@kfi7(0x19d)
00000400:00000200:28.0:1773851897.673817:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000100:00000001:10.0:1773851897.673817:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851897.673818:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851897.673818:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770264:8770264:1022:4294967295] 9@kfi7 LPNI seq info [5403015:5403015:16:4294967295]
00000100:00000001:10.0:1773851897.673818:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:0.0:1773851897.673818:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673819:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851897.673819:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:10.0:1773851897.673819:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851897.673819:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:0.0:1773851897.673819:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:0.0:1773851897.673819:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851897.673820:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:10.0:1773851897.673820:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673820:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.673820:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851897.673821:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_EVENT_TX_OK event status 0
00000100:00000001:0.0:1773851897.673821:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851897.673822:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000800:00000200:29.0:1773851897.673823:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000804ff607: Posted send of 324 bytes to peer 0x19d: rc=0
00000400:00000200:28.0:1773851897.673823:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:9.0:1773851897.673823:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:29.0:1773851897.673824:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851897.673824:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000001:0.0:1773851897.673824:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:0.0:1773851897.673824:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=273 : 273 : 111)
00000400:00000200:9.0:1773851897.673825:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000093445156
00000400:00000010:9.0:1773851897.673825:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000093445156.
00000100:00000001:0.0:1773851897.673825:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851897.673826:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851897.673826:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:0.0:1773851897.673826:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851897.673827:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:9.0:1773851897.673827:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851897.673828:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673829:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673829:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851897.673830:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851897.673830:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:1.0:1773851897.673831:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e TN_EVENT_TX_OK event status 0
00000100:00000001:0.0:1773851897.673831:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851897.673832:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851897.673832:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851897.673832:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:9.0:1773851897.673832:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851897.673832:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673833:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:28.0:1773851897.673833:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:1.0:1773851897.673833:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851897.673834:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851897.673834:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673834:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851897.673834:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851897.673835:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851897.673835:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000800:00000200:28.0:1773851897.673835:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851897.673835:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:1.0:1773851897.673835:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000400:00000200:31.0:1773851897.673836:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851897.673836:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c70e405
00000400:00000200:1.0:1773851897.673836:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008c05e23f
00000400:00000010:1.0:1773851897.673836:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008c05e23f.
00000400:00000010:30.0:1773851897.673837:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c70e405.
00000400:00000200:9.0:1773851897.673837:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000100:00000001:1.0:1773851897.673837:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:31.0:1773851897.673838:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000400:00000200:31.0:1773851897.673838:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ecffec9b
00000100:00000001:30.0:1773851897.673838:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:28.0:1773851897.673838:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851897.673838:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000348da31e: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Transaction freed
00000100:00000200:1.0:1773851897.673838:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 2 fl Rpc:Nr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851897.673839:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ecffec9b.
00000100:00000200:30.0:1773851897.673839:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851897.673840:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:31.0:1773851897.673840:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851897.673840:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 Using peer 9@kfi7(0x200000000000324)
00000100:00000001:1.0:1773851897.673841:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851897.673842:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851897.673843:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851897.673843:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0x200000000000324: rc=0
00000100:00000040:1.0:1773851897.673843:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 2 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851897.673844:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851897.673844:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851897.673844:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851897.673845:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851897.673845:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851897.673846:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:28.0:1773851897.673846:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851897.673846:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851897.673847:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851897.673847:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:28.0:1773851897.673847:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851897.673847:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851897.673847:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:31.0:1773851897.673848:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:28.0:1773851897.673848:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851897.673849:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:30.0:1773851897.673849:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000100:00000001:28.0:1773851897.673849:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851897.673849:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000081e Transaction freed
00000800:00000200:31.0:1773851897.673850:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000804ff607: 2069@kfi7:7 -> 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x19d Transaction freed
00000100:00000001:28.0:1773851897.673850:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851897.673850:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:2.0:1773851897.673851:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000001:28.0:1773851897.673852:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:2.0:1773851897.673852:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:28.0:1773851897.673853:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:2.0:1773851897.673854:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851897.673855:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:28.0:1773851897.673856:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.673857:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851897.673858:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851897.673858:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:29.0:1773851897.673859:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851897.673860:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9@kfi7: PUT: OK
00000400:00000200:29.0:1773851897.673861:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e5971693
00000400:00000010:29.0:1773851897.673861:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e5971693.
00000400:00000200:2.0:1773851897.673861:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 61@kfi7 : PUT - for me
00000400:00000200:2.0:1773851897.673861:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:29.0:1773851897.673862:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:2.0:1773851897.673862:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 1
00000100:00000200:29.0:1773851897.673863:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851897.673863:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:2.0:1773851897.673863:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000800:00000200:25.0:1773851897.673864:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:2.0:1773851897.673864:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000100:00000001:29.0:1773851897.673865:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:25.0:1773851897.673865:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851897.673865:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 3
00000100:00000040:29.0:1773851897.673866:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851897.673866:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000800:00000200:25.0:1773851897.673867:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851897.673867:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 10 MB=0x69b24fe8b6740
00000400:00000200:2.0:1773851897.673868:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000100:00000001:29.0:1773851897.673869:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673869:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:2.0:1773851897.673869:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index a from 12345-61@kfi7 of length 224/224 into md 0x7fb71e5e1 [1] + 224
00000400:00000200:29.0:1773851897.673870:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:25.0:1773851897.673870:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851897.673871:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2084@kfi7 : PUT - for me
00000800:00000200:29.0:1773851897.673872:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2054@kfi7:7 -> 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000324 Transaction freed
00000400:00000200:25.0:1773851897.673872:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:2.0:1773851897.673872:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851897.673873:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:25.0:1773851897.673874:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851897.673874:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:2.0:1773851897.673874:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851897.673875:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:2.0:1773851897.673875:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->61@kfi7: PUT: OK
00000100:00000001:2.0:1773851897.673876:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851897.673877:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:14.0:1773851897.673877:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000100:00000200:2.0:1773851897.673877:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 1 fl Rpc:NQr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851897.673878:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6700
00000800:00000200:14.0:1773851897.673878:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851897.673879:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000800:00000200:14.0:1773851897.673879:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851897.673880:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b83279 [1] + 224
00000100:00000040:2.0:1773851897.673880:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=224 offset=224 replen=224  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851897.673881:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:25.0:1773851897.673882:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851897.673882:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851897.673882:0:2514739:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851897.673883:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:2.0:1773851897.673883:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:25.0:1773851897.673884:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851897.673884:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:2.0:1773851897.673884:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018dc6e0e nid 61@kfi7 refs 2
00000400:00000200:25.0:1773851897.673885:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000001:0.0:1773851897.673885:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:25.0:1773851897.673886:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851897.673886:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851897.673886:0:2514739:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2104@kfi7 : PUT - for me
00000800:00000200:2.0:1773851897.673886:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2054@kfi7:0 <- 61@kfi7(0000000062d37322):0x0 lsk 2079 rsk 1728 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851897.673886:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:0.0:1773851897.673886:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:14.0:1773851897.673887:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000001:0.0:1773851897.673887:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:25.0:1773851897.673888:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851897.673888:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:14.0:1773851897.673888:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000010:0.0:1773851897.673888:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000002a9a269c.
00000400:00000200:0.0:1773851897.673888:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008edf1d49
00000400:00000200:14.0:1773851897.673889:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000010:0.0:1773851897.673889:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008edf1d49.
00000400:00000200:21.0:1773851897.673890:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000400:00000200:14.0:1773851897.673890:0:2514739:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:0.0:1773851897.673890:0:41061:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:25.0:1773851897.673891:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851897.673891:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000200:0.0:1773851897.673891:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 1 fl Rpc:RNQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851897.673892:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:14.0:1773851897.673892:0:2514739:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:21.0:1773851897.673893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000200:0.0:1773851897.673893:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 1 fl Rpc:RNQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851897.673894:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:14.0:1773851897.673894:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:25.0:1773851897.673895:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851897.673895:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:14.0:1773851897.673895:0:2514739:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6640
00000400:00000200:25.0:1773851897.673896:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:21.0:1773851897.673896:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:14.0:1773851897.673896:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:0.0:1773851897.673896:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851897.673897:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851897.673897:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851897.673897:0:41061:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:25.0:1773851897.673898:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:21.0:1773851897.673898:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6680
00000400:00000200:14.0:1773851897.673898:0:2514739:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f72ed [1] + 224
00000100:00000001:10.0:1773851897.673898:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:10.0:1773851897.673898:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
02000000:00000001:0.0:1773851897.673898:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:0.0:1773851897.673898:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:21.0:1773851897.673899:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000001:10.0:1773851897.673899:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:0.0:1773851897.673899:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851897.673899:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:14.0:1773851897.673900:0:2514739:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:10.0:1773851897.673900:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:10.0:1773851897.673900:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000100:00001000:0.0:1773851897.673900:0:41061:0:(import.c:1951:at_measured()) add 288 to 00000000bdd870d6 time=130 v=215 (215 66 66 66)
00000400:00000200:21.0:1773851897.673901:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d1f35 [1] + 224
00000400:00000010:10.0:1773851897.673901:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000800:00000200:5.0:1773851897.673901:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:14.0:1773851897.673902:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:10.0:1773851897.673902:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:5.0:1773851897.673902:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00001000:0.0:1773851897.673902:0:41061:0:(import.c:2016:at_measured()) AT 00000000bdd870d6 change: old=215 new=288 delta=73 (val=288) hist 288 66 66 66
00000800:00000200:21.0:1773851897.673903:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:14.0:1773851897.673903:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2104@kfi7: PUT: OK
00000100:00000200:10.0:1773851897.673903:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851897.673903:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:0.0:1773851897.673903:0:41061:0:(client.c:379:ptlrpc_at_adj_service()) The RPC service estimate for lustre5-MDT0000-lwp-MDT0001 ptl 12 has changed from 215 to 288
00000100:00000001:14.0:1773851897.673904:0:2514739:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:0.0:1773851897.673904:0:41061:0:(import.c:1951:at_measured()) add 1 to 0000000091f5e909 time=130 v=66 (1 1 1 1)
00000400:00000200:21.0:1773851897.673905:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851897.673905:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:0.0:1773851897.673905:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:21.0:1773851897.673906:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000100:00000200:14.0:1773851897.673906:0:2514739:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851897.673906:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851897.673906:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851897.673906:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:21.0:1773851897.673907:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851897.673907:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00010000:00000001:0.0:1773851897.673907:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673908:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:0.0:1773851897.673908:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:0.0:1773851897.673908:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0000-lwp-MDT0001: skip recheck: last_committed 0
00000100:00000200:21.0:1773851897.673909:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:14.0:1773851897.673909:0:2514739:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851897.673909:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851897.673909:0:41069:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:5.0:1773851897.673909:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9@kfi7 : PUT - for me
00000100:00000001:0.0:1773851897.673909:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:0.0:1773851897.673909:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851897.673910:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851897.673910:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:5.0:1773851897.673910:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:10.0:1773851897.673911:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851897.673911:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000100:00000040:0.0:1773851897.673911:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 1 fl Rpc:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:21.0:1773851897.673912:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:10.0:1773851897.673912:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851897.673912:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:5.0:1773851897.673912:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:14.0:1773851897.673913:0:2514739:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:10.0:1773851897.673913:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=130 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851897.673913:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:0.0:1773851897.673913:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:14.0:1773851897.673914:0:2514739:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00001000:10.0:1773851897.673914:0:41069:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=130 v=66 (1 1 1 1)
00000400:00000200:5.0:1773851897.673914:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:0.0:1773851897.673914:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851897.673915:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851897.673915:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851897.673915:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851897.673915:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b66c0
00000100:00000001:0.0:1773851897.673915:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851897.673916:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:21.0:1773851897.673916:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:14.0:1773851897.673916:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2069@kfi7:3 <- 2104@kfi7(00000000803b4f5c):0x0 lsk 414 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00010000:00000001:10.0:1773851897.673916:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:5.0:1773851897.673916:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000040:0.0:1773851897.673916:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 1 fl Interpret:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:29.0:1773851897.673917:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851897.673917:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:21.0:1773851897.673917:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00010000:00000001:10.0:1773851897.673917:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673918:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:29.0:1773851897.673918:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000a4a850a3.
00000100:00000001:10.0:1773851897.673918:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851897.673918:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000400:00000200:5.0:1773851897.673918:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b32445 [1] + 224
00000100:00000001:31.0:1773851897.673919:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:31.0:1773851897.673919:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:29.0:1773851897.673919:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b9245dae
00000400:00000010:29.0:1773851897.673919:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b9245dae.
00000800:00000200:21.0:1773851897.673919:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851897.673919:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851897.673919:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851897.673919:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0000-lwp-MDT0001_UUID:41061:1859433051940672:61@kfi7:400:default-yuba2-0
00000400:00000001:31.0:1773851897.673920:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851897.673920:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:10.0:1773851897.673920:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:5.0:1773851897.673920:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:0.0:1773851897.673920:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:31.0:1773851897.673921:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000100:00000200:29.0:1773851897.673921:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851897.673921:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:31.0:1773851897.673922:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000400:00000010:31.0:1773851897.673922:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000400:00000200:5.0:1773851897.673922:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:0.0:1773851897.673922:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d8f0219f x1859433051940672/t0(0) o400->lustre5-MDT0000-lwp-MDT0001@61@kfi7:12/10 lens 224/224 e 0 to 0 dl 1773852236 ref 1 fl Complete:RNQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851897.673923:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:10.0:1773851897.673923:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:5.0:1773851897.673923:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9@kfi7: PUT: OK
00000100:00000200:31.0:1773851897.673924:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851897.673924:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851897.673924:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851897.673924:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851897.673924:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:10.0:1773851897.673925:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:0.0:1773851897.673925:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000040:10.0:1773851897.673926:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000100:00000200:5.0:1773851897.673926:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:0.0:1773851897.673926:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:0.0:1773851897.673926:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 512 at 0000000006d6cf39.
00000100:00000200:31.0:1773851897.673927:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851897.673927:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:10.0:1773851897.673927:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593663488 avail=351576858624 avail_mb=1373347104 hwm_mb=3131103 files=372189905 ffree=343353187 state=0: rc = 0
02000000:00000001:0.0:1773851897.673927:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:29.0:1773851897.673928:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851897.673928:0:41090:0:(client.c:1428:after_reply()) Process entered
00000020:00000001:0.0:1773851897.673928:0:41061:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:31.0:1773851897.673929:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:29.0:1773851897.673929:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000020:10.0:1773851897.673929:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593663488 free, 351576858624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372189905 files, 343353187 free files
00000100:00000040:5.0:1773851897.673929:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000040:0.0:1773851897.673929:0:41061:0:(genops.c:1107:class_import_put()) import 000000002745b77b refcount=2 obd=lustre5-MDT0000-lwp-MDT0001
00000020:00000001:0.0:1773851897.673929:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:31.0:1773851897.673930:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.673930:0:41089:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:29.0:1773851897.673930:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851897.673930:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851897.673930:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851897.673930:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000945980ce.
02000000:00000001:31.0:1773851897.673931:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851897.673931:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
02000000:00000001:29.0:1773851897.673931:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851897.673931:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:0.0:1773851897.673931:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:31.0:1773851897.673932:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851897.673932:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:29.0:1773851897.673932:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=130 v=66 (66 66 66 66)
02000000:00000001:0.0:1773851897.673932:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:0.0:1773851897.673932:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8f0219f.
00000100:00001000:31.0:1773851897.673933:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=130 v=66 (66 66 66 66)
00000100:00000001:0.0:1773851897.673933:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00001000:29.0:1773851897.673934:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=130 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851897.673934:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:0.0:1773851897.673934:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:31.0:1773851897.673935:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=130 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851897.673935:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:29.0:1773851897.673935:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00100000:10.0:1773851897.673935:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000821d3b26 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051940608:2084@kfi7:13:default-yuba2-0
00000400:00000200:5.0:1773851897.673935:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:0.0:1773851897.673935:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.673936:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851897.673936:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:29.0:1773851897.673936:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851897.673936:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:28.0:1773851897.673936:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851897.673936:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851897.673936:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 9@kfi7(000000009c5854e0):0x0 lsk 805 rsk 4793 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851897.673936:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:0.0:1773851897.673936:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851897.673937:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851897.673937:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:28.0:1773851897.673937:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:10.0:1773851897.673937:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851897.673937:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851897.673938:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:29.0:1773851897.673938:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:28.0:1773851897.673938:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:10.0:1773851897.673938:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:0.0:1773851897.673938:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851897.673939:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00000001:31.0:1773851897.673939:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:29.0:1773851897.673939:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000001:29.0:1773851897.673939:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:28.0:1773851897.673939:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000100:00000040:10.0:1773851897.673939:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000821d3b26 x1859433051940608/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851897.673940:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673940:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851897.673940:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032756c42
00000400:00000010:28.0:1773851897.673940:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032756c42.
00000100:00000040:31.0:1773851897.673941:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:29.0:1773851897.673941:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851897.673941:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:10.0:1773851897.673941:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851897.673942:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:31.0:1773851897.673943:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:28.0:1773851897.673943:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:10.0:1773851897.673943:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000009b6047fd.
00000100:00000001:31.0:1773851897.673944:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851897.673944:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:10.0:1773851897.673944:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:31.0:1773851897.673945:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851897.673945:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:29.0:1773851897.673945:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:29.0:1773851897.673945:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:10.0:1773851897.673945:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851897.673945:0:41069:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000004:00000040:31.0:1773851897.673946:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000004:00000001:29.0:1773851897.673946:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000200:28.0:1773851897.673946:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000001:10.0:1773851897.673946:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851897.673946:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000004:00000040:31.0:1773851897.673947:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351604012032 avail=351601751040 avail_mb=1373444340 hwm_mb=3131103 files=372190421 ffree=343363293 state=0: rc = 0
00000004:00000040:29.0:1773851897.673947:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000004:00000040:29.0:1773851897.673947:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615833088 avail=351613210624 avail_mb=1373489104 hwm_mb=3131103 files=372043332 ffree=343374837 state=0: rc = 0
02000000:00000001:10.0:1773851897.673947:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851897.673948:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851897.673948:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000821d3b26.
00000004:00000020:31.0:1773851897.673949:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351604012032 free, 351601751040 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190421 files, 343363293 free files
00000100:00000001:28.0:1773851897.673949:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851897.673949:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000001:31.0:1773851897.673950:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:29.0:1773851897.673950:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615833088 free, 351613210624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043332 files, 343374837 free files
00000100:00000001:28.0:1773851897.673950:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851897.673950:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851897.673950:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:31.0:1773851897.673951:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:29.0:1773851897.673951:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.673951:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851897.673951:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851897.673951:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000040:29.0:1773851897.673952:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851897.673952:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851897.673952:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673952:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851897.673953:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851897.673953:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:31.0:1773851897.673954:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000000a333d7b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051940480:47@kfi7:13:default-yuba2-0
00000100:00001000:28.0:1773851897.673954:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=130 v=66 (66 66 66 66)
00000100:00000001:10.0:1773851897.673954:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673956:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:29.0:1773851897.673956:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000a47817b8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051940416:2104@kfi7:13:default-yuba2-0
00000100:00001000:28.0:1773851897.673956:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=51 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851897.673957:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851897.673957:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000000a333d7b x1859433051940480/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:29.0:1773851897.673957:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851897.673957:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851897.673957:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673958:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00010000:00000001:28.0:1773851897.673958:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:29.0:1773851897.673959:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000a47817b8 x1859433051940416/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:28.0:1773851897.673959:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.673960:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851897.673960:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:28.0:1773851897.673960:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851897.673960:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
02000000:00000010:31.0:1773851897.673961:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004c6985fa.
00000100:00000001:28.0:1773851897.673961:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:28.0:1773851897.673961:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851897.673962:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:29.0:1773851897.673962:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:29.0:1773851897.673962:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:31.0:1773851897.673963:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851897.673963:0:41089:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
02000000:00000010:29.0:1773851897.673963:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e11c4511.
00000100:00000040:28.0:1773851897.673963:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:31.0:1773851897.673964:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851897.673964:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000073cec333.
02000000:00000001:29.0:1773851897.673964:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:31.0:1773851897.673965:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:29.0:1773851897.673965:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851897.673965:0:41090:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
02000000:00000001:31.0:1773851897.673966:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:29.0:1773851897.673966:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:28.0:1773851897.673966:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851897.673966:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000010:31.0:1773851897.673967:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000000a333d7b.
00000100:00000001:31.0:1773851897.673967:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000010:29.0:1773851897.673967:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006dbfd28d.
00000100:00000001:28.0:1773851897.673967:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.673968:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.673968:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:29.0:1773851897.673968:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851897.673968:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000004:00000001:28.0:1773851897.673968:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:28.0:1773851897.673968:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000100:00000001:31.0:1773851897.673969:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000010:29.0:1773851897.673969:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000a47817b8.
00000100:00000001:29.0:1773851897.673969:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000040:28.0:1773851897.673969:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480017920 avail=351478758400 avail_mb=1372963900 hwm_mb=3131101 files=372073028 ffree=343242205 state=0: rc = 0
00000100:00000001:31.0:1773851897.673970:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673970:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851897.673970:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.673971:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851897.673971:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673971:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851897.673972:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851897.673972:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000020:28.0:1773851897.673972:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480017920 free, 351478758400 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073028 files, 343242205 free files
00000100:00000001:29.0:1773851897.673973:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851897.673974:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851897.673975:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:28.0:1773851897.673978:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6ebb3a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051940544:9@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851897.673980:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851897.673980:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851897.673982:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c6ebb3a1 x1859433051940544/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852050 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851897.673985:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851897.673985:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851897.673986:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b825c1cb.
02000000:00000001:28.0:1773851897.673987:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851897.673987:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851897.673988:0:41091:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
00000020:00000001:28.0:1773851897.673988:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851897.673989:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000037668ce6.
02000000:00000001:28.0:1773851897.673990:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851897.673990:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851897.673991:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c6ebb3a1.
00000100:00000001:28.0:1773851897.673992:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851897.673992:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851897.673993:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851897.673994:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851897.673994:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851897.673995:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851897.673995:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851897.682851:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851897.682852:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851897.682853:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851897.682855:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851897.682857:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22995@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.682858:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22995@kfi7 : PUT - for me
00000400:00000200:1.0:1773851897.682859:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22995@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.682860:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000626754c5 nid 22995@kfi7 refs 1
00000400:00000200:1.0:1773851897.682861:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22995@kfi7 to cpt 0
00000400:00000200:1.0:1773851897.682862:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000626754c5 nid 22995@kfi7 refs 2
00000400:00000200:1.0:1773851897.682863:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000626754c5 nid 22995@kfi7 refs 3
00000400:00000200:1.0:1773851897.682864:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22802@kfi7 to cpt 2
00000400:00000200:1.0:1773851897.682865:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22802@kfi7 of length 224 into portal 12 MB=0x699e10cfb35c0
00000400:00000200:1.0:1773851897.682866:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22802@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 53464
00000800:00000200:1.0:1773851897.682868:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851897.682870:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851897.682871:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22995@kfi7: PUT: OK
00000100:00000001:1.0:1773851897.682872:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851897.682872:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851897.682873:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ff77cd61.
00000100:00000040:1.0:1773851897.682873:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000ff77cd61 x1858041724745152 msgsize 224
00000100:00100000:1.0:1773851897.682875:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22802@kfi7 (source: 12345-22995@kfi7)
00000100:00000001:1.0:1773851897.682876:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851897.682877:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000626754c5 nid 22995@kfi7 refs 2
00000100:00000001:0.0:1773851897.682877:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851897.682878:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851897.682878:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851897.682879:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851897.682879:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851897.682880:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851897.682881:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041724745152
00000020:00000001:0.0:1773851897.682881:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851897.682882:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92acc
00000020:00000001:0.0:1773851897.682882:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851897.682884:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000fc76a6b refcount=6
00000020:00000001:0.0:1773851897.682884:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743453696 : -107128966097920 : ffff9e911807d400)
00000020:00000001:0.0:1773851897.682885:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743453696 : -107128966097920 : ffff9e911807d400)
00000100:00000001:0.0:1773851897.682886:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851897.682886:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851897.682887:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006d6cf39.
00000020:00000010:0.0:1773851897.682888:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851897.682889:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851897.682890:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851897.682890:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851897.682891:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851897.682891:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851897.682892:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851897.682892:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.682893:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851897.682894:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851897.682895:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851897.682895:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851897.682895:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851897.682896:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851897.682896:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22802@kfi7, seq: 1997628
00000100:00000040:0.0:1773851897.682896:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000fc76a6b : new rpc_count 1
00000100:00000001:2.0:1773851897.682897:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.682897:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052756608 : -106991656795008 : ffff9eb1104d8480)
00000100:00000040:0.0:1773851897.682898:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ff77cd61 x1858041724745152/t0(0) o400->01b1eb9c-fe7b-4b5a-847e-7c09d5a39fcc@22802@kfi7:537/0 lens 224/0 e 0 to 0 dl 1773852652 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1925-0'
00000100:00000001:0.0:1773851897.682900:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851897.682901:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851897.682901:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff77cd61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:01b1eb9c-fe7b-4b5a-847e-7c09d5a39fcc+6:39738:x1858041724745152:12345-22802@kfi7:400:default-tuolumne1925-0
00000100:00000200:0.0:1773851897.682902:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041724745152
00000020:00000001:0.0:1773851897.682903:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851897.682904:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851897.682904:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.682905:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851897.682905:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851897.682906:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851897.682906:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041724745152, found 0 last_xid 1858041724745151
00000020:00000001:0.0:1773851897.682907:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851897.682908:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851897.682908:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851897.682909:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.682909:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851897.682910:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851897.682910:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851897.682911:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ceb3804e.
02000000:00000001:0.0:1773851897.682911:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.682912:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.682913:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851897.682913:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668607086, transno 0, xid 1858041724745152
00010000:00000001:0.0:1773851897.682914:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851897.682915:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ff77cd61 x1858041724745152/t0(0) o400->01b1eb9c-fe7b-4b5a-847e-7c09d5a39fcc@22802@kfi7:537/0 lens 224/224 e 0 to 0 dl 1773852652 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1925-0'
00010000:00000001:0.0:1773851897.682917:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851897.682917:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851897.682918:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=130 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851897.682919:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851897.682920:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ba6aff2f refcount 3 to 22802@kfi7
00000100:00000001:0.0:1773851897.682921:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959056480 : -107146750495136 : ffff9e8cf3ff7660)
02000000:00000001:0.0:1773851897.682921:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851897.682922:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851897.682923:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851897.682924:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22995@kfi7
00000400:00000010:0.0:1773851897.682924:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008edf1d49.
00000100:00000200:0.0:1773851897.682925:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041724745152, offset 224
00000400:00000200:0.0:1773851897.682927:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22995@kfi7
00000400:00000200:0.0:1773851897.682928:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22995@kfi7 to cpt 0
00000400:00000200:0.0:1773851897.682929:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000626754c5 nid 22995@kfi7 refs 1
00000400:00000200:0.0:1773851897.682930:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000626754c5 nid 22995@kfi7 refs 2
00000400:00000200:0.0:1773851897.682931:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000626754c5 nid 22995@kfi7 refs 3
00000400:00000200:0.0:1773851897.682932:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22995@kfi7 local destination
00000400:00000200:0.0:1773851897.682934:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770265:8770265:1024:4294967295] 22995@kfi7 LPNI seq info [75503:75503:16:4294967295]
00000400:00000200:0.0:1773851897.682935:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000626754c5 nid 22995@kfi7 refs 2
00000400:00000200:0.0:1773851897.682936:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22995@kfi7 to cpt 0
00000400:00000200:0.0:1773851897.682938:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22995@kfi7(22995@kfi7:22995@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851897.682939:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000626754c5 nid 22995@kfi7 refs 3
00000800:00000200:0.0:1773851897.682940:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851897.682941:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851897.682943:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851897.682946:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042b Using peer 22995@kfi7(0x10000000000042b)
00000800:00000200:0.0:1773851897.682949:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x10000000000042b: rc=0
00000800:00000200:0.0:1773851897.682950:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851897.682952:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851897.682953:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ba6aff2f refcount 2 to 22802@kfi7
00010000:00000001:0.0:1773851897.682953:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851897.682954:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.682954:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851897.682955:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ff77cd61 x1858041724745152/t0(0) o400->01b1eb9c-fe7b-4b5a-847e-7c09d5a39fcc@22802@kfi7:537/0 lens 224/224 e 0 to 0 dl 1773852652 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1925-0'
00000100:00100000:0.0:1773851897.682959:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff77cd61 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:01b1eb9c-fe7b-4b5a-847e-7c09d5a39fcc+6:39738:x1858041724745152:12345-22802@kfi7:400:default-tuolumne1925-0 Request processed in 58us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851897.682965:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22802@kfi7, seq: 1997628
00000100:00000040:0.0:1773851897.682966:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000fc76a6b : new rpc_count 0
00000100:00000001:0.0:1773851897.682967:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851897.682967:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851897.682967:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851897.682968:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851897.682969:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006d6cf39.
00000020:00000040:0.0:1773851897.682969:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000000fc76a6b : new refcount 5
00000100:00000001:0.0:1773851897.682970:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851897.682975:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042b TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851897.682978:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851897.682980:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22995@kfi7: PUT: OK
00000400:00000200:1.0:1773851897.682981:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008edf1d49
00000400:00000010:1.0:1773851897.682981:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008edf1d49.
00000100:00000001:1.0:1773851897.682982:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851897.682982:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851897.682983:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000626754c5 nid 22995@kfi7 refs 2
00000800:00000200:1.0:1773851897.682985:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 22995@kfi7(00000000bc77a372):0x0 lsk 1068 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042b Transaction freed
00000800:00000200:10.0:1773851897.689837:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851897.689837:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851897.689837:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851897.689837:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851897.689839:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851897.689839:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851897.689841:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851897.689841:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20273@kfi7(00000000c11af255):0xad1 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851897.689843:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000800:00000200:9.0:1773851897.689843:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 Using peer 20273@kfi7(0xad1)
00000400:00000200:10.0:1773851897.689844:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20273@kfi7 : PUT - for me
00000400:00000200:9.0:1773851897.689844:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:10.0:1773851897.689845:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:10.0:1773851897.689846:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 1
00000400:00000200:10.0:1773851897.689847:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000800:00000200:9.0:1773851897.689847:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 38 bytes to peer 0xad1: rc=0
00000400:00000200:10.0:1773851897.689848:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000800:00000200:9.0:1773851897.689848:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851897.689849:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 3
00000400:00000200:10.0:1773851897.689850:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20272@kfi7 to cpt 7
00000400:00000200:10.0:1773851897.689851:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20272@kfi7 of length 224 into portal 12 MB=0x699e0f377fc00
00000400:00000200:10.0:1773851897.689852:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20272@kfi7 of length 224/224 into md 0x78146ce49 [64] + 162616
00000800:00000200:10.0:1773851897.689854:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851897.689855:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851897.689856:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20273@kfi7: PUT: OK
00000100:00000001:10.0:1773851897.689857:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851897.689858:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851897.689859:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aea9ea08.
00000100:00000040:10.0:1773851897.689859:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000aea9ea08 x1858041296714752 msgsize 224
00000800:00000200:9.0:1773851897.689860:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 TN_EVENT_TX_OK event status 0
00000100:00100000:10.0:1773851897.689861:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20272@kfi7 (source: 12345-20273@kfi7)
00000100:00000001:10.0:1773851897.689862:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:9.0:1773851897.689862:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 Transaction freed
00000400:00000200:10.0:1773851897.689863:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000100:00000001:8.0:1773851897.689863:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851897.689864:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000005269f40f: 2069@kfi7:2 <- 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851897.689864:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851897.689864:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851897.689865:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851897.689866:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851897.689866:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041296714752
00000020:00000001:8.0:1773851897.689867:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851897.689867:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92657
00000020:00000001:8.0:1773851897.689868:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851897.689872:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028465c05 refcount=6
00000020:00000001:8.0:1773851897.689873:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631018496 : -107123078533120 : ffff9e9276f4f000)
00000020:00000001:8.0:1773851897.689873:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631018496 : -107123078533120 : ffff9e9276f4f000)
00000100:00000001:8.0:1773851897.689875:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851897.689876:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851897.689877:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7e7683.
00000020:00000010:8.0:1773851897.689878:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851897.689879:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851897.689879:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851897.689880:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851897.689880:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851897.689881:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851897.689882:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851897.689882:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.689884:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851897.689885:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851897.689885:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851897.689885:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851897.689885:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851897.689886:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20272@kfi7, seq: 2130873
00000100:00000001:11.0:1773851897.689887:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851897.689887:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000028465c05 : new rpc_count 1
00000100:00000001:11.0:1773851897.689888:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.689888:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087765632 : -106944621785984 : ffff9ebc03cecc80)
00000100:00000040:8.0:1773851897.689889:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aea9ea08 x1858041296714752/t0(0) o400->75768b65-6687-46ef-a350-12c4b47d1494@20272@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1757-0'
00000100:00000001:8.0:1773851897.689892:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851897.689892:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851897.689893:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aea9ea08 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:75768b65-6687-46ef-a350-12c4b47d1494+6:39853:x1858041296714752:12345-20272@kfi7:400:default-tuolumne1757-0
00000100:00000200:8.0:1773851897.689895:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041296714752
00000020:00000001:8.0:1773851897.689895:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851897.689896:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851897.689896:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.689897:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851897.689898:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851897.689898:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851897.689899:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041296714752, found 0 last_xid 1858041296714751
00000020:00000001:8.0:1773851897.689900:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851897.689901:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851897.689902:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851897.689902:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.689903:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851897.689903:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851897.689904:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851897.689905:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007b77abdd.
02000000:00000001:8.0:1773851897.689905:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.689906:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.689906:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851897.689907:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183196369378, transno 0, xid 1858041296714752
00010000:00000001:8.0:1773851897.689908:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851897.689908:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aea9ea08 x1858041296714752/t0(0) o400->75768b65-6687-46ef-a350-12c4b47d1494@20272@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1757-0'
00010000:00000001:8.0:1773851897.689911:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851897.689911:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851897.689912:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=130 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851897.689913:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851897.689914:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d2db579c refcount 3 to 20272@kfi7
00000100:00000001:8.0:1773851897.689915:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805888 : -107130477745728 : ffff9e90bdede9c0)
02000000:00000001:8.0:1773851897.689915:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851897.689916:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.689917:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851897.689917:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20273@kfi7
00000400:00000010:8.0:1773851897.689918:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d2abdf16.
00000100:00000200:8.0:1773851897.689919:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041296714752, offset 224
00000400:00000200:8.0:1773851897.689920:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20273@kfi7
00000400:00000200:8.0:1773851897.689921:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:8.0:1773851897.689922:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 1
00000400:00000200:8.0:1773851897.689923:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000400:00000200:8.0:1773851897.689924:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 3
00000400:00000200:8.0:1773851897.689925:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20273@kfi7 local destination
00000400:00000200:8.0:1773851897.689927:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770266:8770266:1024:4294967295] 20273@kfi7 LPNI seq info [310733:310733:16:4294967295]
00000400:00000200:8.0:1773851897.689928:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000400:00000200:8.0:1773851897.689929:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20273@kfi7 to cpt 2
00000400:00000200:8.0:1773851897.689931:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20273@kfi7(20273@kfi7:20273@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851897.689932:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 3
00000800:00000200:8.0:1773851897.689934:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851897.689935:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851897.689937:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851897.689939:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 Using peer 20273@kfi7(0xad1)
00000800:00000200:8.0:1773851897.689941:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0xad1: rc=0
00000800:00000200:8.0:1773851897.689943:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851897.689945:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851897.689946:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d2db579c refcount 2 to 20272@kfi7
00010000:00000001:8.0:1773851897.689946:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851897.689947:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851897.689947:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851897.689948:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aea9ea08 x1858041296714752/t0(0) o400->75768b65-6687-46ef-a350-12c4b47d1494@20272@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1757-0'
00000100:00100000:8.0:1773851897.689952:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aea9ea08 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:75768b65-6687-46ef-a350-12c4b47d1494+6:39853:x1858041296714752:12345-20272@kfi7:400:default-tuolumne1757-0 Request processed in 60us (92us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851897.689955:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20272@kfi7, seq: 2130873
00000100:00000040:8.0:1773851897.689956:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028465c05 : new rpc_count 0
00000100:00000001:8.0:1773851897.689956:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851897.689957:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851897.689958:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851897.689958:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000020:00000010:8.0:1773851897.689959:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7e7683.
00000020:00000040:8.0:1773851897.689960:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000028465c05 : new refcount 5
00000100:00000001:8.0:1773851897.689961:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851897.689966:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851897.689967:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851897.689968:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20273@kfi7: PUT: OK
00000400:00000200:9.0:1773851897.689969:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d2abdf16
00000400:00000010:9.0:1773851897.689970:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d2abdf16.
00000100:00000001:9.0:1773851897.689971:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851897.689971:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851897.689972:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000427d2adb nid 20273@kfi7 refs 2
00000800:00000200:9.0:1773851897.689973:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 20273@kfi7(00000000c11af255):0x0 lsk 2770 rsk 50 tsk 0 trmk 0 tmk 0 trr 2 tta 0xad1 Transaction freed
00000800:00000200:25.0:1773851897.708832:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851897.708833:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851897.708834:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851897.708834:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851897.708835:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851897.708836:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851897.708838:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 22497@kfi7(00000000ce29b674):0x5f8 version: 2; local version 2; negotiated version: 2
00000800:00000200:26.0:1773851897.708839:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851897.708841:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 Using peer 22497@kfi7(0x5f8)
00000400:00000200:26.0:1773851897.708842:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:26.0:1773851897.708844:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22497@kfi7 : PUT - for me
00000400:00000200:25.0:1773851897.708845:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:26.0:1773851897.708846:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:26.0:1773851897.708847:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053ac7ebd nid 22497@kfi7 refs 1
00000800:00000200:25.0:1773851897.708847:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 38 bytes to peer 0x5f8: rc=0
00000400:00000200:26.0:1773851897.708849:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:26.0:1773851897.708850:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053ac7ebd nid 22497@kfi7 refs 2
00000800:00000200:25.0:1773851897.708850:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851897.708851:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000053ac7ebd nid 22497@kfi7 refs 3
00000400:00000200:26.0:1773851897.708853:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:26.0:1773851897.708854:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22497@kfi7 of length 224 into portal 12 MB=0x69b4bb3531380
00000400:00000200:26.0:1773851897.708856:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22497@kfi7 of length 224/224 into md 0x16159c9699 [64] + 39328
00000800:00000200:26.0:1773851897.708860:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851897.708864:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851897.708865:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851897.708867:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22497@kfi7: PUT: OK
00000800:00000200:25.0:1773851897.708868:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 Transaction freed
00000100:00000001:26.0:1773851897.708869:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851897.708869:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851897.708871:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a3f725d5.
00000100:00000040:26.0:1773851897.708872:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000a3f725d5 x1859599293682560 msgsize 224
00000100:00100000:26.0:1773851897.708875:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-22497@kfi7 (source: 12345-22497@kfi7)
00000100:00000001:26.0:1773851897.708877:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851897.708878:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000053ac7ebd nid 22497@kfi7 refs 2
00000100:00000001:24.0:1773851897.708879:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851897.708880:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851897.708881:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851897.708881:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851897.708882:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851897.708883:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851897.708884:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599293682560
00000020:00000001:24.0:1773851897.708885:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851897.708885:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e2432bef5
00000020:00000001:24.0:1773851897.708887:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851897.708891:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000911d9020 refcount=5
00000020:00000001:24.0:1773851897.708892:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132161045504 : -106941548506112 : ffff9ebcbafd5400)
00000020:00000001:24.0:1773851897.708894:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132161045504 : -106941548506112 : ffff9ebcbafd5400)
00000100:00000001:24.0:1773851897.708895:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851897.708896:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851897.708897:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851897.708899:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851897.708900:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000098ea6441.
00000100:00000001:24.0:1773851897.708901:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851897.708902:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851897.708903:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851897.708904:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851897.708905:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851897.708905:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.708907:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851897.708909:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851897.708909:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851897.708910:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851897.708910:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851897.708911:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22497@kfi7, seq: 2025183
00000100:00000040:24.0:1773851897.708912:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000911d9020 : new rpc_count 1
00000100:00000001:27.0:1773851897.708913:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.708913:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137189204096 : -106936520347520 : ffff9ebde6b0f080)
00000100:00000001:27.0:1773851897.708914:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851897.708915:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a3f725d5 x1859599293682560/t0(0) o400->34728edc-093c-4cd0-a230-0ca100569825@22497@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1887-0'
00000100:00000001:24.0:1773851897.708920:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851897.708920:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851897.708921:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a3f725d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:34728edc-093c-4cd0-a230-0ca100569825+5:39535:x1859599293682560:12345-22497@kfi7:400:default-tuolumne1887-0
00000100:00000200:24.0:1773851897.708924:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599293682560
00000020:00000001:24.0:1773851897.708925:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851897.708926:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851897.708927:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.708928:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851897.708928:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851897.708930:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851897.708930:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599293682560, found 0 last_xid 1859599293682559
00000020:00000001:24.0:1773851897.708934:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851897.708935:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851897.708936:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851897.708937:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.708938:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851897.708939:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851897.708940:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851897.708941:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f673831f.
02000000:00000001:24.0:1773851897.708942:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.708943:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.708944:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851897.708945:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105042018, transno 0, xid 1859599293682560
00010000:00000001:24.0:1773851897.708946:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851897.708948:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a3f725d5 x1859599293682560/t0(0) o400->34728edc-093c-4cd0-a230-0ca100569825@22497@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1887-0'
00010000:00000001:24.0:1773851897.708952:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851897.708953:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851897.708954:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=130 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851897.708955:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851897.708956:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008baeb248 refcount 3 to 22497@kfi7
00000100:00000001:24.0:1773851897.708957:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643689600 : -107157065862016 : ffff9e8a8d277480)
02000000:00000001:24.0:1773851897.708959:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851897.708959:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851897.708960:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851897.708962:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22497@kfi7
00000400:00000010:24.0:1773851897.708963:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009af8923e.
00000100:00000200:24.0:1773851897.708964:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599293682560, offset 224
00000400:00000200:24.0:1773851897.708966:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22497@kfi7
00000400:00000200:24.0:1773851897.708968:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:24.0:1773851897.708969:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000053ac7ebd nid 22497@kfi7 refs 1
00000400:00000200:24.0:1773851897.708971:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000053ac7ebd nid 22497@kfi7 refs 2
00000400:00000200:24.0:1773851897.708972:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000053ac7ebd nid 22497@kfi7 refs 3
00000400:00000200:24.0:1773851897.708974:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22497@kfi7 local destination
00000400:00000200:24.0:1773851897.708977:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770267:8770267:1024:4294967295] 22497@kfi7 LPNI seq info [5650061:5650061:16:4294967295]
00000400:00000200:24.0:1773851897.708980:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000053ac7ebd nid 22497@kfi7 refs 2
00000400:00000200:24.0:1773851897.708981:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22497@kfi7 to cpt 6
00000400:00000200:24.0:1773851897.708984:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22497@kfi7(22497@kfi7:22497@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851897.708987:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000053ac7ebd nid 22497@kfi7 refs 3
00000800:00000200:24.0:1773851897.708989:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851897.708991:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851897.708995:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851897.709000:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 Using peer 22497@kfi7(0x5f8)
00000800:00000200:24.0:1773851897.709004:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0x5f8: rc=0
00000800:00000200:24.0:1773851897.709007:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851897.709011:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851897.709012:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008baeb248 refcount 2 to 22497@kfi7
00010000:00000001:24.0:1773851897.709016:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851897.709017:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851897.709018:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851897.709019:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a3f725d5 x1859599293682560/t0(0) o400->34728edc-093c-4cd0-a230-0ca100569825@22497@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1887-0'
00000100:00100000:24.0:1773851897.709025:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a3f725d5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:34728edc-093c-4cd0-a230-0ca100569825+5:39535:x1859599293682560:12345-22497@kfi7:400:default-tuolumne1887-0 Request processed in 104us (151us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851897.709029:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22497@kfi7, seq: 2025183
00000100:00000040:24.0:1773851897.709031:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000911d9020 : new rpc_count 0
00000100:00000001:24.0:1773851897.709032:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851897.709033:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851897.709034:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851897.709035:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000098ea6441.
00000020:00000010:24.0:1773851897.709037:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851897.709039:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000911d9020 : new refcount 4
00000100:00000001:24.0:1773851897.709040:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851897.709048:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851897.709051:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851897.709053:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22497@kfi7: PUT: OK
00000400:00000200:25.0:1773851897.709054:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009af8923e
00000400:00000010:25.0:1773851897.709055:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009af8923e.
00000100:00000001:25.0:1773851897.709056:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851897.709057:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851897.709058:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000053ac7ebd nid 22497@kfi7 refs 2
00000800:00000200:25.0:1773851897.709061:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 22497@kfi7(00000000ce29b674):0x0 lsk 1529 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x5f8 Transaction freed
00000400:00000200:29.0:1773851897.737732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851897.737734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:31.0:1773851897.842891:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851897.842891:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851897.842892:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851897.842892:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:31.0:1773851897.842894:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000150f4962: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851897.842894:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:31.0:1773851897.842896:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000150f4962: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851897.842896:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 12690@kfi7(0000000035a3a1ef):0x32 version: 2; local version 2; negotiated version: 2
00000400:00000200:31.0:1773851897.842898:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12690@kfi7 to cpt 7
00000800:00000200:29.0:1773851897.842898:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 Using peer 12690@kfi7(0x32)
00000400:00000200:31.0:1773851897.842900:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12690@kfi7 : PUT - for me
00000400:00000200:29.0:1773851897.842900:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12690@kfi7 to cpt 7
00000400:00000200:31.0:1773851897.842901:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12690@kfi7 to cpt 7
00000800:00000200:29.0:1773851897.842901:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 38 bytes to peer 0x32: rc=0
00000400:00000200:31.0:1773851897.842902:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a2e4489 nid 12690@kfi7 refs 1
00000400:00000200:31.0:1773851897.842903:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12690@kfi7 to cpt 7
00000800:00000200:29.0:1773851897.842903:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851897.842904:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a2e4489 nid 12690@kfi7 refs 2
00000400:00000200:31.0:1773851897.842905:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004a2e4489 nid 12690@kfi7 refs 3
00000400:00000200:31.0:1773851897.842906:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12690@kfi7 to cpt 7
00000400:00000200:31.0:1773851897.842907:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12690@kfi7 of length 224 into portal 12 MB=0x699e0f7e96000
00000400:00000200:31.0:1773851897.842909:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12690@kfi7 of length 224/224 into md 0x77fe1859d [64] + 9048
00000800:00000200:31.0:1773851897.842911:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000150f4962: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851897.842912:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851897.842913:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12690@kfi7: PUT: OK
00000100:00000001:31.0:1773851897.842915:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851897.842915:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851897.842916:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fede61b9.
00000800:00000200:29.0:1773851897.842916:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851897.842917:0:2465875:0:(events.c:358:request_in_callback()) incoming req@00000000fede61b9 x1858041371254784 msgsize 224
00000100:00100000:31.0:1773851897.842918:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-12690@kfi7 (source: 12345-12690@kfi7)
00000100:00000001:31.0:1773851897.842920:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:29.0:1773851897.842920:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 Transaction freed
00000400:00000200:31.0:1773851897.842921:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004a2e4489 nid 12690@kfi7 refs 2
00000800:00000200:31.0:1773851897.842923:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000150f4962: 2069@kfi7:7 <- 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851897.842923:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851897.842923:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851897.842924:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851897.842925:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851897.842927:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851897.842928:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041371254784
00000020:00000001:30.0:1773851897.842929:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851897.842930:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a80
00000020:00000001:30.0:1773851897.842931:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851897.842935:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f14311c refcount=6
00000020:00000001:30.0:1773851897.842937:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627759104 : -107123081792512 : ffff9e9276c33400)
00000020:00000001:30.0:1773851897.842938:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627759104 : -107123081792512 : ffff9e9276c33400)
00000100:00000001:30.0:1773851897.842939:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851897.842944:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851897.842945:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006ed3b313.
00000020:00000010:30.0:1773851897.842947:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851897.842948:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000003057cd8b.
00000100:00000001:30.0:1773851897.842949:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851897.842950:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851897.842951:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851897.842953:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851897.842954:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851897.842955:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851897.842956:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.842958:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851897.842959:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851897.842959:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851897.842959:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851897.842960:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12690@kfi7, seq: 2055596
00000100:00000040:31.0:1773851897.842960:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f14311c : new rpc_count 1
00000100:00000001:31.0:1773851897.842961:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637034999080832 : -107038710470784 : ffff9ea61baf6780)
00000100:00000001:30.0:1773851897.842961:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851897.842962:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fede61b9 x1858041371254784/t0(0) o400->7373b1f8-4bd8-4687-986a-d643eb55ca1f@12690@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1286-0'
00000100:00000001:30.0:1773851897.842962:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.842965:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851897.842965:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851897.842966:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fede61b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:7373b1f8-4bd8-4687-986a-d643eb55ca1f+6:39742:x1858041371254784:12345-12690@kfi7:400:default-tuolumne1286-0
00000100:00000200:31.0:1773851897.842968:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041371254784
00000020:00000001:31.0:1773851897.842968:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851897.842969:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851897.842970:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.842970:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851897.842971:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851897.842972:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851897.842972:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041371254784, found 0 last_xid 1858041371254783
00000020:00000001:31.0:1773851897.842973:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851897.842974:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851897.842974:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851897.842975:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.842976:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851897.842976:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851897.842977:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851897.842977:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000243a822a.
02000000:00000001:31.0:1773851897.842978:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.842979:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.842980:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851897.842981:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915840579, transno 0, xid 1858041371254784
00010000:00000001:31.0:1773851897.842981:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851897.842982:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fede61b9 x1858041371254784/t0(0) o400->7373b1f8-4bd8-4687-986a-d643eb55ca1f@12690@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1286-0'
00010000:00000001:31.0:1773851897.842985:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851897.842985:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851897.842986:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=130 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851897.842987:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851897.842988:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003353ec52 refcount 3 to 12690@kfi7
00000100:00000001:31.0:1773851897.842988:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412881632 : -107156296669984 : ffff9e8abb0064e0)
02000000:00000001:31.0:1773851897.842989:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851897.842990:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.842990:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851897.842991:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12690@kfi7
00000400:00000010:31.0:1773851897.842992:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
00000100:00000200:31.0:1773851897.842993:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041371254784, offset 224
00000400:00000200:31.0:1773851897.842994:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12690@kfi7
00000400:00000200:31.0:1773851897.842995:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12690@kfi7 to cpt 7
00000400:00000200:31.0:1773851897.842996:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004a2e4489 nid 12690@kfi7 refs 1
00000400:00000200:31.0:1773851897.842997:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004a2e4489 nid 12690@kfi7 refs 2
00000400:00000200:31.0:1773851897.842998:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004a2e4489 nid 12690@kfi7 refs 3
00000400:00000200:31.0:1773851897.842999:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12690@kfi7 local destination
00000400:00000200:31.0:1773851897.843000:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770268:8770268:1024:4294967295] 12690@kfi7 LPNI seq info [6650016:6650016:16:4294967295]
00000400:00000200:31.0:1773851897.843002:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004a2e4489 nid 12690@kfi7 refs 2
00000400:00000200:31.0:1773851897.843003:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12690@kfi7 to cpt 7
00000400:00000200:31.0:1773851897.843004:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12690@kfi7(12690@kfi7:12690@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851897.843006:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004a2e4489 nid 12690@kfi7 refs 3
00000800:00000200:31.0:1773851897.843007:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851897.843008:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851897.843010:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851897.843013:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 Using peer 12690@kfi7(0x32)
00000800:00000200:31.0:1773851897.843016:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x32: rc=0
00000800:00000200:31.0:1773851897.843017:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851897.843019:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851897.843020:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003353ec52 refcount 2 to 12690@kfi7
00010000:00000001:31.0:1773851897.843021:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851897.843021:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.843022:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851897.843023:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fede61b9 x1858041371254784/t0(0) o400->7373b1f8-4bd8-4687-986a-d643eb55ca1f@12690@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1286-0'
00000100:00100000:31.0:1773851897.843026:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fede61b9 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:7373b1f8-4bd8-4687-986a-d643eb55ca1f+6:39742:x1858041371254784:12345-12690@kfi7:400:default-tuolumne1286-0 Request processed in 60us (108us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851897.843028:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12690@kfi7, seq: 2055596
00000100:00000040:31.0:1773851897.843028:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f14311c : new rpc_count 0
00000100:00000001:31.0:1773851897.843029:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851897.843030:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851897.843030:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000800:00000200:29.0:1773851897.843030:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851897.843031:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000003057cd8b.
00000020:00000010:31.0:1773851897.843032:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006ed3b313.
00000400:00000200:29.0:1773851897.843032:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851897.843033:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000004f14311c : new refcount 5
00000100:00000001:31.0:1773851897.843033:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851897.843033:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12690@kfi7: PUT: OK
00000400:00000200:29.0:1773851897.843034:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000400:00000010:29.0:1773851897.843034:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000100:00000001:29.0:1773851897.843035:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851897.843036:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851897.843036:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004a2e4489 nid 12690@kfi7 refs 2
00000800:00000200:29.0:1773851897.843038:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 12690@kfi7(0000000035a3a1ef):0x0 lsk 51 rsk 53 tsk 0 trmk 0 tmk 0 trr 7 tta 0x32 Transaction freed
00000800:00000200:29.0:1773851897.846652:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851897.846653:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851897.846654:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851897.846656:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851897.846658:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.846659:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13745@kfi7 : PUT - for me
00000400:00000200:29.0:1773851897.846660:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.846661:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 1
00000400:00000200:29.0:1773851897.846662:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.846663:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000400:00000200:29.0:1773851897.846664:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 3
00000400:00000200:29.0:1773851897.846664:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:29.0:1773851897.846665:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13745@kfi7 of length 224 into portal 12 MB=0x69b09adb1bd00
00000400:00000200:29.0:1773851897.846666:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13745@kfi7 of length 224/224 into md 0x77fe1859d [64] + 9272
00000800:00000200:29.0:1773851897.846668:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851897.846670:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851897.846673:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13745@kfi7: PUT: OK
00000100:00000001:29.0:1773851897.846674:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851897.846675:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851897.846675:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000465eff21.
00000100:00000040:29.0:1773851897.846676:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000465eff21 x1859315731381504 msgsize 224
00000100:00100000:29.0:1773851897.846678:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13745@kfi7 (source: 12345-13745@kfi7)
00000100:00000001:29.0:1773851897.846679:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851897.846680:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851897.846680:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
02000000:00000001:31.0:1773851897.846681:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851897.846681:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851897.846681:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851897.846682:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851897.846682:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851897.846683:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315731381504
00000020:00000001:31.0:1773851897.846683:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851897.846684:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ba6
00000020:00000001:31.0:1773851897.846684:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851897.846687:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8dc6cce refcount=6
00000020:00000001:31.0:1773851897.846688:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628036608 : -107123081515008 : ffff9e9276c77000)
00000020:00000001:31.0:1773851897.846688:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628036608 : -107123081515008 : ffff9e9276c77000)
00000100:00000001:31.0:1773851897.846689:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851897.846690:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851897.846691:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000790a35bc.
00000020:00000010:31.0:1773851897.846691:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851897.846692:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851897.846693:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851897.846693:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851897.846694:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.846695:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851897.846695:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851897.846696:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.846696:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851897.846697:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851897.846698:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851897.846698:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851897.846698:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851897.846699:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13745@kfi7, seq: 2055597
00000100:00000040:31.0:1773851897.846699:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8dc6cce : new rpc_count 1
00000100:00000001:30.0:1773851897.846699:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.846700:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337953536 : -106936371598080 : ffff9ebdef8ead00)
00000100:00000001:30.0:1773851897.846700:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851897.846701:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000465eff21 x1859315731381504/t0(0) o400->4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601@13745@kfi7:685/0 lens 224/0 e 0 to 0 dl 1773852045 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1342-0'
00000100:00000001:31.0:1773851897.846703:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851897.846704:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851897.846704:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000465eff21 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601+6:39748:x1859315731381504:12345-13745@kfi7:400:default-tuolumne1342-0
00000100:00000200:31.0:1773851897.846705:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315731381504
00000020:00000001:31.0:1773851897.846706:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851897.846706:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851897.846707:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.846707:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851897.846708:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851897.846709:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851897.846709:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315731381504, found 0 last_xid 1859315731381503
00000020:00000001:31.0:1773851897.846710:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851897.846710:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851897.846711:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851897.846711:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.846712:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851897.846712:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851897.846713:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851897.846715:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008e9f7e00.
02000000:00000001:31.0:1773851897.846715:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.846716:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.846716:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851897.846717:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104890043, transno 0, xid 1859315731381504
00010000:00000001:31.0:1773851897.846717:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851897.846718:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000465eff21 x1859315731381504/t0(0) o400->4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601@13745@kfi7:685/0 lens 224/224 e 0 to 0 dl 1773852045 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1342-0'
00010000:00000001:31.0:1773851897.846721:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851897.846721:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851897.846722:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=130 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851897.846723:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851897.846723:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b9edfa32 refcount 3 to 13745@kfi7
00000100:00000001:31.0:1773851897.846724:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091269184 : -107152618282432 : ffff9e8b96402240)
02000000:00000001:31.0:1773851897.846727:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851897.846728:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851897.846728:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851897.846729:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13745@kfi7
00000400:00000010:31.0:1773851897.846730:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d81a04c.
00000100:00000200:31.0:1773851897.846730:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315731381504, offset 224
00000400:00000200:31.0:1773851897.846732:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13745@kfi7
00000400:00000200:31.0:1773851897.846733:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:31.0:1773851897.846734:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 1
00000400:00000200:31.0:1773851897.846734:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000400:00000200:31.0:1773851897.846736:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 3
00000400:00000200:31.0:1773851897.846737:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13745@kfi7 local destination
00000400:00000200:31.0:1773851897.846738:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770269:8770269:1024:4294967295] 13745@kfi7 LPNI seq info [13502175:13502175:16:4294967295]
00000400:00000200:31.0:1773851897.846739:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000400:00000200:31.0:1773851897.846740:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13745@kfi7 to cpt 7
00000400:00000200:31.0:1773851897.846742:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13745@kfi7(13745@kfi7:13745@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851897.846743:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 3
00000800:00000200:31.0:1773851897.846744:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851897.846745:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851897.846747:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851897.846749:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000526 Using peer 13745@kfi7(0x100000000000526)
00000800:00000200:31.0:1773851897.846752:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x100000000000526: rc=0
00000800:00000200:31.0:1773851897.846753:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000526 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851897.846755:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851897.846756:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b9edfa32 refcount 2 to 13745@kfi7
00010000:00000001:31.0:1773851897.846756:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851897.846756:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851897.846757:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851897.846758:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000465eff21 x1859315731381504/t0(0) o400->4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601@13745@kfi7:685/0 lens 224/224 e 0 to 0 dl 1773852045 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1342-0'
00000100:00100000:31.0:1773851897.846761:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000465eff21 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:4b66bb8b-f2f8-42ed-8e9b-b97e43ab4601+6:39748:x1859315731381504:12345-13745@kfi7:400:default-tuolumne1342-0 Request processed in 57us (83us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851897.846763:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13745@kfi7, seq: 2055597
00000100:00000040:31.0:1773851897.846763:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8dc6cce : new rpc_count 0
00000100:00000001:31.0:1773851897.846764:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851897.846764:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851897.846765:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000800:00000200:29.0:1773851897.846765:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000526 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851897.846766:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000020:00000010:31.0:1773851897.846766:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000790a35bc.
00000020:00000040:31.0:1773851897.846767:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000a8dc6cce : new refcount 5
00000400:00000200:29.0:1773851897.846767:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851897.846768:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851897.846768:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13745@kfi7: PUT: OK
00000400:00000200:29.0:1773851897.846769:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d81a04c
00000400:00000010:29.0:1773851897.846769:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d81a04c.
00000100:00000001:29.0:1773851897.846770:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851897.846770:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851897.846771:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4213ae5 nid 13745@kfi7 refs 2
00000800:00000200:29.0:1773851897.846772:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 13745@kfi7(00000000911d20f0):0x0 lsk 1319 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000526 Transaction freed
00000800:00000200:13.0:1773851897.866016:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851897.866018:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851897.866019:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851897.866022:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851897.866024:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26161@kfi7 to cpt 3
00000400:00000200:13.0:1773851897.866025:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26161@kfi7 : PUT - for me
00000400:00000200:13.0:1773851897.866026:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26161@kfi7 to cpt 3
00000400:00000200:13.0:1773851897.866028:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e65e0bdf nid 26161@kfi7 refs 1
00000400:00000200:13.0:1773851897.866029:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26161@kfi7 to cpt 3
00000400:00000200:13.0:1773851897.866030:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e65e0bdf nid 26161@kfi7 refs 2
00000400:00000200:13.0:1773851897.866030:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e65e0bdf nid 26161@kfi7 refs 3
00000400:00000200:13.0:1773851897.866031:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26353@kfi7 to cpt 5
00000400:00000200:13.0:1773851897.866032:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26353@kfi7 of length 224 into portal 12 MB=0x69b4c6dea0500
00000400:00000200:13.0:1773851897.866034:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26353@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 58328
00000800:00000200:13.0:1773851897.866036:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851897.866038:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851897.866039:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26161@kfi7: PUT: OK
00000100:00000001:13.0:1773851897.866041:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851897.866041:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851897.866043:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002bcd62db.
00000100:00000040:13.0:1773851897.866043:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000002bcd62db x1859602424136960 msgsize 224
00000100:00100000:13.0:1773851897.866045:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-26353@kfi7 (source: 12345-26161@kfi7)
00000100:00000001:13.0:1773851897.866046:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851897.866048:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e65e0bdf nid 26161@kfi7 refs 2
00000100:00000001:12.0:1773851897.866048:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851897.866049:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851897.866049:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851897.866050:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851897.866050:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851897.866051:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851897.866052:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602424136960
00000020:00000001:12.0:1773851897.866053:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851897.866053:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8c7ca
00000020:00000001:12.0:1773851897.866054:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851897.866058:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002d3610f5 refcount=5
00000020:00000001:12.0:1773851897.866059:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107016054784 : -106966693496832 : ffff9eb6e03b3800)
00000020:00000001:12.0:1773851897.866059:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107016054784 : -106966693496832 : ffff9eb6e03b3800)
00000100:00000001:12.0:1773851897.866061:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851897.866062:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851897.866063:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000760fdc85.
00000020:00000010:12.0:1773851897.866064:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851897.866064:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000068cea08.
00000100:00000001:12.0:1773851897.866065:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851897.866066:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851897.866066:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851897.866068:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851897.866068:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851897.866069:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851897.866070:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851897.866071:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851897.866071:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851897.866072:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851897.866072:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851897.866073:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26353@kfi7, seq: 2289932
00000100:00000001:15.0:1773851897.866074:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851897.866074:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851897.866074:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002d3610f5 : new rpc_count 1
00000100:00000001:12.0:1773851897.866074:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636950415879424 : -107123293672192 : ffff9e926a222d00)
00000100:00000040:12.0:1773851897.866076:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002bcd62db x1859602424136960/t0(0) o400->af3cd53c-010a-4afb-aac0-c8b56dd3bcd7@26353@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2125-0'
00000100:00000001:12.0:1773851897.866078:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851897.866078:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851897.866080:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002bcd62db pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:af3cd53c-010a-4afb-aac0-c8b56dd3bcd7+5:39644:x1859602424136960:12345-26353@kfi7:400:default-tuolumne2125-0
00000100:00000200:12.0:1773851897.866081:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602424136960
00000020:00000001:12.0:1773851897.866081:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851897.866082:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851897.866083:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.866084:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851897.866084:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851897.866085:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851897.866085:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602424136960, found 0 last_xid 1859602424136959
00000020:00000001:12.0:1773851897.866086:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851897.866087:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851897.866088:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851897.866088:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.866089:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851897.866090:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851897.866090:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851897.866091:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b04d2770.
02000000:00000001:12.0:1773851897.866092:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851897.866092:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.866093:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851897.866093:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013958208, transno 0, xid 1859602424136960
00010000:00000001:12.0:1773851897.866094:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851897.866095:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002bcd62db x1859602424136960/t0(0) o400->af3cd53c-010a-4afb-aac0-c8b56dd3bcd7@26353@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2125-0'
00010000:00000001:12.0:1773851897.866097:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851897.866098:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851897.866099:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=130 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851897.866100:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851897.866100:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c2e14576 refcount 3 to 26353@kfi7
00000100:00000001:12.0:1773851897.866101:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095648 : -107139307455968 : ffff9e8eafa33a20)
02000000:00000001:12.0:1773851897.866102:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851897.866102:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851897.866103:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851897.866104:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26161@kfi7
00000400:00000010:12.0:1773851897.866105:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000072e7751.
00000100:00000200:12.0:1773851897.866106:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602424136960, offset 224
00000400:00000200:12.0:1773851897.866107:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26161@kfi7
00000400:00000200:12.0:1773851897.866108:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26161@kfi7 to cpt 3
00000400:00000200:12.0:1773851897.866109:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e65e0bdf nid 26161@kfi7 refs 1
00000400:00000200:12.0:1773851897.866110:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e65e0bdf nid 26161@kfi7 refs 2
00000400:00000200:12.0:1773851897.866111:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e65e0bdf nid 26161@kfi7 refs 3
00000400:00000200:12.0:1773851897.866112:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26161@kfi7 local destination
00000400:00000200:12.0:1773851897.866114:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770270:8770270:1024:4294967295] 26161@kfi7 LPNI seq info [6432696:6432696:16:4294967295]
00000400:00000200:12.0:1773851897.866115:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e65e0bdf nid 26161@kfi7 refs 2
00000400:00000200:12.0:1773851897.866116:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26161@kfi7 to cpt 3
00000400:00000200:12.0:1773851897.866118:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26161@kfi7(26161@kfi7:26161@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851897.866119:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e65e0bdf nid 26161@kfi7 refs 3
00000800:00000200:12.0:1773851897.866121:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851897.866122:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851897.866124:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851897.866126:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000794 Using peer 26161@kfi7(0x100000000000794)
00000800:00000200:12.0:1773851897.866129:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0x100000000000794: rc=0
00000800:00000200:12.0:1773851897.866131:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000794 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851897.866133:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851897.866133:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c2e14576 refcount 2 to 26353@kfi7
00010000:00000001:12.0:1773851897.866134:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851897.866134:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.866135:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851897.866136:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002bcd62db x1859602424136960/t0(0) o400->af3cd53c-010a-4afb-aac0-c8b56dd3bcd7@26353@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2125-0'
00000100:00100000:12.0:1773851897.866140:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002bcd62db pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:af3cd53c-010a-4afb-aac0-c8b56dd3bcd7+5:39644:x1859602424136960:12345-26353@kfi7:400:default-tuolumne2125-0 Request processed in 61us (96us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851897.866142:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26353@kfi7, seq: 2289932
00000100:00000040:12.0:1773851897.866143:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002d3610f5 : new rpc_count 0
00000100:00000001:12.0:1773851897.866144:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851897.866144:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851897.866145:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851897.866145:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000068cea08.
00000020:00000010:12.0:1773851897.866146:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000760fdc85.
00000020:00000040:12.0:1773851897.866147:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000002d3610f5 : new refcount 4
00000100:00000001:12.0:1773851897.866148:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851897.866154:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000794 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851897.866156:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851897.866157:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26161@kfi7: PUT: OK
00000400:00000200:13.0:1773851897.866158:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000072e7751
00000400:00000010:13.0:1773851897.866158:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000072e7751.
00000100:00000001:13.0:1773851897.866159:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851897.866160:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851897.866161:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e65e0bdf nid 26161@kfi7 refs 2
00000800:00000200:13.0:1773851897.866162:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 26161@kfi7(0000000029954260):0x0 lsk 1941 rsk 11 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000794 Transaction freed
00000800:00000200:13.0:1773851897.871497:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851897.871497:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851897.871499:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851897.871501:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851897.871502:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:13.0:1773851897.871503:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25106@kfi7 : PUT - for me
00000400:00000200:13.0:1773851897.871504:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:13.0:1773851897.871505:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 1
00000400:00000200:13.0:1773851897.871506:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:13.0:1773851897.871507:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000400:00000200:13.0:1773851897.871508:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 3
00000400:00000200:13.0:1773851897.871509:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25299@kfi7 to cpt 0
00000400:00000200:13.0:1773851897.871510:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25299@kfi7 of length 224 into portal 12 MB=0x69b1adc408140
00000400:00000200:13.0:1773851897.871511:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25299@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 58552
00000800:00000200:13.0:1773851897.871512:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851897.871514:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851897.871515:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25106@kfi7: PUT: OK
00000100:00000001:13.0:1773851897.871516:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851897.871516:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851897.871517:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000003aa910e.
00000100:00000040:13.0:1773851897.871518:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000003aa910e x1859389526933824 msgsize 224
00000100:00100000:13.0:1773851897.871519:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25299@kfi7 (source: 12345-25106@kfi7)
00000100:00000001:13.0:1773851897.871520:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851897.871521:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000800:00000200:13.0:1773851897.871522:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851897.871523:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851897.871524:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851897.871524:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851897.871525:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851897.871526:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851897.871527:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859389526933824
00000020:00000001:12.0:1773851897.871528:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851897.871528:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079ca4369e6
00000020:00000001:12.0:1773851897.871529:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851897.871535:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002bff92cc refcount=8
00000020:00000001:12.0:1773851897.871536:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636949100275712 : -107124609275904 : ffff9e921bb7a800)
00000020:00000001:12.0:1773851897.871537:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636949100275712 : -107124609275904 : ffff9e921bb7a800)
00000100:00000001:12.0:1773851897.871538:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851897.871540:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851897.871541:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000760fdc85.
00000020:00000010:12.0:1773851897.871542:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851897.871543:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000068cea08.
00000100:00000001:12.0:1773851897.871544:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851897.871545:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851897.871546:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851897.871547:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851897.871548:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851897.871548:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851897.871550:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851897.871551:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851897.871552:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851897.871552:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:15.0:1773851897.871553:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851897.871554:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25299@kfi7, seq: 2289933
00000100:00000001:15.0:1773851897.871555:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851897.871555:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002bff92cc : new rpc_count 1
00000100:00000001:15.0:1773851897.871556:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851897.871556:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132319184256 : -106941390367360 : ffff9ebcc46a5580)
00000100:00000040:12.0:1773851897.871557:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000003aa910e x1859389526933824/t0(0) o400->f4e036ba-28ac-46b3-a468-1d618a71f99a@25299@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2069-0'
00000100:00000001:12.0:1773851897.871562:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851897.871563:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851897.871564:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000003aa910e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f4e036ba-28ac-46b3-a468-1d618a71f99a+8:39902:x1859389526933824:12345-25299@kfi7:400:default-tuolumne2069-0
00000100:00000200:12.0:1773851897.871566:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859389526933824
00000020:00000001:12.0:1773851897.871567:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851897.871568:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851897.871569:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.871570:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851897.871571:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851897.871572:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851897.871572:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859389526933824, found 0 last_xid 1859389526933823
00000020:00000001:12.0:1773851897.871574:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851897.871574:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851897.871575:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851897.871576:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.871577:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851897.871578:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851897.871578:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851897.871580:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006535740c.
02000000:00000001:12.0:1773851897.871581:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851897.871582:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.871583:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851897.871584:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182684228501, transno 0, xid 1859389526933824
00010000:00000001:12.0:1773851897.871585:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851897.871586:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000003aa910e x1859389526933824/t0(0) o400->f4e036ba-28ac-46b3-a468-1d618a71f99a@25299@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2069-0'
00010000:00000001:12.0:1773851897.871590:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851897.871591:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851897.871592:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=130 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851897.871593:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851897.871594:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b2c786c refcount 3 to 25299@kfi7
00000100:00000001:12.0:1773851897.871595:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958444384 : -107146751107232 : ffff9e8cf3f61f60)
02000000:00000001:12.0:1773851897.871596:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851897.871597:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851897.871598:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851897.871600:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25106@kfi7
00000400:00000010:12.0:1773851897.871601:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000064f2b75b.
00000100:00000200:12.0:1773851897.871602:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859389526933824, offset 224
00000400:00000200:12.0:1773851897.871604:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25106@kfi7
00000400:00000200:12.0:1773851897.871605:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:12.0:1773851897.871607:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 1
00000400:00000200:12.0:1773851897.871608:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000400:00000200:12.0:1773851897.871610:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 3
00000400:00000200:12.0:1773851897.871612:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25106@kfi7 local destination
00000400:00000200:12.0:1773851897.871614:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770271:8770271:1024:4294967295] 25106@kfi7 LPNI seq info [9309573:9309573:16:4294967295]
00000400:00000200:12.0:1773851897.871616:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000400:00000200:12.0:1773851897.871617:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25106@kfi7 to cpt 3
00000400:00000200:12.0:1773851897.871620:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25106@kfi7(25106@kfi7:25106@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851897.871622:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 3
00000800:00000200:12.0:1773851897.871625:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851897.871626:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851897.871630:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851897.871633:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd17 Using peer 25106@kfi7(0xd17)
00000800:00000200:12.0:1773851897.871638:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0xd17: rc=0
00000800:00000200:12.0:1773851897.871640:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd17 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851897.871643:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851897.871644:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b2c786c refcount 2 to 25299@kfi7
00010000:00000001:12.0:1773851897.871645:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851897.871646:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851897.871647:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851897.871650:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000003aa910e x1859389526933824/t0(0) o400->f4e036ba-28ac-46b3-a468-1d618a71f99a@25299@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2069-0'
00000100:00100000:12.0:1773851897.871660:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000003aa910e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f4e036ba-28ac-46b3-a468-1d618a71f99a+8:39902:x1859389526933824:12345-25299@kfi7:400:default-tuolumne2069-0 Request processed in 97us (141us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851897.871664:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25299@kfi7, seq: 2289933
00000100:00000040:12.0:1773851897.871665:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002bff92cc : new rpc_count 0
00000100:00000001:12.0:1773851897.871666:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851897.871667:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851897.871668:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851897.871669:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000068cea08.
00000020:00000010:12.0:1773851897.871670:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000760fdc85.
00000020:00000040:12.0:1773851897.871671:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000002bff92cc : new refcount 7
00000100:00000001:12.0:1773851897.871672:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851897.871678:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd17 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851897.871680:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851897.871681:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25106@kfi7: PUT: OK
00000400:00000200:13.0:1773851897.871682:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000064f2b75b
00000400:00000010:13.0:1773851897.871683:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000064f2b75b.
00000100:00000001:13.0:1773851897.871683:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851897.871684:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851897.871685:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e9069901 nid 25106@kfi7 refs 2
00000800:00000200:13.0:1773851897.871686:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 25106@kfi7(00000000e8335034):0x0 lsk 3352 rsk 18 tsk 0 trmk 0 tmk 0 trr 3 tta 0xd17 Transaction freed
00000800:00000200:9.0:1773851897.881154:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851897.881155:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851897.881156:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851897.881159:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851897.881161:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:9.0:1773851897.881162:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20705@kfi7 : PUT - for me
00000400:00000200:9.0:1773851897.881163:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:9.0:1773851897.881164:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 1
00000400:00000200:9.0:1773851897.881165:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:9.0:1773851897.881166:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000400:00000200:9.0:1773851897.881166:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 3
00000400:00000200:9.0:1773851897.881168:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20704@kfi7 to cpt 7
00000400:00000200:9.0:1773851897.881168:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20704@kfi7 of length 224 into portal 12 MB=0x69b17134d2200
00000400:00000200:9.0:1773851897.881169:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20704@kfi7 of length 224/224 into md 0x78146ce49 [64] + 162840
00000800:00000200:9.0:1773851897.881171:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851897.881173:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851897.881174:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20705@kfi7: PUT: OK
00000100:00000001:9.0:1773851897.881175:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851897.881175:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851897.881176:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000014929c9b.
00000100:00000040:9.0:1773851897.881177:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000014929c9b x1859373270639104 msgsize 224
00000100:00100000:9.0:1773851897.881178:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20704@kfi7 (source: 12345-20705@kfi7)
00000100:00000001:9.0:1773851897.881179:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851897.881180:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000800:00000200:9.0:1773851897.881181:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851897.881181:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851897.881181:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851897.881182:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851897.881182:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851897.881183:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851897.881184:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373270639104
00000020:00000001:8.0:1773851897.881184:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851897.881185:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793afc81e6
00000020:00000001:8.0:1773851897.881185:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851897.881188:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bebf7857 refcount=5
00000020:00000001:8.0:1773851897.881188:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934554777600 : -107139154774016 : ffff9e8eb8bcf800)
00000020:00000001:8.0:1773851897.881189:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934554777600 : -107139154774016 : ffff9e8eb8bcf800)
00000100:00000001:8.0:1773851897.881190:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851897.881191:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851897.881192:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef7e7683.
00000020:00000010:8.0:1773851897.881192:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851897.881193:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000091cd0944.
00000100:00000001:8.0:1773851897.881194:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851897.881195:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851897.881195:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851897.881196:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851897.881196:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851897.881197:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851897.881198:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851897.881199:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851897.881199:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851897.881200:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851897.881200:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851897.881201:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20704@kfi7, seq: 2130874
00000100:00000040:11.0:1773851897.881202:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bebf7857 : new rpc_count 1
00000100:00000001:8.0:1773851897.881202:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.881203:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609031680 : -107064100519936 : ffff9ea032520000)
00000100:00000001:8.0:1773851897.881203:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851897.881205:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000014929c9b x1859373270639104/t0(0) o400->ad032a7d-253f-4f7b-b233-38716bed026d@20704@kfi7:624/0 lens 224/0 e 0 to 0 dl 1773851984 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1775-0'
00000100:00000001:11.0:1773851897.881208:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851897.881209:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851897.881210:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000014929c9b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ad032a7d-253f-4f7b-b233-38716bed026d+5:39859:x1859373270639104:12345-20704@kfi7:400:default-tuolumne1775-0
00000100:00000200:11.0:1773851897.881211:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373270639104
00000020:00000001:11.0:1773851897.881212:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851897.881213:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851897.881213:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.881214:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851897.881214:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851897.881215:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851897.881216:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373270639104, found 0 last_xid 1859373270639103
00000020:00000001:11.0:1773851897.881217:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851897.881217:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851897.881218:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851897.881218:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.881219:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851897.881220:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851897.881220:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851897.881221:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000089741d53.
02000000:00000001:11.0:1773851897.881222:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.881223:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.881223:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851897.881224:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692330, transno 0, xid 1859373270639104
00010000:00000001:11.0:1773851897.881225:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851897.881226:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000014929c9b x1859373270639104/t0(0) o400->ad032a7d-253f-4f7b-b233-38716bed026d@20704@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1775-0'
00010000:00000001:11.0:1773851897.881229:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851897.881229:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851897.881230:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=130 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851897.881232:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851897.881232:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d876e8bb refcount 3 to 20704@kfi7
00000100:00000001:11.0:1773851897.881233:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803872 : -107130477747744 : ffff9e90bdede1e0)
02000000:00000001:11.0:1773851897.881234:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851897.881235:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851897.881235:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851897.881236:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20705@kfi7
00000400:00000010:11.0:1773851897.881237:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005f852466.
00000100:00000200:11.0:1773851897.881238:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373270639104, offset 224
00000400:00000200:11.0:1773851897.881239:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20705@kfi7
00000400:00000200:11.0:1773851897.881240:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:11.0:1773851897.881241:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 1
00000400:00000200:11.0:1773851897.881242:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000400:00000200:11.0:1773851897.881243:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 3
00000400:00000200:11.0:1773851897.881245:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20705@kfi7 local destination
00000400:00000200:11.0:1773851897.881246:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770272:8770272:1024:4294967295] 20705@kfi7 LPNI seq info [3858709:3858709:16:4294967295]
00000400:00000200:11.0:1773851897.881248:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000400:00000200:11.0:1773851897.881248:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20705@kfi7 to cpt 2
00000400:00000200:11.0:1773851897.881250:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20705@kfi7(20705@kfi7:20705@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851897.881252:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 3
00000800:00000200:11.0:1773851897.881253:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851897.881255:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851897.881257:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851897.881260:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0xd50 Using peer 20705@kfi7(0xd50)
00000800:00000200:11.0:1773851897.881263:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0xd50: rc=0
00000800:00000200:11.0:1773851897.881265:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0xd50 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851897.881267:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851897.881268:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d876e8bb refcount 2 to 20704@kfi7
00010000:00000001:11.0:1773851897.881269:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851897.881269:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851897.881270:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851897.881271:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000014929c9b x1859373270639104/t0(0) o400->ad032a7d-253f-4f7b-b233-38716bed026d@20704@kfi7:624/0 lens 224/224 e 0 to 0 dl 1773851984 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1775-0'
00000100:00100000:11.0:1773851897.881274:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000014929c9b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ad032a7d-253f-4f7b-b233-38716bed026d+5:39859:x1859373270639104:12345-20704@kfi7:400:default-tuolumne1775-0 Request processed in 65us (97us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851897.881277:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20704@kfi7, seq: 2130874
00000800:00000200:9.0:1773851897.881277:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0xd50 TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851897.881278:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bebf7857 : new rpc_count 0
00000100:00000001:11.0:1773851897.881278:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851897.881278:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851897.881279:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851897.881279:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20705@kfi7: PUT: OK
00000020:00000010:11.0:1773851897.881280:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000400:00000200:9.0:1773851897.881280:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005f852466
00000020:00000010:11.0:1773851897.881281:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000091cd0944.
00000400:00000010:9.0:1773851897.881281:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005f852466.
00000020:00000010:11.0:1773851897.881282:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef7e7683.
00000020:00000040:11.0:1773851897.881282:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000bebf7857 : new refcount 4
00000100:00000001:9.0:1773851897.881282:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851897.881282:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:11.0:1773851897.881283:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851897.881283:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005c92f949 nid 20705@kfi7 refs 2
00000800:00000200:9.0:1773851897.881284:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 20705@kfi7(00000000eb9181b2):0x0 lsk 3409 rsk 42 tsk 0 trmk 0 tmk 0 trr 2 tta 0xd50 Transaction freed
00000800:00000200:17.0:1773851897.926542:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851897.926543:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851897.926544:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851897.926547:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851897.926549:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16849@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.926550:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16849@kfi7 : PUT - for me
00000400:00000200:17.0:1773851897.926551:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16849@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.926552:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b400d0c0 nid 16849@kfi7 refs 1
00000400:00000200:17.0:1773851897.926553:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16849@kfi7 to cpt 4
00000400:00000200:17.0:1773851897.926553:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b400d0c0 nid 16849@kfi7 refs 2
00000400:00000200:17.0:1773851897.926554:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b400d0c0 nid 16849@kfi7 refs 3
00000400:00000200:17.0:1773851897.926555:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16848@kfi7 to cpt 1
00000400:00000200:17.0:1773851897.926556:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16848@kfi7 of length 224 into portal 12 MB=0x699e132886280
00000400:00000200:17.0:1773851897.926557:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16848@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 46352
00000800:00000200:17.0:1773851897.926559:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851897.926561:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851897.926562:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16849@kfi7: PUT: OK
00000100:00000001:17.0:1773851897.926563:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851897.926563:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851897.926565:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000163ffc76.
00000100:00000040:17.0:1773851897.926565:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000163ffc76 x1858042354754176 msgsize 224
00000100:00100000:17.0:1773851897.926566:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16848@kfi7 (source: 12345-16849@kfi7)
00000100:00000001:17.0:1773851897.926568:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851897.926569:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b400d0c0 nid 16849@kfi7 refs 2
00000100:00000001:19.0:1773851897.926570:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851897.926570:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851897.926571:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851897.926572:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851897.926573:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851897.926575:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851897.926576:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042354754176
00000020:00000001:19.0:1773851897.926577:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851897.926578:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920fb
00000020:00000001:19.0:1773851897.926579:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851897.926582:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002143a188 refcount=7
00000020:00000001:19.0:1773851897.926583:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629506048 : -107123080045568 : ffff9e9276dddc00)
00000020:00000001:19.0:1773851897.926585:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629506048 : -107123080045568 : ffff9e9276dddc00)
00000100:00000001:19.0:1773851897.926586:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851897.926588:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851897.926589:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851897.926591:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851897.926592:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bdd5777c.
00000100:00000001:19.0:1773851897.926594:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851897.926594:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851897.926595:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851897.926597:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851897.926597:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851897.926598:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851897.926600:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851897.926601:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851897.926602:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851897.926602:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851897.926602:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851897.926603:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16848@kfi7, seq: 2156431
00000100:00000001:19.0:1773851897.926604:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851897.926604:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002143a188 : new rpc_count 1
00000100:00000001:19.0:1773851897.926605:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851897.926605:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794774272 : -107029914777344 : ffff9ea827f30900)
00000100:00000040:16.0:1773851897.926607:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000163ffc76 x1858042354754176/t0(0) o400->eab02ba2-5921-4459-99e4-e5e71ebc6260@16848@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1537-0'
00000100:00000001:16.0:1773851897.926609:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851897.926610:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851897.926611:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000163ffc76 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:eab02ba2-5921-4459-99e4-e5e71ebc6260+7:39636:x1858042354754176:12345-16848@kfi7:400:default-tuolumne1537-0
00000100:00000200:16.0:1773851897.926612:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042354754176
00000020:00000001:16.0:1773851897.926613:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851897.926614:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851897.926614:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851897.926615:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851897.926616:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851897.926617:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851897.926617:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042354754176, found 0 last_xid 1858042354754175
00000020:00000001:16.0:1773851897.926618:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851897.926619:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851897.926619:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851897.926620:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851897.926621:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851897.926621:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851897.926622:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851897.926622:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ae1ca5c8.
02000000:00000001:16.0:1773851897.926623:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851897.926624:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851897.926624:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851897.926625:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255848119, transno 0, xid 1858042354754176
00010000:00000001:16.0:1773851897.926627:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851897.926627:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000163ffc76 x1858042354754176/t0(0) o400->eab02ba2-5921-4459-99e4-e5e71ebc6260@16848@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1537-0'
00010000:00000001:16.0:1773851897.926630:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851897.926631:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851897.926631:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=130 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851897.926633:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851897.926633:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c10a5e1c refcount 3 to 16848@kfi7
00000100:00000001:16.0:1773851897.926634:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412192 : -107145304139424 : ffff9e8d4a351960)
02000000:00000001:16.0:1773851897.926635:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851897.926635:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851897.926636:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851897.926637:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16849@kfi7
00000400:00000010:16.0:1773851897.926638:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003cf15531.
00000100:00000200:16.0:1773851897.926639:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042354754176, offset 224
00000400:00000200:16.0:1773851897.926640:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16849@kfi7
00000400:00000200:16.0:1773851897.926641:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16849@kfi7 to cpt 4
00000400:00000200:16.0:1773851897.926642:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b400d0c0 nid 16849@kfi7 refs 1
00000400:00000200:16.0:1773851897.926643:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b400d0c0 nid 16849@kfi7 refs 2
00000400:00000200:16.0:1773851897.926645:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b400d0c0 nid 16849@kfi7 refs 3
00000400:00000200:16.0:1773851897.926646:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16849@kfi7 local destination
00000400:00000200:16.0:1773851897.926647:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770273:8770273:1024:4294967295] 16849@kfi7 LPNI seq info [770151:770151:16:4294967295]
00000400:00000200:16.0:1773851897.926648:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b400d0c0 nid 16849@kfi7 refs 2
00000400:00000200:16.0:1773851897.926649:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16849@kfi7 to cpt 4
00000400:00000200:16.0:1773851897.926651:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16849@kfi7(16849@kfi7:16849@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851897.926652:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b400d0c0 nid 16849@kfi7 refs 3
00000800:00000200:16.0:1773851897.926654:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851897.926655:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851897.926657:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851897.926661:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cd6 Using peer 16849@kfi7(0x100000000000cd6)
00000800:00000200:16.0:1773851897.926665:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0x100000000000cd6: rc=0
00000800:00000200:16.0:1773851897.926667:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cd6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851897.926669:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851897.926670:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c10a5e1c refcount 2 to 16848@kfi7
00010000:00000001:16.0:1773851897.926670:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851897.926671:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851897.926672:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851897.926672:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000163ffc76 x1858042354754176/t0(0) o400->eab02ba2-5921-4459-99e4-e5e71ebc6260@16848@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1537-0'
00000100:00100000:16.0:1773851897.926677:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000163ffc76 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:eab02ba2-5921-4459-99e4-e5e71ebc6260+7:39636:x1858042354754176:12345-16848@kfi7:400:default-tuolumne1537-0 Request processed in 66us (111us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851897.926679:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16848@kfi7, seq: 2156431
00000100:00000040:16.0:1773851897.926680:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002143a188 : new rpc_count 0
00000100:00000001:16.0:1773851897.926681:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851897.926682:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851897.926682:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:16.0:1773851897.926683:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bdd5777c.
00000020:00000010:16.0:1773851897.926684:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000020:00000040:16.0:1773851897.926685:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000002143a188 : new refcount 6
00000100:00000001:16.0:1773851897.926685:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851897.926692:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cd6 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851897.926694:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851897.926696:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16849@kfi7: PUT: OK
00000400:00000200:17.0:1773851897.926697:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003cf15531
00000400:00000010:17.0:1773851897.926697:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003cf15531.
00000100:00000001:17.0:1773851897.926698:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851897.926699:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851897.926700:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b400d0c0 nid 16849@kfi7 refs 2
00000800:00000200:17.0:1773851897.926701:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16849@kfi7(0000000045c297dd):0x0 lsk 3287 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cd6 Transaction freed
00010000:00000001:2.0:1773851897.993730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851897.993732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851897.993733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851897.993734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851897.993736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851897.993737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851897.993737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851897.993738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851897.993739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851897.993744:0:937840:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851897.993744:0:937840:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851897.993745:0:937840:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851898.089589:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851898.089590:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851898.089591:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851898.089593:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851898.089596:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.089597:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21921@kfi7 : PUT - for me
00000400:00000200:25.0:1773851898.089598:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.089598:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 1
00000400:00000200:25.0:1773851898.089599:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.089600:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000400:00000200:25.0:1773851898.089601:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 3
00000400:00000200:25.0:1773851898.089602:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21920@kfi7 to cpt 3
00000400:00000200:25.0:1773851898.089603:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21920@kfi7 of length 224 into portal 12 MB=0x699e095f3f240
00000400:00000200:25.0:1773851898.089604:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21920@kfi7 of length 224/224 into md 0x16159c9699 [64] + 39552
00000800:00000200:25.0:1773851898.089606:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851898.089608:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851898.089608:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21921@kfi7: PUT: OK
00000100:00000001:25.0:1773851898.089609:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851898.089610:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851898.089611:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e1a021a6.
00000100:00000040:25.0:1773851898.089611:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000e1a021a6 x1858039727780416 msgsize 224
00000100:00100000:25.0:1773851898.089613:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-21920@kfi7 (source: 12345-21921@kfi7)
00000100:00000001:25.0:1773851898.089614:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851898.089614:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000100:00000001:24.0:1773851898.089615:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851898.089616:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851898.089616:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851898.089616:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851898.089617:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851898.089618:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851898.089618:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039727780416
00000020:00000001:24.0:1773851898.089619:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851898.089619:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac922d0
00000020:00000001:24.0:1773851898.089620:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851898.089621:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000019271512 refcount=6
00000020:00000001:24.0:1773851898.089622:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630032384 : -107123079519232 : ffff9e9276e5e400)
00000020:00000001:24.0:1773851898.089623:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630032384 : -107123079519232 : ffff9e9276e5e400)
00000100:00000001:24.0:1773851898.089624:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851898.089624:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851898.089625:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851898.089626:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851898.089627:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000098ea6441.
00000100:00000001:24.0:1773851898.089627:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851898.089628:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851898.089628:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851898.089629:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851898.089630:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851898.089630:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.089631:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851898.089632:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851898.089632:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851898.089633:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851898.089633:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851898.089634:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851898.089634:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21920@kfi7, seq: 2025184
00000100:00000040:24.0:1773851898.089634:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000019271512 : new rpc_count 1
00000100:00000001:27.0:1773851898.089635:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.089635:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780432640 : -106994929118976 : ffff9eb04d41d100)
00000100:00000040:24.0:1773851898.089636:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e1a021a6 x1858039727780416/t0(0) o400->07c68283-08a7-4e2d-9d3a-e4d07a04e682@21920@kfi7:148/0 lens 224/0 e 0 to 0 dl 1773852263 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1856-0'
00000100:00000001:24.0:1773851898.089638:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851898.089647:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851898.089648:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e1a021a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:07c68283-08a7-4e2d-9d3a-e4d07a04e682+6:39638:x1858039727780416:12345-21920@kfi7:400:default-tuolumne1856-0
00000100:00000200:24.0:1773851898.089649:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039727780416
00000020:00000001:24.0:1773851898.089650:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851898.089650:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851898.089651:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.089652:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851898.089652:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851898.089653:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851898.089653:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039727780416, found 0 last_xid 1858039727780415
00000020:00000001:24.0:1773851898.089654:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851898.089655:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851898.089655:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851898.089656:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.089656:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851898.089657:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851898.089657:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851898.089658:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a38f981f.
02000000:00000001:24.0:1773851898.089659:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.089659:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.089660:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851898.089661:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096698258, transno 0, xid 1858039727780416
00010000:00000001:24.0:1773851898.089661:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851898.089662:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e1a021a6 x1858039727780416/t0(0) o400->07c68283-08a7-4e2d-9d3a-e4d07a04e682@21920@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1856-0'
00010000:00000001:24.0:1773851898.089664:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851898.089665:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851898.089665:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=131 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851898.089666:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851898.089667:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b51b8db8 refcount 3 to 21920@kfi7
00000100:00000001:24.0:1773851898.089668:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399154336 : -107139310397280 : ffff9e8eaf7658a0)
02000000:00000001:24.0:1773851898.089669:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851898.089669:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.089670:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851898.089670:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21921@kfi7
00000400:00000010:24.0:1773851898.089671:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b29eb607.
00000100:00000200:24.0:1773851898.089672:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039727780416, offset 224
00000400:00000200:24.0:1773851898.089673:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21921@kfi7
00000400:00000200:24.0:1773851898.089674:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:24.0:1773851898.089674:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 1
00000400:00000200:24.0:1773851898.089675:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000400:00000200:24.0:1773851898.089676:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 3
00000400:00000200:24.0:1773851898.089677:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21921@kfi7 local destination
00000400:00000200:24.0:1773851898.089679:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770274:8770274:1024:4294967295] 21921@kfi7 LPNI seq info [691402:691402:16:4294967295]
00000400:00000200:24.0:1773851898.089680:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000400:00000200:24.0:1773851898.089681:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21921@kfi7 to cpt 6
00000400:00000200:24.0:1773851898.089683:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21921@kfi7(21921@kfi7:21921@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851898.089684:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 3
00000800:00000200:24.0:1773851898.089685:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851898.089686:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851898.089688:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851898.089690:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000063f Using peer 21921@kfi7(0x10000000000063f)
00000800:00000200:24.0:1773851898.089693:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x10000000000063f: rc=0
00000800:00000200:24.0:1773851898.089695:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000063f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851898.089696:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851898.089697:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b51b8db8 refcount 2 to 21920@kfi7
00010000:00000001:24.0:1773851898.089698:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851898.089698:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.089699:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851898.089700:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e1a021a6 x1858039727780416/t0(0) o400->07c68283-08a7-4e2d-9d3a-e4d07a04e682@21920@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1856-0'
00000100:00100000:24.0:1773851898.089704:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e1a021a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:07c68283-08a7-4e2d-9d3a-e4d07a04e682+6:39638:x1858039727780416:12345-21920@kfi7:400:default-tuolumne1856-0 Request processed in 65us (92us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851898.089706:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21920@kfi7, seq: 2025184
00000100:00000040:24.0:1773851898.089707:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000019271512 : new rpc_count 0
00000100:00000001:24.0:1773851898.089707:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851898.089708:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851898.089708:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851898.089709:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000098ea6441.
00000020:00000010:24.0:1773851898.089710:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851898.089710:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000019271512 : new refcount 5
00000100:00000001:24.0:1773851898.089711:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851898.089716:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000063f TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851898.089717:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851898.089718:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21921@kfi7: PUT: OK
00000400:00000200:25.0:1773851898.089719:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b29eb607
00000400:00000010:25.0:1773851898.089719:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b29eb607.
00000100:00000001:25.0:1773851898.089720:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851898.089720:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851898.089721:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be11b2d3 nid 21921@kfi7 refs 2
00000800:00000200:25.0:1773851898.089722:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 21921@kfi7(00000000c3dacc27):0x0 lsk 1600 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000063f Transaction freed
00000800:00000200:25.0:1773851898.160350:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851898.160351:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851898.160351:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851898.160352:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851898.160353:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851898.160354:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851898.160356:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18706@kfi7(000000000d063de1):0xfcc version: 2; local version 2; negotiated version: 2
00000800:00000200:27.0:1773851898.160357:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:27.0:1773851898.160360:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18706@kfi7 to cpt 6
00000800:00000200:25.0:1773851898.160360:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc Using peer 18706@kfi7(0x100000000000fcc)
00000400:00000200:27.0:1773851898.160362:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18706@kfi7 : PUT - for me
00000400:00000200:25.0:1773851898.160363:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18706@kfi7 to cpt 6
00000400:00000200:27.0:1773851898.160364:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18706@kfi7 to cpt 6
00000800:00000200:25.0:1773851898.160365:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 38 bytes to peer 0x100000000000fcc: rc=0
00000400:00000200:27.0:1773851898.160366:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001518808a nid 18706@kfi7 refs 1
00000800:00000200:25.0:1773851898.160367:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851898.160368:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18706@kfi7 to cpt 6
00000400:00000200:27.0:1773851898.160369:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001518808a nid 18706@kfi7 refs 2
00000400:00000200:27.0:1773851898.160371:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001518808a nid 18706@kfi7 refs 3
00000400:00000200:27.0:1773851898.160372:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18707@kfi7 to cpt 1
00000400:00000200:27.0:1773851898.160373:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18707@kfi7 of length 224 into portal 12 MB=0x69b82e366f100
00000400:00000200:27.0:1773851898.160375:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18707@kfi7 of length 224/224 into md 0x16159c9699 [64] + 39776
00000800:00000200:27.0:1773851898.160378:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851898.160381:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:25.0:1773851898.160381:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851898.160382:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18706@kfi7: PUT: OK
00000100:00000001:27.0:1773851898.160384:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851898.160384:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851898.160384:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc Transaction freed
00000100:00000010:27.0:1773851898.160386:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000944814f9.
00000100:00000040:27.0:1773851898.160387:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000944814f9 x1859836323492096 msgsize 224
00000100:00100000:27.0:1773851898.160389:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-18707@kfi7 (source: 12345-18706@kfi7)
00000100:00000001:27.0:1773851898.160391:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851898.160392:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001518808a nid 18706@kfi7 refs 2
00000100:00000001:24.0:1773851898.160393:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:27.0:1773851898.160394:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8517cc3: 2054@kfi7:6 <- 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851898.160394:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851898.160394:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851898.160395:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851898.160396:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851898.160397:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836323492096
00000020:00000001:24.0:1773851898.160398:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851898.160398:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d8938a
00000020:00000001:24.0:1773851898.160399:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851898.160403:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008a7ecbea refcount=5
00000020:00000001:24.0:1773851898.160404:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161377502208 : -106912332049408 : ffff9ec3886d1400)
00000020:00000001:24.0:1773851898.160405:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161377502208 : -106912332049408 : ffff9ec3886d1400)
00000100:00000001:24.0:1773851898.160407:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851898.160408:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851898.160409:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851898.160410:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851898.160411:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000098ea6441.
00000100:00000001:24.0:1773851898.160412:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851898.160412:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851898.160413:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851898.160414:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851898.160416:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851898.160416:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.160418:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851898.160419:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851898.160420:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851898.160420:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851898.160421:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851898.160421:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18707@kfi7, seq: 2025185
00000100:00000001:27.0:1773851898.160422:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851898.160422:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008a7ecbea : new rpc_count 1
00000100:00000001:27.0:1773851898.160423:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.160423:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998407808 : -107053711143808 : ffff9ea29d934c80)
00000100:00000040:24.0:1773851898.160425:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000944814f9 x1859836323492096/t0(0) o400->671b735e-ed23-4569-8251-bdbe309d9c2b@18707@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1669-0'
00000100:00000001:24.0:1773851898.160429:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851898.160430:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851898.160431:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000944814f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:671b735e-ed23-4569-8251-bdbe309d9c2b+5:40042:x1859836323492096:12345-18707@kfi7:400:default-tuolumne1669-0
00000100:00000200:24.0:1773851898.160433:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836323492096
00000020:00000001:24.0:1773851898.160434:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851898.160434:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851898.160435:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.160436:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851898.160437:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851898.160438:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851898.160439:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836323492096, found 0 last_xid 1859836323492095
00000020:00000001:24.0:1773851898.160440:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851898.160441:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851898.160441:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851898.160442:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.160443:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851898.160444:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851898.160444:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851898.160447:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008dca7a1e.
02000000:00000001:24.0:1773851898.160448:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.160448:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.160449:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851898.160450:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413759611, transno 0, xid 1859836323492096
00010000:00000001:24.0:1773851898.160452:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851898.160453:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000944814f9 x1859836323492096/t0(0) o400->671b735e-ed23-4569-8251-bdbe309d9c2b@18707@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1669-0'
00010000:00000001:24.0:1773851898.160457:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851898.160458:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851898.160458:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=131 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851898.160460:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851898.160461:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b9e30e2 refcount 3 to 18707@kfi7
00000100:00000001:24.0:1773851898.160462:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411808 : -107145304139808 : ffff9e8d4a3517e0)
02000000:00000001:24.0:1773851898.160463:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851898.160464:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.160465:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851898.160466:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18706@kfi7
00000400:00000010:24.0:1773851898.160466:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000486ca983.
00000100:00000200:24.0:1773851898.160467:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836323492096, offset 224
00000400:00000200:24.0:1773851898.160469:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18706@kfi7
00000400:00000200:24.0:1773851898.160471:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18706@kfi7 to cpt 6
00000400:00000200:24.0:1773851898.160472:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001518808a nid 18706@kfi7 refs 1
00000400:00000200:24.0:1773851898.160474:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001518808a nid 18706@kfi7 refs 2
00000400:00000200:24.0:1773851898.160475:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001518808a nid 18706@kfi7 refs 3
00000400:00000200:24.0:1773851898.160477:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18706@kfi7 local destination
00000400:00000200:24.0:1773851898.160479:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770275:8770275:1024:4294967295] 18706@kfi7 LPNI seq info [374049:374049:16:4294967295]
00000400:00000200:24.0:1773851898.160481:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001518808a nid 18706@kfi7 refs 2
00000400:00000200:24.0:1773851898.160482:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18706@kfi7 to cpt 6
00000400:00000200:24.0:1773851898.160485:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18706@kfi7(18706@kfi7:18706@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851898.160487:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001518808a nid 18706@kfi7 refs 3
00000800:00000200:24.0:1773851898.160489:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851898.160491:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851898.160494:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851898.160500:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc Using peer 18706@kfi7(0x100000000000fcc)
00000800:00000200:24.0:1773851898.160505:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x100000000000fcc: rc=0
00000800:00000200:24.0:1773851898.160507:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851898.160509:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851898.160511:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b9e30e2 refcount 2 to 18707@kfi7
00010000:00000001:24.0:1773851898.160512:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851898.160512:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.160513:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851898.160516:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000944814f9 x1859836323492096/t0(0) o400->671b735e-ed23-4569-8251-bdbe309d9c2b@18707@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1669-0'
00000100:00100000:24.0:1773851898.160521:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000944814f9 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:671b735e-ed23-4569-8251-bdbe309d9c2b+5:40042:x1859836323492096:12345-18707@kfi7:400:default-tuolumne1669-0 Request processed in 91us (133us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851898.160524:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18707@kfi7, seq: 2025185
00000100:00000040:24.0:1773851898.160525:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008a7ecbea : new rpc_count 0
00000100:00000001:24.0:1773851898.160526:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851898.160527:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851898.160527:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851898.160528:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000098ea6441.
00000020:00000010:24.0:1773851898.160530:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851898.160531:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000008a7ecbea : new refcount 4
00000100:00000001:24.0:1773851898.160532:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851898.160539:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851898.160541:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851898.160543:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18706@kfi7: PUT: OK
00000400:00000200:25.0:1773851898.160544:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000486ca983
00000400:00000010:25.0:1773851898.160545:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000486ca983.
00000100:00000001:25.0:1773851898.160546:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851898.160546:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851898.160548:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001518808a nid 18706@kfi7 refs 2
00000800:00000200:25.0:1773851898.160550:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 18706@kfi7(000000000d063de1):0x0 lsk 4045 rsk 38 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000fcc Transaction freed
00000004:00000001:11.0:1773851898.185732:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851898.185732:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851898.185732:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:11.0:1773851898.185733:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851898.185733:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f835ac3e.
00000020:00000040:11.0:1773851898.185734:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000100:00000010:10.0:1773851898.185734:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bdd23aba.
00000020:00000040:10.0:1773851898.185734:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000001:11.0:1773851898.185735:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851898.185735:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851898.185736:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851898.185736:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851898.185737:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851898.185737:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851898.185738:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000003b54e2de.
02000000:00000010:10.0:1773851898.185738:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000001e07dc98.
00000100:00000001:11.0:1773851898.185739:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.185739:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.185740:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851898.185740:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851898.185741:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.185741:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.185742:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f835ac3e] to pc [ptlrpcd_02_03+3]  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851898.185742:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000bdd23aba] to pc [ptlrpcd_02_02+2]  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:11.0:1773851898.185746:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851898.185746:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851898.185748:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851898.185749:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851898.185749:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851898.185749:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851898.185750:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:9.0:1773851898.185751:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851898.185751:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:8.0:1773851898.185752:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.185756:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:9.0:1773851898.185757:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851898.185757:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:9.0:1773851898.185758:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:8.0:1773851898.185758:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851898.185759:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851898.185759:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00100000:9.0:1773851898.185761:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000bdd23aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051940800:12@kfi7:13:default-yuba2-0
02000000:00000001:8.0:1773851898.185761:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851898.185762:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f835ac3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051940736:42@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851898.185763:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:8.0:1773851898.185764:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851898.185765:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851898.185765:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851898.185765:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851898.185766:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851898.185767:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851898.185767:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:9.0:1773851898.185768:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000016f65810.
02000000:00000001:9.0:1773851898.185769:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851898.185769:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005350c348.
02000000:00000001:8.0:1773851898.185770:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851898.185771:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000010:9.0:1773851898.185772:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000400:00000200:8.0:1773851898.185772:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:9.0:1773851898.185773:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000400:00000010:8.0:1773851898.185773:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000400:00000010:8.0:1773851898.185774:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6b06622.
00000100:00000200:9.0:1773851898.185775:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940800, portal 4
00000100:00000001:9.0:1773851898.185776:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:8.0:1773851898.185776:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940736, portal 4
00000100:00000001:9.0:1773851898.185777:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087750656 : -106944621800960 : ffff9ebc03ce9200)
00000100:00000001:8.0:1773851898.185777:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851898.185777:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446590336 : -106937262961280 : ffff9ebdba6d8d80)
00000100:00000040:9.0:1773851898.185779:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851898.185779:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.185784:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:8.0:1773851898.185784:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851898.185785:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000100:00000040:8.0:1773851898.185785:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000010:9.0:1773851898.185786:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e30a1d2d.
00000400:00000010:8.0:1773851898.185786:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000b6b4cce.
00000100:00000200:9.0:1773851898.185787:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940800, offset 0
00000100:00000200:8.0:1773851898.185787:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940736, offset 0
00000400:00000200:8.0:1773851898.185789:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:9.0:1773851898.185791:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000200:8.0:1773851898.185791:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:8.0:1773851898.185792:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:8.0:1773851898.185794:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:8.0:1773851898.185795:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:8.0:1773851898.185797:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000400:00000200:8.0:1773851898.185800:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770272, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770275, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851898.185803:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851898.185805:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851898.185806:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:8.0:1773851898.185808:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770276:8770276:1024:4294967295] 42@kfi7 LPNI seq info [5404904:5404904:16:4294967295]
00000400:00000200:8.0:1773851898.185810:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:8.0:1773851898.185812:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851898.185813:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.185815:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:8.0:1773851898.185815:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851898.185816:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851898.185818:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:8.0:1773851898.185818:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:9.0:1773851898.185820:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000800:00000200:8.0:1773851898.185820:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851898.185822:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851898.185823:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770276, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770275, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851898.185826:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:8.0:1773851898.185826:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851898.185827:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851898.185829:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000400:00000200:9.0:1773851898.185830:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770277:8770277:1024:4294967295] 12@kfi7 LPNI seq info [5403463:5403463:16:4294967295]
00000800:00000200:8.0:1773851898.185830:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Using peer 42@kfi7(0x17b)
00000400:00000200:9.0:1773851898.185833:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851898.185834:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:8.0:1773851898.185835:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x17b: rc=0
00000800:00000200:8.0:1773851898.185837:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:9.0:1773851898.185838:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851898.185840:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000100:00000001:8.0:1773851898.185840:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851898.185842:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851898.185842:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851898.185843:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851898.185844:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851898.185846:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851898.185847:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851898.185848:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851898.185849:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851898.185850:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851898.185851:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851898.185852:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Using peer 12@kfi7(0x200000000000473)
00000100:00000001:8.0:1773851898.185852:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851898.185857:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x200000000000473: rc=0
00000800:00000200:10.0:1773851898.185859:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851898.185859:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851898.185860:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851898.185860:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851898.185860:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851898.185861:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000400:00000200:10.0:1773851898.185862:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000b6b4cce
00000400:00000010:10.0:1773851898.185863:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000b6b4cce.
00000100:00000001:9.0:1773851898.185863:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.185864:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851898.185864:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:10.0:1773851898.185865:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.185865:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851898.185866:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.185867:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851898.185867:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:10.0:1773851898.185868:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.185869:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851898.185870:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851898.185870:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851898.185871:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851898.185872:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000001:9.0:1773851898.185872:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851898.185872:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:11.0:1773851898.185873:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851898.185873:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851898.185874:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x17b Transaction freed
00000100:00000001:9.0:1773851898.185874:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851898.185878:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851898.185880:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000400:00000200:11.0:1773851898.185880:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e30a1d2d
00000400:00000010:11.0:1773851898.185881:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e30a1d2d.
00000100:00000001:11.0:1773851898.185882:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:11.0:1773851898.185882:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851898.185885:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:11.0:1773851898.185885:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:25.0:1773851898.185886:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:11.0:1773851898.185886:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851898.185887:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851898.185889:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:11.0:1773851898.185889:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.185889:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:11.0:1773851898.185890:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:25.0:1773851898.185891:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.185892:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 42@kfi7 : PUT - for me
00000800:00000200:11.0:1773851898.185892:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2054@kfi7:2 -> 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000473 Transaction freed
00000400:00000200:25.0:1773851898.185893:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.185894:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:25.0:1773851898.185896:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.185897:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:25.0:1773851898.185898:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851898.185899:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.185899:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6780
00000400:00000200:25.0:1773851898.185900:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.185902:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b832f9 [1] + 224
00000800:00000200:25.0:1773851898.185903:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851898.185905:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851898.185906:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->42@kfi7: PUT: OK
00000100:00000001:25.0:1773851898.185907:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851898.185908:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:25.0:1773851898.185911:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851898.185915:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:25.0:1773851898.185916:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:25.0:1773851898.185917:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 42@kfi7(000000000fb07ee5):0x0 lsk 380 rsk 4789 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851898.185919:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851898.185919:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:8.0:1773851898.185921:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851898.185922:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851898.185923:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:8.0:1773851898.185923:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6b06622
00000400:00000010:8.0:1773851898.185924:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6b06622.
00000100:00000001:8.0:1773851898.185925:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851898.185926:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851898.185930:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851898.185933:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851898.185933:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851898.185934:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:8.0:1773851898.185934:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851898.185935:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851898.185935:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851898.185936:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851898.185937:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=131 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851898.185938:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=131 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851898.185939:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851898.185940:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851898.185941:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851898.185942:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851898.185943:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851898.185943:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000001:8.0:1773851898.185944:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851898.185945:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851898.185946:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851898.185949:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851898.185950:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851898.185950:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851898.185951:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851898.185952:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851898.185953:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351378967552 avail=351376030720 avail_mb=1372562620 hwm_mb=3131103 files=372018934 ffree=343143523 state=0: rc = 0
00000004:00000020:8.0:1773851898.185955:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351378967552 free, 351376030720 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372018934 files, 343143523 free files
00000004:00000001:8.0:1773851898.185957:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851898.185958:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:8.0:1773851898.185961:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f835ac3e pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051940736:42@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851898.185965:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851898.185966:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851898.185966:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f835ac3e x1859433051940736/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851898.185970:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851898.185970:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851898.185971:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005350c348.
02000000:00000001:8.0:1773851898.185972:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851898.185973:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851898.185973:0:41071:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:8.0:1773851898.185974:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851898.185975:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000003b54e2de.
02000000:00000001:8.0:1773851898.185976:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851898.185976:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851898.185977:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f835ac3e.
00000100:00000001:8.0:1773851898.185978:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851898.185978:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851898.185979:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851898.185980:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851898.185980:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851898.185980:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851898.185981:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851898.185987:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851898.185987:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851898.185988:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851898.185990:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851898.185992:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.185994:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:9.0:1773851898.185994:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.185995:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851898.185996:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.185997:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851898.185997:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851898.185998:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.185999:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b67c0
00000400:00000200:9.0:1773851898.186000:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.186001:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781698fe9 [1] + 224
00000800:00000200:9.0:1773851898.186003:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851898.186004:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851898.186005:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851898.186006:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851898.186007:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851898.186009:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.186013:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851898.186014:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000800:00000200:9.0:1773851898.186016:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 12@kfi7(0000000050933309):0x0 lsk 1140 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851898.186019:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851898.186019:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:9.0:1773851898.186020:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851898.186020:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:9.0:1773851898.186020:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000400:00000200:9.0:1773851898.186021:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000400:00000010:9.0:1773851898.186021:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:9.0:1773851898.186022:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851898.186022:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851898.186025:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.186027:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851898.186028:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851898.186028:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851898.186029:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851898.186029:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851898.186029:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851898.186030:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851898.186031:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=131 v=66 (66 66 66 66)
00000100:00001000:9.0:1773851898.186032:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=131 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851898.186033:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851898.186034:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851898.186034:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:9.0:1773851898.186035:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851898.186035:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851898.186036:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:9.0:1773851898.186036:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851898.186037:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851898.186038:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.186040:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851898.186041:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851898.186044:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851898.186044:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851898.186045:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851898.186046:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541509120 avail=351539469312 avail_mb=1373201052 hwm_mb=3131101 files=372136560 ffree=343302255 state=0: rc = 0
00000004:00000020:9.0:1773851898.186048:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541509120 free, 351539469312 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136560 files, 343302255 free files
00000004:00000001:9.0:1773851898.186050:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851898.186050:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851898.186053:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000bdd23aba pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051940800:12@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851898.186054:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851898.186055:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851898.186056:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000bdd23aba x1859433051940800/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851898.186058:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851898.186058:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851898.186059:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000016f65810.
02000000:00000001:9.0:1773851898.186059:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:9.0:1773851898.186060:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851898.186060:0:41070:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:9.0:1773851898.186061:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851898.186061:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000001e07dc98.
02000000:00000001:9.0:1773851898.186062:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851898.186062:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851898.186063:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000bdd23aba.
00000100:00000001:9.0:1773851898.186064:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851898.186064:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851898.186065:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851898.186065:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851898.186066:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851898.186066:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851898.186067:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851898.214446:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851898.214447:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851898.214448:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851898.214450:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851898.214452:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10235@kfi7 to cpt 1
00000400:00000200:5.0:1773851898.214453:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10235@kfi7 : PUT - for me
00000400:00000200:5.0:1773851898.214454:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10235@kfi7 to cpt 1
00000400:00000200:5.0:1773851898.214455:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 1
00000400:00000200:5.0:1773851898.214457:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10235@kfi7 to cpt 1
00000400:00000200:5.0:1773851898.214457:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 2
00000400:00000200:5.0:1773851898.214458:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 3
00000400:00000200:5.0:1773851898.214459:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10234@kfi7 to cpt 6
00000400:00000200:5.0:1773851898.214460:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10234@kfi7 of length 440 into portal 12 MB=0x699de8e7a1280
00000400:00000200:5.0:1773851898.214462:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10234@kfi7 of length 440/440 into md 0x793926dc5 [64] + 165776
00000800:00000200:5.0:1773851898.214463:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851898.214465:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851898.214466:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10235@kfi7: PUT: OK
00000100:00000001:5.0:1773851898.214467:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851898.214468:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851898.214469:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eefca3e0.
00000100:00000040:5.0:1773851898.214470:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000eefca3e0 x1858031012418176 msgsize 440
00000100:00100000:5.0:1773851898.214471:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10234@kfi7 (source: 12345-10235@kfi7)
00000100:00000001:5.0:1773851898.214472:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851898.214473:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 2
00000100:00000001:7.0:1773851898.214474:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851898.214474:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851898.214474:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851898.214475:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851898.214475:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851898.214476:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851898.214476:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858031012418176
00000020:00000001:7.0:1773851898.214477:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851898.214477:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912a7
00000020:00000001:7.0:1773851898.214478:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851898.214481:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000edce776b refcount=6
00000020:00000001:7.0:1773851898.214482:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716195328 : -107155993356288 : ffff9e8acd149800)
00000020:00000001:7.0:1773851898.214483:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716195328 : -107155993356288 : ffff9e8acd149800)
00000100:00000001:7.0:1773851898.214484:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851898.214485:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851898.214485:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000050d3f139.
00000020:00000010:7.0:1773851898.214486:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851898.214487:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851898.214488:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851898.214489:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851898.214489:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.214490:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.214491:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851898.214492:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851898.214492:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851898.214492:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851898.214493:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851898.214494:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10234@kfi7, seq: 371100853
00000100:00000040:7.0:1773851898.214495:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000edce776b : new rpc_count 1
00000100:00000001:7.0:1773851898.214495:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636964924632320 : -107108784919296 : ffff9e95caec2d00)
00000100:00000001:4.0:1773851898.214495:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851898.214496:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851898.214497:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eefca3e0 x1858031012418176/t0(0) o41->3a5e7a11-36d0-4a81-b6fc-92e6c4739016@10234@kfi7:179/0 lens 440/0 e 0 to 0 dl 1773852294 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne208-0'
00000100:00000001:7.0:1773851898.214499:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851898.214499:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851898.214500:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eefca3e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3a5e7a11-36d0-4a81-b6fc-92e6c4739016+6:126791:x1858031012418176:12345-10234@kfi7:41:default-tuolumne208-0
00000100:00000200:7.0:1773851898.214501:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858031012418176
00000020:00000001:7.0:1773851898.214502:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851898.214503:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851898.214503:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851898.214504:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851898.214504:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:7.0:1773851898.214505:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851898.214505:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858031012418176, found 0 last_xid 1858031012418175
00000020:00000001:7.0:1773851898.214506:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851898.214507:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851898.214507:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851898.214508:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.214508:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851898.214509:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851898.214510:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000e76468a1.
02000000:00000001:7.0:1773851898.214511:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.214511:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214512:0:61015:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:7.0:1773851898.214512:0:61015:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:7.0:1773851898.214513:0:61015:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214514:0:61015:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:7.0:1773851898.214514:0:61015:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:7.0:1773851898.214515:0:61015:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214516:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851898.214517:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214517:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851898.214518:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214518:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851898.214519:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214519:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851898.214519:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214520:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:7.0:1773851898.214520:0:61015:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214521:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214521:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500129280 free, 351498067968 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097665 files, 343261845 free files
00000004:00000001:7.0:1773851898.214523:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214523:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214524:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504314368 free, 351502162944 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056119 files, 343265932 free files
00000004:00000001:7.0:1773851898.214525:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214525:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214526:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690095616 free, 351687687168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231121 files, 343447359 free files
00000004:00000001:7.0:1773851898.214527:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214527:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214527:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382714368 free, 351380626432 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978599 files, 343147182 free files
00000004:00000001:7.0:1773851898.214528:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214529:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214529:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958951424 free, 350956868608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563891 files, 342733351 free files
00000004:00000001:7.0:1773851898.214530:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214531:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214531:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351175168 free, 351348398080 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372083944 files, 343116382 free files
00000004:00000001:7.0:1773851898.214532:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214533:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214533:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482217472 free, 351481148416 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097101 files, 343244353 free files
00000004:00000001:7.0:1773851898.214534:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214534:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214534:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449345024 free, 351446775808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160923 files, 343212251 free files
00000004:00000001:7.0:1773851898.214537:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214537:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214538:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353588736 free, 351351202816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083184 files, 343118739 free files
00000004:00000001:7.0:1773851898.214539:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214539:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214539:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388963840 free, 351386269696 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019008 files, 343153285 free files
00000004:00000001:7.0:1773851898.214540:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214541:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214541:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406502912 free, 351404106752 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127127 files, 343170413 free files
00000004:00000001:7.0:1773851898.214542:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214543:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214543:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378967552 free, 351376030720 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372018934 files, 343143523 free files
00000004:00000001:7.0:1773851898.214544:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214544:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214545:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351465986048 free, 351462875136 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062748 files, 343228502 free files
00000004:00000001:7.0:1773851898.214545:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214546:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214546:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489068032 free, 351486036992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066743 files, 343251043 free files
00000004:00000001:7.0:1773851898.214547:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214547:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214548:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492738048 free, 351490311168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372077981 files, 343254627 free files
00000004:00000001:7.0:1773851898.214549:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214549:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214550:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524023296 free, 351521284096 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113755 files, 343285179 free files
00000004:00000001:7.0:1773851898.214551:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214551:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214552:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510653952 free, 351508038656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095714 files, 343272123 free files
00000004:00000001:7.0:1773851898.214553:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214553:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214554:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541509120 free, 351539469312 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136560 files, 343302255 free files
00000004:00000001:7.0:1773851898.214554:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214555:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214555:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470702592 free, 351461712896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064442 files, 343233108 free files
00000004:00000001:7.0:1773851898.214556:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214557:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214557:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666633728 free, 351645446144 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237768 files, 343424447 free files
00000004:00000001:7.0:1773851898.214558:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214559:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214559:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545833472 free, 351536191488 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116380 files, 343306478 free files
00000004:00000001:7.0:1773851898.214560:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214560:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214561:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351604012032 free, 351601751040 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190421 files, 343363293 free files
00000004:00000001:7.0:1773851898.214562:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214562:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214563:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615833088 free, 351613210624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043332 files, 343374837 free files
00000004:00000001:7.0:1773851898.214564:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214564:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214565:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420222464 free, 351417744384 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008873 files, 343183811 free files
00000004:00000001:7.0:1773851898.214566:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214566:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214566:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409081344 free, 351407014912 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011194 files, 343172931 free files
00000004:00000001:7.0:1773851898.214567:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214568:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214568:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480017920 free, 351478758400 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073028 files, 343242205 free files
00000004:00000001:7.0:1773851898.214570:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214571:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214571:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593663488 free, 351576858624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189905 files, 343353187 free files
00000004:00000001:7.0:1773851898.214572:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214573:0:61015:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:7.0:1773851898.214574:0:61015:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464032256 free, 351458236416 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064693 files, 343226594 free files
00000004:00000001:7.0:1773851898.214575:0:61015:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214576:0:61015:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214576:0:61015:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:7.0:1773851898.214577:0:61015:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 386138112 granted 1839581985855 pending 396361728 free 40309313440317440 avail 40308836162076672
00000004:00000020:7.0:1773851898.214578:0:61015:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841140976640 free, 9841024262592 avail; 10969025062 objects: 9610489235 free; state 100
00000020:00000001:7.0:1773851898.214580:0:61015:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:7.0:1773851898.214583:0:61015:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.214584:0:61015:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851898.214584:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768353, transno 0, xid 1858031012418176
00010000:00000001:7.0:1773851898.214585:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851898.214586:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eefca3e0 x1858031012418176/t0(0) o41->3a5e7a11-36d0-4a81-b6fc-92e6c4739016@10234@kfi7:179/0 lens 440/368 e 0 to 0 dl 1773852294 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne208-0'
00010000:00000001:7.0:1773851898.214589:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851898.214589:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851898.214590:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=130 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851898.214591:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851898.214592:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aa3fe92f refcount 5 to 10234@kfi7
00000100:00000001:7.0:1773851898.214593:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092336352 : -107152617215264 : ffff9e8b96506ae0)
02000000:00000001:7.0:1773851898.214594:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851898.214594:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.214595:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851898.214596:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10235@kfi7
00000400:00000010:7.0:1773851898.214596:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000034f580d9.
00000100:00000200:7.0:1773851898.214598:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858031012418176, offset 224
00000400:00000200:7.0:1773851898.214599:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10235@kfi7
00000400:00000200:7.0:1773851898.214600:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10235@kfi7 to cpt 1
00000400:00000200:7.0:1773851898.214601:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 1
00000400:00000200:7.0:1773851898.214602:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 2
00000400:00000200:7.0:1773851898.214603:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 3
00000400:00000200:7.0:1773851898.214605:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10235@kfi7 local destination
00000400:00000200:7.0:1773851898.214606:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770278:8770278:1024:4294967295] 10235@kfi7 LPNI seq info [28013:28013:16:4294967295]
00000400:00000200:7.0:1773851898.214607:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 2
00000400:00000200:7.0:1773851898.214608:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10235@kfi7 to cpt 1
00000400:00000200:7.0:1773851898.214610:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10235@kfi7(10235@kfi7:10235@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851898.214612:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 3
00000800:00000200:7.0:1773851898.214613:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851898.214614:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:7.0:1773851898.214616:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851898.214619:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000084f Using peer 10235@kfi7(0x10000000000084f)
00000800:00000200:7.0:1773851898.214622:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 468 bytes to peer 0x10000000000084f: rc=0
00000800:00000200:7.0:1773851898.214624:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000084f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851898.214626:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851898.214627:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aa3fe92f refcount 4 to 10234@kfi7
00010000:00000001:7.0:1773851898.214627:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851898.214628:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851898.214629:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851898.214629:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eefca3e0 x1858031012418176/t0(0) o41->3a5e7a11-36d0-4a81-b6fc-92e6c4739016@10234@kfi7:179/0 lens 440/368 e 0 to 0 dl 1773852294 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne208-0'
00000100:00100000:7.0:1773851898.214632:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eefca3e0 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:3a5e7a11-36d0-4a81-b6fc-92e6c4739016+6:126791:x1858031012418176:12345-10234@kfi7:41:default-tuolumne208-0 Request processed in 132us (162us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851898.214636:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10234@kfi7, seq: 371100853
00000800:00000200:5.0:1773851898.214636:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000084f TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851898.214637:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000edce776b : new rpc_count 0
00000100:00000001:7.0:1773851898.214638:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851898.214638:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851898.214639:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851898.214639:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851898.214640:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000400:00000200:5.0:1773851898.214640:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10235@kfi7: PUT: OK
00000020:00000010:7.0:1773851898.214641:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000050d3f139.
00000020:00000040:7.0:1773851898.214641:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000edce776b : new refcount 5
00000400:00000200:5.0:1773851898.214641:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000034f580d9
00000100:00000001:7.0:1773851898.214642:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:5.0:1773851898.214642:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000034f580d9.
00000100:00000001:5.0:1773851898.214643:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851898.214643:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851898.214644:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ba1cbd8 nid 10235@kfi7 refs 2
00000800:00000200:5.0:1773851898.214645:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 10235@kfi7(00000000eb7af356):0x0 lsk 2128 rsk 173 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000084f Transaction freed
00000800:00000200:31.0:1773851898.273838:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851898.273839:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:31.0:1773851898.273840:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851898.273843:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:31.0:1773851898.273845:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.273846:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12931@kfi7 : PUT - for me
00000400:00000200:31.0:1773851898.273847:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.273848:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 1
00000400:00000200:31.0:1773851898.273849:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.273850:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000400:00000200:31.0:1773851898.273851:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 3
00000400:00000200:31.0:1773851898.273852:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.273853:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12931@kfi7 of length 224 into portal 12 MB=0x69b4b5e8fe580
00000400:00000200:31.0:1773851898.273854:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12931@kfi7 of length 224/224 into md 0x77fe1859d [64] + 9496
00000800:00000200:31.0:1773851898.273856:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851898.273858:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851898.273859:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12931@kfi7: PUT: OK
00000100:00000001:31.0:1773851898.273861:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851898.273861:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:31.0:1773851898.273862:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000055bd4bee.
00000100:00000040:31.0:1773851898.273863:0:2465875:0:(events.c:358:request_in_callback()) incoming req@0000000055bd4bee x1859597871605120 msgsize 224
00000100:00100000:31.0:1773851898.273864:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-12931@kfi7 (source: 12345-12931@kfi7)
00000100:00000001:31.0:1773851898.273866:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851898.273867:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000800:00000200:31.0:1773851898.273869:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000f78341e7: 2069@kfi7:7 <- 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851898.273872:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851898.273873:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851898.273873:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851898.273874:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851898.273874:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851898.273875:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597871605120
00000020:00000001:31.0:1773851898.273876:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851898.273876:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79f4b
00000020:00000001:31.0:1773851898.273877:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851898.273881:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004fde6f08 refcount=5
00000020:00000001:31.0:1773851898.273882:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108662001664 : -106965047549952 : ffff9eb742566000)
00000020:00000001:31.0:1773851898.273882:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108662001664 : -106965047549952 : ffff9eb742566000)
00000100:00000001:31.0:1773851898.273883:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851898.273884:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851898.273885:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000790a35bc.
00000020:00000010:31.0:1773851898.273886:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851898.273887:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851898.273888:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851898.273888:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851898.273889:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851898.273890:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851898.273890:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851898.273891:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.273892:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851898.273893:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851898.273893:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851898.273894:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12931@kfi7, seq: 2055598
00000100:00000001:30.0:1773851898.273894:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:31.0:1773851898.273895:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004fde6f08 : new rpc_count 1
00000100:00000001:30.0:1773851898.273895:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851898.273896:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637034999065856 : -107038710485760 : ffff9ea61baf2d00)
00000100:00000001:30.0:1773851898.273896:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851898.273897:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000055bd4bee x1859597871605120/t0(0) o400->51df9d36-3edf-4909-a0db-9339591aea20@12931@kfi7:686/0 lens 224/0 e 0 to 0 dl 1773852046 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1304-0'
00000100:00000001:30.0:1773851898.273897:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.273899:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851898.273900:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851898.273901:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000055bd4bee pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:51df9d36-3edf-4909-a0db-9339591aea20+5:39542:x1859597871605120:12345-12931@kfi7:400:default-tuolumne1304-0
00000100:00000200:31.0:1773851898.273902:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597871605120
00000020:00000001:31.0:1773851898.273903:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851898.273904:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851898.273904:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.273905:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851898.273906:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851898.273906:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851898.273907:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597871605120, found 0 last_xid 1859597871605119
00000020:00000001:31.0:1773851898.273908:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851898.273909:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851898.273909:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851898.273910:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.273910:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851898.273911:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851898.273911:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851898.273912:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000819a494e.
02000000:00000001:31.0:1773851898.273913:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.273914:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.273914:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851898.273915:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183245103018, transno 0, xid 1859597871605120
00010000:00000001:31.0:1773851898.273916:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851898.273917:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000055bd4bee x1859597871605120/t0(0) o400->51df9d36-3edf-4909-a0db-9339591aea20@12931@kfi7:686/0 lens 224/224 e 0 to 0 dl 1773852046 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1304-0'
00010000:00000001:31.0:1773851898.273919:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851898.273919:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851898.273920:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=131 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851898.273921:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851898.273922:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b12a23f5 refcount 3 to 12931@kfi7
00000100:00000001:31.0:1773851898.273923:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214208 : -107155106337408 : ffff9e8b01f36d80)
02000000:00000001:31.0:1773851898.273924:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851898.273924:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.273925:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851898.273926:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12931@kfi7
00000400:00000010:31.0:1773851898.273926:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c73e55.
00000100:00000200:31.0:1773851898.273927:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597871605120, offset 224
00000400:00000200:31.0:1773851898.273929:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12931@kfi7
00000400:00000200:31.0:1773851898.273929:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.273930:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 1
00000400:00000200:31.0:1773851898.273931:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000400:00000200:31.0:1773851898.273932:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 3
00000400:00000200:31.0:1773851898.273933:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12931@kfi7 local destination
00000400:00000200:31.0:1773851898.273934:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770279:8770279:1024:4294967295] 12931@kfi7 LPNI seq info [1083491:1083491:16:4294967295]
00000400:00000200:31.0:1773851898.273936:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000400:00000200:31.0:1773851898.273936:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12931@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.273938:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12931@kfi7(12931@kfi7:12931@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851898.273939:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 3
00000800:00000200:31.0:1773851898.273940:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851898.273942:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851898.273943:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851898.273946:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d9 Using peer 12931@kfi7(0x1d9)
00000800:00000200:31.0:1773851898.273949:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x1d9: rc=0
00000800:00000200:31.0:1773851898.273950:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851898.273952:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851898.273953:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b12a23f5 refcount 2 to 12931@kfi7
00010000:00000001:31.0:1773851898.273954:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851898.273954:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.273955:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851898.273956:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000055bd4bee x1859597871605120/t0(0) o400->51df9d36-3edf-4909-a0db-9339591aea20@12931@kfi7:686/0 lens 224/224 e 0 to 0 dl 1773852046 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1304-0'
00000800:00000200:29.0:1773851898.273965:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d9 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851898.273967:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851898.273968:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000055bd4bee pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:51df9d36-3edf-4909-a0db-9339591aea20+5:39542:x1859597871605120:12345-12931@kfi7:400:default-tuolumne1304-0 Request processed in 67us (104us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851898.273969:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12931@kfi7: PUT: OK
00000100:00100000:31.0:1773851898.273970:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12931@kfi7, seq: 2055598
00000400:00000200:29.0:1773851898.273970:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c73e55
00000100:00000040:31.0:1773851898.273971:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004fde6f08 : new rpc_count 0
00000100:00000001:31.0:1773851898.273971:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:29.0:1773851898.273971:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c73e55.
00000100:00000001:31.0:1773851898.273972:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851898.273972:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000100:00000001:29.0:1773851898.273972:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:31.0:1773851898.273973:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000100:00000001:29.0:1773851898.273973:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851898.273974:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000790a35bc.
00000400:00000200:29.0:1773851898.273974:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000051bbda6d nid 12931@kfi7 refs 2
00000020:00000040:31.0:1773851898.273975:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000004fde6f08 : new refcount 4
00000100:00000001:31.0:1773851898.273976:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851898.273976:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 12931@kfi7(0000000042dc3f0d):0x0 lsk 474 rsk 17 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1d9 Transaction freed
00000800:00000200:17.0:1773851898.283053:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851898.283053:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851898.283055:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851898.283057:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851898.283059:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.283060:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16035@kfi7 : PUT - for me
00000400:00000200:17.0:1773851898.283061:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.283061:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093635fbc nid 16035@kfi7 refs 1
00000400:00000200:17.0:1773851898.283062:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.283063:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093635fbc nid 16035@kfi7 refs 2
00000400:00000200:17.0:1773851898.283064:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000093635fbc nid 16035@kfi7 refs 3
00000400:00000200:17.0:1773851898.283064:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.283065:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16035@kfi7 of length 224 into portal 12 MB=0x69b0a099ab500
00000400:00000200:17.0:1773851898.283066:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16035@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 46576
00000800:00000200:17.0:1773851898.283068:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851898.283069:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.283070:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16035@kfi7: PUT: OK
00000100:00000001:17.0:1773851898.283071:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851898.283071:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851898.283073:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db479c64.
00000100:00000040:17.0:1773851898.283073:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000db479c64 x1859317273376000 msgsize 224
00000100:00100000:17.0:1773851898.283075:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16035@kfi7 (source: 12345-16035@kfi7)
00000100:00000001:17.0:1773851898.283076:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851898.283077:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000093635fbc nid 16035@kfi7 refs 2
00000800:00000200:17.0:1773851898.283078:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851898.283078:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851898.283078:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851898.283079:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851898.283079:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851898.283080:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851898.283081:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317273376000
00000020:00000001:16.0:1773851898.283081:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851898.283082:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91ad4
00000020:00000001:16.0:1773851898.283083:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851898.283086:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fb4f09c0 refcount=6
00000020:00000001:16.0:1773851898.283087:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627763200 : -107123081788416 : ffff9e9276c34400)
00000020:00000001:16.0:1773851898.283088:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627763200 : -107123081788416 : ffff9e9276c34400)
00000100:00000001:16.0:1773851898.283089:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.283090:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851898.283090:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6dc2e6b.
00000020:00000010:16.0:1773851898.283091:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.283092:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e696e90a.
00000100:00000001:16.0:1773851898.283093:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851898.283093:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851898.283094:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851898.283095:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851898.283095:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851898.283096:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.283097:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.283099:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851898.283099:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851898.283100:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851898.283100:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851898.283102:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16035@kfi7, seq: 2156432
00000100:00000001:19.0:1773851898.283103:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.283103:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fb4f09c0 : new rpc_count 1
00000100:00000001:19.0:1773851898.283104:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.283104:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794775424 : -107029914776192 : ffff9ea827f30d80)
00000100:00000040:16.0:1773851898.283106:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000db479c64 x1859317273376000/t0(0) o400->ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c@16035@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1484-0'
00000100:00000001:16.0:1773851898.283111:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.283112:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851898.283113:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000db479c64 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c+6:39860:x1859317273376000:12345-16035@kfi7:400:default-tuolumne1484-0
00000100:00000200:16.0:1773851898.283115:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317273376000
00000020:00000001:16.0:1773851898.283116:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851898.283117:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851898.283118:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.283120:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851898.283120:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851898.283122:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851898.283123:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317273376000, found 0 last_xid 1859317273375999
00000020:00000001:16.0:1773851898.283124:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851898.283126:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851898.283126:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851898.283127:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.283129:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851898.283129:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851898.283130:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851898.283132:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000375413fc.
02000000:00000001:16.0:1773851898.283133:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.283134:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.283135:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851898.283136:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317273376000
00010000:00000001:16.0:1773851898.283138:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851898.283139:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000db479c64 x1859317273376000/t0(0) o400->ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c@16035@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1484-0'
00010000:00000001:16.0:1773851898.283143:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851898.283144:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851898.283145:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=131 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851898.283147:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851898.283149:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d3423137 refcount 5 to 16035@kfi7
00000100:00000001:16.0:1773851898.283150:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519008 : -107156126032608 : ffff9e8ac52c1d20)
02000000:00000001:16.0:1773851898.283151:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851898.283152:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.283153:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851898.283155:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16035@kfi7
00000400:00000010:16.0:1773851898.283156:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000287d02c3.
00000100:00000200:16.0:1773851898.283157:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317273376000, offset 224
00000400:00000200:16.0:1773851898.283159:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16035@kfi7
00000400:00000200:16.0:1773851898.283160:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.283162:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000093635fbc nid 16035@kfi7 refs 1
00000400:00000200:16.0:1773851898.283163:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000093635fbc nid 16035@kfi7 refs 2
00000400:00000200:16.0:1773851898.283165:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000093635fbc nid 16035@kfi7 refs 3
00000400:00000200:16.0:1773851898.283178:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16035@kfi7 local destination
00000400:00000200:16.0:1773851898.283180:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770280:8770280:1024:4294967295] 16035@kfi7 LPNI seq info [1163067:1163067:16:4294967295]
00000400:00000200:16.0:1773851898.283182:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000093635fbc nid 16035@kfi7 refs 2
00000400:00000200:16.0:1773851898.283183:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16035@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.283187:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16035@kfi7(16035@kfi7:16035@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851898.283189:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000093635fbc nid 16035@kfi7 refs 3
00000800:00000200:16.0:1773851898.283191:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851898.283193:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851898.283196:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851898.283200:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x219 Using peer 16035@kfi7(0x219)
00000800:00000200:16.0:1773851898.283205:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x219: rc=0
00000800:00000200:16.0:1773851898.283207:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x219 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851898.283210:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.283212:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d3423137 refcount 4 to 16035@kfi7
00010000:00000001:16.0:1773851898.283213:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851898.283216:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.283217:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851898.283218:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db479c64 x1859317273376000/t0(0) o400->ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c@16035@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1484-0'
00000100:00100000:16.0:1773851898.283223:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000db479c64 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:ccda4cac-f2aa-48d5-8b23-f8c5d6d3577c+6:39860:x1859317273376000:12345-16035@kfi7:400:default-tuolumne1484-0 Request processed in 111us (149us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851898.283227:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16035@kfi7, seq: 2156432
00000100:00000040:16.0:1773851898.283228:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fb4f09c0 : new rpc_count 0
00000100:00000001:16.0:1773851898.283230:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851898.283230:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851898.283232:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.283233:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e696e90a.
00000020:00000010:16.0:1773851898.283234:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6dc2e6b.
00000020:00000040:16.0:1773851898.283236:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000fb4f09c0 : new refcount 5
00000100:00000001:16.0:1773851898.283237:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851898.283244:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x219 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851898.283246:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851898.283248:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16035@kfi7: PUT: OK
00000400:00000200:18.0:1773851898.283248:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000287d02c3
00000400:00000010:18.0:1773851898.283249:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000287d02c3.
00000100:00000001:18.0:1773851898.283250:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851898.283250:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851898.283251:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000093635fbc nid 16035@kfi7 refs 2
00000800:00000200:18.0:1773851898.283252:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 16035@kfi7(00000000e075543f):0x0 lsk 538 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x219 Transaction freed
00000800:00000200:17.0:1773851898.291312:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851898.291313:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851898.291315:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851898.291317:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851898.291319:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18611@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.291320:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18611@kfi7 : PUT - for me
00000400:00000200:17.0:1773851898.291321:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18611@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.291322:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000137fda97 nid 18611@kfi7 refs 1
00000400:00000200:17.0:1773851898.291323:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18611@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.291324:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000137fda97 nid 18611@kfi7 refs 2
00000400:00000200:17.0:1773851898.291325:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000137fda97 nid 18611@kfi7 refs 3
00000400:00000200:17.0:1773851898.291326:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18611@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.291326:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18611@kfi7 of length 224 into portal 12 MB=0x69b4bb90cf880
00000400:00000200:17.0:1773851898.291327:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18611@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 46800
00000800:00000200:17.0:1773851898.291329:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851898.291331:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.291332:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18611@kfi7: PUT: OK
00000100:00000001:17.0:1773851898.291333:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851898.291333:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851898.291334:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc1b6b28.
00000100:00000040:17.0:1773851898.291334:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000bc1b6b28 x1859599389751424 msgsize 224
00000100:00100000:17.0:1773851898.291336:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-18611@kfi7 (source: 12345-18611@kfi7)
00000100:00000001:17.0:1773851898.291337:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851898.291338:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000137fda97 nid 18611@kfi7 refs 2
00000100:00000001:16.0:1773851898.291338:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851898.291339:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851898.291339:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851898.291339:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851898.291340:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851898.291340:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851898.291341:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599389751424
00000020:00000001:16.0:1773851898.291341:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851898.291342:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3892e60d
00000020:00000001:16.0:1773851898.291342:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851898.291345:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000af832905 refcount=5
00000020:00000001:16.0:1773851898.291346:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637140658999296 : -106933050552320 : ffff9ebeb581d000)
00000020:00000001:16.0:1773851898.291346:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637140658999296 : -106933050552320 : ffff9ebeb581d000)
00000100:00000001:16.0:1773851898.291347:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.291348:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851898.291349:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6dc2e6b.
00000020:00000010:16.0:1773851898.291349:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.291350:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e696e90a.
00000100:00000001:16.0:1773851898.291350:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851898.291351:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851898.291351:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851898.291352:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851898.291352:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851898.291353:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.291354:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.291355:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851898.291355:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851898.291355:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851898.291355:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851898.291356:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18611@kfi7, seq: 2156433
00000100:00000001:19.0:1773851898.291357:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.291357:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.291357:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000af832905 : new rpc_count 1
00000100:00000001:16.0:1773851898.291357:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794773120 : -107029914778496 : ffff9ea827f30480)
00000100:00000040:16.0:1773851898.291358:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc1b6b28 x1859599389751424/t0(0) o400->b8343490-99a3-4834-8b4b-a9fd0a258208@18611@kfi7:150/0 lens 224/0 e 0 to 0 dl 1773852265 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1642-0'
00000100:00000001:16.0:1773851898.291363:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.291363:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851898.291364:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc1b6b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:b8343490-99a3-4834-8b4b-a9fd0a258208+5:39358:x1859599389751424:12345-18611@kfi7:400:default-tuolumne1642-0
00000100:00000200:16.0:1773851898.291365:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599389751424
00000020:00000001:16.0:1773851898.291366:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851898.291366:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851898.291367:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.291367:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851898.291368:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851898.291368:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851898.291369:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599389751424, found 0 last_xid 1859599389751423
00000020:00000001:16.0:1773851898.291369:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851898.291370:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851898.291370:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851898.291371:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.291371:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851898.291372:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851898.291372:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851898.291373:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006eb0a31a.
02000000:00000001:16.0:1773851898.291374:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.291374:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.291375:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851898.291375:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254106987, transno 0, xid 1859599389751424
00010000:00000001:16.0:1773851898.291376:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851898.291376:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc1b6b28 x1859599389751424/t0(0) o400->b8343490-99a3-4834-8b4b-a9fd0a258208@18611@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1642-0'
00010000:00000001:16.0:1773851898.291379:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851898.291379:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851898.291380:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=131 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851898.291381:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851898.291382:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003a939fbe refcount 3 to 18611@kfi7
00000100:00000001:16.0:1773851898.291382:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547680 : -107156126003936 : ffff9e8ac52c8d20)
02000000:00000001:16.0:1773851898.291383:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851898.291384:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.291384:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851898.291385:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18611@kfi7
00000400:00000010:16.0:1773851898.291386:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000090de02a.
00000100:00000200:16.0:1773851898.291386:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599389751424, offset 224
00000400:00000200:16.0:1773851898.291387:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18611@kfi7
00000400:00000200:16.0:1773851898.291388:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18611@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.291389:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000137fda97 nid 18611@kfi7 refs 1
00000400:00000200:16.0:1773851898.291390:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000137fda97 nid 18611@kfi7 refs 2
00000400:00000200:16.0:1773851898.291391:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000137fda97 nid 18611@kfi7 refs 3
00000400:00000200:16.0:1773851898.291392:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18611@kfi7 local destination
00000400:00000200:16.0:1773851898.291393:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770281:8770281:1024:4294967295] 18611@kfi7 LPNI seq info [5577321:5577321:16:4294967295]
00000400:00000200:16.0:1773851898.291395:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000137fda97 nid 18611@kfi7 refs 2
00000400:00000200:16.0:1773851898.291395:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18611@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.291397:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18611@kfi7(18611@kfi7:18611@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851898.291398:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000137fda97 nid 18611@kfi7 refs 3
00000800:00000200:16.0:1773851898.291399:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851898.291400:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851898.291402:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851898.291404:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ce Using peer 18611@kfi7(0x9ce)
00000800:00000200:16.0:1773851898.291407:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x9ce: rc=0
00000800:00000200:16.0:1773851898.291408:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851898.291409:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.291410:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003a939fbe refcount 2 to 18611@kfi7
00010000:00000001:16.0:1773851898.291411:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851898.291411:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.291412:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851898.291413:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc1b6b28 x1859599389751424/t0(0) o400->b8343490-99a3-4834-8b4b-a9fd0a258208@18611@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1642-0'
00000100:00100000:16.0:1773851898.291417:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc1b6b28 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:b8343490-99a3-4834-8b4b-a9fd0a258208+5:39358:x1859599389751424:12345-18611@kfi7:400:default-tuolumne1642-0 Request processed in 53us (82us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851898.291419:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18611@kfi7, seq: 2156433
00000100:00000040:16.0:1773851898.291419:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000af832905 : new rpc_count 0
00000100:00000001:16.0:1773851898.291420:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851898.291421:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851898.291421:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.291422:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e696e90a.
00000020:00000010:16.0:1773851898.291422:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6dc2e6b.
00000020:00000040:16.0:1773851898.291423:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000af832905 : new refcount 4
00000100:00000001:16.0:1773851898.291423:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851898.291428:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ce TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851898.291429:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.291431:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18611@kfi7: PUT: OK
00000400:00000200:17.0:1773851898.291431:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000090de02a
00000400:00000010:17.0:1773851898.291432:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000090de02a.
00000100:00000001:17.0:1773851898.291433:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851898.291433:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851898.291434:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000137fda97 nid 18611@kfi7 refs 2
00000800:00000200:17.0:1773851898.291435:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2069@kfi7:4 -> 18611@kfi7(00000000fd01211f):0x0 lsk 2511 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x9ce Transaction freed
00000800:00000200:9.0:1773851898.360920:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851898.360923:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851898.360925:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851898.360929:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851898.360932:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.360934:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25666@kfi7 : PUT - for me
00000400:00000200:9.0:1773851898.360935:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.360936:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 1
00000400:00000200:9.0:1773851898.360938:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.360939:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:9.0:1773851898.360941:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000400:00000200:9.0:1773851898.360942:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:9.0:1773851898.360944:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25667@kfi7 of length 440 into portal 17 MB=0x69b4b61bf3a00
00000400:00000200:9.0:1773851898.360946:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-25667@kfi7 of length 440/440 into md 0x78155c3a9 [2] + 0
00000800:00000200:9.0:1773851898.360950:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851898.360952:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851898.360954:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25666@kfi7: PUT: OK
00000100:00000001:9.0:1773851898.360956:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851898.360957:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:9.0:1773851898.360958:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000316846da.
00000100:00000040:9.0:1773851898.360959:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000316846da x1859597925038592 msgsize 440
00000100:00100000:9.0:1773851898.360961:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-25667@kfi7 (source: 12345-25666@kfi7)
00000100:00000001:9.0:1773851898.360964:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851898.360965:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000800:00000200:9.0:1773851898.360967:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851898.360968:0:146452:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:10.0:1773851898.360969:0:146452:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:10.0:1773851898.360969:0:146452:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851898.360970:0:146452:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851898.360972:0:146452:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851898.360974:0:146452:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597925038592
00000020:00000001:10.0:1773851898.360975:0:146452:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:10.0:1773851898.360976:0:146452:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74122
00000020:00000001:10.0:1773851898.360977:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.360980:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d60686f refcount=469
00000020:00000001:10.0:1773851898.360981:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000020:00000001:10.0:1773851898.360983:0:146452:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000100:00000001:10.0:1773851898.360984:0:146452:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851898.360986:0:146452:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:10.0:1773851898.360988:0:146452:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f84ecc94.
00000020:00000010:10.0:1773851898.360989:0:146452:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000064bf95dc.
00000020:00000010:10.0:1773851898.360991:0:146452:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a004c0ad.
00000100:00000040:10.0:1773851898.360993:0:146452:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:10.0:1773851898.360994:0:146452:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:10.0:1773851898.360995:0:146452:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:10.0:1773851898.360996:0:146452:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:10.0:1773851898.360997:0:146452:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.360998:0:146452:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:10.0:1773851898.361000:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361000:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361002:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000059d2a801 refcount=3
00000020:00000001:10.0:1773851898.361003:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095068785984 : -106978640765632 : ffff9eb4181e5d40)
00010000:00000001:10.0:1773851898.361004:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095068785984 : -106978640765632 : ffff9eb4181e5d40)
00010000:00000001:10.0:1773851898.361006:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361006:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361007:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361008:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361009:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000279ce0a refcount=3
00000020:00000001:10.0:1773851898.361010:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095068779648 : -106978640771968 : ffff9eb4181e4480)
00010000:00000001:10.0:1773851898.361011:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095068779648 : -106978640771968 : ffff9eb4181e4480)
00010000:00000001:10.0:1773851898.361012:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361012:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361013:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361014:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361014:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000412c4333 refcount=3
00000020:00000001:10.0:1773851898.361016:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095068791168 : -106978640760448 : ffff9eb4181e7180)
00010000:00000001:10.0:1773851898.361017:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095068791168 : -106978640760448 : ffff9eb4181e7180)
00010000:00000001:10.0:1773851898.361018:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361019:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361019:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361020:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361021:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000091a02e52 refcount=3
00000020:00000001:10.0:1773851898.361022:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637070096085376 : -107003613466240 : ffff9eae47a13180)
00010000:00000001:10.0:1773851898.361023:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637070096085376 : -107003613466240 : ffff9eae47a13180)
00010000:00000001:10.0:1773851898.361024:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361025:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361025:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361026:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361027:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003ea221cf refcount=3
00000020:00000001:10.0:1773851898.361028:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277646272 : -107045431905344 : ffff9ea48b0e73c0)
00010000:00000001:10.0:1773851898.361029:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277646272 : -107045431905344 : ffff9ea48b0e73c0)
00010000:00000001:10.0:1773851898.361030:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361031:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361031:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361032:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361033:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c10ce3ca refcount=3
00000020:00000001:10.0:1773851898.361034:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636947352957312 : -107126356594304 : ffff9e91b391b180)
00010000:00000001:10.0:1773851898.361035:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636947352957312 : -107126356594304 : ffff9e91b391b180)
00010000:00000001:10.0:1773851898.361036:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361037:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361037:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361038:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361039:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009943d89b refcount=3
00000020:00000001:10.0:1773851898.361040:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637073565479872 : -107000144071744 : ffff9eaf166bf3c0)
00010000:00000001:10.0:1773851898.361041:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637073565479872 : -107000144071744 : ffff9eaf166bf3c0)
00010000:00000001:10.0:1773851898.361042:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361043:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361043:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361044:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361046:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000847cf2ac refcount=3
00000020:00000001:10.0:1773851898.361046:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637021986241728 : -107051723309888 : ffff9ea3140f3cc0)
00010000:00000001:10.0:1773851898.361047:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637021986241728 : -107051723309888 : ffff9ea3140f3cc0)
00010000:00000001:10.0:1773851898.361049:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361049:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361050:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361050:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361052:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d273561e refcount=3
00000020:00000001:10.0:1773851898.361053:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137901083392 : -106935808468224 : ffff9ebe111f5b00)
00010000:00000001:10.0:1773851898.361054:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637137901083392 : -106935808468224 : ffff9ebe111f5b00)
00010000:00000001:10.0:1773851898.361055:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361055:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361056:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361056:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361057:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000e5ce59b refcount=3
00000020:00000001:10.0:1773851898.361058:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637009817740288 : -107063891811328 : ffff9ea03ec2a400)
00010000:00000001:10.0:1773851898.361059:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637009817740288 : -107063891811328 : ffff9ea03ec2a400)
00010000:00000001:10.0:1773851898.361060:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361061:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361061:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361062:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361063:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ba626363 refcount=3
00000020:00000001:10.0:1773851898.361064:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109285787264 : -106964423764352 : ffff9eb767849680)
00010000:00000001:10.0:1773851898.361065:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637109285787264 : -106964423764352 : ffff9eb767849680)
00010000:00000001:10.0:1773851898.361066:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361066:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361067:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361067:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361069:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003b0b7624 refcount=3
00000020:00000001:10.0:1773851898.361069:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143186281536 : -106930523270080 : ffff9ebf4c251440)
00010000:00000001:10.0:1773851898.361071:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637143186281536 : -106930523270080 : ffff9ebf4c251440)
00010000:00000001:10.0:1773851898.361072:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361072:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361073:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361074:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361075:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006bf1414 refcount=3
00000020:00000001:10.0:1773851898.361076:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109285790720 : -106964423760896 : ffff9eb76784a400)
00010000:00000001:10.0:1773851898.361077:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637109285790720 : -106964423760896 : ffff9eb76784a400)
00010000:00000001:10.0:1773851898.361079:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361079:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361080:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361080:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361082:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000035e2112b refcount=3
00000020:00000001:10.0:1773851898.361083:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151435926784 : -106922273624832 : ffff9ec137dcad00)
00010000:00000001:10.0:1773851898.361084:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637151435926784 : -106922273624832 : ffff9ec137dcad00)
00010000:00000001:10.0:1773851898.361085:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361085:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361086:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361086:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361087:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e28e3b06 refcount=3
00000020:00000001:10.0:1773851898.361088:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637060040548224 : -107013669003392 : ffff9eabf045df80)
00010000:00000001:10.0:1773851898.361089:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637060040548224 : -107013669003392 : ffff9eabf045df80)
00010000:00000001:10.0:1773851898.361091:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361091:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361092:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361092:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361093:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000185d99fb refcount=3
00000020:00000001:10.0:1773851898.361094:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636960204693376 : -107113504858240 : ffff9e94b1979f80)
00010000:00000001:10.0:1773851898.361095:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636960204693376 : -107113504858240 : ffff9e94b1979f80)
00010000:00000001:10.0:1773851898.361096:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361097:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361097:0:146452:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.361099:0:146452:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.361101:0:146452:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.361103:0:146452:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.361107:0:145944:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:10.0:1773851898.361107:0:146452:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851898.361108:0:145944:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:10.0:1773851898.361108:0:146452:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:10.0:1773851898.361109:0:146452:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25667@kfi7, seq: 39215915
00000100:00000001:11.0:1773851898.361113:0:145944:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851898.361113:0:146452:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009d60686f : new rpc_count 11
00000100:00000001:11.0:1773851898.361114:0:145944:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.361114:0:146452:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609038592 : -107064100513024 : ffff9ea032521b00)
00000100:00000040:10.0:1773851898.361116:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000316846da x1859597925038592/t0(0) o103->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:625/0 lens 440/0 e 0 to 0 dl 1773851985 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:10.0:1773851898.361121:0:146452:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:10.0:1773851898.361122:0:146452:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:10.0:1773851898.361124:0:146452:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000316846da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:edddd82f-128c-4bbd-98a4-4162bc248cc0+469:39579:x1859597925038592:12345-25667@kfi7:103:
00000100:00000200:10.0:1773851898.361126:0:146452:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597925038592
00010000:00000001:10.0:1773851898.361127:0:146452:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:10.0:1773851898.361128:0:146452:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:10.0:1773851898.361129:0:146452:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:10.0:1773851898.361131:0:146452:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:10.0:1773851898.361132:0:146452:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:10.0:1773851898.361133:0:146452:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003af8a35d.
02000000:00000001:10.0:1773851898.361134:0:146452:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.361135:0:146452:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361137:0:146452:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:10.0:1773851898.361138:0:146452:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 16 locks, starting at 0
00010000:00000001:10.0:1773851898.361139:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361139:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361140:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000059d2a801 refcount=3
00000020:00000001:10.0:1773851898.361141:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095068785984 : -106978640765632 : ffff9eb4181e5d40)
00010000:00000001:10.0:1773851898.361142:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095068785984 : -106978640765632 : ffff9eb4181e5d40)
00010000:00000040:10.0:1773851898.361144:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000058f5489c count: 3
00000004:00000001:10.0:1773851898.361145:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361147:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361148:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361149:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361150:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361151:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361153:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361154:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361156:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361158:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361159:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361160:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361161:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000059d2a801 with handle 0x21b6f08f07a63042 from hash
00010000:00000001:10.0:1773851898.361162:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361163:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361164:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361164:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361166:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361167:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361168:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361168:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361170:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000059d2a801/0x21b6f08f07a63042 lrc: 0/0,0 mode: --/PR res: [0x200021e61:0x693:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 25667@kfi7 remote: 0xf113e19a5e66cfdf expref: 469 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361175:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000058f5489c count: 3
00010000:00000040:10.0:1773851898.361176:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 390
00000020:00000040:10.0:1773851898.361178:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 468
00010000:00000010:10.0:1773851898.361179:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a136ada6.
00010000:00000040:10.0:1773851898.361180:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000058f5489c count: 2
00010000:00000001:10.0:1773851898.361182:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361182:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361183:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361183:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000279ce0a refcount=3
00000020:00000001:10.0:1773851898.361184:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095068779648 : -106978640771968 : ffff9eb4181e4480)
00010000:00000001:10.0:1773851898.361185:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095068779648 : -106978640771968 : ffff9eb4181e4480)
00010000:00000001:10.0:1773851898.361187:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361188:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361189:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200021e61:0x693:0x0].0x0 (0000000058f5489c)
00010000:00000001:10.0:1773851898.361191:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361192:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361194:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361194:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000058f5489c count: 1
00010000:00000040:10.0:1773851898.361195:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000165e7d45 count: 2
00000004:00000001:10.0:1773851898.361197:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361197:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361198:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361199:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361199:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361200:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361202:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361202:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361203:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361204:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361205:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361205:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361206:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000000279ce0a with handle 0x21b6f08f07a5d7db from hash
00010000:00000001:10.0:1773851898.361208:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361208:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361209:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361210:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361210:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361211:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361212:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361213:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361214:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000000279ce0a/0x21b6f08f07a5d7db lrc: 0/0,0 mode: --/PR res: [0x20001fba0:0xa4fc:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 25667@kfi7 remote: 0xf113e19a5e66c03b expref: 468 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361219:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000165e7d45 count: 2
00010000:00000040:10.0:1773851898.361220:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 389
00000020:00000040:10.0:1773851898.361221:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 467
00010000:00000010:10.0:1773851898.361222:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000044105c28.
00010000:00000040:10.0:1773851898.361223:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000165e7d45 count: 1
00010000:00000001:10.0:1773851898.361224:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361225:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361226:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361226:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000412c4333 refcount=3
00000020:00000001:10.0:1773851898.361227:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095068791168 : -106978640760448 : ffff9eb4181e7180)
00010000:00000001:10.0:1773851898.361228:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637095068791168 : -106978640760448 : ffff9eb4181e7180)
00010000:00000001:10.0:1773851898.361230:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361231:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361232:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001fba0:0xa4fc:0x0].0x0 (00000000165e7d45)
00010000:00000001:10.0:1773851898.361234:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361236:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361237:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361237:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000165e7d45 count: 0
00010000:00000010:10.0:1773851898.361240:0:146452:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000a876170c.
00010000:00000040:10.0:1773851898.361242:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000ba768f94 count: 2
00000004:00000001:10.0:1773851898.361243:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361244:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361244:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361245:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361246:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361247:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361249:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361250:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361251:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361252:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361252:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361253:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361254:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000412c4333 with handle 0x21b6f08f07a5d6fb from hash
00010000:00000001:10.0:1773851898.361256:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361256:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361257:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361258:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361258:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361259:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361260:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361261:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361262:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000412c4333/0x21b6f08f07a5d6fb lrc: 0/0,0 mode: --/PR res: [0x28002c0dc:0x4c9f:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 25667@kfi7 remote: 0xf113e19a5e66bf62 expref: 467 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361266:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba768f94 count: 2
00010000:00000040:10.0:1773851898.361268:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 388
00000020:00000040:10.0:1773851898.361269:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 466
00010000:00000010:10.0:1773851898.361270:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000013f6d4e.
00010000:00000040:10.0:1773851898.361272:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba768f94 count: 1
00010000:00000001:10.0:1773851898.361273:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361274:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361274:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361275:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000091a02e52 refcount=3
00000020:00000001:10.0:1773851898.361276:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637070096085376 : -107003613466240 : ffff9eae47a13180)
00010000:00000001:10.0:1773851898.361277:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637070096085376 : -107003613466240 : ffff9eae47a13180)
00010000:00000001:10.0:1773851898.361279:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361279:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361280:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x28002c0dc:0x4c9f:0x0].0x0 (00000000ba768f94)
00010000:00000001:10.0:1773851898.361282:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361283:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361284:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361285:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba768f94 count: 0
00010000:00000010:10.0:1773851898.361287:0:146452:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000b83e0cd4.
00010000:00000040:10.0:1773851898.361289:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000004c1ae756 count: 4
00000004:00000001:10.0:1773851898.361290:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361290:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361291:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361292:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361293:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361294:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361296:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361297:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361298:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361299:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361299:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361300:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361301:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000091a02e52 with handle 0x21b6f08f07a5c7ce from hash
00010000:00000001:10.0:1773851898.361303:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361303:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361304:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361305:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361305:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361306:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361308:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361309:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361310:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000091a02e52/0x21b6f08f07a5c7ce lrc: 0/0,0 mode: --/PR res: [0x200021ce1:0x1ca6:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 25667@kfi7 remote: 0xf113e19a5e66b12a expref: 466 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361315:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004c1ae756 count: 4
00010000:00000040:10.0:1773851898.361316:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 387
00000020:00000040:10.0:1773851898.361317:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 465
00010000:00000010:10.0:1773851898.361318:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000009e015eeb.
00010000:00000040:10.0:1773851898.361319:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004c1ae756 count: 3
00010000:00000001:10.0:1773851898.361320:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361321:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361322:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361322:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003ea221cf refcount=3
00000020:00000001:10.0:1773851898.361323:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277646272 : -107045431905344 : ffff9ea48b0e73c0)
00010000:00000001:10.0:1773851898.361325:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277646272 : -107045431905344 : ffff9ea48b0e73c0)
00010000:00000001:10.0:1773851898.361326:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361327:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361327:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200021ce1:0x1ca6:0x0].0x0 (000000004c1ae756)
00010000:00000001:10.0:1773851898.361329:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361330:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361331:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361332:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000004c1ae756 count: 2
00010000:00000040:10.0:1773851898.361334:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000a1a55f2a count: 4
00000004:00000001:10.0:1773851898.361335:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361336:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361337:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361338:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361338:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361339:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361341:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361342:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361344:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361344:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361345:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361346:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361347:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000003ea221cf with handle 0x21b6f08f07a5c7b2 from hash
00010000:00000001:10.0:1773851898.361349:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361349:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361350:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361351:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361351:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361352:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361353:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361353:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361355:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000003ea221cf/0x21b6f08f07a5c7b2 lrc: 0/0,0 mode: --/PR res: [0x2c0021045:0x1058b:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 25667@kfi7 remote: 0xf113e19a5e66b0ac expref: 465 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361358:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a1a55f2a count: 4
00010000:00000040:10.0:1773851898.361359:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 386
00000020:00000040:10.0:1773851898.361360:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 464
00010000:00000010:10.0:1773851898.361361:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000009810173e.
00010000:00000040:10.0:1773851898.361362:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a1a55f2a count: 3
00010000:00000001:10.0:1773851898.361362:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361363:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361363:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361364:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c10ce3ca refcount=3
00000020:00000001:10.0:1773851898.361364:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636947352957312 : -107126356594304 : ffff9e91b391b180)
00010000:00000001:10.0:1773851898.361365:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636947352957312 : -107126356594304 : ffff9e91b391b180)
00010000:00000001:10.0:1773851898.361366:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361367:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361367:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2c0021045:0x1058b:0x0].0x0 (00000000a1a55f2a)
00010000:00000001:10.0:1773851898.361368:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361369:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361370:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361370:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000a1a55f2a count: 2
00010000:00000040:10.0:1773851898.361371:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000009111dbc0 count: 3
00000004:00000001:10.0:1773851898.361372:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361372:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361373:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361373:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361374:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361375:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361376:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361376:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361377:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361377:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361378:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361378:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361379:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c10ce3ca with handle 0x21b6f08f07a59bcf from hash
00010000:00000001:10.0:1773851898.361380:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361381:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361381:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361381:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361382:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361382:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361383:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361383:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361384:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c10ce3ca/0x21b6f08f07a59bcf lrc: 0/0,0 mode: --/CR res: [0x240025e6d:0x1c94a:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e669a94 expref: 464 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361387:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009111dbc0 count: 3
00010000:00000040:10.0:1773851898.361387:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 385
00000020:00000040:10.0:1773851898.361388:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 463
00010000:00000010:10.0:1773851898.361389:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000e2d4de83.
00010000:00000040:10.0:1773851898.361390:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009111dbc0 count: 2
00010000:00000001:10.0:1773851898.361390:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361391:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361391:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361392:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000009943d89b refcount=3
00000020:00000001:10.0:1773851898.361392:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637073565479872 : -107000144071744 : ffff9eaf166bf3c0)
00010000:00000001:10.0:1773851898.361393:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637073565479872 : -107000144071744 : ffff9eaf166bf3c0)
00010000:00000001:10.0:1773851898.361394:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361394:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361395:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240025e6d:0x1c94a:0x0].0x0 (000000009111dbc0)
00010000:00000001:10.0:1773851898.361396:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361397:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361398:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361398:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000009111dbc0 count: 1
00010000:00000040:10.0:1773851898.361399:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000299db5ab count: 2
00000004:00000001:10.0:1773851898.361400:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361400:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361401:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361401:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361401:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361402:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361403:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361404:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361405:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361405:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361406:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361406:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361407:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000009943d89b with handle 0x21b6f08f07a59928 from hash
00010000:00000001:10.0:1773851898.361408:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361408:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361408:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361409:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361409:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361410:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361410:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361411:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361412:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000009943d89b/0x21b6f08f07a59928 lrc: 0/0,0 mode: --/CR res: [0x240024c16:0x4de5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6698e2 expref: 463 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361414:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000299db5ab count: 2
00010000:00000040:10.0:1773851898.361415:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 384
00000020:00000040:10.0:1773851898.361415:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 462
00010000:00000010:10.0:1773851898.361416:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000e3383029.
00010000:00000040:10.0:1773851898.361417:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000299db5ab count: 1
00010000:00000001:10.0:1773851898.361418:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361418:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361418:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361419:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000847cf2ac refcount=3
00000020:00000001:10.0:1773851898.361419:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637021986241728 : -107051723309888 : ffff9ea3140f3cc0)
00010000:00000001:10.0:1773851898.361420:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637021986241728 : -107051723309888 : ffff9ea3140f3cc0)
00010000:00000001:10.0:1773851898.361421:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361421:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361422:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024c16:0x4de5:0x0].0x0 (00000000299db5ab)
00010000:00000001:10.0:1773851898.361423:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361424:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361424:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361425:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000299db5ab count: 0
00010000:00000010:10.0:1773851898.361426:0:146452:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000edd0df6b.
00010000:00000040:10.0:1773851898.361427:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000ba019115 count: 2
00000004:00000001:10.0:1773851898.361428:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361428:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361429:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361429:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361429:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361430:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361431:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361431:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361432:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361433:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361433:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361433:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361434:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000847cf2ac with handle 0x21b6f08f07a598f7 from hash
00010000:00000001:10.0:1773851898.361435:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361435:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361436:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361436:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361437:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361437:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361438:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361438:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361439:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000847cf2ac/0x21b6f08f07a598f7 lrc: 0/0,0 mode: --/CR res: [0x240028a95:0x1b9c:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6698bf expref: 462 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361442:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba019115 count: 2
00010000:00000040:10.0:1773851898.361443:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 383
00000020:00000040:10.0:1773851898.361443:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 461
00010000:00000010:10.0:1773851898.361444:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000006decd7da.
00010000:00000040:10.0:1773851898.361445:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba019115 count: 1
00010000:00000001:10.0:1773851898.361445:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361446:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361446:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361447:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000d273561e refcount=3
00000020:00000001:10.0:1773851898.361447:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137901083392 : -106935808468224 : ffff9ebe111f5b00)
00010000:00000001:10.0:1773851898.361448:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637137901083392 : -106935808468224 : ffff9ebe111f5b00)
00010000:00000001:10.0:1773851898.361449:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361449:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361450:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028a95:0x1b9c:0x0].0x0 (00000000ba019115)
00010000:00000001:10.0:1773851898.361451:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361452:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361452:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361453:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba019115 count: 0
00010000:00000010:10.0:1773851898.361454:0:146452:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000abd129e6.
00010000:00000040:10.0:1773851898.361455:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000002008078f count: 3
00000004:00000001:10.0:1773851898.361456:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361457:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361457:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361458:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361458:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361459:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361460:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361460:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361461:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361461:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361462:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361462:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361463:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000d273561e with handle 0x21b6f08f07a5970d from hash
00010000:00000001:10.0:1773851898.361464:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361464:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361465:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361465:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361465:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361466:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361466:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361467:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361467:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000d273561e/0x21b6f08f07a5970d lrc: 0/0,0 mode: --/CR res: [0x2400276c9:0x1b5c:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6696a4 expref: 461 pid: 61054 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361470:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002008078f count: 3
00010000:00000040:10.0:1773851898.361470:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 382
00000020:00000040:10.0:1773851898.361471:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 460
00010000:00000010:10.0:1773851898.361471:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000092c1b278.
00010000:00000040:10.0:1773851898.361472:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002008078f count: 2
00010000:00000001:10.0:1773851898.361473:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361473:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361473:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361474:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000e5ce59b refcount=3
00000020:00000001:10.0:1773851898.361474:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637009817740288 : -107063891811328 : ffff9ea03ec2a400)
00010000:00000001:10.0:1773851898.361475:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637009817740288 : -107063891811328 : ffff9ea03ec2a400)
00010000:00000001:10.0:1773851898.361476:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361476:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361477:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400276c9:0x1b5c:0x0].0x0 (000000002008078f)
00010000:00000001:10.0:1773851898.361478:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361478:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361479:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361479:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002008078f count: 1
00010000:00000040:10.0:1773851898.361480:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000b76d45bd count: 3
00000004:00000001:10.0:1773851898.361480:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361481:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361481:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361481:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361482:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361482:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361484:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361485:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361485:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361486:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361486:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361487:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361487:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000000e5ce59b with handle 0x21b6f08f07a58fce from hash
00010000:00000001:10.0:1773851898.361488:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361488:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361489:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361489:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361489:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361490:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361490:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361491:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361492:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000000e5ce59b/0x21b6f08f07a58fce lrc: 0/0,0 mode: --/CR res: [0x240028a95:0x1a41:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6691b1 expref: 460 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361494:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000b76d45bd count: 3
00010000:00000040:10.0:1773851898.361494:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 381
00000020:00000040:10.0:1773851898.361495:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 459
00010000:00000010:10.0:1773851898.361495:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000eb8503bd.
00010000:00000040:10.0:1773851898.361496:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000b76d45bd count: 2
00010000:00000001:10.0:1773851898.361497:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361497:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361497:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361498:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000ba626363 refcount=3
00000020:00000001:10.0:1773851898.361499:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109285787264 : -106964423764352 : ffff9eb767849680)
00010000:00000001:10.0:1773851898.361500:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637109285787264 : -106964423764352 : ffff9eb767849680)
00010000:00000001:10.0:1773851898.361500:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361501:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361501:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028a95:0x1a41:0x0].0x0 (00000000b76d45bd)
00010000:00000001:10.0:1773851898.361502:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361503:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361503:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361504:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000b76d45bd count: 1
00010000:00000040:10.0:1773851898.361504:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000ba4d0368 count: 3
00000004:00000001:10.0:1773851898.361505:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361506:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361506:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361506:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361507:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361507:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361509:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361509:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361510:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361510:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361510:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361511:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361511:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000ba626363 with handle 0x21b6f08f07a58ed9 from hash
00010000:00000001:10.0:1773851898.361512:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361512:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361513:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361513:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361513:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361514:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361514:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361515:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361515:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba626363/0x21b6f08f07a58ed9 lrc: 0/0,0 mode: --/CR res: [0x240023497:0x121ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e66908b expref: 459 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361518:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba4d0368 count: 3
00010000:00000040:10.0:1773851898.361518:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 380
00000020:00000040:10.0:1773851898.361519:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 458
00010000:00000010:10.0:1773851898.361519:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000da15c161.
00010000:00000040:10.0:1773851898.361520:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba4d0368 count: 2
00010000:00000001:10.0:1773851898.361521:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361521:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361521:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361522:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000003b0b7624 refcount=3
00000020:00000001:10.0:1773851898.361522:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143186281536 : -106930523270080 : ffff9ebf4c251440)
00010000:00000001:10.0:1773851898.361523:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637143186281536 : -106930523270080 : ffff9ebf4c251440)
00010000:00000001:10.0:1773851898.361524:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361524:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361524:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240023497:0x121ed:0x0].0x0 (00000000ba4d0368)
00010000:00000001:10.0:1773851898.361525:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361526:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361526:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361527:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba4d0368 count: 1
00010000:00000040:10.0:1773851898.361527:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000be34193f count: 3
00000004:00000001:10.0:1773851898.361528:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361528:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361529:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361529:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361529:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361530:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361531:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361532:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361532:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361533:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361533:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361533:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361534:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000003b0b7624 with handle 0x21b6f08f07a58dc8 from hash
00010000:00000001:10.0:1773851898.361535:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361535:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361535:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361536:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361536:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361537:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361537:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361537:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361538:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000003b0b7624/0x21b6f08f07a58dc8 lrc: 0/0,0 mode: --/PR res: [0x20001fa89:0x37a3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 25667@kfi7 remote: 0xf113e19a5e668efc expref: 458 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361541:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000be34193f count: 3
00010000:00000040:10.0:1773851898.361542:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 379
00000020:00000040:10.0:1773851898.361543:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 457
00010000:00000010:10.0:1773851898.361543:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000000f50b243.
00010000:00000040:10.0:1773851898.361544:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000be34193f count: 2
00010000:00000001:10.0:1773851898.361545:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361545:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361545:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361546:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000006bf1414 refcount=3
00000020:00000001:10.0:1773851898.361546:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109285790720 : -106964423760896 : ffff9eb76784a400)
00010000:00000001:10.0:1773851898.361547:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637109285790720 : -106964423760896 : ffff9eb76784a400)
00010000:00000001:10.0:1773851898.361548:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361548:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361549:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x20001fa89:0x37a3:0x0].0x0 (00000000be34193f)
00010000:00000001:10.0:1773851898.361550:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361550:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361551:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361551:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000be34193f count: 1
00010000:00000040:10.0:1773851898.361552:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000001af35588 count: 3
00000004:00000001:10.0:1773851898.361552:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361553:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361553:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361554:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361554:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361555:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361556:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361556:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361557:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361557:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361557:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361558:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361558:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000006bf1414 with handle 0x21b6f08f07a586f2 from hash
00010000:00000001:10.0:1773851898.361560:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361560:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361560:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361561:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361561:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361561:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361562:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361562:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361563:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000006bf1414/0x21b6f08f07a586f2 lrc: 0/0,0 mode: --/CR res: [0x24002661f:0x1f1ed:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e668850 expref: 457 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361565:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000001af35588 count: 3
00010000:00000040:10.0:1773851898.361566:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 378
00000020:00000040:10.0:1773851898.361566:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 456
00010000:00000010:10.0:1773851898.361567:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000a7aadf0b.
00010000:00000040:10.0:1773851898.361567:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000001af35588 count: 2
00010000:00000001:10.0:1773851898.361568:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361568:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361568:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361569:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000035e2112b refcount=3
00000020:00000001:10.0:1773851898.361569:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637151435926784 : -106922273624832 : ffff9ec137dcad00)
00010000:00000001:10.0:1773851898.361570:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637151435926784 : -106922273624832 : ffff9ec137dcad00)
00010000:00000001:10.0:1773851898.361570:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361571:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361571:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002661f:0x1f1ed:0x0].0x0 (000000001af35588)
00010000:00000001:10.0:1773851898.361572:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361573:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361573:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361574:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000001af35588 count: 1
00010000:00000040:10.0:1773851898.361574:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000089c9f628 count: 2
00000004:00000001:10.0:1773851898.361575:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361575:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361576:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361576:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361577:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361578:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361579:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361579:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361580:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361580:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361581:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361581:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361582:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000035e2112b with handle 0x21b6f08f07a4e168 from hash
00010000:00000001:10.0:1773851898.361583:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361583:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361583:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361584:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361584:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361584:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361585:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361585:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361586:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000035e2112b/0x21b6f08f07a4e168 lrc: 0/0,0 mode: --/PR res: [0x28002c2bf:0x17e11:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6676e5 expref: 456 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361588:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000089c9f628 count: 2
00010000:00000040:10.0:1773851898.361589:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 377
00000020:00000040:10.0:1773851898.361589:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 455
00010000:00000010:10.0:1773851898.361590:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000009cefb9e.
00010000:00000040:10.0:1773851898.361590:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000089c9f628 count: 1
00010000:00000001:10.0:1773851898.361591:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361591:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361592:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361592:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e28e3b06 refcount=3
00000020:00000001:10.0:1773851898.361593:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637060040548224 : -107013669003392 : ffff9eabf045df80)
00010000:00000001:10.0:1773851898.361593:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637060040548224 : -107013669003392 : ffff9eabf045df80)
00010000:00000001:10.0:1773851898.361594:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361594:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361595:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x28002c2bf:0x17e11:0x0].0x0 (0000000089c9f628)
00010000:00000001:10.0:1773851898.361596:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361599:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361599:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361600:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000089c9f628 count: 0
00010000:00000010:10.0:1773851898.361600:0:146452:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 0000000045d1d0ac.
00010000:00000040:10.0:1773851898.361601:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 0000000034eb726d count: 5
00000004:00000001:10.0:1773851898.361602:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361602:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361603:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361603:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361604:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361604:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361605:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361605:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361606:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361606:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361607:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361607:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361608:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000e28e3b06 with handle 0x21b6f08f07a4e049 from hash
00010000:00000001:10.0:1773851898.361608:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361609:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361609:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361609:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361610:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361610:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361611:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361611:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361612:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000e28e3b06/0x21b6f08f07a4e049 lrc: 0/0,0 mode: --/CR res: [0x240024dbd:0x68e2:0x0].0x0 bits 0x8/0x0 rrc: 6 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e666a2e expref: 455 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361614:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000034eb726d count: 5
00010000:00000040:10.0:1773851898.361614:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 376
00000020:00000040:10.0:1773851898.361615:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 454
00010000:00000010:10.0:1773851898.361615:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000045f89a9f.
00010000:00000040:10.0:1773851898.361616:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000034eb726d count: 4
00010000:00000001:10.0:1773851898.361616:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361617:0:146452:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:10.0:1773851898.361618:0:146452:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:10.0:1773851898.361618:0:146452:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000185d99fb refcount=3
00000020:00000001:10.0:1773851898.361619:0:146452:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636960204693376 : -107113504858240 : ffff9e94b1979f80)
00010000:00000001:10.0:1773851898.361619:0:146452:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636960204693376 : -107113504858240 : ffff9e94b1979f80)
00010000:00000001:10.0:1773851898.361620:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361620:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361621:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024dbd:0x68e2:0x0].0x0 (0000000034eb726d)
00010000:00000001:10.0:1773851898.361622:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361622:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361623:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361623:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 0000000034eb726d count: 3
00010000:00000040:10.0:1773851898.361624:0:146452:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000591be0fb count: 3
00000004:00000001:10.0:1773851898.361625:0:146452:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:10.0:1773851898.361625:0:146452:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:10.0:1773851898.361626:0:146452:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361626:0:146452:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:10.0:1773851898.361626:0:146452:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:10.0:1773851898.361627:0:146452:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361628:0:146452:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:10.0:1773851898.361629:0:146452:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:10.0:1773851898.361629:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361630:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361630:0:146452:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:10.0:1773851898.361630:0:146452:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851898.361631:0:146452:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000185d99fb with handle 0x21b6f08f07a4da1b from hash
00010000:00000001:10.0:1773851898.361632:0:146452:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:10.0:1773851898.361632:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:10.0:1773851898.361632:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361633:0:146452:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:10.0:1773851898.361633:0:146452:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:10.0:1773851898.361634:0:146452:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361634:0:146452:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:10.0:1773851898.361634:0:146452:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:10.0:1773851898.361635:0:146452:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000185d99fb/0x21b6f08f07a4da1b lrc: 0/0,0 mode: --/CR res: [0x2400249fc:0x3ecc:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6666b5 expref: 454 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:10.0:1773851898.361649:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000591be0fb count: 3
00010000:00000040:10.0:1773851898.361650:0:146452:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000009d60686f : new locks_count 375
00000020:00000040:10.0:1773851898.361650:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 453
00010000:00000010:10.0:1773851898.361651:0:146452:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000fb911a8b.
00010000:00000040:10.0:1773851898.361652:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000591be0fb count: 2
00010000:00000001:10.0:1773851898.361652:0:146452:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:10.0:1773851898.361653:0:146452:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:10.0:1773851898.361653:0:146452:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:10.0:1773851898.361654:0:146452:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2400249fc:0x3ecc:0x0].0x0 (00000000591be0fb)
00010000:00000001:10.0:1773851898.361655:0:146452:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:10.0:1773851898.361655:0:146452:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361656:0:146452:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:10.0:1773851898.361656:0:146452:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000591be0fb count: 1
00010000:00010000:10.0:1773851898.361657:0:146452:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:10.0:1773851898.361657:0:146452:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=16 : 16 : 10)
00010000:00000001:10.0:1773851898.361658:0:146452:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:10.0:1773851898.361659:0:146452:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851898.361660:0:146452:0:(import.c:1951:at_measured()) add 1 to 00000000a7d9b651 time=152 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851898.361661:0:146452:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:10.0:1773851898.361662:0:146452:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc978f5f refcount 3 to 25667@kfi7
00000100:00000001:10.0:1773851898.361663:0:146452:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106880 : -107156354444736 : ffff9e8ab78ed240)
02000000:00000001:10.0:1773851898.361664:0:146452:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:10.0:1773851898.361664:0:146452:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.361665:0:146452:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851898.361666:0:146452:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25666@kfi7
00000400:00000010:10.0:1773851898.361666:0:146452:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000200:10.0:1773851898.361667:0:146452:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859597925038592, offset 224
00000400:00000200:10.0:1773851898.361669:0:146452:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25666@kfi7
00000400:00000200:10.0:1773851898.361670:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:10.0:1773851898.361670:0:146452:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 1
00000400:00000200:10.0:1773851898.361672:0:146452:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:10.0:1773851898.361673:0:146452:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000400:00000200:10.0:1773851898.361675:0:146452:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25666@kfi7 local destination
00000400:00000200:10.0:1773851898.361677:0:146452:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770282:8770282:1024:4294967295] 25666@kfi7 LPNI seq info [611807:611807:16:4294967295]
00000400:00000200:10.0:1773851898.361678:0:146452:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:10.0:1773851898.361679:0:146452:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:10.0:1773851898.361681:0:146452:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25666@kfi7(25666@kfi7:25666@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851898.361683:0:146452:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000800:00000200:10.0:1773851898.361684:0:146452:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851898.361685:0:146452:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851898.361687:0:146452:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851898.361690:0:146452:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xce3 Using peer 25666@kfi7(0xce3)
00000800:00000200:10.0:1773851898.361693:0:146452:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000005269f40f: Posted send of 324 bytes to peer 0xce3: rc=0
00000800:00000200:10.0:1773851898.361694:0:146452:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xce3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851898.361697:0:146452:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851898.361697:0:146452:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc978f5f refcount 2 to 25667@kfi7
00010000:00000001:10.0:1773851898.361698:0:146452:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851898.361699:0:146452:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851898.361700:0:146452:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000316846da x1859597925038592/t0(0) o103->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:625/0 lens 440/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:10.0:1773851898.361703:0:146452:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000316846da pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn02_013:edddd82f-128c-4bbd-98a4-4162bc248cc0+453:39579:x1859597925038592:12345-25667@kfi7:103: Request processed in 581us (743us total) trans 0 rc 0/0
00000100:00100000:10.0:1773851898.361705:0:146452:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25667@kfi7, seq: 39215915
00000100:00000040:10.0:1773851898.361706:0:146452:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009d60686f : new rpc_count 10
00000100:00000001:10.0:1773851898.361707:0:146452:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851898.361707:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xce3 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851898.361708:0:146452:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:10.0:1773851898.361708:0:146452:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000064bf95dc.
00000400:00000200:9.0:1773851898.361708:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851898.361709:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25666@kfi7: PUT: OK
00000020:00000010:10.0:1773851898.361710:0:146452:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a004c0ad.
00000020:00000010:10.0:1773851898.361711:0:146452:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f84ecc94.
00000020:00000040:10.0:1773851898.361711:0:146452:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 452
00000400:00000200:9.0:1773851898.361711:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:9.0:1773851898.361711:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851898.361712:0:146452:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851898.361712:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851898.361712:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851898.361713:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000800:00000200:9.0:1773851898.361715:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005269f40f: 2069@kfi7:2 -> 25666@kfi7(00000000f44dfb9f):0x0 lsk 3300 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xce3 Transaction freed
00010000:00000010:10.1:1773851898.366726:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000059d2a801.
00010000:00000010:10.1:1773851898.366728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000000279ce0a.
00010000:00000010:10.1:1773851898.366728:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000165e7d45.
00010000:00000010:10.1:1773851898.366730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000412c4333.
00010000:00000010:10.1:1773851898.366730:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000ba768f94.
00010000:00000010:10.1:1773851898.366731:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000091a02e52.
00010000:00000010:10.1:1773851898.366732:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000003ea221cf.
00010000:00000010:10.1:1773851898.366733:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c10ce3ca.
00010000:00000010:10.1:1773851898.366734:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000009943d89b.
00010000:00000010:10.1:1773851898.366734:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000299db5ab.
00010000:00000010:10.1:1773851898.366736:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000847cf2ac.
00010000:00000010:10.1:1773851898.366736:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 00000000ba019115.
00010000:00000010:10.1:1773851898.366738:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000d273561e.
00010000:00000010:10.1:1773851898.366739:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000000e5ce59b.
00010000:00000010:10.1:1773851898.366740:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000ba626363.
00010000:00000010:10.1:1773851898.366741:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000003b0b7624.
00010000:00000010:10.1:1773851898.366742:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000006bf1414.
00010000:00000010:10.1:1773851898.366742:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000035e2112b.
00010000:00000010:10.1:1773851898.366743:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 0000000089c9f628.
00010000:00000010:10.1:1773851898.366744:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000e28e3b06.
00010000:00000010:10.1:1773851898.366745:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000185d99fb.
00000800:00000200:18.0:1773851898.381074:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851898.381074:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851898.381075:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851898.381075:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851898.381076:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851898.381077:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851898.381078:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851898.381079:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16768@kfi7(000000000f590212):0x1280 version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851898.381080:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:18.0:1773851898.381081:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16768@kfi7 : PUT - for me
00000800:00000200:17.0:1773851898.381081:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 Using peer 16768@kfi7(0x100000000001280)
00000400:00000200:18.0:1773851898.381082:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:18.0:1773851898.381083:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 1
00000400:00000200:18.0:1773851898.381084:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:18.0:1773851898.381085:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000400:00000200:18.0:1773851898.381086:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 3
00000400:00000200:17.0:1773851898.381086:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:18.0:1773851898.381087:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16704@kfi7 to cpt 0
00000400:00000200:18.0:1773851898.381088:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16704@kfi7 of length 224 into portal 12 MB=0x69bacb7925ec0
00000800:00000200:17.0:1773851898.381089:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 38 bytes to peer 0x100000000001280: rc=0
00000400:00000200:18.0:1773851898.381090:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16704@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 47024
00000800:00000200:17.0:1773851898.381090:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:18.0:1773851898.381092:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851898.381093:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851898.381094:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16768@kfi7: PUT: OK
00000100:00000001:18.0:1773851898.381096:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851898.381096:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851898.381097:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000aa4623a3.
00000100:00000040:18.0:1773851898.381098:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000aa4623a3 x1860015976767168 msgsize 224
00000100:00100000:18.0:1773851898.381100:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-16704@kfi7 (source: 12345-16768@kfi7)
00000100:00000001:18.0:1773851898.381101:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851898.381101:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851898.381102:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000100:00000001:16.0:1773851898.381102:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851898.381103:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851898.381103:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851898.381103:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851898.381103:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851898.381104:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 Transaction freed
02000000:00000001:16.0:1773851898.381104:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851898.381105:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860015976767168
00000020:00000001:16.0:1773851898.381105:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851898.381106:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a59f80
00000020:00000001:16.0:1773851898.381106:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851898.381107:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000575ac09a refcount=9
00000020:00000001:16.0:1773851898.381108:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637093020567552 : -106980688984064 : ffff9eb39e090800)
00000020:00000001:16.0:1773851898.381109:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637093020567552 : -106980688984064 : ffff9eb39e090800)
00000100:00000001:16.0:1773851898.381110:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.381111:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851898.381111:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6dc2e6b.
00000020:00000010:16.0:1773851898.381112:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.381113:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e696e90a.
00000100:00000001:16.0:1773851898.381114:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851898.381114:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851898.381115:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851898.381115:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851898.381116:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851898.381116:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.381117:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.381119:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851898.381119:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851898.381119:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851898.381119:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851898.381120:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16704@kfi7, seq: 2156434
00000100:00000001:19.0:1773851898.381121:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.381121:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000575ac09a : new rpc_count 1
00000100:00000001:19.0:1773851898.381122:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.381122:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609993088 : -107015099558528 : ffff9eab9b015580)
00000100:00000040:16.0:1773851898.381123:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000aa4623a3 x1860015976767168/t0(0) o400->4cab7779-d619-43b7-8930-19969db2ae47@16704@kfi7:150/0 lens 224/0 e 0 to 0 dl 1773852265 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1540-0'
00000100:00000001:16.0:1773851898.381126:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.381126:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851898.381127:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000aa4623a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4cab7779-d619-43b7-8930-19969db2ae47+9:59290:x1860015976767168:12345-16704@kfi7:400:default-tuolumne1540-0
00000100:00000200:16.0:1773851898.381129:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860015976767168
00000020:00000001:16.0:1773851898.381129:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851898.381130:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851898.381130:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.381131:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851898.381131:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851898.381132:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851898.381132:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860015976767168, found 0 last_xid 1860015976767167
00000020:00000001:16.0:1773851898.381133:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851898.381133:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851898.381134:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851898.381134:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.381135:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851898.381135:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851898.381136:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851898.381138:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000072b1a5d6.
02000000:00000001:16.0:1773851898.381138:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.381139:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.381140:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851898.381141:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860015976767168
00010000:00000001:16.0:1773851898.381142:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851898.381142:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000aa4623a3 x1860015976767168/t0(0) o400->4cab7779-d619-43b7-8930-19969db2ae47@16704@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1540-0'
00010000:00000001:16.0:1773851898.381144:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851898.381145:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851898.381146:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=131 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851898.381147:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851898.381147:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000011e22fb6 refcount 3 to 16704@kfi7
00000100:00000001:16.0:1773851898.381148:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637126492775744 : -106947216775872 : ffff9ebb69226540)
02000000:00000001:16.0:1773851898.381149:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851898.381149:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.381150:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851898.381151:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16768@kfi7
00000400:00000010:16.0:1773851898.381151:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000493fb085.
00000100:00000200:16.0:1773851898.381152:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860015976767168, offset 224
00000400:00000200:16.0:1773851898.381154:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16768@kfi7
00000400:00000200:16.0:1773851898.381154:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.381155:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 1
00000400:00000200:16.0:1773851898.381156:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000400:00000200:16.0:1773851898.381157:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 3
00000400:00000200:16.0:1773851898.381158:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16768@kfi7 local destination
00000400:00000200:16.0:1773851898.381160:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770283:8770283:1024:4294967295] 16768@kfi7 LPNI seq info [97763:97763:16:4294967295]
00000400:00000200:16.0:1773851898.381161:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000400:00000200:16.0:1773851898.381162:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16768@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.381164:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16768@kfi7(16768@kfi7:16768@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851898.381165:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 3
00000800:00000200:16.0:1773851898.381166:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851898.381167:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851898.381169:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851898.381172:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 Using peer 16768@kfi7(0x100000000001280)
00000800:00000200:16.0:1773851898.381175:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x100000000001280: rc=0
00000800:00000200:16.0:1773851898.381176:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851898.381178:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.381179:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000011e22fb6 refcount 2 to 16704@kfi7
00010000:00000001:16.0:1773851898.381180:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851898.381180:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.381181:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851898.381181:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000aa4623a3 x1860015976767168/t0(0) o400->4cab7779-d619-43b7-8930-19969db2ae47@16704@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1540-0'
00000100:00100000:16.0:1773851898.381186:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000aa4623a3 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:4cab7779-d619-43b7-8930-19969db2ae47+9:59290:x1860015976767168:12345-16704@kfi7:400:default-tuolumne1540-0 Request processed in 59us (87us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851898.381188:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16704@kfi7, seq: 2156434
00000100:00000040:16.0:1773851898.381189:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000575ac09a : new rpc_count 0
00000100:00000001:16.0:1773851898.381190:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851898.381190:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851898.381191:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.381191:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e696e90a.
00000020:00000010:16.0:1773851898.381192:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6dc2e6b.
00000020:00000040:16.0:1773851898.381193:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000575ac09a : new refcount 8
00000100:00000001:16.0:1773851898.381194:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851898.381198:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851898.381202:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.381203:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16768@kfi7: PUT: OK
00000400:00000200:17.0:1773851898.381204:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000493fb085
00000400:00000010:17.0:1773851898.381205:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000493fb085.
00000100:00000001:17.0:1773851898.381205:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851898.381206:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851898.381207:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000073dac11a nid 16768@kfi7 refs 2
00000800:00000200:17.0:1773851898.381208:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 16768@kfi7(000000000f590212):0x0 lsk 4737 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000001280 Transaction freed
00000800:00000200:17.0:1773851898.466297:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851898.466298:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851898.466300:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851898.466303:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851898.466306:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.466308:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22161@kfi7 : PUT - for me
00000400:00000200:17.0:1773851898.466310:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.466311:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 1
00000400:00000200:17.0:1773851898.466313:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.466314:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000400:00000200:17.0:1773851898.466316:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 3
00000400:00000200:17.0:1773851898.466317:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.466318:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22161@kfi7 of length 224 into portal 12 MB=0x699e0fc04df40
00000400:00000200:17.0:1773851898.466320:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22161@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 47248
00000800:00000200:17.0:1773851898.466323:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851898.466326:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.466327:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22161@kfi7: PUT: OK
00000100:00000001:17.0:1773851898.466329:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851898.466329:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851898.466331:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e95ad2a2.
00000100:00000040:17.0:1773851898.466332:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000e95ad2a2 x1858041440165696 msgsize 224
00000100:00100000:17.0:1773851898.466334:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-22161@kfi7 (source: 12345-22161@kfi7)
00000100:00000001:17.0:1773851898.466335:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851898.466337:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000100:00000001:16.0:1773851898.466338:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:17.0:1773851898.466339:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851898.466339:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851898.466339:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851898.466340:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851898.466341:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851898.466342:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041440165696
00000020:00000001:16.0:1773851898.466343:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851898.466343:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92180
00000020:00000001:16.0:1773851898.466345:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851898.466348:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b3318ef8 refcount=6
00000020:00000001:16.0:1773851898.466349:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629751808 : -107123079799808 : ffff9e9276e19c00)
00000020:00000001:16.0:1773851898.466350:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629751808 : -107123079799808 : ffff9e9276e19c00)
00000100:00000001:16.0:1773851898.466351:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.466352:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851898.466353:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e6dc2e6b.
00000020:00000010:16.0:1773851898.466354:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.466355:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e696e90a.
00000100:00000001:16.0:1773851898.466356:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851898.466357:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851898.466357:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851898.466359:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851898.466359:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851898.466360:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.466361:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.466363:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851898.466363:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851898.466363:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851898.466364:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851898.466365:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22161@kfi7, seq: 2156435
00000100:00000001:19.0:1773851898.466366:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.466366:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b3318ef8 : new rpc_count 1
00000100:00000001:19.0:1773851898.466367:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.466367:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794785792 : -107029914765824 : ffff9ea827f33600)
00000100:00000040:16.0:1773851898.466368:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e95ad2a2 x1858041440165696/t0(0) o400->e9ba12f7-5ce9-4db2-ac30-fa369bca6177@22161@kfi7:150/0 lens 224/0 e 0 to 0 dl 1773852265 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1874-0'
00000100:00000001:16.0:1773851898.466373:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.466373:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851898.466375:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e95ad2a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e9ba12f7-5ce9-4db2-ac30-fa369bca6177+6:39688:x1858041440165696:12345-22161@kfi7:400:default-tuolumne1874-0
00000100:00000200:16.0:1773851898.466376:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041440165696
00000020:00000001:16.0:1773851898.466377:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851898.466378:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851898.466379:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.466380:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851898.466380:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851898.466382:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851898.466383:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041440165696, found 0 last_xid 1858041440165695
00000020:00000001:16.0:1773851898.466384:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851898.466385:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851898.466386:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851898.466386:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.466387:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851898.466388:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851898.466388:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851898.466390:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000585b203c.
02000000:00000001:16.0:1773851898.466391:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.466392:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.466393:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851898.466394:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668602316, transno 0, xid 1858041440165696
00010000:00000001:16.0:1773851898.466395:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851898.466396:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e95ad2a2 x1858041440165696/t0(0) o400->e9ba12f7-5ce9-4db2-ac30-fa369bca6177@22161@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1874-0'
00010000:00000001:16.0:1773851898.466400:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851898.466400:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851898.466401:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=131 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851898.466403:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851898.466404:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008b56ec05 refcount 3 to 22161@kfi7
00000100:00000001:16.0:1773851898.466405:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583519104 : -107156126032512 : ffff9e8ac52c1d80)
02000000:00000001:16.0:1773851898.466406:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851898.466407:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.466408:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851898.466409:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22161@kfi7
00000400:00000010:16.0:1773851898.466410:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003d3d92cb.
00000100:00000200:16.0:1773851898.466411:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041440165696, offset 224
00000400:00000200:16.0:1773851898.466414:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22161@kfi7
00000400:00000200:16.0:1773851898.466415:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.466417:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 1
00000400:00000200:16.0:1773851898.466418:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000400:00000200:16.0:1773851898.466420:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 3
00000400:00000200:16.0:1773851898.466423:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22161@kfi7 local destination
00000400:00000200:16.0:1773851898.466425:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770284:8770284:1024:4294967295] 22161@kfi7 LPNI seq info [1627907:1627907:16:4294967295]
00000400:00000200:16.0:1773851898.466428:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000400:00000200:16.0:1773851898.466429:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22161@kfi7 to cpt 4
00000400:00000200:16.0:1773851898.466433:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22161@kfi7(22161@kfi7:22161@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851898.466435:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 3
00000800:00000200:16.0:1773851898.466437:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851898.466439:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851898.466443:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851898.466447:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000096b Using peer 22161@kfi7(0x10000000000096b)
00000800:00000200:16.0:1773851898.466452:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000279c411a: Posted send of 324 bytes to peer 0x10000000000096b: rc=0
00000800:00000200:16.0:1773851898.466454:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000096b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851898.466458:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851898.466459:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008b56ec05 refcount 2 to 22161@kfi7
00010000:00000001:16.0:1773851898.466463:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851898.466463:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851898.466464:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851898.466466:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e95ad2a2 x1858041440165696/t0(0) o400->e9ba12f7-5ce9-4db2-ac30-fa369bca6177@22161@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1874-0'
00000100:00100000:16.0:1773851898.466471:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e95ad2a2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e9ba12f7-5ce9-4db2-ac30-fa369bca6177+6:39688:x1858041440165696:12345-22161@kfi7:400:default-tuolumne1874-0 Request processed in 98us (138us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851898.466475:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22161@kfi7, seq: 2156435
00000100:00000040:16.0:1773851898.466476:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b3318ef8 : new rpc_count 0
00000100:00000001:16.0:1773851898.466478:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851898.466478:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851898.466480:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.466481:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e696e90a.
00000020:00000010:16.0:1773851898.466483:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e6dc2e6b.
00000020:00000040:16.0:1773851898.466484:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b3318ef8 : new refcount 5
00000100:00000001:16.0:1773851898.466485:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851898.466493:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000096b TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851898.466496:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.466498:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22161@kfi7: PUT: OK
00000400:00000200:17.0:1773851898.466499:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003d3d92cb
00000400:00000010:17.0:1773851898.466500:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003d3d92cb.
00000100:00000001:17.0:1773851898.466501:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851898.466502:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851898.466503:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000000bf6035 nid 22161@kfi7 refs 2
00000800:00000200:17.0:1773851898.466505:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000279c411a: 2054@kfi7:4 -> 22161@kfi7(0000000074fb70cc):0x0 lsk 2412 rsk 51 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000096b Transaction freed
00000800:00000200:19.0:1773851898.492913:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851898.492914:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:19.0:1773851898.492915:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000822b3938: 2054@kfi7:4 <- 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:19.0:1773851898.492917:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000822b3938: 2054@kfi7:4 <- 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:19.0:1773851898.492919:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.492920:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23601@kfi7 : PUT - for me
00000400:00000200:19.0:1773851898.492921:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.492922:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008b54c4e nid 23601@kfi7 refs 1
00000400:00000200:19.0:1773851898.492923:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.492924:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008b54c4e nid 23601@kfi7 refs 2
00000400:00000200:19.0:1773851898.492925:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000008b54c4e nid 23601@kfi7 refs 3
00000400:00000200:19.0:1773851898.492926:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.492926:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23601@kfi7 of length 224 into portal 12 MB=0x69b09d709f940
00000400:00000200:19.0:1773851898.492928:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23601@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 47472
00000800:00000200:19.0:1773851898.492930:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000822b3938: 2054@kfi7:4 <- 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:19.0:1773851898.492932:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:19.0:1773851898.492933:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23601@kfi7: PUT: OK
00000100:00000001:19.0:1773851898.492934:0:2464491:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:19.0:1773851898.492934:0:2464491:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:19.0:1773851898.492935:0:2464491:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b1432cd9.
00000100:00000040:19.0:1773851898.492936:0:2464491:0:(events.c:358:request_in_callback()) incoming req@00000000b1432cd9 x1859316425029952 msgsize 224
00000100:00100000:19.0:1773851898.492937:0:2464491:0:(events.c:361:request_in_callback()) peer: 12345-23601@kfi7 (source: 12345-23601@kfi7)
00000100:00000001:19.0:1773851898.492938:0:2464491:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:19.0:1773851898.492939:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000008b54c4e nid 23601@kfi7 refs 2
00000800:00000200:19.0:1773851898.492940:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000822b3938: 2054@kfi7:4 <- 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851898.492940:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851898.492941:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851898.492942:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851898.492943:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851898.492944:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851898.492945:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316425029952
00000020:00000001:16.0:1773851898.492946:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851898.492946:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90e08
00000020:00000001:16.0:1773851898.492947:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851898.492949:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000073eddc97 refcount=6
00000020:00000001:16.0:1773851898.492950:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239636992 : -107152469914624 : ffff9e8b9f180c00)
00000020:00000001:16.0:1773851898.492951:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239636992 : -107152469914624 : ffff9e8b9f180c00)
00000100:00000001:16.0:1773851898.492953:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851898.492954:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851898.492955:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000a80febe.
00000020:00000010:16.0:1773851898.492956:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4710371.
00000020:00000010:16.0:1773851898.492957:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e696e90a.
00000100:00000001:16.0:1773851898.492958:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851898.492959:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851898.492960:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851898.492961:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851898.492962:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851898.492962:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851898.492963:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.492965:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851898.492965:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851898.492965:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851898.492966:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23601@kfi7, seq: 2156436
00000100:00000001:16.0:1773851898.492966:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851898.492967:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000073eddc97 : new rpc_count 1
00000100:00000001:16.0:1773851898.492967:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.492968:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637086339147904 : -106987370403712 : ffff9eb20fcaa880)
00000100:00000001:16.0:1773851898.492968:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851898.492969:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b1432cd9 x1859316425029952/t0(0) o400->65dcbf64-8a8a-4216-acb5-bb5ac5392ac1@23601@kfi7:686/0 lens 224/0 e 0 to 0 dl 1773852046 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1965-0'
00000100:00000001:19.0:1773851898.492971:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851898.492972:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851898.492972:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b1432cd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:65dcbf64-8a8a-4216-acb5-bb5ac5392ac1+6:39832:x1859316425029952:12345-23601@kfi7:400:default-tuolumne1965-0
00000100:00000200:19.0:1773851898.492973:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316425029952
00000020:00000001:19.0:1773851898.492974:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851898.492975:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851898.492975:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.492976:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851898.492976:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851898.492977:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851898.492977:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316425029952, found 0 last_xid 1859316425029951
00000020:00000001:19.0:1773851898.492978:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851898.492979:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851898.492979:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851898.492979:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.492980:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851898.492980:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851898.492981:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851898.492981:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000013afd4e8.
02000000:00000001:19.0:1773851898.492982:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.492982:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.492983:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851898.492983:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859316425029952
00010000:00000001:19.0:1773851898.492984:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851898.492985:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b1432cd9 x1859316425029952/t0(0) o400->65dcbf64-8a8a-4216-acb5-bb5ac5392ac1@23601@kfi7:686/0 lens 224/224 e 0 to 0 dl 1773852046 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1965-0'
00010000:00000001:19.0:1773851898.492987:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851898.492988:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851898.492988:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=131 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851898.492989:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851898.492990:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ab3415d6 refcount 5 to 23601@kfi7
00000100:00000001:19.0:1773851898.492991:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583903744 : -107156125647872 : ffff9e8ac531fc00)
02000000:00000001:19.0:1773851898.492991:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851898.492992:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.492992:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851898.492993:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23601@kfi7
00000400:00000010:19.0:1773851898.492993:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cf6e4638.
00000100:00000200:19.0:1773851898.492994:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316425029952, offset 224
00000400:00000200:19.0:1773851898.492996:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23601@kfi7
00000400:00000200:19.0:1773851898.492996:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.492997:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008b54c4e nid 23601@kfi7 refs 1
00000400:00000200:19.0:1773851898.492998:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000008b54c4e nid 23601@kfi7 refs 2
00000400:00000200:19.0:1773851898.492999:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000008b54c4e nid 23601@kfi7 refs 3
00000400:00000200:19.0:1773851898.493000:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23601@kfi7 local destination
00000400:00000200:19.0:1773851898.493001:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770285:8770285:1024:4294967295] 23601@kfi7 LPNI seq info [169908:169908:16:4294967295]
00000400:00000200:19.0:1773851898.493002:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000008b54c4e nid 23601@kfi7 refs 2
00000400:00000200:19.0:1773851898.493003:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23601@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.493005:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23601@kfi7(23601@kfi7:23601@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851898.493006:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000008b54c4e nid 23601@kfi7 refs 3
00000800:00000200:19.0:1773851898.493007:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851898.493008:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851898.493010:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851898.493012:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008eb Using peer 23601@kfi7(0x1000000000008eb)
00000800:00000200:19.0:1773851898.493018:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x1000000000008eb: rc=0
00000800:00000200:19.0:1773851898.493019:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851898.493021:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851898.493022:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ab3415d6 refcount 4 to 23601@kfi7
00010000:00000001:19.0:1773851898.493022:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851898.493023:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.493023:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851898.493024:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b1432cd9 x1859316425029952/t0(0) o400->65dcbf64-8a8a-4216-acb5-bb5ac5392ac1@23601@kfi7:686/0 lens 224/224 e 0 to 0 dl 1773852046 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1965-0'
00000100:00100000:19.0:1773851898.493027:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b1432cd9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:65dcbf64-8a8a-4216-acb5-bb5ac5392ac1+6:39832:x1859316425029952:12345-23601@kfi7:400:default-tuolumne1965-0 Request processed in 55us (90us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851898.493029:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23601@kfi7, seq: 2156436
00000100:00000040:19.0:1773851898.493030:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000073eddc97 : new rpc_count 0
00000100:00000001:19.0:1773851898.493030:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851898.493031:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851898.493031:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4710371.
00000020:00000010:19.0:1773851898.493032:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e696e90a.
00000020:00000010:19.0:1773851898.493033:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000a80febe.
00000020:00000040:19.0:1773851898.493033:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000073eddc97 : new refcount 5
00000800:00000200:17.0:1773851898.493033:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008eb TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851898.493034:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851898.493036:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.493038:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23601@kfi7: PUT: OK
00000400:00000200:17.0:1773851898.493039:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cf6e4638
00000400:00000010:17.0:1773851898.493039:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cf6e4638.
00000100:00000001:17.0:1773851898.493040:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851898.493041:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851898.493042:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000008b54c4e nid 23601@kfi7 refs 2
00000800:00000200:17.0:1773851898.493044:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 23601@kfi7(00000000dbd5ec75):0x0 lsk 2284 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000008eb Transaction freed
00000800:00000200:21.0:1773851898.512649:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851898.512650:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851898.512651:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851898.512653:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851898.512655:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:21.0:1773851898.512657:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25730@kfi7 : PUT - for me
00000400:00000200:21.0:1773851898.512658:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:21.0:1773851898.512659:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 1
00000400:00000200:21.0:1773851898.512660:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:21.0:1773851898.512661:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000400:00000200:21.0:1773851898.512662:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 3
00000400:00000200:21.0:1773851898.512662:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:21.0:1773851898.512663:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25667@kfi7 of length 376 into portal 12 MB=0x69b4b61bf3a40
00000400:00000200:21.0:1773851898.512665:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25667@kfi7 of length 376/376 into md 0x6a32cacf5 [64] + 65840
00000800:00000200:21.0:1773851898.512667:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851898.512669:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851898.512670:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25730@kfi7: PUT: OK
00000100:00000001:21.0:1773851898.512671:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851898.512671:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851898.512673:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000d8082cf.
00000100:00000040:21.0:1773851898.512673:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000d8082cf x1859597925038656 msgsize 376
00000100:00100000:21.0:1773851898.512675:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25667@kfi7 (source: 12345-25730@kfi7)
00000100:00000001:21.0:1773851898.512676:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851898.512677:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000100:00000001:20.0:1773851898.512677:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851898.512678:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851898.512678:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851898.512679:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851898.512679:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851898.512680:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851898.512681:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597925038656
00000020:00000001:20.0:1773851898.512682:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851898.512682:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74122
00000020:00000001:20.0:1773851898.512683:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851898.512687:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d60686f refcount=453
00000020:00000001:20.0:1773851898.512688:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000020:00000001:20.0:1773851898.512689:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000100:00000001:20.0:1773851898.512690:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851898.512691:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851898.512692:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851898.512693:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851898.512694:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b64450ab.
00000100:00000001:20.0:1773851898.512695:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851898.512695:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:20.0:1773851898.512696:0:60934:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:20.0:1773851898.512696:0:60934:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851898.512697:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851898.512698:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851898.512699:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851898.512702:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851898.512702:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851898.512702:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851898.512702:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851898.512704:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25667@kfi7, seq: 335333155
00000100:00000040:23.0:1773851898.512705:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009d60686f : new rpc_count 11
00000100:00000001:20.0:1773851898.512705:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851898.512706:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701981312 : -106936007570304 : ffff9ebe05414c80)
00000100:00000001:20.0:1773851898.512706:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851898.512708:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000d8082cf x1859597925038656/t0(0) o101->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:625/0 lens 376/0 e 0 to 0 dl 1773851985 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111525036260352'
00000100:00000001:23.0:1773851898.512711:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851898.512711:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851898.512712:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000d8082cf pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:edddd82f-128c-4bbd-98a4-4162bc248cc0+453:290286:x1859597925038656:12345-25667@kfi7:101:tuolumne-833111525036260352
00000100:00000200:23.0:1773851898.512714:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597925038656
00000020:00000001:23.0:1773851898.512715:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851898.512715:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851898.512716:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851898.512717:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851898.512717:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:23.0:1773851898.512718:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851898.512719:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597925038656, found 0 last_xid 1859597917438335
00000020:00000001:23.0:1773851898.512720:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851898.512721:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851898.512721:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851898.512722:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851898.512723:0:61145:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:23.0:1773851898.512723:0:61145:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:23.0:1773851898.512724:0:61145:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:23.0:1773851898.512728:0:61145:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:23.0:1773851898.512728:0:61145:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851898.512730:0:61145:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:23.0:1773851898.512732:0:61145:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000ba4d0368 count: 2
00010000:00000001:23.0:1773851898.512733:0:61145:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851898.512734:0:61145:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:23.0:1773851898.512734:0:61145:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000004040a90b.
00000020:00000001:23.0:1773851898.512735:0:61145:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:23.0:1773851898.512736:0:61145:0:(lustre_handles.c:97:class_handle_hash()) added object 000000004040a90b with handle 0x21b6f08f07a6aec0 to hash
00000020:00000001:23.0:1773851898.512736:0:61145:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:23.0:1773851898.512737:0:61145:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158703505280 : -106915006046336 : ffff9ec2e90b1f80)
00010000:00000010:23.0:1773851898.512737:0:61145:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000d52e94aa.
00010000:00000001:23.0:1773851898.512738:0:61145:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158703505280 : -106915006046336 : ffff9ec2e90b1f80)
00010000:00010000:23.0:1773851898.512739:0:61145:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000004040a90b/0x21b6f08f07a6aec0 lrc: 2/0,0 mode: --/CR res: [0x240023497:0x121ed:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf113e19a5e6738ed expref: -99 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851898.512741:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba4d0368 count: 2
00010000:00000040:23.0:1773851898.512742:0:61145:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000009d60686f : new locks_count 376
00000020:00000040:23.0:1773851898.512743:0:61145:0:(genops.c:871:class_export_get()) GET export 000000009d60686f refcount=454
00010000:00000001:23.0:1773851898.512745:0:61145:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:23.0:1773851898.512745:0:61145:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:23.0:1773851898.512746:0:61145:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:23.0:1773851898.512747:0:61145:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:23.0:1773851898.512747:0:61145:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851898.512748:0:61145:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:23.0:1773851898.512749:0:61145:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x240023497:0x121ed:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:23.0:1773851898.512750:0:61145:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:23.0:1773851898.512750:0:61145:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240023497:0x121ed:0x0]
00000020:00000001:23.0:1773851898.512751:0:61145:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:23.0:1773851898.512752:0:61145:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637114972404584 : -106958737147032 : ffff9eb8ba777b68)
00000004:00000001:23.0:1773851898.512752:0:61145:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637114972404496 : -106958737147120 : ffff9eb8ba777b10)
00000004:00000001:23.0:1773851898.512754:0:61145:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:23.0:1773851898.512757:0:61145:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:23.0:1773851898.512757:0:61145:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:23.0:1773851898.512760:0:61145:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512761:0:61145:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512762:0:61145:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:23.0:1773851898.512763:0:61145:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:23.0:1773851898.512764:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851898.512764:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851898.512765:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 00000000da7e34d1.
02000000:00000001:23.0:1773851898.512766:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851898.512767:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851898.512768:0:61145:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:23.0:1773851898.512768:0:61145:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:23.0:1773851898.512769:0:61145:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:23.0:1773851898.512769:0:61145:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851898.512770:0:61145:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851898.512770:0:61145:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:23.0:1773851898.512771:0:61145:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:23.0:1773851898.512771:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851898.512772:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851898.512773:0:61145:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:23.0:1773851898.512773:0:61145:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851898.512774:0:61145:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:23.0:1773851898.512774:0:61145:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:23.0:1773851898.512774:0:61145:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:23.0:1773851898.512775:0:61145:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:23.0:1773851898.512775:0:61145:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240023497:0x121ed:0x0].0x0 (00000000ba4d0368) refcount = 2
00010000:00000040:23.0:1773851898.512776:0:61145:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:23.0:1773851898.512777:0:61145:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000776da7e6/0x21b6f08f07a41bf5 lrc: 2/0,0 mode: CR/CR res: [0x240023497:0x121ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 25667@kfi7 remote: 0xf113e19a5e660cdb expref: 454 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851898.512779:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba4d0368 count: 2
00010000:00010000:23.0:1773851898.512780:0:61145:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000004040a90b/0x21b6f08f07a6aec0 lrc: 3/0,0 mode: CR/CR res: [0x240023497:0x121ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6738ed expref: 454 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851898.512781:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba4d0368 count: 2
00010000:00000001:23.0:1773851898.512782:0:61145:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:23.0:1773851898.512783:0:61145:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:23.0:1773851898.512783:0:61145:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851898.512784:0:61145:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:23.0:1773851898.512784:0:61145:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851898.512785:0:61145:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851898.512785:0:61145:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:23.0:1773851898.512786:0:61145:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:23.0:1773851898.512786:0:61145:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000004040a90b/0x21b6f08f07a6aec0 lrc: 3/0,0 mode: CR/CR res: [0x240023497:0x121ed:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 25667@kfi7 remote: 0xf113e19a5e6738ed expref: 454 pid: 61145 timeout: 0 lvb_type: 0
00010000:00000040:23.0:1773851898.512788:0:61145:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000ba4d0368 count: 2
00000004:00000001:23.0:1773851898.512789:0:61145:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:23.0:1773851898.512790:0:61145:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:23.0:1773851898.512790:0:61145:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240023497:0x121ed:0x0]
00000020:00000001:23.0:1773851898.512791:0:61145:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:23.0:1773851898.512791:0:61145:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637114972404584 : -106958737147032 : ffff9eb8ba777b68)
00000004:00000001:23.0:1773851898.512792:0:61145:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637114972404496 : -106958737147120 : ffff9eb8ba777b10)
00000004:00000001:23.0:1773851898.512792:0:61145:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:23.0:1773851898.512793:0:61145:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:23.0:1773851898.512793:0:61145:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:23.0:1773851898.512794:0:61145:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512794:0:61145:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512795:0:61145:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512795:0:61145:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:23.0:1773851898.512795:0:61145:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:23.0:1773851898.512796:0:61145:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:23.0:1773851898.512796:0:61145:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512797:0:61145:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512797:0:61145:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:23.0:1773851898.512798:0:61145:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:23.0:1773851898.512798:0:61145:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:23.0:1773851898.512799:0:61145:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:23.0:1773851898.512800:0:61145:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:23.0:1773851898.512800:0:61145:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:23.0:1773851898.512801:0:61145:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240023497:0x121ed:0x0].0x0 (00000000ba4d0368)
00010000:00010000:23.0:1773851898.512802:0:61145:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:23.0:1773851898.512803:0:61145:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:23.0:1773851898.512803:0:61145:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:23.0:1773851898.512804:0:61145:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:23.0:1773851898.512805:0:61145:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:23.0:1773851898.512805:0:61145:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:23.0:1773851898.512806:0:61145:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000004040a90b, rc 0)
00000020:00000001:23.0:1773851898.512806:0:61145:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851898.512807:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584921, transno 0, xid 1859597925038656
00010000:00000001:23.0:1773851898.512808:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851898.512809:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000d8082cf x1859597925038656/t0(0) o101->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:625/0 lens 376/1080 e 0 to 0 dl 1773851985 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111525036260352'
00010000:00000001:23.0:1773851898.512811:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851898.512812:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851898.512812:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=131 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851898.512813:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851898.512814:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc978f5f refcount 3 to 25667@kfi7
00000100:00000001:23.0:1773851898.512815:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106880 : -107156354444736 : ffff9e8ab78ed240)
02000000:00000001:23.0:1773851898.512815:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851898.512816:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851898.512816:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851898.512817:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25730@kfi7
00000400:00000010:23.0:1773851898.512818:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001f94b366.
00000100:00000200:23.0:1773851898.512819:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1859597925038656, offset 224
00000400:00000200:23.0:1773851898.512820:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25730@kfi7
00000400:00000200:23.0:1773851898.512822:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:23.0:1773851898.512822:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 1
00000400:00000200:23.0:1773851898.512824:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000400:00000200:23.0:1773851898.512825:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 3
00000400:00000200:23.0:1773851898.512826:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25730@kfi7 local destination
00000400:00000200:23.0:1773851898.512828:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770286:8770286:1024:4294967295] 25730@kfi7 LPNI seq info [611808:611808:16:4294967295]
00000400:00000200:23.0:1773851898.512829:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000400:00000200:23.0:1773851898.512830:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25730@kfi7 to cpt 5
00000400:00000200:23.0:1773851898.512832:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25730@kfi7(25730@kfi7:25730@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851898.512833:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 3
00000800:00000200:23.0:1773851898.512834:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851898.512836:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000800:00000200:23.0:1773851898.512838:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851898.512840:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 Using peer 25730@kfi7(0x100000000000ee8)
00000800:00000200:23.0:1773851898.512844:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000003da230f: Posted send of 1180 bytes to peer 0x100000000000ee8: rc=0
00000800:00000200:23.0:1773851898.512845:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851898.512847:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851898.512848:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc978f5f refcount 2 to 25667@kfi7
00010000:00000001:23.0:1773851898.512848:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851898.512849:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851898.512850:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851898.512850:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000d8082cf x1859597925038656/t0(0) o101->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:625/0 lens 376/1080 e 0 to 0 dl 1773851985 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111525036260352'
00000100:00100000:23.0:1773851898.512853:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000d8082cf pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:edddd82f-128c-4bbd-98a4-4162bc248cc0+454:290286:x1859597925038656:12345-25667@kfi7:101:tuolumne-833111525036260352 Request processed in 141us (179us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851898.512855:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25667@kfi7, seq: 335333155
00000100:00000040:23.0:1773851898.512856:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009d60686f : new rpc_count 10
00000800:00000200:21.0:1773851898.512856:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851898.512857:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851898.512857:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851898.512858:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000400:00000200:21.0:1773851898.512858:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851898.512859:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b64450ab.
00000400:00000200:21.0:1773851898.512859:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25730@kfi7: PUT: OK
00000400:00000200:21.0:1773851898.512859:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001f94b366
00000020:00000010:23.0:1773851898.512860:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:23.0:1773851898.512860:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 453
00000400:00000010:21.0:1773851898.512860:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001f94b366.
00000100:00000001:23.0:1773851898.512861:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851898.512861:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851898.512861:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851898.512862:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c3be5109 nid 25730@kfi7 refs 2
00000800:00000200:21.0:1773851898.512863:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2054@kfi7:5 -> 25730@kfi7(0000000061eba661):0x0 lsk 3817 rsk 42 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000ee8 Transaction freed
00000800:00000200:10.0:1773851898.568213:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851898.568214:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851898.568216:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851898.568218:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851898.568220:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851898.568221:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.41@o2ib60 : PUT - for me
00000400:00000200:10.0:1773851898.568222:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:10.0:1773851898.568223:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:10.0:1773851898.568225:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.41@o2ib60 to cpt 2
00000400:00000200:10.0:1773851898.568226:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 2
00000400:00000200:10.0:1773851898.568227:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 3
00000400:00000200:10.0:1773851898.568228:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.41@o2ib60 to cpt 2
00000400:00000200:10.0:1773851898.568229:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.41@o2ib60 of length 224 into portal 12 MB=0x69b216b98f680
00000400:00000200:10.0:1773851898.568231:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.41@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 163064
00000800:00000200:10.0:1773851898.568233:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851898.568235:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851898.568236:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:10.0:1773851898.568237:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851898.568238:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851898.568239:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003c8e68d6.
00000100:00000040:10.0:1773851898.568239:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000003c8e68d6 x1859417701676672 msgsize 224
00000100:00100000:10.0:1773851898.568241:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.41@o2ib60 (source: 12345-192.168.128.41@o2ib60)
00000100:00000001:10.0:1773851898.568242:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851898.568243:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:11.0:1773851898.568244:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851898.568244:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851898.568245:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851898.568246:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851898.568246:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851898.568246:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00100000:11.0:1773851898.568247:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859417701676672
00000020:00000001:11.0:1773851898.568248:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851898.568248:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ad8f
00000020:00000001:11.0:1773851898.568249:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851898.568252:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a7dacd53 refcount=6
00000020:00000001:11.0:1773851898.568253:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113217495040 : -106960492056576 : ffff9eb851ddb000)
00000020:00000001:11.0:1773851898.568254:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113217495040 : -106960492056576 : ffff9eb851ddb000)
00000100:00000001:11.0:1773851898.568255:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.568256:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851898.568257:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000816b63bf.
00000020:00000010:11.0:1773851898.568258:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851898.568259:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007dac8f6e.
00000100:00000001:11.0:1773851898.568260:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851898.568261:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851898.568261:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.568262:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851898.568263:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851898.568263:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.568264:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.568265:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851898.568266:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851898.568267:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.41@o2ib60, seq: 2130875
00000100:00000001:8.0:1773851898.568267:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:11.0:1773851898.568268:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a7dacd53 : new rpc_count 2
00000100:00000001:8.0:1773851898.568268:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851898.568269:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087756416 : -106944621795200 : ffff9ebc03cea880)
00000100:00000001:8.0:1773851898.568269:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.568270:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003c8e68d6 x1859417701676672/t0(0) o400->9d12c826-b35e-43a0-8ab1-06827351a10f@192.168.128.41@o2ib60:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix41-0'
00000100:00000001:8.0:1773851898.568270:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.568273:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.568274:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851898.568275:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003c8e68d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9d12c826-b35e-43a0-8ab1-06827351a10f+6:40080:x1859417701676672:12345-192.168.128.41@o2ib60:400:default-matrix41-0
00000100:00000200:11.0:1773851898.568276:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859417701676672
00000020:00000001:11.0:1773851898.568277:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851898.568278:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851898.568278:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.568279:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851898.568280:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851898.568280:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851898.568281:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859417701676672, found 0 last_xid 1859417701358783
00000020:00000001:11.0:1773851898.568282:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851898.568283:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851898.568283:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851898.568284:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.568285:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851898.568286:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851898.568286:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851898.568287:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000459f6c50.
02000000:00000001:11.0:1773851898.568288:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.568288:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.568289:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851898.568290:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183077434443, transno 0, xid 1859417701676672
00010000:00000001:11.0:1773851898.568291:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851898.568292:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003c8e68d6 x1859417701676672/t0(0) o400->9d12c826-b35e-43a0-8ab1-06827351a10f@192.168.128.41@o2ib60:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix41-0'
00010000:00000001:11.0:1773851898.568294:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851898.568295:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851898.568295:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=131 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851898.568297:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851898.568297:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dcf405e0 refcount 3 to 192.168.128.41@o2ib60
00000100:00000001:11.0:1773851898.568298:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133120 : -107146658418496 : ffff9e8cf97c70c0)
02000000:00000001:11.0:1773851898.568299:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851898.568300:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.568300:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851898.568301:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.41@o2ib60
00000400:00000010:11.0:1773851898.568302:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6296e37.
00000100:00000200:11.0:1773851898.568303:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859417701676672, offset 224
00000400:00000200:11.0:1773851898.568304:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.41@o2ib60
00000400:00000200:11.0:1773851898.568306:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.41@o2ib60 to cpt 2
00000400:00000200:11.0:1773851898.568307:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 2
00000400:00000200:11.0:1773851898.568308:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 3
00000400:00000200:11.0:1773851898.568310:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 4
00000400:00000200:11.0:1773851898.568311:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.41@o2ib60 routed destination
00000400:00000200:11.0:1773851898.568312:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:11.0:1773851898.568313:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:11.0:1773851898.568314:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.41@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851898.568316:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:11.0:1773851898.568317:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.41@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851898.568318:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:11.0:1773851898.568319:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770287:8770287:1024:4294967295] 2094@kfi7 LPNI seq info [1258747025:1258747025:16:4294967295]
00000400:00000200:11.0:1773851898.568320:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:11.0:1773851898.568321:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:11.0:1773851898.568324:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.41@o2ib60(192.168.128.41@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851898.568325:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007aa4722b nid 192.168.128.41@o2ib60 refs 3
00000800:00000200:11.0:1773851898.568327:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851898.568328:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851898.568330:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851898.568332:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:11.0:1773851898.568336:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:11.0:1773851898.568337:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851898.568340:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.568341:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dcf405e0 refcount 2 to 192.168.128.41@o2ib60
00010000:00000001:11.0:1773851898.568341:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851898.568342:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.568343:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851898.568343:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003c8e68d6 x1859417701676672/t0(0) o400->9d12c826-b35e-43a0-8ab1-06827351a10f@192.168.128.41@o2ib60:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix41-0'
00000100:00100000:11.0:1773851898.568347:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003c8e68d6 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:9d12c826-b35e-43a0-8ab1-06827351a10f+6:40080:x1859417701676672:12345-192.168.128.41@o2ib60:400:default-matrix41-0 Request processed in 72us (106us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851898.568349:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.41@o2ib60, seq: 2130875
00000800:00000200:10.0:1773851898.568349:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851898.568350:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a7dacd53 : new rpc_count 1
00000100:00000001:11.0:1773851898.568351:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851898.568351:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:11.0:1773851898.568352:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:10.0:1773851898.568352:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000020:00000010:11.0:1773851898.568353:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851898.568353:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007dac8f6e.
00000400:00000200:10.0:1773851898.568353:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6296e37
00000400:00000010:10.0:1773851898.568353:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6296e37.
00000020:00000010:11.0:1773851898.568354:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000816b63bf.
00000100:00000001:10.0:1773851898.568354:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851898.568354:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:11.0:1773851898.568355:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000a7dacd53 : new refcount 5
00000400:00000200:10.0:1773851898.568355:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000100:00000001:11.0:1773851898.568356:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851898.568357:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000000c Transaction freed
00000800:00000200:13.0:1773851898.585351:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851898.585352:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851898.585353:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851898.585355:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851898.585358:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24386@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.585359:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24386@kfi7 : PUT - for me
00000400:00000200:13.0:1773851898.585360:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24386@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.585361:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073fbfe8c nid 24386@kfi7 refs 1
00000400:00000200:13.0:1773851898.585362:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24386@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.585363:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073fbfe8c nid 24386@kfi7 refs 2
00000400:00000200:13.0:1773851898.585363:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000073fbfe8c nid 24386@kfi7 refs 3
00000400:00000200:13.0:1773851898.585364:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24386@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.585365:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24386@kfi7 of length 224 into portal 12 MB=0x69b4bcb40c2c0
00000400:00000200:13.0:1773851898.585366:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24386@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 58776
00000800:00000200:13.0:1773851898.585368:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851898.585370:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851898.585370:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24386@kfi7: PUT: OK
00000100:00000001:13.0:1773851898.585371:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851898.585372:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851898.585374:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad116d4c.
00000100:00000040:13.0:1773851898.585374:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ad116d4c x1859599695135424 msgsize 224
00000100:00100000:13.0:1773851898.585376:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24386@kfi7 (source: 12345-24386@kfi7)
00000100:00000001:13.0:1773851898.585377:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851898.585377:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000073fbfe8c nid 24386@kfi7 refs 2
00000100:00000001:12.0:1773851898.585378:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851898.585379:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851898.585379:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851898.585379:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851898.585380:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851898.585380:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851898.585381:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599695135424
00000020:00000001:12.0:1773851898.585382:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851898.585382:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389435dc
00000020:00000001:12.0:1773851898.585383:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851898.585387:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001de840a7 refcount=5
00000020:00000001:12.0:1773851898.585387:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637103112244224 : -106970597307392 : ffff9eb5f78bcc00)
00000020:00000001:12.0:1773851898.585388:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637103112244224 : -106970597307392 : ffff9eb5f78bcc00)
00000100:00000001:12.0:1773851898.585389:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851898.585389:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851898.585390:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e4ee393e.
00000020:00000010:12.0:1773851898.585391:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851898.585392:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000068cea08.
00000100:00000001:12.0:1773851898.585393:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851898.585393:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851898.585394:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851898.585394:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851898.585397:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851898.585397:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851898.585398:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851898.585399:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851898.585400:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851898.585400:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851898.585400:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851898.585401:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24386@kfi7, seq: 2289934
00000100:00000040:12.0:1773851898.585401:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001de840a7 : new rpc_count 1
00000100:00000001:15.0:1773851898.585402:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.585402:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851898.585402:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945738880 : -106919763812736 : ffff9ec1cd755e80)
00000100:00000040:12.0:1773851898.585403:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad116d4c x1859599695135424/t0(0) o400->c05dc7fc-80a5-43ad-91a0-a8b4341b0a0a@24386@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2024-0'
00000100:00000001:12.0:1773851898.585406:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851898.585406:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851898.585407:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad116d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:c05dc7fc-80a5-43ad-91a0-a8b4341b0a0a+5:39508:x1859599695135424:12345-24386@kfi7:400:default-tuolumne2024-0
00000100:00000200:12.0:1773851898.585408:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599695135424
00000020:00000001:12.0:1773851898.585408:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851898.585409:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851898.585410:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851898.585410:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851898.585411:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851898.585411:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851898.585412:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599695135424, found 0 last_xid 1859599695135423
00000020:00000001:12.0:1773851898.585413:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851898.585413:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851898.585413:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851898.585414:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851898.585415:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851898.585415:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851898.585416:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851898.585416:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000760fdc85.
02000000:00000001:12.0:1773851898.585417:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851898.585417:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851898.585418:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851898.585419:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046980402, transno 0, xid 1859599695135424
00010000:00000001:12.0:1773851898.585420:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851898.585420:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad116d4c x1859599695135424/t0(0) o400->c05dc7fc-80a5-43ad-91a0-a8b4341b0a0a@24386@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2024-0'
00010000:00000001:12.0:1773851898.585422:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851898.585423:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851898.585423:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=131 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851898.585424:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851898.585425:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e6f3fbda refcount 3 to 24386@kfi7
00000100:00000001:12.0:1773851898.585425:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298592 : -107155980253024 : ffff9e8acddc88a0)
02000000:00000001:12.0:1773851898.585426:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851898.585427:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851898.585427:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851898.585428:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24386@kfi7
00000400:00000010:12.0:1773851898.585428:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f4420963.
00000100:00000200:12.0:1773851898.585429:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599695135424, offset 224
00000400:00000200:12.0:1773851898.585430:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24386@kfi7
00000400:00000200:12.0:1773851898.585431:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24386@kfi7 to cpt 3
00000400:00000200:12.0:1773851898.585432:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000073fbfe8c nid 24386@kfi7 refs 1
00000400:00000200:12.0:1773851898.585433:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000073fbfe8c nid 24386@kfi7 refs 2
00000400:00000200:12.0:1773851898.585434:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000073fbfe8c nid 24386@kfi7 refs 3
00000400:00000200:12.0:1773851898.585435:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24386@kfi7 local destination
00000400:00000200:12.0:1773851898.585436:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770288:8770288:1024:4294967295] 24386@kfi7 LPNI seq info [10865875:10865875:16:4294967295]
00000400:00000200:12.0:1773851898.585437:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000073fbfe8c nid 24386@kfi7 refs 2
00000400:00000200:12.0:1773851898.585438:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24386@kfi7 to cpt 3
00000400:00000200:12.0:1773851898.585440:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24386@kfi7(24386@kfi7:24386@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851898.585441:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000073fbfe8c nid 24386@kfi7 refs 3
00000800:00000200:12.0:1773851898.585442:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851898.585443:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851898.585445:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851898.585448:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000016d Using peer 24386@kfi7(0x10000000000016d)
00000800:00000200:12.0:1773851898.585451:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x10000000000016d: rc=0
00000800:00000200:12.0:1773851898.585452:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000016d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851898.585454:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851898.585455:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e6f3fbda refcount 2 to 24386@kfi7
00010000:00000001:12.0:1773851898.585455:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851898.585456:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851898.585456:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851898.585457:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad116d4c x1859599695135424/t0(0) o400->c05dc7fc-80a5-43ad-91a0-a8b4341b0a0a@24386@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2024-0'
00000100:00100000:12.0:1773851898.585461:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad116d4c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:c05dc7fc-80a5-43ad-91a0-a8b4341b0a0a+5:39508:x1859599695135424:12345-24386@kfi7:400:default-tuolumne2024-0 Request processed in 53us (84us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851898.585463:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24386@kfi7, seq: 2289934
00000100:00000040:12.0:1773851898.585464:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001de840a7 : new rpc_count 0
00000100:00000001:12.0:1773851898.585465:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851898.585465:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851898.585466:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851898.585466:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000068cea08.
00000020:00000010:12.0:1773851898.585467:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e4ee393e.
00000020:00000040:12.0:1773851898.585468:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000001de840a7 : new refcount 4
00000100:00000001:12.0:1773851898.585468:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851898.585473:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000016d TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851898.585474:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851898.585475:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24386@kfi7: PUT: OK
00000400:00000200:13.0:1773851898.585476:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f4420963
00000400:00000010:13.0:1773851898.585477:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f4420963.
00000100:00000001:13.0:1773851898.585477:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851898.585478:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851898.585479:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000073fbfe8c nid 24386@kfi7 refs 2
00000800:00000200:13.0:1773851898.585480:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 24386@kfi7(000000005f66b374):0x0 lsk 366 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000016d Transaction freed
00000800:00000200:25.0:1773851898.587332:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851898.587332:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851898.587333:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851898.587335:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851898.587337:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.587338:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24497@kfi7 : PUT - for me
00000400:00000200:25.0:1773851898.587339:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.587340:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 1
00000400:00000200:25.0:1773851898.587341:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:25.0:1773851898.587342:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000400:00000200:25.0:1773851898.587343:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 3
00000400:00000200:25.0:1773851898.587344:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24432@kfi7 to cpt 7
00000400:00000200:25.0:1773851898.587345:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24432@kfi7 of length 224 into portal 12 MB=0x69b4b5e469500
00000400:00000200:25.0:1773851898.587346:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24432@kfi7 of length 224/224 into md 0x16159c9699 [64] + 40000
00000800:00000200:25.0:1773851898.587348:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851898.587349:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851898.587350:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24497@kfi7: PUT: OK
00000100:00000001:25.0:1773851898.587351:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851898.587351:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851898.587352:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008db30391.
00000100:00000040:25.0:1773851898.587353:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000008db30391 x1859597866800384 msgsize 224
00000100:00100000:25.0:1773851898.587355:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24432@kfi7 (source: 12345-24497@kfi7)
00000100:00000001:25.0:1773851898.587356:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851898.587357:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000800:00000200:25.0:1773851898.587358:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851898.587358:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851898.587358:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851898.587359:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851898.587359:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851898.587360:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851898.587361:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597866800384
00000020:00000001:24.0:1773851898.587362:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851898.587362:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e243842e8
00000020:00000001:24.0:1773851898.587363:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851898.587366:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000cce34234 refcount=5
00000020:00000001:24.0:1773851898.587366:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637156957308928 : -106916752242688 : ffff9ec280f64800)
00000020:00000001:24.0:1773851898.587367:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637156957308928 : -106916752242688 : ffff9ec280f64800)
00000100:00000001:24.0:1773851898.587368:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851898.587369:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851898.587370:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851898.587371:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851898.587371:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000098ea6441.
00000100:00000001:24.0:1773851898.587372:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851898.587373:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851898.587373:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851898.587374:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851898.587375:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851898.587375:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.587376:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851898.587378:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851898.587378:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851898.587378:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:27.0:1773851898.587379:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851898.587379:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24432@kfi7, seq: 2025186
00000100:00000001:27.0:1773851898.587380:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851898.587380:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000cce34234 : new rpc_count 1
00000100:00000001:24.0:1773851898.587380:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780415360 : -106994929136256 : ffff9eb04d418d80)
00000100:00000001:27.0:1773851898.587381:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851898.587382:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008db30391 x1859597866800384/t0(0) o400->2ca23292-9077-47ca-b72f-098910436688@24432@kfi7:148/0 lens 224/0 e 0 to 0 dl 1773852263 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2014-0'
00000100:00000001:24.0:1773851898.587384:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851898.587385:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851898.587386:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008db30391 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:2ca23292-9077-47ca-b72f-098910436688+5:39528:x1859597866800384:12345-24432@kfi7:400:default-tuolumne2014-0
00000100:00000200:24.0:1773851898.587387:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597866800384
00000020:00000001:24.0:1773851898.587387:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851898.587388:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851898.587389:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.587389:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851898.587390:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851898.587391:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851898.587392:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597866800384, found 0 last_xid 1859597866800383
00000020:00000001:24.0:1773851898.587392:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851898.587393:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851898.587394:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851898.587394:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.587395:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851898.587396:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851898.587396:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851898.587397:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f457d1ce.
02000000:00000001:24.0:1773851898.587398:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.587398:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.587399:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851898.587400:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183014451382, transno 0, xid 1859597866800384
00010000:00000001:24.0:1773851898.587400:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851898.587401:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008db30391 x1859597866800384/t0(0) o400->2ca23292-9077-47ca-b72f-098910436688@24432@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2014-0'
00010000:00000001:24.0:1773851898.587404:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851898.587404:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851898.587405:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=131 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851898.587406:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851898.587407:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000029d07190 refcount 3 to 24432@kfi7
00000100:00000001:24.0:1773851898.587408:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715066720 : -107155994484896 : ffff9e8acd035f60)
02000000:00000001:24.0:1773851898.587409:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851898.587409:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851898.587410:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851898.587411:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24497@kfi7
00000400:00000010:24.0:1773851898.587412:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bbeeaf9c.
00000100:00000200:24.0:1773851898.587413:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597866800384, offset 224
00000400:00000200:24.0:1773851898.587414:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24497@kfi7
00000400:00000200:24.0:1773851898.587415:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:24.0:1773851898.587416:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 1
00000400:00000200:24.0:1773851898.587417:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000400:00000200:24.0:1773851898.587418:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 3
00000400:00000200:24.0:1773851898.587420:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24497@kfi7 local destination
00000400:00000200:24.0:1773851898.587421:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770289:8770289:1024:4294967295] 24497@kfi7 LPNI seq info [206234:206234:16:4294967295]
00000400:00000200:24.0:1773851898.587423:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000400:00000200:24.0:1773851898.587423:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24497@kfi7 to cpt 6
00000400:00000200:24.0:1773851898.587426:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24497@kfi7(24497@kfi7:24497@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851898.587427:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 3
00000800:00000200:24.0:1773851898.587428:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851898.587430:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851898.587432:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851898.587434:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1157 Using peer 24497@kfi7(0x1157)
00000800:00000200:24.0:1773851898.587438:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x1157: rc=0
00000800:00000200:24.0:1773851898.587439:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1157 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851898.587441:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851898.587442:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000029d07190 refcount 2 to 24432@kfi7
00010000:00000001:24.0:1773851898.587443:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851898.587444:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851898.587444:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851898.587447:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008db30391 x1859597866800384/t0(0) o400->2ca23292-9077-47ca-b72f-098910436688@24432@kfi7:148/0 lens 224/224 e 0 to 0 dl 1773852263 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2014-0'
00000100:00100000:24.0:1773851898.587450:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008db30391 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:2ca23292-9077-47ca-b72f-098910436688+5:39528:x1859597866800384:12345-24432@kfi7:400:default-tuolumne2014-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851898.587452:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24432@kfi7, seq: 2025186
00000100:00000040:24.0:1773851898.587453:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000cce34234 : new rpc_count 0
00000100:00000001:24.0:1773851898.587454:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851898.587455:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851898.587456:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851898.587457:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000098ea6441.
00000020:00000010:24.0:1773851898.587458:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000020:00000040:24.0:1773851898.587459:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000cce34234 : new refcount 4
00000100:00000001:24.0:1773851898.587460:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851898.587465:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1157 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851898.587466:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851898.587467:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24497@kfi7: PUT: OK
00000400:00000200:25.0:1773851898.587468:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bbeeaf9c
00000400:00000010:25.0:1773851898.587468:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bbeeaf9c.
00000100:00000001:25.0:1773851898.587469:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851898.587469:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851898.587470:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000713ac7d8 nid 24497@kfi7 refs 2
00000800:00000200:25.0:1773851898.587471:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24497@kfi7(00000000d77f77c9):0x0 lsk 4440 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1157 Transaction freed
00000800:00000200:1.0:1773851898.588032:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851898.588033:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851898.588035:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851898.588037:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851898.588039:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:1.0:1773851898.588041:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19890@kfi7 : PUT - for me
00000400:00000200:1.0:1773851898.588042:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:1.0:1773851898.588043:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 1
00000400:00000200:1.0:1773851898.588044:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:1.0:1773851898.588044:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000400:00000200:1.0:1773851898.588045:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 3
00000400:00000200:1.0:1773851898.588046:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19826@kfi7 to cpt 4
00000400:00000200:1.0:1773851898.588047:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19826@kfi7 of length 224 into portal 12 MB=0x69b56663cee40
00000400:00000200:1.0:1773851898.588048:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19826@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 53688
00000800:00000200:1.0:1773851898.588050:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851898.588052:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851898.588053:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19890@kfi7: PUT: OK
00000100:00000001:1.0:1773851898.588054:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851898.588055:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851898.588057:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b3b9c28b.
00000100:00000040:1.0:1773851898.588057:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000b3b9c28b x1859645245025856 msgsize 224
00000100:00100000:1.0:1773851898.588059:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-19826@kfi7 (source: 12345-19890@kfi7)
00000100:00000001:1.0:1773851898.588060:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851898.588061:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000100:00000001:0.0:1773851898.588061:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851898.588062:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851898.588062:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851898.588062:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851898.588063:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851898.588064:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851898.588065:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859645245025856
00000020:00000001:0.0:1773851898.588065:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851898.588066:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07fcc9f14b2
00000020:00000001:0.0:1773851898.588067:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851898.588068:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000df4f2df7 refcount=5
00000020:00000001:0.0:1773851898.588068:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637119431355392 : -106954278196224 : ffff9eb9c43dac00)
00000020:00000001:0.0:1773851898.588069:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637119431355392 : -106954278196224 : ffff9eb9c43dac00)
00000100:00000001:0.0:1773851898.588070:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851898.588072:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851898.588072:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006d6cf39.
00000020:00000010:0.0:1773851898.588073:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851898.588074:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851898.588075:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851898.588075:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851898.588076:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851898.588077:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851898.588078:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851898.588078:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.588079:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851898.588080:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851898.588081:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851898.588081:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851898.588081:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851898.588082:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19826@kfi7, seq: 1997629
00000100:00000001:2.0:1773851898.588083:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851898.588083:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000df4f2df7 : new rpc_count 1
00000100:00000001:2.0:1773851898.588084:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.588084:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052757760 : -106991656793856 : ffff9eb1104d8900)
00000100:00000040:0.0:1773851898.588085:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b3b9c28b x1859645245025856/t0(0) o400->4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2@19826@kfi7:538/0 lens 224/0 e 0 to 0 dl 1773852653 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1722-0'
00000100:00000001:0.0:1773851898.588088:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851898.588088:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851898.588089:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3b9c28b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2+5:39434:x1859645245025856:12345-19826@kfi7:400:default-tuolumne1722-0
00000100:00000200:0.0:1773851898.588090:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859645245025856
00000020:00000001:0.0:1773851898.588091:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851898.588091:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851898.588092:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.588093:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851898.588093:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851898.588094:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851898.588095:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859645245025856, found 0 last_xid 1859645245025855
00000020:00000001:0.0:1773851898.588095:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851898.588096:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851898.588097:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851898.588097:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.588098:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851898.588099:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851898.588099:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851898.588100:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c24236ce.
02000000:00000001:0.0:1773851898.588100:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.588101:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.588102:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851898.588102:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183243429325, transno 0, xid 1859645245025856
00010000:00000001:0.0:1773851898.588104:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851898.588105:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b3b9c28b x1859645245025856/t0(0) o400->4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2@19826@kfi7:538/0 lens 224/224 e 0 to 0 dl 1773852653 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1722-0'
00010000:00000001:0.0:1773851898.588107:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851898.588108:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851898.588109:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=131 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851898.588110:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851898.588110:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000460c7ee0 refcount 3 to 19826@kfi7
00000100:00000001:0.0:1773851898.588111:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583950016 : -107156125601600 : ffff9e8ac532b0c0)
02000000:00000001:0.0:1773851898.588112:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851898.588113:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.588113:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851898.588114:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19890@kfi7
00000400:00000010:0.0:1773851898.588115:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ccec3e81.
00000100:00000200:0.0:1773851898.588115:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859645245025856, offset 224
00000400:00000200:0.0:1773851898.588117:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19890@kfi7
00000400:00000200:0.0:1773851898.588118:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:0.0:1773851898.588119:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 1
00000400:00000200:0.0:1773851898.588120:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000400:00000200:0.0:1773851898.588121:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 3
00000400:00000200:0.0:1773851898.588122:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19890@kfi7 local destination
00000400:00000200:0.0:1773851898.588123:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770290:8770290:1024:4294967295] 19890@kfi7 LPNI seq info [7780851:7780851:16:4294967295]
00000400:00000200:0.0:1773851898.588124:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000400:00000200:0.0:1773851898.588125:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19890@kfi7 to cpt 0
00000400:00000200:0.0:1773851898.588127:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19890@kfi7(19890@kfi7:19890@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851898.588128:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 3
00000800:00000200:0.0:1773851898.588130:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851898.588131:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851898.588133:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851898.588137:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001144 Using peer 19890@kfi7(0x100000000001144)
00000800:00000200:0.0:1773851898.588140:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x100000000001144: rc=0
00000800:00000200:0.0:1773851898.588142:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001144 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851898.588144:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851898.588145:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000460c7ee0 refcount 2 to 19826@kfi7
00010000:00000001:0.0:1773851898.588145:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851898.588146:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.588146:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851898.588147:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b3b9c28b x1859645245025856/t0(0) o400->4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2@19826@kfi7:538/0 lens 224/224 e 0 to 0 dl 1773852653 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1722-0'
00000100:00100000:0.0:1773851898.588152:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3b9c28b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:4446c00f-0f6f-4bbb-aa57-1ecb54eb08e2+5:39434:x1859645245025856:12345-19826@kfi7:400:default-tuolumne1722-0 Request processed in 63us (93us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851898.588154:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19826@kfi7, seq: 1997629
00000100:00000040:0.0:1773851898.588155:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000df4f2df7 : new rpc_count 0
00000100:00000001:0.0:1773851898.588156:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851898.588156:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851898.588157:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851898.588158:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851898.588158:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006d6cf39.
00000020:00000040:0.0:1773851898.588159:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000df4f2df7 : new refcount 4
00000100:00000001:0.0:1773851898.588160:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851898.588166:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001144 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851898.588167:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851898.588169:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19890@kfi7: PUT: OK
00000400:00000200:1.0:1773851898.588169:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ccec3e81
00000400:00000010:1.0:1773851898.588170:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ccec3e81.
00000100:00000001:1.0:1773851898.588171:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851898.588171:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851898.588172:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007cc621c7 nid 19890@kfi7 refs 2
00000800:00000200:1.0:1773851898.588174:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 19890@kfi7(000000003371740b):0x0 lsk 4421 rsk 5 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000001144 Transaction freed
00000800:00000200:17.0:1773851898.632753:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851898.632754:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851898.632757:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851898.632763:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851898.632766:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.632767:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8241@kfi7 : PUT - for me
00000400:00000200:17.0:1773851898.632769:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.632770:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 1
00000400:00000200:17.0:1773851898.632772:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.632773:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000400:00000200:17.0:1773851898.632774:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 3
00000400:00000200:17.0:1773851898.632776:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8433@kfi7 to cpt 7
00000400:00000200:17.0:1773851898.632777:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8433@kfi7 of length 224 into portal 12 MB=0x69bad05914e40
00000400:00000200:17.0:1773851898.632780:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8433@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 47696
00000800:00000200:17.0:1773851898.632783:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851898.632785:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.632787:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8241@kfi7: PUT: OK
00000100:00000001:17.0:1773851898.632789:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851898.632789:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851898.632791:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000067596cc6.
00000100:00000040:17.0:1773851898.632792:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000067596cc6 x1860017285320256 msgsize 224
00000100:00100000:17.0:1773851898.632794:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8433@kfi7 (source: 12345-8241@kfi7)
00000100:00000001:17.0:1773851898.632796:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851898.632797:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000100:00000001:19.0:1773851898.632798:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851898.632799:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851898.632799:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851898.632800:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851898.632801:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851898.632803:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851898.632804:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860017285320256
00000020:00000001:19.0:1773851898.632805:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851898.632806:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a66cf6
00000020:00000001:19.0:1773851898.632807:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851898.632808:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000009b2bc02 refcount=6
00000020:00000001:19.0:1773851898.632810:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148546241536 : -106925163310080 : ffff9ec08b9f9400)
00000020:00000001:19.0:1773851898.632812:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148546241536 : -106925163310080 : ffff9ec08b9f9400)
00000100:00000001:19.0:1773851898.632814:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851898.632815:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851898.632817:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851898.632819:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851898.632820:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bdd5777c.
00000100:00000001:19.0:1773851898.632822:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851898.632823:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851898.632824:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.632826:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851898.632826:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851898.632827:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.632829:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.632831:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851898.632832:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851898.632832:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851898.632833:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851898.632834:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8433@kfi7, seq: 2156437
00000100:00000040:19.0:1773851898.632836:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000009b2bc02 : new rpc_count 1
00000100:00000001:16.0:1773851898.632836:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.632837:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794793856 : -107029914757760 : ffff9ea827f35580)
00000100:00000001:16.0:1773851898.632837:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851898.632839:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000067596cc6 x1860017285320256/t0(0) o400->2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc@8433@kfi7:150/0 lens 224/0 e 0 to 0 dl 1773852265 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1005-0'
00000100:00000001:19.0:1773851898.632844:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851898.632844:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851898.632846:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000067596cc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc+6:39589:x1860017285320256:12345-8433@kfi7:400:default-tuolumne1005-0
00000100:00000200:19.0:1773851898.632848:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860017285320256
00000020:00000001:19.0:1773851898.632849:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851898.632850:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851898.632851:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.632852:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851898.632853:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851898.632854:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851898.632854:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860017285320256, found 0 last_xid 1860017285320255
00000020:00000001:19.0:1773851898.632856:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851898.632857:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851898.632857:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851898.632858:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.632859:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851898.632859:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851898.632860:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851898.632862:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b4c8993a.
02000000:00000001:19.0:1773851898.632862:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.632863:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.632864:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851898.632864:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860017285320256
00010000:00000001:19.0:1773851898.632865:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851898.632866:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000067596cc6 x1860017285320256/t0(0) o400->2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc@8433@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1005-0'
00010000:00000001:19.0:1773851898.632869:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851898.632870:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851898.632870:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=131 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851898.632872:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851898.632872:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fe40fad8 refcount 5 to 8433@kfi7
00000100:00000001:19.0:1773851898.632873:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271296 : -107152618280320 : ffff9e8b96402a80)
02000000:00000001:19.0:1773851898.632874:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851898.632875:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.632875:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851898.632876:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8241@kfi7
00000400:00000010:19.0:1773851898.632877:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000488255c4.
00000100:00000200:19.0:1773851898.632878:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860017285320256, offset 224
00000400:00000200:19.0:1773851898.632879:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8241@kfi7
00000400:00000200:19.0:1773851898.632880:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.632881:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 1
00000400:00000200:19.0:1773851898.632882:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000400:00000200:19.0:1773851898.632884:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 3
00000400:00000200:19.0:1773851898.632885:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8241@kfi7 local destination
00000400:00000200:19.0:1773851898.632887:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770291:8770291:1024:4294967295] 8241@kfi7 LPNI seq info [10995300:10995300:16:4294967295]
00000400:00000200:19.0:1773851898.632889:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000400:00000200:19.0:1773851898.632890:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8241@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.632893:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8241@kfi7(8241@kfi7:8241@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851898.632894:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 3
00000800:00000200:19.0:1773851898.632895:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851898.632897:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851898.632899:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851898.632902:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003b7 Using peer 8241@kfi7(0x1000000000003b7)
00000800:00000200:19.0:1773851898.632905:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x1000000000003b7: rc=0
00000800:00000200:19.0:1773851898.632906:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003b7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851898.632909:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851898.632910:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fe40fad8 refcount 4 to 8433@kfi7
00010000:00000001:19.0:1773851898.632910:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851898.632911:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.632912:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851898.632912:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000067596cc6 x1860017285320256/t0(0) o400->2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc@8433@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1005-0'
00000100:00100000:19.0:1773851898.632916:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000067596cc6 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2e51b5e4-ea11-4dcd-9f1c-7a70874d82cc+6:39589:x1860017285320256:12345-8433@kfi7:400:default-tuolumne1005-0 Request processed in 71us (123us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851898.632918:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8433@kfi7, seq: 2156437
00000100:00000040:19.0:1773851898.632919:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000009b2bc02 : new rpc_count 0
00000800:00000200:17.0:1773851898.632919:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003b7 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851898.632920:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851898.632920:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851898.632920:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851898.632921:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851898.632921:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8241@kfi7: PUT: OK
00000400:00000200:17.0:1773851898.632921:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000488255c4
00000020:00000010:19.0:1773851898.632922:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bdd5777c.
00000400:00000010:17.0:1773851898.632922:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000488255c4.
00000100:00000001:17.0:1773851898.632922:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:19.0:1773851898.632923:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000100:00000001:17.0:1773851898.632923:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:19.0:1773851898.632924:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000009b2bc02 : new refcount 5
00000400:00000200:17.0:1773851898.632924:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ba44fc54 nid 8241@kfi7 refs 2
00000100:00000001:19.0:1773851898.632925:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851898.632925:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 8241@kfi7(00000000b8eb4da9):0x0 lsk 952 rsk 26 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000003b7 Transaction freed
00000800:00000200:9.0:1773851898.643983:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851898.643984:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851898.643985:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851898.643988:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851898.643989:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.643991:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:9.0:1773851898.643992:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.643992:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:9.0:1773851898.643993:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.643994:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:9.0:1773851898.643995:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:9.0:1773851898.643995:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.643996:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 224 into portal 12 MB=0x699e13784da80
00000400:00000200:9.0:1773851898.643997:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2080@kfi7 of length 224/224 into md 0x78146ce49 [64] + 163288
00000800:00000200:9.0:1773851898.643999:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851898.644001:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851898.644001:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000100:00000001:9.0:1773851898.644002:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851898.644003:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851898.644004:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002e30abfc.
00000100:00000040:9.0:1773851898.644004:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000002e30abfc x1858042438408832 msgsize 224
00000100:00100000:9.0:1773851898.644006:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-2080@kfi7 (source: 12345-2080@kfi7)
00000100:00000001:9.0:1773851898.644007:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851898.644008:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:11.0:1773851898.644009:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851898.644009:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851898.644009:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851898.644010:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851898.644010:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851898.644011:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851898.644012:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042438408832
00000020:00000001:11.0:1773851898.644012:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851898.644013:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acdb8a7
00000020:00000001:11.0:1773851898.644013:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851898.644016:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f1c78545 refcount=5
00000020:00000001:11.0:1773851898.644017:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636949251805184 : -107124457746432 : ffff9e9224bfd000)
00000020:00000001:11.0:1773851898.644018:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636949251805184 : -107124457746432 : ffff9e9224bfd000)
00000100:00000001:11.0:1773851898.644019:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.644020:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851898.644021:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000816b63bf.
00000020:00000010:11.0:1773851898.644022:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851898.644023:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007dac8f6e.
00000100:00000001:11.0:1773851898.644023:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851898.644024:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851898.644024:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.644025:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851898.644026:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851898.644026:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.644027:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.644028:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851898.644028:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851898.644029:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851898.644029:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851898.644030:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2080@kfi7, seq: 2130876
00000100:00000040:11.0:1773851898.644030:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f1c78545 : new rpc_count 1
00000100:00000001:11.0:1773851898.644031:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609045504 : -107064100506112 : ffff9ea032523600)
00000100:00000001:8.0:1773851898.644031:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851898.644031:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.644033:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002e30abfc x1858042438408832/t0(0) o400->lustre5-MDT0001-lwp-OST0010_UUID@2080@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba117-0'
00000100:00000001:11.0:1773851898.644036:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.644036:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851898.644037:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002e30abfc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:lustre5-MDT0001-lwp-OST0010_UUID+5:272592:x1858042438408832:12345-2080@kfi7:400:default-yuba117-0
00000100:00000200:11.0:1773851898.644038:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042438408832
00000020:00000001:11.0:1773851898.644039:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851898.644039:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851898.644040:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.644040:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851898.644041:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851898.644042:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:11.0:1773851898.644042:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851898.644043:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851898.644043:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851898.644044:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.644045:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851898.644045:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851898.644046:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851898.644047:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002efa0ba5.
02000000:00000001:11.0:1773851898.644047:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.644048:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.644048:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851898.644049:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858042438408832
00010000:00000001:11.0:1773851898.644050:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851898.644051:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002e30abfc x1858042438408832/t0(0) o400->lustre5-MDT0001-lwp-OST0010_UUID@2080@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba117-0'
00010000:00000001:11.0:1773851898.644054:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851898.644054:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851898.644055:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=131 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851898.644056:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851898.644057:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000737191e9 refcount 7 to 2080@kfi7
00000100:00000001:11.0:1773851898.644057:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551675072 : -107156157876544 : ffff9e8ac34636c0)
02000000:00000001:11.0:1773851898.644058:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851898.644059:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.644059:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851898.644060:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000010:11.0:1773851898.644061:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090967037.
00000100:00000200:11.0:1773851898.644062:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042438408832, offset 224
00000400:00000200:11.0:1773851898.644063:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:11.0:1773851898.644064:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:11.0:1773851898.644065:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:11.0:1773851898.644066:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:11.0:1773851898.644067:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:11.0:1773851898.644068:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2080@kfi7 local destination
00000400:00000200:11.0:1773851898.644069:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770292:8770292:1024:4294967295] 2080@kfi7 LPNI seq info [5404397:5404397:16:4294967295]
00000400:00000200:11.0:1773851898.644071:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:11.0:1773851898.644072:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:11.0:1773851898.644073:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851898.644075:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:11.0:1773851898.644076:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851898.644077:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851898.644079:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851898.644081:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x64e Using peer 2080@kfi7(0x64e)
00000800:00000200:11.0:1773851898.644084:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x64e: rc=0
00000800:00000200:11.0:1773851898.644086:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x64e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851898.644088:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.644089:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000737191e9 refcount 6 to 2080@kfi7
00010000:00000001:11.0:1773851898.644089:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851898.644090:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.644091:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851898.644091:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002e30abfc x1858042438408832/t0(0) o400->lustre5-MDT0001-lwp-OST0010_UUID@2080@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba117-0'
00000100:00100000:11.0:1773851898.644094:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002e30abfc pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:lustre5-MDT0001-lwp-OST0010_UUID+5:272592:x1858042438408832:12345-2080@kfi7:400:default-yuba117-0 Request processed in 57us (89us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851898.644096:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x64e TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851898.644097:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2080@kfi7, seq: 2130876
00000400:00000200:9.0:1773851898.644097:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851898.644098:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f1c78545 : new rpc_count 0
00000100:00000001:11.0:1773851898.644098:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851898.644099:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851898.644099:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851898.644099:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2080@kfi7: PUT: OK
00000400:00000200:9.0:1773851898.644099:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090967037
00000020:00000010:11.0:1773851898.644100:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007dac8f6e.
00000400:00000010:9.0:1773851898.644100:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090967037.
00000020:00000010:11.0:1773851898.644101:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000816b63bf.
00000020:00000040:11.0:1773851898.644101:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000f1c78545 : new refcount 4
00000100:00000001:9.0:1773851898.644101:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851898.644101:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:11.0:1773851898.644102:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851898.644102:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:9.0:1773851898.644103:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2069@kfi7:2 -> 2080@kfi7(000000000400df8b):0x0 lsk 1615 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x64e Transaction freed
00000800:00000200:13.0:1773851898.672156:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851898.672157:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851898.672158:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851898.672160:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851898.672162:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.672163:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14113@kfi7 : PUT - for me
00000400:00000200:13.0:1773851898.672164:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.672166:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 1
00000400:00000200:13.0:1773851898.672167:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.672168:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000400:00000200:13.0:1773851898.672168:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 3
00000400:00000200:13.0:1773851898.672169:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14304@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.672170:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14304@kfi7 of length 224 into portal 12 MB=0x69b4758ffff00
00000400:00000200:13.0:1773851898.672171:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14304@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 59000
00000800:00000200:13.0:1773851898.672173:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851898.672175:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851898.672176:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14113@kfi7: PUT: OK
00000100:00000001:13.0:1773851898.672177:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851898.672177:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851898.672178:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a3763be.
00000100:00000040:13.0:1773851898.672179:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000007a3763be x1859580598419200 msgsize 224
00000100:00100000:13.0:1773851898.672180:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14304@kfi7 (source: 12345-14113@kfi7)
00000100:00000001:13.0:1773851898.672181:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851898.672182:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000100:00000001:12.0:1773851898.672183:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851898.672183:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851898.672184:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851898.672184:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851898.672184:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851898.672185:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851898.672186:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580598419200
00000020:00000001:12.0:1773851898.672186:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851898.672187:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dde0de595
00000020:00000001:12.0:1773851898.672188:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851898.672192:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000836ff402 refcount=5
00000020:00000001:12.0:1773851898.672193:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098280317952 : -106975429233664 : ffff9eb4d78a7400)
00000020:00000001:12.0:1773851898.672194:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098280317952 : -106975429233664 : ffff9eb4d78a7400)
00000100:00000001:12.0:1773851898.672195:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851898.672195:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851898.672196:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e4ee393e.
00000020:00000010:12.0:1773851898.672197:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851898.672198:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000068cea08.
00000100:00000001:12.0:1773851898.672199:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851898.672199:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851898.672200:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851898.672201:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851898.672201:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851898.672202:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851898.672203:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851898.672204:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851898.672204:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851898.672205:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851898.672205:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851898.672206:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14304@kfi7, seq: 2289935
00000100:00000040:15.0:1773851898.672207:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000836ff402 : new rpc_count 1
00000100:00000001:15.0:1773851898.672207:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945721600 : -106919763830016 : ffff9ec1cd751b00)
00000100:00000001:12.0:1773851898.672207:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851898.672207:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851898.672209:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007a3763be x1859580598419200/t0(0) o400->07719914-baef-4a6a-855c-dce19c4b3255@14304@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1375-0'
00000100:00000001:15.0:1773851898.672212:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851898.672212:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851898.672213:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007a3763be pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:07719914-baef-4a6a-855c-dce19c4b3255+5:39827:x1859580598419200:12345-14304@kfi7:400:default-tuolumne1375-0
00000100:00000200:15.0:1773851898.672214:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580598419200
00000020:00000001:15.0:1773851898.672215:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851898.672215:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851898.672216:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.672218:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851898.672218:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851898.672219:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851898.672219:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580598419200, found 0 last_xid 1859580598419199
00000020:00000001:15.0:1773851898.672220:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851898.672221:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851898.672221:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851898.672222:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.672223:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851898.672223:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851898.672224:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851898.672225:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d8c697c4.
02000000:00000001:15.0:1773851898.672225:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.672226:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.672227:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851898.672227:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035365208, transno 0, xid 1859580598419200
00010000:00000001:15.0:1773851898.672228:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851898.672229:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007a3763be x1859580598419200/t0(0) o400->07719914-baef-4a6a-855c-dce19c4b3255@14304@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1375-0'
00010000:00000001:15.0:1773851898.672231:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851898.672232:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851898.672232:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=131 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851898.672234:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851898.672234:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c57ba987 refcount 3 to 14304@kfi7
00000100:00000001:15.0:1773851898.672235:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153760 : -107139310397856 : ffff9e8eaf765660)
02000000:00000001:15.0:1773851898.672236:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851898.672236:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.672237:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851898.672238:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14113@kfi7
00000400:00000010:15.0:1773851898.672239:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000616bd872.
00000100:00000200:15.0:1773851898.672239:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580598419200, offset 224
00000400:00000200:15.0:1773851898.672241:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14113@kfi7
00000400:00000200:15.0:1773851898.672242:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:15.0:1773851898.672243:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 1
00000400:00000200:15.0:1773851898.672244:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000400:00000200:15.0:1773851898.672246:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 3
00000400:00000200:15.0:1773851898.672247:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14113@kfi7 local destination
00000400:00000200:15.0:1773851898.672248:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770293:8770293:1024:4294967295] 14113@kfi7 LPNI seq info [808395:808395:16:4294967295]
00000400:00000200:15.0:1773851898.672250:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000400:00000200:15.0:1773851898.672250:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14113@kfi7 to cpt 3
00000400:00000200:15.0:1773851898.672253:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14113@kfi7(14113@kfi7:14113@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851898.672254:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 3
00000800:00000200:15.0:1773851898.672255:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851898.672256:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851898.672258:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851898.672261:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x25 Using peer 14113@kfi7(0x25)
00000800:00000200:15.0:1773851898.672264:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a091e2bc: Posted send of 324 bytes to peer 0x25: rc=0
00000800:00000200:15.0:1773851898.672265:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x25 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851898.672267:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851898.672268:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c57ba987 refcount 2 to 14304@kfi7
00010000:00000001:15.0:1773851898.672269:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851898.672269:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.672270:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851898.672271:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a3763be x1859580598419200/t0(0) o400->07719914-baef-4a6a-855c-dce19c4b3255@14304@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1375-0'
00000100:00100000:15.0:1773851898.672274:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007a3763be pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:07719914-baef-4a6a-855c-dce19c4b3255+5:39827:x1859580598419200:12345-14304@kfi7:400:default-tuolumne1375-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851898.672276:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14304@kfi7, seq: 2289935
00000100:00000040:15.0:1773851898.672278:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000836ff402 : new rpc_count 0
00000100:00000001:15.0:1773851898.672278:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851898.672278:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x25 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851898.672279:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851898.672279:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851898.672280:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:15.0:1773851898.672281:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000068cea08.
00000020:00000010:15.0:1773851898.672281:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e4ee393e.
00000400:00000200:13.0:1773851898.672281:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14113@kfi7: PUT: OK
00000400:00000200:13.0:1773851898.672281:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000616bd872
00000020:00000040:15.0:1773851898.672282:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000836ff402 : new refcount 4
00000400:00000010:13.0:1773851898.672282:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000616bd872.
00000100:00000001:15.0:1773851898.672283:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851898.672283:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851898.672283:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851898.672284:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001e4d879a nid 14113@kfi7 refs 2
00000800:00000200:13.0:1773851898.672285:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a091e2bc: 2069@kfi7:3 -> 14113@kfi7(00000000644a74b7):0x0 lsk 38 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x25 Transaction freed
00000004:00000001:5.0:1773851898.697730:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:31.0:1773851898.697731:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851898.697731:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:9.0:1773851898.697731:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851898.697731:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851898.697731:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851898.697731:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:5.0:1773851898.697731:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006c4a96c8.
00000004:00000020:31.0:1773851898.697732:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:30.0:1773851898.697732:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:9.0:1773851898.697732:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:7.0:1773851898.697732:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:5.0:1773851898.697732:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
00000100:00000010:31.0:1773851898.697733:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d6a92c0.
00000004:00000020:30.0:1773851898.697733:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851898.697733:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:9.0:1773851898.697733:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b304e1e8.
00000100:00000010:7.0:1773851898.697733:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000067479cf9.
00000004:00000020:6.0:1773851898.697733:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:5.0:1773851898.697733:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:30.0:1773851898.697734:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c1b57e73.
00000100:00000010:10.0:1773851898.697734:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007fccf737.
00000020:00000040:9.0:1773851898.697734:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000100:00000010:6.0:1773851898.697734:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000794439fe.
02000000:00000001:5.0:1773851898.697734:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851898.697734:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:31.0:1773851898.697735:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000020:00000040:30.0:1773851898.697735:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000040:10.0:1773851898.697735:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000100:00000001:9.0:1773851898.697735:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:7.0:1773851898.697735:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000040:6.0:1773851898.697735:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
02000000:00000010:5.0:1773851898.697735:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b255b11b.
00000100:00000001:31.0:1773851898.697736:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851898.697736:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:9.0:1773851898.697736:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:9.0:1773851898.697736:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.697736:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:6.0:1773851898.697736:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851898.697736:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851898.697737:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851898.697737:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:10.0:1773851898.697737:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:10.0:1773851898.697737:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:9.0:1773851898.697737:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
02000000:00000001:7.0:1773851898.697737:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851898.697737:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:5.0:1773851898.697737:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:9.0:1773851898.697738:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851898.697738:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851898.697739:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851898.697739:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851898.697739:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851898.697739:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:7.0:1773851898.697739:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851898.697739:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851898.697739:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000006c4a96c8] to pc [ptlrpcd_01_02+2]  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:31.0:1773851898.697740:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000101b0638.
02000000:00000010:30.0:1773851898.697740:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a709584c.
00000100:00000001:9.0:1773851898.697740:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.697741:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851898.697741:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851898.697741:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000068b7b641.
00000100:00000040:9.0:1773851898.697741:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b304e1e8] to pc [ptlrpcd_02_00+0]  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:7.0:1773851898.697741:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000daca50c1.
02000000:00000010:6.0:1773851898.697741:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a8eda3b1.
00000100:00000001:30.0:1773851898.697742:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851898.697742:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.697742:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.697742:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.697743:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:31.0:1773851898.697743:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851898.697743:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.697743:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851898.697743:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851898.697743:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:30.0:1773851898.697744:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c1b57e73] to pc [ptlrpcd_07_00+0]  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851898.697744:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.697744:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.697744:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851898.697745:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000009d6a92c0] to pc [ptlrpcd_07_01+1]  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851898.697745:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007fccf737] to pc [ptlrpcd_02_01+1]  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851898.697745:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000067479cf9] to pc [ptlrpcd_01_00+0]  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851898.697745:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000794439fe] to pc [ptlrpcd_01_03+3]  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:9.0:1773851898.697746:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851898.697746:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851898.697746:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851898.697746:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851898.697746:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851898.697747:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:9.0:1773851898.697747:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000016f65810.
00000100:00000001:8.0:1773851898.697747:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851898.697747:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:5.0:1773851898.697747:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006d27463f.
00080000:00000001:5.0:1773851898.697747:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637011796157440 : -107061913394176 : ffff9ea0b4aee400)
00000100:00000001:4.0:1773851898.697747:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851898.697748:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851898.697748:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636941404286976 : -107132305264640 : ffff9e9051003000)
00000100:00000040:8.0:1773851898.697748:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851898.697748:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:4.0:1773851898.697748:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:9.0:1773851898.697749:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000001:6.0:1773851898.697749:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851898.697749:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851898.697750:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:30.0:1773851898.697750:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851898.697750:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:9.0:1773851898.697750:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851898.697750:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851898.697750:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00080000:00000010:31.0:1773851898.697751:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004c6985fa.
00000100:00000001:29.0:1773851898.697751:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851898.697751:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851898.697751:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851898.697751:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:10.0:1773851898.697751:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000009b6047fd.
00000004:00001000:9.0:1773851898.697751:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:8.0:1773851898.697751:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:5.0:1773851898.697751:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a149ab67.
00000100:00000001:4.0:1773851898.697751:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:4.0:1773851898.697751:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851898.697752:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636962075253760 : -107111634297856 : ffff9e9521161c00)
00000100:00000001:29.0:1773851898.697752:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851898.697752:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:28.0:1773851898.697752:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:11.0:1773851898.697752:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:11.0:1773851898.697752:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851898.697752:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637066064496640 : -107007645054976 : ffff9ead57540800)
00000004:00000010:9.0:1773851898.697752:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ab14e9d3.
00000100:00000001:8.0:1773851898.697752:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851898.697752:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614173151027281ns, next at 614174151026169ns, rc = 0
02000000:00000001:4.0:1773851898.697752:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851898.697752:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851898.697753:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:29.0:1773851898.697753:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:29.0:1773851898.697753:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851898.697753:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00080000:9.0:1773851898.697753:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614173151028363ns, next at 614174151027361ns, rc = 0
02000000:00000001:8.0:1773851898.697753:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851898.697753:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.697753:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851898.697753:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851898.697753:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:31.0:1773851898.697754:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851898.697754:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851898.697754:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851898.697754:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:8.0:1773851898.697754:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b304e1e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051940928:2060@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851898.697754:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851898.697754:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:6.0:1773851898.697754:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851898.697754:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:5.0:1773851898.697754:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851898.697754:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000006c4a96c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051940864:2061@kfi7:13:default-yuba2-0
00000004:00001000:31.0:1773851898.697755:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:11.0:1773851898.697755:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:10.0:1773851898.697755:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00080000:00000001:9.0:1773851898.697755:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:9.0:1773851898.697755:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851898.697755:0:41065:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000100:00000001:7.0:1773851898.697755:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851898.697755:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000010:31.0:1773851898.697756:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000001df99d6a.
00000100:00000001:29.0:1773851898.697756:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:28.0:1773851898.697756:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851898.697756:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851898.697756:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:10.0:1773851898.697756:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000010b84f19.
00000100:00000001:8.0:1773851898.697756:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851898.697756:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:7.0:1773851898.697756:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:4.0:1773851898.697756:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851898.697756:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851898.697757:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851898.697757:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:28.0:1773851898.697757:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851898.697757:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:10.0:1773851898.697757:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614173151032311ns, next at 614174151031179ns, rc = 0
02000000:00000001:8.0:1773851898.697757:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851898.697757:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:7.0:1773851898.697757:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851898.697757:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851898.697757:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851898.697757:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:4.0:1773851898.697757:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00080000:31.0:1773851898.697758:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614173151033643ns, next at 614174151031740ns, rc = 0
02000000:00000001:29.0:1773851898.697758:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851898.697758:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:28.0:1773851898.697758:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851898.697758:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007fccf737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051941248:37@kfi7:13:default-yuba2-0
00080000:00000001:10.0:1773851898.697758:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000010:8.0:1773851898.697758:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005350c348.
00000100:00000001:7.0:1773851898.697758:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851898.697758:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851898.697758:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851898.697758:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851898.697758:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d5f06b74.
00080000:00000001:31.0:1773851898.697759:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00100000:29.0:1773851898.697759:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051941056:60@kfi7:13:default-yuba2-0
00000100:00100000:28.0:1773851898.697759:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1b57e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051940992:13@kfi7:41:default-yuba2-0
00000100:00000001:11.0:1773851898.697759:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:10.0:1773851898.697759:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851898.697759:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851898.697759:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851898.697759:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851898.697759:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851898.697759:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851898.697760:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851898.697760:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:28.0:1773851898.697760:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:11.0:1773851898.697760:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851898.697760:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851898.697760:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851898.697760:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00100000:6.0:1773851898.697760:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000794439fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051941120:36@kfi7:13:default-yuba2-0
00000400:00000200:4.0:1773851898.697760:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000004:00000001:31.0:1773851898.697761:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851898.697761:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851898.697761:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851898.697761:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:8.0:1773851898.697761:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000400:00000010:4.0:1773851898.697761:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
02000000:00000001:29.0:1773851898.697762:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851898.697762:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:28.0:1773851898.697762:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851898.697762:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:11.0:1773851898.697762:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000006de86c58.
00000400:00000010:8.0:1773851898.697762:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6b06622.
00000100:00000001:6.0:1773851898.697762:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:4.0:1773851898.697762:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098ca3a41.
02000000:00000010:29.0:1773851898.697763:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e11c4511.
02000000:00000010:28.0:1773851898.697763:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b825c1cb.
02000000:00000001:11.0:1773851898.697763:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:8.0:1773851898.697763:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940928, portal 4
02000000:00000001:6.0:1773851898.697763:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851898.697763:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851898.697764:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851898.697764:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851898.697764:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:8.0:1773851898.697764:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851898.697764:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:6.0:1773851898.697764:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:4.0:1773851898.697764:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940864, portal 4
00000400:00000200:29.0:1773851898.697765:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000001:8.0:1773851898.697765:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637009609040896 : -107064100510720 : ffff9ea032522400)
00000100:00000001:7.0:1773851898.697765:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851898.697765:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bd6eccac.
00000100:00000001:4.0:1773851898.697765:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851898.697765:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636964924646144 : -107108784905472 : ffff9e95caec6300)
00000400:00000010:29.0:1773851898.697766:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000a4a850a3.
00000400:00000200:28.0:1773851898.697766:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:11.0:1773851898.697766:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000100:00000040:8.0:1773851898.697766:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851898.697766:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851898.697766:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851898.697766:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851898.697767:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b9245dae.
00000400:00000010:28.0:1773851898.697767:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000010:11.0:1773851898.697767:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a4a49aeb.
00000100:00100000:7.0:1773851898.697767:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067479cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051941184:2074@kfi7:41:default-yuba2-0
00000400:00000200:6.0:1773851898.697767:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000040:4.0:1773851898.697767:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851898.697768:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941056, portal 4
00000400:00000010:28.0:1773851898.697768:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032756c42.
00000100:00000200:11.0:1773851898.697768:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941248, portal 4
00000100:00000001:8.0:1773851898.697768:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:7.0:1773851898.697768:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000010:6.0:1773851898.697768:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
00000100:00000001:29.0:1773851898.697769:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:28.0:1773851898.697769:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051940992, portal 4
00000100:00000001:11.0:1773851898.697769:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:8.0:1773851898.697769:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
02000000:00000001:7.0:1773851898.697769:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851898.697769:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851898.697769:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025756a50.
00000100:00000001:29.0:1773851898.697770:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999063552 : -107038710488064 : ffff9ea61baf2400)
00000100:00000001:28.0:1773851898.697770:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851898.697770:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411252608 : -106960298299008 : ffff9eb85d6a3180)
00000100:00000001:11.0:1773851898.697770:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087751808 : -106944621799808 : ffff9ebc03ce9680)
00000400:00000010:8.0:1773851898.697770:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc2dfd46.
00000100:00000200:8.0:1773851898.697770:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940928, offset 0
02000000:00000001:7.0:1773851898.697770:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:6.0:1773851898.697770:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941120, portal 4
00000100:00000001:4.0:1773851898.697770:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:29.0:1773851898.697771:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:7.0:1773851898.697771:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000023aa93ab.
02000000:00000001:7.0:1773851898.697771:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.697771:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851898.697771:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359417600 : -107048350134016 : ffff9ea3dd1dd100)
00000100:00000040:4.0:1773851898.697771:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:4.0:1773851898.697771:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b96d8a3.
00000100:00000040:28.0:1773851898.697772:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:11.0:1773851898.697772:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851898.697772:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000200:7.0:1773851898.697772:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000200:4.0:1773851898.697772:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051940864, offset 0
00000400:00000200:8.0:1773851898.697773:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:8.0:1773851898.697773:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000010:7.0:1773851898.697773:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000100:00000040:6.0:1773851898.697773:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851898.697773:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000100:00000001:29.0:1773851898.697774:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851898.697774:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:11.0:1773851898.697774:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851898.697774:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000010:7.0:1773851898.697774:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df522108.
00000400:00000200:4.0:1773851898.697774:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:29.0:1773851898.697775:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000100:00000040:11.0:1773851898.697775:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000100:00000200:7.0:1773851898.697775:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941184, portal 4
00000100:00000001:7.0:1773851898.697775:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851898.697775:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851898.697775:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000010:29.0:1773851898.697776:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8cfb79.
00000100:00000040:28.0:1773851898.697776:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:11.0:1773851898.697776:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f2b33615.
00000400:00000200:8.0:1773851898.697776:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000100:00000001:7.0:1773851898.697776:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309148928 : -106994400402688 : ffff9eb06cc56300)
00000400:00000200:4.0:1773851898.697776:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000100:00000200:29.0:1773851898.697777:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941056, offset 0
00000400:00000010:28.0:1773851898.697777:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df8dec7a.
00000100:00000200:11.0:1773851898.697777:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941248, offset 0
00000400:00000200:8.0:1773851898.697777:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000100:00000040:7.0:1773851898.697777:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851898.697777:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000400:00000010:6.0:1773851898.697777:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005f69d562.
00000400:00000200:29.0:1773851898.697778:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:8.0:1773851898.697778:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770293, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770291, p:4294967295, g:4294967295, h:1000]
00000100:00000200:6.0:1773851898.697778:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941120, offset 0
00000400:00000200:4.0:1773851898.697778:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:29.0:1773851898.697779:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000100:00000200:28.0:1773851898.697779:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051940992, offset 0
00000400:00000200:11.0:1773851898.697779:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
00000100:00000001:7.0:1773851898.697779:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851898.697779:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000400:00000200:8.0:1773851898.697780:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851898.697780:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:29.0:1773851898.697781:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:28.0:1773851898.697781:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:8.0:1773851898.697781:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000040:7.0:1773851898.697781:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000010:7.0:1773851898.697781:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000400:00000200:4.0:1773851898.697781:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770293, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770291, p:4294967295, g:4294967295, h:1000]
00000400:00000200:29.0:1773851898.697782:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:8.0:1773851898.697782:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000100:00000200:7.0:1773851898.697782:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051941184, offset 0
00000400:00000200:29.0:1773851898.697783:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:7.0:1773851898.697783:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:4.0:1773851898.697783:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:29.0:1773851898.697784:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000200:8.0:1773851898.697784:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770294:8770294:1024:4294967295] 2060@kfi7 LPNI seq info [5405000:5405000:16:4294967295]
00000400:00000200:4.0:1773851898.697784:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851898.697785:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:4.0:1773851898.697785:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000400:00000200:29.0:1773851898.697786:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770293, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770294, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851898.697786:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:4.0:1773851898.697786:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770295:8770295:1024:4294967295] 2061@kfi7 LPNI seq info [5403466:5403466:16:4294967295]
00000400:00000200:11.0:1773851898.697787:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851898.697788:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:11.0:1773851898.697788:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:4.0:1773851898.697788:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:29.0:1773851898.697789:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851898.697789:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:8.0:1773851898.697789:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851898.697789:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:4.0:1773851898.697789:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851898.697790:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:8.0:1773851898.697790:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:6.0:1773851898.697790:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:29.0:1773851898.697791:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770296:8770296:1024:4294967295] 60@kfi7 LPNI seq info [5404315:5404315:16:4294967295]
00000400:00000200:11.0:1773851898.697791:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:6.0:1773851898.697791:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:29.0:1773851898.697792:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851898.697792:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000800:00000200:8.0:1773851898.697792:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:29.0:1773851898.697793:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:6.0:1773851898.697793:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:28.0:1773851898.697794:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:11.0:1773851898.697794:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770296, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770295, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851898.697794:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:6.0:1773851898.697794:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000400:00000200:29.0:1773851898.697796:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851898.697796:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:11.0:1773851898.697796:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:6.0:1773851898.697796:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770296, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770295, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851898.697797:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:11.0:1773851898.697797:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851898.697797:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851898.697798:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:28.0:1773851898.697798:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:11.0:1773851898.697798:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000200:6.0:1773851898.697798:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:29.0:1773851898.697799:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:28.0:1773851898.697799:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000800:00000200:8.0:1773851898.697799:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Using peer 2060@kfi7(0x2000000000001c1)
00000400:00000200:6.0:1773851898.697799:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851898.697800:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770297:8770297:1023:4294967295] 37@kfi7 LPNI seq info [5403400:5403400:16:4294967295]
00000400:00000200:6.0:1773851898.697800:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000800:00000200:29.0:1773851898.697801:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851898.697801:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770297, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770298, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851898.697801:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:6.0:1773851898.697801:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770298:8770298:1023:4294967295] 36@kfi7 LPNI seq info [5403973:5403973:16:4294967295]
00000400:00000200:11.0:1773851898.697802:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:8.0:1773851898.697802:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x2000000000001c1: rc=0
00000800:00000200:29.0:1773851898.697803:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851898.697803:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:6.0:1773851898.697803:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:28.0:1773851898.697804:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851898.697804:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851898.697804:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:28.0:1773851898.697805:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851898.697805:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:29.0:1773851898.697806:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Using peer 60@kfi7(0x1e2)
00000400:00000200:28.0:1773851898.697806:0:41088:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133328, 23133329]
00000100:00000001:8.0:1773851898.697806:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697806:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000100:00000001:8.0:1773851898.697807:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851898.697807:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697807:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000400:00000200:6.0:1773851898.697807:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851898.697808:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 30@kfi7
00000100:00000001:8.0:1773851898.697808:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851898.697809:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x1e2: rc=0
00000400:00000200:28.0:1773851898.697809:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770299:8770299:1023:4294967295] 30@kfi7 LPNI seq info [23133330:23133330:16:4294967295]
00000400:00000200:7.0:1773851898.697809:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000400:00000200:6.0:1773851898.697809:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:29.0:1773851898.697810:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851898.697810:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851898.697810:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000800:00000200:6.0:1773851898.697810:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:28.0:1773851898.697811:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000100:00000001:8.0:1773851898.697811:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851898.697812:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851898.697812:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000100:00000001:8.0:1773851898.697812:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:7.0:1773851898.697812:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770299, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8770298, p:4294967295, g:4294967295, h:1000]
00000800:00000200:6.0:1773851898.697812:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:29.0:1773851898.697813:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851898.697813:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851898.697813:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851898.697814:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851898.697814:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697814:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000800:00000200:6.0:1773851898.697814:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:29.0:1773851898.697815:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851898.697815:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000400:00000200:4.0:1773851898.697815:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000100:00000001:29.0:1773851898.697816:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:7.0:1773851898.697816:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851898.697816:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000100:00000001:29.0:1773851898.697817:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851898.697817:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851898.697817:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697817:0:41065:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425179, 23425176]
00000800:00000200:6.0:1773851898.697817:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000100:00000001:29.0:1773851898.697818:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851898.697818:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851898.697818:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_EVENT_TX_OK event status 0
00000100:00000001:8.0:1773851898.697818:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697818:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000800:00000200:4.0:1773851898.697818:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000001:29.0:1773851898.697819:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:11.0:1773851898.697819:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851898.697819:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851898.697819:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851898.697820:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000400:00000200:7.0:1773851898.697820:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770300:8770300:1022:4294967295] 2081@kfi7 LPNI seq info [23425180:23425180:16:4294967295]
00000800:00000200:6.0:1773851898.697820:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000e8b9920: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000400:00000200:11.0:1773851898.697821:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:9.0:1773851898.697821:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc2dfd46
00000400:00000200:7.0:1773851898.697821:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000800:00000200:4.0:1773851898.697821:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851898.697822:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000010:9.0:1773851898.697822:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc2dfd46.
00000100:00000001:9.0:1773851898.697822:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:6.0:1773851898.697822:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000200:9.0:1773851898.697823:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851898.697823:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000800:00000200:11.0:1773851898.697824:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:6.0:1773851898.697824:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.697824:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:4.0:1773851898.697824:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Using peer 2061@kfi7(0x20000000000019b)
00000100:00000001:9.0:1773851898.697825:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851898.697825:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851898.697826:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 30@kfi7(13@kfi7:30@kfi7) <?> : PUT try# 0
00000800:00000200:11.0:1773851898.697826:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000040:9.0:1773851898.697826:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851898.697826:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697827:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000100:00000001:6.0:1773851898.697827:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:28.0:1773851898.697828:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:7.0:1773851898.697828:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000100:00000001:6.0:1773851898.697828:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851898.697828:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:9.0:1773851898.697829:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851898.697829:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:6.0:1773851898.697829:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851898.697829:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:4.0:1773851898.697829:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x20000000000019b: rc=0
00000800:00000200:11.0:1773851898.697830:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000400:00000200:9.0:1773851898.697830:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:7.0:1773851898.697830:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:6.0:1773851898.697830:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.697830:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851898.697831:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851898.697831:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851898.697832:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Transaction freed
00000800:00000200:7.0:1773851898.697833:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:4.0:1773851898.697833:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851898.697833:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851898.697834:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_EVENT_TX_OK event status 0
00000800:00000200:28.0:1773851898.697834:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:11.0:1773851898.697834:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x1a3: rc=0
00000100:00000001:4.0:1773851898.697834:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851898.697835:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:4.0:1773851898.697835:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851898.697835:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851898.697836:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:11.0:1773851898.697836:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851898.697836:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Using peer 2081@kfi7(0x270)
00000100:00000001:4.0:1773851898.697836:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851898.697837:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851898.697837:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851898.697838:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000400:00000200:29.0:1773851898.697838:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8cfb79
00000800:00000200:28.0:1773851898.697838:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:11.0:1773851898.697838:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.697838:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851898.697838:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:29.0:1773851898.697839:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8cfb79.
00000100:00000001:11.0:1773851898.697839:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851898.697840:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851898.697840:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851898.697840:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.697840:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:28.0:1773851898.697841:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 Using peer 30@kfi7(0xa16)
00000100:00000001:11.0:1773851898.697841:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851898.697842:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851898.697843:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851898.697843:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851898.697843:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851898.697843:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851898.697844:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:28.0:1773851898.697844:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000001138a0c5: Posted send of 324 bytes to peer 0xa16: rc=0
00000100:00000001:11.0:1773851898.697844:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851898.697844:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x270: rc=0
00000800:00000200:6.0:1773851898.697844:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_EVENT_TX_OK event status 0
00000800:00000200:5.0:1773851898.697844:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851898.697844:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.697845:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851898.697846:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851898.697846:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851898.697846:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851898.697846:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851898.697846:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851898.697847:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851898.697847:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:29.0:1773851898.697848:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000001:28.0:1773851898.697848:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851898.697848:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851898.697848:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851898.697848:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000400:00000200:5.0:1773851898.697848:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005f69d562
00000100:00000001:28.0:1773851898.697849:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:10.0:1773851898.697849:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851898.697849:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851898.697849:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b96d8a3
00000400:00000010:5.0:1773851898.697849:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005f69d562.
00000100:00000001:5.0:1773851898.697849:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:29.0:1773851898.697850:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Transaction freed
00000100:00000001:28.0:1773851898.697850:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.697850:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851898.697850:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b96d8a3.
00000100:00000001:6.0:1773851898.697850:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851898.697850:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851898.697851:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000100:00000001:7.0:1773851898.697851:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:6.0:1773851898.697851:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:10.0:1773851898.697852:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f2b33615
00000400:00000010:10.0:1773851898.697852:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f2b33615.
00000100:00000001:7.0:1773851898.697852:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851898.697853:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.697853:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:6.0:1773851898.697853:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851898.697853:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851898.697854:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:10.0:1773851898.697854:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851898.697854:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851898.697855:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851898.697855:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000040:6.0:1773851898.697855:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851898.697856:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851898.697856:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851898.697857:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851898.697857:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851898.697857:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.697857:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851898.697857:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:10.0:1773851898.697858:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851898.697858:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:5.0:1773851898.697858:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:7.0:1773851898.697859:0:2507579:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_EVENT_TX_OK event status 0
00000800:00000200:6.0:1773851898.697860:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Transaction freed
00000800:00000200:5.0:1773851898.697860:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000e8b9920: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000100:00000001:28.0:1773851898.697861:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.697861:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697861:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851898.697862:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851898.697862:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:7.0:1773851898.697862:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000800:00000200:29.0:1773851898.697863:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851898.697863:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:29.0:1773851898.697864:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851898.697864:0:2507579:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000010:7.0:1773851898.697864:0:2507579:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000400:00000200:29.0:1773851898.697865:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000800:00000200:10.0:1773851898.697865:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000100:00000001:7.0:1773851898.697865:0:2507579:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:29.0:1773851898.697866:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df8dec7a
00000100:00000200:7.0:1773851898.697866:0:2507579:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:29.0:1773851898.697867:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df8dec7a.
00000100:00000001:29.0:1773851898.697867:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:21.0:1773851898.697867:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851898.697867:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:29.0:1773851898.697868:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851898.697869:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851898.697869:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:21.0:1773851898.697870:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851898.697870:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:7.0:1773851898.697870:0:2507579:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851898.697871:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:17.0:1773851898.697871:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:7.0:1773851898.697871:0:2507579:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851898.697872:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851898.697872:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:21.0:1773851898.697873:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 60@kfi7 : PUT - for me
00000100:00000001:29.0:1773851898.697874:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851898.697874:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:17.0:1773851898.697874:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851898.697874:0:2507579:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851898.697875:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851898.697875:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000100:00000001:7.0:1773851898.697875:0:2507579:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851898.697876:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:17.0:1773851898.697876:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:29.0:1773851898.697877:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:21.0:1773851898.697877:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:21.0:1773851898.697877:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:17.0:1773851898.697877:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2060@kfi7 : PUT - for me
00000800:00000200:29.0:1773851898.697878:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001138a0c5: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 Transaction freed
00000400:00000200:17.0:1773851898.697878:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.697880:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:7.0:1773851898.697880:0:2507579:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:17.0:1773851898.697881:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.697881:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:21.0:1773851898.697882:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:17.0:1773851898.697882:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:7.0:1773851898.697882:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Transaction freed
00000400:00000200:21.0:1773851898.697884:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b68c0
00000400:00000200:17.0:1773851898.697884:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:21.0:1773851898.697885:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:17.0:1773851898.697885:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6840
00000800:00000200:29.0:1773851898.697886:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:21.0:1773851898.697886:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d1f75 [1] + 224
00000400:00000200:17.0:1773851898.697886:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:29.0:1773851898.697887:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851898.697888:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:17.0:1773851898.697888:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f2411 [1] + 224
00000800:00000200:30.0:1773851898.697889:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851898.697889:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851898.697889:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851898.697890:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851898.697890:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851898.697891:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851898.697891:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:29.0:1773851898.697892:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:22.0:1773851898.697892:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851898.697892:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000400:00000200:17.0:1773851898.697892:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:22.0:1773851898.697893:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:21.0:1773851898.697893:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:30.0:1773851898.697894:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851898.697894:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000200:21.0:1773851898.697894:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851898.697894:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000100:00000001:17.0:1773851898.697895:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851898.697896:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:29.0:1773851898.697896:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2061@kfi7 : PUT - for me
00000800:00000200:22.0:1773851898.697896:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:18.0:1773851898.697896:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000100:00000200:17.0:1773851898.697896:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851898.697897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:21.0:1773851898.697897:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851898.697897:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:30.0:1773851898.697898:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000400:00000200:29.0:1773851898.697898:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:22.0:1773851898.697898:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000800:00000200:18.0:1773851898.697898:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851898.697898:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:29.0:1773851898.697900:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851898.697900:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000800:00000200:5.0:1773851898.697900:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851898.697901:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:22.0:1773851898.697901:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000800:00000200:18.0:1773851898.697901:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:17.0:1773851898.697901:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851898.697902:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:22.0:1773851898.697902:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000100:00000001:21.0:1773851898.697902:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:5.0:1773851898.697903:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851898.697904:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851898.697904:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:31.0:1773851898.697905:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851898.697905:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851898.697905:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:22.0:1773851898.697905:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:5.0:1773851898.697905:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000001:31.0:1773851898.697906:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:30.0:1773851898.697906:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851898.697906:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000800:00000200:18.0:1773851898.697906:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000001:31.0:1773851898.697907:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:30.0:1773851898.697907:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:17.0:1773851898.697907:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851898.697907:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000010:31.0:1773851898.697908:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000a4a850a3.
00000400:00000200:30.0:1773851898.697908:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:21.0:1773851898.697908:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:5.0:1773851898.697908:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:31.0:1773851898.697909:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b9245dae
00000400:00000010:31.0:1773851898.697909:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b9245dae.
00000400:00000200:22.0:1773851898.697909:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:17.0:1773851898.697909:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:5.0:1773851898.697909:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000100:00000001:31.0:1773851898.697910:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851898.697910:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:22.0:1773851898.697910:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6940
00000800:00000200:21.0:1773851898.697910:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851898.697910:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:31.0:1773851898.697911:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851898.697911:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6800
00000400:00000200:18.0:1773851898.697911:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:8.0:1773851898.697911:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851898.697911:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:30.0:1773851898.697912:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:22.0:1773851898.697912:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000800:00000200:17.0:1773851898.697912:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000200:5.0:1773851898.697912:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:30.0:1773851898.697913:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6980
00000400:00000200:29.0:1773851898.697913:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000001:8.0:1773851898.697913:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:5.0:1773851898.697913:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:22.0:1773851898.697914:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x780081fbd [1] + 224
00000400:00000200:18.0:1773851898.697914:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000400:00000001:8.0:1773851898.697914:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851898.697914:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000200:31.0:1773851898.697915:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851898.697915:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000010:8.0:1773851898.697915:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:29.0:1773851898.697916:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x780081f7d [1] + 224
00000400:00000200:8.0:1773851898.697916:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6b06622
00000400:00000200:5.0:1773851898.697916:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6880
00000800:00000200:22.0:1773851898.697917:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851898.697917:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000010:8.0:1773851898.697917:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6b06622.
00000400:00000200:5.0:1773851898.697917:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:31.0:1773851898.697918:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851898.697918:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:22.0:1773851898.697918:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:8.0:1773851898.697918:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851898.697919:0:41089:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:30.0:1773851898.697919:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x780081f9d [1] + 224
00000800:00000200:29.0:1773851898.697919:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851898.697919:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:5.0:1773851898.697919:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d1f95 [1] + 224
02000000:00000001:31.0:1773851898.697920:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851898.697920:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:22.0:1773851898.697920:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000001:31.0:1773851898.697921:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851898.697921:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:22.0:1773851898.697921:0:2456945:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:18.0:1773851898.697921:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000200:8.0:1773851898.697921:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851898.697922:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851898.697922:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851898.697922:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000400:00000200:18.0:1773851898.697922:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:5.0:1773851898.697922:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:31.0:1773851898.697923:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=131 v=66 (66 66 66 66)
00000100:00000200:22.0:1773851898.697923:0:2456945:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851898.697924:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=131 v=66 (1 1 1 1)
00000400:00000200:30.0:1773851898.697924:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:29.0:1773851898.697924:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:18.0:1773851898.697924:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:5.0:1773851898.697924:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851898.697925:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:29.0:1773851898.697925:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851898.697925:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000100:00000001:31.0:1773851898.697926:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851898.697926:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:18.0:1773851898.697926:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00010000:00000001:31.0:1773851898.697927:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851898.697927:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:22.0:1773851898.697927:0:2456945:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851898.697927:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851898.697927:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:31.0:1773851898.697928:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.697928:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:18.0:1773851898.697928:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6900
00000100:00000200:5.0:1773851898.697928:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:31.0:1773851898.697929:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000100:00000200:30.0:1773851898.697929:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851898.697929:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851898.697930:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851898.697930:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:18.0:1773851898.697930:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000040:31.0:1773851898.697931:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:22.0:1773851898.697932:0:2456945:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851898.697932:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:5.0:1773851898.697932:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851898.697933:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851898.697933:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:18.0:1773851898.697933:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f2431 [1] + 224
00000100:00000001:8.0:1773851898.697933:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851898.697934:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:22.0:1773851898.697934:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:8.0:1773851898.697934:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:7.0:1773851898.697934:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851898.697934:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:29.0:1773851898.697935:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:22.0:1773851898.697935:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851898.697935:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000800:00000200:29.0:1773851898.697936:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851898.697936:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000001:7.0:1773851898.697936:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851898.697936:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:5.0:1773851898.697936:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851898.697936:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851898.697936:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851898.697937:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851898.697937:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851898.697937:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851898.697937:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851898.697937:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:5.0:1773851898.697937:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000004:00000001:31.0:1773851898.697938:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851898.697938:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:18.0:1773851898.697938:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:8.0:1773851898.697938:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851898.697938:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df522108
00000004:00000040:31.0:1773851898.697939:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000100:00000001:28.0:1773851898.697939:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:7.0:1773851898.697939:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df522108.
00000100:00000001:7.0:1773851898.697939:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:5.0:1773851898.697939:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000004:00000040:31.0:1773851898.697940:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351166976 avail=351348423680 avail_mb=1372454780 hwm_mb=3131103 files=372083908 ffree=343116374 state=0: rc = 0
00000400:00000001:28.0:1773851898.697940:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:11.0:1773851898.697940:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00001000:8.0:1773851898.697940:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=131 v=66 (66 66 66 66)
00000400:00000001:4.0:1773851898.697940:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851898.697940:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:28.0:1773851898.697941:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:11.0:1773851898.697941:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:7.0:1773851898.697941:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:31.0:1773851898.697942:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351166976 free, 351348423680 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372083908 files, 343116374 free files
00000400:00000010:28.0:1773851898.697942:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000200:18.0:1773851898.697942:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00001000:8.0:1773851898.697942:0:41068:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=131 v=66 (1 1 1 1)
00000400:00000010:4.0:1773851898.697942:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000004:00000001:31.0:1773851898.697943:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851898.697943:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032756c42
00000400:00000200:4.0:1773851898.697943:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098ca3a41
00000400:00000010:28.0:1773851898.697944:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032756c42.
00000400:00000200:18.0:1773851898.697944:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000100:00000001:8.0:1773851898.697944:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:7.0:1773851898.697944:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851898.697944:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098ca3a41.
00000100:00000040:31.0:1773851898.697945:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851898.697945:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851898.697945:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851898.697945:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851898.697946:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000200:28.0:1773851898.697946:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:18.0:1773851898.697946:0:2507147:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:11.0:1773851898.697946:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00010000:00000001:8.0:1773851898.697946:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000001:11.0:1773851898.697947:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:8.0:1773851898.697947:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.697947:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851898.697947:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:4.0:1773851898.697947:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:31.0:1773851898.697948:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051941056:60@kfi7:13:default-yuba2-0
00000800:00000200:30.0:1773851898.697948:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000200:18.0:1773851898.697948:0:2507147:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851898.697948:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851898.697948:0:41065:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:11.0:1773851898.697949:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000100:00000040:8.0:1773851898.697949:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
02000000:00000001:7.0:1773851898.697949:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851898.697949:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851898.697950:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851898.697950:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:28.0:1773851898.697950:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851898.697950:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a4a49aeb
00000100:00000001:8.0:1773851898.697950:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851898.697950:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851898.697951:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000009d6a92c0 x1859433051941056/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:11.0:1773851898.697951:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a4a49aeb.
00000100:00000001:8.0:1773851898.697951:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851898.697951:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851898.697951:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:7.0:1773851898.697952:0:41065:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=131 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851898.697953:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851898.697953:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.697953:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:8.0:1773851898.697953:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851898.697954:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:28.0:1773851898.697954:0:41088:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:11.0:1773851898.697954:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:7.0:1773851898.697954:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=131 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851898.697954:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:31.0:1773851898.697955:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:28.0:1773851898.697955:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851898.697955:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851898.697955:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851898.697955:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851898.697955:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000010:31.0:1773851898.697956:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e11c4511.
00000100:00000001:28.0:1773851898.697956:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00010000:00000001:7.0:1773851898.697956:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:4.0:1773851898.697956:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:31.0:1773851898.697957:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851898.697957:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:28.0:1773851898.697957:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851898.697957:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851898.697957:0:41065:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851898.697957:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000040:31.0:1773851898.697958:0:41089:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00001000:28.0:1773851898.697958:0:41088:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=131 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851898.697958:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851898.697958:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:4.0:1773851898.697958:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851898.697958:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.697959:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851898.697959:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000101b0638.
00000100:00000001:8.0:1773851898.697959:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:31.0:1773851898.697960:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:28.0:1773851898.697960:0:41088:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=131 v=66 (1 1 1 1)
00000100:00000200:11.0:1773851898.697960:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851898.697960:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:7.0:1773851898.697960:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00001000:4.0:1773851898.697960:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=131 v=66 (66 66 66 66)
02000000:00000001:31.0:1773851898.697961:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:28.0:1773851898.697961:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:28.0:1773851898.697961:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851898.697961:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:7.0:1773851898.697961:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851898.697961:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:31.0:1773851898.697962:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d6a92c0.
00010000:00000001:28.0:1773851898.697962:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000040:8.0:1773851898.697962:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000100:00001000:4.0:1773851898.697962:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=131 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851898.697963:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851898.697963:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:28.0:1773851898.697963:0:41088:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:18.0:1773851898.697963:0:2507147:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851898.697963:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851898.697964:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851898.697964:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851898.697964:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000004:00000040:8.0:1773851898.697964:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504315392 avail=351502167040 avail_mb=1373055340 hwm_mb=3131103 files=372056103 ffree=343265933 state=0: rc = 0
00000100:00000001:4.0:1773851898.697964:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851898.697965:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851898.697965:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851898.697965:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851898.697965:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851898.697965:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.697966:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851898.697966:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851898.697966:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.697966:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:4.0:1773851898.697966:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:28.0:1773851898.697967:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851898.697967:0:41069:0:(client.c:1428:after_reply()) Process entered
00000004:00000020:8.0:1773851898.697967:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504315392 free, 351502167040 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056103 files, 343265933 free files
00000100:00000001:7.0:1773851898.697967:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:4.0:1773851898.697967:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851898.697968:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:11.0:1773851898.697969:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851898.697969:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851898.697969:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:28.0:1773851898.697970:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851898.697970:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851898.697970:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.697970:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851898.697970:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00000100:00000001:28.0:1773851898.697971:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851898.697971:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851898.697971:0:2507147:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:7.0:1773851898.697971:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851898.697971:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:28.0:1773851898.697972:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:11.0:1773851898.697972:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851898.697972:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:7.0:1773851898.697972:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223680 blocks, 31250857152 free, 31250820736 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121363 files, 2868731027 free files
00000100:00000001:4.0:1773851898.697972:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:28.0:1773851898.697973:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735096832 blocks, 31192440640 free, 31192403072 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238476 files, 2962368019 free files
00000400:00000200:18.0:1773851898.697973:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:6.0:1773851898.697974:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:4.0:1773851898.697974:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851898.697975:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000001:28.0:1773851898.697976:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851898.697976:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000004:00000001:7.0:1773851898.697976:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:6.0:1773851898.697977:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:28.0:1773851898.697978:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:8.0:1773851898.697978:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b304e1e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051940928:2060@kfi7:13:default-yuba2-0
00000100:00000040:7.0:1773851898.697978:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:6.0:1773851898.697978:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:6.0:1773851898.697979:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000100:00000001:4.0:1773851898.697979:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851898.697980:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025756a50
00000100:00000001:4.0:1773851898.697980:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00100000:28.0:1773851898.697981:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1b57e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051940992:13@kfi7:41:default-yuba2-0
00000100:00000001:8.0:1773851898.697981:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851898.697981:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025756a50.
00000100:00000001:4.0:1773851898.697981:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851898.697982:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851898.697983:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851898.697983:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:4.0:1773851898.697983:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851898.697984:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851898.697984:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b304e1e8 x1859433051940928/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851898.697984:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067479cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051941184:2074@kfi7:41:default-yuba2-0
00000100:00000200:6.0:1773851898.697984:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:4.0:1773851898.697984:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
00000100:00000040:28.0:1773851898.697985:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c1b57e73 x1859433051940992/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:11.0:1773851898.697986:0:41069:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=131 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851898.697986:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:4.0:1773851898.697986:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399725568 free=351492784128 avail=351490364416 avail_mb=1373009236 hwm_mb=3131103 files=372078000 ffree=343254672 state=0: rc = 0
00000100:00000001:28.0:1773851898.697988:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851898.697988:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00001000:11.0:1773851898.697988:0:41069:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=131 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851898.697988:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:28.0:1773851898.697989:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b825c1cb.
00000100:00000040:7.0:1773851898.697989:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000067479cf9 x1859433051941184/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:6.0:1773851898.697989:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000020:4.0:1773851898.697989:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399725568 blocks, 351492784128 free, 351490364416 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372078000 files, 343254672 free files
02000000:00000001:28.0:1773851898.697990:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:11.0:1773851898.697990:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851898.697990:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:28.0:1773851898.697991:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851898.697991:0:41088:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:11.0:1773851898.697991:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851898.697991:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:28.0:1773851898.697992:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00010000:00000001:11.0:1773851898.697992:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000010:8.0:1773851898.697992:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005350c348.
00000004:00000001:4.0:1773851898.697992:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851898.697993:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a709584c.
00010000:00000001:11.0:1773851898.697993:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851898.697994:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851898.697994:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851898.697994:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c1b57e73.
00000100:00000001:11.0:1773851898.697994:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:8.0:1773851898.697994:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:7.0:1773851898.697994:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:6.0:1773851898.697994:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:11.0:1773851898.697995:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000020:00000001:8.0:1773851898.697995:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851898.697995:0:41068:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
02000000:00000001:7.0:1773851898.697995:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:6.0:1773851898.697995:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:4.0:1773851898.697995:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851898.697996:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851898.697996:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:7.0:1773851898.697996:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000023aa93ab.
00000100:00000001:6.0:1773851898.697996:0:41067:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:28.0:1773851898.697997:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.697997:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:11.0:1773851898.697997:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851898.697997:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:6.0:1773851898.697997:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851898.697998:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:8.0:1773851898.697998:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
02000000:00000001:7.0:1773851898.697998:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:6.0:1773851898.697998:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851898.697999:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.697999:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:7.0:1773851898.697999:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:6.0:1773851898.697999:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851898.698000:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851898.698000:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851898.698000:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851898.698000:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000040:7.0:1773851898.698000:0:41065:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
02000000:00000001:6.0:1773851898.698000:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851898.698000:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000006c4a96c8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051940864:2061@kfi7:13:default-yuba2-0
00000100:00000010:8.0:1773851898.698001:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b304e1e8.
00000020:00000001:7.0:1773851898.698001:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851898.698002:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000daca50c1.
00000100:00001000:6.0:1773851898.698002:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=131 v=66 (66 66 66 66)
00000100:00000001:8.0:1773851898.698003:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851898.698003:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.698004:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851898.698004:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851898.698004:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:6.0:1773851898.698004:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=131 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851898.698004:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851898.698005:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851898.698005:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:11.0:1773851898.698006:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851898.698006:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000010:7.0:1773851898.698006:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000067479cf9.
00000100:00000001:6.0:1773851898.698006:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:4.0:1773851898.698006:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000006c4a96c8 x1859433051940864/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:11.0:1773851898.698007:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851898.698007:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.698007:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851898.698007:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851898.698008:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:8.0:1773851898.698008:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851898.698008:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:6.0:1773851898.698008:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851898.698009:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.698009:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:6.0:1773851898.698009:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:11.0:1773851898.698010:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000100:00000001:6.0:1773851898.698010:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000040:11.0:1773851898.698011:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690105856 avail=351687715840 avail_mb=1373780140 hwm_mb=3131103 files=372231114 ffree=343447369 state=0: rc = 0
00000100:00000040:6.0:1773851898.698011:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:4.0:1773851898.698011:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851898.698012:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851898.698012:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
02000000:00000001:4.0:1773851898.698012:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851898.698013:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.698013:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851898.698013:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d5f06b74.
00000100:00000001:7.0:1773851898.698014:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000020:11.0:1773851898.698015:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690105856 free, 351687715840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231114 files, 343447369 free files
00000100:00000001:7.0:1773851898.698015:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851898.698015:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851898.698015:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:6.0:1773851898.698016:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:4.0:1773851898.698016:0:41066:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000020:00000001:4.0:1773851898.698017:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000001:11.0:1773851898.698018:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851898.698018:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b255b11b.
00000100:00000040:11.0:1773851898.698020:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:4.0:1773851898.698020:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:6.0:1773851898.698021:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:4.0:1773851898.698021:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851898.698022:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000006c4a96c8.
00000100:00000001:6.0:1773851898.698023:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851898.698023:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851898.698024:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851898.698024:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851898.698025:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851898.698025:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:11.0:1773851898.698026:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007fccf737 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051941248:37@kfi7:13:default-yuba2-0
00000004:00000040:6.0:1773851898.698026:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000100:00000001:4.0:1773851898.698027:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851898.698027:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:6.0:1773851898.698028:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500131328 avail=351498052608 avail_mb=1373039268 hwm_mb=3131103 files=372097648 ffree=343261847 state=0: rc = 0
00000100:00000001:11.0:1773851898.698029:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851898.698029:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851898.698029:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.698030:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000020:6.0:1773851898.698031:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500131328 free, 351498052608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097648 files, 343261847 free files
00000100:00000040:11.0:1773851898.698032:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007fccf737 x1859433051941248/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:6.0:1773851898.698034:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.698036:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:6.0:1773851898.698036:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:11.0:1773851898.698037:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:11.0:1773851898.698039:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000006de86c58.
02000000:00000001:11.0:1773851898.698041:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851898.698042:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000100:00100000:6.0:1773851898.698042:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000794439fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051941120:36@kfi7:13:default-yuba2-0
00000020:00000040:11.0:1773851898.698043:0:41069:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000020:00000001:11.0:1773851898.698044:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851898.698045:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000068b7b641.
00000100:00000001:6.0:1773851898.698045:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851898.698046:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:11.0:1773851898.698047:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:11.0:1773851898.698048:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:6.0:1773851898.698048:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000794439fe x1859433051941120/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852051 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:11.0:1773851898.698049:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007fccf737.
00000100:00000001:11.0:1773851898.698050:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:11.0:1773851898.698051:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.698052:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851898.698052:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851898.698053:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851898.698054:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000010:6.0:1773851898.698054:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bd6eccac.
00000100:00000001:11.0:1773851898.698055:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.698056:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851898.698057:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851898.698057:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851898.698057:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851898.698058:0:41067:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000020:00000001:6.0:1773851898.698059:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851898.698060:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a8eda3b1.
02000000:00000001:6.0:1773851898.698062:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851898.698062:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851898.698063:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000794439fe.
00000100:00000001:6.0:1773851898.698065:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851898.698066:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851898.698067:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851898.698069:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851898.698070:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851898.698071:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851898.698072:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851898.751901:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851898.751902:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851898.751903:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851898.751905:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851898.751907:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.751909:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26106@kfi7 : PUT - for me
00000400:00000200:9.0:1773851898.751909:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.751911:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:9.0:1773851898.751912:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.751913:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:9.0:1773851898.751914:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:9.0:1773851898.751915:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26107@kfi7 to cpt 6
00000400:00000200:9.0:1773851898.751916:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26107@kfi7 of length 224 into portal 12 MB=0x699de5e105c80
00000400:00000200:9.0:1773851898.751917:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26107@kfi7 of length 224/224 into md 0x78146ce49 [64] + 163512
00000800:00000200:9.0:1773851898.751919:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851898.751921:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851898.751922:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26106@kfi7: PUT: OK
00000100:00000001:9.0:1773851898.751924:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851898.751924:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851898.751925:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e143e1cf.
00000100:00000040:9.0:1773851898.751926:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000e143e1cf x1858030200183936 msgsize 224
00000100:00100000:9.0:1773851898.751928:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26107@kfi7 (source: 12345-26106@kfi7)
00000100:00000001:9.0:1773851898.751929:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851898.751930:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000100:00000001:11.0:1773851898.751931:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851898.751931:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851898.751932:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851898.751933:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851898.751934:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851898.751935:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851898.751936:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030200183936
00000020:00000001:11.0:1773851898.751937:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851898.751938:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f12
00000020:00000001:11.0:1773851898.751939:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851898.751941:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000070f86eb2 refcount=6
00000020:00000001:11.0:1773851898.751942:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239881728 : -107152469669888 : ffff9e8b9f1bc800)
00000020:00000001:11.0:1773851898.751943:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239881728 : -107152469669888 : ffff9e8b9f1bc800)
00000100:00000001:11.0:1773851898.751945:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.751947:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851898.751948:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000816b63bf.
00000020:00000010:11.0:1773851898.751950:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851898.751951:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007dac8f6e.
00000100:00000001:11.0:1773851898.751953:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851898.751954:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851898.751954:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.751956:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851898.751958:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851898.751958:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.751960:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.751962:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851898.751963:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851898.751963:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851898.751964:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851898.751965:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26107@kfi7, seq: 2130877
00000100:00000040:11.0:1773851898.751967:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000070f86eb2 : new rpc_count 1
00000100:00000001:8.0:1773851898.751967:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.751968:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609062784 : -107064100488832 : ffff9ea032527980)
00000100:00000001:8.0:1773851898.751968:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.751970:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e143e1cf x1858030200183936/t0(0) o400->27cdcc61-87a9-4eca-bd50-547a9afd6a93@26107@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne270-0'
00000100:00000001:11.0:1773851898.751976:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.751976:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851898.751978:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e143e1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:27cdcc61-87a9-4eca-bd50-547a9afd6a93+6:47932:x1858030200183936:12345-26107@kfi7:400:default-tuolumne270-0
00000100:00000200:11.0:1773851898.751981:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030200183936
00000020:00000001:11.0:1773851898.751982:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851898.751983:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851898.751985:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.751986:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851898.751987:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851898.751988:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851898.751989:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030200183936, found 0 last_xid 1858030200183935
00000020:00000001:11.0:1773851898.751991:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851898.751992:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851898.751993:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851898.751994:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.751995:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851898.751996:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851898.751997:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851898.751999:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fa2295dd.
02000000:00000001:11.0:1773851898.752000:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.752001:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.752002:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851898.752003:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030200183936
00010000:00000001:11.0:1773851898.752005:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851898.752007:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e143e1cf x1858030200183936/t0(0) o400->27cdcc61-87a9-4eca-bd50-547a9afd6a93@26107@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00010000:00000001:11.0:1773851898.752012:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851898.752013:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851898.752014:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=131 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851898.752016:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851898.752017:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013e1289e refcount 5 to 26107@kfi7
00000100:00000001:11.0:1773851898.752019:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691520 : -107157065860096 : ffff9e8a8d277c00)
02000000:00000001:11.0:1773851898.752020:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851898.752021:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.752022:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851898.752024:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26106@kfi7
00000400:00000010:11.0:1773851898.752025:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a4a49aeb.
00000100:00000200:11.0:1773851898.752026:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030200183936, offset 224
00000400:00000200:11.0:1773851898.752029:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26106@kfi7
00000400:00000200:11.0:1773851898.752031:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:11.0:1773851898.752032:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:11.0:1773851898.752034:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:11.0:1773851898.752036:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:11.0:1773851898.752039:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26106@kfi7 local destination
00000400:00000200:11.0:1773851898.752041:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770301:8770301:1024:4294967295] 26106@kfi7 LPNI seq info [24658:24658:16:4294967295]
00000400:00000200:11.0:1773851898.752044:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:11.0:1773851898.752045:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:11.0:1773851898.752050:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26106@kfi7(26106@kfi7:26106@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851898.752052:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000800:00000200:11.0:1773851898.752055:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851898.752057:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851898.752061:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851898.752066:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 Using peer 26106@kfi7(0x1000000000009e4)
00000800:00000200:11.0:1773851898.752071:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x1000000000009e4: rc=0
00000800:00000200:11.0:1773851898.752074:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851898.752078:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.752079:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013e1289e refcount 4 to 26107@kfi7
00010000:00000001:11.0:1773851898.752081:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851898.752082:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.752083:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851898.752084:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e143e1cf x1858030200183936/t0(0) o400->27cdcc61-87a9-4eca-bd50-547a9afd6a93@26107@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00000800:00000200:9.0:1773851898.752088:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851898.752089:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851898.752091:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e143e1cf pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:27cdcc61-87a9-4eca-bd50-547a9afd6a93+6:47932:x1858030200183936:12345-26107@kfi7:400:default-tuolumne270-0 Request processed in 114us (164us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851898.752091:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26106@kfi7: PUT: OK
00000400:00000200:9.0:1773851898.752092:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a4a49aeb
00000400:00000010:9.0:1773851898.752092:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a4a49aeb.
00000100:00000001:9.0:1773851898.752093:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851898.752094:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:11.0:1773851898.752095:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26107@kfi7, seq: 2130877
00000400:00000200:9.0:1773851898.752095:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000100:00000040:11.0:1773851898.752097:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000070f86eb2 : new rpc_count 0
00000800:00000200:9.0:1773851898.752097:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 26106@kfi7(00000000c1173070):0x0 lsk 2533 rsk 90 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000009e4 Transaction freed
00000100:00000001:11.0:1773851898.752098:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851898.752099:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851898.752100:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851898.752101:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007dac8f6e.
00000020:00000010:11.0:1773851898.752103:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000816b63bf.
00000020:00000040:11.0:1773851898.752105:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000070f86eb2 : new refcount 5
00000100:00000001:11.0:1773851898.752106:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851898.752185:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851898.752185:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851898.752187:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851898.752190:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851898.752192:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.752193:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26106@kfi7 : PUT - for me
00000400:00000200:9.0:1773851898.752194:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.752194:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:9.0:1773851898.752195:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.752196:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:9.0:1773851898.752197:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:9.0:1773851898.752198:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26107@kfi7 to cpt 6
00000400:00000200:9.0:1773851898.752199:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26107@kfi7 of length 224 into portal 12 MB=0x699de5e1064c0
00000400:00000200:9.0:1773851898.752200:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26107@kfi7 of length 224/224 into md 0x78146ce49 [64] + 163736
00000800:00000200:9.0:1773851898.752202:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851898.752203:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851898.752204:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26106@kfi7: PUT: OK
00000100:00000001:9.0:1773851898.752205:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851898.752206:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851898.752206:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b304e1e8.
00000100:00000040:9.0:1773851898.752207:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000b304e1e8 x1858030200186048 msgsize 224
00000100:00100000:9.0:1773851898.752209:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26107@kfi7 (source: 12345-26106@kfi7)
00000100:00000001:9.0:1773851898.752209:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851898.752210:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000100:00000001:11.0:1773851898.752211:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851898.752211:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851898.752212:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851898.752212:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851898.752212:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851898.752213:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851898.752214:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030200186048
00000020:00000001:11.0:1773851898.752214:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851898.752215:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91230
00000020:00000001:11.0:1773851898.752215:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851898.752218:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005b7bb0a6 refcount=6
00000020:00000001:11.0:1773851898.752219:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240528896 : -107152469022720 : ffff9e8b9f25a800)
00000020:00000001:11.0:1773851898.752220:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240528896 : -107152469022720 : ffff9e8b9f25a800)
00000100:00000001:11.0:1773851898.752221:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.752221:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851898.752222:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000816b63bf.
00000020:00000010:11.0:1773851898.752223:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851898.752223:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007dac8f6e.
00000100:00000001:11.0:1773851898.752224:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851898.752225:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851898.752225:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.752226:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851898.752227:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851898.752227:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.752228:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.752229:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851898.752230:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851898.752230:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26107@kfi7, seq: 2130878
00000100:00000001:8.0:1773851898.752230:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851898.752230:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851898.752231:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005b7bb0a6 : new rpc_count 1
00000100:00000001:8.0:1773851898.752231:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.752232:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609040896 : -107064100510720 : ffff9ea032522400)
00000100:00000001:8.0:1773851898.752232:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.752233:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b304e1e8 x1858030200186048/t0(0) o400->65733714-1dfc-4efd-b392-1e01bae40ccb@26107@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne270-0'
00000100:00000001:11.0:1773851898.752236:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.752236:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851898.752237:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b304e1e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:65733714-1dfc-4efd-b392-1e01bae40ccb+6:47933:x1858030200186048:12345-26107@kfi7:400:default-tuolumne270-0
00000100:00000200:11.0:1773851898.752239:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030200186048
00000020:00000001:11.0:1773851898.752239:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851898.752240:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851898.752241:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.752241:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851898.752242:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851898.752243:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851898.752243:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030200186048, found 0 last_xid 1858030200186047
00000020:00000001:11.0:1773851898.752244:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851898.752245:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851898.752245:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851898.752246:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.752246:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851898.752247:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851898.752247:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851898.752248:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000055af825d.
02000000:00000001:11.0:1773851898.752249:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.752249:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.752250:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851898.752250:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030200186048
00010000:00000001:11.0:1773851898.752251:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851898.752252:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b304e1e8 x1858030200186048/t0(0) o400->65733714-1dfc-4efd-b392-1e01bae40ccb@26107@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00010000:00000001:11.0:1773851898.752254:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851898.752254:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851898.752255:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=131 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851898.752256:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851898.752256:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013e1289e refcount 5 to 26107@kfi7
00000100:00000001:11.0:1773851898.752257:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691520 : -107157065860096 : ffff9e8a8d277c00)
02000000:00000001:11.0:1773851898.752258:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851898.752258:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.752258:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851898.752259:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26106@kfi7
00000400:00000010:11.0:1773851898.752260:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000110e0a3f.
00000100:00000200:11.0:1773851898.752260:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030200186048, offset 224
00000400:00000200:11.0:1773851898.752261:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26106@kfi7
00000400:00000200:11.0:1773851898.752262:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:11.0:1773851898.752263:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 1
00000400:00000200:11.0:1773851898.752264:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:11.0:1773851898.752265:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000400:00000200:11.0:1773851898.752266:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26106@kfi7 local destination
00000400:00000200:11.0:1773851898.752267:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770302:8770302:1024:4294967295] 26106@kfi7 LPNI seq info [24659:24659:16:4294967295]
00000400:00000200:11.0:1773851898.752270:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000400:00000200:11.0:1773851898.752271:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26106@kfi7 to cpt 2
00000400:00000200:11.0:1773851898.752273:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26106@kfi7(26106@kfi7:26106@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851898.752274:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 3
00000800:00000200:11.0:1773851898.752275:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851898.752276:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851898.752278:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851898.752280:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 Using peer 26106@kfi7(0x948)
00000800:00000200:11.0:1773851898.752283:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x948: rc=0
00000800:00000200:11.0:1773851898.752284:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851898.752286:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851898.752286:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013e1289e refcount 4 to 26107@kfi7
00010000:00000001:11.0:1773851898.752287:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851898.752287:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851898.752288:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851898.752289:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b304e1e8 x1858030200186048/t0(0) o400->65733714-1dfc-4efd-b392-1e01bae40ccb@26107@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne270-0'
00000100:00100000:11.0:1773851898.752291:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b304e1e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:65733714-1dfc-4efd-b392-1e01bae40ccb+6:47933:x1858030200186048:12345-26107@kfi7:400:default-tuolumne270-0 Request processed in 55us (83us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851898.752294:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26107@kfi7, seq: 2130878
00000100:00000040:11.0:1773851898.752294:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005b7bb0a6 : new rpc_count 0
00000100:00000001:11.0:1773851898.752295:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851898.752295:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851898.752296:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000800:00000200:9.0:1773851898.752296:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851898.752297:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007dac8f6e.
00000020:00000010:11.0:1773851898.752298:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000816b63bf.
00000400:00000200:9.0:1773851898.752298:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:11.0:1773851898.752299:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000005b7bb0a6 : new refcount 5
00000100:00000001:11.0:1773851898.752299:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851898.752299:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26106@kfi7: PUT: OK
00000400:00000200:9.0:1773851898.752300:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000110e0a3f
00000400:00000010:9.0:1773851898.752301:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000110e0a3f.
00000100:00000001:9.0:1773851898.752302:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851898.752302:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851898.752303:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fddbf6c3 nid 26106@kfi7 refs 2
00000800:00000200:9.0:1773851898.752304:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2069@kfi7:2 -> 26106@kfi7(00000000d0eede92):0x0 lsk 2377 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x948 Transaction freed
00000800:00000200:17.0:1773851898.754886:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851898.754888:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851898.754889:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851898.754893:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851898.754895:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.754897:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12642@kfi7 : PUT - for me
00000400:00000200:17.0:1773851898.754898:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.754900:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 1
00000400:00000200:17.0:1773851898.754902:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:17.0:1773851898.754903:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000400:00000200:17.0:1773851898.754904:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 3
00000400:00000200:17.0:1773851898.754905:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12707@kfi7 to cpt 3
00000400:00000200:17.0:1773851898.754907:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12707@kfi7 of length 224 into portal 12 MB=0x69b4b8e9d4040
00000400:00000200:17.0:1773851898.754909:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12707@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 47920
00000800:00000200:17.0:1773851898.754912:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851898.754914:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.754916:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12642@kfi7: PUT: OK
00000100:00000001:17.0:1773851898.754917:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851898.754918:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851898.754919:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fb7586ac.
00000100:00000040:17.0:1773851898.754920:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000fb7586ac x1859598677786688 msgsize 224
00000100:00100000:17.0:1773851898.754922:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12707@kfi7 (source: 12345-12642@kfi7)
00000100:00000001:17.0:1773851898.754924:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851898.754925:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000100:00000001:19.0:1773851898.754926:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851898.754927:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851898.754927:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851898.754928:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851898.754929:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851898.754930:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851898.754931:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598677786688
00000020:00000001:19.0:1773851898.754932:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851898.754933:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79a66
00000020:00000001:19.0:1773851898.754934:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851898.754938:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000055a9eff8 refcount=5
00000020:00000001:19.0:1773851898.754939:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636941370246144 : -107132339305472 : ffff9e904ef8c400)
00000020:00000001:19.0:1773851898.754940:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636941370246144 : -107132339305472 : ffff9e904ef8c400)
00000100:00000001:19.0:1773851898.754942:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851898.754943:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851898.754944:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000583a54c2.
00000020:00000010:19.0:1773851898.754946:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851898.754947:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bdd5777c.
00000100:00000001:19.0:1773851898.754948:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851898.754949:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851898.754950:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.754951:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851898.754952:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851898.754952:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.754954:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851898.754956:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851898.754956:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851898.754957:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851898.754957:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851898.754958:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12707@kfi7, seq: 2156438
00000100:00000040:19.0:1773851898.754959:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000055a9eff8 : new rpc_count 1
00000100:00000001:16.0:1773851898.754960:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.754961:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794796160 : -107029914755456 : ffff9ea827f35e80)
00000100:00000001:16.0:1773851898.754961:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851898.754963:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fb7586ac x1859598677786688/t0(0) o400->54dbe7bf-5e5f-47dd-97be-1212a905e149@12707@kfi7:150/0 lens 224/0 e 0 to 0 dl 1773852265 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1276-0'
00000100:00000001:19.0:1773851898.754968:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851898.754972:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851898.754973:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb7586ac pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:54dbe7bf-5e5f-47dd-97be-1212a905e149+5:39540:x1859598677786688:12345-12707@kfi7:400:default-tuolumne1276-0
00000100:00000200:19.0:1773851898.754976:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598677786688
00000020:00000001:19.0:1773851898.754977:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851898.754978:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851898.754979:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.754981:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851898.754982:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851898.754983:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851898.754984:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598677786688, found 0 last_xid 1859598677786687
00000020:00000001:19.0:1773851898.754986:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851898.754987:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851898.754988:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851898.754989:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.754990:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851898.754991:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851898.754992:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851898.754993:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d7a50bc0.
02000000:00000001:19.0:1773851898.754995:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.754996:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.754997:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851898.754998:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182407588634, transno 0, xid 1859598677786688
00010000:00000001:19.0:1773851898.754999:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851898.755001:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fb7586ac x1859598677786688/t0(0) o400->54dbe7bf-5e5f-47dd-97be-1212a905e149@12707@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1276-0'
00010000:00000001:19.0:1773851898.755005:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851898.755006:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851898.755007:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=131 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851898.755009:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851898.755011:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000036c49ceb refcount 3 to 12707@kfi7
00000100:00000001:19.0:1773851898.755012:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148864 : -107154898402752 : ffff9e8b0e584240)
02000000:00000001:19.0:1773851898.755013:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851898.755014:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851898.755016:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851898.755018:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12642@kfi7
00000400:00000010:19.0:1773851898.755019:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000010bd7129.
00000100:00000200:19.0:1773851898.755021:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598677786688, offset 224
00000400:00000200:19.0:1773851898.755023:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12642@kfi7
00000400:00000200:19.0:1773851898.755024:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.755026:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 1
00000400:00000200:19.0:1773851898.755028:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000400:00000200:19.0:1773851898.755030:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 3
00000400:00000200:19.0:1773851898.755032:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12642@kfi7 local destination
00000400:00000200:19.0:1773851898.755034:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770303:8770303:1024:4294967295] 12642@kfi7 LPNI seq info [16804115:16804115:16:4294967295]
00000400:00000200:19.0:1773851898.755037:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000400:00000200:19.0:1773851898.755038:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12642@kfi7 to cpt 4
00000400:00000200:19.0:1773851898.755042:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12642@kfi7(12642@kfi7:12642@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851898.755044:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 3
00000800:00000200:19.0:1773851898.755046:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851898.755048:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851898.755053:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851898.755057:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa28 Using peer 12642@kfi7(0xa28)
00000800:00000200:19.0:1773851898.755062:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0xa28: rc=0
00000800:00000200:19.0:1773851898.755065:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa28 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851898.755069:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851898.755071:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000036c49ceb refcount 2 to 12707@kfi7
00010000:00000001:19.0:1773851898.755073:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851898.755073:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851898.755075:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851898.755076:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fb7586ac x1859598677786688/t0(0) o400->54dbe7bf-5e5f-47dd-97be-1212a905e149@12707@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1276-0'
00000800:00000200:17.0:1773851898.755080:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa28 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851898.755083:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb7586ac pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:54dbe7bf-5e5f-47dd-97be-1212a905e149+5:39540:x1859598677786688:12345-12707@kfi7:400:default-tuolumne1276-0 Request processed in 114us (161us total) trans 0 rc 0/0
00000400:00000200:17.0:1773851898.755083:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851898.755085:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12642@kfi7: PUT: OK
00000400:00000200:17.0:1773851898.755086:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000010bd7129
00000100:00100000:19.0:1773851898.755087:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12707@kfi7, seq: 2156438
00000400:00000010:17.0:1773851898.755087:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000010bd7129.
00000100:00000040:19.0:1773851898.755088:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000055a9eff8 : new rpc_count 0
00000100:00000001:17.0:1773851898.755089:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851898.755089:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:19.0:1773851898.755090:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851898.755091:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851898.755091:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002a9272c2 nid 12642@kfi7 refs 2
00000020:00000010:19.0:1773851898.755092:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851898.755093:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bdd5777c.
00000800:00000200:17.0:1773851898.755093:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 12642@kfi7(000000000cd584cb):0x0 lsk 2601 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0xa28 Transaction freed
00000020:00000010:19.0:1773851898.755095:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000583a54c2.
00000020:00000040:19.0:1773851898.755096:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000055a9eff8 : new refcount 4
00000100:00000001:19.0:1773851898.755097:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851898.761732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851898.761734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:13.0:1773851898.847413:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851898.847415:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851898.847417:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851898.847421:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851898.847424:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.847426:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25347@kfi7 : PUT - for me
00000400:00000200:13.0:1773851898.847428:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.847430:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00000400:00000200:13.0:1773851898.847432:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.847433:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:13.0:1773851898.847435:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000400:00000200:13.0:1773851898.847437:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25346@kfi7 to cpt 0
00000400:00000200:13.0:1773851898.847438:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25346@kfi7 of length 224 into portal 12 MB=0x69a1b65e02b40
00000400:00000200:13.0:1773851898.847441:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25346@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 59224
00000800:00000200:13.0:1773851898.847444:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851898.847447:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851898.847449:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25347@kfi7: PUT: OK
00000100:00000001:13.0:1773851898.847451:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851898.847452:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851898.847454:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009573ff4a.
00000100:00000040:13.0:1773851898.847455:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009573ff4a x1858292324248384 msgsize 224
00000100:00100000:13.0:1773851898.847458:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-25346@kfi7 (source: 12345-25347@kfi7)
00000100:00000001:13.0:1773851898.847459:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851898.847461:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000100:00000001:15.0:1773851898.847462:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851898.847463:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:15.0:1773851898.847464:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851898.847465:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851898.847466:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851898.847467:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851898.847469:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858292324248384
00000020:00000001:15.0:1773851898.847470:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851898.847471:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92117
00000020:00000001:15.0:1773851898.847472:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851898.847475:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffc3dfaf refcount=10
00000020:00000001:15.0:1773851898.847476:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000020:00000001:15.0:1773851898.847478:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629504000 : -107123080047616 : ffff9e9276ddd400)
00000100:00000001:15.0:1773851898.847480:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851898.847481:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851898.847482:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000255e2a47.
00000020:00000010:15.0:1773851898.847484:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851898.847486:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851898.847487:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851898.847488:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851898.847489:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851898.847491:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851898.847492:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851898.847493:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.847495:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851898.847497:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851898.847498:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851898.847498:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851898.847499:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851898.847500:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25346@kfi7, seq: 2289936
00000100:00000040:15.0:1773851898.847501:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffc3dfaf : new rpc_count 1
00000100:00000001:12.0:1773851898.847501:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.847502:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945745792 : -106919763805824 : ffff9ec1cd757980)
00000100:00000001:12.0:1773851898.847502:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851898.847505:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009573ff4a x1858292324248384/t0(0) o400->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:538/0 lens 224/0 e 0 to 0 dl 1773852653 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2087-0'
00000100:00000001:15.0:1773851898.847509:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851898.847510:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851898.847511:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009573ff4a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4fec6715-7b94-4677-aa38-bf65c6472a0a+10:39513:x1858292324248384:12345-25346@kfi7:400:default-tuolumne2087-0
00000100:00000200:15.0:1773851898.847514:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858292324248384
00000020:00000001:15.0:1773851898.847515:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851898.847516:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851898.847517:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.847518:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851898.847519:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851898.847520:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851898.847521:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858292324248384, found 0 last_xid 1858292324248383
00000020:00000001:15.0:1773851898.847522:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851898.847524:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851898.847524:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851898.847525:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.847526:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851898.847527:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851898.847528:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851898.847529:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000045032512.
02000000:00000001:15.0:1773851898.847530:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.847531:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.847533:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851898.847534:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260458323, transno 0, xid 1858292324248384
00010000:00000001:15.0:1773851898.847535:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851898.847536:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009573ff4a x1858292324248384/t0(0) o400->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:538/0 lens 224/224 e 0 to 0 dl 1773852653 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2087-0'
00010000:00000001:15.0:1773851898.847540:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851898.847541:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851898.847542:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=131 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851898.847544:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851898.847546:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000006a05649 refcount 3 to 25346@kfi7
00000100:00000001:15.0:1773851898.847547:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729379264 : -107155980172352 : ffff9e8acdddc3c0)
02000000:00000001:15.0:1773851898.847549:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851898.847549:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.847550:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851898.847552:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25347@kfi7
00000400:00000010:15.0:1773851898.847553:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006486d8f3.
00000100:00000200:15.0:1773851898.847554:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858292324248384, offset 224
00000400:00000200:15.0:1773851898.847556:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25347@kfi7
00000400:00000200:15.0:1773851898.847557:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:15.0:1773851898.847559:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 1
00000400:00000200:15.0:1773851898.847561:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:15.0:1773851898.847563:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000400:00000200:15.0:1773851898.847564:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25347@kfi7 local destination
00000400:00000200:15.0:1773851898.847567:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770304:8770304:1024:4294967295] 25347@kfi7 LPNI seq info [16384158:16384158:16:4294967295]
00000400:00000200:15.0:1773851898.847569:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000400:00000200:15.0:1773851898.847570:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25347@kfi7 to cpt 3
00000400:00000200:15.0:1773851898.847574:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25347@kfi7(25347@kfi7:25347@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851898.847576:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 3
00000800:00000200:15.0:1773851898.847578:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851898.847580:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851898.847583:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851898.847587:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df Using peer 25347@kfi7(0x4df)
00000800:00000200:15.0:1773851898.847592:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000a77a65b3: Posted send of 324 bytes to peer 0x4df: rc=0
00000800:00000200:15.0:1773851898.847594:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851898.847597:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851898.847599:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000006a05649 refcount 2 to 25346@kfi7
00010000:00000001:15.0:1773851898.847600:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851898.847601:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.847602:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851898.847603:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009573ff4a x1858292324248384/t0(0) o400->4fec6715-7b94-4677-aa38-bf65c6472a0a@25346@kfi7:538/0 lens 224/224 e 0 to 0 dl 1773852653 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2087-0'
00000100:00100000:15.0:1773851898.847609:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009573ff4a pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4fec6715-7b94-4677-aa38-bf65c6472a0a+10:39513:x1858292324248384:12345-25346@kfi7:400:default-tuolumne2087-0 Request processed in 98us (152us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851898.847609:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851898.847612:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851898.847613:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25346@kfi7, seq: 2289936
00000100:00000040:15.0:1773851898.847614:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffc3dfaf : new rpc_count 0
00000400:00000200:13.0:1773851898.847614:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25347@kfi7: PUT: OK
00000100:00000001:15.0:1773851898.847615:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851898.847615:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006486d8f3
00000100:00000001:15.0:1773851898.847616:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:13.0:1773851898.847616:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006486d8f3.
00000020:00000010:15.0:1773851898.847617:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000100:00000001:13.0:1773851898.847617:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851898.847617:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:15.0:1773851898.847618:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000020:00000010:15.0:1773851898.847619:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000255e2a47.
00000400:00000200:13.0:1773851898.847619:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c34c865 nid 25347@kfi7 refs 2
00000020:00000040:15.0:1773851898.847621:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000ffc3dfaf : new refcount 9
00000800:00000200:13.0:1773851898.847621:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a77a65b3: 2069@kfi7:3 -> 25347@kfi7(00000000f36026d4):0x0 lsk 1248 rsk 64 tsk 0 trmk 0 tmk 0 trr 3 tta 0x4df Transaction freed
00000100:00000001:15.0:1773851898.847622:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851898.862443:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851898.862444:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851898.862445:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851898.862447:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851898.862448:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.862449:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12160@kfi7 : PUT - for me
00000400:00000200:13.0:1773851898.862450:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.862451:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 1
00000400:00000200:13.0:1773851898.862453:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.862454:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000400:00000200:13.0:1773851898.862454:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 3
00000400:00000200:13.0:1773851898.862457:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12097@kfi7 to cpt 3
00000400:00000200:13.0:1773851898.862458:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12097@kfi7 of length 224 into portal 12 MB=0x69b4b64dafa00
00000400:00000200:13.0:1773851898.862459:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12097@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 59448
00000800:00000200:13.0:1773851898.862461:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851898.862462:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851898.862463:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12160@kfi7: PUT: OK
00000100:00000001:13.0:1773851898.862464:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851898.862464:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851898.862465:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e6e9a9c.
00000100:00000040:13.0:1773851898.862465:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005e6e9a9c x1859597977188864 msgsize 224
00000100:00100000:13.0:1773851898.862467:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-12097@kfi7 (source: 12345-12160@kfi7)
00000100:00000001:13.0:1773851898.862467:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851898.862468:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000100:00000001:15.0:1773851898.862469:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851898.862469:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851898.862469:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851898.862469:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851898.862470:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851898.862470:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851898.862471:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597977188864
00000020:00000001:15.0:1773851898.862471:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851898.862472:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d809be
00000020:00000001:15.0:1773851898.862472:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851898.862476:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000037094f66 refcount=5
00000020:00000001:15.0:1773851898.862477:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637153820704768 : -106919888846848 : ffff9ec1c6018000)
00000020:00000001:15.0:1773851898.862477:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637153820704768 : -106919888846848 : ffff9ec1c6018000)
00000100:00000001:15.0:1773851898.862478:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851898.862479:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851898.862479:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000255e2a47.
00000020:00000010:15.0:1773851898.862480:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851898.862481:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851898.862483:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851898.862483:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851898.862483:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851898.862484:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851898.862484:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851898.862485:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.862485:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851898.862486:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851898.862487:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851898.862487:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12097@kfi7, seq: 2289937
00000100:00000001:12.0:1773851898.862487:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851898.862487:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:15.0:1773851898.862488:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000037094f66 : new rpc_count 1
00000100:00000001:15.0:1773851898.862488:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945734272 : -106919763817344 : ffff9ec1cd754c80)
00000100:00000001:12.0:1773851898.862488:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851898.862489:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005e6e9a9c x1859597977188864/t0(0) o400->c410130f-dc41-4340-9780-23a22a0eb5e4@12097@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1252-0'
00000100:00000001:12.0:1773851898.862489:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.862492:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851898.862492:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851898.862493:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e6e9a9c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c410130f-dc41-4340-9780-23a22a0eb5e4+5:39757:x1859597977188864:12345-12097@kfi7:400:default-tuolumne1252-0
00000100:00000200:15.0:1773851898.862494:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597977188864
00000020:00000001:15.0:1773851898.862495:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851898.862495:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851898.862496:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.862496:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851898.862497:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851898.862497:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851898.862497:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597977188864, found 0 last_xid 1859597977188863
00000020:00000001:15.0:1773851898.862498:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851898.862499:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851898.862499:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851898.862499:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.862500:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851898.862500:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851898.862501:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851898.862501:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000464d983b.
02000000:00000001:15.0:1773851898.862502:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.862502:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.862503:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851898.862503:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688162, transno 0, xid 1859597977188864
00010000:00000001:15.0:1773851898.862504:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851898.862505:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005e6e9a9c x1859597977188864/t0(0) o400->c410130f-dc41-4340-9780-23a22a0eb5e4@12097@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1252-0'
00010000:00000001:15.0:1773851898.862507:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851898.862507:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851898.862508:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=131 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851898.862509:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851898.862509:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000096d83fa1 refcount 3 to 12097@kfi7
00000100:00000001:15.0:1773851898.862510:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729296384 : -107155980255232 : ffff9e8acddc8000)
02000000:00000001:15.0:1773851898.862510:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851898.862511:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851898.862511:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851898.862512:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12160@kfi7
00000400:00000010:15.0:1773851898.862512:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000db5fd08.
00000100:00000200:15.0:1773851898.862513:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597977188864, offset 224
00000400:00000200:15.0:1773851898.862514:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12160@kfi7
00000400:00000200:15.0:1773851898.862515:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:15.0:1773851898.862515:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 1
00000400:00000200:15.0:1773851898.862516:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000400:00000200:15.0:1773851898.862517:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 3
00000400:00000200:15.0:1773851898.862518:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12160@kfi7 local destination
00000400:00000200:15.0:1773851898.862519:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770305:8770305:1024:4294967295] 12160@kfi7 LPNI seq info [819952:819952:16:4294967295]
00000400:00000200:15.0:1773851898.862520:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000400:00000200:15.0:1773851898.862521:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12160@kfi7 to cpt 3
00000400:00000200:15.0:1773851898.862523:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12160@kfi7(12160@kfi7:12160@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851898.862524:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 3
00000800:00000200:15.0:1773851898.862525:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851898.862526:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851898.862528:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851898.862531:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa46 Using peer 12160@kfi7(0xa46)
00000800:00000200:15.0:1773851898.862534:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000056f9fe8f: Posted send of 324 bytes to peer 0xa46: rc=0
00000800:00000200:15.0:1773851898.862535:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa46 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851898.862537:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851898.862538:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000096d83fa1 refcount 2 to 12097@kfi7
00010000:00000001:15.0:1773851898.862538:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851898.862539:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851898.862539:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851898.862540:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e6e9a9c x1859597977188864/t0(0) o400->c410130f-dc41-4340-9780-23a22a0eb5e4@12097@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1252-0'
00000100:00100000:15.0:1773851898.862543:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e6e9a9c pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:c410130f-dc41-4340-9780-23a22a0eb5e4+5:39757:x1859597977188864:12345-12097@kfi7:400:default-tuolumne1252-0 Request processed in 50us (76us total) trans 0 rc 0/0
00000100:00100000:15.0:1773851898.862545:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12097@kfi7, seq: 2289937
00000100:00000040:15.0:1773851898.862546:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000037094f66 : new rpc_count 0
00000100:00000001:15.0:1773851898.862547:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:15.0:1773851898.862547:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:13.0:1773851898.862547:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa46 TN_EVENT_TX_OK event status 0
00000020:00000010:15.0:1773851898.862548:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851898.862548:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000400:00000200:13.0:1773851898.862548:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:15.0:1773851898.862549:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000255e2a47.
00000400:00000200:13.0:1773851898.862549:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12160@kfi7: PUT: OK
00000020:00000040:15.0:1773851898.862550:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000037094f66 : new refcount 4
00000100:00000001:15.0:1773851898.862550:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851898.862550:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000db5fd08
00000400:00000010:13.0:1773851898.862550:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000db5fd08.
00000100:00000001:13.0:1773851898.862551:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851898.862551:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851898.862552:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000059e10c4c nid 12160@kfi7 refs 2
00000800:00000200:13.0:1773851898.862553:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000056f9fe8f: 2069@kfi7:3 -> 12160@kfi7(000000007465a8dd):0x0 lsk 2631 rsk 39 tsk 0 trmk 0 tmk 0 trr 3 tta 0xa46 Transaction freed
00000800:00000200:9.0:1773851898.882334:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851898.882336:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851898.882338:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851898.882343:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851898.882346:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.882348:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22129@kfi7 : PUT - for me
00000400:00000200:9.0:1773851898.882350:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.882351:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 1
00000400:00000200:9.0:1773851898.882353:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:9.0:1773851898.882354:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000400:00000200:9.0:1773851898.882355:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 3
00000400:00000200:9.0:1773851898.882357:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22193@kfi7 to cpt 5
00000400:00000200:9.0:1773851898.882359:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22193@kfi7 of length 224 into portal 12 MB=0x69b4c38b35500
00000400:00000200:9.0:1773851898.882361:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22193@kfi7 of length 224/224 into md 0x78146ce49 [64] + 163960
00000800:00000200:9.0:1773851898.882365:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851898.882368:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851898.882370:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22129@kfi7: PUT: OK
00000100:00000001:9.0:1773851898.882371:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851898.882372:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851898.882374:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000273570b.
00000100:00000040:9.0:1773851898.882375:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000000273570b x1859601531360512 msgsize 224
00000100:00100000:9.0:1773851898.882378:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-22193@kfi7 (source: 12345-22129@kfi7)
00000100:00000001:9.0:1773851898.882379:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851898.882382:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851898.882382:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
02000000:00000001:11.0:1773851898.882383:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851898.882384:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851898.882385:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851898.882385:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851898.882386:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851898.882387:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601531360512
00000020:00000001:11.0:1773851898.882388:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851898.882389:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff81073
00000020:00000001:11.0:1773851898.882390:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851898.882394:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000023bd2e3d refcount=5
00000020:00000001:11.0:1773851898.882395:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130249601024 : -106943459950592 : ffff9ebc490f0000)
00000020:00000001:11.0:1773851898.882397:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130249601024 : -106943459950592 : ffff9ebc490f0000)
00000100:00000001:11.0:1773851898.882399:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851898.882400:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851898.882401:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef653fd2.
00000020:00000010:11.0:1773851898.882403:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851898.882404:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007dac8f6e.
00000100:00000001:11.0:1773851898.882405:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851898.882406:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851898.882407:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.882408:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851898.882409:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851898.882410:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851898.882412:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851898.882414:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851898.882414:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851898.882414:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851898.882414:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851898.882416:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22193@kfi7, seq: 2130879
00000100:00000001:11.0:1773851898.882418:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851898.882418:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000023bd2e3d : new rpc_count 1
00000100:00000001:8.0:1773851898.882418:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637009609044352 : -107064100507264 : ffff9ea032523180)
00000100:00000001:11.0:1773851898.882419:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851898.882420:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000273570b x1859601531360512/t0(0) o400->05298562-b381-4e97-806e-d1d8a4b2af67@22193@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1870-0'
00000100:00000001:8.0:1773851898.882423:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851898.882424:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851898.882425:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000273570b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:05298562-b381-4e97-806e-d1d8a4b2af67+5:39511:x1859601531360512:12345-22193@kfi7:400:default-tuolumne1870-0
00000100:00000200:8.0:1773851898.882426:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601531360512
00000020:00000001:8.0:1773851898.882427:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851898.882428:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851898.882429:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851898.882430:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851898.882431:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851898.882432:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851898.882432:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601531360512, found 0 last_xid 1859601531360511
00000020:00000001:8.0:1773851898.882433:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851898.882434:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851898.882435:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851898.882435:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851898.882436:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851898.882437:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851898.882437:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851898.882438:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef7e7683.
02000000:00000001:8.0:1773851898.882439:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851898.882439:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851898.882440:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851898.882440:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686894, transno 0, xid 1859601531360512
00010000:00000001:8.0:1773851898.882441:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851898.882442:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000273570b x1859601531360512/t0(0) o400->05298562-b381-4e97-806e-d1d8a4b2af67@22193@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1870-0'
00010000:00000001:8.0:1773851898.882445:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851898.882446:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851898.882458:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=131 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851898.882459:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851898.882460:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000023706f59 refcount 3 to 22193@kfi7
00000100:00000001:8.0:1773851898.882460:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107936 : -107156354443680 : ffff9e8ab78ed660)
02000000:00000001:8.0:1773851898.882462:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851898.882462:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851898.882463:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851898.882464:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22129@kfi7
00000400:00000010:8.0:1773851898.882464:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6b06622.
00000100:00000200:8.0:1773851898.882465:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601531360512, offset 224
00000400:00000200:8.0:1773851898.882467:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22129@kfi7
00000400:00000200:8.0:1773851898.882468:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:8.0:1773851898.882469:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 1
00000400:00000200:8.0:1773851898.882470:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000400:00000200:8.0:1773851898.882471:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 3
00000400:00000200:8.0:1773851898.882472:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22129@kfi7 local destination
00000400:00000200:8.0:1773851898.882474:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770306:8770306:1024:4294967295] 22129@kfi7 LPNI seq info [201220:201220:16:4294967295]
00000400:00000200:8.0:1773851898.882475:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000400:00000200:8.0:1773851898.882476:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22129@kfi7 to cpt 2
00000400:00000200:8.0:1773851898.882478:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22129@kfi7(22129@kfi7:22129@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851898.882479:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 3
00000800:00000200:8.0:1773851898.882481:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851898.882482:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851898.882484:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851898.882487:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c4 Using peer 22129@kfi7(0x4c4)
00000800:00000200:8.0:1773851898.882490:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x4c4: rc=0
00000800:00000200:8.0:1773851898.882491:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851898.882495:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851898.882496:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000023706f59 refcount 2 to 22193@kfi7
00010000:00000001:8.0:1773851898.882497:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851898.882497:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851898.882498:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851898.882500:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000273570b x1859601531360512/t0(0) o400->05298562-b381-4e97-806e-d1d8a4b2af67@22193@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1870-0'
00000100:00100000:8.0:1773851898.882503:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000273570b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:05298562-b381-4e97-806e-d1d8a4b2af67+5:39511:x1859601531360512:12345-22193@kfi7:400:default-tuolumne1870-0 Request processed in 79us (127us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851898.882506:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22193@kfi7, seq: 2130879
00000100:00000040:8.0:1773851898.882507:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000023bd2e3d : new rpc_count 0
00000100:00000001:8.0:1773851898.882508:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851898.882508:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851898.882509:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:8.0:1773851898.882510:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007dac8f6e.
00000020:00000010:8.0:1773851898.882511:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef653fd2.
00000020:00000040:8.0:1773851898.882512:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000023bd2e3d : new refcount 4
00000100:00000001:8.0:1773851898.882513:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:10.0:1773851898.882519:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c4 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851898.882522:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851898.882524:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22129@kfi7: PUT: OK
00000400:00000200:10.0:1773851898.882525:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6b06622
00000400:00000010:10.0:1773851898.882526:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6b06622.
00000100:00000001:10.0:1773851898.882527:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851898.882528:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851898.882529:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c15fd625 nid 22129@kfi7 refs 2
00000800:00000200:10.0:1773851898.882532:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 22129@kfi7(000000006a50234a):0x0 lsk 1221 rsk 4 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4c4 Transaction freed
00000800:00000200:29.0:1773851898.901097:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851898.901099:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851898.901101:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851898.901104:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851898.901107:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851898.901110:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23034@kfi7 : PUT - for me
00000400:00000200:29.0:1773851898.901111:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851898.901112:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 1
00000400:00000200:29.0:1773851898.901114:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851898.901115:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:29.0:1773851898.901117:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000400:00000200:29.0:1773851898.901118:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:29.0:1773851898.901120:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23034@kfi7 of length 224 into portal 12 MB=0x699de8c0a86c0
00000400:00000200:29.0:1773851898.901122:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23034@kfi7 of length 224/224 into md 0x77fe1859d [64] + 9720
00000800:00000200:29.0:1773851898.901125:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851898.901128:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851898.901129:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23034@kfi7: PUT: OK
00000100:00000001:29.0:1773851898.901131:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851898.901132:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851898.901133:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009871e009.
00000100:00000040:29.0:1773851898.901134:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000009871e009 x1858030971553472 msgsize 224
00000100:00100000:29.0:1773851898.901137:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23034@kfi7 (source: 12345-23034@kfi7)
00000100:00000001:29.0:1773851898.901138:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851898.901140:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000100:00000001:31.0:1773851898.901141:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851898.901142:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851898.901142:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851898.901143:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851898.901144:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851898.901145:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851898.901146:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030971553472
00000020:00000001:31.0:1773851898.901147:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851898.901148:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91245
00000020:00000001:31.0:1773851898.901149:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851898.901151:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002e6d822b refcount=6
00000020:00000001:31.0:1773851898.901152:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240525824 : -107152469025792 : ffff9e8b9f259c00)
00000020:00000001:31.0:1773851898.901154:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240525824 : -107152469025792 : ffff9e8b9f259c00)
00000100:00000001:31.0:1773851898.901155:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851898.901157:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851898.901158:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000790a35bc.
00000020:00000010:31.0:1773851898.901159:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851898.901161:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851898.901163:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851898.901163:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851898.901164:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851898.901166:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851898.901167:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851898.901168:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.901170:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851898.901172:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851898.901172:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851898.901173:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851898.901173:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851898.901174:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23034@kfi7, seq: 2055599
00000100:00000040:31.0:1773851898.901175:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002e6d822b : new rpc_count 1
00000100:00000001:30.0:1773851898.901176:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.901177:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337943168 : -106936371608448 : ffff9ebdef8e8480)
00000100:00000001:30.0:1773851898.901177:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851898.901178:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009871e009 x1858030971553472/t0(0) o400->58446cfb-775d-4bd9-821c-19e06c4d30cc@23034@kfi7:686/0 lens 224/0 e 0 to 0 dl 1773852046 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne258-0'
00000100:00000001:31.0:1773851898.901183:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851898.901184:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851898.901185:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009871e009 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:58446cfb-775d-4bd9-821c-19e06c4d30cc+6:47866:x1858030971553472:12345-23034@kfi7:400:default-tuolumne258-0
00000100:00000200:31.0:1773851898.901188:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030971553472
00000020:00000001:31.0:1773851898.901189:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851898.901191:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851898.901192:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.901193:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851898.901194:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851898.901195:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851898.901196:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030971553472, found 0 last_xid 1858030971553471
00000020:00000001:31.0:1773851898.901197:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851898.901198:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851898.901199:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851898.901200:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.901201:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851898.901202:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851898.901203:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851898.901205:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002f773582.
02000000:00000001:31.0:1773851898.901206:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.901207:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.901208:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851898.901209:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799767671, transno 0, xid 1858030971553472
00010000:00000001:31.0:1773851898.901210:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851898.901211:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009871e009 x1858030971553472/t0(0) o400->58446cfb-775d-4bd9-821c-19e06c4d30cc@23034@kfi7:686/0 lens 224/224 e 0 to 0 dl 1773852046 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne258-0'
00010000:00000001:31.0:1773851898.901216:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851898.901217:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851898.901218:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=131 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851898.901220:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851898.901221:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000c0cbd96 refcount 5 to 23034@kfi7
00000100:00000001:31.0:1773851898.901222:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231807328 : -107130477744288 : ffff9e90bdedef60)
02000000:00000001:31.0:1773851898.901223:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851898.901224:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851898.901225:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851898.901226:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23034@kfi7
00000400:00000010:31.0:1773851898.901227:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000819b29f0.
00000100:00000200:31.0:1773851898.901230:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030971553472, offset 224
00000400:00000200:31.0:1773851898.901232:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23034@kfi7
00000400:00000200:31.0:1773851898.901233:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.901235:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 1
00000400:00000200:31.0:1773851898.901236:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:31.0:1773851898.901238:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000400:00000200:31.0:1773851898.901240:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23034@kfi7 local destination
00000400:00000200:31.0:1773851898.901243:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770307:8770307:1024:4294967295] 23034@kfi7 LPNI seq info [28010:28010:16:4294967295]
00000400:00000200:31.0:1773851898.901245:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000400:00000200:31.0:1773851898.901246:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23034@kfi7 to cpt 7
00000400:00000200:31.0:1773851898.901250:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23034@kfi7(23034@kfi7:23034@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851898.901253:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 3
00000800:00000200:31.0:1773851898.901256:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851898.901258:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851898.901262:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851898.901266:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f Using peer 23034@kfi7(0x10000000000071f)
00000800:00000200:31.0:1773851898.901272:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x10000000000071f: rc=0
00000800:00000200:31.0:1773851898.901275:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851898.901279:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851898.901280:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000c0cbd96 refcount 4 to 23034@kfi7
00010000:00000001:31.0:1773851898.901282:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851898.901283:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851898.901284:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851898.901285:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009871e009 x1858030971553472/t0(0) o400->58446cfb-775d-4bd9-821c-19e06c4d30cc@23034@kfi7:686/0 lens 224/224 e 0 to 0 dl 1773852046 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne258-0'
00000800:00000200:29.0:1773851898.901289:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851898.901291:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009871e009 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:58446cfb-775d-4bd9-821c-19e06c4d30cc+6:47866:x1858030971553472:12345-23034@kfi7:400:default-tuolumne258-0 Request processed in 107us (155us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851898.901292:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851898.901294:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23034@kfi7: PUT: OK
00000100:00100000:31.0:1773851898.901296:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23034@kfi7, seq: 2055599
00000400:00000200:29.0:1773851898.901296:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000819b29f0
00000400:00000010:29.0:1773851898.901297:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000819b29f0.
00000100:00000040:31.0:1773851898.901298:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002e6d822b : new rpc_count 0
00000100:00000001:29.0:1773851898.901298:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:31.0:1773851898.901299:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:29.0:1773851898.901299:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:31.0:1773851898.901300:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851898.901300:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006ec33b4d nid 23034@kfi7 refs 2
00000020:00000010:31.0:1773851898.901301:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851898.901303:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000800:00000200:29.0:1773851898.901303:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 23034@kfi7(000000002f8ce5ed):0x0 lsk 1824 rsk 93 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000071f Transaction freed
00000020:00000010:31.0:1773851898.901304:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000790a35bc.
00000020:00000040:31.0:1773851898.901306:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000002e6d822b : new refcount 5
00000100:00000001:31.0:1773851898.901307:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851898.916913:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851898.916914:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851898.916915:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851898.916917:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851898.916919:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851898.916920:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22736@kfi7 : PUT - for me
00000400:00000200:5.0:1773851898.916921:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851898.916922:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 1
00000400:00000200:5.0:1773851898.916923:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851898.916923:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000400:00000200:5.0:1773851898.916924:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 3
00000400:00000200:5.0:1773851898.916925:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:5.0:1773851898.916926:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22736@kfi7 of length 224 into portal 12 MB=0x699e192433d80
00000400:00000200:5.0:1773851898.916927:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22736@kfi7 of length 224/224 into md 0x793926dc5 [64] + 166216
00000800:00000200:5.0:1773851898.916930:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851898.916931:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851898.916932:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22736@kfi7: PUT: OK
00000100:00000001:5.0:1773851898.916933:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851898.916934:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851898.916935:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006c4a96c8.
00000100:00000040:5.0:1773851898.916935:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000006c4a96c8 x1858043960835456 msgsize 224
00000100:00100000:5.0:1773851898.916937:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22736@kfi7 (source: 12345-22736@kfi7)
00000100:00000001:5.0:1773851898.916938:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851898.916938:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000100:00000001:7.0:1773851898.916939:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851898.916940:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851898.916940:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851898.916940:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851898.916941:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851898.916942:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851898.916942:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043960835456
00000020:00000001:7.0:1773851898.916943:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851898.916944:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a39
00000020:00000001:7.0:1773851898.916944:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851898.916947:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fcc40cd0 refcount=6
00000020:00000001:7.0:1773851898.916947:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743448576 : -107128966103040 : ffff9e911807c000)
00000020:00000001:7.0:1773851898.916948:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743448576 : -107128966103040 : ffff9e911807c000)
00000100:00000001:7.0:1773851898.916949:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851898.916950:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851898.916951:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000050d3f139.
00000020:00000010:7.0:1773851898.916952:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851898.916953:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851898.916954:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851898.916954:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851898.916955:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851898.916956:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851898.916956:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851898.916957:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.916958:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851898.916959:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851898.916960:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851898.916960:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851898.916961:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22736@kfi7, seq: 2001997
00000100:00000040:7.0:1773851898.916961:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fcc40cd0 : new rpc_count 1
00000100:00000001:4.0:1773851898.916961:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851898.916962:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636964924646144 : -107108784905472 : ffff9e95caec6300)
00000100:00000040:7.0:1773851898.916963:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006c4a96c8 x1858043960835456/t0(0) o400->2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58@22736@kfi7:625/0 lens 224/0 e 0 to 0 dl 1773851985 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1905-0'
00000100:00000001:4.0:1773851898.916963:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851898.916964:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.916969:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851898.916969:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851898.916970:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006c4a96c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58+6:39618:x1858043960835456:12345-22736@kfi7:400:default-tuolumne1905-0
00000100:00000200:7.0:1773851898.916972:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043960835456
00000020:00000001:7.0:1773851898.916972:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851898.916973:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851898.916974:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851898.916975:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851898.916975:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851898.916976:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851898.916977:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043960835456, found 0 last_xid 1858043960835455
00000020:00000001:7.0:1773851898.916978:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851898.916979:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851898.916979:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851898.916980:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851898.916980:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851898.916981:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851898.916982:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851898.916982:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000023dc681a.
02000000:00000001:7.0:1773851898.916983:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.916984:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851898.916985:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851898.916985:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098908664, transno 0, xid 1858043960835456
00010000:00000001:7.0:1773851898.916986:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851898.916987:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006c4a96c8 x1858043960835456/t0(0) o400->2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58@22736@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1905-0'
00010000:00000001:7.0:1773851898.916989:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851898.916990:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851898.916991:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=130 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851898.916992:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851898.916993:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000540099d9 refcount 3 to 22736@kfi7
00000100:00000001:7.0:1773851898.916993:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411040 : -107145304140576 : ffff9e8d4a3514e0)
02000000:00000001:7.0:1773851898.916995:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851898.916996:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851898.916996:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851898.916997:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22736@kfi7
00000400:00000010:7.0:1773851898.916998:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df522108.
00000100:00000200:7.0:1773851898.916999:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043960835456, offset 224
00000400:00000200:7.0:1773851898.917000:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22736@kfi7
00000400:00000200:7.0:1773851898.917001:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:7.0:1773851898.917002:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 1
00000400:00000200:7.0:1773851898.917003:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000400:00000200:7.0:1773851898.917004:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 3
00000400:00000200:7.0:1773851898.917005:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22736@kfi7 local destination
00000400:00000200:7.0:1773851898.917006:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770308:8770308:1024:4294967295] 22736@kfi7 LPNI seq info [17841032:17841032:16:4294967295]
00000400:00000200:7.0:1773851898.917008:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000400:00000200:7.0:1773851898.917009:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22736@kfi7 to cpt 1
00000400:00000200:7.0:1773851898.917011:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22736@kfi7(22736@kfi7:22736@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851898.917012:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 3
00000800:00000200:7.0:1773851898.917013:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851898.917014:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851898.917016:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851898.917019:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000094c Using peer 22736@kfi7(0x10000000000094c)
00000800:00000200:7.0:1773851898.917022:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000004b1f88de: Posted send of 324 bytes to peer 0x10000000000094c: rc=0
00000800:00000200:7.0:1773851898.917023:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000094c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851898.917025:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851898.917026:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000540099d9 refcount 2 to 22736@kfi7
00010000:00000001:7.0:1773851898.917027:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851898.917028:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851898.917028:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851898.917029:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006c4a96c8 x1858043960835456/t0(0) o400->2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58@22736@kfi7:625/0 lens 224/224 e 0 to 0 dl 1773851985 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1905-0'
00000100:00100000:7.0:1773851898.917032:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006c4a96c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:2dc86cf6-5d04-4a6b-8aad-cdecbef5cd58+6:39618:x1858043960835456:12345-22736@kfi7:400:default-tuolumne1905-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851898.917035:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22736@kfi7, seq: 2001997
00000100:00000040:7.0:1773851898.917035:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fcc40cd0 : new rpc_count 0
00000100:00000001:7.0:1773851898.917036:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851898.917037:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:5.0:1773851898.917037:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000094c TN_EVENT_TX_OK event status 0
00000020:00000010:7.0:1773851898.917038:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851898.917038:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000400:00000200:5.0:1773851898.917038:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851898.917039:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000050d3f139.
00000400:00000200:5.0:1773851898.917039:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22736@kfi7: PUT: OK
00000020:00000040:7.0:1773851898.917040:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000fcc40cd0 : new refcount 5
00000400:00000200:5.0:1773851898.917040:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df522108
00000400:00000010:5.0:1773851898.917040:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df522108.
00000100:00000001:7.0:1773851898.917041:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851898.917041:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851898.917042:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851898.917043:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea8e0a41 nid 22736@kfi7 refs 2
00000800:00000200:5.0:1773851898.917044:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004b1f88de: 2054@kfi7:1 -> 22736@kfi7(0000000098b4eb40):0x0 lsk 2381 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000094c Transaction freed
00000800:00000200:1.0:1773851898.942897:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851898.942899:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851898.942901:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851898.942904:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851898.942908:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22034@kfi7 to cpt 0
00000400:00000200:1.0:1773851898.942909:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22034@kfi7 : PUT - for me
00000400:00000200:1.0:1773851898.942911:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22034@kfi7 to cpt 0
00000400:00000200:1.0:1773851898.942913:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043d954ee nid 22034@kfi7 refs 1
00000400:00000200:1.0:1773851898.942914:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22034@kfi7 to cpt 0
00000400:00000200:1.0:1773851898.942916:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043d954ee nid 22034@kfi7 refs 2
00000400:00000200:1.0:1773851898.942917:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000043d954ee nid 22034@kfi7 refs 3
00000400:00000200:1.0:1773851898.942919:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22035@kfi7 to cpt 3
00000400:00000200:1.0:1773851898.942921:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22035@kfi7 of length 224 into portal 12 MB=0x699e0d9cb8b40
00000400:00000200:1.0:1773851898.942924:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22035@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 53912
00000800:00000200:1.0:1773851898.942926:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851898.942929:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851898.942931:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22034@kfi7: PUT: OK
00000100:00000001:1.0:1773851898.942933:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851898.942933:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851898.942935:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009cb1b8ce.
00000100:00000040:1.0:1773851898.942936:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000009cb1b8ce x1858040865983296 msgsize 224
00000100:00100000:1.0:1773851898.942938:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22035@kfi7 (source: 12345-22034@kfi7)
00000100:00000001:1.0:1773851898.942940:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851898.942941:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000043d954ee nid 22034@kfi7 refs 2
00000100:00000001:0.0:1773851898.942941:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851898.942942:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851898.942942:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851898.942943:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851898.942943:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851898.942943:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851898.942944:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040865983296
00000020:00000001:0.0:1773851898.942944:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851898.942945:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9195a
00000020:00000001:0.0:1773851898.942946:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851898.942948:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000000a72191 refcount=6
00000020:00000001:0.0:1773851898.942949:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242226688 : -107152467324928 : ffff9e8b9f3f9000)
00000020:00000001:0.0:1773851898.942949:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242226688 : -107152467324928 : ffff9e8b9f3f9000)
00000100:00000001:0.0:1773851898.942950:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851898.942951:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851898.942952:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006d6cf39.
00000020:00000010:0.0:1773851898.942953:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851898.942953:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851898.942954:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851898.942955:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851898.942955:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851898.942956:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851898.942956:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851898.942957:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.942958:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851898.942959:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851898.942959:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851898.942960:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851898.942960:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22035@kfi7, seq: 1997630
00000100:00000001:2.0:1773851898.942961:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851898.942961:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000000a72191 : new rpc_count 1
00000100:00000001:2.0:1773851898.942962:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.942962:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052780800 : -106991656770816 : ffff9eb1104de300)
00000100:00000001:2.0:1773851898.942963:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851898.942963:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009cb1b8ce x1858040865983296/t0(0) o400->573f17a9-0ee0-4f77-8511-2df916ef95f6@22035@kfi7:538/0 lens 224/0 e 0 to 0 dl 1773852653 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1877-0'
00000100:00000001:0.0:1773851898.942966:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851898.942966:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851898.942967:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009cb1b8ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:573f17a9-0ee0-4f77-8511-2df916ef95f6+6:39811:x1858040865983296:12345-22035@kfi7:400:default-tuolumne1877-0
00000100:00000200:0.0:1773851898.942968:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040865983296
00000020:00000001:0.0:1773851898.942969:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851898.942969:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851898.942970:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.942971:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851898.942971:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851898.942973:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851898.942973:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040865983296, found 0 last_xid 1858040865983295
00000020:00000001:0.0:1773851898.942974:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851898.942975:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851898.942975:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851898.942976:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.942976:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851898.942977:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851898.942977:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851898.942978:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000064d0890b.
02000000:00000001:0.0:1773851898.942978:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.942979:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.942980:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851898.942980:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096684157, transno 0, xid 1858040865983296
00010000:00000001:0.0:1773851898.942981:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851898.942982:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009cb1b8ce x1858040865983296/t0(0) o400->573f17a9-0ee0-4f77-8511-2df916ef95f6@22035@kfi7:538/0 lens 224/224 e 0 to 0 dl 1773852653 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1877-0'
00010000:00000001:0.0:1773851898.942984:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851898.942985:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851898.942986:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=131 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851898.942987:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851898.942987:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005b997d71 refcount 3 to 22035@kfi7
00000100:00000001:0.0:1773851898.942988:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487623424 : -107151221928192 : ffff9e8be97acf00)
02000000:00000001:0.0:1773851898.942989:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851898.942989:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851898.942990:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851898.942991:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22034@kfi7
00000400:00000010:0.0:1773851898.942992:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007a35718f.
00000100:00000200:0.0:1773851898.942992:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040865983296, offset 224
00000400:00000200:0.0:1773851898.942994:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22034@kfi7
00000400:00000200:0.0:1773851898.942995:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22034@kfi7 to cpt 0
00000400:00000200:0.0:1773851898.942996:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000043d954ee nid 22034@kfi7 refs 1
00000400:00000200:0.0:1773851898.942997:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000043d954ee nid 22034@kfi7 refs 2
00000400:00000200:0.0:1773851898.942998:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000043d954ee nid 22034@kfi7 refs 3
00000400:00000200:0.0:1773851898.943000:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22034@kfi7 local destination
00000400:00000200:0.0:1773851898.943001:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770309:8770309:1024:4294967295] 22034@kfi7 LPNI seq info [1025655:1025655:16:4294967295]
00000400:00000200:0.0:1773851898.943002:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000043d954ee nid 22034@kfi7 refs 2
00000400:00000200:0.0:1773851898.943003:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22034@kfi7 to cpt 0
00000400:00000200:0.0:1773851898.943005:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22034@kfi7(22034@kfi7:22034@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851898.943007:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000043d954ee nid 22034@kfi7 refs 3
00000800:00000200:0.0:1773851898.943008:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851898.943009:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851898.943011:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851898.943013:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ff Using peer 22034@kfi7(0x1000000000003ff)
00000800:00000200:0.0:1773851898.943016:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x1000000000003ff: rc=0
00000800:00000200:0.0:1773851898.943017:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ff TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851898.943019:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851898.943020:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005b997d71 refcount 2 to 22035@kfi7
00010000:00000001:0.0:1773851898.943021:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851898.943021:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851898.943022:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851898.943022:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009cb1b8ce x1858040865983296/t0(0) o400->573f17a9-0ee0-4f77-8511-2df916ef95f6@22035@kfi7:538/0 lens 224/224 e 0 to 0 dl 1773852653 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1877-0'
00000100:00100000:0.0:1773851898.943027:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009cb1b8ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:573f17a9-0ee0-4f77-8511-2df916ef95f6+6:39811:x1858040865983296:12345-22035@kfi7:400:default-tuolumne1877-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851898.943029:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22035@kfi7, seq: 1997630
00000100:00000040:0.0:1773851898.943030:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000000a72191 : new rpc_count 0
00000100:00000001:0.0:1773851898.943030:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851898.943031:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851898.943032:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851898.943033:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851898.943034:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006d6cf39.
00000020:00000040:0.0:1773851898.943034:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000000a72191 : new refcount 5
00000100:00000001:0.0:1773851898.943035:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851898.943041:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ff TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851898.943044:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851898.943046:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22034@kfi7: PUT: OK
00000400:00000200:1.0:1773851898.943047:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007a35718f
00000400:00000010:1.0:1773851898.943048:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007a35718f.
00000100:00000001:1.0:1773851898.943049:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851898.943050:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851898.943051:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000043d954ee nid 22034@kfi7 refs 2
00000800:00000200:1.0:1773851898.943053:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 22034@kfi7(00000000d8a56b8e):0x0 lsk 1024 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003ff Transaction freed
00000800:00000200:25.0:1773851899.008845:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851899.008846:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851899.008847:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851899.008850:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851899.008852:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.008853:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14656@kfi7 : PUT - for me
00000400:00000200:25.0:1773851899.008854:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.008855:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 1
00000400:00000200:25.0:1773851899.008855:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.008856:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000400:00000200:25.0:1773851899.008857:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 3
00000400:00000200:25.0:1773851899.008858:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.008859:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14656@kfi7 of length 224 into portal 12 MB=0x699e140c83700
00000400:00000200:25.0:1773851899.008860:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14656@kfi7 of length 224/224 into md 0x16159c9699 [64] + 40224
00000800:00000200:25.0:1773851899.008862:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851899.008864:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851899.008865:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14656@kfi7: PUT: OK
00000100:00000001:25.0:1773851899.008866:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851899.008866:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851899.008867:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006607d02d.
00000100:00000040:25.0:1773851899.008868:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000006607d02d x1858042593818368 msgsize 224
00000100:00100000:25.0:1773851899.008869:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-14656@kfi7 (source: 12345-14656@kfi7)
00000100:00000001:25.0:1773851899.008870:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851899.008871:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000800:00000200:25.0:1773851899.008872:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851899.008872:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851899.008873:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851899.008874:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851899.008875:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851899.008876:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851899.008878:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042593818368
00000020:00000001:24.0:1773851899.008879:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851899.008879:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92b27
00000020:00000001:24.0:1773851899.008880:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851899.008882:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a0704df refcount=572
00000020:00000001:24.0:1773851899.008884:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743664640 : -107128965886976 : ffff9e91180b0c00)
00000020:00000001:24.0:1773851899.008885:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743664640 : -107128965886976 : ffff9e91180b0c00)
00000100:00000001:24.0:1773851899.008886:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851899.008887:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851899.008888:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001eca4628.
00000020:00000010:24.0:1773851899.008890:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851899.008891:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000098ea6441.
00000100:00000001:24.0:1773851899.008893:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851899.008893:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851899.008894:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851899.008896:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851899.008896:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851899.008897:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.008899:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851899.008900:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:27.0:1773851899.008901:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851899.008901:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851899.008901:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:27.0:1773851899.008902:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14656@kfi7, seq: 2025187
00000100:00000040:27.0:1773851899.008903:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a0704df : new rpc_count 18
00000100:00000001:24.0:1773851899.008903:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.008904:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637078780421120 : -106994929130496 : ffff9eb04d41a400)
00000100:00000001:24.0:1773851899.008904:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851899.008905:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006607d02d x1858042593818368/t0(0) o400->4d613da8-52a2-45c5-a864-e0ec635d8ba1@14656@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1412-0'
00000100:00000001:27.0:1773851899.008911:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:27.0:1773851899.008911:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:27.0:1773851899.008913:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006607d02d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4d613da8-52a2-45c5-a864-e0ec635d8ba1+572:39655:x1858042593818368:12345-14656@kfi7:400:default-tuolumne1412-0
00000100:00000200:27.0:1773851899.008914:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042593818368
00000020:00000001:27.0:1773851899.008915:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:27.0:1773851899.008916:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:27.0:1773851899.008917:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851899.008918:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:27.0:1773851899.008918:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:27.0:1773851899.008919:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:27.0:1773851899.008920:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042593818368, found 0 last_xid 1858042587434367
00000020:00000001:27.0:1773851899.008921:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:27.0:1773851899.008922:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:27.0:1773851899.008922:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:27.0:1773851899.008923:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851899.008924:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:27.0:1773851899.008924:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:27.0:1773851899.008925:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:27.0:1773851899.008926:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008fcb74e8.
02000000:00000001:27.0:1773851899.008926:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.008927:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851899.008928:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:27.0:1773851899.008928:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578672, transno 0, xid 1858042593818368
00010000:00000001:27.0:1773851899.008929:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:27.0:1773851899.008930:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006607d02d x1858042593818368/t0(0) o400->4d613da8-52a2-45c5-a864-e0ec635d8ba1@14656@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1412-0'
00010000:00000001:27.0:1773851899.008932:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:27.0:1773851899.008933:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851899.008934:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=132 v=313 (313 212 1 1)
00000100:00000001:27.0:1773851899.008935:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:27.0:1773851899.008935:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000566f837e refcount 3 to 14656@kfi7
00000100:00000001:27.0:1773851899.008936:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857632 : -107149578693984 : ffff9e8c4b6c92a0)
02000000:00000001:27.0:1773851899.008937:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:27.0:1773851899.008938:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.008939:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:27.0:1773851899.008939:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14656@kfi7
00000400:00000010:27.0:1773851899.008940:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003ce2d312.
00000100:00000200:27.0:1773851899.008941:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042593818368, offset 224
00000400:00000200:27.0:1773851899.008943:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14656@kfi7
00000400:00000200:27.0:1773851899.008944:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:27.0:1773851899.008945:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 1
00000400:00000200:27.0:1773851899.008946:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000400:00000200:27.0:1773851899.008947:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 3
00000400:00000200:27.0:1773851899.008949:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14656@kfi7 local destination
00000400:00000200:27.0:1773851899.008950:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770310:8770310:1024:4294967295] 14656@kfi7 LPNI seq info [10777234:10777234:16:4294967295]
00000400:00000200:27.0:1773851899.008952:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000400:00000200:27.0:1773851899.008953:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14656@kfi7 to cpt 6
00000400:00000200:27.0:1773851899.008955:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14656@kfi7(14656@kfi7:14656@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851899.008956:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 3
00000800:00000200:27.0:1773851899.008958:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851899.008959:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:27.0:1773851899.008962:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:27.0:1773851899.008964:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7b8 Using peer 14656@kfi7(0x7b8)
00000800:00000200:27.0:1773851899.008967:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000e8517cc3: Posted send of 324 bytes to peer 0x7b8: rc=0
00000800:00000200:27.0:1773851899.008969:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7b8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:27.0:1773851899.008971:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:27.0:1773851899.008972:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000566f837e refcount 2 to 14656@kfi7
00010000:00000001:27.0:1773851899.008973:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:27.0:1773851899.008973:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:27.0:1773851899.008974:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:27.0:1773851899.008975:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006607d02d x1858042593818368/t0(0) o400->4d613da8-52a2-45c5-a864-e0ec635d8ba1@14656@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1412-0'
00000100:00100000:27.0:1773851899.008978:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006607d02d pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4d613da8-52a2-45c5-a864-e0ec635d8ba1+572:39655:x1858042593818368:12345-14656@kfi7:400:default-tuolumne1412-0 Request processed in 66us (110us total) trans 0 rc 0/0
00000100:00100000:27.0:1773851899.008981:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14656@kfi7, seq: 2025187
00000100:00000040:27.0:1773851899.008982:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a0704df : new rpc_count 17
00000800:00000200:25.0:1773851899.008982:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7b8 TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851899.008983:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:27.0:1773851899.008983:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:27.0:1773851899.008984:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000400:00000200:25.0:1773851899.008984:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:27.0:1773851899.008985:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000098ea6441.
00000400:00000200:25.0:1773851899.008985:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14656@kfi7: PUT: OK
00000020:00000010:27.0:1773851899.008986:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001eca4628.
00000400:00000200:25.0:1773851899.008986:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003ce2d312
00000400:00000010:25.0:1773851899.008986:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003ce2d312.
00000020:00000040:27.0:1773851899.008987:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000009a0704df : new refcount 571
00000100:00000001:25.0:1773851899.008987:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851899.008987:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:27.0:1773851899.008988:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851899.008988:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000472146d7 nid 14656@kfi7 refs 2
00000800:00000200:25.0:1773851899.008990:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8517cc3: 2069@kfi7:6 -> 14656@kfi7(00000000ec05bef5):0x0 lsk 1977 rsk 70 tsk 0 trmk 0 tmk 0 trr 6 tta 0x7b8 Transaction freed
00010000:00000001:2.0:1773851899.017736:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017737:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851899.017738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851899.017740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851899.017741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851899.017743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017744:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851899.017745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851899.017746:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851899.017748:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851899.017748:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851899.017755:0:937828:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:30.0:1773851899.017755:0:937828:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:30.0:1773851899.017756:0:937828:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:13.0:1773851899.137972:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851899.137973:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851899.137974:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851899.137976:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851899.137979:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.137980:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10466@kfi7 : PUT - for me
00000400:00000200:13.0:1773851899.137981:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.137982:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 1
00000400:00000200:13.0:1773851899.137982:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.137983:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000400:00000200:13.0:1773851899.137984:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 3
00000400:00000200:13.0:1773851899.137985:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10275@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.137986:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10275@kfi7 of length 224 into portal 12 MB=0x69b8233fa86c0
00000400:00000200:13.0:1773851899.137987:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10275@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 59672
00000800:00000200:13.0:1773851899.137988:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851899.137990:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851899.137991:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10466@kfi7: PUT: OK
00000100:00000001:13.0:1773851899.137992:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851899.137992:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851899.137993:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003cb85233.
00000100:00000040:13.0:1773851899.137993:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003cb85233 x1859833380374208 msgsize 224
00000100:00100000:13.0:1773851899.137995:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-10275@kfi7 (source: 12345-10466@kfi7)
00000100:00000001:13.0:1773851899.137996:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851899.137996:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000800:00000200:13.0:1773851899.137997:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:15.0:1773851899.137998:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:15.0:1773851899.137999:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:15.0:1773851899.138000:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:15.0:1773851899.138001:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851899.138002:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:15.0:1773851899.138004:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833380374208
00000020:00000001:15.0:1773851899.138005:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:15.0:1773851899.138006:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c155b0c
00000020:00000001:15.0:1773851899.138007:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:15.0:1773851899.138013:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dacefa08 refcount=5
00000020:00000001:15.0:1773851899.138014:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637060389062656 : -107013320488960 : ffff9eac050bc800)
00000020:00000001:15.0:1773851899.138015:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637060389062656 : -107013320488960 : ffff9eac050bc800)
00000100:00000001:15.0:1773851899.138017:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851899.138018:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:15.0:1773851899.138019:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000255e2a47.
00000020:00000010:15.0:1773851899.138020:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000068335174.
00000020:00000010:15.0:1773851899.138022:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000f3a056a1.
00000100:00000001:15.0:1773851899.138023:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:15.0:1773851899.138024:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:15.0:1773851899.138025:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851899.138027:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:15.0:1773851899.138027:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:15.0:1773851899.138028:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851899.138030:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:15.0:1773851899.138032:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851899.138032:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:15.0:1773851899.138033:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851899.138033:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:15.0:1773851899.138035:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10275@kfi7, seq: 2289938
00000100:00000040:15.0:1773851899.138036:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dacefa08 : new rpc_count 1
00000100:00000001:12.0:1773851899.138036:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851899.138037:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945728512 : -106919763823104 : ffff9ec1cd753600)
00000100:00000001:12.0:1773851899.138037:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851899.138039:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003cb85233 x1859833380374208/t0(0) o400->023b4f51-6e52-4395-803a-4d036fa1cf09@10275@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1131-0'
00000100:00000001:15.0:1773851899.138044:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:15.0:1773851899.138045:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:15.0:1773851899.138046:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003cb85233 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:023b4f51-6e52-4395-803a-4d036fa1cf09+5:39721:x1859833380374208:12345-10275@kfi7:400:default-tuolumne1131-0
00000100:00000200:15.0:1773851899.138048:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833380374208
00000020:00000001:15.0:1773851899.138049:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:15.0:1773851899.138050:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:15.0:1773851899.138051:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851899.138053:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:15.0:1773851899.138054:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:15.0:1773851899.138055:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:15.0:1773851899.138056:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833380374208, found 0 last_xid 1859833380374207
00000020:00000001:15.0:1773851899.138057:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:15.0:1773851899.138058:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:15.0:1773851899.138059:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:15.0:1773851899.138060:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851899.138061:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:15.0:1773851899.138062:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:15.0:1773851899.138063:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:15.0:1773851899.138064:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007e7073c5.
02000000:00000001:15.0:1773851899.138065:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851899.138066:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851899.138067:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:15.0:1773851899.138068:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413770410, transno 0, xid 1859833380374208
00010000:00000001:15.0:1773851899.138069:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:15.0:1773851899.138071:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003cb85233 x1859833380374208/t0(0) o400->023b4f51-6e52-4395-803a-4d036fa1cf09@10275@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1131-0'
00010000:00000001:15.0:1773851899.138075:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:15.0:1773851899.138076:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:15.0:1773851899.138077:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=132 v=66 (1 1 1 1)
00000100:00000001:15.0:1773851899.138079:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:15.0:1773851899.138080:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc537c6e refcount 3 to 10275@kfi7
00000100:00000001:15.0:1773851899.138081:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811148384 : -107154898403232 : ffff9e8b0e584060)
02000000:00000001:15.0:1773851899.138082:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:15.0:1773851899.138083:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851899.138084:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:15.0:1773851899.138086:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10466@kfi7
00000400:00000010:15.0:1773851899.138087:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000067df834c.
00000100:00000200:15.0:1773851899.138088:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833380374208, offset 224
00000400:00000200:15.0:1773851899.138090:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10466@kfi7
00000400:00000200:15.0:1773851899.138092:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:15.0:1773851899.138093:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 1
00000400:00000200:15.0:1773851899.138095:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000400:00000200:15.0:1773851899.138097:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 3
00000400:00000200:15.0:1773851899.138099:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10466@kfi7 local destination
00000400:00000200:15.0:1773851899.138101:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770311:8770311:1024:4294967295] 10466@kfi7 LPNI seq info [205843:205843:16:4294967295]
00000400:00000200:15.0:1773851899.138103:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000400:00000200:15.0:1773851899.138104:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10466@kfi7 to cpt 3
00000400:00000200:15.0:1773851899.138108:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10466@kfi7(10466@kfi7:10466@kfi7) <?> : PUT try# 0
00000400:00000200:15.0:1773851899.138110:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 3
00000800:00000200:15.0:1773851899.138113:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851899.138114:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:15.0:1773851899.138118:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:15.0:1773851899.138122:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104c Using peer 10466@kfi7(0x104c)
00000800:00000200:15.0:1773851899.138127:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef9d2f1a: Posted send of 324 bytes to peer 0x104c: rc=0
00000800:00000200:15.0:1773851899.138129:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:15.0:1773851899.138133:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:15.0:1773851899.138134:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc537c6e refcount 2 to 10275@kfi7
00010000:00000001:15.0:1773851899.138135:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:15.0:1773851899.138136:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851899.138137:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:15.0:1773851899.138138:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003cb85233 x1859833380374208/t0(0) o400->023b4f51-6e52-4395-803a-4d036fa1cf09@10275@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1131-0'
00000800:00000200:13.0:1773851899.138142:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104c TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851899.138143:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:15.0:1773851899.138144:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003cb85233 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:023b4f51-6e52-4395-803a-4d036fa1cf09+5:39721:x1859833380374208:12345-10275@kfi7:400:default-tuolumne1131-0 Request processed in 99us (149us total) trans 0 rc 0/0
00000400:00000200:13.0:1773851899.138144:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10466@kfi7: PUT: OK
00000400:00000200:13.0:1773851899.138145:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000067df834c
00000400:00000010:13.0:1773851899.138146:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000067df834c.
00000100:00000001:13.0:1773851899.138146:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851899.138147:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00100000:15.0:1773851899.138148:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10275@kfi7, seq: 2289938
00000400:00000200:13.0:1773851899.138148:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee1b3bcb nid 10466@kfi7 refs 2
00000100:00000040:15.0:1773851899.138149:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dacefa08 : new rpc_count 0
00000100:00000001:15.0:1773851899.138150:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851899.138150:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef9d2f1a: 2069@kfi7:3 -> 10466@kfi7(00000000d3b43376):0x0 lsk 4173 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x104c Transaction freed
00000100:00000001:15.0:1773851899.138151:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:15.0:1773851899.138152:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000068335174.
00000020:00000010:15.0:1773851899.138153:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000f3a056a1.
00000020:00000010:15.0:1773851899.138155:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000255e2a47.
00000020:00000040:15.0:1773851899.138156:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000dacefa08 : new refcount 4
00000100:00000001:15.0:1773851899.138157:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851899.153781:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851899.153781:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851899.153783:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851899.153785:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851899.153787:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.153788:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14586@kfi7 : PUT - for me
00000400:00000200:1.0:1773851899.153789:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.153790:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 1
00000400:00000200:1.0:1773851899.153791:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.153792:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:1.0:1773851899.153792:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000400:00000200:1.0:1773851899.153793:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.153794:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14586@kfi7 of length 224 into portal 12 MB=0x699de8d2b31c0
00000400:00000200:1.0:1773851899.153795:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14586@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 54136
00000800:00000200:1.0:1773851899.153797:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851899.153799:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851899.153800:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14586@kfi7: PUT: OK
00000100:00000001:1.0:1773851899.153801:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851899.153801:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851899.153802:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007dbe8c96.
00000100:00000040:1.0:1773851899.153803:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007dbe8c96 x1858030990471616 msgsize 224
00000100:00100000:1.0:1773851899.153804:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-14586@kfi7 (source: 12345-14586@kfi7)
00000100:00000001:1.0:1773851899.153805:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851899.153806:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000800:00000200:1.0:1773851899.153807:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851899.153807:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851899.153807:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851899.153808:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851899.153808:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851899.153809:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851899.153810:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030990471616
00000020:00000001:0.0:1773851899.153810:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851899.153811:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9102a
00000020:00000001:0.0:1773851899.153811:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851899.153815:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f2844070 refcount=6
00000020:00000001:0.0:1773851899.153816:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240099840 : -107152469451776 : ffff9e8b9f1f1c00)
00000020:00000001:0.0:1773851899.153817:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240099840 : -107152469451776 : ffff9e8b9f1f1c00)
00000100:00000001:0.0:1773851899.153818:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851899.153819:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851899.153819:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006d6cf39.
00000020:00000010:0.0:1773851899.153820:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851899.153821:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851899.153822:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851899.153822:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851899.153823:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851899.153824:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851899.153824:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851899.153825:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.153826:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851899.153827:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851899.153827:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851899.153827:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851899.153828:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851899.153828:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14586@kfi7, seq: 1997631
00000100:00000001:2.0:1773851899.153829:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851899.153829:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f2844070 : new rpc_count 1
00000100:00000001:2.0:1773851899.153830:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.153830:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052768128 : -106991656783488 : ffff9eb1104db180)
00000100:00000040:0.0:1773851899.153831:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007dbe8c96 x1858030990471616/t0(0) o400->31f05efb-19ec-4279-9939-59a9e638739c@14586@kfi7:151/0 lens 224/0 e 0 to 0 dl 1773852266 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne225-0'
00000100:00000001:0.0:1773851899.153834:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851899.153834:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851899.153835:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007dbe8c96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:31f05efb-19ec-4279-9939-59a9e638739c+6:47876:x1858030990471616:12345-14586@kfi7:400:default-tuolumne225-0
00000100:00000200:0.0:1773851899.153837:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030990471616
00000020:00000001:0.0:1773851899.153837:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851899.153838:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851899.153838:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.153839:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851899.153840:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851899.153840:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851899.153841:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030990471616, found 0 last_xid 1858030990471615
00000020:00000001:0.0:1773851899.153842:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851899.153842:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851899.153843:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851899.153844:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.153844:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851899.153845:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851899.153845:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851899.153846:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000260d9b5b.
02000000:00000001:0.0:1773851899.153847:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.153848:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.153848:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851899.153849:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030990471616
00010000:00000001:0.0:1773851899.153850:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851899.153850:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007dbe8c96 x1858030990471616/t0(0) o400->31f05efb-19ec-4279-9939-59a9e638739c@14586@kfi7:151/0 lens 224/224 e 0 to 0 dl 1773852266 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne225-0'
00010000:00000001:0.0:1773851899.153853:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851899.153853:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851899.153854:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=132 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851899.153855:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851899.153855:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce33b24b refcount 5 to 14586@kfi7
00000100:00000001:0.0:1773851899.153856:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545859072 : -107154163692544 : ffff9e8b3a230c00)
02000000:00000001:0.0:1773851899.153858:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851899.153858:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.153859:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851899.153860:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14586@kfi7
00000400:00000010:0.0:1773851899.153860:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000028349810.
00000100:00000200:0.0:1773851899.153861:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030990471616, offset 224
00000400:00000200:0.0:1773851899.153862:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14586@kfi7
00000400:00000200:0.0:1773851899.153863:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:0.0:1773851899.153864:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 1
00000400:00000200:0.0:1773851899.153865:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:0.0:1773851899.153866:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000400:00000200:0.0:1773851899.153867:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14586@kfi7 local destination
00000400:00000200:0.0:1773851899.153868:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770312:8770312:1024:4294967295] 14586@kfi7 LPNI seq info [28007:28007:16:4294967295]
00000400:00000200:0.0:1773851899.153870:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000400:00000200:0.0:1773851899.153871:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14586@kfi7 to cpt 0
00000400:00000200:0.0:1773851899.153873:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14586@kfi7(14586@kfi7:14586@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851899.153874:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 3
00000800:00000200:0.0:1773851899.153875:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851899.153876:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851899.153878:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851899.153880:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd Using peer 14586@kfi7(0x1000000000003cd)
00000800:00000200:0.0:1773851899.153883:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x1000000000003cd: rc=0
00000800:00000200:0.0:1773851899.153884:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851899.153886:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851899.153887:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce33b24b refcount 4 to 14586@kfi7
00010000:00000001:0.0:1773851899.153888:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851899.153889:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.153889:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851899.153890:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007dbe8c96 x1858030990471616/t0(0) o400->31f05efb-19ec-4279-9939-59a9e638739c@14586@kfi7:151/0 lens 224/224 e 0 to 0 dl 1773852266 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne225-0'
00000100:00100000:0.0:1773851899.153894:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007dbe8c96 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:31f05efb-19ec-4279-9939-59a9e638739c+6:47876:x1858030990471616:12345-14586@kfi7:400:default-tuolumne225-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851899.153897:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14586@kfi7, seq: 1997631
00000100:00000040:0.0:1773851899.153897:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f2844070 : new rpc_count 0
00000100:00000001:0.0:1773851899.153898:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851899.153899:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851899.153899:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851899.153900:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851899.153901:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006d6cf39.
00000020:00000040:0.0:1773851899.153901:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000f2844070 : new refcount 5
00000100:00000001:0.0:1773851899.153902:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851899.153906:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851899.153908:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851899.153909:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14586@kfi7: PUT: OK
00000400:00000200:1.0:1773851899.153910:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000028349810
00000400:00000010:1.0:1773851899.153911:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000028349810.
00000100:00000001:1.0:1773851899.153912:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851899.153912:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851899.153913:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eb8d8627 nid 14586@kfi7 refs 2
00000800:00000200:1.0:1773851899.153914:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 14586@kfi7(000000009b59ba6d):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000003cd Transaction freed
00080000:00000001:30.0:1773851899.176672:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851899.176673:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851899.176699:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851899.176700:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851899.176730:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851899.176731:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851899.176757:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851899.176757:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851899.176918:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 00000000a8444578 (tot 253203059).
00000400:00000010:30.0:1773851899.176920:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 00000000a8444578 (tot 253202803).
00000800:00000200:29.0:1773851899.194734:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851899.194735:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851899.194736:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851899.194738:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851899.194740:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:29.0:1773851899.194741:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19345@kfi7 : PUT - for me
00000400:00000200:29.0:1773851899.194742:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:29.0:1773851899.194743:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 1
00000400:00000200:29.0:1773851899.194745:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:29.0:1773851899.194745:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000400:00000200:29.0:1773851899.194746:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 3
00000400:00000200:29.0:1773851899.194747:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19280@kfi7 to cpt 0
00000400:00000200:29.0:1773851899.194748:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19280@kfi7 of length 224 into portal 12 MB=0x69b4bc4943680
00000400:00000200:29.0:1773851899.194749:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19280@kfi7 of length 224/224 into md 0x77fe1859d [64] + 9944
00000800:00000200:29.0:1773851899.194750:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851899.194752:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851899.194753:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19345@kfi7: PUT: OK
00000100:00000001:29.0:1773851899.194754:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851899.194754:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851899.194755:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000828bbd80.
00000100:00000040:29.0:1773851899.194755:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000828bbd80 x1859599583164032 msgsize 224
00000100:00100000:29.0:1773851899.194757:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19280@kfi7 (source: 12345-19345@kfi7)
00000100:00000001:29.0:1773851899.194759:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851899.194760:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851899.194760:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
02000000:00000001:31.0:1773851899.194761:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851899.194761:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851899.194761:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851899.194762:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851899.194763:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851899.194763:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599583164032
00000020:00000001:31.0:1773851899.194764:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851899.194764:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82586
00000020:00000001:31.0:1773851899.194765:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851899.194771:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e383da9a refcount=5
00000020:00000001:31.0:1773851899.194772:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109687002112 : -106964022549504 : ffff9eb77f6ea400)
00000020:00000001:31.0:1773851899.194773:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637109687002112 : -106964022549504 : ffff9eb77f6ea400)
00000100:00000001:31.0:1773851899.194774:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851899.194775:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851899.194776:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3c67bb1.
00000020:00000010:31.0:1773851899.194776:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851899.194777:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851899.194778:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851899.194779:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851899.194779:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851899.194780:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851899.194781:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851899.194781:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.194782:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851899.194784:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851899.194784:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851899.194785:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19280@kfi7, seq: 2055600
00000100:00000040:31.0:1773851899.194786:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e383da9a : new rpc_count 1
00000100:00000001:30.0:1773851899.194786:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851899.194787:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337947776 : -106936371603840 : ffff9ebdef8e9680)
00000100:00000001:30.0:1773851899.194787:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851899.194788:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000828bbd80 x1859599583164032/t0(0) o400->cffa382e-d77b-4b5b-9a25-e6783e8fc3b8@19280@kfi7:687/0 lens 224/0 e 0 to 0 dl 1773852047 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1698-0'
00000100:00000001:30.0:1773851899.194788:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.194790:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.194791:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851899.194791:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851899.194792:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000828bbd80 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:cffa382e-d77b-4b5b-9a25-e6783e8fc3b8+5:39549:x1859599583164032:12345-19280@kfi7:400:default-tuolumne1698-0
00000100:00000200:31.0:1773851899.194793:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599583164032
00000020:00000001:31.0:1773851899.194794:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851899.194795:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851899.194795:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.194796:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851899.194796:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851899.194797:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851899.194798:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599583164032, found 0 last_xid 1859599583164031
00000020:00000001:31.0:1773851899.194799:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851899.194799:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851899.194800:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851899.194800:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.194801:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851899.194802:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851899.194802:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851899.194803:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057ae5cc5.
02000000:00000001:31.0:1773851899.194804:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.194805:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.194805:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851899.194806:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260651932, transno 0, xid 1859599583164032
00010000:00000001:31.0:1773851899.194807:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851899.194808:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000828bbd80 x1859599583164032/t0(0) o400->cffa382e-d77b-4b5b-9a25-e6783e8fc3b8@19280@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1698-0'
00010000:00000001:31.0:1773851899.194814:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851899.194815:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851899.194816:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=132 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851899.194817:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851899.194818:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000073580499 refcount 3 to 19280@kfi7
00000100:00000001:31.0:1773851899.194819:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050336 : -107154804501280 : ffff9e8b13f114e0)
02000000:00000001:31.0:1773851899.194820:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851899.194820:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.194821:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851899.194822:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19345@kfi7
00000400:00000010:31.0:1773851899.194823:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000535cda91.
00000100:00000200:31.0:1773851899.194824:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599583164032, offset 224
00000400:00000200:31.0:1773851899.194825:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19345@kfi7
00000400:00000200:31.0:1773851899.194826:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:31.0:1773851899.194827:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 1
00000400:00000200:31.0:1773851899.194828:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000400:00000200:31.0:1773851899.194830:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 3
00000400:00000200:31.0:1773851899.194831:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19345@kfi7 local destination
00000400:00000200:31.0:1773851899.194833:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770313:8770313:1024:4294967295] 19345@kfi7 LPNI seq info [9624909:9624909:16:4294967295]
00000400:00000200:31.0:1773851899.194834:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000400:00000200:31.0:1773851899.194835:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19345@kfi7 to cpt 7
00000400:00000200:31.0:1773851899.194838:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19345@kfi7(19345@kfi7:19345@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851899.194839:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 3
00000800:00000200:31.0:1773851899.194841:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851899.194842:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851899.194844:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851899.194847:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002af Using peer 19345@kfi7(0x1000000000002af)
00000800:00000200:31.0:1773851899.194852:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x1000000000002af: rc=0
00000800:00000200:31.0:1773851899.194854:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002af TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851899.194856:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851899.194857:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000073580499 refcount 2 to 19280@kfi7
00010000:00000001:31.0:1773851899.194858:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851899.194859:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.194859:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851899.194860:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000828bbd80 x1859599583164032/t0(0) o400->cffa382e-d77b-4b5b-9a25-e6783e8fc3b8@19280@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1698-0'
00000100:00100000:31.0:1773851899.194864:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000828bbd80 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:cffa382e-d77b-4b5b-9a25-e6783e8fc3b8+5:39549:x1859599583164032:12345-19280@kfi7:400:default-tuolumne1698-0 Request processed in 72us (107us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851899.194866:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19280@kfi7, seq: 2055600
00000100:00000040:31.0:1773851899.194867:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e383da9a : new rpc_count 0
00000800:00000200:29.0:1773851899.194867:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002af TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851899.194868:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851899.194869:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851899.194869:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851899.194869:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851899.194870:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000200:29.0:1773851899.194870:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19345@kfi7: PUT: OK
00000020:00000010:31.0:1773851899.194871:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3c67bb1.
00000400:00000200:29.0:1773851899.194871:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000535cda91
00000020:00000040:31.0:1773851899.194872:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000e383da9a : new refcount 4
00000400:00000010:29.0:1773851899.194872:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000535cda91.
00000100:00000001:31.0:1773851899.194873:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851899.194873:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851899.194873:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851899.194874:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004e8f4d56 nid 19345@kfi7 refs 2
00000800:00000200:29.0:1773851899.194876:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 19345@kfi7(00000000c8973a8e):0x0 lsk 688 rsk 12 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000002af Transaction freed
00000800:00000200:9.0:1773851899.199961:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851899.199963:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851899.199965:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851899.199968:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851899.199971:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17249@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.199973:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17249@kfi7 : PUT - for me
00000400:00000200:9.0:1773851899.199975:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17249@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.199976:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea00a23a nid 17249@kfi7 refs 1
00000400:00000200:9.0:1773851899.199978:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17249@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.199979:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea00a23a nid 17249@kfi7 refs 2
00000400:00000200:9.0:1773851899.199980:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ea00a23a nid 17249@kfi7 refs 3
00000400:00000200:9.0:1773851899.199982:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17249@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.199983:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17249@kfi7 of length 224 into portal 12 MB=0x69b4b594e0e00
00000400:00000200:9.0:1773851899.199985:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17249@kfi7 of length 224/224 into md 0x78146ce49 [64] + 164184
00000800:00000200:9.0:1773851899.199988:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851899.199991:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851899.199992:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17249@kfi7: PUT: OK
00000100:00000001:9.0:1773851899.199994:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851899.199994:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851899.199997:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006f5ab120.
00000100:00000040:9.0:1773851899.199998:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000006f5ab120 x1859597783404032 msgsize 224
00000100:00100000:9.0:1773851899.200000:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17249@kfi7 (source: 12345-17249@kfi7)
00000100:00000001:9.0:1773851899.200002:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851899.200003:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea00a23a nid 17249@kfi7 refs 2
00000100:00000001:8.0:1773851899.200005:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851899.200006:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2054@kfi7:2 <- 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851899.200006:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851899.200007:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851899.200007:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851899.200009:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851899.200010:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597783404032
00000020:00000001:8.0:1773851899.200011:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851899.200012:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81373
00000020:00000001:8.0:1773851899.200013:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851899.200018:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f63cf0b7 refcount=5
00000020:00000001:8.0:1773851899.200019:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136006989824 : -106937702561792 : ffff9ebda039c800)
00000020:00000001:8.0:1773851899.200020:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136006989824 : -106937702561792 : ffff9ebda039c800)
00000100:00000001:8.0:1773851899.200022:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851899.200024:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851899.200027:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851899.200028:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851899.200030:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851899.200031:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851899.200032:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851899.200033:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.200035:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851899.200036:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851899.200036:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.200038:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.200040:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851899.200041:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851899.200041:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851899.200041:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851899.200043:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17249@kfi7, seq: 2130880
00000100:00000001:11.0:1773851899.200044:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851899.200044:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f63cf0b7 : new rpc_count 1
00000100:00000001:11.0:1773851899.200045:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.200045:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134024717824 : -106939684833792 : ffff9ebd2a12b600)
00000100:00000040:8.0:1773851899.200047:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006f5ab120 x1859597783404032/t0(0) o400->e64416a0-133f-4034-a9b2-278a75eebdd0@17249@kfi7:687/0 lens 224/0 e 0 to 0 dl 1773852047 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1568-0'
00000100:00000001:8.0:1773851899.200051:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851899.200052:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851899.200053:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006f5ab120 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:e64416a0-133f-4034-a9b2-278a75eebdd0+5:39690:x1859597783404032:12345-17249@kfi7:400:default-tuolumne1568-0
00000100:00000200:8.0:1773851899.200055:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597783404032
00000020:00000001:8.0:1773851899.200056:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851899.200057:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851899.200058:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.200059:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851899.200060:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851899.200061:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851899.200062:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597783404032, found 0 last_xid 1859597783404031
00000020:00000001:8.0:1773851899.200064:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851899.200065:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851899.200066:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851899.200067:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.200068:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851899.200069:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851899.200070:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851899.200072:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ff3fa347.
02000000:00000001:8.0:1773851899.200073:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.200074:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.200075:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851899.200076:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413766264, transno 0, xid 1859597783404032
00010000:00000001:8.0:1773851899.200078:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851899.200079:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006f5ab120 x1859597783404032/t0(0) o400->e64416a0-133f-4034-a9b2-278a75eebdd0@17249@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1568-0'
00010000:00000001:8.0:1773851899.200083:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851899.200084:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851899.200085:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=132 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851899.200087:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851899.200088:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eafe9e83 refcount 3 to 17249@kfi7
00000100:00000001:8.0:1773851899.200089:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526776256 : -107156182775360 : ffff9e8ac1ca49c0)
02000000:00000001:8.0:1773851899.200090:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851899.200091:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.200092:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851899.200093:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17249@kfi7
00000400:00000010:8.0:1773851899.200094:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000017f9c5c1.
00000100:00000200:8.0:1773851899.200095:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597783404032, offset 224
00000400:00000200:8.0:1773851899.200097:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17249@kfi7
00000400:00000200:8.0:1773851899.200099:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17249@kfi7 to cpt 2
00000400:00000200:8.0:1773851899.200100:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ea00a23a nid 17249@kfi7 refs 1
00000400:00000200:8.0:1773851899.200101:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ea00a23a nid 17249@kfi7 refs 2
00000400:00000200:8.0:1773851899.200103:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ea00a23a nid 17249@kfi7 refs 3
00000400:00000200:8.0:1773851899.200105:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17249@kfi7 local destination
00000400:00000200:8.0:1773851899.200107:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770314:8770314:1024:4294967295] 17249@kfi7 LPNI seq info [6323012:6323012:16:4294967295]
00000400:00000200:8.0:1773851899.200110:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ea00a23a nid 17249@kfi7 refs 2
00000400:00000200:8.0:1773851899.200111:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17249@kfi7 to cpt 2
00000400:00000200:8.0:1773851899.200114:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17249@kfi7(17249@kfi7:17249@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851899.200117:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ea00a23a nid 17249@kfi7 refs 3
00000800:00000200:8.0:1773851899.200119:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851899.200121:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851899.200125:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851899.200128:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000700 Using peer 17249@kfi7(0x100000000000700)
00000800:00000200:8.0:1773851899.200133:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x100000000000700: rc=0
00000800:00000200:8.0:1773851899.200135:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000700 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851899.200139:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851899.200140:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eafe9e83 refcount 2 to 17249@kfi7
00010000:00000001:8.0:1773851899.200141:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851899.200144:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.200145:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851899.200146:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006f5ab120 x1859597783404032/t0(0) o400->e64416a0-133f-4034-a9b2-278a75eebdd0@17249@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1568-0'
00000100:00100000:8.0:1773851899.200151:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006f5ab120 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:e64416a0-133f-4034-a9b2-278a75eebdd0+5:39690:x1859597783404032:12345-17249@kfi7:400:default-tuolumne1568-0 Request processed in 99us (152us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851899.200155:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17249@kfi7, seq: 2130880
00000100:00000040:8.0:1773851899.200156:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f63cf0b7 : new rpc_count 0
00000100:00000001:8.0:1773851899.200157:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851899.200158:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851899.200159:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851899.200160:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851899.200162:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851899.200163:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000f63cf0b7 : new refcount 4
00000100:00000001:8.0:1773851899.200165:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851899.200172:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000700 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851899.200175:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851899.200176:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17249@kfi7: PUT: OK
00000400:00000200:9.0:1773851899.200178:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000017f9c5c1
00000400:00000010:9.0:1773851899.200179:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000017f9c5c1.
00000100:00000001:9.0:1773851899.200180:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851899.200181:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851899.200182:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ea00a23a nid 17249@kfi7 refs 2
00000800:00000200:9.0:1773851899.200185:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2054@kfi7:2 -> 17249@kfi7(0000000004ca65d9):0x0 lsk 1793 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000700 Transaction freed
00000800:00000200:29.0:1773851899.203765:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851899.203766:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851899.203767:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851899.203768:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851899.203769:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851899.203770:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851899.203772:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18769@kfi7(000000006f568269):0xcb5 version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851899.203775:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851899.203775:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 Using peer 18769@kfi7(0x100000000000cb5)
00000400:00000200:29.0:1773851899.203778:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18769@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.203779:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18769@kfi7 to cpt 7
00000800:00000200:29.0:1773851899.203781:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 38 bytes to peer 0x100000000000cb5: rc=0
00000400:00000200:30.0:1773851899.203782:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18769@kfi7 : PUT - for me
00000400:00000200:30.0:1773851899.203784:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18769@kfi7 to cpt 7
00000800:00000200:29.0:1773851899.203784:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851899.203786:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f472c5c nid 18769@kfi7 refs 1
00000400:00000200:30.0:1773851899.203788:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18769@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.203789:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f472c5c nid 18769@kfi7 refs 2
00000400:00000200:30.0:1773851899.203791:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000f472c5c nid 18769@kfi7 refs 3
00000400:00000200:30.0:1773851899.203794:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18833@kfi7 to cpt 2
00000400:00000200:30.0:1773851899.203795:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18833@kfi7 of length 224 into portal 12 MB=0x699e0e263f1c0
00000800:00000200:29.0:1773851899.203796:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851899.203798:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18833@kfi7 of length 224/224 into md 0x77fe1859d [64] + 10168
00000800:00000200:29.0:1773851899.203800:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 Transaction freed
00000800:00000200:30.0:1773851899.203802:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851899.203805:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851899.203807:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18769@kfi7: PUT: OK
00000100:00000001:30.0:1773851899.203809:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851899.203810:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851899.203811:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001e0d4c5b.
00000100:00000040:30.0:1773851899.203813:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000001e0d4c5b x1858041010188736 msgsize 224
00000100:00100000:30.0:1773851899.203815:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-18833@kfi7 (source: 12345-18769@kfi7)
00000100:00000001:30.0:1773851899.203817:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851899.203819:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000f472c5c nid 18769@kfi7 refs 2
00000100:00000001:31.0:1773851899.203820:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851899.203821:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851899.203821:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851899.203822:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851899.203822:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851899.203823:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851899.203825:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041010188736
00000020:00000001:31.0:1773851899.203825:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851899.203826:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92435
00000020:00000001:31.0:1773851899.203827:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851899.203832:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e09e5ef8 refcount=6
00000020:00000001:31.0:1773851899.203833:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630506496 : -107123079045120 : ffff9e9276ed2000)
00000020:00000001:31.0:1773851899.203835:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630506496 : -107123079045120 : ffff9e9276ed2000)
00000100:00000001:31.0:1773851899.203836:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851899.203838:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851899.203839:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3c67bb1.
00000020:00000010:31.0:1773851899.203840:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851899.203842:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851899.203843:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851899.203844:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851899.203845:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851899.203846:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851899.203847:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851899.203847:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.203849:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851899.203851:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851899.203851:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851899.203852:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851899.203852:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851899.203853:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18833@kfi7, seq: 2055601
00000100:00000040:31.0:1773851899.203854:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e09e5ef8 : new rpc_count 1
00000100:00000001:30.0:1773851899.203855:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.203856:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411269888 : -106960298281728 : ffff9eb85d6a7500)
00000100:00000001:30.0:1773851899.203856:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851899.203858:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001e0d4c5b x1858041010188736/t0(0) o400->9be40dda-cc85-4983-97da-6755eea1eda6@18833@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1666-0'
00000100:00000001:31.0:1773851899.203862:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851899.203863:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851899.203864:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001e0d4c5b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:9be40dda-cc85-4983-97da-6755eea1eda6+6:39887:x1858041010188736:12345-18833@kfi7:400:default-tuolumne1666-0
00000100:00000200:31.0:1773851899.203867:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041010188736
00000020:00000001:31.0:1773851899.203868:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851899.203868:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851899.203869:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.203871:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851899.203872:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851899.203873:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851899.203874:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041010188736, found 0 last_xid 1858041010188735
00000020:00000001:31.0:1773851899.203876:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851899.203877:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851899.203878:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851899.203879:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.203880:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851899.203881:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851899.203882:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851899.203883:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000790a35bc.
02000000:00000001:31.0:1773851899.203884:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.203885:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.203886:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851899.203886:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044166223, transno 0, xid 1858041010188736
00010000:00000001:31.0:1773851899.203887:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851899.203889:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001e0d4c5b x1858041010188736/t0(0) o400->9be40dda-cc85-4983-97da-6755eea1eda6@18833@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1666-0'
00010000:00000001:31.0:1773851899.203892:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851899.203893:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851899.203893:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=132 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851899.203895:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851899.203896:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000093a04e95 refcount 3 to 18833@kfi7
00000100:00000001:31.0:1773851899.203896:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917551676032 : -107156157875584 : ffff9e8ac3463a80)
02000000:00000001:31.0:1773851899.203897:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851899.203898:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.203899:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851899.203900:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18769@kfi7
00000400:00000010:31.0:1773851899.203901:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb75a26a.
00000100:00000200:31.0:1773851899.203901:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041010188736, offset 224
00000400:00000200:31.0:1773851899.203903:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18769@kfi7
00000400:00000200:31.0:1773851899.203904:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18769@kfi7 to cpt 7
00000400:00000200:31.0:1773851899.203905:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f472c5c nid 18769@kfi7 refs 1
00000400:00000200:31.0:1773851899.203906:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000f472c5c nid 18769@kfi7 refs 2
00000400:00000200:31.0:1773851899.203907:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000f472c5c nid 18769@kfi7 refs 3
00000400:00000200:31.0:1773851899.203908:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18769@kfi7 local destination
00000400:00000200:31.0:1773851899.203909:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770315:8770315:1024:4294967295] 18769@kfi7 LPNI seq info [1348238:1348238:16:4294967295]
00000400:00000200:31.0:1773851899.203911:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000f472c5c nid 18769@kfi7 refs 2
00000400:00000200:31.0:1773851899.203912:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18769@kfi7 to cpt 7
00000400:00000200:31.0:1773851899.203914:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18769@kfi7(18769@kfi7:18769@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851899.203915:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000f472c5c nid 18769@kfi7 refs 3
00000800:00000200:31.0:1773851899.203916:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851899.203918:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851899.203920:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851899.203922:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 Using peer 18769@kfi7(0x100000000000cb5)
00000800:00000200:31.0:1773851899.203925:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x100000000000cb5: rc=0
00000800:00000200:31.0:1773851899.203927:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851899.203928:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851899.203929:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000093a04e95 refcount 2 to 18833@kfi7
00010000:00000001:31.0:1773851899.203930:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851899.203931:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.203931:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851899.203932:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001e0d4c5b x1858041010188736/t0(0) o400->9be40dda-cc85-4983-97da-6755eea1eda6@18833@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1666-0'
00000100:00100000:31.0:1773851899.203935:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001e0d4c5b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:9be40dda-cc85-4983-97da-6755eea1eda6+6:39887:x1858041010188736:12345-18833@kfi7:400:default-tuolumne1666-0 Request processed in 72us (122us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851899.203937:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18833@kfi7, seq: 2055601
00000100:00000040:31.0:1773851899.203938:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e09e5ef8 : new rpc_count 0
00000800:00000200:29.0:1773851899.203938:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851899.203939:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851899.203939:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851899.203940:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851899.203940:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851899.203941:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000200:29.0:1773851899.203941:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18769@kfi7: PUT: OK
00000400:00000200:29.0:1773851899.203941:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb75a26a
00000020:00000010:31.0:1773851899.203942:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3c67bb1.
00000400:00000010:29.0:1773851899.203942:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb75a26a.
00000020:00000040:31.0:1773851899.203943:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000e09e5ef8 : new refcount 5
00000100:00000001:31.0:1773851899.203943:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851899.203943:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851899.203943:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851899.203944:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000f472c5c nid 18769@kfi7 refs 2
00000800:00000200:29.0:1773851899.203945:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 18769@kfi7(000000006f568269):0x0 lsk 3254 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000cb5 Transaction freed
00000004:00000001:29.0:1773851899.209731:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851899.209731:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:29.0:1773851899.209732:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cca02ff.
00000020:00000040:29.0:1773851899.209733:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000004:00000001:25.0:1773851899.209733:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:25.0:1773851899.209733:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:29.0:1773851899.209734:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851899.209734:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851899.209735:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:25.0:1773851899.209735:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa5dbdb5.
02000000:00000010:29.0:1773851899.209736:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:29.0:1773851899.209737:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:25.0:1773851899.209737:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000100:00000001:29.0:1773851899.209738:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851899.209738:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851899.209739:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851899.209739:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:29.0:1773851899.209740:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007cca02ff] to pc [ptlrpcd_07_02+2]  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:25.0:1773851899.209740:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851899.209742:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000294dbfa2.
00000100:00000001:25.0:1773851899.209743:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851899.209744:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851899.209745:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:29.0:1773851899.209745:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000e11c4511.
00080000:00000001:29.0:1773851899.209745:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637089291022336 : -106984418529280 : ffff9eb2bfbcb000)
00000100:00000001:28.0:1773851899.209745:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:25.0:1773851899.209745:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851899.209746:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851899.209746:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:29.0:1773851899.209746:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:28.0:1773851899.209746:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851899.209746:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851899.209747:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851899.209747:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:29.0:1773851899.209748:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00000100:00000040:25.0:1773851899.209748:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000fa5dbdb5] to pc [ptlrpcd_06_02+2]  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:29.0:1773851899.209749:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006302f7bc.
00000100:00000001:30.0:1773851899.209750:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851899.209750:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:29.0:1773851899.209750:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614173663025377ns, next at 614174663024615ns, rc = 0
02000000:00000001:30.0:1773851899.209751:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:29.0:1773851899.209751:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:30.0:1773851899.209752:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851899.209752:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851899.209752:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851899.209753:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007cca02ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051941312:2090@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851899.209754:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851899.209754:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851899.209755:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209755:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:25.0:1773851899.209755:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:30.0:1773851899.209756:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:27.0:1773851899.209756:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851899.209756:0:41086:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:26.0:1773851899.209756:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:27.0:1773851899.209757:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851899.209757:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:25.0:1773851899.209757:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000cfcb948f.
02000000:00000010:30.0:1773851899.209758:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b86b0688.
02000000:00000001:30.0:1773851899.209758:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851899.209758:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637110267189248 : -106963442362368 : ffff9eb7a2039800)
00000400:00000200:30.0:1773851899.209759:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:30.0:1773851899.209760:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000100:00000001:27.0:1773851899.209760:0:41086:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:27.0:1773851899.209760:0:41086:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851899.209760:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000400:00000010:30.0:1773851899.209761:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3d2c920.
02000000:00000001:27.0:1773851899.209761:0:41086:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000200:30.0:1773851899.209762:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941312, portal 4
02000000:00000001:27.0:1773851899.209762:0:41086:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.209763:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851899.209763:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637137337946624 : -106936371604992 : ffff9ebdef8e9200)
00000100:00100000:27.0:1773851899.209763:0:41086:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000fa5dbdb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_02:lustre5-MDT0001-mdtlov_UUID:41086:1859433051941376:2068@kfi7:13:default-yuba2-0
00080000:00000001:25.0:1773851899.209763:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851899.209764:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:25.0:1773851899.209764:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000100:00000001:27.0:1773851899.209765:0:41086:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:27.0:1773851899.209765:0:41086:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:27.0:1773851899.209766:0:41086:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:27.0:1773851899.209766:0:41086:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:30.0:1773851899.209767:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851899.209768:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:30.0:1773851899.209768:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000086dda7f0.
02000000:00000010:27.0:1773851899.209768:0:41086:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000025408c89.
02000000:00000001:27.0:1773851899.209768:0:41086:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:25.0:1773851899.209768:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000037c72ee3.
00000100:00000200:30.0:1773851899.209769:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941312, offset 0
00000400:00000200:27.0:1773851899.209769:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000004:00080000:25.0:1773851899.209769:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614173663044803ns, next at 614174663040655ns, rc = 0
00000400:00000200:30.0:1773851899.209770:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000400:00000010:27.0:1773851899.209770:0:41086:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000052625ffc.
00000400:00000200:30.0:1773851899.209771:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000010:27.0:1773851899.209771:0:41086:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da133026.
00080000:00000001:25.0:1773851899.209771:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000400:00000200:30.0:1773851899.209772:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:30.0:1773851899.209773:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000200:27.0:1773851899.209773:0:41086:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941376, portal 4
00000100:00000001:27.0:1773851899.209773:0:41086:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00080000:00000001:25.0:1773851899.209773:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851899.209774:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000001:27.0:1773851899.209774:0:41086:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637121199434752 : -106952510116864 : ffff9eba2da06c00)
00000004:00000001:25.0:1773851899.209774:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851899.209775:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000100:00000040:27.0:1773851899.209775:0:41086:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851899.209776:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770311, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770315, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851899.209778:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:27.0:1773851899.209778:0:41086:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851899.209779:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:27.0:1773851899.209779:0:41086:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:27.0:1773851899.209779:0:41086:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001c61fb44.
00000400:00000200:30.0:1773851899.209780:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000100:00000200:27.0:1773851899.209780:0:41086:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941376, offset 0
00000400:00000200:30.0:1773851899.209781:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770316:8770316:1024:4294967295] 2090@kfi7 LPNI seq info [5404257:5404257:16:4294967295]
00000400:00000200:27.0:1773851899.209781:0:41086:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000400:00000200:30.0:1773851899.209782:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:27.0:1773851899.209782:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:30.0:1773851899.209783:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:27.0:1773851899.209784:0:41086:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:27.0:1773851899.209785:0:41086:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:30.0:1773851899.209786:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000400:00000200:27.0:1773851899.209786:0:41086:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:30.0:1773851899.209787:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:30.0:1773851899.209788:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:27.0:1773851899.209788:0:41086:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000400:00000200:27.0:1773851899.209789:0:41086:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770316, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770315, p:4294967295, g:4294967295, h:1000]
00000800:00000200:30.0:1773851899.209790:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851899.209792:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:27.0:1773851899.209792:0:41086:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:27.0:1773851899.209793:0:41086:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:27.0:1773851899.209794:0:41086:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000800:00000200:30.0:1773851899.209795:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000400:00000200:27.0:1773851899.209795:0:41086:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770317:8770317:1024:4294967295] 2068@kfi7 LPNI seq info [5403705:5403705:16:4294967295]
00000400:00000200:27.0:1773851899.209796:0:41086:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:30.0:1773851899.209798:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000bc942d61: Posted send of 324 bytes to peer 0x16: rc=0
00000400:00000200:27.0:1773851899.209798:0:41086:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:30.0:1773851899.209799:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851899.209800:0:41086:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000100:00000001:30.0:1773851899.209801:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.209802:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:27.0:1773851899.209802:0:41086:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000100:00000001:30.0:1773851899.209803:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.209803:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.209804:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:27.0:1773851899.209804:0:41086:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000100:00000001:30.0:1773851899.209805:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:27.0:1773851899.209805:0:41086:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:30.0:1773851899.209806:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851899.209806:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851899.209807:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851899.209807:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851899.209807:0:41086:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:30.0:1773851899.209808:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851899.209810:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000800:00000200:27.0:1773851899.209810:0:41086:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000400:00000200:29.0:1773851899.209811:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851899.209812:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:29.0:1773851899.209813:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000086dda7f0
00000400:00000010:29.0:1773851899.209814:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000086dda7f0.
00000100:00000001:29.0:1773851899.209814:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:27.0:1773851899.209814:0:41086:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000013625cac: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000100:00000200:29.0:1773851899.209815:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:27.0:1773851899.209815:0:41086:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851899.209818:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:27.0:1773851899.209818:0:41086:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209818:0:41086:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:29.0:1773851899.209819:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851899.209819:0:41086:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209820:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209821:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851899.209822:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209822:0:41086:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851899.209823:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:27.0:1773851899.209823:0:41086:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:27.0:1773851899.209823:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851899.209824:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:27.0:1773851899.209824:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:27.0:1773851899.209824:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209825:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851899.209826:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000800:00000200:26.0:1773851899.209827:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851899.209829:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851899.209830:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000400:00000200:26.0:1773851899.209831:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001c61fb44
00000400:00000010:26.0:1773851899.209831:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001c61fb44.
00000100:00000001:26.0:1773851899.209832:0:2507427:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:26.0:1773851899.209833:0:2507427:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851899.209837:0:2507427:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851899.209838:0:2507427:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851899.209841:0:2507427:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.209842:0:2507427:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:26.0:1773851899.209843:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:26.0:1773851899.209845:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000013625cac: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Transaction freed
00000800:00000200:1.0:1773851899.209857:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851899.209858:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851899.209859:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851899.209862:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851899.209864:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.209866:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:1.0:1773851899.209868:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.209869:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:1.0:1773851899.209871:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.209872:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851899.209873:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:1.0:1773851899.209875:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.209876:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b69c0
00000400:00000200:1.0:1773851899.209878:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:21.0:1773851899.209881:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:1.0:1773851899.209881:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71e6a1 [1] + 224
00000800:00000200:21.0:1773851899.209882:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851899.209884:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851899.209884:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851899.209886:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851899.209887:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851899.209888:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.209890:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000400:00000200:1.0:1773851899.209890:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000400:00000200:21.0:1773851899.209891:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000001:1.0:1773851899.209891:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851899.209892:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:21.0:1773851899.209893:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.209894:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000200:1.0:1773851899.209894:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851899.209895:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:21.0:1773851899.209896:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.209897:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6a00
00000400:00000200:21.0:1773851899.209898:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.209900:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d1fb5 [1] + 224
00000100:00000040:1.0:1773851899.209900:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851899.209903:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851899.209904:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851899.209906:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:21.0:1773851899.209907:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:1.0:1773851899.209907:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:21.0:1773851899.209908:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851899.209909:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:30.0:1773851899.209911:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851899.209912:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:21.0:1773851899.209912:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851899.209912:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851899.209913:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851899.209914:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:30.0:1773851899.209916:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000100:00000001:21.0:1773851899.209916:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:30.0:1773851899.209917:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3d2c920
00000400:00000200:21.0:1773851899.209917:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000010:30.0:1773851899.209918:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3d2c920.
00000100:00000001:30.0:1773851899.209919:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:27.0:1773851899.209919:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851899.209920:0:41086:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851899.209920:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:30.0:1773851899.209921:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:27.0:1773851899.209921:0:41086:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:27.0:1773851899.209922:0:41086:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:27.0:1773851899.209923:0:41086:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000052625ffc.
00000400:00000200:27.0:1773851899.209924:0:41086:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da133026
00000400:00000010:27.0:1773851899.209925:0:41086:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da133026.
00000100:00000200:30.0:1773851899.209927:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:27.0:1773851899.209927:0:41086:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:27.0:1773851899.209928:0:41086:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851899.209932:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851899.209933:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851899.209934:0:41090:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:27.0:1773851899.209934:0:41086:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851899.209935:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851899.209936:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851899.209938:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851899.209939:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209939:0:41086:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:27.0:1773851899.209940:0:41086:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:30.0:1773851899.209941:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=132 v=66 (66 66 66 66)
00000100:00000001:27.0:1773851899.209941:0:41086:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:27.0:1773851899.209942:0:41086:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:30.0:1773851899.209943:0:41090:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=132 v=66 (1 1 1 1)
00000100:00000001:27.0:1773851899.209943:0:41086:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:27.0:1773851899.209944:0:41086:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.209945:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:27.0:1773851899.209945:0:41086:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.209946:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851899.209947:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00001000:27.0:1773851899.209947:0:41086:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=132 v=66 (66 66 66 66)
00010000:00000001:30.0:1773851899.209949:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:27.0:1773851899.209949:0:41086:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=132 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851899.209950:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:30.0:1773851899.209951:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:30.0:1773851899.209952:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:27.0:1773851899.209952:0:41086:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851899.209953:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209953:0:41086:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:27.0:1773851899.209954:0:41086:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:30.0:1773851899.209955:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:27.0:1773851899.209955:0:41086:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.209956:0:41086:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:27.0:1773851899.209957:0:41086:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:27.0:1773851899.209959:0:41086:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:27.0:1773851899.209959:0:41086:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.209960:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:27.0:1773851899.209961:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851899.209962:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851899.209963:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851899.209964:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851899.209965:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000100:00000001:27.0:1773851899.209966:0:41086:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:30.0:1773851899.209967:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351388980224 avail=351386247168 avail_mb=1372602528 hwm_mb=3131103 files=372019003 ffree=343153301 state=0: rc = 0
00000100:00000001:27.0:1773851899.209968:0:41086:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:27.0:1773851899.209968:0:41086:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:27.0:1773851899.209970:0:41086:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000020:30.0:1773851899.209971:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351388980224 free, 351386247168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372019003 files, 343153301 free files
00000004:00000040:27.0:1773851899.209971:0:41086:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:27.0:1773851899.209973:0:41086:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350958917632 avail=350956861440 avail_mb=1370925240 hwm_mb=3131103 files=371563842 ffree=342733318 state=0: rc = 0
00000004:00000001:30.0:1773851899.209974:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851899.209976:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:27.0:1773851899.209976:0:41086:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350958917632 free, 350956861440 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371563842 files, 342733318 free files
00000004:00000001:27.0:1773851899.209979:0:41086:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851899.209981:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007cca02ff pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051941312:2090@kfi7:13:default-yuba2-0
00000100:00000040:27.0:1773851899.209981:0:41086:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851899.209984:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851899.209985:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851899.209987:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007cca02ff x1859433051941312/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:27.0:1773851899.209987:0:41086:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000fa5dbdb5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_02:lustre5-MDT0001-mdtlov_UUID:41086:1859433051941376:2068@kfi7:13:default-yuba2-0
00000100:00000001:27.0:1773851899.209990:0:41086:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851899.209991:0:41086:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:27.0:1773851899.209993:0:41086:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000fa5dbdb5 x1859433051941376/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851899.209997:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851899.209998:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:27.0:1773851899.209998:0:41086:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:27.0:1773851899.209999:0:41086:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851899.210000:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b86b0688.
02000000:00000010:27.0:1773851899.210000:0:41086:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000025408c89.
02000000:00000001:30.0:1773851899.210002:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:27.0:1773851899.210002:0:41086:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851899.210003:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000001:27.0:1773851899.210003:0:41086:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851899.210004:0:41090:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000040:27.0:1773851899.210004:0:41086:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:30.0:1773851899.210006:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:27.0:1773851899.210006:0:41086:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851899.210007:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
02000000:00000010:27.0:1773851899.210007:0:41086:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000294dbfa2.
02000000:00000001:30.0:1773851899.210009:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:27.0:1773851899.210009:0:41086:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851899.210010:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000001:27.0:1773851899.210010:0:41086:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851899.210011:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007cca02ff.
00000100:00000010:27.0:1773851899.210011:0:41086:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000fa5dbdb5.
00000100:00000001:30.0:1773851899.210013:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851899.210013:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851899.210013:0:41086:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:27.0:1773851899.210014:0:41086:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851899.210015:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:27.0:1773851899.210015:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851899.210016:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:27.0:1773851899.210016:0:41086:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851899.210017:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.210017:0:41086:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.210019:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851899.210019:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:27.0:1773851899.210019:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:27.0:1773851899.210020:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851899.212077:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851899.212077:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851899.212078:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851899.212078:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851899.212080:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851899.212080:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851899.212082:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:26.0:1773851899.212082:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21523@kfi7(00000000f087eb76):0xb9d version: 2; local version 2; negotiated version: 2
00000400:00000200:27.0:1773851899.212084:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21523@kfi7 to cpt 6
00000800:00000200:26.0:1773851899.212084:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d Using peer 21523@kfi7(0xb9d)
00000400:00000200:27.0:1773851899.212085:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21523@kfi7 : PUT - for me
00000400:00000200:26.0:1773851899.212086:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21523@kfi7 to cpt 6
00000400:00000200:27.0:1773851899.212087:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21523@kfi7 to cpt 6
00000400:00000200:27.0:1773851899.212088:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 1
00000800:00000200:26.0:1773851899.212088:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 38 bytes to peer 0xb9d: rc=0
00000400:00000200:27.0:1773851899.212089:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21523@kfi7 to cpt 6
00000400:00000200:27.0:1773851899.212089:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 2
00000400:00000200:27.0:1773851899.212090:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 3
00000800:00000200:26.0:1773851899.212090:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851899.212091:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21714@kfi7 to cpt 6
00000400:00000200:27.0:1773851899.212092:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21714@kfi7 of length 224 into portal 12 MB=0x69a7212c4bc00
00000400:00000200:27.0:1773851899.212094:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21714@kfi7 of length 224/224 into md 0x16159c9699 [64] + 40448
00000800:00000200:27.0:1773851899.212096:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000013625cac: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851899.212098:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851899.212099:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21523@kfi7: PUT: OK
00000100:00000001:27.0:1773851899.212100:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851899.212101:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851899.212102:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a9adb65.
00000100:00000040:27.0:1773851899.212102:0:2464256:0:(events.c:358:request_in_callback()) incoming req@000000004a9adb65 x1858664592096256 msgsize 224
00000800:00000200:26.0:1773851899.212102:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d TN_EVENT_TX_OK event status 0
00000100:00100000:27.0:1773851899.212104:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-21714@kfi7 (source: 12345-21523@kfi7)
00000800:00000200:26.0:1773851899.212104:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d Transaction freed
00000100:00000001:27.0:1773851899.212106:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851899.212106:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 2
00000800:00000200:27.0:1773851899.212108:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000013625cac: 2069@kfi7:6 <- 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851899.212109:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851899.212109:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851899.212110:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851899.212110:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851899.212111:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851899.212112:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858664592096256
00000020:00000001:26.0:1773851899.212112:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851899.212113:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9206f
00000020:00000001:26.0:1773851899.212114:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851899.212117:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a37f0736 refcount=6
00000020:00000001:26.0:1773851899.212117:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629485568 : -107123080066048 : ffff9e9276dd8c00)
00000020:00000001:26.0:1773851899.212118:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629485568 : -107123080066048 : ffff9e9276dd8c00)
00000100:00000001:26.0:1773851899.212120:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851899.212120:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851899.212121:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000024e5a498.
00000020:00000010:26.0:1773851899.212122:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851899.212123:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000001:26.0:1773851899.212124:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851899.212124:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851899.212125:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851899.212126:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851899.212127:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851899.212127:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.212128:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851899.212130:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851899.212130:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851899.212131:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851899.212131:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851899.212132:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21714@kfi7, seq: 2025188
00000100:00000040:26.0:1773851899.212132:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a37f0736 : new rpc_count 1
00000100:00000001:26.0:1773851899.212133:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637019998406656 : -107053711144960 : ffff9ea29d934800)
00000100:00000001:24.0:1773851899.212133:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.212133:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851899.212134:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a9adb65 x1858664592096256/t0(0) o400->559d6a80-899e-4fc8-934e-404934393a89@21714@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1845-0'
00000100:00000001:26.0:1773851899.212137:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851899.212137:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851899.212138:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a9adb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:559d6a80-899e-4fc8-934e-404934393a89+6:39478:x1858664592096256:12345-21714@kfi7:400:default-tuolumne1845-0
00000100:00000200:26.0:1773851899.212140:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858664592096256
00000020:00000001:26.0:1773851899.212141:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851899.212141:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851899.212142:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.212143:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851899.212143:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851899.212144:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851899.212145:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858664592096256, found 0 last_xid 1858664592096255
00000020:00000001:26.0:1773851899.212146:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851899.212146:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851899.212147:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851899.212147:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.212148:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851899.212149:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851899.212149:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851899.212150:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005eb6339d.
02000000:00000001:26.0:1773851899.212151:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.212151:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.212152:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851899.212153:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044181486, transno 0, xid 1858664592096256
00010000:00000001:26.0:1773851899.212154:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851899.212155:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a9adb65 x1858664592096256/t0(0) o400->559d6a80-899e-4fc8-934e-404934393a89@21714@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1845-0'
00010000:00000001:26.0:1773851899.212157:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851899.212158:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851899.212158:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=132 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851899.212160:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851899.212160:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000219683ef refcount 3 to 21714@kfi7
00000100:00000001:26.0:1773851899.212161:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130857056 : -107149578694560 : ffff9e8c4b6c9060)
02000000:00000001:26.0:1773851899.212162:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851899.212162:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.212163:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851899.212164:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21523@kfi7
00000400:00000010:26.0:1773851899.212164:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006063c4f0.
00000100:00000200:26.0:1773851899.212165:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858664592096256, offset 224
00000400:00000200:26.0:1773851899.212166:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21523@kfi7
00000400:00000200:26.0:1773851899.212167:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21523@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.212168:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 1
00000400:00000200:26.0:1773851899.212169:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 2
00000400:00000200:26.0:1773851899.212170:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 3
00000400:00000200:26.0:1773851899.212171:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21523@kfi7 local destination
00000400:00000200:26.0:1773851899.212172:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770318:8770318:1024:4294967295] 21523@kfi7 LPNI seq info [293504:293504:16:4294967295]
00000400:00000200:26.0:1773851899.212174:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 2
00000400:00000200:26.0:1773851899.212174:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21523@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.212176:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21523@kfi7(21523@kfi7:21523@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851899.212177:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 3
00000800:00000200:26.0:1773851899.212179:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851899.212180:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851899.212182:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851899.212184:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d Using peer 21523@kfi7(0xb9d)
00000800:00000200:26.0:1773851899.212187:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0xb9d: rc=0
00000800:00000200:26.0:1773851899.212188:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851899.212190:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851899.212191:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000219683ef refcount 2 to 21714@kfi7
00010000:00000001:26.0:1773851899.212192:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851899.212192:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.212193:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851899.212193:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a9adb65 x1858664592096256/t0(0) o400->559d6a80-899e-4fc8-934e-404934393a89@21714@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1845-0'
00000100:00100000:26.0:1773851899.212197:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a9adb65 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:559d6a80-899e-4fc8-934e-404934393a89+6:39478:x1858664592096256:12345-21714@kfi7:400:default-tuolumne1845-0 Request processed in 59us (93us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851899.212199:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21714@kfi7, seq: 2025188
00000100:00000040:26.0:1773851899.212200:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a37f0736 : new rpc_count 0
00000100:00000001:26.0:1773851899.212201:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851899.212201:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851899.212201:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851899.212202:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851899.212202:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000020:00000010:26.0:1773851899.212203:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000024e5a498.
00000020:00000040:26.0:1773851899.212204:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000a37f0736 : new refcount 5
00000400:00000200:25.0:1773851899.212204:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851899.212205:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851899.212206:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21523@kfi7: PUT: OK
00000400:00000200:25.0:1773851899.212207:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006063c4f0
00000400:00000010:25.0:1773851899.212208:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006063c4f0.
00000100:00000001:25.0:1773851899.212209:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851899.212210:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851899.212211:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca7b5ff2 nid 21523@kfi7 refs 2
00000800:00000200:25.0:1773851899.212213:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2069@kfi7:6 -> 21523@kfi7(00000000f087eb76):0x0 lsk 2974 rsk 52 tsk 0 trmk 0 tmk 0 trr 6 tta 0xb9d Transaction freed
00000800:00000200:26.0:1773851899.215430:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851899.215431:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851899.215432:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851899.215434:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851899.215436:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.215438:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20706@kfi7 : PUT - for me
00000400:00000200:26.0:1773851899.215438:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.215439:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 1
00000400:00000200:26.0:1773851899.215440:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.215441:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000400:00000200:26.0:1773851899.215441:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 3
00000400:00000200:26.0:1773851899.215442:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.215443:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20706@kfi7 of length 224 into portal 12 MB=0x699e0cc4e05c0
00000400:00000200:26.0:1773851899.215444:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20706@kfi7 of length 224/224 into md 0x16159c9699 [64] + 40672
00000800:00000200:26.0:1773851899.215446:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851899.215448:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851899.215449:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20706@kfi7: PUT: OK
00000100:00000001:26.0:1773851899.215449:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851899.215450:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851899.215451:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000030c9c3c8.
00000100:00000040:26.0:1773851899.215451:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000030c9c3c8 x1858040639653312 msgsize 224
00000100:00100000:26.0:1773851899.215453:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-20706@kfi7 (source: 12345-20706@kfi7)
00000100:00000001:26.0:1773851899.215454:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851899.215455:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000800:00000200:26.0:1773851899.215456:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b1d5b8e6: 2054@kfi7:6 <- 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851899.215459:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851899.215459:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851899.215459:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851899.215460:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851899.215460:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851899.215461:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040639653312
00000020:00000001:26.0:1773851899.215461:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851899.215462:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91d9e
00000020:00000001:26.0:1773851899.215462:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851899.215464:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ac305a91 refcount=8
00000020:00000001:26.0:1773851899.215465:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628499456 : -107123081052160 : ffff9e9276ce8000)
00000020:00000001:26.0:1773851899.215465:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628499456 : -107123081052160 : ffff9e9276ce8000)
00000100:00000001:26.0:1773851899.215466:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851899.215467:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851899.215467:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000024e5a498.
00000020:00000010:26.0:1773851899.215468:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851899.215468:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000001:26.0:1773851899.215469:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851899.215469:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851899.215470:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851899.215471:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851899.215471:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851899.215471:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.215472:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851899.215473:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851899.215473:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851899.215473:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:26.0:1773851899.215474:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20706@kfi7, seq: 2025189
00000100:00000001:24.0:1773851899.215474:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851899.215475:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ac305a91 : new rpc_count 1
00000100:00000001:26.0:1773851899.215475:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137189206400 : -106936520345216 : ffff9ebde6b0f980)
00000100:00000001:24.0:1773851899.215475:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.215475:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851899.215476:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000030c9c3c8 x1858040639653312/t0(0) o400->b665ca94-5aa6-4a24-a470-507cb5a87634@20706@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1771-0'
00000100:00000001:26.0:1773851899.215479:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851899.215479:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851899.215480:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000030c9c3c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b665ca94-5aa6-4a24-a470-507cb5a87634+8:39821:x1858040639653312:12345-20706@kfi7:400:default-tuolumne1771-0
00000100:00000200:26.0:1773851899.215482:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040639653312
00000020:00000001:26.0:1773851899.215482:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851899.215483:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851899.215483:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.215484:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851899.215484:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851899.215485:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851899.215485:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040639653312, found 0 last_xid 1858040639653311
00000020:00000001:26.0:1773851899.215486:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851899.215487:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851899.215487:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851899.215487:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.215488:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851899.215488:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851899.215489:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851899.215489:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bd5c6346.
02000000:00000001:26.0:1773851899.215490:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.215490:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.215491:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851899.215491:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044173959, transno 0, xid 1858040639653312
00010000:00000001:26.0:1773851899.215492:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851899.215493:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000030c9c3c8 x1858040639653312/t0(0) o400->b665ca94-5aa6-4a24-a470-507cb5a87634@20706@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1771-0'
00010000:00000001:26.0:1773851899.215495:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851899.215495:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851899.215496:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=132 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851899.215497:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851899.215498:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000eef21c76 refcount 3 to 20706@kfi7
00000100:00000001:26.0:1773851899.215498:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643691040 : -107157065860576 : ffff9e8a8d277a20)
02000000:00000001:26.0:1773851899.215499:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851899.215499:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.215500:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851899.215501:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20706@kfi7
00000400:00000010:26.0:1773851899.215501:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009b6134f.
00000100:00000200:26.0:1773851899.215502:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040639653312, offset 224
00000400:00000200:26.0:1773851899.215503:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20706@kfi7
00000400:00000200:26.0:1773851899.215504:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.215504:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 1
00000400:00000200:26.0:1773851899.215505:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000400:00000200:26.0:1773851899.215506:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 3
00000400:00000200:26.0:1773851899.215507:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20706@kfi7 local destination
00000400:00000200:26.0:1773851899.215508:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770319:8770319:1024:4294967295] 20706@kfi7 LPNI seq info [630394:630394:16:4294967295]
00000400:00000200:26.0:1773851899.215509:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000400:00000200:26.0:1773851899.215512:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20706@kfi7 to cpt 6
00000400:00000200:26.0:1773851899.215514:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20706@kfi7(20706@kfi7:20706@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851899.215515:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 3
00000800:00000200:26.0:1773851899.215516:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851899.215517:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851899.215519:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851899.215521:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005ba Using peer 20706@kfi7(0x1000000000005ba)
00000800:00000200:26.0:1773851899.215524:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x1000000000005ba: rc=0
00000800:00000200:26.0:1773851899.215525:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005ba TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851899.215527:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851899.215528:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000eef21c76 refcount 2 to 20706@kfi7
00010000:00000001:26.0:1773851899.215529:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851899.215529:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851899.215530:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851899.215530:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000030c9c3c8 x1858040639653312/t0(0) o400->b665ca94-5aa6-4a24-a470-507cb5a87634@20706@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1771-0'
00000100:00100000:26.0:1773851899.215533:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000030c9c3c8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:b665ca94-5aa6-4a24-a470-507cb5a87634+8:39821:x1858040639653312:12345-20706@kfi7:400:default-tuolumne1771-0 Request processed in 53us (81us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851899.215535:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20706@kfi7, seq: 2025189
00000100:00000040:26.0:1773851899.215536:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ac305a91 : new rpc_count 0
00000100:00000001:26.0:1773851899.215536:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851899.215537:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851899.215537:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000800:00000200:27.0:1773851899.215538:0:2464256:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005ba TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851899.215538:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000020:00000010:26.0:1773851899.215538:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000024e5a498.
00000400:00000200:27.0:1773851899.215539:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:26.0:1773851899.215539:0:41182:0:(genops.c:882:class_export_put()) PUTting export 00000000ac305a91 : new refcount 7
00000400:00000200:27.0:1773851899.215540:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20706@kfi7: PUT: OK
00000100:00000001:26.0:1773851899.215540:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:27.0:1773851899.215541:0:2464256:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009b6134f
00000400:00000010:27.0:1773851899.215541:0:2464256:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009b6134f.
00000100:00000001:27.0:1773851899.215542:0:2464256:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:27.0:1773851899.215542:0:2464256:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:27.0:1773851899.215543:0:2464256:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004870c69b nid 20706@kfi7 refs 2
00000800:00000200:27.0:1773851899.215544:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 20706@kfi7(00000000f8d59d28):0x0 lsk 1467 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000005ba Transaction freed
00000800:00000200:15.0:1773851899.217354:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851899.217354:0:2514739:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851899.217355:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:14.0:1773851899.217355:0:2514739:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:15.0:1773851899.217356:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:14.0:1773851899.217356:0:2514739:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:15.0:1773851899.217358:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:14.0:1773851899.217358:0:2514739:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20480@kfi7(000000009db541b0):0x390 version: 2; local version 2; negotiated version: 2
00000400:00000200:15.0:1773851899.217360:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20480@kfi7 to cpt 3
00000800:00000200:14.0:1773851899.217360:0:2514739:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 Using peer 20480@kfi7(0x100000000000390)
00000400:00000200:15.0:1773851899.217362:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20480@kfi7 : PUT - for me
00000400:00000200:14.0:1773851899.217362:0:2514739:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20480@kfi7 to cpt 3
00000400:00000200:15.0:1773851899.217363:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20480@kfi7 to cpt 3
00000400:00000200:15.0:1773851899.217364:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc462059 nid 20480@kfi7 refs 1
00000800:00000200:14.0:1773851899.217364:0:2514739:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000c8e2b965: Posted send of 38 bytes to peer 0x100000000000390: rc=0
00000400:00000200:15.0:1773851899.217365:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20480@kfi7 to cpt 3
00000800:00000200:14.0:1773851899.217365:0:2514739:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:15.0:1773851899.217366:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc462059 nid 20480@kfi7 refs 2
00000400:00000200:15.0:1773851899.217367:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc462059 nid 20480@kfi7 refs 3
00000400:00000200:15.0:1773851899.217368:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20673@kfi7 to cpt 1
00000400:00000200:15.0:1773851899.217369:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20673@kfi7 of length 224 into portal 12 MB=0x69b095b4caec0
00000400:00000200:15.0:1773851899.217371:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20673@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 59896
00000800:00000200:15.0:1773851899.217373:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851899.217375:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851899.217376:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20480@kfi7: PUT: OK
00000100:00000001:15.0:1773851899.217378:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851899.217378:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:14.0:1773851899.217378:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 TN_EVENT_TX_OK event status 0
00000100:00000010:15.0:1773851899.217379:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002cc2fb00.
00000100:00000040:15.0:1773851899.217380:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000002cc2fb00 x1859314349027008 msgsize 224
00000100:00100000:15.0:1773851899.217382:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-20673@kfi7 (source: 12345-20480@kfi7)
00000800:00000200:14.0:1773851899.217382:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c8e2b965: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 Transaction freed
00000100:00000001:15.0:1773851899.217383:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851899.217385:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc462059 nid 20480@kfi7 refs 2
00000800:00000200:15.0:1773851899.217386:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851899.217386:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851899.217387:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851899.217388:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851899.217388:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851899.217389:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851899.217390:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314349027008
00000020:00000001:14.0:1773851899.217391:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851899.217391:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92bf9
00000020:00000001:14.0:1773851899.217392:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851899.217397:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000fe01f404 refcount=6
00000020:00000001:14.0:1773851899.217397:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743923712 : -107128965627904 : ffff9e91180f0000)
00000020:00000001:14.0:1773851899.217398:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743923712 : -107128965627904 : ffff9e91180f0000)
00000100:00000001:14.0:1773851899.217399:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851899.217400:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851899.217401:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e3ea259c.
00000020:00000010:14.0:1773851899.217403:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851899.217403:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000001:14.0:1773851899.217404:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851899.217405:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851899.217406:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851899.217407:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851899.217407:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851899.217408:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.217409:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851899.217410:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851899.217411:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851899.217411:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851899.217411:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851899.217412:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20673@kfi7, seq: 2289939
00000100:00000040:14.0:1773851899.217413:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000fe01f404 : new rpc_count 1
00000100:00000001:12.0:1773851899.217413:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.217414:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860222976 : -107049849328640 : ffff9ea383c1ec00)
00000100:00000040:14.0:1773851899.217415:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002cc2fb00 x1859314349027008/t0(0) o400->fc33c43c-d324-4bcb-b092-ebc4a1f6fa78@20673@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1779-0'
00000100:00000001:12.0:1773851899.217415:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.217421:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851899.217422:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851899.217423:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cc2fb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:fc33c43c-d324-4bcb-b092-ebc4a1f6fa78+6:39545:x1859314349027008:12345-20673@kfi7:400:default-tuolumne1779-0
00000100:00000200:14.0:1773851899.217424:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314349027008
00000020:00000001:14.0:1773851899.217425:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851899.217426:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851899.217427:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.217427:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851899.217428:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851899.217429:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851899.217430:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314349027008, found 0 last_xid 1859314349027007
00000020:00000001:14.0:1773851899.217431:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851899.217431:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851899.217432:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851899.217432:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.217433:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851899.217434:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851899.217435:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851899.217436:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000047b64737.
02000000:00000001:14.0:1773851899.217436:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.217437:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.217438:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851899.217438:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690198, transno 0, xid 1859314349027008
00010000:00000001:14.0:1773851899.217439:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851899.217440:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002cc2fb00 x1859314349027008/t0(0) o400->fc33c43c-d324-4bcb-b092-ebc4a1f6fa78@20673@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1779-0'
00010000:00000001:14.0:1773851899.217443:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851899.217443:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851899.217444:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=132 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851899.217445:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851899.217446:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ea12375e refcount 3 to 20673@kfi7
00000100:00000001:14.0:1773851899.217447:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232980384 : -107130476571232 : ffff9e90bdffd5a0)
02000000:00000001:14.0:1773851899.217449:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851899.217449:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.217450:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851899.217451:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20480@kfi7
00000400:00000010:14.0:1773851899.217452:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c44b05bf.
00000100:00000200:14.0:1773851899.217452:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314349027008, offset 224
00000400:00000200:14.0:1773851899.217454:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20480@kfi7
00000400:00000200:14.0:1773851899.217455:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20480@kfi7 to cpt 3
00000400:00000200:14.0:1773851899.217456:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc462059 nid 20480@kfi7 refs 1
00000400:00000200:14.0:1773851899.217457:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc462059 nid 20480@kfi7 refs 2
00000400:00000200:14.0:1773851899.217458:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc462059 nid 20480@kfi7 refs 3
00000400:00000200:14.0:1773851899.217459:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20480@kfi7 local destination
00000400:00000200:14.0:1773851899.217461:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770320:8770320:1024:4294967295] 20480@kfi7 LPNI seq info [122473:122473:16:4294967295]
00000400:00000200:14.0:1773851899.217462:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc462059 nid 20480@kfi7 refs 2
00000400:00000200:14.0:1773851899.217463:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20480@kfi7 to cpt 3
00000400:00000200:14.0:1773851899.217465:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20480@kfi7(20480@kfi7:20480@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851899.217466:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc462059 nid 20480@kfi7 refs 3
00000800:00000200:14.0:1773851899.217467:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851899.217468:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851899.217471:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851899.217473:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 Using peer 20480@kfi7(0x100000000000390)
00000800:00000200:14.0:1773851899.217476:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000c8e2b965: Posted send of 324 bytes to peer 0x100000000000390: rc=0
00000800:00000200:14.0:1773851899.217477:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851899.217479:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851899.217480:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ea12375e refcount 2 to 20673@kfi7
00010000:00000001:14.0:1773851899.217481:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851899.217482:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.217482:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851899.217483:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002cc2fb00 x1859314349027008/t0(0) o400->fc33c43c-d324-4bcb-b092-ebc4a1f6fa78@20673@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1779-0'
00000100:00100000:14.0:1773851899.217486:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cc2fb00 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:fc33c43c-d324-4bcb-b092-ebc4a1f6fa78+6:39545:x1859314349027008:12345-20673@kfi7:400:default-tuolumne1779-0 Request processed in 64us (106us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851899.217489:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20673@kfi7, seq: 2289939
00000800:00000200:15.0:1773851899.217490:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 TN_EVENT_TX_OK event status 0
00000100:00000040:14.0:1773851899.217490:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000fe01f404 : new rpc_count 0
00000100:00000001:14.0:1773851899.217491:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:15.0:1773851899.217492:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851899.217492:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851899.217492:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000400:00000200:15.0:1773851899.217493:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20480@kfi7: PUT: OK
00000020:00000010:14.0:1773851899.217493:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000400:00000200:15.0:1773851899.217494:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c44b05bf
00000400:00000010:15.0:1773851899.217494:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c44b05bf.
00000020:00000010:14.0:1773851899.217494:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e3ea259c.
00000100:00000001:15.0:1773851899.217495:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:14.0:1773851899.217495:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000fe01f404 : new refcount 5
00000100:00000001:15.0:1773851899.217496:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:14.0:1773851899.217496:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:15.0:1773851899.217497:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc462059 nid 20480@kfi7 refs 2
00000800:00000200:15.0:1773851899.217498:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8e2b965: 2054@kfi7:3 -> 20480@kfi7(000000009db541b0):0x0 lsk 913 rsk 47 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000390 Transaction freed
00000800:00000200:13.0:1773851899.266688:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851899.266689:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851899.266690:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851899.266692:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851899.266693:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.266694:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8945@kfi7 : PUT - for me
00000400:00000200:13.0:1773851899.266695:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.266696:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 1
00000400:00000200:13.0:1773851899.266697:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.266698:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000400:00000200:13.0:1773851899.266699:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 3
00000400:00000200:13.0:1773851899.266700:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8944@kfi7 to cpt 0
00000400:00000200:13.0:1773851899.266700:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8944@kfi7 of length 224 into portal 12 MB=0x69b08bdfa3b00
00000400:00000200:13.0:1773851899.266701:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8944@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 60120
00000800:00000200:13.0:1773851899.266703:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851899.266704:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851899.266705:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8945@kfi7: PUT: OK
00000100:00000001:13.0:1773851899.266706:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851899.266706:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851899.266707:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000023528940.
00000100:00000040:13.0:1773851899.266708:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000023528940 x1859311709600512 msgsize 224
00000100:00100000:13.0:1773851899.266709:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8944@kfi7 (source: 12345-8945@kfi7)
00000100:00000001:13.0:1773851899.266710:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851899.266710:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000100:00000001:14.0:1773851899.266711:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851899.266712:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851899.266712:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851899.266712:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851899.266712:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851899.266713:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851899.266714:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859311709600512
00000020:00000001:14.0:1773851899.266714:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851899.266715:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac926dc
00000020:00000001:14.0:1773851899.266715:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851899.266718:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000473de76 refcount=11
00000020:00000001:14.0:1773851899.266719:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631260160 : -107123078291456 : ffff9e9276f8a000)
00000020:00000001:14.0:1773851899.266719:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631260160 : -107123078291456 : ffff9e9276f8a000)
00000100:00000001:14.0:1773851899.266720:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851899.266721:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851899.266721:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e3ea259c.
00000020:00000010:14.0:1773851899.266722:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851899.266723:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000001:14.0:1773851899.266724:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851899.266728:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851899.266728:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851899.266729:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851899.266729:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851899.266729:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.266730:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851899.266731:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851899.266732:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851899.266732:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851899.266732:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851899.266733:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8944@kfi7, seq: 2289940
00000100:00000040:14.0:1773851899.266733:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000473de76 : new rpc_count 2
00000100:00000001:12.0:1773851899.266733:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.266734:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945731968 : -106919763819648 : ffff9ec1cd754380)
00000100:00000001:12.0:1773851899.266734:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851899.266735:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000023528940 x1859311709600512/t0(0) o400->8f07c412-a714-4a03-b908-a39c23fd64f1@8944@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1037-0'
00000100:00000001:14.0:1773851899.266738:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851899.266738:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851899.266739:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023528940 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8f07c412-a714-4a03-b908-a39c23fd64f1+11:39743:x1859311709600512:12345-8944@kfi7:400:default-tuolumne1037-0
00000100:00000200:14.0:1773851899.266741:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859311709600512
00000020:00000001:14.0:1773851899.266741:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851899.266742:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851899.266743:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.266743:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851899.266743:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851899.266744:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851899.266745:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859311709600512, found 0 last_xid 1859311709508031
00000020:00000001:14.0:1773851899.266745:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851899.266746:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851899.266746:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851899.266747:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.266747:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851899.266748:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851899.266748:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851899.266751:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000044b2f392.
02000000:00000001:14.0:1773851899.266751:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.266753:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.266753:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851899.266754:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183002424739, transno 0, xid 1859311709600512
00010000:00000001:14.0:1773851899.266754:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851899.266755:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000023528940 x1859311709600512/t0(0) o400->8f07c412-a714-4a03-b908-a39c23fd64f1@8944@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1037-0'
00010000:00000001:14.0:1773851899.266758:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851899.266758:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851899.266759:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=132 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851899.266759:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851899.266760:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c8280374 refcount 3 to 8944@kfi7
00000100:00000001:14.0:1773851899.266761:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958002656 : -107146751548960 : ffff9e8cf3ef61e0)
02000000:00000001:14.0:1773851899.266762:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851899.266762:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.266763:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851899.266763:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8945@kfi7
00000400:00000010:14.0:1773851899.266764:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000075bde617.
00000100:00000200:14.0:1773851899.266765:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859311709600512, offset 224
00000400:00000200:14.0:1773851899.266766:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8945@kfi7
00000400:00000200:14.0:1773851899.266767:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:14.0:1773851899.266768:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 1
00000400:00000200:14.0:1773851899.266769:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000400:00000200:14.0:1773851899.266770:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 3
00000400:00000200:14.0:1773851899.266771:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8945@kfi7 local destination
00000400:00000200:14.0:1773851899.266772:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770321:8770321:1024:4294967295] 8945@kfi7 LPNI seq info [2119790:2119790:16:4294967295]
00000400:00000200:14.0:1773851899.266774:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000400:00000200:14.0:1773851899.266774:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8945@kfi7 to cpt 3
00000400:00000200:14.0:1773851899.266776:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8945@kfi7(8945@kfi7:8945@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851899.266778:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 3
00000800:00000200:14.0:1773851899.266780:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851899.266781:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851899.266786:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851899.266788:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e24 Using peer 8945@kfi7(0x100000000000e24)
00000800:00000200:14.0:1773851899.266791:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000bbed2221: Posted send of 324 bytes to peer 0x100000000000e24: rc=0
00000800:00000200:14.0:1773851899.266792:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e24 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851899.266794:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851899.266795:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c8280374 refcount 2 to 8944@kfi7
00010000:00000001:14.0:1773851899.266795:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851899.266796:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.266796:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851899.266797:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000023528940 x1859311709600512/t0(0) o400->8f07c412-a714-4a03-b908-a39c23fd64f1@8944@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1037-0'
00000100:00100000:14.0:1773851899.266800:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023528940 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8f07c412-a714-4a03-b908-a39c23fd64f1+11:39743:x1859311709600512:12345-8944@kfi7:400:default-tuolumne1037-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851899.266802:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8944@kfi7, seq: 2289940
00000100:00000040:14.0:1773851899.266803:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000473de76 : new rpc_count 1
00000100:00000001:14.0:1773851899.266804:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851899.266804:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851899.266804:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000800:00000200:13.0:1773851899.266804:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e24 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851899.266805:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000020:00000010:14.0:1773851899.266806:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e3ea259c.
00000020:00000040:14.0:1773851899.266806:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000000473de76 : new refcount 10
00000400:00000200:13.0:1773851899.266806:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851899.266807:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851899.266807:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8945@kfi7: PUT: OK
00000400:00000200:13.0:1773851899.266807:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000075bde617
00000400:00000010:13.0:1773851899.266808:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000075bde617.
00000100:00000001:13.0:1773851899.266808:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851899.266809:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851899.266809:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001d84dd06 nid 8945@kfi7 refs 2
00000800:00000200:13.0:1773851899.266811:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bbed2221: 2054@kfi7:3 -> 8945@kfi7(00000000c05ec977):0x0 lsk 3621 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000e24 Transaction freed
00000800:00000200:9.0:1773851899.307033:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851899.307035:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851899.307037:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851899.307041:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851899.307044:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17859@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.307047:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17859@kfi7 : PUT - for me
00000400:00000200:9.0:1773851899.307048:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17859@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.307050:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f200ac7 nid 17859@kfi7 refs 1
00000400:00000200:9.0:1773851899.307052:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17859@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.307053:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f200ac7 nid 17859@kfi7 refs 2
00000400:00000200:9.0:1773851899.307055:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009f200ac7 nid 17859@kfi7 refs 3
00000400:00000200:9.0:1773851899.307056:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17666@kfi7 to cpt 4
00000400:00000200:9.0:1773851899.307058:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17666@kfi7 of length 224 into portal 12 MB=0x69b4bfadb9a40
00000400:00000200:9.0:1773851899.307060:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17666@kfi7 of length 224/224 into md 0x78146ce49 [64] + 164408
00000800:00000200:9.0:1773851899.307064:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851899.307067:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851899.307069:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17859@kfi7: PUT: OK
00000100:00000001:9.0:1773851899.307071:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851899.307072:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851899.307074:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036021913.
00000100:00000040:9.0:1773851899.307075:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000036021913 x1859600493812288 msgsize 224
00000100:00100000:9.0:1773851899.307078:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17666@kfi7 (source: 12345-17859@kfi7)
00000100:00000001:9.0:1773851899.307080:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851899.307081:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009f200ac7 nid 17859@kfi7 refs 2
00000100:00000001:8.0:1773851899.307083:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851899.307084:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000a87426ea: 2069@kfi7:2 <- 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851899.307084:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851899.307085:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851899.307086:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851899.307088:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851899.307089:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600493812288
00000020:00000001:8.0:1773851899.307090:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851899.307091:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82310
00000020:00000001:8.0:1773851899.307092:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851899.307097:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b4317454 refcount=5
00000020:00000001:8.0:1773851899.307098:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165079537664 : -106908630013952 : ffff9ec46515a800)
00000020:00000001:8.0:1773851899.307099:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165079537664 : -106908630013952 : ffff9ec46515a800)
00000100:00000001:8.0:1773851899.307101:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851899.307103:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851899.307104:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851899.307106:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851899.307107:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851899.307109:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851899.307109:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851899.307110:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.307112:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851899.307113:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851899.307113:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.307115:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.307117:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851899.307118:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851899.307118:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851899.307119:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851899.307120:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17666@kfi7, seq: 2130881
00000100:00000001:11.0:1773851899.307122:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851899.307122:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b4317454 : new rpc_count 1
00000100:00000001:11.0:1773851899.307123:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.307123:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134024731648 : -106939684819968 : ffff9ebd2a12ec00)
00000100:00000040:8.0:1773851899.307125:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036021913 x1859600493812288/t0(0) o400->82dcaefd-01d7-41d8-9b57-546d38424a38@17666@kfi7:687/0 lens 224/0 e 0 to 0 dl 1773852047 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1607-0'
00000100:00000001:8.0:1773851899.307130:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851899.307131:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851899.307133:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036021913 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:82dcaefd-01d7-41d8-9b57-546d38424a38+5:39682:x1859600493812288:12345-17666@kfi7:400:default-tuolumne1607-0
00000100:00000200:8.0:1773851899.307138:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600493812288
00000020:00000001:8.0:1773851899.307139:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851899.307140:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851899.307141:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.307142:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851899.307143:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851899.307145:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851899.307145:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600493812288, found 0 last_xid 1859600493812287
00000020:00000001:8.0:1773851899.307147:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851899.307148:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851899.307149:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851899.307149:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.307150:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851899.307151:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851899.307151:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851899.307152:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000a8a4e91.
02000000:00000001:8.0:1773851899.307153:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.307154:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.307155:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851899.307156:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183206476152, transno 0, xid 1859600493812288
00010000:00000001:8.0:1773851899.307157:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851899.307158:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036021913 x1859600493812288/t0(0) o400->82dcaefd-01d7-41d8-9b57-546d38424a38@17666@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1607-0'
00010000:00000001:8.0:1773851899.307161:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851899.307161:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851899.307162:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=132 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851899.307163:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851899.307164:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000033f88a16 refcount 3 to 17666@kfi7
00000100:00000001:8.0:1773851899.307165:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583960224 : -107156125591392 : ffff9e8ac532d8a0)
02000000:00000001:8.0:1773851899.307166:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851899.307167:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.307168:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851899.307169:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17859@kfi7
00000400:00000010:8.0:1773851899.307169:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000516de938.
00000100:00000200:8.0:1773851899.307171:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600493812288, offset 224
00000400:00000200:8.0:1773851899.307172:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17859@kfi7
00000400:00000200:8.0:1773851899.307173:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17859@kfi7 to cpt 2
00000400:00000200:8.0:1773851899.307174:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f200ac7 nid 17859@kfi7 refs 1
00000400:00000200:8.0:1773851899.307175:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009f200ac7 nid 17859@kfi7 refs 2
00000400:00000200:8.0:1773851899.307177:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009f200ac7 nid 17859@kfi7 refs 3
00000400:00000200:8.0:1773851899.307178:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17859@kfi7 local destination
00000400:00000200:8.0:1773851899.307180:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770322:8770322:1024:4294967295] 17859@kfi7 LPNI seq info [28010459:28010459:16:4294967295]
00000400:00000200:8.0:1773851899.307182:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009f200ac7 nid 17859@kfi7 refs 2
00000400:00000200:8.0:1773851899.307182:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17859@kfi7 to cpt 2
00000400:00000200:8.0:1773851899.307185:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17859@kfi7(17859@kfi7:17859@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851899.307186:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009f200ac7 nid 17859@kfi7 refs 3
00000800:00000200:8.0:1773851899.307188:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851899.307189:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851899.307192:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851899.307194:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10cd Using peer 17859@kfi7(0x10cd)
00000800:00000200:8.0:1773851899.307197:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x10cd: rc=0
00000800:00000200:8.0:1773851899.307199:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10cd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851899.307202:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851899.307202:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000033f88a16 refcount 2 to 17666@kfi7
00010000:00000001:8.0:1773851899.307203:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851899.307204:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851899.307205:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851899.307205:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036021913 x1859600493812288/t0(0) o400->82dcaefd-01d7-41d8-9b57-546d38424a38@17666@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1607-0'
00000100:00100000:8.0:1773851899.307210:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036021913 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:82dcaefd-01d7-41d8-9b57-546d38424a38+5:39682:x1859600493812288:12345-17666@kfi7:400:default-tuolumne1607-0 Request processed in 79us (134us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851899.307214:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17666@kfi7, seq: 2130881
00000100:00000040:8.0:1773851899.307214:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b4317454 : new rpc_count 0
00000100:00000001:8.0:1773851899.307215:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851899.307216:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851899.307217:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851899.307217:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000020:00000010:8.0:1773851899.307218:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851899.307219:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000b4317454 : new refcount 4
00000100:00000001:8.0:1773851899.307220:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851899.307226:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10cd TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851899.307227:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851899.307228:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17859@kfi7: PUT: OK
00000400:00000200:9.0:1773851899.307229:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000516de938
00000400:00000010:9.0:1773851899.307230:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000516de938.
00000100:00000001:9.0:1773851899.307231:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851899.307231:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851899.307232:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009f200ac7 nid 17859@kfi7 refs 2
00000800:00000200:9.0:1773851899.307234:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 17859@kfi7(00000000e370b23b):0x0 lsk 4302 rsk 5 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10cd Transaction freed
00000800:00000200:29.0:1773851899.376214:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851899.376215:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851899.376216:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851899.376218:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851899.376220:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26097@kfi7 to cpt 7
00000400:00000200:29.0:1773851899.376221:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26097@kfi7 : PUT - for me
00000400:00000200:29.0:1773851899.376222:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26097@kfi7 to cpt 7
00000400:00000200:29.0:1773851899.376223:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 1
00000400:00000200:29.0:1773851899.376224:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26097@kfi7 to cpt 7
00000400:00000200:29.0:1773851899.376225:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 2
00000400:00000200:29.0:1773851899.376226:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 3
00000400:00000200:29.0:1773851899.376227:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25904@kfi7 to cpt 1
00000400:00000200:29.0:1773851899.376228:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25904@kfi7 of length 224 into portal 12 MB=0x699f21eb63940
00000400:00000200:29.0:1773851899.376229:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25904@kfi7 of length 224/224 into md 0x77fe1859d [64] + 10392
00000800:00000200:29.0:1773851899.376232:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851899.376234:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851899.376235:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26097@kfi7: PUT: OK
00000100:00000001:29.0:1773851899.376236:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851899.376236:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851899.376237:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cca02ff.
00000100:00000040:29.0:1773851899.376238:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000007cca02ff x1858115036657984 msgsize 224
00000100:00100000:29.0:1773851899.376239:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25904@kfi7 (source: 12345-26097@kfi7)
00000100:00000001:29.0:1773851899.376240:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851899.376241:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 2
00000100:00000001:31.0:1773851899.376242:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851899.376242:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851899.376242:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851899.376243:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851899.376243:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851899.376244:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851899.376245:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858115036657984
00000020:00000001:31.0:1773851899.376245:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851899.376246:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914ec
00000020:00000001:31.0:1773851899.376246:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851899.376251:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000def70c17 refcount=6
00000020:00000001:31.0:1773851899.376252:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240799232 : -107152468752384 : ffff9e8b9f29c800)
00000020:00000001:31.0:1773851899.376253:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240799232 : -107152468752384 : ffff9e8b9f29c800)
00000100:00000001:31.0:1773851899.376254:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851899.376255:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851899.376255:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3c67bb1.
00000020:00000010:31.0:1773851899.376256:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851899.376257:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851899.376258:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851899.376258:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851899.376259:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851899.376260:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851899.376260:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851899.376261:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.376262:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851899.376263:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851899.376263:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851899.376263:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851899.376264:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25904@kfi7, seq: 2055602
00000100:00000001:30.0:1773851899.376264:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851899.376265:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000def70c17 : new rpc_count 1
00000100:00000001:31.0:1773851899.376265:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337946624 : -106936371604992 : ffff9ebdef8e9200)
00000100:00000001:30.0:1773851899.376265:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.376266:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851899.376267:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007cca02ff x1858115036657984/t0(0) o400->e67f9292-7abd-487c-bdac-dcafe6e6407d@25904@kfi7:687/0 lens 224/0 e 0 to 0 dl 1773852047 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2109-0'
00000100:00000001:31.0:1773851899.376270:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851899.376270:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851899.376271:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cca02ff pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:e67f9292-7abd-487c-bdac-dcafe6e6407d+6:39665:x1858115036657984:12345-25904@kfi7:400:default-tuolumne2109-0
00000100:00000200:31.0:1773851899.376273:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858115036657984
00000020:00000001:31.0:1773851899.376273:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851899.376274:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851899.376275:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.376276:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851899.376276:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851899.376277:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851899.376278:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858115036657984, found 0 last_xid 1858115036657983
00000020:00000001:31.0:1773851899.376278:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851899.376279:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851899.376280:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851899.376280:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.376281:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851899.376281:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851899.376282:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851899.376283:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000007fe4bb1.
02000000:00000001:31.0:1773851899.376284:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.376284:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.376285:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851899.376286:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013979057, transno 0, xid 1858115036657984
00010000:00000001:31.0:1773851899.376286:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851899.376287:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007cca02ff x1858115036657984/t0(0) o400->e67f9292-7abd-487c-bdac-dcafe6e6407d@25904@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2109-0'
00010000:00000001:31.0:1773851899.376289:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851899.376290:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851899.376290:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=132 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851899.376291:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851899.376292:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000daa229bb refcount 3 to 25904@kfi7
00000100:00000001:31.0:1773851899.376293:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074951072 : -107155634600544 : ffff9e8ae276c5a0)
02000000:00000001:31.0:1773851899.376294:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851899.376294:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.376295:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851899.376296:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26097@kfi7
00000400:00000010:31.0:1773851899.376296:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d658250.
00000100:00000200:31.0:1773851899.376297:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858115036657984, offset 224
00000400:00000200:31.0:1773851899.376299:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26097@kfi7
00000400:00000200:31.0:1773851899.376300:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26097@kfi7 to cpt 7
00000400:00000200:31.0:1773851899.376301:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 1
00000400:00000200:31.0:1773851899.376302:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 2
00000400:00000200:31.0:1773851899.376303:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 3
00000400:00000200:31.0:1773851899.376304:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26097@kfi7 local destination
00000400:00000200:31.0:1773851899.376305:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770323:8770323:1024:4294967295] 26097@kfi7 LPNI seq info [11586868:11586868:16:4294967295]
00000400:00000200:31.0:1773851899.376306:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 2
00000400:00000200:31.0:1773851899.376307:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26097@kfi7 to cpt 7
00000400:00000200:31.0:1773851899.376309:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26097@kfi7(26097@kfi7:26097@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851899.376310:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 3
00000800:00000200:31.0:1773851899.376311:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851899.376312:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851899.376314:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851899.376316:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f80 Using peer 26097@kfi7(0x100000000000f80)
00000800:00000200:31.0:1773851899.376319:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x100000000000f80: rc=0
00000800:00000200:31.0:1773851899.376321:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f80 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851899.376322:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851899.376323:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000daa229bb refcount 2 to 25904@kfi7
00010000:00000001:31.0:1773851899.376324:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851899.376325:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851899.376325:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851899.376326:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cca02ff x1858115036657984/t0(0) o400->e67f9292-7abd-487c-bdac-dcafe6e6407d@25904@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2109-0'
00000100:00100000:31.0:1773851899.376330:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cca02ff pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:e67f9292-7abd-487c-bdac-dcafe6e6407d+6:39665:x1858115036657984:12345-25904@kfi7:400:default-tuolumne2109-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851899.376332:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25904@kfi7, seq: 2055602
00000800:00000200:29.0:1773851899.376332:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f80 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851899.376333:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000def70c17 : new rpc_count 0
00000100:00000001:31.0:1773851899.376334:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851899.376334:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851899.376334:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851899.376335:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851899.376335:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000200:29.0:1773851899.376335:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26097@kfi7: PUT: OK
00000020:00000010:31.0:1773851899.376336:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3c67bb1.
00000400:00000200:29.0:1773851899.376336:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d658250
00000400:00000010:29.0:1773851899.376336:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d658250.
00000020:00000040:31.0:1773851899.376337:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000def70c17 : new refcount 5
00000100:00000001:31.0:1773851899.376337:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851899.376337:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851899.376337:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851899.376338:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2c5e6b9 nid 26097@kfi7 refs 2
00000800:00000200:29.0:1773851899.376340:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 26097@kfi7(000000001a62eb23):0x0 lsk 3969 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f80 Transaction freed
00000800:00000200:25.0:1773851899.477088:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851899.477089:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851899.477091:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851899.477095:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851899.477098:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.477101:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9200@kfi7 : PUT - for me
00000400:00000200:25.0:1773851899.477102:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.477104:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 1
00000400:00000200:25.0:1773851899.477105:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.477106:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000400:00000200:25.0:1773851899.477108:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 3
00000400:00000200:25.0:1773851899.477109:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9009@kfi7 to cpt 7
00000400:00000200:25.0:1773851899.477111:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9009@kfi7 of length 224 into portal 12 MB=0x69b4b853fa6c0
00000400:00000200:25.0:1773851899.477113:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9009@kfi7 of length 224/224 into md 0x16159c9699 [64] + 40896
00000800:00000200:25.0:1773851899.477116:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851899.477119:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851899.477121:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9200@kfi7: PUT: OK
00000100:00000001:25.0:1773851899.477122:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851899.477123:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851899.477124:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000049c7badb.
00000100:00000040:25.0:1773851899.477125:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000049c7badb x1859598520657600 msgsize 224
00000100:00100000:25.0:1773851899.477128:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9009@kfi7 (source: 12345-9200@kfi7)
00000100:00000001:25.0:1773851899.477129:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851899.477131:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000100:00000001:26.0:1773851899.477132:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851899.477133:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851899.477133:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851899.477133:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851899.477134:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851899.477135:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851899.477136:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598520657600
00000020:00000001:26.0:1773851899.477138:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851899.477138:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e7513d
00000020:00000001:26.0:1773851899.477139:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851899.477142:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c9e6effb refcount=827
00000020:00000001:26.0:1773851899.477143:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637094908804096 : -106978800747520 : ffff9eb40e953c00)
00000020:00000001:26.0:1773851899.477144:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637094908804096 : -106978800747520 : ffff9eb40e953c00)
00000100:00000001:26.0:1773851899.477145:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851899.477147:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851899.477148:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000024e5a498.
00000020:00000010:26.0:1773851899.477149:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851899.477150:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fcc09f82.
00000100:00000001:26.0:1773851899.477152:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851899.477152:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851899.477153:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851899.477155:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851899.477155:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851899.477156:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.477158:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851899.477159:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851899.477160:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851899.477160:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851899.477160:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851899.477161:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9009@kfi7, seq: 2025190
00000100:00000001:26.0:1773851899.477162:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851899.477162:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c9e6effb : new rpc_count 9
00000100:00000001:26.0:1773851899.477163:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.477163:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121199416320 : -106952510135296 : ffff9eba2da02400)
00000100:00000040:24.0:1773851899.477164:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000049c7badb x1859598520657600/t0(0) o400->a127bbd7-a764-414e-9307-5d5c66e02d5b@9009@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1053-0'
00000100:00000001:24.0:1773851899.477167:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851899.477167:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851899.477168:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000049c7badb pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:a127bbd7-a764-414e-9307-5d5c66e02d5b+827:39490:x1859598520657600:12345-9009@kfi7:400:default-tuolumne1053-0
00000100:00000200:24.0:1773851899.477170:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598520657600
00000020:00000001:24.0:1773851899.477170:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851899.477171:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851899.477172:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.477172:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851899.477173:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851899.477174:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851899.477174:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598520657600, found 0 last_xid 1859598443219199
00000020:00000001:24.0:1773851899.477175:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851899.477176:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851899.477176:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851899.477177:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.477178:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851899.477178:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851899.477179:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851899.477180:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001eca4628.
02000000:00000001:24.0:1773851899.477180:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.477182:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.477182:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851899.477183:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592093, transno 0, xid 1859598520657600
00010000:00000001:24.0:1773851899.477184:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851899.477185:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000049c7badb x1859598520657600/t0(0) o400->a127bbd7-a764-414e-9307-5d5c66e02d5b@9009@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1053-0'
00010000:00000001:24.0:1773851899.477187:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851899.477188:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851899.477188:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=132 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851899.477190:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851899.477190:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a56392fb refcount 3 to 9009@kfi7
00000100:00000001:24.0:1773851899.477191:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869935072 : -107137839616544 : ffff9e8f0720ade0)
02000000:00000001:24.0:1773851899.477192:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851899.477192:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.477193:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851899.477194:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9200@kfi7
00000400:00000010:24.0:1773851899.477195:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005ae854d9.
00000100:00000200:24.0:1773851899.477196:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598520657600, offset 224
00000400:00000200:24.0:1773851899.477197:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9200@kfi7
00000400:00000200:24.0:1773851899.477198:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:24.0:1773851899.477199:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 1
00000400:00000200:24.0:1773851899.477200:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000400:00000200:24.0:1773851899.477201:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 3
00000400:00000200:24.0:1773851899.477202:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9200@kfi7 local destination
00000400:00000200:24.0:1773851899.477203:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770324:8770324:1024:4294967295] 9200@kfi7 LPNI seq info [1853262:1853262:16:4294967295]
00000400:00000200:24.0:1773851899.477205:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000400:00000200:24.0:1773851899.477205:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9200@kfi7 to cpt 6
00000400:00000200:24.0:1773851899.477207:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9200@kfi7(9200@kfi7:9200@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851899.477208:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 3
00000800:00000200:24.0:1773851899.477210:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851899.477211:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851899.477215:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851899.477217:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000cf2 Using peer 9200@kfi7(0x100000000000cf2)
00000800:00000200:24.0:1773851899.477221:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0x100000000000cf2: rc=0
00000800:00000200:24.0:1773851899.477222:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000cf2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851899.477224:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851899.477225:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a56392fb refcount 2 to 9009@kfi7
00010000:00000001:24.0:1773851899.477226:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851899.477226:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.477227:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851899.477228:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000049c7badb x1859598520657600/t0(0) o400->a127bbd7-a764-414e-9307-5d5c66e02d5b@9009@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1053-0'
00000100:00100000:24.0:1773851899.477232:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000049c7badb pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:a127bbd7-a764-414e-9307-5d5c66e02d5b+827:39490:x1859598520657600:12345-9009@kfi7:400:default-tuolumne1053-0 Request processed in 65us (106us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851899.477234:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9009@kfi7, seq: 2025190
00000100:00000040:24.0:1773851899.477235:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c9e6effb : new rpc_count 8
00000100:00000001:24.0:1773851899.477236:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851899.477236:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851899.477237:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:24.0:1773851899.477238:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fcc09f82.
00000020:00000010:24.0:1773851899.477239:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000024e5a498.
00000020:00000040:24.0:1773851899.477239:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000c9e6effb : new refcount 826
00000100:00000001:24.0:1773851899.477240:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851899.477246:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000cf2 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851899.477249:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851899.477251:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9200@kfi7: PUT: OK
00000400:00000200:25.0:1773851899.477252:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005ae854d9
00000400:00000010:25.0:1773851899.477253:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005ae854d9.
00000100:00000001:25.0:1773851899.477254:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851899.477254:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851899.477256:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee691cd5 nid 9200@kfi7 refs 2
00000800:00000200:25.0:1773851899.477258:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2054@kfi7:6 -> 9200@kfi7(0000000084de9006):0x0 lsk 3315 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000cf2 Transaction freed
00000800:00000200:25.0:1773851899.482830:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851899.482831:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851899.482832:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851899.482834:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851899.482836:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.482837:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24353@kfi7 : PUT - for me
00000400:00000200:25.0:1773851899.482838:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.482839:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 1
00000400:00000200:25.0:1773851899.482840:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.482841:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000400:00000200:25.0:1773851899.482842:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 3
00000400:00000200:25.0:1773851899.482842:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:25.0:1773851899.482843:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24353@kfi7 of length 224 into portal 12 MB=0x69b4628546300
00000400:00000200:25.0:1773851899.482844:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24353@kfi7 of length 224/224 into md 0x16159c9699 [64] + 41120
00000800:00000200:25.0:1773851899.482846:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851899.482849:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851899.482850:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24353@kfi7: PUT: OK
00000100:00000001:25.0:1773851899.482851:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851899.482851:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851899.482852:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b947e0e8.
00000100:00000040:25.0:1773851899.482852:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000b947e0e8 x1859575486898944 msgsize 224
00000100:00100000:25.0:1773851899.482854:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24353@kfi7 (source: 12345-24353@kfi7)
00000100:00000001:25.0:1773851899.482855:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851899.482856:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000100:00000001:24.0:1773851899.482856:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851899.482856:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851899.482857:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851899.482857:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851899.482857:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851899.482858:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851899.482861:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859575486898944
00000020:00000001:24.0:1773851899.482861:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851899.482862:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc3bf901b
00000020:00000001:24.0:1773851899.482862:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851899.482864:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d6f534bb refcount=10
00000020:00000001:24.0:1773851899.482864:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637093615878144 : -106980093673472 : ffff9eb3c184c000)
00000020:00000001:24.0:1773851899.482865:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637093615878144 : -106980093673472 : ffff9eb3c184c000)
00000100:00000001:24.0:1773851899.482866:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851899.482867:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851899.482867:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dae1f2b1.
00000020:00000010:24.0:1773851899.482868:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851899.482869:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851899.482870:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851899.482870:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851899.482871:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851899.482872:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851899.482872:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851899.482872:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.482873:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851899.482874:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851899.482874:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851899.482875:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851899.482875:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851899.482875:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24353@kfi7, seq: 2025191
00000100:00000001:26.0:1773851899.482876:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851899.482876:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851899.482876:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d6f534bb : new rpc_count 3
00000100:00000001:24.0:1773851899.482876:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121199407104 : -106952510144512 : ffff9eba2da00000)
00000100:00000040:24.0:1773851899.482878:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b947e0e8 x1859575486898944/t0(0) o400->2d96c80e-450f-42db-9d68-0d1939aa6dd1@24353@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2015-0'
00000100:00000001:24.0:1773851899.482880:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851899.482881:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851899.482882:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b947e0e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:2d96c80e-450f-42db-9d68-0d1939aa6dd1+10:39682:x1859575486898944:12345-24353@kfi7:400:default-tuolumne2015-0
00000100:00000200:24.0:1773851899.482883:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859575486898944
00000020:00000001:24.0:1773851899.482884:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851899.482884:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851899.482885:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.482886:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851899.482886:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851899.482887:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851899.482887:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859575486898944, found 0 last_xid 1859575486329151
00000020:00000001:24.0:1773851899.482888:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851899.482889:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851899.482889:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851899.482889:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.482890:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851899.482890:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851899.482891:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851899.482891:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fb59fa17.
02000000:00000001:24.0:1773851899.482892:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.482892:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.482893:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851899.482893:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264505322, transno 0, xid 1859575486898944
00010000:00000001:24.0:1773851899.482894:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851899.482895:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b947e0e8 x1859575486898944/t0(0) o400->2d96c80e-450f-42db-9d68-0d1939aa6dd1@24353@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2015-0'
00010000:00000001:24.0:1773851899.482897:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851899.482898:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851899.482898:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=132 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851899.482899:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851899.482900:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c59b57ea refcount 3 to 24353@kfi7
00000100:00000001:24.0:1773851899.482900:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419840 : -107156724131776 : ffff9e8aa185d840)
02000000:00000001:24.0:1773851899.482901:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851899.482901:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851899.482902:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851899.482903:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24353@kfi7
00000400:00000010:24.0:1773851899.482903:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d3d31da8.
00000100:00000200:24.0:1773851899.482904:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859575486898944, offset 224
00000400:00000200:24.0:1773851899.482905:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24353@kfi7
00000400:00000200:24.0:1773851899.482906:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:24.0:1773851899.482907:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 1
00000400:00000200:24.0:1773851899.482909:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000400:00000200:24.0:1773851899.482910:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 3
00000400:00000200:24.0:1773851899.482911:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24353@kfi7 local destination
00000400:00000200:24.0:1773851899.482912:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770325:8770325:1024:4294967295] 24353@kfi7 LPNI seq info [518091:518091:16:4294967295]
00000400:00000200:24.0:1773851899.482914:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000400:00000200:24.0:1773851899.482914:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24353@kfi7 to cpt 6
00000400:00000200:24.0:1773851899.482916:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24353@kfi7(24353@kfi7:24353@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851899.482917:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 3
00000800:00000200:24.0:1773851899.482918:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851899.482919:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851899.482921:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851899.482923:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fb Using peer 24353@kfi7(0x8fb)
00000800:00000200:24.0:1773851899.482927:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0x8fb: rc=0
00000800:00000200:24.0:1773851899.482928:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851899.482930:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851899.482930:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c59b57ea refcount 2 to 24353@kfi7
00010000:00000001:24.0:1773851899.482931:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851899.482931:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851899.482932:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851899.482932:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b947e0e8 x1859575486898944/t0(0) o400->2d96c80e-450f-42db-9d68-0d1939aa6dd1@24353@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2015-0'
00000100:00100000:24.0:1773851899.482936:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b947e0e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:2d96c80e-450f-42db-9d68-0d1939aa6dd1+10:39682:x1859575486898944:12345-24353@kfi7:400:default-tuolumne2015-0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851899.482939:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24353@kfi7, seq: 2025191
00000100:00000040:24.0:1773851899.482939:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d6f534bb : new rpc_count 2
00000100:00000001:24.0:1773851899.482941:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851899.482941:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851899.482941:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851899.482942:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851899.482943:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dae1f2b1.
00000020:00000040:24.0:1773851899.482943:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000d6f534bb : new refcount 9
00000100:00000001:24.0:1773851899.482944:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851899.482949:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fb TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851899.482950:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851899.482951:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24353@kfi7: PUT: OK
00000400:00000200:25.0:1773851899.482952:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d3d31da8
00000400:00000010:25.0:1773851899.482952:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d3d31da8.
00000100:00000001:25.0:1773851899.482953:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851899.482953:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851899.482954:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000afb66785 nid 24353@kfi7 refs 2
00000800:00000200:25.0:1773851899.482955:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 24353@kfi7(00000000858342a7):0x0 lsk 2300 rsk 36 tsk 0 trmk 0 tmk 0 trr 6 tta 0x8fb Transaction freed
00000800:00000200:21.0:1773851899.625905:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851899.625906:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851899.625907:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851899.625909:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851899.625911:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11891@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.625912:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11891@kfi7 : PUT - for me
00000400:00000200:21.0:1773851899.625913:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11891@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.625914:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be2ab353 nid 11891@kfi7 refs 1
00000400:00000200:21.0:1773851899.625915:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11891@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.625915:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be2ab353 nid 11891@kfi7 refs 2
00000400:00000200:21.0:1773851899.625916:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000be2ab353 nid 11891@kfi7 refs 3
00000400:00000200:21.0:1773851899.625917:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11890@kfi7 to cpt 2
00000400:00000200:21.0:1773851899.625918:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11890@kfi7 of length 224 into portal 12 MB=0x699e0dc7cd000
00000400:00000200:21.0:1773851899.625919:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11890@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 66216
00000800:00000200:21.0:1773851899.625920:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851899.625922:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851899.625923:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11891@kfi7: PUT: OK
00000100:00000001:21.0:1773851899.625924:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851899.625924:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851899.625925:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d7ce5c09.
00000100:00000040:21.0:1773851899.625926:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000d7ce5c09 x1858040911155200 msgsize 224
00000100:00100000:21.0:1773851899.625927:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-11890@kfi7 (source: 12345-11891@kfi7)
00000100:00000001:21.0:1773851899.625927:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851899.625928:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000be2ab353 nid 11891@kfi7 refs 2
00000100:00000001:23.0:1773851899.625929:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851899.625930:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851899.625930:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851899.625930:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851899.625931:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851899.625932:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851899.625933:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040911155200
00000020:00000001:23.0:1773851899.625933:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851899.625934:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918c0
00000020:00000001:23.0:1773851899.625934:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851899.625936:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f4955647 refcount=6
00000020:00000001:23.0:1773851899.625937:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241967616 : -107152467584000 : ffff9e8b9f3b9c00)
00000020:00000001:23.0:1773851899.625938:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241967616 : -107152467584000 : ffff9e8b9f3b9c00)
00000100:00000001:23.0:1773851899.625939:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851899.625940:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851899.625941:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ea5ccc04.
00000020:00000010:23.0:1773851899.625942:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851899.625942:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851899.625943:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851899.625944:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851899.625944:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851899.625945:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851899.625946:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851899.625946:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.625947:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851899.625949:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851899.625949:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851899.625949:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851899.625949:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851899.625950:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11890@kfi7, seq: 1998077
00000100:00000040:23.0:1773851899.625951:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f4955647 : new rpc_count 1
00000100:00000001:20.0:1773851899.625951:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.625952:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701968640 : -106936007582976 : ffff9ebe05411b00)
00000100:00000001:20.0:1773851899.625952:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851899.625953:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d7ce5c09 x1858040911155200/t0(0) o400->d2b8d687-f647-48e7-9ff8-bc80f9d27919@11890@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1226-0'
00000100:00000001:23.0:1773851899.625956:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851899.625956:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851899.625957:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d7ce5c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d2b8d687-f647-48e7-9ff8-bc80f9d27919+6:39814:x1858040911155200:12345-11890@kfi7:400:default-tuolumne1226-0
00000100:00000200:23.0:1773851899.625958:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040911155200
00000020:00000001:23.0:1773851899.625959:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851899.625960:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851899.625961:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.625961:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851899.625962:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851899.625962:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851899.625963:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040911155200, found 0 last_xid 1858040911155199
00000020:00000001:23.0:1773851899.625964:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851899.625964:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851899.625965:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851899.625965:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.625966:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851899.625966:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851899.625967:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851899.625968:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002b7aa8e5.
02000000:00000001:23.0:1773851899.625968:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.625969:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.625969:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851899.625970:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182332492031, transno 0, xid 1858040911155200
00010000:00000001:23.0:1773851899.625971:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851899.625971:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d7ce5c09 x1858040911155200/t0(0) o400->d2b8d687-f647-48e7-9ff8-bc80f9d27919@11890@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1226-0'
00010000:00000001:23.0:1773851899.625974:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851899.625974:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851899.625975:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=132 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851899.625976:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851899.625976:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3529df2 refcount 3 to 11890@kfi7
00000100:00000001:23.0:1773851899.625977:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902582368 : -107154806969248 : ffff9e8b13cb6c60)
02000000:00000001:23.0:1773851899.625978:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851899.625978:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.625979:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851899.625980:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11891@kfi7
00000400:00000010:23.0:1773851899.625980:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037bf7dea.
00000100:00000200:23.0:1773851899.625981:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040911155200, offset 224
00000400:00000200:23.0:1773851899.625983:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11891@kfi7
00000400:00000200:23.0:1773851899.625983:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11891@kfi7 to cpt 5
00000400:00000200:23.0:1773851899.625984:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000be2ab353 nid 11891@kfi7 refs 1
00000400:00000200:23.0:1773851899.625985:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000be2ab353 nid 11891@kfi7 refs 2
00000400:00000200:23.0:1773851899.625986:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000be2ab353 nid 11891@kfi7 refs 3
00000400:00000200:23.0:1773851899.625987:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11891@kfi7 local destination
00000400:00000200:23.0:1773851899.625989:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770326:8770326:1024:4294967295] 11891@kfi7 LPNI seq info [584947:584947:16:4294967295]
00000400:00000200:23.0:1773851899.625990:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000be2ab353 nid 11891@kfi7 refs 2
00000400:00000200:23.0:1773851899.625991:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11891@kfi7 to cpt 5
00000400:00000200:23.0:1773851899.625992:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11891@kfi7(11891@kfi7:11891@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851899.625993:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000be2ab353 nid 11891@kfi7 refs 3
00000800:00000200:23.0:1773851899.625995:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851899.625996:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851899.625998:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851899.626000:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb1 Using peer 11891@kfi7(0xeb1)
00000800:00000200:23.0:1773851899.626003:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0xeb1: rc=0
00000800:00000200:23.0:1773851899.626004:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851899.626006:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851899.626006:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3529df2 refcount 2 to 11890@kfi7
00010000:00000001:23.0:1773851899.626007:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851899.626008:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.626008:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851899.626009:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d7ce5c09 x1858040911155200/t0(0) o400->d2b8d687-f647-48e7-9ff8-bc80f9d27919@11890@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1226-0'
00000100:00100000:23.0:1773851899.626011:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d7ce5c09 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d2b8d687-f647-48e7-9ff8-bc80f9d27919+6:39814:x1858040911155200:12345-11890@kfi7:400:default-tuolumne1226-0 Request processed in 55us (85us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851899.626014:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11890@kfi7, seq: 1998077
00000100:00000040:23.0:1773851899.626014:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f4955647 : new rpc_count 0
00000100:00000001:23.0:1773851899.626015:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851899.626015:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851899.626016:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851899.626017:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851899.626017:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ea5ccc04.
00000800:00000200:21.0:1773851899.626017:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb1 TN_EVENT_TX_OK event status 0
00000020:00000040:23.0:1773851899.626018:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000f4955647 : new refcount 5
00000400:00000200:21.0:1773851899.626018:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851899.626019:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851899.626019:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11891@kfi7: PUT: OK
00000400:00000200:21.0:1773851899.626020:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037bf7dea
00000400:00000010:21.0:1773851899.626020:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037bf7dea.
00000100:00000001:21.0:1773851899.626021:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851899.626021:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851899.626022:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000be2ab353 nid 11891@kfi7 refs 2
00000800:00000200:21.0:1773851899.626023:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2069@kfi7:5 -> 11891@kfi7(000000003dec9676):0x0 lsk 3762 rsk 66 tsk 0 trmk 0 tmk 0 trr 5 tta 0xeb1 Transaction freed
00000800:00000200:1.0:1773851899.690768:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851899.690771:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851899.690773:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851899.690778:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851899.690782:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23825@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.690784:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23825@kfi7 : PUT - for me
00000400:00000200:1.0:1773851899.690786:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23825@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.690787:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0525dae nid 23825@kfi7 refs 1
00000400:00000200:1.0:1773851899.690789:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23825@kfi7 to cpt 0
00000400:00000200:1.0:1773851899.690790:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0525dae nid 23825@kfi7 refs 2
00000400:00000200:1.0:1773851899.690792:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a0525dae nid 23825@kfi7 refs 3
00000400:00000200:1.0:1773851899.690794:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24017@kfi7 to cpt 3
00000400:00000200:1.0:1773851899.690795:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24017@kfi7 of length 224 into portal 12 MB=0x69b4b5c513cc0
00000400:00000200:1.0:1773851899.690798:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24017@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 54360
00000800:00000200:1.0:1773851899.690802:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851899.690805:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851899.690807:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23825@kfi7: PUT: OK
00000100:00000001:1.0:1773851899.690809:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851899.690810:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851899.690811:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c23cea4d.
00000100:00000040:1.0:1773851899.690813:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000c23cea4d x1859597833944256 msgsize 224
00000100:00100000:1.0:1773851899.690816:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24017@kfi7 (source: 12345-23825@kfi7)
00000100:00000001:1.0:1773851899.690818:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851899.690819:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0525dae nid 23825@kfi7 refs 2
00000100:00000001:0.0:1773851899.690821:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851899.690822:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851899.690822:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851899.690823:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851899.690823:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851899.690825:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851899.690826:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597833944256
00000020:00000001:0.0:1773851899.690827:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851899.690828:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24377262
00000020:00000001:0.0:1773851899.690829:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851899.690833:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008445cfe2 refcount=5
00000020:00000001:0.0:1773851899.690834:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157768979456 : -106915940572160 : ffff9ec2b1576400)
00000020:00000001:0.0:1773851899.690835:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157768979456 : -106915940572160 : ffff9ec2b1576400)
00000100:00000001:0.0:1773851899.690837:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851899.690838:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851899.690839:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006d6cf39.
00000020:00000010:0.0:1773851899.690841:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851899.690842:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851899.690844:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851899.690845:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851899.690846:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851899.690848:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851899.690849:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851899.690850:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.690852:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851899.690854:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851899.690855:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851899.690855:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851899.690855:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851899.690857:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24017@kfi7, seq: 1997632
00000100:00000001:2.0:1773851899.690858:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851899.690858:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008445cfe2 : new rpc_count 1
00000100:00000001:2.0:1773851899.690860:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.690860:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637082052776192 : -106991656775424 : ffff9eb1104dd100)
00000100:00000040:0.0:1773851899.690862:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c23cea4d x1859597833944256/t0(0) o400->fa8ceac3-608f-4555-9a42-33e317fb6a2e@24017@kfi7:539/0 lens 224/0 e 0 to 0 dl 1773852654 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1985-0'
00000100:00000001:0.0:1773851899.690867:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851899.690868:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851899.690870:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c23cea4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa8ceac3-608f-4555-9a42-33e317fb6a2e+5:39702:x1859597833944256:12345-24017@kfi7:400:default-tuolumne1985-0
00000100:00000200:0.0:1773851899.690872:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597833944256
00000020:00000001:0.0:1773851899.690873:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851899.690874:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851899.690875:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.690876:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851899.690877:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851899.690878:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851899.690879:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597833944256, found 0 last_xid 1859597833944255
00000020:00000001:0.0:1773851899.690880:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851899.690881:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851899.690882:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851899.690883:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.690884:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851899.690884:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851899.690885:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851899.690886:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000217e03d4.
02000000:00000001:0.0:1773851899.690887:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.690888:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.690889:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851899.690890:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182437237328, transno 0, xid 1859597833944256
00010000:00000001:0.0:1773851899.690891:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851899.690892:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c23cea4d x1859597833944256/t0(0) o400->fa8ceac3-608f-4555-9a42-33e317fb6a2e@24017@kfi7:539/0 lens 224/224 e 0 to 0 dl 1773852654 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1985-0'
00010000:00000001:0.0:1773851899.690895:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851899.690895:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851899.690896:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=132 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851899.690897:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851899.690898:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a23dbb9a refcount 3 to 24017@kfi7
00000100:00000001:0.0:1773851899.690899:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902778400 : -107154806773216 : ffff9e8b13ce6a20)
02000000:00000001:0.0:1773851899.690900:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851899.690901:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.690901:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851899.690902:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23825@kfi7
00000400:00000010:0.0:1773851899.690903:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000487f5112.
00000100:00000200:0.0:1773851899.690904:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597833944256, offset 224
00000400:00000200:0.0:1773851899.690906:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23825@kfi7
00000400:00000200:0.0:1773851899.690907:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23825@kfi7 to cpt 0
00000400:00000200:0.0:1773851899.690908:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0525dae nid 23825@kfi7 refs 1
00000400:00000200:0.0:1773851899.690910:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a0525dae nid 23825@kfi7 refs 2
00000400:00000200:0.0:1773851899.690911:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a0525dae nid 23825@kfi7 refs 3
00000400:00000200:0.0:1773851899.690912:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23825@kfi7 local destination
00000400:00000200:0.0:1773851899.690914:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770327:8770327:1024:4294967295] 23825@kfi7 LPNI seq info [90279:90279:16:4294967295]
00000400:00000200:0.0:1773851899.690916:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a0525dae nid 23825@kfi7 refs 2
00000400:00000200:0.0:1773851899.690916:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23825@kfi7 to cpt 0
00000400:00000200:0.0:1773851899.690919:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23825@kfi7(23825@kfi7:23825@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851899.690920:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a0525dae nid 23825@kfi7 refs 3
00000800:00000200:0.0:1773851899.690922:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851899.690923:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851899.690928:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851899.690931:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc34 Using peer 23825@kfi7(0xc34)
00000800:00000200:0.0:1773851899.690935:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0xc34: rc=0
00000800:00000200:0.0:1773851899.690937:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc34 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851899.690939:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851899.690940:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a23dbb9a refcount 2 to 24017@kfi7
00010000:00000001:0.0:1773851899.690941:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851899.690941:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.690942:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851899.690943:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c23cea4d x1859597833944256/t0(0) o400->fa8ceac3-608f-4555-9a42-33e317fb6a2e@24017@kfi7:539/0 lens 224/224 e 0 to 0 dl 1773852654 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1985-0'
00000100:00100000:0.0:1773851899.690948:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c23cea4d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:fa8ceac3-608f-4555-9a42-33e317fb6a2e+5:39702:x1859597833944256:12345-24017@kfi7:400:default-tuolumne1985-0 Request processed in 80us (134us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851899.690951:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24017@kfi7, seq: 1997632
00000100:00000040:0.0:1773851899.690952:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008445cfe2 : new rpc_count 0
00000100:00000001:0.0:1773851899.690953:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851899.690953:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851899.690954:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851899.690955:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851899.690956:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006d6cf39.
00000020:00000040:0.0:1773851899.690956:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000008445cfe2 : new refcount 4
00000100:00000001:0.0:1773851899.690957:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851899.690964:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc34 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851899.690966:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851899.690968:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23825@kfi7: PUT: OK
00000400:00000200:1.0:1773851899.690969:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000487f5112
00000400:00000010:1.0:1773851899.690970:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000487f5112.
00000100:00000001:1.0:1773851899.690971:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851899.690971:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851899.690972:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0525dae nid 23825@kfi7 refs 2
00000800:00000200:1.0:1773851899.690974:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 23825@kfi7(00000000dbbf6590):0x0 lsk 3125 rsk 7 tsk 0 trmk 0 tmk 0 trr 0 tta 0xc34 Transaction freed
00000800:00000200:13.0:1773851899.712794:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851899.712795:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851899.712796:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851899.712798:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851899.712800:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.712801:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9699@kfi7 : PUT - for me
00000400:00000200:13.0:1773851899.712802:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.712803:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 1
00000400:00000200:13.0:1773851899.712804:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.712805:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000400:00000200:13.0:1773851899.712806:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 3
00000400:00000200:13.0:1773851899.712807:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:13.0:1773851899.712808:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9699@kfi7 of length 224 into portal 12 MB=0x69b16e342d140
00000400:00000200:13.0:1773851899.712809:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9699@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 60344
00000800:00000200:13.0:1773851899.712811:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851899.712813:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851899.712813:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9699@kfi7: PUT: OK
00000100:00000001:13.0:1773851899.712815:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851899.712816:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851899.712817:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042cca53f.
00000100:00000040:13.0:1773851899.712817:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000042cca53f x1859372464656704 msgsize 224
00000100:00100000:13.0:1773851899.712819:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9699@kfi7 (source: 12345-9699@kfi7)
00000100:00000001:13.0:1773851899.712820:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:14.0:1773851899.712821:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851899.712821:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
02000000:00000001:14.0:1773851899.712822:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851899.712822:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851899.712822:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851899.712823:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851899.712824:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851899.712825:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372464656704
00000020:00000001:14.0:1773851899.712825:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851899.712826:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793af5fbe8
00000020:00000001:14.0:1773851899.712827:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851899.712831:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001838ccf0 refcount=5
00000020:00000001:14.0:1773851899.712832:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636927198965760 : -107146510585856 : ffff9e8d024c3000)
00000020:00000001:14.0:1773851899.712833:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636927198965760 : -107146510585856 : ffff9e8d024c3000)
00000100:00000001:14.0:1773851899.712833:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851899.712834:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851899.712835:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e3ea259c.
00000020:00000010:14.0:1773851899.712836:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851899.712837:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000001:14.0:1773851899.712838:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851899.712838:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851899.712839:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851899.712840:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851899.712840:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851899.712840:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.712841:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851899.712842:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851899.712843:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851899.712843:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851899.712843:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851899.712844:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9699@kfi7, seq: 2289941
00000100:00000040:14.0:1773851899.712845:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001838ccf0 : new rpc_count 1
00000100:00000001:14.0:1773851899.712845:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945720448 : -106919763831168 : ffff9ec1cd751680)
00000100:00000001:12.0:1773851899.712845:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851899.712845:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851899.712847:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042cca53f x1859372464656704/t0(0) o400->4e146e2c-0bd5-4604-94dd-6a0b30c3e991@9699@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1083-0'
00000100:00000001:14.0:1773851899.712849:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851899.712850:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851899.712851:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042cca53f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4e146e2c-0bd5-4604-94dd-6a0b30c3e991+5:39501:x1859372464656704:12345-9699@kfi7:400:default-tuolumne1083-0
00000100:00000200:14.0:1773851899.712852:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372464656704
00000020:00000001:14.0:1773851899.712853:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851899.712854:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851899.712855:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.712856:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851899.712856:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851899.712857:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851899.712858:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372464656704, found 0 last_xid 1859372464656703
00000020:00000001:14.0:1773851899.712858:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851899.712859:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851899.712860:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851899.712860:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.712861:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851899.712861:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851899.712862:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851899.712863:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b1595ce2.
02000000:00000001:14.0:1773851899.712863:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.712864:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.712865:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851899.712865:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530885, transno 0, xid 1859372464656704
00010000:00000001:14.0:1773851899.712866:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851899.712867:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042cca53f x1859372464656704/t0(0) o400->4e146e2c-0bd5-4604-94dd-6a0b30c3e991@9699@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1083-0'
00010000:00000001:14.0:1773851899.712869:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851899.712870:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851899.712870:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=132 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851899.712872:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851899.712872:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a5761387 refcount 3 to 9699@kfi7
00000100:00000001:14.0:1773851899.712873:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399155968 : -107139310395648 : ffff9e8eaf765f00)
02000000:00000001:14.0:1773851899.712874:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851899.712874:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.712875:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851899.712876:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9699@kfi7
00000400:00000010:14.0:1773851899.712876:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009722ddcf.
00000100:00000200:14.0:1773851899.712877:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372464656704, offset 224
00000400:00000200:14.0:1773851899.712879:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9699@kfi7
00000400:00000200:14.0:1773851899.712880:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:14.0:1773851899.712881:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 1
00000400:00000200:14.0:1773851899.712882:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000400:00000200:14.0:1773851899.712883:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 3
00000400:00000200:14.0:1773851899.712884:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9699@kfi7 local destination
00000400:00000200:14.0:1773851899.712886:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770328:8770328:1024:4294967295] 9699@kfi7 LPNI seq info [17493:17493:16:4294967295]
00000400:00000200:14.0:1773851899.712887:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000400:00000200:14.0:1773851899.712888:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9699@kfi7 to cpt 3
00000400:00000200:14.0:1773851899.712890:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9699@kfi7(9699@kfi7:9699@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851899.712891:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 3
00000800:00000200:14.0:1773851899.712893:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851899.712894:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851899.712896:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851899.712899:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf Using peer 9699@kfi7(0xf)
00000800:00000200:14.0:1773851899.712902:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000002eb192a5: Posted send of 324 bytes to peer 0xf: rc=0
00000800:00000200:14.0:1773851899.712904:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851899.712906:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851899.712906:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a5761387 refcount 2 to 9699@kfi7
00010000:00000001:14.0:1773851899.712907:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851899.712907:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.712908:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851899.712909:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042cca53f x1859372464656704/t0(0) o400->4e146e2c-0bd5-4604-94dd-6a0b30c3e991@9699@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1083-0'
00000100:00100000:14.0:1773851899.712912:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042cca53f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:4e146e2c-0bd5-4604-94dd-6a0b30c3e991+5:39501:x1859372464656704:12345-9699@kfi7:400:default-tuolumne1083-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851899.712914:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9699@kfi7, seq: 2289941
00000100:00000040:14.0:1773851899.712915:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001838ccf0 : new rpc_count 0
00000100:00000001:14.0:1773851899.712916:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851899.712916:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851899.712917:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851899.712917:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851899.712918:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000400:00000200:13.0:1773851899.712918:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851899.712919:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e3ea259c.
00000020:00000040:14.0:1773851899.712919:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000001838ccf0 : new refcount 4
00000400:00000200:13.0:1773851899.712919:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9699@kfi7: PUT: OK
00000400:00000200:13.0:1773851899.712919:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009722ddcf
00000100:00000001:14.0:1773851899.712920:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851899.712920:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009722ddcf.
00000100:00000001:13.0:1773851899.712921:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851899.712921:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851899.712922:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae1d4ba nid 9699@kfi7 refs 2
00000800:00000200:13.0:1773851899.712924:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002eb192a5: 2069@kfi7:3 -> 9699@kfi7(00000000caf3be5c):0x0 lsk 16 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0xf Transaction freed
00000800:00000200:18.0:1773851899.714211:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851899.714212:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851899.714214:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851899.714216:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851899.714218:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19250@kfi7 to cpt 4
00000400:00000200:18.0:1773851899.714220:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19250@kfi7 : PUT - for me
00000400:00000200:18.0:1773851899.714221:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19250@kfi7 to cpt 4
00000400:00000200:18.0:1773851899.714222:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e8ee30d nid 19250@kfi7 refs 1
00000400:00000200:18.0:1773851899.714223:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19250@kfi7 to cpt 4
00000400:00000200:18.0:1773851899.714224:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e8ee30d nid 19250@kfi7 refs 2
00000400:00000200:18.0:1773851899.714225:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008e8ee30d nid 19250@kfi7 refs 3
00000400:00000200:18.0:1773851899.714226:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19251@kfi7 to cpt 7
00000400:00000200:18.0:1773851899.714227:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19251@kfi7 of length 224 into portal 12 MB=0x69b4bd999db00
00000400:00000200:18.0:1773851899.714229:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19251@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 48144
00000800:00000200:18.0:1773851899.714230:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851899.714232:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851899.714234:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19250@kfi7: PUT: OK
00000100:00000001:18.0:1773851899.714235:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851899.714235:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851899.714237:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005608f9b4.
00000100:00000040:18.0:1773851899.714237:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000005608f9b4 x1859599935855360 msgsize 224
00000100:00100000:18.0:1773851899.714240:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-19251@kfi7 (source: 12345-19250@kfi7)
00000100:00000001:18.0:1773851899.714241:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851899.714242:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008e8ee30d nid 19250@kfi7 refs 2
00000100:00000001:19.0:1773851899.714243:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851899.714243:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851899.714244:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851899.714245:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851899.714246:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851899.714247:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851899.714248:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599935855360
00000020:00000001:19.0:1773851899.714249:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851899.714250:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3892451b
00000020:00000001:19.0:1773851899.714251:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851899.714254:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ae4741e2 refcount=5
00000020:00000001:19.0:1773851899.714255:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637067953421312 : -107005756130304 : ffff9eadc7eabc00)
00000020:00000001:19.0:1773851899.714256:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637067953421312 : -107005756130304 : ffff9eadc7eabc00)
00000100:00000001:19.0:1773851899.714258:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851899.714259:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851899.714260:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008ad35796.
00000020:00000010:19.0:1773851899.714262:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851899.714263:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000bdd5777c.
00000100:00000001:19.0:1773851899.714264:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851899.714265:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851899.714266:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851899.714267:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851899.714269:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851899.714270:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851899.714271:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851899.714273:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851899.714273:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851899.714273:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851899.714274:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851899.714274:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19251@kfi7, seq: 2156439
00000100:00000001:19.0:1773851899.714275:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851899.714275:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ae4741e2 : new rpc_count 1
00000100:00000001:19.0:1773851899.714276:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851899.714276:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609995392 : -107015099556224 : ffff9eab9b015e80)
00000100:00000040:16.0:1773851899.714277:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005608f9b4 x1859599935855360/t0(0) o400->01ec0790-6293-49b9-9814-1c9113b59e1c@19251@kfi7:687/0 lens 224/0 e 0 to 0 dl 1773852047 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1689-0'
00000100:00000001:16.0:1773851899.714280:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851899.714280:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851899.714281:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005608f9b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:01ec0790-6293-49b9-9814-1c9113b59e1c+5:39628:x1859599935855360:12345-19251@kfi7:400:default-tuolumne1689-0
00000100:00000200:16.0:1773851899.714283:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599935855360
00000020:00000001:16.0:1773851899.714283:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851899.714284:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851899.714285:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.714285:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851899.714286:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851899.714287:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851899.714287:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599935855360, found 0 last_xid 1859599935855359
00000020:00000001:16.0:1773851899.714288:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851899.714289:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851899.714289:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851899.714290:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.714291:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851899.714291:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851899.714292:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851899.714292:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001008594d.
02000000:00000001:16.0:1773851899.714293:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851899.714294:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.714295:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851899.714295:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096675980, transno 0, xid 1859599935855360
00010000:00000001:16.0:1773851899.714296:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851899.714297:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005608f9b4 x1859599935855360/t0(0) o400->01ec0790-6293-49b9-9814-1c9113b59e1c@19251@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1689-0'
00010000:00000001:16.0:1773851899.714299:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851899.714300:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851899.714301:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=132 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851899.714301:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851899.714302:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004511fa1e refcount 3 to 19251@kfi7
00000100:00000001:16.0:1773851899.714303:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063360 : -107155994488256 : ffff9e8acd035240)
02000000:00000001:16.0:1773851899.714304:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851899.714304:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851899.714305:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851899.714306:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19250@kfi7
00000400:00000010:16.0:1773851899.714307:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003d3d92cb.
00000100:00000200:16.0:1773851899.714307:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599935855360, offset 224
00000400:00000200:16.0:1773851899.714309:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19250@kfi7
00000400:00000200:16.0:1773851899.714310:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19250@kfi7 to cpt 4
00000400:00000200:16.0:1773851899.714310:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e8ee30d nid 19250@kfi7 refs 1
00000400:00000200:16.0:1773851899.714312:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008e8ee30d nid 19250@kfi7 refs 2
00000400:00000200:16.0:1773851899.714313:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008e8ee30d nid 19250@kfi7 refs 3
00000400:00000200:16.0:1773851899.714314:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19250@kfi7 local destination
00000400:00000200:16.0:1773851899.714315:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770329:8770329:1024:4294967295] 19250@kfi7 LPNI seq info [1105756:1105756:16:4294967295]
00000400:00000200:16.0:1773851899.714316:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008e8ee30d nid 19250@kfi7 refs 2
00000400:00000200:16.0:1773851899.714317:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19250@kfi7 to cpt 4
00000400:00000200:16.0:1773851899.714319:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19250@kfi7(19250@kfi7:19250@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851899.714320:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008e8ee30d nid 19250@kfi7 refs 3
00000800:00000200:16.0:1773851899.714322:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851899.714323:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851899.714326:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851899.714329:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000141 Using peer 19250@kfi7(0x100000000000141)
00000800:00000200:16.0:1773851899.714332:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000285415e9: Posted send of 324 bytes to peer 0x100000000000141: rc=0
00000800:00000200:16.0:1773851899.714334:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000141 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851899.714336:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851899.714337:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004511fa1e refcount 2 to 19251@kfi7
00010000:00000001:16.0:1773851899.714338:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851899.714338:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.714339:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851899.714340:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005608f9b4 x1859599935855360/t0(0) o400->01ec0790-6293-49b9-9814-1c9113b59e1c@19251@kfi7:687/0 lens 224/224 e 0 to 0 dl 1773852047 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1689-0'
00000100:00100000:16.0:1773851899.714344:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005608f9b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:01ec0790-6293-49b9-9814-1c9113b59e1c+5:39628:x1859599935855360:12345-19251@kfi7:400:default-tuolumne1689-0 Request processed in 63us (106us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851899.714347:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19251@kfi7, seq: 2156439
00000100:00000040:16.0:1773851899.714348:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ae4741e2 : new rpc_count 0
00000100:00000001:16.0:1773851899.714349:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851899.714349:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851899.714350:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:16.0:1773851899.714351:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000bdd5777c.
00000020:00000010:16.0:1773851899.714351:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008ad35796.
00000020:00000040:16.0:1773851899.714352:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000ae4741e2 : new refcount 4
00000100:00000001:16.0:1773851899.714353:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851899.714360:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000141 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851899.714362:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851899.714362:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19250@kfi7: PUT: OK
00000400:00000200:18.0:1773851899.714363:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003d3d92cb
00000400:00000010:18.0:1773851899.714364:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003d3d92cb.
00000100:00000001:18.0:1773851899.714365:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851899.714365:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851899.714366:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008e8ee30d nid 19250@kfi7 refs 2
00000800:00000200:18.0:1773851899.714368:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000285415e9: 2054@kfi7:4 -> 19250@kfi7(000000005d31c042):0x0 lsk 322 rsk 41 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000141 Transaction freed
00000004:00000001:15.0:1773851899.721730:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:11.0:1773851899.721730:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851899.721730:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:3.0:1773851899.721730:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:15.0:1773851899.721731:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:11.0:1773851899.721731:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851899.721731:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:3.0:1773851899.721731:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:15.0:1773851899.721732:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000059918df.
00000100:00000010:11.0:1773851899.721732:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002a9a6f7d.
00000100:00000010:10.0:1773851899.721732:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c66d318a.
00000100:00000010:3.0:1773851899.721732:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8f0219f.
00000020:00000040:15.0:1773851899.721733:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
00000020:00000040:11.0:1773851899.721733:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000020:00000040:3.0:1773851899.721733:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000100:00000001:11.0:1773851899.721734:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:10.0:1773851899.721734:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:10.0:1773851899.721734:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:3.0:1773851899.721734:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:15.0:1773851899.721735:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851899.721735:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851899.721735:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:3.0:1773851899.721735:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:15.0:1773851899.721736:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851899.721736:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851899.721736:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:3.0:1773851899.721736:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851899.721737:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851899.721737:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d5d1c494.
02000000:00000010:15.0:1773851899.721738:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000002a7d34e2.
02000000:00000010:11.0:1773851899.721738:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d420c2f5.
02000000:00000010:10.0:1773851899.721738:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000b4289b24.
00000100:00000001:15.0:1773851899.721739:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.721739:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851899.721739:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851899.721739:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851899.721740:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851899.721740:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851899.721740:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851899.721740:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851899.721740:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851899.721740:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:15.0:1773851899.721741:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851899.721741:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851899.721742:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000002a9a6f7d] to pc [ptlrpcd_02_03+3]  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851899.721742:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c66d318a] to pc [ptlrpcd_02_02+2]  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:3.0:1773851899.721742:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d8f0219f] to pc [ptlrpcd_00_02+2]  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:15.0:1773851899.721743:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000059918df] to pc [ptlrpcd_03_03+3]  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851899.721745:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:10.0:1773851899.721745:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851899.721746:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:3.0:1773851899.721746:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:15.0:1773851899.721747:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:11.0:1773851899.721747:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000006de86c58.
00080000:00000001:11.0:1773851899.721747:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636956527861760 : -107117181689856 : ffff9e93d66fa000)
00080000:00000010:10.0:1773851899.721747:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000003c994c8c.
00080000:00000001:10.0:1773851899.721747:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637149721483264 : -106923988068352 : ffff9ec0d1ac5800)
00000100:00000001:9.0:1773851899.721747:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851899.721747:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851899.721747:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851899.721747:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851899.721747:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:3.0:1773851899.721747:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000091ea4a54.
00000100:00000001:2.0:1773851899.721747:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851899.721747:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:15.0:1773851899.721748:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004a60ee5a.
00000100:00000001:14.0:1773851899.721748:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851899.721748:0:41074:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851899.721748:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:10.0:1773851899.721748:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:9.0:1773851899.721748:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851899.721748:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:3.0:1773851899.721748:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637102153235456 : -106971556316160 : ffff9eb5be627c00)
00000100:00000001:2.0:1773851899.721748:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.721748:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:0.0:1773851899.721748:0:41062:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:15.0:1773851899.721749:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637124548980736 : -106949160570880 : ffff9ebaf5467000)
00000100:00000001:14.0:1773851899.721749:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:14.0:1773851899.721749:0:41075:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:12.0:1773851899.721749:0:41074:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851899.721749:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851899.721749:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:3.0:1773851899.721749:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:0.0:1773851899.721749:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:15.0:1773851899.721750:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:14.0:1773851899.721750:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:11.0:1773851899.721750:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00000010:11.0:1773851899.721750:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000050f2b9c.
00000004:00001000:10.0:1773851899.721750:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
00000004:00000010:10.0:1773851899.721750:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d0393b4b.
00080000:00000001:3.0:1773851899.721750:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851899.721751:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:11.0:1773851899.721751:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614174175026819ns, next at 614175175025847ns, rc = 0
00000004:00080000:10.0:1773851899.721751:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614174175026789ns, next at 614175175025807ns, rc = 0
00000100:00000001:9.0:1773851899.721751:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851899.721751:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:3.0:1773851899.721751:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000004:00001000:15.0:1773851899.721752:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00080000:00000001:11.0:1773851899.721752:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851899.721752:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:9.0:1773851899.721752:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721752:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:3.0:1773851899.721752:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000cf96ec74.
00000100:00000001:0.0:1773851899.721752:0:41062:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000010:15.0:1773851899.721753:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008a192e5a.
00000100:00000001:14.0:1773851899.721753:0:41075:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:11.0:1773851899.721753:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851899.721753:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851899.721753:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851899.721753:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851899.721753:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851899.721753:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:3.0:1773851899.721753:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614174175028312ns, next at 614175175026919ns, rc = 0
00000100:00000001:0.0:1773851899.721753:0:41062:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:15.0:1773851899.721754:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614174175029765ns, next at 614175175027791ns, rc = 0
00000100:00000001:14.0:1773851899.721754:0:41075:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851899.721754:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851899.721754:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851899.721754:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c66d318a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051941440:31@kfi7:13:default-yuba2-0
00000100:00100000:8.0:1773851899.721754:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000002a9a6f7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051941504:6@kfi7:13:default-yuba2-0
00080000:00000001:3.0:1773851899.721754:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:3.0:1773851899.721754:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851899.721754:0:41062:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:0.0:1773851899.721754:0:41062:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851899.721755:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:14.0:1773851899.721755:0:41075:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:14.0:1773851899.721755:0:41075:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851899.721755:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851899.721755:0:41062:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051941568:2095@kfi7:13:default-yuba2-0
00080000:00000001:15.0:1773851899.721756:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851899.721756:0:41075:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000059918df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051941632:54@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851899.721756:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851899.721756:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:8.0:1773851899.721756:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851899.721756:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:15.0:1773851899.721757:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851899.721757:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851899.721757:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:8.0:1773851899.721757:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851899.721757:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:0.0:1773851899.721757:0:41062:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:14.0:1773851899.721758:0:41075:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:14.0:1773851899.721758:0:41075:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:8.0:1773851899.721758:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005350c348.
02000000:00000001:0.0:1773851899.721758:0:41062:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:0.0:1773851899.721758:0:41062:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851899.721759:0:41075:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851899.721759:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851899.721759:0:41062:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:14.0:1773851899.721760:0:41075:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:14.0:1773851899.721760:0:41075:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000a8f2a8d9.
02000000:00000010:9.0:1773851899.721760:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004470a3fd.
00000400:00000200:8.0:1773851899.721760:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
02000000:00000010:0.0:1773851899.721760:0:41062:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005c6c6805.
02000000:00000001:14.0:1773851899.721761:0:41075:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851899.721761:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:8.0:1773851899.721761:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
02000000:00000001:0.0:1773851899.721761:0:41062:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:14.0:1773851899.721762:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851899.721762:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:8.0:1773851899.721762:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006188a4b8.
00000400:00000200:0.0:1773851899.721762:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000010:0.0:1773851899.721762:0:41062:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000002a9a269c.
00000400:00000010:14.0:1773851899.721763:0:41075:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e2d65d66.
00000400:00000010:9.0:1773851899.721763:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000100:00000200:8.0:1773851899.721763:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941504, portal 4
00000100:00000001:8.0:1773851899.721763:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:0.0:1773851899.721763:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004dfb4d66.
00000400:00000010:14.0:1773851899.721764:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006f9b2ffb.
00000400:00000010:9.0:1773851899.721764:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000100:00000001:8.0:1773851899.721764:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446609920 : -106937262941696 : ffff9ebdba6dda00)
00000100:00000200:14.0:1773851899.721765:0:41075:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941632, portal 4
00000100:00000040:8.0:1773851899.721765:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:0.0:1773851899.721765:0:41062:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941568, portal 4
00000100:00000001:14.0:1773851899.721766:0:41075:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:9.0:1773851899.721766:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941440, portal 4
00000100:00000001:0.0:1773851899.721766:0:41062:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:0.0:1773851899.721766:0:41062:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637109288722048 : -106964420829568 : ffff9eb767b15e80)
00000100:00000001:14.0:1773851899.721767:0:41075:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637023860195328 : -107049849356288 : ffff9ea383c18000)
00000100:00000001:9.0:1773851899.721767:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851899.721767:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087769088 : -106944621782528 : ffff9ebc03ceda00)
00000100:00000040:14.0:1773851899.721768:0:41075:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851899.721768:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851899.721768:0:41062:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851899.721769:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851899.721769:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:8.0:1773851899.721770:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4057092.
00000100:00000200:8.0:1773851899.721770:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941504, offset 0
00000100:00000001:14.0:1773851899.721771:0:41075:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:0.0:1773851899.721771:0:41062:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:9.0:1773851899.721772:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851899.721772:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000100:00000040:0.0:1773851899.721772:0:41062:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000100:00000040:14.0:1773851899.721773:0:41075:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000010:14.0:1773851899.721773:0:41075:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7f3f927.
00000100:00000040:9.0:1773851899.721773:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000200:8.0:1773851899.721773:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000010:0.0:1773851899.721773:0:41062:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a494ee40.
00000100:00000200:14.0:1773851899.721774:0:41075:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941632, offset 0
00000400:00000010:9.0:1773851899.721774:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e7ade224.
00000400:00000200:8.0:1773851899.721774:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000100:00000200:0.0:1773851899.721774:0:41062:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941568, offset 0
00000100:00000200:9.0:1773851899.721775:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941440, offset 0
00000400:00000200:8.0:1773851899.721775:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:14.0:1773851899.721776:0:41075:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:9.0:1773851899.721776:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
00000400:00000200:8.0:1773851899.721776:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:0.0:1773851899.721776:0:41062:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:14.0:1773851899.721777:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:8.0:1773851899.721777:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000400:00000200:0.0:1773851899.721777:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851899.721778:0:41075:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:0.0:1773851899.721778:0:41062:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:8.0:1773851899.721779:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770328, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770329, p:4294967295, g:4294967295, h:1000]
00000400:00000200:14.0:1773851899.721780:0:41075:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:0.0:1773851899.721780:0:41062:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:14.0:1773851899.721781:0:41075:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:8.0:1773851899.721781:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:0.0:1773851899.721781:0:41062:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:14.0:1773851899.721782:0:41075:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:8.0:1773851899.721782:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:0.0:1773851899.721783:0:41062:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:14.0:1773851899.721784:0:41075:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770328, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770329, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851899.721784:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:8.0:1773851899.721785:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770330:8770330:1024:4294967295] 6@kfi7 LPNI seq info [5405038:5405038:16:4294967295]
00000400:00000200:0.0:1773851899.721785:0:41062:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770330, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770329, p:4294967295, g:4294967295, h:1000]
00000400:00000200:14.0:1773851899.721786:0:41075:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:14.0:1773851899.721787:0:41075:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851899.721787:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:14.0:1773851899.721788:0:41075:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:8.0:1773851899.721788:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:0.0:1773851899.721788:0:41062:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:0.0:1773851899.721788:0:41062:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:14.0:1773851899.721789:0:41075:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770331:8770331:1024:4294967295] 54@kfi7 LPNI seq info [5403929:5403929:16:4294967295]
00000400:00000200:9.0:1773851899.721789:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:9.0:1773851899.721790:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:0.0:1773851899.721790:0:41062:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:14.0:1773851899.721791:0:41075:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851899.721791:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:14.0:1773851899.721792:0:41075:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851899.721792:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:0.0:1773851899.721792:0:41062:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770332:8770332:1024:4294967295] 2095@kfi7 LPNI seq info [5406049:5406049:16:4294967295]
00000400:00000200:0.0:1773851899.721793:0:41062:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:9.0:1773851899.721794:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000200:0.0:1773851899.721794:0:41062:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:14.0:1773851899.721795:0:41075:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851899.721796:0:41075:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851899.721796:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770330, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770332, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851899.721798:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:0.0:1773851899.721798:0:41062:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000800:00000200:14.0:1773851899.721799:0:41075:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851899.721799:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851899.721799:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000800:00000200:14.0:1773851899.721800:0:41075:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851899.721800:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000200:8.0:1773851899.721800:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:0.0:1773851899.721800:0:41062:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:9.0:1773851899.721801:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770333:8770333:1023:4294967295] 31@kfi7 LPNI seq info [5403625:5403625:16:4294967295]
00000800:00000200:14.0:1773851899.721802:0:41075:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851899.721802:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:0.0:1773851899.721802:0:41062:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:9.0:1773851899.721803:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:9.0:1773851899.721804:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:8.0:1773851899.721804:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851899.721804:0:41062:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851899.721805:0:41075:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000400:00000200:9.0:1773851899.721807:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000800:00000200:8.0:1773851899.721807:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851899.721807:0:41062:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851899.721808:0:41075:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000dac95d1f: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000400:00000200:9.0:1773851899.721809:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000800:00000200:14.0:1773851899.721810:0:41075:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:8.0:1773851899.721810:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Using peer 6@kfi7(0x54b)
00000800:00000200:0.0:1773851899.721810:0:41062:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Using peer 2095@kfi7(0x2000000000005b3)
00000800:00000200:9.0:1773851899.721811:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000100:00000001:14.0:1773851899.721812:0:41075:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.721812:0:41075:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:9.0:1773851899.721812:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:14.0:1773851899.721813:0:41075:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.721814:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:8.0:1773851899.721814:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x54b: rc=0
00000800:00000200:0.0:1773851899.721814:0:41062:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x2000000000005b3: rc=0
00000100:00000001:14.0:1773851899.721816:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:8.0:1773851899.721816:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:0.0:1773851899.721816:0:41062:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851899.721817:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:9.0:1773851899.721817:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:14.0:1773851899.721818:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:8.0:1773851899.721818:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.721818:0:41062:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.721819:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851899.721819:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:14.0:1773851899.721819:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721819:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:0.0:1773851899.721819:0:41062:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851899.721820:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851899.721820:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Using peer 31@kfi7(0x56e)
00000100:00000001:8.0:1773851899.721821:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.721821:0:41062:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851899.721822:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000100:00000001:0.0:1773851899.721822:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721823:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.721823:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851899.721824:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851899.721824:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000a87426ea: Posted send of 324 bytes to peer 0x56e: rc=0
00000100:00000001:8.0:1773851899.721824:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851899.721824:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:13.0:1773851899.721825:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:13.0:1773851899.721825:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7f3f927
00000100:00000001:8.0:1773851899.721825:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851899.721825:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:0.0:1773851899.721825:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000010:13.0:1773851899.721826:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7f3f927.
00000800:00000200:9.0:1773851899.721826:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851899.721826:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851899.721826:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851899.721826:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:13.0:1773851899.721827:0:2514888:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:8.0:1773851899.721827:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:13.0:1773851899.721828:0:2514888:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851899.721828:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851899.721829:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851899.721830:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851899.721831:0:2514888:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:13.0:1773851899.721831:0:2514888:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851899.721831:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851899.721831:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851899.721832:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_EVENT_TX_OK event status 0
00000100:00000001:0.0:1773851899.721832:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851899.721833:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:0.0:1773851899.721833:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851899.721834:0:2514888:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851899.721834:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:13.0:1773851899.721835:0:2514888:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851899.721835:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851899.721835:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851899.721835:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851899.721836:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000800:00000200:11.0:1773851899.721836:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_EVENT_TX_OK event status 0
00000800:00000200:10.0:1773851899.721836:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851899.721836:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721836:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851899.721837:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721837:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851899.721837:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000800:00000200:13.0:1773851899.721838:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000400:00000200:1.0:1773851899.721838:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a494ee40
00000400:00000200:11.0:1773851899.721839:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851899.721839:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:1.0:1773851899.721839:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a494ee40.
00000400:00000200:10.0:1773851899.721840:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000100:00000001:1.0:1773851899.721840:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:11.0:1773851899.721841:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000400:00000200:10.0:1773851899.721842:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4057092
00000400:00000010:10.0:1773851899.721842:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4057092.
00000100:00000200:1.0:1773851899.721842:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851899.721843:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e7ade224
00000400:00000010:11.0:1773851899.721844:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e7ade224.
00000100:00000001:10.0:1773851899.721844:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:11.0:1773851899.721845:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851899.721845:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851899.721846:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:11.0:1773851899.721847:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851899.721847:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851899.721850:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851899.721851:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851899.721851:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.721852:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:1.0:1773851899.721852:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000040:11.0:1773851899.721854:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851899.721854:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:10.0:1773851899.721856:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851899.721857:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Transaction freed
00000100:00000001:11.0:1773851899.721858:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851899.721858:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:11.0:1773851899.721859:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851899.721859:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:11.0:1773851899.721861:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:10.0:1773851899.721862:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x54b Transaction freed
00000800:00000200:2.0:1773851899.721862:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851899.721863:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851899.721864:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a87426ea: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Transaction freed
00000800:00000200:29.0:1773851899.721865:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:13.0:1773851899.721866:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:2.0:1773851899.721866:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851899.721867:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851899.721867:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851899.721868:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851899.721869:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851899.721870:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:13.0:1773851899.721870:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851899.721871:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851899.721871:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851899.721872:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000800:00000200:29.0:1773851899.721873:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851899.721874:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851899.721874:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000200:13.0:1773851899.721875:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:2.0:1773851899.721875:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851899.721876:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:13.0:1773851899.721876:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:29.0:1773851899.721877:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:17.0:1773851899.721878:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851899.721878:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:2.0:1773851899.721878:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:13.0:1773851899.721879:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:29.0:1773851899.721880:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:13.0:1773851899.721880:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:2.0:1773851899.721880:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851899.721881:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6b00
00000400:00000200:29.0:1773851899.721882:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851899.721882:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:13.0:1773851899.721882:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:2.0:1773851899.721882:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:13.0:1773851899.721884:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f744d [1] + 224
00000400:00000200:29.0:1773851899.721885:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:17.0:1773851899.721885:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:2.0:1773851899.721885:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:13.0:1773851899.721886:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851899.721886:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:17.0:1773851899.721887:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:29.0:1773851899.721888:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851899.721888:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851899.721888:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:17.0:1773851899.721889:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:13.0:1773851899.721889:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:29.0:1773851899.721890:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:13.0:1773851899.721890:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851899.721891:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000100:00000200:13.0:1773851899.721891:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851899.721891:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:17.0:1773851899.721892:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:29.0:1773851899.721893:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851899.721893:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:2.0:1773851899.721893:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6a80
00000100:00000040:13.0:1773851899.721894:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851899.721895:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6ac0
00000400:00000200:17.0:1773851899.721895:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:2.0:1773851899.721895:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:17.0:1773851899.721897:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000100:00000001:13.0:1773851899.721897:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851899.721898:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:13.0:1773851899.721898:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:2.0:1773851899.721898:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71e6e1 [1] + 224
00000400:00000200:17.0:1773851899.721899:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6a40
00000100:00000001:14.0:1773851899.721899:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:14.0:1773851899.721899:0:41075:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:14.0:1773851899.721900:0:41075:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:13.0:1773851899.721900:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851899.721901:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000001:14.0:1773851899.721901:0:41075:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851899.721902:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x7800820bd [1] + 224
00000400:00000010:14.0:1773851899.721902:0:41075:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e2d65d66.
00000400:00000200:14.0:1773851899.721902:0:41075:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006f9b2ffb
00000400:00000010:14.0:1773851899.721903:0:41075:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006f9b2ffb.
00000800:00000200:2.0:1773851899.721903:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851899.721904:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f2491 [1] + 224
00000100:00000001:14.0:1773851899.721904:0:41075:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:29.0:1773851899.721905:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:14.0:1773851899.721905:0:41075:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851899.721906:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:17.0:1773851899.721908:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:14.0:1773851899.721908:0:41075:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:2.0:1773851899.721908:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->6@kfi7: PUT: OK
00000400:00000200:29.0:1773851899.721909:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851899.721911:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000400:00000200:17.0:1773851899.721911:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851899.721911:0:41075:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851899.721911:0:2506505:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:14.0:1773851899.721912:0:41075:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851899.721912:0:41075:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:29.0:1773851899.721913:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851899.721913:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
02000000:00000001:14.0:1773851899.721913:0:41075:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:2.0:1773851899.721913:0:2506505:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851899.721914:0:41075:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000200:29.0:1773851899.721915:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851899.721915:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:14.0:1773851899.721915:0:41075:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851899.721915:0:41075:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851899.721916:0:41075:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=132 v=66 (66 66 66 66)
00000100:00000200:17.0:1773851899.721918:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:14.0:1773851899.721918:0:41075:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=132 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851899.721919:0:41075:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:14.0:1773851899.721919:0:41075:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851899.721919:0:2506505:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:14.0:1773851899.721920:0:41075:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:29.0:1773851899.721921:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:14.0:1773851899.721921:0:41075:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.721922:0:41075:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:14.0:1773851899.721923:0:41075:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:14.0:1773851899.721923:0:41075:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:17.0:1773851899.721924:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851899.721924:0:41075:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851899.721925:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851899.721926:0:2506505:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:2.0:1773851899.721928:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000100:00000001:29.0:1773851899.721929:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851899.721929:0:41075:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851899.721929:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:29.0:1773851899.721930:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:14.0:1773851899.721930:0:41075:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:14.0:1773851899.721930:0:41075:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.721930:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:17.0:1773851899.721931:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000001:14.0:1773851899.721931:0:41075:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000800:00000200:2.0:1773851899.721931:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000e8d7e86a: 2069@kfi7:0 <- 6@kfi7(0000000022bad82f):0x0 lsk 1356 rsk 4784 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000004:00000040:14.0:1773851899.721932:0:41075:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000400:00000001:8.0:1773851899.721932:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:0.0:1773851899.721932:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:29.0:1773851899.721933:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851899.721933:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000001:8.0:1773851899.721933:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:0.0:1773851899.721933:0:41062:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000040:14.0:1773851899.721934:0:41075:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524092928 avail=351521376256 avail_mb=1373130376 hwm_mb=3131103 files=372113793 ffree=343285247 state=0: rc = 0
00000100:00000001:9.0:1773851899.721934:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:8.0:1773851899.721934:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000001:0.0:1773851899.721934:0:41062:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:17.0:1773851899.721935:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851899.721935:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:8.0:1773851899.721935:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006188a4b8
00000400:00000001:0.0:1773851899.721935:0:41062:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851899.721936:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006188a4b8.
00000004:00000020:14.0:1773851899.721937:0:41075:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524092928 free, 351521376256 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113793 files, 343285247 free files
00000400:00000001:9.0:1773851899.721937:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851899.721937:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:0.0:1773851899.721937:0:41062:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000002a9a269c.
00000400:00000001:9.0:1773851899.721938:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:0.0:1773851899.721938:0:41062:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004dfb4d66
00000400:00000010:9.0:1773851899.721939:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000100:00000200:8.0:1773851899.721939:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:0.0:1773851899.721939:0:41062:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004dfb4d66.
00000004:00000001:14.0:1773851899.721940:0:41075:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851899.721941:0:41075:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:9.0:1773851899.721941:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000100:00000001:0.0:1773851899.721941:0:41062:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:9.0:1773851899.721942:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000100:00000001:9.0:1773851899.721943:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851899.721945:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851899.721945:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:14.0:1773851899.721946:0:41075:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000059918df pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_03:lustre5-MDT0001-mdtlov_UUID:41075:1859433051941632:54@kfi7:13:default-yuba2-0
00000100:00000200:0.0:1773851899.721946:0:41062:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:14.0:1773851899.721949:0:41075:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.721950:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:14.0:1773851899.721951:0:41075:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:9.0:1773851899.721951:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851899.721951:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:14.0:1773851899.721952:0:41075:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000059918df x1859433051941632/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851899.721952:0:41071:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:0.0:1773851899.721952:0:41062:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851899.721953:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851899.721954:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851899.721955:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851899.721956:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851899.721956:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851899.721956:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.721957:0:41075:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:0.0:1773851899.721957:0:41062:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:14.0:1773851899.721958:0:41075:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:9.0:1773851899.721958:0:41070:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851899.721958:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:8.0:1773851899.721958:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=132 v=66 (66 66 66 66)
00000100:00000001:0.0:1773851899.721958:0:41062:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:14.0:1773851899.721959:0:41075:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000a8f2a8d9.
00000100:00000001:0.0:1773851899.721959:0:41062:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:14.0:1773851899.721960:0:41075:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:9.0:1773851899.721960:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00001000:8.0:1773851899.721960:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=47 v=66 (1 1 1 1)
02000000:00000001:0.0:1773851899.721960:0:41062:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000020:00000001:14.0:1773851899.721961:0:41075:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:9.0:1773851899.721961:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.721961:0:41062:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000040:14.0:1773851899.721962:0:41075:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
02000000:00000001:9.0:1773851899.721962:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721962:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851899.721962:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.721962:0:41062:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851899.721963:0:41062:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851899.721964:0:41075:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:14.0:1773851899.721964:0:41075:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000002a7d34e2.
00000100:00001000:9.0:1773851899.721964:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=132 v=66 (66 66 66 66)
00010000:00000001:8.0:1773851899.721964:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851899.721965:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851899.721965:0:41062:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=132 v=66 (66 66 66 66)
02000000:00000001:14.0:1773851899.721966:0:41075:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851899.721966:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
02000000:00000001:14.0:1773851899.721967:0:41075:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00001000:9.0:1773851899.721967:0:41070:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=132 v=66 (1 1 1 1)
00000100:00000040:8.0:1773851899.721967:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000010:14.0:1773851899.721968:0:41075:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000059918df.
00000100:00000001:8.0:1773851899.721968:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:0.0:1773851899.721968:0:41062:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=132 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851899.721969:0:41075:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851899.721969:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851899.721969:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721969:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851899.721970:0:41075:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851899.721970:0:41062:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:14.0:1773851899.721971:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:9.0:1773851899.721971:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000040:8.0:1773851899.721971:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:0.0:1773851899.721971:0:41062:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851899.721972:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:0.0:1773851899.721972:0:41062:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:14.0:1773851899.721973:0:41075:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851899.721973:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00010000:00000001:0.0:1773851899.721973:0:41062:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851899.721974:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000001:0.0:1773851899.721974:0:41062:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:14.0:1773851899.721975:0:41075:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851899.721975:0:41062:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
00000100:00000001:14.0:1773851899.721976:0:41075:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851899.721976:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851899.721976:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721976:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:14.0:1773851899.721977:0:41075:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.721977:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851899.721977:0:41062:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000040:9.0:1773851899.721978:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851899.721978:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851899.721978:0:41062:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851899.721979:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:8.0:1773851899.721980:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851899.721981:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851899.721982:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420200960 avail=351417826304 avail_mb=1372725884 hwm_mb=3131103 files=372008833 ffree=343183790 state=0: rc = 0
00000100:00000001:9.0:1773851899.721983:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851899.721985:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851899.721985:0:41062:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851899.721986:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:8.0:1773851899.721986:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420200960 free, 351417826304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372008833 files, 343183790 free files
00000100:00000001:0.0:1773851899.721986:0:41062:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000001:9.0:1773851899.721987:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:0.0:1773851899.721987:0:41062:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:9.0:1773851899.721988:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000004:00000001:0.0:1773851899.721988:0:41062:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:9.0:1773851899.721989:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666665472 avail=351645520896 avail_mb=1373615316 hwm_mb=3131103 files=372237776 ffree=343424478 state=0: rc = 0
00000004:00000001:8.0:1773851899.721989:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:0.0:1773851899.721990:0:41062:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000100:00000040:8.0:1773851899.721991:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:0.0:1773851899.721991:0:41062:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399720448 free=351449320448 avail=351446784000 avail_mb=1372839000 hwm_mb=3131103 files=372160878 ffree=343212227 state=0: rc = 0
00000004:00000020:9.0:1773851899.721993:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666665472 free, 351645520896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237776 files, 343424478 free files
00000004:00000020:0.0:1773851899.721995:0:41062:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399720448 blocks, 351449320448 free, 351446784000 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160878 files, 343212227 free files
00000004:00000001:9.0:1773851899.721996:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851899.721996:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000002a9a6f7d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051941504:6@kfi7:13:default-yuba2-0
00000100:00000040:9.0:1773851899.721998:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851899.721999:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:0.0:1773851899.721999:0:41062:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.722001:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:0.0:1773851899.722001:0:41062:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851899.722002:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000002a9a6f7d x1859433051941504/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851899.722004:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c66d318a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051941440:31@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851899.722007:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.722007:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00100000:0.0:1773851899.722007:0:41062:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d8f0219f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre5-MDT0001-mdtlov_UUID:41062:1859433051941568:2095@kfi7:13:default-yuba2-0
00000100:00000001:9.0:1773851899.722008:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:8.0:1773851899.722008:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:9.0:1773851899.722009:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c66d318a x1859433051941440/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:8.0:1773851899.722009:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005350c348.
00000100:00000001:0.0:1773851899.722010:0:41062:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851899.722011:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:0.0:1773851899.722011:0:41062:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000020:00000001:8.0:1773851899.722012:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:0.0:1773851899.722012:0:41062:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d8f0219f x1859433051941568/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852052 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000040:8.0:1773851899.722013:0:41071:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000100:00000001:9.0:1773851899.722014:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:8.0:1773851899.722014:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851899.722015:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d420c2f5.
02000000:00000001:9.0:1773851899.722016:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851899.722017:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004470a3fd.
02000000:00000001:8.0:1773851899.722017:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:8.0:1773851899.722017:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851899.722018:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000002a9a6f7d.
00000100:00000001:0.0:1773851899.722018:0:41062:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:9.0:1773851899.722019:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:0.0:1773851899.722019:0:41062:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000020:00000001:9.0:1773851899.722020:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851899.722020:0:41070:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:8.0:1773851899.722020:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000010:0.0:1773851899.722020:0:41062:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005c6c6805.
00000100:00000001:8.0:1773851899.722021:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851899.722022:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851899.722022:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000b4289b24.
02000000:00000001:0.0:1773851899.722022:0:41062:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:8.0:1773851899.722023:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851899.722023:0:41062:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:0.0:1773851899.722023:0:41062:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
02000000:00000001:9.0:1773851899.722024:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:8.0:1773851899.722024:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:9.0:1773851899.722025:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:8.0:1773851899.722025:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851899.722025:0:41062:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000010:9.0:1773851899.722026:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c66d318a.
00000100:00000001:8.0:1773851899.722026:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000010:0.0:1773851899.722026:0:41062:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d5d1c494.
00000100:00000001:9.0:1773851899.722027:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851899.722027:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851899.722027:0:41062:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:9.0:1773851899.722028:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:0.0:1773851899.722028:0:41062:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:9.0:1773851899.722029:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:0.0:1773851899.722029:0:41062:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d8f0219f.
00000100:00000001:9.0:1773851899.722030:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851899.722031:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.722031:0:41062:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851899.722032:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851899.722032:0:41062:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851899.722033:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.722033:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851899.722034:0:41062:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:0.0:1773851899.722035:0:41062:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851899.722036:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851899.722037:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851899.786731:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851899.786733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:5.0:1773851899.829123:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851899.829124:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851899.829126:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851899.829130:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851899.829133:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851899.829135:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19105@kfi7 : PUT - for me
00000400:00000200:5.0:1773851899.829136:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851899.829138:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 1
00000400:00000200:5.0:1773851899.829140:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851899.829141:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000400:00000200:5.0:1773851899.829142:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 3
00000400:00000200:5.0:1773851899.829144:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:5.0:1773851899.829145:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19105@kfi7 of length 224 into portal 12 MB=0x69b4b5bd557c0
00000400:00000200:5.0:1773851899.829147:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19105@kfi7 of length 224/224 into md 0x793926dc5 [64] + 166440
00000800:00000200:5.0:1773851899.829150:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851899.829153:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851899.829154:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19105@kfi7: PUT: OK
00000100:00000001:5.0:1773851899.829156:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851899.829156:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851899.829158:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e0a2647.
00000100:00000040:5.0:1773851899.829159:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000005e0a2647 x1859597825824704 msgsize 224
00000100:00100000:5.0:1773851899.829162:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19105@kfi7 (source: 12345-19105@kfi7)
00000100:00000001:5.0:1773851899.829163:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851899.829165:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000100:00000001:7.0:1773851899.829166:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851899.829167:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851899.829167:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851899.829167:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851899.829168:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851899.829170:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851899.829171:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597825824704
00000020:00000001:7.0:1773851899.829172:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851899.829172:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81cb1
00000020:00000001:7.0:1773851899.829174:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851899.829175:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a2ba676 refcount=5
00000020:00000001:7.0:1773851899.829176:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637107603102720 : -106966106448896 : ffff9eb70338dc00)
00000020:00000001:7.0:1773851899.829178:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637107603102720 : -106966106448896 : ffff9eb70338dc00)
00000100:00000001:7.0:1773851899.829180:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851899.829181:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851899.829182:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000050d3f139.
00000020:00000010:7.0:1773851899.829184:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851899.829185:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000221a0242.
00000100:00000001:7.0:1773851899.829186:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851899.829187:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851899.829188:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851899.829190:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851899.829191:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851899.829191:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851899.829193:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851899.829194:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851899.829195:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851899.829195:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851899.829195:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851899.829196:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19105@kfi7, seq: 2001998
00000100:00000001:7.0:1773851899.829197:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851899.829197:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a2ba676 : new rpc_count 1
00000100:00000001:4.0:1773851899.829198:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637097484321920 : -106976225229696 : ffff9eb4a8188480)
00000100:00000001:7.0:1773851899.829199:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851899.829199:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005e0a2647 x1859597825824704/t0(0) o400->96ce4e4b-4547-4491-808c-600093cdb9d8@19105@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1680-0'
00000100:00000001:4.0:1773851899.829202:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851899.829202:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851899.829204:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e0a2647 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:96ce4e4b-4547-4491-808c-600093cdb9d8+5:39750:x1859597825824704:12345-19105@kfi7:400:default-tuolumne1680-0
00000100:00000200:4.0:1773851899.829205:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597825824704
00000020:00000001:4.0:1773851899.829206:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851899.829206:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851899.829207:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851899.829208:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851899.829208:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851899.829209:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851899.829210:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597825824704, found 0 last_xid 1859597825824703
00000020:00000001:4.0:1773851899.829211:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851899.829212:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851899.829212:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851899.829213:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851899.829214:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851899.829214:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851899.829215:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851899.829216:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dbc2712d.
02000000:00000001:4.0:1773851899.829216:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851899.829217:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851899.829218:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851899.829218:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689488, transno 0, xid 1859597825824704
00010000:00000001:4.0:1773851899.829219:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851899.829220:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005e0a2647 x1859597825824704/t0(0) o400->96ce4e4b-4547-4491-808c-600093cdb9d8@19105@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1680-0'
00010000:00000001:4.0:1773851899.829223:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851899.829223:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851899.829224:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=131 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851899.829225:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851899.829225:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c6edf66f refcount 3 to 19105@kfi7
00000100:00000001:4.0:1773851899.829226:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740762464 : -107153968789152 : ffff9e8b45c10960)
02000000:00000001:4.0:1773851899.829227:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851899.829227:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851899.829228:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851899.829229:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19105@kfi7
00000400:00000010:4.0:1773851899.829229:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098ca3a41.
00000100:00000200:4.0:1773851899.829230:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597825824704, offset 224
00000400:00000200:4.0:1773851899.829231:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19105@kfi7
00000400:00000200:4.0:1773851899.829232:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:4.0:1773851899.829233:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 1
00000400:00000200:4.0:1773851899.829234:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000400:00000200:4.0:1773851899.829235:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 3
00000400:00000200:4.0:1773851899.829236:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19105@kfi7 local destination
00000400:00000200:4.0:1773851899.829237:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770334:8770334:1024:4294967295] 19105@kfi7 LPNI seq info [9166721:9166721:16:4294967295]
00000400:00000200:4.0:1773851899.829239:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000400:00000200:4.0:1773851899.829239:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19105@kfi7 to cpt 1
00000400:00000200:4.0:1773851899.829242:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19105@kfi7(19105@kfi7:19105@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851899.829243:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 3
00000800:00000200:4.0:1773851899.829244:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851899.829245:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851899.829247:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851899.829249:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x41d Using peer 19105@kfi7(0x41d)
00000800:00000200:4.0:1773851899.829252:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x41d: rc=0
00000800:00000200:4.0:1773851899.829253:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x41d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851899.829255:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851899.829255:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c6edf66f refcount 2 to 19105@kfi7
00010000:00000001:4.0:1773851899.829256:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851899.829257:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851899.829257:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851899.829258:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e0a2647 x1859597825824704/t0(0) o400->96ce4e4b-4547-4491-808c-600093cdb9d8@19105@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1680-0'
00000100:00100000:4.0:1773851899.829262:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e0a2647 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:96ce4e4b-4547-4491-808c-600093cdb9d8+5:39750:x1859597825824704:12345-19105@kfi7:400:default-tuolumne1680-0 Request processed in 58us (100us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851899.829264:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19105@kfi7, seq: 2001998
00000100:00000040:4.0:1773851899.829265:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a2ba676 : new rpc_count 0
00000100:00000001:4.0:1773851899.829266:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851899.829266:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851899.829267:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000020:00000010:4.0:1773851899.829267:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000221a0242.
00000020:00000010:4.0:1773851899.829268:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000050d3f139.
00000020:00000040:4.0:1773851899.829269:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000009a2ba676 : new refcount 4
00000100:00000001:4.0:1773851899.829270:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851899.829276:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x41d TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851899.829278:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851899.829280:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19105@kfi7: PUT: OK
00000400:00000200:5.0:1773851899.829281:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098ca3a41
00000400:00000010:5.0:1773851899.829282:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098ca3a41.
00000100:00000001:5.0:1773851899.829283:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851899.829284:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851899.829285:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dfdc0be0 nid 19105@kfi7 refs 2
00000800:00000200:5.0:1773851899.829288:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 19105@kfi7(00000000658c668f):0x0 lsk 1054 rsk 21 tsk 0 trmk 0 tmk 0 trr 1 tta 0x41d Transaction freed
00000800:00000200:11.0:1773851899.839713:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851899.839713:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851899.839714:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851899.839715:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851899.839716:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bcbe582c: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851899.839716:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851899.839718:0:2510946:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8785@kfi7(0000000092eccdd9):0x5e9 version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851899.839719:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:11.0:1773851899.839720:0:2510946:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bcbe582c: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 Using peer 8785@kfi7(0x5e9)
00000400:00000200:10.0:1773851899.839721:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:11.0:1773851899.839722:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:10.0:1773851899.839722:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8785@kfi7 : PUT - for me
00000800:00000200:11.0:1773851899.839724:0:2510946:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 38 bytes to peer 0x5e9: rc=0
00000400:00000200:10.0:1773851899.839724:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000800:00000200:11.0:1773851899.839729:0:2510946:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000bcbe582c: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851899.839729:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 1
00000400:00000200:10.0:1773851899.839730:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:10.0:1773851899.839731:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000400:00000200:10.0:1773851899.839732:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 3
00000400:00000200:10.0:1773851899.839733:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8784@kfi7 to cpt 7
00000400:00000200:10.0:1773851899.839734:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8784@kfi7 of length 224 into portal 12 MB=0x69b09daddec00
00000400:00000200:10.0:1773851899.839735:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8784@kfi7 of length 224/224 into md 0x78146ce49 [64] + 164632
00000800:00000200:10.0:1773851899.839738:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851899.839740:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000bcbe582c: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851899.839740:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851899.839741:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8785@kfi7: PUT: OK
00000100:00000001:10.0:1773851899.839742:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:11.0:1773851899.839743:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bcbe582c: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 Transaction freed
00000100:00000200:10.0:1773851899.839743:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851899.839744:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d72bffb1.
00000100:00000040:10.0:1773851899.839745:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000d72bffb1 x1859316489251840 msgsize 224
00000100:00100000:10.0:1773851899.839746:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-8784@kfi7 (source: 12345-8785@kfi7)
00000100:00000001:10.0:1773851899.839748:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851899.839749:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000800:00000200:10.0:1773851899.839751:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851899.839751:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851899.839753:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851899.839754:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851899.839755:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851899.839757:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851899.839758:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316489251840
00000020:00000001:8.0:1773851899.839760:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851899.839761:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913a3
00000020:00000001:8.0:1773851899.839762:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851899.839765:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a4f19c69 refcount=9
00000020:00000001:8.0:1773851899.839767:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169306112 : -107127540245504 : ffff9e916d049c00)
00000020:00000001:8.0:1773851899.839769:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169306112 : -107127540245504 : ffff9e916d049c00)
00000100:00000001:8.0:1773851899.839771:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851899.839772:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851899.839773:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851899.839775:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851899.839777:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000fe1d86a1.
00000100:00000001:8.0:1773851899.839779:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851899.839780:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851899.839781:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851899.839783:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851899.839784:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851899.839785:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851899.839786:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851899.839788:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851899.839789:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851899.839789:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851899.839790:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8784@kfi7, seq: 2130882
00000100:00000001:8.0:1773851899.839790:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851899.839791:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a4f19c69 : new rpc_count 1
00000100:00000001:8.0:1773851899.839791:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.839792:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087757568 : -106944621794048 : ffff9ebc03cead00)
00000100:00000001:8.0:1773851899.839792:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851899.839793:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d72bffb1 x1859316489251840/t0(0) o400->1a7a255e-4016-4cc8-81f9-d7275f92b41c@8784@kfi7:149/0 lens 224/0 e 0 to 0 dl 1773852264 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1042-0'
00000100:00000001:11.0:1773851899.839796:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851899.839797:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851899.839798:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d72bffb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1a7a255e-4016-4cc8-81f9-d7275f92b41c+9:39892:x1859316489251840:12345-8784@kfi7:400:default-tuolumne1042-0
00000100:00000200:11.0:1773851899.839799:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316489251840
00000020:00000001:11.0:1773851899.839800:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851899.839801:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851899.839801:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.839802:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851899.839802:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851899.839803:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851899.839804:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316489251840, found 0 last_xid 1859316489251839
00000020:00000001:11.0:1773851899.839805:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851899.839805:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851899.839806:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851899.839806:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.839807:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851899.839808:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851899.839808:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851899.839809:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d7f8a0ef.
02000000:00000001:11.0:1773851899.839810:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.839810:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.839811:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851899.839812:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182991537005, transno 0, xid 1859316489251840
00010000:00000001:11.0:1773851899.839812:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851899.839813:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d72bffb1 x1859316489251840/t0(0) o400->1a7a255e-4016-4cc8-81f9-d7275f92b41c@8784@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1042-0'
00010000:00000001:11.0:1773851899.839815:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851899.839816:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851899.839817:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=132 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851899.839818:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851899.839818:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b36472f refcount 5 to 8784@kfi7
00000100:00000001:11.0:1773851899.839819:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091271392 : -107152618280224 : ffff9e8b96402ae0)
02000000:00000001:11.0:1773851899.839820:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851899.839821:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.839821:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851899.839822:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8785@kfi7
00000400:00000010:11.0:1773851899.839823:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ed9687dd.
00000100:00000200:11.0:1773851899.839824:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316489251840, offset 224
00000400:00000200:11.0:1773851899.839825:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8785@kfi7
00000400:00000200:11.0:1773851899.839826:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:11.0:1773851899.839827:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 1
00000400:00000200:11.0:1773851899.839828:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000400:00000200:11.0:1773851899.839829:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 3
00000400:00000200:11.0:1773851899.839830:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8785@kfi7 local destination
00000400:00000200:11.0:1773851899.839831:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770335:8770335:1024:4294967295] 8785@kfi7 LPNI seq info [721294:721294:16:4294967295]
00000400:00000200:11.0:1773851899.839833:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000400:00000200:11.0:1773851899.839833:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8785@kfi7 to cpt 2
00000400:00000200:11.0:1773851899.839835:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8785@kfi7(8785@kfi7:8785@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851899.839837:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 3
00000800:00000200:11.0:1773851899.839838:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851899.839839:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851899.839841:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851899.839843:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 Using peer 8785@kfi7(0x5e9)
00000800:00000200:11.0:1773851899.839846:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x5e9: rc=0
00000800:00000200:11.0:1773851899.839847:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851899.839849:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851899.839850:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b36472f refcount 4 to 8784@kfi7
00010000:00000001:11.0:1773851899.839851:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851899.839851:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.839852:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851899.839853:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d72bffb1 x1859316489251840/t0(0) o400->1a7a255e-4016-4cc8-81f9-d7275f92b41c@8784@kfi7:149/0 lens 224/224 e 0 to 0 dl 1773852264 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1042-0'
00000100:00100000:11.0:1773851899.839856:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d72bffb1 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:1a7a255e-4016-4cc8-81f9-d7275f92b41c+9:39892:x1859316489251840:12345-8784@kfi7:400:default-tuolumne1042-0 Request processed in 59us (111us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851899.839858:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8784@kfi7, seq: 2130882
00000100:00000040:11.0:1773851899.839859:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a4f19c69 : new rpc_count 0
00000100:00000001:11.0:1773851899.839860:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851899.839860:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851899.839862:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:11.0:1773851899.839862:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000fe1d86a1.
00000800:00000200:10.0:1773851899.839862:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851899.839863:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:11.0:1773851899.839864:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000a4f19c69 : new refcount 8
00000100:00000001:11.0:1773851899.839864:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851899.839864:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851899.839865:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8785@kfi7: PUT: OK
00000400:00000200:10.0:1773851899.839866:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ed9687dd
00000400:00000010:10.0:1773851899.839866:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ed9687dd.
00000100:00000001:10.0:1773851899.839867:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851899.839867:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:10.0:1773851899.839868:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e3fb5dc2 nid 8785@kfi7 refs 2
00000800:00000200:10.0:1773851899.839870:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 8785@kfi7(0000000092eccdd9):0x0 lsk 1514 rsk 45 tsk 0 trmk 0 tmk 0 trr 2 tta 0x5e9 Transaction freed
00000800:00000200:18.0:1773851899.888489:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851899.888490:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851899.888491:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851899.888493:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851899.888495:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:18.0:1773851899.888496:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13985@kfi7 : PUT - for me
00000400:00000200:18.0:1773851899.888497:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:18.0:1773851899.888498:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 1
00000400:00000200:18.0:1773851899.888499:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:18.0:1773851899.888500:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:18.0:1773851899.888501:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000400:00000200:18.0:1773851899.888502:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13921@kfi7 to cpt 0
00000400:00000200:18.0:1773851899.888503:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13921@kfi7 of length 224 into portal 12 MB=0x69b0a274ef600
00000400:00000200:18.0:1773851899.888504:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13921@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 48368
00000800:00000200:18.0:1773851899.888507:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851899.888508:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851899.888509:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13985@kfi7: PUT: OK
00000100:00000001:18.0:1773851899.888510:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851899.888511:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851899.888512:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000036db96aa.
00000100:00000040:18.0:1773851899.888512:0:2507147:0:(events.c:358:request_in_callback()) incoming req@0000000036db96aa x1859317771728384 msgsize 224
00000100:00100000:18.0:1773851899.888514:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-13921@kfi7 (source: 12345-13985@kfi7)
00000100:00000001:18.0:1773851899.888515:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851899.888516:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000100:00000001:16.0:1773851899.888516:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851899.888517:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:16.0:1773851899.888517:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851899.888517:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851899.888518:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851899.888519:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851899.888520:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317771728384
00000020:00000001:16.0:1773851899.888520:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851899.888521:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac918f1
00000020:00000001:16.0:1773851899.888522:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851899.888525:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e3700aad refcount=6
00000020:00000001:16.0:1773851899.888525:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241970688 : -107152467580928 : ffff9e8b9f3ba800)
00000020:00000001:16.0:1773851899.888526:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241970688 : -107152467580928 : ffff9e8b9f3ba800)
00000100:00000001:16.0:1773851899.888528:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851899.888529:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851899.888529:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000a80febe.
00000020:00000010:16.0:1773851899.888530:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851899.888531:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004575af91.
00000100:00000001:16.0:1773851899.888532:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851899.888533:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851899.888533:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851899.888534:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851899.888535:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851899.888535:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851899.888536:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851899.888537:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851899.888537:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851899.888538:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851899.888538:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851899.888539:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13921@kfi7, seq: 2156440
00000100:00000040:16.0:1773851899.888539:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e3700aad : new rpc_count 1
00000100:00000001:19.0:1773851899.888540:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851899.888540:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851899.888540:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609971200 : -107015099580416 : ffff9eab9b010000)
00000100:00000040:16.0:1773851899.888541:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000036db96aa x1859317771728384/t0(0) o400->3575a08f-106b-4cba-9fa2-52babd369fcd@13921@kfi7:151/0 lens 224/0 e 0 to 0 dl 1773852266 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1360-0'
00000100:00000001:16.0:1773851899.888544:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851899.888545:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851899.888546:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000036db96aa pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:3575a08f-106b-4cba-9fa2-52babd369fcd+6:39831:x1859317771728384:12345-13921@kfi7:400:default-tuolumne1360-0
00000100:00000200:16.0:1773851899.888547:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317771728384
00000020:00000001:16.0:1773851899.888548:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851899.888548:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851899.888549:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.888550:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851899.888550:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851899.888551:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851899.888552:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317771728384, found 0 last_xid 1859317771728383
00000020:00000001:16.0:1773851899.888553:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851899.888553:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851899.888554:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851899.888555:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.888555:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851899.888556:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851899.888556:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851899.888557:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e6dc2e6b.
02000000:00000001:16.0:1773851899.888558:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851899.888558:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.888559:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851899.888560:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859317771728384
00010000:00000001:16.0:1773851899.888560:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851899.888561:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000036db96aa x1859317771728384/t0(0) o400->3575a08f-106b-4cba-9fa2-52babd369fcd@13921@kfi7:151/0 lens 224/224 e 0 to 0 dl 1773852266 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1360-0'
00010000:00000001:16.0:1773851899.888564:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851899.888564:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851899.888565:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=132 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851899.888566:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851899.888567:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e5915c6 refcount 5 to 13921@kfi7
00000100:00000001:16.0:1773851899.888567:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919545858112 : -107154163693504 : ffff9e8b3a230840)
02000000:00000001:16.0:1773851899.888568:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851899.888569:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851899.888570:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851899.888570:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13985@kfi7
00000400:00000010:16.0:1773851899.888571:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000493fb085.
00000100:00000200:16.0:1773851899.888572:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317771728384, offset 224
00000400:00000200:16.0:1773851899.888573:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13985@kfi7
00000400:00000200:16.0:1773851899.888574:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:16.0:1773851899.888575:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 1
00000400:00000200:16.0:1773851899.888576:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:16.0:1773851899.888577:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000400:00000200:16.0:1773851899.888578:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13985@kfi7 local destination
00000400:00000200:16.0:1773851899.888579:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770336:8770336:1024:4294967295] 13985@kfi7 LPNI seq info [7474937:7474937:16:4294967295]
00000400:00000200:16.0:1773851899.888581:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000400:00000200:16.0:1773851899.888581:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13985@kfi7 to cpt 4
00000400:00000200:16.0:1773851899.888583:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13985@kfi7(13985@kfi7:13985@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851899.888584:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 3
00000800:00000200:16.0:1773851899.888586:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851899.888587:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851899.888589:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851899.888591:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 Using peer 13985@kfi7(0x801)
00000800:00000200:16.0:1773851899.888594:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000035621ee2: Posted send of 324 bytes to peer 0x801: rc=0
00000800:00000200:16.0:1773851899.888595:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851899.888597:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851899.888598:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e5915c6 refcount 4 to 13921@kfi7
00010000:00000001:16.0:1773851899.888599:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851899.888599:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851899.888600:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851899.888601:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000036db96aa x1859317771728384/t0(0) o400->3575a08f-106b-4cba-9fa2-52babd369fcd@13921@kfi7:151/0 lens 224/224 e 0 to 0 dl 1773852266 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1360-0'
00000100:00100000:16.0:1773851899.888605:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000036db96aa pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:3575a08f-106b-4cba-9fa2-52babd369fcd+6:39831:x1859317771728384:12345-13921@kfi7:400:default-tuolumne1360-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851899.888607:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13921@kfi7, seq: 2156440
00000100:00000040:16.0:1773851899.888608:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e3700aad : new rpc_count 0
00000100:00000001:16.0:1773851899.888611:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851899.888611:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851899.888612:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851899.888613:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004575af91.
00000020:00000010:16.0:1773851899.888614:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000a80febe.
00000020:00000040:16.0:1773851899.888614:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000e3700aad : new refcount 5
00000100:00000001:16.0:1773851899.888615:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851899.888620:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851899.888623:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851899.888624:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13985@kfi7: PUT: OK
00000400:00000200:17.0:1773851899.888625:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000493fb085
00000400:00000010:17.0:1773851899.888625:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000493fb085.
00000100:00000001:17.0:1773851899.888626:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851899.888627:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851899.888627:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009746e490 nid 13985@kfi7 refs 2
00000800:00000200:17.0:1773851899.888629:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000035621ee2: 2069@kfi7:4 -> 13985@kfi7(00000000cd498cb6):0x0 lsk 2050 rsk 49 tsk 0 trmk 0 tmk 0 trr 4 tta 0x801 Transaction freed
00000800:00000200:9.0:1773851899.969920:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851899.969921:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851899.969923:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851899.969925:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851899.969928:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.969929:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21409@kfi7 : PUT - for me
00000400:00000200:9.0:1773851899.969930:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.969931:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 1
00000400:00000200:9.0:1773851899.969932:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.969933:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000400:00000200:9.0:1773851899.969934:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 3
00000400:00000200:9.0:1773851899.969935:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:9.0:1773851899.969936:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21409@kfi7 of length 224 into portal 12 MB=0x699e0a2a83740
00000400:00000200:9.0:1773851899.969937:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21409@kfi7 of length 224/224 into md 0x78146ce49 [64] + 164856
00000800:00000200:9.0:1773851899.969939:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851899.969941:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851899.969942:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21409@kfi7: PUT: OK
00000100:00000001:9.0:1773851899.969943:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851899.969944:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851899.969945:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e706acb.
00000100:00000040:9.0:1773851899.969945:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000005e706acb x1858039940921152 msgsize 224
00000100:00100000:9.0:1773851899.969947:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21409@kfi7 (source: 12345-21409@kfi7)
00000100:00000001:9.0:1773851899.969948:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851899.969949:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851899.969949:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
02000000:00000001:11.0:1773851899.969950:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851899.969950:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851899.969951:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851899.969951:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851899.969951:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00100000:11.0:1773851899.969952:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039940921152
00000020:00000001:11.0:1773851899.969953:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851899.969953:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92810
00000020:00000001:11.0:1773851899.969954:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851899.969957:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005c7bee10 refcount=6
00000020:00000001:11.0:1773851899.969957:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631512064 : -107123078039552 : ffff9e9276fc7800)
00000020:00000001:11.0:1773851899.969958:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631512064 : -107123078039552 : ffff9e9276fc7800)
00000100:00000001:11.0:1773851899.969959:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851899.969960:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851899.969961:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef653fd2.
00000020:00000010:11.0:1773851899.969962:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851899.969963:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851899.969964:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851899.969964:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851899.969965:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851899.969966:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851899.969966:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851899.969967:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.969968:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851899.969969:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851899.969970:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851899.969970:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851899.969971:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21409@kfi7, seq: 2130883
00000100:00000040:11.0:1773851899.969971:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005c7bee10 : new rpc_count 1
00000100:00000001:8.0:1773851899.969971:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851899.969972:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637134024710912 : -106939684840704 : ffff9ebd2a129b00)
00000100:00000001:8.0:1773851899.969972:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851899.969973:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005e706acb x1858039940921152/t0(0) o400->b6a4ec85-993a-4370-a7a3-3dcb162f5254@21409@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1824-0'
00000100:00000001:8.0:1773851899.969974:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.969976:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851899.969976:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851899.969977:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e706acb pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:b6a4ec85-993a-4370-a7a3-3dcb162f5254+6:39634:x1858039940921152:12345-21409@kfi7:400:default-tuolumne1824-0
00000100:00000200:11.0:1773851899.969978:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039940921152
00000020:00000001:11.0:1773851899.969979:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851899.969980:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851899.969980:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.969981:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851899.969981:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851899.969982:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851899.969983:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039940921152, found 0 last_xid 1858039940921151
00000020:00000001:11.0:1773851899.969984:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851899.969984:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851899.969985:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851899.969985:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.969986:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851899.969986:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851899.969987:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851899.969987:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000816b63bf.
02000000:00000001:11.0:1773851899.969988:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.969989:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.969990:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851899.969991:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183052313194, transno 0, xid 1858039940921152
00010000:00000001:11.0:1773851899.969991:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851899.969992:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005e706acb x1858039940921152/t0(0) o400->b6a4ec85-993a-4370-a7a3-3dcb162f5254@21409@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1824-0'
00010000:00000001:11.0:1773851899.969994:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851899.969995:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851899.969995:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=132 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851899.969996:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851899.969997:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000099fd890 refcount 3 to 21409@kfi7
00000100:00000001:11.0:1773851899.969998:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051134752 : -107146658416864 : ffff9e8cf97c7720)
02000000:00000001:11.0:1773851899.969999:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851899.969999:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851899.970000:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851899.970001:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21409@kfi7
00000400:00000010:11.0:1773851899.970001:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1dd5303.
00000100:00000200:11.0:1773851899.970002:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039940921152, offset 224
00000400:00000200:11.0:1773851899.970004:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21409@kfi7
00000400:00000200:11.0:1773851899.970004:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:11.0:1773851899.970005:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 1
00000400:00000200:11.0:1773851899.970006:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000400:00000200:11.0:1773851899.970008:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 3
00000400:00000200:11.0:1773851899.970009:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21409@kfi7 local destination
00000400:00000200:11.0:1773851899.970010:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770337:8770337:1024:4294967295] 21409@kfi7 LPNI seq info [561758:561758:16:4294967295]
00000400:00000200:11.0:1773851899.970011:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000400:00000200:11.0:1773851899.970012:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21409@kfi7 to cpt 2
00000400:00000200:11.0:1773851899.970014:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21409@kfi7(21409@kfi7:21409@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851899.970015:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 3
00000800:00000200:11.0:1773851899.970017:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851899.970018:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851899.970020:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851899.970022:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000778 Using peer 21409@kfi7(0x100000000000778)
00000800:00000200:11.0:1773851899.970025:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x100000000000778: rc=0
00000800:00000200:11.0:1773851899.970026:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000778 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851899.970028:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851899.970029:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000099fd890 refcount 2 to 21409@kfi7
00010000:00000001:11.0:1773851899.970030:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851899.970030:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851899.970031:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851899.970032:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e706acb x1858039940921152/t0(0) o400->b6a4ec85-993a-4370-a7a3-3dcb162f5254@21409@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1824-0'
00000100:00100000:11.0:1773851899.970035:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e706acb pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:b6a4ec85-993a-4370-a7a3-3dcb162f5254+6:39634:x1858039940921152:12345-21409@kfi7:400:default-tuolumne1824-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851899.970037:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21409@kfi7, seq: 2130883
00000100:00000040:11.0:1773851899.970037:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005c7bee10 : new rpc_count 0
00000100:00000001:11.0:1773851899.970038:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851899.970039:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851899.970040:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851899.970040:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000800:00000200:9.0:1773851899.970040:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000778 TN_EVENT_TX_OK event status 0
00000020:00000010:11.0:1773851899.970041:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef653fd2.
00000400:00000200:9.0:1773851899.970041:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:11.0:1773851899.970042:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000005c7bee10 : new refcount 5
00000400:00000200:9.0:1773851899.970042:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21409@kfi7: PUT: OK
00000100:00000001:11.0:1773851899.970043:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851899.970043:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1dd5303
00000400:00000010:9.0:1773851899.970044:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1dd5303.
00000100:00000001:9.0:1773851899.970045:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851899.970045:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851899.970046:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000340bfc82 nid 21409@kfi7 refs 2
00000800:00000200:9.0:1773851899.970048:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 21409@kfi7(000000002b68dea0):0x0 lsk 1913 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000778 Transaction freed
00000800:00000200:30.0:1773851899.994154:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851899.994154:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851899.994155:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851899.994156:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851899.994156:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851899.994157:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851899.994158:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21395@kfi7(00000000d3ee9450):0x7a0 version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851899.994160:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851899.994160:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 Using peer 21395@kfi7(0x1000000000007a0)
00000400:00000200:30.0:1773851899.994162:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.994163:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21395@kfi7 : PUT - for me
00000400:00000200:29.0:1773851899.994164:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.994165:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.994165:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6ca9331 nid 21395@kfi7 refs 1
00000800:00000200:29.0:1773851899.994166:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 38 bytes to peer 0x1000000000007a0: rc=0
00000400:00000200:30.0:1773851899.994167:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.994167:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6ca9331 nid 21395@kfi7 refs 2
00000800:00000200:29.0:1773851899.994168:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851899.994169:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f6ca9331 nid 21395@kfi7 refs 3
00000400:00000200:30.0:1773851899.994170:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.994171:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21395@kfi7 of length 456 into portal 12 MB=0x699e172ba2600
00000400:00000200:30.0:1773851899.994173:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21395@kfi7 of length 456/456 into md 0x77fe1859d [64] + 10616
00000800:00000200:30.0:1773851899.994175:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851899.994177:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851899.994178:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21395@kfi7: PUT: OK
00000100:00000001:30.0:1773851899.994179:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:29.0:1773851899.994179:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 TN_EVENT_TX_OK event status 0
00000100:00000200:30.0:1773851899.994180:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851899.994181:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f9f009d.
00000800:00000200:29.0:1773851899.994181:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 Transaction freed
00000100:00000040:30.0:1773851899.994182:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000007f9f009d x1858043431757312 msgsize 456
00000100:00100000:30.0:1773851899.994184:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-21395@kfi7 (source: 12345-21395@kfi7)
00000100:00000001:30.0:1773851899.994185:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851899.994186:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6ca9331 nid 21395@kfi7 refs 2
00000100:00000001:31.0:1773851899.994188:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851899.994188:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bc942d61: 2054@kfi7:7 <- 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851899.994189:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851899.994189:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851899.994190:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851899.994192:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851899.994193:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043431757312
00000020:00000001:31.0:1773851899.994194:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851899.994194:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a72
00000020:00000001:31.0:1773851899.994195:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851899.994199:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000365e249d refcount=377
00000020:00000001:31.0:1773851899.994200:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627753984 : -107123081797632 : ffff9e9276c32000)
00000020:00000001:31.0:1773851899.994201:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627753984 : -107123081797632 : ffff9e9276c32000)
00000100:00000001:31.0:1773851899.994203:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851899.994204:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851899.994205:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058cf92f8.
00000020:00000010:31.0:1773851899.994207:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851899.994208:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000026c5e333.
00000100:00000001:31.0:1773851899.994210:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851899.994210:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851899.994211:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.994213:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851899.994215:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851899.994217:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851899.994217:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851899.994218:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851899.994218:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851899.994219:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21395@kfi7, seq: 364304989
00000100:00000040:30.0:1773851899.994220:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000365e249d : new rpc_count 9
00000100:00000001:31.0:1773851899.994221:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.994221:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411265280 : -106960298286336 : ffff9eb85d6a6300)
00000100:00000001:31.0:1773851899.994222:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851899.994223:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007f9f009d x1858043431757312/t0(0) o17->99ccfe45-9361-4db1-8454-203e5e6f3a21@21395@kfi7:539/0 lens 456/0 e 0 to 0 dl 1773852654 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1830-0'
00000100:00000001:30.0:1773851899.994226:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851899.994227:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851899.994228:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f9f009d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:99ccfe45-9361-4db1-8454-203e5e6f3a21+377:39842:x1858043431757312:12345-21395@kfi7:17:default-tuolumne1830-0
00000100:00000200:30.0:1773851899.994229:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043431757312
00000020:00000001:30.0:1773851899.994230:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851899.994231:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851899.994232:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851899.994233:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851899.994234:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:30.0:1773851899.994235:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851899.994235:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043431757312, found 0 last_xid 1858043431070143
00000020:00000001:30.0:1773851899.994237:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851899.994237:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851899.994238:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851899.994239:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851899.994239:0:42267:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:30.0:1773851899.994240:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851899.994241:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851899.994242:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000b86b0688.
02000000:00000001:30.0:1773851899.994243:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.994244:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851899.994245:0:42267:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:30.0:1773851899.994245:0:42267:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:30.0:1773851899.994246:0:42267:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851899.994247:0:42267:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851899.994248:0:42267:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:30.0:1773851899.994249:0:42267:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 99ccfe45-9361-4db1-8454-203e5e6f3a21/00000000365e249d free: 126633370845184 avail: 126633368748032
00000020:00000001:30.0:1773851899.994250:0:42267:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:30.0:1773851899.994250:0:42267:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 99ccfe45-9361-4db1-8454-203e5e6f3a21/00000000365e249d avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:30.0:1773851899.994252:0:42267:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:30.0:1773851899.994253:0:42267:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:30.0:1773851899.994253:0:42267:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 99ccfe45-9361-4db1-8454-203e5e6f3a21/00000000365e249d reports grant 1804861439 dropped 0, local 1882456063
00000020:00000001:30.0:1773851899.994255:0:42267:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:30.0:1773851899.994255:0:42267:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:30.0:1773851899.994255:0:42267:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851899.994256:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578717, transno 0, xid 1858043431757312
00010000:00000001:30.0:1773851899.994257:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851899.994258:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007f9f009d x1858043431757312/t0(0) o17->99ccfe45-9361-4db1-8454-203e5e6f3a21@21395@kfi7:539/0 lens 456/432 e 0 to 0 dl 1773852654 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1830-0'
00010000:00000001:30.0:1773851899.994263:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851899.994264:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851899.994265:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=132 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851899.994266:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851899.994267:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006f4ad592 refcount 3 to 21395@kfi7
00000100:00000001:30.0:1773851899.994267:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603211136 : -107155106340480 : ffff9e8b01f36180)
02000000:00000001:30.0:1773851899.994268:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851899.994269:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851899.994270:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851899.994271:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21395@kfi7
00000400:00000010:30.0:1773851899.994271:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3d2c920.
00000100:00000200:30.0:1773851899.994273:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858043431757312, offset 224
00000400:00000200:30.0:1773851899.994274:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21395@kfi7
00000400:00000200:30.0:1773851899.994275:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.994276:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f6ca9331 nid 21395@kfi7 refs 1
00000400:00000200:30.0:1773851899.994277:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f6ca9331 nid 21395@kfi7 refs 2
00000400:00000200:30.0:1773851899.994278:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f6ca9331 nid 21395@kfi7 refs 3
00000400:00000200:30.0:1773851899.994279:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21395@kfi7 local destination
00000400:00000200:30.0:1773851899.994281:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770338:8770338:1024:4294967295] 21395@kfi7 LPNI seq info [2139298:2139298:16:4294967295]
00000400:00000200:30.0:1773851899.994282:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f6ca9331 nid 21395@kfi7 refs 2
00000400:00000200:30.0:1773851899.994283:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21395@kfi7 to cpt 7
00000400:00000200:30.0:1773851899.994285:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21395@kfi7(21395@kfi7:21395@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851899.994286:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f6ca9331 nid 21395@kfi7 refs 3
00000800:00000200:30.0:1773851899.994288:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851899.994289:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:30.0:1773851899.994292:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851899.994294:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 Using peer 21395@kfi7(0x1000000000007a0)
00000800:00000200:30.0:1773851899.994305:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bc942d61: Posted send of 532 bytes to peer 0x1000000000007a0: rc=0
00000800:00000200:30.0:1773851899.994306:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:21.0:1773851899.994306:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851899.994307:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851899.994308:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851899.994309:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006f4ad592 refcount 2 to 21395@kfi7
00000800:00000200:21.0:1773851899.994309:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:30.0:1773851899.994310:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851899.994311:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851899.994311:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851899.994312:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f9f009d x1858043431757312/t0(0) o17->99ccfe45-9361-4db1-8454-203e5e6f3a21@21395@kfi7:539/0 lens 456/432 e 0 to 0 dl 1773852654 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1830-0'
00000800:00000200:21.0:1773851899.994312:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851899.994314:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.994315:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24049@kfi7 : PUT - for me
00000100:00100000:30.0:1773851899.994316:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f9f009d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:99ccfe45-9361-4db1-8454-203e5e6f3a21+377:39842:x1858043431757312:12345-21395@kfi7:17:default-tuolumne1830-0 Request processed in 89us (133us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851899.994316:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:21.0:1773851899.994317:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 1
00000800:00000200:29.0:1773851899.994318:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 TN_EVENT_TX_OK event status 0
00000100:00100000:30.0:1773851899.994319:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21395@kfi7, seq: 364304989
00000100:00000040:30.0:1773851899.994319:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000365e249d : new rpc_count 8
00000400:00000200:29.0:1773851899.994319:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851899.994319:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000100:00000001:30.0:1773851899.994320:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851899.994320:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21395@kfi7: PUT: OK
00000400:00000200:21.0:1773851899.994320:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000100:00000001:30.0:1773851899.994321:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851899.994321:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3d2c920
00000400:00000200:21.0:1773851899.994321:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 3
00000020:00000010:30.0:1773851899.994322:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:30.0:1773851899.994322:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000026c5e333.
00000400:00000010:29.0:1773851899.994322:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3d2c920.
00000100:00000001:29.0:1773851899.994322:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000400:00000200:21.0:1773851899.994322:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24048@kfi7 to cpt 2
00000020:00000010:30.0:1773851899.994323:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058cf92f8.
00000100:00000001:29.0:1773851899.994323:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851899.994323:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24048@kfi7 of length 224 into portal 12 MB=0x699e197dadcc0
00000020:00000040:30.0:1773851899.994324:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000365e249d : new refcount 376
00000400:00000200:29.0:1773851899.994324:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f6ca9331 nid 21395@kfi7 refs 2
00000100:00000001:30.0:1773851899.994325:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851899.994325:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bc942d61: 2054@kfi7:7 -> 21395@kfi7(00000000d3ee9450):0x0 lsk 1953 rsk 52 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000007a0 Transaction freed
00000400:00000200:21.0:1773851899.994325:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24048@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 66440
00000800:00000200:21.0:1773851899.994327:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851899.994329:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851899.994331:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24049@kfi7: PUT: OK
00000100:00000001:21.0:1773851899.994332:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851899.994332:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851899.994333:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b5dee905.
00000100:00000040:21.0:1773851899.994334:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000b5dee905 x1858044054658240 msgsize 224
00000100:00100000:21.0:1773851899.994336:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24048@kfi7 (source: 12345-24049@kfi7)
00000100:00000001:21.0:1773851899.994337:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:23.0:1773851899.994339:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:21.0:1773851899.994339:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 2
02000000:00000001:23.0:1773851899.994340:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851899.994340:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851899.994340:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851899.994341:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851899.994341:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851899.994342:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044054658240
00000020:00000001:23.0:1773851899.994343:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851899.994343:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c46
00000020:00000001:23.0:1773851899.994344:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851899.994347:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001876d267 refcount=6
00000020:00000001:23.0:1773851899.994347:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743952384 : -107128965599232 : ffff9e91180f7000)
00000020:00000001:23.0:1773851899.994348:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743952384 : -107128965599232 : ffff9e91180f7000)
00000100:00000001:23.0:1773851899.994349:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851899.994350:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851899.994350:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851899.994351:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851899.994352:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851899.994353:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851899.994353:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851899.994354:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851899.994355:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851899.994355:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851899.994356:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.994357:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851899.994358:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851899.994358:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851899.994358:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851899.994359:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24048@kfi7, seq: 1998078
00000100:00000001:20.0:1773851899.994359:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851899.994360:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001876d267 : new rpc_count 1
00000100:00000001:20.0:1773851899.994360:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.994361:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701973248 : -106936007578368 : ffff9ebe05412d00)
00000100:00000001:20.0:1773851899.994361:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851899.994362:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b5dee905 x1858044054658240/t0(0) o400->33c2b67e-d2db-42c8-b115-951c593ce283@24048@kfi7:626/0 lens 224/0 e 0 to 0 dl 1773851986 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1981-0'
00000100:00000001:23.0:1773851899.994364:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851899.994365:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851899.994365:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b5dee905 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:33c2b67e-d2db-42c8-b115-951c593ce283+6:39678:x1858044054658240:12345-24048@kfi7:400:default-tuolumne1981-0
00000100:00000200:23.0:1773851899.994367:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044054658240
00000020:00000001:23.0:1773851899.994367:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851899.994368:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851899.994368:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.994369:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851899.994369:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851899.994370:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851899.994370:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044054658240, found 0 last_xid 1858044054658239
00000020:00000001:23.0:1773851899.994371:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851899.994372:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851899.994372:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851899.994373:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.994373:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851899.994374:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851899.994374:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851899.994375:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a627814f.
02000000:00000001:23.0:1773851899.994376:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.994376:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.994377:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851899.994377:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181475771429, transno 0, xid 1858044054658240
00010000:00000001:23.0:1773851899.994378:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851899.994379:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b5dee905 x1858044054658240/t0(0) o400->33c2b67e-d2db-42c8-b115-951c593ce283@24048@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1981-0'
00010000:00000001:23.0:1773851899.994381:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851899.994381:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851899.994383:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=132 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851899.994384:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851899.994384:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee04c026 refcount 3 to 24048@kfi7
00000100:00000001:23.0:1773851899.994385:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051135328 : -107146658416288 : ffff9e8cf97c7960)
02000000:00000001:23.0:1773851899.994386:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851899.994387:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851899.994387:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851899.994388:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24049@kfi7
00000400:00000010:23.0:1773851899.994389:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036e7b619.
00000100:00000200:23.0:1773851899.994389:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858044054658240, offset 224
00000400:00000200:23.0:1773851899.994391:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24049@kfi7
00000400:00000200:23.0:1773851899.994392:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:23.0:1773851899.994392:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 1
00000400:00000200:23.0:1773851899.994394:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000400:00000200:23.0:1773851899.994395:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 3
00000400:00000200:23.0:1773851899.994396:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24049@kfi7 local destination
00000400:00000200:23.0:1773851899.994397:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770339:8770339:1024:4294967295] 24049@kfi7 LPNI seq info [325672:325672:16:4294967295]
00000400:00000200:23.0:1773851899.994398:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000400:00000200:23.0:1773851899.994399:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24049@kfi7 to cpt 5
00000400:00000200:23.0:1773851899.994401:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24049@kfi7(24049@kfi7:24049@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851899.994402:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 3
00000800:00000200:23.0:1773851899.994403:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851899.994405:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851899.994407:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851899.994409:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000076a Using peer 24049@kfi7(0x10000000000076a)
00000800:00000200:23.0:1773851899.994412:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x10000000000076a: rc=0
00000800:00000200:23.0:1773851899.994414:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000076a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851899.994418:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851899.994419:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee04c026 refcount 2 to 24048@kfi7
00010000:00000001:23.0:1773851899.994419:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851899.994420:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851899.994420:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851899.994421:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b5dee905 x1858044054658240/t0(0) o400->33c2b67e-d2db-42c8-b115-951c593ce283@24048@kfi7:626/0 lens 224/224 e 0 to 0 dl 1773851986 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1981-0'
00000100:00100000:23.0:1773851899.994424:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b5dee905 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:33c2b67e-d2db-42c8-b115-951c593ce283+6:39678:x1858044054658240:12345-24048@kfi7:400:default-tuolumne1981-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851899.994426:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24048@kfi7, seq: 1998078
00000800:00000200:21.0:1773851899.994426:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000076a TN_EVENT_TX_OK event status 0
00000100:00000040:23.0:1773851899.994427:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001876d267 : new rpc_count 0
00000100:00000001:23.0:1773851899.994427:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851899.994427:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851899.994428:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851899.994428:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851899.994429:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000400:00000200:21.0:1773851899.994429:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24049@kfi7: PUT: OK
00000400:00000200:21.0:1773851899.994429:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036e7b619
00000020:00000010:23.0:1773851899.994430:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000020:00000040:23.0:1773851899.994430:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000001876d267 : new refcount 5
00000400:00000010:21.0:1773851899.994430:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036e7b619.
00000100:00000001:23.0:1773851899.994431:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851899.994431:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851899.994431:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851899.994432:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002de354bc nid 24049@kfi7 refs 2
00000800:00000200:21.0:1773851899.994434:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 24049@kfi7(0000000016fe34e8):0x0 lsk 1899 rsk 49 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000076a Transaction freed
00010000:00000001:2.0:1773851900.041730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041735:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851900.041736:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851900.041736:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041737:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851900.041737:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041738:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041738:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041740:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851900.041740:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851900.041740:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041741:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851900.041741:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041742:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041742:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041743:0:2506505:0:(ldlm_request.c:2073:ldlm_cancel_lru()) Process entered
00010000:00000001:2.0:1773851900.041744:0:2506505:0:(ldlm_request.c:1878:ldlm_prepare_lru_list()) Process entered
00010000:00000001:2.0:1773851900.041744:0:2506505:0:(ldlm_request.c:2041:ldlm_prepare_lru_list()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041745:0:2506505:0:(ldlm_lockd.c:2211:ldlm_bl_to_thread()) Process entered
00010000:00000001:2.0:1773851900.041745:0:2506505:0:(ldlm_lockd.c:2214:ldlm_bl_to_thread()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041746:0:2506505:0:(ldlm_request.c:2083:ldlm_cancel_lru()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041746:0:2506505:0:(ldlm_pool.c:517:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851900.041747:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851900.041747:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851900.041750:0:849257:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851900.041750:0:849257:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851900.041751:0:849257:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:25.0:1773851900.042544:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851900.042545:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851900.042546:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851900.042548:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851900.042550:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:25.0:1773851900.042551:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21010@kfi7 : PUT - for me
00000400:00000200:25.0:1773851900.042552:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:25.0:1773851900.042553:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 1
00000400:00000200:25.0:1773851900.042554:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:25.0:1773851900.042555:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000400:00000200:25.0:1773851900.042556:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 3
00000400:00000200:25.0:1773851900.042557:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21202@kfi7 to cpt 1
00000400:00000200:25.0:1773851900.042558:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21202@kfi7 of length 224 into portal 12 MB=0x69b0a1d0cbc40
00000400:00000200:25.0:1773851900.042559:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21202@kfi7 of length 224/224 into md 0x16159c9699 [64] + 41344
00000800:00000200:25.0:1773851900.042561:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851900.042563:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851900.042564:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21010@kfi7: PUT: OK
00000100:00000001:25.0:1773851900.042565:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851900.042565:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851900.042566:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006a808a13.
00000100:00000040:25.0:1773851900.042567:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000006a808a13 x1859317599616064 msgsize 224
00000100:00100000:25.0:1773851900.042568:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-21202@kfi7 (source: 12345-21010@kfi7)
00000100:00000001:25.0:1773851900.042569:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851900.042570:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000800:00000200:25.0:1773851900.042571:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851900.042573:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851900.042574:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851900.042575:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851900.042576:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851900.042577:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851900.042579:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317599616064
00000020:00000001:24.0:1773851900.042580:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851900.042581:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925f5
00000020:00000001:24.0:1773851900.042582:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851900.042585:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000032c0b98d refcount=12
00000020:00000001:24.0:1773851900.042587:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631012352 : -107123078539264 : ffff9e9276f4d800)
00000020:00000001:24.0:1773851900.042589:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631012352 : -107123078539264 : ffff9e9276f4d800)
00000100:00000001:24.0:1773851900.042590:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851900.042591:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851900.042593:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dae1f2b1.
00000020:00000010:24.0:1773851900.042595:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851900.042596:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851900.042598:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851900.042599:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851900.042600:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851900.042602:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851900.042602:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851900.042603:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851900.042605:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851900.042606:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851900.042607:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851900.042607:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:26.0:1773851900.042608:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21202@kfi7, seq: 2025192
00000100:00000001:24.0:1773851900.042608:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851900.042609:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000032c0b98d : new rpc_count 1
00000100:00000001:24.0:1773851900.042609:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851900.042610:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121199437056 : -106952510114560 : ffff9eba2da07500)
00000100:00000001:24.0:1773851900.042610:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851900.042611:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006a808a13 x1859317599616064/t0(0) o400->753b8c0b-8653-474f-8451-b3989eeffd8b@21202@kfi7:150/0 lens 224/0 e 0 to 0 dl 1773852265 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1813-0'
00000100:00000001:26.0:1773851900.042613:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851900.042614:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851900.042615:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006a808a13 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:753b8c0b-8653-474f-8451-b3989eeffd8b+12:39718:x1859317599616064:12345-21202@kfi7:400:default-tuolumne1813-0
00000100:00000200:26.0:1773851900.042616:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317599616064
00000020:00000001:26.0:1773851900.042617:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851900.042617:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851900.042618:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.042619:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851900.042619:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851900.042620:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851900.042620:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317599616064, found 0 last_xid 1859317599616063
00000020:00000001:26.0:1773851900.042621:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851900.042622:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851900.042623:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851900.042623:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.042624:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851900.042624:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851900.042625:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851900.042626:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000024e5a498.
02000000:00000001:26.0:1773851900.042626:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851900.042627:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.042628:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851900.042628:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096687948, transno 0, xid 1859317599616064
00010000:00000001:26.0:1773851900.042629:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851900.042630:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006a808a13 x1859317599616064/t0(0) o400->753b8c0b-8653-474f-8451-b3989eeffd8b@21202@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1813-0'
00010000:00000001:26.0:1773851900.042632:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851900.042633:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851900.042634:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=133 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851900.042635:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851900.042636:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000086a48087 refcount 3 to 21202@kfi7
00000100:00000001:26.0:1773851900.042636:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405410944 : -107145304140672 : ffff9e8d4a351480)
02000000:00000001:26.0:1773851900.042637:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851900.042638:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851900.042638:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851900.042639:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21010@kfi7
00000400:00000010:26.0:1773851900.042640:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008661a9da.
00000100:00000200:26.0:1773851900.042641:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317599616064, offset 224
00000400:00000200:26.0:1773851900.042642:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21010@kfi7
00000400:00000200:26.0:1773851900.042643:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:26.0:1773851900.042644:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 1
00000400:00000200:26.0:1773851900.042645:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000400:00000200:26.0:1773851900.042646:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 3
00000400:00000200:26.0:1773851900.042647:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21010@kfi7 local destination
00000400:00000200:26.0:1773851900.042649:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770340:8770340:1024:4294967295] 21010@kfi7 LPNI seq info [992542:992542:16:4294967295]
00000400:00000200:26.0:1773851900.042650:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000400:00000200:26.0:1773851900.042651:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21010@kfi7 to cpt 6
00000400:00000200:26.0:1773851900.042653:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21010@kfi7(21010@kfi7:21010@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851900.042654:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 3
00000800:00000200:26.0:1773851900.042655:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851900.042656:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851900.042658:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851900.042660:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001085 Using peer 21010@kfi7(0x100000000001085)
00000800:00000200:26.0:1773851900.042664:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0x100000000001085: rc=0
00000800:00000200:26.0:1773851900.042665:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001085 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851900.042669:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851900.042670:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000086a48087 refcount 2 to 21202@kfi7
00010000:00000001:26.0:1773851900.042671:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851900.042671:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.042672:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851900.042673:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006a808a13 x1859317599616064/t0(0) o400->753b8c0b-8653-474f-8451-b3989eeffd8b@21202@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1813-0'
00000100:00100000:26.0:1773851900.042676:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006a808a13 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:753b8c0b-8653-474f-8451-b3989eeffd8b+12:39718:x1859317599616064:12345-21202@kfi7:400:default-tuolumne1813-0 Request processed in 62us (108us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851900.042678:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21202@kfi7, seq: 2025192
00000100:00000040:26.0:1773851900.042679:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000032c0b98d : new rpc_count 0
00000800:00000200:25.0:1773851900.042679:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001085 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851900.042680:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851900.042680:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:25.0:1773851900.042680:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851900.042681:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:26.0:1773851900.042681:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000400:00000200:25.0:1773851900.042681:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21010@kfi7: PUT: OK
00000020:00000010:26.0:1773851900.042682:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dae1f2b1.
00000400:00000200:25.0:1773851900.042682:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008661a9da
00000020:00000040:26.0:1773851900.042683:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000032c0b98d : new refcount 11
00000400:00000010:25.0:1773851900.042683:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008661a9da.
00000100:00000001:25.0:1773851900.042683:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851900.042684:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851900.042684:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851900.042685:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000064b4440e nid 21010@kfi7 refs 2
00000800:00000200:25.0:1773851900.042686:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 21010@kfi7(0000000030c4fe6d):0x0 lsk 4230 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000001085 Transaction freed
00000800:00000200:21.0:1773851900.086292:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851900.086293:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851900.086295:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851900.086297:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851900.086298:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.086300:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24947@kfi7 : PUT - for me
00000400:00000200:21.0:1773851900.086300:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.086302:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 1
00000400:00000200:21.0:1773851900.086303:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.086303:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000400:00000200:21.0:1773851900.086304:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 3
00000400:00000200:21.0:1773851900.086305:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25010@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.086306:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25010@kfi7 of length 224 into portal 12 MB=0x699e119872340
00000400:00000200:21.0:1773851900.086307:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25010@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 66664
00000800:00000200:21.0:1773851900.086309:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851900.086311:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.086312:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24947@kfi7: PUT: OK
00000100:00000001:21.0:1773851900.086313:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851900.086313:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851900.086314:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec3e5848.
00000100:00000040:21.0:1773851900.086315:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ec3e5848 x1858041935242048 msgsize 224
00000100:00100000:21.0:1773851900.086316:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25010@kfi7 (source: 12345-24947@kfi7)
00000100:00000001:21.0:1773851900.086317:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851900.086318:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000100:00000001:23.0:1773851900.086319:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851900.086319:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851900.086319:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851900.086320:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851900.086320:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851900.086321:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851900.086322:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041935242048
00000020:00000001:23.0:1773851900.086322:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851900.086323:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92db9
00000020:00000001:23.0:1773851900.086323:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851900.086327:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000e61e606 refcount=6
00000020:00000001:23.0:1773851900.086328:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744424448 : -107128965127168 : ffff9e911816a400)
00000020:00000001:23.0:1773851900.086329:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744424448 : -107128965127168 : ffff9e911816a400)
00000100:00000001:23.0:1773851900.086330:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.086332:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851900.086333:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851900.086334:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.086335:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851900.086335:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851900.086336:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851900.086336:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.086337:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851900.086338:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851900.086338:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.086339:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.086340:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851900.086340:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851900.086341:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851900.086341:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851900.086342:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25010@kfi7, seq: 1998079
00000100:00000040:23.0:1773851900.086342:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000e61e606 : new rpc_count 1
00000100:00000001:20.0:1773851900.086342:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.086343:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137701984768 : -106936007566848 : ffff9ebe05415a00)
00000100:00000001:20.0:1773851900.086343:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.086344:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ec3e5848 x1858041935242048/t0(0) o400->e628e1fc-6dc0-4b33-af9c-93ae40a9357a@25010@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2042-0'
00000100:00000001:23.0:1773851900.086347:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.086347:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851900.086348:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec3e5848 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e628e1fc-6dc0-4b33-af9c-93ae40a9357a+6:39804:x1858041935242048:12345-25010@kfi7:400:default-tuolumne2042-0
00000100:00000200:23.0:1773851900.086349:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041935242048
00000020:00000001:23.0:1773851900.086350:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851900.086350:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851900.086351:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.086352:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851900.086352:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851900.086353:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851900.086354:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041935242048, found 0 last_xid 1858041935242047
00000020:00000001:23.0:1773851900.086354:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851900.086355:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851900.086355:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851900.086356:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.086357:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851900.086357:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851900.086358:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851900.086358:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e091bc85.
02000000:00000001:23.0:1773851900.086359:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.086359:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.086360:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851900.086360:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260753260, transno 0, xid 1858041935242048
00010000:00000001:23.0:1773851900.086361:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851900.086362:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ec3e5848 x1858041935242048/t0(0) o400->e628e1fc-6dc0-4b33-af9c-93ae40a9357a@25010@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2042-0'
00010000:00000001:23.0:1773851900.086364:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851900.086365:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851900.086365:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=133 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851900.086366:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851900.086367:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001d44225e refcount 3 to 25010@kfi7
00000100:00000001:23.0:1773851900.086367:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024896 : -107156745526720 : ffff9e8aa03f6240)
02000000:00000001:23.0:1773851900.086368:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851900.086369:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.086369:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851900.086370:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24947@kfi7
00000400:00000010:23.0:1773851900.086370:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c7cc6c.
00000100:00000200:23.0:1773851900.086371:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041935242048, offset 224
00000400:00000200:23.0:1773851900.086372:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24947@kfi7
00000400:00000200:23.0:1773851900.086373:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.086374:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 1
00000400:00000200:23.0:1773851900.086375:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000400:00000200:23.0:1773851900.086376:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 3
00000400:00000200:23.0:1773851900.086377:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24947@kfi7 local destination
00000400:00000200:23.0:1773851900.086378:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770341:8770341:1024:4294967295] 24947@kfi7 LPNI seq info [961133:961133:16:4294967295]
00000400:00000200:23.0:1773851900.086379:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000400:00000200:23.0:1773851900.086380:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24947@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.086382:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24947@kfi7(24947@kfi7:24947@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851900.086383:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 3
00000800:00000200:23.0:1773851900.086384:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851900.086385:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851900.086387:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851900.086389:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa6a Using peer 24947@kfi7(0xa6a)
00000800:00000200:23.0:1773851900.086392:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 324 bytes to peer 0xa6a: rc=0
00000800:00000200:23.0:1773851900.086393:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa6a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851900.086395:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.086396:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001d44225e refcount 2 to 25010@kfi7
00010000:00000001:23.0:1773851900.086396:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851900.086397:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.086397:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851900.086398:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec3e5848 x1858041935242048/t0(0) o400->e628e1fc-6dc0-4b33-af9c-93ae40a9357a@25010@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2042-0'
00000100:00100000:23.0:1773851900.086400:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec3e5848 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e628e1fc-6dc0-4b33-af9c-93ae40a9357a+6:39804:x1858041935242048:12345-25010@kfi7:400:default-tuolumne2042-0 Request processed in 53us (85us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851900.086402:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25010@kfi7, seq: 1998079
00000100:00000040:23.0:1773851900.086403:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000e61e606 : new rpc_count 0
00000100:00000001:23.0:1773851900.086404:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851900.086404:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851900.086405:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.086405:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851900.086406:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000020:00000040:23.0:1773851900.086406:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000000e61e606 : new refcount 5
00000800:00000200:21.0:1773851900.086406:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa6a TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851900.086407:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851900.086408:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.086409:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24947@kfi7: PUT: OK
00000400:00000200:21.0:1773851900.086410:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c7cc6c
00000400:00000010:21.0:1773851900.086411:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c7cc6c.
00000100:00000001:21.0:1773851900.086411:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851900.086412:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851900.086412:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021ffcb9f nid 24947@kfi7 refs 2
00000800:00000200:21.0:1773851900.086414:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 24947@kfi7(000000004c846443):0x0 lsk 2667 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0xa6a Transaction freed
00000800:00000200:21.0:1773851900.190104:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851900.190105:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851900.190106:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851900.190108:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851900.190109:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.190111:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18978@kfi7 : PUT - for me
00000400:00000200:21.0:1773851900.190111:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.190113:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 1
00000400:00000200:21.0:1773851900.190114:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.190114:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000400:00000200:21.0:1773851900.190115:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 3
00000400:00000200:21.0:1773851900.190116:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.190116:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18978@kfi7 of length 456 into portal 12 MB=0x69b4b895efd00
00000400:00000200:21.0:1773851900.190117:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18978@kfi7 of length 456/456 into md 0x6a32cacf5 [64] + 66888
00000800:00000200:21.0:1773851900.190119:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851900.190120:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.190121:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18978@kfi7: PUT: OK
00000100:00000001:21.0:1773851900.190121:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851900.190122:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851900.190124:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3f3d1b1.
00000100:00000040:21.0:1773851900.190125:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e3f3d1b1 x1859598589820160 msgsize 456
00000100:00100000:21.0:1773851900.190126:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18978@kfi7 (source: 12345-18978@kfi7)
00000100:00000001:21.0:1773851900.190126:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851900.190127:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000100:00000001:23.0:1773851900.190128:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851900.190128:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851900.190128:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851900.190129:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851900.190129:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851900.190130:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851900.190130:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598589820160
00000020:00000001:23.0:1773851900.190131:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851900.190131:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8bf78
00000020:00000001:23.0:1773851900.190132:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851900.190136:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008ebc8cd1 refcount=5
00000020:00000001:23.0:1773851900.190136:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637063872027648 : -107009837523968 : ffff9eacd4a59c00)
00000020:00000001:23.0:1773851900.190137:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637063872027648 : -107009837523968 : ffff9eacd4a59c00)
00000100:00000001:23.0:1773851900.190137:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.190138:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851900.190139:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851900.190139:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.190140:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851900.190140:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851900.190141:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851900.190141:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.190142:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.190142:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.190143:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851900.190144:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851900.190144:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851900.190144:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851900.190145:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18978@kfi7, seq: 335333156
00000100:00000040:23.0:1773851900.190145:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008ebc8cd1 : new rpc_count 1
00000100:00000001:20.0:1773851900.190145:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.190146:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132523089152 : -106941186462464 : ffff9ebcd091ad00)
00000100:00000040:23.0:1773851900.190146:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3f3d1b1 x1859598589820160/t0(0) o17->b14b54a5-4b35-442e-8f31-00b32ef73b8d@18978@kfi7:627/0 lens 456/0 e 0 to 0 dl 1773851987 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1675-0'
00000100:00000001:20.0:1773851900.190146:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.190149:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.190149:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851900.190150:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3f3d1b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b14b54a5-4b35-442e-8f31-00b32ef73b8d+5:39593:x1859598589820160:12345-18978@kfi7:17:default-tuolumne1675-0
00000100:00000200:23.0:1773851900.190151:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598589820160
00000020:00000001:23.0:1773851900.190151:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851900.190152:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851900.190153:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.190153:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851900.190153:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:23.0:1773851900.190154:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851900.190154:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598589820160, found 0 last_xid 1859598589820159
00000020:00000001:23.0:1773851900.190155:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851900.190155:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851900.190156:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851900.190156:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:23.0:1773851900.190156:0:61145:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:23.0:1773851900.190157:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851900.190157:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851900.190158:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000da88e43c.
02000000:00000001:23.0:1773851900.190159:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.190159:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.190160:0:61145:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:23.0:1773851900.190160:0:61145:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:23.0:1773851900.190161:0:61145:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:23.0:1773851900.190163:0:61145:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.190163:0:61145:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:23.0:1773851900.190164:0:61145:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli b14b54a5-4b35-442e-8f31-00b32ef73b8d/000000008ebc8cd1 free: 126633370845184 avail: 126633368748032
00000020:00000001:23.0:1773851900.190165:0:61145:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:23.0:1773851900.190165:0:61145:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli b14b54a5-4b35-442e-8f31-00b32ef73b8d/000000008ebc8cd1 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:23.0:1773851900.190167:0:61145:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:23.0:1773851900.190167:0:61145:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:23.0:1773851900.190168:0:61145:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli b14b54a5-4b35-442e-8f31-00b32ef73b8d/000000008ebc8cd1 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:23.0:1773851900.190169:0:61145:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:23.0:1773851900.190169:0:61145:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:23.0:1773851900.190170:0:61145:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851900.190170:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096696348, transno 0, xid 1859598589820160
00010000:00000001:23.0:1773851900.190171:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851900.190172:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3f3d1b1 x1859598589820160/t0(0) o17->b14b54a5-4b35-442e-8f31-00b32ef73b8d@18978@kfi7:627/0 lens 456/432 e 0 to 0 dl 1773851987 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1675-0'
00010000:00000001:23.0:1773851900.190174:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851900.190174:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851900.190175:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=133 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851900.190176:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851900.190176:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000050541258 refcount 3 to 18978@kfi7
00000100:00000001:23.0:1773851900.190177:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402095360 : -107139307456256 : ffff9e8eafa33900)
02000000:00000001:23.0:1773851900.190178:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851900.190178:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.190179:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851900.190179:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18978@kfi7
00000400:00000010:23.0:1773851900.190180:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d878015d.
00000100:00000200:23.0:1773851900.190181:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859598589820160, offset 224
00000400:00000200:23.0:1773851900.190182:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18978@kfi7
00000400:00000200:23.0:1773851900.190182:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.190183:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 1
00000400:00000200:23.0:1773851900.190184:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000400:00000200:23.0:1773851900.190185:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 3
00000400:00000200:23.0:1773851900.190186:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18978@kfi7 local destination
00000400:00000200:23.0:1773851900.190187:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770342:8770342:1024:4294967295] 18978@kfi7 LPNI seq info [21953451:21953451:16:4294967295]
00000400:00000200:23.0:1773851900.190189:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000400:00000200:23.0:1773851900.190189:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18978@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.190191:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18978@kfi7(18978@kfi7:18978@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851900.190193:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 3
00000800:00000200:23.0:1773851900.190194:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851900.190195:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:23.0:1773851900.190197:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851900.190198:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x963 Using peer 18978@kfi7(0x963)
00000800:00000200:23.0:1773851900.190203:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000003a94a903: Posted send of 532 bytes to peer 0x963: rc=0
00000800:00000200:23.0:1773851900.190204:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x963 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851900.190206:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.190207:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000050541258 refcount 2 to 18978@kfi7
00010000:00000001:23.0:1773851900.190207:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851900.190208:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.190208:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851900.190209:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3f3d1b1 x1859598589820160/t0(0) o17->b14b54a5-4b35-442e-8f31-00b32ef73b8d@18978@kfi7:627/0 lens 456/432 e 0 to 0 dl 1773851987 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1675-0'
00000100:00100000:23.0:1773851900.190212:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3f3d1b1 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:b14b54a5-4b35-442e-8f31-00b32ef73b8d+5:39593:x1859598589820160:12345-18978@kfi7:17:default-tuolumne1675-0 Request processed in 62us (86us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851900.190214:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18978@kfi7, seq: 335333156
00000100:00000040:23.0:1773851900.190214:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008ebc8cd1 : new rpc_count 0
00000100:00000001:23.0:1773851900.190215:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851900.190215:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851900.190216:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.190216:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000800:00000200:21.0:1773851900.190216:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x963 TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851900.190217:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000020:00000040:23.0:1773851900.190218:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000008ebc8cd1 : new refcount 4
00000100:00000001:23.0:1773851900.190218:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851900.190218:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.190219:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18978@kfi7: PUT: OK
00000400:00000200:21.0:1773851900.190219:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d878015d
00000400:00000010:21.0:1773851900.190219:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d878015d.
00000100:00000001:21.0:1773851900.190220:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851900.190220:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851900.190221:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000047c180e nid 18978@kfi7 refs 2
00000800:00000200:21.0:1773851900.190222:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003a94a903: 2069@kfi7:5 -> 18978@kfi7(00000000d5891e79):0x0 lsk 2404 rsk 4 tsk 0 trmk 0 tmk 0 trr 5 tta 0x963 Transaction freed
00000800:00000200:21.0:1773851900.212981:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851900.212982:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851900.212984:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851900.212987:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851900.212990:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.212992:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16496@kfi7 : PUT - for me
00000400:00000200:21.0:1773851900.212994:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.212996:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 1
00000400:00000200:21.0:1773851900.212999:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.213000:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000400:00000200:21.0:1773851900.213001:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 3
00000400:00000200:21.0:1773851900.213003:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16561@kfi7 to cpt 4
00000400:00000200:21.0:1773851900.213004:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16561@kfi7 of length 224 into portal 12 MB=0x69b44eb719f40
00000400:00000200:21.0:1773851900.213006:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16561@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 67344
00000800:00000200:21.0:1773851900.213009:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851900.213014:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.213016:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16496@kfi7: PUT: OK
00000100:00000001:21.0:1773851900.213017:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851900.213018:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851900.213019:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000059cdd635.
00000100:00000040:21.0:1773851900.213020:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000059cdd635 x1859570170437440 msgsize 224
00000100:00100000:21.0:1773851900.213023:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16561@kfi7 (source: 12345-16496@kfi7)
00000100:00000001:21.0:1773851900.213024:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851900.213026:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000100:00000001:23.0:1773851900.213027:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851900.213028:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851900.213028:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851900.213029:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851900.213030:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851900.213031:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851900.213032:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859570170437440
00000020:00000001:23.0:1773851900.213033:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851900.213034:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07d95ea24e6
00000020:00000001:23.0:1773851900.213035:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851900.213040:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000034923f78 refcount=5
00000020:00000001:23.0:1773851900.213041:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139374468096 : -106934335083520 : ffff9ebe68f16c00)
00000020:00000001:23.0:1773851900.213042:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139374468096 : -106934335083520 : ffff9ebe68f16c00)
00000100:00000001:23.0:1773851900.213044:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.213045:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851900.213046:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851900.213047:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.213048:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851900.213050:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851900.213051:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851900.213051:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.213053:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851900.213054:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851900.213055:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.213056:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.213058:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851900.213059:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851900.213059:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851900.213060:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851900.213061:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16561@kfi7, seq: 1998080
00000100:00000040:23.0:1773851900.213062:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000034923f78 : new rpc_count 1
00000100:00000001:20.0:1773851900.213062:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.213063:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132523096064 : -106941186455552 : ffff9ebcd091c800)
00000100:00000001:20.0:1773851900.213063:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.213065:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000059cdd635 x1859570170437440/t0(0) o400->d3aa33fc-9573-49b1-a536-a003b591b72e@16561@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1518-0'
00000100:00000001:23.0:1773851900.213071:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.213072:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851900.213073:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000059cdd635 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d3aa33fc-9573-49b1-a536-a003b591b72e+5:39824:x1859570170437440:12345-16561@kfi7:400:default-tuolumne1518-0
00000100:00000200:23.0:1773851900.213076:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859570170437440
00000020:00000001:23.0:1773851900.213077:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851900.213078:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851900.213079:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.213080:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851900.213080:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851900.213082:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851900.213083:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859570170437440, found 0 last_xid 1859570170437439
00000020:00000001:23.0:1773851900.213084:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851900.213085:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851900.213086:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851900.213087:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.213088:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851900.213089:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851900.213089:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851900.213090:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003d82e7c0.
02000000:00000001:23.0:1773851900.213092:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.213093:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.213094:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851900.213095:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044165082, transno 0, xid 1859570170437440
00010000:00000001:23.0:1773851900.213096:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851900.213098:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000059cdd635 x1859570170437440/t0(0) o400->d3aa33fc-9573-49b1-a536-a003b591b72e@16561@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1518-0'
00010000:00000001:23.0:1773851900.213102:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851900.213103:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851900.213104:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=133 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851900.213106:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851900.213107:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e065949f refcount 3 to 16561@kfi7
00000100:00000001:23.0:1773851900.213109:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958016 : -107156125593600 : ffff9e8ac532d000)
02000000:00000001:23.0:1773851900.213110:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851900.213111:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.213112:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851900.213113:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16496@kfi7
00000400:00000010:23.0:1773851900.213114:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f219ead6.
00000100:00000200:23.0:1773851900.213115:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859570170437440, offset 224
00000400:00000200:23.0:1773851900.213118:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16496@kfi7
00000400:00000200:23.0:1773851900.213119:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.213121:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 1
00000400:00000200:23.0:1773851900.213123:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000400:00000200:23.0:1773851900.213125:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 3
00000400:00000200:23.0:1773851900.213127:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16496@kfi7 local destination
00000400:00000200:23.0:1773851900.213129:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770343:8770343:1024:4294967295] 16496@kfi7 LPNI seq info [8007780:8007780:16:4294967295]
00000400:00000200:23.0:1773851900.213131:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000400:00000200:23.0:1773851900.213133:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16496@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.213137:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16496@kfi7(16496@kfi7:16496@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851900.213139:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 3
00000800:00000200:23.0:1773851900.213141:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851900.213143:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851900.213147:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851900.213151:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ee Using peer 16496@kfi7(0x1000000000011ee)
00000800:00000200:23.0:1773851900.213157:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006caa26ea: Posted send of 324 bytes to peer 0x1000000000011ee: rc=0
00000800:00000200:23.0:1773851900.213159:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ee TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851900.213163:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.213164:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e065949f refcount 2 to 16561@kfi7
00010000:00000001:23.0:1773851900.213165:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851900.213166:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.213167:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851900.213168:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000059cdd635 x1859570170437440/t0(0) o400->d3aa33fc-9573-49b1-a536-a003b591b72e@16561@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1518-0'
00000800:00000200:21.0:1773851900.213173:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ee TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851900.213174:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000059cdd635 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:d3aa33fc-9573-49b1-a536-a003b591b72e+5:39824:x1859570170437440:12345-16561@kfi7:400:default-tuolumne1518-0 Request processed in 102us (152us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851900.213176:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851900.213178:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16561@kfi7, seq: 1998080
00000400:00000200:21.0:1773851900.213178:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16496@kfi7: PUT: OK
00000400:00000200:21.0:1773851900.213179:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f219ead6
00000100:00000040:23.0:1773851900.213180:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000034923f78 : new rpc_count 0
00000400:00000010:21.0:1773851900.213180:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f219ead6.
00000100:00000001:23.0:1773851900.213181:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851900.213181:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851900.213181:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:23.0:1773851900.213182:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851900.213183:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000400:00000200:21.0:1773851900.213183:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000363dcc98 nid 16496@kfi7 refs 2
00000020:00000010:23.0:1773851900.213184:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851900.213185:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000800:00000200:21.0:1773851900.213185:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006caa26ea: 2054@kfi7:5 -> 16496@kfi7(000000001ea70777):0x0 lsk 4591 rsk 15 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000011ee Transaction freed
00000020:00000040:23.0:1773851900.213186:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000034923f78 : new refcount 4
00000100:00000001:23.0:1773851900.213188:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851900.232941:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851900.232943:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851900.232945:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851900.232949:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851900.232953:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17914@kfi7 to cpt 2
00000400:00000200:9.0:1773851900.232955:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17914@kfi7 : PUT - for me
00000400:00000200:9.0:1773851900.232957:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17914@kfi7 to cpt 2
00000400:00000200:9.0:1773851900.232958:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fe2585e nid 17914@kfi7 refs 1
00000400:00000200:9.0:1773851900.232961:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17914@kfi7 to cpt 2
00000400:00000200:9.0:1773851900.232962:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fe2585e nid 17914@kfi7 refs 2
00000400:00000200:9.0:1773851900.232964:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009fe2585e nid 17914@kfi7 refs 3
00000400:00000200:9.0:1773851900.232965:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17915@kfi7 to cpt 5
00000400:00000200:9.0:1773851900.232967:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17915@kfi7 of length 440 into portal 12 MB=0x699de8729ecc0
00000400:00000200:9.0:1773851900.232969:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17915@kfi7 of length 440/440 into md 0x78146ce49 [64] + 165080
00000800:00000200:9.0:1773851900.232973:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851900.232976:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851900.232978:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17914@kfi7: PUT: OK
00000100:00000001:9.0:1773851900.232979:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851900.232980:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851900.232982:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c3882543.
00000100:00000040:9.0:1773851900.232983:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c3882543 x1858030889725120 msgsize 440
00000100:00100000:9.0:1773851900.232986:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17915@kfi7 (source: 12345-17914@kfi7)
00000100:00000001:9.0:1773851900.232988:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851900.232989:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009fe2585e nid 17914@kfi7 refs 2
00000100:00000001:11.0:1773851900.232991:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851900.232992:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851900.232992:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851900.232992:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851900.232993:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851900.232995:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851900.232996:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030889725120
00000020:00000001:11.0:1773851900.232997:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851900.232998:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911dc
00000020:00000001:11.0:1773851900.233000:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851900.233004:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000d388b6c refcount=6
00000020:00000001:11.0:1773851900.233005:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240534016 : -107152469017600 : ffff9e8b9f25bc00)
00000020:00000001:11.0:1773851900.233006:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240534016 : -107152469017600 : ffff9e8b9f25bc00)
00000100:00000001:11.0:1773851900.233008:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851900.233010:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851900.233011:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ef653fd2.
00000020:00000010:11.0:1773851900.233013:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851900.233014:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851900.233016:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851900.233016:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851900.233017:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851900.233019:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851900.233021:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851900.233023:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851900.233024:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851900.233025:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851900.233026:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17915@kfi7, seq: 406391018
00000100:00000001:8.0:1773851900.233026:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851900.233028:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000d388b6c : new rpc_count 1
00000100:00000001:8.0:1773851900.233028:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851900.233029:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498334080 : -106953211217536 : ffff9eba03d67980)
00000100:00000001:8.0:1773851900.233029:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851900.233031:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c3882543 x1858030889725120/t0(0) o41->035605b1-092d-4667-bee0-f2011802534f@17915@kfi7:627/0 lens 440/0 e 0 to 0 dl 1773851987 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne238-0'
00000100:00000001:11.0:1773851900.233035:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851900.233036:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851900.233038:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c3882543 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:035605b1-092d-4667-bee0-f2011802534f+6:111774:x1858030889725120:12345-17915@kfi7:41:default-tuolumne238-0
00000100:00000200:11.0:1773851900.233040:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030889725120
00000020:00000001:11.0:1773851900.233041:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851900.233042:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851900.233043:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851900.233044:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851900.233045:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:11.0:1773851900.233046:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851900.233047:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030889725120, found 0 last_xid 1858030889725119
00000020:00000001:11.0:1773851900.233049:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851900.233050:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851900.233050:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851900.233051:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851900.233053:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851900.233053:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851900.233055:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 0000000075d3a0de.
02000000:00000001:11.0:1773851900.233056:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851900.233057:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233058:0:60829:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:11.0:1773851900.233059:0:60829:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:11.0:1773851900.233060:0:60829:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233063:0:60829:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:11.0:1773851900.233064:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851900.233067:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233070:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851900.233071:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233073:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851900.233073:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233075:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851900.233075:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233077:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851900.233077:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233079:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:11.0:1773851900.233080:0:60829:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233082:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233082:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500131328 free, 351498052608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097648 files, 343261847 free files
00000004:00000001:11.0:1773851900.233085:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233086:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233086:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504315392 free, 351502167040 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056103 files, 343265933 free files
00000004:00000001:11.0:1773851900.233088:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233089:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233090:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690105856 free, 351687715840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231114 files, 343447369 free files
00000004:00000001:11.0:1773851900.233092:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233093:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233094:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382714368 free, 351380626432 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978599 files, 343147182 free files
00000004:00000001:11.0:1773851900.233096:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233097:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233098:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958917632 free, 350956861440 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563842 files, 342733318 free files
00000004:00000001:11.0:1773851900.233100:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233101:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233101:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351166976 free, 351348423680 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372083908 files, 343116374 free files
00000004:00000001:11.0:1773851900.233103:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233105:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233105:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482217472 free, 351481148416 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097101 files, 343244353 free files
00000004:00000001:11.0:1773851900.233107:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233108:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233109:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449320448 free, 351446784000 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160878 files, 343212227 free files
00000004:00000001:11.0:1773851900.233111:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233112:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233112:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353588736 free, 351351202816 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083184 files, 343118739 free files
00000004:00000001:11.0:1773851900.233114:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233115:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233116:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388980224 free, 351386247168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019003 files, 343153301 free files
00000004:00000001:11.0:1773851900.233118:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233119:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233120:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406502912 free, 351404106752 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127127 files, 343170413 free files
00000004:00000001:11.0:1773851900.233121:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233122:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233123:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378967552 free, 351376030720 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372018934 files, 343143523 free files
00000004:00000001:11.0:1773851900.233125:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233126:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233127:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351465986048 free, 351462875136 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062748 files, 343228502 free files
00000004:00000001:11.0:1773851900.233129:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233130:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233130:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489068032 free, 351486036992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066743 files, 343251043 free files
00000004:00000001:11.0:1773851900.233132:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233134:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233134:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492784128 free, 351490364416 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078000 files, 343254672 free files
00000004:00000001:11.0:1773851900.233136:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233137:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233138:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524092928 free, 351521376256 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113793 files, 343285247 free files
00000004:00000001:11.0:1773851900.233140:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233141:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233142:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510653952 free, 351508038656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095714 files, 343272123 free files
00000004:00000001:11.0:1773851900.233144:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233145:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233145:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541509120 free, 351539469312 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136560 files, 343302255 free files
00000004:00000001:11.0:1773851900.233147:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233148:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233149:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470702592 free, 351461712896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064442 files, 343233108 free files
00000004:00000001:11.0:1773851900.233150:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233152:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233152:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666665472 free, 351645520896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237776 files, 343424478 free files
00000004:00000001:11.0:1773851900.233154:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233155:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233155:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545833472 free, 351536191488 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116380 files, 343306478 free files
00000004:00000001:11.0:1773851900.233157:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233158:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233160:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351604012032 free, 351601751040 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190421 files, 343363293 free files
00000004:00000001:11.0:1773851900.233162:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233163:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233163:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615833088 free, 351613210624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043332 files, 343374837 free files
00000004:00000001:11.0:1773851900.233165:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233166:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233167:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420200960 free, 351417826304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008833 files, 343183790 free files
00000004:00000001:11.0:1773851900.233168:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233169:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233170:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409081344 free, 351407014912 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011194 files, 343172931 free files
00000004:00000001:11.0:1773851900.233172:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233173:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233174:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480017920 free, 351478758400 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073028 files, 343242205 free files
00000004:00000001:11.0:1773851900.233175:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233177:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233177:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593663488 free, 351576858624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189905 files, 343353187 free files
00000004:00000001:11.0:1773851900.233179:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233180:0:60829:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:11.0:1773851900.233181:0:60829:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464032256 free, 351458236416 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064693 files, 343226594 free files
00000004:00000001:11.0:1773851900.233183:0:60829:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233184:0:60829:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233185:0:60829:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:11.0:1773851900.233186:0:60829:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 395575296 granted 1839581985855 pending 396361728 free 40309313805221888 avail 40308837487476736
00000004:00000020:11.0:1773851900.233188:0:60829:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841141065728 free, 9841024583872 avail; 10969025165 objects: 9610489322 free; state 100
00000020:00000001:11.0:1773851900.233191:0:60829:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:11.0:1773851900.233195:0:60829:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851900.233196:0:60829:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851900.233197:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768280, transno 0, xid 1858030889725120
00010000:00000001:11.0:1773851900.233200:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851900.233201:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c3882543 x1858030889725120/t0(0) o41->035605b1-092d-4667-bee0-f2011802534f@17915@kfi7:627/0 lens 440/368 e 0 to 0 dl 1773851987 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne238-0'
00010000:00000001:11.0:1773851900.233205:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851900.233206:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851900.233207:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=133 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851900.233208:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851900.233210:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e6e7b546 refcount 5 to 17915@kfi7
00000100:00000001:11.0:1773851900.233211:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024416 : -107156745527200 : ffff9e8aa03f6060)
02000000:00000001:11.0:1773851900.233212:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851900.233213:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851900.233214:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851900.233216:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17914@kfi7
00000400:00000010:11.0:1773851900.233217:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008f5867f4.
00000100:00000200:11.0:1773851900.233218:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030889725120, offset 224
00000400:00000200:11.0:1773851900.233220:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17914@kfi7
00000400:00000200:11.0:1773851900.233222:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17914@kfi7 to cpt 2
00000400:00000200:11.0:1773851900.233223:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fe2585e nid 17914@kfi7 refs 1
00000400:00000200:11.0:1773851900.233225:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009fe2585e nid 17914@kfi7 refs 2
00000400:00000200:11.0:1773851900.233227:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009fe2585e nid 17914@kfi7 refs 3
00000400:00000200:11.0:1773851900.233229:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17914@kfi7 local destination
00000400:00000200:11.0:1773851900.233231:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770344:8770344:1024:4294967295] 17914@kfi7 LPNI seq info [28029:28029:16:4294967295]
00000400:00000200:11.0:1773851900.233233:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009fe2585e nid 17914@kfi7 refs 2
00000400:00000200:11.0:1773851900.233235:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17914@kfi7 to cpt 2
00000400:00000200:11.0:1773851900.233238:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17914@kfi7(17914@kfi7:17914@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851900.233240:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009fe2585e nid 17914@kfi7 refs 3
00000800:00000200:11.0:1773851900.233243:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851900.233244:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:11.0:1773851900.233248:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851900.233252:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000349 Using peer 17914@kfi7(0x100000000000349)
00000800:00000200:11.0:1773851900.233258:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 468 bytes to peer 0x100000000000349: rc=0
00000800:00000200:11.0:1773851900.233261:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000349 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851900.233264:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851900.233265:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e6e7b546 refcount 4 to 17915@kfi7
00010000:00000001:11.0:1773851900.233266:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851900.233267:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851900.233268:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851900.233269:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c3882543 x1858030889725120/t0(0) o41->035605b1-092d-4667-bee0-f2011802534f@17915@kfi7:627/0 lens 440/368 e 0 to 0 dl 1773851987 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne238-0'
00000100:00100000:11.0:1773851900.233275:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c3882543 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:035605b1-092d-4667-bee0-f2011802534f+6:111774:x1858030889725120:12345-17915@kfi7:41:default-tuolumne238-0 Request processed in 238us (290us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851900.233276:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000349 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851900.233278:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851900.233279:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17915@kfi7, seq: 406391018
00000100:00000040:11.0:1773851900.233280:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000d388b6c : new rpc_count 0
00000400:00000200:9.0:1773851900.233280:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17914@kfi7: PUT: OK
00000100:00000001:11.0:1773851900.233281:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851900.233281:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008f5867f4
00000100:00000001:11.0:1773851900.233282:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:9.0:1773851900.233282:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008f5867f4.
00000020:00000010:11.0:1773851900.233283:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000100:00000001:9.0:1773851900.233283:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851900.233283:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851900.233284:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000200:9.0:1773851900.233284:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009fe2585e nid 17914@kfi7 refs 2
00000020:00000010:11.0:1773851900.233286:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ef653fd2.
00000020:00000040:11.0:1773851900.233287:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000000d388b6c : new refcount 5
00000800:00000200:9.0:1773851900.233287:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2054@kfi7:2 -> 17914@kfi7(0000000016ab0d6e):0x0 lsk 842 rsk 89 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000349 Transaction freed
00000100:00000001:11.0:1773851900.233288:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851900.233732:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851900.233733:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:30.0:1773851900.233734:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000032655417.
00000004:00000001:5.0:1773851900.233734:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:7.0:1773851900.233735:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:4.0:1773851900.233735:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:30.0:1773851900.233736:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000004:00000020:7.0:1773851900.233736:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:5.0:1773851900.233736:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:4.0:1773851900.233736:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851900.233737:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000067479cf9.
00000100:00000010:5.0:1773851900.233737:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000051fc656a.
00000100:00000010:4.0:1773851900.233737:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e7d02143.
00000100:00000001:30.0:1773851900.233738:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:7.0:1773851900.233738:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000040:5.0:1773851900.233738:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
02000000:00000001:30.0:1773851900.233739:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:4.0:1773851900.233739:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:7.0:1773851900.233740:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851900.233740:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:4.0:1773851900.233740:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:30.0:1773851900.233741:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851900.233741:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851900.233741:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851900.233741:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851900.233742:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851900.233742:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851900.233742:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851900.233743:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a8444578.
02000000:00000010:7.0:1773851900.233744:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000daca50c1.
02000000:00000010:5.0:1773851900.233744:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000ef164abb.
02000000:00000010:4.0:1773851900.233744:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d7ad89bf.
00000100:00000001:30.0:1773851900.233745:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.233745:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233745:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233745:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.233747:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851900.233747:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851900.233747:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851900.233747:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851900.233748:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233748:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.233750:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851900.233750:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000067479cf9] to pc [ptlrpcd_01_02+2]  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851900.233750:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000051fc656a] to pc [ptlrpcd_01_01+1]  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851900.233750:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851900.233751:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000e7d02143] to pc [ptlrpcd_01_03+3]  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851900.233753:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000032655417] to pc [ptlrpcd_07_03+3]  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851900.233759:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851900.233759:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:4.0:1773851900.233759:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.233761:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:5.0:1773851900.233761:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000009c9623c6.
00080000:00000001:30.0:1773851900.233762:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:6.0:1773851900.233762:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851900.233762:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637153379589120 : -106920329962496 : ffff9ec1abb69c00)
00000100:00000001:4.0:1773851900.233762:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851900.233762:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851900.233763:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:5.0:1773851900.233763:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851900.233763:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:28.0:1773851900.233764:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851900.233765:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851900.233765:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851900.233765:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851900.233765:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851900.233765:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000010:30.0:1773851900.233766:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004a440602.
00000100:00000001:29.0:1773851900.233766:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851900.233766:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00100000:7.0:1773851900.233766:0:41064:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [1->0]
00000100:00000040:6.0:1773851900.233766:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:5.0:1773851900.233766:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00080000:00000001:30.0:1773851900.233767:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130494937088 : -106943214614528 : ffff9ebc57ae8800)
00000004:00000010:5.0:1773851900.233767:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a191f4dd.
00000100:00000040:28.0:1773851900.233768:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851900.233768:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00080000:5.0:1773851900.233768:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614174687043819ns, next at 614175687042206ns, rc = 0
00080000:00000001:30.0:1773851900.233769:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851900.233769:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851900.233769:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851900.233770:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:5.0:1773851900.233770:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851900.233770:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851900.233771:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.233771:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851900.233771:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851900.233771:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851900.233772:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851900.233772:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:5.0:1773851900.233772:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851900.233772:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:30.0:1773851900.233773:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00000001:7.0:1773851900.233773:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851900.233773:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:30.0:1773851900.233774:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000007c1bdb00.
00000100:00000001:28.0:1773851900.233774:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00100000:4.0:1773851900.233774:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000067479cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051941760:7@kfi7:41:default-yuba2-0
00000100:00000001:28.0:1773851900.233775:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851900.233775:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:6.0:1773851900.233775:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:30.0:1773851900.233776:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614174687051333ns, next at 614175687049239ns, rc = 0
02000000:00000001:6.0:1773851900.233776:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233776:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:28.0:1773851900.233777:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851900.233777:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851900.233777:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851900.233778:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:28.0:1773851900.233778:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851900.233778:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000e7d02143 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051941888:2098@kfi7:41:default-yuba2-0
02000000:00000001:4.0:1773851900.233778:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851900.233779:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d5f06b74.
00080000:00000001:30.0:1773851900.233780:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851900.233780:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000032655417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051941696:2080@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851900.233780:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851900.233780:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851900.233780:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851900.233781:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.233781:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233781:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851900.233782:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851900.233782:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851900.233782:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233782:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851900.233782:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
02000000:00000001:28.0:1773851900.233783:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851900.233783:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000400:00000010:4.0:1773851900.233783:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
02000000:00000001:28.0:1773851900.233784:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851900.233784:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851900.233784:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:28.0:1773851900.233785:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:4.0:1773851900.233785:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098ca3a41.
02000000:00000010:28.0:1773851900.233786:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b825c1cb.
00000100:00100000:7.0:1773851900.233786:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000051fc656a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051941824:3@kfi7:13:default-yuba2-0
02000000:00000010:6.0:1773851900.233786:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008355fee1.
00000100:00000200:4.0:1773851900.233786:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941760, portal 4
02000000:00000001:6.0:1773851900.233787:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851900.233788:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.233788:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:4.0:1773851900.233788:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851900.233788:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309148928 : -106994400402688 : ffff9eb06cc56300)
02000000:00000001:7.0:1773851900.233789:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:28.0:1773851900.233790:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
02000000:00000001:7.0:1773851900.233790:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851900.233790:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000040:4.0:1773851900.233790:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851900.233791:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000400:00000010:6.0:1773851900.233791:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
02000000:00000001:7.0:1773851900.233792:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:28.0:1773851900.233793:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032756c42.
02000000:00000010:7.0:1773851900.233793:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000023aa93ab.
00000400:00000010:6.0:1773851900.233793:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025756a50.
02000000:00000001:7.0:1773851900.233794:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233794:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:28.0:1773851900.233795:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941696, portal 4
00000100:00000200:6.0:1773851900.233795:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941888, portal 4
00000400:00000200:7.0:1773851900.233796:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:6.0:1773851900.233796:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:4.0:1773851900.233796:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000400:00000010:4.0:1773851900.233796:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b96d8a3.
00000100:00000001:28.0:1773851900.233797:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:7.0:1773851900.233797:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000100:00000001:6.0:1773851900.233797:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528693760 : -106978180857856 : ffff9eb433880000)
00000100:00000200:4.0:1773851900.233797:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051941760, offset 0
00000400:00000010:7.0:1773851900.233798:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000100:00000001:28.0:1773851900.233799:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411267584 : -106960298284032 : ffff9eb85d6a6c00)
00000400:00000200:4.0:1773851900.233799:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000100:00000200:7.0:1773851900.233800:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941824, portal 4
00000100:00000040:6.0:1773851900.233800:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851900.233801:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000040:28.0:1773851900.233802:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851900.233802:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851900.233803:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097484331136 : -106976225220480 : ffff9eb4a818a880)
00000400:00000200:4.0:1773851900.233803:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000100:00000040:7.0:1773851900.233805:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:4.0:1773851900.233805:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:6.0:1773851900.233806:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:4.0:1773851900.233806:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:28.0:1773851900.233807:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851900.233807:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000200:4.0:1773851900.233808:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000100:00000040:28.0:1773851900.233809:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000010:6.0:1773851900.233809:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004a88ec3c.
00000400:00000010:28.0:1773851900.233810:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d36e974.
00000100:00000001:7.0:1773851900.233810:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:6.0:1773851900.233810:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051941888, offset 0
00000100:00000200:28.0:1773851900.233811:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941696, offset 0
00000400:00000200:4.0:1773851900.233811:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770342, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770344, p:4294967295, g:4294967295, h:1000]
00000100:00000040:7.0:1773851900.233812:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000010:7.0:1773851900.233813:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000068cc9555.
00000400:00000200:6.0:1773851900.233813:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:28.0:1773851900.233814:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:4.0:1773851900.233814:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000200:7.0:1773851900.233815:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941824, offset 0
00000400:00000200:28.0:1773851900.233816:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:4.0:1773851900.233816:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851900.233817:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851900.233818:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:7.0:1773851900.233818:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000400:00000200:4.0:1773851900.233819:0:41066:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340075, 17340074]
00000400:00000200:28.0:1773851900.233820:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:28.0:1773851900.233822:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:4.0:1773851900.233822:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000400:00000200:4.0:1773851900.233823:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770345:8770345:1024:4294967295] 7@kfi7 LPNI seq info [17340076:17340076:16:4294967295]
00000400:00000200:28.0:1773851900.233824:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:4.0:1773851900.233826:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:28.0:1773851900.233827:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770345, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770344, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851900.233827:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:6.0:1773851900.233829:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:28.0:1773851900.233831:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851900.233831:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:4.0:1773851900.233831:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851900.233833:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851900.233833:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:28.0:1773851900.233834:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:6.0:1773851900.233834:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:28.0:1773851900.233836:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770346:8770346:1024:4294967295] 2080@kfi7 LPNI seq info [5404398:5404398:16:4294967295]
00000400:00000200:6.0:1773851900.233836:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:4.0:1773851900.233836:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:6.0:1773851900.233838:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000800:00000200:4.0:1773851900.233838:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851900.233839:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:28.0:1773851900.233841:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:6.0:1773851900.233841:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770345, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770346, p:4294967295, g:4294967295, h:1000]
00000800:00000200:4.0:1773851900.233842:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:28.0:1773851900.233845:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851900.233845:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851900.233846:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:4.0:1773851900.233846:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Using peer 7@kfi7(0x11b1)
00000400:00000200:28.0:1773851900.233847:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:6.0:1773851900.233848:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851900.233849:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346215, 20346216]
00000800:00000200:4.0:1773851900.233850:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x11b1: rc=0
00000800:00000200:28.0:1773851900.233851:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:6.0:1773851900.233852:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2098@kfi7
00000800:00000200:28.0:1773851900.233853:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851900.233853:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851900.233854:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770347:8770347:1023:4294967295] 2098@kfi7 LPNI seq info [20346217:20346217:16:4294967295]
00000100:00000001:4.0:1773851900.233856:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851900.233857:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:4.0:1773851900.233857:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:28.0:1773851900.233858:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851900.233859:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:4.0:1773851900.233859:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233860:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:28.0:1773851900.233863:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000400:00000200:6.0:1773851900.233863:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000100:00000001:4.0:1773851900.233863:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851900.233865:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000100:00000001:4.0:1773851900.233865:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851900.233866:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:7.0:1773851900.233867:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:4.0:1773851900.233867:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851900.233868:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:28.0:1773851900.233869:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009d1ae726: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000400:00000200:7.0:1773851900.233869:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000800:00000200:6.0:1773851900.233869:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:7.0:1773851900.233871:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:6.0:1773851900.233871:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851900.233873:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:7.0:1773851900.233873:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:7.0:1773851900.233875:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000800:00000200:6.0:1773851900.233875:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851900.233875:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851900.233875:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233876:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851900.233877:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770345, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8770347, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851900.233878:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851900.233879:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851900.233880:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:6.0:1773851900.233880:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Using peer 2098@kfi7(0x2000000000004bc)
00000400:00000200:5.0:1773851900.233880:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000100:00000001:28.0:1773851900.233881:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851900.233881:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:5.0:1773851900.233881:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b96d8a3
00000400:00000200:7.0:1773851900.233882:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000010:5.0:1773851900.233882:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b96d8a3.
00000100:00000001:28.0:1773851900.233883:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233883:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:28.0:1773851900.233884:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:7.0:1773851900.233884:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000100:00000200:5.0:1773851900.233884:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851900.233885:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770348:8770348:1023:4294967295] 3@kfi7 LPNI seq info [5406227:5406227:16:4294967295]
00000100:00000001:28.0:1773851900.233886:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851900.233887:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:6.0:1773851900.233887:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 324 bytes to peer 0x2000000000004bc: rc=0
00000100:00000001:28.0:1773851900.233888:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851900.233889:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:6.0:1773851900.233889:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:7.0:1773851900.233893:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:6.0:1773851900.233893:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233893:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851900.233894:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851900.233895:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000100:00000001:6.0:1773851900.233895:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851900.233896:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.233896:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851900.233898:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851900.233898:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.233898:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233898:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851900.233899:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000100:00000001:6.0:1773851900.233899:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851900.233899:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851900.233902:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851900.233902:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000100:00000001:6.0:1773851900.233902:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:29.0:1773851900.233903:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000100:00000001:6.0:1773851900.233903:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851900.233904:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d36e974
00000400:00000010:29.0:1773851900.233904:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d36e974.
00000100:00000001:6.0:1773851900.233904:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851900.233905:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:7.0:1773851900.233905:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:6.0:1773851900.233905:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:29.0:1773851900.233906:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.233906:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851900.233907:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:6.0:1773851900.233907:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851900.233907:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:29.0:1773851900.233909:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851900.233910:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851900.233910:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x11b1 Transaction freed
00000800:00000200:7.0:1773851900.233912:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:29.0:1773851900.233913:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851900.233913:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:13.0:1773851900.233913:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:6.0:1773851900.233913:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851900.233914:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:13.0:1773851900.233914:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851900.233916:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d1ae726: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Transaction freed
00000800:00000200:13.0:1773851900.233916:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:7.0:1773851900.233916:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Using peer 3@kfi7(0x3b9)
00000400:00000200:6.0:1773851900.233916:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851900.233918:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000800:00000200:13.0:1773851900.233919:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851900.233920:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004a88ec3c
00000800:00000200:9.0:1773851900.233921:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:7.0:1773851900.233921:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000071e56989: Posted send of 324 bytes to peer 0x3b9: rc=0
00000400:00000010:6.0:1773851900.233921:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004a88ec3c.
00000400:00000200:13.0:1773851900.233922:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:9.0:1773851900.233922:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:6.0:1773851900.233922:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:7.0:1773851900.233923:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000200:6.0:1773851900.233923:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851900.233924:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:13.0:1773851900.233925:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:9.0:1773851900.233925:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851900.233926:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851900.233927:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000100:00000001:7.0:1773851900.233927:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851900.233927:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.233927:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:13.0:1773851900.233928:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:7.0:1773851900.233928:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851900.233928:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851900.233929:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000800:00000200:9.0:1773851900.233929:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:7.0:1773851900.233929:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851900.233930:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:13.0:1773851900.233931:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:6.0:1773851900.233931:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851900.233932:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:6.0:1773851900.233932:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:13.0:1773851900.233933:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6b80
00000400:00000200:9.0:1773851900.233933:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000400:00000200:6.0:1773851900.233933:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:13.0:1773851900.233934:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:9.0:1773851900.233934:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851900.233935:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000800:00000200:6.0:1773851900.233935:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007b4c751b: 2054@kfi7:1 -> 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2000000000004bc Transaction freed
00000400:00000200:13.0:1773851900.233936:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f748d [1] + 224
00000400:00000200:9.0:1773851900.233936:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851900.233937:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:13.0:1773851900.233938:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851900.233938:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000800:00000200:6.0:1773851900.233938:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851900.233939:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:5.0:1773851900.233939:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:13.0:1773851900.233940:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851900.233940:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6b40
00000400:00000200:6.0:1773851900.233940:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851900.233940:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851900.233941:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->7@kfi7: PUT: OK
00000400:00000200:9.0:1773851900.233941:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:13.0:1773851900.233942:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:6.0:1773851900.233942:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000400:00000200:6.0:1773851900.233942:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000068cc9555
00000800:00000200:5.0:1773851900.233942:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851900.233943:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x781699229 [1] + 224
00000400:00000010:6.0:1773851900.233943:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000068cc9555.
00000100:00000001:6.0:1773851900.233943:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:13.0:1773851900.233944:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:6.0:1773851900.233944:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851900.233944:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851900.233945:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851900.233946:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000040:13.0:1773851900.233947:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851900.233947:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:6.0:1773851900.233947:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851900.233947:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851900.233947:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:9.0:1773851900.233948:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000400:00000200:5.0:1773851900.233948:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000100:00000001:9.0:1773851900.233949:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:5.0:1773851900.233949:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000100:00000001:13.0:1773851900.233950:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851900.233950:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851900.233950:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:13.0:1773851900.233951:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000200:9.0:1773851900.233951:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.233951:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851900.233951:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851900.233952:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:5.0:1773851900.233952:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000100:00000001:4.0:1773851900.233952:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851900.233952:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:13.0:1773851900.233953:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 7@kfi7(00000000a71ebdb7):0x0 lsk 4530 rsk 796 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000800:00000200:6.0:1773851900.233953:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000071e56989: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Transaction freed
00000400:00000200:5.0:1773851900.233953:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000001:4.0:1773851900.233953:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851900.233953:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:9.0:1773851900.233954:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851900.233954:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6c00
00000400:00000010:4.0:1773851900.233954:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:5.0:1773851900.233955:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:4.0:1773851900.233955:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098ca3a41
00000400:00000010:4.0:1773851900.233955:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098ca3a41.
00000400:00000200:5.0:1773851900.233956:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b32525 [1] + 224
00000100:00000001:4.0:1773851900.233956:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851900.233957:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851900.233958:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:5.0:1773851900.233958:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851900.233959:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000200:4.0:1773851900.233959:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851900.233960:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:5.0:1773851900.233960:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851900.233961:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851900.233961:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022757302: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:5.0:1773851900.233961:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2098@kfi7: PUT: OK
00000400:00000001:28.0:1773851900.233962:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851900.233962:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:5.0:1773851900.233962:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851900.233962:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851900.233962:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851900.233962:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851900.233962:0:41066:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:28.0:1773851900.233963:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
02000000:00000001:4.0:1773851900.233963:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851900.233963:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851900.233964:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851900.233964:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851900.233965:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032756c42
00000100:00001000:4.0:1773851900.233965:0:41066:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=9 v=66 (66 66 66 66)
00000400:00000010:28.0:1773851900.233966:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032756c42.
00000100:00000040:5.0:1773851900.233966:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:4.0:1773851900.233966:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=15 v=66 (1 1 1 1)
00000100:00000001:28.0:1773851900.233967:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:4.0:1773851900.233967:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851900.233967:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851900.233968:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:4.0:1773851900.233968:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851900.233968:0:41066:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.233969:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851900.233969:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:5.0:1773851900.233970:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000040:4.0:1773851900.233970:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:4.0:1773851900.233970:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851900.233970:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:28.0:1773851900.233971:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.233971:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851900.233971:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:5.0:1773851900.233971:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 2098@kfi7(000000007ed6de59):0x0 lsk 1213 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000040:4.0:1773851900.233971:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:6.0:1773851900.233972:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851900.233972:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:28.0:1773851900.233973:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:6.0:1773851900.233973:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000100:00000001:28.0:1773851900.233974:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851900.233974:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025756a50
00000400:00000010:6.0:1773851900.233974:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025756a50.
00000100:00000001:28.0:1773851900.233975:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851900.233975:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851900.233975:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:6.0:1773851900.233975:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851900.233976:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851900.233976:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:28.0:1773851900.233977:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851900.233977:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233977:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851900.233977:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:28.0:1773851900.233978:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=133 v=66 (66 66 66 66)
00000100:00000200:6.0:1773851900.233978:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:4.0:1773851900.233978:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00001000:28.0:1773851900.233979:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=133 v=66 (1 1 1 1)
00000004:00000020:4.0:1773851900.233979:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031808 blocks, 31536855200 free, 31536766752 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425635 files, 2779493341 free files
00000100:00000001:28.0:1773851900.233980:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851900.233980:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851900.233980:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851900.233980:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851900.233981:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.233981:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851900.233981:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:4.0:1773851900.233981:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:28.0:1773851900.233982:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:28.0:1773851900.233982:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.233982:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851900.233983:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:6.0:1773851900.233983:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851900.233983:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851900.233983:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000067479cf9 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051941760:7@kfi7:41:default-yuba2-0
00000100:00000040:28.0:1773851900.233984:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00000001:28.0:1773851900.233984:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:6.0:1773851900.233984:0:41067:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=133 v=66 (66 66 66 66)
00000100:00000001:28.0:1773851900.233985:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851900.233985:0:41067:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=133 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851900.233985:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851900.233985:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:28.0:1773851900.233986:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.233986:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:4.0:1773851900.233986:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000067479cf9 x1859433051941760/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.233987:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:6.0:1773851900.233987:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851900.233988:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.233988:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:4.0:1773851900.233988:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851900.233988:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:28.0:1773851900.233989:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:6.0:1773851900.233989:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:6.0:1773851900.233989:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851900.233989:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851900.233989:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d5f06b74.
00000100:00000001:28.0:1773851900.233990:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851900.233990:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851900.233990:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851900.233990:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851900.233990:0:41066:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000004:00000001:28.0:1773851900.233991:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:6.0:1773851900.233991:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:4.0:1773851900.233991:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000004:00000040:28.0:1773851900.233992:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
02000000:00000010:4.0:1773851900.233992:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000daca50c1.
02000000:00000001:4.0:1773851900.233992:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000040:28.0:1773851900.233993:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510669312 avail=351508114432 avail_mb=1373078572 hwm_mb=3131103 files=372095703 ffree=343272138 state=0: rc = 0
00000100:00000001:6.0:1773851900.233993:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:4.0:1773851900.233993:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851900.233993:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000067479cf9.
00000100:00000001:6.0:1773851900.233994:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851900.233994:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851900.233994:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851900.233994:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:28.0:1773851900.233995:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510669312 free, 351508114432 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095703 files, 343272138 free files
00000004:00000001:6.0:1773851900.233995:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:4.0:1773851900.233995:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:6.0:1773851900.233996:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33735999936 blocks, 31354645088 free, 31354598688 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064073 files, 2870603493 free files
00000100:00000001:4.0:1773851900.233996:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851900.233996:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233996:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:28.0:1773851900.233997:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.233997:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851900.233998:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:6.0:1773851900.233998:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851900.233999:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:28.0:1773851900.234001:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000032655417 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051941696:2080@kfi7:13:default-yuba2-0
00000100:00100000:6.0:1773851900.234001:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000e7d02143 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051941888:2098@kfi7:41:default-yuba2-0
00000100:00000001:28.0:1773851900.234003:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851900.234003:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851900.234003:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851900.234004:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851900.234004:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000e7d02143 x1859433051941888/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851900.234005:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000032655417 x1859433051941696/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.234006:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:28.0:1773851900.234007:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851900.234007:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851900.234007:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008355fee1.
02000000:00000001:28.0:1773851900.234008:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:6.0:1773851900.234008:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851900.234008:0:41067:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000010:28.0:1773851900.234009:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b825c1cb.
00000020:00000040:6.0:1773851900.234009:0:41067:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000020:00000001:6.0:1773851900.234009:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:28.0:1773851900.234010:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000010:6.0:1773851900.234010:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d7ad89bf.
02000000:00000001:6.0:1773851900.234010:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:28.0:1773851900.234011:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851900.234011:0:41091:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
02000000:00000001:6.0:1773851900.234011:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851900.234011:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000e7d02143.
00000020:00000001:28.0:1773851900.234012:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:6.0:1773851900.234012:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851900.234012:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851900.234012:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851900.234013:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851900.234013:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851900.234014:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a8444578.
00000100:00000001:6.0:1773851900.234014:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851900.234014:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851900.234015:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851900.234016:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851900.234016:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000032655417.
00000100:00000001:28.0:1773851900.234017:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:28.0:1773851900.234018:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851900.234018:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851900.234019:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851900.234020:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851900.234020:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851900.234021:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851900.234027:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851900.234028:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851900.234029:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851900.234031:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851900.234033:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.234034:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:29.0:1773851900.234035:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.234036:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:29.0:1773851900.234037:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.234037:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:29.0:1773851900.234038:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:29.0:1773851900.234039:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.234040:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6bc0
00000400:00000200:29.0:1773851900.234041:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.234042:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x7800820fd [1] + 224
00000800:00000200:29.0:1773851900.234045:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851900.234046:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851900.234047:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000100:00000001:29.0:1773851900.234048:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851900.234049:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851900.234052:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851900.234056:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851900.234057:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:29.0:1773851900.234058:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851900.234058:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851900.234058:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851900.234059:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851900.234059:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851900.234060:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000200:7.0:1773851900.234061:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000010:7.0:1773851900.234061:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000100:00000001:7.0:1773851900.234062:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851900.234063:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851900.234066:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851900.234068:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851900.234069:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851900.234070:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851900.234070:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851900.234071:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851900.234071:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851900.234072:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851900.234073:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=133 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851900.234074:0:41064:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=133 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851900.234075:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851900.234076:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851900.234076:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851900.234077:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.234078:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851900.234078:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000100:00000001:7.0:1773851900.234079:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851900.234079:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851900.234080:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851900.234083:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851900.234084:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851900.234084:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851900.234085:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851900.234085:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851900.234086:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353597952 avail=351351200768 avail_mb=1372465628 hwm_mb=3131101 files=372083169 ffree=343118748 state=0: rc = 0
00000004:00000020:7.0:1773851900.234088:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353597952 free, 351351200768 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083169 files, 343118748 free files
00000004:00000001:7.0:1773851900.234090:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851900.234091:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851900.234094:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000051fc656a pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051941824:3@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851900.234096:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851900.234096:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851900.234097:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000051fc656a x1859433051941824/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851900.234100:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851900.234100:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851900.234101:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000023aa93ab.
02000000:00000001:7.0:1773851900.234102:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851900.234102:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851900.234103:0:41064:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000020:00000001:7.0:1773851900.234103:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851900.234104:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000ef164abb.
02000000:00000001:7.0:1773851900.234105:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851900.234105:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851900.234106:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000051fc656a.
00000100:00000001:7.0:1773851900.234107:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851900.234107:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851900.234107:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851900.234108:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851900.234109:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.234109:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851900.234110:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851900.259596:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851900.259596:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851900.259598:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851900.259599:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851900.259601:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.259602:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:17.0:1773851900.259603:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.259604:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851900.259605:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.259605:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851900.259606:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851900.259608:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:17.0:1773851900.259609:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e35fc0
00000400:00000200:17.0:1773851900.259610:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 48592
00000800:00000200:17.0:1773851900.259612:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851900.259614:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851900.259615:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000100:00000001:17.0:1773851900.259616:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851900.259617:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851900.259618:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000079402622.
00000100:00000040:17.0:1773851900.259619:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000079402622 x1859316187619264 msgsize 224
00000100:00100000:17.0:1773851900.259620:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:17.0:1773851900.259621:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851900.259622:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:17.0:1773851900.259623:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851900.259623:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851900.259623:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:16.0:1773851900.259624:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851900.259624:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851900.259625:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851900.259626:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187619264
00000020:00000001:16.0:1773851900.259627:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851900.259627:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:16.0:1773851900.259628:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851900.259629:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:16.0:1773851900.259630:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:16.0:1773851900.259631:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:16.0:1773851900.259632:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851900.259633:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851900.259634:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000a80febe.
00000020:00000010:16.0:1773851900.259635:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851900.259636:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004575af91.
00000100:00000001:16.0:1773851900.259637:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851900.259637:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851900.259638:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851900.259639:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851900.259640:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851900.259640:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851900.259641:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851900.259643:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851900.259643:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851900.259643:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851900.259643:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851900.259644:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156441
00000100:00000040:19.0:1773851900.259645:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:16.0:1773851900.259645:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.259646:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794780032 : -107029914771584 : ffff9ea827f31f80)
00000100:00000001:16.0:1773851900.259646:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851900.259647:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000079402622 x1859316187619264/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:19.0:1773851900.259650:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851900.259650:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851900.259651:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079402622 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39683:x1859316187619264:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:19.0:1773851900.259652:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187619264
00000020:00000001:19.0:1773851900.259653:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851900.259654:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851900.259654:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.259655:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851900.259656:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851900.259656:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851900.259657:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187619264, found 0 last_xid 1859316186815935
00000020:00000001:19.0:1773851900.259658:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851900.259659:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851900.259659:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851900.259659:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.259660:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851900.259661:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851900.259661:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851900.259662:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a8c85411.
02000000:00000001:19.0:1773851900.259663:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.259664:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.259664:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851900.259665:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187619264
00010000:00000001:19.0:1773851900.259666:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851900.259666:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000079402622 x1859316187619264/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:19.0:1773851900.259669:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851900.259669:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851900.259670:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=133 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851900.259671:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851900.259672:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:19.0:1773851900.259672:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:19.0:1773851900.259673:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851900.259674:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.259674:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851900.259675:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:19.0:1773851900.259676:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e9adaa40.
00000100:00000200:19.0:1773851900.259676:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187619264, offset 224
00000400:00000200:19.0:1773851900.259678:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:19.0:1773851900.259679:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:19.0:1773851900.259679:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:19.0:1773851900.259680:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:19.0:1773851900.259681:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:19.0:1773851900.259683:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:19.0:1773851900.259684:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770349:8770349:1024:4294967295] 20881@kfi7 LPNI seq info [16890557:16890557:16:4294967295]
00000400:00000200:19.0:1773851900.259685:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:19.0:1773851900.259686:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:19.0:1773851900.259688:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851900.259689:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:19.0:1773851900.259690:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851900.259691:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851900.259693:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851900.259696:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Using peer 20881@kfi7(0x6b5)
00000800:00000200:19.0:1773851900.259699:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x6b5: rc=0
00000800:00000200:19.0:1773851900.259700:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851900.259702:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851900.259703:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:19.0:1773851900.259704:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851900.259704:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.259705:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851900.259705:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000079402622 x1859316187619264/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000100:00100000:19.0:1773851900.259708:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079402622 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39683:x1859316187619264:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851900.259711:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156441
00000100:00000040:19.0:1773851900.259711:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000100:00000001:19.0:1773851900.259712:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851900.259712:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851900.259713:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851900.259713:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:19.0:1773851900.259714:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004575af91.
00000400:00000200:17.0:1773851900.259714:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851900.259715:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000a80febe.
00000400:00000200:17.0:1773851900.259715:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20881@kfi7: PUT: OK
00000020:00000040:19.0:1773851900.259716:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:19.0:1773851900.259716:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851900.259716:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e9adaa40
00000400:00000010:17.0:1773851900.259716:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e9adaa40.
00000100:00000001:17.0:1773851900.259717:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851900.259717:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851900.259718:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000800:00000200:17.0:1773851900.259719:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 20881@kfi7(00000000e0510692):0x0 lsk 1718 rsk 45 tsk 0 trmk 0 tmk 0 trr 4 tta 0x6b5 Transaction freed
00000800:00000200:21.0:1773851900.314461:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851900.314462:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851900.314463:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851900.314465:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851900.314467:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.314468:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20609@kfi7 : PUT - for me
00000400:00000200:21.0:1773851900.314468:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.314469:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 1
00000400:00000200:21.0:1773851900.314470:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.314471:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000400:00000200:21.0:1773851900.314472:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 3
00000400:00000200:21.0:1773851900.314472:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20544@kfi7 to cpt 6
00000400:00000200:21.0:1773851900.314473:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20544@kfi7 of length 224 into portal 12 MB=0x69b095c15efc0
00000400:00000200:21.0:1773851900.314475:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20544@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 67568
00000800:00000200:21.0:1773851900.314476:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851900.314477:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.314479:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20609@kfi7: PUT: OK
00000100:00000001:21.0:1773851900.314479:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851900.314480:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851900.314480:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc830e97.
00000100:00000040:21.0:1773851900.314481:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000cc830e97 x1859314362216384 msgsize 224
00000100:00100000:21.0:1773851900.314482:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20544@kfi7 (source: 12345-20609@kfi7)
00000100:00000001:21.0:1773851900.314483:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851900.314484:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000100:00000001:23.0:1773851900.314485:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851900.314485:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851900.314485:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851900.314486:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851900.314486:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851900.314487:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851900.314488:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314362216384
00000020:00000001:23.0:1773851900.314488:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851900.314489:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac913bf
00000020:00000001:23.0:1773851900.314489:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851900.314492:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000028b73cab refcount=6
00000020:00000001:23.0:1773851900.314493:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946169308160 : -107127540243456 : ffff9e916d04a400)
00000020:00000001:23.0:1773851900.314494:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946169308160 : -107127540243456 : ffff9e916d04a400)
00000100:00000001:23.0:1773851900.314495:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.314496:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851900.314496:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851900.314497:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.314498:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851900.314499:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851900.314499:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851900.314500:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.314501:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851900.314501:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851900.314502:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.314503:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.314504:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851900.314504:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851900.314504:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851900.314504:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851900.314505:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20544@kfi7, seq: 1998081
00000100:00000040:23.0:1773851900.314506:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000028b73cab : new rpc_count 1
00000100:00000001:20.0:1773851900.314506:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.314507:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637132523088000 : -106941186463616 : ffff9ebcd091a880)
00000100:00000001:20.0:1773851900.314507:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.314509:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cc830e97 x1859314362216384/t0(0) o400->e3016a31-a365-4044-b2f6-16bab5868c30@20544@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1780-0'
00000100:00000001:23.0:1773851900.314512:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.314512:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851900.314514:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cc830e97 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e3016a31-a365-4044-b2f6-16bab5868c30+6:39885:x1859314362216384:12345-20544@kfi7:400:default-tuolumne1780-0
00000100:00000200:23.0:1773851900.314515:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314362216384
00000020:00000001:23.0:1773851900.314516:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851900.314516:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851900.314517:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.314517:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851900.314518:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851900.314519:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851900.314519:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314362216384, found 0 last_xid 1859314362216383
00000020:00000001:23.0:1773851900.314520:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851900.314521:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851900.314521:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851900.314522:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.314522:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851900.314523:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851900.314523:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851900.314524:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ea5ccc04.
02000000:00000001:23.0:1773851900.314525:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.314525:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.314526:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851900.314526:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044156668, transno 0, xid 1859314362216384
00010000:00000001:23.0:1773851900.314527:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851900.314528:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cc830e97 x1859314362216384/t0(0) o400->e3016a31-a365-4044-b2f6-16bab5868c30@20544@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1780-0'
00010000:00000001:23.0:1773851900.314530:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851900.314531:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851900.314532:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=133 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851900.314533:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851900.314533:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d02b961 refcount 5 to 20544@kfi7
00000100:00000001:23.0:1773851900.314534:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923993437888 : -107149716113728 : ffff9e8c433bb6c0)
02000000:00000001:23.0:1773851900.314535:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851900.314535:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.314536:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851900.314537:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20609@kfi7
00000400:00000010:23.0:1773851900.314538:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4d95905.
00000100:00000200:23.0:1773851900.314539:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314362216384, offset 224
00000400:00000200:23.0:1773851900.314540:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20609@kfi7
00000400:00000200:23.0:1773851900.314541:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.314541:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 1
00000400:00000200:23.0:1773851900.314543:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000400:00000200:23.0:1773851900.314544:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 3
00000400:00000200:23.0:1773851900.314545:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20609@kfi7 local destination
00000400:00000200:23.0:1773851900.314546:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770350:8770350:1024:4294967295] 20609@kfi7 LPNI seq info [1323081:1323081:16:4294967295]
00000400:00000200:23.0:1773851900.314548:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000400:00000200:23.0:1773851900.314548:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20609@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.314550:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20609@kfi7(20609@kfi7:20609@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851900.314551:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 3
00000800:00000200:23.0:1773851900.314553:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851900.314554:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851900.314556:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851900.314558:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f Using peer 20609@kfi7(0x10000000000048f)
00000800:00000200:23.0:1773851900.314562:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000cf211825: Posted send of 324 bytes to peer 0x10000000000048f: rc=0
00000800:00000200:23.0:1773851900.314563:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851900.314565:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.314566:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d02b961 refcount 4 to 20544@kfi7
00010000:00000001:23.0:1773851900.314567:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851900.314567:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.314568:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851900.314568:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc830e97 x1859314362216384/t0(0) o400->e3016a31-a365-4044-b2f6-16bab5868c30@20544@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1780-0'
00000800:00000200:21.0:1773851900.314573:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851900.314574:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cc830e97 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e3016a31-a365-4044-b2f6-16bab5868c30+6:39885:x1859314362216384:12345-20544@kfi7:400:default-tuolumne1780-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851900.314575:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851900.314576:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20544@kfi7, seq: 1998081
00000400:00000200:21.0:1773851900.314576:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20609@kfi7: PUT: OK
00000400:00000200:21.0:1773851900.314576:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4d95905
00000100:00000040:23.0:1773851900.314577:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000028b73cab : new rpc_count 0
00000100:00000001:23.0:1773851900.314577:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:21.0:1773851900.314577:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4d95905.
00000100:00000001:21.0:1773851900.314577:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:23.0:1773851900.314578:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851900.314578:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000100:00000001:21.0:1773851900.314578:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851900.314578:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f70100ed nid 20609@kfi7 refs 2
00000020:00000010:23.0:1773851900.314579:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:23.0:1773851900.314580:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000020:00000040:23.0:1773851900.314580:0:61145:0:(genops.c:882:class_export_put()) PUTting export 0000000028b73cab : new refcount 5
00000800:00000200:21.0:1773851900.314580:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000cf211825: 2054@kfi7:5 -> 20609@kfi7(0000000002c72290):0x0 lsk 1168 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000048f Transaction freed
00000100:00000001:23.0:1773851900.314581:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851900.397872:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851900.397873:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851900.397875:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851900.397877:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851900.397879:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.397880:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9555@kfi7 : PUT - for me
00000400:00000200:13.0:1773851900.397881:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.397882:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 1
00000400:00000200:13.0:1773851900.397883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.397884:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000400:00000200:13.0:1773851900.397885:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 3
00000400:00000200:13.0:1773851900.397886:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.397886:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9555@kfi7 of length 224 into portal 12 MB=0x69aa079d9ff80
00000400:00000200:13.0:1773851900.397888:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9555@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 60568
00000800:00000200:13.0:1773851900.397889:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851900.397891:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851900.397892:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9555@kfi7: PUT: OK
00000100:00000001:13.0:1773851900.397893:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851900.397893:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851900.397894:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000abbf92f8.
00000100:00000040:13.0:1773851900.397895:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000abbf92f8 x1858863890038656 msgsize 224
00000100:00100000:13.0:1773851900.397897:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-9555@kfi7 (source: 12345-9555@kfi7)
00000100:00000001:13.0:1773851900.397898:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851900.397899:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000800:00000200:13.0:1773851900.397900:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851900.397902:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851900.397903:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851900.397904:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851900.397905:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851900.397907:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851900.397909:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890038656
00000020:00000001:14.0:1773851900.397910:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851900.397911:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92490
00000020:00000001:14.0:1773851900.397913:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851900.397916:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000021dfdda1 refcount=6
00000020:00000001:14.0:1773851900.397918:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630500352 : -107123079051264 : ffff9e9276ed0800)
00000020:00000001:14.0:1773851900.397920:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630500352 : -107123079051264 : ffff9e9276ed0800)
00000100:00000001:14.0:1773851900.397922:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851900.397923:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851900.397924:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005718a032.
00000020:00000010:14.0:1773851900.397926:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000005e47ae5.
00000020:00000010:14.0:1773851900.397928:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008cc79fb6.
00000100:00000001:14.0:1773851900.397930:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851900.397930:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851900.397931:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851900.397934:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851900.397935:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851900.397935:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851900.397937:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851900.397939:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851900.397939:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851900.397940:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851900.397941:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851900.397941:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9555@kfi7, seq: 2289942
00000100:00000001:14.0:1773851900.397942:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851900.397942:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000021dfdda1 : new rpc_count 1
00000100:00000001:12.0:1773851900.397942:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945730816 : -106919763820800 : ffff9ec1cd753f00)
00000100:00000001:14.0:1773851900.397943:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851900.397944:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000abbf92f8 x1858863890038656/t0(0) o400->bd413dbe-eca9-4967-92f4-43bdc1fba79c@9555@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1094-0'
00000100:00000001:12.0:1773851900.397947:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851900.397947:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851900.397948:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000abbf92f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bd413dbe-eca9-4967-92f4-43bdc1fba79c+6:39142:x1858863890038656:12345-9555@kfi7:400:default-tuolumne1094-0
00000100:00000200:12.0:1773851900.397949:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890038656
00000020:00000001:12.0:1773851900.397950:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851900.397951:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851900.397952:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.397952:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851900.397953:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851900.397954:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851900.397954:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890038656, found 0 last_xid 1858863890038655
00000020:00000001:12.0:1773851900.397955:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851900.397956:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851900.397957:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851900.397957:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.397959:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851900.397959:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851900.397960:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851900.397961:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4ee393e.
02000000:00000001:12.0:1773851900.397962:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.397962:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.397963:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851900.397964:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510531041, transno 0, xid 1858863890038656
00010000:00000001:12.0:1773851900.397965:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851900.397966:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000abbf92f8 x1858863890038656/t0(0) o400->bd413dbe-eca9-4967-92f4-43bdc1fba79c@9555@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1094-0'
00010000:00000001:12.0:1773851900.397968:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851900.397969:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851900.397970:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=133 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851900.397971:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851900.397972:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000339508b7 refcount 3 to 9555@kfi7
00000100:00000001:12.0:1773851900.397973:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399152416 : -107139310399200 : ffff9e8eaf765120)
02000000:00000001:12.0:1773851900.397974:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851900.397974:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.397975:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851900.397976:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9555@kfi7
00000400:00000010:12.0:1773851900.397977:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1f39afe.
00000100:00000200:12.0:1773851900.397978:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890038656, offset 224
00000400:00000200:12.0:1773851900.397979:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9555@kfi7
00000400:00000200:12.0:1773851900.397980:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:12.0:1773851900.397981:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 1
00000400:00000200:12.0:1773851900.397982:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000400:00000200:12.0:1773851900.397984:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 3
00000400:00000200:12.0:1773851900.397985:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9555@kfi7 local destination
00000400:00000200:12.0:1773851900.397986:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770351:8770351:1024:4294967295] 9555@kfi7 LPNI seq info [17469:17469:16:4294967295]
00000400:00000200:12.0:1773851900.397988:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000400:00000200:12.0:1773851900.397989:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9555@kfi7 to cpt 3
00000400:00000200:12.0:1773851900.397991:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9555@kfi7(9555@kfi7:9555@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851900.397992:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 3
00000800:00000200:12.0:1773851900.397993:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851900.397994:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851900.397996:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851900.397998:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000094e Using peer 9555@kfi7(0x10000000000094e)
00000800:00000200:12.0:1773851900.398001:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0x10000000000094e: rc=0
00000800:00000200:12.0:1773851900.398003:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000094e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851900.398004:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851900.398005:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000339508b7 refcount 2 to 9555@kfi7
00010000:00000001:12.0:1773851900.398006:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851900.398006:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.398007:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851900.398007:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000abbf92f8 x1858863890038656/t0(0) o400->bd413dbe-eca9-4967-92f4-43bdc1fba79c@9555@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1094-0'
00000100:00100000:12.0:1773851900.398011:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000abbf92f8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:bd413dbe-eca9-4967-92f4-43bdc1fba79c+6:39142:x1858863890038656:12345-9555@kfi7:400:default-tuolumne1094-0 Request processed in 63us (114us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851900.398013:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9555@kfi7, seq: 2289942
00000100:00000040:12.0:1773851900.398014:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000021dfdda1 : new rpc_count 0
00000100:00000001:12.0:1773851900.398015:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851900.398015:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851900.398016:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000005e47ae5.
00000020:00000010:12.0:1773851900.398017:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008cc79fb6.
00000020:00000010:12.0:1773851900.398017:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005718a032.
00000020:00000040:12.0:1773851900.398018:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000021dfdda1 : new refcount 5
00000100:00000001:12.0:1773851900.398019:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851900.398025:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000094e TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851900.398028:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851900.398029:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9555@kfi7: PUT: OK
00000400:00000200:13.0:1773851900.398030:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1f39afe
00000400:00000010:13.0:1773851900.398030:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1f39afe.
00000100:00000001:13.0:1773851900.398031:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851900.398031:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851900.398032:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000751b9c83 nid 9555@kfi7 refs 2
00000800:00000200:13.0:1773851900.398034:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 9555@kfi7(000000003b88c0c8):0x0 lsk 2383 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000094e Transaction freed
00000800:00000200:13.0:1773851900.480888:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851900.480889:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851900.480890:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851900.480891:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851900.480893:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24195@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.480894:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24195@kfi7 : PUT - for me
00000400:00000200:13.0:1773851900.480895:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24195@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.480896:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed09f790 nid 24195@kfi7 refs 1
00000400:00000200:13.0:1773851900.480897:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24195@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.480898:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed09f790 nid 24195@kfi7 refs 2
00000400:00000200:13.0:1773851900.480898:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed09f790 nid 24195@kfi7 refs 3
00000400:00000200:13.0:1773851900.480899:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24130@kfi7 to cpt 4
00000400:00000200:13.0:1773851900.480900:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24130@kfi7 of length 224 into portal 12 MB=0x69b466195ab80
00000400:00000200:13.0:1773851900.480901:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24130@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 60792
00000800:00000200:13.0:1773851900.480903:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851900.480904:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851900.480905:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24195@kfi7: PUT: OK
00000100:00000001:13.0:1773851900.480906:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851900.480906:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851900.480907:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002517bedd.
00000100:00000040:13.0:1773851900.480908:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000002517bedd x1859576447478656 msgsize 224
00000100:00100000:13.0:1773851900.480909:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-24130@kfi7 (source: 12345-24195@kfi7)
00000100:00000001:13.0:1773851900.480910:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851900.480911:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed09f790 nid 24195@kfi7 refs 2
00000800:00000200:13.0:1773851900.480912:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851900.480912:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851900.480912:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851900.480913:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851900.480913:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851900.480914:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851900.480914:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576447478656
00000020:00000001:12.0:1773851900.480915:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851900.480915:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc5571241
00000020:00000001:12.0:1773851900.480915:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851900.480918:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000034444e98 refcount=27
00000020:00000001:12.0:1773851900.480919:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105833324544 : -106967876227072 : ffff9eb699bc3000)
00000020:00000001:12.0:1773851900.480919:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105833324544 : -106967876227072 : ffff9eb699bc3000)
00000100:00000001:12.0:1773851900.480920:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851900.480921:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851900.480923:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000087e8c548.
00000020:00000010:12.0:1773851900.480924:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851900.480924:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851900.480925:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851900.480925:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851900.480926:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851900.480927:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851900.480927:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851900.480927:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.480928:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851900.480929:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851900.480929:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851900.480930:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851900.480930:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851900.480930:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24130@kfi7, seq: 2289943
00000100:00000001:14.0:1773851900.480931:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851900.480931:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851900.480931:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000034444e98 : new rpc_count 3
00000100:00000001:12.0:1773851900.480931:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945722752 : -106919763828864 : ffff9ec1cd751f80)
00000100:00000040:12.0:1773851900.480932:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002517bedd x1859576447478656/t0(0) o400->5d0355ee-385b-4027-a549-a9f96151542e@24130@kfi7:152/0 lens 224/0 e 0 to 0 dl 1773852267 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2008-0'
00000100:00000001:12.0:1773851900.480935:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851900.480935:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851900.480936:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002517bedd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:5d0355ee-385b-4027-a549-a9f96151542e+27:39724:x1859576447478656:12345-24130@kfi7:400:default-tuolumne2008-0
00000100:00000200:12.0:1773851900.480939:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576447478656
00000020:00000001:12.0:1773851900.480939:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851900.480940:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851900.480940:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.480941:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851900.480941:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851900.480942:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851900.480942:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576447478656, found 0 last_xid 1859576446907263
00000020:00000001:12.0:1773851900.480943:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851900.480943:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851900.480944:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851900.480944:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.480945:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851900.480945:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851900.480945:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851900.480946:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dbd6e389.
02000000:00000001:12.0:1773851900.480947:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.480948:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.480948:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851900.480949:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264505453, transno 0, xid 1859576447478656
00010000:00000001:12.0:1773851900.480949:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851900.480950:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002517bedd x1859576447478656/t0(0) o400->5d0355ee-385b-4027-a549-a9f96151542e@24130@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2008-0'
00010000:00000001:12.0:1773851900.480952:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851900.480952:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851900.480953:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=133 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851900.480954:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851900.480954:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000091ff2221 refcount 3 to 24130@kfi7
00000100:00000001:12.0:1773851900.480955:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518240 : -107156126033376 : ffff9e8ac52c1a20)
02000000:00000001:12.0:1773851900.480956:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851900.480956:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.480956:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851900.480957:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24195@kfi7
00000400:00000010:12.0:1773851900.480958:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e559f001.
00000100:00000200:12.0:1773851900.480959:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576447478656, offset 224
00000400:00000200:12.0:1773851900.480960:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24195@kfi7
00000400:00000200:12.0:1773851900.480961:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24195@kfi7 to cpt 3
00000400:00000200:12.0:1773851900.480962:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed09f790 nid 24195@kfi7 refs 1
00000400:00000200:12.0:1773851900.480962:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed09f790 nid 24195@kfi7 refs 2
00000400:00000200:12.0:1773851900.480963:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed09f790 nid 24195@kfi7 refs 3
00000400:00000200:12.0:1773851900.480964:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24195@kfi7 local destination
00000400:00000200:12.0:1773851900.480965:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770352:8770352:1024:4294967295] 24195@kfi7 LPNI seq info [1909019:1909019:16:4294967295]
00000400:00000200:12.0:1773851900.480967:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed09f790 nid 24195@kfi7 refs 2
00000400:00000200:12.0:1773851900.480967:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24195@kfi7 to cpt 3
00000400:00000200:12.0:1773851900.480969:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24195@kfi7(24195@kfi7:24195@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851900.480970:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed09f790 nid 24195@kfi7 refs 3
00000800:00000200:12.0:1773851900.480971:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851900.480972:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851900.480974:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851900.480976:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x218 Using peer 24195@kfi7(0x218)
00000800:00000200:12.0:1773851900.480979:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x218: rc=0
00000800:00000200:12.0:1773851900.480980:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x218 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851900.480982:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851900.480983:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000091ff2221 refcount 2 to 24130@kfi7
00010000:00000001:12.0:1773851900.480983:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851900.480984:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.480984:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851900.480985:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002517bedd x1859576447478656/t0(0) o400->5d0355ee-385b-4027-a549-a9f96151542e@24130@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2008-0'
00000100:00100000:12.0:1773851900.480989:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002517bedd pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:5d0355ee-385b-4027-a549-a9f96151542e+27:39724:x1859576447478656:12345-24130@kfi7:400:default-tuolumne2008-0 Request processed in 52us (78us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851900.480991:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24130@kfi7, seq: 2289943
00000100:00000040:12.0:1773851900.480992:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000034444e98 : new rpc_count 2
00000100:00000001:12.0:1773851900.480993:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851900.480993:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851900.480994:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851900.480995:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851900.480995:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000087e8c548.
00000020:00000040:12.0:1773851900.480996:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000034444e98 : new refcount 26
00000100:00000001:12.0:1773851900.480997:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851900.481002:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x218 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851900.481003:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851900.481004:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24195@kfi7: PUT: OK
00000400:00000200:13.0:1773851900.481005:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e559f001
00000400:00000010:13.0:1773851900.481005:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e559f001.
00000100:00000001:13.0:1773851900.481006:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851900.481006:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851900.481007:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed09f790 nid 24195@kfi7 refs 2
00000800:00000200:13.0:1773851900.481009:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 24195@kfi7(00000000b1dd0335):0x0 lsk 537 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x218 Transaction freed
00000800:00000200:1.0:1773851900.495637:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851900.495639:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851900.495642:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851900.495646:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851900.495650:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:1.0:1773851900.495652:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9779@kfi7 : PUT - for me
00000400:00000200:1.0:1773851900.495654:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:1.0:1773851900.495657:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 1
00000400:00000200:1.0:1773851900.495659:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:1.0:1773851900.495660:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000400:00000200:1.0:1773851900.495661:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 3
00000400:00000200:1.0:1773851900.495663:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9971@kfi7 to cpt 2
00000400:00000200:1.0:1773851900.495665:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9971@kfi7 of length 224 into portal 12 MB=0x699e14b1f0e00
00000400:00000200:1.0:1773851900.495667:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9971@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 54584
00000800:00000200:1.0:1773851900.495671:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851900.495674:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851900.495675:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9779@kfi7: PUT: OK
00000100:00000001:1.0:1773851900.495677:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851900.495678:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851900.495681:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007d3bf6e6.
00000100:00000040:1.0:1773851900.495682:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007d3bf6e6 x1858042767281664 msgsize 224
00000100:00100000:1.0:1773851900.495684:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9971@kfi7 (source: 12345-9779@kfi7)
00000100:00000001:1.0:1773851900.495686:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851900.495688:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000100:00000001:0.0:1773851900.495690:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851900.495691:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851900.495691:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851900.495692:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851900.495693:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851900.495695:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851900.495696:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042767281664
00000020:00000001:0.0:1773851900.495697:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851900.495698:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac915b0
00000020:00000001:0.0:1773851900.495699:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851900.495702:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005830d2c8 refcount=8
00000020:00000001:0.0:1773851900.495703:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241012224 : -107152468539392 : ffff9e8b9f2d0800)
00000020:00000001:0.0:1773851900.495706:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241012224 : -107152468539392 : ffff9e8b9f2d0800)
00000100:00000001:0.0:1773851900.495708:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851900.495709:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851900.495710:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000637bc2c7.
00000020:00000010:0.0:1773851900.495712:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851900.495714:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851900.495716:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851900.495716:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851900.495717:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851900.495719:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851900.495720:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851900.495721:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.495723:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851900.495726:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851900.495729:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851900.495730:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851900.495730:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851900.495732:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9971@kfi7, seq: 1997633
00000100:00000001:2.0:1773851900.495733:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851900.495733:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005830d2c8 : new rpc_count 3
00000100:00000001:2.0:1773851900.495734:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.495734:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636984250967040 : -107089458584576 : ffff9e9a4adca400)
00000100:00000040:0.0:1773851900.495736:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007d3bf6e6 x1858042767281664/t0(0) o400->f0ebef98-f473-4914-88d8-8c3cff8eea0a@9971@kfi7:540/0 lens 224/0 e 0 to 0 dl 1773852655 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1097-0'
00000100:00000001:0.0:1773851900.495741:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851900.495742:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851900.495743:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007d3bf6e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f0ebef98-f473-4914-88d8-8c3cff8eea0a+8:39840:x1858042767281664:12345-9971@kfi7:400:default-tuolumne1097-0
00000100:00000200:0.0:1773851900.495746:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042767281664
00000020:00000001:0.0:1773851900.495747:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851900.495748:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851900.495749:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.495750:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851900.495751:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851900.495753:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851900.495754:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042767281664, found 0 last_xid 1858042764542143
00000020:00000001:0.0:1773851900.495755:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851900.495756:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851900.495757:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851900.495758:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.495760:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851900.495761:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851900.495762:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851900.495763:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000006d6cf39.
02000000:00000001:0.0:1773851900.495764:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.495765:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.495767:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851900.495768:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183235806336, transno 0, xid 1858042767281664
00010000:00000001:0.0:1773851900.495769:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851900.495771:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007d3bf6e6 x1858042767281664/t0(0) o400->f0ebef98-f473-4914-88d8-8c3cff8eea0a@9971@kfi7:540/0 lens 224/224 e 0 to 0 dl 1773852655 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1097-0'
00010000:00000001:0.0:1773851900.495775:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851900.495776:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851900.495778:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=133 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851900.495780:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851900.495781:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005a910016 refcount 3 to 9971@kfi7
00000100:00000001:0.0:1773851900.495782:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051136384 : -107146658415232 : ffff9e8cf97c7d80)
02000000:00000001:0.0:1773851900.495783:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851900.495784:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.495785:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851900.495787:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9779@kfi7
00000400:00000010:0.0:1773851900.495788:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004dfb4d66.
00000100:00000200:0.0:1773851900.495790:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042767281664, offset 224
00000400:00000200:0.0:1773851900.495792:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9779@kfi7
00000400:00000200:0.0:1773851900.495794:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:0.0:1773851900.495796:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 1
00000400:00000200:0.0:1773851900.495798:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000400:00000200:0.0:1773851900.495800:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 3
00000400:00000200:0.0:1773851900.495802:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9779@kfi7 local destination
00000400:00000200:0.0:1773851900.495804:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770353:8770353:1024:4294967295] 9779@kfi7 LPNI seq info [27091917:27091917:16:4294967295]
00000400:00000200:0.0:1773851900.495807:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000400:00000200:0.0:1773851900.495809:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9779@kfi7 to cpt 0
00000400:00000200:0.0:1773851900.495812:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9779@kfi7(9779@kfi7:9779@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851900.495814:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 3
00000800:00000200:0.0:1773851900.495817:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851900.495819:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851900.495823:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851900.495828:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000173 Using peer 9779@kfi7(0x100000000000173)
00000800:00000200:0.0:1773851900.495833:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x100000000000173: rc=0
00000800:00000200:0.0:1773851900.495836:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000173 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851900.495840:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851900.495841:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005a910016 refcount 2 to 9971@kfi7
00010000:00000001:0.0:1773851900.495842:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851900.495843:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.495846:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851900.495848:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007d3bf6e6 x1858042767281664/t0(0) o400->f0ebef98-f473-4914-88d8-8c3cff8eea0a@9971@kfi7:540/0 lens 224/224 e 0 to 0 dl 1773852655 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1097-0'
00000100:00100000:0.0:1773851900.495853:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007d3bf6e6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:f0ebef98-f473-4914-88d8-8c3cff8eea0a+8:39840:x1858042767281664:12345-9971@kfi7:400:default-tuolumne1097-0 Request processed in 110us (170us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851900.495857:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9971@kfi7, seq: 1997633
00000100:00000040:0.0:1773851900.495858:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005830d2c8 : new rpc_count 2
00000100:00000001:0.0:1773851900.495860:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851900.495861:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851900.495862:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851900.495863:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851900.495865:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000637bc2c7.
00000020:00000040:0.0:1773851900.495866:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000005830d2c8 : new refcount 7
00000100:00000001:0.0:1773851900.495868:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851900.495877:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000173 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851900.495879:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851900.495881:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9779@kfi7: PUT: OK
00000400:00000200:1.0:1773851900.495883:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004dfb4d66
00000400:00000010:1.0:1773851900.495884:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004dfb4d66.
00000100:00000001:1.0:1773851900.495885:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851900.495886:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851900.495887:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000064136ad6 nid 9779@kfi7 refs 2
00000800:00000200:1.0:1773851900.495890:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 9779@kfi7(00000000cbfe3fe0):0x0 lsk 372 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000173 Transaction freed
00000800:00000200:13.0:1773851900.514342:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851900.514343:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851900.514344:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851900.514346:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851900.514348:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.514350:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13859@kfi7 : PUT - for me
00000400:00000200:13.0:1773851900.514350:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.514352:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 1
00000400:00000200:13.0:1773851900.514353:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:13.0:1773851900.514354:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000400:00000200:13.0:1773851900.514355:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 3
00000400:00000200:13.0:1773851900.514355:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14051@kfi7 to cpt 6
00000400:00000200:13.0:1773851900.514356:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14051@kfi7 of length 224 into portal 12 MB=0x69b4b86705100
00000400:00000200:13.0:1773851900.514358:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14051@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 61016
00000800:00000200:13.0:1773851900.514360:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851900.514361:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851900.514362:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13859@kfi7: PUT: OK
00000100:00000001:13.0:1773851900.514363:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851900.514363:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851900.514364:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003971e4e3.
00000100:00000040:13.0:1773851900.514365:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000003971e4e3 x1859598540624128 msgsize 224
00000100:00100000:13.0:1773851900.514366:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-14051@kfi7 (source: 12345-13859@kfi7)
00000100:00000001:13.0:1773851900.514367:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851900.514368:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000800:00000200:13.0:1773851900.514369:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851900.514370:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851900.514371:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851900.514372:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851900.514373:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851900.514374:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851900.514375:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598540624128
00000020:00000001:12.0:1773851900.514376:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851900.514377:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7eb10
00000020:00000001:12.0:1773851900.514378:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851900.514383:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e334522a refcount=5
00000020:00000001:12.0:1773851900.514383:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636965671813120 : -107108037738496 : ffff9e95f7754000)
00000020:00000001:12.0:1773851900.514384:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636965671813120 : -107108037738496 : ffff9e95f7754000)
00000100:00000001:12.0:1773851900.514385:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851900.514386:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851900.514387:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00000020:00000010:12.0:1773851900.514388:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851900.514389:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851900.514390:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851900.514390:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851900.514391:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851900.514392:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851900.514392:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851900.514393:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.514394:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851900.514395:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851900.514395:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851900.514396:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851900.514396:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851900.514397:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14051@kfi7, seq: 2289944
00000100:00000001:14.0:1773851900.514398:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851900.514398:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e334522a : new rpc_count 1
00000100:00000001:14.0:1773851900.514399:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.514399:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945727360 : -106919763824256 : ffff9ec1cd753180)
00000100:00000040:12.0:1773851900.514401:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003971e4e3 x1859598540624128/t0(0) o400->0bdc96a4-3516-4624-9207-97e6d1e438fd@14051@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1355-0'
00000100:00000001:12.0:1773851900.514404:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851900.514405:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851900.514406:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003971e4e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:0bdc96a4-3516-4624-9207-97e6d1e438fd+5:39536:x1859598540624128:12345-14051@kfi7:400:default-tuolumne1355-0
00000100:00000200:12.0:1773851900.514407:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598540624128
00000020:00000001:12.0:1773851900.514408:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851900.514409:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851900.514410:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.514410:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851900.514411:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851900.514412:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851900.514412:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598540624128, found 0 last_xid 1859598540624127
00000020:00000001:12.0:1773851900.514413:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851900.514414:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851900.514414:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851900.514415:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.514415:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851900.514416:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851900.514417:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851900.514417:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000077321034.
02000000:00000001:12.0:1773851900.514418:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.514419:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.514420:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851900.514420:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691983, transno 0, xid 1859598540624128
00010000:00000001:12.0:1773851900.514421:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851900.514422:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003971e4e3 x1859598540624128/t0(0) o400->0bdc96a4-3516-4624-9207-97e6d1e438fd@14051@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1355-0'
00010000:00000001:12.0:1773851900.514429:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851900.514429:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851900.514430:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=133 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851900.514431:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851900.514432:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d98afaf0 refcount 3 to 14051@kfi7
00000100:00000001:12.0:1773851900.514432:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985418304 : -107156724133312 : ffff9e8aa185d240)
02000000:00000001:12.0:1773851900.514433:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851900.514434:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851900.514434:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851900.514435:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13859@kfi7
00000400:00000010:12.0:1773851900.514436:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d873db14.
00000100:00000200:12.0:1773851900.514437:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598540624128, offset 224
00000400:00000200:12.0:1773851900.514439:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13859@kfi7
00000400:00000200:12.0:1773851900.514439:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:12.0:1773851900.514440:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 1
00000400:00000200:12.0:1773851900.514442:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000400:00000200:12.0:1773851900.514443:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 3
00000400:00000200:12.0:1773851900.514444:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13859@kfi7 local destination
00000400:00000200:12.0:1773851900.514445:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770354:8770354:1024:4294967295] 13859@kfi7 LPNI seq info [8608400:8608400:16:4294967295]
00000400:00000200:12.0:1773851900.514446:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000400:00000200:12.0:1773851900.514447:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13859@kfi7 to cpt 3
00000400:00000200:12.0:1773851900.514449:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13859@kfi7(13859@kfi7:13859@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851900.514450:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 3
00000800:00000200:12.0:1773851900.514451:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851900.514452:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851900.514454:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851900.514457:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x56 Using peer 13859@kfi7(0x56)
00000800:00000200:12.0:1773851900.514460:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x56: rc=0
00000800:00000200:12.0:1773851900.514462:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x56 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851900.514464:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851900.514465:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d98afaf0 refcount 2 to 14051@kfi7
00010000:00000001:12.0:1773851900.514465:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851900.514466:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851900.514466:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851900.514467:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003971e4e3 x1859598540624128/t0(0) o400->0bdc96a4-3516-4624-9207-97e6d1e438fd@14051@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1355-0'
00000100:00100000:12.0:1773851900.514472:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003971e4e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:0bdc96a4-3516-4624-9207-97e6d1e438fd+5:39536:x1859598540624128:12345-14051@kfi7:400:default-tuolumne1355-0 Request processed in 67us (106us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851900.514474:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14051@kfi7, seq: 2289944
00000100:00000040:12.0:1773851900.514475:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e334522a : new rpc_count 0
00000100:00000001:12.0:1773851900.514476:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851900.514476:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851900.514477:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851900.514478:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851900.514478:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851900.514479:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000e334522a : new refcount 4
00000100:00000001:12.0:1773851900.514480:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851900.514486:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x56 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851900.514488:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851900.514490:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13859@kfi7: PUT: OK
00000400:00000200:14.0:1773851900.514491:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d873db14
00000400:00000010:14.0:1773851900.514491:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d873db14.
00000100:00000001:14.0:1773851900.514492:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851900.514493:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851900.514494:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009115a3cc nid 13859@kfi7 refs 2
00000800:00000200:14.0:1773851900.514496:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2069@kfi7:3 -> 13859@kfi7(000000004540b70d):0x0 lsk 87 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x56 Transaction freed
00000800:00000200:21.0:1773851900.559821:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851900.559823:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851900.559825:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851900.559828:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851900.559831:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.559833:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23329@kfi7 : PUT - for me
00000400:00000200:21.0:1773851900.559834:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.559835:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 1
00000400:00000200:21.0:1773851900.559837:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.559838:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000400:00000200:21.0:1773851900.559839:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 3
00000400:00000200:21.0:1773851900.559840:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23521@kfi7 to cpt 7
00000400:00000200:21.0:1773851900.559842:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23521@kfi7 of length 224 into portal 12 MB=0x69b171abc0840
00000400:00000200:21.0:1773851900.559844:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23521@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 67792
00000800:00000200:21.0:1773851900.559846:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851900.559849:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.559850:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23329@kfi7: PUT: OK
00000100:00000001:21.0:1773851900.559852:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851900.559852:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851900.559854:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8711318.
00000100:00000040:21.0:1773851900.559855:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e8711318 x1859373395347520 msgsize 224
00000100:00100000:21.0:1773851900.559857:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23521@kfi7 (source: 12345-23329@kfi7)
00000100:00000001:21.0:1773851900.559858:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851900.559859:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000100:00000001:23.0:1773851900.559861:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851900.559862:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851900.559862:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851900.559863:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851900.559864:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851900.559865:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851900.559866:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859373395347520
00000020:00000001:23.0:1773851900.559867:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851900.559867:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793b05f36a
00000020:00000001:23.0:1773851900.559868:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851900.559873:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000a68feff refcount=5
00000020:00000001:23.0:1773851900.559874:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636919893070848 : -107153816480768 : ffff9e8b4ed51400)
00000020:00000001:23.0:1773851900.559875:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636919893070848 : -107153816480768 : ffff9e8b4ed51400)
00000100:00000001:23.0:1773851900.559877:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.559878:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851900.559879:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851900.559881:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.559882:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851900.559883:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851900.559884:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851900.559885:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.559886:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851900.559888:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851900.559889:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.559890:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.559892:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851900.559893:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851900.559893:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851900.559893:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851900.559894:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23521@kfi7, seq: 1998082
00000100:00000040:23.0:1773851900.559895:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000a68feff : new rpc_count 1
00000100:00000001:20.0:1773851900.559896:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.559897:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117837174656 : -106955872376960 : ffff9eb965386780)
00000100:00000001:20.0:1773851900.559897:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.559899:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e8711318 x1859373395347520/t0(0) o400->e45b2f0a-cd0b-453c-bf17-c38836be7af6@23521@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1951-0'
00000100:00000001:23.0:1773851900.559903:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.559904:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851900.559905:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8711318 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e45b2f0a-cd0b-453c-bf17-c38836be7af6+5:39691:x1859373395347520:12345-23521@kfi7:400:default-tuolumne1951-0
00000100:00000200:23.0:1773851900.559907:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859373395347520
00000020:00000001:23.0:1773851900.559908:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851900.559909:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851900.559910:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.559911:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851900.559912:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851900.559913:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851900.559914:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859373395347520, found 0 last_xid 1859373395347519
00000020:00000001:23.0:1773851900.559915:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851900.559916:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851900.559917:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851900.559918:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.559919:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851900.559920:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851900.559921:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851900.559922:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000da74e4da.
02000000:00000001:23.0:1773851900.559923:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.559925:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.559926:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851900.559927:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260816345, transno 0, xid 1859373395347520
00010000:00000001:23.0:1773851900.559929:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851900.559930:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e8711318 x1859373395347520/t0(0) o400->e45b2f0a-cd0b-453c-bf17-c38836be7af6@23521@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1951-0'
00010000:00000001:23.0:1773851900.559934:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851900.559935:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851900.559936:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=133 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851900.559937:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851900.559939:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c123457b refcount 3 to 23521@kfi7
00000100:00000001:23.0:1773851900.559940:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063552 : -107155994488064 : ffff9e8acd035300)
02000000:00000001:23.0:1773851900.559941:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851900.559942:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.559943:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851900.559944:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23329@kfi7
00000400:00000010:23.0:1773851900.559945:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000188fee2b.
00000100:00000200:23.0:1773851900.559946:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859373395347520, offset 224
00000400:00000200:23.0:1773851900.559948:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23329@kfi7
00000400:00000200:23.0:1773851900.559949:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.559951:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 1
00000400:00000200:23.0:1773851900.559952:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000400:00000200:23.0:1773851900.559954:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 3
00000400:00000200:23.0:1773851900.559956:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23329@kfi7 local destination
00000400:00000200:23.0:1773851900.559958:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770355:8770355:1024:4294967295] 23329@kfi7 LPNI seq info [7213984:7213984:16:4294967295]
00000400:00000200:23.0:1773851900.559960:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000400:00000200:23.0:1773851900.559961:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23329@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.559964:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23329@kfi7(23329@kfi7:23329@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851900.559966:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 3
00000800:00000200:23.0:1773851900.559969:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851900.559971:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851900.559974:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851900.559981:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9eb Using peer 23329@kfi7(0x9eb)
00000800:00000200:23.0:1773851900.559986:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000003da230f: Posted send of 324 bytes to peer 0x9eb: rc=0
00000800:00000200:23.0:1773851900.559988:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9eb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851900.559991:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.559993:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c123457b refcount 2 to 23521@kfi7
00010000:00000001:23.0:1773851900.559994:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851900.559995:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.559996:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851900.559997:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8711318 x1859373395347520/t0(0) o400->e45b2f0a-cd0b-453c-bf17-c38836be7af6@23521@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1951-0'
00000100:00100000:23.0:1773851900.560002:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8711318 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:e45b2f0a-cd0b-453c-bf17-c38836be7af6+5:39691:x1859373395347520:12345-23521@kfi7:400:default-tuolumne1951-0 Request processed in 98us (146us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851900.560002:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9eb TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851900.560004:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851900.560005:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23521@kfi7, seq: 1998082
00000400:00000200:21.0:1773851900.560005:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23329@kfi7: PUT: OK
00000100:00000040:23.0:1773851900.560006:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000a68feff : new rpc_count 0
00000400:00000200:21.0:1773851900.560007:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000188fee2b
00000100:00000001:23.0:1773851900.560008:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851900.560008:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:21.0:1773851900.560008:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000188fee2b.
00000020:00000010:23.0:1773851900.560009:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000100:00000001:21.0:1773851900.560009:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851900.560010:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000100:00000001:21.0:1773851900.560010:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851900.560011:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009adf31e4 nid 23329@kfi7 refs 2
00000020:00000010:23.0:1773851900.560012:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000020:00000040:23.0:1773851900.560013:0:61145:0:(genops.c:882:class_export_put()) PUTting export 000000000a68feff : new refcount 4
00000800:00000200:21.0:1773851900.560013:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000003da230f: 2069@kfi7:5 -> 23329@kfi7(00000000c5c3225a):0x0 lsk 2540 rsk 9 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9eb Transaction freed
00000100:00000001:23.0:1773851900.560014:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851900.584997:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851900.584997:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851900.584998:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851900.584998:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851900.584999:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851900.584999:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:29.0:1773851900.585001:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20450@kfi7(000000004da061a5):0x10d7 version: 2; local version 2; negotiated version: 2
00000800:00000200:30.0:1773851900.585002:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851900.585002:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 Using peer 20450@kfi7(0x1000000000010d7)
00000400:00000200:30.0:1773851900.585004:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20450@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.585004:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20450@kfi7 to cpt 7
00000400:00000200:30.0:1773851900.585005:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20450@kfi7 : PUT - for me
00000800:00000200:29.0:1773851900.585006:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002607bd23: Posted send of 38 bytes to peer 0x1000000000010d7: rc=0
00000400:00000200:30.0:1773851900.585007:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20450@kfi7 to cpt 7
00000400:00000200:30.0:1773851900.585008:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016765494 nid 20450@kfi7 refs 1
00000800:00000200:29.0:1773851900.585008:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851900.585010:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20450@kfi7 to cpt 7
00000400:00000200:30.0:1773851900.585011:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016765494 nid 20450@kfi7 refs 2
00000400:00000200:30.0:1773851900.585012:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000016765494 nid 20450@kfi7 refs 3
00000400:00000200:30.0:1773851900.585013:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20259@kfi7 to cpt 0
00000400:00000200:30.0:1773851900.585014:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20259@kfi7 of length 224 into portal 12 MB=0x699e144e7f080
00000400:00000200:30.0:1773851900.585016:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20259@kfi7 of length 224/224 into md 0x77fe1859d [64] + 11072
00000800:00000200:30.0:1773851900.585018:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851900.585020:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851900.585021:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:29.0:1773851900.585022:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 Transaction freed
00000400:00000200:30.0:1773851900.585023:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20450@kfi7: PUT: OK
00000100:00000001:30.0:1773851900.585024:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851900.585024:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851900.585025:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000032655417.
00000100:00000040:30.0:1773851900.585026:0:2472963:0:(events.c:358:request_in_callback()) incoming req@0000000032655417 x1858042663006336 msgsize 224
00000100:00100000:30.0:1773851900.585028:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-20259@kfi7 (source: 12345-20450@kfi7)
00000100:00000001:30.0:1773851900.585029:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851900.585030:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000016765494 nid 20450@kfi7 refs 2
00000800:00000200:30.0:1773851900.585032:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fd057322: 2054@kfi7:7 <- 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851900.585036:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851900.585036:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851900.585037:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851900.585037:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851900.585038:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851900.585039:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042663006336
00000020:00000001:30.0:1773851900.585040:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851900.585040:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac921b8
00000020:00000001:30.0:1773851900.585041:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851900.585044:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007958b3ca refcount=481
00000020:00000001:30.0:1773851900.585045:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629771264 : -107123079780352 : ffff9e9276e1e800)
00000020:00000001:30.0:1773851900.585046:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629771264 : -107123079780352 : ffff9e9276e1e800)
00000100:00000001:30.0:1773851900.585047:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851900.585048:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851900.585049:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049bbe91b.
00000020:00000010:30.0:1773851900.585050:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851900.585050:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c1e43eff.
00000100:00000001:30.0:1773851900.585051:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851900.585052:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851900.585053:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851900.585054:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851900.585055:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851900.585056:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.585057:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851900.585058:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851900.585058:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851900.585059:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851900.585059:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851900.585060:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20259@kfi7, seq: 2055603
00000100:00000040:31.0:1773851900.585060:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007958b3ca : new rpc_count 8
00000100:00000001:31.0:1773851900.585061:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411267584 : -106960298284032 : ffff9eb85d6a6c00)
00000100:00000001:30.0:1773851900.585061:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.585061:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851900.585062:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000032655417 x1858042663006336/t0(0) o400->3d41f69c-c681-4606-b049-c7a92f29f23d@20259@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1755-0'
00000100:00000001:31.0:1773851900.585065:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851900.585065:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851900.585066:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000032655417 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:3d41f69c-c681-4606-b049-c7a92f29f23d+481:39658:x1858042663006336:12345-20259@kfi7:400:default-tuolumne1755-0
00000100:00000200:31.0:1773851900.585068:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042663006336
00000020:00000001:31.0:1773851900.585068:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851900.585069:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851900.585070:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.585070:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851900.585071:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851900.585071:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851900.585072:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042663006336, found 0 last_xid 1858042623667775
00000020:00000001:31.0:1773851900.585073:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851900.585074:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851900.585074:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851900.585075:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.585076:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851900.585076:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851900.585076:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851900.585077:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000058cf92f8.
02000000:00000001:31.0:1773851900.585078:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.585078:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.585080:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851900.585080:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592967, transno 0, xid 1858042663006336
00010000:00000001:31.0:1773851900.585081:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851900.585082:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000032655417 x1858042663006336/t0(0) o400->3d41f69c-c681-4606-b049-c7a92f29f23d@20259@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1755-0'
00010000:00000001:31.0:1773851900.585084:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851900.585084:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851900.585085:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=133 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851900.585086:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851900.585087:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000567c149 refcount 3 to 20259@kfi7
00000100:00000001:31.0:1773851900.585088:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850077856 : -107143859473760 : ffff9e8da050f2a0)
02000000:00000001:31.0:1773851900.585088:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851900.585089:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.585089:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851900.585090:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20450@kfi7
00000400:00000010:31.0:1773851900.585091:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f33d0462.
00000100:00000200:31.0:1773851900.585092:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042663006336, offset 224
00000400:00000200:31.0:1773851900.585093:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20450@kfi7
00000400:00000200:31.0:1773851900.585094:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20450@kfi7 to cpt 7
00000400:00000200:31.0:1773851900.585095:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000016765494 nid 20450@kfi7 refs 1
00000400:00000200:31.0:1773851900.585096:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000016765494 nid 20450@kfi7 refs 2
00000400:00000200:31.0:1773851900.585097:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000016765494 nid 20450@kfi7 refs 3
00000400:00000200:31.0:1773851900.585098:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20450@kfi7 local destination
00000400:00000200:31.0:1773851900.585099:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770356:8770356:1024:4294967295] 20450@kfi7 LPNI seq info [10326437:10326437:16:4294967295]
00000400:00000200:31.0:1773851900.585101:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000016765494 nid 20450@kfi7 refs 2
00000400:00000200:31.0:1773851900.585102:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20450@kfi7 to cpt 7
00000400:00000200:31.0:1773851900.585103:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20450@kfi7(20450@kfi7:20450@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851900.585105:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000016765494 nid 20450@kfi7 refs 3
00000800:00000200:31.0:1773851900.585106:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851900.585107:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851900.585109:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851900.585113:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 Using peer 20450@kfi7(0x1000000000010d7)
00000800:00000200:31.0:1773851900.585117:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x1000000000010d7: rc=0
00000800:00000200:31.0:1773851900.585118:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851900.585120:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851900.585121:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000567c149 refcount 2 to 20259@kfi7
00010000:00000001:31.0:1773851900.585122:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851900.585122:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.585123:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851900.585124:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000032655417 x1858042663006336/t0(0) o400->3d41f69c-c681-4606-b049-c7a92f29f23d@20259@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1755-0'
00000100:00100000:31.0:1773851900.585127:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000032655417 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:3d41f69c-c681-4606-b049-c7a92f29f23d+481:39658:x1858042663006336:12345-20259@kfi7:400:default-tuolumne1755-0 Request processed in 61us (100us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851900.585129:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20259@kfi7, seq: 2055603
00000800:00000200:29.0:1773851900.585129:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851900.585130:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007958b3ca : new rpc_count 7
00000100:00000001:31.0:1773851900.585130:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851900.585131:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851900.585131:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851900.585131:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851900.585132:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c1e43eff.
00000400:00000200:29.0:1773851900.585132:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20450@kfi7: PUT: OK
00000400:00000200:29.0:1773851900.585132:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f33d0462
00000020:00000010:31.0:1773851900.585133:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049bbe91b.
00000400:00000010:29.0:1773851900.585133:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f33d0462.
00000100:00000001:29.0:1773851900.585133:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:31.0:1773851900.585134:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000007958b3ca : new refcount 480
00000100:00000001:31.0:1773851900.585134:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851900.585134:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851900.585135:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000016765494 nid 20450@kfi7 refs 2
00000800:00000200:29.0:1773851900.585136:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 20450@kfi7(000000004da061a5):0x0 lsk 4312 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000010d7 Transaction freed
00000800:00000200:29.0:1773851900.591945:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851900.591946:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851900.591947:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851900.591949:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851900.591950:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9729@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.591952:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9729@kfi7 : PUT - for me
00000400:00000200:29.0:1773851900.591952:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9729@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.591953:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007df2d1f3 nid 9729@kfi7 refs 1
00000400:00000200:29.0:1773851900.591955:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9729@kfi7 to cpt 7
00000400:00000200:29.0:1773851900.591955:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007df2d1f3 nid 9729@kfi7 refs 2
00000400:00000200:29.0:1773851900.591956:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007df2d1f3 nid 9729@kfi7 refs 3
00000400:00000200:29.0:1773851900.591957:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9920@kfi7 to cpt 6
00000400:00000200:29.0:1773851900.591958:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9920@kfi7 of length 224 into portal 12 MB=0x69b4bdb881680
00000400:00000200:29.0:1773851900.591959:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9920@kfi7 of length 224/224 into md 0x77fe1859d [64] + 11296
00000800:00000200:29.0:1773851900.591960:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851900.591962:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851900.591962:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9729@kfi7: PUT: OK
00000100:00000001:29.0:1773851900.591963:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851900.591964:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851900.591964:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000a333d7b.
00000100:00000040:29.0:1773851900.591965:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000000a333d7b x1859599968245376 msgsize 224
00000100:00100000:29.0:1773851900.591966:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-9920@kfi7 (source: 12345-9729@kfi7)
00000100:00000001:29.0:1773851900.591967:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851900.591968:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007df2d1f3 nid 9729@kfi7 refs 2
00000100:00000001:31.0:1773851900.591969:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851900.591969:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851900.591969:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851900.591969:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851900.591970:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851900.591970:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851900.591971:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599968245376
00000020:00000001:31.0:1773851900.591971:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851900.591972:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d79cf8
00000020:00000001:31.0:1773851900.591973:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851900.591977:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000020d557c5 refcount=280
00000020:00000001:31.0:1773851900.591978:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637040582517760 : -107033127033856 : ffff9ea7687be400)
00000020:00000001:31.0:1773851900.591978:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637040582517760 : -107033127033856 : ffff9ea7687be400)
00000100:00000001:31.0:1773851900.591980:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851900.591981:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851900.591981:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3c67bb1.
00000020:00000010:31.0:1773851900.591982:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851900.591982:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851900.591983:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851900.591983:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851900.591984:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851900.591985:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851900.591985:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851900.591985:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.591986:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851900.591987:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851900.591987:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851900.591988:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9920@kfi7, seq: 2055604
00000100:00000001:30.0:1773851900.591988:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851900.591988:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851900.591989:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000020d557c5 : new rpc_count 3
00000100:00000001:31.0:1773851900.591989:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137337969664 : -106936371581952 : ffff9ebdef8eec00)
00000100:00000001:30.0:1773851900.591989:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.591989:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851900.591990:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000a333d7b x1859599968245376/t0(0) o400->384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2@9920@kfi7:152/0 lens 224/0 e 0 to 0 dl 1773852267 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1107-0'
00000100:00000001:31.0:1773851900.591993:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851900.591993:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851900.591994:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000a333d7b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2+280:39676:x1859599968245376:12345-9920@kfi7:400:default-tuolumne1107-0
00000100:00000200:31.0:1773851900.591995:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599968245376
00000020:00000001:31.0:1773851900.591996:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851900.591996:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851900.591997:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.591997:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851900.591998:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851900.591999:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851900.592000:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599968245376, found 0 last_xid 1859599824447103
00000020:00000001:31.0:1773851900.592001:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851900.592001:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851900.592001:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851900.592002:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.592002:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851900.592003:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851900.592003:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851900.592005:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000493292a8.
02000000:00000001:31.0:1773851900.592006:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.592006:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.592007:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851900.592007:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592423, transno 0, xid 1859599968245376
00010000:00000001:31.0:1773851900.592008:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851900.592009:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000a333d7b x1859599968245376/t0(0) o400->384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2@9920@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1107-0'
00010000:00000001:31.0:1773851900.592011:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851900.592011:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851900.592012:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=133 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851900.592013:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851900.592014:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000014734729 refcount 3 to 9920@kfi7
00000100:00000001:31.0:1773851900.592014:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420608 : -107156724131008 : ffff9e8aa185db40)
02000000:00000001:31.0:1773851900.592015:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851900.592016:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.592016:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851900.592017:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9729@kfi7
00000400:00000010:31.0:1773851900.592017:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f33d0462.
00000100:00000200:31.0:1773851900.592018:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599968245376, offset 224
00000400:00000200:31.0:1773851900.592019:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9729@kfi7
00000400:00000200:31.0:1773851900.592020:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9729@kfi7 to cpt 7
00000400:00000200:31.0:1773851900.592021:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007df2d1f3 nid 9729@kfi7 refs 1
00000400:00000200:31.0:1773851900.592022:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007df2d1f3 nid 9729@kfi7 refs 2
00000400:00000200:31.0:1773851900.592023:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007df2d1f3 nid 9729@kfi7 refs 3
00000400:00000200:31.0:1773851900.592025:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9729@kfi7 local destination
00000400:00000200:31.0:1773851900.592026:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770357:8770357:1024:4294967295] 9729@kfi7 LPNI seq info [11094979:11094979:16:4294967295]
00000400:00000200:31.0:1773851900.592027:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007df2d1f3 nid 9729@kfi7 refs 2
00000400:00000200:31.0:1773851900.592028:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9729@kfi7 to cpt 7
00000400:00000200:31.0:1773851900.592030:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9729@kfi7(9729@kfi7:9729@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851900.592031:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007df2d1f3 nid 9729@kfi7 refs 3
00000800:00000200:31.0:1773851900.592032:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851900.592033:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851900.592035:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851900.592037:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000614 Using peer 9729@kfi7(0x100000000000614)
00000800:00000200:31.0:1773851900.592039:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x100000000000614: rc=0
00000800:00000200:31.0:1773851900.592041:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000614 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851900.592042:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851900.592043:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000014734729 refcount 2 to 9920@kfi7
00010000:00000001:31.0:1773851900.592044:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851900.592044:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851900.592045:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851900.592045:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000a333d7b x1859599968245376/t0(0) o400->384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2@9920@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1107-0'
00000100:00100000:31.0:1773851900.592048:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000a333d7b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:384b5e7a-e1bf-4b0b-9743-ebfe3427c3d2+280:39676:x1859599968245376:12345-9920@kfi7:400:default-tuolumne1107-0 Request processed in 54us (82us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851900.592050:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9920@kfi7, seq: 2055604
00000100:00000040:31.0:1773851900.592051:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000020d557c5 : new rpc_count 2
00000100:00000001:31.0:1773851900.592051:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851900.592052:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851900.592052:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000614 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851900.592053:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851900.592053:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851900.592054:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3c67bb1.
00000020:00000040:31.0:1773851900.592054:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000020d557c5 : new refcount 279
00000100:00000001:31.0:1773851900.592055:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851900.592055:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851900.592056:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9729@kfi7: PUT: OK
00000400:00000200:29.0:1773851900.592056:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f33d0462
00000400:00000010:29.0:1773851900.592057:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f33d0462.
00000100:00000001:29.0:1773851900.592057:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851900.592057:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851900.592058:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007df2d1f3 nid 9729@kfi7 refs 2
00000800:00000200:29.0:1773851900.592059:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2054@kfi7:7 -> 9729@kfi7(000000008b51923e):0x0 lsk 1557 rsk 8 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000614 Transaction freed
00000800:00000200:5.0:1773851900.718367:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851900.718369:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851900.718371:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851900.718375:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851900.718379:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851900.718381:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12353@kfi7 : PUT - for me
00000400:00000200:5.0:1773851900.718383:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851900.718384:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 1
00000400:00000200:5.0:1773851900.718386:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851900.718387:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000400:00000200:5.0:1773851900.718389:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 3
00000400:00000200:5.0:1773851900.718391:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:5.0:1773851900.718392:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12353@kfi7 of length 224 into portal 12 MB=0x69b4b8bcf1dc0
00000400:00000200:5.0:1773851900.718395:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12353@kfi7 of length 224/224 into md 0x793926dc5 [64] + 166664
00000800:00000200:5.0:1773851900.718398:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851900.718401:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851900.718403:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12353@kfi7: PUT: OK
00000100:00000001:5.0:1773851900.718405:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851900.718406:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851900.718407:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000051fc656a.
00000100:00000040:5.0:1773851900.718408:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000051fc656a x1859598630723008 msgsize 224
00000100:00100000:5.0:1773851900.718412:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-12353@kfi7 (source: 12345-12353@kfi7)
00000100:00000001:5.0:1773851900.718413:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851900.718415:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000100:00000001:4.0:1773851900.718415:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851900.718416:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851900.718416:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851900.718417:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851900.718417:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851900.718417:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851900.718418:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598630723008
00000020:00000001:4.0:1773851900.718419:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851900.718419:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fc3c
00000020:00000001:4.0:1773851900.718420:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851900.718423:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bb4b928d refcount=7
00000020:00000001:4.0:1773851900.718424:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136154940416 : -106937554611200 : ffff9ebda90b5400)
00000020:00000001:4.0:1773851900.718424:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136154940416 : -106937554611200 : ffff9ebda90b5400)
00000100:00000001:4.0:1773851900.718425:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851900.718426:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851900.718427:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851900.718428:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851900.718428:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007ea80e0f.
00000100:00000001:4.0:1773851900.718429:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851900.718430:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851900.718430:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851900.718431:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851900.718432:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851900.718432:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.718433:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851900.718435:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851900.718435:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851900.718436:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:4.0:1773851900.718436:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12353@kfi7, seq: 2001999
00000100:00000001:7.0:1773851900.718437:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:4.0:1773851900.718437:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bb4b928d : new rpc_count 3
00000100:00000001:4.0:1773851900.718437:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637097484331136 : -106976225220480 : ffff9eb4a818a880)
00000100:00000001:7.0:1773851900.718438:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.718439:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851900.718439:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000051fc656a x1859598630723008/t0(0) o400->fcbee1ec-186f-4f69-a3f9-2978df3c252a@12353@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1268-0'
00000100:00000001:4.0:1773851900.718441:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851900.718441:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851900.718442:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051fc656a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fcbee1ec-186f-4f69-a3f9-2978df3c252a+7:39738:x1859598630723008:12345-12353@kfi7:400:default-tuolumne1268-0
00000100:00000200:4.0:1773851900.718445:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598630723008
00000020:00000001:4.0:1773851900.718445:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851900.718446:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851900.718447:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851900.718448:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851900.718448:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851900.718449:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851900.718449:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598630723008, found 0 last_xid 1859598629660095
00000020:00000001:4.0:1773851900.718450:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851900.718451:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851900.718451:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851900.718452:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851900.718452:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851900.718453:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851900.718453:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851900.718454:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000013b74ccb.
02000000:00000001:4.0:1773851900.718455:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.718455:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851900.718456:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851900.718457:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183237937276, transno 0, xid 1859598630723008
00010000:00000001:4.0:1773851900.718457:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851900.718458:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000051fc656a x1859598630723008/t0(0) o400->fcbee1ec-186f-4f69-a3f9-2978df3c252a@12353@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1268-0'
00010000:00000001:4.0:1773851900.718461:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851900.718461:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851900.718462:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=132 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851900.718463:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851900.718464:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000010ad3832 refcount 3 to 12353@kfi7
00000100:00000001:4.0:1773851900.718465:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981632 : -107130476569984 : ffff9e90bdffda80)
02000000:00000001:4.0:1773851900.718466:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851900.718466:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851900.718467:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851900.718467:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12353@kfi7
00000400:00000010:4.0:1773851900.718468:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098ca3a41.
00000100:00000200:4.0:1773851900.718471:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598630723008, offset 224
00000400:00000200:4.0:1773851900.718472:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12353@kfi7
00000400:00000200:4.0:1773851900.718473:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:4.0:1773851900.718474:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 1
00000400:00000200:4.0:1773851900.718475:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000400:00000200:4.0:1773851900.718476:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 3
00000400:00000200:4.0:1773851900.718477:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12353@kfi7 local destination
00000400:00000200:4.0:1773851900.718478:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770358:8770358:1024:4294967295] 12353@kfi7 LPNI seq info [7741080:7741080:16:4294967295]
00000400:00000200:4.0:1773851900.718480:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000400:00000200:4.0:1773851900.718481:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12353@kfi7 to cpt 1
00000400:00000200:4.0:1773851900.718483:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12353@kfi7(12353@kfi7:12353@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851900.718484:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 3
00000800:00000200:4.0:1773851900.718485:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851900.718487:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851900.718489:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851900.718491:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000033f Using peer 12353@kfi7(0x10000000000033f)
00000800:00000200:4.0:1773851900.718495:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x10000000000033f: rc=0
00000800:00000200:4.0:1773851900.718496:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000033f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851900.718498:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851900.718499:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000010ad3832 refcount 2 to 12353@kfi7
00010000:00000001:4.0:1773851900.718500:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851900.718500:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851900.718501:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851900.718502:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000051fc656a x1859598630723008/t0(0) o400->fcbee1ec-186f-4f69-a3f9-2978df3c252a@12353@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1268-0'
00000100:00100000:4.0:1773851900.718506:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051fc656a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:fcbee1ec-186f-4f69-a3f9-2978df3c252a+7:39738:x1859598630723008:12345-12353@kfi7:400:default-tuolumne1268-0 Request processed in 65us (97us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851900.718509:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12353@kfi7, seq: 2001999
00000100:00000040:4.0:1773851900.718510:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bb4b928d : new rpc_count 2
00000100:00000001:4.0:1773851900.718511:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851900.718511:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851900.718512:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851900.718513:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007ea80e0f.
00000020:00000010:4.0:1773851900.718514:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000020:00000040:4.0:1773851900.718515:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000bb4b928d : new refcount 6
00000100:00000001:4.0:1773851900.718516:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851900.718523:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000033f TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851900.718526:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851900.718528:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12353@kfi7: PUT: OK
00000400:00000200:5.0:1773851900.718529:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098ca3a41
00000400:00000010:5.0:1773851900.718530:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098ca3a41.
00000100:00000001:5.0:1773851900.718531:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851900.718532:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851900.718533:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bbf06411 nid 12353@kfi7 refs 2
00000800:00000200:5.0:1773851900.718536:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 12353@kfi7(000000009503823c):0x0 lsk 832 rsk 20 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000033f Transaction freed
00000800:00000200:17.0:1773851900.725138:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851900.725139:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851900.725140:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851900.725142:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851900.725144:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.725145:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19666@kfi7 : PUT - for me
00000400:00000200:17.0:1773851900.725146:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.725147:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 1
00000400:00000200:17.0:1773851900.725148:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.725149:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000400:00000200:17.0:1773851900.725150:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 3
00000400:00000200:17.0:1773851900.725151:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19667@kfi7 to cpt 7
00000400:00000200:17.0:1773851900.725152:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19667@kfi7 of length 224 into portal 12 MB=0x69b0a343c4c00
00000400:00000200:17.0:1773851900.725153:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19667@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 48816
00000800:00000200:17.0:1773851900.725155:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851900.725156:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851900.725157:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19666@kfi7: PUT: OK
00000100:00000001:17.0:1773851900.725158:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851900.725159:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851900.725160:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f3afa73f.
00000100:00000040:17.0:1773851900.725161:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f3afa73f x1859317988609024 msgsize 224
00000100:00100000:17.0:1773851900.725162:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-19667@kfi7 (source: 12345-19666@kfi7)
00000100:00000001:17.0:1773851900.725163:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851900.725164:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851900.725164:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
02000000:00000001:19.0:1773851900.725165:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851900.725165:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851900.725166:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851900.725166:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851900.725167:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851900.725168:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317988609024
00000020:00000001:19.0:1773851900.725169:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851900.725169:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92236
00000020:00000001:19.0:1773851900.725170:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851900.725174:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000043c08bd2 refcount=6
00000020:00000001:19.0:1773851900.725174:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630006784 : -107123079544832 : ffff9e9276e58000)
00000020:00000001:19.0:1773851900.725175:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630006784 : -107123079544832 : ffff9e9276e58000)
00000100:00000001:19.0:1773851900.725176:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851900.725177:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851900.725178:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008ad35796.
00000020:00000010:19.0:1773851900.725179:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851900.725179:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c89cf037.
00000100:00000001:19.0:1773851900.725180:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851900.725181:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851900.725181:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851900.725182:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851900.725183:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851900.725183:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.725184:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851900.725185:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851900.725186:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851900.725186:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19667@kfi7, seq: 2156442
00000100:00000001:16.0:1773851900.725186:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:19.0:1773851900.725187:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000043c08bd2 : new rpc_count 1
00000100:00000001:16.0:1773851900.725187:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851900.725187:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.725188:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794791552 : -107029914760064 : ffff9ea827f34c80)
00000100:00000001:16.0:1773851900.725188:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851900.725189:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f3afa73f x1859317988609024/t0(0) o400->e20cc4ce-fa7e-4086-864e-6c4720af89a1@19667@kfi7:152/0 lens 224/0 e 0 to 0 dl 1773852267 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1717-0'
00000100:00000001:19.0:1773851900.725191:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851900.725192:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851900.725193:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f3afa73f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e20cc4ce-fa7e-4086-864e-6c4720af89a1+6:39496:x1859317988609024:12345-19667@kfi7:400:default-tuolumne1717-0
00000100:00000200:19.0:1773851900.725196:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317988609024
00000020:00000001:19.0:1773851900.725196:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851900.725197:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851900.725198:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.725198:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851900.725199:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851900.725200:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851900.725201:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317988609024, found 0 last_xid 1859317988609023
00000020:00000001:19.0:1773851900.725201:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851900.725202:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851900.725203:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851900.725203:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.725204:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851900.725204:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851900.725205:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851900.725205:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000583a54c2.
02000000:00000001:19.0:1773851900.725206:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.725207:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.725207:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851900.725208:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183243429769, transno 0, xid 1859317988609024
00010000:00000001:19.0:1773851900.725209:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851900.725210:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f3afa73f x1859317988609024/t0(0) o400->e20cc4ce-fa7e-4086-864e-6c4720af89a1@19667@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1717-0'
00010000:00000001:19.0:1773851900.725212:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851900.725213:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851900.725213:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=133 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851900.725214:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851900.725215:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000d6494d refcount 3 to 19667@kfi7
00000100:00000001:19.0:1773851900.725216:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270048 : -107152618281568 : ffff9e8b964025a0)
02000000:00000001:19.0:1773851900.725217:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851900.725217:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.725218:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851900.725219:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19666@kfi7
00000400:00000010:19.0:1773851900.725219:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cf50fa01.
00000100:00000200:19.0:1773851900.725221:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317988609024, offset 224
00000400:00000200:19.0:1773851900.725222:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19666@kfi7
00000400:00000200:19.0:1773851900.725223:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:19.0:1773851900.725223:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 1
00000400:00000200:19.0:1773851900.725225:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000400:00000200:19.0:1773851900.725226:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 3
00000400:00000200:19.0:1773851900.725227:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19666@kfi7 local destination
00000400:00000200:19.0:1773851900.725228:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770359:8770359:1024:4294967295] 19666@kfi7 LPNI seq info [6271474:6271474:16:4294967295]
00000400:00000200:19.0:1773851900.725230:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000400:00000200:19.0:1773851900.725230:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19666@kfi7 to cpt 4
00000400:00000200:19.0:1773851900.725232:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19666@kfi7(19666@kfi7:19666@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851900.725233:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 3
00000800:00000200:19.0:1773851900.725234:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851900.725235:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851900.725237:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851900.725240:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf34 Using peer 19666@kfi7(0xf34)
00000800:00000200:19.0:1773851900.725242:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0xf34: rc=0
00000800:00000200:19.0:1773851900.725243:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf34 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851900.725245:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851900.725246:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000d6494d refcount 2 to 19667@kfi7
00010000:00000001:19.0:1773851900.725247:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851900.725247:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.725248:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851900.725249:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f3afa73f x1859317988609024/t0(0) o400->e20cc4ce-fa7e-4086-864e-6c4720af89a1@19667@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1717-0'
00000100:00100000:19.0:1773851900.725252:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f3afa73f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:e20cc4ce-fa7e-4086-864e-6c4720af89a1+6:39496:x1859317988609024:12345-19667@kfi7:400:default-tuolumne1717-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851900.725254:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19667@kfi7, seq: 2156442
00000100:00000040:19.0:1773851900.725255:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000043c08bd2 : new rpc_count 0
00000800:00000200:17.0:1773851900.725255:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf34 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851900.725256:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851900.725256:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851900.725257:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851900.725257:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851900.725258:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c89cf037.
00000400:00000200:17.0:1773851900.725258:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19666@kfi7: PUT: OK
00000020:00000010:19.0:1773851900.725259:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008ad35796.
00000400:00000200:17.0:1773851900.725259:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cf50fa01
00000400:00000010:17.0:1773851900.725259:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cf50fa01.
00000020:00000040:19.0:1773851900.725260:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000043c08bd2 : new refcount 5
00000100:00000001:19.0:1773851900.725260:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851900.725260:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851900.725261:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851900.725262:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000032aa32d9 nid 19666@kfi7 refs 2
00000800:00000200:17.0:1773851900.725263:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2069@kfi7:4 -> 19666@kfi7(00000000a3d10827):0x0 lsk 3893 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0xf34 Transaction freed
00000004:00000001:4.0:1773851900.745732:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:4.0:1773851900.745732:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:28.0:1773851900.745733:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851900.745733:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:4.0:1773851900.745733:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008db7ad30.
00000004:00000001:29.0:1773851900.745734:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:28.0:1773851900.745734:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:4.0:1773851900.745734:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000004:00000020:29.0:1773851900.745735:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:6.0:1773851900.745735:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:4.0:1773851900.745735:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:0.0:1773851900.745735:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:29.0:1773851900.745736:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d411da6f.
00000100:00000010:28.0:1773851900.745736:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c6ebb3a1.
00000004:00000001:8.0:1773851900.745736:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
02000000:00000001:4.0:1773851900.745736:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:4.0:1773851900.745736:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:0.0:1773851900.745736:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:28.0:1773851900.745737:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000004:00000020:8.0:1773851900.745737:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851900.745737:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000794439fe.
02000000:00000010:4.0:1773851900.745737:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d7ad89bf.
00000020:00000040:29.0:1773851900.745738:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:4.0:1773851900.745738:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:0.0:1773851900.745738:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cc6defe8.
00000100:00000001:28.0:1773851900.745739:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:8.0:1773851900.745739:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001eed8194.
00000020:00000040:6.0:1773851900.745739:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
00000100:00000001:4.0:1773851900.745739:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851900.745740:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851900.745740:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851900.745740:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:0.0:1773851900.745740:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
02000000:00000001:29.0:1773851900.745741:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:28.0:1773851900.745741:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.745741:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851900.745742:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:8.0:1773851900.745742:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
02000000:00000001:6.0:1773851900.745742:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:4.0:1773851900.745742:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000008db7ad30] to pc [ptlrpcd_01_00+0]  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851900.745742:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:28.0:1773851900.745743:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000fd338e66.
02000000:00000001:0.0:1773851900.745743:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:29.0:1773851900.745744:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
00000100:00000001:8.0:1773851900.745744:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851900.745744:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851900.745744:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851900.745745:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851900.745745:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:29.0:1773851900.745746:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851900.745746:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000a8eda3b1.
00080000:00000001:4.0:1773851900.745746:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:29.0:1773851900.745747:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851900.745747:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:8.0:1773851900.745747:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851900.745747:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000d8f54850.
00000100:00000001:7.0:1773851900.745748:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851900.745748:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00080000:00000010:4.0:1773851900.745748:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d5f06b74.
00080000:00000001:4.0:1773851900.745748:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637125750003712 : -106947959547904 : ffff9ebb3cdc9800)
00000100:00000001:29.0:1773851900.745749:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851900.745749:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851900.745749:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00000100:00000001:7.0:1773851900.745749:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851900.745749:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851900.745749:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.745749:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745750:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851900.745750:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:4.0:1773851900.745750:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:29.0:1773851900.745751:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d411da6f] to pc [ptlrpcd_07_01+1]  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:28.0:1773851900.745751:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c6ebb3a1] to pc [ptlrpcd_07_00+0]  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851900.745751:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.745751:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851900.745751:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.745751:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:7.0:1773851900.745752:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00001000:4.0:1773851900.745752:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000100:00000001:0.0:1773851900.745752:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.745753:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:6.0:1773851900.745753:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000794439fe] to pc [ptlrpcd_01_01+1]  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:4.0:1773851900.745753:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005ee2eb52.
00000004:00080000:4.0:1773851900.745754:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614175199029252ns, next at 614176199027909ns, rc = 0
00000100:00000040:0.0:1773851900.745754:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000cc6defe8] to pc [ptlrpcd_00_03+3]  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851900.745755:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:4.0:1773851900.745755:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:4.0:1773851900.745756:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745757:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:4.0:1773851900.745757:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851900.745758:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001eed8194] to pc [ptlrpcd_02_00+0]  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851900.745758:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.745759:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:29.0:1773851900.745759:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851900.745759:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:7.0:1773851900.745759:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:31.0:1773851900.745760:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851900.745760:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
02000000:00000001:7.0:1773851900.745760:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851900.745761:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851900.745761:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:28.0:1773851900.745761:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b825c1cb.
00000100:00100000:7.0:1773851900.745761:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000008db7ad30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051941952:2085@kfi7:13:default-yuba2-0
00080000:00000001:6.0:1773851900.745761:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851900.745762:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000001:0.0:1773851900.745762:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.745763:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:28.0:1773851900.745763:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636940101196800 : -107133608354816 : ffff9e9003549c00)
00080000:00000010:6.0:1773851900.745763:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008355fee1.
00000100:00000040:30.0:1773851900.745764:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851900.745764:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:7.0:1773851900.745764:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:5.0:1773851900.745764:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851900.745764:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851900.745765:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:31.0:1773851900.745765:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851900.745765:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851900.745765:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851900.745765:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637002941970432 : -107070767581184 : ffff9e9ea4eeb800)
00000100:00000001:5.0:1773851900.745765:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:31.0:1773851900.745766:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:28.0:1773851900.745766:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.745766:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:2.0:1773851900.745766:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851900.745766:0:41062:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:31.0:1773851900.745767:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851900.745767:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
02000000:00000001:7.0:1773851900.745767:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:6.0:1773851900.745767:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:2.0:1773851900.745767:0:41063:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851900.745767:0:41062:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851900.745768:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d411da6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051942080:2056@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851900.745768:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:5.0:1773851900.745768:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:28.0:1773851900.745769:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000f8cb094e.
02000000:00000010:7.0:1773851900.745769:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000023aa93ab.
00080000:00000001:6.0:1773851900.745769:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851900.745769:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851900.745770:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851900.745770:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:28.0:1773851900.745770:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614175199045923ns, next at 614176199044040ns, rc = 0
00000100:00000001:9.0:1773851900.745770:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:7.0:1773851900.745770:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851900.745770:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
02000000:00000001:31.0:1773851900.745771:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851900.745771:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.745771:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851900.745771:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:8.0:1773851900.745771:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004fca8f50.
02000000:00000001:31.0:1773851900.745772:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:9.0:1773851900.745772:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851900.745772:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637065588990976 : -107008120560640 : ffff9ead3afc6400)
00000400:00000200:7.0:1773851900.745772:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000004:00000010:6.0:1773851900.745772:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ff9628b5.
02000000:00000010:31.0:1773851900.745773:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f0400889.
02000000:00000001:30.0:1773851900.745773:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:28.0:1773851900.745773:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:11.0:1773851900.745773:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:7.0:1773851900.745773:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
00000004:00080000:6.0:1773851900.745773:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614175199048678ns, next at 614176199046534ns, rc = 0
00000100:00000001:5.0:1773851900.745773:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:31.0:1773851900.745774:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851900.745774:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851900.745774:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851900.745774:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851900.745774:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000400:00000010:7.0:1773851900.745774:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000100:00000001:5.0:1773851900.745774:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851900.745775:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00100000:30.0:1773851900.745775:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c6ebb3a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051942016:2065@kfi7:13:default-yuba2-0
00080000:00000001:28.0:1773851900.745775:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851900.745775:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851900.745775:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:2.0:1773851900.745775:0:41063:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000400:00000010:31.0:1773851900.745776:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000000e01a7f3.
00000004:00000001:28.0:1773851900.745776:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851900.745776:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051941952, portal 4
00000100:00000001:2.0:1773851900.745776:0:41063:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851900.745777:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d658250.
00080000:00000001:8.0:1773851900.745777:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745777:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00080000:00000001:6.0:1773851900.745777:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851900.745777:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851900.745777:0:41063:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000200:31.0:1773851900.745778:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942080, portal 4
00000100:00000001:30.0:1773851900.745778:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00001000:8.0:1773851900.745778:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
00000100:00000001:7.0:1773851900.745778:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528709888 : -106978180841728 : ffff9eb433883f00)
00000004:00000001:6.0:1773851900.745778:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851900.745778:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000794439fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051942144:46@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851900.745779:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851900.745779:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637051649336320 : -107022060215296 : ffff9ea9fc1e2400)
02000000:00000001:30.0:1773851900.745779:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:9.0:1773851900.745779:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:2.0:1773851900.745779:0:41063:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851900.745780:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851900.745780:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851900.745780:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000039e6c558.
00000100:00000040:7.0:1773851900.745780:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:2.0:1773851900.745780:0:41063:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051942208:2057@kfi7:13:default-yuba2-0
00000100:00000040:31.0:1773851900.745781:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851900.745781:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00080000:8.0:1773851900.745781:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614175199056533ns, next at 614176199054499ns, rc = 0
00000100:00000001:5.0:1773851900.745781:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:30.0:1773851900.745782:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000000f9bad1b.
02000000:00000001:9.0:1773851900.745782:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:5.0:1773851900.745782:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851900.745783:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851900.745783:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851900.745783:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851900.745783:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745783:0:41063:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:31.0:1773851900.745784:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:5.0:1773851900.745784:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:2.0:1773851900.745784:0:41063:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000040:31.0:1773851900.745785:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000200:30.0:1773851900.745785:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00100000:9.0:1773851900.745785:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eed8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051942272:2055@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851900.745785:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745785:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:2.0:1773851900.745785:0:41063:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:31.0:1773851900.745786:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000eb75a26a.
00000100:00000200:31.0:1773851900.745786:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942080, offset 0
00000400:00000010:30.0:1773851900.745786:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000004:00000001:8.0:1773851900.745786:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851900.745786:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000080965be6.
00000100:00000001:9.0:1773851900.745787:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000040:7.0:1773851900.745787:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
02000000:00000001:5.0:1773851900.745787:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851900.745787:0:41063:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:31.0:1773851900.745788:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000010:30.0:1773851900.745788:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000147989c0.
02000000:00000001:9.0:1773851900.745788:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:7.0:1773851900.745788:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dc86469d.
02000000:00000010:2.0:1773851900.745788:0:41063:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000d3421c59.
02000000:00000001:9.0:1773851900.745789:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851900.745789:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051941952, offset 0
02000000:00000001:2.0:1773851900.745789:0:41063:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851900.745790:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000200:30.0:1773851900.745790:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942016, portal 4
02000000:00000001:9.0:1773851900.745790:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000200:5.0:1773851900.745790:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:31.0:1773851900.745791:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000100:00000001:30.0:1773851900.745791:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000010:9.0:1773851900.745791:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004470a3fd.
00000400:00000010:5.0:1773851900.745791:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045a04335.
00000400:00000200:31.0:1773851900.745792:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:30.0:1773851900.745792:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324235904 : -106976385315712 : ffff9eb49e8dcc80)
02000000:00000001:9.0:1773851900.745792:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851900.745792:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000400:00000200:2.0:1773851900.745792:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:7.0:1773851900.745793:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000010:5.0:1773851900.745793:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000400:00000010:2.0:1773851900.745793:0:41063:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000007f7464cb.
00000400:00000200:31.0:1773851900.745794:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:9.0:1773851900.745794:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000200:5.0:1773851900.745794:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942144, portal 4
00000400:00000010:2.0:1773851900.745794:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ab3765ed.
00000400:00000200:31.0:1773851900.745795:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000100:00000040:30.0:1773851900.745795:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851900.745795:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bef470ca.
00000400:00000200:7.0:1773851900.745795:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000001:5.0:1773851900.745796:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:31.0:1773851900.745797:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770359, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770358, p:4294967295, g:4294967295, h:1000]
00000400:00000010:9.0:1773851900.745797:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a07dae19.
00000400:00000200:7.0:1773851900.745797:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:5.0:1773851900.745797:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359417600 : -107048350134016 : ffff9ea3dd1dd100)
00000100:00000200:2.0:1773851900.745797:0:41063:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942208, portal 4
00000100:00000001:2.0:1773851900.745798:0:41063:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000200:9.0:1773851900.745799:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942272, portal 4
00000400:00000200:7.0:1773851900.745799:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000040:5.0:1773851900.745799:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851900.745799:0:41063:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203078272 : -107102506473344 : ffff9e974125a880)
00000400:00000200:31.0:1773851900.745800:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:30.0:1773851900.745800:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:9.0:1773851900.745800:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:31.0:1773851900.745801:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:9.0:1773851900.745801:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491259776 : -107117218291840 : ffff9e93d4411f80)
00000400:00000200:7.0:1773851900.745801:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000400:00000200:31.0:1773851900.745802:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000100:00000040:2.0:1773851900.745802:0:41063:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851900.745803:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770360:8770360:1024:4294967295] 2056@kfi7 LPNI seq info [5402407:5402407:16:4294967295]
00000100:00000040:30.0:1773851900.745803:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000400:00000010:30.0:1773851900.745804:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fff2943a.
00000100:00000040:9.0:1773851900.745804:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851900.745804:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770359, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770360, p:4294967295, g:4294967295, h:1000]
00000100:00000001:5.0:1773851900.745804:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851900.745805:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000200:30.0:1773851900.745805:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942016, offset 0
00000100:00000040:5.0:1773851900.745805:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
00000400:00000200:31.0:1773851900.745806:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000010:5.0:1773851900.745806:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070e61bd6.
00000400:00000200:7.0:1773851900.745807:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000200:5.0:1773851900.745807:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942144, offset 0
00000100:00000001:2.0:1773851900.745807:0:41063:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851900.745808:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000100:00000001:9.0:1773851900.745808:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:31.0:1773851900.745809:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851900.745809:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:2.0:1773851900.745809:0:41063:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000400:00000200:30.0:1773851900.745810:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000040:9.0:1773851900.745810:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000200:7.0:1773851900.745810:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:5.0:1773851900.745810:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000010:2.0:1773851900.745810:0:41063:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c63b795d.
00000400:00000200:31.0:1773851900.745811:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000010:9.0:1773851900.745811:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001328b840.
00000400:00000200:30.0:1773851900.745812:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000100:00000200:9.0:1773851900.745812:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942272, offset 0
00000400:00000200:7.0:1773851900.745812:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770361:8770361:1024:4294967295] 2085@kfi7 LPNI seq info [5403247:5403247:16:4294967295]
00000100:00000200:2.0:1773851900.745812:0:41063:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942208, offset 0
00000800:00000200:31.0:1773851900.745813:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851900.745814:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851900.745814:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:2.0:1773851900.745814:0:41063:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:9.0:1773851900.745815:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:7.0:1773851900.745815:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:30.0:1773851900.745816:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000800:00000200:31.0:1773851900.745817:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851900.745817:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:2.0:1773851900.745817:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:30.0:1773851900.745818:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000400:00000200:9.0:1773851900.745818:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:7.0:1773851900.745818:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:2.0:1773851900.745819:0:41063:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000800:00000200:31.0:1773851900.745820:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Using peer 2056@kfi7(0x200000000000202)
00000400:00000200:9.0:1773851900.745820:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:30.0:1773851900.745821:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770361, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770360, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851900.745821:0:41063:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:9.0:1773851900.745822:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:7.0:1773851900.745822:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000800:00000200:31.0:1773851900.745823:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x200000000000202: rc=0
00000400:00000200:9.0:1773851900.745824:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:2.0:1773851900.745824:0:41063:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000800:00000200:31.0:1773851900.745825:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851900.745825:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:7.0:1773851900.745825:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:30.0:1773851900.745827:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851900.745827:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770361, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770360, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851900.745827:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:2.0:1773851900.745827:0:41063:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000100:00000001:31.0:1773851900.745828:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.745828:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851900.745828:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000800:00000200:7.0:1773851900.745828:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:31.0:1773851900.745829:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851900.745829:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00000001:31.0:1773851900.745830:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851900.745830:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770362:8770362:1023:4294967295] 2065@kfi7 LPNI seq info [5402835:5402835:16:4294967295]
00000400:00000200:5.0:1773851900.745830:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:2.0:1773851900.745830:0:41063:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770361, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770360, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851900.745831:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851900.745831:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:31.0:1773851900.745832:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:5.0:1773851900.745832:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:30.0:1773851900.745833:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:9.0:1773851900.745833:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851900.745834:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:9.0:1773851900.745834:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000200:5.0:1773851900.745834:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000400:00000200:2.0:1773851900.745834:0:41063:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:31.0:1773851900.745835:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851900.745835:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851900.745835:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:2.0:1773851900.745835:0:41063:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851900.745836:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851900.745836:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851900.745836:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770363:8770363:1023:4294967295] 2055@kfi7 LPNI seq info [5404676:5404676:16:4294967295]
00000400:00000200:2.0:1773851900.745837:0:41063:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:9.0:1773851900.745838:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:5.0:1773851900.745838:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770363, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8770362, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851900.745839:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:2.0:1773851900.745839:0:41063:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770364:8770364:1023:4294967295] 2057@kfi7 LPNI seq info [5404113:5404113:16:4294967295]
00000400:00000200:30.0:1773851900.745840:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000800:00000200:29.0:1773851900.745840:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851900.745841:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851900.745842:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:2.0:1773851900.745842:0:41063:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:29.0:1773851900.745843:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:7.0:1773851900.745843:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851900.745843:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851900.745843:0:41063:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851900.745844:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851900.745844:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000800:00000200:30.0:1773851900.745845:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:29.0:1773851900.745845:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000400:00000200:9.0:1773851900.745846:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:5.0:1773851900.745846:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770365:8770365:1021:4294967295] 46@kfi7 LPNI seq info [5403865:5403865:16:4294967295]
00000400:00000200:29.0:1773851900.745847:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000eb75a26a
00000400:00000010:29.0:1773851900.745847:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000eb75a26a.
00000800:00000200:30.0:1773851900.745848:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851900.745848:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:7.0:1773851900.745848:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:2.0:1773851900.745848:0:41063:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000100:00000001:29.0:1773851900.745849:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:5.0:1773851900.745849:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:2.0:1773851900.745849:0:41063:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000100:00000200:29.0:1773851900.745850:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851900.745850:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851900.745851:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:2.0:1773851900.745851:0:41063:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:30.0:1773851900.745853:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851900.745853:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851900.745853:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Using peer 2085@kfi7(0x113)
00000800:00000200:2.0:1773851900.745853:0:41063:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:29.0:1773851900.745855:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:5.0:1773851900.745855:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000800:00000200:9.0:1773851900.745856:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Using peer 2055@kfi7(0x2f3)
00000100:00000040:29.0:1773851900.745857:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:2.0:1773851900.745857:0:41063:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851900.745858:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000400:00000200:5.0:1773851900.745858:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:7.0:1773851900.745859:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x113: rc=0
00000800:00000200:9.0:1773851900.745860:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000022757302: Posted send of 324 bytes to peer 0x2f3: rc=0
00000800:00000200:2.0:1773851900.745860:0:41063:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Using peer 2057@kfi7(0x295)
00000800:00000200:5.0:1773851900.745861:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:29.0:1773851900.745862:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851900.745862:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851900.745863:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:5.0:1773851900.745863:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851900.745865:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000fd057322: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000400:00000200:29.0:1773851900.745865:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000800:00000200:2.0:1773851900.745865:0:41063:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000e8d7e86a: Posted send of 324 bytes to peer 0x295: rc=0
00000800:00000200:29.0:1773851900.745867:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x200000000000202 Transaction freed
00000800:00000200:5.0:1773851900.745867:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851900.745867:0:41063:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851900.745868:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:9.0:1773851900.745869:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:1.0:1773851900.745869:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000001:2.0:1773851900.745870:0:41063:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745870:0:41063:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:1.0:1773851900.745870:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:30.0:1773851900.745871:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851900.745871:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745871:0:41063:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.745872:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851900.745872:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851900.745872:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745872:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851900.745872:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851900.745873:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745873:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851900.745874:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745874:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:2.0:1773851900.745874:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:1.0:1773851900.745874:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:9.0:1773851900.745875:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851900.745875:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745875:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851900.745876:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851900.745876:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851900.745876:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851900.745876:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851900.745876:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745876:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:1.0:1773851900.745876:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:30.0:1773851900.745877:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851900.745877:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851900.745877:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851900.745877:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851900.745877:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:2.0:1773851900.745877:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851900.745878:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851900.745878:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851900.745878:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851900.745878:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851900.745878:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745878:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:1.0:1773851900.745878:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2056@kfi7 : PUT - for me
00000100:00000001:30.0:1773851900.745879:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:10.0:1773851900.745879:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:9.0:1773851900.745879:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745879:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:6.0:1773851900.745879:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851900.745879:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.745880:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:10.0:1773851900.745880:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001328b840
00000100:00000001:7.0:1773851900.745880:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851900.745880:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:6.0:1773851900.745880:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000400:00000200:1.0:1773851900.745880:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:30.0:1773851900.745881:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851900.745881:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:10.0:1773851900.745881:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001328b840.
00000100:00000001:7.0:1773851900.745881:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745881:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851900.745881:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dc86469d
00000400:00000200:1.0:1773851900.745881:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:31.0:1773851900.745882:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851900.745882:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851900.745882:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000010:6.0:1773851900.745882:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dc86469d.
00000800:00000200:5.0:1773851900.745882:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000800:00000200:3.0:1773851900.745882:0:2506738:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851900.745882:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:30.0:1773851900.745883:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851900.745883:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.745883:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:1.0:1773851900.745883:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000200:6.0:1773851900.745884:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:3.0:1773851900.745884:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851900.745884:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:31.0:1773851900.745885:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000400:00000200:31.0:1773851900.745886:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fff2943a
00000100:00000001:10.0:1773851900.745886:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:5.0:1773851900.745886:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x3df: rc=0
00000400:00000200:3.0:1773851900.745886:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000400:00000200:1.0:1773851900.745886:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000040:10.0:1773851900.745887:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851900.745887:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:3.0:1773851900.745887:0:2506738:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c63b795d
00000400:00000200:1.0:1773851900.745887:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6cc0
00000400:00000010:31.0:1773851900.745888:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fff2943a.
00000100:00000040:6.0:1773851900.745888:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851900.745888:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000010:3.0:1773851900.745888:0:2506738:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c63b795d.
00000400:00000200:1.0:1773851900.745888:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:31.0:1773851900.745889:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:5.0:1773851900.745889:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851900.745889:0:2506738:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:10.0:1773851900.745890:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.745890:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000200:3.0:1773851900.745890:0:2506738:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851900.745890:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71e741 [1] + 224
00000100:00000200:31.0:1773851900.745891:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851900.745891:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851900.745891:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.745892:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851900.745892:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851900.745892:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851900.745893:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:5.0:1773851900.745893:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851900.745893:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851900.745894:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:5.0:1773851900.745894:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:3.0:1773851900.745894:0:2506738:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:10.0:1773851900.745895:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000022757302: 2069@kfi7:2 -> 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2f3 Transaction freed
00000100:00000001:5.0:1773851900.745895:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000040:3.0:1773851900.745895:0:2506738:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851900.745895:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851900.745896:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Transaction freed
00000100:00000001:5.0:1773851900.745896:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851900.745896:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851900.745896:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2056@kfi7: PUT: OK
00000100:00000001:31.0:1773851900.745897:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851900.745897:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851900.745897:0:2506738:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851900.745898:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851900.745898:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851900.745898:0:2506738:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:1.0:1773851900.745898:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:1.0:1773851900.745899:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:3.0:1773851900.745900:0:2506738:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000800:00000200:5.0:1773851900.745901:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851900.745902:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:3.0:1773851900.745902:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x295 Transaction freed
00000100:00000001:31.0:1773851900.745903:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:1.0:1773851900.745903:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851900.745904:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000400:00000200:5.0:1773851900.745904:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070e61bd6
00000100:00000001:31.0:1773851900.745905:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:5.0:1773851900.745905:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070e61bd6.
00000400:00000200:31.0:1773851900.745906:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:5.0:1773851900.745906:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851900.745907:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851900.745908:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:31.0:1773851900.745909:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fd057322: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Transaction freed
00000400:00000200:1.0:1773851900.745909:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:29.0:1773851900.745911:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:1.0:1773851900.745911:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 2056@kfi7(00000000afa1022e):0x0 lsk 515 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:29.0:1773851900.745912:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851900.745912:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000001:29.0:1773851900.745913:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:5.0:1773851900.745913:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:29.0:1773851900.745914:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:29.0:1773851900.745915:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000000e01a7f3.
00000400:00000200:29.0:1773851900.745916:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d658250
00000400:00000010:29.0:1773851900.745916:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d658250.
00000100:00000001:5.0:1773851900.745916:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851900.745917:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:6.0:1773851900.745917:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:5.0:1773851900.745917:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:29.0:1773851900.745918:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851900.745918:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851900.745919:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:13.0:1773851900.745920:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:6.0:1773851900.745920:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851900.745920:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000800:00000200:13.0:1773851900.745921:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:29.0:1773851900.745922:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851900.745922:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:13.0:1773851900.745922:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851900.745922:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851900.745923:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:29.0:1773851900.745924:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:29.0:1773851900.745925:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851900.745925:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851900.745925:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851900.745925:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:29.0:1773851900.745926:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:29.0:1773851900.745926:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:29.0:1773851900.745927:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:29.0:1773851900.745927:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851900.745927:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851900.745927:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:13.0:1773851900.745927:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:6.0:1773851900.745927:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2085@kfi7 : PUT - for me
02000000:00000001:29.0:1773851900.745928:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851900.745928:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:21.0:1773851900.745929:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:17.0:1773851900.745929:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851900.745929:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2057@kfi7 : PUT - for me
00000100:00001000:29.0:1773851900.745930:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=133 v=66 (66 66 66 66)
00000800:00000200:17.0:1773851900.745930:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851900.745930:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:6.0:1773851900.745930:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00001000:29.0:1773851900.745931:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=133 v=66 (1 1 1 1)
00000400:00000200:21.0:1773851900.745931:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:13.0:1773851900.745931:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:6.0:1773851900.745931:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:29.0:1773851900.745932:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:6.0:1773851900.745932:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:29.0:1773851900.745933:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851900.745933:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:21.0:1773851900.745933:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:17.0:1773851900.745933:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851900.745933:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:6.0:1773851900.745933:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00010000:00000001:29.0:1773851900.745934:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851900.745934:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:13.0:1773851900.745934:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:29.0:1773851900.745935:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:13.0:1773851900.745935:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:6.0:1773851900.745935:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000040:29.0:1773851900.745936:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000100:00000001:29.0:1773851900.745936:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:21.0:1773851900.745936:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.745936:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:17.0:1773851900.745936:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:29.0:1773851900.745937:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851900.745937:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:13.0:1773851900.745937:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:6.0:1773851900.745937:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6c40
00000100:00000040:29.0:1773851900.745938:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:17.0:1773851900.745938:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:13.0:1773851900.745938:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6d40
00000400:00000200:6.0:1773851900.745938:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:21.0:1773851900.745939:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:13.0:1773851900.745939:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:21.0:1773851900.745940:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6d80
00000400:00000200:17.0:1773851900.745940:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:6.0:1773851900.745940:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b325c5 [1] + 224
00000100:00000001:29.0:1773851900.745941:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:17.0:1773851900.745941:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:13.0:1773851900.745941:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f750d [1] + 224
00000800:00000200:9.0:1773851900.745941:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851900.745941:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:29.0:1773851900.745942:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:21.0:1773851900.745942:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:17.0:1773851900.745942:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000100:00000001:29.0:1773851900.745943:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851900.745943:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000800:00000200:9.0:1773851900.745943:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851900.745943:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000001:29.0:1773851900.745944:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:21.0:1773851900.745944:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d20b5 [1] + 224
00000400:00000200:17.0:1773851900.745944:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000800:00000200:13.0:1773851900.745944:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000040:29.0:1773851900.745945:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000400:00000200:17.0:1773851900.745945:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:9.0:1773851900.745945:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851900.745945:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000040:29.0:1773851900.745946:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545838592 avail=351536230400 avail_mb=1373188400 hwm_mb=3131103 files=372116360 ffree=343306483 state=0: rc = 0
00000800:00000200:21.0:1773851900.745946:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851900.745946:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851900.745947:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6c80
00000400:00000200:6.0:1773851900.745947:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000004:00000020:29.0:1773851900.745948:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545838592 free, 351536230400 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116360 files, 343306483 free files
00000400:00000200:21.0:1773851900.745948:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851900.745948:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851900.745948:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2057@kfi7: PUT: OK
00000400:00000200:9.0:1773851900.745948:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:6.0:1773851900.745948:0:2499722:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851900.745949:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2055@kfi7: PUT: OK
00000100:00000001:13.0:1773851900.745949:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851900.745949:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000100:00000200:6.0:1773851900.745949:0:2499722:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:29.0:1773851900.745950:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851900.745950:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851900.745950:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f2511 [1] + 224
00000400:00000200:9.0:1773851900.745950:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:29.0:1773851900.745951:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:13.0:1773851900.745951:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851900.745951:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000100:00000200:21.0:1773851900.745952:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851900.745952:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851900.745952:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:6.0:1773851900.745952:0:2499722:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:29.0:1773851900.745953:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d411da6f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051942080:2056@kfi7:13:default-yuba2-0
00000400:00000200:9.0:1773851900.745953:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:17.0:1773851900.745954:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:13.0:1773851900.745954:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851900.745954:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000001:29.0:1773851900.745955:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851900.745955:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:21.0:1773851900.745955:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851900.745955:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000040:29.0:1773851900.745956:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d411da6f x1859433051942080/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:17.0:1773851900.745956:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000400:00000200:9.0:1773851900.745956:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6d00
00000100:00000001:17.0:1773851900.745957:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:9.0:1773851900.745957:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:29.0:1773851900.745958:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000200:17.0:1773851900.745958:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851900.745958:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851900.745958:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781699249 [1] + 224
00000100:00000001:6.0:1773851900.745958:0:2499722:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:29.0:1773851900.745959:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:29.0:1773851900.745959:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f0400889.
00000400:00000200:13.0:1773851900.745959:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
02000000:00000001:29.0:1773851900.745960:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000800:00000200:9.0:1773851900.745960:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:7.0:1773851900.745960:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:6.0:1773851900.745960:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:2.0:1773851900.745960:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851900.745960:0:41063:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000020:00000001:29.0:1773851900.745961:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:29.0:1773851900.745961:0:41089:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000800:00000200:13.0:1773851900.745961:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 2057@kfi7(00000000208ff399):0x0 lsk 662 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851900.745961:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851900.745961:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:6.0:1773851900.745961:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007b4c751b: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:2.0:1773851900.745961:0:41063:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000020:00000001:29.0:1773851900.745962:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851900.745962:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
00000100:00000040:17.0:1773851900.745962:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851900.745962:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:7.0:1773851900.745962:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:2.0:1773851900.745962:0:41063:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
02000000:00000001:29.0:1773851900.745963:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:21.0:1773851900.745963:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851900.745963:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000400:00000010:7.0:1773851900.745963:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000400:00000010:2.0:1773851900.745963:0:41063:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000007f7464cb.
02000000:00000001:29.0:1773851900.745964:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:29.0:1773851900.745964:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d411da6f.
00000400:00000200:21.0:1773851900.745964:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:9.0:1773851900.745964:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:7.0:1773851900.745964:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000200:2.0:1773851900.745964:0:41063:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ab3765ed
00000100:00000001:29.0:1773851900.745965:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851900.745965:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851900.745965:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2055@kfi7(000000002bb87888):0x0 lsk 756 rsk 4784 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000200:9.0:1773851900.745965:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851900.745965:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:7.0:1773851900.745965:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000400:00000010:2.0:1773851900.745965:0:41063:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ab3765ed.
00000100:00000001:29.0:1773851900.745966:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851900.745966:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851900.745966:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851900.745966:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:2.0:1773851900.745966:0:41063:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851900.745967:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:17.0:1773851900.745967:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000001:8.0:1773851900.745967:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:7.0:1773851900.745967:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:2.0:1773851900.745967:0:41063:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851900.745968:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851900.745968:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851900.745968:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851900.745968:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:9.0:1773851900.745968:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:8.0:1773851900.745968:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:30.0:1773851900.745969:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:29.0:1773851900.745969:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851900.745969:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000010:8.0:1773851900.745969:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bef470ca.
00000400:00000001:30.0:1773851900.745970:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:30.0:1773851900.745970:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:8.0:1773851900.745970:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a07dae19
00000100:00000200:7.0:1773851900.745970:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:2.0:1773851900.745970:0:41063:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851900.745971:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000147989c0
00000400:00000010:8.0:1773851900.745971:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a07dae19.
00000400:00000010:30.0:1773851900.745972:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000147989c0.
00000100:00000001:9.0:1773851900.745972:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851900.745972:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851900.745972:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851900.745972:0:41063:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851900.745973:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:8.0:1773851900.745973:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851900.745973:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851900.745973:0:41063:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:30.0:1773851900.745974:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851900.745974:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:7.0:1773851900.745974:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:5.0:1773851900.745974:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851900.745974:0:41063:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:9.0:1773851900.745975:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:7.0:1773851900.745975:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851900.745975:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
02000000:00000001:2.0:1773851900.745975:0:41063:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:2.0:1773851900.745975:0:41063:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851900.745976:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851900.745976:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:5.0:1773851900.745976:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851900.745976:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:2.0:1773851900.745976:0:41063:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851900.745977:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:8.0:1773851900.745977:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:7.0:1773851900.745977:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851900.745977:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045a04335.
02000000:00000001:2.0:1773851900.745977:0:41063:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851900.745978:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=133 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851900.745978:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:5.0:1773851900.745978:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00001000:2.0:1773851900.745978:0:41063:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=133 v=66 (66 66 66 66)
00000100:00000001:30.0:1773851900.745979:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851900.745979:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851900.745979:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:7.0:1773851900.745979:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=133 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851900.745979:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:2.0:1773851900.745979:0:41063:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=133 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851900.745980:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851900.745980:0:41068:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:7.0:1773851900.745980:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000200:5.0:1773851900.745980:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851900.745980:0:41063:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851900.745981:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:30.0:1773851900.745981:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:8.0:1773851900.745981:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851900.745981:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745981:0:41063:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.745982:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851900.745982:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851900.745982:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851900.745982:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:2.0:1773851900.745982:0:41063:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:30.0:1773851900.745983:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851900.745983:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:5.0:1773851900.745983:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:2.0:1773851900.745983:0:41063:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851900.745984:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851900.745984:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.745984:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851900.745984:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000001:2.0:1773851900.745984:0:41063:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:2.0:1773851900.745984:0:41063:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000100:00001000:30.0:1773851900.745985:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=133 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851900.745985:0:41068:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=133 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851900.745985:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851900.745985:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851900.745985:0:41063:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:8.0:1773851900.745986:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=133 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851900.745986:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.745986:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851900.745986:0:41065:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:2.0:1773851900.745986:0:41063:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851900.745987:0:41088:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=133 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851900.745987:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:7.0:1773851900.745987:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:5.0:1773851900.745987:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000040:2.0:1773851900.745987:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851900.745988:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851900.745988:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.745988:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851900.745988:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.745989:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:30.0:1773851900.745989:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851900.745989:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:8.0:1773851900.745989:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851900.745989:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.745989:0:41063:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:30.0:1773851900.745990:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.745990:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:7.0:1773851900.745990:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00001000:5.0:1773851900.745990:0:41065:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=133 v=66 (66 66 66 66)
00000100:00000001:2.0:1773851900.745990:0:41063:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851900.745991:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851900.745991:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000001:7.0:1773851900.745991:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851900.745991:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:5.0:1773851900.745991:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=133 v=66 (1 1 1 1)
00000100:00000001:2.0:1773851900.745991:0:41063:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851900.745992:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000001:8.0:1773851900.745992:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851900.745992:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851900.745992:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:5.0:1773851900.745992:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:2.0:1773851900.745992:0:41063:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:30.0:1773851900.745993:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000040:7.0:1773851900.745993:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851900.745993:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351466002432 avail=351462887424 avail_mb=1372901904 hwm_mb=3131103 files=372062738 ffree=343228518 state=0: rc = 0
00000100:00000001:5.0:1773851900.745993:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851900.745993:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000040:2.0:1773851900.745993:0:41063:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000100:00000001:30.0:1773851900.745994:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851900.745994:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:5.0:1773851900.745994:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:2.0:1773851900.745994:0:41063:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406468096 avail=351404091392 avail_mb=1372672232 hwm_mb=3131103 files=372127068 ffree=343170379 state=0: rc = 0
00000100:00000040:30.0:1773851900.745995:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851900.745995:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851900.745995:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000100:00000001:8.0:1773851900.745996:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000020:7.0:1773851900.745996:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351466002432 free, 351462887424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062738 files, 343228518 free files
00000100:00000001:5.0:1773851900.745996:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851900.745996:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:2.0:1773851900.745996:0:41063:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406468096 free, 351404091392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127068 files, 343170379 free files
00000100:00000001:8.0:1773851900.745997:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851900.745998:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851900.745998:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851900.745998:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851900.745998:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851900.745998:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:2.0:1773851900.745998:0:41063:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.745999:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851900.745999:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851900.745999:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00000040:7.0:1773851900.745999:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:2.0:1773851900.745999:0:41063:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:30.0:1773851900.746000:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851900.746000:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851900.746000:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382735872 avail=351380670464 avail_mb=1372580744 hwm_mb=3131101 files=371978596 ffree=343147203 state=0: rc = 0
00000100:00000001:5.0:1773851900.746000:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:30.0:1773851900.746001:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464023040 avail=351458265088 avail_mb=1372883848 hwm_mb=3131101 files=372064662 ffree=343226585 state=0: rc = 0
00000100:00000001:5.0:1773851900.746001:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000004:00000020:8.0:1773851900.746002:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382735872 free, 351380670464 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371978596 files, 343147203 free files
00000100:00100000:7.0:1773851900.746002:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000008db7ad30 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051941952:2085@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851900.746002:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851900.746002:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00100000:2.0:1773851900.746002:0:41063:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000cc6defe8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre5-MDT0001-mdtlov_UUID:41063:1859433051942208:2057@kfi7:13:default-yuba2-0
00000004:00000020:30.0:1773851900.746003:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464023040 free, 351458265088 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064662 files, 343226585 free files
00000100:00000001:7.0:1773851900.746003:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851900.746004:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851900.746004:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:5.0:1773851900.746004:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000004:00000040:5.0:1773851900.746004:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489069056 avail=351486055424 avail_mb=1372992404 hwm_mb=3131103 files=372066722 ffree=343251044 state=0: rc = 0
00000100:00000001:2.0:1773851900.746004:0:41063:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851900.746004:0:41063:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:30.0:1773851900.746005:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851900.746005:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000008db7ad30 x1859433051941952/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:2.0:1773851900.746005:0:41063:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000cc6defe8 x1859433051942208/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851900.746006:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:8.0:1773851900.746006:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:5.0:1773851900.746006:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489069056 free, 351486055424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066722 files, 343251044 free files
00000004:00000001:5.0:1773851900.746008:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.746008:0:41063:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:2.0:1773851900.746008:0:41063:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:30.0:1773851900.746009:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c6ebb3a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051942016:2065@kfi7:13:default-yuba2-0
00000100:00000040:5.0:1773851900.746009:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:2.0:1773851900.746009:0:41063:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000d3421c59.
00000100:00100000:8.0:1773851900.746010:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eed8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051942272:2055@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851900.746010:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:2.0:1773851900.746010:0:41063:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:30.0:1773851900.746011:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851900.746011:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:8.0:1773851900.746011:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851900.746011:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851900.746011:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000023aa93ab.
00000020:00000001:2.0:1773851900.746011:0:41063:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:2.0:1773851900.746011:0:41063:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000100:00000040:30.0:1773851900.746012:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c6ebb3a1 x1859433051942016/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851900.746012:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:7.0:1773851900.746012:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00100000:5.0:1773851900.746012:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000794439fe pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051942144:46@kfi7:13:default-yuba2-0
00000020:00000001:2.0:1773851900.746012:0:41063:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:2.0:1773851900.746012:0:41063:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d8f54850.
00000100:00000040:8.0:1773851900.746013:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001eed8194 x1859433051942272/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:7.0:1773851900.746013:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851900.746013:0:41064:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
00000100:00000001:5.0:1773851900.746013:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:2.0:1773851900.746013:0:41063:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:7.0:1773851900.746014:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851900.746014:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000d7ad89bf.
00000100:00000001:5.0:1773851900.746014:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:2.0:1773851900.746014:0:41063:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851900.746014:0:41063:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000cc6defe8.
00000100:00000001:30.0:1773851900.746015:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851900.746015:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:7.0:1773851900.746015:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:5.0:1773851900.746015:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000794439fe x1859433051942144/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852053 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851900.746015:0:41063:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000010:30.0:1773851900.746016:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000000f9bad1b.
00000100:00000001:8.0:1773851900.746016:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851900.746016:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000001:7.0:1773851900.746016:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851900.746016:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000008db7ad30.
00000100:00000001:2.0:1773851900.746016:0:41063:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851900.746016:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851900.746017:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000010:8.0:1773851900.746017:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004470a3fd.
00000100:00000001:7.0:1773851900.746017:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851900.746017:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851900.746017:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:2.0:1773851900.746017:0:41063:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:30.0:1773851900.746018:0:41088:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:8.0:1773851900.746018:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:7.0:1773851900.746018:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:5.0:1773851900.746018:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:2.0:1773851900.746018:0:41063:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851900.746018:0:41063:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000020:00000040:30.0:1773851900.746019:0:41088:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000020:00000001:30.0:1773851900.746019:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000001:8.0:1773851900.746019:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851900.746019:0:41068:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000100:00000001:7.0:1773851900.746019:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851900.746019:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851900.746019:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000080965be6.
00000100:00000001:2.0:1773851900.746019:0:41063:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851900.746020:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000fd338e66.
00000020:00000001:8.0:1773851900.746020:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851900.746020:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851900.746020:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851900.746020:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851900.746020:0:41065:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:30.0:1773851900.746021:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000010:8.0:1773851900.746021:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
02000000:00000001:8.0:1773851900.746021:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000040:5.0:1773851900.746021:0:41065:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
02000000:00000001:30.0:1773851900.746022:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851900.746022:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c6ebb3a1.
02000000:00000001:8.0:1773851900.746022:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:5.0:1773851900.746022:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851900.746022:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000a8eda3b1.
00000100:00000001:30.0:1773851900.746023:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000010:8.0:1773851900.746023:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001eed8194.
02000000:00000001:5.0:1773851900.746023:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:30.0:1773851900.746024:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851900.746024:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:5.0:1773851900.746024:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851900.746024:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000794439fe.
00000100:00000001:30.0:1773851900.746025:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851900.746025:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851900.746025:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851900.746025:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851900.746025:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851900.746025:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851900.746026:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851900.746026:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851900.746026:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851900.746026:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851900.746027:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.746027:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.746027:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851900.746027:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851900.746027:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.746028:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851900.746028:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851900.746029:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851900.764808:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851900.764809:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851900.764811:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851900.764813:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851900.764815:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:25.0:1773851900.764816:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25251@kfi7 : PUT - for me
00000400:00000200:25.0:1773851900.764817:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:25.0:1773851900.764818:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 1
00000400:00000200:25.0:1773851900.764818:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:25.0:1773851900.764819:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000400:00000200:25.0:1773851900.764820:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 3
00000400:00000200:25.0:1773851900.764821:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25250@kfi7 to cpt 3
00000400:00000200:25.0:1773851900.764821:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25250@kfi7 of length 224 into portal 12 MB=0x69b4c52f19c80
00000400:00000200:25.0:1773851900.764823:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25250@kfi7 of length 224/224 into md 0x16159c9699 [64] + 41568
00000800:00000200:25.0:1773851900.764824:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851900.764826:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851900.764827:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25251@kfi7: PUT: OK
00000100:00000001:25.0:1773851900.764828:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851900.764828:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851900.764829:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000026d898f1.
00000100:00000040:25.0:1773851900.764830:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000026d898f1 x1859601971649664 msgsize 224
00000100:00100000:25.0:1773851900.764831:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-25250@kfi7 (source: 12345-25251@kfi7)
00000100:00000001:25.0:1773851900.764832:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851900.764833:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000100:00000001:26.0:1773851900.764834:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851900.764834:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851900.764834:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851900.764835:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851900.764835:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851900.764836:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851900.764837:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601971649664
00000020:00000001:26.0:1773851900.764838:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851900.764838:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7c835
00000020:00000001:26.0:1773851900.764839:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851900.764841:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077df1929 refcount=5
00000020:00000001:26.0:1773851900.764842:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142647362560 : -106931062189056 : ffff9ebf2c05d400)
00000020:00000001:26.0:1773851900.764843:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142647362560 : -106931062189056 : ffff9ebf2c05d400)
00000100:00000001:26.0:1773851900.764844:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851900.764845:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851900.764846:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000043d0394d.
00000020:00000010:26.0:1773851900.764847:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851900.764848:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851900.764849:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851900.764850:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851900.764850:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851900.764851:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851900.764852:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851900.764852:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851900.764853:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851900.764854:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851900.764855:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851900.764855:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851900.764855:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851900.764856:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25250@kfi7, seq: 2025193
00000100:00000040:26.0:1773851900.764857:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077df1929 : new rpc_count 1
00000100:00000001:26.0:1773851900.764857:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121199412864 : -106952510138752 : ffff9eba2da01680)
00000100:00000001:24.0:1773851900.764857:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851900.764857:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851900.764858:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000026d898f1 x1859601971649664/t0(0) o400->e755ee86-706a-4dae-86e4-1329d80d4283@25250@kfi7:150/0 lens 224/0 e 0 to 0 dl 1773852265 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2060-0'
00000100:00000001:26.0:1773851900.764861:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851900.764861:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851900.764862:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000026d898f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e755ee86-706a-4dae-86e4-1329d80d4283+5:39570:x1859601971649664:12345-25250@kfi7:400:default-tuolumne2060-0
00000100:00000200:26.0:1773851900.764864:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601971649664
00000020:00000001:26.0:1773851900.764864:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851900.764865:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851900.764865:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.764866:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851900.764867:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851900.764867:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851900.764868:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601971649664, found 0 last_xid 1859601971649663
00000020:00000001:26.0:1773851900.764869:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851900.764869:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851900.764870:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851900.764870:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.764872:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851900.764873:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851900.764873:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851900.764874:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000932fc3e1.
02000000:00000001:26.0:1773851900.764875:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851900.764875:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.764876:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851900.764877:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824564, transno 0, xid 1859601971649664
00010000:00000001:26.0:1773851900.764878:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851900.764878:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000026d898f1 x1859601971649664/t0(0) o400->e755ee86-706a-4dae-86e4-1329d80d4283@25250@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2060-0'
00010000:00000001:26.0:1773851900.764881:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851900.764882:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851900.764882:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=133 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851900.764883:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851900.764884:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000281813b7 refcount 3 to 25250@kfi7
00000100:00000001:26.0:1773851900.764885:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149920 : -107154898401696 : ffff9e8b0e584660)
02000000:00000001:26.0:1773851900.764886:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851900.764886:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851900.764887:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851900.764888:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25251@kfi7
00000400:00000010:26.0:1773851900.764889:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f71e1c4.
00000100:00000200:26.0:1773851900.764889:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601971649664, offset 224
00000400:00000200:26.0:1773851900.764891:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25251@kfi7
00000400:00000200:26.0:1773851900.764892:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:26.0:1773851900.764892:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 1
00000400:00000200:26.0:1773851900.764893:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000400:00000200:26.0:1773851900.764895:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 3
00000400:00000200:26.0:1773851900.764896:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25251@kfi7 local destination
00000400:00000200:26.0:1773851900.764897:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770366:8770366:1024:4294967295] 25251@kfi7 LPNI seq info [1058368:1058368:16:4294967295]
00000400:00000200:26.0:1773851900.764899:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000400:00000200:26.0:1773851900.764899:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25251@kfi7 to cpt 6
00000400:00000200:26.0:1773851900.764901:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25251@kfi7(25251@kfi7:25251@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851900.764903:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 3
00000800:00000200:26.0:1773851900.764905:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851900.764906:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851900.764908:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851900.764910:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e6d Using peer 25251@kfi7(0x100000000000e6d)
00000800:00000200:26.0:1773851900.764913:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 324 bytes to peer 0x100000000000e6d: rc=0
00000800:00000200:26.0:1773851900.764915:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e6d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851900.764917:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851900.764918:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000281813b7 refcount 2 to 25250@kfi7
00010000:00000001:26.0:1773851900.764919:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851900.764919:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851900.764920:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851900.764920:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000026d898f1 x1859601971649664/t0(0) o400->e755ee86-706a-4dae-86e4-1329d80d4283@25250@kfi7:150/0 lens 224/224 e 0 to 0 dl 1773852265 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2060-0'
00000100:00100000:26.0:1773851900.764923:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000026d898f1 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:e755ee86-706a-4dae-86e4-1329d80d4283+5:39570:x1859601971649664:12345-25250@kfi7:400:default-tuolumne2060-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851900.764926:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25250@kfi7, seq: 2025193
00000100:00000040:26.0:1773851900.764926:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077df1929 : new rpc_count 0
00000100:00000001:26.0:1773851900.764927:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:25.0:1773851900.764927:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e6d TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851900.764928:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851900.764928:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851900.764928:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851900.764929:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000400:00000200:25.0:1773851900.764929:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25251@kfi7: PUT: OK
00000020:00000010:26.0:1773851900.764930:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000043d0394d.
00000400:00000200:25.0:1773851900.764930:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f71e1c4
00000020:00000040:26.0:1773851900.764931:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000077df1929 : new refcount 4
00000100:00000001:26.0:1773851900.764931:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:25.0:1773851900.764931:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f71e1c4.
00000100:00000001:25.0:1773851900.764931:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851900.764932:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851900.764933:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000af04606f nid 25251@kfi7 refs 2
00000800:00000200:25.0:1773851900.764934:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2054@kfi7:6 -> 25251@kfi7(00000000cd6d8e88):0x0 lsk 3694 rsk 5 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000e6d Transaction freed
00000400:00000200:29.0:1773851900.809732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851900.809733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:10.0:1773851900.844828:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851900.844828:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851900.844829:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851900.844829:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851900.844830:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851900.844830:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851900.844832:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851900.844832:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 24480@kfi7(00000000b33d17f7):0x6fc version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851900.844835:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000800:00000200:9.0:1773851900.844835:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc Using peer 24480@kfi7(0x6fc)
00000400:00000200:10.0:1773851900.844836:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24480@kfi7 : PUT - for me
00000400:00000200:9.0:1773851900.844836:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000400:00000200:10.0:1773851900.844837:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000400:00000200:10.0:1773851900.844838:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fba9494 nid 24480@kfi7 refs 1
00000800:00000200:9.0:1773851900.844838:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000438708cd: Posted send of 38 bytes to peer 0x6fc: rc=0
00000400:00000200:10.0:1773851900.844840:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000400:00000200:10.0:1773851900.844840:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fba9494 nid 24480@kfi7 refs 2
00000800:00000200:9.0:1773851900.844840:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851900.844841:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009fba9494 nid 24480@kfi7 refs 3
00000400:00000200:10.0:1773851900.844842:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000400:00000200:10.0:1773851900.844843:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24480@kfi7 of length 224 into portal 12 MB=0x69b8271492d80
00000400:00000200:10.0:1773851900.844845:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24480@kfi7 of length 224/224 into md 0x78146ce49 [64] + 165520
00000800:00000200:10.0:1773851900.844847:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851900.844849:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851900.844850:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24480@kfi7: PUT: OK
00000100:00000001:10.0:1773851900.844851:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:11.0:1773851900.844852:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc TN_EVENT_TX_OK event status 0
00000100:00000200:10.0:1773851900.844852:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851900.844853:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000089acaf6f.
00000100:00000040:10.0:1773851900.844853:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000089acaf6f x1859834408938880 msgsize 224
00000800:00000200:11.0:1773851900.844855:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000438708cd: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc Transaction freed
00000100:00100000:10.0:1773851900.844855:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-24480@kfi7 (source: 12345-24480@kfi7)
00000100:00000001:10.0:1773851900.844856:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851900.844857:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009fba9494 nid 24480@kfi7 refs 2
00000100:00000001:8.0:1773851900.844858:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851900.844859:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000019dc57a6: 2069@kfi7:2 <- 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851900.844859:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851900.844860:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851900.844860:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851900.844861:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851900.844862:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859834408938880
00000020:00000001:8.0:1773851900.844862:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851900.844863:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875ee00af3
00000020:00000001:8.0:1773851900.844863:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851900.844867:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009cd0a936 refcount=210
00000020:00000001:8.0:1773851900.844867:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133105587200 : -106940603964416 : ffff9ebcf349e400)
00000020:00000001:8.0:1773851900.844868:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133105587200 : -106940603964416 : ffff9ebcf349e400)
00000100:00000001:8.0:1773851900.844869:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851900.844870:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851900.844871:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851900.844872:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851900.844873:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851900.844874:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851900.844874:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851900.844875:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851900.844876:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851900.844877:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851900.844877:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.844878:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851900.844880:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851900.844880:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851900.844880:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851900.844881:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851900.844882:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24480@kfi7, seq: 2130884
00000100:00000040:8.0:1773851900.844882:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009cd0a936 : new rpc_count 8
00000100:00000001:9.0:1773851900.844883:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851900.844883:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.844883:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087749504 : -106944621802112 : ffff9ebc03ce8d80)
00000100:00000040:8.0:1773851900.844885:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000089acaf6f x1859834408938880/t0(0) o400->0a9a84d7-3b33-4079-b892-6b1b660a69ab@24480@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2016-0'
00000100:00000001:8.0:1773851900.844888:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851900.844888:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851900.844889:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000089acaf6f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:0a9a84d7-3b33-4079-b892-6b1b660a69ab+210:39693:x1859834408938880:12345-24480@kfi7:400:default-tuolumne2016-0
00000100:00000200:8.0:1773851900.844891:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859834408938880
00000020:00000001:8.0:1773851900.844891:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851900.844892:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851900.844893:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.844894:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851900.844895:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851900.844896:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851900.844896:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859834408938880, found 0 last_xid 1859834350631359
00000020:00000001:8.0:1773851900.844898:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851900.844898:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851900.844899:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851900.844899:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.844900:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851900.844901:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851900.844901:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851900.844902:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000029d2418.
02000000:00000001:8.0:1773851900.844903:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.844904:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.844904:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851900.844905:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264578128, transno 0, xid 1859834408938880
00010000:00000001:8.0:1773851900.844906:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851900.844907:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000089acaf6f x1859834408938880/t0(0) o400->0a9a84d7-3b33-4079-b892-6b1b660a69ab@24480@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2016-0'
00010000:00000001:8.0:1773851900.844909:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851900.844910:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851900.844911:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=133 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851900.844912:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851900.844912:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032330ec1 refcount 3 to 24480@kfi7
00000100:00000001:8.0:1773851900.844913:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994448160 : -107149715103456 : ffff9e8c434b2120)
02000000:00000001:8.0:1773851900.844914:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851900.844914:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.844915:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851900.844916:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24480@kfi7
00000400:00000010:8.0:1773851900.844917:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006188a4b8.
00000100:00000200:8.0:1773851900.844918:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859834408938880, offset 224
00000400:00000200:8.0:1773851900.844919:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24480@kfi7
00000400:00000200:8.0:1773851900.844920:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000400:00000200:8.0:1773851900.844921:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009fba9494 nid 24480@kfi7 refs 1
00000400:00000200:8.0:1773851900.844922:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009fba9494 nid 24480@kfi7 refs 2
00000400:00000200:8.0:1773851900.844923:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009fba9494 nid 24480@kfi7 refs 3
00000400:00000200:8.0:1773851900.844924:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24480@kfi7 local destination
00000400:00000200:8.0:1773851900.844926:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770367:8770367:1024:4294967295] 24480@kfi7 LPNI seq info [2995988:2995988:16:4294967295]
00000400:00000200:8.0:1773851900.844927:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009fba9494 nid 24480@kfi7 refs 2
00000400:00000200:8.0:1773851900.844928:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24480@kfi7 to cpt 2
00000400:00000200:8.0:1773851900.844930:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24480@kfi7(24480@kfi7:24480@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851900.844932:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009fba9494 nid 24480@kfi7 refs 3
00000800:00000200:8.0:1773851900.844933:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851900.844934:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851900.844937:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851900.844939:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc Using peer 24480@kfi7(0x6fc)
00000800:00000200:8.0:1773851900.844942:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x6fc: rc=0
00000800:00000200:8.0:1773851900.844944:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851900.844946:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851900.844947:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032330ec1 refcount 2 to 24480@kfi7
00010000:00000001:8.0:1773851900.844948:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851900.844949:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.844950:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851900.844952:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000089acaf6f x1859834408938880/t0(0) o400->0a9a84d7-3b33-4079-b892-6b1b660a69ab@24480@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2016-0'
00000100:00100000:8.0:1773851900.844955:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000089acaf6f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:0a9a84d7-3b33-4079-b892-6b1b660a69ab+210:39693:x1859834408938880:12345-24480@kfi7:400:default-tuolumne2016-0 Request processed in 66us (101us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851900.844957:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24480@kfi7, seq: 2130884
00000100:00000040:8.0:1773851900.844958:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009cd0a936 : new rpc_count 7
00000100:00000001:8.0:1773851900.844959:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851900.844960:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851900.844960:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851900.844961:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851900.844962:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851900.844963:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000009cd0a936 : new refcount 209
00000100:00000001:8.0:1773851900.844964:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851900.844968:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851900.844970:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851900.844971:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24480@kfi7: PUT: OK
00000400:00000200:9.0:1773851900.844972:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006188a4b8
00000400:00000010:9.0:1773851900.844973:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006188a4b8.
00000100:00000001:9.0:1773851900.844974:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851900.844974:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851900.844975:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009fba9494 nid 24480@kfi7 refs 2
00000800:00000200:9.0:1773851900.844977:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2069@kfi7:2 -> 24480@kfi7(00000000b33d17f7):0x0 lsk 1789 rsk 13 tsk 0 trmk 0 tmk 0 trr 2 tta 0x6fc Transaction freed
00000800:00000200:21.0:1773851900.874404:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851900.874406:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851900.874408:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851900.874411:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851900.874414:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.874416:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18944@kfi7 : PUT - for me
00000400:00000200:21.0:1773851900.874417:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.874419:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 1
00000400:00000200:21.0:1773851900.874421:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:21.0:1773851900.874422:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000400:00000200:21.0:1773851900.874423:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 3
00000400:00000200:21.0:1773851900.874424:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18945@kfi7 to cpt 0
00000400:00000200:21.0:1773851900.874426:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18945@kfi7 of length 224 into portal 12 MB=0x699e17acc8980
00000400:00000200:21.0:1773851900.874428:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18945@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 68016
00000800:00000200:21.0:1773851900.874431:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851900.874433:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851900.874435:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18944@kfi7: PUT: OK
00000100:00000001:21.0:1773851900.874436:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851900.874437:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851900.874440:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c702876.
00000100:00000040:21.0:1773851900.874441:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000009c702876 x1858043567180160 msgsize 224
00000100:00100000:21.0:1773851900.874443:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-18945@kfi7 (source: 12345-18944@kfi7)
00000100:00000001:21.0:1773851900.874444:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851900.874446:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000100:00000001:23.0:1773851900.874447:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851900.874448:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851900.874449:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851900.874449:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851900.874450:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851900.874451:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851900.874452:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043567180160
00000020:00000001:23.0:1773851900.874453:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851900.874454:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924ac
00000020:00000001:23.0:1773851900.874455:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851900.874458:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000270be7a1 refcount=6
00000020:00000001:23.0:1773851900.874459:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630505472 : -107123079046144 : ffff9e9276ed1c00)
00000020:00000001:23.0:1773851900.874460:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630505472 : -107123079046144 : ffff9e9276ed1c00)
00000100:00000001:23.0:1773851900.874462:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.874463:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851900.874464:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851900.874466:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851900.874467:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851900.874468:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851900.874469:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851900.874470:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.874471:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851900.874472:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851900.874473:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.874474:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851900.874476:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851900.874476:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851900.874477:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851900.874477:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851900.874478:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18945@kfi7, seq: 1998083
00000100:00000040:23.0:1773851900.874479:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000270be7a1 : new rpc_count 1
00000100:00000001:20.0:1773851900.874480:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.874481:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313423488 : -106917396128128 : ffff9ec25a955e80)
00000100:00000001:20.0:1773851900.874481:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.874482:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c702876 x1858043567180160/t0(0) o400->9b23f4d2-cc78-4d3d-973f-25e64044c0ee@18945@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1683-0'
00000100:00000001:23.0:1773851900.874487:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851900.874488:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851900.874489:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c702876 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:9b23f4d2-cc78-4d3d-973f-25e64044c0ee+6:39619:x1858043567180160:12345-18945@kfi7:400:default-tuolumne1683-0
00000100:00000200:23.0:1773851900.874491:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043567180160
00000020:00000001:23.0:1773851900.874492:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851900.874493:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851900.874494:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.874495:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851900.874496:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851900.874498:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851900.874499:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043567180160, found 0 last_xid 1858043567180159
00000020:00000001:23.0:1773851900.874500:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851900.874501:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851900.874502:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851900.874503:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.874504:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851900.874505:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851900.874506:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851900.874509:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f10fbfed.
02000000:00000001:23.0:1773851900.874510:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.874511:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.874512:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851900.874513:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254665449, transno 0, xid 1858043567180160
00010000:00000001:23.0:1773851900.874514:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851900.874515:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c702876 x1858043567180160/t0(0) o400->9b23f4d2-cc78-4d3d-973f-25e64044c0ee@18945@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1683-0'
00010000:00000001:23.0:1773851900.874519:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851900.874520:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851900.874521:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=133 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851900.874523:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851900.874524:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000090f06c9 refcount 3 to 18945@kfi7
00000100:00000001:23.0:1773851900.874525:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994449504 : -107149715102112 : ffff9e8c434b2660)
02000000:00000001:23.0:1773851900.874527:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851900.874527:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851900.874528:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851900.874530:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18944@kfi7
00000400:00000010:23.0:1773851900.874531:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009b97a0f1.
00000100:00000200:23.0:1773851900.874532:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043567180160, offset 224
00000400:00000200:23.0:1773851900.874534:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18944@kfi7
00000400:00000200:23.0:1773851900.874535:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.874537:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 1
00000400:00000200:23.0:1773851900.874538:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000400:00000200:23.0:1773851900.874541:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 3
00000400:00000200:23.0:1773851900.874543:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18944@kfi7 local destination
00000400:00000200:23.0:1773851900.874545:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770368:8770368:1024:4294967295] 18944@kfi7 LPNI seq info [20193645:20193645:16:4294967295]
00000400:00000200:23.0:1773851900.874547:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000400:00000200:23.0:1773851900.874548:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18944@kfi7 to cpt 5
00000400:00000200:23.0:1773851900.874552:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18944@kfi7(18944@kfi7:18944@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851900.874554:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 3
00000800:00000200:23.0:1773851900.874556:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851900.874558:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851900.874561:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851900.874565:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000010dc Using peer 18944@kfi7(0x1000000000010dc)
00000800:00000200:23.0:1773851900.874570:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b6f34af6: Posted send of 324 bytes to peer 0x1000000000010dc: rc=0
00000800:00000200:23.0:1773851900.874572:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000010dc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851900.874575:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851900.874576:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000090f06c9 refcount 2 to 18945@kfi7
00010000:00000001:23.0:1773851900.874578:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851900.874579:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851900.874580:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851900.874581:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c702876 x1858043567180160/t0(0) o400->9b23f4d2-cc78-4d3d-973f-25e64044c0ee@18945@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1683-0'
00000100:00100000:23.0:1773851900.874586:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c702876 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:9b23f4d2-cc78-4d3d-973f-25e64044c0ee+6:39619:x1858043567180160:12345-18945@kfi7:400:default-tuolumne1683-0 Request processed in 98us (144us total) trans 0 rc 0/0
00000800:00000200:22.0:1773851900.874586:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000010dc TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851900.874589:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18945@kfi7, seq: 1998083
00000100:00000040:23.0:1773851900.874590:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000270be7a1 : new rpc_count 0
00000400:00000200:22.0:1773851900.874590:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:23.0:1773851900.874592:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851900.874592:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:22.0:1773851900.874592:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18944@kfi7: PUT: OK
00000400:00000200:22.0:1773851900.874594:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009b97a0f1
00000400:00000010:22.0:1773851900.874595:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009b97a0f1.
00000020:00000010:23.0:1773851900.874596:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000100:00000001:22.0:1773851900.874596:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851900.874597:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000100:00000001:22.0:1773851900.874597:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851900.874598:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000082b4311c nid 18944@kfi7 refs 2
00000020:00000010:23.0:1773851900.874599:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000020:00000040:23.0:1773851900.874600:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000270be7a1 : new refcount 5
00000100:00000001:23.0:1773851900.874601:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851900.874601:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b6f34af6: 2054@kfi7:5 -> 18944@kfi7(00000000353ef047):0x0 lsk 4317 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1000000000010dc Transaction freed
00000800:00000200:17.0:1773851900.891095:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851900.891096:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851900.891097:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851900.891099:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851900.891101:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.891102:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9440@kfi7 : PUT - for me
00000400:00000200:17.0:1773851900.891103:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.891104:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 1
00000400:00000200:17.0:1773851900.891105:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.891106:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000400:00000200:17.0:1773851900.891107:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 3
00000400:00000200:17.0:1773851900.891108:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9248@kfi7 to cpt 1
00000400:00000200:17.0:1773851900.891109:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9248@kfi7 of length 224 into portal 12 MB=0x699e1ece830c0
00000400:00000200:17.0:1773851900.891110:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9248@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 49040
00000800:00000200:17.0:1773851900.891112:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851900.891113:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851900.891114:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9440@kfi7: PUT: OK
00000100:00000001:17.0:1773851900.891116:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851900.891116:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851900.891117:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000498fa906.
00000100:00000040:17.0:1773851900.891118:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000498fa906 x1858045481595072 msgsize 224
00000100:00100000:17.0:1773851900.891120:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9248@kfi7 (source: 12345-9440@kfi7)
00000100:00000001:17.0:1773851900.891121:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851900.891122:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851900.891122:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:17.0:1773851900.891122:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000100:00000001:19.0:1773851900.891123:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851900.891123:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851900.891123:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2069@kfi7:4 <- 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851900.891124:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851900.891125:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858045481595072
00000020:00000001:19.0:1773851900.891125:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851900.891126:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b98
00000020:00000001:19.0:1773851900.891126:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851900.891128:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029538b25 refcount=7
00000020:00000001:19.0:1773851900.891129:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628027392 : -107123081524224 : ffff9e9276c74c00)
00000020:00000001:19.0:1773851900.891130:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628027392 : -107123081524224 : ffff9e9276c74c00)
00000100:00000001:19.0:1773851900.891131:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851900.891132:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851900.891132:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008ad35796.
00000020:00000010:19.0:1773851900.891133:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851900.891134:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c89cf037.
00000100:00000001:19.0:1773851900.891135:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851900.891135:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851900.891135:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851900.891136:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851900.891137:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851900.891137:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.891138:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851900.891140:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851900.891140:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851900.891140:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851900.891140:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851900.891141:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9248@kfi7, seq: 2156443
00000100:00000040:19.0:1773851900.891142:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000029538b25 : new rpc_count 2
00000100:00000001:16.0:1773851900.891142:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.891143:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794790400 : -107029914761216 : ffff9ea827f34800)
00000100:00000001:16.0:1773851900.891143:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851900.891144:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000498fa906 x1858045481595072/t0(0) o400->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:152/0 lens 224/0 e 0 to 0 dl 1773852267 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1071-0'
00000100:00000001:19.0:1773851900.891147:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851900.891147:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851900.891148:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000498fa906 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1babdaf0-18e0-4dce-a52d-1dbe90afd35c+7:39637:x1858045481595072:12345-9248@kfi7:400:default-tuolumne1071-0
00000100:00000200:19.0:1773851900.891149:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858045481595072
00000020:00000001:19.0:1773851900.891150:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851900.891151:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851900.891151:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.891152:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851900.891152:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851900.891153:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851900.891154:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858045481595072, found 0 last_xid 1858045479652159
00000020:00000001:19.0:1773851900.891155:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851900.891155:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851900.891156:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851900.891156:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.891157:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851900.891157:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851900.891158:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851900.891159:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008b4b5fdc.
02000000:00000001:19.0:1773851900.891159:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.891160:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.891161:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851900.891161:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183256634619, transno 0, xid 1858045481595072
00010000:00000001:19.0:1773851900.891162:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851900.891163:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000498fa906 x1858045481595072/t0(0) o400->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1071-0'
00010000:00000001:19.0:1773851900.891168:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851900.891168:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851900.891169:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=133 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851900.891170:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851900.891171:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000243285 refcount 3 to 9248@kfi7
00000100:00000001:19.0:1773851900.891172:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704800 : -107156155846816 : ffff9e8ac3652f60)
02000000:00000001:19.0:1773851900.891173:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851900.891173:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851900.891174:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851900.891174:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9440@kfi7
00000400:00000010:19.0:1773851900.891175:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7522538.
00000100:00000200:19.0:1773851900.891176:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858045481595072, offset 224
00000400:00000200:19.0:1773851900.891178:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9440@kfi7
00000400:00000200:19.0:1773851900.891179:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:19.0:1773851900.891179:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 1
00000400:00000200:19.0:1773851900.891180:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000400:00000200:19.0:1773851900.891181:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 3
00000400:00000200:19.0:1773851900.891182:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9440@kfi7 local destination
00000400:00000200:19.0:1773851900.891184:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770369:8770369:1024:4294967295] 9440@kfi7 LPNI seq info [9763631:9763631:16:4294967295]
00000400:00000200:19.0:1773851900.891185:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000400:00000200:19.0:1773851900.891186:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9440@kfi7 to cpt 4
00000400:00000200:19.0:1773851900.891188:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9440@kfi7(9440@kfi7:9440@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851900.891189:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 3
00000800:00000200:19.0:1773851900.891190:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851900.891191:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851900.891193:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851900.891195:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf Using peer 9440@kfi7(0xeaf)
00000800:00000200:19.0:1773851900.891210:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000024734d67: Posted send of 324 bytes to peer 0xeaf: rc=0
00000800:00000200:19.0:1773851900.891211:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851900.891213:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851900.891214:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000243285 refcount 2 to 9248@kfi7
00010000:00000001:19.0:1773851900.891215:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851900.891215:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851900.891216:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851900.891216:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000498fa906 x1858045481595072/t0(0) o400->1babdaf0-18e0-4dce-a52d-1dbe90afd35c@9248@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1071-0'
00000100:00100000:19.0:1773851900.891219:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000498fa906 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1babdaf0-18e0-4dce-a52d-1dbe90afd35c+7:39637:x1858045481595072:12345-9248@kfi7:400:default-tuolumne1071-0 Request processed in 72us (101us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851900.891222:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9248@kfi7, seq: 2156443
00000100:00000040:19.0:1773851900.891222:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000029538b25 : new rpc_count 1
00000100:00000001:19.0:1773851900.891223:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851900.891223:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851900.891223:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851900.891224:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851900.891224:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c89cf037.
00000400:00000200:17.0:1773851900.891224:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851900.891225:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008ad35796.
00000400:00000200:17.0:1773851900.891225:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9440@kfi7: PUT: OK
00000020:00000040:19.0:1773851900.891226:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000029538b25 : new refcount 6
00000400:00000200:17.0:1773851900.891226:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7522538
00000400:00000010:17.0:1773851900.891226:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7522538.
00000100:00000001:19.0:1773851900.891227:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851900.891227:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851900.891227:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851900.891228:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000de59a3af nid 9440@kfi7 refs 2
00000800:00000200:17.0:1773851900.891229:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9440@kfi7(00000000f02f7417):0x0 lsk 3760 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0xeaf Transaction freed
00000800:00000200:11.0:1773851900.967810:0:2510946:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851900.967811:0:2510946:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851900.967812:0:2510946:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:11.0:1773851900.967815:0:2510946:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:11.0:1773851900.967817:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:11.0:1773851900.967819:0:2510946:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8832@kfi7 : PUT - for me
00000400:00000200:11.0:1773851900.967820:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:11.0:1773851900.967821:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 1
00000400:00000200:11.0:1773851900.967822:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:11.0:1773851900.967822:0:2510946:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000400:00000200:11.0:1773851900.967823:0:2510946:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 3
00000400:00000200:11.0:1773851900.967824:0:2510946:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8769@kfi7 to cpt 1
00000400:00000200:11.0:1773851900.967825:0:2510946:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8769@kfi7 of length 224 into portal 12 MB=0x699e0a362f5c0
00000400:00000200:11.0:1773851900.967827:0:2510946:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8769@kfi7 of length 224/224 into md 0x78146ce49 [64] + 165744
00000800:00000200:11.0:1773851900.967829:0:2510946:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:11.0:1773851900.967831:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851900.967832:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8832@kfi7: PUT: OK
00000100:00000001:11.0:1773851900.967833:0:2510946:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:11.0:1773851900.967834:0:2510946:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:11.0:1773851900.967835:0:2510946:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dbcdff99.
00000100:00000040:11.0:1773851900.967836:0:2510946:0:(events.c:358:request_in_callback()) incoming req@00000000dbcdff99 x1858039953159616 msgsize 224
00000100:00100000:11.0:1773851900.967837:0:2510946:0:(events.c:361:request_in_callback()) peer: 12345-8769@kfi7 (source: 12345-8832@kfi7)
00000100:00000001:11.0:1773851900.967838:0:2510946:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:11.0:1773851900.967839:0:2510946:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000100:00000001:8.0:1773851900.967839:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:11.0:1773851900.967840:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ccb6c3a6: 2069@kfi7:2 <- 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851900.967840:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851900.967840:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851900.967841:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851900.967842:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851900.967843:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039953159616
00000020:00000001:8.0:1773851900.967843:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851900.967844:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92386
00000020:00000001:8.0:1773851900.967844:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851900.967847:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000077b90749 refcount=8
00000020:00000001:8.0:1773851900.967848:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630291456 : -107123079260160 : ffff9e9276e9d800)
00000020:00000001:8.0:1773851900.967849:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630291456 : -107123079260160 : ffff9e9276e9d800)
00000100:00000001:8.0:1773851900.967850:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851900.967851:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851900.967852:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851900.967853:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851900.967854:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851900.967854:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851900.967855:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851900.967856:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851900.967857:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851900.967857:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851900.967858:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.967859:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851900.967860:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851900.967860:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851900.967861:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:8.0:1773851900.967861:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8769@kfi7, seq: 2130885
00000100:00000001:9.0:1773851900.967862:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:8.0:1773851900.967862:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000077b90749 : new rpc_count 1
00000100:00000001:9.0:1773851900.967863:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.967863:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637136446616832 : -106937262934784 : ffff9ebdba6df500)
00000100:00000001:9.0:1773851900.967864:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851900.967864:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dbcdff99 x1858039953159616/t0(0) o400->a042c893-3cab-4ab4-9143-0e4725873866@8769@kfi7:627/0 lens 224/0 e 0 to 0 dl 1773851987 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1044-0'
00000100:00000001:8.0:1773851900.967867:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851900.967868:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851900.967869:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dbcdff99 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a042c893-3cab-4ab4-9143-0e4725873866+8:39852:x1858039953159616:12345-8769@kfi7:400:default-tuolumne1044-0
00000100:00000200:8.0:1773851900.967870:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039953159616
00000020:00000001:8.0:1773851900.967871:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851900.967871:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851900.967872:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.967873:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851900.967874:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851900.967875:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851900.967875:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039953159616, found 0 last_xid 1858039953159615
00000020:00000001:8.0:1773851900.967876:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851900.967877:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851900.967877:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851900.967878:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.967879:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851900.967879:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851900.967880:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851900.967881:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000309c7cd2.
02000000:00000001:8.0:1773851900.967882:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.967883:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.967883:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851900.967884:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182974960269, transno 0, xid 1858039953159616
00010000:00000001:8.0:1773851900.967885:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851900.967885:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dbcdff99 x1858039953159616/t0(0) o400->a042c893-3cab-4ab4-9143-0e4725873866@8769@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1044-0'
00010000:00000001:8.0:1773851900.967888:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851900.967888:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851900.967889:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=133 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851900.967890:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851900.967891:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007592b8f4 refcount 3 to 8769@kfi7
00000100:00000001:8.0:1773851900.967891:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412768 : -107145304138848 : ffff9e8d4a351ba0)
02000000:00000001:8.0:1773851900.967892:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851900.967893:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851900.967894:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851900.967894:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8832@kfi7
00000400:00000010:8.0:1773851900.967895:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002bb674c2.
00000100:00000200:8.0:1773851900.967896:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039953159616, offset 224
00000400:00000200:8.0:1773851900.967897:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8832@kfi7
00000400:00000200:8.0:1773851900.967898:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:8.0:1773851900.967899:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 1
00000400:00000200:8.0:1773851900.967900:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000400:00000200:8.0:1773851900.967901:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 3
00000400:00000200:8.0:1773851900.967902:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8832@kfi7 local destination
00000400:00000200:8.0:1773851900.967903:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770370:8770370:1024:4294967295] 8832@kfi7 LPNI seq info [1501621:1501621:16:4294967295]
00000400:00000200:8.0:1773851900.967904:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000400:00000200:8.0:1773851900.967905:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8832@kfi7 to cpt 2
00000400:00000200:8.0:1773851900.967906:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8832@kfi7(8832@kfi7:8832@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851900.967908:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 3
00000800:00000200:8.0:1773851900.967909:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851900.967910:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851900.967912:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851900.967914:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1001 Using peer 8832@kfi7(0x1001)
00000800:00000200:8.0:1773851900.967916:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x1001: rc=0
00000800:00000200:8.0:1773851900.967918:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1001 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851900.967920:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851900.967920:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007592b8f4 refcount 2 to 8769@kfi7
00010000:00000001:8.0:1773851900.967921:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851900.967921:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851900.967922:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851900.967923:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dbcdff99 x1858039953159616/t0(0) o400->a042c893-3cab-4ab4-9143-0e4725873866@8769@kfi7:627/0 lens 224/224 e 0 to 0 dl 1773851987 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1044-0'
00000100:00100000:8.0:1773851900.967928:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dbcdff99 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:a042c893-3cab-4ab4-9143-0e4725873866+8:39852:x1858039953159616:12345-8769@kfi7:400:default-tuolumne1044-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851900.967930:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8769@kfi7, seq: 2130885
00000100:00000040:8.0:1773851900.967930:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000077b90749 : new rpc_count 0
00000100:00000001:8.0:1773851900.967931:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851900.967931:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851900.967932:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851900.967933:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851900.967934:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851900.967934:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000077b90749 : new refcount 7
00000100:00000001:8.0:1773851900.967935:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:11.0:1773851900.967940:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1001 TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851900.967941:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851900.967942:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8832@kfi7: PUT: OK
00000400:00000200:11.0:1773851900.967943:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002bb674c2
00000400:00000010:11.0:1773851900.967944:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002bb674c2.
00000100:00000001:11.0:1773851900.967945:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851900.967946:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851900.967947:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000088c5b53a nid 8832@kfi7 refs 2
00000800:00000200:11.0:1773851900.967948:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 8832@kfi7(0000000053b77033):0x0 lsk 4098 rsk 53 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1001 Transaction freed
00000800:00000200:18.0:1773851900.972214:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851900.972214:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851900.972215:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851900.972215:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851900.972216:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851900.972216:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:17.0:1773851900.972218:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9186@kfi7(0000000006752e5e):0x7aa version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851900.972219:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851900.972219:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa Using peer 9186@kfi7(0x1000000000007aa)
00000400:00000200:18.0:1773851900.972220:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.972221:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:18.0:1773851900.972222:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9186@kfi7 : PUT - for me
00000400:00000200:18.0:1773851900.972223:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:18.0:1773851900.972223:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 1
00000800:00000200:17.0:1773851900.972223:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000aee891f1: Posted send of 38 bytes to peer 0x1000000000007aa: rc=0
00000400:00000200:18.0:1773851900.972224:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:18.0:1773851900.972225:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000800:00000200:17.0:1773851900.972225:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851900.972226:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 3
00000400:00000200:18.0:1773851900.972227:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:18.0:1773851900.972228:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9186@kfi7 of length 224 into portal 12 MB=0x69b823692ac80
00000400:00000200:18.0:1773851900.972229:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9186@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 49264
00000800:00000200:18.0:1773851900.972231:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851900.972233:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851900.972235:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9186@kfi7: PUT: OK
00000800:00000200:19.0:1773851900.972236:0:2464491:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa TN_EVENT_TX_OK event status 0
00000100:00000001:18.0:1773851900.972236:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851900.972236:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851900.972237:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cfab4ed.
00000100:00000040:18.0:1773851900.972238:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000007cfab4ed x1859833423899776 msgsize 224
00000800:00000200:19.0:1773851900.972239:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aee891f1: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa Transaction freed
00000100:00100000:18.0:1773851900.972239:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-9186@kfi7 (source: 12345-9186@kfi7)
00000100:00000001:18.0:1773851900.972241:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851900.972241:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000800:00000200:18.0:1773851900.972243:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851900.972243:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851900.972244:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851900.972244:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851900.972245:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851900.972246:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851900.972247:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833423899776
00000020:00000001:17.0:1773851900.972248:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851900.972248:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c16f105
00000020:00000001:17.0:1773851900.972249:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851900.972251:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ec27bebc refcount=5
00000020:00000001:17.0:1773851900.972252:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148287554560 : -106925421997056 : ffff9ec07c345400)
00000020:00000001:17.0:1773851900.972253:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148287554560 : -106925421997056 : ffff9ec07c345400)
00000100:00000001:17.0:1773851900.972254:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851900.972255:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851900.972256:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005b4be0ac.
00000020:00000010:17.0:1773851900.972257:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851900.972258:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851900.972259:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851900.972259:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851900.972260:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851900.972261:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851900.972262:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851900.972262:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851900.972263:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851900.972264:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851900.972265:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851900.972265:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851900.972265:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851900.972266:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9186@kfi7, seq: 2156444
00000100:00000040:17.0:1773851900.972267:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ec27bebc : new rpc_count 1
00000100:00000001:17.0:1773851900.972267:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609980416 : -107015099571200 : ffff9eab9b012400)
00000100:00000001:16.0:1773851900.972267:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851900.972267:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851900.972268:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007cfab4ed x1859833423899776/t0(0) o400->c372f125-707b-440e-ac9b-182540fa9ffb@9186@kfi7:152/0 lens 224/0 e 0 to 0 dl 1773852267 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1051-0'
00000100:00000001:17.0:1773851900.972271:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851900.972271:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851900.972272:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cfab4ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c372f125-707b-440e-ac9b-182540fa9ffb+5:39709:x1859833423899776:12345-9186@kfi7:400:default-tuolumne1051-0
00000100:00000200:17.0:1773851900.972273:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833423899776
00000020:00000001:17.0:1773851900.972274:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851900.972275:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851900.972275:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851900.972276:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851900.972277:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851900.972277:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851900.972278:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833423899776, found 0 last_xid 1859833423899775
00000020:00000001:17.0:1773851900.972279:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851900.972279:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851900.972280:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851900.972281:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851900.972281:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851900.972282:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851900.972282:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851900.972283:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000081730abf.
02000000:00000001:17.0:1773851900.972284:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851900.972284:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851900.972285:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851900.972286:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182984232520, transno 0, xid 1859833423899776
00010000:00000001:17.0:1773851900.972287:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851900.972287:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007cfab4ed x1859833423899776/t0(0) o400->c372f125-707b-440e-ac9b-182540fa9ffb@9186@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1051-0'
00010000:00000001:17.0:1773851900.972290:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851900.972290:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851900.972291:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=133 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851900.972292:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851900.972293:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002927be28 refcount 3 to 9186@kfi7
00000100:00000001:17.0:1773851900.972293:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095777472 : -107152613774144 : ffff9e8b9684ecc0)
02000000:00000001:17.0:1773851900.972294:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851900.972295:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851900.972295:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851900.972296:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9186@kfi7
00000400:00000010:17.0:1773851900.972296:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007e57d848.
00000100:00000200:17.0:1773851900.972297:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833423899776, offset 224
00000400:00000200:17.0:1773851900.972298:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9186@kfi7
00000400:00000200:17.0:1773851900.972299:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.972300:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 1
00000400:00000200:17.0:1773851900.972301:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000400:00000200:17.0:1773851900.972302:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 3
00000400:00000200:17.0:1773851900.972303:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9186@kfi7 local destination
00000400:00000200:17.0:1773851900.972304:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770371:8770371:1024:4294967295] 9186@kfi7 LPNI seq info [2053840:2053840:16:4294967295]
00000400:00000200:17.0:1773851900.972306:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000400:00000200:17.0:1773851900.972307:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9186@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.972309:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9186@kfi7(9186@kfi7:9186@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851900.972310:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 3
00000800:00000200:17.0:1773851900.972311:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851900.972312:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851900.972314:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851900.972316:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa Using peer 9186@kfi7(0x1000000000007aa)
00000800:00000200:17.0:1773851900.972319:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000767aee6e: Posted send of 324 bytes to peer 0x1000000000007aa: rc=0
00000800:00000200:17.0:1773851900.972320:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851900.972322:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851900.972323:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002927be28 refcount 2 to 9186@kfi7
00010000:00000001:17.0:1773851900.972323:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851900.972324:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851900.972324:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851900.972325:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cfab4ed x1859833423899776/t0(0) o400->c372f125-707b-440e-ac9b-182540fa9ffb@9186@kfi7:152/0 lens 224/224 e 0 to 0 dl 1773852267 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1051-0'
00000100:00100000:17.0:1773851900.972328:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cfab4ed pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:c372f125-707b-440e-ac9b-182540fa9ffb+5:39709:x1859833423899776:12345-9186@kfi7:400:default-tuolumne1051-0 Request processed in 56us (89us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851900.972330:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9186@kfi7, seq: 2156444
00000100:00000040:17.0:1773851900.972331:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ec27bebc : new rpc_count 0
00000800:00000200:18.0:1773851900.972332:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851900.972332:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851900.972332:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851900.972333:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851900.972334:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851900.972334:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000020:00000010:17.0:1773851900.972334:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005b4be0ac.
00000400:00000200:18.0:1773851900.972335:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9186@kfi7: PUT: OK
00000020:00000040:17.0:1773851900.972335:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000ec27bebc : new refcount 4
00000400:00000200:18.0:1773851900.972336:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007e57d848
00000400:00000010:18.0:1773851900.972336:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007e57d848.
00000100:00000001:17.0:1773851900.972336:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851900.972337:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851900.972338:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851900.972339:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007032bb1e nid 9186@kfi7 refs 2
00000800:00000200:18.0:1773851900.972340:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000767aee6e: 2054@kfi7:4 -> 9186@kfi7(0000000006752e5e):0x0 lsk 1963 rsk 8 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000007aa Transaction freed
00000800:00000200:17.0:1773851900.997498:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851900.997499:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851900.997500:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851900.997502:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851900.997504:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.997505:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.39@o2ib60 : PUT - for me
00000400:00000200:17.0:1773851900.997506:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:17.0:1773851900.997507:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:17.0:1773851900.997508:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:17.0:1773851900.997509:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:17.0:1773851900.997510:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:17.0:1773851900.997511:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:17.0:1773851900.997512:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.39@o2ib60 of length 224 into portal 12 MB=0x69b220e968400
00000400:00000200:17.0:1773851900.997513:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.39@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 54808
00000800:00000200:17.0:1773851900.997515:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851900.997516:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851900.997517:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:17.0:1773851900.997518:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851900.997518:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851900.997519:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a2f659e.
00000100:00000040:17.0:1773851900.997520:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000004a2f659e x1859420436202496 msgsize 224
00000100:00100000:17.0:1773851900.997521:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.39@o2ib60 (source: 12345-192.168.128.39@o2ib60)
00000100:00000001:17.0:1773851900.997523:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851900.997523:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:17.0:1773851900.997524:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851900.997526:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851900.997527:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851900.997527:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851900.997528:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851900.997529:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851900.997529:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859420436202496
00000020:00000001:0.0:1773851900.997530:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851900.997530:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07b2344ab51
00000020:00000001:0.0:1773851900.997531:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851900.997532:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000187322e6 refcount=125617
00000020:00000001:0.0:1773851900.997533:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000020:00000001:0.0:1773851900.997534:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636956484092928 : -107117225458688 : ffff9e93d3d3c400)
00000100:00000001:0.0:1773851900.997535:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851900.997536:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851900.997536:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000637bc2c7.
00000020:00000010:0.0:1773851900.997537:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851900.997538:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851900.997539:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851900.997540:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851900.997541:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851900.997542:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851900.997542:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851900.997542:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.997543:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851900.997544:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851900.997545:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851900.997545:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851900.997546:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851900.997546:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.39@o2ib60, seq: 1997634
00000100:00000001:2.0:1773851900.997547:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851900.997547:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000187322e6 : new rpc_count 9
00000100:00000001:2.0:1773851900.997548:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.997548:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794792704 : -107029914758912 : ffff9ea827f35100)
00000100:00000040:0.0:1773851900.997549:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a2f659e x1859420436202496/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:540/0 lens 224/0 e 0 to 0 dl 1773852655 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix39-0'
00000100:00000001:0.0:1773851900.997551:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851900.997552:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851900.997553:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a2f659e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40575:x1859420436202496:12345-192.168.128.39@o2ib60:400:default-matrix39-0
00000100:00000200:0.0:1773851900.997554:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859420436202496
00000020:00000001:0.0:1773851900.997555:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851900.997555:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851900.997558:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.997558:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851900.997559:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851900.997560:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851900.997560:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859420436202496, found 0 last_xid 1859420408095423
00000020:00000001:0.0:1773851900.997561:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851900.997561:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851900.997562:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851900.997562:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.997563:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851900.997563:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851900.997564:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851900.997565:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000911b16a8.
02000000:00000001:0.0:1773851900.997565:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.997566:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.997567:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851900.997567:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593807, transno 0, xid 1859420436202496
00010000:00000001:0.0:1773851900.997568:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851900.997569:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a2f659e x1859420436202496/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:540/0 lens 224/224 e 0 to 0 dl 1773852655 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00010000:00000001:0.0:1773851900.997571:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851900.997572:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851900.997573:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=133 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851900.997574:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851900.997574:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b587bdf refcount 3 to 192.168.128.39@o2ib60
00000100:00000001:0.0:1773851900.997575:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958441792 : -107146751109824 : ffff9e8cf3f61540)
02000000:00000001:0.0:1773851900.997576:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851900.997576:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851900.997577:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851900.997578:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.39@o2ib60
00000400:00000010:0.0:1773851900.997578:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f597ead9.
00000100:00000200:0.0:1773851900.997579:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859420436202496, offset 224
00000400:00000200:0.0:1773851900.997581:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.39@o2ib60
00000400:00000200:0.0:1773851900.997582:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.39@o2ib60 to cpt 0
00000400:00000200:0.0:1773851900.997583:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 2
00000400:00000200:0.0:1773851900.997584:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000400:00000200:0.0:1773851900.997585:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 4
00000400:00000200:0.0:1773851900.997587:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.39@o2ib60 routed destination
00000400:00000200:0.0:1773851900.997588:0:42868:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:0.0:1773851900.997588:0:42868:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:0.0:1773851900.997590:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:0.0:1773851900.997591:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:0.0:1773851900.997592:0:42868:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.39@o2ib60: rtr pref emtpy: 1
00000400:00000200:0.0:1773851900.997593:0:42868:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:0.0:1773851900.997594:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770372:8770372:1024:4294967295] 17@kfi7 LPNI seq info [1250891926:1250891926:16:4294967295]
00000400:00000200:0.0:1773851900.997595:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:0.0:1773851900.997596:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:0.0:1773851900.997599:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.39@o2ib60(192.168.128.39@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851900.997600:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d08e73ce nid 192.168.128.39@o2ib60 refs 3
00000800:00000200:0.0:1773851900.997601:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851900.997602:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851900.997605:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851900.997607:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:0.0:1773851900.997609:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:0.0:1773851900.997611:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851900.997613:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851900.997614:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b587bdf refcount 2 to 192.168.128.39@o2ib60
00010000:00000001:0.0:1773851900.997614:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851900.997615:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851900.997615:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851900.997616:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a2f659e x1859420436202496/t0(0) o400->a5fd2e38-596d-44a5-8fc2-20596d27a3ba@192.168.128.39@o2ib60:540/0 lens 224/224 e 0 to 0 dl 1773852655 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix39-0'
00000100:00100000:0.0:1773851900.997621:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a2f659e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:a5fd2e38-596d-44a5-8fc2-20596d27a3ba+125617:40575:x1859420436202496:12345-192.168.128.39@o2ib60:400:default-matrix39-0 Request processed in 68us (100us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851900.997623:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.39@o2ib60, seq: 1997634
00000100:00000040:0.0:1773851900.997623:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000187322e6 : new rpc_count 8
00000100:00000001:0.0:1773851900.997624:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851900.997625:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851900.997625:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851900.997626:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851900.997627:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000637bc2c7.
00000020:00000040:0.0:1773851900.997627:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000187322e6 : new refcount 125616
00000100:00000001:0.0:1773851900.997628:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851900.997635:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851900.997637:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851900.997638:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:2.0:1773851900.997639:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f597ead9
00000400:00000010:2.0:1773851900.997640:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f597ead9.
00000100:00000001:2.0:1773851900.997640:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851900.997641:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851900.997642:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:2.0:1773851900.997644:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Transaction freed
00000800:00000200:17.0:1773851901.014421:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851901.014423:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851901.014424:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851901.014426:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851901.014428:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.014430:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26528@kfi7 : PUT - for me
00000400:00000200:17.0:1773851901.014430:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.014431:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 1
00000400:00000200:17.0:1773851901.014432:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.014433:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000400:00000200:17.0:1773851901.014434:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 3
00000400:00000200:17.0:1773851901.014435:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.014436:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26528@kfi7 of length 224 into portal 12 MB=0x69a9d49db9480
00000400:00000200:17.0:1773851901.014437:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26528@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 49488
00000800:00000200:17.0:1773851901.014438:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851901.014440:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851901.014441:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26528@kfi7: PUT: OK
00000100:00000001:17.0:1773851901.014442:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851901.014442:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851901.014443:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000051be8fc2.
00000100:00000040:17.0:1773851901.014444:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000051be8fc2 x1858850199934080 msgsize 224
00000100:00100000:17.0:1773851901.014445:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-26528@kfi7 (source: 12345-26528@kfi7)
00000100:00000001:17.0:1773851901.014446:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851901.014447:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000800:00000200:17.0:1773851901.014448:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b83ced21: 2054@kfi7:4 <- 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851901.014451:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851901.014451:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851901.014452:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851901.014453:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851901.014454:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851901.014454:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858850199934080
00000020:00000001:17.0:1773851901.014455:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851901.014456:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914b4
00000020:00000001:17.0:1773851901.014456:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851901.014459:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005ea1098b refcount=6
00000020:00000001:17.0:1773851901.014460:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240806400 : -107152468745216 : ffff9e8b9f29e400)
00000020:00000001:17.0:1773851901.014461:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240806400 : -107152468745216 : ffff9e8b9f29e400)
00000100:00000001:17.0:1773851901.014462:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851901.014463:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851901.014463:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005b4be0ac.
00000020:00000010:17.0:1773851901.014465:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851901.014466:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851901.014467:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851901.014467:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851901.014468:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851901.014468:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851901.014469:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851901.014469:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.014470:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851901.014472:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851901.014472:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851901.014472:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851901.014472:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851901.014473:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26528@kfi7, seq: 2156445
00000100:00000040:17.0:1773851901.014474:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005ea1098b : new rpc_count 1
00000100:00000001:16.0:1773851901.014474:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.014475:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794771968 : -107029914779648 : ffff9ea827f30000)
00000100:00000001:16.0:1773851901.014475:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851901.014476:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000051be8fc2 x1858850199934080/t0(0) o400->1f277aad-a14c-4077-b83c-4ff3ae6d561e@26528@kfi7:153/0 lens 224/0 e 0 to 0 dl 1773852268 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2144-0'
00000100:00000001:17.0:1773851901.014478:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851901.014479:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851901.014480:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000051be8fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1f277aad-a14c-4077-b83c-4ff3ae6d561e+6:39686:x1858850199934080:12345-26528@kfi7:400:default-tuolumne2144-0
00000100:00000200:17.0:1773851901.014481:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858850199934080
00000020:00000001:17.0:1773851901.014482:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851901.014483:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851901.014484:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.014484:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851901.014485:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851901.014485:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851901.014486:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858850199934080, found 0 last_xid 1858850199934079
00000020:00000001:17.0:1773851901.014486:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851901.014487:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851901.014487:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851901.014488:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.014489:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851901.014489:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851901.014489:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851901.014492:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000026632677.
02000000:00000001:17.0:1773851901.014492:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.014493:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.014493:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851901.014494:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182427040445, transno 0, xid 1858850199934080
00010000:00000001:17.0:1773851901.014495:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851901.014495:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000051be8fc2 x1858850199934080/t0(0) o400->1f277aad-a14c-4077-b83c-4ff3ae6d561e@26528@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2144-0'
00010000:00000001:17.0:1773851901.014497:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851901.014498:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851901.014499:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=134 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851901.014500:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851901.014500:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000005dc5ade0 refcount 3 to 26528@kfi7
00000100:00000001:17.0:1773851901.014501:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363991648 : -107142345559968 : ffff9e8dfa8d7060)
02000000:00000001:17.0:1773851901.014502:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851901.014502:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.014503:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851901.014503:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26528@kfi7
00000400:00000010:17.0:1773851901.014504:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d50c8a85.
00000100:00000200:17.0:1773851901.014505:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858850199934080, offset 224
00000400:00000200:17.0:1773851901.014506:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26528@kfi7
00000400:00000200:17.0:1773851901.014507:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.014507:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 1
00000400:00000200:17.0:1773851901.014508:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000400:00000200:17.0:1773851901.014509:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 3
00000400:00000200:17.0:1773851901.014510:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26528@kfi7 local destination
00000400:00000200:17.0:1773851901.014512:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770373:8770373:1024:4294967295] 26528@kfi7 LPNI seq info [34337:34337:16:4294967295]
00000400:00000200:17.0:1773851901.014513:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000400:00000200:17.0:1773851901.014514:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26528@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.014515:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26528@kfi7(26528@kfi7:26528@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851901.014516:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 3
00000800:00000200:17.0:1773851901.014517:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851901.014518:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851901.014520:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851901.014522:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009a9 Using peer 26528@kfi7(0x1000000000009a9)
00000800:00000200:17.0:1773851901.014525:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000b83ced21: Posted send of 324 bytes to peer 0x1000000000009a9: rc=0
00000800:00000200:17.0:1773851901.014526:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009a9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851901.014528:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851901.014528:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000005dc5ade0 refcount 2 to 26528@kfi7
00010000:00000001:17.0:1773851901.014529:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851901.014529:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.014530:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851901.014531:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000051be8fc2 x1858850199934080/t0(0) o400->1f277aad-a14c-4077-b83c-4ff3ae6d561e@26528@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2144-0'
00000100:00100000:17.0:1773851901.014533:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000051be8fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1f277aad-a14c-4077-b83c-4ff3ae6d561e+6:39686:x1858850199934080:12345-26528@kfi7:400:default-tuolumne2144-0 Request processed in 54us (89us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851901.014536:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26528@kfi7, seq: 2156445
00000100:00000040:17.0:1773851901.014537:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005ea1098b : new rpc_count 0
00000100:00000001:17.0:1773851901.014537:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851901.014538:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851901.014538:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000800:00000200:18.0:1773851901.014539:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009a9 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851901.014539:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000020:00000010:17.0:1773851901.014540:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005b4be0ac.
00000020:00000040:17.0:1773851901.014540:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000005ea1098b : new refcount 5
00000400:00000200:18.0:1773851901.014541:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851901.014541:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851901.014542:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26528@kfi7: PUT: OK
00000400:00000200:18.0:1773851901.014542:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d50c8a85
00000400:00000010:18.0:1773851901.014543:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d50c8a85.
00000100:00000001:18.0:1773851901.014544:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851901.014544:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851901.014545:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f06d6247 nid 26528@kfi7 refs 2
00000800:00000200:18.0:1773851901.014547:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b83ced21: 2054@kfi7:4 -> 26528@kfi7(00000000a513b33c):0x0 lsk 2474 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1000000000009a9 Transaction freed
00010000:00000001:2.0:1773851901.065732:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065733:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851901.065733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851901.065734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851901.065735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851901.065736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851901.065737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851901.065738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851901.065739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851901.065739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851901.065743:0:937831:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851901.065743:0:937831:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851901.065744:0:937831:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:9.0:1773851901.072353:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851901.072355:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851901.072356:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851901.072359:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851901.072362:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.072363:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10641@kfi7 : PUT - for me
00000400:00000200:9.0:1773851901.072364:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.072366:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 1
00000400:00000200:9.0:1773851901.072367:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.072368:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000400:00000200:9.0:1773851901.072369:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 3
00000400:00000200:9.0:1773851901.072370:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10576@kfi7 to cpt 3
00000400:00000200:9.0:1773851901.072371:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10576@kfi7 of length 224 into portal 12 MB=0x69aeff139c500
00000400:00000200:9.0:1773851901.072372:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10576@kfi7 of length 224/224 into md 0x78146ce49 [64] + 165968
00000800:00000200:9.0:1773851901.072375:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851901.072377:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.072378:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10641@kfi7: PUT: OK
00000100:00000001:9.0:1773851901.072379:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851901.072379:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851901.072380:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009e09479f.
00000100:00000040:9.0:1773851901.072381:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009e09479f x1859205195220224 msgsize 224
00000100:00100000:9.0:1773851901.072383:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-10576@kfi7 (source: 12345-10641@kfi7)
00000100:00000001:9.0:1773851901.072384:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851901.072385:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000100:00000001:8.0:1773851901.072385:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851901.072386:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851901.072386:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851901.072387:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851901.072387:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851901.072387:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851901.072388:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859205195220224
00000020:00000001:8.0:1773851901.072389:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851901.072389:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92593
00000020:00000001:8.0:1773851901.072390:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851901.072393:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000033237b95 refcount=333
00000020:00000001:8.0:1773851901.072393:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630764544 : -107123078787072 : ffff9e9276f11000)
00000020:00000001:8.0:1773851901.072394:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630764544 : -107123078787072 : ffff9e9276f11000)
00000100:00000001:8.0:1773851901.072395:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.072396:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851901.072396:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851901.072398:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.072398:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851901.072399:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851901.072400:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851901.072400:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851901.072401:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851901.072402:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851901.072403:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.072404:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851901.072405:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851901.072406:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851901.072406:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851901.072407:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851901.072407:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10576@kfi7, seq: 2130886
00000100:00000001:9.0:1773851901.072408:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.072408:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000033237b95 : new rpc_count 8
00000100:00000001:8.0:1773851901.072408:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498319104 : -106953211232512 : ffff9eba03d63f00)
00000100:00000001:9.0:1773851901.072409:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.072409:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009e09479f x1859205195220224/t0(0) o400->fe2fec01-85c0-4406-85a9-7671e1eaf5bb@10576@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1154-0'
00000100:00000001:8.0:1773851901.072412:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.072412:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851901.072413:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009e09479f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fe2fec01-85c0-4406-85a9-7671e1eaf5bb+333:39661:x1859205195220224:12345-10576@kfi7:400:default-tuolumne1154-0
00000100:00000200:8.0:1773851901.072414:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859205195220224
00000020:00000001:8.0:1773851901.072415:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851901.072415:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851901.072416:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.072417:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851901.072417:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851901.072418:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851901.072419:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859205195220224, found 0 last_xid 1859205092801151
00000020:00000001:8.0:1773851901.072420:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851901.072420:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851901.072421:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851901.072422:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.072422:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851901.072423:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851901.072423:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851901.072425:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008fdfca40.
02000000:00000001:8.0:1773851901.072425:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.072426:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.072427:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851901.072427:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593887, transno 0, xid 1859205195220224
00010000:00000001:8.0:1773851901.072429:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851901.072430:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009e09479f x1859205195220224/t0(0) o400->fe2fec01-85c0-4406-85a9-7671e1eaf5bb@10576@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1154-0'
00010000:00000001:8.0:1773851901.072432:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851901.072432:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851901.072433:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=134 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851901.072434:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851901.072434:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fd84902e refcount 3 to 10576@kfi7
00000100:00000001:8.0:1773851901.072435:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153280 : -107139310398336 : ffff9e8eaf765480)
02000000:00000001:8.0:1773851901.072436:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851901.072436:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.072437:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851901.072438:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10641@kfi7
00000400:00000010:8.0:1773851901.072438:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007f71c7d5.
00000100:00000200:8.0:1773851901.072439:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859205195220224, offset 224
00000400:00000200:8.0:1773851901.072440:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10641@kfi7
00000400:00000200:8.0:1773851901.072441:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.072441:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 1
00000400:00000200:8.0:1773851901.072442:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000400:00000200:8.0:1773851901.072443:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 3
00000400:00000200:8.0:1773851901.072444:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10641@kfi7 local destination
00000400:00000200:8.0:1773851901.072446:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770374:8770374:1024:4294967295] 10641@kfi7 LPNI seq info [4421991:4421991:16:4294967295]
00000400:00000200:8.0:1773851901.072447:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000400:00000200:8.0:1773851901.072448:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10641@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.072449:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10641@kfi7(10641@kfi7:10641@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851901.072451:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 3
00000800:00000200:8.0:1773851901.072452:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851901.072453:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851901.072455:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851901.072458:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe93 Using peer 10641@kfi7(0xe93)
00000800:00000200:8.0:1773851901.072460:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0xe93: rc=0
00000800:00000200:8.0:1773851901.072462:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe93 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851901.072463:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.072464:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fd84902e refcount 2 to 10576@kfi7
00010000:00000001:8.0:1773851901.072465:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851901.072465:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.072466:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851901.072466:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009e09479f x1859205195220224/t0(0) o400->fe2fec01-85c0-4406-85a9-7671e1eaf5bb@10576@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1154-0'
00000100:00100000:8.0:1773851901.072470:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009e09479f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:fe2fec01-85c0-4406-85a9-7671e1eaf5bb+333:39661:x1859205195220224:12345-10576@kfi7:400:default-tuolumne1154-0 Request processed in 56us (87us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851901.072473:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10576@kfi7, seq: 2130886
00000100:00000040:8.0:1773851901.072473:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000033237b95 : new rpc_count 7
00000100:00000001:8.0:1773851901.072474:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851901.072474:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851901.072475:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.072476:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851901.072476:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851901.072477:0:60829:0:(genops.c:882:class_export_put()) PUTting export 0000000033237b95 : new refcount 332
00000100:00000001:8.0:1773851901.072478:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851901.072482:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe93 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851901.072484:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.072485:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10641@kfi7: PUT: OK
00000400:00000200:9.0:1773851901.072486:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007f71c7d5
00000400:00000010:9.0:1773851901.072487:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007f71c7d5.
00000100:00000001:9.0:1773851901.072488:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851901.072488:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851901.072489:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003fa70a27 nid 10641@kfi7 refs 2
00000800:00000200:9.0:1773851901.072491:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2069@kfi7:2 -> 10641@kfi7(000000007a84552e):0x0 lsk 3732 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe93 Transaction freed
00000800:00000200:5.0:1773851901.084216:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851901.084217:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851901.084219:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851901.084223:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851901.084227:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.084229:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22833@kfi7 : PUT - for me
00000400:00000200:5.0:1773851901.084231:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.084232:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 1
00000400:00000200:5.0:1773851901.084234:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.084235:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000400:00000200:5.0:1773851901.084237:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 3
00000400:00000200:5.0:1773851901.084239:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23024@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.084240:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23024@kfi7 of length 224 into portal 12 MB=0x69b4665285f80
00000400:00000200:5.0:1773851901.084242:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23024@kfi7 of length 224/224 into md 0x793926dc5 [64] + 166888
00000800:00000200:5.0:1773851901.084245:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851901.084248:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.084250:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22833@kfi7: PUT: OK
00000100:00000001:5.0:1773851901.084252:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851901.084252:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851901.084255:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000029aabbbc.
00000100:00000040:5.0:1773851901.084256:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000029aabbbc x1859576507424640 msgsize 224
00000100:00100000:5.0:1773851901.084259:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23024@kfi7 (source: 12345-22833@kfi7)
00000100:00000001:5.0:1773851901.084260:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851901.084262:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000100:00000001:4.0:1773851901.084262:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851901.084262:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851901.084263:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851901.084263:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851901.084264:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851901.084264:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851901.084265:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859576507424640
00000020:00000001:4.0:1773851901.084266:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851901.084266:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc30bd679
00000020:00000001:4.0:1773851901.084267:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851901.084270:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000014ddb816 refcount=5
00000020:00000001:4.0:1773851901.084270:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637072996454400 : -107000713097216 : ffff9eaef4815000)
00000020:00000001:4.0:1773851901.084271:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637072996454400 : -107000713097216 : ffff9eaef4815000)
00000100:00000001:4.0:1773851901.084272:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851901.084273:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851901.084274:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851901.084275:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851901.084275:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007ea80e0f.
00000100:00000001:4.0:1773851901.084276:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851901.084277:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851901.084277:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.084278:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851901.084279:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851901.084279:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.084280:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.084281:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851901.084282:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851901.084282:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23024@kfi7, seq: 2002000
00000100:00000001:7.0:1773851901.084283:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:4.0:1773851901.084283:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000014ddb816 : new rpc_count 1
00000100:00000001:7.0:1773851901.084284:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851901.084284:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.084284:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637142761866368 : -106930947685248 : ffff9ebf32d90480)
00000100:00000001:7.0:1773851901.084285:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851901.084285:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000029aabbbc x1859576507424640/t0(0) o400->34309051-ae01-4994-9f23-d7dfc668d6f2@23024@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1917-0'
00000100:00000001:4.0:1773851901.084287:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851901.084289:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851901.084289:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000029aabbbc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:34309051-ae01-4994-9f23-d7dfc668d6f2+5:39860:x1859576507424640:12345-23024@kfi7:400:default-tuolumne1917-0
00000100:00000200:4.0:1773851901.084291:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859576507424640
00000020:00000001:4.0:1773851901.084292:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851901.084292:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851901.084293:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851901.084294:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851901.084295:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851901.084295:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851901.084296:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859576507424640, found 0 last_xid 1859576507424639
00000020:00000001:4.0:1773851901.084297:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851901.084298:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851901.084298:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851901.084299:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851901.084299:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851901.084300:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851901.084301:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851901.084301:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c91e8177.
02000000:00000001:4.0:1773851901.084302:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.084303:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851901.084304:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851901.084304:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098907222, transno 0, xid 1859576507424640
00010000:00000001:4.0:1773851901.084305:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851901.084306:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000029aabbbc x1859576507424640/t0(0) o400->34309051-ae01-4994-9f23-d7dfc668d6f2@23024@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1917-0'
00010000:00000001:4.0:1773851901.084308:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851901.084308:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851901.084309:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=133 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851901.084310:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851901.084311:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006bc7a0cd refcount 3 to 23024@kfi7
00000100:00000001:4.0:1773851901.084312:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232980480 : -107130476571136 : ffff9e90bdffd600)
02000000:00000001:4.0:1773851901.084313:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851901.084313:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.084324:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851901.084324:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22833@kfi7
00000400:00000010:4.0:1773851901.084325:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e586845a.
00000100:00000200:4.0:1773851901.084326:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859576507424640, offset 224
00000400:00000200:4.0:1773851901.084327:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22833@kfi7
00000400:00000200:4.0:1773851901.084328:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:4.0:1773851901.084329:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 1
00000400:00000200:4.0:1773851901.084330:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000400:00000200:4.0:1773851901.084331:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 3
00000400:00000200:4.0:1773851901.084332:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22833@kfi7 local destination
00000400:00000200:4.0:1773851901.084333:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770375:8770375:1024:4294967295] 22833@kfi7 LPNI seq info [3861660:3861660:16:4294967295]
00000400:00000200:4.0:1773851901.084335:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000400:00000200:4.0:1773851901.084335:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22833@kfi7 to cpt 1
00000400:00000200:4.0:1773851901.084337:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22833@kfi7(22833@kfi7:22833@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851901.084338:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 3
00000800:00000200:4.0:1773851901.084340:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851901.084341:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851901.084343:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851901.084345:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x102c Using peer 22833@kfi7(0x102c)
00000800:00000200:4.0:1773851901.084348:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x102c: rc=0
00000800:00000200:4.0:1773851901.084350:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x102c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851901.084352:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851901.084353:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006bc7a0cd refcount 2 to 23024@kfi7
00010000:00000001:4.0:1773851901.084353:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851901.084354:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851901.084355:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851901.084355:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000029aabbbc x1859576507424640/t0(0) o400->34309051-ae01-4994-9f23-d7dfc668d6f2@23024@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1917-0'
00000100:00100000:4.0:1773851901.084361:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000029aabbbc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:34309051-ae01-4994-9f23-d7dfc668d6f2+5:39860:x1859576507424640:12345-23024@kfi7:400:default-tuolumne1917-0 Request processed in 73us (104us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851901.084364:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23024@kfi7, seq: 2002000
00000100:00000040:4.0:1773851901.084365:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000014ddb816 : new rpc_count 0
00000100:00000001:4.0:1773851901.084366:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851901.084366:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851901.084367:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851901.084368:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007ea80e0f.
00000020:00000010:4.0:1773851901.084369:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000020:00000040:4.0:1773851901.084370:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000014ddb816 : new refcount 4
00000100:00000001:4.0:1773851901.084370:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851901.084377:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x102c TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851901.084380:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.084382:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22833@kfi7: PUT: OK
00000400:00000200:5.0:1773851901.084384:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e586845a
00000400:00000010:5.0:1773851901.084385:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e586845a.
00000100:00000001:5.0:1773851901.084387:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851901.084388:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851901.084389:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e89466ba nid 22833@kfi7 refs 2
00000800:00000200:5.0:1773851901.084392:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 22833@kfi7(000000001b188498):0x0 lsk 4141 rsk 17 tsk 0 trmk 0 tmk 0 trr 1 tta 0x102c Transaction freed
00000800:00000200:21.0:1773851901.132017:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851901.132018:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851901.132019:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851901.132021:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 17491@kfi7(00000000c2b35ba4):0x126 version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851901.132023:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 Using peer 17491@kfi7(0x100000000000126)
00000400:00000200:21.0:1773851901.132025:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000800:00000200:21.0:1773851901.132027:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0x100000000000126: rc=0
00000800:00000200:21.0:1773851901.132029:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:21.0:1773851901.132039:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 TN_EVENT_TX_OK event status 0
00000800:00000200:21.0:1773851901.132041:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 Transaction freed
00000800:00000200:21.0:1773851901.132239:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851901.132240:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851901.132241:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851901.132243:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851901.132244:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.132246:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17491@kfi7 : PUT - for me
00000400:00000200:21.0:1773851901.132246:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.132248:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 1
00000400:00000200:21.0:1773851901.132249:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.132249:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000400:00000200:21.0:1773851901.132250:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 3
00000400:00000200:21.0:1773851901.132252:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.132253:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17491@kfi7 of length 224 into portal 12 MB=0x699e11ad75b80
00000400:00000200:21.0:1773851901.132254:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17491@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 68240
00000800:00000200:21.0:1773851901.132255:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851901.132257:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851901.132258:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17491@kfi7: PUT: OK
00000100:00000001:21.0:1773851901.132259:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851901.132259:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851901.132260:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ba376a50.
00000100:00000040:21.0:1773851901.132261:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ba376a50 x1858041957276544 msgsize 224
00000100:00100000:21.0:1773851901.132262:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17491@kfi7 (source: 12345-17491@kfi7)
00000100:00000001:21.0:1773851901.132263:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851901.132264:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000100:00000001:23.0:1773851901.132265:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851901.132265:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851901.132265:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851901.132266:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851901.132266:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851901.132267:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851901.132268:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041957276544
00000020:00000001:23.0:1773851901.132268:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851901.132269:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92259
00000020:00000001:23.0:1773851901.132269:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851901.132272:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f5875560 refcount=7
00000020:00000001:23.0:1773851901.132273:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630010880 : -107123079540736 : ffff9e9276e59000)
00000020:00000001:23.0:1773851901.132274:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630010880 : -107123079540736 : ffff9e9276e59000)
00000100:00000001:23.0:1773851901.132275:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851901.132276:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851901.132277:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000af79742e.
00000020:00000010:23.0:1773851901.132278:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851901.132279:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851901.132279:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851901.132280:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851901.132281:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851901.132281:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851901.132282:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851901.132282:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851901.132283:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851901.132284:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851901.132284:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851901.132285:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851901.132286:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17491@kfi7, seq: 1998084
00000100:00000001:20.0:1773851901.132286:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:23.0:1773851901.132287:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f5875560 : new rpc_count 1
00000100:00000001:23.0:1773851901.132287:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313401600 : -106917396150016 : ffff9ec25a950900)
00000100:00000001:20.0:1773851901.132287:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851901.132287:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851901.132288:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ba376a50 x1858041957276544/t0(0) o400->ffa2222d-56e5-4372-aae4-de164838bb86@17491@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1590-0'
00000100:00000001:23.0:1773851901.132292:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851901.132293:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851901.132294:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba376a50 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ffa2222d-56e5-4372-aae4-de164838bb86+7:39617:x1858041957276544:12345-17491@kfi7:400:default-tuolumne1590-0
00000100:00000200:23.0:1773851901.132295:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041957276544
00000020:00000001:23.0:1773851901.132296:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851901.132296:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851901.132297:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.132298:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851901.132298:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851901.132299:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851901.132300:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041957276544, found 0 last_xid 1858041957276543
00000020:00000001:23.0:1773851901.132301:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851901.132301:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851901.132302:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851901.132303:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.132303:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851901.132304:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851901.132304:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851901.132305:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bbc241c3.
02000000:00000001:23.0:1773851901.132306:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851901.132307:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.132307:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851901.132308:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183245961964, transno 0, xid 1858041957276544
00010000:00000001:23.0:1773851901.132309:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851901.132310:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ba376a50 x1858041957276544/t0(0) o400->ffa2222d-56e5-4372-aae4-de164838bb86@17491@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1590-0'
00010000:00000001:23.0:1773851901.132312:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851901.132313:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851901.132314:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=134 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851901.132315:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851901.132316:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000098b2b123 refcount 3 to 17491@kfi7
00000100:00000001:23.0:1773851901.132316:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452096 : -107146752099520 : ffff9e8cf3e6fb40)
02000000:00000001:23.0:1773851901.132317:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851901.132318:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851901.132319:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851901.132319:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17491@kfi7
00000400:00000010:23.0:1773851901.132320:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7e037cd.
00000100:00000200:23.0:1773851901.132321:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041957276544, offset 224
00000400:00000200:23.0:1773851901.132322:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17491@kfi7
00000400:00000200:23.0:1773851901.132323:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:23.0:1773851901.132324:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 1
00000400:00000200:23.0:1773851901.132325:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000400:00000200:23.0:1773851901.132326:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 3
00000400:00000200:23.0:1773851901.132327:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17491@kfi7 local destination
00000400:00000200:23.0:1773851901.132328:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770376:8770376:1024:4294967295] 17491@kfi7 LPNI seq info [384900:384900:16:4294967295]
00000400:00000200:23.0:1773851901.132329:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000400:00000200:23.0:1773851901.132330:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17491@kfi7 to cpt 5
00000400:00000200:23.0:1773851901.132332:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17491@kfi7(17491@kfi7:17491@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851901.132334:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 3
00000800:00000200:23.0:1773851901.132335:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851901.132336:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851901.132338:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851901.132341:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 Using peer 17491@kfi7(0x100000000000126)
00000800:00000200:23.0:1773851901.132344:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x100000000000126: rc=0
00000800:00000200:23.0:1773851901.132345:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851901.132347:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851901.132348:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000098b2b123 refcount 2 to 17491@kfi7
00010000:00000001:23.0:1773851901.132349:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851901.132350:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.132351:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851901.132351:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ba376a50 x1858041957276544/t0(0) o400->ffa2222d-56e5-4372-aae4-de164838bb86@17491@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1590-0'
00000100:00100000:23.0:1773851901.132354:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba376a50 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:ffa2222d-56e5-4372-aae4-de164838bb86+7:39617:x1858041957276544:12345-17491@kfi7:400:default-tuolumne1590-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000800:00000200:21.0:1773851901.132356:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 TN_EVENT_TX_OK event status 0
00000100:00100000:23.0:1773851901.132357:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17491@kfi7, seq: 1998084
00000400:00000200:21.0:1773851901.132357:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:23.0:1773851901.132358:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f5875560 : new rpc_count 0
00000400:00000200:21.0:1773851901.132358:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17491@kfi7: PUT: OK
00000100:00000001:23.0:1773851901.132359:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851901.132359:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:21.0:1773851901.132359:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7e037cd
00000400:00000010:21.0:1773851901.132359:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7e037cd.
00000020:00000010:23.0:1773851901.132360:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851901.132360:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000100:00000001:21.0:1773851901.132360:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:23.0:1773851901.132361:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000af79742e.
00000100:00000001:21.0:1773851901.132361:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851901.132361:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000074f48145 nid 17491@kfi7 refs 2
00000020:00000040:23.0:1773851901.132362:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000f5875560 : new refcount 6
00000100:00000001:23.0:1773851901.132363:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851901.132363:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2054@kfi7:5 -> 17491@kfi7(00000000c2b35ba4):0x0 lsk 295 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000126 Transaction freed
00000800:00000200:25.0:1773851901.170339:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851901.170340:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851901.170341:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851901.170343:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851901.170345:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.170346:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8514@kfi7 : PUT - for me
00000400:00000200:25.0:1773851901.170347:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.170348:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 1
00000400:00000200:25.0:1773851901.170349:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.170350:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000400:00000200:25.0:1773851901.170350:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 3
00000400:00000200:25.0:1773851901.170351:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.170352:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8514@kfi7 of length 224 into portal 12 MB=0x69b1941641d80
00000400:00000200:25.0:1773851901.170353:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8514@kfi7 of length 224/224 into md 0x16159c9699 [64] + 41792
00000800:00000200:25.0:1773851901.170355:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851901.170356:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851901.170357:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8514@kfi7: PUT: OK
00000100:00000001:25.0:1773851901.170358:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851901.170358:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851901.170359:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fa5dbdb5.
00000100:00000040:25.0:1773851901.170360:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000fa5dbdb5 x1859382633831808 msgsize 224
00000100:00100000:25.0:1773851901.170361:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8514@kfi7 (source: 12345-8514@kfi7)
00000100:00000001:25.0:1773851901.170362:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:26.0:1773851901.170364:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851901.170364:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
02000000:00000001:26.0:1773851901.170365:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851901.170365:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851901.170365:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851901.170366:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.170367:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851901.170367:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859382633831808
00000020:00000001:26.0:1773851901.170368:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851901.170368:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f079668825e2
00000020:00000001:26.0:1773851901.170369:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.170372:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008b9d793a refcount=8
00000020:00000001:26.0:1773851901.170373:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029441421312 : -107044268130304 : ffff9ea4d06c4000)
00000020:00000001:26.0:1773851901.170373:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029441421312 : -107044268130304 : ffff9ea4d06c4000)
00000100:00000001:26.0:1773851901.170374:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.170375:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851901.170376:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000043d0394d.
00000020:00000010:26.0:1773851901.170376:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851901.170377:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851901.170378:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851901.170378:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851901.170379:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.170380:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851901.170380:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851901.170380:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.170381:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.170382:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851901.170383:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851901.170384:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8514@kfi7, seq: 2025194
00000100:00000001:24.0:1773851901.170384:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851901.170384:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851901.170385:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008b9d793a : new rpc_count 1
00000100:00000001:26.0:1773851901.170385:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121199434752 : -106952510116864 : ffff9eba2da06c00)
00000100:00000001:24.0:1773851901.170385:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.170386:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fa5dbdb5 x1859382633831808/t0(0) o400->4eaa24ef-b496-49ee-9889-c2bd9e5f9792@8514@kfi7:151/0 lens 224/0 e 0 to 0 dl 1773852266 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1032-0'
00000100:00000001:24.0:1773851901.170386:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.170389:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.170389:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851901.170390:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fa5dbdb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4eaa24ef-b496-49ee-9889-c2bd9e5f9792+8:39769:x1859382633831808:12345-8514@kfi7:400:default-tuolumne1032-0
00000100:00000200:26.0:1773851901.170393:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859382633831808
00000020:00000001:26.0:1773851901.170394:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851901.170395:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851901.170396:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.170396:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851901.170397:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851901.170398:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851901.170398:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859382633831808, found 0 last_xid 1859382633831807
00000020:00000001:26.0:1773851901.170399:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851901.170400:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851901.170400:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851901.170401:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.170401:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851901.170402:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851901.170402:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851901.170403:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000051c1d96a.
02000000:00000001:26.0:1773851901.170404:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.170404:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.170405:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851901.170406:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182926648606, transno 0, xid 1859382633831808
00010000:00000001:26.0:1773851901.170406:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851901.170407:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fa5dbdb5 x1859382633831808/t0(0) o400->4eaa24ef-b496-49ee-9889-c2bd9e5f9792@8514@kfi7:151/0 lens 224/224 e 0 to 0 dl 1773852266 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1032-0'
00010000:00000001:26.0:1773851901.170410:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851901.170410:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851901.170411:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=134 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851901.170412:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851901.170413:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003c1a782a refcount 3 to 8514@kfi7
00000100:00000001:26.0:1773851901.170413:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299332160 : -107155410219456 : ffff9e8aefd68e40)
02000000:00000001:26.0:1773851901.170414:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851901.170415:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.170415:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851901.170416:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8514@kfi7
00000400:00000010:26.0:1773851901.170417:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004b36f071.
00000100:00000200:26.0:1773851901.170418:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859382633831808, offset 224
00000400:00000200:26.0:1773851901.170419:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8514@kfi7
00000400:00000200:26.0:1773851901.170420:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.170421:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 1
00000400:00000200:26.0:1773851901.170422:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000400:00000200:26.0:1773851901.170423:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 3
00000400:00000200:26.0:1773851901.170424:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8514@kfi7 local destination
00000400:00000200:26.0:1773851901.170425:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770377:8770377:1024:4294967295] 8514@kfi7 LPNI seq info [6325574:6325574:16:4294967295]
00000400:00000200:26.0:1773851901.170426:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000400:00000200:26.0:1773851901.170427:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8514@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.170429:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8514@kfi7(8514@kfi7:8514@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851901.170430:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 3
00000800:00000200:26.0:1773851901.170431:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.170432:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851901.170434:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851901.170437:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x9a6 Using peer 8514@kfi7(0x9a6)
00000800:00000200:26.0:1773851901.170440:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 324 bytes to peer 0x9a6: rc=0
00000800:00000200:26.0:1773851901.170441:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x9a6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.170443:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.170444:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003c1a782a refcount 2 to 8514@kfi7
00010000:00000001:26.0:1773851901.170444:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851901.170445:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.170445:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851901.170446:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fa5dbdb5 x1859382633831808/t0(0) o400->4eaa24ef-b496-49ee-9889-c2bd9e5f9792@8514@kfi7:151/0 lens 224/224 e 0 to 0 dl 1773852266 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1032-0'
00000100:00100000:26.0:1773851901.170449:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fa5dbdb5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:4eaa24ef-b496-49ee-9889-c2bd9e5f9792+8:39769:x1859382633831808:12345-8514@kfi7:400:default-tuolumne1032-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851901.170451:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8514@kfi7, seq: 2025194
00000100:00000040:26.0:1773851901.170452:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008b9d793a : new rpc_count 0
00000800:00000200:25.0:1773851901.170452:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x9a6 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851901.170453:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851901.170454:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851901.170454:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851901.170454:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851901.170455:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000400:00000200:25.0:1773851901.170455:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8514@kfi7: PUT: OK
00000020:00000010:26.0:1773851901.170456:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000043d0394d.
00000020:00000040:26.0:1773851901.170456:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000008b9d793a : new refcount 7
00000400:00000200:25.0:1773851901.170456:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004b36f071
00000400:00000010:25.0:1773851901.170456:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004b36f071.
00000100:00000001:26.0:1773851901.170457:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851901.170457:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851901.170457:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851901.170458:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ab803f0c nid 8514@kfi7 refs 2
00000800:00000200:25.0:1773851901.170459:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8514@kfi7(00000000b7bcc36a):0x0 lsk 2471 rsk 39 tsk 0 trmk 0 tmk 0 trr 6 tta 0x9a6 Transaction freed
00000800:00000200:1.0:1773851901.192063:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851901.192066:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851901.192069:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851901.192073:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851901.192077:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.192079:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20432@kfi7 : PUT - for me
00000400:00000200:1.0:1773851901.192081:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.192082:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 1
00000400:00000200:1.0:1773851901.192084:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.192085:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000400:00000200:1.0:1773851901.192086:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 3
00000400:00000200:1.0:1773851901.192088:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20241@kfi7 to cpt 1
00000400:00000200:1.0:1773851901.192090:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20241@kfi7 of length 224 into portal 12 MB=0x69b4c2d16b280
00000400:00000200:1.0:1773851901.192092:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20241@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 55032
00000800:00000200:1.0:1773851901.192096:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851901.192099:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851901.192101:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20432@kfi7: PUT: OK
00000100:00000001:1.0:1773851901.192103:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851901.192103:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851901.192105:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f1860a60.
00000100:00000040:1.0:1773851901.192106:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000f1860a60 x1859601336545920 msgsize 224
00000100:00100000:1.0:1773851901.192109:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-20241@kfi7 (source: 12345-20432@kfi7)
00000100:00000001:1.0:1773851901.192111:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:0.0:1773851901.192112:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:1.0:1773851901.192113:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
02000000:00000001:0.0:1773851901.192113:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851901.192113:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851901.192114:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851901.192115:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851901.192115:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601336545920
00000800:00000200:1.0:1773851901.192116:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000020:00000001:0.0:1773851901.192116:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851901.192116:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7d849
00000020:00000001:0.0:1773851901.192117:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851901.192119:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000029d36c25 refcount=5
00000020:00000001:0.0:1773851901.192120:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142389326848 : -106931320224768 : ffff9ebf1ca48400)
00000020:00000001:0.0:1773851901.192120:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142389326848 : -106931320224768 : ffff9ebf1ca48400)
00000100:00000001:0.0:1773851901.192121:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851901.192122:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851901.192123:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000637bc2c7.
00000020:00000010:0.0:1773851901.192124:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851901.192124:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851901.192125:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851901.192125:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851901.192126:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851901.192127:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851901.192127:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851901.192127:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.192129:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851901.192130:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851901.192130:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851901.192131:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:0.0:1773851901.192131:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20241@kfi7, seq: 1997635
00000100:00000001:2.0:1773851901.192132:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:0.0:1773851901.192132:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000029d36c25 : new rpc_count 1
00000100:00000001:0.0:1773851901.192132:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117848915328 : -106955860636288 : ffff9eb965eb8d80)
00000100:00000001:2.0:1773851901.192133:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851901.192133:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f1860a60 x1859601336545920/t0(0) o400->c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb@20241@kfi7:541/0 lens 224/0 e 0 to 0 dl 1773852656 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1761-0'
00000100:00000001:2.0:1773851901.192134:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.192136:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851901.192136:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851901.192137:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f1860a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb+5:39442:x1859601336545920:12345-20241@kfi7:400:default-tuolumne1761-0
00000100:00000200:0.0:1773851901.192139:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601336545920
00000020:00000001:0.0:1773851901.192139:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851901.192140:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851901.192140:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.192141:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851901.192142:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851901.192142:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851901.192143:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601336545920, found 0 last_xid 1859601336545919
00000020:00000001:0.0:1773851901.192143:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851901.192144:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851901.192145:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851901.192145:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.192146:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851901.192146:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851901.192147:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851901.192147:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007969ab98.
02000000:00000001:0.0:1773851901.192148:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.192148:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.192149:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851901.192150:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183105131216, transno 0, xid 1859601336545920
00010000:00000001:0.0:1773851901.192150:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851901.192151:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f1860a60 x1859601336545920/t0(0) o400->c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb@20241@kfi7:541/0 lens 224/224 e 0 to 0 dl 1773852656 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1761-0'
00010000:00000001:0.0:1773851901.192153:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851901.192154:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851901.192154:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=134 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851901.192155:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851901.192156:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007fb1e49a refcount 3 to 20241@kfi7
00000100:00000001:0.0:1773851901.192157:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405411232 : -107145304140384 : ffff9e8d4a3515a0)
02000000:00000001:0.0:1773851901.192157:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851901.192158:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.192158:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851901.192160:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20432@kfi7
00000400:00000010:0.0:1773851901.192160:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d94499d6.
00000100:00000200:0.0:1773851901.192161:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601336545920, offset 224
00000400:00000200:0.0:1773851901.192162:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20432@kfi7
00000400:00000200:0.0:1773851901.192163:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:0.0:1773851901.192164:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 1
00000400:00000200:0.0:1773851901.192165:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000400:00000200:0.0:1773851901.192166:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 3
00000400:00000200:0.0:1773851901.192167:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20432@kfi7 local destination
00000400:00000200:0.0:1773851901.192168:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770378:8770378:1024:4294967295] 20432@kfi7 LPNI seq info [10496295:10496295:16:4294967295]
00000400:00000200:0.0:1773851901.192170:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000400:00000200:0.0:1773851901.192170:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20432@kfi7 to cpt 0
00000400:00000200:0.0:1773851901.192172:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20432@kfi7(20432@kfi7:20432@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851901.192173:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 3
00000800:00000200:0.0:1773851901.192175:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851901.192176:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851901.192178:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851901.192180:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bda Using peer 20432@kfi7(0x100000000000bda)
00000800:00000200:0.0:1773851901.192183:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x100000000000bda: rc=0
00000800:00000200:0.0:1773851901.192184:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bda TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851901.192186:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851901.192187:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007fb1e49a refcount 2 to 20241@kfi7
00010000:00000001:0.0:1773851901.192187:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851901.192188:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.192188:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851901.192189:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f1860a60 x1859601336545920/t0(0) o400->c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb@20241@kfi7:541/0 lens 224/224 e 0 to 0 dl 1773852656 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1761-0'
00000100:00100000:0.0:1773851901.192196:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f1860a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:c9a6c4e9-2b15-439f-b879-2cf6b0cdf1fb+5:39442:x1859601336545920:12345-20241@kfi7:400:default-tuolumne1761-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851901.192198:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20241@kfi7, seq: 1997635
00000100:00000040:0.0:1773851901.192199:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000029d36c25 : new rpc_count 0
00000100:00000001:0.0:1773851901.192200:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851901.192200:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851901.192201:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851901.192201:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851901.192202:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000637bc2c7.
00000020:00000040:0.0:1773851901.192203:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000029d36c25 : new refcount 4
00000100:00000001:0.0:1773851901.192204:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851901.192210:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bda TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851901.192213:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851901.192215:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20432@kfi7: PUT: OK
00000400:00000200:1.0:1773851901.192217:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d94499d6
00000400:00000010:1.0:1773851901.192218:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d94499d6.
00000100:00000001:1.0:1773851901.192219:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851901.192219:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851901.192221:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b71c4915 nid 20432@kfi7 refs 2
00000800:00000200:1.0:1773851901.192224:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 20432@kfi7(00000000860beb76):0x0 lsk 3035 rsk 34 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000bda Transaction freed
00000800:00000200:1.0:1773851901.205373:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851901.205374:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851901.205376:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851901.205379:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851901.205381:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.205383:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11515@kfi7 : PUT - for me
00000400:00000200:1.0:1773851901.205384:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.205385:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:1.0:1773851901.205387:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.205388:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851901.205389:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:1.0:1773851901.205390:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11514@kfi7 to cpt 5
00000400:00000200:1.0:1773851901.205391:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11514@kfi7 of length 224 into portal 12 MB=0x699de8c6d7c00
00000400:00000200:1.0:1773851901.205393:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11514@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 55256
00000800:00000200:1.0:1773851901.205396:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851901.205398:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851901.205399:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11515@kfi7: PUT: OK
00000100:00000001:1.0:1773851901.205400:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851901.205401:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851901.205402:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000eaba38c3.
00000100:00000040:1.0:1773851901.205403:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000eaba38c3 x1858030978038784 msgsize 224
00000100:00100000:1.0:1773851901.205405:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11514@kfi7 (source: 12345-11515@kfi7)
00000100:00000001:1.0:1773851901.205407:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851901.205408:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000800:00000200:1.0:1773851901.205410:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851901.205410:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851901.205410:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851901.205411:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851901.205411:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851901.205412:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851901.205413:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978038784
00000020:00000001:0.0:1773851901.205414:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851901.205415:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90efd
00000020:00000001:0.0:1773851901.205415:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851901.205417:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009f551fac refcount=6
00000020:00000001:0.0:1773851901.205418:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239890944 : -107152469660672 : ffff9e8b9f1bec00)
00000020:00000001:0.0:1773851901.205420:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239890944 : -107152469660672 : ffff9e8b9f1bec00)
00000100:00000001:0.0:1773851901.205421:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851901.205422:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851901.205423:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000637bc2c7.
00000020:00000010:0.0:1773851901.205424:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851901.205425:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851901.205426:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851901.205426:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851901.205427:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851901.205428:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851901.205429:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851901.205430:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.205431:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851901.205433:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851901.205434:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851901.205434:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851901.205435:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851901.205435:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11514@kfi7, seq: 1997636
00000100:00000001:2.0:1773851901.205436:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851901.205436:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009f551fac : new rpc_count 1
00000100:00000001:2.0:1773851901.205437:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.205437:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117848916480 : -106955860635136 : ffff9eb965eb9200)
00000100:00000040:0.0:1773851901.205439:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000eaba38c3 x1858030978038784/t0(0) o400->007dbd5a-bbfd-4f1d-b41d-342980af677a@11514@kfi7:541/0 lens 224/0 e 0 to 0 dl 1773852656 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne213-0'
00000100:00000001:0.0:1773851901.205443:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851901.205444:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851901.205445:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000eaba38c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:007dbd5a-bbfd-4f1d-b41d-342980af677a+6:47854:x1858030978038784:12345-11514@kfi7:400:default-tuolumne213-0
00000100:00000200:0.0:1773851901.205447:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978038784
00000020:00000001:0.0:1773851901.205448:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851901.205448:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851901.205449:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.205450:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851901.205451:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851901.205452:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851901.205453:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978038784, found 0 last_xid 1858030978038783
00000020:00000001:0.0:1773851901.205454:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851901.205455:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851901.205455:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851901.205456:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.205457:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851901.205457:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851901.205458:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851901.205459:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000084d0cd65.
02000000:00000001:0.0:1773851901.205460:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.205461:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.205462:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851901.205463:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030978038784
00010000:00000001:0.0:1773851901.205464:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851901.205465:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000eaba38c3 x1858030978038784/t0(0) o400->007dbd5a-bbfd-4f1d-b41d-342980af677a@11514@kfi7:541/0 lens 224/224 e 0 to 0 dl 1773852656 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00010000:00000001:0.0:1773851901.205469:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851901.205470:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851901.205471:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=134 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851901.205472:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851901.205473:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e9f490fd refcount 5 to 11514@kfi7
00000100:00000001:0.0:1773851901.205474:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450464 : -107146752101152 : ffff9e8cf3e6f4e0)
02000000:00000001:0.0:1773851901.205475:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851901.205476:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.205476:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851901.205478:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11515@kfi7
00000400:00000010:0.0:1773851901.205478:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c2d69e3.
00000100:00000200:0.0:1773851901.205480:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978038784, offset 224
00000400:00000200:0.0:1773851901.205481:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11515@kfi7
00000400:00000200:0.0:1773851901.205483:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:0.0:1773851901.205484:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:0.0:1773851901.205485:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:0.0:1773851901.205487:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:0.0:1773851901.205488:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11515@kfi7 local destination
00000400:00000200:0.0:1773851901.205490:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770379:8770379:1024:4294967295] 11515@kfi7 LPNI seq info [24507:24507:16:4294967295]
00000400:00000200:0.0:1773851901.205492:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:0.0:1773851901.205494:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:0.0:1773851901.205497:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11515@kfi7(11515@kfi7:11515@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851901.205498:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000800:00000200:0.0:1773851901.205500:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851901.205502:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851901.205505:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851901.205509:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a Using peer 11515@kfi7(0x10000000000008a)
00000800:00000200:0.0:1773851901.205513:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 324 bytes to peer 0x10000000000008a: rc=0
00000800:00000200:0.0:1773851901.205515:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851901.205518:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851901.205519:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e9f490fd refcount 4 to 11514@kfi7
00010000:00000001:0.0:1773851901.205520:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851901.205520:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.205521:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851901.205524:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000eaba38c3 x1858030978038784/t0(0) o400->007dbd5a-bbfd-4f1d-b41d-342980af677a@11514@kfi7:541/0 lens 224/224 e 0 to 0 dl 1773852656 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00000100:00100000:0.0:1773851901.205529:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000eaba38c3 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:007dbd5a-bbfd-4f1d-b41d-342980af677a+6:47854:x1858030978038784:12345-11514@kfi7:400:default-tuolumne213-0 Request processed in 85us (125us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851901.205532:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11514@kfi7, seq: 1997636
00000100:00000040:0.0:1773851901.205534:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009f551fac : new rpc_count 0
00000100:00000001:0.0:1773851901.205534:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851901.205535:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851901.205536:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851901.205537:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851901.205538:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000637bc2c7.
00000020:00000040:0.0:1773851901.205539:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000009f551fac : new refcount 5
00000100:00000001:0.0:1773851901.205540:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851901.205547:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851901.205549:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851901.205551:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11515@kfi7: PUT: OK
00000400:00000200:1.0:1773851901.205552:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c2d69e3
00000400:00000010:1.0:1773851901.205553:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c2d69e3.
00000100:00000001:1.0:1773851901.205554:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851901.205554:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851901.205555:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000800:00000200:1.0:1773851901.205557:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2054@kfi7:0 -> 11515@kfi7(00000000b8e9c352):0x0 lsk 139 rsk 133 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000008a Transaction freed
00000800:00000200:1.0:1773851901.206164:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851901.206165:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851901.206166:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851901.206168:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851901.206170:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.206171:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11515@kfi7 : PUT - for me
00000400:00000200:1.0:1773851901.206171:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.206172:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:1.0:1773851901.206173:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:1.0:1773851901.206173:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:1.0:1773851901.206174:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:1.0:1773851901.206174:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11514@kfi7 to cpt 5
00000400:00000200:1.0:1773851901.206175:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11514@kfi7 of length 224 into portal 12 MB=0x699de8c6d8480
00000400:00000200:1.0:1773851901.206176:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11514@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 55480
00000800:00000200:1.0:1773851901.206177:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851901.206179:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851901.206180:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11515@kfi7: PUT: OK
00000100:00000001:1.0:1773851901.206180:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851901.206181:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851901.206181:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce99d349.
00000100:00000040:1.0:1773851901.206182:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000ce99d349 x1858030978040960 msgsize 224
00000100:00100000:1.0:1773851901.206183:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11514@kfi7 (source: 12345-11515@kfi7)
00000100:00000001:1.0:1773851901.206184:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851901.206185:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000100:00000001:0.0:1773851901.206185:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851901.206186:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851901.206186:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851901.206186:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851901.206186:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851901.206187:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851901.206187:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978040960
00000020:00000001:0.0:1773851901.206188:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851901.206188:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912e6
00000020:00000001:0.0:1773851901.206188:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851901.206190:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a671848 refcount=6
00000020:00000001:0.0:1773851901.206190:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716203520 : -107155993348096 : ffff9e8acd14b800)
00000020:00000001:0.0:1773851901.206191:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716203520 : -107155993348096 : ffff9e8acd14b800)
00000100:00000001:0.0:1773851901.206192:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851901.206193:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851901.206193:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000637bc2c7.
00000020:00000010:0.0:1773851901.206194:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851901.206194:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851901.206195:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851901.206195:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851901.206195:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851901.206196:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851901.206196:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851901.206197:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.206197:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851901.206198:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851901.206198:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851901.206199:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851901.206199:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851901.206199:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11514@kfi7, seq: 1997637
00000100:00000001:2.0:1773851901.206200:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851901.206200:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851901.206200:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a671848 : new rpc_count 1
00000100:00000001:0.0:1773851901.206200:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117848926848 : -106955860624768 : ffff9eb965ebba80)
00000100:00000040:0.0:1773851901.206201:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ce99d349 x1858030978040960/t0(0) o400->2edac9c7-455d-446a-93b6-0d0a73e9f47f@11514@kfi7:541/0 lens 224/0 e 0 to 0 dl 1773852656 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne213-0'
00000100:00000001:0.0:1773851901.206204:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851901.206204:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851901.206205:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ce99d349 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2edac9c7-455d-446a-93b6-0d0a73e9f47f+6:47856:x1858030978040960:12345-11514@kfi7:400:default-tuolumne213-0
00000100:00000200:0.0:1773851901.206206:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978040960
00000020:00000001:0.0:1773851901.206206:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851901.206207:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851901.206207:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.206208:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851901.206208:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851901.206208:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851901.206209:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978040960, found 0 last_xid 1858030978040959
00000020:00000001:0.0:1773851901.206212:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851901.206212:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851901.206213:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851901.206213:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.206213:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851901.206214:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851901.206214:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851901.206215:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006390c0d7.
02000000:00000001:0.0:1773851901.206215:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.206216:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.206216:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851901.206216:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768320, transno 0, xid 1858030978040960
00010000:00000001:0.0:1773851901.206217:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851901.206218:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ce99d349 x1858030978040960/t0(0) o400->2edac9c7-455d-446a-93b6-0d0a73e9f47f@11514@kfi7:541/0 lens 224/224 e 0 to 0 dl 1773852656 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00010000:00000001:0.0:1773851901.206220:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851901.206220:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851901.206221:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=134 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851901.206221:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851901.206222:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e9f490fd refcount 5 to 11514@kfi7
00000100:00000001:0.0:1773851901.206222:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957450464 : -107146752101152 : ffff9e8cf3e6f4e0)
02000000:00000001:0.0:1773851901.206223:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851901.206223:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851901.206224:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851901.206224:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11515@kfi7
00000400:00000010:0.0:1773851901.206225:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000485e1abd.
00000100:00000200:0.0:1773851901.206225:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978040960, offset 224
00000400:00000200:0.0:1773851901.206226:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11515@kfi7
00000400:00000200:0.0:1773851901.206227:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:0.0:1773851901.206228:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 1
00000400:00000200:0.0:1773851901.206229:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:0.0:1773851901.206229:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000400:00000200:0.0:1773851901.206230:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11515@kfi7 local destination
00000400:00000200:0.0:1773851901.206231:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770380:8770380:1024:4294967295] 11515@kfi7 LPNI seq info [24508:24508:16:4294967295]
00000400:00000200:0.0:1773851901.206233:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000400:00000200:0.0:1773851901.206234:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11515@kfi7 to cpt 0
00000400:00000200:0.0:1773851901.206235:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11515@kfi7(11515@kfi7:11515@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851901.206236:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 3
00000800:00000200:0.0:1773851901.206237:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851901.206238:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851901.206240:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851901.206242:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 Using peer 11515@kfi7(0x83)
00000800:00000200:0.0:1773851901.206244:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x83: rc=0
00000800:00000200:0.0:1773851901.206245:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851901.206247:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851901.206248:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e9f490fd refcount 4 to 11514@kfi7
00010000:00000001:0.0:1773851901.206248:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851901.206248:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851901.206249:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851901.206249:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce99d349 x1858030978040960/t0(0) o400->2edac9c7-455d-446a-93b6-0d0a73e9f47f@11514@kfi7:541/0 lens 224/224 e 0 to 0 dl 1773852656 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne213-0'
00000100:00100000:0.0:1773851901.206252:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ce99d349 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:2edac9c7-455d-446a-93b6-0d0a73e9f47f+6:47856:x1858030978040960:12345-11514@kfi7:400:default-tuolumne213-0 Request processed in 48us (69us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851901.206256:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11514@kfi7, seq: 1997637
00000100:00000040:0.0:1773851901.206256:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a671848 : new rpc_count 0
00000100:00000001:0.0:1773851901.206257:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851901.206257:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851901.206257:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851901.206258:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000020:00000010:0.0:1773851901.206258:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000637bc2c7.
00000020:00000040:0.0:1773851901.206259:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000009a671848 : new refcount 5
00000100:00000001:0.0:1773851901.206260:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851901.206264:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851901.206266:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851901.206266:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11515@kfi7: PUT: OK
00000400:00000200:1.0:1773851901.206267:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000485e1abd
00000400:00000010:1.0:1773851901.206267:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000485e1abd.
00000100:00000001:1.0:1773851901.206268:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851901.206268:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851901.206269:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000698362cd nid 11515@kfi7 refs 2
00000800:00000200:1.0:1773851901.206270:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2069@kfi7:0 -> 11515@kfi7(00000000b64ac115):0x0 lsk 132 rsk 132 tsk 0 trmk 0 tmk 0 trr 0 tta 0x83 Transaction freed
00000800:00000200:9.0:1773851901.257024:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851901.257025:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851901.257028:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851901.257032:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851901.257036:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.257038:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23027@kfi7 : PUT - for me
00000400:00000200:9.0:1773851901.257040:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.257041:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 1
00000400:00000200:9.0:1773851901.257043:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.257044:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000400:00000200:9.0:1773851901.257046:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 3
00000400:00000200:9.0:1773851901.257047:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23026@kfi7 to cpt 7
00000400:00000200:9.0:1773851901.257049:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23026@kfi7 of length 224 into portal 12 MB=0x69b0a1b590f40
00000400:00000200:9.0:1773851901.257051:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23026@kfi7 of length 224/224 into md 0x78146ce49 [64] + 166192
00000800:00000200:9.0:1773851901.257054:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851901.257057:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.257058:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23027@kfi7: PUT: OK
00000100:00000001:9.0:1773851901.257060:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851901.257060:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851901.257062:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000086245665.
00000100:00000040:9.0:1773851901.257063:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000086245665 x1859317571063616 msgsize 224
00000100:00100000:9.0:1773851901.257065:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-23026@kfi7 (source: 12345-23027@kfi7)
00000100:00000001:9.0:1773851901.257067:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851901.257068:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000100:00000001:8.0:1773851901.257070:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851901.257070:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851901.257071:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851901.257071:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851901.257072:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851901.257073:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851901.257074:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317571063616
00000020:00000001:8.0:1773851901.257075:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851901.257076:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92faa
00000020:00000001:8.0:1773851901.257077:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851901.257081:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006a3b15fb refcount=6
00000020:00000001:8.0:1773851901.257082:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744906752 : -107128964644864 : ffff9e91181e0000)
00000020:00000001:8.0:1773851901.257083:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744906752 : -107128964644864 : ffff9e91181e0000)
00000100:00000001:8.0:1773851901.257085:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.257086:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851901.257087:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851901.257088:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.257089:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851901.257091:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851901.257091:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851901.257092:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851901.257093:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851901.257094:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851901.257095:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.257096:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851901.257098:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851901.257099:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851901.257099:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851901.257101:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851901.257101:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23026@kfi7, seq: 2130887
00000100:00000001:9.0:1773851901.257102:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.257102:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006a3b15fb : new rpc_count 1
00000100:00000001:9.0:1773851901.257103:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.257103:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498302976 : -106953211248640 : ffff9eba03d60000)
00000100:00000040:8.0:1773851901.257105:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000086245665 x1859317571063616/t0(0) o400->846b8381-9333-48d8-8e13-eed170471ae2@23026@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1913-0'
00000100:00000001:8.0:1773851901.257109:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.257109:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851901.257111:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000086245665 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:846b8381-9333-48d8-8e13-eed170471ae2+6:39629:x1859317571063616:12345-23026@kfi7:400:default-tuolumne1913-0
00000100:00000200:8.0:1773851901.257113:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317571063616
00000020:00000001:8.0:1773851901.257114:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851901.257115:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851901.257116:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.257117:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851901.257117:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851901.257119:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851901.257120:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317571063616, found 0 last_xid 1859317571063615
00000020:00000001:8.0:1773851901.257121:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851901.257122:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851901.257123:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851901.257124:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.257125:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851901.257126:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851901.257126:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851901.257128:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000057820081.
02000000:00000001:8.0:1773851901.257129:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.257130:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.257131:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851901.257132:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915840701, transno 0, xid 1859317571063616
00010000:00000001:8.0:1773851901.257133:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851901.257134:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000086245665 x1859317571063616/t0(0) o400->846b8381-9333-48d8-8e13-eed170471ae2@23026@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1913-0'
00010000:00000001:8.0:1773851901.257138:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851901.257139:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851901.257140:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=134 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851901.257142:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851901.257143:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003850777f refcount 3 to 23026@kfi7
00000100:00000001:8.0:1773851901.257144:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805600 : -107130477746016 : ffff9e90bdede8a0)
02000000:00000001:8.0:1773851901.257145:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851901.257145:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.257146:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851901.257148:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23027@kfi7
00000400:00000010:8.0:1773851901.257149:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ce37ba88.
00000100:00000200:8.0:1773851901.257150:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317571063616, offset 224
00000400:00000200:8.0:1773851901.257152:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23027@kfi7
00000400:00000200:8.0:1773851901.257154:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.257155:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 1
00000400:00000200:8.0:1773851901.257157:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000400:00000200:8.0:1773851901.257158:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 3
00000400:00000200:8.0:1773851901.257161:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23027@kfi7 local destination
00000400:00000200:8.0:1773851901.257163:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770381:8770381:1024:4294967295] 23027@kfi7 LPNI seq info [747491:747491:16:4294967295]
00000400:00000200:8.0:1773851901.257165:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000400:00000200:8.0:1773851901.257167:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23027@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.257170:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23027@kfi7(23027@kfi7:23027@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851901.257172:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 3
00000800:00000200:8.0:1773851901.257174:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851901.257176:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851901.257179:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851901.257183:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbf4 Using peer 23027@kfi7(0xbf4)
00000800:00000200:8.0:1773851901.257187:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000006618773c: Posted send of 324 bytes to peer 0xbf4: rc=0
00000800:00000200:8.0:1773851901.257189:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbf4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851901.257192:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.257194:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003850777f refcount 2 to 23026@kfi7
00010000:00000001:8.0:1773851901.257195:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851901.257195:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.257196:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851901.257199:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000086245665 x1859317571063616/t0(0) o400->846b8381-9333-48d8-8e13-eed170471ae2@23026@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1913-0'
00000100:00100000:8.0:1773851901.257204:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000086245665 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:846b8381-9333-48d8-8e13-eed170471ae2+6:39629:x1859317571063616:12345-23026@kfi7:400:default-tuolumne1913-0 Request processed in 94us (140us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851901.257208:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23026@kfi7, seq: 2130887
00000100:00000040:8.0:1773851901.257209:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006a3b15fb : new rpc_count 0
00000100:00000001:8.0:1773851901.257210:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851901.257211:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851901.257212:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.257214:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851901.257215:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851901.257216:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000006a3b15fb : new refcount 5
00000100:00000001:8.0:1773851901.257217:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851901.257224:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbf4 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851901.257227:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.257228:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23027@kfi7: PUT: OK
00000400:00000200:9.0:1773851901.257229:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ce37ba88
00000400:00000010:9.0:1773851901.257230:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ce37ba88.
00000100:00000001:9.0:1773851901.257231:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851901.257232:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851901.257233:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ccd428f6 nid 23027@kfi7 refs 2
00000800:00000200:9.0:1773851901.257235:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2069@kfi7:2 -> 23027@kfi7(00000000a98e2226):0x0 lsk 3061 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0xbf4 Transaction freed
00000004:00000001:6.0:1773851901.257734:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851901.257735:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851901.257736:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000469e2a6b.
00000020:00000040:6.0:1773851901.257738:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851901.257740:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851901.257741:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851901.257742:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851901.257744:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004acfe469.
00000100:00000001:6.0:1773851901.257746:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.257747:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851901.257749:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851901.257751:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000469e2a6b] to pc [ptlrpcd_01_02+2]  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851901.257759:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:4.0:1773851901.257760:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:6.0:1773851901.257761:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000053e2b1ce.
00000100:00000001:4.0:1773851901.257761:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:6.0:1773851901.257762:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637056173004800 : -107017536546816 : ffff9eab09bfd800)
00000100:00000001:5.0:1773851901.257762:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851901.257762:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.257762:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851901.257764:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:4.0:1773851901.257764:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851901.257766:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851901.257767:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000004:00000010:6.0:1773851901.257768:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000032dfdbee.
00000100:00000001:4.0:1773851901.257769:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:6.0:1773851901.257770:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614175711045071ns, next at 614176711043398ns, rc = 0
00000100:00000001:4.0:1773851901.257770:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851901.257771:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851901.257771:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851901.257772:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851901.257773:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851901.257774:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851901.257774:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000469e2a6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051942336:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851901.257776:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851901.257777:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851901.257778:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851901.257779:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:4.0:1773851901.257781:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002e351634.
02000000:00000001:4.0:1773851901.257782:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851901.257785:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:4.0:1773851901.257786:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000400:00000010:4.0:1773851901.257788:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da924145.
00000100:00000200:4.0:1773851901.257789:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942336, portal 4
00000100:00000001:4.0:1773851901.257791:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:4.0:1773851901.257793:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359401472 : -107048350150144 : ffff9ea3dd1d9200)
00000100:00000040:4.0:1773851901.257795:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851901.257800:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851901.257801:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:4.0:1773851901.257802:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000058aef11.
00000100:00000200:4.0:1773851901.257804:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942336, offset 0
00000400:00000200:4.0:1773851901.257806:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:4.0:1773851901.257808:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851901.257810:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:4.0:1773851901.257812:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851901.257814:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:4.0:1773851901.257816:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:4.0:1773851901.257819:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770381, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770379, p:4294967295, g:4294967295, h:1000]
00000400:00000200:4.0:1773851901.257823:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:4.0:1773851901.257824:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:4.0:1773851901.257826:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:4.0:1773851901.257828:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770382:8770382:1024:4294967295] 16@kfi7 LPNI seq info [5403822:5403822:16:4294967295]
00000400:00000200:4.0:1773851901.257830:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:4.0:1773851901.257832:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:4.0:1773851901.257836:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851901.257838:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:4.0:1773851901.257841:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851901.257843:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851901.257847:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851901.257851:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Using peer 16@kfi7(0x200000000000169)
00000800:00000200:4.0:1773851901.257857:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x200000000000169: rc=0
00000800:00000200:4.0:1773851901.257859:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851901.257864:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.257865:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851901.257866:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.257870:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.257871:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.257873:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851901.257873:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:4.0:1773851901.257875:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851901.257875:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851901.257882:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851901.257883:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851901.257883:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851901.257886:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.257888:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000400:00000200:5.0:1773851901.257890:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000058aef11
00000400:00000010:5.0:1773851901.257891:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000058aef11.
00000100:00000001:5.0:1773851901.257892:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851901.257893:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851901.257898:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851901.257900:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851901.257904:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851901.257905:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:5.0:1773851901.257907:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:5.0:1773851901.257910:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000169 Transaction freed
00000800:00000200:29.0:1773851901.257922:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851901.257924:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851901.257926:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851901.257931:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851901.257935:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.257938:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851901.257939:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.257941:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851901.257943:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.257944:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851901.257946:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851901.257948:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.257950:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6dc0
00000400:00000200:29.0:1773851901.257952:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.257954:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x7800821bd [1] + 224
00000800:00000200:29.0:1773851901.257959:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851901.257962:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851901.257964:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851901.257966:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851901.257968:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851901.257974:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851901.257987:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851901.257989:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000100:00000001:4.0:1773851901.257990:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851901.257991:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851901.257992:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16@kfi7(0000000007a30427):0x0 lsk 362 rsk 5430 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000001:4.0:1773851901.257992:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851901.257993:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:4.0:1773851901.257994:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:4.0:1773851901.257995:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da924145
00000400:00000010:4.0:1773851901.257997:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da924145.
00000100:00000001:4.0:1773851901.257998:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:4.0:1773851901.258000:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:4.0:1773851901.258006:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851901.258011:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851901.258011:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.258012:0:41066:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851901.258013:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:4.0:1773851901.258014:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851901.258015:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851901.258016:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851901.258018:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=134 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851901.258020:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851901.258022:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851901.258023:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851901.258024:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851901.258025:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.258027:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851901.258028:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:4.0:1773851901.258029:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851901.258030:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851901.258032:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851901.258036:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851901.258038:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:4.0:1773851901.258039:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851901.258040:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:4.0:1773851901.258041:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:4.0:1773851901.258042:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482217472 avail=351481143296 avail_mb=1372973216 hwm_mb=3131103 files=372097077 ffree=343244353 state=0: rc = 0
00000004:00000020:4.0:1773851901.258046:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482217472 free, 351481143296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097077 files, 343244353 free files
00000004:00000001:4.0:1773851901.258049:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851901.258051:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:4.0:1773851901.258056:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000469e2a6b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051942336:16@kfi7:13:default-yuba2-0
00000100:00000001:4.0:1773851901.258059:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.258060:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:4.0:1773851901.258062:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000469e2a6b x1859433051942336/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851901.258066:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851901.258067:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851901.258068:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002e351634.
02000000:00000001:4.0:1773851901.258070:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851901.258070:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851901.258071:0:41066:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:4.0:1773851901.258072:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851901.258073:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004acfe469.
02000000:00000001:4.0:1773851901.258074:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851901.258076:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851901.258076:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000469e2a6b.
00000100:00000001:4.0:1773851901.258078:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851901.258079:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.258080:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.258081:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851901.258082:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.258083:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851901.258083:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851901.299128:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851901.299129:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851901.299131:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851901.299134:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851901.299137:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.299140:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.103@tcp : PUT - for me
00000400:00000200:9.0:1773851901.299142:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.299143:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851901.299145:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.103@tcp to cpt 3
00000400:00000200:9.0:1773851901.299148:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002abde94d nid 172.16.70.103@tcp refs 2
00000400:00000200:9.0:1773851901.299150:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002abde94d nid 172.16.70.103@tcp refs 3
00000400:00000200:9.0:1773851901.299152:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.103@tcp to cpt 3
00000400:00000200:9.0:1773851901.299153:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.103@tcp of length 224 into portal 12 MB=0x69a13d851b140
00000400:00000200:9.0:1773851901.299156:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.103@tcp of length 224/224 into md 0x82a36e8ed [64] + 61240
00000800:00000200:9.0:1773851901.299159:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851901.299162:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.299164:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851901.299166:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851901.299166:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851901.299168:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ba780a4.
00000100:00000040:9.0:1773851901.299169:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000002ba780a4 x1858259884552512 msgsize 224
00000100:00100000:9.0:1773851901.299171:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.103@tcp (source: 12345-172.16.70.103@tcp)
00000100:00000001:9.0:1773851901.299174:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851901.299175:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851901.299177:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851901.299178:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851901.299180:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851901.299180:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851901.299181:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851901.299183:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851901.299184:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858259884552512
00000020:00000001:12.0:1773851901.299185:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851901.299186:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9304b
00000020:00000001:12.0:1773851901.299187:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.299191:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071f0a341 refcount=6
00000020:00000001:12.0:1773851901.299192:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745139200 : -107128964412416 : ffff9e9118218c00)
00000020:00000001:12.0:1773851901.299195:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745139200 : -107128964412416 : ffff9e9118218c00)
00000100:00000001:12.0:1773851901.299197:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.299198:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851901.299199:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00000020:00000010:12.0:1773851901.299201:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.299203:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851901.299205:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851901.299205:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851901.299206:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851901.299208:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851901.299209:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851901.299210:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.299212:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851901.299214:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851901.299215:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851901.299216:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851901.299216:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851901.299217:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.103@tcp, seq: 2289945
00000100:00000040:12.0:1773851901.299218:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071f0a341 : new rpc_count 1
00000100:00000001:14.0:1773851901.299219:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851901.299220:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.299220:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498332928 : -106953211218688 : ffff9eba03d67500)
00000100:00000040:12.0:1773851901.299222:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002ba780a4 x1858259884552512/t0(0) o400->9597e36b-de2b-415a-a471-4504ee58a17f@172.16.70.103@tcp:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic3-0'
00000100:00000001:12.0:1773851901.299228:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.299228:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851901.299230:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ba780a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9597e36b-de2b-415a-a471-4504ee58a17f+6:53036:x1858259884552512:12345-172.16.70.103@tcp:400:login-rzslic3-0
00000100:00000200:12.0:1773851901.299233:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858259884552512
00000020:00000001:12.0:1773851901.299234:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851901.299235:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851901.299236:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.299237:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851901.299238:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851901.299239:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851901.299240:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858259884552512, found 0 last_xid 1858259884552511
00000020:00000001:12.0:1773851901.299242:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851901.299243:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851901.299244:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851901.299245:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.299246:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851901.299247:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851901.299248:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851901.299249:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000053ccee0b.
02000000:00000001:12.0:1773851901.299250:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.299251:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.299252:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851901.299253:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 172876228056, transno 0, xid 1858259884552512
00010000:00000001:12.0:1773851901.299254:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851901.299255:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002ba780a4 x1858259884552512/t0(0) o400->9597e36b-de2b-415a-a471-4504ee58a17f@172.16.70.103@tcp:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic3-0'
00010000:00000001:12.0:1773851901.299259:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851901.299260:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851901.299261:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=134 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851901.299263:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851901.299264:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e5463af2 refcount 3 to 172.16.70.103@tcp
00000100:00000001:12.0:1773851901.299265:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811150112 : -107154898401504 : ffff9e8b0e584720)
02000000:00000001:12.0:1773851901.299267:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851901.299267:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.299268:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851901.299270:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.103@tcp
00000400:00000010:12.0:1773851901.299271:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000090c520ee.
00000100:00000200:12.0:1773851901.299273:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858259884552512, offset 224
00000400:00000200:12.0:1773851901.299276:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.103@tcp
00000400:00000200:12.0:1773851901.299278:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.103@tcp to cpt 3
00000400:00000200:12.0:1773851901.299280:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002abde94d nid 172.16.70.103@tcp refs 2
00000400:00000200:12.0:1773851901.299282:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002abde94d nid 172.16.70.103@tcp refs 3
00000400:00000200:12.0:1773851901.299284:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002abde94d nid 172.16.70.103@tcp refs 4
00000400:00000200:12.0:1773851901.299286:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.103@tcp routed destination
00000400:00000200:12.0:1773851901.299288:0:60487:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:12.0:1773851901.299290:0:60487:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:12.0:1773851901.299292:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.103@tcp: rtr pref emtpy: 1
00000400:00000200:12.0:1773851901.299294:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:12.0:1773851901.299295:0:60487:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.103@tcp: rtr pref emtpy: 1
00000400:00000200:12.0:1773851901.299296:0:60487:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:12.0:1773851901.299299:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770383:8770383:1024:4294967295] 17@kfi7 LPNI seq info [1250891927:1250891927:16:4294967295]
00000400:00000200:12.0:1773851901.299301:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:12.0:1773851901.299303:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:12.0:1773851901.299307:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.103@tcp(172.16.70.103@tcp:17@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851901.299309:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002abde94d nid 172.16.70.103@tcp refs 3
00000800:00000200:12.0:1773851901.299312:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851901.299314:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851901.299318:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851901.299322:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:12.0:1773851901.299327:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:12.0:1773851901.299329:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851901.299332:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.299334:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e5463af2 refcount 2 to 172.16.70.103@tcp
00010000:00000001:12.0:1773851901.299337:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851901.299338:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.299339:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851901.299340:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002ba780a4 x1858259884552512/t0(0) o400->9597e36b-de2b-415a-a471-4504ee58a17f@172.16.70.103@tcp:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic3-0'
00000100:00100000:12.0:1773851901.299346:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ba780a4 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9597e36b-de2b-415a-a471-4504ee58a17f+6:53036:x1858259884552512:12345-172.16.70.103@tcp:400:login-rzslic3-0 Request processed in 117us (175us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851901.299350:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.103@tcp, seq: 2289945
00000100:00000040:12.0:1773851901.299352:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071f0a341 : new rpc_count 0
00000100:00000001:12.0:1773851901.299353:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851901.299354:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851901.299355:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.299356:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851901.299357:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851901.299358:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000071f0a341 : new refcount 5
00000100:00000001:12.0:1773851901.299359:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851901.299368:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851901.299372:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851901.299373:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:14.0:1773851901.299375:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000090c520ee
00000400:00000010:14.0:1773851901.299376:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000090c520ee.
00000100:00000001:14.0:1773851901.299377:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851901.299378:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851901.299379:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:14.0:1773851901.299382:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000001a Transaction freed
00000800:00000200:13.0:1773851901.573117:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851901.573118:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851901.573119:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851901.573121:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851901.573123:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.573124:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19027@kfi7 : PUT - for me
00000400:00000200:13.0:1773851901.573125:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.573126:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 1
00000400:00000200:13.0:1773851901.573127:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.573128:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000400:00000200:13.0:1773851901.573129:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 3
00000400:00000200:13.0:1773851901.573130:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19091@kfi7 to cpt 7
00000400:00000200:13.0:1773851901.573131:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19091@kfi7 of length 224 into portal 12 MB=0x69b4b67b45ac0
00000400:00000200:13.0:1773851901.573132:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19091@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 61464
00000800:00000200:13.0:1773851901.573134:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851901.573136:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.573137:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19027@kfi7: PUT: OK
00000100:00000001:13.0:1773851901.573138:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851901.573139:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851901.573140:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e2231f64.
00000100:00000040:13.0:1773851901.573141:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000e2231f64 x1859598024989376 msgsize 224
00000100:00100000:13.0:1773851901.573142:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-19091@kfi7 (source: 12345-19027@kfi7)
00000100:00000001:13.0:1773851901.573144:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851901.573144:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000100:00000001:12.0:1773851901.573145:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851901.573145:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851901.573146:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851901.573146:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851901.573146:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851901.573147:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851901.573147:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598024989376
00000020:00000001:12.0:1773851901.573148:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851901.573148:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822e6
00000020:00000001:12.0:1773851901.573148:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.573152:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000003288035 refcount=5
00000020:00000001:12.0:1773851901.573153:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637099150530560 : -106974559021056 : ffff9eb50b68d800)
00000020:00000001:12.0:1773851901.573153:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637099150530560 : -106974559021056 : ffff9eb50b68d800)
00000100:00000001:12.0:1773851901.573154:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.573155:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851901.573155:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00000020:00000010:12.0:1773851901.573156:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.573156:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851901.573157:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851901.573157:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851901.573158:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851901.573158:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851901.573159:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851901.573159:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.573160:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851901.573161:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851901.573161:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851901.573161:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851901.573162:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851901.573162:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19091@kfi7, seq: 2289946
00000100:00000001:14.0:1773851901.573165:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851901.573165:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.573165:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000003288035 : new rpc_count 1
00000100:00000001:12.0:1773851901.573165:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945737728 : -106919763813888 : ffff9ec1cd755a00)
00000100:00000040:12.0:1773851901.573166:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e2231f64 x1859598024989376/t0(0) o400->f0a87ff1-2cb8-41f1-b1a9-2291c64402d6@19091@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1686-0'
00000100:00000001:12.0:1773851901.573169:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.573169:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851901.573170:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e2231f64 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f0a87ff1-2cb8-41f1-b1a9-2291c64402d6+5:39729:x1859598024989376:12345-19091@kfi7:400:default-tuolumne1686-0
00000100:00000200:12.0:1773851901.573171:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598024989376
00000020:00000001:12.0:1773851901.573171:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851901.573172:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851901.573172:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.573173:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851901.573173:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851901.573174:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851901.573174:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598024989376, found 0 last_xid 1859598024989375
00000020:00000001:12.0:1773851901.573175:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851901.573175:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851901.573175:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851901.573176:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.573176:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851901.573177:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851901.573177:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851901.573178:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000087e8c548.
02000000:00000001:12.0:1773851901.573178:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.573178:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.573179:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851901.573179:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096688634, transno 0, xid 1859598024989376
00010000:00000001:12.0:1773851901.573180:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851901.573181:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e2231f64 x1859598024989376/t0(0) o400->f0a87ff1-2cb8-41f1-b1a9-2291c64402d6@19091@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1686-0'
00010000:00000001:12.0:1773851901.573183:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851901.573183:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851901.573184:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=134 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851901.573185:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851901.573186:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b4aa1c4 refcount 3 to 19091@kfi7
00000100:00000001:12.0:1773851901.573186:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603212768 : -107155106338848 : ffff9e8b01f367e0)
02000000:00000001:12.0:1773851901.573187:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851901.573187:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.573187:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851901.573188:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19027@kfi7
00000400:00000010:12.0:1773851901.573189:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e652fce.
00000100:00000200:12.0:1773851901.573189:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598024989376, offset 224
00000400:00000200:12.0:1773851901.573190:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19027@kfi7
00000400:00000200:12.0:1773851901.573191:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.573192:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 1
00000400:00000200:12.0:1773851901.573193:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000400:00000200:12.0:1773851901.573194:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 3
00000400:00000200:12.0:1773851901.573194:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19027@kfi7 local destination
00000400:00000200:12.0:1773851901.573196:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770384:8770384:1024:4294967295] 19027@kfi7 LPNI seq info [2017412:2017412:16:4294967295]
00000400:00000200:12.0:1773851901.573197:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000400:00000200:12.0:1773851901.573197:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19027@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.573199:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19027@kfi7(19027@kfi7:19027@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851901.573200:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 3
00000800:00000200:12.0:1773851901.573201:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851901.573202:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851901.573204:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851901.573206:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc51 Using peer 19027@kfi7(0xc51)
00000800:00000200:12.0:1773851901.573209:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0xc51: rc=0
00000800:00000200:12.0:1773851901.573210:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc51 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851901.573213:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.573214:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b4aa1c4 refcount 2 to 19091@kfi7
00010000:00000001:12.0:1773851901.573214:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851901.573215:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.573215:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851901.573216:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e2231f64 x1859598024989376/t0(0) o400->f0a87ff1-2cb8-41f1-b1a9-2291c64402d6@19091@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1686-0'
00000100:00100000:12.0:1773851901.573220:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e2231f64 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:f0a87ff1-2cb8-41f1-b1a9-2291c64402d6+5:39729:x1859598024989376:12345-19091@kfi7:400:default-tuolumne1686-0 Request processed in 50us (79us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851901.573222:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19091@kfi7, seq: 2289946
00000100:00000040:12.0:1773851901.573223:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000003288035 : new rpc_count 0
00000100:00000001:12.0:1773851901.573223:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851901.573223:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851901.573224:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.573224:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851901.573225:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851901.573226:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000003288035 : new refcount 4
00000100:00000001:12.0:1773851901.573226:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851901.573231:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc51 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851901.573232:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.573233:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19027@kfi7: PUT: OK
00000400:00000200:13.0:1773851901.573234:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e652fce
00000400:00000010:13.0:1773851901.573234:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e652fce.
00000100:00000001:13.0:1773851901.573235:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851901.573235:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851901.573236:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000038d41792 nid 19027@kfi7 refs 2
00000800:00000200:13.0:1773851901.573238:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2069@kfi7:3 -> 19027@kfi7(000000003d677143):0x0 lsk 3154 rsk 12 tsk 0 trmk 0 tmk 0 trr 3 tta 0xc51 Transaction freed
00000800:00000200:21.0:1773851901.599643:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851901.599644:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851901.599645:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851901.599647:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851901.599652:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.599653:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9011@kfi7 : PUT - for me
00000400:00000200:21.0:1773851901.599654:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.599655:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 1
00000400:00000200:21.0:1773851901.599656:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.599657:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000400:00000200:21.0:1773851901.599658:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 3
00000400:00000200:21.0:1773851901.599658:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9202@kfi7 to cpt 4
00000400:00000200:21.0:1773851901.599659:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9202@kfi7 of length 224 into portal 12 MB=0x69b4be4ec5ec0
00000400:00000200:21.0:1773851901.599660:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9202@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 68464
00000800:00000200:21.0:1773851901.599662:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851901.599663:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851901.599664:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9011@kfi7: PUT: OK
00000100:00000001:21.0:1773851901.599665:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851901.599665:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851901.599666:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008f604576.
00000100:00000040:21.0:1773851901.599667:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008f604576 x1859600125812416 msgsize 224
00000100:00100000:21.0:1773851901.599668:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9202@kfi7 (source: 12345-9011@kfi7)
00000100:00000001:21.0:1773851901.599669:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851901.599670:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000100:00000001:23.0:1773851901.599671:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851901.599671:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851901.599672:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851901.599672:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851901.599672:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851901.599673:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851901.599674:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600125812416
00000020:00000001:23.0:1773851901.599675:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851901.599675:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e71d49
00000020:00000001:23.0:1773851901.599676:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851901.599679:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000964232c4 refcount=5
00000020:00000001:23.0:1773851901.599679:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814436864 : -106911895114752 : ffff9ec3a2782c00)
00000020:00000001:23.0:1773851901.599680:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814436864 : -106911895114752 : ffff9ec3a2782c00)
00000100:00000001:23.0:1773851901.599681:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851901.599682:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851901.599683:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005f866e7c.
00000020:00000010:23.0:1773851901.599684:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851901.599685:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851901.599686:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851901.599687:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851901.599687:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851901.599688:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851901.599689:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851901.599689:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851901.599690:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851901.599691:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851901.599692:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851901.599692:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:23.0:1773851901.599693:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9202@kfi7, seq: 1998085
00000100:00000040:23.0:1773851901.599693:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000964232c4 : new rpc_count 1
00000100:00000001:20.0:1773851901.599693:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851901.599694:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313402752 : -106917396148864 : ffff9ec25a950d80)
00000100:00000001:20.0:1773851901.599694:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851901.599695:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008f604576 x1859600125812416/t0(0) o400->095df23b-cfee-4b15-a8d0-940ff444150e@9202@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1049-0'
00000100:00000001:20.0:1773851901.599695:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851901.599698:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851901.599698:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851901.599699:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008f604576 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:095df23b-cfee-4b15-a8d0-940ff444150e+5:39466:x1859600125812416:12345-9202@kfi7:400:default-tuolumne1049-0
00000100:00000200:23.0:1773851901.599701:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600125812416
00000020:00000001:23.0:1773851901.599701:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851901.599702:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851901.599703:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.599703:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851901.599704:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851901.599705:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851901.599705:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600125812416, found 0 last_xid 1859600125812415
00000020:00000001:23.0:1773851901.599706:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851901.599707:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851901.599707:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851901.599708:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.599708:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851901.599709:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851901.599709:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851901.599710:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000af79742e.
02000000:00000001:23.0:1773851901.599711:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851901.599720:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.599721:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851901.599722:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260765186, transno 0, xid 1859600125812416
00010000:00000001:23.0:1773851901.599723:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851901.599723:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008f604576 x1859600125812416/t0(0) o400->095df23b-cfee-4b15-a8d0-940ff444150e@9202@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1049-0'
00010000:00000001:23.0:1773851901.599728:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851901.599729:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851901.599730:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=134 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851901.599731:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851901.599731:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000030f111c5 refcount 3 to 9202@kfi7
00000100:00000001:23.0:1773851901.599732:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332032 : -107155408219584 : ffff9e8aeff51240)
02000000:00000001:23.0:1773851901.599733:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851901.599733:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851901.599734:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851901.599734:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9011@kfi7
00000400:00000010:23.0:1773851901.599735:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d909465f.
00000100:00000200:23.0:1773851901.599736:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600125812416, offset 224
00000400:00000200:23.0:1773851901.599737:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9011@kfi7
00000400:00000200:23.0:1773851901.599738:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:23.0:1773851901.599739:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 1
00000400:00000200:23.0:1773851901.599740:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000400:00000200:23.0:1773851901.599742:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 3
00000400:00000200:23.0:1773851901.599743:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9011@kfi7 local destination
00000400:00000200:23.0:1773851901.599744:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770385:8770385:1024:4294967295] 9011@kfi7 LPNI seq info [14728030:14728030:16:4294967295]
00000400:00000200:23.0:1773851901.599746:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000400:00000200:23.0:1773851901.599746:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9011@kfi7 to cpt 5
00000400:00000200:23.0:1773851901.599749:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9011@kfi7(9011@kfi7:9011@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851901.599750:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 3
00000800:00000200:23.0:1773851901.599751:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851901.599752:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851901.599757:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851901.599759:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xfbd Using peer 9011@kfi7(0xfbd)
00000800:00000200:23.0:1773851901.599763:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0xfbd: rc=0
00000800:00000200:23.0:1773851901.599764:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xfbd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851901.599766:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851901.599767:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000030f111c5 refcount 2 to 9202@kfi7
00010000:00000001:23.0:1773851901.599768:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851901.599768:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851901.599769:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851901.599769:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008f604576 x1859600125812416/t0(0) o400->095df23b-cfee-4b15-a8d0-940ff444150e@9202@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1049-0'
00000100:00100000:23.0:1773851901.599773:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008f604576 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:095df23b-cfee-4b15-a8d0-940ff444150e+5:39466:x1859600125812416:12345-9202@kfi7:400:default-tuolumne1049-0 Request processed in 73us (105us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851901.599775:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9202@kfi7, seq: 1998085
00000100:00000040:23.0:1773851901.599775:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000964232c4 : new rpc_count 0
00000100:00000001:23.0:1773851901.599776:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:23.0:1773851901.599777:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851901.599777:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851901.599778:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000800:00000200:21.0:1773851901.599778:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xfbd TN_EVENT_TX_OK event status 0
00000020:00000010:23.0:1773851901.599779:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005f866e7c.
00000400:00000200:21.0:1773851901.599779:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:23.0:1773851901.599780:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000964232c4 : new refcount 4
00000100:00000001:23.0:1773851901.599780:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851901.599780:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9011@kfi7: PUT: OK
00000400:00000200:21.0:1773851901.599781:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d909465f
00000400:00000010:21.0:1773851901.599781:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d909465f.
00000100:00000001:21.0:1773851901.599782:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851901.599782:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851901.599783:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d4c29a71 nid 9011@kfi7 refs 2
00000800:00000200:21.0:1773851901.599785:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2069@kfi7:5 -> 9011@kfi7(00000000baa4f361):0x0 lsk 4030 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0xfbd Transaction freed
00000800:00000200:9.0:1773851901.627836:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851901.627837:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851901.627838:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851901.627840:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851901.627842:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.627843:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26619@kfi7 : PUT - for me
00000400:00000200:9.0:1773851901.627843:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.627844:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 1
00000400:00000200:9.0:1773851901.627845:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.627846:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000400:00000200:9.0:1773851901.627847:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 3
00000400:00000200:9.0:1773851901.627848:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:9.0:1773851901.627848:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26618@kfi7 of length 224 into portal 12 MB=0x699de5b7cd180
00000400:00000200:9.0:1773851901.627849:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26618@kfi7 of length 224/224 into md 0x78146ce49 [64] + 166416
00000800:00000200:9.0:1773851901.627851:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851901.627852:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.627853:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26619@kfi7: PUT: OK
00000100:00000001:9.0:1773851901.627854:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851901.627854:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851901.627865:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a17179f.
00000100:00000040:9.0:1773851901.627866:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004a17179f x1858030156960128 msgsize 224
00000100:00100000:9.0:1773851901.627867:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-26618@kfi7 (source: 12345-26619@kfi7)
00000100:00000001:9.0:1773851901.627868:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851901.627869:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000100:00000001:8.0:1773851901.627869:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851901.627870:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851901.627870:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851901.627870:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851901.627871:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851901.627872:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851901.627872:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030156960128
00000020:00000001:8.0:1773851901.627873:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851901.627873:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910ee
00000020:00000001:8.0:1773851901.627874:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851901.627876:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c84116a7 refcount=6
00000020:00000001:8.0:1773851901.627877:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240353792 : -107152469197824 : ffff9e8b9f22fc00)
00000020:00000001:8.0:1773851901.627878:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240353792 : -107152469197824 : ffff9e8b9f22fc00)
00000100:00000001:8.0:1773851901.627879:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.627879:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851901.627880:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851901.627881:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.627882:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851901.627882:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851901.627883:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851901.627883:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851901.627884:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851901.627885:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851901.627885:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.627886:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851901.627887:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851901.627887:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851901.627888:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851901.627888:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851901.627889:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851901.627889:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26618@kfi7, seq: 2130888
00000100:00000040:8.0:1773851901.627889:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c84116a7 : new rpc_count 1
00000100:00000001:9.0:1773851901.627890:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.627890:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498311040 : -106953211240576 : ffff9eba03d61f80)
00000100:00000040:8.0:1773851901.627891:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a17179f x1858030156960128/t0(0) o400->41f6ac82-eec0-4588-84f8-b4f44a59b133@26618@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne272-0'
00000100:00000001:8.0:1773851901.627894:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.627894:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851901.627895:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a17179f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:41f6ac82-eec0-4588-84f8-b4f44a59b133+6:47798:x1858030156960128:12345-26618@kfi7:400:default-tuolumne272-0
00000100:00000200:8.0:1773851901.627896:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030156960128
00000020:00000001:8.0:1773851901.627896:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851901.627897:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851901.627898:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.627898:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851901.627899:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851901.627899:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851901.627900:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030156960128, found 0 last_xid 1858030156960127
00000020:00000001:8.0:1773851901.627900:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851901.627901:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851901.627901:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851901.627902:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.627903:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851901.627903:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851901.627904:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851901.627906:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000094b0c861.
02000000:00000001:8.0:1773851901.627907:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.627907:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.627908:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851901.627908:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030156960128
00010000:00000001:8.0:1773851901.627909:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851901.627910:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a17179f x1858030156960128/t0(0) o400->41f6ac82-eec0-4588-84f8-b4f44a59b133@26618@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00010000:00000001:8.0:1773851901.627912:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851901.627912:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851901.627913:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=134 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851901.627914:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851901.627914:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000743cfeb9 refcount 5 to 26618@kfi7
00000100:00000001:8.0:1773851901.627915:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064032 : -107155994487584 : ffff9e8acd0354e0)
02000000:00000001:8.0:1773851901.627916:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851901.627916:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.627917:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851901.627918:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26619@kfi7
00000400:00000010:8.0:1773851901.627918:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a36d61ab.
00000100:00000200:8.0:1773851901.627919:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030156960128, offset 224
00000400:00000200:8.0:1773851901.627920:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26619@kfi7
00000400:00000200:8.0:1773851901.627921:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.627921:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 1
00000400:00000200:8.0:1773851901.627922:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000400:00000200:8.0:1773851901.627923:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 3
00000400:00000200:8.0:1773851901.627924:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26619@kfi7 local destination
00000400:00000200:8.0:1773851901.627925:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770386:8770386:1024:4294967295] 26619@kfi7 LPNI seq info [24451:24451:16:4294967295]
00000400:00000200:8.0:1773851901.627927:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000400:00000200:8.0:1773851901.627927:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26619@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.627929:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26619@kfi7(26619@kfi7:26619@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851901.627930:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 3
00000800:00000200:8.0:1773851901.627931:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851901.627932:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851901.627934:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851901.627936:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 Using peer 26619@kfi7(0x230)
00000800:00000200:8.0:1773851901.627939:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 324 bytes to peer 0x230: rc=0
00000800:00000200:8.0:1773851901.627940:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851901.627942:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.627943:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000743cfeb9 refcount 4 to 26618@kfi7
00010000:00000001:8.0:1773851901.627943:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851901.627944:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.627947:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851901.627947:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a17179f x1858030156960128/t0(0) o400->41f6ac82-eec0-4588-84f8-b4f44a59b133@26618@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00000100:00100000:8.0:1773851901.627952:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a17179f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:41f6ac82-eec0-4588-84f8-b4f44a59b133+6:47798:x1858030156960128:12345-26618@kfi7:400:default-tuolumne272-0 Request processed in 57us (85us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851901.627954:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26618@kfi7, seq: 2130888
00000100:00000040:8.0:1773851901.627954:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c84116a7 : new rpc_count 0
00000100:00000001:8.0:1773851901.627955:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851901.627955:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851901.627956:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.627957:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851901.627957:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851901.627958:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000c84116a7 : new refcount 5
00000100:00000001:8.0:1773851901.627959:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851901.627963:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851901.627965:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.627965:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26619@kfi7: PUT: OK
00000400:00000200:9.0:1773851901.627966:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a36d61ab
00000400:00000010:9.0:1773851901.627967:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a36d61ab.
00000100:00000001:9.0:1773851901.627967:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851901.627968:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851901.627969:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dd731600 nid 26619@kfi7 refs 2
00000800:00000200:9.0:1773851901.627970:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 26619@kfi7(00000000a2cd3f24):0x0 lsk 561 rsk 82 tsk 0 trmk 0 tmk 0 trr 2 tta 0x230 Transaction freed
00000800:00000200:29.0:1773851901.628035:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851901.628036:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851901.628037:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851901.628039:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851901.628041:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.628042:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26618@kfi7 : PUT - for me
00000400:00000200:29.0:1773851901.628043:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.628044:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 1
00000400:00000200:29.0:1773851901.628045:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.628046:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000400:00000200:29.0:1773851901.628047:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 3
00000400:00000200:29.0:1773851901.628047:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.628048:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26618@kfi7 of length 224 into portal 12 MB=0x699de5b7cd900
00000400:00000200:29.0:1773851901.628049:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26618@kfi7 of length 224/224 into md 0x77fe1859d [64] + 11520
00000800:00000200:29.0:1773851901.628051:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851901.628052:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851901.628053:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26618@kfi7: PUT: OK
00000100:00000001:29.0:1773851901.628054:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851901.628055:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851901.628056:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d411da6f.
00000100:00000040:29.0:1773851901.628056:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000d411da6f x1858030156962048 msgsize 224
00000100:00100000:29.0:1773851901.628057:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26618@kfi7 (source: 12345-26618@kfi7)
00000100:00000001:29.0:1773851901.628058:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851901.628060:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000100:00000001:31.0:1773851901.628061:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851901.628061:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851901.628062:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851901.628063:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851901.628064:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851901.628065:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851901.628066:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030156962048
00000020:00000001:31.0:1773851901.628067:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851901.628068:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91292
00000020:00000001:31.0:1773851901.628069:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851901.628074:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006910799b refcount=6
00000020:00000001:31.0:1773851901.628075:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716200448 : -107155993351168 : ffff9e8acd14ac00)
00000020:00000001:31.0:1773851901.628077:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716200448 : -107155993351168 : ffff9e8acd14ac00)
00000100:00000001:31.0:1773851901.628079:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851901.628081:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851901.628082:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3c67bb1.
00000020:00000010:31.0:1773851901.628084:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851901.628085:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851901.628087:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851901.628088:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851901.628089:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851901.628090:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851901.628091:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851901.628092:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.628093:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851901.628096:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851901.628096:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851901.628097:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851901.628097:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851901.628098:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26618@kfi7, seq: 2055605
00000100:00000040:31.0:1773851901.628099:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006910799b : new rpc_count 1
00000100:00000001:31.0:1773851901.628100:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637051649336320 : -107022060215296 : ffff9ea9fc1e2400)
00000100:00000001:30.0:1773851901.628100:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851901.628101:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851901.628103:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d411da6f x1858030156962048/t0(0) o400->2e369438-c3c2-47e1-bcd5-12dc00068d91@26618@kfi7:689/0 lens 224/0 e 0 to 0 dl 1773852049 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne272-0'
00000100:00000001:31.0:1773851901.628108:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851901.628108:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851901.628110:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d411da6f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:2e369438-c3c2-47e1-bcd5-12dc00068d91+6:47795:x1858030156962048:12345-26618@kfi7:400:default-tuolumne272-0
00000100:00000200:31.0:1773851901.628112:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030156962048
00000020:00000001:31.0:1773851901.628113:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851901.628114:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851901.628115:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.628116:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851901.628117:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851901.628119:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851901.628120:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030156962048, found 0 last_xid 1858030156962047
00000020:00000001:31.0:1773851901.628121:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851901.628122:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851901.628123:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851901.628124:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.628126:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851901.628126:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851901.628127:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851901.628129:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ff8b12cc.
02000000:00000001:31.0:1773851901.628130:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.628131:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.628132:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851901.628133:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030156962048
00010000:00000001:31.0:1773851901.628134:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851901.628135:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d411da6f x1858030156962048/t0(0) o400->2e369438-c3c2-47e1-bcd5-12dc00068d91@26618@kfi7:689/0 lens 224/224 e 0 to 0 dl 1773852049 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00010000:00000001:31.0:1773851901.628140:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851901.628141:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851901.628142:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=134 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851901.628144:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851901.628145:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000743cfeb9 refcount 5 to 26618@kfi7
00000100:00000001:31.0:1773851901.628146:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064032 : -107155994487584 : ffff9e8acd0354e0)
02000000:00000001:31.0:1773851901.628148:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851901.628148:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.628149:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851901.628151:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26618@kfi7
00000400:00000010:31.0:1773851901.628152:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000535cda91.
00000100:00000200:31.0:1773851901.628153:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030156962048, offset 224
00000400:00000200:31.0:1773851901.628156:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26618@kfi7
00000400:00000200:31.0:1773851901.628157:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:31.0:1773851901.628159:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 1
00000400:00000200:31.0:1773851901.628160:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000400:00000200:31.0:1773851901.628162:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 3
00000400:00000200:31.0:1773851901.628164:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26618@kfi7 local destination
00000400:00000200:31.0:1773851901.628166:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770387:8770387:1024:4294967295] 26618@kfi7 LPNI seq info [24452:24452:16:4294967295]
00000400:00000200:31.0:1773851901.628169:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000400:00000200:31.0:1773851901.628170:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26618@kfi7 to cpt 7
00000400:00000200:31.0:1773851901.628174:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26618@kfi7(26618@kfi7:26618@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851901.628176:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 3
00000800:00000200:31.0:1773851901.628179:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851901.628180:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851901.628184:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851901.628188:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 Using peer 26618@kfi7(0x100000000000230)
00000800:00000200:31.0:1773851901.628193:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0x100000000000230: rc=0
00000800:00000200:31.0:1773851901.628195:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851901.628199:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851901.628200:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000743cfeb9 refcount 4 to 26618@kfi7
00010000:00000001:31.0:1773851901.628201:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851901.628202:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.628203:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851901.628204:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d411da6f x1858030156962048/t0(0) o400->2e369438-c3c2-47e1-bcd5-12dc00068d91@26618@kfi7:689/0 lens 224/224 e 0 to 0 dl 1773852049 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne272-0'
00000800:00000200:29.0:1773851901.628208:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851901.628209:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851901.628210:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d411da6f pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:2e369438-c3c2-47e1-bcd5-12dc00068d91+6:47795:x1858030156962048:12345-26618@kfi7:400:default-tuolumne272-0 Request processed in 101us (152us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851901.628210:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26618@kfi7: PUT: OK
00000400:00000200:29.0:1773851901.628211:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000535cda91
00000400:00000010:29.0:1773851901.628211:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000535cda91.
00000100:00000001:29.0:1773851901.628212:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851901.628212:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851901.628213:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e92ce423 nid 26618@kfi7 refs 2
00000100:00100000:31.0:1773851901.628214:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26618@kfi7, seq: 2055605
00000100:00000040:31.0:1773851901.628215:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006910799b : new rpc_count 0
00000800:00000200:29.0:1773851901.628215:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 26618@kfi7(00000000bba54e7c):0x0 lsk 561 rsk 90 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000230 Transaction freed
00000100:00000001:31.0:1773851901.628216:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851901.628217:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851901.628218:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851901.628219:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851901.628220:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3c67bb1.
00000020:00000040:31.0:1773851901.628222:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000006910799b : new refcount 5
00000100:00000001:31.0:1773851901.628223:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851901.662766:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851901.662766:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851901.662768:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851901.662770:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851901.662772:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.662773:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19762@kfi7 : PUT - for me
00000400:00000200:5.0:1773851901.662774:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.662776:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 1
00000400:00000200:5.0:1773851901.662777:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.662777:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000400:00000200:5.0:1773851901.662778:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 3
00000400:00000200:5.0:1773851901.662779:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19955@kfi7 to cpt 7
00000400:00000200:5.0:1773851901.662780:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19955@kfi7 of length 224 into portal 12 MB=0x69b4c5676e300
00000400:00000200:5.0:1773851901.662782:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19955@kfi7 of length 224/224 into md 0x793926dc5 [64] + 167112
00000800:00000200:5.0:1773851901.662783:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851901.662785:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.662786:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19762@kfi7: PUT: OK
00000100:00000001:5.0:1773851901.662787:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851901.662787:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851901.662789:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000599fe334.
00000100:00000040:5.0:1773851901.662789:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000599fe334 x1859602030715648 msgsize 224
00000100:00100000:5.0:1773851901.662791:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19955@kfi7 (source: 12345-19762@kfi7)
00000100:00000001:5.0:1773851901.662792:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851901.662793:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000100:00000001:4.0:1773851901.662793:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851901.662794:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851901.662794:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851901.662794:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851901.662795:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851901.662796:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851901.662796:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602030715648
00000020:00000001:4.0:1773851901.662797:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851901.662798:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78e59
00000020:00000001:4.0:1773851901.662798:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851901.662800:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000039a8b877 refcount=5
00000020:00000001:4.0:1773851901.662801:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126829084672 : -106946880466944 : ffff9ebb7d2e1000)
00000020:00000001:4.0:1773851901.662802:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126829084672 : -106946880466944 : ffff9ebb7d2e1000)
00000100:00000001:4.0:1773851901.662803:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851901.662804:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851901.662805:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000815a9a8.
00000020:00000010:4.0:1773851901.662806:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851901.662807:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007ea80e0f.
00000100:00000001:4.0:1773851901.662808:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851901.662808:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851901.662809:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851901.662810:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851901.662810:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851901.662811:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851901.662812:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851901.662813:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851901.662813:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851901.662814:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851901.662814:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851901.662815:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19955@kfi7, seq: 2002001
00000100:00000040:7.0:1773851901.662816:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000039a8b877 : new rpc_count 1
00000100:00000001:4.0:1773851901.662816:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851901.662817:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569661568 : -106988139890048 : ffff9eb1e1ed3a80)
00000100:00000001:4.0:1773851901.662817:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851901.662818:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000599fe334 x1859602030715648/t0(0) o400->d7cb7640-1a0d-41eb-90cb-d58ce9a92857@19955@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1721-0'
00000100:00000001:7.0:1773851901.662821:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851901.662821:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851901.662823:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000599fe334 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:d7cb7640-1a0d-41eb-90cb-d58ce9a92857+5:39665:x1859602030715648:12345-19955@kfi7:400:default-tuolumne1721-0
00000100:00000200:7.0:1773851901.662824:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602030715648
00000020:00000001:7.0:1773851901.662826:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851901.662827:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851901.662827:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851901.662828:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851901.662829:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851901.662830:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851901.662830:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602030715648, found 0 last_xid 1859602030715647
00000020:00000001:7.0:1773851901.662831:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851901.662832:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851901.662833:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851901.662833:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851901.662834:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851901.662835:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851901.662835:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851901.662836:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000050d3f139.
02000000:00000001:7.0:1773851901.662837:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851901.662838:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851901.662839:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851901.662839:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183106926206, transno 0, xid 1859602030715648
00010000:00000001:7.0:1773851901.662840:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851901.662841:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000599fe334 x1859602030715648/t0(0) o400->d7cb7640-1a0d-41eb-90cb-d58ce9a92857@19955@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1721-0'
00010000:00000001:7.0:1773851901.662844:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851901.662845:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851901.662845:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=133 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851901.662846:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851901.662847:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008a67f331 refcount 3 to 19955@kfi7
00000100:00000001:7.0:1773851901.662848:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805120 : -107130477746496 : ffff9e90bdede6c0)
02000000:00000001:7.0:1773851901.662849:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851901.662850:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851901.662851:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851901.662852:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19762@kfi7
00000400:00000010:7.0:1773851901.662852:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006c6e9e2d.
00000100:00000200:7.0:1773851901.662853:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602030715648, offset 224
00000400:00000200:7.0:1773851901.662855:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19762@kfi7
00000400:00000200:7.0:1773851901.662856:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:7.0:1773851901.662857:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 1
00000400:00000200:7.0:1773851901.662859:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000400:00000200:7.0:1773851901.662860:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 3
00000400:00000200:7.0:1773851901.662861:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19762@kfi7 local destination
00000400:00000200:7.0:1773851901.662863:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770388:8770388:1024:4294967295] 19762@kfi7 LPNI seq info [5373238:5373238:16:4294967295]
00000400:00000200:7.0:1773851901.662864:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000400:00000200:7.0:1773851901.662865:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19762@kfi7 to cpt 1
00000400:00000200:7.0:1773851901.662867:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19762@kfi7(19762@kfi7:19762@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851901.662868:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 3
00000800:00000200:7.0:1773851901.662870:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851901.662871:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851901.662873:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851901.662876:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4dd Using peer 19762@kfi7(0x4dd)
00000800:00000200:7.0:1773851901.662879:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x4dd: rc=0
00000800:00000200:7.0:1773851901.662881:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4dd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851901.662883:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851901.662884:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008a67f331 refcount 2 to 19955@kfi7
00010000:00000001:7.0:1773851901.662884:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851901.662885:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851901.662886:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851901.662886:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000599fe334 x1859602030715648/t0(0) o400->d7cb7640-1a0d-41eb-90cb-d58ce9a92857@19955@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1721-0'
00000100:00100000:7.0:1773851901.662889:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000599fe334 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:d7cb7640-1a0d-41eb-90cb-d58ce9a92857+5:39665:x1859602030715648:12345-19955@kfi7:400:default-tuolumne1721-0 Request processed in 68us (99us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851901.662892:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19955@kfi7, seq: 2002001
00000800:00000200:5.0:1773851901.662892:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4dd TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851901.662894:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000039a8b877 : new rpc_count 0
00000400:00000200:5.0:1773851901.662894:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851901.662895:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851901.662895:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851901.662895:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19762@kfi7: PUT: OK
00000020:00000010:7.0:1773851901.662896:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000400:00000200:5.0:1773851901.662896:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006c6e9e2d
00000400:00000010:5.0:1773851901.662896:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006c6e9e2d.
00000020:00000010:7.0:1773851901.662897:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007ea80e0f.
00000100:00000001:5.0:1773851901.662897:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851901.662898:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000815a9a8.
00000100:00000001:5.0:1773851901.662898:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:7.0:1773851901.662899:0:61015:0:(genops.c:882:class_export_put()) PUTting export 0000000039a8b877 : new refcount 4
00000400:00000200:5.0:1773851901.662899:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000daa3c72e nid 19762@kfi7 refs 2
00000100:00000001:7.0:1773851901.662900:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851901.662900:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 19762@kfi7(000000001ffdb9e6):0x0 lsk 1246 rsk 42 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4dd Transaction freed
00000800:00000200:26.0:1773851901.666933:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851901.666933:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.666934:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851901.666934:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851901.666935:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851901.666935:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851901.666937:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851901.666937:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8946@kfi7(000000003fbf98bc):0xf82 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851901.666938:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Using peer 8946@kfi7(0xf82)
00000400:00000200:26.0:1773851901.666939:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.666940:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.666941:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8946@kfi7 : PUT - for me
00000400:00000200:26.0:1773851901.666942:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.666942:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000800:00000200:25.0:1773851901.666942:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 38 bytes to peer 0xf82: rc=0
00000800:00000200:25.0:1773851901.666943:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851901.666944:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.666944:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.666945:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:26.0:1773851901.666946:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:26.0:1773851901.666947:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 576 into portal 12 MB=0x69b0936b1b140
00000400:00000200:26.0:1773851901.666949:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8754@kfi7 of length 576/576 into md 0x16159c9699 [64] + 42016
00000800:00000200:26.0:1773851901.666951:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851901.666953:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851901.666954:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00000100:00000001:26.0:1773851901.666955:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:25.0:1773851901.666955:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_EVENT_TX_OK event status 0
00000100:00000200:26.0:1773851901.666956:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851901.666957:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000001d5d0e3.
00000800:00000200:25.0:1773851901.666957:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Transaction freed
00000100:00000040:26.0:1773851901.666958:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000001d5d0e3 x1859313734889792 msgsize 576
00000100:00100000:26.0:1773851901.666959:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8946@kfi7)
00000100:00000001:26.0:1773851901.666961:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851901.666961:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000800:00000200:26.0:1773851901.666963:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fe1d82e3: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851901.666966:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851901.666967:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851901.666967:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851901.666968:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.666969:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851901.666969:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734889792
00000020:00000001:26.0:1773851901.666970:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851901.666971:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:26.0:1773851901.666971:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.666974:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=9
00000020:00000001:26.0:1773851901.666975:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000001:26.0:1773851901.666976:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000100:00000001:26.0:1773851901.666977:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.666978:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851901.666978:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f5cb6f5.
00000020:00000010:26.0:1773851901.666979:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851901.666980:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851901.666981:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851901.666982:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:26.0:1773851901.666982:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:26.0:1773851901.666983:0:41182:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.666983:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.666984:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.666985:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.666987:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851901.666987:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851901.666988:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 1451911043
00000100:00000001:24.0:1773851901.666988:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851901.666988:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851901.666990:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 1
00000100:00000001:26.0:1773851901.666990:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137189198336 : -106936520353280 : ffff9ebde6b0da00)
00000100:00000001:24.0:1773851901.666990:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.666991:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000001d5d0e3 x1859313734889792/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 576/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1033-0'
00000100:00000001:24.0:1773851901.666991:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.666994:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.666994:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851901.666995:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001d5d0e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:2028291:x1859313734889792:12345-8754@kfi7:101:default-tuolumne1033-0
00000100:00000200:26.0:1773851901.666996:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734889792
00000020:00000001:26.0:1773851901.666997:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851901.666998:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851901.666998:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.666999:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851901.666999:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:26.0:1773851901.667001:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851901.667001:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313734889792, found 0 last_xid 1859313734889791
00000020:00000001:26.0:1773851901.667002:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851901.667003:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851901.667003:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851901.667004:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.667005:0:41182:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:26.0:1773851901.667005:0:41182:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:26.0:1773851901.667006:0:41182:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:26.0:1773851901.667006:0:41182:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:26.0:1773851901.667007:0:41182:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.667010:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851901.667011:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:26.0:1773851901.667011:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.667012:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.667013:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000056845fce.
00000020:00000001:26.0:1773851901.667014:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.667014:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000056845fce with handle 0x21b6f08f07a6aec7 to hash
00000020:00000001:26.0:1773851901.667015:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.667016:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637028277643968 : -107045431907648 : ffff9ea48b0e6ac0)
00010000:00000010:26.0:1773851901.667017:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000002e11f02b.
00010000:00000001:26.0:1773851901.667018:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637028277643968 : -107045431907648 : ffff9ea48b0e6ac0)
00010000:00010000:26.0:1773851901.667018:0:41182:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000056845fce/0x21b6f08f07a6aec7 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0f5706c4644c2c6 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667021:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:26.0:1773851901.667022:0:41182:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000002338620b : new locks_count 4
00000020:00000040:26.0:1773851901.667023:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002338620b refcount=10
00010000:00000001:26.0:1773851901.667025:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:26.0:1773851901.667026:0:41182:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:26.0:1773851901.667027:0:41182:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:26.0:1773851901.667028:0:41182:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:26.0:1773851901.667028:0:41182:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:26.0:1773851901.667029:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:26.0:1773851901.667029:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:26.0:1773851901.667030:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:26.0:1773851901.667031:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:26.0:1773851901.667032:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:26.0:1773851901.667033:0:41182:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667034:0:41182:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:26.0:1773851901.667034:0:41182:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:26.0:1773851901.667035:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851901.667035:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851901.667037:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 000000004ac84bb2.
02000000:00000001:26.0:1773851901.667038:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.667038:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667039:0:41182:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667040:0:41182:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:26.0:1773851901.667040:0:41182:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:26.0:1773851901.667041:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.667042:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667042:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.667043:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667043:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.667044:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667045:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.667045:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667046:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.667046:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.667047:0:41182:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:26.0:1773851901.667047:0:41182:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:26.0:1773851901.667048:0:41182:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:26.0:1773851901.667049:0:41182:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667049:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.667050:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667050:0:41182:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:26.0:1773851901.667051:0:41182:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667052:0:41182:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:26.0:1773851901.667052:0:41182:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24001b599:0x10e2:0x0], ldlm_rep = 0000000024d215aa
00000004:00000001:26.0:1773851901.667053:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:26.0:1773851901.667054:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:26.0:1773851901.667054:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:26.0:1773851901.667054:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851901.667055:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.667056:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.667056:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.667057:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000006a6e8496.
00000020:00000001:26.0:1773851901.667057:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.667058:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 000000006a6e8496 with handle 0x21b6f08f07a6aece to hash
00000020:00000001:26.0:1773851901.667059:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.667059:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000010:26.0:1773851901.667060:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000f51e5eb4.
00010000:00000001:26.0:1773851901.667060:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000001:26.0:1773851901.667061:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.667062:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.667062:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000006a6e8496/0x21b6f08f07a6aece lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 197 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667065:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.667068:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:26.0:1773851901.667069:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:26.0:1773851901.667069:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:26.0:1773851901.667070:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.667071:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.667071:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.667072:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.667072:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:26.0:1773851901.667073:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:26.0:1773851901.667073:0:41182:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:26.0:1773851901.667074:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:26.0:1773851901.667074:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 196
00010000:00000040:26.0:1773851901.667075:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:26.0:1773851901.667076:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667079:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667080:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667082:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667084:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667086:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667087:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f430c34/0x21b6f08f07a6ae73 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ec5 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667089:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667090:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667092:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667094:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667096:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667097:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667099:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667100:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667102:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667103:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667105:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667106:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667108:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667109:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667111:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667112:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667114:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667115:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667117:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667118:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667120:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667121:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667123:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667124:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667126:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667127:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667129:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667130:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667132:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667132:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667135:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667136:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667138:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667138:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667141:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667142:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667144:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667145:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667147:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667148:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667150:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667151:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667153:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667154:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667156:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667157:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667159:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667160:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667162:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667162:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667164:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667166:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667168:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667169:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667171:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667171:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667174:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667174:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667176:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667177:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667179:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667180:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667183:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667183:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667185:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667186:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667188:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667190:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667192:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667193:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667195:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667196:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667198:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667199:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667201:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667202:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667204:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667204:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667207:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667208:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667210:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667211:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667213:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667214:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667217:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667217:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667219:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667220:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667222:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667223:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667225:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667226:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 10 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667227:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667228:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667231:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667232:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667234:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667235:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667236:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667238:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667240:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667241:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667243:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667243:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667246:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667247:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667249:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667250:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667252:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667252:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667255:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667255:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667257:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667258:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667261:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667262:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667264:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667265:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667267:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667268:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667270:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667271:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667273:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667274:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667276:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667277:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667279:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667280:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667282:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667283:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667286:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667287:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667289:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667290:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667292:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667293:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667295:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667296:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667298:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667299:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667301:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667302:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667304:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667305:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667307:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667308:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667310:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667311:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667314:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667314:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667316:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667317:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667319:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667320:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667322:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667323:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667325:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667326:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667328:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667328:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667331:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667332:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667334:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667335:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667337:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667338:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667340:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667341:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667343:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667344:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667346:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667347:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667350:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667350:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667353:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667353:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667355:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667356:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667359:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667360:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667362:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667363:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667365:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667366:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667368:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667369:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667372:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667372:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667374:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667375:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667377:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667378:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667380:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667381:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667383:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667385:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667387:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667388:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667390:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667390:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667393:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667393:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667396:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667397:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667399:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667400:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667402:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667403:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667405:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667405:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667407:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667409:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667411:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667412:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667414:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667414:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667416:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667417:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667419:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667420:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667422:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667423:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667425:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667426:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667428:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667428:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667431:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667432:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667434:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667435:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667437:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667438:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667440:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667441:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667444:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667444:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667447:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667448:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667450:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667451:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667453:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667454:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667456:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667459:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667461:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667462:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667464:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667465:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667467:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667468:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667470:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667471:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667473:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667474:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667476:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667477:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667479:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667480:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667482:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667483:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667485:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667486:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667488:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667489:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667491:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667492:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667494:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667495:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667497:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667498:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667500:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667501:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667503:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667504:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667506:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667508:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667510:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667511:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667513:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667513:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667516:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667516:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667519:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667520:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667522:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667523:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667525:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667525:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667528:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667528:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667530:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667532:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667534:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667535:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667537:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667538:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667540:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667540:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667542:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667543:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667545:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667546:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667548:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667548:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667550:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667551:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667553:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667554:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667556:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667557:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667559:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667560:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667562:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667562:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667565:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667565:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667567:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667568:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667570:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667571:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667573:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667574:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667576:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667577:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667580:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667580:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667582:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667583:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667585:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667586:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667589:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667590:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667592:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667592:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667594:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667595:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667598:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667599:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667601:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667602:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667604:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667605:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667607:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667608:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667610:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667611:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667613:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667614:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667616:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667616:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667618:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667619:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667621:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667622:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667624:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667625:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667628:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667628:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667630:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667631:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667633:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667634:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667636:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667637:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667639:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667640:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667641:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667643:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667644:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667645:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667647:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667648:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667650:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667651:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667653:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667654:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667656:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667657:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667659:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667660:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667662:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00010000:26.0:1773851901.667662:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000006a6e8496/0x21b6f08f07a6aece lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667664:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.667665:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:26.0:1773851901.667666:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851901.667667:0:41182:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.667668:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:26.0:1773851901.667668:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.667669:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.667669:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.667670:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:26.0:1773851901.667671:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.667672:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000006a6e8496/0x21b6f08f07a6aece lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667674:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.667675:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:26.0:1773851901.667676:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.667676:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.667677:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.667677:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.667678:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006a6e8496 refcount=3
00000020:00000001:26.0:1773851901.667678:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000001:26.0:1773851901.667679:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000001:26.0:1773851901.667680:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.667680:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.667680:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667681:0:41182:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667682:0:41182:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:26.0:1773851901.667683:0:41182:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:26.0:1773851901.667684:0:41182:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:26.0:1773851901.667689:0:41182:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667690:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851901.667691:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.667691:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.667692:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667693:0:41182:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667694:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667694:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851901.667695:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.667695:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.667695:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667696:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667697:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:26.0:1773851901.667697:0:41182:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:26.0:1773851901.667698:0:41182:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667699:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.667700:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667700:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.667701:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.667701:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.667702:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=3672 : 3672 : e58)
00000001:00000001:26.0:1773851901.667702:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.667702:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:26.0:1773851901.667703:0:41182:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: nlink=3, mode=40750, valid=0x1100000000002f8f
00000004:00200000:26.0:1773851901.667705:0:41182:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24001b599:0x10e2:0x0]: returning size 37888
00000004:00200000:26.0:1773851901.667705:0:41182:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 6
00000004:00000002:26.0:1773851901.667706:0:41182:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:26.0:1773851901.667707:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.667707:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667708:0:41182:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:26.0:1773851901.667708:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851901.667709:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.667709:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.667709:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667710:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667711:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.667711:0:41182:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.667713:0:41182:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000010:26.0:1773851901.667715:0:41182:0:(lprocfs_status.c:1166:lprocfs_stats_alloc_one()) alloc '(stats->ls_percpu[cpuid])': 960 at 00000000513e7f5d (tot 253203763).
00000020:00000001:26.0:1773851901.667716:0:41182:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667717:0:41182:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667719:0:41182:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.667720:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.667720:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.667720:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006a6e8496 refcount=3
00000020:00000001:26.0:1773851901.667721:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000001:26.0:1773851901.667722:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00000004:00000040:26.0:1773851901.667722:0:41182:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000002338620b : new locks_count 5
00000020:00000040:26.0:1773851901.667723:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002338620b refcount=11
00010000:00000001:26.0:1773851901.667724:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.667728:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.667728:0:41182:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851901.667729:0:41182:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:26.0:1773851901.667730:0:41182:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:26.0:1773851901.667730:0:41182:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:26.0:1773851901.667731:0:41182:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:26.0:1773851901.667731:0:41182:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:26.0:1773851901.667732:0:41182:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:26.0:1773851901.667732:0:41182:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:26.0:1773851901.667733:0:41182:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.667734:0:41182:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851901.667735:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:26.0:1773851901.667735:0:41182:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:26.0:1773851901.667736:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:26.0:1773851901.667737:0:41182:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:26.0:1773851901.667737:0:41182:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:26.0:1773851901.667738:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851901.667738:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.667739:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.667739:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.667740:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851901.667740:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000056845fce with handle 0x21b6f08f07a6aec7 from hash
00010000:00000001:26.0:1773851901.667741:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851901.667741:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.667742:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.667742:0:41182:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:26.0:1773851901.667742:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851901.667743:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000056845fce/0x21b6f08f07a6aec7 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x44000000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2c6 expref: 11 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667745:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.667746:0:41182:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002338620b : new locks_count 4
00000020:00000040:26.0:1773851901.667747:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 10
00010000:00000010:26.0:1773851901.667747:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002e11f02b.
00010000:00000040:26.0:1773851901.667748:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:26.0:1773851901.667749:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.667750:0:41182:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.667750:0:41182:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:26.0:1773851901.667751:0:41182:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000006a6e8496/0x21b6f08f07a6aece lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2c6 expref: 10 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.667754:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:26.0:1773851901.667755:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851901.667755:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851901.667756:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:26.0:1773851901.667757:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:26.0:1773851901.667758:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.667758:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.667759:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:26.0:1773851901.667759:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.667760:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:26.0:1773851901.667760:0:41182:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006a6e8496, rc 0)
00000020:00000001:26.0:1773851901.667761:0:41182:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851901.667762:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183110002015, transno 0, xid 1859313734889792
00010000:00000001:26.0:1773851901.667762:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851901.667763:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000001d5d0e3 x1859313734889792/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 576/640 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00010000:00000001:26.0:1773851901.667766:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851901.667766:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851901.667767:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=134 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851901.667768:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851901.667769:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:26.0:1773851901.667770:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:26.0:1773851901.667771:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851901.667771:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.667772:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851901.667773:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8946@kfi7
00000400:00000010:26.0:1773851901.667773:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ec73ae2a.
00000100:00000200:26.0:1773851901.667774:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859313734889792, offset 224
00000400:00000200:26.0:1773851901.667775:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8946@kfi7
00000400:00000200:26.0:1773851901.667777:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.667778:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000400:00000200:26.0:1773851901.667779:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.667780:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:26.0:1773851901.667781:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8946@kfi7 local destination
00000400:00000200:26.0:1773851901.667782:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770389:8770389:1024:4294967295] 8946@kfi7 LPNI seq info [5400472:5400472:16:4294967295]
00000400:00000200:26.0:1773851901.667784:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.667785:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.667787:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8946@kfi7(8946@kfi7:8946@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851901.667788:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000800:00000200:26.0:1773851901.667789:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.667790:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:26.0:1773851901.667792:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851901.667795:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Using peer 8946@kfi7(0xf82)
00000800:00000200:26.0:1773851901.667798:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 740 bytes to peer 0xf82: rc=0
00000800:00000200:26.0:1773851901.667799:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.667801:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.667802:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:26.0:1773851901.667802:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851901.667803:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.667804:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851901.667805:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000001d5d0e3 x1859313734889792/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 576/640 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00000100:00100000:26.0:1773851901.667807:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001d5d0e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+10:2028291:x1859313734889792:12345-8754@kfi7:101:default-tuolumne1033-0 Request processed in 813us (849us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851901.667810:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 1451911043
00000800:00000200:25.0:1773851901.667811:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_EVENT_TX_OK event status 0
00000100:00000040:26.0:1773851901.667812:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 0
00000100:00000001:26.0:1773851901.667812:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:25.0:1773851901.667812:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:26.0:1773851901.667813:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851901.667814:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851901.667814:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00000400:00000200:25.0:1773851901.667814:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ec73ae2a
00000020:00000010:26.0:1773851901.667815:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000020:00000010:26.0:1773851901.667815:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f5cb6f5.
00000400:00000010:25.0:1773851901.667815:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ec73ae2a.
00000020:00000040:26.0:1773851901.667816:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 9
00000100:00000001:25.0:1773851901.667816:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851901.667817:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851901.667817:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851901.667818:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000800:00000200:25.0:1773851901.667819:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Transaction freed
00000800:00000200:5.0:1773851901.668004:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851901.668005:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851901.668006:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851901.668008:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851901.668010:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.668011:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851901.668012:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.668013:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851901.668013:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.668014:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851901.668015:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851901.668016:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851901.668017:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 328 into portal 24 MB=0x699e69c9ac2c0
00000400:00000200:5.0:1773851901.668018:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 328/328 into md 0x793844545 [256] + 8960
00000800:00000200:5.0:1773851901.668020:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851901.668022:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.668023:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851901.668023:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851901.668024:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851901.668025:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004ed214fe.
00000100:00000040:5.0:1773851901.668026:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000004ed214fe x1858065609179840 msgsize 328
00000100:00100000:5.0:1773851901.668027:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-30@kfi7)
00000100:00000001:5.0:1773851901.668028:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851901.668029:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000001:6.0:1773851901.668030:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851901.668030:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851901.668030:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851901.668031:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851901.668031:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851901.668032:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851901.668033:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065609179840
00000020:00000001:6.0:1773851901.668034:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851901.668034:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:6.0:1773851901.668035:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851901.668036:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:6.0:1773851901.668037:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:6.0:1773851901.668037:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:6.0:1773851901.668038:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851901.668039:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851901.668040:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d27ec1a9.
00000020:00000010:6.0:1773851901.668041:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851901.668042:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851901.668043:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851901.668043:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851901.668044:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851901.668044:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.668045:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851901.668046:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000001:6.0:1773851901.668046:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851901.668047:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851901.668048:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851901.668048:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851901.668048:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851901.668048:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:6.0:1773851901.668049:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 18314090
00000100:00000001:5.0:1773851901.668049:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000800:00000200:13.0:1773851901.668050:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:6.0:1773851901.668050:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:5.0:1773851901.668050:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.668051:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569651200 : -106988139900416 : ffff9eb1e1ed1200)
00000100:00000001:5.0:1773851901.668051:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851901.668052:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000100:00000040:6.0:1773851901.668052:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004ed214fe x1858065609179840/t0(0) o1000->lustre5-MDT0002-mdtlov_UUID@13@kfi7:628/0 lens 328/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000400:00000200:13.0:1773851901.668053:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8754@kfi7 : PUT - for me
00000400:00000200:13.0:1773851901.668054:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000100:00000001:6.0:1773851901.668054:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000400:00000200:13.0:1773851901.668055:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000100:00000001:6.0:1773851901.668055:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:13.0:1773851901.668056:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000100:00100000:6.0:1773851901.668056:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004ed214fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:165971:x1858065609179840:12345-13@kfi7:1000:default-yuba3-0
00000400:00000200:13.0:1773851901.668057:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000100:00000200:6.0:1773851901.668057:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065609179840
00000020:00000001:6.0:1773851901.668057:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000400:00000200:13.0:1773851901.668058:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000020:00000001:6.0:1773851901.668058:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000400:00000200:13.0:1773851901.668059:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000020:00000001:6.0:1773851901.668059:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851901.668059:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000400:00000200:13.0:1773851901.668060:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 328 into portal 17 MB=0x69b0936b1b280
00000020:00000001:6.0:1773851901.668060:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667521856 : -1042029760 : ffffffffc1e3e340)
00000020:00000001:6.0:1773851901.668061:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000400:00000200:13.0:1773851901.668062:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8754@kfi7 of length 328/328 into md 0x82a56312d [2] + 768
00000020:00000001:6.0:1773851901.668062:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851901.668062:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851901.668063:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851901.668063:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851901.668064:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000001:6.0:1773851901.668064:0:1537125:0:(out_handler.c:970:out_handle()) Process entered
00000020:00000010:6.0:1773851901.668065:0:1537125:0:(out_handler.c:993:out_handle()) kmalloced '(update_bufs)': 8 at 00000000dcc7d040.
00000100:00000001:6.0:1773851901.668065:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000400:00000200:13.0:1773851901.668066:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:6.0:1773851901.668066:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000400:00000200:13.0:1773851901.668067:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000100:00000001:13.0:1773851901.668068:0:2514888:0:(events.c:307:request_in_callback()) Process entered
02000000:00000010:6.0:1773851901.668068:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 4576 at 00000000f3159e14.
00000100:00000200:13.0:1773851901.668069:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
02000000:00000001:6.0:1773851901.668069:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.668069:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:13.0:1773851901.668070:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f02ac86.
00000100:00000040:13.0:1773851901.668070:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000007f02ac86 x1859313734890112 msgsize 328
00000020:00000001:6.0:1773851901.668070:0:1537125:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:6.0:1773851901.668071:0:1537125:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000100:00100000:13.0:1773851901.668072:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8754@kfi7)
00000020:00000001:6.0:1773851901.668072:0:1537125:0:(out_handler.c:356:out_index_lookup()) Process entered
00080000:00000001:6.0:1773851901.668072:0:1537125:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00000100:00000001:13.0:1773851901.668075:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851901.668075:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000800:00000200:13.0:1773851901.668077:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851901.668077:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851901.668078:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851901.668078:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00080000:00000001:6.0:1773851901.668078:0:1537125:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00000100:00000001:12.0:1773851901.668079:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851901.668079:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851901.668079:0:1537125:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:6.0:1773851901.668079:0:1537125:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:6.0:1773851901.668079:0:1537125:0:(fld_handler.c:211:fld_local_lookup()) Process entered
00000100:00100000:12.0:1773851901.668080:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734890112
00000020:00000001:12.0:1773851901.668080:0:609420:0:(genops.c:802:class_conn2export()) Process entered
80000000:00000001:6.0:1773851901.668080:0:1537125:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
00000020:00000040:12.0:1773851901.668081:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:12.0:1773851901.668081:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
80000000:00000001:6.0:1773851901.668081:0:1537125:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:6.0:1773851901.668081:0:1537125:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851901.668082:0:1537125:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851901.668082:0:1537125:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000020:00000040:6.0:1773851901.668083:0:1537125:0:(out_handler.c:389:out_index_lookup()) lookup [0x24001b599:0x10e2:0x0] slingshotmon get [0x2800256ea:0x3d:0x0] rc 1
00000020:00000040:6.0:1773851901.668084:0:1537125:0:(out_handler.c:393:out_index_lookup()) lustre5-MDT0001: insert lookup reply 00000000c4776055 index 0: rc = 1
00000020:00000040:12.0:1773851901.668085:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=10
00000020:00000001:12.0:1773851901.668085:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000001:6.0:1773851901.668085:0:1537125:0:(out_handler.c:398:out_index_lookup()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851901.668086:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000002:6.0:1773851901.668086:0:1537125:0:(lu_object.c:224:lu_object_put()) Add 000000003fbfefe6/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000100:00000001:12.0:1773851901.668087:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000010:6.0:1773851901.668087:0:1537125:0:(out_handler.c:1241:out_handle()) kfreed 'update_bufs': 8 at 00000000dcc7d040.
00000020:00000001:6.0:1773851901.668087:0:1537125:0:(out_handler.c:1247:out_handle()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851901.668088:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851901.668088:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00010000:00000040:6.0:1773851901.668088:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065609179840
00000020:00000010:12.0:1773851901.668089:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00010000:00000001:6.0:1773851901.668089:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000020:00000010:12.0:1773851901.668090:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00010000:00000200:6.0:1773851901.668090:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004ed214fe x1858065609179840/t0(0) o1000->lustre5-MDT0002-mdtlov_UUID@13@kfi7:628/0 lens 328/4320 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 1/0 job:'default-yuba3-0'
00000100:00000040:12.0:1773851901.668091:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:12.0:1773851901.668092:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851901.668092:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:12.0:1773851901.668093:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:12.0:1773851901.668094:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.668094:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:6.0:1773851901.668094:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851901.668095:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851901.668095:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00010000:00000001:6.0:1773851901.668095:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851901.668096:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006a6e8496 refcount=3
00000100:00001000:6.0:1773851901.668096:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=130 v=66 (1 1 1 1)
00000020:00000001:12.0:1773851901.668097:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000001:12.0:1773851901.668097:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00000100:00000001:6.0:1773851901.668097:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851901.668097:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00010000:00000001:12.0:1773851901.668098:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00000100:00000001:6.0:1773851901.668098:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
00010000:00000001:12.0:1773851901.668099:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.668099:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851901.668099:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851901.668099:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.668100:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.668100:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:12.0:1773851901.668101:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851901.668101:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-30@kfi7
00000100:00000001:12.0:1773851901.668102:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851901.668102:0:1537125:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000a1c27096 (tot 253203915).
00000100:00000200:6.0:1773851901.668103:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 4320 bytes to portal 4, xid 1858065609179840, offset 224
00000100:00000001:12.0:1773851901.668104:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000400:00000200:6.0:1773851901.668104:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-30@kfi7
00000100:00000001:13.0:1773851901.668105:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851901.668105:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000400:00000200:6.0:1773851901.668105:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000100:00000001:13.0:1773851901.668106:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851901.668106:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 50273008
00000400:00000200:6.0:1773851901.668106:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000100:00000001:13.0:1773851901.668107:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.668107:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 1
00000100:00000001:12.0:1773851901.668107:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945741184 : -106919763810432 : ffff9ec1cd756780)
00000400:00000200:6.0:1773851901.668107:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000001:13.0:1773851901.668108:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.668108:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007f02ac86 x1859313734890112/t0(0) o103->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 328/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000400:00000200:6.0:1773851901.668108:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:6.0:1773851901.668109:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  30@kfi7 local destination
00000100:00000001:12.0:1773851901.668111:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.668111:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000400:00000200:6.0:1773851901.668111:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770390:8770390:1024:4294967295] 30@kfi7 LPNI seq info [23133331:23133331:16:4294967295]
00000100:00100000:12.0:1773851901.668112:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f02ac86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:5ac50477-c5c0-47ab-9937-99f367ea73c9+10:39862:x1859313734890112:12345-8754@kfi7:103:
00000400:00000200:6.0:1773851901.668112:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:6.0:1773851901.668113:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000100:00000200:12.0:1773851901.668114:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734890112
00010000:00000001:12.0:1773851901.668114:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:12.0:1773851901.668115:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00000400:00000200:6.0:1773851901.668115:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 30@kfi7(30@kfi7:30@kfi7) <?> : PUT try# 0
00010000:00000001:12.0:1773851901.668116:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000400:00000200:6.0:1773851901.668116:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000100:00000001:12.0:1773851901.668118:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851901.668118:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000800:00000200:6.0:1773851901.668118:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 1 allocated
02000000:00000010:12.0:1773851901.668119:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d2861eac.
00000800:00000200:6.0:1773851901.668119:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
02000000:00000001:12.0:1773851901.668120:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.668120:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.668121:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:12.0:1773851901.668121:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00000800:00000200:6.0:1773851901.668121:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_EVENT_INIT_BULK event status 0
00010000:00000001:12.0:1773851901.668122:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851901.668122:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.668122:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006a6e8496 refcount=3
00000020:00000001:12.0:1773851901.668123:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000001:12.0:1773851901.668124:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277644544 : -107045431907072 : ffff9ea48b0e6d00)
00010000:00000040:12.0:1773851901.668124:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 196
00000004:00000001:12.0:1773851901.668125:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851901.668126:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000800:00000200:6.0:1773851901.668126:0:1537125:0:(kfilnd_ep.c:374:kfilnd_ep_post_tagged_recv()) 2054@kfi7:1 Transaction ID 000000007b4c751b: Posted tagged recv of 4320 bytes (2 frags) with tag 0xff0001: rc=0
00000020:00000001:12.0:1773851901.668127:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851901.668127:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851901.668127:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851901.668127:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_TAGGED_RECV_POSTED state change
00000020:00000001:12.0:1773851901.668128:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.668129:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00000800:00000200:6.0:1773851901.668129:0:1537125:0:(kfilnd_tn.c:603:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x0 TN_EVENT_INIT_BULK event status 0
00010000:00000001:12.0:1773851901.668130:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851901.668131:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.668131:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:6.0:1773851901.668131:0:1537125:0:(kfilnd_tn.c:610:kfilnd_tn_state_tagged_recv_posted()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00010000:00000001:12.0:1773851901.668132:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851901.668132:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851901.668133:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006a6e8496 with handle 0x21b6f08f07a6aece from hash
00010000:00000001:12.0:1773851901.668134:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851901.668134:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.668134:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000800:00000200:6.0:1773851901.668134:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000007b4c751b: Posted send of 110 bytes to peer 0x2000000000000fe: rc=0
00010000:00000001:12.0:1773851901.668135:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851901.668135:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00000800:00000200:6.0:1773851901.668135:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_STATE_TAGGED_RECV_POSTED -> TN_STATE_WAIT_COMP state change
00010000:00000001:12.0:1773851901.668136:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.668136:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851901.668137:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851901.668137:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006a6e8496/0x21b6f08f07a6aece lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x44a01000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2c6 expref: 10 pid: 41182 timeout: 0 lvb_type: 0
00000100:00000001:6.0:1773851901.668137:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851901.668138:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:6.0:1773851901.668139:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851901.668139:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851901.668140:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00000020:00000001:6.0:1773851901.668140:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00010000:00000040:12.0:1773851901.668141:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002338620b : new locks_count 3
00000100:00000040:6.0:1773851901.668141:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004ed214fe x1858065609179840/t0(0) o1000->lustre5-MDT0002-mdtlov_UUID@13@kfi7:628/0 lens 328/4320 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 1/1 job:'default-yuba3-0'
00000020:00000040:12.0:1773851901.668142:0:609420:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 9
00010000:00000010:12.0:1773851901.668142:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000f51e5eb4.
00010000:00000040:12.0:1773851901.668143:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00000100:00100000:6.0:1773851901.668143:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004ed214fe pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0002-mdtlov_UUID+5:165971:x1858065609179840:12345-13@kfi7:1000:default-yuba3-0 Request processed in 88us (117us total) trans 0 rc 1/1
00010000:00000001:12.0:1773851901.668144:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.668144:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851901.668145:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851901.668146:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00000100:00100000:6.0:1773851901.668146:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 18314090
00010000:00000001:12.0:1773851901.668147:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851901.668147:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851901.668147:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000100:00000001:6.0:1773851901.668147:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:5.0:1773851901.668147:0:2507993:0:(kfilnd_tn.c:1127:kfilnd_tn_state_wait_comp()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00010000:00000001:12.0:1773851901.668148:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851901.668148:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00000100:00000001:6.0:1773851901.668148:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00010000:00010000:12.0:1773851901.668149:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:12.0:1773851901.668149:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000020:00000010:6.0:1773851901.668149:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000020:00000010:6.0:1773851901.668149:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000800:00000200:5.0:1773851901.668149:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_STATE_WAIT_COMP -> TN_STATE_WAIT_TAG_COMP state change
00010000:00000001:12.0:1773851901.668150:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000020:00000010:6.0:1773851901.668150:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d27ec1a9.
00010000:00000001:12.0:1773851901.668151:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851901.668151:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=155 v=66 (1 1 1 1)
00000020:00000040:6.0:1773851901.668151:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:12.0:1773851901.668152:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000001:6.0:1773851901.668152:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:12.0:1773851901.668153:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:12.0:1773851901.668154:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:12.0:1773851901.668154:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851901.668155:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.668155:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851901.668156:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8754@kfi7
00000400:00000010:12.0:1773851901.668157:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000781064e3.
00000100:00000200:12.0:1773851901.668157:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859313734890112, offset 224
00000400:00000200:12.0:1773851901.668159:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8754@kfi7
00000400:00000200:12.0:1773851901.668160:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.668161:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000400:00000200:12.0:1773851901.668162:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:12.0:1773851901.668163:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000400:00000200:12.0:1773851901.668164:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8754@kfi7 local destination
00000400:00000200:12.0:1773851901.668166:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770391:8770391:1023:4294967295] 8754@kfi7 LPNI seq info [5400473:5400473:16:4294967295]
00000400:00000200:12.0:1773851901.668167:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:12.0:1773851901.668168:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.668170:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8754@kfi7(8754@kfi7:8754@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851901.668171:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000800:00000200:5.0:1773851901.668171:0:2507993:0:(kfilnd_tn.c:1307:kfilnd_tn_state_wait_tag_comp()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe TN_EVENT_TAG_RX_OK event status 0
00000800:00000200:12.0:1773851901.668173:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:5.0:1773851901.668173:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:12.0:1773851901.668174:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:5.0:1773851901.668174:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000400:00000200:5.0:1773851901.668175:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a1c27096
00000400:00000010:5.0:1773851901.668175:0:2507993:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000a1c27096 (tot 253203763).
00000800:00000200:12.0:1773851901.668176:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:5.0:1773851901.668176:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851901.668177:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000800:00000200:12.0:1773851901.668178:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Using peer 8754@kfi7(0x10000000000000a)
00000400:00000200:5.0:1773851901.668178:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:5.0:1773851901.668179:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_BULK_PUT_REQ TN 000000007b4c751b: 2054@kfi7:1 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 1 trr 1 tta 0x2000000000000fe Transaction freed
00000800:00000200:12.0:1773851901.668181:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x10000000000000a: rc=0
00000800:00000200:12.0:1773851901.668183:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851901.668185:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.668186:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:12.0:1773851901.668187:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.668187:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.668188:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f02ac86 x1859313734890112/t0(0) o103->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 328/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:12.0:1773851901.668193:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f02ac86 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:39862:x1859313734890112:12345-8754@kfi7:103: Request processed in 81us (122us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851901.668195:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 50273008
00000100:00000040:12.0:1773851901.668196:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 0
00000100:00000001:12.0:1773851901.668197:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851901.668197:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851901.668198:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.668199:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851901.668200:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851901.668201:0:609420:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 8
00000100:00000001:12.0:1773851901.668202:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851901.668208:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851901.668209:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.668210:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000400:00000200:13.0:1773851901.668211:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000781064e3
00000400:00000010:13.0:1773851901.668212:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000781064e3.
00000100:00000001:13.0:1773851901.668213:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851901.668213:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851901.668214:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000800:00000200:13.0:1773851901.668215:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Transaction freed
00000800:00000200:25.0:1773851901.668275:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851901.668275:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851901.668277:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851901.668279:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851901.668281:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.668282:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8946@kfi7 : PUT - for me
00000400:00000200:25.0:1773851901.668283:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.668284:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000400:00000200:25.0:1773851901.668285:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.668285:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:25.0:1773851901.668286:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:25.0:1773851901.668287:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:25.0:1773851901.668288:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 584 into portal 12 MB=0x69b0936b1b2c0
00000400:00000200:25.0:1773851901.668289:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8754@kfi7 of length 584/584 into md 0x16159c9699 [64] + 42592
00000800:00000200:25.0:1773851901.668291:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851901.668292:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851901.668293:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00000100:00000001:25.0:1773851901.668294:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851901.668295:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851901.668297:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000144e137a.
00000100:00000040:25.0:1773851901.668297:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000144e137a x1859313734890176 msgsize 584
00000100:00100000:25.0:1773851901.668299:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8946@kfi7)
00000100:00000001:25.0:1773851901.668300:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851901.668301:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000100:00000001:26.0:1773851901.668302:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851901.668302:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851901.668302:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851901.668303:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851901.668303:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.668304:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851901.668305:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734890176
00000020:00000001:26.0:1773851901.668305:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851901.668306:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:26.0:1773851901.668306:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.668307:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=9
00000020:00000001:26.0:1773851901.668308:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000001:26.0:1773851901.668309:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000100:00000001:26.0:1773851901.668310:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.668310:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851901.668311:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f5cb6f5.
00000020:00000010:26.0:1773851901.668312:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851901.668313:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851901.668314:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851901.668314:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:26.0:1773851901.668315:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:26.0:1773851901.668315:0:41182:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.668316:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.668317:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.668318:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.668319:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851901.668319:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851901.668319:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851901.668319:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851901.668321:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 1451911044
00000100:00000040:26.0:1773851901.668322:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 1
00000100:00000001:26.0:1773851901.668322:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636951520131712 : -107122189419904 : ffff9e92abf3ba80)
00000100:00000001:24.0:1773851901.668322:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851901.668323:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.668324:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000144e137a x1859313734890176/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 584/0 e 0 to 0 dl 1773852297 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1033-0'
00000100:00000001:26.0:1773851901.668326:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.668327:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851901.668328:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000144e137a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:2028291:x1859313734890176:12345-8754@kfi7:101:default-tuolumne1033-0
00000100:00000200:26.0:1773851901.668329:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734890176
00000020:00000001:26.0:1773851901.668330:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851901.668331:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851901.668331:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.668332:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851901.668332:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:26.0:1773851901.668333:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851901.668334:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313734890176, found 0 last_xid 1859313734890175
00000020:00000001:26.0:1773851901.668335:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851901.668335:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851901.668336:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851901.668337:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.668337:0:41182:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:26.0:1773851901.668338:0:41182:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:26.0:1773851901.668338:0:41182:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:26.0:1773851901.668339:0:41182:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:26.0:1773851901.668339:0:41182:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.668341:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851901.668342:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00010000:00000001:26.0:1773851901.668342:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.668343:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.668344:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000003ea221cf.
00000020:00000001:26.0:1773851901.668344:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.668345:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 000000003ea221cf with handle 0x21b6f08f07a6aed5 to hash
00000020:00000001:26.0:1773851901.668346:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.668348:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637028277646272 : -107045431905344 : ffff9ea48b0e73c0)
00010000:00000010:26.0:1773851901.668348:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000002e11f02b.
00010000:00000001:26.0:1773851901.668349:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637028277646272 : -107045431905344 : ffff9ea48b0e73c0)
00010000:00010000:26.0:1773851901.668350:0:41182:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000003ea221cf/0x21b6f08f07a6aed5 lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0f5706c4644c2cd expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668352:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:26.0:1773851901.668353:0:41182:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000002338620b : new locks_count 4
00000020:00000040:26.0:1773851901.668354:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002338620b refcount=10
00010000:00000001:26.0:1773851901.668355:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:26.0:1773851901.668355:0:41182:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:26.0:1773851901.668356:0:41182:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:26.0:1773851901.668356:0:41182:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:26.0:1773851901.668357:0:41182:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:26.0:1773851901.668357:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:26.0:1773851901.668358:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24001b599:0x10e2:0x0]
00000020:00000001:26.0:1773851901.668359:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:26.0:1773851901.668359:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637077270833752 : -106996438717864 : ffff9eaff3472a58)
00000004:00000001:26.0:1773851901.668360:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637077270833664 : -106996438717952 : ffff9eaff3472a00)
00000004:00000001:26.0:1773851901.668361:0:41182:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.668361:0:41182:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:26.0:1773851901.668362:0:41182:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:26.0:1773851901.668362:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851901.668363:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851901.668364:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000a514a942.
02000000:00000001:26.0:1773851901.668365:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.668366:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.668366:0:41182:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.668367:0:41182:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:26.0:1773851901.668367:0:41182:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:26.0:1773851901.668367:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.668368:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.668368:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.668369:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.668369:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.668379:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.668379:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.668380:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.668380:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.668381:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.668381:0:41182:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:26.0:1773851901.668381:0:41182:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:26.0:1773851901.668382:0:41182:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:26.0:1773851901.668383:0:41182:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.668383:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.668383:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.668384:0:41182:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:26.0:1773851901.668384:0:41182:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.668385:0:41182:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:26.0:1773851901.668386:0:41182:0:(mdt_handler.c:2137:mdt_getattr_name_lock()) getattr with lock for [0x24001b599:0x10e2:0x0]/slingshotmon, ldlm_rep = 00000000f9bf82b1
00000004:00000001:26.0:1773851901.668387:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:26.0:1773851901.668388:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00000004:00000001:26.0:1773851901.668388:0:41182:0:(mdt_handler.c:203:mdt_lock_pdo_mode()) Process entered
00000004:00000001:26.0:1773851901.668389:0:41182:0:(mdt_handler.c:271:mdt_lock_pdo_mode()) Process leaving
00010000:00000001:26.0:1773851901.668389:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:26.0:1773851901.668389:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851901.668390:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.668390:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.668391:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.668392:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000017380f27.
00000020:00000001:26.0:1773851901.668393:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.668394:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000017380f27 with handle 0x21b6f08f07a6aedc to hash
00000020:00000001:26.0:1773851901.668394:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.668395:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000010:26.0:1773851901.668395:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000005581b56b.
00010000:00000001:26.0:1773851901.668396:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:26.0:1773851901.668397:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.668397:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.668398:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 3/1,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x0/0x0 rrc: 197 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668403:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.668404:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:26.0:1773851901.668404:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:26.0:1773851901.668405:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:26.0:1773851901.668405:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.668406:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.668406:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.668407:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.668407:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:26.0:1773851901.668408:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:26.0:1773851901.668408:0:41182:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:26.0:1773851901.668408:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:26.0:1773851901.668409:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013) refcount = 196
00010000:00000040:26.0:1773851901.668410:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:26.0:1773851901.668411:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b1c626e/0x21b6f08f07a63a13 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db40a3 expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668413:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668414:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000da84b9c3/0x21b6f08f07a5339a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e6bd35e expref: 904 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668416:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668417:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047f866bb/0x21b6f08f07a52936 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x20/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfba485288 expref: 904 pid: 60556 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668419:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668420:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f430c34/0x21b6f08f07a6ae73 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92ec5 expref: 7 pid: 60487 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668422:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668423:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fdf7b4ae/0x21b6f08f07a6ab94 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc6e expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668425:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668426:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffc71bda/0x21b6f08f07a6824a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a56053661fe expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668428:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668429:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb0ff262/0x21b6f08f07a681b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f0 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668431:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668432:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055190f01/0x21b6f08f07a67ab0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb87f expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668434:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668435:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e19844fb/0x21b6f08f07a67a4e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecb6 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668437:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668437:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab5d136b/0x21b6f08f07a67730 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfed5 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668440:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668440:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ff6b278/0x21b6f08f07a66fa4 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f33 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668443:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668443:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd93d37/0x21b6f08f07a66c9b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ac7 expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668446:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668446:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000081e1f05/0x21b6f08f07a66a72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66becf39 expref: 8 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668450:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668451:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008e026d23/0x21b6f08f07a63a05 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.153@o2ib600 remote: 0x318b409262db409c expref: 907 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668453:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668454:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c4c0925/0x21b6f08f07a5edec lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0dfd expref: 7 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668456:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668456:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be730fa9/0x21b6f08f07a5d438 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7d3 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668458:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668459:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d1c17432/0x21b6f08f07a5d2be lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf809 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668461:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668462:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000055d0accc/0x21b6f08f07a5d20f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b4038495 expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668464:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668465:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f174b6f/0x21b6f08f07a5bfb6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.162@o2ib600 remote: 0xdd24cd147787eed3 expref: 349 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668467:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668468:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015c4d77b/0x21b6f08f07a5b234 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940348 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668470:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668471:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b0038c6c/0x21b6f08f07a5b19a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa80 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668474:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668475:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dbd9b53/0x21b6f08f07a5b100 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3207 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668477:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668478:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef13314c/0x21b6f08f07a5b0c8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219e4 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668480:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668481:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eaa13186/0x21b6f08f07a5a8e8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc95 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668483:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668484:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbc6800/0x21b6f08f07a5a8a2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ebf expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668486:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668486:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e8e9ddb/0x21b6f08f07a5a878 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c6f expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668489:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668489:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b19f1aba/0x21b6f08f07a5a840 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6b5 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668492:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668492:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b728790/0x21b6f08f07a5a6f7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476f6 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668494:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668496:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000020865608/0x21b6f08f07a5a51b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f0 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668498:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668499:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d56720b2/0x21b6f08f07a5a2f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733833f expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668501:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668502:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005cc7a21d/0x21b6f08f07a5a2b3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c70 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668504:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668505:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d345882a/0x21b6f08f07a5a19b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d4278d expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668506:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668507:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008a4dc21/0x21b6f08f07a50ca3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f42 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668509:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668510:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000462d5a52/0x21b6f08f07a50c6b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948057 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668512:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668513:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000463e726a/0x21b6f08f07a50c33 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c201 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668515:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668516:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000009c23fb1/0x21b6f08f07a4e78f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453df expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668518:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668519:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007515b7fa/0x21b6f08f07a4e757 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1460d expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668522:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668523:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000056441af1/0x21b6f08f07a4e71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040e8 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668525:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668525:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c975a34/0x21b6f08f07a4e669 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6e9 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668527:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668528:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003cec6a4f/0x21b6f08f07a4e3a6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e27 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668530:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668531:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000264f5bf6/0x21b6f08f07a4e2e2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8eb4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668533:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668534:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000af741a45/0x21b6f08f07a4e2aa lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6c4 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668536:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668537:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6ada456/0x21b6f08f07a4e23a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4023 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668539:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668540:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035369b68/0x21b6f08f07a4e0d5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c205 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668542:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668543:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c4906b8/0x21b6f08f07a4e09d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f2d expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668546:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668547:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007aab9066/0x21b6f08f07a4db17 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f2094 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668549:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668550:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000084476a6/0x21b6f08f07a4dadf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499526 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668552:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668553:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668555:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668555:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004e63e6a8/0x21b6f08f07a4b81e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66622 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668557:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668558:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016a5f681/0x21b6f08f07a472c6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1fb expref: 10 pid: 60758 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668560:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668561:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043c14f10/0x21b6f08f07a44179 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cc9 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668563:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668564:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6648ddc/0x21b6f08f07a44109 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e115ed expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668566:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668567:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6606301/0x21b6f08f07a440d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792847 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668571:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668572:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7bc8ba6/0x21b6f08f07a44099 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877784e5c expref: 165 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668574:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668575:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000122c3c50/0x21b6f08f07a44061 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5262 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668577:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668578:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a13711c6/0x21b6f08f07a44029 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc53 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668579:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668580:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1c79fe9/0x21b6f08f07a43ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c8f expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668582:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668583:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043912716/0x21b6f08f07a43f81 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338026 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668585:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668586:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b211b08/0x21b6f08f07a43f11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030723 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668588:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668589:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d3cb8441/0x21b6f08f07a43ebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a92768e expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668591:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668592:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004504d254/0x21b6f08f07a43e69 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f8d expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668595:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668596:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b28144b/0x21b6f08f07a43df9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dd4962 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668598:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668599:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000068add76e/0x21b6f08f07a43d43 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde2c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668601:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668602:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b4aa9c0/0x21b6f08f07a43ce1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da868 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668604:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668604:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001c05edce/0x21b6f08f07a43ca9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53167 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668607:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668607:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe5e1d39/0x21b6f08f07a43c2b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73a9c expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668609:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668610:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000916ffc77/0x21b6f08f07a43be5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd731 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668612:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668613:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007581a372/0x21b6f08f07a43bbb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b0b expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668616:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668616:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6505c87/0x21b6f08f07a43b3d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01de9 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668619:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668620:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009037e450/0x21b6f08f07a43ae9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10c3 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668622:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668622:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf217941/0x21b6f08f07a43a5d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd46693f expref: 167 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668625:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668625:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b086e694/0x21b6f08f07a43a25 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bc8 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668627:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668628:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015f74380/0x21b6f08f07a439d1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f14 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668630:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668631:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000085527c50/0x21b6f08f07a43961 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84356 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668633:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668634:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000164c0a65/0x21b6f08f07a438e3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76af expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668636:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668637:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c82907e/0x21b6f08f07a438b9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d823 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668639:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668640:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b8960e67/0x21b6f08f07a437a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b37d7 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668643:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668643:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bee2462c/0x21b6f08f07a43769 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03befa2d expref: 165 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668646:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668647:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080877058/0x21b6f08f07a43731 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d1c expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668649:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668650:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c710c8bb/0x21b6f08f07a436f9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3238 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668652:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668652:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dae2d64e/0x21b6f08f07a43651 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f315 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668654:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668655:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8445fd4/0x21b6f08f07a4352b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94732d expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668657:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668658:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003fbb821d/0x21b6f08f07a434c9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4b7 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668660:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668661:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a35b2891/0x21b6f08f07a43491 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bd7 expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668663:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668664:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e42d8074/0x21b6f08f07a43421 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b20c expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668667:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668668:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a53dab9e/0x21b6f08f07a433e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f0e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668670:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668670:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a1bb12/0x21b6f08f07a43379 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80b8 expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668673:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668673:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084ce8fb8/0x21b6f08f07a431f1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640451 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668676:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668676:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016bb71a3/0x21b6f08f07a4311f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3438 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668678:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668679:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ead758f/0x21b6f08f07a430a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ebc expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668681:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668682:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce2b5285/0x21b6f08f07a4303f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff40275f expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668685:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668685:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028c5ecb9/0x21b6f08f07a42f97 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc351 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668688:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668688:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c6a39da8/0x21b6f08f07a42f35 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f2a28c expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668691:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668692:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d28ab2ad/0x21b6f08f07a42f27 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91dab expref: 169 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668694:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668695:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c7d93fe/0x21b6f08f07a42f19 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdd3 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668697:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668698:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d314ebf/0x21b6f08f07a42e7f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2efb9 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668700:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668700:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb3071df/0x21b6f08f07a42dd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672417 expref: 167 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668703:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668703:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f89d1281/0x21b6f08f07a42c41 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13b4 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668705:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668706:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef79d3f8/0x21b6f08f07a42c3a lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1412 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668709:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668709:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029b440b8/0x21b6f08f07a42b99 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c35 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668711:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668712:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1722039/0x21b6f08f07a42b45 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcd4 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668714:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668715:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005e588a9f/0x21b6f08f07a42af1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc66 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668717:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668718:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7edd0d9/0x21b6f08f07a42a11 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581cf expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668720:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668721:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098aae988/0x21b6f08f07a429a1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cee expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668723:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668724:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c3f3dc0/0x21b6f08f07a428c1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417ed expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668730:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668731:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c14046fa/0x21b6f08f07a42843 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d24 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668733:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668734:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d94fdf07/0x21b6f08f07a427b7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e482 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668735:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668737:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000302d8a18/0x21b6f08f07a42771 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a7fa expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668739:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668739:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d83ab164/0x21b6f08f07a426f3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed2 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668744:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668745:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cd1b022c/0x21b6f08f07a42659 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e840 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668747:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668748:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098fed8b8/0x21b6f08f07a42381 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c64077 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668750:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668751:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0a413dc/0x21b6f08f07a4233b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cbfb expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668753:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668754:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a14445/0x21b6f08f07a422d9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4631c expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668756:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668757:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5908de/0x21b6f08f07a42119 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f25 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668759:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668759:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002de05f76/0x21b6f08f07a3f1fc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b562 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668762:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668762:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000002aac1e6/0x21b6f08f0301ae0f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac04c expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668764:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668765:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a758dd91/0x21b6f08f02faff1b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f17 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668768:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668769:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000183d7853/0x21b6f08f02e26b72 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644bc expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668771:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668772:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003e1e85b5/0x21b6f08f02dbf780 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834036 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668774:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668775:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf911613/0x21b6f08f02dbf6ed lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828c6cb expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668776:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668777:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be89b971/0x21b6f08f02dbf6c3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb282365103ce96 expref: 164 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668779:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668780:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001fb6b5c/0x21b6f08f02db3070 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed29 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668782:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668783:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f2f02694/0x21b6f08f02db1b7e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb9101 expref: 161 pid: 60845 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668785:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668786:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f556c8c/0x21b6f08f02daf25e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe1c7e0 expref: 160 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668788:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668788:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9641afc/0x21b6f08f02cc4b8b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111701 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668791:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668792:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000263ac47b/0x21b6f08f02c838ae lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782beb1fd expref: 166 pid: 61030 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668794:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668794:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d073217/0x21b6f08f02b3faa1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76ca expref: 166 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668797:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668797:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2133c1b/0x21b6f08f02b3e497 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a2e expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668799:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668800:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f4a18e2e/0x21b6f08f02a70ec6 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882938 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668802:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668803:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000edc5c805/0x21b6f08f029964fd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce3b expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668805:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668806:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000954abf8d/0x21b6f08f0295ba08 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa21 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668808:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668809:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c18300aa/0x21b6f08f02947ef3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b68287 expref: 167 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668811:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668812:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e27b452/0x21b6f08f0293fac5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d710 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668815:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668816:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000016dcd64f/0x21b6f08f0293a996 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d7437c7 expref: 166 pid: 60764 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668817:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668818:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7f16944/0x21b6f08f029383b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac95 expref: 166 pid: 60802 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668820:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668821:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008c2bec52/0x21b6f08f028de14e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf0 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668823:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668824:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cec6d75/0x21b6f08f028de060 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac2d expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668826:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668827:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f6c6213b/0x21b6f08f028d8f70 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424c8e83 expref: 166 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668828:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668829:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006d973e4d/0x21b6f08f0289ddcf lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e70e1e expref: 167 pid: 60866 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668831:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668832:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b582bc7/0x21b6f08f0289daa3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e04fd expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668834:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668835:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a1f7ed7/0x21b6f08f0288306e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deaba6 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668838:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668839:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000031482a9/0x21b6f08f02882f2c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0305b expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668841:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668842:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f9caf/0x21b6f08f027f5715 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ecc expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668844:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668845:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000626286c3/0x21b6f08f027f560b lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7ee expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668847:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668848:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fd90f2f/0x21b6f08f027f3ba1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc864 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668850:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668851:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5fa1681/0x21b6f08f027411cc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b273 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668853:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668854:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdadd598/0x21b6f08f02531414 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55cc6 expref: 26 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668856:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668857:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9ecf80a/0x21b6f08f02245516 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec695 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668859:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668860:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef80157b/0x21b6f08f02237ff1 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817062f8b5 expref: 168 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668862:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668863:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d64deab5/0x21b6f08f021eabd0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e2 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668865:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668866:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000011b5d210/0x21b6f08f00c4fdd7 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe0922f expref: 169 pid: 61109 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668868:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668869:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072a5b847/0x21b6f08f0084f463 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a1 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668871:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668872:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003dc71bf9/0x21b6f08f0031dca5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269f4 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668874:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668875:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000065613736/0x21b6f08effdbbfde lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb191 expref: 166 pid: 61117 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668877:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668878:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad23ea33/0x21b6f08effdaabd5 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09418 expref: 166 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668880:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668880:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b8d77e3/0x21b6f08effb44f84 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e13 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668883:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668884:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004794918d/0x21b6f08effb44ec0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5364d expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668887:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668888:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cdd3ad2e/0x21b6f08eff5c9e29 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa177f expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668889:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668890:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d37b433d/0x21b6f08efefa598e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826713a expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668892:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668893:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d4d55cc/0x21b6f08efefa58a0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a0b expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668895:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668896:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009d2a53f0/0x21b6f08efec34844 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54456a expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668898:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668898:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000010642ea9/0x21b6f08efeb89aa8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0546 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668900:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668901:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000676bac0d/0x21b6f08efe87d5a3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c49 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668903:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668904:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000744d95af/0x21b6f08efd22a11c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ce expref: 159 pid: 60503 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668906:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668907:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a874023/0x21b6f08efccf1c6e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad0675 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668910:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668911:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba67bd55/0x21b6f08efc27c643 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c28a expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668913:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668914:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003ef2b0ea/0x21b6f08eebf3da4f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde01 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668916:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668916:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b369bbe6/0x21b6f08eebf3c621 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3e4 expref: 3755 pid: 59148 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668918:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668919:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4e0ac89/0x21b6f08eebf3b7fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea951178 expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668921:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668922:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015545eae/0x21b6f08eebf3a71f lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931da9e expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668924:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668925:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009612bee3/0x21b6f08eebf36c1d lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee3d expref: 2105 pid: 60530 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668927:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668928:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000690ec22c/0x21b6f08eebf306ab lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec69 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668930:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668931:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d755d7e3/0x21b6f08eebf305d2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f0 expref: 3467 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668934:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668935:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f0f906d/0x21b6f08eebf2496c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5d4 expref: 778 pid: 60916 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668937:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668938:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031fec366/0x21b6f08eebf21007 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb62 expref: 60 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668940:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668941:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003fcab63/0x21b6f08eebf1e2e9 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e87 expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668943:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668944:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bce72d95/0x21b6f08eebf1b5a8 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab0 expref: 428 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668946:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668946:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000820fd372/0x21b6f08eebf16203 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf429 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668948:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668949:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000b67341e/0x21b6f08eebf14c15 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d2 expref: 433 pid: 60637 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668951:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668952:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bc317168/0x21b6f08eebf144dd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759fea expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668954:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668955:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035db2262/0x21b6f08eebf12039 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab6f expref: 21 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668958:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668959:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008dce216e/0x21b6f08eebf0d6c0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e82c expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668961:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668962:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022c5fce3/0x21b6f08eebf0d5cb lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e590924 expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668965:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668965:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f1331e8/0x21b6f08eebf086b0 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a557 expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668967:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668968:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000039b9944c/0x21b6f08eebf0776e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897190 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668970:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668971:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c7de9c8b/0x21b6f08eebf06fe2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f80 expref: 3489 pid: 61138 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668973:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668974:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3cc13eb/0x21b6f08eebf068fe lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a16 expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668976:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668977:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000d86238c/0x21b6f08eebf05666 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b7561f9 expref: 4098 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668979:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668980:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000001d59498/0x21b6f08eebf051dc lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b3c expref: 2659 pid: 60521 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668982:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668983:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e5b53531/0x21b6f08eebf0490e lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e092 expref: 1566 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668985:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668986:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000328034fa/0x21b6f08eebf03f7c lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f18 expref: 2188 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668988:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668989:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002d3d89d0/0x21b6f08eebf03f60 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e20 expref: 1003 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668991:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668992:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c49c3cc/0x21b6f08e328ccebd lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.16.70.114@tcp remote: 0xa3f8274c6e48932a expref: 904 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668994:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000040:26.0:1773851901.668995:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066eff2cc/0x21b6f08b915649f2 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 197 type: IBT gid 0 flags: 0x40200000000000 nid: 172.19.3.170@o2ib600 remote: 0x7e9462dfb34e91e5 expref: 904 pid: 43034 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.668997:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00010000:26.0:1773851901.668998:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669000:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.669001:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:26.0:1773851901.669001:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851901.669002:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669003:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:26.0:1773851901.669003:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669004:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669005:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.669006:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:26.0:1773851901.669006:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.669007:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669009:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.669010:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:26.0:1773851901.669010:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669011:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669011:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:26.0:1773851901.669012:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:26.0:1773851901.669013:0:41182:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000003bcbed33.
00010000:00000010:26.0:1773851901.669014:0:41182:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 00000000043dbba8.
00010000:00000001:26.0:1773851901.669015:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.669016:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000008018faef.
00000020:00000001:26.0:1773851901.669017:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.669017:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 000000008018faef with handle 0x21b6f08f07a6aee3 to hash
00000020:00000001:26.0:1773851901.669018:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.669018:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000010:26.0:1773851901.669019:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000001001fa8.
00010000:00000001:26.0:1773851901.669020:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000001:26.0:1773851901.669021:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.669021:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.669022:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 3/1,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669024:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669025:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:26.0:1773851901.669025:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:26.0:1773851901.669026:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:26.0:1773851901.669026:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.669026:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669027:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.669028:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669029:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:26.0:1773851901.669029:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:26.0:1773851901.669029:0:41182:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:26.0:1773851901.669030:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:26.0:1773851901.669030:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24001b599:0x10e2:0x0].0xba093aa3 (000000003bcbed33) refcount = 1
00010000:00010000:26.0:1773851901.669031:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669033:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669034:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:26.0:1773851901.669034:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851901.669034:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669035:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:26.0:1773851901.669035:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669036:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669037:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.669037:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:26.0:1773851901.669038:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.669038:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669041:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669041:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:26.0:1773851901.669041:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669042:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669042:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669043:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669043:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008018faef refcount=3
00000020:00000001:26.0:1773851901.669044:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000001:26.0:1773851901.669045:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000001:26.0:1773851901.669045:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669045:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.669046:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669046:0:41182:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669048:0:41182:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:26.0:1773851901.669051:0:41182:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000001:26.0:1773851901.669052:0:41182:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:26.0:1773851901.669052:0:41182:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:26.0:1773851901.669053:0:41182:0:(osd_index.c:639:osd_dir_lookup()) Process entered
00080000:00000001:26.0:1773851901.669057:0:41182:0:(osd_index.c:669:osd_dir_lookup()) Process leaving via out_unlock (rc=0 : 0 : 0x0)
00080000:00000001:26.0:1773851901.669058:0:41182:0:(osd_index.c:965:osd_remote_fid()) Process entered
00080000:00000001:26.0:1773851901.669058:0:41182:0:(osd_index.c:945:osd_seq_exists()) Process entered
80000000:00000001:26.0:1773851901.669059:0:41182:0:(fld_handler.c:211:fld_local_lookup()) Process entered
80000000:00000001:26.0:1773851901.669060:0:41182:0:(fld_cache.c:468:fld_cache_lookup()) Process entered
80000000:00000001:26.0:1773851901.669060:0:41182:0:(fld_cache.c:487:fld_cache_lookup()) Process leaving (rc=0 : 0 : 0)
80000000:00000001:26.0:1773851901.669061:0:41182:0:(fld_handler.c:228:fld_local_lookup()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:26.0:1773851901.669062:0:41182:0:(osd_index.c:958:osd_seq_exists()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:26.0:1773851901.669062:0:41182:0:(osd_index.c:981:osd_remote_fid()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851901.669063:0:41182:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669063:0:41182:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669064:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:26.0:1773851901.669064:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:26.0:1773851901.669065:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:26.0:1773851901.669066:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000004:00000001:26.0:1773851901.669067:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000004:00000001:26.0:1773851901.669067:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:26.0:1773851901.669068:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:26.0:1773851901.669068:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:26.0:1773851901.669069:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851901.669069:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851901.669070:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.669070:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.669071:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000000a72d08f.
00000020:00000001:26.0:1773851901.669072:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.669072:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 000000000a72d08f with handle 0x21b6f08f07a6aeea to hash
00000020:00000001:26.0:1773851901.669073:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.669073:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000010:26.0:1773851901.669074:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000e4682501.
00010000:00000001:26.0:1773851901.669075:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000001:26.0:1773851901.669076:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.669076:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.669077:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000000a72d08f/0x21b6f08f07a6aeea lrc: 3/1,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x0/0x0 rrc: 230 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669079:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851901.669080:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:26.0:1773851901.669080:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:26.0:1773851901.669081:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:26.0:1773851901.669081:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.669082:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669082:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.669083:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669083:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:26.0:1773851901.669084:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:26.0:1773851901.669084:0:41182:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:26.0:1773851901.669085:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:26.0:1773851901.669085:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622) refcount = 229
00010000:00000040:26.0:1773851901.669086:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:26.0:1773851901.669087:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d01a2c58/0x21b6f08f07a6abb0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc75 expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669089:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669090:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002815e9f2/0x21b6f08f07a68266 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a5605366205 expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669092:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669092:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a365d1f/0x21b6f08f07a681d3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb03f7 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669094:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669095:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f282af36/0x21b6f08f07a67acc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb886 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669097:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669098:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fa9a2292/0x21b6f08f07a67a6a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ecbd expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669101:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669101:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ea32f231/0x21b6f08f07a6774c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bfedc expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669103:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669104:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000095146217/0x21b6f08f07a66fc0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f3a expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669106:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669107:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a8e6ba94/0x21b6f08f07a66cb7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939ace expref: 10 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669109:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669110:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb15cab7/0x21b6f08f07a667a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2b7 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669112:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669113:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1d07fb5/0x21b6f08f07a5d5c7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80d5 expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669115:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669116:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a39f262/0x21b6f08f07a5d462 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e7da expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669117:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669118:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ed2df5c/0x21b6f08f07a5d2fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf810 expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669120:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669121:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047dae4f2/0x21b6f08f07a5d247 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b403849c expref: 9 pid: 60919 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669125:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669126:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef17bc6e/0x21b6f08f07a5b250 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c94034f expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669128:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669129:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000689d3f36/0x21b6f08f07a5b218 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b683234 expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669131:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669132:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd02d3a4/0x21b6f08f07a5b1b6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fa87 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669134:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669135:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bd981b51/0x21b6f08f07a5b11c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b320e expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669137:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669138:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c38ee929/0x21b6f08f07a5b0e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac94219eb expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669140:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669140:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bad62b37/0x21b6f08f07a5a904 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fcc9c expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669142:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669143:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d428c4cb/0x21b6f08f07a5a8cc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ec6 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669145:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669146:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8572a96/0x21b6f08f07a5a894 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52c76 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669151:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669152:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000087367bfa/0x21b6f08f07a5a85c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6bc expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669154:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669155:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce4677f2/0x21b6f08f07a5a713 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a86476fd expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669157:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669157:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000084a0b500/0x21b6f08f07a5a599 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6af expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669159:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669161:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d63739b0/0x21b6f08f07a5a56f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e98f7 expref: 7 pid: 41171 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669163:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669163:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050332378/0x21b6f08f07a5a1b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d42794 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669165:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669166:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ddec1056/0x21b6f08f07a59022 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e891685d expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669168:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669169:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30fb5a2/0x21b6f08f07a50dd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca829d expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669171:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669172:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4a82c4/0x21b6f08f07a50cbf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f49 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669176:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669177:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a70e664/0x21b6f08f07a50c87 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe494805e expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669179:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669180:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099496a7f/0x21b6f08f07a50c4f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c208 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669182:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669183:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012469f82/0x21b6f08f07a4e7ab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde48453e6 expref: 8 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669185:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669186:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e60ac52f/0x21b6f08f07a4e773 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a14614 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669188:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669189:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d50eeada/0x21b6f08f07a4e73b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e0897040ef expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669191:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669192:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d355831/0x21b6f08f07a4e685 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea6f0 expref: 8 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669194:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669195:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce5b3614/0x21b6f08f07a4e2fe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ebb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669197:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669197:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a2b19d9/0x21b6f08f07a4e2c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6cb expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669201:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669201:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007f104590/0x21b6f08f07a4e256 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca402a expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669204:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669204:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006235fd61/0x21b6f08f07a4e0f1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c20c expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669206:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669207:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000074d3af6e/0x21b6f08f07a4e0b9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f34 expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669209:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669210:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4de6fed/0x21b6f08f07a4db33 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f209b expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669212:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669213:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000042ad143f/0x21b6f08f07a4dafb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d849952d expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669215:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669216:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669218:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669219:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dd12dd12/0x21b6f08f07a4da8b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3f8e expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669221:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669222:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669227:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669228:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e2398785/0x21b6f08f07a4cb03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92dc9 expref: 7 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669230:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669231:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000098267d56/0x21b6f08f07a4b83a lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66629 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669233:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669234:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f5bf727c/0x21b6f08f07a4522e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec62c expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669236:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669237:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4d3f4f3/0x21b6f08f07a44195 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cd0 expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669239:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669240:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000507483d3/0x21b6f08f07a440ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d5491979284e expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669242:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669243:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a894973d/0x21b6f08f07a4407d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd2460954248a5269 expref: 171 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669245:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669245:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000054b2441a/0x21b6f08f07a44045 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc5a expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669247:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669248:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000010e535b/0x21b6f08f07a4400d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2c96 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669251:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669252:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5e3042c/0x21b6f08f07a43f9d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef2933802d expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669254:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669255:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4cd0b0/0x21b6f08f07a43f2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f03072a expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669257:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669258:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000161d04a6/0x21b6f08f07a43ee7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a927695 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669260:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669261:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d6f53fa/0x21b6f08f07a43e85 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2f94 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669263:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669263:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dfd18a89/0x21b6f08f07a43da5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c53115f expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669266:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669267:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ded41bde/0x21b6f08f07a43d5f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde33 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669269:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669270:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3b4a463/0x21b6f08f07a43d27 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae4279aaf1 expref: 167 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669272:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669272:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a4a9fad/0x21b6f08f07a43cfd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17da86f expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669275:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669276:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045bf24fb/0x21b6f08f07a43cc5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f5316e expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669278:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669279:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ffee6a19/0x21b6f08f07a43c55 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73aa3 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669281:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669282:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069a2cc30/0x21b6f08f07a43c01 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd738 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669284:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669285:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000655e5066/0x21b6f08f07a43bd7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b12 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669287:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669287:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002a1598ae/0x21b6f08f07a43b59 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01df0 expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669290:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669290:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8c0e456/0x21b6f08f07a43b13 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10ca expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669292:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669293:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000037a0851f/0x21b6f08f07a43a79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466946 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669295:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669296:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b28fde4/0x21b6f08f07a43a41 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bcf expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669298:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669299:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b4ed5e0/0x21b6f08f07a439ed lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f1b expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669301:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669302:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f572102a/0x21b6f08f07a4397d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a8435d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669304:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669305:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f150431c/0x21b6f08f07a4390d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d76b6 expref: 168 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669307:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669308:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fcf71a66/0x21b6f08f07a438d5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d82a expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669310:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669310:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000015e4e4c1/0x21b6f08f07a437f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b46549 expref: 168 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669313:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669313:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c597a0ee/0x21b6f08f07a4374d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72b8d23 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669315:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669316:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e37a798d/0x21b6f08f07a43715 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce323f expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669318:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669318:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e889b7/0x21b6f08f07a4366d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e2f31c expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669321:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669322:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b6d521b1/0x21b6f08f07a43547 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b947334 expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669324:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669324:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a235a07b/0x21b6f08f07a434e5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c74291e4be expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669327:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669327:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004be14df5/0x21b6f08f07a434ad lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097bde expref: 168 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669329:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669330:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b63fe483/0x21b6f08f07a4343d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b213 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669332:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669333:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c42d1145/0x21b6f08f07a43405 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f15 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669335:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669336:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000007dce830/0x21b6f08f07a43395 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7f80bf expref: 169 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669338:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669338:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000665803a7/0x21b6f08f07a4335d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0a0 expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669341:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669341:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba4569f0/0x21b6f08f07a432b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d51 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669344:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669345:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000024e86162/0x21b6f08f07a4320d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640458 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669347:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669347:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077dadcee/0x21b6f08f07a4313b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf343f expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669350:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669351:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e00868b4/0x21b6f08f07a430bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9ec3 expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669352:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669353:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c8ab43d/0x21b6f08f07a43077 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402766 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669355:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669356:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003282cc45/0x21b6f08f07a42fb3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc358 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669358:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669359:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdb56afa/0x21b6f08f07a42f6d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91db2 expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669361:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669362:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005b60e145/0x21b6f08f07a42f58 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abdda expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669364:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669365:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b647835/0x21b6f08f07a42e0f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f167241e expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669368:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669369:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000533e255e/0x21b6f08f07a42ca3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13bb expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669371:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669372:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d107e383/0x21b6f08f07a42c72 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1419 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669374:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669375:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bba003cb/0x21b6f08f07a42c25 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e85d expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669377:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669378:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058510f52/0x21b6f08f07a42bc3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c3c expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669380:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669380:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6aef473/0x21b6f08f07a42b6f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bcdb expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669382:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669383:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000018aacd08/0x21b6f08f07a42b0d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc6d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669385:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669386:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b44cfcaf/0x21b6f08f07a42a57 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3116 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669388:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669389:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000eedf511e/0x21b6f08f07a42a2d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b5581d6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669392:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669392:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006c099989/0x21b6f08f07a429bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021cf5 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669394:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669395:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009510a3ed/0x21b6f08f07a428dd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f417f4 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669398:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669399:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075c9b092/0x21b6f08f07a428a5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f29151 expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669400:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669401:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0e3edc1/0x21b6f08f07a4285f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d2b expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669403:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669404:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000229ed045/0x21b6f08f07a427e1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e489 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669406:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669407:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000642824fc/0x21b6f08f07a427a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a801 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669409:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669410:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030630977/0x21b6f08f07a4270f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783ed9 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669412:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669412:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bfae6641/0x21b6f08f07a426c9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e03 expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669415:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669416:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a51e53e/0x21b6f08f07a4269f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e847 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669418:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669419:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e1ea11f/0x21b6f08f07a4239d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c6407e expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669421:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669422:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f228136d/0x21b6f08f07a42357 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc02 expref: 17 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669424:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669425:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b4a1ece/0x21b6f08f07a422f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d46323 expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669427:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669428:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003a9be4c0/0x21b6f08f07a42285 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3def expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669429:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669430:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d7e332f2/0x21b6f08f07a4216d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3bf2 expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669433:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669433:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000aeaba9c/0x21b6f08f07a42135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f2c expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669435:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669436:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005204d230/0x21b6f08f07a420fd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1c3 expref: 10 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669441:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669442:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e88ad3d/0x21b6f08f07a4208d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cb4 expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669444:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669445:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000036e9d93d/0x21b6f08f07a41a19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f733806e expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669447:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669448:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033fd848f/0x21b6f08f07a41511 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbc7 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669450:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669451:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008300d2dc/0x21b6f08f07a3f226 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b569 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669453:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669454:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006dd6a30d/0x21b6f08f0305c204 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd04018682df expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669456:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669457:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001e1b6670/0x21b6f08f0305a325 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43e0e303 expref: 167 pid: 59127 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669459:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669459:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d38b93/0x21b6f08f0301ae2b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac053 expref: 165 pid: 60479 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669461:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669462:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002c1870de/0x21b6f08f02faff53 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f1e expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669466:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669467:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008b2c615f/0x21b6f08f02e26be2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644c3 expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669469:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669470:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002b043c48/0x21b6f08f02dbf7bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b83403d expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669472:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669473:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000022edf7e1/0x21b6f08f02db30bd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7f0ed30 expref: 164 pid: 61315 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669474:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669475:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000028bc8bf1/0x21b6f08f02db2580 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c148 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669477:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669478:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008fbdff09/0x21b6f08f02cc4bd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111708 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669480:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669481:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b2400217/0x21b6f08f02c839c6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c0931 expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669483:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669484:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062863d65/0x21b6f08f02b3fafc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76d1 expref: 166 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669486:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669487:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9a154e7/0x21b6f08f02b3e4cf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a35 expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669490:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669491:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006f03ebeb/0x21b6f08f02b165b4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e4e4 expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669493:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669494:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3d1f2bf/0x21b6f08f02a70ef7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d388293f expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669496:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669497:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000061c269aa/0x21b6f08f02996574 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce42 expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669499:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669500:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4de340/0x21b6f08f0295ba8d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa28 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669502:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669503:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008da5689a/0x21b6f08f02947fd3 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b6828e expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669505:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669506:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000434a91db/0x21b6f08f0293fd5e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f2e0 expref: 165 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669508:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669508:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000627ecd7b/0x21b6f08f0293fb04 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d717 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669511:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669511:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec2a2d1/0x21b6f08f0293840b lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dac9c expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669516:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669517:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005da6b528/0x21b6f08f02938133 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe0b06fa expref: 167 pid: 41177 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669518:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669519:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c694721f/0x21b6f08f028de194 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276cf7 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669521:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669522:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004bf2a6b8/0x21b6f08f028de098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac34 expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669524:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669525:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec695b1f/0x21b6f08f028d95e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4c4 expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669527:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669528:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008eac6802/0x21b6f08f0289daf0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e0504 expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669530:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669531:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd830a43/0x21b6f08f02883098 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabad expref: 22 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669533:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669533:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000077bd28ba/0x21b6f08f02882f5d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd03062 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669535:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669536:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000080f24a76/0x21b6f08f0283d3f5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd4d expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669539:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669540:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de99ea96/0x21b6f08f027f5731 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679ed3 expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669542:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669543:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008bfe5d45/0x21b6f08f027f5627 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a7f5 expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669545:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669546:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b7c7ff0b/0x21b6f08f027f3bcb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc86b expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669548:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669549:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000234c2301/0x21b6f08f027c550e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f8777819ea expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669551:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669552:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007b5f64dc/0x21b6f08f027411e8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b27a expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669554:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669555:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb1693b/0x21b6f08f02531468 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24546@kfi7 remote: 0x9d665c6b5ac55ccd expref: 26 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669557:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669558:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000058750430/0x21b6f08f024b1c19 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328adea035cc expref: 21 pid: 60703 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669560:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669560:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ea9ac4d/0x21b6f08f0245f66e lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b6e expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669564:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669565:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006e83dfb9/0x21b6f08f0245f499 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e5634dd expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669567:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669568:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000930e9f66/0x21b6f08f02245555 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec69c expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669570:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669571:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000190dbae4/0x21b6f08f021eac24 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a414e9 expref: 168 pid: 60950 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669573:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669574:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000035387eff/0x21b6f08f01438c1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c12659828460f expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669576:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669577:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c30931b2/0x21b6f08f013c969c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e66 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669579:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669580:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007662a7b4/0x21b6f08f013b2a9c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5e8e expref: 166 pid: 59137 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669582:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669583:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003c900978/0x21b6f08f0133f352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0f96 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669585:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669586:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000559e2b87/0x21b6f08f012c1fd1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b3b expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669588:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669589:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed8c1b6/0x21b6f08f00e2f601 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814a9 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669591:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669592:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000395fad4f/0x21b6f08f00c4f3b2 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be010c expref: 166 pid: 41183 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669594:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669595:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000dbac42bd/0x21b6f08f0084f53c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80a8 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669597:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669598:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004cde275c/0x21b6f08f003e72dc lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a8706db expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669600:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669600:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043f6914f/0x21b6f08f0031dd1c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb269fb expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669603:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669603:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe4edf59/0x21b6f08f000f1745 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2ed9 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669605:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669606:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de7450bd/0x21b6f08effdbc0b7 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb198 expref: 166 pid: 60545 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669608:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669609:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007a0468fa/0x21b6f08effdab1a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c860 expref: 165 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669611:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669612:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004a63f733/0x21b6f08effdaac45 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c0941f expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669614:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669615:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048b56ebd/0x21b6f08effb44fae lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e1a expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669617:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669618:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086eba05c/0x21b6f08effb44eea lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc53654 expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669620:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669620:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cef3559/0x21b6f08effb413f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc440 expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669622:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669623:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000102b91e7/0x21b6f08effb390a1 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650ca expref: 167 pid: 60675 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669626:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669626:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000048a8395e/0x21b6f08effa8f064 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc21 expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669628:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669629:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000097796262/0x21b6f08eff5ca0de lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa1786 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669631:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669632:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004349accd/0x21b6f08efefa5a44 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec8267141 expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669634:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669635:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089a3873d/0x21b6f08efefa594f lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a12 expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669637:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669637:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bed424bc/0x21b6f08efec34860 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e544571 expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669640:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669641:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009683e655/0x21b6f08efec34622 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c85d expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669642:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669643:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c4a8c271/0x21b6f08efeb89b03 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb054d expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669645:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669646:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000acebd2f2/0x21b6f08efe87d5cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c50 expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669648:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669649:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045f79a03/0x21b6f08efe335f52 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f51 expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669651:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669652:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aafa0e93/0x21b6f08efe1ebeab lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13a9f expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669654:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669655:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b87ffcf/0x21b6f08efde3800c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a6e7 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669657:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669658:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983ddb8f/0x21b6f08efd22a169 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644d5 expref: 159 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669660:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669661:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001bbb363b/0x21b6f08efccf1f4d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6ef2 expref: 165 pid: 60985 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669663:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669664:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f0cac1b/0x21b6f08efccf1cbb lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad067c expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669666:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669666:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007eeae201/0x21b6f08efc27c682 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c291 expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669668:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669669:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f880488e/0x21b6f08efc075683 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f11f expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669671:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669672:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064663138/0x21b6f08eebf3dafe lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15619@kfi7 remote: 0x13421e61c30bde08 expref: 611 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669674:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669675:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003d4233c3/0x21b6f08eebf3c98c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17889@kfi7 remote: 0x1ef17fc52ebbf3eb expref: 3755 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669677:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669678:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ab46645d/0x21b6f08eebf3b932 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17971@kfi7 remote: 0xc543b1e2ea95117f expref: 40 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669680:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669681:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004394beb3/0x21b6f08eebf3b2a9 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20592@kfi7 remote: 0x18e250fbde9ea5b4 expref: 4237 pid: 42865 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669683:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669684:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b10dcaa/0x21b6f08eebf3a76c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18514@kfi7 remote: 0x48cb1912931daa5 expref: 3759 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669686:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669687:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000cbf3adec/0x21b6f08eebf3a3fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12195@kfi7 remote: 0x3b28c707cf1a3fb9 expref: 4124 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669689:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669690:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf120284/0x21b6f08eebf36ce8 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 18642@kfi7 remote: 0xdde2e53e9425ee44 expref: 2105 pid: 60746 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669692:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669693:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ab75320/0x21b6f08eebf30f79 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20754@kfi7 remote: 0x6f664a4b13b0c4f7 expref: 3467 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669695:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669695:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000003506123/0x21b6f08eebf307b5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21040@kfi7 remote: 0x770725b1bd1dec70 expref: 328 pid: 60770 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669698:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669698:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c29bc004/0x21b6f08eebf2c597 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15522@kfi7 remote: 0x25de49ee18984b72 expref: 1289 pid: 60827 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669701:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669701:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c13d7f65/0x21b6f08eebf249c0 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8992@kfi7 remote: 0x3c373a20ade2d5db expref: 778 pid: 60737 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669705:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669705:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012f20f7d/0x21b6f08eebf21070 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9122@kfi7 remote: 0xc728d2a5c5d3fb69 expref: 60 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669708:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669709:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a7b515ec/0x21b6f08eebf1e352 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9811@kfi7 remote: 0x51399c0e767f1e8e expref: 673 pid: 61034 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669711:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669712:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0fe4b41/0x21b6f08eebf1b714 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 19585@kfi7 remote: 0xac28c055d64feab7 expref: 428 pid: 59129 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669714:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669715:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001467eb80/0x21b6f08eebf162ff lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 26323@kfi7 remote: 0xfb8778c7a5ddf430 expref: 163 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669717:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669718:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e958f908/0x21b6f08eebf14e84 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 9809@kfi7 remote: 0xeaa3e1844a5c82d9 expref: 433 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669720:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669720:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000711f009d/0x21b6f08eebf1454d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15426@kfi7 remote: 0x63ad21a368759ff1 expref: 65 pid: 41817 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669723:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669723:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a5b55674/0x21b6f08eebf120f6 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22002@kfi7 remote: 0x2edc118d7e3fab76 expref: 21 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669729:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669729:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000c717dd5/0x21b6f08eebf0d74c lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20321@kfi7 remote: 0x20792502a3a2e833 expref: 311 pid: 61082 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669732:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669733:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fc71efd8/0x21b6f08eebf0d657 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 15088@kfi7 remote: 0xc19807591e59092b expref: 3364 pid: 60886 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669735:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669735:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec2e4d25/0x21b6f08eebf0a637 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21667@kfi7 remote: 0xee984c5c06f68661 expref: 3931 pid: 60795 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669738:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669738:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef29333a/0x21b6f08eebf0a3e4 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22146@kfi7 remote: 0x2216305c804c9b49 expref: 3452 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669740:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669741:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002ca9276e/0x21b6f08eebf099bf lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 14498@kfi7 remote: 0x7526978f5835e99b expref: 3831 pid: 61110 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669743:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669744:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccd310fc/0x21b6f08eebf0876d lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 12128@kfi7 remote: 0xe6e41db47617a55e expref: 3500 pid: 60571 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669746:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669747:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001a7d163d/0x21b6f08eebf07808 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 10482@kfi7 remote: 0x29e88e8130897197 expref: 3569 pid: 60750 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669749:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669750:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f325fe05/0x21b6f08eebf076cd lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20594@kfi7 remote: 0x64bd0b9dbc0c120 expref: 3832 pid: 60509 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669752:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669752:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ad3466af/0x21b6f08eebf070fa lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 22675@kfi7 remote: 0xef1050c817e34f87 expref: 3489 pid: 61056 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669755:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669756:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002936de2c/0x21b6f08eebf06952 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21585@kfi7 remote: 0xc7965a50b814a1d expref: 4083 pid: 61170 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669758:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669759:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033c6dca6/0x21b6f08eebf05ef5 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 20337@kfi7 remote: 0xd66f8f3577d5770 expref: 3935 pid: 42862 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669761:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669762:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ec65f313/0x21b6f08eebf05707 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25233@kfi7 remote: 0x14ca43c75b756200 expref: 4098 pid: 61180 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669764:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669765:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d44dbc2e/0x21b6f08eebf05245 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 17539@kfi7 remote: 0xd2762350a90d9b43 expref: 2659 pid: 61021 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669767:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669767:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000969c1512/0x21b6f08eebf04985 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 25154@kfi7 remote: 0x5cabcb8497e0e099 expref: 1566 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669769:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669770:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000033f37ac3/0x21b6f08eebf04190 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 11312@kfi7 remote: 0xf61d7dd1125e4f1f expref: 2188 pid: 60667 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669772:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:26.0:1773851901.669773:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd031381/0x21b6f08eebf04135 lrc: 2/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 21442@kfi7 remote: 0x2f50bce2fd053e27 expref: 1003 pid: 60933 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669775:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00010000:26.0:1773851901.669776:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000000a72d08f/0x21b6f08f07a6aeea lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669778:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851901.669779:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:26.0:1773851901.669779:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851901.669780:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669780:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:26.0:1773851901.669781:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669781:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669782:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.669782:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:26.0:1773851901.669783:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.669783:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000000a72d08f/0x21b6f08f07a6aeea lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669786:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851901.669786:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:26.0:1773851901.669787:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669787:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669787:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669788:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669788:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000a72d08f refcount=3
00000020:00000001:26.0:1773851901.669789:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000001:26.0:1773851901.669789:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000001:26.0:1773851901.669790:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669790:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.669791:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669792:0:41182:0:(osp_object.c:1386:osp_invalidate()) Process entered
00000004:00080000:26.0:1773851901.669792:0:41182:0:(osp_object.c:1389:osp_invalidate()) Invalidate osp_object [0x2800256ea:0x3d:0x0]
00000004:00000001:26.0:1773851901.669793:0:41182:0:(osp_object.c:1408:osp_invalidate()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669794:0:41182:0:(mdt_handler.c:3920:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669794:0:41182:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:26.0:1773851901.669795:0:41182:0:(mdt_handler.c:1372:mdt_getattr_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000001:26.0:1773851901.669796:0:41182:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:26.0:1773851901.669797:0:41182:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669798:0:41182:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669799:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669799:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669800:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000a72d08f refcount=3
00000020:00000001:26.0:1773851901.669800:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000001:26.0:1773851901.669801:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00000004:00010000:26.0:1773851901.669801:0:41182:0:(mdt_handler.c:2353:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre5-MDT0001_UUID lock: 000000000a72d08f/0x21b6f08f07a6aeea lrc: 3/1,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669803:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851901.669804:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669804:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.669805:0:41182:0:(mdt_handler.c:2389:mdt_getattr_name_lock()) Process leaving
00000004:00000001:26.0:1773851901.669805:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:26.0:1773851901.669806:0:41182:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:26.0:1773851901.669807:0:41182:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:26.0:1773851901.669807:0:41182:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:26.0:1773851901.669808:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:26.0:1773851901.669808:0:41182:0:(mdt_handler.c:4077:mdt_object_unlock()) Process entered
00000004:00000001:26.0:1773851901.669809:0:41182:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:26.0:1773851901.669809:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669810:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669810:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000017380f27 refcount=3
00000020:00000001:26.0:1773851901.669810:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:26.0:1773851901.669811:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:26.0:1773851901.669812:0:41182:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:26.0:1773851901.669813:0:41182:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 3/1,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669815:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.669815:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669816:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:26.0:1773851901.669816:0:41182:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 2/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669821:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.669822:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.669822:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669823:0:41182:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:26.0:1773851901.669823:0:41182:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669825:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00010000:26.0:1773851901.669826:0:41182:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 0000000017380f27 already unused, calling callback (000000001690cbe4)
00000004:00000001:26.0:1773851901.669827:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851901.669827:0:41182:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:26.0:1773851901.669828:0:41182:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 3/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669830:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.669830:0:41182:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:26.0:1773851901.669831:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669831:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669832:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 0000000017380f27 refcount=4
00000020:00000001:26.0:1773851901.669832:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:26.0:1773851901.669833:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637028277642816 : -107045431908800 : ffff9ea48b0e6640)
00010000:00000001:26.0:1773851901.669834:0:41182:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:26.0:1773851901.669834:0:41182:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 4/0,0 mode: CR/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669836:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.669837:0:41182:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:26.0:1773851901.669837:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:26.0:1773851901.669837:0:41182:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669838:0:41182:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851901.669839:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851901.669840:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.669840:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851901.669841:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 0000000017380f27 with handle 0x21b6f08f07a6aedc from hash
00010000:00000001:26.0:1773851901.669842:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851901.669842:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669842:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669843:0:41182:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851901.669843:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851901.669844:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669844:0:41182:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851901.669845:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851901.669845:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851901.669846:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00010000:26.0:1773851901.669847:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:26.0:1773851901.669848:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669848:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669849:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:26.0:1773851901.669850:0:41182:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:26.0:1773851901.669850:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669851:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669851:0:41182:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669852:0:41182:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669853:0:41182:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.669853:0:41182:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 2/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669855:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000001:26.0:1773851901.669856:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669856:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669857:0:41182:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:26.0:1773851901.669857:0:41182:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:26.0:1773851901.669857:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851901.669858:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 0000000017380f27/0x21b6f08f07a6aedc lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 197 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669860:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 196
00010000:00000010:26.0:1773851901.669861:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000005581b56b.
00010000:00000040:26.0:1773851901.669862:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000001:26.0:1773851901.669863:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.669863:0:41182:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:26.0:1773851901.669863:0:41182:0:(mdt_handler.c:3971:mdt_save_lock()) Process entered
00010000:00000001:26.0:1773851901.669864:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669864:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669865:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008018faef refcount=3
00000020:00000001:26.0:1773851901.669866:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000001:26.0:1773851901.669866:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000001:26.0:1773851901.669867:0:41182:0:(ldlm_lock.c:848:ldlm_lock_decref_internal()) Process entered
00010000:00010000:26.0:1773851901.669867:0:41182:0:(ldlm_lock.c:820:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 3/1,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669869:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669870:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669870:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:26.0:1773851901.669871:0:41182:0:(ldlm_lock.c:879:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 2/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669873:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669873:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.669874:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669874:0:41182:0:(ldlm_lockd.c:1877:ldlm_handle_bl_callback()) Process entered
00010000:00010000:26.0:1773851901.669875:0:41182:0:(ldlm_lockd.c:1879:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669877:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00010000:26.0:1773851901.669877:0:41182:0:(ldlm_lockd.c:1893:ldlm_handle_bl_callback()) Lock 000000008018faef already unused, calling callback (000000001690cbe4)
00000004:00000001:26.0:1773851901.669878:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00010000:00000001:26.0:1773851901.669878:0:41182:0:(ldlm_request.c:354:ldlm_blocking_ast_nocheck()) Process entered
00010000:00010000:26.0:1773851901.669879:0:41182:0:(ldlm_request.c:364:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 3/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669892:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669893:0:41182:0:(ldlm_request.c:1577:ldlm_cli_cancel()) Process entered
00010000:00000001:26.0:1773851901.669893:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669894:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669894:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000008018faef refcount=4
00000020:00000001:26.0:1773851901.669895:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000001:26.0:1773851901.669895:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637159628434112 : -106914081117504 : ffff9ec3202c6ac0)
00010000:00000001:26.0:1773851901.669896:0:41182:0:(ldlm_request.c:1227:ldlm_cli_cancel_local()) Process entered
00010000:00010000:26.0:1773851901.669896:0:41182:0:(ldlm_request.c:1257:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 4/0,0 mode: PR/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669898:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669899:0:41182:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000004:00000001:26.0:1773851901.669900:0:41182:0:(mdt_handler.c:3511:mdt_blocking_ast()) Process entered
00000004:00000001:26.0:1773851901.669900:0:41182:0:(mdt_handler.c:3514:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669900:0:41182:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:26.0:1773851901.669901:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851901.669901:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.669902:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851901.669902:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000008018faef with handle 0x21b6f08f07a6aee3 from hash
00010000:00000001:26.0:1773851901.669903:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851901.669903:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669904:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669904:0:41182:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:26.0:1773851901.669905:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851901.669905:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669905:0:41182:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:26.0:1773851901.669906:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851901.669906:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851901.669906:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0xba093aa3 (000000003bcbed33)
00010000:00010000:26.0:1773851901.669907:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 2
00010000:00000001:26.0:1773851901.669908:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669909:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669909:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:26.0:1773851901.669910:0:41182:0:(ldlm_request.c:1263:ldlm_cli_cancel_local()) Process leaving (rc=137438953472 : 137438953472 : 2000000000)
00010000:00000001:26.0:1773851901.669911:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669911:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669911:0:41182:0:(ldlm_request.c:1616:ldlm_cli_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669912:0:41182:0:(ldlm_request.c:373:ldlm_blocking_ast_nocheck()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669913:0:41182:0:(mdt_handler.c:3569:mdt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.669913:0:41182:0:(ldlm_lockd.c:1903:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 2/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669915:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000001:26.0:1773851901.669916:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669916:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669916:0:41182:0:(ldlm_lockd.c:1905:ldlm_handle_bl_callback()) Process leaving
00010000:00000001:26.0:1773851901.669917:0:41182:0:(ldlm_lock.c:913:ldlm_lock_decref_internal()) Process leaving
00010000:00000001:26.0:1773851901.669917:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851901.669918:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000008018faef/0x21b6f08f07a6aee3 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0xba093aa3 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669920:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 1
00010000:00000010:26.0:1773851901.669920:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000001001fa8.
00010000:00000040:26.0:1773851901.669921:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000003bcbed33 count: 0
00010000:00000010:26.0:1773851901.669922:0:41182:0:(ldlm_resource.c:1484:ldlm_resource_free()) kfreed 'res->lr_ibits_queues': 112 at 00000000043dbba8.
00010000:00000001:26.0:1773851901.669923:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.669923:0:41182:0:(mdt_handler.c:4016:mdt_save_lock()) Process leaving
00000004:00000001:26.0:1773851901.669923:0:41182:0:(mdt_handler.c:4034:mdt_save_remote_lock()) Process entered
00000004:00000001:26.0:1773851901.669924:0:41182:0:(mdt_handler.c:4057:mdt_save_remote_lock()) Process leaving
00000004:00000001:26.0:1773851901.669924:0:41182:0:(mdt_handler.c:4084:mdt_object_unlock()) Process leaving
00010000:00000001:26.0:1773851901.669925:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.669925:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.669925:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000a72d08f refcount=3
00000020:00000001:26.0:1773851901.669926:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000001:26.0:1773851901.669926:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00000004:00000040:26.0:1773851901.669927:0:41182:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000002338620b : new locks_count 5
00000020:00000040:26.0:1773851901.669929:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002338620b refcount=11
00010000:00000001:26.0:1773851901.669930:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669931:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.669931:0:41182:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851901.669932:0:41182:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:26.0:1773851901.669932:0:41182:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:26.0:1773851901.669932:0:41182:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:26.0:1773851901.669933:0:41182:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:26.0:1773851901.669933:0:41182:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:26.0:1773851901.669934:0:41182:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:26.0:1773851901.669934:0:41182:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:26.0:1773851901.669935:0:41182:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.669935:0:41182:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851901.669936:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:26.0:1773851901.669936:0:41182:0:(lu_object.c:224:lu_object_put()) Add 00000000459be8a2/00000000bd20113f to site lru. bkt: 00000000a44f0a1e
00000004:00000001:26.0:1773851901.669937:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:26.0:1773851901.669938:0:41182:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:26.0:1773851901.669938:0:41182:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:26.0:1773851901.669939:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851901.669939:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669940:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669940:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.669940:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851901.669941:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000003ea221cf with handle 0x21b6f08f07a6aed5 from hash
00010000:00000001:26.0:1773851901.669942:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851901.669942:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669942:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669943:0:41182:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:26.0:1773851901.669943:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851901.669944:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000003ea221cf/0x21b6f08f07a6aed5 lrc: 0/0,0 mode: --/CR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2cd expref: 11 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669946:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:26.0:1773851901.669947:0:41182:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002338620b : new locks_count 4
00000020:00000040:26.0:1773851901.669947:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 10
00010000:00000010:26.0:1773851901.669948:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002e11f02b.
00010000:00000040:26.0:1773851901.669949:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:26.0:1773851901.669950:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.669950:0:41182:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669951:0:41182:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:26.0:1773851901.669952:0:41182:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000000a72d08f/0x21b6f08f07a6aeea lrc: 3/0,0 mode: PR/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2cd expref: 10 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.669954:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:26.0:1773851901.669955:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851901.669955:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851901.669956:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00010000:26.0:1773851901.669956:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 1
00010000:00000001:26.0:1773851901.669957:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.669957:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.669958:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:26.0:1773851901.669958:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.669959:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:26.0:1773851901.669959:0:41182:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000000a72d08f, rc 0)
00000020:00000001:26.0:1773851901.669960:0:41182:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851901.669960:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183110002015, transno 0, xid 1859313734890176
00010000:00000001:26.0:1773851901.669961:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851901.669962:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000144e137a x1859313734890176/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 584/640 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00010000:00000001:26.0:1773851901.669965:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851901.669965:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851901.669966:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=134 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851901.669967:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851901.669968:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:26.0:1773851901.669969:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:26.0:1773851901.669970:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851901.669970:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.669971:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851901.669972:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8946@kfi7
00000400:00000010:26.0:1773851901.669973:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e24181d3.
00000100:00000200:26.0:1773851901.669974:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859313734890176, offset 224
00000400:00000200:26.0:1773851901.669975:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8946@kfi7
00000400:00000200:26.0:1773851901.669976:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.669977:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000400:00000200:26.0:1773851901.669978:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.669979:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:26.0:1773851901.669981:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8946@kfi7 local destination
00000400:00000200:26.0:1773851901.669982:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770392:8770392:1024:4294967295] 8946@kfi7 LPNI seq info [5400474:5400474:16:4294967295]
00000400:00000200:26.0:1773851901.669983:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.669984:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.669986:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8946@kfi7(8946@kfi7:8946@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851901.669987:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000800:00000200:26.0:1773851901.669989:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.669990:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:26.0:1773851901.669992:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851901.669995:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Using peer 8946@kfi7(0xf82)
00000800:00000200:26.0:1773851901.669998:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001c682e34: Posted send of 740 bytes to peer 0xf82: rc=0
00000800:00000200:26.0:1773851901.669999:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.670001:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.670001:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:26.0:1773851901.670002:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851901.670003:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.670004:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851901.670004:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000144e137a x1859313734890176/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 584/640 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00000100:00100000:26.0:1773851901.670007:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000144e137a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+10:2028291:x1859313734890176:12345-8754@kfi7:101:default-tuolumne1033-0 Request processed in 1680us (1709us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851901.670010:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 1451911044
00000100:00000040:26.0:1773851901.670011:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 0
00000100:00000001:26.0:1773851901.670012:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851901.670012:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851901.670012:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851901.670013:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000400:00000200:25.0:1773851901.670013:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851901.670014:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000400:00000200:25.0:1773851901.670014:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00000020:00000010:26.0:1773851901.670015:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f5cb6f5.
00000020:00000040:26.0:1773851901.670015:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 9
00000400:00000200:25.0:1773851901.670015:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e24181d3
00000400:00000010:25.0:1773851901.670015:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e24181d3.
00000100:00000001:26.0:1773851901.670016:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851901.670016:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851901.670017:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851901.670017:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000800:00000200:25.0:1773851901.670019:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001c682e34: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Transaction freed
00000800:00000200:13.0:1773851901.670173:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851901.670175:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851901.670176:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851901.670178:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851901.670180:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.670181:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8754@kfi7 : PUT - for me
00000400:00000200:13.0:1773851901.670182:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.670183:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000400:00000200:13.0:1773851901.670184:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.670184:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:13.0:1773851901.670185:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000400:00000200:13.0:1773851901.670186:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.670187:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 328 into portal 17 MB=0x69b0936b1b340
00000400:00000200:13.0:1773851901.670188:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8754@kfi7 of length 328/328 into md 0x82a56312d [2] + 1096
00000800:00000200:13.0:1773851901.670190:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851901.670191:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.670192:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000100:00000001:13.0:1773851901.670193:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851901.670194:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:13.0:1773851901.670195:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000056d1a7b1.
00000100:00000040:13.0:1773851901.670195:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000056d1a7b1 x1859313734890304 msgsize 328
00000100:00100000:13.0:1773851901.670197:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8754@kfi7)
00000100:00000001:13.0:1773851901.670198:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851901.670198:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000100:00000001:12.0:1773851901.670199:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851901.670200:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851901.670200:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851901.670200:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851901.670201:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851901.670201:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851901.670202:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734890304
00000020:00000001:12.0:1773851901.670203:0:609420:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851901.670203:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:12.0:1773851901.670204:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.670205:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=10
00000020:00000001:12.0:1773851901.670205:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000001:12.0:1773851901.670206:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000100:00000001:12.0:1773851901.670207:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.670207:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851901.670208:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00000020:00000010:12.0:1773851901.670209:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.670210:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000040:12.0:1773851901.670211:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:12.0:1773851901.670212:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851901.670212:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:12.0:1773851901.670212:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:12.0:1773851901.670213:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.670214:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:12.0:1773851901.670214:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851901.670215:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.670215:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000a72d08f refcount=3
00000020:00000001:12.0:1773851901.670216:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000001:12.0:1773851901.670217:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000001:12.0:1773851901.670218:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.670218:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.670218:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.670219:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.670220:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.670221:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851901.670223:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851901.670223:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851901.670223:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851901.670223:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851901.670224:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 50273009
00000100:00000001:13.0:1773851901.670225:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.670225:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 1
00000100:00000001:12.0:1773851901.670225:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945714688 : -106919763836928 : ffff9ec1cd750000)
00000100:00000001:13.0:1773851901.670226:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.670227:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000056d1a7b1 x1859313734890304/t0(0) o103->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 328/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:12.0:1773851901.670231:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.670231:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851901.670232:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000056d1a7b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:5ac50477-c5c0-47ab-9937-99f367ea73c9+10:39848:x1859313734890304:12345-8754@kfi7:103:
00000100:00000200:12.0:1773851901.670234:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734890304
00010000:00000001:12.0:1773851901.670234:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00000800:00000200:25.0:1773851901.670235:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00010000:00000002:12.0:1773851901.670235:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:12.0:1773851901.670235:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000800:00000200:25.0:1773851901.670236:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:12.0:1773851901.670236:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851901.670236:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000800:00000200:25.0:1773851901.670237:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000010:12.0:1773851901.670237:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005f1c00e2.
02000000:00000001:12.0:1773851901.670238:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.670238:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851901.670239:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00010000:00000001:12.0:1773851901.670239:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:12.0:1773851901.670240:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:12.0:1773851901.670240:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851901.670240:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000800:00000200:26.0:1773851901.670241:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:25.0:1773851901.670241:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000020:00000040:12.0:1773851901.670241:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000a72d08f refcount=3
00000020:00000001:12.0:1773851901.670241:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00000800:00000200:27.0:1773851901.670242:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.670242:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000400:00000200:25.0:1773851901.670242:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8946@kfi7 : PUT - for me
00010000:00000001:12.0:1773851901.670242:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888896 : -107012697662720 : ffff9eac2a2b5b00)
00010000:00000040:12.0:1773851901.670242:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 230
00000800:00000200:27.0:1773851901.670243:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851901.670243:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000400:00000200:25.0:1773851901.670243:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000004:00000001:12.0:1773851901.670243:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851901.670243:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000400:00000200:25.0:1773851901.670244:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000020:00000001:12.0:1773851901.670244:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851901.670244:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00000800:00000200:27.0:1773851901.670245:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851901.670245:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8946@kfi7(000000002efd873d):0x11fe version: 2; local version 2; negotiated version: 2
00000400:00000200:25.0:1773851901.670245:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00010000:00000001:12.0:1773851901.670245:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.670245:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851901.670246:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe Using peer 8946@kfi7(0x1000000000011fe)
00000400:00000200:25.0:1773851901.670246:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:25.0:1773851901.670246:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00010000:00000001:12.0:1773851901.670246:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00000800:00000200:27.0:1773851901.670247:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851901.670247:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00010000:00000001:12.0:1773851901.670247:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00000400:00000200:26.0:1773851901.670248:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.670248:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 512 into portal 12 MB=0x69b0936b1b400
00010000:00000001:12.0:1773851901.670248:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.670248:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000400:00000200:27.0:1773851901.670249:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.670249:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8754@kfi7 of length 512/512 into md 0x16159c9699 [64] + 43176
00010000:00000001:12.0:1773851901.670249:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851901.670249:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851901.670250:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8946@kfi7 : PUT - for me
00000800:00000200:26.0:1773851901.670250:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001c682e34: Posted send of 38 bytes to peer 0x1000000000011fe: rc=0
00000020:00000040:12.0:1773851901.670250:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000000a72d08f with handle 0x21b6f08f07a6aeea from hash
00000400:00000200:27.0:1773851901.670251:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000800:00000200:26.0:1773851901.670251:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:25.0:1773851901.670251:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00010000:00000001:12.0:1773851901.670251:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00000400:00000200:27.0:1773851901.670252:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00010000:00000001:12.0:1773851901.670252:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.670252:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.670252:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00000400:00000200:27.0:1773851901.670253:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:27.0:1773851901.670253:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:25.0:1773851901.670253:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00010000:00000001:12.0:1773851901.670253:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851901.670253:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:27.0:1773851901.670254:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 4
00000400:00000200:25.0:1773851901.670254:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00010000:00000001:12.0:1773851901.670254:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00000400:00000200:27.0:1773851901.670255:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000100:00000001:25.0:1773851901.670255:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851901.670255:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00010000:00000001:12.0:1773851901.670255:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851901.670255:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000000a72d08f/0x21b6f08f07a6aeea lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 231 type: IBT gid 0 flags: 0x44a01000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2cd expref: 10 pid: 41182 timeout: 0 lvb_type: 0
00000400:00000200:27.0:1773851901.670256:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 224 into portal 12 MB=0x69b0936b1b380
00000100:00000010:25.0:1773851901.670256:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000af4d4c55.
00000100:00000040:25.0:1773851901.670257:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000af4d4c55 x1859313734890496 msgsize 512
00000400:00000200:27.0:1773851901.670258:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8754@kfi7 of length 224/224 into md 0x16159c9699 [64] + 43688
00000100:00100000:25.0:1773851901.670258:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8946@kfi7)
00010000:00000040:12.0:1773851901.670258:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 230
00000800:00000200:27.0:1773851901.670259:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851901.670259:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00010000:00000040:12.0:1773851901.670259:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002338620b : new locks_count 3
00000100:00000001:26.0:1773851901.670260:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:25.0:1773851901.670260:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000020:00000040:12.0:1773851901.670260:0:609420:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 9
00000400:00000200:27.0:1773851901.670261:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
02000000:00000001:26.0:1773851901.670261:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851901.670261:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00010000:00000010:12.0:1773851901.670261:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000e4682501.
00000400:00000200:27.0:1773851901.670262:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8946@kfi7: PUT: OK
00000100:00000001:26.0:1773851901.670262:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851901.670262:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851901.670262:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000001:12.0:1773851901.670262:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000100:00000001:27.0:1773851901.670263:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851901.670263:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
02000000:00000001:26.0:1773851901.670263:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851901.670263:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe TN_EVENT_TX_OK event status 0
00010000:00000001:12.0:1773851901.670263:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851901.670263:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00000100:00000010:27.0:1773851901.670264:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b8144ec5.
00000100:00100000:26.0:1773851901.670264:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734890496
00000020:00000001:26.0:1773851901.670264:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00010000:00010000:12.0:1773851901.670264:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00000100:00000040:27.0:1773851901.670265:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000b8144ec5 x1859313734890368 msgsize 224
00000020:00000040:26.0:1773851901.670265:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000800:00000200:25.0:1773851901.670265:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000001c682e34: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe Transaction freed
00010000:00000001:12.0:1773851901.670265:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:27.0:1773851901.670266:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8946@kfi7)
00000020:00000001:26.0:1773851901.670266:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.670266:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=10
00010000:00000001:12.0:1773851901.670266:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.670266:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00000100:00000001:27.0:1773851901.670267:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000001:26.0:1773851901.670267:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00010000:00000040:12.0:1773851901.670267:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00010000:12.0:1773851901.670267:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00000400:00000200:27.0:1773851901.670268:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000020:00000001:26.0:1773851901.670268:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00010000:00000001:12.0:1773851901.670268:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.670269:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.670269:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:24.0:1773851901.670269:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851901.670269:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00010000:00000001:12.0:1773851901.670269:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851901.670269:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:27.0:1773851901.670270:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000020:00000010:26.0:1773851901.670270:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f5cb6f5.
00000100:00000001:24.0:1773851901.670270:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851901.670270:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851901.670270:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=5 v=66 (1 1 1 1)
00000020:00000010:26.0:1773851901.670271:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000043dbba8.
02000000:00000001:24.0:1773851901.670271:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.670271:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000020:00000010:26.0:1773851901.670272:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00100000:24.0:1773851901.670272:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734890368
00000020:00000001:24.0:1773851901.670272:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000100:00000040:12.0:1773851901.670272:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:26.0:1773851901.670273:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851901.670273:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000020:00000040:24.0:1773851901.670273:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:24.0:1773851901.670273:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:12.0:1773851901.670273:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:12.0:1773851901.670273:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000001:26.0:1773851901.670274:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:24.0:1773851901.670274:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=11
02000000:00000001:12.0:1773851901.670274:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670275:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851901.670275:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000100:00000001:12.0:1773851901.670275:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851901.670275:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8754@kfi7
00000100:00000001:26.0:1773851901.670276:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851901.670276:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000400:00000010:12.0:1773851901.670276:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f7dab02.
00000100:00000001:26.0:1773851901.670277:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851901.670277:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000200:12.0:1773851901.670277:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859313734890304, offset 224
00000100:00000001:26.0:1773851901.670278:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851901.670278:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851901.670278:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000dae1f2b1.
00000400:00000200:12.0:1773851901.670278:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8754@kfi7
00000100:00100000:26.0:1773851901.670279:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 1451911045
00000100:00000001:25.0:1773851901.670279:0:60844:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000020:00000010:24.0:1773851901.670279:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000400:00000200:12.0:1773851901.670279:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000100:00000040:26.0:1773851901.670280:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 2
00000100:00000001:26.0:1773851901.670280:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636951520146688 : -107122189404928 : ffff9e92abf3f500)
00000100:00000001:25.0:1773851901.670280:0:60844:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851901.670280:0:60844:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:24.0:1773851901.670280:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000400:00000200:12.0:1773851901.670280:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000100:00000040:26.0:1773851901.670281:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000af4d4c55 x1859313734890496/t0(0) o36->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 512/0 e 0 to 0 dl 1773852297 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1033-0'
00000100:00000001:25.0:1773851901.670281:0:60844:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851901.670281:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851901.670281:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000400:00000200:12.0:1773851901.670281:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:12.0:1773851901.670282:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000100:00000001:24.0:1773851901.670283:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851901.670283:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8754@kfi7 local destination
00000100:00000001:26.0:1773851901.670284:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851901.670284:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670285:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00000001:24.0:1773851901.670285:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:12.0:1773851901.670285:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770393:8770393:1024:4294967295] 8754@kfi7 LPNI seq info [5400475:5400475:16:4294967295]
00000100:00100000:26.0:1773851901.670286:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af4d4c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+11:2028291:x1859313734890496:12345-8754@kfi7:36:default-tuolumne1033-0
00000100:00000001:24.0:1773851901.670286:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851901.670286:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000400:00000200:12.0:1773851901.670286:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000100:00000200:26.0:1773851901.670287:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734890496
00000400:00000200:12.0:1773851901.670287:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000020:00000001:26.0:1773851901.670288:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851901.670288:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00000001:25.0:1773851901.670288:0:60844:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851901.670288:0:60844:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851901.670288:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 1451911046
00000020:00000001:26.0:1773851901.670289:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.670289:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:25.0:1773851901.670289:0:60844:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851901.670289:0:60844:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851901.670289:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 3
00000100:00000001:24.0:1773851901.670289:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637018804536192 : -107054905015424 : ffff9ea2566a4380)
00000400:00000200:12.0:1773851901.670289:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8754@kfi7(8754@kfi7:8754@kfi7) <?> : PUT try# 0
00000020:00000001:26.0:1773851901.670290:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658704 : -1035892912 : ffffffffc2418750)
00000020:00000001:26.0:1773851901.670290:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851901.670291:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313734890496, found 0 last_xid 1859313734890303
00000100:00000040:24.0:1773851901.670291:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b8144ec5 x1859313734890368/t0(0) o41->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 224/0 e 0 to 0 dl 1773852297 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1033-0'
00000400:00000200:12.0:1773851901.670291:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000020:00000001:26.0:1773851901.670292:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851901.670292:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000800:00000200:12.0:1773851901.670292:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000020:00000001:26.0:1773851901.670293:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851901.670293:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:12.0:1773851901.670293:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000004:00000001:26.0:1773851901.670294:0:41182:0:(mdt_handler.c:3040:mdt_reint()) Process entered
00000100:00000001:24.0:1773851901.670294:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851901.670294:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000004:00000002:26.0:1773851901.670295:0:41182:0:(mdt_handler.c:3007:mdt_reint_opcode()) @@@ reint opt = 2  req@00000000af4d4c55 x1859313734890496/t0(0) o36->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 512/0 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/ffffffff rc 0/-1 job:'default-tuolumne1033-0'
00000100:00100000:24.0:1773851901.670295:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b8144ec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:5ac50477-c5c0-47ab-9937-99f367ea73c9+11:39855:x1859313734890368:12345-8754@kfi7:41:default-tuolumne1033-0
00000800:00000200:12.0:1773851901.670295:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000200:24.0:1773851901.670297:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734890368
00000800:00000200:12.0:1773851901.670297:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Using peer 8754@kfi7(0x10000000000000a)
00000004:00000001:26.0:1773851901.670298:0:41182:0:(mdt_handler.c:2906:mdt_reint_internal()) Process entered
00000020:00000001:24.0:1773851901.670298:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851901.670298:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000004:00000001:26.0:1773851901.670299:0:41182:0:(mdt_lib.c:1846:mdt_reint_unpack()) Process entered
00000020:00000001:24.0:1773851901.670299:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670300:0:41182:0:(mdt_lib.c:1303:mdt_create_unpack()) Process entered
00000020:00000001:24.0:1773851901.670300:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851901.670300:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000800:00000200:12.0:1773851901.670300:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0x10000000000000a: rc=0
00000001:00000001:26.0:1773851901.670301:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.670301:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851901.670301:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000004:00000001:26.0:1773851901.670302:0:41182:0:(mdt_lib.c:1213:mdt_dlmreq_unpack()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:24.0:1773851901.670302:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313734890368, found 0 last_xid 1859313734890303
00000020:00000001:24.0:1773851901.670302:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:12.0:1773851901.670302:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000004:00000001:26.0:1773851901.670303:0:41182:0:(mdt_lib.c:1379:mdt_create_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670303:0:41182:0:(mdt_lib.c:1856:mdt_reint_unpack()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851901.670303:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851901.670303:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000004:00000001:26.0:1773851901.670304:0:41182:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:26.0:1773851901.670304:0:41182:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000020:00000001:24.0:1773851901.670304:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.670304:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670305:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000100:00000001:24.0:1773851901.670305:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00000100:00000040:12.0:1773851901.670305:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:12.0:1773851901.670305:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670306:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000001:24.0:1773851901.670306:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00010000:00000001:12.0:1773851901.670306:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:26.0:1773851901.670307:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 704 at 00000000e706500d.
02000000:00000010:24.0:1773851901.670307:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 000000000bb17911.
02000000:00000001:24.0:1773851901.670307:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.670307:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000056d1a7b1 x1859313734890304/t0(0) o103->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 328/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:''
02000000:00000001:26.0:1773851901.670308:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670308:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851901.670308:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670309:0:41182:0:(mdt_lib.c:578:old_init_ucred_reint()) Process entered
00000001:00000001:26.0:1773851901.670309:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000004:00000001:24.0:1773851901.670309:0:60973:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000001:00000001:26.0:1773851901.670310:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.670310:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000004:00000001:24.0:1773851901.670310:0:60973:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851901.670310:0:60973:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.670311:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.670311:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.670311:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670312:0:41182:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:26.0:1773851901.670312:0:41182:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00080000:00000001:24.0:1773851901.670312:0:60973:0:(osd_handler.c:559:osd_statfs()) Process entered
00000100:00100000:12.0:1773851901.670312:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000056d1a7b1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:5ac50477-c5c0-47ab-9937-99f367ea73c9+11:39848:x1859313734890304:12345-8754@kfi7:103: Request processed in 80us (116us total) trans 0 rc 0/0
00000004:00000001:26.0:1773851901.670313:0:41182:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:26.0:1773851901.670313:0:41182:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851901.670313:0:60973:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.670314:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.670314:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851901.670314:0:60973:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 395575296 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000100:00100000:12.0:1773851901.670314:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 50273009
00000004:00000001:26.0:1773851901.670315:0:41182:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:26.0:1773851901.670315:0:41182:0:(mdt_lib.c:599:old_init_ucred_reint()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:24.0:1773851901.670315:0:60973:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129889 avail; 3492774874 objects: 3200325324 free; state 0
00000100:00000040:12.0:1773851901.670315:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 2
00000004:00000001:26.0:1773851901.670316:0:41182:0:(mdt_internal.h:1182:mdt_check_resent()) Process entered
00000020:00000001:24.0:1773851901.670316:0:60973:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000100:00000001:12.0:1773851901.670316:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851901.670316:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000004:00000001:26.0:1773851901.670317:0:41182:0:(mdt_internal.h:1200:mdt_check_resent()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:12.0:1773851901.670317:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000004:00000001:26.0:1773851901.670318:0:41182:0:(mdt_reint.c:3241:mdt_reint_rec()) Process entered
00000020:00000001:24.0:1773851901.670318:0:60973:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:12.0:1773851901.670318:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000004:00000001:26.0:1773851901.670319:0:41182:0:(mdt_reint.c:1049:mdt_reint_create()) Process entered
00000004:00000001:24.0:1773851901.670319:0:60973:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000010:12.0:1773851901.670319:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851901.670319:0:609420:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 10
00010000:00000001:26.0:1773851901.670320:0:41182:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:26.0:1773851901.670320:0:41182:0:(ldlm_lockd.c:1710:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851901.670320:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183110002015, transno 0, xid 1859313734890368
00010000:00000001:24.0:1773851901.670320:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000100:00000001:12.0:1773851901.670320:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851901.670321:0:41182:0:(mdt_reint.c:511:mdt_create()) Process entered
00010000:00000200:24.0:1773851901.670321:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b8144ec5 x1859313734890368/t0(0) o41->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 224/368 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00000004:00000002:26.0:1773851901.670322:0:41182:0:(mdt_reint.c:514:mdt_create()) @@@ Create (job_flaps->[0x2400276b3:0x14a2:0x0]) in [0x2800256ea:0x3d:0x0]  req@00000000af4d4c55 x1859313734890496/t0(0) o36->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 512/448 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00010000:00000001:24.0:1773851901.670324:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000004:00000001:26.0:1773851901.670325:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00010000:00000001:24.0:1773851901.670325:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851901.670325:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=134 v=313 (313 212 1 1)
00000800:00000200:13.0:1773851901.670325:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_EVENT_TX_OK event status 0
00000004:00000040:26.0:1773851901.670326:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x2800256ea:0x3d:0x0]
00000020:00000001:26.0:1773851901.670326:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:26.0:1773851901.670327:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636928692022184 : -107145017529432 : ffff9e8d5b4a6ba8)
00000100:00000001:24.0:1773851901.670327:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851901.670327:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000400:00000200:13.0:1773851901.670327:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000001:26.0:1773851901.670328:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636928692022096 : -107145017529520 : ffff9e8d5b4a6b50)
00000100:00000001:24.0:1773851901.670328:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
00000400:00000200:13.0:1773851901.670328:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000004:00000001:26.0:1773851901.670329:0:41182:0:(mdd_dir.c:119:mdd_lookup()) Process entered
00000004:00000001:26.0:1773851901.670329:0:41182:0:(osp_object.c:581:osp_attr_get()) Process entered
02000000:00000001:24.0:1773851901.670329:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000400:00000200:13.0:1773851901.670329:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f7dab02
00000400:00000010:13.0:1773851901.670329:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f7dab02.
02000000:00000001:24.0:1773851901.670330:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851901.670330:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:13.0:1773851901.670330:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851901.670330:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000004:00000010:26.0:1773851901.670331:0:41182:0:(osp_trans.c:185:osp_update_request_create()) kmalloced '(our)': 120 at 00000000dd0d8078.
00000100:00000040:24.0:1773851901.670331:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8946@kfi7
00000400:00000200:13.0:1773851901.670331:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000004:00000010:26.0:1773851901.670332:0:41182:0:(osp_trans.c:117:osp_object_update_request_create()) kmalloced '(ours)': 32 at 0000000055d883c0.
00000400:00000010:24.0:1773851901.670332:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003c502b5b.
00000100:00000200:24.0:1773851901.670333:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1859313734890368, offset 224
00000800:00000200:13.0:1773851901.670333:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Transaction freed
00000004:00000010:26.0:1773851901.670334:0:41182:0:(osp_trans.c:128:osp_object_update_request_create()) kmalloced '(ourq)': 4096 at 00000000582505ce.
00000020:00000001:26.0:1773851901.670335:0:41182:0:(out_lib.c:157:out_update_pack()) Process entered
00000400:00000200:24.0:1773851901.670335:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8946@kfi7
00000020:00000001:26.0:1773851901.670336:0:41182:0:(out_lib.c:171:out_update_pack()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:24.0:1773851901.670336:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000004:00000001:26.0:1773851901.670337:0:41182:0:(osp_trans.c:477:osp_remote_sync()) Process entered
00000400:00000200:24.0:1773851901.670337:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000004:00000001:26.0:1773851901.670338:0:41182:0:(osp_trans.c:355:osp_prep_update_req()) Process entered
00000004:00000040:26.0:1773851901.670338:0:41182:0:(osp_trans.c:265:object_update_request_dump()) i = 0 fid = [0x2800256ea:0x3d:0x0] op = attr_get params = 0 batchid = 0 size = 40 repsize 208
00000400:00000200:24.0:1773851901.670338:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:24.0:1773851901.670339:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000004:00000040:26.0:1773851901.670340:0:41182:0:(osp_trans.c:271:object_update_request_dump()) updates = 00000000582505ce magic = bdde0002 count = 1 size = 40
00000400:00000200:24.0:1773851901.670340:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8946@kfi7 local destination
00000100:00000010:26.0:1773851901.670342:0:41182:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000019152df0.
00000020:00000040:26.0:1773851901.670342:0:41182:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000400:00000200:24.0:1773851901.670342:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770394:8770394:1024:4294967295] 8946@kfi7 LPNI seq info [5400476:5400476:16:4294967295]
00000400:00000200:24.0:1773851901.670343:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000100:00000001:26.0:1773851901.670344:0:41182:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:26.0:1773851901.670344:0:41182:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000400:00000200:24.0:1773851901.670344:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
02000000:00000001:26.0:1773851901.670345:0:41182:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:26.0:1773851901.670346:0:41182:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000dd135460.
00000400:00000200:24.0:1773851901.670346:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8946@kfi7(8946@kfi7:8946@kfi7) <?> : PUT try# 0
00000100:00000001:26.0:1773851901.670347:0:41182:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670348:0:41182:0:(osp_trans.c:322:osp_prep_inline_update_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:24.0:1773851901.670348:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000004:00000001:26.0:1773851901.670349:0:41182:0:(osp_trans.c:399:osp_prep_update_req()) Process leaving via out_req (rc=0 : 0 : 0x0)
00000800:00000200:24.0:1773851901.670349:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000004:00000001:26.0:1773851901.670350:0:41182:0:(osp_trans.c:454:osp_prep_update_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670351:0:41182:0:(client.c:3060:ptlrpc_queue_wait()) Process entered
00000800:00000200:24.0:1773851901.670351:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000100:00000001:26.0:1773851901.670352:0:41182:0:(client.c:1049:ptlrpc_prep_set()) Process entered
00000100:00000010:26.0:1773851901.670353:0:41182:0:(client.c:1051:ptlrpc_prep_set()) kmalloced '(set)': 112 at 00000000829ff116.
00000100:00000001:26.0:1773851901.670353:0:41182:0:(client.c:1066:ptlrpc_prep_set()) Process leaving (rc=18446636942074779904 : -107131634771712 : ffff9e9078f71900)
00000800:00000200:24.0:1773851901.670353:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:26.0:1773851901.670354:0:41182:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:26.0:1773851901.670355:0:41182:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637137189202944 : -106936520348672 : ffff9ebde6b0ec00)
00000100:00000001:26.0:1773851901.670356:0:41182:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000800:00000200:24.0:1773851901.670356:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe Using peer 8946@kfi7(0x1000000000011fe)
00000100:00000001:26.0:1773851901.670357:0:41182:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670357:0:41182:0:(client.c:2473:ptlrpc_set_wait()) Process entered
00000100:00000001:26.0:1773851901.670358:0:41182:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:26.0:1773851901.670359:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 0 ref 2 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:24.0:1773851901.670359:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007491e18f: Posted send of 468 bytes to peer 0x1000000000011fe: rc=0
00000800:00000200:24.0:1773851901.670361:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.670362:0:41182:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:26.0:1773851901.670362:0:41182:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670363:0:41182:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:24.0:1773851901.670363:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670364:0:41182:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851901.670364:0:41182:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019152df0 pname:cluuid:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-mdtlov_UUID:41182:1859433051942400:13@kfi7:1000:default-yuba2-0
00000100:00000040:24.0:1773851901.670364:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:24.0:1773851901.670365:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851901.670365:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670366:0:41182:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:26.0:1773851901.670366:0:41182:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000020:00000001:24.0:1773851901.670366:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
02000000:00000001:26.0:1773851901.670367:0:41182:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851901.670367:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b8144ec5 x1859313734890368/t0(0) o41->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 224/368 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
02000000:00000001:26.0:1773851901.670368:0:41182:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:26.0:1773851901.670370:0:41182:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 8192 at 00000000a9cd7472.
02000000:00000001:26.0:1773851901.670370:0:41182:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851901.670371:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:26.0:1773851901.670372:0:41182:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f00e36c9.
00000100:00100000:24.0:1773851901.670372:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b8144ec5 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:5ac50477-c5c0-47ab-9937-99f367ea73c9+10:39855:x1859313734890368:12345-8754@kfi7:41:default-tuolumne1033-0 Request processed in 77us (105us total) trans 0 rc 0/0
00000400:00000010:26.0:1773851901.670373:0:41182:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000241c33cb (tot 253203915).
00000100:00100000:24.0:1773851901.670374:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 1451911046
00000100:00000200:26.0:1773851901.670375:0:41182:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 8192 bytes, xid 1859433051942400, portal 4
00000100:00000001:26.0:1773851901.670375:0:41182:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:24.0:1773851901.670375:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 1
00000100:00000001:26.0:1773851901.670376:0:41182:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637137189202944 : -106936520348672 : ffff9ebde6b0ec00)
00000100:00000001:24.0:1773851901.670376:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000040:26.0:1773851901.670377:0:41182:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:24.0:1773851901.670377:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851901.670378:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851901.670378:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851901.670379:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000dae1f2b1.
00000100:00000001:26.0:1773851901.670380:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851901.670380:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000020:00000040:24.0:1773851901.670380:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 9
00000400:00000010:26.0:1773851901.670381:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006957f781.
00000100:00000001:24.0:1773851901.670381:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:26.0:1773851901.670382:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 304 bytes to portal 24, xid 1859433051942400, offset 0
00000400:00000200:26.0:1773851901.670383:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:26.0:1773851901.670384:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:26.0:1773851901.670385:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:26.0:1773851901.670385:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:26.0:1773851901.670387:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:25.0:1773851901.670387:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851901.670388:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:25.0:1773851901.670389:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851901.670390:0:41182:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770392, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770394, p:4294967295, g:4294967295, h:1000]
00000400:00000200:25.0:1773851901.670390:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8946@kfi7: PUT: OK
00000400:00000200:25.0:1773851901.670391:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003c502b5b
00000400:00000010:25.0:1773851901.670391:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003c502b5b.
00000400:00000200:26.0:1773851901.670392:0:41182:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:25.0:1773851901.670392:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851901.670392:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851901.670393:0:41182:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851901.670394:0:41182:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851901.670395:0:41182:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133331, 23133329]
00000400:00000200:26.0:1773851901.670397:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 13@kfi7
00000400:00000200:26.0:1773851901.670398:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770395:8770395:1024:4294967295] 13@kfi7 LPNI seq info [23133332:23133332:16:4294967295]
00000400:00000200:26.0:1773851901.670399:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:26.0:1773851901.670400:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:25.0:1773851901.670401:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.670402:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000800:00000200:25.0:1773851901.670402:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 8946@kfi7(000000002efd873d):0x0 lsk 4607 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000011fe Transaction freed
00000400:00000200:26.0:1773851901.670403:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:26.0:1773851901.670404:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.670405:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 304 bytes in 1 frags
00000800:00000200:26.0:1773851901.670407:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851901.670409:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 6 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:26.0:1773851901.670412:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 404 bytes to peer 0x102: rc=0
00000800:00000200:26.0:1773851901.670413:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 6 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.670416:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670416:0:41182:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851901.670417:0:41182:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670418:0:41182:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851901.670418:0:41182:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00100000:26.0:1773851901.670419:0:41182:0:(client.c:2500:ptlrpc_set_wait()) set 00000000829ff116 going to sleep for 87 seconds
00000100:00000001:26.0:1773851901.670420:0:41182:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851901.670421:0:41182:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:26.0:1773851901.670424:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 6 tta 0x102 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851901.670426:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851901.670427:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000200:26.0:1773851901.670428:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006957f781
00000400:00000010:26.0:1773851901.670428:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006957f781.
00000100:00000001:26.0:1773851901.670429:0:2507427:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:26.0:1773851901.670430:0:2507427:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670432:0:2507427:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851901.670433:0:2507427:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 2  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 3 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670436:0:2507427:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670436:0:2507427:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:26.0:1773851901.670437:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:26.0:1773851901.670439:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2069@kfi7:6 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 6 tta 0x102 Transaction freed
00000800:00000200:21.0:1773851901.670517:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851901.670518:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000800:00000200:21.0:1773851901.670519:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851901.670521:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851901.670523:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.670524:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:21.0:1773851901.670525:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.670525:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:21.0:1773851901.670526:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.670527:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:21.0:1773851901.670528:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851901.670528:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.670529:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 4320 into portal 4 MB=0x69b24fe8b6e00
00000400:00000200:21.0:1773851901.670530:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.670531:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 4320/4320 into md 0x6a34d2135 [2] + 224
00000800:00000200:21.0:1773851901.670533:0:2494373:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:21.0:1773851901.670535:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000800:00000200:21.0:1773851901.670537:0:2494373:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:21.0:1773851901.670541:0:2494373:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2069@kfi7:5 TN 0000000063ddb849: Posted read of 4320 bytes in 2 frags kp 13@kfi7(00000000db68253b) rma_iov.key 314703873: rc=0
00000800:00000200:21.0:1773851901.670543:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000800:00000200:21.0:1773851901.670559:0:2494373:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 TN_EVENT_TAG_TX_OK event status 0
00000400:00000200:21.0:1773851901.670560:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851901.670562:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000100:00000001:21.0:1773851901.670563:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:21.0:1773851901.670565:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851901.670568:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=4320 offset=224 replen=4320  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:21.0:1773851901.670573:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851901.670574:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000100:00000001:26.0:1773851901.670575:0:41182:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851901.670575:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 4802 trmk 1 tmk 0 trr 0 tta 0x102 Transaction freed
00000400:00000001:26.0:1773851901.670576:0:41182:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:26.0:1773851901.670576:0:41182:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:26.0:1773851901.670577:0:41182:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f00e36c9.
00000400:00000200:26.0:1773851901.670578:0:41182:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000241c33cb
00000400:00000010:26.0:1773851901.670579:0:41182:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000241c33cb (tot 253203763).
00000100:00000001:26.0:1773851901.670580:0:41182:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:26.0:1773851901.670581:0:41182:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:26.0:1773851901.670584:0:41182:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670586:0:41182:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851901.670587:0:41182:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.670588:0:41182:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:26.0:1773851901.670588:0:41182:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:26.0:1773851901.670588:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851901.670589:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670590:0:41182:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851901.670591:0:41182:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=134 v=66 (66 66 66 66)
00000100:00001000:26.0:1773851901.670592:0:41182:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=134 v=66 (1 1 1 1)
00000100:00000001:26.0:1773851901.670593:0:41182:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:26.0:1773851901.670594:0:41182:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.670594:0:41182:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:26.0:1773851901.670595:0:41182:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670596:0:41182:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:26.0:1773851901.670596:0:41182:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000100:00000001:26.0:1773851901.670597:0:41182:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851901.670597:0:41182:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.670598:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670601:0:41182:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851901.670602:0:41182:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:26.0:1773851901.670602:0:41182:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:26.0:1773851901.670603:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 2 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:26.0:1773851901.670605:0:41182:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019152df0 pname:cluuid:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-mdtlov_UUID:41182:1859433051942400:13@kfi7:1000:default-yuba2-0
00000100:00000001:26.0:1773851901.670607:0:41182:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.670608:0:41182:0:(client.c:2564:ptlrpc_set_wait()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670608:0:41182:0:(client.c:1109:ptlrpc_set_destroy()) Process entered
00000100:00000001:26.0:1773851901.670609:0:41182:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851901.670609:0:41182:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 2 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670612:0:41182:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:26.0:1773851901.670612:0:41182:0:(ptlrpc_internal.h:359:ptlrpc_reqset_put()) kfreed 'set': 112 at 00000000829ff116.
00000100:00000001:26.0:1773851901.670613:0:41182:0:(client.c:1146:ptlrpc_set_destroy()) Process leaving
00000100:00000001:26.0:1773851901.670613:0:41182:0:(client.c:3079:ptlrpc_queue_wait()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670614:0:41182:0:(osp_trans.c:495:osp_remote_sync()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670616:0:41182:0:(osp_object.c:653:osp_attr_get()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851901.670617:0:41182:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851901.670618:0:41182:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000019152df0 x1859433051942400/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 304/4320 e 0 to 0 dl 1773852054 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670620:0:41182:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:26.0:1773851901.670621:0:41182:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:26.0:1773851901.670621:0:41182:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 8192 at 00000000a9cd7472.
02000000:00000001:26.0:1773851901.670622:0:41182:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851901.670623:0:41182:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851901.670623:0:41182:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000001:26.0:1773851901.670624:0:41182:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:26.0:1773851901.670625:0:41182:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at 00000000dd135460.
02000000:00000001:26.0:1773851901.670626:0:41182:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851901.670626:0:41182:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851901.670627:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019152df0.
00000100:00000001:26.0:1773851901.670628:0:41182:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851901.670628:0:41182:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000010:26.0:1773851901.670629:0:41182:0:(osp_trans.c:215:osp_update_request_destroy()) kfreed 'ours->ours_req': 4096 at 00000000582505ce.
00000004:00000010:26.0:1773851901.670629:0:41182:0:(osp_trans.c:216:osp_update_request_destroy()) kfreed 'ours': 32 at 0000000055d883c0.
00000004:00000010:26.0:1773851901.670630:0:41182:0:(osp_trans.c:243:osp_update_request_destroy()) kfreed 'our': 120 at 00000000dd0d8078.
00000004:00000001:26.0:1773851901.670631:0:41182:0:(mdd_dir.c:85:__mdd_lookup()) Process entered
00000004:00000040:26.0:1773851901.670631:0:41182:0:(mdd_dir.c:96:__mdd_lookup()) lustre5-MDD0001: Object [0x2800256ea:0x3d:0x0] located on remote server
00000004:00000001:26.0:1773851901.670632:0:41182:0:(mdd_permission.c:259:__mdd_permission_internal()) Process entered
00000004:00000001:26.0:1773851901.670633:0:41182:0:(mdd_permission.c:302:__mdd_permission_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670634:0:41182:0:(osp_md_object.c:476:osp_md_index_lookup()) Process entered
00000004:00000010:26.0:1773851901.670634:0:41182:0:(osp_trans.c:185:osp_update_request_create()) kmalloced '(our)': 120 at 00000000829ff116.
00000004:00000010:26.0:1773851901.670635:0:41182:0:(osp_trans.c:117:osp_object_update_request_create()) kmalloced '(ours)': 32 at 0000000055d883c0.
00000004:00000010:26.0:1773851901.670636:0:41182:0:(osp_trans.c:128:osp_object_update_request_create()) kmalloced '(ourq)': 4096 at 00000000582505ce.
00000020:00000001:26.0:1773851901.670637:0:41182:0:(out_lib.c:157:out_update_pack()) Process entered
00000020:00000001:26.0:1773851901.670637:0:41182:0:(out_lib.c:171:out_update_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670638:0:41182:0:(osp_trans.c:477:osp_remote_sync()) Process entered
00000004:00000001:26.0:1773851901.670638:0:41182:0:(osp_trans.c:355:osp_prep_update_req()) Process entered
00000004:00000040:26.0:1773851901.670639:0:41182:0:(osp_trans.c:265:object_update_request_dump()) i = 0 fid = [0x2800256ea:0x3d:0x0] op = lookup params = 1 batchid = 0 size = 64 repsize 256
00000004:00000040:26.0:1773851901.670640:0:41182:0:(osp_trans.c:271:object_update_request_dump()) updates = 00000000582505ce magic = bdde0002 count = 1 size = 64
00000100:00000010:26.0:1773851901.670641:0:41182:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000019152df0.
00000020:00000040:26.0:1773851901.670642:0:41182:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000100:00000001:26.0:1773851901.670642:0:41182:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:26.0:1773851901.670643:0:41182:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:26.0:1773851901.670643:0:41182:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:26.0:1773851901.670644:0:41182:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 512 at 00000000dd135460.
00000100:00000001:26.0:1773851901.670644:0:41182:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670645:0:41182:0:(osp_trans.c:322:osp_prep_inline_update_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670646:0:41182:0:(osp_trans.c:399:osp_prep_update_req()) Process leaving via out_req (rc=0 : 0 : 0x0)
00000004:00000001:26.0:1773851901.670646:0:41182:0:(osp_trans.c:454:osp_prep_update_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670647:0:41182:0:(client.c:3060:ptlrpc_queue_wait()) Process entered
00000100:00000001:26.0:1773851901.670647:0:41182:0:(client.c:1049:ptlrpc_prep_set()) Process entered
00000100:00000010:26.0:1773851901.670648:0:41182:0:(client.c:1051:ptlrpc_prep_set()) kmalloced '(set)': 112 at 00000000dd0d8078.
00000100:00000001:26.0:1773851901.670648:0:41182:0:(client.c:1066:ptlrpc_prep_set()) Process leaving (rc=18446637064007505280 : -107009702046336 : ffff9eacdcb8d580)
00000100:00000001:26.0:1773851901.670649:0:41182:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:26.0:1773851901.670649:0:41182:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637137189202944 : -106936520348672 : ffff9ebde6b0ec00)
00000100:00000001:26.0:1773851901.670650:0:41182:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:26.0:1773851901.670650:0:41182:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670651:0:41182:0:(client.c:2473:ptlrpc_set_wait()) Process entered
00000100:00000001:26.0:1773851901.670651:0:41182:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:26.0:1773851901.670652:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 0 ref 2 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670654:0:41182:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:26.0:1773851901.670655:0:41182:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670655:0:41182:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:26.0:1773851901.670656:0:41182:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851901.670656:0:41182:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000019152df0 pname:cluuid:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-mdtlov_UUID:41182:1859433051942464:13@kfi7:1000:default-yuba2-0
00000100:00000001:26.0:1773851901.670657:0:41182:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:26.0:1773851901.670658:0:41182:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:26.0:1773851901.670658:0:41182:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670659:0:41182:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:26.0:1773851901.670659:0:41182:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 8192 at 00000000a9cd7472.
02000000:00000001:26.0:1773851901.670660:0:41182:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851901.670661:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000010:26.0:1773851901.670662:0:41182:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f00e36c9.
00000400:00000010:26.0:1773851901.670662:0:41182:0:(lib-md.c:191:lnet_md_build()) alloc '(lmd)': 152 at 00000000241c33cb (tot 253203915).
00000100:00000200:26.0:1773851901.670663:0:41182:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 8192 bytes, xid 1859433051942464, portal 4
00000100:00000001:26.0:1773851901.670664:0:41182:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:26.0:1773851901.670664:0:41182:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637137189202944 : -106936520348672 : ffff9ebde6b0ec00)
00000100:00000040:26.0:1773851901.670665:0:41182:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670667:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851901.670668:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:26.0:1773851901.670668:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006957f781.
00000100:00000200:26.0:1773851901.670669:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 328 bytes to portal 24, xid 1859433051942464, offset 0
00000400:00000200:26.0:1773851901.670670:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:26.0:1773851901.670671:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:26.0:1773851901.670672:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:26.0:1773851901.670673:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:26.0:1773851901.670674:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:26.0:1773851901.670675:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:26.0:1773851901.670676:0:41182:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770395, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770394, p:4294967295, g:4294967295, h:1000]
00000400:00000200:26.0:1773851901.670678:0:41182:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:26.0:1773851901.670678:0:41182:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851901.670679:0:41182:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:26.0:1773851901.670680:0:41182:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133331, 23133332]
00000400:00000200:26.0:1773851901.670681:0:41182:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 30@kfi7
00000400:00000200:26.0:1773851901.670682:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770396:8770396:1024:4294967295] 30@kfi7 LPNI seq info [23133333:23133333:16:4294967295]
00000400:00000200:26.0:1773851901.670683:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:26.0:1773851901.670684:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:26.0:1773851901.670687:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 30@kfi7(13@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851901.670688:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:26.0:1773851901.670690:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.670691:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 328 bytes in 1 frags
00000800:00000200:26.0:1773851901.670694:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851901.670696:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000800:00000200:26.0:1773851901.670699:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000fe1d82e3: Posted send of 428 bytes to peer 0x2000000000000fe: rc=0
00000800:00000200:26.0:1773851901.670700:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2000000000000fe TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.670702:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670703:0:41182:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851901.670703:0:41182:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670704:0:41182:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851901.670704:0:41182:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00100000:26.0:1773851901.670705:0:41182:0:(client.c:2500:ptlrpc_set_wait()) set 00000000dd0d8078 going to sleep for 87 seconds
00000100:00000001:26.0:1773851901.670705:0:41182:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:26.0:1773851901.670706:0:41182:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851901.670712:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2000000000000fe TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851901.670713:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851901.670714:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000400:00000200:25.0:1773851901.670715:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006957f781
00000400:00000010:25.0:1773851901.670715:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006957f781.
00000100:00000001:25.0:1773851901.670716:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:25.0:1773851901.670717:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 3 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851901.670720:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:25.0:1773851901.670720:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 2  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 3 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851901.670723:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851901.670723:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851901.670724:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000800:00000200:25.0:1773851901.670729:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fe1d82e3: 2054@kfi7:6 -> 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2000000000000fe Transaction freed
00000800:00000200:5.0:1773851901.670773:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851901.670774:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_BULK_PUT_REQ transaction ID 0
00000800:00000200:5.0:1773851901.670775:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851901.670777:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851901.670779:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.670780:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 30@kfi7 : PUT - for me
00000400:00000200:5.0:1773851901.670781:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.670782:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:5.0:1773851901.670783:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.670784:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:5.0:1773851901.670785:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:5.0:1773851901.670785:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851901.670786:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 4320 into portal 4 MB=0x69b24fe8b6e40
00000400:00000200:5.0:1773851901.670787:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:5.0:1773851901.670789:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 4320/4320 into md 0x6a34d2155 [2] + 224
00000800:00000200:5.0:1773851901.670791:0:2507993:0:(kfilnd.c:351:kfilnd_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 4804 trmk 1 tmk 0 trr 2 tta 0x0 KFILND_MSG_BULK_PUT_REQ in 4320 bytes in 2 frags
00000800:00000200:5.0:1773851901.670794:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 4804 trmk 1 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_TAG_RMA event status 0
00000800:00000200:5.0:1773851901.670796:0:2507993:0:(kfilnd_tn.c:1016:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 4804 trmk 1 tmk 0 trr 2 tta 0x2000000000000fe Using peer 30@kfi7(0x2000000000000fe)
00000800:00000200:5.0:1773851901.670801:0:2507993:0:(kfilnd_ep.c:598:kfilnd_ep_post_read()) 2054@kfi7:1 TN 00000000fddc5cf3: Posted read of 4320 bytes in 2 frags kp 30@kfi7(0000000005b89dad) rma_iov.key 314834945: rc=0
00000800:00000200:5.0:1773851901.670803:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 4804 trmk 1 tmk 0 trr 2 tta 0x2000000000000fe TN_STATE_IMM_RECV -> TN_STATE_WAIT_TAG_RMA_COMP state change
00000800:00000200:5.0:1773851901.670818:0:2507993:0:(kfilnd_tn.c:1268:kfilnd_tn_state_wait_tag_rma_comp()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 4804 trmk 1 tmk 0 trr 2 tta 0x2000000000000fe TN_EVENT_TAG_TX_OK event status 0
00000400:00000200:5.0:1773851901.670820:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.670820:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->30@kfi7: PUT: OK
00000100:00000001:5.0:1773851901.670822:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851901.670823:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851901.670826:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=4320 offset=224 replen=4320  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851901.670830:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:5.0:1773851901.670831:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000001:26.0:1773851901.670832:0:41182:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:26.0:1773851901.670833:0:41182:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:26.0:1773851901.670833:0:41182:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:5.0:1773851901.670833:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2054@kfi7:1 <- 30@kfi7(0000000005b89dad):0x0 lsk 255 rsk 4804 tsk 4804 trmk 1 tmk 0 trr 2 tta 0x2000000000000fe Transaction freed
00000400:00000010:26.0:1773851901.670834:0:41182:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f00e36c9.
00000400:00000200:26.0:1773851901.670835:0:41182:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000241c33cb
00000400:00000010:26.0:1773851901.670835:0:41182:0:(lib-lnet.h:316:lnet_md_free()) kfreed 'md': 152 at 00000000241c33cb (tot 253203763).
00000100:00000001:26.0:1773851901.670836:0:41182:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:26.0:1773851901.670837:0:41182:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:26.0:1773851901.670840:0:41182:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670842:0:41182:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851901.670843:0:41182:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.670843:0:41182:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:26.0:1773851901.670844:0:41182:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:26.0:1773851901.670844:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851901.670845:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.670845:0:41182:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851901.670848:0:41182:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=134 v=66 (66 66 66 66)
00000100:00001000:26.0:1773851901.670849:0:41182:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=134 v=66 (1 1 1 1)
00000100:00000001:26.0:1773851901.670850:0:41182:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:26.0:1773851901.670850:0:41182:0:(client.c:1366:ptlrpc_check_status()) @@@ check status: rc = 1  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQU/0/0 rc 0/1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670853:0:41182:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.670853:0:41182:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:26.0:1773851901.670854:0:41182:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000100:00000001:26.0:1773851901.670854:0:41182:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851901.670855:0:41182:0:(client.c:1614:after_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:26.0:1773851901.670855:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Rpc:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670858:0:41182:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=1 : 1 : 0x1)
00000100:00000001:26.0:1773851901.670859:0:41182:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:26.0:1773851901.670859:0:41182:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:26.0:1773851901.670860:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Interpret:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00100000:26.0:1773851901.670862:0:41182:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000019152df0 pname:cluuid:pid:xid:nid:opc:job mdt06_001:lustre5-MDT0001-mdtlov_UUID:41182:1859433051942464:13@kfi7:1000:default-yuba2-0
00000100:00000001:26.0:1773851901.670864:0:41182:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.670864:0:41182:0:(client.c:2564:ptlrpc_set_wait()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.670865:0:41182:0:(client.c:1109:ptlrpc_set_destroy()) Process entered
00000100:00000001:26.0:1773851901.670865:0:41182:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851901.670866:0:41182:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 2 fl Complete:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670868:0:41182:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:26.0:1773851901.670869:0:41182:0:(ptlrpc_internal.h:359:ptlrpc_reqset_put()) kfreed 'set': 112 at 00000000dd0d8078.
00000100:00000001:26.0:1773851901.670869:0:41182:0:(client.c:1146:ptlrpc_set_destroy()) Process leaving
00000100:00000001:26.0:1773851901.670869:0:41182:0:(client.c:3079:ptlrpc_queue_wait()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851901.670870:0:41182:0:(osp_trans.c:495:osp_remote_sync()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851901.670872:0:41182:0:(osp_md_object.c:532:osp_md_index_lookup()) Process leaving via out (rc=1 : 1 : 0x1)
00000100:00000001:26.0:1773851901.670873:0:41182:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851901.670874:0:41182:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000019152df0 x1859433051942464/t0(0) o1000->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 328/4320 e 0 to 0 dl 1773852054 ref 1 fl Complete:RQU/0/0 rc 1/1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851901.670879:0:41182:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:26.0:1773851901.670879:0:41182:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:26.0:1773851901.670879:0:41182:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 8192 at 00000000a9cd7472.
02000000:00000001:26.0:1773851901.670881:0:41182:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851901.670881:0:41182:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851901.670881:0:41182:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
00000020:00000001:26.0:1773851901.670882:0:41182:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:26.0:1773851901.670883:0:41182:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 512 at 00000000dd135460.
02000000:00000001:26.0:1773851901.670883:0:41182:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851901.670884:0:41182:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851901.670884:0:41182:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000019152df0.
00000100:00000001:26.0:1773851901.670885:0:41182:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851901.670885:0:41182:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000010:26.0:1773851901.670886:0:41182:0:(osp_trans.c:215:osp_update_request_destroy()) kfreed 'ours->ours_req': 4096 at 00000000582505ce.
00000004:00000010:26.0:1773851901.670886:0:41182:0:(osp_trans.c:216:osp_update_request_destroy()) kfreed 'ours': 32 at 0000000055d883c0.
00000004:00000010:26.0:1773851901.670887:0:41182:0:(osp_trans.c:243:osp_update_request_destroy()) kfreed 'our': 120 at 00000000829ff116.
00000004:00000001:26.0:1773851901.670888:0:41182:0:(mdd_dir.c:110:__mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670888:0:41182:0:(mdd_dir.c:127:mdd_lookup()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670890:0:41182:0:(mdt_reint.c:581:mdt_create()) Process leaving via put_parent (rc=18446744073709551599 : -17 : 0xffffffffffffffef)
00000004:00000001:26.0:1773851901.670891:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:26.0:1773851901.670892:0:41182:0:(osp_object.c:2384:osp_object_release()) Process entered
00000004:00000001:26.0:1773851901.670892:0:41182:0:(osp_object.c:2416:osp_object_release()) Process leaving
00000020:00000002:26.0:1773851901.670892:0:41182:0:(lu_object.c:224:lu_object_put()) Add 00000000f2f19bc0/00000000bd70c739 to site lru. bkt: 00000000f61b8bf8
00000004:00000001:26.0:1773851901.670893:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:26.0:1773851901.670894:0:41182:0:(mdt_reint.c:1087:mdt_reint_create()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000004:00000001:26.0:1773851901.670895:0:41182:0:(mdt_reint.c:3254:mdt_reint_rec()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00000004:00000001:26.0:1773851901.670896:0:41182:0:(mdt_handler.c:2976:mdt_reint_internal()) Process leaving
02000000:00000001:26.0:1773851901.670896:0:41182:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:26.0:1773851901.670897:0:41182:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:26.0:1773851901.670897:0:41182:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:26.0:1773851901.670897:0:41182:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:26.0:1773851901.670898:0:41182:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:26.0:1773851901.670898:0:41182:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:26.0:1773851901.670899:0:41182:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.670900:0:41182:0:(mdt_handler.c:3056:mdt_reint()) Process leaving (rc=18446744073709551599 : -17 : ffffffffffffffef)
00010000:00000040:26.0:1773851901.670901:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183110002015, transno 0, xid 1859313734890496
00010000:00000001:26.0:1773851901.670901:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851901.670902:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000af4d4c55 x1859313734890496/t0(0) o36->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 512/448 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc -17/0 job:'default-tuolumne1033-0'
00010000:00000001:26.0:1773851901.670905:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851901.670905:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851901.670906:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=134 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851901.670907:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851901.670907:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:26.0:1773851901.670908:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:26.0:1773851901.670909:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851901.670909:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.670910:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851901.670910:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8946@kfi7
00000400:00000010:26.0:1773851901.670911:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000027bbb058.
00000100:00000200:26.0:1773851901.670911:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 448 bytes to portal 10, xid 1859313734890496, offset 224
00000400:00000200:26.0:1773851901.670913:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8946@kfi7
00000400:00000200:26.0:1773851901.670914:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.670914:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000400:00000200:26.0:1773851901.670915:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.670916:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:26.0:1773851901.670917:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8946@kfi7 local destination
00000400:00000200:26.0:1773851901.670919:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770397:8770397:1024:4294967295] 8946@kfi7 LPNI seq info [5400477:5400477:16:4294967295]
00000400:00000200:26.0:1773851901.670920:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.670921:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.670923:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8946@kfi7(8946@kfi7:8946@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851901.670924:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000800:00000200:26.0:1773851901.670925:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.670926:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 448 bytes in 1 frags
00000800:00000200:26.0:1773851901.670928:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851901.670930:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Using peer 8946@kfi7(0xf82)
00000800:00000200:26.0:1773851901.670933:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000bb1c0c9f: Posted send of 548 bytes to peer 0xf82: rc=0
00000800:00000200:26.0:1773851901.670934:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.670936:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.670937:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:26.0:1773851901.670937:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851901.670938:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.670938:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851901.670939:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000af4d4c55 x1859313734890496/t0(0) o36->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 512/448 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc -17/-17 job:'default-tuolumne1033-0'
00000100:00100000:26.0:1773851901.670942:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af4d4c55 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:2028291:x1859313734890496:12345-8754@kfi7:36:default-tuolumne1033-0 Request processed in 657us (685us total) trans 0 rc -17/-17
00000100:00100000:26.0:1773851901.670944:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 1451911045
00000100:00000040:26.0:1773851901.670945:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 0
00000100:00000001:26.0:1773851901.670946:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851901.670946:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851901.670946:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851901.670947:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000043dbba8.
00000020:00000010:26.0:1773851901.670947:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000400:00000200:25.0:1773851901.670947:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851901.670948:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f5cb6f5.
00000400:00000200:25.0:1773851901.670948:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00000020:00000040:26.0:1773851901.670949:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 8
00000100:00000001:26.0:1773851901.670949:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851901.670949:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000027bbb058
00000400:00000010:25.0:1773851901.670949:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000027bbb058.
00000100:00000001:25.0:1773851901.670950:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851901.670950:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851901.670952:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000800:00000200:25.0:1773851901.670953:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bb1c0c9f: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Transaction freed
00000800:00000200:25.0:1773851901.671989:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851901.671990:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851901.671991:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851901.671995:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851901.671997:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.671998:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8946@kfi7 : PUT - for me
00000400:00000200:25.0:1773851901.671999:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.671999:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000400:00000200:25.0:1773851901.672000:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.672001:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:25.0:1773851901.672002:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:25.0:1773851901.672002:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:25.0:1773851901.672003:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 576 into portal 12 MB=0x69b0936b1b740
00000400:00000200:25.0:1773851901.672004:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8754@kfi7 of length 576/576 into md 0x16159c9699 [64] + 43912
00000800:00000200:25.0:1773851901.672006:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851901.672007:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851901.672009:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00000100:00000001:25.0:1773851901.672009:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851901.672010:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851901.672011:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000023fc2e36.
00000100:00000040:25.0:1773851901.672011:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000023fc2e36 x1859313734891328 msgsize 576
00000100:00100000:25.0:1773851901.672013:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8946@kfi7)
00000100:00000001:25.0:1773851901.672014:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851901.672014:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000100:00000001:26.0:1773851901.672015:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851901.672015:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851901.672016:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851901.672016:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851901.672016:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851901.672017:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851901.672017:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734891328
00000020:00000001:26.0:1773851901.672018:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851901.672018:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:26.0:1773851901.672019:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.672019:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=9
00000020:00000001:26.0:1773851901.672020:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000001:26.0:1773851901.672020:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000100:00000001:26.0:1773851901.672021:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.672021:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851901.672022:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f5cb6f5.
00000020:00000010:26.0:1773851901.672023:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851901.672023:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851901.672024:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851901.672025:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:26.0:1773851901.672025:0:41182:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:26.0:1773851901.672025:0:41182:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.672026:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.672027:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.672027:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851901.672028:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851901.672029:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851901.672029:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851901.672029:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:26.0:1773851901.672030:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 1451911047
00000100:00000040:26.0:1773851901.672030:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 1
00000100:00000001:24.0:1773851901.672030:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.672031:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636951520124800 : -107122189426816 : ffff9e92abf39f80)
00000100:00000001:24.0:1773851901.672031:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.672032:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000023fc2e36 x1859313734891328/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 576/0 e 0 to 0 dl 1773852297 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1033-0'
00000100:00000001:26.0:1773851901.672035:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851901.672035:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851901.672036:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000023fc2e36 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:2028291:x1859313734891328:12345-8754@kfi7:101:default-tuolumne1033-0
00000100:00000200:26.0:1773851901.672037:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734891328
00000020:00000001:26.0:1773851901.672038:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851901.672038:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851901.672039:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.672039:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851901.672040:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:26.0:1773851901.672041:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851901.672041:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859313734891328, found 0 last_xid 1859313734891327
00000020:00000001:26.0:1773851901.672042:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851901.672042:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851901.672043:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851901.672043:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.672044:0:41182:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:26.0:1773851901.672044:0:41182:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:26.0:1773851901.672045:0:41182:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:26.0:1773851901.672045:0:41182:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:26.0:1773851901.672046:0:41182:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.672047:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851901.672048:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 194
00010000:00000001:26.0:1773851901.672049:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.672049:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.672050:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000813103dd.
00000020:00000001:26.0:1773851901.672051:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.672052:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000813103dd with handle 0x21b6f08f07a6aef1 to hash
00000020:00000001:26.0:1773851901.672052:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.672053:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637061011894656 : -107012697656960 : ffff9eac2a2b7180)
00010000:00000010:26.0:1773851901.672053:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 000000002e11f02b.
00010000:00000001:26.0:1773851901.672054:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637061011894656 : -107012697656960 : ffff9eac2a2b7180)
00010000:00010000:26.0:1773851901.672055:0:41182:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000813103dd/0x21b6f08f07a6aef1 lrc: 2/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 195 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xd0f5706c4644c2f7 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672057:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000040:26.0:1773851901.672058:0:41182:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000002338620b : new locks_count 4
00000020:00000040:26.0:1773851901.672059:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002338620b refcount=10
00010000:00000001:26.0:1773851901.672060:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:26.0:1773851901.672061:0:41182:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:26.0:1773851901.672062:0:41182:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:26.0:1773851901.672062:0:41182:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:26.0:1773851901.672062:0:41182:0:(mdt_handler.c:4136:mdt_body_unpack()) Process entered
00000004:00000001:26.0:1773851901.672063:0:41182:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:26.0:1773851901.672064:0:41182:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x24002684f:0x62d0:0x0]
00000020:00000001:26.0:1773851901.672064:0:41182:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:26.0:1773851901.672065:0:41182:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637149798067784 : -106923911483832 : ffff9ec0d63cee48)
00000004:00000001:26.0:1773851901.672066:0:41182:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637149798067696 : -106923911483920 : ffff9ec0d63cedf0)
00000004:00000001:26.0:1773851901.672066:0:41182:0:(mdt_handler.c:4165:mdt_body_unpack()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672067:0:41182:0:(mdt_handler.c:1328:mdt_preset_encctx_size()) Process entered
00000004:00000001:26.0:1773851901.672067:0:41182:0:(mdt_handler.c:1335:mdt_preset_encctx_size()) Process leaving
00000100:00000001:26.0:1773851901.672068:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851901.672068:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851901.672069:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 5600 at 00000000a9cd7472.
02000000:00000001:26.0:1773851901.672069:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.672070:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672071:0:41182:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672071:0:41182:0:(mdt_handler.c:4540:mdt_intent_getattr()) Process entered
00000004:00000001:26.0:1773851901.672072:0:41182:0:(mdt_lib.c:540:old_init_ucred()) Process entered
00000001:00000001:26.0:1773851901.672072:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.672072:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672073:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.672073:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672074:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.672074:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672075:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.672075:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672076:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.672076:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851901.672077:0:41182:0:(upcall_cache.c:153:upcall_cache_get_entry()) Process entered
02000000:00000001:26.0:1773851901.672077:0:41182:0:(upcall_cache.c:272:upcall_cache_get_entry()) Process leaving (rc=18446637088748833152 : -106984960718464 : ffff9eb29f6b8980)
00000004:00000001:26.0:1773851901.672078:0:41182:0:(mdt_lib.c:102:mdt_root_squash()) Process entered
00000004:00000001:26.0:1773851901.672078:0:41182:0:(mdt_lib.c:106:mdt_root_squash()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672079:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.672079:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672080:0:41182:0:(mdt_lib.c:529:old_init_ucred_common()) Process leaving
00000004:00000001:26.0:1773851901.672080:0:41182:0:(mdt_lib.c:570:old_init_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672081:0:41182:0:(mdt_handler.c:2033:mdt_getattr_name_lock()) Process entered
00000004:00000002:26.0:1773851901.672081:0:41182:0:(mdt_handler.c:2049:mdt_getattr_name_lock()) partial getattr_name child_fid = [0x24002684f:0x62d0:0x0], ldlm_rep = 00000000eea04148
00000004:00000001:26.0:1773851901.672082:0:41182:0:(mdt_handler.c:3865:mdt_object_lock_internal()) Process entered
00000004:00000001:26.0:1773851901.672083:0:41182:0:(mdt_handler.c:3752:mdt_object_local_lock()) Process entered
00010000:00000001:26.0:1773851901.672083:0:41182:0:(ldlm_request.c:472:ldlm_cli_enqueue_local()) Process entered
00010000:00000001:26.0:1773851901.672084:0:41182:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:26.0:1773851901.672084:0:41182:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00010000:00000001:26.0:1773851901.672085:0:41182:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.672086:0:41182:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:26.0:1773851901.672086:0:41182:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 00000000e01b3f2a.
00000020:00000001:26.0:1773851901.672087:0:41182:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:26.0:1773851901.672087:0:41182:0:(lustre_handles.c:97:class_handle_hash()) added object 00000000e01b3f2a with handle 0x21b6f08f07a6aef8 to hash
00000020:00000001:26.0:1773851901.672088:0:41182:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:26.0:1773851901.672088:0:41182:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000010:26.0:1773851901.672089:0:41182:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000001001fa8.
00010000:00000001:26.0:1773851901.672090:0:41182:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000001:26.0:1773851901.672090:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.672091:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.672092:0:41182:0:(ldlm_lock.c:766:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre5-MDT0001_UUID lock: 00000000e01b3f2a/0x21b6f08f07a6aef8 lrc: 3/1,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x0/0x0 rrc: 196 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672094:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:26.0:1773851901.672095:0:41182:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00010000:00000001:26.0:1773851901.672095:0:41182:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:26.0:1773851901.672095:0:41182:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:26.0:1773851901.672096:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.672097:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.672097:0:41182:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:26.0:1773851901.672098:0:41182:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.672098:0:41182:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:26.0:1773851901.672099:0:41182:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:26.0:1773851901.672100:0:41182:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:26.0:1773851901.672100:0:41182:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:26.0:1773851901.672100:0:41182:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6) refcount = 195
00010000:00000040:26.0:1773851901.672101:0:41182:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:26.0:1773851901.672102:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006a1fbefc/0x21b6f08f07a6abbe lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14082@kfi7 remote: 0x86336e1afc74bc9f expref: 8 pid: 60533 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672107:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672108:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005149eab6/0x21b6f08f07a68274 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25299@kfi7 remote: 0xb766a560536622f expref: 7 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672110:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672111:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000387fb7d1/0x21b6f08f07a681e1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8835@kfi7 remote: 0x9f64bd3b8edb0421 expref: 7 pid: 60824 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672113:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672114:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca6f7003/0x21b6f08f07a67ada lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8915@kfi7 remote: 0xaafd8255f21bb8b0 expref: 7 pid: 60597 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672116:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672116:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f67613f5/0x21b6f08f07a67a78 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8258@kfi7 remote: 0x2d8d0d89cfa6ece7 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672118:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672119:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000834daa9a/0x21b6f08f07a6775a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8640@kfi7 remote: 0xc09f1112ca4bff06 expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672121:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672122:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b812159/0x21b6f08f07a66fce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8512@kfi7 remote: 0xb032449c3ba34f64 expref: 8 pid: 60961 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672124:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672125:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000783f37c9/0x21b6f08f07a66cc5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17699@kfi7 remote: 0x874bf61c8939af8 expref: 10 pid: 60979 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672127:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672128:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e8092731/0x21b6f08f07a667af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 23266@kfi7 remote: 0xb7acc016c604a2e1 expref: 7 pid: 61075 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672131:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672132:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b788a75/0x21b6f08f07a5d661 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8545@kfi7 remote: 0x40718b3ef74f80ff expref: 9 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672134:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672135:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000012450b7d/0x21b6f08f07a5d581 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8673@kfi7 remote: 0x5f799cd3b40384c6 expref: 9 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672137:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672137:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004b6d7010/0x21b6f08f07a5d573 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8336@kfi7 remote: 0x5a84671fe993e804 expref: 9 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672139:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672140:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d87ebbe0/0x21b6f08f07a5d415 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8464@kfi7 remote: 0xfef594dda3fcf83a expref: 10 pid: 61175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672142:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672143:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f7337016/0x21b6f08f07a5b25e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8784@kfi7 remote: 0xaa971f102c940379 expref: 8 pid: 60547 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672145:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672146:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef94276d/0x21b6f08f07a5b226 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8769@kfi7 remote: 0x8c3fdf145b68325e expref: 7 pid: 60922 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672148:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672149:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006ef5e613/0x21b6f08f07a5b1c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8897@kfi7 remote: 0x320fe3dcad19fab1 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672151:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672152:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000541ea5f9/0x21b6f08f07a5b12a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16832@kfi7 remote: 0xa23cfcfc0c8b3238 expref: 8 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672155:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672155:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009c7a07f8/0x21b6f08f07a5b0f2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16704@kfi7 remote: 0x46980b8ac9421a15 expref: 8 pid: 60679 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672157:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672158:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000f9a8165/0x21b6f08f07a5a912 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8944@kfi7 remote: 0x6187836d10fccc6 expref: 10 pid: 60928 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672160:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672161:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f458dc96/0x21b6f08f07a5a8da lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8817@kfi7 remote: 0xa3e3351460468ef0 expref: 10 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672163:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672164:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8f6883a/0x21b6f08f07a5a8b0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8867@kfi7 remote: 0xcaff327788a52ca0 expref: 8 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672166:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672167:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006cb1a841/0x21b6f08f07a5a86a lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8736@kfi7 remote: 0xf873d8c19b75f6e6 expref: 10 pid: 60763 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672169:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672170:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044489353/0x21b6f08f07a5a72f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8211@kfi7 remote: 0x70aa1f42a8647727 expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672172:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672173:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009935b5c2/0x21b6f08f07a5a65d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26483@kfi7 remote: 0x9f31783b4587f6d9 expref: 7 pid: 60607 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672175:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672175:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fd548b93/0x21b6f08f07a5a633 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26179@kfi7 remote: 0x898fbdc00e8e9921 expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672178:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672180:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6e60820/0x21b6f08f07a5a1d3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8865@kfi7 remote: 0x999fc89951d427be expref: 9 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672182:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672182:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005dd95f9/0x21b6f08f07a59030 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8706@kfi7 remote: 0xc08839c7e8916887 expref: 6 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672184:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672185:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000062ad5f2b/0x21b6f08f07a50de5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8786@kfi7 remote: 0x26557037c5ca82c7 expref: 6 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672187:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672188:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e67a7c21/0x21b6f08f07a50ccd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19923@kfi7 remote: 0x5e2dd46d04d62f73 expref: 7 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672190:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672191:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d643d03a/0x21b6f08f07a50c95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19841@kfi7 remote: 0x18b0416fe4948088 expref: 8 pid: 60677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672193:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672193:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000099512fd6/0x21b6f08f07a50c5d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 19729@kfi7 remote: 0x944f3d3e3376c232 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672195:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672196:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ce3b4fe0/0x21b6f08f07a4e7b9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20435@kfi7 remote: 0x380878dde4845410 expref: 8 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672198:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672199:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b1e66817/0x21b6f08f07a4e781 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20417@kfi7 remote: 0x5c8a7ac080a1463e expref: 7 pid: 60769 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672202:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672203:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073db2a02/0x21b6f08f07a4e749 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 20289@kfi7 remote: 0xf9cf31e089704119 expref: 7 pid: 61039 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672205:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672206:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000fb0acb5/0x21b6f08f07a4e693 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13696@kfi7 remote: 0x1567c253ab7ea71a expref: 8 pid: 61176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672208:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672209:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000897cea85/0x21b6f08f07a4e30c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17633@kfi7 remote: 0xd7cf2b4a37ae8ee5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672211:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672211:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000ba78c03/0x21b6f08f07a4e2d4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17570@kfi7 remote: 0xaa1e31675b81c6f5 expref: 7 pid: 61024 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672213:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672214:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067d43774/0x21b6f08f07a4e264 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 22099@kfi7 remote: 0x2eed5fc18ca4054 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672216:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672217:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4dc85a6/0x21b6f08f07a4e0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25937@kfi7 remote: 0x574d56bbc781c236 expref: 10 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672219:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672220:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ccc5e964/0x21b6f08f07a4e0c7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26418@kfi7 remote: 0xed14d6305ffb5f5e expref: 9 pid: 61111 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672222:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672223:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000005275df1/0x21b6f08f07a4db41 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16115@kfi7 remote: 0x7b883183327f20c5 expref: 7 pid: 59132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672226:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672227:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0f48062/0x21b6f08f07a4db09 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15987@kfi7 remote: 0x269a22f0d8499557 expref: 7 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672228:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672229:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672231:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672232:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a41c7fd5/0x21b6f08f07a4dac3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9392@kfi7 remote: 0x1364b7a57f3b3fb8 expref: 6 pid: 61158 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672234:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672235:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672237:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672238:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e5fcc06/0x21b6f08f07a4cb11 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8691@kfi7 remote: 0xe67d5cc0bfa92df3 expref: 7 pid: 60836 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672240:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672241:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001441c4a1/0x21b6f08f07a4b848 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26545@kfi7 remote: 0xb4c4d0a6aee66653 expref: 9 pid: 60601 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672243:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672244:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000044401c34/0x21b6f08f07a4523c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26449@kfi7 remote: 0x5ff86eba66bec656 expref: 8 pid: 60568 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672246:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672246:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003100c182/0x21b6f08f07a441a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17008@kfi7 remote: 0x69d9e93dd9142cfa expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672249:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672250:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000047e36dd4/0x21b6f08f07a440fb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15025@kfi7 remote: 0xc7d0d54919792878 expref: 166 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672252:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672253:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000884c33e6/0x21b6f08f07a44053 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14945@kfi7 remote: 0x282a2b0c949fcc84 expref: 166 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672255:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672256:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007fde88be/0x21b6f08f07a4401b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17010@kfi7 remote: 0xea8767cff67d2cc0 expref: 167 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672258:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672258:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000029e590f0/0x21b6f08f07a43fab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17107@kfi7 remote: 0xfa43baef29338057 expref: 169 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672260:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672261:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001ffc128d/0x21b6f08f07a43f3b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16354@kfi7 remote: 0x3b6270f57f030754 expref: 168 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672263:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672264:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6a02def/0x21b6f08f07a43ef5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16480@kfi7 remote: 0x6e5958106a9276bf expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672266:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672267:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000072f4526b/0x21b6f08f07a43ecb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15264@kfi7 remote: 0xdbbd63e858e2fbe expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672269:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672270:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aee0c95b/0x21b6f08f07a43d89 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16931@kfi7 remote: 0x984da97548cdde5d expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672273:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672274:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d4d5b5fd/0x21b6f08f07a43cd3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16464@kfi7 remote: 0x24c6bc8158f53198 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672276:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672277:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000be2ec7b0/0x21b6f08f07a43c63 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16418@kfi7 remote: 0xe1e8bcd5f3d73acd expref: 166 pid: 41176 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672279:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672280:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d9672e1f/0x21b6f08f07a43c39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14928@kfi7 remote: 0x8e5c3aaa1e4dd762 expref: 166 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672282:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672282:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f8ab5eb1/0x21b6f08f07a43c1d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14867@kfi7 remote: 0x1ea7857ddfa69b3c expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672284:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672285:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de2aabec/0x21b6f08f07a43b83 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15168@kfi7 remote: 0xe920e5ddcdf01e1a expref: 167 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672287:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672288:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e45504a8/0x21b6f08f07a43b67 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17091@kfi7 remote: 0xb4c53cf92f3a10f4 expref: 168 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672290:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672291:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001510d4b6/0x21b6f08f07a43aa3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15249@kfi7 remote: 0x94587431dd466970 expref: 167 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672293:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672293:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027d9b7f7/0x21b6f08f07a43a95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14848@kfi7 remote: 0x73d9d778151b8bf9 expref: 168 pid: 60775 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672297:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672298:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c9320a18/0x21b6f08f07a43a4f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15251@kfi7 remote: 0x471be29d77d00f45 expref: 169 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672300:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672300:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002bf85b9c/0x21b6f08f07a43999 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14915@kfi7 remote: 0xcc79298405a84387 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672302:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672303:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000050311474/0x21b6f08f07a438f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16129@kfi7 remote: 0xfad1efe464a1d854 expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672305:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672306:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000083f60169/0x21b6f08f07a43723 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17360@kfi7 remote: 0xd90c54b0fbce3269 expref: 168 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672308:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672309:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c6f8bd8/0x21b6f08f07a43563 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15600@kfi7 remote: 0xecb1b4b94735e expref: 169 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672311:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672312:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c60103ee/0x21b6f08f07a434bb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15746@kfi7 remote: 0x4c83ee1056097c08 expref: 168 pid: 60552 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672314:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672315:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000045fa6fea/0x21b6f08f07a4344b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15395@kfi7 remote: 0x2ff35523bc61b23d expref: 166 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672317:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672317:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d641e4c/0x21b6f08f07a43413 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15921@kfi7 remote: 0xc888aea2167b6f3f expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672322:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672323:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e0a758eb/0x21b6f08f07a4336b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16482@kfi7 remote: 0x2ff7943acc0cf0ca expref: 167 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672325:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672326:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4292d10/0x21b6f08f07a432c3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16083@kfi7 remote: 0x8f12e087d65f5d7b expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672328:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672329:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007577918c/0x21b6f08f07a4321b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17616@kfi7 remote: 0x4bdab35193640482 expref: 167 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672331:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672331:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d66303e8/0x21b6f08f07a43165 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17233@kfi7 remote: 0xc4acac0fa1cf3469 expref: 166 pid: 60664 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672333:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672334:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1cd7404/0x21b6f08f07a430cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17649@kfi7 remote: 0x4672d4c7558f9eed expref: 168 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672336:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672337:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000066c132df/0x21b6f08f07a43093 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16593@kfi7 remote: 0xe78eab8eff402790 expref: 166 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672339:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672340:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000451f4ce0/0x21b6f08f07a42feb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16224@kfi7 remote: 0xdaf6d918fb9cc382 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672342:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672342:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000c8cb5ed4/0x21b6f08f07a42fcf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15666@kfi7 remote: 0x998ca149381abe04 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672345:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672346:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7e7eb30/0x21b6f08f07a42fc1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15488@kfi7 remote: 0x407d034c3fa91ddc expref: 169 pid: 60605 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672348:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672348:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fe013d07/0x21b6f08f07a42e2b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14385@kfi7 remote: 0x4aece5a4f1672448 expref: 167 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672351:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672351:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005349ebca/0x21b6f08f07a42cdb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10674@kfi7 remote: 0x3dcc8691941d13e5 expref: 172 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672353:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672354:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a54ec2c6/0x21b6f08f07a42cbf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17584@kfi7 remote: 0x75b55e9c42cf1443 expref: 166 pid: 61032 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672356:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672357:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007804ae7c/0x21b6f08f07a42cb1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14291@kfi7 remote: 0x6b3dd27c6e88e887 expref: 165 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672359:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672360:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002f5f78fd/0x21b6f08f07a42bfb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12611@kfi7 remote: 0xa6746a83d2494c66 expref: 166 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672362:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672362:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d0b00686/0x21b6f08f07a42b8b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12529@kfi7 remote: 0x831faae56111bd05 expref: 166 pid: 61058 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672365:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672365:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086cc300d/0x21b6f08f07a42b53 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13907@kfi7 remote: 0x6cd3bd055f5dfc97 expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672368:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672369:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6acfbbf/0x21b6f08f07a42a73 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12498@kfi7 remote: 0x695c72cd780f3140 expref: 165 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672371:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672371:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7581e56/0x21b6f08f07a42a65 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12803@kfi7 remote: 0x7361f42f6b558200 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672374:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672374:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007d31d541/0x21b6f08f07a429cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16864@kfi7 remote: 0xac6e72138b021d1f expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672376:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672377:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7d73e1c/0x21b6f08f07a428eb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13441@kfi7 remote: 0x2618676081f4181e expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672379:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672380:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e429cb4a/0x21b6f08f07a428b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13778@kfi7 remote: 0x5a4f978bc8f2917b expref: 165 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672382:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672382:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bdbe8715/0x21b6f08f07a4287b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12883@kfi7 remote: 0x98e7c0a03f9d9d55 expref: 166 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672384:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672385:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e7a54af5/0x21b6f08f07a4280b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11953@kfi7 remote: 0x7637e8b344b8e4b3 expref: 166 pid: 41175 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672387:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672388:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000240ce509/0x21b6f08f07a427ef lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16834@kfi7 remote: 0xbe5490b473a8a82b expref: 166 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672391:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672391:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003b1b4bb5/0x21b6f08f07a4272b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11649@kfi7 remote: 0x7725db2346783f03 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672393:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672394:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008ceab5a2/0x21b6f08f07a4271d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 11715@kfi7 remote: 0xcedd3a0fad4a6e2d expref: 168 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672396:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672397:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000780e677e/0x21b6f08f07a426d7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9987@kfi7 remote: 0xdb8664d366b8e871 expref: 166 pid: 42677 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672399:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672400:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002af2e9e8/0x21b6f08f07a423ab lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8514@kfi7 remote: 0x8ab1524b69c640a8 expref: 7 pid: 60604 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672402:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672402:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003edfe460/0x21b6f08f07a42373 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8592@kfi7 remote: 0x9d69fc283ef4cc2c expref: 17 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672404:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672405:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ba75d464/0x21b6f08f07a42303 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8658@kfi7 remote: 0x7b0aff8279d4634d expref: 7 pid: 60590 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672407:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672408:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073d7265c/0x21b6f08f07a422bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8530@kfi7 remote: 0x8b2d568a5edc3e19 expref: 7 pid: 60912 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672410:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672411:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6b69276/0x21b6f08f07a4217b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8931@kfi7 remote: 0xde0abe468d1e3c1c expref: 8 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672413:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672414:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005f59a500/0x21b6f08f07a42143 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8882@kfi7 remote: 0x21bc629b7a549f56 expref: 8 pid: 60838 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672416:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672417:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e4b71a32/0x21b6f08f07a4210b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c1ed expref: 10 pid: 60962 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672419:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672420:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cdcaf92/0x21b6f08f07a4209b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8642@kfi7 remote: 0xea34c370deef0cde expref: 7 pid: 60974 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672422:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672422:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000246f4386/0x21b6f08f07a41a27 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8387@kfi7 remote: 0xa5c56a10f7338098 expref: 7 pid: 61074 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672424:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672425:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000000a5b8cce/0x21b6f08f07a4151f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 8256@kfi7 remote: 0x347c41b86e4dfbf1 expref: 14 pid: 60473 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672427:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672428:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000094e508f2/0x21b6f08f07a3f234 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24128@kfi7 remote: 0x982498fe0360b593 expref: 24 pid: 61045 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672430:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672431:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000067536a88/0x21b6f08f0305c307 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16145@kfi7 remote: 0x54ccd0401868309 expref: 165 pid: 60551 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672433:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672434:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000130899e5/0x21b6f08f0301ae39 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9760@kfi7 remote: 0x106df78870ac07d expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672436:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672437:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000284a9f84/0x21b6f08f02fb005d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12641@kfi7 remote: 0x24b138e3005e8f48 expref: 165 pid: 60622 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672439:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672440:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000069ea4cf4/0x21b6f08f02e26db0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10961@kfi7 remote: 0x51e0b5c79b6644ed expref: 165 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672442:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672443:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000041a9ff07/0x21b6f08f02dbf7f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15729@kfi7 remote: 0xa0feec80b834067 expref: 167 pid: 60783 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672445:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672445:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000aa246925/0x21b6f08f02dbc3cb lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14881@kfi7 remote: 0xea22bfae427978b6 expref: 167 pid: 60970 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672447:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672448:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000983c4951/0x21b6f08f02db260c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16322@kfi7 remote: 0xf3cbe73fc05c172 expref: 168 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672450:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672451:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006deda6e3/0x21b6f08f02cc4c33 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14899@kfi7 remote: 0x6ee9f78399111732 expref: 165 pid: 61103 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672453:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672453:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d49c16ac/0x21b6f08f02c83a05 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9744@kfi7 remote: 0xda76152b3e6c095b expref: 165 pid: 60868 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672455:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672456:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000014fa8595/0x21b6f08f02b3fbe3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16369@kfi7 remote: 0xd34db448dcdf76fb expref: 166 pid: 60501 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672459:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672459:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000043d9b50b/0x21b6f08f02b3e58c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16096@kfi7 remote: 0x45339c0e25633a5f expref: 163 pid: 60652 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672461:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672462:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000071d6944b/0x21b6f08f02b165d0 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13921@kfi7 remote: 0x3d95f7462ab0e50e expref: 164 pid: 61005 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672464:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672465:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a0211c18/0x21b6f08f02a70f6e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16978@kfi7 remote: 0x2df2f2f0d3882969 expref: 167 pid: 60976 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672467:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672468:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002e9042e9/0x21b6f08f029965b3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16929@kfi7 remote: 0x40bfc99243c6ce6c expref: 164 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672470:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672471:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000089178226/0x21b6f08f0295bbc8 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25569@kfi7 remote: 0x1f799143310daa52 expref: 22 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672473:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672473:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ec8daeb/0x21b6f08f02948433 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17778@kfi7 remote: 0x843c247831d438d expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672475:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672476:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ef1e3d49/0x21b6f08f029482a4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17777@kfi7 remote: 0x923b33308b682b8 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672478:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672479:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d5cf231c/0x21b6f08f0293feca lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17618@kfi7 remote: 0x48a62a125212f30a expref: 165 pid: 61062 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672482:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672483:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000648d24af/0x21b6f08f0293fc0e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17488@kfi7 remote: 0x86d181539a58d741 expref: 167 pid: 60948 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672485:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672485:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a2a29b87/0x21b6f08f029388bf lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17152@kfi7 remote: 0x9e34c1d6be2dacc6 expref: 166 pid: 41796 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672487:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672488:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000001619a458/0x21b6f08f028de1f6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17729@kfi7 remote: 0x4ff3e6a142276d21 expref: 164 pid: 60798 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672490:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672491:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007c4615b6/0x21b6f08f028de124 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17185@kfi7 remote: 0x620f7d78d330ac5e expref: 166 pid: 60925 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672493:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672494:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d704f860/0x21b6f08f028d96c4 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16963@kfi7 remote: 0x3a97adb2b6d4ee expref: 163 pid: 60598 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672496:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672496:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000532ccd30/0x21b6f08f0289dc94 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16690@kfi7 remote: 0xc2d4114f8b6e052e expref: 168 pid: 60537 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672498:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672499:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b93e2d6d/0x21b6f08f028830c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26210@kfi7 remote: 0x27cd5cd235deabd7 expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672501:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672502:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008532433/0x21b6f08f02882f95 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26195@kfi7 remote: 0x24b36e38fdd0308c expref: 22 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672504:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672505:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003bc7a078/0x21b6f08f0283d4ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10643@kfi7 remote: 0x10db8655a1e2bd77 expref: 168 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672507:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672508:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000040136faa/0x21b6f08f027f5785 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15155@kfi7 remote: 0x914b099512679efd expref: 166 pid: 60744 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672510:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672511:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000073a6f47a/0x21b6f08f027f5651 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15107@kfi7 remote: 0x46f82657fe38a81f expref: 166 pid: 60559 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672513:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672513:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f9d23788/0x21b6f08f027f3c5e lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15474@kfi7 remote: 0xe805a3dde13fc895 expref: 166 pid: 60619 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672515:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672516:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000008bd034d/0x21b6f08f027c558c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14946@kfi7 remote: 0xf8f187f877781a14 expref: 165 pid: 60893 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672518:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672519:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b9f9f648/0x21b6f08f0274120b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14864@kfi7 remote: 0xdebda194ce95b2a4 expref: 166 pid: 60892 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672521:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672522:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000026d2281b/0x21b6f08f0245f755 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25027@kfi7 remote: 0x97a5b08947639b98 expref: 20 pid: 60745 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672524:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672524:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000a1a40f2d/0x21b6f08f0245f5a3 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13683@kfi7 remote: 0xe1cb1a219e563507 expref: 164 pid: 60806 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672527:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672527:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008d59de77/0x21b6f08f02245643 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 24896@kfi7 remote: 0xbdaf42aef7ec6c6 expref: 22 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672529:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672530:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d79c75b8/0x21b6f08f021eae69 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16210@kfi7 remote: 0xf9d0b66655a41513 expref: 168 pid: 60468 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672532:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672533:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000157f1abb/0x21b6f08f01f95b5b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15283@kfi7 remote: 0x5c87b25547b3661d expref: 168 pid: 61065 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672535:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672535:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000046080b7a/0x21b6f08f01439060 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15731@kfi7 remote: 0xba2c126598284639 expref: 168 pid: 60757 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672537:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672538:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004151c940/0x21b6f08f013ca8ee lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15697@kfi7 remote: 0x9bb2823651034e90 expref: 164 pid: 60956 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672540:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672541:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000064e7ddfb/0x21b6f08f013b2e8c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16435@kfi7 remote: 0x283fc291e8dc5eb8 expref: 166 pid: 60869 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672543:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672544:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000082f3ec5a/0x21b6f08f0133f6af lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10305@kfi7 remote: 0xecaa6f6ab3bb0fc0 expref: 161 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672546:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672547:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002844aed6/0x21b6f08f012c21c2 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 12272@kfi7 remote: 0xe4263bc3dfe10b65 expref: 160 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672549:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672550:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000027cb7fc0/0x21b6f08f00e32e5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14912@kfi7 remote: 0x5eb40385e17cbfb6 expref: 168 pid: 59136 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672552:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672552:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000638e50be/0x21b6f08f00e2f815 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15313@kfi7 remote: 0x2cd47d4f24b814d3 expref: 166 pid: 60984 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672554:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672555:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000030a779b0/0x21b6f08f00c4f5db lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14546@kfi7 remote: 0x476f368782be0136 expref: 166 pid: 60872 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672557:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672558:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009aa79dbb/0x21b6f08f0084f806 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15393@kfi7 remote: 0x1f9cbf875ee80d2 expref: 165 pid: 60729 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672560:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672561:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000de67dcad/0x21b6f08f003e7392 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14016@kfi7 remote: 0x816cce5b9a870705 expref: 169 pid: 42670 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672562:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672563:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e581b81c/0x21b6f08f0031ded5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16721@kfi7 remote: 0x410330ba6fb26a25 expref: 166 pid: 61191 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672565:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672566:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d6d28fce/0x21b6f08f000f18c6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17104@kfi7 remote: 0xe81d4bcb03be2f03 expref: 165 pid: 60826 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672568:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672569:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000daad043a/0x21b6f08f000f0c5c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16961@kfi7 remote: 0xd246095424896e2c expref: 171 pid: 60706 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672571:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672572:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000131aec2e/0x21b6f08effdbc40d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16993@kfi7 remote: 0x7797faf8438cb1c2 expref: 166 pid: 60630 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672574:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672574:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e3fdf2f4/0x21b6f08effdab3bc lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17745@kfi7 remote: 0xab64cd6cd0f8c88a expref: 165 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672577:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672577:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000005d97bbe7/0x21b6f08effdab00b lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17824@kfi7 remote: 0xec45408b52c09449 expref: 166 pid: 61047 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672579:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672580:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000f551b5b1/0x21b6f08effb45009 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16530@kfi7 remote: 0x971f0c311ee72e44 expref: 167 pid: 60615 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672582:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672583:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e1a51b10/0x21b6f08effb44f22 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16515@kfi7 remote: 0x8424db10fcc5367e expref: 166 pid: 60989 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672585:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672585:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000fb1b09d3/0x21b6f08effb4162d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17314@kfi7 remote: 0x49ac162b424bc46a expref: 166 pid: 60847 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672587:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672588:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000008cfbfbb9/0x21b6f08effb39261 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16594@kfi7 remote: 0x422a410e75e650f4 expref: 167 pid: 60842 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672590:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672591:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000d8c75827/0x21b6f08effa8f58f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17283@kfi7 remote: 0xd314f3fd9d73bc4b expref: 166 pid: 60582 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672593:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672594:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bb7d637c/0x21b6f08eff5ca679 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14963@kfi7 remote: 0x1084b4eff8aa17b0 expref: 166 pid: 60843 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672596:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672597:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004ae78062/0x21b6f08eff5be7f1 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15137@kfi7 remote: 0xdbeb890ba72aa32f expref: 168 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672599:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672600:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000025d52cb9/0x21b6f08efefa5c66 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 13872@kfi7 remote: 0x9ed456cec826716b expref: 160 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672602:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672603:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000075b90b49/0x21b6f08efefa5b40 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14048@kfi7 remote: 0x203c4d0f2a3a6a3c expref: 161 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672605:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672606:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004862b2b1/0x21b6f08efec34898 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14256@kfi7 remote: 0x1e3c68f62e54459b expref: 169 pid: 61143 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672608:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672608:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000031aec5bb/0x21b6f08efec3467d lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14176@kfi7 remote: 0x959f7e487d48c887 expref: 166 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672610:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672611:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009a009c3e/0x21b6f08efeb89bce lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25602@kfi7 remote: 0xa31a2ef1dfcb0577 expref: 22 pid: 60963 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672613:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672614:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e364a5e5/0x21b6f08efe87d5f7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15217@kfi7 remote: 0xa04a5d4364c06c7a expref: 167 pid: 60716 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672616:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672617:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000076e77735/0x21b6f08efe87cc26 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16099@kfi7 remote: 0x7a0a80c742905c39 expref: 168 pid: 61190 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672619:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672620:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000003eb0ca0a/0x21b6f08efe335fe5 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 9042@kfi7 remote: 0xd0fab01d9fe00f7b expref: 169 pid: 60532 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672622:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672623:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000e6c97e32/0x21b6f08efe2a0d32 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15554@kfi7 remote: 0xbd39790bbd7e4f51 expref: 169 pid: 41181 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672625:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672625:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b4997f8c/0x21b6f08efe1ebf84 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16032@kfi7 remote: 0x2879f735e0f13ac9 expref: 166 pid: 60712 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672627:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672628:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009ba2bdb8/0x21b6f08efde3809f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17280@kfi7 remote: 0xad673c58f141a711 expref: 171 pid: 60760 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672630:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672631:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004262a0a4/0x21b6f08efde379a6 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17171@kfi7 remote: 0xf3e46522fe09b1b3 expref: 167 pid: 61132 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672633:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672634:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007e09c02b/0x21b6f08efdc4a5ea lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17139@kfi7 remote: 0x58b70fda2c516cfd expref: 168 pid: 60926 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672636:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672636:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000864d1e67/0x21b6f08efd85acc7 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 25329@kfi7 remote: 0xd009328ade9efb35 expref: 21 pid: 61100 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672639:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672640:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000ca094a5d/0x21b6f08efd22a1bd lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 10899@kfi7 remote: 0x3749a7efdbf644ff expref: 159 pid: 61044 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672642:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672643:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000007ad7e27c/0x21b6f08efd1bb0ff lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15635@kfi7 remote: 0x1bb8e14de7ef1f22 expref: 164 pid: 60748 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672645:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672646:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000002cd4d11d/0x21b6f08efccf1fd9 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16352@kfi7 remote: 0x7ab3c0b813ef6f1c expref: 165 pid: 60711 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672648:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672649:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000009b5b14f5/0x21b6f08efccf1d0f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 15937@kfi7 remote: 0x7a5ad29e1cad06a6 expref: 166 pid: 61002 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672651:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672651:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006b825027/0x21b6f08efc8e8a6c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 17392@kfi7 remote: 0x6318bf4462e12df1 expref: 169 pid: 60696 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672653:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672654:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000b41b3824/0x21b6f08efc27c86c lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 26035@kfi7 remote: 0x370db1399629c2bb expref: 25 pid: 60638 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672656:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672657:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 00000000bf246cc9/0x21b6f08efc07570f lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 14321@kfi7 remote: 0x67e1f817060f149 expref: 168 pid: 61151 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672659:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672660:0:41182:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000004c0811ab/0x21b6f08ef7d8a225 lrc: 2/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40200000000000 nid: 16994@kfi7 remote: 0x4086f1ab43dbb8e3 expref: 167 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672662:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00010000:26.0:1773851901.672663:0:41182:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 00000000e01b3f2a/0x21b6f08f07a6aef8 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672665:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:26.0:1773851901.672666:0:41182:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:26.0:1773851901.672667:0:41182:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:26.0:1773851901.672667:0:41182:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.672668:0:41182:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:26.0:1773851901.672668:0:41182:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.672669:0:41182:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.672669:0:41182:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:26.0:1773851901.672670:0:41182:0:(ldlm_request.c:271:ldlm_completion_ast()) Process entered
00010000:00000001:26.0:1773851901.672670:0:41182:0:(ldlm_request.c:280:ldlm_completion_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:26.0:1773851901.672671:0:41182:0:(ldlm_request.c:528:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 00000000e01b3f2a/0x21b6f08f07a6aef8 lrc: 3/1,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672673:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000001:26.0:1773851901.672674:0:41182:0:(ldlm_request.c:529:ldlm_cli_enqueue_local()) Process leaving
00010000:00000001:26.0:1773851901.672674:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.672675:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.672675:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.672676:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.672676:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e01b3f2a refcount=3
00000020:00000001:26.0:1773851901.672677:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000001:26.0:1773851901.672677:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000001:26.0:1773851901.672678:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.672678:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.672679:0:41182:0:(mdt_handler.c:3855:mdt_object_local_lock()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672679:0:41182:0:(mdt_handler.c:3870:mdt_object_lock_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672680:0:41182:0:(mdt_handler.c:1355:mdt_getattr_internal()) Process entered
00000004:00000001:26.0:1773851901.672681:0:41182:0:(mdt_handler.c:1235:mdt_attr_get_complex()) Process entered
00000004:00000001:26.0:1773851901.672682:0:41182:0:(mdd_object.c:376:mdd_attr_get()) Process entered
00000004:00000001:26.0:1773851901.672686:0:41182:0:(mdd_object.c:382:mdd_attr_get()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672687:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851901.672688:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.672688:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.672689:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672689:0:41182:0:(lod_object.c:1623:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672690:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672691:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851901.672691:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.672691:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.672692:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672692:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672693:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000002:26.0:1773851901.672693:0:41182:0:(mdt_handler.c:1320:mdt_attr_get_complex()) after getattr rc = 0, ma_valid = 0x1 ma_lmm=0000000000000000
00000004:00000001:26.0:1773851901.672694:0:41182:0:(mdt_handler.c:1321:mdt_attr_get_complex()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672695:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.672695:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672696:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.672696:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:26.0:1773851901.672697:0:41182:0:(nodemap_handler.c:664:nodemap_map_id()) Process entered
00000001:00000001:26.0:1773851901.672697:0:41182:0:(nodemap_handler.c:719:nodemap_map_id()) Process leaving (rc=0 : 0 : 0)
00000004:00000002:26.0:1773851901.672697:0:41182:0:(mdt_handler.c:869:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: nlink=2, mode=42755, valid=0x100000000000278f
00000004:00200000:26.0:1773851901.672698:0:41182:0:(mdt_handler.c:912:mdt_pack_attr2body()) [0x24002684f:0x62d0:0x0]: returning size 37888
00000004:00200000:26.0:1773851901.672699:0:41182:0:(mdt_handler.c:1523:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 6
00000004:00000002:26.0:1773851901.672700:0:41182:0:(mdt_handler.c:1577:mdt_getattr_internal()) changing the max MD size to 2008
00000001:00000001:26.0:1773851901.672700:0:41182:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:26.0:1773851901.672700:0:41182:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672701:0:41182:0:(mdt_handler.c:699:mdt_pack_acl2body()) Process entered
00000004:00000001:26.0:1773851901.672702:0:41182:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:26.0:1773851901.672702:0:41182:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.672702:0:41182:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:26.0:1773851901.672703:0:41182:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672703:0:41182:0:(lod_object.c:1680:lod_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672704:0:41182:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=18446744073709551555 : -61 : ffffffffffffffc3)
00000004:00000001:26.0:1773851901.672705:0:41182:0:(mdt_handler.c:773:mdt_pack_acl2body()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.672705:0:41182:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:26.0:1773851901.672706:0:41182:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672707:0:41182:0:(mdt_handler.c:1597:mdt_getattr_internal()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672709:0:41182:0:(mdt_handler.c:2098:mdt_getattr_name_lock()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.672709:0:41182:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:26.0:1773851901.672710:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851901.672710:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e01b3f2a refcount=3
00000020:00000001:26.0:1773851901.672711:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000001:26.0:1773851901.672711:0:41182:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00000004:00000040:26.0:1773851901.672712:0:41182:0:(mdt_handler.c:4413:mdt_intent_lock_replace()) lock GETting export 000000002338620b : new locks_count 5
00000020:00000040:26.0:1773851901.672713:0:41182:0:(genops.c:871:class_export_get()) GET export 000000002338620b refcount=11
00010000:00000001:26.0:1773851901.672713:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.672714:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:26.0:1773851901.672714:0:41182:0:(mdt_handler.c:4430:mdt_intent_lock_replace()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851901.672715:0:41182:0:(mdt_handler.c:4589:mdt_intent_getattr()) Process leaving
02000000:00000001:26.0:1773851901.672715:0:41182:0:(upcall_cache.c:279:upcall_cache_put_entry()) Process entered
02000000:00000001:26.0:1773851901.672715:0:41182:0:(upcall_cache.c:290:upcall_cache_put_entry()) Process leaving
00000004:00000001:26.0:1773851901.672716:0:41182:0:(mdt_handler.c:933:mdt_client_compatibility()) Process entered
00000004:00000001:26.0:1773851901.672716:0:41182:0:(mdt_handler.c:937:mdt_client_compatibility()) Process leaving
00000004:00000001:26.0:1773851901.672716:0:41182:0:(mdt_lib.c:741:mdt_fix_reply()) Process entered
00000004:00000040:26.0:1773851901.672717:0:41182:0:(mdt_lib.c:761:mdt_fix_reply()) Shrink to md_size = 0 cookie/acl_size = 0
00000004:00000001:26.0:1773851901.672718:0:41182:0:(mdt_lib.c:877:mdt_fix_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:26.0:1773851901.672718:0:41182:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:26.0:1773851901.672719:0:41182:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000020:00000002:26.0:1773851901.672719:0:41182:0:(lu_object.c:224:lu_object_put()) Add 00000000de762604/00000000a9cba94d to site lru. bkt: 00000000cea38b70
00000004:00000001:26.0:1773851901.672720:0:41182:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:26.0:1773851901.672720:0:41182:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:26.0:1773851901.672721:0:41182:0:(ldlm_lock.c:420:ldlm_lock_destroy()) Process entered
00010000:00000001:26.0:1773851901.672721:0:41182:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:26.0:1773851901.672722:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.672722:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.672722:0:41182:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:26.0:1773851901.672723:0:41182:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:26.0:1773851901.672723:0:41182:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000813103dd with handle 0x21b6f08f07a6aef1 from hash
00010000:00000001:26.0:1773851901.672724:0:41182:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:26.0:1773851901.672728:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.672728:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.672729:0:41182:0:(ldlm_lock.c:430:ldlm_lock_destroy()) Process leaving
00010000:00000001:26.0:1773851901.672729:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:26.0:1773851901.672730:0:41182:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000813103dd/0x21b6f08f07a6aef1 lrc: 0/0,0 mode: --/CR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x2/0x0 rrc: 196 type: IBT gid 0 flags: 0x44000000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2f7 expref: 11 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672732:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:26.0:1773851901.672733:0:41182:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002338620b : new locks_count 4
00000020:00000040:26.0:1773851901.672733:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 10
00010000:00000010:26.0:1773851901.672734:0:41182:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000002e11f02b.
00010000:00000040:26.0:1773851901.672735:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:26.0:1773851901.672735:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:26.0:1773851901.672736:0:41182:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.672736:0:41182:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:26.0:1773851901.672737:0:41182:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 00000000e01b3f2a/0x21b6f08f07a6aef8 lrc: 3/0,0 mode: PR/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x40200000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2f7 expref: 10 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:26.0:1773851901.672739:0:41182:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:26.0:1773851901.672740:0:41182:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:26.0:1773851901.672741:0:41182:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:26.0:1773851901.672741:0:41182:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00010000:26.0:1773851901.672742:0:41182:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 12
00010000:00000001:26.0:1773851901.672743:0:41182:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:26.0:1773851901.672744:0:41182:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851901.672744:0:41182:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:26.0:1773851901.672744:0:41182:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:26.0:1773851901.672745:0:41182:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:26.0:1773851901.672745:0:41182:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 00000000e01b3f2a, rc 0)
00000020:00000001:26.0:1773851901.672746:0:41182:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851901.672746:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183110002015, transno 0, xid 1859313734891328
00010000:00000001:26.0:1773851901.672747:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851901.672748:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000023fc2e36 x1859313734891328/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 576/640 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00010000:00000001:26.0:1773851901.672753:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851901.672753:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851901.672754:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=134 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851901.672755:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851901.672755:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:26.0:1773851901.672756:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:26.0:1773851901.672757:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851901.672757:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851901.672758:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851901.672758:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8946@kfi7
00000400:00000010:26.0:1773851901.672759:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a08fe443.
00000100:00000200:26.0:1773851901.672759:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 640 bytes to portal 10, xid 1859313734891328, offset 224
00000400:00000200:26.0:1773851901.672761:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8946@kfi7
00000400:00000200:26.0:1773851901.672761:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.672762:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 1
00000400:00000200:26.0:1773851901.672763:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.672764:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000400:00000200:26.0:1773851901.672765:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8946@kfi7 local destination
00000400:00000200:26.0:1773851901.672766:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770398:8770398:1024:4294967295] 8946@kfi7 LPNI seq info [5400478:5400478:16:4294967295]
00000400:00000200:26.0:1773851901.672767:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000400:00000200:26.0:1773851901.672768:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8946@kfi7 to cpt 6
00000400:00000200:26.0:1773851901.672770:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8946@kfi7(8946@kfi7:8946@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851901.672771:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 3
00000800:00000200:26.0:1773851901.672772:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851901.672773:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 640 bytes in 1 frags
00000800:00000200:26.0:1773851901.672775:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851901.672777:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Using peer 8946@kfi7(0xf82)
00000800:00000200:26.0:1773851901.672781:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000034381e9b: Posted send of 740 bytes to peer 0xf82: rc=0
00000800:00000200:26.0:1773851901.672782:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851901.672784:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851901.672784:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:26.0:1773851901.672785:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851901.672785:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851901.672786:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851901.672786:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000023fc2e36 x1859313734891328/t0(0) o101->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:182/0 lens 576/640 e 0 to 0 dl 1773852297 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1033-0'
00000100:00100000:26.0:1773851901.672789:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000023fc2e36 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:5ac50477-c5c0-47ab-9937-99f367ea73c9+10:2028291:x1859313734891328:12345-8754@kfi7:101:default-tuolumne1033-0 Request processed in 754us (777us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851901.672791:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 1451911047
00000100:00000040:26.0:1773851901.672792:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 0
00000100:00000001:26.0:1773851901.672792:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851901.672793:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851901.672793:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851901.672794:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000020:00000010:26.0:1773851901.672795:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f5cb6f5.
00000020:00000040:26.0:1773851901.672795:0:41182:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 9
00000800:00000200:25.0:1773851901.672795:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851901.672796:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851901.672796:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851901.672797:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8946@kfi7: PUT: OK
00000400:00000200:25.0:1773851901.672797:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a08fe443
00000400:00000010:25.0:1773851901.672798:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a08fe443.
00000100:00000001:25.0:1773851901.672799:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851901.672799:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851901.672799:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8858503 nid 8946@kfi7 refs 2
00000800:00000200:25.0:1773851901.672801:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000034381e9b: 2069@kfi7:6 -> 8946@kfi7(000000003fbf98bc):0x0 lsk 3971 rsk 53 tsk 0 trmk 0 tmk 0 trr 6 tta 0xf82 Transaction freed
00000800:00000200:13.0:1773851901.673052:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851901.673053:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851901.673054:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851901.673056:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851901.673058:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.673059:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8754@kfi7 : PUT - for me
00000400:00000200:13.0:1773851901.673060:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.673061:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000400:00000200:13.0:1773851901.673062:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.673063:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:13.0:1773851901.673063:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000400:00000200:13.0:1773851901.673064:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.673065:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8754@kfi7 of length 328 into portal 17 MB=0x69b0936b1b7c0
00000400:00000200:13.0:1773851901.673066:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-8754@kfi7 of length 328/328 into md 0x82a56312d [2] + 1424
00000800:00000200:13.0:1773851901.673068:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851901.673069:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.673070:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000100:00000001:13.0:1773851901.673071:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851901.673074:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:13.0:1773851901.673075:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000608f00b.
00000100:00000040:13.0:1773851901.673076:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000000608f00b x1859313734891456 msgsize 328
00000100:00100000:13.0:1773851901.673077:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8754@kfi7 (source: 12345-8754@kfi7)
00000100:00000001:13.0:1773851901.673078:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851901.673079:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000100:00000001:12.0:1773851901.673079:0:609420:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851901.673080:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851901.673080:0:609420:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851901.673080:0:609420:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851901.673081:0:609420:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851901.673082:0:609420:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851901.673082:0:609420:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859313734891456
00000020:00000001:12.0:1773851901.673083:0:609420:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851901.673084:0:609420:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f80
00000020:00000001:12.0:1773851901.673084:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.673085:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002338620b refcount=10
00000020:00000001:12.0:1773851901.673086:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000020:00000001:12.0:1773851901.673086:0:609420:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744934400 : -107128964617216 : ffff9e91181e6c00)
00000100:00000001:12.0:1773851901.673087:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.673088:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851901.673089:0:609420:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00000020:00000010:12.0:1773851901.673090:0:609420:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.673091:0:609420:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000040:12.0:1773851901.673092:0:609420:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:12.0:1773851901.673092:0:609420:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851901.673093:0:609420:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:12.0:1773851901.673093:0:609420:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:12.0:1773851901.673094:0:609420:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.673094:0:609420:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:12.0:1773851901.673095:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851901.673095:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.673096:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e01b3f2a refcount=3
00000020:00000001:12.0:1773851901.673096:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000001:12.0:1773851901.673097:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000001:12.0:1773851901.673098:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.673099:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.673099:0:609420:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.673100:0:609420:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.673101:0:609420:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.673102:0:609420:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851901.673103:0:536982:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:13.0:1773851901.673103:0:536982:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851901.673103:0:609420:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851901.673103:0:609420:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851901.673104:0:609420:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8754@kfi7, seq: 50273010
00000100:00000001:13.0:1773851901.673105:0:536982:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.673105:0:609420:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002338620b : new rpc_count 1
00000100:00000001:13.0:1773851901.673106:0:536982:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.673106:0:609420:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945715840 : -106919763835776 : ffff9ec1cd750480)
00000100:00000040:12.0:1773851901.673107:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000608f00b x1859313734891456/t0(0) o103->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 328/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:12.0:1773851901.673110:0:609420:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.673110:0:609420:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851901.673111:0:609420:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000608f00b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:5ac50477-c5c0-47ab-9937-99f367ea73c9+10:39868:x1859313734891456:12345-8754@kfi7:103:
00000100:00000200:12.0:1773851901.673112:0:609420:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859313734891456
00010000:00000001:12.0:1773851901.673113:0:609420:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:12.0:1773851901.673114:0:609420:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:12.0:1773851901.673114:0:609420:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:12.0:1773851901.673115:0:609420:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851901.673116:0:609420:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851901.673116:0:609420:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000026d53c71.
02000000:00000001:12.0:1773851901.673117:0:609420:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.673118:0:609420:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.673119:0:609420:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:12.0:1773851901.673119:0:609420:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0
00010000:00000001:12.0:1773851901.673120:0:609420:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:12.0:1773851901.673120:0:609420:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.673120:0:609420:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000e01b3f2a refcount=3
00000020:00000001:12.0:1773851901.673121:0:609420:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000001:12.0:1773851901.673122:0:609420:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637061011888320 : -107012697663296 : ffff9eac2a2b58c0)
00010000:00000040:12.0:1773851901.673122:0:609420:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 195
00000004:00000001:12.0:1773851901.673123:0:609420:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:12.0:1773851901.673123:0:609420:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:12.0:1773851901.673124:0:609420:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:12.0:1773851901.673124:0:609420:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:12.0:1773851901.673125:0:609420:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.673125:0:609420:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.673127:0:609420:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:12.0:1773851901.673127:0:609420:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:12.0:1773851901.673128:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.673129:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.673129:0:609420:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:12.0:1773851901.673130:0:609420:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:12.0:1773851901.673130:0:609420:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000e01b3f2a with handle 0x21b6f08f07a6aef8 from hash
00010000:00000001:12.0:1773851901.673132:0:609420:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:12.0:1773851901.673132:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:12.0:1773851901.673132:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.673133:0:609420:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:12.0:1773851901.673133:0:609420:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:12.0:1773851901.673134:0:609420:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.673134:0:609420:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:12.0:1773851901.673135:0:609420:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:12.0:1773851901.673136:0:609420:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000e01b3f2a/0x21b6f08f07a6aef8 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 8754@kfi7 remote: 0xd0f5706c4644c2f7 expref: 10 pid: 41182 timeout: 0 lvb_type: 0
00010000:00000040:12.0:1773851901.673139:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 195
00010000:00000040:12.0:1773851901.673139:0:609420:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000002338620b : new locks_count 3
00000020:00000040:12.0:1773851901.673140:0:609420:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 9
00010000:00000010:12.0:1773851901.673141:0:609420:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000001001fa8.
00010000:00000040:12.0:1773851901.673142:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000001:12.0:1773851901.673142:0:609420:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:12.0:1773851901.673143:0:609420:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:12.0:1773851901.673143:0:609420:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:12.0:1773851901.673144:0:609420:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:12.0:1773851901.673145:0:609420:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851901.673145:0:609420:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.673146:0:609420:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:12.0:1773851901.673146:0:609420:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00010000:12.0:1773851901.673147:0:609420:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:12.0:1773851901.673147:0:609420:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:12.0:1773851901.673148:0:609420:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851901.673149:0:609420:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851901.673149:0:609420:0:(import.c:1951:at_measured()) add 1 to 000000007924b58f time=5 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851901.673150:0:609420:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851901.673151:0:609420:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000597753c9 refcount 3 to 8754@kfi7
00000100:00000001:12.0:1773851901.673152:0:609420:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917717418848 : -107155992132768 : ffff9e8acd274360)
02000000:00000001:12.0:1773851901.673153:0:609420:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851901.673153:0:609420:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.673154:0:609420:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851901.673154:0:609420:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8754@kfi7
00000400:00000010:12.0:1773851901.673155:0:609420:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000df1f761c.
00000100:00000200:12.0:1773851901.673156:0:609420:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859313734891456, offset 224
00000400:00000200:12.0:1773851901.673157:0:609420:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8754@kfi7
00000400:00000200:12.0:1773851901.673158:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.673159:0:609420:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 1
00000400:00000200:12.0:1773851901.673160:0:609420:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:12.0:1773851901.673161:0:609420:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000400:00000200:12.0:1773851901.673162:0:609420:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8754@kfi7 local destination
00000400:00000200:12.0:1773851901.673163:0:609420:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770399:8770399:1024:4294967295] 8754@kfi7 LPNI seq info [5400479:5400479:16:4294967295]
00000400:00000200:12.0:1773851901.673165:0:609420:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000400:00000200:12.0:1773851901.673165:0:609420:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8754@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.673168:0:609420:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8754@kfi7(8754@kfi7:8754@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851901.673169:0:609420:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 3
00000800:00000200:12.0:1773851901.673170:0:609420:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851901.673171:0:609420:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851901.673173:0:609420:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851901.673176:0:609420:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Using peer 8754@kfi7(0x10000000000000a)
00000800:00000200:12.0:1773851901.673179:0:609420:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x10000000000000a: rc=0
00000800:00000200:12.0:1773851901.673180:0:609420:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851901.673182:0:609420:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.673183:0:609420:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000597753c9 refcount 2 to 8754@kfi7
00010000:00000001:12.0:1773851901.673184:0:609420:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:12.0:1773851901.673184:0:609420:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.673185:0:609420:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000608f00b x1859313734891456/t0(0) o103->5ac50477-c5c0-47ab-9937-99f367ea73c9@8754@kfi7:628/0 lens 328/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:12.0:1773851901.673189:0:609420:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000608f00b pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn03_022:5ac50477-c5c0-47ab-9937-99f367ea73c9+9:39868:x1859313734891456:12345-8754@kfi7:103: Request processed in 78us (113us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851901.673191:0:609420:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8754@kfi7, seq: 50273010
00000100:00000040:12.0:1773851901.673192:0:609420:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002338620b : new rpc_count 0
00000100:00000001:12.0:1773851901.673192:0:609420:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851901.673193:0:609420:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851901.673193:0:609420:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.673196:0:609420:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851901.673197:0:609420:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851901.673197:0:609420:0:(genops.c:882:class_export_put()) PUTting export 000000002338620b : new refcount 8
00000100:00000001:12.0:1773851901.673198:0:609420:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851901.673203:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851901.673204:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.673205:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8754@kfi7: PUT: OK
00000400:00000200:13.0:1773851901.673206:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000df1f761c
00000400:00000010:13.0:1773851901.673207:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000df1f761c.
00000100:00000001:13.0:1773851901.673207:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851901.673208:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851901.673209:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014f19429 nid 8754@kfi7 refs 2
00000800:00000200:13.0:1773851901.673210:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 8754@kfi7(00000000a7328de8):0x0 lsk 11 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x10000000000000a Transaction freed
00010000:00000010:12.1:1773851901.673727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006a6e8496.
00010000:00000010:26.1:1773851901.673728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000056845fce.
00000800:00000200:5.0:1773851901.674834:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851901.674836:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851901.674838:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851901.674841:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851901.674844:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.674846:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2098@kfi7 : PUT - for me
00000400:00000200:5.0:1773851901.674848:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.674850:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:5.0:1773851901.674851:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.674852:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:5.0:1773851901.674854:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:5.0:1773851901.674855:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:5.0:1773851901.674857:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed462700
00000400:00000200:5.0:1773851901.674859:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x793844545 [256] + 9288
00000800:00000200:5.0:1773851901.674862:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851901.674864:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.674866:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2098@kfi7: PUT: OK
00000100:00000001:5.0:1773851901.674867:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851901.674868:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851901.674869:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000007615868.
00000100:00000040:5.0:1773851901.674871:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000007615868 x1858062667622144 msgsize 224
00000100:00100000:5.0:1773851901.674873:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2098@kfi7)
00000100:00000001:5.0:1773851901.674875:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851901.674876:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000001:6.0:1773851901.674877:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851901.674878:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:6.0:1773851901.674878:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851901.674878:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851901.674879:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851901.674880:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851901.674882:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667622144
00000020:00000001:6.0:1773851901.674883:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851901.674884:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:6.0:1773851901.674885:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851901.674887:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:6.0:1773851901.674888:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:6.0:1773851901.674890:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:6.0:1773851901.674891:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851901.674892:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851901.674893:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000be250a4f.
00000020:00000010:6.0:1773851901.674895:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851901.674896:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851901.674897:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851901.674898:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851901.674899:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851901.674900:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.674901:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.674902:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851901.674904:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851901.674905:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851901.674905:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851901.674906:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851901.674907:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 18314091
00000100:00000040:6.0:1773851901.674908:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:5.0:1773851901.674908:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.674909:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569659264 : -106988139892352 : ffff9eb1e1ed3180)
00000100:00000001:5.0:1773851901.674909:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851901.674910:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000007615868 x1858062667622144/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:6.0:1773851901.674915:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851901.674916:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851901.674917:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007615868 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:52190:x1858062667622144:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:6.0:1773851901.674919:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667622144
00000020:00000001:6.0:1773851901.674920:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851901.674921:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851901.674922:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851901.674923:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851901.674925:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851901.674926:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851901.674927:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851901.674928:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851901.674929:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851901.674929:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.674931:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851901.674931:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851901.674933:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000058b9455.
02000000:00000001:6.0:1773851901.674934:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.674935:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851901.674937:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851901.674937:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851901.674938:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851901.674939:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 395575296 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851901.674941:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129889 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851901.674943:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851901.674944:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667622144
00010000:00000001:6.0:1773851901.674946:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851901.674947:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000007615868 x1858062667622144/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:628/0 lens 224/368 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:6.0:1773851901.674951:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851901.674952:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851901.674953:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=130 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851901.674955:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851901.674956:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:6.0:1773851901.674957:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:6.0:1773851901.674958:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851901.674959:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851901.674960:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851901.674961:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000400:00000010:6.0:1773851901.674962:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000025756a50.
00000100:00000200:6.0:1773851901.674964:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667622144, offset 224
00000400:00000200:6.0:1773851901.674966:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000400:00000200:6.0:1773851901.674967:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851901.674969:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:6.0:1773851901.674970:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851901.674972:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:6.0:1773851901.674974:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  2098@kfi7 local destination
00000400:00000200:6.0:1773851901.674976:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770400:8770400:1024:4294967295] 2098@kfi7 LPNI seq info [20346218:20346218:16:4294967295]
00000400:00000200:6.0:1773851901.674978:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:6.0:1773851901.674979:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:6.0:1773851901.674982:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 2098@kfi7(2098@kfi7:2098@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851901.674984:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000800:00000200:6.0:1773851901.674986:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851901.674988:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851901.674991:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851901.674995:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 Using peer 2098@kfi7(0x4c7)
00000800:00000200:6.0:1773851901.674999:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 468 bytes to peer 0x4c7: rc=0
00000800:00000200:6.0:1773851901.675002:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851901.675005:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851901.675006:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:6.0:1773851901.675007:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851901.675008:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851901.675009:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851901.675010:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000007615868 x1858062667622144/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:628/0 lens 224/368 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000800:00000200:5.0:1773851901.675013:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 TN_EVENT_TX_OK event status 0
00000100:00100000:6.0:1773851901.675015:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007615868 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0005-mdtlov_UUID+5:52190:x1858062667622144:12345-2098@kfi7:41:default-yuba6-0 Request processed in 98us (143us total) trans 0 rc 0/0
00000400:00000200:5.0:1773851901.675015:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851901.675017:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2098@kfi7: PUT: OK
00000100:00100000:6.0:1773851901.675018:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 18314091
00000400:00000200:5.0:1773851901.675018:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000025756a50
00000400:00000010:5.0:1773851901.675019:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000025756a50.
00000100:00000040:6.0:1773851901.675020:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:5.0:1773851901.675020:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851901.675021:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851901.675021:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:6.0:1773851901.675022:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851901.675023:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000400:00000200:5.0:1773851901.675023:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000020:00000010:6.0:1773851901.675024:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000020:00000010:6.0:1773851901.675025:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000be250a4f.
00000800:00000200:5.0:1773851901.675025:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2069@kfi7:1 -> 2098@kfi7(000000005e0b6bc7):0x0 lsk 1224 rsk 4796 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c7 Transaction freed
00000020:00000040:6.0:1773851901.675026:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:6.0:1773851901.675027:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851901.677181:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851901.677182:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851901.677184:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851901.677188:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851901.677191:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.677193:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13456@kfi7 : PUT - for me
00000400:00000200:13.0:1773851901.677194:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.677195:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 1
00000400:00000200:13.0:1773851901.677197:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.677199:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000400:00000200:13.0:1773851901.677200:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 3
00000400:00000200:13.0:1773851901.677202:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13393@kfi7 to cpt 3
00000400:00000200:13.0:1773851901.677203:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13393@kfi7 of length 224 into portal 12 MB=0x69b0986f151c0
00000400:00000200:13.0:1773851901.677206:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13393@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 61688
00000800:00000200:13.0:1773851901.677209:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851901.677211:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.677213:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13456@kfi7: PUT: OK
00000100:00000001:13.0:1773851901.677214:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851901.677215:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851901.677216:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001406a03b.
00000100:00000040:13.0:1773851901.677217:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000001406a03b x1859315081236928 msgsize 224
00000100:00100000:13.0:1773851901.677220:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13393@kfi7 (source: 12345-13456@kfi7)
00000100:00000001:13.0:1773851901.677221:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851901.677223:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000100:00000001:12.0:1773851901.677223:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851901.677223:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851901.677224:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851901.677224:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851901.677225:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851901.677225:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851901.677226:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315081236928
00000020:00000001:12.0:1773851901.677226:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851901.677226:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92eae
00000020:00000001:12.0:1773851901.677227:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851901.677231:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000b4833b9 refcount=6
00000020:00000001:12.0:1773851901.677231:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744666112 : -107128964885504 : ffff9e91181a5400)
00000020:00000001:12.0:1773851901.677232:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744666112 : -107128964885504 : ffff9e91181a5400)
00000100:00000001:12.0:1773851901.677233:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.677234:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851901.677234:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00000020:00000010:12.0:1773851901.677235:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.677236:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851901.677237:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851901.677238:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851901.677238:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851901.677239:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851901.677240:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851901.677240:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.677241:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851901.677242:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851901.677243:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851901.677244:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:12.0:1773851901.677244:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13393@kfi7, seq: 2289947
00000100:00000040:12.0:1773851901.677244:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000b4833b9 : new rpc_count 1
00000100:00000001:14.0:1773851901.677245:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851901.677245:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945719296 : -106919763832320 : ffff9ec1cd751200)
00000100:00000001:14.0:1773851901.677246:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851901.677247:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.677247:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001406a03b x1859315081236928/t0(0) o400->ea062319-fd1d-4bbd-8620-0e1458450484@13393@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1330-0'
00000100:00000001:12.0:1773851901.677250:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851901.677250:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851901.677251:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001406a03b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ea062319-fd1d-4bbd-8620-0e1458450484+6:39597:x1859315081236928:12345-13393@kfi7:400:default-tuolumne1330-0
00000100:00000200:12.0:1773851901.677252:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315081236928
00000020:00000001:12.0:1773851901.677253:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851901.677253:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851901.677254:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.677255:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851901.677255:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851901.677256:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851901.677257:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315081236928, found 0 last_xid 1859315081236927
00000020:00000001:12.0:1773851901.677257:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851901.677258:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851901.677259:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851901.677259:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.677260:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851901.677261:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851901.677261:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851901.677263:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000989593ff.
02000000:00000001:12.0:1773851901.677263:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.677264:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.677265:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851901.677265:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096673860, transno 0, xid 1859315081236928
00010000:00000001:12.0:1773851901.677266:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851901.677267:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001406a03b x1859315081236928/t0(0) o400->ea062319-fd1d-4bbd-8620-0e1458450484@13393@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1330-0'
00010000:00000001:12.0:1773851901.677269:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851901.677270:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851901.677271:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=134 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851901.677272:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851901.677272:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000062e2e3a7 refcount 3 to 13393@kfi7
00000100:00000001:12.0:1773851901.677273:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487619680 : -107151221931936 : ffff9e8be97ac060)
02000000:00000001:12.0:1773851901.677274:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851901.677275:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851901.677275:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851901.677276:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13456@kfi7
00000400:00000010:12.0:1773851901.677277:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000dde699a.
00000100:00000200:12.0:1773851901.677278:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315081236928, offset 224
00000400:00000200:12.0:1773851901.677279:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13456@kfi7
00000400:00000200:12.0:1773851901.677280:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.677280:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 1
00000400:00000200:12.0:1773851901.677281:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000400:00000200:12.0:1773851901.677283:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 3
00000400:00000200:12.0:1773851901.677284:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13456@kfi7 local destination
00000400:00000200:12.0:1773851901.677285:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770401:8770401:1024:4294967295] 13456@kfi7 LPNI seq info [9761479:9761479:16:4294967295]
00000400:00000200:12.0:1773851901.677287:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000400:00000200:12.0:1773851901.677287:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13456@kfi7 to cpt 3
00000400:00000200:12.0:1773851901.677289:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13456@kfi7(13456@kfi7:13456@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851901.677291:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 3
00000800:00000200:12.0:1773851901.677292:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851901.677293:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851901.677295:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851901.677298:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000414 Using peer 13456@kfi7(0x100000000000414)
00000800:00000200:12.0:1773851901.677300:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x100000000000414: rc=0
00000800:00000200:12.0:1773851901.677302:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000414 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851901.677304:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851901.677305:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000062e2e3a7 refcount 2 to 13393@kfi7
00010000:00000001:12.0:1773851901.677305:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851901.677306:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851901.677307:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851901.677308:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001406a03b x1859315081236928/t0(0) o400->ea062319-fd1d-4bbd-8620-0e1458450484@13393@kfi7:628/0 lens 224/224 e 0 to 0 dl 1773851988 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1330-0'
00000100:00100000:12.0:1773851901.677312:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001406a03b pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:ea062319-fd1d-4bbd-8620-0e1458450484+6:39597:x1859315081236928:12345-13393@kfi7:400:default-tuolumne1330-0 Request processed in 61us (94us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851901.677314:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13393@kfi7, seq: 2289947
00000100:00000040:12.0:1773851901.677315:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000b4833b9 : new rpc_count 0
00000100:00000001:12.0:1773851901.677316:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851901.677316:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851901.677317:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851901.677318:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851901.677318:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851901.677319:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000000b4833b9 : new refcount 5
00000100:00000001:12.0:1773851901.677320:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851901.677326:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000414 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851901.677329:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851901.677331:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13456@kfi7: PUT: OK
00000400:00000200:13.0:1773851901.677332:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000dde699a
00000400:00000010:13.0:1773851901.677333:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000dde699a.
00000100:00000001:13.0:1773851901.677334:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851901.677334:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851901.677336:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000eba77f7c nid 13456@kfi7 refs 2
00000800:00000200:13.0:1773851901.677338:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2054@kfi7:3 -> 13456@kfi7(000000004720be7e):0x0 lsk 1045 rsk 49 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000414 Transaction freed
00010000:00000010:26.1:1773851901.677728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 0000000017380f27.
00010000:00000010:12.1:1773851901.677728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000000a72d08f.
00010000:00000010:26.1:1773851901.677729:0:0:0:(ldlm_resource.c:1473:__ldlm_resource_free()) slab-freed '(res)': 168 at 000000003bcbed33.
00010000:00000010:26.1:1773851901.677730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000008018faef.
00010000:00000010:26.1:1773851901.677730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000003ea221cf.
00010000:00000010:12.1:1773851901.681727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000e01b3f2a.
00010000:00000010:26.1:1773851901.681728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000813103dd.
00000004:00000001:11.0:1773851901.769734:0:42375:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851901.769735:0:42375:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851901.769736:0:42375:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000918809b0.
00000020:00000040:11.0:1773851901.769738:0:42375:0:(genops.c:1094:class_import_get()) import 000000008e0db0b6 refcount=4 obd=lustre5-OST0012-osc-MDT0001
00000100:00000001:11.0:1773851901.769740:0:42375:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851901.769741:0:42375:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851901.769742:0:42375:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851901.769744:0:42375:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000011f33f0e.
00000100:00000001:11.0:1773851901.769746:0:42375:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851901.769748:0:42375:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851901.769749:0:42375:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851901.769752:0:42375:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000918809b0] to pc [ptlrpcd_02_01+1]  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851901.769760:0:42375:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:10.0:1773851901.769762:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:11.0:1773851901.769763:0:42375:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000ade0524b.
00000100:00000001:8.0:1773851901.769763:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851901.769764:0:42375:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637081929245696 : -106991780305920 : ffff9eb108f0e400)
00000100:00000001:10.0:1773851901.769764:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851901.769764:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851901.769765:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:11.0:1773851901.769766:0:42375:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:10.0:1773851901.769766:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:11.0:1773851901.769768:0:42375:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851901.769769:0:42375:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0012-osc-MDT0001: sync forced, 1 changes
00000004:00000010:11.0:1773851901.769771:0:42375:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000a86f28dc.
00000004:00080000:11.0:1773851901.769772:0:42375:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0012-osc-MDT0001: add commit cb at 614176223047996ns, next at 614177223045982ns, rc = 0
00000100:00000001:10.0:1773851901.769772:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851901.769772:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851901.769774:0:42375:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:10.0:1773851901.769774:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:10.0:1773851901.769775:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851901.769776:0:42375:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851901.769777:0:42375:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:10.0:1773851901.769778:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000918809b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051942528:2075@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851901.769781:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851901.769782:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:10.0:1773851901.769783:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851901.769784:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:10.0:1773851901.769786:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000249e46d2.
02000000:00000001:10.0:1773851901.769787:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851901.769789:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000010:10.0:1773851901.769791:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000400:00000010:10.0:1773851901.769792:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000100:00000200:10.0:1773851901.769794:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942528, portal 4
00000100:00000001:10.0:1773851901.769796:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851901.769796:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446612224 : -106937262939392 : ffff9ebdba6de300)
00000100:00000040:10.0:1773851901.769799:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851901.769804:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:10.0:1773851901.769805:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2075@kfi7
00000400:00000010:10.0:1773851901.769806:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000093445156.
00000100:00000200:10.0:1773851901.769807:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942528, offset 0
00000400:00000200:10.0:1773851901.769810:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2075@kfi7
00000400:00000200:10.0:1773851901.769812:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851901.769813:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:10.0:1773851901.769815:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851901.769818:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:10.0:1773851901.769819:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2075@kfi7 local destination
00000400:00000200:10.0:1773851901.769822:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770400, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770401, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851901.769826:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:10.0:1773851901.769827:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851901.769829:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2075@kfi7
00000400:00000200:10.0:1773851901.769831:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770402:8770402:1024:4294967295] 2075@kfi7 LPNI seq info [5403918:5403918:16:4294967295]
00000400:00000200:10.0:1773851901.769834:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:10.0:1773851901.769838:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:10.0:1773851901.769842:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2075@kfi7(2075@kfi7:2075@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851901.769845:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000800:00000200:10.0:1773851901.769847:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851901.769850:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:10.0:1773851901.769854:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:10.0:1773851901.769858:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Using peer 2075@kfi7(0x4e8)
00000800:00000200:10.0:1773851901.769865:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000019dc57a6: Posted send of 324 bytes to peer 0x4e8: rc=0
00000800:00000200:10.0:1773851901.769868:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851901.769872:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851901.769873:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851901.769874:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851901.769876:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851901.769877:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851901.769880:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851901.769880:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851901.769882:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851901.769882:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851901.769883:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851901.769883:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851901.769884:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851901.769886:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.769888:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000400:00000200:9.0:1773851901.769889:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000093445156
00000400:00000010:9.0:1773851901.769890:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000093445156.
00000100:00000001:9.0:1773851901.769891:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851901.769893:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851901.769899:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851901.769901:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851901.769913:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851901.769914:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851901.769915:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000800:00000200:9.0:1773851901.769919:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000019dc57a6: 2069@kfi7:2 -> 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x4e8 Transaction freed
00000800:00000200:9.0:1773851901.769975:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851901.769976:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851901.769978:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851901.769982:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851901.769985:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.769987:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2075@kfi7 : PUT - for me
00000400:00000200:9.0:1773851901.769989:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.769990:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 1
00000400:00000200:9.0:1773851901.769991:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.769992:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000400:00000200:9.0:1773851901.769994:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 3
00000400:00000200:9.0:1773851901.769995:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.769997:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2075@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6e80
00000400:00000200:9.0:1773851901.769998:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2075@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.770000:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2075@kfi7 of length 368/368 into md 0x781699329 [1] + 224
00000800:00000200:9.0:1773851901.770003:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851901.770006:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.770007:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2075@kfi7: PUT: OK
00000100:00000001:9.0:1773851901.770009:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851901.770010:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851901.770015:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851901.770025:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851901.770027:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:9.0:1773851901.770027:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d3861da nid 2075@kfi7 refs 2
00000100:00000001:10.0:1773851901.770028:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:10.0:1773851901.770029:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000800:00000200:9.0:1773851901.770029:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 2075@kfi7(00000000604f2757):0x0 lsk 1257 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000001:10.0:1773851901.770030:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851901.770031:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:10.0:1773851901.770032:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000400:00000010:10.0:1773851901.770033:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:10.0:1773851901.770034:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851901.770035:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851901.770040:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851901.770044:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851901.770045:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851901.770046:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851901.770047:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851901.770047:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851901.770049:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851901.770050:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851901.770051:0:41069:0:(import.c:1951:at_measured()) add 66 to 00000000b41ec263 time=134 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851901.770053:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000970cb517 time=134 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851901.770055:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851901.770056:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851901.770057:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851901.770058:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851901.770059:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851901.770060:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0012-osc-MDT0001: skip recheck: last_committed 167636587916
00000100:00000001:10.0:1773851901.770061:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851901.770062:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851901.770064:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851901.770068:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851901.770069:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851901.770070:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:10.0:1773851901.770071:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:10.0:1773851901.770072:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0012-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851901.770074:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0012-osc-MDT0001: blocks=410399725568 free=351470702592 avail=351461668864 avail_mb=1372897144 hwm_mb=3131103 files=372064442 ffree=343233108 state=0: rc = 0
00000004:00000020:10.0:1773851901.770077:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0012-osc-MDT0001 (000000006f81cf05): 410399725568 blocks, 351470702592 free, 351461668864 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372064442 files, 343233108 free files
00000004:00000001:10.0:1773851901.770079:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851901.770081:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851901.770086:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000918809b0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051942528:2075@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851901.770091:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851901.770092:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851901.770093:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000918809b0 x1859433051942528/t0(0) o13->lustre5-OST0012-osc-MDT0001@2075@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852054 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851901.770098:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851901.770099:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851901.770099:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000249e46d2.
02000000:00000001:10.0:1773851901.770101:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851901.770102:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851901.770102:0:41069:0:(genops.c:1107:class_import_put()) import 000000008e0db0b6 refcount=3 obd=lustre5-OST0012-osc-MDT0001
00000020:00000001:10.0:1773851901.770104:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851901.770104:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000011f33f0e.
02000000:00000001:10.0:1773851901.770106:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851901.770106:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851901.770107:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000918809b0.
00000100:00000001:10.0:1773851901.770108:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851901.770109:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851901.770110:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851901.770111:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851901.770112:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851901.770113:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851901.770113:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851901.820360:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851901.820362:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851901.820364:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:10.0:1773851901.820368:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:10.0:1773851901.820371:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:10.0:1773851901.820373:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20129@kfi7 : PUT - for me
00000400:00000200:10.0:1773851901.820374:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:10.0:1773851901.820376:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 1
00000400:00000200:10.0:1773851901.820378:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:10.0:1773851901.820379:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000400:00000200:10.0:1773851901.820381:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 3
00000400:00000200:10.0:1773851901.820383:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:10.0:1773851901.820384:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20064@kfi7 of length 376 into portal 12 MB=0x69b16f5d507c0
00000400:00000200:10.0:1773851901.820386:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20064@kfi7 of length 376/376 into md 0x78146ce49 [64] + 166640
00000800:00000200:10.0:1773851901.820390:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851901.820393:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851901.820394:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20129@kfi7: PUT: OK
00000100:00000001:10.0:1773851901.820396:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851901.820397:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851901.820398:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c66d318a.
00000100:00000040:10.0:1773851901.820399:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000c66d318a x1859372776228800 msgsize 376
00000100:00100000:10.0:1773851901.820401:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-20064@kfi7 (source: 12345-20129@kfi7)
00000100:00000001:10.0:1773851901.820403:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851901.820404:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000100:00000001:8.0:1773851901.820406:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851901.820406:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851901.820407:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851901.820407:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851901.820408:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851901.820409:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851901.820410:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372776228800
00000020:00000001:8.0:1773851901.820411:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851901.820412:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793af9d4a3
00000020:00000001:8.0:1773851901.820412:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851901.820419:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005a4dfb5d refcount=300
00000020:00000001:8.0:1773851901.820420:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946285607936 : -107127423943680 : ffff9e9173f33c00)
00000020:00000001:8.0:1773851901.820421:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946285607936 : -107127423943680 : ffff9e9173f33c00)
00000100:00000001:8.0:1773851901.820423:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.820424:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851901.820425:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851901.820426:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.820427:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851901.820430:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851901.820430:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:8.0:1773851901.820431:0:60829:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:8.0:1773851901.820432:0:60829:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820433:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820435:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820436:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851901.820438:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851901.820439:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851901.820440:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851901.820441:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851901.820441:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20064@kfi7, seq: 406391019
00000100:00000001:9.0:1773851901.820442:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.820442:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005a4dfb5d : new rpc_count 11
00000100:00000001:9.0:1773851901.820443:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820443:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087769088 : -106944621782528 : ffff9ebc03ceda00)
00000100:00000040:8.0:1773851901.820445:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c66d318a x1859372776228800/t0(0) o101->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:184/0 lens 376/0 e 0 to 0 dl 1773852299 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111555218471936'
00000100:00000001:8.0:1773851901.820449:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.820449:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851901.820451:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c66d318a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:179dc248-1257-4dfe-bb71-f157f3daaf14+300:395292:x1859372776228800:12345-20064@kfi7:101:tuolumne-833111555218471936
00000100:00000200:8.0:1773851901.820453:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372776228800
00000020:00000001:8.0:1773851901.820454:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851901.820455:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851901.820456:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.820457:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851901.820458:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:8.0:1773851901.820459:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851901.820460:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372776228800, found 0 last_xid 1859372770172415
00000020:00000001:8.0:1773851901.820461:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851901.820462:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851901.820462:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851901.820464:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.820465:0:60829:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:8.0:1773851901.820466:0:60829:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:8.0:1773851901.820466:0:60829:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:8.0:1773851901.820467:0:60829:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:8.0:1773851901.820468:0:60829:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.820473:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:8.0:1773851901.820476:0:60829:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e7ecf85a count: 2
00010000:00000001:8.0:1773851901.820477:0:60829:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:8.0:1773851901.820479:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:8.0:1773851901.820480:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000006bb12fc3.
00000020:00000001:8.0:1773851901.820482:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:8.0:1773851901.820483:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 000000006bb12fc3 with handle 0x21b6f08f07a6aeff to hash
00000020:00000001:8.0:1773851901.820484:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:8.0:1773851901.820485:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637091671138752 : -106982038412864 : ffff9eb34d9a61c0)
00010000:00000010:8.0:1773851901.820487:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000433c34cf.
00010000:00000001:8.0:1773851901.820488:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637091671138752 : -106982038412864 : ffff9eb34d9a61c0)
00010000:00010000:8.0:1773851901.820489:0:60829:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb12fc3/0x21b6f08f07a6aeff lrc: 2/0,0 mode: --/CR res: [0x240028959:0x25d5:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x49b8290fd9a6132e expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.820495:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 2
00010000:00000040:8.0:1773851901.820496:0:60829:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000005a4dfb5d : new locks_count 223
00000020:00000040:8.0:1773851901.820497:0:60829:0:(genops.c:871:class_export_get()) GET export 000000005a4dfb5d refcount=301
00010000:00000001:8.0:1773851901.820500:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:8.0:1773851901.820501:0:60829:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:8.0:1773851901.820503:0:60829:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:8.0:1773851901.820504:0:60829:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:8.0:1773851901.820505:0:60829:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851901.820506:0:60829:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:8.0:1773851901.820507:0:60829:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x240028959:0x25d5:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:8.0:1773851901.820509:0:60829:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:8.0:1773851901.820510:0:60829:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028959:0x25d5:0x0]
00000020:00000001:8.0:1773851901.820512:0:60829:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:8.0:1773851901.820514:0:60829:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637132934889896 : -106940774661720 : ffff9ebce91d41a8)
00000004:00000001:8.0:1773851901.820516:0:60829:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637132934889808 : -106940774661808 : ffff9ebce91d4150)
00000004:00000001:8.0:1773851901.820518:0:60829:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:8.0:1773851901.820522:0:60829:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:8.0:1773851901.820523:0:60829:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:8.0:1773851901.820526:0:60829:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820528:0:60829:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820530:0:60829:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:8.0:1773851901.820531:0:60829:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:8.0:1773851901.820532:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851901.820533:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851901.820534:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 0000000054cde7e0.
02000000:00000001:8.0:1773851901.820535:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820536:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851901.820538:0:60829:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:8.0:1773851901.820540:0:60829:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:8.0:1773851901.820541:0:60829:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:8.0:1773851901.820542:0:60829:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851901.820543:0:60829:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.820545:0:60829:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:8.0:1773851901.820546:0:60829:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:8.0:1773851901.820547:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:8.0:1773851901.820548:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851901.820549:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:8.0:1773851901.820550:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851901.820551:0:60829:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:8.0:1773851901.820552:0:60829:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:8.0:1773851901.820553:0:60829:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:8.0:1773851901.820553:0:60829:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:8.0:1773851901.820554:0:60829:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240028959:0x25d5:0x0].0x0 (00000000e7ecf85a) refcount = 2
00010000:00000040:8.0:1773851901.820556:0:60829:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:8.0:1773851901.820558:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086fc157d/0x21b6f08f07a45488 lrc: 2/0,0 mode: PR/PR res: [0x240028959:0x25d5:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 13234@kfi7 remote: 0x9f53f3a6802bfd96 expref: 602 pid: 60742 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.820562:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 2
00010000:00010000:8.0:1773851901.820564:0:60829:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb12fc3/0x21b6f08f07a6aeff lrc: 3/0,0 mode: CR/CR res: [0x240028959:0x25d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 20064@kfi7 remote: 0x49b8290fd9a6132e expref: 301 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.820568:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 2
00010000:00000001:8.0:1773851901.820569:0:60829:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:8.0:1773851901.820570:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:8.0:1773851901.820572:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.820573:0:60829:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:8.0:1773851901.820574:0:60829:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851901.820575:0:60829:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.820576:0:60829:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:8.0:1773851901.820578:0:60829:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:8.0:1773851901.820579:0:60829:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb12fc3/0x21b6f08f07a6aeff lrc: 3/0,0 mode: CR/CR res: [0x240028959:0x25d5:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 20064@kfi7 remote: 0x49b8290fd9a6132e expref: 301 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.820583:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 2
00000004:00000001:8.0:1773851901.820585:0:60829:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:8.0:1773851901.820587:0:60829:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:8.0:1773851901.820588:0:60829:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240028959:0x25d5:0x0]
00000020:00000001:8.0:1773851901.820588:0:60829:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:8.0:1773851901.820589:0:60829:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446637132934889896 : -106940774661720 : ffff9ebce91d41a8)
00000004:00000001:8.0:1773851901.820590:0:60829:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446637132934889808 : -106940774661808 : ffff9ebce91d4150)
00000004:00000001:8.0:1773851901.820592:0:60829:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:8.0:1773851901.820592:0:60829:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:8.0:1773851901.820593:0:60829:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:8.0:1773851901.820594:0:60829:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820595:0:60829:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820596:0:60829:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820597:0:60829:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:8.0:1773851901.820597:0:60829:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:8.0:1773851901.820598:0:60829:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:8.0:1773851901.820599:0:60829:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820600:0:60829:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820601:0:60829:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:8.0:1773851901.820602:0:60829:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:8.0:1773851901.820602:0:60829:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:8.0:1773851901.820603:0:60829:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:8.0:1773851901.820605:0:60829:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:8.0:1773851901.820605:0:60829:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:8.0:1773851901.820606:0:60829:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028959:0x25d5:0x0].0x0 (00000000e7ecf85a)
00010000:00010000:8.0:1773851901.820608:0:60829:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:8.0:1773851901.820610:0:60829:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851901.820611:0:60829:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.820612:0:60829:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:8.0:1773851901.820613:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:8.0:1773851901.820614:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:8.0:1773851901.820615:0:60829:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000006bb12fc3, rc 0)
00000020:00000001:8.0:1773851901.820616:0:60829:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851901.820617:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588432, transno 0, xid 1859372776228800
00010000:00000001:8.0:1773851901.820619:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851901.820620:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c66d318a x1859372776228800/t0(0) o101->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:184/0 lens 376/1080 e 0 to 0 dl 1773852299 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111555218471936'
00010000:00000001:8.0:1773851901.820625:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851901.820626:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851901.820627:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=134 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851901.820629:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851901.820630:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000061de2c3f refcount 3 to 20064@kfi7
00000100:00000001:8.0:1773851901.820631:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333280 : -107155408218336 : ffff9e8aeff51720)
02000000:00000001:8.0:1773851901.820632:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851901.820633:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820634:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851901.820636:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20129@kfi7
00000400:00000010:8.0:1773851901.820636:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079e75b3d.
00000100:00000200:8.0:1773851901.820638:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1859372776228800, offset 224
00000400:00000200:8.0:1773851901.820640:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20129@kfi7
00000400:00000200:8.0:1773851901.820642:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.820643:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 1
00000400:00000200:8.0:1773851901.820645:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000400:00000200:8.0:1773851901.820647:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 3
00000400:00000200:8.0:1773851901.820648:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20129@kfi7 local destination
00000400:00000200:8.0:1773851901.820650:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770403:8770403:1024:4294967295] 20129@kfi7 LPNI seq info [370258:370258:16:4294967295]
00000400:00000200:8.0:1773851901.820653:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000400:00000200:8.0:1773851901.820654:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.820657:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20129@kfi7(20129@kfi7:20129@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851901.820658:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 3
00000800:00000200:8.0:1773851901.820661:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851901.820663:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000800:00000200:8.0:1773851901.820667:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851901.820670:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe12 Using peer 20129@kfi7(0xe12)
00000800:00000200:8.0:1773851901.820675:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000936f09bd: Posted send of 1180 bytes to peer 0xe12: rc=0
00000800:00000200:8.0:1773851901.820677:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe12 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851901.820680:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.820681:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000061de2c3f refcount 2 to 20064@kfi7
00010000:00000001:8.0:1773851901.820683:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851901.820683:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.820687:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851901.820688:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c66d318a x1859372776228800/t0(0) o101->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:184/0 lens 376/1080 e 0 to 0 dl 1773852299 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111555218471936'
00000100:00100000:8.0:1773851901.820693:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c66d318a pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:179dc248-1257-4dfe-bb71-f157f3daaf14+301:395292:x1859372776228800:12345-20064@kfi7:101:tuolumne-833111555218471936 Request processed in 243us (293us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851901.820697:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20064@kfi7, seq: 406391019
00000100:00000040:8.0:1773851901.820698:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005a4dfb5d : new rpc_count 10
00000100:00000001:8.0:1773851901.820699:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851901.820700:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851901.820701:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.820702:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851901.820703:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851901.820704:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000005a4dfb5d : new refcount 300
00000100:00000001:8.0:1773851901.820705:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851901.820714:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe12 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851901.820717:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.820719:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20129@kfi7: PUT: OK
00000400:00000200:9.0:1773851901.820721:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079e75b3d
00000400:00000010:9.0:1773851901.820722:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079e75b3d.
00000100:00000001:9.0:1773851901.820723:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851901.820724:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851901.820729:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000800:00000200:9.0:1773851901.820731:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000936f09bd: 2069@kfi7:2 -> 20129@kfi7(00000000aa724b33):0x0 lsk 3603 rsk 9 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe12 Transaction freed
00000800:00000200:9.0:1773851901.820922:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851901.820923:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851901.820925:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851901.820927:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851901.820929:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.820930:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20129@kfi7 : PUT - for me
00000400:00000200:9.0:1773851901.820931:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.820932:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 1
00000400:00000200:9.0:1773851901.820933:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.820933:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000400:00000200:9.0:1773851901.820934:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 3
00000400:00000200:9.0:1773851901.820936:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20064@kfi7 to cpt 4
00000400:00000200:9.0:1773851901.820937:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20064@kfi7 of length 328 into portal 12 MB=0x69b16f5d50800
00000400:00000200:9.0:1773851901.820938:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20064@kfi7 of length 328/328 into md 0x78146ce49 [64] + 167016
00000800:00000200:9.0:1773851901.820940:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851901.820941:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.820942:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20129@kfi7: PUT: OK
00000100:00000001:9.0:1773851901.820943:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851901.820943:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851901.820944:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c313a16d.
00000100:00000040:9.0:1773851901.820945:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c313a16d x1859372776228864 msgsize 328
00000100:00100000:9.0:1773851901.820946:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20064@kfi7 (source: 12345-20129@kfi7)
00000100:00000001:9.0:1773851901.820947:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851901.820948:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000100:00000001:8.0:1773851901.820948:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851901.820949:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851901.820949:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851901.820949:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851901.820950:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851901.820951:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851901.820952:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372776228864
00000020:00000001:8.0:1773851901.820952:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851901.820953:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793af9d4a3
00000020:00000001:8.0:1773851901.820953:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851901.820953:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005a4dfb5d refcount=301
00000020:00000001:8.0:1773851901.820954:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946285607936 : -107127423943680 : ffff9e9173f33c00)
00000020:00000001:8.0:1773851901.820955:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946285607936 : -107127423943680 : ffff9e9173f33c00)
00000100:00000001:8.0:1773851901.820955:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.820956:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851901.820956:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851901.820957:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.820957:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851901.820958:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851901.820959:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:8.0:1773851901.820959:0:60829:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:8.0:1773851901.820959:0:60829:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820960:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820961:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820962:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851901.820963:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851901.820963:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851901.820963:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851901.820964:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851901.820964:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20064@kfi7, seq: 406391020
00000100:00000001:9.0:1773851901.820965:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851901.820965:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.820965:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005a4dfb5d : new rpc_count 11
00000100:00000001:8.0:1773851901.820965:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498304128 : -106953211247488 : ffff9eba03d60480)
00000100:00000040:8.0:1773851901.820966:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c313a16d x1859372776228864/t0(0) o101->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:628/0 lens 328/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111555218471936'
00000100:00000001:8.0:1773851901.820969:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851901.820969:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851901.820970:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c313a16d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:179dc248-1257-4dfe-bb71-f157f3daaf14+301:39790:x1859372776228864:12345-20064@kfi7:101:tuolumne-833111555218471936
00000100:00000200:8.0:1773851901.820971:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372776228864
00000020:00000001:8.0:1773851901.820972:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851901.820973:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851901.820973:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.820974:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851901.820974:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:8.0:1773851901.820975:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851901.820975:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372776228864, found 0 last_xid 1859372770172415
00000020:00000001:8.0:1773851901.820975:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851901.820976:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851901.820976:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851901.820977:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.820977:0:60829:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:8.0:1773851901.820977:0:60829:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:8.0:1773851901.820978:0:60829:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:8.0:1773851901.820978:0:60829:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:8.0:1773851901.820979:0:60829:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.820979:0:60829:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000040:8.0:1773851901.820980:0:60829:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000e7ecf85a count: 3
00010000:00000001:8.0:1773851901.820980:0:60829:0:(ldlm_resource.c:1517:ldlm_resource_get()) Process leaving via found (rc=0 : 0 : 0x0)
00010000:00000001:8.0:1773851901.820981:0:60829:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:8.0:1773851901.820982:0:60829:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 0000000092972cd3.
00000020:00000001:8.0:1773851901.820982:0:60829:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:8.0:1773851901.820983:0:60829:0:(lustre_handles.c:97:class_handle_hash()) added object 0000000092972cd3 with handle 0x21b6f08f07a6af06 to hash
00000020:00000001:8.0:1773851901.820984:0:60829:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:8.0:1773851901.820984:0:60829:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637091671130112 : -106982038421504 : ffff9eb34d9a4000)
00010000:00000010:8.0:1773851901.820985:0:60829:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 0000000032068d4b.
00010000:00000001:8.0:1773851901.820985:0:60829:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637091671130112 : -106982038421504 : ffff9eb34d9a4000)
00010000:00010000:8.0:1773851901.820986:0:60829:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 0000000092972cd3/0x21b6f08f07a6af06 lrc: 2/0,0 mode: --/PR res: [0x240028959:0x25d5:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x49b8290fd9a61335 expref: -99 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.820988:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 3
00010000:00000040:8.0:1773851901.820988:0:60829:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000005a4dfb5d : new locks_count 224
00000020:00000040:8.0:1773851901.820989:0:60829:0:(genops.c:871:class_export_get()) GET export 000000005a4dfb5d refcount=302
00010000:00000001:8.0:1773851901.820990:0:60829:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:8.0:1773851901.820990:0:60829:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00002000:00000001:8.0:1773851901.820991:0:60829:0:(mdt_io.c:1388:mdt_glimpse_enqueue()) Process entered
00000100:00000001:8.0:1773851901.820992:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851901.820992:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851901.820993:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 656 at 00000000dbb7b9a2.
02000000:00000001:8.0:1773851901.820994:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.820994:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.820995:0:60829:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:8.0:1773851901.820995:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:8.0:1773851901.820996:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851901.820996:0:60829:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:8.0:1773851901.820996:0:60829:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851901.820997:0:60829:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:8.0:1773851901.820997:0:60829:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:8.0:1773851901.820998:0:60829:0:(ldlm_lock.c:1016:search_granted_lock()) Process leaving
00010000:00000001:8.0:1773851901.820998:0:60829:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:8.0:1773851901.820998:0:60829:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240028959:0x25d5:0x0].0x0 (00000000e7ecf85a) refcount = 3
00010000:00000040:8.0:1773851901.820999:0:60829:0:(ldlm_resource.c:1800:ldlm_resource_dump()) Granted locks (in reverse order):
00010000:00000040:8.0:1773851901.821000:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 000000006bb12fc3/0x21b6f08f07a6aeff lrc: 2/0,0 mode: CR/CR res: [0x240028959:0x25d5:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 20064@kfi7 remote: 0x49b8290fd9a6132e expref: 302 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.821002:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 3
00010000:00000040:8.0:1773851901.821002:0:60829:0:(ldlm_resource.c:1803:ldlm_resource_dump()) ### ### ns: mdt-lustre5-MDT0001_UUID lock: 0000000086fc157d/0x21b6f08f07a45488 lrc: 2/0,0 mode: PR/PR res: [0x240028959:0x25d5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 13234@kfi7 remote: 0x9f53f3a6802bfd96 expref: 602 pid: 60742 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.821004:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 3
00010000:00010000:8.0:1773851901.821005:0:60829:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 0000000092972cd3/0x21b6f08f07a6af06 lrc: 3/0,0 mode: PR/PR res: [0x240028959:0x25d5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 20064@kfi7 remote: 0x49b8290fd9a61335 expref: 302 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.821007:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 3
00010000:00000001:8.0:1773851901.821007:0:60829:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:8.0:1773851901.821008:0:60829:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:8.0:1773851901.821008:0:60829:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.821008:0:60829:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:8.0:1773851901.821009:0:60829:0:(ldlm_inodebits.c:406:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00002000:00000001:8.0:1773851901.821010:0:60829:0:(mdt_io.c:1433:mdt_glimpse_enqueue()) Process leaving via fill_mbo (rc=302 : 302 : 0x12e)
00002000:00010000:8.0:1773851901.821011:0:60829:0:(mdt_io.c:1321:mdt_lvb2reply()) size 13
00002000:00000001:8.0:1773851901.821011:0:60829:0:(mdt_io.c:1461:mdt_glimpse_enqueue()) Process leaving (rc=302 : 302 : 12e)
00000004:00000001:8.0:1773851901.821012:0:60829:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=302 : 302 : 12e)
00010000:00000001:8.0:1773851901.821013:0:60829:0:(ldlm_lock.c:1787:ldlm_lock_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.821013:0:60829:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:8.0:1773851901.821014:0:60829:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 0000000092972cd3/0x21b6f08f07a6af06 lrc: 3/0,0 mode: PR/PR res: [0x240028959:0x25d5:0x0].0x0 bits 0x40/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 20064@kfi7 remote: 0x49b8290fd9a61335 expref: 302 pid: 60829 timeout: 0 lvb_type: 0
00010000:00000040:8.0:1773851901.821016:0:60829:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000e7ecf85a count: 3
00000004:00000001:8.0:1773851901.821016:0:60829:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:8.0:1773851901.821017:0:60829:0:(mdt_lvb.c:377:mdt_lvbo_fill()) Process leaving via out (rc=56 : 56 : 0x38)
00000004:00000001:8.0:1773851901.821018:0:60829:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=56 : 56 : 38)
00010000:00000001:8.0:1773851901.821018:0:60829:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:8.0:1773851901.821019:0:60829:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:8.0:1773851901.821019:0:60829:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240028959:0x25d5:0x0].0x0 (00000000e7ecf85a)
00010000:00010000:8.0:1773851901.821020:0:60829:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 40
00010000:00000001:8.0:1773851901.821020:0:60829:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:8.0:1773851901.821021:0:60829:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851901.821021:0:60829:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:8.0:1773851901.821021:0:60829:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:8.0:1773851901.821022:0:60829:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:8.0:1773851901.821022:0:60829:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 0000000092972cd3, rc 0)
00000020:00000001:8.0:1773851901.821023:0:60829:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851901.821023:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264588432, transno 0, xid 1859372776228864
00010000:00000001:8.0:1773851901.821024:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851901.821024:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c313a16d x1859372776228864/t0(0) o101->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:628/0 lens 328/400 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111555218471936'
00010000:00000001:8.0:1773851901.821026:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851901.821027:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851901.821027:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=134 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851901.821028:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851901.821028:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000061de2c3f refcount 3 to 20064@kfi7
00000100:00000001:8.0:1773851901.821029:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333280 : -107155408218336 : ffff9e8aeff51720)
02000000:00000001:8.0:1773851901.821030:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851901.821030:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851901.821030:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851901.821031:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20129@kfi7
00000400:00000010:8.0:1773851901.821032:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000286a46f2.
00000100:00000200:8.0:1773851901.821032:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 400 bytes to portal 10, xid 1859372776228864, offset 224
00000400:00000200:8.0:1773851901.821033:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20129@kfi7
00000400:00000200:8.0:1773851901.821034:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.821035:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 1
00000400:00000200:8.0:1773851901.821036:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000400:00000200:8.0:1773851901.821037:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 3
00000400:00000200:8.0:1773851901.821038:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20129@kfi7 local destination
00000400:00000200:8.0:1773851901.821039:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770404:8770404:1024:4294967295] 20129@kfi7 LPNI seq info [370259:370259:16:4294967295]
00000400:00000200:8.0:1773851901.821040:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000400:00000200:8.0:1773851901.821041:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20129@kfi7 to cpt 2
00000400:00000200:8.0:1773851901.821043:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20129@kfi7(20129@kfi7:20129@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851901.821044:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 3
00000800:00000200:8.0:1773851901.821045:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851901.821046:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 400 bytes in 1 frags
00000800:00000200:8.0:1773851901.821047:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851901.821049:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e6 Using peer 20129@kfi7(0x1000000000011e6)
00000800:00000200:8.0:1773851901.821052:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000006618773c: Posted send of 500 bytes to peer 0x1000000000011e6: rc=0
00000800:00000200:8.0:1773851901.821053:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851901.821055:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851901.821055:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000061de2c3f refcount 2 to 20064@kfi7
00010000:00000001:8.0:1773851901.821056:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851901.821057:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851901.821057:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851901.821058:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c313a16d x1859372776228864/t0(0) o101->179dc248-1257-4dfe-bb71-f157f3daaf14@20064@kfi7:628/0 lens 328/400 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111555218471936'
00000100:00100000:8.0:1773851901.821062:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c313a16d pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:179dc248-1257-4dfe-bb71-f157f3daaf14+302:39790:x1859372776228864:12345-20064@kfi7:101:tuolumne-833111555218471936 Request processed in 91us (115us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851901.821064:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20064@kfi7, seq: 406391020
00000100:00000040:8.0:1773851901.821064:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005a4dfb5d : new rpc_count 10
00000100:00000001:8.0:1773851901.821065:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851901.821065:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851901.821066:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851901.821066:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851901.821067:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851901.821067:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000005a4dfb5d : new refcount 301
00000100:00000001:8.0:1773851901.821068:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851901.821073:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e6 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851901.821075:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.821076:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20129@kfi7: PUT: OK
00000400:00000200:9.0:1773851901.821076:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000286a46f2
00000400:00000010:9.0:1773851901.821077:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000286a46f2.
00000100:00000001:9.0:1773851901.821077:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851901.821078:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851901.821079:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007bb9d222 nid 20129@kfi7 refs 2
00000800:00000200:9.0:1773851901.821080:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006618773c: 2054@kfi7:2 -> 20129@kfi7(000000006f700380):0x0 lsk 4583 rsk 8 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000011e6 Transaction freed
00000400:00000200:29.0:1773851901.833733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851901.833734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:9.0:1773851901.894134:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851901.894135:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851901.894137:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851901.894139:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851901.894140:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.894142:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.14@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851901.894143:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851901.894143:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851901.894145:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.14@o2ib60 to cpt 7
00000400:00000200:9.0:1773851901.894146:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 2
00000400:00000200:9.0:1773851901.894147:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 3
00000400:00000200:9.0:1773851901.894148:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.14@o2ib60 to cpt 7
00000400:00000200:9.0:1773851901.894149:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.14@o2ib60 of length 224 into portal 12 MB=0x69b17af54d9c0
00000400:00000200:9.0:1773851901.894151:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.14@o2ib60 of length 224/224 into md 0x77fe1859d [64] + 11744
00000800:00000200:9.0:1773851901.894153:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851901.894154:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851901.894155:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851901.894156:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851901.894157:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851901.894158:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000837345c4.
00000100:00000040:9.0:1773851901.894158:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000837345c4 x1859375888390592 msgsize 224
00000100:00100000:9.0:1773851901.894160:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.14@o2ib60 (source: 12345-192.168.128.14@o2ib60)
00000100:00000001:9.0:1773851901.894162:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851901.894163:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851901.894164:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851901.894165:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851901.894166:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851901.894167:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851901.894167:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851901.894168:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851901.894169:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859375888390592
00000020:00000001:31.0:1773851901.894170:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851901.894170:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae3f1d2
00000020:00000001:31.0:1773851901.894171:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851901.894174:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004d43108c refcount=5
00000020:00000001:31.0:1773851901.894175:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636946297476096 : -107127412075520 : ffff9e9174a85400)
00000020:00000001:31.0:1773851901.894176:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636946297476096 : -107127412075520 : ffff9e9174a85400)
00000100:00000001:31.0:1773851901.894177:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851901.894178:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851901.894179:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3c67bb1.
00000020:00000010:31.0:1773851901.894180:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851901.894181:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851901.894181:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851901.894182:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851901.894182:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851901.894184:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851901.894184:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851901.894184:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.894186:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851901.894187:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851901.894187:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851901.894188:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851901.894188:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851901.894189:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.14@o2ib60, seq: 2055606
00000100:00000040:31.0:1773851901.894190:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004d43108c : new rpc_count 1
00000100:00000001:31.0:1773851901.894190:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498322560 : -106953211229056 : ffff9eba03d64c80)
00000100:00000001:30.0:1773851901.894190:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851901.894190:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851901.894192:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000837345c4 x1859375888390592/t0(0) o400->a18f2895-7960-4808-acf3-aecc617f42d6@192.168.128.14@o2ib60:689/0 lens 224/0 e 0 to 0 dl 1773852049 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix14-0'
00000100:00000001:31.0:1773851901.894195:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851901.894195:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851901.894196:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000837345c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:a18f2895-7960-4808-acf3-aecc617f42d6+5:39995:x1859375888390592:12345-192.168.128.14@o2ib60:400:default-matrix14-0
00000100:00000200:31.0:1773851901.894199:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859375888390592
00000020:00000001:31.0:1773851901.894200:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851901.894200:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851901.894201:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.894202:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851901.894202:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851901.894203:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851901.894204:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859375888390592, found 0 last_xid 1859375888390591
00000020:00000001:31.0:1773851901.894205:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851901.894205:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851901.894206:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851901.894206:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.894207:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851901.894207:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851901.894208:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851901.894209:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000072f89a74.
02000000:00000001:31.0:1773851901.894209:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.894210:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.894211:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851901.894212:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182562244964, transno 0, xid 1859375888390592
00010000:00000001:31.0:1773851901.894212:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851901.894213:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000837345c4 x1859375888390592/t0(0) o400->a18f2895-7960-4808-acf3-aecc617f42d6@192.168.128.14@o2ib60:689/0 lens 224/224 e 0 to 0 dl 1773852049 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix14-0'
00010000:00000001:31.0:1773851901.894216:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851901.894216:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851901.894217:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=134 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851901.894218:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851901.894219:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f64972ed refcount 3 to 192.168.128.14@o2ib60
00000100:00000001:31.0:1773851901.894220:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934276594496 : -107139432957120 : ffff9e8ea8283b40)
02000000:00000001:31.0:1773851901.894221:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851901.894221:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.894222:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851901.894223:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.14@o2ib60
00000400:00000010:31.0:1773851901.894224:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000819b29f0.
00000100:00000200:31.0:1773851901.894225:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859375888390592, offset 224
00000400:00000200:31.0:1773851901.894226:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.14@o2ib60
00000400:00000200:31.0:1773851901.894227:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.14@o2ib60 to cpt 7
00000400:00000200:31.0:1773851901.894229:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 2
00000400:00000200:31.0:1773851901.894230:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 3
00000400:00000200:31.0:1773851901.894232:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 4
00000400:00000200:31.0:1773851901.894233:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.14@o2ib60 routed destination
00000400:00000200:31.0:1773851901.894234:0:60677:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:31.0:1773851901.894235:0:60677:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:31.0:1773851901.894236:0:60677:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.14@o2ib60: rtr pref emtpy: 1
00000400:00000200:31.0:1773851901.894237:0:60677:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:31.0:1773851901.894239:0:60677:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.14@o2ib60: rtr pref emtpy: 1
00000400:00000200:31.0:1773851901.894239:0:60677:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:31.0:1773851901.894241:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770405:8770405:1024:4294967295] 2094@kfi7 LPNI seq info [1258747026:1258747026:16:4294967295]
00000400:00000200:31.0:1773851901.894242:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:31.0:1773851901.894243:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:31.0:1773851901.894246:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.14@o2ib60(192.168.128.14@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851901.894247:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb5f282c nid 192.168.128.14@o2ib60 refs 3
00000800:00000200:31.0:1773851901.894249:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851901.894250:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851901.894252:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851901.894254:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:31.0:1773851901.894258:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:31.0:1773851901.894259:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851901.894263:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851901.894264:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f64972ed refcount 2 to 192.168.128.14@o2ib60
00010000:00000001:31.0:1773851901.894265:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851901.894265:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.894266:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851901.894267:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000837345c4 x1859375888390592/t0(0) o400->a18f2895-7960-4808-acf3-aecc617f42d6@192.168.128.14@o2ib60:689/0 lens 224/224 e 0 to 0 dl 1773852049 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix14-0'
00000100:00100000:31.0:1773851901.894270:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000837345c4 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:a18f2895-7960-4808-acf3-aecc617f42d6+5:39995:x1859375888390592:12345-192.168.128.14@o2ib60:400:default-matrix14-0 Request processed in 74us (111us total) trans 0 rc 0/0
00000800:00000200:30.0:1773851901.894271:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851901.894273:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.14@o2ib60, seq: 2055606
00000400:00000200:30.0:1773851901.894273:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:31.0:1773851901.894274:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004d43108c : new rpc_count 0
00000100:00000001:31.0:1773851901.894274:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:30.0:1773851901.894274:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000100:00000001:31.0:1773851901.894275:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851901.894275:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:30.0:1773851901.894275:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000819b29f0
00000020:00000010:31.0:1773851901.894276:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000010:30.0:1773851901.894276:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000819b29f0.
00000020:00000010:31.0:1773851901.894277:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3c67bb1.
00000100:00000001:30.0:1773851901.894277:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851901.894277:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:31.0:1773851901.894278:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000004d43108c : new refcount 4
00000100:00000001:31.0:1773851901.894278:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851901.894278:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:30.0:1773851901.894280:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000000c Transaction freed
00000800:00000200:25.0:1773851901.896180:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851901.896181:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851901.896182:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851901.896184:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851901.896186:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.896187:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8@kfi7 : PUT - for me
00000400:00000200:25.0:1773851901.896188:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.896189:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:25.0:1773851901.896190:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:25.0:1773851901.896190:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:25.0:1773851901.896191:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:25.0:1773851901.896192:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:25.0:1773851901.896193:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 224 into portal 24 MB=0x69b1a860dc780
00000400:00000200:25.0:1773851901.896194:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-7@kfi7 of length 224/224 into md 0x160dfce379 [256] + 15736
00000800:00000200:25.0:1773851901.896196:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851901.896197:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851901.896198:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000100:00000001:25.0:1773851901.896199:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851901.896200:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851901.896201:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dc4ed428.
00000100:00000040:25.0:1773851901.896201:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000dc4ed428 x1859388080768896 msgsize 224
00000100:00100000:25.0:1773851901.896203:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-7@kfi7 (source: 12345-8@kfi7)
00000100:00000001:25.0:1773851901.896204:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851901.896205:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851901.896206:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:25.0:1773851901.896209:0:1691804:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:25.0:1773851901.896210:0:1691804:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:25.0:1773851901.896210:0:1691804:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:25.0:1773851901.896211:0:1691804:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851901.896211:0:1691804:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:25.0:1773851901.896212:0:1691804:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388080768896
00000020:00000001:25.0:1773851901.896213:0:1691804:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:25.0:1773851901.896213:0:1691804:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0794537a489
00000020:00000001:25.0:1773851901.896214:0:1691804:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:25.0:1773851901.896215:0:1691804:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002b5027d8 refcount=5
00000020:00000001:25.0:1773851901.896215:0:1691804:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000020:00000001:25.0:1773851901.896216:0:1691804:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636928130033664 : -107145579517952 : ffff9e8d39cb2800)
00000100:00000001:25.0:1773851901.896217:0:1691804:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:25.0:1773851901.896217:0:1691804:0:(service.c:1147:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:25.0:1773851901.896218:0:1691804:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000008d096de4.
00000020:00000010:25.0:1773851901.896219:0:1691804:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e3c6e04b.
00000020:00000010:25.0:1773851901.896220:0:1691804:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000215850cb.
00000100:00000040:25.0:1773851901.896221:0:1691804:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:25.0:1773851901.896222:0:1691804:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:25.0:1773851901.896222:0:1691804:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:25.0:1773851901.896223:0:1691804:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851901.896223:0:1691804:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851901.896224:0:1691804:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:25.0:1773851901.896226:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851901.896226:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851901.896226:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851901.896226:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851901.896227:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-7@kfi7, seq: 5799992
00000100:00000001:25.0:1773851901.896228:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851901.896228:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851901.896228:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002b5027d8 : new rpc_count 1
00000100:00000001:24.0:1773851901.896229:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157361024 : -106936552190592 : ffff9ebde4cb0d80)
00000100:00000040:24.0:1773851901.896230:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dc4ed428 x1859388080768896/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba5-0'
00000100:00000001:24.0:1773851901.896233:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851901.896233:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851901.896234:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dc4ed428 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38115:x1859388080768896:12345-7@kfi7:41:default-yuba5-0
00000100:00000200:24.0:1773851901.896235:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388080768896
00000020:00000001:24.0:1773851901.896236:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851901.896237:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851901.896237:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851901.896238:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851901.896238:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851901.896239:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851901.896240:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851901.896240:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851901.896241:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851901.896241:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851901.896242:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851901.896243:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851901.896244:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000c992ef77.
02000000:00000001:24.0:1773851901.896244:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851901.896245:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851901.896246:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851901.896246:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851901.896247:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851901.896248:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 395575296 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851901.896249:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129889 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851901.896250:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851901.896251:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183261792016, transno 0, xid 1859388080768896
00010000:00000001:24.0:1773851901.896252:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851901.896253:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dc4ed428 x1859388080768896/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:628/0 lens 224/368 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00010000:00000001:24.0:1773851901.896255:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851901.896256:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851901.896257:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=28 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851901.896258:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851901.896258:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c4eaef12 refcount 7 to 7@kfi7
00000100:00000001:24.0:1773851901.896259:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918205072800 : -107155504478816 : ffff9e8aea3845a0)
02000000:00000001:24.0:1773851901.896260:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851901.896261:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851901.896261:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851901.896262:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8@kfi7
00000400:00000010:24.0:1773851901.896263:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000094777d.
00000100:00000200:24.0:1773851901.896264:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388080768896, offset 224
00000400:00000200:24.0:1773851901.896265:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8@kfi7
00000400:00000200:24.0:1773851901.896266:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851901.896267:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 1
00000400:00000200:24.0:1773851901.896268:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851901.896269:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000400:00000200:24.0:1773851901.896270:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8@kfi7 local destination
00000400:00000200:24.0:1773851901.896271:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770406:8770406:1024:4294967295] 8@kfi7 LPNI seq info [17340077:17340077:16:4294967295]
00000400:00000200:24.0:1773851901.896273:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000400:00000200:24.0:1773851901.896274:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8@kfi7 to cpt 6
00000400:00000200:24.0:1773851901.896276:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8@kfi7(8@kfi7:8@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851901.896277:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 3
00000800:00000200:24.0:1773851901.896278:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851901.896279:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851901.896282:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851901.896285:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Using peer 8@kfi7(0x200000000001191)
00000800:00000200:24.0:1773851901.896287:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 468 bytes to peer 0x200000000001191: rc=0
00000800:00000200:24.0:1773851901.896289:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851901.896291:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851901.896291:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c4eaef12 refcount 6 to 7@kfi7
00010000:00000001:24.0:1773851901.896292:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851901.896293:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851901.896293:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851901.896294:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dc4ed428 x1859388080768896/t0(0) o41->lustre5-MDT0004-mdtlov_UUID@7@kfi7:628/0 lens 224/368 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba5-0'
00000100:00100000:24.0:1773851901.896298:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dc4ed428 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0004-mdtlov_UUID+5:38115:x1859388080768896:12345-7@kfi7:41:default-yuba5-0 Request processed in 64us (96us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851901.896300:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-7@kfi7, seq: 5799992
00000100:00000040:24.0:1773851901.896301:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002b5027d8 : new rpc_count 0
00000100:00000001:24.0:1773851901.896301:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851901.896302:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851901.896302:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e3c6e04b.
00000020:00000010:24.0:1773851901.896303:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000215850cb.
00000020:00000010:24.0:1773851901.896304:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000008d096de4.
00000020:00000040:24.0:1773851901.896305:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 000000002b5027d8 : new refcount 4
00000100:00000001:24.0:1773851901.896305:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851901.896310:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851901.896311:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851901.896312:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8@kfi7: PUT: OK
00000400:00000200:25.0:1773851901.896313:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000094777d
00000400:00000010:25.0:1773851901.896314:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000094777d.
00000100:00000001:25.0:1773851901.896314:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851901.896315:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851901.896316:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000014759d04 nid 8@kfi7 refs 2
00000800:00000200:25.0:1773851901.896317:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 8@kfi7(000000002618e505):0x0 lsk 4498 rsk 88 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000001191 Transaction freed
00000800:00000200:29.0:1773851901.903882:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851901.903882:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851901.903884:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851901.903885:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851901.903887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.903888:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22513@kfi7 : PUT - for me
00000400:00000200:29.0:1773851901.903889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.903890:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 1
00000400:00000200:29.0:1773851901.903891:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:29.0:1773851901.903892:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000400:00000200:29.0:1773851901.903893:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 3
00000400:00000200:29.0:1773851901.903893:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22320@kfi7 to cpt 1
00000400:00000200:29.0:1773851901.903894:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22320@kfi7 of length 224 into portal 12 MB=0x699e10530b900
00000400:00000200:29.0:1773851901.903896:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22320@kfi7 of length 224/224 into md 0x77fe1859d [64] + 11968
00000800:00000200:29.0:1773851901.903898:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851901.903900:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851901.903901:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22513@kfi7: PUT: OK
00000100:00000001:29.0:1773851901.903902:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851901.903902:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851901.903903:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000090cbd20e.
00000100:00000040:29.0:1773851901.903904:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000090cbd20e x1858041594034432 msgsize 224
00000100:00100000:29.0:1773851901.903906:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22320@kfi7 (source: 12345-22513@kfi7)
00000100:00000001:29.0:1773851901.903907:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851901.903908:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851901.903908:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
02000000:00000001:31.0:1773851901.903909:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851901.903909:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851901.903909:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851901.903910:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851901.903911:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851901.903911:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041594034432
00000020:00000001:31.0:1773851901.903912:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851901.903912:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91e3f
00000020:00000001:31.0:1773851901.903913:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851901.903916:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000467bea46 refcount=6
00000020:00000001:31.0:1773851901.903917:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628792320 : -107123080759296 : ffff9e9276d2f800)
00000020:00000001:31.0:1773851901.903918:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628792320 : -107123080759296 : ffff9e9276d2f800)
00000100:00000001:31.0:1773851901.903919:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851901.903921:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851901.903921:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000afd5d76e.
00000020:00000010:31.0:1773851901.903922:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851901.903923:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851901.903924:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851901.903924:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851901.903925:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851901.903926:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851901.903926:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851901.903926:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.903927:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851901.903928:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851901.903929:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851901.903929:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851901.903929:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851901.903930:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22320@kfi7, seq: 2055607
00000100:00000040:31.0:1773851901.903930:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000467bea46 : new rpc_count 1
00000100:00000001:31.0:1773851901.903931:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208514560 : -106943501037056 : ffff9ebc469c1200)
00000100:00000001:30.0:1773851901.903931:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851901.903931:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851901.903932:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000090cbd20e x1858041594034432/t0(0) o400->f81d0730-d54a-4e10-abd8-eaddbac1f6b8@22320@kfi7:689/0 lens 224/0 e 0 to 0 dl 1773852049 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1885-0'
00000100:00000001:31.0:1773851901.903935:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851901.903935:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851901.903936:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090cbd20e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:f81d0730-d54a-4e10-abd8-eaddbac1f6b8+6:39625:x1858041594034432:12345-22320@kfi7:400:default-tuolumne1885-0
00000100:00000200:31.0:1773851901.903938:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041594034432
00000020:00000001:31.0:1773851901.903938:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851901.903939:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851901.903939:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.903940:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851901.903941:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851901.903941:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851901.903942:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041594034432, found 0 last_xid 1858041594034431
00000020:00000001:31.0:1773851901.903943:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851901.903943:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851901.903944:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851901.903944:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.903945:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851901.903946:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851901.903946:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851901.903947:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a2a4d942.
02000000:00000001:31.0:1773851901.903948:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.903948:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.903949:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851901.903950:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183241701982, transno 0, xid 1858041594034432
00010000:00000001:31.0:1773851901.903950:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851901.903951:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000090cbd20e x1858041594034432/t0(0) o400->f81d0730-d54a-4e10-abd8-eaddbac1f6b8@22320@kfi7:689/0 lens 224/224 e 0 to 0 dl 1773852049 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1885-0'
00010000:00000001:31.0:1773851901.903954:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851901.903954:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851901.903955:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=134 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851901.903956:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851901.903957:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000096d24127 refcount 3 to 22320@kfi7
00000100:00000001:31.0:1773851901.903957:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553700864 : -107156155850752 : ffff9e8ac3652000)
02000000:00000001:31.0:1773851901.903958:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851901.903959:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851901.903959:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851901.903960:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22513@kfi7
00000400:00000010:31.0:1773851901.903961:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e4c73e55.
00000100:00000200:31.0:1773851901.903962:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041594034432, offset 224
00000400:00000200:31.0:1773851901.903963:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22513@kfi7
00000400:00000200:31.0:1773851901.903964:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:31.0:1773851901.903965:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 1
00000400:00000200:31.0:1773851901.903966:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000400:00000200:31.0:1773851901.903967:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 3
00000400:00000200:31.0:1773851901.903968:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22513@kfi7 local destination
00000400:00000200:31.0:1773851901.903969:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770407:8770407:1024:4294967295] 22513@kfi7 LPNI seq info [305403:305403:16:4294967295]
00000400:00000200:31.0:1773851901.903971:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000400:00000200:31.0:1773851901.903971:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22513@kfi7 to cpt 7
00000400:00000200:31.0:1773851901.903973:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22513@kfi7(22513@kfi7:22513@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851901.903975:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 3
00000800:00000200:31.0:1773851901.903977:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851901.903978:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851901.903980:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851901.903982:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e60 Using peer 22513@kfi7(0x100000000000e60)
00000800:00000200:31.0:1773851901.903985:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x100000000000e60: rc=0
00000800:00000200:31.0:1773851901.903987:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e60 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851901.903989:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851901.903990:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000096d24127 refcount 2 to 22320@kfi7
00010000:00000001:31.0:1773851901.903990:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851901.903991:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851901.903992:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851901.903992:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000090cbd20e x1858041594034432/t0(0) o400->f81d0730-d54a-4e10-abd8-eaddbac1f6b8@22320@kfi7:689/0 lens 224/224 e 0 to 0 dl 1773852049 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1885-0'
00000100:00100000:31.0:1773851901.903995:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090cbd20e pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:f81d0730-d54a-4e10-abd8-eaddbac1f6b8+6:39625:x1858041594034432:12345-22320@kfi7:400:default-tuolumne1885-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851901.903998:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22320@kfi7, seq: 2055607
00000100:00000040:31.0:1773851901.903999:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000467bea46 : new rpc_count 0
00000100:00000001:31.0:1773851901.904000:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851901.904000:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851901.904000:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e60 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851901.904001:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851901.904002:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000020:00000010:31.0:1773851901.904002:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000afd5d76e.
00000400:00000200:29.0:1773851901.904002:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:31.0:1773851901.904003:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000467bea46 : new refcount 5
00000400:00000200:29.0:1773851901.904003:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22513@kfi7: PUT: OK
00000100:00000001:31.0:1773851901.904004:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851901.904004:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e4c73e55
00000400:00000010:29.0:1773851901.904004:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e4c73e55.
00000100:00000001:29.0:1773851901.904005:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851901.904005:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851901.904006:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000510a60a2 nid 22513@kfi7 refs 2
00000800:00000200:29.0:1773851901.904008:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2054@kfi7:7 -> 22513@kfi7(00000000c57de895):0x0 lsk 3681 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000e60 Transaction freed
00000800:00000200:17.0:1773851901.937277:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851901.937278:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851901.937279:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851901.937281:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851901.937283:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.937284:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15713@kfi7 : PUT - for me
00000400:00000200:17.0:1773851901.937285:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.937286:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 1
00000400:00000200:17.0:1773851901.937287:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.937288:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000400:00000200:17.0:1773851901.937289:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 3
00000400:00000200:17.0:1773851901.937289:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15777@kfi7 to cpt 0
00000400:00000200:17.0:1773851901.937290:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15777@kfi7 of length 224 into portal 12 MB=0x69b4b5c4ff640
00000400:00000200:17.0:1773851901.937291:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15777@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 49712
00000800:00000200:17.0:1773851901.937293:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851901.937295:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851901.937296:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15713@kfi7: PUT: OK
00000100:00000001:17.0:1773851901.937297:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851901.937297:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851901.937298:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000070031e27.
00000100:00000040:17.0:1773851901.937298:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000070031e27 x1859597833860672 msgsize 224
00000100:00100000:17.0:1773851901.937301:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-15777@kfi7 (source: 12345-15713@kfi7)
00000100:00000001:17.0:1773851901.937302:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851901.937303:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000800:00000200:17.0:1773851901.937304:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000061cc5e0c: 2054@kfi7:4 <- 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851901.937307:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851901.937307:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851901.937308:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851901.937308:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851901.937309:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851901.937309:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597833860672
00000020:00000001:17.0:1773851901.937310:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851901.937310:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d800c6
00000020:00000001:17.0:1773851901.937311:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851901.937313:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000079f2046e refcount=5
00000020:00000001:17.0:1773851901.937314:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637125217122304 : -106948492429312 : ffff9ebb1d197800)
00000020:00000001:17.0:1773851901.937314:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637125217122304 : -106948492429312 : ffff9ebb1d197800)
00000100:00000001:17.0:1773851901.937315:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851901.937316:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851901.937316:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005b4be0ac.
00000020:00000010:17.0:1773851901.937317:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851901.937318:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851901.937319:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851901.937319:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851901.937320:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851901.937320:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851901.937321:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851901.937321:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.937322:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851901.937323:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851901.937323:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851901.937324:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851901.937324:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851901.937325:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15777@kfi7, seq: 2156446
00000100:00000040:17.0:1773851901.937325:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000079f2046e : new rpc_count 1
00000100:00000001:16.0:1773851901.937325:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.937326:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794800768 : -107029914750848 : ffff9ea827f37080)
00000100:00000001:16.0:1773851901.937326:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851901.937327:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000070031e27 x1859597833860672/t0(0) o400->5c61fdcb-62ff-4226-a348-6d11e38945c6@15777@kfi7:153/0 lens 224/0 e 0 to 0 dl 1773852268 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1472-0'
00000100:00000001:17.0:1773851901.937330:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851901.937330:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851901.937331:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000070031e27 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5c61fdcb-62ff-4226-a348-6d11e38945c6+5:39523:x1859597833860672:12345-15777@kfi7:400:default-tuolumne1472-0
00000100:00000200:17.0:1773851901.937332:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597833860672
00000020:00000001:17.0:1773851901.937332:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851901.937333:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851901.937333:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.937334:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851901.937334:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851901.937335:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851901.937336:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597833860672, found 0 last_xid 1859597833860671
00000020:00000001:17.0:1773851901.937336:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851901.937337:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851901.937337:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851901.937338:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.937338:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851901.937339:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851901.937339:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851901.937340:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e141d89b.
02000000:00000001:17.0:1773851901.937340:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.937341:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.937342:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851901.937342:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183250624124, transno 0, xid 1859597833860672
00010000:00000001:17.0:1773851901.937343:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851901.937343:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000070031e27 x1859597833860672/t0(0) o400->5c61fdcb-62ff-4226-a348-6d11e38945c6@15777@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1472-0'
00010000:00000001:17.0:1773851901.937346:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851901.937346:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851901.937347:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=134 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851901.937348:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851901.937348:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000042cd4471 refcount 3 to 15777@kfi7
00000100:00000001:17.0:1773851901.937349:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905051680 : -107154804499936 : ffff9e8b13f11a20)
02000000:00000001:17.0:1773851901.937350:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851901.937350:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851901.937351:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851901.937351:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15713@kfi7
00000400:00000010:17.0:1773851901.937352:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000031ca15d6.
00000100:00000200:17.0:1773851901.937353:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597833860672, offset 224
00000400:00000200:17.0:1773851901.937354:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15713@kfi7
00000400:00000200:17.0:1773851901.937355:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.937356:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 1
00000400:00000200:17.0:1773851901.937356:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000400:00000200:17.0:1773851901.937357:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 3
00000400:00000200:17.0:1773851901.937358:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15713@kfi7 local destination
00000400:00000200:17.0:1773851901.937360:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770408:8770408:1024:4294967295] 15713@kfi7 LPNI seq info [630455:630455:16:4294967295]
00000400:00000200:17.0:1773851901.937361:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000400:00000200:17.0:1773851901.937361:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15713@kfi7 to cpt 4
00000400:00000200:17.0:1773851901.937363:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15713@kfi7(15713@kfi7:15713@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851901.937364:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 3
00000800:00000200:17.0:1773851901.937365:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851901.937366:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851901.937368:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851901.937370:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a00 Using peer 15713@kfi7(0x100000000000a00)
00000800:00000200:17.0:1773851901.937373:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000061cc5e0c: Posted send of 324 bytes to peer 0x100000000000a00: rc=0
00000800:00000200:17.0:1773851901.937374:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a00 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851901.937376:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851901.937377:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000042cd4471 refcount 2 to 15777@kfi7
00010000:00000001:17.0:1773851901.937377:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851901.937378:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851901.937378:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851901.937379:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000070031e27 x1859597833860672/t0(0) o400->5c61fdcb-62ff-4226-a348-6d11e38945c6@15777@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1472-0'
00000100:00100000:17.0:1773851901.937382:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000070031e27 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:5c61fdcb-62ff-4226-a348-6d11e38945c6+5:39523:x1859597833860672:12345-15777@kfi7:400:default-tuolumne1472-0 Request processed in 51us (82us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851901.937384:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15777@kfi7, seq: 2156446
00000100:00000040:17.0:1773851901.937384:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000079f2046e : new rpc_count 0
00000100:00000001:17.0:1773851901.937385:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851901.937385:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851901.937386:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851901.937386:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000800:00000200:18.0:1773851901.937387:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a00 TN_EVENT_TX_OK event status 0
00000020:00000010:17.0:1773851901.937387:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005b4be0ac.
00000020:00000040:17.0:1773851901.937388:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000079f2046e : new refcount 4
00000100:00000001:17.0:1773851901.937388:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:18.0:1773851901.937390:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851901.937391:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15713@kfi7: PUT: OK
00000400:00000200:18.0:1773851901.937392:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000031ca15d6
00000400:00000010:18.0:1773851901.937393:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000031ca15d6.
00000100:00000001:18.0:1773851901.937393:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851901.937394:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851901.937395:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002da70805 nid 15713@kfi7 refs 2
00000800:00000200:18.0:1773851901.937396:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000061cc5e0c: 2054@kfi7:4 -> 15713@kfi7(00000000755fe6eb):0x0 lsk 2561 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000a00 Transaction freed
00000800:00000200:21.0:1773851901.969630:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851901.969631:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851901.969632:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851901.969634:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851901.969635:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.969636:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13@kfi7 : PUT - for me
00000400:00000200:21.0:1773851901.969637:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.969638:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:21.0:1773851901.969639:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.969639:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:21.0:1773851901.969640:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:21.0:1773851901.969641:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:21.0:1773851901.969642:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 224 into portal 24 MB=0x699e69c9ac840
00000400:00000200:21.0:1773851901.969643:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-13@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 8328
00000800:00000200:21.0:1773851901.969645:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851901.969646:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851901.969647:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000100:00000001:21.0:1773851901.969648:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851901.969649:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:21.0:1773851901.969650:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000091044a16.
00000100:00000040:21.0:1773851901.969651:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000091044a16 x1858065609181248 msgsize 224
00000100:00100000:21.0:1773851901.969652:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13@kfi7 (source: 12345-13@kfi7)
00000100:00000001:21.0:1773851901.969653:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851901.969654:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:21.0:1773851901.969655:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851901.969655:0:1537152:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851901.969655:0:1537152:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851901.969656:0:1537152:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851901.969656:0:1537152:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851901.969657:0:1537152:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851901.969658:0:1537152:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858065609181248
00000020:00000001:20.0:1773851901.969658:0:1537152:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851901.969659:0:1537152:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cc6
00000020:00000001:20.0:1773851901.969659:0:1537152:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851901.969660:0:1537152:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001a662865 refcount=5
00000020:00000001:20.0:1773851901.969661:0:1537152:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000020:00000001:20.0:1773851901.969662:0:1537152:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395700736 : -107136313850880 : ffff9e8f62120400)
00000100:00000001:20.0:1773851901.969663:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851901.969663:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851901.969664:0:1537152:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000058fd4362.
00000020:00000010:20.0:1773851901.969665:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851901.969666:0:1537152:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000040:20.0:1773851901.969667:0:1537152:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:20.0:1773851901.969668:0:1537152:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851901.969669:0:1537152:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851901.969669:0:1537152:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851901.969670:0:1537152:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851901.969671:0:1537152:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851901.969672:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851901.969673:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851901.969674:0:1537152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13@kfi7, seq: 3084765
00000100:00000040:20.0:1773851901.969675:0:1537152:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001a662865 : new rpc_count 1
00000100:00000001:20.0:1773851901.969675:0:1537152:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313413120 : -106917396138496 : ffff9ec25a953600)
00000100:00000040:20.0:1773851901.969677:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000091044a16 x1858065609181248/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:628/0 lens 224/0 e 0 to 0 dl 1773851988 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba3-0'
00000100:00000001:20.0:1773851901.969681:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851901.969681:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851901.969682:0:1537152:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000091044a16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065609181248:12345-13@kfi7:41:default-yuba3-0
00000100:00000200:20.0:1773851901.969683:0:1537152:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858065609181248
00000020:00000001:20.0:1773851901.969684:0:1537152:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851901.969685:0:1537152:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851901.969685:0:1537152:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851901.969686:0:1537152:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851901.969687:0:1537152:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:20.0:1773851901.969687:0:1537152:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851901.969688:0:1537152:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851901.969689:0:1537152:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851901.969689:0:1537152:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851901.969690:0:1537152:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851901.969691:0:1537152:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851901.969691:0:1537152:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851901.969692:0:1537152:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000ca9bc09a.
02000000:00000001:20.0:1773851901.969693:0:1537152:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851901.969694:0:1537152:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851901.969695:0:1537152:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:20.0:1773851901.969695:0:1537152:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:20.0:1773851901.969696:0:1537152:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:20.0:1773851901.969697:0:1537152:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 395575296 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:20.0:1773851901.969698:0:1537152:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129889 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:20.0:1773851901.969700:0:1537152:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851901.969701:0:1537152:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586888, transno 0, xid 1858065609181248
00010000:00000001:20.0:1773851901.969702:0:1537152:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851901.969702:0:1537152:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000091044a16 x1858065609181248/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:628/0 lens 224/368 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00010000:00000001:20.0:1773851901.969705:0:1537152:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851901.969706:0:1537152:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851901.969707:0:1537152:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=125 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851901.969709:0:1537152:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851901.969709:0:1537152:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006413d0e5 refcount 7 to 13@kfi7
00000100:00000001:20.0:1773851901.969710:0:1537152:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957453056 : -107146752098560 : ffff9e8cf3e6ff00)
02000000:00000001:20.0:1773851901.969711:0:1537152:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851901.969712:0:1537152:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851901.969712:0:1537152:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851901.969713:0:1537152:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:20.0:1773851901.969714:0:1537152:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a48173f.
00000100:00000200:20.0:1773851901.969715:0:1537152:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858065609181248, offset 224
00000400:00000200:20.0:1773851901.969717:0:1537152:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
00000400:00000200:20.0:1773851901.969718:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851901.969719:0:1537152:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000400:00000200:20.0:1773851901.969720:0:1537152:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851901.969721:0:1537152:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:20.0:1773851901.969723:0:1537152:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13@kfi7 local destination
00000400:00000200:20.0:1773851901.969724:0:1537152:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770409:8770409:1024:4294967295] 13@kfi7 LPNI seq info [23133334:23133334:16:4294967295]
00000400:00000200:20.0:1773851901.969730:0:1537152:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000200:20.0:1773851901.969731:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:20.0:1773851901.969733:0:1537152:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13@kfi7(13@kfi7:13@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851901.969734:0:1537152:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000800:00000200:20.0:1773851901.969735:0:1537152:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851901.969737:0:1537152:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:20.0:1773851901.969739:0:1537152:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851901.969742:0:1537152:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 Using peer 13@kfi7(0x102)
00000800:00000200:20.0:1773851901.969745:0:1537152:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000194956ef: Posted send of 468 bytes to peer 0x102: rc=0
00000800:00000200:20.0:1773851901.969747:0:1537152:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851901.969751:0:1537152:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851901.969752:0:1537152:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006413d0e5 refcount 6 to 13@kfi7
00010000:00000001:20.0:1773851901.969753:0:1537152:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851901.969753:0:1537152:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851901.969755:0:1537152:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851901.969756:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000091044a16 x1858065609181248/t0(0) o41->lustre5-MDT0002-mdtlov_UUID@13@kfi7:628/0 lens 224/368 e 0 to 0 dl 1773851988 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba3-0'
00000100:00100000:20.0:1773851901.969759:0:1537152:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000091044a16 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0002-mdtlov_UUID+5:52337:x1858065609181248:12345-13@kfi7:41:default-yuba3-0 Request processed in 78us (108us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851901.969762:0:1537152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13@kfi7, seq: 3084765
00000100:00000040:20.0:1773851901.969763:0:1537152:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001a662865 : new rpc_count 0
00000100:00000001:20.0:1773851901.969763:0:1537152:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851901.969764:0:1537152:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851901.969765:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851901.969765:0:1537152:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851901.969766:0:1537152:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000058fd4362.
00000020:00000040:20.0:1773851901.969767:0:1537152:0:(genops.c:882:class_export_put()) PUTting export 000000001a662865 : new refcount 4
00000100:00000001:20.0:1773851901.969768:0:1537152:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851901.969773:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851901.969774:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851901.969775:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13@kfi7: PUT: OK
00000400:00000200:21.0:1773851901.969776:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a48173f
00000400:00000010:21.0:1773851901.969776:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a48173f.
00000100:00000001:21.0:1773851901.969777:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851901.969777:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851901.969778:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:21.0:1773851901.969779:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 13@kfi7(00000000db68253b):0x0 lsk 259 rsk 4802 tsk 0 trmk 0 tmk 0 trr 5 tta 0x102 Transaction freed
00000800:00000200:21.0:1773851902.011610:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851902.011611:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851902.011613:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851902.011616:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851902.011619:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.011621:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9587@kfi7 : PUT - for me
00000400:00000200:21.0:1773851902.011622:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.011624:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 1
00000400:00000200:21.0:1773851902.011625:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.011626:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000400:00000200:21.0:1773851902.011628:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 3
00000400:00000200:21.0:1773851902.011629:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.011631:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9587@kfi7 of length 224 into portal 12 MB=0x69b16e344c640
00000400:00000200:21.0:1773851902.011633:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9587@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 68688
00000800:00000200:21.0:1773851902.011636:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851902.011638:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.011640:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9587@kfi7: PUT: OK
00000100:00000001:21.0:1773851902.011641:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851902.011642:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851902.011643:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac294714.
00000100:00000040:21.0:1773851902.011644:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ac294714 x1859372464784960 msgsize 224
00000100:00100000:21.0:1773851902.011646:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9587@kfi7 (source: 12345-9587@kfi7)
00000100:00000001:21.0:1773851902.011647:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851902.011648:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000100:00000001:23.0:1773851902.011650:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851902.011651:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851902.011651:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851902.011651:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851902.011652:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851902.011653:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851902.011654:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372464784960
00000020:00000001:23.0:1773851902.011656:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851902.011657:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92570
00000020:00000001:23.0:1773851902.011658:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851902.011662:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001be2f3fc refcount=6
00000020:00000001:23.0:1773851902.011663:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630760448 : -107123078791168 : ffff9e9276f10000)
00000020:00000001:23.0:1773851902.011664:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630760448 : -107123078791168 : ffff9e9276f10000)
00000100:00000001:23.0:1773851902.011666:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851902.011667:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851902.011668:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005f866e7c.
00000020:00000010:23.0:1773851902.011669:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851902.011670:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000002dfa750d.
00000100:00000001:23.0:1773851902.011672:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851902.011673:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851902.011673:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851902.011675:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851902.011676:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851902.011676:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851902.011678:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851902.011679:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851902.011680:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851902.011680:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851902.011680:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851902.011681:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9587@kfi7, seq: 1998086
00000100:00000001:23.0:1773851902.011682:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.011682:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001be2f3fc : new rpc_count 1
00000100:00000001:20.0:1773851902.011682:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313426944 : -106917396124672 : ffff9ec25a956c00)
00000100:00000001:23.0:1773851902.011683:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.011684:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ac294714 x1859372464784960/t0(0) o400->b9c8c5dc-d238-4795-82ef-ae3aafe74c61@9587@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1082-0'
00000100:00000001:20.0:1773851902.011686:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.011687:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851902.011688:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac294714 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b9c8c5dc-d238-4795-82ef-ae3aafe74c61+6:39487:x1859372464784960:12345-9587@kfi7:400:default-tuolumne1082-0
00000100:00000200:20.0:1773851902.011689:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372464784960
00000020:00000001:20.0:1773851902.011690:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851902.011691:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851902.011691:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.011692:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851902.011692:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851902.011693:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851902.011694:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372464784960, found 0 last_xid 1859372464784959
00000020:00000001:20.0:1773851902.011694:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851902.011695:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851902.011695:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851902.011696:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.011697:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851902.011697:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851902.011698:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851902.011698:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000058fd4362.
02000000:00000001:20.0:1773851902.011699:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.011699:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.011700:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851902.011701:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510527984, transno 0, xid 1859372464784960
00010000:00000001:20.0:1773851902.011701:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851902.011702:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ac294714 x1859372464784960/t0(0) o400->b9c8c5dc-d238-4795-82ef-ae3aafe74c61@9587@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1082-0'
00010000:00000001:20.0:1773851902.011705:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851902.011705:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851902.011706:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=135 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851902.011707:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851902.011708:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000704def3b refcount 3 to 9587@kfi7
00000100:00000001:20.0:1773851902.011708:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355107744 : -107156354443872 : ffff9e8ab78ed5a0)
02000000:00000001:20.0:1773851902.011709:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851902.011710:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.011710:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851902.011711:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9587@kfi7
00000400:00000010:20.0:1773851902.011712:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b1efbb09.
00000100:00000200:20.0:1773851902.011712:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372464784960, offset 224
00000400:00000200:20.0:1773851902.011714:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9587@kfi7
00000400:00000200:20.0:1773851902.011715:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.011716:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 1
00000400:00000200:20.0:1773851902.011717:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000400:00000200:20.0:1773851902.011718:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 3
00000400:00000200:20.0:1773851902.011719:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9587@kfi7 local destination
00000400:00000200:20.0:1773851902.011720:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770410:8770410:1024:4294967295] 9587@kfi7 LPNI seq info [17486:17486:16:4294967295]
00000400:00000200:20.0:1773851902.011721:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000400:00000200:20.0:1773851902.011722:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9587@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.011724:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9587@kfi7(9587@kfi7:9587@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851902.011727:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 3
00000800:00000200:20.0:1773851902.011728:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851902.011729:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851902.011731:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851902.011733:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000058c Using peer 9587@kfi7(0x10000000000058c)
00000800:00000200:20.0:1773851902.011736:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0x10000000000058c: rc=0
00000800:00000200:20.0:1773851902.011737:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000058c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851902.011739:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.011740:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000704def3b refcount 2 to 9587@kfi7
00010000:00000001:20.0:1773851902.011741:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851902.011741:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.011742:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851902.011742:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac294714 x1859372464784960/t0(0) o400->b9c8c5dc-d238-4795-82ef-ae3aafe74c61@9587@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1082-0'
00000100:00100000:20.0:1773851902.011745:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac294714 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b9c8c5dc-d238-4795-82ef-ae3aafe74c61+6:39487:x1859372464784960:12345-9587@kfi7:400:default-tuolumne1082-0 Request processed in 58us (101us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851902.011751:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9587@kfi7, seq: 1998086
00000100:00000040:20.0:1773851902.011752:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001be2f3fc : new rpc_count 0
00000100:00000001:20.0:1773851902.011753:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851902.011753:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851902.011754:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:20.0:1773851902.011754:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000002dfa750d.
00000020:00000010:20.0:1773851902.011755:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005f866e7c.
00000020:00000040:20.0:1773851902.011756:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000001be2f3fc : new refcount 5
00000100:00000001:20.0:1773851902.011756:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851902.011762:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000058c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851902.011765:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.011767:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9587@kfi7: PUT: OK
00000400:00000200:21.0:1773851902.011768:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b1efbb09
00000400:00000010:21.0:1773851902.011768:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b1efbb09.
00000100:00000001:21.0:1773851902.011769:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851902.011770:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851902.011771:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008c6c9582 nid 9587@kfi7 refs 2
00000800:00000200:21.0:1773851902.011774:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 9587@kfi7(00000000bc2a8e21):0x0 lsk 1421 rsk 46 tsk 0 trmk 0 tmk 0 trr 5 tta 0x10000000000058c Transaction freed
00000800:00000200:17.0:1773851902.012961:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851902.012961:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851902.012963:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851902.012965:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851902.012966:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.012968:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9330@kfi7 : PUT - for me
00000400:00000200:17.0:1773851902.012968:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.012969:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 1
00000400:00000200:17.0:1773851902.012970:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.012971:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000400:00000200:17.0:1773851902.012971:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 3
00000400:00000200:17.0:1773851902.012972:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9331@kfi7 to cpt 7
00000400:00000200:17.0:1773851902.012973:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9331@kfi7 of length 224 into portal 12 MB=0x69b8265cbd400
00000400:00000200:17.0:1773851902.012974:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9331@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 49936
00000800:00000200:17.0:1773851902.012976:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851902.012978:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851902.012978:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9330@kfi7: PUT: OK
00000100:00000001:17.0:1773851902.012979:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851902.012980:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851902.012980:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a1992b85.
00000100:00000040:17.0:1773851902.012981:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000a1992b85 x1859834216174592 msgsize 224
00000100:00100000:17.0:1773851902.012983:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9331@kfi7 (source: 12345-9330@kfi7)
00000100:00000001:17.0:1773851902.012984:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851902.012985:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000800:00000200:17.0:1773851902.012986:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:17.0:1773851902.012988:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:17.0:1773851902.012989:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:17.0:1773851902.012989:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:17.0:1773851902.012990:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:17.0:1773851902.012990:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:17.0:1773851902.012991:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859834216174592
00000020:00000001:17.0:1773851902.012991:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:17.0:1773851902.012992:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875c177d7c
00000020:00000001:17.0:1773851902.012992:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:17.0:1773851902.012994:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b135b089 refcount=5
00000020:00000001:17.0:1773851902.012994:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637029411892224 : -107044297659392 : ffff9ea4cea9ac00)
00000020:00000001:17.0:1773851902.012995:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637029411892224 : -107044297659392 : ffff9ea4cea9ac00)
00000100:00000001:17.0:1773851902.012996:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851902.012996:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:17.0:1773851902.012997:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005b4be0ac.
00000020:00000010:17.0:1773851902.012998:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d9c3a317.
00000020:00000010:17.0:1773851902.012999:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000183340e0.
00000100:00000001:17.0:1773851902.012999:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:17.0:1773851902.013000:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:17.0:1773851902.013000:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851902.013001:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:17.0:1773851902.013002:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:17.0:1773851902.013002:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851902.013003:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851902.013004:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851902.013004:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:17.0:1773851902.013005:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851902.013005:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:17.0:1773851902.013006:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9331@kfi7, seq: 2156447
00000100:00000040:17.0:1773851902.013007:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b135b089 : new rpc_count 1
00000100:00000001:16.0:1773851902.013007:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851902.013008:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794788096 : -107029914763520 : ffff9ea827f33f00)
00000100:00000001:16.0:1773851902.013008:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851902.013009:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a1992b85 x1859834216174592/t0(0) o400->1698a260-6167-4170-80ac-0ec0b5956089@9331@kfi7:154/0 lens 224/0 e 0 to 0 dl 1773852269 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1066-0'
00000100:00000001:17.0:1773851902.013011:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:17.0:1773851902.013012:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:17.0:1773851902.013013:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a1992b85 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1698a260-6167-4170-80ac-0ec0b5956089+5:39730:x1859834216174592:12345-9331@kfi7:400:default-tuolumne1066-0
00000100:00000200:17.0:1773851902.013014:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859834216174592
00000020:00000001:17.0:1773851902.013015:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:17.0:1773851902.013016:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:17.0:1773851902.013016:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851902.013017:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:17.0:1773851902.013017:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:17.0:1773851902.013018:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:17.0:1773851902.013019:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859834216174592, found 0 last_xid 1859834216174591
00000020:00000001:17.0:1773851902.013020:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:17.0:1773851902.013020:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:17.0:1773851902.013021:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:17.0:1773851902.013021:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851902.013022:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:17.0:1773851902.013023:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:17.0:1773851902.013023:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:17.0:1773851902.013024:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004ccc8d14.
02000000:00000001:17.0:1773851902.013024:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851902.013025:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851902.013026:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:17.0:1773851902.013026:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183206694979, transno 0, xid 1859834216174592
00010000:00000001:17.0:1773851902.013029:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:17.0:1773851902.013030:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a1992b85 x1859834216174592/t0(0) o400->1698a260-6167-4170-80ac-0ec0b5956089@9331@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1066-0'
00010000:00000001:17.0:1773851902.013032:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:17.0:1773851902.013033:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:17.0:1773851902.013034:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=135 v=340 (340 214 1 1)
00000100:00000001:17.0:1773851902.013035:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:17.0:1773851902.013036:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c130e67c refcount 3 to 9331@kfi7
00000100:00000001:17.0:1773851902.013036:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932096 : -107137839619520 : ffff9e8f0720a240)
02000000:00000001:17.0:1773851902.013037:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:17.0:1773851902.013038:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851902.013038:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:17.0:1773851902.013039:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9330@kfi7
00000400:00000010:17.0:1773851902.013039:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cfc002a6.
00000100:00000200:17.0:1773851902.013040:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859834216174592, offset 224
00000400:00000200:17.0:1773851902.013041:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9330@kfi7
00000400:00000200:17.0:1773851902.013042:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.013043:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 1
00000400:00000200:17.0:1773851902.013044:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000400:00000200:17.0:1773851902.013045:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 3
00000400:00000200:17.0:1773851902.013046:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9330@kfi7 local destination
00000400:00000200:17.0:1773851902.013048:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770411:8770411:1024:4294967295] 9330@kfi7 LPNI seq info [1621602:1621602:16:4294967295]
00000400:00000200:17.0:1773851902.013049:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000400:00000200:17.0:1773851902.013050:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9330@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.013052:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9330@kfi7(9330@kfi7:9330@kfi7) <?> : PUT try# 0
00000400:00000200:17.0:1773851902.013053:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 3
00000800:00000200:17.0:1773851902.013054:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851902.013055:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:17.0:1773851902.013057:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:17.0:1773851902.013059:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1012 Using peer 9330@kfi7(0x1012)
00000800:00000200:17.0:1773851902.013062:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 324 bytes to peer 0x1012: rc=0
00000800:00000200:17.0:1773851902.013064:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1012 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:17.0:1773851902.013066:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:17.0:1773851902.013067:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c130e67c refcount 2 to 9331@kfi7
00010000:00000001:17.0:1773851902.013067:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:17.0:1773851902.013068:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:17.0:1773851902.013069:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:17.0:1773851902.013069:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a1992b85 x1859834216174592/t0(0) o400->1698a260-6167-4170-80ac-0ec0b5956089@9331@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1066-0'
00000100:00100000:17.0:1773851902.013072:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a1992b85 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1698a260-6167-4170-80ac-0ec0b5956089+5:39730:x1859834216174592:12345-9331@kfi7:400:default-tuolumne1066-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:17.0:1773851902.013074:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9331@kfi7, seq: 2156447
00000100:00000040:17.0:1773851902.013075:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b135b089 : new rpc_count 0
00000800:00000200:18.0:1773851902.013076:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1012 TN_EVENT_TX_OK event status 0
00000100:00000001:17.0:1773851902.013076:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:17.0:1773851902.013076:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:17.0:1773851902.013077:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d9c3a317.
00000400:00000200:18.0:1773851902.013078:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:17.0:1773851902.013078:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000183340e0.
00000020:00000010:17.0:1773851902.013078:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005b4be0ac.
00000400:00000200:18.0:1773851902.013079:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9330@kfi7: PUT: OK
00000020:00000040:17.0:1773851902.013079:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000b135b089 : new refcount 4
00000400:00000200:18.0:1773851902.013080:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cfc002a6
00000400:00000010:18.0:1773851902.013080:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cfc002a6.
00000100:00000001:17.0:1773851902.013080:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:18.0:1773851902.013081:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851902.013082:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851902.013083:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d405f74b nid 9330@kfi7 refs 2
00000800:00000200:18.0:1773851902.013084:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009e13a487: 2069@kfi7:4 -> 9330@kfi7(000000000f05ab75):0x0 lsk 4115 rsk 30 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1012 Transaction freed
00000800:00000200:26.0:1773851902.058676:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851902.058677:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851902.058678:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851902.058680:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851902.058682:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:26.0:1773851902.058684:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12915@kfi7 : PUT - for me
00000400:00000200:26.0:1773851902.058685:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:26.0:1773851902.058686:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 1
00000400:00000200:26.0:1773851902.058687:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:26.0:1773851902.058688:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000400:00000200:26.0:1773851902.058689:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 3
00000400:00000200:26.0:1773851902.058690:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12978@kfi7 to cpt 7
00000400:00000200:26.0:1773851902.058691:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12978@kfi7 of length 224 into portal 12 MB=0x69b31167f8900
00000400:00000200:26.0:1773851902.058693:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12978@kfi7 of length 224/224 into md 0x16159c9699 [64] + 44488
00000800:00000200:26.0:1773851902.058695:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851902.058697:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851902.058698:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12915@kfi7: PUT: OK
00000100:00000001:26.0:1773851902.058699:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851902.058700:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851902.058701:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000019152df0.
00000100:00000040:26.0:1773851902.058701:0:2507427:0:(events.c:358:request_in_callback()) incoming req@0000000019152df0 x1859484993423616 msgsize 224
00000100:00100000:26.0:1773851902.058703:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-12978@kfi7 (source: 12345-12915@kfi7)
00000100:00000001:26.0:1773851902.058704:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851902.058706:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000800:00000200:26.0:1773851902.058707:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b4a0b7d0: 2054@kfi7:6 <- 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851902.058710:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851902.058711:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851902.058711:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851902.058712:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851902.058713:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851902.058713:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859484993423616
00000020:00000001:26.0:1773851902.058714:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851902.058714:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07cdbf9b67c
00000020:00000001:26.0:1773851902.058715:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851902.058717:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000052438900 refcount=5
00000020:00000001:26.0:1773851902.058718:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636979123768320 : -107094585783296 : ffff9e991941cc00)
00000020:00000001:26.0:1773851902.058718:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636979123768320 : -107094585783296 : ffff9e991941cc00)
00000100:00000001:26.0:1773851902.058720:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851902.058721:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851902.058722:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f5cb6f5.
00000020:00000010:26.0:1773851902.058723:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851902.058724:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851902.058725:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851902.058728:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851902.058728:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851902.058729:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851902.058730:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851902.058730:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.058731:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851902.058733:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851902.058734:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851902.058734:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:26.0:1773851902.058735:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12978@kfi7, seq: 2025195
00000100:00000040:26.0:1773851902.058735:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000052438900 : new rpc_count 1
00000100:00000001:24.0:1773851902.058735:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851902.058736:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137189202944 : -106936520348672 : ffff9ebde6b0ec00)
00000100:00000001:24.0:1773851902.058736:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851902.058737:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000019152df0 x1859484993423616/t0(0) o400->ff3af850-8622-47de-8418-85a9c6c111f1@12978@kfi7:183/0 lens 224/0 e 0 to 0 dl 1773852298 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1290-0'
00000100:00000001:24.0:1773851902.058737:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.058740:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851902.058740:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851902.058741:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000019152df0 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ff3af850-8622-47de-8418-85a9c6c111f1+5:39892:x1859484993423616:12345-12978@kfi7:400:default-tuolumne1290-0
00000100:00000200:26.0:1773851902.058742:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859484993423616
00000020:00000001:26.0:1773851902.058743:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851902.058744:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851902.058744:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.058745:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851902.058746:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851902.058746:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851902.058747:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859484993423616, found 0 last_xid 1859484993423615
00000020:00000001:26.0:1773851902.058748:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851902.058749:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851902.058749:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851902.058750:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.058751:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851902.058751:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851902.058752:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851902.058752:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dd135460.
02000000:00000001:26.0:1773851902.058753:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.058754:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.058754:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851902.058755:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096686839, transno 0, xid 1859484993423616
00010000:00000001:26.0:1773851902.058756:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851902.058757:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000019152df0 x1859484993423616/t0(0) o400->ff3af850-8622-47de-8418-85a9c6c111f1@12978@kfi7:183/0 lens 224/224 e 0 to 0 dl 1773852298 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1290-0'
00010000:00000001:26.0:1773851902.058760:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851902.058760:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851902.058761:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=135 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851902.058762:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851902.058763:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000181ed72f refcount 3 to 12978@kfi7
00000100:00000001:26.0:1773851902.058764:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091272160 : -107152618279456 : ffff9e8b96402de0)
02000000:00000001:26.0:1773851902.058765:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851902.058765:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.058766:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851902.058766:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12915@kfi7
00000400:00000010:26.0:1773851902.058767:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1589030.
00000100:00000200:26.0:1773851902.058768:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859484993423616, offset 224
00000400:00000200:26.0:1773851902.058769:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12915@kfi7
00000400:00000200:26.0:1773851902.058770:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:26.0:1773851902.058771:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 1
00000400:00000200:26.0:1773851902.058772:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000400:00000200:26.0:1773851902.058773:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 3
00000400:00000200:26.0:1773851902.058774:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12915@kfi7 local destination
00000400:00000200:26.0:1773851902.058775:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770412:8770412:1024:4294967295] 12915@kfi7 LPNI seq info [10811826:10811826:16:4294967295]
00000400:00000200:26.0:1773851902.058777:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000400:00000200:26.0:1773851902.058777:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12915@kfi7 to cpt 6
00000400:00000200:26.0:1773851902.058779:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12915@kfi7(12915@kfi7:12915@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851902.058781:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 3
00000800:00000200:26.0:1773851902.058782:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851902.058783:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851902.058785:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851902.058788:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c1 Using peer 12915@kfi7(0x1000000000010c1)
00000800:00000200:26.0:1773851902.058791:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b4a0b7d0: Posted send of 324 bytes to peer 0x1000000000010c1: rc=0
00000800:00000200:26.0:1773851902.058792:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851902.058794:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851902.058795:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000181ed72f refcount 2 to 12978@kfi7
00010000:00000001:26.0:1773851902.058796:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851902.058796:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.058797:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851902.058797:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000019152df0 x1859484993423616/t0(0) o400->ff3af850-8622-47de-8418-85a9c6c111f1@12978@kfi7:183/0 lens 224/224 e 0 to 0 dl 1773852298 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1290-0'
00000100:00100000:26.0:1773851902.058800:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000019152df0 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:ff3af850-8622-47de-8418-85a9c6c111f1+5:39892:x1859484993423616:12345-12978@kfi7:400:default-tuolumne1290-0 Request processed in 60us (98us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851902.058803:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12978@kfi7, seq: 2025195
00000100:00000040:26.0:1773851902.058803:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000052438900 : new rpc_count 0
00000100:00000001:26.0:1773851902.058804:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851902.058805:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:26.0:1773851902.058806:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851902.058806:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000020:00000010:26.0:1773851902.058807:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f5cb6f5.
00000800:00000200:25.0:1773851902.058807:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c1 TN_EVENT_TX_OK event status 0
00000020:00000040:26.0:1773851902.058808:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000052438900 : new refcount 4
00000100:00000001:26.0:1773851902.058808:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851902.058809:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851902.058811:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12915@kfi7: PUT: OK
00000400:00000200:25.0:1773851902.058812:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1589030
00000400:00000010:25.0:1773851902.058813:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1589030.
00000100:00000001:25.0:1773851902.058814:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851902.058814:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851902.058816:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000189c6ede nid 12915@kfi7 refs 2
00000800:00000200:25.0:1773851902.058818:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b4a0b7d0: 2054@kfi7:6 -> 12915@kfi7(00000000020311bd):0x0 lsk 4290 rsk 11 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000010c1 Transaction freed
00000800:00000200:9.0:1773851902.067989:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.067990:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851902.067993:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851902.067999:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851902.068002:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.068004:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20354@kfi7 : PUT - for me
00000400:00000200:9.0:1773851902.068006:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.068008:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 1
00000400:00000200:9.0:1773851902.068010:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.068011:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000400:00000200:9.0:1773851902.068013:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 3
00000400:00000200:9.0:1773851902.068014:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20291@kfi7 to cpt 1
00000400:00000200:9.0:1773851902.068016:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20291@kfi7 of length 224 into portal 12 MB=0x69b0a3f2d0840
00000400:00000200:9.0:1773851902.068017:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20291@kfi7 of length 224/224 into md 0x78146ce49 [64] + 167344
00000800:00000200:9.0:1773851902.068020:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851902.068023:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851902.068025:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20354@kfi7: PUT: OK
00000100:00000001:9.0:1773851902.068027:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851902.068028:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851902.068029:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d5102ce7.
00000100:00000040:9.0:1773851902.068030:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d5102ce7 x1859318172158016 msgsize 224
00000100:00100000:9.0:1773851902.068032:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20291@kfi7 (source: 12345-20354@kfi7)
00000100:00000001:9.0:1773851902.068034:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851902.068035:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000100:00000001:8.0:1773851902.068036:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851902.068037:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851902.068037:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851902.068038:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851902.068039:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851902.068040:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851902.068041:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318172158016
00000020:00000001:8.0:1773851902.068042:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851902.068043:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9243c
00000020:00000001:8.0:1773851902.068044:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851902.068048:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dde6cf3b refcount=6
00000020:00000001:8.0:1773851902.068049:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630525952 : -107123079025664 : ffff9e9276ed6c00)
00000020:00000001:8.0:1773851902.068050:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630525952 : -107123079025664 : ffff9e9276ed6c00)
00000100:00000001:8.0:1773851902.068052:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851902.068053:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851902.068054:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000d56077ea.
00000020:00000010:8.0:1773851902.068056:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851902.068057:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851902.068058:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851902.068059:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851902.068060:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851902.068062:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851902.068063:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851902.068063:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.068065:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851902.068067:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851902.068067:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851902.068067:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:9.0:1773851902.068068:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851902.068069:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20291@kfi7, seq: 2130889
00000100:00000001:9.0:1773851902.068070:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.068070:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dde6cf3b : new rpc_count 1
00000100:00000001:8.0:1773851902.068071:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498306432 : -106953211245184 : ffff9eba03d60d80)
00000100:00000001:9.0:1773851902.068072:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.068073:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d5102ce7 x1859318172158016/t0(0) o400->d5639816-d81a-4bc3-b4d8-29a95f8c3635@20291@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1768-0'
00000100:00000001:8.0:1773851902.068077:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851902.068078:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851902.068079:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d5102ce7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d5639816-d81a-4bc3-b4d8-29a95f8c3635+6:39541:x1859318172158016:12345-20291@kfi7:400:default-tuolumne1768-0
00000100:00000200:8.0:1773851902.068081:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318172158016
00000020:00000001:8.0:1773851902.068082:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851902.068083:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851902.068084:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.068085:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851902.068086:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851902.068087:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851902.068088:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318172158016, found 0 last_xid 1859318172158015
00000020:00000001:8.0:1773851902.068089:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851902.068090:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851902.068091:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851902.068092:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.068093:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851902.068094:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851902.068095:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851902.068096:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f0195c50.
02000000:00000001:8.0:1773851902.068097:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.068099:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.068100:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851902.068101:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183208761549, transno 0, xid 1859318172158016
00010000:00000001:8.0:1773851902.068102:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851902.068103:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d5102ce7 x1859318172158016/t0(0) o400->d5639816-d81a-4bc3-b4d8-29a95f8c3635@20291@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1768-0'
00010000:00000001:8.0:1773851902.068108:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851902.068108:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851902.068109:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=135 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851902.068111:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851902.068112:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000aff866f1 refcount 3 to 20291@kfi7
00000100:00000001:8.0:1773851902.068114:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553704608 : -107156155847008 : ffff9e8ac3652ea0)
02000000:00000001:8.0:1773851902.068115:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851902.068116:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.068117:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851902.068118:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20354@kfi7
00000400:00000010:8.0:1773851902.068119:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bf7b495c.
00000100:00000200:8.0:1773851902.068120:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318172158016, offset 224
00000400:00000200:8.0:1773851902.068122:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20354@kfi7
00000400:00000200:8.0:1773851902.068124:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:8.0:1773851902.068126:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 1
00000400:00000200:8.0:1773851902.068127:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000400:00000200:8.0:1773851902.068129:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 3
00000400:00000200:8.0:1773851902.068131:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20354@kfi7 local destination
00000400:00000200:8.0:1773851902.068133:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770413:8770413:1024:4294967295] 20354@kfi7 LPNI seq info [8766889:8766889:16:4294967295]
00000400:00000200:8.0:1773851902.068136:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000400:00000200:8.0:1773851902.068137:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20354@kfi7 to cpt 2
00000400:00000200:8.0:1773851902.068140:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20354@kfi7(20354@kfi7:20354@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851902.068142:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 3
00000800:00000200:8.0:1773851902.068144:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851902.068146:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851902.068153:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851902.068157:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003b3 Using peer 20354@kfi7(0x1000000000003b3)
00000800:00000200:8.0:1773851902.068162:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 0000000014641c8a: Posted send of 324 bytes to peer 0x1000000000003b3: rc=0
00000800:00000200:8.0:1773851902.068164:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851902.068168:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.068169:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000aff866f1 refcount 2 to 20291@kfi7
00010000:00000001:8.0:1773851902.068170:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851902.068173:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.068174:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851902.068176:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d5102ce7 x1859318172158016/t0(0) o400->d5639816-d81a-4bc3-b4d8-29a95f8c3635@20291@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1768-0'
00000100:00100000:8.0:1773851902.068181:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d5102ce7 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:d5639816-d81a-4bc3-b4d8-29a95f8c3635+6:39541:x1859318172158016:12345-20291@kfi7:400:default-tuolumne1768-0 Request processed in 103us (150us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851902.068186:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20291@kfi7, seq: 2130889
00000100:00000040:8.0:1773851902.068187:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dde6cf3b : new rpc_count 0
00000100:00000001:8.0:1773851902.068188:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851902.068189:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851902.068190:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851902.068191:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851902.068193:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000d56077ea.
00000020:00000040:8.0:1773851902.068194:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000dde6cf3b : new refcount 5
00000100:00000001:8.0:1773851902.068195:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851902.068203:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003b3 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851902.068208:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851902.068210:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20354@kfi7: PUT: OK
00000400:00000200:9.0:1773851902.068211:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bf7b495c
00000400:00000010:9.0:1773851902.068212:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bf7b495c.
00000100:00000001:9.0:1773851902.068214:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851902.068214:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851902.068216:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000c6a6c05 nid 20354@kfi7 refs 2
00000800:00000200:9.0:1773851902.068219:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014641c8a: 2054@kfi7:2 -> 20354@kfi7(000000000724d89b):0x0 lsk 948 rsk 49 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1000000000003b3 Transaction freed
00000800:00000200:5.0:1773851902.085317:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.085318:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.085319:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.085322:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851902.085324:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.085326:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11696@kfi7 : PUT - for me
00000400:00000200:5.0:1773851902.085327:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.085328:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 1
00000400:00000200:5.0:1773851902.085329:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.085329:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000400:00000200:5.0:1773851902.085330:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 3
00000400:00000200:5.0:1773851902.085332:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11632@kfi7 to cpt 6
00000400:00000200:5.0:1773851902.085333:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11632@kfi7 of length 224 into portal 12 MB=0x69b4c00449340
00000400:00000200:5.0:1773851902.085335:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11632@kfi7 of length 224/224 into md 0x793926dc5 [64] + 167336
00000800:00000200:5.0:1773851902.085338:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851902.085340:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.085341:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11696@kfi7: PUT: OK
00000100:00000001:5.0:1773851902.085342:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851902.085343:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851902.085345:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000065fd465d.
00000100:00000040:5.0:1773851902.085346:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000065fd465d x1859600584577856 msgsize 224
00000100:00100000:5.0:1773851902.085349:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-11632@kfi7 (source: 12345-11696@kfi7)
00000100:00000001:5.0:1773851902.085350:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.085352:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000100:00000001:7.0:1773851902.085353:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851902.085354:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851902.085355:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:5.0:1773851902.085355:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851902.085356:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851902.085357:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851902.085359:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600584577856
00000020:00000001:7.0:1773851902.085360:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851902.085361:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7f56f
00000020:00000001:7.0:1773851902.085362:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851902.085366:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000096bfa274 refcount=5
00000020:00000001:7.0:1773851902.085367:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636938641305600 : -107135068246016 : ffff9e8fac507000)
00000020:00000001:7.0:1773851902.085368:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636938641305600 : -107135068246016 : ffff9e8fac507000)
00000100:00000001:7.0:1773851902.085370:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851902.085372:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851902.085375:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c33ebcf0.
00000020:00000010:7.0:1773851902.085377:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000020:00000010:7.0:1773851902.085379:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008745c425.
00000100:00000001:7.0:1773851902.085381:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851902.085382:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851902.085383:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851902.085385:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851902.085386:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851902.085387:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851902.085389:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851902.085391:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.085391:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.085391:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851902.085392:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851902.085393:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11632@kfi7, seq: 2002002
00000100:00000001:7.0:1773851902.085394:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.085394:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000096bfa274 : new rpc_count 1
00000100:00000001:4.0:1773851902.085395:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569655808 : -106988139895808 : ffff9eb1e1ed2400)
00000100:00000001:7.0:1773851902.085396:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.085397:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000065fd465d x1859600584577856/t0(0) o400->d3292450-52af-4bad-93b2-3895aa25a10b@11632@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1214-0'
00000100:00000001:4.0:1773851902.085400:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.085401:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851902.085402:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000065fd465d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d3292450-52af-4bad-93b2-3895aa25a10b+5:39705:x1859600584577856:12345-11632@kfi7:400:default-tuolumne1214-0
00000100:00000200:4.0:1773851902.085403:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600584577856
00000020:00000001:4.0:1773851902.085404:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851902.085405:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851902.085406:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.085407:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851902.085407:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851902.085408:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851902.085409:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600584577856, found 0 last_xid 1859600584577855
00000020:00000001:4.0:1773851902.085410:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851902.085411:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851902.085412:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851902.085412:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.085413:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851902.085414:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851902.085414:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851902.085415:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000815a9a8.
02000000:00000001:4.0:1773851902.085416:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.085417:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.085418:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851902.085418:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035363001, transno 0, xid 1859600584577856
00010000:00000001:4.0:1773851902.085419:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851902.085420:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000065fd465d x1859600584577856/t0(0) o400->d3292450-52af-4bad-93b2-3895aa25a10b@11632@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1214-0'
00010000:00000001:4.0:1773851902.085427:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851902.085428:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851902.085429:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851902.085430:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851902.085431:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009f542743 refcount 3 to 11632@kfi7
00000100:00000001:4.0:1773851902.085432:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313738240 : -107139395813376 : ffff9e8eaa5f0000)
02000000:00000001:4.0:1773851902.085433:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851902.085434:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.085434:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851902.085435:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11696@kfi7
00000400:00000010:4.0:1773851902.085436:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000da924145.
00000100:00000200:4.0:1773851902.085437:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600584577856, offset 224
00000400:00000200:4.0:1773851902.085439:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11696@kfi7
00000400:00000200:4.0:1773851902.085440:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.085441:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 1
00000400:00000200:4.0:1773851902.085443:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000400:00000200:4.0:1773851902.085444:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 3
00000400:00000200:4.0:1773851902.085445:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11696@kfi7 local destination
00000400:00000200:4.0:1773851902.085447:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770414:8770414:1024:4294967295] 11696@kfi7 LPNI seq info [633604:633604:16:4294967295]
00000400:00000200:4.0:1773851902.085449:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000400:00000200:4.0:1773851902.085450:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11696@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.085452:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11696@kfi7(11696@kfi7:11696@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851902.085454:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 3
00000800:00000200:4.0:1773851902.085455:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851902.085457:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851902.085459:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851902.085462:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x35f Using peer 11696@kfi7(0x35f)
00000800:00000200:4.0:1773851902.085468:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x35f: rc=0
00000800:00000200:4.0:1773851902.085470:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x35f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851902.085473:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.085474:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009f542743 refcount 2 to 11632@kfi7
00010000:00000001:4.0:1773851902.085474:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851902.085475:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.085476:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851902.085477:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000065fd465d x1859600584577856/t0(0) o400->d3292450-52af-4bad-93b2-3895aa25a10b@11632@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1214-0'
00000100:00100000:4.0:1773851902.085482:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000065fd465d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:d3292450-52af-4bad-93b2-3895aa25a10b+5:39705:x1859600584577856:12345-11632@kfi7:400:default-tuolumne1214-0 Request processed in 81us (135us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851902.085485:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11632@kfi7, seq: 2002002
00000100:00000040:4.0:1773851902.085486:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000096bfa274 : new rpc_count 0
00000100:00000001:4.0:1773851902.085487:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851902.085488:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851902.085489:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000010:4.0:1773851902.085489:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008745c425.
00000020:00000010:4.0:1773851902.085490:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c33ebcf0.
00000020:00000040:4.0:1773851902.085491:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000096bfa274 : new refcount 4
00000100:00000001:4.0:1773851902.085492:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851902.085500:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x35f TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851902.085503:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.085505:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11696@kfi7: PUT: OK
00000400:00000200:5.0:1773851902.085506:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000da924145
00000400:00000010:5.0:1773851902.085507:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000da924145.
00000100:00000001:5.0:1773851902.085508:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851902.085509:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851902.085511:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a583458 nid 11696@kfi7 refs 2
00000800:00000200:5.0:1773851902.085513:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 11696@kfi7(0000000058759da5):0x0 lsk 864 rsk 10 tsk 0 trmk 0 tmk 0 trr 1 tta 0x35f Transaction freed
00010000:00000001:2.0:1773851902.089732:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089733:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851902.089734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851902.089735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851902.089736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851902.089737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851902.089738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851902.089739:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851902.089740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851902.089740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851902.089744:0:937839:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:0.0:1773851902.089745:0:937839:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:0.0:1773851902.089745:0:937839:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:21.0:1773851902.121322:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851902.121323:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851902.121324:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851902.121326:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851902.121328:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.121330:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14323@kfi7 : PUT - for me
00000400:00000200:21.0:1773851902.121331:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.121331:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 1
00000400:00000200:21.0:1773851902.121333:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.121334:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000400:00000200:21.0:1773851902.121334:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 3
00000400:00000200:21.0:1773851902.121335:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14130@kfi7 to cpt 7
00000400:00000200:21.0:1773851902.121336:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14130@kfi7 of length 224 into portal 12 MB=0x699e0be1a00c0
00000400:00000200:21.0:1773851902.121337:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14130@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 68912
00000800:00000200:21.0:1773851902.121339:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851902.121340:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.121341:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14323@kfi7: PUT: OK
00000100:00000001:21.0:1773851902.121342:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851902.121343:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851902.121343:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e3bf806c.
00000100:00000040:21.0:1773851902.121344:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000e3bf806c x1858040401363136 msgsize 224
00000100:00100000:21.0:1773851902.121345:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14130@kfi7 (source: 12345-14323@kfi7)
00000100:00000001:21.0:1773851902.121346:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851902.121347:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000100:00000001:20.0:1773851902.121348:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851902.121349:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851902.121349:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851902.121349:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851902.121350:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851902.121351:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851902.121352:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040401363136
00000020:00000001:20.0:1773851902.121352:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851902.121353:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91674
00000020:00000001:20.0:1773851902.121354:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851902.121358:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002183a2bb refcount=6
00000020:00000001:20.0:1773851902.121359:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241240576 : -107152468311040 : ffff9e8b9f308400)
00000020:00000001:20.0:1773851902.121360:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241240576 : -107152468311040 : ffff9e8b9f308400)
00000100:00000001:20.0:1773851902.121361:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.121362:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851902.121363:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851902.121364:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.121365:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851902.121366:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851902.121367:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851902.121367:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851902.121368:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851902.121369:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851902.121370:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.121371:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851902.121373:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851902.121373:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851902.121373:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851902.121373:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851902.121375:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14130@kfi7, seq: 1998087
00000100:00000040:20.0:1773851902.121375:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002183a2bb : new rpc_count 1
00000100:00000001:23.0:1773851902.121376:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851902.121376:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.121376:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313420032 : -106917396131584 : ffff9ec25a955100)
00000100:00000040:20.0:1773851902.121378:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e3bf806c x1858040401363136/t0(0) o400->79bfc268-2c23-489c-b61e-95950ba6e74c@14130@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1369-0'
00000100:00000001:20.0:1773851902.121381:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.121381:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851902.121383:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e3bf806c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:79bfc268-2c23-489c-b61e-95950ba6e74c+6:39827:x1858040401363136:12345-14130@kfi7:400:default-tuolumne1369-0
00000100:00000200:20.0:1773851902.121384:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040401363136
00000020:00000001:20.0:1773851902.121385:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851902.121386:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851902.121387:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.121387:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851902.121388:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851902.121389:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851902.121389:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040401363136, found 0 last_xid 1858040401363135
00000020:00000001:20.0:1773851902.121390:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851902.121391:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851902.121392:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851902.121392:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.121393:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851902.121394:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851902.121394:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851902.121395:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d045e2ad.
02000000:00000001:20.0:1773851902.121396:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.121397:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.121397:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851902.121398:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693973, transno 0, xid 1858040401363136
00010000:00000001:20.0:1773851902.121399:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851902.121400:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e3bf806c x1858040401363136/t0(0) o400->79bfc268-2c23-489c-b61e-95950ba6e74c@14130@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1369-0'
00010000:00000001:20.0:1773851902.121407:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851902.121407:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851902.121408:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=135 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851902.121410:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851902.121410:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ce3ef0a7 refcount 3 to 14130@kfi7
00000100:00000001:20.0:1773851902.121412:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603214304 : -107155106337312 : ffff9e8b01f36de0)
02000000:00000001:20.0:1773851902.121413:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851902.121413:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.121414:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851902.121415:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14323@kfi7
00000400:00000010:20.0:1773851902.121416:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007749ce00.
00000100:00000200:20.0:1773851902.121417:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040401363136, offset 224
00000400:00000200:20.0:1773851902.121418:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14323@kfi7
00000400:00000200:20.0:1773851902.121419:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.121420:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 1
00000400:00000200:20.0:1773851902.121422:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000400:00000200:20.0:1773851902.121423:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 3
00000400:00000200:20.0:1773851902.121425:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14323@kfi7 local destination
00000400:00000200:20.0:1773851902.121427:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770415:8770415:1024:4294967295] 14323@kfi7 LPNI seq info [8496374:8496374:16:4294967295]
00000400:00000200:20.0:1773851902.121430:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000400:00000200:20.0:1773851902.121431:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14323@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.121434:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14323@kfi7(14323@kfi7:14323@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851902.121436:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 3
00000800:00000200:20.0:1773851902.121439:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851902.121441:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851902.121445:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851902.121450:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7cb Using peer 14323@kfi7(0x7cb)
00000800:00000200:20.0:1773851902.121458:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x7cb: rc=0
00000800:00000200:20.0:1773851902.121460:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851902.121464:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.121465:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ce3ef0a7 refcount 2 to 14130@kfi7
00010000:00000001:20.0:1773851902.121467:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851902.121470:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.121471:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851902.121472:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e3bf806c x1858040401363136/t0(0) o400->79bfc268-2c23-489c-b61e-95950ba6e74c@14130@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1369-0'
00000100:00100000:20.0:1773851902.121479:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e3bf806c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:79bfc268-2c23-489c-b61e-95950ba6e74c+6:39827:x1858040401363136:12345-14130@kfi7:400:default-tuolumne1369-0 Request processed in 96us (133us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851902.121483:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14130@kfi7, seq: 1998087
00000100:00000040:20.0:1773851902.121485:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002183a2bb : new rpc_count 0
00000100:00000001:20.0:1773851902.121486:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851902.121487:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851902.121488:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.121489:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851902.121491:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851902.121493:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000002183a2bb : new refcount 5
00000100:00000001:20.0:1773851902.121494:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851902.121503:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7cb TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851902.121506:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.121507:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14323@kfi7: PUT: OK
00000400:00000200:21.0:1773851902.121509:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007749ce00
00000400:00000010:21.0:1773851902.121509:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007749ce00.
00000100:00000001:21.0:1773851902.121511:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851902.121511:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851902.121513:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001ed1662e nid 14323@kfi7 refs 2
00000800:00000200:21.0:1773851902.121515:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 14323@kfi7(000000001af18080):0x0 lsk 1996 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x7cb Transaction freed
00000800:00000200:18.0:1773851902.161182:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851902.161182:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851902.161183:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851902.161183:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851902.161184:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851902.161184:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851902.161186:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851902.161186:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9859@kfi7(00000000ee582981):0x3c1 version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851902.161187:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 Using peer 9859@kfi7(0x3c1)
00000400:00000200:18.0:1773851902.161188:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.161189:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9859@kfi7 : PUT - for me
00000400:00000200:17.0:1773851902.161189:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.161190:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.161191:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000401a5102 nid 9859@kfi7 refs 1
00000800:00000200:17.0:1773851902.161191:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x3c1: rc=0
00000400:00000200:18.0:1773851902.161192:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.161193:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000401a5102 nid 9859@kfi7 refs 2
00000800:00000200:17.0:1773851902.161193:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851902.161194:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000401a5102 nid 9859@kfi7 refs 3
00000400:00000200:18.0:1773851902.161195:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.161196:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9859@kfi7 of length 456 into portal 12 MB=0x69a9e47eed880
00000400:00000200:18.0:1773851902.161197:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9859@kfi7 of length 456/456 into md 0x6ab01b5d1 [64] + 50160
00000800:00000200:18.0:1773851902.161200:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851902.161201:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851902.161202:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9859@kfi7: PUT: OK
00000100:00000001:18.0:1773851902.161203:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851902.161203:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851902.161204:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f615386f.
00000800:00000200:17.0:1773851902.161204:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 TN_EVENT_TX_OK event status 0
00000100:00000040:18.0:1773851902.161205:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000f615386f x1858854462609536 msgsize 456
00000800:00000200:17.0:1773851902.161206:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 Transaction freed
00000100:00100000:18.0:1773851902.161207:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-9859@kfi7 (source: 12345-9859@kfi7)
00000100:00000001:18.0:1773851902.161208:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851902.161209:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000401a5102 nid 9859@kfi7 refs 2
00000100:00000001:19.0:1773851902.161210:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851902.161210:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851902.161210:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851902.161211:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851902.161211:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851902.161212:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851902.161213:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858854462609536
00000020:00000001:19.0:1773851902.161214:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851902.161214:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9205a
00000020:00000001:19.0:1773851902.161215:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851902.161218:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000013e0a55e refcount=1076
00000020:00000001:19.0:1773851902.161219:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629492736 : -107123080058880 : ffff9e9276dda800)
00000020:00000001:19.0:1773851902.161220:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629492736 : -107123080058880 : ffff9e9276dda800)
00000100:00000001:19.0:1773851902.161221:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851902.161222:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851902.161223:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009e07516.
00000020:00000010:19.0:1773851902.161223:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851902.161224:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c89cf037.
00000100:00000001:19.0:1773851902.161225:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851902.161225:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851902.161226:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.161227:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.161228:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851902.161229:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851902.161229:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851902.161230:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851902.161230:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851902.161231:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9859@kfi7, seq: 323103295
00000100:00000040:19.0:1773851902.161232:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000013e0a55e : new rpc_count 3
00000100:00000001:19.0:1773851902.161232:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609979264 : -107015099572352 : ffff9eab9b011f80)
00000100:00000001:16.0:1773851902.161232:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851902.161232:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851902.161233:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f615386f x1858854462609536/t0(0) o17->726a12db-5a5e-4487-b031-20a1f1bb333e@9859@kfi7:542/0 lens 456/0 e 0 to 0 dl 1773852657 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1112-0'
00000100:00000001:19.0:1773851902.161236:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851902.161236:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851902.161237:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f615386f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:726a12db-5a5e-4487-b031-20a1f1bb333e+1076:39850:x1858854462609536:12345-9859@kfi7:17:default-tuolumne1112-0
00000100:00000200:19.0:1773851902.161239:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858854462609536
00000020:00000001:19.0:1773851902.161239:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851902.161240:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851902.161241:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.161241:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851902.161242:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:19.0:1773851902.161243:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851902.161243:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858854462609536, found 0 last_xid 1858854377157375
00000020:00000001:19.0:1773851902.161244:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851902.161245:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851902.161245:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851902.161246:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851902.161247:0:60961:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:19.0:1773851902.161247:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851902.161248:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851902.161249:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000008a4cee59.
02000000:00000001:19.0:1773851902.161249:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.161250:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.161251:0:60961:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:19.0:1773851902.161251:0:60961:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:19.0:1773851902.161252:0:60961:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:19.0:1773851902.161253:0:60961:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.161254:0:60961:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:19.0:1773851902.161255:0:60961:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 726a12db-5a5e-4487-b031-20a1f1bb333e/0000000013e0a55e free: 126633370845184 avail: 126633368748032
00000020:00000001:19.0:1773851902.161256:0:60961:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:19.0:1773851902.161257:0:60961:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 726a12db-5a5e-4487-b031-20a1f1bb333e/0000000013e0a55e avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:19.0:1773851902.161258:0:60961:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:19.0:1773851902.161259:0:60961:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:19.0:1773851902.161259:0:60961:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 726a12db-5a5e-4487-b031-20a1f1bb333e/0000000013e0a55e reports grant 1783627775 dropped 0, local 1880883199
00000020:00000001:19.0:1773851902.161261:0:60961:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:19.0:1773851902.161261:0:60961:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:19.0:1773851902.161261:0:60961:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851902.161262:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264590604, transno 0, xid 1858854462609536
00010000:00000001:19.0:1773851902.161263:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851902.161264:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f615386f x1858854462609536/t0(0) o17->726a12db-5a5e-4487-b031-20a1f1bb333e@9859@kfi7:542/0 lens 456/432 e 0 to 0 dl 1773852657 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1112-0'
00010000:00000001:19.0:1773851902.161266:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851902.161267:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851902.161268:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=135 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851902.161270:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851902.161270:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bcf654c6 refcount 3 to 9859@kfi7
00000100:00000001:19.0:1773851902.161271:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363994048 : -107142345557568 : ffff9e8dfa8d79c0)
02000000:00000001:19.0:1773851902.161272:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851902.161272:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.161273:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851902.161274:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9859@kfi7
00000400:00000010:19.0:1773851902.161275:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000094621db5.
00000100:00000200:19.0:1773851902.161275:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858854462609536, offset 224
00000400:00000200:19.0:1773851902.161277:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9859@kfi7
00000400:00000200:19.0:1773851902.161278:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:19.0:1773851902.161278:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000401a5102 nid 9859@kfi7 refs 1
00000400:00000200:19.0:1773851902.161279:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000401a5102 nid 9859@kfi7 refs 2
00000400:00000200:19.0:1773851902.161281:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000401a5102 nid 9859@kfi7 refs 3
00000400:00000200:19.0:1773851902.161282:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9859@kfi7 local destination
00000400:00000200:19.0:1773851902.161283:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770416:8770416:1024:4294967295] 9859@kfi7 LPNI seq info [3699156:3699156:16:4294967295]
00000400:00000200:19.0:1773851902.161284:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000401a5102 nid 9859@kfi7 refs 2
00000400:00000200:19.0:1773851902.161285:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9859@kfi7 to cpt 4
00000400:00000200:19.0:1773851902.161287:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9859@kfi7(9859@kfi7:9859@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851902.161288:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000401a5102 nid 9859@kfi7 refs 3
00000800:00000200:19.0:1773851902.161289:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851902.161291:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:19.0:1773851902.161293:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851902.161295:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 Using peer 9859@kfi7(0x3c1)
00000800:00000200:19.0:1773851902.161298:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 0000000024734d67: Posted send of 532 bytes to peer 0x3c1: rc=0
00000800:00000200:19.0:1773851902.161299:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851902.161301:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851902.161303:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bcf654c6 refcount 2 to 9859@kfi7
00010000:00000001:19.0:1773851902.161303:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851902.161304:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.161304:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851902.161305:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f615386f x1858854462609536/t0(0) o17->726a12db-5a5e-4487-b031-20a1f1bb333e@9859@kfi7:542/0 lens 456/432 e 0 to 0 dl 1773852657 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1112-0'
00000100:00100000:19.0:1773851902.161308:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f615386f pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:726a12db-5a5e-4487-b031-20a1f1bb333e+1076:39850:x1858854462609536:12345-9859@kfi7:17:default-tuolumne1112-0 Request processed in 71us (102us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851902.161310:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9859@kfi7, seq: 323103295
00000800:00000200:17.0:1773851902.161310:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 TN_EVENT_TX_OK event status 0
00000100:00000040:19.0:1773851902.161311:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000013e0a55e : new rpc_count 2
00000100:00000001:19.0:1773851902.161312:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851902.161312:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:17.0:1773851902.161312:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851902.161313:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851902.161313:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c89cf037.
00000400:00000200:17.0:1773851902.161313:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9859@kfi7: PUT: OK
00000020:00000010:19.0:1773851902.161314:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009e07516.
00000400:00000200:17.0:1773851902.161314:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000094621db5
00000400:00000010:17.0:1773851902.161314:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000094621db5.
00000020:00000040:19.0:1773851902.161315:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000013e0a55e : new refcount 1075
00000100:00000001:17.0:1773851902.161315:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851902.161316:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851902.161316:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851902.161317:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000401a5102 nid 9859@kfi7 refs 2
00000800:00000200:17.0:1773851902.161318:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000024734d67: 2069@kfi7:4 -> 9859@kfi7(00000000ee582981):0x0 lsk 962 rsk 46 tsk 0 trmk 0 tmk 0 trr 4 tta 0x3c1 Transaction freed
00000800:00000200:5.0:1773851902.199643:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.199644:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.199645:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.199648:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851902.199649:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.199651:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23202@kfi7 : PUT - for me
00000400:00000200:5.0:1773851902.199651:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.199652:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 1
00000400:00000200:5.0:1773851902.199653:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.199654:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000400:00000200:5.0:1773851902.199655:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 3
00000400:00000200:5.0:1773851902.199656:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23139@kfi7 to cpt 0
00000400:00000200:5.0:1773851902.199657:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23139@kfi7 of length 224 into portal 12 MB=0x699e09d3c59c0
00000400:00000200:5.0:1773851902.199658:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23139@kfi7 of length 224/224 into md 0x793926dc5 [64] + 167560
00000800:00000200:5.0:1773851902.199659:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851902.199661:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.199662:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23202@kfi7: PUT: OK
00000100:00000001:5.0:1773851902.199664:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851902.199664:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851902.199665:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008914a101.
00000100:00000040:5.0:1773851902.199666:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008914a101 x1858039849966016 msgsize 224
00000100:00100000:5.0:1773851902.199667:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-23139@kfi7 (source: 12345-23202@kfi7)
00000100:00000001:5.0:1773851902.199668:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.199669:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000100:00000001:4.0:1773851902.199670:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851902.199670:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851902.199671:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000fddc5cf3: 2069@kfi7:1 <- 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851902.199671:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851902.199671:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851902.199672:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.199673:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039849966016
00000020:00000001:4.0:1773851902.199673:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851902.199674:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92afd
00000020:00000001:4.0:1773851902.199674:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851902.199677:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004e18a56b refcount=6
00000020:00000001:4.0:1773851902.199677:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743670784 : -107128965880832 : ffff9e91180b2400)
00000020:00000001:4.0:1773851902.199679:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743670784 : -107128965880832 : ffff9e91180b2400)
00000100:00000001:4.0:1773851902.199680:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.199681:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851902.199682:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001c023165.
00000020:00000010:4.0:1773851902.199683:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.199684:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000089183453.
00000100:00000001:4.0:1773851902.199685:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851902.199685:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851902.199686:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.199687:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851902.199687:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851902.199688:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.199688:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851902.199690:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851902.199690:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851902.199690:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.199690:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851902.199691:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23139@kfi7, seq: 2002003
00000100:00000001:7.0:1773851902.199692:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.199692:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004e18a56b : new rpc_count 1
00000100:00000001:7.0:1773851902.199693:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.199693:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569650048 : -106988139901568 : ffff9eb1e1ed0d80)
00000100:00000040:4.0:1773851902.199694:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008914a101 x1858039849966016/t0(0) o400->60cc34a0-911a-4365-8e9a-94876c00bdbb@23139@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1932-0'
00000100:00000001:4.0:1773851902.199697:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.199697:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851902.199698:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008914a101 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:60cc34a0-911a-4365-8e9a-94876c00bdbb+6:39649:x1858039849966016:12345-23139@kfi7:400:default-tuolumne1932-0
00000100:00000200:4.0:1773851902.199700:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039849966016
00000020:00000001:4.0:1773851902.199700:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851902.199701:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851902.199701:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.199702:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851902.199703:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851902.199703:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851902.199704:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039849966016, found 0 last_xid 1858039849966015
00000020:00000001:4.0:1773851902.199705:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851902.199706:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851902.199706:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851902.199707:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.199708:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851902.199708:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851902.199709:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851902.199710:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bb68fba1.
02000000:00000001:4.0:1773851902.199710:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.199711:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.199712:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851902.199712:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044164973, transno 0, xid 1858039849966016
00010000:00000001:4.0:1773851902.199713:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851902.199714:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008914a101 x1858039849966016/t0(0) o400->60cc34a0-911a-4365-8e9a-94876c00bdbb@23139@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1932-0'
00010000:00000001:4.0:1773851902.199716:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851902.199717:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851902.199717:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851902.199719:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851902.199719:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000dfea3861 refcount 3 to 23139@kfi7
00000100:00000001:4.0:1773851902.199720:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052544 : -107154804499072 : ffff9e8b13f11d80)
02000000:00000001:4.0:1773851902.199721:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851902.199721:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.199722:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851902.199723:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23202@kfi7
00000400:00000010:4.0:1773851902.199724:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000037fa94eb.
00000100:00000200:4.0:1773851902.199729:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039849966016, offset 224
00000400:00000200:4.0:1773851902.199730:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23202@kfi7
00000400:00000200:4.0:1773851902.199731:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.199732:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 1
00000400:00000200:4.0:1773851902.199733:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000400:00000200:4.0:1773851902.199734:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 3
00000400:00000200:4.0:1773851902.199735:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23202@kfi7 local destination
00000400:00000200:4.0:1773851902.199736:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770417:8770417:1024:4294967295] 23202@kfi7 LPNI seq info [88742:88742:16:4294967295]
00000400:00000200:4.0:1773851902.199738:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000400:00000200:4.0:1773851902.199741:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23202@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.199743:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23202@kfi7(23202@kfi7:23202@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851902.199744:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 3
00000800:00000200:4.0:1773851902.199745:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851902.199746:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851902.199749:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851902.199751:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b0 Using peer 23202@kfi7(0x2b0)
00000800:00000200:4.0:1773851902.199754:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x2b0: rc=0
00000800:00000200:4.0:1773851902.199755:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851902.199757:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.199758:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000dfea3861 refcount 2 to 23139@kfi7
00010000:00000001:4.0:1773851902.199759:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851902.199759:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.199760:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851902.199761:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008914a101 x1858039849966016/t0(0) o400->60cc34a0-911a-4365-8e9a-94876c00bdbb@23139@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1932-0'
00000100:00100000:4.0:1773851902.199765:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008914a101 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:60cc34a0-911a-4365-8e9a-94876c00bdbb+6:39649:x1858039849966016:12345-23139@kfi7:400:default-tuolumne1932-0 Request processed in 67us (99us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851902.199768:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23139@kfi7, seq: 2002003
00000100:00000040:4.0:1773851902.199769:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004e18a56b : new rpc_count 0
00000100:00000001:4.0:1773851902.199769:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851902.199770:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851902.199770:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.199771:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000089183453.
00000020:00000010:4.0:1773851902.199772:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001c023165.
00000020:00000040:4.0:1773851902.199773:0:60963:0:(genops.c:882:class_export_put()) PUTting export 000000004e18a56b : new refcount 5
00000100:00000001:4.0:1773851902.199774:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851902.199780:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b0 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851902.199781:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.199782:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23202@kfi7: PUT: OK
00000400:00000200:5.0:1773851902.199783:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000037fa94eb
00000400:00000010:5.0:1773851902.199783:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000037fa94eb.
00000100:00000001:5.0:1773851902.199784:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851902.199785:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851902.199786:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ca23e3cb nid 23202@kfi7 refs 2
00000800:00000200:5.0:1773851902.199787:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 23202@kfi7(00000000dd42839c):0x0 lsk 689 rsk 51 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b0 Transaction freed
00000800:00000200:10.0:1773851902.201104:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.201104:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.201104:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851902.201105:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851902.201106:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851902.201106:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851902.201108:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851902.201108:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19841@kfi7(00000000e8743145):0x8b9 version: 2; local version 2; negotiated version: 2
00000400:00000200:10.0:1773851902.201110:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000800:00000200:9.0:1773851902.201110:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 Using peer 19841@kfi7(0x8b9)
00000400:00000200:10.0:1773851902.201111:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19841@kfi7 : PUT - for me
00000400:00000200:9.0:1773851902.201112:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.201113:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.201114:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5adb164 nid 19841@kfi7 refs 1
00000800:00000200:9.0:1773851902.201114:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 38 bytes to peer 0x8b9: rc=0
00000400:00000200:10.0:1773851902.201116:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000800:00000200:9.0:1773851902.201116:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851902.201117:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5adb164 nid 19841@kfi7 refs 2
00000400:00000200:10.0:1773851902.201118:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f5adb164 nid 19841@kfi7 refs 3
00000400:00000200:10.0:1773851902.201118:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.201120:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19841@kfi7 of length 224 into portal 12 MB=0x69b0978f33540
00000400:00000200:10.0:1773851902.201121:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19841@kfi7 of length 224/224 into md 0x78146ce49 [64] + 167568
00000800:00000200:10.0:1773851902.201123:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851902.201125:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851902.201126:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19841@kfi7: PUT: OK
00000100:00000001:10.0:1773851902.201127:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851902.201127:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851902.201128:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007fccf737.
00000800:00000200:9.0:1773851902.201128:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 TN_EVENT_TX_OK event status 0
00000100:00000040:10.0:1773851902.201129:0:2464469:0:(events.c:358:request_in_callback()) incoming req@000000007fccf737 x1859314846479680 msgsize 224
00000100:00100000:10.0:1773851902.201130:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-19841@kfi7 (source: 12345-19841@kfi7)
00000800:00000200:9.0:1773851902.201130:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 Transaction freed
00000100:00000001:10.0:1773851902.201131:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851902.201132:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f5adb164 nid 19841@kfi7 refs 2
00000100:00000001:8.0:1773851902.201133:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851902.201133:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:10.0:1773851902.201134:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851902.201134:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851902.201134:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851902.201135:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851902.201136:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859314846479680
00000020:00000001:8.0:1773851902.201136:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851902.201137:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91539
00000020:00000001:8.0:1773851902.201138:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851902.201141:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001fe18b5e refcount=9
00000020:00000001:8.0:1773851902.201141:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241021440 : -107152468530176 : ffff9e8b9f2d2c00)
00000020:00000001:8.0:1773851902.201142:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241021440 : -107152468530176 : ffff9e8b9f2d2c00)
00000100:00000001:8.0:1773851902.201143:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851902.201144:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851902.201145:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b1f3e4f.
00000020:00000010:8.0:1773851902.201146:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851902.201147:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851902.201148:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851902.201149:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851902.201149:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851902.201150:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851902.201151:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851902.201151:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.201152:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851902.201153:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851902.201153:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851902.201154:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851902.201154:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851902.201154:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19841@kfi7, seq: 2130890
00000100:00000001:9.0:1773851902.201155:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.201155:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001fe18b5e : new rpc_count 1
00000100:00000001:9.0:1773851902.201156:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.201156:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087751808 : -106944621799808 : ffff9ebc03ce9680)
00000100:00000040:8.0:1773851902.201157:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007fccf737 x1859314846479680/t0(0) o400->8df2c079-cdec-416a-bce6-a24dae3c2ec8@19841@kfi7:690/0 lens 224/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1732-0'
00000100:00000001:8.0:1773851902.201159:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851902.201159:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851902.201161:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007fccf737 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8df2c079-cdec-416a-bce6-a24dae3c2ec8+9:39779:x1859314846479680:12345-19841@kfi7:400:default-tuolumne1732-0
00000100:00000200:8.0:1773851902.201162:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859314846479680
00000020:00000001:8.0:1773851902.201162:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851902.201163:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851902.201174:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.201174:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851902.201175:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851902.201176:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851902.201176:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859314846479680, found 0 last_xid 1859314846479679
00000020:00000001:8.0:1773851902.201177:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851902.201178:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851902.201178:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851902.201179:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.201179:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851902.201180:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851902.201180:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851902.201181:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000876f48f8.
02000000:00000001:8.0:1773851902.201181:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.201182:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.201183:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851902.201183:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182847780279, transno 0, xid 1859314846479680
00010000:00000001:8.0:1773851902.201184:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851902.201185:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007fccf737 x1859314846479680/t0(0) o400->8df2c079-cdec-416a-bce6-a24dae3c2ec8@19841@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1732-0'
00010000:00000001:8.0:1773851902.201187:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851902.201187:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851902.201188:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=135 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851902.201189:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851902.201190:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ec52ff21 refcount 3 to 19841@kfi7
00000100:00000001:8.0:1773851902.201190:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959055904 : -107146750495712 : ffff9e8cf3ff7420)
02000000:00000001:8.0:1773851902.201191:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851902.201192:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.201192:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851902.201193:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19841@kfi7
00000400:00000010:8.0:1773851902.201194:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054a4b090.
00000100:00000200:8.0:1773851902.201195:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859314846479680, offset 224
00000400:00000200:8.0:1773851902.201196:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19841@kfi7
00000400:00000200:8.0:1773851902.201197:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000400:00000200:8.0:1773851902.201198:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f5adb164 nid 19841@kfi7 refs 1
00000400:00000200:8.0:1773851902.201199:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f5adb164 nid 19841@kfi7 refs 2
00000400:00000200:8.0:1773851902.201200:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f5adb164 nid 19841@kfi7 refs 3
00000400:00000200:8.0:1773851902.201202:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19841@kfi7 local destination
00000400:00000200:8.0:1773851902.201203:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770418:8770418:1024:4294967295] 19841@kfi7 LPNI seq info [2032247:2032247:16:4294967295]
00000400:00000200:8.0:1773851902.201204:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f5adb164 nid 19841@kfi7 refs 2
00000400:00000200:8.0:1773851902.201205:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19841@kfi7 to cpt 2
00000400:00000200:8.0:1773851902.201207:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19841@kfi7(19841@kfi7:19841@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851902.201208:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f5adb164 nid 19841@kfi7 refs 3
00000800:00000200:8.0:1773851902.201209:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851902.201210:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851902.201212:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851902.201215:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 Using peer 19841@kfi7(0x8b9)
00000800:00000200:8.0:1773851902.201217:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000039182e44: Posted send of 324 bytes to peer 0x8b9: rc=0
00000800:00000200:8.0:1773851902.201219:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851902.201221:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.201222:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ec52ff21 refcount 2 to 19841@kfi7
00010000:00000001:8.0:1773851902.201222:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851902.201223:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.201223:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851902.201224:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007fccf737 x1859314846479680/t0(0) o400->8df2c079-cdec-416a-bce6-a24dae3c2ec8@19841@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1732-0'
00000100:00100000:8.0:1773851902.201229:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007fccf737 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8df2c079-cdec-416a-bce6-a24dae3c2ec8+9:39779:x1859314846479680:12345-19841@kfi7:400:default-tuolumne1732-0 Request processed in 69us (99us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851902.201231:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19841@kfi7, seq: 2130890
00000100:00000040:8.0:1773851902.201232:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001fe18b5e : new rpc_count 0
00000100:00000001:8.0:1773851902.201233:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851902.201234:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851902.201234:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851902.201235:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000020:00000010:8.0:1773851902.201236:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b1f3e4f.
00000020:00000040:8.0:1773851902.201237:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000001fe18b5e : new refcount 8
00000100:00000001:8.0:1773851902.201237:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851902.201242:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851902.201243:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851902.201245:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19841@kfi7: PUT: OK
00000400:00000200:9.0:1773851902.201246:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054a4b090
00000400:00000010:9.0:1773851902.201246:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054a4b090.
00000100:00000001:9.0:1773851902.201247:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851902.201247:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851902.201248:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f5adb164 nid 19841@kfi7 refs 2
00000800:00000200:9.0:1773851902.201250:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000039182e44: 2069@kfi7:2 -> 19841@kfi7(00000000e8743145):0x0 lsk 2234 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x8b9 Transaction freed
00000800:00000200:22.0:1773851902.222880:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851902.222881:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851902.222883:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851902.222885:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851902.222887:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851902.222888:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2081@kfi7 : PUT - for me
00000400:00000200:22.0:1773851902.222889:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851902.222889:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:22.0:1773851902.222890:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:22.0:1773851902.222891:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:22.0:1773851902.222892:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:22.0:1773851902.222892:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:22.0:1773851902.222893:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 224 into portal 24 MB=0x699e51ee33f80
00000400:00000200:22.0:1773851902.222895:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2074@kfi7 of length 224/224 into md 0x6a2a45875 [256] + 8552
00000800:00000200:22.0:1773851902.222897:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851902.222901:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851902.222902:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000100:00000001:22.0:1773851902.222903:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851902.222904:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:22.0:1773851902.222905:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009dd7f6da.
00000100:00000040:22.0:1773851902.222906:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000009dd7f6da x1858059205033856 msgsize 224
00000100:00100000:22.0:1773851902.222907:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-2074@kfi7 (source: 12345-2081@kfi7)
00000100:00000001:22.0:1773851902.222908:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851902.222909:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:20.0:1773851902.222910:0:1537152:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851902.222910:0:1537152:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851902.222911:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851902.222911:0:1537152:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851902.222911:0:1537152:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851902.222912:0:1537152:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851902.222913:0:1537152:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858059205033856
00000020:00000001:20.0:1773851902.222913:0:1537152:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851902.222914:0:1537152:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cb1
00000020:00000001:20.0:1773851902.222914:0:1537152:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851902.222915:0:1537152:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000230dac49 refcount=5
00000020:00000001:20.0:1773851902.222916:0:1537152:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000020:00000001:20.0:1773851902.222918:0:1537152:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395699712 : -107136313851904 : ffff9e8f62120000)
00000100:00000001:20.0:1773851902.222919:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.222920:0:1537152:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851902.222920:0:1537152:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851902.222921:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.222922:0:1537152:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000040:20.0:1773851902.222923:0:1537152:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:20.0:1773851902.222924:0:1537152:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851902.222924:0:1537152:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851902.222925:0:1537152:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.222926:0:1537152:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.222927:0:1537152:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:22.0:1773851902.222928:0:1537183:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851902.222928:0:1537152:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851902.222928:0:1537152:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851902.222929:0:1537183:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:22.0:1773851902.222930:0:1537183:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851902.222930:0:1537152:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2074@kfi7, seq: 3084766
00000100:00000040:20.0:1773851902.222930:0:1537152:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000230dac49 : new rpc_count 1
00000100:00000001:22.0:1773851902.222931:0:1537183:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.222931:0:1537152:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382193536 : -106946327358080 : ffff9ebb9e25d580)
00000100:00000040:20.0:1773851902.222932:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009dd7f6da x1858059205033856/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba4-0'
00000100:00000001:20.0:1773851902.222935:0:1537152:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.222935:0:1537152:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851902.222936:0:1537152:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009dd7f6da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059205033856:12345-2074@kfi7:41:default-yuba4-0
00000100:00000200:20.0:1773851902.222937:0:1537152:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858059205033856
00000020:00000001:20.0:1773851902.222938:0:1537152:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851902.222938:0:1537152:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851902.222939:0:1537152:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.222940:0:1537152:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851902.222940:0:1537152:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:20.0:1773851902.222941:0:1537152:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851902.222942:0:1537152:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851902.222942:0:1537152:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851902.222943:0:1537152:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851902.222944:0:1537152:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.222945:0:1537152:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851902.222945:0:1537152:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851902.222947:0:1537152:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000afdeb7b4.
02000000:00000001:20.0:1773851902.222947:0:1537152:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.222948:0:1537152:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851902.222949:0:1537152:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:20.0:1773851902.222949:0:1537152:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:20.0:1773851902.222950:0:1537152:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:20.0:1773851902.222950:0:1537152:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 424673280 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:20.0:1773851902.222951:0:1537152:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129667 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:20.0:1773851902.222953:0:1537152:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851902.222954:0:1537152:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262540794, transno 0, xid 1858059205033856
00010000:00000001:20.0:1773851902.222954:0:1537152:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851902.222955:0:1537152:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009dd7f6da x1858059205033856/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:629/0 lens 224/368 e 0 to 0 dl 1773851989 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00010000:00000001:20.0:1773851902.222958:0:1537152:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851902.222958:0:1537152:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851902.222959:0:1537152:0:(import.c:1951:at_measured()) add 1 to 00000000bf8a879b time=126 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851902.222960:0:1537152:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851902.222961:0:1537152:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a21e6d91 refcount 7 to 2074@kfi7
00000100:00000001:20.0:1773851902.222962:0:1537152:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231805696 : -107130477745920 : ffff9e90bdede900)
02000000:00000001:20.0:1773851902.222963:0:1537152:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851902.222963:0:1537152:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.222964:0:1537152:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851902.222964:0:1537152:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2081@kfi7
00000400:00000010:20.0:1773851902.222965:0:1537152:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe5250b8.
00000100:00000200:20.0:1773851902.222966:0:1537152:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858059205033856, offset 224
00000400:00000200:20.0:1773851902.222967:0:1537152:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2081@kfi7
00000400:00000200:20.0:1773851902.222968:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.222969:0:1537152:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000200:20.0:1773851902.222970:0:1537152:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:20.0:1773851902.222971:0:1537152:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000400:00000200:20.0:1773851902.222972:0:1537152:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2081@kfi7 local destination
00000400:00000200:20.0:1773851902.222974:0:1537152:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770419:8770419:1024:4294967295] 2081@kfi7 LPNI seq info [23425181:23425181:16:4294967295]
00000400:00000200:20.0:1773851902.222976:0:1537152:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:20.0:1773851902.222976:0:1537152:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.222979:0:1537152:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2081@kfi7(2081@kfi7:2081@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851902.222980:0:1537152:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000800:00000200:20.0:1773851902.222981:0:1537152:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851902.222982:0:1537152:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:20.0:1773851902.222984:0:1537152:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851902.222986:0:1537152:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 Using peer 2081@kfi7(0x200000000000275)
00000800:00000200:20.0:1773851902.222989:0:1537152:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 468 bytes to peer 0x200000000000275: rc=0
00000800:00000200:20.0:1773851902.222990:0:1537152:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851902.222993:0:1537152:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.222993:0:1537152:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a21e6d91 refcount 6 to 2074@kfi7
00010000:00000001:20.0:1773851902.222994:0:1537152:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851902.222995:0:1537152:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.222995:0:1537152:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851902.222996:0:1537152:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009dd7f6da x1858059205033856/t0(0) o41->lustre5-MDT0003-mdtlov_UUID@2074@kfi7:629/0 lens 224/368 e 0 to 0 dl 1773851989 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba4-0'
00000100:00100000:20.0:1773851902.222999:0:1537152:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009dd7f6da pname:cluuid+ref:pid:xid:nid:opc:job mdt_out05_015:lustre5-MDT0003-mdtlov_UUID+5:52353:x1858059205033856:12345-2074@kfi7:41:default-yuba4-0 Request processed in 64us (93us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851902.223001:0:1537152:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2074@kfi7, seq: 3084766
00000100:00000040:20.0:1773851902.223002:0:1537152:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000230dac49 : new rpc_count 0
00000100:00000001:20.0:1773851902.223003:0:1537152:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851902.223003:0:1537152:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851902.223004:0:1537152:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.223005:0:1537152:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851902.223006:0:1537152:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851902.223007:0:1537152:0:(genops.c:882:class_export_put()) PUTting export 00000000230dac49 : new refcount 4
00000100:00000001:20.0:1773851902.223008:0:1537152:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851902.223012:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851902.223014:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851902.223015:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2081@kfi7: PUT: OK
00000400:00000200:22.0:1773851902.223016:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe5250b8
00000400:00000010:22.0:1773851902.223017:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe5250b8.
00000100:00000001:22.0:1773851902.223018:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851902.223018:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851902.223019:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000800:00000200:22.0:1773851902.223021:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 2081@kfi7(000000006013e2da):0x0 lsk 630 rsk 4796 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000275 Transaction freed
00000004:00000001:7.0:1773851902.281730:0:42387:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851902.281731:0:42387:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851902.281731:0:42387:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000db244de4.
00000100:00000001:11.0:1773851902.281732:0:60519:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000020:00000040:7.0:1773851902.281732:0:42387:0:(genops.c:1094:class_import_get()) import 00000000729ad433 refcount=5 obd=lustre5-OST0018-osc-MDT0001
00000100:00000001:7.0:1773851902.281733:0:42387:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851902.281734:0:42387:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851902.281735:0:42387:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851902.281736:0:42387:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000c821af11.
00000100:00000001:7.0:1773851902.281737:0:42387:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851902.281738:0:60519:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +245s
00000100:00001000:11.0:1773851902.281738:0:60519:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +5s, asking for 30 secs on 1 early replies
00000100:00000001:7.0:1773851902.281738:0:42387:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851902.281738:0:42387:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851902.281739:0:60519:0:(service.c:1354:ptlrpc_at_send_early_reply()) Process entered
00000100:00000040:7.0:1773851902.281739:0:42387:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000db244de4] to pc [ptlrpcd_01_03+3]  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:11.0:1773851902.281740:0:60519:0:(service.c:1370:ptlrpc_at_send_early_reply()) @@@ sending early reply (deadline +5s, margin -134s) for 139+30  req@000000000e26b193 x1859597924930816/t0(0) o49->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:547/0 lens 480/0 e 2 to 0 dl 1773851907 ref 2 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111525036260352'
00080000:00000001:7.0:1773851902.281743:0:42387:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00001000:11.0:1773851902.281744:0:60519:0:(import.c:1951:at_measured()) add 164 to 00000000119ab4c7 time=156 v=139 (139 0 0 0)
00080000:00000010:7.0:1773851902.281744:0:42387:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000023aa93ab.
00000100:00000001:5.0:1773851902.281744:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:7.0:1773851902.281745:0:42387:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637115587520512 : -106958122031104 : ffff9eb8df216800)
00000100:00000001:5.0:1773851902.281745:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851902.281745:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00001000:11.0:1773851902.281746:0:60519:0:(import.c:2016:at_measured()) AT 00000000119ab4c7 change: old=139 new=164 delta=25 (val=164) hist 164 139 0 0
00080000:00000001:7.0:1773851902.281746:0:42387:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:5.0:1773851902.281746:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851902.281746:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000010:11.0:1773851902.281747:0:60519:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d4a564a2.
00080000:00000001:7.0:1773851902.281747:0:42387:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.281747:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000010:11.0:1773851902.281748:0:60519:0:(service.c:1444:ptlrpc_at_send_early_reply()) kmalloced '(reqmsg)': 480 at 00000000ef653fd2.
00000004:00001000:7.0:1773851902.281748:0:42387:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0018-osc-MDT0001: sync forced, 3 changes
00000020:00000001:11.0:1773851902.281749:0:60519:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851902.281749:0:60519:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74122
00000004:00000010:7.0:1773851902.281749:0:42387:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008984a01f.
00000100:00000001:5.0:1773851902.281749:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851902.281749:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851902.281750:0:60519:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000004:00080000:7.0:1773851902.281750:0:42387:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0018-osc-MDT0001: add commit cb at 614176735025121ns, next at 614177735024089ns, rc = 0
02000000:00000001:5.0:1773851902.281750:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000020:00000040:11.0:1773851902.281751:0:60519:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d60686f refcount=454
00080000:00000001:7.0:1773851902.281751:0:42387:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851902.281751:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:5.0:1773851902.281751:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000db244de4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051942592:2099@kfi7:13:default-yuba2-0
00000020:00000001:11.0:1773851902.281752:0:60519:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00080000:00000001:7.0:1773851902.281752:0:42387:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851902.281752:0:42387:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851902.281753:0:60519:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000100:00000040:11.0:1773851902.281753:0:60519:0:(service.c:1483:ptlrpc_at_send_early_reply()) RPC GETting export 000000009d60686f : new rpc_count 11
00000100:00000001:5.0:1773851902.281753:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:5.0:1773851902.281753:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:11.0:1773851902.281754:0:60519:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:5.0:1773851902.281754:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851902.281754:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:11.0:1773851902.281755:0:60519:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:5.0:1773851902.281756:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000080965be6.
02000000:00000001:5.0:1773851902.281756:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851902.281757:0:60519:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e1fd08a7.
02000000:00000001:11.0:1773851902.281757:0:60519:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851902.281757:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000100:00000001:11.0:1773851902.281758:0:60519:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851902.281758:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045a04335.
00010000:00000001:11.0:1773851902.281759:0:60519:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851902.281759:0:60519:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851902.281759:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000001:11.0:1773851902.281760:0:60519:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000200:5.0:1773851902.281760:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942592, portal 4
00000100:00000040:11.0:1773851902.281761:0:60519:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc978f5f refcount 3 to 25667@kfi7
00000100:00000001:5.0:1773851902.281761:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:5.0:1773851902.281761:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309140864 : -106994400410752 : ffff9eb06cc54380)
00000100:00000001:11.0:1773851902.281762:0:60519:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106880 : -107156354444736 : ffff9e8ab78ed240)
02000000:00000001:11.0:1773851902.281762:0:60519:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000040:5.0:1773851902.281763:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:11.0:1773851902.281765:0:60519:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.281765:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:11.0:1773851902.281766:0:60519:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851902.281766:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2099@kfi7
00000400:00000010:5.0:1773851902.281766:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000070e61bd6.
00000100:00000040:11.0:1773851902.281767:0:60519:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25666@kfi7
00000100:00000200:5.0:1773851902.281767:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942592, offset 0
00000400:00000010:11.0:1773851902.281768:0:60519:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000100:00000200:11.0:1773851902.281768:0:60519:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597924930816, offset 0
00000400:00000200:5.0:1773851902.281769:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2099@kfi7
00000400:00000200:11.0:1773851902.281770:0:60519:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25666@kfi7
00000400:00000200:5.0:1773851902.281770:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:5.0:1773851902.281770:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:11.0:1773851902.281771:0:60519:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:5.0:1773851902.281771:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:11.0:1773851902.281772:0:60519:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 1
00000400:00000200:11.0:1773851902.281773:0:60519:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:5.0:1773851902.281773:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:11.0:1773851902.281774:0:60519:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000400:00000200:5.0:1773851902.281774:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2099@kfi7 local destination
00000400:00000200:5.0:1773851902.281775:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770418, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770419, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851902.281776:0:60519:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25666@kfi7 local destination
00000400:00000200:5.0:1773851902.281777:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:11.0:1773851902.281778:0:60519:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770420:8770420:1024:4294967295] 25666@kfi7 LPNI seq info [611809:611809:16:4294967295]
00000400:00000200:5.0:1773851902.281778:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851902.281779:0:60519:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000400:00000200:5.0:1773851902.281779:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2099@kfi7
00000400:00000200:11.0:1773851902.281780:0:60519:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25666@kfi7 to cpt 2
00000400:00000200:5.0:1773851902.281780:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770421:8770421:1024:4294967295] 2099@kfi7 LPNI seq info [5403438:5403438:16:4294967295]
00000400:00000200:5.0:1773851902.281782:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:11.0:1773851902.281783:0:60519:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25666@kfi7(25666@kfi7:25666@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851902.281783:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:11.0:1773851902.281785:0:60519:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 3
00000400:00000200:5.0:1773851902.281785:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2099@kfi7(2099@kfi7:2099@kfi7) <?> : PUT try# 0
00000800:00000200:11.0:1773851902.281786:0:60519:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000400:00000200:5.0:1773851902.281787:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000800:00000200:11.0:1773851902.281788:0:60519:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:5.0:1773851902.281789:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:11.0:1773851902.281790:0:60519:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851902.281790:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851902.281793:0:60519:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb Using peer 25666@kfi7(0x100000000000dcb)
00000800:00000200:5.0:1773851902.281793:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:5.0:1773851902.281795:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Using peer 2099@kfi7(0x2c1)
00000800:00000200:11.0:1773851902.281796:0:60519:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x100000000000dcb: rc=0
00000800:00000200:11.0:1773851902.281797:0:60519:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:5.0:1773851902.281798:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fddc5cf3: Posted send of 324 bytes to peer 0x2c1: rc=0
00000100:00000001:11.0:1773851902.281799:0:60519:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851902.281800:0:60519:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc978f5f refcount 2 to 25667@kfi7
00000800:00000200:5.0:1773851902.281800:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000040:11.0:1773851902.281801:0:60519:0:(service.c:1509:ptlrpc_at_send_early_reply()) RPC PUTting export 000000009d60686f : new rpc_count 10
00000020:00000040:11.0:1773851902.281802:0:60519:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 453
00000100:00000001:5.0:1773851902.281802:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.281802:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000010:11.0:1773851902.281803:0:60519:0:(service.c:1513:ptlrpc_at_send_early_reply()) kfreed 'reqmsg': 480 at 00000000ef653fd2.
00000100:00000010:11.0:1773851902.281803:0:60519:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4a564a2.
00000100:00000001:5.0:1773851902.281803:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851902.281804:0:60519:0:(service.c:1516:ptlrpc_at_send_early_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.281804:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.281804:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:11.0:1773851902.281805:0:60519:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_readpage at +25s
00000100:00000001:11.0:1773851902.281806:0:60519:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851902.281806:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851902.281806:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:5.0:1773851902.281807:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851902.281807:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851902.281808:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.281808:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:11.0:1773851902.281811:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851902.281813:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851902.281813:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 TN_EVENT_TX_OK event status 0
00000400:00000200:11.0:1773851902.281814:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25666@kfi7: PUT: OK
00000400:00000200:6.0:1773851902.281814:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851902.281815:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000400:00000010:11.0:1773851902.281816:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000400:00000200:6.0:1773851902.281816:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000400:00000200:6.0:1773851902.281816:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000070e61bd6
00000100:00000001:11.0:1773851902.281817:0:2510946:0:(events.c:407:reply_out_callback()) Process entered
02000000:00000001:11.0:1773851902.281817:0:2510946:0:(sec.c:2362:sptlrpc_svc_free_rs()) Process entered
00000400:00000010:6.0:1773851902.281817:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000070e61bd6.
02000000:00000010:11.0:1773851902.281818:0:2510946:0:(sec_null.c:339:null_free_rs()) kfreed 'rs': 480 at 00000000e1fd08a7.
00000100:00000001:6.0:1773851902.281818:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851902.281818:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:11.0:1773851902.281819:0:2510946:0:(sec.c:2375:sptlrpc_svc_free_rs()) Process leaving
00000100:00000001:11.0:1773851902.281819:0:2510946:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:11.0:1773851902.281820:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f7d7136e nid 25666@kfi7 refs 2
00000800:00000200:11.0:1773851902.281821:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2054@kfi7:2 -> 25666@kfi7(00000000aec15569):0x0 lsk 3532 rsk 35 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dcb Transaction freed
00000100:00000001:6.0:1773851902.281821:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851902.281822:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851902.281824:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851902.281825:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851902.281826:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000800:00000200:6.0:1773851902.281827:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fddc5cf3: 2069@kfi7:1 -> 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2c1 Transaction freed
00000800:00000200:17.0:1773851902.281858:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851902.281859:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851902.281860:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851902.281863:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851902.281864:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.281866:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2099@kfi7 : PUT - for me
00000400:00000200:17.0:1773851902.281867:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.281867:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 1
00000400:00000200:17.0:1773851902.281868:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.281869:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000400:00000200:17.0:1773851902.281870:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 3
00000400:00000200:17.0:1773851902.281871:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.281872:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2099@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6ec0
00000400:00000200:17.0:1773851902.281873:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2099@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.281875:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2099@kfi7 of length 368/368 into md 0x6ab1f25f1 [1] + 224
00000800:00000200:17.0:1773851902.281877:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851902.281878:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851902.281879:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2099@kfi7: PUT: OK
00000100:00000001:17.0:1773851902.281880:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:17.0:1773851902.281881:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:17.0:1773851902.281884:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:17.0:1773851902.281888:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851902.281889:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000083ab6a2d nid 2099@kfi7 refs 2
00000100:00000001:5.0:1773851902.281889:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:17.0:1773851902.281890:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 2099@kfi7(000000002de47da2):0x0 lsk 706 rsk 4788 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:5.0:1773851902.281890:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:5.0:1773851902.281891:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851902.281891:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:5.0:1773851902.281892:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045a04335.
00000400:00000200:5.0:1773851902.281893:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000400:00000010:5.0:1773851902.281893:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000100:00000001:5.0:1773851902.281894:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:5.0:1773851902.281895:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:5.0:1773851902.281898:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851902.281900:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851902.281901:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851902.281901:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851902.281902:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:5.0:1773851902.281903:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:5.0:1773851902.281904:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851902.281905:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:5.0:1773851902.281905:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000099544ce2 time=135 v=66 (66 66 66 66)
00000100:00001000:5.0:1773851902.281906:0:41067:0:(import.c:1951:at_measured()) add 1 to 0000000092842c10 time=135 v=66 (1 1 1 1)
00000100:00000001:5.0:1773851902.281907:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851902.281908:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:5.0:1773851902.281909:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851902.281909:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.281910:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851902.281910:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0018-osc-MDT0001: skip recheck: last_committed 159045964137
00000100:00000001:5.0:1773851902.281911:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:5.0:1773851902.281911:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851902.281912:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851902.281915:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851902.281916:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851902.281916:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:5.0:1773851902.281917:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:5.0:1773851902.281918:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0018-osc-MDT0001: Updating status = 0
00000004:00000040:5.0:1773851902.281918:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0018-osc-MDT0001: blocks=410399705088 free=351409059840 avail=351407102976 avail_mb=1372683996 hwm_mb=3131101 files=372011130 ffree=343172910 state=0: rc = 0
00000004:00000020:5.0:1773851902.281920:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0018-osc-MDT0001 (0000000029559068): 410399705088 blocks, 351409059840 free, 351407102976 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372011130 files, 343172910 free files
00000004:00000001:5.0:1773851902.281922:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851902.281923:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:5.0:1773851902.281926:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000db244de4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051942592:2099@kfi7:13:default-yuba2-0
00000100:00000001:5.0:1773851902.281927:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851902.281928:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851902.281928:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000db244de4 x1859433051942592/t0(0) o13->lustre5-OST0018-osc-MDT0001@2099@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851902.281930:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:5.0:1773851902.281932:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:5.0:1773851902.281932:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000080965be6.
02000000:00000001:5.0:1773851902.281933:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:5.0:1773851902.281934:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:5.0:1773851902.281934:0:41067:0:(genops.c:1107:class_import_put()) import 00000000729ad433 refcount=4 obd=lustre5-OST0018-osc-MDT0001
00000020:00000001:5.0:1773851902.281935:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:5.0:1773851902.281936:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000c821af11.
02000000:00000001:5.0:1773851902.281937:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:5.0:1773851902.281937:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:5.0:1773851902.281937:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000db244de4.
00000100:00000001:5.0:1773851902.281938:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:5.0:1773851902.281939:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851902.281939:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851902.281940:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:5.0:1773851902.281940:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.281941:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851902.281941:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:15.0:1773851902.304472:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851902.304473:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851902.304474:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851902.304477:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851902.304480:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:15.0:1773851902.304481:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19451@kfi7 : PUT - for me
00000400:00000200:15.0:1773851902.304482:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:15.0:1773851902.304483:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 1
00000400:00000200:15.0:1773851902.304484:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:15.0:1773851902.304485:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000400:00000200:15.0:1773851902.304486:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 3
00000400:00000200:15.0:1773851902.304487:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:15.0:1773851902.304488:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19451@kfi7 of length 224 into portal 12 MB=0x699de86f2f800
00000400:00000200:15.0:1773851902.304490:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19451@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 61912
00000800:00000200:15.0:1773851902.304492:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851902.304494:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851902.304496:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19451@kfi7: PUT: OK
00000100:00000001:15.0:1773851902.304497:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851902.304497:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851902.304498:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000059918df.
00000100:00000040:15.0:1773851902.304499:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000059918df x1858030886123520 msgsize 224
00000100:00100000:15.0:1773851902.304501:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-19451@kfi7 (source: 12345-19451@kfi7)
00000100:00000001:15.0:1773851902.304502:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851902.304503:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000100:00000001:12.0:1773851902.304505:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:15.0:1773851902.304506:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851902.304506:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851902.304507:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851902.304508:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851902.304510:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851902.304511:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030886123520
00000020:00000001:12.0:1773851902.304512:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851902.304513:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f3c
00000020:00000001:12.0:1773851902.304514:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851902.304519:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000039eaf5bd refcount=6
00000020:00000001:12.0:1773851902.304520:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239867392 : -107152469684224 : ffff9e8b9f1b9000)
00000020:00000001:12.0:1773851902.304522:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239867392 : -107152469684224 : ffff9e8b9f1b9000)
00000100:00000001:12.0:1773851902.304523:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851902.304524:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851902.304526:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000004642b5fe.
00000020:00000010:12.0:1773851902.304527:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851902.304529:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851902.304530:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851902.304532:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851902.304533:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851902.304534:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851902.304535:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851902.304536:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.304538:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851902.304540:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851902.304541:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851902.304541:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851902.304541:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851902.304543:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19451@kfi7, seq: 2289948
00000100:00000040:12.0:1773851902.304544:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000039eaf5bd : new rpc_count 1
00000100:00000001:14.0:1773851902.304545:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.304545:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860195328 : -107049849356288 : ffff9ea383c18000)
00000100:00000001:14.0:1773851902.304546:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851902.304547:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000059918df x1858030886123520/t0(0) o400->3a919ed7-97fb-4238-96eb-f184c1cb3ad1@19451@kfi7:542/0 lens 224/0 e 0 to 0 dl 1773852657 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne244-0'
00000100:00000001:12.0:1773851902.304552:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851902.304553:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851902.304555:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000059918df pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3a919ed7-97fb-4238-96eb-f184c1cb3ad1+6:47685:x1858030886123520:12345-19451@kfi7:400:default-tuolumne244-0
00000100:00000200:12.0:1773851902.304557:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030886123520
00000020:00000001:12.0:1773851902.304558:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851902.304559:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851902.304560:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.304562:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851902.304562:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851902.304564:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851902.304565:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030886123520, found 0 last_xid 1858030886123519
00000020:00000001:12.0:1773851902.304567:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851902.304568:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851902.304569:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851902.304569:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.304571:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851902.304572:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851902.304573:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851902.304574:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c46d7a92.
02000000:00000001:12.0:1773851902.304575:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.304577:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.304578:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851902.304579:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030886123520
00010000:00000001:12.0:1773851902.304581:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851902.304582:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000059918df x1858030886123520/t0(0) o400->3a919ed7-97fb-4238-96eb-f184c1cb3ad1@19451@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne244-0'
00010000:00000001:12.0:1773851902.304586:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851902.304587:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851902.304589:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=135 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851902.304590:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851902.304591:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000020c12e0 refcount 5 to 19451@kfi7
00000100:00000001:12.0:1773851902.304593:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811151072 : -107154898400544 : ffff9e8b0e584ae0)
02000000:00000001:12.0:1773851902.304594:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851902.304595:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.304596:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851902.304597:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19451@kfi7
00000400:00000010:12.0:1773851902.304598:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009203df6c.
00000100:00000200:12.0:1773851902.304600:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030886123520, offset 224
00000400:00000200:12.0:1773851902.304602:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19451@kfi7
00000400:00000200:12.0:1773851902.304604:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:12.0:1773851902.304605:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 1
00000400:00000200:12.0:1773851902.304607:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000400:00000200:12.0:1773851902.304609:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 3
00000400:00000200:12.0:1773851902.304611:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19451@kfi7 local destination
00000400:00000200:12.0:1773851902.304613:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770422:8770422:1024:4294967295] 19451@kfi7 LPNI seq info [28187:28187:16:4294967295]
00000400:00000200:12.0:1773851902.304616:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000400:00000200:12.0:1773851902.304617:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19451@kfi7 to cpt 3
00000400:00000200:12.0:1773851902.304621:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19451@kfi7(19451@kfi7:19451@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851902.304623:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 3
00000800:00000200:12.0:1773851902.304625:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851902.304627:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851902.304634:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851902.304639:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2bc Using peer 19451@kfi7(0x2bc)
00000800:00000200:12.0:1773851902.304644:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 0000000025990170: Posted send of 324 bytes to peer 0x2bc: rc=0
00000800:00000200:12.0:1773851902.304646:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2bc TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851902.304650:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851902.304651:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000020c12e0 refcount 4 to 19451@kfi7
00010000:00000001:12.0:1773851902.304653:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851902.304656:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.304657:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851902.304658:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000059918df x1858030886123520/t0(0) o400->3a919ed7-97fb-4238-96eb-f184c1cb3ad1@19451@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne244-0'
00000100:00100000:12.0:1773851902.304664:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000059918df pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:3a919ed7-97fb-4238-96eb-f184c1cb3ad1+6:47685:x1858030886123520:12345-19451@kfi7:400:default-tuolumne244-0 Request processed in 111us (164us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851902.304669:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19451@kfi7, seq: 2289948
00000100:00000040:12.0:1773851902.304670:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000039eaf5bd : new rpc_count 0
00000100:00000001:12.0:1773851902.304672:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851902.304673:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851902.304674:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851902.304675:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851902.304677:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000004642b5fe.
00000020:00000040:12.0:1773851902.304678:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000039eaf5bd : new refcount 5
00000100:00000001:12.0:1773851902.304680:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:15.0:1773851902.304688:0:2513974:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2bc TN_EVENT_TX_OK event status 0
00000400:00000200:15.0:1773851902.304689:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851902.304690:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19451@kfi7: PUT: OK
00000400:00000200:15.0:1773851902.304691:0:2513974:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009203df6c
00000400:00000010:15.0:1773851902.304692:0:2513974:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009203df6c.
00000100:00000001:15.0:1773851902.304692:0:2513974:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:15.0:1773851902.304693:0:2513974:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:15.0:1773851902.304694:0:2513974:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b52638ef nid 19451@kfi7 refs 2
00000800:00000200:15.0:1773851902.304695:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2069@kfi7:3 -> 19451@kfi7(0000000075d6f09d):0x0 lsk 701 rsk 87 tsk 0 trmk 0 tmk 0 trr 3 tta 0x2bc Transaction freed
00000800:00000200:9.0:1773851902.308313:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.308314:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851902.308315:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851902.308317:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851902.308319:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.308321:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19778@kfi7 : PUT - for me
00000400:00000200:9.0:1773851902.308322:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.308322:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 1
00000400:00000200:9.0:1773851902.308323:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.308324:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000400:00000200:9.0:1773851902.308325:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 3
00000400:00000200:9.0:1773851902.308326:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19842@kfi7 to cpt 5
00000400:00000200:9.0:1773851902.308327:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19842@kfi7 of length 224 into portal 12 MB=0x69b81a0565740
00000400:00000200:9.0:1773851902.308328:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19842@kfi7 of length 224/224 into md 0x78146ce49 [64] + 167792
00000800:00000200:9.0:1773851902.308329:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851902.308331:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851902.308332:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19778@kfi7: PUT: OK
00000100:00000001:9.0:1773851902.308333:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851902.308333:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851902.308334:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000177ebc66.
00000100:00000040:9.0:1773851902.308335:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000177ebc66 x1859830903363392 msgsize 224
00000100:00100000:9.0:1773851902.308338:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-19842@kfi7 (source: 12345-19778@kfi7)
00000100:00000001:9.0:1773851902.308339:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851902.308340:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000100:00000001:8.0:1773851902.308341:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851902.308341:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851902.308342:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b8e2b7e7: 2054@kfi7:2 <- 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851902.308342:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851902.308342:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851902.308343:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851902.308344:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830903363392
00000020:00000001:8.0:1773851902.308344:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851902.308345:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087408a2e46
00000020:00000001:8.0:1773851902.308345:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851902.308349:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000dab6d205 refcount=5
00000020:00000001:8.0:1773851902.308350:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637016918589440 : -107056790962176 : ffff9ea1e6010000)
00000020:00000001:8.0:1773851902.308350:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637016918589440 : -107056790962176 : ffff9ea1e6010000)
00000100:00000001:8.0:1773851902.308351:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851902.308352:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851902.308353:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006b1f3e4f.
00000020:00000010:8.0:1773851902.308354:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851902.308355:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb73beb2.
00000100:00000001:8.0:1773851902.308355:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851902.308356:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851902.308356:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851902.308357:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851902.308358:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851902.308358:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.308359:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851902.308360:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851902.308360:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851902.308361:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851902.308361:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851902.308362:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19842@kfi7, seq: 2130891
00000100:00000040:9.0:1773851902.308363:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000dab6d205 : new rpc_count 1
00000100:00000001:8.0:1773851902.308363:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.308364:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498316800 : -106953211234816 : ffff9eba03d63600)
00000100:00000001:8.0:1773851902.308364:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851902.308365:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000177ebc66 x1859830903363392/t0(0) o400->be04a832-fc51-4c4e-9082-83badf1682f6@19842@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1736-0'
00000100:00000001:9.0:1773851902.308368:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851902.308368:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851902.308370:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000177ebc66 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:be04a832-fc51-4c4e-9082-83badf1682f6+5:39681:x1859830903363392:12345-19842@kfi7:400:default-tuolumne1736-0
00000100:00000200:9.0:1773851902.308371:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830903363392
00000020:00000001:9.0:1773851902.308372:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851902.308373:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851902.308373:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.308374:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851902.308375:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851902.308375:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851902.308376:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830903363392, found 0 last_xid 1859830903363391
00000020:00000001:9.0:1773851902.308377:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851902.308378:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851902.308378:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851902.308379:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.308379:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851902.308380:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851902.308381:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851902.308381:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001cb612df.
02000000:00000001:9.0:1773851902.308382:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.308383:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.308384:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851902.308385:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690294, transno 0, xid 1859830903363392
00010000:00000001:9.0:1773851902.308386:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851902.308387:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000177ebc66 x1859830903363392/t0(0) o400->be04a832-fc51-4c4e-9082-83badf1682f6@19842@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1736-0'
00010000:00000001:9.0:1773851902.308389:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851902.308390:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851902.308391:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=135 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851902.308392:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851902.308393:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a0d50067 refcount 3 to 19842@kfi7
00000100:00000001:9.0:1773851902.308394:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402096224 : -107139307455392 : ffff9e8eafa33c60)
02000000:00000001:9.0:1773851902.308394:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851902.308395:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.308396:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851902.308396:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19778@kfi7
00000400:00000010:9.0:1773851902.308397:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000146cbe4e.
00000100:00000200:9.0:1773851902.308398:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830903363392, offset 224
00000400:00000200:9.0:1773851902.308400:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19778@kfi7
00000400:00000200:9.0:1773851902.308400:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.308401:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 1
00000400:00000200:9.0:1773851902.308402:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000400:00000200:9.0:1773851902.308403:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 3
00000400:00000200:9.0:1773851902.308405:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19778@kfi7 local destination
00000400:00000200:9.0:1773851902.308406:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770423:8770423:1024:4294967295] 19778@kfi7 LPNI seq info [165892:165892:16:4294967295]
00000400:00000200:9.0:1773851902.308408:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000400:00000200:9.0:1773851902.308408:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19778@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.308410:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19778@kfi7(19778@kfi7:19778@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851902.308412:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 3
00000800:00000200:9.0:1773851902.308413:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.308414:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851902.308418:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851902.308421:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000016b Using peer 19778@kfi7(0x10000000000016b)
00000800:00000200:9.0:1773851902.308424:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b8e2b7e7: Posted send of 324 bytes to peer 0x10000000000016b: rc=0
00000800:00000200:9.0:1773851902.308426:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000016b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851902.308428:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851902.308429:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a0d50067 refcount 2 to 19842@kfi7
00010000:00000001:9.0:1773851902.308430:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851902.308430:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.308431:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851902.308432:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000177ebc66 x1859830903363392/t0(0) o400->be04a832-fc51-4c4e-9082-83badf1682f6@19842@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1736-0'
00000100:00100000:9.0:1773851902.308435:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000177ebc66 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:be04a832-fc51-4c4e-9082-83badf1682f6+5:39681:x1859830903363392:12345-19842@kfi7:400:default-tuolumne1736-0 Request processed in 66us (99us total) trans 0 rc 0/0
00000100:00100000:9.0:1773851902.308438:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19842@kfi7, seq: 2130891
00000100:00000040:9.0:1773851902.308438:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000dab6d205 : new rpc_count 0
00000800:00000200:10.0:1773851902.308439:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000016b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851902.308439:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:10.0:1773851902.308440:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851902.308440:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:9.0:1773851902.308440:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:9.0:1773851902.308441:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb73beb2.
00000400:00000200:10.0:1773851902.308442:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19778@kfi7: PUT: OK
00000400:00000200:10.0:1773851902.308442:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000146cbe4e
00000020:00000010:9.0:1773851902.308442:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006b1f3e4f.
00000400:00000010:10.0:1773851902.308443:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000146cbe4e.
00000020:00000040:9.0:1773851902.308443:0:60898:0:(genops.c:882:class_export_put()) PUTting export 00000000dab6d205 : new refcount 4
00000100:00000001:10.0:1773851902.308444:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:10.0:1773851902.308444:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:9.0:1773851902.308444:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851902.308445:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002da2ac9a nid 19778@kfi7 refs 2
00000800:00000200:10.0:1773851902.308446:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b8e2b7e7: 2054@kfi7:2 -> 19778@kfi7(000000001c483ecb):0x0 lsk 364 rsk 19 tsk 0 trmk 0 tmk 0 trr 2 tta 0x10000000000016b Transaction freed
00000800:00000200:5.0:1773851902.328044:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.328045:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.328047:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.328049:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851902.328051:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.328052:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17906@kfi7 : PUT - for me
00000400:00000200:5.0:1773851902.328053:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.328054:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 1
00000400:00000200:5.0:1773851902.328055:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.328056:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000400:00000200:5.0:1773851902.328057:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 3
00000400:00000200:5.0:1773851902.328057:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17907@kfi7 to cpt 5
00000400:00000200:5.0:1773851902.328058:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17907@kfi7 of length 224 into portal 12 MB=0x69b4baa68a6c0
00000400:00000200:5.0:1773851902.328060:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17907@kfi7 of length 224/224 into md 0x793926dc5 [64] + 167784
00000800:00000200:5.0:1773851902.328062:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851902.328065:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.328066:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17906@kfi7: PUT: OK
00000100:00000001:5.0:1773851902.328067:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851902.328068:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851902.328068:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000079ceed67.
00000100:00000040:5.0:1773851902.328069:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000079ceed67 x1859599144101568 msgsize 224
00000100:00100000:5.0:1773851902.328071:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-17907@kfi7 (source: 12345-17906@kfi7)
00000100:00000001:5.0:1773851902.328071:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.328072:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000100:00000001:4.0:1773851902.328073:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851902.328073:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851902.328074:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851902.328074:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851902.328074:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851902.328075:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.328076:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599144101568
00000020:00000001:4.0:1773851902.328076:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851902.328077:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81b45
00000020:00000001:4.0:1773851902.328078:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851902.328079:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ed265264 refcount=912
00000020:00000001:4.0:1773851902.328079:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637146516842496 : -106927192709120 : ffff9ec012a96800)
00000020:00000001:4.0:1773851902.328080:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637146516842496 : -106927192709120 : ffff9ec012a96800)
00000100:00000001:4.0:1773851902.328081:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.328082:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851902.328083:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000001c023165.
00000020:00000010:4.0:1773851902.328084:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.328084:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000089183453.
00000100:00000001:4.0:1773851902.328085:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851902.328086:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851902.328086:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.328087:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851902.328087:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851902.328088:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.328089:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.328090:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851902.328091:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.328091:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851902.328092:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851902.328092:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17907@kfi7, seq: 2002004
00000100:00000040:4.0:1773851902.328092:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ed265264 : new rpc_count 7
00000100:00000001:7.0:1773851902.328093:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.328093:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569667328 : -106988139884288 : ffff9eb1e1ed5100)
00000100:00000001:7.0:1773851902.328094:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.328094:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000079ceed67 x1859599144101568/t0(0) o400->5c64f764-8ed7-4055-8a23-f149b09516bc@17907@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1593-0'
00000100:00000001:4.0:1773851902.328097:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.328097:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851902.328099:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000079ceed67 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5c64f764-8ed7-4055-8a23-f149b09516bc+912:39592:x1859599144101568:12345-17907@kfi7:400:default-tuolumne1593-0
00000100:00000200:4.0:1773851902.328100:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599144101568
00000020:00000001:4.0:1773851902.328101:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851902.328101:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851902.328102:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.328103:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851902.328103:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851902.328104:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851902.328105:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599144101568, found 0 last_xid 1859599143432383
00000020:00000001:4.0:1773851902.328105:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851902.328106:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851902.328106:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851902.328107:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.328108:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851902.328108:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851902.328109:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851902.328110:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001de1915f.
02000000:00000001:4.0:1773851902.328110:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.328111:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.328112:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851902.328112:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593320, transno 0, xid 1859599144101568
00010000:00000001:4.0:1773851902.328113:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851902.328114:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000079ceed67 x1859599144101568/t0(0) o400->5c64f764-8ed7-4055-8a23-f149b09516bc@17907@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1593-0'
00010000:00000001:4.0:1773851902.328116:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851902.328117:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851902.328117:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851902.328118:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851902.328119:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e348bef4 refcount 3 to 17907@kfi7
00000100:00000001:4.0:1773851902.328120:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964024992 : -107156745526624 : ffff9e8aa03f62a0)
02000000:00000001:4.0:1773851902.328121:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851902.328121:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.328122:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851902.328123:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17906@kfi7
00000400:00000010:4.0:1773851902.328123:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a0b1f78.
00000100:00000200:4.0:1773851902.328124:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599144101568, offset 224
00000400:00000200:4.0:1773851902.328125:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17906@kfi7
00000400:00000200:4.0:1773851902.328126:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.328127:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 1
00000400:00000200:4.0:1773851902.328128:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000400:00000200:4.0:1773851902.328129:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 3
00000400:00000200:4.0:1773851902.328130:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17906@kfi7 local destination
00000400:00000200:4.0:1773851902.328132:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770424:8770424:1024:4294967295] 17906@kfi7 LPNI seq info [15152056:15152056:16:4294967295]
00000400:00000200:4.0:1773851902.328133:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000400:00000200:4.0:1773851902.328134:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17906@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.328135:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17906@kfi7(17906@kfi7:17906@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851902.328136:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 3
00000800:00000200:4.0:1773851902.328138:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851902.328139:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851902.328141:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851902.328143:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0xffa Using peer 17906@kfi7(0xffa)
00000800:00000200:4.0:1773851902.328146:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0xffa: rc=0
00000800:00000200:4.0:1773851902.328147:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0xffa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851902.328149:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.328150:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e348bef4 refcount 2 to 17907@kfi7
00010000:00000001:4.0:1773851902.328151:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851902.328151:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.328152:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851902.328153:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000079ceed67 x1859599144101568/t0(0) o400->5c64f764-8ed7-4055-8a23-f149b09516bc@17907@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1593-0'
00000100:00100000:4.0:1773851902.328158:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000079ceed67 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:5c64f764-8ed7-4055-8a23-f149b09516bc+912:39592:x1859599144101568:12345-17907@kfi7:400:default-tuolumne1593-0 Request processed in 60us (87us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851902.328160:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17907@kfi7, seq: 2002004
00000100:00000040:4.0:1773851902.328161:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ed265264 : new rpc_count 6
00000100:00000001:4.0:1773851902.328161:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851902.328162:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851902.328162:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.328163:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000089183453.
00000020:00000010:4.0:1773851902.328164:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000001c023165.
00000020:00000040:4.0:1773851902.328165:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000ed265264 : new refcount 911
00000100:00000001:4.0:1773851902.328166:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851902.328170:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0xffa TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851902.328172:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.328173:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17906@kfi7: PUT: OK
00000400:00000200:5.0:1773851902.328174:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a0b1f78
00000400:00000010:5.0:1773851902.328174:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a0b1f78.
00000100:00000001:5.0:1773851902.328175:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851902.328176:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851902.328176:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000046a63518 nid 17906@kfi7 refs 2
00000800:00000200:5.0:1773851902.328178:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2069@kfi7:1 -> 17906@kfi7(0000000034c1e97e):0x0 lsk 4091 rsk 27 tsk 0 trmk 0 tmk 0 trr 1 tta 0xffa Transaction freed
00000800:00000200:29.0:1773851902.366190:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851902.366190:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851902.366192:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851902.366193:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851902.366195:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.366196:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18387@kfi7 : PUT - for me
00000400:00000200:29.0:1773851902.366197:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.366198:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 1
00000400:00000200:29.0:1773851902.366200:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.366200:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000400:00000200:29.0:1773851902.366201:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 3
00000400:00000200:29.0:1773851902.366202:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.366202:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18387@kfi7 of length 224 into portal 12 MB=0x69b16ef2079c0
00000400:00000200:29.0:1773851902.366204:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18387@kfi7 of length 224/224 into md 0x77fe1859d [64] + 12192
00000800:00000200:29.0:1773851902.366205:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851902.366207:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851902.366208:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18387@kfi7: PUT: OK
00000100:00000001:29.0:1773851902.366208:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851902.366209:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851902.366210:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000cbb5f55b.
00000100:00000040:29.0:1773851902.366210:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000cbb5f55b x1859372663732672 msgsize 224
00000100:00100000:29.0:1773851902.366212:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-18387@kfi7 (source: 12345-18387@kfi7)
00000100:00000001:29.0:1773851902.366213:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851902.366213:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000100:00000001:31.0:1773851902.366214:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851902.366214:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851902.366217:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851902.366217:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851902.366218:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851902.366218:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851902.366219:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859372663732672
00000020:00000001:31.0:1773851902.366220:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851902.366220:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ae82968
00000020:00000001:31.0:1773851902.366221:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851902.366225:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c82f7925 refcount=5
00000020:00000001:31.0:1773851902.366225:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636922792924160 : -107150916627456 : ffff9e8bfbad5400)
00000020:00000001:31.0:1773851902.366226:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636922792924160 : -107150916627456 : ffff9e8bfbad5400)
00000100:00000001:31.0:1773851902.366227:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851902.366228:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851902.366229:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000afd5d76e.
00000020:00000010:31.0:1773851902.366230:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851902.366231:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851902.366231:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851902.366232:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851902.366232:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.366233:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851902.366234:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851902.366234:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.366235:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.366236:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851902.366237:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851902.366237:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851902.366237:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851902.366238:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18387@kfi7, seq: 2055608
00000100:00000040:31.0:1773851902.366239:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c82f7925 : new rpc_count 1
00000100:00000001:31.0:1773851902.366239:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208522624 : -106943501028992 : ffff9ebc469c3180)
00000100:00000001:30.0:1773851902.366239:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.366240:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851902.366241:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000cbb5f55b x1859372663732672/t0(0) o400->369b8a33-a99c-4e5d-92eb-872818783069@18387@kfi7:690/0 lens 224/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1637-0'
00000100:00000001:31.0:1773851902.366243:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851902.366243:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851902.366244:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000cbb5f55b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:369b8a33-a99c-4e5d-92eb-872818783069+5:39842:x1859372663732672:12345-18387@kfi7:400:default-tuolumne1637-0
00000100:00000200:31.0:1773851902.366247:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859372663732672
00000020:00000001:31.0:1773851902.366248:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851902.366249:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851902.366250:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851902.366250:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851902.366251:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851902.366251:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851902.366252:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859372663732672, found 0 last_xid 1859372663732671
00000020:00000001:31.0:1773851902.366253:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851902.366253:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851902.366254:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851902.366255:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851902.366255:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851902.366256:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851902.366256:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851902.366257:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000094c03088.
02000000:00000001:31.0:1773851902.366257:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.366258:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851902.366259:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851902.366259:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044175218, transno 0, xid 1859372663732672
00010000:00000001:31.0:1773851902.366260:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851902.366261:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000cbb5f55b x1859372663732672/t0(0) o400->369b8a33-a99c-4e5d-92eb-872818783069@18387@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1637-0'
00010000:00000001:31.0:1773851902.366263:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851902.366263:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851902.366264:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=135 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851902.366265:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851902.366266:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003641a136 refcount 3 to 18387@kfi7
00000100:00000001:31.0:1773851902.366267:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231804544 : -107130477747072 : ffff9e90bdede480)
02000000:00000001:31.0:1773851902.366267:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851902.366268:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.366269:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851902.366270:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18387@kfi7
00000400:00000010:31.0:1773851902.366270:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005d81a04c.
00000100:00000200:31.0:1773851902.366271:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859372663732672, offset 224
00000400:00000200:31.0:1773851902.366273:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18387@kfi7
00000400:00000200:31.0:1773851902.366273:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:31.0:1773851902.366274:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 1
00000400:00000200:31.0:1773851902.366275:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000400:00000200:31.0:1773851902.366276:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 3
00000400:00000200:31.0:1773851902.366278:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18387@kfi7 local destination
00000400:00000200:31.0:1773851902.366279:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770425:8770425:1024:4294967295] 18387@kfi7 LPNI seq info [260909:260909:16:4294967295]
00000400:00000200:31.0:1773851902.366280:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000400:00000200:31.0:1773851902.366281:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18387@kfi7 to cpt 7
00000400:00000200:31.0:1773851902.366283:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18387@kfi7(18387@kfi7:18387@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851902.366284:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 3
00000800:00000200:31.0:1773851902.366286:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851902.366287:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851902.366289:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851902.366291:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ec Using peer 18387@kfi7(0x6ec)
00000800:00000200:31.0:1773851902.366294:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002809a79a: Posted send of 324 bytes to peer 0x6ec: rc=0
00000800:00000200:31.0:1773851902.366295:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851902.366297:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851902.366298:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003641a136 refcount 2 to 18387@kfi7
00010000:00000001:31.0:1773851902.366299:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851902.366299:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851902.366300:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851902.366300:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000cbb5f55b x1859372663732672/t0(0) o400->369b8a33-a99c-4e5d-92eb-872818783069@18387@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1637-0'
00000100:00100000:31.0:1773851902.366304:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000cbb5f55b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:369b8a33-a99c-4e5d-92eb-872818783069+5:39842:x1859372663732672:12345-18387@kfi7:400:default-tuolumne1637-0 Request processed in 59us (92us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851902.366306:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18387@kfi7, seq: 2055608
00000100:00000040:31.0:1773851902.366307:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c82f7925 : new rpc_count 0
00000100:00000001:31.0:1773851902.366307:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851902.366308:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851902.366308:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000800:00000200:29.0:1773851902.366308:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ec TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851902.366309:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851902.366309:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851902.366310:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000afd5d76e.
00000400:00000200:29.0:1773851902.366310:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18387@kfi7: PUT: OK
00000020:00000040:31.0:1773851902.366311:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000c82f7925 : new refcount 4
00000100:00000001:31.0:1773851902.366311:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851902.366311:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005d81a04c
00000400:00000010:29.0:1773851902.366311:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005d81a04c.
00000100:00000001:29.0:1773851902.366312:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851902.366312:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851902.366313:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c1f9b8e3 nid 18387@kfi7 refs 2
00000800:00000200:29.0:1773851902.366314:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002809a79a: 2069@kfi7:7 -> 18387@kfi7(00000000bbd4f9ef):0x0 lsk 1773 rsk 47 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ec Transaction freed
00000800:00000200:13.0:1773851902.367499:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851902.367500:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851902.367501:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851902.367504:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851902.367506:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:13.0:1773851902.367507:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8704@kfi7 : PUT - for me
00000400:00000200:13.0:1773851902.367508:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:13.0:1773851902.367509:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 1
00000400:00000200:13.0:1773851902.367510:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:13.0:1773851902.367511:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000400:00000200:13.0:1773851902.367511:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 3
00000400:00000200:13.0:1773851902.367512:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8897@kfi7 to cpt 0
00000400:00000200:13.0:1773851902.367513:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8897@kfi7 of length 224 into portal 12 MB=0x69b0a2a0de380
00000400:00000200:13.0:1773851902.367514:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8897@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 62136
00000800:00000200:13.0:1773851902.367516:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851902.367518:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851902.367519:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8704@kfi7: PUT: OK
00000100:00000001:13.0:1773851902.367520:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851902.367520:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851902.367521:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c4db11f.
00000100:00000040:13.0:1773851902.367522:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000009c4db11f x1859317817795456 msgsize 224
00000100:00100000:13.0:1773851902.367523:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-8897@kfi7 (source: 12345-8704@kfi7)
00000100:00000001:13.0:1773851902.367524:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851902.367525:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000100:00000001:12.0:1773851902.367526:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851902.367526:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851902.367527:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851902.367527:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851902.367527:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851902.367528:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851902.367529:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317817795456
00000020:00000001:12.0:1773851902.367530:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851902.367531:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f72
00000020:00000001:12.0:1773851902.367532:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851902.367535:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000045e6442 refcount=9
00000020:00000001:12.0:1773851902.367536:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744912896 : -107128964638720 : ffff9e91181e1800)
00000020:00000001:12.0:1773851902.367537:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744912896 : -107128964638720 : ffff9e91181e1800)
00000100:00000001:12.0:1773851902.367539:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851902.367540:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851902.367540:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000732ec20a.
00000020:00000010:12.0:1773851902.367541:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851902.367542:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851902.367543:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851902.367543:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851902.367544:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851902.367545:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851902.367545:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851902.367546:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.367547:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851902.367548:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851902.367548:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851902.367549:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851902.367549:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851902.367550:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851902.367550:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8897@kfi7, seq: 2289949
00000100:00000040:12.0:1773851902.367550:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000045e6442 : new rpc_count 1
00000100:00000001:14.0:1773851902.367551:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.367551:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637153945744640 : -106919763806976 : ffff9ec1cd757500)
00000100:00000040:12.0:1773851902.367552:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c4db11f x1859317817795456/t0(0) o400->4117e73c-97d2-47ae-808b-056227912da3@8897@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1043-0'
00000100:00000001:12.0:1773851902.367555:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851902.367555:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851902.367557:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c4db11f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:4117e73c-97d2-47ae-808b-056227912da3+9:39500:x1859317817795456:12345-8897@kfi7:400:default-tuolumne1043-0
00000100:00000200:12.0:1773851902.367558:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317817795456
00000020:00000001:12.0:1773851902.367559:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851902.367559:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851902.367560:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.367562:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851902.367562:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851902.367563:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851902.367564:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317817795456, found 0 last_xid 1859317817795455
00000020:00000001:12.0:1773851902.367564:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851902.367565:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851902.367566:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851902.367566:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.367567:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851902.367567:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851902.367568:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851902.367568:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ce1f79b7.
02000000:00000001:12.0:1773851902.367569:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.367570:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.367570:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851902.367571:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183007402965, transno 0, xid 1859317817795456
00010000:00000001:12.0:1773851902.367572:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851902.367572:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c4db11f x1859317817795456/t0(0) o400->4117e73c-97d2-47ae-808b-056227912da3@8897@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1043-0'
00010000:00000001:12.0:1773851902.367575:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851902.367575:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851902.367576:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=135 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851902.367577:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851902.367578:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008ea29daa refcount 3 to 8897@kfi7
00000100:00000001:12.0:1773851902.367579:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274737568 : -107155434814048 : ffff9e8aee5f45a0)
02000000:00000001:12.0:1773851902.367579:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851902.367580:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.367581:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851902.367582:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8704@kfi7
00000400:00000010:12.0:1773851902.367582:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000018d1ad92.
00000100:00000200:12.0:1773851902.367583:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317817795456, offset 224
00000400:00000200:12.0:1773851902.367584:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8704@kfi7
00000400:00000200:12.0:1773851902.367585:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:12.0:1773851902.367586:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 1
00000400:00000200:12.0:1773851902.367587:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000400:00000200:12.0:1773851902.367589:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 3
00000400:00000200:12.0:1773851902.367590:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8704@kfi7 local destination
00000400:00000200:12.0:1773851902.367591:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770426:8770426:1024:4294967295] 8704@kfi7 LPNI seq info [1624785:1624785:16:4294967295]
00000400:00000200:12.0:1773851902.367593:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000400:00000200:12.0:1773851902.367593:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8704@kfi7 to cpt 3
00000400:00000200:12.0:1773851902.367595:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8704@kfi7(8704@kfi7:8704@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851902.367596:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 3
00000800:00000200:12.0:1773851902.367597:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851902.367599:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851902.367601:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851902.367603:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1077 Using peer 8704@kfi7(0x1077)
00000800:00000200:12.0:1773851902.367606:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x1077: rc=0
00000800:00000200:12.0:1773851902.367607:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1077 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851902.367609:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851902.367610:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008ea29daa refcount 2 to 8897@kfi7
00010000:00000001:12.0:1773851902.367611:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851902.367612:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.367612:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851902.367613:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c4db11f x1859317817795456/t0(0) o400->4117e73c-97d2-47ae-808b-056227912da3@8897@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1043-0'
00000100:00100000:12.0:1773851902.367618:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c4db11f pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:4117e73c-97d2-47ae-808b-056227912da3+9:39500:x1859317817795456:12345-8897@kfi7:400:default-tuolumne1043-0 Request processed in 61us (95us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851902.367620:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8897@kfi7, seq: 2289949
00000100:00000040:12.0:1773851902.367620:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000045e6442 : new rpc_count 0
00000100:00000001:12.0:1773851902.367621:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851902.367622:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851902.367623:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851902.367623:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851902.367624:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000732ec20a.
00000020:00000040:12.0:1773851902.367625:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000045e6442 : new refcount 8
00000100:00000001:12.0:1773851902.367626:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851902.367631:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1077 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851902.367632:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851902.367633:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8704@kfi7: PUT: OK
00000400:00000200:13.0:1773851902.367634:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000018d1ad92
00000400:00000010:13.0:1773851902.367635:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000018d1ad92.
00000100:00000001:13.0:1773851902.367636:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851902.367636:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851902.367637:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000020917240 nid 8704@kfi7 refs 2
00000800:00000200:13.0:1773851902.367638:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2069@kfi7:3 -> 8704@kfi7(000000003a383172):0x0 lsk 4216 rsk 44 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1077 Transaction freed
00000800:00000200:5.0:1773851902.421195:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.421196:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.421197:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.421199:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851902.421201:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.421202:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 43@kfi7 : PUT - for me
00000400:00000200:5.0:1773851902.421203:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.421203:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:5.0:1773851902.421205:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.421205:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:5.0:1773851902.421206:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:5.0:1773851902.421207:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 61@kfi7 to cpt 0
00000400:00000200:5.0:1773851902.421208:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-61@kfi7 of length 224 into portal 24 MB=0x69b1a87a23200
00000400:00000200:5.0:1773851902.421209:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-61@kfi7 of length 224/224 into md 0x793844545 [256] + 9512
00000800:00000200:5.0:1773851902.421211:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851902.421213:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.421214:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000100:00000001:5.0:1773851902.421215:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851902.421215:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:5.0:1773851902.421216:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008713e098.
00000100:00000040:5.0:1773851902.421217:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000008713e098 x1859388107272704 msgsize 224
00000100:00100000:5.0:1773851902.421218:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-61@kfi7 (source: 12345-43@kfi7)
00000100:00000001:5.0:1773851902.421219:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.421220:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000100:00000001:6.0:1773851902.421221:0:1537125:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:6.0:1773851902.421221:0:1537125:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851902.421221:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:6.0:1773851902.421222:0:1537125:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851902.421222:0:1537125:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851902.421223:0:1537125:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851902.421223:0:1537125:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859388107272704
00000020:00000001:6.0:1773851902.421224:0:1537125:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:6.0:1773851902.421224:0:1537125:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90ce2
00000020:00000001:6.0:1773851902.421225:0:1537125:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:6.0:1773851902.421228:0:1537125:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003b257870 refcount=5
00000020:00000001:6.0:1773851902.421229:0:1537125:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000020:00000001:6.0:1773851902.421230:0:1537125:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395723264 : -107136313828352 : ffff9e8f62125c00)
00000100:00000001:6.0:1773851902.421231:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851902.421232:0:1537125:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:6.0:1773851902.421233:0:1537125:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000be250a4f.
00000020:00000010:6.0:1773851902.421234:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000007f854136.
00000020:00000010:6.0:1773851902.421235:0:1537125:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c00deed3.
00000100:00000040:6.0:1773851902.421236:0:1537125:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:6.0:1773851902.421236:0:1537125:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:6.0:1773851902.421237:0:1537125:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:6.0:1773851902.421237:0:1537125:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851902.421238:0:1537125:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851902.421239:0:1537125:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851902.421240:0:1537125:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:6.0:1773851902.421241:0:1537125:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:5.0:1773851902.421241:0:1203214:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:5.0:1773851902.421241:0:1203214:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:6.0:1773851902.421242:0:1537125:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-61@kfi7, seq: 18314092
00000100:00000040:6.0:1773851902.421243:0:1537125:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003b257870 : new rpc_count 1
00000100:00000001:6.0:1773851902.421243:0:1537125:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569653504 : -106988139898112 : ffff9eb1e1ed1b00)
00000100:00000001:5.0:1773851902.421243:0:1203214:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.421244:0:1203214:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851902.421245:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008713e098 x1859388107272704/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba1-0'
00000100:00000001:6.0:1773851902.421248:0:1537125:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:6.0:1773851902.421248:0:1537125:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:6.0:1773851902.421249:0:1537125:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008713e098 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388107272704:12345-61@kfi7:41:default-yuba1-0
00000100:00000200:6.0:1773851902.421250:0:1537125:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859388107272704
00000020:00000001:6.0:1773851902.421251:0:1537125:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:6.0:1773851902.421252:0:1537125:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:6.0:1773851902.421252:0:1537125:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851902.421253:0:1537125:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:6.0:1773851902.421253:0:1537125:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:6.0:1773851902.421254:0:1537125:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:6.0:1773851902.421255:0:1537125:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:6.0:1773851902.421256:0:1537125:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:6.0:1773851902.421256:0:1537125:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:6.0:1773851902.421257:0:1537125:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851902.421258:0:1537125:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:6.0:1773851902.421258:0:1537125:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:6.0:1773851902.421259:0:1537125:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000038a1899.
02000000:00000001:6.0:1773851902.421260:0:1537125:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851902.421261:0:1537125:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851902.421262:0:1537125:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:6.0:1773851902.421262:0:1537125:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:6.0:1773851902.421263:0:1537125:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:6.0:1773851902.421264:0:1537125:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 424673280 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:6.0:1773851902.421265:0:1537125:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129667 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:6.0:1773851902.421266:0:1537125:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:6.0:1773851902.421267:0:1537125:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264473241, transno 0, xid 1859388107272704
00010000:00000001:6.0:1773851902.421268:0:1537125:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:6.0:1773851902.421269:0:1537125:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008713e098 x1859388107272704/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:629/0 lens 224/368 e 0 to 0 dl 1773851989 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00010000:00000001:6.0:1773851902.421271:0:1537125:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:6.0:1773851902.421272:0:1537125:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:6.0:1773851902.421273:0:1537125:0:(import.c:1951:at_measured()) add 1 to 0000000032c55cdd time=131 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851902.421274:0:1537125:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:6.0:1773851902.421274:0:1537125:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b44e919 refcount 12 to 61@kfi7
00000100:00000001:6.0:1773851902.421275:0:1537125:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005152 : -107146751546464 : ffff9e8cf3ef6ba0)
02000000:00000001:6.0:1773851902.421276:0:1537125:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:6.0:1773851902.421277:0:1537125:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851902.421278:0:1537125:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851902.421278:0:1537125:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-43@kfi7
00000400:00000010:6.0:1773851902.421279:0:1537125:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004a88ec3c.
00000100:00000200:6.0:1773851902.421280:0:1537125:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1859388107272704, offset 224
00000400:00000200:6.0:1773851902.421281:0:1537125:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-43@kfi7
00000400:00000200:6.0:1773851902.421282:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851902.421283:0:1537125:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 1
00000400:00000200:6.0:1773851902.421284:0:1537125:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851902.421285:0:1537125:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000400:00000200:6.0:1773851902.421287:0:1537125:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  43@kfi7 local destination
00000400:00000200:6.0:1773851902.421289:0:1537125:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770427:8770427:1024:4294967295] 43@kfi7 LPNI seq info [37492110:37492110:16:4294967295]
00000400:00000200:6.0:1773851902.421290:0:1537125:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000400:00000200:6.0:1773851902.421291:0:1537125:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 43@kfi7 to cpt 1
00000400:00000200:6.0:1773851902.421293:0:1537125:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 43@kfi7(43@kfi7:43@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851902.421294:0:1537125:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 3
00000800:00000200:6.0:1773851902.421295:0:1537125:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851902.421296:0:1537125:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:6.0:1773851902.421299:0:1537125:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851902.421301:0:1537125:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Using peer 43@kfi7(0xa02)
00000800:00000200:6.0:1773851902.421304:0:1537125:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000001aa19562: Posted send of 468 bytes to peer 0xa02: rc=0
00000800:00000200:6.0:1773851902.421305:0:1537125:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851902.421307:0:1537125:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851902.421308:0:1537125:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b44e919 refcount 11 to 61@kfi7
00010000:00000001:6.0:1773851902.421309:0:1537125:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:6.0:1773851902.421309:0:1537125:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:6.0:1773851902.421310:0:1537125:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:6.0:1773851902.421311:0:1537125:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008713e098 x1859388107272704/t0(0) o41->lustre5-MDT0000-mdtlov_UUID@61@kfi7:629/0 lens 224/368 e 0 to 0 dl 1773851989 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba1-0'
00000100:00100000:6.0:1773851902.421313:0:1537125:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008713e098 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out01_029:lustre5-MDT0000-mdtlov_UUID+5:40154:x1859388107272704:12345-61@kfi7:41:default-yuba1-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000100:00100000:6.0:1773851902.421315:0:1537125:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-61@kfi7, seq: 18314092
00000100:00000040:6.0:1773851902.421316:0:1537125:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003b257870 : new rpc_count 0
00000100:00000001:6.0:1773851902.421316:0:1537125:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:6.0:1773851902.421317:0:1537125:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:6.0:1773851902.421317:0:1537125:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000007f854136.
00000800:00000200:5.0:1773851902.421317:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 TN_EVENT_TX_OK event status 0
00000020:00000010:6.0:1773851902.421318:0:1537125:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c00deed3.
00000400:00000200:5.0:1773851902.421318:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:6.0:1773851902.421319:0:1537125:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000be250a4f.
00000400:00000200:5.0:1773851902.421319:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->43@kfi7: PUT: OK
00000020:00000040:6.0:1773851902.421320:0:1537125:0:(genops.c:882:class_export_put()) PUTting export 000000003b257870 : new refcount 4
00000400:00000200:5.0:1773851902.421320:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004a88ec3c
00000100:00000001:6.0:1773851902.421321:0:1537125:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:5.0:1773851902.421321:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004a88ec3c.
00000100:00000001:5.0:1773851902.421321:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851902.421322:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851902.421322:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000170d0ba nid 43@kfi7 refs 2
00000800:00000200:5.0:1773851902.421324:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2069@kfi7:1 -> 43@kfi7(0000000066fa1d6c):0x0 lsk 2563 rsk 2883 tsk 0 trmk 0 tmk 0 trr 1 tta 0xa02 Transaction freed
00000800:00000200:29.0:1773851902.516346:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851902.516347:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851902.516348:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851902.516350:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851902.516351:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.516352:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19201@kfi7 : PUT - for me
00000400:00000200:29.0:1773851902.516353:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.516354:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 1
00000400:00000200:29.0:1773851902.516356:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.516356:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000400:00000200:29.0:1773851902.516357:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 3
00000400:00000200:29.0:1773851902.516358:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19200@kfi7 to cpt 4
00000400:00000200:29.0:1773851902.516358:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19200@kfi7 of length 224 into portal 12 MB=0x69b4b849cab40
00000400:00000200:29.0:1773851902.516360:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19200@kfi7 of length 224/224 into md 0x77fe1859d [64] + 12416
00000800:00000200:29.0:1773851902.516361:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851902.516363:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851902.516363:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19201@kfi7: PUT: OK
00000100:00000001:29.0:1773851902.516364:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851902.516365:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851902.516365:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000adb21cab.
00000100:00000040:29.0:1773851902.516366:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000adb21cab x1859598509976384 msgsize 224
00000100:00100000:29.0:1773851902.516367:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-19200@kfi7 (source: 12345-19201@kfi7)
00000100:00000001:29.0:1773851902.516368:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:31.0:1773851902.516369:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:29.0:1773851902.516369:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
02000000:00000001:31.0:1773851902.516370:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851902.516370:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851902.516370:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851902.516371:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851902.516372:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851902.516372:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598509976384
00000020:00000001:31.0:1773851902.516373:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851902.516373:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81caa
00000020:00000001:31.0:1773851902.516374:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851902.516377:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000efb06e4b refcount=5
00000020:00000001:31.0:1773851902.516377:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637139323327488 : -106934386224128 : ffff9ebe65e51400)
00000020:00000001:31.0:1773851902.516378:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637139323327488 : -106934386224128 : ffff9ebe65e51400)
00000100:00000001:31.0:1773851902.516379:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851902.516380:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851902.516380:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000afd5d76e.
00000020:00000010:31.0:1773851902.516381:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851902.516382:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b9dfe5c0.
00000100:00000001:31.0:1773851902.516383:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851902.516383:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851902.516384:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.516385:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851902.516385:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851902.516386:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.516386:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.516388:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851902.516388:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851902.516389:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851902.516389:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851902.516390:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19200@kfi7, seq: 2055609
00000100:00000001:31.0:1773851902.516391:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851902.516391:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000efb06e4b : new rpc_count 1
00000100:00000001:31.0:1773851902.516392:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.516392:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208539904 : -106943501011712 : ffff9ebc469c7500)
00000100:00000040:30.0:1773851902.516394:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000adb21cab x1859598509976384/t0(0) o400->f1a14405-9455-40ba-a816-ab7b23799e06@19200@kfi7:690/0 lens 224/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1699-0'
00000100:00000001:30.0:1773851902.516397:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851902.516397:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851902.516398:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000adb21cab pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:f1a14405-9455-40ba-a816-ab7b23799e06+5:39523:x1859598509976384:12345-19200@kfi7:400:default-tuolumne1699-0
00000100:00000200:30.0:1773851902.516400:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598509976384
00000020:00000001:30.0:1773851902.516401:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851902.516401:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851902.516402:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.516403:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851902.516403:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851902.516404:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851902.516405:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598509976384, found 0 last_xid 1859598509976383
00000020:00000001:30.0:1773851902.516406:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851902.516406:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851902.516407:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851902.516407:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.516408:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851902.516409:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851902.516410:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851902.516410:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003ac8adba.
02000000:00000001:30.0:1773851902.516411:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.516412:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.516412:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851902.516413:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262830027, transno 0, xid 1859598509976384
00010000:00000001:30.0:1773851902.516414:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851902.516415:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000adb21cab x1859598509976384/t0(0) o400->f1a14405-9455-40ba-a816-ab7b23799e06@19200@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1699-0'
00010000:00000001:30.0:1773851902.516418:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851902.516418:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851902.516419:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=135 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851902.516430:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851902.516431:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ab0141db refcount 3 to 19200@kfi7
00000100:00000001:30.0:1773851902.516432:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301333376 : -107155408218240 : ffff9e8aeff51780)
02000000:00000001:30.0:1773851902.516433:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851902.516433:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.516434:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851902.516435:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19201@kfi7
00000400:00000010:30.0:1773851902.516436:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000147989c0.
00000100:00000200:30.0:1773851902.516436:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598509976384, offset 224
00000400:00000200:30.0:1773851902.516438:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19201@kfi7
00000400:00000200:30.0:1773851902.516439:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:30.0:1773851902.516440:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 1
00000400:00000200:30.0:1773851902.516441:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000400:00000200:30.0:1773851902.516442:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 3
00000400:00000200:30.0:1773851902.516443:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19201@kfi7 local destination
00000400:00000200:30.0:1773851902.516445:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770428:8770428:1024:4294967295] 19201@kfi7 LPNI seq info [9070807:9070807:16:4294967295]
00000400:00000200:30.0:1773851902.516446:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000400:00000200:30.0:1773851902.516447:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19201@kfi7 to cpt 7
00000400:00000200:30.0:1773851902.516449:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19201@kfi7(19201@kfi7:19201@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851902.516450:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 3
00000800:00000200:30.0:1773851902.516452:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851902.516453:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851902.516455:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851902.516457:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d3a Using peer 19201@kfi7(0x100000000000d3a)
00000800:00000200:30.0:1773851902.516461:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000bfd826e8: Posted send of 324 bytes to peer 0x100000000000d3a: rc=0
00000800:00000200:30.0:1773851902.516463:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d3a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851902.516465:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851902.516466:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ab0141db refcount 2 to 19200@kfi7
00010000:00000001:30.0:1773851902.516467:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851902.516468:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.516468:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851902.516469:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000adb21cab x1859598509976384/t0(0) o400->f1a14405-9455-40ba-a816-ab7b23799e06@19200@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1699-0'
00000100:00100000:30.0:1773851902.516472:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000adb21cab pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:f1a14405-9455-40ba-a816-ab7b23799e06+5:39523:x1859598509976384:12345-19200@kfi7:400:default-tuolumne1699-0 Request processed in 74us (105us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851902.516474:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19200@kfi7, seq: 2055609
00000100:00000040:30.0:1773851902.516475:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000efb06e4b : new rpc_count 0
00000800:00000200:29.0:1773851902.516475:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d3a TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851902.516476:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851902.516477:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851902.516477:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000200:29.0:1773851902.516477:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851902.516478:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b9dfe5c0.
00000400:00000200:29.0:1773851902.516478:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19201@kfi7: PUT: OK
00000020:00000010:30.0:1773851902.516479:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000afd5d76e.
00000400:00000200:29.0:1773851902.516479:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000147989c0
00000400:00000010:29.0:1773851902.516479:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000147989c0.
00000020:00000040:30.0:1773851902.516480:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000efb06e4b : new refcount 4
00000100:00000001:29.0:1773851902.516480:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851902.516480:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:30.0:1773851902.516481:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851902.516481:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ec7581b9 nid 19201@kfi7 refs 2
00000800:00000200:29.0:1773851902.516482:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bfd826e8: 2054@kfi7:7 -> 19201@kfi7(0000000062da1609):0x0 lsk 3387 rsk 21 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000d3a Transaction freed
00000800:00000200:29.0:1773851902.542012:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851902.542012:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851902.542014:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851902.542015:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851902.542017:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.542018:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9585@kfi7 : PUT - for me
00000400:00000200:29.0:1773851902.542019:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.542020:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 1
00000400:00000200:29.0:1773851902.542021:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.542021:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000400:00000200:29.0:1773851902.542022:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 3
00000400:00000200:29.0:1773851902.542023:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.542023:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9585@kfi7 of length 224 into portal 12 MB=0x69aa079dc2800
00000400:00000200:29.0:1773851902.542024:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9585@kfi7 of length 224/224 into md 0x77fe1859d [64] + 12640
00000800:00000200:29.0:1773851902.542026:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851902.542027:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851902.542028:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9585@kfi7: PUT: OK
00000100:00000001:29.0:1773851902.542028:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851902.542029:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851902.542029:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ab0012af.
00000100:00000040:29.0:1773851902.542030:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000ab0012af x1858863890180096 msgsize 224
00000100:00100000:29.0:1773851902.542031:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-9585@kfi7 (source: 12345-9585@kfi7)
00000100:00000001:29.0:1773851902.542032:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851902.542033:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000100:00000001:30.0:1773851902.542034:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851902.542034:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851902.542035:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851902.542035:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851902.542035:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:30.0:1773851902.542036:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851902.542036:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890180096
00000020:00000001:30.0:1773851902.542037:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851902.542037:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90cf7
00000020:00000001:30.0:1773851902.542038:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851902.542041:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b12b325 refcount=6
00000020:00000001:30.0:1773851902.542041:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636937395721216 : -107136313830400 : ffff9e8f62125400)
00000020:00000001:30.0:1773851902.542042:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636937395721216 : -107136313830400 : ffff9e8f62125400)
00000100:00000001:30.0:1773851902.542043:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851902.542044:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851902.542044:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851902.542045:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851902.542046:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ec1fc6c0.
00000100:00000001:30.0:1773851902.542047:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851902.542047:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851902.542048:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851902.542049:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851902.542049:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851902.542050:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.542051:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.542052:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851902.542052:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851902.542052:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851902.542053:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851902.542053:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9585@kfi7, seq: 2055610
00000100:00000001:31.0:1773851902.542054:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.542054:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851902.542054:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b12b325 : new rpc_count 1
00000100:00000001:30.0:1773851902.542054:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208518016 : -106943501033600 : ffff9ebc469c1f80)
00000100:00000040:30.0:1773851902.542055:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ab0012af x1858863890180096/t0(0) o400->af2b1efd-c372-4639-aa69-7d778f8db008@9585@kfi7:690/0 lens 224/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1086-0'
00000100:00000001:30.0:1773851902.542058:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851902.542058:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851902.542059:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab0012af pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:af2b1efd-c372-4639-aa69-7d778f8db008+6:39117:x1858863890180096:12345-9585@kfi7:400:default-tuolumne1086-0
00000100:00000200:30.0:1773851902.542060:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890180096
00000020:00000001:30.0:1773851902.542061:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851902.542061:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851902.542062:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.542062:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851902.542063:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851902.542063:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851902.542064:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890180096, found 0 last_xid 1858863890180095
00000020:00000001:30.0:1773851902.542065:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851902.542065:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851902.542065:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851902.542066:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.542066:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851902.542067:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851902.542067:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851902.542068:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000049bbe91b.
02000000:00000001:30.0:1773851902.542068:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.542069:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.542069:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851902.542070:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475272608, transno 0, xid 1858863890180096
00010000:00000001:30.0:1773851902.542071:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851902.542071:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ab0012af x1858863890180096/t0(0) o400->af2b1efd-c372-4639-aa69-7d778f8db008@9585@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1086-0'
00010000:00000001:30.0:1773851902.542074:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851902.542074:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851902.542075:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=135 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851902.542076:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851902.542076:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a8e7c881 refcount 3 to 9585@kfi7
00000100:00000001:30.0:1773851902.542077:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063840 : -107155994487776 : ffff9e8acd035420)
02000000:00000001:30.0:1773851902.542078:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851902.542078:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.542079:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851902.542079:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9585@kfi7
00000400:00000010:30.0:1773851902.542080:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ea7638e8.
00000100:00000200:30.0:1773851902.542081:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890180096, offset 224
00000400:00000200:30.0:1773851902.542082:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9585@kfi7
00000400:00000200:30.0:1773851902.542083:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:30.0:1773851902.542083:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 1
00000400:00000200:30.0:1773851902.542084:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000400:00000200:30.0:1773851902.542085:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 3
00000400:00000200:30.0:1773851902.542086:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9585@kfi7 local destination
00000400:00000200:30.0:1773851902.542087:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770429:8770429:1024:4294967295] 9585@kfi7 LPNI seq info [17389:17389:16:4294967295]
00000400:00000200:30.0:1773851902.542089:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000400:00000200:30.0:1773851902.542090:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9585@kfi7 to cpt 7
00000400:00000200:30.0:1773851902.542091:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9585@kfi7(9585@kfi7:9585@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851902.542092:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 3
00000800:00000200:30.0:1773851902.542094:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851902.542095:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851902.542097:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851902.542100:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x690 Using peer 9585@kfi7(0x690)
00000800:00000200:30.0:1773851902.542103:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x690: rc=0
00000800:00000200:30.0:1773851902.542105:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x690 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851902.542107:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851902.542107:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a8e7c881 refcount 2 to 9585@kfi7
00010000:00000001:30.0:1773851902.542108:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851902.542109:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.542109:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851902.542110:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ab0012af x1858863890180096/t0(0) o400->af2b1efd-c372-4639-aa69-7d778f8db008@9585@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1086-0'
00000100:00100000:30.0:1773851902.542113:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab0012af pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:af2b1efd-c372-4639-aa69-7d778f8db008+6:39117:x1858863890180096:12345-9585@kfi7:400:default-tuolumne1086-0 Request processed in 55us (83us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851902.542116:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9585@kfi7, seq: 2055610
00000100:00000040:30.0:1773851902.542116:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b12b325 : new rpc_count 0
00000100:00000001:30.0:1773851902.542117:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:29.0:1773851902.542117:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x690 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851902.542118:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851902.542118:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851902.542119:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ec1fc6c0.
00000400:00000200:29.0:1773851902.542119:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851902.542120:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000020:00000040:30.0:1773851902.542120:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000004b12b325 : new refcount 5
00000400:00000200:29.0:1773851902.542120:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9585@kfi7: PUT: OK
00000100:00000001:30.0:1773851902.542121:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851902.542121:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ea7638e8
00000400:00000010:29.0:1773851902.542122:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ea7638e8.
00000100:00000001:29.0:1773851902.542122:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851902.542123:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851902.542124:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000009c184a7 nid 9585@kfi7 refs 2
00000800:00000200:29.0:1773851902.542125:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 9585@kfi7(000000009b03507a):0x0 lsk 1681 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x690 Transaction freed
00000800:00000200:9.0:1773851902.544273:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.544275:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851902.544278:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851902.544281:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.544281:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 23666@kfi7(00000000e2bab552):0x1064 version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851902.544282:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851902.544285:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851902.544286:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 Using peer 23666@kfi7(0x1064)
00000800:00000200:10.0:1773851902.544289:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851902.544289:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23666@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.544292:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23666@kfi7 to cpt 2
00000800:00000200:9.0:1773851902.544293:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000009d546266: Posted send of 38 bytes to peer 0x1064: rc=0
00000400:00000200:10.0:1773851902.544295:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23666@kfi7 : PUT - for me
00000800:00000200:9.0:1773851902.544295:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851902.544297:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23666@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.544299:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d41ae15 nid 23666@kfi7 refs 1
00000400:00000200:10.0:1773851902.544301:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23666@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.544302:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d41ae15 nid 23666@kfi7 refs 2
00000400:00000200:10.0:1773851902.544304:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002d41ae15 nid 23666@kfi7 refs 3
00000400:00000200:10.0:1773851902.544306:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23667@kfi7 to cpt 6
00000400:00000200:10.0:1773851902.544307:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23667@kfi7 of length 224 into portal 12 MB=0x699e0d3972d40
00000800:00000200:9.0:1773851902.544309:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851902.544310:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23667@kfi7 of length 224/224 into md 0x78146ce49 [64] + 168016
00000800:00000200:10.0:1773851902.544313:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851902.544313:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009d546266: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 Transaction freed
00000400:00000200:10.0:1773851902.544316:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851902.544318:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23666@kfi7: PUT: OK
00000100:00000001:10.0:1773851902.544320:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851902.544321:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:10.0:1773851902.544322:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bdd23aba.
00000100:00000040:10.0:1773851902.544323:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000bdd23aba x1858040761888064 msgsize 224
00000100:00100000:10.0:1773851902.544326:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-23667@kfi7 (source: 12345-23666@kfi7)
00000100:00000001:10.0:1773851902.544328:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851902.544330:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002d41ae15 nid 23666@kfi7 refs 2
00000100:00000001:9.0:1773851902.544331:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851902.544332:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2069@kfi7:2 <- 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:9.0:1773851902.544332:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:9.0:1773851902.544333:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851902.544334:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851902.544336:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851902.544337:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040761888064
00000020:00000001:9.0:1773851902.544339:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:9.0:1773851902.544340:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92068
00000020:00000001:9.0:1773851902.544341:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:9.0:1773851902.544346:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000020e4e4b4 refcount=6
00000020:00000001:9.0:1773851902.544347:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629507072 : -107123080044544 : ffff9e9276dde000)
00000020:00000001:9.0:1773851902.544348:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629507072 : -107123080044544 : ffff9e9276dde000)
00000100:00000001:9.0:1773851902.544350:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851902.544351:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:9.0:1773851902.544353:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000bbce3b66.
00000020:00000010:9.0:1773851902.544354:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c8fc5a75.
00000020:00000010:9.0:1773851902.544355:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004dafc563.
00000100:00000001:9.0:1773851902.544357:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:9.0:1773851902.544358:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:9.0:1773851902.544359:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851902.544361:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:9.0:1773851902.544362:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:9.0:1773851902.544362:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.544365:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851902.544366:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:9.0:1773851902.544367:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851902.544367:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851902.544368:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:9.0:1773851902.544369:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23667@kfi7, seq: 2130892
00000100:00000040:9.0:1773851902.544370:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000020e4e4b4 : new rpc_count 1
00000100:00000001:8.0:1773851902.544370:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.544371:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087750656 : -106944621800960 : ffff9ebc03ce9200)
00000100:00000001:8.0:1773851902.544371:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851902.544373:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bdd23aba x1858040761888064/t0(0) o400->28adea76-dedb-4857-8cc9-30f2a67bcaa5@23667@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1962-0'
00000100:00000001:9.0:1773851902.544378:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:9.0:1773851902.544378:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:9.0:1773851902.544380:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bdd23aba pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:28adea76-dedb-4857-8cc9-30f2a67bcaa5+6:39649:x1858040761888064:12345-23667@kfi7:400:default-tuolumne1962-0
00000100:00000200:9.0:1773851902.544382:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040761888064
00000020:00000001:9.0:1773851902.544383:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:9.0:1773851902.544384:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:9.0:1773851902.544385:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.544386:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:9.0:1773851902.544387:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:9.0:1773851902.544388:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:9.0:1773851902.544389:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040761888064, found 0 last_xid 1858040761888063
00000020:00000001:9.0:1773851902.544390:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:9.0:1773851902.544391:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:9.0:1773851902.544392:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:9.0:1773851902.544393:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.544394:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:9.0:1773851902.544395:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:9.0:1773851902.544396:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:9.0:1773851902.544397:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006b11b374.
02000000:00000001:9.0:1773851902.544398:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.544399:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.544400:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:9.0:1773851902.544401:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181817315201, transno 0, xid 1858040761888064
00010000:00000001:9.0:1773851902.544402:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:9.0:1773851902.544403:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bdd23aba x1858040761888064/t0(0) o400->28adea76-dedb-4857-8cc9-30f2a67bcaa5@23667@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1962-0'
00010000:00000001:9.0:1773851902.544409:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:9.0:1773851902.544410:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851902.544411:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=135 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851902.544413:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:9.0:1773851902.544414:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000831189aa refcount 3 to 23667@kfi7
00000100:00000001:9.0:1773851902.544415:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130859360 : -107149578692256 : ffff9e8c4b6c9960)
02000000:00000001:9.0:1773851902.544416:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:9.0:1773851902.544417:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.544418:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:9.0:1773851902.544419:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23666@kfi7
00000400:00000010:9.0:1773851902.544420:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003d28ebe7.
00000100:00000200:9.0:1773851902.544421:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040761888064, offset 224
00000400:00000200:9.0:1773851902.544424:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23666@kfi7
00000400:00000200:9.0:1773851902.544425:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23666@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.544426:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002d41ae15 nid 23666@kfi7 refs 1
00000400:00000200:9.0:1773851902.544428:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002d41ae15 nid 23666@kfi7 refs 2
00000400:00000200:9.0:1773851902.544429:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002d41ae15 nid 23666@kfi7 refs 3
00000400:00000200:9.0:1773851902.544431:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23666@kfi7 local destination
00000400:00000200:9.0:1773851902.544433:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770430:8770430:1024:4294967295] 23666@kfi7 LPNI seq info [178993:178993:16:4294967295]
00000400:00000200:9.0:1773851902.544436:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002d41ae15 nid 23666@kfi7 refs 2
00000400:00000200:9.0:1773851902.544437:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23666@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.544440:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23666@kfi7(23666@kfi7:23666@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851902.544442:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002d41ae15 nid 23666@kfi7 refs 3
00000800:00000200:9.0:1773851902.544444:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.544446:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:9.0:1773851902.544449:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851902.544453:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 Using peer 23666@kfi7(0x1064)
00000800:00000200:9.0:1773851902.544460:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000009d546266: Posted send of 324 bytes to peer 0x1064: rc=0
00000800:00000200:9.0:1773851902.544462:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851902.544465:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:9.0:1773851902.544467:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000831189aa refcount 2 to 23667@kfi7
00010000:00000001:9.0:1773851902.544468:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:9.0:1773851902.544469:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.544470:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:9.0:1773851902.544471:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bdd23aba x1858040761888064/t0(0) o400->28adea76-dedb-4857-8cc9-30f2a67bcaa5@23667@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1962-0'
00000800:00000200:10.0:1773851902.544476:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 TN_EVENT_TX_OK event status 0
00000100:00100000:9.0:1773851902.544476:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bdd23aba pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:28adea76-dedb-4857-8cc9-30f2a67bcaa5+6:39649:x1858040761888064:12345-23667@kfi7:400:default-tuolumne1962-0 Request processed in 97us (152us total) trans 0 rc 0/0
00000400:00000200:10.0:1773851902.544479:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851902.544480:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23666@kfi7: PUT: OK
00000100:00100000:9.0:1773851902.544480:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23667@kfi7, seq: 2130892
00000100:00000040:9.0:1773851902.544481:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000020e4e4b4 : new rpc_count 0
00000400:00000200:10.0:1773851902.544482:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003d28ebe7
00000400:00000010:10.0:1773851902.544482:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003d28ebe7.
00000100:00000001:9.0:1773851902.544482:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:10.0:1773851902.544483:0:2464469:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851902.544483:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:10.0:1773851902.544484:0:2464469:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:9.0:1773851902.544484:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c8fc5a75.
00000400:00000200:10.0:1773851902.544485:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002d41ae15 nid 23666@kfi7 refs 2
00000020:00000010:9.0:1773851902.544485:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004dafc563.
00000020:00000010:9.0:1773851902.544487:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000bbce3b66.
00000800:00000200:10.0:1773851902.544488:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009d546266: 2069@kfi7:2 -> 23666@kfi7(00000000e2bab552):0x0 lsk 4197 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1064 Transaction freed
00000020:00000040:9.0:1773851902.544488:0:60898:0:(genops.c:882:class_export_put()) PUTting export 0000000020e4e4b4 : new refcount 5
00000100:00000001:9.0:1773851902.544489:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851902.550188:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.550189:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.550190:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.550192:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851902.550194:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.550195:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 22147@kfi7 : PUT - for me
00000400:00000200:5.0:1773851902.550196:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.550197:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 1
00000400:00000200:5.0:1773851902.550198:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.550199:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000400:00000200:5.0:1773851902.550200:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 3
00000400:00000200:5.0:1773851902.550201:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22146@kfi7 to cpt 6
00000400:00000200:5.0:1773851902.550202:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22146@kfi7 of length 224 into portal 12 MB=0x699e2c36511c0
00000400:00000200:5.0:1773851902.550203:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22146@kfi7 of length 224/224 into md 0x793926dc5 [64] + 168008
00000800:00000200:5.0:1773851902.550205:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851902.550206:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.550207:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22147@kfi7: PUT: OK
00000100:00000001:5.0:1773851902.550208:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851902.550209:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851902.550210:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e7f0e5ab.
00000100:00000040:5.0:1773851902.550210:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000e7f0e5ab x1858049080103360 msgsize 224
00000100:00100000:5.0:1773851902.550212:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-22146@kfi7 (source: 12345-22147@kfi7)
00000100:00000001:5.0:1773851902.550213:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.550214:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000800:00000200:5.0:1773851902.550215:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2069@kfi7:1 <- 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851902.550216:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851902.550216:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851902.550217:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851902.550218:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851902.550219:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.550220:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858049080103360
00000020:00000001:4.0:1773851902.550221:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851902.550222:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac929b4
00000020:00000001:4.0:1773851902.550223:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851902.550227:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000827577a3 refcount=3453
00000020:00000001:4.0:1773851902.550228:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743199744 : -107128966351872 : ffff9e911803f400)
00000020:00000001:4.0:1773851902.550229:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743199744 : -107128966351872 : ffff9e911803f400)
00000100:00000001:4.0:1773851902.550231:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.550232:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851902.550233:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060f2dc04.
00000020:00000010:4.0:1773851902.550234:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.550236:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000089183453.
00000100:00000001:4.0:1773851902.550237:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851902.550238:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851902.550239:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.550240:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851902.550242:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851902.550243:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.550244:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.550246:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851902.550247:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.550247:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851902.550248:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851902.550249:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22146@kfi7, seq: 2002005
00000100:00000001:7.0:1773851902.550250:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.550250:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000827577a3 : new rpc_count 10
00000100:00000001:7.0:1773851902.550251:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.550251:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569665024 : -106988139886592 : ffff9eb1e1ed4800)
00000100:00000040:4.0:1773851902.550253:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e7f0e5ab x1858049080103360/t0(0) o400->1ba86d43-3adb-487b-b509-2e31a79a43c3@22146@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1880-0'
00000100:00000001:4.0:1773851902.550258:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.550258:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851902.550260:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e7f0e5ab pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1ba86d43-3adb-487b-b509-2e31a79a43c3+3453:39644:x1858049080103360:12345-22146@kfi7:400:default-tuolumne1880-0
00000100:00000200:4.0:1773851902.550262:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858049080103360
00000020:00000001:4.0:1773851902.550262:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851902.550263:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851902.550264:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.550264:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851902.550265:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851902.550266:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851902.550266:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858049080103360, found 0 last_xid 1858049079317567
00000020:00000001:4.0:1773851902.550267:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851902.550268:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851902.550268:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851902.550269:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.550269:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851902.550270:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851902.550271:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851902.550271:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009850140b.
02000000:00000001:4.0:1773851902.550272:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.550273:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.550274:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851902.550274:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593460, transno 0, xid 1858049080103360
00010000:00000001:4.0:1773851902.550276:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851902.550276:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e7f0e5ab x1858049080103360/t0(0) o400->1ba86d43-3adb-487b-b509-2e31a79a43c3@22146@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1880-0'
00010000:00000001:4.0:1773851902.550279:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851902.550280:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851902.550281:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851902.550282:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851902.550283:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004f1b770b refcount 3 to 22146@kfi7
00000100:00000001:4.0:1773851902.550284:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329472 : -107155410222144 : ffff9e8aefd683c0)
02000000:00000001:4.0:1773851902.550285:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851902.550285:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.550286:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851902.550287:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22147@kfi7
00000400:00000010:4.0:1773851902.550288:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009ae139dd.
00000100:00000200:4.0:1773851902.550289:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858049080103360, offset 224
00000400:00000200:4.0:1773851902.550290:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22147@kfi7
00000400:00000200:4.0:1773851902.550291:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.550292:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 1
00000400:00000200:4.0:1773851902.550293:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000400:00000200:4.0:1773851902.550294:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 3
00000400:00000200:4.0:1773851902.550295:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  22147@kfi7 local destination
00000400:00000200:4.0:1773851902.550297:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770431:8770431:1024:4294967295] 22147@kfi7 LPNI seq info [12849565:12849565:16:4294967295]
00000400:00000200:4.0:1773851902.550299:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000400:00000200:4.0:1773851902.550300:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22147@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.550302:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 22147@kfi7(22147@kfi7:22147@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851902.550304:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 3
00000800:00000200:4.0:1773851902.550305:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851902.550307:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851902.550309:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851902.550313:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b8 Using peer 22147@kfi7(0x3b8)
00000800:00000200:4.0:1773851902.550316:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x3b8: rc=0
00000800:00000200:4.0:1773851902.550317:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851902.550319:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.550320:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004f1b770b refcount 2 to 22146@kfi7
00010000:00000001:4.0:1773851902.550321:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851902.550321:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.550322:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851902.550322:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e7f0e5ab x1858049080103360/t0(0) o400->1ba86d43-3adb-487b-b509-2e31a79a43c3@22146@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1880-0'
00000100:00100000:4.0:1773851902.550327:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e7f0e5ab pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:1ba86d43-3adb-487b-b509-2e31a79a43c3+3453:39644:x1858049080103360:12345-22146@kfi7:400:default-tuolumne1880-0 Request processed in 68us (116us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851902.550329:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22146@kfi7, seq: 2002005
00000100:00000040:4.0:1773851902.550330:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000827577a3 : new rpc_count 9
00000100:00000001:4.0:1773851902.550331:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851902.550331:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851902.550332:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.550333:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000089183453.
00000020:00000010:4.0:1773851902.550333:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060f2dc04.
00000020:00000040:4.0:1773851902.550334:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000827577a3 : new refcount 3452
00000100:00000001:4.0:1773851902.550335:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851902.550340:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b8 TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851902.550342:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851902.550343:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->22147@kfi7: PUT: OK
00000400:00000200:6.0:1773851902.550344:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009ae139dd
00000400:00000010:6.0:1773851902.550345:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009ae139dd.
00000100:00000001:6.0:1773851902.550346:0:2499722:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:6.0:1773851902.550346:0:2499722:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:6.0:1773851902.550347:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001de00ab1 nid 22147@kfi7 refs 2
00000800:00000200:6.0:1773851902.550349:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2069@kfi7:1 -> 22147@kfi7(00000000e640dd84):0x0 lsk 953 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b8 Transaction freed
00000800:00000200:5.0:1773851902.560528:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.560528:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:5.0:1773851902.560530:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:5.0:1773851902.560533:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 10866@kfi7(0000000033ae3e67):0xf90 version: 2; local version 2; negotiated version: 2
00000800:00000200:5.0:1773851902.560534:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 Using peer 10866@kfi7(0x100000000000f90)
00000400:00000200:5.0:1773851902.560536:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10866@kfi7 to cpt 1
00000800:00000200:5.0:1773851902.560538:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000ab24271c: Posted send of 38 bytes to peer 0x100000000000f90: rc=0
00000800:00000200:5.0:1773851902.560539:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:5.0:1773851902.560545:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.560546:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.560547:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.560549:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851902.560550:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10866@kfi7 to cpt 1
00000800:00000200:6.0:1773851902.560551:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851902.560551:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 10866@kfi7 : PUT - for me
00000400:00000200:5.0:1773851902.560552:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10866@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.560553:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cebdaec nid 10866@kfi7 refs 1
00000800:00000200:6.0:1773851902.560554:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ab24271c: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 Transaction freed
00000400:00000200:5.0:1773851902.560554:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10866@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.560554:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cebdaec nid 10866@kfi7 refs 2
00000400:00000200:5.0:1773851902.560555:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000cebdaec nid 10866@kfi7 refs 3
00000400:00000200:5.0:1773851902.560556:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10867@kfi7 to cpt 4
00000400:00000200:5.0:1773851902.560557:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10867@kfi7 of length 224 into portal 12 MB=0x69b563ef2bd00
00000400:00000200:5.0:1773851902.560558:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10867@kfi7 of length 224/224 into md 0x793926dc5 [64] + 168232
00000800:00000200:5.0:1773851902.560559:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851902.560561:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.560562:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10866@kfi7: PUT: OK
00000100:00000001:5.0:1773851902.560562:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851902.560563:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851902.560564:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ee7cf13c.
00000100:00000040:5.0:1773851902.560565:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ee7cf13c x1859644585852160 msgsize 224
00000100:00100000:5.0:1773851902.560566:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10867@kfi7 (source: 12345-10866@kfi7)
00000100:00000001:5.0:1773851902.560566:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.560567:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000cebdaec nid 10866@kfi7 refs 2
00000100:00000001:4.0:1773851902.560568:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851902.560568:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851902.560569:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851902.560569:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851902.560569:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851902.560570:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.560570:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859644585852160
00000020:00000001:4.0:1773851902.560571:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851902.560571:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07fcc9e2228
00000020:00000001:4.0:1773851902.560573:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851902.560576:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000042a48808 refcount=5
00000020:00000001:4.0:1773851902.560576:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637148937019392 : -106924772532224 : ffff9ec0a2ea6000)
00000020:00000001:4.0:1773851902.560577:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637148937019392 : -106924772532224 : ffff9ec0a2ea6000)
00000100:00000001:4.0:1773851902.560578:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.560579:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851902.560579:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060f2dc04.
00000020:00000010:4.0:1773851902.560580:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.560580:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000089183453.
00000100:00000001:4.0:1773851902.560581:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851902.560581:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851902.560582:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.560583:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851902.560583:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851902.560583:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.560584:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.560585:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.560585:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851902.560586:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851902.560586:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851902.560586:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10867@kfi7, seq: 2002006
00000100:00000001:7.0:1773851902.560587:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851902.560587:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.560587:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000042a48808 : new rpc_count 1
00000100:00000001:4.0:1773851902.560588:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569654656 : -106988139896960 : ffff9eb1e1ed1f80)
00000100:00000040:4.0:1773851902.560589:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ee7cf13c x1859644585852160/t0(0) o400->6310648f-13f0-4c64-b7ff-37db3addf14e@10867@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1162-0'
00000100:00000001:4.0:1773851902.560591:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.560592:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851902.560592:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ee7cf13c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6310648f-13f0-4c64-b7ff-37db3addf14e+5:39560:x1859644585852160:12345-10867@kfi7:400:default-tuolumne1162-0
00000100:00000200:4.0:1773851902.560594:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859644585852160
00000020:00000001:4.0:1773851902.560594:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851902.560595:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851902.560595:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.560596:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851902.560596:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851902.560598:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851902.560598:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859644585852160, found 0 last_xid 1859644585852159
00000020:00000001:4.0:1773851902.560599:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851902.560600:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851902.560600:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851902.560600:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.560601:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851902.560601:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851902.560602:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851902.560602:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a04166bf.
02000000:00000001:4.0:1773851902.560603:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.560603:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.560604:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851902.560604:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096683842, transno 0, xid 1859644585852160
00010000:00000001:4.0:1773851902.560605:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851902.560606:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ee7cf13c x1859644585852160/t0(0) o400->6310648f-13f0-4c64-b7ff-37db3addf14e@10867@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1162-0'
00010000:00000001:4.0:1773851902.560608:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851902.560608:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851902.560609:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851902.560610:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851902.560610:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000074a2eafb refcount 3 to 10867@kfi7
00000100:00000001:4.0:1773851902.560611:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363992032 : -107142345559584 : ffff9e8dfa8d71e0)
02000000:00000001:4.0:1773851902.560612:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851902.560612:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.560613:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851902.560613:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10866@kfi7
00000400:00000010:4.0:1773851902.560614:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000062ec508f.
00000100:00000200:4.0:1773851902.560614:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859644585852160, offset 224
00000400:00000200:4.0:1773851902.560615:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10866@kfi7
00000400:00000200:4.0:1773851902.560616:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10866@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.560617:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000cebdaec nid 10866@kfi7 refs 1
00000400:00000200:4.0:1773851902.560618:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000cebdaec nid 10866@kfi7 refs 2
00000400:00000200:4.0:1773851902.560619:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000cebdaec nid 10866@kfi7 refs 3
00000400:00000200:4.0:1773851902.560620:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  10866@kfi7 local destination
00000400:00000200:4.0:1773851902.560622:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770432:8770432:1024:4294967295] 10866@kfi7 LPNI seq info [280092:280092:16:4294967295]
00000400:00000200:4.0:1773851902.560623:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000cebdaec nid 10866@kfi7 refs 2
00000400:00000200:4.0:1773851902.560624:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10866@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.560626:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 10866@kfi7(10866@kfi7:10866@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851902.560627:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000cebdaec nid 10866@kfi7 refs 3
00000800:00000200:4.0:1773851902.560628:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851902.560629:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851902.560631:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851902.560633:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 Using peer 10866@kfi7(0x100000000000f90)
00000800:00000200:4.0:1773851902.560635:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000006e41a4d6: Posted send of 324 bytes to peer 0x100000000000f90: rc=0
00000800:00000200:4.0:1773851902.560636:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851902.560638:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.560639:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000074a2eafb refcount 2 to 10867@kfi7
00010000:00000001:4.0:1773851902.560639:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851902.560640:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.560640:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851902.560641:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ee7cf13c x1859644585852160/t0(0) o400->6310648f-13f0-4c64-b7ff-37db3addf14e@10867@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1162-0'
00000100:00100000:4.0:1773851902.560645:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ee7cf13c pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6310648f-13f0-4c64-b7ff-37db3addf14e+5:39560:x1859644585852160:12345-10867@kfi7:400:default-tuolumne1162-0 Request processed in 53us (80us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851902.560647:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10867@kfi7, seq: 2002006
00000100:00000040:4.0:1773851902.560648:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000042a48808 : new rpc_count 0
00000100:00000001:4.0:1773851902.560649:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851902.560649:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851902.560650:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.560650:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000089183453.
00000020:00000010:4.0:1773851902.560651:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060f2dc04.
00000020:00000040:4.0:1773851902.560652:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000042a48808 : new refcount 4
00000100:00000001:4.0:1773851902.560652:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851902.560657:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851902.560659:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.560659:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->10866@kfi7: PUT: OK
00000400:00000200:5.0:1773851902.560660:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000062ec508f
00000400:00000010:5.0:1773851902.560660:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000062ec508f.
00000100:00000001:5.0:1773851902.560661:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851902.560661:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851902.560662:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000cebdaec nid 10866@kfi7 refs 2
00000800:00000200:5.0:1773851902.560664:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e41a4d6: 2054@kfi7:1 -> 10866@kfi7(0000000033ae3e67):0x0 lsk 3985 rsk 16 tsk 0 trmk 0 tmk 0 trr 1 tta 0x100000000000f90 Transaction freed
00000800:00000200:18.0:1773851902.601603:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851902.601604:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851902.601606:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851902.601608:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851902.601610:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.601611:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16433@kfi7 : PUT - for me
00000400:00000200:18.0:1773851902.601612:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.601613:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 1
00000400:00000200:18.0:1773851902.601615:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.601615:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000400:00000200:18.0:1773851902.601616:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 3
00000400:00000200:18.0:1773851902.601617:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.601618:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16433@kfi7 of length 224 into portal 12 MB=0x69b4b9555d940
00000400:00000200:18.0:1773851902.601620:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16433@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 50616
00000800:00000200:18.0:1773851902.601622:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851902.601623:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851902.601624:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16433@kfi7: PUT: OK
00000100:00000001:18.0:1773851902.601625:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851902.601626:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851902.601627:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b6a81fc2.
00000100:00000040:18.0:1773851902.601627:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000b6a81fc2 x1859598790547776 msgsize 224
00000100:00100000:18.0:1773851902.601629:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-16433@kfi7 (source: 12345-16433@kfi7)
00000100:00000001:18.0:1773851902.601630:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851902.601631:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000100:00000001:19.0:1773851902.601633:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851902.601633:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851902.601634:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851902.601634:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851902.601635:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851902.601637:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851902.601638:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598790547776
00000020:00000001:19.0:1773851902.601639:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851902.601639:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3894fd9b
00000020:00000001:19.0:1773851902.601640:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851902.601643:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b7c861d7 refcount=5
00000020:00000001:19.0:1773851902.601645:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130631108608 : -106943078443008 : ffff9ebc5fcc5800)
00000020:00000001:19.0:1773851902.601646:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130631108608 : -106943078443008 : ffff9ebc5fcc5800)
00000100:00000001:19.0:1773851902.601647:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851902.601648:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851902.601649:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000009e07516.
00000020:00000010:19.0:1773851902.601651:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851902.601653:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000c89cf037.
00000100:00000001:19.0:1773851902.601654:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851902.601655:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851902.601656:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851902.601657:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851902.601658:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851902.601659:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.601660:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851902.601662:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851902.601662:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851902.601662:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851902.601663:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851902.601664:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16433@kfi7, seq: 2156448
00000100:00000001:19.0:1773851902.601665:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851902.601665:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b7c861d7 : new rpc_count 1
00000100:00000001:19.0:1773851902.601666:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851902.601666:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609972352 : -107015099579264 : ffff9eab9b010480)
00000100:00000040:16.0:1773851902.601667:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b6a81fc2 x1859598790547776/t0(0) o400->e54702dc-7b2d-4df9-9c3f-fd083857bb92@16433@kfi7:154/0 lens 224/0 e 0 to 0 dl 1773852269 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1517-0'
00000100:00000001:16.0:1773851902.601673:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851902.601674:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851902.601675:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b6a81fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e54702dc-7b2d-4df9-9c3f-fd083857bb92+5:39543:x1859598790547776:12345-16433@kfi7:400:default-tuolumne1517-0
00000100:00000200:16.0:1773851902.601676:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598790547776
00000020:00000001:16.0:1773851902.601677:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851902.601677:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851902.601678:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851902.601679:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851902.601679:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851902.601680:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851902.601681:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598790547776, found 0 last_xid 1859598790547775
00000020:00000001:16.0:1773851902.601682:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851902.601682:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851902.601683:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851902.601684:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851902.601684:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851902.601685:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851902.601686:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851902.601687:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000a80febe.
02000000:00000001:16.0:1773851902.601687:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851902.601688:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851902.601689:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851902.601690:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044139343, transno 0, xid 1859598790547776
00010000:00000001:16.0:1773851902.601691:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851902.601692:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b6a81fc2 x1859598790547776/t0(0) o400->e54702dc-7b2d-4df9-9c3f-fd083857bb92@16433@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1517-0'
00010000:00000001:16.0:1773851902.601694:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851902.601695:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851902.601695:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=135 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851902.601697:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851902.601697:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000962f1278 refcount 3 to 16433@kfi7
00000100:00000001:16.0:1773851902.601698:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095775072 : -107152613776544 : ffff9e8b9684e360)
02000000:00000001:16.0:1773851902.601700:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851902.601700:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851902.601701:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851902.601702:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16433@kfi7
00000400:00000010:16.0:1773851902.601702:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000090de02a.
00000100:00000200:16.0:1773851902.601703:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598790547776, offset 224
00000400:00000200:16.0:1773851902.601705:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16433@kfi7
00000400:00000200:16.0:1773851902.601706:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:16.0:1773851902.601707:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 1
00000400:00000200:16.0:1773851902.601707:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000400:00000200:16.0:1773851902.601709:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 3
00000400:00000200:16.0:1773851902.601710:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16433@kfi7 local destination
00000400:00000200:16.0:1773851902.601711:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770433:8770433:1024:4294967295] 16433@kfi7 LPNI seq info [384797:384797:16:4294967295]
00000400:00000200:16.0:1773851902.601713:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000400:00000200:16.0:1773851902.601713:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16433@kfi7 to cpt 4
00000400:00000200:16.0:1773851902.601715:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16433@kfi7(16433@kfi7:16433@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851902.601716:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 3
00000800:00000200:16.0:1773851902.601718:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851902.601719:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851902.601721:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851902.601723:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000986 Using peer 16433@kfi7(0x100000000000986)
00000800:00000200:16.0:1773851902.601731:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000d6bb7f4b: Posted send of 324 bytes to peer 0x100000000000986: rc=0
00000800:00000200:16.0:1773851902.601733:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000986 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851902.601735:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851902.601736:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000962f1278 refcount 2 to 16433@kfi7
00010000:00000001:16.0:1773851902.601737:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851902.601738:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851902.601738:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851902.601739:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b6a81fc2 x1859598790547776/t0(0) o400->e54702dc-7b2d-4df9-9c3f-fd083857bb92@16433@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1517-0'
00000100:00100000:16.0:1773851902.601744:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b6a81fc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:e54702dc-7b2d-4df9-9c3f-fd083857bb92+5:39543:x1859598790547776:12345-16433@kfi7:400:default-tuolumne1517-0 Request processed in 70us (115us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851902.601746:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16433@kfi7, seq: 2156448
00000100:00000040:16.0:1773851902.601747:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b7c861d7 : new rpc_count 0
00000100:00000001:16.0:1773851902.601748:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851902.601749:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851902.601749:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:16.0:1773851902.601750:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000c89cf037.
00000020:00000010:16.0:1773851902.601751:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000009e07516.
00000020:00000040:16.0:1773851902.601752:0:61039:0:(genops.c:882:class_export_put()) PUTting export 00000000b7c861d7 : new refcount 4
00000100:00000001:16.0:1773851902.601753:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851902.601759:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000986 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851902.601761:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851902.601762:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16433@kfi7: PUT: OK
00000400:00000200:18.0:1773851902.601763:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000090de02a
00000400:00000010:18.0:1773851902.601764:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000090de02a.
00000100:00000001:18.0:1773851902.601764:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851902.601765:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851902.601766:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c8a7247a nid 16433@kfi7 refs 2
00000800:00000200:18.0:1773851902.601767:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d6bb7f4b: 2054@kfi7:4 -> 16433@kfi7(000000001ef0965c):0x0 lsk 2439 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000986 Transaction freed
00000800:00000200:25.0:1773851902.647768:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851902.647769:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851902.647770:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851902.647773:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851902.647774:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851902.647775:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22675@kfi7 : PUT - for me
00000400:00000200:25.0:1773851902.647777:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851902.647778:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 1
00000400:00000200:25.0:1773851902.647779:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851902.647779:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000400:00000200:25.0:1773851902.647780:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 3
00000400:00000200:25.0:1773851902.647781:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:25.0:1773851902.647782:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22675@kfi7 of length 224 into portal 12 MB=0x699e18d2ce700
00000400:00000200:25.0:1773851902.647783:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22675@kfi7 of length 224/224 into md 0x16159c9699 [64] + 44712
00000800:00000200:25.0:1773851902.647785:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851902.647787:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851902.647788:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22675@kfi7: PUT: OK
00000100:00000001:25.0:1773851902.647789:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851902.647789:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851902.647790:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cb6fe2e.
00000100:00000040:25.0:1773851902.647791:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000007cb6fe2e x1858043875485440 msgsize 224
00000100:00100000:25.0:1773851902.647792:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-22675@kfi7 (source: 12345-22675@kfi7)
00000100:00000001:25.0:1773851902.647793:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851902.647794:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000100:00000001:26.0:1773851902.647795:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851902.647795:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:26.0:1773851902.647796:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851902.647796:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851902.647797:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851902.647798:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851902.647798:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043875485440
00000020:00000001:26.0:1773851902.647799:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851902.647799:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9271b
00000020:00000001:26.0:1773851902.647800:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851902.647802:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000096f2e818 refcount=3490
00000020:00000001:26.0:1773851902.647803:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631267328 : -107123078284288 : ffff9e9276f8bc00)
00000020:00000001:26.0:1773851902.647804:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631267328 : -107123078284288 : ffff9e9276f8bc00)
00000100:00000001:26.0:1773851902.647804:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851902.647806:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851902.647806:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f5cb6f5.
00000020:00000010:26.0:1773851902.647807:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851902.647808:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851902.647809:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851902.647809:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851902.647810:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851902.647810:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851902.647811:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851902.647811:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.647812:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851902.647814:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851902.647814:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851902.647814:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:26.0:1773851902.647815:0:41182:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22675@kfi7, seq: 2025196
00000100:00000001:24.0:1773851902.647815:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:26.0:1773851902.647816:0:41182:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000096f2e818 : new rpc_count 56
00000100:00000001:26.0:1773851902.647816:0:41182:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157367936 : -106936552183680 : ffff9ebde4cb2880)
00000100:00000001:24.0:1773851902.647816:0:60973:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851902.647817:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007cb6fe2e x1858043875485440/t0(0) o400->634ede5b-68a2-450e-aa69-6e0526153b59@22675@kfi7:183/0 lens 224/0 e 0 to 0 dl 1773852298 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1910-0'
00000100:00000001:24.0:1773851902.647817:0:60973:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.647820:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851902.647820:0:41182:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:26.0:1773851902.647821:0:41182:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cb6fe2e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:634ede5b-68a2-450e-aa69-6e0526153b59+3490:39671:x1858043875485440:12345-22675@kfi7:400:default-tuolumne1910-0
00000100:00000200:26.0:1773851902.647823:0:41182:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043875485440
00000020:00000001:26.0:1773851902.647824:0:41182:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:26.0:1773851902.647825:0:41182:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:26.0:1773851902.647825:0:41182:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.647826:0:41182:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:26.0:1773851902.647826:0:41182:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:26.0:1773851902.647827:0:41182:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:26.0:1773851902.647828:0:41182:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043875485440, found 0 last_xid 1858043874695167
00000020:00000001:26.0:1773851902.647829:0:41182:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:26.0:1773851902.647829:0:41182:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:26.0:1773851902.647830:0:41182:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:26.0:1773851902.647830:0:41182:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.647831:0:41182:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:26.0:1773851902.647831:0:41182:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:26.0:1773851902.647832:0:41182:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:26.0:1773851902.647832:0:41182:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000043d0394d.
02000000:00000001:26.0:1773851902.647833:0:41182:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.647834:0:41182:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.647834:0:41182:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:26.0:1773851902.647835:0:41182:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593323, transno 0, xid 1858043875485440
00010000:00000001:26.0:1773851902.647836:0:41182:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:26.0:1773851902.647836:0:41182:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007cb6fe2e x1858043875485440/t0(0) o400->634ede5b-68a2-450e-aa69-6e0526153b59@22675@kfi7:183/0 lens 224/224 e 0 to 0 dl 1773852298 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1910-0'
00010000:00000001:26.0:1773851902.647839:0:41182:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:26.0:1773851902.647839:0:41182:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851902.647840:0:41182:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=135 v=313 (313 212 1 1)
00000100:00000001:26.0:1773851902.647841:0:41182:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:26.0:1773851902.647841:0:41182:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bfc8a764 refcount 3 to 22675@kfi7
00000100:00000001:26.0:1773851902.647842:0:41182:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092334720 : -107152617216896 : ffff9e8b96506480)
02000000:00000001:26.0:1773851902.647843:0:41182:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:26.0:1773851902.647843:0:41182:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851902.647844:0:41182:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851902.647845:0:41182:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22675@kfi7
00000400:00000010:26.0:1773851902.647845:0:41182:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002a370da0.
00000100:00000200:26.0:1773851902.647847:0:41182:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043875485440, offset 224
00000400:00000200:26.0:1773851902.647848:0:41182:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22675@kfi7
00000400:00000200:26.0:1773851902.647849:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:26.0:1773851902.647849:0:41182:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 1
00000400:00000200:26.0:1773851902.647850:0:41182:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000400:00000200:26.0:1773851902.647852:0:41182:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 3
00000400:00000200:26.0:1773851902.647853:0:41182:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22675@kfi7 local destination
00000400:00000200:26.0:1773851902.647854:0:41182:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770434:8770434:1024:4294967295] 22675@kfi7 LPNI seq info [23384542:23384542:16:4294967295]
00000400:00000200:26.0:1773851902.647855:0:41182:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000400:00000200:26.0:1773851902.647856:0:41182:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22675@kfi7 to cpt 6
00000400:00000200:26.0:1773851902.647858:0:41182:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22675@kfi7(22675@kfi7:22675@kfi7) <?> : PUT try# 0
00000400:00000200:26.0:1773851902.647859:0:41182:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 3
00000800:00000200:26.0:1773851902.647860:0:41182:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851902.647861:0:41182:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:26.0:1773851902.647863:0:41182:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851902.647866:0:41182:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009af Using peer 22675@kfi7(0x1000000000009af)
00000800:00000200:26.0:1773851902.647869:0:41182:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000b1d5b8e6: Posted send of 324 bytes to peer 0x1000000000009af: rc=0
00000800:00000200:26.0:1773851902.647870:0:41182:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009af TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:26.0:1773851902.647872:0:41182:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851902.647873:0:41182:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bfc8a764 refcount 2 to 22675@kfi7
00010000:00000001:26.0:1773851902.647874:0:41182:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:26.0:1773851902.647874:0:41182:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:26.0:1773851902.647875:0:41182:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:26.0:1773851902.647875:0:41182:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cb6fe2e x1858043875485440/t0(0) o400->634ede5b-68a2-450e-aa69-6e0526153b59@22675@kfi7:183/0 lens 224/224 e 0 to 0 dl 1773852298 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1910-0'
00000100:00100000:26.0:1773851902.647878:0:41182:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cb6fe2e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_001:634ede5b-68a2-450e-aa69-6e0526153b59+3490:39671:x1858043875485440:12345-22675@kfi7:400:default-tuolumne1910-0 Request processed in 58us (86us total) trans 0 rc 0/0
00000100:00100000:26.0:1773851902.647881:0:41182:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22675@kfi7, seq: 2025196
00000100:00000040:26.0:1773851902.647881:0:41182:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000096f2e818 : new rpc_count 55
00000100:00000001:26.0:1773851902.647882:0:41182:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:26.0:1773851902.647882:0:41182:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:25.0:1773851902.647882:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009af TN_EVENT_TX_OK event status 0
00000020:00000010:26.0:1773851902.647883:0:41182:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851902.647883:0:41182:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000400:00000200:25.0:1773851902.647883:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:26.0:1773851902.647884:0:41182:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f5cb6f5.
00000400:00000200:25.0:1773851902.647884:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22675@kfi7: PUT: OK
00000020:00000040:26.0:1773851902.647885:0:41182:0:(genops.c:882:class_export_put()) PUTting export 0000000096f2e818 : new refcount 3489
00000100:00000001:26.0:1773851902.647885:0:41182:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:25.0:1773851902.647885:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002a370da0
00000400:00000010:25.0:1773851902.647885:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002a370da0.
00000100:00000001:25.0:1773851902.647886:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851902.647886:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851902.647887:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000c57eaeb4 nid 22675@kfi7 refs 2
00000800:00000200:25.0:1773851902.647888:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b1d5b8e6: 2054@kfi7:6 -> 22675@kfi7(000000009b716e6e):0x0 lsk 2480 rsk 49 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000009af Transaction freed
00000800:00000200:9.0:1773851902.650989:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.650991:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851902.650993:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851902.650997:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851902.651000:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.651002:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.19.3.160@o2ib600 : PUT - for me
00000400:00000200:9.0:1773851902.651004:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851902.651006:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851902.651008:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.160@o2ib600 to cpt 1
00000400:00000200:9.0:1773851902.651010:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 2
00000400:00000200:9.0:1773851902.651012:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 3
00000400:00000200:9.0:1773851902.651014:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.160@o2ib600 to cpt 1
00000400:00000200:9.0:1773851902.651016:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.19.3.160@o2ib600 of length 224 into portal 12 MB=0x699f2789a1a00
00000400:00000200:9.0:1773851902.651019:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.19.3.160@o2ib600 of length 224/224 into md 0x793926dc5 [64] + 168456
00000800:00000200:9.0:1773851902.651022:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851902.651025:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851902.651027:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851902.651029:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851902.651029:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851902.651031:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000008164362.
00000100:00000040:9.0:1773851902.651032:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000008164362 x1858116544764416 msgsize 224
00000100:00100000:9.0:1773851902.651035:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.19.3.160@o2ib600 (source: 12345-172.19.3.160@o2ib600)
00000100:00000001:9.0:1773851902.651038:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851902.651039:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851902.651042:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000004481c792: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851902.651042:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851902.651043:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851902.651044:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851902.651045:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851902.651046:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.651047:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858116544764416
00000020:00000001:4.0:1773851902.651048:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851902.651049:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90dc9
00000020:00000001:4.0:1773851902.651050:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851902.651051:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000568dff62 refcount=6
00000020:00000001:4.0:1773851902.651053:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239491584 : -107152470060032 : ffff9e8b9f15d400)
00000020:00000001:4.0:1773851902.651054:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239491584 : -107152470060032 : ffff9e8b9f15d400)
00000100:00000001:4.0:1773851902.651055:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.651057:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851902.651058:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060f2dc04.
00000020:00000010:4.0:1773851902.651059:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.651060:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000089183453.
00000100:00000001:4.0:1773851902.651062:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851902.651062:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851902.651063:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.651065:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851902.651066:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851902.651066:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.651068:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.651070:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851902.651071:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.651071:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851902.651072:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851902.651073:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.19.3.160@o2ib600, seq: 2002007
00000100:00000001:7.0:1773851902.651075:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.651075:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000568dff62 : new rpc_count 1
00000100:00000001:7.0:1773851902.651076:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.651076:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498321408 : -106953211230208 : ffff9eba03d64800)
00000100:00000040:4.0:1773851902.651078:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000008164362 x1858116544764416/t0(0) o400->f325ba5a-1c96-4e56-b14b-2dc6339836bd@172.19.3.160@o2ib600:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-oslic10-0'
00000100:00000001:4.0:1773851902.651084:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.651085:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851902.651087:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000008164362 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f325ba5a-1c96-4e56-b14b-2dc6339836bd+6:24907:x1858116544764416:12345-172.19.3.160@o2ib600:400:default-oslic10-0
00000100:00000200:4.0:1773851902.651089:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858116544764416
00000020:00000001:4.0:1773851902.651090:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851902.651091:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851902.651092:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.651093:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851902.651094:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851902.651095:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851902.651096:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858116544764416, found 0 last_xid 1858116544764415
00000020:00000001:4.0:1773851902.651098:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851902.651099:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851902.651099:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851902.651100:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.651101:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851902.651102:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851902.651103:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851902.651104:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000094589606.
02000000:00000001:4.0:1773851902.651105:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.651106:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.651107:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851902.651108:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183211359502, transno 0, xid 1858116544764416
00010000:00000001:4.0:1773851902.651109:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851902.651111:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000008164362 x1858116544764416/t0(0) o400->f325ba5a-1c96-4e56-b14b-2dc6339836bd@172.19.3.160@o2ib600:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic10-0'
00010000:00000001:4.0:1773851902.651115:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851902.651116:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851902.651117:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851902.651119:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851902.651120:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f41b0213 refcount 3 to 172.19.3.160@o2ib600
00000100:00000001:4.0:1773851902.651122:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074951456 : -107155634600160 : ffff9e8ae276c720)
02000000:00000001:4.0:1773851902.651123:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851902.651124:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.651125:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851902.651127:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.19.3.160@o2ib600
00000400:00000010:4.0:1773851902.651128:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e5f4f73.
00000100:00000200:4.0:1773851902.651129:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858116544764416, offset 224
00000400:00000200:4.0:1773851902.651132:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.19.3.160@o2ib600
00000400:00000200:4.0:1773851902.651134:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.19.3.160@o2ib600 to cpt 1
00000400:00000200:4.0:1773851902.651135:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 2
00000400:00000200:4.0:1773851902.651137:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 3
00000400:00000200:4.0:1773851902.651140:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 4
00000400:00000200:4.0:1773851902.651142:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.19.3.160@o2ib600 routed destination
00000400:00000200:4.0:1773851902.651144:0:60963:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:4.0:1773851902.651145:0:60963:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib600, from kfi7
00000400:00000200:4.0:1773851902.651148:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.160@o2ib600: rtr pref emtpy: 1
00000400:00000200:4.0:1773851902.651150:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:4.0:1773851902.651151:0:60963:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.19.3.160@o2ib600: rtr pref emtpy: 1
00000400:00000200:4.0:1773851902.651153:0:60963:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:4.0:1773851902.651154:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770435:8770435:1024:4294967295] 2094@kfi7 LPNI seq info [1258747027:1258747027:16:4294967295]
00000400:00000200:4.0:1773851902.651157:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:4.0:1773851902.651158:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:4.0:1773851902.651163:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.19.3.160@o2ib600(172.19.3.160@o2ib600:2094@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851902.651165:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000190df74b nid 172.19.3.160@o2ib600 refs 3
00000800:00000200:4.0:1773851902.651168:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851902.651169:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851902.651173:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851902.651177:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:4.0:1773851902.651181:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002aef9758: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:4.0:1773851902.651185:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851902.651190:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.651192:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f41b0213 refcount 2 to 172.19.3.160@o2ib600
00010000:00000001:4.0:1773851902.651193:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851902.651193:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.651195:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851902.651196:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000008164362 x1858116544764416/t0(0) o400->f325ba5a-1c96-4e56-b14b-2dc6339836bd@172.19.3.160@o2ib600:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-oslic10-0'
00000100:00100000:4.0:1773851902.651202:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000008164362 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:f325ba5a-1c96-4e56-b14b-2dc6339836bd+6:24907:x1858116544764416:12345-172.19.3.160@o2ib600:400:default-oslic10-0 Request processed in 116us (168us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851902.651206:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.19.3.160@o2ib600, seq: 2002007
00000100:00000040:4.0:1773851902.651207:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000568dff62 : new rpc_count 0
00000100:00000001:4.0:1773851902.651208:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851902.651209:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851902.651210:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.651211:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000089183453.
00000020:00000010:4.0:1773851902.651213:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060f2dc04.
00000020:00000040:4.0:1773851902.651214:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000568dff62 : new refcount 5
00000100:00000001:4.0:1773851902.651215:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851902.651222:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851902.651223:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.651224:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:5.0:1773851902.651225:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e5f4f73
00000400:00000010:5.0:1773851902.651226:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e5f4f73.
00000100:00000001:5.0:1773851902.651226:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851902.651227:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851902.651228:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:5.0:1773851902.651229:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002aef9758: 2054@kfi7:1 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000000c Transaction freed
00000800:00000200:21.0:1773851902.654917:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851902.654918:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851902.654919:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851902.654921:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851902.654923:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.654924:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23761@kfi7 : PUT - for me
00000400:00000200:21.0:1773851902.654925:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.654926:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 1
00000400:00000200:21.0:1773851902.654927:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.654928:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000400:00000200:21.0:1773851902.654929:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 3
00000400:00000200:21.0:1773851902.654929:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23568@kfi7 to cpt 7
00000400:00000200:21.0:1773851902.654930:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23568@kfi7 of length 224 into portal 12 MB=0x699e175ec8800
00000400:00000200:21.0:1773851902.654932:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23568@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 69136
00000800:00000200:21.0:1773851902.654933:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851902.654935:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.654936:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23761@kfi7: PUT: OK
00000100:00000001:21.0:1773851902.654936:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851902.654937:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851902.654938:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006e596a60.
00000100:00000040:21.0:1773851902.654938:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006e596a60 x1858043485390848 msgsize 224
00000100:00100000:21.0:1773851902.654940:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-23568@kfi7 (source: 12345-23761@kfi7)
00000100:00000001:21.0:1773851902.654941:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851902.654942:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000100:00000001:20.0:1773851902.654942:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851902.654943:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851902.654943:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851902.654943:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851902.654944:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851902.654945:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851902.654945:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043485390848
00000020:00000001:20.0:1773851902.654946:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851902.654947:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916ac
00000020:00000001:20.0:1773851902.654947:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851902.654951:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002da1a89e refcount=6
00000020:00000001:20.0:1773851902.654951:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241268224 : -107152468283392 : ffff9e8b9f30f000)
00000020:00000001:20.0:1773851902.654952:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241268224 : -107152468283392 : ffff9e8b9f30f000)
00000100:00000001:20.0:1773851902.654953:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.654954:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851902.654955:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851902.654956:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.654957:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851902.654958:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851902.654958:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851902.654959:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851902.654960:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851902.654960:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851902.654961:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.654962:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851902.654963:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851902.654963:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851902.654963:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851902.654963:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851902.654964:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23568@kfi7, seq: 1998088
00000100:00000001:23.0:1773851902.654965:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.654965:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002da1a89e : new rpc_count 1
00000100:00000001:23.0:1773851902.654966:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.654966:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313406208 : -106917396145408 : ffff9ec25a951b00)
00000100:00000040:20.0:1773851902.654967:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006e596a60 x1858043485390848/t0(0) o400->aade71c6-4c41-45b6-86ac-ee2aaaf30341@23568@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1969-0'
00000100:00000001:20.0:1773851902.654973:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.654973:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851902.654974:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006e596a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:aade71c6-4c41-45b6-86ac-ee2aaaf30341+6:39787:x1858043485390848:12345-23568@kfi7:400:default-tuolumne1969-0
00000100:00000200:20.0:1773851902.654976:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043485390848
00000020:00000001:20.0:1773851902.654976:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851902.654977:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851902.654978:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.654978:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851902.654979:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851902.654980:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851902.654980:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043485390848, found 0 last_xid 1858043485390847
00000020:00000001:20.0:1773851902.654981:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851902.654982:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851902.654982:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851902.654983:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.654984:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851902.654984:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851902.654985:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851902.654986:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008b1843cd.
02000000:00000001:20.0:1773851902.654987:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.654987:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.654988:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851902.654989:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044150185, transno 0, xid 1858043485390848
00010000:00000001:20.0:1773851902.654989:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851902.654990:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006e596a60 x1858043485390848/t0(0) o400->aade71c6-4c41-45b6-86ac-ee2aaaf30341@23568@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1969-0'
00010000:00000001:20.0:1773851902.654992:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851902.654993:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851902.654994:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=135 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851902.654995:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851902.654996:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd4ac1c6 refcount 3 to 23568@kfi7
00000100:00000001:20.0:1773851902.654997:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715063456 : -107155994488160 : ffff9e8acd0352a0)
02000000:00000001:20.0:1773851902.654998:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851902.654998:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.654999:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851902.655000:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23761@kfi7
00000400:00000010:20.0:1773851902.655001:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003cda9dd5.
00000100:00000200:20.0:1773851902.655001:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043485390848, offset 224
00000400:00000200:20.0:1773851902.655002:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23761@kfi7
00000400:00000200:20.0:1773851902.655003:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.655004:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 1
00000400:00000200:20.0:1773851902.655005:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000400:00000200:20.0:1773851902.655006:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 3
00000400:00000200:20.0:1773851902.655008:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23761@kfi7 local destination
00000400:00000200:20.0:1773851902.655009:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770436:8770436:1024:4294967295] 23761@kfi7 LPNI seq info [1164134:1164134:16:4294967295]
00000400:00000200:20.0:1773851902.655010:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000400:00000200:20.0:1773851902.655011:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23761@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.655013:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23761@kfi7(23761@kfi7:23761@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851902.655014:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 3
00000800:00000200:20.0:1773851902.655015:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851902.655017:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851902.655019:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851902.655021:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000625 Using peer 23761@kfi7(0x100000000000625)
00000800:00000200:20.0:1773851902.655024:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x100000000000625: rc=0
00000800:00000200:20.0:1773851902.655025:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000625 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851902.655027:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.655028:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd4ac1c6 refcount 2 to 23568@kfi7
00010000:00000001:20.0:1773851902.655029:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851902.655031:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.655032:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851902.655033:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006e596a60 x1858043485390848/t0(0) o400->aade71c6-4c41-45b6-86ac-ee2aaaf30341@23568@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1969-0'
00000100:00100000:20.0:1773851902.655036:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006e596a60 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:aade71c6-4c41-45b6-86ac-ee2aaaf30341+6:39787:x1858043485390848:12345-23568@kfi7:400:default-tuolumne1969-0 Request processed in 62us (97us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851902.655039:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23568@kfi7, seq: 1998088
00000100:00000040:20.0:1773851902.655040:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002da1a89e : new rpc_count 0
00000100:00000001:20.0:1773851902.655040:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851902.655041:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851902.655041:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.655042:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851902.655043:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851902.655044:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000002da1a89e : new refcount 5
00000100:00000001:20.0:1773851902.655044:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851902.655049:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000625 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851902.655053:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.655054:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23761@kfi7: PUT: OK
00000400:00000200:21.0:1773851902.655054:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003cda9dd5
00000400:00000010:21.0:1773851902.655055:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003cda9dd5.
00000100:00000001:21.0:1773851902.655055:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851902.655056:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851902.655057:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000067631cf3 nid 23761@kfi7 refs 2
00000800:00000200:21.0:1773851902.655058:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 23761@kfi7(0000000011dce191):0x0 lsk 1574 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000625 Transaction freed
00000800:00000200:18.0:1773851902.702613:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851902.702614:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851902.702615:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851902.702617:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851902.702619:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.702620:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22787@kfi7 : PUT - for me
00000400:00000200:18.0:1773851902.702621:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.702623:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 1
00000400:00000200:18.0:1773851902.702624:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:18.0:1773851902.702624:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000400:00000200:18.0:1773851902.702625:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 3
00000400:00000200:18.0:1773851902.702626:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22979@kfi7 to cpt 7
00000400:00000200:18.0:1773851902.702627:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22979@kfi7 of length 224 into portal 12 MB=0x699e0a31beec0
00000400:00000200:18.0:1773851902.702628:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22979@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 50840
00000800:00000200:18.0:1773851902.702630:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851902.702631:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851902.702633:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22787@kfi7: PUT: OK
00000100:00000001:18.0:1773851902.702634:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851902.702634:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851902.702635:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a84393c9.
00000100:00000040:18.0:1773851902.702636:0:2507147:0:(events.c:358:request_in_callback()) incoming req@00000000a84393c9 x1858039948504768 msgsize 224
00000100:00100000:18.0:1773851902.702637:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-22979@kfi7 (source: 12345-22787@kfi7)
00000100:00000001:18.0:1773851902.702638:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851902.702639:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000100:00000001:16.0:1773851902.702640:0:61039:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:16.0:1773851902.702640:0:61039:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851902.702641:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:16.0:1773851902.702641:0:61039:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:16.0:1773851902.702641:0:61039:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:16.0:1773851902.702642:0:61039:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:16.0:1773851902.702643:0:61039:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039948504768
00000020:00000001:16.0:1773851902.702644:0:61039:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:16.0:1773851902.702644:0:61039:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ada
00000020:00000001:16.0:1773851902.702645:0:61039:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:16.0:1773851902.702647:0:61039:0:(lustre_handles.c:151:class_handle2object()) GET export 000000007dd85248 refcount=6
00000020:00000001:16.0:1773851902.702648:0:61039:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743681024 : -107128965870592 : ffff9e91180b4c00)
00000020:00000001:16.0:1773851902.702649:0:61039:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743681024 : -107128965870592 : ffff9e91180b4c00)
00000100:00000001:16.0:1773851902.702650:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851902.702651:0:61039:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:16.0:1773851902.702652:0:61039:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000040dcafa1.
00000020:00000010:16.0:1773851902.702653:0:61039:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009c9f33af.
00000020:00000010:16.0:1773851902.702654:0:61039:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d549cbd6.
00000100:00000001:16.0:1773851902.702654:0:61039:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:16.0:1773851902.702656:0:61039:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:16.0:1773851902.702656:0:61039:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:16.0:1773851902.702658:0:61039:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:16.0:1773851902.702658:0:61039:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:16.0:1773851902.702659:0:61039:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851902.702660:0:61039:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851902.702661:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851902.702661:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851902.702661:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851902.702661:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851902.702662:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22979@kfi7, seq: 2156449
00000100:00000040:19.0:1773851902.702663:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000007dd85248 : new rpc_count 1
00000100:00000001:16.0:1773851902.702663:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.702664:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609998848 : -107015099552768 : ffff9eab9b016c00)
00000100:00000001:16.0:1773851902.702664:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851902.702665:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a84393c9 x1858039948504768/t0(0) o400->7d8ce497-db29-470b-93e2-7eb1ef517947@22979@kfi7:154/0 lens 224/0 e 0 to 0 dl 1773852269 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1927-0'
00000100:00000001:19.0:1773851902.702667:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851902.702668:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851902.702669:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a84393c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7d8ce497-db29-470b-93e2-7eb1ef517947+6:39689:x1858039948504768:12345-22979@kfi7:400:default-tuolumne1927-0
00000100:00000200:19.0:1773851902.702670:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039948504768
00000020:00000001:19.0:1773851902.702671:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851902.702671:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851902.702672:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.702673:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851902.702673:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851902.702674:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851902.702674:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039948504768, found 0 last_xid 1858039948504767
00000020:00000001:19.0:1773851902.702675:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851902.702676:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851902.702679:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851902.702680:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.702680:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851902.702681:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851902.702681:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851902.702682:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000042d9eea6.
02000000:00000001:19.0:1773851902.702683:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.702683:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.702684:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851902.702684:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181668605953, transno 0, xid 1858039948504768
00010000:00000001:19.0:1773851902.702685:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851902.702686:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a84393c9 x1858039948504768/t0(0) o400->7d8ce497-db29-470b-93e2-7eb1ef517947@22979@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1927-0'
00010000:00000001:19.0:1773851902.702688:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851902.702689:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851902.702689:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=135 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851902.702690:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851902.702691:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c20b8d6d refcount 3 to 22979@kfi7
00000100:00000001:19.0:1773851902.702692:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715064896 : -107155994486720 : ffff9e8acd035840)
02000000:00000001:19.0:1773851902.702693:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851902.702693:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.702694:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851902.702694:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22787@kfi7
00000400:00000010:19.0:1773851902.702695:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ff06d06d.
00000100:00000200:19.0:1773851902.702696:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039948504768, offset 224
00000400:00000200:19.0:1773851902.702697:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22787@kfi7
00000400:00000200:19.0:1773851902.702698:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:19.0:1773851902.702698:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 1
00000400:00000200:19.0:1773851902.702699:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000400:00000200:19.0:1773851902.702700:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 3
00000400:00000200:19.0:1773851902.702702:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22787@kfi7 local destination
00000400:00000200:19.0:1773851902.702703:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770437:8770437:1024:4294967295] 22787@kfi7 LPNI seq info [82429:82429:16:4294967295]
00000400:00000200:19.0:1773851902.702704:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000400:00000200:19.0:1773851902.702706:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22787@kfi7 to cpt 4
00000400:00000200:19.0:1773851902.702708:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22787@kfi7(22787@kfi7:22787@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851902.702709:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 3
00000800:00000200:19.0:1773851902.702710:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851902.702711:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851902.702713:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851902.702716:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cbb Using peer 22787@kfi7(0x100000000000cbb)
00000800:00000200:19.0:1773851902.702719:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x100000000000cbb: rc=0
00000800:00000200:19.0:1773851902.702720:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cbb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851902.702722:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851902.702723:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c20b8d6d refcount 2 to 22979@kfi7
00010000:00000001:19.0:1773851902.702724:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851902.702724:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.702729:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851902.702730:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a84393c9 x1858039948504768/t0(0) o400->7d8ce497-db29-470b-93e2-7eb1ef517947@22979@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1927-0'
00000800:00000200:18.0:1773851902.702732:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cbb TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851902.702733:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a84393c9 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:7d8ce497-db29-470b-93e2-7eb1ef517947+6:39689:x1858039948504768:12345-22979@kfi7:400:default-tuolumne1927-0 Request processed in 65us (96us total) trans 0 rc 0/0
00000400:00000200:18.0:1773851902.702733:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851902.702735:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22979@kfi7, seq: 2156449
00000400:00000200:18.0:1773851902.702735:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22787@kfi7: PUT: OK
00000100:00000040:19.0:1773851902.702736:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000007dd85248 : new rpc_count 0
00000400:00000200:18.0:1773851902.702736:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ff06d06d
00000400:00000010:18.0:1773851902.702736:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ff06d06d.
00000100:00000001:19.0:1773851902.702737:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851902.702737:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:18.0:1773851902.702737:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851902.702737:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851902.702738:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009c9f33af.
00000020:00000010:19.0:1773851902.702738:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d549cbd6.
00000400:00000200:18.0:1773851902.702738:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000012a8fa6d nid 22787@kfi7 refs 2
00000020:00000010:19.0:1773851902.702739:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000040dcafa1.
00000800:00000200:18.0:1773851902.702739:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 22787@kfi7(0000000086766464):0x0 lsk 3260 rsk 50 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000cbb Transaction freed
00000020:00000040:19.0:1773851902.702740:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000007dd85248 : new refcount 5
00000100:00000001:19.0:1773851902.702741:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851902.793731:0:42391:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851902.793732:0:42391:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851902.793733:0:42391:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001eed8194.
00000004:00000001:30.0:1773851902.793734:0:42383:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851902.793734:0:42383:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:28.0:1773851902.793734:0:42389:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000020:00000040:8.0:1773851902.793734:0:42391:0:(genops.c:1094:class_import_get()) import 000000000146e57a refcount=3 obd=lustre5-OST001a-osc-MDT0001
00000004:00000001:29.0:1773851902.793735:0:42381:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851902.793735:0:42381:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:8.0:1773851902.793735:0:42391:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:30.0:1773851902.793736:0:42383:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c1b57e73.
00000100:00000010:29.0:1773851902.793736:0:42381:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031b2b886.
00000004:00000020:28.0:1773851902.793736:0:42389:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:8.0:1773851902.793736:0:42391:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:30.0:1773851902.793737:0:42383:0:(genops.c:1094:class_import_get()) import 00000000f0b977fe refcount=7 obd=lustre5-OST0016-osc-MDT0001
00000020:00000040:29.0:1773851902.793737:0:42381:0:(genops.c:1094:class_import_get()) import 000000008dbf32d7 refcount=7 obd=lustre5-OST0015-osc-MDT0001
00000100:00000010:28.0:1773851902.793737:0:42389:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d6930c2f.
02000000:00000001:8.0:1773851902.793737:0:42391:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793738:0:42383:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851902.793738:0:42381:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:8.0:1773851902.793738:0:42391:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
02000000:00000001:29.0:1773851902.793739:0:42381:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:28.0:1773851902.793739:0:42389:0:(genops.c:1094:class_import_get()) import 00000000d60e6948 refcount=3 obd=lustre5-OST0019-osc-MDT0001
00000100:00000001:8.0:1773851902.793739:0:42391:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851902.793740:0:42383:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851902.793740:0:42381:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.793740:0:42391:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:30.0:1773851902.793741:0:42383:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851902.793741:0:42381:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
00000100:00000001:28.0:1773851902.793741:0:42389:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851902.793741:0:42389:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:8.0:1773851902.793741:0:42391:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851902.793742:0:42383:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000078bc3602.
02000000:00000001:28.0:1773851902.793742:0:42389:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.793742:0:42391:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001eed8194] to pc [ptlrpcd_02_02+2]  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851902.793743:0:42383:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793743:0:42381:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793744:0:42383:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851902.793744:0:42381:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851902.793744:0:42381:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851902.793744:0:42389:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000067ad0b6.
00000100:00000001:30.0:1773851902.793745:0:42383:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851902.793745:0:42389:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851902.793746:0:42383:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000c1b57e73] to pc [ptlrpcd_07_03+3]  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851902.793746:0:42381:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000031b2b886] to pc [ptlrpcd_07_02+2]  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851902.793746:0:42389:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851902.793747:0:42389:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851902.793748:0:42389:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d6930c2f] to pc [ptlrpcd_07_00+0]  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851902.793748:0:42391:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:10.0:1773851902.793749:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851902.793749:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851902.793749:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:8.0:1773851902.793749:0:42391:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f76cf2e6.
00000100:00000001:10.0:1773851902.793750:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.793750:0:41070:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:8.0:1773851902.793750:0:42391:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637133439787008 : -106940269764608 : ffff9ebd07356000)
00080000:00000001:30.0:1773851902.793751:0:42383:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:29.0:1773851902.793751:0:42381:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000040:9.0:1773851902.793751:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:8.0:1773851902.793751:0:42391:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:31.0:1773851902.793752:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:30.0:1773851902.793752:0:42383:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000000f9bad1b.
00080000:00000010:29.0:1773851902.793752:0:42381:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004323a9ab.
00000100:00000001:31.0:1773851902.793753:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:30.0:1773851902.793753:0:42383:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130494936064 : -106943214615552 : ffff9ebc57ae8400)
00080000:00000001:29.0:1773851902.793753:0:42381:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637143720937472 : -106929988614144 : ffff9ebf6c034800)
00080000:00000001:8.0:1773851902.793753:0:42391:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793754:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:30.0:1773851902.793754:0:42383:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:29.0:1773851902.793754:0:42381:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:9.0:1773851902.793754:0:41070:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:8.0:1773851902.793754:0:42391:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001a-osc-MDT0001: sync forced, 5 changes
00000100:00000040:31.0:1773851902.793755:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851902.793755:0:42383:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851902.793755:0:42381:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851902.793755:0:42389:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:9.0:1773851902.793755:0:41070:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851902.793755:0:42391:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000fd8f02be.
00000004:00001000:30.0:1773851902.793756:0:42383:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0016-osc-MDT0001: sync forced, 1 changes
00000004:00001000:29.0:1773851902.793756:0:42381:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0015-osc-MDT0001: sync forced, 3 changes
02000000:00000001:9.0:1773851902.793756:0:41070:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:8.0:1773851902.793756:0:42391:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001a-osc-MDT0001: add commit cb at 614177247031102ns, next at 614178247029810ns, rc = 0
00000004:00000010:30.0:1773851902.793757:0:42383:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000005155bc5d.
00000004:00000010:29.0:1773851902.793757:0:42381:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000cc92c808.
00080000:00000010:28.0:1773851902.793757:0:42389:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000d75daf55.
02000000:00000001:9.0:1773851902.793757:0:41070:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851902.793757:0:42391:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:31.0:1773851902.793758:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00080000:30.0:1773851902.793758:0:42383:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0016-osc-MDT0001: add commit cb at 614177247033647ns, next at 614178247032415ns, rc = 0
00000004:00080000:29.0:1773851902.793758:0:42381:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0015-osc-MDT0001: add commit cb at 614177247033617ns, next at 614178247032605ns, rc = 0
00080000:00000001:28.0:1773851902.793758:0:42389:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636948988508160 : -107124721043456 : ffff9e92150e3800)
00000100:00100000:9.0:1773851902.793758:0:41070:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001eed8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051942656:2084@kfi7:13:default-yuba2-0
00080000:00000001:8.0:1773851902.793758:0:42391:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793759:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851902.793759:0:42383:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:29.0:1773851902.793759:0:42381:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:28.0:1773851902.793759:0:42389:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000004:00000001:8.0:1773851902.793759:0:42391:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851902.793760:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:30.0:1773851902.793760:0:42383:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851902.793760:0:42381:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:28.0:1773851902.793760:0:42389:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.793760:0:41070:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:31.0:1773851902.793761:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851902.793761:0:42383:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851902.793761:0:42381:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:28.0:1773851902.793761:0:42389:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0019-osc-MDT0001: sync forced, 2 changes
02000000:00000001:9.0:1773851902.793761:0:41070:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00100000:31.0:1773851902.793762:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000c1b57e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051942784:2104@kfi7:13:default-yuba2-0
00000100:00000001:29.0:1773851902.793762:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000010:28.0:1773851902.793762:0:42389:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000003df0a390.
02000000:00000001:9.0:1773851902.793762:0:41070:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851902.793762:0:41070:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851902.793763:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851902.793763:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851902.793763:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:29.0:1773851902.793763:0:41089:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00000004:00080000:28.0:1773851902.793763:0:42389:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0019-osc-MDT0001: add commit cb at 614177247038146ns, next at 614178247037144ns, rc = 0
02000000:00000010:9.0:1773851902.793763:0:41070:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004470a3fd.
02000000:00000001:31.0:1773851902.793764:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:29.0:1773851902.793764:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:28.0:1773851902.793764:0:42389:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:9.0:1773851902.793764:0:41070:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851902.793765:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793765:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851902.793765:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:28.0:1773851902.793765:0:42389:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851902.793765:0:42389:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851902.793765:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
02000000:00000001:31.0:1773851902.793766:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:29.0:1773851902.793766:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851902.793766:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:9.0:1773851902.793766:0:41070:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf4ea876.
02000000:00000010:31.0:1773851902.793767:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000f0400889.
02000000:00000001:31.0:1773851902.793767:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793767:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000400:00000010:9.0:1773851902.793767:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003dd826d2.
00000100:00000040:29.0:1773851902.793768:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851902.793768:0:41070:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942656, portal 4
00000400:00000200:31.0:1773851902.793769:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000010:31.0:1773851902.793769:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000008174bb91.
00000100:00000001:30.0:1773851902.793769:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851902.793769:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851902.793769:0:41070:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:31.0:1773851902.793770:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
00000100:00000001:30.0:1773851902.793770:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851902.793770:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:29.0:1773851902.793770:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.793770:0:41070:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491259776 : -107117218291840 : ffff9e93d4411f80)
00000100:00000040:30.0:1773851902.793771:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:29.0:1773851902.793771:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:9.0:1773851902.793771:0:41070:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851902.793772:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942784, portal 4
02000000:00000001:29.0:1773851902.793772:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793773:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:31.0:1773851902.793773:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411252608 : -106960298299008 : ffff9eb85d6a3180)
00000100:00100000:29.0:1773851902.793773:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d6930c2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051942848:9@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851902.793774:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851902.793774:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793774:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:9.0:1773851902.793774:0:41070:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851902.793775:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851902.793775:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:29.0:1773851902.793775:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:29.0:1773851902.793775:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851902.793776:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851902.793776:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:9.0:1773851902.793776:0:41070:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2084@kfi7
00000400:00000010:9.0:1773851902.793776:0:41070:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa4a0339.
00000100:00100000:30.0:1773851902.793777:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000031b2b886 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051942720:47@kfi7:13:default-yuba2-0
02000000:00000010:29.0:1773851902.793777:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000007573667.
02000000:00000001:29.0:1773851902.793777:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851902.793777:0:41070:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942656, offset 0
00000100:00000001:31.0:1773851902.793778:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:30.0:1773851902.793778:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:29.0:1773851902.793778:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000040:31.0:1773851902.793779:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2104@kfi7
00000400:00000010:31.0:1773851902.793779:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c70e405.
02000000:00000001:30.0:1773851902.793779:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851902.793779:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:29.0:1773851902.793779:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e108dc56.
00000400:00000200:9.0:1773851902.793779:0:41070:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2084@kfi7
02000000:00000001:30.0:1773851902.793780:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:29.0:1773851902.793780:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8cfb79.
00000400:00000200:9.0:1773851902.793780:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000200:31.0:1773851902.793781:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942784, offset 0
02000000:00000010:30.0:1773851902.793781:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000811c6a94.
00000100:00000200:29.0:1773851902.793781:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942848, portal 4
00000400:00000200:9.0:1773851902.793781:0:41070:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000400:00000200:31.0:1773851902.793782:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2104@kfi7
02000000:00000001:30.0:1773851902.793782:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793782:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851902.793782:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324241664 : -106976385309952 : ffff9eb49e8de300)
00000400:00000200:9.0:1773851902.793782:0:41070:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:30.0:1773851902.793783:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000040:29.0:1773851902.793783:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851902.793784:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000010:30.0:1773851902.793784:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
00000400:00000200:9.0:1773851902.793784:0:41070:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:31.0:1773851902.793785:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000010:30.0:1773851902.793785:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000927f3e9e.
00000400:00000200:9.0:1773851902.793785:0:41070:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2084@kfi7 local destination
00000400:00000200:31.0:1773851902.793786:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000200:30.0:1773851902.793786:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942720, portal 4
00000100:00000001:30.0:1773851902.793786:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851902.793786:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851902.793786:0:41070:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770431, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770437, p:4294967295, g:4294967295, h:1000]
00000100:00000001:30.0:1773851902.793787:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637130208521472 : -106943501030144 : ffff9ebc469c2d00)
00000100:00000040:29.0:1773851902.793787:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9@kfi7
00000400:00000010:29.0:1773851902.793787:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089b548b8.
00000400:00000200:31.0:1773851902.793788:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000100:00000040:30.0:1773851902.793788:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851902.793788:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942848, offset 0
00000400:00000200:31.0:1773851902.793789:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2104@kfi7 local destination
00000400:00000200:29.0:1773851902.793789:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9@kfi7
00000400:00000200:9.0:1773851902.793789:0:41070:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:31.0:1773851902.793790:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770431, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770437, p:4294967295, g:4294967295, h:1000]
00000100:00000001:30.0:1773851902.793790:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851902.793790:0:41070:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:30.0:1773851902.793791:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-47@kfi7
00000400:00000010:30.0:1773851902.793791:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000227bab5d.
00000400:00000200:9.0:1773851902.793791:0:41070:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2084@kfi7
00000400:00000200:31.0:1773851902.793792:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000200:30.0:1773851902.793792:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942720, offset 0
00000400:00000200:9.0:1773851902.793792:0:41070:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770438:8770438:1024:4294967295] 2084@kfi7 LPNI seq info [5402752:5402752:16:4294967295]
00000400:00000200:31.0:1773851902.793793:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851902.793793:0:41070:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:31.0:1773851902.793794:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2104@kfi7
00000400:00000200:30.0:1773851902.793794:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-47@kfi7
00000400:00000200:9.0:1773851902.793794:0:41070:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851902.793796:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770439:8770439:1024:4294967295] 2104@kfi7 LPNI seq info [5403384:5403384:16:4294967295]
00000400:00000200:31.0:1773851902.793797:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:9.0:1773851902.793797:0:41070:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2084@kfi7(2084@kfi7:2084@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851902.793798:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:29.0:1773851902.793799:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:9.0:1773851902.793799:0:41070:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:29.0:1773851902.793800:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000800:00000200:9.0:1773851902.793800:0:41070:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:31.0:1773851902.793801:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2104@kfi7(2104@kfi7:2104@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851902.793801:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:31.0:1773851902.793802:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:29.0:1773851902.793802:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000800:00000200:9.0:1773851902.793802:0:41070:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851902.793804:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:29.0:1773851902.793804:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  9@kfi7 local destination
00000800:00000200:9.0:1773851902.793804:0:41070:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851902.793805:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:29.0:1773851902.793805:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770438, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770439, p:4294967295, g:4294967295, h:1000]
00000800:00000200:9.0:1773851902.793806:0:41070:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Using peer 2084@kfi7(0x103)
00000800:00000200:31.0:1773851902.793807:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851902.793807:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:29.0:1773851902.793808:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851902.793809:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 9@kfi7
00000800:00000200:9.0:1773851902.793809:0:41070:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004481c792: Posted send of 324 bytes to peer 0x103: rc=0
00000800:00000200:31.0:1773851902.793810:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Using peer 2104@kfi7(0x20000000000019e)
00000400:00000200:29.0:1773851902.793810:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770440:8770440:1023:4294967295] 9@kfi7 LPNI seq info [5403016:5403016:16:4294967295]
00000800:00000200:9.0:1773851902.793811:0:41070:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851902.793812:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:31.0:1773851902.793813:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x20000000000019e: rc=0
00000400:00000200:29.0:1773851902.793813:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000100:00000001:9.0:1773851902.793813:0:41070:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.793813:0:41070:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851902.793814:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000001:9.0:1773851902.793814:0:41070:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851902.793815:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:30.0:1773851902.793815:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:30.0:1773851902.793815:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:29.0:1773851902.793815:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 9@kfi7(9@kfi7:9@kfi7) <?> : PUT try# 0
00000100:00000001:9.0:1773851902.793815:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.793816:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.793817:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793817:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851902.793817:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000400:00000200:29.0:1773851902.793817:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000100:00000001:9.0:1773851902.793817:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851902.793817:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851902.793818:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851902.793818:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  47@kfi7 local destination
00000800:00000200:29.0:1773851902.793818:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000100:00000001:9.0:1773851902.793818:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851902.793818:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851902.793819:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851902.793819:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8770440, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770439, p:4294967295, g:4294967295, h:1000]
00000100:00000001:9.0:1773851902.793819:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793820:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851902.793820:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:9.0:1773851902.793820:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793821:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851902.793821:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:10.0:1773851902.793821:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851902.793822:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:30.0:1773851902.793822:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851902.793822:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:29.0:1773851902.793822:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:31.0:1773851902.793823:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851902.793823:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851902.793823:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 47@kfi7
00000400:00000200:10.0:1773851902.793823:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851902.793824:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851902.793824:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770441:8770441:1023:4294967295] 47@kfi7 LPNI seq info [5403027:5403027:16:4294967295]
00000800:00000200:29.0:1773851902.793824:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Using peer 9@kfi7(0x31e)
00000400:00000200:10.0:1773851902.793825:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000400:00000200:10.0:1773851902.793825:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa4a0339
00000800:00000200:31.0:1773851902.793826:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851902.793826:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000010:10.0:1773851902.793826:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa4a0339.
00000100:00000001:10.0:1773851902.793826:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:30.0:1773851902.793827:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000800:00000200:29.0:1773851902.793827:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0x31e: rc=0
00000400:00000200:31.0:1773851902.793828:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000200:10.0:1773851902.793828:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851902.793829:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00000400:00000200:30.0:1773851902.793829:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 47@kfi7(47@kfi7:47@kfi7) <?> : PUT try# 0
00000800:00000200:29.0:1773851902.793829:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851902.793830:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c70e405
00000400:00000010:31.0:1773851902.793830:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c70e405.
00000400:00000200:30.0:1773851902.793830:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000001:29.0:1773851902.793830:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851902.793830:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851902.793831:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:30.0:1773851902.793831:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000100:00000001:29.0:1773851902.793831:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851902.793831:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851902.793831:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:31.0:1773851902.793832:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851902.793832:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851902.793833:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:29.0:1773851902.793833:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851902.793833:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851902.793834:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851902.793835:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851902.793835:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851902.793835:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851902.793835:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:30.0:1773851902.793837:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Using peer 47@kfi7(0x20000000000027b)
00000800:00000200:10.0:1773851902.793837:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004481c792: 2069@kfi7:2 -> 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 2 tta 0x103 Transaction freed
00000100:00000001:31.0:1773851902.793838:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793838:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:31.0:1773851902.793839:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000800:00000200:30.0:1773851902.793840:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000030498a96: Posted send of 324 bytes to peer 0x20000000000027b: rc=0
00000800:00000200:31.0:1773851902.793841:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2054@kfi7:7 -> 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000019e Transaction freed
00000800:00000200:30.0:1773851902.793841:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:29.0:1773851902.793841:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851902.793842:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851902.793843:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793843:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:29.0:1773851902.793843:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000100:00000001:30.0:1773851902.793844:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793844:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851902.793844:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089b548b8
00000400:00000010:29.0:1773851902.793844:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089b548b8.
00000100:00000001:30.0:1773851902.793845:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851902.793845:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851902.793845:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851902.793846:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851902.793846:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:30.0:1773851902.793847:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851902.793847:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851902.793847:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793848:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793848:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851902.793848:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851902.793851:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793851:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:29.0:1773851902.793852:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000800:00000200:31.0:1773851902.793853:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b TN_EVENT_TX_OK event status 0
00000800:00000200:29.0:1773851902.793854:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 7 tta 0x31e Transaction freed
00000400:00000200:31.0:1773851902.793855:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851902.793856:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000400:00000200:31.0:1773851902.793857:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000227bab5d
00000400:00000010:31.0:1773851902.793857:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000227bab5d.
00000800:00000200:25.0:1773851902.793857:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000100:00000001:31.0:1773851902.793858:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:31.0:1773851902.793858:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851902.793858:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851902.793859:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851902.793861:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:25.0:1773851902.793861:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000040:31.0:1773851902.793862:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851902.793863:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000100:00000001:31.0:1773851902.793864:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793864:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:25.0:1773851902.793864:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2084@kfi7 : PUT - for me
00000400:00000200:25.0:1773851902.793864:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:31.0:1773851902.793865:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:25.0:1773851902.793865:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 1
00000800:00000200:31.0:1773851902.793867:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x20000000000027b Transaction freed
00000400:00000200:25.0:1773851902.793867:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851902.793867:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000400:00000200:25.0:1773851902.793868:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 3
00000400:00000200:25.0:1773851902.793869:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851902.793870:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2084@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6f00
00000400:00000200:25.0:1773851902.793871:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2084@kfi7 to cpt 6
00000400:00000200:25.0:1773851902.793873:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2084@kfi7 of length 368/368 into md 0x1615b83599 [1] + 224
00000800:00000200:25.0:1773851902.793875:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851902.793876:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851902.793877:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2084@kfi7: PUT: OK
00000100:00000001:25.0:1773851902.793878:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851902.793879:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851902.793881:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000040:25.0:1773851902.793882:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851902.793882:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.793884:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851902.793885:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851902.793885:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:25.0:1773851902.793886:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:5.0:1773851902.793886:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851902.793887:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003ec05866 nid 2084@kfi7 refs 2
00000800:00000200:13.0:1773851902.793887:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851902.793888:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2084@kfi7(00000000183737ba):0x0 lsk 260 rsk 4811 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:9.0:1773851902.793888:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851902.793888:0:41070:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851902.793888:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000800:00000200:13.0:1773851902.793889:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000001:9.0:1773851902.793889:0:41070:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851902.793889:0:41070:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:5.0:1773851902.793889:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9@kfi7 : PUT - for me
00000400:00000010:9.0:1773851902.793890:0:41070:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf4ea876.
00000400:00000200:5.0:1773851902.793890:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:13.0:1773851902.793891:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:9.0:1773851902.793891:0:41070:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003dd826d2
00000400:00000200:5.0:1773851902.793891:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 1
00000400:00000010:9.0:1773851902.793892:0:41070:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003dd826d2.
00000400:00000200:13.0:1773851902.793893:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2104@kfi7 : PUT - for me
00000100:00000001:9.0:1773851902.793893:0:41070:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:9.0:1773851902.793893:0:41070:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851902.793893:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000400:00000200:13.0:1773851902.793894:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000400:00000200:5.0:1773851902.793894:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000400:00000200:13.0:1773851902.793895:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 1
00000400:00000200:5.0:1773851902.793895:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 3
00000400:00000200:13.0:1773851902.793896:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000200:9.0:1773851902.793896:0:41070:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851902.793896:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000800:00000200:21.0:1773851902.793897:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000400:00000200:13.0:1773851902.793897:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000400:00000200:5.0:1773851902.793897:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6fc0
00000800:00000200:21.0:1773851902.793898:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:13.0:1773851902.793898:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 3
00000400:00000200:5.0:1773851902.793898:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9@kfi7 to cpt 1
00000800:00000200:21.0:1773851902.793899:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851902.793899:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
00000100:00000001:9.0:1773851902.793899:0:41070:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:9.0:1773851902.793899:0:41070:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851902.793900:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2104@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6f80
00000100:00000001:9.0:1773851902.793900:0:41070:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:5.0:1773851902.793900:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-9@kfi7 of length 368/368 into md 0x793b327c5 [1] + 224
00000800:00000200:21.0:1773851902.793901:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851902.793901:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2104@kfi7 to cpt 3
02000000:00000001:9.0:1773851902.793901:0:41070:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:9.0:1773851902.793901:0:41070:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851902.793902:0:41070:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851902.793902:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851902.793903:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:13.0:1773851902.793903:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2104@kfi7 of length 368/368 into md 0x82a5f762d [1] + 224
02000000:00000001:9.0:1773851902.793903:0:41070:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851902.793904:0:41070:0:(import.c:1951:at_measured()) add 66 to 00000000dccecfe8 time=135 v=66 (66 66 66 66)
00000400:00000200:5.0:1773851902.793904:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.793905:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 47@kfi7 : PUT - for me
00000800:00000200:13.0:1773851902.793905:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00001000:9.0:1773851902.793905:0:41070:0:(import.c:1951:at_measured()) add 1 to 0000000086fe909a time=135 v=66 (1 1 1 1)
00000400:00000200:5.0:1773851902.793905:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9@kfi7: PUT: OK
00000400:00000200:21.0:1773851902.793906:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.793906:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 1
00000400:00000200:13.0:1773851902.793906:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851902.793906:0:41070:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:9.0:1773851902.793906:0:41070:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851902.793906:0:2507993:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:9.0:1773851902.793907:0:41070:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:21.0:1773851902.793908:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.793908:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000400:00000200:13.0:1773851902.793908:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2104@kfi7: PUT: OK
00010000:00000001:9.0:1773851902.793908:0:41070:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851902.793908:0:41070:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:5.0:1773851902.793908:0:2507993:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851902.793909:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 3
00000100:00000001:13.0:1773851902.793909:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:9.0:1773851902.793909:0:41070:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001a-osc-MDT0001: skip recheck: last_committed 176224959231
00000400:00000200:21.0:1773851902.793910:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000200:13.0:1773851902.793910:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851902.793910:0:41070:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851902.793910:0:41070:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851902.793911:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-47@kfi7 of length 368 into portal 4 MB=0x69b24fe8b6f40
00000100:00000040:9.0:1773851902.793911:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:5.0:1773851902.793911:0:2507993:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851902.793912:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 47@kfi7 to cpt 5
00000100:00000040:13.0:1773851902.793913:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:21.0:1773851902.793914:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-47@kfi7 of length 368/368 into md 0x6a34d2215 [1] + 224
00000100:00000001:9.0:1773851902.793914:0:41070:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851902.793914:0:41070:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851902.793915:0:41070:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851902.793915:0:2507993:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:21.0:1773851902.793916:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000004:00000001:9.0:1773851902.793916:0:41070:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:5.0:1773851902.793916:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094c50701 nid 9@kfi7 refs 2
00000100:00000001:29.0:1773851902.793917:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851902.793917:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851902.793917:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851902.793917:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:9.0:1773851902.793917:0:41070:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001a-osc-MDT0001: Updating status = 0
00000004:00000040:9.0:1773851902.793917:0:41070:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001a-osc-MDT0001: blocks=410399724544 free=351593710592 avail=351576908800 avail_mb=1373347300 hwm_mb=3131103 files=372189933 ffree=343353233 state=0: rc = 0
00000800:00000200:5.0:1773851902.793917:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 9@kfi7(00000000408655b5):0x0 lsk 799 rsk 4792 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:29.0:1773851902.793918:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:29.0:1773851902.793918:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:13.0:1773851902.793918:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0ac637 nid 2104@kfi7 refs 2
00000100:00000001:31.0:1773851902.793919:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851902.793919:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:29.0:1773851902.793919:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e108dc56.
00000400:00000200:21.0:1773851902.793919:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->47@kfi7: PUT: OK
00000004:00000020:9.0:1773851902.793919:0:41070:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001a-osc-MDT0001 (000000004b2fa194): 410399724544 blocks, 351593710592 free, 351576908800 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372189933 files, 343353233 free files
00000400:00000001:31.0:1773851902.793920:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851902.793920:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:29.0:1773851902.793920:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8cfb79
00000100:00000001:21.0:1773851902.793920:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:13.0:1773851902.793920:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2104@kfi7(0000000059b11f62):0x0 lsk 415 rsk 4788 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000010:31.0:1773851902.793921:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000008174bb91.
00000400:00000010:29.0:1773851902.793921:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8cfb79.
00000100:00000001:29.0:1773851902.793921:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:9.0:1773851902.793921:0:41070:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851902.793922:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000400:00000010:31.0:1773851902.793922:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000100:00000200:29.0:1773851902.793922:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:21.0:1773851902.793922:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851902.793922:0:41070:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851902.793923:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:31.0:1773851902.793924:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:29.0:1773851902.793925:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:21.0:1773851902.793925:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:9.0:1773851902.793925:0:41070:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001eed8194 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_02:lustre5-MDT0001-mdtlov_UUID:41070:1859433051942656:2084@kfi7:13:default-yuba2-0
00000100:00000200:31.0:1773851902.793927:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851902.793927:0:41070:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851902.793927:0:41070:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:29.0:1773851902.793928:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:21.0:1773851902.793928:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:9.0:1773851902.793928:0:41070:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001eed8194 x1859433051942656/t0(0) o13->lustre5-OST001a-osc-MDT0001@2084@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851902.793929:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851902.793929:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851902.793929:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851902.793929:0:41089:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:21.0:1773851902.793929:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bc937ea6 nid 47@kfi7 refs 2
00000100:00000001:31.0:1773851902.793930:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851902.793930:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851902.793930:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:29.0:1773851902.793930:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851902.793931:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851902.793931:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793931:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851902.793931:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851902.793931:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 47@kfi7(000000009d295d5d):0x0 lsk 636 rsk 4789 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851902.793932:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:30.0:1773851902.793932:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:30.0:1773851902.793932:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:29.0:1773851902.793932:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851902.793932:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851902.793933:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000a62b103c time=135 v=66 (66 66 66 66)
00000400:00000010:30.0:1773851902.793933:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:30.0:1773851902.793933:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000927f3e9e
00000100:00001000:29.0:1773851902.793933:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000ceaa434d time=135 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851902.793933:0:41070:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00001000:31.0:1773851902.793934:0:41091:0:(import.c:1951:at_measured()) add 1 to 00000000ff55bd00 time=135 v=66 (1 1 1 1)
00000400:00000010:30.0:1773851902.793934:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000927f3e9e.
00000100:00001000:29.0:1773851902.793934:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000822859e4 time=56 v=66 (1 1 1 1)
02000000:00000001:9.0:1773851902.793934:0:41070:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:31.0:1773851902.793935:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851902.793935:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:29.0:1773851902.793935:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000010:9.0:1773851902.793935:0:41070:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004470a3fd.
00000100:00000001:31.0:1773851902.793936:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851902.793936:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851902.793936:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851902.793936:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:9.0:1773851902.793936:0:41070:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00010000:00000001:31.0:1773851902.793937:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851902.793937:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:29.0:1773851902.793937:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:9.0:1773851902.793937:0:41070:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851902.793937:0:41070:0:(genops.c:1107:class_import_put()) import 000000000146e57a refcount=2 obd=lustre5-OST001a-osc-MDT0001
00000100:00000001:31.0:1773851902.793938:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851902.793938:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0016-osc-MDT0001: skip recheck: last_committed 163342248942
00000100:00000200:30.0:1773851902.793938:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851902.793938:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:29.0:1773851902.793938:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0019-osc-MDT0001: skip recheck: last_committed 167636664984
00000020:00000001:9.0:1773851902.793938:0:41070:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851902.793938:0:41070:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:31.0:1773851902.793939:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851902.793939:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793939:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:29.0:1773851902.793939:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851902.793939:0:41070:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000040:29.0:1773851902.793940:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:9.0:1773851902.793940:0:41070:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000040:31.0:1773851902.793941:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851902.793941:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:30.0:1773851902.793941:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851902.793941:0:41090:0:(client.c:1428:after_reply()) Process entered
00000100:00000010:9.0:1773851902.793941:0:41070:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001eed8194.
02000000:00000001:30.0:1773851902.793942:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851902.793942:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851902.793942:0:41070:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:9.0:1773851902.793942:0:41070:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.793943:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:30.0:1773851902.793943:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851902.793943:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851902.793943:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:29.0:1773851902.793943:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851902.793943:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.793944:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851902.793944:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:30.0:1773851902.793944:0:41090:0:(import.c:1951:at_measured()) add 66 to 000000002b59929f time=135 v=66 (66 66 66 66)
00000100:00000001:29.0:1773851902.793944:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851902.793944:0:41070:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851902.793944:0:41070:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851902.793945:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851902.793945:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0016-osc-MDT0001: Updating status = 0
00000100:00001000:30.0:1773851902.793945:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000eaf6cac1 time=135 v=66 (1 1 1 1)
00000004:00000001:29.0:1773851902.793945:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:29.0:1773851902.793945:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0019-osc-MDT0001: Updating status = 0
00000100:00000001:9.0:1773851902.793945:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851902.793945:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:31.0:1773851902.793946:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0016-osc-MDT0001: blocks=410399739904 free=351615890432 avail=351613254656 avail_mb=1373489276 hwm_mb=3131103 files=372043359 ffree=343374893 state=0: rc = 0
00000100:00000001:30.0:1773851902.793946:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851902.793946:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:29.0:1773851902.793946:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0019-osc-MDT0001: blocks=410399699968 free=351480041472 avail=351478789120 avail_mb=1372964020 hwm_mb=3131101 files=372073029 ffree=343242228 state=0: rc = 0
00010000:00000001:30.0:1773851902.793947:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:31.0:1773851902.793948:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0016-osc-MDT0001 (00000000a9f1c04b): 410399739904 blocks, 351615890432 free, 351613254656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372043359 files, 343374893 free files
00010000:00000001:30.0:1773851902.793948:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793948:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000020:29.0:1773851902.793948:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0019-osc-MDT0001 (000000006fa556bd): 410399699968 blocks, 351480041472 free, 351478789120 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372073029 files, 343242228 free files
00000100:00000040:30.0:1773851902.793949:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0015-osc-MDT0001: skip recheck: last_committed 180521016867
00000100:00000001:30.0:1773851902.793949:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000001:31.0:1773851902.793950:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793950:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851902.793950:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851902.793950:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:31.0:1773851902.793951:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:30.0:1773851902.793951:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:31.0:1773851902.793953:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000c1b57e73 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051942784:2104@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851902.793953:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00100000:29.0:1773851902.793953:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d6930c2f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051942848:9@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851902.793954:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851902.793954:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.793955:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:30.0:1773851902.793955:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:30.0:1773851902.793955:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0015-osc-MDT0001: Updating status = 0
00000100:00000001:29.0:1773851902.793955:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851902.793955:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851902.793956:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:31.0:1773851902.793956:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000c1b57e73 x1859433051942784/t0(0) o13->lustre5-OST0016-osc-MDT0001@2104@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:30.0:1773851902.793956:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0015-osc-MDT0001: blocks=410399719424 free=351603982336 avail=351601690624 avail_mb=1373444104 hwm_mb=3131103 files=372190369 ffree=343363264 state=0: rc = 0
00000100:00000040:29.0:1773851902.793956:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d6930c2f x1859433051942848/t0(0) o13->lustre5-OST0019-osc-MDT0001@9@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851902.793958:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000020:30.0:1773851902.793958:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0015-osc-MDT0001 (000000007870c985): 410399719424 blocks, 351603982336 free, 351601690624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372190369 files, 343363264 free files
00000100:00000001:29.0:1773851902.793958:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851902.793959:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:30.0:1773851902.793959:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851902.793959:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851902.793960:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000f0400889.
00000100:00000040:30.0:1773851902.793960:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000010:29.0:1773851902.793960:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000007573667.
02000000:00000001:31.0:1773851902.793961:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851902.793961:0:41091:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:29.0:1773851902.793961:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:29.0:1773851902.793961:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851902.793962:0:41091:0:(genops.c:1107:class_import_put()) import 00000000f0b977fe refcount=6 obd=lustre5-OST0016-osc-MDT0001
00000020:00000001:31.0:1773851902.793962:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
00000020:00000040:29.0:1773851902.793962:0:41089:0:(genops.c:1107:class_import_put()) import 00000000d60e6948 refcount=2 obd=lustre5-OST0019-osc-MDT0001
02000000:00000010:31.0:1773851902.793963:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000078bc3602.
00000100:00100000:30.0:1773851902.793963:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000031b2b886 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051942720:47@kfi7:13:default-yuba2-0
00000020:00000001:29.0:1773851902.793963:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:29.0:1773851902.793963:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000067ad0b6.
02000000:00000001:31.0:1773851902.793964:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851902.793964:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:30.0:1773851902.793964:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:29.0:1773851902.793964:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:29.0:1773851902.793964:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851902.793965:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000c1b57e73.
00000100:00000001:30.0:1773851902.793965:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:30.0:1773851902.793965:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000031b2b886 x1859433051942720/t0(0) o13->lustre5-OST0015-osc-MDT0001@47@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852055 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000010:29.0:1773851902.793965:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d6930c2f.
00000100:00000001:31.0:1773851902.793966:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851902.793966:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851902.793966:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:29.0:1773851902.793966:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.793967:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851902.793967:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851902.793967:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851902.793967:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851902.793968:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793968:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:29.0:1773851902.793968:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851902.793969:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851902.793969:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851902.793969:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:30.0:1773851902.793969:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000811c6a94.
00000100:00000001:29.0:1773851902.793969:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851902.793969:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851902.793970:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:30.0:1773851902.793971:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851902.793971:0:41090:0:(genops.c:1107:class_import_put()) import 000000008dbf32d7 refcount=6 obd=lustre5-OST0015-osc-MDT0001
00000020:00000001:30.0:1773851902.793972:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:30.0:1773851902.793972:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
02000000:00000001:30.0:1773851902.793973:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851902.793973:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851902.793974:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000031b2b886.
00000100:00000001:30.0:1773851902.793975:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851902.793975:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851902.793976:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851902.793976:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851902.793977:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.793977:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851902.793978:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851902.808364:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851902.808366:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851902.808368:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851902.808372:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851902.808375:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.808377:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23937@kfi7 : PUT - for me
00000400:00000200:29.0:1773851902.808379:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.808380:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 1
00000400:00000200:29.0:1773851902.808382:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:29.0:1773851902.808383:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000400:00000200:29.0:1773851902.808385:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 3
00000400:00000200:29.0:1773851902.808386:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23873@kfi7 to cpt 3
00000400:00000200:29.0:1773851902.808388:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23873@kfi7 of length 224 into portal 12 MB=0x69b4cb11d4e80
00000400:00000200:29.0:1773851902.808390:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23873@kfi7 of length 224/224 into md 0x77fe1859d [64] + 12864
00000800:00000200:29.0:1773851902.808393:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851902.808396:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851902.808397:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23937@kfi7: PUT: OK
00000100:00000001:29.0:1773851902.808399:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851902.808400:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851902.808401:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006794a36b.
00000100:00000040:29.0:1773851902.808402:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000006794a36b x1859603551571584 msgsize 224
00000100:00100000:29.0:1773851902.808404:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-23873@kfi7 (source: 12345-23937@kfi7)
00000100:00000001:29.0:1773851902.808406:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851902.808407:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000100:00000001:30.0:1773851902.808409:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851902.808410:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851902.808410:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851902.808410:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851902.808411:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851902.808412:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851902.808413:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859603551571584
00000020:00000001:30.0:1773851902.808415:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851902.808416:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff78bb2
00000020:00000001:30.0:1773851902.808417:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851902.808421:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006ca4359d refcount=5
00000020:00000001:30.0:1773851902.808422:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637109617785856 : -106964091765760 : ffff9eb77b4e7c00)
00000020:00000001:30.0:1773851902.808424:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637109617785856 : -106964091765760 : ffff9eb77b4e7c00)
00000100:00000001:30.0:1773851902.808425:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851902.808426:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851902.808427:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851902.808429:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851902.808430:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ec1fc6c0.
00000100:00000001:30.0:1773851902.808432:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851902.808433:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851902.808434:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851902.808436:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851902.808437:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851902.808438:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.808439:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851902.808441:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851902.808442:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851902.808442:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851902.808443:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851902.808444:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23873@kfi7, seq: 2055611
00000100:00000001:31.0:1773851902.808446:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851902.808446:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006ca4359d : new rpc_count 1
00000100:00000001:31.0:1773851902.808447:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.808447:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208541056 : -106943501010560 : ffff9ebc469c7980)
00000100:00000040:30.0:1773851902.808449:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006794a36b x1859603551571584/t0(0) o400->ddfa68f8-12ed-49a6-ba4e-621be0d539a7@23873@kfi7:690/0 lens 224/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1988-0'
00000100:00000001:30.0:1773851902.808454:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851902.808454:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851902.808456:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006794a36b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ddfa68f8-12ed-49a6-ba4e-621be0d539a7+5:39731:x1859603551571584:12345-23873@kfi7:400:default-tuolumne1988-0
00000100:00000200:30.0:1773851902.808458:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859603551571584
00000020:00000001:30.0:1773851902.808459:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851902.808460:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851902.808461:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.808462:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851902.808463:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851902.808465:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851902.808465:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859603551571584, found 0 last_xid 1859603551571583
00000020:00000001:30.0:1773851902.808467:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851902.808468:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851902.808469:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851902.808470:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.808471:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851902.808472:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851902.808473:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851902.808474:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f029511a.
02000000:00000001:30.0:1773851902.808475:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.808476:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.808480:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851902.808481:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915826680, transno 0, xid 1859603551571584
00010000:00000001:30.0:1773851902.808483:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851902.808484:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006794a36b x1859603551571584/t0(0) o400->ddfa68f8-12ed-49a6-ba4e-621be0d539a7@23873@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1988-0'
00010000:00000001:30.0:1773851902.808488:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851902.808489:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851902.808490:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=135 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851902.808492:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851902.808493:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000044bd0e40 refcount 3 to 23873@kfi7
00000100:00000001:30.0:1773851902.808494:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487622368 : -107151221929248 : ffff9e8be97acae0)
02000000:00000001:30.0:1773851902.808495:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851902.808496:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851902.808497:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851902.808498:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23937@kfi7
00000400:00000010:30.0:1773851902.808499:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000927f3e9e.
00000100:00000200:30.0:1773851902.808500:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859603551571584, offset 224
00000400:00000200:30.0:1773851902.808502:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23937@kfi7
00000400:00000200:30.0:1773851902.808504:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:30.0:1773851902.808505:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 1
00000400:00000200:30.0:1773851902.808506:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000400:00000200:30.0:1773851902.808509:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 3
00000400:00000200:30.0:1773851902.808510:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23937@kfi7 local destination
00000400:00000200:30.0:1773851902.808513:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770442:8770442:1024:4294967295] 23937@kfi7 LPNI seq info [427173:427173:16:4294967295]
00000400:00000200:30.0:1773851902.808515:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000400:00000200:30.0:1773851902.808516:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23937@kfi7 to cpt 7
00000400:00000200:30.0:1773851902.808519:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23937@kfi7(23937@kfi7:23937@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851902.808521:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 3
00000800:00000200:30.0:1773851902.808524:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851902.808526:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851902.808529:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851902.808533:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000deb Using peer 23937@kfi7(0x100000000000deb)
00000800:00000200:30.0:1773851902.808538:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000c05b04ad: Posted send of 324 bytes to peer 0x100000000000deb: rc=0
00000800:00000200:30.0:1773851902.808541:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000deb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851902.808543:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851902.808545:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000044bd0e40 refcount 2 to 23873@kfi7
00010000:00000001:30.0:1773851902.808546:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851902.808547:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851902.808548:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851902.808549:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006794a36b x1859603551571584/t0(0) o400->ddfa68f8-12ed-49a6-ba4e-621be0d539a7@23873@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1988-0'
00000100:00100000:30.0:1773851902.808554:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006794a36b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:ddfa68f8-12ed-49a6-ba4e-621be0d539a7+5:39731:x1859603551571584:12345-23873@kfi7:400:default-tuolumne1988-0 Request processed in 100us (151us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851902.808555:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000deb TN_EVENT_TX_OK event status 0
00000100:00100000:30.0:1773851902.808558:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23873@kfi7, seq: 2055611
00000400:00000200:29.0:1773851902.808558:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851902.808559:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23937@kfi7: PUT: OK
00000100:00000040:30.0:1773851902.808560:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006ca4359d : new rpc_count 0
00000400:00000200:29.0:1773851902.808560:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000927f3e9e
00000100:00000001:30.0:1773851902.808561:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:29.0:1773851902.808561:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000927f3e9e.
00000100:00000001:30.0:1773851902.808562:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851902.808562:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000100:00000001:29.0:1773851902.808562:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851902.808563:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:30.0:1773851902.808564:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ec1fc6c0.
00000400:00000200:29.0:1773851902.808564:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000f064373 nid 23937@kfi7 refs 2
00000020:00000010:30.0:1773851902.808565:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000020:00000040:30.0:1773851902.808566:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000006ca4359d : new refcount 4
00000800:00000200:29.0:1773851902.808566:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 23937@kfi7(00000000be437ef5):0x0 lsk 3564 rsk 41 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000deb Transaction freed
00000100:00000001:30.0:1773851902.808567:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851902.816367:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851902.816368:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851902.816369:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.816371:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851902.816373:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.816374:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13107@kfi7 : PUT - for me
00000400:00000200:5.0:1773851902.816375:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.816376:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 1
00000400:00000200:5.0:1773851902.816377:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:5.0:1773851902.816378:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000400:00000200:5.0:1773851902.816379:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 3
00000400:00000200:5.0:1773851902.816379:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13299@kfi7 to cpt 4
00000400:00000200:5.0:1773851902.816380:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13299@kfi7 of length 224 into portal 12 MB=0x699e169d11540
00000400:00000200:5.0:1773851902.816382:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13299@kfi7 of length 224/224 into md 0x793926dc5 [64] + 168680
00000800:00000200:5.0:1773851902.816383:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851902.816385:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.816385:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13107@kfi7: PUT: OK
00000100:00000001:5.0:1773851902.816386:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851902.816387:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851902.816388:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000039ed676a.
00000100:00000040:5.0:1773851902.816389:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000039ed676a x1858043282265408 msgsize 224
00000100:00100000:5.0:1773851902.816390:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-13299@kfi7 (source: 12345-13107@kfi7)
00000100:00000001:5.0:1773851902.816391:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.816391:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000800:00000200:5.0:1773851902.816392:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851902.816392:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851902.816393:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851902.816393:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851902.816394:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851902.816394:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.816395:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043282265408
00000020:00000001:4.0:1773851902.816396:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851902.816396:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91f65
00000020:00000001:4.0:1773851902.816397:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851902.816399:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005f1251dd refcount=6
00000020:00000001:4.0:1773851902.816399:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629016576 : -107123080535040 : ffff9e9276d66400)
00000020:00000001:4.0:1773851902.816400:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629016576 : -107123080535040 : ffff9e9276d66400)
00000100:00000001:4.0:1773851902.816401:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.816402:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851902.816403:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000060f2dc04.
00000020:00000010:4.0:1773851902.816404:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851902.816405:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000089183453.
00000100:00000001:4.0:1773851902.816405:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851902.816406:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851902.816406:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851902.816407:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851902.816408:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851902.816408:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.816409:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851902.816410:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.816410:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851902.816411:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851902.816411:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851902.816412:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13299@kfi7, seq: 2002008
00000100:00000040:7.0:1773851902.816413:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005f1251dd : new rpc_count 1
00000100:00000001:7.0:1773851902.816413:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637085569675392 : -106988139876224 : ffff9eb1e1ed7080)
00000100:00000001:4.0:1773851902.816413:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.816413:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851902.816415:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000039ed676a x1858043282265408/t0(0) o400->161cd7e3-04ea-4f69-a294-914022728b49@13299@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1305-0'
00000100:00000001:7.0:1773851902.816417:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851902.816418:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851902.816419:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039ed676a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:161cd7e3-04ea-4f69-a294-914022728b49+6:39702:x1858043282265408:12345-13299@kfi7:400:default-tuolumne1305-0
00000100:00000200:7.0:1773851902.816420:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043282265408
00000020:00000001:7.0:1773851902.816421:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851902.816421:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851902.816422:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851902.816423:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851902.816423:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851902.816424:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851902.816425:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043282265408, found 0 last_xid 1858043282265407
00000020:00000001:7.0:1773851902.816426:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851902.816426:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851902.816427:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851902.816428:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851902.816429:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851902.816429:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851902.816430:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851902.816431:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e6e66594.
02000000:00000001:7.0:1773851902.816432:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851902.816432:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851902.816433:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851902.816434:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096690261, transno 0, xid 1858043282265408
00010000:00000001:7.0:1773851902.816435:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851902.816436:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000039ed676a x1858043282265408/t0(0) o400->161cd7e3-04ea-4f69-a294-914022728b49@13299@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1305-0'
00010000:00000001:7.0:1773851902.816438:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851902.816439:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851902.816439:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851902.816440:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851902.816441:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000527b2cb8 refcount 3 to 13299@kfi7
00000100:00000001:7.0:1773851902.816442:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301332512 : -107155408219104 : ffff9e8aeff51420)
02000000:00000001:7.0:1773851902.816443:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851902.816443:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851902.816444:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851902.816445:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13107@kfi7
00000400:00000010:7.0:1773851902.816446:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000036a990bc.
00000100:00000200:7.0:1773851902.816447:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043282265408, offset 224
00000400:00000200:7.0:1773851902.816448:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13107@kfi7
00000400:00000200:7.0:1773851902.816449:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:7.0:1773851902.816450:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 1
00000400:00000200:7.0:1773851902.816451:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000400:00000200:7.0:1773851902.816452:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 3
00000400:00000200:7.0:1773851902.816453:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13107@kfi7 local destination
00000400:00000200:7.0:1773851902.816454:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770443:8770443:1024:4294967295] 13107@kfi7 LPNI seq info [239639:239639:16:4294967295]
00000400:00000200:7.0:1773851902.816456:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000400:00000200:7.0:1773851902.816457:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13107@kfi7 to cpt 1
00000400:00000200:7.0:1773851902.816459:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13107@kfi7(13107@kfi7:13107@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851902.816461:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 3
00000800:00000200:7.0:1773851902.816462:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851902.816463:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851902.816465:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851902.816468:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1116 Using peer 13107@kfi7(0x1116)
00000800:00000200:7.0:1773851902.816471:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x1116: rc=0
00000800:00000200:7.0:1773851902.816473:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1116 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851902.816475:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851902.816476:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000527b2cb8 refcount 2 to 13299@kfi7
00010000:00000001:7.0:1773851902.816476:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851902.816477:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851902.816478:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851902.816478:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000039ed676a x1858043282265408/t0(0) o400->161cd7e3-04ea-4f69-a294-914022728b49@13299@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1305-0'
00000100:00100000:7.0:1773851902.816481:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039ed676a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:161cd7e3-04ea-4f69-a294-914022728b49+6:39702:x1858043282265408:12345-13299@kfi7:400:default-tuolumne1305-0 Request processed in 63us (92us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851902.816484:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13299@kfi7, seq: 2002008
00000800:00000200:5.0:1773851902.816484:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1116 TN_EVENT_TX_OK event status 0
00000100:00000040:7.0:1773851902.816485:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005f1251dd : new rpc_count 0
00000100:00000001:7.0:1773851902.816486:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:7.0:1773851902.816486:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851902.816486:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:7.0:1773851902.816487:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:7.0:1773851902.816487:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000089183453.
00000400:00000200:5.0:1773851902.816487:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13107@kfi7: PUT: OK
00000400:00000200:5.0:1773851902.816487:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000036a990bc
00000020:00000010:7.0:1773851902.816488:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000060f2dc04.
00000400:00000010:5.0:1773851902.816488:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000036a990bc.
00000100:00000001:5.0:1773851902.816488:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:7.0:1773851902.816489:0:61015:0:(genops.c:882:class_export_put()) PUTting export 000000005f1251dd : new refcount 5
00000100:00000001:5.0:1773851902.816489:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851902.816490:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851902.816491:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0ec51cf nid 13107@kfi7 refs 2
00000800:00000200:5.0:1773851902.816492:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2069@kfi7:1 -> 13107@kfi7(00000000b9f6ff63):0x0 lsk 4375 rsk 48 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1116 Transaction freed
00000800:00000200:1.0:1773851902.816966:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851902.816968:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851902.816971:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851902.816975:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851902.816978:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.816980:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25202@kfi7 : PUT - for me
00000400:00000200:1.0:1773851902.816982:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.816983:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 1
00000400:00000200:1.0:1773851902.816986:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.816987:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000400:00000200:1.0:1773851902.816988:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 3
00000400:00000200:1.0:1773851902.816989:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.816991:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25202@kfi7 of length 224 into portal 12 MB=0x699e126f02080
00000400:00000200:1.0:1773851902.816993:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25202@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 55704
00000800:00000200:1.0:1773851902.816997:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851902.816999:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851902.817001:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25202@kfi7: PUT: OK
00000100:00000001:1.0:1773851902.817003:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851902.817003:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851902.817005:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000042e04729.
00000100:00000040:1.0:1773851902.817006:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000042e04729 x1858042160226432 msgsize 224
00000100:00100000:1.0:1773851902.817008:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25202@kfi7 (source: 12345-25202@kfi7)
00000100:00000001:1.0:1773851902.817010:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851902.817011:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000100:00000001:0.0:1773851902.817013:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851902.817014:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851902.817014:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851902.817015:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851902.817016:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851902.817017:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851902.817019:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042160226432
00000020:00000001:0.0:1773851902.817020:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851902.817021:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e1b
00000020:00000001:0.0:1773851902.817022:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851902.817024:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000054f30bb5 refcount=6
00000020:00000001:0.0:1773851902.817026:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744420352 : -107128965131264 : ffff9e9118169400)
00000020:00000001:0.0:1773851902.817027:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744420352 : -107128965131264 : ffff9e9118169400)
00000100:00000001:0.0:1773851902.817029:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851902.817030:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851902.817031:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000637bc2c7.
00000020:00000010:0.0:1773851902.817033:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851902.817034:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d79e9a42.
00000100:00000001:0.0:1773851902.817036:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851902.817037:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851902.817038:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851902.817040:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851902.817041:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851902.817041:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851902.817043:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851902.817046:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851902.817046:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851902.817046:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851902.817047:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851902.817049:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25202@kfi7, seq: 1997638
00000100:00000040:2.0:1773851902.817050:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000054f30bb5 : new rpc_count 1
00000100:00000001:0.0:1773851902.817050:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.817051:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117848936064 : -106955860615552 : ffff9eb965ebde80)
00000100:00000001:0.0:1773851902.817051:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851902.817054:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000042e04729 x1858042160226432/t0(0) o400->8c82da73-812f-448a-885d-a8fc9804b49c@25202@kfi7:542/0 lens 224/0 e 0 to 0 dl 1773852657 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2058-0'
00000100:00000001:2.0:1773851902.817059:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851902.817060:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851902.817061:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000042e04729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8c82da73-812f-448a-885d-a8fc9804b49c+6:39698:x1858042160226432:12345-25202@kfi7:400:default-tuolumne2058-0
00000100:00000200:2.0:1773851902.817064:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042160226432
00000020:00000001:2.0:1773851902.817065:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851902.817066:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851902.817068:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.817070:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851902.817071:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851902.817072:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851902.817073:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042160226432, found 0 last_xid 1858042160226431
00000020:00000001:2.0:1773851902.817075:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851902.817076:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851902.817077:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851902.817078:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.817079:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851902.817080:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851902.817081:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851902.817082:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000603280d7.
02000000:00000001:2.0:1773851902.817084:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.817085:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.817086:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851902.817087:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183047692922, transno 0, xid 1858042160226432
00010000:00000001:2.0:1773851902.817088:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851902.817090:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000042e04729 x1858042160226432/t0(0) o400->8c82da73-812f-448a-885d-a8fc9804b49c@25202@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2058-0'
00010000:00000001:2.0:1773851902.817094:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851902.817095:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851902.817096:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=135 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851902.817098:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851902.817100:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c283804b refcount 3 to 25202@kfi7
00000100:00000001:2.0:1773851902.817101:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850078336 : -107143859473280 : ffff9e8da050f480)
02000000:00000001:2.0:1773851902.817103:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851902.817104:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.817105:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851902.817106:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25202@kfi7
00000400:00000010:2.0:1773851902.817107:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ab3765ed.
00000100:00000200:2.0:1773851902.817108:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042160226432, offset 224
00000400:00000200:2.0:1773851902.817111:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25202@kfi7
00000400:00000200:2.0:1773851902.817112:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.817114:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 1
00000400:00000200:2.0:1773851902.817116:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000400:00000200:2.0:1773851902.817118:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 3
00000400:00000200:2.0:1773851902.817120:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25202@kfi7 local destination
00000400:00000200:2.0:1773851902.817123:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770444:8770444:1024:4294967295] 25202@kfi7 LPNI seq info [294935:294935:16:4294967295]
00000400:00000200:2.0:1773851902.817125:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000400:00000200:2.0:1773851902.817127:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25202@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.817130:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25202@kfi7(25202@kfi7:25202@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851902.817132:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 3
00000800:00000200:2.0:1773851902.817135:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851902.817136:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851902.817140:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851902.817144:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042d Using peer 25202@kfi7(0x10000000000042d)
00000800:00000200:2.0:1773851902.817149:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004991649e: Posted send of 324 bytes to peer 0x10000000000042d: rc=0
00000800:00000200:2.0:1773851902.817151:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851902.817155:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851902.817156:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c283804b refcount 2 to 25202@kfi7
00010000:00000001:2.0:1773851902.817157:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851902.817158:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.817159:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851902.817160:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000042e04729 x1858042160226432/t0(0) o400->8c82da73-812f-448a-885d-a8fc9804b49c@25202@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2058-0'
00000100:00100000:2.0:1773851902.817166:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000042e04729 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:8c82da73-812f-448a-885d-a8fc9804b49c+6:39698:x1858042160226432:12345-25202@kfi7:400:default-tuolumne2058-0 Request processed in 106us (159us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851902.817168:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042d TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851902.817170:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25202@kfi7, seq: 1997638
00000400:00000200:1.0:1773851902.817170:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:2.0:1773851902.817172:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000054f30bb5 : new rpc_count 0
00000400:00000200:1.0:1773851902.817172:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25202@kfi7: PUT: OK
00000400:00000200:1.0:1773851902.817173:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ab3765ed
00000100:00000001:2.0:1773851902.817174:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851902.817174:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:1.0:1773851902.817174:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ab3765ed.
00000100:00000001:1.0:1773851902.817175:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:2.0:1773851902.817176:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000100:00000001:1.0:1773851902.817176:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:2.0:1773851902.817177:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d79e9a42.
00000400:00000200:1.0:1773851902.817177:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000078de7f9b nid 25202@kfi7 refs 2
00000020:00000010:2.0:1773851902.817179:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000637bc2c7.
00000020:00000040:2.0:1773851902.817180:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000054f30bb5 : new refcount 5
00000800:00000200:1.0:1773851902.817180:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 25202@kfi7(00000000df1a2cdf):0x0 lsk 1070 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000042d Transaction freed
00000100:00000001:2.0:1773851902.817181:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851902.823259:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851902.823259:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851902.823261:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851902.823263:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851902.823265:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:22.0:1773851902.823267:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13056@kfi7 : PUT - for me
00000400:00000200:22.0:1773851902.823267:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:22.0:1773851902.823269:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 1
00000400:00000200:22.0:1773851902.823270:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:22.0:1773851902.823271:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000400:00000200:22.0:1773851902.823272:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 3
00000400:00000200:22.0:1773851902.823273:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13248@kfi7 to cpt 0
00000400:00000200:22.0:1773851902.823274:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13248@kfi7 of length 224 into portal 12 MB=0x699e12ce67680
00000400:00000200:22.0:1773851902.823275:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13248@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 69360
00000800:00000200:22.0:1773851902.823277:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851902.823279:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851902.823280:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13056@kfi7: PUT: OK
00000100:00000001:22.0:1773851902.823281:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851902.823282:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851902.823283:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004537cd7c.
00000100:00000040:22.0:1773851902.823283:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000004537cd7c x1858042260256384 msgsize 224
00000100:00100000:22.0:1773851902.823285:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-13248@kfi7 (source: 12345-13056@kfi7)
00000100:00000001:22.0:1773851902.823286:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851902.823287:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000100:00000001:20.0:1773851902.823288:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:22.0:1773851902.823289:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851902.823289:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851902.823289:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851902.823290:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851902.823291:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851902.823292:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042260256384
00000020:00000001:20.0:1773851902.823292:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851902.823293:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b1a
00000020:00000001:20.0:1773851902.823294:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851902.823296:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a3946b85 refcount=767
00000020:00000001:20.0:1773851902.823297:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628024320 : -107123081527296 : ffff9e9276c74000)
00000020:00000001:20.0:1773851902.823298:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628024320 : -107123081527296 : ffff9e9276c74000)
00000100:00000001:20.0:1773851902.823299:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.823300:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851902.823300:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851902.823301:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.823302:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851902.823303:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851902.823304:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851902.823304:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851902.823305:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851902.823306:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851902.823306:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.823307:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851902.823309:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851902.823309:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851902.823309:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851902.823309:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851902.823310:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13248@kfi7, seq: 1998089
00000100:00000001:23.0:1773851902.823311:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.823311:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a3946b85 : new rpc_count 8
00000100:00000001:23.0:1773851902.823312:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.823312:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382182016 : -106946327369600 : ffff9ebb9e25a880)
00000100:00000040:20.0:1773851902.823313:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004537cd7c x1858042260256384/t0(0) o400->b1994ce0-73f4-44e3-8721-2aa9fd18171a@13248@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1315-0'
00000100:00000001:20.0:1773851902.823315:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.823316:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851902.823317:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004537cd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b1994ce0-73f4-44e3-8721-2aa9fd18171a+767:39653:x1858042260256384:12345-13248@kfi7:400:default-tuolumne1315-0
00000100:00000200:20.0:1773851902.823318:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042260256384
00000020:00000001:20.0:1773851902.823319:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851902.823320:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851902.823320:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.823321:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851902.823321:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851902.823322:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851902.823323:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042260256384, found 0 last_xid 1858042214607295
00000020:00000001:20.0:1773851902.823324:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851902.823325:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851902.823325:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851902.823326:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.823326:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851902.823327:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851902.823327:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851902.823328:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006226dd56.
02000000:00000001:20.0:1773851902.823329:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.823330:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.823331:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851902.823332:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593675, transno 0, xid 1858042260256384
00010000:00000001:20.0:1773851902.823332:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851902.823333:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004537cd7c x1858042260256384/t0(0) o400->b1994ce0-73f4-44e3-8721-2aa9fd18171a@13248@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1315-0'
00010000:00000001:20.0:1773851902.823336:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851902.823336:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851902.823337:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=135 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851902.823338:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851902.823338:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000d3c4198 refcount 3 to 13248@kfi7
00000100:00000001:20.0:1773851902.823339:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052736 : -107154804498880 : ffff9e8b13f11e40)
02000000:00000001:20.0:1773851902.823340:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851902.823340:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.823341:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851902.823342:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13056@kfi7
00000400:00000010:20.0:1773851902.823343:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039a01a83.
00000100:00000200:20.0:1773851902.823344:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042260256384, offset 224
00000400:00000200:20.0:1773851902.823345:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13056@kfi7
00000400:00000200:20.0:1773851902.823346:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.823347:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 1
00000400:00000200:20.0:1773851902.823348:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000400:00000200:20.0:1773851902.823349:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 3
00000400:00000200:20.0:1773851902.823350:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13056@kfi7 local destination
00000400:00000200:20.0:1773851902.823351:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770445:8770445:1024:4294967295] 13056@kfi7 LPNI seq info [11763769:11763769:16:4294967295]
00000400:00000200:20.0:1773851902.823353:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000400:00000200:20.0:1773851902.823353:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13056@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.823355:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13056@kfi7(13056@kfi7:13056@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851902.823356:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 3
00000800:00000200:20.0:1773851902.823358:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851902.823359:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851902.823363:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851902.823365:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0xee0 Using peer 13056@kfi7(0xee0)
00000800:00000200:20.0:1773851902.823368:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0xee0: rc=0
00000800:00000200:20.0:1773851902.823369:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0xee0 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851902.823371:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.823372:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000d3c4198 refcount 2 to 13248@kfi7
00010000:00000001:20.0:1773851902.823373:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851902.823373:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.823374:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851902.823375:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004537cd7c x1858042260256384/t0(0) o400->b1994ce0-73f4-44e3-8721-2aa9fd18171a@13248@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1315-0'
00000100:00100000:20.0:1773851902.823379:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004537cd7c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b1994ce0-73f4-44e3-8721-2aa9fd18171a+767:39653:x1858042260256384:12345-13248@kfi7:400:default-tuolumne1315-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851902.823382:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13248@kfi7, seq: 1998089
00000100:00000040:20.0:1773851902.823382:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a3946b85 : new rpc_count 7
00000100:00000001:20.0:1773851902.823383:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851902.823384:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851902.823384:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.823385:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851902.823386:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851902.823387:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000a3946b85 : new refcount 766
00000100:00000001:20.0:1773851902.823387:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:22.0:1773851902.823394:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0xee0 TN_EVENT_TX_OK event status 0
00000400:00000200:22.0:1773851902.823396:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851902.823397:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13056@kfi7: PUT: OK
00000400:00000200:22.0:1773851902.823398:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039a01a83
00000400:00000010:22.0:1773851902.823399:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039a01a83.
00000100:00000001:22.0:1773851902.823399:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851902.823400:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:22.0:1773851902.823401:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000019fb9e23 nid 13056@kfi7 refs 2
00000800:00000200:22.0:1773851902.823403:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2069@kfi7:5 -> 13056@kfi7(0000000085cbb739):0x0 lsk 3809 rsk 53 tsk 0 trmk 0 tmk 0 trr 5 tta 0xee0 Transaction freed
00000800:00000200:10.0:1773851902.857406:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851902.857406:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:10.0:1773851902.857407:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851902.857407:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:10.0:1773851902.857409:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851902.857409:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851902.857411:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851902.857411:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21841@kfi7(00000000091c1cd8):0xe6f version: 2; local version 2; negotiated version: 2
00000800:00000200:9.0:1773851902.857412:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f Using peer 21841@kfi7(0x100000000000e6f)
00000400:00000200:10.0:1773851902.857413:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21841@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.857414:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21841@kfi7 : PUT - for me
00000400:00000200:9.0:1773851902.857414:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21841@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.857415:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21841@kfi7 to cpt 2
00000800:00000200:9.0:1773851902.857416:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000743dc611: Posted send of 38 bytes to peer 0x100000000000e6f: rc=0
00000400:00000200:10.0:1773851902.857417:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b54ea82 nid 21841@kfi7 refs 1
00000400:00000200:10.0:1773851902.857418:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21841@kfi7 to cpt 2
00000800:00000200:9.0:1773851902.857418:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851902.857419:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b54ea82 nid 21841@kfi7 refs 2
00000400:00000200:10.0:1773851902.857420:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b54ea82 nid 21841@kfi7 refs 3
00000400:00000200:10.0:1773851902.857421:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21904@kfi7 to cpt 2
00000400:00000200:10.0:1773851902.857422:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21904@kfi7 of length 224 into portal 12 MB=0x699e0bef13c80
00000400:00000200:10.0:1773851902.857423:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21904@kfi7 of length 224/224 into md 0x78146ce49 [64] + 168240
00000800:00000200:10.0:1773851902.857425:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851902.857426:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:10.0:1773851902.857427:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21841@kfi7: PUT: OK
00000100:00000001:10.0:1773851902.857428:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851902.857429:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851902.857429:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f TN_EVENT_TX_OK event status 0
00000100:00000010:10.0:1773851902.857430:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000fb9196ac.
00000100:00000040:10.0:1773851902.857430:0:2464469:0:(events.c:358:request_in_callback()) incoming req@00000000fb9196ac x1858040415468672 msgsize 224
00000100:00100000:10.0:1773851902.857432:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-21904@kfi7 (source: 12345-21841@kfi7)
00000800:00000200:9.0:1773851902.857432:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f Transaction freed
00000100:00000001:10.0:1773851902.857433:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:10.0:1773851902.857434:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b54ea82 nid 21841@kfi7 refs 2
00000100:00000001:8.0:1773851902.857435:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:10.0:1773851902.857436:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000000600ceff: 2054@kfi7:2 <- 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:8.0:1773851902.857436:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851902.857436:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851902.857437:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851902.857437:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851902.857438:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040415468672
00000020:00000001:8.0:1773851902.857439:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851902.857440:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b60
00000020:00000001:8.0:1773851902.857440:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851902.857443:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 000000008fe5c163 refcount=6
00000020:00000001:8.0:1773851902.857444:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628022272 : -107123081529344 : ffff9e9276c73800)
00000020:00000001:8.0:1773851902.857445:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628022272 : -107123081529344 : ffff9e9276c73800)
00000100:00000001:8.0:1773851902.857446:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851902.857446:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851902.857447:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5279bed.
00000020:00000010:8.0:1773851902.857448:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851902.857449:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e231bd3.
00000100:00000001:8.0:1773851902.857450:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851902.857450:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851902.857451:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851902.857452:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851902.857452:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851902.857453:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.857454:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851902.857455:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851902.857455:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:11.0:1773851902.857456:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851902.857456:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:8.0:1773851902.857456:0:60898:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21904@kfi7, seq: 2130893
00000100:00000001:11.0:1773851902.857457:0:60829:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.857457:0:60898:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000008fe5c163 : new rpc_count 1
00000100:00000001:11.0:1773851902.857458:0:60829:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.857458:0:60898:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087762176 : -106944621789440 : ffff9ebc03cebf00)
00000100:00000040:8.0:1773851902.857460:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000fb9196ac x1858040415468672/t0(0) o400->c067ddfe-3c69-408f-b9c3-30be380d1b9b@21904@kfi7:690/0 lens 224/0 e 0 to 0 dl 1773852050 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1858-0'
00000100:00000001:8.0:1773851902.857462:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851902.857463:0:60898:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:8.0:1773851902.857464:0:60898:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000fb9196ac pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c067ddfe-3c69-408f-b9c3-30be380d1b9b+6:39653:x1858040415468672:12345-21904@kfi7:400:default-tuolumne1858-0
00000100:00000200:8.0:1773851902.857465:0:60898:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040415468672
00000020:00000001:8.0:1773851902.857466:0:60898:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:8.0:1773851902.857466:0:60898:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:8.0:1773851902.857467:0:60898:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.857468:0:60898:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:8.0:1773851902.857469:0:60898:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:8.0:1773851902.857470:0:60898:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:8.0:1773851902.857470:0:60898:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040415468672, found 0 last_xid 1858040415468671
00000020:00000001:8.0:1773851902.857471:0:60898:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:8.0:1773851902.857472:0:60898:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:8.0:1773851902.857472:0:60898:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:8.0:1773851902.857473:0:60898:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.857473:0:60898:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:8.0:1773851902.857474:0:60898:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:8.0:1773851902.857474:0:60898:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:8.0:1773851902.857475:0:60898:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c85554fa.
02000000:00000001:8.0:1773851902.857476:0:60898:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.857477:0:60898:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.857477:0:60898:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:8.0:1773851902.857478:0:60898:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183052319744, transno 0, xid 1858040415468672
00010000:00000001:8.0:1773851902.857479:0:60898:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:8.0:1773851902.857479:0:60898:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000fb9196ac x1858040415468672/t0(0) o400->c067ddfe-3c69-408f-b9c3-30be380d1b9b@21904@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1858-0'
00010000:00000001:8.0:1773851902.857482:0:60898:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:8.0:1773851902.857482:0:60898:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851902.857483:0:60898:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=135 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851902.857484:0:60898:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:8.0:1773851902.857485:0:60898:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b58cf250 refcount 3 to 21904@kfi7
00000100:00000001:8.0:1773851902.857485:0:60898:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902581600 : -107154806970016 : ffff9e8b13cb6960)
02000000:00000001:8.0:1773851902.857486:0:60898:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:8.0:1773851902.857487:0:60898:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851902.857487:0:60898:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851902.857488:0:60898:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21841@kfi7
00000400:00000010:8.0:1773851902.857489:0:60898:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1f08bfb.
00000100:00000200:8.0:1773851902.857490:0:60898:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040415468672, offset 224
00000400:00000200:8.0:1773851902.857491:0:60898:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21841@kfi7
00000400:00000200:8.0:1773851902.857492:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21841@kfi7 to cpt 2
00000400:00000200:8.0:1773851902.857493:0:60898:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b54ea82 nid 21841@kfi7 refs 1
00000400:00000200:8.0:1773851902.857494:0:60898:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b54ea82 nid 21841@kfi7 refs 2
00000400:00000200:8.0:1773851902.857495:0:60898:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b54ea82 nid 21841@kfi7 refs 3
00000400:00000200:8.0:1773851902.857497:0:60898:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21841@kfi7 local destination
00000400:00000200:8.0:1773851902.857498:0:60898:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770446:8770446:1024:4294967295] 21841@kfi7 LPNI seq info [1353654:1353654:16:4294967295]
00000400:00000200:8.0:1773851902.857499:0:60898:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b54ea82 nid 21841@kfi7 refs 2
00000400:00000200:8.0:1773851902.857500:0:60898:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21841@kfi7 to cpt 2
00000400:00000200:8.0:1773851902.857502:0:60898:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21841@kfi7(21841@kfi7:21841@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851902.857503:0:60898:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b54ea82 nid 21841@kfi7 refs 3
00000800:00000200:8.0:1773851902.857505:0:60898:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851902.857506:0:60898:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:8.0:1773851902.857508:0:60898:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:8.0:1773851902.857510:0:60898:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f Using peer 21841@kfi7(0x100000000000e6f)
00000800:00000200:8.0:1773851902.857513:0:60898:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000d9e7a38d: Posted send of 324 bytes to peer 0x100000000000e6f: rc=0
00000800:00000200:8.0:1773851902.857514:0:60898:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851902.857516:0:60898:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851902.857517:0:60898:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b58cf250 refcount 2 to 21904@kfi7
00010000:00000001:8.0:1773851902.857518:0:60898:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:8.0:1773851902.857519:0:60898:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851902.857519:0:60898:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:8.0:1773851902.857520:0:60898:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000fb9196ac x1858040415468672/t0(0) o400->c067ddfe-3c69-408f-b9c3-30be380d1b9b@21904@kfi7:690/0 lens 224/224 e 0 to 0 dl 1773852050 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1858-0'
00000100:00100000:8.0:1773851902.857524:0:60898:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000fb9196ac pname:cluuid+ref:pid:xid:nid:opc:job mdt02_071:c067ddfe-3c69-408f-b9c3-30be380d1b9b+6:39653:x1858040415468672:12345-21904@kfi7:400:default-tuolumne1858-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:8.0:1773851902.857527:0:60898:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21904@kfi7, seq: 2130893
00000100:00000040:8.0:1773851902.857527:0:60898:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000008fe5c163 : new rpc_count 0
00000100:00000001:8.0:1773851902.857529:0:60898:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:8.0:1773851902.857529:0:60898:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:8.0:1773851902.857530:0:60898:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000020:00000010:8.0:1773851902.857530:0:60898:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e231bd3.
00000020:00000010:8.0:1773851902.857531:0:60898:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5279bed.
00000020:00000040:8.0:1773851902.857532:0:60898:0:(genops.c:882:class_export_put()) PUTting export 000000008fe5c163 : new refcount 5
00000100:00000001:8.0:1773851902.857533:0:60898:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851902.857537:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851902.857539:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851902.857540:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21841@kfi7: PUT: OK
00000400:00000200:9.0:1773851902.857541:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1f08bfb
00000400:00000010:9.0:1773851902.857542:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1f08bfb.
00000100:00000001:9.0:1773851902.857542:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851902.857543:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851902.857543:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b54ea82 nid 21841@kfi7 refs 2
00000800:00000200:9.0:1773851902.857545:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d9e7a38d: 2054@kfi7:2 -> 21841@kfi7(00000000091c1cd8):0x0 lsk 3696 rsk 48 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e6f Transaction freed
00000400:00000200:29.0:1773851902.857733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851902.857734:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:21.0:1773851902.930359:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851902.930360:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851902.930361:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851902.930363:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851902.930364:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.930366:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25667@kfi7 : PUT - for me
00000400:00000200:21.0:1773851902.930367:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.930367:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1c9107e nid 25667@kfi7 refs 1
00000400:00000200:21.0:1773851902.930368:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.930369:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1c9107e nid 25667@kfi7 refs 2
00000400:00000200:21.0:1773851902.930370:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f1c9107e nid 25667@kfi7 refs 3
00000400:00000200:21.0:1773851902.930370:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:21.0:1773851902.930371:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25667@kfi7 of length 376 into portal 12 MB=0x69b4b61bf4a00
00000400:00000200:21.0:1773851902.930372:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25667@kfi7 of length 376/376 into md 0x6a32cacf5 [64] + 69584
00000800:00000200:21.0:1773851902.930374:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851902.930376:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.930376:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25667@kfi7: PUT: OK
00000100:00000001:21.0:1773851902.930377:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851902.930378:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851902.930379:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008fd84642.
00000100:00000040:21.0:1773851902.930380:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008fd84642 x1859597925042688 msgsize 376
00000100:00100000:21.0:1773851902.930381:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25667@kfi7 (source: 12345-25667@kfi7)
00000100:00000001:21.0:1773851902.930382:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851902.930383:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f1c9107e nid 25667@kfi7 refs 2
00000100:00000001:20.0:1773851902.930383:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851902.930384:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851902.930384:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851902.930384:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851902.930385:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851902.930386:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851902.930387:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597925042688
00000020:00000001:20.0:1773851902.930387:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851902.930388:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23e74122
00000020:00000001:20.0:1773851902.930389:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851902.930389:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d60686f refcount=454
00000020:00000001:20.0:1773851902.930390:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000020:00000001:20.0:1773851902.930391:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161814443008 : -106911895108608 : ffff9ec3a2784400)
00000100:00000001:20.0:1773851902.930392:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.930393:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851902.930393:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851902.930395:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.930395:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851902.930396:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851902.930396:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:20.0:1773851902.930397:0:60934:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00000001:20.0:1773851902.930398:0:60934:0:(mdt_mds.c:170:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.930398:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.930399:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.930400:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851902.930401:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851902.930402:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851902.930402:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851902.930402:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851902.930403:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25667@kfi7, seq: 335333157
00000100:00000040:20.0:1773851902.930403:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009d60686f : new rpc_count 11
00000100:00000001:23.0:1773851902.930404:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851902.930404:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.930404:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313428096 : -106917396123520 : ffff9ec25a957080)
00000100:00000040:20.0:1773851902.930405:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008fd84642 x1859597925042688/t0(0) o101->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:629/0 lens 376/0 e 0 to 0 dl 1773851989 ref 1 fl New:/0/ffffffff rc 0/-1 job:'tuolumne-833111525036260352'
00000100:00000001:20.0:1773851902.930408:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851902.930408:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851902.930409:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008fd84642 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:edddd82f-128c-4bbd-98a4-4162bc248cc0+454:290625:x1859597925042688:12345-25667@kfi7:101:tuolumne-833111525036260352
00000100:00000200:20.0:1773851902.930411:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597925042688
00000020:00000001:20.0:1773851902.930411:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851902.930412:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851902.930413:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.930414:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851902.930414:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514144 : -1042037472 : ffffffffc1e3c520)
00000020:00000001:20.0:1773851902.930415:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851902.930416:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597925042688, found 0 last_xid 1859597917438335
00000020:00000001:20.0:1773851902.930417:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851902.930417:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851902.930418:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851902.930418:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.930419:0:60934:0:(tgt_handler.c:1395:tgt_enqueue()) Process entered
00010000:00000001:20.0:1773851902.930420:0:60934:0:(ldlm_lockd.c:1246:ldlm_handle_enqueue0()) Process entered
00010000:00010000:20.0:1773851902.930420:0:60934:0:(ldlm_lockd.c:1248:ldlm_handle_enqueue0()) ### server-side enqueue handler START
00010000:00000001:20.0:1773851902.930421:0:60934:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00000001:20.0:1773851902.930421:0:60934:0:(ldlm_lockd.c:1707:ldlm_request_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:20.0:1773851902.930424:0:60934:0:(ldlm_lock.c:1668:ldlm_lock_create()) Process entered
00010000:00000010:20.0:1773851902.930426:0:60934:0:(ldlm_resource.c:1433:ldlm_resource_new()) slab-alloced 'res': 168 at 000000002a13ce2e.
00010000:00000010:20.0:1773851902.930427:0:60934:0:(ldlm_resource.c:1419:ldlm_resource_inodebits_new()) kmalloced '(res->lr_ibits_queues)': 112 at 000000009b697ec8.
00010000:00000001:20.0:1773851902.930428:0:60934:0:(ldlm_lock.c:462:ldlm_lock_new()) Process entered
00010000:00000010:20.0:1773851902.930429:0:60934:0:(ldlm_lock.c:467:ldlm_lock_new()) slab-alloced 'lock': 544 at 000000005161bfe6.
00000020:00000001:20.0:1773851902.930430:0:60934:0:(lustre_handles.c:65:class_handle_hash()) Process entered
00000020:00000040:20.0:1773851902.930431:0:60934:0:(lustre_handles.c:97:class_handle_hash()) added object 000000005161bfe6 with handle 0x21b6f08f07a6af0d to hash
00000020:00000001:20.0:1773851902.930432:0:60934:0:(lustre_handles.c:98:class_handle_hash()) Process leaving
00010000:00000001:20.0:1773851902.930432:0:60934:0:(ldlm_lock.c:505:ldlm_lock_new()) Process leaving (rc=18446637158157076160 : -106915552475456 : ffff9ec2c87946c0)
00010000:00000010:20.0:1773851902.930433:0:60934:0:(ldlm_inodebits.c:602:ldlm_inodebits_alloc_lock()) slab-alloced 'lock->l_ibits_node': 120 at 00000000c837bfd8.
00010000:00000001:20.0:1773851902.930434:0:60934:0:(ldlm_lock.c:1715:ldlm_lock_create()) Process leaving (rc=18446637158157076160 : -106915552475456 : ffff9ec2c87946c0)
00010000:00010000:20.0:1773851902.930435:0:60934:0:(ldlm_lockd.c:1318:ldlm_handle_enqueue0()) ### server-side enqueue handler, new lock created ns: mdt-lustre5-MDT0001_UUID lock: 000000005161bfe6/0x21b6f08f07a6af0d lrc: 2/0,0 mode: --/CR res: [0x240024c16:0x4de5:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0xf113e19a5e673910 expref: -99 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1773851902.930438:0:60934:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002a13ce2e count: 1
00010000:00000040:20.0:1773851902.930439:0:60934:0:(ldlm_lockd.c:1348:ldlm_handle_enqueue0()) lock GETting export 000000009d60686f : new locks_count 377
00000020:00000040:20.0:1773851902.930440:0:60934:0:(genops.c:871:class_export_get()) GET export 000000009d60686f refcount=455
00010000:00000001:20.0:1773851902.930441:0:60934:0:(ldlm_lock.c:1770:ldlm_lock_enqueue()) Process entered
00000004:00000001:20.0:1773851902.930442:0:60934:0:(mdt_handler.c:4951:mdt_intent_policy()) Process entered
00000004:00000001:20.0:1773851902.930443:0:60934:0:(mdt_handler.c:4834:mdt_intent_opc()) Process entered
00000004:00000001:20.0:1773851902.930444:0:60934:0:(mdt_handler.c:4174:mdt_unpack_req_pack_rep()) Process entered
00000004:00000001:20.0:1773851902.930444:0:60934:0:(mdt_handler.c:4205:mdt_unpack_req_pack_rep()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851902.930445:0:60934:0:(mdt_handler.c:4615:mdt_intent_layout()) Process entered
00000004:00000040:20.0:1773851902.930445:0:60934:0:(mdt_handler.c:4626:mdt_intent_layout()) [0x240024c16:0x4de5:0x0]got layout change request from client: opc:0 flags:0x0 extent [0x0, 0x0)
00000004:00000001:20.0:1773851902.930447:0:60934:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:20.0:1773851902.930447:0:60934:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240024c16:0x4de5:0x0]
00000020:00000001:20.0:1773851902.930448:0:60934:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:20.0:1773851902.930449:0:60934:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636962183787736 : -107111525763880 : ffff9e95278e34d8)
00000004:00000001:20.0:1773851902.930450:0:60934:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636962183787648 : -107111525763968 : ffff9e95278e3480)
00000004:00000001:20.0:1773851902.930451:0:60934:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:20.0:1773851902.930453:0:60934:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:20.0:1773851902.930453:0:60934:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:20.0:1773851902.930455:0:60934:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930456:0:60934:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930456:0:60934:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000040:20.0:1773851902.930457:0:60934:0:(mdt_handler.c:4669:mdt_intent_layout()) lustre5-MDT0001: layout_size 736
00000100:00000001:20.0:1773851902.930458:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851902.930459:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851902.930460:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 1336 at 000000004540a060.
02000000:00000001:20.0:1773851902.930461:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.930461:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851902.930462:0:60934:0:(mdt_handler.c:4690:mdt_intent_layout()) Process leaving via out (rc=0 : 0 : 0x0)
00000004:00000001:20.0:1773851902.930463:0:60934:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:20.0:1773851902.930463:0:60934:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:20.0:1773851902.930464:0:60934:0:(mdt_handler.c:4921:mdt_intent_opc()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:20.0:1773851902.930465:0:60934:0:(mdt_handler.c:5007:mdt_intent_policy()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:20.0:1773851902.930465:0:60934:0:(ldlm_lock.c:1732:ldlm_lock_enqueue_helper()) Process entered
00010000:00000001:20.0:1773851902.930466:0:60934:0:(ldlm_inodebits.c:354:ldlm_process_inodebits_lock()) Process entered
00010000:00000001:20.0:1773851902.930467:0:60934:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:20.0:1773851902.930467:0:60934:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:20.0:1773851902.930468:0:60934:0:(ldlm_inodebits.c:172:ldlm_inodebits_compat_queue()) Process entered
00010000:00000001:20.0:1773851902.930468:0:60934:0:(ldlm_inodebits.c:334:ldlm_inodebits_compat_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:20.0:1773851902.930469:0:60934:0:(ldlm_lock.c:1116:ldlm_grant_lock()) Process entered
00010000:00000001:20.0:1773851902.930470:0:60934:0:(ldlm_lock.c:977:search_granted_lock()) Process entered
00010000:00000001:20.0:1773851902.930470:0:60934:0:(ldlm_lock.c:1048:search_granted_lock()) Process leaving
00010000:00000001:20.0:1773851902.930471:0:60934:0:(ldlm_lock.c:1059:ldlm_granted_list_add_lock()) Process entered
00010000:00000040:20.0:1773851902.930472:0:60934:0:(ldlm_resource.c:1797:ldlm_resource_dump()) --- Resource: [0x240024c16:0x4de5:0x0].0x0 (000000002a13ce2e) refcount = 1
00010000:00010000:20.0:1773851902.930473:0:60934:0:(ldlm_lock.c:1064:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre5-MDT0001_UUID lock: 000000005161bfe6/0x21b6f08f07a6af0d lrc: 3/0,0 mode: CR/CR res: [0x240024c16:0x4de5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 25667@kfi7 remote: 0xf113e19a5e673910 expref: 455 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1773851902.930476:0:60934:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002a13ce2e count: 1
00010000:00000001:20.0:1773851902.930477:0:60934:0:(ldlm_lock.c:1086:ldlm_granted_list_add_lock()) Process leaving
00010000:00000001:20.0:1773851902.930478:0:60934:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:20.0:1773851902.930478:0:60934:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:20.0:1773851902.930479:0:60934:0:(ldlm_lock.c:1147:ldlm_grant_lock()) Process leaving
00010000:00000001:20.0:1773851902.930479:0:60934:0:(ldlm_inodebits.c:445:ldlm_process_inodebits_lock()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:20.0:1773851902.930480:0:60934:0:(ldlm_lock.c:1743:ldlm_lock_enqueue_helper()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:20.0:1773851902.930481:0:60934:0:(ldlm_lock.c:1905:ldlm_lock_enqueue()) Process leaving via out (rc=0 : 0 : 0x0)
00010000:00000001:20.0:1773851902.930482:0:60934:0:(ldlm_lockd.c:1468:ldlm_handle_enqueue0()) Process leaving
00010000:00010000:20.0:1773851902.930483:0:60934:0:(ldlm_lockd.c:1484:ldlm_handle_enqueue0()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre5-MDT0001_UUID lock: 000000005161bfe6/0x21b6f08f07a6af0d lrc: 3/0,0 mode: CR/CR res: [0x240024c16:0x4de5:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 25667@kfi7 remote: 0xf113e19a5e673910 expref: 455 pid: 60934 timeout: 0 lvb_type: 0
00010000:00000040:20.0:1773851902.930485:0:60934:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000002a13ce2e count: 1
00000004:00000001:20.0:1773851902.930486:0:60934:0:(mdt_lvb.c:331:mdt_lvbo_fill()) Process entered
00000004:00000001:20.0:1773851902.930487:0:60934:0:(mdt_handler.c:3425:mdt_object_find()) Process entered
00000004:00000040:20.0:1773851902.930487:0:60934:0:(mdt_handler.c:3427:mdt_object_find()) Find object for [0x240024c16:0x4de5:0x0]
00000020:00000001:20.0:1773851902.930488:0:60934:0:(lu_object.c:823:lu_object_find_at()) Process entered
00000020:00000001:20.0:1773851902.930488:0:60934:0:(lu_object.c:862:lu_object_find_at()) Process leaving (rc=18446636962183787736 : -107111525763880 : ffff9e95278e34d8)
00000004:00000001:20.0:1773851902.930489:0:60934:0:(mdt_handler.c:3434:mdt_object_find()) Process leaving (rc=18446636962183787648 : -107111525763968 : ffff9e95278e3480)
00000004:00000001:20.0:1773851902.930489:0:60934:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:20.0:1773851902.930490:0:60934:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:20.0:1773851902.930490:0:60934:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:20.0:1773851902.930491:0:60934:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930491:0:60934:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930492:0:60934:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930492:0:60934:0:(mdd_object.c:396:mdd_xattr_get()) Process entered
00000004:00000001:20.0:1773851902.930493:0:60934:0:(lod_object.c:1575:lod_xattr_get()) Process entered
00080000:00000001:20.0:1773851902.930493:0:60934:0:(osd_xattr.c:323:osd_xattr_get()) Process entered
00080000:00000001:20.0:1773851902.930494:0:60934:0:(osd_xattr.c:351:osd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930494:0:60934:0:(lod_object.c:1643:lod_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930495:0:60934:0:(mdd_object.c:460:mdd_xattr_get()) Process leaving (rc=736 : 736 : 2e0)
00000004:00000001:20.0:1773851902.930495:0:60934:0:(mdt_internal.h:663:mdt_object_put()) Process entered
00000004:00000001:20.0:1773851902.930496:0:60934:0:(mdt_internal.h:665:mdt_object_put()) Process leaving
00000004:00000001:20.0:1773851902.930496:0:60934:0:(mdt_lvb.c:442:mdt_lvbo_fill()) Process leaving (rc=736 : 736 : 2e0)
00010000:00000001:20.0:1773851902.930497:0:60934:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:20.0:1773851902.930498:0:60934:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:20.0:1773851902.930498:0:60934:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x240024c16:0x4de5:0x0].0x0 (000000002a13ce2e)
00010000:00010000:20.0:1773851902.930499:0:60934:0:(ldlm_inodebits.c:96:ldlm_reprocess_inodebits_queue()) Hint 8
00010000:00000001:20.0:1773851902.930500:0:60934:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:20.0:1773851902.930500:0:60934:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:20.0:1773851902.930501:0:60934:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000001:20.0:1773851902.930502:0:60934:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:20.0:1773851902.930502:0:60934:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00010000:20.0:1773851902.930503:0:60934:0:(ldlm_lockd.c:1565:ldlm_handle_enqueue0()) ### server-side enqueue handler END (lock 000000005161bfe6, rc 0)
00000020:00000001:20.0:1773851902.930504:0:60934:0:(tgt_handler.c:1420:tgt_enqueue()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851902.930504:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264584921, transno 0, xid 1859597925042688
00010000:00000001:20.0:1773851902.930505:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851902.930506:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008fd84642 x1859597925042688/t0(0) o101->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:629/0 lens 376/1080 e 0 to 0 dl 1773851989 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111525036260352'
00010000:00000001:20.0:1773851902.930508:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851902.930509:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851902.930510:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=135 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851902.930510:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851902.930511:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bc978f5f refcount 3 to 25667@kfi7
00000100:00000001:20.0:1773851902.930512:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106880 : -107156354444736 : ffff9e8ab78ed240)
02000000:00000001:20.0:1773851902.930513:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851902.930513:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851902.930514:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851902.930515:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25667@kfi7
00000400:00000010:20.0:1773851902.930515:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000039a01a83.
00000100:00000200:20.0:1773851902.930517:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 1080 bytes to portal 10, xid 1859597925042688, offset 224
00000400:00000200:20.0:1773851902.930518:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25667@kfi7
00000400:00000200:20.0:1773851902.930519:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.930520:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f1c9107e nid 25667@kfi7 refs 1
00000400:00000200:20.0:1773851902.930521:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f1c9107e nid 25667@kfi7 refs 2
00000400:00000200:20.0:1773851902.930522:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f1c9107e nid 25667@kfi7 refs 3
00000400:00000200:20.0:1773851902.930524:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25667@kfi7 local destination
00000400:00000200:20.0:1773851902.930526:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770447:8770447:1024:4294967295] 25667@kfi7 LPNI seq info [611810:611810:16:4294967295]
00000400:00000200:20.0:1773851902.930527:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f1c9107e nid 25667@kfi7 refs 2
00000400:00000200:20.0:1773851902.930528:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25667@kfi7 to cpt 5
00000400:00000200:20.0:1773851902.930530:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25667@kfi7(25667@kfi7:25667@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851902.930531:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f1c9107e nid 25667@kfi7 refs 3
00000800:00000200:20.0:1773851902.930532:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851902.930533:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 1080 bytes in 1 frags
00000800:00000200:20.0:1773851902.930535:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851902.930538:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x666 Using peer 25667@kfi7(0x666)
00000800:00000200:20.0:1773851902.930541:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 1180 bytes to peer 0x666: rc=0
00000800:00000200:20.0:1773851902.930542:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x666 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851902.930544:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851902.930545:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bc978f5f refcount 2 to 25667@kfi7
00010000:00000001:20.0:1773851902.930546:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851902.930546:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851902.930547:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851902.930548:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008fd84642 x1859597925042688/t0(0) o101->edddd82f-128c-4bbd-98a4-4162bc248cc0@25667@kfi7:629/0 lens 376/1080 e 0 to 0 dl 1773851989 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-833111525036260352'
00000100:00100000:20.0:1773851902.930552:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008fd84642 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:edddd82f-128c-4bbd-98a4-4162bc248cc0+455:290625:x1859597925042688:12345-25667@kfi7:101:tuolumne-833111525036260352 Request processed in 143us (172us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851902.930555:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25667@kfi7, seq: 335333157
00000100:00000040:20.0:1773851902.930555:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009d60686f : new rpc_count 10
00000100:00000001:20.0:1773851902.930556:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851902.930557:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851902.930558:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a73bb9ac.
00000020:00000010:20.0:1773851902.930559:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851902.930560:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851902.930561:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009d60686f : new refcount 454
00000100:00000001:20.0:1773851902.930562:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851902.930567:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x666 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851902.930568:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851902.930569:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25667@kfi7: PUT: OK
00000400:00000200:21.0:1773851902.930570:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000039a01a83
00000400:00000010:21.0:1773851902.930570:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000039a01a83.
00000100:00000001:21.0:1773851902.930571:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851902.930571:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851902.930572:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f1c9107e nid 25667@kfi7 refs 2
00000800:00000200:21.0:1773851902.930573:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2069@kfi7:5 -> 25667@kfi7(000000009955bca4):0x0 lsk 1639 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x666 Transaction freed
00000800:00000200:1.0:1773851902.931618:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851902.931619:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851902.931621:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851902.931623:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851902.931625:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.931626:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9410@kfi7 : PUT - for me
00000400:00000200:1.0:1773851902.931627:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.931628:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 1
00000400:00000200:1.0:1773851902.931628:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.931629:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000400:00000200:1.0:1773851902.931630:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 3
00000400:00000200:1.0:1773851902.931630:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.931631:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9410@kfi7 of length 224 into portal 12 MB=0x69b4bc5aaadc0
00000400:00000200:1.0:1773851902.931633:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9410@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 55928
00000800:00000200:1.0:1773851902.931634:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851902.931636:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851902.931636:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9410@kfi7: PUT: OK
00000100:00000001:1.0:1773851902.931637:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851902.931638:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851902.931638:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007c2d7d05.
00000100:00000040:1.0:1773851902.931639:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000007c2d7d05 x1859599601413568 msgsize 224
00000100:00100000:1.0:1773851902.931640:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-9410@kfi7 (source: 12345-9410@kfi7)
00000100:00000001:1.0:1773851902.931641:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851902.931642:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000100:00000001:2.0:1773851902.931643:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851902.931643:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851902.931644:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851902.931644:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851902.931645:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851902.931645:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851902.931647:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599601413568
00000020:00000001:2.0:1773851902.931647:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851902.931648:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d777ba
00000020:00000001:2.0:1773851902.931648:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851902.931651:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004f039ce3 refcount=6
00000020:00000001:2.0:1773851902.931651:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637156959353856 : -106916750197760 : ffff9ec281157c00)
00000020:00000001:2.0:1773851902.931652:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637156959353856 : -106916750197760 : ffff9ec281157c00)
00000100:00000001:2.0:1773851902.931653:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851902.931654:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851902.931655:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851902.931656:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851902.931657:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851902.931658:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851902.931659:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851902.931659:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851902.931660:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851902.931661:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851902.931661:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.931662:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851902.931664:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851902.931664:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851902.931664:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851902.931664:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851902.931666:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9410@kfi7, seq: 1997639
00000100:00000040:2.0:1773851902.931666:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004f039ce3 : new rpc_count 2
00000100:00000001:0.0:1773851902.931667:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851902.931667:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.931668:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117848934912 : -106955860616704 : ffff9eb965ebda00)
00000100:00000040:2.0:1773851902.931669:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007c2d7d05 x1859599601413568/t0(0) o400->6d79422a-f50e-45ec-938e-37aceb27293c@9410@kfi7:542/0 lens 224/0 e 0 to 0 dl 1773852657 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1079-0'
00000100:00000001:2.0:1773851902.931671:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851902.931672:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851902.931673:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007c2d7d05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6d79422a-f50e-45ec-938e-37aceb27293c+6:39539:x1859599601413568:12345-9410@kfi7:400:default-tuolumne1079-0
00000100:00000200:2.0:1773851902.931674:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599601413568
00000020:00000001:2.0:1773851902.931675:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851902.931675:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851902.931676:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.931677:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851902.931677:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851902.931678:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851902.931678:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599601413568, found 0 last_xid 1859599600996351
00000020:00000001:2.0:1773851902.931679:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851902.931680:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851902.931680:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851902.931681:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.931682:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851902.931682:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851902.931683:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851902.931683:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f3932adb.
02000000:00000001:2.0:1773851902.931684:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.931685:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.931685:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851902.931686:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183167140555, transno 0, xid 1859599601413568
00010000:00000001:2.0:1773851902.931687:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851902.931687:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007c2d7d05 x1859599601413568/t0(0) o400->6d79422a-f50e-45ec-938e-37aceb27293c@9410@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1079-0'
00010000:00000001:2.0:1773851902.931690:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851902.931690:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851902.931691:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=135 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851902.931693:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851902.931694:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000abf8fc8a refcount 3 to 9410@kfi7
00000100:00000001:2.0:1773851902.931695:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994449216 : -107149715102400 : ffff9e8c434b2540)
02000000:00000001:2.0:1773851902.931696:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851902.931696:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.931697:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851902.931698:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9410@kfi7
00000400:00000010:2.0:1773851902.931699:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008543743c.
00000100:00000200:2.0:1773851902.931699:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599601413568, offset 224
00000400:00000200:2.0:1773851902.931701:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9410@kfi7
00000400:00000200:2.0:1773851902.931702:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.931702:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 1
00000400:00000200:2.0:1773851902.931703:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000400:00000200:2.0:1773851902.931705:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 3
00000400:00000200:2.0:1773851902.931706:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9410@kfi7 local destination
00000400:00000200:2.0:1773851902.931707:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770448:8770448:1024:4294967295] 9410@kfi7 LPNI seq info [20856471:20856471:16:4294967295]
00000400:00000200:2.0:1773851902.931709:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000400:00000200:2.0:1773851902.931709:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9410@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.931711:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9410@kfi7(9410@kfi7:9410@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851902.931712:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 3
00000800:00000200:2.0:1773851902.931714:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851902.931715:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851902.931717:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851902.931719:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007f1 Using peer 9410@kfi7(0x1000000000007f1)
00000800:00000200:2.0:1773851902.931722:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 0000000014e57432: Posted send of 324 bytes to peer 0x1000000000007f1: rc=0
00000800:00000200:2.0:1773851902.931724:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007f1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851902.931728:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851902.931730:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000abf8fc8a refcount 2 to 9410@kfi7
00010000:00000001:2.0:1773851902.931730:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851902.931731:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.931732:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851902.931732:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007c2d7d05 x1859599601413568/t0(0) o400->6d79422a-f50e-45ec-938e-37aceb27293c@9410@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1079-0'
00000100:00100000:2.0:1773851902.931735:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007c2d7d05 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:6d79422a-f50e-45ec-938e-37aceb27293c+6:39539:x1859599601413568:12345-9410@kfi7:400:default-tuolumne1079-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851902.931736:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007f1 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851902.931737:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:2.0:1773851902.931738:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9410@kfi7, seq: 1997639
00000100:00000040:2.0:1773851902.931738:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004f039ce3 : new rpc_count 1
00000400:00000200:1.0:1773851902.931738:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9410@kfi7: PUT: OK
00000100:00000001:2.0:1773851902.931739:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:1.0:1773851902.931739:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008543743c
00000100:00000001:2.0:1773851902.931740:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851902.931740:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000400:00000010:1.0:1773851902.931740:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008543743c.
00000100:00000001:1.0:1773851902.931740:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:2.0:1773851902.931741:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000100:00000001:1.0:1773851902.931741:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:2.0:1773851902.931742:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000020:00000040:2.0:1773851902.931742:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004f039ce3 : new refcount 5
00000400:00000200:1.0:1773851902.931742:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a7defd00 nid 9410@kfi7 refs 2
00000100:00000001:2.0:1773851902.931743:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851902.931743:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2054@kfi7:0 -> 9410@kfi7(00000000e7c663ed):0x0 lsk 2034 rsk 40 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000007f1 Transaction freed
00000800:00000200:13.0:1773851902.936635:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851902.936635:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851902.936636:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851902.936638:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851902.936640:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:13.0:1773851902.936642:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26224@kfi7 : PUT - for me
00000400:00000200:13.0:1773851902.936643:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:13.0:1773851902.936644:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 1
00000400:00000200:13.0:1773851902.936645:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:13.0:1773851902.936646:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000400:00000200:13.0:1773851902.936647:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 3
00000400:00000200:13.0:1773851902.936648:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26289@kfi7 to cpt 2
00000400:00000200:13.0:1773851902.936648:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26289@kfi7 of length 224 into portal 12 MB=0x699e0d4fffd40
00000400:00000200:13.0:1773851902.936650:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26289@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 62360
00000800:00000200:13.0:1773851902.936651:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851902.936653:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851902.936654:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26224@kfi7: PUT: OK
00000100:00000001:13.0:1773851902.936655:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851902.936655:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851902.936657:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ca0c9ac8.
00000100:00000040:13.0:1773851902.936658:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000ca0c9ac8 x1858040785534272 msgsize 224
00000100:00100000:13.0:1773851902.936659:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-26289@kfi7 (source: 12345-26224@kfi7)
00000100:00000001:13.0:1773851902.936660:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851902.936661:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000100:00000001:12.0:1773851902.936662:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851902.936662:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851902.936663:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851902.936663:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851902.936664:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851902.936664:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851902.936665:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040785534272
00000020:00000001:12.0:1773851902.936666:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851902.936666:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92fc6
00000020:00000001:12.0:1773851902.936667:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851902.936670:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ffe8db66 refcount=6
00000020:00000001:12.0:1773851902.936671:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744937472 : -107128964614144 : ffff9e91181e7800)
00000020:00000001:12.0:1773851902.936672:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744937472 : -107128964614144 : ffff9e91181e7800)
00000100:00000001:12.0:1773851902.936673:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851902.936674:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851902.936674:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000732ec20a.
00000020:00000010:12.0:1773851902.936675:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851902.936676:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851902.936677:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851902.936678:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851902.936678:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851902.936679:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851902.936680:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851902.936680:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.936681:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851902.936682:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851902.936682:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851902.936683:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851902.936683:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851902.936684:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26289@kfi7, seq: 2289950
00000100:00000001:14.0:1773851902.936685:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851902.936685:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851902.936685:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ffe8db66 : new rpc_count 1
00000100:00000001:12.0:1773851902.936685:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637089685644288 : -106984023907328 : ffff9eb2d7422400)
00000100:00000040:12.0:1773851902.936687:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ca0c9ac8 x1858040785534272/t0(0) o400->568d622e-1620-4ec0-bab0-846211b031a3@26289@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2126-0'
00000100:00000001:12.0:1773851902.936690:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851902.936690:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851902.936691:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ca0c9ac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:568d622e-1620-4ec0-bab0-846211b031a3+6:39768:x1858040785534272:12345-26289@kfi7:400:default-tuolumne2126-0
00000100:00000200:12.0:1773851902.936693:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040785534272
00000020:00000001:12.0:1773851902.936693:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851902.936694:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851902.936695:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.936695:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851902.936696:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851902.936697:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851902.936697:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040785534272, found 0 last_xid 1858040785534271
00000020:00000001:12.0:1773851902.936698:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851902.936699:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851902.936699:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851902.936700:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.936700:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851902.936701:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851902.936701:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851902.936702:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000083052334.
02000000:00000001:12.0:1773851902.936703:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.936703:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.936704:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851902.936705:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183013969455, transno 0, xid 1858040785534272
00010000:00000001:12.0:1773851902.936705:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851902.936706:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ca0c9ac8 x1858040785534272/t0(0) o400->568d622e-1620-4ec0-bab0-846211b031a3@26289@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2126-0'
00010000:00000001:12.0:1773851902.936709:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851902.936709:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851902.936710:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=135 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851902.936711:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851902.936712:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000200b5744 refcount 3 to 26289@kfi7
00000100:00000001:12.0:1773851902.936713:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899612768 : -107146809938848 : ffff9e8cf0746c60)
02000000:00000001:12.0:1773851902.936714:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851902.936714:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851902.936715:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851902.936716:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26224@kfi7
00000400:00000010:12.0:1773851902.936716:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000009fd0199.
00000100:00000200:12.0:1773851902.936717:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040785534272, offset 224
00000400:00000200:12.0:1773851902.936719:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26224@kfi7
00000400:00000200:12.0:1773851902.936720:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:12.0:1773851902.936720:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 1
00000400:00000200:12.0:1773851902.936722:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000400:00000200:12.0:1773851902.936723:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 3
00000400:00000200:12.0:1773851902.936724:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26224@kfi7 local destination
00000400:00000200:12.0:1773851902.936729:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770449:8770449:1024:4294967295] 26224@kfi7 LPNI seq info [878872:878872:16:4294967295]
00000400:00000200:12.0:1773851902.936731:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000400:00000200:12.0:1773851902.936732:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26224@kfi7 to cpt 3
00000400:00000200:12.0:1773851902.936734:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26224@kfi7(26224@kfi7:26224@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851902.936735:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 3
00000800:00000200:12.0:1773851902.936736:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851902.936737:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851902.936740:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851902.936742:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb9f Using peer 26224@kfi7(0xb9f)
00000800:00000200:12.0:1773851902.936745:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0xb9f: rc=0
00000800:00000200:12.0:1773851902.936746:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb9f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851902.936748:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851902.936749:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000200b5744 refcount 2 to 26289@kfi7
00010000:00000001:12.0:1773851902.936750:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851902.936751:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851902.936751:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851902.936752:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ca0c9ac8 x1858040785534272/t0(0) o400->568d622e-1620-4ec0-bab0-846211b031a3@26289@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2126-0'
00000100:00100000:12.0:1773851902.936757:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ca0c9ac8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:568d622e-1620-4ec0-bab0-846211b031a3+6:39768:x1858040785534272:12345-26289@kfi7:400:default-tuolumne2126-0 Request processed in 66us (98us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851902.936759:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26289@kfi7, seq: 2289950
00000100:00000040:12.0:1773851902.936760:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ffe8db66 : new rpc_count 0
00000100:00000001:12.0:1773851902.936761:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851902.936761:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851902.936762:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851902.936763:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851902.936763:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000732ec20a.
00000020:00000040:12.0:1773851902.936764:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000ffe8db66 : new refcount 5
00000100:00000001:12.0:1773851902.936765:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851902.936770:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb9f TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851902.936772:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851902.936773:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26224@kfi7: PUT: OK
00000400:00000200:13.0:1773851902.936774:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000009fd0199
00000400:00000010:13.0:1773851902.936774:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000009fd0199.
00000100:00000001:13.0:1773851902.936775:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851902.936775:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851902.936776:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009f78d45d nid 26224@kfi7 refs 2
00000800:00000200:13.0:1773851902.936778:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2069@kfi7:3 -> 26224@kfi7(0000000054bf3656):0x0 lsk 2976 rsk 46 tsk 0 trmk 0 tmk 0 trr 3 tta 0xb9f Transaction freed
00000800:00000200:17.0:1773851902.952224:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851902.952226:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851902.952228:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851902.952231:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851902.952234:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.952236:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8720@kfi7 : PUT - for me
00000400:00000200:17.0:1773851902.952237:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.952238:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 1
00000400:00000200:17.0:1773851902.952240:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.952241:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000400:00000200:17.0:1773851902.952242:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 3
00000400:00000200:17.0:1773851902.952244:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8721@kfi7 to cpt 7
00000800:00000200:5.0:1773851902.952244:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:17.0:1773851902.952245:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8721@kfi7 of length 224 into portal 12 MB=0x69b473fc32300
00000800:00000200:5.0:1773851902.952246:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:17.0:1773851902.952248:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8721@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 51064
00000800:00000200:5.0:1773851902.952248:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851902.952251:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851902.952251:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851902.952254:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.952255:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:17.0:1773851902.952256:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8720@kfi7: PUT: OK
00000100:00000001:17.0:1773851902.952257:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000400:00000200:5.0:1773851902.952257:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25650@kfi7 : PUT - for me
00000100:00000200:17.0:1773851902.952258:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000400:00000200:5.0:1773851902.952258:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000100:00000010:17.0:1773851902.952259:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002f8d559a.
00000100:00000040:17.0:1773851902.952260:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002f8d559a x1859580175000320 msgsize 224
00000400:00000200:5.0:1773851902.952260:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 1
00000400:00000200:5.0:1773851902.952261:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000100:00100000:17.0:1773851902.952262:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-8721@kfi7 (source: 12345-8720@kfi7)
00000400:00000200:5.0:1773851902.952262:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000100:00000001:17.0:1773851902.952264:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851902.952264:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 3
00000400:00000200:5.0:1773851902.952265:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25651@kfi7 to cpt 4
00000400:00000200:17.0:1773851902.952266:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000100:00000001:19.0:1773851902.952267:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:5.0:1773851902.952267:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25651@kfi7 of length 224 into portal 12 MB=0x69b4c3e291380
02000000:00000001:19.0:1773851902.952268:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851902.952268:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851902.952268:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851902.952269:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851902.952269:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25651@kfi7 of length 224/224 into md 0x793926dc5 [64] + 168904
02000000:00000001:19.0:1773851902.952270:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851902.952271:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580175000320
00000020:00000001:19.0:1773851902.952272:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:5.0:1773851902.952272:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000020:00000040:19.0:1773851902.952273:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3fd343
00000020:00000001:19.0:1773851902.952274:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000400:00000200:5.0:1773851902.952275:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851902.952277:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25650@kfi7: PUT: OK
00000020:00000040:19.0:1773851902.952278:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000eb040dea refcount=6
00000100:00000001:5.0:1773851902.952278:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000020:00000001:19.0:1773851902.952279:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637116516518912 : -106957193032704 : ffff9eb91680cc00)
00000100:00000200:5.0:1773851902.952279:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851902.952280:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000027a7097d.
00000020:00000001:19.0:1773851902.952281:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637116516518912 : -106957193032704 : ffff9eb91680cc00)
00000100:00000040:5.0:1773851902.952281:0:2507993:0:(events.c:358:request_in_callback()) incoming req@0000000027a7097d x1859601622963072 msgsize 224
00000100:00000001:19.0:1773851902.952282:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851902.952283:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851902.952284:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000231c32fd.
00000100:00100000:5.0:1773851902.952284:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-25651@kfi7 (source: 12345-25650@kfi7)
00000100:00000001:5.0:1773851902.952285:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000020:00000010:19.0:1773851902.952286:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851902.952287:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000400:00000200:5.0:1773851902.952287:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000100:00000001:7.0:1773851902.952288:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000100:00000001:19.0:1773851902.952289:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851902.952289:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000800:00000200:5.0:1773851902.952289:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851902.952290:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851902.952290:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851902.952291:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851902.952291:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.952292:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851902.952292:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851902.952293:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851902.952293:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851902.952294:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601622963072
00000100:00000001:19.0:1773851902.952295:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851902.952295:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851902.952296:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff82485
00000100:00000001:19.0:1773851902.952297:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851902.952297:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000020:00000001:7.0:1773851902.952297:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000100:00000001:19.0:1773851902.952298:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851902.952298:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851902.952299:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8721@kfi7, seq: 2156450
00000100:00000040:19.0:1773851902.952300:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000eb040dea : new rpc_count 2
00000020:00000040:7.0:1773851902.952300:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000046ccb84b refcount=9
00000100:00000001:16.0:1773851902.952301:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851902.952301:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108589139968 : -106965120411648 : ffff9eb73dfe9800)
00000100:00000001:19.0:1773851902.952302:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794778880 : -107029914772736 : ffff9ea827f31b00)
00000100:00000001:16.0:1773851902.952302:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851902.952302:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108589139968 : -106965120411648 : ffff9eb73dfe9800)
00000100:00000040:19.0:1773851902.952303:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002f8d559a x1859580175000320/t0(0) o400->8728b896-e97f-43f3-b7ed-6bf03b7dc567@8721@kfi7:154/0 lens 224/0 e 0 to 0 dl 1773852269 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1041-0'
00000100:00000001:7.0:1773851902.952304:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851902.952305:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851902.952306:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c33ebcf0.
00000100:00000001:19.0:1773851902.952308:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000020:00000010:7.0:1773851902.952308:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000063c4a189.
00000100:00000001:19.0:1773851902.952309:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851902.952309:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000d926879.
00000100:00100000:19.0:1773851902.952311:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002f8d559a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8728b896-e97f-43f3-b7ed-6bf03b7dc567+6:39716:x1859580175000320:12345-8721@kfi7:400:default-tuolumne1041-0
00000100:00000001:7.0:1773851902.952311:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851902.952311:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851902.952312:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:19.0:1773851902.952313:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580175000320
00000020:00000001:19.0:1773851902.952314:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000100:00000001:7.0:1773851902.952314:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000020:00000001:19.0:1773851902.952315:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000100:00000001:7.0:1773851902.952315:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851902.952315:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.952316:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.952317:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000100:00000001:7.0:1773851902.952317:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851902.952318:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851902.952319:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000100:00000001:7.0:1773851902.952319:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.952319:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851902.952319:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000001:00000001:19.0:1773851902.952320:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580175000320, found 0 last_xid 1859580174866431
00000100:00000001:7.0:1773851902.952320:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851902.952320:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25651@kfi7, seq: 2002009
00000020:00000001:19.0:1773851902.952321:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851902.952321:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.952321:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000046ccb84b : new rpc_count 1
00000020:00000001:19.0:1773851902.952322:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000100:00000001:4.0:1773851902.952322:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637097043243392 : -106976666308224 : ffff9eb48dce3180)
00000020:00000001:19.0:1773851902.952323:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000100:00000001:7.0:1773851902.952323:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.952323:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000027a7097d x1859601622963072/t0(0) o400->32324cb1-964d-4b36-8769-0612de2afa4d@25651@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2089-0'
00000020:00000001:19.0:1773851902.952324:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851902.952325:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851902.952325:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851902.952326:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00000001:4.0:1773851902.952326:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851902.952326:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
02000000:00000010:19.0:1773851902.952327:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000009e07516.
02000000:00000001:19.0:1773851902.952328:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.952328:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000027a7097d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:32324cb1-964d-4b36-8769-0612de2afa4d+9:39515:x1859601622963072:12345-25651@kfi7:400:default-tuolumne2089-0
00000100:00000001:19.0:1773851902.952329:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:4.0:1773851902.952329:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601622963072
00000020:00000001:4.0:1773851902.952330:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851902.952330:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851902.952331:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.952331:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851902.952332:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183003856728, transno 0, xid 1859580175000320
00000020:00000001:4.0:1773851902.952332:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851902.952332:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00010000:00000001:19.0:1773851902.952333:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000020:00000001:4.0:1773851902.952333:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00010000:00000200:19.0:1773851902.952334:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002f8d559a x1859580175000320/t0(0) o400->8728b896-e97f-43f3-b7ed-6bf03b7dc567@8721@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1041-0'
00000001:00000001:4.0:1773851902.952335:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601622963072, found 0 last_xid 1859601622963071
00000020:00000001:4.0:1773851902.952335:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851902.952336:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851902.952337:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851902.952337:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851902.952338:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00000020:00000001:4.0:1773851902.952338:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851902.952338:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
00010000:00000001:19.0:1773851902.952339:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851902.952339:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
00000100:00001000:19.0:1773851902.952340:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=135 v=340 (340 214 1 1)
02000000:00000010:4.0:1773851902.952340:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000085fde4d5.
02000000:00000001:4.0:1773851902.952340:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.952341:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.952342:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000020:00000001:4.0:1773851902.952342:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851902.952343:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a5150dad refcount 3 to 8721@kfi7
00010000:00000040:4.0:1773851902.952343:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182684279075, transno 0, xid 1859601622963072
00010000:00000001:4.0:1773851902.952343:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00000100:00000001:19.0:1773851902.952344:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803776 : -107130477747840 : ffff9e90bdede180)
00010000:00000200:4.0:1773851902.952344:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000027a7097d x1859601622963072/t0(0) o400->32324cb1-964d-4b36-8769-0612de2afa4d@25651@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2089-0'
02000000:00000001:19.0:1773851902.952346:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851902.952347:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851902.952347:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851902.952347:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851902.952348:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00001000:4.0:1773851902.952348:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=134 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851902.952349:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851902.952350:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8720@kfi7
00000100:00000040:4.0:1773851902.952350:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ea17a7e0 refcount 3 to 25651@kfi7
00000100:00000001:4.0:1773851902.952350:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518432 : -107156126033184 : ffff9e8ac52c1ae0)
00000400:00000010:19.0:1773851902.952351:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008f376219.
02000000:00000001:4.0:1773851902.952351:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
00000100:00000200:19.0:1773851902.952352:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580175000320, offset 224
02000000:00000001:4.0:1773851902.952352:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.952352:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851902.952353:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25650@kfi7
00000400:00000200:19.0:1773851902.952354:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8720@kfi7
00000400:00000010:4.0:1773851902.952354:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000645e16b0.
00000100:00000200:4.0:1773851902.952355:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601622963072, offset 224
00000400:00000200:19.0:1773851902.952356:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:4.0:1773851902.952356:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25650@kfi7
00000400:00000200:19.0:1773851902.952357:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 1
00000400:00000200:4.0:1773851902.952357:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:4.0:1773851902.952358:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 1
00000400:00000200:19.0:1773851902.952359:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000400:00000200:4.0:1773851902.952360:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000400:00000200:19.0:1773851902.952361:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 3
00000400:00000200:4.0:1773851902.952361:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 3
00000400:00000200:4.0:1773851902.952362:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25650@kfi7 local destination
00000400:00000200:19.0:1773851902.952363:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8720@kfi7 local destination
00000400:00000200:4.0:1773851902.952364:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770450:8770450:1024:4294967295] 25650@kfi7 LPNI seq info [261074:261074:16:4294967295]
00000400:00000200:19.0:1773851902.952366:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770451:8770451:1024:4294967295] 8720@kfi7 LPNI seq info [1851733:1851733:16:4294967295]
00000400:00000200:4.0:1773851902.952366:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000400:00000200:19.0:1773851902.952368:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000400:00000200:4.0:1773851902.952368:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25650@kfi7 to cpt 1
00000400:00000200:19.0:1773851902.952370:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8720@kfi7 to cpt 4
00000400:00000200:4.0:1773851902.952371:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25650@kfi7(25650@kfi7:25650@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851902.952372:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 3
00000400:00000200:19.0:1773851902.952374:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8720@kfi7(8720@kfi7:8720@kfi7) <?> : PUT try# 0
00000800:00000200:4.0:1773851902.952374:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851902.952375:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:19.0:1773851902.952376:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 3
00000800:00000200:4.0:1773851902.952378:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851902.952379:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851902.952381:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851902.952381:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10c5 Using peer 25650@kfi7(0x10c5)
00000800:00000200:19.0:1773851902.952384:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851902.952384:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000bac703c5: Posted send of 324 bytes to peer 0x10c5: rc=0
00000800:00000200:4.0:1773851902.952386:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10c5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:19.0:1773851902.952388:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000470 Using peer 8720@kfi7(0x100000000000470)
00000100:00000001:4.0:1773851902.952388:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851902.952389:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ea17a7e0 refcount 2 to 25651@kfi7
00010000:00000001:4.0:1773851902.952389:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851902.952390:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851902.952391:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851902.952392:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000027a7097d x1859601622963072/t0(0) o400->32324cb1-964d-4b36-8769-0612de2afa4d@25651@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2089-0'
00000800:00000200:19.0:1773851902.952393:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x100000000000470: rc=0
00000800:00000200:19.0:1773851902.952395:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000470 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00100000:4.0:1773851902.952396:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000027a7097d pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:32324cb1-964d-4b36-8769-0612de2afa4d+9:39515:x1859601622963072:12345-25651@kfi7:400:default-tuolumne2089-0 Request processed in 69us (114us total) trans 0 rc 0/0
00000100:00000001:19.0:1773851902.952398:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851902.952399:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25651@kfi7, seq: 2002009
00000100:00000040:19.0:1773851902.952400:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a5150dad refcount 2 to 8721@kfi7
00000100:00000040:4.0:1773851902.952400:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000046ccb84b : new rpc_count 0
00000100:00000001:4.0:1773851902.952400:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00010000:00000001:19.0:1773851902.952401:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851902.952401:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851902.952401:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851902.952401:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000063c4a189.
00000020:00000001:19.0:1773851902.952402:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000020:00000010:4.0:1773851902.952402:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000d926879.
00000100:00000040:19.0:1773851902.952404:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002f8d559a x1859580175000320/t0(0) o400->8728b896-e97f-43f3-b7ed-6bf03b7dc567@8721@kfi7:154/0 lens 224/224 e 0 to 0 dl 1773852269 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1041-0'
00000020:00000010:4.0:1773851902.952404:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c33ebcf0.
00000020:00000040:4.0:1773851902.952405:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000046ccb84b : new refcount 8
00000100:00000001:4.0:1773851902.952406:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851902.952410:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000470 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851902.952412:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:5.0:1773851902.952412:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10c5 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851902.952413:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002f8d559a pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8728b896-e97f-43f3-b7ed-6bf03b7dc567+6:39716:x1859580175000320:12345-8721@kfi7:400:default-tuolumne1041-0 Request processed in 104us (152us total) trans 0 rc 0/0
00000400:00000200:17.0:1773851902.952414:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8720@kfi7: PUT: OK
00000400:00000200:17.0:1773851902.952415:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008f376219
00000400:00000200:5.0:1773851902.952415:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000010:17.0:1773851902.952416:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008f376219.
00000100:00100000:19.0:1773851902.952417:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8721@kfi7, seq: 2156450
00000100:00000001:17.0:1773851902.952417:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000400:00000200:5.0:1773851902.952417:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25650@kfi7: PUT: OK
00000100:00000001:17.0:1773851902.952418:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851902.952418:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000645e16b0
00000100:00000040:19.0:1773851902.952419:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000eb040dea : new rpc_count 1
00000400:00000200:17.0:1773851902.952419:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008dc6434b nid 8720@kfi7 refs 2
00000400:00000010:5.0:1773851902.952419:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000645e16b0.
00000100:00000001:19.0:1773851902.952420:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:5.0:1773851902.952420:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:19.0:1773851902.952421:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:5.0:1773851902.952421:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851902.952422:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851902.952422:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2054@kfi7:4 -> 8720@kfi7(0000000030a2c2b1):0x0 lsk 1137 rsk 40 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000470 Transaction freed
00000400:00000200:5.0:1773851902.952422:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000006889c8a4 nid 25650@kfi7 refs 2
00000020:00000010:19.0:1773851902.952423:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000020:00000010:19.0:1773851902.952424:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000231c32fd.
00000020:00000040:19.0:1773851902.952425:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000eb040dea : new refcount 5
00000800:00000200:5.0:1773851902.952425:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bac703c5: 2069@kfi7:1 -> 25650@kfi7(000000001361ccb6):0x0 lsk 4294 rsk 9 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10c5 Transaction freed
00000100:00000001:19.0:1773851902.952426:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851902.952824:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851902.952825:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851902.952827:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851902.952830:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851902.952833:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18081@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.952835:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18081@kfi7 : PUT - for me
00000400:00000200:1.0:1773851902.952836:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18081@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.952837:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001fb30091 nid 18081@kfi7 refs 1
00000400:00000200:1.0:1773851902.952839:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18081@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.952840:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001fb30091 nid 18081@kfi7 refs 2
00000400:00000200:1.0:1773851902.952842:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001fb30091 nid 18081@kfi7 refs 3
00000400:00000200:1.0:1773851902.952843:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18017@kfi7 to cpt 5
00000400:00000200:1.0:1773851902.952844:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18017@kfi7 of length 224 into portal 12 MB=0x69b82ee054940
00000400:00000200:1.0:1773851902.952846:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18017@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 56152
00000800:00000200:1.0:1773851902.952849:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851902.952851:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851902.952853:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18081@kfi7: PUT: OK
00000100:00000001:1.0:1773851902.952854:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851902.952855:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851902.952856:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000188dd516.
00000100:00000040:1.0:1773851902.952857:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000188dd516 x1859836501641536 msgsize 224
00000100:00100000:1.0:1773851902.952859:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-18017@kfi7 (source: 12345-18081@kfi7)
00000100:00000001:1.0:1773851902.952861:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851902.952862:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001fb30091 nid 18081@kfi7 refs 2
00000100:00000001:2.0:1773851902.952863:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851902.952864:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851902.952865:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:1.0:1773851902.952865:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851902.952866:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851902.952867:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851902.952868:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859836501641536
00000020:00000001:2.0:1773851902.952869:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851902.952870:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08781d6e6a7
00000020:00000001:2.0:1773851902.952871:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851902.952875:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005602a7a2 refcount=5
00000020:00000001:2.0:1773851902.952876:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637095721517056 : -106977988034560 : ffff9eb43f064000)
00000020:00000001:2.0:1773851902.952878:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637095721517056 : -106977988034560 : ffff9eb43f064000)
00000100:00000001:2.0:1773851902.952879:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851902.952881:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851902.952882:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851902.952883:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851902.952889:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851902.952890:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851902.952891:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851902.952892:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851902.952894:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851902.952894:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851902.952895:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.952897:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851902.952899:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851902.952899:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851902.952900:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851902.952900:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851902.952902:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18017@kfi7, seq: 1997640
00000100:00000040:2.0:1773851902.952903:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005602a7a2 : new rpc_count 1
00000100:00000001:0.0:1773851902.952903:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.952905:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117848924544 : -106955860627072 : ffff9eb965ebb180)
00000100:00000001:0.0:1773851902.952905:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851902.952907:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000188dd516 x1859836501641536/t0(0) o400->799294c7-b7c7-4892-8b83-c4ee8be75c49@18017@kfi7:629/0 lens 224/0 e 0 to 0 dl 1773851989 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1616-0'
00000100:00000001:2.0:1773851902.952912:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851902.952913:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851902.952914:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000188dd516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:799294c7-b7c7-4892-8b83-c4ee8be75c49+5:40442:x1859836501641536:12345-18017@kfi7:400:default-tuolumne1616-0
00000100:00000200:2.0:1773851902.952917:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859836501641536
00000020:00000001:2.0:1773851902.952918:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851902.952919:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851902.952920:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.952921:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851902.952922:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851902.952924:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851902.952924:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859836501641536, found 0 last_xid 1859836501641535
00000020:00000001:2.0:1773851902.952926:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851902.952927:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851902.952928:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851902.952929:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.952930:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851902.952931:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851902.952932:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851902.952934:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000a46afe9.
02000000:00000001:2.0:1773851902.952935:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.952936:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.952937:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851902.952939:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183001219526, transno 0, xid 1859836501641536
00010000:00000001:2.0:1773851902.952940:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851902.952942:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000188dd516 x1859836501641536/t0(0) o400->799294c7-b7c7-4892-8b83-c4ee8be75c49@18017@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1616-0'
00010000:00000001:2.0:1773851902.952946:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851902.952947:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851902.952949:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=135 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851902.952950:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851902.952952:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004f582f4e refcount 3 to 18017@kfi7
00000100:00000001:2.0:1773851902.952953:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026240 : -107156745525376 : ffff9e8aa03f6780)
02000000:00000001:2.0:1773851902.952954:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851902.952955:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.952956:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851902.952958:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18081@kfi7
00000400:00000010:2.0:1773851902.952959:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006483d1b8.
00000100:00000200:2.0:1773851902.952960:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859836501641536, offset 224
00000400:00000200:2.0:1773851902.952963:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18081@kfi7
00000400:00000200:2.0:1773851902.952964:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18081@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.952966:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001fb30091 nid 18081@kfi7 refs 1
00000400:00000200:2.0:1773851902.952968:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001fb30091 nid 18081@kfi7 refs 2
00000400:00000200:2.0:1773851902.952970:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001fb30091 nid 18081@kfi7 refs 3
00000400:00000200:2.0:1773851902.952972:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18081@kfi7 local destination
00000400:00000200:2.0:1773851902.952974:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770452:8770452:1024:4294967295] 18081@kfi7 LPNI seq info [170573:170573:16:4294967295]
00000400:00000200:2.0:1773851902.952977:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001fb30091 nid 18081@kfi7 refs 2
00000400:00000200:2.0:1773851902.952979:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18081@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.952982:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18081@kfi7(18081@kfi7:18081@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851902.952985:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001fb30091 nid 18081@kfi7 refs 3
00000800:00000200:2.0:1773851902.952987:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851902.952990:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851902.952994:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851902.952998:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe35 Using peer 18081@kfi7(0xe35)
00000800:00000200:2.0:1773851902.953003:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000009005aa0b: Posted send of 324 bytes to peer 0xe35: rc=0
00000800:00000200:2.0:1773851902.953006:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe35 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851902.953010:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851902.953011:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004f582f4e refcount 2 to 18017@kfi7
00010000:00000001:2.0:1773851902.953013:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851902.953014:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.953015:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851902.953016:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000188dd516 x1859836501641536/t0(0) o400->799294c7-b7c7-4892-8b83-c4ee8be75c49@18017@kfi7:629/0 lens 224/224 e 0 to 0 dl 1773851989 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1616-0'
00000100:00100000:2.0:1773851902.953021:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000188dd516 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:799294c7-b7c7-4892-8b83-c4ee8be75c49+5:40442:x1859836501641536:12345-18017@kfi7:400:default-tuolumne1616-0 Request processed in 108us (163us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851902.953021:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe35 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851902.953023:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:2.0:1773851902.953025:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18017@kfi7, seq: 1997640
00000400:00000200:1.0:1773851902.953025:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18081@kfi7: PUT: OK
00000100:00000040:2.0:1773851902.953026:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005602a7a2 : new rpc_count 0
00000400:00000200:1.0:1773851902.953026:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006483d1b8
00000100:00000001:2.0:1773851902.953027:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:1.0:1773851902.953027:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006483d1b8.
00000100:00000001:2.0:1773851902.953028:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:1.0:1773851902.953028:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851902.953028:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:2.0:1773851902.953029:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000400:00000200:1.0:1773851902.953029:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001fb30091 nid 18081@kfi7 refs 2
00000020:00000010:2.0:1773851902.953030:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000020:00000010:2.0:1773851902.953031:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000800:00000200:1.0:1773851902.953031:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2069@kfi7:0 -> 18081@kfi7(00000000807a4e7b):0x0 lsk 3638 rsk 8 tsk 0 trmk 0 tmk 0 trr 0 tta 0xe35 Transaction freed
00000020:00000040:2.0:1773851902.953032:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000005602a7a2 : new refcount 4
00000100:00000001:2.0:1773851902.953032:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851902.984119:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851902.984120:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851902.984122:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851902.984125:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851902.984127:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.984129:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26032@kfi7 : PUT - for me
00000400:00000200:1.0:1773851902.984131:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.984132:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 1
00000400:00000200:1.0:1773851902.984133:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:1.0:1773851902.984134:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000400:00000200:1.0:1773851902.984136:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 3
00000400:00000200:1.0:1773851902.984137:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25968@kfi7 to cpt 5
00000400:00000200:1.0:1773851902.984138:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25968@kfi7 of length 224 into portal 12 MB=0x699e16c067ec0
00000400:00000200:1.0:1773851902.984140:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25968@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 56376
00000800:00000200:1.0:1773851902.984142:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851902.984147:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851902.984148:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26032@kfi7: PUT: OK
00000100:00000001:1.0:1773851902.984149:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851902.984150:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851902.984151:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c7896c40.
00000100:00000040:1.0:1773851902.984152:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000c7896c40 x1858043319320256 msgsize 224
00000100:00100000:1.0:1773851902.984154:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-25968@kfi7 (source: 12345-26032@kfi7)
00000100:00000001:1.0:1773851902.984155:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851902.984156:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000100:00000001:2.0:1773851902.984157:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851902.984158:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851902.984158:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851902.984159:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851902.984159:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851902.984160:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851902.984162:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043319320256
00000020:00000001:2.0:1773851902.984163:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851902.984163:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f56
00000020:00000001:2.0:1773851902.984164:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851902.984167:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009823d5b4 refcount=6
00000020:00000001:2.0:1773851902.984168:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744909824 : -107128964641792 : ffff9e91181e0c00)
00000020:00000001:2.0:1773851902.984169:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744909824 : -107128964641792 : ffff9e91181e0c00)
00000100:00000001:2.0:1773851902.984170:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851902.984171:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851902.984172:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851902.984173:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851902.984174:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851902.984175:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851902.984176:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851902.984177:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851902.984178:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851902.984178:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851902.984179:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.984180:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851902.984182:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851902.984183:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851902.984183:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:2.0:1773851902.984184:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25968@kfi7, seq: 1997641
00000100:00000001:0.0:1773851902.984184:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:2.0:1773851902.984185:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009823d5b4 : new rpc_count 1
00000100:00000001:2.0:1773851902.984186:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637117848914176 : -106955860637440 : ffff9eb965eb8900)
00000100:00000001:0.0:1773851902.984186:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851902.984186:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851902.984188:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c7896c40 x1858043319320256/t0(0) o400->0f3115da-fe03-4cb5-9f51-142871ab6186@25968@kfi7:542/0 lens 224/0 e 0 to 0 dl 1773852657 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2110-0'
00000100:00000001:2.0:1773851902.984192:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851902.984193:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851902.984194:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c7896c40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0f3115da-fe03-4cb5-9f51-142871ab6186+6:39708:x1858043319320256:12345-25968@kfi7:400:default-tuolumne2110-0
00000100:00000200:2.0:1773851902.984196:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043319320256
00000020:00000001:2.0:1773851902.984197:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851902.984198:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851902.984199:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.984200:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851902.984201:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851902.984202:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851902.984203:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043319320256, found 0 last_xid 1858043319320255
00000020:00000001:2.0:1773851902.984204:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851902.984205:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851902.984206:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851902.984206:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.984207:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851902.984208:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851902.984208:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851902.984209:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000049c2e37c.
02000000:00000001:2.0:1773851902.984210:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.984211:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.984212:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851902.984213:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183028139431, transno 0, xid 1858043319320256
00010000:00000001:2.0:1773851902.984214:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851902.984216:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c7896c40 x1858043319320256/t0(0) o400->0f3115da-fe03-4cb5-9f51-142871ab6186@25968@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2110-0'
00010000:00000001:2.0:1773851902.984220:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851902.984220:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851902.984221:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=135 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851902.984223:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851902.984224:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b7872b40 refcount 3 to 25968@kfi7
00000100:00000001:2.0:1773851902.984225:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355108032 : -107156354443584 : ffff9e8ab78ed6c0)
02000000:00000001:2.0:1773851902.984226:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851902.984227:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851902.984228:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851902.984229:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26032@kfi7
00000400:00000010:2.0:1773851902.984229:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f87ba33.
00000100:00000200:2.0:1773851902.984231:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043319320256, offset 224
00000400:00000200:2.0:1773851902.984233:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26032@kfi7
00000400:00000200:2.0:1773851902.984234:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.984235:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 1
00000400:00000200:2.0:1773851902.984238:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000400:00000200:2.0:1773851902.984239:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 3
00000400:00000200:2.0:1773851902.984241:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26032@kfi7 local destination
00000400:00000200:2.0:1773851902.984243:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770453:8770453:1024:4294967295] 26032@kfi7 LPNI seq info [3537996:3537996:16:4294967295]
00000400:00000200:2.0:1773851902.984245:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000400:00000200:2.0:1773851902.984246:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26032@kfi7 to cpt 0
00000400:00000200:2.0:1773851902.984249:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26032@kfi7(26032@kfi7:26032@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851902.984251:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 3
00000800:00000200:2.0:1773851902.984254:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851902.984255:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851902.984258:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851902.984262:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10d1 Using peer 26032@kfi7(0x10d1)
00000800:00000200:2.0:1773851902.984267:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000497e951d: Posted send of 324 bytes to peer 0x10d1: rc=0
00000800:00000200:2.0:1773851902.984269:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851902.984271:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851902.984272:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b7872b40 refcount 2 to 25968@kfi7
00010000:00000001:2.0:1773851902.984273:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851902.984274:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851902.984275:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851902.984276:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c7896c40 x1858043319320256/t0(0) o400->0f3115da-fe03-4cb5-9f51-142871ab6186@25968@kfi7:542/0 lens 224/224 e 0 to 0 dl 1773852657 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2110-0'
00000100:00100000:2.0:1773851902.984281:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c7896c40 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:0f3115da-fe03-4cb5-9f51-142871ab6186+6:39708:x1858043319320256:12345-25968@kfi7:400:default-tuolumne2110-0 Request processed in 87us (128us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851902.984283:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10d1 TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851902.984284:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25968@kfi7, seq: 1997641
00000100:00000040:2.0:1773851902.984285:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009823d5b4 : new rpc_count 0
00000100:00000001:2.0:1773851902.984286:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:1.0:1773851902.984286:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851902.984287:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:1.0:1773851902.984287:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26032@kfi7: PUT: OK
00000020:00000010:2.0:1773851902.984288:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000400:00000200:1.0:1773851902.984288:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f87ba33
00000020:00000010:2.0:1773851902.984289:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000400:00000010:1.0:1773851902.984289:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f87ba33.
00000020:00000010:2.0:1773851902.984290:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000100:00000001:1.0:1773851902.984290:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851902.984290:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:2.0:1773851902.984291:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000009823d5b4 : new refcount 5
00000400:00000200:1.0:1773851902.984291:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001c4d0ebf nid 26032@kfi7 refs 2
00000100:00000001:2.0:1773851902.984292:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851902.984293:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2069@kfi7:0 -> 26032@kfi7(00000000ab6425c0):0x0 lsk 4306 rsk 48 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10d1 Transaction freed
00000800:00000200:13.0:1773851903.004622:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851903.004622:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851903.004624:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851903.004625:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851903.004627:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.004629:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17184@kfi7 : PUT - for me
00000400:00000200:13.0:1773851903.004630:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.004631:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 1
00000400:00000200:13.0:1773851903.004632:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.004633:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000400:00000200:13.0:1773851903.004634:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 3
00000400:00000200:13.0:1773851903.004634:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17185@kfi7 to cpt 6
00000400:00000200:13.0:1773851903.004635:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17185@kfi7 of length 224 into portal 12 MB=0x69b4b7cb64680
00000400:00000200:13.0:1773851903.004636:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17185@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 62584
00000800:00000200:13.0:1773851903.004638:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851903.004640:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.004640:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17184@kfi7: PUT: OK
00000100:00000001:13.0:1773851903.004642:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851903.004642:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851903.004643:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005e97e36e.
00000100:00000040:13.0:1773851903.004644:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000005e97e36e x1859598377436800 msgsize 224
00000100:00100000:13.0:1773851903.004645:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-17185@kfi7 (source: 12345-17184@kfi7)
00000100:00000001:13.0:1773851903.004646:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851903.004647:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000800:00000200:13.0:1773851903.004648:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851903.004648:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851903.004648:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851903.004649:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851903.004649:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851903.004650:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851903.004651:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598377436800
00000020:00000001:12.0:1773851903.004651:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851903.004652:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81882
00000020:00000001:12.0:1773851903.004652:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851903.004656:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000074aec319 refcount=167
00000020:00000001:12.0:1773851903.004657:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111792243712 : -106961917307904 : ffff9eb7fcea1400)
00000020:00000001:12.0:1773851903.004657:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111792243712 : -106961917307904 : ffff9eb7fcea1400)
00000100:00000001:12.0:1773851903.004658:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.004659:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851903.004660:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000732ec20a.
00000020:00000010:12.0:1773851903.004660:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.004661:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851903.004663:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851903.004664:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851903.004664:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851903.004665:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851903.004666:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851903.004666:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.004667:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851903.004668:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851903.004668:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851903.004668:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:14.0:1773851903.004669:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851903.004669:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17185@kfi7, seq: 2289951
00000100:00000001:14.0:1773851903.004670:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851903.004670:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.004670:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000074aec319 : new rpc_count 1
00000100:00000001:12.0:1773851903.004671:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637089685639680 : -106984023911936 : ffff9eb2d7421200)
00000100:00000040:12.0:1773851903.004672:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005e97e36e x1859598377436800/t0(0) o400->eee653b6-2872-450b-b441-d87a5a423c5a@17185@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1567-0'
00000100:00000001:12.0:1773851903.004674:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.004675:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851903.004676:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005e97e36e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:eee653b6-2872-450b-b441-d87a5a423c5a+167:39597:x1859598377436800:12345-17185@kfi7:400:default-tuolumne1567-0
00000100:00000200:12.0:1773851903.004677:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598377436800
00000020:00000001:12.0:1773851903.004678:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851903.004678:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851903.004679:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.004680:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851903.004680:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851903.004681:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851903.004681:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598377436800, found 0 last_xid 1859598377010815
00000020:00000001:12.0:1773851903.004682:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851903.004683:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851903.004683:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851903.004684:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.004684:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851903.004685:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851903.004685:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851903.004686:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d7843d16.
02000000:00000001:12.0:1773851903.004687:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.004688:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.004688:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851903.004689:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264061812, transno 0, xid 1859598377436800
00010000:00000001:12.0:1773851903.004690:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851903.004691:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005e97e36e x1859598377436800/t0(0) o400->eee653b6-2872-450b-b441-d87a5a423c5a@17185@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1567-0'
00010000:00000001:12.0:1773851903.004693:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851903.004694:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851903.004694:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=136 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851903.004695:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851903.004696:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3d42dea refcount 3 to 17185@kfi7
00000100:00000001:12.0:1773851903.004697:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916643689120 : -107157065862496 : ffff9e8a8d2772a0)
02000000:00000001:12.0:1773851903.004697:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851903.004698:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.004698:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851903.004700:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17184@kfi7
00000400:00000010:12.0:1773851903.004700:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f25aa5d2.
00000100:00000200:12.0:1773851903.004701:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598377436800, offset 224
00000400:00000200:12.0:1773851903.004702:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17184@kfi7
00000400:00000200:12.0:1773851903.004703:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.004704:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 1
00000400:00000200:12.0:1773851903.004706:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000400:00000200:12.0:1773851903.004707:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 3
00000400:00000200:12.0:1773851903.004708:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17184@kfi7 local destination
00000400:00000200:12.0:1773851903.004709:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770454:8770454:1024:4294967295] 17184@kfi7 LPNI seq info [4964065:4964065:16:4294967295]
00000400:00000200:12.0:1773851903.004710:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000400:00000200:12.0:1773851903.004711:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17184@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.004714:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17184@kfi7(17184@kfi7:17184@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851903.004715:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 3
00000800:00000200:12.0:1773851903.004716:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851903.004717:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851903.004721:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851903.004724:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000da7 Using peer 17184@kfi7(0x100000000000da7)
00000800:00000200:12.0:1773851903.004729:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ef7a9c83: Posted send of 324 bytes to peer 0x100000000000da7: rc=0
00000800:00000200:12.0:1773851903.004730:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000da7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851903.004732:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.004733:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3d42dea refcount 2 to 17185@kfi7
00010000:00000001:12.0:1773851903.004734:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851903.004734:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.004735:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851903.004736:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005e97e36e x1859598377436800/t0(0) o400->eee653b6-2872-450b-b441-d87a5a423c5a@17185@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1567-0'
00000100:00100000:12.0:1773851903.004740:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005e97e36e pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:eee653b6-2872-450b-b441-d87a5a423c5a+167:39597:x1859598377436800:12345-17185@kfi7:400:default-tuolumne1567-0 Request processed in 65us (95us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851903.004742:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17185@kfi7, seq: 2289951
00000100:00000040:12.0:1773851903.004743:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000074aec319 : new rpc_count 0
00000100:00000001:12.0:1773851903.004744:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851903.004744:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851903.004745:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.004745:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851903.004746:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000732ec20a.
00000020:00000040:12.0:1773851903.004747:0:60487:0:(genops.c:882:class_export_put()) PUTting export 0000000074aec319 : new refcount 166
00000100:00000001:12.0:1773851903.004747:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851903.004754:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000da7 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851903.004755:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.004756:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17184@kfi7: PUT: OK
00000400:00000200:13.0:1773851903.004757:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f25aa5d2
00000400:00000010:13.0:1773851903.004757:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f25aa5d2.
00000100:00000001:13.0:1773851903.004758:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851903.004759:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851903.004760:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000048aa3df6 nid 17184@kfi7 refs 2
00000800:00000200:13.0:1773851903.004761:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ef7a9c83: 2054@kfi7:3 -> 17184@kfi7(00000000dc13241d):0x0 lsk 3496 rsk 24 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000da7 Transaction freed
00000800:00000200:22.0:1773851903.019122:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851903.019123:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851903.019125:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851903.019127:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851903.019129:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.019131:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13522@kfi7 : PUT - for me
00000400:00000200:22.0:1773851903.019132:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.019133:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 1
00000400:00000200:22.0:1773851903.019134:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.019135:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000400:00000200:22.0:1773851903.019136:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 3
00000400:00000200:22.0:1773851903.019137:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.019138:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13522@kfi7 of length 224 into portal 12 MB=0x699e0d8dd7040
00000400:00000200:22.0:1773851903.019140:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13522@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 69960
00000800:00000200:22.0:1773851903.019142:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851903.019144:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851903.019145:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13522@kfi7: PUT: OK
00000100:00000001:22.0:1773851903.019147:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851903.019147:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851903.019148:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000046a4ce89.
00000100:00000040:22.0:1773851903.019149:0:2456945:0:(events.c:358:request_in_callback()) incoming req@0000000046a4ce89 x1858040850378816 msgsize 224
00000100:00100000:22.0:1773851903.019151:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-13522@kfi7 (source: 12345-13522@kfi7)
00000100:00000001:22.0:1773851903.019152:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851903.019153:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000800:00000200:22.0:1773851903.019154:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851903.019154:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851903.019154:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851903.019155:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851903.019156:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851903.019157:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851903.019158:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040850378816
00000020:00000001:20.0:1773851903.019158:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851903.019159:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91bbb
00000020:00000001:20.0:1773851903.019160:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851903.019165:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000da179c1d refcount=6
00000020:00000001:20.0:1773851903.019166:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628017152 : -107123081534464 : ffff9e9276c72400)
00000020:00000001:20.0:1773851903.019167:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628017152 : -107123081534464 : ffff9e9276c72400)
00000100:00000001:20.0:1773851903.019168:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.019169:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851903.019170:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851903.019171:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.019172:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851903.019173:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851903.019174:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851903.019174:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.019175:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851903.019176:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851903.019177:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.019178:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.019179:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851903.019180:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851903.019180:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851903.019180:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851903.019181:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13522@kfi7, seq: 1998090
00000100:00000001:23.0:1773851903.019182:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.019182:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000da179c1d : new rpc_count 1
00000100:00000001:23.0:1773851903.019183:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.019183:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127382188928 : -106946327362688 : ffff9ebb9e25c380)
00000100:00000040:20.0:1773851903.019184:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000046a4ce89 x1858040850378816/t0(0) o400->b0a8b929-be92-42d5-8320-c2004ce3aa74@13522@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1333-0'
00000100:00000001:20.0:1773851903.019189:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.019189:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851903.019190:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000046a4ce89 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b0a8b929-be92-42d5-8320-c2004ce3aa74+6:39806:x1858040850378816:12345-13522@kfi7:400:default-tuolumne1333-0
00000100:00000200:20.0:1773851903.019192:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040850378816
00000020:00000001:20.0:1773851903.019192:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851903.019193:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851903.019194:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.019195:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851903.019195:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851903.019196:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851903.019197:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040850378816, found 0 last_xid 1858040850378815
00000020:00000001:20.0:1773851903.019198:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851903.019199:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851903.019199:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851903.019200:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.019201:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851903.019201:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851903.019202:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851903.019203:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001954d559.
02000000:00000001:20.0:1773851903.019204:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.019205:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.019205:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851903.019206:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 173177117327, transno 0, xid 1858040850378816
00010000:00000001:20.0:1773851903.019207:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851903.019208:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000046a4ce89 x1858040850378816/t0(0) o400->b0a8b929-be92-42d5-8320-c2004ce3aa74@13522@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1333-0'
00010000:00000001:20.0:1773851903.019211:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851903.019211:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851903.019212:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=136 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851903.019213:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851903.019214:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000066d61f3d refcount 3 to 13522@kfi7
00000100:00000001:20.0:1773851903.019215:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027680 : -107156745523936 : ffff9e8aa03f6d20)
02000000:00000001:20.0:1773851903.019216:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851903.019217:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.019218:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851903.019219:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13522@kfi7
00000400:00000010:20.0:1773851903.019220:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003cda9dd5.
00000100:00000200:20.0:1773851903.019220:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040850378816, offset 224
00000400:00000200:20.0:1773851903.019222:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13522@kfi7
00000400:00000200:20.0:1773851903.019223:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.019224:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 1
00000400:00000200:20.0:1773851903.019225:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000400:00000200:20.0:1773851903.019226:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 3
00000400:00000200:20.0:1773851903.019227:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13522@kfi7 local destination
00000400:00000200:20.0:1773851903.019229:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770455:8770455:1024:4294967295] 13522@kfi7 LPNI seq info [15736:15736:16:4294967295]
00000400:00000200:20.0:1773851903.019231:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000400:00000200:20.0:1773851903.019231:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13522@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.019234:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13522@kfi7(13522@kfi7:13522@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851903.019235:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 3
00000800:00000200:20.0:1773851903.019237:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851903.019238:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851903.019240:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851903.019243:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000452 Using peer 13522@kfi7(0x100000000000452)
00000800:00000200:20.0:1773851903.019246:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x100000000000452: rc=0
00000800:00000200:20.0:1773851903.019247:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000452 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851903.019249:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.019250:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000066d61f3d refcount 2 to 13522@kfi7
00010000:00000001:20.0:1773851903.019251:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851903.019252:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.019253:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851903.019253:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000046a4ce89 x1858040850378816/t0(0) o400->b0a8b929-be92-42d5-8320-c2004ce3aa74@13522@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1333-0'
00000100:00100000:20.0:1773851903.019257:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000046a4ce89 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b0a8b929-be92-42d5-8320-c2004ce3aa74+6:39806:x1858040850378816:12345-13522@kfi7:400:default-tuolumne1333-0 Request processed in 67us (107us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851903.019259:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13522@kfi7, seq: 1998090
00000100:00000040:20.0:1773851903.019260:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000da179c1d : new rpc_count 0
00000100:00000001:20.0:1773851903.019261:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851903.019261:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851903.019262:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.019262:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851903.019263:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851903.019264:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000da179c1d : new refcount 5
00000100:00000001:20.0:1773851903.019265:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.019269:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000452 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851903.019271:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.019272:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13522@kfi7: PUT: OK
00000400:00000200:21.0:1773851903.019272:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003cda9dd5
00000400:00000010:21.0:1773851903.019273:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003cda9dd5.
00000100:00000001:21.0:1773851903.019273:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851903.019274:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851903.019274:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004841b626 nid 13522@kfi7 refs 2
00000800:00000200:21.0:1773851903.019276:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2054@kfi7:5 -> 13522@kfi7(00000000ef8f400b):0x0 lsk 1107 rsk 61 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000452 Transaction freed
00000800:00000200:13.0:1773851903.047426:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851903.047427:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851903.047428:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851903.047430:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851903.047432:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.047433:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13058@kfi7 : PUT - for me
00000400:00000200:13.0:1773851903.047434:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.047435:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 1
00000400:00000200:13.0:1773851903.047436:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.047437:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000400:00000200:13.0:1773851903.047438:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 3
00000400:00000200:13.0:1773851903.047439:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.047440:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13058@kfi7 of length 224 into portal 12 MB=0x69b4b6b5a8940
00000400:00000200:13.0:1773851903.047441:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13058@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 62808
00000800:00000200:13.0:1773851903.047443:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851903.047444:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.047445:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13058@kfi7: PUT: OK
00000100:00000001:13.0:1773851903.047446:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851903.047446:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851903.047447:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000038c1eab2.
00000100:00000040:13.0:1773851903.047448:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000038c1eab2 x1859598086211904 msgsize 224
00000100:00100000:13.0:1773851903.047449:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13058@kfi7 (source: 12345-13058@kfi7)
00000100:00000001:13.0:1773851903.047450:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851903.047451:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000100:00000001:12.0:1773851903.047452:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851903.047452:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851903.047453:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851903.047453:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851903.047453:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851903.047454:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851903.047455:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598086211904
00000020:00000001:12.0:1773851903.047456:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851903.047456:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e06d
00000020:00000001:12.0:1773851903.047457:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851903.047462:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c346a78b refcount=5
00000020:00000001:12.0:1773851903.047462:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636920812368896 : -107152897182720 : ffff9e8b85a07400)
00000020:00000001:12.0:1773851903.047463:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636920812368896 : -107152897182720 : ffff9e8b85a07400)
00000100:00000001:12.0:1773851903.047464:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.047465:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851903.047466:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000732ec20a.
00000020:00000010:12.0:1773851903.047467:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.047467:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851903.047468:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851903.047469:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851903.047469:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851903.047470:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851903.047471:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851903.047471:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.047472:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851903.047473:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851903.047473:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851903.047474:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851903.047474:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851903.047475:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13058@kfi7, seq: 2289952
00000100:00000040:12.0:1773851903.047475:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c346a78b : new rpc_count 1
00000100:00000001:14.0:1773851903.047476:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851903.047476:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.047476:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092546816 : -106946617004800 : ffff9ebb8ce22d00)
00000100:00000040:12.0:1773851903.047477:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000038c1eab2 x1859598086211904/t0(0) o400->aa4c535c-afaa-414b-a725-478a416db45e@13058@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1319-0'
00000100:00000001:12.0:1773851903.047480:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.047480:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851903.047481:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000038c1eab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:aa4c535c-afaa-414b-a725-478a416db45e+5:39710:x1859598086211904:12345-13058@kfi7:400:default-tuolumne1319-0
00000100:00000200:12.0:1773851903.047483:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598086211904
00000020:00000001:12.0:1773851903.047483:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851903.047484:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851903.047485:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.047486:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851903.047487:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851903.047487:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851903.047488:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598086211904, found 0 last_xid 1859598086211903
00000020:00000001:12.0:1773851903.047489:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851903.047490:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851903.047490:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851903.047491:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.047491:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851903.047492:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851903.047493:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851903.047493:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004642b5fe.
02000000:00000001:12.0:1773851903.047494:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.047495:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.047495:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851903.047496:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183210479690, transno 0, xid 1859598086211904
00010000:00000001:12.0:1773851903.047497:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851903.047497:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000038c1eab2 x1859598086211904/t0(0) o400->aa4c535c-afaa-414b-a725-478a416db45e@13058@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1319-0'
00010000:00000001:12.0:1773851903.047500:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851903.047500:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851903.047501:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=136 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851903.047502:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851903.047503:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004e14d67a refcount 3 to 13058@kfi7
00000100:00000001:12.0:1773851903.047503:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636922487620352 : -107151221931264 : ffff9e8be97ac300)
02000000:00000001:12.0:1773851903.047504:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851903.047505:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.047506:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851903.047506:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13058@kfi7
00000400:00000010:12.0:1773851903.047507:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a2534e29.
00000100:00000200:12.0:1773851903.047508:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598086211904, offset 224
00000400:00000200:12.0:1773851903.047509:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13058@kfi7
00000400:00000200:12.0:1773851903.047510:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.047510:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 1
00000400:00000200:12.0:1773851903.047513:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000400:00000200:12.0:1773851903.047514:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 3
00000400:00000200:12.0:1773851903.047515:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13058@kfi7 local destination
00000400:00000200:12.0:1773851903.047516:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770456:8770456:1024:4294967295] 13058@kfi7 LPNI seq info [7000136:7000136:16:4294967295]
00000400:00000200:12.0:1773851903.047518:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000400:00000200:12.0:1773851903.047518:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13058@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.047520:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13058@kfi7(13058@kfi7:13058@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851903.047521:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 3
00000800:00000200:12.0:1773851903.047523:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851903.047524:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851903.047526:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851903.047528:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007e2 Using peer 13058@kfi7(0x1000000000007e2)
00000800:00000200:12.0:1773851903.047531:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000007e6c72d6: Posted send of 324 bytes to peer 0x1000000000007e2: rc=0
00000800:00000200:12.0:1773851903.047532:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851903.047535:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.047535:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004e14d67a refcount 2 to 13058@kfi7
00010000:00000001:12.0:1773851903.047536:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851903.047537:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.047537:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851903.047538:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000038c1eab2 x1859598086211904/t0(0) o400->aa4c535c-afaa-414b-a725-478a416db45e@13058@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1319-0'
00000100:00100000:12.0:1773851903.047543:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000038c1eab2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:aa4c535c-afaa-414b-a725-478a416db45e+5:39710:x1859598086211904:12345-13058@kfi7:400:default-tuolumne1319-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851903.047545:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13058@kfi7, seq: 2289952
00000100:00000040:12.0:1773851903.047545:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c346a78b : new rpc_count 0
00000100:00000001:12.0:1773851903.047547:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851903.047547:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851903.047548:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.047549:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851903.047550:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000732ec20a.
00000020:00000040:12.0:1773851903.047550:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000c346a78b : new refcount 4
00000100:00000001:12.0:1773851903.047551:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851903.047556:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007e2 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851903.047557:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.047558:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13058@kfi7: PUT: OK
00000400:00000200:13.0:1773851903.047559:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a2534e29
00000400:00000010:13.0:1773851903.047560:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a2534e29.
00000100:00000001:13.0:1773851903.047560:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851903.047561:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851903.047562:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001c7125d6 nid 13058@kfi7 refs 2
00000800:00000200:13.0:1773851903.047563:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007e6c72d6: 2054@kfi7:3 -> 13058@kfi7(00000000e663ae61):0x0 lsk 2019 rsk 5 tsk 0 trmk 0 tmk 0 trr 3 tta 0x1000000000007e2 Transaction freed
00000800:00000200:25.0:1773851903.048962:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851903.048962:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851903.048963:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851903.048965:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851903.048967:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.048969:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9603@kfi7 : PUT - for me
00000400:00000200:25.0:1773851903.048969:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.048970:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 1
00000400:00000200:25.0:1773851903.048971:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.048974:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000400:00000200:25.0:1773851903.048975:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 3
00000400:00000200:25.0:1773851903.048975:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9602@kfi7 to cpt 3
00000400:00000200:25.0:1773851903.048977:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9602@kfi7 of length 224 into portal 12 MB=0x69aa079d6d3c0
00000400:00000200:25.0:1773851903.048978:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9602@kfi7 of length 224/224 into md 0x16159c9699 [64] + 44936
00000800:00000200:25.0:1773851903.048979:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851903.048981:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.048982:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9603@kfi7: PUT: OK
00000100:00000001:25.0:1773851903.048983:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851903.048983:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851903.048984:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003edd3add.
00000100:00000040:25.0:1773851903.048985:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000003edd3add x1858863889830848 msgsize 224
00000100:00100000:25.0:1773851903.048986:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-9602@kfi7 (source: 12345-9603@kfi7)
00000100:00000001:25.0:1773851903.048987:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851903.048988:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000100:00000001:26.0:1773851903.048989:0:41182:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:26.0:1773851903.048990:0:41182:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:26.0:1773851903.048990:0:41182:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:25.0:1773851903.048990:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:26.0:1773851903.048991:0:41182:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851903.048991:0:41182:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:26.0:1773851903.048992:0:41182:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863889830848
00000020:00000001:26.0:1773851903.048993:0:41182:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:26.0:1773851903.048993:0:41182:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92975
00000020:00000001:26.0:1773851903.048994:0:41182:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:26.0:1773851903.048996:0:41182:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ea320856 refcount=6
00000020:00000001:26.0:1773851903.048997:0:41182:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743172096 : -107128966379520 : ffff9e9118038800)
00000020:00000001:26.0:1773851903.048998:0:41182:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743172096 : -107128966379520 : ffff9e9118038800)
00000100:00000001:26.0:1773851903.048998:0:41182:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:26.0:1773851903.048999:0:41182:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:26.0:1773851903.049000:0:41182:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009f5cb6f5.
00000020:00000010:26.0:1773851903.049001:0:41182:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000dd0d8078.
00000020:00000010:26.0:1773851903.049002:0:41182:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b4ceb708.
00000100:00000001:26.0:1773851903.049003:0:41182:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:26.0:1773851903.049003:0:41182:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:26.0:1773851903.049004:0:41182:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851903.049004:0:41182:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:26.0:1773851903.049005:0:41182:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:26.0:1773851903.049005:0:41182:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851903.049006:0:41182:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851903.049008:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851903.049009:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851903.049010:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9602@kfi7, seq: 2025197
00000100:00000040:24.0:1773851903.049010:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ea320856 : new rpc_count 1
00000100:00000001:24.0:1773851903.049011:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157388672 : -106936552162944 : ffff9ebde4cb7980)
00000100:00000040:24.0:1773851903.049013:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003edd3add x1858863889830848/t0(0) o400->de176814-41b9-488d-aaa3-7c60066e77ac@9602@kfi7:153/0 lens 224/0 e 0 to 0 dl 1773852268 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1096-0'
00000100:00000001:24.0:1773851903.049015:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851903.049016:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851903.049017:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003edd3add pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:de176814-41b9-488d-aaa3-7c60066e77ac+6:39020:x1858863889830848:12345-9602@kfi7:400:default-tuolumne1096-0
00000100:00000200:24.0:1773851903.049018:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863889830848
00000020:00000001:24.0:1773851903.049018:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851903.049019:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851903.049020:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.049021:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851903.049021:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851903.049022:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851903.049022:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863889830848, found 0 last_xid 1858863889830847
00000020:00000001:24.0:1773851903.049023:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851903.049024:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851903.049024:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851903.049025:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.049025:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851903.049026:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851903.049027:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851903.049027:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000dae1f2b1.
02000000:00000001:24.0:1773851903.049028:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.049029:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.049029:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851903.049030:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475272696, transno 0, xid 1858863889830848
00010000:00000001:24.0:1773851903.049031:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851903.049032:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003edd3add x1858863889830848/t0(0) o400->de176814-41b9-488d-aaa3-7c60066e77ac@9602@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1096-0'
00010000:00000001:24.0:1773851903.049034:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851903.049035:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851903.049036:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=136 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851903.049037:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851903.049037:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d8ca4473 refcount 3 to 9602@kfi7
00000100:00000001:24.0:1773851903.049038:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917729298304 : -107155980253312 : ffff9e8acddc8780)
02000000:00000001:24.0:1773851903.049039:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851903.049040:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.049040:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851903.049041:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9603@kfi7
00000400:00000010:24.0:1773851903.049042:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007c583f63.
00000100:00000200:24.0:1773851903.049043:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863889830848, offset 224
00000400:00000200:24.0:1773851903.049044:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9603@kfi7
00000400:00000200:24.0:1773851903.049045:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.049046:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 1
00000400:00000200:24.0:1773851903.049047:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000400:00000200:24.0:1773851903.049048:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 3
00000400:00000200:24.0:1773851903.049049:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9603@kfi7 local destination
00000400:00000200:24.0:1773851903.049050:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770457:8770457:1024:4294967295] 9603@kfi7 LPNI seq info [17361:17361:16:4294967295]
00000400:00000200:24.0:1773851903.049052:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000400:00000200:24.0:1773851903.049053:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9603@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.049055:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9603@kfi7(9603@kfi7:9603@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851903.049056:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 3
00000800:00000200:24.0:1773851903.049057:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851903.049058:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851903.049060:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851903.049063:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f3a Using peer 9603@kfi7(0x100000000000f3a)
00000800:00000200:24.0:1773851903.049067:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x100000000000f3a: rc=0
00000800:00000200:24.0:1773851903.049069:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f3a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851903.049071:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851903.049072:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d8ca4473 refcount 2 to 9602@kfi7
00010000:00000001:24.0:1773851903.049073:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851903.049073:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.049074:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851903.049075:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003edd3add x1858863889830848/t0(0) o400->de176814-41b9-488d-aaa3-7c60066e77ac@9602@kfi7:153/0 lens 224/224 e 0 to 0 dl 1773852268 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1096-0'
00000100:00100000:24.0:1773851903.049080:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003edd3add pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:de176814-41b9-488d-aaa3-7c60066e77ac+6:39020:x1858863889830848:12345-9602@kfi7:400:default-tuolumne1096-0 Request processed in 63us (94us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851903.049082:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9602@kfi7, seq: 2025197
00000100:00000040:24.0:1773851903.049083:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ea320856 : new rpc_count 0
00000100:00000001:24.0:1773851903.049084:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851903.049084:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851903.049085:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000dd0d8078.
00000020:00000010:24.0:1773851903.049086:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b4ceb708.
00000020:00000010:24.0:1773851903.049087:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009f5cb6f5.
00000020:00000040:24.0:1773851903.049088:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000ea320856 : new refcount 5
00000100:00000001:24.0:1773851903.049089:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851903.049094:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f3a TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851903.049096:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.049097:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9603@kfi7: PUT: OK
00000400:00000200:25.0:1773851903.049098:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007c583f63
00000400:00000010:25.0:1773851903.049098:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007c583f63.
00000100:00000001:25.0:1773851903.049099:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851903.049099:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851903.049100:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000013ece61a nid 9603@kfi7 refs 2
00000800:00000200:25.0:1773851903.049102:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 9603@kfi7(000000005c2d504a):0x0 lsk 3899 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f3a Transaction freed
00000800:00000200:21.0:1773851903.092439:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851903.092440:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851903.092442:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851903.092445:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851903.092448:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.092450:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13569@kfi7 : PUT - for me
00000400:00000200:21.0:1773851903.092452:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.092453:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 1
00000400:00000200:21.0:1773851903.092455:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.092456:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000400:00000200:21.0:1773851903.092458:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 3
00000400:00000200:21.0:1773851903.092459:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13760@kfi7 to cpt 4
00000400:00000200:21.0:1773851903.092460:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13760@kfi7 of length 224 into portal 12 MB=0x69b8239a6ae00
00000400:00000200:21.0:1773851903.092462:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13760@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 70184
00000800:00000200:21.0:1773851903.092465:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851903.092468:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.092469:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13569@kfi7: PUT: OK
00000100:00000001:21.0:1773851903.092470:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851903.092471:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851903.092472:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002ea0fce8.
00000100:00000040:21.0:1773851903.092473:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002ea0fce8 x1859833475542528 msgsize 224
00000100:00100000:21.0:1773851903.092476:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-13760@kfi7 (source: 12345-13569@kfi7)
00000100:00000001:21.0:1773851903.092477:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851903.092479:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000100:00000001:20.0:1773851903.092480:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851903.092481:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851903.092481:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851903.092481:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851903.092482:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851903.092483:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851903.092484:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859833475542528
00000020:00000001:20.0:1773851903.092485:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851903.092486:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0875d32bfbe
00000020:00000001:20.0:1773851903.092487:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851903.092491:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000de8a2683 refcount=5
00000020:00000001:20.0:1773851903.092492:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637144875876352 : -106928833675264 : ffff9ebfb0da4000)
00000020:00000001:20.0:1773851903.092493:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637144875876352 : -106928833675264 : ffff9ebfb0da4000)
00000100:00000001:20.0:1773851903.092495:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.092496:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851903.092497:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851903.092499:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.092500:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851903.092501:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851903.092503:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851903.092504:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.092506:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851903.092506:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851903.092507:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.092509:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851903.092511:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.092511:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.092511:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851903.092512:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851903.092513:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13760@kfi7, seq: 1998091
00000100:00000001:23.0:1773851903.092514:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.092514:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000de8a2683 : new rpc_count 1
00000100:00000001:23.0:1773851903.092515:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.092515:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313424640 : -106917396126976 : ffff9ec25a956300)
00000100:00000040:20.0:1773851903.092517:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002ea0fce8 x1859833475542528/t0(0) o400->b554442c-f36c-48c6-8f35-ced70d428437@13760@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1347-0'
00000100:00000001:20.0:1773851903.092522:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.092522:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851903.092524:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002ea0fce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b554442c-f36c-48c6-8f35-ced70d428437+5:39871:x1859833475542528:12345-13760@kfi7:400:default-tuolumne1347-0
00000100:00000200:20.0:1773851903.092526:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859833475542528
00000020:00000001:20.0:1773851903.092527:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851903.092528:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851903.092529:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.092530:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851903.092531:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851903.092532:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851903.092533:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859833475542528, found 0 last_xid 1859833475542527
00000020:00000001:20.0:1773851903.092534:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851903.092535:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851903.092536:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851903.092537:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.092538:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851903.092538:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851903.092539:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851903.092542:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c423e641.
02000000:00000001:20.0:1773851903.092543:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.092545:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.092546:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851903.092547:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413757282, transno 0, xid 1859833475542528
00010000:00000001:20.0:1773851903.092548:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851903.092550:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002ea0fce8 x1859833475542528/t0(0) o400->b554442c-f36c-48c6-8f35-ced70d428437@13760@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1347-0'
00010000:00000001:20.0:1773851903.092554:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851903.092555:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851903.092556:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=136 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851903.092557:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851903.092558:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000021553fb9 refcount 3 to 13760@kfi7
00000100:00000001:20.0:1773851903.092560:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583516512 : -107156126035104 : ffff9e8ac52c1360)
02000000:00000001:20.0:1773851903.092561:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851903.092561:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.092563:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851903.092564:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13569@kfi7
00000400:00000010:20.0:1773851903.092565:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fe5250b8.
00000100:00000200:20.0:1773851903.092566:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859833475542528, offset 224
00000400:00000200:20.0:1773851903.092568:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13569@kfi7
00000400:00000200:20.0:1773851903.092569:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.092570:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 1
00000400:00000200:20.0:1773851903.092572:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000400:00000200:20.0:1773851903.092574:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 3
00000400:00000200:20.0:1773851903.092576:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13569@kfi7 local destination
00000400:00000200:20.0:1773851903.092578:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770458:8770458:1024:4294967295] 13569@kfi7 LPNI seq info [4793181:4793181:16:4294967295]
00000400:00000200:20.0:1773851903.092580:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000400:00000200:20.0:1773851903.092581:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13569@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.092585:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13569@kfi7(13569@kfi7:13569@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851903.092587:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 3
00000800:00000200:20.0:1773851903.092589:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851903.092590:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851903.092597:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851903.092601:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbc7 Using peer 13569@kfi7(0xbc7)
00000800:00000200:20.0:1773851903.092605:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0xbc7: rc=0
00000800:00000200:20.0:1773851903.092608:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbc7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851903.092611:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.092612:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000021553fb9 refcount 2 to 13760@kfi7
00010000:00000001:20.0:1773851903.092614:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851903.092614:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.092618:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851903.092619:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002ea0fce8 x1859833475542528/t0(0) o400->b554442c-f36c-48c6-8f35-ced70d428437@13760@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1347-0'
00000100:00100000:20.0:1773851903.092624:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002ea0fce8 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:b554442c-f36c-48c6-8f35-ced70d428437+5:39871:x1859833475542528:12345-13760@kfi7:400:default-tuolumne1347-0 Request processed in 102us (150us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851903.092628:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13760@kfi7, seq: 1998091
00000100:00000040:20.0:1773851903.092630:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000de8a2683 : new rpc_count 0
00000100:00000001:20.0:1773851903.092631:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851903.092632:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851903.092633:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.092634:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851903.092635:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851903.092636:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000de8a2683 : new refcount 4
00000100:00000001:20.0:1773851903.092637:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.092645:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbc7 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851903.092647:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.092649:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13569@kfi7: PUT: OK
00000400:00000200:21.0:1773851903.092650:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fe5250b8
00000400:00000010:21.0:1773851903.092651:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fe5250b8.
00000100:00000001:21.0:1773851903.092652:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851903.092653:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851903.092654:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000b5c3cc3 nid 13569@kfi7 refs 2
00000800:00000200:21.0:1773851903.092657:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 13569@kfi7(000000006285609f):0x0 lsk 3016 rsk 30 tsk 0 trmk 0 tmk 0 trr 5 tta 0xbc7 Transaction freed
00000800:00000200:9.0:1773851903.102320:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851903.102321:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851903.102322:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851903.102325:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851903.102328:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.102329:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.31@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851903.102330:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.102332:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851903.102333:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.31@o2ib60 to cpt 0
00000400:00000200:9.0:1773851903.102335:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 2
00000400:00000200:9.0:1773851903.102337:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 3
00000400:00000200:9.0:1773851903.102338:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.31@o2ib60 to cpt 0
00000400:00000200:9.0:1773851903.102340:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.31@o2ib60 of length 224 into portal 12 MB=0x69b877c8ee7c0
00000400:00000200:9.0:1773851903.102342:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.31@o2ib60 of length 224/224 into md 0x7fb56e801 [64] + 56600
00000800:00000200:9.0:1773851903.102345:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851903.102347:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851903.102348:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851903.102350:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851903.102350:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851903.102351:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000050d7714b.
00000100:00000040:9.0:1773851903.102352:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000050d7714b x1859856072894400 msgsize 224
00000100:00100000:9.0:1773851903.102355:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.31@o2ib60 (source: 12345-192.168.128.31@o2ib60)
00000100:00000001:9.0:1773851903.102357:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851903.102358:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851903.102360:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851903.102362:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851903.102363:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851903.102364:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851903.102365:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851903.102366:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851903.102368:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859856072894400
00000020:00000001:2.0:1773851903.102369:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851903.102369:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f088c6a10317
00000020:00000001:2.0:1773851903.102370:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851903.102373:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004ff8a158 refcount=5
00000020:00000001:2.0:1773851903.102375:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637142213413888 : -106931496137728 : ffff9ebf12284c00)
00000020:00000001:2.0:1773851903.102376:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637142213413888 : -106931496137728 : ffff9ebf12284c00)
00000100:00000001:2.0:1773851903.102378:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.102380:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851903.102381:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851903.102383:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.102384:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851903.102386:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851903.102386:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851903.102387:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.102389:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851903.102390:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851903.102391:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.102393:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.102395:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851903.102396:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851903.102396:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.102397:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851903.102399:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.31@o2ib60, seq: 1997642
00000100:00000040:2.0:1773851903.102400:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004ff8a158 : new rpc_count 1
00000100:00000001:0.0:1773851903.102400:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.102401:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.102403:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498330624 : -106953211220992 : ffff9eba03d66c00)
00000100:00000040:2.0:1773851903.102405:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000050d7714b x1859856072894400/t0(0) o400->33817210-3a80-455d-8b39-e62572be47a5@192.168.128.31@o2ib60:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix31-0'
00000100:00000001:2.0:1773851903.102411:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.102411:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851903.102413:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000050d7714b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:33817210-3a80-455d-8b39-e62572be47a5+5:39853:x1859856072894400:12345-192.168.128.31@o2ib60:400:default-matrix31-0
00000100:00000200:2.0:1773851903.102416:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859856072894400
00000020:00000001:2.0:1773851903.102417:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851903.102418:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851903.102419:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.102420:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851903.102421:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851903.102423:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851903.102424:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859856072894400, found 0 last_xid 1859856072894399
00000020:00000001:2.0:1773851903.102425:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851903.102427:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851903.102428:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851903.102428:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.102430:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851903.102431:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851903.102432:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851903.102433:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000aec5e091.
02000000:00000001:2.0:1773851903.102434:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.102435:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.102436:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851903.102437:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182425071597, transno 0, xid 1859856072894400
00010000:00000001:2.0:1773851903.102439:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851903.102441:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000050d7714b x1859856072894400/t0(0) o400->33817210-3a80-455d-8b39-e62572be47a5@192.168.128.31@o2ib60:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix31-0'
00010000:00000001:2.0:1773851903.102446:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851903.102447:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851903.102448:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=136 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851903.102451:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851903.102452:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e03b5cee refcount 3 to 192.168.128.31@o2ib60
00000100:00000001:2.0:1773851903.102454:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905050816 : -107154804500800 : ffff9e8b13f116c0)
02000000:00000001:2.0:1773851903.102455:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851903.102456:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.102457:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851903.102458:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.31@o2ib60
00000400:00000010:2.0:1773851903.102459:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000983b994a.
00000100:00000200:2.0:1773851903.102461:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859856072894400, offset 224
00000400:00000200:2.0:1773851903.102463:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.31@o2ib60
00000400:00000200:2.0:1773851903.102465:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.31@o2ib60 to cpt 0
00000400:00000200:2.0:1773851903.102467:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 2
00000400:00000200:2.0:1773851903.102470:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 3
00000400:00000200:2.0:1773851903.102472:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 4
00000400:00000200:2.0:1773851903.102475:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.31@o2ib60 routed destination
00000400:00000200:2.0:1773851903.102477:0:60951:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:2.0:1773851903.102478:0:60951:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:2.0:1773851903.102481:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.31@o2ib60: rtr pref emtpy: 1
00000400:00000200:2.0:1773851903.102483:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:2.0:1773851903.102484:0:60951:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.31@o2ib60: rtr pref emtpy: 1
00000400:00000200:2.0:1773851903.102486:0:60951:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:2.0:1773851903.102487:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770459:8770459:1024:4294967295] 17@kfi7 LPNI seq info [1250891928:1250891928:16:4294967295]
00000400:00000200:2.0:1773851903.102490:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:2.0:1773851903.102491:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:2.0:1773851903.102495:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.31@o2ib60(192.168.128.31@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851903.102498:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003cfeeb83 nid 192.168.128.31@o2ib60 refs 3
00000800:00000200:2.0:1773851903.102500:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851903.102503:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851903.102506:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851903.102525:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:2.0:1773851903.102530:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000497e951d: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:2.0:1773851903.102532:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851903.102536:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.102538:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e03b5cee refcount 2 to 192.168.128.31@o2ib60
00010000:00000001:2.0:1773851903.102539:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851903.102540:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.102541:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851903.102542:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000050d7714b x1859856072894400/t0(0) o400->33817210-3a80-455d-8b39-e62572be47a5@192.168.128.31@o2ib60:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix31-0'
00000100:00100000:2.0:1773851903.102548:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000050d7714b pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:33817210-3a80-455d-8b39-e62572be47a5+5:39853:x1859856072894400:12345-192.168.128.31@o2ib60:400:default-matrix31-0 Request processed in 136us (194us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851903.102548:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851903.102550:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:2.0:1773851903.102552:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.31@o2ib60, seq: 1997642
00000400:00000200:1.0:1773851903.102552:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000400:00000200:1.0:1773851903.102553:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000983b994a
00000100:00000040:2.0:1773851903.102554:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004ff8a158 : new rpc_count 0
00000400:00000010:1.0:1773851903.102554:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000983b994a.
00000100:00000001:2.0:1773851903.102555:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:1.0:1773851903.102555:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851903.102556:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851903.102556:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000100:00000001:1.0:1773851903.102556:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:2.0:1773851903.102557:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000400:00000200:1.0:1773851903.102557:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000020:00000010:2.0:1773851903.102559:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000800:00000200:1.0:1773851903.102559:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000497e951d: 2054@kfi7:0 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 0 tta 0x20000000000001a Transaction freed
00000020:00000040:2.0:1773851903.102560:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000004ff8a158 : new refcount 4
00000100:00000001:2.0:1773851903.102561:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851903.113729:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113729:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851903.113730:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113730:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851903.113731:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113731:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851903.113732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851903.113734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851903.113735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851903.113736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851903.113737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851903.113737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851903.113740:0:849254:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851903.113740:0:849254:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851903.113741:0:849254:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:1.0:1773851903.146086:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851903.146087:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851903.146087:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:3.0:1773851903.146088:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851903.146088:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:3.0:1773851903.146089:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d86b7001: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851903.146090:0:2494030:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21712@kfi7(0000000061f3ad23):0x377 version: 2; local version 2; negotiated version: 2
00000800:00000200:3.0:1773851903.146091:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d86b7001: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851903.146092:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000800:00000200:1.0:1773851903.146092:0:2494030:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 Using peer 21712@kfi7(0x100000000000377)
00000400:00000200:3.0:1773851903.146093:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21712@kfi7 : PUT - for me
00000400:00000200:3.0:1773851903.146094:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.146094:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:3.0:1773851903.146095:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 1
00000400:00000200:3.0:1773851903.146096:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:3.0:1773851903.146096:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000800:00000200:1.0:1773851903.146096:0:2494030:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000cc4d90e2: Posted send of 38 bytes to peer 0x100000000000377: rc=0
00000400:00000200:3.0:1773851903.146097:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 3
00000800:00000200:1.0:1773851903.146097:0:2494030:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:3.0:1773851903.146098:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:3.0:1773851903.146099:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21712@kfi7 of length 224 into portal 12 MB=0x699e0a7029ec0
00000400:00000200:3.0:1773851903.146100:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21712@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 56824
00000800:00000200:3.0:1773851903.146102:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d86b7001: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851903.146104:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851903.146105:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21712@kfi7: PUT: OK
00000100:00000001:3.0:1773851903.146106:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851903.146106:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851903.146107:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d8f0219f.
00000100:00000040:3.0:1773851903.146108:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000d8f0219f x1858040013954752 msgsize 224
00000800:00000200:1.0:1773851903.146109:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 TN_EVENT_TX_OK event status 0
00000100:00100000:3.0:1773851903.146110:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-21712@kfi7 (source: 12345-21712@kfi7)
00000100:00000001:3.0:1773851903.146111:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851903.146111:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000800:00000200:1.0:1773851903.146111:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 Transaction freed
00000100:00000001:2.0:1773851903.146112:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851903.146112:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851903.146113:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d86b7001: 2054@kfi7:0 <- 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851903.146113:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851903.146113:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851903.146114:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851903.146114:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040013954752
00000020:00000001:2.0:1773851903.146115:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851903.146115:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9289c
00000020:00000001:2.0:1773851903.146116:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851903.146117:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000075bb3aec refcount=6
00000020:00000001:2.0:1773851903.146118:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742966272 : -107128966585344 : ffff9e9118006400)
00000020:00000001:2.0:1773851903.146118:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742966272 : -107128966585344 : ffff9e9118006400)
00000100:00000001:2.0:1773851903.146119:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.146121:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851903.146121:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851903.146122:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.146122:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851903.146123:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851903.146123:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851903.146124:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.146125:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851903.146125:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851903.146125:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.146126:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.146127:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851903.146127:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851903.146128:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21712@kfi7, seq: 1997643
00000100:00000001:0.0:1773851903.146128:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.146128:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:2.0:1773851903.146130:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000075bb3aec : new rpc_count 1
00000100:00000001:2.0:1773851903.146130:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109288722048 : -106964420829568 : ffff9eb767b15e80)
00000100:00000001:0.0:1773851903.146130:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.146130:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.146131:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d8f0219f x1858040013954752/t0(0) o400->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1841-0'
00000100:00000001:2.0:1773851903.146134:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.146134:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851903.146135:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d8f0219f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:45cc513a-aa46-4716-a011-ea6a00158659+6:39691:x1858040013954752:12345-21712@kfi7:400:default-tuolumne1841-0
00000100:00000200:2.0:1773851903.146136:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040013954752
00000020:00000001:2.0:1773851903.146137:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851903.146137:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851903.146138:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.146138:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851903.146139:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851903.146140:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851903.146140:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040013954752, found 0 last_xid 1858040013954751
00000020:00000001:2.0:1773851903.146141:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851903.146141:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851903.146142:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851903.146142:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.146143:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851903.146143:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851903.146144:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851903.146144:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005b67ea9f.
02000000:00000001:2.0:1773851903.146145:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.146145:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.146146:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851903.146147:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154595829, transno 0, xid 1858040013954752
00010000:00000001:2.0:1773851903.146147:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851903.146148:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d8f0219f x1858040013954752/t0(0) o400->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1841-0'
00010000:00000001:2.0:1773851903.146151:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851903.146151:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851903.146152:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=136 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851903.146153:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851903.146153:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006edcb5ed refcount 3 to 21712@kfi7
00000100:00000001:2.0:1773851903.146154:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451232 : -107149715100384 : ffff9e8c434b2d20)
02000000:00000001:2.0:1773851903.146155:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851903.146155:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.146156:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851903.146157:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21712@kfi7
00000400:00000010:2.0:1773851903.146157:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000983b994a.
00000100:00000200:2.0:1773851903.146158:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040013954752, offset 224
00000400:00000200:2.0:1773851903.146159:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21712@kfi7
00000400:00000200:2.0:1773851903.146160:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.146161:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 1
00000400:00000200:2.0:1773851903.146161:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000400:00000200:2.0:1773851903.146162:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 3
00000400:00000200:2.0:1773851903.146163:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21712@kfi7 local destination
00000400:00000200:2.0:1773851903.146164:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770460:8770460:1024:4294967295] 21712@kfi7 LPNI seq info [3936249:3936249:16:4294967295]
00000400:00000200:2.0:1773851903.146166:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000400:00000200:2.0:1773851903.146166:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21712@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.146168:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21712@kfi7(21712@kfi7:21712@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851903.146169:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 3
00000800:00000200:2.0:1773851903.146170:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851903.146171:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851903.146173:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851903.146175:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 Using peer 21712@kfi7(0x100000000000377)
00000800:00000200:2.0:1773851903.146178:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000009005aa0b: Posted send of 324 bytes to peer 0x100000000000377: rc=0
00000800:00000200:2.0:1773851903.146179:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851903.146183:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.146184:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006edcb5ed refcount 2 to 21712@kfi7
00010000:00000001:2.0:1773851903.146185:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851903.146185:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.146186:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851903.146186:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d8f0219f x1858040013954752/t0(0) o400->45cc513a-aa46-4716-a011-ea6a00158659@21712@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1841-0'
00000100:00100000:2.0:1773851903.146189:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d8f0219f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:45cc513a-aa46-4716-a011-ea6a00158659+6:39691:x1858040013954752:12345-21712@kfi7:400:default-tuolumne1841-0 Request processed in 55us (81us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851903.146191:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851903.146192:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21712@kfi7, seq: 1997643
00000100:00000040:2.0:1773851903.146192:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000075bb3aec : new rpc_count 0
00000400:00000200:1.0:1773851903.146192:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:2.0:1773851903.146193:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851903.146193:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:1.0:1773851903.146193:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21712@kfi7: PUT: OK
00000020:00000010:2.0:1773851903.146194:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.146194:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000400:00000200:1.0:1773851903.146194:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000983b994a
00000400:00000010:1.0:1773851903.146194:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000983b994a.
00000020:00000010:2.0:1773851903.146195:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000020:00000040:2.0:1773851903.146195:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000075bb3aec : new refcount 5
00000100:00000001:1.0:1773851903.146195:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851903.146195:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:2.0:1773851903.146196:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851903.146196:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000061b0bb85 nid 21712@kfi7 refs 2
00000800:00000200:1.0:1773851903.146197:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009005aa0b: 2054@kfi7:0 -> 21712@kfi7(0000000061f3ad23):0x0 lsk 888 rsk 53 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000377 Transaction freed
00000800:00000200:25.0:1773851903.196163:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851903.196164:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851903.196165:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851903.196167:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851903.196169:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.196170:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8739@kfi7 : PUT - for me
00000400:00000200:25.0:1773851903.196171:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.196172:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 1
00000400:00000200:25.0:1773851903.196174:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.196174:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:25.0:1773851903.196175:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000400:00000200:25.0:1773851903.196176:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8931@kfi7 to cpt 0
00000400:00000200:25.0:1773851903.196177:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8931@kfi7 of length 224 into portal 12 MB=0x69b09e5d91a00
00000400:00000200:25.0:1773851903.196179:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8931@kfi7 of length 224/224 into md 0x16159c9699 [64] + 45160
00000800:00000200:25.0:1773851903.196180:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851903.196182:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.196183:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8739@kfi7: PUT: OK
00000100:00000001:25.0:1773851903.196184:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851903.196184:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851903.196185:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dba6c613.
00000100:00000040:25.0:1773851903.196186:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000dba6c613 x1859316673485312 msgsize 224
00000100:00100000:25.0:1773851903.196187:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-8931@kfi7 (source: 12345-8739@kfi7)
00000100:00000001:25.0:1773851903.196189:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851903.196190:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000100:00000001:24.0:1773851903.196190:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851903.196190:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851903.196191:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851903.196191:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851903.196192:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851903.196192:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851903.196193:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316673485312
00000020:00000001:24.0:1773851903.196194:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851903.196194:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9111f
00000020:00000001:24.0:1773851903.196195:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851903.196197:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000006b8dd11 refcount=9
00000020:00000001:24.0:1773851903.196199:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000020:00000001:24.0:1773851903.196199:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240339456 : -107152469212160 : ffff9e8b9f22c400)
00000100:00000001:24.0:1773851903.196201:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851903.196201:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851903.196202:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000030bb5633.
00000020:00000010:24.0:1773851903.196203:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851903.196204:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851903.196205:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851903.196205:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851903.196206:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851903.196207:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851903.196208:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851903.196208:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.196209:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851903.196210:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851903.196211:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851903.196211:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8931@kfi7, seq: 2025198
00000100:00000001:26.0:1773851903.196212:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:24.0:1773851903.196212:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000006b8dd11 : new rpc_count 1
00000100:00000001:26.0:1773851903.196213:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851903.196213:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.196213:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157373696 : -106936552177920 : ffff9ebde4cb3f00)
00000100:00000040:24.0:1773851903.196214:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dba6c613 x1859316673485312/t0(0) o400->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1035-0'
00000100:00000001:26.0:1773851903.196215:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.196217:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851903.196217:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851903.196218:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dba6c613 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:39779:x1859316673485312:12345-8931@kfi7:400:default-tuolumne1035-0
00000100:00000200:24.0:1773851903.196219:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316673485312
00000020:00000001:24.0:1773851903.196220:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851903.196221:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851903.196221:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.196222:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851903.196223:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851903.196223:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851903.196224:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316673485312, found 0 last_xid 1859316673485311
00000020:00000001:24.0:1773851903.196225:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851903.196226:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851903.196226:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851903.196227:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.196228:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851903.196228:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851903.196229:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851903.196230:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000277ce113.
02000000:00000001:24.0:1773851903.196230:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.196231:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.196231:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851903.196232:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183058200468, transno 0, xid 1859316673485312
00010000:00000001:24.0:1773851903.196233:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851903.196233:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dba6c613 x1859316673485312/t0(0) o400->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1035-0'
00010000:00000001:24.0:1773851903.196236:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851903.196236:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851903.196237:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=136 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851903.196238:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851903.196239:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000b4216c8 refcount 3 to 8931@kfi7
00000100:00000001:24.0:1773851903.196240:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918905052832 : -107154804498784 : ffff9e8b13f11ea0)
02000000:00000001:24.0:1773851903.196240:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851903.196241:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.196241:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851903.196242:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8739@kfi7
00000400:00000010:24.0:1773851903.196243:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c206b7b6.
00000100:00000200:24.0:1773851903.196243:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316673485312, offset 224
00000400:00000200:24.0:1773851903.196245:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8739@kfi7
00000400:00000200:24.0:1773851903.196246:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.196247:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 1
00000400:00000200:24.0:1773851903.196248:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:24.0:1773851903.196249:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000400:00000200:24.0:1773851903.196250:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8739@kfi7 local destination
00000400:00000200:24.0:1773851903.196251:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770461:8770461:1024:4294967295] 8739@kfi7 LPNI seq info [2192107:2192107:16:4294967295]
00000400:00000200:24.0:1773851903.196253:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000400:00000200:24.0:1773851903.196254:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8739@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.196255:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8739@kfi7(8739@kfi7:8739@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851903.196257:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 3
00000800:00000200:24.0:1773851903.196258:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851903.196259:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851903.196261:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851903.196263:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2aa Using peer 8739@kfi7(0x2aa)
00000800:00000200:24.0:1773851903.196266:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0x2aa: rc=0
00000800:00000200:24.0:1773851903.196268:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2aa TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851903.196270:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851903.196270:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000b4216c8 refcount 2 to 8931@kfi7
00010000:00000001:24.0:1773851903.196271:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851903.196272:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.196272:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851903.196273:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dba6c613 x1859316673485312/t0(0) o400->060c0146-d4d1-4a42-8c8d-241eaa2f523c@8931@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1035-0'
00000100:00100000:24.0:1773851903.196276:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dba6c613 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:060c0146-d4d1-4a42-8c8d-241eaa2f523c+9:39779:x1859316673485312:12345-8931@kfi7:400:default-tuolumne1035-0 Request processed in 58us (89us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851903.196278:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8931@kfi7, seq: 2025198
00000100:00000040:24.0:1773851903.196279:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000006b8dd11 : new rpc_count 0
00000100:00000001:24.0:1773851903.196280:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851903.196280:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851903.196281:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851903.196281:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851903.196282:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000030bb5633.
00000020:00000040:24.0:1773851903.196283:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000006b8dd11 : new refcount 8
00000100:00000001:24.0:1773851903.196284:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851903.196294:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2aa TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851903.196295:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.196296:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8739@kfi7: PUT: OK
00000400:00000200:25.0:1773851903.196297:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c206b7b6
00000400:00000010:25.0:1773851903.196297:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c206b7b6.
00000100:00000001:25.0:1773851903.196298:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851903.196298:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851903.196299:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cb37712a nid 8739@kfi7 refs 2
00000800:00000200:25.0:1773851903.196300:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 8739@kfi7(00000000b4953773):0x0 lsk 683 rsk 76 tsk 0 trmk 0 tmk 0 trr 6 tta 0x2aa Transaction freed
00000800:00000200:15.0:1773851903.210372:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851903.210373:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851903.210374:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851903.210376:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851903.210378:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:15.0:1773851903.210379:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 23441@kfi7 : PUT - for me
00000400:00000200:15.0:1773851903.210380:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:15.0:1773851903.210381:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 1
00000400:00000200:15.0:1773851903.210382:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:15.0:1773851903.210382:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000400:00000200:15.0:1773851903.210383:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 3
00000400:00000200:15.0:1773851903.210384:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23376@kfi7 to cpt 4
00000400:00000200:15.0:1773851903.210385:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23376@kfi7 of length 456 into portal 12 MB=0x69b4685a87800
00000400:00000200:15.0:1773851903.210386:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23376@kfi7 of length 456/456 into md 0x82a36e8ed [64] + 63032
00000800:00000200:15.0:1773851903.210388:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851903.210389:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851903.210390:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23441@kfi7: PUT: OK
00000100:00000001:15.0:1773851903.210392:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851903.210392:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851903.210393:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000449d3970.
00000100:00000040:15.0:1773851903.210393:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000449d3970 x1859577052690432 msgsize 456
00000100:00100000:15.0:1773851903.210395:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-23376@kfi7 (source: 12345-23441@kfi7)
00000100:00000001:15.0:1773851903.210396:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851903.210397:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000100:00000001:12.0:1773851903.210398:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851903.210398:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:15.0:1773851903.210399:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851903.210399:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851903.210399:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851903.210400:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851903.210401:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859577052690432
00000020:00000001:12.0:1773851903.210402:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851903.210403:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07dc30c4be3
00000020:00000001:12.0:1773851903.210404:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851903.210405:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000de198f0 refcount=5
00000020:00000001:12.0:1773851903.210406:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134069762048 : -106939639789568 : ffff9ebd2cc20800)
00000020:00000001:12.0:1773851903.210407:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134069762048 : -106939639789568 : ffff9ebd2cc20800)
00000100:00000001:12.0:1773851903.210408:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.210409:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851903.210409:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000732ec20a.
00000020:00000010:12.0:1773851903.210411:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.210411:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851903.210412:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851903.210413:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851903.210413:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.210415:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.210416:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851903.210417:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851903.210417:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851903.210418:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851903.210418:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851903.210419:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23376@kfi7, seq: 411190564
00000100:00000001:14.0:1773851903.210420:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.210420:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000de198f0 : new rpc_count 1
00000100:00000001:14.0:1773851903.210421:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.210421:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637023860201088 : -107049849350528 : ffff9ea383c19680)
00000100:00000040:12.0:1773851903.210423:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000449d3970 x1859577052690432/t0(0) o17->5736ac83-ccd2-4b57-95fa-2fc26c0acc04@23376@kfi7:630/0 lens 456/0 e 0 to 0 dl 1773851990 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1954-0'
00000100:00000001:12.0:1773851903.210426:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.210427:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851903.210428:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000449d3970 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:5736ac83-ccd2-4b57-95fa-2fc26c0acc04+5:39688:x1859577052690432:12345-23376@kfi7:17:default-tuolumne1954-0
00000100:00000200:12.0:1773851903.210429:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859577052690432
00000020:00000001:12.0:1773851903.210430:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851903.210431:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851903.210431:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.210432:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851903.210433:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:12.0:1773851903.210434:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851903.210434:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859577052690432, found 0 last_xid 1859577052690431
00000020:00000001:12.0:1773851903.210435:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851903.210436:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851903.210437:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851903.210437:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:12.0:1773851903.210438:0:60487:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:12.0:1773851903.210439:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851903.210440:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851903.210441:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000d09fffbe.
02000000:00000001:12.0:1773851903.210442:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.210443:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.210444:0:60487:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:12.0:1773851903.210444:0:60487:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:12.0:1773851903.210445:0:60487:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:12.0:1773851903.210448:0:60487:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.210448:0:60487:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:12.0:1773851903.210450:0:60487:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 5736ac83-ccd2-4b57-95fa-2fc26c0acc04/000000000de198f0 free: 126633370845184 avail: 126633368748032
00000020:00000001:12.0:1773851903.210451:0:60487:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:12.0:1773851903.210452:0:60487:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 5736ac83-ccd2-4b57-95fa-2fc26c0acc04/000000000de198f0 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:12.0:1773851903.210454:0:60487:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:12.0:1773851903.210455:0:60487:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:12.0:1773851903.210456:0:60487:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 5736ac83-ccd2-4b57-95fa-2fc26c0acc04/000000000de198f0 reports grant 1811152895 dropped 0, local 1879310335
00000020:00000001:12.0:1773851903.210457:0:60487:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:12.0:1773851903.210457:0:60487:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:12.0:1773851903.210458:0:60487:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851903.210459:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044159089, transno 0, xid 1859577052690432
00010000:00000001:12.0:1773851903.210460:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851903.210461:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000449d3970 x1859577052690432/t0(0) o17->5736ac83-ccd2-4b57-95fa-2fc26c0acc04@23376@kfi7:630/0 lens 456/432 e 0 to 0 dl 1773851990 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1954-0'
00010000:00000001:12.0:1773851903.210464:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851903.210464:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851903.210465:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=136 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851903.210466:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851903.210467:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000079e18a6f refcount 3 to 23376@kfi7
00000100:00000001:12.0:1773851903.210468:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363995392 : -107142345556224 : ffff9e8dfa8d7f00)
02000000:00000001:12.0:1773851903.210469:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851903.210470:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.210470:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851903.210471:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23441@kfi7
00000400:00000010:12.0:1773851903.210472:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003df794fb.
00000100:00000200:12.0:1773851903.210473:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859577052690432, offset 224
00000400:00000200:12.0:1773851903.210475:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23441@kfi7
00000400:00000200:12.0:1773851903.210476:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.210477:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 1
00000400:00000200:12.0:1773851903.210478:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000400:00000200:12.0:1773851903.210479:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 3
00000400:00000200:12.0:1773851903.210480:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  23441@kfi7 local destination
00000400:00000200:12.0:1773851903.210482:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770462:8770462:1024:4294967295] 23441@kfi7 LPNI seq info [21811745:21811745:16:4294967295]
00000400:00000200:12.0:1773851903.210483:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000400:00000200:12.0:1773851903.210484:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23441@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.210487:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 23441@kfi7(23441@kfi7:23441@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851903.210488:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 3
00000800:00000200:12.0:1773851903.210490:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851903.210491:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:12.0:1773851903.210493:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851903.210496:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001055 Using peer 23441@kfi7(0x100000000001055)
00000800:00000200:12.0:1773851903.210499:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 0000000025990170: Posted send of 532 bytes to peer 0x100000000001055: rc=0
00000800:00000200:12.0:1773851903.210500:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001055 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851903.210503:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.210504:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000079e18a6f refcount 2 to 23376@kfi7
00010000:00000001:12.0:1773851903.210505:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851903.210505:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.210506:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851903.210507:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000449d3970 x1859577052690432/t0(0) o17->5736ac83-ccd2-4b57-95fa-2fc26c0acc04@23376@kfi7:630/0 lens 456/432 e 0 to 0 dl 1773851990 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1954-0'
00000100:00100000:12.0:1773851903.210512:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000449d3970 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:5736ac83-ccd2-4b57-95fa-2fc26c0acc04+5:39688:x1859577052690432:12345-23376@kfi7:17:default-tuolumne1954-0 Request processed in 85us (118us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851903.210515:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23376@kfi7, seq: 411190564
00000100:00000040:12.0:1773851903.210516:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000de198f0 : new rpc_count 0
00000100:00000001:12.0:1773851903.210517:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851903.210517:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851903.210518:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.210519:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851903.210520:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000732ec20a.
00000020:00000040:12.0:1773851903.210520:0:60487:0:(genops.c:882:class_export_put()) PUTting export 000000000de198f0 : new refcount 4
00000100:00000001:12.0:1773851903.210521:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851903.210527:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001055 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851903.210529:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.210530:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->23441@kfi7: PUT: OK
00000400:00000200:13.0:1773851903.210531:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003df794fb
00000400:00000010:13.0:1773851903.210532:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003df794fb.
00000100:00000001:13.0:1773851903.210533:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851903.210533:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851903.210535:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a5a5c453 nid 23441@kfi7 refs 2
00000800:00000200:13.0:1773851903.210536:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000025990170: 2054@kfi7:3 -> 23441@kfi7(00000000d27892e3):0x0 lsk 4182 rsk 30 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000001055 Transaction freed
00000004:00000001:11.0:1773851903.305732:0:42361:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:10.0:1773851903.305732:0:42373:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851903.305733:0:42361:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:10.0:1773851903.305733:0:42373:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851903.305734:0:42361:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d4a564a2.
00000100:00000010:10.0:1773851903.305734:0:42373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000037d69b00.
00000020:00000040:11.0:1773851903.305736:0:42361:0:(genops.c:1094:class_import_get()) import 000000000cafb461 refcount=5 obd=lustre5-OST000b-osc-MDT0001
00000020:00000040:10.0:1773851903.305736:0:42373:0:(genops.c:1094:class_import_get()) import 000000003ce0727b refcount=5 obd=lustre5-OST0011-osc-MDT0001
00000100:00000001:11.0:1773851903.305737:0:42361:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:10.0:1773851903.305737:0:42373:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851903.305738:0:42361:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851903.305739:0:42373:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:11.0:1773851903.305740:0:42361:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851903.305740:0:42373:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:11.0:1773851903.305742:0:42361:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000cadaf1a7.
02000000:00000010:10.0:1773851903.305742:0:42373:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004dd7265c.
00000100:00000001:11.0:1773851903.305743:0:42361:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.305743:0:42373:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.305745:0:42361:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851903.305745:0:42373:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851903.305746:0:42361:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.305746:0:42373:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851903.305748:0:42361:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d4a564a2] to pc [ptlrpcd_02_03+3]  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:10.0:1773851903.305748:0:42373:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000037d69b00] to pc [ptlrpcd_02_00+0]  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:10.0:1773851903.305756:0:42373:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305756:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:11.0:1773851903.305757:0:42361:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305757:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851903.305758:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851903.305759:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:8.0:1773851903.305759:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851903.305760:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851903.305760:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:9.0:1773851903.305761:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851903.305762:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851903.305763:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851903.305763:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.305764:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.305764:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:8.0:1773851903.305764:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:8.0:1773851903.305764:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.305765:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851903.305765:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851903.305765:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051942976:12@kfi7:13:default-yuba2-0
00000100:00000001:11.0:1773851903.305766:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851903.305766:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851903.305766:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:9.0:1773851903.305767:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d4a564a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051942912:42@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851903.305767:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851903.305768:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851903.305768:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.305769:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:9.0:1773851903.305769:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:8.0:1773851903.305769:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:9.0:1773851903.305770:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851903.305770:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:8.0:1773851903.305770:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005350c348.
02000000:00000010:9.0:1773851903.305771:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000004470a3fd.
02000000:00000001:9.0:1773851903.305771:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851903.305771:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851903.305772:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.305773:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000010:9.0:1773851903.305773:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000bf4ea876.
00000400:00000010:8.0:1773851903.305773:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000400:00000010:9.0:1773851903.305774:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003dd826d2.
00000400:00000010:8.0:1773851903.305774:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
00000100:00000200:9.0:1773851903.305775:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942912, portal 4
00000100:00000200:8.0:1773851903.305775:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051942976, portal 4
00000100:00000001:9.0:1773851903.305776:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851903.305776:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851903.305776:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087763328 : -106944621788288 : ffff9ebc03cec380)
00000100:00000001:9.0:1773851903.305777:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446613376 : -106937262938240 : ffff9ebdba6de780)
00000100:00000040:9.0:1773851903.305778:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851903.305778:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851903.305781:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851903.305782:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12@kfi7
00000400:00000010:8.0:1773851903.305783:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d1f08bfb.
00000100:00000001:9.0:1773851903.305784:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:8.0:1773851903.305784:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942976, offset 0
00000100:00000040:9.0:1773851903.305785:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-42@kfi7
00000400:00000200:8.0:1773851903.305785:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12@kfi7
00000400:00000010:9.0:1773851903.305786:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003289b6e6.
00000400:00000200:8.0:1773851903.305786:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000100:00000200:9.0:1773851903.305787:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051942912, offset 0
00000400:00000200:8.0:1773851903.305787:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851903.305788:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-42@kfi7
00000400:00000200:8.0:1773851903.305789:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851903.305790:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:8.0:1773851903.305791:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  12@kfi7 local destination
00000400:00000200:8.0:1773851903.305794:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770461, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770462, p:4294967295, g:4294967295, h:1000]
00000400:00000200:8.0:1773851903.305796:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:8.0:1773851903.305797:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851903.305799:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 12@kfi7
00000400:00000200:8.0:1773851903.305800:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770463:8770463:1024:4294967295] 12@kfi7 LPNI seq info [5403464:5403464:16:4294967295]
00000400:00000200:8.0:1773851903.305801:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:8.0:1773851903.305802:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:8.0:1773851903.305804:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 12@kfi7(12@kfi7:12@kfi7) <?> : PUT try# 0
00000400:00000200:8.0:1773851903.305805:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:9.0:1773851903.305806:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851903.305807:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000800:00000200:8.0:1773851903.305807:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:9.0:1773851903.305808:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:8.0:1773851903.305808:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851903.305809:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:9.0:1773851903.305810:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  42@kfi7 local destination
00000800:00000200:8.0:1773851903.305810:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:9.0:1773851903.305811:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770463, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770462, p:4294967295, g:4294967295, h:1000]
00000800:00000200:8.0:1773851903.305812:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Using peer 12@kfi7(0x47e)
00000400:00000200:9.0:1773851903.305813:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:9.0:1773851903.305814:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851903.305814:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 42@kfi7
00000400:00000200:9.0:1773851903.305815:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770464:8770464:1024:4294967295] 42@kfi7 LPNI seq info [5404905:5404905:16:4294967295]
00000800:00000200:8.0:1773851903.305815:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 000000004524e376: Posted send of 324 bytes to peer 0x47e: rc=0
00000400:00000200:9.0:1773851903.305817:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851903.305817:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000800:00000200:8.0:1773851903.305817:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851903.305819:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305819:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:9.0:1773851903.305820:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 42@kfi7(42@kfi7:42@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851903.305820:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851903.305821:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000100:00000001:8.0:1773851903.305821:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305822:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851903.305823:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851903.305824:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851903.305824:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851903.305825:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:9.0:1773851903.305826:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:8.0:1773851903.305826:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851903.305826:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:9.0:1773851903.305828:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Using peer 42@kfi7(0x200000000000183)
00000100:00000001:8.0:1773851903.305829:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305830:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851903.305831:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x200000000000183: rc=0
00000800:00000200:10.0:1773851903.305832:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851903.305832:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:9.0:1773851903.305835:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851903.305836:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851903.305836:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851903.305836:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.305837:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.305837:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851903.305838:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851903.305838:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851903.305838:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:10.0:1773851903.305839:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d1f08bfb
00000100:00000001:9.0:1773851903.305839:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851903.305839:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:10.0:1773851903.305840:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d1f08bfb.
00000100:00000001:9.0:1773851903.305840:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.305840:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.305841:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:10.0:1773851903.305843:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851903.305845:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 TN_EVENT_TX_OK event status 0
00000100:00000001:10.0:1773851903.305847:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:9.0:1773851903.305847:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:10.0:1773851903.305848:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851903.305848:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000400:00000200:9.0:1773851903.305848:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003289b6e6
00000400:00000010:9.0:1773851903.305849:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003289b6e6.
00000100:00000001:9.0:1773851903.305849:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:9.0:1773851903.305850:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.305852:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.305852:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:9.0:1773851903.305853:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.305854:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:10.0:1773851903.305855:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000001:9.0:1773851903.305855:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.305856:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:9.0:1773851903.305857:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000800:00000200:10.0:1773851903.305858:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004524e376: 2069@kfi7:2 -> 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x47e Transaction freed
00000800:00000200:9.0:1773851903.305858:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000183 Transaction freed
00000800:00000200:9.0:1773851903.305884:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851903.305885:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851903.305886:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851903.305888:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851903.305891:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851903.305892:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851903.305892:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:25.0:1773851903.305893:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851903.305893:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12@kfi7 : PUT - for me
00000400:00000200:9.0:1773851903.305894:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000800:00000200:25.0:1773851903.305895:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851903.305895:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 1
00000400:00000200:9.0:1773851903.305896:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:25.0:1773851903.305897:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851903.305897:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000400:00000200:9.0:1773851903.305898:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 3
00000400:00000200:25.0:1773851903.305899:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 42@kfi7 : PUT - for me
00000400:00000200:25.0:1773851903.305900:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851903.305900:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:25.0:1773851903.305901:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 1
00000400:00000200:9.0:1773851903.305901:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7040
00000400:00000200:25.0:1773851903.305902:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.305902:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000400:00000200:9.0:1773851903.305902:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12@kfi7 to cpt 2
00000400:00000200:25.0:1773851903.305903:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 3
00000400:00000200:25.0:1773851903.305904:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000400:00000200:9.0:1773851903.305904:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-12@kfi7 of length 368/368 into md 0x781699489 [1] + 224
00000400:00000200:25.0:1773851903.305905:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-42@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7000
00000400:00000200:25.0:1773851903.305906:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 42@kfi7 to cpt 6
00000800:00000200:9.0:1773851903.305906:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851903.305907:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.305908:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-42@kfi7 of length 368/368 into md 0x1615b835f9 [1] + 224
00000400:00000200:9.0:1773851903.305908:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12@kfi7: PUT: OK
00000100:00000001:9.0:1773851903.305909:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:25.0:1773851903.305910:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:9.0:1773851903.305910:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:25.0:1773851903.305911:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.305912:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->42@kfi7: PUT: OK
00000100:00000040:9.0:1773851903.305913:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851903.305914:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:25.0:1773851903.305915:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851903.305916:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851903.305917:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000084a2b640 nid 12@kfi7 refs 2
00000100:00000040:25.0:1773851903.305918:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851903.305918:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:9.0:1773851903.305919:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 12@kfi7(0000000070c0b5cc):0x0 lsk 1151 rsk 4786 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851903.305919:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:8.0:1773851903.305920:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:8.0:1773851903.305920:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:8.0:1773851903.305921:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:8.0:1773851903.305921:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000100:00000001:25.0:1773851903.305922:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:8.0:1773851903.305922:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000100:00000001:8.0:1773851903.305922:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851903.305923:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000076f3fd40 nid 42@kfi7 refs 2
00000100:00000200:8.0:1773851903.305924:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851903.305925:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 42@kfi7(00000000a7fc3398):0x0 lsk 388 rsk 4790 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:10.0:1773851903.305925:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851903.305926:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:8.0:1773851903.305926:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:10.0:1773851903.305927:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:10.0:1773851903.305928:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:10.0:1773851903.305929:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000bf4ea876.
00000100:00000001:8.0:1773851903.305929:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:8.0:1773851903.305929:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:10.0:1773851903.305930:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003dd826d2
00000100:00000001:8.0:1773851903.305930:0:41068:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:10.0:1773851903.305931:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003dd826d2.
02000000:00000001:8.0:1773851903.305931:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851903.305931:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851903.305932:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851903.305932:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851903.305933:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:8.0:1773851903.305933:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851903.305934:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000201e503d time=136 v=66 (66 66 66 66)
00000100:00001000:8.0:1773851903.305935:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000ec86c021 time=136 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851903.305936:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851903.305937:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:8.0:1773851903.305937:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000200:10.0:1773851903.305938:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:8.0:1773851903.305938:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305939:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851903.305939:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0011-osc-MDT0001: skip recheck: last_committed 193406446763
00000100:00000001:8.0:1773851903.305940:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851903.305940:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.305942:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:8.0:1773851903.305942:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.305943:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851903.305944:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851903.305944:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:10.0:1773851903.305945:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851903.305945:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851903.305946:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305946:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:8.0:1773851903.305946:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851903.305947:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:8.0:1773851903.305947:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:8.0:1773851903.305948:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0011-osc-MDT0001: Updating status = 0
00000004:00000040:8.0:1773851903.305948:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0011-osc-MDT0001: blocks=410399705088 free=351541580800 avail=351539635200 avail_mb=1373201700 hwm_mb=3131101 files=372136581 ffree=343302325 state=0: rc = 0
00000100:00001000:10.0:1773851903.305949:0:41071:0:(import.c:1951:at_measured()) add 66 to 000000004cee8069 time=136 v=66 (66 66 66 66)
00000100:00001000:10.0:1773851903.305951:0:41071:0:(import.c:1951:at_measured()) add 1 to 000000004bcaec50 time=136 v=66 (1 1 1 1)
00000004:00000020:8.0:1773851903.305951:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0011-osc-MDT0001 (00000000ea50c941): 410399705088 blocks, 351541580800 free, 351539635200 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372136581 files, 343302325 free files
00000004:00000001:8.0:1773851903.305952:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.305953:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851903.305953:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851903.305953:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:10.0:1773851903.305954:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:10.0:1773851903.305955:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851903.305955:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051942976:12@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851903.305956:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851903.305957:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000b-osc-MDT0001: skip recheck: last_committed 171932648501
00000100:00000001:8.0:1773851903.305957:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851903.305958:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851903.305958:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305958:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851903.305958:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000037d69b00 x1859433051942976/t0(0) o13->lustre5-OST0011-osc-MDT0001@12@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:10.0:1773851903.305960:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851903.305961:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851903.305961:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:8.0:1773851903.305962:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005350c348.
02000000:00000001:8.0:1773851903.305963:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:8.0:1773851903.305963:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:10.0:1773851903.305964:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000020:00000040:8.0:1773851903.305964:0:41068:0:(genops.c:1107:class_import_put()) import 000000003ce0727b refcount=4 obd=lustre5-OST0011-osc-MDT0001
00000020:00000001:8.0:1773851903.305964:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:10.0:1773851903.305965:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000010:8.0:1773851903.305965:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004dd7265c.
00000100:00000001:10.0:1773851903.305966:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:8.0:1773851903.305966:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000001:10.0:1773851903.305967:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
02000000:00000001:8.0:1773851903.305967:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851903.305967:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037d69b00.
00000004:00000040:10.0:1773851903.305968:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000b-osc-MDT0001: Updating status = 0
00000100:00000001:8.0:1773851903.305968:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:8.0:1773851903.305968:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:10.0:1773851903.305969:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000b-osc-MDT0001: blocks=410399732736 free=351378967552 avail=351375956992 avail_mb=1372562332 hwm_mb=3131103 files=372018934 ffree=343143523 state=0: rc = 0
00000100:00000001:8.0:1773851903.305969:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851903.305970:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851903.305971:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.305971:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851903.305971:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:10.0:1773851903.305972:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000b-osc-MDT0001 (00000000b4897436): 410399732736 blocks, 351378967552 free, 351375956992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372018934 files, 343143523 free files
00000004:00000001:10.0:1773851903.305975:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851903.305976:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:10.0:1773851903.305981:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d4a564a2 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051942912:42@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851903.305984:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851903.305984:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851903.305986:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d4a564a2 x1859433051942912/t0(0) o13->lustre5-OST000b-osc-MDT0001@42@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.305990:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:10.0:1773851903.305991:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851903.305991:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000004470a3fd.
02000000:00000001:10.0:1773851903.305993:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851903.305994:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851903.305994:0:41071:0:(genops.c:1107:class_import_put()) import 000000000cafb461 refcount=4 obd=lustre5-OST000b-osc-MDT0001
00000020:00000001:10.0:1773851903.305995:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851903.305996:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000cadaf1a7.
02000000:00000001:10.0:1773851903.305997:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851903.305998:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851903.305999:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d4a564a2.
00000100:00000001:10.0:1773851903.306000:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851903.306000:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851903.306001:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851903.306003:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851903.306004:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.306005:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851903.306005:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851903.330668:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851903.330669:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851903.330671:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851903.330675:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851903.330678:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.330681:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9697@kfi7 : PUT - for me
00000400:00000200:21.0:1773851903.330682:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.330684:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 1
00000400:00000200:21.0:1773851903.330686:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.330687:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000400:00000200:21.0:1773851903.330688:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 3
00000400:00000200:21.0:1773851903.330690:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9505@kfi7 to cpt 2
00000400:00000200:21.0:1773851903.330692:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9505@kfi7 of length 224 into portal 12 MB=0x69aa079dc0b40
00000400:00000200:21.0:1773851903.330694:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9505@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 70408
00000800:00000200:21.0:1773851903.330697:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851903.330700:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.330702:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9697@kfi7: PUT: OK
00000100:00000001:21.0:1773851903.330703:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851903.330704:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851903.330706:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac4a2f1c.
00000100:00000040:21.0:1773851903.330707:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000ac4a2f1c x1858863890172736 msgsize 224
00000100:00100000:21.0:1773851903.330710:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-9505@kfi7 (source: 12345-9697@kfi7)
00000100:00000001:21.0:1773851903.330711:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851903.330713:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000100:00000001:20.0:1773851903.330714:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851903.330715:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851903.330715:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851903.330716:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851903.330717:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851903.330719:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851903.330720:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890172736
00000020:00000001:20.0:1773851903.330729:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851903.330730:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a4e
00000020:00000001:20.0:1773851903.330731:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851903.330735:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b97b2bf8 refcount=6
00000020:00000001:20.0:1773851903.330737:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743459840 : -107128966091776 : ffff9e911807ec00)
00000020:00000001:20.0:1773851903.330739:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743459840 : -107128966091776 : ffff9e911807ec00)
00000100:00000001:20.0:1773851903.330740:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.330741:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851903.330743:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000acabc0f0.
00000020:00000010:20.0:1773851903.330745:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.330746:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851903.330748:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851903.330749:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851903.330750:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.330752:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851903.330752:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851903.330753:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.330755:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851903.330758:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.330758:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851903.330759:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851903.330759:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851903.330761:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9505@kfi7, seq: 1998092
00000100:00000001:23.0:1773851903.330762:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.330762:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b97b2bf8 : new rpc_count 1
00000100:00000001:23.0:1773851903.330763:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.330763:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313414272 : -106917396137344 : ffff9ec25a953a80)
00000100:00000040:20.0:1773851903.330766:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ac4a2f1c x1858863890172736/t0(0) o400->f1242886-a7cd-42fb-a71e-e33abc31f00a@9505@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1087-0'
00000100:00000001:20.0:1773851903.330771:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.330771:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851903.330773:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ac4a2f1c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:f1242886-a7cd-42fb-a71e-e33abc31f00a+6:39037:x1858863890172736:12345-9505@kfi7:400:default-tuolumne1087-0
00000100:00000200:20.0:1773851903.330774:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890172736
00000020:00000001:20.0:1773851903.330775:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851903.330776:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851903.330777:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.330779:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851903.330779:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851903.330780:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851903.330781:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890172736, found 0 last_xid 1858863890172735
00000020:00000001:20.0:1773851903.330782:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851903.330783:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851903.330784:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851903.330784:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.330785:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851903.330786:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851903.330786:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851903.330787:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000330e2b55.
02000000:00000001:20.0:1773851903.330788:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.330789:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.330789:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851903.330790:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180475273052, transno 0, xid 1858863890172736
00010000:00000001:20.0:1773851903.330791:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851903.330792:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ac4a2f1c x1858863890172736/t0(0) o400->f1242886-a7cd-42fb-a71e-e33abc31f00a@9505@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1087-0'
00010000:00000001:20.0:1773851903.330795:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851903.330796:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851903.330797:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=136 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851903.330798:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851903.330799:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000a7843a0 refcount 3 to 9505@kfi7
00000100:00000001:20.0:1773851903.330800:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051135424 : -107146658416192 : ffff9e8cf97c79c0)
02000000:00000001:20.0:1773851903.330801:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851903.330801:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.330802:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851903.330803:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9697@kfi7
00000400:00000010:20.0:1773851903.330804:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007749ce00.
00000100:00000200:20.0:1773851903.330805:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890172736, offset 224
00000400:00000200:20.0:1773851903.330807:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9697@kfi7
00000400:00000200:20.0:1773851903.330808:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.330809:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 1
00000400:00000200:20.0:1773851903.330810:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000400:00000200:20.0:1773851903.330812:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 3
00000400:00000200:20.0:1773851903.330813:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9697@kfi7 local destination
00000400:00000200:20.0:1773851903.330815:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770465:8770465:1024:4294967295] 9697@kfi7 LPNI seq info [17482:17482:16:4294967295]
00000400:00000200:20.0:1773851903.330817:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000400:00000200:20.0:1773851903.330818:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9697@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.330820:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9697@kfi7(9697@kfi7:9697@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851903.330821:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 3
00000800:00000200:20.0:1773851903.330823:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851903.330824:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851903.330827:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851903.330829:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1228 Using peer 9697@kfi7(0x1228)
00000800:00000200:20.0:1773851903.330832:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x1228: rc=0
00000800:00000200:20.0:1773851903.330834:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1228 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851903.330836:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.330837:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000a7843a0 refcount 2 to 9505@kfi7
00010000:00000001:20.0:1773851903.330838:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851903.330838:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.330839:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851903.330839:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac4a2f1c x1858863890172736/t0(0) o400->f1242886-a7cd-42fb-a71e-e33abc31f00a@9505@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1087-0'
00000100:00100000:20.0:1773851903.330844:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ac4a2f1c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:f1242886-a7cd-42fb-a71e-e33abc31f00a+6:39037:x1858863890172736:12345-9505@kfi7:400:default-tuolumne1087-0 Request processed in 73us (136us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851903.330846:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9505@kfi7, seq: 1998092
00000100:00000040:20.0:1773851903.330847:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b97b2bf8 : new rpc_count 0
00000100:00000001:20.0:1773851903.330848:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851903.330848:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851903.330849:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.330850:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851903.330851:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000acabc0f0.
00000020:00000040:20.0:1773851903.330851:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000b97b2bf8 : new refcount 5
00000100:00000001:20.0:1773851903.330852:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.330857:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1228 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851903.330858:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.330859:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9697@kfi7: PUT: OK
00000400:00000200:21.0:1773851903.330860:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007749ce00
00000400:00000010:21.0:1773851903.330860:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007749ce00.
00000100:00000001:21.0:1773851903.330861:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851903.330861:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851903.330862:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000086365f5 nid 9697@kfi7 refs 2
00000800:00000200:21.0:1773851903.330863:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2069@kfi7:5 -> 9697@kfi7(00000000c0fbaf52):0x0 lsk 4649 rsk 45 tsk 0 trmk 0 tmk 0 trr 5 tta 0x1228 Transaction freed
00000800:00000200:13.0:1773851903.332931:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851903.332933:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851903.332935:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851903.332938:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851903.332941:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.332943:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17409@kfi7 : PUT - for me
00000400:00000200:13.0:1773851903.332944:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.332946:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 1
00000400:00000200:13.0:1773851903.332948:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.332949:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000400:00000200:13.0:1773851903.332950:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 3
00000400:00000200:13.0:1773851903.332952:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.332954:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17409@kfi7 of length 224 into portal 12 MB=0x69b4b9fa3bf00
00000400:00000200:13.0:1773851903.332956:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17409@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 63488
00000800:00000200:13.0:1773851903.332958:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851903.332961:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.332962:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17409@kfi7: PUT: OK
00000100:00000001:13.0:1773851903.332964:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851903.332965:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851903.332966:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e9ed7dc2.
00000100:00000040:13.0:1773851903.332967:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000e9ed7dc2 x1859598963425024 msgsize 224
00000100:00100000:13.0:1773851903.332969:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-17409@kfi7 (source: 12345-17409@kfi7)
00000100:00000001:13.0:1773851903.332971:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851903.332973:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000100:00000001:12.0:1773851903.332974:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851903.332975:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851903.332975:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851903.332976:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851903.332977:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851903.332978:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851903.332979:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598963425024
00000020:00000001:12.0:1773851903.332980:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851903.332981:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d820d9
00000020:00000001:12.0:1773851903.332982:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851903.332986:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a1f78026 refcount=5
00000020:00000001:12.0:1773851903.332987:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113785078784 : -106959924472832 : ffff9eb873b25400)
00000020:00000001:12.0:1773851903.332988:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113785078784 : -106959924472832 : ffff9eb873b25400)
00000100:00000001:12.0:1773851903.332990:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.332991:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851903.332992:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000732ec20a.
00000020:00000010:12.0:1773851903.332994:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.332995:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851903.332996:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851903.332997:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851903.332998:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851903.332999:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851903.333000:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851903.333001:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.333002:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851903.333004:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851903.333005:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851903.333005:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851903.333005:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851903.333007:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17409@kfi7, seq: 2289953
00000100:00000001:14.0:1773851903.333008:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.333008:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a1f78026 : new rpc_count 1
00000100:00000001:14.0:1773851903.333009:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.333009:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092545664 : -106946617005952 : ffff9ebb8ce22880)
00000100:00000040:12.0:1773851903.333011:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e9ed7dc2 x1859598963425024/t0(0) o400->08eaedb1-39c4-4c0e-8c8f-1e772e114f26@17409@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1587-0'
00000100:00000001:12.0:1773851903.333015:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.333016:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851903.333017:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e9ed7dc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:08eaedb1-39c4-4c0e-8c8f-1e772e114f26+5:39589:x1859598963425024:12345-17409@kfi7:400:default-tuolumne1587-0
00000100:00000200:12.0:1773851903.333019:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598963425024
00000020:00000001:12.0:1773851903.333021:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851903.333022:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851903.333023:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.333024:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851903.333025:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851903.333026:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851903.333027:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598963425024, found 0 last_xid 1859598963425023
00000020:00000001:12.0:1773851903.333028:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851903.333029:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851903.333030:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851903.333031:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.333032:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851903.333033:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851903.333033:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851903.333035:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000df2280f.
02000000:00000001:12.0:1773851903.333036:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.333037:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.333038:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851903.333039:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104889088, transno 0, xid 1859598963425024
00010000:00000001:12.0:1773851903.333040:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851903.333042:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e9ed7dc2 x1859598963425024/t0(0) o400->08eaedb1-39c4-4c0e-8c8f-1e772e114f26@17409@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1587-0'
00010000:00000001:12.0:1773851903.333045:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851903.333046:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851903.333047:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=136 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851903.333049:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851903.333050:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000e21193e refcount 3 to 17409@kfi7
00000100:00000001:12.0:1773851903.333051:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642468512 : -107157067083104 : ffff9e8a8d14d2a0)
02000000:00000001:12.0:1773851903.333053:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851903.333054:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.333055:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851903.333056:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17409@kfi7
00000400:00000010:12.0:1773851903.333057:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000464fc1d9.
00000100:00000200:12.0:1773851903.333058:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598963425024, offset 224
00000400:00000200:12.0:1773851903.333060:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17409@kfi7
00000400:00000200:12.0:1773851903.333062:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.333063:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 1
00000400:00000200:12.0:1773851903.333065:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000400:00000200:12.0:1773851903.333067:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 3
00000400:00000200:12.0:1773851903.333069:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17409@kfi7 local destination
00000400:00000200:12.0:1773851903.333071:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770466:8770466:1024:4294967295] 17409@kfi7 LPNI seq info [13528358:13528358:16:4294967295]
00000400:00000200:12.0:1773851903.333073:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000400:00000200:12.0:1773851903.333074:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17409@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.333077:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17409@kfi7(17409@kfi7:17409@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851903.333079:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 3
00000800:00000200:12.0:1773851903.333082:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851903.333083:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851903.333087:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851903.333090:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9b6 Using peer 17409@kfi7(0x9b6)
00000800:00000200:12.0:1773851903.333095:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000000426de06: Posted send of 324 bytes to peer 0x9b6: rc=0
00000800:00000200:12.0:1773851903.333097:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851903.333100:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.333102:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000e21193e refcount 2 to 17409@kfi7
00010000:00000001:12.0:1773851903.333103:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851903.333104:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.333107:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851903.333108:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e9ed7dc2 x1859598963425024/t0(0) o400->08eaedb1-39c4-4c0e-8c8f-1e772e114f26@17409@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1587-0'
00000100:00100000:12.0:1773851903.333113:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e9ed7dc2 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:08eaedb1-39c4-4c0e-8c8f-1e772e114f26+5:39589:x1859598963425024:12345-17409@kfi7:400:default-tuolumne1587-0 Request processed in 96us (144us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851903.333116:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17409@kfi7, seq: 2289953
00000100:00000040:12.0:1773851903.333118:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a1f78026 : new rpc_count 0
00000100:00000001:12.0:1773851903.333120:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851903.333120:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851903.333121:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.333122:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851903.333124:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000732ec20a.
00000020:00000040:12.0:1773851903.333125:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000a1f78026 : new refcount 4
00000100:00000001:12.0:1773851903.333127:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851903.333134:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9b6 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851903.333137:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.333139:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17409@kfi7: PUT: OK
00000400:00000200:13.0:1773851903.333140:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000464fc1d9
00000400:00000010:13.0:1773851903.333141:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000464fc1d9.
00000100:00000001:13.0:1773851903.333142:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851903.333143:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851903.333144:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e54af316 nid 17409@kfi7 refs 2
00000800:00000200:13.0:1773851903.333146:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000426de06: 2069@kfi7:3 -> 17409@kfi7(00000000a1c10188):0x0 lsk 2487 rsk 7 tsk 0 trmk 0 tmk 0 trr 3 tta 0x9b6 Transaction freed
00000800:00000200:22.0:1773851903.354186:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851903.354186:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851903.354188:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851903.354188:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851903.354189:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:22.0:1773851903.354190:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851903.354192:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 21041@kfi7(000000000103e20e):0xb66 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851903.354193:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851903.354195:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 Using peer 21041@kfi7(0xb66)
00000400:00000200:22.0:1773851903.354197:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21041@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.354198:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21041@kfi7 : PUT - for me
00000400:00000200:21.0:1773851903.354198:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21041@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.354200:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21041@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.354201:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000446c9309 nid 21041@kfi7 refs 1
00000800:00000200:21.0:1773851903.354201:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0xb66: rc=0
00000400:00000200:22.0:1773851903.354203:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21041@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.354204:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000446c9309 nid 21041@kfi7 refs 2
00000800:00000200:21.0:1773851903.354204:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851903.354205:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000446c9309 nid 21041@kfi7 refs 3
00000400:00000200:22.0:1773851903.354207:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21040@kfi7 to cpt 2
00000400:00000200:22.0:1773851903.354208:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21040@kfi7 of length 224 into portal 12 MB=0x69b194678c780
00000400:00000200:22.0:1773851903.354210:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21040@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 70632
00000800:00000200:22.0:1773851903.354213:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851903.354215:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851903.354217:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21041@kfi7: PUT: OK
00000100:00000001:22.0:1773851903.354218:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000800:00000200:21.0:1773851903.354218:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 TN_EVENT_TX_OK event status 0
00000100:00000200:22.0:1773851903.354219:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:21.0:1773851903.354221:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 Transaction freed
00000100:00000010:22.0:1773851903.354222:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000098f7262e.
00000100:00000040:22.0:1773851903.354223:0:2456945:0:(events.c:358:request_in_callback()) incoming req@0000000098f7262e x1859382719072128 msgsize 224
00000100:00100000:22.0:1773851903.354225:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-21040@kfi7 (source: 12345-21041@kfi7)
00000100:00000001:22.0:1773851903.354227:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851903.354228:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000446c9309 nid 21041@kfi7 refs 2
00000100:00000001:20.0:1773851903.354229:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851903.354230:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851903.354231:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851903.354231:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851903.354232:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851903.354233:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851903.354234:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859382719072128
00000020:00000001:20.0:1773851903.354235:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851903.354236:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0796788641d
00000020:00000001:20.0:1773851903.354237:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851903.354240:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ab06bf45 refcount=329
00000020:00000001:20.0:1773851903.354241:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636967266106368 : -107106443445248 : ffff9e96567c3c00)
00000020:00000001:20.0:1773851903.354243:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636967266106368 : -107106443445248 : ffff9e96567c3c00)
00000100:00000001:20.0:1773851903.354245:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.354246:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851903.354247:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000156734c4.
00000020:00000010:20.0:1773851903.354249:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.354250:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851903.354252:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851903.354252:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851903.354253:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.354255:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851903.354256:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851903.354256:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.354258:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851903.354260:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.354260:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851903.354261:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851903.354261:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851903.354262:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21040@kfi7, seq: 1998093
00000100:00000001:23.0:1773851903.354264:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.354264:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ab06bf45 : new rpc_count 8
00000100:00000001:23.0:1773851903.354265:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.354265:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636969435603968 : -107104273947648 : ffff9e96d7cc2400)
00000100:00000040:20.0:1773851903.354268:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000098f7262e x1859382719072128/t0(0) o400->c5a31666-2451-4528-af13-9142bc328874@21040@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1805-0'
00000100:00000001:20.0:1773851903.354272:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.354273:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851903.354274:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000098f7262e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c5a31666-2451-4528-af13-9142bc328874+329:39931:x1859382719072128:12345-21040@kfi7:400:default-tuolumne1805-0
00000100:00000200:20.0:1773851903.354277:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859382719072128
00000020:00000001:20.0:1773851903.354278:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851903.354279:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851903.354280:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.354281:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851903.354281:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851903.354283:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851903.354284:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859382719072128, found 0 last_xid 1859382665986175
00000020:00000001:20.0:1773851903.354285:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851903.354286:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851903.354287:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851903.354288:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.354289:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851903.354290:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851903.354290:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851903.354291:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000330fc911.
02000000:00000001:20.0:1773851903.354292:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.354293:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.354294:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851903.354295:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264574578, transno 0, xid 1859382719072128
00010000:00000001:20.0:1773851903.354296:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851903.354298:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000098f7262e x1859382719072128/t0(0) o400->c5a31666-2451-4528-af13-9142bc328874@21040@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1805-0'
00010000:00000001:20.0:1773851903.354302:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851903.354303:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851903.354304:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=136 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851903.354305:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851903.354307:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d4dc43b2 refcount 3 to 21040@kfi7
00000100:00000001:20.0:1773851903.354309:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994448544 : -107149715103072 : ffff9e8c434b22a0)
02000000:00000001:20.0:1773851903.354310:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851903.354311:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.354312:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851903.354313:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21041@kfi7
00000400:00000010:20.0:1773851903.354314:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b1efbb09.
00000100:00000200:20.0:1773851903.354315:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859382719072128, offset 224
00000400:00000200:20.0:1773851903.354317:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21041@kfi7
00000400:00000200:20.0:1773851903.354318:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21041@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.354319:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000446c9309 nid 21041@kfi7 refs 1
00000400:00000200:20.0:1773851903.354321:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000446c9309 nid 21041@kfi7 refs 2
00000400:00000200:20.0:1773851903.354323:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000446c9309 nid 21041@kfi7 refs 3
00000400:00000200:20.0:1773851903.354325:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21041@kfi7 local destination
00000400:00000200:20.0:1773851903.354327:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770467:8770467:1024:4294967295] 21041@kfi7 LPNI seq info [2553810:2553810:16:4294967295]
00000400:00000200:20.0:1773851903.354329:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000446c9309 nid 21041@kfi7 refs 2
00000400:00000200:20.0:1773851903.354330:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21041@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.354333:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21041@kfi7(21041@kfi7:21041@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851903.354335:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000446c9309 nid 21041@kfi7 refs 3
00000800:00000200:20.0:1773851903.354338:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851903.354339:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851903.354343:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851903.354347:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 Using peer 21041@kfi7(0xb66)
00000800:00000200:20.0:1773851903.354351:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0xb66: rc=0
00000800:00000200:20.0:1773851903.354354:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851903.354357:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.354358:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d4dc43b2 refcount 2 to 21040@kfi7
00010000:00000001:20.0:1773851903.354362:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851903.354363:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.354364:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851903.354365:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000098f7262e x1859382719072128/t0(0) o400->c5a31666-2451-4528-af13-9142bc328874@21040@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1805-0'
00000100:00100000:20.0:1773851903.354370:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000098f7262e pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:c5a31666-2451-4528-af13-9142bc328874+329:39931:x1859382719072128:12345-21040@kfi7:400:default-tuolumne1805-0 Request processed in 96us (146us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851903.354374:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21040@kfi7, seq: 1998093
00000100:00000040:20.0:1773851903.354375:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ab06bf45 : new rpc_count 7
00000100:00000001:20.0:1773851903.354376:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851903.354377:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851903.354378:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.354379:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851903.354380:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000156734c4.
00000020:00000040:20.0:1773851903.354382:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000ab06bf45 : new refcount 328
00000100:00000001:20.0:1773851903.354383:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.354390:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851903.354392:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.354394:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21041@kfi7: PUT: OK
00000400:00000200:21.0:1773851903.354395:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b1efbb09
00000400:00000010:21.0:1773851903.354396:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b1efbb09.
00000100:00000001:21.0:1773851903.354397:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851903.354398:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851903.354399:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000446c9309 nid 21041@kfi7 refs 2
00000800:00000200:21.0:1773851903.354402:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2069@kfi7:5 -> 21041@kfi7(000000000103e20e):0x0 lsk 2919 rsk 31 tsk 0 trmk 0 tmk 0 trr 5 tta 0xb66 Transaction freed
00000800:00000200:17.0:1773851903.360087:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851903.360088:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851903.360090:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851903.360094:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851903.360097:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.360099:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21936@kfi7 : PUT - for me
00000400:00000200:17.0:1773851903.360100:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.360102:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 1
00000400:00000200:17.0:1773851903.360104:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.360105:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000400:00000200:17.0:1773851903.360107:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 3
00000400:00000200:17.0:1773851903.360108:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.360110:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21936@kfi7 of length 224 into portal 12 MB=0x69b4c401d0b80
00000400:00000200:17.0:1773851903.360112:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21936@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 51288
00000800:00000200:17.0:1773851903.360115:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851903.360118:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851903.360120:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21936@kfi7: PUT: OK
00000100:00000001:17.0:1773851903.360121:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851903.360122:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851903.360124:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000741f1da7.
00000100:00000040:17.0:1773851903.360125:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000741f1da7 x1859601655729024 msgsize 224
00000100:00100000:17.0:1773851903.360127:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-21936@kfi7 (source: 12345-21936@kfi7)
00000100:00000001:17.0:1773851903.360129:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851903.360130:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851903.360130:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 2
02000000:00000001:19.0:1773851903.360131:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851903.360131:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851903.360132:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851903.360133:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851903.360133:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601655729024
00000800:00000200:17.0:1773851903.360133:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000020:00000001:19.0:1773851903.360134:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851903.360134:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff85864
00000020:00000001:19.0:1773851903.360135:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851903.360137:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006e40c48f refcount=7
00000020:00000001:19.0:1773851903.360138:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636942363377664 : -107131346173952 : ffff9e908a2ac000)
00000020:00000001:19.0:1773851903.360139:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636942363377664 : -107131346173952 : ffff9e908a2ac000)
00000100:00000001:19.0:1773851903.360140:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851903.360141:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851903.360141:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000231c32fd.
00000020:00000010:19.0:1773851903.360142:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851903.360143:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851903.360144:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851903.360145:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851903.360145:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851903.360146:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851903.360147:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851903.360147:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.360148:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851903.360150:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851903.360150:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851903.360151:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21936@kfi7, seq: 2156451
00000100:00000001:16.0:1773851903.360151:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000040:19.0:1773851903.360152:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006e40c48f : new rpc_count 1
00000100:00000001:16.0:1773851903.360152:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:19.0:1773851903.360153:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794797312 : -107029914754304 : ffff9ea827f36300)
00000100:00000001:16.0:1773851903.360153:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851903.360154:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000741f1da7 x1859601655729024/t0(0) o400->422cd82f-f001-4d23-a8f6-51fae3e05432@21936@kfi7:155/0 lens 224/0 e 0 to 0 dl 1773852270 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1854-0'
00000100:00000001:16.0:1773851903.360154:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.360157:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851903.360157:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851903.360158:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000741f1da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:422cd82f-f001-4d23-a8f6-51fae3e05432+7:39771:x1859601655729024:12345-21936@kfi7:400:default-tuolumne1854-0
00000100:00000200:19.0:1773851903.360159:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601655729024
00000020:00000001:19.0:1773851903.360160:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851903.360161:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851903.360161:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.360162:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851903.360162:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851903.360163:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851903.360164:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601655729024, found 0 last_xid 1859601655729023
00000020:00000001:19.0:1773851903.360165:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851903.360165:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851903.360166:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851903.360166:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.360167:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851903.360167:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851903.360168:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851903.360168:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008ad35796.
02000000:00000001:19.0:1773851903.360169:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.360170:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.360170:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851903.360171:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044163794, transno 0, xid 1859601655729024
00010000:00000001:19.0:1773851903.360172:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851903.360173:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000741f1da7 x1859601655729024/t0(0) o400->422cd82f-f001-4d23-a8f6-51fae3e05432@21936@kfi7:155/0 lens 224/224 e 0 to 0 dl 1773852270 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1854-0'
00010000:00000001:19.0:1773851903.360175:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851903.360176:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851903.360177:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=136 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851903.360178:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851903.360179:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000045e3ff1 refcount 3 to 21936@kfi7
00000100:00000001:19.0:1773851903.360179:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583958304 : -107156125593312 : ffff9e8ac532d120)
02000000:00000001:19.0:1773851903.360180:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851903.360180:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.360181:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851903.360182:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21936@kfi7
00000400:00000010:19.0:1773851903.360183:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c4b6298d.
00000100:00000200:19.0:1773851903.360183:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601655729024, offset 224
00000400:00000200:19.0:1773851903.360185:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21936@kfi7
00000400:00000200:19.0:1773851903.360186:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:19.0:1773851903.360186:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 1
00000400:00000200:19.0:1773851903.360188:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000400:00000200:19.0:1773851903.360189:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 3
00000400:00000200:19.0:1773851903.360190:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21936@kfi7 local destination
00000400:00000200:19.0:1773851903.360192:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770468:8770468:1024:4294967295] 21936@kfi7 LPNI seq info [1100428:1100428:16:4294967295]
00000400:00000200:19.0:1773851903.360193:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000400:00000200:19.0:1773851903.360194:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21936@kfi7 to cpt 4
00000400:00000200:19.0:1773851903.360196:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21936@kfi7(21936@kfi7:21936@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851903.360197:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 3
00000800:00000200:19.0:1773851903.360198:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851903.360199:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851903.360202:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851903.360206:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000458 Using peer 21936@kfi7(0x100000000000458)
00000800:00000200:19.0:1773851903.360209:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x100000000000458: rc=0
00000800:00000200:19.0:1773851903.360210:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000458 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851903.360212:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851903.360213:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000045e3ff1 refcount 2 to 21936@kfi7
00010000:00000001:19.0:1773851903.360214:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851903.360214:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.360215:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851903.360216:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000741f1da7 x1859601655729024/t0(0) o400->422cd82f-f001-4d23-a8f6-51fae3e05432@21936@kfi7:155/0 lens 224/224 e 0 to 0 dl 1773852270 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1854-0'
00000100:00100000:19.0:1773851903.360219:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000741f1da7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:422cd82f-f001-4d23-a8f6-51fae3e05432+7:39771:x1859601655729024:12345-21936@kfi7:400:default-tuolumne1854-0 Request processed in 61us (93us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851903.360221:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21936@kfi7, seq: 2156451
00000100:00000040:19.0:1773851903.360222:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006e40c48f : new rpc_count 0
00000100:00000001:19.0:1773851903.360223:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851903.360223:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851903.360224:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851903.360224:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000020:00000010:19.0:1773851903.360225:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000231c32fd.
00000800:00000200:17.0:1773851903.360225:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000458 TN_EVENT_TX_OK event status 0
00000020:00000040:19.0:1773851903.360226:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000006e40c48f : new refcount 6
00000100:00000001:19.0:1773851903.360226:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851903.360228:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851903.360229:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21936@kfi7: PUT: OK
00000400:00000200:17.0:1773851903.360231:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c4b6298d
00000400:00000010:17.0:1773851903.360232:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c4b6298d.
00000100:00000001:17.0:1773851903.360233:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851903.360234:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851903.360235:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000062763bdc nid 21936@kfi7 refs 2
00000800:00000200:17.0:1773851903.360238:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2054@kfi7:4 -> 21936@kfi7(0000000059dec60c):0x0 lsk 1113 rsk 6 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000458 Transaction freed
00000800:00000200:22.0:1773851903.403800:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851903.403801:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851903.403802:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851903.403804:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851903.403807:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.403808:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000400:00000200:22.0:1773851903.403809:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.403810:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:22.0:1773851903.403811:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.403811:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:22.0:1773851903.403812:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:22.0:1773851903.403813:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:22.0:1773851903.403814:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 224 into portal 12 MB=0x699e12d526440
00000400:00000200:22.0:1773851903.403815:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-2055@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 70856
00000800:00000200:22.0:1773851903.403817:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851903.403819:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851903.403820:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:22.0:1773851903.403821:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851903.403821:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851903.403822:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007dcdc29c.
00000100:00000040:22.0:1773851903.403823:0:2456945:0:(events.c:358:request_in_callback()) incoming req@000000007dcdc29c x1858042267329600 msgsize 224
00000100:00100000:22.0:1773851903.403824:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-2055@kfi7 (source: 12345-2055@kfi7)
00000100:00000001:22.0:1773851903.403825:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851903.403826:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000100:00000001:20.0:1773851903.403827:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851903.403827:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:22.0:1773851903.403828:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851903.403828:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851903.403829:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851903.403829:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851903.403830:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042267329600
00000020:00000001:20.0:1773851903.403831:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851903.403831:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793acdf562
00000020:00000001:20.0:1773851903.403832:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851903.403837:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bc769ae0 refcount=5
00000020:00000001:20.0:1773851903.403838:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636958049081344 : -107115660470272 : ffff9e94311b9800)
00000020:00000001:20.0:1773851903.403839:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636958049081344 : -107115660470272 : ffff9e94311b9800)
00000100:00000001:20.0:1773851903.403840:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.403841:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851903.403841:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000156734c4.
00000020:00000010:20.0:1773851903.403843:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.403844:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851903.403845:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851903.403846:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851903.403846:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.403847:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851903.403848:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851903.403849:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.403850:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851903.403851:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.403851:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.403851:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851903.403852:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851903.403853:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2055@kfi7, seq: 1998094
00000100:00000040:20.0:1773851903.403853:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bc769ae0 : new rpc_count 1
00000100:00000001:23.0:1773851903.403854:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851903.403854:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.403854:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637155706622208 : -106918002929408 : ffff9ec2366a5100)
00000100:00000040:20.0:1773851903.403856:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007dcdc29c x1858042267329600/t0(0) o400->lustre5-MDT0001-lwp-OST0003_UUID@2055@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-yuba104-0'
00000100:00000001:20.0:1773851903.403859:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.403859:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851903.403860:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007dcdc29c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0003_UUID+5:272678:x1858042267329600:12345-2055@kfi7:400:default-yuba104-0
00000100:00000200:20.0:1773851903.403862:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042267329600
00000020:00000001:20.0:1773851903.403863:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851903.403863:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851903.403864:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.403865:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851903.403865:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851903.403866:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:20.0:1773851903.403867:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851903.403868:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851903.403869:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851903.403869:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.403870:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851903.403871:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851903.403871:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851903.403872:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000acabc0f0.
02000000:00000001:20.0:1773851903.403873:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.403873:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.403875:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851903.403876:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858042267329600
00010000:00000001:20.0:1773851903.403877:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851903.403878:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007dcdc29c x1858042267329600/t0(0) o400->lustre5-MDT0001-lwp-OST0003_UUID@2055@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba104-0'
00010000:00000001:20.0:1773851903.403882:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851903.403883:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851903.403884:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=136 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851903.403886:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851903.403887:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000078e2608b refcount 7 to 2055@kfi7
00000100:00000001:20.0:1773851903.403888:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916999949312 : -107156709602304 : ffff9e8aa2638c00)
02000000:00000001:20.0:1773851903.403890:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851903.403891:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.403892:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851903.403893:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000010:20.0:1773851903.403894:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008a48173f.
00000100:00000200:20.0:1773851903.403896:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042267329600, offset 224
00000400:00000200:20.0:1773851903.403898:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:20.0:1773851903.403900:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.403901:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000200:20.0:1773851903.403903:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:20.0:1773851903.403905:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:20.0:1773851903.403907:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2055@kfi7 local destination
00000400:00000200:20.0:1773851903.403909:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770469:8770469:1024:4294967295] 2055@kfi7 LPNI seq info [5404677:5404677:16:4294967295]
00000400:00000200:20.0:1773851903.403912:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:20.0:1773851903.403914:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:20.0:1773851903.403917:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851903.403919:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000800:00000200:20.0:1773851903.403922:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851903.403924:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851903.403928:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851903.403944:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000800:00000200:20.0:1773851903.403950:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000a6b7758e: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000800:00000200:20.0:1773851903.403952:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851903.403957:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.403958:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000078e2608b refcount 6 to 2055@kfi7
00010000:00000001:20.0:1773851903.403959:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851903.403960:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.403961:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851903.403963:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007dcdc29c x1858042267329600/t0(0) o400->lustre5-MDT0001-lwp-OST0003_UUID@2055@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-yuba104-0'
00000100:00100000:20.0:1773851903.403968:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007dcdc29c pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:lustre5-MDT0001-lwp-OST0003_UUID+5:272678:x1858042267329600:12345-2055@kfi7:400:default-yuba104-0 Request processed in 108us (144us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851903.403973:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2055@kfi7, seq: 1998094
00000100:00000040:20.0:1773851903.403974:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bc769ae0 : new rpc_count 0
00000100:00000001:20.0:1773851903.403975:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851903.403976:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851903.403977:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.403978:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851903.403980:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000156734c4.
00000020:00000040:20.0:1773851903.403981:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000bc769ae0 : new refcount 4
00000100:00000001:20.0:1773851903.403983:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.403989:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851903.403990:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.403991:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000400:00000200:21.0:1773851903.403991:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008a48173f
00000400:00000010:21.0:1773851903.403992:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008a48173f.
00000100:00000001:21.0:1773851903.403993:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851903.403993:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851903.403994:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:21.0:1773851903.403995:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a6b7758e: 2054@kfi7:5 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x200000000000637 Transaction freed
00000800:00000200:5.0:1773851903.435203:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851903.435204:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851903.435205:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851903.435207:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851903.435209:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:5.0:1773851903.435210:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21859@kfi7 : PUT - for me
00000400:00000200:5.0:1773851903.435211:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:5.0:1773851903.435212:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 1
00000400:00000200:5.0:1773851903.435212:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:5.0:1773851903.435213:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000400:00000200:5.0:1773851903.435214:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 3
00000400:00000200:5.0:1773851903.435215:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21858@kfi7 to cpt 6
00000400:00000200:5.0:1773851903.435216:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21858@kfi7 of length 224 into portal 12 MB=0x69b0a33cd2700
00000400:00000200:5.0:1773851903.435217:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21858@kfi7 of length 224/224 into md 0x793926dc5 [64] + 169128
00000800:00000200:5.0:1773851903.435219:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851903.435221:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851903.435222:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21859@kfi7: PUT: OK
00000100:00000001:5.0:1773851903.435223:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851903.435223:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851903.435224:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ba41ad91.
00000100:00000040:5.0:1773851903.435225:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ba41ad91 x1859317981325056 msgsize 224
00000100:00100000:5.0:1773851903.435227:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-21858@kfi7 (source: 12345-21859@kfi7)
00000100:00000001:5.0:1773851903.435227:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851903.435228:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000100:00000001:4.0:1773851903.435229:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851903.435230:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851903.435230:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851903.435230:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851903.435231:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851903.435231:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851903.435232:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317981325056
00000020:00000001:4.0:1773851903.435233:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851903.435233:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9275a
00000020:00000001:4.0:1773851903.435234:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851903.435238:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000637b8908 refcount=6
00000020:00000001:4.0:1773851903.435238:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631488512 : -107123078063104 : ffff9e9276fc1c00)
00000020:00000001:4.0:1773851903.435239:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631488512 : -107123078063104 : ffff9e9276fc1c00)
00000100:00000001:4.0:1773851903.435240:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851903.435241:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851903.435242:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b1f45ba0.
00000020:00000010:4.0:1773851903.435243:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851903.435244:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d85801b.
00000100:00000001:4.0:1773851903.435245:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851903.435245:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851903.435246:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.435247:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851903.435247:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851903.435248:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.435248:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851903.435250:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851903.435250:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851903.435250:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851903.435250:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851903.435251:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21858@kfi7, seq: 2002010
00000100:00000001:7.0:1773851903.435252:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.435252:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000637b8908 : new rpc_count 1
00000100:00000001:4.0:1773851903.435252:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637097043256064 : -106976666295552 : ffff9eb48dce6300)
00000100:00000001:7.0:1773851903.435253:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.435254:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ba41ad91 x1859317981325056/t0(0) o400->87bc2668-48aa-41e5-aad3-cd00e0aa0d18@21858@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1852-0'
00000100:00000001:4.0:1773851903.435261:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851903.435261:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851903.435262:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ba41ad91 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:87bc2668-48aa-41e5-aad3-cd00e0aa0d18+6:39489:x1859317981325056:12345-21858@kfi7:400:default-tuolumne1852-0
00000100:00000200:4.0:1773851903.435264:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317981325056
00000020:00000001:4.0:1773851903.435264:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851903.435265:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851903.435266:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.435266:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851903.435267:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851903.435268:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851903.435268:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317981325056, found 0 last_xid 1859317981325055
00000020:00000001:4.0:1773851903.435269:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851903.435270:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851903.435271:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851903.435271:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.435272:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851903.435273:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851903.435273:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851903.435274:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000de3c986e.
02000000:00000001:4.0:1773851903.435275:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.435275:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.435276:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851903.435277:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096705949, transno 0, xid 1859317981325056
00010000:00000001:4.0:1773851903.435277:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851903.435278:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ba41ad91 x1859317981325056/t0(0) o400->87bc2668-48aa-41e5-aad3-cd00e0aa0d18@21858@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1852-0'
00010000:00000001:4.0:1773851903.435281:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851903.435281:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851903.435282:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=135 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851903.435283:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851903.435284:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000034e2684 refcount 3 to 21858@kfi7
00000100:00000001:4.0:1773851903.435285:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419168 : -107156724132448 : ffff9e8aa185d5a0)
02000000:00000001:4.0:1773851903.435286:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851903.435287:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.435287:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851903.435288:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21859@kfi7
00000400:00000010:4.0:1773851903.435289:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f5d265c4.
00000100:00000200:4.0:1773851903.435290:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317981325056, offset 224
00000400:00000200:4.0:1773851903.435291:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21859@kfi7
00000400:00000200:4.0:1773851903.435292:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:4.0:1773851903.435292:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 1
00000400:00000200:4.0:1773851903.435293:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000400:00000200:4.0:1773851903.435294:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 3
00000400:00000200:4.0:1773851903.435296:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21859@kfi7 local destination
00000400:00000200:4.0:1773851903.435297:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770470:8770470:1024:4294967295] 21859@kfi7 LPNI seq info [1218959:1218959:16:4294967295]
00000400:00000200:4.0:1773851903.435298:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000400:00000200:4.0:1773851903.435299:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21859@kfi7 to cpt 1
00000400:00000200:4.0:1773851903.435301:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21859@kfi7(21859@kfi7:21859@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851903.435302:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 3
00000800:00000200:4.0:1773851903.435304:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851903.435305:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851903.435307:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851903.435309:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b Using peer 21859@kfi7(0x2b)
00000800:00000200:4.0:1773851903.435312:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 0000000046154330: Posted send of 324 bytes to peer 0x2b: rc=0
00000800:00000200:4.0:1773851903.435313:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851903.435315:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.435316:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000034e2684 refcount 2 to 21858@kfi7
00010000:00000001:4.0:1773851903.435317:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851903.435317:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.435319:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851903.435319:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ba41ad91 x1859317981325056/t0(0) o400->87bc2668-48aa-41e5-aad3-cd00e0aa0d18@21858@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1852-0'
00000100:00100000:4.0:1773851903.435324:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ba41ad91 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:87bc2668-48aa-41e5-aad3-cd00e0aa0d18+6:39489:x1859317981325056:12345-21858@kfi7:400:default-tuolumne1852-0 Request processed in 61us (98us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851903.435326:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21858@kfi7, seq: 2002010
00000100:00000040:4.0:1773851903.435327:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000637b8908 : new rpc_count 0
00000100:00000001:4.0:1773851903.435328:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851903.435328:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851903.435329:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851903.435330:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d85801b.
00000020:00000010:4.0:1773851903.435331:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b1f45ba0.
00000020:00000040:4.0:1773851903.435331:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000637b8908 : new refcount 5
00000100:00000001:4.0:1773851903.435332:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851903.435337:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851903.435338:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851903.435339:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21859@kfi7: PUT: OK
00000400:00000200:5.0:1773851903.435340:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f5d265c4
00000400:00000010:5.0:1773851903.435340:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f5d265c4.
00000100:00000001:5.0:1773851903.435341:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851903.435341:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851903.435342:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008e05f987 nid 21859@kfi7 refs 2
00000800:00000200:5.0:1773851903.435344:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000046154330: 2069@kfi7:1 -> 21859@kfi7(0000000087d9316e):0x0 lsk 44 rsk 65 tsk 0 trmk 0 tmk 0 trr 1 tta 0x2b Transaction freed
00000800:00000200:29.0:1773851903.438676:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851903.438677:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851903.438678:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851903.438680:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851903.438682:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.438686:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20387@kfi7 : PUT - for me
00000400:00000200:29.0:1773851903.438687:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.438688:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 1
00000400:00000200:29.0:1773851903.438689:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.438690:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000400:00000200:29.0:1773851903.438691:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 3
00000400:00000200:29.0:1773851903.438691:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20323@kfi7 to cpt 3
00000400:00000200:29.0:1773851903.438692:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20323@kfi7 of length 224 into portal 12 MB=0x699e1181af340
00000400:00000200:29.0:1773851903.438694:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20323@kfi7 of length 224/224 into md 0x77fe1859d [64] + 13088
00000800:00000200:29.0:1773851903.438696:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851903.438697:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851903.438699:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20387@kfi7: PUT: OK
00000100:00000001:29.0:1773851903.438700:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851903.438700:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851903.438701:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e16c2529.
00000100:00000040:29.0:1773851903.438702:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000e16c2529 x1858041911374656 msgsize 224
00000100:00100000:29.0:1773851903.438704:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-20323@kfi7 (source: 12345-20387@kfi7)
00000100:00000001:29.0:1773851903.438705:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851903.438705:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000100:00000001:30.0:1773851903.438706:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851903.438707:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851903.438707:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851903.438707:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851903.438708:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851903.438708:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851903.438709:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041911374656
00000020:00000001:30.0:1773851903.438710:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851903.438710:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91769
00000020:00000001:30.0:1773851903.438711:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851903.438715:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e448dc86 refcount=6
00000020:00000001:30.0:1773851903.438716:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241499648 : -107152468051968 : ffff9e8b9f347800)
00000020:00000001:30.0:1773851903.438717:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241499648 : -107152468051968 : ffff9e8b9f347800)
00000100:00000001:30.0:1773851903.438718:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.438719:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851903.438719:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851903.438720:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851903.438721:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ec1fc6c0.
00000100:00000001:30.0:1773851903.438722:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851903.438722:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851903.438723:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851903.438724:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851903.438727:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851903.438727:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.438728:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851903.438729:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851903.438730:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851903.438730:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851903.438730:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851903.438731:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20323@kfi7, seq: 2055612
00000100:00000001:31.0:1773851903.438732:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.438732:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e448dc86 : new rpc_count 1
00000100:00000001:30.0:1773851903.438732:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208520320 : -106943501031296 : ffff9ebc469c2880)
00000100:00000001:31.0:1773851903.438733:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.438733:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e16c2529 x1858041911374656/t0(0) o400->9f30d803-c78b-4aff-a0c2-53c7b4656346@20323@kfi7:691/0 lens 224/0 e 0 to 0 dl 1773852051 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1756-0'
00000100:00000001:30.0:1773851903.438736:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.438736:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851903.438737:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e16c2529 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:9f30d803-c78b-4aff-a0c2-53c7b4656346+6:39660:x1858041911374656:12345-20323@kfi7:400:default-tuolumne1756-0
00000100:00000200:30.0:1773851903.438739:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041911374656
00000020:00000001:30.0:1773851903.438739:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851903.438740:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851903.438741:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.438741:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851903.438742:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851903.438744:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851903.438745:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041911374656, found 0 last_xid 1858041911374655
00000020:00000001:30.0:1773851903.438746:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851903.438746:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851903.438747:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851903.438747:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.438748:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851903.438749:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851903.438749:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851903.438750:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006392c63e.
02000000:00000001:30.0:1773851903.438750:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.438751:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.438752:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851903.438752:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096694172, transno 0, xid 1858041911374656
00010000:00000001:30.0:1773851903.438753:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851903.438754:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e16c2529 x1858041911374656/t0(0) o400->9f30d803-c78b-4aff-a0c2-53c7b4656346@20323@kfi7:691/0 lens 224/224 e 0 to 0 dl 1773852051 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1756-0'
00010000:00000001:30.0:1773851903.438757:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851903.438757:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851903.438758:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=136 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851903.438759:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851903.438760:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007faa644f refcount 3 to 20323@kfi7
00000100:00000001:30.0:1773851903.438760:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153088 : -107139310398528 : ffff9e8eaf7653c0)
02000000:00000001:30.0:1773851903.438761:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851903.438762:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.438762:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851903.438763:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20387@kfi7
00000400:00000010:30.0:1773851903.438764:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000007d5ec24f.
00000100:00000200:30.0:1773851903.438765:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041911374656, offset 224
00000400:00000200:30.0:1773851903.438766:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20387@kfi7
00000400:00000200:30.0:1773851903.438767:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.438768:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 1
00000400:00000200:30.0:1773851903.438769:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000400:00000200:30.0:1773851903.438770:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 3
00000400:00000200:30.0:1773851903.438772:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20387@kfi7 local destination
00000400:00000200:30.0:1773851903.438773:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770471:8770471:1024:4294967295] 20387@kfi7 LPNI seq info [17703301:17703301:16:4294967295]
00000400:00000200:30.0:1773851903.438775:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000400:00000200:30.0:1773851903.438776:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20387@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.438778:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20387@kfi7(20387@kfi7:20387@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851903.438779:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 3
00000800:00000200:30.0:1773851903.438780:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851903.438781:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851903.438784:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851903.438786:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001057 Using peer 20387@kfi7(0x100000000001057)
00000800:00000200:30.0:1773851903.438789:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000b68a0a1e: Posted send of 324 bytes to peer 0x100000000001057: rc=0
00000800:00000200:30.0:1773851903.438790:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001057 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851903.438792:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.438793:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007faa644f refcount 2 to 20323@kfi7
00010000:00000001:30.0:1773851903.438794:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851903.438794:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.438795:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851903.438796:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e16c2529 x1858041911374656/t0(0) o400->9f30d803-c78b-4aff-a0c2-53c7b4656346@20323@kfi7:691/0 lens 224/224 e 0 to 0 dl 1773852051 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1756-0'
00000100:00100000:30.0:1773851903.438799:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e16c2529 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:9f30d803-c78b-4aff-a0c2-53c7b4656346+6:39660:x1858041911374656:12345-20323@kfi7:400:default-tuolumne1756-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851903.438801:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20323@kfi7, seq: 2055612
00000100:00000040:30.0:1773851903.438802:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e448dc86 : new rpc_count 0
00000800:00000200:29.0:1773851903.438802:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001057 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851903.438803:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851903.438803:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851903.438804:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851903.438804:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:30.0:1773851903.438805:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ec1fc6c0.
00000400:00000200:29.0:1773851903.438805:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20387@kfi7: PUT: OK
00000020:00000010:30.0:1773851903.438806:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000020:00000040:30.0:1773851903.438806:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000e448dc86 : new refcount 5
00000400:00000200:29.0:1773851903.438806:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000007d5ec24f
00000400:00000010:29.0:1773851903.438806:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000007d5ec24f.
00000100:00000001:30.0:1773851903.438807:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851903.438807:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851903.438807:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851903.438808:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000496d0f49 nid 20387@kfi7 refs 2
00000800:00000200:29.0:1773851903.438810:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2054@kfi7:7 -> 20387@kfi7(00000000ac806d91):0x0 lsk 4184 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000001057 Transaction freed
00000800:00000200:1.0:1773851903.454409:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851903.454410:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851903.454411:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851903.454414:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851903.454416:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.454417:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11939@kfi7 : PUT - for me
00000400:00000200:1.0:1773851903.454418:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.454419:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 1
00000400:00000200:1.0:1773851903.454420:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.454421:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000400:00000200:1.0:1773851903.454422:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 3
00000400:00000200:1.0:1773851903.454422:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11875@kfi7 to cpt 4
00000400:00000200:1.0:1773851903.454423:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11875@kfi7 of length 224 into portal 12 MB=0x69b09f34d2a40
00000400:00000200:1.0:1773851903.454425:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11875@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 57048
00000800:00000200:1.0:1773851903.454427:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851903.454428:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851903.454429:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11939@kfi7: PUT: OK
00000100:00000001:1.0:1773851903.454431:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851903.454431:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851903.454433:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d37c7bfd.
00000100:00000040:1.0:1773851903.454433:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000d37c7bfd x1859316899195456 msgsize 224
00000100:00100000:1.0:1773851903.454435:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11875@kfi7 (source: 12345-11939@kfi7)
00000100:00000001:1.0:1773851903.454435:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851903.454436:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000100:00000001:2.0:1773851903.454437:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851903.454437:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:2.0:1773851903.454438:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851903.454438:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851903.454439:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851903.454439:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851903.454440:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316899195456
00000020:00000001:2.0:1773851903.454441:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851903.454441:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac916c1
00000020:00000001:2.0:1773851903.454442:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851903.454443:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000016f43646 refcount=66
00000020:00000001:2.0:1773851903.454444:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241490432 : -107152468061184 : ffff9e8b9f345400)
00000020:00000001:2.0:1773851903.454445:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241490432 : -107152468061184 : ffff9e8b9f345400)
00000100:00000001:2.0:1773851903.454446:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.454448:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851903.454448:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851903.454449:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.454450:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851903.454451:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851903.454451:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851903.454452:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.454453:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851903.454453:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851903.454454:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.454455:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.454456:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851903.454456:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851903.454456:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.454456:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851903.454457:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11875@kfi7, seq: 1997644
00000100:00000040:2.0:1773851903.454458:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000016f43646 : new rpc_count 2
00000100:00000001:0.0:1773851903.454458:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.454459:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327705088 : -106982381846528 : ffff9eb339220000)
00000100:00000001:0.0:1773851903.454459:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.454460:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d37c7bfd x1859316899195456/t0(0) o400->f3103dab-b948-4502-8ded-56b82d207221@11875@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1228-0'
00000100:00000001:2.0:1773851903.454463:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.454463:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851903.454464:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d37c7bfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f3103dab-b948-4502-8ded-56b82d207221+66:39641:x1859316899195456:12345-11875@kfi7:400:default-tuolumne1228-0
00000100:00000200:2.0:1773851903.454465:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316899195456
00000020:00000001:2.0:1773851903.454466:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851903.454466:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851903.454467:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.454468:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851903.454468:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851903.454469:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851903.454470:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316899195456, found 0 last_xid 1859316898628223
00000020:00000001:2.0:1773851903.454471:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851903.454471:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851903.454472:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851903.454472:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.454474:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851903.454474:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851903.454475:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851903.454475:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000bdd30879.
02000000:00000001:2.0:1773851903.454476:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.454477:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.454477:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851903.454478:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264586628, transno 0, xid 1859316899195456
00010000:00000001:2.0:1773851903.454479:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851903.454480:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d37c7bfd x1859316899195456/t0(0) o400->f3103dab-b948-4502-8ded-56b82d207221@11875@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1228-0'
00010000:00000001:2.0:1773851903.454482:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851903.454483:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851903.454484:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=136 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851903.454485:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851903.454485:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000711ef0da refcount 3 to 11875@kfi7
00000100:00000001:2.0:1773851903.454486:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301331936 : -107155408219680 : ffff9e8aeff511e0)
02000000:00000001:2.0:1773851903.454487:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851903.454487:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.454488:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851903.454489:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11939@kfi7
00000400:00000010:2.0:1773851903.454489:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009f87ba33.
00000100:00000200:2.0:1773851903.454490:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316899195456, offset 224
00000400:00000200:2.0:1773851903.454491:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11939@kfi7
00000400:00000200:2.0:1773851903.454492:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.454493:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 1
00000400:00000200:2.0:1773851903.454494:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000400:00000200:2.0:1773851903.454495:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 3
00000400:00000200:2.0:1773851903.454496:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11939@kfi7 local destination
00000400:00000200:2.0:1773851903.454497:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770472:8770472:1024:4294967295] 11939@kfi7 LPNI seq info [832170:832170:16:4294967295]
00000400:00000200:2.0:1773851903.454499:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000400:00000200:2.0:1773851903.454499:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11939@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.454501:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11939@kfi7(11939@kfi7:11939@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851903.454503:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 3
00000800:00000200:2.0:1773851903.454504:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851903.454505:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851903.454508:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851903.454510:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfa6 Using peer 11939@kfi7(0xfa6)
00000800:00000200:2.0:1773851903.454513:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 0000000014e57432: Posted send of 324 bytes to peer 0xfa6: rc=0
00000800:00000200:2.0:1773851903.454515:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfa6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851903.454517:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.454517:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000711ef0da refcount 2 to 11875@kfi7
00010000:00000001:2.0:1773851903.454518:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851903.454519:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.454519:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851903.454520:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d37c7bfd x1859316899195456/t0(0) o400->f3103dab-b948-4502-8ded-56b82d207221@11875@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1228-0'
00000100:00100000:2.0:1773851903.454523:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d37c7bfd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:f3103dab-b948-4502-8ded-56b82d207221+66:39641:x1859316899195456:12345-11875@kfi7:400:default-tuolumne1228-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851903.454525:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11875@kfi7, seq: 1997644
00000100:00000040:2.0:1773851903.454526:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000016f43646 : new rpc_count 1
00000800:00000200:1.0:1773851903.454526:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfa6 TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851903.454527:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851903.454527:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:2.0:1773851903.454528:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.454528:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000400:00000200:1.0:1773851903.454528:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:2.0:1773851903.454529:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000400:00000200:1.0:1773851903.454529:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11939@kfi7: PUT: OK
00000020:00000040:2.0:1773851903.454530:0:60951:0:(genops.c:882:class_export_put()) PUTting export 0000000016f43646 : new refcount 65
00000400:00000200:1.0:1773851903.454530:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009f87ba33
00000100:00000001:2.0:1773851903.454531:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:1.0:1773851903.454531:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009f87ba33.
00000100:00000001:1.0:1773851903.454531:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851903.454532:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851903.454533:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018723acd nid 11939@kfi7 refs 2
00000800:00000200:1.0:1773851903.454534:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000014e57432: 2069@kfi7:0 -> 11939@kfi7(000000005a1e1694):0x0 lsk 4007 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0xfa6 Transaction freed
00000800:00000200:26.0:1773851903.489144:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851903.489144:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851903.489145:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851903.489145:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:26.0:1773851903.489146:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851903.489146:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851903.489148:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851903.489148:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9891@kfi7(000000005c213168):0x722 version: 2; local version 2; negotiated version: 2
00000800:00000200:25.0:1773851903.489149:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 Using peer 9891@kfi7(0x722)
00000400:00000200:26.0:1773851903.489150:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000400:00000200:26.0:1773851903.489151:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9891@kfi7 : PUT - for me
00000400:00000200:25.0:1773851903.489151:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000400:00000200:26.0:1773851903.489152:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000400:00000200:26.0:1773851903.489153:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000786c6602 nid 9891@kfi7 refs 1
00000800:00000200:25.0:1773851903.489153:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 38 bytes to peer 0x722: rc=0
00000400:00000200:26.0:1773851903.489154:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000800:00000200:25.0:1773851903.489154:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851903.489155:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000786c6602 nid 9891@kfi7 refs 2
00000400:00000200:26.0:1773851903.489156:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000786c6602 nid 9891@kfi7 refs 3
00000400:00000200:26.0:1773851903.489157:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000400:00000200:26.0:1773851903.489158:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9891@kfi7 of length 456 into portal 12 MB=0x699e1adede140
00000400:00000200:26.0:1773851903.489159:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9891@kfi7 of length 456/456 into md 0x16159c9699 [64] + 45384
00000800:00000200:26.0:1773851903.489161:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851903.489163:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851903.489164:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9891@kfi7: PUT: OK
00000100:00000001:26.0:1773851903.489165:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851903.489166:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851903.489167:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 TN_EVENT_TX_OK event status 0
00000100:00000010:26.0:1773851903.489168:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b3d98555.
00000100:00000040:26.0:1773851903.489169:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000b3d98555 x1858044425003328 msgsize 456
00000800:00000200:25.0:1773851903.489169:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 Transaction freed
00000100:00100000:26.0:1773851903.489170:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9891@kfi7 (source: 12345-9891@kfi7)
00000100:00000001:26.0:1773851903.489171:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851903.489172:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000786c6602 nid 9891@kfi7 refs 2
00000100:00000001:24.0:1773851903.489172:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:26.0:1773851903.489173:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851903.489173:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851903.489173:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851903.489174:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851903.489175:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851903.489175:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858044425003328
00000020:00000001:24.0:1773851903.489176:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851903.489176:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9152b
00000020:00000001:24.0:1773851903.489177:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851903.489181:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009a13b008 refcount=108
00000020:00000001:24.0:1773851903.489182:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241034752 : -107152468516864 : ffff9e8b9f2d6000)
00000020:00000001:24.0:1773851903.489183:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241034752 : -107152468516864 : ffff9e8b9f2d6000)
00000100:00000001:24.0:1773851903.489184:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851903.489184:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851903.489185:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000030bb5633.
00000020:00000010:24.0:1773851903.489186:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851903.489187:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851903.489188:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851903.489188:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851903.489189:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.489190:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.489191:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851903.489193:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851903.489193:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851903.489193:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851903.489193:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851903.489194:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9891@kfi7, seq: 1451911048
00000100:00000001:26.0:1773851903.489195:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851903.489195:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851903.489195:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009a13b008 : new rpc_count 2
00000100:00000001:24.0:1773851903.489195:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637143659005952 : -106930050545664 : ffff9ebf68524800)
00000100:00000040:24.0:1773851903.489196:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b3d98555 x1858044425003328/t0(0) o17->b9059a34-2344-4c58-b046-9ffd24d46dbe@9891@kfi7:630/0 lens 456/0 e 0 to 0 dl 1773851990 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1100-0'
00000100:00000001:24.0:1773851903.489199:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851903.489199:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851903.489200:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b3d98555 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b9059a34-2344-4c58-b046-9ffd24d46dbe+108:39709:x1858044425003328:12345-9891@kfi7:17:default-tuolumne1100-0
00000100:00000200:24.0:1773851903.489201:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858044425003328
00000020:00000001:24.0:1773851903.489202:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851903.489202:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851903.489203:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.489204:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851903.489204:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:24.0:1773851903.489205:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851903.489205:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858044425003328, found 0 last_xid 1858044331299327
00000020:00000001:24.0:1773851903.489206:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851903.489207:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851903.489207:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851903.489208:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851903.489209:0:60973:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:24.0:1773851903.489210:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851903.489210:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851903.489211:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 0000000009956b1a.
02000000:00000001:24.0:1773851903.489211:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.489212:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.489213:0:60973:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:24.0:1773851903.489214:0:60973:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:24.0:1773851903.489214:0:60973:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851903.489216:0:60973:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.489216:0:60973:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:24.0:1773851903.489217:0:60973:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli b9059a34-2344-4c58-b046-9ffd24d46dbe/000000009a13b008 free: 126633370845184 avail: 126633368748032
00000020:00000001:24.0:1773851903.489218:0:60973:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:24.0:1773851903.489219:0:60973:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli b9059a34-2344-4c58-b046-9ffd24d46dbe/000000009a13b008 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:24.0:1773851903.489220:0:60973:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:24.0:1773851903.489221:0:60973:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:24.0:1773851903.489221:0:60973:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli b9059a34-2344-4c58-b046-9ffd24d46dbe/000000009a13b008 reports grant 1810628607 dropped 0, local 1878786047
00000020:00000001:24.0:1773851903.489222:0:60973:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:24.0:1773851903.489223:0:60973:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:24.0:1773851903.489224:0:60973:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851903.489225:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183263957080, transno 0, xid 1858044425003328
00010000:00000001:24.0:1773851903.489225:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851903.489226:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b3d98555 x1858044425003328/t0(0) o17->b9059a34-2344-4c58-b046-9ffd24d46dbe@9891@kfi7:630/0 lens 456/432 e 0 to 0 dl 1773851990 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1100-0'
00010000:00000001:24.0:1773851903.489228:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851903.489229:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851903.489230:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=136 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851903.489231:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851903.489231:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e5c3e3df refcount 3 to 9891@kfi7
00000100:00000001:24.0:1773851903.489232:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985420896 : -107156724130720 : ffff9e8aa185dc60)
02000000:00000001:24.0:1773851903.489233:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851903.489234:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.489234:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851903.489235:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9891@kfi7
00000400:00000010:24.0:1773851903.489235:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000460dc888.
00000100:00000200:24.0:1773851903.489236:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858044425003328, offset 224
00000400:00000200:24.0:1773851903.489237:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9891@kfi7
00000400:00000200:24.0:1773851903.489238:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.489239:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000786c6602 nid 9891@kfi7 refs 1
00000400:00000200:24.0:1773851903.489240:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000786c6602 nid 9891@kfi7 refs 2
00000400:00000200:24.0:1773851903.489241:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000786c6602 nid 9891@kfi7 refs 3
00000400:00000200:24.0:1773851903.489242:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9891@kfi7 local destination
00000400:00000200:24.0:1773851903.489243:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770473:8770473:1024:4294967295] 9891@kfi7 LPNI seq info [1186164:1186164:16:4294967295]
00000400:00000200:24.0:1773851903.489244:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000786c6602 nid 9891@kfi7 refs 2
00000400:00000200:24.0:1773851903.489245:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9891@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.489247:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9891@kfi7(9891@kfi7:9891@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851903.489248:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000786c6602 nid 9891@kfi7 refs 3
00000800:00000200:24.0:1773851903.489249:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851903.489250:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:24.0:1773851903.489252:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851903.489254:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 Using peer 9891@kfi7(0x722)
00000800:00000200:24.0:1773851903.489257:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000358ab717: Posted send of 532 bytes to peer 0x722: rc=0
00000800:00000200:24.0:1773851903.489258:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851903.489260:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851903.489260:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e5c3e3df refcount 2 to 9891@kfi7
00010000:00000001:24.0:1773851903.489261:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851903.489261:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.489262:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851903.489263:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b3d98555 x1858044425003328/t0(0) o17->b9059a34-2344-4c58-b046-9ffd24d46dbe@9891@kfi7:630/0 lens 456/432 e 0 to 0 dl 1773851990 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1100-0'
00000100:00100000:24.0:1773851903.489267:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b3d98555 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b9059a34-2344-4c58-b046-9ffd24d46dbe+108:39709:x1858044425003328:12345-9891@kfi7:17:default-tuolumne1100-0 Request processed in 67us (97us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851903.489269:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9891@kfi7, seq: 1451911048
00000100:00000040:24.0:1773851903.489269:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009a13b008 : new rpc_count 1
00000100:00000001:24.0:1773851903.489270:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851903.489271:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851903.489271:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851903.489272:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851903.489273:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000030bb5633.
00000020:00000040:24.0:1773851903.489273:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000009a13b008 : new refcount 107
00000100:00000001:24.0:1773851903.489274:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851903.489279:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851903.489280:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851903.489281:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9891@kfi7: PUT: OK
00000400:00000200:26.0:1773851903.489282:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000460dc888
00000400:00000010:26.0:1773851903.489282:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000460dc888.
00000100:00000001:26.0:1773851903.489283:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851903.489283:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851903.489284:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000786c6602 nid 9891@kfi7 refs 2
00000800:00000200:26.0:1773851903.489286:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2069@kfi7:6 -> 9891@kfi7(000000005c213168):0x0 lsk 1827 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x722 Transaction freed
00000800:00000200:1.0:1773851903.498760:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851903.498761:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851903.498763:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851903.498766:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851903.498769:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22267@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.498771:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22267@kfi7 : PUT - for me
00000400:00000200:1.0:1773851903.498773:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22267@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.498774:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007e22ce0d nid 22267@kfi7 refs 1
00000400:00000200:1.0:1773851903.498775:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22267@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.498776:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007e22ce0d nid 22267@kfi7 refs 2
00000400:00000200:1.0:1773851903.498778:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007e22ce0d nid 22267@kfi7 refs 3
00000400:00000200:1.0:1773851903.498779:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22266@kfi7 to cpt 4
00000400:00000200:1.0:1773851903.498781:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22266@kfi7 of length 440 into portal 12 MB=0x699de8d0afb00
00000400:00000200:1.0:1773851903.498783:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22266@kfi7 of length 440/440 into md 0x7fb56e801 [64] + 57272
00000800:00000200:1.0:1773851903.498786:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851903.498789:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851903.498791:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22267@kfi7: PUT: OK
00000100:00000001:1.0:1773851903.498792:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851903.498793:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851903.498794:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004c4d438f.
00000100:00000040:1.0:1773851903.498796:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000004c4d438f x1858030988360448 msgsize 440
00000100:00100000:1.0:1773851903.498798:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-22266@kfi7 (source: 12345-22267@kfi7)
00000100:00000001:1.0:1773851903.498800:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851903.498801:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007e22ce0d nid 22267@kfi7 refs 2
00000100:00000001:2.0:1773851903.498802:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851903.498804:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851903.498804:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851903.498805:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851903.498805:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851903.498807:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851903.498808:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030988360448
00000020:00000001:2.0:1773851903.498809:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851903.498810:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912ae
00000020:00000001:2.0:1773851903.498811:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851903.498814:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000ce3e864 refcount=6
00000020:00000001:2.0:1773851903.498815:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716197376 : -107155993354240 : ffff9e8acd14a000)
00000020:00000001:2.0:1773851903.498817:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716197376 : -107155993354240 : ffff9e8acd14a000)
00000100:00000001:2.0:1773851903.498818:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.498820:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851903.498820:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851903.498822:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.498823:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851903.498825:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851903.498826:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851903.498827:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.498828:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.498830:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.498832:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.498832:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851903.498833:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851903.498833:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851903.498834:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22266@kfi7, seq: 408701491
00000100:00000040:2.0:1773851903.498836:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000ce3e864 : new rpc_count 1
00000100:00000001:0.0:1773851903.498836:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.498837:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327735040 : -106982381816576 : ffff9eb339227500)
00000100:00000001:0.0:1773851903.498837:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.498839:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004c4d438f x1858030988360448/t0(0) o41->342477c9-0c6d-4683-860c-89c5961d8c63@22266@kfi7:218/0 lens 440/0 e 0 to 0 dl 1773852333 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne255-0'
00000100:00000001:2.0:1773851903.498844:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.498844:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851903.498846:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004c4d438f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:342477c9-0c6d-4683-860c-89c5961d8c63+6:114101:x1858030988360448:12345-22266@kfi7:41:default-tuolumne255-0
00000100:00000200:2.0:1773851903.498848:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030988360448
00000020:00000001:2.0:1773851903.498850:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851903.498851:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851903.498852:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.498853:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851903.498854:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:2.0:1773851903.498855:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851903.498856:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030988360448, found 0 last_xid 1858030988360447
00000020:00000001:2.0:1773851903.498858:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851903.498859:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851903.498860:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851903.498860:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.498862:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851903.498863:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851903.498863:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000d3421c59.
02000000:00000001:2.0:1773851903.498864:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.498865:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498867:0:60951:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:2.0:1773851903.498868:0:60951:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:2.0:1773851903.498869:0:60951:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498871:0:60951:0:(mdd_device.c:1491:mdd_statfs()) Process entered
00080000:00000001:2.0:1773851903.498872:0:60951:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:2.0:1773851903.498875:0:60951:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498876:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:2.0:1773851903.498877:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498878:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:2.0:1773851903.498879:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498880:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:2.0:1773851903.498881:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498882:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:2.0:1773851903.498882:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498883:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00000001:2.0:1773851903.498884:0:60951:0:(osp_dev.c:799:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498885:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498886:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0000-osc-MDT0001: 410399722496 blocks, 351500131328 free, 351498052608 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097648 files, 343261847 free files
00000004:00000001:2.0:1773851903.498889:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498890:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498890:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0001-osc-MDT0001: 410399705088 blocks, 351504315392 free, 351502167040 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372056103 files, 343265933 free files
00000004:00000001:2.0:1773851903.498897:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498898:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498899:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0002-osc-MDT0001: 410399708160 blocks, 351690105856 free, 351687715840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372231114 files, 343447369 free files
00000004:00000001:2.0:1773851903.498901:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498902:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498903:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0003-osc-MDT0001: 410399716352 blocks, 351382735872 free, 351380670464 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 371978596 files, 343147203 free files
00000004:00000001:2.0:1773851903.498905:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498906:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498906:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0004-osc-MDT0001: 410399710208 blocks, 350958917632 free, 350956861440 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 371563842 files, 342733318 free files
00000004:00000001:2.0:1773851903.498908:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498909:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498910:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0005-osc-MDT0001: 410399720448 blocks, 351351166976 free, 351348423680 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372083908 files, 343116374 free files
00000004:00000001:2.0:1773851903.498912:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498913:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498914:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0006-osc-MDT0001: 410399715328 blocks, 351482217472 free, 351481143296 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372097077 files, 343244353 free files
00000004:00000001:2.0:1773851903.498916:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498917:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498918:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0007-osc-MDT0001: 410399720448 blocks, 351449320448 free, 351446784000 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372160878 files, 343212227 free files
00000004:00000001:2.0:1773851903.498920:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498921:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498922:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0008-osc-MDT0001: 410399696896 blocks, 351353597952 free, 351351200768 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372083169 files, 343118748 free files
00000004:00000001:2.0:1773851903.498924:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498925:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498926:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0009-osc-MDT0001: 410399713280 blocks, 351388980224 free, 351386247168 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372019003 files, 343153301 free files
00000004:00000001:2.0:1773851903.498928:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498929:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498930:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000a-osc-MDT0001: 410399721472 blocks, 351406468096 free, 351404091392 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372127068 files, 343170379 free files
00000004:00000001:2.0:1773851903.498933:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498934:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498935:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000b-osc-MDT0001: 410399732736 blocks, 351378967552 free, 351375956992 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372018934 files, 343143523 free files
00000004:00000001:2.0:1773851903.498937:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498938:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498939:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000c-osc-MDT0001: 410399724544 blocks, 351466002432 free, 351462887424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372062738 files, 343228518 free files
00000004:00000001:2.0:1773851903.498941:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498942:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498943:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000d-osc-MDT0001: 410399721472 blocks, 351489069056 free, 351486055424 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372066722 files, 343251044 free files
00000004:00000001:2.0:1773851903.498945:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498946:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498947:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000e-osc-MDT0001: 410399725568 blocks, 351492784128 free, 351490364416 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372078000 files, 343254672 free files
00000004:00000001:2.0:1773851903.498949:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498950:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498951:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST000f-osc-MDT0001: 410399720448 blocks, 351524092928 free, 351521376256 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372113793 files, 343285247 free files
00000004:00000001:2.0:1773851903.498953:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498954:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498955:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0010-osc-MDT0001: 410399726592 blocks, 351510669312 free, 351508114432 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372095703 files, 343272138 free files
00000004:00000001:2.0:1773851903.498957:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498958:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498959:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0011-osc-MDT0001: 410399705088 blocks, 351541580800 free, 351539635200 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372136581 files, 343302325 free files
00000004:00000001:2.0:1773851903.498961:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498963:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498963:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0012-osc-MDT0001: 410399725568 blocks, 351470702592 free, 351461668864 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372064442 files, 343233108 free files
00000004:00000001:2.0:1773851903.498965:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498967:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498967:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0013-osc-MDT0001: 410399764480 blocks, 351666665472 free, 351645520896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372237776 files, 343424478 free files
00000004:00000001:2.0:1773851903.498970:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498972:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498972:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0014-osc-MDT0001: 410399727616 blocks, 351545838592 free, 351536230400 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372116360 files, 343306483 free files
00000004:00000001:2.0:1773851903.498974:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498976:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498976:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0015-osc-MDT0001: 410399719424 blocks, 351603982336 free, 351601690624 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372190369 files, 343363264 free files
00000004:00000001:2.0:1773851903.498979:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498980:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498981:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0016-osc-MDT0001: 410399739904 blocks, 351615890432 free, 351613254656 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372043359 files, 343374893 free files
00000004:00000001:2.0:1773851903.498983:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498984:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498985:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0017-osc-MDT0001: 410399726592 blocks, 351420200960 free, 351417826304 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372008833 files, 343183790 free files
00000004:00000001:2.0:1773851903.498987:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498988:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498989:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0018-osc-MDT0001: 410399705088 blocks, 351409059840 free, 351407102976 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372011130 files, 343172910 free files
00000004:00000001:2.0:1773851903.498991:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498992:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498993:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST0019-osc-MDT0001: 410399699968 blocks, 351480041472 free, 351478789120 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372073029 files, 343242228 free files
00000004:00000001:2.0:1773851903.498995:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.498996:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.498997:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001a-osc-MDT0001: 410399724544 blocks, 351593710592 free, 351576908800 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high, 372189933 files, 343353233 free files
00000004:00000001:2.0:1773851903.498999:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.499000:0:60951:0:(osp_dev.c:783:osp_statfs()) Process entered
00000004:00001000:2.0:1773851903.499001:0:60951:0:(osp_dev.c:806:osp_statfs()) lustre5-OST001b-osc-MDT0001: 410399693824 blocks, 351464023040 free, 351458265088 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high, 372064662 files, 343226585 free files
00000004:00000001:2.0:1773851903.499003:0:60951:0:(osp_dev.c:825:osp_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.499004:0:60951:0:(lod_dev.c:1414:lod_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.499006:0:60951:0:(mdd_device.c:1497:mdd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:2.0:1773851903.499008:0:60951:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 424673280 granted 1839581985855 pending 396361728 free 40309314514059264 avail 40308839119060992
00000004:00000020:2.0:1773851903.499010:0:60951:0:(mdt_handler.c:558:mdt_statfs()) 11491192133632 blocks: 9841141238784 free, 9841024975104 avail; 10969025337 objects: 9610489491 free; state 100
00000020:00000001:2.0:1773851903.499012:0:60951:0:(lprocfs_jobstats.c:286:lprocfs_job_stats_log()) Process entered
00000020:00000001:2.0:1773851903.499016:0:60951:0:(lprocfs_jobstats.c:338:lprocfs_job_stats_log()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:2.0:1773851903.499018:0:60951:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851903.499019:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768323, transno 0, xid 1858030988360448
00010000:00000001:2.0:1773851903.499021:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851903.499022:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004c4d438f x1858030988360448/t0(0) o41->342477c9-0c6d-4683-860c-89c5961d8c63@22266@kfi7:218/0 lens 440/368 e 0 to 0 dl 1773852333 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne255-0'
00010000:00000001:2.0:1773851903.499027:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851903.499029:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851903.499030:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=136 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851903.499032:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851903.499033:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b1bb0ffd refcount 5 to 22266@kfi7
00000100:00000001:2.0:1773851903.499035:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931363995008 : -107142345556608 : ffff9e8dfa8d7d80)
02000000:00000001:2.0:1773851903.499036:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851903.499037:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.499038:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851903.499040:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22267@kfi7
00000400:00000010:2.0:1773851903.499041:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006483d1b8.
00000100:00000200:2.0:1773851903.499042:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 10, xid 1858030988360448, offset 224
00000400:00000200:2.0:1773851903.499044:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22267@kfi7
00000400:00000200:2.0:1773851903.499046:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22267@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.499046:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007e22ce0d nid 22267@kfi7 refs 1
00000400:00000200:2.0:1773851903.499048:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007e22ce0d nid 22267@kfi7 refs 2
00000400:00000200:2.0:1773851903.499049:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007e22ce0d nid 22267@kfi7 refs 3
00000400:00000200:2.0:1773851903.499050:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22267@kfi7 local destination
00000400:00000200:2.0:1773851903.499052:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770474:8770474:1024:4294967295] 22267@kfi7 LPNI seq info [28029:28029:16:4294967295]
00000400:00000200:2.0:1773851903.499054:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007e22ce0d nid 22267@kfi7 refs 2
00000400:00000200:2.0:1773851903.499055:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22267@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.499057:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22267@kfi7(22267@kfi7:22267@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851903.499059:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007e22ce0d nid 22267@kfi7 refs 3
00000800:00000200:2.0:1773851903.499060:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851903.499061:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:2.0:1773851903.499064:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851903.499067:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005a8 Using peer 22267@kfi7(0x1000000000005a8)
00000800:00000200:2.0:1773851903.499070:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000004991649e: Posted send of 468 bytes to peer 0x1000000000005a8: rc=0
00000800:00000200:2.0:1773851903.499072:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005a8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851903.499074:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.499075:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b1bb0ffd refcount 4 to 22266@kfi7
00010000:00000001:2.0:1773851903.499076:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851903.499077:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.499078:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851903.499078:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004c4d438f x1858030988360448/t0(0) o41->342477c9-0c6d-4683-860c-89c5961d8c63@22266@kfi7:218/0 lens 440/368 e 0 to 0 dl 1773852333 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne255-0'
00000100:00100000:2.0:1773851903.499082:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004c4d438f pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:342477c9-0c6d-4683-860c-89c5961d8c63+6:114101:x1858030988360448:12345-22266@kfi7:41:default-tuolumne255-0 Request processed in 237us (286us total) trans 0 rc 0/0
00000100:00100000:2.0:1773851903.499085:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22266@kfi7, seq: 408701491
00000800:00000200:1.0:1773851903.499085:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005a8 TN_EVENT_TX_OK event status 0
00000100:00000040:2.0:1773851903.499086:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000ce3e864 : new rpc_count 0
00000100:00000001:2.0:1773851903.499087:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:2.0:1773851903.499087:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:1.0:1773851903.499087:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:2.0:1773851903.499088:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.499089:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000400:00000200:1.0:1773851903.499089:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22267@kfi7: PUT: OK
00000020:00000010:2.0:1773851903.499090:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000020:00000040:2.0:1773851903.499090:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000000ce3e864 : new refcount 5
00000400:00000200:1.0:1773851903.499090:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006483d1b8
00000400:00000010:1.0:1773851903.499090:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006483d1b8.
00000100:00000001:2.0:1773851903.499091:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:1.0:1773851903.499091:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851903.499092:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851903.499093:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007e22ce0d nid 22267@kfi7 refs 2
00000800:00000200:1.0:1773851903.499095:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004991649e: 2054@kfi7:0 -> 22267@kfi7(00000000a815fe39):0x0 lsk 1449 rsk 86 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000005a8 Transaction freed
00000800:00000200:9.0:1773851903.500587:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851903.500587:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851903.500589:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851903.500591:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851903.500593:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.500595:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.44@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851903.500596:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.500596:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851903.500598:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.44@o2ib60 to cpt 5
00000400:00000200:9.0:1773851903.500599:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 2
00000400:00000200:9.0:1773851903.500600:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 3
00000400:00000200:9.0:1773851903.500601:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.44@o2ib60 to cpt 5
00000400:00000200:9.0:1773851903.500602:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.44@o2ib60 of length 224 into portal 12 MB=0x69b2b0598c080
00000400:00000200:9.0:1773851903.500604:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.44@o2ib60 of length 224/224 into md 0x6a32cacf5 [64] + 71080
00000800:00000200:9.0:1773851903.500606:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851903.500608:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851903.500609:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851903.500610:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851903.500610:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851903.500611:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000039410571.
00000100:00000040:9.0:1773851903.500612:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000039410571 x1859458940059776 msgsize 224
00000100:00100000:9.0:1773851903.500614:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.44@o2ib60 (source: 12345-192.168.128.44@o2ib60)
00000100:00000001:9.0:1773851903.500616:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851903.500617:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851903.500618:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851903.500619:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851903.500620:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851903.500620:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851903.500621:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851903.500621:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851903.500622:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859458940059776
00000020:00000001:20.0:1773851903.500623:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851903.500623:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07c5f4c88e1
00000020:00000001:20.0:1773851903.500625:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851903.500627:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d45491cf refcount=5
00000020:00000001:20.0:1773851903.500628:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636992240006144 : -107081469545472 : ffff9e9c270bb400)
00000020:00000001:20.0:1773851903.500629:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636992240006144 : -107081469545472 : ffff9e9c270bb400)
00000100:00000001:20.0:1773851903.500630:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.500631:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851903.500632:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000156734c4.
00000020:00000010:20.0:1773851903.500633:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.500633:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851903.500634:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851903.500635:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851903.500635:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.500636:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851903.500637:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851903.500638:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.500639:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.500640:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.500640:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851903.500641:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851903.500641:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851903.500642:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.44@o2ib60, seq: 1998095
00000100:00000001:23.0:1773851903.500643:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851903.500643:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.500643:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d45491cf : new rpc_count 1
00000100:00000001:20.0:1773851903.500643:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498327168 : -106953211224448 : ffff9eba03d65e80)
00000100:00000040:20.0:1773851903.500645:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000039410571 x1859458940059776/t0(0) o400->d7135126-0e2a-45af-ba93-31b92fb030ef@192.168.128.44@o2ib60:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix44-0'
00000100:00000001:20.0:1773851903.500648:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.500648:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851903.500649:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000039410571 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:d7135126-0e2a-45af-ba93-31b92fb030ef+5:39995:x1859458940059776:12345-192.168.128.44@o2ib60:400:default-matrix44-0
00000100:00000200:20.0:1773851903.500650:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859458940059776
00000020:00000001:20.0:1773851903.500651:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851903.500652:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851903.500652:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.500653:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851903.500654:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851903.500655:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851903.500655:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859458940059776, found 0 last_xid 1859458940059775
00000020:00000001:20.0:1773851903.500656:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851903.500657:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851903.500657:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851903.500658:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.500658:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851903.500659:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851903.500660:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851903.500660:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000052cfb64f.
02000000:00000001:20.0:1773851903.500661:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.500662:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.500662:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851903.500663:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183077510627, transno 0, xid 1859458940059776
00010000:00000001:20.0:1773851903.500664:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851903.500665:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000039410571 x1859458940059776/t0(0) o400->d7135126-0e2a-45af-ba93-31b92fb030ef@192.168.128.44@o2ib60:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix44-0'
00010000:00000001:20.0:1773851903.500667:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851903.500668:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851903.500668:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=136 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851903.500669:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851903.500670:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000045e72181 refcount 3 to 192.168.128.44@o2ib60
00000100:00000001:20.0:1773851903.500671:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452384 : -107146752099232 : ffff9e8cf3e6fc60)
02000000:00000001:20.0:1773851903.500672:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851903.500673:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.500673:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851903.500674:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.44@o2ib60
00000400:00000010:20.0:1773851903.500675:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000408d3b17.
00000100:00000200:20.0:1773851903.500676:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859458940059776, offset 224
00000400:00000200:20.0:1773851903.500677:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.44@o2ib60
00000400:00000200:20.0:1773851903.500678:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.44@o2ib60 to cpt 5
00000400:00000200:20.0:1773851903.500679:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 2
00000400:00000200:20.0:1773851903.500680:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 3
00000400:00000200:20.0:1773851903.500682:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 4
00000400:00000200:20.0:1773851903.500685:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.44@o2ib60 routed destination
00000400:00000200:20.0:1773851903.500686:0:60934:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:20.0:1773851903.500687:0:60934:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:20.0:1773851903.500688:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.44@o2ib60: rtr pref emtpy: 1
00000400:00000200:20.0:1773851903.500690:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:20.0:1773851903.500691:0:60934:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.44@o2ib60: rtr pref emtpy: 1
00000400:00000200:20.0:1773851903.500692:0:60934:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:20.0:1773851903.500693:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770475:8770475:1024:4294967295] 2094@kfi7 LPNI seq info [1258747028:1258747028:16:4294967295]
00000400:00000200:20.0:1773851903.500694:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:20.0:1773851903.500695:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:20.0:1773851903.500697:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.44@o2ib60(192.168.128.44@o2ib60:2094@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851903.500699:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000099a0cdbb nid 192.168.128.44@o2ib60 refs 3
00000800:00000200:20.0:1773851903.500700:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851903.500702:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851903.500704:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851903.500706:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:20.0:1773851903.500709:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000294c799f: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:20.0:1773851903.500710:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851903.500712:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851903.500713:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000045e72181 refcount 2 to 192.168.128.44@o2ib60
00010000:00000001:20.0:1773851903.500714:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851903.500714:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851903.500715:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851903.500716:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000039410571 x1859458940059776/t0(0) o400->d7135126-0e2a-45af-ba93-31b92fb030ef@192.168.128.44@o2ib60:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix44-0'
00000100:00100000:20.0:1773851903.500720:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000039410571 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:d7135126-0e2a-45af-ba93-31b92fb030ef+5:39995:x1859458940059776:12345-192.168.128.44@o2ib60:400:default-matrix44-0 Request processed in 71us (106us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851903.500723:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.44@o2ib60, seq: 1998095
00000100:00000040:20.0:1773851903.500724:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d45491cf : new rpc_count 0
00000100:00000001:20.0:1773851903.500729:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851903.500730:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851903.500730:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.500731:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:20.0:1773851903.500732:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000156734c4.
00000020:00000040:20.0:1773851903.500732:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000d45491cf : new refcount 4
00000100:00000001:20.0:1773851903.500733:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.500739:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851903.500740:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.500741:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:21.0:1773851903.500742:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000408d3b17
00000400:00000010:21.0:1773851903.500742:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000408d3b17.
00000100:00000001:21.0:1773851903.500743:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851903.500743:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851903.500744:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:21.0:1773851903.500745:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000294c799f: 2054@kfi7:5 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 5 tta 0x20000000000000c Transaction freed
00000800:00000200:3.0:1773851903.585766:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851903.585768:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851903.585770:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851903.585773:0:2506738:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:3.0:1773851903.585776:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:3.0:1773851903.585778:0:2506738:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14337@kfi7 : PUT - for me
00000400:00000200:3.0:1773851903.585780:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:3.0:1773851903.585781:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 1
00000400:00000200:3.0:1773851903.585783:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:3.0:1773851903.585784:0:2506738:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000400:00000200:3.0:1773851903.585785:0:2506738:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 3
00000400:00000200:3.0:1773851903.585786:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14528@kfi7 to cpt 7
00000400:00000200:3.0:1773851903.585788:0:2506738:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14528@kfi7 of length 224 into portal 12 MB=0x69b4b905b5740
00000400:00000200:3.0:1773851903.585790:0:2506738:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14528@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 57712
00000800:00000200:3.0:1773851903.585793:0:2506738:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:3.0:1773851903.585795:0:2506738:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:3.0:1773851903.585797:0:2506738:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14337@kfi7: PUT: OK
00000100:00000001:3.0:1773851903.585799:0:2506738:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:3.0:1773851903.585799:0:2506738:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:3.0:1773851903.585802:0:2506738:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b40c5bbd.
00000100:00000040:3.0:1773851903.585803:0:2506738:0:(events.c:358:request_in_callback()) incoming req@00000000b40c5bbd x1859598707021632 msgsize 224
00000100:00100000:3.0:1773851903.585806:0:2506738:0:(events.c:361:request_in_callback()) peer: 12345-14528@kfi7 (source: 12345-14337@kfi7)
00000100:00000001:3.0:1773851903.585808:0:2506738:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:3.0:1773851903.585809:0:2506738:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000100:00000001:2.0:1773851903.585810:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851903.585811:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:3.0:1773851903.585812:0:2506738:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851903.585812:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851903.585813:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851903.585814:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851903.585815:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598707021632
00000020:00000001:2.0:1773851903.585816:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851903.585817:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80056
00000020:00000001:2.0:1773851903.585818:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851903.585821:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001fc955ce refcount=5
00000020:00000001:2.0:1773851903.585822:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637059659974656 : -107014049576960 : ffff9eabd996c800)
00000020:00000001:2.0:1773851903.585824:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637059659974656 : -107014049576960 : ffff9eabd996c800)
00000100:00000001:2.0:1773851903.585825:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.585826:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851903.585827:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851903.585829:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.585830:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851903.585831:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851903.585832:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851903.585833:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.585834:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851903.585835:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851903.585835:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.585837:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.585839:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.585839:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851903.585840:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851903.585840:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:2.0:1773851903.585841:0:60951:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14528@kfi7, seq: 1997645
00000100:00000040:2.0:1773851903.585843:0:60951:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001fc955ce : new rpc_count 1
00000100:00000001:0.0:1773851903.585843:0:42868:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.585844:0:60951:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637133514874752 : -106940194676864 : ffff9ebd0baf1f80)
00000100:00000001:0.0:1773851903.585844:0:42868:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.585846:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b40c5bbd x1859598707021632/t0(0) o400->5572fbc8-1545-4f89-a541-491a75017e2f@14528@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1395-0'
00000100:00000001:2.0:1773851903.585850:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.585851:0:60951:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:2.0:1773851903.585852:0:60951:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b40c5bbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5572fbc8-1545-4f89-a541-491a75017e2f+5:39616:x1859598707021632:12345-14528@kfi7:400:default-tuolumne1395-0
00000100:00000200:2.0:1773851903.585857:0:60951:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598707021632
00000020:00000001:2.0:1773851903.585858:0:60951:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:2.0:1773851903.585859:0:60951:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:2.0:1773851903.585860:0:60951:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.585861:0:60951:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:2.0:1773851903.585862:0:60951:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:2.0:1773851903.585863:0:60951:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:2.0:1773851903.585864:0:60951:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598707021632, found 0 last_xid 1859598707021631
00000020:00000001:2.0:1773851903.585866:0:60951:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851903.585867:0:60951:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:2.0:1773851903.585867:0:60951:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:2.0:1773851903.585868:0:60951:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.585869:0:60951:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:2.0:1773851903.585870:0:60951:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:2.0:1773851903.585871:0:60951:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:2.0:1773851903.585872:0:60951:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000046cfdfe5.
02000000:00000001:2.0:1773851903.585873:0:60951:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.585874:0:60951:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.585875:0:60951:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:2.0:1773851903.585876:0:60951:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096703605, transno 0, xid 1859598707021632
00010000:00000001:2.0:1773851903.585877:0:60951:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:2.0:1773851903.585879:0:60951:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b40c5bbd x1859598707021632/t0(0) o400->5572fbc8-1545-4f89-a541-491a75017e2f@14528@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1395-0'
00010000:00000001:2.0:1773851903.585883:0:60951:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:2.0:1773851903.585884:0:60951:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:2.0:1773851903.585885:0:60951:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=136 v=600 (1 1121 1 1)
00000100:00000001:2.0:1773851903.585886:0:60951:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:2.0:1773851903.585887:0:60951:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000028dc5e87 refcount 3 to 14528@kfi7
00000100:00000001:2.0:1773851903.585888:0:60951:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957478944 : -107146752072672 : ffff9e8cf3e76420)
02000000:00000001:2.0:1773851903.585890:0:60951:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:2.0:1773851903.585891:0:60951:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.585892:0:60951:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851903.585893:0:60951:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14337@kfi7
00000400:00000010:2.0:1773851903.585894:0:60951:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008543743c.
00000100:00000200:2.0:1773851903.585896:0:60951:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598707021632, offset 224
00000400:00000200:2.0:1773851903.585898:0:60951:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14337@kfi7
00000400:00000200:2.0:1773851903.585900:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.585901:0:60951:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 1
00000400:00000200:2.0:1773851903.585903:0:60951:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000400:00000200:2.0:1773851903.585905:0:60951:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 3
00000400:00000200:2.0:1773851903.585907:0:60951:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14337@kfi7 local destination
00000400:00000200:2.0:1773851903.585909:0:60951:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770476:8770476:1024:4294967295] 14337@kfi7 LPNI seq info [11120092:11120092:16:4294967295]
00000400:00000200:2.0:1773851903.585911:0:60951:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000400:00000200:2.0:1773851903.585912:0:60951:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14337@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.585915:0:60951:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14337@kfi7(14337@kfi7:14337@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851903.585917:0:60951:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 3
00000800:00000200:2.0:1773851903.585919:0:60951:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851903.585921:0:60951:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:2.0:1773851903.585924:0:60951:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:2.0:1773851903.585928:0:60951:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88c Using peer 14337@kfi7(0x88c)
00000800:00000200:2.0:1773851903.585933:0:60951:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000e8d7e86a: Posted send of 324 bytes to peer 0x88c: rc=0
00000800:00000200:2.0:1773851903.585935:0:60951:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:2.0:1773851903.585938:0:60951:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851903.585939:0:60951:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000028dc5e87 refcount 2 to 14528@kfi7
00010000:00000001:2.0:1773851903.585940:0:60951:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:2.0:1773851903.585941:0:60951:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:2.0:1773851903.585942:0:60951:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:2.0:1773851903.585943:0:60951:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b40c5bbd x1859598707021632/t0(0) o400->5572fbc8-1545-4f89-a541-491a75017e2f@14528@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1395-0'
00000100:00100000:2.0:1773851903.585948:0:60951:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b40c5bbd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_056:5572fbc8-1545-4f89-a541-491a75017e2f+5:39616:x1859598707021632:12345-14528@kfi7:400:default-tuolumne1395-0 Request processed in 97us (144us total) trans 0 rc 0/0
00000800:00000200:1.0:1773851903.585949:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88c TN_EVENT_TX_OK event status 0
00000100:00100000:2.0:1773851903.585952:0:60951:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14528@kfi7, seq: 1997645
00000400:00000200:1.0:1773851903.585952:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:2.0:1773851903.585953:0:60951:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001fc955ce : new rpc_count 0
00000100:00000001:2.0:1773851903.585954:0:60951:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:1.0:1773851903.585954:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14337@kfi7: PUT: OK
00000100:00000001:2.0:1773851903.585955:0:60951:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:1.0:1773851903.585955:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008543743c
00000020:00000010:2.0:1773851903.585956:0:60951:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000400:00000010:1.0:1773851903.585956:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008543743c.
00000020:00000010:2.0:1773851903.585957:0:60951:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000020:00000010:2.0:1773851903.585958:0:60951:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000100:00000001:1.0:1773851903.585958:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851903.585958:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:2.0:1773851903.585959:0:60951:0:(genops.c:882:class_export_put()) PUTting export 000000001fc955ce : new refcount 4
00000400:00000200:1.0:1773851903.585960:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000063de033a nid 14337@kfi7 refs 2
00000100:00000001:2.0:1773851903.585961:0:60951:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851903.585962:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e8d7e86a: 2069@kfi7:0 -> 14337@kfi7(00000000e4470e61):0x0 lsk 2189 rsk 3 tsk 0 trmk 0 tmk 0 trr 0 tta 0x88c Transaction freed
00000800:00000200:21.0:1773851903.604981:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851903.604982:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851903.604984:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851903.604987:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851903.604993:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.604995:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8291@kfi7 : PUT - for me
00000400:00000200:21.0:1773851903.604996:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.604998:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 1
00000400:00000200:21.0:1773851903.605000:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.605001:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000400:00000200:21.0:1773851903.605002:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 3
00000400:00000200:21.0:1773851903.605003:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:21.0:1773851903.605005:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8291@kfi7 of length 224 into portal 12 MB=0x699e42c2fcb40
00000400:00000200:21.0:1773851903.605007:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8291@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 71304
00000800:00000200:21.0:1773851903.605010:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851903.605012:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851903.605014:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8291@kfi7: PUT: OK
00000100:00000001:21.0:1773851903.605015:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851903.605016:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851903.605017:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001b07fb39.
00000100:00000040:21.0:1773851903.605018:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000001b07fb39 x1858055133186880 msgsize 224
00000100:00100000:21.0:1773851903.605020:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-8291@kfi7 (source: 12345-8291@kfi7)
00000100:00000001:21.0:1773851903.605022:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851903.605024:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000100:00000001:20.0:1773851903.605025:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851903.605025:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851903.605026:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851903.605026:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851903.605027:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851903.605028:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851903.605029:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858055133186880
00000020:00000001:20.0:1773851903.605030:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851903.605031:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91bd7
00000020:00000001:20.0:1773851903.605032:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851903.605038:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b315c015 refcount=5967
00000020:00000001:20.0:1773851903.605039:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628034560 : -107123081517056 : ffff9e9276c76800)
00000020:00000001:20.0:1773851903.605041:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628034560 : -107123081517056 : ffff9e9276c76800)
00000100:00000001:20.0:1773851903.605042:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851903.605044:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851903.605045:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000156734c4.
00000020:00000010:20.0:1773851903.605046:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851903.605048:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000288ff20f.
00000100:00000001:20.0:1773851903.605049:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851903.605050:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851903.605051:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851903.605052:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851903.605053:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851903.605054:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851903.605055:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851903.605058:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851903.605058:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851903.605058:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851903.605059:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851903.605060:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8291@kfi7, seq: 1998096
00000100:00000040:23.0:1773851903.605062:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b315c015 : new rpc_count 8
00000100:00000001:20.0:1773851903.605062:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851903.605063:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313422336 : -106917396129280 : ffff9ec25a955a00)
00000100:00000001:20.0:1773851903.605063:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851903.605065:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001b07fb39 x1858055133186880/t0(0) o400->3d87da24-b427-4287-836f-67cf84d90c94@8291@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne1004-0'
00000100:00000001:23.0:1773851903.605070:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851903.605072:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851903.605073:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001b07fb39 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3d87da24-b427-4287-836f-67cf84d90c94+5967:40621:x1858055133186880:12345-8291@kfi7:400:login-tuolumne1004-0
00000100:00000200:23.0:1773851903.605076:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858055133186880
00000020:00000001:23.0:1773851903.605077:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851903.605078:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851903.605079:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851903.605080:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851903.605081:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851903.605082:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851903.605083:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858055133186880, found 0 last_xid 1858055132577599
00000020:00000001:23.0:1773851903.605084:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851903.605085:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851903.605086:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851903.605087:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851903.605088:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851903.605089:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851903.605090:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851903.605091:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005f866e7c.
02000000:00000001:23.0:1773851903.605092:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851903.605093:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851903.605094:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851903.605095:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593871, transno 0, xid 1858055133186880
00010000:00000001:23.0:1773851903.605097:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851903.605098:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001b07fb39 x1858055133186880/t0(0) o400->3d87da24-b427-4287-836f-67cf84d90c94@8291@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1004-0'
00010000:00000001:23.0:1773851903.605102:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851903.605103:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851903.605104:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=136 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851903.605106:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851903.605107:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ed825b52 refcount 3 to 8291@kfi7
00000100:00000001:23.0:1773851903.605108:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402094304 : -107139307457312 : ffff9e8eafa334e0)
02000000:00000001:23.0:1773851903.605110:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851903.605110:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851903.605112:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851903.605114:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8291@kfi7
00000400:00000010:23.0:1773851903.605115:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000dffbbfb6.
00000100:00000200:23.0:1773851903.605116:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858055133186880, offset 224
00000400:00000200:23.0:1773851903.605118:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8291@kfi7
00000400:00000200:23.0:1773851903.605120:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:23.0:1773851903.605121:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 1
00000400:00000200:23.0:1773851903.605123:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000400:00000200:23.0:1773851903.605125:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 3
00000400:00000200:23.0:1773851903.605126:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8291@kfi7 local destination
00000400:00000200:23.0:1773851903.605129:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770477:8770477:1024:4294967295] 8291@kfi7 LPNI seq info [41191085:41191085:16:4294967295]
00000400:00000200:23.0:1773851903.605132:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000400:00000200:23.0:1773851903.605133:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8291@kfi7 to cpt 5
00000400:00000200:23.0:1773851903.605137:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8291@kfi7(8291@kfi7:8291@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851903.605140:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 3
00000800:00000200:23.0:1773851903.605142:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851903.605144:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851903.605149:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851903.605153:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x14000000000001b6 Using peer 8291@kfi7(0x14000000000001b6)
00000800:00000200:23.0:1773851903.605159:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000009dd258a1: Posted send of 324 bytes to peer 0x14000000000001b6: rc=0
00000800:00000200:23.0:1773851903.605162:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x14000000000001b6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851903.605165:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851903.605167:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ed825b52 refcount 2 to 8291@kfi7
00010000:00000001:23.0:1773851903.605168:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851903.605169:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851903.605170:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851903.605172:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001b07fb39 x1858055133186880/t0(0) o400->3d87da24-b427-4287-836f-67cf84d90c94@8291@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne1004-0'
00000800:00000200:21.0:1773851903.605175:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x14000000000001b6 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851903.605178:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:23.0:1773851903.605179:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001b07fb39 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:3d87da24-b427-4287-836f-67cf84d90c94+5967:40621:x1858055133186880:12345-8291@kfi7:400:login-tuolumne1004-0 Request processed in 107us (159us total) trans 0 rc 0/0
00000400:00000200:21.0:1773851903.605180:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8291@kfi7: PUT: OK
00000400:00000200:21.0:1773851903.605181:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000dffbbfb6
00000400:00000010:21.0:1773851903.605182:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000dffbbfb6.
00000100:00100000:23.0:1773851903.605183:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8291@kfi7, seq: 1998096
00000100:00000001:21.0:1773851903.605183:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851903.605184:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:23.0:1773851903.605185:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b315c015 : new rpc_count 7
00000100:00000001:23.0:1773851903.605186:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:21.0:1773851903.605186:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000db0bcdbf nid 8291@kfi7 refs 2
00000100:00000001:23.0:1773851903.605187:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851903.605188:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000800:00000200:21.0:1773851903.605188:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009dd258a1: 2054@kfi7:5 -> 8291@kfi7(00000000d6e62d98):0x0 lsk 439 rsk 48 tsk 0 trmk 0 tmk 0 trr 5 tta 0x14000000000001b6 Transaction freed
00000020:00000010:23.0:1773851903.605190:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000288ff20f.
00000020:00000010:23.0:1773851903.605192:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000156734c4.
00000020:00000040:23.0:1773851903.605193:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b315c015 : new refcount 5966
00000100:00000001:23.0:1773851903.605194:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851903.609140:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851903.609141:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851903.609142:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851903.609144:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851903.609146:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.609147:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14466@kfi7 : PUT - for me
00000400:00000200:9.0:1773851903.609148:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.609150:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 1
00000400:00000200:9.0:1773851903.609151:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.609151:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000400:00000200:9.0:1773851903.609152:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 3
00000400:00000200:9.0:1773851903.609153:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14467@kfi7 to cpt 5
00000400:00000200:9.0:1773851903.609154:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14467@kfi7 of length 224 into portal 12 MB=0x69b1913e95100
00000400:00000200:9.0:1773851903.609155:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14467@kfi7 of length 224/224 into md 0x78146ce49 [64] + 168464
00000800:00000200:9.0:1773851903.609157:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851903.609159:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851903.609160:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14466@kfi7: PUT: OK
00000100:00000001:9.0:1773851903.609161:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851903.609161:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851903.609162:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f4aea272.
00000100:00000040:9.0:1773851903.609162:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000f4aea272 x1859381870809344 msgsize 224
00000100:00100000:9.0:1773851903.609164:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-14467@kfi7 (source: 12345-14466@kfi7)
00000100:00000001:9.0:1773851903.609165:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851903.609166:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000800:00000200:9.0:1773851903.609167:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:8.0:1773851903.609167:0:60898:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:8.0:1773851903.609167:0:60898:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:8.0:1773851903.609168:0:60898:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:8.0:1773851903.609168:0:60898:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851903.609169:0:60898:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851903.609170:0:60898:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859381870809344
00000020:00000001:8.0:1773851903.609170:0:60898:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:8.0:1773851903.609171:0:60898:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0796852dd1e
00000020:00000001:8.0:1773851903.609172:0:60898:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:8.0:1773851903.609176:0:60898:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b80a48ea refcount=5
00000020:00000001:8.0:1773851903.609176:0:60898:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637013007810560 : -107060701741056 : ffff9ea0fce74000)
00000020:00000001:8.0:1773851903.609177:0:60898:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637013007810560 : -107060701741056 : ffff9ea0fce74000)
00000100:00000001:8.0:1773851903.609178:0:60898:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:8.0:1773851903.609179:0:60898:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:8.0:1773851903.609180:0:60898:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f5279bed.
00000020:00000010:8.0:1773851903.609181:0:60898:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000013598747.
00000020:00000010:8.0:1773851903.609182:0:60898:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000006e231bd3.
00000100:00000001:8.0:1773851903.609183:0:60898:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:8.0:1773851903.609184:0:60898:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:8.0:1773851903.609184:0:60898:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851903.609185:0:60898:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:8.0:1773851903.609186:0:60898:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:8.0:1773851903.609186:0:60898:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.609187:0:60898:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851903.609188:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851903.609189:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851903.609189:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851903.609189:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851903.609190:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14467@kfi7, seq: 2130894
00000100:00000040:11.0:1773851903.609191:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b80a48ea : new rpc_count 1
00000100:00000001:8.0:1773851903.609191:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.609192:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498305280 : -106953211246336 : ffff9eba03d60900)
00000100:00000001:8.0:1773851903.609192:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851903.609193:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f4aea272 x1859381870809344/t0(0) o400->ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c@14467@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1400-0'
00000100:00000001:11.0:1773851903.609197:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851903.609197:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851903.609198:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4aea272 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c+5:39826:x1859381870809344:12345-14467@kfi7:400:default-tuolumne1400-0
00000100:00000200:11.0:1773851903.609199:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859381870809344
00000020:00000001:11.0:1773851903.609200:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851903.609201:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851903.609201:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.609202:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851903.609203:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851903.609204:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851903.609204:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859381870809344, found 0 last_xid 1859381870809343
00000020:00000001:11.0:1773851903.609205:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851903.609206:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851903.609207:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851903.609207:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.609208:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851903.609209:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851903.609209:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851903.609210:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e1fd08a7.
02000000:00000001:11.0:1773851903.609211:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.609211:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.609212:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851903.609212:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182676018384, transno 0, xid 1859381870809344
00010000:00000001:11.0:1773851903.609213:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851903.609214:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f4aea272 x1859381870809344/t0(0) o400->ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c@14467@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1400-0'
00010000:00000001:11.0:1773851903.609217:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851903.609217:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851903.609218:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=136 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851903.609219:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851903.609220:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002ccbb477 refcount 3 to 14467@kfi7
00000100:00000001:11.0:1773851903.609221:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964026816 : -107156745524800 : ffff9e8aa03f69c0)
02000000:00000001:11.0:1773851903.609222:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851903.609223:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.609223:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851903.609224:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14466@kfi7
00000400:00000010:11.0:1773851903.609225:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000035d9b0de.
00000100:00000200:11.0:1773851903.609226:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859381870809344, offset 224
00000400:00000200:11.0:1773851903.609227:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14466@kfi7
00000400:00000200:11.0:1773851903.609228:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:11.0:1773851903.609229:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 1
00000400:00000200:11.0:1773851903.609230:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000400:00000200:11.0:1773851903.609231:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 3
00000400:00000200:11.0:1773851903.609232:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14466@kfi7 local destination
00000400:00000200:11.0:1773851903.609234:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770478:8770478:1024:4294967295] 14466@kfi7 LPNI seq info [638823:638823:16:4294967295]
00000400:00000200:11.0:1773851903.609235:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000400:00000200:11.0:1773851903.609236:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14466@kfi7 to cpt 2
00000400:00000200:11.0:1773851903.609238:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14466@kfi7(14466@kfi7:14466@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851903.609239:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 3
00000800:00000200:11.0:1773851903.609240:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851903.609242:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851903.609244:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851903.609246:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xcf5 Using peer 14466@kfi7(0xcf5)
00000800:00000200:11.0:1773851903.609249:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0xcf5: rc=0
00000800:00000200:11.0:1773851903.609250:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xcf5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851903.609252:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851903.609253:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002ccbb477 refcount 2 to 14467@kfi7
00010000:00000001:11.0:1773851903.609254:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851903.609254:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.609255:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851903.609256:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f4aea272 x1859381870809344/t0(0) o400->ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c@14467@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1400-0'
00000100:00100000:11.0:1773851903.609259:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4aea272 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:ce630e27-d7aa-4e3f-b33a-a5c5bd8bf20c+5:39826:x1859381870809344:12345-14467@kfi7:400:default-tuolumne1400-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851903.609262:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14467@kfi7, seq: 2130894
00000800:00000200:9.0:1773851903.609262:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xcf5 TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851903.609263:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b80a48ea : new rpc_count 0
00000100:00000001:11.0:1773851903.609264:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851903.609264:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851903.609264:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851903.609265:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000013598747.
00000400:00000200:9.0:1773851903.609265:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14466@kfi7: PUT: OK
00000020:00000010:11.0:1773851903.609266:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000006e231bd3.
00000400:00000200:9.0:1773851903.609266:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000035d9b0de
00000020:00000010:11.0:1773851903.609267:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f5279bed.
00000400:00000010:9.0:1773851903.609267:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000035d9b0de.
00000100:00000001:9.0:1773851903.609267:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:11.0:1773851903.609268:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b80a48ea : new refcount 4
00000100:00000001:11.0:1773851903.609268:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851903.609268:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851903.609269:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d63911b2 nid 14466@kfi7 refs 2
00000800:00000200:9.0:1773851903.609270:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 14466@kfi7(0000000084e8891a):0x0 lsk 3318 rsk 41 tsk 0 trmk 0 tmk 0 trr 2 tta 0xcf5 Transaction freed
00000800:00000200:5.0:1773851903.696130:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851903.696131:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851903.696133:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851903.696137:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851903.696140:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:5.0:1773851903.696142:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19537@kfi7 : PUT - for me
00000400:00000200:5.0:1773851903.696143:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:5.0:1773851903.696145:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 1
00000400:00000200:5.0:1773851903.696146:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:5.0:1773851903.696147:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000400:00000200:5.0:1773851903.696149:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 3
00000400:00000200:5.0:1773851903.696151:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19536@kfi7 to cpt 6
00000400:00000200:5.0:1773851903.696153:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19536@kfi7 of length 224 into portal 12 MB=0x69b174cd13d80
00000400:00000200:5.0:1773851903.696155:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19536@kfi7 of length 224/224 into md 0x793926dc5 [64] + 169352
00000800:00000200:5.0:1773851903.696158:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851903.696161:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851903.696162:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19537@kfi7: PUT: OK
00000100:00000001:5.0:1773851903.696164:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851903.696165:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851903.696167:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b656cafc.
00000100:00000040:5.0:1773851903.696168:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000b656cafc x1859374235598208 msgsize 224
00000100:00100000:5.0:1773851903.696170:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-19536@kfi7 (source: 12345-19537@kfi7)
00000100:00000001:5.0:1773851903.696172:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851903.696173:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000100:00000001:4.0:1773851903.696174:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851903.696174:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851903.696175:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851903.696175:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851903.696176:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851903.696176:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851903.696176:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374235598208
00000020:00000001:4.0:1773851903.696177:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851903.696177:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793b0a0da9
00000020:00000001:4.0:1773851903.696178:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851903.696179:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000046053e5c refcount=5
00000020:00000001:4.0:1773851903.696180:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636939132352512 : -107134577199104 : ffff9e8fc9953800)
00000020:00000001:4.0:1773851903.696181:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636939132352512 : -107134577199104 : ffff9e8fc9953800)
00000100:00000001:4.0:1773851903.696182:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851903.696183:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851903.696184:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b1f45ba0.
00000020:00000010:4.0:1773851903.696185:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851903.696186:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d85801b.
00000100:00000001:4.0:1773851903.696186:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851903.696187:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851903.696188:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.696189:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851903.696189:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851903.696190:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.696191:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.696192:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851903.696193:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851903.696194:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851903.696194:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851903.696194:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19536@kfi7, seq: 2002011
00000100:00000001:7.0:1773851903.696195:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.696195:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000046053e5c : new rpc_count 1
00000100:00000001:4.0:1773851903.696195:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637121088358656 : -106952621192960 : ffff9eba27018900)
00000100:00000001:7.0:1773851903.696196:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.696197:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000b656cafc x1859374235598208/t0(0) o400->a6e73be6-36ee-481a-8cf7-3e6235c0cd00@19536@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1714-0'
00000100:00000001:4.0:1773851903.696199:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851903.696200:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851903.696201:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000b656cafc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:a6e73be6-36ee-481a-8cf7-3e6235c0cd00+5:39907:x1859374235598208:12345-19536@kfi7:400:default-tuolumne1714-0
00000100:00000200:4.0:1773851903.696202:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374235598208
00000020:00000001:4.0:1773851903.696203:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851903.696203:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851903.696204:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.696205:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851903.696205:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851903.696206:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851903.696206:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374235598208, found 0 last_xid 1859374235598207
00000020:00000001:4.0:1773851903.696207:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851903.696208:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851903.696208:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851903.696209:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.696210:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851903.696210:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851903.696211:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851903.696211:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef85de26.
02000000:00000001:4.0:1773851903.696212:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.696213:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.696214:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851903.696215:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154596474, transno 0, xid 1859374235598208
00010000:00000001:4.0:1773851903.696216:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851903.696217:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000b656cafc x1859374235598208/t0(0) o400->a6e73be6-36ee-481a-8cf7-3e6235c0cd00@19536@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1714-0'
00010000:00000001:4.0:1773851903.696219:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851903.696220:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851903.696220:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=135 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851903.696222:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851903.696222:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cf68c30f refcount 3 to 19536@kfi7
00000100:00000001:4.0:1773851903.696223:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331296 : -107155410220320 : ffff9e8aefd68ae0)
02000000:00000001:4.0:1773851903.696224:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851903.696224:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.696225:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851903.696226:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19537@kfi7
00000400:00000010:4.0:1773851903.696226:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000008d6fd271.
00000100:00000200:4.0:1773851903.696227:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374235598208, offset 224
00000400:00000200:4.0:1773851903.696229:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19537@kfi7
00000400:00000200:4.0:1773851903.696229:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:4.0:1773851903.696230:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 1
00000400:00000200:4.0:1773851903.696231:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000400:00000200:4.0:1773851903.696232:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 3
00000400:00000200:4.0:1773851903.696233:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19537@kfi7 local destination
00000400:00000200:4.0:1773851903.696235:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770479:8770479:1024:4294967295] 19537@kfi7 LPNI seq info [18778078:18778078:16:4294967295]
00000400:00000200:4.0:1773851903.696236:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000400:00000200:4.0:1773851903.696237:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19537@kfi7 to cpt 1
00000400:00000200:4.0:1773851903.696239:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19537@kfi7(19537@kfi7:19537@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851903.696240:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 3
00000800:00000200:4.0:1773851903.696241:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851903.696242:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851903.696244:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851903.696247:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006d3 Using peer 19537@kfi7(0x1000000000006d3)
00000800:00000200:4.0:1773851903.696250:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x1000000000006d3: rc=0
00000800:00000200:4.0:1773851903.696252:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006d3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851903.696254:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.696255:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cf68c30f refcount 2 to 19536@kfi7
00010000:00000001:4.0:1773851903.696255:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851903.696256:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.696257:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851903.696257:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b656cafc x1859374235598208/t0(0) o400->a6e73be6-36ee-481a-8cf7-3e6235c0cd00@19536@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1714-0'
00000100:00100000:4.0:1773851903.696262:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000b656cafc pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:a6e73be6-36ee-481a-8cf7-3e6235c0cd00+5:39907:x1859374235598208:12345-19536@kfi7:400:default-tuolumne1714-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851903.696264:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19536@kfi7, seq: 2002011
00000100:00000040:4.0:1773851903.696265:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000046053e5c : new rpc_count 0
00000100:00000001:4.0:1773851903.696266:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851903.696266:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851903.696267:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851903.696267:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d85801b.
00000020:00000010:4.0:1773851903.696268:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b1f45ba0.
00000020:00000040:4.0:1773851903.696269:0:60963:0:(genops.c:882:class_export_put()) PUTting export 0000000046053e5c : new refcount 4
00000100:00000001:4.0:1773851903.696270:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851903.696276:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006d3 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851903.696279:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851903.696280:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19537@kfi7: PUT: OK
00000400:00000200:5.0:1773851903.696282:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000008d6fd271
00000400:00000010:5.0:1773851903.696282:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000008d6fd271.
00000100:00000001:5.0:1773851903.696283:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851903.696284:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851903.696285:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002667fedc nid 19537@kfi7 refs 2
00000800:00000200:5.0:1773851903.696288:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2054@kfi7:1 -> 19537@kfi7(00000000aad223e9):0x0 lsk 1748 rsk 44 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000006d3 Transaction freed
00000800:00000200:30.0:1773851903.768003:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851903.768005:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851903.768007:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851903.768012:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851903.768015:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8915@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.768017:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8915@kfi7 : PUT - for me
00000400:00000200:30.0:1773851903.768019:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8915@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.768020:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 1
00000400:00000200:30.0:1773851903.768022:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8915@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.768023:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 2
00000400:00000200:30.0:1773851903.768025:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 3
00000400:00000200:30.0:1773851903.768026:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8915@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.768028:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8915@kfi7 of length 224 into portal 12 MB=0x69b4bfa441040
00000400:00000200:30.0:1773851903.768031:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8915@kfi7 of length 224/224 into md 0x77fe1859d [64] + 13312
00000800:00000200:30.0:1773851903.768035:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851903.768039:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851903.768041:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8915@kfi7: PUT: OK
00000100:00000001:30.0:1773851903.768042:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851903.768043:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851903.768045:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a47817b8.
00000100:00000040:30.0:1773851903.768046:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000a47817b8 x1859600483881024 msgsize 224
00000100:00100000:30.0:1773851903.768048:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-8915@kfi7 (source: 12345-8915@kfi7)
00000100:00000001:30.0:1773851903.768051:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851903.768053:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 2
00000800:00000200:30.0:1773851903.768056:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b68a0a1e: 2069@kfi7:7 <- 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851903.768061:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851903.768061:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851903.768062:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851903.768063:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851903.768064:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851903.768066:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600483881024
00000020:00000001:30.0:1773851903.768067:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851903.768067:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e52d7a0d5
00000020:00000001:30.0:1773851903.768068:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851903.768073:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b60f90a5 refcount=8
00000020:00000001:30.0:1773851903.768074:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636934456947712 : -107139252603904 : ffff9e8eb2e83400)
00000020:00000001:30.0:1773851903.768075:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636934456947712 : -107139252603904 : ffff9e8eb2e83400)
00000100:00000001:30.0:1773851903.768077:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.768078:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851903.768079:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851903.768081:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851903.768082:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ec1fc6c0.
00000100:00000001:30.0:1773851903.768084:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851903.768084:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851903.768085:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851903.768087:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851903.768088:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851903.768088:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.768090:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851903.768092:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851903.768092:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851903.768093:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851903.768093:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851903.768094:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8915@kfi7, seq: 2055613
00000100:00000001:31.0:1773851903.768096:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.768096:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b60f90a5 : new rpc_count 1
00000100:00000001:31.0:1773851903.768097:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.768097:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411257216 : -106960298294400 : ffff9eb85d6a4380)
00000100:00000040:30.0:1773851903.768099:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a47817b8 x1859600483881024/t0(0) o400->546589f1-5243-4d08-8810-91f5d7737d00@8915@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1045-0'
00000100:00000001:30.0:1773851903.768103:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.768104:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851903.768106:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a47817b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:546589f1-5243-4d08-8810-91f5d7737d00+8:39604:x1859600483881024:12345-8915@kfi7:400:default-tuolumne1045-0
00000100:00000200:30.0:1773851903.768109:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600483881024
00000020:00000001:30.0:1773851903.768109:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851903.768110:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851903.768112:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.768113:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851903.768114:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851903.768115:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851903.768116:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600483881024, found 0 last_xid 1859600483881023
00000020:00000001:30.0:1773851903.768117:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851903.768118:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851903.768119:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851903.768120:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.768121:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851903.768122:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851903.768123:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851903.768124:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007dbeb200.
02000000:00000001:30.0:1773851903.768125:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.768126:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.768127:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851903.768128:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859600483881024
00010000:00000001:30.0:1773851903.768130:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851903.768131:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a47817b8 x1859600483881024/t0(0) o400->546589f1-5243-4d08-8810-91f5d7737d00@8915@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1045-0'
00010000:00000001:30.0:1773851903.768135:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851903.768136:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851903.768137:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=136 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851903.768139:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851903.768140:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ee3ab4df refcount 3 to 8915@kfi7
00000100:00000001:30.0:1773851903.768141:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270144 : -107152618281472 : ffff9e8b96402600)
02000000:00000001:30.0:1773851903.768143:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851903.768143:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.768145:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851903.768147:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8915@kfi7
00000400:00000010:30.0:1773851903.768148:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000e57a604.
00000100:00000200:30.0:1773851903.768149:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600483881024, offset 224
00000400:00000200:30.0:1773851903.768151:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8915@kfi7
00000400:00000200:30.0:1773851903.768152:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8915@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.768154:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 1
00000400:00000200:30.0:1773851903.768155:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 2
00000400:00000200:30.0:1773851903.768157:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 3
00000400:00000200:30.0:1773851903.768159:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  8915@kfi7 local destination
00000400:00000200:30.0:1773851903.768161:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770480:8770480:1024:4294967295] 8915@kfi7 LPNI seq info [33672:33672:16:4294967295]
00000400:00000200:30.0:1773851903.768164:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 2
00000400:00000200:30.0:1773851903.768165:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8915@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.768168:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 8915@kfi7(8915@kfi7:8915@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851903.768170:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 3
00000800:00000200:30.0:1773851903.768172:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851903.768174:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851903.768177:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851903.768181:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bd Using peer 8915@kfi7(0x3bd)
00000800:00000200:30.0:1773851903.768186:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b68a0a1e: Posted send of 324 bytes to peer 0x3bd: rc=0
00000800:00000200:30.0:1773851903.768188:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851903.768192:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.768193:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ee3ab4df refcount 2 to 8915@kfi7
00010000:00000001:30.0:1773851903.768194:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851903.768195:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.768196:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851903.768197:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a47817b8 x1859600483881024/t0(0) o400->546589f1-5243-4d08-8810-91f5d7737d00@8915@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1045-0'
00000800:00000200:29.0:1773851903.768203:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bd TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851903.768205:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:30.0:1773851903.768207:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a47817b8 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:546589f1-5243-4d08-8810-91f5d7737d00+8:39604:x1859600483881024:12345-8915@kfi7:400:default-tuolumne1045-0 Request processed in 103us (160us total) trans 0 rc 0/0
00000400:00000200:29.0:1773851903.768207:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8915@kfi7: PUT: OK
00000400:00000200:29.0:1773851903.768208:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000e57a604
00000400:00000010:29.0:1773851903.768209:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000e57a604.
00000100:00000001:29.0:1773851903.768210:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:30.0:1773851903.768211:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8915@kfi7, seq: 2055613
00000100:00000001:29.0:1773851903.768211:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851903.768212:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ef8cdb47 nid 8915@kfi7 refs 2
00000100:00000040:30.0:1773851903.768213:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b60f90a5 : new rpc_count 0
00000100:00000001:30.0:1773851903.768214:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851903.768215:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851903.768215:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b68a0a1e: 2069@kfi7:7 -> 8915@kfi7(00000000934f98c9):0x0 lsk 958 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x3bd Transaction freed
00000020:00000010:30.0:1773851903.768216:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851903.768217:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ec1fc6c0.
00000020:00000010:30.0:1773851903.768218:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000020:00000040:30.0:1773851903.768220:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000b60f90a5 : new refcount 7
00000100:00000001:30.0:1773851903.768220:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851903.772910:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851903.772911:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851903.772912:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851903.772914:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851903.772917:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.772918:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16378@kfi7 : PUT - for me
00000400:00000200:17.0:1773851903.772919:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.772919:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 1
00000400:00000200:17.0:1773851903.772921:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.772921:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000400:00000200:17.0:1773851903.772922:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 3
00000400:00000200:17.0:1773851903.772923:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:17.0:1773851903.772924:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16379@kfi7 of length 224 into portal 12 MB=0x699de8bdc2040
00000400:00000200:17.0:1773851903.772925:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16379@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 51512
00000800:00000200:17.0:1773851903.772927:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851903.772928:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851903.772930:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16378@kfi7: PUT: OK
00000100:00000001:17.0:1773851903.772930:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851903.772931:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851903.772932:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000058f08be8.
00000100:00000040:17.0:1773851903.772932:0:2511435:0:(events.c:358:request_in_callback()) incoming req@0000000058f08be8 x1858030968512576 msgsize 224
00000100:00100000:17.0:1773851903.772934:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-16379@kfi7 (source: 12345-16378@kfi7)
00000100:00000001:17.0:1773851903.772935:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851903.772936:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:17.0:1773851903.772936:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 2
02000000:00000001:19.0:1773851903.772937:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851903.772937:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851903.772937:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851903.772937:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851903.772938:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851903.772939:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968512576
00000020:00000001:19.0:1773851903.772939:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851903.772940:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91069
00000020:00000001:19.0:1773851903.772941:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851903.772944:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000009c236c0 refcount=6
00000020:00000001:19.0:1773851903.772944:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240103936 : -107152469447680 : ffff9e8b9f1f2c00)
00000020:00000001:19.0:1773851903.772945:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240103936 : -107152469447680 : ffff9e8b9f1f2c00)
00000100:00000001:19.0:1773851903.772946:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851903.772947:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851903.772947:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000231c32fd.
00000020:00000010:19.0:1773851903.772948:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851903.772949:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851903.772950:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851903.772950:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851903.772951:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851903.772951:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851903.772952:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851903.772952:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.772953:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851903.772954:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851903.772955:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851903.772955:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851903.772955:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851903.772956:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16379@kfi7, seq: 2156452
00000100:00000040:19.0:1773851903.772957:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000009c236c0 : new rpc_count 1
00000100:00000001:19.0:1773851903.772957:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794795008 : -107029914756608 : ffff9ea827f35a00)
00000100:00000001:16.0:1773851903.772957:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851903.772957:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851903.772959:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000058f08be8 x1858030968512576/t0(0) o400->62cca3f4-8fd1-4c26-a5b3-5e10ec9de534@16379@kfi7:691/0 lens 224/0 e 0 to 0 dl 1773852051 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne232-0'
00000100:00000001:19.0:1773851903.772961:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851903.772962:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851903.772963:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000058f08be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:62cca3f4-8fd1-4c26-a5b3-5e10ec9de534+6:47867:x1858030968512576:12345-16379@kfi7:400:default-tuolumne232-0
00000100:00000200:19.0:1773851903.772964:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968512576
00000020:00000001:19.0:1773851903.772965:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851903.772965:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851903.772966:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.772966:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851903.772967:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851903.772969:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851903.772969:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968512576, found 0 last_xid 1858030968512575
00000020:00000001:19.0:1773851903.772970:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851903.772970:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851903.772971:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851903.772971:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.772972:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851903.772973:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851903.772973:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851903.772975:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eaf648c8.
02000000:00000001:19.0:1773851903.772976:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.772976:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.772977:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851903.772978:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030968512576
00010000:00000001:19.0:1773851903.772978:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851903.772979:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000058f08be8 x1858030968512576/t0(0) o400->62cca3f4-8fd1-4c26-a5b3-5e10ec9de534@16379@kfi7:691/0 lens 224/224 e 0 to 0 dl 1773852051 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00010000:00000001:19.0:1773851903.772981:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851903.772982:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851903.772983:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=136 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851903.772984:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851903.772984:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b253f1f refcount 5 to 16379@kfi7
00000100:00000001:19.0:1773851903.772985:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715062880 : -107155994488736 : ffff9e8acd035060)
02000000:00000001:19.0:1773851903.772986:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851903.772986:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.772987:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851903.772988:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16378@kfi7
00000400:00000010:19.0:1773851903.772988:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c549776.
00000100:00000200:19.0:1773851903.772989:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968512576, offset 224
00000400:00000200:19.0:1773851903.772990:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16378@kfi7
00000400:00000200:19.0:1773851903.772991:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:19.0:1773851903.772992:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 1
00000400:00000200:19.0:1773851903.772993:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000400:00000200:19.0:1773851903.772994:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 3
00000400:00000200:19.0:1773851903.772996:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16378@kfi7 local destination
00000400:00000200:19.0:1773851903.772997:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770481:8770481:1024:4294967295] 16378@kfi7 LPNI seq info [24406:24406:16:4294967295]
00000400:00000200:19.0:1773851903.772999:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000400:00000200:19.0:1773851903.772999:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16378@kfi7 to cpt 4
00000400:00000200:19.0:1773851903.773001:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16378@kfi7(16378@kfi7:16378@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851903.773002:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 3
00000800:00000200:19.0:1773851903.773003:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851903.773004:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851903.773006:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851903.773008:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x138 Using peer 16378@kfi7(0x138)
00000800:00000200:19.0:1773851903.773012:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x138: rc=0
00000800:00000200:19.0:1773851903.773013:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x138 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851903.773015:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851903.773016:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b253f1f refcount 4 to 16379@kfi7
00010000:00000001:19.0:1773851903.773016:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851903.773017:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.773018:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851903.773018:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000058f08be8 x1858030968512576/t0(0) o400->62cca3f4-8fd1-4c26-a5b3-5e10ec9de534@16379@kfi7:691/0 lens 224/224 e 0 to 0 dl 1773852051 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00000100:00100000:19.0:1773851903.773021:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000058f08be8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:62cca3f4-8fd1-4c26-a5b3-5e10ec9de534+6:47867:x1858030968512576:12345-16379@kfi7:400:default-tuolumne232-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851903.773023:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16379@kfi7, seq: 2156452
00000100:00000040:19.0:1773851903.773024:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000009c236c0 : new rpc_count 0
00000100:00000001:19.0:1773851903.773024:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851903.773025:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:17.0:1773851903.773025:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x138 TN_EVENT_TX_OK event status 0
00000020:00000010:19.0:1773851903.773026:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851903.773026:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000020:00000010:19.0:1773851903.773027:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000231c32fd.
00000400:00000200:17.0:1773851903.773027:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:19.0:1773851903.773028:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000009c236c0 : new refcount 5
00000400:00000200:17.0:1773851903.773028:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16378@kfi7: PUT: OK
00000100:00000001:19.0:1773851903.773029:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851903.773029:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c549776
00000400:00000010:17.0:1773851903.773029:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c549776.
00000100:00000001:17.0:1773851903.773030:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851903.773031:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851903.773032:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b168a976 nid 16378@kfi7 refs 2
00000800:00000200:17.0:1773851903.773033:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2069@kfi7:4 -> 16378@kfi7(000000001e64f7c0):0x0 lsk 313 rsk 90 tsk 0 trmk 0 tmk 0 trr 4 tta 0x138 Transaction freed
00000800:00000200:29.0:1773851903.773385:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851903.773386:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851903.773387:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851903.773389:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851903.773391:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.773392:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16379@kfi7 : PUT - for me
00000400:00000200:29.0:1773851903.773393:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.773394:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 1
00000400:00000200:29.0:1773851903.773396:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.773396:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000400:00000200:29.0:1773851903.773397:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 3
00000400:00000200:29.0:1773851903.773398:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.773399:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16379@kfi7 of length 224 into portal 12 MB=0x699de8bdc2880
00000400:00000200:29.0:1773851903.773400:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16379@kfi7 of length 224/224 into md 0x77fe1859d [64] + 13536
00000800:00000200:29.0:1773851903.773401:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851903.773403:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851903.773404:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16379@kfi7: PUT: OK
00000100:00000001:29.0:1773851903.773405:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851903.773406:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851903.773406:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a9343bb.
00000100:00000040:29.0:1773851903.773407:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000001a9343bb x1858030968514688 msgsize 224
00000100:00100000:29.0:1773851903.773408:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-16379@kfi7 (source: 12345-16379@kfi7)
00000100:00000001:29.0:1773851903.773409:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851903.773410:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000100:00000001:30.0:1773851903.773411:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851903.773411:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:30.0:1773851903.773412:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851903.773412:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851903.773412:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:30.0:1773851903.773413:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851903.773414:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030968514688
00000020:00000001:30.0:1773851903.773414:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851903.773415:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91261
00000020:00000001:30.0:1773851903.773416:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851903.773420:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ef038100 refcount=6
00000020:00000001:30.0:1773851903.773421:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716198400 : -107155993353216 : ffff9e8acd14a400)
00000020:00000001:30.0:1773851903.773422:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716198400 : -107155993353216 : ffff9e8acd14a400)
00000100:00000001:30.0:1773851903.773423:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.773424:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851903.773424:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851903.773426:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851903.773426:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ec1fc6c0.
00000100:00000001:30.0:1773851903.773427:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851903.773428:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851903.773428:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851903.773429:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851903.773430:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851903.773431:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.773432:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851903.773433:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851903.773433:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851903.773433:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851903.773433:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851903.773434:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16379@kfi7, seq: 2055614
00000100:00000001:31.0:1773851903.773435:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.773435:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ef038100 : new rpc_count 1
00000100:00000001:30.0:1773851903.773435:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208532992 : -106943501018624 : ffff9ebc469c5a00)
00000100:00000001:31.0:1773851903.773436:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.773437:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a9343bb x1858030968514688/t0(0) o400->7edca6f3-ed65-447f-a152-66b9ba44fa80@16379@kfi7:155/0 lens 224/0 e 0 to 0 dl 1773852270 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne232-0'
00000100:00000001:30.0:1773851903.773440:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.773440:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851903.773441:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a9343bb pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:7edca6f3-ed65-447f-a152-66b9ba44fa80+6:47868:x1858030968514688:12345-16379@kfi7:400:default-tuolumne232-0
00000100:00000200:30.0:1773851903.773442:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030968514688
00000020:00000001:30.0:1773851903.773443:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851903.773443:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851903.773444:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.773444:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851903.773445:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851903.773446:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851903.773446:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030968514688, found 0 last_xid 1858030968514687
00000020:00000001:30.0:1773851903.773447:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851903.773448:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851903.773448:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851903.773449:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.773449:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851903.773450:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851903.773450:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851903.773451:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000008de5cd1.
02000000:00000001:30.0:1773851903.773452:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.773452:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.773453:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851903.773453:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768283, transno 0, xid 1858030968514688
00010000:00000001:30.0:1773851903.773455:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851903.773456:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a9343bb x1858030968514688/t0(0) o400->7edca6f3-ed65-447f-a152-66b9ba44fa80@16379@kfi7:155/0 lens 224/224 e 0 to 0 dl 1773852270 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00010000:00000001:30.0:1773851903.773459:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851903.773459:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851903.773460:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=136 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851903.773461:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851903.773461:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b253f1f refcount 5 to 16379@kfi7
00000100:00000001:30.0:1773851903.773462:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917715062880 : -107155994488736 : ffff9e8acd035060)
02000000:00000001:30.0:1773851903.773463:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851903.773464:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.773464:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851903.773465:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16379@kfi7
00000400:00000010:30.0:1773851903.773466:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bddd7f6b.
00000100:00000200:30.0:1773851903.773466:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030968514688, offset 224
00000400:00000200:30.0:1773851903.773468:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16379@kfi7
00000400:00000200:30.0:1773851903.773468:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.773469:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 1
00000400:00000200:30.0:1773851903.773470:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000400:00000200:30.0:1773851903.773472:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 3
00000400:00000200:30.0:1773851903.773473:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16379@kfi7 local destination
00000400:00000200:30.0:1773851903.773474:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770482:8770482:1024:4294967295] 16379@kfi7 LPNI seq info [24407:24407:16:4294967295]
00000400:00000200:30.0:1773851903.773475:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000400:00000200:30.0:1773851903.773476:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16379@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.773478:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16379@kfi7(16379@kfi7:16379@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851903.773480:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 3
00000800:00000200:30.0:1773851903.773481:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851903.773482:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851903.773484:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851903.773488:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000013e Using peer 16379@kfi7(0x10000000000013e)
00000800:00000200:30.0:1773851903.773491:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000c05b04ad: Posted send of 324 bytes to peer 0x10000000000013e: rc=0
00000800:00000200:30.0:1773851903.773493:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000013e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851903.773495:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.773496:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b253f1f refcount 4 to 16379@kfi7
00010000:00000001:30.0:1773851903.773497:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851903.773497:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.773498:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851903.773498:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a9343bb x1858030968514688/t0(0) o400->7edca6f3-ed65-447f-a152-66b9ba44fa80@16379@kfi7:155/0 lens 224/224 e 0 to 0 dl 1773852270 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne232-0'
00000100:00100000:30.0:1773851903.773501:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a9343bb pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:7edca6f3-ed65-447f-a152-66b9ba44fa80+6:47868:x1858030968514688:12345-16379@kfi7:400:default-tuolumne232-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:30.0:1773851903.773504:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16379@kfi7, seq: 2055614
00000100:00000040:30.0:1773851903.773504:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ef038100 : new rpc_count 0
00000800:00000200:29.0:1773851903.773504:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000013e TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851903.773505:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851903.773505:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:30.0:1773851903.773506:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851903.773506:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851903.773506:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16379@kfi7: PUT: OK
00000020:00000010:30.0:1773851903.773507:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ec1fc6c0.
00000020:00000010:30.0:1773851903.773507:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000400:00000200:29.0:1773851903.773507:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bddd7f6b
00000020:00000040:30.0:1773851903.773508:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000ef038100 : new refcount 5
00000400:00000010:29.0:1773851903.773508:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bddd7f6b.
00000100:00000001:29.0:1773851903.773508:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851903.773509:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851903.773509:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851903.773509:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b60370a8 nid 16379@kfi7 refs 2
00000800:00000200:29.0:1773851903.773511:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c05b04ad: 2054@kfi7:7 -> 16379@kfi7(00000000d446f643):0x0 lsk 319 rsk 88 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000013e Transaction freed
00000800:00000200:18.0:1773851903.778143:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851903.778143:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851903.778144:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851903.778144:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851903.778145:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851903.778145:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851903.778147:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851903.778147:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8448@kfi7(000000000abc97fc):0x127b version: 2; local version 2; negotiated version: 2
00000400:00000200:18.0:1773851903.778149:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8448@kfi7 to cpt 4
00000800:00000200:17.0:1773851903.778149:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b Using peer 8448@kfi7(0x10000000000127b)
00000400:00000200:18.0:1773851903.778150:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 8448@kfi7 : PUT - for me
00000400:00000200:18.0:1773851903.778151:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8448@kfi7 to cpt 4
00000400:00000200:18.0:1773851903.778152:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ca090f0 nid 8448@kfi7 refs 1
00000400:00000200:18.0:1773851903.778153:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8448@kfi7 to cpt 4
00000400:00000200:18.0:1773851903.778154:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ca090f0 nid 8448@kfi7 refs 2
00000400:00000200:18.0:1773851903.778155:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ca090f0 nid 8448@kfi7 refs 3
00000400:00000200:17.0:1773851903.778156:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8448@kfi7 to cpt 4
00000400:00000200:18.0:1773851903.778157:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8640@kfi7 to cpt 7
00000400:00000200:18.0:1773851903.778158:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8640@kfi7 of length 520 into portal 12 MB=0x69b96006f4ac0
00000800:00000200:17.0:1773851903.778158:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x10000000000127b: rc=0
00000400:00000200:18.0:1773851903.778159:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8640@kfi7 of length 520/520 into md 0x6ab01b5d1 [64] + 51736
00000800:00000200:17.0:1773851903.778160:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:18.0:1773851903.778161:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851903.778162:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851903.778163:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8448@kfi7: PUT: OK
00000100:00000001:18.0:1773851903.778164:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851903.778165:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851903.778166:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a572783.
00000100:00000040:18.0:1773851903.778167:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001a572783 x1859918414957248 msgsize 520
00000100:00100000:18.0:1773851903.778168:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-8640@kfi7 (source: 12345-8448@kfi7)
00000100:00000001:18.0:1773851903.778169:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:19.0:1773851903.778170:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:18.0:1773851903.778170:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ca090f0 nid 8448@kfi7 refs 2
02000000:00000001:19.0:1773851903.778171:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851903.778171:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851903.778172:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:18.0:1773851903.778172:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000800:00000200:17.0:1773851903.778172:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b TN_EVENT_TX_OK event status 0
02000000:00000001:19.0:1773851903.778173:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851903.778173:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859918414957248
00000020:00000001:19.0:1773851903.778174:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851903.778174:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b6e3109a6
00000800:00000200:17.0:1773851903.778174:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b Transaction freed
00000020:00000001:19.0:1773851903.778175:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851903.778179:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000003104de1 refcount=10
00000020:00000001:19.0:1773851903.778180:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133871429632 : -106939838121984 : ffff9ebd20efb800)
00000020:00000001:19.0:1773851903.778180:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133871429632 : -106939838121984 : ffff9ebd20efb800)
00000100:00000001:19.0:1773851903.778181:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851903.778182:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851903.778183:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000231c32fd.
00000020:00000010:19.0:1773851903.778184:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851903.778185:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851903.778185:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851903.778186:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851903.778186:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851903.778187:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000200:19.0:1773851903.778188:0:60961:0:(nrs.c:872:ptlrpc_nrs_hpreq_add_nolock()) @@@ high priority req  req@000000001a572783 x1859918414957248/t0(0) o38->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852103 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1027-0'
00000100:00000001:19.0:1773851903.778191:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851903.778191:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.778192:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851903.778193:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851903.778194:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851903.778194:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851903.778194:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851903.778195:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-8640@kfi7, seq: 2156453
00000100:00000040:19.0:1773851903.778196:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000003104de1 : new rpc_count 2
00000100:00000001:16.0:1773851903.778196:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851903.778196:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.778197:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609975808 : -107015099575808 : ffff9eab9b011200)
00000100:00000040:19.0:1773851903.778198:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a572783 x1859918414957248/t0(0) o38->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:0/0 lens 520/0 e 0 to 0 dl 1773852103 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1027-0'
00000100:00000001:19.0:1773851903.778200:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851903.778201:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851903.778202:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a572783 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f+10:39961:x1859918414957248:12345-8640@kfi7:38:default-tuolumne1027-0
00000100:00000200:19.0:1773851903.778203:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859918414957248
00000020:00000001:19.0:1773851903.778204:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00010000:00000001:19.0:1773851903.778204:0:60961:0:(ldlm_lib.c:1108:target_handle_connect()) Process entered
00000020:00000040:19.0:1773851903.778206:0:60961:0:(obd_config.c:918:class_incref()) incref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00000020:00000001:19.0:1773851903.778207:0:60961:0:(genops.c:675:class_str2obd()) Process leaving (rc=18446636946211611648 : -107127497939968 : ffff9e916f8a2400)
00000100:00000001:19.0:1773851903.778208:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851903.778209:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851903.778209:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 672 at 000000001d7b97ca.
02000000:00000001:19.0:1773851903.778210:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.778211:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851903.778212:0:60961:0:(ldlm_lib.c:883:target_handle_reconnect()) Process entered
00010000:02000400:19.0:1773851903.778213:0:60961:0:(ldlm_lib.c:914:target_handle_reconnect()) lustre5-MDT0001: Client 8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f (at 8640@kfi7) reconnecting
00010000:00000001:19.0:1773851903.778213:0:60961:0:(ldlm_lib.c:915:target_handle_reconnect()) Process leaving via out_already (rc=0 : 0 : 0x0)
00010000:00000001:19.0:1773851903.778214:0:60961:0:(ldlm_lib.c:966:target_handle_reconnect()) Process leaving (rc=114 : 114 : 72)
00010000:00080000:19.0:1773851903.778215:0:60961:0:(ldlm_lib.c:1370:target_handle_connect()) lustre5-MDT0001: connection from 8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7 t0 exp 0000000003104de1 cur 614178 last 1773851903
00010000:00000001:19.0:1773851903.778216:0:60961:0:(obd_class.h:873:obd_reconnect()) Process entered
00000004:00000001:19.0:1773851903.778217:0:60961:0:(mdt_handler.c:6888:mdt_obd_reconnect()) Process entered
00000001:00000001:19.0:1773851903.778217:0:60961:0:(nodemap_handler.c:384:nodemap_add_member()) Process entered
00000001:00000001:19.0:1773851903.778218:0:60961:0:(nodemap_handler.c:263:nodemap_classify_nid()) Process entered
00000001:00000040:19.0:1773851903.778218:0:60961:0:(nodemap_handler.c:96:nodemap_getref()) GETting nodemap default(p=000000008266b5f7) : new refcount 1419
00000001:00000001:19.0:1773851903.778219:0:60961:0:(nodemap_handler.c:289:nodemap_classify_nid()) Process leaving (rc=18446636928574898176 : -107145134653440 : ffff9e8d544f4000)
00000001:00000001:19.0:1773851903.778220:0:60961:0:(nodemap_member.c:99:nm_member_add()) Process entered
00000001:00000001:19.0:1773851903.778220:0:60961:0:(nodemap_member.c:114:nm_member_add()) Process leaving (rc=0 : 0 : 0)
00000001:00000040:19.0:1773851903.778221:0:60961:0:(nodemap_handler.c:112:nodemap_putref()) PUTting nodemap default(p=000000008266b5f7) : new refcount 1418
00000001:00000001:19.0:1773851903.778221:0:60961:0:(nodemap_handler.c:405:nodemap_add_member()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.778223:0:60961:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00000020:00000001:19.0:1773851903.778223:0:60961:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:19.0:1773851903.778224:0:60961:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f/0000000003104de1 free: 126633370845184 avail: 126633368748032
00000020:00000001:19.0:1773851903.778226:0:60961:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:19.0:1773851903.778226:0:60961:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f/0000000003104de1 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:19.0:1773851903.778227:0:60961:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:19.0:1773851903.778228:0:60961:0:(tgt_grant.c:913:tgt_grant_alloc()) Process entered
00000020:00000001:19.0:1773851903.778228:0:60961:0:(tgt_grant.c:943:tgt_grant_alloc()) Process leaving (rc=0 : 0 : 0)
00000020:00000020:19.0:1773851903.778229:0:60961:0:(tgt_grant.c:1079:tgt_grant_connect()) lustre5-MDT0001: cli 8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f/0000000003104de1 ocd_grant: 454295552 want: 2097152 left: 112130449866752
00000020:00000001:19.0:1773851903.778230:0:60961:0:(tgt_grant.c:1081:tgt_grant_connect()) Process leaving
00000004:00100000:19.0:1773851903.778231:0:60961:0:(mdt_handler.c:6641:mdt_connect_internal()) lustre5-MDT0001: cli 8640@kfi7 supports cksum type f7, return f7
00000004:00000001:19.0:1773851903.778232:0:60961:0:(mdt_fs.c:69:mdt_export_stats_init()) Process entered
00000020:00000001:19.0:1773851903.778233:0:60961:0:(lprocfs_status_server.c:524:lprocfs_exp_setup()) Process entered
00000020:00000001:19.0:1773851903.778233:0:60961:0:(lprocfs_status_server.c:541:lprocfs_exp_setup()) Process leaving (rc=18446744073709551502 : -114 : ffffffffffffff8e)
00000004:00000001:19.0:1773851903.778234:0:60961:0:(mdt_fs.c:74:mdt_export_stats_init()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:19.0:1773851903.778235:0:60961:0:(mdt_handler.c:6904:mdt_obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851903.778235:0:60961:0:(obd_class.h:883:obd_reconnect()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851903.778236:0:60961:0:(service.c:1064:ptlrpc_request_change_export()) RPC PUTting export 0000000003104de1 : new rpc_count 1
00000020:00000040:19.0:1773851903.778237:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000003104de1 : new refcount 10
00000020:00000040:19.0:1773851903.778238:0:60961:0:(genops.c:871:class_export_get()) GET export 0000000003104de1 refcount=11
00000100:00000040:19.0:1773851903.778238:0:60961:0:(service.c:1070:ptlrpc_request_change_export()) RPC GETting export 0000000003104de1 : new rpc_count 2
00000100:00000001:19.0:1773851903.778239:0:60961:0:(connection.c:84:ptlrpc_connection_get()) Process entered
00000400:00000200:19.0:1773851903.778240:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8640@kfi7 to cpt 7
00000400:00000200:19.0:1773851903.778242:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000006faa87f5 nid 8640@kfi7 refs 1
00000400:00000200:19.0:1773851903.778243:0:60961:0:(peer.c:1550:LNetPrimaryNID()) lnet_peer_ni_decref_locked 000000006faa87f5 nid 8640@kfi7 refs 2
00000400:00000200:19.0:1773851903.778244:0:60961:0:(peer.c:1555:LNetPrimaryNID()) NID 8640@kfi7 primary NID 8640@kfi7 rc 0
00000100:00000001:19.0:1773851903.778336:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851903.778337:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3aa866a refcount 3 to 8640@kfi7
00000100:00000001:19.0:1773851903.778338:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637113204256128 : -106960505295488 : ffff9eb85113ad80)
00000100:00000001:19.0:1773851903.778338:0:60961:0:(connection.c:91:ptlrpc_connection_get()) Process leaving via out (rc=18446637113204256128 : -106960505295488 : 0xffff9eb85113ad80)
00000100:00000040:19.0:1773851903.778340:0:60961:0:(connection.c:133:ptlrpc_connection_get()) conn=00000000a3aa866a refcount 3 to 8640@kfi7
00000100:00080000:19.0:1773851903.778342:0:60961:0:(import.c:86:import_set_state_nolock()) 00000000c59af7e9 nCÞ: changing import state from FULL to RECOVER
00010000:00000040:19.0:1773851903.778344:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3aa866a refcount 2 to 8640@kfi7
00000100:00000001:19.0:1773851903.778344:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851903.778345:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3aa866a refcount 3 to 8640@kfi7
00000100:00000001:19.0:1773851903.778345:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637113204256128 : -106960505295488 : ffff9eb85113ad80)
02000000:00000001:19.0:1773851903.778346:0:60961:0:(sec.c:1458:sptlrpc_import_sec_adapt()) Process entered
02000000:00000001:19.0:1773851903.778347:0:60961:0:(sec.c:1498:sptlrpc_import_sec_adapt()) Process leaving via out (rc=0 : 0 : 0x0)
02000000:00000001:19.0:1773851903.778348:0:60961:0:(sec.c:1526:sptlrpc_import_sec_adapt()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.778348:0:60961:0:(import.c:1572:ptlrpc_import_recovery_state_machine()) Process entered
00000100:00000001:19.0:1773851903.778349:0:60961:0:(recover.c:177:ptlrpc_resend()) Process entered
00000100:00000001:19.0:1773851903.778349:0:60961:0:(recover.c:205:ptlrpc_resend()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:19.0:1773851903.778350:0:60961:0:(import.c:86:import_set_state_nolock()) 00000000c59af7e9 nCÞ: changing import state from RECOVER to FULL
00000100:00000001:19.0:1773851903.778350:0:60961:0:(obd_class.h:1208:obd_import_event()) Process entered
00000100:00000001:19.0:1773851903.778351:0:60961:0:(obd_class.h:1218:obd_import_event()) Process leaving
00000100:00000001:19.0:1773851903.778351:0:60961:0:(import.c:1670:ptlrpc_import_recovery_state_machine()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:19.0:1773851903.778352:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000003104de1 : new refcount 10
00000020:00000040:19.0:1773851903.778352:0:60961:0:(obd_config.c:929:class_decref()) Decref lustre5-MDT0001 (00000000e08a4481) now 2844 - find
00010000:00000040:19.0:1773851903.778353:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3aa866a refcount 2 to 8640@kfi7
00010000:00000001:19.0:1773851903.778354:0:60961:0:(ldlm_lib.c:1606:target_handle_connect()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.778355:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851903.778355:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658800 : -1035892816 : ffffffffc24187b0)
00000020:00000001:19.0:1773851903.778356:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:19.0:1773851903.778357:0:60961:0:(tgt_handler.c:562:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851903.778357:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851903.778358:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851903.778358:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.778359:0:60961:0:(tgt_handler.c:1009:tgt_connect()) Process entered
00000001:00000001:19.0:1773851903.778360:0:60961:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:19.0:1773851903.778360:0:60961:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000001:00000001:19.0:1773851903.778361:0:60961:0:(nodemap_handler.c:609:nodemap_get_from_exp()) Process entered
00000001:00000001:19.0:1773851903.778361:0:60961:0:(nodemap_handler.c:612:nodemap_get_from_exp()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.778362:0:60961:0:(tgt_handler.c:1060:tgt_connect()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851903.778362:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183172162590, transno 0, xid 1859918414957248
00010000:00000001:19.0:1773851903.778363:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851903.778364:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a572783 x1859918414957248/t0(0) o38->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852103 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1027-0'
00010000:00000001:19.0:1773851903.778366:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851903.778367:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851903.778368:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=136 v=340 (340 214 1 1)
00000100:00001000:19.0:1773851903.778369:0:60961:0:(niobuf.c:567:ptlrpc_at_set_reply()) No early reply support: flags=0x1 req_flags=0x0 magic=bd00bd3/bd00bd3 len=416
00000100:00000001:19.0:1773851903.778370:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851903.778370:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a3aa866a refcount 3 to 8640@kfi7
00000100:00000001:19.0:1773851903.778371:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446637113204256128 : -106960505295488 : ffff9eb85113ad80)
02000000:00000001:19.0:1773851903.778372:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851903.778372:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851903.778373:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851903.778373:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-8448@kfi7
00000400:00000010:19.0:1773851903.778374:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001c1fd52d.
00000100:00000200:19.0:1773851903.778375:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 416 bytes to portal 10, xid 1859918414957248, offset 0
00000400:00000200:19.0:1773851903.778376:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-8448@kfi7
00000400:00000200:19.0:1773851903.778377:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8448@kfi7 to cpt 4
00000400:00000200:19.0:1773851903.778378:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ca090f0 nid 8448@kfi7 refs 1
00000400:00000200:19.0:1773851903.778379:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ca090f0 nid 8448@kfi7 refs 2
00000400:00000200:19.0:1773851903.778380:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ca090f0 nid 8448@kfi7 refs 3
00000400:00000200:19.0:1773851903.778381:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  8448@kfi7 local destination
00000400:00000200:19.0:1773851903.778382:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770483:8770483:1024:4294967295] 8448@kfi7 LPNI seq info [2312126:2312126:16:4294967295]
00000400:00000200:19.0:1773851903.778383:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ca090f0 nid 8448@kfi7 refs 2
00000400:00000200:19.0:1773851903.778384:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8448@kfi7 to cpt 4
00000400:00000200:19.0:1773851903.778386:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 8448@kfi7(8448@kfi7:8448@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851903.778387:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ca090f0 nid 8448@kfi7 refs 3
00000800:00000200:19.0:1773851903.778388:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851903.778390:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 416 bytes in 1 frags
00000800:00000200:19.0:1773851903.778392:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851903.778394:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b Using peer 8448@kfi7(0x10000000000127b)
00000800:00000200:19.0:1773851903.778397:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000822b3938: Posted send of 516 bytes to peer 0x10000000000127b: rc=0
00000800:00000200:19.0:1773851903.778398:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851903.778400:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851903.778401:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a3aa866a refcount 2 to 8640@kfi7
00010000:00000001:19.0:1773851903.778402:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851903.778402:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851903.778403:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851903.778404:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a572783 x1859918414957248/t0(0) o38->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:0/0 lens 520/416 e 0 to 0 dl 1773852103 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1027-0'
00000100:00100000:19.0:1773851903.778407:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a572783 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f+10:39961:x1859918414957248:12345-8640@kfi7:38:default-tuolumne1027-0 Request processed in 205us (239us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851903.778409:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-8640@kfi7, seq: 2156453
00000100:00000040:19.0:1773851903.778410:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000003104de1 : new rpc_count 1
00000100:00000001:19.0:1773851903.778410:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851903.778410:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851903.778411:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851903.778412:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851903.778412:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000400:00000200:17.0:1773851903.778412:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851903.778413:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000231c32fd.
00000400:00000200:17.0:1773851903.778413:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->8448@kfi7: PUT: OK
00000020:00000040:19.0:1773851903.778414:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000003104de1 : new refcount 9
00000400:00000200:17.0:1773851903.778414:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001c1fd52d
00000100:00000001:19.0:1773851903.778415:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:17.0:1773851903.778415:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001c1fd52d.
00000100:00000001:17.0:1773851903.778415:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851903.778416:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851903.778417:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ca090f0 nid 8448@kfi7 refs 2
00000800:00000200:17.0:1773851903.778418:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2054@kfi7:4 -> 8448@kfi7(000000000abc97fc):0x0 lsk 4732 rsk 5 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000127b Transaction freed
00000800:00000200:9.0:1773851903.779884:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851903.779885:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851903.779887:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851903.779889:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851903.779890:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.779892:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21985@kfi7 : PUT - for me
00000400:00000200:9.0:1773851903.779893:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.779894:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 1
00000400:00000200:9.0:1773851903.779895:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.779896:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000400:00000200:9.0:1773851903.779897:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 3
00000400:00000200:9.0:1773851903.779897:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21792@kfi7 to cpt 4
00000400:00000200:9.0:1773851903.779898:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21792@kfi7 of length 224 into portal 12 MB=0x699e0dbf00c40
00000400:00000200:9.0:1773851903.779899:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21792@kfi7 of length 224/224 into md 0x78146ce49 [64] + 168688
00000800:00000200:9.0:1773851903.779901:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851903.779903:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851903.779903:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21985@kfi7: PUT: OK
00000100:00000001:9.0:1773851903.779904:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851903.779905:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851903.779905:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009c93dbae.
00000100:00000040:9.0:1773851903.779906:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000009c93dbae x1858040901930048 msgsize 224
00000100:00100000:9.0:1773851903.779908:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-21792@kfi7 (source: 12345-21985@kfi7)
00000100:00000001:9.0:1773851903.779909:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851903.779909:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000100:00000001:11.0:1773851903.779910:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851903.779911:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851903.779911:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851903.779911:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851903.779912:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851903.779913:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851903.779913:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040901930048
00000020:00000001:11.0:1773851903.779914:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851903.779914:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92905
00000020:00000001:11.0:1773851903.779915:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851903.779918:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e78e8aba refcount=6
00000020:00000001:11.0:1773851903.779919:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944742944768 : -107128966606848 : ffff9e9118001000)
00000020:00000001:11.0:1773851903.779920:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944742944768 : -107128966606848 : ffff9e9118001000)
00000100:00000001:11.0:1773851903.779921:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851903.779922:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851903.779923:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006dc7c85.
00000020:00000010:11.0:1773851903.779924:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851903.779925:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851903.779926:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851903.779926:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851903.779927:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851903.779929:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851903.779929:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851903.779930:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.779931:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851903.779932:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851903.779932:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851903.779932:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851903.779932:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851903.779933:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21792@kfi7, seq: 2130895
00000100:00000040:11.0:1773851903.779934:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e78e8aba : new rpc_count 1
00000100:00000001:8.0:1773851903.779934:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.779935:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498317952 : -106953211233664 : ffff9eba03d63a80)
00000100:00000001:8.0:1773851903.779935:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851903.779936:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009c93dbae x1858040901930048/t0(0) o400->eea97ee4-0975-4e57-9e34-713079f029eb@21792@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1855-0'
00000100:00000001:11.0:1773851903.779939:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851903.779939:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851903.779940:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009c93dbae pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:eea97ee4-0975-4e57-9e34-713079f029eb+6:39905:x1858040901930048:12345-21792@kfi7:400:default-tuolumne1855-0
00000100:00000200:11.0:1773851903.779942:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040901930048
00000020:00000001:11.0:1773851903.779942:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851903.779943:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851903.779944:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.779944:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851903.779945:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851903.779946:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851903.779946:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040901930048, found 0 last_xid 1858040901930047
00000020:00000001:11.0:1773851903.779947:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851903.779948:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851903.779948:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851903.779949:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.779949:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851903.779950:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851903.779950:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851903.779951:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ef653fd2.
02000000:00000001:11.0:1773851903.779952:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.779952:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.779953:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851903.779954:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044152544, transno 0, xid 1858040901930048
00010000:00000001:11.0:1773851903.779955:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851903.779956:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009c93dbae x1858040901930048/t0(0) o400->eea97ee4-0975-4e57-9e34-713079f029eb@21792@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1855-0'
00010000:00000001:11.0:1773851903.779958:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851903.779959:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851903.779959:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=136 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851903.779960:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851903.779961:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009bdbad0c refcount 3 to 21792@kfi7
00000100:00000001:11.0:1773851903.779962:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583911552 : -107156125640064 : ffff9e8ac5321a80)
02000000:00000001:11.0:1773851903.779962:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851903.779963:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.779964:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851903.779965:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21985@kfi7
00000400:00000010:11.0:1773851903.779965:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e1f8095d.
00000100:00000200:11.0:1773851903.779966:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040901930048, offset 224
00000400:00000200:11.0:1773851903.779967:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21985@kfi7
00000400:00000200:11.0:1773851903.779968:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:11.0:1773851903.779969:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 1
00000400:00000200:11.0:1773851903.779970:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000400:00000200:11.0:1773851903.779971:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 3
00000400:00000200:11.0:1773851903.779972:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21985@kfi7 local destination
00000400:00000200:11.0:1773851903.779973:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770484:8770484:1024:4294967295] 21985@kfi7 LPNI seq info [531823:531823:16:4294967295]
00000400:00000200:11.0:1773851903.779975:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000400:00000200:11.0:1773851903.779975:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21985@kfi7 to cpt 2
00000400:00000200:11.0:1773851903.779977:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21985@kfi7(21985@kfi7:21985@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851903.779979:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 3
00000800:00000200:11.0:1773851903.779980:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851903.779981:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851903.779983:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851903.779985:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9e Using peer 21985@kfi7(0x100000000000f9e)
00000800:00000200:11.0:1773851903.779988:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x100000000000f9e: rc=0
00000800:00000200:11.0:1773851903.779990:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851903.779992:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851903.779992:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009bdbad0c refcount 2 to 21792@kfi7
00010000:00000001:11.0:1773851903.779993:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851903.779994:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.779994:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851903.779995:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009c93dbae x1858040901930048/t0(0) o400->eea97ee4-0975-4e57-9e34-713079f029eb@21792@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1855-0'
00000100:00100000:11.0:1773851903.779998:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009c93dbae pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:eea97ee4-0975-4e57-9e34-713079f029eb+6:39905:x1858040901930048:12345-21792@kfi7:400:default-tuolumne1855-0 Request processed in 58us (91us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851903.780001:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21792@kfi7, seq: 2130895
00000100:00000040:11.0:1773851903.780002:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e78e8aba : new rpc_count 0
00000100:00000001:11.0:1773851903.780002:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851903.780002:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9e TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851903.780003:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851903.780003:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851903.780004:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851903.780004:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000200:9.0:1773851903.780004:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21985@kfi7: PUT: OK
00000020:00000010:11.0:1773851903.780005:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006dc7c85.
00000400:00000200:9.0:1773851903.780005:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e1f8095d
00000020:00000040:11.0:1773851903.780006:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e78e8aba : new refcount 5
00000400:00000010:9.0:1773851903.780006:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e1f8095d.
00000100:00000001:11.0:1773851903.780007:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851903.780007:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851903.780007:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851903.780008:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000027b296fb nid 21985@kfi7 refs 2
00000800:00000200:9.0:1773851903.780010:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 21985@kfi7(000000002aff1f77):0x0 lsk 3999 rsk 51 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000f9e Transaction freed
00000800:00000200:29.0:1773851903.781645:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851903.781647:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851903.781649:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851903.781653:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851903.781656:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.781659:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26466@kfi7 : PUT - for me
00000400:00000200:29.0:1773851903.781661:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.781663:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 1
00000400:00000200:29.0:1773851903.781665:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.781666:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000400:00000200:29.0:1773851903.781668:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 3
00000400:00000200:29.0:1773851903.781670:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26467@kfi7 to cpt 2
00000400:00000200:29.0:1773851903.781672:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26467@kfi7 of length 224 into portal 12 MB=0x699e15f08e980
00000400:00000200:29.0:1773851903.781674:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26467@kfi7 of length 224/224 into md 0x77fe1859d [64] + 13760
00000800:00000200:29.0:1773851903.781677:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851903.781681:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851903.781682:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26466@kfi7: PUT: OK
00000100:00000001:29.0:1773851903.781684:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851903.781685:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851903.781686:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000031b2b886.
00000100:00000040:29.0:1773851903.781688:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000031b2b886 x1858043101374848 msgsize 224
00000100:00100000:29.0:1773851903.781690:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26467@kfi7 (source: 12345-26466@kfi7)
00000100:00000001:29.0:1773851903.781692:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851903.781694:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000100:00000001:30.0:1773851903.781695:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:30.0:1773851903.781696:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851903.781696:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2054@kfi7:7 <- 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:30.0:1773851903.781697:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:30.0:1773851903.781698:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851903.781699:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851903.781700:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043101374848
00000020:00000001:30.0:1773851903.781702:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:30.0:1773851903.781702:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920bc
00000020:00000001:30.0:1773851903.781704:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:30.0:1773851903.781709:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d96466f6 refcount=6
00000020:00000001:30.0:1773851903.781710:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629514240 : -107123080037376 : ffff9e9276ddfc00)
00000020:00000001:30.0:1773851903.781712:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629514240 : -107123080037376 : ffff9e9276ddfc00)
00000100:00000001:30.0:1773851903.781713:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.781715:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:30.0:1773851903.781716:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000000f3cc0d4.
00000020:00000010:30.0:1773851903.781717:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000724cacf9.
00000020:00000010:30.0:1773851903.781719:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ec1fc6c0.
00000100:00000001:30.0:1773851903.781720:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:30.0:1773851903.781721:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:30.0:1773851903.781722:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851903.781724:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:30.0:1773851903.781729:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:30.0:1773851903.781730:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.781731:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851903.781734:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:30.0:1773851903.781734:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851903.781735:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:30.0:1773851903.781735:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:30.0:1773851903.781736:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26467@kfi7, seq: 2055615
00000100:00000040:30.0:1773851903.781737:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d96466f6 : new rpc_count 1
00000100:00000001:31.0:1773851903.781738:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851903.781739:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.781739:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637130208521472 : -106943501030144 : ffff9ebc469c2d00)
00000100:00000040:30.0:1773851903.781741:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000031b2b886 x1858043101374848/t0(0) o400->058f1734-10ab-4bd0-870f-9300526f4f24@26467@kfi7:691/0 lens 224/0 e 0 to 0 dl 1773852051 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2140-0'
00000100:00000001:30.0:1773851903.781745:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:30.0:1773851903.781746:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:30.0:1773851903.781747:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000031b2b886 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:058f1734-10ab-4bd0-870f-9300526f4f24+6:39797:x1858043101374848:12345-26467@kfi7:400:default-tuolumne2140-0
00000100:00000200:30.0:1773851903.781750:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043101374848
00000020:00000001:30.0:1773851903.781750:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:30.0:1773851903.781751:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:30.0:1773851903.781752:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.781754:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:30.0:1773851903.781754:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:30.0:1773851903.781757:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:30.0:1773851903.781757:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043101374848, found 0 last_xid 1858043101374847
00000020:00000001:30.0:1773851903.781759:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851903.781760:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:30.0:1773851903.781760:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:30.0:1773851903.781761:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.781762:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:30.0:1773851903.781763:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:30.0:1773851903.781764:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:30.0:1773851903.781765:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006ed3b313.
02000000:00000001:30.0:1773851903.781766:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.781767:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.781768:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:30.0:1773851903.781769:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182422364440, transno 0, xid 1858043101374848
00010000:00000001:30.0:1773851903.781770:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:30.0:1773851903.781771:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000031b2b886 x1858043101374848/t0(0) o400->058f1734-10ab-4bd0-870f-9300526f4f24@26467@kfi7:691/0 lens 224/224 e 0 to 0 dl 1773852051 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2140-0'
00010000:00000001:30.0:1773851903.781776:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:30.0:1773851903.781777:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:30.0:1773851903.781778:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=136 v=115 (1 1 1 115)
00000100:00000001:30.0:1773851903.781780:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:30.0:1773851903.781781:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000005fb9a55 refcount 3 to 26467@kfi7
00000100:00000001:30.0:1773851903.781782:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526777696 : -107156182773920 : ffff9e8ac1ca4f60)
02000000:00000001:30.0:1773851903.781783:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:30.0:1773851903.781784:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.781785:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851903.781787:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26466@kfi7
00000400:00000010:30.0:1773851903.781788:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004459b6e1.
00000100:00000200:30.0:1773851903.781789:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043101374848, offset 224
00000400:00000200:30.0:1773851903.781791:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26466@kfi7
00000400:00000200:30.0:1773851903.781793:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.781794:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 1
00000400:00000200:30.0:1773851903.781796:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000400:00000200:30.0:1773851903.781798:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 3
00000400:00000200:30.0:1773851903.781800:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26466@kfi7 local destination
00000400:00000200:30.0:1773851903.781803:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770485:8770485:1024:4294967295] 26466@kfi7 LPNI seq info [14483600:14483600:16:4294967295]
00000400:00000200:30.0:1773851903.781805:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000400:00000200:30.0:1773851903.781806:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26466@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.781809:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26466@kfi7(26466@kfi7:26466@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851903.781811:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 3
00000800:00000200:30.0:1773851903.781814:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851903.781815:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851903.781819:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:30.0:1773851903.781822:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f13 Using peer 26466@kfi7(0x100000000000f13)
00000800:00000200:30.0:1773851903.781827:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000030498a96: Posted send of 324 bytes to peer 0x100000000000f13: rc=0
00000800:00000200:30.0:1773851903.781829:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f13 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851903.781832:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:30.0:1773851903.781834:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000005fb9a55 refcount 2 to 26467@kfi7
00010000:00000001:30.0:1773851903.781835:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:30.0:1773851903.781836:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:30.0:1773851903.781837:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:30.0:1773851903.781838:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000031b2b886 x1858043101374848/t0(0) o400->058f1734-10ab-4bd0-870f-9300526f4f24@26467@kfi7:691/0 lens 224/224 e 0 to 0 dl 1773852051 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2140-0'
00000100:00100000:30.0:1773851903.781843:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000031b2b886 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:058f1734-10ab-4bd0-870f-9300526f4f24+6:39797:x1858043101374848:12345-26467@kfi7:400:default-tuolumne2140-0 Request processed in 97us (154us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851903.781844:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f13 TN_EVENT_TX_OK event status 0
00000100:00100000:30.0:1773851903.781847:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26467@kfi7, seq: 2055615
00000400:00000200:29.0:1773851903.781847:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:30.0:1773851903.781848:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d96466f6 : new rpc_count 0
00000400:00000200:29.0:1773851903.781848:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26466@kfi7: PUT: OK
00000100:00000001:30.0:1773851903.781849:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:30.0:1773851903.781850:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851903.781850:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004459b6e1
00000400:00000010:29.0:1773851903.781850:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004459b6e1.
00000100:00000001:29.0:1773851903.781851:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851903.781852:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:30.0:1773851903.781854:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000724cacf9.
00000400:00000200:29.0:1773851903.781854:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ebfbef31 nid 26466@kfi7 refs 2
00000020:00000010:30.0:1773851903.781855:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ec1fc6c0.
00000020:00000010:30.0:1773851903.781856:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000000f3cc0d4.
00000800:00000200:29.0:1773851903.781856:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000030498a96: 2054@kfi7:7 -> 26466@kfi7(000000002f235f4c):0x0 lsk 3860 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000f13 Transaction freed
00000020:00000040:30.0:1773851903.781857:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000d96466f6 : new refcount 5
00000100:00000001:30.0:1773851903.781858:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851903.789197:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851903.789197:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851903.789198:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851903.789198:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:30.0:1773851903.789199:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851903.789199:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:30.0:1773851903.789201:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851903.789201:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 8449@kfi7(0000000060b1901c):0x126d version: 2; local version 2; negotiated version: 2
00000400:00000200:30.0:1773851903.789203:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8449@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.789204:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 8449@kfi7 : PUT - for me
00000800:00000200:29.0:1773851903.789204:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x126d Using peer 8449@kfi7(0x126d)
00000400:00000200:30.0:1773851903.789205:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8449@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.789207:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fb92780 nid 8449@kfi7 refs 1
00000400:00000200:30.0:1773851903.789208:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8449@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.789209:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002fb92780 nid 8449@kfi7 refs 2
00000400:00000200:30.0:1773851903.789210:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002fb92780 nid 8449@kfi7 refs 3
00000400:00000200:29.0:1773851903.789210:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8449@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.789211:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 8640@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.789212:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-8640@kfi7 of length 2536 into portal 12 MB=0x69b96006a86c0
00000800:00000200:29.0:1773851903.789212:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 38 bytes to peer 0x126d: rc=0
00000400:00000200:30.0:1773851903.789213:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-8640@kfi7 of length 2536/2536 into md 0x77fe1859d [64] + 13984
00000800:00000200:29.0:1773851903.789214:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x126d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:30.0:1773851903.789215:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851903.789217:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851903.789219:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->8449@kfi7: PUT: OK
00000100:00000001:30.0:1773851903.789220:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851903.789220:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851903.789221:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002b87c4f9.
00000100:00000040:30.0:1773851903.789221:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000002b87c4f9 x1859918414644928 msgsize 2536
00000100:00100000:30.0:1773851903.789223:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-8640@kfi7 (source: 12345-8449@kfi7)
00000100:00000001:30.0:1773851903.789224:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851903.789225:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002fb92780 nid 8449@kfi7 refs 2
00000800:00000200:29.0:1773851903.789225:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x126d TN_EVENT_TX_OK event status 0
00000800:00000200:30.0:1773851903.789227:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000800:00000200:29.0:1773851903.789227:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002607bd23: 2069@kfi7:7 <- 8449@kfi7(0000000060b1901c):0x0 lsk 4718 rsk 23 tsk 0 trmk 0 tmk 0 trr 7 tta 0x126d Transaction freed
00000100:00000001:28.0:1773851903.789227:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851903.789228:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851903.789228:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851903.789229:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851903.789229:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851903.789230:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859918414644928
00000020:00000001:28.0:1773851903.789231:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851903.789231:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08b6e3109a6
00000020:00000001:28.0:1773851903.789232:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851903.789235:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000003104de1 refcount=10
00000020:00000001:28.0:1773851903.789236:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637133871429632 : -106939838121984 : ffff9ebd20efb800)
00000020:00000001:28.0:1773851903.789237:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637133871429632 : -106939838121984 : ffff9ebd20efb800)
00000100:00000001:28.0:1773851903.789238:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851903.789239:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851903.789239:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851903.789240:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851903.789241:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851903.789243:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851903.789243:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000004:00000001:28.0:1773851903.789244:0:42267:0:(mdt_mds.c:166:ldlm_enqueue_hpreq_check()) Process entered
00000004:00100000:28.0:1773851903.789247:0:42267:0:(mdt_mds.c:185:ldlm_enqueue_hpreq_check()) @@@ lock 00000000d010f236 cookie 0xc09f1112ca4bfeb9  req@000000002b87c4f9 x1859918414644928/t0(0) o101->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:388/0 lens 2536/0 e 0 to 0 dl 1773852503 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-834418369633582080'
00010000:00000001:28.0:1773851903.789250:0:42267:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:28.0:1773851903.789251:0:42267:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00000004:00000001:28.0:1773851903.789251:0:42267:0:(mdt_mds.c:194:ldlm_enqueue_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851903.789252:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00080000:28.1:1773851903.789254:0:42267:0:(service.c:1668:ptlrpc_server_check_resend_in_progress()) @@@ Found duplicate req in processing  req@000000002b87c4f9 x1859918414644928/t0(0) o101->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:388/0 lens 2536/0 e 0 to 0 dl 1773852503 ref 1 fl New:/2/ffffffff rc 0/-1 job:'tuolumne-834418369633582080'
00000100:00080000:28.1:1773851903.789258:0:42267:0:(service.c:1669:ptlrpc_server_check_resend_in_progress()) @@@ Request being processed  req@00000000998b25c3 x1859918414644928/t0(0) o101->8071f6ea-a5c5-4e6d-bf4c-8bffe318fa1f@8640@kfi7:345/0 lens 2536/3296 e 21 to 0 dl 1773851837 ref 1 fl Interpret:/0/0 rc 0/0 job:'tuolumne-834418369633582080'
00000100:00000001:28.0:1773851903.789261:0:42267:0:(service.c:1881:ptlrpc_server_request_add()) Process leaving (rc=18446744073709551600 : -16 : fffffffffffffff0)
00000100:00000001:28.0:1773851903.789262:0:42267:0:(service.c:2227:ptlrpc_server_handle_req_in()) Process leaving via err_req (rc=18446744073709551600 : -16 : 0xfffffffffffffff0)
00000100:00000001:28.0:1773851903.789263:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851903.789263:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851903.789264:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851903.789264:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851903.789265:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851903.789266:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000003104de1 : new refcount 9
00000100:00000001:28.0:1773851903.789266:0:42267:0:(service.c:2235:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851903.795711:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851903.795712:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:2.0:1773851903.795713:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:2.0:1773851903.795715:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:2.0:1773851903.795717:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.795718:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18801@kfi7 : PUT - for me
00000400:00000200:2.0:1773851903.795719:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.795720:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 1
00000400:00000200:2.0:1773851903.795721:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:2.0:1773851903.795722:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000400:00000200:2.0:1773851903.795723:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 3
00000400:00000200:2.0:1773851903.795724:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18800@kfi7 to cpt 5
00000400:00000200:2.0:1773851903.795728:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18800@kfi7 of length 224 into portal 12 MB=0x69b4ba6ddcb80
00000400:00000200:2.0:1773851903.795729:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18800@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 57936
00000800:00000200:2.0:1773851903.795732:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851903.795733:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851903.795735:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18801@kfi7: PUT: OK
00000100:00000001:2.0:1773851903.795736:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851903.795737:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851903.795737:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000899e405a.
00000100:00000040:2.0:1773851903.795738:0:2506505:0:(events.c:358:request_in_callback()) incoming req@00000000899e405a x1859599084669824 msgsize 224
00000100:00100000:2.0:1773851903.795740:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-18800@kfi7 (source: 12345-18801@kfi7)
00000100:00000001:2.0:1773851903.795741:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851903.795742:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000800:00000200:2.0:1773851903.795744:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:2.0:1773851903.795747:0:60951:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:2.0:1773851903.795747:0:60951:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:2.0:1773851903.795748:0:60951:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:2.0:1773851903.795748:0:60951:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851903.795749:0:60951:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:2.0:1773851903.795750:0:60951:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599084669824
00000020:00000001:2.0:1773851903.795750:0:60951:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:2.0:1773851903.795751:0:60951:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3893c415
00000020:00000001:2.0:1773851903.795752:0:60951:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:2.0:1773851903.795753:0:60951:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003e4a3866 refcount=5
00000020:00000001:2.0:1773851903.795754:0:60951:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637130178664448 : -106943530887168 : ffff9ebc44d49800)
00000020:00000001:2.0:1773851903.795754:0:60951:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637130178664448 : -106943530887168 : ffff9ebc44d49800)
00000100:00000001:2.0:1773851903.795756:0:60951:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:2.0:1773851903.795757:0:60951:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:2.0:1773851903.795757:0:60951:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e46b6a24.
00000020:00000010:2.0:1773851903.795758:0:60951:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d178eb61.
00000020:00000010:2.0:1773851903.795759:0:60951:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000e3a1cb31.
00000100:00000001:2.0:1773851903.795760:0:60951:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:2.0:1773851903.795760:0:60951:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:2.0:1773851903.795761:0:60951:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.795762:0:60951:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:2.0:1773851903.795763:0:60951:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:2.0:1773851903.795763:0:60951:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.795764:0:60951:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.795766:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851903.795766:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851903.795766:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.795766:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851903.795767:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18800@kfi7, seq: 1997646
00000100:00000001:2.0:1773851903.795768:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851903.795768:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003e4a3866 : new rpc_count 1
00000100:00000001:2.0:1773851903.795769:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.795769:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159877932288 : -106913831619328 : ffff9ec32f0b7500)
00000100:00000040:0.0:1773851903.795770:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000899e405a x1859599084669824/t0(0) o400->8237baa5-dfce-4505-ba05-5fb328dae416@18800@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1662-0'
00000100:00000001:0.0:1773851903.795774:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851903.795774:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851903.795775:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000899e405a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:8237baa5-dfce-4505-ba05-5fb328dae416+5:39520:x1859599084669824:12345-18800@kfi7:400:default-tuolumne1662-0
00000100:00000200:0.0:1773851903.795777:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599084669824
00000020:00000001:0.0:1773851903.795778:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851903.795778:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851903.795779:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.795780:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851903.795780:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851903.795781:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851903.795782:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599084669824, found 0 last_xid 1859599084669823
00000020:00000001:0.0:1773851903.795783:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851903.795784:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851903.795785:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851903.795785:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.795786:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851903.795787:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851903.795787:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851903.795788:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000637bc2c7.
02000000:00000001:0.0:1773851903.795789:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.795790:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.795791:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851903.795791:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260594509, transno 0, xid 1859599084669824
00010000:00000001:0.0:1773851903.795792:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851903.795794:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000899e405a x1859599084669824/t0(0) o400->8237baa5-dfce-4505-ba05-5fb328dae416@18800@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1662-0'
00010000:00000001:0.0:1773851903.795796:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851903.795797:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851903.795798:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=136 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851903.795799:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851903.795800:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009a6c3a6f refcount 3 to 18800@kfi7
00000100:00000001:0.0:1773851903.795800:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051069312 : -107146658482304 : ffff9e8cf97b7780)
02000000:00000001:0.0:1773851903.795802:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851903.795802:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.795803:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851903.795804:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18801@kfi7
00000400:00000010:0.0:1773851903.795805:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000024fe8e76.
00000100:00000200:0.0:1773851903.795806:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599084669824, offset 224
00000400:00000200:0.0:1773851903.795807:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18801@kfi7
00000400:00000200:0.0:1773851903.795809:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:0.0:1773851903.795810:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 1
00000400:00000200:0.0:1773851903.795811:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000400:00000200:0.0:1773851903.795812:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 3
00000400:00000200:0.0:1773851903.795814:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18801@kfi7 local destination
00000400:00000200:0.0:1773851903.795815:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770486:8770486:1024:4294967295] 18801@kfi7 LPNI seq info [1543244:1543244:16:4294967295]
00000400:00000200:0.0:1773851903.795817:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000400:00000200:0.0:1773851903.795817:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18801@kfi7 to cpt 0
00000400:00000200:0.0:1773851903.795820:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18801@kfi7(18801@kfi7:18801@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851903.795821:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 3
00000800:00000200:0.0:1773851903.795823:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851903.795824:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851903.795826:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851903.795829:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1222 Using peer 18801@kfi7(0x1222)
00000800:00000200:0.0:1773851903.795832:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x1222: rc=0
00000800:00000200:0.0:1773851903.795834:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1222 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851903.795836:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851903.795837:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009a6c3a6f refcount 2 to 18800@kfi7
00010000:00000001:0.0:1773851903.795838:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851903.795838:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.795840:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851903.795841:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000899e405a x1859599084669824/t0(0) o400->8237baa5-dfce-4505-ba05-5fb328dae416@18800@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1662-0'
00000100:00100000:0.0:1773851903.795846:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000899e405a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:8237baa5-dfce-4505-ba05-5fb328dae416+5:39520:x1859599084669824:12345-18800@kfi7:400:default-tuolumne1662-0 Request processed in 71us (106us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851903.795849:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18800@kfi7, seq: 1997646
00000100:00000040:0.0:1773851903.795849:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003e4a3866 : new rpc_count 0
00000100:00000001:0.0:1773851903.795850:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851903.795851:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851903.795852:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d178eb61.
00000020:00000010:0.0:1773851903.795853:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000e3a1cb31.
00000020:00000010:0.0:1773851903.795854:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e46b6a24.
00000020:00000040:0.0:1773851903.795855:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000003e4a3866 : new refcount 4
00000100:00000001:0.0:1773851903.795855:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851903.795861:0:2506505:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1222 TN_EVENT_TX_OK event status 0
00000400:00000200:2.0:1773851903.795863:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851903.795864:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18801@kfi7: PUT: OK
00000400:00000200:2.0:1773851903.795865:0:2506505:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000024fe8e76
00000400:00000010:2.0:1773851903.795866:0:2506505:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000024fe8e76.
00000100:00000001:2.0:1773851903.795866:0:2506505:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:2.0:1773851903.795867:0:2506505:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:2.0:1773851903.795868:0:2506505:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000008662334 nid 18801@kfi7 refs 2
00000800:00000200:2.0:1773851903.795870:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2069@kfi7:0 -> 18801@kfi7(000000003a81e967):0x0 lsk 4643 rsk 37 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1222 Transaction freed
00000800:00000200:13.0:1773851903.800137:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851903.800138:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851903.800139:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851903.800141:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851903.800143:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.800144:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14066@kfi7 : PUT - for me
00000400:00000200:13.0:1773851903.800145:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.800146:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 1
00000400:00000200:13.0:1773851903.800147:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:13.0:1773851903.800148:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000400:00000200:13.0:1773851903.800149:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 3
00000400:00000200:13.0:1773851903.800150:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13874@kfi7 to cpt 1
00000400:00000200:13.0:1773851903.800151:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13874@kfi7 of length 224 into portal 12 MB=0x69b4ba7752c80
00000400:00000200:13.0:1773851903.800152:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13874@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 63712
00000800:00000200:13.0:1773851903.800154:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851903.800157:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851903.800158:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14066@kfi7: PUT: OK
00000100:00000001:13.0:1773851903.800159:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851903.800159:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851903.800160:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004f379937.
00000100:00000040:13.0:1773851903.800161:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000004f379937 x1859599094590592 msgsize 224
00000100:00100000:13.0:1773851903.800162:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13874@kfi7 (source: 12345-14066@kfi7)
00000100:00000001:13.0:1773851903.800163:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851903.800164:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000100:00000001:12.0:1773851903.800164:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851903.800165:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851903.800165:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851903.800166:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851903.800166:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851903.800167:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851903.800168:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859599094590592
00000020:00000001:12.0:1773851903.800168:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851903.800169:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38944ea2
00000020:00000001:12.0:1773851903.800169:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851903.800173:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f920d659 refcount=760
00000020:00000001:12.0:1773851903.800174:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637114263451648 : -106959446099968 : ffff9eb89035b800)
00000020:00000001:12.0:1773851903.800174:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637114263451648 : -106959446099968 : ffff9eb89035b800)
00000100:00000001:12.0:1773851903.800175:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.800176:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851903.800177:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c0ce2707.
00000020:00000010:12.0:1773851903.800178:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.800178:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851903.800179:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851903.800180:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851903.800180:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851903.800181:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851903.800182:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851903.800182:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.800183:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851903.800185:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851903.800185:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851903.800185:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851903.800185:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851903.800186:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13874@kfi7, seq: 2289954
00000100:00000001:14.0:1773851903.800188:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851903.800188:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.800188:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f920d659 : new rpc_count 15
00000100:00000001:12.0:1773851903.800188:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092552576 : -106946616999040 : ffff9ebb8ce24380)
00000100:00000040:12.0:1773851903.800189:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004f379937 x1859599094590592/t0(0) o400->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1353-0'
00000100:00000001:12.0:1773851903.800192:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.800193:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851903.800194:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004f379937 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7fc5910d-f170-4eda-bc46-60ec6a7ee835+760:39446:x1859599094590592:12345-13874@kfi7:400:default-tuolumne1353-0
00000100:00000200:12.0:1773851903.800195:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859599094590592
00000020:00000001:12.0:1773851903.800196:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851903.800197:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851903.800197:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.800198:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851903.800198:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851903.800199:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851903.800200:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859599094590592, found 0 last_xid 1859599087266815
00000020:00000001:12.0:1773851903.800201:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851903.800201:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851903.800202:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851903.800202:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.800203:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851903.800204:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851903.800204:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851903.800205:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000732ec20a.
02000000:00000001:12.0:1773851903.800206:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.800206:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.800207:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851903.800207:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264585739, transno 0, xid 1859599094590592
00010000:00000001:12.0:1773851903.800208:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851903.800209:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004f379937 x1859599094590592/t0(0) o400->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1353-0'
00010000:00000001:12.0:1773851903.800211:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851903.800212:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851903.800213:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=136 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851903.800214:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851903.800215:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000312e3384 refcount 3 to 13874@kfi7
00000100:00000001:12.0:1773851903.800216:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232982784 : -107130476568832 : ffff9e90bdffdf00)
02000000:00000001:12.0:1773851903.800217:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851903.800217:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.800218:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851903.800219:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14066@kfi7
00000400:00000010:12.0:1773851903.800219:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009bd347e2.
00000100:00000200:12.0:1773851903.800220:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859599094590592, offset 224
00000400:00000200:12.0:1773851903.800222:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14066@kfi7
00000400:00000200:12.0:1773851903.800222:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.800223:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 1
00000400:00000200:12.0:1773851903.800224:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000400:00000200:12.0:1773851903.800225:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 3
00000400:00000200:12.0:1773851903.800226:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14066@kfi7 local destination
00000400:00000200:12.0:1773851903.800228:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770487:8770487:1024:4294967295] 14066@kfi7 LPNI seq info [729483:729483:16:4294967295]
00000400:00000200:12.0:1773851903.800229:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000400:00000200:12.0:1773851903.800230:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14066@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.800232:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14066@kfi7(14066@kfi7:14066@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851903.800233:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 3
00000800:00000200:12.0:1773851903.800234:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851903.800235:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851903.800237:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851903.800239:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c70 Using peer 14066@kfi7(0x100000000000c70)
00000800:00000200:12.0:1773851903.800242:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000686b4bf8: Posted send of 324 bytes to peer 0x100000000000c70: rc=0
00000800:00000200:12.0:1773851903.800244:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c70 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851903.800248:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.800249:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000312e3384 refcount 2 to 13874@kfi7
00010000:00000001:12.0:1773851903.800252:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851903.800252:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.800253:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851903.800253:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004f379937 x1859599094590592/t0(0) o400->7fc5910d-f170-4eda-bc46-60ec6a7ee835@13874@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1353-0'
00000100:00100000:12.0:1773851903.800257:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004f379937 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:7fc5910d-f170-4eda-bc46-60ec6a7ee835+760:39446:x1859599094590592:12345-13874@kfi7:400:default-tuolumne1353-0 Request processed in 63us (95us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851903.800260:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13874@kfi7, seq: 2289954
00000100:00000040:12.0:1773851903.800260:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f920d659 : new rpc_count 14
00000100:00000001:12.0:1773851903.800261:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851903.800261:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851903.800262:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.800263:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851903.800264:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c0ce2707.
00000020:00000040:12.0:1773851903.800264:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000f920d659 : new refcount 759
00000100:00000001:12.0:1773851903.800265:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851903.800270:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c70 TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851903.800272:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851903.800273:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14066@kfi7: PUT: OK
00000400:00000200:14.0:1773851903.800274:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009bd347e2
00000400:00000010:14.0:1773851903.800275:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009bd347e2.
00000100:00000001:14.0:1773851903.800276:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851903.800276:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851903.800277:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000352c21be nid 14066@kfi7 refs 2
00000800:00000200:14.0:1773851903.800279:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000686b4bf8: 2054@kfi7:3 -> 14066@kfi7(00000000c9b8e572):0x0 lsk 3185 rsk 10 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000c70 Transaction freed
00000004:00000001:31.0:1773851903.817729:0:42317:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:30.0:1773851903.817729:0:42298:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:31.0:1773851903.817730:0:42317:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:30.0:1773851903.817730:0:42298:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:31.0:1773851903.817731:0:42317:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d6a92c0.
00000020:00000040:31.0:1773851903.817731:0:42317:0:(genops.c:1094:class_import_get()) import 00000000c07400e7 refcount=5 obd=lustre5-OST0005-osc-MDT0001
00000100:00000010:30.0:1773851903.817731:0:42298:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000085ab5bae.
00000020:00000040:30.0:1773851903.817731:0:42298:0:(genops.c:1094:class_import_get()) import 0000000085573a11 refcount=3 obd=lustre5-MDT0002-osp-MDT0001
00000004:00000001:7.0:1773851903.817731:0:42300:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:31.0:1773851903.817732:0:42317:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:30.0:1773851903.817732:0:42298:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000001:10.0:1773851903.817732:0:42311:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851903.817732:0:42307:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851903.817732:0:42307:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:5.0:1773851903.817732:0:42367:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851903.817732:0:42367:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
02000000:00000001:31.0:1773851903.817733:0:42317:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851903.817733:0:42298:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:10.0:1773851903.817733:0:42311:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:10.0:1773851903.817733:0:42311:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000037d69b00.
00000100:00000010:6.0:1773851903.817733:0:42307:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000095bd404b.
00000100:00000010:5.0:1773851903.817733:0:42367:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000165a41dd.
02000000:00000001:31.0:1773851903.817734:0:42317:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851903.817734:0:42298:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:10.0:1773851903.817734:0:42311:0:(genops.c:1094:class_import_get()) import 000000005bb3c871 refcount=5 obd=lustre5-OST0002-osc-MDT0001
00000004:00000001:9.0:1773851903.817734:0:42309:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:7.0:1773851903.817734:0:42300:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:6.0:1773851903.817734:0:42307:0:(genops.c:1094:class_import_get()) import 00000000e75a8f63 refcount=5 obd=lustre5-OST0000-osc-MDT0001
00000020:00000040:5.0:1773851903.817734:0:42367:0:(genops.c:1094:class_import_get()) import 000000002c6f8ce2 refcount=5 obd=lustre5-OST000e-osc-MDT0001
02000000:00000010:31.0:1773851903.817735:0:42317:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000101b0638.
02000000:00000010:30.0:1773851903.817735:0:42298:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000040d06717.
00000100:00000001:10.0:1773851903.817735:0:42311:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:9.0:1773851903.817735:0:42309:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:7.0:1773851903.817735:0:42300:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a2bedac.
00000100:00000001:6.0:1773851903.817735:0:42307:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851903.817735:0:42367:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:31.0:1773851903.817736:0:42317:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.817736:0:42298:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851903.817736:0:42311:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:9.0:1773851903.817736:0:42309:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001e258fdd.
00000020:00000040:7.0:1773851903.817736:0:42300:0:(genops.c:1094:class_import_get()) import 00000000519ae0d4 refcount=3 obd=lustre5-MDT0003-osp-MDT0001
02000000:00000001:6.0:1773851903.817736:0:42307:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851903.817736:0:42367:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:31.0:1773851903.817737:0:42317:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:31.0:1773851903.817737:0:42317:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.817737:0:42298:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851903.817737:0:42298:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851903.817737:0:42311:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:9.0:1773851903.817737:0:42309:0:(genops.c:1094:class_import_get()) import 0000000067ea1a7d refcount=18 obd=lustre5-OST0001-osc-MDT0001
00000100:00000001:7.0:1773851903.817737:0:42300:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:7.0:1773851903.817737:0:42300:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851903.817737:0:42300:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851903.817737:0:42307:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851903.817737:0:42367:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851903.817738:0:42311:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000009c52eb5f.
02000000:00000010:6.0:1773851903.817738:0:42307:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000035adc4a4.
02000000:00000010:5.0:1773851903.817738:0:42367:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000097fed2c.
00000100:00000040:31.0:1773851903.817739:0:42317:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000009d6a92c0] to pc [ptlrpcd_07_02+2]  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851903.817739:0:42298:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000085ab5bae] to pc [ptlrpcd_07_01+1]  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817739:0:42311:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.817739:0:42309:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000010:7.0:1773851903.817739:0:42300:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000085d7323e.
00000100:00000001:7.0:1773851903.817739:0:42300:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817739:0:42307:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851903.817739:0:42367:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.817740:0:42311:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:9.0:1773851903.817740:0:42309:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:7.0:1773851903.817740:0:42300:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851903.817740:0:42307:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851903.817740:0:42367:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851903.817741:0:42311:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851903.817741:0:42309:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817741:0:42300:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817741:0:42307:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851903.817741:0:42367:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851903.817742:0:42300:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007a2bedac] to pc [ptlrpcd_01_00+0]  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851903.817742:0:42307:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000095bd404b] to pc [ptlrpcd_01_02+2]  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851903.817742:0:42367:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000165a41dd] to pc [ptlrpcd_01_01+1]  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:30.0:1773851903.817743:0:42298:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:10.0:1773851903.817743:0:42311:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000037d69b00] to pc [ptlrpcd_02_01+1]  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000010:9.0:1773851903.817743:0:42309:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000569baa6b.
00000100:00000001:29.0:1773851903.817744:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851903.817744:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851903.817745:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:28.0:1773851903.817745:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851903.817745:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.817745:0:42309:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:29.0:1773851903.817746:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851903.817746:0:42309:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:31.0:1773851903.817747:0:42317:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:30.0:1773851903.817747:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851903.817747:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:10.0:1773851903.817747:0:42311:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:7.0:1773851903.817747:0:42300:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:6.0:1773851903.817747:0:42307:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851903.817747:0:42367:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:31.0:1773851903.817748:0:42317:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f0400889.
00000100:00000001:30.0:1773851903.817748:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851903.817748:0:41090:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:29.0:1773851903.817748:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:11.0:1773851903.817748:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:11.0:1773851903.817748:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:10.0:1773851903.817748:0:42311:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000249e46d2.
00000100:00000001:9.0:1773851903.817748:0:42309:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:31.0:1773851903.817749:0:42317:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637134586569728 : -106939122981888 : ffff9ebd4b8fe400)
00000100:00000040:30.0:1773851903.817749:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851903.817749:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851903.817749:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000040:11.0:1773851903.817749:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851903.817749:0:42311:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637156243267584 : -106917466284032 : ffff9ec25666e000)
00000100:00000040:9.0:1773851903.817749:0:42309:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001e258fdd] to pc [ptlrpcd_02_02+2]  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851903.817749:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:5.0:1773851903.817749:0:42367:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000080965be6.
00000100:00000001:4.0:1773851903.817749:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:31.0:1773851903.817750:0:42317:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:29.0:1773851903.817750:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:10.0:1773851903.817750:0:42311:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:8.0:1773851903.817750:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817750:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851903.817750:0:42367:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637035639619584 : -107038069932032 : ffff9ea641dd4000)
00000100:00000001:4.0:1773851903.817750:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851903.817751:0:41090:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00100000:29.0:1773851903.817751:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000085ab5bae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051943104:13@kfi7:41:default-yuba2-0
00080000:00000001:10.0:1773851903.817751:0:42311:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817751:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851903.817751:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851903.817751:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:5.0:1773851903.817751:0:42367:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851903.817751:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:31.0:1773851903.817752:0:42317:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:31.0:1773851903.817752:0:42317:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0005-osc-MDT0001: sync forced, 4 changes
00000100:00000001:30.0:1773851903.817752:0:41090:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851903.817752:0:41090:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:11.0:1773851903.817752:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:10.0:1773851903.817752:0:42311:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0002-osc-MDT0001: sync forced, 3 changes
00000100:00100000:6.0:1773851903.817752:0:41067:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00080000:00000001:5.0:1773851903.817752:0:42367:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:31.0:1773851903.817753:0:42317:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000082142742.
02000000:00000001:30.0:1773851903.817753:0:41090:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851903.817753:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:29.0:1773851903.817753:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:11.0:1773851903.817753:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:10.0:1773851903.817753:0:42311:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000034d0d533.
00000100:00000040:7.0:1773851903.817753:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851903.817753:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00001000:5.0:1773851903.817753:0:42367:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000e-osc-MDT0001: sync forced, 5 changes
00000100:00000040:4.0:1773851903.817753:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00080000:31.0:1773851903.817754:0:42317:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0005-osc-MDT0001: add commit cb at 614178271030089ns, next at 614179271028827ns, rc = 0
00000100:00100000:30.0:1773851903.817754:0:41090:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000009d6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051943040:60@kfi7:13:default-yuba2-0
02000000:00000001:29.0:1773851903.817754:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851903.817754:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:11.0:1773851903.817754:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:10.0:1773851903.817754:0:42311:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0002-osc-MDT0001: add commit cb at 614178271029679ns, next at 614179271028466ns, rc = 0
00000100:00000001:6.0:1773851903.817754:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851903.817754:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000004:00000010:5.0:1773851903.817754:0:42367:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000ac98bec4.
00000100:00000001:30.0:1773851903.817755:0:41090:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851903.817755:0:41090:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000010:29.0:1773851903.817755:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000007573667.
02000000:00000001:11.0:1773851903.817755:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817755:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:6.0:1773851903.817755:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851903.817755:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00080000:5.0:1773851903.817755:0:42367:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000e-osc-MDT0001: add commit cb at 614178271030841ns, next at 614179271029258ns, rc = 0
00080000:00000001:31.0:1773851903.817756:0:42317:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:30.0:1773851903.817756:0:41090:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851903.817756:0:41090:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:29.0:1773851903.817756:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851903.817756:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051943360:37@kfi7:13:default-yuba2-0
00080000:00000001:10.0:1773851903.817756:0:42311:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:7.0:1773851903.817756:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851903.817756:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:6.0:1773851903.817756:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:31.0:1773851903.817757:0:42317:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851903.817757:0:41090:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000811c6a94.
02000000:00000001:30.0:1773851903.817757:0:41090:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851903.817757:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:11.0:1773851903.817757:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:10.0:1773851903.817757:0:42311:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851903.817757:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851903.817757:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851903.817757:0:42367:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:4.0:1773851903.817757:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:31.0:1773851903.817758:0:42317:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851903.817758:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000010:29.0:1773851903.817758:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e108dc56.
00000400:00000010:29.0:1773851903.817758:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003b8cfb79.
02000000:00000001:11.0:1773851903.817758:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:11.0:1773851903.817758:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851903.817758:0:42311:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851903.817758:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000165a41dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051943296:2061@kfi7:13:default-yuba2-0
00080000:00000001:5.0:1773851903.817758:0:42367:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.817758:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851903.817759:0:41090:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b6291be0.
02000000:00000001:11.0:1773851903.817759:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:7.0:1773851903.817759:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:6.0:1773851903.817759:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00000001:5.0:1773851903.817759:0:42367:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851903.817760:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:30.0:1773851903.817760:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f690b6e3.
00000100:00000200:29.0:1773851903.817760:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943104, portal 4
00000100:00000001:29.0:1773851903.817760:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851903.817760:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:10.0:1773851903.817760:0:41071:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00080000:00000001:9.0:1773851903.817760:0:42309:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000001:7.0:1773851903.817760:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851903.817760:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817760:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851903.817760:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:4.0:1773851903.817760:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:31.0:1773851903.817761:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851903.817761:0:41090:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943040, portal 4
00000100:00000001:30.0:1773851903.817761:0:41090:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:29.0:1773851903.817761:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411259520 : -106960298292096 : ffff9eb85d6a4c80)
02000000:00000010:11.0:1773851903.817761:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000bb57814a.
02000000:00000001:11.0:1773851903.817761:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.817761:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000010:9.0:1773851903.817761:0:42309:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000004470a3fd.
02000000:00000001:7.0:1773851903.817761:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:6.0:1773851903.817761:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851903.817761:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.817762:0:41090:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637034999063552 : -107038710488064 : ffff9ea61baf2400)
00000100:00000040:29.0:1773851903.817762:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:11.0:1773851903.817762:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000100:00000001:10.0:1773851903.817762:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00100000:6.0:1773851903.817762:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000095bd404b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051943168:36@kfi7:13:default-yuba2-0
00000100:00000040:30.0:1773851903.817763:0:41090:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:11.0:1773851903.817763:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045aadb6d.
00000100:00000001:10.0:1773851903.817763:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851903.817763:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:9.0:1773851903.817763:0:42309:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637128857759744 : -106944851791872 : ffff9ebbf6193000)
02000000:00000010:7.0:1773851903.817763:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b2b64901.
02000000:00000001:7.0:1773851903.817763:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817763:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00100000:4.0:1773851903.817763:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a2bedac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051943232:2074@kfi7:41:default-yuba2-0
00000400:00000010:11.0:1773851903.817764:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000841fb28d.
00000100:00000001:10.0:1773851903.817764:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851903.817764:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:9.0:1773851903.817764:0:42309:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000400:00000200:7.0:1773851903.817764:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
02000000:00000001:6.0:1773851903.817764:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:6.0:1773851903.817764:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851903.817765:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:11.0:1773851903.817765:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943360, portal 4
00000100:00000040:10.0:1773851903.817765:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:7.0:1773851903.817765:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000e59aed44.
02000000:00000001:6.0:1773851903.817765:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:5.0:1773851903.817765:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851903.817765:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851903.817766:0:41090:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:30.0:1773851903.817766:0:41090:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-60@kfi7
00000100:00000040:29.0:1773851903.817766:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13@kfi7
00000400:00000010:29.0:1773851903.817766:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000089b548b8.
00000100:00000001:11.0:1773851903.817766:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000010:7.0:1773851903.817766:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000232fbe3.
02000000:00000010:6.0:1773851903.817766:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008d25977b.
00000100:00000001:5.0:1773851903.817766:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851903.817766:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:4.0:1773851903.817766:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851903.817767:0:41090:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000048340f51.
00000100:00000001:11.0:1773851903.817767:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087763328 : -106944621788288 : ffff9ebc03cec380)
00080000:00000001:9.0:1773851903.817767:0:42309:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851903.817767:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943296, portal 4
02000000:00000001:6.0:1773851903.817767:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851903.817767:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:30.0:1773851903.817768:0:41090:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943040, offset 0
00000100:00000200:29.0:1773851903.817768:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051943104, offset 0
00000100:00000040:11.0:1773851903.817768:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817768:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851903.817768:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:9.0:1773851903.817768:0:42309:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0001-osc-MDT0001: sync forced, 3 changes
00000100:00000001:7.0:1773851903.817768:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:6.0:1773851903.817768:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
02000000:00000010:4.0:1773851903.817768:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000002e351634.
00000400:00000200:29.0:1773851903.817769:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13@kfi7
02000000:00000001:10.0:1773851903.817769:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:9.0:1773851903.817769:0:42309:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000000e8818ec.
00000100:00000001:7.0:1773851903.817769:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113837119360 : -106959872432256 : ffff9eb876cc6780)
00000400:00000010:6.0:1773851903.817769:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
02000000:00000001:4.0:1773851903.817769:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851903.817770:0:41090:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-60@kfi7
00000400:00000200:29.0:1773851903.817770:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
02000000:00000001:10.0:1773851903.817770:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851903.817770:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:6.0:1773851903.817770:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000114436b6.
00000400:00000200:29.0:1773851903.817771:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 1
00000100:00000001:11.0:1773851903.817771:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851903.817771:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-37@kfi7
00000100:00100000:10.0:1773851903.817771:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001e258fdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051943424:2060@kfi7:13:default-yuba2-0
00000004:00080000:9.0:1773851903.817771:0:42309:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0001-osc-MDT0001: add commit cb at 614178271046540ns, next at 614179271044196ns, rc = 0
00000100:00000200:6.0:1773851903.817771:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943168, portal 4
00000100:00000001:6.0:1773851903.817771:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:4.0:1773851903.817771:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.817772:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000400:00000010:11.0:1773851903.817772:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000557250e8.
00000100:00000001:10.0:1773851903.817772:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851903.817772:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:6.0:1773851903.817772:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359407232 : -107048350144384 : ffff9ea3dd1da880)
00000400:00000010:4.0:1773851903.817772:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000009b452653.
00000100:00000200:11.0:1773851903.817773:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943360, offset 0
02000000:00000001:10.0:1773851903.817773:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:9.0:1773851903.817773:0:42309:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:7.0:1773851903.817773:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:6.0:1773851903.817773:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851903.817774:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 3
00000400:00000200:11.0:1773851903.817774:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-37@kfi7
02000000:00000001:10.0:1773851903.817774:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00080000:00000001:9.0:1773851903.817774:0:42309:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851903.817774:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2061@kfi7
00000400:00000010:7.0:1773851903.817774:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000012526ad9.
00000400:00000010:4.0:1773851903.817774:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6473a15.
00000400:00000200:29.0:1773851903.817775:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  13@kfi7 local destination
00000400:00000200:11.0:1773851903.817775:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
02000000:00000010:10.0:1773851903.817775:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001aa877ac.
02000000:00000001:10.0:1773851903.817775:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851903.817775:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943296, offset 0
00000100:00000001:6.0:1773851903.817775:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000200:4.0:1773851903.817775:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943232, portal 4
00000400:00000200:11.0:1773851903.817776:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000004:00000001:9.0:1773851903.817776:0:42309:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.817776:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:6.0:1773851903.817777:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-36@kfi7
00000100:00000001:4.0:1773851903.817777:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309125888 : -106994400425728 : ffff9eb06cc50900)
00000400:00000200:29.0:1773851903.817778:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770486, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770487, p:4294967295, g:4294967295, h:1000]
00000400:00000200:11.0:1773851903.817778:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:7.0:1773851903.817778:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2061@kfi7
00000400:00000010:6.0:1773851903.817778:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000011f34731.
00000100:00000200:6.0:1773851903.817778:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943168, offset 0
00000100:00000001:9.0:1773851903.817779:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:7.0:1773851903.817779:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:4.0:1773851903.817779:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851903.817780:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:11.0:1773851903.817780:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000001:9.0:1773851903.817780:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851903.817780:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000400:00000200:6.0:1773851903.817780:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-36@kfi7
00000400:00000200:29.0:1773851903.817781:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851903.817781:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  37@kfi7 local destination
00000400:00000200:7.0:1773851903.817781:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:29.0:1773851903.817782:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:11.0:1773851903.817782:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770486, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770487, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851903.817782:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:29.0:1773851903.817783:0:41089:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[30@kfi7, 13@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23133333, 23133334]
00000400:00000200:7.0:1773851903.817783:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2061@kfi7 local destination
00000100:00000001:4.0:1773851903.817784:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:29.0:1773851903.817785:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 30@kfi7
00000400:00000200:11.0:1773851903.817785:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851903.817785:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770486, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770487, p:4294967295, g:4294967295, h:1000]
00000100:00000040:4.0:1773851903.817785:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2074@kfi7
00000400:00000200:29.0:1773851903.817786:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770488:8770488:1024:4294967295] 30@kfi7 LPNI seq info [23133335:23133335:16:4294967295]
00000400:00000200:11.0:1773851903.817786:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000010:4.0:1773851903.817786:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a851431c.
00000400:00000200:11.0:1773851903.817787:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 37@kfi7
00000400:00000200:7.0:1773851903.817787:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000200:4.0:1773851903.817787:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051943232, offset 0
00000400:00000200:29.0:1773851903.817788:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000400:00000200:11.0:1773851903.817788:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770489:8770489:1024:4294967295] 37@kfi7 LPNI seq info [5403401:5403401:16:4294967295]
00000400:00000200:7.0:1773851903.817788:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:29.0:1773851903.817789:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:7.0:1773851903.817789:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2061@kfi7
00000400:00000200:4.0:1773851903.817789:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2074@kfi7
00000400:00000200:30.0:1773851903.817790:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:30.0:1773851903.817791:0:41090:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000400:00000200:11.0:1773851903.817791:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:7.0:1773851903.817791:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770490:8770490:1024:4294967295] 2061@kfi7 LPNI seq info [5403467:5403467:16:4294967295]
00000400:00000200:30.0:1773851903.817792:0:41090:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851903.817792:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:7.0:1773851903.817792:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:10.0:1773851903.817793:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:30.0:1773851903.817794:0:41090:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000010:10.0:1773851903.817794:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000400:00000200:7.0:1773851903.817794:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:30.0:1773851903.817795:0:41090:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  60@kfi7 local destination
00000400:00000010:10.0:1773851903.817795:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000400:00000200:6.0:1773851903.817795:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000200:10.0:1773851903.817796:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943424, portal 4
00000400:00000200:6.0:1773851903.817796:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000200:30.0:1773851903.817797:0:41090:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770489, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770490, p:4294967295, g:4294967295, h:1000]
00000100:00000001:10.0:1773851903.817797:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851903.817797:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637120498329472 : -106953211222144 : ffff9eba03d66780)
00000400:00000200:6.0:1773851903.817797:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:30.0:1773851903.817799:0:41090:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851903.817799:0:41090:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000040:10.0:1773851903.817799:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851903.817799:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000400:00000200:30.0:1773851903.817800:0:41090:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 60@kfi7
00000400:00000200:6.0:1773851903.817800:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  36@kfi7 local destination
00000100:00000001:10.0:1773851903.817801:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:30.0:1773851903.817802:0:41090:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770491:8770491:1024:4294967295] 60@kfi7 LPNI seq info [5404316:5404316:16:4294967295]
00000100:00000040:10.0:1773851903.817802:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2060@kfi7
00000400:00000010:10.0:1773851903.817802:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e53ad71d.
00000400:00000200:6.0:1773851903.817802:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770491, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770490, p:4294967295, g:4294967295, h:1000]
00000400:00000200:30.0:1773851903.817803:0:41090:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000100:00000200:10.0:1773851903.817804:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943424, offset 0
00000400:00000200:6.0:1773851903.817804:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:30.0:1773851903.817805:0:41090:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:10.0:1773851903.817805:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2060@kfi7
00000400:00000200:6.0:1773851903.817805:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:10.0:1773851903.817806:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:6.0:1773851903.817806:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 36@kfi7
00000400:00000200:10.0:1773851903.817807:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000400:00000200:6.0:1773851903.817807:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770492:8770492:1024:4294967295] 36@kfi7 LPNI seq info [5403974:5403974:16:4294967295]
00000400:00000200:30.0:1773851903.817808:0:41090:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 60@kfi7(60@kfi7:60@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851903.817808:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 37@kfi7(37@kfi7:37@kfi7) <?> : PUT try# 0
00000400:00000200:10.0:1773851903.817808:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:11.0:1773851903.817809:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000400:00000200:6.0:1773851903.817809:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000400:00000200:30.0:1773851903.817810:0:41090:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:10.0:1773851903.817810:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000400:00000200:6.0:1773851903.817810:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000800:00000200:11.0:1773851903.817811:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:10.0:1773851903.817811:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2060@kfi7 local destination
00000800:00000200:30.0:1773851903.817812:0:41090:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:11.0:1773851903.817812:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:30.0:1773851903.817813:0:41090:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:10.0:1773851903.817813:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8770491, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1022, d:10, s:8770492, p:4294967295, g:4294967295, h:1000]
00000400:00000200:6.0:1773851903.817813:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 36@kfi7(36@kfi7:36@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851903.817814:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 30@kfi7(13@kfi7:30@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851903.817814:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2061@kfi7(2061@kfi7:2061@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851903.817815:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000400:00000200:6.0:1773851903.817815:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000800:00000200:30.0:1773851903.817816:0:41090:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:29.0:1773851903.817816:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000042ae0c2e nid 13@kfi7 refs 2
00000800:00000200:11.0:1773851903.817816:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851903.817816:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:29.0:1773851903.817817:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:10.0:1773851903.817817:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:7.0:1773851903.817817:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851903.817817:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851903.817817:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000400:00000200:10.0:1773851903.817818:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2060@kfi7
00000800:00000200:7.0:1773851903.817818:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:6.0:1773851903.817818:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851903.817818:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 1
00000800:00000200:30.0:1773851903.817819:0:41090:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Using peer 60@kfi7(0x1e2)
00000800:00000200:29.0:1773851903.817819:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851903.817819:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Using peer 37@kfi7(0x1a3)
00000400:00000200:10.0:1773851903.817819:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770493:8770493:1022:4294967295] 2060@kfi7 LPNI seq info [5405001:5405001:16:4294967295]
00000400:00000200:10.0:1773851903.817820:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:4.0:1773851903.817820:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:29.0:1773851903.817821:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:10.0:1773851903.817821:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000800:00000200:7.0:1773851903.817821:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:6.0:1773851903.817821:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851903.817822:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x1a3: rc=0
00000400:00000200:4.0:1773851903.817822:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 3
00000800:00000200:30.0:1773851903.817823:0:41090:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x1e2: rc=0
00000800:00000200:7.0:1773851903.817823:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Using peer 2061@kfi7(0x20000000000019b)
00000800:00000200:6.0:1773851903.817823:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Using peer 36@kfi7(0x200000000000216)
00000800:00000200:30.0:1773851903.817824:0:41090:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:29.0:1773851903.817824:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 Using peer 30@kfi7(0xa16)
00000800:00000200:11.0:1773851903.817824:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:4.0:1773851903.817824:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2074@kfi7 local destination
00000400:00000200:10.0:1773851903.817825:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2060@kfi7(2060@kfi7:2060@kfi7) <?> : PUT try# 0
00000100:00000001:30.0:1773851903.817826:0:41090:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817826:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851903.817826:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000800:00000200:6.0:1773851903.817826:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000001aa19562: Posted send of 324 bytes to peer 0x200000000000216: rc=0
00000400:00000200:4.0:1773851903.817826:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1021, d:10, s:8770491, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8770493, p:4294967295, g:4294967295, h:1000]
00000100:00000001:30.0:1773851903.817827:0:41090:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:29.0:1773851903.817827:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000002607bd23: Posted send of 324 bytes to peer 0xa16: rc=0
00000100:00000001:11.0:1773851903.817827:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:7.0:1773851903.817827:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x20000000000019b: rc=0
00000100:00000001:30.0:1773851903.817828:0:41090:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817828:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817828:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851903.817828:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:6.0:1773851903.817828:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:30.0:1773851903.817829:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851903.817829:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851903.817829:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851903.817830:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851903.817830:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:11.0:1773851903.817830:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:10.0:1773851903.817830:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:6.0:1773851903.817830:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851903.817830:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:30.0:1773851903.817831:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851903.817831:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:29.0:1773851903.817831:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817831:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851903.817831:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851903.817831:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:6.0:1773851903.817831:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851903.817831:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000100:00000001:30.0:1773851903.817832:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851903.817832:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:29.0:1773851903.817832:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851903.817832:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851903.817832:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:6.0:1773851903.817832:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851903.817832:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000001:30.0:1773851903.817833:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851903.817833:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851903.817833:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817833:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817833:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.817834:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851903.817834:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:7.0:1773851903.817834:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851903.817835:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:29.0:1773851903.817835:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:10.0:1773851903.817835:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Using peer 2060@kfi7(0x2000000000001c1)
00000800:00000200:30.0:1773851903.817836:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851903.817836:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:29.0:1773851903.817836:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851903.817836:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817836:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:4.0:1773851903.817836:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2074@kfi7, 2081@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[23425179, 23425181]
00000800:00000200:31.0:1773851903.817837:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 TN_EVENT_TX_OK event status 0
00000100:00000001:29.0:1773851903.817837:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851903.817837:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817837:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851903.817838:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:10.0:1773851903.817838:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000000600ceff: Posted send of 324 bytes to peer 0x2000000000001c1: rc=0
00000800:00000200:9.0:1773851903.817838:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851903.817838:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851903.817839:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851903.817839:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:31.0:1773851903.817840:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000400:00000200:30.0:1773851903.817840:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000800:00000200:10.0:1773851903.817840:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851903.817840:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851903.817840:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:4.0:1773851903.817840:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2081@kfi7
00000400:00000200:30.0:1773851903.817841:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000048340f51
00000400:00000010:30.0:1773851903.817841:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000048340f51.
00000400:00000200:9.0:1773851903.817841:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851903.817841:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851903.817841:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:4.0:1773851903.817841:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770494:8770494:1021:4294967295] 2081@kfi7 LPNI seq info [23425182:23425182:16:4294967295]
00000400:00000200:31.0:1773851903.817842:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000089b548b8
00000400:00000010:31.0:1773851903.817842:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000089b548b8.
00000100:00000001:30.0:1773851903.817842:0:2472963:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:10.0:1773851903.817842:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817842:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.817842:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851903.817843:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:30.0:1773851903.817843:0:2472963:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817843:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851903.817843:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851903.817843:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000100:00000200:31.0:1773851903.817844:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817844:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851903.817844:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000557250e8
00000400:00000200:4.0:1773851903.817844:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00000400:00000010:9.0:1773851903.817845:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000557250e8.
00000400:00000200:4.0:1773851903.817845:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:31.0:1773851903.817846:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851903.817846:0:2472963:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:10.0:1773851903.817846:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851903.817846:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000040:31.0:1773851903.817847:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851903.817847:0:2472963:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851903.817848:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851903.817849:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851903.817849:0:2472963:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:4.0:1773851903.817849:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2081@kfi7(2074@kfi7:2081@kfi7) <?> : PUT try# 0
00000100:00000001:31.0:1773851903.817850:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:30.0:1773851903.817850:0:2472963:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:31.0:1773851903.817851:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:4.0:1773851903.817851:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009c31898f nid 2074@kfi7 refs 2
00000800:00000200:31.0:1773851903.817852:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002607bd23: 2069@kfi7:7 -> 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 7 tta 0xa16 Transaction freed
00000800:00000200:11.0:1773851903.817852:0:2510946:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851903.817853:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000400:00000200:11.0:1773851903.817853:0:2510946:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:9.0:1773851903.817853:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:11.0:1773851903.817854:0:2510946:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000100:00000040:9.0:1773851903.817854:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851903.817855:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1e2 Transaction freed
00000400:00000200:11.0:1773851903.817855:0:2510946:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e53ad71d
00000400:00000010:11.0:1773851903.817856:0:2510946:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e53ad71d.
00000100:00000001:11.0:1773851903.817857:0:2510946:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:11.0:1773851903.817858:0:2510946:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851903.817859:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851903.817859:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b TN_EVENT_TX_OK event status 0
00000100:00000001:9.0:1773851903.817860:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:5.0:1773851903.817860:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851903.817861:0:2510946:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:11.0:1773851903.817861:0:2510946:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851903.817861:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851903.817861:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851903.817861:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:5.0:1773851903.817862:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000400:00000200:6.0:1773851903.817863:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000400:00000200:5.0:1773851903.817863:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000011f34731
00000800:00000200:4.0:1773851903.817863:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:11.0:1773851903.817864:0:2510946:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851903.817864:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:6.0:1773851903.817864:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000012526ad9
00000400:00000010:5.0:1773851903.817864:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000011f34731.
00000100:00000001:5.0:1773851903.817864:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:11.0:1773851903.817865:0:2510946:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:6.0:1773851903.817865:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000012526ad9.
00000100:00000001:6.0:1773851903.817865:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851903.817865:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851903.817866:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000400:00000200:11.0:1773851903.817866:0:2510946:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000100:00000200:6.0:1773851903.817866:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851903.817867:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:11.0:1773851903.817867:0:2510946:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000600ceff: 2054@kfi7:2 -> 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 2 tta 0x2000000000001c1 Transaction freed
00000800:00000200:9.0:1773851903.817867:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 2 tta 0x1a3 Transaction freed
00000800:00000200:21.0:1773851903.817868:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:5.0:1773851903.817868:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851903.817869:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851903.817869:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851903.817869:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851903.817871:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851903.817872:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:6.0:1773851903.817872:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817872:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:5.0:1773851903.817872:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:21.0:1773851903.817874:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:7.0:1773851903.817874:0:2507579:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:6.0:1773851903.817874:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000400:00000200:5.0:1773851903.817874:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000800:00000200:4.0:1773851903.817874:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:21.0:1773851903.817875:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 60@kfi7 : PUT - for me
00000800:00000200:7.0:1773851903.817875:0:2507579:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851903.817876:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:7.0:1773851903.817876:0:2507579:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000736a2e34: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:6.0:1773851903.817876:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2054@kfi7:1 -> 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000019b Transaction freed
00000800:00000200:5.0:1773851903.817876:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001aa19562: 2054@kfi7:1 -> 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x200000000000216 Transaction freed
00000800:00000200:30.0:1773851903.817877:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851903.817877:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:21.0:1773851903.817877:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 1
00000800:00000200:30.0:1773851903.817878:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851903.817878:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:21.0:1773851903.817878:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000800:00000200:4.0:1773851903.817878:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Using peer 2081@kfi7(0x270)
00000800:00000200:29.0:1773851903.817879:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851903.817879:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:7.0:1773851903.817879:0:2507579:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000736a2e34: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:30.0:1773851903.817880:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851903.817880:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 3
00000400:00000200:21.0:1773851903.817881:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:7.0:1773851903.817881:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000800:00000200:30.0:1773851903.817882:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851903.817882:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851903.817882:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-60@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7080
00000400:00000200:21.0:1773851903.817883:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 60@kfi7 to cpt 5
00000400:00000200:7.0:1773851903.817883:0:2507579:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 30@kfi7 : PUT - for me
00000800:00000200:4.0:1773851903.817883:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x270: rc=0
00000400:00000200:29.0:1773851903.817884:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:21.0:1773851903.817884:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-60@kfi7 of length 368/368 into md 0x6a34d2375 [1] + 224
00000400:00000200:30.0:1773851903.817885:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.817885:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 37@kfi7 : PUT - for me
00000400:00000200:7.0:1773851903.817885:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:30.0:1773851903.817886:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2061@kfi7 : PUT - for me
00000800:00000200:21.0:1773851903.817886:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851903.817886:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 1
00000800:00000200:4.0:1773851903.817886:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:29.0:1773851903.817887:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:21.0:1773851903.817887:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:7.0:1773851903.817887:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 30@kfi7 to cpt 1
00000400:00000200:29.0:1773851903.817888:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 1
00000400:00000200:7.0:1773851903.817888:0:2507579:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000400:00000200:29.0:1773851903.817889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:21.0:1773851903.817889:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->60@kfi7: PUT: OK
00000100:00000001:4.0:1773851903.817889:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851903.817890:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000100:00000001:21.0:1773851903.817890:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:7.0:1773851903.817890:0:2507579:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 3
00000400:00000200:29.0:1773851903.817891:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 3
00000100:00000200:21.0:1773851903.817891:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:7.0:1773851903.817891:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000400:00000200:30.0:1773851903.817892:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000001:4.0:1773851903.817892:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:30.0:1773851903.817893:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 1
00000800:00000200:17.0:1773851903.817893:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000400:00000200:7.0:1773851903.817893:0:2507579:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13@kfi7 of length 368 into portal 4 MB=0x69b24fe8b70c0
00000400:00000200:30.0:1773851903.817894:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000100:00000040:21.0:1773851903.817894:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:19.0:1773851903.817894:0:2464491:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851903.817894:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:7.0:1773851903.817894:0:2507579:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13@kfi7 to cpt 5
00000100:00000001:4.0:1773851903.817894:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851903.817895:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:19.0:1773851903.817895:0:2464491:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851903.817895:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:4.0:1773851903.817895:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851903.817896:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 3
00000800:00000200:19.0:1773851903.817896:0:2464491:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008b0501c6: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:7.0:1773851903.817896:0:2507579:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-13@kfi7 of length 368/368 into md 0x6a34d2355 [1] + 224
00000100:00000001:4.0:1773851903.817896:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851903.817897:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000800:00000200:17.0:1773851903.817897:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:4.0:1773851903.817897:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000400:00000200:30.0:1773851903.817898:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.817898:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-37@kfi7 of length 368 into portal 4 MB=0x69b24fe8b71c0
00000100:00000001:21.0:1773851903.817898:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:19.0:1773851903.817898:0:2464491:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000008b0501c6: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:4.0:1773851903.817898:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:30.0:1773851903.817899:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2061@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7180
00000400:00000200:29.0:1773851903.817899:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 37@kfi7 to cpt 7
00000400:00000200:21.0:1773851903.817899:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000923deacc nid 60@kfi7 refs 2
00000800:00000200:7.0:1773851903.817899:0:2507579:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000736a2e34: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:4.0:1773851903.817899:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851903.817900:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:21.0:1773851903.817900:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 60@kfi7(000000009ad045cd):0x0 lsk 483 rsk 4788 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851903.817900:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:4.0:1773851903.817900:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851903.817901:0:41090:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:30.0:1773851903.817901:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2061@kfi7 to cpt 7
00000400:00000200:29.0:1773851903.817901:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-37@kfi7 of length 368/368 into md 0x78008239d [1] + 224
00000400:00000200:19.0:1773851903.817901:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.817901:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 36@kfi7 : PUT - for me
00000400:00000200:7.0:1773851903.817901:0:2507579:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000001:31.0:1773851903.817902:0:41090:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:19.0:1773851903.817902:0:2464491:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2060@kfi7 : PUT - for me
00000400:00000001:31.0:1773851903.817903:0:41090:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:30.0:1773851903.817903:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2061@kfi7 of length 368/368 into md 0x7800823bd [1] + 224
00000800:00000200:29.0:1773851903.817903:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851903.817903:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000400:00000200:7.0:1773851903.817903:0:2507579:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->30@kfi7: PUT: OK
00000400:00000010:31.0:1773851903.817904:0:41090:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b6291be0.
00000400:00000200:31.0:1773851903.817904:0:41090:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f690b6e3
00000400:00000200:17.0:1773851903.817904:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 1
00000400:00000010:31.0:1773851903.817905:0:41090:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f690b6e3.
00000800:00000200:30.0:1773851903.817905:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851903.817905:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851903.817905:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:31.0:1773851903.817906:0:41090:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851903.817906:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->37@kfi7: PUT: OK
00000400:00000200:17.0:1773851903.817906:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:7.0:1773851903.817906:0:2507579:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:5.0:1773851903.817906:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851903.817906:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:31.0:1773851903.817907:0:41090:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851903.817907:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851903.817907:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 3
00000100:00000001:4.0:1773851903.817907:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851903.817908:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2061@kfi7: PUT: OK
00000100:00000001:29.0:1773851903.817908:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851903.817908:0:2507579:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851903.817908:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851903.817909:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851903.817909:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:19.0:1773851903.817909:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:5.0:1773851903.817909:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000100:00000200:31.0:1773851903.817910:0:41090:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851903.817910:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a851431c
00000400:00000010:5.0:1773851903.817910:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a851431c.
00000100:00000200:30.0:1773851903.817911:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:7.0:1773851903.817911:0:2507579:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851903.817911:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:31.0:1773851903.817912:0:41090:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851903.817912:0:41090:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:29.0:1773851903.817912:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:19.0:1773851903.817912:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 1
00000100:00000200:5.0:1773851903.817912:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851903.817913:0:41090:0:(client.c:1428:after_reply()) Process entered
00000100:00000040:30.0:1773851903.817913:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:19.0:1773851903.817913:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
02000000:00000001:31.0:1773851903.817914:0:41090:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851903.817914:0:41090:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:19.0:1773851903.817914:0:2464491:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000400:00000200:19.0:1773851903.817914:0:2464491:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 3
00000100:00000001:5.0:1773851903.817914:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:31.0:1773851903.817915:0:41090:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851903.817915:0:41090:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851903.817915:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000040:5.0:1773851903.817915:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851903.817916:0:41090:0:(import.c:1951:at_measured()) add 66 to 00000000d5af3202 time=136 v=66 (66 66 66 66)
00000100:00000001:29.0:1773851903.817916:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:19.0:1773851903.817916:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000100:00000001:7.0:1773851903.817916:0:2507579:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00001000:31.0:1773851903.817917:0:41090:0:(import.c:1951:at_measured()) add 1 to 00000000b35a366d time=136 v=66 (1 1 1 1)
00000400:00000200:29.0:1773851903.817917:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ee3a01c0 nid 37@kfi7 refs 2
00000400:00000200:19.0:1773851903.817917:0:2464491:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2060@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7200
00000400:00000200:17.0:1773851903.817917:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-36@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7100
00000400:00000200:7.0:1773851903.817917:0:2507579:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000a1a15d8 nid 30@kfi7 refs 2
00000100:00000001:5.0:1773851903.817917:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851903.817918:0:41090:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851903.817918:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851903.817918:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:17.0:1773851903.817918:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 36@kfi7 to cpt 4
00000100:00000001:11.0:1773851903.817918:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851903.817918:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:31.0:1773851903.817919:0:41090:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:31.0:1773851903.817919:0:41090:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:30.0:1773851903.817919:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009c8a1fbd nid 2061@kfi7 refs 2
00000800:00000200:29.0:1773851903.817919:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 37@kfi7(000000000b73c360):0x0 lsk 420 rsk 4794 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851903.817919:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:19.0:1773851903.817919:0:2464491:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2060@kfi7 to cpt 4
00000400:00000200:17.0:1773851903.817919:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-36@kfi7 of length 368/368 into md 0x6ab1f26d1 [1] + 224
00000100:00000001:11.0:1773851903.817919:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:7.0:1773851903.817919:0:2507579:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000736a2e34: 2069@kfi7:1 <- 30@kfi7(00000000c73227cf):0x0 lsk 2583 rsk 4803 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000200:5.0:1773851903.817919:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00010000:00000001:31.0:1773851903.817920:0:41090:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851903.817920:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2061@kfi7(0000000080bb90e8):0x0 lsk 412 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000400:00000001:28.0:1773851903.817920:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851903.817920:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:11.0:1773851903.817920:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:31.0:1773851903.817921:0:41090:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:31.0:1773851903.817921:0:41090:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0005-osc-MDT0001: skip recheck: last_committed 171930981611
00000400:00000010:28.0:1773851903.817921:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e108dc56.
00000800:00000200:17.0:1773851903.817921:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000001:11.0:1773851903.817921:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:5.0:1773851903.817921:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2069@kfi7:1 -> 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 1 tta 0x270 Transaction freed
00000100:00000001:4.0:1773851903.817921:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851903.817922:0:41090:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851903.817922:0:41090:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:28.0:1773851903.817922:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003b8cfb79
00000400:00000200:19.0:1773851903.817922:0:2464491:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2060@kfi7 of length 368/368 into md 0x6ab1f26f1 [1] + 224
00000400:00000010:11.0:1773851903.817922:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045aadb6d.
00000100:00000001:4.0:1773851903.817922:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:31.0:1773851903.817923:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:28.0:1773851903.817923:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003b8cfb79.
00000100:00000001:28.0:1773851903.817923:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851903.817923:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:11.0:1773851903.817923:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000841fb28d
00000400:00000010:11.0:1773851903.817923:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000841fb28d.
00000800:00000200:19.0:1773851903.817924:0:2464491:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000008b0501c6: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851903.817924:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->36@kfi7: PUT: OK
00000100:00000001:11.0:1773851903.817924:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851903.817925:0:41090:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:28.0:1773851903.817925:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:4.0:1773851903.817925:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:19.0:1773851903.817926:0:2464491:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:17.0:1773851903.817926:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:11.0:1773851903.817926:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:4.0:1773851903.817926:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:31.0:1773851903.817927:0:41090:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:31.0:1773851903.817927:0:41090:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:19.0:1773851903.817927:0:2464491:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2060@kfi7: PUT: OK
00000100:00000200:17.0:1773851903.817927:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851903.817927:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000e59aed44.
00000004:00000001:31.0:1773851903.817928:0:41090:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:31.0:1773851903.817928:0:41090:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0005-osc-MDT0001: Updating status = 0
00000100:00000001:19.0:1773851903.817928:0:2464491:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:4.0:1773851903.817928:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000232fbe3
00000004:00000040:31.0:1773851903.817929:0:41090:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0005-osc-MDT0001: blocks=410399720448 free=351351199744 avail=351348421632 avail_mb=1372454772 hwm_mb=3131103 files=372083919 ffree=343116406 state=0: rc = 0
00000100:00000200:28.0:1773851903.817929:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:19.0:1773851903.817929:0:2464491:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:11.0:1773851903.817929:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:4.0:1773851903.817929:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000232fbe3.
00000100:00000040:17.0:1773851903.817930:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851903.817931:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851903.817931:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851903.817931:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000020:31.0:1773851903.817932:0:41090:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0005-osc-MDT0001 (0000000072d4e276): 410399720448 blocks, 351351199744 free, 351348421632 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372083919 files, 343116406 free files
00000100:00000001:28.0:1773851903.817932:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.817932:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000100:00000040:19.0:1773851903.817932:0:2464491:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:11.0:1773851903.817932:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:4.0:1773851903.817932:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851903.817933:0:41089:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:21.0:1773851903.817933:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:11.0:1773851903.817933:0:41069:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:11.0:1773851903.817933:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000004:00000001:31.0:1773851903.817934:0:41090:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851903.817934:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851903.817934:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851903.817934:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:17.0:1773851903.817934:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:11.0:1773851903.817934:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:31.0:1773851903.817935:0:41090:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851903.817935:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:17.0:1773851903.817935:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005b1605e2 nid 36@kfi7 refs 2
00000100:00000001:11.0:1773851903.817935:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851903.817936:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851903.817936:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:19.0:1773851903.817936:0:2464491:0:(events.c:185:reply_in_callback()) Process leaving
02000000:00000001:11.0:1773851903.817936:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817936:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851903.817936:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00001000:28.0:1773851903.817937:0:41089:0:(import.c:1951:at_measured()) add 66 to 000000004456caab time=136 v=66 (66 66 66 66)
00000400:00000200:19.0:1773851903.817937:0:2464491:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191a5a79 nid 2060@kfi7 refs 2
00000800:00000200:17.0:1773851903.817937:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 36@kfi7(00000000b7714ae2):0x0 lsk 535 rsk 4789 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00001000:11.0:1773851903.817937:0:41069:0:(import.c:1951:at_measured()) add 66 to 000000006cd863a2 time=136 v=66 (66 66 66 66)
00000400:00000001:6.0:1773851903.817937:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00100000:31.0:1773851903.817938:0:41090:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000009d6a92c0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_02:lustre5-MDT0001-mdtlov_UUID:41090:1859433051943040:60@kfi7:13:default-yuba2-0
00000100:00001000:28.0:1773851903.817938:0:41089:0:(import.c:1951:at_measured()) add 1 to 0000000042be44b1 time=136 v=66 (1 1 1 1)
00000400:00000200:21.0:1773851903.817938:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00001000:11.0:1773851903.817938:0:41069:0:(import.c:1951:at_measured()) add 1 to 000000006b6d99fc time=136 v=66 (1 1 1 1)
00000100:00000001:10.0:1773851903.817938:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000001:6.0:1773851903.817938:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:4.0:1773851903.817938:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851903.817939:0:41090:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851903.817939:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:21.0:1773851903.817939:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2081@kfi7 : PUT - for me
00000800:00000200:19.0:1773851903.817939:0:2464491:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000008b0501c6: 2054@kfi7:4 <- 2060@kfi7(00000000cbf81e4c):0x0 lsk 450 rsk 4791 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851903.817939:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851903.817939:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000010:6.0:1773851903.817939:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000400:00000200:6.0:1773851903.817939:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000114436b6
00000100:00000001:31.0:1773851903.817940:0:41090:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851903.817940:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851903.817940:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:11.0:1773851903.817940:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:6.0:1773851903.817940:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000114436b6.
00000100:00000040:31.0:1773851903.817941:0:41090:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000009d6a92c0 x1859433051943040/t0(0) o13->lustre5-OST0005-osc-MDT0001@60@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:28.0:1773851903.817941:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:21.0:1773851903.817941:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 1
00010000:00000001:11.0:1773851903.817941:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:11.0:1773851903.817941:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:10.0:1773851903.817941:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:6.0:1773851903.817941:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:28.0:1773851903.817942:0:41089:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851903.817942:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2081@kfi7 to cpt 5
00000100:00000001:11.0:1773851903.817942:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:10.0:1773851903.817942:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:6.0:1773851903.817942:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851903.817942:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851903.817943:0:41090:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:28.0:1773851903.817943:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:28.0:1773851903.817943:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0002-osp-MDT0001: skip recheck: last_committed 251213478406
00000400:00000200:21.0:1773851903.817943:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000400:00000200:21.0:1773851903.817943:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 3
00000100:00000040:11.0:1773851903.817943:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0002-osc-MDT0001: skip recheck: last_committed 197699407018
00000400:00000010:10.0:1773851903.817943:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000400:00000200:10.0:1773851903.817943:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000100:00000001:4.0:1773851903.817943:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851903.817944:0:41090:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851903.817944:0:41090:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000811c6a94.
00000100:00000001:28.0:1773851903.817944:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:21.0:1773851903.817944:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000001:11.0:1773851903.817944:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:10.0:1773851903.817944:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00000001:4.0:1773851903.817944:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851903.817945:0:41090:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:28.0:1773851903.817945:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851903.817945:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2074@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7140
00000100:00000001:11.0:1773851903.817945:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.817945:0:41071:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:6.0:1773851903.817945:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:4.0:1773851903.817945:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000020:00000001:31.0:1773851903.817946:0:41090:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851903.817946:0:41090:0:(genops.c:1107:class_import_put()) import 00000000c07400e7 refcount=4 obd=lustre5-OST0005-osc-MDT0001
00000100:00000040:28.0:1773851903.817946:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:21.0:1773851903.817946:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2074@kfi7 to cpt 7
00000100:00000040:11.0:1773851903.817946:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:10.0:1773851903.817946:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851903.817946:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000020:00000001:31.0:1773851903.817947:0:41090:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851903.817947:0:41090:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000101b0638.
00000100:00000001:6.0:1773851903.817947:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:6.0:1773851903.817947:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.817947:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851903.817948:0:41090:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000400:00000200:21.0:1773851903.817948:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2074@kfi7 of length 368/368 into md 0x78008241d [1] + 224
00000100:00000001:6.0:1773851903.817948:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851903.817948:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000001:4.0:1773851903.817948:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851903.817949:0:41090:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851903.817949:0:41090:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000009d6a92c0.
00000100:00000001:28.0:1773851903.817949:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:11.0:1773851903.817949:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000200:10.0:1773851903.817949:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851903.817949:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:6.0:1773851903.817949:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851903.817949:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000002e65bb64 time=136 v=66 (66 66 66 66)
00000100:00000001:31.0:1773851903.817950:0:41090:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:31.0:1773851903.817950:0:41090:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851903.817950:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:28.0:1773851903.817950:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851903.817950:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:11.0:1773851903.817950:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:11.0:1773851903.817950:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:6.0:1773851903.817950:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851903.817951:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:28.0:1773851903.817951:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:21.0:1773851903.817951:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000004:00000001:11.0:1773851903.817951:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:10.0:1773851903.817951:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851903.817951:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:6.0:1773851903.817951:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000d49e1150 time=136 v=66 (66 66 66 66)
00000100:00001000:4.0:1773851903.817951:0:41065:0:(import.c:1951:at_measured()) add 1 to 00000000e93b7c0f time=136 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851903.817952:0:41090:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851903.817952:0:41090:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851903.817952:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2081@kfi7: PUT: OK
00000004:00000040:11.0:1773851903.817952:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0002-osc-MDT0001: Updating status = 0
00000100:00000001:10.0:1773851903.817952:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:10.0:1773851903.817952:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00001000:6.0:1773851903.817952:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000ec58e2a2 time=136 v=66 (1 1 1 1)
00000100:00000001:31.0:1773851903.817953:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851903.817953:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:28.0:1773851903.817953:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0002-osp-MDT0001 (0000000082080b7d): 33735096800 blocks, 31192440448 free, 31192401536 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3204238440 files, 2962368001 free files
00000100:00000001:21.0:1773851903.817953:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000040:11.0:1773851903.817953:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0002-osc-MDT0001: blocks=410399708160 free=351690089472 avail=351687715840 avail_mb=1373780140 hwm_mb=3131103 files=372231078 ffree=343447353 state=0: rc = 0
00000100:00000001:10.0:1773851903.817953:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851903.817953:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000004:00000001:28.0:1773851903.817954:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:21.0:1773851903.817954:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817954:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851903.817954:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851903.817954:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851903.817954:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.817954:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851903.817955:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:11.0:1773851903.817955:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0002-osc-MDT0001 (0000000027537575): 410399708160 blocks, 351690089472 free, 351687715840 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372231078 files, 343447353 free files
00000100:00001000:10.0:1773851903.817955:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000e6901c96 time=136 v=66 (66 66 66 66)
00010000:00000001:6.0:1773851903.817955:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851903.817955:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:4.0:1773851903.817955:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000001:11.0:1773851903.817956:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:10.0:1773851903.817956:0:41071:0:(import.c:1951:at_measured()) add 1 to 0000000035f8ff8d time=136 v=66 (1 1 1 1)
00000100:00000001:6.0:1773851903.817956:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00010000:00000001:4.0:1773851903.817956:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851903.817957:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817957:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:6.0:1773851903.817957:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0000-osc-MDT0001: skip recheck: last_committed 180522293430
00000100:00000001:4.0:1773851903.817957:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00100000:28.0:1773851903.817958:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000085ab5bae pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051943104:13@kfi7:41:default-yuba2-0
00000100:00000040:11.0:1773851903.817958:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817958:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:10.0:1773851903.817958:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:6.0:1773851903.817958:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851903.817958:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.817958:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000e-osc-MDT0001: skip recheck: last_committed 146161946248
00010000:00000001:10.0:1773851903.817959:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851903.817959:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851903.817959:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851903.817959:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851903.817960:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051943360:37@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851903.817960:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:10.0:1773851903.817960:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0001-osc-MDT0001: skip recheck: last_committed 180522690109
00000100:00000001:28.0:1773851903.817961:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:21.0:1773851903.817961:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:21.0:1773851903.817961:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d0f5332d nid 2081@kfi7 refs 2
00000100:00000001:10.0:1773851903.817961:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:10.0:1773851903.817961:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.817961:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851903.817962:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:11.0:1773851903.817962:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851903.817962:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:28.0:1773851903.817963:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000085ab5bae x1859433051943104/t0(0) o41->lustre5-MDT0002-osp-MDT0001@13@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000800:00000200:21.0:1773851903.817963:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 2081@kfi7(00000000184cf4db):0x0 lsk 625 rsk 4797 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851903.817963:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:10.0:1773851903.817963:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851903.817963:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851903.817963:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851903.817963:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851903.817963:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:11.0:1773851903.817964:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000037d69b00 x1859433051943360/t0(0) o13->lustre5-OST0002-osc-MDT0001@37@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000001:7.0:1773851903.817964:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000004:00000001:6.0:1773851903.817964:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:6.0:1773851903.817964:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0000-osc-MDT0001: Updating status = 0
00000100:00000001:10.0:1773851903.817965:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000001:7.0:1773851903.817965:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000040:6.0:1773851903.817965:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0000-osc-MDT0001: blocks=410399722496 free=351500144640 avail=351498109952 avail_mb=1373039492 hwm_mb=3131103 files=372097642 ffree=343261860 state=0: rc = 0
00000100:00000001:28.0:1773851903.817966:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:28.0:1773851903.817966:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:11.0:1773851903.817966:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:10.0:1773851903.817966:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:10.0:1773851903.817966:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:7.0:1773851903.817966:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000009b452653.
00000400:00000200:7.0:1773851903.817966:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6473a15
00000100:00000001:4.0:1773851903.817966:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000010:28.0:1773851903.817967:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000007573667.
02000000:00000001:11.0:1773851903.817967:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:10.0:1773851903.817967:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000010:7.0:1773851903.817967:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6473a15.
00000004:00000020:6.0:1773851903.817967:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0000-osc-MDT0001 (00000000c8c3e6c2): 410399722496 blocks, 351500144640 free, 351498109952 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097642 files, 343261860 free files
00000100:00000001:4.0:1773851903.817967:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
02000000:00000001:28.0:1773851903.817968:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000010:11.0:1773851903.817968:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000bb57814a.
00000100:00000001:7.0:1773851903.817968:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:4.0:1773851903.817968:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851903.817969:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:28.0:1773851903.817969:0:41089:0:(genops.c:1107:class_import_put()) import 0000000085573a11 refcount=2 obd=lustre5-MDT0002-osp-MDT0001
02000000:00000001:11.0:1773851903.817969:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:11.0:1773851903.817969:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000004:00000040:10.0:1773851903.817969:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0001-osc-MDT0001: Updating status = 0
00000004:00000040:10.0:1773851903.817969:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0001-osc-MDT0001: blocks=410399705088 free=351504325632 avail=351502194688 avail_mb=1373055448 hwm_mb=3131103 files=372056094 ffree=343265943 state=0: rc = 0
00000100:00000200:7.0:1773851903.817969:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:6.0:1773851903.817969:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851903.817969:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000020:00000001:28.0:1773851903.817970:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:28.0:1773851903.817970:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000040d06717.
00000020:00000040:11.0:1773851903.817970:0:41069:0:(genops.c:1107:class_import_put()) import 000000005bb3c871 refcount=4 obd=lustre5-OST0002-osc-MDT0001
00000100:00000040:6.0:1773851903.817970:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:4.0:1773851903.817970:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000e-osc-MDT0001: Updating status = 0
02000000:00000001:28.0:1773851903.817971:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:11.0:1773851903.817971:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:11.0:1773851903.817971:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000009c52eb5f.
00000004:00000020:10.0:1773851903.817971:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0001-osc-MDT0001 (00000000c5194270): 410399705088 blocks, 351504325632 free, 351502194688 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372056094 files, 343265943 free files
00000100:00000200:7.0:1773851903.817971:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:4.0:1773851903.817971:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000e-osc-MDT0001: blocks=410399725568 free=351492789248 avail=351490379776 avail_mb=1373009296 hwm_mb=3131103 files=372077981 ffree=343254677 state=0: rc = 0
02000000:00000001:28.0:1773851903.817972:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:28.0:1773851903.817972:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000085ab5bae.
02000000:00000001:11.0:1773851903.817972:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000001:10.0:1773851903.817972:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851903.817973:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:11.0:1773851903.817973:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:11.0:1773851903.817973:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037d69b00.
00000100:00000040:10.0:1773851903.817973:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:6.0:1773851903.817973:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000095bd404b pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051943168:36@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851903.817974:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851903.817974:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851903.817974:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851903.817974:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851903.817974:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851903.817974:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851903.817975:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851903.817975:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817975:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851903.817975:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851903.817975:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851903.817975:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:6.0:1773851903.817975:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000020:4.0:1773851903.817975:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000e-osc-MDT0001 (00000000402f3d69): 410399725568 blocks, 351492789248 free, 351490379776 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372077981 files, 343254677 free files
00000100:00000001:28.0:1773851903.817976:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851903.817976:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00100000:10.0:1773851903.817976:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001e258fdd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051943424:2060@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851903.817976:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:6.0:1773851903.817976:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000095bd404b x1859433051943168/t0(0) o13->lustre5-OST0000-osc-MDT0001@36@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851903.817977:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817977:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817977:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851903.817977:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851903.817977:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851903.817977:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851903.817977:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.817978:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.817978:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00001000:7.0:1773851903.817978:0:41064:0:(import.c:1951:at_measured()) add 66 to 0000000016ffdf05 time=136 v=66 (66 66 66 66)
00000100:00000001:6.0:1773851903.817978:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:10.0:1773851903.817979:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001e258fdd x1859433051943424/t0(0) o13->lustre5-OST0001-osc-MDT0001@2060@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:7.0:1773851903.817979:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000535cff41 time=136 v=66 (1 1 1 1)
02000000:00000001:6.0:1773851903.817979:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851903.817979:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008d25977b.
00000100:00000001:7.0:1773851903.817980:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:4.0:1773851903.817980:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817981:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851903.817981:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851903.817981:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:6.0:1773851903.817981:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851903.817981:0:41067:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:10.0:1773851903.817982:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:10.0:1773851903.817982:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001aa877ac.
00010000:00000001:7.0:1773851903.817982:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:6.0:1773851903.817982:0:41067:0:(genops.c:1107:class_import_put()) import 00000000e75a8f63 refcount=4 obd=lustre5-OST0000-osc-MDT0001
00000100:00000001:7.0:1773851903.817983:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000020:00000001:6.0:1773851903.817983:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851903.817983:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000035adc4a4.
02000000:00000001:10.0:1773851903.817984:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:10.0:1773851903.817984:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:7.0:1773851903.817984:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0003-osp-MDT0001: skip recheck: last_committed 173220836534
00000100:00000001:7.0:1773851903.817984:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851903.817984:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851903.817984:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000040:10.0:1773851903.817985:0:41071:0:(genops.c:1107:class_import_put()) import 0000000067ea1a7d refcount=17 obd=lustre5-OST0001-osc-MDT0001
00000020:00000001:10.0:1773851903.817985:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:7.0:1773851903.817985:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:6.0:1773851903.817985:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851903.817985:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000095bd404b.
00000100:00100000:4.0:1773851903.817985:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000165a41dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051943296:2061@kfi7:13:default-yuba2-0
02000000:00000010:10.0:1773851903.817986:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000569baa6b.
00000100:00000001:6.0:1773851903.817986:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851903.817986:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851903.817987:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:10.0:1773851903.817987:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:6.0:1773851903.817987:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.817987:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:10.0:1773851903.817988:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001e258fdd.
00000100:00000001:7.0:1773851903.817988:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851903.817988:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851903.817988:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851903.817988:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.817988:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:10.0:1773851903.817989:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851903.817989:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851903.817989:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851903.817989:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:6.0:1773851903.817989:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851903.817989:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.817989:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000165a41dd x1859433051943296/t0(0) o13->lustre5-OST000e-osc-MDT0001@2061@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:10.0:1773851903.817990:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000020:7.0:1773851903.817990:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0003-osp-MDT0001 (000000002c1bf1c3): 33736223680 blocks, 31250857888 free, 31250809376 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3097121452 files, 2868731095 free files
00000100:00000001:10.0:1773851903.817991:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851903.817991:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851903.817992:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851903.817992:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:7.0:1773851903.817992:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851903.817993:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:4.0:1773851903.817994:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:4.0:1773851903.817994:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00100000:7.0:1773851903.817995:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a2bedac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051943232:2074@kfi7:41:default-yuba2-0
02000000:00000010:4.0:1773851903.817995:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b2b64901.
00000100:00000001:7.0:1773851903.817997:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851903.817997:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:4.0:1773851903.817997:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000040:7.0:1773851903.817998:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007a2bedac x1859433051943232/t0(0) o41->lustre5-MDT0003-osp-MDT0001@2074@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852056 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000020:00000001:4.0:1773851903.817998:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851903.817999:0:41065:0:(genops.c:1107:class_import_put()) import 000000002c6f8ce2 refcount=4 obd=lustre5-OST000e-osc-MDT0001
00000100:00000001:7.0:1773851903.818000:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:4.0:1773851903.818000:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:7.0:1773851903.818001:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851903.818001:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000002e351634.
02000000:00000010:4.0:1773851903.818001:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000097fed2c.
02000000:00000001:7.0:1773851903.818002:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851903.818002:0:41064:0:(genops.c:1101:class_import_put()) Process entered
02000000:00000001:4.0:1773851903.818002:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000040:7.0:1773851903.818003:0:41064:0:(genops.c:1107:class_import_put()) import 00000000519ae0d4 refcount=2 obd=lustre5-MDT0003-osp-MDT0001
00000020:00000001:7.0:1773851903.818003:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:4.0:1773851903.818003:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
02000000:00000010:7.0:1773851903.818004:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000085d7323e.
00000100:00000010:4.0:1773851903.818004:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000165a41dd.
02000000:00000001:7.0:1773851903.818005:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851903.818005:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851903.818005:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a2bedac.
00000100:00000001:4.0:1773851903.818005:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851903.818006:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851903.818006:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.818006:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851903.818007:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.818007:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851903.818008:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851903.818008:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.818008:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851903.818008:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.818009:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851903.818009:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.818009:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851903.818010:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:25.0:1773851903.862733:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851903.862735:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851903.862737:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851903.862740:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851903.862744:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.862746:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11920@kfi7 : PUT - for me
00000400:00000200:25.0:1773851903.862748:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.862750:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 1
00000400:00000200:25.0:1773851903.862752:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:25.0:1773851903.862753:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000400:00000200:25.0:1773851903.862755:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 3
00000400:00000200:25.0:1773851903.862758:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11921@kfi7 to cpt 1
00000400:00000200:25.0:1773851903.862759:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11921@kfi7 of length 224 into portal 12 MB=0x69b4b575b5740
00000400:00000200:25.0:1773851903.862762:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11921@kfi7 of length 224/224 into md 0x16159c9699 [64] + 45840
00000800:00000200:25.0:1773851903.862765:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851903.862768:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.862770:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11920@kfi7: PUT: OK
00000100:00000001:25.0:1773851903.862772:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851903.862772:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851903.862774:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000082cf81f.
00000100:00000040:25.0:1773851903.862776:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000082cf81f x1859597750720320 msgsize 224
00000100:00100000:25.0:1773851903.862778:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-11921@kfi7 (source: 12345-11920@kfi7)
00000100:00000001:25.0:1773851903.862780:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851903.862782:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000100:00000001:24.0:1773851903.862783:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851903.862784:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851903.862784:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851903.862785:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851903.862786:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851903.862788:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851903.862789:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597750720320
00000020:00000001:24.0:1773851903.862791:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851903.862791:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ed63
00000020:00000001:24.0:1773851903.862794:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851903.862797:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b661e706 refcount=5
00000020:00000001:24.0:1773851903.862798:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637161058305024 : -106912651246592 : ffff9ec375668400)
00000020:00000001:24.0:1773851903.862800:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637161058305024 : -106912651246592 : ffff9ec375668400)
00000100:00000001:24.0:1773851903.862802:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851903.862803:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851903.862804:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000030bb5633.
00000020:00000010:24.0:1773851903.862806:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851903.862808:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851903.862809:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851903.862810:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851903.862811:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851903.862813:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851903.862814:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851903.862815:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.862817:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851903.862819:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851903.862820:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851903.862820:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851903.862821:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851903.862822:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11921@kfi7, seq: 2025199
00000100:00000001:26.0:1773851903.862824:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851903.862824:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b661e706 : new rpc_count 1
00000100:00000001:26.0:1773851903.862825:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.862825:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157357568 : -106936552194048 : ffff9ebde4cb0000)
00000100:00000040:24.0:1773851903.862827:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000082cf81f x1859597750720320/t0(0) o400->0eebdac8-7b88-4014-b570-98df74744c30@11921@kfi7:184/0 lens 224/0 e 0 to 0 dl 1773852299 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1234-0'
00000100:00000001:24.0:1773851903.862832:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851903.862833:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851903.862834:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000082cf81f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:0eebdac8-7b88-4014-b570-98df74744c30+5:39573:x1859597750720320:12345-11921@kfi7:400:default-tuolumne1234-0
00000100:00000200:24.0:1773851903.862837:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597750720320
00000020:00000001:24.0:1773851903.862838:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851903.862839:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851903.862840:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.862841:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851903.862842:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851903.862845:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851903.862846:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597750720320, found 0 last_xid 1859597750720319
00000020:00000001:24.0:1773851903.862847:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851903.862848:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851903.862849:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851903.862850:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.862852:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851903.862853:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851903.862853:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851903.862855:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b6e19057.
02000000:00000001:24.0:1773851903.862856:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.862858:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.862859:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851903.862860:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182690944576, transno 0, xid 1859597750720320
00010000:00000001:24.0:1773851903.862861:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851903.862863:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000082cf81f x1859597750720320/t0(0) o400->0eebdac8-7b88-4014-b570-98df74744c30@11921@kfi7:184/0 lens 224/224 e 0 to 0 dl 1773852299 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1234-0'
00010000:00000001:24.0:1773851903.862868:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851903.862869:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851903.862870:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=136 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851903.862872:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851903.862874:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002d0245cf refcount 3 to 11921@kfi7
00000100:00000001:24.0:1773851903.862875:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981344 : -107130476570272 : ffff9e90bdffd960)
02000000:00000001:24.0:1773851903.862876:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851903.862877:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851903.862879:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851903.862880:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11920@kfi7
00000400:00000010:24.0:1773851903.862881:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000049ef55f5.
00000100:00000200:24.0:1773851903.862883:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597750720320, offset 224
00000400:00000200:24.0:1773851903.862885:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11920@kfi7
00000400:00000200:24.0:1773851903.862887:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.862888:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 1
00000400:00000200:24.0:1773851903.862890:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000400:00000200:24.0:1773851903.862892:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 3
00000400:00000200:24.0:1773851903.862895:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11920@kfi7 local destination
00000400:00000200:24.0:1773851903.862898:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770495:8770495:1024:4294967295] 11920@kfi7 LPNI seq info [1132879:1132879:16:4294967295]
00000400:00000200:24.0:1773851903.862901:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000400:00000200:24.0:1773851903.862902:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11920@kfi7 to cpt 6
00000400:00000200:24.0:1773851903.862906:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11920@kfi7(11920@kfi7:11920@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851903.862909:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 3
00000800:00000200:24.0:1773851903.862911:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851903.862913:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851903.862917:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851903.862922:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000039f Using peer 11920@kfi7(0x10000000000039f)
00000800:00000200:24.0:1773851903.862927:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000008402ee93: Posted send of 324 bytes to peer 0x10000000000039f: rc=0
00000800:00000200:24.0:1773851903.862930:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000039f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851903.862934:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851903.862935:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002d0245cf refcount 2 to 11921@kfi7
00010000:00000001:24.0:1773851903.862940:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851903.862940:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851903.862941:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851903.862943:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000082cf81f x1859597750720320/t0(0) o400->0eebdac8-7b88-4014-b570-98df74744c30@11921@kfi7:184/0 lens 224/224 e 0 to 0 dl 1773852299 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1234-0'
00000100:00100000:24.0:1773851903.862948:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000082cf81f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:0eebdac8-7b88-4014-b570-98df74744c30+5:39573:x1859597750720320:12345-11921@kfi7:400:default-tuolumne1234-0 Request processed in 115us (172us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851903.862953:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11921@kfi7, seq: 2025199
00000100:00000040:24.0:1773851903.862954:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b661e706 : new rpc_count 0
00000100:00000001:24.0:1773851903.862955:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851903.862956:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851903.862958:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851903.862960:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851903.862961:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000030bb5633.
00000020:00000040:24.0:1773851903.862963:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000b661e706 : new refcount 4
00000100:00000001:24.0:1773851903.862964:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851903.862973:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000039f TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851903.862976:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851903.862978:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11920@kfi7: PUT: OK
00000400:00000200:25.0:1773851903.862979:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000049ef55f5
00000400:00000010:25.0:1773851903.862980:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000049ef55f5.
00000100:00000001:25.0:1773851903.862982:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851903.862982:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851903.862984:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000ea8e770 nid 11920@kfi7 refs 2
00000800:00000200:25.0:1773851903.862986:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 11920@kfi7(00000000818f5cac):0x0 lsk 928 rsk 28 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000039f Transaction freed
00000400:00000200:29.0:1773851903.881732:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851903.881733:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000400:00000010:29.0:1773851903.881738:0:34579:0:(lib-lnet.h:494:lnet_rspt_free()) rspt free 00000000d7a72a8d
00000400:00000010:29.0:1773851903.881739:0:34579:0:(lib-lnet.h:494:lnet_rspt_free()) rspt free 0000000071a3de04
00000400:00000010:29.0:1773851903.881740:0:34579:0:(lib-lnet.h:494:lnet_rspt_free()) rspt free 00000000b7e76d68
00000400:00000010:29.0:1773851903.881740:0:34579:0:(lib-lnet.h:494:lnet_rspt_free()) rspt free 000000009d4ad477
00000800:00000200:15.0:1773851903.891686:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851903.891687:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:15.0:1773851903.891689:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:15.0:1773851903.891691:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:15.0:1773851903.891693:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23682@kfi7 to cpt 3
00000400:00000200:15.0:1773851903.891694:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23682@kfi7 : PUT - for me
00000400:00000200:15.0:1773851903.891695:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23682@kfi7 to cpt 3
00000400:00000200:15.0:1773851903.891696:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7c4433b nid 23682@kfi7 refs 1
00000400:00000200:15.0:1773851903.891697:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23682@kfi7 to cpt 3
00000400:00000200:15.0:1773851903.891697:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7c4433b nid 23682@kfi7 refs 2
00000400:00000200:15.0:1773851903.891698:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b7c4433b nid 23682@kfi7 refs 3
00000400:00000200:15.0:1773851903.891699:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23619@kfi7 to cpt 3
00000400:00000200:15.0:1773851903.891700:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23619@kfi7 of length 224 into portal 12 MB=0x69b83c611b040
00000400:00000200:15.0:1773851903.891701:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23619@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 63936
00000800:00000200:15.0:1773851903.891703:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851903.891704:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851903.891705:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23682@kfi7: PUT: OK
00000100:00000001:15.0:1773851903.891706:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851903.891706:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851903.891707:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000090e501.
00000100:00000040:15.0:1773851903.891709:0:2513974:0:(events.c:358:request_in_callback()) incoming req@000000000090e501 x1859840126332992 msgsize 224
00000100:00100000:15.0:1773851903.891710:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-23619@kfi7 (source: 12345-23682@kfi7)
00000100:00000001:15.0:1773851903.891711:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851903.891712:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7c4433b nid 23682@kfi7 refs 2
00000100:00000001:12.0:1773851903.891712:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:15.0:1773851903.891713:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007bd95d26: 2069@kfi7:3 <- 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:12.0:1773851903.891713:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851903.891713:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851903.891714:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851903.891715:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851903.891716:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859840126332992
00000020:00000001:12.0:1773851903.891716:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851903.891716:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087ab3448f1
00000020:00000001:12.0:1773851903.891717:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851903.891720:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d3bc059d refcount=5
00000020:00000001:12.0:1773851903.891721:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637121059023872 : -106952650527744 : ffff9eba2541ec00)
00000020:00000001:12.0:1773851903.891722:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637121059023872 : -106952650527744 : ffff9eba2541ec00)
00000100:00000001:12.0:1773851903.891723:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.891728:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851903.891729:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c0ce2707.
00000020:00000010:12.0:1773851903.891730:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.891731:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851903.891731:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851903.891732:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851903.891732:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851903.891733:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851903.891734:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851903.891734:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.891735:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851903.891736:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851903.891737:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851903.891737:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851903.891737:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851903.891738:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23619@kfi7, seq: 2289955
00000100:00000001:14.0:1773851903.891739:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.891739:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d3bc059d : new rpc_count 1
00000100:00000001:14.0:1773851903.891740:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.891740:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113251452288 : -106960458099328 : ffff9eb853e3d580)
00000100:00000040:12.0:1773851903.891741:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000090e501 x1859840126332992/t0(0) o400->9ae7937b-da08-4c7b-9875-fe6a081eb4df@23619@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1976-0'
00000100:00000001:12.0:1773851903.891744:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851903.891744:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851903.891745:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000090e501 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9ae7937b-da08-4c7b-9875-fe6a081eb4df+5:39719:x1859840126332992:12345-23619@kfi7:400:default-tuolumne1976-0
00000100:00000200:12.0:1773851903.891747:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859840126332992
00000020:00000001:12.0:1773851903.891747:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851903.891748:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851903.891749:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.891749:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851903.891750:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851903.891751:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851903.891751:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859840126332992, found 0 last_xid 1859840126332991
00000020:00000001:12.0:1773851903.891752:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851903.891753:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851903.891753:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851903.891754:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.891757:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851903.891758:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851903.891758:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851903.891760:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000896892a8.
02000000:00000001:12.0:1773851903.891761:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.891761:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.891762:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851903.891763:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183260828409, transno 0, xid 1859840126332992
00010000:00000001:12.0:1773851903.891764:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851903.891764:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000090e501 x1859840126332992/t0(0) o400->9ae7937b-da08-4c7b-9875-fe6a081eb4df@23619@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1976-0'
00010000:00000001:12.0:1773851903.891767:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851903.891767:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851903.891768:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=136 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851903.891769:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851903.891770:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006fce085a refcount 3 to 23619@kfi7
00000100:00000001:12.0:1773851903.891771:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918811149056 : -107154898402560 : ffff9e8b0e584300)
02000000:00000001:12.0:1773851903.891771:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851903.891772:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851903.891773:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851903.891774:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23682@kfi7
00000400:00000010:12.0:1773851903.891774:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f51b28f0.
00000100:00000200:12.0:1773851903.891775:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859840126332992, offset 224
00000400:00000200:12.0:1773851903.891777:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23682@kfi7
00000400:00000200:12.0:1773851903.891778:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23682@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.891778:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b7c4433b nid 23682@kfi7 refs 1
00000400:00000200:12.0:1773851903.891780:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b7c4433b nid 23682@kfi7 refs 2
00000400:00000200:12.0:1773851903.891781:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b7c4433b nid 23682@kfi7 refs 3
00000400:00000200:12.0:1773851903.891782:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23682@kfi7 local destination
00000400:00000200:12.0:1773851903.891783:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770496:8770496:1024:4294967295] 23682@kfi7 LPNI seq info [51461:51461:16:4294967295]
00000400:00000200:12.0:1773851903.891784:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b7c4433b nid 23682@kfi7 refs 2
00000400:00000200:12.0:1773851903.891785:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23682@kfi7 to cpt 3
00000400:00000200:12.0:1773851903.891787:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23682@kfi7(23682@kfi7:23682@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851903.891789:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b7c4433b nid 23682@kfi7 refs 3
00000800:00000200:12.0:1773851903.891790:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851903.891791:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851903.891793:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851903.891795:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x27d Using peer 23682@kfi7(0x27d)
00000800:00000200:12.0:1773851903.891798:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004f3fa634: Posted send of 324 bytes to peer 0x27d: rc=0
00000800:00000200:12.0:1773851903.891800:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x27d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851903.891802:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851903.891803:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006fce085a refcount 2 to 23619@kfi7
00010000:00000001:12.0:1773851903.891803:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851903.891804:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851903.891804:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851903.891805:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000090e501 x1859840126332992/t0(0) o400->9ae7937b-da08-4c7b-9875-fe6a081eb4df@23619@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1976-0'
00000100:00100000:12.0:1773851903.891810:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000090e501 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:9ae7937b-da08-4c7b-9875-fe6a081eb4df+5:39719:x1859840126332992:12345-23619@kfi7:400:default-tuolumne1976-0 Request processed in 65us (100us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851903.891812:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23619@kfi7, seq: 2289955
00000100:00000040:12.0:1773851903.891813:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d3bc059d : new rpc_count 0
00000100:00000001:12.0:1773851903.891814:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851903.891814:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851903.891815:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851903.891815:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851903.891816:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c0ce2707.
00000020:00000040:12.0:1773851903.891817:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000d3bc059d : new refcount 4
00000100:00000001:12.0:1773851903.891818:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:14.0:1773851903.891822:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x27d TN_EVENT_TX_OK event status 0
00000400:00000200:14.0:1773851903.891824:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:14.0:1773851903.891825:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23682@kfi7: PUT: OK
00000400:00000200:14.0:1773851903.891826:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f51b28f0
00000400:00000010:14.0:1773851903.891827:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f51b28f0.
00000100:00000001:14.0:1773851903.891828:0:2514739:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851903.891828:0:2514739:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:14.0:1773851903.891829:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b7c4433b nid 23682@kfi7 refs 2
00000800:00000200:14.0:1773851903.891830:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004f3fa634: 2069@kfi7:3 -> 23682@kfi7(00000000779fe513):0x0 lsk 638 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x27d Transaction freed
00000800:00000200:9.0:1773851903.910092:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851903.910093:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851903.910095:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851903.910099:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851903.910102:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18304@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.910104:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18304@kfi7 : PUT - for me
00000400:00000200:9.0:1773851903.910105:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18304@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.910107:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071860699 nid 18304@kfi7 refs 1
00000400:00000200:9.0:1773851903.910108:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18304@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.910109:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071860699 nid 18304@kfi7 refs 2
00000400:00000200:9.0:1773851903.910111:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000071860699 nid 18304@kfi7 refs 3
00000400:00000200:9.0:1773851903.910112:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18304@kfi7 to cpt 2
00000400:00000200:9.0:1773851903.910114:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18304@kfi7 of length 224 into portal 12 MB=0x69b0a05ac5080
00000400:00000200:9.0:1773851903.910116:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18304@kfi7 of length 224/224 into md 0x78146ce49 [64] + 168912
00000800:00000200:9.0:1773851903.910119:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851903.910122:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851903.910124:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18304@kfi7: PUT: OK
00000100:00000001:9.0:1773851903.910125:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851903.910126:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851903.910127:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c686a39b.
00000100:00000040:9.0:1773851903.910128:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000c686a39b x1859317207421056 msgsize 224
00000100:00100000:9.0:1773851903.910131:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-18304@kfi7 (source: 12345-18304@kfi7)
00000100:00000001:9.0:1773851903.910133:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851903.910134:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000071860699 nid 18304@kfi7 refs 2
00000100:00000001:11.0:1773851903.910135:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851903.910136:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851903.910137:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851903.910137:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851903.910138:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851903.910139:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851903.910140:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317207421056
00000020:00000001:11.0:1773851903.910141:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851903.910142:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91fd5
00000020:00000001:11.0:1773851903.910143:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851903.910148:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e953d29d refcount=6
00000020:00000001:11.0:1773851903.910149:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629267456 : -107123080284160 : ffff9e9276da3800)
00000020:00000001:11.0:1773851903.910150:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629267456 : -107123080284160 : ffff9e9276da3800)
00000100:00000001:11.0:1773851903.910151:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851903.910153:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851903.910154:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006dc7c85.
00000020:00000010:11.0:1773851903.910156:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851903.910157:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851903.910158:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851903.910159:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851903.910160:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851903.910162:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851903.910162:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851903.910163:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.910165:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851903.910167:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851903.910167:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851903.910168:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851903.910168:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851903.910169:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18304@kfi7, seq: 2130896
00000100:00000040:11.0:1773851903.910171:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e953d29d : new rpc_count 1
00000100:00000001:8.0:1773851903.910171:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851903.910172:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.910173:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498326016 : -106953211225600 : ffff9eba03d65a00)
00000100:00000040:11.0:1773851903.910175:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c686a39b x1859317207421056/t0(0) o400->7ab41b3c-ab7c-4fb9-8f74-dc6193954110@18304@kfi7:630/0 lens 224/0 e 0 to 0 dl 1773851990 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1636-0'
00000100:00000001:11.0:1773851903.910180:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851903.910180:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851903.910182:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c686a39b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7ab41b3c-ab7c-4fb9-8f74-dc6193954110+6:39741:x1859317207421056:12345-18304@kfi7:400:default-tuolumne1636-0
00000100:00000200:11.0:1773851903.910184:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317207421056
00000020:00000001:11.0:1773851903.910185:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851903.910186:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851903.910187:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.910188:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851903.910189:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851903.910190:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851903.910191:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317207421056, found 0 last_xid 1859317207421055
00000020:00000001:11.0:1773851903.910193:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851903.910194:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851903.910194:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851903.910195:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.910196:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851903.910197:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851903.910198:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851903.910199:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e5966cd2.
02000000:00000001:11.0:1773851903.910200:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.910201:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.910202:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851903.910203:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182413746207, transno 0, xid 1859317207421056
00010000:00000001:11.0:1773851903.910204:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851903.910206:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c686a39b x1859317207421056/t0(0) o400->7ab41b3c-ab7c-4fb9-8f74-dc6193954110@18304@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1636-0'
00010000:00000001:11.0:1773851903.910210:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851903.910211:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851903.910212:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=136 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851903.910214:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851903.910216:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009fdc3e62 refcount 3 to 18304@kfi7
00000100:00000001:11.0:1773851903.910217:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899610080 : -107146809941536 : ffff9e8cf07461e0)
02000000:00000001:11.0:1773851903.910218:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851903.910219:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851903.910220:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851903.910222:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18304@kfi7
00000400:00000010:11.0:1773851903.910223:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000841fb28d.
00000100:00000200:11.0:1773851903.910224:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317207421056, offset 224
00000400:00000200:11.0:1773851903.910226:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18304@kfi7
00000400:00000200:11.0:1773851903.910228:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18304@kfi7 to cpt 2
00000400:00000200:11.0:1773851903.910229:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000071860699 nid 18304@kfi7 refs 1
00000400:00000200:11.0:1773851903.910231:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000071860699 nid 18304@kfi7 refs 2
00000400:00000200:11.0:1773851903.910233:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000071860699 nid 18304@kfi7 refs 3
00000400:00000200:11.0:1773851903.910235:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18304@kfi7 local destination
00000400:00000200:11.0:1773851903.910237:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770497:8770497:1024:4294967295] 18304@kfi7 LPNI seq info [211340:211340:16:4294967295]
00000400:00000200:11.0:1773851903.910240:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000071860699 nid 18304@kfi7 refs 2
00000400:00000200:11.0:1773851903.910241:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18304@kfi7 to cpt 2
00000400:00000200:11.0:1773851903.910244:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18304@kfi7(18304@kfi7:18304@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851903.910246:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000071860699 nid 18304@kfi7 refs 3
00000800:00000200:11.0:1773851903.910249:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851903.910250:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851903.910254:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851903.910258:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x147 Using peer 18304@kfi7(0x147)
00000800:00000200:11.0:1773851903.910262:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000eff95f77: Posted send of 324 bytes to peer 0x147: rc=0
00000800:00000200:11.0:1773851903.910265:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x147 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851903.910268:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851903.910270:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009fdc3e62 refcount 2 to 18304@kfi7
00010000:00000001:11.0:1773851903.910271:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851903.910272:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851903.910273:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851903.910274:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c686a39b x1859317207421056/t0(0) o400->7ab41b3c-ab7c-4fb9-8f74-dc6193954110@18304@kfi7:630/0 lens 224/224 e 0 to 0 dl 1773851990 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1636-0'
00000800:00000200:9.0:1773851903.910279:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x147 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851903.910280:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c686a39b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:7ab41b3c-ab7c-4fb9-8f74-dc6193954110+6:39741:x1859317207421056:12345-18304@kfi7:400:default-tuolumne1636-0 Request processed in 99us (150us total) trans 0 rc 0/0
00000400:00000200:9.0:1773851903.910282:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851903.910283:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18304@kfi7, seq: 2130896
00000400:00000200:9.0:1773851903.910283:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18304@kfi7: PUT: OK
00000400:00000200:9.0:1773851903.910284:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000841fb28d
00000100:00000040:11.0:1773851903.910285:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e953d29d : new rpc_count 0
00000400:00000010:9.0:1773851903.910285:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000841fb28d.
00000100:00000001:11.0:1773851903.910286:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:9.0:1773851903.910286:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:11.0:1773851903.910287:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851903.910287:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851903.910288:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851903.910288:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000071860699 nid 18304@kfi7 refs 2
00000020:00000010:11.0:1773851903.910289:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000020:00000010:11.0:1773851903.910290:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006dc7c85.
00000020:00000040:11.0:1773851903.910291:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000e953d29d : new refcount 5
00000800:00000200:9.0:1773851903.910291:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000eff95f77: 2069@kfi7:2 -> 18304@kfi7(00000000c8ec3059):0x0 lsk 328 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x147 Transaction freed
00000100:00000001:11.0:1773851903.910292:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:6.0:1773851903.923811:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851903.923811:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:6.0:1773851903.923812:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851903.923812:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:6.0:1773851903.923813:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851903.923813:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:6.0:1773851903.923815:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:5.0:1773851903.923815:0:2507993:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 19969@kfi7(0000000055589ee7):0x7bb version: 2; local version 2; negotiated version: 2
00000400:00000200:6.0:1773851903.923817:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19969@kfi7 to cpt 1
00000800:00000200:5.0:1773851903.923817:0:2507993:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb Using peer 19969@kfi7(0x1000000000007bb)
00000400:00000200:6.0:1773851903.923819:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19969@kfi7 : PUT - for me
00000400:00000200:5.0:1773851903.923819:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19969@kfi7 to cpt 1
00000400:00000200:6.0:1773851903.923820:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19969@kfi7 to cpt 1
00000800:00000200:5.0:1773851903.923820:0:2507993:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 38 bytes to peer 0x1000000000007bb: rc=0
00000400:00000200:6.0:1773851903.923821:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fff49e1a nid 19969@kfi7 refs 1
00000400:00000200:6.0:1773851903.923822:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19969@kfi7 to cpt 1
00000800:00000200:5.0:1773851903.923822:0:2507993:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851903.923823:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fff49e1a nid 19969@kfi7 refs 2
00000400:00000200:6.0:1773851903.923824:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000fff49e1a nid 19969@kfi7 refs 3
00000400:00000200:6.0:1773851903.923825:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20161@kfi7 to cpt 4
00000400:00000200:6.0:1773851903.923826:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20161@kfi7 of length 456 into portal 12 MB=0x69b81c0327380
00000400:00000200:6.0:1773851903.923828:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20161@kfi7 of length 456/456 into md 0x793926dc5 [64] + 169576
00000800:00000200:6.0:1773851903.923830:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851903.923832:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851903.923833:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19969@kfi7: PUT: OK
00000800:00000200:5.0:1773851903.923834:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb TN_EVENT_TX_OK event status 0
00000100:00000001:6.0:1773851903.923835:0:2499722:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:6.0:1773851903.923836:0:2499722:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:5.0:1773851903.923836:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb Transaction freed
00000100:00000010:6.0:1773851903.923837:0:2499722:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000095bd404b.
00000100:00000040:6.0:1773851903.923838:0:2499722:0:(events.c:358:request_in_callback()) incoming req@0000000095bd404b x1859831437882240 msgsize 456
00000100:00100000:6.0:1773851903.923839:0:2499722:0:(events.c:361:request_in_callback()) peer: 12345-20161@kfi7 (source: 12345-19969@kfi7)
00000100:00000001:6.0:1773851903.923840:0:2499722:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:6.0:1773851903.923841:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000fff49e1a nid 19969@kfi7 refs 2
00000100:00000001:4.0:1773851903.923842:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851903.923842:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:6.0:1773851903.923843:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2054@kfi7:1 <- 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851903.923843:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851903.923843:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851903.923844:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851903.923845:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859831437882240
00000020:00000001:4.0:1773851903.923846:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851903.923846:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce43c84
00000020:00000001:4.0:1773851903.923847:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851903.923847:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a11167e7 refcount=5
00000020:00000001:4.0:1773851903.923848:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637141258093568 : -106932451458048 : ffff9ebed9374400)
00000020:00000001:4.0:1773851903.923850:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637141258093568 : -106932451458048 : ffff9ebed9374400)
00000100:00000001:4.0:1773851903.923850:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851903.923851:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851903.923852:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b1f45ba0.
00000020:00000010:4.0:1773851903.923853:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851903.923854:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d85801b.
00000100:00000001:4.0:1773851903.923855:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851903.923855:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851903.923855:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.923856:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.923857:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851903.923858:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851903.923859:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851903.923859:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851903.923859:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851903.923860:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20161@kfi7, seq: 371100854
00000100:00000001:7.0:1773851903.923861:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851903.923861:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.923861:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a11167e7 : new rpc_count 1
00000100:00000001:4.0:1773851903.923861:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637025359407232 : -107048350144384 : ffff9ea3dd1da880)
00000100:00000040:4.0:1773851903.923862:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000095bd404b x1859831437882240/t0(0) o17->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:630/0 lens 456/0 e 0 to 0 dl 1773851990 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1747-0'
00000100:00000001:4.0:1773851903.923865:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851903.923866:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851903.923867:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000095bd404b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7+5:39650:x1859831437882240:12345-20161@kfi7:17:default-tuolumne1747-0
00000100:00000200:4.0:1773851903.923868:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859831437882240
00000020:00000001:4.0:1773851903.923869:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851903.923869:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851903.923870:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.923871:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851903.923871:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:4.0:1773851903.923872:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851903.923873:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859831437882240, found 0 last_xid 1859831437882239
00000020:00000001:4.0:1773851903.923874:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851903.923875:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851903.923875:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851903.923876:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851903.923877:0:60963:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:4.0:1773851903.923878:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851903.923878:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851903.923879:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000002e351634.
02000000:00000001:4.0:1773851903.923879:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.923880:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.923881:0:60963:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:4.0:1773851903.923881:0:60963:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:4.0:1773851903.923882:0:60963:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:4.0:1773851903.923883:0:60963:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.923884:0:60963:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:4.0:1773851903.923885:0:60963:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7/00000000a11167e7 free: 126633370845184 avail: 126633368748032
00000020:00000001:4.0:1773851903.923886:0:60963:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:4.0:1773851903.923886:0:60963:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7/00000000a11167e7 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:4.0:1773851903.923888:0:60963:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:4.0:1773851903.923889:0:60963:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:4.0:1773851903.923889:0:60963:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7/00000000a11167e7 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:4.0:1773851903.923890:0:60963:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:4.0:1773851903.923891:0:60963:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:4.0:1773851903.923891:0:60963:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851903.923892:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096691390, transno 0, xid 1859831437882240
00010000:00000001:4.0:1773851903.923893:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851903.923894:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000095bd404b x1859831437882240/t0(0) o17->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:630/0 lens 456/432 e 0 to 0 dl 1773851990 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1747-0'
00010000:00000001:4.0:1773851903.923896:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851903.923896:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851903.923897:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=135 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851903.923898:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851903.923899:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f7aa4622 refcount 3 to 20161@kfi7
00000100:00000001:4.0:1773851903.923899:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583515840 : -107156126035776 : ffff9e8ac52c10c0)
02000000:00000001:4.0:1773851903.923901:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851903.923902:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851903.923902:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851903.923903:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19969@kfi7
00000400:00000010:4.0:1773851903.923904:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001d5c2697.
00000100:00000200:4.0:1773851903.923905:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859831437882240, offset 224
00000400:00000200:4.0:1773851903.923906:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19969@kfi7
00000400:00000200:4.0:1773851903.923907:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19969@kfi7 to cpt 1
00000400:00000200:4.0:1773851903.923908:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000fff49e1a nid 19969@kfi7 refs 1
00000400:00000200:4.0:1773851903.923909:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000fff49e1a nid 19969@kfi7 refs 2
00000400:00000200:4.0:1773851903.923910:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000fff49e1a nid 19969@kfi7 refs 3
00000400:00000200:4.0:1773851903.923911:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19969@kfi7 local destination
00000400:00000200:4.0:1773851903.923913:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770498:8770498:1024:4294967295] 19969@kfi7 LPNI seq info [7476288:7476288:16:4294967295]
00000400:00000200:4.0:1773851903.923914:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000fff49e1a nid 19969@kfi7 refs 2
00000400:00000200:4.0:1773851903.923915:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19969@kfi7 to cpt 1
00000400:00000200:4.0:1773851903.923917:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19969@kfi7(19969@kfi7:19969@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851903.923918:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000fff49e1a nid 19969@kfi7 refs 3
00000800:00000200:4.0:1773851903.923919:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851903.923920:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:4.0:1773851903.923923:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851903.923925:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb Using peer 19969@kfi7(0x1000000000007bb)
00000800:00000200:4.0:1773851903.923928:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 532 bytes to peer 0x1000000000007bb: rc=0
00000800:00000200:4.0:1773851903.923930:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851903.923932:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851903.923933:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f7aa4622 refcount 2 to 20161@kfi7
00010000:00000001:4.0:1773851903.923933:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851903.923934:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851903.923935:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851903.923936:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000095bd404b x1859831437882240/t0(0) o17->e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7@20161@kfi7:630/0 lens 456/432 e 0 to 0 dl 1773851990 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1747-0'
00000100:00100000:4.0:1773851903.923940:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000095bd404b pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:e9e5f6a6-f042-4b43-b0a1-ccec5735c3b7+5:39650:x1859831437882240:12345-20161@kfi7:17:default-tuolumne1747-0 Request processed in 74us (102us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851903.923943:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20161@kfi7, seq: 371100854
00000100:00000040:4.0:1773851903.923944:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a11167e7 : new rpc_count 0
00000100:00000001:4.0:1773851903.923944:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851903.923945:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851903.923945:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851903.923946:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d85801b.
00000020:00000010:4.0:1773851903.923947:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b1f45ba0.
00000020:00000040:4.0:1773851903.923948:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000a11167e7 : new refcount 4
00000100:00000001:4.0:1773851903.923948:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851903.923953:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851903.923955:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851903.923955:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19969@kfi7: PUT: OK
00000400:00000200:5.0:1773851903.923956:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001d5c2697
00000400:00000010:5.0:1773851903.923957:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001d5c2697.
00000100:00000001:5.0:1773851903.923957:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851903.923958:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851903.923959:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000fff49e1a nid 19969@kfi7 refs 2
00000800:00000200:5.0:1773851903.923960:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2054@kfi7:1 -> 19969@kfi7(0000000055589ee7):0x0 lsk 1980 rsk 40 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007bb Transaction freed
00000800:00000200:1.0:1773851903.997202:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851903.997203:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851903.997204:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851903.997207:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851903.997209:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.997210:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11473@kfi7 : PUT - for me
00000400:00000200:1.0:1773851903.997211:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.997212:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 1
00000400:00000200:1.0:1773851903.997213:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.997214:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000400:00000200:1.0:1773851903.997214:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 3
00000400:00000200:1.0:1773851903.997215:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:1.0:1773851903.997216:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11473@kfi7 of length 224 into portal 12 MB=0x69b472e7d8f00
00000400:00000200:1.0:1773851903.997218:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11473@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 58160
00000800:00000200:1.0:1773851903.997219:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851903.997221:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851903.997222:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11473@kfi7: PUT: OK
00000100:00000001:1.0:1773851903.997223:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851903.997223:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851903.997224:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005079e4ce.
00000100:00000040:1.0:1773851903.997225:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000005079e4ce x1859579885227776 msgsize 224
00000100:00100000:1.0:1773851903.997226:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-11473@kfi7 (source: 12345-11473@kfi7)
00000100:00000001:1.0:1773851903.997227:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851903.997228:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000100:00000001:0.0:1773851903.997228:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851903.997229:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851903.997229:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851903.997229:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851903.997230:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851903.997231:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851903.997232:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859579885227776
00000020:00000001:0.0:1773851903.997232:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851903.997233:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3f5217
00000020:00000001:0.0:1773851903.997234:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851903.997235:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009272c87b refcount=5
00000020:00000001:0.0:1773851903.997236:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636964372225024 : -107109337326592 : ffff9e95a9ff1c00)
00000020:00000001:0.0:1773851903.997237:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636964372225024 : -107109337326592 : ffff9e95a9ff1c00)
00000100:00000001:0.0:1773851903.997238:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851903.997239:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851903.997240:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000877d5ffd.
00000020:00000010:0.0:1773851903.997241:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851903.997242:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851903.997243:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851903.997243:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851903.997244:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851903.997245:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851903.997246:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851903.997246:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.997247:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851903.997248:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.997248:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851903.997248:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851903.997249:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851903.997249:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11473@kfi7, seq: 1997647
00000100:00000001:2.0:1773851903.997250:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851903.997250:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851903.997250:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009272c87b : new rpc_count 1
00000100:00000001:0.0:1773851903.997250:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327713152 : -106982381838464 : ffff9eb339221f80)
00000100:00000040:0.0:1773851903.997252:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005079e4ce x1859579885227776/t0(0) o400->12e8f0ce-8486-4b90-a323-2801d5f5b55c@11473@kfi7:543/0 lens 224/0 e 0 to 0 dl 1773852658 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1201-0'
00000100:00000001:0.0:1773851903.997254:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851903.997254:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851903.997255:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005079e4ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:12e8f0ce-8486-4b90-a323-2801d5f5b55c+5:39830:x1859579885227776:12345-11473@kfi7:400:default-tuolumne1201-0
00000100:00000200:0.0:1773851903.997256:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859579885227776
00000020:00000001:0.0:1773851903.997257:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851903.997257:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851903.997258:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.997259:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851903.997259:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851903.997260:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851903.997260:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859579885227776, found 0 last_xid 1859579885227775
00000020:00000001:0.0:1773851903.997261:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851903.997262:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851903.997262:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851903.997263:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.997264:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851903.997264:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851903.997265:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851903.997266:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a1900a8a.
02000000:00000001:0.0:1773851903.997267:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.997267:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.997268:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851903.997269:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183254359119, transno 0, xid 1859579885227776
00010000:00000001:0.0:1773851903.997270:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851903.997270:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005079e4ce x1859579885227776/t0(0) o400->12e8f0ce-8486-4b90-a323-2801d5f5b55c@11473@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1201-0'
00010000:00000001:0.0:1773851903.997273:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851903.997273:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851903.997274:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=136 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851903.997275:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851903.997275:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f3115979 refcount 3 to 11473@kfi7
00000100:00000001:0.0:1773851903.997276:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958005536 : -107146751546080 : ffff9e8cf3ef6d20)
02000000:00000001:0.0:1773851903.997276:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851903.997277:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851903.997277:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851903.997278:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11473@kfi7
00000400:00000010:0.0:1773851903.997279:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005abdc8a1.
00000100:00000200:0.0:1773851903.997279:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859579885227776, offset 224
00000400:00000200:0.0:1773851903.997281:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11473@kfi7
00000400:00000200:0.0:1773851903.997281:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:0.0:1773851903.997282:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 1
00000400:00000200:0.0:1773851903.997283:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000400:00000200:0.0:1773851903.997284:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 3
00000400:00000200:0.0:1773851903.997285:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11473@kfi7 local destination
00000400:00000200:0.0:1773851903.997286:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770499:8770499:1024:4294967295] 11473@kfi7 LPNI seq info [8828671:8828671:16:4294967295]
00000400:00000200:0.0:1773851903.997287:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000400:00000200:0.0:1773851903.997288:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11473@kfi7 to cpt 0
00000400:00000200:0.0:1773851903.997290:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11473@kfi7(11473@kfi7:11473@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851903.997291:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 3
00000800:00000200:0.0:1773851903.997292:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851903.997293:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851903.997295:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851903.997297:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000758 Using peer 11473@kfi7(0x100000000000758)
00000800:00000200:0.0:1773851903.997300:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005de39e87: Posted send of 324 bytes to peer 0x100000000000758: rc=0
00000800:00000200:0.0:1773851903.997301:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000758 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851903.997303:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851903.997303:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f3115979 refcount 2 to 11473@kfi7
00010000:00000001:0.0:1773851903.997304:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851903.997304:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851903.997305:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851903.997306:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005079e4ce x1859579885227776/t0(0) o400->12e8f0ce-8486-4b90-a323-2801d5f5b55c@11473@kfi7:543/0 lens 224/224 e 0 to 0 dl 1773852658 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1201-0'
00000100:00100000:0.0:1773851903.997310:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005079e4ce pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:12e8f0ce-8486-4b90-a323-2801d5f5b55c+5:39830:x1859579885227776:12345-11473@kfi7:400:default-tuolumne1201-0 Request processed in 53us (83us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851903.997312:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11473@kfi7, seq: 1997647
00000100:00000040:0.0:1773851903.997312:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009272c87b : new rpc_count 0
00000100:00000001:0.0:1773851903.997313:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851903.997313:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851903.997314:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851903.997314:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000020:00000010:0.0:1773851903.997315:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000877d5ffd.
00000020:00000040:0.0:1773851903.997316:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000009272c87b : new refcount 4
00000100:00000001:0.0:1773851903.997316:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851903.997322:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000758 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851903.997323:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851903.997324:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11473@kfi7: PUT: OK
00000400:00000200:1.0:1773851903.997324:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005abdc8a1
00000400:00000010:1.0:1773851903.997325:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005abdc8a1.
00000100:00000001:1.0:1773851903.997326:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851903.997326:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851903.997327:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000086958d6e nid 11473@kfi7 refs 2
00000800:00000200:1.0:1773851903.997328:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005de39e87: 2054@kfi7:0 -> 11473@kfi7(000000009df09e96):0x0 lsk 1881 rsk 14 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000758 Transaction freed
00000800:00000200:30.0:1773851904.033054:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851904.033054:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851904.033056:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851904.033058:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851904.033060:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.033061:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 13219@kfi7 : PUT - for me
00000400:00000200:30.0:1773851904.033062:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.033063:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 1
00000400:00000200:30.0:1773851904.033065:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.033065:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000400:00000200:30.0:1773851904.033066:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 3
00000400:00000200:30.0:1773851904.033067:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13218@kfi7 to cpt 4
00000400:00000200:30.0:1773851904.033068:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13218@kfi7 of length 224 into portal 12 MB=0x699e0fdb3d1c0
00000400:00000200:30.0:1773851904.033070:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13218@kfi7 of length 224/224 into md 0x77fe1859d [64] + 16520
00000800:00000200:30.0:1773851904.033071:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851904.033073:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851904.033074:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13219@kfi7: PUT: OK
00000100:00000001:30.0:1773851904.033075:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851904.033075:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851904.033076:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ad40347c.
00000100:00000040:30.0:1773851904.033077:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000ad40347c x1858041468408256 msgsize 224
00000100:00100000:30.0:1773851904.033078:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-13218@kfi7 (source: 12345-13219@kfi7)
00000100:00000001:30.0:1773851904.033079:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851904.033080:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000100:00000001:28.0:1773851904.033081:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:30.0:1773851904.033082:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2069@kfi7:7 <- 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851904.033082:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851904.033082:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851904.033083:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851904.033084:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.033084:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041468408256
00000020:00000001:28.0:1773851904.033085:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851904.033085:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b28
00000020:00000001:28.0:1773851904.033086:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851904.033090:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009ebe3c23 refcount=6
00000020:00000001:28.0:1773851904.033090:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628016128 : -107123081535488 : ffff9e9276c72000)
00000020:00000001:28.0:1773851904.033091:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628016128 : -107123081535488 : ffff9e9276c72000)
00000100:00000001:28.0:1773851904.033092:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.033094:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851904.033094:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851904.033095:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.033096:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851904.033097:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851904.033097:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851904.033098:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.033099:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851904.033099:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851904.033100:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.033101:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851904.033102:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851904.033102:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851904.033103:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851904.033103:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851904.033104:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13218@kfi7, seq: 2055616
00000100:00000001:31.0:1773851904.033105:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.033105:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.033105:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009ebe3c23 : new rpc_count 1
00000100:00000001:28.0:1773851904.033105:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411245696 : -106960298305920 : ffff9eb85d6a1680)
00000100:00000040:28.0:1773851904.033107:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ad40347c x1858041468408256/t0(0) o400->01e626c5-180f-4eb8-9637-473270a7b169@13218@kfi7:692/0 lens 224/0 e 0 to 0 dl 1773852052 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1308-0'
00000100:00000001:28.0:1773851904.033109:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.033110:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851904.033111:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ad40347c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:01e626c5-180f-4eb8-9637-473270a7b169+6:39673:x1858041468408256:12345-13218@kfi7:400:default-tuolumne1308-0
00000100:00000200:28.0:1773851904.033112:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041468408256
00000020:00000001:28.0:1773851904.033113:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851904.033114:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851904.033114:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.033115:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851904.033115:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851904.033116:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851904.033117:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041468408256, found 0 last_xid 1858041468408255
00000020:00000001:28.0:1773851904.033118:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851904.033118:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851904.033119:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851904.033119:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.033120:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851904.033121:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851904.033121:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851904.033122:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000d477a307.
02000000:00000001:28.0:1773851904.033123:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.033123:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.033124:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851904.033125:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693316, transno 0, xid 1858041468408256
00010000:00000001:28.0:1773851904.033126:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851904.033126:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ad40347c x1858041468408256/t0(0) o400->01e626c5-180f-4eb8-9637-473270a7b169@13218@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1308-0'
00010000:00000001:28.0:1773851904.033129:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851904.033129:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851904.033130:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=137 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851904.033131:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851904.033132:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000ead4c652 refcount 3 to 13218@kfi7
00000100:00000001:28.0:1773851904.033132:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583518048 : -107156126033568 : ffff9e8ac52c1960)
02000000:00000001:28.0:1773851904.033133:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851904.033134:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.033134:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851904.033135:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13219@kfi7
00000400:00000010:28.0:1773851904.033135:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000032756c42.
00000100:00000200:28.0:1773851904.033137:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041468408256, offset 224
00000400:00000200:28.0:1773851904.033138:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13219@kfi7
00000400:00000200:28.0:1773851904.033139:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.033140:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 1
00000400:00000200:28.0:1773851904.033141:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000400:00000200:28.0:1773851904.033142:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 3
00000400:00000200:28.0:1773851904.033143:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  13219@kfi7 local destination
00000400:00000200:28.0:1773851904.033145:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770500:8770500:1024:4294967295] 13219@kfi7 LPNI seq info [5760225:5760225:16:4294967295]
00000400:00000200:28.0:1773851904.033146:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000400:00000200:28.0:1773851904.033147:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13219@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.033149:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 13219@kfi7(13219@kfi7:13219@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851904.033151:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 3
00000800:00000200:28.0:1773851904.033152:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851904.033153:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851904.033156:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851904.033158:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1151 Using peer 13219@kfi7(0x1151)
00000800:00000200:28.0:1773851904.033161:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000752ebe64: Posted send of 324 bytes to peer 0x1151: rc=0
00000800:00000200:28.0:1773851904.033163:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1151 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851904.033165:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.033166:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000ead4c652 refcount 2 to 13218@kfi7
00010000:00000001:28.0:1773851904.033166:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851904.033167:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.033167:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851904.033168:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ad40347c x1858041468408256/t0(0) o400->01e626c5-180f-4eb8-9637-473270a7b169@13218@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1308-0'
00000100:00100000:28.0:1773851904.033172:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ad40347c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:01e626c5-180f-4eb8-9637-473270a7b169+6:39673:x1858041468408256:12345-13218@kfi7:400:default-tuolumne1308-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851904.033175:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13218@kfi7, seq: 2055616
00000100:00000040:28.0:1773851904.033175:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009ebe3c23 : new rpc_count 0
00000100:00000001:28.0:1773851904.033176:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851904.033177:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851904.033177:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.033178:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851904.033179:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851904.033179:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000009ebe3c23 : new refcount 5
00000100:00000001:28.0:1773851904.033180:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851904.033185:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1151 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851904.033187:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.033188:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->13219@kfi7: PUT: OK
00000400:00000200:29.0:1773851904.033189:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000032756c42
00000400:00000010:29.0:1773851904.033189:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000032756c42.
00000100:00000001:29.0:1773851904.033190:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851904.033191:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851904.033192:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002e6352d0 nid 13219@kfi7 refs 2
00000800:00000200:29.0:1773851904.033193:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000752ebe64: 2069@kfi7:7 -> 13219@kfi7(0000000035394d2d):0x0 lsk 4434 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1151 Transaction freed
00000800:00000200:15.0:1773851904.048979:0:2513974:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851904.048979:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:15.0:1773851904.048980:0:2513974:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851904.048980:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:15.0:1773851904.048982:0:2513974:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851904.048982:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:15.0:1773851904.048984:0:2513974:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:13.0:1773851904.048984:0:2514888:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9521@kfi7(00000000cfa03182):0xee1 version: 2; local version 2; negotiated version: 2
00000400:00000200:15.0:1773851904.048986:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9521@kfi7 to cpt 3
00000800:00000200:13.0:1773851904.048986:0:2514888:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 Using peer 9521@kfi7(0x100000000000ee1)
00000400:00000200:15.0:1773851904.048987:0:2513974:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9521@kfi7 : PUT - for me
00000400:00000200:15.0:1773851904.048988:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9521@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.048988:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9521@kfi7 to cpt 3
00000400:00000200:15.0:1773851904.048990:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069e3493f nid 9521@kfi7 refs 1
00000800:00000200:13.0:1773851904.048990:0:2514888:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000af8ff251: Posted send of 38 bytes to peer 0x100000000000ee1: rc=0
00000400:00000200:15.0:1773851904.048991:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9521@kfi7 to cpt 3
00000400:00000200:15.0:1773851904.048992:0:2513974:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069e3493f nid 9521@kfi7 refs 2
00000800:00000200:13.0:1773851904.048992:0:2514888:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:15.0:1773851904.048993:0:2513974:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000069e3493f nid 9521@kfi7 refs 3
00000400:00000200:15.0:1773851904.048994:0:2513974:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9712@kfi7 to cpt 3
00000400:00000200:15.0:1773851904.048995:0:2513974:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9712@kfi7 of length 224 into portal 12 MB=0x69aa079e03540
00000400:00000200:15.0:1773851904.048996:0:2513974:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9712@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 64160
00000800:00000200:15.0:1773851904.048998:0:2513974:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:15.0:1773851904.048999:0:2513974:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:15.0:1773851904.049000:0:2513974:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9521@kfi7: PUT: OK
00000100:00000001:15.0:1773851904.049001:0:2513974:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:15.0:1773851904.049002:0:2513974:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:15.0:1773851904.049003:0:2513974:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000af15af77.
00000100:00000040:15.0:1773851904.049003:0:2513974:0:(events.c:358:request_in_callback()) incoming req@00000000af15af77 x1858863890445632 msgsize 224
00000100:00100000:15.0:1773851904.049005:0:2513974:0:(events.c:361:request_in_callback()) peer: 12345-9712@kfi7 (source: 12345-9521@kfi7)
00000800:00000200:13.0:1773851904.049005:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 TN_EVENT_TX_OK event status 0
00000100:00000001:15.0:1773851904.049006:0:2513974:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:15.0:1773851904.049007:0:2513974:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000069e3493f nid 9521@kfi7 refs 2
00000800:00000200:13.0:1773851904.049007:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 Transaction freed
00000100:00000001:12.0:1773851904.049007:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851904.049008:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:15.0:1773851904.049009:0:2513974:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000007bd95d26: 2054@kfi7:3 <- 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851904.049009:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851904.049009:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851904.049010:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851904.049011:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858863890445632
00000020:00000001:12.0:1773851904.049012:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851904.049012:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92a5c
00000020:00000001:12.0:1773851904.049012:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851904.049017:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000102562a3 refcount=6
00000020:00000001:12.0:1773851904.049018:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743437312 : -107128966114304 : ffff9e9118079400)
00000020:00000001:12.0:1773851904.049018:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743437312 : -107128966114304 : ffff9e9118079400)
00000100:00000001:12.0:1773851904.049019:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851904.049020:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851904.049021:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c0ce2707.
00000020:00000010:12.0:1773851904.049022:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851904.049022:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851904.049023:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851904.049024:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851904.049024:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851904.049025:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851904.049026:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851904.049026:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.049027:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851904.049028:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851904.049029:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851904.049029:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851904.049029:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:12.0:1773851904.049030:0:60487:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9712@kfi7, seq: 2289956
00000100:00000001:14.0:1773851904.049031:0:60824:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851904.049031:0:60824:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851904.049031:0:60487:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000102562a3 : new rpc_count 1
00000100:00000001:12.0:1773851904.049031:0:60487:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127732684672 : -106945976866944 : ffff9ebbb309e780)
00000100:00000040:12.0:1773851904.049033:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000af15af77 x1858863890445632/t0(0) o400->533fe074-1855-4dcb-8168-79a229472317@9712@kfi7:631/0 lens 224/0 e 0 to 0 dl 1773851991 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1085-0'
00000100:00000001:12.0:1773851904.049035:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851904.049035:0:60487:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:12.0:1773851904.049036:0:60487:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000af15af77 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:533fe074-1855-4dcb-8168-79a229472317+6:39146:x1858863890445632:12345-9712@kfi7:400:default-tuolumne1085-0
00000100:00000200:12.0:1773851904.049038:0:60487:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858863890445632
00000020:00000001:12.0:1773851904.049039:0:60487:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:12.0:1773851904.049039:0:60487:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:12.0:1773851904.049040:0:60487:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851904.049041:0:60487:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:12.0:1773851904.049041:0:60487:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:12.0:1773851904.049042:0:60487:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:12.0:1773851904.049043:0:60487:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858863890445632, found 0 last_xid 1858863890445631
00000020:00000001:12.0:1773851904.049043:0:60487:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:12.0:1773851904.049044:0:60487:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:12.0:1773851904.049044:0:60487:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:12.0:1773851904.049045:0:60487:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851904.049046:0:60487:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:12.0:1773851904.049046:0:60487:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:12.0:1773851904.049047:0:60487:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:12.0:1773851904.049048:0:60487:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a66af2a4.
02000000:00000001:12.0:1773851904.049048:0:60487:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.049049:0:60487:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851904.049050:0:60487:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:12.0:1773851904.049050:0:60487:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180510530908, transno 0, xid 1858863890445632
00010000:00000001:12.0:1773851904.049051:0:60487:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:12.0:1773851904.049052:0:60487:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000af15af77 x1858863890445632/t0(0) o400->533fe074-1855-4dcb-8168-79a229472317@9712@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1085-0'
00010000:00000001:12.0:1773851904.049054:0:60487:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:12.0:1773851904.049055:0:60487:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851904.049056:0:60487:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=137 v=66 (1 1 1 1)
00000100:00000001:12.0:1773851904.049056:0:60487:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:12.0:1773851904.049057:0:60487:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002673c990 refcount 3 to 9712@kfi7
00000100:00000001:12.0:1773851904.049058:0:60487:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916642470048 : -107157067081568 : ffff9e8a8d14d8a0)
02000000:00000001:12.0:1773851904.049059:0:60487:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:12.0:1773851904.049059:0:60487:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.049060:0:60487:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:12.0:1773851904.049061:0:60487:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9521@kfi7
00000400:00000010:12.0:1773851904.049061:0:60487:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006af2a73b.
00000100:00000200:12.0:1773851904.049062:0:60487:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858863890445632, offset 224
00000400:00000200:12.0:1773851904.049064:0:60487:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9521@kfi7
00000400:00000200:12.0:1773851904.049066:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9521@kfi7 to cpt 3
00000400:00000200:12.0:1773851904.049068:0:60487:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000069e3493f nid 9521@kfi7 refs 1
00000400:00000200:12.0:1773851904.049070:0:60487:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000069e3493f nid 9521@kfi7 refs 2
00000400:00000200:12.0:1773851904.049072:0:60487:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000069e3493f nid 9521@kfi7 refs 3
00000400:00000200:12.0:1773851904.049074:0:60487:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9521@kfi7 local destination
00000400:00000200:12.0:1773851904.049075:0:60487:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770501:8770501:1024:4294967295] 9521@kfi7 LPNI seq info [17522:17522:16:4294967295]
00000400:00000200:12.0:1773851904.049078:0:60487:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000069e3493f nid 9521@kfi7 refs 2
00000400:00000200:12.0:1773851904.049079:0:60487:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9521@kfi7 to cpt 3
00000400:00000200:12.0:1773851904.049082:0:60487:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9521@kfi7(9521@kfi7:9521@kfi7) <?> : PUT try# 0
00000400:00000200:12.0:1773851904.049084:0:60487:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000069e3493f nid 9521@kfi7 refs 3
00000800:00000200:12.0:1773851904.049087:0:60487:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:12.0:1773851904.049089:0:60487:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:12.0:1773851904.049092:0:60487:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851904.049096:0:60487:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 Using peer 9521@kfi7(0x100000000000ee1)
00000800:00000200:12.0:1773851904.049100:0:60487:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x100000000000ee1: rc=0
00000800:00000200:12.0:1773851904.049103:0:60487:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851904.049106:0:60487:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:12.0:1773851904.049107:0:60487:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002673c990 refcount 2 to 9712@kfi7
00010000:00000001:12.0:1773851904.049110:0:60487:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:12.0:1773851904.049111:0:60487:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:12.0:1773851904.049112:0:60487:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:12.0:1773851904.049113:0:60487:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000af15af77 x1858863890445632/t0(0) o400->533fe074-1855-4dcb-8168-79a229472317@9712@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1085-0'
00000100:00100000:12.0:1773851904.049119:0:60487:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000af15af77 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_018:533fe074-1855-4dcb-8168-79a229472317+6:39146:x1858863890445632:12345-9712@kfi7:400:default-tuolumne1085-0 Request processed in 82us (114us total) trans 0 rc 0/0
00000100:00100000:12.0:1773851904.049127:0:60487:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9712@kfi7, seq: 2289956
00000100:00000040:12.0:1773851904.049128:0:60487:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000102562a3 : new rpc_count 0
00000100:00000001:12.0:1773851904.049129:0:60487:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:12.0:1773851904.049130:0:60487:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:12.0:1773851904.049131:0:60487:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851904.049132:0:60487:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000020:00000010:12.0:1773851904.049134:0:60487:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c0ce2707.
00000020:00000040:12.0:1773851904.049135:0:60487:0:(genops.c:882:class_export_put()) PUTting export 00000000102562a3 : new refcount 5
00000100:00000001:12.0:1773851904.049136:0:60487:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851904.049145:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 TN_EVENT_TX_OK event status 0
00000400:00000200:13.0:1773851904.049148:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851904.049150:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9521@kfi7: PUT: OK
00000400:00000200:13.0:1773851904.049152:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006af2a73b
00000400:00000010:13.0:1773851904.049152:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006af2a73b.
00000100:00000001:13.0:1773851904.049154:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851904.049155:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851904.049156:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000069e3493f nid 9521@kfi7 refs 2
00000800:00000200:13.0:1773851904.049158:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 9521@kfi7(00000000cfa03182):0x0 lsk 3810 rsk 48 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000ee1 Transaction freed
00000800:00000200:5.0:1773851904.114219:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851904.114220:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851904.114221:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851904.114223:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851904.114225:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:5.0:1773851904.114227:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11002@kfi7 : PUT - for me
00000400:00000200:5.0:1773851904.114228:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:5.0:1773851904.114228:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 1
00000400:00000200:5.0:1773851904.114229:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:5.0:1773851904.114230:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000400:00000200:5.0:1773851904.114231:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 3
00000400:00000200:5.0:1773851904.114232:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:5.0:1773851904.114233:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11002@kfi7 of length 224 into portal 12 MB=0x699de8cc30300
00000400:00000200:5.0:1773851904.114234:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11002@kfi7 of length 224/224 into md 0x793926dc5 [64] + 170032
00000800:00000200:5.0:1773851904.114236:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851904.114238:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851904.114239:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11002@kfi7: PUT: OK
00000100:00000001:5.0:1773851904.114240:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851904.114241:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851904.114241:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ed35718a.
00000100:00000040:5.0:1773851904.114242:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ed35718a x1858030983643904 msgsize 224
00000100:00100000:5.0:1773851904.114244:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-11002@kfi7 (source: 12345-11002@kfi7)
00000100:00000001:5.0:1773851904.114245:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851904.114246:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000100:00000001:4.0:1773851904.114246:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:5.0:1773851904.114247:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
02000000:00000001:4.0:1773851904.114247:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851904.114247:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851904.114248:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851904.114248:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851904.114249:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030983643904
00000020:00000001:4.0:1773851904.114250:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851904.114250:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911d5
00000020:00000001:4.0:1773851904.114251:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851904.114253:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000102b8067 refcount=6
00000020:00000001:4.0:1773851904.114254:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240545280 : -107152469006336 : ffff9e8b9f25e800)
00000020:00000001:4.0:1773851904.114254:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240545280 : -107152469006336 : ffff9e8b9f25e800)
00000100:00000001:4.0:1773851904.114255:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851904.114256:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851904.114256:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b1f45ba0.
00000020:00000010:4.0:1773851904.114257:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851904.114258:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d85801b.
00000100:00000001:4.0:1773851904.114259:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851904.114260:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851904.114261:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851904.114262:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851904.114262:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851904.114263:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851904.114264:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851904.114265:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851904.114265:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:7.0:1773851904.114266:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:4.0:1773851904.114266:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11002@kfi7, seq: 2002012
00000100:00000001:7.0:1773851904.114267:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:4.0:1773851904.114267:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000102b8067 : new rpc_count 1
00000100:00000001:4.0:1773851904.114267:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113837098624 : -106959872452992 : ffff9eb876cc1680)
00000100:00000001:7.0:1773851904.114268:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851904.114269:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851904.114269:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ed35718a x1858030983643904/t0(0) o400->8b9ddf22-0076-4a43-bae0-8966102e80ab@11002@kfi7:631/0 lens 224/0 e 0 to 0 dl 1773851991 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne211-0'
00000100:00000001:4.0:1773851904.114271:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851904.114272:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851904.114272:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ed35718a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8b9ddf22-0076-4a43-bae0-8966102e80ab+6:47810:x1858030983643904:12345-11002@kfi7:400:default-tuolumne211-0
00000100:00000200:4.0:1773851904.114274:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030983643904
00000020:00000001:4.0:1773851904.114274:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851904.114275:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851904.114276:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.114276:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851904.114277:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851904.114278:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851904.114278:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030983643904, found 0 last_xid 1858030983643903
00000020:00000001:4.0:1773851904.114279:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851904.114280:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851904.114280:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851904.114281:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.114281:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851904.114282:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851904.114282:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851904.114283:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000060f2dc04.
02000000:00000001:4.0:1773851904.114283:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851904.114285:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.114286:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851904.114286:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030983643904
00010000:00000001:4.0:1773851904.114287:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851904.114288:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ed35718a x1858030983643904/t0(0) o400->8b9ddf22-0076-4a43-bae0-8966102e80ab@11002@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne211-0'
00010000:00000001:4.0:1773851904.114290:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851904.114290:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851904.114291:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=136 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851904.114292:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851904.114293:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003ea4911a refcount 3 to 11002@kfi7
00000100:00000001:4.0:1773851904.114293:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921094244896 : -107152615306720 : ffff9e8b966d8a20)
02000000:00000001:4.0:1773851904.114294:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851904.114295:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851904.114295:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851904.114296:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11002@kfi7
00000400:00000010:4.0:1773851904.114297:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000615c4c0e.
00000100:00000200:4.0:1773851904.114298:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030983643904, offset 224
00000400:00000200:4.0:1773851904.114299:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11002@kfi7
00000400:00000200:4.0:1773851904.114300:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:4.0:1773851904.114300:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 1
00000400:00000200:4.0:1773851904.114301:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000400:00000200:4.0:1773851904.114302:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 3
00000400:00000200:4.0:1773851904.114303:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11002@kfi7 local destination
00000400:00000200:4.0:1773851904.114305:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770502:8770502:1024:4294967295] 11002@kfi7 LPNI seq info [28073:28073:16:4294967295]
00000400:00000200:4.0:1773851904.114306:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000400:00000200:4.0:1773851904.114307:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11002@kfi7 to cpt 1
00000400:00000200:4.0:1773851904.114309:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11002@kfi7(11002@kfi7:11002@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851904.114310:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 3
00000800:00000200:4.0:1773851904.114311:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851904.114312:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851904.114316:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851904.114319:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 Using peer 11002@kfi7(0x5a4)
00000800:00000200:4.0:1773851904.114321:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000000081d0e7: Posted send of 324 bytes to peer 0x5a4: rc=0
00000800:00000200:4.0:1773851904.114323:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851904.114325:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851904.114326:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003ea4911a refcount 2 to 11002@kfi7
00010000:00000001:4.0:1773851904.114326:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851904.114327:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.114328:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851904.114328:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ed35718a x1858030983643904/t0(0) o400->8b9ddf22-0076-4a43-bae0-8966102e80ab@11002@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne211-0'
00000100:00100000:4.0:1773851904.114333:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ed35718a pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:8b9ddf22-0076-4a43-bae0-8966102e80ab+6:47810:x1858030983643904:12345-11002@kfi7:400:default-tuolumne211-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851904.114335:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11002@kfi7, seq: 2002012
00000100:00000040:4.0:1773851904.114336:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000102b8067 : new rpc_count 0
00000100:00000001:4.0:1773851904.114337:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851904.114337:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851904.114338:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851904.114338:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d85801b.
00000020:00000010:4.0:1773851904.114339:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b1f45ba0.
00000020:00000040:4.0:1773851904.114340:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000102b8067 : new refcount 5
00000100:00000001:4.0:1773851904.114341:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851904.114345:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851904.114347:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851904.114348:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11002@kfi7: PUT: OK
00000400:00000200:5.0:1773851904.114349:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000615c4c0e
00000400:00000010:5.0:1773851904.114350:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000615c4c0e.
00000100:00000001:5.0:1773851904.114350:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851904.114351:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851904.114352:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a3b34d36 nid 11002@kfi7 refs 2
00000800:00000200:5.0:1773851904.114353:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000000081d0e7: 2069@kfi7:1 -> 11002@kfi7(00000000ba05bb5a):0x0 lsk 1445 rsk 132 tsk 0 trmk 0 tmk 0 trr 1 tta 0x5a4 Transaction freed
00000800:00000200:29.0:1773851904.115265:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851904.115266:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851904.115267:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851904.115269:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851904.115271:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.115272:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15075@kfi7 : PUT - for me
00000400:00000200:29.0:1773851904.115274:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.115274:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 1
00000400:00000200:29.0:1773851904.115276:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.115276:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000400:00000200:29.0:1773851904.115277:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 3
00000400:00000200:29.0:1773851904.115278:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.115279:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15075@kfi7 of length 224 into portal 12 MB=0x69b4b57487cc0
00000400:00000200:29.0:1773851904.115280:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15075@kfi7 of length 224/224 into md 0x77fe1859d [64] + 16744
00000800:00000200:29.0:1773851904.115282:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851904.115283:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.115284:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15075@kfi7: PUT: OK
00000100:00000001:29.0:1773851904.115285:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851904.115286:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851904.115287:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000007dfdb61.
00000100:00000040:29.0:1773851904.115288:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000007dfdb61 x1859597749484736 msgsize 224
00000100:00100000:29.0:1773851904.115289:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-15075@kfi7 (source: 12345-15075@kfi7)
00000100:00000001:29.0:1773851904.115290:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851904.115291:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000100:00000001:28.0:1773851904.115291:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851904.115292:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851904.115292:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851904.115293:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851904.115293:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851904.115294:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.115295:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597749484736
00000020:00000001:28.0:1773851904.115295:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851904.115296:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7e862
00000020:00000001:28.0:1773851904.115296:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851904.115300:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000962fe2ad refcount=5
00000020:00000001:28.0:1773851904.115301:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157024034816 : -106916685516800 : ffff9ec284f07000)
00000020:00000001:28.0:1773851904.115302:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157024034816 : -106916685516800 : ffff9ec284f07000)
00000100:00000001:28.0:1773851904.115303:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.115304:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851904.115304:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851904.115305:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.115306:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851904.115307:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851904.115307:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851904.115308:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.115309:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851904.115309:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851904.115310:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.115310:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.115311:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851904.115312:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851904.115312:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851904.115312:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851904.115313:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15075@kfi7, seq: 2055617
00000100:00000001:31.0:1773851904.115314:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.115314:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.115314:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000962fe2ad : new rpc_count 1
00000100:00000001:28.0:1773851904.115314:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405320704 : -106994304230912 : ffff9eb07280da00)
00000100:00000040:28.0:1773851904.115315:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000007dfdb61 x1859597749484736/t0(0) o400->898c8171-d161-4e53-b143-d9fcdd253bcf@15075@kfi7:692/0 lens 224/0 e 0 to 0 dl 1773852052 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1419-0'
00000100:00000001:28.0:1773851904.115318:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.115318:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851904.115319:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000007dfdb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:898c8171-d161-4e53-b143-d9fcdd253bcf+5:39759:x1859597749484736:12345-15075@kfi7:400:default-tuolumne1419-0
00000100:00000200:28.0:1773851904.115322:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597749484736
00000020:00000001:28.0:1773851904.115323:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851904.115323:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851904.115324:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.115325:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851904.115325:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851904.115326:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851904.115326:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597749484736, found 0 last_xid 1859597749484735
00000020:00000001:28.0:1773851904.115327:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851904.115328:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851904.115328:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851904.115329:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.115329:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851904.115330:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851904.115330:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851904.115331:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002a949be8.
02000000:00000001:28.0:1773851904.115331:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.115332:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.115333:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851904.115333:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096689997, transno 0, xid 1859597749484736
00010000:00000001:28.0:1773851904.115334:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851904.115335:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000007dfdb61 x1859597749484736/t0(0) o400->898c8171-d161-4e53-b143-d9fcdd253bcf@15075@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1419-0'
00010000:00000001:28.0:1773851904.115337:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851904.115337:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851904.115338:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=137 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851904.115339:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851904.115340:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002b5a77c4 refcount 3 to 15075@kfi7
00000100:00000001:28.0:1773851904.115340:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869932480 : -107137839619136 : ffff9e8f0720a3c0)
02000000:00000001:28.0:1773851904.115341:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851904.115342:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.115342:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851904.115343:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15075@kfi7
00000400:00000010:28.0:1773851904.115344:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000081660f45.
00000100:00000200:28.0:1773851904.115345:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597749484736, offset 224
00000400:00000200:28.0:1773851904.115346:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15075@kfi7
00000400:00000200:28.0:1773851904.115347:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.115348:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 1
00000400:00000200:28.0:1773851904.115349:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000400:00000200:28.0:1773851904.115350:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 3
00000400:00000200:28.0:1773851904.115351:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15075@kfi7 local destination
00000400:00000200:28.0:1773851904.115352:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770503:8770503:1024:4294967295] 15075@kfi7 LPNI seq info [217612:217612:16:4294967295]
00000400:00000200:28.0:1773851904.115354:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000400:00000200:28.0:1773851904.115354:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15075@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.115356:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15075@kfi7(15075@kfi7:15075@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851904.115357:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 3
00000800:00000200:28.0:1773851904.115358:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851904.115360:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851904.115361:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851904.115363:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008cf Using peer 15075@kfi7(0x1000000000008cf)
00000800:00000200:28.0:1773851904.115366:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x1000000000008cf: rc=0
00000800:00000200:28.0:1773851904.115367:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008cf TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851904.115369:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.115370:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002b5a77c4 refcount 2 to 15075@kfi7
00010000:00000001:28.0:1773851904.115371:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851904.115371:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.115372:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851904.115372:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000007dfdb61 x1859597749484736/t0(0) o400->898c8171-d161-4e53-b143-d9fcdd253bcf@15075@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1419-0'
00000100:00100000:28.0:1773851904.115376:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000007dfdb61 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:898c8171-d161-4e53-b143-d9fcdd253bcf+5:39759:x1859597749484736:12345-15075@kfi7:400:default-tuolumne1419-0 Request processed in 56us (86us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851904.115379:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15075@kfi7, seq: 2055617
00000100:00000040:28.0:1773851904.115379:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000962fe2ad : new rpc_count 0
00000100:00000001:28.0:1773851904.115380:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851904.115380:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851904.115381:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.115382:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851904.115382:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851904.115383:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000962fe2ad : new refcount 4
00000100:00000001:28.0:1773851904.115383:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851904.115390:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008cf TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851904.115391:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.115392:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15075@kfi7: PUT: OK
00000400:00000200:29.0:1773851904.115393:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000081660f45
00000400:00000010:29.0:1773851904.115394:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000081660f45.
00000100:00000001:29.0:1773851904.115394:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851904.115395:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851904.115396:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000341b7ea2 nid 15075@kfi7 refs 2
00000800:00000200:29.0:1773851904.115397:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2054@kfi7:7 -> 15075@kfi7(000000003941e4c4):0x0 lsk 2256 rsk 5 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008cf Transaction freed
00010000:00000001:2.0:1773851904.137730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137731:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851904.137732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851904.137733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851904.137734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851904.137735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851904.137736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851904.137737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851904.137738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851904.137738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:29.0:1773851904.137744:0:937835:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:29.0:1773851904.137745:0:937835:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:29.0:1773851904.137745:0:937835:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00080000:00000001:30.0:1773851904.177345:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851904.177346:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851904.177373:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851904.177374:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851904.177399:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851904.177400:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851904.177425:0:2142466:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:30.0:1773851904.177426:0:2142466:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:30.0:1773851904.177586:0:2142466:0:(lnet_debugfs.c:228:proc_lnet_routes()) alloc '(tmpstr)': 256 at 000000008a71a94e (tot 253204019).
00000400:00000010:30.0:1773851904.177588:0:2142466:0:(lnet_debugfs.c:324:proc_lnet_routes()) kfreed 'tmpstr': 256 at 000000008a71a94e (tot 253203763).
00000004:00000001:29.0:1773851904.329734:0:42325:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:25.0:1773851904.329734:0:42315:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:29.0:1773851904.329735:0:42325:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:25.0:1773851904.329735:0:42315:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:25.0:1773851904.329736:0:42315:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066d07729.
00000100:00000010:29.0:1773851904.329737:0:42325:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000720bfc57.
00000020:00000040:25.0:1773851904.329737:0:42315:0:(genops.c:1094:class_import_get()) import 00000000280dc0a4 refcount=8 obd=lustre5-OST0004-osc-MDT0001
00000020:00000040:29.0:1773851904.329738:0:42325:0:(genops.c:1094:class_import_get()) import 00000000629158da refcount=5 obd=lustre5-OST0009-osc-MDT0001
00000100:00000001:25.0:1773851904.329738:0:42315:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:29.0:1773851904.329740:0:42325:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:29.0:1773851904.329741:0:42325:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:29.0:1773851904.329742:0:42325:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851904.329744:0:42325:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000006cf400e0.
00000100:00000001:29.0:1773851904.329746:0:42325:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851904.329747:0:42325:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:25.0:1773851904.329748:0:42315:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:29.0:1773851904.329749:0:42325:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:25.0:1773851904.329749:0:42315:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:25.0:1773851904.329750:0:42315:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000014a6e7aa.
00000100:00000040:29.0:1773851904.329751:0:42325:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000720bfc57] to pc [ptlrpcd_07_03+3]  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851904.329751:0:42315:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851904.329752:0:42315:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:25.0:1773851904.329752:0:42315:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:25.0:1773851904.329754:0:42315:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000066d07729] to pc [ptlrpcd_06_03+3]  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851904.329758:0:42325:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:25.0:1773851904.329758:0:42315:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:31.0:1773851904.329759:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851904.329760:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851904.329760:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:29.0:1773851904.329760:0:42325:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000007573667.
00080000:00000010:25.0:1773851904.329760:0:42315:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 0000000056c93536.
00000100:00000001:27.0:1773851904.329761:0:41086:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851904.329761:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:25.0:1773851904.329761:0:42315:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637144476103680 : -106929233447936 : ffff9ebf99063400)
00000100:00000040:31.0:1773851904.329762:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:29.0:1773851904.329762:0:42325:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637133201803264 : -106940507748352 : ffff9ebcf9060800)
00000100:00000001:27.0:1773851904.329762:0:41086:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851904.329762:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:25.0:1773851904.329762:0:42315:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:30.0:1773851904.329763:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:29.0:1773851904.329763:0:42325:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:26.0:1773851904.329763:0:41087:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:25.0:1773851904.329763:0:42315:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.329764:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:30.0:1773851904.329764:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:25.0:1773851904.329764:0:42315:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0004-osc-MDT0001: sync forced, 3 changes
00000100:00000001:31.0:1773851904.329765:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851904.329765:0:42325:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851904.329765:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000010:25.0:1773851904.329765:0:42315:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000643115dd.
00000004:00080000:25.0:1773851904.329765:0:42315:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0004-osc-MDT0001: add commit cb at 614178783040938ns, next at 614179783039846ns, rc = 0
02000000:00000001:31.0:1773851904.329766:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:29.0:1773851904.329766:0:42325:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0009-osc-MDT0001: sync forced, 3 changes
00080000:00000001:25.0:1773851904.329766:0:42315:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:31.0:1773851904.329767:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:25.0:1773851904.329767:0:42315:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851904.329768:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000720bfc57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051943488:2090@kfi7:13:default-yuba2-0
00000004:00000010:29.0:1773851904.329768:0:42325:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000da165ac6.
00000004:00000001:25.0:1773851904.329768:0:42315:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.329769:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00080000:29.0:1773851904.329769:0:42325:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0009-osc-MDT0001: add commit cb at 614178783044505ns, next at 614179783042581ns, rc = 0
02000000:00000001:31.0:1773851904.329770:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:31.0:1773851904.329770:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851904.329770:0:42325:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:26.0:1773851904.329770:0:41087:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:31.0:1773851904.329771:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:26.0:1773851904.329771:0:41087:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:29.0:1773851904.329772:0:42325:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851904.329773:0:42325:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851904.329773:0:41087:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000010:31.0:1773851904.329774:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005c322e05.
02000000:00000001:31.0:1773851904.329774:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851904.329774:0:41087:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851904.329775:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00100000:26.0:1773851904.329775:0:41087:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000066d07729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_03:lustre5-MDT0001-mdtlov_UUID:41087:1859433051943552:2068@kfi7:13:default-yuba2-0
00000400:00000010:31.0:1773851904.329776:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000008174bb91.
00000400:00000010:31.0:1773851904.329777:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
00000100:00000001:26.0:1773851904.329777:0:41087:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000200:31.0:1773851904.329778:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943488, portal 4
02000000:00000001:26.0:1773851904.329778:0:41087:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:31.0:1773851904.329779:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
02000000:00000001:26.0:1773851904.329779:0:41087:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.329780:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079405316096 : -106994304235520 : ffff9eb07280c800)
02000000:00000001:26.0:1773851904.329780:0:41087:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:31.0:1773851904.329781:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851904.329783:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000010:26.0:1773851904.329783:0:41087:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000caf8b346.
00000100:00000040:31.0:1773851904.329784:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2090@kfi7
00000400:00000010:31.0:1773851904.329784:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c70e405.
00000100:00000200:31.0:1773851904.329785:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943488, offset 0
02000000:00000001:26.0:1773851904.329785:0:41087:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:31.0:1773851904.329786:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2090@kfi7
00000400:00000200:26.0:1773851904.329786:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000400:00000200:31.0:1773851904.329787:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:31.0:1773851904.329788:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000010:26.0:1773851904.329788:0:41087:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000f00e36c9.
00000400:00000200:31.0:1773851904.329789:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000010:26.0:1773851904.329789:0:41087:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b92c768b.
00000400:00000200:31.0:1773851904.329791:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000100:00000200:26.0:1773851904.329791:0:41087:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943552, portal 4
00000400:00000200:31.0:1773851904.329792:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2090@kfi7 local destination
00000100:00000001:26.0:1773851904.329792:0:41087:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:26.0:1773851904.329793:0:41087:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637137157387520 : -106936552164096 : ffff9ebde4cb7500)
00000400:00000200:31.0:1773851904.329794:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770502, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770503, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851904.329795:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000040:26.0:1773851904.329795:0:41087:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851904.329796:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:31.0:1773851904.329797:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2090@kfi7
00000400:00000200:31.0:1773851904.329798:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770504:8770504:1024:4294967295] 2090@kfi7 LPNI seq info [5404258:5404258:16:4294967295]
00000400:00000200:31.0:1773851904.329800:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:31.0:1773851904.329800:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:26.0:1773851904.329800:0:41087:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:26.0:1773851904.329801:0:41087:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2068@kfi7
00000400:00000010:26.0:1773851904.329802:0:41087:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000909b9a2b.
00000400:00000200:31.0:1773851904.329803:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2090@kfi7(2090@kfi7:2090@kfi7) <?> : PUT try# 0
00000100:00000200:26.0:1773851904.329803:0:41087:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943552, offset 0
00000400:00000200:31.0:1773851904.329804:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000800:00000200:31.0:1773851904.329805:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:26.0:1773851904.329805:0:41087:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2068@kfi7
00000800:00000200:31.0:1773851904.329807:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:26.0:1773851904.329807:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:31.0:1773851904.329809:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:26.0:1773851904.329809:0:41087:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000400:00000200:26.0:1773851904.329810:0:41087:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000800:00000200:31.0:1773851904.329812:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Using peer 2090@kfi7(0x16)
00000400:00000200:26.0:1773851904.329812:0:41087:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:26.0:1773851904.329814:0:41087:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2068@kfi7 local destination
00000800:00000200:31.0:1773851904.329815:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000150f4962: Posted send of 324 bytes to peer 0x16: rc=0
00000800:00000200:31.0:1773851904.329817:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851904.329817:0:41087:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770504, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770503, p:4294967295, g:4294967295, h:1000]
00000100:00000001:31.0:1773851904.329818:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.329819:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851904.329820:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.329820:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851904.329820:0:41087:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000100:00000001:31.0:1773851904.329821:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:26.0:1773851904.329821:0:41087:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:31.0:1773851904.329822:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851904.329822:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:31.0:1773851904.329823:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:26.0:1773851904.329823:0:41087:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2068@kfi7
00000100:00000001:31.0:1773851904.329824:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:31.0:1773851904.329824:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851904.329824:0:41087:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770505:8770505:1024:4294967295] 2068@kfi7 LPNI seq info [5403706:5403706:16:4294967295]
00000100:00000001:31.0:1773851904.329827:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:26.0:1773851904.329827:0:41087:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:26.0:1773851904.329828:0:41087:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000800:00000200:29.0:1773851904.329831:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851904.329832:0:41087:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2068@kfi7(2068@kfi7:2068@kfi7) <?> : PUT try# 0
00000400:00000200:29.0:1773851904.329834:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851904.329834:0:41087:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000400:00000200:29.0:1773851904.329836:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000800:00000200:26.0:1773851904.329836:0:41087:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000400:00000200:29.0:1773851904.329837:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c70e405
00000400:00000010:29.0:1773851904.329838:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c70e405.
00000800:00000200:26.0:1773851904.329838:0:41087:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:29.0:1773851904.329839:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:29.0:1773851904.329840:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:26.0:1773851904.329847:0:41087:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:26.0:1773851904.329852:0:41087:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Using peer 2068@kfi7(0x200000000000177)
00000100:00000001:29.0:1773851904.329856:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:29.0:1773851904.329857:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:26.0:1773851904.329857:0:41087:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 324 bytes to peer 0x200000000000177: rc=0
00000800:00000200:26.0:1773851904.329859:0:41087:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:29.0:1773851904.329862:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851904.329863:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:26.0:1773851904.329863:0:41087:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851904.329864:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000100:00000001:26.0:1773851904.329864:0:41087:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851904.329865:0:41087:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851904.329866:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851904.329867:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000150f4962: 2069@kfi7:7 -> 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x16 Transaction freed
00000100:00000001:26.0:1773851904.329868:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.329869:0:41087:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851904.329870:0:41087:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:25.0:1773851904.329870:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851904.329871:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:1.0:1773851904.329871:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000100:00000001:26.0:1773851904.329872:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:25.0:1773851904.329872:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:1.0:1773851904.329872:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:26.0:1773851904.329873:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851904.329873:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:26.0:1773851904.329874:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:25.0:1773851904.329874:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000909b9a2b
00000400:00000010:25.0:1773851904.329874:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000909b9a2b.
00000800:00000200:1.0:1773851904.329874:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:25.0:1773851904.329875:0:2494371:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:25.0:1773851904.329876:0:2494371:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851904.329878:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:25.0:1773851904.329879:0:2494371:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:25.0:1773851904.329880:0:2494371:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:25.0:1773851904.329882:0:2494371:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851904.329882:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000100:00000001:25.0:1773851904.329883:0:2494371:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:1.0:1773851904.329883:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2090@kfi7 : PUT - for me
00000400:00000200:25.0:1773851904.329885:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000400:00000200:1.0:1773851904.329885:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000800:00000200:25.0:1773851904.329887:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006e71e7e9: 2054@kfi7:6 -> 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 6 tta 0x200000000000177 Transaction freed
00000400:00000200:1.0:1773851904.329887:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 1
00000400:00000200:1.0:1773851904.329888:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.329889:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000200:1.0:1773851904.329891:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 3
00000400:00000200:1.0:1773851904.329892:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.329894:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2090@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7240
00000400:00000200:1.0:1773851904.329896:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2090@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.329898:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2090@kfi7 of length 368/368 into md 0x7fb71e961 [1] + 224
00000800:00000200:1.0:1773851904.329901:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851904.329904:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851904.329906:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2090@kfi7: PUT: OK
00000100:00000001:1.0:1773851904.329907:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:1.0:1773851904.329909:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:1.0:1773851904.329915:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:1.0:1773851904.329921:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851904.329923:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851904.329923:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851904.329923:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000d1ab3ba nid 2090@kfi7 refs 2
00000400:00000001:31.0:1773851904.329924:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851904.329925:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:31.0:1773851904.329925:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000008174bb91.
00000800:00000200:1.0:1773851904.329925:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2090@kfi7(00000000fbbb4e1d):0x0 lsk 23 rsk 4789 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000200:31.0:1773851904.329926:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000400:00000010:31.0:1773851904.329927:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000100:00000001:31.0:1773851904.329928:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000800:00000200:21.0:1773851904.329928:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000200:31.0:1773851904.329929:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851904.329930:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000200:31.0:1773851904.329932:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851904.329932:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:31.0:1773851904.329934:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851904.329935:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851904.329935:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851904.329936:0:41091:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:31.0:1773851904.329936:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:31.0:1773851904.329936:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851904.329937:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851904.329938:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851904.329938:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00001000:31.0:1773851904.329939:0:41091:0:(import.c:1951:at_measured()) add 66 to 000000008a7bd1ab time=137 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851904.329940:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000007c14d560 time=137 v=66 (1 1 1 1)
00000400:00000200:21.0:1773851904.329940:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2068@kfi7 : PUT - for me
00000100:00000001:31.0:1773851904.329941:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:31.0:1773851904.329941:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851904.329941:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00010000:00000001:31.0:1773851904.329942:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:31.0:1773851904.329942:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.329943:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000200:21.0:1773851904.329943:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 1
00000100:00000040:31.0:1773851904.329944:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0009-osc-MDT0001: skip recheck: last_committed 167638342105
00000100:00000001:31.0:1773851904.329944:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:21.0:1773851904.329944:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000001:31.0:1773851904.329945:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:21.0:1773851904.329945:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000040:31.0:1773851904.329946:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:21.0:1773851904.329946:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 3
00000100:00000001:31.0:1773851904.329948:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000200:21.0:1773851904.329948:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000100:00000001:31.0:1773851904.329949:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:21.0:1773851904.329949:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2068@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7280
00000100:00000001:31.0:1773851904.329950:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:31.0:1773851904.329950:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000400:00000200:21.0:1773851904.329951:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2068@kfi7 to cpt 5
00000004:00000040:31.0:1773851904.329952:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0009-osc-MDT0001: Updating status = 0
00000004:00000040:31.0:1773851904.329952:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0009-osc-MDT0001: blocks=410399713280 free=351388963840 avail=351386265600 avail_mb=1372602600 hwm_mb=3131103 files=372018960 ffree=343153285 state=0: rc = 0
00000400:00000200:21.0:1773851904.329953:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2068@kfi7 of length 368/368 into md 0x6a34d2395 [1] + 224
00000004:00000020:31.0:1773851904.329954:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0009-osc-MDT0001 (000000008255fe0a): 410399713280 blocks, 351388963840 free, 351386265600 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372018960 files, 343153285 free files
00000004:00000001:31.0:1773851904.329956:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851904.329956:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000040:31.0:1773851904.329957:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:21.0:1773851904.329958:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851904.329960:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000720bfc57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051943488:2090@kfi7:13:default-yuba2-0
00000400:00000200:21.0:1773851904.329960:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2068@kfi7: PUT: OK
00000100:00000001:31.0:1773851904.329961:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851904.329962:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:21.0:1773851904.329962:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:31.0:1773851904.329963:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000720bfc57 x1859433051943488/t0(0) o13->lustre5-OST0009-osc-MDT0001@2090@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:21.0:1773851904.329963:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851904.329965:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:31.0:1773851904.329966:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851904.329967:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005c322e05.
02000000:00000001:31.0:1773851904.329968:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:31.0:1773851904.329968:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:21.0:1773851904.329968:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000020:00000040:31.0:1773851904.329969:0:41091:0:(genops.c:1107:class_import_put()) import 00000000629158da refcount=4 obd=lustre5-OST0009-osc-MDT0001
00000020:00000001:31.0:1773851904.329970:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851904.329970:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000006cf400e0.
02000000:00000001:31.0:1773851904.329971:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:31.0:1773851904.329972:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851904.329972:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000720bfc57.
00000100:00000001:31.0:1773851904.329973:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:21.0:1773851904.329973:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851904.329974:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851904.329974:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:21.0:1773851904.329974:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000ed7a4ed9 nid 2068@kfi7 refs 2
00000100:00000001:31.0:1773851904.329975:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:31.0:1773851904.329975:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.329976:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851904.329976:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851904.329977:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851904.329977:0:41087:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:21.0:1773851904.329977:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2068@kfi7(0000000045b2e030):0x0 lsk 376 rsk 4792 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000001:26.0:1773851904.329979:0:41087:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:26.0:1773851904.329979:0:41087:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:26.0:1773851904.329981:0:41087:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000f00e36c9.
00000400:00000200:26.0:1773851904.329982:0:41087:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b92c768b
00000400:00000010:26.0:1773851904.329982:0:41087:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b92c768b.
00000100:00000001:26.0:1773851904.329984:0:41087:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:26.0:1773851904.329985:0:41087:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:26.0:1773851904.329991:0:41087:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:26.0:1773851904.329996:0:41087:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:26.0:1773851904.329996:0:41087:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.329997:0:41087:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:26.0:1773851904.329998:0:41087:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:26.0:1773851904.330000:0:41087:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:26.0:1773851904.330001:0:41087:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:26.0:1773851904.330002:0:41087:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:26.0:1773851904.330004:0:41087:0:(import.c:1951:at_measured()) add 66 to 000000004b2cce66 time=137 v=66 (66 66 66 66)
00000100:00001000:26.0:1773851904.330006:0:41087:0:(import.c:1951:at_measured()) add 1 to 00000000dccd972b time=137 v=66 (1 1 1 1)
00000100:00000001:26.0:1773851904.330007:0:41087:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:26.0:1773851904.330008:0:41087:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:26.0:1773851904.330009:0:41087:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:26.0:1773851904.330010:0:41087:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851904.330012:0:41087:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:26.0:1773851904.330012:0:41087:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0004-osc-MDT0001: skip recheck: last_committed 167637045854
00000100:00000001:26.0:1773851904.330013:0:41087:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:26.0:1773851904.330014:0:41087:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851904.330016:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851904.330020:0:41087:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:26.0:1773851904.330021:0:41087:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:26.0:1773851904.330022:0:41087:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:26.0:1773851904.330023:0:41087:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:26.0:1773851904.330025:0:41087:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0004-osc-MDT0001: Updating status = 0
00000004:00000040:26.0:1773851904.330026:0:41087:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0004-osc-MDT0001: blocks=410399710208 free=350958959616 avail=350956924928 avail_mb=1370925488 hwm_mb=3131103 files=371563860 ffree=342733359 state=0: rc = 0
00000004:00000020:26.0:1773851904.330029:0:41087:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0004-osc-MDT0001 (00000000d6fe7e09): 410399710208 blocks, 350958959616 free, 350956924928 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,371563860 files, 342733359 free files
00000004:00000001:26.0:1773851904.330032:0:41087:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:26.0:1773851904.330034:0:41087:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:26.0:1773851904.330038:0:41087:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000066d07729 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_06_03:lustre5-MDT0001-mdtlov_UUID:41087:1859433051943552:2068@kfi7:13:default-yuba2-0
00000100:00000001:26.0:1773851904.330041:0:41087:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.330042:0:41087:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:26.0:1773851904.330043:0:41087:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000066d07729 x1859433051943552/t0(0) o13->lustre5-OST0004-osc-MDT0001@2068@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:26.0:1773851904.330047:0:41087:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:26.0:1773851904.330049:0:41087:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:26.0:1773851904.330050:0:41087:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000caf8b346.
02000000:00000001:26.0:1773851904.330051:0:41087:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:26.0:1773851904.330052:0:41087:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:26.0:1773851904.330053:0:41087:0:(genops.c:1107:class_import_put()) import 00000000280dc0a4 refcount=7 obd=lustre5-OST0004-osc-MDT0001
00000020:00000001:26.0:1773851904.330054:0:41087:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:26.0:1773851904.330055:0:41087:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000014a6e7aa.
02000000:00000001:26.0:1773851904.330056:0:41087:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:26.0:1773851904.330057:0:41087:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:26.0:1773851904.330058:0:41087:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000066d07729.
00000100:00000001:26.0:1773851904.330059:0:41087:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:26.0:1773851904.330060:0:41087:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.330061:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.330062:0:41087:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:26.0:1773851904.330063:0:41087:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851904.330064:0:41087:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:26.0:1773851904.330064:0:41087:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851904.401275:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851904.401276:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851904.401278:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851904.401281:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851904.401285:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.401287:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18683@kfi7 : PUT - for me
00000400:00000200:1.0:1773851904.401288:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.401290:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 1
00000400:00000200:1.0:1773851904.401291:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.401292:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:1.0:1773851904.401294:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000400:00000200:1.0:1773851904.401295:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18682@kfi7 to cpt 5
00000400:00000200:1.0:1773851904.401296:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18682@kfi7 of length 224 into portal 12 MB=0x699dedbdb7100
00000400:00000200:1.0:1773851904.401299:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18682@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 58384
00000800:00000200:1.0:1773851904.401301:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851904.401304:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851904.401305:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18683@kfi7: PUT: OK
00000100:00000001:1.0:1773851904.401306:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851904.401307:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851904.401308:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000bc5f61f0.
00000100:00000040:1.0:1773851904.401309:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000bc5f61f0 x1858032310644992 msgsize 224
00000100:00100000:1.0:1773851904.401312:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-18682@kfi7 (source: 12345-18683@kfi7)
00000100:00000001:1.0:1773851904.401313:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851904.401315:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000100:00000001:0.0:1773851904.401316:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851904.401317:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851904.401317:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851904.401317:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851904.401318:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851904.401319:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851904.401320:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858032310644992
00000020:00000001:0.0:1773851904.401321:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851904.401322:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912df
00000020:00000001:0.0:1773851904.401323:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851904.401327:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005bf31ffe refcount=6
00000020:00000001:0.0:1773851904.401328:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716189184 : -107155993362432 : ffff9e8acd148000)
00000020:00000001:0.0:1773851904.401329:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716189184 : -107155993362432 : ffff9e8acd148000)
00000100:00000001:0.0:1773851904.401331:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851904.401332:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851904.401333:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000877d5ffd.
00000020:00000010:0.0:1773851904.401335:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851904.401336:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851904.401337:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851904.401338:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851904.401339:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851904.401340:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851904.401341:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851904.401341:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.401343:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851904.401345:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851904.401345:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851904.401346:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851904.401346:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851904.401347:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18682@kfi7, seq: 1997648
00000100:00000001:2.0:1773851904.401348:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.401348:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005bf31ffe : new rpc_count 1
00000100:00000001:2.0:1773851904.401349:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.401349:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327706240 : -106982381845376 : ffff9eb339220480)
00000100:00000040:0.0:1773851904.401351:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000bc5f61f0 x1858032310644992/t0(0) o400->ab453a19-f80c-4fd4-8fd5-40b713ca1db7@18682@kfi7:544/0 lens 224/0 e 0 to 0 dl 1773852659 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne241-0'
00000100:00000001:0.0:1773851904.401355:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851904.401356:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851904.401357:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000bc5f61f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:ab453a19-f80c-4fd4-8fd5-40b713ca1db7+6:47622:x1858032310644992:12345-18682@kfi7:400:default-tuolumne241-0
00000100:00000200:0.0:1773851904.401359:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858032310644992
00000020:00000001:0.0:1773851904.401360:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851904.401361:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851904.401362:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.401363:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851904.401363:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851904.401365:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851904.401366:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858032310644992, found 0 last_xid 1858032310644991
00000020:00000001:0.0:1773851904.401367:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851904.401368:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851904.401369:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851904.401370:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.401371:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851904.401372:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851904.401373:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851904.401376:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000277e6325.
02000000:00000001:0.0:1773851904.401377:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.401378:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.401379:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851904.401380:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858032310644992
00010000:00000001:0.0:1773851904.401381:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851904.401382:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000bc5f61f0 x1858032310644992/t0(0) o400->ab453a19-f80c-4fd4-8fd5-40b713ca1db7@18682@kfi7:544/0 lens 224/224 e 0 to 0 dl 1773852659 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne241-0'
00010000:00000001:0.0:1773851904.401386:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851904.401387:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851904.401388:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=137 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851904.401390:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851904.401391:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b964497e refcount 5 to 18682@kfi7
00000100:00000001:0.0:1773851904.401392:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355109952 : -107156354441664 : ffff9e8ab78ede40)
02000000:00000001:0.0:1773851904.401393:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851904.401393:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.401394:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851904.401396:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18683@kfi7
00000400:00000010:0.0:1773851904.401397:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000009e6d8.
00000100:00000200:0.0:1773851904.401398:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858032310644992, offset 224
00000400:00000200:0.0:1773851904.401400:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18683@kfi7
00000400:00000200:0.0:1773851904.401402:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:0.0:1773851904.401403:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 1
00000400:00000200:0.0:1773851904.401404:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:0.0:1773851904.401406:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000400:00000200:0.0:1773851904.401408:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18683@kfi7 local destination
00000400:00000200:0.0:1773851904.401410:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770506:8770506:1024:4294967295] 18683@kfi7 LPNI seq info [28007:28007:16:4294967295]
00000400:00000200:0.0:1773851904.401412:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000400:00000200:0.0:1773851904.401414:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18683@kfi7 to cpt 0
00000400:00000200:0.0:1773851904.401417:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18683@kfi7(18683@kfi7:18683@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851904.401419:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 3
00000800:00000200:0.0:1773851904.401421:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851904.401422:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851904.401426:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851904.401429:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce Using peer 18683@kfi7(0x1000000000004ce)
00000800:00000200:0.0:1773851904.401433:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b94520d5: Posted send of 324 bytes to peer 0x1000000000004ce: rc=0
00000800:00000200:0.0:1773851904.401436:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851904.401438:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.401440:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b964497e refcount 4 to 18682@kfi7
00010000:00000001:0.0:1773851904.401441:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851904.401441:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.401444:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851904.401446:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000bc5f61f0 x1858032310644992/t0(0) o400->ab453a19-f80c-4fd4-8fd5-40b713ca1db7@18682@kfi7:544/0 lens 224/224 e 0 to 0 dl 1773852659 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne241-0'
00000100:00100000:0.0:1773851904.401450:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000bc5f61f0 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:ab453a19-f80c-4fd4-8fd5-40b713ca1db7+6:47622:x1858032310644992:12345-18682@kfi7:400:default-tuolumne241-0 Request processed in 94us (140us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851904.401454:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18682@kfi7, seq: 1997648
00000100:00000040:0.0:1773851904.401455:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005bf31ffe : new rpc_count 0
00000100:00000001:0.0:1773851904.401456:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851904.401457:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851904.401458:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851904.401459:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000020:00000010:0.0:1773851904.401460:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000877d5ffd.
00000020:00000040:0.0:1773851904.401461:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000005bf31ffe : new refcount 5
00000100:00000001:0.0:1773851904.401462:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851904.401470:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851904.401472:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851904.401474:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18683@kfi7: PUT: OK
00000400:00000200:1.0:1773851904.401475:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000009e6d8
00000400:00000010:1.0:1773851904.401476:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000009e6d8.
00000100:00000001:1.0:1773851904.401477:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851904.401478:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851904.401482:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000854a334b nid 18683@kfi7 refs 2
00000800:00000200:1.0:1773851904.401484:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b94520d5: 2054@kfi7:0 -> 18683@kfi7(000000008b42abaa):0x0 lsk 1231 rsk 47 tsk 0 trmk 0 tmk 0 trr 0 tta 0x1000000000004ce Transaction freed
00000800:00000200:29.0:1773851904.411841:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851904.411842:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851904.411843:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851904.411845:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851904.411847:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20963@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.411848:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20963@kfi7 : PUT - for me
00000400:00000200:29.0:1773851904.411849:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20963@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.411850:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f250a0f nid 20963@kfi7 refs 1
00000400:00000200:29.0:1773851904.411851:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20963@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.411852:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f250a0f nid 20963@kfi7 refs 2
00000400:00000200:29.0:1773851904.411852:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004f250a0f nid 20963@kfi7 refs 3
00000400:00000200:29.0:1773851904.411853:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20771@kfi7 to cpt 4
00000400:00000200:29.0:1773851904.411854:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20771@kfi7 of length 224 into portal 12 MB=0x69b4b95e2f400
00000400:00000200:29.0:1773851904.411855:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20771@kfi7 of length 224/224 into md 0x77fe1859d [64] + 16968
00000800:00000200:29.0:1773851904.411857:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851904.411859:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.411859:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20963@kfi7: PUT: OK
00000100:00000001:29.0:1773851904.411860:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851904.411861:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851904.411862:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000025e3f153.
00000100:00000040:29.0:1773851904.411863:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000025e3f153 x1859598799795200 msgsize 224
00000100:00100000:29.0:1773851904.411865:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-20771@kfi7 (source: 12345-20963@kfi7)
00000100:00000001:29.0:1773851904.411865:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851904.411866:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004f250a0f nid 20963@kfi7 refs 2
00000100:00000001:28.0:1773851904.411867:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851904.411868:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851904.411868:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851904.411868:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851904.411868:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851904.411869:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.411870:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598799795200
00000020:00000001:28.0:1773851904.411870:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851904.411871:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e38956bb8
00000020:00000001:28.0:1773851904.411871:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851904.411876:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000188afc38 refcount=5
00000020:00000001:28.0:1773851904.411877:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637065547358208 : -107008162193408 : ffff9ead38812000)
00000020:00000001:28.0:1773851904.411877:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637065547358208 : -107008162193408 : ffff9ead38812000)
00000100:00000001:28.0:1773851904.411878:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.411879:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851904.411880:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851904.411881:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.411881:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851904.411882:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851904.411883:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851904.411883:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.411884:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851904.411884:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851904.411885:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.411886:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851904.411887:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851904.411887:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851904.411888:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851904.411888:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851904.411889:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.411889:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20771@kfi7, seq: 2055618
00000100:00000040:28.0:1773851904.411889:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000188afc38 : new rpc_count 1
00000100:00000001:28.0:1773851904.411890:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405311488 : -106994304240128 : ffff9eb07280b600)
00000100:00000001:31.0:1773851904.411891:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.411891:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000025e3f153 x1859598799795200/t0(0) o400->23a1b59d-c44e-4770-9609-f75151108cda@20771@kfi7:156/0 lens 224/0 e 0 to 0 dl 1773852271 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1787-0'
00000100:00000001:28.0:1773851904.411893:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.411894:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851904.411895:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025e3f153 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:23a1b59d-c44e-4770-9609-f75151108cda+5:39586:x1859598799795200:12345-20771@kfi7:400:default-tuolumne1787-0
00000100:00000200:28.0:1773851904.411896:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598799795200
00000020:00000001:28.0:1773851904.411897:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851904.411897:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851904.411898:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.411898:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851904.411899:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851904.411900:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851904.411900:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598799795200, found 0 last_xid 1859598799795199
00000020:00000001:28.0:1773851904.411901:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851904.411902:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851904.411902:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851904.411903:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.411903:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851904.411904:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851904.411904:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851904.411905:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000085eeb390.
02000000:00000001:28.0:1773851904.411905:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.411906:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.411906:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851904.411907:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693369, transno 0, xid 1859598799795200
00010000:00000001:28.0:1773851904.411908:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851904.411909:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000025e3f153 x1859598799795200/t0(0) o400->23a1b59d-c44e-4770-9609-f75151108cda@20771@kfi7:156/0 lens 224/224 e 0 to 0 dl 1773852271 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1787-0'
00010000:00000001:28.0:1773851904.411913:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851904.411914:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851904.411914:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=137 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851904.411916:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851904.411916:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000090646e32 refcount 3 to 20771@kfi7
00000100:00000001:28.0:1773851904.411917:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583547488 : -107156126004128 : ffff9e8ac52c8c60)
02000000:00000001:28.0:1773851904.411918:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851904.411918:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.411919:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851904.411920:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20963@kfi7
00000400:00000010:28.0:1773851904.411920:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c31df675.
00000100:00000200:28.0:1773851904.411921:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598799795200, offset 224
00000400:00000200:28.0:1773851904.411922:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20963@kfi7
00000400:00000200:28.0:1773851904.411923:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20963@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.411924:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004f250a0f nid 20963@kfi7 refs 1
00000400:00000200:28.0:1773851904.411925:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004f250a0f nid 20963@kfi7 refs 2
00000400:00000200:28.0:1773851904.411926:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004f250a0f nid 20963@kfi7 refs 3
00000400:00000200:28.0:1773851904.411927:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20963@kfi7 local destination
00000400:00000200:28.0:1773851904.411928:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770507:8770507:1024:4294967295] 20963@kfi7 LPNI seq info [259721:259721:16:4294967295]
00000400:00000200:28.0:1773851904.411929:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004f250a0f nid 20963@kfi7 refs 2
00000400:00000200:28.0:1773851904.411930:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20963@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.411932:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20963@kfi7(20963@kfi7:20963@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851904.411933:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004f250a0f nid 20963@kfi7 refs 3
00000800:00000200:28.0:1773851904.411934:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851904.411935:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851904.411937:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851904.411939:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004f9 Using peer 20963@kfi7(0x1000000000004f9)
00000800:00000200:28.0:1773851904.411943:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x1000000000004f9: rc=0
00000800:00000200:28.0:1773851904.411945:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004f9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851904.411947:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.411947:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000090646e32 refcount 2 to 20771@kfi7
00010000:00000001:28.0:1773851904.411948:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851904.411948:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.411949:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851904.411950:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000025e3f153 x1859598799795200/t0(0) o400->23a1b59d-c44e-4770-9609-f75151108cda@20771@kfi7:156/0 lens 224/224 e 0 to 0 dl 1773852271 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1787-0'
00000100:00100000:28.0:1773851904.411954:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025e3f153 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:23a1b59d-c44e-4770-9609-f75151108cda+5:39586:x1859598799795200:12345-20771@kfi7:400:default-tuolumne1787-0 Request processed in 59us (90us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851904.411956:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20771@kfi7, seq: 2055618
00000100:00000040:28.0:1773851904.411957:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000188afc38 : new rpc_count 0
00000100:00000001:28.0:1773851904.411957:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851904.411958:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851904.411958:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.411959:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851904.411960:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851904.411960:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000188afc38 : new refcount 4
00000100:00000001:28.0:1773851904.411961:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851904.411966:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004f9 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851904.411967:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.411968:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20963@kfi7: PUT: OK
00000400:00000200:29.0:1773851904.411969:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c31df675
00000400:00000010:29.0:1773851904.411970:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c31df675.
00000100:00000001:29.0:1773851904.411970:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851904.411971:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851904.411972:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004f250a0f nid 20963@kfi7 refs 2
00000800:00000200:29.0:1773851904.411973:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 20963@kfi7(000000009f4caf91):0x0 lsk 1274 rsk 33 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000004f9 Transaction freed
00000800:00000200:25.0:1773851904.444219:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851904.444220:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851904.444221:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851904.444223:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851904.444225:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851904.444226:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16080@kfi7 : PUT - for me
00000400:00000200:25.0:1773851904.444227:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851904.444228:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 1
00000400:00000200:25.0:1773851904.444228:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:25.0:1773851904.444229:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000400:00000200:25.0:1773851904.444230:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 3
00000400:00000200:25.0:1773851904.444231:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15889@kfi7 to cpt 6
00000400:00000200:25.0:1773851904.444231:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15889@kfi7 of length 456 into portal 12 MB=0x69b4c4b490400
00000400:00000200:25.0:1773851904.444233:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15889@kfi7 of length 456/456 into md 0x16159c9699 [64] + 46064
00000800:00000200:25.0:1773851904.444234:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851904.444236:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851904.444237:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16080@kfi7: PUT: OK
00000100:00000001:25.0:1773851904.444238:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851904.444238:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851904.444239:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ef2c3e33.
00000100:00000040:25.0:1773851904.444240:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ef2c3e33 x1859601843160064 msgsize 456
00000100:00100000:25.0:1773851904.444241:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-15889@kfi7 (source: 12345-16080@kfi7)
00000100:00000001:25.0:1773851904.444242:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851904.444243:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000800:00000200:25.0:1773851904.444245:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851904.444245:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851904.444246:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851904.444246:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851904.444247:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851904.444249:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851904.444250:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601843160064
00000020:00000001:24.0:1773851904.444251:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851904.444252:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e6260b754
00000020:00000001:24.0:1773851904.444253:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851904.444255:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bfe20125 refcount=5
00000020:00000001:24.0:1773851904.444257:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637134943534080 : -106938766017536 : ffff9ebd60d6bc00)
00000020:00000001:24.0:1773851904.444258:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637134943534080 : -106938766017536 : ffff9ebd60d6bc00)
00000100:00000001:24.0:1773851904.444259:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851904.444260:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851904.444261:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000030bb5633.
00000020:00000010:24.0:1773851904.444263:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851904.444264:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851904.444265:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851904.444266:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851904.444267:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.444269:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.444270:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.444273:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851904.444273:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851904.444273:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851904.444274:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851904.444275:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15889@kfi7, seq: 1451911049
00000100:00000001:26.0:1773851904.444276:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851904.444276:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bfe20125 : new rpc_count 1
00000100:00000001:26.0:1773851904.444277:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.444277:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157365632 : -106936552185984 : ffff9ebde4cb1f80)
00000100:00000040:24.0:1773851904.444279:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ef2c3e33 x1859601843160064/t0(0) o17->7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4@15889@kfi7:185/0 lens 456/0 e 0 to 0 dl 1773852300 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1489-0'
00000100:00000001:24.0:1773851904.444289:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851904.444290:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851904.444291:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ef2c3e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4+5:39557:x1859601843160064:12345-15889@kfi7:17:default-tuolumne1489-0
00000100:00000200:24.0:1773851904.444294:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601843160064
00000020:00000001:24.0:1773851904.444295:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851904.444296:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851904.444297:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.444298:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851904.444299:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:24.0:1773851904.444300:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851904.444301:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601843160064, found 0 last_xid 1859601843160063
00000020:00000001:24.0:1773851904.444302:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851904.444303:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851904.444304:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851904.444305:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851904.444306:0:60973:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:24.0:1773851904.444307:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851904.444308:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851904.444310:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000218be579.
02000000:00000001:24.0:1773851904.444311:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.444312:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.444313:0:60973:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:24.0:1773851904.444314:0:60973:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:24.0:1773851904.444315:0:60973:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851904.444317:0:60973:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.444318:0:60973:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:24.0:1773851904.444319:0:60973:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4/00000000bfe20125 free: 126633370845184 avail: 126633368748032
00000020:00000001:24.0:1773851904.444321:0:60973:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:24.0:1773851904.444322:0:60973:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4/00000000bfe20125 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:24.0:1773851904.444324:0:60973:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:24.0:1773851904.444325:0:60973:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:24.0:1773851904.444327:0:60973:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4/00000000bfe20125 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:24.0:1773851904.444328:0:60973:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:24.0:1773851904.444329:0:60973:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:24.0:1773851904.444330:0:60973:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851904.444331:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183154616931, transno 0, xid 1859601843160064
00010000:00000001:24.0:1773851904.444332:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851904.444334:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ef2c3e33 x1859601843160064/t0(0) o17->7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4@15889@kfi7:185/0 lens 456/432 e 0 to 0 dl 1773852300 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1489-0'
00010000:00000001:24.0:1773851904.444338:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851904.444339:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851904.444340:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=137 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851904.444342:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851904.444343:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000f6fb1437 refcount 3 to 15889@kfi7
00000100:00000001:24.0:1773851904.444344:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860608 : -107149578691008 : ffff9e8c4b6c9e40)
02000000:00000001:24.0:1773851904.444346:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851904.444347:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.444348:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851904.444349:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16080@kfi7
00000400:00000010:24.0:1773851904.444350:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000040aa4957.
00000100:00000200:24.0:1773851904.444351:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859601843160064, offset 224
00000400:00000200:24.0:1773851904.444353:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16080@kfi7
00000400:00000200:24.0:1773851904.444355:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:24.0:1773851904.444356:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 1
00000400:00000200:24.0:1773851904.444358:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000400:00000200:24.0:1773851904.444359:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 3
00000400:00000200:24.0:1773851904.444361:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16080@kfi7 local destination
00000400:00000200:24.0:1773851904.444363:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770508:8770508:1024:4294967295] 16080@kfi7 LPNI seq info [4009743:4009743:16:4294967295]
00000400:00000200:24.0:1773851904.444366:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000400:00000200:24.0:1773851904.444367:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16080@kfi7 to cpt 6
00000400:00000200:24.0:1773851904.444370:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16080@kfi7(16080@kfi7:16080@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851904.444372:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 3
00000800:00000200:24.0:1773851904.444375:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851904.444377:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:24.0:1773851904.444381:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851904.444384:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000214 Using peer 16080@kfi7(0x100000000000214)
00000800:00000200:24.0:1773851904.444389:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000008402ee93: Posted send of 532 bytes to peer 0x100000000000214: rc=0
00000800:00000200:24.0:1773851904.444392:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000214 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851904.444395:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851904.444396:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000f6fb1437 refcount 2 to 15889@kfi7
00010000:00000001:24.0:1773851904.444398:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851904.444401:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.444402:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851904.444403:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ef2c3e33 x1859601843160064/t0(0) o17->7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4@15889@kfi7:185/0 lens 456/432 e 0 to 0 dl 1773852300 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1489-0'
00000100:00100000:24.0:1773851904.444408:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ef2c3e33 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:7cb3d0a9-ae06-4d31-ad62-e1ac12d9acf4+5:39557:x1859601843160064:12345-15889@kfi7:17:default-tuolumne1489-0 Request processed in 118us (167us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851904.444412:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15889@kfi7, seq: 1451911049
00000100:00000040:24.0:1773851904.444413:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bfe20125 : new rpc_count 0
00000100:00000001:24.0:1773851904.444414:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851904.444415:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851904.444416:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851904.444417:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851904.444418:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000030bb5633.
00000020:00000040:24.0:1773851904.444420:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000bfe20125 : new refcount 4
00000100:00000001:24.0:1773851904.444421:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851904.444427:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000214 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851904.444429:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851904.444430:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16080@kfi7: PUT: OK
00000400:00000200:25.0:1773851904.444430:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000040aa4957
00000400:00000010:25.0:1773851904.444431:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000040aa4957.
00000100:00000001:25.0:1773851904.444431:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851904.444432:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851904.444433:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b633f9dc nid 16080@kfi7 refs 2
00000800:00000200:25.0:1773851904.444434:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008402ee93: 2054@kfi7:6 -> 16080@kfi7(0000000050f5ba98):0x0 lsk 533 rsk 23 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000214 Transaction freed
00000800:00000200:21.0:1773851904.478515:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851904.478516:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851904.478517:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851904.478519:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851904.478521:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24578@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.478522:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24578@kfi7 : PUT - for me
00000400:00000200:21.0:1773851904.478523:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24578@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.478523:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003f292c1e nid 24578@kfi7 refs 1
00000400:00000200:21.0:1773851904.478524:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24578@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.478525:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003f292c1e nid 24578@kfi7 refs 2
00000400:00000200:21.0:1773851904.478526:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003f292c1e nid 24578@kfi7 refs 3
00000400:00000200:21.0:1773851904.478527:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24578@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.478527:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24578@kfi7 of length 224 into portal 12 MB=0x69b4c3aece200
00000400:00000200:21.0:1773851904.478528:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24578@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 71528
00000800:00000200:21.0:1773851904.478530:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851904.478531:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851904.478532:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24578@kfi7: PUT: OK
00000100:00000001:21.0:1773851904.478533:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851904.478534:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851904.478535:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000074da53e7.
00000100:00000040:21.0:1773851904.478535:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000074da53e7 x1859601568686592 msgsize 224
00000100:00100000:21.0:1773851904.478536:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-24578@kfi7 (source: 12345-24578@kfi7)
00000100:00000001:21.0:1773851904.478537:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851904.478538:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003f292c1e nid 24578@kfi7 refs 2
00000100:00000001:23.0:1773851904.478539:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:23.0:1773851904.478539:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851904.478539:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:23.0:1773851904.478540:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851904.478540:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:23.0:1773851904.478541:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851904.478542:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601568686592
00000020:00000001:23.0:1773851904.478542:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:23.0:1773851904.478543:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff81c19
00000020:00000001:23.0:1773851904.478543:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851904.478549:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b07469aa refcount=5
00000020:00000001:23.0:1773851904.478549:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637111503885312 : -106962205666304 : ffff9eb7ebba1400)
00000020:00000001:23.0:1773851904.478550:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637111503885312 : -106962205666304 : ffff9eb7ebba1400)
00000100:00000001:23.0:1773851904.478551:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851904.478552:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851904.478553:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2fd346c.
00000020:00000010:23.0:1773851904.478554:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851904.478555:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851904.478556:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851904.478556:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851904.478557:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851904.478557:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851904.478559:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851904.478559:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851904.478560:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851904.478562:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851904.478562:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851904.478562:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851904.478562:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:23.0:1773851904.478563:0:61145:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24578@kfi7, seq: 1998097
00000100:00000040:23.0:1773851904.478564:0:61145:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b07469aa : new rpc_count 1
00000100:00000001:20.0:1773851904.478564:0:60934:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851904.478565:0:61145:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313408512 : -106917396143104 : ffff9ec25a952400)
00000100:00000001:20.0:1773851904.478565:0:60934:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851904.478566:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000074da53e7 x1859601568686592/t0(0) o400->f740de4c-b891-45a8-9fc0-104b4b0bae76@24578@kfi7:544/0 lens 224/0 e 0 to 0 dl 1773852659 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2039-0'
00000100:00000001:23.0:1773851904.478569:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851904.478569:0:61145:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:23.0:1773851904.478570:0:61145:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000074da53e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f740de4c-b891-45a8-9fc0-104b4b0bae76+5:39497:x1859601568686592:12345-24578@kfi7:400:default-tuolumne2039-0
00000100:00000200:23.0:1773851904.478572:0:61145:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601568686592
00000020:00000001:23.0:1773851904.478572:0:61145:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:23.0:1773851904.478573:0:61145:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:23.0:1773851904.478573:0:61145:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851904.478574:0:61145:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:23.0:1773851904.478575:0:61145:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:23.0:1773851904.478575:0:61145:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:23.0:1773851904.478576:0:61145:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859601568686592, found 0 last_xid 1859601568686591
00000020:00000001:23.0:1773851904.478577:0:61145:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:23.0:1773851904.478578:0:61145:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:23.0:1773851904.478578:0:61145:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:23.0:1773851904.478579:0:61145:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851904.478579:0:61145:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:23.0:1773851904.478580:0:61145:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:23.0:1773851904.478580:0:61145:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:23.0:1773851904.478581:0:61145:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006cc0fab3.
02000000:00000001:23.0:1773851904.478582:0:61145:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851904.478582:0:61145:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851904.478583:0:61145:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:23.0:1773851904.478584:0:61145:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046795510, transno 0, xid 1859601568686592
00010000:00000001:23.0:1773851904.478585:0:61145:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:23.0:1773851904.478586:0:61145:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000074da53e7 x1859601568686592/t0(0) o400->f740de4c-b891-45a8-9fc0-104b4b0bae76@24578@kfi7:544/0 lens 224/224 e 0 to 0 dl 1773852659 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2039-0'
00010000:00000001:23.0:1773851904.478588:0:61145:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:23.0:1773851904.478588:0:61145:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:23.0:1773851904.478589:0:61145:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=137 v=66 (1 1 1 1)
00000100:00000001:23.0:1773851904.478590:0:61145:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:23.0:1773851904.478591:0:61145:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003f09ac3a refcount 3 to 24578@kfi7
00000100:00000001:23.0:1773851904.478592:0:61145:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402093440 : -107139307458176 : ffff9e8eafa33180)
02000000:00000001:23.0:1773851904.478592:0:61145:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:23.0:1773851904.478593:0:61145:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851904.478594:0:61145:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:23.0:1773851904.478594:0:61145:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24578@kfi7
00000400:00000010:23.0:1773851904.478595:0:61145:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a16c98de.
00000100:00000200:23.0:1773851904.478596:0:61145:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859601568686592, offset 224
00000400:00000200:23.0:1773851904.478597:0:61145:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24578@kfi7
00000400:00000200:23.0:1773851904.478598:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24578@kfi7 to cpt 5
00000400:00000200:23.0:1773851904.478599:0:61145:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003f292c1e nid 24578@kfi7 refs 1
00000400:00000200:23.0:1773851904.478600:0:61145:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003f292c1e nid 24578@kfi7 refs 2
00000400:00000200:23.0:1773851904.478601:0:61145:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003f292c1e nid 24578@kfi7 refs 3
00000400:00000200:23.0:1773851904.478602:0:61145:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24578@kfi7 local destination
00000400:00000200:23.0:1773851904.478603:0:61145:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770509:8770509:1024:4294967295] 24578@kfi7 LPNI seq info [446124:446124:16:4294967295]
00000400:00000200:23.0:1773851904.478605:0:61145:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003f292c1e nid 24578@kfi7 refs 2
00000400:00000200:23.0:1773851904.478605:0:61145:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24578@kfi7 to cpt 5
00000400:00000200:23.0:1773851904.478607:0:61145:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24578@kfi7(24578@kfi7:24578@kfi7) <?> : PUT try# 0
00000400:00000200:23.0:1773851904.478608:0:61145:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003f292c1e nid 24578@kfi7 refs 3
00000800:00000200:23.0:1773851904.478610:0:61145:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:23.0:1773851904.478611:0:61145:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:23.0:1773851904.478613:0:61145:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:23.0:1773851904.478617:0:61145:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x77e Using peer 24578@kfi7(0x77e)
00000800:00000200:23.0:1773851904.478620:0:61145:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 000000004edcc86d: Posted send of 324 bytes to peer 0x77e: rc=0
00000800:00000200:23.0:1773851904.478621:0:61145:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x77e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:23.0:1773851904.478623:0:61145:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:23.0:1773851904.478624:0:61145:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003f09ac3a refcount 2 to 24578@kfi7
00010000:00000001:23.0:1773851904.478625:0:61145:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:23.0:1773851904.478625:0:61145:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:23.0:1773851904.478626:0:61145:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:23.0:1773851904.478626:0:61145:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000074da53e7 x1859601568686592/t0(0) o400->f740de4c-b891-45a8-9fc0-104b4b0bae76@24578@kfi7:544/0 lens 224/224 e 0 to 0 dl 1773852659 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2039-0'
00000100:00100000:23.0:1773851904.478630:0:61145:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000074da53e7 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_090:f740de4c-b891-45a8-9fc0-104b4b0bae76+5:39497:x1859601568686592:12345-24578@kfi7:400:default-tuolumne2039-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:23.0:1773851904.478632:0:61145:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24578@kfi7, seq: 1998097
00000100:00000040:23.0:1773851904.478632:0:61145:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b07469aa : new rpc_count 0
00000100:00000001:23.0:1773851904.478633:0:61145:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:21.0:1773851904.478633:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x77e TN_EVENT_TX_OK event status 0
00000100:00000001:23.0:1773851904.478634:0:61145:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:23.0:1773851904.478634:0:61145:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851904.478635:0:61145:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000400:00000200:21.0:1773851904.478635:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:23.0:1773851904.478636:0:61145:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2fd346c.
00000020:00000040:23.0:1773851904.478636:0:61145:0:(genops.c:882:class_export_put()) PUTting export 00000000b07469aa : new refcount 4
00000400:00000200:21.0:1773851904.478636:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24578@kfi7: PUT: OK
00000400:00000200:21.0:1773851904.478636:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a16c98de
00000100:00000001:23.0:1773851904.478637:0:61145:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:21.0:1773851904.478637:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a16c98de.
00000100:00000001:21.0:1773851904.478638:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851904.478638:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851904.478639:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003f292c1e nid 24578@kfi7 refs 2
00000800:00000200:21.0:1773851904.478640:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004edcc86d: 2069@kfi7:5 -> 24578@kfi7(00000000336b3a99):0x0 lsk 1919 rsk 7 tsk 0 trmk 0 tmk 0 trr 5 tta 0x77e Transaction freed
00000800:00000200:29.0:1773851904.479623:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851904.479624:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851904.479625:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851904.479627:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851904.479629:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.479630:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25089@kfi7 : PUT - for me
00000400:00000200:29.0:1773851904.479631:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.479633:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 1
00000400:00000200:29.0:1773851904.479635:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.479635:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000400:00000200:29.0:1773851904.479636:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 3
00000400:00000200:29.0:1773851904.479637:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25281@kfi7 to cpt 1
00000400:00000200:29.0:1773851904.479638:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25281@kfi7 of length 224 into portal 12 MB=0x69b4b94ba7300
00000400:00000200:29.0:1773851904.479640:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25281@kfi7 of length 224/224 into md 0x77fe1859d [64] + 17192
00000800:00000200:29.0:1773851904.479642:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851904.479643:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.479644:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25089@kfi7: PUT: OK
00000100:00000001:29.0:1773851904.479645:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851904.479645:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851904.479646:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000002c6d032.
00000100:00000040:29.0:1773851904.479647:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000002c6d032 x1859598780363520 msgsize 224
00000100:00100000:29.0:1773851904.479648:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-25281@kfi7 (source: 12345-25089@kfi7)
00000100:00000001:29.0:1773851904.479649:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851904.479650:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000800:00000200:29.0:1773851904.479651:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851904.479651:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851904.479651:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851904.479652:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851904.479652:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851904.479653:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.479653:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598780363520
00000020:00000001:28.0:1773851904.479654:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851904.479654:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389340d5
00000020:00000001:28.0:1773851904.479655:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851904.479658:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000052a470cc refcount=5
00000020:00000001:28.0:1773851904.479661:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637165090483200 : -106908619068416 : ffff9ec465bcac00)
00000020:00000001:28.0:1773851904.479662:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637165090483200 : -106908619068416 : ffff9ec465bcac00)
00000100:00000001:28.0:1773851904.479664:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.479665:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851904.479665:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851904.479666:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.479667:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851904.479668:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851904.479668:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851904.479669:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.479670:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851904.479671:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851904.479671:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.479672:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.479673:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851904.479674:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851904.479674:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851904.479675:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851904.479675:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25281@kfi7, seq: 2055619
00000100:00000040:28.0:1773851904.479675:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000052a470cc : new rpc_count 1
00000100:00000001:31.0:1773851904.479676:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.479676:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405305728 : -106994304245888 : ffff9eb072809f80)
00000100:00000001:31.0:1773851904.479677:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.479677:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000002c6d032 x1859598780363520/t0(0) o400->e4557c0a-c316-4306-b114-a8521041acdb@25281@kfi7:692/0 lens 224/0 e 0 to 0 dl 1773852052 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2067-0'
00000100:00000001:28.0:1773851904.479679:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.479680:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851904.479681:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002c6d032 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e4557c0a-c316-4306-b114-a8521041acdb+5:39564:x1859598780363520:12345-25281@kfi7:400:default-tuolumne2067-0
00000100:00000200:28.0:1773851904.479682:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598780363520
00000020:00000001:28.0:1773851904.479683:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851904.479684:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851904.479684:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.479685:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851904.479686:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851904.479686:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851904.479687:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598780363520, found 0 last_xid 1859598780363519
00000020:00000001:28.0:1773851904.479688:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851904.479689:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851904.479689:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851904.479690:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.479691:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851904.479691:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851904.479691:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851904.479692:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000427ecd1f.
02000000:00000001:28.0:1773851904.479693:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.479693:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.479694:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851904.479694:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 181761069426, transno 0, xid 1859598780363520
00010000:00000001:28.0:1773851904.479695:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851904.479696:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000002c6d032 x1859598780363520/t0(0) o400->e4557c0a-c316-4306-b114-a8521041acdb@25281@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2067-0'
00010000:00000001:28.0:1773851904.479698:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851904.479698:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851904.479699:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=137 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851904.479700:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851904.479701:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a0d6227 refcount 3 to 25281@kfi7
00000100:00000001:28.0:1773851904.479702:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232979424 : -107130476572192 : ffff9e90bdffd1e0)
02000000:00000001:28.0:1773851904.479702:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851904.479703:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.479704:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851904.479705:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25089@kfi7
00000400:00000010:28.0:1773851904.479705:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b417b847.
00000100:00000200:28.0:1773851904.479706:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598780363520, offset 224
00000400:00000200:28.0:1773851904.479708:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25089@kfi7
00000400:00000200:28.0:1773851904.479708:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.479709:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 1
00000400:00000200:28.0:1773851904.479710:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000400:00000200:28.0:1773851904.479712:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 3
00000400:00000200:28.0:1773851904.479713:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25089@kfi7 local destination
00000400:00000200:28.0:1773851904.479714:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770510:8770510:1024:4294967295] 25089@kfi7 LPNI seq info [4081020:4081020:16:4294967295]
00000400:00000200:28.0:1773851904.479716:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000400:00000200:28.0:1773851904.479717:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25089@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.479719:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25089@kfi7(25089@kfi7:25089@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851904.479720:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 3
00000800:00000200:28.0:1773851904.479721:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851904.479722:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851904.479724:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851904.479729:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x436 Using peer 25089@kfi7(0x436)
00000800:00000200:28.0:1773851904.479732:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x436: rc=0
00000800:00000200:28.0:1773851904.479733:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x436 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851904.479736:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.479736:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a0d6227 refcount 2 to 25281@kfi7
00010000:00000001:28.0:1773851904.479737:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851904.479738:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.479739:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851904.479739:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000002c6d032 x1859598780363520/t0(0) o400->e4557c0a-c316-4306-b114-a8521041acdb@25281@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2067-0'
00000100:00100000:28.0:1773851904.479744:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002c6d032 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e4557c0a-c316-4306-b114-a8521041acdb+5:39564:x1859598780363520:12345-25281@kfi7:400:default-tuolumne2067-0 Request processed in 63us (96us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851904.479746:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25281@kfi7, seq: 2055619
00000100:00000040:28.0:1773851904.479747:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000052a470cc : new rpc_count 0
00000100:00000001:28.0:1773851904.479747:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851904.479748:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851904.479749:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.479749:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851904.479750:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851904.479751:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000052a470cc : new refcount 4
00000100:00000001:28.0:1773851904.479752:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851904.479757:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x436 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851904.479758:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.479759:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25089@kfi7: PUT: OK
00000400:00000200:29.0:1773851904.479760:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b417b847
00000400:00000010:29.0:1773851904.479760:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b417b847.
00000100:00000001:29.0:1773851904.479761:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851904.479761:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851904.479762:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e8d8a1da nid 25089@kfi7 refs 2
00000800:00000200:29.0:1773851904.479764:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 25089@kfi7(00000000f14c00da):0x0 lsk 1079 rsk 42 tsk 0 trmk 0 tmk 0 trr 7 tta 0x436 Transaction freed
00000800:00000200:29.0:1773851904.513428:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851904.513428:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851904.513429:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851904.513431:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851904.513433:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.513435:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13266@kfi7 : PUT - for me
00000400:00000200:29.0:1773851904.513435:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.513437:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 1
00000400:00000200:29.0:1773851904.513438:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.513438:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000400:00000200:29.0:1773851904.513439:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 3
00000400:00000200:29.0:1773851904.513440:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.513441:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13266@kfi7 of length 224 into portal 12 MB=0x69a9ddfcbf800
00000400:00000200:29.0:1773851904.513441:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13266@kfi7 of length 224/224 into md 0x77fe1859d [64] + 17416
00000800:00000200:29.0:1773851904.513443:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851904.513444:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.513446:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13266@kfi7: PUT: OK
00000100:00000001:29.0:1773851904.513446:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851904.513447:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851904.513447:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f4ae4484.
00000100:00000040:29.0:1773851904.513448:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000f4ae4484 x1858852715493376 msgsize 224
00000100:00100000:29.0:1773851904.513449:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-13266@kfi7 (source: 12345-13266@kfi7)
00000100:00000001:29.0:1773851904.513450:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851904.513450:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000100:00000001:28.0:1773851904.513451:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851904.513452:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851904.513452:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851904.513452:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851904.513452:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851904.513453:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.513453:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858852715493376
00000020:00000001:28.0:1773851904.513454:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851904.513454:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91532
00000020:00000001:28.0:1773851904.513454:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851904.513460:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e0e0e802 refcount=6
00000020:00000001:28.0:1773851904.513460:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241013248 : -107152468538368 : ffff9e8b9f2d0c00)
00000020:00000001:28.0:1773851904.513461:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241013248 : -107152468538368 : ffff9e8b9f2d0c00)
00000100:00000001:28.0:1773851904.513462:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.513462:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851904.513463:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c3473bf2.
00000020:00000010:28.0:1773851904.513463:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.513464:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851904.513465:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851904.513465:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851904.513465:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.513466:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851904.513466:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851904.513466:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.513467:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.513468:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851904.513468:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851904.513469:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13266@kfi7, seq: 2055620
00000100:00000040:28.0:1773851904.513470:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e0e0e802 : new rpc_count 1
00000100:00000001:28.0:1773851904.513470:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405318400 : -106994304233216 : ffff9eb07280d100)
00000100:00000040:28.0:1773851904.513471:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f4ae4484 x1858852715493376/t0(0) o400->e62f082e-4418-4fb8-9e8e-82115f4489d7@13266@kfi7:692/0 lens 224/0 e 0 to 0 dl 1773852052 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1317-0'
00000100:00000001:28.0:1773851904.513473:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.513474:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851904.513475:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f4ae4484 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e62f082e-4418-4fb8-9e8e-82115f4489d7+6:39564:x1858852715493376:12345-13266@kfi7:400:default-tuolumne1317-0
00000100:00000200:28.0:1773851904.513476:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858852715493376
00000020:00000001:28.0:1773851904.513476:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851904.513477:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851904.513477:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.513478:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851904.513478:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851904.513478:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851904.513479:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858852715493376, found 0 last_xid 1858852715493375
00000020:00000001:28.0:1773851904.513479:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851904.513480:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851904.513480:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851904.513480:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.513481:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851904.513481:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851904.513482:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851904.513482:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001e41aca0.
02000000:00000001:28.0:1773851904.513483:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.513483:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.513484:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851904.513484:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692378, transno 0, xid 1858852715493376
00010000:00000001:28.0:1773851904.513485:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851904.513485:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f4ae4484 x1858852715493376/t0(0) o400->e62f082e-4418-4fb8-9e8e-82115f4489d7@13266@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1317-0'
00010000:00000001:28.0:1773851904.513487:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851904.513488:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851904.513488:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=137 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851904.513489:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851904.513489:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002d9174f8 refcount 3 to 13266@kfi7
00000100:00000001:28.0:1773851904.513490:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412884128 : -107156296667488 : ffff9e8abb006ea0)
02000000:00000001:28.0:1773851904.513490:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851904.513491:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.513492:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851904.513493:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13266@kfi7
00000400:00000010:28.0:1773851904.513493:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000069139332.
00000100:00000200:28.0:1773851904.513494:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858852715493376, offset 224
00000400:00000200:28.0:1773851904.513495:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13266@kfi7
00000400:00000200:28.0:1773851904.513496:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.513497:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 1
00000400:00000200:28.0:1773851904.513498:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000400:00000200:28.0:1773851904.513499:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 3
00000400:00000200:28.0:1773851904.513500:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13266@kfi7 local destination
00000400:00000200:28.0:1773851904.513501:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770511:8770511:1024:4294967295] 13266@kfi7 LPNI seq info [8560215:8560215:16:4294967295]
00000400:00000200:28.0:1773851904.513502:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000400:00000200:28.0:1773851904.513502:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13266@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.513504:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13266@kfi7(13266@kfi7:13266@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851904.513505:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 3
00000800:00000200:28.0:1773851904.513506:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851904.513507:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851904.513509:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851904.513511:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000004d Using peer 13266@kfi7(0x10000000000004d)
00000800:00000200:28.0:1773851904.513513:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x10000000000004d: rc=0
00000800:00000200:28.0:1773851904.513515:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000004d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851904.513516:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.513517:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002d9174f8 refcount 2 to 13266@kfi7
00010000:00000001:28.0:1773851904.513517:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851904.513518:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.513518:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851904.513519:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f4ae4484 x1858852715493376/t0(0) o400->e62f082e-4418-4fb8-9e8e-82115f4489d7@13266@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1317-0'
00000100:00100000:28.0:1773851904.513523:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f4ae4484 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:e62f082e-4418-4fb8-9e8e-82115f4489d7+6:39564:x1858852715493376:12345-13266@kfi7:400:default-tuolumne1317-0 Request processed in 47us (73us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851904.513525:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13266@kfi7, seq: 2055620
00000100:00000040:28.0:1773851904.513525:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e0e0e802 : new rpc_count 0
00000100:00000001:28.0:1773851904.513526:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851904.513526:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851904.513526:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.513527:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851904.513528:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c3473bf2.
00000020:00000040:28.0:1773851904.513528:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000e0e0e802 : new refcount 5
00000100:00000001:28.0:1773851904.513529:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851904.513533:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000004d TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851904.513534:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.513535:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13266@kfi7: PUT: OK
00000400:00000200:29.0:1773851904.513536:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000069139332
00000400:00000010:29.0:1773851904.513536:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000069139332.
00000100:00000001:29.0:1773851904.513537:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851904.513537:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851904.513538:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a4d7716a nid 13266@kfi7 refs 2
00000800:00000200:29.0:1773851904.513539:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 13266@kfi7(0000000040417f95):0x0 lsk 78 rsk 50 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000004d Transaction freed
00000800:00000200:26.0:1773851904.528335:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851904.528336:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851904.528338:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851904.528340:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851904.528342:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:26.0:1773851904.528343:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 19248@kfi7 : PUT - for me
00000400:00000200:26.0:1773851904.528344:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:26.0:1773851904.528345:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 1
00000400:00000200:26.0:1773851904.528346:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:26.0:1773851904.528346:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000400:00000200:26.0:1773851904.528347:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 3
00000400:00000200:26.0:1773851904.528348:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:26.0:1773851904.528350:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19248@kfi7 of length 224 into portal 12 MB=0x699e0940fe000
00000400:00000200:26.0:1773851904.528351:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19248@kfi7 of length 224/224 into md 0x16159c9699 [64] + 46520
00000800:00000200:26.0:1773851904.528353:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851904.528355:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851904.528356:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19248@kfi7: PUT: OK
00000100:00000001:26.0:1773851904.528357:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851904.528357:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851904.528358:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001953a58e.
00000100:00000040:26.0:1773851904.528359:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000001953a58e x1858039696056320 msgsize 224
00000100:00100000:26.0:1773851904.528360:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-19248@kfi7 (source: 12345-19248@kfi7)
00000100:00000001:26.0:1773851904.528361:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851904.528362:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000100:00000001:24.0:1773851904.528363:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851904.528363:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851904.528364:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851904.528364:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851904.528364:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851904.528365:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851904.528366:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858039696056320
00000020:00000001:24.0:1773851904.528367:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851904.528367:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac924e4
00000020:00000001:24.0:1773851904.528368:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851904.528371:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009b6536bf refcount=6
00000020:00000001:24.0:1773851904.528371:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630781952 : -107123078769664 : ffff9e9276f15400)
00000020:00000001:24.0:1773851904.528372:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630781952 : -107123078769664 : ffff9e9276f15400)
00000100:00000001:24.0:1773851904.528373:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851904.528374:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851904.528374:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000030bb5633.
00000020:00000010:24.0:1773851904.528375:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851904.528376:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851904.528377:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851904.528377:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851904.528378:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851904.528379:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851904.528379:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851904.528380:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.528381:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.528382:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851904.528382:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851904.528382:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851904.528382:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851904.528383:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19248@kfi7, seq: 2025200
00000100:00000001:26.0:1773851904.528384:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851904.528384:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851904.528384:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009b6536bf : new rpc_count 1
00000100:00000001:24.0:1773851904.528384:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105767423872 : -106967942127744 : ffff9eb695ce9f80)
00000100:00000040:24.0:1773851904.528386:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001953a58e x1858039696056320/t0(0) o400->583ca5b8-884e-4568-977b-61053f27c332@19248@kfi7:185/0 lens 224/0 e 0 to 0 dl 1773852300 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1693-0'
00000100:00000001:24.0:1773851904.528388:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851904.528388:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851904.528389:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001953a58e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:583ca5b8-884e-4568-977b-61053f27c332+6:39687:x1858039696056320:12345-19248@kfi7:400:default-tuolumne1693-0
00000100:00000200:24.0:1773851904.528390:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858039696056320
00000020:00000001:24.0:1773851904.528391:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851904.528393:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851904.528393:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.528394:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851904.528394:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851904.528395:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851904.528396:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858039696056320, found 0 last_xid 1858039696056319
00000020:00000001:24.0:1773851904.528396:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851904.528397:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851904.528398:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851904.528398:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.528399:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851904.528399:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851904.528400:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851904.528401:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008aed8675.
02000000:00000001:24.0:1773851904.528401:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.528402:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.528403:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851904.528403:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096692164, transno 0, xid 1858039696056320
00010000:00000001:24.0:1773851904.528404:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851904.528405:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001953a58e x1858039696056320/t0(0) o400->583ca5b8-884e-4568-977b-61053f27c332@19248@kfi7:185/0 lens 224/224 e 0 to 0 dl 1773852300 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1693-0'
00010000:00000001:24.0:1773851904.528407:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851904.528408:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851904.528408:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=137 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851904.528409:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851904.528410:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000031950d16 refcount 3 to 19248@kfi7
00000100:00000001:24.0:1773851904.528410:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921092334144 : -107152617217472 : ffff9e8b96506240)
02000000:00000001:24.0:1773851904.528411:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851904.528412:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.528412:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851904.528413:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19248@kfi7
00000400:00000010:24.0:1773851904.528413:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002fb795f8.
00000100:00000200:24.0:1773851904.528414:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858039696056320, offset 224
00000400:00000200:24.0:1773851904.528415:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19248@kfi7
00000400:00000200:24.0:1773851904.528416:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:24.0:1773851904.528417:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 1
00000400:00000200:24.0:1773851904.528418:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000400:00000200:24.0:1773851904.528419:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 3
00000400:00000200:24.0:1773851904.528420:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  19248@kfi7 local destination
00000400:00000200:24.0:1773851904.528422:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770512:8770512:1024:4294967295] 19248@kfi7 LPNI seq info [538874:538874:16:4294967295]
00000400:00000200:24.0:1773851904.528423:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000400:00000200:24.0:1773851904.528424:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19248@kfi7 to cpt 6
00000400:00000200:24.0:1773851904.528426:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 19248@kfi7(19248@kfi7:19248@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851904.528427:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 3
00000800:00000200:24.0:1773851904.528428:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851904.528429:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851904.528431:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851904.528433:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000659 Using peer 19248@kfi7(0x100000000000659)
00000800:00000200:24.0:1773851904.528436:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000358ab717: Posted send of 324 bytes to peer 0x100000000000659: rc=0
00000800:00000200:24.0:1773851904.528437:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000659 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851904.528439:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851904.528440:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000031950d16 refcount 2 to 19248@kfi7
00010000:00000001:24.0:1773851904.528441:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851904.528441:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.528442:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851904.528443:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001953a58e x1858039696056320/t0(0) o400->583ca5b8-884e-4568-977b-61053f27c332@19248@kfi7:185/0 lens 224/224 e 0 to 0 dl 1773852300 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1693-0'
00000100:00100000:24.0:1773851904.528447:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001953a58e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:583ca5b8-884e-4568-977b-61053f27c332+6:39687:x1858039696056320:12345-19248@kfi7:400:default-tuolumne1693-0 Request processed in 58us (87us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851904.528448:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19248@kfi7, seq: 2025200
00000100:00000040:24.0:1773851904.528449:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009b6536bf : new rpc_count 0
00000100:00000001:24.0:1773851904.528450:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851904.528450:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851904.528451:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851904.528452:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851904.528453:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000030bb5633.
00000020:00000040:24.0:1773851904.528453:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000009b6536bf : new refcount 5
00000100:00000001:24.0:1773851904.528454:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851904.528459:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000659 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851904.528460:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851904.528461:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->19248@kfi7: PUT: OK
00000400:00000200:26.0:1773851904.528462:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002fb795f8
00000400:00000010:26.0:1773851904.528462:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002fb795f8.
00000100:00000001:26.0:1773851904.528463:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851904.528463:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851904.528464:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000018ffeb44 nid 19248@kfi7 refs 2
00000800:00000200:26.0:1773851904.528466:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 19248@kfi7(0000000099b2a658):0x0 lsk 1626 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000659 Transaction freed
00000800:00000200:22.0:1773851904.579165:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851904.579165:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851904.579166:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:21.0:1773851904.579166:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851904.579167:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851904.579167:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851904.579169:0:2456945:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20211@kfi7(0000000082930f3d):0x9c6 version: 2; local version 2; negotiated version: 2
00000800:00000200:21.0:1773851904.579169:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851904.579171:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000800:00000200:22.0:1773851904.579172:0:2456945:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 Using peer 20211@kfi7(0x9c6)
00000400:00000200:21.0:1773851904.579172:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20211@kfi7 : PUT - for me
00000400:00000200:21.0:1773851904.579173:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.579174:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de60fae0 nid 20211@kfi7 refs 1
00000400:00000200:21.0:1773851904.579175:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.579175:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de60fae0 nid 20211@kfi7 refs 2
00000400:00000200:21.0:1773851904.579176:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000de60fae0 nid 20211@kfi7 refs 3
00000400:00000200:22.0:1773851904.579177:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.579178:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000400:00000200:21.0:1773851904.579179:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20211@kfi7 of length 224 into portal 12 MB=0x69b80ed4dabc0
00000800:00000200:22.0:1773851904.579180:0:2456945:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000ea85a7d6: Posted send of 38 bytes to peer 0x9c6: rc=0
00000400:00000200:21.0:1773851904.579180:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20211@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 71752
00000800:00000200:22.0:1773851904.579181:0:2456945:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:21.0:1773851904.579182:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851904.579183:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851904.579184:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20211@kfi7: PUT: OK
00000100:00000001:21.0:1773851904.579185:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851904.579185:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851904.579186:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000c3f3533.
00000100:00000040:21.0:1773851904.579187:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000000c3f3533 x1859827899673536 msgsize 224
00000100:00100000:21.0:1773851904.579188:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-20211@kfi7 (source: 12345-20211@kfi7)
00000100:00000001:21.0:1773851904.579189:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851904.579190:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000de60fae0 nid 20211@kfi7 refs 2
00000100:00000001:23.0:1773851904.579191:0:61145:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851904.579191:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:23.0:1773851904.579192:0:61145:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:23.0:1773851904.579192:0:61145:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:23.0:1773851904.579193:0:61145:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:22.0:1773851904.579193:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 TN_EVENT_TX_OK event status 0
02000000:00000001:23.0:1773851904.579194:0:61145:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:23.0:1773851904.579195:0:61145:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859827899673536
00000020:00000001:23.0:1773851904.579195:0:61145:0:(genops.c:802:class_conn2export()) Process entered
00000800:00000200:22.0:1773851904.579195:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 Transaction freed
00000020:00000040:23.0:1773851904.579196:0:61145:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f086fcb858a5
00000020:00000001:23.0:1773851904.579197:0:61145:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:23.0:1773851904.579201:0:61145:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000757894f0 refcount=1043
00000020:00000001:23.0:1773851904.579202:0:61145:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637071986072576 : -107001723479040 : ffff9eaeb8481c00)
00000020:00000001:23.0:1773851904.579203:0:61145:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637071986072576 : -107001723479040 : ffff9eaeb8481c00)
00000100:00000001:23.0:1773851904.579204:0:61145:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:23.0:1773851904.579204:0:61145:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:23.0:1773851904.579205:0:61145:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000c2fd346c.
00000020:00000010:23.0:1773851904.579206:0:61145:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d33e08aa.
00000020:00000010:23.0:1773851904.579207:0:61145:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b7087f8a.
00000100:00000001:23.0:1773851904.579208:0:61145:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:23.0:1773851904.579209:0:61145:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:23.0:1773851904.579209:0:61145:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851904.579210:0:61145:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:23.0:1773851904.579211:0:61145:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:23.0:1773851904.579212:0:61145:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:23.0:1773851904.579213:0:61145:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851904.579214:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851904.579214:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851904.579215:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851904.579215:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851904.579216:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20211@kfi7, seq: 1998098
00000100:00000001:23.0:1773851904.579217:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851904.579217:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000757894f0 : new rpc_count 13
00000100:00000001:20.0:1773851904.579217:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313403904 : -106917396147712 : ffff9ec25a951200)
00000100:00000001:23.0:1773851904.579218:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851904.579219:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000c3f3533 x1859827899673536/t0(0) o400->112e4cf0-b379-4577-b931-b9f17463644a@20211@kfi7:631/0 lens 224/0 e 0 to 0 dl 1773851991 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1737-0'
00000100:00000001:20.0:1773851904.579221:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851904.579222:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851904.579223:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000c3f3533 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:112e4cf0-b379-4577-b931-b9f17463644a+1043:39597:x1859827899673536:12345-20211@kfi7:400:default-tuolumne1737-0
00000100:00000200:20.0:1773851904.579225:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859827899673536
00000020:00000001:20.0:1773851904.579225:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851904.579226:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851904.579226:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851904.579227:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851904.579228:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851904.579228:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851904.579229:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859827899673536, found 0 last_xid 1859827850244607
00000020:00000001:20.0:1773851904.579230:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851904.579230:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851904.579231:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851904.579231:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851904.579232:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851904.579233:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851904.579233:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851904.579234:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000156734c4.
02000000:00000001:20.0:1773851904.579235:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851904.579235:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851904.579236:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851904.579237:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592458, transno 0, xid 1859827899673536
00010000:00000001:20.0:1773851904.579237:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851904.579238:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000c3f3533 x1859827899673536/t0(0) o400->112e4cf0-b379-4577-b931-b9f17463644a@20211@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1737-0'
00010000:00000001:20.0:1773851904.579240:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851904.579241:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851904.579242:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=137 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851904.579243:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851904.579243:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e3318e8 refcount 3 to 20211@kfi7
00000100:00000001:20.0:1773851904.579244:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964027968 : -107156745523648 : ffff9e8aa03f6e40)
02000000:00000001:20.0:1773851904.579245:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851904.579245:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851904.579246:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851904.579247:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20211@kfi7
00000400:00000010:20.0:1773851904.579248:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005c6b46a6.
00000100:00000200:20.0:1773851904.579248:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859827899673536, offset 224
00000400:00000200:20.0:1773851904.579250:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20211@kfi7
00000400:00000200:20.0:1773851904.579250:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000400:00000200:20.0:1773851904.579251:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000de60fae0 nid 20211@kfi7 refs 1
00000400:00000200:20.0:1773851904.579252:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000de60fae0 nid 20211@kfi7 refs 2
00000400:00000200:20.0:1773851904.579254:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000de60fae0 nid 20211@kfi7 refs 3
00000400:00000200:20.0:1773851904.579255:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20211@kfi7 local destination
00000400:00000200:20.0:1773851904.579256:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770513:8770513:1024:4294967295] 20211@kfi7 LPNI seq info [13673115:13673115:16:4294967295]
00000400:00000200:20.0:1773851904.579257:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000de60fae0 nid 20211@kfi7 refs 2
00000400:00000200:20.0:1773851904.579258:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20211@kfi7 to cpt 5
00000400:00000200:20.0:1773851904.579260:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20211@kfi7(20211@kfi7:20211@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851904.579261:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000de60fae0 nid 20211@kfi7 refs 3
00000800:00000200:20.0:1773851904.579263:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851904.579264:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851904.579266:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851904.579269:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 Using peer 20211@kfi7(0x9c6)
00000800:00000200:20.0:1773851904.579271:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000b65d7555: Posted send of 324 bytes to peer 0x9c6: rc=0
00000800:00000200:20.0:1773851904.579273:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851904.579275:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851904.579276:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e3318e8 refcount 2 to 20211@kfi7
00010000:00000001:20.0:1773851904.579276:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851904.579277:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851904.579277:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851904.579278:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000c3f3533 x1859827899673536/t0(0) o400->112e4cf0-b379-4577-b931-b9f17463644a@20211@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1737-0'
00000100:00100000:20.0:1773851904.579283:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000c3f3533 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:112e4cf0-b379-4577-b931-b9f17463644a+1043:39597:x1859827899673536:12345-20211@kfi7:400:default-tuolumne1737-0 Request processed in 60us (95us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851904.579285:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20211@kfi7, seq: 1998098
00000100:00000040:20.0:1773851904.579285:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000757894f0 : new rpc_count 12
00000100:00000001:20.0:1773851904.579286:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851904.579287:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851904.579287:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d33e08aa.
00000020:00000010:20.0:1773851904.579288:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b7087f8a.
00000020:00000010:20.0:1773851904.579289:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000c2fd346c.
00000020:00000040:20.0:1773851904.579290:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000757894f0 : new refcount 1042
00000100:00000001:20.0:1773851904.579290:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851904.579295:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851904.579296:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851904.579297:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20211@kfi7: PUT: OK
00000400:00000200:21.0:1773851904.579298:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005c6b46a6
00000400:00000010:21.0:1773851904.579298:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005c6b46a6.
00000100:00000001:21.0:1773851904.579299:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851904.579299:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851904.579300:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000de60fae0 nid 20211@kfi7 refs 2
00000800:00000200:21.0:1773851904.579301:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b65d7555: 2069@kfi7:5 -> 20211@kfi7(0000000082930f3d):0x0 lsk 2503 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x9c6 Transaction freed
00000800:00000200:3.0:1773851904.744321:0:2506738:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:2.0:1773851904.744321:0:2506505:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:3.0:1773851904.744322:0:2506738:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:2.0:1773851904.744322:0:2506505:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:3.0:1773851904.744324:0:2506738:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:2.0:1773851904.744324:0:2506505:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:3.0:1773851904.744325:0:2506738:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15523@kfi7(00000000f5d6dbb3):0x2ad version: 2; local version 2; negotiated version: 2
00000800:00000200:2.0:1773851904.744326:0:2506505:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:3.0:1773851904.744327:0:2506738:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad Using peer 15523@kfi7(0x2ad)
00000400:00000200:2.0:1773851904.744328:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15523@kfi7 to cpt 0
00000400:00000200:3.0:1773851904.744329:0:2506738:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15523@kfi7 to cpt 0
00000400:00000200:2.0:1773851904.744330:0:2506505:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 15523@kfi7 : PUT - for me
00000800:00000200:3.0:1773851904.744331:0:2506738:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d86b7001: Posted send of 38 bytes to peer 0x2ad: rc=0
00000400:00000200:2.0:1773851904.744331:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15523@kfi7 to cpt 0
00000400:00000200:2.0:1773851904.744332:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000508135f5 nid 15523@kfi7 refs 1
00000800:00000200:3.0:1773851904.744333:0:2506738:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:2.0:1773851904.744333:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15523@kfi7 to cpt 0
00000400:00000200:2.0:1773851904.744334:0:2506505:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000508135f5 nid 15523@kfi7 refs 2
00000400:00000200:2.0:1773851904.744335:0:2506505:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000508135f5 nid 15523@kfi7 refs 3
00000400:00000200:2.0:1773851904.744336:0:2506505:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15522@kfi7 to cpt 5
00000400:00000200:2.0:1773851904.744337:0:2506505:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15522@kfi7 of length 456 into portal 12 MB=0x69b4b622575c0
00000400:00000200:2.0:1773851904.744338:0:2506505:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15522@kfi7 of length 456/456 into md 0x7fb56e801 [64] + 58608
00000800:00000200:2.0:1773851904.744340:0:2506505:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:2.0:1773851904.744342:0:2506505:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:2.0:1773851904.744343:0:2506505:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15523@kfi7: PUT: OK
00000100:00000001:2.0:1773851904.744344:0:2506505:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:2.0:1773851904.744344:0:2506505:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:2.0:1773851904.744345:0:2506505:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000003ad1eb43.
00000800:00000200:1.0:1773851904.744345:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad TN_EVENT_TX_OK event status 0
00000100:00000040:2.0:1773851904.744346:0:2506505:0:(events.c:358:request_in_callback()) incoming req@000000003ad1eb43 x1859597931738560 msgsize 456
00000800:00000200:1.0:1773851904.744347:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000d86b7001: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad Transaction freed
00000100:00100000:2.0:1773851904.744348:0:2506505:0:(events.c:361:request_in_callback()) peer: 12345-15522@kfi7 (source: 12345-15523@kfi7)
00000100:00000001:2.0:1773851904.744349:0:2506505:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:2.0:1773851904.744350:0:2506505:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000508135f5 nid 15523@kfi7 refs 2
00000100:00000001:0.0:1773851904.744350:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:2.0:1773851904.744351:0:2506505:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dae7d744: 2069@kfi7:0 <- 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851904.744351:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851904.744351:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851904.744352:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851904.744352:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851904.744353:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597931738560
00000020:00000001:0.0:1773851904.744354:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851904.744354:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8269e
00000020:00000001:0.0:1773851904.744355:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851904.744359:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d0437836 refcount=1290
00000020:00000001:0.0:1773851904.744360:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157028249600 : -106916681302016 : ffff9ec28530c000)
00000020:00000001:0.0:1773851904.744361:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157028249600 : -106916681302016 : ffff9ec28530c000)
00000100:00000001:0.0:1773851904.744361:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851904.744362:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851904.744363:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000877d5ffd.
00000020:00000010:0.0:1773851904.744364:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851904.744364:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851904.744365:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851904.744365:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851904.744366:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.744367:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.744368:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851904.744369:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851904.744369:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851904.744369:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851904.744370:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851904.744370:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15522@kfi7, seq: 408701492
00000100:00000001:2.0:1773851904.744371:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.744371:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d0437836 : new rpc_count 9
00000100:00000001:0.0:1773851904.744372:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637159877906944 : -106913831644672 : ffff9ec32f0b1200)
00000100:00000001:2.0:1773851904.744373:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.744373:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000003ad1eb43 x1859597931738560/t0(0) o17->8162f468-ab4e-4359-855e-8e3883ad0f78@15522@kfi7:631/0 lens 456/0 e 0 to 0 dl 1773851991 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1452-0'
00000100:00000001:0.0:1773851904.744378:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851904.744378:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851904.744379:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000003ad1eb43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:8162f468-ab4e-4359-855e-8e3883ad0f78+1290:39559:x1859597931738560:12345-15522@kfi7:17:default-tuolumne1452-0
00000100:00000200:0.0:1773851904.744380:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597931738560
00000020:00000001:0.0:1773851904.744381:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851904.744381:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851904.744382:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.744383:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851904.744383:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:0.0:1773851904.744384:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851904.744384:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597931738560, found 0 last_xid 1859597931056191
00000020:00000001:0.0:1773851904.744385:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851904.744386:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851904.744386:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851904.744387:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851904.744387:0:42868:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:0.0:1773851904.744388:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851904.744389:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851904.744389:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000005c6c6805.
02000000:00000001:0.0:1773851904.744390:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.744390:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.744391:0:42868:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:0.0:1773851904.744392:0:42868:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:0.0:1773851904.744393:0:42868:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:0.0:1773851904.744394:0:42868:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.744395:0:42868:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:0.0:1773851904.744396:0:42868:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 8162f468-ab4e-4359-855e-8e3883ad0f78/00000000d0437836 free: 126633370845184 avail: 126633368748032
00000020:00000001:0.0:1773851904.744397:0:42868:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:0.0:1773851904.744397:0:42868:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 8162f468-ab4e-4359-855e-8e3883ad0f78/00000000d0437836 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:0.0:1773851904.744398:0:42868:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:0.0:1773851904.744399:0:42868:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:0.0:1773851904.744400:0:42868:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 8162f468-ab4e-4359-855e-8e3883ad0f78/00000000d0437836 reports grant 1807220735 dropped 0, local 1882456063
00000020:00000001:0.0:1773851904.744401:0:42868:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:0.0:1773851904.744401:0:42868:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:0.0:1773851904.744402:0:42868:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851904.744403:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264589572, transno 0, xid 1859597931738560
00010000:00000001:0.0:1773851904.744403:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851904.744404:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000003ad1eb43 x1859597931738560/t0(0) o17->8162f468-ab4e-4359-855e-8e3883ad0f78@15522@kfi7:631/0 lens 456/432 e 0 to 0 dl 1773851991 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1452-0'
00010000:00000001:0.0:1773851904.744406:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851904.744407:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851904.744407:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=137 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851904.744408:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851904.744409:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002e9fbf45 refcount 3 to 15522@kfi7
00000100:00000001:0.0:1773851904.744410:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926957452864 : -107146752098752 : ffff9e8cf3e6fe40)
02000000:00000001:0.0:1773851904.744411:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851904.744411:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.744412:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851904.744412:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15523@kfi7
00000400:00000010:0.0:1773851904.744413:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a3358ad2.
00000100:00000200:0.0:1773851904.744414:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859597931738560, offset 224
00000400:00000200:0.0:1773851904.744415:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15523@kfi7
00000400:00000200:0.0:1773851904.744415:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15523@kfi7 to cpt 0
00000400:00000200:0.0:1773851904.744416:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000508135f5 nid 15523@kfi7 refs 1
00000400:00000200:0.0:1773851904.744417:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000508135f5 nid 15523@kfi7 refs 2
00000400:00000200:0.0:1773851904.744418:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000508135f5 nid 15523@kfi7 refs 3
00000400:00000200:0.0:1773851904.744419:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  15523@kfi7 local destination
00000400:00000200:0.0:1773851904.744420:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770514:8770514:1024:4294967295] 15523@kfi7 LPNI seq info [1905565:1905565:16:4294967295]
00000400:00000200:0.0:1773851904.744422:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000508135f5 nid 15523@kfi7 refs 2
00000400:00000200:0.0:1773851904.744422:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15523@kfi7 to cpt 0
00000400:00000200:0.0:1773851904.744424:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 15523@kfi7(15523@kfi7:15523@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851904.744425:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000508135f5 nid 15523@kfi7 refs 3
00000800:00000200:0.0:1773851904.744426:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851904.744427:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:0.0:1773851904.744429:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851904.744432:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad Using peer 15523@kfi7(0x2ad)
00000800:00000200:0.0:1773851904.744434:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 000000006861ccb4: Posted send of 532 bytes to peer 0x2ad: rc=0
00000800:00000200:0.0:1773851904.744435:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851904.744437:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.744438:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002e9fbf45 refcount 2 to 15522@kfi7
00010000:00000001:0.0:1773851904.744439:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851904.744439:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.744440:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851904.744440:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000003ad1eb43 x1859597931738560/t0(0) o17->8162f468-ab4e-4359-855e-8e3883ad0f78@15522@kfi7:631/0 lens 456/432 e 0 to 0 dl 1773851991 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1452-0'
00000100:00100000:0.0:1773851904.744444:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000003ad1eb43 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:8162f468-ab4e-4359-855e-8e3883ad0f78+1290:39559:x1859597931738560:12345-15522@kfi7:17:default-tuolumne1452-0 Request processed in 66us (97us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851904.744447:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15522@kfi7, seq: 408701492
00000100:00000040:0.0:1773851904.744447:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d0437836 : new rpc_count 8
00000100:00000001:0.0:1773851904.744448:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851904.744448:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851904.744449:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851904.744449:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000020:00000010:0.0:1773851904.744450:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000877d5ffd.
00000020:00000040:0.0:1773851904.744451:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000d0437836 : new refcount 1289
00000100:00000001:0.0:1773851904.744451:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851904.744456:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851904.744457:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851904.744458:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->15523@kfi7: PUT: OK
00000400:00000200:1.0:1773851904.744459:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a3358ad2
00000400:00000010:1.0:1773851904.744459:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a3358ad2.
00000100:00000001:1.0:1773851904.744460:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851904.744460:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851904.744461:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000508135f5 nid 15523@kfi7 refs 2
00000800:00000200:1.0:1773851904.744462:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006861ccb4: 2069@kfi7:0 -> 15523@kfi7(00000000f5d6dbb3):0x0 lsk 686 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2ad Transaction freed
00000800:00000200:13.0:1773851904.777047:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851904.777048:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851904.777049:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851904.777051:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851904.777053:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.777054:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 18946@kfi7 : PUT - for me
00000400:00000200:13.0:1773851904.777055:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.777056:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 1
00000400:00000200:13.0:1773851904.777057:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.777058:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000400:00000200:13.0:1773851904.777058:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 3
00000400:00000200:13.0:1773851904.777059:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.777060:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18946@kfi7 of length 224 into portal 12 MB=0x69b4b92905c80
00000400:00000200:13.0:1773851904.777061:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-18946@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 64384
00000800:00000200:13.0:1773851904.777063:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851904.777065:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851904.777066:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18946@kfi7: PUT: OK
00000100:00000001:13.0:1773851904.777067:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851904.777067:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851904.777068:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cf40837.
00000100:00000040:13.0:1773851904.777069:0:2514888:0:(events.c:358:request_in_callback()) incoming req@000000007cf40837 x1859598744050816 msgsize 224
00000100:00100000:13.0:1773851904.777070:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-18946@kfi7 (source: 12345-18946@kfi7)
00000100:00000001:13.0:1773851904.777072:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851904.777073:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000800:00000200:13.0:1773851904.777074:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:12.0:1773851904.777074:0:60487:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:12.0:1773851904.777074:0:60487:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:12.0:1773851904.777075:0:60487:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851904.777075:0:60487:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851904.777076:0:60487:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:12.0:1773851904.777077:0:60487:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598744050816
00000020:00000001:12.0:1773851904.777077:0:60487:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:12.0:1773851904.777078:0:60487:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d802b0
00000020:00000001:12.0:1773851904.777078:0:60487:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:12.0:1773851904.777081:0:60487:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000740d8c3e refcount=5
00000020:00000001:12.0:1773851904.777082:0:60487:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637132046950400 : -106941662601216 : ffff9ebcb4306000)
00000020:00000001:12.0:1773851904.777083:0:60487:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637132046950400 : -106941662601216 : ffff9ebcb4306000)
00000100:00000001:12.0:1773851904.777084:0:60487:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:12.0:1773851904.777085:0:60487:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:12.0:1773851904.777086:0:60487:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f78d902d.
00000020:00000010:12.0:1773851904.777087:0:60487:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 0000000050e21959.
00000020:00000010:12.0:1773851904.777087:0:60487:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000d1219248.
00000100:00000001:12.0:1773851904.777088:0:60487:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:12.0:1773851904.777089:0:60487:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:12.0:1773851904.777089:0:60487:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851904.777090:0:60487:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:12.0:1773851904.777091:0:60487:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:12.0:1773851904.777091:0:60487:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.777092:0:60487:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851904.777094:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851904.777094:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851904.777094:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851904.777095:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851904.777096:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18946@kfi7, seq: 2289957
00000100:00000040:14.0:1773851904.777096:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000740d8c3e : new rpc_count 1
00000100:00000001:14.0:1773851904.777097:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092547968 : -106946617003648 : ffff9ebb8ce23180)
00000100:00000001:12.0:1773851904.777097:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.777097:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851904.777099:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007cf40837 x1859598744050816/t0(0) o400->48e2200b-a543-4d57-b813-456caa265e22@18946@kfi7:631/0 lens 224/0 e 0 to 0 dl 1773851991 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1687-0'
00000100:00000001:14.0:1773851904.777105:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851904.777105:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851904.777106:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cf40837 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:48e2200b-a543-4d57-b813-456caa265e22+5:39687:x1859598744050816:12345-18946@kfi7:400:default-tuolumne1687-0
00000100:00000200:14.0:1773851904.777108:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598744050816
00000020:00000001:14.0:1773851904.777109:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851904.777110:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851904.777111:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.777111:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851904.777112:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851904.777113:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851904.777113:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598744050816, found 0 last_xid 1859598744050815
00000020:00000001:14.0:1773851904.777114:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851904.777115:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851904.777116:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851904.777116:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.777117:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851904.777118:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851904.777118:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851904.777119:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e5d9306e.
02000000:00000001:14.0:1773851904.777120:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851904.777121:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.777122:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851904.777123:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693879, transno 0, xid 1859598744050816
00010000:00000001:14.0:1773851904.777124:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851904.777124:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007cf40837 x1859598744050816/t0(0) o400->48e2200b-a543-4d57-b813-456caa265e22@18946@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1687-0'
00010000:00000001:14.0:1773851904.777127:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851904.777128:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851904.777128:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=137 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851904.777130:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851904.777130:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fc97fbf7 refcount 3 to 18946@kfi7
00000100:00000001:14.0:1773851904.777131:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918902779456 : -107154806772160 : ffff9e8b13ce6e40)
02000000:00000001:14.0:1773851904.777141:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851904.777142:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851904.777142:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851904.777143:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18946@kfi7
00000400:00000010:14.0:1773851904.777144:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006f9b2ffb.
00000100:00000200:14.0:1773851904.777145:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598744050816, offset 224
00000400:00000200:14.0:1773851904.777146:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18946@kfi7
00000400:00000200:14.0:1773851904.777147:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:14.0:1773851904.777148:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 1
00000400:00000200:14.0:1773851904.777149:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000400:00000200:14.0:1773851904.777150:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 3
00000400:00000200:14.0:1773851904.777152:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  18946@kfi7 local destination
00000400:00000200:14.0:1773851904.777153:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770515:8770515:1024:4294967295] 18946@kfi7 LPNI seq info [10584767:10584767:16:4294967295]
00000400:00000200:14.0:1773851904.777155:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000400:00000200:14.0:1773851904.777156:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18946@kfi7 to cpt 3
00000400:00000200:14.0:1773851904.777158:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 18946@kfi7(18946@kfi7:18946@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851904.777159:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 3
00000800:00000200:14.0:1773851904.777161:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851904.777162:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851904.777165:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851904.777168:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5b7 Using peer 18946@kfi7(0x5b7)
00000800:00000200:14.0:1773851904.777171:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000e70f539d: Posted send of 324 bytes to peer 0x5b7: rc=0
00000800:00000200:14.0:1773851904.777173:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5b7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851904.777175:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851904.777175:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fc97fbf7 refcount 2 to 18946@kfi7
00010000:00000001:14.0:1773851904.777176:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851904.777177:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.777178:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851904.777178:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cf40837 x1859598744050816/t0(0) o400->48e2200b-a543-4d57-b813-456caa265e22@18946@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1687-0'
00000100:00100000:14.0:1773851904.777182:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cf40837 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:48e2200b-a543-4d57-b813-456caa265e22+5:39687:x1859598744050816:12345-18946@kfi7:400:default-tuolumne1687-0 Request processed in 76us (112us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851904.777184:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18946@kfi7, seq: 2289957
00000100:00000040:14.0:1773851904.777185:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000740d8c3e : new rpc_count 0
00000800:00000200:13.0:1773851904.777185:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5b7 TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851904.777186:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851904.777186:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:13.0:1773851904.777186:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851904.777187:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 0000000050e21959.
00000400:00000200:13.0:1773851904.777187:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->18946@kfi7: PUT: OK
00000020:00000010:14.0:1773851904.777188:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000d1219248.
00000400:00000200:13.0:1773851904.777188:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006f9b2ffb
00000020:00000010:14.0:1773851904.777189:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f78d902d.
00000020:00000040:14.0:1773851904.777189:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000740d8c3e : new refcount 4
00000400:00000010:13.0:1773851904.777189:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006f9b2ffb.
00000100:00000001:13.0:1773851904.777189:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:14.0:1773851904.777190:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851904.777190:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851904.777191:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009b8058b3 nid 18946@kfi7 refs 2
00000800:00000200:13.0:1773851904.777192:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 18946@kfi7(0000000098bc5756):0x0 lsk 1464 rsk 6 tsk 0 trmk 0 tmk 0 trr 3 tta 0x5b7 Transaction freed
00000800:00000200:30.0:1773851904.779236:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851904.779237:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851904.779239:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851904.779241:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851904.779244:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.779245:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12512@kfi7 : PUT - for me
00000400:00000200:30.0:1773851904.779246:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.779249:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 1
00000400:00000200:30.0:1773851904.779250:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.779251:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000400:00000200:30.0:1773851904.779252:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 3
00000400:00000200:30.0:1773851904.779253:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12321@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.779254:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12321@kfi7 of length 224 into portal 12 MB=0x69b4b5667c2c0
00000400:00000200:30.0:1773851904.779255:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12321@kfi7 of length 224/224 into md 0x77fe1859d [64] + 17640
00000800:00000200:30.0:1773851904.779257:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851904.779259:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851904.779260:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12512@kfi7: PUT: OK
00000100:00000001:30.0:1773851904.779262:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851904.779262:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851904.779263:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ab2e2c82.
00000100:00000040:30.0:1773851904.779264:0:2472963:0:(events.c:358:request_in_callback()) incoming req@00000000ab2e2c82 x1859597734757056 msgsize 224
00000100:00100000:30.0:1773851904.779266:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-12321@kfi7 (source: 12345-12512@kfi7)
00000100:00000001:30.0:1773851904.779267:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851904.779268:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000100:00000001:28.0:1773851904.779268:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851904.779269:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851904.779269:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:30.0:1773851904.779270:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851904.779270:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851904.779270:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.779271:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597734757056
00000020:00000001:28.0:1773851904.779272:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851904.779272:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7d3d9
00000020:00000001:28.0:1773851904.779273:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851904.779275:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ba76814c refcount=5
00000020:00000001:28.0:1773851904.779276:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637092408504320 : -106981301047296 : ffff9eb3798db000)
00000020:00000001:28.0:1773851904.779277:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637092408504320 : -106981301047296 : ffff9eb3798db000)
00000100:00000001:28.0:1773851904.779277:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.779278:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851904.779279:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007019ce07.
00000020:00000010:28.0:1773851904.779280:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.779281:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851904.779282:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851904.779282:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851904.779283:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.779284:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851904.779285:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851904.779285:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.779286:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851904.779287:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851904.779287:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851904.779288:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851904.779288:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851904.779289:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12321@kfi7, seq: 2055621
00000100:00000001:31.0:1773851904.779290:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.779290:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.779290:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ba76814c : new rpc_count 1
00000100:00000001:28.0:1773851904.779290:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411243392 : -106960298308224 : ffff9eb85d6a0d80)
00000100:00000040:28.0:1773851904.779292:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ab2e2c82 x1859597734757056/t0(0) o400->94b4f77a-d744-4fde-b718-8ac986464a78@12321@kfi7:692/0 lens 224/0 e 0 to 0 dl 1773852052 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1263-0'
00000100:00000001:28.0:1773851904.779294:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.779295:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851904.779296:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ab2e2c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:94b4f77a-d744-4fde-b718-8ac986464a78+5:39600:x1859597734757056:12345-12321@kfi7:400:default-tuolumne1263-0
00000100:00000200:28.0:1773851904.779297:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597734757056
00000020:00000001:28.0:1773851904.779298:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851904.779298:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851904.779299:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.779300:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851904.779300:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851904.779301:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851904.779302:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597734757056, found 0 last_xid 1859597734757055
00000020:00000001:28.0:1773851904.779303:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851904.779303:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851904.779304:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851904.779304:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.779305:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851904.779306:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851904.779306:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851904.779307:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000590ddc6f.
02000000:00000001:28.0:1773851904.779308:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.779308:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.779309:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851904.779310:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096677557, transno 0, xid 1859597734757056
00010000:00000001:28.0:1773851904.779311:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851904.779312:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ab2e2c82 x1859597734757056/t0(0) o400->94b4f77a-d744-4fde-b718-8ac986464a78@12321@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1263-0'
00010000:00000001:28.0:1773851904.779314:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851904.779315:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851904.779316:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=137 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851904.779317:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851904.779318:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000314956ff refcount 3 to 12321@kfi7
00000100:00000001:28.0:1773851904.779318:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636935869934400 : -107137839617216 : ffff9e8f0720ab40)
02000000:00000001:28.0:1773851904.779319:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851904.779320:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.779320:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851904.779321:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12512@kfi7
00000400:00000010:28.0:1773851904.779322:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000015fd77cc.
00000100:00000200:28.0:1773851904.779322:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597734757056, offset 224
00000400:00000200:28.0:1773851904.779324:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12512@kfi7
00000400:00000200:28.0:1773851904.779325:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.779326:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 1
00000400:00000200:28.0:1773851904.779327:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000400:00000200:28.0:1773851904.779328:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 3
00000400:00000200:28.0:1773851904.779330:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12512@kfi7 local destination
00000400:00000200:28.0:1773851904.779331:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770516:8770516:1024:4294967295] 12512@kfi7 LPNI seq info [410714:410714:16:4294967295]
00000400:00000200:28.0:1773851904.779332:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000400:00000200:28.0:1773851904.779333:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12512@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.779335:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12512@kfi7(12512@kfi7:12512@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851904.779336:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 3
00000800:00000200:28.0:1773851904.779338:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851904.779339:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851904.779341:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851904.779345:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008b4 Using peer 12512@kfi7(0x1000000000008b4)
00000800:00000200:28.0:1773851904.779348:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000004360a85a: Posted send of 324 bytes to peer 0x1000000000008b4: rc=0
00000800:00000200:28.0:1773851904.779349:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008b4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851904.779351:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.779352:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000314956ff refcount 2 to 12321@kfi7
00010000:00000001:28.0:1773851904.779353:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851904.779353:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.779354:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851904.779355:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ab2e2c82 x1859597734757056/t0(0) o400->94b4f77a-d744-4fde-b718-8ac986464a78@12321@kfi7:692/0 lens 224/224 e 0 to 0 dl 1773852052 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1263-0'
00000100:00100000:28.0:1773851904.779360:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ab2e2c82 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:94b4f77a-d744-4fde-b718-8ac986464a78+5:39600:x1859597734757056:12345-12321@kfi7:400:default-tuolumne1263-0 Request processed in 64us (94us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851904.779363:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12321@kfi7, seq: 2055621
00000100:00000040:28.0:1773851904.779365:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ba76814c : new rpc_count 0
00000100:00000001:28.0:1773851904.779366:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851904.779367:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851904.779367:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.779369:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851904.779370:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007019ce07.
00000020:00000040:28.0:1773851904.779371:0:42267:0:(genops.c:882:class_export_put()) PUTting export 00000000ba76814c : new refcount 4
00000100:00000001:28.0:1773851904.779372:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851904.779378:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008b4 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851904.779380:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.779381:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12512@kfi7: PUT: OK
00000400:00000200:29.0:1773851904.779382:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000015fd77cc
00000400:00000010:29.0:1773851904.779383:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000015fd77cc.
00000100:00000001:29.0:1773851904.779383:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851904.779384:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851904.779385:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a847f8fe nid 12512@kfi7 refs 2
00000800:00000200:29.0:1773851904.779387:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004360a85a: 2054@kfi7:7 -> 12512@kfi7(00000000649e2780):0x0 lsk 2229 rsk 10 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000008b4 Transaction freed
00000004:00000001:11.0:1773851904.841730:0:42385:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:11.0:1773851904.841730:0:42385:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:10.0:1773851904.841730:0:42377:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:10.0:1773851904.841730:0:42377:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:11.0:1773851904.841731:0:42385:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001937abea.
00000100:00000010:10.0:1773851904.841731:0:42377:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000037d69b00.
00000004:00000001:3.0:1773851904.841731:0:42321:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:3.0:1773851904.841731:0:42321:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:15.0:1773851904.841732:0:42369:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:15.0:1773851904.841732:0:42369:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:11.0:1773851904.841732:0:42385:0:(genops.c:1094:class_import_get()) import 00000000bd2bb069 refcount=5 obd=lustre5-OST0017-osc-MDT0001
00000100:00000010:3.0:1773851904.841732:0:42321:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ac7bcb57.
00000100:00000010:15.0:1773851904.841733:0:42369:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ce8bc3d5.
00000100:00000001:11.0:1773851904.841733:0:42385:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:11.0:1773851904.841733:0:42385:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000020:00000040:10.0:1773851904.841733:0:42377:0:(genops.c:1094:class_import_get()) import 000000008054c9ec refcount=3 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:10.0:1773851904.841733:0:42377:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:3.0:1773851904.841733:0:42321:0:(genops.c:1094:class_import_get()) import 000000005b27a69d refcount=8 obd=lustre5-OST0007-osc-MDT0001
00000020:00000040:15.0:1773851904.841734:0:42369:0:(genops.c:1094:class_import_get()) import 00000000c439201d refcount=8 obd=lustre5-OST000f-osc-MDT0001
02000000:00000001:11.0:1773851904.841734:0:42385:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851904.841734:0:42377:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:10.0:1773851904.841734:0:42377:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851904.841734:0:42321:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:3.0:1773851904.841734:0:42321:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:15.0:1773851904.841735:0:42369:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:15.0:1773851904.841735:0:42369:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:11.0:1773851904.841735:0:42385:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000004f719342.
02000000:00000010:10.0:1773851904.841735:0:42377:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000002f6163b3.
02000000:00000001:3.0:1773851904.841735:0:42321:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:15.0:1773851904.841736:0:42369:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851904.841736:0:42385:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851904.841736:0:42377:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:3.0:1773851904.841736:0:42321:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000690adcac.
02000000:00000010:15.0:1773851904.841737:0:42369:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000061b717ba.
00000100:00000001:11.0:1773851904.841737:0:42385:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:11.0:1773851904.841737:0:42385:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851904.841737:0:42377:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:10.0:1773851904.841737:0:42377:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:3.0:1773851904.841737:0:42321:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851904.841738:0:42369:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851904.841738:0:42385:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000001937abea] to pc [ptlrpcd_02_03+3]  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851904.841738:0:42321:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:15.0:1773851904.841739:0:42369:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:10.0:1773851904.841739:0:42377:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000037d69b00] to pc [ptlrpcd_02_00+0]  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:3.0:1773851904.841739:0:42321:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:15.0:1773851904.841740:0:42369:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:3.0:1773851904.841740:0:42321:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ac7bcb57] to pc [ptlrpcd_00_00+0]  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:15.0:1773851904.841741:0:42369:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ce8bc3d5] to pc [ptlrpcd_03_00+0]  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851904.841743:0:42377:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:8.0:1773851904.841743:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:3.0:1773851904.841743:0:42321:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851904.841744:0:42385:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000010:10.0:1773851904.841744:0:42377:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000001aa877ac.
00000100:00000001:9.0:1773851904.841744:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851904.841744:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:11.0:1773851904.841745:0:42385:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000bb57814a.
00080000:00000001:10.0:1773851904.841745:0:42377:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637140885259264 : -106932824292352 : ffff9ebec2fe4400)
00000100:00000001:9.0:1773851904.841745:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851904.841745:0:41071:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851904.841745:0:41068:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:3.0:1773851904.841745:0:42321:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c3d43391.
00080000:00000001:3.0:1773851904.841745:0:42321:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637130312355840 : -106943397195776 : ffff9ebc4ccc9000)
00000100:00000001:1.0:1773851904.841745:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851904.841745:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:0.0:1773851904.841745:0:41061:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [0->1]
00080000:00000001:15.0:1773851904.841746:0:42369:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:11.0:1773851904.841746:0:42385:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637117584703488 : -106956124848128 : ffff9eb9562c0000)
00080000:00000001:10.0:1773851904.841746:0:42377:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:9.0:1773851904.841746:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:8.0:1773851904.841746:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:3.0:1773851904.841746:0:42321:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:1.0:1773851904.841746:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.841746:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000010:15.0:1773851904.841747:0:42369:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000b4fc87b1.
00000100:00000001:14.0:1773851904.841747:0:41073:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:12.0:1773851904.841747:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:11.0:1773851904.841747:0:42385:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:3.0:1773851904.841747:0:42321:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.841747:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:15.0:1773851904.841748:0:42369:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637100647516160 : -106973062035456 : ffff9eb564a30800)
00000100:00000001:14.0:1773851904.841748:0:41073:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841748:0:41072:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:12.0:1773851904.841748:0:41072:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:8.0:1773851904.841748:0:41068:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:3.0:1773851904.841748:0:42321:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0007-osc-MDT0001: sync forced, 1 changes
00000100:00000001:0.0:1773851904.841748:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:15.0:1773851904.841749:0:42369:0:(osd_handler.c:202:osd_trans_start()) Process entered
00080000:00000001:15.0:1773851904.841749:0:42369:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841749:0:41071:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:8.0:1773851904.841749:0:41068:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851904.841749:0:41068:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00000010:3.0:1773851904.841749:0:42321:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000b9f737a8.
00000004:00001000:15.0:1773851904.841750:0:42369:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000f-osc-MDT0001: sync forced, 3 changes
00000100:00000040:12.0:1773851904.841750:0:41072:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:10.0:1773851904.841750:0:42377:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841750:0:41071:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851904.841750:0:41068:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:3.0:1773851904.841750:0:42321:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0007-osc-MDT0001: add commit cb at 614179295025620ns, next at 614180295024628ns, rc = 0
00000004:00000010:15.0:1773851904.841751:0:42369:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000d83d040f.
00000004:00001000:10.0:1773851904.841751:0:42377:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0013-osc-MDT0001: sync forced, 2 changes
02000000:00000001:9.0:1773851904.841751:0:41071:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:9.0:1773851904.841751:0:41071:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:8.0:1773851904.841751:0:41068:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051943680:31@kfi7:13:default-yuba2-0
00080000:00000001:3.0:1773851904.841751:0:42321:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000004:00080000:15.0:1773851904.841752:0:42369:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000f-osc-MDT0001: add commit cb at 614179295027103ns, next at 614180295026171ns, rc = 0
00080000:00000001:11.0:1773851904.841752:0:42385:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:11.0:1773851904.841752:0:42385:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0017-osc-MDT0001: sync forced, 3 changes
00000004:00000010:10.0:1773851904.841752:0:42377:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000008e4ea686.
00000004:00080000:10.0:1773851904.841752:0:42377:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0013-osc-MDT0001: add commit cb at 614179295027965ns, next at 614180295026903ns, rc = 0
00000100:00100000:9.0:1773851904.841752:0:41071:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000001937abea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051943616:6@kfi7:13:default-yuba2-0
00000100:00000001:8.0:1773851904.841752:0:41068:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:3.0:1773851904.841752:0:42321:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:3.0:1773851904.841752:0:42321:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:15.0:1773851904.841753:0:42369:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:15.0:1773851904.841753:0:42369:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841753:0:41072:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:12.0:1773851904.841753:0:41072:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:11.0:1773851904.841753:0:42385:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000e1329658.
00080000:00000001:10.0:1773851904.841753:0:42377:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:8.0:1773851904.841753:0:41068:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:15.0:1773851904.841754:0:42369:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851904.841754:0:41072:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:11.0:1773851904.841754:0:42385:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0017-osc-MDT0001: add commit cb at 614179295029277ns, next at 614180295028516ns, rc = 0
00080000:00000001:11.0:1773851904.841754:0:42385:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:10.0:1773851904.841754:0:42377:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841754:0:41071:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:8.0:1773851904.841754:0:41068:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851904.841754:0:41068:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:12.0:1773851904.841755:0:41072:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:11.0:1773851904.841755:0:42385:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851904.841755:0:42377:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851904.841755:0:41071:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:9.0:1773851904.841755:0:41071:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:8.0:1773851904.841755:0:41068:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005350c348.
02000000:00000001:8.0:1773851904.841755:0:41068:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.841755:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851904.841755:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00100000:12.0:1773851904.841756:0:41072:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ce8bc3d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_00:lustre5-MDT0001-mdtlov_UUID:41072:1859433051943808:54@kfi7:13:default-yuba2-0
00000004:00000001:11.0:1773851904.841756:0:42385:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:9.0:1773851904.841756:0:41071:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:0.0:1773851904.841756:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:12.0:1773851904.841757:0:41072:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000010:9.0:1773851904.841757:0:41071:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000245f1981.
02000000:00000001:9.0:1773851904.841757:0:41071:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:8.0:1773851904.841757:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000010:8.0:1773851904.841757:0:41068:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000cb686a9f.
00000100:00000040:0.0:1773851904.841757:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:12.0:1773851904.841758:0:41072:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000200:9.0:1773851904.841758:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000010:8.0:1773851904.841758:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001b897718.
02000000:00000001:12.0:1773851904.841759:0:41072:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851904.841759:0:41072:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:11.0:1773851904.841759:0:41070:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:11.0:1773851904.841759:0:41070:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:9.0:1773851904.841759:0:41071:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000eb62b974.
00000100:00000001:10.0:1773851904.841760:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000010:9.0:1773851904.841760:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003289b6e6.
00000100:00000200:8.0:1773851904.841760:0:41068:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943680, portal 4
00000100:00000001:0.0:1773851904.841760:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000010:12.0:1773851904.841761:0:41072:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 0000000077d03d26.
00000100:00000001:10.0:1773851904.841761:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851904.841761:0:41071:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943616, portal 4
00000100:00000001:8.0:1773851904.841761:0:41068:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:8.0:1773851904.841761:0:41068:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637129087763328 : -106944621788288 : ffff9ebc03cec380)
00000100:00000001:0.0:1773851904.841761:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851904.841761:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:12.0:1773851904.841762:0:41072:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841762:0:41071:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:9.0:1773851904.841762:0:41071:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637136446588032 : -106937262963584 : ffff9ebdba6d8480)
00000100:00000040:8.0:1773851904.841762:0:41068:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:0.0:1773851904.841762:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:12.0:1773851904.841763:0:41072:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000010:12.0:1773851904.841763:0:41072:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000001259ac8.
00000100:00000040:9.0:1773851904.841763:0:41071:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:0.0:1773851904.841763:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ac7bcb57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051943744:2095@kfi7:13:default-yuba2-0
00000400:00000010:12.0:1773851904.841764:0:41072:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e3dfef6f.
00000100:00000200:12.0:1773851904.841765:0:41072:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943808, portal 4
00000100:00000001:8.0:1773851904.841765:0:41068:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:0.0:1773851904.841765:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:0.0:1773851904.841765:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:12.0:1773851904.841766:0:41072:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:12.0:1773851904.841766:0:41072:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637127732677760 : -106945976873856 : ffff9ebbb309cc80)
00000100:00000001:9.0:1773851904.841766:0:41071:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:8.0:1773851904.841766:0:41068:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-31@kfi7
00000400:00000010:8.0:1773851904.841766:0:41068:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000054a4b090.
02000000:00000001:0.0:1773851904.841766:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851904.841766:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:9.0:1773851904.841767:0:41071:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-6@kfi7
00000400:00000010:9.0:1773851904.841767:0:41071:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000cb80094.
00000100:00000200:8.0:1773851904.841767:0:41068:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943680, offset 0
00000100:00000040:12.0:1773851904.841768:0:41072:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:8.0:1773851904.841768:0:41068:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-31@kfi7
02000000:00000010:0.0:1773851904.841768:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001d4af4cd.
02000000:00000001:0.0:1773851904.841768:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:9.0:1773851904.841769:0:41071:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943616, offset 0
00000400:00000200:8.0:1773851904.841769:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:0.0:1773851904.841769:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000001:12.0:1773851904.841770:0:41072:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:9.0:1773851904.841770:0:41071:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-6@kfi7
00000400:00000010:0.0:1773851904.841770:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000002a9a269c.
00000100:00000040:12.0:1773851904.841771:0:41072:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-54@kfi7
00000400:00000200:8.0:1773851904.841771:0:41068:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:8.0:1773851904.841771:0:41068:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000010:0.0:1773851904.841771:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e89b889f.
00000400:00000010:12.0:1773851904.841772:0:41072:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d0c203c4.
00000100:00000200:12.0:1773851904.841772:0:41072:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943808, offset 0
00000100:00000200:0.0:1773851904.841772:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943744, portal 4
00000400:00000200:8.0:1773851904.841773:0:41068:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000100:00000001:0.0:1773851904.841773:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:0.0:1773851904.841773:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637133514866688 : -106940194684928 : ffff9ebd0baf0000)
00000400:00000200:12.0:1773851904.841774:0:41072:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-54@kfi7
00000400:00000200:8.0:1773851904.841774:0:41068:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  31@kfi7 local destination
00000400:00000200:12.0:1773851904.841775:0:41072:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000040:0.0:1773851904.841775:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:12.0:1773851904.841776:0:41072:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000400:00000200:8.0:1773851904.841776:0:41068:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770515, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770516, p:4294967295, g:4294967295, h:1000]
00000100:00000001:0.0:1773851904.841777:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:8.0:1773851904.841778:0:41068:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000040:0.0:1773851904.841778:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2095@kfi7
00000400:00000200:8.0:1773851904.841779:0:41068:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:8.0:1773851904.841779:0:41068:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 31@kfi7
00000400:00000010:0.0:1773851904.841779:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a92b0d66.
00000100:00000200:0.0:1773851904.841780:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051943744, offset 0
00000400:00000200:8.0:1773851904.841781:0:41068:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770517:8770517:1024:4294967295] 31@kfi7 LPNI seq info [5403626:5403626:16:4294967295]
00000400:00000200:0.0:1773851904.841781:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2095@kfi7
00000400:00000200:8.0:1773851904.841782:0:41068:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:0.0:1773851904.841782:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:8.0:1773851904.841783:0:41068:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:9.0:1773851904.841784:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:0.0:1773851904.841784:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000400:00000200:9.0:1773851904.841785:0:41071:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:0.0:1773851904.841785:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:12.0:1773851904.841786:0:41072:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:8.0:1773851904.841786:0:41068:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 31@kfi7(31@kfi7:31@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851904.841786:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:9.0:1773851904.841787:0:41071:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:8.0:1773851904.841787:0:41068:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:12.0:1773851904.841788:0:41072:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851904.841788:0:41071:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:0.0:1773851904.841788:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2095@kfi7 local destination
00000400:00000200:12.0:1773851904.841789:0:41072:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  54@kfi7 local destination
00000400:00000200:9.0:1773851904.841789:0:41071:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  6@kfi7 local destination
00000800:00000200:8.0:1773851904.841789:0:41068:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:8.0:1773851904.841790:0:41068:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:0.0:1773851904.841790:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770517, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770516, p:4294967295, g:4294967295, h:1000]
00000400:00000200:12.0:1773851904.841791:0:41072:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770517, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770516, p:4294967295, g:4294967295, h:1000]
00000400:00000200:9.0:1773851904.841791:0:41071:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770517, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770516, p:4294967295, g:4294967295, h:1000]
00000400:00000200:0.0:1773851904.841792:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:12.0:1773851904.841793:0:41072:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000800:00000200:8.0:1773851904.841793:0:41068:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:0.0:1773851904.841793:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:12.0:1773851904.841794:0:41072:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:9.0:1773851904.841794:0:41071:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:0.0:1773851904.841794:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2095@kfi7
00000400:00000200:9.0:1773851904.841795:0:41071:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000800:00000200:8.0:1773851904.841795:0:41068:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Using peer 31@kfi7(0x56e)
00000400:00000200:0.0:1773851904.841795:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770518:8770518:1024:4294967295] 2095@kfi7 LPNI seq info [5406050:5406050:16:4294967295]
00000400:00000200:12.0:1773851904.841796:0:41072:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 54@kfi7
00000400:00000200:9.0:1773851904.841796:0:41071:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 6@kfi7
00000400:00000200:0.0:1773851904.841796:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:12.0:1773851904.841797:0:41072:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770520:8770520:1024:4294967295] 54@kfi7 LPNI seq info [5403930:5403930:16:4294967295]
00000400:00000200:9.0:1773851904.841797:0:41071:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770520:8770520:1024:4294967295] 6@kfi7 LPNI seq info [5405039:5405039:16:4294967295]
00000400:00000200:0.0:1773851904.841797:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:12.0:1773851904.841798:0:41072:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:12.0:1773851904.841799:0:41072:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000200:9.0:1773851904.841799:0:41071:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000800:00000200:8.0:1773851904.841799:0:41068:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000c8b1a09e: Posted send of 324 bytes to peer 0x56e: rc=0
00000400:00000200:0.0:1773851904.841799:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2095@kfi7(2095@kfi7:2095@kfi7) <?> : PUT try# 0
00000400:00000200:9.0:1773851904.841800:0:41071:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:8.0:1773851904.841800:0:41068:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:0.0:1773851904.841800:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000400:00000200:12.0:1773851904.841802:0:41072:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 54@kfi7(54@kfi7:54@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851904.841802:0:41068:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:0.0:1773851904.841802:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000100:00000001:8.0:1773851904.841803:0:41068:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:0.0:1773851904.841803:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:12.0:1773851904.841804:0:41072:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000400:00000200:9.0:1773851904.841804:0:41071:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 6@kfi7(6@kfi7:6@kfi7) <?> : PUT try# 0
00000100:00000001:8.0:1773851904.841804:0:41068:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851904.841804:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851904.841805:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:0.0:1773851904.841805:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:12.0:1773851904.841806:0:41072:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851904.841806:0:41071:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000100:00000001:8.0:1773851904.841806:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:8.0:1773851904.841806:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:12.0:1773851904.841807:0:41072:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851904.841807:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Using peer 2095@kfi7(0x2000000000005b3)
00000800:00000200:9.0:1773851904.841808:0:41071:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:8.0:1773851904.841808:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:12.0:1773851904.841809:0:41072:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:9.0:1773851904.841809:0:41071:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:8.0:1773851904.841809:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:0.0:1773851904.841810:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000a24d4899: Posted send of 324 bytes to peer 0x2000000000005b3: rc=0
00000800:00000200:12.0:1773851904.841812:0:41072:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Using peer 54@kfi7(0x20000000000063c)
00000800:00000200:9.0:1773851904.841812:0:41071:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851904.841812:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:8.0:1773851904.841813:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851904.841814:0:2464469:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e TN_EVENT_TX_OK event status 0
00000800:00000200:9.0:1773851904.841814:0:41071:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Using peer 6@kfi7(0x20000000000053d)
00000100:00000001:8.0:1773851904.841814:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.841814:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:12.0:1773851904.841815:0:41072:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000ad3645cb: Posted send of 324 bytes to peer 0x20000000000063c: rc=0
00000100:00000001:0.0:1773851904.841815:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:0.0:1773851904.841815:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851904.841816:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:0.0:1773851904.841816:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:12.0:1773851904.841817:0:41072:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851904.841817:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000100:00000001:12.0:1773851904.841818:0:41072:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:10.0:1773851904.841818:0:2464469:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000054a4b090
00000800:00000200:9.0:1773851904.841818:0:41071:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000743dc611: Posted send of 324 bytes to peer 0x20000000000053d: rc=0
00000100:00000001:12.0:1773851904.841819:0:41072:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000010:10.0:1773851904.841819:0:2464469:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000054a4b090.
00000100:00000001:10.0:1773851904.841819:0:2464469:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:0.0:1773851904.841819:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841820:0:41072:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:10.0:1773851904.841820:0:2464469:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851904.841820:0:41071:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:12.0:1773851904.841821:0:41072:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841821:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851904.841822:0:41071:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841822:0:41071:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:9.0:1773851904.841823:0:41071:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841824:0:41072:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851904.841824:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841824:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851904.841825:0:41072:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:10.0:1773851904.841825:0:2464469:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:1.0:1773851904.841825:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 TN_EVENT_TX_OK event status 0
00000100:00000001:12.0:1773851904.841826:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:10.0:1773851904.841826:0:2464469:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851904.841826:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851904.841826:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:1.0:1773851904.841826:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:12.0:1773851904.841827:0:41072:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:9.0:1773851904.841827:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851904.841827:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851904.841827:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000100:00000001:10.0:1773851904.841828:0:2464469:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841828:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841828:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851904.841828:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a92b0d66
00000400:00000010:1.0:1773851904.841828:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a92b0d66.
00000100:00000001:10.0:1773851904.841829:0:2464469:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:1.0:1773851904.841829:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:10.0:1773851904.841830:0:2464469:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000100:00000200:1.0:1773851904.841830:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:12.0:1773851904.841831:0:41072:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841832:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851904.841832:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c8b1a09e: 2069@kfi7:2 -> 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 2 tta 0x56e Transaction freed
00000800:00000200:9.0:1773851904.841832:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d TN_EVENT_TX_OK event status 0
00000800:00000200:14.0:1773851904.841833:0:2514739:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c TN_EVENT_TX_OK event status 0
00000100:00000001:1.0:1773851904.841833:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:14.0:1773851904.841834:0:2514739:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851904.841834:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:1.0:1773851904.841834:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851904.841835:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000400:00000200:14.0:1773851904.841836:0:2514739:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000400:00000200:14.0:1773851904.841836:0:2514739:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d0c203c4
00000400:00000200:9.0:1773851904.841836:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000cb80094
00000100:00000001:1.0:1773851904.841836:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:14.0:1773851904.841837:0:2514739:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d0c203c4.
00000400:00000010:9.0:1773851904.841837:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000cb80094.
00000100:00000001:1.0:1773851904.841837:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:14.0:1773851904.841838:0:2514739:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851904.841838:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:1.0:1773851904.841838:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000200:14.0:1773851904.841839:0:2514739:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851904.841839:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851904.841840:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a24d4899: 2054@kfi7:0 -> 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 0 tta 0x2000000000005b3 Transaction freed
00000100:00000001:14.0:1773851904.841842:0:2514739:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851904.841842:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:17.0:1773851904.841843:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000100:00000040:9.0:1773851904.841843:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851904.841844:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:14.0:1773851904.841844:0:2514739:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:17.0:1773851904.841846:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:14.0:1773851904.841846:0:2514739:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841846:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851904.841847:0:2514739:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:9.0:1773851904.841847:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:17.0:1773851904.841848:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:14.0:1773851904.841848:0:2514739:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:9.0:1773851904.841848:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:17.0:1773851904.841850:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:14.0:1773851904.841850:0:2514739:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ad3645cb: 2054@kfi7:3 -> 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x20000000000063c Transaction freed
00000800:00000200:9.0:1773851904.841850:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000743dc611: 2054@kfi7:2 -> 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000053d Transaction freed
00000400:00000200:17.0:1773851904.841852:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 31@kfi7 : PUT - for me
00000400:00000200:17.0:1773851904.841853:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851904.841853:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 1
00000400:00000200:17.0:1773851904.841854:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851904.841855:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000400:00000200:17.0:1773851904.841856:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 3
00000400:00000200:17.0:1773851904.841857:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000800:00000200:30.0:1773851904.841858:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:17.0:1773851904.841858:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-31@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7300
00000800:00000200:30.0:1773851904.841859:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851904.841860:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851904.841860:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 31@kfi7 to cpt 4
00000400:00000200:17.0:1773851904.841861:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-31@kfi7 of length 368/368 into md 0x6ab1f2711 [1] + 224
00000800:00000200:30.0:1773851904.841862:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851904.841863:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851904.841864:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:30.0:1773851904.841865:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2095@kfi7 : PUT - for me
00000400:00000200:17.0:1773851904.841865:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851904.841866:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000400:00000200:17.0:1773851904.841866:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->31@kfi7: PUT: OK
00000400:00000200:30.0:1773851904.841867:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 1
00000100:00000001:17.0:1773851904.841867:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:30.0:1773851904.841868:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000200:17.0:1773851904.841868:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:30.0:1773851904.841869:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000400:00000200:30.0:1773851904.841870:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 3
00000800:00000200:1.0:1773851904.841870:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:30.0:1773851904.841871:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000100:00000040:17.0:1773851904.841871:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851904.841871:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:30.0:1773851904.841872:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2095@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7340
00000800:00000200:13.0:1773851904.841872:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:1.0:1773851904.841872:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851904.841873:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2095@kfi7 to cpt 7
00000800:00000200:13.0:1773851904.841873:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851904.841874:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851904.841875:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2095@kfi7 of length 368/368 into md 0x78008251d [1] + 224
00000100:00000001:17.0:1773851904.841875:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:1.0:1773851904.841875:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851904.841876:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000124b43dd nid 31@kfi7 refs 2
00000800:00000200:30.0:1773851904.841877:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851904.841877:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:8.0:1773851904.841877:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851904.841877:0:41068:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:1.0:1773851904.841877:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000800:00000200:17.0:1773851904.841878:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 31@kfi7(0000000090941590):0x0 lsk 1391 rsk 4784 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000400:00000001:8.0:1773851904.841878:0:41068:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000200:30.0:1773851904.841879:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851904.841879:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000001:8.0:1773851904.841879:0:41068:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:1.0:1773851904.841879:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 6@kfi7 : PUT - for me
00000400:00000200:30.0:1773851904.841880:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2095@kfi7: PUT: OK
00000400:00000200:13.0:1773851904.841880:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 54@kfi7 : PUT - for me
00000400:00000010:8.0:1773851904.841880:0:41068:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000cb686a9f.
00000400:00000200:8.0:1773851904.841880:0:41068:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001b897718
00000400:00000200:1.0:1773851904.841880:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851904.841881:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000400:00000010:8.0:1773851904.841881:0:41068:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001b897718.
00000400:00000200:1.0:1773851904.841881:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 1
00000400:00000200:13.0:1773851904.841882:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 1
00000100:00000001:8.0:1773851904.841882:0:41068:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:1.0:1773851904.841882:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851904.841883:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000200:8.0:1773851904.841883:0:41068:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851904.841883:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:13.0:1773851904.841884:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001affe08e nid 54@kfi7 refs 2
00000400:00000200:1.0:1773851904.841884:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 3
00000400:00000200:13.0:1773851904.841885:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 3
00000100:00000001:30.0:1773851904.841886:0:2472963:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851904.841886:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000200:8.0:1773851904.841886:0:41068:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851904.841886:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000100:00000200:30.0:1773851904.841888:0:2472963:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851904.841888:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-54@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7380
00000100:00000001:8.0:1773851904.841888:0:41068:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:1.0:1773851904.841888:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-6@kfi7 of length 368 into portal 4 MB=0x69b24fe8b72c0
00000400:00000200:13.0:1773851904.841889:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 54@kfi7 to cpt 3
00000100:00000001:8.0:1773851904.841889:0:41068:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851904.841889:0:41068:0:(client.c:1428:after_reply()) Process entered
00000400:00000200:1.0:1773851904.841889:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 6@kfi7 to cpt 0
00000400:00000200:13.0:1773851904.841890:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-54@kfi7 of length 368/368 into md 0x82a5f776d [1] + 224
02000000:00000001:8.0:1773851904.841890:0:41068:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:8.0:1773851904.841890:0:41068:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000040:30.0:1773851904.841891:0:2472963:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851904.841891:0:41068:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851904.841891:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-6@kfi7 of length 368/368 into md 0x7fb71e9c1 [1] + 224
00000800:00000200:13.0:1773851904.841892:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
02000000:00000001:8.0:1773851904.841892:0:41068:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:8.0:1773851904.841893:0:41068:0:(import.c:1951:at_measured()) add 66 to 00000000f906a269 time=137 v=66 (66 66 66 66)
00000800:00000200:1.0:1773851904.841893:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851904.841894:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00001000:8.0:1773851904.841894:0:41068:0:(import.c:1951:at_measured()) add 1 to 00000000f9699ff4 time=137 v=66 (1 1 1 1)
00000100:00000001:30.0:1773851904.841895:0:2472963:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851904.841895:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->54@kfi7: PUT: OK
00000100:00000001:8.0:1773851904.841895:0:41068:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:8.0:1773851904.841895:0:41068:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851904.841895:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851904.841896:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007541d3b3 nid 2095@kfi7 refs 2
00000100:00000001:13.0:1773851904.841896:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00010000:00000001:8.0:1773851904.841896:0:41068:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000400:00000200:1.0:1773851904.841896:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->6@kfi7: PUT: OK
00000800:00000200:30.0:1773851904.841897:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000b26b1be8: 2054@kfi7:7 <- 2095@kfi7(00000000bd933a7d):0x0 lsk 1460 rsk 4791 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000200:13.0:1773851904.841897:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:8.0:1773851904.841897:0:41068:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.841897:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851904.841897:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:8.0:1773851904.841898:0:41068:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:8.0:1773851904.841898:0:41068:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0013-osc-MDT0001: skip recheck: last_committed 171931333400
00000100:00000001:1.0:1773851904.841898:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:0.0:1773851904.841898:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:8.0:1773851904.841899:0:41068:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:8.0:1773851904.841899:0:41068:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:1.0:1773851904.841899:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:0.0:1773851904.841899:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:8.0:1773851904.841900:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:0.0:1773851904.841900:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000002a9a269c.
00000100:00000040:13.0:1773851904.841901:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:0.0:1773851904.841901:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e89b889f
00000400:00000010:0.0:1773851904.841901:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e89b889f.
00000100:00000040:1.0:1773851904.841902:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851904.841902:0:41061:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:8.0:1773851904.841903:0:41068:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:8.0:1773851904.841903:0:41068:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000200:0.0:1773851904.841903:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:13.0:1773851904.841904:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851904.841905:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001affe08e nid 54@kfi7 refs 2
00000100:00000001:12.0:1773851904.841905:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:8.0:1773851904.841905:0:41068:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:8.0:1773851904.841905:0:41068:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:12.0:1773851904.841906:0:41072:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000040:8.0:1773851904.841906:0:41068:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0013-osc-MDT0001: Updating status = 0
00000100:00000001:1.0:1773851904.841906:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:0.0:1773851904.841906:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851904.841907:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 54@kfi7(000000005a4992d4):0x0 lsk 1597 rsk 4789 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000400:00000001:12.0:1773851904.841907:0:41072:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:12.0:1773851904.841907:0:41072:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000040:8.0:1773851904.841907:0:41068:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0013-osc-MDT0001: blocks=410399764480 free=351666697216 avail=351645539328 avail_mb=1373615388 hwm_mb=3131103 files=372237778 ffree=343424509 state=0: rc = 0
00000400:00000010:12.0:1773851904.841908:0:41072:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000001259ac8.
00000100:00000001:9.0:1773851904.841908:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:1.0:1773851904.841908:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d90779b8 nid 6@kfi7 refs 2
00000400:00000200:12.0:1773851904.841909:0:41072:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e3dfef6f
00000400:00000010:12.0:1773851904.841909:0:41072:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e3dfef6f.
00000100:00000001:9.0:1773851904.841909:0:41071:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000004:00000020:8.0:1773851904.841909:0:41068:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0013-osc-MDT0001 (00000000c6098346): 410399764480 blocks, 351666697216 free, 351645539328 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372237778 files, 343424509 free files
00000800:00000200:1.0:1773851904.841909:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 6@kfi7(00000000f58e6ca4):0x0 lsk 1342 rsk 4785 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851904.841909:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:0.0:1773851904.841909:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851904.841910:0:41072:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000001:9.0:1773851904.841910:0:41071:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:9.0:1773851904.841910:0:41071:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000004:00000001:8.0:1773851904.841910:0:41068:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.841910:0:41061:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:12.0:1773851904.841911:0:41072:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:9.0:1773851904.841911:0:41071:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000eb62b974.
00000100:00000040:8.0:1773851904.841911:0:41068:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:0.0:1773851904.841911:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:0.0:1773851904.841911:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:9.0:1773851904.841912:0:41071:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003289b6e6
00000400:00000010:9.0:1773851904.841912:0:41071:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003289b6e6.
00000100:00000001:0.0:1773851904.841912:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841913:0:41071:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:0.0:1773851904.841913:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:12.0:1773851904.841914:0:41072:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:9.0:1773851904.841914:0:41071:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:8.0:1773851904.841914:0:41068:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000037d69b00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_00:lustre5-MDT0001-mdtlov_UUID:41068:1859433051943680:31@kfi7:13:default-yuba2-0
00000100:00001000:0.0:1773851904.841914:0:41061:0:(import.c:1951:at_measured()) add 66 to 000000000eee4aaa time=137 v=66 (66 66 66 66)
00000100:00001000:0.0:1773851904.841915:0:41061:0:(import.c:1951:at_measured()) add 1 to 00000000ecd01df4 time=137 v=66 (1 1 1 1)
00000100:00000001:8.0:1773851904.841916:0:41068:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851904.841916:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:0.0:1773851904.841916:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841917:0:41072:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:12.0:1773851904.841917:0:41072:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000200:9.0:1773851904.841917:0:41071:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:8.0:1773851904.841917:0:41068:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:8.0:1773851904.841917:0:41068:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000037d69b00 x1859433051943680/t0(0) o13->lustre5-OST0013-osc-MDT0001@31@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:0.0:1773851904.841917:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:12.0:1773851904.841918:0:41072:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:12.0:1773851904.841918:0:41072:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00010000:00000001:0.0:1773851904.841918:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841919:0:41072:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:12.0:1773851904.841919:0:41072:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841919:0:41071:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:0.0:1773851904.841919:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:0.0:1773851904.841919:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0007-osc-MDT0001: skip recheck: last_committed 176226461838
02000000:00000001:12.0:1773851904.841920:0:41072:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841920:0:41071:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851904.841920:0:41068:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:8.0:1773851904.841920:0:41068:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:0.0:1773851904.841920:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:0.0:1773851904.841920:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:12.0:1773851904.841921:0:41072:0:(import.c:1951:at_measured()) add 66 to 00000000e16d0871 time=137 v=66 (66 66 66 66)
00000100:00000001:9.0:1773851904.841921:0:41071:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:9.0:1773851904.841921:0:41071:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
02000000:00000010:8.0:1773851904.841921:0:41068:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005350c348.
00000100:00000040:0.0:1773851904.841921:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:12.0:1773851904.841922:0:41072:0:(import.c:1951:at_measured()) add 1 to 00000000d5371c45 time=137 v=66 (1 1 1 1)
00000100:00000001:9.0:1773851904.841922:0:41071:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:9.0:1773851904.841922:0:41071:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:8.0:1773851904.841922:0:41068:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:12.0:1773851904.841923:0:41072:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:9.0:1773851904.841923:0:41071:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:8.0:1773851904.841923:0:41068:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:8.0:1773851904.841923:0:41068:0:(genops.c:1107:class_import_put()) import 000000008054c9ec refcount=2 obd=lustre5-OST0013-osc-MDT0001
00000100:00000001:12.0:1773851904.841924:0:41072:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851904.841924:0:41071:0:(import.c:1951:at_measured()) add 66 to 00000000c8f3839f time=137 v=66 (66 66 66 66)
00000020:00000001:8.0:1773851904.841924:0:41068:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:8.0:1773851904.841924:0:41068:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000002f6163b3.
00000100:00000001:0.0:1773851904.841924:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:12.0:1773851904.841925:0:41072:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:12.0:1773851904.841925:0:41072:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:9.0:1773851904.841925:0:41071:0:(import.c:1951:at_measured()) add 1 to 00000000f67d6a45 time=52 v=66 (1 1 1 1)
02000000:00000001:8.0:1773851904.841925:0:41068:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:0.0:1773851904.841925:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:0.0:1773851904.841925:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851904.841926:0:41072:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:9.0:1773851904.841926:0:41071:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:8.0:1773851904.841926:0:41068:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:8.0:1773851904.841926:0:41068:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000037d69b00.
00000004:00000001:0.0:1773851904.841926:0:41061:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:12.0:1773851904.841927:0:41072:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000f-osc-MDT0001: skip recheck: last_committed 193406113439
00000100:00000001:12.0:1773851904.841927:0:41072:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851904.841927:0:41071:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851904.841927:0:41071:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:8.0:1773851904.841927:0:41068:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000004:00000040:0.0:1773851904.841927:0:41061:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0007-osc-MDT0001: Updating status = 0
00000004:00000040:0.0:1773851904.841927:0:41061:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0007-osc-MDT0001: blocks=410399721472 free=351449316352 avail=351446785024 avail_mb=1372839004 hwm_mb=3131103 files=372160850 ffree=343212223 state=0: rc = 0
00000100:00000001:12.0:1773851904.841928:0:41072:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:9.0:1773851904.841928:0:41071:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851904.841928:0:41068:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:8.0:1773851904.841928:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:12.0:1773851904.841929:0:41072:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:9.0:1773851904.841929:0:41071:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:9.0:1773851904.841929:0:41071:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0017-osc-MDT0001: skip recheck: last_committed 176226843343
00000100:00000001:8.0:1773851904.841929:0:41068:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851904.841930:0:41071:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:9.0:1773851904.841930:0:41071:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851904.841930:0:41068:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851904.841930:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000020:0.0:1773851904.841930:0:41061:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0007-osc-MDT0001 (000000001fcaf447): 410399721472 blocks, 351449316352 free, 351446785024 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372160850 files, 343212223 free files
00000100:00000001:12.0:1773851904.841931:0:41072:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:9.0:1773851904.841931:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:8.0:1773851904.841931:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:0.0:1773851904.841931:0:41061:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841932:0:41072:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:12.0:1773851904.841933:0:41072:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:0.0:1773851904.841933:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:12.0:1773851904.841934:0:41072:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:9.0:1773851904.841934:0:41071:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000004:00000040:12.0:1773851904.841935:0:41072:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000f-osc-MDT0001: Updating status = 0
00000004:00000040:12.0:1773851904.841935:0:41072:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000f-osc-MDT0001: blocks=410399720448 free=351524080640 avail=351521324032 avail_mb=1373130172 hwm_mb=3131103 files=372113755 ffree=343285235 state=0: rc = 0
00000100:00000001:9.0:1773851904.841935:0:41071:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:9.0:1773851904.841936:0:41071:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:9.0:1773851904.841936:0:41071:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00100000:0.0:1773851904.841936:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ac7bcb57 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051943744:2095@kfi7:13:default-yuba2-0
00000004:00000020:12.0:1773851904.841937:0:41072:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000f-osc-MDT0001 (000000002522a6c1): 410399720448 blocks, 351524080640 free, 351521324032 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372113755 files, 343285235 free files
00000004:00000040:9.0:1773851904.841937:0:41071:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0017-osc-MDT0001: Updating status = 0
00000100:00000001:0.0:1773851904.841937:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:9.0:1773851904.841938:0:41071:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0017-osc-MDT0001: blocks=410399726592 free=351420217344 avail=351417829376 avail_mb=1372725896 hwm_mb=3131103 files=372008828 ffree=343183806 state=0: rc = 0
00000100:00000001:0.0:1773851904.841938:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000001:12.0:1773851904.841939:0:41072:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.841939:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ac7bcb57 x1859433051943744/t0(0) o13->lustre5-OST0007-osc-MDT0001@2095@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:12.0:1773851904.841940:0:41072:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:9.0:1773851904.841940:0:41071:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0017-osc-MDT0001 (00000000fd584715): 410399726592 blocks, 351420217344 free, 351417829376 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372008828 files, 343183806 free files
00000100:00000001:0.0:1773851904.841941:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:0.0:1773851904.841941:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000001:9.0:1773851904.841942:0:41071:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:0.0:1773851904.841942:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001d4af4cd.
00000100:00100000:12.0:1773851904.841943:0:41072:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ce8bc3d5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_03_00:lustre5-MDT0001-mdtlov_UUID:41072:1859433051943808:54@kfi7:13:default-yuba2-0
00000100:00000040:9.0:1773851904.841943:0:41071:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:0.0:1773851904.841943:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:0.0:1773851904.841943:0:41061:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:0.0:1773851904.841943:0:41061:0:(genops.c:1107:class_import_put()) import 000000005b27a69d refcount=7 obd=lustre5-OST0007-osc-MDT0001
00000100:00000001:12.0:1773851904.841944:0:41072:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851904.841944:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:12.0:1773851904.841945:0:41072:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000010:0.0:1773851904.841945:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000690adcac.
00000100:00000040:12.0:1773851904.841946:0:41072:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ce8bc3d5 x1859433051943808/t0(0) o13->lustre5-OST000f-osc-MDT0001@54@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:9.0:1773851904.841946:0:41071:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000001937abea pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_03:lustre5-MDT0001-mdtlov_UUID:41071:1859433051943616:6@kfi7:13:default-yuba2-0
02000000:00000001:0.0:1773851904.841946:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:0.0:1773851904.841946:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:0.0:1773851904.841946:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ac7bcb57.
00000100:00000001:9.0:1773851904.841947:0:41071:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851904.841947:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:12.0:1773851904.841948:0:41072:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:9.0:1773851904.841948:0:41071:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:0.0:1773851904.841948:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851904.841948:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:12.0:1773851904.841949:0:41072:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000040:9.0:1773851904.841949:0:41071:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000001937abea x1859433051943616/t0(0) o13->lustre5-OST0017-osc-MDT0001@6@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852057 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:0.0:1773851904.841949:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:0.0:1773851904.841949:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:12.0:1773851904.841950:0:41072:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 0000000077d03d26.
00000100:00000001:0.0:1773851904.841950:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:0.0:1773851904.841950:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:12.0:1773851904.841951:0:41072:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:12.0:1773851904.841951:0:41072:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:12.0:1773851904.841951:0:41072:0:(genops.c:1107:class_import_put()) import 00000000c439201d refcount=7 obd=lustre5-OST000f-osc-MDT0001
00000100:00000001:9.0:1773851904.841951:0:41071:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000020:00000001:12.0:1773851904.841952:0:41072:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000001:9.0:1773851904.841952:0:41071:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:9.0:1773851904.841952:0:41071:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000245f1981.
02000000:00000010:12.0:1773851904.841953:0:41072:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000061b717ba.
02000000:00000001:12.0:1773851904.841953:0:41072:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:9.0:1773851904.841953:0:41071:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:12.0:1773851904.841954:0:41072:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000020:00000001:9.0:1773851904.841954:0:41071:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:9.0:1773851904.841954:0:41071:0:(genops.c:1107:class_import_put()) import 00000000bd2bb069 refcount=4 obd=lustre5-OST0017-osc-MDT0001
00000100:00000010:12.0:1773851904.841955:0:41072:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ce8bc3d5.
00000100:00000001:12.0:1773851904.841955:0:41072:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000020:00000001:9.0:1773851904.841955:0:41071:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:9.0:1773851904.841955:0:41071:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000004f719342.
00000100:00000001:12.0:1773851904.841956:0:41072:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:12.0:1773851904.841956:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:9.0:1773851904.841956:0:41071:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:12.0:1773851904.841957:0:41072:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:9.0:1773851904.841957:0:41071:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:9.0:1773851904.841957:0:41071:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000001937abea.
00000100:00000001:12.0:1773851904.841958:0:41072:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.841958:0:41072:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851904.841958:0:41071:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:12.0:1773851904.841959:0:41072:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841959:0:41071:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851904.841959:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851904.841960:0:41071:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:9.0:1773851904.841961:0:41071:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851904.841962:0:41071:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:9.0:1773851904.841963:0:41071:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851904.854179:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851904.854180:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851904.854181:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851904.854183:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851904.854185:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.854186:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 26176@kfi7 : PUT - for me
00000400:00000200:1.0:1773851904.854187:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.854188:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 1
00000400:00000200:1.0:1773851904.854189:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.854190:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000400:00000200:1.0:1773851904.854190:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 3
00000400:00000200:1.0:1773851904.854191:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:1.0:1773851904.854192:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26176@kfi7 of length 224 into portal 12 MB=0x69b4b96e6d2c0
00000400:00000200:1.0:1773851904.854194:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26176@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 59064
00000800:00000200:1.0:1773851904.854196:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851904.854197:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851904.854198:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26176@kfi7: PUT: OK
00000100:00000001:1.0:1773851904.854199:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851904.854200:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851904.854201:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004e3a4f26.
00000100:00000040:1.0:1773851904.854202:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000004e3a4f26 x1859598816826048 msgsize 224
00000100:00100000:1.0:1773851904.854204:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-26176@kfi7 (source: 12345-26176@kfi7)
00000100:00000001:1.0:1773851904.854205:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851904.854205:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000100:00000001:0.0:1773851904.854206:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851904.854207:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851904.854207:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851904.854207:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851904.854208:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851904.854208:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851904.854209:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598816826048
00000020:00000001:0.0:1773851904.854210:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851904.854210:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e389470d7
00000020:00000001:0.0:1773851904.854211:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851904.854213:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000009fb796b refcount=5
00000020:00000001:0.0:1773851904.854214:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143382586368 : -106930326965248 : ffff9ebf57d87400)
00000020:00000001:0.0:1773851904.854215:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143382586368 : -106930326965248 : ffff9ebf57d87400)
00000100:00000001:0.0:1773851904.854216:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851904.854217:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851904.854217:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000877d5ffd.
00000020:00000010:0.0:1773851904.854218:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851904.854219:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851904.854220:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851904.854220:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851904.854221:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851904.854222:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851904.854222:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851904.854223:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.854223:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851904.854225:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851904.854225:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851904.854225:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851904.854225:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851904.854226:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26176@kfi7, seq: 1997649
00000100:00000001:2.0:1773851904.854227:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851904.854227:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.854227:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000009fb796b : new rpc_count 1
00000100:00000001:0.0:1773851904.854227:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327724672 : -106982381826944 : ffff9eb339224c80)
00000100:00000040:0.0:1773851904.854228:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004e3a4f26 x1859598816826048/t0(0) o400->d694a97a-c615-4ad0-9894-0a08ce0bc5b4@26176@kfi7:544/0 lens 224/0 e 0 to 0 dl 1773852659 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2132-0'
00000100:00000001:0.0:1773851904.854231:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851904.854231:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851904.854232:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004e3a4f26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:d694a97a-c615-4ad0-9894-0a08ce0bc5b4+5:39734:x1859598816826048:12345-26176@kfi7:400:default-tuolumne2132-0
00000100:00000200:0.0:1773851904.854233:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598816826048
00000020:00000001:0.0:1773851904.854234:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851904.854234:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851904.854235:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.854236:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851904.854236:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851904.854237:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851904.854237:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598816826048, found 0 last_xid 1859598816826047
00000020:00000001:0.0:1773851904.854238:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851904.854239:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851904.854239:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851904.854240:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.854241:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851904.854242:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851904.854242:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851904.854243:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000429643d9.
02000000:00000001:0.0:1773851904.854243:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.854244:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.854245:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851904.854245:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183152133795, transno 0, xid 1859598816826048
00010000:00000001:0.0:1773851904.854246:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851904.854247:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004e3a4f26 x1859598816826048/t0(0) o400->d694a97a-c615-4ad0-9894-0a08ce0bc5b4@26176@kfi7:544/0 lens 224/224 e 0 to 0 dl 1773852659 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2132-0'
00010000:00000001:0.0:1773851904.854249:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851904.854249:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851904.854250:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=137 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851904.854251:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851904.854252:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000095266bfa refcount 3 to 26176@kfi7
00000100:00000001:0.0:1773851904.854252:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958003808 : -107146751547808 : ffff9e8cf3ef6660)
02000000:00000001:0.0:1773851904.854253:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851904.854254:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851904.854254:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851904.854255:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26176@kfi7
00000400:00000010:0.0:1773851904.854255:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e89b889f.
00000100:00000200:0.0:1773851904.854256:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598816826048, offset 224
00000400:00000200:0.0:1773851904.854257:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26176@kfi7
00000400:00000200:0.0:1773851904.854258:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:0.0:1773851904.854259:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 1
00000400:00000200:0.0:1773851904.854260:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000400:00000200:0.0:1773851904.854261:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 3
00000400:00000200:0.0:1773851904.854262:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  26176@kfi7 local destination
00000400:00000200:0.0:1773851904.854263:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770521:8770521:1024:4294967295] 26176@kfi7 LPNI seq info [150618:150618:16:4294967295]
00000400:00000200:0.0:1773851904.854264:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000400:00000200:0.0:1773851904.854265:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26176@kfi7 to cpt 0
00000400:00000200:0.0:1773851904.854267:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 26176@kfi7(26176@kfi7:26176@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851904.854268:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 3
00000800:00000200:0.0:1773851904.854269:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851904.854270:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851904.854272:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851904.854274:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000725 Using peer 26176@kfi7(0x100000000000725)
00000800:00000200:0.0:1773851904.854277:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 000000005ebe09f2: Posted send of 324 bytes to peer 0x100000000000725: rc=0
00000800:00000200:0.0:1773851904.854278:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000725 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851904.854280:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851904.854281:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000095266bfa refcount 2 to 26176@kfi7
00010000:00000001:0.0:1773851904.854281:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851904.854282:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851904.854282:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851904.854283:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004e3a4f26 x1859598816826048/t0(0) o400->d694a97a-c615-4ad0-9894-0a08ce0bc5b4@26176@kfi7:544/0 lens 224/224 e 0 to 0 dl 1773852659 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2132-0'
00000100:00100000:0.0:1773851904.854287:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004e3a4f26 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:d694a97a-c615-4ad0-9894-0a08ce0bc5b4+5:39734:x1859598816826048:12345-26176@kfi7:400:default-tuolumne2132-0 Request processed in 55us (85us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851904.854289:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26176@kfi7, seq: 1997649
00000100:00000040:0.0:1773851904.854290:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000009fb796b : new rpc_count 0
00000100:00000001:0.0:1773851904.854291:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851904.854291:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851904.854292:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851904.854292:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000020:00000010:0.0:1773851904.854293:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000877d5ffd.
00000020:00000040:0.0:1773851904.854294:0:42868:0:(genops.c:882:class_export_put()) PUTting export 0000000009fb796b : new refcount 4
00000100:00000001:0.0:1773851904.854295:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851904.854300:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000725 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851904.854303:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851904.854304:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->26176@kfi7: PUT: OK
00000400:00000200:1.0:1773851904.854305:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e89b889f
00000400:00000010:1.0:1773851904.854306:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e89b889f.
00000100:00000001:1.0:1773851904.854307:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851904.854307:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851904.854308:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000056605a00 nid 26176@kfi7 refs 2
00000800:00000200:1.0:1773851904.854309:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005ebe09f2: 2054@kfi7:0 -> 26176@kfi7(00000000c60e57e8):0x0 lsk 1830 rsk 39 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000725 Transaction freed
00000800:00000200:29.0:1773851904.865640:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851904.865642:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851904.865644:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851904.865648:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851904.865651:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26563@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.865653:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26563@kfi7 : PUT - for me
00000400:00000200:29.0:1773851904.865655:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26563@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.865657:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000baed4a0b nid 26563@kfi7 refs 1
00000400:00000200:29.0:1773851904.865659:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26563@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.865660:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000baed4a0b nid 26563@kfi7 refs 2
00000400:00000200:29.0:1773851904.865662:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000baed4a0b nid 26563@kfi7 refs 3
00000400:00000200:29.0:1773851904.865663:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26563@kfi7 to cpt 7
00000400:00000200:29.0:1773851904.865665:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26563@kfi7 of length 224 into portal 12 MB=0x69b51cc6da300
00000400:00000200:29.0:1773851904.865667:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26563@kfi7 of length 224/224 into md 0x77fe1859d [64] + 17864
00000800:00000200:29.0:1773851904.865670:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851904.865673:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.865675:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26563@kfi7: PUT: OK
00000100:00000001:29.0:1773851904.865678:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851904.865679:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851904.865680:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a060c2e3.
00000100:00000040:29.0:1773851904.865682:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a060c2e3 x1859625484657408 msgsize 224
00000100:00100000:29.0:1773851904.865684:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-26563@kfi7 (source: 12345-26563@kfi7)
00000100:00000001:29.0:1773851904.865686:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851904.865687:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000baed4a0b nid 26563@kfi7 refs 2
00000100:00000001:28.0:1773851904.865689:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:29.0:1773851904.865690:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851904.865690:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851904.865691:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851904.865692:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851904.865693:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851904.865694:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859625484657408
00000020:00000001:28.0:1773851904.865696:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851904.865696:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e1b1009dc
00000020:00000001:28.0:1773851904.865699:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851904.865703:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000015f32c02 refcount=5918
00000020:00000001:28.0:1773851904.865704:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637136975640576 : -106936733911040 : ffff9ebdd9f63800)
00000020:00000001:28.0:1773851904.865706:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637136975640576 : -106936733911040 : ffff9ebdd9f63800)
00000100:00000001:28.0:1773851904.865709:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.865710:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851904.865711:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007019ce07.
00000020:00000010:28.0:1773851904.865713:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.865715:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851904.865716:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851904.865717:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851904.865718:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851904.865720:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851904.865721:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851904.865722:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.865723:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851904.865726:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851904.865729:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851904.865730:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851904.865731:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:28.0:1773851904.865732:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26563@kfi7, seq: 2055622
00000100:00000040:28.0:1773851904.865733:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000015f32c02 : new rpc_count 10
00000100:00000001:31.0:1773851904.865734:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851904.865735:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.865735:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405314944 : -106994304236672 : ffff9eb07280c380)
00000100:00000040:28.0:1773851904.865737:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a060c2e3 x1859625484657408/t0(0) o400->0a76d28d-b8c9-4ae2-a94e-e228108c2897@26563@kfi7:156/0 lens 224/0 e 0 to 0 dl 1773852271 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-tuolumne2151-0'
00000100:00000001:28.0:1773851904.865743:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851904.865744:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851904.865745:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a060c2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0a76d28d-b8c9-4ae2-a94e-e228108c2897+5918:39192:x1859625484657408:12345-26563@kfi7:400:login-tuolumne2151-0
00000100:00000200:28.0:1773851904.865748:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859625484657408
00000020:00000001:28.0:1773851904.865749:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851904.865750:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851904.865751:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.865752:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851904.865753:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851904.865755:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851904.865756:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859625484657408, found 0 last_xid 1859625452689151
00000020:00000001:28.0:1773851904.865757:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851904.865758:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851904.865759:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851904.865760:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.865761:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851904.865762:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851904.865763:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851904.865764:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000008a057a76.
02000000:00000001:28.0:1773851904.865765:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.865766:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.865767:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851904.865768:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593469, transno 0, xid 1859625484657408
00010000:00000001:28.0:1773851904.865769:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851904.865771:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a060c2e3 x1859625484657408/t0(0) o400->0a76d28d-b8c9-4ae2-a94e-e228108c2897@26563@kfi7:156/0 lens 224/224 e 0 to 0 dl 1773852271 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2151-0'
00010000:00000001:28.0:1773851904.865775:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851904.865776:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851904.865777:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=137 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851904.865779:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851904.865780:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000013997a60 refcount 3 to 26563@kfi7
00000100:00000001:28.0:1773851904.865781:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231803680 : -107130477747936 : ffff9e90bdede120)
02000000:00000001:28.0:1773851904.865783:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851904.865783:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851904.865784:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851904.865786:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26563@kfi7
00000400:00000010:28.0:1773851904.865787:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000074a7a0bc.
00000100:00000200:28.0:1773851904.865788:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859625484657408, offset 224
00000400:00000200:28.0:1773851904.865790:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26563@kfi7
00000400:00000200:28.0:1773851904.865792:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26563@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.865793:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000baed4a0b nid 26563@kfi7 refs 1
00000400:00000200:28.0:1773851904.865795:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000baed4a0b nid 26563@kfi7 refs 2
00000400:00000200:28.0:1773851904.865796:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000baed4a0b nid 26563@kfi7 refs 3
00000400:00000200:28.0:1773851904.865799:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26563@kfi7 local destination
00000400:00000200:28.0:1773851904.865801:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770522:8770522:1024:4294967295] 26563@kfi7 LPNI seq info [60171836:60171836:16:4294967295]
00000400:00000200:28.0:1773851904.865803:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000baed4a0b nid 26563@kfi7 refs 2
00000400:00000200:28.0:1773851904.865805:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26563@kfi7 to cpt 7
00000400:00000200:28.0:1773851904.865808:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26563@kfi7(26563@kfi7:26563@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851904.865810:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000baed4a0b nid 26563@kfi7 refs 3
00000800:00000200:28.0:1773851904.865812:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851904.865814:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851904.865817:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851904.865821:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x300000000000882 Using peer 26563@kfi7(0x300000000000882)
00000800:00000200:28.0:1773851904.865825:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000004655d1b3: Posted send of 324 bytes to peer 0x300000000000882: rc=0
00000800:00000200:28.0:1773851904.865827:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x300000000000882 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851904.865830:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851904.865832:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000013997a60 refcount 2 to 26563@kfi7
00010000:00000001:28.0:1773851904.865833:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851904.865835:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851904.865836:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851904.865837:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a060c2e3 x1859625484657408/t0(0) o400->0a76d28d-b8c9-4ae2-a94e-e228108c2897@26563@kfi7:156/0 lens 224/224 e 0 to 0 dl 1773852271 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-tuolumne2151-0'
00000100:00100000:28.0:1773851904.865842:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a060c2e3 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:0a76d28d-b8c9-4ae2-a94e-e228108c2897+5918:39192:x1859625484657408:12345-26563@kfi7:400:login-tuolumne2151-0 Request processed in 98us (160us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851904.865846:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26563@kfi7, seq: 2055622
00000100:00000040:28.0:1773851904.865847:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000015f32c02 : new rpc_count 9
00000100:00000001:28.0:1773851904.865849:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851904.865849:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851904.865851:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851904.865852:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:28.0:1773851904.865853:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007019ce07.
00000020:00000040:28.0:1773851904.865854:0:42267:0:(genops.c:882:class_export_put()) PUTting export 0000000015f32c02 : new refcount 5917
00000100:00000001:28.0:1773851904.865855:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851904.865863:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x300000000000882 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851904.865866:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851904.865867:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26563@kfi7: PUT: OK
00000400:00000200:29.0:1773851904.865868:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000074a7a0bc
00000400:00000010:29.0:1773851904.865869:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000074a7a0bc.
00000100:00000001:29.0:1773851904.865870:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851904.865871:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851904.865873:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000baed4a0b nid 26563@kfi7 refs 2
00000800:00000200:29.0:1773851904.865875:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004655d1b3: 2069@kfi7:7 -> 26563@kfi7(000000003249d5d8):0x0 lsk 2179 rsk 3 tsk 0 trmk 0 tmk 0 trr 7 tta 0x300000000000882 Transaction freed
00000800:00000200:5.0:1773851904.894385:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851904.894386:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851904.894387:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851904.894389:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851904.894391:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:5.0:1773851904.894392:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 14018@kfi7 : PUT - for me
00000400:00000200:5.0:1773851904.894393:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:5.0:1773851904.894397:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 1
00000400:00000200:5.0:1773851904.894397:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:5.0:1773851904.894398:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000400:00000200:5.0:1773851904.894399:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 3
00000400:00000200:5.0:1773851904.894400:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14019@kfi7 to cpt 4
00000400:00000200:5.0:1773851904.894401:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14019@kfi7 of length 224 into portal 12 MB=0x699e0e7d75d80
00000400:00000200:5.0:1773851904.894402:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14019@kfi7 of length 224/224 into md 0x793926dc5 [64] + 170256
00000800:00000200:5.0:1773851904.894404:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851904.894406:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851904.894407:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14018@kfi7: PUT: OK
00000100:00000001:5.0:1773851904.894408:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851904.894408:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851904.894409:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000000ed293b4.
00000100:00000040:5.0:1773851904.894410:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000000ed293b4 x1858041101639040 msgsize 224
00000100:00100000:5.0:1773851904.894412:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-14019@kfi7 (source: 12345-14018@kfi7)
00000100:00000001:5.0:1773851904.894413:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851904.894413:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000100:00000001:4.0:1773851904.894414:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851904.894414:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851904.894415:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2054@kfi7:1 <- 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851904.894415:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851904.894415:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851904.894416:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851904.894417:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041101639040
00000020:00000001:4.0:1773851904.894420:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851904.894420:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac925e0
00000020:00000001:4.0:1773851904.894421:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851904.894423:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f4bc5786 refcount=6
00000020:00000001:4.0:1773851904.894423:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631017472 : -107123078534144 : ffff9e9276f4ec00)
00000020:00000001:4.0:1773851904.894425:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631017472 : -107123078534144 : ffff9e9276f4ec00)
00000100:00000001:4.0:1773851904.894426:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851904.894427:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851904.894427:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b1f45ba0.
00000020:00000010:4.0:1773851904.894428:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851904.894429:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d85801b.
00000100:00000001:4.0:1773851904.894430:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851904.894430:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851904.894431:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851904.894432:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851904.894432:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851904.894433:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851904.894434:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851904.894435:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851904.894435:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851904.894436:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851904.894436:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:4.0:1773851904.894437:0:60963:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14019@kfi7, seq: 2002013
00000100:00000001:7.0:1773851904.894438:0:61015:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851904.894438:0:61015:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851904.894438:0:60963:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f4bc5786 : new rpc_count 1
00000100:00000001:4.0:1773851904.894438:0:60963:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113837100928 : -106959872450688 : ffff9eb876cc1f80)
00000100:00000040:4.0:1773851904.894440:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000000ed293b4 x1858041101639040/t0(0) o400->6b6ac767-84f5-4bcd-8873-5b9eb6f722cb@14019@kfi7:631/0 lens 224/0 e 0 to 0 dl 1773851991 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1367-0'
00000100:00000001:4.0:1773851904.894442:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851904.894443:0:60963:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:4.0:1773851904.894444:0:60963:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000000ed293b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6b6ac767-84f5-4bcd-8873-5b9eb6f722cb+6:39704:x1858041101639040:12345-14019@kfi7:400:default-tuolumne1367-0
00000100:00000200:4.0:1773851904.894445:0:60963:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041101639040
00000020:00000001:4.0:1773851904.894446:0:60963:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:4.0:1773851904.894446:0:60963:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:4.0:1773851904.894447:0:60963:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.894448:0:60963:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:4.0:1773851904.894449:0:60963:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:4.0:1773851904.894450:0:60963:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:4.0:1773851904.894450:0:60963:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041101639040, found 0 last_xid 1858041101639039
00000020:00000001:4.0:1773851904.894451:0:60963:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:4.0:1773851904.894452:0:60963:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:4.0:1773851904.894452:0:60963:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:4.0:1773851904.894453:0:60963:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.894454:0:60963:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:4.0:1773851904.894454:0:60963:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:4.0:1773851904.894454:0:60963:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:4.0:1773851904.894455:0:60963:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001c023165.
02000000:00000001:4.0:1773851904.894456:0:60963:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851904.894456:0:60963:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.894457:0:60963:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:4.0:1773851904.894458:0:60963:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096693986, transno 0, xid 1858041101639040
00010000:00000001:4.0:1773851904.894459:0:60963:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:4.0:1773851904.894459:0:60963:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000000ed293b4 x1858041101639040/t0(0) o400->6b6ac767-84f5-4bcd-8873-5b9eb6f722cb@14019@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1367-0'
00010000:00000001:4.0:1773851904.894462:0:60963:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:4.0:1773851904.894462:0:60963:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851904.894463:0:60963:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=136 v=66 (1 1 1 1)
00000100:00000001:4.0:1773851904.894464:0:60963:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:4.0:1773851904.894465:0:60963:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007186c27d refcount 3 to 14019@kfi7
00000100:00000001:4.0:1773851904.894466:0:60963:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921095774976 : -107152613776640 : ffff9e8b9684e300)
02000000:00000001:4.0:1773851904.894466:0:60963:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:4.0:1773851904.894467:0:60963:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851904.894468:0:60963:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:4.0:1773851904.894469:0:60963:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14018@kfi7
00000400:00000010:4.0:1773851904.894469:0:60963:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000970b84f9.
00000100:00000200:4.0:1773851904.894470:0:60963:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041101639040, offset 224
00000400:00000200:4.0:1773851904.894472:0:60963:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14018@kfi7
00000400:00000200:4.0:1773851904.894472:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:4.0:1773851904.894473:0:60963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 1
00000400:00000200:4.0:1773851904.894474:0:60963:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000400:00000200:4.0:1773851904.894476:0:60963:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 3
00000400:00000200:4.0:1773851904.894477:0:60963:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  14018@kfi7 local destination
00000400:00000200:4.0:1773851904.894478:0:60963:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770523:8770523:1024:4294967295] 14018@kfi7 LPNI seq info [7488134:7488134:16:4294967295]
00000400:00000200:4.0:1773851904.894480:0:60963:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000400:00000200:4.0:1773851904.894480:0:60963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14018@kfi7 to cpt 1
00000400:00000200:4.0:1773851904.894483:0:60963:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 14018@kfi7(14018@kfi7:14018@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851904.894484:0:60963:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 3
00000800:00000200:4.0:1773851904.894485:0:60963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:4.0:1773851904.894486:0:60963:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:4.0:1773851904.894488:0:60963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:4.0:1773851904.894490:0:60963:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086e Using peer 14018@kfi7(0x10000000000086e)
00000800:00000200:4.0:1773851904.894493:0:60963:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000fa7ea95a: Posted send of 324 bytes to peer 0x10000000000086e: rc=0
00000800:00000200:4.0:1773851904.894494:0:60963:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:4.0:1773851904.894496:0:60963:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:4.0:1773851904.894497:0:60963:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007186c27d refcount 2 to 14019@kfi7
00010000:00000001:4.0:1773851904.894498:0:60963:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:4.0:1773851904.894498:0:60963:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851904.894499:0:60963:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:4.0:1773851904.894500:0:60963:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000000ed293b4 x1858041101639040/t0(0) o400->6b6ac767-84f5-4bcd-8873-5b9eb6f722cb@14019@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1367-0'
00000100:00100000:4.0:1773851904.894504:0:60963:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000000ed293b4 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_069:6b6ac767-84f5-4bcd-8873-5b9eb6f722cb+6:39704:x1858041101639040:12345-14019@kfi7:400:default-tuolumne1367-0 Request processed in 60us (93us total) trans 0 rc 0/0
00000100:00100000:4.0:1773851904.894506:0:60963:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14019@kfi7, seq: 2002013
00000100:00000040:4.0:1773851904.894507:0:60963:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f4bc5786 : new rpc_count 0
00000100:00000001:4.0:1773851904.894509:0:60963:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:4.0:1773851904.894509:0:60963:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:4.0:1773851904.894510:0:60963:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851904.894510:0:60963:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d85801b.
00000020:00000010:4.0:1773851904.894511:0:60963:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b1f45ba0.
00000020:00000040:4.0:1773851904.894512:0:60963:0:(genops.c:882:class_export_put()) PUTting export 00000000f4bc5786 : new refcount 5
00000100:00000001:4.0:1773851904.894513:0:60963:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851904.894517:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086e TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851904.894519:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851904.894520:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->14018@kfi7: PUT: OK
00000400:00000200:5.0:1773851904.894521:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000970b84f9
00000400:00000010:5.0:1773851904.894521:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000970b84f9.
00000100:00000001:5.0:1773851904.894522:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851904.894522:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:5.0:1773851904.894523:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000024bffd66 nid 14018@kfi7 refs 2
00000800:00000200:5.0:1773851904.894525:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000fa7ea95a: 2054@kfi7:1 -> 14018@kfi7(000000005c7838da):0x0 lsk 2159 rsk 50 tsk 0 trmk 0 tmk 0 trr 1 tta 0x10000000000086e Transaction freed
00000400:00000200:29.0:1773851904.905736:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851904.905738:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:13.0:1773851904.983778:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851904.983779:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851904.983780:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851904.983782:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851904.983784:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.983785:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19857@kfi7 : PUT - for me
00000400:00000200:13.0:1773851904.983786:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.983787:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 1
00000400:00000200:13.0:1773851904.983789:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:13.0:1773851904.983789:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000400:00000200:13.0:1773851904.983790:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 3
00000400:00000200:13.0:1773851904.983791:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19856@kfi7 to cpt 0
00000400:00000200:13.0:1773851904.983792:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19856@kfi7 of length 224 into portal 12 MB=0x69b81a0ece0c0
00000400:00000200:13.0:1773851904.983793:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19856@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 64608
00000800:00000200:13.0:1773851904.983795:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851904.983797:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851904.983799:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19857@kfi7: PUT: OK
00000100:00000001:13.0:1773851904.983799:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851904.983800:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851904.983801:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000add9a3d8.
00000100:00000040:13.0:1773851904.983801:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000add9a3d8 x1859830913228992 msgsize 224
00000100:00100000:13.0:1773851904.983803:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-19856@kfi7 (source: 12345-19857@kfi7)
00000100:00000001:13.0:1773851904.983804:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:14.0:1773851904.983805:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851904.983805:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
02000000:00000001:14.0:1773851904.983806:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851904.983806:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:13.0:1773851904.983806:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851904.983807:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851904.983808:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851904.983808:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859830913228992
00000020:00000001:14.0:1773851904.983809:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851904.983809:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0873ce54255
00000020:00000001:14.0:1773851904.983810:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851904.983813:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006b180d1b refcount=5
00000020:00000001:14.0:1773851904.983813:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637143576656896 : -106930132894720 : ffff9ebf6369bc00)
00000020:00000001:14.0:1773851904.983814:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637143576656896 : -106930132894720 : ffff9ebf6369bc00)
00000100:00000001:14.0:1773851904.983815:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851904.983816:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851904.983817:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005718a032.
00000020:00000010:14.0:1773851904.983818:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851904.983819:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851904.983820:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851904.983820:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851904.983821:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851904.983822:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851904.983822:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851904.983823:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851904.983824:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851904.983825:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851904.983825:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851904.983826:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851904.983826:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851904.983827:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19856@kfi7, seq: 2289958
00000100:00000040:14.0:1773851904.983827:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006b180d1b : new rpc_count 1
00000100:00000001:14.0:1773851904.983828:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092541056 : -106946617010560 : ffff9ebb8ce21680)
00000100:00000001:12.0:1773851904.983828:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851904.983828:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851904.983829:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000add9a3d8 x1859830913228992/t0(0) o400->79fdafa2-6645-4cea-a794-10701a3109b4@19856@kfi7:631/0 lens 224/0 e 0 to 0 dl 1773851991 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1730-0'
00000100:00000001:14.0:1773851904.983832:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851904.983832:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851904.983834:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000add9a3d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:79fdafa2-6645-4cea-a794-10701a3109b4+5:39508:x1859830913228992:12345-19856@kfi7:400:default-tuolumne1730-0
00000100:00000200:14.0:1773851904.983835:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859830913228992
00000020:00000001:14.0:1773851904.983836:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851904.983837:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851904.983837:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.983838:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851904.983839:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851904.983839:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851904.983840:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859830913228992, found 0 last_xid 1859830913228991
00000020:00000001:14.0:1773851904.983841:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851904.983842:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851904.983842:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851904.983842:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.983843:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851904.983844:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851904.983844:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851904.983845:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e3ea259c.
02000000:00000001:14.0:1773851904.983845:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851904.983846:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.983847:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851904.983847:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096683572, transno 0, xid 1859830913228992
00010000:00000001:14.0:1773851904.983848:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851904.983849:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000add9a3d8 x1859830913228992/t0(0) o400->79fdafa2-6645-4cea-a794-10701a3109b4@19856@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1730-0'
00010000:00000001:14.0:1773851904.983851:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851904.983852:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851904.983852:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=137 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851904.983853:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851904.983854:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000999e0b93 refcount 3 to 19856@kfi7
00000100:00000001:14.0:1773851904.983855:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451616 : -107149715100000 : ffff9e8c434b2ea0)
02000000:00000001:14.0:1773851904.983856:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851904.983856:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851904.983857:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851904.983858:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19857@kfi7
00000400:00000010:14.0:1773851904.983859:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022ae072f.
00000100:00000200:14.0:1773851904.983859:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859830913228992, offset 224
00000400:00000200:14.0:1773851904.983861:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19857@kfi7
00000400:00000200:14.0:1773851904.983861:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:14.0:1773851904.983862:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 1
00000400:00000200:14.0:1773851904.983863:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000400:00000200:14.0:1773851904.983865:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 3
00000400:00000200:14.0:1773851904.983866:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19857@kfi7 local destination
00000400:00000200:14.0:1773851904.983867:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770524:8770524:1024:4294967295] 19857@kfi7 LPNI seq info [138973:138973:16:4294967295]
00000400:00000200:14.0:1773851904.983869:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000400:00000200:14.0:1773851904.983870:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19857@kfi7 to cpt 3
00000400:00000200:14.0:1773851904.983871:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19857@kfi7(19857@kfi7:19857@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851904.983873:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 3
00000800:00000200:14.0:1773851904.983875:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851904.983876:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851904.983878:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851904.983880:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0xea7 Using peer 19857@kfi7(0xea7)
00000800:00000200:14.0:1773851904.983883:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 000000004c2b9f01: Posted send of 324 bytes to peer 0xea7: rc=0
00000800:00000200:14.0:1773851904.983884:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0xea7 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851904.983886:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851904.983887:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000999e0b93 refcount 2 to 19856@kfi7
00010000:00000001:14.0:1773851904.983888:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851904.983888:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851904.983889:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851904.983890:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000add9a3d8 x1859830913228992/t0(0) o400->79fdafa2-6645-4cea-a794-10701a3109b4@19856@kfi7:631/0 lens 224/224 e 0 to 0 dl 1773851991 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1730-0'
00000100:00100000:14.0:1773851904.983895:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000add9a3d8 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:79fdafa2-6645-4cea-a794-10701a3109b4+5:39508:x1859830913228992:12345-19856@kfi7:400:default-tuolumne1730-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000800:00000200:13.0:1773851904.983897:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0xea7 TN_EVENT_TX_OK event status 0
00000100:00100000:14.0:1773851904.983898:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19856@kfi7, seq: 2289958
00000100:00000040:14.0:1773851904.983898:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006b180d1b : new rpc_count 0
00000400:00000200:13.0:1773851904.983898:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:14.0:1773851904.983899:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:13.0:1773851904.983899:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19857@kfi7: PUT: OK
00000100:00000001:14.0:1773851904.983900:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851904.983900:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000400:00000200:13.0:1773851904.983900:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022ae072f
00000400:00000010:13.0:1773851904.983900:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022ae072f.
00000020:00000010:14.0:1773851904.983901:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000100:00000001:13.0:1773851904.983901:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:14.0:1773851904.983902:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005718a032.
00000020:00000040:14.0:1773851904.983902:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000006b180d1b : new refcount 4
00000100:00000001:13.0:1773851904.983902:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851904.983902:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a35c3353 nid 19857@kfi7 refs 2
00000100:00000001:14.0:1773851904.983903:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851904.983904:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2069@kfi7:3 -> 19857@kfi7(00000000496b6125):0x0 lsk 3752 rsk 4 tsk 0 trmk 0 tmk 0 trr 3 tta 0xea7 Transaction freed
00000800:00000200:25.0:1773851904.992208:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851904.992209:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851904.992209:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851904.992211:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851904.992211:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851904.992213:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851904.992214:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 13394@kfi7(00000000d021356d):0xf2a version: 2; local version 2; negotiated version: 2
00000800:00000200:27.0:1773851904.992217:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851904.992217:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a Using peer 13394@kfi7(0x100000000000f2a)
00000400:00000200:27.0:1773851904.992220:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13394@kfi7 to cpt 6
00000400:00000200:25.0:1773851904.992221:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13394@kfi7 to cpt 6
00000400:00000200:27.0:1773851904.992222:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13394@kfi7 : PUT - for me
00000400:00000200:27.0:1773851904.992224:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13394@kfi7 to cpt 6
00000800:00000200:25.0:1773851904.992224:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 38 bytes to peer 0x100000000000f2a: rc=0
00000400:00000200:27.0:1773851904.992225:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000054494b6a nid 13394@kfi7 refs 1
00000800:00000200:25.0:1773851904.992226:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851904.992227:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13394@kfi7 to cpt 6
00000400:00000200:27.0:1773851904.992228:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000054494b6a nid 13394@kfi7 refs 2
00000400:00000200:27.0:1773851904.992230:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000054494b6a nid 13394@kfi7 refs 3
00000400:00000200:27.0:1773851904.992231:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13395@kfi7 to cpt 1
00000400:00000200:27.0:1773851904.992233:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13395@kfi7 of length 456 into portal 12 MB=0x69b4cd1f41380
00000400:00000200:27.0:1773851904.992236:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13395@kfi7 of length 456/456 into md 0x16159c9699 [64] + 46744
00000800:00000200:27.0:1773851904.992239:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851904.992240:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a TN_EVENT_TX_OK event status 0
00000400:00000200:27.0:1773851904.992242:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851904.992243:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13394@kfi7: PUT: OK
00000800:00000200:25.0:1773851904.992244:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a Transaction freed
00000100:00000001:27.0:1773851904.992245:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851904.992246:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851904.992248:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000dea8c683.
00000100:00000040:27.0:1773851904.992249:0:2464256:0:(events.c:358:request_in_callback()) incoming req@00000000dea8c683 x1859604102517632 msgsize 456
00000100:00100000:27.0:1773851904.992251:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-13395@kfi7 (source: 12345-13394@kfi7)
00000100:00000001:27.0:1773851904.992253:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851904.992255:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000054494b6a nid 13394@kfi7 refs 2
00000100:00000001:24.0:1773851904.992255:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851904.992256:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:27.0:1773851904.992257:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851904.992257:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851904.992258:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851904.992259:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851904.992260:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859604102517632
00000020:00000001:24.0:1773851904.992261:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851904.992262:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7ab94
00000020:00000001:24.0:1773851904.992263:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851904.992270:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000001481ae20 refcount=115
00000020:00000001:24.0:1773851904.992271:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105525064704 : -106968184486912 : ffff9eb6875c8400)
00000020:00000001:24.0:1773851904.992272:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105525064704 : -106968184486912 : ffff9eb6875c8400)
00000100:00000001:24.0:1773851904.992274:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851904.992275:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851904.992276:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851904.992278:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851904.992279:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851904.992280:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851904.992281:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851904.992282:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.992283:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.992285:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851904.992287:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851904.992287:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851904.992288:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851904.992288:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851904.992289:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13395@kfi7, seq: 1451911050
00000100:00000040:24.0:1773851904.992290:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000001481ae20 : new rpc_count 2
00000100:00000001:26.0:1773851904.992291:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851904.992292:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.992301:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637018804531584 : -107054905020032 : ffff9ea2566a3180)
00000100:00000040:24.0:1773851904.992303:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000dea8c683 x1859604102517632/t0(0) o17->76eaa1ef-5ee4-426c-80cc-0867211b0760@13395@kfi7:631/0 lens 456/0 e 0 to 0 dl 1773851991 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1334-0'
00000100:00000001:24.0:1773851904.992307:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851904.992308:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851904.992309:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000dea8c683 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:76eaa1ef-5ee4-426c-80cc-0867211b0760+115:39730:x1859604102517632:12345-13395@kfi7:17:default-tuolumne1334-0
00000100:00000200:24.0:1773851904.992311:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859604102517632
00000020:00000001:24.0:1773851904.992312:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851904.992313:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851904.992314:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.992315:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851904.992316:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:24.0:1773851904.992317:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851904.992318:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859604102517632, found 0 last_xid 1859603968649727
00000020:00000001:24.0:1773851904.992319:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851904.992320:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851904.992320:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851904.992321:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851904.992322:0:60973:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:24.0:1773851904.992323:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851904.992324:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851904.992325:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000eb9da9ee.
02000000:00000001:24.0:1773851904.992326:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.992327:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.992329:0:60973:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:24.0:1773851904.992329:0:60973:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:24.0:1773851904.992330:0:60973:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851904.992332:0:60973:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.992333:0:60973:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:24.0:1773851904.992334:0:60973:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 76eaa1ef-5ee4-426c-80cc-0867211b0760/000000001481ae20 free: 126633370845184 avail: 126633368748032
00000020:00000001:24.0:1773851904.992336:0:60973:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:24.0:1773851904.992336:0:60973:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 76eaa1ef-5ee4-426c-80cc-0867211b0760/000000001481ae20 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:24.0:1773851904.992343:0:60973:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:24.0:1773851904.992344:0:60973:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:24.0:1773851904.992345:0:60973:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 76eaa1ef-5ee4-426c-80cc-0867211b0760/000000001481ae20 reports grant 1810890751 dropped 0, local 1879048191
00000020:00000001:24.0:1773851904.992346:0:60973:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:24.0:1773851904.992347:0:60973:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:24.0:1773851904.992348:0:60973:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851904.992349:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264029026, transno 0, xid 1859604102517632
00010000:00000001:24.0:1773851904.992350:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851904.992351:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000dea8c683 x1859604102517632/t0(0) o17->76eaa1ef-5ee4-426c-80cc-0867211b0760@13395@kfi7:631/0 lens 456/432 e 0 to 0 dl 1773851991 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1334-0'
00010000:00000001:24.0:1773851904.992356:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851904.992357:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851904.992358:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=137 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851904.992359:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851904.992361:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e93c258b refcount 3 to 13395@kfi7
00000100:00000001:24.0:1773851904.992362:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636949266836384 : -107124442715232 : ffff9e9225a52ba0)
02000000:00000001:24.0:1773851904.992363:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851904.992364:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851904.992365:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851904.992366:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13394@kfi7
00000400:00000010:24.0:1773851904.992367:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000473d3742.
00000100:00000200:24.0:1773851904.992368:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1859604102517632, offset 224
00000400:00000200:24.0:1773851904.992371:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13394@kfi7
00000400:00000200:24.0:1773851904.992372:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13394@kfi7 to cpt 6
00000400:00000200:24.0:1773851904.992374:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000054494b6a nid 13394@kfi7 refs 1
00000400:00000200:24.0:1773851904.992375:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000054494b6a nid 13394@kfi7 refs 2
00000400:00000200:24.0:1773851904.992377:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000054494b6a nid 13394@kfi7 refs 3
00000400:00000200:24.0:1773851904.992379:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13394@kfi7 local destination
00000400:00000200:24.0:1773851904.992381:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770525:8770525:1024:4294967295] 13394@kfi7 LPNI seq info [17255155:17255155:16:4294967295]
00000400:00000200:24.0:1773851904.992384:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000054494b6a nid 13394@kfi7 refs 2
00000400:00000200:24.0:1773851904.992385:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13394@kfi7 to cpt 6
00000400:00000200:24.0:1773851904.992389:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13394@kfi7(13394@kfi7:13394@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851904.992391:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000054494b6a nid 13394@kfi7 refs 3
00000800:00000200:24.0:1773851904.992394:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851904.992395:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:24.0:1773851904.992399:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851904.992402:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a Using peer 13394@kfi7(0x100000000000f2a)
00000800:00000200:24.0:1773851904.992407:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 532 bytes to peer 0x100000000000f2a: rc=0
00000800:00000200:24.0:1773851904.992409:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851904.992412:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851904.992413:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e93c258b refcount 2 to 13395@kfi7
00010000:00000001:24.0:1773851904.992415:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851904.992415:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851904.992418:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851904.992419:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000dea8c683 x1859604102517632/t0(0) o17->76eaa1ef-5ee4-426c-80cc-0867211b0760@13395@kfi7:631/0 lens 456/432 e 0 to 0 dl 1773851991 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1334-0'
00000100:00100000:24.0:1773851904.992424:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000dea8c683 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:76eaa1ef-5ee4-426c-80cc-0867211b0760+115:39730:x1859604102517632:12345-13395@kfi7:17:default-tuolumne1334-0 Request processed in 116us (174us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851904.992428:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13395@kfi7, seq: 1451911050
00000100:00000040:24.0:1773851904.992429:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000001481ae20 : new rpc_count 1
00000100:00000001:24.0:1773851904.992430:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851904.992431:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851904.992432:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851904.992433:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851904.992434:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851904.992435:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000001481ae20 : new refcount 114
00000100:00000001:24.0:1773851904.992436:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851904.992444:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851904.992446:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851904.992448:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13394@kfi7: PUT: OK
00000400:00000200:25.0:1773851904.992450:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000473d3742
00000400:00000010:25.0:1773851904.992450:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000473d3742.
00000100:00000001:25.0:1773851904.992451:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851904.992452:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851904.992453:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000054494b6a nid 13394@kfi7 refs 2
00000800:00000200:25.0:1773851904.992456:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2054@kfi7:6 -> 13394@kfi7(00000000d021356d):0x0 lsk 3883 rsk 26 tsk 0 trmk 0 tmk 0 trr 6 tta 0x100000000000f2a Transaction freed
00000800:00000200:17.0:1773851904.997297:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851904.997298:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851904.997299:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851904.997301:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851904.997303:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851904.997304:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 9906@kfi7 : PUT - for me
00000400:00000200:17.0:1773851904.997305:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851904.997306:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 1
00000400:00000200:17.0:1773851904.997308:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851904.997308:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000400:00000200:17.0:1773851904.997309:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 3
00000400:00000200:17.0:1773851904.997310:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:17.0:1773851904.997311:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9906@kfi7 of length 224 into portal 12 MB=0x69b4b60839d80
00000400:00000200:17.0:1773851904.997312:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9906@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 52256
00000800:00000200:17.0:1773851904.997314:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851904.997316:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851904.997317:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9906@kfi7: PUT: OK
00000100:00000001:17.0:1773851904.997318:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851904.997318:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851904.997319:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f93cc836.
00000100:00000040:17.0:1773851904.997320:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000f93cc836 x1859597904354688 msgsize 224
00000100:00100000:17.0:1773851904.997321:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-9906@kfi7 (source: 12345-9906@kfi7)
00000100:00000001:17.0:1773851904.997323:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851904.997323:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000100:00000001:19.0:1773851904.997324:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851904.997325:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851904.997325:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851904.997325:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851904.997326:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851904.997327:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851904.997328:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597904354688
00000020:00000001:19.0:1773851904.997328:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851904.997329:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7a25b
00000020:00000001:19.0:1773851904.997329:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851904.997332:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000023536866 refcount=5
00000020:00000001:19.0:1773851904.997332:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637108661995520 : -106965047556096 : ffff9eb742564800)
00000020:00000001:19.0:1773851904.997333:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637108661995520 : -106965047556096 : ffff9eb742564800)
00000100:00000001:19.0:1773851904.997335:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851904.997336:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851904.997336:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000231c32fd.
00000020:00000010:19.0:1773851904.997337:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851904.997338:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851904.997339:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851904.997339:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851904.997340:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851904.997341:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851904.997341:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851904.997342:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851904.997343:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851904.997344:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851904.997344:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851904.997344:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:19.0:1773851904.997345:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9906@kfi7, seq: 2156454
00000100:00000001:16.0:1773851904.997345:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851904.997346:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000023536866 : new rpc_count 1
00000100:00000001:16.0:1773851904.997346:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851904.997347:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794798464 : -107029914753152 : ffff9ea827f36780)
00000100:00000001:16.0:1773851904.997347:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851904.997348:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000f93cc836 x1859597904354688/t0(0) o400->a9d92964-5099-4ac7-8280-1029cc3b4a3e@9906@kfi7:156/0 lens 224/0 e 0 to 0 dl 1773852271 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1098-0'
00000100:00000001:19.0:1773851904.997351:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851904.997351:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851904.997352:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000f93cc836 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:a9d92964-5099-4ac7-8280-1029cc3b4a3e+5:39709:x1859597904354688:12345-9906@kfi7:400:default-tuolumne1098-0
00000100:00000200:19.0:1773851904.997353:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597904354688
00000020:00000001:19.0:1773851904.997354:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851904.997355:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851904.997355:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851904.997356:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851904.997357:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851904.997357:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851904.997358:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597904354688, found 0 last_xid 1859597904354687
00000020:00000001:19.0:1773851904.997359:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851904.997360:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851904.997360:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851904.997361:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851904.997361:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851904.997362:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851904.997362:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851904.997364:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000065d114d7.
02000000:00000001:19.0:1773851904.997365:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851904.997365:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851904.997366:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851904.997367:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183258172994, transno 0, xid 1859597904354688
00010000:00000001:19.0:1773851904.997367:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851904.997368:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000f93cc836 x1859597904354688/t0(0) o400->a9d92964-5099-4ac7-8280-1029cc3b4a3e@9906@kfi7:156/0 lens 224/224 e 0 to 0 dl 1773852271 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1098-0'
00010000:00000001:19.0:1773851904.997370:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851904.997371:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851904.997372:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=137 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851904.997373:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851904.997374:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000eabdece refcount 3 to 9906@kfi7
00000100:00000001:19.0:1773851904.997374:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583517952 : -107156126033664 : ffff9e8ac52c1900)
02000000:00000001:19.0:1773851904.997375:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851904.997376:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851904.997376:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851904.997377:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9906@kfi7
00000400:00000010:19.0:1773851904.997378:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a69e3aa9.
00000100:00000200:19.0:1773851904.997379:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597904354688, offset 224
00000400:00000200:19.0:1773851904.997380:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9906@kfi7
00000400:00000200:19.0:1773851904.997381:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:19.0:1773851904.997382:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 1
00000400:00000200:19.0:1773851904.997383:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000400:00000200:19.0:1773851904.997384:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 3
00000400:00000200:19.0:1773851904.997385:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  9906@kfi7 local destination
00000400:00000200:19.0:1773851904.997387:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770526:8770526:1024:4294967295] 9906@kfi7 LPNI seq info [1035667:1035667:16:4294967295]
00000400:00000200:19.0:1773851904.997388:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000400:00000200:19.0:1773851904.997389:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9906@kfi7 to cpt 4
00000400:00000200:19.0:1773851904.997391:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 9906@kfi7(9906@kfi7:9906@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851904.997392:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 3
00000800:00000200:19.0:1773851904.997393:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851904.997394:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851904.997397:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851904.997399:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000168 Using peer 9906@kfi7(0x100000000000168)
00000800:00000200:19.0:1773851904.997402:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0x100000000000168: rc=0
00000800:00000200:19.0:1773851904.997403:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000168 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851904.997405:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851904.997406:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000eabdece refcount 2 to 9906@kfi7
00010000:00000001:19.0:1773851904.997407:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851904.997408:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851904.997408:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851904.997409:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f93cc836 x1859597904354688/t0(0) o400->a9d92964-5099-4ac7-8280-1029cc3b4a3e@9906@kfi7:156/0 lens 224/224 e 0 to 0 dl 1773852271 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1098-0'
00000100:00100000:19.0:1773851904.997412:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000f93cc836 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:a9d92964-5099-4ac7-8280-1029cc3b4a3e+5:39709:x1859597904354688:12345-9906@kfi7:400:default-tuolumne1098-0 Request processed in 60us (91us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851904.997414:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9906@kfi7, seq: 2156454
00000100:00000040:19.0:1773851904.997415:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000023536866 : new rpc_count 0
00000800:00000200:17.0:1773851904.997415:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000168 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851904.997416:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851904.997416:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:19.0:1773851904.997417:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851904.997417:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851904.997417:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->9906@kfi7: PUT: OK
00000020:00000010:19.0:1773851904.997418:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000400:00000200:17.0:1773851904.997418:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a69e3aa9
00000020:00000010:19.0:1773851904.997419:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000231c32fd.
00000020:00000040:19.0:1773851904.997419:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000023536866 : new refcount 4
00000400:00000010:17.0:1773851904.997419:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a69e3aa9.
00000100:00000001:19.0:1773851904.997420:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851904.997420:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851904.997421:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851904.997421:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007f6ba310 nid 9906@kfi7 refs 2
00000800:00000200:17.0:1773851904.997423:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 9906@kfi7(00000000a782ce97):0x0 lsk 361 rsk 13 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000168 Transaction freed
00000800:00000200:25.0:1773851905.024277:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851905.024278:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851905.024279:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851905.024281:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851905.024283:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.024285:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13153@kfi7 : PUT - for me
00000400:00000200:25.0:1773851905.024285:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.024286:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 1
00000400:00000200:25.0:1773851905.024287:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.024288:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000400:00000200:25.0:1773851905.024289:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 3
00000400:00000200:25.0:1773851905.024289:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.024290:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13153@kfi7 of length 224 into portal 12 MB=0x69b1761f68d40
00000400:00000200:25.0:1773851905.024291:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13153@kfi7 of length 224/224 into md 0x16159c9699 [64] + 47200
00000800:00000200:25.0:1773851905.024293:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851905.024294:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.024295:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13153@kfi7: PUT: OK
00000100:00000001:25.0:1773851905.024296:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851905.024296:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851905.024297:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000068789c41.
00000100:00000040:25.0:1773851905.024298:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000068789c41 x1859374590364992 msgsize 224
00000100:00100000:25.0:1773851905.024299:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-13153@kfi7 (source: 12345-13153@kfi7)
00000100:00000001:25.0:1773851905.024301:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851905.024301:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000100:00000001:24.0:1773851905.024302:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851905.024303:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851905.024303:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851905.024303:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851905.024303:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851905.024304:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851905.024305:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859374590364992
00000020:00000001:24.0:1773851905.024306:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851905.024306:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793afc65fb
00000020:00000001:24.0:1773851905.024307:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851905.024310:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009f1d1626 refcount=5
00000020:00000001:24.0:1773851905.024311:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636955093846016 : -107118615705600 : ffff9e9380f64800)
00000020:00000001:24.0:1773851905.024312:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636955093846016 : -107118615705600 : ffff9e9380f64800)
00000100:00000001:24.0:1773851905.024312:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.024313:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851905.024314:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851905.024315:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.024315:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851905.024316:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851905.024317:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851905.024317:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851905.024318:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851905.024319:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851905.024319:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.024320:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851905.024321:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851905.024321:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851905.024322:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851905.024322:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851905.024323:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13153@kfi7, seq: 2025201
00000100:00000040:24.0:1773851905.024323:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009f1d1626 : new rpc_count 1
00000100:00000001:26.0:1773851905.024324:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851905.024324:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.024324:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157358720 : -106936552192896 : ffff9ebde4cb0480)
00000100:00000040:24.0:1773851905.024325:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000068789c41 x1859374590364992/t0(0) o400->58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3@13153@kfi7:155/0 lens 224/0 e 0 to 0 dl 1773852270 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1312-0'
00000100:00000001:24.0:1773851905.024328:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.024328:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851905.024329:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000068789c41 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3+5:39892:x1859374590364992:12345-13153@kfi7:400:default-tuolumne1312-0
00000100:00000200:24.0:1773851905.024331:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859374590364992
00000020:00000001:24.0:1773851905.024332:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851905.024332:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851905.024333:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.024334:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851905.024334:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851905.024335:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851905.024335:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859374590364992, found 0 last_xid 1859374590364991
00000020:00000001:24.0:1773851905.024336:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851905.024337:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851905.024337:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851905.024338:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.024338:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851905.024339:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851905.024339:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851905.024340:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000264f0b4d.
02000000:00000001:24.0:1773851905.024341:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.024341:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.024342:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851905.024342:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182888316797, transno 0, xid 1859374590364992
00010000:00000001:24.0:1773851905.024343:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851905.024344:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000068789c41 x1859374590364992/t0(0) o400->58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3@13153@kfi7:155/0 lens 224/224 e 0 to 0 dl 1773852270 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1312-0'
00010000:00000001:24.0:1773851905.024346:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851905.024346:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851905.024347:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=138 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851905.024348:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851905.024349:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000eab27ea refcount 3 to 13153@kfi7
00000100:00000001:24.0:1773851905.024349:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636924130860416 : -107149578691200 : ffff9e8c4b6c9d80)
02000000:00000001:24.0:1773851905.024350:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851905.024351:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.024351:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851905.024352:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13153@kfi7
00000400:00000010:24.0:1773851905.024353:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d6088efc.
00000100:00000200:24.0:1773851905.024354:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859374590364992, offset 224
00000400:00000200:24.0:1773851905.024355:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13153@kfi7
00000400:00000200:24.0:1773851905.024356:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.024356:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 1
00000400:00000200:24.0:1773851905.024357:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000400:00000200:24.0:1773851905.024358:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 3
00000400:00000200:24.0:1773851905.024359:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13153@kfi7 local destination
00000400:00000200:24.0:1773851905.024360:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770527:8770527:1024:4294967295] 13153@kfi7 LPNI seq info [27813203:27813203:16:4294967295]
00000400:00000200:24.0:1773851905.024362:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000400:00000200:24.0:1773851905.024363:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13153@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.024364:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13153@kfi7(13153@kfi7:13153@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851905.024366:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 3
00000800:00000200:24.0:1773851905.024367:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851905.024368:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851905.024370:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851905.024372:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e9 Using peer 13153@kfi7(0x1000000000001e9)
00000800:00000200:24.0:1773851905.024375:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x1000000000001e9: rc=0
00000800:00000200:24.0:1773851905.024376:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851905.024378:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.024379:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000eab27ea refcount 2 to 13153@kfi7
00010000:00000001:24.0:1773851905.024379:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851905.024380:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.024380:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851905.024381:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000068789c41 x1859374590364992/t0(0) o400->58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3@13153@kfi7:155/0 lens 224/224 e 0 to 0 dl 1773852270 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1312-0'
00000100:00100000:24.0:1773851905.024384:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000068789c41 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:58f81a44-8bd2-4caf-bbda-8b0c0bf93cc3+5:39892:x1859374590364992:12345-13153@kfi7:400:default-tuolumne1312-0 Request processed in 55us (85us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851905.024387:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13153@kfi7, seq: 2025201
00000100:00000040:24.0:1773851905.024388:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009f1d1626 : new rpc_count 0
00000100:00000001:24.0:1773851905.024388:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851905.024389:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851905.024389:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.024390:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851905.024391:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851905.024392:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000009f1d1626 : new refcount 4
00000100:00000001:24.0:1773851905.024392:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851905.024397:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e9 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851905.024398:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.024399:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13153@kfi7: PUT: OK
00000400:00000200:25.0:1773851905.024400:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d6088efc
00000400:00000010:25.0:1773851905.024400:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d6088efc.
00000100:00000001:25.0:1773851905.024401:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851905.024401:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851905.024402:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e1907215 nid 13153@kfi7 refs 2
00000800:00000200:25.0:1773851905.024403:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 13153@kfi7(000000005af51c34):0x0 lsk 490 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000001e9 Transaction freed
00000800:00000200:17.0:1773851905.077907:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851905.077908:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851905.077908:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851905.077909:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851905.077909:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851905.077912:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851905.077912:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 16577@kfi7(0000000051231dc3):0x104a version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851905.077914:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a Using peer 16577@kfi7(0x10000000000104a)
00000800:00000200:18.0:1773851905.077915:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851905.077916:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000800:00000200:17.0:1773851905.077918:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x10000000000104a: rc=0
00000400:00000200:18.0:1773851905.077919:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000800:00000200:17.0:1773851905.077920:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851905.077921:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16577@kfi7 : PUT - for me
00000400:00000200:18.0:1773851905.077922:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:18.0:1773851905.077924:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 1
00000400:00000200:18.0:1773851905.077925:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:18.0:1773851905.077927:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000400:00000200:18.0:1773851905.077928:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 3
00000400:00000200:18.0:1773851905.077930:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16576@kfi7 to cpt 1
00000400:00000200:18.0:1773851905.077931:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16576@kfi7 of length 224 into portal 12 MB=0x69b4b5ac917c0
00000800:00000200:17.0:1773851905.077933:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851905.077934:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16576@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 52480
00000800:00000200:18.0:1773851905.077936:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851905.077936:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a Transaction freed
00000400:00000200:18.0:1773851905.077939:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851905.077941:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16577@kfi7: PUT: OK
00000100:00000001:18.0:1773851905.077943:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851905.077943:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851905.077944:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007cbc10bb.
00000100:00000040:18.0:1773851905.077946:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000007cbc10bb x1859597808244672 msgsize 224
00000100:00100000:18.0:1773851905.077948:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-16576@kfi7 (source: 12345-16577@kfi7)
00000100:00000001:18.0:1773851905.077950:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851905.077951:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000100:00000001:19.0:1773851905.077952:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851905.077953:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851905.077954:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:18.0:1773851905.077954:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851905.077955:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851905.077957:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851905.077958:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597808244672
00000020:00000001:19.0:1773851905.077959:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851905.077960:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d85c6e
00000020:00000001:19.0:1773851905.077961:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851905.077965:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000004ac5241 refcount=5
00000020:00000001:19.0:1773851905.077966:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637123907279872 : -106949802271744 : ffff9ebacf06dc00)
00000020:00000001:19.0:1773851905.077967:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637123907279872 : -106949802271744 : ffff9ebacf06dc00)
00000100:00000001:19.0:1773851905.077969:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851905.077971:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851905.077972:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e78e6ddd.
00000020:00000010:19.0:1773851905.077973:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851905.077975:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851905.077976:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851905.077977:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851905.077978:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851905.077979:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851905.077980:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851905.077981:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.077983:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851905.077985:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851905.077985:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851905.077986:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851905.077986:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851905.077988:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16576@kfi7, seq: 2156455
00000100:00000040:19.0:1773851905.077989:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000004ac5241 : new rpc_count 1
00000100:00000001:16.0:1773851905.077989:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851905.077990:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.077991:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609982720 : -107015099568896 : ffff9eab9b012d00)
00000100:00000040:19.0:1773851905.077993:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007cbc10bb x1859597808244672/t0(0) o400->1202a898-6271-4faf-b8a5-29782a51113a@16576@kfi7:157/0 lens 224/0 e 0 to 0 dl 1773852272 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1523-0'
00000100:00000001:19.0:1773851905.077996:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851905.077996:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851905.077998:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007cbc10bb pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1202a898-6271-4faf-b8a5-29782a51113a+5:39695:x1859597808244672:12345-16576@kfi7:400:default-tuolumne1523-0
00000100:00000200:19.0:1773851905.078000:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597808244672
00000020:00000001:19.0:1773851905.078000:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851905.078001:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851905.078002:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.078003:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851905.078003:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851905.078004:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851905.078005:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597808244672, found 0 last_xid 1859597808244671
00000020:00000001:19.0:1773851905.078006:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851905.078007:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851905.078007:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851905.078008:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.078009:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851905.078009:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851905.078010:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851905.078011:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ff4b95fa.
02000000:00000001:19.0:1773851905.078011:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.078012:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.078013:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851905.078014:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183035392088, transno 0, xid 1859597808244672
00010000:00000001:19.0:1773851905.078014:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851905.078015:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007cbc10bb x1859597808244672/t0(0) o400->1202a898-6271-4faf-b8a5-29782a51113a@16576@kfi7:157/0 lens 224/224 e 0 to 0 dl 1773852272 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1523-0'
00010000:00000001:19.0:1773851905.078018:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851905.078019:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851905.078020:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=138 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851905.078021:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851905.078022:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d9368660 refcount 3 to 16576@kfi7
00000100:00000001:19.0:1773851905.078022:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232979808 : -107130476571808 : ffff9e90bdffd360)
02000000:00000001:19.0:1773851905.078023:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851905.078024:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.078025:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851905.078026:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16577@kfi7
00000400:00000010:19.0:1773851905.078027:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d89c953e.
00000100:00000200:19.0:1773851905.078028:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597808244672, offset 224
00000400:00000200:19.0:1773851905.078029:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16577@kfi7
00000400:00000200:19.0:1773851905.078030:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:19.0:1773851905.078031:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 1
00000400:00000200:19.0:1773851905.078032:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000400:00000200:19.0:1773851905.078034:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 3
00000400:00000200:19.0:1773851905.078035:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16577@kfi7 local destination
00000400:00000200:19.0:1773851905.078037:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770528:8770528:1024:4294967295] 16577@kfi7 LPNI seq info [1116737:1116737:16:4294967295]
00000400:00000200:19.0:1773851905.078038:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000400:00000200:19.0:1773851905.078039:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16577@kfi7 to cpt 4
00000400:00000200:19.0:1773851905.078041:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16577@kfi7(16577@kfi7:16577@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851905.078043:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 3
00000800:00000200:19.0:1773851905.078044:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851905.078046:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851905.078048:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851905.078051:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a Using peer 16577@kfi7(0x10000000000104a)
00000800:00000200:19.0:1773851905.078054:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000008b0501c6: Posted send of 324 bytes to peer 0x10000000000104a: rc=0
00000800:00000200:19.0:1773851905.078056:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851905.078058:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851905.078059:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d9368660 refcount 2 to 16576@kfi7
00010000:00000001:19.0:1773851905.078060:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851905.078060:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.078061:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851905.078062:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007cbc10bb x1859597808244672/t0(0) o400->1202a898-6271-4faf-b8a5-29782a51113a@16576@kfi7:157/0 lens 224/224 e 0 to 0 dl 1773852272 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1523-0'
00000100:00100000:19.0:1773851905.078069:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007cbc10bb pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:1202a898-6271-4faf-b8a5-29782a51113a+5:39695:x1859597808244672:12345-16576@kfi7:400:default-tuolumne1523-0 Request processed in 72us (123us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851905.078069:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851905.078071:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851905.078072:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16576@kfi7, seq: 2156455
00000400:00000200:17.0:1773851905.078072:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16577@kfi7: PUT: OK
00000100:00000040:19.0:1773851905.078073:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000004ac5241 : new rpc_count 0
00000400:00000200:17.0:1773851905.078073:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d89c953e
00000400:00000010:17.0:1773851905.078073:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d89c953e.
00000100:00000001:19.0:1773851905.078074:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851905.078074:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:17.0:1773851905.078074:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851905.078074:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851905.078075:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851905.078075:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009decd7b0 nid 16577@kfi7 refs 2
00000020:00000010:19.0:1773851905.078076:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000020:00000010:19.0:1773851905.078077:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e78e6ddd.
00000800:00000200:17.0:1773851905.078077:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000008b0501c6: 2054@kfi7:4 -> 16577@kfi7(0000000051231dc3):0x0 lsk 4171 rsk 11 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000104a Transaction freed
00000020:00000040:19.0:1773851905.078078:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000004ac5241 : new refcount 4
00000100:00000001:19.0:1773851905.078079:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851905.089062:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851905.089063:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851905.089066:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851905.089069:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851905.089073:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:17.0:1773851905.089075:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 12291@kfi7 : PUT - for me
00000400:00000200:17.0:1773851905.089077:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:17.0:1773851905.089079:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 1
00000400:00000200:17.0:1773851905.089081:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:17.0:1773851905.089082:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000400:00000200:17.0:1773851905.089083:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 3
00000400:00000200:17.0:1773851905.089085:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12483@kfi7 to cpt 6
00000400:00000200:17.0:1773851905.089087:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12483@kfi7 of length 224 into portal 12 MB=0x699e0a6c2ea40
00000400:00000200:17.0:1773851905.089089:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12483@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 52704
00000800:00000200:17.0:1773851905.089092:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851905.089095:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851905.089096:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12291@kfi7: PUT: OK
00000100:00000001:17.0:1773851905.089098:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851905.089099:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851905.089100:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000be856f6b.
00000100:00000040:17.0:1773851905.089101:0:2511435:0:(events.c:358:request_in_callback()) incoming req@00000000be856f6b x1858040009779776 msgsize 224
00000100:00100000:17.0:1773851905.089104:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-12483@kfi7 (source: 12345-12291@kfi7)
00000100:00000001:17.0:1773851905.089105:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851905.089107:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000100:00000001:19.0:1773851905.089108:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851905.089109:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:17.0:1773851905.089109:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851905.089110:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851905.089111:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851905.089112:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851905.089113:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040009779776
00000020:00000001:19.0:1773851905.089114:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851905.089114:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a10
00000020:00000001:19.0:1773851905.089115:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851905.089117:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a8e20867 refcount=6
00000020:00000001:19.0:1773851905.089118:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921242254336 : -107152467297280 : ffff9e8b9f3ffc00)
00000020:00000001:19.0:1773851905.089120:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921242254336 : -107152467297280 : ffff9e8b9f3ffc00)
00000100:00000001:19.0:1773851905.089121:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851905.089122:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851905.089123:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e78e6ddd.
00000020:00000010:19.0:1773851905.089125:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851905.089126:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851905.089127:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851905.089128:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851905.089129:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851905.089130:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851905.089132:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851905.089132:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.089134:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851905.089136:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851905.089137:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851905.089137:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851905.089137:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851905.089138:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12483@kfi7, seq: 2156456
00000100:00000040:19.0:1773851905.089140:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a8e20867 : new rpc_count 1
00000100:00000001:16.0:1773851905.089140:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.089141:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794776576 : -107029914775040 : ffff9ea827f31200)
00000100:00000001:16.0:1773851905.089142:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851905.089143:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000be856f6b x1858040009779776/t0(0) o400->eaccd46a-924c-467e-a4e3-8b698464c35c@12483@kfi7:157/0 lens 224/0 e 0 to 0 dl 1773852272 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1271-0'
00000100:00000001:19.0:1773851905.089148:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851905.089149:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851905.089151:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000be856f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:eaccd46a-924c-467e-a4e3-8b698464c35c+6:39709:x1858040009779776:12345-12483@kfi7:400:default-tuolumne1271-0
00000100:00000200:19.0:1773851905.089153:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040009779776
00000020:00000001:19.0:1773851905.089154:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851905.089155:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851905.089156:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.089157:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851905.089158:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851905.089159:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851905.089160:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040009779776, found 0 last_xid 1858040009779775
00000020:00000001:19.0:1773851905.089161:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851905.089162:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851905.089163:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851905.089164:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.089165:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851905.089166:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851905.089166:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851905.089167:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000231c32fd.
02000000:00000001:19.0:1773851905.089169:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.089170:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.089171:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851905.089172:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096705810, transno 0, xid 1858040009779776
00010000:00000001:19.0:1773851905.089174:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851905.089175:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000be856f6b x1858040009779776/t0(0) o400->eaccd46a-924c-467e-a4e3-8b698464c35c@12483@kfi7:157/0 lens 224/224 e 0 to 0 dl 1773852272 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1271-0'
00010000:00000001:19.0:1773851905.089180:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851905.089181:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851905.089182:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=138 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851905.089184:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851905.089185:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000066079c3b refcount 3 to 12483@kfi7
00000100:00000001:19.0:1773851905.089186:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299331776 : -107155410219840 : ffff9e8aefd68cc0)
02000000:00000001:19.0:1773851905.089187:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851905.089188:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.089189:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851905.089190:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12291@kfi7
00000400:00000010:19.0:1773851905.089191:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c937ac03.
00000100:00000200:19.0:1773851905.089192:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040009779776, offset 224
00000400:00000200:19.0:1773851905.089195:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12291@kfi7
00000400:00000200:19.0:1773851905.089196:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:19.0:1773851905.089198:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 1
00000400:00000200:19.0:1773851905.089199:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000400:00000200:19.0:1773851905.089201:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 3
00000400:00000200:19.0:1773851905.089203:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  12291@kfi7 local destination
00000400:00000200:19.0:1773851905.089205:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770529:8770529:1024:4294967295] 12291@kfi7 LPNI seq info [255609:255609:16:4294967295]
00000400:00000200:19.0:1773851905.089207:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000400:00000200:19.0:1773851905.089208:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12291@kfi7 to cpt 4
00000400:00000200:19.0:1773851905.089211:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 12291@kfi7(12291@kfi7:12291@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851905.089213:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 3
00000800:00000200:19.0:1773851905.089215:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851905.089217:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851905.089221:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851905.089227:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x921 Using peer 12291@kfi7(0x921)
00000800:00000200:19.0:1773851905.089232:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000822b3938: Posted send of 324 bytes to peer 0x921: rc=0
00000800:00000200:19.0:1773851905.089234:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x921 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851905.089237:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851905.089238:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000066079c3b refcount 2 to 12483@kfi7
00010000:00000001:19.0:1773851905.089239:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851905.089240:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.089241:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851905.089242:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000be856f6b x1858040009779776/t0(0) o400->eaccd46a-924c-467e-a4e3-8b698464c35c@12483@kfi7:157/0 lens 224/224 e 0 to 0 dl 1773852272 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1271-0'
00000100:00100000:19.0:1773851905.089248:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000be856f6b pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:eaccd46a-924c-467e-a4e3-8b698464c35c+6:39709:x1858040009779776:12345-12483@kfi7:400:default-tuolumne1271-0 Request processed in 98us (145us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851905.089248:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x921 TN_EVENT_TX_OK event status 0
00000100:00100000:19.0:1773851905.089251:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12483@kfi7, seq: 2156456
00000400:00000200:17.0:1773851905.089251:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:19.0:1773851905.089252:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a8e20867 : new rpc_count 0
00000100:00000001:19.0:1773851905.089253:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851905.089253:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->12291@kfi7: PUT: OK
00000100:00000001:19.0:1773851905.089254:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851905.089254:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851905.089254:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c937ac03
00000020:00000010:19.0:1773851905.089255:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000400:00000010:17.0:1773851905.089255:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c937ac03.
00000020:00000010:19.0:1773851905.089256:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e78e6ddd.
00000100:00000001:17.0:1773851905.089256:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:19.0:1773851905.089257:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000a8e20867 : new refcount 5
00000100:00000001:17.0:1773851905.089257:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:19.0:1773851905.089258:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851905.089258:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008b8e44c9 nid 12291@kfi7 refs 2
00000800:00000200:17.0:1773851905.089260:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000822b3938: 2069@kfi7:4 -> 12291@kfi7(000000009b154916):0x0 lsk 2338 rsk 53 tsk 0 trmk 0 tmk 0 trr 4 tta 0x921 Transaction freed
00000800:00000200:29.0:1773851905.138013:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851905.138015:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851905.138016:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851905.138019:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851905.138021:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.138023:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24610@kfi7 : PUT - for me
00000400:00000200:29.0:1773851905.138024:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.138025:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 1
00000400:00000200:29.0:1773851905.138027:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.138028:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000400:00000200:29.0:1773851905.138029:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 3
00000400:00000200:29.0:1773851905.138030:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24802@kfi7 to cpt 2
00000400:00000200:29.0:1773851905.138031:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24802@kfi7 of length 224 into portal 12 MB=0x69a9dbfb44f80
00000400:00000200:29.0:1773851905.138032:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24802@kfi7 of length 224/224 into md 0x77fe1859d [64] + 18088
00000800:00000200:29.0:1773851905.138035:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851905.138037:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.138038:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24610@kfi7: PUT: OK
00000100:00000001:29.0:1773851905.138039:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851905.138040:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851905.138041:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000094e0f615.
00000100:00000040:29.0:1773851905.138042:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000094e0f615 x1858852177072000 msgsize 224
00000100:00100000:29.0:1773851905.138044:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-24802@kfi7 (source: 12345-24610@kfi7)
00000100:00000001:29.0:1773851905.138045:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851905.138046:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000800:00000200:29.0:1773851905.138048:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851905.138049:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:28.0:1773851905.138050:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851905.138051:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851905.138052:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851905.138054:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851905.138056:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858852177072000
00000020:00000001:28.0:1773851905.138057:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851905.138058:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917d2
00000020:00000001:28.0:1773851905.138059:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851905.138064:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e408d3e7 refcount=6
00000020:00000001:28.0:1773851905.138066:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241738240 : -107152467813376 : ffff9e8b9f381c00)
00000020:00000001:28.0:1773851905.138067:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241738240 : -107152467813376 : ffff9e8b9f381c00)
00000100:00000001:28.0:1773851905.138069:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851905.138070:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851905.138072:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000007019ce07.
00000020:00000010:28.0:1773851905.138073:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851905.138075:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000075a9b189.
00000100:00000001:28.0:1773851905.138077:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851905.138078:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851905.138079:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851905.138081:0:42267:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:28.0:1773851905.138082:0:42267:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:28.0:1773851905.138083:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.138084:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.138086:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851905.138087:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851905.138087:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851905.138088:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24802@kfi7, seq: 2055623
00000100:00000001:28.0:1773851905.138088:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851905.138089:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e408d3e7 : new rpc_count 1
00000100:00000001:31.0:1773851905.138090:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405310336 : -106994304241280 : ffff9eb07280b180)
00000100:00000001:28.0:1773851905.138090:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.138091:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.138092:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000094e0f615 x1858852177072000/t0(0) o400->ff2c26b8-dedd-4a7b-b20c-24247e1a648d@24802@kfi7:693/0 lens 224/0 e 0 to 0 dl 1773852053 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2027-0'
00000100:00000001:31.0:1773851905.138095:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.138096:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851905.138097:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000094e0f615 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:ff2c26b8-dedd-4a7b-b20c-24247e1a648d+6:39653:x1858852177072000:12345-24802@kfi7:400:default-tuolumne2027-0
00000100:00000200:31.0:1773851905.138099:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858852177072000
00000020:00000001:31.0:1773851905.138100:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851905.138100:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851905.138101:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.138102:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851905.138103:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851905.138104:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851905.138104:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858852177072000, found 0 last_xid 1858852177071999
00000020:00000001:31.0:1773851905.138105:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851905.138107:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851905.138107:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851905.138108:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.138109:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851905.138110:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851905.138110:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851905.138111:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002590e767.
02000000:00000001:31.0:1773851905.138112:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.138113:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.138113:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851905.138114:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824191, transno 0, xid 1858852177072000
00010000:00000001:31.0:1773851905.138115:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851905.138116:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000094e0f615 x1858852177072000/t0(0) o400->ff2c26b8-dedd-4a7b-b20c-24247e1a648d@24802@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2027-0'
00010000:00000001:31.0:1773851905.138119:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851905.138120:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851905.138121:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=138 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851905.138123:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851905.138124:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000070fdc554 refcount 3 to 24802@kfi7
00000100:00000001:31.0:1773851905.138126:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051133024 : -107146658418592 : ffff9e8cf97c7060)
02000000:00000001:31.0:1773851905.138127:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851905.138128:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.138129:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851905.138131:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24610@kfi7
00000400:00000010:31.0:1773851905.138132:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000022265b70.
00000100:00000200:31.0:1773851905.138133:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858852177072000, offset 224
00000400:00000200:31.0:1773851905.138136:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24610@kfi7
00000400:00000200:31.0:1773851905.138137:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.138139:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 1
00000400:00000200:31.0:1773851905.138141:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000400:00000200:31.0:1773851905.138143:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 3
00000400:00000200:31.0:1773851905.138145:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24610@kfi7 local destination
00000400:00000200:31.0:1773851905.138147:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770530:8770530:1024:4294967295] 24610@kfi7 LPNI seq info [773234:773234:16:4294967295]
00000400:00000200:31.0:1773851905.138150:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000400:00000200:31.0:1773851905.138152:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24610@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.138156:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24610@kfi7(24610@kfi7:24610@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851905.138158:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 3
00000800:00000200:31.0:1773851905.138161:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851905.138163:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851905.138167:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851905.138172:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0xbb3 Using peer 24610@kfi7(0xbb3)
00000800:00000200:31.0:1773851905.138177:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 324 bytes to peer 0xbb3: rc=0
00000800:00000200:31.0:1773851905.138180:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0xbb3 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851905.138183:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.138185:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000070fdc554 refcount 2 to 24802@kfi7
00010000:00000001:31.0:1773851905.138186:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851905.138187:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.138188:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851905.138190:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000094e0f615 x1858852177072000/t0(0) o400->ff2c26b8-dedd-4a7b-b20c-24247e1a648d@24802@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2027-0'
00000800:00000200:30.0:1773851905.138193:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0xbb3 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851905.138195:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:31.0:1773851905.138196:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000094e0f615 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:ff2c26b8-dedd-4a7b-b20c-24247e1a648d+6:39653:x1858852177072000:12345-24802@kfi7:400:default-tuolumne2027-0 Request processed in 99us (153us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851905.138197:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24610@kfi7: PUT: OK
00000400:00000200:30.0:1773851905.138198:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000022265b70
00000400:00000010:30.0:1773851905.138198:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000022265b70.
00000100:00000001:30.0:1773851905.138199:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:31.0:1773851905.138200:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24802@kfi7, seq: 2055623
00000100:00000001:30.0:1773851905.138200:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:31.0:1773851905.138201:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e408d3e7 : new rpc_count 0
00000400:00000200:30.0:1773851905.138201:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f0e29484 nid 24610@kfi7 refs 2
00000100:00000001:31.0:1773851905.138203:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:30.0:1773851905.138203:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2069@kfi7:7 -> 24610@kfi7(0000000064cca3c2):0x0 lsk 2996 rsk 44 tsk 0 trmk 0 tmk 0 trr 7 tta 0xbb3 Transaction freed
00000100:00000001:31.0:1773851905.138204:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851905.138205:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851905.138206:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000075a9b189.
00000020:00000010:31.0:1773851905.138208:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000007019ce07.
00000020:00000040:31.0:1773851905.138209:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000e408d3e7 : new refcount 5
00000100:00000001:31.0:1773851905.138211:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851905.149532:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851905.149534:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851905.149536:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851905.149540:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851905.149543:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851905.149545:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24529@kfi7 : PUT - for me
00000400:00000200:1.0:1773851905.149546:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851905.149548:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 1
00000400:00000200:1.0:1773851905.149549:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851905.149550:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000400:00000200:1.0:1773851905.149552:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 3
00000400:00000200:1.0:1773851905.149553:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:1.0:1773851905.149555:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24529@kfi7 of length 224 into portal 12 MB=0x699e132bd7fc0
00000400:00000200:1.0:1773851905.149557:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24529@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 59288
00000800:00000200:1.0:1773851905.149560:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851905.149563:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851905.149564:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24529@kfi7: PUT: OK
00000100:00000001:1.0:1773851905.149566:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851905.149566:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851905.149569:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009a127fcd.
00000100:00000040:1.0:1773851905.149570:0:2494030:0:(events.c:358:request_in_callback()) incoming req@000000009a127fcd x1858042358235072 msgsize 224
00000100:00100000:1.0:1773851905.149572:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-24529@kfi7 (source: 12345-24529@kfi7)
00000100:00000001:1.0:1773851905.149574:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851905.149575:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000100:00000001:0.0:1773851905.149576:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:0.0:1773851905.149577:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:1.0:1773851905.149578:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000100:00000001:0.0:1773851905.149578:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851905.149579:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851905.149580:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851905.149581:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042358235072
00000020:00000001:0.0:1773851905.149582:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851905.149583:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92d42
00000020:00000001:0.0:1773851905.149584:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851905.149588:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b2f0deb3 refcount=6
00000020:00000001:0.0:1773851905.149589:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744180736 : -107128965370880 : ffff9e911812ec00)
00000020:00000001:0.0:1773851905.149590:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744180736 : -107128965370880 : ffff9e911812ec00)
00000100:00000001:0.0:1773851905.149592:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851905.149593:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851905.149594:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000877d5ffd.
00000020:00000010:0.0:1773851905.149596:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851905.149597:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851905.149598:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851905.149599:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851905.149600:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851905.149602:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851905.149603:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851905.149603:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851905.149605:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851905.149607:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851905.149607:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851905.149608:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851905.149608:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851905.149610:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24529@kfi7, seq: 1997650
00000100:00000001:2.0:1773851905.149611:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851905.149611:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b2f0deb3 : new rpc_count 1
00000100:00000001:2.0:1773851905.149612:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851905.149612:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327708544 : -106982381843072 : ffff9eb339220d80)
00000100:00000040:0.0:1773851905.149614:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009a127fcd x1858042358235072/t0(0) o400->8905909c-1928-46a1-87ab-4d3a4effb77d@24529@kfi7:545/0 lens 224/0 e 0 to 0 dl 1773852660 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2017-0'
00000100:00000001:0.0:1773851905.149619:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851905.149619:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851905.149622:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009a127fcd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:8905909c-1928-46a1-87ab-4d3a4effb77d+6:39790:x1858042358235072:12345-24529@kfi7:400:default-tuolumne2017-0
00000100:00000200:0.0:1773851905.149624:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042358235072
00000020:00000001:0.0:1773851905.149625:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851905.149626:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851905.149627:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851905.149628:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851905.149629:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851905.149630:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851905.149631:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042358235072, found 0 last_xid 1858042358235071
00000020:00000001:0.0:1773851905.149633:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851905.149634:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851905.149634:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851905.149635:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851905.149636:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851905.149637:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851905.149638:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851905.149640:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005ccba9e4.
02000000:00000001:0.0:1773851905.149640:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851905.149641:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851905.149643:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851905.149644:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183104961841, transno 0, xid 1858042358235072
00010000:00000001:0.0:1773851905.149645:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851905.149646:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009a127fcd x1858042358235072/t0(0) o400->8905909c-1928-46a1-87ab-4d3a4effb77d@24529@kfi7:545/0 lens 224/224 e 0 to 0 dl 1773852660 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2017-0'
00010000:00000001:0.0:1773851905.149650:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851905.149651:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851905.149652:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=138 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851905.149654:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851905.149655:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d81eff1 refcount 3 to 24529@kfi7
00000100:00000001:0.0:1773851905.149656:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928670973120 : -107145038578496 : ffff9e8d5a093cc0)
02000000:00000001:0.0:1773851905.149658:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851905.149659:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851905.149660:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851905.149662:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24529@kfi7
00000400:00000010:0.0:1773851905.149663:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000079ba0077.
00000100:00000200:0.0:1773851905.149664:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042358235072, offset 224
00000400:00000200:0.0:1773851905.149666:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24529@kfi7
00000400:00000200:0.0:1773851905.149667:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:0.0:1773851905.149668:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 1
00000400:00000200:0.0:1773851905.149670:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000400:00000200:0.0:1773851905.149672:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 3
00000400:00000200:0.0:1773851905.149674:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24529@kfi7 local destination
00000400:00000200:0.0:1773851905.149675:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770531:8770531:1024:4294967295] 24529@kfi7 LPNI seq info [6478803:6478803:16:4294967295]
00000400:00000200:0.0:1773851905.149678:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000400:00000200:0.0:1773851905.149679:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24529@kfi7 to cpt 0
00000400:00000200:0.0:1773851905.149682:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24529@kfi7(24529@kfi7:24529@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851905.149684:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 3
00000800:00000200:0.0:1773851905.149686:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851905.149688:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851905.149691:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851905.149695:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000059d Using peer 24529@kfi7(0x10000000000059d)
00000800:00000200:0.0:1773851905.149700:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000b62ee0c0: Posted send of 324 bytes to peer 0x10000000000059d: rc=0
00000800:00000200:0.0:1773851905.149702:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000059d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851905.149705:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851905.149706:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d81eff1 refcount 2 to 24529@kfi7
00010000:00000001:0.0:1773851905.149707:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851905.149710:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851905.149711:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851905.149712:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009a127fcd x1858042358235072/t0(0) o400->8905909c-1928-46a1-87ab-4d3a4effb77d@24529@kfi7:545/0 lens 224/224 e 0 to 0 dl 1773852660 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2017-0'
00000100:00100000:0.0:1773851905.149723:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009a127fcd pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:8905909c-1928-46a1-87ab-4d3a4effb77d+6:39790:x1858042358235072:12345-24529@kfi7:400:default-tuolumne2017-0 Request processed in 103us (152us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851905.149734:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24529@kfi7, seq: 1997650
00000100:00000040:0.0:1773851905.149735:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b2f0deb3 : new rpc_count 0
00000100:00000001:0.0:1773851905.149737:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851905.149738:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851905.149738:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851905.149740:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000020:00000010:0.0:1773851905.149741:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000877d5ffd.
00000020:00000040:0.0:1773851905.149742:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000b2f0deb3 : new refcount 5
00000100:00000001:0.0:1773851905.149743:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851905.149751:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000059d TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851905.149754:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851905.149756:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24529@kfi7: PUT: OK
00000400:00000200:1.0:1773851905.149757:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000079ba0077
00000400:00000010:1.0:1773851905.149758:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000079ba0077.
00000100:00000001:1.0:1773851905.149759:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851905.149760:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851905.149761:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000173fea21 nid 24529@kfi7 refs 2
00000800:00000200:1.0:1773851905.149763:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b62ee0c0: 2054@kfi7:0 -> 24529@kfi7(00000000c7f2c97c):0x0 lsk 1438 rsk 49 tsk 0 trmk 0 tmk 0 trr 0 tta 0x10000000000059d Transaction freed
00010000:00000001:2.0:1773851905.161733:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161733:0:2506505:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851905.161735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851905.161736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851905.161738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161739:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851905.161740:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161740:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851905.161741:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161742:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851905.161743:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161743:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851905.161745:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851905.161745:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:15.0:1773851905.161752:0:205377:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:15.0:1773851905.161753:0:205377:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:15.0:1773851905.161754:0:205377:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:9.0:1773851905.173468:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851905.173469:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851905.173470:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851905.173472:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851905.173474:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.173475:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 192.168.128.25@o2ib60 : PUT - for me
00000400:00000200:9.0:1773851905.173477:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.173478:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851905.173479:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.25@o2ib60 to cpt 2
00000400:00000200:9.0:1773851905.173480:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 2
00000400:00000200:9.0:1773851905.173481:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 3
00000400:00000200:9.0:1773851905.173482:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.25@o2ib60 to cpt 2
00000400:00000200:9.0:1773851905.173483:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-192.168.128.25@o2ib60 of length 224 into portal 12 MB=0x69a0ced30bec0
00000400:00000200:9.0:1773851905.173485:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-192.168.128.25@o2ib60 of length 224/224 into md 0x78146ce49 [64] + 169136
00000800:00000200:9.0:1773851905.173487:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851905.173489:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851905.173490:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851905.173491:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851905.173491:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851905.173492:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000002beb988.
00000100:00000040:9.0:1773851905.173493:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000002beb988 x1858230169943744 msgsize 224
00000100:00100000:9.0:1773851905.173495:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-192.168.128.25@o2ib60 (source: 12345-192.168.128.25@o2ib60)
00000100:00000001:9.0:1773851905.173496:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851905.173497:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:11.0:1773851905.173498:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851905.173498:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851905.173499:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851905.173499:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851905.173499:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851905.173500:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851905.173501:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858230169943744
00000020:00000001:11.0:1773851905.173501:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851905.173502:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac93028
00000020:00000001:11.0:1773851905.173502:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851905.173505:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bcf147e8 refcount=6
00000020:00000001:11.0:1773851905.173506:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745165824 : -107128964385792 : ffff9e911821f400)
00000020:00000001:11.0:1773851905.173507:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745165824 : -107128964385792 : ffff9e911821f400)
00000100:00000001:11.0:1773851905.173508:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.173509:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851905.173509:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000006dc7c85.
00000020:00000010:11.0:1773851905.173510:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851905.173511:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851905.173512:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851905.173513:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851905.173513:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.173514:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851905.173515:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851905.173515:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.173516:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.173517:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851905.173519:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851905.173519:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:11.0:1773851905.173520:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.128.25@o2ib60, seq: 2130897
00000100:00000001:8.0:1773851905.173520:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851905.173521:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bcf147e8 : new rpc_count 1
00000100:00000001:11.0:1773851905.173521:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498312192 : -106953211239424 : ffff9eba03d62400)
00000100:00000001:8.0:1773851905.173521:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851905.173522:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.173523:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000002beb988 x1858230169943744/t0(0) o400->69314898-c1f0-4dd0-9825-7592e9b9a02e@192.168.128.25@o2ib60:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-matrix25-0'
00000100:00000001:11.0:1773851905.173526:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.173526:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851905.173527:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000002beb988 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:69314898-c1f0-4dd0-9825-7592e9b9a02e+6:41329:x1858230169943744:12345-192.168.128.25@o2ib60:400:default-matrix25-0
00000100:00000200:11.0:1773851905.173529:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858230169943744
00000020:00000001:11.0:1773851905.173530:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851905.173530:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851905.173531:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.173532:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851905.173532:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851905.173533:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851905.173534:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858230169943744, found 0 last_xid 1858230169943743
00000020:00000001:11.0:1773851905.173535:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851905.173535:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851905.173536:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851905.173536:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.173537:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851905.173538:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851905.173538:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851905.173539:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002906c20f.
02000000:00000001:11.0:1773851905.173540:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.173540:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.173541:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851905.173542:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858230169943744
00010000:00000001:11.0:1773851905.173543:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851905.173544:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000002beb988 x1858230169943744/t0(0) o400->69314898-c1f0-4dd0-9825-7592e9b9a02e@192.168.128.25@o2ib60:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix25-0'
00010000:00000001:11.0:1773851905.173548:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851905.173549:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851905.173550:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=138 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851905.173551:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851905.173552:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a54d2907 refcount 3 to 192.168.128.25@o2ib60
00000100:00000001:11.0:1773851905.173553:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636927051136576 : -107146658415040 : ffff9e8cf97c7e40)
02000000:00000001:11.0:1773851905.173554:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851905.173554:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.173555:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851905.173556:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-192.168.128.25@o2ib60
00000400:00000010:11.0:1773851905.173557:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b8ad34c8.
00000100:00000200:11.0:1773851905.173557:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858230169943744, offset 224
00000400:00000200:11.0:1773851905.173559:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-192.168.128.25@o2ib60
00000400:00000200:11.0:1773851905.173560:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 192.168.128.25@o2ib60 to cpt 2
00000400:00000200:11.0:1773851905.173561:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 2
00000400:00000200:11.0:1773851905.173563:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 3
00000400:00000200:11.0:1773851905.173564:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 4
00000400:00000200:11.0:1773851905.173566:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  192.168.128.25@o2ib60 routed destination
00000400:00000200:11.0:1773851905.173567:0:60829:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:11.0:1773851905.173568:0:60829:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to o2ib60, from kfi7
00000400:00000200:11.0:1773851905.173570:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.25@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851905.173571:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:11.0:1773851905.173572:0:60829:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 192.168.128.25@o2ib60: rtr pref emtpy: 1
00000400:00000200:11.0:1773851905.173572:0:60829:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:11.0:1773851905.173573:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770532:8770532:1024:4294967295] 17@kfi7 LPNI seq info [1250891929:1250891929:16:4294967295]
00000400:00000200:11.0:1773851905.173575:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:11.0:1773851905.173576:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.173578:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 192.168.128.25@o2ib60(192.168.128.25@o2ib60:17@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851905.173580:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e13692e9 nid 192.168.128.25@o2ib60 refs 3
00000800:00000200:11.0:1773851905.173581:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851905.173583:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851905.173585:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851905.173587:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Using peer 17@kfi7(0x20000000000001a)
00000800:00000200:11.0:1773851905.173590:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ae8f21ee: Posted send of 324 bytes to peer 0x20000000000001a: rc=0
00000800:00000200:11.0:1773851905.173592:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851905.173594:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.173595:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a54d2907 refcount 2 to 192.168.128.25@o2ib60
00010000:00000001:11.0:1773851905.173596:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851905.173596:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.173597:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851905.173598:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000002beb988 x1858230169943744/t0(0) o400->69314898-c1f0-4dd0-9825-7592e9b9a02e@192.168.128.25@o2ib60:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-matrix25-0'
00000100:00100000:11.0:1773851905.173601:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000002beb988 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:69314898-c1f0-4dd0-9825-7592e9b9a02e+6:41329:x1858230169943744:12345-192.168.128.25@o2ib60:400:default-matrix25-0 Request processed in 74us (107us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851905.173604:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.128.25@o2ib60, seq: 2130897
00000800:00000200:9.0:1773851905.173604:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a TN_EVENT_TX_OK event status 0
00000100:00000040:11.0:1773851905.173605:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bcf147e8 : new rpc_count 0
00000100:00000001:11.0:1773851905.173606:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851905.173606:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:9.0:1773851905.173606:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851905.173607:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851905.173607:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000020:00000010:11.0:1773851905.173608:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000200:9.0:1773851905.173608:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b8ad34c8
00000400:00000010:9.0:1773851905.173608:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b8ad34c8.
00000020:00000010:11.0:1773851905.173609:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000006dc7c85.
00000020:00000040:11.0:1773851905.173609:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000bcf147e8 : new refcount 5
00000100:00000001:9.0:1773851905.173609:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851905.173609:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:11.0:1773851905.173610:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851905.173610:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000800:00000200:9.0:1773851905.173612:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ae8f21ee: 2054@kfi7:2 -> 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x20000000000001a Transaction freed
00000800:00000200:29.0:1773851905.203730:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851905.203732:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851905.203734:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851905.203737:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851905.203740:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.203742:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 12944@kfi7 : PUT - for me
00000400:00000200:29.0:1773851905.203744:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.203746:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 1
00000400:00000200:29.0:1773851905.203748:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.203749:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000400:00000200:29.0:1773851905.203750:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 3
00000400:00000200:29.0:1773851905.203753:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.203754:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-12944@kfi7 of length 224 into portal 12 MB=0x69b4b57c18e00
00000400:00000200:29.0:1773851905.203756:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-12944@kfi7 of length 224/224 into md 0x77fe1859d [64] + 18312
00000800:00000200:29.0:1773851905.203759:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851905.203762:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.203764:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12944@kfi7: PUT: OK
00000100:00000001:29.0:1773851905.203765:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851905.203766:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851905.203767:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007580c285.
00000100:00000040:29.0:1773851905.203768:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000007580c285 x1859597757419008 msgsize 224
00000100:00100000:29.0:1773851905.203771:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-12944@kfi7 (source: 12345-12944@kfi7)
00000100:00000001:29.0:1773851905.203772:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851905.203773:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000100:00000001:31.0:1773851905.203775:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851905.203776:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851905.203776:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851905.203776:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851905.203777:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851905.203779:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851905.203780:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597757419008
00000020:00000001:31.0:1773851905.203781:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851905.203782:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7ed39
00000020:00000001:31.0:1773851905.203783:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851905.203786:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071c91787 refcount=5
00000020:00000001:31.0:1773851905.203787:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636959017488384 : -107114692063232 : ffff9e946ad45000)
00000020:00000001:31.0:1773851905.203789:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636959017488384 : -107114692063232 : ffff9e946ad45000)
00000100:00000001:31.0:1773851905.203790:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.203791:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851905.203792:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000afd5d76e.
00000020:00000010:31.0:1773851905.203794:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.203795:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851905.203797:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851905.203798:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851905.203799:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.203800:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851905.203801:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851905.203802:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.203804:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.203806:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851905.203806:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851905.203807:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851905.203807:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851905.203808:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-12944@kfi7, seq: 2055624
00000100:00000040:31.0:1773851905.203810:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071c91787 : new rpc_count 1
00000100:00000001:28.0:1773851905.203810:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.203811:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405306880 : -106994304244736 : ffff9eb07280a400)
00000100:00000001:28.0:1773851905.203811:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.203813:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007580c285 x1859597757419008/t0(0) o400->6b7746ca-91e9-4383-8baa-701498855e5a@12944@kfi7:693/0 lens 224/0 e 0 to 0 dl 1773852053 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1298-0'
00000100:00000001:31.0:1773851905.203818:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.203818:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851905.203820:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007580c285 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:6b7746ca-91e9-4383-8baa-701498855e5a+5:39541:x1859597757419008:12345-12944@kfi7:400:default-tuolumne1298-0
00000100:00000200:31.0:1773851905.203823:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597757419008
00000020:00000001:31.0:1773851905.203824:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851905.203825:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851905.203826:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.203827:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851905.203828:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851905.203829:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851905.203830:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597757419008, found 0 last_xid 1859597757419007
00000020:00000001:31.0:1773851905.203831:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851905.203832:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851905.203833:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851905.203834:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.203835:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851905.203836:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851905.203837:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851905.203838:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c3c67bb1.
02000000:00000001:31.0:1773851905.203839:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.203840:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.203841:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851905.203842:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183096685241, transno 0, xid 1859597757419008
00010000:00000001:31.0:1773851905.203844:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851905.203845:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007580c285 x1859597757419008/t0(0) o400->6b7746ca-91e9-4383-8baa-701498855e5a@12944@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1298-0'
00010000:00000001:31.0:1773851905.203849:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851905.203850:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851905.203851:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=138 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851905.203853:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851905.203854:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000004b450b4a refcount 3 to 12944@kfi7
00000100:00000001:31.0:1773851905.203855:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636956444310240 : -107117265241376 : ffff9e93d174bae0)
02000000:00000001:31.0:1773851905.203857:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851905.203857:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.203858:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851905.203860:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-12944@kfi7
00000400:00000010:31.0:1773851905.203861:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000761d5a45.
00000100:00000200:31.0:1773851905.203862:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597757419008, offset 224
00000400:00000200:31.0:1773851905.203865:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-12944@kfi7
00000400:00000200:31.0:1773851905.203866:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.203867:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 1
00000400:00000200:31.0:1773851905.203869:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000400:00000200:31.0:1773851905.203871:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 3
00000400:00000200:31.0:1773851905.203873:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  12944@kfi7 local destination
00000400:00000200:31.0:1773851905.203875:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770533:8770533:1024:4294967295] 12944@kfi7 LPNI seq info [376602:376602:16:4294967295]
00000400:00000200:31.0:1773851905.203877:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000400:00000200:31.0:1773851905.203879:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 12944@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.203882:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 12944@kfi7(12944@kfi7:12944@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851905.203884:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 3
00000800:00000200:31.0:1773851905.203886:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851905.203888:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851905.203892:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851905.203896:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000011f1 Using peer 12944@kfi7(0x1000000000011f1)
00000800:00000200:31.0:1773851905.203901:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x1000000000011f1: rc=0
00000800:00000200:31.0:1773851905.203903:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000011f1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851905.203906:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.203908:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000004b450b4a refcount 2 to 12944@kfi7
00010000:00000001:31.0:1773851905.203909:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851905.203910:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.203911:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851905.203912:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007580c285 x1859597757419008/t0(0) o400->6b7746ca-91e9-4383-8baa-701498855e5a@12944@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1298-0'
00000800:00000200:30.0:1773851905.203916:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000011f1 TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851905.203917:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007580c285 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:6b7746ca-91e9-4383-8baa-701498855e5a+5:39541:x1859597757419008:12345-12944@kfi7:400:default-tuolumne1298-0 Request processed in 98us (148us total) trans 0 rc 0/0
00000400:00000200:30.0:1773851905.203917:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851905.203918:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->12944@kfi7: PUT: OK
00000400:00000200:30.0:1773851905.203919:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000761d5a45
00000400:00000010:30.0:1773851905.203919:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000761d5a45.
00000100:00000001:30.0:1773851905.203920:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:31.0:1773851905.203921:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-12944@kfi7, seq: 2055624
00000100:00000001:30.0:1773851905.203921:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851905.203921:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000140773a2 nid 12944@kfi7 refs 2
00000100:00000040:31.0:1773851905.203922:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071c91787 : new rpc_count 0
00000800:00000200:30.0:1773851905.203923:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2054@kfi7:7 -> 12944@kfi7(00000000a0c9852c):0x0 lsk 4594 rsk 9 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1000000000011f1 Transaction freed
00000100:00000001:31.0:1773851905.203924:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851905.203924:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851905.203925:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.203926:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851905.203928:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000afd5d76e.
00000020:00000040:31.0:1773851905.203929:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000071c91787 : new refcount 4
00000100:00000001:31.0:1773851905.203930:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851905.204968:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851905.204969:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851905.204970:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851905.204971:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851905.204973:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14674@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.204974:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 14674@kfi7 : PUT - for me
00000400:00000200:21.0:1773851905.204975:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14674@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.204976:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbfa7309 nid 14674@kfi7 refs 1
00000400:00000200:21.0:1773851905.204977:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14674@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.204977:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbfa7309 nid 14674@kfi7 refs 2
00000400:00000200:21.0:1773851905.204978:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cbfa7309 nid 14674@kfi7 refs 3
00000400:00000200:21.0:1773851905.204979:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14675@kfi7 to cpt 0
00000400:00000200:21.0:1773851905.204980:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-14675@kfi7 of length 224 into portal 12 MB=0x69b4b5c4123c0
00000400:00000200:21.0:1773851905.204981:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-14675@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 71976
00000800:00000200:21.0:1773851905.204983:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851905.204984:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.204985:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14674@kfi7: PUT: OK
00000100:00000001:21.0:1773851905.204986:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851905.204987:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851905.204988:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008922ea79.
00000100:00000040:21.0:1773851905.204988:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000008922ea79 x1859597832889280 msgsize 224
00000100:00100000:21.0:1773851905.204990:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-14675@kfi7 (source: 12345-14674@kfi7)
00000100:00000001:21.0:1773851905.204990:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851905.204991:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cbfa7309 nid 14674@kfi7 refs 2
00000100:00000001:20.0:1773851905.204992:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851905.204992:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:21.0:1773851905.204993:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2069@kfi7:5 <- 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851905.204993:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851905.204993:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851905.204994:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851905.204995:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597832889280
00000020:00000001:20.0:1773851905.204996:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851905.204996:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d7fac9
00000020:00000001:20.0:1773851905.204997:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851905.205002:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009bb1bc3c refcount=58
00000020:00000001:20.0:1773851905.205002:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637105660605440 : -106968048946176 : ffff9eb68f70b400)
00000020:00000001:20.0:1773851905.205003:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637105660605440 : -106968048946176 : ffff9eb68f70b400)
00000100:00000001:20.0:1773851905.205004:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.205005:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851905.205006:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003c2194b9.
00000020:00000010:20.0:1773851905.205007:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.205008:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008b2657fc.
00000100:00000001:20.0:1773851905.205008:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851905.205009:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851905.205009:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851905.205011:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851905.205011:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851905.205012:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.205012:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851905.205014:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851905.205014:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851905.205014:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851905.205015:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851905.205015:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-14675@kfi7, seq: 1998099
00000100:00000001:23.0:1773851905.205016:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.205016:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009bb1bc3c : new rpc_count 2
00000100:00000001:20.0:1773851905.205016:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313410816 : -106917396140800 : ffff9ec25a952d00)
00000100:00000001:23.0:1773851905.205017:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.205017:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008922ea79 x1859597832889280/t0(0) o400->24aa0c0d-3c4e-45d6-ae3c-badf912980be@14675@kfi7:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1414-0'
00000100:00000001:20.0:1773851905.205020:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.205020:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851905.205021:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008922ea79 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:24aa0c0d-3c4e-45d6-ae3c-badf912980be+58:39606:x1859597832889280:12345-14675@kfi7:400:default-tuolumne1414-0
00000100:00000200:20.0:1773851905.205022:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597832889280
00000020:00000001:20.0:1773851905.205023:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851905.205024:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851905.205027:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.205028:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851905.205028:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851905.205029:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851905.205030:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597832889280, found 0 last_xid 1859597832322175
00000020:00000001:20.0:1773851905.205031:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851905.205031:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851905.205032:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851905.205033:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.205033:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851905.205034:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851905.205034:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851905.205035:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f3007004.
02000000:00000001:20.0:1773851905.205036:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.205036:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.205037:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851905.205038:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264581322, transno 0, xid 1859597832889280
00010000:00000001:20.0:1773851905.205039:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851905.205039:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008922ea79 x1859597832889280/t0(0) o400->24aa0c0d-3c4e-45d6-ae3c-badf912980be@14675@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1414-0'
00010000:00000001:20.0:1773851905.205042:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851905.205042:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851905.205043:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=138 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851905.205044:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851905.205045:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000c50bff73 refcount 3 to 14675@kfi7
00000100:00000001:20.0:1773851905.205045:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636923994451328 : -107149715100288 : ffff9e8c434b2d80)
02000000:00000001:20.0:1773851905.205046:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851905.205047:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.205048:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851905.205048:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-14674@kfi7
00000400:00000010:20.0:1773851905.205049:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002f2b7e97.
00000100:00000200:20.0:1773851905.205050:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597832889280, offset 224
00000400:00000200:20.0:1773851905.205051:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-14674@kfi7
00000400:00000200:20.0:1773851905.205052:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14674@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.205052:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cbfa7309 nid 14674@kfi7 refs 1
00000400:00000200:20.0:1773851905.205054:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cbfa7309 nid 14674@kfi7 refs 2
00000400:00000200:20.0:1773851905.205055:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cbfa7309 nid 14674@kfi7 refs 3
00000400:00000200:20.0:1773851905.205056:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  14674@kfi7 local destination
00000400:00000200:20.0:1773851905.205057:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770534:8770534:1024:4294967295] 14674@kfi7 LPNI seq info [1031493:1031493:16:4294967295]
00000400:00000200:20.0:1773851905.205059:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cbfa7309 nid 14674@kfi7 refs 2
00000400:00000200:20.0:1773851905.205059:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 14674@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.205061:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 14674@kfi7(14674@kfi7:14674@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851905.205062:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cbfa7309 nid 14674@kfi7 refs 3
00000800:00000200:20.0:1773851905.205063:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851905.205065:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851905.205067:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851905.205069:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x372 Using peer 14674@kfi7(0x372)
00000800:00000200:20.0:1773851905.205072:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 00000000194956ef: Posted send of 324 bytes to peer 0x372: rc=0
00000800:00000200:20.0:1773851905.205073:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x372 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851905.205075:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.205076:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000c50bff73 refcount 2 to 14675@kfi7
00010000:00000001:20.0:1773851905.205077:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851905.205077:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.205078:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851905.205079:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008922ea79 x1859597832889280/t0(0) o400->24aa0c0d-3c4e-45d6-ae3c-badf912980be@14675@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1414-0'
00000100:00100000:20.0:1773851905.205083:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008922ea79 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:24aa0c0d-3c4e-45d6-ae3c-badf912980be+58:39606:x1859597832889280:12345-14675@kfi7:400:default-tuolumne1414-0 Request processed in 62us (94us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851905.205085:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-14675@kfi7, seq: 1998099
00000100:00000040:20.0:1773851905.205086:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009bb1bc3c : new rpc_count 1
00000100:00000001:20.0:1773851905.205087:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851905.205088:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851905.205089:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.205089:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008b2657fc.
00000020:00000010:20.0:1773851905.205090:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003c2194b9.
00000020:00000040:20.0:1773851905.205091:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009bb1bc3c : new refcount 57
00000100:00000001:20.0:1773851905.205092:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851905.205097:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x372 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851905.205098:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.205099:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->14674@kfi7: PUT: OK
00000400:00000200:21.0:1773851905.205099:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002f2b7e97
00000400:00000010:21.0:1773851905.205100:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002f2b7e97.
00000100:00000001:21.0:1773851905.205101:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851905.205101:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851905.205102:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cbfa7309 nid 14674@kfi7 refs 2
00000800:00000200:21.0:1773851905.205103:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000194956ef: 2069@kfi7:5 -> 14674@kfi7(000000001edeb5e3):0x0 lsk 883 rsk 6 tsk 0 trmk 0 tmk 0 trr 5 tta 0x372 Transaction freed
00000800:00000200:21.0:1773851905.220220:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851905.220220:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851905.220221:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851905.220223:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851905.220225:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21329@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.220226:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21329@kfi7 : PUT - for me
00000400:00000200:21.0:1773851905.220227:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21329@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.220228:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007261dcdc nid 21329@kfi7 refs 1
00000400:00000200:21.0:1773851905.220229:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21329@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.220230:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007261dcdc nid 21329@kfi7 refs 2
00000400:00000200:21.0:1773851905.220231:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007261dcdc nid 21329@kfi7 refs 3
00000400:00000200:21.0:1773851905.220232:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21393@kfi7 to cpt 1
00000400:00000200:21.0:1773851905.220233:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21393@kfi7 of length 224 into portal 12 MB=0x699e0e13137c0
00000400:00000200:21.0:1773851905.220234:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21393@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 72200
00000800:00000200:21.0:1773851905.220236:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851905.220237:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.220238:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21329@kfi7: PUT: OK
00000100:00000001:21.0:1773851905.220239:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851905.220239:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851905.220240:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000006695df0d.
00000100:00000040:21.0:1773851905.220241:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000006695df0d x1858040990087104 msgsize 224
00000100:00100000:21.0:1773851905.220242:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-21393@kfi7 (source: 12345-21329@kfi7)
00000100:00000001:21.0:1773851905.220243:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851905.220244:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007261dcdc nid 21329@kfi7 refs 2
00000100:00000001:20.0:1773851905.220244:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851905.220245:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851905.220245:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851905.220245:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851905.220246:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851905.220246:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851905.220247:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040990087104
00000020:00000001:20.0:1773851905.220248:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851905.220248:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac914ad
00000020:00000001:20.0:1773851905.220249:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851905.220253:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000840913ea refcount=8
00000020:00000001:20.0:1773851905.220253:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240792064 : -107152468759552 : ffff9e8b9f29ac00)
00000020:00000001:20.0:1773851905.220254:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240792064 : -107152468759552 : ffff9e8b9f29ac00)
00000100:00000001:20.0:1773851905.220255:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.220256:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851905.220257:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005f9598dd.
00000020:00000010:20.0:1773851905.220258:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.220259:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008b2657fc.
00000100:00000001:20.0:1773851905.220260:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851905.220260:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851905.220260:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851905.220261:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851905.220262:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851905.220262:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.220263:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851905.220264:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851905.220265:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851905.220265:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851905.220265:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851905.220266:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21393@kfi7, seq: 1998100
00000100:00000001:23.0:1773851905.220267:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.220267:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000840913ea : new rpc_count 1
00000100:00000001:23.0:1773851905.220268:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.220268:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313416576 : -106917396135040 : ffff9ec25a954380)
00000100:00000040:20.0:1773851905.220269:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000006695df0d x1858040990087104/t0(0) o400->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:186/0 lens 224/0 e 0 to 0 dl 1773852301 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1826-0'
00000100:00000001:20.0:1773851905.220273:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.220273:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851905.220274:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000006695df0d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0be85a48-c251-410d-838d-23bdfd7e98c7+8:39826:x1858040990087104:12345-21393@kfi7:400:default-tuolumne1826-0
00000100:00000200:20.0:1773851905.220276:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040990087104
00000020:00000001:20.0:1773851905.220276:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851905.220277:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851905.220278:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.220279:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851905.220279:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851905.220280:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851905.220281:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040990087104, found 0 last_xid 1858040990087103
00000020:00000001:20.0:1773851905.220282:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851905.220283:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851905.220284:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851905.220284:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.220285:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851905.220286:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851905.220287:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851905.220287:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000683b02b9.
02000000:00000001:20.0:1773851905.220288:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.220289:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.220290:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851905.220291:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044109179, transno 0, xid 1858040990087104
00010000:00000001:20.0:1773851905.220292:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851905.220294:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000006695df0d x1858040990087104/t0(0) o400->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1826-0'
00010000:00000001:20.0:1773851905.220299:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851905.220299:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851905.220301:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=138 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851905.220303:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851905.220305:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000969e3622 refcount 3 to 21393@kfi7
00000100:00000001:20.0:1773851905.220306:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231612512 : -107130477939104 : ffff9e90bdeaf660)
02000000:00000001:20.0:1773851905.220308:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851905.220308:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.220309:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851905.220311:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21329@kfi7
00000400:00000010:20.0:1773851905.220312:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006e2f6c1a.
00000100:00000200:20.0:1773851905.220313:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040990087104, offset 224
00000400:00000200:20.0:1773851905.220315:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21329@kfi7
00000400:00000200:20.0:1773851905.220317:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21329@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.220318:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007261dcdc nid 21329@kfi7 refs 1
00000400:00000200:20.0:1773851905.220320:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007261dcdc nid 21329@kfi7 refs 2
00000400:00000200:20.0:1773851905.220322:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007261dcdc nid 21329@kfi7 refs 3
00000400:00000200:20.0:1773851905.220324:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21329@kfi7 local destination
00000400:00000200:20.0:1773851905.220326:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770535:8770535:1024:4294967295] 21329@kfi7 LPNI seq info [1131116:1131116:16:4294967295]
00000400:00000200:20.0:1773851905.220329:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007261dcdc nid 21329@kfi7 refs 2
00000400:00000200:20.0:1773851905.220330:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21329@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.220334:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21329@kfi7(21329@kfi7:21329@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851905.220336:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007261dcdc nid 21329@kfi7 refs 3
00000800:00000200:20.0:1773851905.220339:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851905.220341:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851905.220345:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851905.220349:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c4c Using peer 21329@kfi7(0x100000000000c4c)
00000800:00000200:20.0:1773851905.220354:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 00000000b79d0b97: Posted send of 324 bytes to peer 0x100000000000c4c: rc=0
00000800:00000200:20.0:1773851905.220357:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c4c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851905.220361:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.220364:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000969e3622 refcount 2 to 21393@kfi7
00010000:00000001:20.0:1773851905.220365:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851905.220366:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.220367:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851905.220368:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000006695df0d x1858040990087104/t0(0) o400->0be85a48-c251-410d-838d-23bdfd7e98c7@21393@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1826-0'
00000100:00100000:20.0:1773851905.220374:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000006695df0d pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0be85a48-c251-410d-838d-23bdfd7e98c7+8:39826:x1858040990087104:12345-21393@kfi7:400:default-tuolumne1826-0 Request processed in 100us (132us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851905.220378:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21393@kfi7, seq: 1998100
00000100:00000040:20.0:1773851905.220379:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000840913ea : new rpc_count 0
00000100:00000001:20.0:1773851905.220380:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851905.220381:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851905.220382:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.220383:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008b2657fc.
00000020:00000010:20.0:1773851905.220384:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005f9598dd.
00000020:00000040:20.0:1773851905.220386:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000840913ea : new refcount 7
00000100:00000001:20.0:1773851905.220387:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851905.220395:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c4c TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851905.220398:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.220399:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21329@kfi7: PUT: OK
00000400:00000200:21.0:1773851905.220401:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006e2f6c1a
00000400:00000010:21.0:1773851905.220401:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006e2f6c1a.
00000100:00000001:21.0:1773851905.220402:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851905.220403:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851905.220405:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007261dcdc nid 21329@kfi7 refs 2
00000800:00000200:21.0:1773851905.220407:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b79d0b97: 2054@kfi7:5 -> 21329@kfi7(000000007a992435):0x0 lsk 3149 rsk 50 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c4c Transaction freed
00000004:00000001:5.0:1773851905.353729:0:42323:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:31.0:1773851905.353730:0:60677:0:(service.c:1534:ptlrpc_at_check_timed()) Process entered
00000004:00000001:30.0:1773851905.353730:0:42371:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:30.0:1773851905.353731:0:42371:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:7.0:1773851905.353731:0:42303:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:5.0:1773851905.353731:0:42323:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:5.0:1773851905.353731:0:42323:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000165a41dd.
00000100:00000010:30.0:1773851905.353732:0:42371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000074adcffb.
00000004:00000020:7.0:1773851905.353732:0:42303:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:5.0:1773851905.353732:0:42323:0:(genops.c:1094:class_import_get()) import 0000000034e5921a refcount=4 obd=lustre5-OST0008-osc-MDT0001
00000004:00000001:4.0:1773851905.353732:0:42305:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:4.0:1773851905.353732:0:42305:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000020:00000040:30.0:1773851905.353733:0:42371:0:(genops.c:1094:class_import_get()) import 00000000dc4c50a3 refcount=8 obd=lustre5-OST0010-osc-MDT0001
00000100:00000010:7.0:1773851905.353733:0:42303:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007a2bedac.
00000020:00000040:7.0:1773851905.353733:0:42303:0:(genops.c:1094:class_import_get()) import 000000001b0ad50a refcount=3 obd=lustre5-MDT0004-osp-MDT0001
00000100:00000010:4.0:1773851905.353733:0:42305:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000f47525b1.
00000100:00000001:30.0:1773851905.353734:0:42371:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:7.0:1773851905.353734:0:42303:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000001:5.0:1773851905.353734:0:42323:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:4.0:1773851905.353734:0:42305:0:(genops.c:1094:class_import_get()) import 0000000062d6f8bb refcount=3 obd=lustre5-MDT0005-osp-MDT0001
02000000:00000001:30.0:1773851905.353735:0:42371:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:7.0:1773851905.353735:0:42303:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:5.0:1773851905.353735:0:42323:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851905.353735:0:42305:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:4.0:1773851905.353735:0:42305:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:30.0:1773851905.353736:0:42371:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851905.353736:0:42303:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851905.353736:0:42323:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851905.353736:0:42305:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.353737:0:60677:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +126s
00000100:00001000:31.0:1773851905.353737:0:60677:0:(service.c:1603:ptlrpc_at_check_timed()) timeout in +4s, asking for 30 secs on 0 early replies
02000000:00000010:7.0:1773851905.353737:0:42303:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000085d7323e.
02000000:00000010:5.0:1773851905.353737:0:42323:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000100f702c.
02000000:00000010:4.0:1773851905.353737:0:42305:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000000869d922.
00000100:00000001:31.0:1773851905.353738:0:60677:0:(service.c:1632:ptlrpc_at_check_timed()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:30.0:1773851905.353738:0:42371:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 000000008a71a94e.
00000100:00000001:7.0:1773851905.353738:0:42303:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.353738:0:42323:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353738:0:42305:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.353739:0:42371:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353739:0:42303:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:7.0:1773851905.353739:0:42303:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.353739:0:42323:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:4.0:1773851905.353739:0:42305:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:5.0:1773851905.353740:0:42323:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353740:0:42305:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.353741:0:42371:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:30.0:1773851905.353741:0:42371:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851905.353741:0:42303:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007a2bedac] to pc [ptlrpcd_01_03+3]  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:5.0:1773851905.353741:0:42323:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000165a41dd] to pc [ptlrpcd_01_01+1]  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851905.353741:0:42305:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000f47525b1] to pc [ptlrpcd_01_00+0]  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851905.353743:0:42371:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000074adcffb] to pc [ptlrpcd_07_00+0]  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:7.0:1773851905.353745:0:42303:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353746:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851905.353746:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851905.353746:0:42323:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000004:00000001:4.0:1773851905.353746:0:42305:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353747:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851905.353747:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:6.0:1773851905.353747:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:5.0:1773851905.353747:0:42323:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000f223d882.
00000100:00000001:4.0:1773851905.353747:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851905.353747:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:30.0:1773851905.353748:0:42371:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851905.353748:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:7.0:1773851905.353748:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851905.353748:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:5.0:1773851905.353748:0:42323:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637126350526464 : -106947359025152 : ffff9ebb60a7d800)
00000100:00000001:4.0:1773851905.353748:0:41065:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000010:30.0:1773851905.353749:0:42371:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000c125874a.
00000100:00000001:29.0:1773851905.353749:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851905.353749:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851905.353749:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:5.0:1773851905.353749:0:42323:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:4.0:1773851905.353749:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:30.0:1773851905.353750:0:42371:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637095308339200 : -106978401212416 : ffff9eb42665a800)
00000100:00000001:29.0:1773851905.353750:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.353750:0:41088:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:6.0:1773851905.353750:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:5.0:1773851905.353750:0:42323:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851905.353751:0:42371:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000040:28.0:1773851905.353751:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851905.353751:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:5.0:1773851905.353751:0:42323:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0008-osc-MDT0001: sync forced, 4 changes
00000004:00000010:5.0:1773851905.353751:0:42323:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000c0950a2d.
00000100:00000001:4.0:1773851905.353751:0:41065:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:30.0:1773851905.353752:0:42371:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851905.353752:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:6.0:1773851905.353752:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:5.0:1773851905.353752:0:42323:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0008-osc-MDT0001: add commit cb at 614179807027902ns, next at 614180807026860ns, rc = 0
00000100:00000001:4.0:1773851905.353752:0:41065:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851905.353752:0:41065:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:30.0:1773851905.353753:0:42371:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0010-osc-MDT0001: sync forced, 1 changes
00000100:00000001:7.0:1773851905.353753:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851905.353753:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:6.0:1773851905.353753:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007a2bedac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051943936:7@kfi7:41:default-yuba2-0
00080000:00000001:5.0:1773851905.353753:0:42323:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:4.0:1773851905.353753:0:41065:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:30.0:1773851905.353754:0:42371:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000dca6bd25.
00000004:00080000:30.0:1773851905.353754:0:42371:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0010-osc-MDT0001: add commit cb at 614179807030096ns, next at 614180807029135ns, rc = 0
00000100:00000001:28.0:1773851905.353754:0:41088:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
02000000:00000001:7.0:1773851905.353754:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851905.353754:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:5.0:1773851905.353754:0:42323:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851905.353754:0:41065:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000165a41dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051944000:3@kfi7:13:default-yuba2-0
00000100:00000001:28.0:1773851905.353755:0:41088:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851905.353755:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000f47525b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051943872:2098@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851905.353755:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851905.353755:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000004:00000001:5.0:1773851905.353755:0:42323:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353755:0:41065:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:4.0:1773851905.353755:0:41065:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00080000:00000001:30.0:1773851905.353756:0:42371:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:28.0:1773851905.353756:0:41088:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000100:00000001:7.0:1773851905.353756:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:6.0:1773851905.353756:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851905.353756:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000001:4.0:1773851905.353756:0:41065:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:30.0:1773851905.353757:0:42371:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:30.0:1773851905.353757:0:42371:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851905.353757:0:41088:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851905.353757:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851905.353757:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851905.353757:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:6.0:1773851905.353757:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008d25977b.
00000100:00000001:5.0:1773851905.353757:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:4.0:1773851905.353757:0:41065:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:28.0:1773851905.353758:0:41088:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000074adcffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051944064:2080@kfi7:13:default-yuba2-0
02000000:00000010:7.0:1773851905.353758:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b2b64901.
02000000:00000001:6.0:1773851905.353758:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.353758:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851905.353758:0:41065:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000009143fe2b.
00000100:00000001:28.0:1773851905.353759:0:41088:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851905.353759:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851905.353759:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
02000000:00000001:4.0:1773851905.353759:0:41065:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851905.353760:0:41088:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:28.0:1773851905.353760:0:41088:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851905.353760:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000010:7.0:1773851905.353760:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000007398a75e.
00000400:00000010:6.0:1773851905.353760:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dd6d514f.
02000000:00000001:28.0:1773851905.353761:0:41088:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000400:00000010:7.0:1773851905.353761:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c74d75.
00000400:00000010:6.0:1773851905.353761:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000114436b6.
00000400:00000200:4.0:1773851905.353761:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000010:4.0:1773851905.353761:0:41065:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000ec5e3fa5.
02000000:00000010:28.0:1773851905.353762:0:41088:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000074d5d06.
00000100:00000200:7.0:1773851905.353762:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943872, portal 4
00000100:00000200:6.0:1773851905.353762:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051943936, portal 4
00000400:00000010:4.0:1773851905.353762:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000092a2acd5.
02000000:00000001:28.0:1773851905.353763:0:41088:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353763:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851905.353763:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528724864 : -106978180826752 : ffff9eb433887980)
00000100:00000001:6.0:1773851905.353763:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:6.0:1773851905.353763:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637079309125888 : -106994400425728 : ffff9eb06cc50900)
00000100:00000200:4.0:1773851905.353763:0:41065:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944000, portal 4
00000100:00000001:4.0:1773851905.353763:0:41065:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000400:00000200:28.0:1773851905.353764:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000100:00000001:4.0:1773851905.353764:0:41065:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113837119360 : -106959872432256 : ffff9eb876cc6780)
00000400:00000010:28.0:1773851905.353765:0:41088:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000dce9d16e.
00000100:00000040:7.0:1773851905.353765:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:6.0:1773851905.353765:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:4.0:1773851905.353765:0:41065:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:28.0:1773851905.353766:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e00fc912.
00000100:00000200:28.0:1773851905.353767:0:41088:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944064, portal 4
00000100:00000001:7.0:1773851905.353767:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:6.0:1773851905.353767:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:4.0:1773851905.353767:0:41065:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:28.0:1773851905.353768:0:41088:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:28.0:1773851905.353768:0:41088:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637113411241088 : -106960298310528 : ffff9eb85d6a0480)
00000100:00000040:7.0:1773851905.353768:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2098@kfi7
00000100:00000040:6.0:1773851905.353768:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-7@kfi7
00000100:00000040:4.0:1773851905.353768:0:41065:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-3@kfi7
00000400:00000010:7.0:1773851905.353769:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c46149c8.
00000100:00000200:7.0:1773851905.353769:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051943872, offset 0
00000400:00000010:6.0:1773851905.353769:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000009150aefe.
00000400:00000010:4.0:1773851905.353769:0:41065:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cb2a5541.
00000100:00000200:4.0:1773851905.353769:0:41065:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944000, offset 0
00000100:00000040:28.0:1773851905.353770:0:41088:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:6.0:1773851905.353770:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 24, xid 1859433051943936, offset 0
00000400:00000200:7.0:1773851905.353771:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2098@kfi7
00000100:00000001:28.0:1773851905.353772:0:41088:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:7.0:1773851905.353772:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:4.0:1773851905.353772:0:41065:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-3@kfi7
00000100:00000040:28.0:1773851905.353773:0:41088:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2080@kfi7
00000400:00000200:7.0:1773851905.353773:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 1
00000400:00000200:6.0:1773851905.353773:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-7@kfi7
00000400:00000010:28.0:1773851905.353774:0:41088:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000077c78d1a.
00000400:00000200:7.0:1773851905.353774:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000100:00000200:28.0:1773851905.353775:0:41088:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944064, offset 0
00000400:00000200:7.0:1773851905.353775:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 3
00000400:00000200:7.0:1773851905.353776:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2098@kfi7 local destination
00000400:00000200:28.0:1773851905.353777:0:41088:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2080@kfi7
00000400:00000200:28.0:1773851905.353778:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851905.353778:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770534, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770535, p:4294967295, g:4294967295, h:1000]
00000400:00000200:28.0:1773851905.353779:0:41088:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:7.0:1773851905.353780:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:28.0:1773851905.353781:0:41088:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851905.353781:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 1
00000400:00000200:28.0:1773851905.353782:0:41088:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:7.0:1773851905.353782:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851905.353783:0:41064:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[2098@kfi7, 2105@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[20346218, 20346216]
00000400:00000200:28.0:1773851905.353784:0:41088:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2080@kfi7 local destination
00000400:00000200:28.0:1773851905.353785:0:41088:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770534, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770535, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851905.353785:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2105@kfi7
00000400:00000200:7.0:1773851905.353786:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770536:8770536:1024:4294967295] 2105@kfi7 LPNI seq info [20346219:20346219:16:4294967295]
00000400:00000200:28.0:1773851905.353787:0:41088:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:7.0:1773851905.353787:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:28.0:1773851905.353788:0:41088:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:28.0:1773851905.353789:0:41088:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2080@kfi7
00000400:00000200:7.0:1773851905.353789:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:4.0:1773851905.353789:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:28.0:1773851905.353791:0:41088:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770537:8770537:1024:4294967295] 2080@kfi7 LPNI seq info [5404399:5404399:16:4294967295]
00000400:00000200:4.0:1773851905.353791:0:41065:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:28.0:1773851905.353792:0:41088:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000400:00000200:7.0:1773851905.353792:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2105@kfi7(2098@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:4.0:1773851905.353792:0:41065:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000400:00000200:28.0:1773851905.353793:0:41088:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:7.0:1773851905.353793:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000021a6f298 nid 2098@kfi7 refs 2
00000400:00000200:4.0:1773851905.353794:0:41065:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:7.0:1773851905.353795:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:4.0:1773851905.353796:0:41065:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  3@kfi7 local destination
00000400:00000200:28.0:1773851905.353797:0:41088:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2080@kfi7(2080@kfi7:2080@kfi7) <?> : PUT try# 0
00000800:00000200:7.0:1773851905.353797:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:28.0:1773851905.353798:0:41088:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:4.0:1773851905.353798:0:41065:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770536, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770537, p:4294967295, g:4294967295, h:1000]
00000800:00000200:7.0:1773851905.353799:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851905.353800:0:41088:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000400:00000200:4.0:1773851905.353800:0:41065:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:4.0:1773851905.353800:0:41065:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000800:00000200:28.0:1773851905.353801:0:41088:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:4.0:1773851905.353801:0:41065:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 3@kfi7
00000800:00000200:7.0:1773851905.353802:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Using peer 2105@kfi7(0x4c6)
00000400:00000200:4.0:1773851905.353802:0:41065:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770538:8770538:1023:4294967295] 3@kfi7 LPNI seq info [5406228:5406228:16:4294967295]
00000800:00000200:28.0:1773851905.353803:0:41088:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:4.0:1773851905.353804:0:41065:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:7.0:1773851905.353805:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x4c6: rc=0
00000400:00000200:4.0:1773851905.353805:0:41065:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000800:00000200:28.0:1773851905.353806:0:41088:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Using peer 2080@kfi7(0x2000000000002ec)
00000400:00000200:6.0:1773851905.353806:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:7.0:1773851905.353807:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:6.0:1773851905.353807:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000400:00000200:4.0:1773851905.353807:0:41065:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 3@kfi7(3@kfi7:3@kfi7) <?> : PUT try# 0
00000400:00000200:6.0:1773851905.353808:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:7.0:1773851905.353809:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353809:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851905.353809:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000200:4.0:1773851905.353809:0:41065:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000800:00000200:28.0:1773851905.353810:0:41088:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 0000000015d39231: Posted send of 324 bytes to peer 0x2000000000002ec: rc=0
00000100:00000001:7.0:1773851905.353810:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353810:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851905.353810:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  7@kfi7 local destination
00000800:00000200:4.0:1773851905.353810:0:41065:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:28.0:1773851905.353811:0:41088:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851905.353811:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851905.353812:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851905.353812:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:6.0:1773851905.353812:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1022, d:10, s:8770538, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770537, p:4294967295, g:4294967295, h:1000]
00000100:00000001:28.0:1773851905.353813:0:41088:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353813:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851905.353813:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:4.0:1773851905.353813:0:41065:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:28.0:1773851905.353814:0:41088:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851905.353814:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851905.353814:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:6.0:1773851905.353814:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000100:00000001:28.0:1773851905.353815:0:41088:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353815:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851905.353815:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:6.0:1773851905.353816:0:41067:0:(lib-move.c:1351:lnet_select_peer_ni()) n:[8@kfi7, 7@kfi7] h:[1000, 1000] p:[-1, -1] c:[16, 16] s:[17340077, 17340076]
00000100:00000001:28.0:1773851905.353817:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.353818:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:6.0:1773851905.353818:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 7@kfi7
00000400:00000200:6.0:1773851905.353818:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770539:8770539:1023:4294967295] 7@kfi7 LPNI seq info [17340078:17340078:16:4294967295]
00000100:00000001:28.0:1773851905.353819:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:5.0:1773851905.353819:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 TN_EVENT_TX_OK event status 0
00000100:00000001:28.0:1773851905.353820:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:28.0:1773851905.353820:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:6.0:1773851905.353820:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:6.0:1773851905.353820:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000800:00000200:4.0:1773851905.353820:0:41065:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:28.0:1773851905.353821:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851905.353821:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:4.0:1773851905.353822:0:41065:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Using peer 3@kfi7(0x3b9)
00000400:00000200:6.0:1773851905.353823:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 7@kfi7(7@kfi7:7@kfi7) <?> : PUT try# 0
00000400:00000200:5.0:1773851905.353823:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000400:00000200:5.0:1773851905.353824:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c46149c8
00000400:00000010:5.0:1773851905.353824:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c46149c8.
00000400:00000200:6.0:1773851905.353825:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000100:00000001:5.0:1773851905.353825:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000800:00000200:4.0:1773851905.353825:0:41065:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000772e8e87: Posted send of 324 bytes to peer 0x3b9: rc=0
00000800:00000200:6.0:1773851905.353826:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000100:00000200:5.0:1773851905.353826:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:4.0:1773851905.353826:0:41065:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:6.0:1773851905.353827:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:28.0:1773851905.353828:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.353828:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353828:0:41065:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851905.353829:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851905.353829:0:41065:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851905.353829:0:41065:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:29.0:1773851905.353830:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:6.0:1773851905.353830:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:4.0:1773851905.353830:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.353831:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:4.0:1773851905.353831:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851905.353832:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000400:00000200:29.0:1773851905.353832:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000077c78d1a
00000800:00000200:6.0:1773851905.353832:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a Using peer 7@kfi7(0x20000000000119a)
00000100:00000040:5.0:1773851905.353832:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:29.0:1773851905.353833:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000077c78d1a.
00000100:00000001:29.0:1773851905.353834:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:5.0:1773851905.353834:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353834:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:4.0:1773851905.353834:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000200:29.0:1773851905.353835:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:6.0:1773851905.353835:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000dbb44ac2: Posted send of 324 bytes to peer 0x20000000000119a: rc=0
00000100:00000001:5.0:1773851905.353835:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:4.0:1773851905.353835:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851905.353835:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851905.353836:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:29.0:1773851905.353837:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:6.0:1773851905.353837:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:5.0:1773851905.353837:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 1 tta 0x4c6 Transaction freed
00000100:00000040:29.0:1773851905.353838:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851905.353839:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353839:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851905.353839:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851905.353840:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353840:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851905.353840:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 TN_EVENT_TX_OK event status 0
00000100:00000001:4.0:1773851905.353840:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851905.353841:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:6.0:1773851905.353841:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353841:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851905.353841:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.353842:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000100:00000001:6.0:1773851905.353842:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851905.353842:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:5.0:1773851905.353842:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000100:00000001:6.0:1773851905.353843:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851905.353843:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:5.0:1773851905.353843:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cb2a5541
00000100:00000001:6.0:1773851905.353844:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353844:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851905.353844:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cb2a5541.
00000100:00000001:5.0:1773851905.353844:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:5.0:1773851905.353845:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:29.0:1773851905.353846:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000015d39231: 2054@kfi7:7 -> 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000002ec Transaction freed
00000800:00000200:6.0:1773851905.353848:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851905.353848:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:5.0:1773851905.353848:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851905.353849:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851905.353850:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000400:00000200:6.0:1773851905.353851:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000009150aefe
00000100:00000001:5.0:1773851905.353851:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.353851:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000010:6.0:1773851905.353852:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000009150aefe.
00000100:00000001:6.0:1773851905.353852:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000400:00000200:5.0:1773851905.353852:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000200:6.0:1773851905.353853:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:5.0:1773851905.353854:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000772e8e87: 2069@kfi7:1 -> 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3b9 Transaction freed
00000800:00000200:9.0:1773851905.353855:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000100:00000001:6.0:1773851905.353855:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:9.0:1773851905.353856:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000040:6.0:1773851905.353856:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851905.353858:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851905.353858:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353859:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:9.0:1773851905.353860:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:6.0:1773851905.353860:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000400:00000200:9.0:1773851905.353862:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:6.0:1773851905.353862:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dbb44ac2: 2054@kfi7:1 -> 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 1 tta 0x20000000000119a Transaction freed
00000800:00000200:25.0:1773851905.353864:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000400:00000200:9.0:1773851905.353864:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2080@kfi7 : PUT - for me
00000800:00000200:25.0:1773851905.353865:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851905.353865:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:25.0:1773851905.353866:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851905.353866:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 1
00000400:00000200:9.0:1773851905.353867:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.353868:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:25.0:1773851905.353869:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851905.353869:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 3
00000400:00000200:9.0:1773851905.353870:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:29.0:1773851905.353871:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:25.0:1773851905.353871:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:9.0:1773851905.353871:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2080@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7480
00000800:00000200:29.0:1773851905.353872:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:25.0:1773851905.353872:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:9.0:1773851905.353872:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2080@kfi7 to cpt 2
00000800:00000200:29.0:1773851905.353874:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851905.353874:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.353874:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:9.0:1773851905.353874:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2080@kfi7 of length 368/368 into md 0x7816995e9 [1] + 224
00000400:00000200:25.0:1773851905.353875:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000800:00000200:29.0:1773851905.353876:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:9.0:1773851905.353876:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851905.353877:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:29.0:1773851905.353878:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851905.353878:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:9.0:1773851905.353878:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.353879:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 3@kfi7 : PUT - for me
00000400:00000200:25.0:1773851905.353879:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851905.353880:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 368 into portal 4 MB=0x69b24fe8b73c0
00000400:00000200:29.0:1773851905.353881:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851905.353881:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:9.0:1773851905.353881:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2080@kfi7: PUT: OK
00000400:00000200:29.0:1773851905.353882:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 1
00000400:00000200:25.0:1773851905.353882:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2098@kfi7 of length 368/368 into md 0x793b32925 [1] + 224
00000100:00000001:9.0:1773851905.353882:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851905.353883:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.353884:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000800:00000200:25.0:1773851905.353884:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:9.0:1773851905.353884:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851905.353885:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 3
00000400:00000200:29.0:1773851905.353886:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851905.353886:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.353887:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-3@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7440
00000800:00000200:13.0:1773851905.353887:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000100:00000040:9.0:1773851905.353887:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:29.0:1773851905.353888:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 3@kfi7 to cpt 7
00000400:00000200:25.0:1773851905.353888:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2105@kfi7: PUT: OK
00000800:00000200:13.0:1773851905.353888:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000100:00000001:25.0:1773851905.353889:0:2494371:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851905.353890:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-3@kfi7 of length 368/368 into md 0x78008259d [1] + 224
00000100:00000200:25.0:1773851905.353890:0:2494371:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:13.0:1773851905.353890:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:9.0:1773851905.353890:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:9.0:1773851905.353891:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bed3e4c9 nid 2080@kfi7 refs 2
00000800:00000200:29.0:1773851905.353892:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:28.0:1773851905.353892:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:13.0:1773851905.353892:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851905.353893:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:28.0:1773851905.353893:0:41088:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:25.0:1773851905.353893:0:2494371:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851905.353893:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 2080@kfi7(000000008a4d16cf):0x0 lsk 749 rsk 4789 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000400:00000200:29.0:1773851905.353894:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->3@kfi7: PUT: OK
00000400:00000001:28.0:1773851905.353894:0:41088:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:28.0:1773851905.353894:0:41088:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000200:13.0:1773851905.353894:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:29.0:1773851905.353895:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000010:28.0:1773851905.353895:0:41088:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dce9d16e.
00000400:00000200:13.0:1773851905.353895:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 7@kfi7 : PUT - for me
00000400:00000200:28.0:1773851905.353896:0:41088:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e00fc912
00000400:00000010:28.0:1773851905.353896:0:41088:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e00fc912.
00000100:00000001:25.0:1773851905.353896:0:2494371:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851905.353896:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000200:29.0:1773851905.353897:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851905.353897:0:41088:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:25.0:1773851905.353897:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:13.0:1773851905.353897:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 1
00000100:00000200:28.0:1773851905.353898:0:41088:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851905.353898:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:7.0:1773851905.353898:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:29.0:1773851905.353899:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:25.0:1773851905.353899:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 2105@kfi7(00000000b65923da):0x0 lsk 1223 rsk 4799 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000400:00000200:13.0:1773851905.353899:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:7.0:1773851905.353899:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851905.353900:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851905.353900:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000200:28.0:1773851905.353901:0:41088:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851905.353901:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 3
00000400:00000010:7.0:1773851905.353901:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000007398a75e.
00000400:00000200:13.0:1773851905.353902:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000400:00000200:7.0:1773851905.353902:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c74d75
00000400:00000010:7.0:1773851905.353902:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c74d75.
00000100:00000001:29.0:1773851905.353903:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:13.0:1773851905.353903:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-7@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7400
00000100:00000001:7.0:1773851905.353903:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:29.0:1773851905.353904:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000119a7d55 nid 3@kfi7 refs 2
00000100:00000001:28.0:1773851905.353904:0:41088:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:28.0:1773851905.353904:0:41088:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851905.353904:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 7@kfi7 to cpt 3
00000100:00000001:28.0:1773851905.353905:0:41088:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:28.0:1773851905.353905:0:41088:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000200:7.0:1773851905.353905:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851905.353905:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851905.353905:0:41065:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851905.353906:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 3@kfi7(0000000022f15586):0x0 lsk 954 rsk 4789 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:28.0:1773851905.353906:0:41088:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851905.353906:0:41088:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851905.353906:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-7@kfi7 of length 368/368 into md 0x82a5f77cd [1] + 224
02000000:00000001:28.0:1773851905.353907:0:41088:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851905.353907:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000001:4.0:1773851905.353907:0:41065:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:4.0:1773851905.353907:0:41065:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00001000:28.0:1773851905.353908:0:41088:0:(import.c:1951:at_measured()) add 66 to 00000000e9b3bafc time=138 v=66 (66 66 66 66)
00000800:00000200:13.0:1773851905.353908:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000010:4.0:1773851905.353908:0:41065:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000ec5e3fa5.
00000100:00001000:28.0:1773851905.353909:0:41088:0:(import.c:1951:at_measured()) add 1 to 00000000a48dfe13 time=138 v=66 (1 1 1 1)
00000400:00000200:4.0:1773851905.353909:0:41065:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000092a2acd5
00000400:00000010:4.0:1773851905.353909:0:41065:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000092a2acd5.
00000100:00000001:28.0:1773851905.353910:0:41088:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000400:00000200:13.0:1773851905.353910:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851905.353910:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851905.353910:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851905.353910:0:41065:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:28.0:1773851905.353911:0:41088:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:13.0:1773851905.353911:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->7@kfi7: PUT: OK
00000100:00000001:7.0:1773851905.353911:0:41064:0:(client.c:1428:after_reply()) Process entered
00000100:00000200:4.0:1773851905.353911:0:41065:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00010000:00000001:28.0:1773851905.353912:0:41088:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:28.0:1773851905.353912:0:41088:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:13.0:1773851905.353912:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
02000000:00000001:7.0:1773851905.353912:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851905.353912:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851905.353913:0:41088:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000200:13.0:1773851905.353913:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851905.353913:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851905.353913:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851905.353914:0:41088:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0010-osc-MDT0001: skip recheck: last_committed 176227474340
00000100:00000001:28.0:1773851905.353914:0:41088:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:7.0:1773851905.353914:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000009b7f1508 time=138 v=66 (66 66 66 66)
00000100:00000200:4.0:1773851905.353914:0:41065:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:28.0:1773851905.353915:0:41088:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851905.353915:0:41064:0:(import.c:1951:at_measured()) add 1 to 000000008fc08c2d time=138 v=66 (1 1 1 1)
00000100:00000040:28.0:1773851905.353916:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:13.0:1773851905.353916:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851905.353916:0:41065:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:4.0:1773851905.353916:0:41065:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851905.353917:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851905.353917:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353917:0:41065:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:4.0:1773851905.353917:0:41065:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851905.353918:0:41088:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00010000:00000001:7.0:1773851905.353918:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851905.353918:0:41064:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353918:0:41065:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851905.353919:0:41088:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851905.353919:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000001:4.0:1773851905.353919:0:41065:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851905.353919:0:41065:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.353920:0:41088:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851905.353920:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:7.0:1773851905.353920:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0005-osp-MDT0001: skip recheck: last_committed 169056978786
00000100:00000001:7.0:1773851905.353920:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00001000:4.0:1773851905.353920:0:41065:0:(import.c:1951:at_measured()) add 66 to 000000007cc90ba1 time=138 v=66 (66 66 66 66)
00000004:00000001:28.0:1773851905.353921:0:41088:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:28.0:1773851905.353921:0:41088:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0010-osc-MDT0001: Updating status = 0
00000400:00000200:13.0:1773851905.353921:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000191803e6 nid 7@kfi7 refs 2
00000100:00000001:7.0:1773851905.353921:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:4.0:1773851905.353921:0:41065:0:(import.c:1951:at_measured()) add 1 to 0000000044bbf089 time=138 v=66 (1 1 1 1)
00000004:00000040:28.0:1773851905.353922:0:41088:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0010-osc-MDT0001: blocks=410399726592 free=351510654976 avail=351508065280 avail_mb=1373078380 hwm_mb=3131103 files=372095663 ffree=343272124 state=0: rc = 0
00000800:00000200:13.0:1773851905.353922:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 7@kfi7(000000004335c4f3):0x0 lsk 4507 rsk 766 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000040:7.0:1773851905.353922:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851905.353922:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851905.353922:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:4.0:1773851905.353922:0:41065:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:4.0:1773851905.353922:0:41065:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:6.0:1773851905.353923:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:6.0:1773851905.353923:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00010000:00000001:4.0:1773851905.353923:0:41065:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:4.0:1773851905.353923:0:41065:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:28.0:1773851905.353924:0:41088:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0010-osc-MDT0001 (000000005208f938): 410399726592 blocks, 351510654976 free, 351508065280 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372095663 files, 343272124 free files
00000100:00000001:7.0:1773851905.353924:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:6.0:1773851905.353924:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000dd6d514f.
00000100:00000001:4.0:1773851905.353924:0:41065:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:4.0:1773851905.353924:0:41065:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0008-osc-MDT0001: skip recheck: last_committed 163342184689
00000004:00000001:28.0:1773851905.353925:0:41088:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353925:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000400:00000200:6.0:1773851905.353925:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000114436b6
00000400:00000010:6.0:1773851905.353925:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000114436b6.
00000100:00000001:4.0:1773851905.353925:0:41065:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:4.0:1773851905.353925:0:41065:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353926:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851905.353926:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:6.0:1773851905.353926:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000040:4.0:1773851905.353926:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:28.0:1773851905.353927:0:41088:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:7.0:1773851905.353927:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0005-osp-MDT0001 (000000001ce04029): 33735999936 blocks, 31354644736 free, 31354611008 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,3089064038 files, 2870603460 free files
00000100:00000200:6.0:1773851905.353927:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00100000:28.0:1773851905.353929:0:41088:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000074adcffb pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_00:lustre5-MDT0001-mdtlov_UUID:41088:1859433051944064:2080@kfi7:13:default-yuba2-0
00000004:00000001:7.0:1773851905.353929:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353929:0:41065:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851905.353929:0:41065:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:7.0:1773851905.353930:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000200:6.0:1773851905.353930:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:4.0:1773851905.353930:0:41065:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:4.0:1773851905.353930:0:41065:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:28.0:1773851905.353931:0:41088:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851905.353931:0:41088:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:4.0:1773851905.353931:0:41065:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0008-osc-MDT0001: Updating status = 0
00000100:00000040:28.0:1773851905.353932:0:41088:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000074adcffb x1859433051944064/t0(0) o13->lustre5-OST0010-osc-MDT0001@2080@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851905.353932:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000004:00000040:4.0:1773851905.353932:0:41065:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0008-osc-MDT0001: blocks=410399696896 free=351353565184 avail=351351213056 avail_mb=1372465676 hwm_mb=3131101 files=372083116 ffree=343118716 state=0: rc = 0
00000100:00100000:7.0:1773851905.353933:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000f47525b1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051943872:2098@kfi7:41:default-yuba2-0
00000100:00000001:6.0:1773851905.353933:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851905.353933:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:6.0:1773851905.353933:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:28.0:1773851905.353934:0:41088:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851905.353934:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851905.353934:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000004:00000020:4.0:1773851905.353934:0:41065:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0008-osc-MDT0001 (00000000b2413e54): 410399696896 blocks, 351353565184 free, 351351213056 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372083116 files, 343118716 free files
02000000:00000001:28.0:1773851905.353935:0:41088:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:28.0:1773851905.353935:0:41088:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000074d5d06.
00000100:00000001:7.0:1773851905.353935:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:6.0:1773851905.353935:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:6.0:1773851905.353935:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:4.0:1773851905.353935:0:41065:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851905.353936:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000f47525b1 x1859433051943872/t0(0) o41->lustre5-MDT0005-osp-MDT0001@2098@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00001000:6.0:1773851905.353936:0:41067:0:(import.c:1951:at_measured()) add 66 to 0000000029bec472 time=14 v=66 (66 66 66 66)
00000100:00000040:4.0:1773851905.353936:0:41065:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:28.0:1773851905.353937:0:41088:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:28.0:1773851905.353937:0:41088:0:(genops.c:1101:class_import_put()) Process entered
00000100:00001000:6.0:1773851905.353937:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000b3fd8ba2 time=20 v=66 (1 1 1 1)
00000020:00000040:28.0:1773851905.353938:0:41088:0:(genops.c:1107:class_import_put()) import 00000000dc4c50a3 refcount=7 obd=lustre5-OST0010-osc-MDT0001
00000020:00000001:28.0:1773851905.353938:0:41088:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851905.353938:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:6.0:1773851905.353938:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:6.0:1773851905.353938:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:28.0:1773851905.353939:0:41088:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000008a71a94e.
02000000:00000001:7.0:1773851905.353939:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851905.353939:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b2b64901.
00010000:00000001:6.0:1773851905.353939:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:6.0:1773851905.353939:0:41067:0:(ldlm_request.c:1473:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851905.353939:0:41065:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000165a41dd pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_01:lustre5-MDT0001-mdtlov_UUID:41065:1859433051944000:3@kfi7:13:default-yuba2-0
02000000:00000001:28.0:1773851905.353940:0:41088:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:28.0:1773851905.353940:0:41088:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:6.0:1773851905.353940:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:6.0:1773851905.353940:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-MDT0004-osp-MDT0001: skip recheck: last_committed 150865387852
00000100:00000001:4.0:1773851905.353940:0:41065:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000010:28.0:1773851905.353941:0:41088:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000074adcffb.
00000100:00000001:28.0:1773851905.353941:0:41088:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
02000000:00000001:7.0:1773851905.353941:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851905.353941:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851905.353941:0:41064:0:(genops.c:1107:class_import_put()) import 0000000062d6f8bb refcount=2 obd=lustre5-MDT0005-osp-MDT0001
00000100:00000001:6.0:1773851905.353941:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:6.0:1773851905.353941:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353941:0:41065:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:28.0:1773851905.353942:0:41088:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:28.0:1773851905.353942:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851905.353942:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000040:6.0:1773851905.353942:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000040:4.0:1773851905.353942:0:41065:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000165a41dd x1859433051944000/t0(0) o13->lustre5-OST0008-osc-MDT0001@3@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:28.0:1773851905.353943:0:41088:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:28.0:1773851905.353943:0:41088:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851905.353943:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 000000000869d922.
02000000:00000001:7.0:1773851905.353943:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:28.0:1773851905.353944:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:28.0:1773851905.353944:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851905.353944:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851905.353944:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000f47525b1.
00000100:00000001:6.0:1773851905.353944:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:4.0:1773851905.353944:0:41065:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:7.0:1773851905.353945:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851905.353945:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:6.0:1773851905.353945:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:4.0:1773851905.353945:0:41065:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:4.0:1773851905.353945:0:41065:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000009143fe2b.
00000100:00000001:7.0:1773851905.353946:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851905.353946:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:6.0:1773851905.353946:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:7.0:1773851905.353947:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000004:00000020:6.0:1773851905.353947:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-MDT0004-osp-MDT0001 (0000000065b282ed): 33736031808 blocks, 31536853920 free, 31536782176 avail, 4096 bsize, 0 reserved mb low, 0 reserved mb high,2973425540 files, 2779493228 free files
02000000:00000001:4.0:1773851905.353947:0:41065:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:4.0:1773851905.353947:0:41065:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:4.0:1773851905.353947:0:41065:0:(genops.c:1107:class_import_put()) import 0000000034e5921a refcount=3 obd=lustre5-OST0008-osc-MDT0001
00000100:00000001:7.0:1773851905.353948:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.353948:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00000001:6.0:1773851905.353948:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:4.0:1773851905.353948:0:41065:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:4.0:1773851905.353948:0:41065:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000100f702c.
00000100:00000001:7.0:1773851905.353949:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851905.353949:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:4.0:1773851905.353949:0:41065:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:4.0:1773851905.353950:0:41065:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:4.0:1773851905.353950:0:41065:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000165a41dd.
00000100:00000001:4.0:1773851905.353951:0:41065:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:4.0:1773851905.353951:0:41065:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00100000:6.0:1773851905.353952:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007a2bedac pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051943936:7@kfi7:41:default-yuba2-0
00000100:00000001:4.0:1773851905.353952:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851905.353952:0:41065:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851905.353953:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851905.353953:0:41065:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.353953:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:4.0:1773851905.353954:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353955:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851905.353955:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007a2bedac x1859433051943936/t0(0) o41->lustre5-MDT0004-osp-MDT0001@7@kfi7:24/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:6.0:1773851905.353957:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:6.0:1773851905.353958:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:6.0:1773851905.353958:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008d25977b.
02000000:00000001:6.0:1773851905.353959:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:6.0:1773851905.353960:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:6.0:1773851905.353960:0:41067:0:(genops.c:1107:class_import_put()) import 000000001b0ad50a refcount=2 obd=lustre5-MDT0004-osp-MDT0001
00000020:00000001:6.0:1773851905.353961:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:6.0:1773851905.353961:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000085d7323e.
02000000:00000001:6.0:1773851905.353962:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:6.0:1773851905.353962:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:6.0:1773851905.353963:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007a2bedac.
00000100:00000001:6.0:1773851905.353963:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:6.0:1773851905.353964:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851905.353964:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:6.0:1773851905.353965:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851905.353965:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.353966:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:6.0:1773851905.353966:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851905.374004:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851905.374006:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851905.374008:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851905.374011:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851905.374014:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.374016:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23506@kfi7 : PUT - for me
00000400:00000200:9.0:1773851905.374017:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.374018:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 1
00000400:00000200:9.0:1773851905.374020:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.374021:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000400:00000200:9.0:1773851905.374023:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 3
00000400:00000200:9.0:1773851905.374024:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.374025:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23506@kfi7 of length 224 into portal 12 MB=0x69b4b61451580
00000400:00000200:9.0:1773851905.374028:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23506@kfi7 of length 224/224 into md 0x78146ce49 [64] + 169360
00000800:00000200:9.0:1773851905.374031:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851905.374033:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851905.374035:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23506@kfi7: PUT: OK
00000100:00000001:9.0:1773851905.374037:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851905.374038:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851905.374039:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000053c250f.
00000100:00000040:9.0:1773851905.374041:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000053c250f x1859597917033856 msgsize 224
00000100:00100000:9.0:1773851905.374044:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-23506@kfi7 (source: 12345-23506@kfi7)
00000100:00000001:9.0:1773851905.374045:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851905.374047:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000100:00000001:11.0:1773851905.374048:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851905.374049:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:9.0:1773851905.374049:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851905.374050:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851905.374050:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851905.374052:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851905.374053:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597917033856
00000020:00000001:11.0:1773851905.374054:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851905.374055:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e24376d14
00000020:00000001:11.0:1773851905.374056:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851905.374060:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004b73932b refcount=40
00000020:00000001:11.0:1773851905.374061:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637152147262464 : -106921562289152 : ffff9ec16242cc00)
00000020:00000001:11.0:1773851905.374062:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637152147262464 : -106921562289152 : ffff9ec16242cc00)
00000100:00000001:11.0:1773851905.374064:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.374065:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851905.374066:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003236ac4a.
00000020:00000010:11.0:1773851905.374068:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851905.374069:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851905.374071:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851905.374072:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851905.374072:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.374074:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851905.374075:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851905.374075:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.374077:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.374079:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851905.374079:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851905.374080:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851905.374080:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851905.374081:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23506@kfi7, seq: 2130898
00000100:00000040:11.0:1773851905.374082:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004b73932b : new rpc_count 2
00000100:00000001:8.0:1773851905.374083:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.374084:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498307584 : -106953211244032 : ffff9eba03d61200)
00000100:00000001:8.0:1773851905.374084:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.374086:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000053c250f x1859597917033856/t0(0) o400->afc43426-7358-4285-8350-05d8e010e254@23506@kfi7:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1957-0'
00000100:00000001:11.0:1773851905.374090:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.374091:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851905.374092:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000053c250f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:afc43426-7358-4285-8350-05d8e010e254+40:39727:x1859597917033856:12345-23506@kfi7:400:default-tuolumne1957-0
00000100:00000200:11.0:1773851905.374095:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597917033856
00000020:00000001:11.0:1773851905.374096:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851905.374097:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851905.374098:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.374099:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851905.374100:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851905.374101:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851905.374103:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597917033856, found 0 last_xid 1859597916462655
00000020:00000001:11.0:1773851905.374104:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851905.374105:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851905.374106:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851905.374107:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.374108:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851905.374109:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851905.374109:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851905.374110:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000006dc7c85.
02000000:00000001:11.0:1773851905.374111:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.374112:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.374113:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851905.374115:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593494, transno 0, xid 1859597917033856
00010000:00000001:11.0:1773851905.374116:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851905.374117:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000053c250f x1859597917033856/t0(0) o400->afc43426-7358-4285-8350-05d8e010e254@23506@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1957-0'
00010000:00000001:11.0:1773851905.374121:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851905.374122:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851905.374123:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=138 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851905.374125:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851905.374126:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000988e1f20 refcount 3 to 23506@kfi7
00000100:00000001:11.0:1773851905.374128:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926899609984 : -107146809941632 : ffff9e8cf0746180)
02000000:00000001:11.0:1773851905.374129:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851905.374130:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.374131:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851905.374132:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23506@kfi7
00000400:00000010:11.0:1773851905.374133:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000040309670.
00000100:00000200:11.0:1773851905.374134:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597917033856, offset 224
00000400:00000200:11.0:1773851905.374137:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23506@kfi7
00000400:00000200:11.0:1773851905.374138:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.374140:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 1
00000400:00000200:11.0:1773851905.374142:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000400:00000200:11.0:1773851905.374143:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 3
00000400:00000200:11.0:1773851905.374145:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23506@kfi7 local destination
00000400:00000200:11.0:1773851905.374147:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770540:8770540:1024:4294967295] 23506@kfi7 LPNI seq info [598679:598679:16:4294967295]
00000400:00000200:11.0:1773851905.374150:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000400:00000200:11.0:1773851905.374151:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23506@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.374154:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23506@kfi7(23506@kfi7:23506@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851905.374156:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 3
00000800:00000200:11.0:1773851905.374158:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851905.374160:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851905.374163:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851905.374167:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x107 Using peer 23506@kfi7(0x107)
00000800:00000200:11.0:1773851905.374171:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000ccb6c3a6: Posted send of 324 bytes to peer 0x107: rc=0
00000800:00000200:11.0:1773851905.374174:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x107 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851905.374177:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.374178:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000988e1f20 refcount 2 to 23506@kfi7
00010000:00000001:11.0:1773851905.374179:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851905.374180:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.374181:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851905.374182:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000053c250f x1859597917033856/t0(0) o400->afc43426-7358-4285-8350-05d8e010e254@23506@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1957-0'
00000100:00100000:11.0:1773851905.374188:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000053c250f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:afc43426-7358-4285-8350-05d8e010e254+40:39727:x1859597917033856:12345-23506@kfi7:400:default-tuolumne1957-0 Request processed in 96us (146us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851905.374188:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x107 TN_EVENT_TX_OK event status 0
00000400:00000200:9.0:1773851905.374191:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:11.0:1773851905.374192:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23506@kfi7, seq: 2130898
00000400:00000200:9.0:1773851905.374193:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23506@kfi7: PUT: OK
00000100:00000040:11.0:1773851905.374194:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004b73932b : new rpc_count 1
00000400:00000200:9.0:1773851905.374194:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000040309670
00000100:00000001:11.0:1773851905.374195:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:9.0:1773851905.374195:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000040309670.
00000100:00000001:11.0:1773851905.374196:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851905.374196:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851905.374197:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000100:00000001:9.0:1773851905.374197:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851905.374198:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000200:9.0:1773851905.374198:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000aab98179 nid 23506@kfi7 refs 2
00000020:00000010:11.0:1773851905.374200:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003236ac4a.
00000020:00000040:11.0:1773851905.374201:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000004b73932b : new refcount 39
00000800:00000200:9.0:1773851905.374201:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ccb6c3a6: 2069@kfi7:2 -> 23506@kfi7(0000000018b81fa1):0x0 lsk 264 rsk 27 tsk 0 trmk 0 tmk 0 trr 2 tta 0x107 Transaction freed
00000100:00000001:11.0:1773851905.374202:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851905.385058:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851905.385059:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851905.385060:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851905.385062:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851905.385064:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385065:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 11258@kfi7 : PUT - for me
00000400:00000200:29.0:1773851905.385066:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385067:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:29.0:1773851905.385069:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385069:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:29.0:1773851905.385070:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:29.0:1773851905.385071:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385072:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11258@kfi7 of length 224 into portal 12 MB=0x69b867d08aec0
00000400:00000200:29.0:1773851905.385073:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11258@kfi7 of length 224/224 into md 0x77fe1859d [64] + 18536
00000800:00000200:29.0:1773851905.385075:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851905.385076:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.385078:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11258@kfi7: PUT: OK
00000100:00000001:29.0:1773851905.385078:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851905.385079:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851905.385080:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000720bfc57.
00000100:00000040:29.0:1773851905.385080:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000720bfc57 x1859851785907904 msgsize 224
00000100:00100000:29.0:1773851905.385082:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11258@kfi7 (source: 12345-11258@kfi7)
00000100:00000001:29.0:1773851905.385083:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851905.385084:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000100:00000001:31.0:1773851905.385085:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851905.385085:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:29.0:1773851905.385085:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851905.385086:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851905.385086:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851905.385087:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851905.385088:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859851785907904
00000020:00000001:31.0:1773851905.385088:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851905.385089:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08873a6770a
00000020:00000001:31.0:1773851905.385090:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851905.385093:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000048f0e615 refcount=5
00000020:00000001:31.0:1773851905.385094:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637150717597696 : -106922991953920 : ffff9ec10d0bd800)
00000020:00000001:31.0:1773851905.385094:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637150717597696 : -106922991953920 : ffff9ec10d0bd800)
00000100:00000001:31.0:1773851905.385095:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.385096:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851905.385097:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000afd5d76e.
00000020:00000010:31.0:1773851905.385098:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.385098:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851905.385099:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851905.385100:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851905.385100:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.385102:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851905.385102:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851905.385102:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.385103:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.385105:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851905.385105:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851905.385105:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851905.385105:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851905.385106:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11258@kfi7, seq: 2055625
00000100:00000040:31.0:1773851905.385107:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000048f0e615 : new rpc_count 1
00000100:00000001:31.0:1773851905.385107:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637079405316096 : -106994304235520 : ffff9eb07280c800)
00000100:00000001:28.0:1773851905.385107:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.385108:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000720bfc57 x1859851785907904/t0(0) o400->d7981da2-55de-42b6-b17a-9d58902c456d@11258@kfi7:693/0 lens 224/0 e 0 to 0 dl 1773852053 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne212-0'
00000100:00000001:28.0:1773851905.385108:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.385111:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.385112:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851905.385113:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000720bfc57 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:d7981da2-55de-42b6-b17a-9d58902c456d+5:42018:x1859851785907904:12345-11258@kfi7:400:default-tuolumne212-0
00000100:00000200:31.0:1773851905.385114:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859851785907904
00000020:00000001:31.0:1773851905.385115:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851905.385115:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851905.385116:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385117:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851905.385117:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851905.385118:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851905.385118:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859851785907904, found 0 last_xid 1859851785907903
00000020:00000001:31.0:1773851905.385119:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851905.385120:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851905.385120:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851905.385121:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385122:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851905.385122:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851905.385123:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851905.385125:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006d9d410e.
02000000:00000001:31.0:1773851905.385125:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.385126:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385127:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851905.385128:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859851785907904
00010000:00000001:31.0:1773851905.385129:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851905.385129:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000720bfc57 x1859851785907904/t0(0) o400->d7981da2-55de-42b6-b17a-9d58902c456d@11258@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00010000:00000001:31.0:1773851905.385132:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851905.385132:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851905.385133:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=138 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851905.385134:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851905.385135:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b5b44ef refcount 5 to 11258@kfi7
00000100:00000001:31.0:1773851905.385135:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806080 : -107130477745536 : ffff9e90bdedea80)
02000000:00000001:31.0:1773851905.385137:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851905.385137:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.385138:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851905.385138:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11258@kfi7
00000400:00000010:31.0:1773851905.385139:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000defe7a25.
00000100:00000200:31.0:1773851905.385140:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859851785907904, offset 224
00000400:00000200:31.0:1773851905.385142:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11258@kfi7
00000400:00000200:31.0:1773851905.385142:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.385143:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:31.0:1773851905.385145:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:31.0:1773851905.385146:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:31.0:1773851905.385147:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  11258@kfi7 local destination
00000400:00000200:31.0:1773851905.385148:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770541:8770541:1024:4294967295] 11258@kfi7 LPNI seq info [14064:14064:16:4294967295]
00000400:00000200:31.0:1773851905.385149:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:31.0:1773851905.385150:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.385152:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 11258@kfi7(11258@kfi7:11258@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851905.385153:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000800:00000200:31.0:1773851905.385154:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851905.385156:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851905.385158:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851905.385160:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 Using peer 11258@kfi7(0x423)
00000800:00000200:31.0:1773851905.385163:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x423: rc=0
00000800:00000200:31.0:1773851905.385165:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851905.385167:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.385168:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b5b44ef refcount 4 to 11258@kfi7
00010000:00000001:31.0:1773851905.385168:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851905.385169:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385169:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851905.385170:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000720bfc57 x1859851785907904/t0(0) o400->d7981da2-55de-42b6-b17a-9d58902c456d@11258@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00000100:00100000:31.0:1773851905.385173:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000720bfc57 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:d7981da2-55de-42b6-b17a-9d58902c456d+5:42018:x1859851785907904:12345-11258@kfi7:400:default-tuolumne212-0 Request processed in 61us (92us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851905.385175:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11258@kfi7, seq: 2055625
00000100:00000040:31.0:1773851905.385176:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000048f0e615 : new rpc_count 0
00000100:00000001:31.0:1773851905.385177:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851905.385177:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851905.385177:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851905.385178:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.385178:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851905.385179:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000afd5d76e.
00000020:00000040:31.0:1773851905.385180:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000048f0e615 : new refcount 4
00000100:00000001:31.0:1773851905.385180:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851905.385180:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.385181:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->11258@kfi7: PUT: OK
00000400:00000200:29.0:1773851905.385181:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000defe7a25
00000400:00000010:29.0:1773851905.385182:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000defe7a25.
00000100:00000001:29.0:1773851905.385183:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851905.385183:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851905.385184:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000800:00000200:29.0:1773851905.385185:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 11258@kfi7(000000007305fe62):0x0 lsk 1060 rsk 36 tsk 0 trmk 0 tmk 0 trr 7 tta 0x423 Transaction freed
00000800:00000200:29.0:1773851905.385630:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851905.385631:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851905.385632:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851905.385634:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851905.385635:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385636:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 11258@kfi7 : PUT - for me
00000400:00000200:29.0:1773851905.385637:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385638:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:29.0:1773851905.385639:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385640:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:29.0:1773851905.385640:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:29.0:1773851905.385641:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.385642:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-11258@kfi7 of length 224 into portal 12 MB=0x69b867d08b740
00000400:00000200:29.0:1773851905.385643:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-11258@kfi7 of length 224/224 into md 0x77fe1859d [64] + 18760
00000800:00000200:29.0:1773851905.385645:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851905.385646:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.385647:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11258@kfi7: PUT: OK
00000100:00000001:29.0:1773851905.385648:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851905.385648:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851905.385650:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000001d918fd.
00000100:00000040:29.0:1773851905.385650:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000001d918fd x1859851785910080 msgsize 224
00000100:00100000:29.0:1773851905.385652:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-11258@kfi7 (source: 12345-11258@kfi7)
00000100:00000001:29.0:1773851905.385653:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851905.385653:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000100:00000001:31.0:1773851905.385654:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851905.385654:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851905.385655:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851905.385655:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851905.385655:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851905.385656:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851905.385656:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859851785910080
00000020:00000001:31.0:1773851905.385657:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851905.385657:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f088caa601dc
00000020:00000001:31.0:1773851905.385667:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851905.385671:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000407f4e4e refcount=5
00000020:00000001:31.0:1773851905.385671:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637120382072832 : -106953327478784 : ffff9eb9fce87800)
00000020:00000001:31.0:1773851905.385672:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637120382072832 : -106953327478784 : ffff9eb9fce87800)
00000100:00000001:31.0:1773851905.385673:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.385674:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851905.385674:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049fc09bd.
00000020:00000010:31.0:1773851905.385675:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.385675:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851905.385676:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851905.385676:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851905.385677:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.385678:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851905.385678:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851905.385678:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.385679:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.385680:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851905.385680:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851905.385680:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:31.0:1773851905.385681:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-11258@kfi7, seq: 2055626
00000100:00000001:28.0:1773851905.385681:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851905.385682:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000407f4e4e : new rpc_count 1
00000100:00000001:31.0:1773851905.385682:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637151562461312 : -106922147090304 : ffff9ec13f677080)
00000100:00000001:28.0:1773851905.385682:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.385682:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.385683:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000001d918fd x1859851785910080/t0(0) o400->1deafb17-958a-41fb-a8ff-c35b2029a49d@11258@kfi7:693/0 lens 224/0 e 0 to 0 dl 1773852053 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne212-0'
00000100:00000001:31.0:1773851905.385686:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.385686:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851905.385687:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000001d918fd pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:1deafb17-958a-41fb-a8ff-c35b2029a49d+5:42020:x1859851785910080:12345-11258@kfi7:400:default-tuolumne212-0
00000100:00000200:31.0:1773851905.385688:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859851785910080
00000020:00000001:31.0:1773851905.385688:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851905.385689:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851905.385689:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385690:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851905.385690:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851905.385692:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851905.385692:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859851785910080, found 0 last_xid 1859851785910079
00000020:00000001:31.0:1773851905.385693:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851905.385694:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851905.385694:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851905.385694:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385695:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851905.385695:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851905.385696:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851905.385696:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000002b1c33da.
02000000:00000001:31.0:1773851905.385697:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.385697:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385698:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851905.385698:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859851785910080
00010000:00000001:31.0:1773851905.385699:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851905.385699:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000001d918fd x1859851785910080/t0(0) o400->1deafb17-958a-41fb-a8ff-c35b2029a49d@11258@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00010000:00000001:31.0:1773851905.385702:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851905.385702:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851905.385703:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=138 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851905.385704:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851905.385704:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000009b5b44ef refcount 5 to 11258@kfi7
00000100:00000001:31.0:1773851905.385705:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943231806080 : -107130477745536 : ffff9e90bdedea80)
02000000:00000001:31.0:1773851905.385705:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851905.385706:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.385706:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851905.385707:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-11258@kfi7
00000400:00000010:31.0:1773851905.385707:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e37bb3ee.
00000100:00000200:31.0:1773851905.385708:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859851785910080, offset 224
00000400:00000200:31.0:1773851905.385709:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-11258@kfi7
00000400:00000200:31.0:1773851905.385710:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.385711:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 1
00000400:00000200:31.0:1773851905.385711:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:31.0:1773851905.385712:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000400:00000200:31.0:1773851905.385713:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  11258@kfi7 local destination
00000400:00000200:31.0:1773851905.385714:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770542:8770542:1024:4294967295] 11258@kfi7 LPNI seq info [14065:14065:16:4294967295]
00000400:00000200:31.0:1773851905.385716:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000400:00000200:31.0:1773851905.385716:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 11258@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.385718:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 11258@kfi7(11258@kfi7:11258@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851905.385719:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 3
00000800:00000200:31.0:1773851905.385720:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851905.385721:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851905.385723:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851905.385729:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 Using peer 11258@kfi7(0x100000000000828)
00000800:00000200:31.0:1773851905.385733:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x100000000000828: rc=0
00000800:00000200:31.0:1773851905.385734:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851905.385735:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.385736:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000009b5b44ef refcount 4 to 11258@kfi7
00010000:00000001:31.0:1773851905.385737:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851905.385737:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.385737:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851905.385738:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000001d918fd x1859851785910080/t0(0) o400->1deafb17-958a-41fb-a8ff-c35b2029a49d@11258@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne212-0'
00000100:00100000:31.0:1773851905.385741:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000001d918fd pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:1deafb17-958a-41fb-a8ff-c35b2029a49d+5:42020:x1859851785910080:12345-11258@kfi7:400:default-tuolumne212-0 Request processed in 54us (90us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851905.385743:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-11258@kfi7, seq: 2055626
00000100:00000040:31.0:1773851905.385743:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000407f4e4e : new rpc_count 0
00000100:00000001:31.0:1773851905.385744:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851905.385744:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851905.385745:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.385746:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:31.0:1773851905.385747:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049fc09bd.
00000020:00000040:31.0:1773851905.385747:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000407f4e4e : new refcount 4
00000100:00000001:31.0:1773851905.385748:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:30.0:1773851905.385748:0:2472963:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 TN_EVENT_TX_OK event status 0
00000400:00000200:30.0:1773851905.385749:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851905.385751:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->11258@kfi7: PUT: OK
00000400:00000200:30.0:1773851905.385751:0:2472963:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e37bb3ee
00000400:00000010:30.0:1773851905.385752:0:2472963:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e37bb3ee.
00000100:00000001:30.0:1773851905.385752:0:2472963:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:30.0:1773851905.385753:0:2472963:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:30.0:1773851905.385754:0:2472963:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007629ca24 nid 11258@kfi7 refs 2
00000800:00000200:30.0:1773851905.385755:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 11258@kfi7(00000000b6e7ab42):0x0 lsk 2089 rsk 28 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000828 Transaction freed
00000800:00000200:29.0:1773851905.493172:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851905.493173:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851905.493175:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851905.493178:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851905.493181:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.493183:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22081@kfi7 : PUT - for me
00000400:00000200:29.0:1773851905.493184:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.493186:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 1
00000400:00000200:29.0:1773851905.493188:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.493189:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000400:00000200:29.0:1773851905.493190:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 3
00000400:00000200:29.0:1773851905.493192:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.493193:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22081@kfi7 of length 224 into portal 12 MB=0x699e0febfba80
00000400:00000200:29.0:1773851905.493195:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22081@kfi7 of length 224/224 into md 0x77fe1859d [64] + 18984
00000800:00000200:29.0:1773851905.493197:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851905.493200:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.493202:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22081@kfi7: PUT: OK
00000100:00000001:29.0:1773851905.493203:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851905.493203:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851905.493204:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004a7a4e7b.
00000100:00000040:29.0:1773851905.493205:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000004a7a4e7b x1858041485965952 msgsize 224
00000100:00100000:29.0:1773851905.493208:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22081@kfi7 (source: 12345-22081@kfi7)
00000100:00000001:29.0:1773851905.493210:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851905.493211:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000100:00000001:31.0:1773851905.493212:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851905.493213:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851905.493213:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851905.493213:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851905.493214:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851905.493215:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851905.493216:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041485965952
00000020:00000001:31.0:1773851905.493217:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851905.493217:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9299f
00000020:00000001:31.0:1773851905.493218:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851905.493222:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000017282155 refcount=6
00000020:00000001:31.0:1773851905.493223:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743191552 : -107128966360064 : ffff9e911803d400)
00000020:00000001:31.0:1773851905.493224:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743191552 : -107128966360064 : ffff9e911803d400)
00000100:00000001:31.0:1773851905.493226:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.493227:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851905.493228:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049fc09bd.
00000020:00000010:31.0:1773851905.493229:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.493230:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851905.493231:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851905.493232:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851905.493232:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.493234:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851905.493234:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851905.493235:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.493236:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.493238:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851905.493239:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851905.493239:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851905.493239:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851905.493240:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22081@kfi7, seq: 2055627
00000100:00000040:31.0:1773851905.493241:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000017282155 : new rpc_count 1
00000100:00000001:28.0:1773851905.493241:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.493242:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637151562456704 : -106922147094912 : ffff9ec13f675e80)
00000100:00000001:28.0:1773851905.493242:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.493244:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004a7a4e7b x1858041485965952/t0(0) o400->6e72f25a-084c-4639-bb1d-812ef8b57e86@22081@kfi7:693/0 lens 224/0 e 0 to 0 dl 1773852053 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1876-0'
00000100:00000001:31.0:1773851905.493249:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.493249:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851905.493251:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004a7a4e7b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:6e72f25a-084c-4639-bb1d-812ef8b57e86+6:39620:x1858041485965952:12345-22081@kfi7:400:default-tuolumne1876-0
00000100:00000200:31.0:1773851905.493253:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041485965952
00000020:00000001:31.0:1773851905.493253:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851905.493254:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851905.493255:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.493256:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851905.493257:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851905.493258:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851905.493259:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041485965952, found 0 last_xid 1858041485965951
00000020:00000001:31.0:1773851905.493260:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851905.493261:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851905.493261:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851905.493262:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.493263:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851905.493264:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851905.493265:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851905.493266:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000afd5d76e.
02000000:00000001:31.0:1773851905.493267:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.493267:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.493268:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851905.493269:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183252845152, transno 0, xid 1858041485965952
00010000:00000001:31.0:1773851905.493270:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851905.493271:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004a7a4e7b x1858041485965952/t0(0) o400->6e72f25a-084c-4639-bb1d-812ef8b57e86@22081@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1876-0'
00010000:00000001:31.0:1773851905.493275:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851905.493276:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851905.493277:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=138 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851905.493278:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851905.493280:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e7b1e045 refcount 3 to 22081@kfi7
00000100:00000001:31.0:1773851905.493281:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918603213152 : -107155106338464 : ffff9e8b01f36960)
02000000:00000001:31.0:1773851905.493284:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851905.493285:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.493286:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851905.493287:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22081@kfi7
00000400:00000010:31.0:1773851905.493288:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002c1b339d.
00000100:00000200:31.0:1773851905.493289:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041485965952, offset 224
00000400:00000200:31.0:1773851905.493291:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22081@kfi7
00000400:00000200:31.0:1773851905.493292:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.493294:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 1
00000400:00000200:31.0:1773851905.493295:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000400:00000200:31.0:1773851905.493297:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 3
00000400:00000200:31.0:1773851905.493299:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22081@kfi7 local destination
00000400:00000200:31.0:1773851905.493301:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770543:8770543:1024:4294967295] 22081@kfi7 LPNI seq info [297784:297784:16:4294967295]
00000400:00000200:31.0:1773851905.493303:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000400:00000200:31.0:1773851905.493304:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22081@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.493307:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22081@kfi7(22081@kfi7:22081@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851905.493309:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 3
00000800:00000200:31.0:1773851905.493311:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851905.493312:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851905.493316:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851905.493319:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000015e Using peer 22081@kfi7(0x10000000000015e)
00000800:00000200:31.0:1773851905.493323:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 000000009b43813d: Posted send of 324 bytes to peer 0x10000000000015e: rc=0
00000800:00000200:31.0:1773851905.493325:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000015e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851905.493328:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.493329:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e7b1e045 refcount 2 to 22081@kfi7
00010000:00000001:31.0:1773851905.493330:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851905.493331:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.493332:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851905.493333:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004a7a4e7b x1858041485965952/t0(0) o400->6e72f25a-084c-4639-bb1d-812ef8b57e86@22081@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1876-0'
00000100:00100000:31.0:1773851905.493338:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004a7a4e7b pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:6e72f25a-084c-4639-bb1d-812ef8b57e86+6:39620:x1858041485965952:12345-22081@kfi7:400:default-tuolumne1876-0 Request processed in 88us (132us total) trans 0 rc 0/0
00000800:00000200:29.0:1773851905.493339:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000015e TN_EVENT_TX_OK event status 0
00000100:00100000:31.0:1773851905.493342:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22081@kfi7, seq: 2055627
00000400:00000200:29.0:1773851905.493342:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:31.0:1773851905.493343:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000017282155 : new rpc_count 0
00000100:00000001:31.0:1773851905.493344:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851905.493344:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22081@kfi7: PUT: OK
00000100:00000001:31.0:1773851905.493345:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:29.0:1773851905.493345:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002c1b339d
00000020:00000010:31.0:1773851905.493346:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000400:00000010:29.0:1773851905.493346:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002c1b339d.
00000020:00000010:31.0:1773851905.493347:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000100:00000001:29.0:1773851905.493347:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851905.493347:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:31.0:1773851905.493348:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049fc09bd.
00000020:00000040:31.0:1773851905.493349:0:60677:0:(genops.c:882:class_export_put()) PUTting export 0000000017282155 : new refcount 5
00000400:00000200:29.0:1773851905.493349:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004ba12060 nid 22081@kfi7 refs 2
00000100:00000001:31.0:1773851905.493350:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851905.493351:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2054@kfi7:7 -> 22081@kfi7(00000000eba19d1f):0x0 lsk 351 rsk 48 tsk 0 trmk 0 tmk 0 trr 7 tta 0x10000000000015e Transaction freed
00000800:00000200:29.0:1773851905.518846:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851905.518847:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851905.518848:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851905.518850:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851905.518852:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.518853:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10449@kfi7 : PUT - for me
00000400:00000200:29.0:1773851905.518854:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.518854:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 1
00000400:00000200:29.0:1773851905.518856:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.518857:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000400:00000200:29.0:1773851905.518857:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 3
00000400:00000200:29.0:1773851905.518858:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10448@kfi7 to cpt 4
00000400:00000200:29.0:1773851905.518859:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10448@kfi7 of length 224 into portal 12 MB=0x699e115819ec0
00000400:00000200:29.0:1773851905.518860:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10448@kfi7 of length 224/224 into md 0x77fe1859d [64] + 19208
00000800:00000200:29.0:1773851905.518862:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851905.518863:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.518864:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10449@kfi7: PUT: OK
00000100:00000001:29.0:1773851905.518865:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851905.518866:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851905.518866:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a257c21c.
00000100:00000040:29.0:1773851905.518867:0:2467684:0:(events.c:358:request_in_callback()) incoming req@00000000a257c21c x1858041867771584 msgsize 224
00000100:00100000:29.0:1773851905.518869:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-10448@kfi7 (source: 12345-10449@kfi7)
00000100:00000001:29.0:1773851905.518869:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851905.518870:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000800:00000200:29.0:1773851905.518871:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851905.518872:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851905.518872:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851905.518873:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851905.518874:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851905.518875:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851905.518876:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041867771584
00000020:00000001:31.0:1773851905.518877:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851905.518877:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91689
00000020:00000001:31.0:1773851905.518878:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851905.518884:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003f7208bc refcount=6
00000020:00000001:31.0:1773851905.518884:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241241600 : -107152468310016 : ffff9e8b9f308800)
00000020:00000001:31.0:1773851905.518886:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241241600 : -107152468310016 : ffff9e8b9f308800)
00000100:00000001:31.0:1773851905.518887:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.518888:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851905.518889:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049fc09bd.
00000020:00000010:31.0:1773851905.518890:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000000682ea93.
00000020:00000010:31.0:1773851905.518892:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000eb167b5d.
00000100:00000001:31.0:1773851905.518893:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851905.518894:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851905.518895:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.518896:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851905.518897:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851905.518897:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.518898:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.518900:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851905.518900:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851905.518900:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851905.518901:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:31.0:1773851905.518902:0:60677:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851905.518902:0:42267:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10448@kfi7, seq: 2055628
00000100:00000040:28.0:1773851905.518902:0:42267:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003f7208bc : new rpc_count 1
00000100:00000001:31.0:1773851905.518903:0:60677:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.518903:0:42267:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637151562434816 : -106922147116800 : ffff9ec13f670900)
00000100:00000040:28.0:1773851905.518904:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a257c21c x1858041867771584/t0(0) o400->9aba6351-b3b7-49dd-bb1e-db0185a8585c@10448@kfi7:693/0 lens 224/0 e 0 to 0 dl 1773852053 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1137-0'
00000100:00000001:28.0:1773851905.518906:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851905.518907:0:42267:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:28.0:1773851905.518908:0:42267:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a257c21c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:9aba6351-b3b7-49dd-bb1e-db0185a8585c+6:39711:x1858041867771584:12345-10448@kfi7:400:default-tuolumne1137-0
00000100:00000200:28.0:1773851905.518909:0:42267:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041867771584
00000020:00000001:28.0:1773851905.518909:0:42267:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:28.0:1773851905.518910:0:42267:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:28.0:1773851905.518911:0:42267:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851905.518911:0:42267:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:28.0:1773851905.518912:0:42267:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:28.0:1773851905.518912:0:42267:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:28.0:1773851905.518913:0:42267:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041867771584, found 0 last_xid 1858041867771583
00000020:00000001:28.0:1773851905.518913:0:42267:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:28.0:1773851905.518914:0:42267:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:28.0:1773851905.518914:0:42267:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:28.0:1773851905.518915:0:42267:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851905.518915:0:42267:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:28.0:1773851905.518916:0:42267:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:28.0:1773851905.518916:0:42267:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:28.0:1773851905.518917:0:42267:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000000e469be4.
02000000:00000001:28.0:1773851905.518918:0:42267:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.518919:0:42267:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851905.518919:0:42267:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:28.0:1773851905.518920:0:42267:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183201002852, transno 0, xid 1858041867771584
00010000:00000001:28.0:1773851905.518920:0:42267:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:28.0:1773851905.518921:0:42267:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a257c21c x1858041867771584/t0(0) o400->9aba6351-b3b7-49dd-bb1e-db0185a8585c@10448@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1137-0'
00010000:00000001:28.0:1773851905.518923:0:42267:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:28.0:1773851905.518924:0:42267:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:28.0:1773851905.518924:0:42267:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=138 v=115 (1 1 1 115)
00000100:00000001:28.0:1773851905.518925:0:42267:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:28.0:1773851905.518926:0:42267:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007553f5da refcount 3 to 10448@kfi7
00000100:00000001:28.0:1773851905.518926:0:42267:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918301335200 : -107155408216416 : ffff9e8aeff51ea0)
02000000:00000001:28.0:1773851905.518927:0:42267:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:28.0:1773851905.518927:0:42267:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.518928:0:42267:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:28.0:1773851905.518928:0:42267:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10449@kfi7
00000400:00000010:28.0:1773851905.518929:0:42267:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e00fc912.
00000100:00000200:28.0:1773851905.518930:0:42267:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858041867771584, offset 224
00000400:00000200:28.0:1773851905.518931:0:42267:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10449@kfi7
00000400:00000200:28.0:1773851905.518932:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:28.0:1773851905.518933:0:42267:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 1
00000400:00000200:28.0:1773851905.518934:0:42267:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000400:00000200:28.0:1773851905.518935:0:42267:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 3
00000400:00000200:28.0:1773851905.518936:0:42267:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10449@kfi7 local destination
00000400:00000200:28.0:1773851905.518937:0:42267:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770544:8770544:1024:4294967295] 10449@kfi7 LPNI seq info [8660003:8660003:16:4294967295]
00000400:00000200:28.0:1773851905.518938:0:42267:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000400:00000200:28.0:1773851905.518939:0:42267:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10449@kfi7 to cpt 7
00000400:00000200:28.0:1773851905.518941:0:42267:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10449@kfi7(10449@kfi7:10449@kfi7) <?> : PUT try# 0
00000400:00000200:28.0:1773851905.518942:0:42267:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 3
00000800:00000200:28.0:1773851905.518944:0:42267:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:28.0:1773851905.518945:0:42267:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:28.0:1773851905.518947:0:42267:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:28.0:1773851905.518949:0:42267:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1103 Using peer 10449@kfi7(0x1103)
00000800:00000200:28.0:1773851905.518951:0:42267:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000298824bb: Posted send of 324 bytes to peer 0x1103: rc=0
00000800:00000200:28.0:1773851905.518952:0:42267:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1103 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:28.0:1773851905.518954:0:42267:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851905.518955:0:42267:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007553f5da refcount 2 to 10448@kfi7
00010000:00000001:28.0:1773851905.518955:0:42267:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:28.0:1773851905.518955:0:42267:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:28.0:1773851905.518956:0:42267:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:28.0:1773851905.518957:0:42267:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a257c21c x1858041867771584/t0(0) o400->9aba6351-b3b7-49dd-bb1e-db0185a8585c@10448@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1137-0'
00000100:00100000:28.0:1773851905.518959:0:42267:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a257c21c pname:cluuid+ref:pid:xid:nid:opc:job mdt07_004:9aba6351-b3b7-49dd-bb1e-db0185a8585c+6:39711:x1858041867771584:12345-10448@kfi7:400:default-tuolumne1137-0 Request processed in 52us (92us total) trans 0 rc 0/0
00000100:00100000:28.0:1773851905.518963:0:42267:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10448@kfi7, seq: 2055628
00000100:00000040:28.0:1773851905.518963:0:42267:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003f7208bc : new rpc_count 0
00000100:00000001:28.0:1773851905.518964:0:42267:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:28.0:1773851905.518964:0:42267:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:28.0:1773851905.518965:0:42267:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000000682ea93.
00000020:00000010:28.0:1773851905.518965:0:42267:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000eb167b5d.
00000020:00000010:28.0:1773851905.518966:0:42267:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049fc09bd.
00000020:00000040:28.0:1773851905.518967:0:42267:0:(genops.c:882:class_export_put()) PUTting export 000000003f7208bc : new refcount 5
00000100:00000001:28.0:1773851905.518967:0:42267:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:29.0:1773851905.518972:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1103 TN_EVENT_TX_OK event status 0
00000400:00000200:29.0:1773851905.518973:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.518975:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10449@kfi7: PUT: OK
00000400:00000200:29.0:1773851905.518975:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e00fc912
00000400:00000010:29.0:1773851905.518976:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e00fc912.
00000100:00000001:29.0:1773851905.518976:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851905.518977:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851905.518977:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008a7ce76c nid 10449@kfi7 refs 2
00000800:00000200:29.0:1773851905.518978:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000298824bb: 2069@kfi7:7 -> 10449@kfi7(00000000956a0609):0x0 lsk 4356 rsk 54 tsk 0 trmk 0 tmk 0 trr 7 tta 0x1103 Transaction freed
00000800:00000200:21.0:1773851905.566164:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851905.566165:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851905.566166:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851905.566169:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851905.566171:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.566172:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 25248@kfi7 : PUT - for me
00000400:00000200:21.0:1773851905.566173:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.566173:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 1
00000400:00000200:21.0:1773851905.566174:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.566175:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 2
00000400:00000200:21.0:1773851905.566176:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 3
00000400:00000200:21.0:1773851905.566176:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.566177:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25248@kfi7 of length 224 into portal 12 MB=0x69b4b9e485240
00000400:00000200:21.0:1773851905.566178:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25248@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 72424
00000800:00000200:21.0:1773851905.566179:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851905.566181:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.566182:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25248@kfi7: PUT: OK
00000100:00000001:21.0:1773851905.566183:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851905.566183:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851905.566184:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002d94e655.
00000100:00000040:21.0:1773851905.566185:0:2494373:0:(events.c:358:request_in_callback()) incoming req@000000002d94e655 x1859598940656192 msgsize 224
00000100:00100000:21.0:1773851905.566186:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-25248@kfi7 (source: 12345-25248@kfi7)
00000100:00000001:21.0:1773851905.566187:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851905.566188:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 2
00000100:00000001:20.0:1773851905.566188:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:21.0:1773851905.566189:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851905.566189:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851905.566189:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851905.566189:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851905.566191:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851905.566191:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598940656192
00000020:00000001:20.0:1773851905.566192:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851905.566192:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e3895db56
00000020:00000001:20.0:1773851905.566193:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851905.566196:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000060dded7a refcount=5
00000020:00000001:20.0:1773851905.566197:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637137288117248 : -106936421434368 : ffff9ebdec963c00)
00000020:00000001:20.0:1773851905.566198:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637137288117248 : -106936421434368 : ffff9ebdec963c00)
00000100:00000001:20.0:1773851905.566199:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.566200:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851905.566200:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005f9598dd.
00000020:00000010:20.0:1773851905.566201:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.566203:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008b2657fc.
00000100:00000001:20.0:1773851905.566203:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851905.566204:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851905.566204:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851905.566205:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851905.566206:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851905.566206:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.566207:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851905.566208:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851905.566209:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851905.566209:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851905.566209:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:23.0:1773851905.566210:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851905.566210:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25248@kfi7, seq: 1998101
00000100:00000040:20.0:1773851905.566210:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000060dded7a : new rpc_count 1
00000100:00000001:23.0:1773851905.566211:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.566211:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313411968 : -106917396139648 : ffff9ec25a953180)
00000100:00000040:20.0:1773851905.566212:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002d94e655 x1859598940656192/t0(0) o400->274c2e67-cfbb-4b8c-a5eb-f77cc706a134@25248@kfi7:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2064-0'
00000100:00000001:20.0:1773851905.566215:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.566215:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851905.566216:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002d94e655 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:274c2e67-cfbb-4b8c-a5eb-f77cc706a134+5:39590:x1859598940656192:12345-25248@kfi7:400:default-tuolumne2064-0
00000100:00000200:20.0:1773851905.566217:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598940656192
00000020:00000001:20.0:1773851905.566218:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851905.566219:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851905.566219:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.566220:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851905.566221:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851905.566221:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851905.566222:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598940656192, found 0 last_xid 1859598940656191
00000020:00000001:20.0:1773851905.566223:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851905.566223:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851905.566224:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851905.566224:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.566225:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851905.566225:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851905.566226:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851905.566227:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003c2194b9.
02000000:00000001:20.0:1773851905.566227:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.566228:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.566229:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851905.566229:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182608876305, transno 0, xid 1859598940656192
00010000:00000001:20.0:1773851905.566230:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851905.566231:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002d94e655 x1859598940656192/t0(0) o400->274c2e67-cfbb-4b8c-a5eb-f77cc706a134@25248@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2064-0'
00010000:00000001:20.0:1773851905.566233:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851905.566234:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851905.566234:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=138 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851905.566235:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851905.566236:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000279c6fb refcount 3 to 25248@kfi7
00000100:00000001:20.0:1773851905.566237:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916964028160 : -107156745523456 : ffff9e8aa03f6f00)
02000000:00000001:20.0:1773851905.566237:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851905.566238:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.566239:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851905.566239:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25248@kfi7
00000400:00000010:20.0:1773851905.566240:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c06062.
00000100:00000200:20.0:1773851905.566241:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598940656192, offset 224
00000400:00000200:20.0:1773851905.566242:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25248@kfi7
00000400:00000200:20.0:1773851905.566242:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.566243:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 1
00000400:00000200:20.0:1773851905.566245:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 2
00000400:00000200:20.0:1773851905.566246:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 3
00000400:00000200:20.0:1773851905.566247:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  25248@kfi7 local destination
00000400:00000200:20.0:1773851905.566248:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770545:8770545:1024:4294967295] 25248@kfi7 LPNI seq info [211829:211829:16:4294967295]
00000400:00000200:20.0:1773851905.566249:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004969363a nid 25248@kfi7 refs 2
00000400:00000200:20.0:1773851905.566250:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25248@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.566252:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 25248@kfi7(25248@kfi7:25248@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851905.566253:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 3
00000800:00000200:20.0:1773851905.566255:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851905.566256:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851905.566258:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851905.566261:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000819 Using peer 25248@kfi7(0x100000000000819)
00000800:00000200:20.0:1773851905.566263:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x100000000000819: rc=0
00000800:00000200:20.0:1773851905.566265:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000819 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851905.566267:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.566268:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000279c6fb refcount 2 to 25248@kfi7
00010000:00000001:20.0:1773851905.566268:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851905.566269:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.566270:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851905.566270:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002d94e655 x1859598940656192/t0(0) o400->274c2e67-cfbb-4b8c-a5eb-f77cc706a134@25248@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2064-0'
00000100:00100000:20.0:1773851905.566274:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002d94e655 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:274c2e67-cfbb-4b8c-a5eb-f77cc706a134+5:39590:x1859598940656192:12345-25248@kfi7:400:default-tuolumne2064-0 Request processed in 58us (88us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851905.566276:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25248@kfi7, seq: 1998101
00000100:00000040:20.0:1773851905.566277:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000060dded7a : new rpc_count 0
00000100:00000001:20.0:1773851905.566277:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851905.566278:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851905.566278:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.566279:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008b2657fc.
00000020:00000010:20.0:1773851905.566280:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005f9598dd.
00000020:00000040:20.0:1773851905.566280:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000060dded7a : new refcount 4
00000100:00000001:20.0:1773851905.566281:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851905.566286:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000819 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851905.566287:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.566288:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->25248@kfi7: PUT: OK
00000400:00000200:21.0:1773851905.566288:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c06062
00000400:00000010:21.0:1773851905.566289:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c06062.
00000100:00000001:21.0:1773851905.566290:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851905.566290:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851905.566291:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004969363a nid 25248@kfi7 refs 2
00000800:00000200:21.0:1773851905.566292:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 25248@kfi7(00000000dc28523b):0x0 lsk 2074 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000819 Transaction freed
00000800:00000200:9.0:1773851905.586615:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851905.586616:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:9.0:1773851905.586617:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:10.0:1773851905.586619:0:2464469:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851905.586619:0:2458095:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 26064@kfi7(00000000391f6590):0xe75 version: 2; local version 2; negotiated version: 2
00000800:00000200:10.0:1773851905.586620:0:2464469:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:10.0:1773851905.586621:0:2464469:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851905.586621:0:2458095:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 Using peer 26064@kfi7(0xe75)
00000800:00000200:10.0:1773851905.586623:0:2464469:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851905.586623:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26064@kfi7 to cpt 2
00000400:00000200:10.0:1773851905.586625:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26064@kfi7 to cpt 2
00000800:00000200:9.0:1773851905.586625:0:2458095:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000743dc611: Posted send of 38 bytes to peer 0xe75: rc=0
00000400:00000200:10.0:1773851905.586626:0:2464469:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26064@kfi7 : PUT - for me
00000800:00000200:9.0:1773851905.586626:0:2458095:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:10.0:1773851905.586627:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26064@kfi7 to cpt 2
00000400:00000200:10.0:1773851905.586628:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000164746ab nid 26064@kfi7 refs 1
00000400:00000200:10.0:1773851905.586630:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26064@kfi7 to cpt 2
00000400:00000200:10.0:1773851905.586630:0:2464469:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000164746ab nid 26064@kfi7 refs 2
00000400:00000200:10.0:1773851905.586631:0:2464469:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000164746ab nid 26064@kfi7 refs 3
00000400:00000200:10.0:1773851905.586632:0:2464469:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25872@kfi7 to cpt 7
00000400:00000200:10.0:1773851905.586633:0:2464469:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25872@kfi7 of length 456 into portal 12 MB=0x699e1077785c0
00000400:00000200:10.0:1773851905.586634:0:2464469:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25872@kfi7 of length 456/456 into md 0x78146ce49 [64] + 169584
00000800:00000200:10.0:1773851905.586636:0:2464469:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:10.0:1773851905.586638:0:2464469:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:9.0:1773851905.586638:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 TN_EVENT_TX_OK event status 0
00000400:00000200:10.0:1773851905.586639:0:2464469:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26064@kfi7: PUT: OK
00000100:00000001:10.0:1773851905.586640:0:2464469:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:10.0:1773851905.586640:0:2464469:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:9.0:1773851905.586640:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 Transaction freed
00000100:00000010:10.0:1773851905.586641:0:2464469:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000037d69b00.
00000100:00000040:10.0:1773851905.586642:0:2464469:0:(events.c:358:request_in_callback()) incoming req@0000000037d69b00 x1858041632228800 msgsize 456
00000100:00100000:10.0:1773851905.586643:0:2464469:0:(events.c:361:request_in_callback()) peer: 12345-25872@kfi7 (source: 12345-26064@kfi7)
00000100:00000001:10.0:1773851905.586644:0:2464469:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851905.586646:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851905.586646:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000400:00000200:10.0:1773851905.586646:0:2464469:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000164746ab nid 26064@kfi7 refs 2
00000100:00000001:11.0:1773851905.586647:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851905.586647:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851905.586648:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851905.586648:0:2464469:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000003858ee31: 2069@kfi7:2 <- 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00100000:11.0:1773851905.586649:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041632228800
00000020:00000001:11.0:1773851905.586650:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851905.586650:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac917af
00000020:00000001:11.0:1773851905.586651:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851905.586655:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000bcdecf64 refcount=6
00000020:00000001:11.0:1773851905.586656:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921241735168 : -107152467816448 : ffff9e8b9f381000)
00000020:00000001:11.0:1773851905.586657:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921241735168 : -107152467816448 : ffff9e8b9f381000)
00000100:00000001:11.0:1773851905.586658:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.586659:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851905.586660:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003236ac4a.
00000020:00000010:11.0:1773851905.586661:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851905.586661:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851905.586662:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851905.586662:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851905.586663:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.586664:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.586665:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.586666:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851905.586666:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851905.586667:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851905.586667:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851905.586668:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25872@kfi7, seq: 406391021
00000100:00000001:8.0:1773851905.586668:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.586669:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000bcdecf64 : new rpc_count 1
00000100:00000001:8.0:1773851905.586669:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.586670:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637129087763328 : -106944621788288 : ffff9ebc03cec380)
00000100:00000040:11.0:1773851905.586671:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000037d69b00 x1858041632228800/t0(0) o17->8193d9ee-0a9b-4a47-8469-72557e5b8f41@25872@kfi7:693/0 lens 456/0 e 0 to 0 dl 1773852053 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2113-0'
00000100:00000001:11.0:1773851905.586674:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.586674:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851905.586675:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000037d69b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8193d9ee-0a9b-4a47-8469-72557e5b8f41+6:39684:x1858041632228800:12345-25872@kfi7:17:default-tuolumne2113-0
00000100:00000200:11.0:1773851905.586676:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041632228800
00000020:00000001:11.0:1773851905.586677:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851905.586678:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851905.586678:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.586679:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851905.586679:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:11.0:1773851905.586680:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851905.586681:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041632228800, found 0 last_xid 1858041632228799
00000020:00000001:11.0:1773851905.586682:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851905.586682:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851905.586683:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851905.586683:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:11.0:1773851905.586684:0:60829:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:11.0:1773851905.586685:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851905.586685:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851905.586687:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 00000000960ffd8c.
02000000:00000001:11.0:1773851905.586687:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.586688:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.586689:0:60829:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:11.0:1773851905.586690:0:60829:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:11.0:1773851905.586690:0:60829:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:11.0:1773851905.586692:0:60829:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.586692:0:60829:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:11.0:1773851905.586693:0:60829:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 8193d9ee-0a9b-4a47-8469-72557e5b8f41/00000000bcdecf64 free: 126633370845184 avail: 126633368748032
00000020:00000001:11.0:1773851905.586694:0:60829:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:11.0:1773851905.586695:0:60829:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 8193d9ee-0a9b-4a47-8469-72557e5b8f41/00000000bcdecf64 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:11.0:1773851905.586698:0:60829:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:11.0:1773851905.586699:0:60829:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:11.0:1773851905.586699:0:60829:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 8193d9ee-0a9b-4a47-8469-72557e5b8f41/00000000bcdecf64 reports grant 1811939327 dropped 0, local 1880096767
00000020:00000001:11.0:1773851905.586701:0:60829:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:11.0:1773851905.586701:0:60829:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:11.0:1773851905.586702:0:60829:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851905.586703:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183255728282, transno 0, xid 1858041632228800
00010000:00000001:11.0:1773851905.586703:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851905.586704:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000037d69b00 x1858041632228800/t0(0) o17->8193d9ee-0a9b-4a47-8469-72557e5b8f41@25872@kfi7:693/0 lens 456/432 e 0 to 0 dl 1773852053 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2113-0'
00010000:00000001:11.0:1773851905.586707:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851905.586707:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851905.586708:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=138 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851905.586709:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851905.586710:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000b951b8c9 refcount 3 to 25872@kfi7
00000100:00000001:11.0:1773851905.586711:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091268608 : -107152618283008 : ffff9e8b96402000)
02000000:00000001:11.0:1773851905.586712:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851905.586712:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.586713:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851905.586714:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26064@kfi7
00000400:00000010:11.0:1773851905.586714:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006b3931a1.
00000100:00000200:11.0:1773851905.586715:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858041632228800, offset 224
00000400:00000200:11.0:1773851905.586717:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26064@kfi7
00000400:00000200:11.0:1773851905.586717:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26064@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.586718:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000164746ab nid 26064@kfi7 refs 1
00000400:00000200:11.0:1773851905.586719:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000164746ab nid 26064@kfi7 refs 2
00000400:00000200:11.0:1773851905.586720:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000164746ab nid 26064@kfi7 refs 3
00000400:00000200:11.0:1773851905.586722:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26064@kfi7 local destination
00000400:00000200:11.0:1773851905.586723:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770546:8770546:1024:4294967295] 26064@kfi7 LPNI seq info [6163689:6163689:16:4294967295]
00000400:00000200:11.0:1773851905.586729:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000164746ab nid 26064@kfi7 refs 2
00000400:00000200:11.0:1773851905.586730:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26064@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.586732:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26064@kfi7(26064@kfi7:26064@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851905.586733:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000164746ab nid 26064@kfi7 refs 3
00000800:00000200:11.0:1773851905.586734:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851905.586735:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:11.0:1773851905.586737:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851905.586740:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 Using peer 26064@kfi7(0xe75)
00000800:00000200:11.0:1773851905.586743:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 0000000077a0c43c: Posted send of 532 bytes to peer 0xe75: rc=0
00000800:00000200:11.0:1773851905.586744:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851905.586746:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.586747:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000b951b8c9 refcount 2 to 25872@kfi7
00010000:00000001:11.0:1773851905.586748:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851905.586748:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.586749:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851905.586749:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000037d69b00 x1858041632228800/t0(0) o17->8193d9ee-0a9b-4a47-8469-72557e5b8f41@25872@kfi7:693/0 lens 456/432 e 0 to 0 dl 1773852053 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2113-0'
00000100:00100000:11.0:1773851905.586753:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000037d69b00 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:8193d9ee-0a9b-4a47-8469-72557e5b8f41+6:39684:x1858041632228800:12345-25872@kfi7:17:default-tuolumne2113-0 Request processed in 78us (110us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851905.586755:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25872@kfi7, seq: 406391021
00000100:00000040:11.0:1773851905.586756:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000bcdecf64 : new rpc_count 0
00000800:00000200:9.0:1773851905.586756:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851905.586757:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851905.586758:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851905.586758:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851905.586758:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851905.586759:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000200:9.0:1773851905.586759:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26064@kfi7: PUT: OK
00000020:00000010:11.0:1773851905.586760:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003236ac4a.
00000020:00000040:11.0:1773851905.586760:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000bcdecf64 : new refcount 5
00000400:00000200:9.0:1773851905.586760:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006b3931a1
00000400:00000010:9.0:1773851905.586760:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006b3931a1.
00000100:00000001:11.0:1773851905.586761:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:9.0:1773851905.586761:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851905.586761:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851905.586762:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000164746ab nid 26064@kfi7 refs 2
00000800:00000200:9.0:1773851905.586764:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000077a0c43c: 2069@kfi7:2 -> 26064@kfi7(00000000391f6590):0x0 lsk 3702 rsk 52 tsk 0 trmk 0 tmk 0 trr 2 tta 0xe75 Transaction freed
00000800:00000200:31.0:1773851905.620880:0:2465875:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851905.620880:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851905.620881:0:2465875:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851905.620881:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:31.0:1773851905.620883:0:2465875:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851905.620883:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:31.0:1773851905.620885:0:2465875:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:29.0:1773851905.620885:0:2467684:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25665@kfi7(00000000d0927b62):0x72b version: 2; local version 2; negotiated version: 2
00000400:00000200:31.0:1773851905.620887:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000800:00000200:29.0:1773851905.620887:0:2467684:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b Using peer 25665@kfi7(0x72b)
00000400:00000200:31.0:1773851905.620888:0:2465875:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25665@kfi7 : PUT - for me
00000400:00000200:31.0:1773851905.620889:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000400:00000200:29.0:1773851905.620889:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.620890:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063c19341 nid 25665@kfi7 refs 1
00000800:00000200:29.0:1773851905.620890:0:2467684:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b83ff6e: Posted send of 38 bytes to peer 0x72b: rc=0
00000400:00000200:31.0:1773851905.620891:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.620892:0:2465875:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063c19341 nid 25665@kfi7 refs 2
00000800:00000200:29.0:1773851905.620892:0:2467684:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:31.0:1773851905.620893:0:2465875:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000063c19341 nid 25665@kfi7 refs 3
00000400:00000200:31.0:1773851905.620894:0:2465875:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.620895:0:2465875:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25665@kfi7 of length 456 into portal 12 MB=0x699e0ecf1fb00
00000400:00000200:31.0:1773851905.620897:0:2465875:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25665@kfi7 of length 456/456 into md 0x77fe1859d [64] + 19432
00000800:00000200:31.0:1773851905.620899:0:2465875:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:31.0:1773851905.620901:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:31.0:1773851905.620902:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25665@kfi7: PUT: OK
00000100:00000001:31.0:1773851905.620903:0:2465875:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:31.0:1773851905.620904:0:2465875:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:29.0:1773851905.620904:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b TN_EVENT_TX_OK event status 0
00000100:00000010:31.0:1773851905.620905:0:2465875:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000009d6a92c0.
00000100:00000040:31.0:1773851905.620906:0:2465875:0:(events.c:358:request_in_callback()) incoming req@000000009d6a92c0 x1858041187269376 msgsize 456
00000800:00000200:29.0:1773851905.620906:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b Transaction freed
00000100:00100000:31.0:1773851905.620908:0:2465875:0:(events.c:361:request_in_callback()) peer: 12345-25665@kfi7 (source: 12345-25665@kfi7)
00000100:00000001:31.0:1773851905.620909:0:2465875:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:31.0:1773851905.620910:0:2465875:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000063c19341 nid 25665@kfi7 refs 2
00000100:00000001:28.0:1773851905.620910:0:42267:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:31.0:1773851905.620911:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b43813d: 2069@kfi7:7 <- 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:28.0:1773851905.620911:0:42267:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:28.0:1773851905.620911:0:42267:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:28.0:1773851905.620912:0:42267:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851905.620913:0:42267:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:28.0:1773851905.620914:0:42267:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858041187269376
00000020:00000001:28.0:1773851905.620915:0:42267:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:28.0:1773851905.620916:0:42267:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91a6b
00000020:00000001:28.0:1773851905.620916:0:42267:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:28.0:1773851905.620920:0:42267:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000abf47023 refcount=6
00000020:00000001:28.0:1773851905.620920:0:42267:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950627751936 : -107123081799680 : ffff9e9276c31800)
00000020:00000001:28.0:1773851905.620921:0:42267:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950627751936 : -107123081799680 : ffff9e9276c31800)
00000100:00000001:28.0:1773851905.620922:0:42267:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:28.0:1773851905.620923:0:42267:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:28.0:1773851905.620924:0:42267:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000006eaed4a4.
00000020:00000010:28.0:1773851905.620925:0:42267:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a47915ef.
00000020:00000010:28.0:1773851905.620926:0:42267:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000ba3dd508.
00000100:00000040:28.0:1773851905.620928:0:42267:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt at +82s
00000100:00000001:28.0:1773851905.620929:0:42267:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:28.0:1773851905.620929:0:42267:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:28.0:1773851905.620930:0:42267:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.620931:0:42267:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.620932:0:42267:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.620934:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851905.620934:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851905.620935:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851905.620935:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851905.620936:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25665@kfi7, seq: 364304990
00000100:00000040:31.0:1773851905.620936:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000abf47023 : new rpc_count 1
00000100:00000001:28.0:1773851905.620936:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.620937:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637034999063552 : -107038710488064 : ffff9ea61baf2400)
00000100:00000001:28.0:1773851905.620937:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.620938:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000009d6a92c0 x1858041187269376/t0(0) o17->4d62ce7a-d894-4ab1-87c4-4305d73f0dfa@25665@kfi7:632/0 lens 456/0 e 0 to 0 dl 1773851992 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne2100-0'
00000100:00000001:31.0:1773851905.620941:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851905.620941:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851905.620942:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000009d6a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:4d62ce7a-d894-4ab1-87c4-4305d73f0dfa+6:39652:x1858041187269376:12345-25665@kfi7:17:default-tuolumne2100-0
00000100:00000200:31.0:1773851905.620944:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858041187269376
00000020:00000001:31.0:1773851905.620944:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851905.620945:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851905.620946:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.620946:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851905.620947:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:31.0:1773851905.620948:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851905.620948:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858041187269376, found 0 last_xid 1858041187269375
00000020:00000001:31.0:1773851905.620949:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851905.620950:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851905.620950:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851905.620951:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851905.620951:0:60677:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:31.0:1773851905.620952:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851905.620953:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851905.620953:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000005c322e05.
02000000:00000001:31.0:1773851905.620954:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.620955:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.620956:0:60677:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:31.0:1773851905.620957:0:60677:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:31.0:1773851905.620957:0:60677:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851905.620959:0:60677:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.620959:0:60677:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:31.0:1773851905.620960:0:60677:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli 4d62ce7a-d894-4ab1-87c4-4305d73f0dfa/00000000abf47023 free: 126633370845184 avail: 126633368748032
00000020:00000001:31.0:1773851905.620961:0:60677:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:31.0:1773851905.620962:0:60677:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli 4d62ce7a-d894-4ab1-87c4-4305d73f0dfa/00000000abf47023 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:31.0:1773851905.620963:0:60677:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:31.0:1773851905.620964:0:60677:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:31.0:1773851905.620965:0:60677:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli 4d62ce7a-d894-4ab1-87c4-4305d73f0dfa/00000000abf47023 reports grant 1810890751 dropped 0, local 1878786047
00000020:00000001:31.0:1773851905.620966:0:60677:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:31.0:1773851905.620966:0:60677:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:31.0:1773851905.620967:0:60677:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851905.620968:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183066172622, transno 0, xid 1858041187269376
00010000:00000001:31.0:1773851905.620968:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851905.620969:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000009d6a92c0 x1858041187269376/t0(0) o17->4d62ce7a-d894-4ab1-87c4-4305d73f0dfa@25665@kfi7:632/0 lens 456/432 e 0 to 0 dl 1773851992 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2100-0'
00010000:00000001:31.0:1773851905.620972:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851905.620972:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851905.620973:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=138 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851905.620974:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851905.620975:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000daa428b1 refcount 3 to 25665@kfi7
00000100:00000001:31.0:1773851905.620975:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917412883264 : -107156296668352 : ffff9e8abb006b40)
02000000:00000001:31.0:1773851905.620976:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851905.620977:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.620977:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851905.620978:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25665@kfi7
00000400:00000010:31.0:1773851905.620979:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000030edd6e9.
00000100:00000200:31.0:1773851905.620980:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858041187269376, offset 224
00000400:00000200:31.0:1773851905.620981:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25665@kfi7
00000400:00000200:31.0:1773851905.620982:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.620982:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000063c19341 nid 25665@kfi7 refs 1
00000400:00000200:31.0:1773851905.620983:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000063c19341 nid 25665@kfi7 refs 2
00000400:00000200:31.0:1773851905.620984:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000063c19341 nid 25665@kfi7 refs 3
00000400:00000200:31.0:1773851905.620986:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25665@kfi7 local destination
00000400:00000200:31.0:1773851905.620987:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770547:8770547:1024:4294967295] 25665@kfi7 LPNI seq info [8595006:8595006:16:4294967295]
00000400:00000200:31.0:1773851905.620988:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000063c19341 nid 25665@kfi7 refs 2
00000400:00000200:31.0:1773851905.620989:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25665@kfi7 to cpt 7
00000400:00000200:31.0:1773851905.620990:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25665@kfi7(25665@kfi7:25665@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851905.620991:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000063c19341 nid 25665@kfi7 refs 3
00000800:00000200:31.0:1773851905.620993:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851905.620993:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:31.0:1773851905.620995:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851905.620997:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b Using peer 25665@kfi7(0x72b)
00000800:00000200:31.0:1773851905.621000:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000009b43813d: Posted send of 532 bytes to peer 0x72b: rc=0
00000800:00000200:31.0:1773851905.621001:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851905.621003:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.621004:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000daa428b1 refcount 2 to 25665@kfi7
00010000:00000001:31.0:1773851905.621004:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851905.621005:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851905.621006:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851905.621006:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000009d6a92c0 x1858041187269376/t0(0) o17->4d62ce7a-d894-4ab1-87c4-4305d73f0dfa@25665@kfi7:632/0 lens 456/432 e 0 to 0 dl 1773851992 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne2100-0'
00000100:00100000:31.0:1773851905.621009:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000009d6a92c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:4d62ce7a-d894-4ab1-87c4-4305d73f0dfa+6:39652:x1858041187269376:12345-25665@kfi7:17:default-tuolumne2100-0 Request processed in 67us (102us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851905.621011:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25665@kfi7, seq: 364304990
00000100:00000040:31.0:1773851905.621012:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000abf47023 : new rpc_count 0
00000100:00000001:31.0:1773851905.621013:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851905.621013:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851905.621014:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a47915ef.
00000020:00000010:31.0:1773851905.621015:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000ba3dd508.
00000800:00000200:29.0:1773851905.621015:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851905.621016:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000006eaed4a4.
00000020:00000040:31.0:1773851905.621016:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000abf47023 : new refcount 5
00000400:00000200:29.0:1773851905.621016:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851905.621017:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851905.621017:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25665@kfi7: PUT: OK
00000400:00000200:29.0:1773851905.621018:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000030edd6e9
00000400:00000010:29.0:1773851905.621019:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000030edd6e9.
00000100:00000001:29.0:1773851905.621020:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851905.621020:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851905.621021:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000063c19341 nid 25665@kfi7 refs 2
00000800:00000200:29.0:1773851905.621023:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000009b43813d: 2069@kfi7:7 -> 25665@kfi7(00000000d0927b62):0x0 lsk 1836 rsk 46 tsk 0 trmk 0 tmk 0 trr 7 tta 0x72b Transaction freed
00000800:00000200:9.0:1773851905.711999:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851905.712000:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851905.712001:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851905.712003:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851905.712005:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20163@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.712006:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20163@kfi7 : PUT - for me
00000400:00000200:9.0:1773851905.712007:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20163@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.712008:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e3c6bfb nid 20163@kfi7 refs 1
00000400:00000200:9.0:1773851905.712009:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20163@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.712010:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e3c6bfb nid 20163@kfi7 refs 2
00000400:00000200:9.0:1773851905.712011:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000009e3c6bfb nid 20163@kfi7 refs 3
00000400:00000200:9.0:1773851905.712012:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20162@kfi7 to cpt 7
00000400:00000200:9.0:1773851905.712013:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20162@kfi7 of length 224 into portal 12 MB=0x69b0a12cf6e00
00000400:00000200:9.0:1773851905.712014:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20162@kfi7 of length 224/224 into md 0x78146ce49 [64] + 170040
00000800:00000200:9.0:1773851905.712016:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851905.712018:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851905.712018:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20163@kfi7: PUT: OK
00000100:00000001:9.0:1773851905.712020:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851905.712020:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851905.712021:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000de200aca.
00000100:00000040:9.0:1773851905.712022:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000de200aca x1859317427826176 msgsize 224
00000100:00100000:9.0:1773851905.712024:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20162@kfi7 (source: 12345-20163@kfi7)
00000100:00000001:9.0:1773851905.712025:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851905.712025:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000009e3c6bfb nid 20163@kfi7 refs 2
00000100:00000001:11.0:1773851905.712026:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851905.712027:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851905.712028:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851905.712028:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851905.712029:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851905.712030:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851905.712031:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859317427826176
00000020:00000001:11.0:1773851905.712031:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851905.712032:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92301
00000020:00000001:11.0:1773851905.712033:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851905.712037:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ff95e706 refcount=688
00000020:00000001:11.0:1773851905.712038:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630276096 : -107123079275520 : ffff9e9276e99c00)
00000020:00000001:11.0:1773851905.712039:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630276096 : -107123079275520 : ffff9e9276e99c00)
00000100:00000001:11.0:1773851905.712040:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.712041:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851905.712041:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000003236ac4a.
00000020:00000010:11.0:1773851905.712043:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851905.712044:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851905.712045:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851905.712045:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851905.712046:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.712047:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851905.712047:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851905.712048:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.712049:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.712050:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851905.712050:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851905.712051:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851905.712051:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851905.712052:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20162@kfi7, seq: 2130899
00000100:00000040:11.0:1773851905.712052:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ff95e706 : new rpc_count 10
00000100:00000001:11.0:1773851905.712053:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498313344 : -106953211238272 : ffff9eba03d62880)
00000100:00000001:8.0:1773851905.712053:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851905.712053:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.712054:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000de200aca x1859317427826176/t0(0) o400->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1751-0'
00000100:00000001:11.0:1773851905.712057:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.712058:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851905.712059:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000de200aca pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:396b608f-c2d1-4dee-979d-4441a31d5059+688:39548:x1859317427826176:12345-20162@kfi7:400:default-tuolumne1751-0
00000100:00000200:11.0:1773851905.712062:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859317427826176
00000020:00000001:11.0:1773851905.712063:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851905.712063:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851905.712064:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.712065:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851905.712065:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851905.712066:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851905.712067:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859317427826176, found 0 last_xid 1859317421780543
00000020:00000001:11.0:1773851905.712068:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851905.712069:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851905.712069:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851905.712070:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.712070:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851905.712071:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851905.712071:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851905.712072:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000690da6ea.
02000000:00000001:11.0:1773851905.712073:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.712074:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.712074:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851905.712075:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264557774, transno 0, xid 1859317427826176
00010000:00000001:11.0:1773851905.712076:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851905.712077:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000de200aca x1859317427826176/t0(0) o400->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1751-0'
00010000:00000001:11.0:1773851905.712080:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851905.712080:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851905.712081:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=138 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851905.712082:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851905.712083:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000008815f050 refcount 3 to 20162@kfi7
00000100:00000001:11.0:1773851905.712084:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921091270624 : -107152618280992 : ffff9e8b964027e0)
02000000:00000001:11.0:1773851905.712085:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851905.712085:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.712086:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851905.712087:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20163@kfi7
00000400:00000010:11.0:1773851905.712088:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000151638b3.
00000100:00000200:11.0:1773851905.712089:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859317427826176, offset 224
00000400:00000200:11.0:1773851905.712090:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20163@kfi7
00000400:00000200:11.0:1773851905.712091:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20163@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.712092:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000009e3c6bfb nid 20163@kfi7 refs 1
00000400:00000200:11.0:1773851905.712094:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000009e3c6bfb nid 20163@kfi7 refs 2
00000400:00000200:11.0:1773851905.712095:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000009e3c6bfb nid 20163@kfi7 refs 3
00000400:00000200:11.0:1773851905.712096:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20163@kfi7 local destination
00000400:00000200:11.0:1773851905.712098:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770548:8770548:1024:4294967295] 20163@kfi7 LPNI seq info [662769:662769:16:4294967295]
00000400:00000200:11.0:1773851905.712099:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009e3c6bfb nid 20163@kfi7 refs 2
00000400:00000200:11.0:1773851905.712100:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20163@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.712102:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20163@kfi7(20163@kfi7:20163@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851905.712103:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000009e3c6bfb nid 20163@kfi7 refs 3
00000800:00000200:11.0:1773851905.712105:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851905.712106:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851905.712108:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851905.712110:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dc8 Using peer 20163@kfi7(0x100000000000dc8)
00000800:00000200:11.0:1773851905.712113:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000b2566f3a: Posted send of 324 bytes to peer 0x100000000000dc8: rc=0
00000800:00000200:11.0:1773851905.712115:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dc8 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851905.712117:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.712118:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000008815f050 refcount 2 to 20162@kfi7
00010000:00000001:11.0:1773851905.712119:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851905.712119:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.712120:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851905.712121:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000de200aca x1859317427826176/t0(0) o400->396b608f-c2d1-4dee-979d-4441a31d5059@20162@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1751-0'
00000100:00100000:11.0:1773851905.712124:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000de200aca pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:396b608f-c2d1-4dee-979d-4441a31d5059+688:39548:x1859317427826176:12345-20162@kfi7:400:default-tuolumne1751-0 Request processed in 66us (101us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851905.712128:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dc8 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851905.712129:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20162@kfi7, seq: 2130899
00000400:00000200:9.0:1773851905.712129:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851905.712130:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ff95e706 : new rpc_count 9
00000400:00000200:9.0:1773851905.712131:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20163@kfi7: PUT: OK
00000400:00000200:9.0:1773851905.712131:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000151638b3
00000100:00000001:11.0:1773851905.712132:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000010:9.0:1773851905.712132:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000151638b3.
00000100:00000001:11.0:1773851905.712133:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:9.0:1773851905.712133:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851905.712133:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:11.0:1773851905.712134:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851905.712134:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009e3c6bfb nid 20163@kfi7 refs 2
00000020:00000010:11.0:1773851905.712135:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000800:00000200:9.0:1773851905.712136:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b2566f3a: 2054@kfi7:2 -> 20163@kfi7(00000000e0eda285):0x0 lsk 3529 rsk 47 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000dc8 Transaction freed
00000020:00000010:11.0:1773851905.712137:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000003236ac4a.
00000020:00000040:11.0:1773851905.712138:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000ff95e706 : new refcount 687
00000100:00000001:11.0:1773851905.712139:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851905.809250:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851905.809251:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851905.809252:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851905.809254:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851905.809256:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.809257:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16635@kfi7 : PUT - for me
00000400:00000200:25.0:1773851905.809258:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.809259:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000400:00000200:25.0:1773851905.809260:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.809260:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:25.0:1773851905.809261:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:25.0:1773851905.809262:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16634@kfi7 to cpt 3
00000400:00000200:25.0:1773851905.809263:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16634@kfi7 of length 224 into portal 12 MB=0x699de8c701fc0
00000400:00000200:25.0:1773851905.809264:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16634@kfi7 of length 224/224 into md 0x16159c9699 [64] + 47424
00000800:00000200:25.0:1773851905.809266:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851905.809267:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.809269:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16635@kfi7: PUT: OK
00000100:00000001:25.0:1773851905.809270:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851905.809270:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851905.809271:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004947a669.
00000100:00000040:25.0:1773851905.809272:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000004947a669 x1858030978211776 msgsize 224
00000100:00100000:25.0:1773851905.809274:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16634@kfi7 (source: 12345-16635@kfi7)
00000100:00000001:25.0:1773851905.809275:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851905.809276:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000100:00000001:24.0:1773851905.809276:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851905.809276:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:25.0:1773851905.809277:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851905.809277:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851905.809277:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851905.809278:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851905.809279:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978211776
00000020:00000001:24.0:1773851905.809279:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851905.809280:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90fc8
00000020:00000001:24.0:1773851905.809280:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851905.809283:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006dec92c0 refcount=6
00000020:00000001:24.0:1773851905.809284:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240098816 : -107152469452800 : ffff9e8b9f1f1800)
00000020:00000001:24.0:1773851905.809285:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240098816 : -107152469452800 : ffff9e8b9f1f1800)
00000100:00000001:24.0:1773851905.809286:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.809286:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851905.809287:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851905.809288:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.809289:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851905.809289:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851905.809290:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851905.809290:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851905.809291:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851905.809292:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851905.809292:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.809293:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851905.809295:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851905.809295:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851905.809295:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851905.809295:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851905.809296:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16634@kfi7, seq: 2025202
00000100:00000001:26.0:1773851905.809297:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.809297:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006dec92c0 : new rpc_count 1
00000100:00000001:26.0:1773851905.809298:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.809298:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157377152 : -106936552174464 : ffff9ebde4cb4c80)
00000100:00000040:24.0:1773851905.809299:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004947a669 x1858030978211776/t0(0) o400->7fb29351-fdec-447b-894b-55817dcd5426@16634@kfi7:186/0 lens 224/0 e 0 to 0 dl 1773852301 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne233-0'
00000100:00000001:24.0:1773851905.809301:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.809302:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851905.809302:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004947a669 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:7fb29351-fdec-447b-894b-55817dcd5426+6:48024:x1858030978211776:12345-16634@kfi7:400:default-tuolumne233-0
00000100:00000200:24.0:1773851905.809304:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978211776
00000020:00000001:24.0:1773851905.809304:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851905.809305:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851905.809305:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809306:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851905.809306:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851905.809307:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851905.809308:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978211776, found 0 last_xid 1858030978211775
00000020:00000001:24.0:1773851905.809309:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851905.809310:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851905.809310:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851905.809311:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809311:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851905.809312:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851905.809312:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851905.809313:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003c872c1f.
02000000:00000001:24.0:1773851905.809314:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.809314:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809315:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851905.809315:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030978211776
00010000:00000001:24.0:1773851905.809316:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851905.809317:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004947a669 x1858030978211776/t0(0) o400->7fb29351-fdec-447b-894b-55817dcd5426@16634@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00010000:00000001:24.0:1773851905.809322:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851905.809322:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851905.809323:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=138 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851905.809324:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851905.809325:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000757a55d7 refcount 5 to 16634@kfi7
00000100:00000001:24.0:1773851905.809326:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153568 : -107139310398048 : ffff9e8eaf7655a0)
02000000:00000001:24.0:1773851905.809327:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851905.809327:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.809328:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851905.809328:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16635@kfi7
00000400:00000010:24.0:1773851905.809329:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a14eb2ca.
00000100:00000200:24.0:1773851905.809330:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978211776, offset 224
00000400:00000200:24.0:1773851905.809331:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16635@kfi7
00000400:00000200:24.0:1773851905.809332:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.809332:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000400:00000200:24.0:1773851905.809333:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851905.809334:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:24.0:1773851905.809336:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16635@kfi7 local destination
00000400:00000200:24.0:1773851905.809337:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770549:8770549:1024:4294967295] 16635@kfi7 LPNI seq info [24391:24391:16:4294967295]
00000400:00000200:24.0:1773851905.809338:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851905.809339:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.809341:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16635@kfi7(16635@kfi7:16635@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851905.809342:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000800:00000200:24.0:1773851905.809343:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851905.809344:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851905.809346:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851905.809349:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd Using peer 16635@kfi7(0x3cd)
00000800:00000200:24.0:1773851905.809353:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x3cd: rc=0
00000800:00000200:24.0:1773851905.809354:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851905.809356:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.809357:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000757a55d7 refcount 4 to 16634@kfi7
00010000:00000001:24.0:1773851905.809358:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851905.809358:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809359:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851905.809359:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004947a669 x1858030978211776/t0(0) o400->7fb29351-fdec-447b-894b-55817dcd5426@16634@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00000100:00100000:24.0:1773851905.809363:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004947a669 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:7fb29351-fdec-447b-894b-55817dcd5426+6:48024:x1858030978211776:12345-16634@kfi7:400:default-tuolumne233-0 Request processed in 61us (91us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851905.809365:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16634@kfi7, seq: 2025202
00000100:00000040:24.0:1773851905.809366:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006dec92c0 : new rpc_count 0
00000100:00000001:24.0:1773851905.809367:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851905.809367:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851905.809368:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.809368:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851905.809369:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851905.809370:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000006dec92c0 : new refcount 5
00000100:00000001:24.0:1773851905.809370:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851905.809375:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851905.809377:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.809378:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16635@kfi7: PUT: OK
00000400:00000200:25.0:1773851905.809378:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a14eb2ca
00000400:00000010:25.0:1773851905.809379:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a14eb2ca.
00000100:00000001:25.0:1773851905.809379:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851905.809380:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851905.809380:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000800:00000200:25.0:1773851905.809382:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2069@kfi7:6 -> 16635@kfi7(00000000410d9b00):0x0 lsk 974 rsk 89 tsk 0 trmk 0 tmk 0 trr 6 tta 0x3cd Transaction freed
00000800:00000200:25.0:1773851905.809729:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851905.809730:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851905.809731:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851905.809733:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851905.809734:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.809735:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16635@kfi7 : PUT - for me
00000400:00000200:25.0:1773851905.809736:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.809737:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000400:00000200:25.0:1773851905.809737:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.809738:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:25.0:1773851905.809739:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:25.0:1773851905.809740:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16634@kfi7 to cpt 3
00000400:00000200:25.0:1773851905.809741:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16634@kfi7 of length 224 into portal 12 MB=0x699de8c702740
00000400:00000200:25.0:1773851905.809742:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16634@kfi7 of length 224/224 into md 0x16159c9699 [64] + 47648
00000800:00000200:25.0:1773851905.809743:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851905.809744:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.809745:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16635@kfi7: PUT: OK
00000100:00000001:25.0:1773851905.809746:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851905.809746:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851905.809747:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066d07729.
00000100:00000040:25.0:1773851905.809747:0:2494371:0:(events.c:358:request_in_callback()) incoming req@0000000066d07729 x1858030978213696 msgsize 224
00000100:00100000:25.0:1773851905.809748:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-16634@kfi7 (source: 12345-16635@kfi7)
00000100:00000001:25.0:1773851905.809749:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851905.809750:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000800:00000200:25.0:1773851905.809751:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851905.809751:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851905.809751:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851905.809751:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851905.809752:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851905.809752:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851905.809753:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030978213696
00000020:00000001:24.0:1773851905.809753:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851905.809753:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911e3
00000020:00000001:24.0:1773851905.809754:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851905.809757:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009509b713 refcount=6
00000020:00000001:24.0:1773851905.809757:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240521728 : -107152469029888 : ffff9e8b9f258c00)
00000020:00000001:24.0:1773851905.809758:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240521728 : -107152469029888 : ffff9e8b9f258c00)
00000100:00000001:24.0:1773851905.809759:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.809760:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851905.809760:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851905.809761:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.809761:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851905.809762:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851905.809762:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851905.809763:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851905.809764:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851905.809764:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851905.809764:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.809765:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851905.809766:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851905.809766:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851905.809767:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851905.809767:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851905.809767:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16634@kfi7, seq: 2025203
00000100:00000001:26.0:1773851905.809768:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851905.809768:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.809768:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009509b713 : new rpc_count 1
00000100:00000001:24.0:1773851905.809768:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637137157387520 : -106936552164096 : ffff9ebde4cb7500)
00000100:00000040:24.0:1773851905.809769:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066d07729 x1858030978213696/t0(0) o400->3081707c-5141-4dbe-9894-cd5202e99e27@16634@kfi7:186/0 lens 224/0 e 0 to 0 dl 1773852301 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne233-0'
00000100:00000001:24.0:1773851905.809772:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.809772:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851905.809773:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066d07729 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3081707c-5141-4dbe-9894-cd5202e99e27+6:48022:x1858030978213696:12345-16634@kfi7:400:default-tuolumne233-0
00000100:00000200:24.0:1773851905.809774:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030978213696
00000020:00000001:24.0:1773851905.809774:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851905.809775:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851905.809775:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809776:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851905.809776:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851905.809777:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851905.809777:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030978213696, found 0 last_xid 1858030978213695
00000020:00000001:24.0:1773851905.809778:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851905.809779:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851905.809779:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851905.809780:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809780:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851905.809781:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851905.809781:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851905.809782:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000f6126c67.
02000000:00000001:24.0:1773851905.809782:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.809783:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809783:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851905.809784:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030978213696
00010000:00000001:24.0:1773851905.809784:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851905.809785:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066d07729 x1858030978213696/t0(0) o400->3081707c-5141-4dbe-9894-cd5202e99e27@16634@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00010000:00000001:24.0:1773851905.809787:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851905.809787:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851905.809788:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=138 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851905.809789:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851905.809789:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000757a55d7 refcount 5 to 16634@kfi7
00000100:00000001:24.0:1773851905.809790:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934399153568 : -107139310398048 : ffff9e8eaf7655a0)
02000000:00000001:24.0:1773851905.809791:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851905.809791:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.809791:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851905.809792:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16635@kfi7
00000400:00000010:24.0:1773851905.809792:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000cd21ec1b.
00000100:00000200:24.0:1773851905.809793:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030978213696, offset 224
00000400:00000200:24.0:1773851905.809794:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16635@kfi7
00000400:00000200:24.0:1773851905.809795:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.809795:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 1
00000400:00000200:24.0:1773851905.809796:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851905.809797:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000400:00000200:24.0:1773851905.809798:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16635@kfi7 local destination
00000400:00000200:24.0:1773851905.809799:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770550:8770550:1024:4294967295] 16635@kfi7 LPNI seq info [24392:24392:16:4294967295]
00000400:00000200:24.0:1773851905.809801:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000400:00000200:24.0:1773851905.809802:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16635@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.809804:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16635@kfi7(16635@kfi7:16635@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851905.809805:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 3
00000800:00000200:24.0:1773851905.809806:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851905.809807:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851905.809809:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851905.809811:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb Using peer 16635@kfi7(0x1000000000003cb)
00000800:00000200:24.0:1773851905.809813:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x1000000000003cb: rc=0
00000800:00000200:24.0:1773851905.809815:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851905.809816:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.809817:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000757a55d7 refcount 4 to 16634@kfi7
00010000:00000001:24.0:1773851905.809818:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851905.809818:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.809819:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851905.809819:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066d07729 x1858030978213696/t0(0) o400->3081707c-5141-4dbe-9894-cd5202e99e27@16634@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne233-0'
00000100:00100000:24.0:1773851905.809822:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066d07729 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:3081707c-5141-4dbe-9894-cd5202e99e27+6:48022:x1858030978213696:12345-16634@kfi7:400:default-tuolumne233-0 Request processed in 49us (74us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851905.809825:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16634@kfi7, seq: 2025203
00000100:00000040:24.0:1773851905.809826:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009509b713 : new rpc_count 0
00000100:00000001:24.0:1773851905.809826:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851905.809827:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851905.809827:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.809828:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851905.809828:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851905.809829:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000009509b713 : new refcount 5
00000100:00000001:24.0:1773851905.809830:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851905.809834:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851905.809835:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.809836:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16635@kfi7: PUT: OK
00000400:00000200:25.0:1773851905.809837:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000cd21ec1b
00000400:00000010:25.0:1773851905.809837:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000cd21ec1b.
00000100:00000001:25.0:1773851905.809838:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851905.809838:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851905.809839:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a6110b8f nid 16635@kfi7 refs 2
00000800:00000200:25.0:1773851905.809840:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2054@kfi7:6 -> 16635@kfi7(0000000050065eff):0x0 lsk 972 rsk 90 tsk 0 trmk 0 tmk 0 trr 6 tta 0x1000000000003cb Transaction freed
00000800:00000200:9.0:1773851905.810345:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851905.810346:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851905.810347:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851905.810349:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851905.810351:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.810353:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20731@kfi7 : PUT - for me
00000400:00000200:9.0:1773851905.810354:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.810355:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 1
00000400:00000200:9.0:1773851905.810356:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.810357:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 2
00000400:00000200:9.0:1773851905.810357:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 3
00000400:00000200:9.0:1773851905.810359:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.810360:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20731@kfi7 of length 224 into portal 12 MB=0x699de8bc31700
00000400:00000200:9.0:1773851905.810361:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20731@kfi7 of length 224/224 into md 0x78146ce49 [64] + 170264
00000800:00000200:9.0:1773851905.810363:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851905.810365:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851905.810366:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20731@kfi7: PUT: OK
00000100:00000001:9.0:1773851905.810367:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851905.810367:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851905.810368:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000066c02ca3.
00000100:00000040:9.0:1773851905.810369:0:2458095:0:(events.c:358:request_in_callback()) incoming req@0000000066c02ca3 x1858030966871808 msgsize 224
00000100:00100000:9.0:1773851905.810370:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-20731@kfi7 (source: 12345-20731@kfi7)
00000100:00000001:9.0:1773851905.810371:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851905.810372:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 2
00000100:00000001:11.0:1773851905.810373:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:11.0:1773851905.810373:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851905.810374:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:9.0:1773851905.810374:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:11.0:1773851905.810375:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:11.0:1773851905.810375:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851905.810376:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030966871808
00000020:00000001:11.0:1773851905.810377:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851905.810377:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac912ed
00000020:00000001:11.0:1773851905.810378:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851905.810381:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a9d5ad2c refcount=6
00000020:00000001:11.0:1773851905.810382:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636917716204544 : -107155993347072 : ffff9e8acd14bc00)
00000020:00000001:11.0:1773851905.810382:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636917716204544 : -107155993347072 : ffff9e8acd14bc00)
00000100:00000001:11.0:1773851905.810384:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.810385:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851905.810385:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f71ac8fb.
00000020:00000010:11.0:1773851905.810386:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851905.810387:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851905.810388:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851905.810388:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851905.810389:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.810390:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851905.810390:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851905.810391:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.810392:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851905.810393:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851905.810393:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851905.810394:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851905.810394:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851905.810395:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20731@kfi7, seq: 2130900
00000100:00000040:11.0:1773851905.810395:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a9d5ad2c : new rpc_count 1
00000100:00000001:8.0:1773851905.810395:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.810396:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498320256 : -106953211231360 : ffff9eba03d64380)
00000100:00000001:8.0:1773851905.810396:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.810397:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000066c02ca3 x1858030966871808/t0(0) o400->09bbfb8c-d3e1-4120-87ce-4227c255fc36@20731@kfi7:693/0 lens 224/0 e 0 to 0 dl 1773852053 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne249-0'
00000100:00000001:11.0:1773851905.810400:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851905.810400:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851905.810402:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000066c02ca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:09bbfb8c-d3e1-4120-87ce-4227c255fc36+6:47817:x1858030966871808:12345-20731@kfi7:400:default-tuolumne249-0
00000100:00000200:11.0:1773851905.810403:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030966871808
00000020:00000001:11.0:1773851905.810404:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851905.810404:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851905.810405:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.810406:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851905.810406:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851905.810407:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851905.810408:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030966871808, found 0 last_xid 1858030966871807
00000020:00000001:11.0:1773851905.810408:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851905.810409:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851905.810410:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851905.810410:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.810411:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851905.810411:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851905.810412:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851905.810412:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003236ac4a.
02000000:00000001:11.0:1773851905.810413:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.810414:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.810414:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851905.810415:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768262, transno 0, xid 1858030966871808
00010000:00000001:11.0:1773851905.810416:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851905.810417:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000066c02ca3 x1858030966871808/t0(0) o400->09bbfb8c-d3e1-4120-87ce-4227c255fc36@20731@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne249-0'
00010000:00000001:11.0:1773851905.810421:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851905.810422:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851905.810423:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=138 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851905.810424:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851905.810425:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000000a2cc74 refcount 5 to 20731@kfi7
00000100:00000001:11.0:1773851905.810426:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917526777120 : -107156182774496 : ffff9e8ac1ca4d20)
02000000:00000001:11.0:1773851905.810426:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851905.810427:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851905.810427:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851905.810428:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20731@kfi7
00000400:00000010:11.0:1773851905.810429:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000001e5494cf.
00000100:00000200:11.0:1773851905.810430:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030966871808, offset 224
00000400:00000200:11.0:1773851905.810431:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20731@kfi7
00000400:00000200:11.0:1773851905.810432:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.810433:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 1
00000400:00000200:11.0:1773851905.810434:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 2
00000400:00000200:11.0:1773851905.810435:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 3
00000400:00000200:11.0:1773851905.810437:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20731@kfi7 local destination
00000400:00000200:11.0:1773851905.810438:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770551:8770551:1024:4294967295] 20731@kfi7 LPNI seq info [28144:28144:16:4294967295]
00000400:00000200:11.0:1773851905.810439:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 2
00000400:00000200:11.0:1773851905.810440:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20731@kfi7 to cpt 2
00000400:00000200:11.0:1773851905.810442:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20731@kfi7(20731@kfi7:20731@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851905.810443:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 3
00000800:00000200:11.0:1773851905.810444:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851905.810445:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851905.810447:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851905.810450:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x50d Using peer 20731@kfi7(0x50d)
00000800:00000200:11.0:1773851905.810454:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:2 Transaction ID 00000000bcbe582c: Posted send of 324 bytes to peer 0x50d: rc=0
00000800:00000200:11.0:1773851905.810455:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x50d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851905.810457:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851905.810458:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000000a2cc74 refcount 4 to 20731@kfi7
00010000:00000001:11.0:1773851905.810459:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851905.810459:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851905.810460:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851905.810460:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000066c02ca3 x1858030966871808/t0(0) o400->09bbfb8c-d3e1-4120-87ce-4227c255fc36@20731@kfi7:693/0 lens 224/224 e 0 to 0 dl 1773852053 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne249-0'
00000100:00100000:11.0:1773851905.810463:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000066c02ca3 pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:09bbfb8c-d3e1-4120-87ce-4227c255fc36+6:47817:x1858030966871808:12345-20731@kfi7:400:default-tuolumne249-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851905.810465:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20731@kfi7, seq: 2130900
00000100:00000040:11.0:1773851905.810467:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a9d5ad2c : new rpc_count 0
00000100:00000001:11.0:1773851905.810467:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:9.0:1773851905.810467:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x50d TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851905.810468:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851905.810468:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851905.810468:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851905.810469:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000200:9.0:1773851905.810469:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20731@kfi7: PUT: OK
00000020:00000010:11.0:1773851905.810470:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f71ac8fb.
00000400:00000200:9.0:1773851905.810470:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000001e5494cf
00000020:00000040:11.0:1773851905.810471:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000a9d5ad2c : new refcount 5
00000100:00000001:11.0:1773851905.810471:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:9.0:1773851905.810471:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000001e5494cf.
00000100:00000001:9.0:1773851905.810471:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851905.810472:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851905.810472:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003aa1f6a3 nid 20731@kfi7 refs 2
00000800:00000200:9.0:1773851905.810474:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000bcbe582c: 2069@kfi7:2 -> 20731@kfi7(00000000d0c2ae41):0x0 lsk 1294 rsk 83 tsk 0 trmk 0 tmk 0 trr 2 tta 0x50d Transaction freed
00000800:00000200:26.0:1773851905.818331:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851905.818331:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851905.818332:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851905.818332:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:25.0:1773851905.818333:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:26.0:1773851905.818334:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851905.818337:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:25.0:1773851905.818337:0:2494371:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 9056@kfi7(000000000f71c4d2):0xe78 version: 2; local version 2; negotiated version: 2
00000400:00000200:26.0:1773851905.818339:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9056@kfi7 to cpt 6
00000800:00000200:25.0:1773851905.818339:0:2494371:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 Using peer 9056@kfi7(0xe78)
00000400:00000200:26.0:1773851905.818340:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 9056@kfi7 : PUT - for me
00000400:00000200:25.0:1773851905.818341:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9056@kfi7 to cpt 6
00000400:00000200:26.0:1773851905.818342:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9056@kfi7 to cpt 6
00000400:00000200:26.0:1773851905.818343:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004791626c nid 9056@kfi7 refs 1
00000800:00000200:25.0:1773851905.818343:0:2494371:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000aaa7c3d1: Posted send of 38 bytes to peer 0xe78: rc=0
00000800:00000200:25.0:1773851905.818344:0:2494371:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:26.0:1773851905.818345:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9056@kfi7 to cpt 6
00000400:00000200:26.0:1773851905.818346:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004791626c nid 9056@kfi7 refs 2
00000400:00000200:26.0:1773851905.818347:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004791626c nid 9056@kfi7 refs 3
00000400:00000200:26.0:1773851905.818348:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9057@kfi7 to cpt 1
00000400:00000200:26.0:1773851905.818349:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-9057@kfi7 of length 224 into portal 12 MB=0x699e19095c8c0
00000400:00000200:26.0:1773851905.818351:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-9057@kfi7 of length 224/224 into md 0x16159c9699 [64] + 47872
00000800:00000200:26.0:1773851905.818353:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851905.818355:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851905.818356:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9056@kfi7: PUT: OK
00000800:00000200:25.0:1773851905.818356:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 TN_EVENT_TX_OK event status 0
00000100:00000001:26.0:1773851905.818357:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851905.818358:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000800:00000200:25.0:1773851905.818358:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 Transaction freed
00000100:00000010:26.0:1773851905.818359:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000008a4a680f.
00000100:00000040:26.0:1773851905.818360:0:2507427:0:(events.c:358:request_in_callback()) incoming req@000000008a4a680f x1858043932690624 msgsize 224
00000100:00100000:26.0:1773851905.818362:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-9057@kfi7 (source: 12345-9056@kfi7)
00000100:00000001:26.0:1773851905.818363:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851905.818364:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004791626c nid 9056@kfi7 refs 2
00000100:00000001:24.0:1773851905.818365:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851905.818365:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:26.0:1773851905.818366:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851905.818366:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851905.818366:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851905.818367:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851905.818368:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043932690624
00000020:00000001:24.0:1773851905.818369:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851905.818369:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91428
00000020:00000001:24.0:1773851905.818370:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851905.818375:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000953a2ea6 refcount=113
00000020:00000001:24.0:1773851905.818376:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240796160 : -107152468755456 : ffff9e8b9f29bc00)
00000020:00000001:24.0:1773851905.818377:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240796160 : -107152468755456 : ffff9e8b9f29bc00)
00000100:00000001:24.0:1773851905.818378:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.818378:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851905.818379:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851905.818380:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.818381:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851905.818382:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851905.818382:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851905.818383:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851905.818384:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851905.818384:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851905.818385:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.818386:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851905.818387:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851905.818388:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851905.818388:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851905.818388:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851905.818389:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-9057@kfi7, seq: 2025204
00000100:00000001:26.0:1773851905.818390:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.818390:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000953a2ea6 : new rpc_count 8
00000100:00000001:26.0:1773851905.818391:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.818391:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105767443456 : -106967942108160 : ffff9eb695ceec00)
00000100:00000040:24.0:1773851905.818392:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000008a4a680f x1858043932690624/t0(0) o400->b843b541-a4c6-482f-a046-40b3bbbfd095@9057@kfi7:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1056-0'
00000100:00000001:24.0:1773851905.818395:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.818396:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851905.818397:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000008a4a680f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b843b541-a4c6-482f-a046-40b3bbbfd095+113:39683:x1858043932690624:12345-9057@kfi7:400:default-tuolumne1056-0
00000100:00000200:24.0:1773851905.818398:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043932690624
00000020:00000001:24.0:1773851905.818399:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851905.818399:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851905.818400:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.818401:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851905.818401:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851905.818402:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851905.818403:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043932690624, found 0 last_xid 1858043922262911
00000020:00000001:24.0:1773851905.818404:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851905.818405:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851905.818405:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851905.818406:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.818406:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851905.818407:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851905.818407:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851905.818408:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000007630c5cd.
02000000:00000001:24.0:1773851905.818409:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.818410:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.818410:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851905.818411:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264587337, transno 0, xid 1858043932690624
00010000:00000001:24.0:1773851905.818412:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851905.818413:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000008a4a680f x1858043932690624/t0(0) o400->b843b541-a4c6-482f-a046-40b3bbbfd095@9057@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1056-0'
00010000:00000001:24.0:1773851905.818415:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851905.818416:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851905.818417:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=138 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851905.818418:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851905.818419:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000e51d10db refcount 3 to 9057@kfi7
00000100:00000001:24.0:1773851905.818419:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702304 : -107156155849312 : ffff9e8ac36525a0)
02000000:00000001:24.0:1773851905.818420:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851905.818421:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.818422:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851905.818423:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-9056@kfi7
00000400:00000010:24.0:1773851905.818424:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000043f7937d.
00000100:00000200:24.0:1773851905.818424:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043932690624, offset 224
00000400:00000200:24.0:1773851905.818426:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-9056@kfi7
00000400:00000200:24.0:1773851905.818427:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9056@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.818428:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004791626c nid 9056@kfi7 refs 1
00000400:00000200:24.0:1773851905.818429:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004791626c nid 9056@kfi7 refs 2
00000400:00000200:24.0:1773851905.818430:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004791626c nid 9056@kfi7 refs 3
00000400:00000200:24.0:1773851905.818431:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  9056@kfi7 local destination
00000400:00000200:24.0:1773851905.818433:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770552:8770552:1024:4294967295] 9056@kfi7 LPNI seq info [16740650:16740650:16:4294967295]
00000400:00000200:24.0:1773851905.818435:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004791626c nid 9056@kfi7 refs 2
00000400:00000200:24.0:1773851905.818436:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 9056@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.818438:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 9056@kfi7(9056@kfi7:9056@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851905.818439:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004791626c nid 9056@kfi7 refs 3
00000800:00000200:24.0:1773851905.818441:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851905.818442:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851905.818444:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851905.818447:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 Using peer 9056@kfi7(0xe78)
00000800:00000200:24.0:1773851905.818450:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0xe78: rc=0
00000800:00000200:24.0:1773851905.818451:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851905.818453:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.818454:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000e51d10db refcount 2 to 9057@kfi7
00010000:00000001:24.0:1773851905.818455:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851905.818455:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.818456:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851905.818457:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000008a4a680f x1858043932690624/t0(0) o400->b843b541-a4c6-482f-a046-40b3bbbfd095@9057@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1056-0'
00000100:00100000:24.0:1773851905.818465:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000008a4a680f pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:b843b541-a4c6-482f-a046-40b3bbbfd095+113:39683:x1858043932690624:12345-9057@kfi7:400:default-tuolumne1056-0 Request processed in 69us (104us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851905.818468:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-9057@kfi7, seq: 2025204
00000100:00000040:24.0:1773851905.818468:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000953a2ea6 : new rpc_count 7
00000100:00000001:24.0:1773851905.818469:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851905.818470:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851905.818470:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.818471:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851905.818472:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851905.818473:0:60973:0:(genops.c:882:class_export_put()) PUTting export 00000000953a2ea6 : new refcount 112
00000100:00000001:24.0:1773851905.818474:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851905.818478:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851905.818480:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.818481:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->9056@kfi7: PUT: OK
00000400:00000200:25.0:1773851905.818482:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000043f7937d
00000400:00000010:25.0:1773851905.818482:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000043f7937d.
00000100:00000001:25.0:1773851905.818483:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851905.818483:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851905.818484:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004791626c nid 9056@kfi7 refs 2
00000800:00000200:25.0:1773851905.818485:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 9056@kfi7(000000000f71c4d2):0x0 lsk 3705 rsk 48 tsk 0 trmk 0 tmk 0 trr 6 tta 0xe78 Transaction freed
00000800:00000200:5.0:1773851905.818598:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851905.818599:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851905.818600:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851905.818602:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851905.818605:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:5.0:1773851905.818607:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10227@kfi7 : PUT - for me
00000400:00000200:5.0:1773851905.818608:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:5.0:1773851905.818609:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 1
00000400:00000200:5.0:1773851905.818609:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:5.0:1773851905.818610:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000400:00000200:5.0:1773851905.818611:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 3
00000400:00000200:5.0:1773851905.818612:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10035@kfi7 to cpt 6
00000400:00000200:5.0:1773851905.818613:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10035@kfi7 of length 224 into portal 12 MB=0x699e12da7be00
00000400:00000200:5.0:1773851905.818614:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10035@kfi7 of length 224/224 into md 0x793926dc5 [64] + 170480
00000800:00000200:5.0:1773851905.818617:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851905.818618:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851905.818620:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10227@kfi7: PUT: OK
00000100:00000001:5.0:1773851905.818621:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851905.818621:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851905.818622:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000165a41dd.
00000100:00000040:5.0:1773851905.818623:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000165a41dd x1858042272923136 msgsize 224
00000100:00100000:5.0:1773851905.818624:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-10035@kfi7 (source: 12345-10227@kfi7)
00000100:00000001:5.0:1773851905.818625:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851905.818626:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000800:00000200:5.0:1773851905.818628:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000002275c6f1: 2069@kfi7:1 <- 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:4.0:1773851905.818628:0:60963:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:4.0:1773851905.818629:0:60963:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:4.0:1773851905.818630:0:60963:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:4.0:1773851905.818631:0:60963:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:4.0:1773851905.818632:0:60963:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:4.0:1773851905.818633:0:60963:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042272923136
00000020:00000001:4.0:1773851905.818634:0:60963:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:4.0:1773851905.818635:0:60963:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac927fb
00000020:00000001:4.0:1773851905.818636:0:60963:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:4.0:1773851905.818638:0:60963:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000759bc648 refcount=6
00000020:00000001:4.0:1773851905.818639:0:60963:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950631495680 : -107123078055936 : ffff9e9276fc3800)
00000020:00000001:4.0:1773851905.818641:0:60963:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950631495680 : -107123078055936 : ffff9e9276fc3800)
00000100:00000001:4.0:1773851905.818642:0:60963:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:4.0:1773851905.818643:0:60963:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:4.0:1773851905.818644:0:60963:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000b1f45ba0.
00000020:00000010:4.0:1773851905.818646:0:60963:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000001c0df968.
00000020:00000010:4.0:1773851905.818647:0:60963:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000007d85801b.
00000100:00000001:4.0:1773851905.818649:0:60963:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:4.0:1773851905.818650:0:60963:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:4.0:1773851905.818651:0:60963:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:4.0:1773851905.818653:0:60963:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:4.0:1773851905.818654:0:60963:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:4.0:1773851905.818655:0:60963:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.818656:0:60963:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851905.818658:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851905.818658:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851905.818659:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851905.818659:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851905.818660:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10035@kfi7, seq: 2002014
00000100:00000040:7.0:1773851905.818661:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000759bc648 : new rpc_count 1
00000100:00000001:7.0:1773851905.818661:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113837119360 : -106959872432256 : ffff9eb876cc6780)
00000100:00000001:4.0:1773851905.818661:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.818662:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851905.818663:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000165a41dd x1858042272923136/t0(0) o400->c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5@10035@kfi7:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1113-0'
00000100:00000001:7.0:1773851905.818665:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851905.818666:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851905.818667:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000165a41dd pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5+6:39722:x1858042272923136:12345-10035@kfi7:400:default-tuolumne1113-0
00000100:00000200:7.0:1773851905.818669:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042272923136
00000020:00000001:7.0:1773851905.818669:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851905.818670:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851905.818671:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851905.818671:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851905.818672:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851905.818673:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851905.818673:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042272923136, found 0 last_xid 1858042272923135
00000020:00000001:7.0:1773851905.818674:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851905.818675:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851905.818676:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851905.818676:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851905.818677:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851905.818678:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851905.818678:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851905.818679:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000c33ebcf0.
02000000:00000001:7.0:1773851905.818679:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.818680:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851905.818681:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851905.818682:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183097238425, transno 0, xid 1858042272923136
00010000:00000001:7.0:1773851905.818682:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851905.818683:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000165a41dd x1858042272923136/t0(0) o400->c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5@10035@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1113-0'
00010000:00000001:7.0:1773851905.818686:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851905.818686:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851905.818687:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=137 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851905.818688:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851905.818689:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000d65da430 refcount 3 to 10035@kfi7
00000100:00000001:7.0:1773851905.818689:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299328704 : -107155410222912 : ffff9e8aefd680c0)
02000000:00000001:7.0:1773851905.818690:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851905.818691:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.818692:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851905.818693:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10227@kfi7
00000400:00000010:7.0:1773851905.818693:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047c74d75.
00000100:00000200:7.0:1773851905.818694:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042272923136, offset 224
00000400:00000200:7.0:1773851905.818696:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10227@kfi7
00000400:00000200:7.0:1773851905.818697:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:7.0:1773851905.818698:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 1
00000400:00000200:7.0:1773851905.818699:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000400:00000200:7.0:1773851905.818700:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 3
00000400:00000200:7.0:1773851905.818701:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10227@kfi7 local destination
00000400:00000200:7.0:1773851905.818702:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770553:8770553:1024:4294967295] 10227@kfi7 LPNI seq info [79185:79185:16:4294967295]
00000400:00000200:7.0:1773851905.818703:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000400:00000200:7.0:1773851905.818704:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10227@kfi7 to cpt 1
00000400:00000200:7.0:1773851905.818706:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10227@kfi7(10227@kfi7:10227@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851905.818707:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 3
00000800:00000200:7.0:1773851905.818708:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851905.818709:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851905.818711:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851905.818714:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d2 Using peer 10227@kfi7(0x3d2)
00000800:00000200:7.0:1773851905.818717:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000736a2e34: Posted send of 324 bytes to peer 0x3d2: rc=0
00000800:00000200:7.0:1773851905.818718:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d2 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851905.818720:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851905.818721:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000d65da430 refcount 2 to 10035@kfi7
00010000:00000001:7.0:1773851905.818722:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851905.818722:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851905.818723:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851905.818724:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000165a41dd x1858042272923136/t0(0) o400->c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5@10035@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1113-0'
00000100:00100000:7.0:1773851905.818731:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000165a41dd pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:c743d6d6-7b0b-4a04-9e5f-21f32ce4c9a5+6:39722:x1858042272923136:12345-10035@kfi7:400:default-tuolumne1113-0 Request processed in 65us (108us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851905.818732:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d2 TN_EVENT_TX_OK event status 0
00000100:00100000:7.0:1773851905.818734:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10035@kfi7, seq: 2002014
00000400:00000200:5.0:1773851905.818734:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:7.0:1773851905.818735:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000759bc648 : new rpc_count 0
00000100:00000001:7.0:1773851905.818735:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851905.818735:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10227@kfi7: PUT: OK
00000100:00000001:7.0:1773851905.818736:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000200:5.0:1773851905.818736:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047c74d75
00000020:00000010:7.0:1773851905.818737:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000001c0df968.
00000020:00000010:7.0:1773851905.818737:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000007d85801b.
00000400:00000010:5.0:1773851905.818737:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047c74d75.
00000100:00000001:5.0:1773851905.818737:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:7.0:1773851905.818738:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000b1f45ba0.
00000100:00000001:5.0:1773851905.818738:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:7.0:1773851905.818739:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000759bc648 : new refcount 5
00000400:00000200:5.0:1773851905.818739:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000b2ed342c nid 10227@kfi7 refs 2
00000100:00000001:7.0:1773851905.818740:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:5.0:1773851905.818740:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000736a2e34: 2069@kfi7:1 -> 10227@kfi7(00000000f9514853):0x0 lsk 979 rsk 54 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3d2 Transaction freed
00000800:00000200:18.0:1773851905.843810:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851905.843811:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851905.843811:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851905.843811:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851905.843813:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851905.843813:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851905.843815:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851905.843815:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 15650@kfi7(0000000083085ddf):0x510 version: 2; local version 2; negotiated version: 2
00000800:00000200:17.0:1773851905.843816:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 Using peer 15650@kfi7(0x100000000000510)
00000400:00000200:18.0:1773851905.843818:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15650@kfi7 to cpt 4
00000400:00000200:17.0:1773851905.843818:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15650@kfi7 to cpt 4
00000400:00000200:18.0:1773851905.843819:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15650@kfi7 : PUT - for me
00000400:00000200:18.0:1773851905.843820:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15650@kfi7 to cpt 4
00000800:00000200:17.0:1773851905.843820:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x100000000000510: rc=0
00000400:00000200:18.0:1773851905.843821:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044d150d6 nid 15650@kfi7 refs 1
00000400:00000200:18.0:1773851905.843822:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15650@kfi7 to cpt 4
00000800:00000200:17.0:1773851905.843822:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851905.843823:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044d150d6 nid 15650@kfi7 refs 2
00000400:00000200:18.0:1773851905.843824:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000044d150d6 nid 15650@kfi7 refs 3
00000400:00000200:18.0:1773851905.843825:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15843@kfi7 to cpt 2
00000400:00000200:18.0:1773851905.843826:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15843@kfi7 of length 328 into portal 17 MB=0x69b4b57af9600
00000400:00000200:18.0:1773851905.843827:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-15843@kfi7 of length 328/328 into md 0x6ab0f7c31 [2] + 1112
00000800:00000200:18.0:1773851905.843829:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851905.843831:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851905.843832:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15650@kfi7: PUT: OK
00000100:00000001:18.0:1773851905.843833:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851905.843833:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000800:00000200:17.0:1773851905.843833:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 TN_EVENT_TX_OK event status 0
00000100:00000010:18.0:1773851905.843834:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002cfd8eb7.
00000100:00000040:18.0:1773851905.843835:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000002cfd8eb7 x1859597756241408 msgsize 328
00000800:00000200:17.0:1773851905.843835:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 Transaction freed
00000100:00100000:18.0:1773851905.843837:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-15843@kfi7 (source: 12345-15650@kfi7)
00000100:00000001:18.0:1773851905.843839:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851905.843840:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000044d150d6 nid 15650@kfi7 refs 2
00000800:00000200:18.0:1773851905.843841:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2054@kfi7:4 <- 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:18.0:1773851905.843844:0:154717:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:18.0:1773851905.843845:0:154717:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:18.0:1773851905.843846:0:154717:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:18.0:1773851905.843846:0:154717:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:18.0:1773851905.843847:0:154717:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:18.0:1773851905.843848:0:154717:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597756241408
00000020:00000001:18.0:1773851905.843849:0:154717:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:18.0:1773851905.843850:0:154717:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81bed
00000020:00000001:18.0:1773851905.843850:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851905.843854:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET export 000000003a964e3a refcount=7
00000020:00000001:18.0:1773851905.843855:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637127342097408 : -106946367454208 : ffff9ebb9bc20400)
00000020:00000001:18.0:1773851905.843856:0:154717:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637127342097408 : -106946367454208 : ffff9ebb9bc20400)
00000100:00000001:18.0:1773851905.843857:0:154717:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:18.0:1773851905.843858:0:154717:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:18.0:1773851905.843859:0:154717:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0c86ad4.
00000020:00000010:18.0:1773851905.843860:0:154717:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000003330dfeb.
00000020:00000010:18.0:1773851905.843861:0:154717:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000004b65e428.
00000100:00000040:18.0:1773851905.843862:0:154717:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:18.0:1773851905.843863:0:154717:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:18.0:1773851905.843864:0:154717:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:18.0:1773851905.843864:0:154717:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:18.0:1773851905.843865:0:154717:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:18.0:1773851905.843866:0:154717:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:18.0:1773851905.843867:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851905.843867:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851905.843868:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006eeb010d refcount=3
00000020:00000001:18.0:1773851905.843869:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937567808 : -107144771983808 : ffff9e8d69ed2640)
00010000:00000001:18.0:1773851905.843870:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937567808 : -107144771983808 : ffff9e8d69ed2640)
00010000:00000001:18.0:1773851905.843871:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851905.843871:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851905.843872:0:154717:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:18.0:1773851905.843872:0:154717:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:18.0:1773851905.843873:0:154717:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000930358e7 refcount=3
00000020:00000001:18.0:1773851905.843873:0:154717:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937564928 : -107144771986688 : ffff9e8d69ed1b00)
00010000:00000001:18.0:1773851905.843874:0:154717:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937564928 : -107144771986688 : ffff9e8d69ed1b00)
00010000:00000001:18.0:1773851905.843874:0:154717:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:18.0:1773851905.843875:0:154717:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:18.0:1773851905.843875:0:154717:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851905.843876:0:154717:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851905.843877:0:154717:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851905.843878:0:154717:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851905.843880:0:154220:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:18.0:1773851905.843880:0:154717:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851905.843881:0:154220:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:18.0:1773851905.843881:0:154717:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851905.843882:0:154220:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15843@kfi7, seq: 38350204
00000100:00000040:19.0:1773851905.843883:0:154220:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000003a964e3a : new rpc_count 1
00000100:00000001:19.0:1773851905.843883:0:154220:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609976960 : -107015099574656 : ffff9eab9b011680)
00000100:00000001:18.0:1773851905.843883:0:154717:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:18.0:1773851905.843883:0:154717:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851905.843885:0:154220:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002cfd8eb7 x1859597756241408/t0(0) o103->463f1138-5013-4bdc-85c4-9db5cba3e1f5@15843@kfi7:632/0 lens 328/0 e 0 to 0 dl 1773851992 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:19.0:1773851905.843890:0:154220:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851905.843890:0:154220:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851905.843891:0:154220:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002cfd8eb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_010:463f1138-5013-4bdc-85c4-9db5cba3e1f5+7:39740:x1859597756241408:12345-15843@kfi7:103:
00000100:00000200:19.0:1773851905.843893:0:154220:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597756241408
00010000:00000001:19.0:1773851905.843894:0:154220:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:19.0:1773851905.843894:0:154220:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:19.0:1773851905.843895:0:154220:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:19.0:1773851905.843896:0:154220:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851905.843897:0:154220:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851905.843897:0:154220:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e78e6ddd.
02000000:00000001:19.0:1773851905.843898:0:154220:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.843899:0:154220:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843899:0:154220:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:19.0:1773851905.843900:0:154220:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0
00010000:00000001:19.0:1773851905.843901:0:154220:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:19.0:1773851905.843901:0:154220:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851905.843902:0:154220:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000006eeb010d refcount=3
00000020:00000001:19.0:1773851905.843902:0:154220:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937567808 : -107144771983808 : ffff9e8d69ed2640)
00010000:00000001:19.0:1773851905.843903:0:154220:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937567808 : -107144771983808 : ffff9e8d69ed2640)
00010000:00000040:19.0:1773851905.843904:0:154220:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 194
00000004:00000001:19.0:1773851905.843905:0:154220:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:19.0:1773851905.843906:0:154220:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:19.0:1773851905.843907:0:154220:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:19.0:1773851905.843907:0:154220:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:19.0:1773851905.843908:0:154220:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.843909:0:154220:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843910:0:154220:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:19.0:1773851905.843911:0:154220:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:19.0:1773851905.843912:0:154220:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:19.0:1773851905.843912:0:154220:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:19.0:1773851905.843913:0:154220:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:19.0:1773851905.843914:0:154220:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:19.0:1773851905.843915:0:154220:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000006eeb010d with handle 0x21b6f08f07a4da61 from hash
00010000:00000001:19.0:1773851905.843916:0:154220:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:19.0:1773851905.843916:0:154220:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:19.0:1773851905.843916:0:154220:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:19.0:1773851905.843917:0:154220:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:19.0:1773851905.843918:0:154220:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:19.0:1773851905.843919:0:154220:0:(ldlm_pool.c:370:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843919:0:154220:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:19.0:1773851905.843920:0:154220:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:19.0:1773851905.843920:0:154220:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000006eeb010d/0x21b6f08f07a4da61 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 195 type: IBT gid 0 flags: 0x44a01000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3d8 expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851905.843924:0:154220:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 194
00010000:00000040:19.0:1773851905.843925:0:154220:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003a964e3a : new locks_count 1
00000020:00000040:19.0:1773851905.843925:0:154220:0:(genops.c:882:class_export_put()) PUTting export 000000003a964e3a : new refcount 6
00010000:00000010:19.0:1773851905.843926:0:154220:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 000000005d67886a.
00010000:00000040:19.0:1773851905.843927:0:154220:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00000001:19.0:1773851905.843928:0:154220:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:19.0:1773851905.843928:0:154220:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:19.0:1773851905.843928:0:154220:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851905.843929:0:154220:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000930358e7 refcount=3
00000020:00000001:19.0:1773851905.843929:0:154220:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937564928 : -107144771986688 : ffff9e8d69ed1b00)
00010000:00000001:19.0:1773851905.843930:0:154220:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937564928 : -107144771986688 : ffff9e8d69ed1b00)
00010000:00000001:19.0:1773851905.843931:0:154220:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:19.0:1773851905.843931:0:154220:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:19.0:1773851905.843932:0:154220:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:19.0:1773851905.843933:0:154220:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851905.843934:0:154220:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843935:0:154220:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:19.0:1773851905.843935:0:154220:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 192
00010000:00000040:19.0:1773851905.843936:0:154220:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 229
00000004:00000001:19.0:1773851905.843936:0:154220:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:19.0:1773851905.843937:0:154220:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:19.0:1773851905.843937:0:154220:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:19.0:1773851905.843937:0:154220:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:19.0:1773851905.843938:0:154220:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851905.843938:0:154220:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843940:0:154220:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:19.0:1773851905.843941:0:154220:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:19.0:1773851905.843941:0:154220:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:19.0:1773851905.843942:0:154220:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:19.0:1773851905.843942:0:154220:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:19.0:1773851905.843943:0:154220:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:19.0:1773851905.843943:0:154220:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000930358e7 with handle 0x21b6f08f07a4da53 from hash
00010000:00000001:19.0:1773851905.843944:0:154220:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:19.0:1773851905.843944:0:154220:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:19.0:1773851905.843945:0:154220:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:19.0:1773851905.843945:0:154220:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:19.0:1773851905.843945:0:154220:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:19.0:1773851905.843946:0:154220:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843947:0:154220:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:19.0:1773851905.843947:0:154220:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:19.0:1773851905.843948:0:154220:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000930358e7/0x21b6f08f07a4da53 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 230 type: IBT gid 0 flags: 0x44a01000000000 nid: 15843@kfi7 remote: 0xe64097bd856fd3ae expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:19.0:1773851905.843950:0:154220:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 229
00010000:00000040:19.0:1773851905.843951:0:154220:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 000000003a964e3a : new locks_count 0
00000020:00000040:19.0:1773851905.843951:0:154220:0:(genops.c:882:class_export_put()) PUTting export 000000003a964e3a : new refcount 5
00010000:00000010:19.0:1773851905.843952:0:154220:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 0000000094978096.
00010000:00000040:19.0:1773851905.843952:0:154220:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00000001:19.0:1773851905.843953:0:154220:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:19.0:1773851905.843953:0:154220:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:19.0:1773851905.843954:0:154220:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:19.0:1773851905.843954:0:154220:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:19.0:1773851905.843955:0:154220:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:19.0:1773851905.843956:0:154220:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843956:0:154220:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:19.0:1773851905.843956:0:154220:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 227
00010000:00010000:19.0:1773851905.843957:0:154220:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:19.0:1773851905.843958:0:154220:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=2 : 2 : 2)
00010000:00000001:19.0:1773851905.843959:0:154220:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851905.843959:0:154220:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851905.843961:0:154220:0:(import.c:1951:at_measured()) add 1 to 000000001a540702 time=159 v=66 (1 0 0 1)
00000100:00000001:19.0:1773851905.843962:0:154220:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851905.843963:0:154220:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a12952c0 refcount 3 to 15843@kfi7
00000100:00000001:19.0:1773851905.843964:0:154220:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918274738240 : -107155434813376 : ffff9e8aee5f4840)
02000000:00000001:19.0:1773851905.843965:0:154220:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851905.843965:0:154220:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851905.843966:0:154220:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851905.843966:0:154220:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15650@kfi7
00000400:00000010:19.0:1773851905.843967:0:154220:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000067d0f432.
00000100:00000200:19.0:1773851905.843968:0:154220:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859597756241408, offset 224
00000400:00000200:19.0:1773851905.843969:0:154220:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15650@kfi7
00000400:00000200:19.0:1773851905.843970:0:154220:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15650@kfi7 to cpt 4
00000400:00000200:19.0:1773851905.843971:0:154220:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000044d150d6 nid 15650@kfi7 refs 1
00000400:00000200:19.0:1773851905.843972:0:154220:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000044d150d6 nid 15650@kfi7 refs 2
00000400:00000200:19.0:1773851905.843973:0:154220:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000044d150d6 nid 15650@kfi7 refs 3
00000400:00000200:19.0:1773851905.843974:0:154220:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15650@kfi7 local destination
00000400:00000200:19.0:1773851905.843975:0:154220:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770554:8770554:1024:4294967295] 15650@kfi7 LPNI seq info [70650:70650:16:4294967295]
00000400:00000200:19.0:1773851905.843977:0:154220:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000044d150d6 nid 15650@kfi7 refs 2
00000400:00000200:19.0:1773851905.843978:0:154220:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15650@kfi7 to cpt 4
00000400:00000200:19.0:1773851905.843980:0:154220:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15650@kfi7(15650@kfi7:15650@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851905.843981:0:154220:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000044d150d6 nid 15650@kfi7 refs 3
00000800:00000200:19.0:1773851905.843982:0:154220:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851905.843983:0:154220:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851905.843985:0:154220:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851905.843988:0:154220:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 Using peer 15650@kfi7(0x100000000000510)
00000800:00000200:19.0:1773851905.843991:0:154220:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 00000000c0436e42: Posted send of 324 bytes to peer 0x100000000000510: rc=0
00000800:00000200:19.0:1773851905.843992:0:154220:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851905.843996:0:154220:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851905.843997:0:154220:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a12952c0 refcount 2 to 15843@kfi7
00010000:00000001:19.0:1773851905.843998:0:154220:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:19.0:1773851905.843999:0:154220:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851905.844000:0:154220:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002cfd8eb7 x1859597756241408/t0(0) o103->463f1138-5013-4bdc-85c4-9db5cba3e1f5@15843@kfi7:632/0 lens 328/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000100:00100000:19.0:1773851905.844003:0:154220:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002cfd8eb7 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn04_010:463f1138-5013-4bdc-85c4-9db5cba3e1f5+5:39740:x1859597756241408:12345-15843@kfi7:103: Request processed in 112us (167us total) trans 0 rc 0/0
00000800:00000200:17.0:1773851905.844003:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851905.844004:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851905.844005:0:154220:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15843@kfi7, seq: 38350204
00000400:00000200:17.0:1773851905.844005:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15650@kfi7: PUT: OK
00000100:00000040:19.0:1773851905.844006:0:154220:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000003a964e3a : new rpc_count 0
00000100:00000001:19.0:1773851905.844006:0:154220:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:17.0:1773851905.844006:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000067d0f432
00000100:00000001:19.0:1773851905.844007:0:154220:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851905.844007:0:154220:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000003330dfeb.
00000400:00000010:17.0:1773851905.844007:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000067d0f432.
00000100:00000001:17.0:1773851905.844007:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:19.0:1773851905.844008:0:154220:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000004b65e428.
00000100:00000001:17.0:1773851905.844008:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:19.0:1773851905.844009:0:154220:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0c86ad4.
00000400:00000200:17.0:1773851905.844009:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000044d150d6 nid 15650@kfi7 refs 2
00000020:00000040:19.0:1773851905.844010:0:154220:0:(genops.c:882:class_export_put()) PUTting export 000000003a964e3a : new refcount 4
00000100:00000001:19.0:1773851905.844010:0:154220:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:17.0:1773851905.844010:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000c0436e42: 2054@kfi7:4 -> 15650@kfi7(0000000083085ddf):0x0 lsk 1297 rsk 3 tsk 0 trmk 0 tmk 0 trr 4 tta 0x100000000000510 Transaction freed
00010000:00000010:19.1F:1773851905.849728:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000006eeb010d.
00010000:00000010:19.1:1773851905.849730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000930358e7.
00000004:00000001:4.0:1773851905.865733:0:42363:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:4.0:1773851905.865733:0:42363:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:8.0:1773851905.865734:0:42313:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000001:6.0:1773851905.865734:0:42365:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000010:4.0:1773851905.865734:0:42363:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005df3e88d.
00000020:00000040:4.0:1773851905.865734:0:42363:0:(genops.c:1094:class_import_get()) import 000000005b942184 refcount=3 obd=lustre5-OST000c-osc-MDT0001
00000004:00000001:0.0:1773851905.865734:0:42327:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:8.0:1773851905.865735:0:42313:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000020:6.0:1773851905.865735:0:42365:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:4.0:1773851905.865735:0:42363:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000010:6.0:1773851905.865736:0:42365:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000024253d81.
02000000:00000001:4.0:1773851905.865736:0:42363:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000004:00000020:0.0:1773851905.865736:0:42327:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:8.0:1773851905.865737:0:42313:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000b54598de.
00000020:00000040:6.0:1773851905.865737:0:42365:0:(genops.c:1094:class_import_get()) import 000000008b68a823 refcount=10 obd=lustre5-OST000d-osc-MDT0001
02000000:00000001:4.0:1773851905.865737:0:42363:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:4.0:1773851905.865738:0:42363:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000022c33118.
00000100:00000010:0.0:1773851905.865738:0:42327:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d5ef0100.
00000020:00000040:8.0:1773851905.865739:0:42313:0:(genops.c:1094:class_import_get()) import 00000000f44a2c65 refcount=16 obd=lustre5-OST0003-osc-MDT0001
00000100:00000001:6.0:1773851905.865739:0:42365:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851905.865739:0:42365:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000001:4.0:1773851905.865739:0:42363:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.865739:0:42363:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000020:00000040:0.0:1773851905.865739:0:42327:0:(genops.c:1094:class_import_get()) import 000000004d57f306 refcount=5 obd=lustre5-OST000a-osc-MDT0001
02000000:00000001:6.0:1773851905.865740:0:42365:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851905.865740:0:42363:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:29.0:1773851905.865741:0:42379:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000100:00000001:8.0:1773851905.865741:0:42313:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000100:00000040:4.0:1773851905.865741:0:42363:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000005df3e88d] to pc [ptlrpcd_01_02+2]  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:0.0:1773851905.865741:0:42327:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000004:00000020:29.0:1773851905.865742:0:42379:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000004:00000001:28.0:1773851905.865742:0:42393:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
02000000:00000001:8.0:1773851905.865742:0:42313:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:6.0:1773851905.865742:0:42365:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000035adc4a4.
02000000:00000001:0.0:1773851905.865742:0:42327:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000010:29.0:1773851905.865743:0:42379:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec1b16b5.
00000004:00000020:28.0:1773851905.865743:0:42393:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000001:6.0:1773851905.865743:0:42365:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:29.0:1773851905.865744:0:42379:0:(genops.c:1094:class_import_get()) import 00000000f2730b1b refcount=3 obd=lustre5-OST0014-osc-MDT0001
00000100:00000010:28.0:1773851905.865744:0:42393:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007d05b48c.
02000000:00000001:8.0:1773851905.865744:0:42313:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.865744:0:42365:0:(jobid.c:870:lustre_get_jobid()) Process entered
02000000:00000001:0.0:1773851905.865744:0:42327:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851905.865745:0:42379:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
00000020:00000040:28.0:1773851905.865745:0:42393:0:(genops.c:1094:class_import_get()) import 000000002802f54d refcount=3 obd=lustre5-OST001b-osc-MDT0001
00000100:00000001:6.0:1773851905.865745:0:42365:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:29.0:1773851905.865746:0:42379:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000010:8.0:1773851905.865746:0:42313:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000623b0925.
00080000:00000001:4.0:1773851905.865746:0:42363:0:(osd_handler.c:349:osd_trans_create()) Process entered
02000000:00000010:0.0:1773851905.865746:0:42327:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000028bed4d2.
00000100:00000001:28.0:1773851905.865747:0:42393:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:28.0:1773851905.865747:0:42393:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
00000100:00000040:6.0:1773851905.865747:0:42365:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000024253d81] to pc [ptlrpcd_01_03+3]  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851905.865747:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:4.0:1773851905.865747:0:42363:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000009143fe2b.
02000000:00000001:29.0:1773851905.865748:0:42379:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:28.0:1773851905.865748:0:42393:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851905.865748:0:42313:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.865748:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851905.865748:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000001:4.0:1773851905.865748:0:42363:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637114992005120 : -106958717546496 : ffff9eb8bba29000)
00000100:00000001:0.0:1773851905.865748:0:42327:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:29.0:1773851905.865749:0:42379:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000db9c2666.
00000100:00000001:7.0:1773851905.865749:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.865749:0:41066:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:4.0:1773851905.865749:0:42363:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000010:28.0:1773851905.865750:0:42393:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 0000000075d6ffad.
00000100:00000001:8.0:1773851905.865750:0:42313:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000040:5.0:1773851905.865750:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:4.0:1773851905.865750:0:42363:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851905.865750:0:42327:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:29.0:1773851905.865751:0:42379:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.865751:0:42393:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:4.0:1773851905.865751:0:42363:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000c-osc-MDT0001: sync forced, 1 changes
00000004:00000010:4.0:1773851905.865751:0:42363:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000070caca3d.
00000100:00000001:0.0:1773851905.865751:0:42327:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851905.865752:0:42313:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:4.0:1773851905.865752:0:42363:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000c-osc-MDT0001: add commit cb at 614180319027852ns, next at 614181319026700ns, rc = 0
00000100:00000001:29.0:1773851905.865753:0:42379:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:28.0:1773851905.865753:0:42393:0:(jobid.c:870:lustre_get_jobid()) Process entered
00080000:00000001:6.0:1773851905.865753:0:42365:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:4.0:1773851905.865753:0:42363:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:29.0:1773851905.865754:0:42379:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:28.0:1773851905.865754:0:42393:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:8.0:1773851905.865754:0:42313:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000b54598de] to pc [ptlrpcd_02_01+1]  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851905.865754:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:4.0:1773851905.865754:0:42363:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851905.865754:0:42327:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000d5ef0100] to pc [ptlrpcd_00_01+1]  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851905.865755:0:42379:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [00000000ec1b16b5] to pc [ptlrpcd_07_01+1]  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851905.865755:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00080000:00000010:6.0:1773851905.865755:0:42365:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 000000008d25977b.
00000004:00000001:4.0:1773851905.865755:0:42363:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:28.0:1773851905.865756:0:42393:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [000000007d05b48c] to pc [ptlrpcd_07_02+2]  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851905.865756:0:41067:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851905.865756:0:42365:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637110950039552 : -106962759512064 : ffff9eb7cab71000)
00000100:00000001:5.0:1773851905.865756:0:41066:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:5.0:1773851905.865756:0:41066:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851905.865757:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851905.865758:0:42365:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:5.0:1773851905.865758:0:41066:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00080000:00000001:6.0:1773851905.865759:0:42365:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851905.865759:0:41066:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851905.865760:0:42365:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST000d-osc-MDT0001: sync forced, 4 changes
00000100:00100000:5.0:1773851905.865761:0:41066:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000005df3e88d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051944128:2085@kfi7:13:default-yuba2-0
00000004:00000001:0.0:1773851905.865761:0:42327:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851905.865762:0:42313:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851905.865762:0:41067:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851905.865762:0:41067:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:6.0:1773851905.865762:0:42365:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 00000000dbbcd04a.
00000004:00000001:29.0:1773851905.865763:0:42379:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.865763:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000004:00080000:6.0:1773851905.865763:0:42365:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST000d-osc-MDT0001: add commit cb at 614180319038852ns, next at 614181319036859ns, rc = 0
00000100:00000001:5.0:1773851905.865763:0:41066:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000100:00000001:30.0:1773851905.865764:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851905.865764:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851905.865764:0:41069:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:9.0:1773851905.865764:0:41068:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:8.0:1773851905.865764:0:42313:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000083bfc2c.
02000000:00000001:7.0:1773851905.865764:0:41067:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851905.865764:0:41067:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.865764:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000001:28.0:1773851905.865765:0:42393:0:(osd_handler.c:349:osd_trans_create()) Process entered
00080000:00000001:8.0:1773851905.865765:0:42313:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637161789344768 : -106911920206848 : ffff9ec3a0f94c00)
00080000:00000001:6.0:1773851905.865765:0:42365:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:5.0:1773851905.865765:0:41066:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:5.0:1773851905.865765:0:41066:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.865765:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851905.865765:0:41060:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851905.865766:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851905.865766:0:41089:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000040:10.0:1773851905.865766:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:9.0:1773851905.865766:0:41068:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851905.865766:0:42313:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00100000:7.0:1773851905.865766:0:41067:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000024253d81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051944192:46@kfi7:13:default-yuba2-0
00080000:00000001:6.0:1773851905.865766:0:42365:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.865766:0:41061:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:1.0:1773851905.865766:0:41060:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.865767:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:28.0:1773851905.865767:0:42393:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000074d5d06.
02000000:00000001:5.0:1773851905.865767:0:41066:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00100000:31.0:1773851905.865768:0:41091:0:(ptlrpcd.c:415:ptlrpcd_check()) transfer 1 async RPCs [2->3]
00000100:00000040:30.0:1773851905.865768:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:28.0:1773851905.865768:0:42393:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446636920109166592 : -107153600385024 : ffff9e8b5bb67000)
00000100:00000001:7.0:1773851905.865768:0:41067:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000004:00000001:6.0:1773851905.865768:0:42365:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851905.865768:0:41066:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000008ddfd792.
00000100:00000040:2.0:1773851905.865768:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851905.865769:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00080000:00000001:28.0:1773851905.865769:0:42393:0:(osd_handler.c:202:osd_trans_start()) Process entered
02000000:00000001:7.0:1773851905.865769:0:41067:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851905.865769:0:41067:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:5.0:1773851905.865769:0:41066:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851905.865770:0:41067:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851905.865771:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00080000:00000001:28.0:1773851905.865771:0:42393:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.865771:0:41069:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:10.0:1773851905.865771:0:41069:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851905.865771:0:42313:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:7.0:1773851905.865771:0:41067:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b2b64901.
00000100:00000001:31.0:1773851905.865772:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:10.0:1773851905.865772:0:41069:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00001000:8.0:1773851905.865772:0:42313:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0003-osc-MDT0001: sync forced, 3 changes
02000000:00000001:7.0:1773851905.865772:0:41067:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:5.0:1773851905.865772:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851905.865773:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851905.865773:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:30.0:1773851905.865773:0:41089:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000004:00001000:28.0:1773851905.865773:0:42393:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST001b-osc-MDT0001: sync forced, 2 changes
02000000:00000001:10.0:1773851905.865773:0:41069:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:5.0:1773851905.865773:0:41066:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 0000000045a04335.
00000100:00000001:31.0:1773851905.865774:0:41091:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00000100:00000001:30.0:1773851905.865774:0:41089:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:8.0:1773851905.865774:0:42313:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006291c91f.
00000400:00000200:7.0:1773851905.865774:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000010:5.0:1773851905.865774:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000006eb792ca.
00000100:00000001:2.0:1773851905.865774:0:41061:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:2.0:1773851905.865774:0:41061:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000010:28.0:1773851905.865775:0:42393:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 000000006d181789.
00000100:00100000:10.0:1773851905.865775:0:41069:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000b54598de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051944320:2055@kfi7:13:default-yuba2-0
00000004:00080000:8.0:1773851905.865775:0:42313:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0003-osc-MDT0001: add commit cb at 614180319050845ns, next at 614181319048961ns, rc = 0
00000400:00000010:7.0:1773851905.865775:0:41067:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000007398a75e.
00000100:00000040:31.0:1773851905.865776:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:30.0:1773851905.865776:0:41089:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
00000004:00080000:28.0:1773851905.865776:0:42393:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST001b-osc-MDT0001: add commit cb at 614180319051847ns, next at 614181319049542ns, rc = 0
00000400:00000010:7.0:1773851905.865776:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a17c530.
00000100:00000200:5.0:1773851905.865776:0:41066:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944128, portal 4
02000000:00000001:2.0:1773851905.865776:0:41061:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:30.0:1773851905.865777:0:41089:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.865777:0:41069:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00080000:00000001:8.0:1773851905.865777:0:42313:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00000100:00000001:5.0:1773851905.865777:0:41066:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00080000:00000001:28.0:1773851905.865778:0:42393:0:(osd_handler.c:287:osd_trans_stop()) Process entered
02000000:00000001:10.0:1773851905.865778:0:41069:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00000001:5.0:1773851905.865778:0:41066:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637095528699520 : -106978180852096 : ffff9eb433881680)
02000000:00000001:2.0:1773851905.865778:0:41061:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:30.0:1773851905.865779:0:41089:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000ec1b16b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051944384:2056@kfi7:13:default-yuba2-0
02000000:00000001:10.0:1773851905.865779:0:41069:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:8.0:1773851905.865779:0:42313:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:7.0:1773851905.865779:0:41067:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944192, portal 4
00000100:00100000:2.0:1773851905.865779:0:41061:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@00000000d5ef0100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051944256:2057@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851905.865780:0:41091:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00080000:00000001:28.0:1773851905.865780:0:42393:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851905.865780:0:41069:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000004:00000001:8.0:1773851905.865780:0:42313:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.865780:0:41067:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851905.865780:0:41067:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359408384 : -107048350143232 : ffff9ea3dd1dad00)
00000100:00000040:5.0:1773851905.865780:0:41066:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851905.865781:0:41091:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:28.0:1773851905.865781:0:42393:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851905.865782:0:41091:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000010:10.0:1773851905.865782:0:41069:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000e85052a5.
00000100:00000040:7.0:1773851905.865782:0:41067:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851905.865782:0:41061:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:10.0:1773851905.865783:0:41069:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851905.865784:0:41091:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851905.865784:0:41061:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000100:00100000:31.0:1773851905.865785:0:41091:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@000000007d05b48c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051944448:2065@kfi7:13:default-yuba2-0
00000100:00000001:30.0:1773851905.865785:0:41089:0:(niobuf.c:712:ptl_send_rpc()) Process entered
00000400:00000200:10.0:1773851905.865785:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:5.0:1773851905.865785:0:41066:0:(niobuf.c:55:ptl_send_buf()) Process entered
02000000:00000001:2.0:1773851905.865785:0:41061:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851905.865786:0:41089:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
00000400:00000010:10.0:1773851905.865786:0:41069:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000222549a5.
00000100:00000001:7.0:1773851905.865786:0:41067:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:5.0:1773851905.865786:0:41066:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2085@kfi7
02000000:00000001:2.0:1773851905.865786:0:41061:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000001:31.0:1773851905.865787:0:41091:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:30.0:1773851905.865787:0:41089:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:10.0:1773851905.865787:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d5e68c33.
00000400:00000010:5.0:1773851905.865787:0:41066:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d4e64133.
02000000:00000010:2.0:1773851905.865787:0:41061:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000005f97961b.
02000000:00000001:31.0:1773851905.865788:0:41091:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:30.0:1773851905.865788:0:41089:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000040:7.0:1773851905.865788:0:41067:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-46@kfi7
02000000:00000001:31.0:1773851905.865789:0:41091:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851905.865789:0:41091:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
00000100:00000200:10.0:1773851905.865789:0:41069:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944320, portal 4
00000400:00000010:7.0:1773851905.865789:0:41067:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000726eb128.
00000100:00000200:5.0:1773851905.865789:0:41066:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944128, offset 0
02000000:00000001:2.0:1773851905.865789:0:41061:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851905.865790:0:41089:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000811c6a94.
00000100:00000200:7.0:1773851905.865790:0:41067:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944192, offset 0
02000000:00000010:31.0:1773851905.865791:0:41091:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 000000001a23e593.
02000000:00000001:30.0:1773851905.865791:0:41089:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.865791:0:41069:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:10.0:1773851905.865791:0:41069:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636956491275904 : -107117218275712 : ffff9e93d4415e80)
00000400:00000200:5.0:1773851905.865791:0:41066:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2085@kfi7
00000400:00000200:2.0:1773851905.865791:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
02000000:00000001:31.0:1773851905.865792:0:41091:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851905.865792:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000010:2.0:1773851905.865792:0:41061:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000007f7464cb.
00000400:00000200:7.0:1773851905.865793:0:41067:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-46@kfi7
00000400:00000200:5.0:1773851905.865793:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000010:2.0:1773851905.865793:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000ab3765ed.
00000400:00000200:31.0:1773851905.865794:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000010:30.0:1773851905.865794:0:41089:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 00000000b35d67d7.
00000100:00000040:10.0:1773851905.865794:0:41069:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:31.0:1773851905.865795:0:41091:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000008174bb91.
00000400:00000010:30.0:1773851905.865795:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000048340f51.
00000400:00000200:5.0:1773851905.865795:0:41066:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000200:2.0:1773851905.865795:0:41061:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944256, portal 4
00000400:00000010:31.0:1773851905.865796:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa0db5be.
00000400:00000200:5.0:1773851905.865797:0:41066:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:2.0:1773851905.865797:0:41061:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:2.0:1773851905.865797:0:41061:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446636971203072512 : -107102506479104 : ffff9e9741259200)
00000100:00000200:31.0:1773851905.865798:0:41091:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944448, portal 4
00000100:00000200:30.0:1773851905.865798:0:41089:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944384, portal 4
00000100:00000001:10.0:1773851905.865798:0:41069:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000001:31.0:1773851905.865799:0:41091:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:30.0:1773851905.865799:0:41089:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000040:10.0:1773851905.865799:0:41069:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2055@kfi7
00000400:00000200:5.0:1773851905.865799:0:41066:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000100:00000001:31.0:1773851905.865800:0:41091:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637097324222080 : -106976385329536 : ffff9eb49e8d9680)
00000100:00000001:30.0:1773851905.865800:0:41089:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637151562447488 : -106922147104128 : ffff9ec13f673a80)
00000400:00000010:10.0:1773851905.865800:0:41069:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d45b4413.
00000100:00000040:2.0:1773851905.865800:0:41061:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:10.0:1773851905.865801:0:41069:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944320, offset 0
00000100:00000040:31.0:1773851905.865802:0:41091:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:30.0:1773851905.865802:0:41089:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:5.0:1773851905.865802:0:41066:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2085@kfi7 local destination
00000400:00000200:10.0:1773851905.865804:0:41069:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2055@kfi7
00000400:00000200:5.0:1773851905.865804:0:41066:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770553, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770554, p:4294967295, g:4294967295, h:1000]
00000100:00000001:2.0:1773851905.865804:0:41061:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851905.865805:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000001:31.0:1773851905.865806:0:41091:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:2.0:1773851905.865806:0:41061:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2057@kfi7
00000100:00000001:30.0:1773851905.865807:0:41089:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000400:00000200:10.0:1773851905.865807:0:41069:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000400:00000010:2.0:1773851905.865807:0:41061:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000c63b795d.
00000100:00000040:31.0:1773851905.865808:0:41091:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2065@kfi7
00000100:00000040:30.0:1773851905.865808:0:41089:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2056@kfi7
00000400:00000200:5.0:1773851905.865808:0:41066:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000200:2.0:1773851905.865808:0:41061:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944256, offset 0
00000400:00000010:31.0:1773851905.865809:0:41091:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fab8ac69.
00000400:00000010:30.0:1773851905.865809:0:41089:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000002d1b6f02.
00000400:00000200:10.0:1773851905.865809:0:41069:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:5.0:1773851905.865809:0:41066:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000100:00000200:31.0:1773851905.865810:0:41091:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944448, offset 0
00000100:00000200:30.0:1773851905.865810:0:41089:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944384, offset 0
00000400:00000200:10.0:1773851905.865811:0:41069:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:5.0:1773851905.865811:0:41066:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2085@kfi7
00000400:00000200:2.0:1773851905.865811:0:41061:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2057@kfi7
00000400:00000200:31.0:1773851905.865812:0:41091:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2065@kfi7
00000400:00000200:2.0:1773851905.865812:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:10.0:1773851905.865813:0:41069:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2055@kfi7 local destination
00000400:00000200:5.0:1773851905.865813:0:41066:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770555:8770555:1024:4294967295] 2085@kfi7 LPNI seq info [5403248:5403248:16:4294967295]
00000400:00000200:31.0:1773851905.865814:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:30.0:1773851905.865814:0:41089:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2056@kfi7
00000400:00000200:2.0:1773851905.865814:0:41061:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000400:00000200:31.0:1773851905.865815:0:41091:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:10.0:1773851905.865816:0:41069:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770555, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770554, p:4294967295, g:4294967295, h:1000]
00000400:00000200:5.0:1773851905.865816:0:41066:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:2.0:1773851905.865816:0:41061:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:31.0:1773851905.865817:0:41091:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:5.0:1773851905.865818:0:41066:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:2.0:1773851905.865818:0:41061:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:10.0:1773851905.865819:0:41069:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851905.865820:0:41091:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:10.0:1773851905.865820:0:41069:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851905.865820:0:41061:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2057@kfi7 local destination
00000400:00000200:31.0:1773851905.865822:0:41091:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2065@kfi7 local destination
00000400:00000200:10.0:1773851905.865822:0:41069:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2055@kfi7
00000400:00000200:5.0:1773851905.865822:0:41066:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2085@kfi7(2085@kfi7:2085@kfi7) <?> : PUT try# 0
00000400:00000200:2.0:1773851905.865823:0:41061:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770555, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770554, p:4294967295, g:4294967295, h:1000]
00000400:00000200:31.0:1773851905.865824:0:41091:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770555, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770556, p:4294967295, g:4294967295, h:1000]
00000400:00000200:10.0:1773851905.865824:0:41069:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770556:8770556:1024:4294967295] 2055@kfi7 LPNI seq info [5404678:5404678:16:4294967295]
00000400:00000200:5.0:1773851905.865824:0:41066:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000400:00000200:10.0:1773851905.865826:0:41069:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:7.0:1773851905.865826:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:7.0:1773851905.865827:0:41067:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000800:00000200:5.0:1773851905.865827:0:41066:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000400:00000200:2.0:1773851905.865827:0:41061:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:31.0:1773851905.865828:0:41091:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2054@kfi7
00000400:00000200:10.0:1773851905.865828:0:41069:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000400:00000200:2.0:1773851905.865828:0:41061:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851905.865829:0:41067:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:5.0:1773851905.865829:0:41066:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:31.0:1773851905.865830:0:41091:0:(lib-move.c:1336:lnet_select_peer_ni()) 2054@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851905.865830:0:41061:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2057@kfi7
00000400:00000200:31.0:1773851905.865831:0:41091:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2065@kfi7
00000400:00000200:7.0:1773851905.865831:0:41067:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000400:00000200:2.0:1773851905.865832:0:41061:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770557:8770557:1023:4294967295] 2057@kfi7 LPNI seq info [5404114:5404114:16:4294967295]
00000400:00000200:31.0:1773851905.865833:0:41091:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770558:8770558:1023:4294967295] 2065@kfi7 LPNI seq info [5402836:5402836:16:4294967295]
00000400:00000200:10.0:1773851905.865833:0:41069:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2055@kfi7(2055@kfi7:2055@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851905.865833:0:41067:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  46@kfi7 local destination
00000800:00000200:5.0:1773851905.865833:0:41066:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:2.0:1773851905.865834:0:41061:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:10.0:1773851905.865835:0:41069:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000400:00000200:31.0:1773851905.865836:0:41091:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:7.0:1773851905.865836:0:41067:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770555, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1023, d:10, s:8770558, p:4294967295, g:4294967295, h:1000]
00000400:00000200:2.0:1773851905.865836:0:41061:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:31.0:1773851905.865837:0:41091:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:10.0:1773851905.865838:0:41069:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:5.0:1773851905.865838:0:41066:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Using peer 2085@kfi7(0x113)
00000400:00000200:30.0:1773851905.865839:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:7.0:1773851905.865839:0:41067:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:30.0:1773851905.865840:0:41089:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000800:00000200:10.0:1773851905.865841:0:41069:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851905.865841:0:41067:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:2.0:1773851905.865841:0:41061:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2057@kfi7(2057@kfi7:2057@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851905.865842:0:41091:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:<?>) -> 2065@kfi7(2065@kfi7:2065@kfi7) <?> : PUT try# 0
00000400:00000200:30.0:1773851905.865842:0:41089:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:7.0:1773851905.865842:0:41067:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 46@kfi7
00000800:00000200:5.0:1773851905.865843:0:41066:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000002275c6f1: Posted send of 324 bytes to peer 0x113: rc=0
00000400:00000200:2.0:1773851905.865843:0:41061:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:31.0:1773851905.865844:0:41091:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:30.0:1773851905.865844:0:41089:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:7.0:1773851905.865844:0:41067:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770559:8770559:1023:4294967295] 46@kfi7 LPNI seq info [5403866:5403866:16:4294967295]
00000800:00000200:10.0:1773851905.865845:0:41069:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851905.865846:0:41089:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  2056@kfi7 local destination
00000400:00000200:7.0:1773851905.865846:0:41067:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000800:00000200:5.0:1773851905.865846:0:41066:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:31.0:1773851905.865847:0:41091:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:2.0:1773851905.865847:0:41061:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000400:00000200:7.0:1773851905.865848:0:41067:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:31.0:1773851905.865849:0:41091:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:30.0:1773851905.865849:0:41089:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1023, d:10, s:8770559, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1021, d:10, s:8770558, p:4294967295, g:4294967295, h:1000]
00000800:00000200:10.0:1773851905.865849:0:41069:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Using peer 2055@kfi7(0x200000000000637)
00000100:00000001:5.0:1773851905.865849:0:41066:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.865850:0:41066:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:2.0:1773851905.865850:0:41061:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:7.0:1773851905.865852:0:41067:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 46@kfi7(46@kfi7:46@kfi7) <?> : PUT try# 0
00000100:00000001:5.0:1773851905.865852:0:41066:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:31.0:1773851905.865853:0:41091:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851905.865853:0:41089:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000100:00000001:5.0:1773851905.865853:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:10.0:1773851905.865854:0:41069:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 000000003858ee31: Posted send of 324 bytes to peer 0x200000000000637: rc=0
00000400:00000200:7.0:1773851905.865854:0:41067:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000100:00000001:5.0:1773851905.865854:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:2.0:1773851905.865854:0:41061:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:30.0:1773851905.865855:0:41089:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:30.0:1773851905.865856:0:41089:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2056@kfi7
00000100:00000001:5.0:1773851905.865856:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000800:00000200:10.0:1773851905.865857:0:41069:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000800:00000200:7.0:1773851905.865857:0:41067:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:5.0:1773851905.865857:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:31.0:1773851905.865858:0:41091:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Using peer 2065@kfi7(0x2000000000005d1)
00000400:00000200:30.0:1773851905.865858:0:41089:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770560:8770560:1022:4294967295] 2056@kfi7 LPNI seq info [5402408:5402408:16:4294967295]
00000800:00000200:6.0:1773851905.865858:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 TN_EVENT_TX_OK event status 0
00000100:00000001:5.0:1773851905.865858:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:7.0:1773851905.865859:0:41067:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000100:00000001:5.0:1773851905.865859:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:5.0:1773851905.865859:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:2.0:1773851905.865859:0:41061:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 Using peer 2057@kfi7(0x200000000000294)
00000100:00000001:10.0:1773851905.865860:0:41069:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.865860:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851905.865861:0:41089:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:10.0:1773851905.865861:0:41069:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000400:00000200:6.0:1773851905.865861:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:31.0:1773851905.865862:0:41091:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000d80c8618: Posted send of 324 bytes to peer 0x2000000000005d1: rc=0
00000400:00000200:30.0:1773851905.865862:0:41089:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:10.0:1773851905.865862:0:41069:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:7.0:1773851905.865863:0:41067:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000400:00000200:6.0:1773851905.865863:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000800:00000200:31.0:1773851905.865864:0:41091:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:10.0:1773851905.865864:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851905.865864:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d4e64133
00000800:00000200:2.0:1773851905.865864:0:41061:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000dae7d744: Posted send of 324 bytes to peer 0x200000000000294: rc=0
00000100:00000001:10.0:1773851905.865865:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:6.0:1773851905.865865:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d4e64133.
00000100:00000001:10.0:1773851905.865866:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:6.0:1773851905.865866:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:10.0:1773851905.865867:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000800:00000200:7.0:1773851905.865867:0:41067:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Using peer 46@kfi7(0x3df)
00000800:00000200:2.0:1773851905.865867:0:41061:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851905.865868:0:41091:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851905.865868:0:41089:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 2056@kfi7(2056@kfi7:2056@kfi7) <?> : PUT try# 0
00000100:00000001:10.0:1773851905.865868:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000200:6.0:1773851905.865868:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851905.865869:0:41091:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851905.865870:0:41091:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:30.0:1773851905.865870:0:41089:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000100:00000001:10.0:1773851905.865870:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:10.0:1773851905.865870:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851905.865870:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 TN_EVENT_TX_OK event status 0
00000100:00000001:2.0:1773851905.865870:0:41061:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.865871:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.865871:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.865871:0:41061:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:31.0:1773851905.865872:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851905.865872:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:2.0:1773851905.865872:0:41061:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851905.865873:0:41089:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000400:00000200:9.0:1773851905.865873:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:6.0:1773851905.865873:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:2.0:1773851905.865874:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:30.0:1773851905.865875:0:41089:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000400:00000200:9.0:1773851905.865875:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000100:00000001:2.0:1773851905.865875:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.865876:0:41090:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000800:00000200:7.0:1773851905.865876:0:41067:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000dd83fa75: Posted send of 324 bytes to peer 0x3df: rc=0
00000100:00000001:31.0:1773851905.865877:0:41090:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851905.865877:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d45b4413
00000100:00000001:6.0:1773851905.865877:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.865877:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851905.865877:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000010:9.0:1773851905.865878:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d45b4413.
00000800:00000200:7.0:1773851905.865878:0:41067:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:6.0:1773851905.865878:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:30.0:1773851905.865879:0:41089:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000100:00000001:9.0:1773851905.865879:0:2458095:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:2.0:1773851905.865879:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851905.865879:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851905.865880:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 TN_EVENT_TX_OK event status 0
00000100:00000200:9.0:1773851905.865880:0:2458095:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851905.865880:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:2.0:1773851905.865880:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.865881:0:41067:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.865881:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851905.865881:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851905.865882:0:41088:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:31.0:1773851905.865882:0:41088:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.865882:0:41067:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000800:00000200:6.0:1773851905.865882:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000002275c6f1: 2069@kfi7:1 -> 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x113 Transaction freed
00000400:00000200:29.0:1773851905.865883:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:30.0:1773851905.865884:0:41089:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Using peer 2056@kfi7(0x204)
00000100:00000001:7.0:1773851905.865884:0:41067:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851905.865884:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851905.865885:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000100:00000001:7.0:1773851905.865885:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.865886:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851905.865886:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00000400:00000200:29.0:1773851905.865887:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fab8ac69
00000400:00000010:29.0:1773851905.865887:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fab8ac69.
00000400:00000200:1.0:1773851905.865887:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000c63b795d
00000100:00000001:7.0:1773851905.865888:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851905.865888:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000010:1.0:1773851905.865888:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000c63b795d.
00000800:00000200:30.0:1773851905.865889:0:41089:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000b26b1be8: Posted send of 324 bytes to peer 0x204: rc=0
00000100:00000001:29.0:1773851905.865889:0:2467684:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:9.0:1773851905.865889:0:2458095:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:29.0:1773851905.865890:0:2467684:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851905.865890:0:2458095:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851905.865890:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851905.865890:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:1.0:1773851905.865890:0:2494030:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:7.0:1773851905.865891:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:5.0:1773851905.865891:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df TN_EVENT_TX_OK event status 0
00000100:00000200:1.0:1773851905.865891:0:2494030:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:30.0:1773851905.865892:0:41089:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851905.865892:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851905.865893:0:2499722:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000100:00000001:29.0:1773851905.865894:0:2467684:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:9.0:1773851905.865894:0:2458095:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.865895:0:41089:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:9.0:1773851905.865895:0:2458095:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:6.0:1773851905.865895:0:2499722:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:5.0:1773851905.865895:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:30.0:1773851905.865896:0:41089:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000040:29.0:1773851905.865896:0:2467684:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851905.865897:0:41089:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851905.865897:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:6.0:1773851905.865897:0:2499722:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851905.865897:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
00000100:00000001:1.0:1773851905.865897:0:2494030:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:1.0:1773851905.865898:0:2494030:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851905.865899:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851905.865899:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003858ee31: 2054@kfi7:2 -> 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 2 tta 0x200000000000637 Transaction freed
00000400:00000200:5.0:1773851905.865899:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000726eb128
00000400:00000010:5.0:1773851905.865899:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000726eb128.
00000100:00000001:30.0:1773851905.865900:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851905.865900:0:2467684:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:29.0:1773851905.865901:0:2467684:0:(events.c:93:request_out_callback()) Process leaving
00000800:00000200:6.0:1773851905.865901:0:2499722:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:5.0:1773851905.865901:0:2507993:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:30.0:1773851905.865902:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000200:5.0:1773851905.865902:0:2507993:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851905.865903:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000400:00000200:29.0:1773851905.865903:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:1.0:1773851905.865903:0:2494030:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.865904:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:6.0:1773851905.865904:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000800:00000200:31.0:1773851905.865905:0:2465875:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 TN_EVENT_TX_OK event status 0
00000100:00000001:30.0:1773851905.865905:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:29.0:1773851905.865905:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d80c8618: 2054@kfi7:7 -> 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 7 tta 0x2000000000005d1 Transaction freed
00000100:00000001:1.0:1773851905.865905:0:2494030:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000001:30.0:1773851905.865906:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851905.865906:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:5.0:1773851905.865907:0:2507993:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000400:00000200:31.0:1773851905.865908:0:2465875:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:5.0:1773851905.865909:0:2507993:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:1.0:1773851905.865909:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dae7d744: 2054@kfi7:0 -> 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 0 tta 0x200000000000294 Transaction freed
00000400:00000200:31.0:1773851905.865910:0:2465875:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000100:00000001:30.0:1773851905.865910:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:6.0:1773851905.865910:0:2499722:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2085@kfi7 : PUT - for me
00000400:00000200:31.0:1773851905.865912:0:2465875:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000002d1b6f02
00000400:00000200:6.0:1773851905.865912:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000010:31.0:1773851905.865913:0:2465875:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000002d1b6f02.
00000400:00000200:6.0:1773851905.865913:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 1
00000100:00000001:5.0:1773851905.865913:0:2507993:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.865914:0:2465875:0:(events.c:53:request_out_callback()) Process entered
00000100:00000001:5.0:1773851905.865914:0:2507993:0:(events.c:93:request_out_callback()) Process leaving
00000100:00000200:31.0:1773851905.865915:0:2465875:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:6.0:1773851905.865915:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000400:00000200:6.0:1773851905.865916:0:2499722:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000400:00000200:5.0:1773851905.865916:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000400:00000200:6.0:1773851905.865918:0:2499722:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 3
00000800:00000200:5.0:1773851905.865918:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dd83fa75: 2069@kfi7:1 -> 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x3df Transaction freed
00000800:00000200:21.0:1773851905.865919:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000100:00000001:31.0:1773851905.865920:0:2465875:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000800:00000200:21.0:1773851905.865920:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:6.0:1773851905.865920:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000040:31.0:1773851905.865921:0:2465875:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:21.0:1773851905.865922:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:6.0:1773851905.865922:0:2499722:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2085@kfi7 of length 368 into portal 4 MB=0x69b24fe8b74c0
00000400:00000200:6.0:1773851905.865923:0:2499722:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2085@kfi7 to cpt 1
00000100:00000001:31.0:1773851905.865925:0:2465875:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851905.865925:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:31.0:1773851905.865926:0:2465875:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851905.865926:0:2499722:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2085@kfi7 of length 368/368 into md 0x793b329c5 [1] + 224
00000400:00000200:31.0:1773851905.865928:0:2465875:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:21.0:1773851905.865928:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:9.0:1773851905.865928:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:2 Transaction ID 0 allocated
00000400:00000200:21.0:1773851905.865930:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2055@kfi7 : PUT - for me
00000800:00000200:6.0:1773851905.865930:0:2499722:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:31.0:1773851905.865931:0:2465875:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000b26b1be8: 2069@kfi7:7 -> 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 7 tta 0x204 Transaction freed
00000400:00000200:21.0:1773851905.865932:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:9.0:1773851905.865932:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:6.0:1773851905.865932:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.865933:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 1
00000800:00000200:17.0:1773851905.865933:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851905.865934:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:6.0:1773851905.865934:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2085@kfi7: PUT: OK
00000400:00000200:21.0:1773851905.865935:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:9.0:1773851905.865935:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851905.865936:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000003576128d nid 2055@kfi7 refs 2
00000800:00000200:17.0:1773851905.865936:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:6.0:1773851905.865936:0:2499722:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:21.0:1773851905.865937:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 3
00000100:00000200:6.0:1773851905.865937:0:2499722:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000800:00000200:9.0:1773851905.865938:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851905.865939:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000800:00000200:17.0:1773851905.865940:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851905.865941:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2055@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7580
00000800:00000200:13.0:1773851905.865941:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000400:00000200:9.0:1773851905.865941:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:21.0:1773851905.865942:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2055@kfi7 to cpt 5
00000100:00000040:6.0:1773851905.865942:0:2499722:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851905.865943:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:13.0:1773851905.865943:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000400:00000200:9.0:1773851905.865944:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 46@kfi7 : PUT - for me
00000400:00000200:21.0:1773851905.865945:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2055@kfi7 of length 368/368 into md 0x6a34d2455 [1] + 224
00000800:00000200:13.0:1773851905.865945:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851905.865945:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000400:00000200:17.0:1773851905.865946:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2065@kfi7 : PUT - for me
00000400:00000200:9.0:1773851905.865946:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000200:9.0:1773851905.865947:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 1
00000800:00000200:1.0:1773851905.865947:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851905.865948:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851905.865948:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000800:00000200:13.0:1773851905.865948:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:6.0:1773851905.865948:0:2499722:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:17.0:1773851905.865949:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 1
00000400:00000200:9.0:1773851905.865949:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000800:00000200:1.0:1773851905.865949:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851905.865950:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851905.865950:0:2499722:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000d10e5d8a nid 2085@kfi7 refs 2
00000100:00000001:5.0:1773851905.865950:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000400:00000200:17.0:1773851905.865951:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851905.865951:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851905.865951:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:5.0:1773851905.865951:0:41066:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:21.0:1773851905.865952:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2055@kfi7: PUT: OK
00000400:00000200:17.0:1773851905.865952:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000400:00000200:9.0:1773851905.865952:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 3
00000800:00000200:6.0:1773851905.865952:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000dbb44ac2: 2069@kfi7:1 <- 2085@kfi7(00000000381bd453):0x0 lsk 276 rsk 4787 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000400:00000001:5.0:1773851905.865952:0:41066:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:5.0:1773851905.865953:0:41066:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000800:00000200:1.0:1773851905.865953:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000100:00000001:21.0:1773851905.865954:0:2494373:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851905.865954:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 3
00000400:00000200:13.0:1773851905.865954:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2057@kfi7 : PUT - for me
00000400:00000200:9.0:1773851905.865954:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000400:00000010:5.0:1773851905.865954:0:41066:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 0000000045a04335.
00000400:00000200:9.0:1773851905.865955:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-46@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7500
00000400:00000200:5.0:1773851905.865955:0:41066:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000006eb792ca
00000100:00000200:21.0:1773851905.865956:0:2494373:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851905.865956:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851905.865956:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000010:5.0:1773851905.865956:0:41066:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000006eb792ca.
00000400:00000200:1.0:1773851905.865956:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:9.0:1773851905.865957:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 46@kfi7 to cpt 2
00000100:00000001:5.0:1773851905.865957:0:41066:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851905.865958:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2065@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7600
00000400:00000200:13.0:1773851905.865958:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 1
00000100:00000200:5.0:1773851905.865958:0:41066:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:9.0:1773851905.865959:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-46@kfi7 of length 368/368 into md 0x781699689 [1] + 224
00000400:00000200:1.0:1773851905.865959:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 2056@kfi7 : PUT - for me
00000100:00000040:21.0:1773851905.865960:0:2494373:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:17.0:1773851905.865960:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2065@kfi7 to cpt 4
00000400:00000200:13.0:1773851905.865960:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:13.0:1773851905.865961:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000400:00000200:1.0:1773851905.865961:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:13.0:1773851905.865962:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 3
00000400:00000200:17.0:1773851905.865963:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2065@kfi7 of length 368/368 into md 0x6ab1f27b1 [1] + 224
00000800:00000200:9.0:1773851905.865963:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000200:5.0:1773851905.865963:0:41066:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:1.0:1773851905.865963:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 1
00000400:00000200:1.0:1773851905.865965:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000100:00000001:21.0:1773851905.865966:0:2494373:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:17.0:1773851905.865966:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851905.865966:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000400:00000200:21.0:1773851905.865968:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000003576128d nid 2055@kfi7 refs 2
00000400:00000200:13.0:1773851905.865968:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000200:9.0:1773851905.865968:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851905.865968:0:41066:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851905.865968:0:41066:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:1.0:1773851905.865968:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 3
00000400:00000200:17.0:1773851905.865969:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851905.865969:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2057@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7540
00000100:00000001:10.0:1773851905.865969:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:5.0:1773851905.865969:0:41066:0:(client.c:1428:after_reply()) Process entered
00000100:00000001:10.0:1773851905.865970:0:41069:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000200:9.0:1773851905.865970:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->46@kfi7: PUT: OK
02000000:00000001:5.0:1773851905.865970:0:41066:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000200:1.0:1773851905.865970:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000800:00000200:21.0:1773851905.865971:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 2055@kfi7(00000000cf27b04c):0x0 lsk 1592 rsk 4785 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000400:00000200:17.0:1773851905.865971:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2065@kfi7: PUT: OK
00000400:00000200:13.0:1773851905.865971:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2057@kfi7 to cpt 3
00000400:00000001:10.0:1773851905.865971:0:41069:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:5.0:1773851905.865971:0:41066:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000200:1.0:1773851905.865971:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2056@kfi7 of length 368 into portal 4 MB=0x69b24fe8b75c0
00000400:00000001:10.0:1773851905.865972:0:41069:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:9.0:1773851905.865972:0:2458095:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:5.0:1773851905.865972:0:41066:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:17.0:1773851905.865973:0:2511435:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:13.0:1773851905.865973:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2057@kfi7 of length 368/368 into md 0x82a5f77ed [1] + 224
00000400:00000010:10.0:1773851905.865973:0:41069:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000222549a5.
00000100:00000200:9.0:1773851905.865973:0:2458095:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:5.0:1773851905.865973:0:41066:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851905.865973:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2056@kfi7 to cpt 0
00000400:00000200:10.0:1773851905.865974:0:41069:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d5e68c33
00000100:00000200:17.0:1773851905.865975:0:2511435:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000010:10.0:1773851905.865975:0:41069:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d5e68c33.
00000100:00001000:5.0:1773851905.865975:0:41066:0:(import.c:1951:at_measured()) add 66 to 000000004aac437c time=138 v=66 (66 66 66 66)
00000400:00000200:1.0:1773851905.865976:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-2056@kfi7 of length 368/368 into md 0x7fb71ea41 [1] + 224
00000800:00000200:13.0:1773851905.865977:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000100:00000001:10.0:1773851905.865977:0:41069:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:5.0:1773851905.865977:0:41066:0:(import.c:1951:at_measured()) add 1 to 00000000df526287 time=138 v=66 (1 1 1 1)
00000100:00000200:10.0:1773851905.865978:0:41069:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:9.0:1773851905.865978:0:2458095:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851905.865979:0:41066:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000040:17.0:1773851905.865980:0:2511435:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851905.865980:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:5.0:1773851905.865980:0:41066:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:1.0:1773851905.865980:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851905.865981:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2057@kfi7: PUT: OK
00010000:00000001:5.0:1773851905.865981:0:41066:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:5.0:1773851905.865981:0:41066:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851905.865982:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:13.0:1773851905.865983:0:2514888:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:10.0:1773851905.865983:0:41069:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851905.865983:0:41066:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:5.0:1773851905.865983:0:41066:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000c-osc-MDT0001: skip recheck: last_committed 163342363236
00000100:00000001:9.0:1773851905.865984:0:2458095:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:5.0:1773851905.865984:0:41066:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000200:1.0:1773851905.865984:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->2056@kfi7: PUT: OK
00000100:00000001:17.0:1773851905.865985:0:2511435:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:13.0:1773851905.865985:0:2514888:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:5.0:1773851905.865985:0:41066:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:9.0:1773851905.865986:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005330dc69 nid 46@kfi7 refs 2
00000100:00000001:1.0:1773851905.865986:0:2494030:0:(events.c:103:reply_in_callback()) Process entered
00000400:00000200:17.0:1773851905.865987:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f2a0da5f nid 2065@kfi7 refs 2
00000100:00000001:10.0:1773851905.865987:0:41069:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:10.0:1773851905.865987:0:41069:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851905.865987:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000040:5.0:1773851905.865987:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851905.865988:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851905.865988:0:41069:0:(client.c:1428:after_reply()) Process entered
00000800:00000200:9.0:1773851905.865988:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2069@kfi7:2 <- 46@kfi7(00000000501110e9):0x0 lsk 992 rsk 4787 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851905.865988:0:41067:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000200:1.0:1773851905.865988:0:2494030:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:31.0:1773851905.865989:0:41091:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000800:00000200:17.0:1773851905.865989:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 2065@kfi7(0000000057d7cc44):0x0 lsk 1490 rsk 4785 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:10.0:1773851905.865989:0:41069:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000400:00000001:7.0:1773851905.865989:0:41067:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:31.0:1773851905.865990:0:41091:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000040:13.0:1773851905.865990:0:2514888:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851905.865990:0:41069:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000400:00000001:7.0:1773851905.865990:0:41067:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000001:31.0:1773851905.865991:0:41091:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:10.0:1773851905.865991:0:41069:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000400:00000010:7.0:1773851905.865991:0:41067:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000007398a75e.
00000100:00000001:5.0:1773851905.865991:0:41066:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000400:00000010:31.0:1773851905.865992:0:41091:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000008174bb91.
02000000:00000001:10.0:1773851905.865992:0:41069:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851905.865992:0:41067:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a17c530
00000100:00000001:5.0:1773851905.865992:0:41066:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:1.0:1773851905.865992:0:2494030:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:31.0:1773851905.865993:0:41091:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa0db5be
00000400:00000010:7.0:1773851905.865993:0:41067:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a17c530.
00000100:00000001:5.0:1773851905.865993:0:41066:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:31.0:1773851905.865994:0:41091:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa0db5be.
00000100:00001000:10.0:1773851905.865994:0:41069:0:(import.c:1951:at_measured()) add 66 to 0000000015a02373 time=138 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851905.865994:0:41067:0:(events.c:103:reply_in_callback()) Process entered
00000004:00000001:5.0:1773851905.865994:0:41066:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:31.0:1773851905.865995:0:41091:0:(events.c:103:reply_in_callback()) Process entered
00000100:00001000:10.0:1773851905.865995:0:41069:0:(import.c:1951:at_measured()) add 1 to 00000000b20673f6 time=138 v=66 (1 1 1 1)
00000004:00000040:5.0:1773851905.865995:0:41066:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000c-osc-MDT0001: Updating status = 0
00000100:00000001:13.0:1773851905.865996:0:2514888:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000200:7.0:1773851905.865996:0:41067:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:5.0:1773851905.865996:0:41066:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000c-osc-MDT0001: blocks=410399724544 free=351466039296 avail=351462933504 avail_mb=1372902084 hwm_mb=3131103 files=372062752 ffree=343228554 state=0: rc = 0
00000100:00000200:31.0:1773851905.865997:0:41091:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000400:00000200:13.0:1773851905.865997:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e0e4ec61 nid 2057@kfi7 refs 2
00000100:00000001:10.0:1773851905.865997:0:41069:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:10.0:1773851905.865998:0:41069:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:1.0:1773851905.865998:0:2494030:0:(events.c:185:reply_in_callback()) Process leaving
00000800:00000200:13.0:1773851905.865999:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 2057@kfi7(00000000cbe46564):0x0 lsk 661 rsk 4787 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00010000:00000001:10.0:1773851905.865999:0:41069:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000004:00000020:5.0:1773851905.865999:0:41066:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000c-osc-MDT0001 (00000000a2f93000): 410399724544 blocks, 351466039296 free, 351462933504 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372062752 files, 343228554 free files
00000100:00000001:2.0:1773851905.865999:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851905.865999:0:41061:0:(client.c:1798:ptlrpc_check_set()) Process entered
00010000:00000001:10.0:1773851905.866000:0:41069:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:1.0:1773851905.866000:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f670a9e2 nid 2056@kfi7 refs 2
00000100:00000001:30.0:1773851905.866001:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:10.0:1773851905.866001:0:41069:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000400:00000001:2.0:1773851905.866001:0:41061:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000200:31.0:1773851905.866002:0:41091:0:(events.c:127:reply_in_callback()) @@@ unlink  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:30.0:1773851905.866002:0:41089:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000040:10.0:1773851905.866002:0:41069:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0003-osc-MDT0001: skip recheck: last_committed 184816505018
00000100:00000200:7.0:1773851905.866002:0:41067:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000001:5.0:1773851905.866002:0:41066:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000400:00000001:2.0:1773851905.866002:0:41061:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000001:10.0:1773851905.866003:0:41069:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000400:00000010:2.0:1773851905.866003:0:41061:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000007f7464cb.
00000800:00000200:1.0:1773851905.866003:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 2056@kfi7(0000000092264688):0x0 lsk 517 rsk 4788 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
00000400:00000001:30.0:1773851905.866004:0:41089:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000100:00000001:10.0:1773851905.866004:0:41069:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:5.0:1773851905.866004:0:41066:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000200:2.0:1773851905.866004:0:41061:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000ab3765ed
00000400:00000001:30.0:1773851905.866005:0:41089:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000100:00000040:10.0:1773851905.866005:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000400:00000010:2.0:1773851905.866005:0:41061:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000ab3765ed.
00000100:00000001:31.0:1773851905.866006:0:41091:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000010:30.0:1773851905.866006:0:41089:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 00000000b35d67d7.
00000100:00000001:7.0:1773851905.866006:0:41067:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:2.0:1773851905.866006:0:41061:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:31.0:1773851905.866007:0:41091:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:30.0:1773851905.866007:0:41089:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000048340f51
00000100:00000001:7.0:1773851905.866007:0:41067:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.866008:0:41091:0:(client.c:1428:after_reply()) Process entered
00000400:00000010:30.0:1773851905.866008:0:41089:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000048340f51.
00000100:00000200:2.0:1773851905.866008:0:41061:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
02000000:00000001:31.0:1773851905.866009:0:41091:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:30.0:1773851905.866009:0:41089:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000001:7.0:1773851905.866009:0:41067:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851905.866009:0:41067:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00100000:5.0:1773851905.866009:0:41066:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000005df3e88d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_02:lustre5-MDT0001-mdtlov_UUID:41066:1859433051944128:2085@kfi7:13:default-yuba2-0
00000100:00000001:31.0:1773851905.866010:0:41091:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:10.0:1773851905.866010:0:41069:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851905.866010:0:41067:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851905.866011:0:41091:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000200:30.0:1773851905.866011:0:41089:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:10.0:1773851905.866011:0:41069:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851905.866012:0:41067:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.866012:0:41066:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:31.0:1773851905.866013:0:41091:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.866013:0:41069:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851905.866013:0:41067:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:5.0:1773851905.866013:0:41066:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000200:2.0:1773851905.866013:0:41061:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00001000:31.0:1773851905.866014:0:41091:0:(import.c:1951:at_measured()) add 66 to 00000000572dc2b8 time=138 v=66 (66 66 66 66)
00000004:00000001:10.0:1773851905.866014:0:41069:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:5.0:1773851905.866014:0:41066:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000005df3e88d x1859433051944128/t0(0) o13->lustre5-OST000c-osc-MDT0001@2085@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:10.0:1773851905.866015:0:41069:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0003-osc-MDT0001: Updating status = 0
00000100:00001000:7.0:1773851905.866015:0:41067:0:(import.c:1951:at_measured()) add 66 to 00000000f2023878 time=138 v=66 (66 66 66 66)
00000100:00001000:31.0:1773851905.866016:0:41091:0:(import.c:1951:at_measured()) add 1 to 000000000d43210e time=138 v=66 (1 1 1 1)
00000100:00000200:30.0:1773851905.866016:0:41089:0:(events.c:127:reply_in_callback()) @@@ unlink  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000004:00000040:10.0:1773851905.866016:0:41069:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0003-osc-MDT0001: blocks=410399716352 free=351382718464 avail=351380703232 avail_mb=1372580872 hwm_mb=3131101 files=371980607 ffree=343147186 state=0: rc = 0
00000100:00001000:7.0:1773851905.866017:0:41067:0:(import.c:1951:at_measured()) add 1 to 00000000a58f7023 time=138 v=66 (1 1 1 1)
00000100:00000001:2.0:1773851905.866017:0:41061:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:31.0:1773851905.866018:0:41091:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:5.0:1773851905.866018:0:41066:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:31.0:1773851905.866019:0:41091:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:10.0:1773851905.866019:0:41069:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0003-osc-MDT0001 (00000000ae415516): 410399716352 blocks, 351382718464 free, 351380703232 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,371980607 files, 343147186 free files
02000000:00000001:5.0:1773851905.866019:0:41066:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:2.0:1773851905.866019:0:41061:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:31.0:1773851905.866020:0:41091:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:7.0:1773851905.866020:0:41067:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851905.866020:0:41067:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851905.866020:0:41066:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000008ddfd792.
00000100:00000001:2.0:1773851905.866020:0:41061:0:(client.c:1428:after_reply()) Process entered
00010000:00000001:31.0:1773851905.866021:0:41091:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:10.0:1773851905.866021:0:41069:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851905.866021:0:41061:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:2.0:1773851905.866021:0:41061:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851905.866022:0:41091:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00010000:00000001:7.0:1773851905.866022:0:41067:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
02000000:00000001:5.0:1773851905.866022:0:41066:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:2.0:1773851905.866022:0:41061:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851905.866023:0:41091:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST001b-osc-MDT0001: skip recheck: last_committed 171931130542
00000100:00000040:10.0:1773851905.866023:0:41069:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00010000:00000001:7.0:1773851905.866023:0:41067:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:5.0:1773851905.866023:0:41066:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:31.0:1773851905.866024:0:41091:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:31.0:1773851905.866024:0:41091:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.866024:0:41067:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000020:00000040:5.0:1773851905.866024:0:41066:0:(genops.c:1107:class_import_put()) import 000000005b942184 refcount=2 obd=lustre5-OST000c-osc-MDT0001
02000000:00000001:2.0:1773851905.866024:0:41061:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.866025:0:41089:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000040:7.0:1773851905.866025:0:41067:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000d-osc-MDT0001: skip recheck: last_committed 159046700647
00000020:00000001:5.0:1773851905.866025:0:41066:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00001000:2.0:1773851905.866025:0:41061:0:(import.c:1951:at_measured()) add 66 to 00000000a6acfde7 time=138 v=66 (66 66 66 66)
00000100:00000040:31.0:1773851905.866026:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851905.866026:0:41089:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851905.866026:0:41067:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851905.866026:0:41067:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:5.0:1773851905.866026:0:41066:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000022c33118.
00000100:00000001:30.0:1773851905.866027:0:41089:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:5.0:1773851905.866027:0:41066:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00001000:2.0:1773851905.866027:0:41061:0:(import.c:1951:at_measured()) add 1 to 00000000eb314ae4 time=138 v=66 (1 1 1 1)
02000000:00000001:30.0:1773851905.866028:0:41089:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00100000:10.0:1773851905.866028:0:41069:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000b54598de pname:cluuid:pid:xid:nid:opc:job ptlrpcd_02_01:lustre5-MDT0001-mdtlov_UUID:41069:1859433051944320:2055@kfi7:13:default-yuba2-0
00000100:00000040:7.0:1773851905.866028:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:5.0:1773851905.866028:0:41066:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:30.0:1773851905.866029:0:41089:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000010:5.0:1773851905.866029:0:41066:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000005df3e88d.
00000100:00000001:2.0:1773851905.866029:0:41061:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:30.0:1773851905.866030:0:41089:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.866030:0:41069:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851905.866030:0:41066:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851905.866030:0:41061:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.866031:0:41091:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
02000000:00000001:30.0:1773851905.866031:0:41089:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:10.0:1773851905.866031:0:41069:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:5.0:1773851905.866031:0:41066:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851905.866031:0:41061:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00000100:00000001:31.0:1773851905.866032:0:41091:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000040:10.0:1773851905.866032:0:41069:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000b54598de x1859433051944320/t0(0) o13->lustre5-OST0003-osc-MDT0001@2055@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:5.0:1773851905.866032:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:2.0:1773851905.866032:0:41061:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851905.866033:0:41091:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00001000:30.0:1773851905.866033:0:41089:0:(import.c:1951:at_measured()) add 66 to 00000000a726bcd7 time=138 v=66 (66 66 66 66)
00000100:00000001:7.0:1773851905.866033:0:41067:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:5.0:1773851905.866033:0:41066:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:2.0:1773851905.866033:0:41061:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000004:00000001:31.0:1773851905.866034:0:41091:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:7.0:1773851905.866034:0:41067:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:5.0:1773851905.866034:0:41066:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:2.0:1773851905.866034:0:41061:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST000a-osc-MDT0001: skip recheck: last_committed 159047428657
00000004:00000040:31.0:1773851905.866035:0:41091:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST001b-osc-MDT0001: Updating status = 0
00000100:00001000:30.0:1773851905.866035:0:41089:0:(import.c:1951:at_measured()) add 1 to 00000000d3a89c4e time=138 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851905.866035:0:41067:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:5.0:1773851905.866035:0:41066:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851905.866035:0:41061:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000004:00000040:31.0:1773851905.866036:0:41091:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST001b-osc-MDT0001: blocks=410399693824 free=351464064000 avail=351458306048 avail_mb=1372884008 hwm_mb=3131101 files=372064679 ffree=343226625 state=0: rc = 0
00000100:00000001:10.0:1773851905.866036:0:41069:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000004:00000001:7.0:1773851905.866036:0:41067:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:5.0:1773851905.866036:0:41066:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.866036:0:41061:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.866037:0:41089:0:(client.c:1349:ptlrpc_check_status()) Process entered
02000000:00000001:10.0:1773851905.866037:0:41069:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000004:00000040:7.0:1773851905.866037:0:41067:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000d-osc-MDT0001: Updating status = 0
00000100:00000001:30.0:1773851905.866038:0:41089:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:10.0:1773851905.866038:0:41069:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000e85052a5.
00000004:00000040:7.0:1773851905.866038:0:41067:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000d-osc-MDT0001: blocks=410399721472 free=351489073152 avail=351486046208 avail_mb=1372992368 hwm_mb=3131103 files=372066702 ffree=343251048 state=0: rc = 0
00000100:00000040:2.0:1773851905.866038:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000020:31.0:1773851905.866039:0:41091:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST001b-osc-MDT0001 (00000000283e125f): 410399693824 blocks, 351464064000 free, 351458306048 avail, 4096 bsize, 1565550 reserved mb low, 3131101 reserved mb high,372064679 files, 343226625 free files
00010000:00000001:30.0:1773851905.866039:0:41089:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:30.0:1773851905.866040:0:41089:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851905.866040:0:41069:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000004:00000001:31.0:1773851905.866041:0:41091:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.866041:0:41089:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000020:00000001:10.0:1773851905.866041:0:41069:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:10.0:1773851905.866041:0:41069:0:(genops.c:1107:class_import_put()) import 00000000f44a2c65 refcount=15 obd=lustre5-OST0003-osc-MDT0001
00000100:00000040:30.0:1773851905.866042:0:41089:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0014-osc-MDT0001: skip recheck: last_committed 193406616685
00000004:00000020:7.0:1773851905.866042:0:41067:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000d-osc-MDT0001 (00000000bdce700a): 410399721472 blocks, 351489073152 free, 351486046208 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372066702 files, 343251048 free files
00000100:00000001:2.0:1773851905.866042:0:41061:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000040:31.0:1773851905.866043:0:41091:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:30.0:1773851905.866043:0:41089:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000020:00000001:10.0:1773851905.866043:0:41069:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:10.0:1773851905.866043:0:41069:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000623b0925.
00000100:00000001:2.0:1773851905.866043:0:41061:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851905.866044:0:41089:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.866044:0:41061:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000040:30.0:1773851905.866045:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:10.0:1773851905.866045:0:41069:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000004:00000001:7.0:1773851905.866045:0:41067:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:10.0:1773851905.866046:0:41069:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:10.0:1773851905.866046:0:41069:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000b54598de.
00000004:00000001:2.0:1773851905.866046:0:41061:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000040:7.0:1773851905.866047:0:41067:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000040:2.0:1773851905.866047:0:41061:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST000a-osc-MDT0001: Updating status = 0
00000100:00100000:31.0:1773851905.866048:0:41091:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@000000007d05b48c pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_03:lustre5-MDT0001-mdtlov_UUID:41091:1859433051944448:2065@kfi7:13:default-yuba2-0
00000100:00000001:10.0:1773851905.866048:0:41069:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:10.0:1773851905.866048:0:41069:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000004:00000040:2.0:1773851905.866048:0:41061:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST000a-osc-MDT0001: blocks=410399721472 free=351406456832 avail=351404151808 avail_mb=1372672468 hwm_mb=3131103 files=372127031 ffree=343170368 state=0: rc = 0
00000100:00000001:10.0:1773851905.866049:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851905.866050:0:41091:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851905.866050:0:41089:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:10.0:1773851905.866051:0:41069:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:10.0:1773851905.866051:0:41069:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000004:00000020:2.0:1773851905.866051:0:41061:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST000a-osc-MDT0001 (0000000050ebbc9b): 410399721472 blocks, 351406456832 free, 351404151808 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372127031 files, 343170368 free files
00000100:00000001:31.0:1773851905.866052:0:41091:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:30.0:1773851905.866052:0:41089:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:30.0:1773851905.866052:0:41089:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:10.0:1773851905.866052:0:41069:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00100000:7.0:1773851905.866052:0:41067:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000024253d81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_03:lustre5-MDT0001-mdtlov_UUID:41067:1859433051944192:46@kfi7:13:default-yuba2-0
00000100:00000040:31.0:1773851905.866053:0:41091:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@000000007d05b48c x1859433051944448/t0(0) o13->lustre5-OST001b-osc-MDT0001@2065@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000004:00000001:30.0:1773851905.866053:0:41089:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000100:00000001:10.0:1773851905.866053:0:41069:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851905.866054:0:41067:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:2.0:1773851905.866054:0:41061:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000004:00000040:30.0:1773851905.866055:0:41089:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0014-osc-MDT0001: Updating status = 0
00000100:00000001:7.0:1773851905.866055:0:41067:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000004:00000040:30.0:1773851905.866056:0:41089:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0014-osc-MDT0001: blocks=410399727616 free=351545848832 avail=351536240640 avail_mb=1373188440 hwm_mb=3131103 files=372116347 ffree=343306493 state=0: rc = 0
00000100:00000040:2.0:1773851905.866056:0:41061:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:31.0:1773851905.866057:0:41091:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000040:7.0:1773851905.866057:0:41067:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000024253d81 x1859433051944192/t0(0) o13->lustre5-OST000d-osc-MDT0001@46@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851905.866058:0:41091:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:31.0:1773851905.866059:0:41091:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000001a23e593.
00000004:00000020:30.0:1773851905.866059:0:41089:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0014-osc-MDT0001 (00000000f826143f): 410399727616 blocks, 351545848832 free, 351536240640 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372116347 files, 343306493 free files
02000000:00000001:31.0:1773851905.866061:0:41091:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:7.0:1773851905.866061:0:41067:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00100000:2.0:1773851905.866061:0:41061:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000d5ef0100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre5-MDT0001-mdtlov_UUID:41061:1859433051944256:2057@kfi7:13:default-yuba2-0
00000020:00000001:31.0:1773851905.866062:0:41091:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:31.0:1773851905.866062:0:41091:0:(genops.c:1107:class_import_put()) import 000000002802f54d refcount=2 obd=lustre5-OST001b-osc-MDT0001
00000004:00000001:30.0:1773851905.866062:0:41089:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851905.866062:0:41067:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851905.866063:0:41067:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b2b64901.
00000100:00000001:2.0:1773851905.866063:0:41061:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851905.866064:0:41091:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:31.0:1773851905.866064:0:41091:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000075d6ffad.
00000100:00000040:30.0:1773851905.866064:0:41089:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:2.0:1773851905.866064:0:41061:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
02000000:00000001:7.0:1773851905.866065:0:41067:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
02000000:00000001:31.0:1773851905.866066:0:41091:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000020:00000001:7.0:1773851905.866066:0:41067:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000040:2.0:1773851905.866066:0:41061:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000d5ef0100 x1859433051944256/t0(0) o13->lustre5-OST000a-osc-MDT0001@2057@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
02000000:00000001:31.0:1773851905.866067:0:41091:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:31.0:1773851905.866068:0:41091:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 000000007d05b48c.
00000100:00000001:31.0:1773851905.866069:0:41091:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00100000:30.0:1773851905.866069:0:41089:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@00000000ec1b16b5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_07_01:lustre5-MDT0001-mdtlov_UUID:41089:1859433051944384:2056@kfi7:13:default-yuba2-0
00000020:00000040:7.0:1773851905.866069:0:41067:0:(genops.c:1107:class_import_put()) import 000000008b68a823 refcount=9 obd=lustre5-OST000d-osc-MDT0001
00000100:00000001:31.0:1773851905.866070:0:41091:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851905.866070:0:41067:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:2.0:1773851905.866070:0:41061:0:(client.c:2578:__ptlrpc_free_req()) Process entered
00000100:00000001:31.0:1773851905.866071:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:7.0:1773851905.866071:0:41067:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000035adc4a4.
02000000:00000001:2.0:1773851905.866071:0:41061:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:31.0:1773851905.866072:0:41091:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
02000000:00000001:7.0:1773851905.866072:0:41067:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000010:2.0:1773851905.866072:0:41061:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 000000005f97961b.
00000100:00000001:31.0:1773851905.866073:0:41091:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.866073:0:41089:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:7.0:1773851905.866073:0:41067:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000001:31.0:1773851905.866074:0:41091:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000010:7.0:1773851905.866074:0:41067:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000024253d81.
02000000:00000001:2.0:1773851905.866074:0:41061:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:2.0:1773851905.866074:0:41061:0:(genops.c:1101:class_import_put()) Process entered
00000100:00000001:31.0:1773851905.866075:0:41091:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.866075:0:41089:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000001:7.0:1773851905.866075:0:41067:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000020:00000040:2.0:1773851905.866075:0:41061:0:(genops.c:1107:class_import_put()) import 000000004d57f306 refcount=4 obd=lustre5-OST000a-osc-MDT0001
00000100:00000040:30.0:1773851905.866076:0:41089:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@00000000ec1b16b5 x1859433051944384/t0(0) o13->lustre5-OST0014-osc-MDT0001@2056@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852058 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851905.866076:0:41067:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:2.0:1773851905.866076:0:41061:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:7.0:1773851905.866077:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
02000000:00000010:2.0:1773851905.866077:0:41061:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 0000000028bed4d2.
00000100:00000001:7.0:1773851905.866078:0:41067:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851905.866079:0:41067:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:2.0:1773851905.866079:0:41061:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
00000100:00000001:30.0:1773851905.866080:0:41089:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:30.0:1773851905.866080:0:41089:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
00000100:00000001:7.0:1773851905.866080:0:41067:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
02000000:00000001:2.0:1773851905.866080:0:41061:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:2.0:1773851905.866080:0:41061:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000d5ef0100.
02000000:00000010:30.0:1773851905.866081:0:41089:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000811c6a94.
00000100:00000001:7.0:1773851905.866081:0:41067:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851905.866082:0:41061:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:2.0:1773851905.866082:0:41061:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
02000000:00000001:30.0:1773851905.866083:0:41089:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000100:00000001:2.0:1773851905.866083:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:30.0:1773851905.866084:0:41089:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:30.0:1773851905.866085:0:41089:0:(genops.c:1107:class_import_put()) import 00000000f2730b1b refcount=2 obd=lustre5-OST0014-osc-MDT0001
00000100:00000001:2.0:1773851905.866085:0:41061:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000020:00000001:30.0:1773851905.866086:0:41089:0:(genops.c:1114:class_import_put()) Process leaving
00000100:00000001:2.0:1773851905.866086:0:41061:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:30.0:1773851905.866087:0:41089:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000db9c2666.
00000100:00000001:2.0:1773851905.866087:0:41061:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:2.0:1773851905.866087:0:41061:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:30.0:1773851905.866088:0:41089:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:30.0:1773851905.866089:0:41089:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:30.0:1773851905.866090:0:41089:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 00000000ec1b16b5.
00000100:00000001:30.0:1773851905.866092:0:41089:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:30.0:1773851905.866092:0:41089:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851905.866093:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:30.0:1773851905.866095:0:41089:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:30.0:1773851905.866096:0:41089:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:30.0:1773851905.866097:0:41089:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:30.0:1773851905.866097:0:41089:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851905.877123:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851905.877124:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851905.877125:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851905.877127:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851905.877130:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.877131:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17538@kfi7 : PUT - for me
00000400:00000200:21.0:1773851905.877132:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.877132:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 1
00000400:00000200:21.0:1773851905.877134:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:21.0:1773851905.877135:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000400:00000200:21.0:1773851905.877136:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 3
00000400:00000200:21.0:1773851905.877137:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17539@kfi7 to cpt 0
00000400:00000200:21.0:1773851905.877138:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17539@kfi7 of length 224 into portal 12 MB=0x69b4be63eb000
00000400:00000200:21.0:1773851905.877139:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17539@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 72648
00000800:00000200:21.0:1773851905.877141:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851905.877143:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.877144:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17538@kfi7: PUT: OK
00000100:00000001:21.0:1773851905.877145:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851905.877145:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851905.877146:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c6260c54.
00000100:00000040:21.0:1773851905.877147:0:2494373:0:(events.c:358:request_in_callback()) incoming req@00000000c6260c54 x1859600147984384 msgsize 224
00000100:00100000:21.0:1773851905.877148:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-17539@kfi7 (source: 12345-17538@kfi7)
00000100:00000001:21.0:1773851905.877149:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851905.877150:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000100:00000001:20.0:1773851905.877150:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851905.877151:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851905.877151:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:21.0:1773851905.877152:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:20.0:1773851905.877152:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851905.877154:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851905.877154:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859600147984384
00000020:00000001:20.0:1773851905.877155:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851905.877156:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d82188
00000020:00000001:20.0:1773851905.877156:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851905.877161:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000687debe3 refcount=2660
00000020:00000001:20.0:1773851905.877162:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637157028238336 : -106916681313280 : ffff9ec285309400)
00000020:00000001:20.0:1773851905.877162:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637157028238336 : -106916681313280 : ffff9ec285309400)
00000100:00000001:20.0:1773851905.877163:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.877164:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851905.877165:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005f9598dd.
00000020:00000010:20.0:1773851905.877166:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.877167:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008b2657fc.
00000100:00000001:20.0:1773851905.877168:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851905.877168:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851905.877169:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851905.877170:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851905.877171:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851905.877171:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.877172:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851905.877173:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851905.877174:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851905.877174:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851905.877174:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851905.877175:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17539@kfi7, seq: 1998102
00000100:00000001:23.0:1773851905.877176:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.877176:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000687debe3 : new rpc_count 8
00000100:00000001:20.0:1773851905.877177:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313405056 : -106917396146560 : ffff9ec25a951680)
00000100:00000040:20.0:1773851905.877178:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c6260c54 x1859600147984384/t0(0) o400->e821b58d-0b5a-422e-ace5-6066ed9bda6c@17539@kfi7:632/0 lens 224/0 e 0 to 0 dl 1773851992 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1592-0'
00000100:00000001:23.0:1773851905.877179:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.877180:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851905.877181:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851905.877182:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c6260c54 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e821b58d-0b5a-422e-ace5-6066ed9bda6c+2660:39511:x1859600147984384:12345-17539@kfi7:400:default-tuolumne1592-0
00000100:00000200:20.0:1773851905.877183:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859600147984384
00000020:00000001:20.0:1773851905.877184:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851905.877185:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851905.877185:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.877186:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851905.877187:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851905.877187:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851905.877188:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859600147984384, found 0 last_xid 1859600147284031
00000020:00000001:20.0:1773851905.877189:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851905.877190:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851905.877190:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851905.877191:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.877191:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851905.877192:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851905.877192:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851905.877194:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000001711cfa9.
02000000:00000001:20.0:1773851905.877195:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.877196:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.877196:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851905.877197:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264582885, transno 0, xid 1859600147984384
00010000:00000001:20.0:1773851905.877198:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851905.877199:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c6260c54 x1859600147984384/t0(0) o400->e821b58d-0b5a-422e-ace5-6066ed9bda6c@17539@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1592-0'
00010000:00000001:20.0:1773851905.877201:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851905.877202:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851905.877202:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=138 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851905.877204:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851905.877204:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000056a3bbea refcount 3 to 17539@kfi7
00000100:00000001:20.0:1773851905.877205:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958006016 : -107146751545600 : ffff9e8cf3ef6f00)
02000000:00000001:20.0:1773851905.877206:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851905.877206:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851905.877207:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851905.877208:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17538@kfi7
00000400:00000010:20.0:1773851905.877208:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000056b73a04.
00000100:00000200:20.0:1773851905.877209:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859600147984384, offset 224
00000400:00000200:20.0:1773851905.877211:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17538@kfi7
00000400:00000200:20.0:1773851905.877211:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.877212:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 1
00000400:00000200:20.0:1773851905.877213:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000400:00000200:20.0:1773851905.877215:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 3
00000400:00000200:20.0:1773851905.877216:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17538@kfi7 local destination
00000400:00000200:20.0:1773851905.877217:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770561:8770561:1024:4294967295] 17538@kfi7 LPNI seq info [16807487:16807487:16:4294967295]
00000400:00000200:20.0:1773851905.877218:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000400:00000200:20.0:1773851905.877219:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17538@kfi7 to cpt 5
00000400:00000200:20.0:1773851905.877221:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17538@kfi7(17538@kfi7:17538@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851905.877222:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 3
00000800:00000200:20.0:1773851905.877223:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851905.877224:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851905.877226:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851905.877229:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001014 Using peer 17538@kfi7(0x100000000001014)
00000800:00000200:20.0:1773851905.877232:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x100000000001014: rc=0
00000800:00000200:20.0:1773851905.877233:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001014 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851905.877235:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851905.877236:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000056a3bbea refcount 2 to 17539@kfi7
00010000:00000001:20.0:1773851905.877237:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851905.877237:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851905.877238:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851905.877238:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c6260c54 x1859600147984384/t0(0) o400->e821b58d-0b5a-422e-ace5-6066ed9bda6c@17539@kfi7:632/0 lens 224/224 e 0 to 0 dl 1773851992 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1592-0'
00000100:00100000:20.0:1773851905.877242:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c6260c54 pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:e821b58d-0b5a-422e-ace5-6066ed9bda6c+2660:39511:x1859600147984384:12345-17539@kfi7:400:default-tuolumne1592-0 Request processed in 60us (94us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851905.877244:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17539@kfi7, seq: 1998102
00000100:00000040:20.0:1773851905.877245:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000687debe3 : new rpc_count 7
00000100:00000001:20.0:1773851905.877246:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851905.877247:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851905.877247:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851905.877248:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008b2657fc.
00000020:00000010:20.0:1773851905.877249:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005f9598dd.
00000020:00000040:20.0:1773851905.877249:0:60934:0:(genops.c:882:class_export_put()) PUTting export 00000000687debe3 : new refcount 2659
00000100:00000001:20.0:1773851905.877250:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851905.877255:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001014 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851905.877256:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851905.877257:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17538@kfi7: PUT: OK
00000400:00000200:21.0:1773851905.877258:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000056b73a04
00000400:00000010:21.0:1773851905.877259:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000056b73a04.
00000100:00000001:21.0:1773851905.877260:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851905.877260:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851905.877261:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000062ad410d nid 17538@kfi7 refs 2
00000800:00000200:21.0:1773851905.877262:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2054@kfi7:5 -> 17538@kfi7(000000004f142464):0x0 lsk 4117 rsk 19 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000001014 Transaction freed
00000400:00000200:29.0:1773851905.929737:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.20@tcp(000000001e7ab870) kfi7(00000000bbedff81) next ping 1773851929
00000400:00000200:29.0:1773851905.929739:0:34579:0:(router.c:1217:lnet_check_routers()) rtr 172.16.94.21@tcp(000000007a7ee94a) kfi7(00000000f027a047) next ping 1773851929
00000800:00000200:25.0:1773851905.939751:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851905.939753:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851905.939755:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851905.939759:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851905.939762:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.939764:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23840@kfi7 : PUT - for me
00000400:00000200:25.0:1773851905.939766:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.939768:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 1
00000400:00000200:25.0:1773851905.939770:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:25.0:1773851905.939771:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000400:00000200:25.0:1773851905.939773:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 3
00000400:00000200:25.0:1773851905.939775:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24032@kfi7 to cpt 1
00000400:00000200:25.0:1773851905.939776:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24032@kfi7 of length 224 into portal 12 MB=0x69b4756451a00
00000400:00000200:25.0:1773851905.939779:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24032@kfi7 of length 224/224 into md 0x16159c9699 [64] + 48096
00000800:00000200:25.0:1773851905.939782:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851905.939785:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.939787:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23840@kfi7: PUT: OK
00000100:00000001:25.0:1773851905.939788:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851905.939789:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851905.939791:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ff9e687a.
00000100:00000040:25.0:1773851905.939793:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000ff9e687a x1859580552616448 msgsize 224
00000100:00100000:25.0:1773851905.939795:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24032@kfi7 (source: 12345-23840@kfi7)
00000100:00000001:25.0:1773851905.939797:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851905.939799:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000100:00000001:24.0:1773851905.939800:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851905.939801:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851905.939801:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851905.939802:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851905.939803:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851905.939804:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851905.939805:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859580552616448
00000020:00000001:24.0:1773851905.939806:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851905.939807:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddd0109eb
00000020:00000001:24.0:1773851905.939808:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851905.939811:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000044bea927 refcount=5
00000020:00000001:24.0:1773851905.939813:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637077288256512 : -106996421295104 : ffff9eaff4510400)
00000020:00000001:24.0:1773851905.939815:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637077288256512 : -106996421295104 : ffff9eaff4510400)
00000100:00000001:24.0:1773851905.939817:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.939818:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851905.939819:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851905.939820:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.939822:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851905.939823:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851905.939824:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851905.939825:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851905.939827:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851905.939830:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851905.939831:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.939833:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851905.939835:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851905.939835:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851905.939836:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851905.939836:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851905.939838:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24032@kfi7, seq: 2025205
00000100:00000001:26.0:1773851905.939839:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.939839:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000044bea927 : new rpc_count 1
00000100:00000001:26.0:1773851905.939840:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.939840:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636996227522176 : -107077482029440 : ffff9e9d14b85e80)
00000100:00000040:24.0:1773851905.939843:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ff9e687a x1859580552616448/t0(0) o400->28c7b5db-3e42-4937-9833-2cefd799bdeb@24032@kfi7:186/0 lens 224/0 e 0 to 0 dl 1773852301 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1983-0'
00000100:00000001:24.0:1773851905.939848:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851905.939849:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851905.939850:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ff9e687a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:28c7b5db-3e42-4937-9833-2cefd799bdeb+5:39822:x1859580552616448:12345-24032@kfi7:400:default-tuolumne1983-0
00000100:00000200:24.0:1773851905.939853:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859580552616448
00000020:00000001:24.0:1773851905.939854:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851905.939855:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851905.939856:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.939857:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851905.939858:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851905.939859:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851905.939860:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859580552616448, found 0 last_xid 1859580552616447
00000020:00000001:24.0:1773851905.939862:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851905.939863:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851905.939864:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851905.939865:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.939866:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851905.939867:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851905.939868:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851905.939869:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004ba9dbd9.
02000000:00000001:24.0:1773851905.939870:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.939871:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.939872:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851905.939873:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182915824229, transno 0, xid 1859580552616448
00010000:00000001:24.0:1773851905.939875:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851905.939877:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ff9e687a x1859580552616448/t0(0) o400->28c7b5db-3e42-4937-9833-2cefd799bdeb@24032@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1983-0'
00010000:00000001:24.0:1773851905.939881:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851905.939882:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851905.939883:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=138 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851905.939884:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851905.939886:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001b3bf362 refcount 3 to 24032@kfi7
00000100:00000001:24.0:1773851905.939887:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636943232981536 : -107130476570080 : ffff9e90bdffda20)
02000000:00000001:24.0:1773851905.939888:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851905.939889:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851905.939890:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851905.939891:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23840@kfi7
00000400:00000010:24.0:1773851905.939892:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000098854375.
00000100:00000200:24.0:1773851905.939893:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859580552616448, offset 224
00000400:00000200:24.0:1773851905.939895:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23840@kfi7
00000400:00000200:24.0:1773851905.939897:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.939898:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 1
00000400:00000200:24.0:1773851905.939899:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000400:00000200:24.0:1773851905.939902:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 3
00000400:00000200:24.0:1773851905.939903:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23840@kfi7 local destination
00000400:00000200:24.0:1773851905.939905:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770562:8770562:1024:4294967295] 23840@kfi7 LPNI seq info [12932518:12932518:16:4294967295]
00000400:00000200:24.0:1773851905.939908:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000400:00000200:24.0:1773851905.939909:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23840@kfi7 to cpt 6
00000400:00000200:24.0:1773851905.939912:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23840@kfi7(23840@kfi7:23840@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851905.939914:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 3
00000800:00000200:24.0:1773851905.939916:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851905.939918:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851905.939921:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851905.939927:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8c Using peer 23840@kfi7(0xc8c)
00000800:00000200:24.0:1773851905.939931:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 0000000067401146: Posted send of 324 bytes to peer 0xc8c: rc=0
00000800:00000200:24.0:1773851905.939934:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851905.939937:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851905.939938:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001b3bf362 refcount 2 to 24032@kfi7
00010000:00000001:24.0:1773851905.939939:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851905.939940:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851905.939943:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851905.939944:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ff9e687a x1859580552616448/t0(0) o400->28c7b5db-3e42-4937-9833-2cefd799bdeb@24032@kfi7:186/0 lens 224/224 e 0 to 0 dl 1773852301 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1983-0'
00000100:00100000:24.0:1773851905.939949:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ff9e687a pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:28c7b5db-3e42-4937-9833-2cefd799bdeb+5:39822:x1859580552616448:12345-24032@kfi7:400:default-tuolumne1983-0 Request processed in 100us (155us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851905.939953:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24032@kfi7, seq: 2025205
00000100:00000040:24.0:1773851905.939954:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000044bea927 : new rpc_count 0
00000100:00000001:24.0:1773851905.939955:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851905.939956:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851905.939957:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851905.939958:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851905.939959:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851905.939960:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000044bea927 : new refcount 4
00000100:00000001:24.0:1773851905.939962:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851905.939969:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851905.939971:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851905.939973:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23840@kfi7: PUT: OK
00000400:00000200:25.0:1773851905.939974:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000098854375
00000400:00000010:25.0:1773851905.939975:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000098854375.
00000100:00000001:25.0:1773851905.939976:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851905.939976:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851905.939977:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000cfb1b406 nid 23840@kfi7 refs 2
00000800:00000200:25.0:1773851905.939980:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000067401146: 2069@kfi7:6 -> 23840@kfi7(000000008c32458c):0x0 lsk 3213 rsk 6 tsk 0 trmk 0 tmk 0 trr 6 tta 0xc8c Transaction freed
00000800:00000200:30.0:1773851906.003358:0:2472963:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:30.0:1773851906.003359:0:2472963:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:30.0:1773851906.003361:0:2472963:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:30.0:1773851906.003363:0:2472963:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:30.0:1773851906.003365:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:30.0:1773851906.003366:0:2472963:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 19586@kfi7 : PUT - for me
00000400:00000200:30.0:1773851906.003367:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:30.0:1773851906.003369:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 1
00000400:00000200:30.0:1773851906.003370:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:30.0:1773851906.003371:0:2472963:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000400:00000200:30.0:1773851906.003372:0:2472963:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 3
00000400:00000200:30.0:1773851906.003373:0:2472963:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19522@kfi7 to cpt 4
00000400:00000200:30.0:1773851906.003374:0:2472963:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-19522@kfi7 of length 224 into portal 12 MB=0x699e184a4a2c0
00000400:00000200:30.0:1773851906.003376:0:2472963:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-19522@kfi7 of length 224/224 into md 0x77fe1859d [64] + 19888
00000800:00000200:30.0:1773851906.003378:0:2472963:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:30.0:1773851906.003380:0:2472963:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:30.0:1773851906.003381:0:2472963:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19586@kfi7: PUT: OK
00000100:00000001:30.0:1773851906.003382:0:2472963:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:30.0:1773851906.003382:0:2472963:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:30.0:1773851906.003383:0:2472963:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a88e84d.
00000100:00000040:30.0:1773851906.003384:0:2472963:0:(events.c:358:request_in_callback()) incoming req@000000001a88e84d x1858043732337344 msgsize 224
00000100:00100000:30.0:1773851906.003385:0:2472963:0:(events.c:361:request_in_callback()) peer: 12345-19522@kfi7 (source: 12345-19586@kfi7)
00000100:00000001:30.0:1773851906.003386:0:2472963:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:30.0:1773851906.003387:0:2472963:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000100:00000001:31.0:1773851906.003388:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851906.003388:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:30.0:1773851906.003388:0:2472963:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000bfd826e8: 2069@kfi7:7 <- 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851906.003389:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851906.003389:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851906.003390:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851906.003391:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858043732337344
00000020:00000001:31.0:1773851906.003391:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851906.003392:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92482
00000020:00000001:31.0:1773851906.003393:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851906.003395:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002cf1246b refcount=6
00000020:00000001:31.0:1773851906.003395:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950630529024 : -107123079022592 : ffff9e9276ed7800)
00000020:00000001:31.0:1773851906.003397:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950630529024 : -107123079022592 : ffff9e9276ed7800)
00000100:00000001:31.0:1773851906.003398:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851906.003399:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851906.003399:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000049fc09bd.
00000020:00000010:31.0:1773851906.003400:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851906.003401:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851906.003402:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851906.003402:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851906.003403:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851906.003404:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851906.003405:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851906.003405:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.003406:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851906.003407:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851906.003407:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851906.003408:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851906.003408:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-19522@kfi7, seq: 2055629
00000100:00000001:28.0:1773851906.003408:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:31.0:1773851906.003409:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002cf1246b : new rpc_count 1
00000100:00000001:28.0:1773851906.003409:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.003410:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637113411248000 : -106960298303616 : ffff9eb85d6a1f80)
00000100:00000001:28.0:1773851906.003410:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851906.003411:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a88e84d x1858043732337344/t0(0) o400->203b0707-8946-4ab9-bf3b-e60dd2992146@19522@kfi7:694/0 lens 224/0 e 0 to 0 dl 1773852054 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1720-0'
00000100:00000001:31.0:1773851906.003414:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851906.003414:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851906.003415:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a88e84d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:203b0707-8946-4ab9-bf3b-e60dd2992146+6:39748:x1858043732337344:12345-19522@kfi7:400:default-tuolumne1720-0
00000100:00000200:31.0:1773851906.003416:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858043732337344
00000020:00000001:31.0:1773851906.003417:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851906.003417:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851906.003418:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.003419:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851906.003419:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851906.003420:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851906.003421:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858043732337344, found 0 last_xid 1858043732337343
00000020:00000001:31.0:1773851906.003422:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851906.003423:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851906.003424:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851906.003424:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.003425:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851906.003426:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851906.003426:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851906.003427:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000b5c2f7ef.
02000000:00000001:31.0:1773851906.003428:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.003428:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.003429:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851906.003430:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183243430305, transno 0, xid 1858043732337344
00010000:00000001:31.0:1773851906.003430:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851906.003431:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a88e84d x1858043732337344/t0(0) o400->203b0707-8946-4ab9-bf3b-e60dd2992146@19522@kfi7:694/0 lens 224/224 e 0 to 0 dl 1773852054 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1720-0'
00010000:00000001:31.0:1773851906.003434:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851906.003434:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851906.003435:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=139 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851906.003436:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851906.003437:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000097ed30be refcount 3 to 19522@kfi7
00000100:00000001:31.0:1773851906.003437:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583546048 : -107156126005568 : ffff9e8ac52c86c0)
02000000:00000001:31.0:1773851906.003438:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851906.003439:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.003439:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851906.003440:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-19586@kfi7
00000400:00000010:31.0:1773851906.003441:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000fa0db5be.
00000100:00000200:31.0:1773851906.003442:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858043732337344, offset 224
00000400:00000200:31.0:1773851906.003443:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-19586@kfi7
00000400:00000200:31.0:1773851906.003444:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:31.0:1773851906.003445:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 1
00000400:00000200:31.0:1773851906.003446:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000400:00000200:31.0:1773851906.003447:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 3
00000400:00000200:31.0:1773851906.003448:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  19586@kfi7 local destination
00000400:00000200:31.0:1773851906.003449:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770563:8770563:1024:4294967295] 19586@kfi7 LPNI seq info [4566818:4566818:16:4294967295]
00000400:00000200:31.0:1773851906.003451:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000400:00000200:31.0:1773851906.003452:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 19586@kfi7 to cpt 7
00000400:00000200:31.0:1773851906.003454:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 19586@kfi7(19586@kfi7:19586@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851906.003455:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 3
00000800:00000200:31.0:1773851906.003456:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851906.003457:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851906.003459:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851906.003462:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ee Using peer 19586@kfi7(0x6ee)
00000800:00000200:31.0:1773851906.003465:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 000000003c4a6e41: Posted send of 324 bytes to peer 0x6ee: rc=0
00000800:00000200:31.0:1773851906.003466:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ee TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851906.003468:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851906.003469:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000097ed30be refcount 2 to 19522@kfi7
00010000:00000001:31.0:1773851906.003470:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851906.003470:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.003471:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851906.003472:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a88e84d x1858043732337344/t0(0) o400->203b0707-8946-4ab9-bf3b-e60dd2992146@19522@kfi7:694/0 lens 224/224 e 0 to 0 dl 1773852054 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1720-0'
00000100:00100000:31.0:1773851906.003474:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a88e84d pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:203b0707-8946-4ab9-bf3b-e60dd2992146+6:39748:x1858043732337344:12345-19522@kfi7:400:default-tuolumne1720-0 Request processed in 60us (90us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851906.003477:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-19522@kfi7, seq: 2055629
00000100:00000040:31.0:1773851906.003477:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002cf1246b : new rpc_count 0
00000100:00000001:31.0:1773851906.003478:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851906.003478:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000800:00000200:29.0:1773851906.003478:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ee TN_EVENT_TX_OK event status 0
00000020:00000010:31.0:1773851906.003479:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851906.003480:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000400:00000200:29.0:1773851906.003480:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851906.003481:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000049fc09bd.
00000020:00000040:31.0:1773851906.003481:0:60677:0:(genops.c:882:class_export_put()) PUTting export 000000002cf1246b : new refcount 5
00000400:00000200:29.0:1773851906.003481:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->19586@kfi7: PUT: OK
00000100:00000001:31.0:1773851906.003482:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:29.0:1773851906.003482:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000fa0db5be
00000400:00000010:29.0:1773851906.003482:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000fa0db5be.
00000100:00000001:29.0:1773851906.003483:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851906.003483:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851906.003484:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000dae0a10c nid 19586@kfi7 refs 2
00000800:00000200:29.0:1773851906.003485:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000003c4a6e41: 2069@kfi7:7 -> 19586@kfi7(000000003e373843):0x0 lsk 1775 rsk 49 tsk 0 trmk 0 tmk 0 trr 7 tta 0x6ee Transaction freed
00000800:00000200:18.0:1773851906.047770:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851906.047771:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851906.047772:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851906.047774:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851906.047776:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.047778:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17009@kfi7 : PUT - for me
00000400:00000200:18.0:1773851906.047778:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.047780:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 1
00000400:00000200:18.0:1773851906.047781:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.047782:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000400:00000200:18.0:1773851906.047783:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 3
00000400:00000200:18.0:1773851906.047784:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17008@kfi7 to cpt 1
00000400:00000200:18.0:1773851906.047784:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17008@kfi7 of length 224 into portal 12 MB=0x69b4b5abb7840
00000400:00000200:18.0:1773851906.047786:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17008@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 52928
00000800:00000200:18.0:1773851906.047788:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851906.047790:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851906.047791:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17009@kfi7: PUT: OK
00000100:00000001:18.0:1773851906.047792:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851906.047792:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851906.047793:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001159dfcd.
00000100:00000040:18.0:1773851906.047794:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000001159dfcd x1859597807351872 msgsize 224
00000100:00100000:18.0:1773851906.047796:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-17008@kfi7 (source: 12345-17009@kfi7)
00000100:00000001:18.0:1773851906.047797:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851906.047798:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000100:00000001:19.0:1773851906.047799:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851906.047799:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851906.047799:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851906.047800:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851906.047800:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851906.047801:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851906.047802:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597807351872
00000020:00000001:19.0:1773851906.047803:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851906.047803:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d822fb
00000020:00000001:19.0:1773851906.047804:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851906.047809:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d4a35379 refcount=167
00000020:00000001:19.0:1773851906.047809:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131280826368 : -106942428725248 : ffff9ebc86864000)
00000020:00000001:19.0:1773851906.047810:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131280826368 : -106942428725248 : ffff9ebc86864000)
00000100:00000001:19.0:1773851906.047811:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851906.047812:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851906.047815:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000301e8f40.
00000020:00000010:19.0:1773851906.047817:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851906.047817:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851906.047818:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851906.047819:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851906.047819:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.047820:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851906.047820:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851906.047821:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.047822:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.047823:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851906.047824:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851906.047824:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851906.047824:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851906.047825:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17008@kfi7, seq: 2156457
00000100:00000040:19.0:1773851906.047826:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d4a35379 : new rpc_count 1
00000100:00000001:19.0:1773851906.047826:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609989632 : -107015099561984 : ffff9eab9b014800)
00000100:00000001:16.0:1773851906.047826:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851906.047827:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001159dfcd x1859597807351872/t0(0) o400->2f6dbe94-2578-485e-84cf-f4e45b43989a@17008@kfi7:158/0 lens 224/0 e 0 to 0 dl 1773852273 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1550-0'
00000100:00000001:16.0:1773851906.047827:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.047830:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851906.047830:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851906.047832:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001159dfcd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2f6dbe94-2578-485e-84cf-f4e45b43989a+167:39573:x1859597807351872:12345-17008@kfi7:400:default-tuolumne1550-0
00000100:00000200:19.0:1773851906.047833:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597807351872
00000020:00000001:19.0:1773851906.047834:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851906.047834:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851906.047835:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.047836:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851906.047836:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851906.047837:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851906.047838:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597807351872, found 0 last_xid 1859597806928447
00000020:00000001:19.0:1773851906.047838:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851906.047839:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851906.047840:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851906.047840:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.047841:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851906.047842:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851906.047842:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851906.047843:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004c3edeb1.
02000000:00000001:19.0:1773851906.047844:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.047844:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.047845:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851906.047846:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062262, transno 0, xid 1859597807351872
00010000:00000001:19.0:1773851906.047846:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851906.047847:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001159dfcd x1859597807351872/t0(0) o400->2f6dbe94-2578-485e-84cf-f4e45b43989a@17008@kfi7:158/0 lens 224/224 e 0 to 0 dl 1773852273 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1550-0'
00010000:00000001:19.0:1773851906.047849:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851906.047850:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851906.047851:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=139 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851906.047852:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851906.047852:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cea9c403 refcount 3 to 17008@kfi7
00000100:00000001:19.0:1773851906.047853:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636919740764000 : -107153968787616 : ffff9e8b45c10f60)
02000000:00000001:19.0:1773851906.047854:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851906.047854:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.047855:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851906.047856:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17009@kfi7
00000400:00000010:19.0:1773851906.047857:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a7998b6f.
00000100:00000200:19.0:1773851906.047858:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597807351872, offset 224
00000400:00000200:19.0:1773851906.047859:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17009@kfi7
00000400:00000200:19.0:1773851906.047860:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:19.0:1773851906.047861:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 1
00000400:00000200:19.0:1773851906.047862:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000400:00000200:19.0:1773851906.047863:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 3
00000400:00000200:19.0:1773851906.047864:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17009@kfi7 local destination
00000400:00000200:19.0:1773851906.047865:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770564:8770564:1024:4294967295] 17009@kfi7 LPNI seq info [279488:279488:16:4294967295]
00000400:00000200:19.0:1773851906.047867:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000400:00000200:19.0:1773851906.047868:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17009@kfi7 to cpt 4
00000400:00000200:19.0:1773851906.047870:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17009@kfi7(17009@kfi7:17009@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851906.047871:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 3
00000800:00000200:19.0:1773851906.047873:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851906.047874:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851906.047876:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851906.047878:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10e4 Using peer 17009@kfi7(0x10e4)
00000800:00000200:19.0:1773851906.047881:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000005d7a1ecc: Posted send of 324 bytes to peer 0x10e4: rc=0
00000800:00000200:19.0:1773851906.047883:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10e4 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851906.047885:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851906.047885:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cea9c403 refcount 2 to 17008@kfi7
00010000:00000001:19.0:1773851906.047886:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851906.047887:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.047887:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851906.047888:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001159dfcd x1859597807351872/t0(0) o400->2f6dbe94-2578-485e-84cf-f4e45b43989a@17008@kfi7:158/0 lens 224/224 e 0 to 0 dl 1773852273 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1550-0'
00000100:00100000:19.0:1773851906.047891:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001159dfcd pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:2f6dbe94-2578-485e-84cf-f4e45b43989a+167:39573:x1859597807351872:12345-17008@kfi7:400:default-tuolumne1550-0 Request processed in 60us (96us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851906.047893:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17008@kfi7, seq: 2156457
00000100:00000040:19.0:1773851906.047894:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d4a35379 : new rpc_count 0
00000100:00000001:19.0:1773851906.047895:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851906.047895:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10e4 TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851906.047896:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851906.047896:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851906.047897:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000400:00000200:17.0:1773851906.047897:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851906.047898:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000301e8f40.
00000020:00000040:19.0:1773851906.047898:0:60961:0:(genops.c:882:class_export_put()) PUTting export 00000000d4a35379 : new refcount 166
00000400:00000200:17.0:1773851906.047898:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17009@kfi7: PUT: OK
00000100:00000001:19.0:1773851906.047899:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:17.0:1773851906.047899:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a7998b6f
00000400:00000010:17.0:1773851906.047899:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a7998b6f.
00000100:00000001:17.0:1773851906.047900:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851906.047900:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851906.047901:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000850e53ae nid 17009@kfi7 refs 2
00000800:00000200:17.0:1773851906.047903:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000005d7a1ecc: 2069@kfi7:4 -> 17009@kfi7(00000000afc08639):0x0 lsk 4325 rsk 14 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10e4 Transaction freed
00000800:00000200:22.0:1773851906.087909:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851906.087909:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851906.087910:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:22.0:1773851906.087911:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851906.087913:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851906.087913:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:21.0:1773851906.087916:0:2494373:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 18656@kfi7(00000000abc24ecb):0xc98 version: 2; local version 2; negotiated version: 2
00000800:00000200:22.0:1773851906.087917:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:21.0:1773851906.087920:0:2494373:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 Using peer 18656@kfi7(0x100000000000c98)
00000400:00000200:22.0:1773851906.087921:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18656@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.087923:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 18656@kfi7 : PUT - for me
00000400:00000200:21.0:1773851906.087923:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18656@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.087925:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18656@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.087927:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c7c73a2 nid 18656@kfi7 refs 1
00000800:00000200:21.0:1773851906.087927:0:2494373:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 38 bytes to peer 0x100000000000c98: rc=0
00000400:00000200:22.0:1773851906.087929:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18656@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.087930:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c7c73a2 nid 18656@kfi7 refs 2
00000800:00000200:21.0:1773851906.087930:0:2494373:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:22.0:1773851906.087932:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002c7c73a2 nid 18656@kfi7 refs 3
00000400:00000200:22.0:1773851906.087933:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18657@kfi7 to cpt 0
00000400:00000200:22.0:1773851906.087935:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-18657@kfi7 of length 336 into portal 17 MB=0x69b4c38747dc0
00000400:00000200:22.0:1773851906.087939:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 11 from 12345-18657@kfi7 of length 336/336 into md 0x6a33b3855 [2] + 0
00000800:00000200:21.0:1773851906.087942:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 TN_EVENT_TX_OK event status 0
00000800:00000200:22.0:1773851906.087944:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851906.087947:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000800:00000200:21.0:1773851906.087947:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000063ddb849: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 Transaction freed
00000400:00000200:22.0:1773851906.087949:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18656@kfi7: PUT: OK
00000100:00000001:22.0:1773851906.087951:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851906.087952:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service ldlm_canceld
00000100:00000010:22.0:1773851906.087954:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e97a8038.
00000100:00000040:22.0:1773851906.087955:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000e97a8038 x1859601527242176 msgsize 336
00000100:00100000:22.0:1773851906.087961:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-18657@kfi7 (source: 12345-18656@kfi7)
00000100:00000001:22.0:1773851906.087964:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851906.087966:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002c7c73a2 nid 18656@kfi7 refs 2
00000800:00000200:22.0:1773851906.087969:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2054@kfi7:5 <- 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
00000100:00000001:21.0:1773851906.087970:0:41144:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:21.0:1773851906.087971:0:41144:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:21.0:1773851906.087972:0:41144:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:21.0:1773851906.087973:0:41144:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:21.0:1773851906.087975:0:41144:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:21.0:1773851906.087977:0:41144:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859601527242176
00000020:00000001:21.0:1773851906.087978:0:41144:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:21.0:1773851906.087979:0:41144:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff7f55a
00000020:00000001:21.0:1773851906.087980:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851906.087984:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000d45d6ad8 refcount=8
00000020:00000001:21.0:1773851906.087985:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637098804637696 : -106974904913920 : ffff9eb4f6caf000)
00000020:00000001:21.0:1773851906.087986:0:41144:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637098804637696 : -106974904913920 : ffff9eb4f6caf000)
00000100:00000001:21.0:1773851906.087988:0:41144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:21.0:1773851906.087989:0:41144:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:21.0:1773851906.087990:0:41144:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f06186fb.
00000020:00000010:21.0:1773851906.087991:0:41144:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000a03aa828.
00000020:00000010:21.0:1773851906.087992:0:41144:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000000104460d.
00000100:00000040:21.0:1773851906.087994:0:41144:0:(service.c:1264:ptlrpc_at_set_timer()) armed ldlm_canceld at +82s
00000100:00000001:21.0:1773851906.087995:0:41144:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:21.0:1773851906.087996:0:41144:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00010000:00000001:21.0:1773851906.087997:0:41144:0:(ldlm_lockd.c:2656:ldlm_hpreq_handler()) Process entered
00010000:00000001:21.0:1773851906.087998:0:41144:0:(ldlm_lockd.c:2670:ldlm_hpreq_handler()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.087999:0:41144:0:(ldlm_lockd.c:2613:ldlm_cancel_hpreq_check()) Process entered
00010000:00000001:21.0:1773851906.088000:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851906.088000:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851906.088002:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000718350b refcount=3
00000020:00000001:21.0:1773851906.088002:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135473436224 : -106938236115392 : ffff9ebd806c6640)
00010000:00000001:21.0:1773851906.088004:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637135473436224 : -106938236115392 : ffff9ebd806c6640)
00010000:00000001:21.0:1773851906.088004:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088005:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088006:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851906.088006:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851906.088007:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000349ccf43 refcount=3
00000020:00000001:21.0:1773851906.088008:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135473440832 : -106938236110784 : ffff9ebd806c7840)
00010000:00000001:21.0:1773851906.088008:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637135473440832 : -106938236110784 : ffff9ebd806c7840)
00010000:00000001:21.0:1773851906.088009:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088009:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088010:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851906.088010:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851906.088011:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c21ebf89 refcount=3
00000020:00000001:21.0:1773851906.088012:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937570688 : -107144771980928 : ffff9e8d69ed3180)
00010000:00000001:21.0:1773851906.088013:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937570688 : -107144771980928 : ffff9e8d69ed3180)
00010000:00000001:21.0:1773851906.088014:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088014:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088014:0:41144:0:(ldlm_lockd.c:2645:ldlm_cancel_hpreq_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851906.088015:0:41144:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851906.088017:0:41144:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851906.088019:0:41144:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851906.088022:0:170562:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:21.0:1773851906.088022:0:41144:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851906.088023:0:170562:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:21.0:1773851906.088023:0:41144:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:21.0:1773851906.088024:0:41144:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-18657@kfi7, seq: 37871502
00000100:00000001:23.0:1773851906.088025:0:170562:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851906.088025:0:41144:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000d45d6ad8 : new rpc_count 1
00000100:00000001:23.0:1773851906.088026:0:170562:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851906.088026:0:41144:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637155706627968 : -106918002923648 : ffff9ec2366a6780)
00000100:00000040:21.0:1773851906.088028:0:41144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e97a8038 x1859601527242176/t0(0) o103->f7398e4e-f172-420c-af61-13e2a77b18d1@18657@kfi7:633/0 lens 336/0 e 0 to 0 dl 1773851993 ref 1 fl New:/0/ffffffff rc 0/-1 job:''
00000100:00000001:21.0:1773851906.088032:0:41144:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:21.0:1773851906.088032:0:41144:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:21.0:1773851906.088033:0:41144:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e97a8038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn05_000:f7398e4e-f172-420c-af61-13e2a77b18d1+8:39541:x1859601527242176:12345-18657@kfi7:103:
00000100:00000200:21.0:1773851906.088035:0:41144:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859601527242176
00010000:00000001:21.0:1773851906.088036:0:41144:0:(ldlm_lockd.c:2508:ldlm_cancel_handler()) Process entered
00010000:00000002:21.0:1773851906.088036:0:41144:0:(ldlm_lockd.c:2544:ldlm_cancel_handler()) cancel
00010000:00000001:21.0:1773851906.088037:0:41144:0:(ldlm_lockd.c:1797:ldlm_handle_cancel()) Process entered
00000100:00000001:21.0:1773851906.088038:0:41144:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:21.0:1773851906.088039:0:41144:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:21.0:1773851906.088040:0:41144:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000004cfa686b.
02000000:00000001:21.0:1773851906.088041:0:41144:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851906.088042:0:41144:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088042:0:41144:0:(ldlm_lockd.c:1698:ldlm_request_cancel()) Process entered
00010000:00010000:21.0:1773851906.088043:0:41144:0:(ldlm_lockd.c:1720:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0
00010000:00000001:21.0:1773851906.088044:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851906.088044:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851906.088044:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 000000000718350b refcount=3
00000020:00000001:21.0:1773851906.088045:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135473436224 : -106938236115392 : ffff9ebd806c6640)
00010000:00000001:21.0:1773851906.088046:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637135473436224 : -106938236115392 : ffff9ebd806c6640)
00010000:00000040:21.0:1773851906.088047:0:41144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 000000008de3aeb6 count: 193
00000004:00000001:21.0:1773851906.088048:0:41144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:21.0:1773851906.088048:0:41144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:21.0:1773851906.088049:0:41144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:21.0:1773851906.088050:0:41144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:21.0:1773851906.088050:0:41144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:21.0:1773851906.088051:0:41144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088053:0:41144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:21.0:1773851906.088053:0:41144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:21.0:1773851906.088054:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088055:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088055:0:41144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:21.0:1773851906.088056:0:41144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:21.0:1773851906.088056:0:41144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 000000000718350b with handle 0x21b6f08f07a4dad1 from hash
00010000:00000001:21.0:1773851906.088057:0:41144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:21.0:1773851906.088058:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088058:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088058:0:41144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:21.0:1773851906.088059:0:41144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:21.0:1773851906.088060:0:41144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088060:0:41144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:21.0:1773851906.088061:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:21.0:1773851906.088061:0:41144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 000000000718350b/0x21b6f08f07a4dad1 lrc: 0/0,0 mode: --/PR res: [0x24002684f:0x62d0:0x0].0x0 bits 0x12/0x0 rrc: 194 type: IBT gid 0 flags: 0x44a01000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013fa4 expref: 8 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:21.0:1773851906.088064:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 193
00010000:00000040:21.0:1773851906.088065:0:41144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000d45d6ad8 : new locks_count 2
00000020:00000040:21.0:1773851906.088066:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000d45d6ad8 : new refcount 7
00010000:00000010:21.0:1773851906.088067:0:41144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000d9f7b5c8.
00010000:00000040:21.0:1773851906.088068:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 192
00010000:00000001:21.0:1773851906.088069:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088069:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851906.088069:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851906.088069:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000349ccf43 refcount=3
00000020:00000001:21.0:1773851906.088070:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637135473440832 : -106938236110784 : ffff9ebd806c7840)
00010000:00000001:21.0:1773851906.088071:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446637135473440832 : -106938236110784 : ffff9ebd806c7840)
00010000:00000001:21.0:1773851906.088072:0:41144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:21.0:1773851906.088072:0:41144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:21.0:1773851906.088073:0:41144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24002684f:0x62d0:0x0].0x0 (000000008de3aeb6)
00010000:00000001:21.0:1773851906.088074:0:41144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:21.0:1773851906.088075:0:41144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088075:0:41144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:21.0:1773851906.088076:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 000000008de3aeb6 count: 191
00010000:00000040:21.0:1773851906.088076:0:41144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000fca6c622 count: 228
00000004:00000001:21.0:1773851906.088077:0:41144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:21.0:1773851906.088077:0:41144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:21.0:1773851906.088078:0:41144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:21.0:1773851906.088078:0:41144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:21.0:1773851906.088078:0:41144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:21.0:1773851906.088079:0:41144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088080:0:41144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:21.0:1773851906.088080:0:41144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:21.0:1773851906.088081:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088081:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088082:0:41144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:21.0:1773851906.088082:0:41144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:21.0:1773851906.088083:0:41144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000349ccf43 with handle 0x21b6f08f07a4dab5 from hash
00010000:00000001:21.0:1773851906.088083:0:41144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:21.0:1773851906.088084:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088084:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088084:0:41144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:21.0:1773851906.088085:0:41144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:21.0:1773851906.088085:0:41144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088085:0:41144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:21.0:1773851906.088086:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:21.0:1773851906.088086:0:41144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000349ccf43/0x21b6f08f07a4dab5 lrc: 0/0,0 mode: --/PR res: [0x2800256ea:0x3d:0x0].0x0 bits 0x1/0x0 rrc: 229 type: IBT gid 0 flags: 0x44a01000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f7a expref: 7 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:21.0:1773851906.088088:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 228
00010000:00000040:21.0:1773851906.088090:0:41144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000d45d6ad8 : new locks_count 1
00000020:00000040:21.0:1773851906.088090:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000d45d6ad8 : new refcount 6
00010000:00000010:21.0:1773851906.088090:0:41144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000676d684c.
00010000:00000040:21.0:1773851906.088091:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 227
00010000:00000001:21.0:1773851906.088091:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088092:0:41144:0:(ldlm_lock.c:598:__ldlm_handle2lock()) Process entered
00000020:00000001:21.0:1773851906.088092:0:41144:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:21.0:1773851906.088092:0:41144:0:(lustre_handles.c:151:class_handle2object()) GET ldlm 00000000c21ebf89 refcount=3
00000020:00000001:21.0:1773851906.088093:0:41144:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636928937570688 : -107144771980928 : ffff9e8d69ed3180)
00010000:00000001:21.0:1773851906.088093:0:41144:0:(ldlm_lock.c:620:__ldlm_handle2lock()) Process leaving (rc=18446636928937570688 : -107144771980928 : ffff9e8d69ed3180)
00010000:00000001:21.0:1773851906.088094:0:41144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:21.0:1773851906.088094:0:41144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:21.0:1773851906.088094:0:41144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x2800256ea:0x3d:0x0].0x0 (00000000fca6c622)
00010000:00000001:21.0:1773851906.088095:0:41144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:21.0:1773851906.088096:0:41144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088096:0:41144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:21.0:1773851906.088097:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000fca6c622 count: 226
00010000:00000040:21.0:1773851906.088097:0:41144:0:(ldlm_resource.c:1580:ldlm_resource_getref()) getref res: 00000000255c9013 count: 195
00000004:00000001:21.0:1773851906.088098:0:41144:0:(mdt_lvb.c:250:mdt_lvbo_update()) Process entered
00010000:00000001:21.0:1773851906.088098:0:41144:0:(ldlm_lock.c:2482:ldlm_lock_cancel()) Process entered
00000020:00000001:21.0:1773851906.088099:0:41144:0:(tgt_handler.c:1326:tgt_blocking_ast()) Process entered
00010000:00000001:21.0:1773851906.088099:0:41144:0:(ldlm_lockd.c:892:ldlm_server_blocking_ast()) Process entered
00010000:00000001:21.0:1773851906.088099:0:41144:0:(ldlm_lockd.c:896:ldlm_server_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:21.0:1773851906.088100:0:41144:0:(tgt_handler.c:1381:tgt_blocking_ast()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088101:0:41144:0:(ldlm_lock.c:439:ldlm_lock_destroy_nolock()) Process entered
00010000:00000001:21.0:1773851906.088101:0:41144:0:(ldlm_lock.c:378:ldlm_lock_destroy_internal()) Process entered
00010000:00000001:21.0:1773851906.088102:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088102:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088102:0:41144:0:(ldlm_lock.c:288:ldlm_lock_remove_from_lru_check()) Process entered
00010000:00000001:21.0:1773851906.088103:0:41144:0:(ldlm_lock.c:291:ldlm_lock_remove_from_lru_check()) Process leaving (rc=0 : 0 : 0)
00000020:00000040:21.0:1773851906.088103:0:41144:0:(lustre_handles.c:111:class_handle_unhash_nolock()) removing object 00000000c21ebf89 with handle 0x21b6f08f07a4da99 from hash
00010000:00000001:21.0:1773851906.088104:0:41144:0:(ldlm_lock.c:410:ldlm_lock_destroy_internal()) Process leaving
00010000:00000001:21.0:1773851906.088104:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00000001:21.0:1773851906.088104:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088105:0:41144:0:(ldlm_lock.c:446:ldlm_lock_destroy_nolock()) Process leaving
00010000:00000001:21.0:1773851906.088107:0:41144:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:21.0:1773851906.088107:0:41144:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088108:0:41144:0:(ldlm_lock.c:2519:ldlm_lock_cancel()) Process leaving
00010000:00000001:21.0:1773851906.088108:0:41144:0:(ldlm_lock.c:208:ldlm_lock_put()) Process entered
00010000:00010000:21.0:1773851906.088109:0:41144:0:(ldlm_lock.c:216:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre5-MDT0001_UUID lock: 00000000c21ebf89/0x21b6f08f07a4da99 lrc: 0/0,0 mode: --/PR res: [0x24001b599:0x10e2:0x0].0x0 bits 0x12/0x0 rrc: 196 type: IBT gid 0 flags: 0x44a01000000000 nid: 18657@kfi7 remote: 0x124b24cb8d013f73 expref: 6 pid: 60858 timeout: 0 lvb_type: 0
00010000:00000040:21.0:1773851906.088111:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 195
00010000:00000040:21.0:1773851906.088111:0:41144:0:(ldlm_lock.c:228:ldlm_lock_put()) lock PUTting export 00000000d45d6ad8 : new locks_count 0
00000020:00000040:21.0:1773851906.088112:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000d45d6ad8 : new refcount 5
00010000:00000010:21.0:1773851906.088112:0:41144:0:(ldlm_lock.c:240:ldlm_lock_put()) slab-freed '(lock->l_ibits_node)': 120 at 00000000d5d50ef2.
00010000:00000040:21.0:1773851906.088113:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 194
00010000:00000001:21.0:1773851906.088113:0:41144:0:(ldlm_lock.c:248:ldlm_lock_put()) Process leaving
00010000:00000001:21.0:1773851906.088113:0:41144:0:(ldlm_lock.c:2361:__ldlm_reprocess_all()) Process entered
00010000:00000001:21.0:1773851906.088114:0:41144:0:(ldlm_inodebits.c:80:ldlm_reprocess_inodebits_queue()) Process entered
00010000:00010000:21.0:1773851906.088114:0:41144:0:(ldlm_inodebits.c:94:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x24001b599:0x10e2:0x0].0x0 (00000000255c9013)
00010000:00000001:21.0:1773851906.088115:0:41144:0:(ldlm_inodebits.c:143:ldlm_reprocess_inodebits_queue()) Process leaving (rc=1 : 1 : 1)
00010000:00000001:21.0:1773851906.088115:0:41144:0:(ldlm_lock.c:2292:ldlm_run_ast_work()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088116:0:41144:0:(ldlm_lock.c:2398:__ldlm_reprocess_all()) Process leaving
00010000:00000040:21.0:1773851906.088116:0:41144:0:(ldlm_resource.c:1614:ldlm_resource_putref()) putref res: 00000000255c9013 count: 193
00010000:00010000:21.0:1773851906.088117:0:41144:0:(ldlm_lockd.c:1782:ldlm_request_cancel()) ### server-side cancel handler END
00010000:00000001:21.0:1773851906.088118:0:41144:0:(ldlm_lockd.c:1783:ldlm_request_cancel()) Process leaving (rc=3 : 3 : 3)
00010000:00000001:21.0:1773851906.088119:0:41144:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:21.0:1773851906.088119:0:41144:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:21.0:1773851906.088120:0:41144:0:(import.c:1951:at_measured()) add 1 to 0000000007eb48e0 time=160 v=66 (1 1 1 1)
00000100:00000001:21.0:1773851906.088121:0:41144:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:21.0:1773851906.088122:0:41144:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fb1bd251 refcount 3 to 18657@kfi7
00000100:00000001:21.0:1773851906.088123:0:41144:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926958004192 : -107146751547424 : ffff9e8cf3ef67e0)
02000000:00000001:21.0:1773851906.088123:0:41144:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:21.0:1773851906.088124:0:41144:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:21.0:1773851906.088125:0:41144:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:21.0:1773851906.088126:0:41144:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-18656@kfi7
00000400:00000010:21.0:1773851906.088126:0:41144:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000f82f3ec.
00000100:00000200:21.0:1773851906.088127:0:41144:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 18, xid 1859601527242176, offset 224
00000400:00000200:21.0:1773851906.088129:0:41144:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-18656@kfi7
00000400:00000200:21.0:1773851906.088130:0:41144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18656@kfi7 to cpt 5
00000400:00000200:21.0:1773851906.088131:0:41144:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002c7c73a2 nid 18656@kfi7 refs 1
00000400:00000200:21.0:1773851906.088132:0:41144:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002c7c73a2 nid 18656@kfi7 refs 2
00000400:00000200:21.0:1773851906.088133:0:41144:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002c7c73a2 nid 18656@kfi7 refs 3
00000400:00000200:21.0:1773851906.088135:0:41144:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  18656@kfi7 local destination
00000400:00000200:21.0:1773851906.088136:0:41144:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770565:8770565:1024:4294967295] 18656@kfi7 LPNI seq info [138269:138269:16:4294967295]
00000400:00000200:21.0:1773851906.088138:0:41144:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002c7c73a2 nid 18656@kfi7 refs 2
00000400:00000200:21.0:1773851906.088139:0:41144:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 18656@kfi7 to cpt 5
00000400:00000200:21.0:1773851906.088141:0:41144:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 18656@kfi7(18656@kfi7:18656@kfi7) <?> : PUT try# 0
00000400:00000200:21.0:1773851906.088142:0:41144:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002c7c73a2 nid 18656@kfi7 refs 3
00000800:00000200:21.0:1773851906.088143:0:41144:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851906.088145:0:41144:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063ddb849: 2054@kfi7:5 -> 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:21.0:1773851906.088147:0:41144:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063ddb849: 2054@kfi7:5 -> 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:21.0:1773851906.088149:0:41144:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063ddb849: 2054@kfi7:5 -> 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 Using peer 18656@kfi7(0x100000000000c98)
00000800:00000200:21.0:1773851906.088152:0:41144:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 0000000063ddb849: Posted send of 324 bytes to peer 0x100000000000c98: rc=0
00000800:00000200:21.0:1773851906.088154:0:41144:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063ddb849: 2054@kfi7:5 -> 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:21.0:1773851906.088156:0:41144:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851906.088157:0:41144:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fb1bd251 refcount 2 to 18657@kfi7
00010000:00000001:21.0:1773851906.088157:0:41144:0:(ldlm_lockd.c:1821:ldlm_handle_cancel()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:21.0:1773851906.088159:0:41144:0:(ldlm_lockd.c:2575:ldlm_cancel_handler()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:21.0:1773851906.088160:0:41144:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e97a8038 x1859601527242176/t0(0) o103->f7398e4e-f172-420c-af61-13e2a77b18d1@18657@kfi7:633/0 lens 336/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:/0/0 rc 0/0 job:''
00000800:00000200:22.0:1773851906.088164:0:2456945:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063ddb849: 2054@kfi7:5 -> 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 TN_EVENT_TX_OK event status 0
00000100:00100000:21.0:1773851906.088164:0:41144:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e97a8038 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn05_000:f7398e4e-f172-420c-af61-13e2a77b18d1+5:39541:x1859601527242176:12345-18657@kfi7:103: Request processed in 131us (208us total) trans 0 rc 0/0
00000400:00000200:22.0:1773851906.088166:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:21.0:1773851906.088166:0:41144:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-18657@kfi7, seq: 37871502
00000400:00000200:22.0:1773851906.088167:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->18656@kfi7: PUT: OK
00000400:00000200:22.0:1773851906.088167:0:2456945:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000f82f3ec
00000100:00000040:21.0:1773851906.088167:0:41144:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000d45d6ad8 : new rpc_count 0
00000400:00000010:22.0:1773851906.088168:0:2456945:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000f82f3ec.
00000100:00000001:21.0:1773851906.088168:0:41144:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:21.0:1773851906.088168:0:41144:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000100:00000001:22.0:1773851906.088169:0:2456945:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:22.0:1773851906.088169:0:2456945:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:21.0:1773851906.088169:0:41144:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000a03aa828.
00000400:00000200:22.0:1773851906.088170:0:2456945:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002c7c73a2 nid 18656@kfi7 refs 2
00000020:00000010:21.0:1773851906.088170:0:41144:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000000104460d.
00000800:00000200:22.0:1773851906.088171:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063ddb849: 2054@kfi7:5 -> 18656@kfi7(00000000abc24ecb):0x0 lsk 3225 rsk 5 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000c98 Transaction freed
00000020:00000010:21.0:1773851906.088171:0:41144:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f06186fb.
00000020:00000040:21.0:1773851906.088172:0:41144:0:(genops.c:882:class_export_put()) PUTting export 00000000d45d6ad8 : new refcount 4
00000100:00000001:21.0:1773851906.088173:0:41144:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00010000:00000010:21.1F:1773851906.093727:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 000000000718350b.
00010000:00000010:21.1:1773851906.093729:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000349ccf43.
00010000:00000010:21.1:1773851906.093730:0:0:0:(ldlm_lock.c:197:lock_handle_free()) slab-freed 'lock': 544 at 00000000c21ebf89.
00000800:00000200:18.0:1773851906.128660:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851906.128660:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851906.128661:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:18.0:1773851906.128662:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851906.128662:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:18.0:1773851906.128663:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851906.128664:0:2511435:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 25473@kfi7(0000000053ebb398):0x10f version: 2; local version 2; negotiated version: 2
00000800:00000200:18.0:1773851906.128665:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:17.0:1773851906.128665:0:2511435:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f Using peer 25473@kfi7(0x10f)
00000400:00000200:18.0:1773851906.128667:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:17.0:1773851906.128667:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.128668:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 25473@kfi7 : PUT - for me
00000400:00000200:18.0:1773851906.128669:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000800:00000200:17.0:1773851906.128669:0:2511435:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000009e13a487: Posted send of 38 bytes to peer 0x10f: rc=0
00000400:00000200:18.0:1773851906.128670:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 1
00000800:00000200:17.0:1773851906.128670:0:2511435:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:18.0:1773851906.128671:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.128672:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000400:00000200:18.0:1773851906.128673:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 3
00000400:00000200:18.0:1773851906.128673:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25472@kfi7 to cpt 1
00000400:00000200:18.0:1773851906.128674:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-25472@kfi7 of length 224 into portal 12 MB=0x699e0d0d4be40
00000400:00000200:18.0:1773851906.128675:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-25472@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 53152
00000800:00000200:18.0:1773851906.128677:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851906.128679:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851906.128680:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25473@kfi7: PUT: OK
00000100:00000001:18.0:1773851906.128681:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851906.128681:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851906.128682:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005a11d4de.
00000100:00000040:18.0:1773851906.128682:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000005a11d4de x1858040715591232 msgsize 224
00000800:00000200:17.0:1773851906.128682:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f TN_EVENT_TX_OK event status 0
00000100:00100000:18.0:1773851906.128684:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-25472@kfi7 (source: 12345-25473@kfi7)
00000100:00000001:18.0:1773851906.128684:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000800:00000200:17.0:1773851906.128684:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f Transaction freed
00000400:00000200:18.0:1773851906.128685:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000100:00000001:19.0:1773851906.128686:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851906.128686:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:18.0:1773851906.128686:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851906.128687:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851906.128688:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851906.128689:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851906.128689:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040715591232
00000020:00000001:19.0:1773851906.128690:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851906.128690:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92ea0
00000020:00000001:19.0:1773851906.128691:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851906.128694:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009d154656 refcount=6
00000020:00000001:19.0:1773851906.128694:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744651776 : -107128964899840 : ffff9e91181a1c00)
00000020:00000001:19.0:1773851906.128695:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744651776 : -107128964899840 : ffff9e91181a1c00)
00000100:00000001:19.0:1773851906.128696:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851906.128697:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851906.128698:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000301e8f40.
00000020:00000010:19.0:1773851906.128699:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851906.128699:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851906.128700:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851906.128701:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851906.128701:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.128702:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851906.128703:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851906.128703:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.128704:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.128705:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851906.128705:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851906.128706:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851906.128706:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-25472@kfi7, seq: 2156458
00000100:00000001:16.0:1773851906.128706:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:19.0:1773851906.128707:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009d154656 : new rpc_count 1
00000100:00000001:16.0:1773851906.128707:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.128708:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637058609981568 : -107015099570048 : ffff9eab9b012880)
00000100:00000001:16.0:1773851906.128708:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851906.128709:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005a11d4de x1858040715591232/t0(0) o400->ea17e9ac-929c-40d5-9605-398b01644c5e@25472@kfi7:158/0 lens 224/0 e 0 to 0 dl 1773852273 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2084-0'
00000100:00000001:19.0:1773851906.128711:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851906.128712:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851906.128713:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005a11d4de pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ea17e9ac-929c-40d5-9605-398b01644c5e+6:39802:x1858040715591232:12345-25472@kfi7:400:default-tuolumne2084-0
00000100:00000200:19.0:1773851906.128714:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040715591232
00000020:00000001:19.0:1773851906.128715:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851906.128715:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851906.128716:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.128716:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851906.128717:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851906.128717:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851906.128718:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040715591232, found 0 last_xid 1858040715591231
00000020:00000001:19.0:1773851906.128719:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851906.128719:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851906.128719:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851906.128720:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.128720:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851906.128721:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851906.128722:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851906.128722:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000eab773a2.
02000000:00000001:19.0:1773851906.128723:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.128723:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.128724:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851906.128728:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 182998107156, transno 0, xid 1858040715591232
00010000:00000001:19.0:1773851906.128729:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851906.128729:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005a11d4de x1858040715591232/t0(0) o400->ea17e9ac-929c-40d5-9605-398b01644c5e@25472@kfi7:158/0 lens 224/224 e 0 to 0 dl 1773852273 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2084-0'
00010000:00000001:19.0:1773851906.128732:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851906.128732:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851906.128733:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=139 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851906.128734:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851906.128735:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001c97e1aa refcount 3 to 25472@kfi7
00000100:00000001:19.0:1773851906.128735:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405412480 : -107145304139136 : ffff9e8d4a351a80)
02000000:00000001:19.0:1773851906.128736:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851906.128737:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.128737:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851906.128738:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-25473@kfi7
00000400:00000010:19.0:1773851906.128739:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000e88f2542.
00000100:00000200:19.0:1773851906.128739:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040715591232, offset 224
00000400:00000200:19.0:1773851906.128741:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-25473@kfi7
00000400:00000200:19.0:1773851906.128742:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:19.0:1773851906.128743:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 1
00000400:00000200:19.0:1773851906.128744:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000400:00000200:19.0:1773851906.128745:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 3
00000400:00000200:19.0:1773851906.128746:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  25473@kfi7 local destination
00000400:00000200:19.0:1773851906.128748:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770566:8770566:1024:4294967295] 25473@kfi7 LPNI seq info [8126580:8126580:16:4294967295]
00000400:00000200:19.0:1773851906.128749:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000400:00000200:19.0:1773851906.128750:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 25473@kfi7 to cpt 4
00000400:00000200:19.0:1773851906.128752:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 25473@kfi7(25473@kfi7:25473@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851906.128753:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 3
00000800:00000200:19.0:1773851906.128755:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851906.128756:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851906.128758:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851906.128760:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f Using peer 25473@kfi7(0x10f)
00000800:00000200:19.0:1773851906.128763:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 00000000281c67ea: Posted send of 324 bytes to peer 0x10f: rc=0
00000800:00000200:19.0:1773851906.128764:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851906.128766:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851906.128767:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001c97e1aa refcount 2 to 25472@kfi7
00010000:00000001:19.0:1773851906.128767:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851906.128767:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.128768:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851906.128769:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005a11d4de x1858040715591232/t0(0) o400->ea17e9ac-929c-40d5-9605-398b01644c5e@25472@kfi7:158/0 lens 224/224 e 0 to 0 dl 1773852273 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2084-0'
00000100:00100000:19.0:1773851906.128772:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005a11d4de pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:ea17e9ac-929c-40d5-9605-398b01644c5e+6:39802:x1858040715591232:12345-25472@kfi7:400:default-tuolumne2084-0 Request processed in 59us (88us total) trans 0 rc 0/0
00000100:00100000:19.0:1773851906.128774:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-25472@kfi7, seq: 2156458
00000100:00000040:19.0:1773851906.128775:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009d154656 : new rpc_count 0
00000100:00000001:19.0:1773851906.128776:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:17.0:1773851906.128776:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f TN_EVENT_TX_OK event status 0
00000100:00000001:19.0:1773851906.128777:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851906.128777:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000400:00000200:17.0:1773851906.128777:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:19.0:1773851906.128778:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000400:00000200:17.0:1773851906.128778:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->25473@kfi7: PUT: OK
00000020:00000010:19.0:1773851906.128779:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000301e8f40.
00000400:00000200:17.0:1773851906.128779:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000e88f2542
00000400:00000010:17.0:1773851906.128779:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000e88f2542.
00000020:00000040:19.0:1773851906.128780:0:60961:0:(genops.c:882:class_export_put()) PUTting export 000000009d154656 : new refcount 5
00000100:00000001:19.0:1773851906.128780:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:17.0:1773851906.128780:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:17.0:1773851906.128781:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:17.0:1773851906.128782:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e961a4aa nid 25473@kfi7 refs 2
00000800:00000200:17.0:1773851906.128783:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000281c67ea: 2069@kfi7:4 -> 25473@kfi7(0000000053ebb398):0x0 lsk 272 rsk 52 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10f Transaction freed
00010000:00000001:2.0:1773851906.185730:0:2506505:0:(ldlm_pool.c:338:ldlm_srv_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185731:0:2506505:0:(ldlm_pool.c:342:ldlm_srv_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851906.185732:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185732:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851906.185733:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185733:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851906.185734:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185734:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851906.185735:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185735:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851906.185736:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185736:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851906.185737:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185737:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:2.0:1773851906.185738:0:2506505:0:(ldlm_pool.c:478:ldlm_cli_pool_recalc()) Process entered
00010000:00000001:2.0:1773851906.185738:0:2506505:0:(ldlm_pool.c:482:ldlm_cli_pool_recalc()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:3.0:1773851906.185741:0:41154:0:(genops.c:1734:obd_stale_export_get()) Process entered
00000020:00000001:3.0:1773851906.185741:0:41154:0:(genops.c:1748:obd_stale_export_get()) Process leaving (rc=0 : 0 : 0)
00010000:00010000:3.0:1773851906.185742:0:41154:0:(ldlm_lockd.c:2792:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue)
00000800:00000200:1.0:1773851906.187778:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851906.187780:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851906.187781:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851906.187783:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851906.187785:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:1.0:1773851906.187786:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16544@kfi7 : PUT - for me
00000400:00000200:1.0:1773851906.187787:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:1.0:1773851906.187788:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 1
00000400:00000200:1.0:1773851906.187789:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:1.0:1773851906.187790:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000400:00000200:1.0:1773851906.187791:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 3
00000400:00000200:1.0:1773851906.187791:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16480@kfi7 to cpt 4
00000400:00000200:1.0:1773851906.187792:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16480@kfi7 of length 224 into portal 12 MB=0x69b9db1b98180
00000400:00000200:1.0:1773851906.187794:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16480@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 59512
00000800:00000200:1.0:1773851906.187795:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851906.187797:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851906.187798:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16544@kfi7: PUT: OK
00000100:00000001:1.0:1773851906.187799:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851906.187800:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851906.187801:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000e8640bb8.
00000100:00000040:1.0:1773851906.187801:0:2494030:0:(events.c:358:request_in_callback()) incoming req@00000000e8640bb8 x1859951454159232 msgsize 224
00000100:00100000:1.0:1773851906.187803:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-16480@kfi7 (source: 12345-16544@kfi7)
00000100:00000001:1.0:1773851906.187804:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851906.187805:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000100:00000001:0.0:1773851906.187806:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851906.187807:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2069@kfi7:0 <- 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851906.187807:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851906.187807:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851906.187808:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851906.187808:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851906.187809:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859951454159232
00000020:00000001:0.0:1773851906.187810:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851906.187811:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08c833289fa
00000020:00000001:0.0:1773851906.187812:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851906.187813:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 000000002454b9e4 refcount=167
00000020:00000001:0.0:1773851906.187814:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637100752097280 : -106972957454336 : ffff9eb56aded000)
00000020:00000001:0.0:1773851906.187815:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637100752097280 : -106972957454336 : ffff9eb56aded000)
00000100:00000001:0.0:1773851906.187816:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851906.187817:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851906.187817:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000877d5ffd.
00000020:00000010:0.0:1773851906.187818:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851906.187819:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851906.187820:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851906.187821:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851906.187821:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851906.187822:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851906.187823:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851906.187823:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851906.187824:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851906.187825:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851906.187826:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:2.0:1773851906.187826:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:0.0:1773851906.187826:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851906.187827:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16480@kfi7, seq: 1997651
00000100:00000001:2.0:1773851906.187828:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851906.187828:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851906.187828:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000002454b9e4 : new rpc_count 1
00000100:00000001:0.0:1773851906.187828:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327718912 : -106982381832704 : ffff9eb339223600)
00000100:00000040:0.0:1773851906.187829:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000e8640bb8 x1859951454159232/t0(0) o400->01143989-8a17-4a30-9e1d-b6b0fa770cfc@16480@kfi7:546/0 lens 224/0 e 0 to 0 dl 1773852661 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1520-0'
00000100:00000001:0.0:1773851906.187832:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851906.187832:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851906.187834:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000e8640bb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:01143989-8a17-4a30-9e1d-b6b0fa770cfc+167:39732:x1859951454159232:12345-16480@kfi7:400:default-tuolumne1520-0
00000100:00000200:0.0:1773851906.187835:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859951454159232
00000020:00000001:0.0:1773851906.187836:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851906.187836:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851906.187837:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.187838:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851906.187839:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851906.187839:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851906.187840:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859951454159232, found 0 last_xid 1859951453733311
00000020:00000001:0.0:1773851906.187841:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851906.187842:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851906.187842:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851906.187843:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.187843:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851906.187844:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851906.187844:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851906.187845:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000330a990f.
02000000:00000001:0.0:1773851906.187846:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851906.187847:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.187847:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851906.187848:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062852, transno 0, xid 1859951454159232
00010000:00000001:0.0:1773851906.187849:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851906.187850:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000e8640bb8 x1859951454159232/t0(0) o400->01143989-8a17-4a30-9e1d-b6b0fa770cfc@16480@kfi7:546/0 lens 224/224 e 0 to 0 dl 1773852661 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1520-0'
00010000:00000001:0.0:1773851906.187852:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851906.187852:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851906.187853:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=139 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851906.187854:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851906.187854:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000098baeed7 refcount 3 to 16480@kfi7
00000100:00000001:0.0:1773851906.187855:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583959360 : -107156125592256 : ffff9e8ac532d540)
02000000:00000001:0.0:1773851906.187856:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851906.187856:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851906.187857:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851906.187858:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16544@kfi7
00000400:00000010:0.0:1773851906.187859:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000b7cd9ccd.
00000100:00000200:0.0:1773851906.187860:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859951454159232, offset 224
00000400:00000200:0.0:1773851906.187861:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16544@kfi7
00000400:00000200:0.0:1773851906.187862:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:0.0:1773851906.187862:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 1
00000400:00000200:0.0:1773851906.187863:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000400:00000200:0.0:1773851906.187865:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 3
00000400:00000200:0.0:1773851906.187867:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  16544@kfi7 local destination
00000400:00000200:0.0:1773851906.187868:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770567:8770567:1024:4294967295] 16544@kfi7 LPNI seq info [438916:438916:16:4294967295]
00000400:00000200:0.0:1773851906.187869:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000400:00000200:0.0:1773851906.187870:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16544@kfi7 to cpt 0
00000400:00000200:0.0:1773851906.187872:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 16544@kfi7(16544@kfi7:16544@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851906.187873:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 3
00000800:00000200:0.0:1773851906.187875:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851906.187876:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851906.187878:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851906.187880:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x478 Using peer 16544@kfi7(0x478)
00000800:00000200:0.0:1773851906.187883:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x478: rc=0
00000800:00000200:0.0:1773851906.187885:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x478 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851906.187887:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851906.187888:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000098baeed7 refcount 2 to 16480@kfi7
00010000:00000001:0.0:1773851906.187889:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851906.187889:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.187890:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851906.187890:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000e8640bb8 x1859951454159232/t0(0) o400->01143989-8a17-4a30-9e1d-b6b0fa770cfc@16480@kfi7:546/0 lens 224/224 e 0 to 0 dl 1773852661 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1520-0'
00000100:00100000:0.0:1773851906.187895:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000e8640bb8 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:01143989-8a17-4a30-9e1d-b6b0fa770cfc+167:39732:x1859951454159232:12345-16480@kfi7:400:default-tuolumne1520-0 Request processed in 62us (92us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851906.187897:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16480@kfi7, seq: 1997651
00000100:00000040:0.0:1773851906.187898:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000002454b9e4 : new rpc_count 0
00000100:00000001:0.0:1773851906.187899:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851906.187900:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851906.187901:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851906.187901:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000020:00000010:0.0:1773851906.187902:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000877d5ffd.
00000020:00000040:0.0:1773851906.187903:0:42868:0:(genops.c:882:class_export_put()) PUTting export 000000002454b9e4 : new refcount 166
00000100:00000001:0.0:1773851906.187903:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851906.187910:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x478 TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851906.187912:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851906.187913:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16544@kfi7: PUT: OK
00000400:00000200:1.0:1773851906.187914:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000b7cd9ccd
00000400:00000010:1.0:1773851906.187914:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000b7cd9ccd.
00000100:00000001:1.0:1773851906.187915:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851906.187915:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851906.187916:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f8fa5182 nid 16544@kfi7 refs 2
00000800:00000200:1.0:1773851906.187918:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2069@kfi7:0 -> 16544@kfi7(0000000066665e6e):0x0 lsk 1145 rsk 6 tsk 0 trmk 0 tmk 0 trr 0 tta 0x478 Transaction freed
00000800:00000200:9.0:1773851906.249378:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851906.249379:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851906.249380:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851906.249383:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851906.249385:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.249387:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 17728@kfi7 : PUT - for me
00000400:00000200:9.0:1773851906.249388:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.249389:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 1
00000400:00000200:9.0:1773851906.249390:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.249391:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000400:00000200:9.0:1773851906.249392:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 3
00000400:00000200:9.0:1773851906.249393:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17729@kfi7 to cpt 5
00000400:00000200:9.0:1773851906.249394:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17729@kfi7 of length 224 into portal 12 MB=0x69b4b5baf03c0
00000400:00000200:9.0:1773851906.249395:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17729@kfi7 of length 224/224 into md 0x78146ce49 [64] + 170488
00000800:00000200:9.0:1773851906.249397:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851906.249399:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851906.249401:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17728@kfi7: PUT: OK
00000100:00000001:9.0:1773851906.249402:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851906.249402:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851906.249403:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000004141806f.
00000100:00000040:9.0:1773851906.249404:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000004141806f x1859597823312832 msgsize 224
00000100:00100000:9.0:1773851906.249406:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-17729@kfi7 (source: 12345-17728@kfi7)
00000100:00000001:9.0:1773851906.249407:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851906.249408:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851906.249408:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
02000000:00000001:11.0:1773851906.249409:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851906.249409:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851906.249410:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851906.249410:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851906.249411:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851906.249411:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597823312832
00000020:00000001:11.0:1773851906.249412:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851906.249412:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d81e5c
00000020:00000001:11.0:1773851906.249413:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851906.249415:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b0be8314 refcount=165
00000020:00000001:11.0:1773851906.249415:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637131280812032 : -106942428739584 : ffff9ebc86860800)
00000020:00000001:11.0:1773851906.249417:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637131280812032 : -106942428739584 : ffff9ebc86860800)
00000100:00000001:11.0:1773851906.249418:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851906.249419:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851906.249420:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000f71ac8fb.
00000020:00000010:11.0:1773851906.249421:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851906.249421:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851906.249422:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851906.249423:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851906.249423:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851906.249424:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851906.249425:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851906.249425:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851906.249426:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851906.249427:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851906.249428:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851906.249428:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17729@kfi7, seq: 2130901
00000100:00000001:8.0:1773851906.249428:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851906.249428:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:11.0:1773851906.249429:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b0be8314 : new rpc_count 1
00000100:00000001:8.0:1773851906.249429:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851906.249430:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498323712 : -106953211227904 : ffff9eba03d65100)
00000100:00000001:8.0:1773851906.249430:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851906.249431:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000004141806f x1859597823312832/t0(0) o400->3761013e-3503-4a7d-ad92-4b3a0f692635@17729@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1604-0'
00000100:00000001:11.0:1773851906.249434:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851906.249434:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851906.249435:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000004141806f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:3761013e-3503-4a7d-ad92-4b3a0f692635+165:39695:x1859597823312832:12345-17729@kfi7:400:default-tuolumne1604-0
00000100:00000200:11.0:1773851906.249437:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597823312832
00000020:00000001:11.0:1773851906.249437:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851906.249438:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851906.249438:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.249439:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851906.249440:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851906.249440:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851906.249441:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597823312832, found 0 last_xid 1859597822889663
00000020:00000001:11.0:1773851906.249442:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851906.249443:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851906.249443:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851906.249443:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.249444:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851906.249445:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851906.249445:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851906.249447:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000183983d4.
02000000:00000001:11.0:1773851906.249448:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851906.249448:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.249449:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851906.249450:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062127, transno 0, xid 1859597823312832
00010000:00000001:11.0:1773851906.249450:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851906.249451:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000004141806f x1859597823312832/t0(0) o400->3761013e-3503-4a7d-ad92-4b3a0f692635@17729@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1604-0'
00010000:00000001:11.0:1773851906.249454:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851906.249454:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851906.249455:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=139 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851906.249456:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851906.249456:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007776ad29 refcount 3 to 17729@kfi7
00000100:00000001:11.0:1773851906.249457:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424336768 : -107145285214848 : ffff9e8d4b55dd80)
02000000:00000001:11.0:1773851906.249458:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851906.249458:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851906.249459:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851906.249460:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17728@kfi7
00000400:00000010:11.0:1773851906.249461:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a08630ef.
00000100:00000200:11.0:1773851906.249462:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597823312832, offset 224
00000400:00000200:11.0:1773851906.249463:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17728@kfi7
00000400:00000200:11.0:1773851906.249464:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:11.0:1773851906.249465:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 1
00000400:00000200:11.0:1773851906.249466:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000400:00000200:11.0:1773851906.249467:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 3
00000400:00000200:11.0:1773851906.249468:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  17728@kfi7 local destination
00000400:00000200:11.0:1773851906.249469:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770568:8770568:1024:4294967295] 17728@kfi7 LPNI seq info [353911:353911:16:4294967295]
00000400:00000200:11.0:1773851906.249470:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000400:00000200:11.0:1773851906.249480:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17728@kfi7 to cpt 2
00000400:00000200:11.0:1773851906.249482:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 17728@kfi7(17728@kfi7:17728@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851906.249484:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 3
00000800:00000200:11.0:1773851906.249485:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851906.249486:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851906.249488:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851906.249490:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e48 Using peer 17728@kfi7(0x100000000000e48)
00000800:00000200:11.0:1773851906.249493:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x100000000000e48: rc=0
00000800:00000200:11.0:1773851906.249495:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e48 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851906.249497:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851906.249498:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007776ad29 refcount 2 to 17729@kfi7
00010000:00000001:11.0:1773851906.249498:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851906.249499:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.249500:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851906.249500:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000004141806f x1859597823312832/t0(0) o400->3761013e-3503-4a7d-ad92-4b3a0f692635@17729@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1604-0'
00000100:00100000:11.0:1773851906.249503:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000004141806f pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:3761013e-3503-4a7d-ad92-4b3a0f692635+165:39695:x1859597823312832:12345-17729@kfi7:400:default-tuolumne1604-0 Request processed in 68us (98us total) trans 0 rc 0/0
00000100:00100000:11.0:1773851906.249505:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17729@kfi7, seq: 2130901
00000100:00000040:11.0:1773851906.249507:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b0be8314 : new rpc_count 0
00000800:00000200:9.0:1773851906.249507:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e48 TN_EVENT_TX_OK event status 0
00000100:00000001:11.0:1773851906.249508:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:11.0:1773851906.249508:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851906.249509:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851906.249509:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000200:9.0:1773851906.249509:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:11.0:1773851906.249510:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000f71ac8fb.
00000400:00000200:9.0:1773851906.249510:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17728@kfi7: PUT: OK
00000020:00000040:11.0:1773851906.249511:0:60829:0:(genops.c:882:class_export_put()) PUTting export 00000000b0be8314 : new refcount 164
00000400:00000200:9.0:1773851906.249511:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a08630ef
00000400:00000010:9.0:1773851906.249512:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a08630ef.
00000100:00000001:9.0:1773851906.249512:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:9.0:1773851906.249513:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:9.0:1773851906.249514:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000007b4fb511 nid 17728@kfi7 refs 2
00000100:00000001:11.0:1773851906.249515:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:9.0:1773851906.249515:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 17728@kfi7(00000000cd9059fd):0x0 lsk 3657 rsk 11 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000e48 Transaction freed
00000800:00000200:5.0:1773851906.254827:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851906.254828:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851906.254830:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851906.254834:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851906.254837:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16322@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.254839:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16322@kfi7 : PUT - for me
00000400:00000200:5.0:1773851906.254841:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16322@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.254842:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7b32008 nid 16322@kfi7 refs 1
00000400:00000200:5.0:1773851906.254844:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16322@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.254845:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7b32008 nid 16322@kfi7 refs 2
00000400:00000200:5.0:1773851906.254847:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e7b32008 nid 16322@kfi7 refs 3
00000400:00000200:5.0:1773851906.254848:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16322@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.254850:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16322@kfi7 of length 224 into portal 12 MB=0x69b84a5c95dc0
00000400:00000200:5.0:1773851906.254852:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16322@kfi7 of length 224/224 into md 0x793926dc5 [64] + 170704
00000800:00000200:5.0:1773851906.254855:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851906.254858:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851906.254861:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16322@kfi7: PUT: OK
00000100:00000001:5.0:1773851906.254862:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851906.254863:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851906.254866:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001a191f88.
00000100:00000040:5.0:1773851906.254867:0:2507993:0:(events.c:358:request_in_callback()) incoming req@000000001a191f88 x1859843879689664 msgsize 224
00000100:00100000:5.0:1773851906.254869:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-16322@kfi7 (source: 12345-16322@kfi7)
00000100:00000001:5.0:1773851906.254871:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851906.254873:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7b32008 nid 16322@kfi7 refs 2
00000100:00000001:7.0:1773851906.254874:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851906.254875:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:5.0:1773851906.254875:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2054@kfi7:1 <- 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851906.254876:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851906.254876:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851906.254878:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851906.254879:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859843879689664
00000020:00000001:7.0:1773851906.254880:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851906.254881:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f087f2036965
00000020:00000001:7.0:1773851906.254882:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851906.254888:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000f3ed1bd5 refcount=169
00000020:00000001:7.0:1773851906.254889:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117669292032 : -106956040259584 : ffff9eb95b36b800)
00000020:00000001:7.0:1773851906.254890:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117669292032 : -106956040259584 : ffff9eb95b36b800)
00000100:00000001:7.0:1773851906.254892:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851906.254893:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851906.254895:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000052baafa5.
00000020:00000010:7.0:1773851906.254896:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851906.254898:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851906.254899:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851906.254900:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851906.254901:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.254903:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851906.254904:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851906.254904:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.254907:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.254909:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:4.0:1773851906.254909:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851906.254910:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851906.254910:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:7.0:1773851906.254912:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16322@kfi7, seq: 2002015
00000100:00000040:7.0:1773851906.254913:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000f3ed1bd5 : new rpc_count 1
00000100:00000001:4.0:1773851906.254913:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.254914:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636967363951232 : -107106345600384 : ffff9e965c513a80)
00000100:00000001:4.0:1773851906.254914:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851906.254916:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001a191f88 x1859843879689664/t0(0) o400->5c4c66a5-a226-45a5-ba3d-944cfa5bd32a@16322@kfi7:694/0 lens 224/0 e 0 to 0 dl 1773852054 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1511-0'
00000100:00000001:7.0:1773851906.254921:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851906.254921:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851906.254923:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001a191f88 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5c4c66a5-a226-45a5-ba3d-944cfa5bd32a+169:40211:x1859843879689664:12345-16322@kfi7:400:default-tuolumne1511-0
00000100:00000200:7.0:1773851906.254925:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859843879689664
00000020:00000001:7.0:1773851906.254926:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851906.254927:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851906.254928:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.254930:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851906.254930:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851906.254932:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851906.254933:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859843879689664, found 0 last_xid 1859843879265791
00000020:00000001:7.0:1773851906.254934:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851906.254935:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851906.254936:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851906.254937:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.254938:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851906.254939:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851906.254940:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851906.254941:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000026933a21.
02000000:00000001:7.0:1773851906.254942:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.254943:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.254944:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851906.254945:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062544, transno 0, xid 1859843879689664
00010000:00000001:7.0:1773851906.254947:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851906.254948:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001a191f88 x1859843879689664/t0(0) o400->5c4c66a5-a226-45a5-ba3d-944cfa5bd32a@16322@kfi7:694/0 lens 224/224 e 0 to 0 dl 1773852054 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1511-0'
00010000:00000001:7.0:1773851906.254953:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851906.254954:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851906.254955:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=138 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851906.254957:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851906.254958:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000bdfa9aeb refcount 3 to 16322@kfi7
00000100:00000001:7.0:1773851906.254960:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918074950496 : -107155634601120 : ffff9e8ae276c360)
02000000:00000001:7.0:1773851906.254961:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851906.254962:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.254963:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851906.254964:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16322@kfi7
00000400:00000010:7.0:1773851906.254966:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000003a17c530.
00000100:00000200:7.0:1773851906.254967:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859843879689664, offset 224
00000400:00000200:7.0:1773851906.254969:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16322@kfi7
00000400:00000200:7.0:1773851906.254971:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16322@kfi7 to cpt 1
00000400:00000200:7.0:1773851906.254972:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e7b32008 nid 16322@kfi7 refs 1
00000400:00000200:7.0:1773851906.254974:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e7b32008 nid 16322@kfi7 refs 2
00000400:00000200:7.0:1773851906.254976:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e7b32008 nid 16322@kfi7 refs 3
00000400:00000200:7.0:1773851906.254977:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16322@kfi7 local destination
00000400:00000200:7.0:1773851906.254980:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770569:8770569:1024:4294967295] 16322@kfi7 LPNI seq info [78808:78808:16:4294967295]
00000400:00000200:7.0:1773851906.254982:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e7b32008 nid 16322@kfi7 refs 2
00000400:00000200:7.0:1773851906.254983:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16322@kfi7 to cpt 1
00000400:00000200:7.0:1773851906.254986:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16322@kfi7(16322@kfi7:16322@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851906.254989:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e7b32008 nid 16322@kfi7 refs 3
00000800:00000200:7.0:1773851906.254991:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851906.254992:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851906.254996:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851906.255000:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007a1 Using peer 16322@kfi7(0x1000000000007a1)
00000800:00000200:7.0:1773851906.255008:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:1 Transaction ID 00000000f47c5f93: Posted send of 324 bytes to peer 0x1000000000007a1: rc=0
00000800:00000200:7.0:1773851906.255010:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007a1 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851906.255014:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851906.255015:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000bdfa9aeb refcount 2 to 16322@kfi7
00010000:00000001:7.0:1773851906.255016:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851906.255017:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.255018:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851906.255019:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001a191f88 x1859843879689664/t0(0) o400->5c4c66a5-a226-45a5-ba3d-944cfa5bd32a@16322@kfi7:694/0 lens 224/224 e 0 to 0 dl 1773852054 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1511-0'
00000100:00100000:7.0:1773851906.255024:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001a191f88 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:5c4c66a5-a226-45a5-ba3d-944cfa5bd32a+169:40211:x1859843879689664:12345-16322@kfi7:400:default-tuolumne1511-0 Request processed in 102us (156us total) trans 0 rc 0/0
00000800:00000200:5.0:1773851906.255024:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007a1 TN_EVENT_TX_OK event status 0
00000400:00000200:5.0:1773851906.255027:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:7.0:1773851906.255028:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16322@kfi7, seq: 2002015
00000100:00000040:7.0:1773851906.255029:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000f3ed1bd5 : new rpc_count 0
00000400:00000200:5.0:1773851906.255029:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16322@kfi7: PUT: OK
00000100:00000001:7.0:1773851906.255030:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851906.255030:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000003a17c530
00000100:00000001:7.0:1773851906.255031:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000400:00000010:5.0:1773851906.255031:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000003a17c530.
00000020:00000010:7.0:1773851906.255032:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000100:00000001:5.0:1773851906.255032:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:5.0:1773851906.255032:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000010:7.0:1773851906.255033:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000400:00000200:5.0:1773851906.255034:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e7b32008 nid 16322@kfi7 refs 2
00000020:00000010:7.0:1773851906.255035:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000052baafa5.
00000020:00000040:7.0:1773851906.255036:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000f3ed1bd5 : new refcount 168
00000800:00000200:5.0:1773851906.255036:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f47c5f93: 2054@kfi7:1 -> 16322@kfi7(0000000022d259a0):0x0 lsk 1954 rsk 32 tsk 0 trmk 0 tmk 0 trr 1 tta 0x1000000000007a1 Transaction freed
00000100:00000001:7.0:1773851906.255037:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:13.0:1773851906.280160:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851906.280161:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851906.280162:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851906.280164:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851906.280166:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280167:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 21755@kfi7 : PUT - for me
00000400:00000200:13.0:1773851906.280168:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280169:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:13.0:1773851906.280170:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280171:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:13.0:1773851906.280172:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:13.0:1773851906.280173:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280174:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21755@kfi7 of length 224 into portal 12 MB=0x699de8c231540
00000400:00000200:13.0:1773851906.280176:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21755@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 64832
00000800:00000200:13.0:1773851906.280178:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851906.280179:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851906.280180:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21755@kfi7: PUT: OK
00000100:00000001:13.0:1773851906.280181:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851906.280182:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851906.280183:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000c2bd7e31.
00000100:00000040:13.0:1773851906.280183:0:2514888:0:(events.c:358:request_in_callback()) incoming req@00000000c2bd7e31 x1858030973162816 msgsize 224
00000100:00100000:13.0:1773851906.280185:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21755@kfi7 (source: 12345-21755@kfi7)
00000100:00000001:13.0:1773851906.280186:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851906.280187:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000100:00000001:14.0:1773851906.280188:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:14.0:1773851906.280188:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000800:00000200:13.0:1773851906.280188:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
00000100:00000001:14.0:1773851906.280189:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851906.280189:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851906.280190:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851906.280191:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030973162816
00000020:00000001:14.0:1773851906.280191:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851906.280192:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac90f58
00000020:00000001:14.0:1773851906.280192:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851906.280196:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000049547fde refcount=6
00000020:00000001:14.0:1773851906.280197:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921239870464 : -107152469681152 : ffff9e8b9f1b9c00)
00000020:00000001:14.0:1773851906.280198:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921239870464 : -107152469681152 : ffff9e8b9f1b9c00)
00000100:00000001:14.0:1773851906.280199:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851906.280200:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851906.280201:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005718a032.
00000020:00000010:14.0:1773851906.280202:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851906.280203:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851906.280204:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851906.280204:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851906.280204:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851906.280205:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851906.280209:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851906.280209:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.280210:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851906.280212:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851906.280212:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851906.280212:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:14.0:1773851906.280213:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21755@kfi7, seq: 2289959
00000100:00000001:12.0:1773851906.280213:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:14.0:1773851906.280214:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000049547fde : new rpc_count 1
00000100:00000001:12.0:1773851906.280214:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.280215:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092566400 : -106946616985216 : ffff9ebb8ce27980)
00000100:00000001:12.0:1773851906.280215:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851906.280216:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000c2bd7e31 x1858030973162816/t0(0) o400->617da55e-691b-4798-ae52-d332b6296a7f@21755@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne253-0'
00000100:00000001:14.0:1773851906.280219:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851906.280219:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851906.280220:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000c2bd7e31 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:617da55e-691b-4798-ae52-d332b6296a7f+6:47684:x1858030973162816:12345-21755@kfi7:400:default-tuolumne253-0
00000100:00000200:14.0:1773851906.280221:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030973162816
00000020:00000001:14.0:1773851906.280222:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851906.280223:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851906.280223:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280224:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851906.280225:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851906.280225:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851906.280226:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030973162816, found 0 last_xid 1858030973162815
00000020:00000001:14.0:1773851906.280227:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851906.280227:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851906.280228:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851906.280228:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280229:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851906.280230:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851906.280230:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851906.280231:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005acd30eb.
02000000:00000001:14.0:1773851906.280232:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.280232:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280233:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851906.280234:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030973162816
00010000:00000001:14.0:1773851906.280235:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851906.280236:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000c2bd7e31 x1858030973162816/t0(0) o400->617da55e-691b-4798-ae52-d332b6296a7f@21755@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00010000:00000001:14.0:1773851906.280238:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851906.280239:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851906.280240:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=139 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851906.280241:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851906.280241:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002affc16a refcount 5 to 21755@kfi7
00000100:00000001:14.0:1773851906.280242:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015836032 : -107152693715584 : ffff9e8b91c11d80)
02000000:00000001:14.0:1773851906.280243:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851906.280243:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.280244:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851906.280245:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21755@kfi7
00000400:00000010:14.0:1773851906.280245:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000082ef9263.
00000100:00000200:14.0:1773851906.280246:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030973162816, offset 224
00000400:00000200:14.0:1773851906.280247:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21755@kfi7
00000400:00000200:14.0:1773851906.280248:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851906.280249:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:14.0:1773851906.280250:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851906.280251:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:14.0:1773851906.280252:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  21755@kfi7 local destination
00000400:00000200:14.0:1773851906.280254:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770570:8770570:1024:4294967295] 21755@kfi7 LPNI seq info [24446:24446:16:4294967295]
00000400:00000200:14.0:1773851906.280255:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851906.280256:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851906.280258:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 21755@kfi7(21755@kfi7:21755@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851906.280259:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000800:00000200:14.0:1773851906.280261:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851906.280262:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851906.280264:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851906.280266:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 Using peer 21755@kfi7(0x100000000000781)
00000800:00000200:14.0:1773851906.280270:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 000000004c2b9f01: Posted send of 324 bytes to peer 0x100000000000781: rc=0
00000800:00000200:14.0:1773851906.280271:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851906.280274:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851906.280274:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002affc16a refcount 4 to 21755@kfi7
00010000:00000001:14.0:1773851906.280275:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851906.280276:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280276:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851906.280277:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000c2bd7e31 x1858030973162816/t0(0) o400->617da55e-691b-4798-ae52-d332b6296a7f@21755@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00000100:00100000:14.0:1773851906.280280:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000c2bd7e31 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:617da55e-691b-4798-ae52-d332b6296a7f+6:47684:x1858030973162816:12345-21755@kfi7:400:default-tuolumne253-0 Request processed in 61us (96us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851906.280283:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21755@kfi7, seq: 2289959
00000100:00000040:14.0:1773851906.280283:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000049547fde : new rpc_count 0
00000800:00000200:13.0:1773851906.280283:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851906.280284:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851906.280284:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851906.280285:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000400:00000200:13.0:1773851906.280285:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:14.0:1773851906.280286:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000400:00000200:13.0:1773851906.280286:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->21755@kfi7: PUT: OK
00000400:00000200:13.0:1773851906.280286:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000082ef9263
00000020:00000010:14.0:1773851906.280287:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005718a032.
00000020:00000040:14.0:1773851906.280287:0:60824:0:(genops.c:882:class_export_put()) PUTting export 0000000049547fde : new refcount 5
00000400:00000010:13.0:1773851906.280287:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000082ef9263.
00000100:00000001:14.0:1773851906.280288:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:13.0:1773851906.280288:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851906.280288:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851906.280289:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000800:00000200:13.0:1773851906.280290:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000004c2b9f01: 2054@kfi7:3 -> 21755@kfi7(0000000050f809aa):0x0 lsk 1922 rsk 84 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000781 Transaction freed
00000800:00000200:13.0:1773851906.280841:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851906.280841:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851906.280842:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851906.280844:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851906.280846:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280848:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 21755@kfi7 : PUT - for me
00000400:00000200:13.0:1773851906.280849:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280849:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:13.0:1773851906.280850:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280851:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:13.0:1773851906.280852:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:13.0:1773851906.280852:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.280853:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-21755@kfi7 of length 224 into portal 12 MB=0x699de8c231cc0
00000400:00000200:13.0:1773851906.280854:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-21755@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 65056
00000800:00000200:13.0:1773851906.280855:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851906.280857:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851906.280858:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21755@kfi7: PUT: OK
00000100:00000001:13.0:1773851906.280859:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851906.280859:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851906.280860:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000053da6f00.
00000100:00000040:13.0:1773851906.280861:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000053da6f00 x1858030973164736 msgsize 224
00000100:00100000:13.0:1773851906.280862:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-21755@kfi7 (source: 12345-21755@kfi7)
00000100:00000001:13.0:1773851906.280863:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:14.0:1773851906.280864:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:13.0:1773851906.280864:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
02000000:00000001:14.0:1773851906.280865:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851906.280865:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851906.280865:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:13.0:1773851906.280865:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2069@kfi7:3 <- 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851906.280866:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851906.280867:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030973164736
00000020:00000001:14.0:1773851906.280867:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851906.280868:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac911b9
00000020:00000001:14.0:1773851906.280868:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851906.280871:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000ea37d21d refcount=6
00000020:00000001:14.0:1773851906.280872:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240541184 : -107152469010432 : ffff9e8b9f25d800)
00000020:00000001:14.0:1773851906.280873:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240541184 : -107152469010432 : ffff9e8b9f25d800)
00000100:00000001:14.0:1773851906.280874:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851906.280874:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851906.280875:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005718a032.
00000020:00000010:14.0:1773851906.280875:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851906.280876:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851906.280877:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851906.280877:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851906.280878:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851906.280878:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851906.280879:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851906.280879:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.280880:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851906.280881:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851906.280881:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851906.280882:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-21755@kfi7, seq: 2289960
00000100:00000001:12.0:1773851906.280882:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851906.280882:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:14.0:1773851906.280883:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000ea37d21d : new rpc_count 1
00000100:00000001:14.0:1773851906.280883:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092551424 : -106946617000192 : ffff9ebb8ce23f00)
00000100:00000001:12.0:1773851906.280883:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851906.280883:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851906.280884:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000053da6f00 x1858030973164736/t0(0) o400->8a787133-e548-4933-b9b5-1a87a61de2a4@21755@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne253-0'
00000100:00000001:14.0:1773851906.280887:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851906.280887:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851906.280888:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000053da6f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8a787133-e548-4933-b9b5-1a87a61de2a4+6:47682:x1858030973164736:12345-21755@kfi7:400:default-tuolumne253-0
00000100:00000200:14.0:1773851906.280889:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030973164736
00000020:00000001:14.0:1773851906.280890:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851906.280890:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851906.280891:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280891:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851906.280892:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851906.280892:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851906.280893:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030973164736, found 0 last_xid 1858030973164735
00000020:00000001:14.0:1773851906.280894:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851906.280894:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851906.280895:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851906.280895:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280896:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851906.280896:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851906.280897:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851906.280898:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000052f11e69.
02000000:00000001:14.0:1773851906.280898:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.280898:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280899:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851906.280899:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 171799768118, transno 0, xid 1858030973164736
00010000:00000001:14.0:1773851906.280900:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851906.280901:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000053da6f00 x1858030973164736/t0(0) o400->8a787133-e548-4933-b9b5-1a87a61de2a4@21755@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00010000:00000001:14.0:1773851906.280903:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851906.280903:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851906.280904:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=139 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851906.280905:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851906.280906:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000002affc16a refcount 5 to 21755@kfi7
00000100:00000001:14.0:1773851906.280906:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636921015836032 : -107152693715584 : ffff9e8b91c11d80)
02000000:00000001:14.0:1773851906.280907:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851906.280907:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.280908:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851906.280908:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-21755@kfi7
00000400:00000010:14.0:1773851906.280909:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004c617e88.
00000100:00000200:14.0:1773851906.280910:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030973164736, offset 224
00000400:00000200:14.0:1773851906.280911:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-21755@kfi7
00000400:00000200:14.0:1773851906.280911:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851906.280912:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 1
00000400:00000200:14.0:1773851906.280913:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851906.280914:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000400:00000200:14.0:1773851906.280915:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  21755@kfi7 local destination
00000400:00000200:14.0:1773851906.280917:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770571:8770571:1024:4294967295] 21755@kfi7 LPNI seq info [24447:24447:16:4294967295]
00000400:00000200:14.0:1773851906.280919:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000400:00000200:14.0:1773851906.280920:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 21755@kfi7 to cpt 3
00000400:00000200:14.0:1773851906.280922:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 21755@kfi7(21755@kfi7:21755@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851906.280923:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 3
00000800:00000200:14.0:1773851906.280924:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851906.280925:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851906.280927:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851906.280929:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 Using peer 21755@kfi7(0x205)
00000800:00000200:14.0:1773851906.280932:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:3 Transaction ID 00000000e70f539d: Posted send of 324 bytes to peer 0x205: rc=0
00000800:00000200:14.0:1773851906.280933:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851906.280935:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851906.280936:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000002affc16a refcount 4 to 21755@kfi7
00010000:00000001:14.0:1773851906.280936:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851906.280936:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.280937:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851906.280938:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000053da6f00 x1858030973164736/t0(0) o400->8a787133-e548-4933-b9b5-1a87a61de2a4@21755@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne253-0'
00000100:00100000:14.0:1773851906.280940:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000053da6f00 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:8a787133-e548-4933-b9b5-1a87a61de2a4+6:47682:x1858030973164736:12345-21755@kfi7:400:default-tuolumne253-0 Request processed in 53us (79us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851906.280943:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-21755@kfi7, seq: 2289960
00000100:00000040:14.0:1773851906.280943:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000ea37d21d : new rpc_count 0
00000100:00000001:14.0:1773851906.280944:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:14.0:1773851906.280944:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851906.280945:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851906.280945:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000800:00000200:13.0:1773851906.280945:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 TN_EVENT_TX_OK event status 0
00000020:00000010:14.0:1773851906.280946:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005718a032.
00000400:00000200:13.0:1773851906.280946:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:14.0:1773851906.280947:0:60824:0:(genops.c:882:class_export_put()) PUTting export 00000000ea37d21d : new refcount 5
00000400:00000200:13.0:1773851906.280947:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->21755@kfi7: PUT: OK
00000400:00000200:13.0:1773851906.280947:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004c617e88
00000100:00000001:14.0:1773851906.280948:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000010:13.0:1773851906.280948:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004c617e88.
00000100:00000001:13.0:1773851906.280948:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851906.280949:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851906.280950:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008d8e64c2 nid 21755@kfi7 refs 2
00000800:00000200:13.0:1773851906.280951:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e70f539d: 2069@kfi7:3 -> 21755@kfi7(00000000558b96e6):0x0 lsk 518 rsk 85 tsk 0 trmk 0 tmk 0 trr 3 tta 0x205 Transaction freed
00000800:00000200:9.0:1773851906.305114:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851906.305115:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851906.305116:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851906.305118:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851906.305120:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.305121:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 24082@kfi7 : PUT - for me
00000400:00000200:9.0:1773851906.305122:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.305123:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 1
00000400:00000200:9.0:1773851906.305124:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.305125:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000400:00000200:9.0:1773851906.305126:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 3
00000400:00000200:9.0:1773851906.305127:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24274@kfi7 to cpt 4
00000400:00000200:9.0:1773851906.305128:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24274@kfi7 of length 224 into portal 12 MB=0x69b4c62a00440
00000400:00000200:9.0:1773851906.305129:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24274@kfi7 of length 224/224 into md 0x78146ce49 [64] + 170712
00000800:00000200:9.0:1773851906.305131:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851906.305132:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851906.305134:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24082@kfi7: PUT: OK
00000100:00000001:9.0:1773851906.305135:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851906.305135:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851906.305136:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000001aabd78b.
00000100:00000040:9.0:1773851906.305137:0:2458095:0:(events.c:358:request_in_callback()) incoming req@000000001aabd78b x1859602234737728 msgsize 224
00000100:00100000:9.0:1773851906.305139:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-24274@kfi7 (source: 12345-24082@kfi7)
00000100:00000001:9.0:1773851906.305140:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000100:00000001:11.0:1773851906.305141:0:60829:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000400:00000200:9.0:1773851906.305141:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 2
02000000:00000001:11.0:1773851906.305142:0:60829:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:11.0:1773851906.305142:0:60829:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:11.0:1773851906.305142:0:60829:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:9.0:1773851906.305142:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:11.0:1773851906.305143:0:60829:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:11.0:1773851906.305144:0:60829:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859602234737728
00000020:00000001:11.0:1773851906.305144:0:60829:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:11.0:1773851906.305145:0:60829:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e5ff8db1f
00000020:00000001:11.0:1773851906.305145:0:60829:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:11.0:1773851906.305149:0:60829:0:(lustre_handles.c:151:class_handle2object()) GET export 000000000281f20d refcount=5
00000020:00000001:11.0:1773851906.305150:0:60829:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637117511712768 : -106956197838848 : ffff9eb951d24000)
00000020:00000001:11.0:1773851906.305151:0:60829:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637117511712768 : -106956197838848 : ffff9eb951d24000)
00000100:00000001:11.0:1773851906.305152:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851906.305153:0:60829:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:11.0:1773851906.305153:0:60829:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000a0cb0c3c.
00000020:00000010:11.0:1773851906.305154:0:60829:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000005e0077c3.
00000020:00000010:11.0:1773851906.305155:0:60829:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a202c870.
00000100:00000001:11.0:1773851906.305156:0:60829:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:11.0:1773851906.305156:0:60829:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:11.0:1773851906.305157:0:60829:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851906.305158:0:60829:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:11.0:1773851906.305158:0:60829:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:11.0:1773851906.305158:0:60829:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851906.305159:0:60829:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:11.0:1773851906.305160:0:60829:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:11.0:1773851906.305161:0:60829:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:8.0:1773851906.305161:0:60898:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:8.0:1773851906.305161:0:60898:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:11.0:1773851906.305162:0:60829:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24274@kfi7, seq: 2130902
00000100:00000040:11.0:1773851906.305162:0:60829:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000000281f20d : new rpc_count 1
00000100:00000001:11.0:1773851906.305163:0:60829:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498308736 : -106953211242880 : ffff9eba03d61680)
00000100:00000001:8.0:1773851906.305163:0:60898:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:8.0:1773851906.305163:0:60898:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851906.305164:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000001aabd78b x1859602234737728/t0(0) o400->c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca@24274@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2005-0'
00000100:00000001:11.0:1773851906.305167:0:60829:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:11.0:1773851906.305167:0:60829:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:11.0:1773851906.305169:0:60829:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000001aabd78b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca+5:39647:x1859602234737728:12345-24274@kfi7:400:default-tuolumne2005-0
00000100:00000200:11.0:1773851906.305170:0:60829:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859602234737728
00000020:00000001:11.0:1773851906.305171:0:60829:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:11.0:1773851906.305172:0:60829:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:11.0:1773851906.305172:0:60829:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.305173:0:60829:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:11.0:1773851906.305173:0:60829:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:11.0:1773851906.305174:0:60829:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:11.0:1773851906.305175:0:60829:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859602234737728, found 0 last_xid 1859602234737727
00000020:00000001:11.0:1773851906.305176:0:60829:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:11.0:1773851906.305176:0:60829:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:11.0:1773851906.305177:0:60829:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:11.0:1773851906.305177:0:60829:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.305178:0:60829:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:11.0:1773851906.305178:0:60829:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:11.0:1773851906.305179:0:60829:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:11.0:1773851906.305179:0:60829:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003961a60c.
02000000:00000001:11.0:1773851906.305180:0:60829:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851906.305180:0:60829:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.305181:0:60829:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:11.0:1773851906.305182:0:60829:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183046923900, transno 0, xid 1859602234737728
00010000:00000001:11.0:1773851906.305182:0:60829:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:11.0:1773851906.305183:0:60829:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000001aabd78b x1859602234737728/t0(0) o400->c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca@24274@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2005-0'
00010000:00000001:11.0:1773851906.305185:0:60829:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:11.0:1773851906.305186:0:60829:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:11.0:1773851906.305187:0:60829:0:(import.c:1951:at_measured()) add 1 to 000000003fb946a0 time=139 v=66 (1 1 1 1)
00000100:00000001:11.0:1773851906.305188:0:60829:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:11.0:1773851906.305188:0:60829:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000000f9c17ad refcount 3 to 24274@kfi7
00000100:00000001:11.0:1773851906.305189:0:60829:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917583961184 : -107156125590432 : ffff9e8ac532dc60)
02000000:00000001:11.0:1773851906.305190:0:60829:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:11.0:1773851906.305190:0:60829:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:11.0:1773851906.305191:0:60829:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:11.0:1773851906.305192:0:60829:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24082@kfi7
00000400:00000010:11.0:1773851906.305193:0:60829:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000000fb1e983.
00000100:00000200:11.0:1773851906.305194:0:60829:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859602234737728, offset 224
00000400:00000200:11.0:1773851906.305195:0:60829:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24082@kfi7
00000400:00000200:11.0:1773851906.305196:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:11.0:1773851906.305196:0:60829:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 1
00000400:00000200:11.0:1773851906.305197:0:60829:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000400:00000200:11.0:1773851906.305198:0:60829:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 3
00000400:00000200:11.0:1773851906.305199:0:60829:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  24082@kfi7 local destination
00000400:00000200:11.0:1773851906.305200:0:60829:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770572:8770572:1024:4294967295] 24082@kfi7 LPNI seq info [8357038:8357038:16:4294967295]
00000400:00000200:11.0:1773851906.305202:0:60829:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000400:00000200:11.0:1773851906.305203:0:60829:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24082@kfi7 to cpt 2
00000400:00000200:11.0:1773851906.305204:0:60829:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 24082@kfi7(24082@kfi7:24082@kfi7) <?> : PUT try# 0
00000400:00000200:11.0:1773851906.305206:0:60829:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 3
00000800:00000200:11.0:1773851906.305207:0:60829:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:11.0:1773851906.305208:0:60829:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:11.0:1773851906.305210:0:60829:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:11.0:1773851906.305212:0:60829:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a46 Using peer 24082@kfi7(0x100000000000a46)
00000800:00000200:11.0:1773851906.305215:0:60829:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:2 Transaction ID 00000000ffa6bc9d: Posted send of 324 bytes to peer 0x100000000000a46: rc=0
00000800:00000200:11.0:1773851906.305216:0:60829:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a46 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:11.0:1773851906.305218:0:60829:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:11.0:1773851906.305219:0:60829:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000000f9c17ad refcount 2 to 24274@kfi7
00010000:00000001:11.0:1773851906.305220:0:60829:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:11.0:1773851906.305220:0:60829:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:11.0:1773851906.305221:0:60829:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:11.0:1773851906.305221:0:60829:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000001aabd78b x1859602234737728/t0(0) o400->c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca@24274@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2005-0'
00000100:00100000:11.0:1773851906.305227:0:60829:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000001aabd78b pname:cluuid+ref:pid:xid:nid:opc:job mdt02_062:c052ad4e-7aa8-4696-ab9c-e877ffe6a7ca+5:39647:x1859602234737728:12345-24274@kfi7:400:default-tuolumne2005-0 Request processed in 59us (89us total) trans 0 rc 0/0
00000800:00000200:9.0:1773851906.305228:0:2458095:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a46 TN_EVENT_TX_OK event status 0
00000100:00100000:11.0:1773851906.305230:0:60829:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24274@kfi7, seq: 2130902
00000400:00000200:9.0:1773851906.305230:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000040:11.0:1773851906.305231:0:60829:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000000281f20d : new rpc_count 0
00000100:00000001:11.0:1773851906.305231:0:60829:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:9.0:1773851906.305231:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->24082@kfi7: PUT: OK
00000100:00000001:11.0:1773851906.305232:0:60829:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:11.0:1773851906.305232:0:60829:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000005e0077c3.
00000400:00000200:9.0:1773851906.305232:0:2458095:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000000fb1e983
00000020:00000010:11.0:1773851906.305233:0:60829:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a202c870.
00000400:00000010:9.0:1773851906.305233:0:2458095:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000000fb1e983.
00000100:00000001:9.0:1773851906.305233:0:2458095:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000010:11.0:1773851906.305234:0:60829:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000a0cb0c3c.
00000100:00000001:9.0:1773851906.305234:0:2458095:0:(events.c:419:reply_out_callback()) Process leaving
00000020:00000040:11.0:1773851906.305235:0:60829:0:(genops.c:882:class_export_put()) PUTting export 000000000281f20d : new refcount 4
00000100:00000001:11.0:1773851906.305235:0:60829:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:9.0:1773851906.305235:0:2458095:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000034108dfa nid 24082@kfi7 refs 2
00000800:00000200:9.0:1773851906.305236:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000ffa6bc9d: 2054@kfi7:2 -> 24082@kfi7(0000000036a7c05b):0x0 lsk 2631 rsk 10 tsk 0 trmk 0 tmk 0 trr 2 tta 0x100000000000a46 Transaction freed
00000800:00000200:25.0:1773851906.312808:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851906.312810:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851906.312810:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851906.312813:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851906.312814:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24128@kfi7 to cpt 6
00000400:00000200:25.0:1773851906.312815:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 24128@kfi7 : PUT - for me
00000400:00000200:25.0:1773851906.312816:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24128@kfi7 to cpt 6
00000400:00000200:25.0:1773851906.312817:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004d852ad8 nid 24128@kfi7 refs 1
00000400:00000200:25.0:1773851906.312818:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24128@kfi7 to cpt 6
00000400:00000200:25.0:1773851906.312819:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004d852ad8 nid 24128@kfi7 refs 2
00000400:00000200:25.0:1773851906.312820:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000004d852ad8 nid 24128@kfi7 refs 3
00000400:00000200:25.0:1773851906.312820:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24128@kfi7 to cpt 6
00000400:00000200:25.0:1773851906.312821:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-24128@kfi7 of length 224 into portal 12 MB=0x699e145b03340
00000400:00000200:25.0:1773851906.312822:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-24128@kfi7 of length 224/224 into md 0x16159c9699 [64] + 48320
00000800:00000200:25.0:1773851906.312824:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851906.312825:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851906.312826:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24128@kfi7: PUT: OK
00000100:00000001:25.0:1773851906.312827:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851906.312827:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:25.0:1773851906.312828:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000a676cf2e.
00000100:00000040:25.0:1773851906.312829:0:2494371:0:(events.c:358:request_in_callback()) incoming req@00000000a676cf2e x1858042676130624 msgsize 224
00000100:00100000:25.0:1773851906.312830:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-24128@kfi7 (source: 12345-24128@kfi7)
00000100:00000001:25.0:1773851906.312831:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851906.312832:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000004d852ad8 nid 24128@kfi7 refs 2
00000800:00000200:25.0:1773851906.312833:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2069@kfi7:6 <- 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
00000100:00000001:24.0:1773851906.312833:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:24.0:1773851906.312833:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851906.312834:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851906.312835:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851906.312835:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851906.312836:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042676130624
00000020:00000001:24.0:1773851906.312837:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851906.312837:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92cf5
00000020:00000001:24.0:1773851906.312838:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851906.312840:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 000000004ea3057c refcount=25
00000020:00000001:24.0:1773851906.312841:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744182784 : -107128965368832 : ffff9e911812f400)
00000020:00000001:24.0:1773851906.312842:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744182784 : -107128965368832 : ffff9e911812f400)
00000100:00000001:24.0:1773851906.312843:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.312843:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851906.312844:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851906.312845:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.312846:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851906.312846:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851906.312847:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851906.312847:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851906.312848:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851906.312848:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851906.312849:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.312850:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851906.312851:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851906.312851:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851906.312851:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851906.312852:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851906.312852:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-24128@kfi7, seq: 2025206
00000100:00000001:26.0:1773851906.312853:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851906.312853:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000004ea3057c : new rpc_count 2
00000100:00000001:26.0:1773851906.312854:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.312854:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636996227507200 : -107077482044416 : ffff9e9d14b82400)
00000100:00000040:24.0:1773851906.312855:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000a676cf2e x1858042676130624/t0(0) o400->dc18368a-698b-4893-ba34-a9c0cf7621ac@24128@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2004-0'
00000100:00000001:24.0:1773851906.312857:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.312858:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851906.312858:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000a676cf2e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:dc18368a-698b-4893-ba34-a9c0cf7621ac+25:39700:x1858042676130624:12345-24128@kfi7:400:default-tuolumne2004-0
00000100:00000200:24.0:1773851906.312860:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042676130624
00000020:00000001:24.0:1773851906.312860:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851906.312861:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851906.312861:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.312862:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851906.312863:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851906.312864:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851906.312864:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042676130624, found 0 last_xid 1858042675624319
00000020:00000001:24.0:1773851906.312865:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851906.312865:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851906.312866:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851906.312866:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.312867:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851906.312868:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851906.312868:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851906.312869:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003bdccbc6.
02000000:00000001:24.0:1773851906.312869:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.312870:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.312871:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851906.312871:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264524668, transno 0, xid 1858042676130624
00010000:00000001:24.0:1773851906.312872:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851906.312873:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000a676cf2e x1858042676130624/t0(0) o400->dc18368a-698b-4893-ba34-a9c0cf7621ac@24128@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2004-0'
00010000:00000001:24.0:1773851906.312875:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851906.312875:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851906.312876:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=139 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851906.312877:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851906.312878:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000008b8fa1c refcount 3 to 24128@kfi7
00000100:00000001:24.0:1773851906.312878:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918299329280 : -107155410222336 : ffff9e8aefd68300)
02000000:00000001:24.0:1773851906.312879:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851906.312880:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.312880:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851906.312881:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-24128@kfi7
00000400:00000010:24.0:1773851906.312882:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000047620e92.
00000100:00000200:24.0:1773851906.312882:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042676130624, offset 224
00000400:00000200:24.0:1773851906.312884:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-24128@kfi7
00000400:00000200:24.0:1773851906.312884:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24128@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.312885:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000004d852ad8 nid 24128@kfi7 refs 1
00000400:00000200:24.0:1773851906.312886:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000004d852ad8 nid 24128@kfi7 refs 2
00000400:00000200:24.0:1773851906.312887:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000004d852ad8 nid 24128@kfi7 refs 3
00000400:00000200:24.0:1773851906.312888:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  24128@kfi7 local destination
00000400:00000200:24.0:1773851906.312890:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770573:8770573:1024:4294967295] 24128@kfi7 LPNI seq info [46851:46851:16:4294967295]
00000400:00000200:24.0:1773851906.312891:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000004d852ad8 nid 24128@kfi7 refs 2
00000400:00000200:24.0:1773851906.312892:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 24128@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.312894:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 24128@kfi7(24128@kfi7:24128@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851906.312895:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000004d852ad8 nid 24128@kfi7 refs 3
00000800:00000200:24.0:1773851906.312896:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851906.312897:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851906.312899:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851906.312901:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x47f Using peer 24128@kfi7(0x47f)
00000800:00000200:24.0:1773851906.312903:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 000000007491e18f: Posted send of 324 bytes to peer 0x47f: rc=0
00000800:00000200:24.0:1773851906.312905:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x47f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851906.312907:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851906.312908:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000008b8fa1c refcount 2 to 24128@kfi7
00010000:00000001:24.0:1773851906.312908:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851906.312909:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.312909:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851906.312910:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000a676cf2e x1858042676130624/t0(0) o400->dc18368a-698b-4893-ba34-a9c0cf7621ac@24128@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2004-0'
00000100:00100000:24.0:1773851906.312914:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000a676cf2e pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:dc18368a-698b-4893-ba34-a9c0cf7621ac+25:39700:x1858042676130624:12345-24128@kfi7:400:default-tuolumne2004-0 Request processed in 56us (84us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851906.312916:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-24128@kfi7, seq: 2025206
00000100:00000040:24.0:1773851906.312917:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000004ea3057c : new rpc_count 1
00000100:00000001:24.0:1773851906.312917:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851906.312918:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851906.312919:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.312919:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851906.312920:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851906.312921:0:60973:0:(genops.c:882:class_export_put()) PUTting export 000000004ea3057c : new refcount 24
00000100:00000001:24.0:1773851906.312921:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851906.312926:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x47f TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851906.312927:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851906.312928:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->24128@kfi7: PUT: OK
00000400:00000200:25.0:1773851906.312931:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000047620e92
00000400:00000010:25.0:1773851906.312931:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000047620e92.
00000100:00000001:25.0:1773851906.312932:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851906.312932:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851906.312933:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000004d852ad8 nid 24128@kfi7 refs 2
00000800:00000200:25.0:1773851906.312934:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007491e18f: 2069@kfi7:6 -> 24128@kfi7(00000000c58cc5a4):0x0 lsk 1152 rsk 51 tsk 0 trmk 0 tmk 0 trr 6 tta 0x47f Transaction freed
00000800:00000200:13.0:1773851906.329862:0:2514888:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:13.0:1773851906.329862:0:2514888:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:3 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:13.0:1773851906.329864:0:2514888:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:13.0:1773851906.329866:0:2514888:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:13.0:1773851906.329868:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.329869:0:2514888:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 13490@kfi7 : PUT - for me
00000400:00000200:13.0:1773851906.329870:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.329871:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 1
00000400:00000200:13.0:1773851906.329872:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:13.0:1773851906.329873:0:2514888:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000400:00000200:13.0:1773851906.329874:0:2514888:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 3
00000400:00000200:13.0:1773851906.329874:0:2514888:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13491@kfi7 to cpt 6
00000400:00000200:13.0:1773851906.329875:0:2514888:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-13491@kfi7 of length 224 into portal 12 MB=0x699e13ec4f580
00000400:00000200:13.0:1773851906.329876:0:2514888:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-13491@kfi7 of length 224/224 into md 0x82a36e8ed [64] + 65280
00000800:00000200:13.0:1773851906.329878:0:2514888:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:13.0:1773851906.329880:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:13.0:1773851906.329881:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13490@kfi7: PUT: OK
00000100:00000001:13.0:1773851906.329882:0:2514888:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:13.0:1773851906.329882:0:2514888:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:13.0:1773851906.329883:0:2514888:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000005ae69a0.
00000100:00000040:13.0:1773851906.329884:0:2514888:0:(events.c:358:request_in_callback()) incoming req@0000000005ae69a0 x1858042560050560 msgsize 224
00000100:00100000:13.0:1773851906.329885:0:2514888:0:(events.c:361:request_in_callback()) peer: 12345-13491@kfi7 (source: 12345-13490@kfi7)
00000100:00000001:13.0:1773851906.329886:0:2514888:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:13.0:1773851906.329887:0:2514888:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000100:00000001:14.0:1773851906.329888:0:60824:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:13.0:1773851906.329888:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000af8ff251: 2054@kfi7:3 <- 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 Transaction freed
02000000:00000001:14.0:1773851906.329889:0:60824:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:14.0:1773851906.329889:0:60824:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:14.0:1773851906.329889:0:60824:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:14.0:1773851906.329890:0:60824:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:14.0:1773851906.329891:0:60824:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042560050560
00000020:00000001:14.0:1773851906.329891:0:60824:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:14.0:1773851906.329892:0:60824:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91b52
00000020:00000001:14.0:1773851906.329892:0:60824:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:14.0:1773851906.329897:0:60824:0:(lustre_handles.c:151:class_handle2object()) GET export 000000005961a270 refcount=6
00000020:00000001:14.0:1773851906.329897:0:60824:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950628039680 : -107123081511936 : ffff9e9276c77c00)
00000020:00000001:14.0:1773851906.329898:0:60824:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950628039680 : -107123081511936 : ffff9e9276c77c00)
00000100:00000001:14.0:1773851906.329899:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851906.329900:0:60824:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:14.0:1773851906.329900:0:60824:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000005718a032.
00000020:00000010:14.0:1773851906.329901:0:60824:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851906.329902:0:60824:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000a2230bb4.
00000100:00000001:14.0:1773851906.329903:0:60824:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:14.0:1773851906.329903:0:60824:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:14.0:1773851906.329904:0:60824:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851906.329905:0:60824:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:14.0:1773851906.329905:0:60824:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:14.0:1773851906.329906:0:60824:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.329906:0:60824:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:14.0:1773851906.329907:0:60824:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:14.0:1773851906.329908:0:60824:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:12.0:1773851906.329908:0:60487:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:12.0:1773851906.329908:0:60487:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:14.0:1773851906.329909:0:60824:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-13491@kfi7, seq: 2289961
00000100:00000040:14.0:1773851906.329910:0:60824:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000005961a270 : new rpc_count 1
00000100:00000001:14.0:1773851906.329910:0:60824:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637127092535296 : -106946617016320 : ffff9ebb8ce20000)
00000100:00000001:12.0:1773851906.329910:0:60487:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:12.0:1773851906.329911:0:60487:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851906.329912:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000005ae69a0 x1858042560050560/t0(0) o400->7d6510c0-1e31-448e-a25c-8cd71c721d01@13491@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1322-0'
00000100:00000001:14.0:1773851906.329914:0:60824:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:14.0:1773851906.329915:0:60824:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:14.0:1773851906.329916:0:60824:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000005ae69a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7d6510c0-1e31-448e-a25c-8cd71c721d01+6:39667:x1858042560050560:12345-13491@kfi7:400:default-tuolumne1322-0
00000100:00000200:14.0:1773851906.329918:0:60824:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042560050560
00000020:00000001:14.0:1773851906.329918:0:60824:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:14.0:1773851906.329919:0:60824:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:14.0:1773851906.329919:0:60824:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.329920:0:60824:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:14.0:1773851906.329921:0:60824:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:14.0:1773851906.329921:0:60824:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:14.0:1773851906.329922:0:60824:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042560050560, found 0 last_xid 1858042560050559
00000020:00000001:14.0:1773851906.329923:0:60824:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:14.0:1773851906.329923:0:60824:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:14.0:1773851906.329924:0:60824:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:14.0:1773851906.329924:0:60824:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.329925:0:60824:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:14.0:1773851906.329926:0:60824:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:14.0:1773851906.329926:0:60824:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:14.0:1773851906.329927:0:60824:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000e4be56a1.
02000000:00000001:14.0:1773851906.329928:0:60824:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.329928:0:60824:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.329929:0:60824:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:14.0:1773851906.329930:0:60824:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183230551873, transno 0, xid 1858042560050560
00010000:00000001:14.0:1773851906.329930:0:60824:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:14.0:1773851906.329931:0:60824:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000005ae69a0 x1858042560050560/t0(0) o400->7d6510c0-1e31-448e-a25c-8cd71c721d01@13491@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1322-0'
00010000:00000001:14.0:1773851906.329933:0:60824:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:14.0:1773851906.329934:0:60824:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:14.0:1773851906.329934:0:60824:0:(import.c:1951:at_measured()) add 1 to 00000000c401c819 time=139 v=66 (1 1 1 1)
00000100:00000001:14.0:1773851906.329935:0:60824:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:14.0:1773851906.329936:0:60824:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000da50139c refcount 3 to 13491@kfi7
00000100:00000001:14.0:1773851906.329937:0:60824:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636931366321344 : -107142343230272 : ffff9e8dfab0fcc0)
02000000:00000001:14.0:1773851906.329938:0:60824:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:14.0:1773851906.329938:0:60824:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:14.0:1773851906.329939:0:60824:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:14.0:1773851906.329940:0:60824:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-13490@kfi7
00000400:00000010:14.0:1773851906.329940:0:60824:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000005496b2bb.
00000100:00000200:14.0:1773851906.329941:0:60824:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858042560050560, offset 224
00000400:00000200:14.0:1773851906.329942:0:60824:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-13490@kfi7
00000400:00000200:14.0:1773851906.329943:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:14.0:1773851906.329944:0:60824:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 1
00000400:00000200:14.0:1773851906.329945:0:60824:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000400:00000200:14.0:1773851906.329946:0:60824:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 3
00000400:00000200:14.0:1773851906.329947:0:60824:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  13490@kfi7 local destination
00000400:00000200:14.0:1773851906.329948:0:60824:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770574:8770574:1024:4294967295] 13490@kfi7 LPNI seq info [9271792:9271792:16:4294967295]
00000400:00000200:14.0:1773851906.329950:0:60824:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000400:00000200:14.0:1773851906.329951:0:60824:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 13490@kfi7 to cpt 3
00000400:00000200:14.0:1773851906.329952:0:60824:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 13490@kfi7(13490@kfi7:13490@kfi7) <?> : PUT try# 0
00000400:00000200:14.0:1773851906.329953:0:60824:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 3
00000800:00000200:14.0:1773851906.329955:0:60824:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:3 Transaction ID 0 allocated
00000800:00000200:14.0:1773851906.329956:0:60824:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:14.0:1773851906.329958:0:60824:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:14.0:1773851906.329960:0:60824:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a41 Using peer 13490@kfi7(0x100000000000a41)
00000800:00000200:14.0:1773851906.329963:0:60824:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:3 Transaction ID 00000000dac95d1f: Posted send of 324 bytes to peer 0x100000000000a41: rc=0
00000800:00000200:14.0:1773851906.329964:0:60824:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a41 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:14.0:1773851906.329966:0:60824:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:14.0:1773851906.329967:0:60824:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000da50139c refcount 2 to 13491@kfi7
00010000:00000001:14.0:1773851906.329968:0:60824:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:14.0:1773851906.329968:0:60824:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:14.0:1773851906.329969:0:60824:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:14.0:1773851906.329969:0:60824:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000005ae69a0 x1858042560050560/t0(0) o400->7d6510c0-1e31-448e-a25c-8cd71c721d01@13491@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1322-0'
00000100:00100000:14.0:1773851906.329973:0:60824:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000005ae69a0 pname:cluuid+ref:pid:xid:nid:opc:job mdt03_060:7d6510c0-1e31-448e-a25c-8cd71c721d01+6:39667:x1858042560050560:12345-13491@kfi7:400:default-tuolumne1322-0 Request processed in 57us (88us total) trans 0 rc 0/0
00000100:00100000:14.0:1773851906.329975:0:60824:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-13491@kfi7, seq: 2289961
00000100:00000040:14.0:1773851906.329976:0:60824:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000005961a270 : new rpc_count 0
00000100:00000001:14.0:1773851906.329976:0:60824:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000800:00000200:13.0:1773851906.329976:0:2514888:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a41 TN_EVENT_TX_OK event status 0
00000100:00000001:14.0:1773851906.329977:0:60824:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:14.0:1773851906.329977:0:60824:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000457ed2ed.
00000020:00000010:14.0:1773851906.329978:0:60824:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000a2230bb4.
00000020:00000010:14.0:1773851906.329979:0:60824:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000005718a032.
00000400:00000200:13.0:1773851906.329979:0:2514888:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000040:14.0:1773851906.329980:0:60824:0:(genops.c:882:class_export_put()) PUTting export 000000005961a270 : new refcount 5
00000100:00000001:14.0:1773851906.329980:0:60824:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:13.0:1773851906.329980:0:2514888:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->13490@kfi7: PUT: OK
00000400:00000200:13.0:1773851906.329981:0:2514888:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000005496b2bb
00000400:00000010:13.0:1773851906.329982:0:2514888:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000005496b2bb.
00000100:00000001:13.0:1773851906.329982:0:2514888:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:13.0:1773851906.329983:0:2514888:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:13.0:1773851906.329984:0:2514888:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000013c683fb nid 13490@kfi7 refs 2
00000800:00000200:13.0:1773851906.329985:0:2514888:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000dac95d1f: 2054@kfi7:3 -> 13490@kfi7(000000007a52d62a):0x0 lsk 2626 rsk 51 tsk 0 trmk 0 tmk 0 trr 3 tta 0x100000000000a41 Transaction freed
00000800:00000200:9.0:1773851906.337807:0:2458095:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:2 Transaction ID 0 allocated
00000800:00000200:9.0:1773851906.337808:0:2458095:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:2 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:9.0:1773851906.337810:0:2458095:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:9.0:1773851906.337814:0:2458095:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:9.0:1773851906.337816:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.337818:0:2458095:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 172.16.70.106@tcp : PUT - for me
00000400:00000200:9.0:1773851906.337819:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17@kfi7 to cpt 2
00000400:00000200:9.0:1773851906.337819:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000005a344472 nid 17@kfi7 refs 1
00000400:00000200:9.0:1773851906.337821:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.106@tcp to cpt 6
00000400:00000200:9.0:1773851906.337822:0:2458095:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 2
00000400:00000200:9.0:1773851906.337823:0:2458095:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 3
00000400:00000200:9.0:1773851906.337824:0:2458095:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.106@tcp to cpt 6
00000400:00000200:9.0:1773851906.337825:0:2458095:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-172.16.70.106@tcp of length 224 into portal 12 MB=0x69a10a6a744c0
00000400:00000200:9.0:1773851906.337827:0:2458095:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-172.16.70.106@tcp of length 224/224 into md 0x16159c9699 [64] + 48544
00000800:00000200:9.0:1773851906.337829:0:2458095:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:9.0:1773851906.337831:0:2458095:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:9.0:1773851906.337832:0:2458095:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->17@kfi7: PUT: OK
00000100:00000001:9.0:1773851906.337833:0:2458095:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:9.0:1773851906.337834:0:2458095:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:9.0:1773851906.337834:0:2458095:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000d390ba55.
00000100:00000040:9.0:1773851906.337835:0:2458095:0:(events.c:358:request_in_callback()) incoming req@00000000d390ba55 x1858246166398144 msgsize 224
00000100:00100000:9.0:1773851906.337837:0:2458095:0:(events.c:361:request_in_callback()) peer: 12345-172.16.70.106@tcp (source: 12345-172.16.70.106@tcp)
00000100:00000001:9.0:1773851906.337839:0:2458095:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:9.0:1773851906.337840:0:2458095:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000005a344472 nid 17@kfi7 refs 2
00000100:00000001:24.0:1773851906.337842:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:9.0:1773851906.337842:0:2458095:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000743dc611: 2054@kfi7:2 <- 17@kfi7(0000000013677549):0x0 lsk 27 rsk 4854 tsk 0 trmk 0 tmk 0 trr 2 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851906.337843:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851906.337843:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851906.337844:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851906.337844:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851906.337845:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858246166398144
00000020:00000001:24.0:1773851906.337846:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851906.337846:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac930d0
00000020:00000001:24.0:1773851906.337847:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851906.337849:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000001f34815 refcount=6
00000020:00000001:24.0:1773851906.337850:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944745153536 : -107128964398080 : ffff9e911821c400)
00000020:00000001:24.0:1773851906.337850:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944745153536 : -107128964398080 : ffff9e911821c400)
00000100:00000001:24.0:1773851906.337851:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.337852:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851906.337852:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851906.337853:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.337854:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851906.337855:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851906.337855:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851906.337856:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851906.337857:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851906.337857:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851906.337857:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.337859:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851906.337860:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851906.337860:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851906.337860:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851906.337861:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851906.337862:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851906.337862:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-172.16.70.106@tcp, seq: 2025207
00000100:00000040:24.0:1773851906.337862:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000001f34815 : new rpc_count 1
00000100:00000001:26.0:1773851906.337863:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.337863:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637120498315648 : -106953211235968 : ffff9eba03d63180)
00000100:00000040:24.0:1773851906.337864:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000d390ba55 x1858246166398144/t0(0) o400->34ef1146-173a-4ba8-943d-d0fda67cb162@172.16.70.106@tcp:187/0 lens 224/0 e 0 to 0 dl 1773852302 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'login-rzslic6-0'
00000100:00000001:24.0:1773851906.337867:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.337868:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851906.337869:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000d390ba55 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:34ef1146-173a-4ba8-943d-d0fda67cb162+6:34165:x1858246166398144:12345-172.16.70.106@tcp:400:login-rzslic6-0
00000100:00000200:24.0:1773851906.337870:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858246166398144
00000020:00000001:24.0:1773851906.337871:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851906.337871:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851906.337872:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.337873:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851906.337873:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851906.337874:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851906.337874:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858246166398144, found 0 last_xid 1858246166398143
00000020:00000001:24.0:1773851906.337875:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851906.337876:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851906.337876:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851906.337877:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.337878:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851906.337878:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851906.337879:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851906.337879:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000a9f134f7.
02000000:00000001:24.0:1773851906.337880:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.337881:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.337881:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851906.337882:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 180968704544, transno 0, xid 1858246166398144
00010000:00000001:24.0:1773851906.337882:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851906.337883:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000d390ba55 x1858246166398144/t0(0) o400->34ef1146-173a-4ba8-943d-d0fda67cb162@172.16.70.106@tcp:187/0 lens 224/224 e 0 to 0 dl 1773852302 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic6-0'
00010000:00000001:24.0:1773851906.337886:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851906.337886:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851906.337887:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=139 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851906.337888:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851906.337888:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006e4507a9 refcount 3 to 172.16.70.106@tcp
00000100:00000001:24.0:1773851906.337889:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636916985419744 : -107156724131872 : ffff9e8aa185d7e0)
02000000:00000001:24.0:1773851906.337890:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851906.337891:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.337891:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851906.337892:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-172.16.70.106@tcp
00000400:00000010:24.0:1773851906.337893:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f9a0eed.
00000100:00000200:24.0:1773851906.337894:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858246166398144, offset 224
00000400:00000200:24.0:1773851906.337895:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-172.16.70.106@tcp
00000400:00000200:24.0:1773851906.337896:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 172.16.70.106@tcp to cpt 6
00000400:00000200:24.0:1773851906.337897:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 2
00000400:00000200:24.0:1773851906.337898:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 3
00000400:00000200:24.0:1773851906.337899:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 4
00000400:00000200:24.0:1773851906.337900:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to NMR:  172.16.70.106@tcp routed destination
00000400:00000200:24.0:1773851906.337901:0:60973:0:(lib-move.c:2175:lnet_handle_find_routed_path()) using src nid 2054@kfi7 for route restriction
00000400:00000200:24.0:1773851906.337902:0:60973:0:(lib-move.c:1514:lnet_find_route_locked()) Looking up a route to tcp, from kfi7
00000400:00000200:24.0:1773851906.337904:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.106@tcp: rtr pref emtpy: 1
00000400:00000200:24.0:1773851906.337905:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 2094@kfi7
00000400:00000200:24.0:1773851906.337906:0:60973:0:(peer.c:1029:lnet_peer_is_pref_rtr_locked()) 172.16.70.106@tcp: rtr pref emtpy: 1
00000400:00000200:24.0:1773851906.337907:0:60973:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 17@kfi7
00000400:00000200:24.0:1773851906.337908:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770575:8770575:1024:4294967295] 2094@kfi7 LPNI seq info [1258747029:1258747029:16:4294967295]
00000400:00000200:24.0:1773851906.337910:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000009bbdeb49 nid 2094@kfi7 refs 1
00000400:00000200:24.0:1773851906.337910:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2094@kfi7 to cpt 4
00000400:00000200:24.0:1773851906.337913:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 172.16.70.106@tcp(172.16.70.106@tcp:2094@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851906.337914:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000017e7f03f nid 172.16.70.106@tcp refs 3
00000800:00000200:24.0:1773851906.337915:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851906.337917:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851906.337919:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851906.337921:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Using peer 2094@kfi7(0x20000000000000c)
00000800:00000200:24.0:1773851906.337924:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000001fc074b2: Posted send of 324 bytes to peer 0x20000000000000c: rc=0
00000800:00000200:24.0:1773851906.337925:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851906.337927:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851906.337928:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006e4507a9 refcount 2 to 172.16.70.106@tcp
00010000:00000001:24.0:1773851906.337929:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851906.337929:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.337930:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851906.337932:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000d390ba55 x1858246166398144/t0(0) o400->34ef1146-173a-4ba8-943d-d0fda67cb162@172.16.70.106@tcp:187/0 lens 224/224 e 0 to 0 dl 1773852302 ref 1 fl Interpret:H/0/0 rc 0/0 job:'login-rzslic6-0'
00000100:00100000:24.0:1773851906.337935:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000d390ba55 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:34ef1146-173a-4ba8-943d-d0fda67cb162+6:34165:x1858246166398144:12345-172.16.70.106@tcp:400:login-rzslic6-0 Request processed in 67us (99us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851906.337938:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-172.16.70.106@tcp, seq: 2025207
00000100:00000040:24.0:1773851906.337938:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000001f34815 : new rpc_count 0
00000100:00000001:24.0:1773851906.337939:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851906.337940:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851906.337940:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.337941:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851906.337942:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851906.337942:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000001f34815 : new refcount 5
00000100:00000001:24.0:1773851906.337943:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851906.337948:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851906.337950:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851906.337951:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2094@kfi7: PUT: OK
00000400:00000200:25.0:1773851906.337952:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f9a0eed
00000400:00000010:25.0:1773851906.337952:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f9a0eed.
00000100:00000001:25.0:1773851906.337953:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851906.337953:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851906.337954:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000009bbdeb49 nid 2094@kfi7 refs 2
00000800:00000200:25.0:1773851906.337955:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000001fc074b2: 2054@kfi7:6 -> 2094@kfi7(000000005da8aaa8):0x0 lsk 13 rsk 4848 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000000c Transaction freed
00000004:00000001:6.0:1773851906.377731:0:42319:0:(osp_precreate.c:211:osp_statfs_update()) Process entered
00000004:00000020:6.0:1773851906.377731:0:42319:0:(osp_precreate.c:213:osp_statfs_update()) going to update statfs
00000100:00000010:6.0:1773851906.377732:0:42319:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000091b13a06.
00000020:00000040:6.0:1773851906.377733:0:42319:0:(genops.c:1094:class_import_get()) import 000000007c3759c8 refcount=3 obd=lustre5-OST0006-osc-MDT0001
00000100:00000001:6.0:1773851906.377734:0:42319:0:(client.c:780:ptlrpc_request_bufs_pack()) Process entered
02000000:00000001:6.0:1773851906.377734:0:42319:0:(sec.c:437:sptlrpc_req_get_ctx()) Process entered
02000000:00000001:6.0:1773851906.377735:0:42319:0:(sec.c:455:sptlrpc_req_get_ctx()) Process leaving (rc=0 : 0 : 0)
02000000:00000010:6.0:1773851906.377736:0:42319:0:(sec_null.c:155:null_alloc_reqbuf()) kmalloced '(req->rq_reqbuf)': 256 at 00000000f17f2b52.
00000100:00000001:6.0:1773851906.377737:0:42319:0:(client.c:860:ptlrpc_request_bufs_pack()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851906.377739:0:42319:0:(jobid.c:870:lustre_get_jobid()) Process entered
00000100:00000001:6.0:1773851906.377739:0:42319:0:(jobid.c:907:lustre_get_jobid()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:6.0:1773851906.377741:0:42319:0:(ptlrpcd.c:301:ptlrpcd_add_req()) @@@ add req [0000000091b13a06] to pc [ptlrpcd_01_00+0]  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851906.377745:0:42319:0:(osd_handler.c:349:osd_trans_create()) Process entered
00000100:00000001:7.0:1773851906.377746:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00080000:00000010:6.0:1773851906.377746:0:42319:0:(osd_handler.c:364:osd_trans_create()) kmalloced '(oh)': 720 at 00000000367cc135.
00000100:00000001:4.0:1773851906.377746:0:41065:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851906.377747:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851906.377747:0:41064:0:(client.c:1628:ptlrpc_send_new_req()) Process entered
00080000:00000001:6.0:1773851906.377747:0:42319:0:(osd_handler.c:382:osd_trans_create()) Process leaving (rc=18446637141337737216 : -106932371814400 : ffff9ebeddf68800)
00080000:00000001:6.0:1773851906.377747:0:42319:0:(osd_handler.c:202:osd_trans_start()) Process entered
00000100:00000001:4.0:1773851906.377747:0:41065:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851906.377748:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Rpc  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 0 ref 1 fl New:QU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00080000:00000001:6.0:1773851906.377748:0:42319:0:(osd_handler.c:237:osd_trans_start()) Process leaving (rc=0 : 0 : 0)
00000004:00001000:6.0:1773851906.377749:0:42319:0:(osp_precreate.c:264:osp_statfs_update()) lustre5-OST0006-osc-MDT0001: sync forced, 2 changes
00000004:00000010:6.0:1773851906.377750:0:42319:0:(osp_sync.c:1649:osp_sync_add_commit_cb()) kmalloced '(cb)': 88 at 0000000034f61370.
00000100:00000001:7.0:1773851906.377751:0:41064:0:(client.c:1239:ptlrpc_import_delay_req()) Process entered
00000100:00000001:7.0:1773851906.377751:0:41064:0:(client.c:1296:ptlrpc_import_delay_req()) Process leaving (rc=0 : 0 : 0)
00000004:00080000:6.0:1773851906.377751:0:42319:0:(osp_sync.c:1662:osp_sync_add_commit_cb()) lustre5-OST0006-osc-MDT0001: add commit cb at 614180831026097ns, next at 614181831025156ns, rc = 0
02000000:00000001:7.0:1773851906.377752:0:41064:0:(sec.c:667:sptlrpc_req_refresh_ctx()) Process entered
02000000:00000001:7.0:1773851906.377752:0:41064:0:(sec.c:699:sptlrpc_req_refresh_ctx()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:6.0:1773851906.377752:0:42319:0:(osd_handler.c:287:osd_trans_stop()) Process entered
00080000:00000001:6.0:1773851906.377752:0:42319:0:(osd_handler.c:339:osd_trans_stop()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851906.377753:0:41064:0:(client.c:1733:ptlrpc_send_new_req()) Sending RPC req@0000000091b13a06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051944512:16@kfi7:13:default-yuba2-0
00000004:00000001:6.0:1773851906.377753:0:42319:0:(osp_precreate.c:271:osp_statfs_update()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.377755:0:41064:0:(niobuf.c:712:ptl_send_rpc()) Process entered
02000000:00000001:7.0:1773851906.377756:0:41064:0:(sec.c:1004:sptlrpc_cli_wrap_request()) Process entered
02000000:00000001:7.0:1773851906.377756:0:41064:0:(sec.c:1041:sptlrpc_cli_wrap_request()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851906.377757:0:41064:0:(sec.c:1716:sptlrpc_cli_alloc_repbuf()) Process entered
02000000:00000010:7.0:1773851906.377758:0:41064:0:(sec_null.c:198:null_alloc_repbuf()) kmalloced '(req->rq_repbuf)': 1024 at 00000000b2b64901.
02000000:00000001:7.0:1773851906.377758:0:41064:0:(sec.c:1726:sptlrpc_cli_alloc_repbuf()) Process leaving (rc=0 : 0 : 0)
00000400:00000200:7.0:1773851906.377759:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000010:7.0:1773851906.377760:0:41064:0:(lib-me.c:92:LNetMEAttach()) slab-alloced 'me' at 000000007398a75e.
00000400:00000010:7.0:1773851906.377761:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000100:00000200:7.0:1773851906.377762:0:41064:0:(niobuf.c:919:ptl_send_rpc()) Setup reply buffer: 1024 bytes, xid 1859433051944512, portal 4
00000100:00000001:7.0:1773851906.377763:0:41064:0:(client.c:2985:ptlrpc_request_addref()) Process entered
00000100:00000001:7.0:1773851906.377764:0:41064:0:(client.c:2987:ptlrpc_request_addref()) Process leaving (rc=18446637025359398016 : -107048350153600 : ffff9ea3dd1d8480)
00000100:00000040:7.0:1773851906.377765:0:41064:0:(niobuf.c:939:ptl_send_rpc()) @@@ send flags=0  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851906.377767:0:41064:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851906.377768:0:41064:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16@kfi7
00000400:00000010:7.0:1773851906.377769:0:41064:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000bc26fd9e.
00000100:00000200:7.0:1773851906.377770:0:41064:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 7, xid 1859433051944512, offset 0
00000400:00000200:7.0:1773851906.377771:0:41064:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16@kfi7
00000400:00000200:7.0:1773851906.377772:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851906.377773:0:41064:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:7.0:1773851906.377774:0:41064:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851906.377776:0:41064:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:7.0:1773851906.377777:0:41064:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source ANY to MR:  16@kfi7 local destination
00000400:00000200:7.0:1773851906.377778:0:41064:0:(lib-move.c:1716:lnet_get_best_ni()) compare ni 2069@kfi7 [c:1024, d:10, s:8770573, p:4294967295, g:4294967295, h:1000] with best_ni 2054@kfi7 [c:1024, d:10, s:8770575, p:4294967295, g:4294967295, h:1000]
00000400:00000200:7.0:1773851906.377780:0:41064:0:(lib-move.c:1758:lnet_get_best_ni()) selected best_ni 2069@kfi7
00000400:00000200:7.0:1773851906.377781:0:41064:0:(lib-move.c:1336:lnet_select_peer_ni()) 2069@kfi7 lpni_is_preferred = 0
00000400:00000200:7.0:1773851906.377782:0:41064:0:(lib-move.c:1416:lnet_select_peer_ni()) sd_best_lpni = 16@kfi7
00000400:00000200:7.0:1773851906.377783:0:41064:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770576:8770576:1024:4294967295] 16@kfi7 LPNI seq info [5403823:5403823:16:4294967295]
00000400:00000200:7.0:1773851906.377784:0:41064:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:7.0:1773851906.377785:0:41064:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:7.0:1773851906.377788:0:41064:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:<?>) -> 16@kfi7(16@kfi7:16@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851906.377789:0:41064:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000800:00000200:7.0:1773851906.377791:0:41064:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851906.377792:0:41064:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851906.377794:0:41064:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851906.377796:0:41064:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Using peer 16@kfi7(0x15d)
00000800:00000200:7.0:1773851906.377798:0:41064:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 000000007adb163d: Posted send of 324 bytes to peer 0x15d: rc=0
00000800:00000200:7.0:1773851906.377800:0:41064:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851906.377802:0:41064:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.377802:0:41064:0:(niobuf.c:948:ptl_send_rpc()) Process leaving via out (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851906.377803:0:41064:0:(client.c:1755:ptlrpc_send_new_req()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.377804:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.377804:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.377805:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851906.377806:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=87 : 87 : 57)
00000100:00000001:7.0:1773851906.377806:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851906.377807:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000100:00000001:7.0:1773851906.377807:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.377808:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:6.0:1773851906.377812:0:2499722:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d TN_EVENT_TX_OK event status 0
00000400:00000200:6.0:1773851906.377814:0:2499722:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:6.0:1773851906.377815:0:2499722:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000400:00000200:6.0:1773851906.377816:0:2499722:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000bc26fd9e
00000400:00000010:6.0:1773851906.377816:0:2499722:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000bc26fd9e.
00000100:00000001:6.0:1773851906.377817:0:2499722:0:(events.c:53:request_out_callback()) Process entered
00000100:00000200:6.0:1773851906.377818:0:2499722:0:(events.c:64:request_out_callback()) @@@ type 5, status 0  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 2 fl Rpc:r/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851906.377820:0:2499722:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:6.0:1773851906.377821:0:2499722:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 1  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 2 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:6.0:1773851906.377823:0:2499722:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:6.0:1773851906.377824:0:2499722:0:(events.c:93:request_out_callback()) Process leaving
00000400:00000200:6.0:1773851906.377825:0:2499722:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:6.0:1773851906.377827:0:2499722:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000007adb163d: 2069@kfi7:1 -> 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 1 tta 0x15d Transaction freed
00000800:00000200:29.0:1773851906.377857:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851906.377858:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851906.377859:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851906.377862:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851906.377864:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.377866:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 16@kfi7 : PUT - for me
00000400:00000200:29.0:1773851906.377867:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.377868:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 1
00000400:00000200:29.0:1773851906.377869:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.377869:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000002b721338 nid 16@kfi7 refs 2
00000400:00000200:29.0:1773851906.377870:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 3
00000400:00000200:29.0:1773851906.377871:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.377872:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16@kfi7 of length 368 into portal 4 MB=0x69b24fe8b7640
00000400:00000200:29.0:1773851906.377873:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.377875:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 4 from 12345-16@kfi7 of length 368/368 into md 0x7800826dd [1] + 224
00000800:00000200:29.0:1773851906.377877:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851906.377879:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851906.377880:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->16@kfi7: PUT: OK
00000100:00000001:29.0:1773851906.377881:0:2467684:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:29.0:1773851906.377882:0:2467684:0:(events.c:105:reply_in_callback()) @@@ type 2, status 0  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 1 fl Rpc:Qr/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000040:29.0:1773851906.377885:0:2467684:0:(events.c:174:reply_in_callback()) @@@ reply in flags=0 mlen=368 offset=224 replen=368  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:29.0:1773851906.377888:0:2467684:0:(events.c:185:reply_in_callback()) Process leaving
00000400:00000200:29.0:1773851906.377889:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000002b721338 nid 16@kfi7 refs 2
00000800:00000200:29.0:1773851906.377890:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 16@kfi7(000000009dfc9ba7):0x0 lsk 350 rsk 5431 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851906.377890:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851906.377890:0:41064:0:(client.c:1798:ptlrpc_check_set()) Process entered
00000400:00000001:7.0:1773851906.377891:0:41064:0:(lib-msg.c:43:lnet_build_unlink_event()) Process entered
00000400:00000001:7.0:1773851906.377892:0:41064:0:(lib-msg.c:52:lnet_build_unlink_event()) Process leaving
00000400:00000010:7.0:1773851906.377892:0:41064:0:(lib-me.c:135:lnet_me_unlink()) slab-freed 'me' at 000000007398a75e.
00000400:00000200:7.0:1773851906.377893:0:41064:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000400:00000010:7.0:1773851906.377893:0:41064:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:7.0:1773851906.377894:0:41064:0:(events.c:103:reply_in_callback()) Process entered
00000100:00000200:7.0:1773851906.377895:0:41064:0:(events.c:105:reply_in_callback()) @@@ type 6, status 0  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 1 fl Rpc:RQ/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000200:7.0:1773851906.377898:0:41064:0:(events.c:127:reply_in_callback()) @@@ unlink  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 1 fl Rpc:RQU/0/ffffffff rc 0/-1 job:'default-yuba2-0'
00000100:00000001:7.0:1773851906.377903:0:41064:0:(events.c:185:reply_in_callback()) Process leaving
00000100:00000001:7.0:1773851906.377903:0:41064:0:(client.c:2757:ptlrpc_unregister_reply()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.377904:0:41064:0:(client.c:1428:after_reply()) Process entered
02000000:00000001:7.0:1773851906.377905:0:41064:0:(sec.c:1049:do_cli_unwrap_reply()) Process entered
00000100:00000001:7.0:1773851906.377905:0:41064:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851906.377906:0:41064:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851906.377906:0:41064:0:(sec.c:1104:do_cli_unwrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851906.377907:0:41064:0:(import.c:1951:at_measured()) add 66 to 000000001b821342 time=139 v=66 (66 66 66 66)
00000100:00001000:7.0:1773851906.377908:0:41064:0:(import.c:1951:at_measured()) add 1 to 00000000ec822c66 time=139 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851906.377909:0:41064:0:(client.c:1349:ptlrpc_check_status()) Process entered
00000100:00000001:7.0:1773851906.377910:0:41064:0:(client.c:1368:ptlrpc_check_status()) Process leaving (rc=0 : 0 : 0)
00010000:00000001:7.0:1773851906.377911:0:41064:0:(ldlm_request.c:1469:ldlm_cli_update_pool()) Process entered
00010000:00000001:7.0:1773851906.377911:0:41064:0:(ldlm_request.c:1499:ldlm_cli_update_pool()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.377912:0:41064:0:(client.c:2852:ptlrpc_free_committed()) Process entered
00000100:00000040:7.0:1773851906.377912:0:41064:0:(client.c:2859:ptlrpc_free_committed()) lustre5-OST0006-osc-MDT0001: skip recheck: last_committed 193387449614
00000100:00000001:7.0:1773851906.377913:0:41064:0:(client.c:2860:ptlrpc_free_committed()) Process leaving
00000100:00000001:7.0:1773851906.377914:0:41064:0:(client.c:1614:after_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851906.377915:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Rpc to Interpret  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 1 fl Rpc:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851906.377917:0:41064:0:(client.c:2150:ptlrpc_check_set()) Process leaving via interpret (rc=0 : 0 : 0x0)
00000100:00000001:7.0:1773851906.377918:0:41064:0:(niobuf.c:442:ptlrpc_unregister_bulk()) Process entered
00000100:00000001:7.0:1773851906.377918:0:41064:0:(niobuf.c:456:ptlrpc_unregister_bulk()) Process leaving (rc=1 : 1 : 1)
00000004:00000001:7.0:1773851906.377919:0:41064:0:(osp_precreate.c:146:osp_statfs_interpret()) Process entered
00000004:00000040:7.0:1773851906.377920:0:41064:0:(osp_precreate.c:104:osp_pre_update_status_msfs()) lustre5-OST0006-osc-MDT0001: Updating status = 0
00000004:00000040:7.0:1773851906.377920:0:41064:0:(osp_precreate.c:1053:osp_pre_update_msfs()) lustre5-OST0006-osc-MDT0001: blocks=410399715328 free=351482228736 avail=351481168896 avail_mb=1372973316 hwm_mb=3131103 files=372097070 ffree=343244364 state=0: rc = 0
00000004:00000020:7.0:1773851906.377922:0:41064:0:(osp_precreate.c:177:osp_statfs_interpret()) lustre5-OST0006-osc-MDT0001 (00000000ff14bff8): 410399715328 blocks, 351482228736 free, 351481168896 avail, 4096 bsize, 1565551 reserved mb low, 3131103 reserved mb high,372097070 files, 343244364 free files
00000004:00000001:7.0:1773851906.377924:0:41064:0:(osp_precreate.c:179:osp_statfs_interpret()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851906.377925:0:41064:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 1 fl Interpret:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00100000:7.0:1773851906.377928:0:41064:0:(client.c:2215:ptlrpc_check_set()) Completed RPC req@0000000091b13a06 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_01_00:lustre5-MDT0001-mdtlov_UUID:41064:1859433051944512:16@kfi7:13:default-yuba2-0
00000100:00000001:7.0:1773851906.377931:0:41064:0:(client.c:2266:ptlrpc_check_set()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.377932:0:41064:0:(client.c:2663:__ptlrpc_req_finished()) Process entered
00000100:00000040:7.0:1773851906.377932:0:41064:0:(client.c:2671:__ptlrpc_req_finished()) @@@ refcount now 0  req@0000000091b13a06 x1859433051944512/t0(0) o13->lustre5-OST0006-osc-MDT0001@16@kfi7:7/4 lens 224/368 e 0 to 0 dl 1773852059 ref 1 fl Complete:RQU/0/0 rc 0/0 job:'default-yuba2-0'
00000100:00000001:7.0:1773851906.377934:0:41064:0:(client.c:2578:__ptlrpc_free_req()) Process entered
02000000:00000001:7.0:1773851906.377935:0:41064:0:(sec.c:1738:sptlrpc_cli_free_repbuf()) Process entered
02000000:00000010:7.0:1773851906.377936:0:41064:0:(sec_null.c:212:null_free_repbuf()) kfreed 'req->rq_repbuf': 1024 at 00000000b2b64901.
02000000:00000001:7.0:1773851906.377937:0:41064:0:(sec.c:1752:sptlrpc_cli_free_repbuf()) Process leaving
00000020:00000001:7.0:1773851906.377937:0:41064:0:(genops.c:1101:class_import_put()) Process entered
00000020:00000040:7.0:1773851906.377938:0:41064:0:(genops.c:1107:class_import_put()) import 000000007c3759c8 refcount=2 obd=lustre5-OST0006-osc-MDT0001
00000020:00000001:7.0:1773851906.377939:0:41064:0:(genops.c:1114:class_import_put()) Process leaving
02000000:00000010:7.0:1773851906.377939:0:41064:0:(sec_null.c:182:null_free_reqbuf()) kfreed 'req->rq_reqbuf': 256 at 00000000f17f2b52.
02000000:00000001:7.0:1773851906.377940:0:41064:0:(sec.c:469:sptlrpc_req_put_ctx()) Process entered
02000000:00000001:7.0:1773851906.377940:0:41064:0:(sec.c:486:sptlrpc_req_put_ctx()) Process leaving
00000100:00000010:7.0:1773851906.377941:0:41064:0:(client.c:544:ptlrpc_request_cache_free()) slab-freed '(req)': 1120 at 0000000091b13a06.
00000100:00000001:7.0:1773851906.377942:0:41064:0:(client.c:2636:__ptlrpc_free_req()) Process leaving
00000100:00000001:7.0:1773851906.377942:0:41064:0:(client.c:2704:__ptlrpc_req_finished()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.377943:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.377943:0:41064:0:(client.c:2429:ptlrpc_set_next_timeout()) Process entered
00000100:00000001:7.0:1773851906.377944:0:41064:0:(client.c:2457:ptlrpc_set_next_timeout()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.377944:0:41064:0:(ptlrpcd.c:323:ptlrpcd_check()) Process entered
00000100:00000001:7.0:1773851906.377945:0:41064:0:(ptlrpcd.c:422:ptlrpcd_check()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:17.0:1773851906.403601:0:2511435:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:17.0:1773851906.403603:0:2511435:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:17.0:1773851906.403605:0:2511435:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:17.0:1773851906.403609:0:2511435:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:17.0:1773851906.403612:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851906.403614:0:2511435:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20881@kfi7 : PUT - for me
00000400:00000200:17.0:1773851906.403616:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851906.403618:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:17.0:1773851906.403619:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:17.0:1773851906.403620:0:2511435:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:17.0:1773851906.403622:0:2511435:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:17.0:1773851906.403624:0:2511435:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20816@kfi7 to cpt 6
00000400:00000200:17.0:1773851906.403625:0:2511435:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20816@kfi7 of length 224 into portal 12 MB=0x69b09c8e36140
00000400:00000200:17.0:1773851906.403628:0:2511435:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20816@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 53376
00000800:00000200:17.0:1773851906.403631:0:2511435:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:17.0:1773851906.403634:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:17.0:1773851906.403636:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000100:00000001:17.0:1773851906.403638:0:2511435:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:17.0:1773851906.403639:0:2511435:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:17.0:1773851906.403640:0:2511435:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002599a1e8.
00000100:00000040:17.0:1773851906.403642:0:2511435:0:(events.c:358:request_in_callback()) incoming req@000000002599a1e8 x1859316187619648 msgsize 224
00000100:00100000:17.0:1773851906.403644:0:2511435:0:(events.c:361:request_in_callback()) peer: 12345-20816@kfi7 (source: 12345-20881@kfi7)
00000100:00000001:17.0:1773851906.403646:0:2511435:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:17.0:1773851906.403648:0:2511435:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000100:00000001:19.0:1773851906.403649:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:19.0:1773851906.403650:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851906.403651:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:17.0:1773851906.403651:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009e13a487: 2054@kfi7:4 <- 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
00000100:00000001:19.0:1773851906.403652:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851906.403653:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851906.403654:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859316187619648
00000020:00000001:19.0:1773851906.403656:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851906.403656:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92c1c
00000020:00000001:19.0:1773851906.403657:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851906.403659:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000081bf6b5a refcount=4307
00000020:00000001:19.0:1773851906.403660:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000020:00000001:19.0:1773851906.403661:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944743927808 : -107128965623808 : ffff9e91180f1000)
00000100:00000001:19.0:1773851906.403663:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851906.403664:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851906.403665:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000301e8f40.
00000020:00000010:19.0:1773851906.403667:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851906.403668:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851906.403670:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851906.403671:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851906.403672:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.403674:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851906.403674:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851906.403675:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.403677:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.403679:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851906.403680:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851906.403680:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851906.403680:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:19.0:1773851906.403681:0:60961:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20816@kfi7, seq: 2156459
00000100:00000040:19.0:1773851906.403683:0:60961:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000081bf6b5a : new rpc_count 36
00000100:00000001:16.0:1773851906.403684:0:61039:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.403685:0:60961:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637043794782336 : -107029914769280 : ffff9ea827f32880)
00000100:00000001:16.0:1773851906.403685:0:61039:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851906.403686:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002599a1e8 x1859316187619648/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:221/0 lens 224/0 e 0 to 0 dl 1773852336 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1794-0'
00000100:00000001:19.0:1773851906.403691:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851906.403691:0:60961:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:19.0:1773851906.403693:0:60961:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002599a1e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39683:x1859316187619648:12345-20816@kfi7:400:default-tuolumne1794-0
00000100:00000200:19.0:1773851906.403695:0:60961:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859316187619648
00000020:00000001:19.0:1773851906.403696:0:60961:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:19.0:1773851906.403697:0:60961:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:19.0:1773851906.403698:0:60961:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.403699:0:60961:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:19.0:1773851906.403700:0:60961:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:19.0:1773851906.403701:0:60961:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:19.0:1773851906.403702:0:60961:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859316187619648, found 0 last_xid 1859316186815935
00000020:00000001:19.0:1773851906.403703:0:60961:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:19.0:1773851906.403704:0:60961:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:19.0:1773851906.403705:0:60961:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:19.0:1773851906.403706:0:60961:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.403707:0:60961:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:19.0:1773851906.403707:0:60961:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:19.0:1773851906.403708:0:60961:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:19.0:1773851906.403709:0:60961:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000ae07c6e0.
02000000:00000001:19.0:1773851906.403710:0:60961:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.403711:0:60961:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.403712:0:60961:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:19.0:1773851906.403713:0:60961:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264593759, transno 0, xid 1859316187619648
00010000:00000001:19.0:1773851906.403715:0:60961:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:19.0:1773851906.403716:0:60961:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002599a1e8 x1859316187619648/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:221/0 lens 224/224 e 0 to 0 dl 1773852336 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00010000:00000001:19.0:1773851906.403719:0:60961:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:19.0:1773851906.403720:0:60961:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:19.0:1773851906.403722:0:60961:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=139 v=340 (340 214 1 1)
00000100:00000001:19.0:1773851906.403723:0:60961:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:19.0:1773851906.403729:0:60961:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000cd93bcf0 refcount 3 to 20816@kfi7
00000100:00000001:19.0:1773851906.403730:0:60961:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313740640 : -107139395810976 : ffff9e8eaa5f0960)
02000000:00000001:19.0:1773851906.403732:0:60961:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:19.0:1773851906.403732:0:60961:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.403734:0:60961:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:19.0:1773851906.403735:0:60961:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20881@kfi7
00000400:00000010:19.0:1773851906.403736:0:60961:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000073b38b00.
00000100:00000200:19.0:1773851906.403737:0:60961:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859316187619648, offset 224
00000400:00000200:19.0:1773851906.403739:0:60961:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20881@kfi7
00000400:00000200:19.0:1773851906.403741:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:19.0:1773851906.403742:0:60961:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 1
00000400:00000200:19.0:1773851906.403744:0:60961:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:19.0:1773851906.403746:0:60961:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000400:00000200:19.0:1773851906.403748:0:60961:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20881@kfi7 local destination
00000400:00000200:19.0:1773851906.403750:0:60961:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770577:8770577:1024:4294967295] 20881@kfi7 LPNI seq info [16890558:16890558:16:4294967295]
00000400:00000200:19.0:1773851906.403752:0:60961:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000400:00000200:19.0:1773851906.403753:0:60961:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20881@kfi7 to cpt 4
00000400:00000200:19.0:1773851906.403757:0:60961:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20881@kfi7(20881@kfi7:20881@kfi7) <?> : PUT try# 0
00000400:00000200:19.0:1773851906.403758:0:60961:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 3
00000800:00000200:19.0:1773851906.403761:0:60961:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:4 Transaction ID 0 allocated
00000800:00000200:19.0:1773851906.403762:0:60961:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:19.0:1773851906.403766:0:60961:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:19.0:1773851906.403769:0:60961:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Using peer 20881@kfi7(0x10000000000027f)
00000800:00000200:19.0:1773851906.403774:0:60961:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:4 Transaction ID 0000000049addc73: Posted send of 324 bytes to peer 0x10000000000027f: rc=0
00000800:00000200:19.0:1773851906.403776:0:60961:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:19.0:1773851906.403783:0:60961:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:19.0:1773851906.403784:0:60961:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000cd93bcf0 refcount 2 to 20816@kfi7
00010000:00000001:19.0:1773851906.403785:0:60961:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:19.0:1773851906.403786:0:60961:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:19.0:1773851906.403787:0:60961:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:19.0:1773851906.403788:0:60961:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002599a1e8 x1859316187619648/t0(0) o400->4fb1135c-80e8-4fba-bd27-a7d8cb531077@20816@kfi7:221/0 lens 224/224 e 0 to 0 dl 1773852336 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1794-0'
00000800:00000200:17.0:1773851906.403790:0:2511435:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f TN_EVENT_TX_OK event status 0
00000400:00000200:17.0:1773851906.403793:0:2511435:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00100000:19.0:1773851906.403794:0:60961:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002599a1e8 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_072:4fb1135c-80e8-4fba-bd27-a7d8cb531077+4307:39683:x1859316187619648:12345-20816@kfi7:400:default-tuolumne1794-0 Request processed in 102us (151us total) trans 0 rc 0/0
00000400:00000200:17.0:1773851906.403794:0:2511435:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20881@kfi7: PUT: OK
00000400:00000200:17.0:1773851906.403795:0:2511435:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000073b38b00
00000400:00000010:17.0:1773851906.403796:0:2511435:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000073b38b00.
00000100:00000001:17.0:1773851906.403797:0:2511435:0:(events.c:407:reply_out_callback()) Process entered
00000100:00100000:19.0:1773851906.403798:0:60961:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20816@kfi7, seq: 2156459
00000100:00000001:17.0:1773851906.403798:0:2511435:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000040:19.0:1773851906.403799:0:60961:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000081bf6b5a : new rpc_count 35
00000400:00000200:17.0:1773851906.403799:0:2511435:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000096b45e4d nid 20881@kfi7 refs 2
00000100:00000001:19.0:1773851906.403800:0:60961:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:19.0:1773851906.403801:0:60961:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:19.0:1773851906.403801:0:60961:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000800:00000200:17.0:1773851906.403802:0:2511435:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000049addc73: 2054@kfi7:4 -> 20881@kfi7(00000000a4790d96):0x0 lsk 640 rsk 47 tsk 0 trmk 0 tmk 0 trr 4 tta 0x10000000000027f Transaction freed
00000020:00000010:19.0:1773851906.403803:0:60961:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000020:00000010:19.0:1773851906.403804:0:60961:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000301e8f40.
00000020:00000040:19.0:1773851906.403805:0:60961:0:(genops.c:882:class_export_put()) PUTting export 0000000081bf6b5a : new refcount 4306
00000100:00000001:19.0:1773851906.403806:0:60961:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851906.432898:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851906.432899:0:2464256:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:27.0:1773851906.432899:0:2464256:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851906.432899:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_HELLO_REQ transaction ID 0
00000800:00000200:27.0:1773851906.432901:0:2464256:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851906.432901:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_HELLO event status 0
00000800:00000200:27.0:1773851906.432903:0:2464256:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000800:00000200:26.0:1773851906.432903:0:2507427:0:(kfilnd_peer.c:371:kfilnd_peer_process_hello()) Peer 20866@kfi7(00000000857bc1fc):0x80e version: 2; local version 2; negotiated version: 2
00000400:00000200:27.0:1773851906.432904:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000800:00000200:26.0:1773851906.432904:0:2507427:0:(kfilnd_tn.c:890:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e Using peer 20866@kfi7(0x10000000000080e)
00000400:00000200:27.0:1773851906.432905:0:2464256:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 20866@kfi7 : PUT - for me
00000400:00000200:26.0:1773851906.432906:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:27.0:1773851906.432907:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:27.0:1773851906.432908:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 1
00000800:00000200:26.0:1773851906.432908:0:2507427:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 000000006e71e7e9: Posted send of 38 bytes to peer 0x10000000000080e: rc=0
00000400:00000200:27.0:1773851906.432909:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:27.0:1773851906.432909:0:2464256:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000400:00000200:27.0:1773851906.432910:0:2464256:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 3
00000800:00000200:26.0:1773851906.432910:0:2507427:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000400:00000200:27.0:1773851906.432911:0:2464256:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:27.0:1773851906.432912:0:2464256:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20866@kfi7 of length 224 into portal 12 MB=0x69b0a43fc64c0
00000400:00000200:27.0:1773851906.432913:0:2464256:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20866@kfi7 of length 224/224 into md 0x16159c9699 [64] + 48768
00000800:00000200:27.0:1773851906.432915:0:2464256:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:27.0:1773851906.432917:0:2464256:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:27.0:1773851906.432918:0:2464256:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20866@kfi7: PUT: OK
00000100:00000001:27.0:1773851906.432918:0:2464256:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:27.0:1773851906.432919:0:2464256:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:27.0:1773851906.432920:0:2464256:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000090b6b8a6.
00000100:00000040:27.0:1773851906.432920:0:2464256:0:(events.c:358:request_in_callback()) incoming req@0000000090b6b8a6 x1859318252856512 msgsize 224
00000100:00100000:27.0:1773851906.432922:0:2464256:0:(events.c:361:request_in_callback()) peer: 12345-20866@kfi7 (source: 12345-20866@kfi7)
00000800:00000200:26.0:1773851906.432922:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e TN_EVENT_TX_OK event status 0
00000100:00000001:27.0:1773851906.432923:0:2464256:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:27.0:1773851906.432923:0:2464256:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000800:00000200:26.0:1773851906.432924:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e Transaction freed
00000100:00000001:24.0:1773851906.432924:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:27.0:1773851906.432925:0:2464256:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000013625cac: 2054@kfi7:6 <- 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851906.432925:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851906.432925:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851906.432925:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851906.432926:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851906.432927:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859318252856512
00000020:00000001:24.0:1773851906.432928:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851906.432928:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92f9c
00000020:00000001:24.0:1773851906.432928:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851906.432930:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000068a4f811 refcount=6
00000020:00000001:24.0:1773851906.432931:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744925184 : -107128964626432 : ffff9e91181e4800)
00000020:00000001:24.0:1773851906.432931:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744925184 : -107128964626432 : ffff9e91181e4800)
00000100:00000001:24.0:1773851906.432932:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.432933:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851906.432934:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851906.432935:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.432935:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851906.432936:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851906.432936:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851906.432937:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851906.432938:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851906.432938:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851906.432939:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.432939:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851906.432940:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851906.432941:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:26.0:1773851906.432941:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:24.0:1773851906.432941:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851906.432942:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20866@kfi7, seq: 2025208
00000100:00000040:24.0:1773851906.432942:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000068a4f811 : new rpc_count 1
00000100:00000001:26.0:1773851906.432943:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:26.0:1773851906.432943:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.432943:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637018804524672 : -107054905026944 : ffff9ea2566a1680)
00000100:00000040:24.0:1773851906.432944:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000090b6b8a6 x1859318252856512/t0(0) o400->4f80de69-1eb8-4dc2-be2a-b739d23a0281@20866@kfi7:187/0 lens 224/0 e 0 to 0 dl 1773852302 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1800-0'
00000100:00000001:24.0:1773851906.432947:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.432947:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851906.432948:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000090b6b8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4f80de69-1eb8-4dc2-be2a-b739d23a0281+6:39631:x1859318252856512:12345-20866@kfi7:400:default-tuolumne1800-0
00000100:00000200:24.0:1773851906.432949:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859318252856512
00000020:00000001:24.0:1773851906.432950:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851906.432950:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851906.432951:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.432952:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851906.432952:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851906.432953:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851906.432953:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859318252856512, found 0 last_xid 1859318252856511
00000020:00000001:24.0:1773851906.432954:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851906.432955:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851906.432956:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851906.432956:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.432957:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851906.432957:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851906.432958:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851906.432959:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000fc50bf47.
02000000:00000001:24.0:1773851906.432959:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.432960:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.432961:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851906.432961:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1859318252856512
00010000:00000001:24.0:1773851906.432962:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851906.432963:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000090b6b8a6 x1859318252856512/t0(0) o400->4f80de69-1eb8-4dc2-be2a-b739d23a0281@20866@kfi7:187/0 lens 224/224 e 0 to 0 dl 1773852302 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1800-0'
00010000:00000001:24.0:1773851906.432965:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851906.432965:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851906.432966:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=139 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851906.432967:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851906.432968:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000003d36ced6 refcount 5 to 20866@kfi7
00000100:00000001:24.0:1773851906.432968:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934313739104 : -107139395812512 : ffff9e8eaa5f0360)
02000000:00000001:24.0:1773851906.432969:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851906.432970:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.432971:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851906.432971:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20866@kfi7
00000400:00000010:24.0:1773851906.432972:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d7bd97df.
00000100:00000200:24.0:1773851906.432973:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859318252856512, offset 224
00000400:00000200:24.0:1773851906.432974:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20866@kfi7
00000400:00000200:24.0:1773851906.432975:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.432975:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 1
00000400:00000200:24.0:1773851906.432976:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000400:00000200:24.0:1773851906.432977:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 3
00000400:00000200:24.0:1773851906.432979:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  20866@kfi7 local destination
00000400:00000200:24.0:1773851906.432980:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770578:8770578:1024:4294967295] 20866@kfi7 LPNI seq info [6979597:6979597:16:4294967295]
00000400:00000200:24.0:1773851906.432981:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000400:00000200:24.0:1773851906.432983:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20866@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.432985:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 20866@kfi7(20866@kfi7:20866@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851906.432986:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 3
00000800:00000200:24.0:1773851906.432987:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851906.432988:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851906.432990:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851906.432992:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e Using peer 20866@kfi7(0x10000000000080e)
00000800:00000200:24.0:1773851906.432995:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000a91130f8: Posted send of 324 bytes to peer 0x10000000000080e: rc=0
00000800:00000200:24.0:1773851906.432996:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851906.432998:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851906.432999:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000003d36ced6 refcount 4 to 20866@kfi7
00010000:00000001:24.0:1773851906.433000:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851906.433000:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.433001:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851906.433001:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000090b6b8a6 x1859318252856512/t0(0) o400->4f80de69-1eb8-4dc2-be2a-b739d23a0281@20866@kfi7:187/0 lens 224/224 e 0 to 0 dl 1773852302 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1800-0'
00000100:00100000:24.0:1773851906.433005:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000090b6b8a6 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:4f80de69-1eb8-4dc2-be2a-b739d23a0281+6:39631:x1859318252856512:12345-20866@kfi7:400:default-tuolumne1800-0 Request processed in 58us (84us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851906.433007:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20866@kfi7, seq: 2025208
00000100:00000040:24.0:1773851906.433008:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000068a4f811 : new rpc_count 0
00000100:00000001:24.0:1773851906.433009:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851906.433009:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851906.433009:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.433010:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851906.433011:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851906.433012:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000068a4f811 : new refcount 5
00000100:00000001:24.0:1773851906.433013:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851906.433018:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851906.433019:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851906.433020:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->20866@kfi7: PUT: OK
00000400:00000200:26.0:1773851906.433021:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d7bd97df
00000400:00000010:26.0:1773851906.433022:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d7bd97df.
00000100:00000001:26.0:1773851906.433022:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851906.433023:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851906.433024:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000000fb44ccc nid 20866@kfi7 refs 2
00000800:00000200:26.0:1773851906.433025:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a91130f8: 2054@kfi7:6 -> 20866@kfi7(00000000857bc1fc):0x0 lsk 2063 rsk 50 tsk 0 trmk 0 tmk 0 trr 6 tta 0x10000000000080e Transaction freed
00000800:00000200:22.0:1773851906.464437:0:2456945:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:22.0:1773851906.464437:0:2456945:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:22.0:1773851906.464439:0:2456945:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:22.0:1773851906.464441:0:2456945:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:22.0:1773851906.464443:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.464444:0:2456945:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 23803@kfi7 : PUT - for me
00000400:00000200:22.0:1773851906.464445:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.464446:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 1
00000400:00000200:22.0:1773851906.464447:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.464447:0:2456945:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000400:00000200:22.0:1773851906.464448:0:2456945:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 3
00000400:00000200:22.0:1773851906.464449:0:2456945:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:22.0:1773851906.464450:0:2456945:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-23803@kfi7 of length 224 into portal 12 MB=0x699de8d4e6b40
00000400:00000200:22.0:1773851906.464451:0:2456945:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-23803@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 72872
00000800:00000200:22.0:1773851906.464454:0:2456945:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:22.0:1773851906.464456:0:2456945:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:22.0:1773851906.464457:0:2456945:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23803@kfi7: PUT: OK
00000100:00000001:22.0:1773851906.464458:0:2456945:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:22.0:1773851906.464459:0:2456945:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:22.0:1773851906.464459:0:2456945:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000949a9c8b.
00000100:00000040:22.0:1773851906.464460:0:2456945:0:(events.c:358:request_in_callback()) incoming req@00000000949a9c8b x1858030992780096 msgsize 224
00000100:00100000:22.0:1773851906.464462:0:2456945:0:(events.c:361:request_in_callback()) peer: 12345-23803@kfi7 (source: 12345-23803@kfi7)
00000100:00000001:22.0:1773851906.464462:0:2456945:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:22.0:1773851906.464463:0:2456945:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000100:00000001:20.0:1773851906.464464:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:22.0:1773851906.464465:0:2456945:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000ea85a7d6: 2069@kfi7:5 <- 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851906.464465:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851906.464465:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851906.464465:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:20.0:1773851906.464466:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851906.464467:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858030992780096
00000020:00000001:20.0:1773851906.464468:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851906.464468:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac910cb
00000020:00000001:20.0:1773851906.464469:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851906.464472:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000071a6e1d9 refcount=6
00000020:00000001:20.0:1773851906.464472:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240328192 : -107152469223424 : ffff9e8b9f229800)
00000020:00000001:20.0:1773851906.464473:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240328192 : -107152469223424 : ffff9e8b9f229800)
00000100:00000001:20.0:1773851906.464474:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851906.464475:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851906.464476:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009ca7dbc5.
00000020:00000010:20.0:1773851906.464477:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851906.464478:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008b2657fc.
00000100:00000001:20.0:1773851906.464479:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851906.464479:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851906.464479:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851906.464481:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851906.464481:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851906.464481:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.464482:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851906.464483:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851906.464484:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851906.464484:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851906.464484:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851906.464485:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-23803@kfi7, seq: 1998103
00000100:00000001:23.0:1773851906.464486:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851906.464486:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000071a6e1d9 : new rpc_count 1
00000100:00000001:23.0:1773851906.464487:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.464487:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637155706629120 : -106918002922496 : ffff9ec2366a6c00)
00000100:00000040:20.0:1773851906.464488:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000949a9c8b x1858030992780096/t0(0) o400->918a8a56-13a2-4a91-9ded-d83af214a091@23803@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne261-0'
00000100:00000001:20.0:1773851906.464490:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851906.464491:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851906.464492:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000949a9c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:918a8a56-13a2-4a91-9ded-d83af214a091+6:47895:x1858030992780096:12345-23803@kfi7:400:default-tuolumne261-0
00000100:00000200:20.0:1773851906.464493:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858030992780096
00000020:00000001:20.0:1773851906.464493:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851906.464494:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851906.464495:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.464495:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851906.464496:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851906.464496:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851906.464497:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858030992780096, found 0 last_xid 1858030992780095
00000020:00000001:20.0:1773851906.464498:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851906.464498:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851906.464499:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851906.464499:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.464500:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851906.464500:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851906.464501:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851906.464502:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000003ef62660.
02000000:00000001:20.0:1773851906.464502:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.464503:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.464503:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851906.464504:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1858030992780096
00010000:00000001:20.0:1773851906.464505:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851906.464506:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000949a9c8b x1858030992780096/t0(0) o400->918a8a56-13a2-4a91-9ded-d83af214a091@23803@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne261-0'
00010000:00000001:20.0:1773851906.464508:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851906.464509:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851906.464510:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=139 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851906.464511:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851906.464512:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000006a39a93a refcount 5 to 23803@kfi7
00000100:00000001:20.0:1773851906.464513:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928424334176 : -107145285217440 : ffff9e8d4b55d360)
02000000:00000001:20.0:1773851906.464514:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851906.464514:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.464515:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851906.464516:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-23803@kfi7
00000400:00000010:20.0:1773851906.464516:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000046fff747.
00000100:00000200:20.0:1773851906.464517:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858030992780096, offset 224
00000400:00000200:20.0:1773851906.464518:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-23803@kfi7
00000400:00000200:20.0:1773851906.464519:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:20.0:1773851906.464520:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 1
00000400:00000200:20.0:1773851906.464521:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000400:00000200:20.0:1773851906.464522:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 3
00000400:00000200:20.0:1773851906.464523:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  23803@kfi7 local destination
00000400:00000200:20.0:1773851906.464524:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770579:8770579:1024:4294967295] 23803@kfi7 LPNI seq info [28036:28036:16:4294967295]
00000400:00000200:20.0:1773851906.464526:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000400:00000200:20.0:1773851906.464526:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 23803@kfi7 to cpt 5
00000400:00000200:20.0:1773851906.464528:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 23803@kfi7(23803@kfi7:23803@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851906.464529:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 3
00000800:00000200:20.0:1773851906.464531:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851906.464532:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851906.464534:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851906.464536:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f Using peer 23803@kfi7(0x39f)
00000800:00000200:20.0:1773851906.464539:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:5 Transaction ID 0000000063fe874a: Posted send of 324 bytes to peer 0x39f: rc=0
00000800:00000200:20.0:1773851906.464541:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851906.464545:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851906.464546:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000006a39a93a refcount 4 to 23803@kfi7
00010000:00000001:20.0:1773851906.464547:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851906.464547:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.464548:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851906.464550:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000949a9c8b x1858030992780096/t0(0) o400->918a8a56-13a2-4a91-9ded-d83af214a091@23803@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne261-0'
00000100:00100000:20.0:1773851906.464554:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000949a9c8b pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:918a8a56-13a2-4a91-9ded-d83af214a091+6:47895:x1858030992780096:12345-23803@kfi7:400:default-tuolumne261-0 Request processed in 62us (93us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851906.464557:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-23803@kfi7, seq: 1998103
00000100:00000040:20.0:1773851906.464558:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000071a6e1d9 : new rpc_count 0
00000100:00000001:20.0:1773851906.464559:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851906.464559:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851906.464560:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851906.464561:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008b2657fc.
00000020:00000010:20.0:1773851906.464562:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009ca7dbc5.
00000020:00000040:20.0:1773851906.464562:0:60934:0:(genops.c:882:class_export_put()) PUTting export 0000000071a6e1d9 : new refcount 5
00000100:00000001:20.0:1773851906.464563:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851906.464570:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851906.464572:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851906.464573:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->23803@kfi7: PUT: OK
00000400:00000200:21.0:1773851906.464574:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000046fff747
00000400:00000010:21.0:1773851906.464575:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000046fff747.
00000100:00000001:21.0:1773851906.464576:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851906.464577:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851906.464578:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000a0b5b0fd nid 23803@kfi7 refs 2
00000800:00000200:21.0:1773851906.464580:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 0000000063fe874a: 2069@kfi7:5 -> 23803@kfi7(000000008acc50a4):0x0 lsk 928 rsk 87 tsk 0 trmk 0 tmk 0 trr 5 tta 0x39f Transaction freed
00000800:00000200:26.0:1773851906.508495:0:2507427:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:26.0:1773851906.508495:0:2507427:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:26.0:1773851906.508497:0:2507427:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:26.0:1773851906.508499:0:2507427:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:26.0:1773851906.508501:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20960@kfi7 to cpt 6
00000400:00000200:26.0:1773851906.508502:0:2507427:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 20960@kfi7 : PUT - for me
00000400:00000200:26.0:1773851906.508503:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20960@kfi7 to cpt 6
00000400:00000200:26.0:1773851906.508504:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d2fb91c nid 20960@kfi7 refs 1
00000400:00000200:26.0:1773851906.508505:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20960@kfi7 to cpt 6
00000400:00000200:26.0:1773851906.508506:0:2507427:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d2fb91c nid 20960@kfi7 refs 2
00000400:00000200:26.0:1773851906.508507:0:2507427:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000001d2fb91c nid 20960@kfi7 refs 3
00000400:00000200:26.0:1773851906.508508:0:2507427:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20961@kfi7 to cpt 1
00000400:00000200:26.0:1773851906.508509:0:2507427:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-20961@kfi7 of length 224 into portal 12 MB=0x69b09ada10480
00000400:00000200:26.0:1773851906.508510:0:2507427:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-20961@kfi7 of length 224/224 into md 0x16159c9699 [64] + 48992
00000800:00000200:26.0:1773851906.508512:0:2507427:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:26.0:1773851906.508513:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851906.508514:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20960@kfi7: PUT: OK
00000100:00000001:26.0:1773851906.508515:0:2507427:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:26.0:1773851906.508516:0:2507427:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:26.0:1773851906.508517:0:2507427:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000918ac0e2.
00000100:00000040:26.0:1773851906.508517:0:2507427:0:(events.c:358:request_in_callback()) incoming req@00000000918ac0e2 x1859315730285696 msgsize 224
00000100:00100000:26.0:1773851906.508519:0:2507427:0:(events.c:361:request_in_callback()) peer: 12345-20961@kfi7 (source: 12345-20960@kfi7)
00000100:00000001:26.0:1773851906.508520:0:2507427:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:26.0:1773851906.508521:0:2507427:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000001d2fb91c nid 20960@kfi7 refs 2
00000100:00000001:24.0:1773851906.508521:0:60973:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:26.0:1773851906.508522:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000006e71e7e9: 2069@kfi7:6 <- 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851906.508522:0:60973:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851906.508522:0:60973:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851906.508522:0:60973:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851906.508523:0:60973:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851906.508524:0:60973:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859315730285696
00000020:00000001:24.0:1773851906.508524:0:60973:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851906.508525:0:60973:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac92e5a
00000020:00000001:24.0:1773851906.508525:0:60973:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851906.508529:0:60973:0:(lustre_handles.c:151:class_handle2object()) GET export 0000000027beeb13 refcount=557
00000020:00000001:24.0:1773851906.508529:0:60973:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944744644608 : -107128964907008 : ffff9e91181a0000)
00000020:00000001:24.0:1773851906.508530:0:60973:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944744644608 : -107128964907008 : ffff9e91181a0000)
00000100:00000001:24.0:1773851906.508531:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.508531:0:60973:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851906.508532:0:60973:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851906.508533:0:60973:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.508534:0:60973:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000001:24.0:1773851906.508534:0:60973:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851906.508535:0:60973:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851906.508535:0:60973:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851906.508536:0:60973:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:24.0:1773851906.508536:0:60973:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:24.0:1773851906.508537:0:60973:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.508538:0:60973:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:26.0:1773851906.508539:0:41182:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851906.508539:0:60973:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851906.508539:0:60973:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:26.0:1773851906.508540:0:41182:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851906.508540:0:60973:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-20961@kfi7, seq: 2025209
00000100:00000001:26.0:1773851906.508541:0:41182:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851906.508541:0:60973:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 0000000027beeb13 : new rpc_count 6
00000100:00000001:26.0:1773851906.508542:0:41182:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.508542:0:60973:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637105767433088 : -106967942118528 : ffff9eb695cec380)
00000100:00000040:24.0:1773851906.508543:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000918ac0e2 x1859315730285696/t0(0) o400->429ba700-3a73-4a1e-94e0-f2d2c040c60e@20961@kfi7:187/0 lens 224/0 e 0 to 0 dl 1773852302 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1791-0'
00000100:00000001:24.0:1773851906.508545:0:60973:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.508546:0:60973:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851906.508547:0:60973:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000918ac0e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:429ba700-3a73-4a1e-94e0-f2d2c040c60e+557:39506:x1859315730285696:12345-20961@kfi7:400:default-tuolumne1791-0
00000100:00000200:24.0:1773851906.508548:0:60973:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859315730285696
00000020:00000001:24.0:1773851906.508549:0:60973:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851906.508549:0:60973:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851906.508550:0:60973:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.508551:0:60973:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851906.508551:0:60973:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:24.0:1773851906.508552:0:60973:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:24.0:1773851906.508552:0:60973:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859315730285696, found 0 last_xid 1859315697686911
00000020:00000001:24.0:1773851906.508553:0:60973:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851906.508554:0:60973:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851906.508554:0:60973:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851906.508555:0:60973:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.508555:0:60973:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:24.0:1773851906.508556:0:60973:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851906.508557:0:60973:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851906.508557:0:60973:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000009a77713c.
02000000:00000001:24.0:1773851906.508558:0:60973:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.508558:0:60973:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.508559:0:60973:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851906.508560:0:60973:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264592162, transno 0, xid 1859315730285696
00010000:00000001:24.0:1773851906.508560:0:60973:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851906.508561:0:60973:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000918ac0e2 x1859315730285696/t0(0) o400->429ba700-3a73-4a1e-94e0-f2d2c040c60e@20961@kfi7:187/0 lens 224/224 e 0 to 0 dl 1773852302 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1791-0'
00010000:00000001:24.0:1773851906.508563:0:60973:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851906.508564:0:60973:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851906.508565:0:60973:0:(import.c:1951:at_measured()) add 1 to 00000000eab3bd15 time=139 v=313 (313 212 1 1)
00000100:00000001:24.0:1773851906.508566:0:60973:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851906.508566:0:60973:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000024eff6a3 refcount 3 to 20961@kfi7
00000100:00000001:24.0:1773851906.508567:0:60973:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636928405413728 : -107145304137888 : ffff9e8d4a351f60)
02000000:00000001:24.0:1773851906.508568:0:60973:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851906.508568:0:60973:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.508569:0:60973:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851906.508570:0:60973:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-20960@kfi7
00000400:00000010:24.0:1773851906.508570:0:60973:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000d7bd97df.
00000100:00000200:24.0:1773851906.508571:0:60973:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859315730285696, offset 224
00000400:00000200:24.0:1773851906.508572:0:60973:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-20960@kfi7
00000400:00000200:24.0:1773851906.508573:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20960@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.508574:0:60973:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000001d2fb91c nid 20960@kfi7 refs 1
00000400:00000200:24.0:1773851906.508575:0:60973:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000001d2fb91c nid 20960@kfi7 refs 2
00000400:00000200:24.0:1773851906.508576:0:60973:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000001d2fb91c nid 20960@kfi7 refs 3
00000400:00000200:24.0:1773851906.508577:0:60973:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  20960@kfi7 local destination
00000400:00000200:24.0:1773851906.508578:0:60973:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770580:8770580:1024:4294967295] 20960@kfi7 LPNI seq info [2566881:2566881:16:4294967295]
00000400:00000200:24.0:1773851906.508579:0:60973:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000001d2fb91c nid 20960@kfi7 refs 2
00000400:00000200:24.0:1773851906.508580:0:60973:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 20960@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.508582:0:60973:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 20960@kfi7(20960@kfi7:20960@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851906.508583:0:60973:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000001d2fb91c nid 20960@kfi7 refs 3
00000800:00000200:24.0:1773851906.508584:0:60973:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851906.508585:0:60973:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:24.0:1773851906.508587:0:60973:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851906.508589:0:60973:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd56 Using peer 20960@kfi7(0xd56)
00000800:00000200:24.0:1773851906.508592:0:60973:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:6 Transaction ID 00000000416fd73d: Posted send of 324 bytes to peer 0xd56: rc=0
00000800:00000200:24.0:1773851906.508593:0:60973:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd56 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851906.508595:0:60973:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851906.508596:0:60973:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000024eff6a3 refcount 2 to 20961@kfi7
00010000:00000001:24.0:1773851906.508597:0:60973:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851906.508597:0:60973:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.508598:0:60973:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851906.508599:0:60973:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000918ac0e2 x1859315730285696/t0(0) o400->429ba700-3a73-4a1e-94e0-f2d2c040c60e@20961@kfi7:187/0 lens 224/224 e 0 to 0 dl 1773852302 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1791-0'
00000100:00100000:24.0:1773851906.508607:0:60973:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000918ac0e2 pname:cluuid+ref:pid:xid:nid:opc:job mdt06_062:429ba700-3a73-4a1e-94e0-f2d2c040c60e+557:39506:x1859315730285696:12345-20961@kfi7:400:default-tuolumne1791-0 Request processed in 61us (89us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851906.508610:0:60973:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-20961@kfi7, seq: 2025209
00000100:00000040:24.0:1773851906.508611:0:60973:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 0000000027beeb13 : new rpc_count 5
00000100:00000001:24.0:1773851906.508612:0:60973:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851906.508612:0:60973:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851906.508613:0:60973:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.508613:0:60973:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851906.508614:0:60973:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851906.508615:0:60973:0:(genops.c:882:class_export_put()) PUTting export 0000000027beeb13 : new refcount 556
00000100:00000001:24.0:1773851906.508616:0:60973:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:26.0:1773851906.508622:0:2507427:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd56 TN_EVENT_TX_OK event status 0
00000400:00000200:26.0:1773851906.508623:0:2507427:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:26.0:1773851906.508624:0:2507427:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->20960@kfi7: PUT: OK
00000400:00000200:26.0:1773851906.508625:0:2507427:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000d7bd97df
00000400:00000010:26.0:1773851906.508626:0:2507427:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000d7bd97df.
00000100:00000001:26.0:1773851906.508626:0:2507427:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:26.0:1773851906.508627:0:2507427:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:26.0:1773851906.508628:0:2507427:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000001d2fb91c nid 20960@kfi7 refs 2
00000800:00000200:26.0:1773851906.508629:0:2507427:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000416fd73d: 2069@kfi7:6 -> 20960@kfi7(00000000d32111eb):0x0 lsk 3415 rsk 47 tsk 0 trmk 0 tmk 0 trr 6 tta 0xd56 Transaction freed
00000800:00000200:18.0:1773851906.558029:0:2507147:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:18.0:1773851906.558030:0:2507147:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:4 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:18.0:1773851906.558031:0:2507147:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:18.0:1773851906.558036:0:2507147:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:18.0:1773851906.558038:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.558039:0:2507147:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 17315@kfi7 : PUT - for me
00000400:00000200:18.0:1773851906.558040:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.558041:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 1
00000400:00000200:18.0:1773851906.558042:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:18.0:1773851906.558043:0:2507147:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000400:00000200:18.0:1773851906.558044:0:2507147:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 3
00000400:00000200:18.0:1773851906.558044:0:2507147:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17314@kfi7 to cpt 0
00000400:00000200:18.0:1773851906.558045:0:2507147:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-17314@kfi7 of length 224 into portal 12 MB=0x69b4b5f4151c0
00000400:00000200:18.0:1773851906.558046:0:2507147:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-17314@kfi7 of length 224/224 into md 0x6ab01b5d1 [64] + 53600
00000800:00000200:18.0:1773851906.558048:0:2507147:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:18.0:1773851906.558050:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851906.558051:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17315@kfi7: PUT: OK
00000100:00000001:18.0:1773851906.558052:0:2507147:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:18.0:1773851906.558052:0:2507147:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:18.0:1773851906.558053:0:2507147:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000005c6f97f7.
00000100:00000040:18.0:1773851906.558054:0:2507147:0:(events.c:358:request_in_callback()) incoming req@000000005c6f97f7 x1859597883232704 msgsize 224
00000100:00100000:18.0:1773851906.558055:0:2507147:0:(events.c:361:request_in_callback()) peer: 12345-17314@kfi7 (source: 12345-17315@kfi7)
00000100:00000001:18.0:1773851906.558056:0:2507147:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:18.0:1773851906.558057:0:2507147:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000100:00000001:19.0:1773851906.558058:0:60961:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:18.0:1773851906.558058:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 0000000022b02854: 2069@kfi7:4 <- 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 Transaction freed
02000000:00000001:19.0:1773851906.558059:0:60961:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:19.0:1773851906.558060:0:60961:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:19.0:1773851906.558060:0:60961:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:19.0:1773851906.558061:0:60961:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:19.0:1773851906.558062:0:60961:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859597883232704
00000020:00000001:19.0:1773851906.558062:0:60961:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:19.0:1773851906.558063:0:60961:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d8207e
00000020:00000001:19.0:1773851906.558064:0:60961:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:19.0:1773851906.558066:0:60961:0:(lustre_handles.c:151:class_handle2object()) GET export 000000006315effd refcount=167
00000020:00000001:19.0:1773851906.558067:0:60961:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636994755049472 : -107078954502144 : ffff9e9cbcf43800)
00000020:00000001:19.0:1773851906.558068:0:60961:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636994755049472 : -107078954502144 : ffff9e9cbcf43800)
00000100:00000001:19.0:1773851906.558070:0:60961:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:19.0:1773851906.558071:0:60961:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:19.0:1773851906.558072:0:60961:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000301e8f40.
00000020:00000010:19.0:1773851906.558073:0:60961:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000008870f69b.
00000020:00000010:19.0:1773851906.558073:0:60961:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000507e3969.
00000100:00000001:19.0:1773851906.558075:0:60961:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:19.0:1773851906.558075:0:60961:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:19.0:1773851906.558076:0:60961:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.558077:0:60961:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:19.0:1773851906.558077:0:60961:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:19.0:1773851906.558078:0:60961:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.558079:0:60961:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:19.0:1773851906.558080:0:60961:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:16.0:1773851906.558080:0:61039:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:19.0:1773851906.558081:0:60961:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:16.0:1773851906.558081:0:61039:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:16.0:1773851906.558082:0:61039:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-17314@kfi7, seq: 2156460
00000100:00000001:19.0:1773851906.558084:0:60961:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:19.0:1773851906.558084:0:60961:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851906.558084:0:61039:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000006315effd : new rpc_count 1
00000100:00000001:16.0:1773851906.558084:0:61039:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637109870488576 : -106963839063040 : ffff9eb78a5e6c00)
00000100:00000040:16.0:1773851906.558086:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000005c6f97f7 x1859597883232704/t0(0) o400->d490388b-0f0e-413d-b949-19f6e15372d5@17314@kfi7:158/0 lens 224/0 e 0 to 0 dl 1773852273 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1564-0'
00000100:00000001:16.0:1773851906.558089:0:61039:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:16.0:1773851906.558089:0:61039:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:16.0:1773851906.558090:0:61039:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000005c6f97f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d490388b-0f0e-413d-b949-19f6e15372d5+167:39675:x1859597883232704:12345-17314@kfi7:400:default-tuolumne1564-0
00000100:00000200:16.0:1773851906.558092:0:61039:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859597883232704
00000020:00000001:16.0:1773851906.558092:0:61039:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:16.0:1773851906.558093:0:61039:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:16.0:1773851906.558094:0:61039:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851906.558095:0:61039:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:16.0:1773851906.558095:0:61039:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:16.0:1773851906.558096:0:61039:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:16.0:1773851906.558097:0:61039:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859597883232704, found 0 last_xid 1859597882808255
00000020:00000001:16.0:1773851906.558098:0:61039:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:16.0:1773851906.558099:0:61039:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:16.0:1773851906.558100:0:61039:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:16.0:1773851906.558100:0:61039:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851906.558101:0:61039:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:16.0:1773851906.558102:0:61039:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:16.0:1773851906.558102:0:61039:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:16.0:1773851906.558103:0:61039:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000040dcafa1.
02000000:00000001:16.0:1773851906.558104:0:61039:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851906.558105:0:61039:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851906.558105:0:61039:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:16.0:1773851906.558106:0:61039:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062649, transno 0, xid 1859597883232704
00010000:00000001:16.0:1773851906.558107:0:61039:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:16.0:1773851906.558108:0:61039:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000005c6f97f7 x1859597883232704/t0(0) o400->d490388b-0f0e-413d-b949-19f6e15372d5@17314@kfi7:158/0 lens 224/224 e 0 to 0 dl 1773852273 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1564-0'
00010000:00000001:16.0:1773851906.558111:0:61039:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:16.0:1773851906.558111:0:61039:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:16.0:1773851906.558112:0:61039:0:(import.c:1951:at_measured()) add 1 to 00000000268b17f2 time=139 v=340 (340 214 1 1)
00000100:00000001:16.0:1773851906.558113:0:61039:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:16.0:1773851906.558114:0:61039:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001e95ced3 refcount 3 to 17314@kfi7
00000100:00000001:16.0:1773851906.558115:0:61039:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636929850079488 : -107143859472128 : ffff9e8da050f900)
02000000:00000001:16.0:1773851906.558116:0:61039:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:16.0:1773851906.558116:0:61039:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:16.0:1773851906.558117:0:61039:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:16.0:1773851906.558118:0:61039:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-17315@kfi7
00000400:00000010:16.0:1773851906.558119:0:61039:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000287d02c3.
00000100:00000200:16.0:1773851906.558120:0:61039:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859597883232704, offset 224
00000400:00000200:16.0:1773851906.558121:0:61039:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-17315@kfi7
00000400:00000200:16.0:1773851906.558122:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:16.0:1773851906.558123:0:61039:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 1
00000400:00000200:16.0:1773851906.558125:0:61039:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000400:00000200:16.0:1773851906.558126:0:61039:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 3
00000400:00000200:16.0:1773851906.558127:0:61039:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  17315@kfi7 local destination
00000400:00000200:16.0:1773851906.558129:0:61039:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770581:8770581:1024:4294967295] 17315@kfi7 LPNI seq info [136501:136501:16:4294967295]
00000400:00000200:16.0:1773851906.558130:0:61039:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000400:00000200:16.0:1773851906.558131:0:61039:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 17315@kfi7 to cpt 4
00000400:00000200:16.0:1773851906.558133:0:61039:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 17315@kfi7(17315@kfi7:17315@kfi7) <?> : PUT try# 0
00000400:00000200:16.0:1773851906.558134:0:61039:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 3
00000800:00000200:16.0:1773851906.558136:0:61039:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:4 Transaction ID 0 allocated
00000800:00000200:16.0:1773851906.558137:0:61039:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:16.0:1773851906.558140:0:61039:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:16.0:1773851906.558142:0:61039:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1242 Using peer 17315@kfi7(0x1242)
00000800:00000200:16.0:1773851906.558146:0:61039:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:4 Transaction ID 000000006cf84359: Posted send of 324 bytes to peer 0x1242: rc=0
00000800:00000200:16.0:1773851906.558147:0:61039:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1242 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:16.0:1773851906.558149:0:61039:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:16.0:1773851906.558150:0:61039:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001e95ced3 refcount 2 to 17314@kfi7
00010000:00000001:16.0:1773851906.558151:0:61039:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:16.0:1773851906.558152:0:61039:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:16.0:1773851906.558152:0:61039:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:16.0:1773851906.558153:0:61039:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000005c6f97f7 x1859597883232704/t0(0) o400->d490388b-0f0e-413d-b949-19f6e15372d5@17314@kfi7:158/0 lens 224/224 e 0 to 0 dl 1773852273 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1564-0'
00000100:00100000:16.0:1773851906.558158:0:61039:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000005c6f97f7 pname:cluuid+ref:pid:xid:nid:opc:job mdt04_082:d490388b-0f0e-413d-b949-19f6e15372d5+167:39675:x1859597883232704:12345-17314@kfi7:400:default-tuolumne1564-0 Request processed in 68us (103us total) trans 0 rc 0/0
00000100:00100000:16.0:1773851906.558161:0:61039:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-17314@kfi7, seq: 2156460
00000100:00000040:16.0:1773851906.558162:0:61039:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000006315effd : new rpc_count 0
00000100:00000001:16.0:1773851906.558162:0:61039:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:16.0:1773851906.558163:0:61039:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:16.0:1773851906.558164:0:61039:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000008870f69b.
00000020:00000010:16.0:1773851906.558164:0:61039:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000507e3969.
00000020:00000010:16.0:1773851906.558165:0:61039:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000301e8f40.
00000020:00000040:16.0:1773851906.558166:0:61039:0:(genops.c:882:class_export_put()) PUTting export 000000006315effd : new refcount 166
00000100:00000001:16.0:1773851906.558168:0:61039:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:18.0:1773851906.558173:0:2507147:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1242 TN_EVENT_TX_OK event status 0
00000400:00000200:18.0:1773851906.558174:0:2507147:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:18.0:1773851906.558175:0:2507147:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->17315@kfi7: PUT: OK
00000400:00000200:18.0:1773851906.558176:0:2507147:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000287d02c3
00000400:00000010:18.0:1773851906.558176:0:2507147:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000287d02c3.
00000100:00000001:18.0:1773851906.558179:0:2507147:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:18.0:1773851906.558179:0:2507147:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:18.0:1773851906.558180:0:2507147:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000f9c29837 nid 17315@kfi7 refs 2
00000800:00000200:18.0:1773851906.558181:0:2507147:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006cf84359: 2069@kfi7:4 -> 17315@kfi7(000000004cafb1f7):0x0 lsk 4675 rsk 12 tsk 0 trmk 0 tmk 0 trr 4 tta 0x1242 Transaction freed
00000800:00000200:29.0:1773851906.597281:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851906.597283:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851906.597284:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851906.597287:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851906.597290:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.597291:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 10512@kfi7 : PUT - for me
00000400:00000200:29.0:1773851906.597292:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.597294:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 1
00000400:00000200:29.0:1773851906.597296:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.597297:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000400:00000200:29.0:1773851906.597297:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 3
00000400:00000200:29.0:1773851906.597298:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10705@kfi7 to cpt 5
00000400:00000200:29.0:1773851906.597299:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-10705@kfi7 of length 224 into portal 12 MB=0x69b4732325180
00000400:00000200:29.0:1773851906.597301:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-10705@kfi7 of length 224/224 into md 0x77fe1859d [64] + 20112
00000800:00000200:29.0:1773851906.597303:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851906.597305:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851906.597306:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10512@kfi7: PUT: OK
00000100:00000001:29.0:1773851906.597307:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851906.597308:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851906.597309:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000002fb2f7c0.
00000100:00000040:29.0:1773851906.597310:0:2467684:0:(events.c:358:request_in_callback()) incoming req@000000002fb2f7c0 x1859579947405696 msgsize 224
00000100:00100000:29.0:1773851906.597311:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-10705@kfi7 (source: 12345-10512@kfi7)
00000100:00000001:29.0:1773851906.597312:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851906.597313:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000100:00000001:31.0:1773851906.597314:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851906.597315:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851906.597315:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:31.0:1773851906.597315:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:29.0:1773851906.597315:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2069@kfi7:7 <- 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
02000000:00000001:31.0:1773851906.597316:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851906.597317:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859579947405696
00000020:00000001:31.0:1773851906.597317:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851906.597318:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07ddc3e948b
00000020:00000001:31.0:1773851906.597319:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851906.597323:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000c5da03e1 refcount=49
00000020:00000001:31.0:1773851906.597324:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636944013828096 : -107129695723520 : ffff9e90ec8aa000)
00000020:00000001:31.0:1773851906.597324:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636944013828096 : -107129695723520 : ffff9e90ec8aa000)
00000100:00000001:31.0:1773851906.597325:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851906.597326:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851906.597327:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec3e46cc.
00000020:00000010:31.0:1773851906.597328:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851906.597329:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851906.597330:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851906.597330:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851906.597331:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851906.597332:0:60677:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:31.0:1773851906.597332:0:60677:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:31.0:1773851906.597333:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.597334:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851906.597335:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851906.597335:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851906.597336:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851906.597336:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851906.597337:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-10705@kfi7, seq: 2055630
00000100:00000040:31.0:1773851906.597337:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000c5da03e1 : new rpc_count 4
00000100:00000001:28.0:1773851906.597337:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.597338:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637151562459008 : -106922147092608 : ffff9ec13f676780)
00000100:00000001:28.0:1773851906.597338:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851906.597339:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000002fb2f7c0 x1859579947405696/t0(0) o400->f76f91bc-d379-4db1-b5b6-36a38df7a0d1@10705@kfi7:694/0 lens 224/0 e 0 to 0 dl 1773852054 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1153-0'
00000100:00000001:31.0:1773851906.597342:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851906.597342:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851906.597343:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000002fb2f7c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:f76f91bc-d379-4db1-b5b6-36a38df7a0d1+49:39830:x1859579947405696:12345-10705@kfi7:400:default-tuolumne1153-0
00000100:00000200:31.0:1773851906.597345:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859579947405696
00000020:00000001:31.0:1773851906.597346:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851906.597347:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851906.597347:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.597348:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851906.597348:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:31.0:1773851906.597349:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851906.597350:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859579947405696, found 0 last_xid 1859579946833023
00000020:00000001:31.0:1773851906.597350:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851906.597351:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851906.597352:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851906.597352:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.597353:0:60677:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:31.0:1773851906.597353:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851906.597354:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851906.597355:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000006e2335ad.
02000000:00000001:31.0:1773851906.597355:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.597356:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.597356:0:60677:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851906.597357:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264582484, transno 0, xid 1859579947405696
00010000:00000001:31.0:1773851906.597358:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851906.597359:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000002fb2f7c0 x1859579947405696/t0(0) o400->f76f91bc-d379-4db1-b5b6-36a38df7a0d1@10705@kfi7:694/0 lens 224/224 e 0 to 0 dl 1773852054 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1153-0'
00010000:00000001:31.0:1773851906.597361:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851906.597362:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851906.597362:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=139 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851906.597363:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851906.597364:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a9caf37f refcount 3 to 10705@kfi7
00000100:00000001:31.0:1773851906.597365:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106400 : -107156354445216 : ffff9e8ab78ed060)
02000000:00000001:31.0:1773851906.597366:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851906.597366:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.597367:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851906.597368:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-10512@kfi7
00000400:00000010:31.0:1773851906.597368:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000f9abbdbd.
00000100:00000200:31.0:1773851906.597370:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859579947405696, offset 224
00000400:00000200:31.0:1773851906.597371:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-10512@kfi7
00000400:00000200:31.0:1773851906.597372:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:31.0:1773851906.597373:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 1
00000400:00000200:31.0:1773851906.597374:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000400:00000200:31.0:1773851906.597375:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 3
00000400:00000200:31.0:1773851906.597376:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  10512@kfi7 local destination
00000400:00000200:31.0:1773851906.597377:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770582:8770582:1024:4294967295] 10512@kfi7 LPNI seq info [535627:535627:16:4294967295]
00000400:00000200:31.0:1773851906.597379:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000400:00000200:31.0:1773851906.597379:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 10512@kfi7 to cpt 7
00000400:00000200:31.0:1773851906.597381:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 10512@kfi7(10512@kfi7:10512@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851906.597382:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 3
00000800:00000200:31.0:1773851906.597383:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851906.597384:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:31.0:1773851906.597386:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851906.597389:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x73 Using peer 10512@kfi7(0x73)
00000800:00000200:31.0:1773851906.597392:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:7 Transaction ID 00000000f78341e7: Posted send of 324 bytes to peer 0x73: rc=0
00000800:00000200:31.0:1773851906.597393:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x73 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851906.597395:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851906.597396:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a9caf37f refcount 2 to 10705@kfi7
00010000:00000001:31.0:1773851906.597397:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851906.597397:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.597398:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851906.597399:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000002fb2f7c0 x1859579947405696/t0(0) o400->f76f91bc-d379-4db1-b5b6-36a38df7a0d1@10705@kfi7:694/0 lens 224/224 e 0 to 0 dl 1773852054 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1153-0'
00000100:00100000:31.0:1773851906.597402:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000002fb2f7c0 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:f76f91bc-d379-4db1-b5b6-36a38df7a0d1+49:39830:x1859579947405696:12345-10705@kfi7:400:default-tuolumne1153-0 Request processed in 59us (91us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851906.597404:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-10705@kfi7, seq: 2055630
00000100:00000040:31.0:1773851906.597405:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000c5da03e1 : new rpc_count 3
00000800:00000200:29.0:1773851906.597405:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x73 TN_EVENT_TX_OK event status 0
00000100:00000001:31.0:1773851906.597406:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:31.0:1773851906.597406:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851906.597407:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851906.597407:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000020:00000010:31.0:1773851906.597408:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000020:00000010:31.0:1773851906.597408:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec3e46cc.
00000400:00000200:29.0:1773851906.597408:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->10512@kfi7: PUT: OK
00000020:00000040:31.0:1773851906.597409:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000c5da03e1 : new refcount 48
00000400:00000200:29.0:1773851906.597409:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000f9abbdbd
00000400:00000010:29.0:1773851906.597409:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000f9abbdbd.
00000100:00000001:31.0:1773851906.597410:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851906.597410:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851906.597410:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851906.597411:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000e94fac1a nid 10512@kfi7 refs 2
00000800:00000200:29.0:1773851906.597412:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000f78341e7: 2069@kfi7:7 -> 10512@kfi7(000000000f771f12):0x0 lsk 116 rsk 6 tsk 0 trmk 0 tmk 0 trr 7 tta 0x73 Transaction freed
00000800:00000200:29.0:1773851906.602173:0:2467684:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:29.0:1773851906.602174:0:2467684:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:7 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:29.0:1773851906.602176:0:2467684:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:29.0:1773851906.602180:0:2467684:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:29.0:1773851906.602183:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22704@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.602185:0:2467684:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 22704@kfi7 : PUT - for me
00000400:00000200:29.0:1773851906.602186:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22704@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.602187:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094022986 nid 22704@kfi7 refs 1
00000400:00000200:29.0:1773851906.602190:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22704@kfi7 to cpt 7
00000400:00000200:29.0:1773851906.602191:0:2467684:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094022986 nid 22704@kfi7 refs 2
00000400:00000200:29.0:1773851906.602192:0:2467684:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000094022986 nid 22704@kfi7 refs 3
00000400:00000200:29.0:1773851906.602193:0:2467684:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22705@kfi7 to cpt 2
00000400:00000200:29.0:1773851906.602195:0:2467684:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-22705@kfi7 of length 456 into portal 12 MB=0x699e14c3f3080
00000400:00000200:29.0:1773851906.602196:0:2467684:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-22705@kfi7 of length 456/456 into md 0x77fe1859d [64] + 20336
00000800:00000200:29.0:1773851906.602200:0:2467684:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:29.0:1773851906.602202:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:29.0:1773851906.602204:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22704@kfi7: PUT: OK
00000100:00000001:29.0:1773851906.602205:0:2467684:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:29.0:1773851906.602206:0:2467684:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:29.0:1773851906.602207:0:2467684:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000025a96101.
00000100:00000040:29.0:1773851906.602208:0:2467684:0:(events.c:358:request_in_callback()) incoming req@0000000025a96101 x1858042786164864 msgsize 456
00000100:00100000:29.0:1773851906.602210:0:2467684:0:(events.c:361:request_in_callback()) peer: 12345-22705@kfi7 (source: 12345-22704@kfi7)
00000100:00000001:29.0:1773851906.602211:0:2467684:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:29.0:1773851906.602213:0:2467684:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000094022986 nid 22704@kfi7 refs 2
00000100:00000001:31.0:1773851906.602214:0:60677:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:31.0:1773851906.602214:0:60677:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:31.0:1773851906.602215:0:60677:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000800:00000200:29.0:1773851906.602215:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 000000009b83ff6e: 2054@kfi7:7 <- 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 Transaction freed
00000100:00000001:31.0:1773851906.602216:0:60677:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:31.0:1773851906.602217:0:60677:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:31.0:1773851906.602218:0:60677:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858042786164864
00000020:00000001:31.0:1773851906.602218:0:60677:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:31.0:1773851906.602219:0:60677:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac9204c
00000020:00000001:31.0:1773851906.602220:0:60677:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:31.0:1773851906.602223:0:60677:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000e1274596 refcount=6
00000020:00000001:31.0:1773851906.602224:0:60677:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629279744 : -107123080271872 : ffff9e9276da6800)
00000020:00000001:31.0:1773851906.602225:0:60677:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629279744 : -107123080271872 : ffff9e9276da6800)
00000100:00000001:31.0:1773851906.602226:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851906.602227:0:60677:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:31.0:1773851906.602228:0:60677:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000ec3e46cc.
00000020:00000010:31.0:1773851906.602229:0:60677:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000d4caef57.
00000020:00000010:31.0:1773851906.602230:0:60677:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 0000000066776243.
00000100:00000001:31.0:1773851906.602231:0:60677:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:31.0:1773851906.602232:0:60677:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:31.0:1773851906.602232:0:60677:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.602234:0:60677:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.602235:0:60677:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:31.0:1773851906.602237:0:60677:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:31.0:1773851906.602238:0:60677:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:28.0:1773851906.602238:0:42267:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:28.0:1773851906.602239:0:42267:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:31.0:1773851906.602240:0:60677:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-22705@kfi7, seq: 364304991
00000100:00000040:31.0:1773851906.602241:0:60677:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000e1274596 : new rpc_count 1
00000100:00000001:28.0:1773851906.602241:0:42267:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.602242:0:60677:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637151562441728 : -106922147109888 : ffff9ec13f672400)
00000100:00000001:28.0:1773851906.602242:0:42267:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851906.602244:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000025a96101 x1858042786164864/t0(0) o17->e6b8f102-d037-4a55-a360-eeca5675b76c@22705@kfi7:187/0 lens 456/0 e 0 to 0 dl 1773852302 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-tuolumne1902-0'
00000100:00000001:31.0:1773851906.602248:0:60677:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:31.0:1773851906.602249:0:60677:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:31.0:1773851906.602250:0:60677:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000025a96101 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:e6b8f102-d037-4a55-a360-eeca5675b76c+6:39861:x1858042786164864:12345-22705@kfi7:17:default-tuolumne1902-0
00000100:00000200:31.0:1773851906.602252:0:60677:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858042786164864
00000020:00000001:31.0:1773851906.602253:0:60677:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:31.0:1773851906.602254:0:60677:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:31.0:1773851906.602255:0:60677:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.602256:0:60677:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:31.0:1773851906.602256:0:60677:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658224 : -1035893392 : ffffffffc2418570)
00000020:00000001:31.0:1773851906.602257:0:60677:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:31.0:1773851906.602258:0:60677:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858042786164864, found 0 last_xid 1858042786164863
00000020:00000001:31.0:1773851906.602259:0:60677:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:31.0:1773851906.602260:0:60677:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:31.0:1773851906.602261:0:60677:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:31.0:1773851906.602261:0:60677:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:31.0:1773851906.602262:0:60677:0:(mdt_handler.c:2672:mdt_io_set_info()) Process entered
00000100:00000001:31.0:1773851906.602263:0:60677:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:31.0:1773851906.602264:0:60677:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:31.0:1773851906.602265:0:60677:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 688 at 000000001a23e593.
02000000:00000001:31.0:1773851906.602266:0:60677:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.602267:0:60677:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.602268:0:60677:0:(tgt_grant.c:1168:tgt_grant_prepare_read()) Process entered
00000020:00000001:31.0:1773851906.602269:0:60677:0:(tgt_grant.c:296:tgt_statfs_internal()) Process entered
00080000:00000001:31.0:1773851906.602270:0:60677:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:31.0:1773851906.602271:0:60677:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.602272:0:60677:0:(tgt_grant.c:372:tgt_statfs_internal()) Process leaving via out (rc=0 : 0 : 0x0)
00000020:00000020:31.0:1773851906.602273:0:60677:0:(tgt_grant.c:422:tgt_grant_statfs()) lustre5-MDT0001: cli e6b8f102-d037-4a55-a360-eeca5675b76c/00000000e1274596 free: 126633370845184 avail: 126633368748032
00000020:00000001:31.0:1773851906.602276:0:60677:0:(tgt_grant.c:449:tgt_grant_space_left()) Process entered
00000020:00000020:31.0:1773851906.602276:0:60677:0:(tgt_grant.c:486:tgt_grant_space_left()) lustre5-MDT0001: cli e6b8f102-d037-4a55-a360-eeca5675b76c/00000000e1274596 avail=126633368748032 left=112130449866752 unstable=396361728 tot_grant=14502918860658 pending=396361728
00000020:00000001:31.0:1773851906.602278:0:60677:0:(tgt_grant.c:488:tgt_grant_space_left()) Process leaving (rc=112130449866752 : 112130449866752 : 65fb67a20000)
00000020:00000001:31.0:1773851906.602279:0:60677:0:(tgt_grant.c:512:tgt_grant_incoming()) Process entered
00000020:00000020:31.0:1773851906.602280:0:60677:0:(tgt_grant.c:528:tgt_grant_incoming()) lustre5-MDT0001: cli e6b8f102-d037-4a55-a360-eeca5675b76c/00000000e1274596 reports grant 517472256 dropped 0, local 585367552
00000020:00000001:31.0:1773851906.602282:0:60677:0:(tgt_grant.c:584:tgt_grant_incoming()) Process leaving
00000020:00000001:31.0:1773851906.602282:0:60677:0:(tgt_grant.c:1218:tgt_grant_prepare_read()) Process leaving
00000004:00000001:31.0:1773851906.602283:0:60677:0:(mdt_handler.c:2715:mdt_io_set_info()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:31.0:1773851906.602284:0:60677:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183098910982, transno 0, xid 1858042786164864
00010000:00000001:31.0:1773851906.602285:0:60677:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:31.0:1773851906.602287:0:60677:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000025a96101 x1858042786164864/t0(0) o17->e6b8f102-d037-4a55-a360-eeca5675b76c@22705@kfi7:187/0 lens 456/432 e 0 to 0 dl 1773852302 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1902-0'
00010000:00000001:31.0:1773851906.602291:0:60677:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:31.0:1773851906.602291:0:60677:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:31.0:1773851906.602292:0:60677:0:(import.c:1951:at_measured()) add 1 to 000000007e22ed49 time=139 v=115 (1 1 1 115)
00000100:00000001:31.0:1773851906.602294:0:60677:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:31.0:1773851906.602295:0:60677:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000fedb57c3 refcount 3 to 22705@kfi7
00000100:00000001:31.0:1773851906.602296:0:60677:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636926959055616 : -107146750496000 : ffff9e8cf3ff7300)
02000000:00000001:31.0:1773851906.602297:0:60677:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:31.0:1773851906.602298:0:60677:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:31.0:1773851906.602299:0:60677:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:31.0:1773851906.602300:0:60677:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-22704@kfi7
00000400:00000010:31.0:1773851906.602301:0:60677:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000811703b3.
00000100:00000200:31.0:1773851906.602302:0:60677:0:(niobuf.c:86:ptl_send_buf()) Sending 432 bytes to portal 10, xid 1858042786164864, offset 224
00000400:00000200:31.0:1773851906.602304:0:60677:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-22704@kfi7
00000400:00000200:31.0:1773851906.602305:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22704@kfi7 to cpt 7
00000400:00000200:31.0:1773851906.602306:0:60677:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000094022986 nid 22704@kfi7 refs 1
00000400:00000200:31.0:1773851906.602308:0:60677:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000094022986 nid 22704@kfi7 refs 2
00000400:00000200:31.0:1773851906.602310:0:60677:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000094022986 nid 22704@kfi7 refs 3
00000400:00000200:31.0:1773851906.602311:0:60677:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  22704@kfi7 local destination
00000400:00000200:31.0:1773851906.602313:0:60677:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770583:8770583:1024:4294967295] 22704@kfi7 LPNI seq info [145397:145397:16:4294967295]
00000400:00000200:31.0:1773851906.602315:0:60677:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000094022986 nid 22704@kfi7 refs 2
00000400:00000200:31.0:1773851906.602317:0:60677:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 22704@kfi7 to cpt 7
00000400:00000200:31.0:1773851906.602320:0:60677:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 22704@kfi7(22704@kfi7:22704@kfi7) <?> : PUT try# 0
00000400:00000200:31.0:1773851906.602321:0:60677:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000094022986 nid 22704@kfi7 refs 3
00000800:00000200:31.0:1773851906.602324:0:60677:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:7 Transaction ID 0 allocated
00000800:00000200:31.0:1773851906.602325:0:60677:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 KFILND_MSG_IMMEDIATE in 432 bytes in 1 frags
00000800:00000200:31.0:1773851906.602329:0:60677:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:31.0:1773851906.602332:0:60677:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000eb5 Using peer 22704@kfi7(0x100000000000eb5)
00000800:00000200:31.0:1773851906.602337:0:60677:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:7 Transaction ID 00000000a3f98e4d: Posted send of 532 bytes to peer 0x100000000000eb5: rc=0
00000800:00000200:31.0:1773851906.602339:0:60677:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000eb5 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:31.0:1773851906.602342:0:60677:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:31.0:1773851906.602343:0:60677:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000fedb57c3 refcount 2 to 22705@kfi7
00010000:00000001:31.0:1773851906.602344:0:60677:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:31.0:1773851906.602345:0:60677:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:31.0:1773851906.602346:0:60677:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:31.0:1773851906.602347:0:60677:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000025a96101 x1858042786164864/t0(0) o17->e6b8f102-d037-4a55-a360-eeca5675b76c@22705@kfi7:187/0 lens 456/432 e 0 to 0 dl 1773852302 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-tuolumne1902-0'
00000100:00100000:31.0:1773851906.602351:0:60677:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000025a96101 pname:cluuid+ref:pid:xid:nid:opc:job mdt07_035:e6b8f102-d037-4a55-a360-eeca5675b76c+6:39861:x1858042786164864:12345-22705@kfi7:17:default-tuolumne1902-0 Request processed in 103us (143us total) trans 0 rc 0/0
00000100:00100000:31.0:1773851906.602355:0:60677:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-22705@kfi7, seq: 364304991
00000800:00000200:29.0:1773851906.602355:0:2467684:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000eb5 TN_EVENT_TX_OK event status 0
00000100:00000040:31.0:1773851906.602356:0:60677:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000e1274596 : new rpc_count 0
00000100:00000001:31.0:1773851906.602357:0:60677:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:29.0:1773851906.602357:0:2467684:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:31.0:1773851906.602358:0:60677:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:31.0:1773851906.602358:0:60677:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000d4caef57.
00000400:00000200:29.0:1773851906.602359:0:2467684:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->22704@kfi7: PUT: OK
00000020:00000010:31.0:1773851906.602360:0:60677:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 0000000066776243.
00000400:00000200:29.0:1773851906.602360:0:2467684:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000811703b3
00000020:00000010:31.0:1773851906.602361:0:60677:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000ec3e46cc.
00000020:00000040:31.0:1773851906.602362:0:60677:0:(genops.c:882:class_export_put()) PUTting export 00000000e1274596 : new refcount 5
00000400:00000010:29.0:1773851906.602362:0:2467684:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000811703b3.
00000100:00000001:31.0:1773851906.602363:0:60677:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:29.0:1773851906.602363:0:2467684:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:29.0:1773851906.602363:0:2467684:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:29.0:1773851906.602365:0:2467684:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000094022986 nid 22704@kfi7 refs 2
00000800:00000200:29.0:1773851906.602367:0:2467684:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000a3f98e4d: 2054@kfi7:7 -> 22704@kfi7(00000000c52fe140):0x0 lsk 3766 rsk 51 tsk 0 trmk 0 tmk 0 trr 7 tta 0x100000000000eb5 Transaction freed
00000800:00000200:1.0:1773851906.656998:0:2494030:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:1.0:1773851906.656999:0:2494030:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:0 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:1.0:1773851906.657000:0:2494030:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:1.0:1773851906.657003:0:2494030:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:1.0:1773851906.657005:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851906.657007:0:2494030:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 15667@kfi7 : PUT - for me
00000400:00000200:1.0:1773851906.657008:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851906.657009:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 1
00000400:00000200:1.0:1773851906.657010:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:1.0:1773851906.657011:0:2494030:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000400:00000200:1.0:1773851906.657012:0:2494030:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 3
00000400:00000200:1.0:1773851906.657013:0:2494030:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15666@kfi7 to cpt 5
00000400:00000200:1.0:1773851906.657014:0:2494030:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-15666@kfi7 of length 224 into portal 12 MB=0x69b4b93c12280
00000400:00000200:1.0:1773851906.657016:0:2494030:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-15666@kfi7 of length 224/224 into md 0x7fb56e801 [64] + 59736
00000800:00000200:1.0:1773851906.657018:0:2494030:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:1.0:1773851906.657020:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851906.657022:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15667@kfi7: PUT: OK
00000100:00000001:1.0:1773851906.657024:0:2494030:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:1.0:1773851906.657024:0:2494030:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:1.0:1773851906.657025:0:2494030:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000013543d1d.
00000100:00000040:1.0:1773851906.657026:0:2494030:0:(events.c:358:request_in_callback()) incoming req@0000000013543d1d x1859598764024448 msgsize 224
00000100:00100000:1.0:1773851906.657028:0:2494030:0:(events.c:361:request_in_callback()) peer: 12345-15666@kfi7 (source: 12345-15667@kfi7)
00000100:00000001:1.0:1773851906.657029:0:2494030:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:1.0:1773851906.657031:0:2494030:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000100:00000001:0.0:1773851906.657031:0:42868:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:1.0:1773851906.657032:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cc4d90e2: 2054@kfi7:0 <- 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 Transaction freed
02000000:00000001:0.0:1773851906.657032:0:42868:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:0.0:1773851906.657032:0:42868:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:0.0:1773851906.657033:0:42868:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:0.0:1773851906.657034:0:42868:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:0.0:1773851906.657035:0:42868:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1859598764024448
00000020:00000001:0.0:1773851906.657035:0:42868:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:0.0:1773851906.657036:0:42868:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f07e23d80d30
00000020:00000001:0.0:1773851906.657037:0:42868:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:0.0:1773851906.657038:0:42868:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000132a9f0c refcount=167
00000020:00000001:0.0:1773851906.657038:0:42868:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637126449935360 : -106947259616256 : ffff9ebb6694b400)
00000020:00000001:0.0:1773851906.657039:0:42868:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637126449935360 : -106947259616256 : ffff9ebb6694b400)
00000100:00000001:0.0:1773851906.657040:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851906.657041:0:42868:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:0.0:1773851906.657042:0:42868:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000accd888e.
00000020:00000010:0.0:1773851906.657043:0:42868:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851906.657044:0:42868:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000596502fc.
00000100:00000001:0.0:1773851906.657045:0:42868:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:0.0:1773851906.657046:0:42868:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:0.0:1773851906.657046:0:42868:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:0.0:1773851906.657047:0:42868:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:0.0:1773851906.657048:0:42868:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:0.0:1773851906.657049:0:42868:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851906.657050:0:42868:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:2.0:1773851906.657051:0:60951:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851906.657051:0:42868:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:0.0:1773851906.657051:0:42868:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:2.0:1773851906.657052:0:60951:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:0.0:1773851906.657053:0:42868:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-15666@kfi7, seq: 1997652
00000100:00000001:2.0:1773851906.657054:0:60951:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:2.0:1773851906.657054:0:60951:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851906.657054:0:42868:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000132a9f0c : new rpc_count 1
00000100:00000001:0.0:1773851906.657054:0:42868:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637091327723520 : -106982381828096 : ffff9eb339224800)
00000100:00000040:0.0:1773851906.657057:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000013543d1d x1859598764024448/t0(0) o400->7c56ebde-86e9-4a5b-8754-bbedb7bddb49@15666@kfi7:546/0 lens 224/0 e 0 to 0 dl 1773852661 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1465-0'
00000100:00000001:0.0:1773851906.657060:0:42868:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:0.0:1773851906.657060:0:42868:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:0.0:1773851906.657061:0:42868:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000013543d1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7c56ebde-86e9-4a5b-8754-bbedb7bddb49+167:39760:x1859598764024448:12345-15666@kfi7:400:default-tuolumne1465-0
00000100:00000200:0.0:1773851906.657063:0:42868:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1859598764024448
00000020:00000001:0.0:1773851906.657063:0:42868:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:0.0:1773851906.657064:0:42868:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:0.0:1773851906.657065:0:42868:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.657066:0:42868:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:0.0:1773851906.657066:0:42868:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:0.0:1773851906.657067:0:42868:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:0.0:1773851906.657067:0:42868:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1859598764024448, found 0 last_xid 1859598763597823
00000020:00000001:0.0:1773851906.657068:0:42868:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:0.0:1773851906.657069:0:42868:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:0.0:1773851906.657069:0:42868:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:0.0:1773851906.657070:0:42868:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.657071:0:42868:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:0.0:1773851906.657071:0:42868:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:0.0:1773851906.657072:0:42868:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:0.0:1773851906.657072:0:42868:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 00000000877d5ffd.
02000000:00000001:0.0:1773851906.657073:0:42868:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851906.657073:0:42868:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.657074:0:42868:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:0.0:1773851906.657075:0:42868:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183264062787, transno 0, xid 1859598764024448
00010000:00000001:0.0:1773851906.657076:0:42868:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:0.0:1773851906.657077:0:42868:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000013543d1d x1859598764024448/t0(0) o400->7c56ebde-86e9-4a5b-8754-bbedb7bddb49@15666@kfi7:546/0 lens 224/224 e 0 to 0 dl 1773852661 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1465-0'
00010000:00000001:0.0:1773851906.657079:0:42868:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:0.0:1773851906.657079:0:42868:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:0.0:1773851906.657080:0:42868:0:(import.c:1951:at_measured()) add 1 to 000000008ac56573 time=139 v=600 (1 1121 1 1)
00000100:00000001:0.0:1773851906.657081:0:42868:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:0.0:1773851906.657084:0:42868:0:(connection.c:145:ptlrpc_connection_addref()) conn=00000000a504c1f7 refcount 3 to 15666@kfi7
00000100:00000001:0.0:1773851906.657085:0:42868:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636934402093728 : -107139307457888 : ffff9e8eafa332a0)
02000000:00000001:0.0:1773851906.657086:0:42868:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:0.0:1773851906.657087:0:42868:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:0.0:1773851906.657087:0:42868:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:0.0:1773851906.657088:0:42868:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-15667@kfi7
00000400:00000010:0.0:1773851906.657088:0:42868:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 0000000050d1fed3.
00000100:00000200:0.0:1773851906.657089:0:42868:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1859598764024448, offset 224
00000400:00000200:0.0:1773851906.657090:0:42868:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-15667@kfi7
00000400:00000200:0.0:1773851906.657091:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:0.0:1773851906.657092:0:42868:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 1
00000400:00000200:0.0:1773851906.657093:0:42868:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000400:00000200:0.0:1773851906.657094:0:42868:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 3
00000400:00000200:0.0:1773851906.657095:0:42868:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  15667@kfi7 local destination
00000400:00000200:0.0:1773851906.657097:0:42868:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770584:8770584:1024:4294967295] 15667@kfi7 LPNI seq info [4389012:4389012:16:4294967295]
00000400:00000200:0.0:1773851906.657098:0:42868:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000400:00000200:0.0:1773851906.657099:0:42868:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 15667@kfi7 to cpt 0
00000400:00000200:0.0:1773851906.657101:0:42868:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 15667@kfi7(15667@kfi7:15667@kfi7) <?> : PUT try# 0
00000400:00000200:0.0:1773851906.657102:0:42868:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 3
00000800:00000200:0.0:1773851906.657103:0:42868:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:0 Transaction ID 0 allocated
00000800:00000200:0.0:1773851906.657104:0:42868:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:0.0:1773851906.657107:0:42868:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:0.0:1773851906.657109:0:42868:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f9f Using peer 15667@kfi7(0x100000000000f9f)
00000800:00000200:0.0:1773851906.657111:0:42868:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:0 Transaction ID 00000000d98a5a5c: Posted send of 324 bytes to peer 0x100000000000f9f: rc=0
00000800:00000200:0.0:1773851906.657113:0:42868:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f9f TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:0.0:1773851906.657115:0:42868:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:0.0:1773851906.657116:0:42868:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=00000000a504c1f7 refcount 2 to 15666@kfi7
00010000:00000001:0.0:1773851906.657116:0:42868:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:0.0:1773851906.657117:0:42868:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:0.0:1773851906.657118:0:42868:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:0.0:1773851906.657118:0:42868:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000013543d1d x1859598764024448/t0(0) o400->7c56ebde-86e9-4a5b-8754-bbedb7bddb49@15666@kfi7:546/0 lens 224/224 e 0 to 0 dl 1773852661 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1465-0'
00000100:00100000:0.0:1773851906.657123:0:42868:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000013543d1d pname:cluuid+ref:pid:xid:nid:opc:job mdt00_007:7c56ebde-86e9-4a5b-8754-bbedb7bddb49+167:39760:x1859598764024448:12345-15666@kfi7:400:default-tuolumne1465-0 Request processed in 62us (96us total) trans 0 rc 0/0
00000100:00100000:0.0:1773851906.657125:0:42868:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-15666@kfi7, seq: 1997652
00000100:00000040:0.0:1773851906.657126:0:42868:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000132a9f0c : new rpc_count 0
00000100:00000001:0.0:1773851906.657127:0:42868:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:0.0:1773851906.657127:0:42868:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:0.0:1773851906.657128:0:42868:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000758ace2b.
00000020:00000010:0.0:1773851906.657129:0:42868:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000596502fc.
00000020:00000010:0.0:1773851906.657129:0:42868:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000accd888e.
00000020:00000040:0.0:1773851906.657130:0:42868:0:(genops.c:882:class_export_put()) PUTting export 00000000132a9f0c : new refcount 166
00000100:00000001:0.0:1773851906.657131:0:42868:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:1.0:1773851906.657138:0:2494030:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f9f TN_EVENT_TX_OK event status 0
00000400:00000200:1.0:1773851906.657139:0:2494030:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:1.0:1773851906.657141:0:2494030:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->15667@kfi7: PUT: OK
00000400:00000200:1.0:1773851906.657141:0:2494030:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 0000000050d1fed3
00000400:00000010:1.0:1773851906.657142:0:2494030:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 0000000050d1fed3.
00000100:00000001:1.0:1773851906.657142:0:2494030:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:1.0:1773851906.657143:0:2494030:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:1.0:1773851906.657144:0:2494030:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000bf1b606c nid 15667@kfi7 refs 2
00000800:00000200:1.0:1773851906.657145:0:2494030:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000d98a5a5c: 2054@kfi7:0 -> 15667@kfi7(000000003642dab7):0x0 lsk 4000 rsk 10 tsk 0 trmk 0 tmk 0 trr 0 tta 0x100000000000f9f Transaction freed
00000800:00000200:5.0:1773851906.673016:0:2507993:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:5.0:1773851906.673018:0:2507993:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2069@kfi7:1 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:5.0:1773851906.673020:0:2507993:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:5.0:1773851906.673024:0:2507993:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:5.0:1773851906.673027:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.673030:0:2507993:0:(lib-move.c:4556:lnet_parse()) TRACE: 2069@kfi7(2069@kfi7) <- 26082@kfi7 : PUT - for me
00000400:00000200:5.0:1773851906.673031:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.673033:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 1
00000400:00000200:5.0:1773851906.673035:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.673036:0:2507993:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000400:00000200:5.0:1773851906.673039:0:2507993:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 3
00000400:00000200:5.0:1773851906.673040:0:2507993:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:5.0:1773851906.673042:0:2507993:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-26082@kfi7 of length 224 into portal 12 MB=0x69bab6e312b40
00000400:00000200:5.0:1773851906.673045:0:2507993:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-26082@kfi7 of length 224/224 into md 0x793926dc5 [64] + 170928
00000800:00000200:5.0:1773851906.673048:0:2507993:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:5.0:1773851906.673051:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:5.0:1773851906.673053:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26082@kfi7: PUT: OK
00000100:00000001:5.0:1773851906.673054:0:2507993:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:5.0:1773851906.673055:0:2507993:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:5.0:1773851906.673057:0:2507993:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 00000000ec4866a8.
00000100:00000040:5.0:1773851906.673058:0:2507993:0:(events.c:358:request_in_callback()) incoming req@00000000ec4866a8 x1860010450692928 msgsize 224
00000100:00100000:5.0:1773851906.673060:0:2507993:0:(events.c:361:request_in_callback()) peer: 12345-26082@kfi7 (source: 12345-26082@kfi7)
00000100:00000001:5.0:1773851906.673062:0:2507993:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:5.0:1773851906.673063:0:2507993:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000800:00000200:5.0:1773851906.673065:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000cd4ef01e: 2069@kfi7:1 <- 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 Transaction freed
00000100:00000001:7.0:1773851906.673066:0:61015:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:7.0:1773851906.673067:0:61015:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:7.0:1773851906.673067:0:61015:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:7.0:1773851906.673068:0:61015:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:7.0:1773851906.673069:0:61015:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:7.0:1773851906.673070:0:61015:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1860010450692928
00000020:00000001:7.0:1773851906.673071:0:61015:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:7.0:1773851906.673072:0:61015:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f08f07a3ecc3
00000020:00000001:7.0:1773851906.673073:0:61015:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:7.0:1773851906.673073:0:61015:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000b01b6d34 refcount=6
00000020:00000001:7.0:1773851906.673074:0:61015:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446637113618595840 : -106960090955776 : ffff9eb869c60000)
00000020:00000001:7.0:1773851906.673076:0:61015:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446637113618595840 : -106960090955776 : ffff9eb869c60000)
00000100:00000001:7.0:1773851906.673077:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851906.673078:0:61015:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:7.0:1773851906.673079:0:61015:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 00000000e735bc14.
00000020:00000010:7.0:1773851906.673080:0:61015:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 000000009b7160b3.
00000020:00000010:7.0:1773851906.673081:0:61015:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000001359f515.
00000100:00000001:7.0:1773851906.673082:0:61015:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:7.0:1773851906.673083:0:61015:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:7.0:1773851906.673084:0:61015:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.673085:0:61015:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:7.0:1773851906.673086:0:61015:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:7.0:1773851906.673086:0:61015:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.673087:0:61015:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:7.0:1773851906.673089:0:61015:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:7.0:1773851906.673090:0:61015:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:4.0:1773851906.673090:0:60963:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00100000:7.0:1773851906.673091:0:61015:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-26082@kfi7, seq: 2002016
00000100:00000001:4.0:1773851906.673091:0:60963:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000040:7.0:1773851906.673092:0:61015:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000b01b6d34 : new rpc_count 1
00000100:00000001:7.0:1773851906.673093:0:61015:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636967363942016 : -107106345609600 : ffff9e965c511680)
00000100:00000001:4.0:1773851906.673093:0:60963:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:4.0:1773851906.673094:0:60963:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851906.673095:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@00000000ec4866a8 x1860010450692928/t0(0) o400->57c6abeb-2558-4462-b6dd-1b4491238d56@26082@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne2107-0'
00000100:00000001:7.0:1773851906.673099:0:61015:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:7.0:1773851906.673099:0:61015:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:7.0:1773851906.673100:0:61015:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@00000000ec4866a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:57c6abeb-2558-4462-b6dd-1b4491238d56+6:39500:x1860010450692928:12345-26082@kfi7:400:default-tuolumne2107-0
00000100:00000200:7.0:1773851906.673102:0:61015:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1860010450692928
00000020:00000001:7.0:1773851906.673103:0:61015:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:7.0:1773851906.673103:0:61015:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:7.0:1773851906.673104:0:61015:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.673105:0:61015:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:7.0:1773851906.673106:0:61015:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:7.0:1773851906.673106:0:61015:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:7.0:1773851906.673107:0:61015:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1860010450692928, found 0 last_xid 1860010450692927
00000020:00000001:7.0:1773851906.673108:0:61015:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:7.0:1773851906.673109:0:61015:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:7.0:1773851906.673109:0:61015:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:7.0:1773851906.673110:0:61015:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.673111:0:61015:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:7.0:1773851906.673112:0:61015:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:7.0:1773851906.673112:0:61015:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:7.0:1773851906.673113:0:61015:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 0000000040cac6a7.
02000000:00000001:7.0:1773851906.673114:0:61015:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.673115:0:61015:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.673116:0:61015:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:7.0:1773851906.673116:0:61015:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 0, transno 0, xid 1860010450692928
00010000:00000001:7.0:1773851906.673117:0:61015:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:7.0:1773851906.673118:0:61015:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@00000000ec4866a8 x1860010450692928/t0(0) o400->57c6abeb-2558-4462-b6dd-1b4491238d56@26082@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2107-0'
00010000:00000001:7.0:1773851906.673122:0:61015:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:7.0:1773851906.673122:0:61015:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:7.0:1773851906.673123:0:61015:0:(import.c:1951:at_measured()) add 1 to 00000000086e84a7 time=138 v=66 (1 1 1 1)
00000100:00000001:7.0:1773851906.673125:0:61015:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:7.0:1773851906.673125:0:61015:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000001557af9a refcount 3 to 26082@kfi7
00000100:00000001:7.0:1773851906.673126:0:61015:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917553702400 : -107156155849216 : ffff9e8ac3652600)
02000000:00000001:7.0:1773851906.673127:0:61015:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:7.0:1773851906.673128:0:61015:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:7.0:1773851906.673128:0:61015:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:7.0:1773851906.673129:0:61015:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-26082@kfi7
00000400:00000010:7.0:1773851906.673130:0:61015:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a60a0852.
00000100:00000200:7.0:1773851906.673131:0:61015:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1860010450692928, offset 224
00000400:00000200:7.0:1773851906.673133:0:61015:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-26082@kfi7
00000400:00000200:7.0:1773851906.673134:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:7.0:1773851906.673135:0:61015:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 1
00000400:00000200:7.0:1773851906.673136:0:61015:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000400:00000200:7.0:1773851906.673137:0:61015:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 3
00000400:00000200:7.0:1773851906.673139:0:61015:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2069@kfi7 to MR:  26082@kfi7 local destination
00000400:00000200:7.0:1773851906.673140:0:61015:0:(lib-move.c:1863:lnet_handle_send()) 2069@kfi7 NI seq info: [8770585:8770585:1024:4294967295] 26082@kfi7 LPNI seq info [5155700:5155700:16:4294967295]
00000400:00000200:7.0:1773851906.673142:0:61015:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000400:00000200:7.0:1773851906.673143:0:61015:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 26082@kfi7 to cpt 1
00000400:00000200:7.0:1773851906.673145:0:61015:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2069@kfi7(2069@kfi7:2069@kfi7) -> 26082@kfi7(26082@kfi7:26082@kfi7) <?> : PUT try# 0
00000400:00000200:7.0:1773851906.673147:0:61015:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 3
00000800:00000200:7.0:1773851906.673148:0:61015:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2069@kfi7:1 Transaction ID 0 allocated
00000800:00000200:7.0:1773851906.673149:0:61015:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:7.0:1773851906.673152:0:61015:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:7.0:1773851906.673155:0:61015:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x487 Using peer 26082@kfi7(0x487)
00000800:00000200:7.0:1773851906.673158:0:61015:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2069@kfi7:1 Transaction ID 00000000e7e04499: Posted send of 324 bytes to peer 0x487: rc=0
00000800:00000200:7.0:1773851906.673160:0:61015:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x487 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:7.0:1773851906.673162:0:61015:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:7.0:1773851906.673163:0:61015:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000001557af9a refcount 2 to 26082@kfi7
00010000:00000001:7.0:1773851906.673164:0:61015:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:7.0:1773851906.673164:0:61015:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:7.0:1773851906.673165:0:61015:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:7.0:1773851906.673166:0:61015:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@00000000ec4866a8 x1860010450692928/t0(0) o400->57c6abeb-2558-4462-b6dd-1b4491238d56@26082@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne2107-0'
00000100:00100000:7.0:1773851906.673169:0:61015:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@00000000ec4866a8 pname:cluuid+ref:pid:xid:nid:opc:job mdt01_076:57c6abeb-2558-4462-b6dd-1b4491238d56+6:39500:x1860010450692928:12345-26082@kfi7:400:default-tuolumne2107-0 Request processed in 69us (110us total) trans 0 rc 0/0
00000100:00100000:7.0:1773851906.673171:0:61015:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-26082@kfi7, seq: 2002016
00000100:00000040:7.0:1773851906.673172:0:61015:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000b01b6d34 : new rpc_count 0
00000800:00000200:5.0:1773851906.673172:0:2507993:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x487 TN_EVENT_TX_OK event status 0
00000100:00000001:7.0:1773851906.673173:0:61015:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000400:00000200:5.0:1773851906.673173:0:2507993:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000100:00000001:7.0:1773851906.673174:0:61015:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:7.0:1773851906.673174:0:61015:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 000000009b7160b3.
00000400:00000200:5.0:1773851906.673174:0:2507993:0:(lib-msg.c:838:lnet_health_check()) health check: 2069@kfi7->26082@kfi7: PUT: OK
00000020:00000010:7.0:1773851906.673175:0:61015:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000001359f515.
00000400:00000200:5.0:1773851906.673175:0:2507993:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a60a0852
00000020:00000010:7.0:1773851906.673176:0:61015:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 00000000e735bc14.
00000400:00000010:5.0:1773851906.673176:0:2507993:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a60a0852.
00000100:00000001:5.0:1773851906.673176:0:2507993:0:(events.c:407:reply_out_callback()) Process entered
00000020:00000040:7.0:1773851906.673177:0:61015:0:(genops.c:882:class_export_put()) PUTting export 00000000b01b6d34 : new refcount 5
00000100:00000001:5.0:1773851906.673177:0:2507993:0:(events.c:419:reply_out_callback()) Process leaving
00000100:00000001:7.0:1773851906.673178:0:61015:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000400:00000200:5.0:1773851906.673178:0:2507993:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 00000000158e1547 nid 26082@kfi7 refs 2
00000800:00000200:5.0:1773851906.673179:0:2507993:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000e7e04499: 2069@kfi7:1 -> 26082@kfi7(00000000ee5296e0):0x0 lsk 1160 rsk 13 tsk 0 trmk 0 tmk 0 trr 1 tta 0x487 Transaction freed
00000800:00000200:21.0:1773851906.703035:0:2494373:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:21.0:1773851906.703037:0:2494373:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:5 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:21.0:1773851906.703040:0:2494373:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c926eaba: 2054@kfi7:5 <- 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:21.0:1773851906.703046:0:2494373:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000c926eaba: 2054@kfi7:5 <- 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:21.0:1773851906.703050:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:21.0:1773851906.703053:0:2494373:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 16737@kfi7 : PUT - for me
00000400:00000200:21.0:1773851906.703056:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:21.0:1773851906.703057:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 1
00000400:00000200:21.0:1773851906.703059:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:21.0:1773851906.703061:0:2494373:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000400:00000200:21.0:1773851906.703062:0:2494373:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 3
00000400:00000200:21.0:1773851906.703064:0:2494373:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:21.0:1773851906.703067:0:2494373:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-16737@kfi7 of length 224 into portal 12 MB=0x699e0c3858200
00000400:00000200:21.0:1773851906.703070:0:2494373:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index c from 12345-16737@kfi7 of length 224/224 into md 0x6a32cacf5 [64] + 73096
00000800:00000200:21.0:1773851906.703075:0:2494373:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000c926eaba: 2054@kfi7:5 <- 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:21.0:1773851906.703078:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851906.703081:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16737@kfi7: PUT: OK
00000100:00000001:21.0:1773851906.703083:0:2494373:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:21.0:1773851906.703084:0:2494373:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt
00000100:00000010:21.0:1773851906.703086:0:2494373:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 0000000083e71aea.
00000100:00000040:21.0:1773851906.703087:0:2494373:0:(events.c:358:request_in_callback()) incoming req@0000000083e71aea x1858040492294656 msgsize 224
00000100:00100000:21.0:1773851906.703090:0:2494373:0:(events.c:361:request_in_callback()) peer: 12345-16737@kfi7 (source: 12345-16737@kfi7)
00000100:00000001:21.0:1773851906.703092:0:2494373:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:21.0:1773851906.703094:0:2494373:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000100:00000001:20.0:1773851906.703095:0:60934:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
02000000:00000001:20.0:1773851906.703096:0:60934:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:20.0:1773851906.703097:0:60934:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:20.0:1773851906.703097:0:60934:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
00000800:00000200:21.0:1773851906.703098:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000c926eaba: 2054@kfi7:5 <- 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 Transaction freed
02000000:00000001:20.0:1773851906.703099:0:60934:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:20.0:1773851906.703100:0:60934:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858040492294656
00000020:00000001:20.0:1773851906.703101:0:60934:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:20.0:1773851906.703102:0:60934:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac920f4
00000020:00000001:20.0:1773851906.703103:0:60934:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:20.0:1773851906.703107:0:60934:0:(lustre_handles.c:151:class_handle2object()) GET export 000000009e5dbd74 refcount=6
00000020:00000001:20.0:1773851906.703108:0:60934:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636950629499904 : -107123080051712 : ffff9e9276ddc400)
00000020:00000001:20.0:1773851906.703110:0:60934:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636950629499904 : -107123080051712 : ffff9e9276ddc400)
00000100:00000001:20.0:1773851906.703112:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851906.703115:0:60934:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:20.0:1773851906.703116:0:60934:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 000000009ca7dbc5.
00000020:00000010:20.0:1773851906.703117:0:60934:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851906.703119:0:60934:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 000000008b2657fc.
00000100:00000001:20.0:1773851906.703120:0:60934:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:20.0:1773851906.703121:0:60934:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:20.0:1773851906.703122:0:60934:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:20.0:1773851906.703123:0:60934:0:(nrs.c:866:ptlrpc_nrs_hpreq_add_nolock()) Process entered
00000100:00000001:20.0:1773851906.703124:0:60934:0:(nrs.c:874:ptlrpc_nrs_hpreq_add_nolock()) Process leaving
00000100:00000001:20.0:1773851906.703125:0:60934:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.703126:0:60934:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:23.0:1773851906.703129:0:61145:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:20.0:1773851906.703129:0:60934:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:23.0:1773851906.703130:0:61145:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:20.0:1773851906.703130:0:60934:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:20.0:1773851906.703131:0:60934:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-16737@kfi7, seq: 1998104
00000100:00000001:23.0:1773851906.703133:0:61145:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851906.703133:0:60934:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 000000009e5dbd74 : new rpc_count 1
00000100:00000001:23.0:1773851906.703134:0:61145:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.703134:0:60934:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446637156313430400 : -106917396121216 : ffff9ec25a957980)
00000100:00000040:20.0:1773851906.703136:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@0000000083e71aea x1858040492294656/t0(0) o400->0c8abac1-08b2-4ebd-94ea-b4eb21c770f0@16737@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:H/0/ffffffff rc 0/-1 job:'default-tuolumne1536-0'
00000100:00000001:20.0:1773851906.703141:0:60934:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:20.0:1773851906.703142:0:60934:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:20.0:1773851906.703143:0:60934:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@0000000083e71aea pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0c8abac1-08b2-4ebd-94ea-b4eb21c770f0+6:39638:x1858040492294656:12345-16737@kfi7:400:default-tuolumne1536-0
00000100:00000200:20.0:1773851906.703146:0:60934:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858040492294656
00000020:00000001:20.0:1773851906.703146:0:60934:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:20.0:1773851906.703147:0:60934:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:20.0:1773851906.703148:0:60934:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.703149:0:60934:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:20.0:1773851906.703150:0:60934:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072667514432 : -1042037184 : ffffffffc1e3c640)
00000020:00000001:20.0:1773851906.703151:0:60934:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000001:00000001:20.0:1773851906.703151:0:60934:0:(tgt_lastrcvd.c:2255:tgt_lookup_reply()) lustre5-MDT0001: lookup reply xid 1858040492294656, found 0 last_xid 1858040492294655
00000020:00000001:20.0:1773851906.703152:0:60934:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:20.0:1773851906.703153:0:60934:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:20.0:1773851906.703154:0:60934:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:20.0:1773851906.703155:0:60934:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.703158:0:60934:0:(tgt_handler.c:1090:tgt_obd_ping()) Process entered
00000100:00000001:20.0:1773851906.703159:0:60934:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:20.0:1773851906.703159:0:60934:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:20.0:1773851906.703160:0:60934:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 480 at 000000005f9598dd.
02000000:00000001:20.0:1773851906.703161:0:60934:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.703162:0:60934:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.703162:0:60934:0:(tgt_handler.c:1105:tgt_obd_ping()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:20.0:1773851906.703163:0:60934:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183044158747, transno 0, xid 1858040492294656
00010000:00000001:20.0:1773851906.703164:0:60934:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:20.0:1773851906.703165:0:60934:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@0000000083e71aea x1858040492294656/t0(0) o400->0c8abac1-08b2-4ebd-94ea-b4eb21c770f0@16737@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1536-0'
00010000:00000001:20.0:1773851906.703168:0:60934:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:20.0:1773851906.703169:0:60934:0:(ldlm_lib.c:3217:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:20.0:1773851906.703169:0:60934:0:(import.c:1951:at_measured()) add 1 to 00000000898b15c5 time=139 v=66 (1 1 1 1)
00000100:00000001:20.0:1773851906.703170:0:60934:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:20.0:1773851906.703171:0:60934:0:(connection.c:145:ptlrpc_connection_addref()) conn=0000000032cab2e4 refcount 3 to 16737@kfi7
00000100:00000001:20.0:1773851906.703172:0:60934:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636917355106304 : -107156354445312 : ffff9e8ab78ed000)
02000000:00000001:20.0:1773851906.703173:0:60934:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:20.0:1773851906.703174:0:60934:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:20.0:1773851906.703174:0:60934:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:20.0:1773851906.703175:0:60934:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-16737@kfi7
00000400:00000010:20.0:1773851906.703176:0:60934:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 00000000a6c83aab.
00000100:00000200:20.0:1773851906.703177:0:60934:0:(niobuf.c:86:ptl_send_buf()) Sending 224 bytes to portal 10, xid 1858040492294656, offset 224
00000400:00000200:20.0:1773851906.703179:0:60934:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-16737@kfi7
00000400:00000200:20.0:1773851906.703179:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:20.0:1773851906.703180:0:60934:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 1
00000400:00000200:20.0:1773851906.703182:0:60934:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000400:00000200:20.0:1773851906.703183:0:60934:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 3
00000400:00000200:20.0:1773851906.703184:0:60934:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  16737@kfi7 local destination
00000400:00000200:20.0:1773851906.703186:0:60934:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770586:8770586:1024:4294967295] 16737@kfi7 LPNI seq info [87255:87255:16:4294967295]
00000400:00000200:20.0:1773851906.703187:0:60934:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000400:00000200:20.0:1773851906.703188:0:60934:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 16737@kfi7 to cpt 5
00000400:00000200:20.0:1773851906.703190:0:60934:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 16737@kfi7(16737@kfi7:16737@kfi7) <?> : PUT try# 0
00000400:00000200:20.0:1773851906.703193:0:60934:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 3
00000800:00000200:20.0:1773851906.703194:0:60934:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:5 Transaction ID 0 allocated
00000800:00000200:20.0:1773851906.703195:0:60934:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 KFILND_MSG_IMMEDIATE in 224 bytes in 1 frags
00000800:00000200:20.0:1773851906.703197:0:60934:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:20.0:1773851906.703200:0:60934:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000535 Using peer 16737@kfi7(0x100000000000535)
00000800:00000200:20.0:1773851906.703203:0:60934:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:5 Transaction ID 000000006987bf51: Posted send of 324 bytes to peer 0x100000000000535: rc=0
00000800:00000200:20.0:1773851906.703204:0:60934:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000535 TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:20.0:1773851906.703206:0:60934:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:20.0:1773851906.703207:0:60934:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=0000000032cab2e4 refcount 2 to 16737@kfi7
00010000:00000001:20.0:1773851906.703208:0:60934:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:20.0:1773851906.703209:0:60934:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:20.0:1773851906.703210:0:60934:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:20.0:1773851906.703210:0:60934:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@0000000083e71aea x1858040492294656/t0(0) o400->0c8abac1-08b2-4ebd-94ea-b4eb21c770f0@16737@kfi7:633/0 lens 224/224 e 0 to 0 dl 1773851993 ref 1 fl Interpret:H/0/0 rc 0/0 job:'default-tuolumne1536-0'
00000100:00100000:20.0:1773851906.703214:0:60934:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@0000000083e71aea pname:cluuid+ref:pid:xid:nid:opc:job mdt05_070:0c8abac1-08b2-4ebd-94ea-b4eb21c770f0+6:39638:x1858040492294656:12345-16737@kfi7:400:default-tuolumne1536-0 Request processed in 72us (126us total) trans 0 rc 0/0
00000100:00100000:20.0:1773851906.703216:0:60934:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-16737@kfi7, seq: 1998104
00000100:00000040:20.0:1773851906.703216:0:60934:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 000000009e5dbd74 : new rpc_count 0
00000100:00000001:20.0:1773851906.703217:0:60934:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:20.0:1773851906.703218:0:60934:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:20.0:1773851906.703218:0:60934:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000e9120fe6.
00000020:00000010:20.0:1773851906.703219:0:60934:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 000000008b2657fc.
00000020:00000010:20.0:1773851906.703220:0:60934:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 000000009ca7dbc5.
00000020:00000040:20.0:1773851906.703220:0:60934:0:(genops.c:882:class_export_put()) PUTting export 000000009e5dbd74 : new refcount 5
00000100:00000001:20.0:1773851906.703221:0:60934:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:21.0:1773851906.703226:0:2494373:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000535 TN_EVENT_TX_OK event status 0
00000400:00000200:21.0:1773851906.703228:0:2494373:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:21.0:1773851906.703229:0:2494373:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->16737@kfi7: PUT: OK
00000400:00000200:21.0:1773851906.703229:0:2494373:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 00000000a6c83aab
00000400:00000010:21.0:1773851906.703230:0:2494373:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 00000000a6c83aab.
00000100:00000001:21.0:1773851906.703231:0:2494373:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:21.0:1773851906.703231:0:2494373:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:21.0:1773851906.703232:0:2494373:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 0000000028a401f0 nid 16737@kfi7 refs 2
00000800:00000200:21.0:1773851906.703233:0:2494373:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 000000006987bf51: 2054@kfi7:5 -> 16737@kfi7(0000000073c33479):0x0 lsk 1334 rsk 51 tsk 0 trmk 0 tmk 0 trr 5 tta 0x100000000000535 Transaction freed
00000800:00000200:25.0:1773851906.794834:0:2494371:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:25.0:1773851906.794836:0:2494371:0:(kfilnd_tn.c:405:kfilnd_tn_process_rx_event()) 2054@kfi7:6 KFILND_MSG_IMMEDIATE transaction ID 0
00000800:00000200:25.0:1773851906.794838:0:2494371:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000800:00000200:25.0:1773851906.794842:0:2494371:0:(kfilnd_tn.c:833:kfilnd_tn_state_idle()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_STATE_IDLE -> TN_STATE_IMM_RECV state change
00000400:00000200:25.0:1773851906.794845:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851906.794847:0:2494371:0:(lib-move.c:4556:lnet_parse()) TRACE: 2054@kfi7(2054@kfi7) <- 2105@kfi7 : PUT - for me
00000400:00000200:25.0:1773851906.794848:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851906.794849:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:25.0:1773851906.794851:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:25.0:1773851906.794852:0:2494371:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:25.0:1773851906.794853:0:2494371:0:(peer.c:1376:lnet_peer_primary_nid_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:25.0:1773851906.794855:0:2494371:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2098@kfi7 to cpt 1
00000400:00000200:25.0:1773851906.794856:0:2494371:0:(lib-ptl.c:607:lnet_ptl_match_md()) Request from 12345-2098@kfi7 of length 224 into portal 24 MB=0x699e5ed46a600
00000400:00000200:25.0:1773851906.794859:0:2494371:0:(lib-ptl.c:233:lnet_try_match_md()) Incoming put index 18 from 12345-2098@kfi7 of length 224/224 into md 0x160dfce379 [256] + 15960
00000800:00000200:25.0:1773851906.794862:0:2494371:0:(kfilnd_tn.c:992:kfilnd_tn_state_imm_recv()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_RX_OK event status 0
00000400:00000200:25.0:1773851906.794864:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851906.794866:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000100:00000001:25.0:1773851906.794867:0:2494371:0:(events.c:307:request_in_callback()) Process entered
00000100:00000200:25.0:1773851906.794868:0:2494371:0:(events.c:317:request_in_callback()) event type 2, status 0, service mdt_out
00000100:00000010:25.0:1773851906.794869:0:2494371:0:(client.c:538:ptlrpc_request_cache_alloc()) slab-alloced 'req': 1120 at 000000007f874aa4.
00000100:00000040:25.0:1773851906.794870:0:2494371:0:(events.c:358:request_in_callback()) incoming req@000000007f874aa4 x1858062667654656 msgsize 224
00000100:00100000:25.0:1773851906.794872:0:2494371:0:(events.c:361:request_in_callback()) peer: 12345-2098@kfi7 (source: 12345-2105@kfi7)
00000100:00000001:25.0:1773851906.794874:0:2494371:0:(events.c:394:request_in_callback()) Process leaving
00000400:00000200:25.0:1773851906.794875:0:2494371:0:(lib-move.c:1297:lnet_return_rx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000100:00000001:24.0:1773851906.794876:0:1537164:0:(service.c:2069:ptlrpc_server_handle_req_in()) Process entered
00000800:00000200:25.0:1773851906.794877:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_INVALID TN 00000000aaa7c3d1: 2054@kfi7:6 <- 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 Transaction freed
02000000:00000001:24.0:1773851906.794877:0:1537164:0:(sec.c:2227:sptlrpc_svc_unwrap_request()) Process entered
00000100:00000001:24.0:1773851906.794878:0:1537164:0:(pack_generic.c:619:__lustre_unpack_msg()) Process entered
00000100:00000001:24.0:1773851906.794879:0:1537164:0:(pack_generic.c:637:__lustre_unpack_msg()) Process leaving (rc=0 : 0 : 0)
02000000:00000001:24.0:1773851906.794880:0:1537164:0:(sec.c:2275:sptlrpc_svc_unwrap_request()) Process leaving (rc=0 : 0 : 0)
00000100:00100000:24.0:1773851906.794881:0:1537164:0:(service.c:2152:ptlrpc_server_handle_req_in()) got req x1858062667654656
00000020:00000001:24.0:1773851906.794882:0:1537164:0:(genops.c:802:class_conn2export()) Process entered
00000020:00000040:24.0:1773851906.794882:0:1537164:0:(genops.c:814:class_conn2export()) looking for export cookie 0x21b6f0793ac91237
00000020:00000001:24.0:1773851906.794884:0:1537164:0:(lustre_handles.c:133:class_handle2object()) Process entered
00000020:00000040:24.0:1773851906.794885:0:1537164:0:(lustre_handles.c:151:class_handle2object()) GET export 00000000a887a120 refcount=5
00000020:00000001:24.0:1773851906.794887:0:1537164:0:(lustre_handles.c:158:class_handle2object()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000020:00000001:24.0:1773851906.794888:0:1537164:0:(genops.c:816:class_conn2export()) Process leaving (rc=18446636921240538112 : -107152469013504 : ffff9e8b9f25cc00)
00000100:00000001:24.0:1773851906.794890:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.794891:0:1537164:0:(service.c:1194:ptlrpc_update_export_timer()) Process leaving
00000020:00000010:24.0:1773851906.794892:0:1537164:0:(lu_object.c:1757:keys_init()) kmalloced '(ctx->lc_value)': 320 at 0000000042838b04.
00000020:00000010:24.0:1773851906.794894:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_init()) kmalloced '(value)': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.794895:0:1537164:0:(tgt_main.c:784:tgt_ses_key_init()) slab-alloced 'session': 168 at 00000000b0e18c80.
00000100:00000040:24.0:1773851906.794897:0:1537164:0:(service.c:1264:ptlrpc_at_set_timer()) armed mdt_out at +82s
00000100:00000001:24.0:1773851906.794898:0:1537164:0:(service.c:1812:ptlrpc_server_request_add()) Process entered
00000100:00000001:24.0:1773851906.794898:0:1537164:0:(service.c:1728:ptlrpc_server_hpreq_init()) Process entered
00000100:00000001:24.0:1773851906.794899:0:1537164:0:(service.c:1758:ptlrpc_server_hpreq_init()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.794901:0:1537164:0:(service.c:1901:ptlrpc_server_request_add()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.794903:0:1537164:0:(service.c:2230:ptlrpc_server_handle_req_in()) Process leaving (rc=1 : 1 : 1)
00000100:00000001:24.0:1773851906.794905:0:1537164:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:25.0:1773851906.794906:0:1691804:0:(service.c:2255:ptlrpc_server_handle_request()) Process entered
00000100:00000001:24.0:1773851906.794906:0:1537164:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00000001:25.0:1773851906.794907:0:1691804:0:(service.c:2018:ptlrpc_server_request_get()) Process entered
00000100:00100000:24.0:1773851906.794907:0:1537164:0:(nrs_fifo.c:179:nrs_fifo_req_get()) NRS start fifo request from 12345-2098@kfi7, seq: 5799993
00000100:00000040:24.0:1773851906.794908:0:1537164:0:(service.c:2049:ptlrpc_server_request_get()) RPC GETting export 00000000a887a120 : new rpc_count 1
00000100:00000001:25.0:1773851906.794909:0:1691804:0:(service.c:2039:ptlrpc_server_request_get()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:25.0:1773851906.794910:0:1691804:0:(service.c:2259:ptlrpc_server_handle_request()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.794910:0:1537164:0:(service.c:2051:ptlrpc_server_request_get()) Process leaving (rc=18446636996227512960 : -107077482038656 : ffff9e9d14b83a80)
00000100:00000040:24.0:1773851906.794912:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from New to Interpret  req@000000007f874aa4 x1858062667654656/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:633/0 lens 224/0 e 0 to 0 dl 1773851993 ref 1 fl New:/0/ffffffff rc 0/-1 job:'default-yuba6-0'
00000100:00000001:24.0:1773851906.794916:0:1537164:0:(service.c:1118:ptlrpc_update_export_timer()) Process entered
00000100:00000001:24.0:1773851906.794917:0:1537164:0:(service.c:1133:ptlrpc_update_export_timer()) Process leaving
00000100:00100000:24.0:1773851906.794918:0:1537164:0:(service.c:2324:ptlrpc_server_handle_request()) Handling RPC req@000000007f874aa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667654656:12345-2098@kfi7:41:default-yuba6-0
00000100:00000200:24.0:1773851906.794920:0:1537164:0:(service.c:2329:ptlrpc_server_handle_request()) got req 1858062667654656
00000020:00000001:24.0:1773851906.794921:0:1537164:0:(tgt_handler.c:737:tgt_request_handle()) Process entered
00000020:00000001:24.0:1773851906.794922:0:1537164:0:(tgt_handler.c:657:process_req_last_xid()) Process entered
00000020:00000001:24.0:1773851906.794923:0:1537164:0:(tgt_handler.c:722:process_req_last_xid()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.794924:0:1537164:0:(tgt_handler.c:614:tgt_handler_find_check()) Process entered
00000020:00000001:24.0:1773851906.794925:0:1537164:0:(tgt_handler.c:647:tgt_handler_find_check()) Process leaving (rc=18446744072673658944 : -1035892672 : ffffffffc2418840)
00000020:00000001:24.0:1773851906.794927:0:1537164:0:(tgt_handler.c:553:tgt_handle_recovery()) Process entered
00000020:00000001:24.0:1773851906.794927:0:1537164:0:(tgt_handler.c:603:tgt_handle_recovery()) Process leaving (rc=1 : 1 : 1)
00000020:00000001:24.0:1773851906.794928:0:1537164:0:(tgt_handler.c:388:tgt_handle_request0()) Process entered
00000020:00000001:24.0:1773851906.794929:0:1537164:0:(tgt_handler.c:310:tgt_request_preprocess()) Process entered
00000020:00000001:24.0:1773851906.794930:0:1537164:0:(tgt_handler.c:372:tgt_request_preprocess()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.794931:0:1537164:0:(pack_generic.c:314:lustre_pack_reply_v2()) Process entered
02000000:00000001:24.0:1773851906.794932:0:1537164:0:(sec.c:2289:sptlrpc_svc_alloc_rs()) Process entered
02000000:00000010:24.0:1773851906.794933:0:1537164:0:(sec_null.c:314:null_alloc_rs()) kmalloced '(rs)': 624 at 00000000d1951e94.
02000000:00000001:24.0:1773851906.794934:0:1537164:0:(sec.c:2326:sptlrpc_svc_alloc_rs()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.794935:0:1537164:0:(pack_generic.c:349:lustre_pack_reply_v2()) Process leaving (rc=0 : 0 : 0)
00000004:00000001:24.0:1773851906.794937:0:1537164:0:(mdt_handler.c:477:mdt_statfs()) Process entered
00000004:00000001:24.0:1773851906.794937:0:1537164:0:(mdt_lib.c:411:mdt_check_ucred()) Process entered
00000004:00000001:24.0:1773851906.794938:0:1537164:0:(mdt_lib.c:418:mdt_check_ucred()) Process leaving (rc=0 : 0 : 0)
00080000:00000001:24.0:1773851906.794940:0:1537164:0:(osd_handler.c:559:osd_statfs()) Process entered
00080000:00000001:24.0:1773851906.794941:0:1537164:0:(osd_handler.c:574:osd_statfs()) Process leaving (rc=0 : 0 : 0)
00000004:00000024:24.0:1773851906.794943:0:1537164:0:(mdt_handler.c:548:mdt_statfs()) blocks cached 431751168 granted 1839581985855 pending 396361728 free 126633370845184 avail 126633368748032
00000004:00000020:24.0:1773851906.794947:0:1537164:0:(mdt_handler.c:558:mdt_statfs()) 1054255461 blocks: 966135947 free, 966129613 avail; 3492774874 objects: 3200325324 free; state 0
00000004:00000001:24.0:1773851906.794950:0:1537164:0:(mdt_handler.c:577:mdt_statfs()) Process leaving (rc=0 : 0 : 0)
00010000:00000040:24.0:1773851906.794951:0:1537164:0:(ldlm_lib.c:3184:target_committed_to_req()) last_committed 183262994522, transno 0, xid 1858062667654656
00010000:00000001:24.0:1773851906.794952:0:1537164:0:(ldlm_lib.c:3253:target_send_reply()) Process entered
00010000:00000200:24.0:1773851906.794953:0:1537164:0:(ldlm_lib.c:3241:target_send_reply_msg()) @@@ sending reply  req@000000007f874aa4 x1858062667654656/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:633/0 lens 224/368 e 0 to 0 dl 1773851993 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00010000:00000001:24.0:1773851906.794958:0:1537164:0:(ldlm_lib.c:3196:target_pack_pool_reply()) Process entered
00010000:00000001:24.0:1773851906.794958:0:1537164:0:(ldlm_lib.c:3206:target_pack_pool_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00001000:24.0:1773851906.794960:0:1537164:0:(import.c:1951:at_measured()) add 1 to 00000000355ab0da time=33 v=66 (1 1 1 1)
00000100:00000001:24.0:1773851906.794961:0:1537164:0:(connection.c:140:ptlrpc_connection_addref()) Process entered
00000100:00000040:24.0:1773851906.794963:0:1537164:0:(connection.c:145:ptlrpc_connection_addref()) conn=000000007d6515c0 refcount 7 to 2098@kfi7
00000100:00000001:24.0:1773851906.794964:0:1537164:0:(connection.c:147:ptlrpc_connection_addref()) Process leaving (rc=18446636918863572448 : -107154845979168 : ffff9e8b11782de0)
02000000:00000001:24.0:1773851906.794965:0:1537164:0:(sec.c:2340:sptlrpc_svc_wrap_reply()) Process entered
02000000:00000001:24.0:1773851906.794966:0:1537164:0:(sec.c:2351:sptlrpc_svc_wrap_reply()) Process leaving (rc=0 : 0 : 0)
00000100:00000001:24.0:1773851906.794967:0:1537164:0:(niobuf.c:55:ptl_send_buf()) Process entered
00000100:00000040:24.0:1773851906.794968:0:1537164:0:(niobuf.c:58:ptl_send_buf()) peer_id 12345-2105@kfi7
00000400:00000010:24.0:1773851906.794969:0:1537164:0:(lib-md.c:185:lnet_md_build()) slab-alloced 'md' of size 136 at 000000004f9a0eed.
00000100:00000200:24.0:1773851906.794970:0:1537164:0:(niobuf.c:86:ptl_send_buf()) Sending 368 bytes to portal 4, xid 1858062667654656, offset 224
00000400:00000200:24.0:1773851906.794972:0:1537164:0:(lib-move.c:5065:LNetPut()) LNetPut -> 12345-2105@kfi7
00000400:00000200:24.0:1773851906.794974:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.794975:0:1537164:0:(peer.c:712:lnet_get_peer_ni_locked()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 1
00000400:00000200:24.0:1773851906.794976:0:1537164:0:(lib-move.c:2091:lnet_initiate_peer_discovery()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851906.794978:0:1537164:0:(lib-move.c:2101:lnet_initiate_peer_discovery()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000400:00000200:24.0:1773851906.794980:0:1537164:0:(lib-move.c:2899:lnet_handle_send_case_locked()) Source Specified: 2054@kfi7 to MR:  2105@kfi7 local destination
00000400:00000200:24.0:1773851906.794982:0:1537164:0:(lib-move.c:1863:lnet_handle_send()) 2054@kfi7 NI seq info: [8770587:8770587:1024:4294967295] 2105@kfi7 LPNI seq info [20346220:20346220:16:4294967295]
00000400:00000200:24.0:1773851906.794984:0:1537164:0:(lib-move.c:1869:lnet_handle_send()) lnet_peer_ni_addref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000400:00000200:24.0:1773851906.794985:0:1537164:0:(api-ni.c:1551:lnet_nid4_cpt_hash()) Match nid 2105@kfi7 to cpt 6
00000400:00000200:24.0:1773851906.794988:0:1537164:0:(lib-move.c:1975:lnet_handle_send()) TRACE: 2054@kfi7(2054@kfi7:2054@kfi7) -> 2105@kfi7(2105@kfi7:2105@kfi7) <?> : PUT try# 0
00000400:00000200:24.0:1773851906.794990:0:1537164:0:(lib-move.c:3113:lnet_select_pathway()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 3
00000800:00000200:24.0:1773851906.794992:0:1537164:0:(kfilnd_tn.c:1624:kfilnd_tn_alloc_common()) 2054@kfi7:6 Transaction ID 0 allocated
00000800:00000200:24.0:1773851906.794994:0:1537164:0:(kfilnd.c:236:kfilnd_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 KFILND_MSG_IMMEDIATE in 368 bytes in 1 frags
00000800:00000200:24.0:1773851906.794998:0:1537164:0:(kfilnd_tn.c:667:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x0 TN_EVENT_INIT_IMMEDIATE event status 0
00000800:00000200:24.0:1773851906.795002:0:1537164:0:(kfilnd_tn.c:730:kfilnd_tn_state_idle()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c Using peer 2105@kfi7(0x20000000000085c)
00000800:00000200:24.0:1773851906.795006:0:1537164:0:(kfilnd_ep.c:439:kfilnd_ep_post_send()) 2054@kfi7:6 Transaction ID 00000000358ab717: Posted send of 468 bytes to peer 0x20000000000085c: rc=0
00000800:00000200:24.0:1773851906.795008:0:1537164:0:(kfilnd_tn.c:317:kfilnd_tn_state_change()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c TN_STATE_IDLE -> TN_STATE_IMM_SEND state change
00000100:00000001:24.0:1773851906.795012:0:1537164:0:(niobuf.c:103:ptl_send_buf()) Process leaving (rc=0 : 0 : 0)
00000100:00000040:24.0:1773851906.795015:0:1537164:0:(lustre_net.h:1943:ptlrpc_connection_put()) PUT conn=000000007d6515c0 refcount 6 to 2098@kfi7
00010000:00000001:24.0:1773851906.795016:0:1537164:0:(ldlm_lib.c:3265:target_send_reply()) Process leaving
00000020:00000001:24.0:1773851906.795017:0:1537164:0:(tgt_handler.c:504:tgt_handle_request0()) Process leaving (rc=0 : 0 : 0)
00000020:00000001:24.0:1773851906.795018:0:1537164:0:(tgt_handler.c:854:tgt_request_handle()) Process leaving
00000100:00000040:24.0:1773851906.795019:0:1537164:0:(lustre_net.h:2402:ptlrpc_rqphase_move()) @@@ move request phase from Interpret to Complete  req@000000007f874aa4 x1858062667654656/t0(0) o41->lustre5-MDT0005-mdtlov_UUID@2098@kfi7:633/0 lens 224/368 e 0 to 0 dl 1773851993 ref 1 fl Interpret:/0/0 rc 0/0 job:'default-yuba6-0'
00000100:00100000:24.0:1773851906.795024:0:1537164:0:(service.c:2372:ptlrpc_server_handle_request()) Handled RPC req@000000007f874aa4 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out06_025:lustre5-MDT0005-mdtlov_UUID+5:52189:x1858062667654656:12345-2098@kfi7:41:default-yuba6-0 Request processed in 107us (153us total) trans 0 rc 0/0
00000100:00100000:24.0:1773851906.795028:0:1537164:0:(nrs_fifo.c:241:nrs_fifo_req_stop()) NRS stop fifo request from 12345-2098@kfi7, seq: 5799993
00000100:00000040:24.0:1773851906.795029:0:1537164:0:(service.c:1103:ptlrpc_server_finish_active_request()) RPC PUTting export 00000000a887a120 : new rpc_count 0
00000100:00000001:24.0:1773851906.795030:0:1537164:0:(service.c:1764:ptlrpc_server_hpreq_fini()) Process entered
00000100:00000001:24.0:1773851906.795031:0:1537164:0:(service.c:1775:ptlrpc_server_hpreq_fini()) Process leaving
00000020:00000010:24.0:1773851906.795032:0:1537164:0:(lu_ucred.c:48:lu_ucred_key_fini()) kfreed 'info': 120 at 00000000c826f230.
00000020:00000010:24.0:1773851906.795033:0:1537164:0:(tgt_main.c:796:tgt_ses_key_fini()) slab-freed '(session)': 168 at 00000000b0e18c80.
00000020:00000010:24.0:1773851906.795035:0:1537164:0:(lu_object.c:1689:keys_fini()) kfreed 'ctx->lc_value': 320 at 0000000042838b04.
00000020:00000040:24.0:1773851906.795036:0:1537164:0:(genops.c:882:class_export_put()) PUTting export 00000000a887a120 : new refcount 4
00000100:00000001:24.0:1773851906.795037:0:1537164:0:(service.c:2392:ptlrpc_server_handle_request()) Process leaving (rc=1 : 1 : 1)
00000800:00000200:25.0:1773851906.795044:0:2494371:0:(kfilnd_tn.c:952:kfilnd_tn_state_imm_send()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c TN_EVENT_TX_OK event status 0
00000400:00000200:25.0:1773851906.795047:0:2494371:0:(lib-msg.c:1070:lnet_is_health_check()) health check = 1, status = 0, hstatus = 0
00000400:00000200:25.0:1773851906.795048:0:2494371:0:(lib-msg.c:838:lnet_health_check()) health check: 2054@kfi7->2105@kfi7: PUT: OK
00000400:00000200:25.0:1773851906.795050:0:2494371:0:(lib-md.c:68:lnet_md_unlink()) Unlinking md 000000004f9a0eed
00000400:00000010:25.0:1773851906.795050:0:2494371:0:(lib-lnet.h:313:lnet_md_free()) slab-freed 'md' at 000000004f9a0eed.
00000100:00000001:25.0:1773851906.795051:0:2494371:0:(events.c:407:reply_out_callback()) Process entered
00000100:00000001:25.0:1773851906.795052:0:2494371:0:(events.c:419:reply_out_callback()) Process leaving
00000400:00000200:25.0:1773851906.795053:0:2494371:0:(lib-move.c:1151:lnet_return_tx_credits_locked()) lnet_peer_ni_decref_locked 000000008ff279a2 nid 2105@kfi7 refs 2
00000800:00000200:25.0:1773851906.795055:0:2494371:0:(kfilnd_tn.c:1554:kfilnd_tn_free()) KFILND_MSG_IMMEDIATE TN 00000000358ab717: 2054@kfi7:6 -> 2105@kfi7(00000000967e7897):0x0 lsk 2141 rsk 4798 tsk 0 trmk 0 tmk 0 trr 6 tta 0x20000000000085c Transaction freed
Debug log: 227138 lines, 227138 kept, 0 dropped, 0 bad.
